diff --git a/.gitignore b/.gitignore index 44318fa..611e5d8 100644 --- a/.gitignore +++ b/.gitignore @@ -3,6 +3,8 @@ dist/ .astro/ .DS_Store *.log +__pycache__/ +*.pyc # Local primary-source cache. The public repository stores canonical URLs, # checksums and research notes instead of redistributing downloaded papers. diff --git a/PROGRESS.md b/PROGRESS.md index 47a4c8c..f961c90 100644 --- a/PROGRESS.md +++ b/PROGRESS.md @@ -14,7 +14,7 @@ | 表示、位置与残差高速公路 | 完成首版 | 81% | 真实 hidden-state / norm traces、长上下文位置外推与深层稳定性消融 | | Scaling Laws | 完成首版 | 74% | 真实拟合复现、置信区间与更多模型族对照 | | 数据工程与预训练配方 | 完成首版 | 73% | FineWeb / DCLM 逐图精读、真实去重误伤与 mixture traces | -| DeepSeek 专题 | 四轮实证进行中 | 98% | completion-aware 生成评测、完整 27 层与固定 batch-content 对照,再推进 SM90 FlashMLA、FP8/pipeline 与 R1-like RL 复现 | +| DeepSeek 专题 | 五轮实证进行中 | 99% | 扩大 completion/task 样本与 sampling 复现,再推进 SM90 FlashMLA、FP8/pipeline、干预式 mediation 与 R1-like RL 复现 | | 指令微调与人类偏好 | 完成首版 | 75% | 真实偏好分歧、RM 长度偏置与 PPO/DPO 小模型复现 | | 推理与测试时扩展 | 完成首版 | 76% | 真实模型采样曲线、PRM 案例与逐篇图表精读 | | 工具使用与长程 Agent | 完成首版 | 74% | 真实环境 traces、cross-harness 对照、Agent RL 曲线与安全案例 | @@ -41,7 +41,7 @@ - [x] 完成 486 篇关键论文索引,覆盖 16 个标签专题与 Kimi/DeepSeek 聚光主线。 - [x] 完成可检索、可按专题筛选的论文库页面。 - [x] 完成 K3、语言模型前史、Transformer 基础、表示/位置/残差、DeepSeek 谱系、Scaling Laws、数据工程、长上下文、MoE、指令微调与人类偏好、推理、Agent、原生多模态、训练系统、推理服务、数值优化与评测安全十七篇首版长文。 -- [x] 完成 K3 三轴架构、八联报告实验与四联开放工件实验、语言模型前史四联实验、Transformer 四联实验、表示深度四联实验、DeepSeek 十八联实验、长上下文、MoE 路由、推理三页签,以及训练系统、推理服务、Scaling、数据工程、数值、Alignment、Agent、原生多模态与评测安全专题各四页签等八十五个原创交互视图。 +- [x] 完成 K3 三轴架构、八联报告实验与四联开放工件实验、语言模型前史四联实验、Transformer 四联实验、表示深度四联实验、DeepSeek 十九联实验、长上下文、MoE 路由、推理三页签,以及训练系统、推理服务、Scaling、数据工程、数值、Alignment、Agent、原生多模态与评测安全专题各四页签等八十六个原创交互视图。 - [x] 完成长上下文首版:五张成本账、26 篇一手论文、10+ 机制图与 8 策略交互实验室。 - [x] 核验 FlashAttention、DeepSeek-V2/V3.2/V4、Kimi Linear/K3 等六份论文原文,并建立长上下文研究账本。 - [x] 核验 Switch、ST-MoE、DeepSeekMoE、Loss-Free、V3、LatentMoE 与 K3 原文,并建立 MoE 研究账本。 @@ -241,11 +241,17 @@ - [x] 第十八个 DeepSeek 交互实验将逐来源双输出、十边分歧图、29 单元设备切分与证据阶梯放到同一页;compact 构建器同时校验固定 revision、官方工件 hash 与 32 / 32 长复现合同。 - [x] DeepSeek Chat 行为层本地闸门通过:75 个 Astro 文件零诊断,21 个页面、1,151 个站内引用、12 个跨页锚点零失败;十四页签桌面与 390px 移动端无运行时异常或文档级横向溢出,十六套真实 Chrome 专题回归全部通过。 - [x] DeepSeek Chat 行为层以源提交 `96443d4`、不可变镜像 `20260729T144827Z-96443d4` 发布;OCI digest `sha256:9468b546…db214`,复用 NAS `12010→8080`、NPM host 31 / cert 41、门户 `LLM ATLAS / projects / 180`,HTTPS、HTTP/2 与十六套生产 Chrome 回归全通过;保留 `20260729T134520Z-1d0a331` 回滚。 +- [x] DeepSeek Round 05 预注册统一 512-token 预算,不选择性续写 97 个截断格;29 GiB formal OOM 发生在写 JSON 前,透明修订为 28 GiB static placement、GPU layers 0–23 + layers 24–26/norm/head offload,并以 29→28 GiB smoke 的 32 / 32 完整 token exact 闸门确认放置不改输出。 +- [x] 512-token formal 对 128 / 128 prompt hashes 与前 128 generated-token prefixes 全部 exact;自然 EOS 从 31 / 128 增至 121 / 128,仍有 7 格截断。GSM8K strict-complete numeric exact 为 23 / 32;HumanEval 在 pinned、无网络、只读、无 host mount 的逐 candidate 容器中 24 / 32 通过官方 tests。 +- [x] 512-token 新进程复跑覆盖每域第 1 条的 32 格,完整 generated token IDs、decoded text、EOS 与 truncation state 均 32 / 32 exact;不冒充 128 / 128 全覆盖。 +- [x] 完成相同 Chat checkpoint 的 prompt-only 全深度 trace:embedding + 27 decoder layers + final norm 共 29 阶段,26 个 MoE gate;1,537 个精确 interior content tokens / condition 产生 1,918,176 次 target top-6 route decisions,56 个 boundary-crossing tokens 明确排除。 +- [x] 全深度新进程复跑的 4 / 4 source objects(去 runtime 后)、1,856 / 1,856 hidden tensor hashes、1,664 / 1,664 ordered-route hashes 与 1,664 / 1,664 route-weight hashes 全部 exact;复现核对抓到并修正 source-level content-token hash 的循环变量缺陷,正式与复跑文件随后全部重跑。 +- [x] 第十九个 DeepSeek 交互实验用四页签分开 128→512 completion、Math/Code evaluator、29-stage hidden divergence 与 26-gate route divergence;桌面、390px 移动端、键盘 tab、分域/分边/分指标交互与无横向溢出闸门通过。 ## 正在进行 - [ ] K3 三轮下一闸门:获得真实 token hidden states、expert load 与 cache traces,解释或修订 `A_log [128]` 工件冲突,再做 Figure 3/4/5 数值重绘和独立小模型复现。 -- [ ] DeepSeek 四轮下一闸门:把 31 / 128 completion 提升为长度分层、可执行 evaluator 与更长生成预算;扩到完整 27 层并固定 batch content 审计,再推进 SM90 FlashMLA、FP8 / pipeline traces 与 R1-like RL 小模型复现。 +- [ ] DeepSeek 五轮下一闸门:扩大 GSM8K/HumanEval 与语言 source 样本,加入 sampling robustness 和干预式 mediation;再推进 SM90 FlashMLA、FP8 / pipeline traces 与 R1-like RL 小模型复现。 - [ ] 表示、位置与残差二轮:真实 hidden-state / norm traces、长上下文位置外推复现与 mHC / AttnRes 深层稳定性消融。 - [ ] 评测安全二轮:真实 cross-harness / pass@k 复跑、Judge 元评测、动态污染与过拒案例。 - [ ] 推理服务二轮:真实 GPU kernel / workload traces、功耗与成本、跨 vLLM / SGLang / TensorRT-LLM 复现。 @@ -404,6 +410,11 @@ | 2026-07-29 | 生成实验把 completion 设为首要审计字段 | 31 / 128 自然 EOS 与 97 / 128 长度截断分开报告;截断输出不被当作完整答案参与越界判断 | | 2026-07-29 | CPU offload 是执行拓扑而非模型属性 | 31.4 GB BF16 工件不因本机 25-GPU-layer / 2-CPU-layer 切分而改变模型身份;设备映射、参数字节与峰值显存都进入复现合同 | | 2026-07-29 | DeepSeek Chat 行为层以 `20260729T144827Z-96443d4` 发布 | OCI digest `sha256:9468b546…db214`;复用 NAS 12010→8080、NPM 31 / cert 41、门户 order 180;十六套生产 Chrome 回归通过,保留上一不可变镜像回滚 | +| 2026-07-29 | 更长预算必须统一重跑全部条件 | 不只续写先前截断格;128→512 的 128 / 128 prompt 与 generated-prefix exact 进入正式结果闸门 | +| 2026-07-29 | 停止、任务终点、可评测与正确分四张账 | 自然 EOS 不等于正确;fallback 不冒充 strict completion;HumanEval tests pass 不冒充代码安全 | +| 2026-07-29 | 全深度目标范围排除 boundary-crossing tokens | 八格目标内容先验证 token IDs exact,再比较 1,537 个完全位于字符区间内部的 tokens;56 个相交 token 明确剔除 | +| 2026-07-29 | hidden/router association 不升级为 mediation | 29-stage 表示曲线与 26-gate route 曲线描述传播路径;没有干预式中介实验前不解释能力因果 | +| 2026-07-29 | 复跑逐字段覆盖身份元数据 | source-level hash 的循环变量缺陷虽不影响激活/路由结论,仍修复并重跑正式与复现文件;不只比较 headline 数字 | | 2026-07-29 | K3 二轮按 32 张对象账与完整报告顺序重建 | total/active、2.5×、KDA state、深度来源、专家路由、视觉目标、轨迹、缓存与评测协议不再压成一页组件摘要 | | 2026-07-29 | K3 原生视觉事实回到 §2.4 / §3.3 核验 | 删除“先冻结语言模型再解冻”旧表述;明确 MoonViT-V2 从头训练,视觉/文本从开始共同 NTP | | 2026-07-29 | K3 Figure 1–16 / Table 1–5 全部建立课程视觉契约 | 每张图同时写支持范围与不可外推项;作者报告、论文、推导与 toy model 使用 R/P/D/T 标签 | diff --git a/README.md b/README.md index 1d12d2a..18525ad 100644 --- a/README.md +++ b/README.md @@ -19,7 +19,7 @@ 当前里程碑包含 17 专题学习地图、486 篇关键论文索引、Kimi K3 完整导读, 语言模型前史、Transformer 基础、表示/位置/残差、DeepSeek 技术谱系、Scaling Laws、数据工程、长上下文、MoE、指令微调与人类偏好、推理、工具使用与长程 Agent、原生多模态、训练系统、推理服务、数值优化,以及评测与安全深度专题, -以及 85 个覆盖核心机制的原创交互视图。K3 二轮导读以 32 张问题账、16 图 / 5 表审计、 +以及 86 个覆盖核心机制的原创交互视图。K3 二轮导读以 32 张问题账、16 图 / 5 表审计、 8 个交互实验和 100 个一手/官方节点,完整覆盖架构、预训练、后训练、系统、评测、案例与附录。 第三轮已完成开放工件与首个真实 kernel 里程碑:固定官方模型与 FlashKDA revisions,审计 96 个 checkpoint shards、 497,220 个 tensor entries、真实 KDA / MLA / MoE / MoonViT shapes 与小范围参数统计,并用 4 个新视图 @@ -27,8 +27,8 @@ `sm_120a` wheel,在 RTX 5090 上完成 6/6 官方参考 exact-match 和 K3 fixed / varlen 形状计时。详见 [K3_ARTIFACT_AUDIT.md](./research/K3_ARTIFACT_AUDIT.md) 与 [checkpoint_probe.py](./experiments/k3/checkpoint_probe.py)、[FlashKDA probe](./experiments/k3/flashkda/)。 -DeepSeek 四轮专题以 24 张问题账、10 次技术转向、 -18 个交互实验和 60 个一手/官方节点,串起 Dense、MoE、MLA、V3 协同、R1 与 V4; +DeepSeek 五轮专题以 24 张问题账、10 次技术转向、 +19 个交互实验和 60 个一手/官方节点,串起 Dense、MoE、MLA、V3 协同、R1 与 V4; 并固定官方 V2-Lite revision,在 RTX 5090 上连续执行 7/27 层,记录 3,240 次真实专家选择、 MLA/HF eager cache shapes 与 `31/31` exact 独立复跑;进一步用真实 layer-1 权重执行官方 V3 naive/absorb 路径,实际写入 576 元素 latent cache,并以 FP32 将两种结合顺序的最大误差压到 @@ -64,7 +64,15 @@ Round 04 又固定官方 `DeepSeek-V2-Lite-Chat` revision,加载 31.4 GB 完 边界条件,共 128 个 greedy 输出;四域中 31 个自然命中 EOS、97 个在 128 新 token 上限处截断,因此只把十条成对边写成“生成分歧”,不把它们冒充能力评测。每域独立抽取 1 个来源的 32 个输出再次运行,prompt hash、生成 token IDs、文本与 EOS 状态均为 -`32 / 32` exact。FlashMLA 的 SM90/SM100 官方支持矩阵与本机 SM120 边界单独记账。详见 +`32 / 32` exact。FlashMLA 的 SM90/SM100 官方支持矩阵与本机 SM120 边界单独记账。 +Round 05 再让全部 128 格统一使用 512-token 预算:自然 EOS 从 `31 / 128` 提升到 +`121 / 128`,剩余 7 格仍按截断处理;GSM8K 严格完成且数值 exact 为 `23 / 32`, +HumanEval 官方 tests pass 为 `24 / 32`,四任务/域不外推为 benchmark。相同 Chat +checkpoint 又执行 embedding、27 层、final norm 与 26 个 MoE gate 的 prompt-only +全深度 trace,在 1,537 个精确 interior content tokens / condition 上记录 +1,918,176 次 top-6 路由决定。新进程子集复跑达到 `1,856 / 1,856` hidden tensor hashes、 +`1,664 / 1,664` ordered route hashes 与 `1,664 / 1,664` route-weight hashes exact。 +详见 [DEEPSEEK_V2_LITE_TRACE.md](./research/DEEPSEEK_V2_LITE_TRACE.md) 与 [DEEPSEEK_MLA_ABSORB_AUDIT.md](./research/DEEPSEEK_MLA_ABSORB_AUDIT.md)、 [DEEPSEEK_ROUTING_CORPUS_AUDIT.md](./research/DEEPSEEK_ROUTING_CORPUS_AUDIT.md)、 @@ -76,7 +84,8 @@ Round 04 又固定官方 `DeepSeek-V2-Lite-Chat` revision,加载 31.4 GB 完 [DEEPSEEK_ROUTING_ROLE_MARKER_HEAD_AUDIT.md](./research/DEEPSEEK_ROUTING_ROLE_MARKER_HEAD_AUDIT.md)、 [DEEPSEEK_ROUTING_SPECIAL_TOKEN_FAMILY_AUDIT.md](./research/DEEPSEEK_ROUTING_SPECIAL_TOKEN_FAMILY_AUDIT.md) 与 [DEEPSEEK_ROUTING_ROLE_MARKER_BLOCK_AUDIT.md](./research/DEEPSEEK_ROUTING_ROLE_MARKER_BLOCK_AUDIT.md),以及 -[DEEPSEEK_V2_LITE_CHAT_BEHAVIOR_AUDIT.md](./research/DEEPSEEK_V2_LITE_CHAT_BEHAVIOR_AUDIT.md)。 +[DEEPSEEK_V2_LITE_CHAT_BEHAVIOR_AUDIT.md](./research/DEEPSEEK_V2_LITE_CHAT_BEHAVIOR_AUDIT.md) 与 +[DEEPSEEK_V2_LITE_CHAT_COMPLETION_DEPTH_AUDIT.md](./research/DEEPSEEK_V2_LITE_CHAT_COMPLETION_DEPTH_AUDIT.md)。 其余专题按进度账本持续扩建。 ## 本地开发 diff --git a/ROADMAP.md b/ROADMAP.md index b9c53b2..14e996d 100644 --- a/ROADMAP.md +++ b/ROADMAP.md @@ -100,10 +100,12 @@ SFT / RM / PPO / DPO / RLAIF / RLVR 的角色合同,重点追踪 DeepSeek LLM CoT、自洽性、搜索、验证器、过程奖励、GRPO、DeepSeekMath、DeepSeek-R1/R1-Zero、Kimi k1.5、multi-effort RL 与 on-policy distillation。 -DeepSeek 聚光二轮已完成:以 24 张问题账和 10 次问题转向,串起 DeepSeek LLM、DeepSeekMoE、 +DeepSeek 聚光五轮持续推进:以 24 张问题账和 10 次问题转向,串起 DeepSeek LLM、DeepSeekMoE、 DeepSeekMath、V2、V3、R1-Zero/R1、V3.2 与 V4;DAPO / Dr.GRPO 明确作为公开后续反查, Coder/Prover/VL/OCR/系统实现/Engram 作为旁支。配套稀疏容量、MLA 缓存、V3 协同与 RL 偏差四个实验, -并以 60 个一手论文或官方仓库节点连接 Kimi K2/K3。 +并以 60 个一手论文或官方仓库节点连接 Kimi K2/K3;真实权重线已从 Base 前七层、吸收缓存和 +11,289,744 次公开语料路由,推进到完整 Chat 生成、统一 512-token completion evaluator、 +29-stage hidden-state 与 26-gate router trace。 ### 12. 工具使用与长程 Agent @@ -156,7 +158,7 @@ pass^k、校准、动态基准、代码 Verifier、LLM Judge、Arena、Agent 最 1. **Kimi K3 解剖**:二轮已完成 32 张问题账、Figure 1–16 / Table 1–5 审计、 8 个报告实验与 100 节点阅读链;三轮首个里程碑进一步固定官方 revisions,审计 96 个 checkpoint shards、 497,220 个 tensor entries、真实 KDA / MLA / MoE / MoonViT shapes,并用 4 个工件视图公开复现边界。 -2. **DeepSeek 技术谱系**:DeepSeek LLM → DeepSeekMoE → V2/MLA → V3/FP8/MTP/DualPipe → Math/GRPO → R1 → V3.2/DSA → V4 长上下文;四轮已经从 24 张问题账、60 个一手/官方节点和 4 个公式实验,推进到 13 个 Base 工件实验与 1 个完整 Chat 行为实验。最新生成层固定 31.4 GB 官方 V2-Lite-Chat BF16 权重,以 16 个来源 × 8 条件得到 128 个输出,并把自然 EOS、长度截断、成对分歧和 32 / 32 独立复现分账。 +2. **DeepSeek 技术谱系**:DeepSeek LLM → DeepSeekMoE → V2/MLA → V3/FP8/MTP/DualPipe → Math/GRPO → R1 → V3.2/DSA → V4 长上下文;五轮已经从 24 张问题账、60 个一手/官方节点和 4 个公式实验,推进到 13 个 Base 工件实验、完整 Chat 行为与 completion/full-depth 实验。最新一轮让 16 个来源 × 8 条件统一使用 512-token 预算,分开报告 121 / 128 自然 EOS、Math/Code evaluator 与 32 / 32 长序列复现;同一 checkpoint 的 29-stage hidden / 26-gate route trace 覆盖 1,918,176 次目标路由决定,并以 5,184 个新进程哈希 exact 收口。 3. **“一个 Token 的旅行”**:从文本分词,经注意力、MoE、GPU 集群、后训练,再到线上推理与工具调用。 ## 完成标准 diff --git a/experiments/deepseek/README.md b/experiments/deepseek/README.md index f79e40b..4703339 100644 --- a/experiments/deepseek/README.md +++ b/experiments/deepseek/README.md @@ -586,3 +586,89 @@ See `research/DEEPSEEK_V2_LITE_CHAT_BEHAVIOR_PROTOCOL.md` and `research/DEEPSEEK_V2_LITE_CHAT_BEHAVIOR_AUDIT.md` for the preregistered contract, output-divergence table, offload device map, truncation boundary, rerun coverage, execution fixes, primary sources, and forbidden conclusions. + +## Completion-aware 512-token evaluation + +The completion run uses the same 16 sources and eight-condition batches but +reruns all 128 cells with one uniform 512-token budget. The successful formal +placement leaves embeddings and layers 0–23 on CUDA and offloads layers 24–26, +final norm, and LM head. `expandable_segments:True` is part of the recorded +runtime contract. + +```bash +PYTORCH_CUDA_ALLOC_CONF=expandable_segments:True \ +PYTHONPATH=/path/to/transformers-4.41.2-deps \ +python -B experiments/deepseek/v2_lite_chat_special_token_behavior_probe.py \ + --artifact-dir /path/to/deepseek-v2-lite-chat \ + --reference-routing-json \ + src/data/deepseek-v2-lite-routing-special-token-family-control.json \ + --human-eval /path/to/HumanEval.jsonl.gz \ + --gsm8k /path/to/gsm8k/test.jsonl \ + --tnews /path/to/tnews/test.json \ + --tnews-archive /path/to/tnews_public.zip \ + --wikitext /path/to/wikitext-validation.parquet \ + --output src/data/deepseek-v2-lite-chat-completion-512.json \ + --per-domain 4 \ + --max-new-tokens 512 \ + --gpu-memory 28GiB \ + --cpu-memory 80GiB +``` + +The evaluator separates stopping, semantic terminal state, evaluator coverage, +and correctness. Each HumanEval candidate runs in a fresh pinned, networkless, +read-only Docker container with no host mounts: + +```bash +python -B experiments/deepseek/v2_lite_chat_completion_evaluator.py \ + --behavior-json \ + src/data/deepseek-v2-lite-chat-completion-512.json \ + --baseline-json src/data/deepseek-v2-lite-chat-behavior.json \ + --human-eval /path/to/HumanEval.jsonl.gz \ + --gsm8k /path/to/gsm8k/test.jsonl \ + --sandbox-image \ + python:3.11-alpine@sha256:25976e9d34a0fab1f278cae931f34c8303d97bf0c0d7f85b6b4dcf641d7702a4 \ + --output \ + src/data/deepseek-v2-lite-chat-completion-512-eval.json +``` + +The formal run reaches natural EOS in 121/128 cells, up from 31/128 at the +128-token budget. Strict-complete GSM8K numeric exact is 23/32; HumanEval +official-test pass is 24/32. These are four source tasks per domain, not +benchmark estimates. A fresh-process one-source-per-domain rerun reproduces +all 32 complete generated token sequences. + +## Full 27-layer Chat hidden-state and router trace + +`v2_lite_chat_full_depth_trace.py` performs a prompt-only `use_cache=False` +forward on the same checkpoint and inputs. It captures hashes and statistics +for embedding, every decoder-layer output, final norm, and every MoE gate. +Boundary-crossing tokenizer tokens are excluded from the exact target-content +scope. + +```bash +PYTORCH_CUDA_ALLOC_CONF=expandable_segments:True \ +PYTHONPATH=/path/to/transformers-4.41.2-deps \ +python -B experiments/deepseek/v2_lite_chat_full_depth_trace.py \ + --artifact-dir /path/to/deepseek-v2-lite-chat \ + --reference-routing-json \ + src/data/deepseek-v2-lite-routing-special-token-family-control.json \ + --human-eval /path/to/HumanEval.jsonl.gz \ + --gsm8k /path/to/gsm8k/test.jsonl \ + --tnews /path/to/tnews/test.json \ + --tnews-archive /path/to/tnews_public.zip \ + --wikitext /path/to/wikitext-validation.parquet \ + --output src/data/deepseek-v2-lite-chat-full-depth.json \ + --per-domain 4 \ + --gpu-memory 28GiB \ + --cpu-memory 80GiB +``` + +The formal trace covers 1,537 exact interior content tokens per condition, +29 hidden stages, 26 gates, and 1,918,176 top-6 route decisions. A fresh +four-source rerun reproduces 1,856 hidden tensor hashes, 1,664 ordered route +hashes, 1,664 route-weight hashes, and every derived comparison. + +See `research/DEEPSEEK_V2_LITE_CHAT_COMPLETION_PROTOCOL.md` and +`research/DEEPSEEK_V2_LITE_CHAT_COMPLETION_DEPTH_AUDIT.md` for the OOM +amendment, task evaluators, completion table, depth curves, reproduction +audit, artifact hashes, and claim boundaries. diff --git a/experiments/deepseek/v2_lite_chat_completion_evaluator.py b/experiments/deepseek/v2_lite_chat_completion_evaluator.py new file mode 100644 index 0000000..892ad8f --- /dev/null +++ b/experiments/deepseek/v2_lite_chat_completion_evaluator.py @@ -0,0 +1,701 @@ +#!/usr/bin/env python3 +"""Evaluate completion state, GSM8K answers, and HumanEval code safely. + +The input is a raw JSON emitted by +v2_lite_chat_special_token_behavior_probe.py. Generated code is executed only +inside one fresh, networkless, read-only Docker container per candidate. The +result preserves fixed-budget and strict-completion metrics separately. +""" + +from __future__ import annotations + +import argparse +import ast +import gzip +import hashlib +import json +import re +import subprocess +import time +from collections import Counter +from decimal import Decimal, InvalidOperation +from pathlib import Path +from statistics import mean +from typing import Any + + +NUMBER = r"[-+]?(?:\d[\d,]*\.?\d*|\.\d+)" +NUMBER_PATTERN = re.compile(NUMBER) +BOXED_PATTERN = re.compile( + rf"\\boxed\s*\{{\s*({NUMBER})\s*\}}", + flags=re.IGNORECASE, +) +HASH_PATTERN = re.compile( + rf"####\s*({NUMBER})", + flags=re.IGNORECASE, +) +ANSWER_PATTERN = re.compile( + rf"(?:final\s+answer|answer|result|total|profit)" + rf"(?:\s+(?:is|equals|will\s+be))?\s*[:=]?\s*" + rf"(?:\$|USD\s*)?({NUMBER})", + flags=re.IGNORECASE, +) +FENCE_PATTERN = re.compile( + r"```(?P[A-Za-z0-9_+-]*)[ \t]*\n?" + r"(?P.*?)(?:```|$)", + flags=re.DOTALL, +) + + +def parse_args() -> argparse.Namespace: + parser = argparse.ArgumentParser() + parser.add_argument("--behavior-json", type=Path, required=True) + parser.add_argument("--baseline-json", type=Path) + parser.add_argument("--human-eval", type=Path, required=True) + parser.add_argument("--gsm8k", type=Path, required=True) + parser.add_argument("--output", type=Path, required=True) + parser.add_argument( + "--sandbox-image", + required=True, + help="Pinned image reference including @sha256 digest.", + ) + parser.add_argument("--timeout-seconds", type=float, default=5.0) + parser.add_argument("--skip-code-execution", action="store_true") + return parser.parse_args() + + +def sha256_bytes(payload: bytes) -> str: + return hashlib.sha256(payload).hexdigest() + + +def sha256_file(path: Path) -> str: + digest = hashlib.sha256() + with path.open("rb") as handle: + while chunk := handle.read(16 * 1024 * 1024): + digest.update(chunk) + return digest.hexdigest() + + +def canonical_hash(value: Any) -> str: + return sha256_bytes( + json.dumps( + value, + ensure_ascii=False, + sort_keys=True, + separators=(",", ":"), + ).encode() + ) + + +def load_jsonl(path: Path) -> list[dict[str, Any]]: + with path.open(encoding="utf-8") as handle: + return [json.loads(line) for line in handle if line.strip()] + + +def load_tasks( + human_eval_path: Path, + gsm8k_path: Path, +) -> tuple[dict[str, dict[str, Any]], dict[str, dict[str, Any]]]: + with gzip.open(human_eval_path, "rt", encoding="utf-8") as handle: + human_eval = { + row["task_id"]: row + for line in handle + if line.strip() + for row in [json.loads(line)] + } + gsm8k = { + f"gsm8k/test/{index:04d}": row + for index, row in enumerate(load_jsonl(gsm8k_path)) + } + return human_eval, gsm8k + + +def normalize_number(value: str | None) -> str | None: + if value is None: + return None + cleaned = value.replace(",", "").strip().rstrip(".") + try: + number = Decimal(cleaned) + except InvalidOperation: + return None + normalized = format(number.normalize(), "f") + if "." in normalized: + normalized = normalized.rstrip("0").rstrip(".") + return "0" if normalized in {"-0", "+0"} else normalized + + +def last_match( + pattern: re.Pattern[str], + text: str, +) -> str | None: + matches = list(pattern.finditer(text)) + return matches[-1].group(1) if matches else None + + +def evaluate_math( + text: str, + hit_eos: bool, + gold_answer: str, +) -> dict[str, Any]: + candidates = [ + ("boxed", last_match(BOXED_PATTERN, text)), + ("hash_marker", last_match(HASH_PATTERN, text)), + ("answer_phrase", last_match(ANSWER_PATTERN, text)), + ] + method = "none" + extracted = None + for name, value in candidates: + if value is not None: + method = name + extracted = value + break + explicit_terminal = extracted is not None + if extracted is None: + values = NUMBER_PATTERN.findall(text) + if values: + method = "last_number_fallback" + extracted = values[-1] + + gold_values = NUMBER_PATTERN.findall( + gold_answer.rsplit("####", 1)[-1] + ) + gold = normalize_number(gold_values[-1] if gold_values else None) + predicted = normalize_number(extracted) + fixed_budget_exact = ( + gold is not None + and predicted is not None + and gold == predicted + ) + semantic_terminal = bool(hit_eos or explicit_terminal) + return { + "gold_final": gold, + "predicted_final": predicted, + "extraction_method": method, + "explicit_final_marker": explicit_terminal, + "semantic_terminal": semantic_terminal, + "evaluator_covered": predicted is not None, + "fixed_budget_numeric_exact": fixed_budget_exact, + "strict_complete_numeric_exact": ( + fixed_budget_exact and semantic_terminal + ), + } + + +def code_fences(text: str) -> list[dict[str, str | bool]]: + rows = [] + for match in FENCE_PATTERN.finditer(text): + language = match.group("lang").lower() + body = match.group("body").strip() + rows.append( + { + "language": language, + "body": body, + "closed": text[match.start():match.end()].rstrip().endswith( + "```" + ), + } + ) + return rows + + +def extract_code( + text: str, + prompt: str, + entry_point: str, +) -> dict[str, Any]: + target = re.compile( + rf"(?m)^\s*(?:async\s+)?def\s+{re.escape(entry_point)}\s*\(" + ) + fences = code_fences(text) + chosen = next( + ( + row for row in fences + if target.search(str(row["body"])) + and row["language"] in {"", "py", "python", "python3"} + ), + None, + ) + if chosen is None: + chosen = next( + ( + row for row in fences + if row["language"] in {"", "py", "python", "python3"} + ), + None, + ) + + if chosen is not None: + raw = str(chosen["body"]) + mode = "fenced" + fence_closed = bool(chosen["closed"]) + else: + match = target.search(text) + if match: + raw = text[match.start():].strip() + mode = "direct_definition" + else: + raw = text.strip() + mode = "prompt_completion" + fence_closed = False + + contains_entry_point = target.search(raw) is not None + candidate = raw if contains_entry_point else prompt + raw + try: + ast.parse(candidate) + ast_ok = True + ast_error = None + except SyntaxError as error: + ast_ok = False + ast_error = { + "line": error.lineno, + "offset": error.offset, + "type": type(error).__name__, + } + return { + "candidate": candidate, + "candidate_sha256": sha256_bytes(candidate.encode()), + "extraction_mode": mode, + "contains_entry_point_definition": contains_entry_point, + "closed_code_fence": fence_closed, + "python_ast_parse": ast_ok, + "parse_error": ast_error, + } + + +def sandbox_harness( + candidate: str, + test: str, + entry_point: str, +) -> str: + return ( + "import sys\n" + "try:\n" + + "\n".join( + f" {line}" if line else "" + for line in candidate.splitlines() + ) + + "\n" + + "\n".join( + f" {line}" if line else "" + for line in test.splitlines() + ) + + f"\n check({entry_point})\n" + + "except AssertionError:\n" + + " raise SystemExit(10)\n" + + "except BaseException:\n" + + " raise SystemExit(11)\n" + + "raise SystemExit(0)\n" + ) + + +def execute_code( + candidate: str, + task: dict[str, Any], + image: str, + timeout_seconds: float, +) -> dict[str, Any]: + harness = sandbox_harness( + candidate, + task["test"], + task["entry_point"], + ) + command = [ + "docker", + "run", + "--rm", + "-i", + "--network", + "none", + "--read-only", + "--tmpfs", + "/tmp:rw,noexec,nosuid,size=16m", + "--memory", + "256m", + "--memory-swap", + "256m", + "--pids-limit", + "64", + "--cpus", + "0.5", + "--cap-drop", + "ALL", + "--security-opt", + "no-new-privileges", + "--user", + "65534:65534", + image, + "python", + "-I", + "-", + ] + started = time.perf_counter() + try: + completed = subprocess.run( + command, + input=harness.encode(), + stdout=subprocess.DEVNULL, + stderr=subprocess.DEVNULL, + timeout=timeout_seconds, + check=False, + ) + except subprocess.TimeoutExpired: + return { + "status": "timeout", + "return_code": None, + "runtime_ms": (time.perf_counter() - started) * 1000, + "harness_sha256": sha256_bytes(harness.encode()), + } + runtime_ms = (time.perf_counter() - started) * 1000 + statuses = { + 0: "passed", + 10: "assertion_failed", + 11: "runtime_error", + } + return { + "status": statuses.get( + completed.returncode, + "sandbox_error", + ), + "return_code": completed.returncode, + "runtime_ms": runtime_ms, + "harness_sha256": sha256_bytes(harness.encode()), + } + + +def evaluate_code( + text: str, + hit_eos: bool, + task: dict[str, Any], + image: str, + timeout_seconds: float, + skip_execution: bool, +) -> dict[str, Any]: + extracted = extract_code( + text, + task["prompt"], + task["entry_point"], + ) + execution = { + "status": "not_run", + "return_code": None, + "runtime_ms": None, + "harness_sha256": None, + } + if extracted["python_ast_parse"] and not skip_execution: + execution = execute_code( + extracted["candidate"], + task, + image, + timeout_seconds, + ) + passed = execution["status"] == "passed" + semantic_terminal = bool( + hit_eos + or extracted["closed_code_fence"] + or passed + ) + return { + key: value + for key, value in extracted.items() + if key != "candidate" + } | { + "semantic_terminal": semantic_terminal, + "evaluator_covered": ( + extracted["python_ast_parse"] + and execution["status"] != "not_run" + ), + "execution": execution, + "fixed_budget_tests_pass": passed, + "strict_complete_tests_pass": passed and semantic_terminal, + } + + +def completion_class( + output: dict[str, Any], + task_evaluation: dict[str, Any] | None, +) -> str: + if output["hit_eos"]: + return "NATURAL_EOS" + if ( + task_evaluation is not None + and task_evaluation.get("semantic_terminal") + ): + return "TASK_TERMINAL_BEFORE_EOS" + if output["stopped_at_max_new_tokens"]: + if ( + task_evaluation is not None + and task_evaluation.get("extraction_method") + == "last_number_fallback" + ): + return "BUDGET_TRUNCATED_WITH_FALLBACK_ONLY" + return "BUDGET_TRUNCATED_UNRESOLVED" + return "OTHER_STOP" + + +def baseline_index( + baseline: dict[str, Any] | None, +) -> dict[tuple[str, str], dict[str, Any]]: + if baseline is None: + return {} + return { + (source["id"], output["condition"]): output + for source in baseline["sources"] + for output in source["outputs"] + } + + +def prefix_audit( + source_id: str, + output: dict[str, Any], + baseline_rows: dict[tuple[str, str], dict[str, Any]], +) -> dict[str, Any] | None: + prior = baseline_rows.get((source_id, output["condition"])) + if prior is None: + return None + reference = prior["generated_token_ids"] + observed = output["generated_token_ids"][: len(reference)] + return { + "baseline_generated_tokens": len(reference), + "compared_tokens": min( + len(reference), + len(output["generated_token_ids"]), + ), + "prompt_hash_exact": ( + prior["prompt_token_ids_sha256"] + == output["prompt_token_ids_sha256"] + ), + "generated_prefix_exact": observed == reference, + "baseline_hit_eos": prior["hit_eos"], + } + + +def summarize(rows: list[dict[str, Any]]) -> dict[str, Any]: + by_condition: dict[str, dict[str, Any]] = {} + conditions = sorted({row["condition"] for row in rows}) + for condition in conditions: + subset = [ + row for row in rows + if row["condition"] == condition + ] + math_rows = [ + row for row in subset + if row["domain"] == "math" + ] + code_rows = [ + row for row in subset + if row["domain"] == "code" + ] + by_condition[condition] = { + "outputs": len(subset), + "natural_eos": sum(row["hit_eos"] for row in subset), + "budget_truncated": sum( + row["stopped_at_max_new_tokens"] + for row in subset + ), + "mean_generated_tokens": mean( + row["generated_tokens"] for row in subset + ), + "completion_classes": dict( + Counter(row["completion_class"] for row in subset) + ), + "math_fixed_budget_exact": sum( + row["task_evaluation"][ + "fixed_budget_numeric_exact" + ] + for row in math_rows + ), + "math_strict_complete_exact": sum( + row["task_evaluation"][ + "strict_complete_numeric_exact" + ] + for row in math_rows + ), + "math_sources": len(math_rows), + "code_ast_parse": sum( + row["task_evaluation"]["python_ast_parse"] + for row in code_rows + ), + "code_executed": sum( + row["task_evaluation"]["execution"]["status"] + != "not_run" + for row in code_rows + ), + "code_tests_pass": sum( + row["task_evaluation"]["fixed_budget_tests_pass"] + for row in code_rows + ), + "code_sources": len(code_rows), + } + prefix_rows = [ + row["baseline_prefix_audit"] + for row in rows + if row["baseline_prefix_audit"] is not None + ] + return { + "outputs": len(rows), + "natural_eos": sum(row["hit_eos"] for row in rows), + "budget_truncated": sum( + row["stopped_at_max_new_tokens"] for row in rows + ), + "completion_classes": dict( + Counter(row["completion_class"] for row in rows) + ), + "baseline_prefix": { + "cells": len(prefix_rows), + "prompt_hash_exact": sum( + row["prompt_hash_exact"] for row in prefix_rows + ), + "generated_prefix_exact": sum( + row["generated_prefix_exact"] for row in prefix_rows + ), + }, + "by_condition": by_condition, + } + + +def main() -> None: + args = parse_args() + for path in ( + args.behavior_json, + args.human_eval, + args.gsm8k, + ): + if not path.is_file(): + raise FileNotFoundError(path) + if args.baseline_json is not None and not args.baseline_json.is_file(): + raise FileNotFoundError(args.baseline_json) + if "@sha256:" not in args.sandbox_image: + raise ValueError("--sandbox-image must include an immutable digest") + if args.timeout_seconds <= 0: + raise ValueError("--timeout-seconds must be positive") + + behavior = json.loads( + args.behavior_json.read_text(encoding="utf-8") + ) + baseline = ( + json.loads(args.baseline_json.read_text(encoding="utf-8")) + if args.baseline_json is not None + else None + ) + baseline_rows = baseline_index(baseline) + human_eval, gsm8k = load_tasks(args.human_eval, args.gsm8k) + + rows = [] + for source in behavior["sources"]: + for output in source["outputs"]: + evaluation = None + if source["domain"] == "math": + evaluation = evaluate_math( + output["text"], + output["hit_eos"], + gsm8k[source["id"]]["answer"], + ) + elif source["domain"] == "code": + evaluation = evaluate_code( + output["text"], + output["hit_eos"], + human_eval[source["id"]], + args.sandbox_image, + args.timeout_seconds, + args.skip_code_execution, + ) + rows.append( + { + "source_id": source["id"], + "domain": source["domain"], + "condition": output["condition"], + "generated_tokens": output["generated_tokens"], + "hit_eos": output["hit_eos"], + "stopped_at_max_new_tokens": ( + output["stopped_at_max_new_tokens"] + ), + "prompt_token_ids_sha256": ( + output["prompt_token_ids_sha256"] + ), + "generated_token_ids_sha256": ( + output["generated_token_ids_sha256"] + ), + "text_sha256": output["text_sha256"], + "task_evaluation": evaluation, + "completion_class": completion_class( + output, + evaluation, + ), + "baseline_prefix_audit": prefix_audit( + source["id"], + output, + baseline_rows, + ), + } + ) + + result = { + "schema_version": 1, + "input": { + "behavior_path": str(args.behavior_json), + "behavior_sha256": sha256_file(args.behavior_json), + "baseline_path": ( + str(args.baseline_json) + if args.baseline_json is not None + else None + ), + "baseline_sha256": ( + sha256_file(args.baseline_json) + if args.baseline_json is not None + else None + ), + "human_eval_sha256": sha256_file(args.human_eval), + "gsm8k_sha256": sha256_file(args.gsm8k), + "model_revision": behavior["model"]["revision"], + "max_new_tokens": behavior[ + "generation_contract" + ]["max_new_tokens"], + }, + "sandbox": { + "image": args.sandbox_image, + "timeout_seconds": args.timeout_seconds, + "code_execution_skipped": args.skip_code_execution, + "network": "none", + "filesystem": "read-only", + "user": "65534:65534", + "capabilities": "ALL dropped", + "memory": "256m", + "memory_swap": "256m", + "pids_limit": 64, + "cpus": 0.5, + "tmpfs": "/tmp:rw,noexec,nosuid,size=16m", + "host_mounts": 0, + }, + "rows": rows, + "summary": summarize(rows), + "claim_boundary": [ + "Four math and four code sources are not benchmark estimates.", + "Completion-conditioned metrics are selection-biased diagnostics.", + "A passing HumanEval test is functional evidence, not code-safety evidence.", + "Fallback last-number extraction is not strict completion.", + "Counterfactual token sequences are not official-valid chats.", + ], + "content_hash": canonical_hash(rows), + } + args.output.parent.mkdir(parents=True, exist_ok=True) + args.output.write_text( + json.dumps(result, ensure_ascii=False, indent=2) + "\n", + encoding="utf-8", + ) + payload = args.output.read_bytes() + print( + json.dumps( + { + "output": str(args.output), + "sha256": sha256_bytes(payload), + "bytes": len(payload), + "summary": result["summary"], + }, + ensure_ascii=False, + indent=2, + ) + ) + + +if __name__ == "__main__": + main() diff --git a/experiments/deepseek/v2_lite_chat_full_depth_trace.py b/experiments/deepseek/v2_lite_chat_full_depth_trace.py new file mode 100644 index 0000000..af50c7d --- /dev/null +++ b/experiments/deepseek/v2_lite_chat_full_depth_trace.py @@ -0,0 +1,872 @@ +#!/usr/bin/env python3 +"""Trace all 27 Chat decoder layers and all 26 MoE gates. + +The probe reuses the fixed 16-source, eight-condition completion cohort but +runs prompt-only full-depth forwards. It stores hashes and summaries rather +than raw hidden tensors. Target-content comparisons use only byte-identical +interior content tokens; boundary-crossing tokens are explicitly excluded. +""" + +from __future__ import annotations + +import argparse +import hashlib +import json +import math +import os +import platform +import resource +import time +from datetime import datetime, timezone +from pathlib import Path +from statistics import mean +from typing import Any + +import accelerate +import safetensors +import torch +import torch.nn.functional as F +import transformers +from transformers import AutoTokenizer + +import v2_lite_chat_special_token_behavior_probe as behavior +import v2_lite_routing_special_token_family_control as special + + +EDGE_PAIRS = { + "system_eos": ("s0_eos", "s1_eos"), + "system_bos": ("s0_bos", "s1_bos"), + "system_x": ("s0_x", "s1_x"), + "system_period": ("s0_period", "s1_period"), + "bos_at_s0": ("s0_eos", "s0_bos"), + "bos_at_s1": ("s1_eos", "s1_bos"), + "x_at_s0": ("s0_eos", "s0_x"), + "x_at_s1": ("s1_eos", "s1_x"), + "period_at_s0": ("s0_eos", "s0_period"), + "period_at_s1": ("s1_eos", "s1_period"), +} +SCOPES = ("target_content", "full_input") + + +def parse_args() -> argparse.Namespace: + parser = argparse.ArgumentParser() + parser.add_argument("--artifact-dir", type=Path, required=True) + parser.add_argument("--reference-routing-json", type=Path, required=True) + parser.add_argument("--human-eval", type=Path, required=True) + parser.add_argument("--gsm8k", type=Path, required=True) + parser.add_argument("--tnews", type=Path, required=True) + parser.add_argument("--tnews-archive", type=Path, required=True) + parser.add_argument("--wikitext", type=Path, required=True) + parser.add_argument("--output", type=Path, required=True) + parser.add_argument( + "--domains", + nargs="+", + choices=behavior.DEFAULT_DOMAINS, + default=list(behavior.DEFAULT_DOMAINS), + ) + parser.add_argument("--per-domain", type=int, default=1) + parser.add_argument("--gpu-memory", default="28GiB") + parser.add_argument("--cpu-memory", default="80GiB") + parser.add_argument("--captured-at", default=None) + return parser.parse_args() + + +def canonical_hash(value: Any) -> str: + payload = json.dumps( + value, + ensure_ascii=False, + sort_keys=True, + separators=(",", ":"), + ).encode() + return hashlib.sha256(payload).hexdigest() + + +def tensor_hash(tensor: torch.Tensor) -> str: + value = tensor.detach().cpu().contiguous() + header = json.dumps( + { + "shape": list(value.shape), + "dtype": str(value.dtype), + }, + separators=(",", ":"), + ).encode() + raw = value.view(torch.uint8).numpy().tobytes() + return hashlib.sha256(header + b"\0" + raw).hexdigest() + + +def validate_args(args: argparse.Namespace) -> None: + if args.per_domain <= 0: + raise ValueError("--per-domain must be positive") + for path in ( + args.artifact_dir, + args.reference_routing_json, + args.human_eval, + args.gsm8k, + args.tnews, + args.tnews_archive, + args.wikitext, + ): + if not path.exists(): + raise FileNotFoundError(path) + missing = [ + name + for name in behavior.MODEL_FILES + if not (args.artifact_dir / name).is_file() + ] + if missing: + raise FileNotFoundError( + f"artifact directory is incomplete: {missing}" + ) + + +def condition_positions( + variants: dict[str, dict[str, Any]], + batch_tokens: int, +) -> dict[str, dict[str, list[int]]]: + result = {} + for condition in special.CONDITIONS: + variant = variants[condition] + padding = batch_tokens - variant["tokens"] + result[condition] = { + "target_content": [ + padding + int(position) + for position in variant["content_positions"] + ], + "full_input": list(range(padding, batch_tokens)), + } + return result + + +def hidden_stats(value: torch.Tensor) -> dict[str, Any]: + fp32 = value.float() + return { + "shape": list(value.shape), + "dtype": str(value.dtype), + "tensor_sha256": tensor_hash(value), + "mean": fp32.mean().item(), + "std": fp32.std(unbiased=False).item(), + "rms": fp32.square().mean().sqrt().item(), + "max_abs": fp32.abs().max().item(), + } + + +def compare_hidden( + left: torch.Tensor, + right: torch.Tensor, +) -> dict[str, Any]: + if left.shape != right.shape: + raise RuntimeError( + f"hidden comparison shape mismatch: {left.shape} != " + f"{right.shape}" + ) + left_fp32 = left.float() + right_fp32 = right.float() + delta = right_fp32 - left_fp32 + denominator = left_fp32.norm(dim=-1).clamp_min(1e-12) + relative = delta.norm(dim=-1) / denominator + cosine = F.cosine_similarity( + left_fp32, + right_fp32, + dim=-1, + eps=1e-12, + ).clamp(-1.0, 1.0) + exact = (left == right).all(dim=-1) + return { + "tokens": left.shape[0], + "exact_hidden_rows": exact.sum().item(), + "mean_cosine_similarity": cosine.mean().item(), + "min_cosine_similarity": cosine.min().item(), + "mean_relative_l2": relative.mean().item(), + "max_abs_delta": delta.abs().max().item(), + } + + +def route_distribution( + route_ids: torch.Tensor, + route_weights: torch.Tensor, + experts: int, +) -> dict[str, Any]: + loads = torch.bincount( + route_ids.reshape(-1), + minlength=experts, + ).to(torch.int64) + weighted = torch.zeros(experts, dtype=torch.float64) + weighted.scatter_add_( + 0, + route_ids.reshape(-1), + route_weights.reshape(-1).to(torch.float64), + ) + total = loads.sum().item() + probabilities = loads.to(torch.float64) / max(total, 1) + nonzero = probabilities[probabilities > 0] + entropy = ( + -(nonzero * nonzero.log()).sum().item() / math.log(experts) + if len(nonzero) + else 0.0 + ) + mean_load = loads.double().mean() + cv = ( + loads.double().std(unbiased=False) / mean_load + if mean_load > 0 + else torch.tensor(0.0) + ) + return { + "tokens": route_ids.shape[0], + "top_k": route_ids.shape[1], + "decisions": total, + "ordered_route_sha256": canonical_hash(route_ids.tolist()), + "route_weight_sha256": tensor_hash(route_weights), + "loads": loads.tolist(), + "weighted_loads": weighted.tolist(), + "unique_experts": int((loads > 0).sum().item()), + "load_cv": cv.item(), + "normalized_load_entropy": entropy, + "max_load_share": probabilities.max().item(), + } + + +def normalized_load(loads: torch.Tensor) -> torch.Tensor: + value = loads.to(torch.float64) + return value / value.sum().clamp_min(1e-12) + + +def compare_routes( + left_ids: torch.Tensor, + left_weights: torch.Tensor, + right_ids: torch.Tensor, + right_weights: torch.Tensor, + experts: int, +) -> dict[str, Any]: + if left_ids.shape != right_ids.shape: + raise RuntimeError( + f"route comparison shape mismatch: {left_ids.shape} != " + f"{right_ids.shape}" + ) + ordered_exact = (left_ids == right_ids).all(dim=-1) + left_sorted = left_ids.sort(dim=-1).values + right_sorted = right_ids.sort(dim=-1).values + set_exact = (left_sorted == right_sorted).all(dim=-1) + left_hot = F.one_hot( + left_ids, + num_classes=experts, + ).sum(dim=1).bool() + right_hot = F.one_hot( + right_ids, + num_classes=experts, + ).sum(dim=1).bool() + intersection = (left_hot & right_hot).sum(dim=-1) + union = (left_hot | right_hot).sum(dim=-1).clamp_min(1) + + left_token_weighted = torch.zeros( + left_ids.shape[0], + experts, + dtype=torch.float64, + ) + right_token_weighted = torch.zeros_like(left_token_weighted) + left_token_weighted.scatter_add_( + 1, + left_ids, + left_weights.to(torch.float64), + ) + right_token_weighted.scatter_add_( + 1, + right_ids, + right_weights.to(torch.float64), + ) + token_weighted_tv = 0.5 * ( + left_token_weighted - right_token_weighted + ).abs().sum(dim=-1) + + left_load = torch.bincount( + left_ids.reshape(-1), + minlength=experts, + ) + right_load = torch.bincount( + right_ids.reshape(-1), + minlength=experts, + ) + load_tv = 0.5 * ( + normalized_load(left_load) + - normalized_load(right_load) + ).abs().sum() + return { + "tokens": left_ids.shape[0], + "ordered_topk_exact_tokens": ordered_exact.sum().item(), + "set_exact_tokens": set_exact.sum().item(), + "mean_set_jaccard": ( + intersection.to(torch.float64) + / union.to(torch.float64) + ).mean().item(), + "mean_token_weighted_tv": token_weighted_tv.mean().item(), + "aggregate_load_tv": load_tv.item(), + } + + +class TraceCapture: + def __init__(self, experts: int) -> None: + self.experts = experts + self.positions: dict[str, dict[str, list[int]]] = {} + self.batch_tokens = 0 + self.hidden: dict[str, Any] = {} + self.routes: dict[str, Any] = {} + + def start( + self, + positions: dict[str, dict[str, list[int]]], + batch_tokens: int, + ) -> None: + self.positions = positions + self.batch_tokens = batch_tokens + self.hidden = {} + self.routes = {} + + def hidden_hook(self, stage: str): + def hook( + _module: torch.nn.Module, + _inputs: tuple[Any, ...], + output: Any, + ) -> None: + tensor = output[0] if isinstance(output, tuple) else output + if tensor.ndim != 3: + raise RuntimeError( + f"{stage} hidden rank {tensor.ndim}, expected 3" + ) + cpu = tensor.detach().cpu() + condition_values: dict[str, dict[str, torch.Tensor]] = {} + condition_rows = {} + for row, condition in enumerate(special.CONDITIONS): + condition_values[condition] = {} + condition_rows[condition] = {} + for scope in SCOPES: + positions = self.positions[condition][scope] + value = cpu[row, positions, :].contiguous() + condition_values[condition][scope] = value + condition_rows[condition][scope] = hidden_stats(value) + comparisons = {} + for name, (left, right) in EDGE_PAIRS.items(): + comparisons[name] = compare_hidden( + condition_values[left]["target_content"], + condition_values[right]["target_content"], + ) + self.hidden[stage] = { + "conditions": condition_rows, + "target_comparisons": comparisons, + } + + return hook + + def gate_hook(self, layer: int): + def hook( + _module: torch.nn.Module, + _inputs: tuple[Any, ...], + output: Any, + ) -> None: + route_ids, route_weights, _aux = output + top_k = route_ids.shape[-1] + ids = route_ids.detach().reshape( + len(special.CONDITIONS), + self.batch_tokens, + top_k, + ).cpu() + weights = route_weights.detach().reshape( + len(special.CONDITIONS), + self.batch_tokens, + top_k, + ).cpu() + values: dict[ + str, + dict[str, tuple[torch.Tensor, torch.Tensor]], + ] = {} + condition_rows = {} + for row, condition in enumerate(special.CONDITIONS): + values[condition] = {} + condition_rows[condition] = {} + for scope in SCOPES: + positions = self.positions[condition][scope] + scoped_ids = ids[row, positions, :].contiguous() + scoped_weights = weights[ + row, + positions, + :, + ].contiguous() + values[condition][scope] = ( + scoped_ids, + scoped_weights, + ) + condition_rows[condition][scope] = ( + route_distribution( + scoped_ids, + scoped_weights, + self.experts, + ) + ) + comparisons = {} + for name, (left, right) in EDGE_PAIRS.items(): + left_ids, left_weights = values[left][ + "target_content" + ] + right_ids, right_weights = values[right][ + "target_content" + ] + comparisons[name] = compare_routes( + left_ids, + left_weights, + right_ids, + right_weights, + self.experts, + ) + self.routes[f"layer_{layer:02d}"] = { + "layer": layer, + "conditions": condition_rows, + "target_comparisons": comparisons, + } + + return hook + + +def aggregate_trace(sources: list[dict[str, Any]]) -> dict[str, Any]: + hidden_stages = [ + "embedding", + *(f"layer_{index:02d}" for index in range(27)), + "final_norm", + ] + router_layers = [ + f"layer_{index:02d}" + for index in range(1, 27) + ] + hidden = {} + for stage in hidden_stages: + hidden[stage] = {} + for edge in EDGE_PAIRS: + rows = [ + source["hidden_stages"][stage][ + "target_comparisons" + ][edge] + for source in sources + ] + tokens = sum(row["tokens"] for row in rows) + hidden[stage][edge] = { + "sources": len(rows), + "tokens": tokens, + "exact_hidden_rows": sum( + row["exact_hidden_rows"] for row in rows + ), + "token_weighted_mean_cosine_similarity": sum( + row["mean_cosine_similarity"] * row["tokens"] + for row in rows + ) / tokens, + "source_mean_relative_l2": mean( + row["mean_relative_l2"] for row in rows + ), + "max_abs_delta": max( + row["max_abs_delta"] for row in rows + ), + } + routes = {} + for layer in router_layers: + routes[layer] = {} + for edge in EDGE_PAIRS: + rows = [ + source["router_layers"][layer][ + "target_comparisons" + ][edge] + for source in sources + ] + tokens = sum(row["tokens"] for row in rows) + routes[layer][edge] = { + "sources": len(rows), + "tokens": tokens, + "ordered_topk_exact_tokens": sum( + row["ordered_topk_exact_tokens"] for row in rows + ), + "set_exact_tokens": sum( + row["set_exact_tokens"] for row in rows + ), + "token_weighted_mean_set_jaccard": sum( + row["mean_set_jaccard"] * row["tokens"] + for row in rows + ) / tokens, + "source_mean_token_weighted_tv": mean( + row["mean_token_weighted_tv"] for row in rows + ), + "source_mean_aggregate_load_tv": mean( + row["aggregate_load_tv"] for row in rows + ), + } + target_tokens = sum( + source["content_tokens"] for source in sources + ) + return { + "sources": len(sources), + "conditions_per_source": len(special.CONDITIONS), + "decoder_layers_executed": 27, + "moe_gates_executed": 26, + "hidden_stages": len(hidden_stages), + "target_content_tokens_per_condition": target_tokens, + "target_route_decisions": ( + target_tokens + * len(special.CONDITIONS) + * 26 + * 6 + ), + "hidden": hidden, + "routes": routes, + } + + +def main() -> None: + args = parse_args() + validate_args(args) + captured_at = args.captured_at or datetime.now( + timezone.utc + ).isoformat() + revision_contract = behavior.download_revision_contract( + args.artifact_dir + ) + special.install_control_contract() + tokenizer = AutoTokenizer.from_pretrained( + args.artifact_dir, + trust_remote_code=True, + local_files_only=True, + use_fast=True, + ) + if tokenizer.pad_token_id is None: + tokenizer.pad_token_id = tokenizer.eos_token_id + if special.special_family_token_ids(tokenizer) != { + "eos": 100001, + "bos": 100000, + "x": 87, + "period": 13, + }: + raise RuntimeError("pinned tokenizer ID contract changed") + + source_rows, reference = behavior.selected_sources(args, tokenizer) + for source in source_rows: + source["variants"] = { + condition: special.prior.render_boundary_variant( + tokenizer, + source["content"], + condition, + ) + for condition in special.CONDITIONS + } + content_sequences = { + tuple( + source["variants"][condition]["token_ids"][position] + for position in source["variants"][condition][ + "content_positions" + ] + ) + for condition in special.CONDITIONS + } + if len(content_sequences) != 1: + raise RuntimeError( + f"{source['id']} target token sequence is not exact " + "across conditions" + ) + source["content_token_ids_sha256"] = canonical_hash( + next(iter(content_sequences)) + ) + + if torch.cuda.is_available(): + torch.cuda.empty_cache() + torch.cuda.reset_peak_memory_stats() + torch.cuda.synchronize() + load_started = time.perf_counter() + _, official_modeling = special.base.load_official_modules( + args.artifact_dir + ) + model = official_modeling.DeepseekV2ForCausalLM.from_pretrained( + args.artifact_dir, + local_files_only=True, + torch_dtype=torch.bfloat16, + low_cpu_mem_usage=True, + device_map="auto", + max_memory={ + 0: args.gpu_memory, + "cpu": args.cpu_memory, + }, + ) + model.eval() + if torch.cuda.is_available(): + torch.cuda.synchronize() + load_seconds = time.perf_counter() - load_started + load_peak_cuda = ( + torch.cuda.max_memory_allocated() + if torch.cuda.is_available() + else None + ) + input_device = model.get_input_embeddings().weight.device + + capture = TraceCapture(model.config.n_routed_experts) + handles = [ + model.model.embed_tokens.register_forward_hook( + capture.hidden_hook("embedding") + ), + model.model.norm.register_forward_hook( + capture.hidden_hook("final_norm") + ), + ] + for index, layer in enumerate(model.model.layers): + handles.append( + layer.register_forward_hook( + capture.hidden_hook(f"layer_{index:02d}") + ) + ) + if hasattr(layer.mlp, "gate"): + handles.append( + layer.mlp.gate.register_forward_hook( + capture.gate_hook(index) + ) + ) + + traced_sources = [] + try: + for source in source_rows: + unpadded = [ + source["variants"][condition]["token_ids"] + for condition in special.CONDITIONS + ] + prompt_lengths = [len(row) for row in unpadded] + batch_tokens = max(prompt_lengths) + padded = [ + [int(tokenizer.pad_token_id)] + * (batch_tokens - len(row)) + + row + for row in unpadded + ] + masks = [ + [0] * (batch_tokens - len(row)) + + [1] * len(row) + for row in unpadded + ] + positions = condition_positions( + source["variants"], + batch_tokens, + ) + capture.start(positions, batch_tokens) + input_ids = torch.tensor( + padded, + dtype=torch.long, + device=input_device, + ) + attention_mask = torch.tensor( + masks, + dtype=torch.long, + device=input_device, + ) + if torch.cuda.is_available(): + torch.cuda.reset_peak_memory_stats() + torch.cuda.synchronize() + started = time.perf_counter() + with torch.inference_mode(): + output = model.model( + input_ids=input_ids, + attention_mask=attention_mask, + use_cache=False, + output_attentions=False, + output_hidden_states=False, + return_dict=True, + ) + if torch.cuda.is_available(): + torch.cuda.synchronize() + elapsed = time.perf_counter() - started + peak = ( + torch.cuda.max_memory_allocated() + if torch.cuda.is_available() + else None + ) + if output.last_hidden_state.shape[:2] != input_ids.shape: + raise RuntimeError( + "final hidden batch/sequence shape does not match input" + ) + expected_hidden = { + "embedding", + *(f"layer_{index:02d}" for index in range(27)), + "final_norm", + } + expected_routes = { + f"layer_{index:02d}" + for index in range(1, 27) + } + if set(capture.hidden) != expected_hidden: + raise RuntimeError( + f"hidden stages mismatch: {set(capture.hidden)}" + ) + if set(capture.routes) != expected_routes: + raise RuntimeError( + f"router layers mismatch: {set(capture.routes)}" + ) + content_tokens = len( + positions[special.CONDITIONS[0]][ + "target_content" + ] + ) + traced_sources.append( + { + key: value + for key, value in source.items() + if key not in {"content", "variants"} + } + | { + "prompt_tokens_by_condition": { + condition: prompt_lengths[index] + for index, condition in enumerate( + special.CONDITIONS + ) + }, + "batch_prompt_tokens": batch_tokens, + "content_tokens": content_tokens, + "content_token_ids_sha256": source[ + "content_token_ids_sha256" + ], + "boundary_crossing_tokens_by_condition": { + condition: source["variants"][condition][ + "boundary_crossing_tokens" + ] + for condition in special.CONDITIONS + }, + "forward_seconds": elapsed, + "peak_cuda_memory_allocated_bytes": peak, + "hidden_stages": capture.hidden, + "router_layers": capture.routes, + } + ) + finally: + for handle in handles: + handle.remove() + + device_map = getattr(model, "hf_device_map", {}) + peaks = [ + source["peak_cuda_memory_allocated_bytes"] + for source in traced_sources + if source["peak_cuda_memory_allocated_bytes"] is not None + ] + result = { + "schema_version": 1, + "captured_at": captured_at, + "model": { + "repo": "deepseek-ai/DeepSeek-V2-Lite-Chat", + "revision": behavior.MODEL_REVISION, + "checkpoint_identity": "SFT Chat", + "architecture": type(model).__name__, + "dtype": "bfloat16", + "download_revision_contract": revision_contract, + "files": { + name: { + "bytes": (args.artifact_dir / name).stat().st_size, + "sha256": behavior.sha256( + args.artifact_dir / name + ), + } + for name in behavior.MODEL_FILES + }, + }, + "tokenizer_contract": { + "length": len(tokenizer), + "vocab_size": tokenizer.vocab_size, + "all_special_ids": tokenizer.all_special_ids, + "pad_token_id": tokenizer.pad_token_id, + "conditions": special.FACTORS, + }, + "source_contract": { + **reference, + "domains": args.domains, + "per_domain": args.per_domain, + "sources": len(source_rows), + "full_source_text_used": True, + "target_scope": ( + "byte-identical interior content tokens; tokens whose " + "offset crosses the content boundary are excluded" + ), + }, + "trace_contract": { + "conditions": list(special.CONDITIONS), + "scopes": list(SCOPES), + "edge_pairs": EDGE_PAIRS, + "decoder_layers": 27, + "moe_gate_layers": list(range(1, 27)), + "experts": model.config.n_routed_experts, + "top_k": model.config.num_experts_per_tok, + "use_cache": False, + "raw_hidden_tensors_saved": False, + "raw_route_ids_saved": False, + "load_vectors_saved": True, + "hashes_cover_exact_bfloat16_hidden_and_route_values": True, + }, + "execution": { + "python": platform.python_version(), + "torch": torch.__version__, + "transformers": transformers.__version__, + "accelerate": accelerate.__version__, + "safetensors": safetensors.__version__, + "platform": platform.platform(), + "gpu": ( + torch.cuda.get_device_name(0) + if torch.cuda.is_available() + else None + ), + "gpu_memory_limit": args.gpu_memory, + "cpu_memory_limit": args.cpu_memory, + "pytorch_cuda_alloc_conf": os.environ.get( + "PYTORCH_CUDA_ALLOC_CONF" + ), + "input_device": str(input_device), + "device_map": device_map, + "load_seconds": load_seconds, + "forward_seconds": sum( + source["forward_seconds"] + for source in traced_sources + ), + "load_peak_cuda_memory_allocated_bytes": load_peak_cuda, + "peak_cuda_memory_allocated_bytes": max( + [load_peak_cuda, *peaks] + ), + "process_max_rss_kib": resource.getrusage( + resource.RUSAGE_SELF + ).ru_maxrss, + }, + "sources": traced_sources, + "summary": aggregate_trace(traced_sources), + "claim_boundary": [ + "The trace observes one fixed SFT Chat checkpoint, not the Base checkpoint.", + "Target comparisons exclude boundary-crossing tokens and require exact token IDs.", + "Router and hidden associations do not establish mediation or capability causality.", + "CPU in hf_device_map is offload residency, not proof of CPU matrix execution.", + "Prompt-only use_cache=False traces are not generation-time KV or serving traces.", + ], + } + args.output.parent.mkdir(parents=True, exist_ok=True) + args.output.write_text( + json.dumps(result, ensure_ascii=False, indent=2) + "\n", + encoding="utf-8", + ) + payload = args.output.read_bytes() + print( + json.dumps( + { + "output": str(args.output), + "sha256": hashlib.sha256(payload).hexdigest(), + "bytes": len(payload), + "sources": len(traced_sources), + "decoder_layers": 27, + "moe_gates": 26, + "target_route_decisions": result["summary"][ + "target_route_decisions" + ], + "load_seconds": load_seconds, + "forward_seconds": result["execution"][ + "forward_seconds" + ], + "peak_cuda_memory_allocated_bytes": result[ + "execution" + ]["peak_cuda_memory_allocated_bytes"], + }, + ensure_ascii=False, + indent=2, + ) + ) + + +if __name__ == "__main__": + main() diff --git a/experiments/deepseek/v2_lite_chat_special_token_behavior_probe.py b/experiments/deepseek/v2_lite_chat_special_token_behavior_probe.py index a41f629..e1179e3 100644 --- a/experiments/deepseek/v2_lite_chat_special_token_behavior_probe.py +++ b/experiments/deepseek/v2_lite_chat_special_token_behavior_probe.py @@ -24,6 +24,7 @@ import ast import gzip import hashlib import json +import os import platform import re import resource @@ -933,6 +934,9 @@ def main() -> None: ), "gpu_memory_limit": args.gpu_memory, "cpu_memory_limit": args.cpu_memory, + "pytorch_cuda_alloc_conf": os.environ.get( + "PYTORCH_CUDA_ALLOC_CONF" + ), "input_device": str(input_device), "device_map": device_map, "parameter_bytes_by_runtime_parameter_device": ( diff --git a/package.json b/package.json index c528d98..8022c55 100644 --- a/package.json +++ b/package.json @@ -14,6 +14,7 @@ "build:data:deepseek-special": "node scripts/build-deepseek-special-token-family-compact.mjs", "build:data:deepseek-role-block": "node scripts/build-deepseek-role-marker-block-compact.mjs", "build:data:deepseek-chat-behavior": "node scripts/build-deepseek-chat-behavior-compact.mjs", + "build:data:deepseek-chat-completion-depth": "node scripts/build-deepseek-chat-completion-depth-compact.mjs", "check:site": "node scripts/check-site.mjs", "check:moe-browser": "node scripts/check-moe-browser.mjs", "check:reasoning-browser": "node scripts/check-reasoning-browser.mjs", diff --git a/research/DEEPSEEK_V2_LITE_CHAT_COMPLETION_DEPTH_AUDIT.md b/research/DEEPSEEK_V2_LITE_CHAT_COMPLETION_DEPTH_AUDIT.md new file mode 100644 index 0000000..62fcf8f --- /dev/null +++ b/research/DEEPSEEK_V2_LITE_CHAT_COMPLETION_DEPTH_AUDIT.md @@ -0,0 +1,412 @@ +# DeepSeek-V2-Lite-Chat:512-token 完成度与全 27 层传播审计 + +> 状态:已执行、已评测、已做独立子集复跑 +> +> 执行日期:2026-07-29 +> +> 模型:`deepseek-ai/DeepSeek-V2-Lite-Chat` +> +> revision:`85864749cd611b4353ce1decdb286193298f64c7` +> +> 前序审计:`DEEPSEEK_V2_LITE_CHAT_BEHAVIOR_AUDIT.md` +> +> 预注册协议:`DEEPSEEK_V2_LITE_CHAT_COMPLETION_PROTOCOL.md` + +## 0. 先说结论,也先说不能说什么 + +这轮把 Round 04 的两个缺口分别补上: + +1. 将统一生成预算从 128 提高到 512,区分“达到长度上限”“自然结束”“可评测”和 + “答案正确”; +2. 不再只观察 Base checkpoint 的前六个 MoE 层,而是在同一个官方 SFT Chat checkpoint + 上追踪 embedding、27 个 decoder layer、final norm 与 26 个 MoE gate。 + +最短结果是: + +```text +128-token natural EOS 31 / 128 +512-token natural EOS 121 / 128 +仍在 512 截断 7 / 128 + +GSM8K 严格完成且数值 exact 23 / 32 +HumanEval 官方 tests pass 24 / 32 + +全深度目标 content tokens 1,537 / condition +隐藏状态阶段 29 +MoE gate 26 +top-6 route decisions 1,918,176 +``` + +这些数字只来自四域各 4 条 source、八个固定条件。它们证明这组输入上的执行事实,不是 +GSM8K、HumanEval、语言能力或“哪种边界更好”的 benchmark 估计。 + +--- + +## 1. 冻结的实验对象 + +### 1.1 模型与条件 + +- 官方 `DeepSeek-V2-Lite-Chat` SFT checkpoint,不是 Base、R1 或蒸馏模型; +- 12 个模型与 tokenizer 文件固定到同一个 revision; +- English、Chinese、Code、Math 各 4 条完整公开 source; +- 每条 source 使用相同八格: + +| 条件 | system | 历史边界 | 身份 | +|---|---:|---|---| +| `s0_eos` | off | EOS | 官方序列 | +| `s1_eos` | on | EOS | 官方序列 | +| `s0_bos` | off | BOS | 单 ID 反事实 | +| `s1_bos` | on | BOS | 单 ID 反事实 | +| `s0_x` | off | `x` | 单 ID 普通词元对照 | +| `s1_x` | on | `x` | 单 ID 普通词元对照 | +| `s0_period` | off | `.` | 单 ID 普通词元对照 | +| `s1_period` | on | `.` | 单 ID 普通词元对照 | + +同一 source 的八格仍在同一个左填充 batch 内 greedy generation。BOS、`x` 与句点格 +不是有效官方聊天格式;它们是只改一个 input ID 的机制对照。 + +### 1.2 数据身份 + +| 域 | 数据 | 本轮判断 | +|---|---|---| +| English | WikiText-2 raw validation | EOS / 截断与传播差异 | +| Chinese | TNEWS public test | EOS / 截断与传播差异 | +| Code | OpenAI HumanEval | AST、官方 tests、完成状态 | +| Math | GSM8K test | 数值抽取、gold exact、完成状态 | + +gold answer、HumanEval tests 与 entry point 都没有进入模型 prompt。 + +--- + +## 2. 为什么不能从 128-token 结果直接读“能力” + +Round 04 的 128 个输出里,97 个因为达到 `max_new_tokens=128` 而停下。此时: + +```text +数学没有来得及写最终数值 ≠ 推理一定错误 +代码 fence 尚未闭合 ≠ 完整代码一定不能运行 +generation 停止 ≠ 模型主动输出 EOS +``` + +所以本轮没有只续写那 97 格,而是让全部 128 格从头使用相同的 512-token 预算。选择性续写 +会让先前是否完成决定后续算力,破坏八格的固定预算比较。 + +--- + +## 3. 显存协议:两次 OOM 如何改变了放置,而没有改变输出 + +本机可见显存为 32,607 MiB,官方 model card 给出的单卡 BF16 需求是 40GB,因此必须 +使用 Accelerate 模块级 CPU offload。 + +### 3.1 失败链 + +1. 初次加载在 allocator 碎片下失败; +2. 启用 `expandable_segments:True` 后,29 GiB static placement smoke 成功; +3. 29 GiB formal 在长 prompt、512-token KV 与 offloaded `lm_head` 临时回装共同出现时, + 额外申请约 400 MiB 失败; +4. 失败发生在写正式 JSON 之前,没有可供挑选的部分结果。 + +### 3.2 正式放置 + +```text +max_memory[CUDA:0] = 28 GiB +CUDA resident = embedding + layers 0–23 +CPU offload = layers 24–26 + final norm + lm_head +allocator = expandable_segments:True +八格 batch = 保持不拆 +``` + +`hf_device_map` 里的 CPU 表示权重驻留 / offload 身份。Accelerate hook 会在执行前搬运模块, +不能把它简写成“后三层在 CPU 上做矩阵乘”。 + +28 GiB 与成功的 29 GiB smoke 在 32 格上: + +```text +prompt hash 32 / 32 exact +完整 generated token IDs 32 / 32 exact +decoded text 32 / 32 exact +EOS state 32 / 32 exact +``` + +因此改变的是可执行的静态放置余量,不是这 32 格的 greedy 输出。 + +--- + +## 4. 512-token completion 结果 + +### 4.1 总体完成度阶梯 + +| 统一预算 | 自然 EOS | 达到预算仍未 EOS | 总输出 | +|---:|---:|---:|---:| +| 128 | 31 | 97 | 128 | +| 512 | 121 | 7 | 128 | + +这不是说“512 已经足够”。它只表明在这组固定输入上,增加统一预算解决了 90 个原先的 +截断格,仍有 7 格没有自然结束。 + +### 4.2 八个条件逐格 + +| 条件 | 自然 EOS | 截断 | 平均生成 tokens | Math strict exact | Code tests pass | +|---|---:|---:|---:|---:|---:| +| `s0_bos` | 15/16 | 1 | 272.6 | 3/4 | 4/4 | +| `s0_eos` | 15/16 | 1 | 278.0 | 3/4 | 3/4 | +| `s0_period` | 15/16 | 1 | 270.9 | 3/4 | 3/4 | +| `s0_x` | 13/16 | 3 | 294.4 | 2/4 | 3/4 | +| `s1_bos` | 16/16 | 0 | 232.6 | 3/4 | 4/4 | +| `s1_eos` | 15/16 | 1 | 229.6 | 3/4 | 2/4 | +| `s1_period` | 16/16 | 0 | 158.3 | 3/4 | 3/4 | +| `s1_x` | 16/16 | 0 | 177.3 | 3/4 | 2/4 | + +分母始终保留。每格的 4 条 math / code 太少,不能把 4/4 与 2/4 排成“边界排行榜”。 + +### 4.3 仍截断的 7 格 + +| source | 域 | 条件 | 状态 | +|---|---|---|---| +| WikiText `0443` | English | `s0_bos` | 512 截断 | +| WikiText `0030` | English | `s0_x` | 512 截断 | +| WikiText `2909` | English | `s0_x` | 512 截断 | +| WikiText `2746` | English | `s0_eos` | 512 截断 | +| WikiText `2746` | English | `s0_x` | 512 截断 | +| WikiText `2746` | English | `s0_period` | 512 截断 | +| HumanEval `44` | Code | `s1_eos` | fence 未闭合、AST 失败、未执行 | + +English / Chinese 没有 gold task terminal,因此“不截断”只表示遇到 EOS,不表示回答正确。 + +--- + +## 5. 任务评测:完成、可评测、正确各记一张账 + +### 5.1 GSM8K + +32 个 math cells 的抽取方法: + +| 方法 | 数量 | 严格身份 | +|---|---:|---| +| `\boxed{}` | 20 | 明确 final marker | +| answer phrase | 8 | 明确 final marker | +| last-number fallback | 4 | 只作固定预算诊断 | + +最终: + +```text +strict-complete numeric exact = 23 / 32 +``` + +fallback 即使碰巧与 gold 相等,也不会因为“最后一个数字”被升级成严格完成。 + +### 5.2 HumanEval + +32 个 code cells 使用官方 tests,逐 candidate 进入新容器: + +| 执行分类 | 数量 | +|---|---:| +| `passed` | 24 | +| `assertion_failed` | 5 | +| `runtime_error` | 2 | +| `not_run` | 1 | + +沙箱固定为: + +```text +python:3.11-alpine@sha256:25976e9d34a0fab1f278cae931f34c8303d97bf0c0d7f85b6b4dcf641d7702a4 +network=none · read-only · user=65534:65534 +cap-drop=ALL · no-new-privileges +memory/swap=256m · pids=64 · cpus=0.5 +/tmp=16m,noexec,nosuid · host mounts=0 · timeout=5s +``` + +通过官方 tests 是这 4 道 HumanEval 上的功能证据,不是生成代码的安全证明。 + +--- + +## 6. 128-token 前缀与独立复跑 + +正式 512 运行首先通过: + +```text +prompt hash 与 Round 04 相同 128 / 128 +前 128 generated token prefix exact 128 / 128 +``` + +正式运行后再启动新进程、重新加载模型,每域只取第 1 条 source: + +```text +prompt hash 32 / 32 exact +完整 generated token IDs 32 / 32 exact +decoded text 32 / 32 exact +EOS / truncation state 32 / 32 exact +``` + +它只能支持“32 格长序列复现”,不能写成 128 / 128 独立复跑。 + +--- + +## 7. 全 27 层 trace:到底追踪了什么 + +### 7.1 两条观察线 + +对每条 source 的八格做一次 prompt-only、`use_cache=false` forward: + +```text +hidden line: +embedding → layer 00 → ... → layer 26 → final norm +共 29 个阶段 + +router line: +MoE gate layer 01 → ... → layer 26 +共 26 个 gate +``` + +每个 hidden 阶段保存目标 content 与完整输入的 shape、dtype、统计量和 tensor SHA-256; +每个 gate 保存 ordered top-6 route hash、route-weight hash、64 专家 load / weighted load 与 +描述统计。原始激活 tensor 和逐 token route ID 不写入数据文件。 + +### 7.2 为什么排除边界相交 token + +八种序列化的字符边界可能落在 tokenizer token 的内部。本轮先验证每个条件的目标内容 token +序列完全相同,再只比较完全位于 content 字符区间内的 token: + +```text +目标 interior content tokens = 1,537 / condition +被排除的 boundary-crossing tokens = 56 / 128 variants +``` + +否则比较的可能是“同一位置上的不同 token”,隐藏状态差异会混入 tokenizer 边界变化。 + +### 7.3 规模恒等式 + +```text +1,537 target tokens +× 8 conditions +× 26 MoE gates +× top-6 experts += 1,918,176 route decisions +``` + +--- + +## 8. 隐藏状态怎样沿深度分叉 + +十条 edge 在 embedding 的 1,537 个目标 token 上都 byte-exact: + +```text +10 edges × 1,537 rows = 15,370 / 15,370 exact +``` + +原因不是“条件没有影响”,而是 embedding 是逐 token lookup;目标内容 token ID 相同, +尚未与前文发生 attention 混合。进入 layer 00 后,十条 edge 的 exact hidden rows 都降为 0, +说明上下文差异已经传播到全部目标行。 + +四域合计的代表性结果: + +| edge | final-norm cosine | final relative L2 | cosine 最低阶段 | +|---|---:|---:|---| +| System on−off · EOS | 0.99530 | 0.08474 | layer 22 | +| System on−off · BOS | 0.99440 | 0.09614 | layer 22 | +| System on−off · x | 0.98771 | 0.14814 | layer 22 | +| System on−off · period | 0.98747 | 0.15230 | layer 22 | +| BOS−EOS · system off | 0.99321 | 0.10376 | layer 01 | +| BOS−EOS · system on | 0.99304 | 0.11123 | layer 02 | +| x−EOS · system off | 0.99252 | 0.11333 | layer 13 | +| x−EOS · system on | 0.98706 | 0.15694 | layer 10 | +| period−EOS · system off | 0.99252 | 0.11368 | layer 08 | +| period−EOS · system on | 0.98754 | 0.15810 | layer 08 | + +不能只看 cosine 接近 1 就说“几乎一样”:2048 维状态中的小方向变化可以改变后续 router +排序与 logits。也不能把 relative L2 的深度曲线读成单调累积;残差、归一化与注意力会让差异 +被放大、旋转或部分抵消。 + +--- + +## 9. 26 个 gate 怎样分叉 + +ordered top-6 exact 比 set exact 更严格:前者要求六个专家及顺序完全一致;后者只要求专家集合 +一致。四域合计: + +| edge | ordered exact 最低层 | 最低比例 | layer 26 ordered exact | layer 26 set exact | +|---|---|---:|---:|---:| +| System on−off · EOS | 24 | 52.6% | 60.2% | 71.6% | +| System on−off · BOS | 24 | 47.0% | 56.9% | 69.8% | +| System on−off · x | 24 | 38.1% | 45.7% | 60.5% | +| System on−off · period | 24 | 36.6% | 44.2% | 59.1% | +| BOS−EOS · system off | 01 | 42.0% | 54.1% | 67.0% | +| BOS−EOS · system on | 24 | 40.9% | 50.6% | 64.9% | +| x−EOS · system off | 21 | 41.1% | 49.1% | 63.6% | +| x−EOS · system on | 24 | 32.9% | 44.6% | 58.9% | +| period−EOS · system off | 24 | 42.7% | 48.9% | 63.8% | +| period−EOS · system on | 24 | 34.8% | 43.4% | 57.2% | + +“最低层常在 24”是这 16 条 source 的描述事实,不是模型普遍规律,也不是 layer 24 的因果 +特殊性。更不能把 gate 分叉率直接解释成能力变化:路由只是稀疏 FFN 计算路径的一部分。 + +--- + +## 10. 全深度独立复跑与元数据缺陷 + +正式 trace 后重新启动进程,每域复跑第 1 条 source。逐字段核对: + +```text +source objects(去除 runtime 字段) 4 / 4 exact +hidden tensor SHA-256 1,856 / 1,856 exact +ordered-route SHA-256 1,664 / 1,664 exact +route-weight SHA-256 1,664 / 1,664 exact +所有隐藏 / 路由比较统计 exact +``` + +预发布核对曾发现 `content_token_ids_sha256` 错误引用了外层循环最后一条 source,并通过 +Python set 的迭代顺序让该顶层元数据在两个进程间不同。隐藏 tensor、route hash 与全部比较 +统计当时已经 exact;仍然修正脚本为“在每条 source 验证后立即保存其内容 token hash”,随后 +正式与复跑两份 trace 全部重跑。当前公开文件是修正后的结果。 + +这个例子说明:复跑不能只看 headline 数字,也要比较不参与结论的身份字段。 + +--- + +## 11. 文件、哈希与运行账 + +| 文件 | bytes | SHA-256 | +|---|---:|---| +| 512 formal generation | 871,946 | `6af40512c5868caab0ef58356aaa7728384f2b7acc7c502aa89478fdf5a2a468` | +| completion evaluation | 138,837 | `73f4616359d664377405dd989ee15cbf18e540e2f7b916b0ff99a99143091427` | +| 512 independent subset | 233,300 | `6c89f85ae783de5dfbe71694ba23307e79ca04f9522dd8684aef8f6f5295424d` | +| full-depth formal | 36,019,346 | `5678ed238f13e3b0d5cf7a3db2268dbddf13f047cdc3730771ba1c66d96426e8` | +| full-depth independent subset | 9,166,628 | `17c367cccce3698df6fa8a0c0455d2b0e52cd27e1f66717a66989a586dfd1098` | + +关键运行账: + +| 运行 | GPU placement | 模型加载 | 执行 | peak CUDA allocation | +|---|---|---:|---:|---:| +| 512 formal | 28 GiB | 8.42 s | 1,225.27 s generation | 31,464,357,376 B | +| full-depth formal | 28 GiB | 8.37 s | 13.55 s forward | 28,754,760,704 B | +| full-depth subset | 28 GiB | 8.44 s | 3.85 s forward | 28,754,760,704 B | + +这些 eager + offload 延迟不是生产 serving throughput。 + +--- + +## 12. 证据阶梯与下一步 + +```text +前六层 Base route + ↓ 回答早期路由是否分叉 + +完整 Chat generation + ↓ 回答最终 token 轨迹是否结束、可评测、正确 + +29-stage hidden + 26-gate route + ↓ 回答同一输入差异怎样穿过完整 checkpoint + +尚未完成: + 干预式 mediation、更多 source、sampling robustness、 + 标准 benchmark harness、generation-time KV / serving trace +``` + +本轮最重要的边界仍然是: + +- hidden/router association 不是中介因果; +- 4 道 math / code 不是 benchmark; +- 固定 greedy exact 不是采样鲁棒性; +- counterfactual token 序列不是官方有效聊天; +- prompt-only `use_cache=false` trace 不是生成期 KV 或生产服务轨迹; +- HumanEval tests pass 不是代码安全。 diff --git a/research/DEEPSEEK_V2_LITE_CHAT_COMPLETION_PROTOCOL.md b/research/DEEPSEEK_V2_LITE_CHAT_COMPLETION_PROTOCOL.md new file mode 100644 index 0000000..fa681c5 --- /dev/null +++ b/research/DEEPSEEK_V2_LITE_CHAT_COMPLETION_PROTOCOL.md @@ -0,0 +1,331 @@ +# DeepSeek-V2-Lite-Chat completion-aware 生成与任务评测协议 + +> 状态:已执行;正式结果与独立复跑均通过预注册闸门 +> +> 上一阶段:`DEEPSEEK_V2_LITE_CHAT_BEHAVIOR_AUDIT.md` +> +> 模型:`deepseek-ai/DeepSeek-V2-Lite-Chat` +> +> revision:`85864749cd611b4353ce1decdb286193298f64c7` + +## 0. 这一轮要修正什么 + +Round 04 在 16 个固定 source、8 个条件上生成了 128 个输出,但只有 31 个自然遇到 +EOS,另外 97 个在 `max_new_tokens=128` 处停止。编辑距离和 exact comparison 仍然是 +真实观测;任务准确率却不能直接解释,因为: + +```text +没有出现最终数值 +≠ 数学推理已经失败 + +代码在第 128 token 处不能解析 +≠ 完整代码一定不能通过测试 + +生成达到长度上限 +≠ 模型主动结束回答 +``` + +本轮因此把“停止”“任务终点”“可评测”和“正确”拆成四张账。 + +--- + +## 1. 冻结不变的实验对象 + +下列对象全部继承 Round 04,不因结果调整: + +- 官方 SFT Chat checkpoint、12 个模型/tokenizer 文件及其 SHA-256; +- 4 个域 × 4 个 source,共 16 个完整公开 source; +- `system off/on × EOS/BOS/x/period` 八格; +- 同 source 八格进入同一个左填充 batch; +- EOS 为官方序列;BOS、`x`、句点各只替换一个历史边界 input ID; +- greedy、`do_sample=false`、`use_cache=true`; +- BF16 权重、官方 eager 实现与 Accelerate 模块级 CPU offload; +- 数学和代码各只有 4 条,仍不是 benchmark。 + +数据身份: + +- English / Chinese 只测生成终止与成对输出变化,没有 gold correctness; +- Math 使用 GSM8K 官方 `answer`; +- Code 使用 OpenAI HumanEval 官方 `prompt`、`test` 与 `entry_point`; +- gold 与 tests 从不进入模型 prompt。 + +来源: +[GSM8K](https://github.com/openai/grade-school-math)、 +[HumanEval](https://github.com/openai/human-eval/tree/6d43fb980f9fee3c892a914eda09951f772ad10d)。 + +--- + +## 2. 统一预算,而不是选择性续写 + +执行阶梯: + +```text +已发布 baseline = 4 source/domain × 8 conditions × 128 new tokens +512 smoke = 1 source/domain × 8 conditions × 512 new tokens +512 formal = 4 source/domain × 8 conditions × 512 new tokens +512 independent = 1 source/domain × 8 conditions × 512 new tokens +``` + +不能只给 97 个截断格追加预算。那会让“之前是否完成”决定后续算力,破坏八格比较。512 +正式运行必须重跑全部 128 格。 + +进入正式运行前,smoke 必须满足: + +1. 32 / 32 prompt token hashes 与 128 baseline 相同; +2. 32 / 32 新输出的前 `min(128, baseline length)` 个 token 与 baseline exact; +3. 没有 OOM、NaN 或 runtime exception; +4. EOS、PAD、左填充和单 ID edit 合同不变; +5. evaluator 可以对 32 格全部产出 completion state。 + +正式运行还必须满足: + +```text +128 / 128 prompt hashes exact +128 / 128 baseline token prefixes exact +``` + +独立复跑只覆盖每域第 1 条的 32 格,因此只能写“32 / 32 长序列复现”,不能写 +“128 / 128 独立复跑”。 + +--- + +## 3. 正式运行前的显存协议修订 + +29 GiB static-placement smoke 成功: + +```text +CUDA resident = embedding + layers 0–24 +CPU offloaded = layers 25–26 + final norm + lm_head +32 outputs = 完成 +``` + +但 16-source formal 在更长 source 的 512-token KV 状态下,于 offloaded `lm_head` +临时回装执行设备时申请 400 MiB 失败;脚本在写 JSON 前退出,没有产生可选择的正式结果。 +这说明 `max_memory=29GiB` 只约束静态参数放置,不是 activation、KV 和临时回装后的硬峰值。 + +正式运行改为: + +```text +max_memory[CUDA:0] = 28 GiB +CUDA resident = embedding + layers 0–23 +CPU offloaded = layers 24–26 + final norm + lm_head +allocator = expandable_segments:True +八格 batch = 不拆分 +``` + +这里的 `CPU offloaded` 是驻留身份;Accelerate hook 会在 forward 前把模块权重带到执行 +设备,不能把 device map 写成“后三层在 CPU 做矩阵乘”。 + +修订发生在成功 formal 结果之前。为检查它是否改变输出,28 GiB smoke 与此前 29 GiB +smoke 逐格比较: + +```text +prompt hash exact 32 / 32 +generated token IDs exact 32 / 32 +decoded text exact 32 / 32 +EOS state exact 32 / 32 +``` + +因此正式运行采用 28 GiB,同时把两次 OOM、两张 device map、峰值显存和跨放置 exact +闸门全部写入审计。若成功 formal 的 baseline 前缀不是 128 / 128 exact,仍判失败。 + +--- + +## 4. 四张 completion 账 + +每个输出保存以下互不替代的字段: + +### 4.1 停止账 + +- `natural_eos`:生成序列实际遇到官方 EOS; +- `budget_truncated`:未遇 EOS 且正好达到 512-token 上限; +- `other_stop`:两者皆否;出现时必须单独调查。 + +### 4.2 任务终点账 + +- Math:出现明确 `\boxed{}`、`####` 或 final-answer 语言标记; +- Code:出现闭合 Python code fence,或自然 EOS; +- English / Chinese:没有任务终点判定器,不用句号冒充完成。 + +### 4.3 可评测账 + +- Math:终点范围内能抽取规范化数值; +- Code:抽出的 candidate 能通过 Python AST,并进入隔离沙箱; +- 截断后的“最后一个数字”只保存为 fallback 诊断,不进入严格完成指标。 + +### 4.4 正确账 + +- Math:规范化预测数值与 GSM8K gold final exact; +- Code:HumanEval 官方 `check(candidate)` 在隔离沙箱退出 0; +- 同时报告固定预算 pass 与 strict-complete pass; +- completion-conditioned accuracy 只作选择偏差明显的诊断,不作为主准确率。 + +由此得到五种状态: + +```text +NATURAL_EOS +TASK_TERMINAL_BEFORE_EOS +BUDGET_TRUNCATED_WITH_FALLBACK_ONLY +BUDGET_TRUNCATED_UNRESOLVED +OTHER_STOP +``` + +--- + +## 5. 数学答案抽取 + +按以下优先级只取最后一个命中: + +1. `\boxed{number}`; +2. `#### number`; +3. 明确的 `answer/result/total/profit ... is/= number`; +4. 文本最后数值,仅作 fallback。 + +数字统一: + +- 去逗号; +- `Decimal` 规范化; +- 去无意义末尾零; +- `-0/+0 → 0`。 + +主指标: + +```text +fixed_budget_numeric_exact = gold 与任何抽取结果 exact +strict_complete_numeric_exact + = gold exact + AND (natural EOS OR explicit final marker) +``` + +fallback exact 可以显示,但不能冒充 strict completion。 + +--- + +## 6. HumanEval 执行合同 + +代码抽取优先级: + +1. 包含目标 `def entry_point` 的 Python fence; +2. 其他 Python fence; +3. 文本中目标函数定义起点; +4. 作为官方 prompt 的 completion suffix。 + +每个 candidate 单独进入一个全新 Docker 容器: + +```text +network = none +filesystem = read-only +user = 65534:65534 +capabilities = drop ALL +no-new-privilege = true +memory / swap = 256 MiB / 256 MiB +pids = 64 +cpus = 0.5 +wall timeout = 5 s +/tmp = 16 MiB tmpfs, noexec,nosuid +Python = pinned image digest +``` + +容器没有 host mount,不读取仓库、Docker socket、凭据或网络。官方 `test` 和 +`check(entry_point)` 只在容器内拼接;结果 JSON 不复制隐藏测试正文,只保存输入数据 hash、 +harness hash、退出分类与运行时间。 + +退出分类: + +- `passed`; +- `assertion_failed`; +- `runtime_error`; +- `timeout`; +- `ast_error`; +- `sandbox_error`。 + +HumanEval 官方仓库本身警告不要在不受信环境中直接执行生成代码;这里把容器隔离合同当作 +结果的一部分,而不是一句“用了 sandbox”。 + +--- + +## 7. 预注册汇总 + +每个 condition 与 domain 同时报告: + +- natural EOS / budget truncated; +- explicit task terminal; +- evaluator coverage; +- math fixed-budget exact / strict-complete exact; +- code AST / executed / passed; +- completion class 计数; +- mean generated tokens。 + +成对比较继续报告: + +- token IDs exact; +- common prefix; +- edit distance; +- normalized similarity。 + +另外新增: + +- 128→512 completion gain; +- 128-token prefix exact; +- 32-cell 独立复跑 exact; +- 每个比较边两侧的 completion class,防止“一个完整、一个截断”被压成单个 edit distance。 + +每域只有 4 条,因此所有 task 分数都保留分子/分母,不报告总体能力置信区间。 + +--- + +## 8. 仍然禁止的结论 + +- 512 tokens 足以代表模型最大能力; +- EOS 条件让答案更好; +- ordinary token 让回答更差; +- 4 条 GSM8K / HumanEval 等于 benchmark; +- completion-conditioned accuracy 可以与标准 pass@1 横比; +- greedy deterministic exact 等于 sampling robustness; +- HumanEval 通过说明代码安全; +- Chat 输出变化由 Base 前六层 route TV 造成; +- CPU offload 延迟代表生产吞吐。 + +--- + +## 9. 与全 27 层 trace 的接口 + +完整 27 层 forward 是另一条证据线: + +```text +completion evaluator → 回答“输出是否结束、可评测、正确” +27-layer trace → 回答“同一输入怎样经过全部层与 26 个 MoE gates” +``` + +二者只有在同 checkpoint、同完整输入、同 condition、同 prompt hash 下才能做预注册关联; +即使 route feature 与输出分叉相关,也不能自动升级为中介因果。 + +--- + +## 10. 执行后登记(不回写预注册定义) + +正式结果见 `DEEPSEEK_V2_LITE_CHAT_COMPLETION_DEPTH_AUDIT.md`。这里只登记协议闸门: + +```text +512 formal + prompt hash 与 baseline exact 128 / 128 + baseline generated prefix exact 128 / 128 + natural EOS 121 / 128 + budget truncated 7 / 128 + +512 independent subset + 完整 generated token IDs exact 32 / 32 + decoded text / EOS / truncation exact 32 / 32 + +full-depth independent subset + source object 去 runtime 后 exact 4 / 4 + hidden tensor hashes exact 1,856 / 1,856 + ordered route hashes exact 1,664 / 1,664 + route-weight hashes exact 1,664 / 1,664 +``` + +正式生成 SHA-256: +`6af40512c5868caab0ef58356aaa7728384f2b7acc7c502aa89478fdf5a2a468`。 + +正式全深度 trace SHA-256: +`5678ed238f13e3b0d5cf7a3db2268dbddf13f047cdc3730771ba1c66d96426e8`。 diff --git a/scripts/build-deepseek-chat-completion-depth-compact.mjs b/scripts/build-deepseek-chat-completion-depth-compact.mjs new file mode 100644 index 0000000..c14c102 --- /dev/null +++ b/scripts/build-deepseek-chat-completion-depth-compact.mjs @@ -0,0 +1,461 @@ +import { createHash } from "node:crypto"; +import { readFileSync, statSync, writeFileSync } from "node:fs"; +import { resolve } from "node:path"; + +const root = resolve(import.meta.dirname, ".."); +const paths = { + baseline: resolve(root, "src/data/deepseek-v2-lite-chat-behavior.json"), + completion: resolve( + root, + "src/data/deepseek-v2-lite-chat-completion-512.json", + ), + completionEval: resolve( + root, + "src/data/deepseek-v2-lite-chat-completion-512-eval.json", + ), + completionRepro: resolve( + root, + "src/data/deepseek-v2-lite-chat-completion-512-repro-1pd.json", + ), + depth: resolve( + root, + "src/data/deepseek-v2-lite-chat-full-depth.json", + ), + depthRepro: resolve( + root, + "src/data/deepseek-v2-lite-chat-full-depth-repro-1pd.json", + ), + output: resolve( + root, + "src/data/deepseek-v2-lite-chat-completion-depth-compact.json", + ), +}; + +const readJson = (path) => JSON.parse(readFileSync(path, "utf8")); +const sha256 = (path) => createHash("sha256") + .update(readFileSync(path)) + .digest("hex"); +const artifact = (path) => ({ + bytes: statSync(path).size, + sha256: sha256(path), +}); + +const baseline = readJson(paths.baseline); +const completion = readJson(paths.completion); +const completionEval = readJson(paths.completionEval); +const completionRepro = readJson(paths.completionRepro); +const depth = readJson(paths.depth); +const depthRepro = readJson(paths.depthRepro); + +const completionArtifact = artifact(paths.completion); +const baselineArtifact = artifact(paths.baseline); +if ( + completionEval.input.behavior_sha256 !== completionArtifact.sha256 + || completionEval.input.baseline_sha256 !== baselineArtifact.sha256 +) { + throw new Error("completion evaluator input hash contract failed"); +} + +const outputKey = (sourceId, condition) => `${sourceId}\0${condition}`; +const completionByKey = new Map( + completion.sources.flatMap((source) => source.outputs.map((output) => [ + outputKey(source.id, output.condition), + output, + ])), +); +const completionReproduction = { + sources: completionRepro.sources.length, + cells: 0, + promptHashExact: 0, + generatedTokenIdsExact: 0, + generatedTextExact: 0, + eosStateExact: 0, + truncationStateExact: 0, +}; +for (const source of completionRepro.sources) { + for (const output of source.outputs) { + const formal = completionByKey.get(outputKey(source.id, output.condition)); + if (!formal) { + throw new Error( + `completion formal output missing: ${source.id}/${output.condition}`, + ); + } + completionReproduction.cells += 1; + completionReproduction.promptHashExact += ( + formal.prompt_token_ids_sha256 === output.prompt_token_ids_sha256 + ); + completionReproduction.generatedTokenIdsExact += ( + JSON.stringify(formal.generated_token_ids) + === JSON.stringify(output.generated_token_ids) + ); + completionReproduction.generatedTextExact += formal.text === output.text; + completionReproduction.eosStateExact += formal.hit_eos === output.hit_eos; + completionReproduction.truncationStateExact += ( + formal.stopped_at_max_new_tokens + === output.stopped_at_max_new_tokens + ); + } +} +for (const [name, value] of Object.entries(completionReproduction)) { + if ( + !["sources", "cells"].includes(name) + && value !== completionReproduction.cells + ) { + throw new Error( + `completion reproduction mismatch: ${name}=${value}`, + ); + } +} + +const stableDepthSource = (source) => { + const copy = structuredClone(source); + delete copy.forward_seconds; + delete copy.peak_cuda_memory_allocated_bytes; + return copy; +}; +const depthSourceById = new Map( + depth.sources.map((source) => [source.id, source]), +); +const depthReproduction = { + sources: depthRepro.sources.length, + sourceObjectsExactAfterRuntimeStrip: 0, + hiddenStagesPerSource: 29, + routerLayersPerSource: 26, + hiddenTensorHashesExact: 0, + hiddenTensorHashesCompared: 0, + orderedRouteHashesExact: 0, + orderedRouteHashesCompared: 0, + routeWeightHashesExact: 0, + routeWeightHashesCompared: 0, +}; +for (const rerunSource of depthRepro.sources) { + const formalSource = depthSourceById.get(rerunSource.id); + if (!formalSource) { + throw new Error(`depth formal source missing: ${rerunSource.id}`); + } + depthReproduction.sourceObjectsExactAfterRuntimeStrip += ( + JSON.stringify(stableDepthSource(formalSource)) + === JSON.stringify(stableDepthSource(rerunSource)) + ); + for (const [stage, stageValue] of Object.entries( + rerunSource.hidden_stages, + )) { + for (const [condition, conditionValue] of Object.entries( + stageValue.conditions, + )) { + for (const scope of ["target_content", "full_input"]) { + depthReproduction.hiddenTensorHashesCompared += 1; + depthReproduction.hiddenTensorHashesExact += ( + formalSource.hidden_stages[stage].conditions[condition][scope] + .tensor_sha256 + === conditionValue[scope].tensor_sha256 + ); + } + } + } + for (const [layer, layerValue] of Object.entries( + rerunSource.router_layers, + )) { + for (const [condition, conditionValue] of Object.entries( + layerValue.conditions, + )) { + for (const scope of ["target_content", "full_input"]) { + const formalScope = ( + formalSource.router_layers[layer].conditions[condition][scope] + ); + depthReproduction.orderedRouteHashesCompared += 1; + depthReproduction.orderedRouteHashesExact += ( + formalScope.ordered_route_sha256 + === conditionValue[scope].ordered_route_sha256 + ); + depthReproduction.routeWeightHashesCompared += 1; + depthReproduction.routeWeightHashesExact += ( + formalScope.route_weight_sha256 + === conditionValue[scope].route_weight_sha256 + ); + } + } + } +} +if ( + depthReproduction.sourceObjectsExactAfterRuntimeStrip + !== depthReproduction.sources + || depthReproduction.hiddenTensorHashesExact + !== depthReproduction.hiddenTensorHashesCompared + || depthReproduction.orderedRouteHashesExact + !== depthReproduction.orderedRouteHashesCompared + || depthReproduction.routeWeightHashesExact + !== depthReproduction.routeWeightHashesCompared +) { + throw new Error( + `depth reproduction mismatch: ${JSON.stringify(depthReproduction)}`, + ); +} + +const conditions = Object.keys(completion.generation_contract.conditions); +const edgeOrder = Object.keys(depth.trace_contract.edge_pairs); +const edgeLabels = { + system_eos: "System on − off · EOS", + system_bos: "System on − off · BOS", + system_x: "System on − off · x", + system_period: "System on − off · 句点", + bos_at_s0: "BOS − EOS · system off", + bos_at_s1: "BOS − EOS · system on", + x_at_s0: "x − EOS · system off", + x_at_s1: "x − EOS · system on", + period_at_s0: "句点 − EOS · system off", + period_at_s1: "句点 − EOS · system on", +}; +const domains = ["all", "english", "chinese", "code", "math"]; +const hiddenStages = [ + "embedding", + ...Array.from({ length: 27 }, (_, index) => ( + `layer_${String(index).padStart(2, "0")}` + )), + "final_norm", +]; +const routerLayers = Array.from({ length: 26 }, (_, index) => ( + `layer_${String(index + 1).padStart(2, "0")}` +)); + +const sourcesForDomain = (domain) => ( + domain === "all" + ? depth.sources + : depth.sources.filter((source) => source.domain === domain) +); +const mean = (values) => ( + values.reduce((sum, value) => sum + value, 0) / values.length +); +const aggregateHidden = (sources, stage, edge) => { + const rows = sources.map( + (source) => ( + source.hidden_stages[stage].target_comparisons[edge] + ), + ); + const tokens = rows.reduce((sum, row) => sum + row.tokens, 0); + return { + tokens, + exactRows: rows.reduce( + (sum, row) => sum + row.exact_hidden_rows, + 0, + ), + meanCosine: rows.reduce( + (sum, row) => sum + row.mean_cosine_similarity * row.tokens, + 0, + ) / tokens, + meanRelativeL2: mean(rows.map((row) => row.mean_relative_l2)), + maxAbsDelta: Math.max(...rows.map((row) => row.max_abs_delta)), + }; +}; +const aggregateRouter = (sources, layer, edge) => { + const rows = sources.map( + (source) => ( + source.router_layers[layer].target_comparisons[edge] + ), + ); + const tokens = rows.reduce((sum, row) => sum + row.tokens, 0); + const orderedExact = rows.reduce( + (sum, row) => sum + row.ordered_topk_exact_tokens, + 0, + ); + const setExact = rows.reduce( + (sum, row) => sum + row.set_exact_tokens, + 0, + ); + return { + tokens, + orderedExact, + orderedExactRate: orderedExact / tokens, + setExact, + setExactRate: setExact / tokens, + meanSetJaccard: rows.reduce( + (sum, row) => sum + row.mean_set_jaccard * row.tokens, + 0, + ) / tokens, + meanTokenWeightedTv: mean( + rows.map((row) => row.mean_token_weighted_tv), + ), + meanAggregateLoadTv: mean( + rows.map((row) => row.aggregate_load_tv), + ), + }; +}; + +const hiddenSeries = Object.fromEntries(domains.map((domain) => { + const sources = sourcesForDomain(domain); + return [domain, Object.fromEntries(edgeOrder.map((edge) => [ + edge, + hiddenStages.map((stage) => ({ + stage, + ...aggregateHidden(sources, stage, edge), + })), + ]))]; +})); +const routerSeries = Object.fromEntries(domains.map((domain) => { + const sources = sourcesForDomain(domain); + return [domain, Object.fromEntries(edgeOrder.map((edge) => [ + edge, + routerLayers.map((layer) => ({ + layer, + ...aggregateRouter(sources, layer, edge), + })), + ]))]; +})); + +const evaluationRows = completionEval.rows.map((row) => ({ + sourceId: row.source_id, + domain: row.domain, + condition: row.condition, + generatedTokens: row.generated_tokens, + hitEos: row.hit_eos, + completionClass: row.completion_class, + taskEvaluation: row.task_evaluation, +})); +const incompleteRows = evaluationRows.filter((row) => !row.hitEos); +const codeRows = evaluationRows.filter((row) => row.domain === "code"); +const mathRows = evaluationRows.filter((row) => row.domain === "math"); +const codeStatuses = Object.groupBy( + codeRows, + (row) => row.taskEvaluation.execution?.status ?? "not_run", +); +const mathExtraction = Object.groupBy( + mathRows, + (row) => row.taskEvaluation.extraction_method, +); + +const baselineNaturalEos = baseline.sources.reduce( + (sum, source) => ( + sum + source.outputs.filter((output) => output.hit_eos).length + ), + 0, +); +const boundaryCrossingTokens = depth.sources.reduce( + (sum, source) => ( + sum + Object.values(source.boundary_crossing_tokens_by_condition) + .reduce((sourceSum, value) => sourceSum + value, 0) + ), + 0, +); +const { + hidden: _hiddenSummary, + routes: _routeSummary, + ...depthHeadline +} = depth.summary; + +const compact = { + schemaVersion: 1, + artifacts: Object.fromEntries( + Object.entries(paths) + .filter(([name]) => name !== "output") + .map(([name, path]) => [name, artifact(path)]), + ), + model: { + repo: completion.model.repo, + revision: completion.model.revision, + checkpointIdentity: completion.model.checkpoint_identity, + architecture: completion.model.architecture, + dtype: completion.model.dtype, + }, + contract: { + conditions, + conditionFactors: completion.generation_contract.conditions, + edgeOrder, + edgePairs: depth.trace_contract.edge_pairs, + edgeLabels, + domains, + targetScope: depth.source_contract.target_scope, + decode: completion.generation_contract.decode, + maxNewTokens: completion.generation_contract.max_new_tokens, + useCacheGeneration: completion.generation_contract.use_cache, + useCacheTrace: depth.trace_contract.use_cache, + }, + completion: { + budgetLadder: [ + { + maxNewTokens: baseline.generation_contract.max_new_tokens, + naturalEos: baselineNaturalEos, + truncated: 128 - baselineNaturalEos, + outputs: 128, + }, + { + maxNewTokens: 512, + naturalEos: completionEval.summary.natural_eos, + truncated: completionEval.summary.budget_truncated, + outputs: completionEval.summary.outputs, + }, + ], + summary: completionEval.summary, + incompleteRows, + taskRows: evaluationRows.filter( + (row) => ["code", "math"].includes(row.domain), + ), + taskTotals: { + math: { + strictCorrect: mathRows.filter( + (row) => ( + row.taskEvaluation.strict_complete_numeric_exact + ), + ).length, + total: mathRows.length, + extractionMethods: Object.fromEntries( + Object.entries(mathExtraction).map(([key, rows]) => [ + key, + rows.length, + ]), + ), + }, + code: { + testsPassed: codeRows.filter( + (row) => row.taskEvaluation.fixed_budget_tests_pass, + ).length, + total: codeRows.length, + statuses: Object.fromEntries( + Object.entries(codeStatuses).map(([key, rows]) => [ + key, + rows.length, + ]), + ), + }, + }, + sandbox: completionEval.sandbox, + reproduction: completionReproduction, + execution: completion.execution, + claimBoundary: completionEval.claim_boundary, + }, + depth: { + summary: depthHeadline, + hiddenSeries, + routerSeries, + hiddenStages, + routerLayers, + boundaryCrossingTokens, + sources: depth.sources.map((source) => ({ + id: source.id, + domain: source.domain, + label: source.label, + contentTokens: source.content_tokens, + contentTokenIdsSha256: source.content_token_ids_sha256, + boundaryCrossingTokensByCondition: ( + source.boundary_crossing_tokens_by_condition + ), + })), + reproduction: depthReproduction, + execution: depth.execution, + claimBoundary: depth.claim_boundary, + }, +}; + +writeFileSync( + paths.output, + `${JSON.stringify(compact, null, 2)}\n`, + "utf8", +); +process.stdout.write( + `${paths.output}\n` + + `${statSync(paths.output).size} bytes compact\n` + + `${completionReproduction.generatedTokenIdsExact}` + + ` / ${completionReproduction.cells} completion cells exact\n` + + `${depthReproduction.sourceObjectsExactAfterRuntimeStrip}` + + ` / ${depthReproduction.sources} depth sources exact` + + " after runtime strip\n", +); diff --git a/scripts/check-deepseek-browser.mjs b/scripts/check-deepseek-browser.mjs index 082a7a1..c803aa0 100644 --- a/scripts/check-deepseek-browser.mjs +++ b/scripts/check-deepseek-browser.mjs @@ -80,6 +80,10 @@ const overview = await evaluate(`(() => ({ behaviorPanels: document.querySelectorAll("[data-behavior-panel]").length, behaviorSources: document.querySelectorAll("[data-behavior-source] option").length, behaviorEdges: document.querySelectorAll("[data-behavior-map-edge]").length, + completionDepthTabs: document.querySelectorAll("[data-cd-tab]").length, + completionDepthPanels: document.querySelectorAll("[data-cd-panel]").length, + hiddenStages: document.querySelectorAll("[data-hidden-stage]").length, + routerLayers: document.querySelectorAll("[data-router-layer]").length, branches: document.querySelectorAll(".branch-grid > a").length, followups: document.querySelectorAll(".lineage-row.followup").length, navLinks: document.querySelectorAll(".top-nav a").length, @@ -879,6 +883,86 @@ await evaluate(`(() => { await pause(180); await screenshot("/tmp/llm-atlas-deepseek-behavior-desktop.png"); +const completionDepth = await evaluate(`(() => { + const root = document.querySelector("[data-completion-depth-lab]"); + const initial = { + panel: root.querySelector("[data-cd-panel]:not([hidden])").dataset.cdPanel, + conditionRows: root.querySelectorAll("[data-completion-condition]").length, + incompleteRows: root.querySelectorAll(".incomplete-ledger article").length, + prefixCards: root.querySelectorAll(".prefix-gate > article").length, + }; + root.querySelector('[data-cd-tab="tasks"]').click(); + const condition = root.querySelector("[data-task-condition]"); + condition.value = "s1_eos"; + condition.dispatchEvent(new Event("change", { bubbles: true })); + const tasks = { + panel: root.querySelector("[data-cd-panel]:not([hidden])").dataset.cdPanel, + mathCards: root.querySelectorAll("[data-math-task-grid] > article").length, + codeCards: root.querySelectorAll("[data-code-task-grid] > article").length, + mathTotal: root.querySelector("[data-math-condition-total]").textContent.trim(), + codeTotal: root.querySelector("[data-code-condition-total]").textContent.trim(), + sandboxSteps: root.querySelectorAll(".sandbox-flow > article").length, + }; + root.querySelector('[data-cd-tab="hidden"]').click(); + const hiddenEdge = root.querySelector("[data-hidden-edge]"); + const hiddenDomain = root.querySelector("[data-hidden-domain]"); + const hiddenMetric = root.querySelector("[data-hidden-metric]"); + hiddenEdge.value = "period_at_s1"; + hiddenEdge.dispatchEvent(new Event("change", { bubbles: true })); + hiddenDomain.value = "code"; + hiddenDomain.dispatchEvent(new Event("change", { bubbles: true })); + hiddenMetric.value = "relative"; + hiddenMetric.dispatchEvent(new Event("change", { bubbles: true })); + root.querySelector('[data-hidden-stage="8"]').click(); + const hidden = { + panel: root.querySelector("[data-cd-panel]:not([hidden])").dataset.cdPanel, + stages: root.querySelectorAll("[data-hidden-stage]").length, + selected: root.querySelector("[data-hidden-stage-name]").textContent.trim(), + cosine: root.querySelector("[data-hidden-cosine]").textContent.trim(), + relative: root.querySelector("[data-hidden-relative]").textContent.trim(), + exact: root.querySelector("[data-hidden-exact]").textContent.trim(), + points: root.querySelector("[data-hidden-line]").getAttribute("points").split(" ").length, + }; + root.querySelector('[data-cd-tab="router"]').click(); + const routerEdge = root.querySelector("[data-router-edge]"); + const routerDomain = root.querySelector("[data-router-domain]"); + routerEdge.value = "period_at_s1"; + routerEdge.dispatchEvent(new Event("change", { bubbles: true })); + routerDomain.value = "math"; + routerDomain.dispatchEvent(new Event("change", { bubbles: true })); + root.querySelector('[data-router-layer="23"]').click(); + const router = { + panel: root.querySelector("[data-cd-panel]:not([hidden])").dataset.cdPanel, + layers: root.querySelectorAll("[data-router-layer]").length, + selected: root.querySelector("[data-router-layer-name]").textContent.trim(), + ordered: root.querySelector("[data-router-ordered]").textContent.trim(), + setExact: root.querySelector("[data-router-set]").textContent.trim(), + tv: root.querySelector("[data-router-tv]").textContent.trim(), + points: root.querySelector("[data-router-line]").getAttribute("points").split(" ").length, + reproCards: root.querySelectorAll(".repro-proof > article").length, + links: root.querySelectorAll('[data-cd-panel="router"] .artifact-links > a').length, + }; + const first = root.querySelector('[data-cd-tab="completion"]'); + first.focus(); + first.dispatchEvent(new KeyboardEvent("keydown", { key: "ArrowRight", bubbles: true })); + return { + initial, + tasks, + hidden, + router, + keyboardSelected: root.querySelector('[data-cd-tab][aria-selected="true"]').dataset.cdTab, + keyboardVisible: root.querySelector("[data-cd-panel]:not([hidden])").dataset.cdPanel, + }; +})()`); +await evaluate(`(() => { + const root = document.querySelector("[data-completion-depth-lab]"); + root.querySelector('[data-cd-tab="hidden"]').click(); + root.scrollIntoView({ block: "start", behavior: "instant" }); + window.scrollBy(0, -82); +})()`); +await pause(180); +await screenshot("/tmp/llm-atlas-deepseek-completion-depth-desktop.png"); + await navigate("/"); const home = await evaluate(`(() => ({ releaseCards: document.querySelectorAll(".release-card").length, @@ -912,6 +996,7 @@ const mobile = await evaluate(`(() => { const root = document.querySelector("[data-deepseek-lab]"); const artifact = document.querySelector("[data-dsv2-lab]"); const behavior = document.querySelector("[data-behavior-lab]"); + const completionDepth = document.querySelector("[data-completion-depth-lab]"); root.scrollIntoView({ block: "start", behavior: "instant" }); const toggle = document.querySelector("#menu-toggle"); toggle?.click(); @@ -926,6 +1011,9 @@ const mobile = await evaluate(`(() => { behaviorSources: behavior.querySelectorAll("[data-behavior-source] option").length, behaviorEdges: behavior.querySelectorAll("[data-behavior-map-edge]").length, behaviorDeviceCells: behavior.querySelectorAll(".layer-device-map > span").length, + completionDepthTabs: completionDepth.querySelectorAll("[data-cd-tab]").length, + completionDepthHiddenStages: completionDepth.querySelectorAll("[data-hidden-stage]").length, + completionDepthRouterLayers: completionDepth.querySelectorAll("[data-router-layer]").length, artifactHeatCells: artifact.querySelectorAll("[data-route-heatmap] > span").length, corpusCohorts: artifact.querySelectorAll("[data-corpus-cohort]").length, lengthDeltaCards: artifact.querySelectorAll("[data-length-delta-grid] > article").length, @@ -975,7 +1063,7 @@ const mobile = await evaluate(`(() => { roleBlockDomainCards: artifact.querySelectorAll("[data-role-block-domain-grid] > article").length, roleBlockDepthCells: artifact.querySelectorAll("[data-role-block-depth-map] > div > span").length, offenders: [...document.querySelectorAll("body *")] - .filter((node) => !node.closest(".paper-chain, .advantage-table, .precision-table, .mapping-table, [data-deepseek-lab], [data-dsv2-lab], [data-behavior-lab]")) + .filter((node) => !node.closest(".paper-chain, .advantage-table, .precision-table, .mapping-table, [data-deepseek-lab], [data-dsv2-lab], [data-behavior-lab], [data-completion-depth-lab]")) .filter((node) => node.getBoundingClientRect().right > document.documentElement.clientWidth + 1) .slice(0, 12) .map((node) => ({ @@ -1107,20 +1195,29 @@ await evaluate(`(() => { })()`); await pause(180); await screenshot("/tmp/llm-atlas-deepseek-behavior-mobile.png"); +await evaluate(`(() => { + const completionDepth = document.querySelector("[data-completion-depth-lab]"); + completionDepth.querySelector('[data-cd-tab="router"]').click(); + completionDepth.scrollIntoView({ block: "start", behavior: "instant" }); + window.scrollBy(0, -70); +})()`); +await pause(180); +await screenshot("/tmp/llm-atlas-deepseek-completion-depth-mobile.png"); -const report = { overview, capacity, cache, codesign, rl, artifactRoute, artifactLoad, artifactCache, artifactAbsorb, artifactCorpus, artifactTemplate, artifactHistory, artifactDistance, artifactBoundary, artifactRole, artifactSpecial, artifactRoleBlock, artifactEvidence, behavior, home, papers, mobile, exceptions }; +const report = { overview, capacity, cache, codesign, rl, artifactRoute, artifactLoad, artifactCache, artifactAbsorb, artifactCorpus, artifactTemplate, artifactHistory, artifactDistance, artifactBoundary, artifactRole, artifactSpecial, artifactRoleBlock, artifactEvidence, behavior, completionDepth, home, papers, mobile, exceptions }; console.log(JSON.stringify(report, null, 2)); const numeric = (text) => Number.parseFloat(text.replaceAll(",", "")); const failures = []; if (!overview.title.includes("为什么转向")) failures.push("专题标题异常"); -if (overview.sections !== 27 || overview.tocLinks !== 27) failures.push("二十六个编号专题加阅读链的目录结构异常"); +if (overview.sections !== 28 || overview.tocLinks !== 28) failures.push("二十七个编号专题加阅读链的目录结构异常"); if (overview.ledgers !== 24 || overview.waves !== 10) failures.push("二十四张问题账或十次转向结构异常"); if (overview.paperLinks !== 60 || overview.branches !== 5 || overview.followups !== 1) failures.push("论文链、旁支或公开后续标记异常"); if (overview.labTabs !== 4 || overview.labPanels !== 4) failures.push("四联实验结构异常"); if (overview.artifactTabs !== 13 || overview.artifactPanels !== 13 || overview.artifactLayers !== 27) failures.push("真实权重十三联实验结构异常"); if (overview.behaviorTabs !== 4 || overview.behaviorPanels !== 4 || overview.behaviorSources !== 16 || overview.behaviorEdges !== 10) failures.push("Chat 行为实验结构异常"); -if (overview.heroLabs !== "18 个可操作实验") failures.push("DeepSeek 实验总数账异常"); +if (overview.completionDepthTabs !== 4 || overview.completionDepthPanels !== 4 || overview.hiddenStages !== 29 || overview.routerLayers !== 26) failures.push("Chat 完成度与全深度实验结构异常"); +if (overview.heroLabs !== "19 个可操作实验") failures.push("DeepSeek 实验总数账异常"); if (overview.navLinks !== 20 || home.navLinks !== 20 || mobile.mobileLinks !== 20 || overview.activeNav !== "DeepSeek") failures.push("全站导航未同步 DeepSeek"); if (overview.documentOverflow > 1 || mobile.documentOverflow > 1) failures.push("桌面或移动端存在文档级横向溢出"); if (capacity.initial.panel !== "capacity" || capacity.initial.total !== "32.1× FFN" || capacity.initial.active !== "1.13× FFN") failures.push("V3 稀疏容量初始账异常"); @@ -1213,9 +1310,14 @@ if (behavior.mathMap.panel !== "map" || behavior.mathMap.rows !== 10 || !behavio if (behavior.execution.panel !== "execution" || behavior.execution.layers !== 29 || behavior.execution.gpu !== 25 || behavior.execution.cpu !== 4 || behavior.execution.runtimeCards !== 4) failures.push("Chat BF16 GPU / CPU offload 设备图异常"); if (behavior.boundary.panel !== "boundary" || behavior.boundary.ladder !== 3 || behavior.boundary.tokenCards !== 4 || behavior.boundary.reproCards !== 4 || behavior.boundary.links !== 3 || !behavior.boundary.forbidden.includes("route TV")) failures.push("Chat 行为证据阶梯或限制异常"); if (behavior.keyboardSelected !== "map" || behavior.keyboardVisible !== "map") failures.push("Chat 行为实验键盘 tab 导航异常"); +if (completionDepth.initial.panel !== "completion" || completionDepth.initial.conditionRows !== 8 || completionDepth.initial.incompleteRows !== 7 || completionDepth.initial.prefixCards !== 3) failures.push("512-token 完成度阶梯结构异常"); +if (completionDepth.tasks.panel !== "tasks" || completionDepth.tasks.mathCards !== 4 || completionDepth.tasks.codeCards !== 4 || completionDepth.tasks.mathTotal !== "3 / 4 PASS" || completionDepth.tasks.codeTotal !== "2 / 4 PASS" || completionDepth.tasks.sandboxSteps !== 4) failures.push("Math / HumanEval 完成感知评测切换异常"); +if (completionDepth.hidden.panel !== "hidden" || completionDepth.hidden.stages !== 29 || completionDepth.hidden.selected !== "layer_07" || completionDepth.hidden.points !== 29 || completionDepth.hidden.exact === "1,537 / 1,537" || numeric(completionDepth.hidden.relative) <= 0) failures.push("29 阶段隐藏状态曲线或交互异常"); +if (completionDepth.router.panel !== "router" || completionDepth.router.layers !== 26 || completionDepth.router.selected !== "layer 24" || completionDepth.router.points !== 26 || !completionDepth.router.ordered.includes("%") || !completionDepth.router.setExact.includes("%") || numeric(completionDepth.router.tv) <= 0 || completionDepth.router.reproCards !== 4 || completionDepth.router.links !== 4) failures.push("26 层 MoE 路由曲线或复跑证据异常"); +if (completionDepth.keyboardSelected !== "tasks" || completionDepth.keyboardVisible !== "tasks") failures.push("完成度与全深度实验键盘 tab 导航异常"); if (home.releaseCards !== 17 || !home.firstRelease.includes("47 页不再压成摘要") || home.firstHref !== "/k3/" || home.paperCount !== "486") failures.push("首页 DeepSeek 首发入口或论文数异常"); if (papers.total !== 486 || !papers.hasFilter || papers.visible < 20 || !papers.hasCoder || !papers.hasEngram) failures.push("论文库 DeepSeek 聚光异常"); -if (!mobile.menuVisible || mobile.menuOpen !== "true" || mobile.tabs !== 4 || mobile.artifactTabs !== 13 || mobile.behaviorTabs !== 4 || mobile.behaviorSources !== 16 || mobile.behaviorEdges !== 10 || mobile.behaviorDeviceCells !== 29 || mobile.artifactHeatCells !== 64 || mobile.corpusCohorts !== 3 || mobile.lengthDeltaCards !== 4 || mobile.templateLayers !== 6 || mobile.templateScopes !== 2 || mobile.templateModes !== 2 || mobile.templateDomainCards !== 4 || mobile.templateDepthCells !== 24 || mobile.historyLayers !== 6 || mobile.historyScopes !== 2 || mobile.historyModes !== 2 || mobile.historyEffects !== 3 || mobile.historyDomainCards !== 4 || mobile.historyDepthCells !== 24 || mobile.distanceLayers !== 6 || mobile.distanceScopes !== 2 || mobile.distanceModes !== 2 || mobile.distanceContrasts !== 2 || mobile.distanceDomainCards !== 4 || mobile.distanceDepthCells !== 24 || mobile.boundaryLayers !== 6 || mobile.boundaryScopes !== 2 || mobile.boundaryModes !== 2 || mobile.boundaryContrasts !== 3 || mobile.boundaryTokenCards !== 4 || mobile.boundaryDomainCards !== 4 || mobile.boundaryDepthCells !== 24 || mobile.roleLayers !== 6 || mobile.roleScopes !== 2 || mobile.roleModes !== 2 || mobile.roleContrasts !== 3 || mobile.roleLevelCards !== 4 || mobile.roleDomainCards !== 4 || mobile.roleDepthCells !== 24 || mobile.specialLayers !== 6 || mobile.specialScopes !== 2 || mobile.specialModes !== 2 || mobile.specialContrasts !== 4 || mobile.specialTokenCards !== 4 || mobile.specialDomainCards !== 4 || mobile.specialDepthCells !== 24 || mobile.roleBlockLayers !== 6 || mobile.roleBlockScopes !== 2 || mobile.roleBlockModes !== 2 || mobile.roleBlockEffects !== 3 || mobile.roleBlockMatrixCards !== 4 || mobile.roleBlockDomainCards !== 4 || mobile.roleBlockDepthCells !== 24) failures.push("移动端导航或实验异常"); +if (!mobile.menuVisible || mobile.menuOpen !== "true" || mobile.tabs !== 4 || mobile.artifactTabs !== 13 || mobile.behaviorTabs !== 4 || mobile.behaviorSources !== 16 || mobile.behaviorEdges !== 10 || mobile.behaviorDeviceCells !== 29 || mobile.completionDepthTabs !== 4 || mobile.completionDepthHiddenStages !== 29 || mobile.completionDepthRouterLayers !== 26 || mobile.artifactHeatCells !== 64 || mobile.corpusCohorts !== 3 || mobile.lengthDeltaCards !== 4 || mobile.templateLayers !== 6 || mobile.templateScopes !== 2 || mobile.templateModes !== 2 || mobile.templateDomainCards !== 4 || mobile.templateDepthCells !== 24 || mobile.historyLayers !== 6 || mobile.historyScopes !== 2 || mobile.historyModes !== 2 || mobile.historyEffects !== 3 || mobile.historyDomainCards !== 4 || mobile.historyDepthCells !== 24 || mobile.distanceLayers !== 6 || mobile.distanceScopes !== 2 || mobile.distanceModes !== 2 || mobile.distanceContrasts !== 2 || mobile.distanceDomainCards !== 4 || mobile.distanceDepthCells !== 24 || mobile.boundaryLayers !== 6 || mobile.boundaryScopes !== 2 || mobile.boundaryModes !== 2 || mobile.boundaryContrasts !== 3 || mobile.boundaryTokenCards !== 4 || mobile.boundaryDomainCards !== 4 || mobile.boundaryDepthCells !== 24 || mobile.roleLayers !== 6 || mobile.roleScopes !== 2 || mobile.roleModes !== 2 || mobile.roleContrasts !== 3 || mobile.roleLevelCards !== 4 || mobile.roleDomainCards !== 4 || mobile.roleDepthCells !== 24 || mobile.specialLayers !== 6 || mobile.specialScopes !== 2 || mobile.specialModes !== 2 || mobile.specialContrasts !== 4 || mobile.specialTokenCards !== 4 || mobile.specialDomainCards !== 4 || mobile.specialDepthCells !== 24 || mobile.roleBlockLayers !== 6 || mobile.roleBlockScopes !== 2 || mobile.roleBlockModes !== 2 || mobile.roleBlockEffects !== 3 || mobile.roleBlockMatrixCards !== 4 || mobile.roleBlockDomainCards !== 4 || mobile.roleBlockDepthCells !== 24) failures.push("移动端导航或实验异常"); if (mobile.offenders.length) failures.push(`移动端越界元素:${JSON.stringify(mobile.offenders)}`); if (exceptions.length) failures.push(`浏览器异常:${exceptions.join(" | ")}`); diff --git a/src/components/DeepSeekCompletionDepthLab.astro b/src/components/DeepSeekCompletionDepthLab.astro new file mode 100644 index 0000000..4325e10 --- /dev/null +++ b/src/components/DeepSeekCompletionDepthLab.astro @@ -0,0 +1,851 @@ +--- +import rawLab from "@/data/deepseek-v2-lite-chat-completion-depth-compact.json"; + +const lab = rawLab as any; +const json = JSON.stringify(lab).replaceAll("<", "\\u003c"); +const conditions = [ + "s0_eos", + "s1_eos", + "s0_bos", + "s1_bos", + "s0_x", + "s1_x", + "s0_period", + "s1_period", +]; +const conditionLabels: Record = { + s0_eos: "S0 · EOS", + s1_eos: "S1 · EOS", + s0_bos: "S0 · BOS", + s1_bos: "S1 · BOS", + s0_x: "S0 · x", + s1_x: "S1 · x", + s0_period: "S0 · 句点", + s1_period: "S1 · 句点", +}; +const firstHidden = lab.depth.hiddenSeries.all.system_eos; +const firstRouter = lab.depth.routerSeries.all.system_eos; +const shortStage = (stage: string) => ( + stage === "embedding" + ? "E" + : stage === "final_norm" + ? "N" + : `L${Number(stage.slice(-2))}` +); +--- + +
+
+
+

ROUND 05 / COMPLETION × FULL DEPTH

+

一句输出怎样穿过 27 层:完成、答对、表示、路由分四张账

+
+

+ 同一官方 SFT Chat checkpoint、同 16 条完整 source、同八格输入。 + 先把统一预算升到 512,再沿 embedding → 27 decoder layers → final norm + 追踪隐藏状态,并读取 26 个 MoE gate。每个数字都能回到原始 JSON 与独立复跑。 +

+
+ +
+
512 · NATURAL EOS121 / 128

128-token 时只有 31 / 128

+
MATH · STRICT23 / 32

4 tasks × 8 conditions

+
CODE · TESTS PASS24 / 32

官方 HumanEval tests

+
HIDDEN TRACE29 stages

embedding + 27 layers + norm

+
ROUTER TRACE1,918,176

target top-6 decisions

+
FRESH-PROCESS RERUN5,184 hashes

hidden + route + weights exact

+
+ +
+ + + + +
+ +
+
+
I / STOPPING LEDGER

长度上限不是 EOS,更不是错误答案

+

+ 两次运行都对全部 128 格使用统一预算;不是只给先前截断的 97 格“续杯”。 + 512 解决了大部分截断,但仍有 7 格没有自然结束。 +

+
+ +
+ {lab.completion.budgetLadder.map((budget: any) => ( +
+
MAX NEW TOKENS{budget.maxNewTokens}
+
+ +
+
+
NATURAL EOS
{budget.naturalEos} / {budget.outputs}
+
BUDGET TRUNCATED
{budget.truncated} / {budget.outputs}
+
+
+ ))} +
统一重跑+90新增自然 EOS
+
+ +
+
CONDITIONNATURAL EOSMEAN TOKENSMATH STRICTCODE PASS
+ {conditions.map((condition) => { + const row = lab.completion.summary.by_condition[condition]; + return ( +
+ {conditionLabels[condition]} + {row.natural_eos} / 16 + {row.mean_generated_tokens.toFixed(1)} + {row.math_strict_complete_exact} / {row.math_sources} + {row.code_tests_pass} / {row.code_sources} +
+ ); + })} +
+ +
+
仍未解决的 7 格

6 个 English continuation + 1 个未闭合的 HumanEval code fence

+
+ {lab.completion.incompleteRows.map((row: any) => ( +
+ {row.sourceId} + {conditionLabels[row.condition]} · {row.generatedTokens} tokens + {row.domain === "code" ? "AST FAIL · NOT RUN" : "NO EOS"} +
+ ))} +
+
+ +
+
BASELINE PROMPT HASH128 / 128 EXACT

输入身份没有漂移

+
FIRST 128 GENERATED TOKENS128 / 128 EXACT

512 运行完整复现短预算前缀

+
INDEPENDENT LONG RERUN32 / 32 EXACT

完整 token IDs、文本与停止状态

+
+
+ + + + + + + +
+ X / OFFICIAL BF16 CHAT · COMPLETION-AWARE FULL-DEPTH TRACE + revision {lab.model.revision};512 formal + {lab.artifacts.completion.sha256.slice(0, 16)}…; + full-depth formal {lab.artifacts.depth.sha256.slice(0, 16)}…。 + 四域各 4 条是机制显微镜,不是 benchmark。 +
+ + +
+ + + + diff --git a/src/data/deepseek-v2-lite-chat-completion-512-eval.json b/src/data/deepseek-v2-lite-chat-completion-512-eval.json new file mode 100644 index 0000000..abffd69 --- /dev/null +++ b/src/data/deepseek-v2-lite-chat-completion-512-eval.json @@ -0,0 +1,3583 @@ +{ + "schema_version": 1, + "input": { + "behavior_path": "/tmp/deepseek-v2-lite-chat-completion-512-formal.json", + "behavior_sha256": "6af40512c5868caab0ef58356aaa7728384f2b7acc7c502aa89478fdf5a2a468", + "baseline_path": "src/data/deepseek-v2-lite-chat-behavior.json", + "baseline_sha256": "54496955d0dd20a3116e6b758a55f56e2444c43dd99bfef94a2cb7b140e6196e", + "human_eval_sha256": "b796127e635a67f93fb35c04f4cb03cf06f38c8072ee7cee8833d7bee06979ef", + "gsm8k_sha256": "3730d312f6e3440559ace48831e51066acaca737f6eabec99bccb9e4b3c39d14", + "model_revision": "85864749cd611b4353ce1decdb286193298f64c7", + "max_new_tokens": 512 + }, + "sandbox": { + "image": "python:3.11-alpine@sha256:25976e9d34a0fab1f278cae931f34c8303d97bf0c0d7f85b6b4dcf641d7702a4", + "timeout_seconds": 5.0, + "code_execution_skipped": false, + "network": "none", + "filesystem": "read-only", + "user": "65534:65534", + "capabilities": "ALL dropped", + "memory": "256m", + "memory_swap": "256m", + "pids_limit": 64, + "cpus": 0.5, + "tmpfs": "/tmp:rw,noexec,nosuid,size=16m", + "host_mounts": 0 + }, + "rows": [ + { + "source_id": "wikitext2/raw-validation/0443", + "domain": "english", + "condition": "s0_eos", + "generated_tokens": 463, + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "prompt_token_ids_sha256": "5434667d3541b957f782b64d98c09083bd369ecd7cdc3a7df8696dfb22d896c5", + "generated_token_ids_sha256": "20ee70c7e6eea7a55efc794c55041d2358d3ea1917826bc567870e3e197e9a2a", + "text_sha256": "dca5f7f4845857fa375ffe30eb063c8f7fe95a8b91f017a4d25fc657031cc0fa", + "task_evaluation": null, + "completion_class": "NATURAL_EOS", + "baseline_prefix_audit": { + "baseline_generated_tokens": 128, + "compared_tokens": 128, + "prompt_hash_exact": true, + "generated_prefix_exact": true, + "baseline_hit_eos": false + } + }, + { + "source_id": "wikitext2/raw-validation/0443", + "domain": "english", + "condition": "s1_eos", + "generated_tokens": 350, + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "prompt_token_ids_sha256": "1e0bcadb7aef5021ec6541bec3245447e15b3904f44eee8bc3560ca3a3be17d7", + "generated_token_ids_sha256": "3b7e4df21d031796cc519678773ec1c549ac737c25cd53c74fd79ccaf324d905", + "text_sha256": "ce78de37e13b8458cc9232484b91a1eb2cc750f9beae630a03dd8ba20c8311f6", + "task_evaluation": null, + "completion_class": "NATURAL_EOS", + "baseline_prefix_audit": { + "baseline_generated_tokens": 128, + "compared_tokens": 128, + "prompt_hash_exact": true, + "generated_prefix_exact": true, + "baseline_hit_eos": false + } + }, + { + "source_id": "wikitext2/raw-validation/0443", + "domain": "english", + "condition": "s0_bos", + "generated_tokens": 512, + "hit_eos": false, + "stopped_at_max_new_tokens": true, + "prompt_token_ids_sha256": "6a09cf8e108abe6f680742417af9627959dd3b560d4fef3822f4d6af895b95ff", + "generated_token_ids_sha256": "66edb1e7762fe6cc70b8ea2bd7c8ce71043045fccb9f695abfba5061d2994641", + "text_sha256": "9778b266a87874a0ef15550b5d4401658edb474909b5876ed5f41ac7adea31d9", + "task_evaluation": null, + "completion_class": "BUDGET_TRUNCATED_UNRESOLVED", + "baseline_prefix_audit": { + "baseline_generated_tokens": 128, + "compared_tokens": 128, + "prompt_hash_exact": true, + "generated_prefix_exact": true, + "baseline_hit_eos": false + } + }, + { + "source_id": "wikitext2/raw-validation/0443", + "domain": "english", + "condition": "s1_bos", + "generated_tokens": 186, + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "prompt_token_ids_sha256": "94dadd54d4e285af191cd433d2a3e77f04e990f15ec14046501e3711187f4ce7", + "generated_token_ids_sha256": "0d3edcd06960c212f25a68dbe5999ec81ad3db843857e64e5818174d5f561462", + "text_sha256": "39da87bdbfaf2241494af215baf7702f2eb8c18ac6b50864703283dacf462c15", + "task_evaluation": null, + "completion_class": "NATURAL_EOS", + "baseline_prefix_audit": { + "baseline_generated_tokens": 128, + "compared_tokens": 128, + "prompt_hash_exact": true, + "generated_prefix_exact": true, + "baseline_hit_eos": false + } + }, + { + "source_id": "wikitext2/raw-validation/0443", + "domain": "english", + "condition": "s0_x", + "generated_tokens": 444, + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "prompt_token_ids_sha256": "7c2072be2dbef455fc3a7469ca40fe34a64ac83cea4d048e3000a989b0a4ce91", + "generated_token_ids_sha256": "6f025b7680d94b507576f661932d3349603b368dbb40e7a5aed3a48d1fb4a310", + "text_sha256": "c9d51efc70d56906fd7ed90ffdc91f951f8d968b545caf00464cd9067cdbcbfb", + "task_evaluation": null, + "completion_class": "NATURAL_EOS", + "baseline_prefix_audit": { + "baseline_generated_tokens": 128, + "compared_tokens": 128, + "prompt_hash_exact": true, + "generated_prefix_exact": true, + "baseline_hit_eos": false + } + }, + { + "source_id": "wikitext2/raw-validation/0443", + "domain": "english", + "condition": "s1_x", + "generated_tokens": 155, + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "prompt_token_ids_sha256": "f8031307ed1f5c0894c3e6e54e868e89e56d9286d9bda5b61005fd2546cb6c8b", + "generated_token_ids_sha256": "a4414c6f42eb5e1fb6c9f81d6ba39996e9e35eaac6de8b831437ead92f3facb7", + "text_sha256": "8d642782addedb69f39c27f88638a0ca150417fdab9b710dceb6b16930051a42", + "task_evaluation": null, + "completion_class": "NATURAL_EOS", + "baseline_prefix_audit": { + "baseline_generated_tokens": 128, + "compared_tokens": 128, + "prompt_hash_exact": true, + "generated_prefix_exact": true, + "baseline_hit_eos": false + } + }, + { + "source_id": "wikitext2/raw-validation/0443", + "domain": "english", + "condition": "s0_period", + "generated_tokens": 447, + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "prompt_token_ids_sha256": "ff0a25894210af41c2ac2b14e8d71079e4570d45b66d9e1f4bb2cf57fb90981e", + "generated_token_ids_sha256": "095fcab0a3c7ee9e2d95c918c730eacd0b30d361b1fd738921094516af74200c", + "text_sha256": "9bd1501033375bc7c52f23387e99262da2f425f9f236a35b9400babe93f76402", + "task_evaluation": null, + "completion_class": "NATURAL_EOS", + "baseline_prefix_audit": { + "baseline_generated_tokens": 128, + "compared_tokens": 128, + "prompt_hash_exact": true, + "generated_prefix_exact": true, + "baseline_hit_eos": false + } + }, + { + "source_id": "wikitext2/raw-validation/0443", + "domain": "english", + "condition": "s1_period", + "generated_tokens": 125, + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "prompt_token_ids_sha256": "bd9667669414b6730ba499f8191c50397e136d25b33022e1b1457fcedf1964e7", + "generated_token_ids_sha256": "3188d53e8b729c95658171b2bae3fa33a7dcbcd620dbefdfc68c28eb09c7f118", + "text_sha256": "317d9c0ab2d45fa5cdce60547cba707b169071d9c51e5b32ab7c540fcd75bbdc", + "task_evaluation": null, + "completion_class": "NATURAL_EOS", + "baseline_prefix_audit": { + "baseline_generated_tokens": 125, + "compared_tokens": 125, + "prompt_hash_exact": true, + "generated_prefix_exact": true, + "baseline_hit_eos": true + } + }, + { + "source_id": "wikitext2/raw-validation/0030", + "domain": "english", + "condition": "s0_eos", + "generated_tokens": 416, + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "prompt_token_ids_sha256": "444c608dfc963cb50803bd7d74331726aaf708d2a358596035693bb77df540e1", + "generated_token_ids_sha256": "7422865083f3009e0c8bd7508d286825993e9bd3e7c00bd3da0038ff4366a065", + "text_sha256": "b1826ed7efe7a45e440beee465c880031573b1e35ff390314545bc528856ce86", + "task_evaluation": null, + "completion_class": "NATURAL_EOS", + "baseline_prefix_audit": { + "baseline_generated_tokens": 128, + "compared_tokens": 128, + "prompt_hash_exact": true, + "generated_prefix_exact": true, + "baseline_hit_eos": false + } + }, + { + "source_id": "wikitext2/raw-validation/0030", + "domain": "english", + "condition": "s1_eos", + "generated_tokens": 66, + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "prompt_token_ids_sha256": "31af45583f68bf573d269a75f87c4f45f037d622a9818535efbac90008b392e8", + "generated_token_ids_sha256": "bd901e9c241ff4350777860c4253cc83689b692c4e19a751328747be9df762d5", + "text_sha256": "fe27a666ae2d0d5aabf230ae281b1d7fab4e86f8793039ff3c909bda8e713529", + "task_evaluation": null, + "completion_class": "NATURAL_EOS", + "baseline_prefix_audit": { + "baseline_generated_tokens": 66, + "compared_tokens": 66, + "prompt_hash_exact": true, + "generated_prefix_exact": true, + "baseline_hit_eos": true + } + }, + { + "source_id": "wikitext2/raw-validation/0030", + "domain": "english", + "condition": "s0_bos", + "generated_tokens": 468, + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "prompt_token_ids_sha256": "d2f84d6f572db24f3d36e048c66d60c778964f3a775b8cf1e3c01baf2832de59", + "generated_token_ids_sha256": "cf1e633fcc612e6e6ddb2d2ed66adf927a0d71e49917ad20d03b46687e3ed4e2", + "text_sha256": "13f3a489610c5730582b2585e4199246c43bac4c938b2bce39212e04fc961fdb", + "task_evaluation": null, + "completion_class": "NATURAL_EOS", + "baseline_prefix_audit": { + "baseline_generated_tokens": 128, + "compared_tokens": 128, + "prompt_hash_exact": true, + "generated_prefix_exact": true, + "baseline_hit_eos": false + } + }, + { + "source_id": "wikitext2/raw-validation/0030", + "domain": "english", + "condition": "s1_bos", + "generated_tokens": 90, + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "prompt_token_ids_sha256": "fdc04e28401db152d30934024e00dccfcb879f93b48f0e71526c94b728bd68da", + "generated_token_ids_sha256": "47acda4c7abe0317f94a12fbf28fe537e53ef3f66ff88b7b634ee7a0dc4e28fe", + "text_sha256": "89fac9ab28a0afedd8e94281fc497d9cfe455d3be342a33dea5174872519031a", + "task_evaluation": null, + "completion_class": "NATURAL_EOS", + "baseline_prefix_audit": { + "baseline_generated_tokens": 90, + "compared_tokens": 90, + "prompt_hash_exact": true, + "generated_prefix_exact": true, + "baseline_hit_eos": true + } + }, + { + "source_id": "wikitext2/raw-validation/0030", + "domain": "english", + "condition": "s0_x", + "generated_tokens": 512, + "hit_eos": false, + "stopped_at_max_new_tokens": true, + "prompt_token_ids_sha256": "e58d86084999d335a8cbf7f2199f33e227083962f560b55cdb23ffc53fa6f643", + "generated_token_ids_sha256": "f996b145920f124fa691aa5ba94f9a65f378cc10ce3dc59498ff88e23d1fb745", + "text_sha256": "b294a63670c38ed1be7969e4d795723e4cdafa7db9c075839a67f07e2b4ab120", + "task_evaluation": null, + "completion_class": "BUDGET_TRUNCATED_UNRESOLVED", + "baseline_prefix_audit": { + "baseline_generated_tokens": 128, + "compared_tokens": 128, + "prompt_hash_exact": true, + "generated_prefix_exact": true, + "baseline_hit_eos": false + } + }, + { + "source_id": "wikitext2/raw-validation/0030", + "domain": "english", + "condition": "s1_x", + "generated_tokens": 58, + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "prompt_token_ids_sha256": "622b26d9dd5ab8da251346f4a0a4c323c7bf7f04104aff695c8cc4931ecc16ad", + "generated_token_ids_sha256": "f1f745687024ee6d3c062d1f55a1662aa41fa4c2bb06bcada914ba8cfd46f365", + "text_sha256": "5d5a1c8cbad7049ca2018a2f1169a515c200503225c0dda20aa8d335597ae0c0", + "task_evaluation": null, + "completion_class": "NATURAL_EOS", + "baseline_prefix_audit": { + "baseline_generated_tokens": 58, + "compared_tokens": 58, + "prompt_hash_exact": true, + "generated_prefix_exact": true, + "baseline_hit_eos": true + } + }, + { + "source_id": "wikitext2/raw-validation/0030", + "domain": "english", + "condition": "s0_period", + "generated_tokens": 261, + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "prompt_token_ids_sha256": "cb855711f73de3c5b25f372374062c409555268374981b1e9cf7e4bac2ee4b11", + "generated_token_ids_sha256": "e23b1febca81e61822e794027287b2b42944cbe1936ef3b6ae801b2744046d3d", + "text_sha256": "1525f681ec388cd77186d4bfe1965fc500d19e328ea1699c0fa3854d699e1842", + "task_evaluation": null, + "completion_class": "NATURAL_EOS", + "baseline_prefix_audit": { + "baseline_generated_tokens": 128, + "compared_tokens": 128, + "prompt_hash_exact": true, + "generated_prefix_exact": true, + "baseline_hit_eos": false + } + }, + { + "source_id": "wikitext2/raw-validation/0030", + "domain": "english", + "condition": "s1_period", + "generated_tokens": 71, + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "prompt_token_ids_sha256": "53daf77913f36d0e7e677b84720bb9b1008ef3da6f69ba980ee2716abf6ae18a", + "generated_token_ids_sha256": "050748807bbfacad32bd2c4cf1f3ed49d5a8ebe88f6978b904885fcae736301a", + "text_sha256": "3106fa8213affa199be9a8a121cdbc7fdec645bd8df45dd35bf7e6f4d4b641bd", + "task_evaluation": null, + "completion_class": "NATURAL_EOS", + "baseline_prefix_audit": { + "baseline_generated_tokens": 71, + "compared_tokens": 71, + "prompt_hash_exact": true, + "generated_prefix_exact": true, + "baseline_hit_eos": true + } + }, + { + "source_id": "wikitext2/raw-validation/2909", + "domain": "english", + "condition": "s0_eos", + "generated_tokens": 142, + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "prompt_token_ids_sha256": "f351730b4ead703efd8bdbb965f9c71dc6dc252bb77ac99dd89451c751701b23", + "generated_token_ids_sha256": "33ce06ffe8b475668c9d887ebea300697edec719af0d94e10bc38ee8f76d27ea", + "text_sha256": "e24a82cff6f22d89df8acadc86c213a779f563c7dab2f10f55a4875cc6fb5527", + "task_evaluation": null, + "completion_class": "NATURAL_EOS", + "baseline_prefix_audit": { + "baseline_generated_tokens": 128, + "compared_tokens": 128, + "prompt_hash_exact": true, + "generated_prefix_exact": true, + "baseline_hit_eos": false + } + }, + { + "source_id": "wikitext2/raw-validation/2909", + "domain": "english", + "condition": "s1_eos", + "generated_tokens": 135, + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "prompt_token_ids_sha256": "828b146d4942f4a056c20318b99f14c8885a9a20b7bf037ea4e88358e43ebc28", + "generated_token_ids_sha256": "06b654a446b3228f482f7f90f179dd398769214c76636e1ac90da674133c2486", + "text_sha256": "e6298eb2adbc6b0512a07e5aa5d03f0a36de4fc9e56b2cd2db6a0b6219de8a3f", + "task_evaluation": null, + "completion_class": "NATURAL_EOS", + "baseline_prefix_audit": { + "baseline_generated_tokens": 128, + "compared_tokens": 128, + "prompt_hash_exact": true, + "generated_prefix_exact": true, + "baseline_hit_eos": false + } + }, + { + "source_id": "wikitext2/raw-validation/2909", + "domain": "english", + "condition": "s0_bos", + "generated_tokens": 235, + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "prompt_token_ids_sha256": "8875f01e38100671f6936d9be4b440b2f9e976bad3b4c5d8f6734bfe4726210f", + "generated_token_ids_sha256": "1ccc9f8691c63cb903fb79acb4a010e484e6fda4311234ee81a8504ee8ca9cd0", + "text_sha256": "0e509e29cd5d4a74f241c1cf13f4508f99275d93602cb8f50703d8ffbe2391ef", + "task_evaluation": null, + "completion_class": "NATURAL_EOS", + "baseline_prefix_audit": { + "baseline_generated_tokens": 128, + "compared_tokens": 128, + "prompt_hash_exact": true, + "generated_prefix_exact": true, + "baseline_hit_eos": false + } + }, + { + "source_id": "wikitext2/raw-validation/2909", + "domain": "english", + "condition": "s1_bos", + "generated_tokens": 213, + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "prompt_token_ids_sha256": "53b29e76a427cc2665d67389a755451b0650683d3598eb6360670deac081ac74", + "generated_token_ids_sha256": "b5b676a9e27211af58670c61bddf8fa9e0b25ab9df5dc10feb4d699415af7f3d", + "text_sha256": "e986a463a6234decd6b19580c7a3d708e92d44301ac853d4dceb25ca2e50a707", + "task_evaluation": null, + "completion_class": "NATURAL_EOS", + "baseline_prefix_audit": { + "baseline_generated_tokens": 128, + "compared_tokens": 128, + "prompt_hash_exact": true, + "generated_prefix_exact": true, + "baseline_hit_eos": false + } + }, + { + "source_id": "wikitext2/raw-validation/2909", + "domain": "english", + "condition": "s0_x", + "generated_tokens": 512, + "hit_eos": false, + "stopped_at_max_new_tokens": true, + "prompt_token_ids_sha256": "eac4e491e87635d5b8be53b36d098ac2dbe11dd22939f3c71b565e31ccaae837", + "generated_token_ids_sha256": "bc5ca304310298065d081cb556c715a60012b317f21982845287a8b0787d5d48", + "text_sha256": "023cd2de0ec837b58aa10bde2d4452f0afd5bf9a8673d743e41c5511488acb80", + "task_evaluation": null, + "completion_class": "BUDGET_TRUNCATED_UNRESOLVED", + "baseline_prefix_audit": { + "baseline_generated_tokens": 128, + "compared_tokens": 128, + "prompt_hash_exact": true, + "generated_prefix_exact": true, + "baseline_hit_eos": false + } + }, + { + "source_id": "wikitext2/raw-validation/2909", + "domain": "english", + "condition": "s1_x", + "generated_tokens": 142, + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "prompt_token_ids_sha256": "b6a531104c06467cbd5f3b44a190f074c190b7b82be815dc9fc28e844c57d119", + "generated_token_ids_sha256": "880bbc18fa94033a371df7a7879c5893e54fae7cf87a7f1234c5104bf79e05a5", + "text_sha256": "231053fbdea7cf31e082c1c2266168023f8febe93c05bc71497df7f689fd97cb", + "task_evaluation": null, + "completion_class": "NATURAL_EOS", + "baseline_prefix_audit": { + "baseline_generated_tokens": 128, + "compared_tokens": 128, + "prompt_hash_exact": true, + "generated_prefix_exact": true, + "baseline_hit_eos": false + } + }, + { + "source_id": "wikitext2/raw-validation/2909", + "domain": "english", + "condition": "s0_period", + "generated_tokens": 236, + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "prompt_token_ids_sha256": "196d96f2e2e7d02fe46977d4c8c3532719ff777ddb94899be9ffd2549358a744", + "generated_token_ids_sha256": "88a00106018522fc499ca70c3d07f0b86ab5527748a0d961aa60e7e407c0091e", + "text_sha256": "c8b85ee1dfa223abeb7b2d9af1a84db7efc05df5dbf64c92062cf77983b9df77", + "task_evaluation": null, + "completion_class": "NATURAL_EOS", + "baseline_prefix_audit": { + "baseline_generated_tokens": 128, + "compared_tokens": 128, + "prompt_hash_exact": true, + "generated_prefix_exact": true, + "baseline_hit_eos": false + } + }, + { + "source_id": "wikitext2/raw-validation/2909", + "domain": "english", + "condition": "s1_period", + "generated_tokens": 229, + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "prompt_token_ids_sha256": "166f5c3702fbb44766f23f3611d9182bf641293cd2b643e83c2e066b256a0f3f", + "generated_token_ids_sha256": "4ee1e832b867636022c930bf8b3ef942c1bdc40c8ac3d0fc8470fbe197c0fe2b", + "text_sha256": "ceb73474c27d9ab6b50e8314da2dd8ba5fd7b4f2680ca8437923008d4d3e6f34", + "task_evaluation": null, + "completion_class": "NATURAL_EOS", + "baseline_prefix_audit": { + "baseline_generated_tokens": 128, + "compared_tokens": 128, + "prompt_hash_exact": true, + "generated_prefix_exact": true, + "baseline_hit_eos": false + } + }, + { + "source_id": "wikitext2/raw-validation/2746", + "domain": "english", + "condition": "s0_eos", + "generated_tokens": 512, + "hit_eos": false, + "stopped_at_max_new_tokens": true, + "prompt_token_ids_sha256": "d7caa73b2e4542fc0775a98a4dea21e424ecfebdeab0c0d36068d6828239c4ad", + "generated_token_ids_sha256": "33bd39ced6e5e59e9ce18f9a05d5a7b67bfd42be3c62e250c77c66e759a41247", + "text_sha256": "f8b91c605fccade251b9aa8d09b3036981ad39fae81de473fc950b30ada16f47", + "task_evaluation": null, + "completion_class": "BUDGET_TRUNCATED_UNRESOLVED", + "baseline_prefix_audit": { + "baseline_generated_tokens": 128, + "compared_tokens": 128, + "prompt_hash_exact": true, + "generated_prefix_exact": true, + "baseline_hit_eos": false + } + }, + { + "source_id": "wikitext2/raw-validation/2746", + "domain": "english", + "condition": "s1_eos", + "generated_tokens": 321, + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "prompt_token_ids_sha256": "7c0f858fce295f0031ddf4a23e27a2600920745b044a86614ce3e762a0245b42", + "generated_token_ids_sha256": "007da6b92bdcf7689992cda493e3403ba663a70761779c551d13ca697a4940e9", + "text_sha256": "e4da46c08ff795f4cb669b390f7b54eee3cae201d5aa405dd07f875079a9300d", + "task_evaluation": null, + "completion_class": "NATURAL_EOS", + "baseline_prefix_audit": { + "baseline_generated_tokens": 128, + "compared_tokens": 128, + "prompt_hash_exact": true, + "generated_prefix_exact": true, + "baseline_hit_eos": false + } + }, + { + "source_id": "wikitext2/raw-validation/2746", + "domain": "english", + "condition": "s0_bos", + "generated_tokens": 451, + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "prompt_token_ids_sha256": "2b5cb2f748d18c60077652f43dc0ef5060bb40de1df45d8b4de8ba7bf5a18790", + "generated_token_ids_sha256": "6ed55a31072fe3d84b901b8deeb80040ee5d7a4ff3f7150a72bda0e5fe9adcb3", + "text_sha256": "4abc80509509ac026f84498357e5b9f1e4971c5537b5fe064c6b5235e00f638d", + "task_evaluation": null, + "completion_class": "NATURAL_EOS", + "baseline_prefix_audit": { + "baseline_generated_tokens": 128, + "compared_tokens": 128, + "prompt_hash_exact": true, + "generated_prefix_exact": true, + "baseline_hit_eos": false + } + }, + { + "source_id": "wikitext2/raw-validation/2746", + "domain": "english", + "condition": "s1_bos", + "generated_tokens": 429, + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "prompt_token_ids_sha256": "e65aeaa8834c854804a3be0897848f85979c800b0b305bd228751fd749bd6390", + "generated_token_ids_sha256": "10e9284390fdcb6440fb0bd50563241ca41a9a9576ad2723ba7ae94103cd70d1", + "text_sha256": "be1a033bb4a906b5cef982d4b3891649c1fae6557f3507c51b33a3de40fcc823", + "task_evaluation": null, + "completion_class": "NATURAL_EOS", + "baseline_prefix_audit": { + "baseline_generated_tokens": 128, + "compared_tokens": 128, + "prompt_hash_exact": true, + "generated_prefix_exact": true, + "baseline_hit_eos": false + } + }, + { + "source_id": "wikitext2/raw-validation/2746", + "domain": "english", + "condition": "s0_x", + "generated_tokens": 512, + "hit_eos": false, + "stopped_at_max_new_tokens": true, + "prompt_token_ids_sha256": "7eb2f3f54f8d98a89af2c30b6c84414be31ab8abb4515afeb1185775dc4eb6ea", + "generated_token_ids_sha256": "9b4dcfe7f52d4cf74974e9ae778f379444464e3fe8e5112e6c8177960a9ac565", + "text_sha256": "f309d587f30612def50e48e837e40ca0a01f12d879c3b491003b419de153d078", + "task_evaluation": null, + "completion_class": "BUDGET_TRUNCATED_UNRESOLVED", + "baseline_prefix_audit": { + "baseline_generated_tokens": 128, + "compared_tokens": 128, + "prompt_hash_exact": true, + "generated_prefix_exact": true, + "baseline_hit_eos": false + } + }, + { + "source_id": "wikitext2/raw-validation/2746", + "domain": "english", + "condition": "s1_x", + "generated_tokens": 320, + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "prompt_token_ids_sha256": "fc32f3a7e3a77f3f9846cddc7a9bb08bacdeddc17d8a5ef92248febe4384b656", + "generated_token_ids_sha256": "7be8d14d1b4ee249ffc019fe2b7995337043ac7264acadeb30eb5cb74449b3a5", + "text_sha256": "c706fddf36595fbb54ca6c1eb7a59d0bc8118dcc41141c8c33077ab106bb347e", + "task_evaluation": null, + "completion_class": "NATURAL_EOS", + "baseline_prefix_audit": { + "baseline_generated_tokens": 128, + "compared_tokens": 128, + "prompt_hash_exact": true, + "generated_prefix_exact": true, + "baseline_hit_eos": false + } + }, + { + "source_id": "wikitext2/raw-validation/2746", + "domain": "english", + "condition": "s0_period", + "generated_tokens": 512, + "hit_eos": false, + "stopped_at_max_new_tokens": true, + "prompt_token_ids_sha256": "4906db86130c6188af0cdf1126b6d7c08f19e86c6e1a02d125b5beefb0e6eea6", + "generated_token_ids_sha256": "5d320e0bd6fc9d8ee6da60f5168874617ff07c57a05ecb98f58b9874e8f41cf1", + "text_sha256": "374795497fad6bf0ea98624fa0f051ffbf29c686b079b4ecff17a74288287158", + "task_evaluation": null, + "completion_class": "BUDGET_TRUNCATED_UNRESOLVED", + "baseline_prefix_audit": { + "baseline_generated_tokens": 128, + "compared_tokens": 128, + "prompt_hash_exact": true, + "generated_prefix_exact": true, + "baseline_hit_eos": false + } + }, + { + "source_id": "wikitext2/raw-validation/2746", + "domain": "english", + "condition": "s1_period", + "generated_tokens": 342, + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "prompt_token_ids_sha256": "963e684c468291bcfb4e9ed97b58e8f729e80cc5f2e9ecf96f770ff94083e3c7", + "generated_token_ids_sha256": "257351c3fa966e621ad847a1643ee25dc2edc577dc1649631a8a288494bb14ba", + "text_sha256": "5217daa942b2dfcb7927d8e0188324dbd0be2c9f121e1c0ef83cb5f0c7d0d6c0", + "task_evaluation": null, + "completion_class": "NATURAL_EOS", + "baseline_prefix_audit": { + "baseline_generated_tokens": 128, + "compared_tokens": 128, + "prompt_hash_exact": true, + "generated_prefix_exact": true, + "baseline_hit_eos": false + } + }, + { + "source_id": "tnews/test/4855", + "domain": "chinese", + "condition": "s0_eos", + "generated_tokens": 69, + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "prompt_token_ids_sha256": "243c51e89c6d3074f9af468b06de3959c3b83828f186ccd3c0929fc2f6453b3c", + "generated_token_ids_sha256": "081f21a76899adf3619e117dd6494ded5751231101e729c6aa7843aee4053315", + "text_sha256": "d2aa4f04579c6adb12cefa10bd94c0f8e9079cad8380744b0b4330aa095e78a9", + "task_evaluation": null, + "completion_class": "NATURAL_EOS", + "baseline_prefix_audit": { + "baseline_generated_tokens": 69, + "compared_tokens": 69, + "prompt_hash_exact": true, + "generated_prefix_exact": true, + "baseline_hit_eos": true + } + }, + { + "source_id": "tnews/test/4855", + "domain": "chinese", + "condition": "s1_eos", + "generated_tokens": 95, + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "prompt_token_ids_sha256": "f26118f3d8f3560f476c1e1a800b0d81b8569863011a200bf7493c46bcb7f2b2", + "generated_token_ids_sha256": "88c2f413b0064ece304cd94e59dbc3b0e209d28f247a7bfc7da6117041b9ab20", + "text_sha256": "51be7a4497a6a201af736c8b50a02ac2623b0d3153dc7a7b5790d819d1f3b002", + "task_evaluation": null, + "completion_class": "NATURAL_EOS", + "baseline_prefix_audit": { + "baseline_generated_tokens": 95, + "compared_tokens": 95, + "prompt_hash_exact": true, + "generated_prefix_exact": true, + "baseline_hit_eos": true + } + }, + { + "source_id": "tnews/test/4855", + "domain": "chinese", + "condition": "s0_bos", + "generated_tokens": 100, + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "prompt_token_ids_sha256": "e6cdebdac69fde3623fcff79ddb42fc5ffe8fa8bb016078e44f6d0595e3c5c59", + "generated_token_ids_sha256": "808049905023231e1a7faf061c5384fe1aac4e00a7df8394a2a21ee9a7adcee6", + "text_sha256": "85e6435a196358cfd44cee9e6871ba01127e136fedcc7119083c4847a43b30ab", + "task_evaluation": null, + "completion_class": "NATURAL_EOS", + "baseline_prefix_audit": { + "baseline_generated_tokens": 100, + "compared_tokens": 100, + "prompt_hash_exact": true, + "generated_prefix_exact": true, + "baseline_hit_eos": true + } + }, + { + "source_id": "tnews/test/4855", + "domain": "chinese", + "condition": "s1_bos", + "generated_tokens": 91, + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "prompt_token_ids_sha256": "95d8970c8adb629701413a5c649edbce54626dfbe7badbe73606454ffb6bad3f", + "generated_token_ids_sha256": "8044b15472dafaa4fbb8a75994ffd75d30624c9e90e315a4cc8ab3769fecf656", + "text_sha256": "37c03f9415ee943c6a4604841a91bfdd398efdfd72c7bd01773ac765f8da1a88", + "task_evaluation": null, + "completion_class": "NATURAL_EOS", + "baseline_prefix_audit": { + "baseline_generated_tokens": 91, + "compared_tokens": 91, + "prompt_hash_exact": true, + "generated_prefix_exact": true, + "baseline_hit_eos": true + } + }, + { + "source_id": "tnews/test/4855", + "domain": "chinese", + "condition": "s0_x", + "generated_tokens": 113, + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "prompt_token_ids_sha256": "19e1e8885427ccab8047a0ebc3962ce3925fc5d193a4e60aabb73f0c6b9174a4", + "generated_token_ids_sha256": "bf0a7174feb24a170e599d8f77153736d2741fa49e8a1e5c277cbcd386d50433", + "text_sha256": "34d557cece94128127c3aeb3d46cec278e1d224bf75376fb3fcfbaf4f7791bce", + "task_evaluation": null, + "completion_class": "NATURAL_EOS", + "baseline_prefix_audit": { + "baseline_generated_tokens": 113, + "compared_tokens": 113, + "prompt_hash_exact": true, + "generated_prefix_exact": true, + "baseline_hit_eos": true + } + }, + { + "source_id": "tnews/test/4855", + "domain": "chinese", + "condition": "s1_x", + "generated_tokens": 77, + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "prompt_token_ids_sha256": "e26da3903129c70971f74fef75e1dd0a372573a811b9878a29f62019c9cfda57", + "generated_token_ids_sha256": "7fa20dc17e364a3ca76e89c85044b098b883bcf441811abf9c551cf0c4328a30", + "text_sha256": "ffc479d1e1f291ed5fe0cd9efc93e57010869910a1fcb4e012a28226b6fb8c77", + "task_evaluation": null, + "completion_class": "NATURAL_EOS", + "baseline_prefix_audit": { + "baseline_generated_tokens": 77, + "compared_tokens": 77, + "prompt_hash_exact": true, + "generated_prefix_exact": true, + "baseline_hit_eos": true + } + }, + { + "source_id": "tnews/test/4855", + "domain": "chinese", + "condition": "s0_period", + "generated_tokens": 72, + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "prompt_token_ids_sha256": "c0042137952c7e982622815128ef5c23c7e3aa0ae07cb6e9d6fb5a351e2a1cb6", + "generated_token_ids_sha256": "1b4d349f9fb3c7d31f288a6843307fc9302582d71a1b08cedb7d20efd60d00c6", + "text_sha256": "f33d34ebdd04d74efd037d43aa21ae36ac893f3adefc85d4a3bf76bdd706b7a5", + "task_evaluation": null, + "completion_class": "NATURAL_EOS", + "baseline_prefix_audit": { + "baseline_generated_tokens": 72, + "compared_tokens": 72, + "prompt_hash_exact": true, + "generated_prefix_exact": true, + "baseline_hit_eos": true + } + }, + { + "source_id": "tnews/test/4855", + "domain": "chinese", + "condition": "s1_period", + "generated_tokens": 117, + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "prompt_token_ids_sha256": "def18002aa7c333a53604a3a7278c824588b22b3321d52be4fc9767abf5b6c38", + "generated_token_ids_sha256": "99abddc24e5eb5657af131ceb0f865531118f979a9d94ec5aa04e00900667263", + "text_sha256": "28378f573e6bc046838eb10aa8d46077dd68ae5aedb9570703e2184602a5b20b", + "task_evaluation": null, + "completion_class": "NATURAL_EOS", + "baseline_prefix_audit": { + "baseline_generated_tokens": 117, + "compared_tokens": 117, + "prompt_hash_exact": true, + "generated_prefix_exact": true, + "baseline_hit_eos": true + } + }, + { + "source_id": "tnews/test/8935", + "domain": "chinese", + "condition": "s0_eos", + "generated_tokens": 109, + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "prompt_token_ids_sha256": "490ea1e841a3f22def064376f2f878e27c59e416c16a8c9549c18a50e42de591", + "generated_token_ids_sha256": "56026d9aee37adf4a22577be974e99da74151a38721d558a99ad8c3c6acd538e", + "text_sha256": "cb0b5e6ad12cd0d0bebd193c55039f1828a55d723d63c1a471d3d111a159cd5a", + "task_evaluation": null, + "completion_class": "NATURAL_EOS", + "baseline_prefix_audit": { + "baseline_generated_tokens": 109, + "compared_tokens": 109, + "prompt_hash_exact": true, + "generated_prefix_exact": true, + "baseline_hit_eos": true + } + }, + { + "source_id": "tnews/test/8935", + "domain": "chinese", + "condition": "s1_eos", + "generated_tokens": 163, + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "prompt_token_ids_sha256": "542ca2642e552f7c267a6f61fa9dcd90f7cef33d42aced054adef8916cb62525", + "generated_token_ids_sha256": "bd14fdee6280f16ce49e2dcce79593280bc5e81aa7afb00497627cdd47fcd1ad", + "text_sha256": "fbd9c14c1cfd96f13f163991a83c8cb0019152ba93808ae6c9a7d40a587e3166", + "task_evaluation": null, + "completion_class": "NATURAL_EOS", + "baseline_prefix_audit": { + "baseline_generated_tokens": 128, + "compared_tokens": 128, + "prompt_hash_exact": true, + "generated_prefix_exact": true, + "baseline_hit_eos": false + } + }, + { + "source_id": "tnews/test/8935", + "domain": "chinese", + "condition": "s0_bos", + "generated_tokens": 95, + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "prompt_token_ids_sha256": "a431a59471822b0968660e28a7126312b1aac76c8eaa7d64cc3711bfb7976066", + "generated_token_ids_sha256": "458445bb4dd7440199af494e2015bf34782e3dfddbc750c36905f13cda030adb", + "text_sha256": "eff380461c02fd6fbd7e3e53b52ec4e67e8be2714bd22bf740324cfd7beed34d", + "task_evaluation": null, + "completion_class": "NATURAL_EOS", + "baseline_prefix_audit": { + "baseline_generated_tokens": 95, + "compared_tokens": 95, + "prompt_hash_exact": true, + "generated_prefix_exact": true, + "baseline_hit_eos": true + } + }, + { + "source_id": "tnews/test/8935", + "domain": "chinese", + "condition": "s1_bos", + "generated_tokens": 88, + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "prompt_token_ids_sha256": "e609b1993ecd67269ee07062f55db9fca3cb07fff85a56c391f1ea9760b14f87", + "generated_token_ids_sha256": "6c692af046ecaccc67693ace509d377c20671acc5124e7199bf40cdbf7ecdb79", + "text_sha256": "ed1e6709e2b81bbbd528d3decb0349a362c4d21f63bad028ba72b2e92ad8fce9", + "task_evaluation": null, + "completion_class": "NATURAL_EOS", + "baseline_prefix_audit": { + "baseline_generated_tokens": 88, + "compared_tokens": 88, + "prompt_hash_exact": true, + "generated_prefix_exact": true, + "baseline_hit_eos": true + } + }, + { + "source_id": "tnews/test/8935", + "domain": "chinese", + "condition": "s0_x", + "generated_tokens": 84, + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "prompt_token_ids_sha256": "846c5545df426d546cc79f9f40a8fd50dab4e108714c3a53d023e295e500ed7a", + "generated_token_ids_sha256": "928c88158acb746138be3a0c6dd2d05e5d0232b0014477891926227845e51738", + "text_sha256": "23215ab6dd1fcee2e4978b92c7b53b4dabffcda7e3517a2f30064de1e2d6a2d0", + "task_evaluation": null, + "completion_class": "NATURAL_EOS", + "baseline_prefix_audit": { + "baseline_generated_tokens": 84, + "compared_tokens": 84, + "prompt_hash_exact": true, + "generated_prefix_exact": true, + "baseline_hit_eos": true + } + }, + { + "source_id": "tnews/test/8935", + "domain": "chinese", + "condition": "s1_x", + "generated_tokens": 106, + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "prompt_token_ids_sha256": "b447502e1e6f4197525fdec033650386c9c229c7c27e14d2c613cdc8dcb0df09", + "generated_token_ids_sha256": "c84658b48ed148b5296605c2fc7a032a49452e7717a9196e3c024e49b8a1ca29", + "text_sha256": "0ee8c0783cd9454e3c9e87ab0c54b72753d04bc659059396a16f4142df5960e5", + "task_evaluation": null, + "completion_class": "NATURAL_EOS", + "baseline_prefix_audit": { + "baseline_generated_tokens": 106, + "compared_tokens": 106, + "prompt_hash_exact": true, + "generated_prefix_exact": true, + "baseline_hit_eos": true + } + }, + { + "source_id": "tnews/test/8935", + "domain": "chinese", + "condition": "s0_period", + "generated_tokens": 266, + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "prompt_token_ids_sha256": "0f8510eef8fa980dc6770b464dd02d7451e2388dd3627572bb0b9f39ad03c23b", + "generated_token_ids_sha256": "2230db0da94fd33a6106a3c52cda4c550127c78b8cc6580cbd82b083ce53a984", + "text_sha256": "e84221ab60c0d753c502f8d20b6d82753bca1f50768a702279f70fdb404feac6", + "task_evaluation": null, + "completion_class": "NATURAL_EOS", + "baseline_prefix_audit": { + "baseline_generated_tokens": 128, + "compared_tokens": 128, + "prompt_hash_exact": true, + "generated_prefix_exact": true, + "baseline_hit_eos": false + } + }, + { + "source_id": "tnews/test/8935", + "domain": "chinese", + "condition": "s1_period", + "generated_tokens": 148, + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "prompt_token_ids_sha256": "36427ffc9adcdc5c8b41264cd424d480343c34b044aa76a299f5fce635db1f5f", + "generated_token_ids_sha256": "44fa42bdfd4e533a577867d6b2eb67ee7aaf948086b6bb1aa928296b8a9e1caa", + "text_sha256": "f48608a107671c50ffb287310bbfc9a10c4702a8bf253548298161a0d64bf665", + "task_evaluation": null, + "completion_class": "NATURAL_EOS", + "baseline_prefix_audit": { + "baseline_generated_tokens": 128, + "compared_tokens": 128, + "prompt_hash_exact": true, + "generated_prefix_exact": true, + "baseline_hit_eos": false + } + }, + { + "source_id": "tnews/test/3448", + "domain": "chinese", + "condition": "s0_eos", + "generated_tokens": 153, + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "prompt_token_ids_sha256": "ea3973310bbe06247d12f149529be01af5de4afb533217d003bedc50b239ede5", + "generated_token_ids_sha256": "dc5839e837ed3e259a234a41137a543e4c6c2aca055e632a01514516eb28832d", + "text_sha256": "13efb9d5d16109921a847c3e806db78fe5a5a52b4dd7537fb8fe76ac5e871580", + "task_evaluation": null, + "completion_class": "NATURAL_EOS", + "baseline_prefix_audit": { + "baseline_generated_tokens": 128, + "compared_tokens": 128, + "prompt_hash_exact": true, + "generated_prefix_exact": true, + "baseline_hit_eos": false + } + }, + { + "source_id": "tnews/test/3448", + "domain": "chinese", + "condition": "s1_eos", + "generated_tokens": 153, + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "prompt_token_ids_sha256": "00da48f0f7f515abe70179bd2a00aaf65c43e20f70950726fe72b72d4e986ac8", + "generated_token_ids_sha256": "c98d13c82853885bf1d3ae3fc596b439fa405f447991471815c4b4efd14c5074", + "text_sha256": "1947e8ca74e69f369e0ecf74c627df84d38891989db17cf7b76f18197999a753", + "task_evaluation": null, + "completion_class": "NATURAL_EOS", + "baseline_prefix_audit": { + "baseline_generated_tokens": 128, + "compared_tokens": 128, + "prompt_hash_exact": true, + "generated_prefix_exact": true, + "baseline_hit_eos": false + } + }, + { + "source_id": "tnews/test/3448", + "domain": "chinese", + "condition": "s0_bos", + "generated_tokens": 85, + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "prompt_token_ids_sha256": "6201b139bc73b770b00c6d60eef0536cf0324c8c586f63e2ef6cbf4899497443", + "generated_token_ids_sha256": "92cb250be10ceca2e0f750a90a2bd5b0dffb0b30b5ac9c10f13329fa367b47e6", + "text_sha256": "5dca819922fbd2d66cf32e2cbb515c9eebf1bb2edbfcd7ab37b35e140ba48b99", + "task_evaluation": null, + "completion_class": "NATURAL_EOS", + "baseline_prefix_audit": { + "baseline_generated_tokens": 85, + "compared_tokens": 85, + "prompt_hash_exact": true, + "generated_prefix_exact": true, + "baseline_hit_eos": true + } + }, + { + "source_id": "tnews/test/3448", + "domain": "chinese", + "condition": "s1_bos", + "generated_tokens": 369, + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "prompt_token_ids_sha256": "8c55b5a2c20885b29653f1a280281c68ea69b7692b635419a1876f7814e2dd15", + "generated_token_ids_sha256": "9b916fdb5afe18ca1a5b060f95c8ae52d35f7fa38d670e12a20ba6e0cc8d47c8", + "text_sha256": "e48144e9b1baf2122eab114217a1469ec7d30798a7e0f7871050b4431f8f959d", + "task_evaluation": null, + "completion_class": "NATURAL_EOS", + "baseline_prefix_audit": { + "baseline_generated_tokens": 128, + "compared_tokens": 128, + "prompt_hash_exact": true, + "generated_prefix_exact": true, + "baseline_hit_eos": false + } + }, + { + "source_id": "tnews/test/3448", + "domain": "chinese", + "condition": "s0_x", + "generated_tokens": 184, + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "prompt_token_ids_sha256": "e76dc359969ff494635248827ff3e5d1d4226ee1b2e021ef35d6cef6fbb53b49", + "generated_token_ids_sha256": "37ec5c6ab69fafaa057b7b5b2df3beec6e26dcdbde8f5cabee218ae5e52734fc", + "text_sha256": "7ee8baa1d09e6dcf9866e85d98eca60d642371f09bbe78aa046a42c6c60f9e06", + "task_evaluation": null, + "completion_class": "NATURAL_EOS", + "baseline_prefix_audit": { + "baseline_generated_tokens": 128, + "compared_tokens": 128, + "prompt_hash_exact": true, + "generated_prefix_exact": true, + "baseline_hit_eos": false + } + }, + { + "source_id": "tnews/test/3448", + "domain": "chinese", + "condition": "s1_x", + "generated_tokens": 127, + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "prompt_token_ids_sha256": "a49e199029086ac332fba766e5af04ea6a4f23bdf53bd453c148b83ec796d6de", + "generated_token_ids_sha256": "c4777d84ebc99cb0f27935a04bf3c8b4113477e60aac69d3a2ea885a01a33020", + "text_sha256": "8d2e31fab785214c8d005948406aafb9a86e5300d50dfa645a90c05ece4040df", + "task_evaluation": null, + "completion_class": "NATURAL_EOS", + "baseline_prefix_audit": { + "baseline_generated_tokens": 127, + "compared_tokens": 127, + "prompt_hash_exact": true, + "generated_prefix_exact": true, + "baseline_hit_eos": true + } + }, + { + "source_id": "tnews/test/3448", + "domain": "chinese", + "condition": "s0_period", + "generated_tokens": 110, + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "prompt_token_ids_sha256": "8ed08535881112d8d9ca8c60129404c43c882f19ce8998d12186d55ec00d2112", + "generated_token_ids_sha256": "3ad0e97b3703af98242089a72e811232c33f30a9872734e2c22e95554e2e94bb", + "text_sha256": "85681dbc48ca2603407e72c6e9c8dff2f4fda2d08ed59e19a4fa62b4652fa212", + "task_evaluation": null, + "completion_class": "NATURAL_EOS", + "baseline_prefix_audit": { + "baseline_generated_tokens": 110, + "compared_tokens": 110, + "prompt_hash_exact": true, + "generated_prefix_exact": true, + "baseline_hit_eos": true + } + }, + { + "source_id": "tnews/test/3448", + "domain": "chinese", + "condition": "s1_period", + "generated_tokens": 113, + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "prompt_token_ids_sha256": "13cd1369f7d47450f952b9e478eb9d8f4dfff3d8759d1ab2c0465e315fbd743d", + "generated_token_ids_sha256": "397340c981928cc88fe97bb5c21ed3a255a16e9ede46102a35a5fb27586f9601", + "text_sha256": "f1306a8e2cb7cf24922bca550b66df4da5d45ded0803f9679b0b42945666b6f7", + "task_evaluation": null, + "completion_class": "NATURAL_EOS", + "baseline_prefix_audit": { + "baseline_generated_tokens": 113, + "compared_tokens": 113, + "prompt_hash_exact": true, + "generated_prefix_exact": true, + "baseline_hit_eos": true + } + }, + { + "source_id": "tnews/test/1059", + "domain": "chinese", + "condition": "s0_eos", + "generated_tokens": 207, + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "prompt_token_ids_sha256": "0b5785222b0b73c25b0e351aad49f5d08d68c29a92a81928b9169ecc522678d9", + "generated_token_ids_sha256": "ea915eb229de7e6c53ef437dc4567f07468fe1c304639035d5006a970ea96bb2", + "text_sha256": "0b6d3c2e4bd03bde8814758238199a96e8a7da68229ea2a9d501ae7946f93977", + "task_evaluation": null, + "completion_class": "NATURAL_EOS", + "baseline_prefix_audit": { + "baseline_generated_tokens": 128, + "compared_tokens": 128, + "prompt_hash_exact": true, + "generated_prefix_exact": true, + "baseline_hit_eos": false + } + }, + { + "source_id": "tnews/test/1059", + "domain": "chinese", + "condition": "s1_eos", + "generated_tokens": 247, + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "prompt_token_ids_sha256": "c421681bbd355786697980821e247a14d5ebfd07105626a732092a3212623e4b", + "generated_token_ids_sha256": "a135ca270833422b4932c2afcccfec6f035d5de0f233147d1ad2d9705c086a93", + "text_sha256": "0c79991344ff76ad192cb83ab1825d382279bef31596d6247444e98342933fdd", + "task_evaluation": null, + "completion_class": "NATURAL_EOS", + "baseline_prefix_audit": { + "baseline_generated_tokens": 128, + "compared_tokens": 128, + "prompt_hash_exact": true, + "generated_prefix_exact": true, + "baseline_hit_eos": false + } + }, + { + "source_id": "tnews/test/1059", + "domain": "chinese", + "condition": "s0_bos", + "generated_tokens": 320, + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "prompt_token_ids_sha256": "eaa288a9315a5a392ea2aea4c51509f5e192e617d9ab5c5d5f31be20c0635a52", + "generated_token_ids_sha256": "f81badbae7db14af318093e587e2e9a6e54a5235c48d62b7b5da0ea569ff2226", + "text_sha256": "18b9b0aa8496822a7ee41a94c69d6a6396697dc28d9978c75027ff1b535e8579", + "task_evaluation": null, + "completion_class": "NATURAL_EOS", + "baseline_prefix_audit": { + "baseline_generated_tokens": 128, + "compared_tokens": 128, + "prompt_hash_exact": true, + "generated_prefix_exact": true, + "baseline_hit_eos": false + } + }, + { + "source_id": "tnews/test/1059", + "domain": "chinese", + "condition": "s1_bos", + "generated_tokens": 231, + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "prompt_token_ids_sha256": "d8b996e7614ff74eb3b8ff2f53acd65e6183b6817c6164f9840b1af1b476301f", + "generated_token_ids_sha256": "a5f0da9a88555f8cb3e0c0383639ac29049edfbfa17b647dd2c6ff968ad161e2", + "text_sha256": "4177871a5b4cd7b0c0f3378dcf6a6572e32edfe4bb6e4bb96505e038d978d951", + "task_evaluation": null, + "completion_class": "NATURAL_EOS", + "baseline_prefix_audit": { + "baseline_generated_tokens": 128, + "compared_tokens": 128, + "prompt_hash_exact": true, + "generated_prefix_exact": true, + "baseline_hit_eos": false + } + }, + { + "source_id": "tnews/test/1059", + "domain": "chinese", + "condition": "s0_x", + "generated_tokens": 155, + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "prompt_token_ids_sha256": "0f3b77e93fdc02e48ba7b2eb1e96068020ff6a89f4dcedcbf975a3c36752e64f", + "generated_token_ids_sha256": "b200e788b830b9dde24d9bb3ae141e2a50d300497a6e2c264fb1362ef7aa44d8", + "text_sha256": "996ce0a7dfaa950752b650f82dc8e43af1e0e1228e73ba6845b3f1c94c0e9558", + "task_evaluation": null, + "completion_class": "NATURAL_EOS", + "baseline_prefix_audit": { + "baseline_generated_tokens": 128, + "compared_tokens": 128, + "prompt_hash_exact": true, + "generated_prefix_exact": true, + "baseline_hit_eos": false + } + }, + { + "source_id": "tnews/test/1059", + "domain": "chinese", + "condition": "s1_x", + "generated_tokens": 125, + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "prompt_token_ids_sha256": "27059da052bbadbdba194691ad422c105c0a18aba9d2977a159e136d99f8a7a5", + "generated_token_ids_sha256": "31ec50499160b0f70ff16d52a9cb4a0a7799b3fa72368335d8cb5f8164c6a620", + "text_sha256": "7a28480afa946109f4a90bffe928d34bb54e72b4ac48a821a83289a37cbaa5ff", + "task_evaluation": null, + "completion_class": "NATURAL_EOS", + "baseline_prefix_audit": { + "baseline_generated_tokens": 125, + "compared_tokens": 125, + "prompt_hash_exact": true, + "generated_prefix_exact": true, + "baseline_hit_eos": true + } + }, + { + "source_id": "tnews/test/1059", + "domain": "chinese", + "condition": "s0_period", + "generated_tokens": 225, + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "prompt_token_ids_sha256": "e14358af6594705e0109ef78fddae368aa4c0d51dae7058ee59d054fd81676e9", + "generated_token_ids_sha256": "c697904933e77b26b635b05fe5bf823f427d4b8b92f6a783e06b8c0897b08c30", + "text_sha256": "0bfaabd1058ae7e51e5ab58ae5bd1ad81e71394c4ce8a2ec69160fc7f8556f3b", + "task_evaluation": null, + "completion_class": "NATURAL_EOS", + "baseline_prefix_audit": { + "baseline_generated_tokens": 128, + "compared_tokens": 128, + "prompt_hash_exact": true, + "generated_prefix_exact": true, + "baseline_hit_eos": false + } + }, + { + "source_id": "tnews/test/1059", + "domain": "chinese", + "condition": "s1_period", + "generated_tokens": 110, + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "prompt_token_ids_sha256": "7c421121f0cb46dd7cd004e2b0681fb736a802b45fa7734580f7a5dec93f6d8a", + "generated_token_ids_sha256": "023622aa8d36e9f76bb50a6a3bc3d790f6ea590a15dee85a488a01e4fefc9478", + "text_sha256": "566ea4e44fd347d851e9daa6cec446fec1d33bcb3e6cc71910923cbed6a49519", + "task_evaluation": null, + "completion_class": "NATURAL_EOS", + "baseline_prefix_audit": { + "baseline_generated_tokens": 110, + "compared_tokens": 110, + "prompt_hash_exact": true, + "generated_prefix_exact": true, + "baseline_hit_eos": true + } + }, + { + "source_id": "HumanEval/31", + "domain": "code", + "condition": "s0_eos", + "generated_tokens": 397, + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "prompt_token_ids_sha256": "6be7e854ac1a52102505446e011621de1eb53890d8bb05e6da6acc04b8aba862", + "generated_token_ids_sha256": "51062153bce2cacf76ed30a07ddf8e2a12584ffe151479497c81be2934d6303c", + "text_sha256": "45c1e4a40540f9de31d5ead7675556fb4ca64ede36e94aba8bd005d6c3301fca", + "task_evaluation": { + "candidate_sha256": "af9f7acecc15979fd07061448278bf3ebe4b8e865597307302c7b07d50711f44", + "extraction_mode": "fenced", + "contains_entry_point_definition": true, + "closed_code_fence": true, + "python_ast_parse": true, + "parse_error": null, + "semantic_terminal": true, + "evaluator_covered": true, + "execution": { + "status": "passed", + "return_code": 0, + "runtime_ms": 364.7789540118538, + "harness_sha256": "cad7d81e40d6a4afddc7951f7ec580342e4ccb52230b48f85feb73eb1c0b3d27" + }, + "fixed_budget_tests_pass": true, + "strict_complete_tests_pass": true + }, + "completion_class": "NATURAL_EOS", + "baseline_prefix_audit": { + "baseline_generated_tokens": 128, + "compared_tokens": 128, + "prompt_hash_exact": true, + "generated_prefix_exact": true, + "baseline_hit_eos": false + } + }, + { + "source_id": "HumanEval/31", + "domain": "code", + "condition": "s1_eos", + "generated_tokens": 322, + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "prompt_token_ids_sha256": "c6783406e90bf388721019684ddad1e7fb00ae8d7e28588fedc2098130fcfbe9", + "generated_token_ids_sha256": "6a52846b2faf17e19b9925f18ad1442b8d6c8bb05c0dec261f632031c3bb3eac", + "text_sha256": "64935e66c7081e378b95e68763d4ffe05e0561f06e565bb0b89123a184bb2824", + "task_evaluation": { + "candidate_sha256": "08063a9ae2f1615cd3d3379aefff53aa8f08a3bbcf19c6092ebc44cc461915b8", + "extraction_mode": "fenced", + "contains_entry_point_definition": true, + "closed_code_fence": true, + "python_ast_parse": true, + "parse_error": null, + "semantic_terminal": true, + "evaluator_covered": true, + "execution": { + "status": "passed", + "return_code": 0, + "runtime_ms": 314.3631999846548, + "harness_sha256": "32e3d841119f5a063e0d2d5ed86cec9eafc1df6d9926a622ff04a8d56dbf20a1" + }, + "fixed_budget_tests_pass": true, + "strict_complete_tests_pass": true + }, + "completion_class": "NATURAL_EOS", + "baseline_prefix_audit": { + "baseline_generated_tokens": 128, + "compared_tokens": 128, + "prompt_hash_exact": true, + "generated_prefix_exact": true, + "baseline_hit_eos": false + } + }, + { + "source_id": "HumanEval/31", + "domain": "code", + "condition": "s0_bos", + "generated_tokens": 412, + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "prompt_token_ids_sha256": "38c3f8aeedce7475927d567cbc6416a0a5ef9513726fba330253dc7d2224ab62", + "generated_token_ids_sha256": "2b6cfd2f4e0adc17c6a6bd87742f86d2142facff7834e5c71b12403e36cba4c5", + "text_sha256": "e829f7f676c8c08675751dc68176e1303e6b59ee664add76312f29df7517925f", + "task_evaluation": { + "candidate_sha256": "af9f7acecc15979fd07061448278bf3ebe4b8e865597307302c7b07d50711f44", + "extraction_mode": "fenced", + "contains_entry_point_definition": true, + "closed_code_fence": true, + "python_ast_parse": true, + "parse_error": null, + "semantic_terminal": true, + "evaluator_covered": true, + "execution": { + "status": "passed", + "return_code": 0, + "runtime_ms": 314.4568419957068, + "harness_sha256": "cad7d81e40d6a4afddc7951f7ec580342e4ccb52230b48f85feb73eb1c0b3d27" + }, + "fixed_budget_tests_pass": true, + "strict_complete_tests_pass": true + }, + "completion_class": "NATURAL_EOS", + "baseline_prefix_audit": { + "baseline_generated_tokens": 128, + "compared_tokens": 128, + "prompt_hash_exact": true, + "generated_prefix_exact": true, + "baseline_hit_eos": false + } + }, + { + "source_id": "HumanEval/31", + "domain": "code", + "condition": "s1_bos", + "generated_tokens": 320, + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "prompt_token_ids_sha256": "6d288fc010eee1c71df12ad1777bd4232fb5774570082f4d8d846b924a6b4d9c", + "generated_token_ids_sha256": "8c1f8c0a24d1fe416cb1a4772ef403fc635da763d6f140a2499ed13f4fd00ab4", + "text_sha256": "964c8252b0cb6c714898cb9f0c8f9f778af3e372ee27220fa8be8f8111b8eb4f", + "task_evaluation": { + "candidate_sha256": "08063a9ae2f1615cd3d3379aefff53aa8f08a3bbcf19c6092ebc44cc461915b8", + "extraction_mode": "fenced", + "contains_entry_point_definition": true, + "closed_code_fence": true, + "python_ast_parse": true, + "parse_error": null, + "semantic_terminal": true, + "evaluator_covered": true, + "execution": { + "status": "passed", + "return_code": 0, + "runtime_ms": 314.4663749844767, + "harness_sha256": "32e3d841119f5a063e0d2d5ed86cec9eafc1df6d9926a622ff04a8d56dbf20a1" + }, + "fixed_budget_tests_pass": true, + "strict_complete_tests_pass": true + }, + "completion_class": "NATURAL_EOS", + "baseline_prefix_audit": { + "baseline_generated_tokens": 128, + "compared_tokens": 128, + "prompt_hash_exact": true, + "generated_prefix_exact": true, + "baseline_hit_eos": false + } + }, + { + "source_id": "HumanEval/31", + "domain": "code", + "condition": "s0_x", + "generated_tokens": 429, + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "prompt_token_ids_sha256": "cb848063b64e250814d3f599ea82a68588dcfdf2fe8141053f798d5c11f5bed2", + "generated_token_ids_sha256": "1941ed79cea77800e6b6837ffa304d58f913066dc909033b5de1c4ca655e156f", + "text_sha256": "3c73711955f8f2e2b64b226e9696c88219973cb75e540d18c9883005a8373c44", + "task_evaluation": { + "candidate_sha256": "122b3a6829e529fa11072d2109aeffa728fd53573b3abcdb94dd23259c740f93", + "extraction_mode": "fenced", + "contains_entry_point_definition": true, + "closed_code_fence": true, + "python_ast_parse": true, + "parse_error": null, + "semantic_terminal": true, + "evaluator_covered": true, + "execution": { + "status": "passed", + "return_code": 0, + "runtime_ms": 314.73573099356145, + "harness_sha256": "dd6e1ba85655799f4e2793e729b73fd8c3f032d5f8d41791c8868568b57224ab" + }, + "fixed_budget_tests_pass": true, + "strict_complete_tests_pass": true + }, + "completion_class": "NATURAL_EOS", + "baseline_prefix_audit": { + "baseline_generated_tokens": 128, + "compared_tokens": 128, + "prompt_hash_exact": true, + "generated_prefix_exact": true, + "baseline_hit_eos": false + } + }, + { + "source_id": "HumanEval/31", + "domain": "code", + "condition": "s1_x", + "generated_tokens": 216, + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "prompt_token_ids_sha256": "07c33c0a495f4cf4e660cd5e8edd35416fe77eae15e9b8ce542aefca5d0932dc", + "generated_token_ids_sha256": "1a1a73d93051e9ed677e7f69235e1ba455ffaeffdb781553aa0c1612c0ddcbbd", + "text_sha256": "838982bfdfa0c06f8ffdbcf45aa1db7357fdb232a74ae438b72dc7f1ee737a63", + "task_evaluation": { + "candidate_sha256": "25c4489e64cd3cc1936373f2344f7c799b3f7664db669c63640d8cfc1833e843", + "extraction_mode": "fenced", + "contains_entry_point_definition": true, + "closed_code_fence": true, + "python_ast_parse": true, + "parse_error": null, + "semantic_terminal": true, + "evaluator_covered": true, + "execution": { + "status": "passed", + "return_code": 0, + "runtime_ms": 314.4173300242983, + "harness_sha256": "569042a5117094e33fd0e99c53a5979a16def6adb1b892dc48b1f19c56f771ed" + }, + "fixed_budget_tests_pass": true, + "strict_complete_tests_pass": true + }, + "completion_class": "NATURAL_EOS", + "baseline_prefix_audit": { + "baseline_generated_tokens": 128, + "compared_tokens": 128, + "prompt_hash_exact": true, + "generated_prefix_exact": true, + "baseline_hit_eos": false + } + }, + { + "source_id": "HumanEval/31", + "domain": "code", + "condition": "s0_period", + "generated_tokens": 355, + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "prompt_token_ids_sha256": "28a248f8e6baf3e910836ec1212882afd51ccef972a30d6306f604cd3fd10a10", + "generated_token_ids_sha256": "f41032a4ec778feda5fc3818f94ddc41b5eb4f71172f4b0a220541bc692d49b4", + "text_sha256": "de4736f67189b059194499a3bf15cc1bd75cb44c68285d47dbd8063b6603a451", + "task_evaluation": { + "candidate_sha256": "122b3a6829e529fa11072d2109aeffa728fd53573b3abcdb94dd23259c740f93", + "extraction_mode": "fenced", + "contains_entry_point_definition": true, + "closed_code_fence": true, + "python_ast_parse": true, + "parse_error": null, + "semantic_terminal": true, + "evaluator_covered": true, + "execution": { + "status": "passed", + "return_code": 0, + "runtime_ms": 314.49275999329984, + "harness_sha256": "dd6e1ba85655799f4e2793e729b73fd8c3f032d5f8d41791c8868568b57224ab" + }, + "fixed_budget_tests_pass": true, + "strict_complete_tests_pass": true + }, + "completion_class": "NATURAL_EOS", + "baseline_prefix_audit": { + "baseline_generated_tokens": 128, + "compared_tokens": 128, + "prompt_hash_exact": true, + "generated_prefix_exact": true, + "baseline_hit_eos": false + } + }, + { + "source_id": "HumanEval/31", + "domain": "code", + "condition": "s1_period", + "generated_tokens": 59, + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "prompt_token_ids_sha256": "60e9d47943e9ba8869476dcc61e1a943b7e2dcf88d1d7334c44267baa5a8fd5f", + "generated_token_ids_sha256": "5cc9c902a87c82327d846c4c6298e61a9d3fddfa00127c92e699bc5bfc3e87ac", + "text_sha256": "a0f2b66062d9a781aed1e410e9263412406b1ecc6c3fb51a89e82c6d3022221a", + "task_evaluation": { + "candidate_sha256": "28f166261950fa956e299a50872f539d490af163c1b0fb6d316d346fd7644685", + "extraction_mode": "direct_definition", + "contains_entry_point_definition": true, + "closed_code_fence": false, + "python_ast_parse": true, + "parse_error": null, + "semantic_terminal": true, + "evaluator_covered": true, + "execution": { + "status": "passed", + "return_code": 0, + "runtime_ms": 314.4734380184673, + "harness_sha256": "c3402f42179ae84b6c6382d262fe7a6cd646472dae79c24c2f0e2e79afe01d49" + }, + "fixed_budget_tests_pass": true, + "strict_complete_tests_pass": true + }, + "completion_class": "NATURAL_EOS", + "baseline_prefix_audit": { + "baseline_generated_tokens": 59, + "compared_tokens": 59, + "prompt_hash_exact": true, + "generated_prefix_exact": true, + "baseline_hit_eos": true + } + }, + { + "source_id": "HumanEval/44", + "domain": "code", + "condition": "s0_eos", + "generated_tokens": 512, + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "prompt_token_ids_sha256": "34636650c2d01d108c0812d19c1b7832fc580fe1251ae8d9fa905b5a0c3dc85b", + "generated_token_ids_sha256": "7cf70cc66d680d43ea005d9d811b6ca0e2d8c337441db9a6117e55998375c261", + "text_sha256": "9c22ba225c0285cd24f7234581add0236a3acef41be795108f3d26c6e173376d", + "task_evaluation": { + "candidate_sha256": "dc070836ec6f006332215bf0b91ee2e87eb4bad0c1addae16af8e90cac647502", + "extraction_mode": "fenced", + "contains_entry_point_definition": true, + "closed_code_fence": true, + "python_ast_parse": true, + "parse_error": null, + "semantic_terminal": true, + "evaluator_covered": true, + "execution": { + "status": "assertion_failed", + "return_code": 10, + "runtime_ms": 314.38884101225995, + "harness_sha256": "23ba7d00d20ad960abe277ccd0ce5a88182a67bef06246eabf9982041deb09d4" + }, + "fixed_budget_tests_pass": false, + "strict_complete_tests_pass": false + }, + "completion_class": "NATURAL_EOS", + "baseline_prefix_audit": { + "baseline_generated_tokens": 128, + "compared_tokens": 128, + "prompt_hash_exact": true, + "generated_prefix_exact": true, + "baseline_hit_eos": false + } + }, + { + "source_id": "HumanEval/44", + "domain": "code", + "condition": "s1_eos", + "generated_tokens": 512, + "hit_eos": false, + "stopped_at_max_new_tokens": true, + "prompt_token_ids_sha256": "8064601979f18146c339c546016365833f2ca0d6c99b504906e55b54d5a4a7e4", + "generated_token_ids_sha256": "24a1ef7b3fb9a974c792a00ae9674339fa76d48fabe82dd0c9b03f152d06cb7f", + "text_sha256": "272a7d878efe7ed9484fbd31a60add469176b59216c4cd3c0a7607e299a2297d", + "task_evaluation": { + "candidate_sha256": "5479975e8b92c1f8a63012932817fd2cb2bb9c0b8a66f11625d070ae8ac4aebf", + "extraction_mode": "fenced", + "contains_entry_point_definition": true, + "closed_code_fence": false, + "python_ast_parse": false, + "parse_error": { + "line": 26, + "offset": 18, + "type": "SyntaxError" + }, + "semantic_terminal": false, + "evaluator_covered": false, + "execution": { + "status": "not_run", + "return_code": null, + "runtime_ms": null, + "harness_sha256": null + }, + "fixed_budget_tests_pass": false, + "strict_complete_tests_pass": false + }, + "completion_class": "BUDGET_TRUNCATED_UNRESOLVED", + "baseline_prefix_audit": { + "baseline_generated_tokens": 128, + "compared_tokens": 128, + "prompt_hash_exact": true, + "generated_prefix_exact": true, + "baseline_hit_eos": false + } + }, + { + "source_id": "HumanEval/44", + "domain": "code", + "condition": "s0_bos", + "generated_tokens": 331, + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "prompt_token_ids_sha256": "a9677eeacfdaa69c7a1febf31256819301807a3737f96a980f4d4bfea0ba7ef9", + "generated_token_ids_sha256": "c42b5e65f9c230397204050a125b166034365250cecb16b4590d3a15e991a0d6", + "text_sha256": "8a1060f9a8cc1e60c2a2746ff1805437a7210ef0b09b6d095c6ff36de57013df", + "task_evaluation": { + "candidate_sha256": "dcd020b020569fb69a8acf381a6fec51a2d468871005f54f883c2aefb4b43880", + "extraction_mode": "fenced", + "contains_entry_point_definition": true, + "closed_code_fence": true, + "python_ast_parse": true, + "parse_error": null, + "semantic_terminal": true, + "evaluator_covered": true, + "execution": { + "status": "passed", + "return_code": 0, + "runtime_ms": 314.43385398597457, + "harness_sha256": "990307c9f8412878a71634f44ae97ca78c6a768c0a4aa7fedc2807eadb8d4165" + }, + "fixed_budget_tests_pass": true, + "strict_complete_tests_pass": true + }, + "completion_class": "NATURAL_EOS", + "baseline_prefix_audit": { + "baseline_generated_tokens": 128, + "compared_tokens": 128, + "prompt_hash_exact": true, + "generated_prefix_exact": true, + "baseline_hit_eos": false + } + }, + { + "source_id": "HumanEval/44", + "domain": "code", + "condition": "s1_bos", + "generated_tokens": 408, + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "prompt_token_ids_sha256": "e1678df6379b9df385290d7b0feb2356a96ea6bd3190ba61d223e5742db049d8", + "generated_token_ids_sha256": "262dbb91e952aa58c08d5dbf65b4048a388c263ed7b96cb5881e548b51787e3a", + "text_sha256": "ae074321557273e8ffe399092321f9cefbf8cdd1537e3c95c35bd2d6f5bcfb31", + "task_evaluation": { + "candidate_sha256": "c19ed20142ba780b3ea83ecafce9521832613a119a6920e64ec53f7ef20636e1", + "extraction_mode": "fenced", + "contains_entry_point_definition": true, + "closed_code_fence": true, + "python_ast_parse": true, + "parse_error": null, + "semantic_terminal": true, + "evaluator_covered": true, + "execution": { + "status": "passed", + "return_code": 0, + "runtime_ms": 364.66425299295224, + "harness_sha256": "a24856466ecae0c571185ca35329d960b432519112c71f1e99ee608c2a1d7b7f" + }, + "fixed_budget_tests_pass": true, + "strict_complete_tests_pass": true + }, + "completion_class": "NATURAL_EOS", + "baseline_prefix_audit": { + "baseline_generated_tokens": 128, + "compared_tokens": 128, + "prompt_hash_exact": true, + "generated_prefix_exact": true, + "baseline_hit_eos": false + } + }, + { + "source_id": "HumanEval/44", + "domain": "code", + "condition": "s0_x", + "generated_tokens": 351, + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "prompt_token_ids_sha256": "1a626851d1b4c79591f00401c8b96b6f6383c9930a5e50f7b5d4edd232c67c6b", + "generated_token_ids_sha256": "81cd37a3a3efecdd97028e9b942c113961da1dab48447c89d971bd79f686a4c8", + "text_sha256": "e69bd7892ee0ba6739c377a3f923beb05bf277f5fbad92db0e53a743c8905a61", + "task_evaluation": { + "candidate_sha256": "cd92908e60a99feb5c22bd8f4b2790f6f019272e2d0697f90e02ba9b9d8dbfe6", + "extraction_mode": "fenced", + "contains_entry_point_definition": true, + "closed_code_fence": true, + "python_ast_parse": true, + "parse_error": null, + "semantic_terminal": true, + "evaluator_covered": true, + "execution": { + "status": "runtime_error", + "return_code": 11, + "runtime_ms": 314.5527970045805, + "harness_sha256": "c69b021bcdea7dda4ca041d95513843acf6a2150301ee8155f04df9bcf3b16d9" + }, + "fixed_budget_tests_pass": false, + "strict_complete_tests_pass": false + }, + "completion_class": "NATURAL_EOS", + "baseline_prefix_audit": { + "baseline_generated_tokens": 128, + "compared_tokens": 128, + "prompt_hash_exact": true, + "generated_prefix_exact": true, + "baseline_hit_eos": false + } + }, + { + "source_id": "HumanEval/44", + "domain": "code", + "condition": "s1_x", + "generated_tokens": 456, + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "prompt_token_ids_sha256": "56cc86c7774bd2a7f825e55fcbe97ab6f1970e570cdc993b8a1ee5ab606d859c", + "generated_token_ids_sha256": "122f420b674dcb35e9d36dd142b92e97bb8a60cea7a643d504589e3ebefb1629", + "text_sha256": "7c464bf9f2af8882b9d1ab73a28c11ffc1928e54c893dae173ff298cc2d8ec85", + "task_evaluation": { + "candidate_sha256": "c4f9301b787b076744851b04f39c216fc321fba92dc96783e9a257803ba755c8", + "extraction_mode": "fenced", + "contains_entry_point_definition": true, + "closed_code_fence": true, + "python_ast_parse": true, + "parse_error": null, + "semantic_terminal": true, + "evaluator_covered": true, + "execution": { + "status": "assertion_failed", + "return_code": 10, + "runtime_ms": 364.60569500923157, + "harness_sha256": "c55ea4f3a4d566f64aed9956a1bcad07fb9d1da70ff797a65ce82daaa390bacb" + }, + "fixed_budget_tests_pass": false, + "strict_complete_tests_pass": false + }, + "completion_class": "NATURAL_EOS", + "baseline_prefix_audit": { + "baseline_generated_tokens": 128, + "compared_tokens": 128, + "prompt_hash_exact": true, + "generated_prefix_exact": true, + "baseline_hit_eos": false + } + }, + { + "source_id": "HumanEval/44", + "domain": "code", + "condition": "s0_period", + "generated_tokens": 363, + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "prompt_token_ids_sha256": "e71413377a91a13f6e6add6206927e67c2f744738c6124a22048f67a2fb45266", + "generated_token_ids_sha256": "53675bd86ddc0e186ca629e3280bc1b8f2d96245572a113930326ef522ef5137", + "text_sha256": "ec3b54d902a4aef184083f161da935a5331579ee69469ba765dcaca6f2ddbb80", + "task_evaluation": { + "candidate_sha256": "cba9c698349b69f75d2ada5e2b47a36dfd07fb13152c1d4a0183b3db321ea1f3", + "extraction_mode": "fenced", + "contains_entry_point_definition": true, + "closed_code_fence": true, + "python_ast_parse": true, + "parse_error": null, + "semantic_terminal": true, + "evaluator_covered": true, + "execution": { + "status": "runtime_error", + "return_code": 11, + "runtime_ms": 314.7800369770266, + "harness_sha256": "37901be215c128cad275087194785cf32ee477e8af5f1bce5d856f247f8ce5e5" + }, + "fixed_budget_tests_pass": false, + "strict_complete_tests_pass": false + }, + "completion_class": "NATURAL_EOS", + "baseline_prefix_audit": { + "baseline_generated_tokens": 128, + "compared_tokens": 128, + "prompt_hash_exact": true, + "generated_prefix_exact": true, + "baseline_hit_eos": false + } + }, + { + "source_id": "HumanEval/44", + "domain": "code", + "condition": "s1_period", + "generated_tokens": 162, + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "prompt_token_ids_sha256": "4a47efad70aed38e5a3f4ec519584f08d4e9cd89a12fbc9ee9b1f1ee206a651b", + "generated_token_ids_sha256": "1cc1c58f189ba6c70095114475bfe0f04052cd53d10861328fe3e2f38dcf6081", + "text_sha256": "6106b51d81a144e29cde25414fbe97ec08bd01731839b5b1ca5e467c32ef923f", + "task_evaluation": { + "candidate_sha256": "8fcd50f214cb73f5396f66780d535a14b9097e95bbaa75656faa3528df34a7d3", + "extraction_mode": "direct_definition", + "contains_entry_point_definition": true, + "closed_code_fence": false, + "python_ast_parse": true, + "parse_error": null, + "semantic_terminal": true, + "evaluator_covered": true, + "execution": { + "status": "passed", + "return_code": 0, + "runtime_ms": 314.39152397797443, + "harness_sha256": "31a8143131621fcedad61d6972b336d771c003be7f2fcafdf8cf056e254af50b" + }, + "fixed_budget_tests_pass": true, + "strict_complete_tests_pass": true + }, + "completion_class": "NATURAL_EOS", + "baseline_prefix_audit": { + "baseline_generated_tokens": 128, + "compared_tokens": 128, + "prompt_hash_exact": true, + "generated_prefix_exact": true, + "baseline_hit_eos": false + } + }, + { + "source_id": "HumanEval/133", + "domain": "code", + "condition": "s0_eos", + "generated_tokens": 391, + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "prompt_token_ids_sha256": "7b84065a1b5a2ed75dc3a7b4946b265f6ddc8294e89dfc581c7da9b0cc5a938c", + "generated_token_ids_sha256": "00d8c9083f6292736b3e0bc592529edcca422b65e01fd5b754bf5de3adfc4bd4", + "text_sha256": "2d0ade27b1f645b083197638d387de4d7ce9c8a29912535e9847ef2e03099177", + "task_evaluation": { + "candidate_sha256": "063c560631d9f3a0c1c2dda3ac8a138961b7049c3b5234ab042357c01185672d", + "extraction_mode": "fenced", + "contains_entry_point_definition": true, + "closed_code_fence": true, + "python_ast_parse": true, + "parse_error": null, + "semantic_terminal": true, + "evaluator_covered": true, + "execution": { + "status": "passed", + "return_code": 0, + "runtime_ms": 314.50751298689283, + "harness_sha256": "38fbf7139d8ff026985f0322065866f77fdcb46e3e883d4d880cfecb25282c38" + }, + "fixed_budget_tests_pass": true, + "strict_complete_tests_pass": true + }, + "completion_class": "NATURAL_EOS", + "baseline_prefix_audit": { + "baseline_generated_tokens": 128, + "compared_tokens": 128, + "prompt_hash_exact": true, + "generated_prefix_exact": true, + "baseline_hit_eos": false + } + }, + { + "source_id": "HumanEval/133", + "domain": "code", + "condition": "s1_eos", + "generated_tokens": 416, + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "prompt_token_ids_sha256": "e4276f9ff4296a6c846b43bbc3fa2221ec810ffd93bb6b2222e1f3a3228422a0", + "generated_token_ids_sha256": "19e068e791cc684b5ac5de77217c7e3b25a95bc11a4e3e54ec3215d92d90327b", + "text_sha256": "837e0a1eb75d96deb472ca3c494837a97c26350dbadb4f9a8ee5eca18c559fd2", + "task_evaluation": { + "candidate_sha256": "43181722452490fe6bfa0addba5498d854915ccbe6d88d45c98438fc26345407", + "extraction_mode": "fenced", + "contains_entry_point_definition": true, + "closed_code_fence": true, + "python_ast_parse": true, + "parse_error": null, + "semantic_terminal": true, + "evaluator_covered": true, + "execution": { + "status": "assertion_failed", + "return_code": 10, + "runtime_ms": 314.23531801556237, + "harness_sha256": "fd16610a3fa2849d01e52ad01a059fbfa5278682acd761d8d2a4515b2db639dc" + }, + "fixed_budget_tests_pass": false, + "strict_complete_tests_pass": false + }, + "completion_class": "NATURAL_EOS", + "baseline_prefix_audit": { + "baseline_generated_tokens": 128, + "compared_tokens": 128, + "prompt_hash_exact": true, + "generated_prefix_exact": true, + "baseline_hit_eos": false + } + }, + { + "source_id": "HumanEval/133", + "domain": "code", + "condition": "s0_bos", + "generated_tokens": 361, + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "prompt_token_ids_sha256": "ee3860ad1a33de8e8372314fe4db11d3787a9a2f20e9ee7ff23ed6c1d834e044", + "generated_token_ids_sha256": "c6bba52444abc13222e68bc7b1e477ab1ae3090e3f5158bbacf5306a21e5c61d", + "text_sha256": "21a7924a0f49cdcc14c34ade399435faab3b36438a732572d90fab48e28fdd79", + "task_evaluation": { + "candidate_sha256": "19855a3603cdbc2102fee4850d03e96ae4bdb7c54245ce222e33fd7454dc0c47", + "extraction_mode": "fenced", + "contains_entry_point_definition": true, + "closed_code_fence": true, + "python_ast_parse": true, + "parse_error": null, + "semantic_terminal": true, + "evaluator_covered": true, + "execution": { + "status": "passed", + "return_code": 0, + "runtime_ms": 314.48952498612925, + "harness_sha256": "945365d23121de01d747be6323dfc2636e5ef59ee1d7fafd64acaf260e8290d4" + }, + "fixed_budget_tests_pass": true, + "strict_complete_tests_pass": true + }, + "completion_class": "NATURAL_EOS", + "baseline_prefix_audit": { + "baseline_generated_tokens": 128, + "compared_tokens": 128, + "prompt_hash_exact": true, + "generated_prefix_exact": true, + "baseline_hit_eos": false + } + }, + { + "source_id": "HumanEval/133", + "domain": "code", + "condition": "s1_bos", + "generated_tokens": 329, + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "prompt_token_ids_sha256": "5473c54512924d23c4b17924fbf1d8d7d4afb2d78ff619de2c5b7add1c6fda30", + "generated_token_ids_sha256": "df1b580562352c10a0142464bfc5df450113400698a4bd672757a2c0d6b35ef6", + "text_sha256": "5657a7b8f10719e5c30e7ff79e6fe3f02008624be7444aeccd7783b11833da13", + "task_evaluation": { + "candidate_sha256": "2330b87cb12c52fe0bd0087d0a37d45af8caec132677cc4a0c15321cdc60409d", + "extraction_mode": "fenced", + "contains_entry_point_definition": true, + "closed_code_fence": true, + "python_ast_parse": true, + "parse_error": null, + "semantic_terminal": true, + "evaluator_covered": true, + "execution": { + "status": "passed", + "return_code": 0, + "runtime_ms": 314.2013059987221, + "harness_sha256": "361f7491047e4602f19053308dc490f39255f8c79d991e2562565c46efad3332" + }, + "fixed_budget_tests_pass": true, + "strict_complete_tests_pass": true + }, + "completion_class": "NATURAL_EOS", + "baseline_prefix_audit": { + "baseline_generated_tokens": 128, + "compared_tokens": 128, + "prompt_hash_exact": true, + "generated_prefix_exact": true, + "baseline_hit_eos": false + } + }, + { + "source_id": "HumanEval/133", + "domain": "code", + "condition": "s0_x", + "generated_tokens": 361, + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "prompt_token_ids_sha256": "bf0d4583be831e2c74147cd47eee6fedc28e35effde0efda5728df8186330eef", + "generated_token_ids_sha256": "c6bba52444abc13222e68bc7b1e477ab1ae3090e3f5158bbacf5306a21e5c61d", + "text_sha256": "21a7924a0f49cdcc14c34ade399435faab3b36438a732572d90fab48e28fdd79", + "task_evaluation": { + "candidate_sha256": "19855a3603cdbc2102fee4850d03e96ae4bdb7c54245ce222e33fd7454dc0c47", + "extraction_mode": "fenced", + "contains_entry_point_definition": true, + "closed_code_fence": true, + "python_ast_parse": true, + "parse_error": null, + "semantic_terminal": true, + "evaluator_covered": true, + "execution": { + "status": "passed", + "return_code": 0, + "runtime_ms": 314.33891199412756, + "harness_sha256": "945365d23121de01d747be6323dfc2636e5ef59ee1d7fafd64acaf260e8290d4" + }, + "fixed_budget_tests_pass": true, + "strict_complete_tests_pass": true + }, + "completion_class": "NATURAL_EOS", + "baseline_prefix_audit": { + "baseline_generated_tokens": 128, + "compared_tokens": 128, + "prompt_hash_exact": true, + "generated_prefix_exact": true, + "baseline_hit_eos": false + } + }, + { + "source_id": "HumanEval/133", + "domain": "code", + "condition": "s1_x", + "generated_tokens": 342, + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "prompt_token_ids_sha256": "ee2daeb568041b52ce494749ceeb0c6fd06a7f9ce8a2b6ef8ab2377e1e246d66", + "generated_token_ids_sha256": "207104a2f47a5f2d5230874c6ec6121dd636a36105e720df626c0dd691ab3419", + "text_sha256": "349691bb1439aa09a619c0fafd681667e47cf4ce53507035846adcda7ed9dcd3", + "task_evaluation": { + "candidate_sha256": "6f3f83e9dde59ce9c0e53e46daac16f280cb778f391fe050c60bb98d3a20d33b", + "extraction_mode": "fenced", + "contains_entry_point_definition": true, + "closed_code_fence": true, + "python_ast_parse": true, + "parse_error": null, + "semantic_terminal": true, + "evaluator_covered": true, + "execution": { + "status": "assertion_failed", + "return_code": 10, + "runtime_ms": 314.2733109998517, + "harness_sha256": "12506957684c37b4b79afbecfe8fa6842b7382eddd709f314d394bc074925847" + }, + "fixed_budget_tests_pass": false, + "strict_complete_tests_pass": false + }, + "completion_class": "NATURAL_EOS", + "baseline_prefix_audit": { + "baseline_generated_tokens": 128, + "compared_tokens": 128, + "prompt_hash_exact": true, + "generated_prefix_exact": true, + "baseline_hit_eos": false + } + }, + { + "source_id": "HumanEval/133", + "domain": "code", + "condition": "s0_period", + "generated_tokens": 367, + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "prompt_token_ids_sha256": "5e556876b30e7de83e1d58a9331853ee7adff92957c6421cf176331235fe7f80", + "generated_token_ids_sha256": "a339ea5740089c54aac78cc9db051688a5368ffcb97346745c4d7f60bf765146", + "text_sha256": "21e051a87628c02474b4e2f49663a10864e28cd4db0c833be3ec7bf530179f1b", + "task_evaluation": { + "candidate_sha256": "19855a3603cdbc2102fee4850d03e96ae4bdb7c54245ce222e33fd7454dc0c47", + "extraction_mode": "fenced", + "contains_entry_point_definition": true, + "closed_code_fence": true, + "python_ast_parse": true, + "parse_error": null, + "semantic_terminal": true, + "evaluator_covered": true, + "execution": { + "status": "passed", + "return_code": 0, + "runtime_ms": 314.3206940148957, + "harness_sha256": "945365d23121de01d747be6323dfc2636e5ef59ee1d7fafd64acaf260e8290d4" + }, + "fixed_budget_tests_pass": true, + "strict_complete_tests_pass": true + }, + "completion_class": "NATURAL_EOS", + "baseline_prefix_audit": { + "baseline_generated_tokens": 128, + "compared_tokens": 128, + "prompt_hash_exact": true, + "generated_prefix_exact": true, + "baseline_hit_eos": false + } + }, + { + "source_id": "HumanEval/133", + "domain": "code", + "condition": "s1_period", + "generated_tokens": 74, + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "prompt_token_ids_sha256": "537648bc701d6509e6c7925284b842e598400c662918f3b2319d0e54a404019c", + "generated_token_ids_sha256": "a96d4d398ece12ebb86170c95a112480e6781b5c8564676c0bfb99e006de3faa", + "text_sha256": "feac86b93f35acaa5792c576d649424cd542a09eb5472c75bac21558be489784", + "task_evaluation": { + "candidate_sha256": "f0f47ad5d481f48cd88b6091c1eceb093e44040c9f22c0cd3f5984bd2533f9ea", + "extraction_mode": "direct_definition", + "contains_entry_point_definition": true, + "closed_code_fence": false, + "python_ast_parse": true, + "parse_error": null, + "semantic_terminal": true, + "evaluator_covered": true, + "execution": { + "status": "assertion_failed", + "return_code": 10, + "runtime_ms": 314.3881849828176, + "harness_sha256": "88fa4b0e5793c96dac9c96afee722ccf5a0738a22c51cd36589a2f479c81d1e3" + }, + "fixed_budget_tests_pass": false, + "strict_complete_tests_pass": false + }, + "completion_class": "NATURAL_EOS", + "baseline_prefix_audit": { + "baseline_generated_tokens": 74, + "compared_tokens": 74, + "prompt_hash_exact": true, + "generated_prefix_exact": true, + "baseline_hit_eos": true + } + }, + { + "source_id": "HumanEval/23", + "domain": "code", + "condition": "s0_eos", + "generated_tokens": 146, + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "prompt_token_ids_sha256": "cb47bc5c0e78c4ab62201c207af6c0385abba0c85cc1a22c130a8b6a445a1116", + "generated_token_ids_sha256": "3fa5b21e5c9d1720b2839bec0ed52f74018d7d525c1ec8e05ebbaee700bf11cf", + "text_sha256": "53ad1f6a9dbaa9d63818cc7a162c6d57f4e95648f2cb5982c3dae3ceca5e2a0e", + "task_evaluation": { + "candidate_sha256": "7897188c3cb91527449f69dcd0c4473974736a470998152874ccf04e6df93e37", + "extraction_mode": "fenced", + "contains_entry_point_definition": true, + "closed_code_fence": true, + "python_ast_parse": true, + "parse_error": null, + "semantic_terminal": true, + "evaluator_covered": true, + "execution": { + "status": "passed", + "return_code": 0, + "runtime_ms": 314.44897601613775, + "harness_sha256": "1f8be36a0ff375dbdfe72ba64b71760e81f7763864312ddd859eabeea4f25151" + }, + "fixed_budget_tests_pass": true, + "strict_complete_tests_pass": true + }, + "completion_class": "NATURAL_EOS", + "baseline_prefix_audit": { + "baseline_generated_tokens": 128, + "compared_tokens": 128, + "prompt_hash_exact": true, + "generated_prefix_exact": true, + "baseline_hit_eos": false + } + }, + { + "source_id": "HumanEval/23", + "domain": "code", + "condition": "s1_eos", + "generated_tokens": 71, + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "prompt_token_ids_sha256": "82597f376eaa8456e5ef6faa9ca76898c8a26dc24355f8548d4588aca4a36df0", + "generated_token_ids_sha256": "0a81818d1ff5c7a2b2a89805328794df308d6cd4ac7e0d5f47069842174d15b3", + "text_sha256": "c6f4eb869288b3103dbb7b271134cfbe8e870235c6f8e79caeb76689167fbf3c", + "task_evaluation": { + "candidate_sha256": "aac1b2005230da60d09fe75f852bfc4c24e16d9de060c4d7c31b227d860307bf", + "extraction_mode": "fenced", + "contains_entry_point_definition": true, + "closed_code_fence": true, + "python_ast_parse": true, + "parse_error": null, + "semantic_terminal": true, + "evaluator_covered": true, + "execution": { + "status": "passed", + "return_code": 0, + "runtime_ms": 314.3976960272994, + "harness_sha256": "4f4764de384658f51552b0456a9e65f920396f05985c0476f43f6b190d5b422e" + }, + "fixed_budget_tests_pass": true, + "strict_complete_tests_pass": true + }, + "completion_class": "NATURAL_EOS", + "baseline_prefix_audit": { + "baseline_generated_tokens": 71, + "compared_tokens": 71, + "prompt_hash_exact": true, + "generated_prefix_exact": true, + "baseline_hit_eos": true + } + }, + { + "source_id": "HumanEval/23", + "domain": "code", + "condition": "s0_bos", + "generated_tokens": 130, + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "prompt_token_ids_sha256": "45e00434df50a11d9fc7fcecfdcd2801af37014c711ad35437b6c3b66333f13e", + "generated_token_ids_sha256": "bfd451d0e50fdfb8c654c3b8b34e9a1520766c1763cf1a7c7f9d8a41357e149c", + "text_sha256": "df2f9b9098db8beec0f5828a82404ef284aeef468fd7866a55e3b2d96cdaa0a6", + "task_evaluation": { + "candidate_sha256": "aac1b2005230da60d09fe75f852bfc4c24e16d9de060c4d7c31b227d860307bf", + "extraction_mode": "fenced", + "contains_entry_point_definition": true, + "closed_code_fence": true, + "python_ast_parse": true, + "parse_error": null, + "semantic_terminal": true, + "evaluator_covered": true, + "execution": { + "status": "passed", + "return_code": 0, + "runtime_ms": 314.27101101144217, + "harness_sha256": "4f4764de384658f51552b0456a9e65f920396f05985c0476f43f6b190d5b422e" + }, + "fixed_budget_tests_pass": true, + "strict_complete_tests_pass": true + }, + "completion_class": "NATURAL_EOS", + "baseline_prefix_audit": { + "baseline_generated_tokens": 128, + "compared_tokens": 128, + "prompt_hash_exact": true, + "generated_prefix_exact": true, + "baseline_hit_eos": false + } + }, + { + "source_id": "HumanEval/23", + "domain": "code", + "condition": "s1_bos", + "generated_tokens": 149, + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "prompt_token_ids_sha256": "fdfddae640dc75ab1b51c7ab606e82efd1d0785b1980843adc823118ba04b9ec", + "generated_token_ids_sha256": "e4f6ac633d70834c0d9ce2104bbe156e26e6650748815f58f6e2c50559ada36a", + "text_sha256": "61b3aef398e8fd0c4459c22637a78697677e4f448308a1171efc8ce63157c539", + "task_evaluation": { + "candidate_sha256": "74f33e189fe5c71b7a2bc81a0b26b36a45c640674bbf3bdadaa313c6b4404b6d", + "extraction_mode": "fenced", + "contains_entry_point_definition": true, + "closed_code_fence": true, + "python_ast_parse": true, + "parse_error": null, + "semantic_terminal": true, + "evaluator_covered": true, + "execution": { + "status": "passed", + "return_code": 0, + "runtime_ms": 314.4300209823996, + "harness_sha256": "67333f4ad29040664c2cee7fbf330b7627af5ef1401567a639da63e2e6f38891" + }, + "fixed_budget_tests_pass": true, + "strict_complete_tests_pass": true + }, + "completion_class": "NATURAL_EOS", + "baseline_prefix_audit": { + "baseline_generated_tokens": 128, + "compared_tokens": 128, + "prompt_hash_exact": true, + "generated_prefix_exact": true, + "baseline_hit_eos": false + } + }, + { + "source_id": "HumanEval/23", + "domain": "code", + "condition": "s0_x", + "generated_tokens": 180, + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "prompt_token_ids_sha256": "5854ab6a5ff35cb37f7ab3b7a7ebea68ffa4cc02b05d668a2e087e39b28cb1d3", + "generated_token_ids_sha256": "03607362ece5f82402412df7d58b7537306aa7e6f673cda8b573854529d84308", + "text_sha256": "ec948a9e93b6daf14082c7b420299e921779987a33705183407385189ede775d", + "task_evaluation": { + "candidate_sha256": "aac1b2005230da60d09fe75f852bfc4c24e16d9de060c4d7c31b227d860307bf", + "extraction_mode": "fenced", + "contains_entry_point_definition": true, + "closed_code_fence": true, + "python_ast_parse": true, + "parse_error": null, + "semantic_terminal": true, + "evaluator_covered": true, + "execution": { + "status": "passed", + "return_code": 0, + "runtime_ms": 314.35666198376566, + "harness_sha256": "4f4764de384658f51552b0456a9e65f920396f05985c0476f43f6b190d5b422e" + }, + "fixed_budget_tests_pass": true, + "strict_complete_tests_pass": true + }, + "completion_class": "NATURAL_EOS", + "baseline_prefix_audit": { + "baseline_generated_tokens": 128, + "compared_tokens": 128, + "prompt_hash_exact": true, + "generated_prefix_exact": true, + "baseline_hit_eos": false + } + }, + { + "source_id": "HumanEval/23", + "domain": "code", + "condition": "s1_x", + "generated_tokens": 53, + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "prompt_token_ids_sha256": "7542edb390d1f29af1273083ba591b257398ab4c1eecf864bbc52663edea9850", + "generated_token_ids_sha256": "69fad8c4eb2a45c2965c4ca8530af6af58724bd20406d6aa5aafd7c1f239f76f", + "text_sha256": "b6132b60b7e0b2beabaee066e1b4c4f0368072576cd8578e528b8c45fd9abfb3", + "task_evaluation": { + "candidate_sha256": "831c4d6a608f99826ae7fb5dc85b3f25a5aebf7643e2dec1468c8a442c7f751b", + "extraction_mode": "fenced", + "contains_entry_point_definition": true, + "closed_code_fence": true, + "python_ast_parse": true, + "parse_error": null, + "semantic_terminal": true, + "evaluator_covered": true, + "execution": { + "status": "passed", + "return_code": 0, + "runtime_ms": 314.5247499924153, + "harness_sha256": "e4e27b8f12797e58c1403da41903b81918a277a69c402102b0dc61e23c9cb10a" + }, + "fixed_budget_tests_pass": true, + "strict_complete_tests_pass": true + }, + "completion_class": "NATURAL_EOS", + "baseline_prefix_audit": { + "baseline_generated_tokens": 53, + "compared_tokens": 53, + "prompt_hash_exact": true, + "generated_prefix_exact": true, + "baseline_hit_eos": true + } + }, + { + "source_id": "HumanEval/23", + "domain": "code", + "condition": "s0_period", + "generated_tokens": 191, + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "prompt_token_ids_sha256": "2f54a215c9dbb510d46c5a9ec14a563ab2d8bcd06081a351221e49244ff23ee7", + "generated_token_ids_sha256": "bc0930e9e75131c62800bdf57817d5483dba76548e035c448881159d0d842738", + "text_sha256": "dc10a29795fe824f4af3638c65bf453c36541fd26d64648945509cba32693694", + "task_evaluation": { + "candidate_sha256": "31d023bb07881f723b75dbf119cf0c53d66ef97775cdd2714bb5a4e6f3c2d0cd", + "extraction_mode": "fenced", + "contains_entry_point_definition": true, + "closed_code_fence": true, + "python_ast_parse": true, + "parse_error": null, + "semantic_terminal": true, + "evaluator_covered": true, + "execution": { + "status": "passed", + "return_code": 0, + "runtime_ms": 314.2992399807554, + "harness_sha256": "702682a7208424bb605d3ebbe4df63f42855fda32208e4b3766ef4ad95f5e3cb" + }, + "fixed_budget_tests_pass": true, + "strict_complete_tests_pass": true + }, + "completion_class": "NATURAL_EOS", + "baseline_prefix_audit": { + "baseline_generated_tokens": 128, + "compared_tokens": 128, + "prompt_hash_exact": true, + "generated_prefix_exact": true, + "baseline_hit_eos": false + } + }, + { + "source_id": "HumanEval/23", + "domain": "code", + "condition": "s1_period", + "generated_tokens": 48, + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "prompt_token_ids_sha256": "19eb1141be8bf17769a49defff6edd7401bce652f18c7df994b21151755aca3a", + "generated_token_ids_sha256": "f8eebd031ad078516c8440851176176962b288167d2b641d54ccf57d4676d232", + "text_sha256": "e55ad8094293e4c6fa4fe7efbb83b0c4275a2627227745fffa4cfe85907c8abe", + "task_evaluation": { + "candidate_sha256": "831c4d6a608f99826ae7fb5dc85b3f25a5aebf7643e2dec1468c8a442c7f751b", + "extraction_mode": "direct_definition", + "contains_entry_point_definition": true, + "closed_code_fence": false, + "python_ast_parse": true, + "parse_error": null, + "semantic_terminal": true, + "evaluator_covered": true, + "execution": { + "status": "passed", + "return_code": 0, + "runtime_ms": 314.36260099872015, + "harness_sha256": "e4e27b8f12797e58c1403da41903b81918a277a69c402102b0dc61e23c9cb10a" + }, + "fixed_budget_tests_pass": true, + "strict_complete_tests_pass": true + }, + "completion_class": "NATURAL_EOS", + "baseline_prefix_audit": { + "baseline_generated_tokens": 48, + "compared_tokens": 48, + "prompt_hash_exact": true, + "generated_prefix_exact": true, + "baseline_hit_eos": true + } + }, + { + "source_id": "gsm8k/test/1069", + "domain": "math", + "condition": "s0_eos", + "generated_tokens": 213, + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "prompt_token_ids_sha256": "af8148f2dd065587b6d5a13e8fe115de24ccbdaa6dacd40254d522b17c1ff83b", + "generated_token_ids_sha256": "a0c4de5c6c0c4969c0afed16c01332c372d253d54f6567899c51b9cb7cabf19a", + "text_sha256": "4d8fe3fdd2261d4523c8736a0f065cf8e209595cc2a2f19448a3b35cab3c9c3c", + "task_evaluation": { + "gold_final": "300", + "predicted_final": "300", + "extraction_method": "boxed", + "explicit_final_marker": true, + "semantic_terminal": true, + "evaluator_covered": true, + "fixed_budget_numeric_exact": true, + "strict_complete_numeric_exact": true + }, + "completion_class": "NATURAL_EOS", + "baseline_prefix_audit": { + "baseline_generated_tokens": 128, + "compared_tokens": 128, + "prompt_hash_exact": true, + "generated_prefix_exact": true, + "baseline_hit_eos": false + } + }, + { + "source_id": "gsm8k/test/1069", + "domain": "math", + "condition": "s1_eos", + "generated_tokens": 213, + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "prompt_token_ids_sha256": "6fc9f186b31f6926a443a0d8218e5e92ff09af381a872054c954792ca2d2204f", + "generated_token_ids_sha256": "a0c4de5c6c0c4969c0afed16c01332c372d253d54f6567899c51b9cb7cabf19a", + "text_sha256": "4d8fe3fdd2261d4523c8736a0f065cf8e209595cc2a2f19448a3b35cab3c9c3c", + "task_evaluation": { + "gold_final": "300", + "predicted_final": "300", + "extraction_method": "boxed", + "explicit_final_marker": true, + "semantic_terminal": true, + "evaluator_covered": true, + "fixed_budget_numeric_exact": true, + "strict_complete_numeric_exact": true + }, + "completion_class": "NATURAL_EOS", + "baseline_prefix_audit": { + "baseline_generated_tokens": 128, + "compared_tokens": 128, + "prompt_hash_exact": true, + "generated_prefix_exact": true, + "baseline_hit_eos": false + } + }, + { + "source_id": "gsm8k/test/1069", + "domain": "math", + "condition": "s0_bos", + "generated_tokens": 211, + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "prompt_token_ids_sha256": "24dd306a5686c350327c6a23c72a83fc0e9539674bb9956eb3527c68914b70cc", + "generated_token_ids_sha256": "b738f6a3caaffcb4c50909ea3ccdaed5844ea82db16e73baffffa214396623b7", + "text_sha256": "ac292517068f24a3c029f08cc0d9d70edcfd32b845825ad0a466af0980cb6ead", + "task_evaluation": { + "gold_final": "300", + "predicted_final": "300", + "extraction_method": "boxed", + "explicit_final_marker": true, + "semantic_terminal": true, + "evaluator_covered": true, + "fixed_budget_numeric_exact": true, + "strict_complete_numeric_exact": true + }, + "completion_class": "NATURAL_EOS", + "baseline_prefix_audit": { + "baseline_generated_tokens": 128, + "compared_tokens": 128, + "prompt_hash_exact": true, + "generated_prefix_exact": true, + "baseline_hit_eos": false + } + }, + { + "source_id": "gsm8k/test/1069", + "domain": "math", + "condition": "s1_bos", + "generated_tokens": 192, + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "prompt_token_ids_sha256": "9fb414bf7d783b9126038381d3d05e6c636a850ff5ce0c31e436a722dc0d9eba", + "generated_token_ids_sha256": "55777717b0868223d1ea198ec487f5fc8594b132b9802458ac8258ace944894b", + "text_sha256": "c4c5873b576c645844d6dc3be7116075f14516f5f9e6373b20e46c341a51cf51", + "task_evaluation": { + "gold_final": "300", + "predicted_final": "300", + "extraction_method": "boxed", + "explicit_final_marker": true, + "semantic_terminal": true, + "evaluator_covered": true, + "fixed_budget_numeric_exact": true, + "strict_complete_numeric_exact": true + }, + "completion_class": "NATURAL_EOS", + "baseline_prefix_audit": { + "baseline_generated_tokens": 128, + "compared_tokens": 128, + "prompt_hash_exact": true, + "generated_prefix_exact": true, + "baseline_hit_eos": false + } + }, + { + "source_id": "gsm8k/test/1069", + "domain": "math", + "condition": "s0_x", + "generated_tokens": 184, + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "prompt_token_ids_sha256": "649621b617e9d4e0eeb4cd1bfa2abde7beba97e78de3598f23447098686b2252", + "generated_token_ids_sha256": "4c98c4e91046a2a824091a214e088a761f6ae68023ce6fe04e125539c60882a4", + "text_sha256": "84282454ce6b5b1416b2183303027126d577e0e1e93b62181dbf925922cca498", + "task_evaluation": { + "gold_final": "300", + "predicted_final": "300", + "extraction_method": "boxed", + "explicit_final_marker": true, + "semantic_terminal": true, + "evaluator_covered": true, + "fixed_budget_numeric_exact": true, + "strict_complete_numeric_exact": true + }, + "completion_class": "NATURAL_EOS", + "baseline_prefix_audit": { + "baseline_generated_tokens": 128, + "compared_tokens": 128, + "prompt_hash_exact": true, + "generated_prefix_exact": true, + "baseline_hit_eos": false + } + }, + { + "source_id": "gsm8k/test/1069", + "domain": "math", + "condition": "s1_x", + "generated_tokens": 112, + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "prompt_token_ids_sha256": "a846fa2918690d92f2ebda2b3478d1c61be06006d33f21cc62b46e565398da36", + "generated_token_ids_sha256": "38b791aa6f593bb8cc65ab6404ad8b9b9f4026d1f667701d06b7c88597ee07dd", + "text_sha256": "79ea0183839c01a5e4e2f93ebc4e65ebfa7c47b626ae808efe0bac0fdf7380b2", + "task_evaluation": { + "gold_final": "300", + "predicted_final": "300", + "extraction_method": "answer_phrase", + "explicit_final_marker": true, + "semantic_terminal": true, + "evaluator_covered": true, + "fixed_budget_numeric_exact": true, + "strict_complete_numeric_exact": true + }, + "completion_class": "NATURAL_EOS", + "baseline_prefix_audit": { + "baseline_generated_tokens": 112, + "compared_tokens": 112, + "prompt_hash_exact": true, + "generated_prefix_exact": true, + "baseline_hit_eos": true + } + }, + { + "source_id": "gsm8k/test/1069", + "domain": "math", + "condition": "s0_period", + "generated_tokens": 194, + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "prompt_token_ids_sha256": "c9871468f54fb12742eb484332b45383b61d6ba4fc0250e2f2d929165251b35b", + "generated_token_ids_sha256": "856bc8e1e2434f61ca08f9dbb492b079dd8e2c05ddefb24cc992f2dec5bb328b", + "text_sha256": "aeb498f00b41e408290a9d50299a1591c11c03e6c77d2de1d01bd6f29321b93a", + "task_evaluation": { + "gold_final": "300", + "predicted_final": "300", + "extraction_method": "boxed", + "explicit_final_marker": true, + "semantic_terminal": true, + "evaluator_covered": true, + "fixed_budget_numeric_exact": true, + "strict_complete_numeric_exact": true + }, + "completion_class": "NATURAL_EOS", + "baseline_prefix_audit": { + "baseline_generated_tokens": 128, + "compared_tokens": 128, + "prompt_hash_exact": true, + "generated_prefix_exact": true, + "baseline_hit_eos": false + } + }, + { + "source_id": "gsm8k/test/1069", + "domain": "math", + "condition": "s1_period", + "generated_tokens": 192, + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "prompt_token_ids_sha256": "c2f1b1ae4a81b97e603806b23729d92b118bc3de70c647ae0d91c62f6b6912cc", + "generated_token_ids_sha256": "338c0ec1841319140ecf9bd5c7416a581dbd88786a5044ada648010791ebcfc1", + "text_sha256": "d9d4408fa27b8aa6f41cb3741927117dd7b4be0b70e085c0efa202769811258e", + "task_evaluation": { + "gold_final": "300", + "predicted_final": "300", + "extraction_method": "boxed", + "explicit_final_marker": true, + "semantic_terminal": true, + "evaluator_covered": true, + "fixed_budget_numeric_exact": true, + "strict_complete_numeric_exact": true + }, + "completion_class": "NATURAL_EOS", + "baseline_prefix_audit": { + "baseline_generated_tokens": 128, + "compared_tokens": 128, + "prompt_hash_exact": true, + "generated_prefix_exact": true, + "baseline_hit_eos": false + } + }, + { + "source_id": "gsm8k/test/1228", + "domain": "math", + "condition": "s0_eos", + "generated_tokens": 258, + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "prompt_token_ids_sha256": "32ada50df0fccf416d8c91e21dbb4bdd2246fcd7afaa04a69f1f38fc50f8ca5c", + "generated_token_ids_sha256": "9cc560caf3a938fc32017f947e010168e6bcf6b5e598ec3d5be1727a029d9cc9", + "text_sha256": "c8a0aac02a6758a7c6f0376d15cd2ef09108e42169487348475591c5ec76d89d", + "task_evaluation": { + "gold_final": "31", + "predicted_final": "31", + "extraction_method": "boxed", + "explicit_final_marker": true, + "semantic_terminal": true, + "evaluator_covered": true, + "fixed_budget_numeric_exact": true, + "strict_complete_numeric_exact": true + }, + "completion_class": "NATURAL_EOS", + "baseline_prefix_audit": { + "baseline_generated_tokens": 128, + "compared_tokens": 128, + "prompt_hash_exact": true, + "generated_prefix_exact": true, + "baseline_hit_eos": false + } + }, + { + "source_id": "gsm8k/test/1228", + "domain": "math", + "condition": "s1_eos", + "generated_tokens": 215, + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "prompt_token_ids_sha256": "f30e793e92ed3c09cac2e94c1d37a636ca60e1ff8d4e540bd4bb32914bc9f728", + "generated_token_ids_sha256": "b8c489fbc4938fedc1dbdf1bdcb5e3e83413e50b2c7902608155b89aa75a4379", + "text_sha256": "1312a7833a48f3d6c3299ce72be93b235d726dbca1e3a433593197d93dd64331", + "task_evaluation": { + "gold_final": "31", + "predicted_final": "31", + "extraction_method": "boxed", + "explicit_final_marker": true, + "semantic_terminal": true, + "evaluator_covered": true, + "fixed_budget_numeric_exact": true, + "strict_complete_numeric_exact": true + }, + "completion_class": "NATURAL_EOS", + "baseline_prefix_audit": { + "baseline_generated_tokens": 128, + "compared_tokens": 128, + "prompt_hash_exact": true, + "generated_prefix_exact": true, + "baseline_hit_eos": false + } + }, + { + "source_id": "gsm8k/test/1228", + "domain": "math", + "condition": "s0_bos", + "generated_tokens": 228, + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "prompt_token_ids_sha256": "d5adb63b1170d4de4efa1a3bd0d7a788716fcbcc0c917b69c18b5337bdc916f2", + "generated_token_ids_sha256": "3c75f913724f7bd8accd11869d5708e90371845a277702826bc6c0fe3b8d103b", + "text_sha256": "4e98146ed4e9a3b3e68ef922b171cec2486f444f9ba788aaa67f8b96efcd5073", + "task_evaluation": { + "gold_final": "31", + "predicted_final": "31", + "extraction_method": "boxed", + "explicit_final_marker": true, + "semantic_terminal": true, + "evaluator_covered": true, + "fixed_budget_numeric_exact": true, + "strict_complete_numeric_exact": true + }, + "completion_class": "NATURAL_EOS", + "baseline_prefix_audit": { + "baseline_generated_tokens": 128, + "compared_tokens": 128, + "prompt_hash_exact": true, + "generated_prefix_exact": true, + "baseline_hit_eos": false + } + }, + { + "source_id": "gsm8k/test/1228", + "domain": "math", + "condition": "s1_bos", + "generated_tokens": 228, + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "prompt_token_ids_sha256": "b4cdcd54cc58f8c8f30968af667a84f2bdf51d2e846eacfd3940fe23d6c8d47d", + "generated_token_ids_sha256": "3c75f913724f7bd8accd11869d5708e90371845a277702826bc6c0fe3b8d103b", + "text_sha256": "4e98146ed4e9a3b3e68ef922b171cec2486f444f9ba788aaa67f8b96efcd5073", + "task_evaluation": { + "gold_final": "31", + "predicted_final": "31", + "extraction_method": "boxed", + "explicit_final_marker": true, + "semantic_terminal": true, + "evaluator_covered": true, + "fixed_budget_numeric_exact": true, + "strict_complete_numeric_exact": true + }, + "completion_class": "NATURAL_EOS", + "baseline_prefix_audit": { + "baseline_generated_tokens": 128, + "compared_tokens": 128, + "prompt_hash_exact": true, + "generated_prefix_exact": true, + "baseline_hit_eos": false + } + }, + { + "source_id": "gsm8k/test/1228", + "domain": "math", + "condition": "s0_x", + "generated_tokens": 222, + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "prompt_token_ids_sha256": "4f2aa6f9a7b8d503d88375079069a0eee4c1a3a4f777ada27d9de74dfbb5aa35", + "generated_token_ids_sha256": "d833003847179786efdbcefbbbd242818628157f352490e2b7c57e927a8b8263", + "text_sha256": "97ef02ababeeef105c0d877953bbbe5eb6622917faaa70f56f988e4a57e75368", + "task_evaluation": { + "gold_final": "31", + "predicted_final": "31", + "extraction_method": "boxed", + "explicit_final_marker": true, + "semantic_terminal": true, + "evaluator_covered": true, + "fixed_budget_numeric_exact": true, + "strict_complete_numeric_exact": true + }, + "completion_class": "NATURAL_EOS", + "baseline_prefix_audit": { + "baseline_generated_tokens": 128, + "compared_tokens": 128, + "prompt_hash_exact": true, + "generated_prefix_exact": true, + "baseline_hit_eos": false + } + }, + { + "source_id": "gsm8k/test/1228", + "domain": "math", + "condition": "s1_x", + "generated_tokens": 80, + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "prompt_token_ids_sha256": "54226ca7cb7587db7663475656cf6e7887cb2a17374c3137ec81a3ac07746e20", + "generated_token_ids_sha256": "abccf29a6c329726f09ebc2c214b5c259a1661eb1a05bbb7e8c0aca1abcdd74d", + "text_sha256": "c1d2d377257545cc8805b3f6215df9c84f4d9ad17a7df50edbde11a519f4440a", + "task_evaluation": { + "gold_final": "31", + "predicted_final": "31", + "extraction_method": "answer_phrase", + "explicit_final_marker": true, + "semantic_terminal": true, + "evaluator_covered": true, + "fixed_budget_numeric_exact": true, + "strict_complete_numeric_exact": true + }, + "completion_class": "NATURAL_EOS", + "baseline_prefix_audit": { + "baseline_generated_tokens": 80, + "compared_tokens": 80, + "prompt_hash_exact": true, + "generated_prefix_exact": true, + "baseline_hit_eos": true + } + }, + { + "source_id": "gsm8k/test/1228", + "domain": "math", + "condition": "s0_period", + "generated_tokens": 228, + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "prompt_token_ids_sha256": "945934580628dcd1edf2a85b5c83c6afb72ffde9ddec26f5568f6780c953ee22", + "generated_token_ids_sha256": "3c75f913724f7bd8accd11869d5708e90371845a277702826bc6c0fe3b8d103b", + "text_sha256": "4e98146ed4e9a3b3e68ef922b171cec2486f444f9ba788aaa67f8b96efcd5073", + "task_evaluation": { + "gold_final": "31", + "predicted_final": "31", + "extraction_method": "boxed", + "explicit_final_marker": true, + "semantic_terminal": true, + "evaluator_covered": true, + "fixed_budget_numeric_exact": true, + "strict_complete_numeric_exact": true + }, + "completion_class": "NATURAL_EOS", + "baseline_prefix_audit": { + "baseline_generated_tokens": 128, + "compared_tokens": 128, + "prompt_hash_exact": true, + "generated_prefix_exact": true, + "baseline_hit_eos": false + } + }, + { + "source_id": "gsm8k/test/1228", + "domain": "math", + "condition": "s1_period", + "generated_tokens": 243, + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "prompt_token_ids_sha256": "a3debe06e713b24eeba50430c4ab26a96682361c0ad76de71fc9a9e5c319efda", + "generated_token_ids_sha256": "0a4c97d4335a6cf64e2507738d2bf4b5e75488f71ce2de23c37b2e6f33254250", + "text_sha256": "632c2a00ea7441cbd4af33c17cd908e04393fa59c1716b4e444daf013f4d0813", + "task_evaluation": { + "gold_final": "31", + "predicted_final": "31", + "extraction_method": "boxed", + "explicit_final_marker": true, + "semantic_terminal": true, + "evaluator_covered": true, + "fixed_budget_numeric_exact": true, + "strict_complete_numeric_exact": true + }, + "completion_class": "NATURAL_EOS", + "baseline_prefix_audit": { + "baseline_generated_tokens": 128, + "compared_tokens": 128, + "prompt_hash_exact": true, + "generated_prefix_exact": true, + "baseline_hit_eos": false + } + }, + { + "source_id": "gsm8k/test/0144", + "domain": "math", + "condition": "s0_eos", + "generated_tokens": 202, + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "prompt_token_ids_sha256": "d8dc51585cedab0a1ad0851d7e762b43f4e0c384234e27717205b618bdbcd926", + "generated_token_ids_sha256": "29a8e89d23a4b3c9bc018a89a32814230f16555bf998ca4be8091d41a4f6c1ee", + "text_sha256": "58210a2f71f94c40fbe2ca3d690318a2faf67a194e711d0cb070808f381b34f9", + "task_evaluation": { + "gold_final": "20", + "predicted_final": "140", + "extraction_method": "answer_phrase", + "explicit_final_marker": true, + "semantic_terminal": true, + "evaluator_covered": true, + "fixed_budget_numeric_exact": false, + "strict_complete_numeric_exact": false + }, + "completion_class": "NATURAL_EOS", + "baseline_prefix_audit": { + "baseline_generated_tokens": 128, + "compared_tokens": 128, + "prompt_hash_exact": true, + "generated_prefix_exact": true, + "baseline_hit_eos": false + } + }, + { + "source_id": "gsm8k/test/0144", + "domain": "math", + "condition": "s1_eos", + "generated_tokens": 194, + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "prompt_token_ids_sha256": "e9be7845cdbf1b842381628cfb7fc89a2856e64d6ad742734daccb7870279f73", + "generated_token_ids_sha256": "e60c5ea3aee55c1bb4a624fda24628ad0aa940ee88d1114ede272b13c627a74c", + "text_sha256": "ab90643cacfadd43de611cbf836699f0153968d6ef44dfff2939113ca4a439e3", + "task_evaluation": { + "gold_final": "20", + "predicted_final": "20", + "extraction_method": "answer_phrase", + "explicit_final_marker": true, + "semantic_terminal": true, + "evaluator_covered": true, + "fixed_budget_numeric_exact": true, + "strict_complete_numeric_exact": true + }, + "completion_class": "NATURAL_EOS", + "baseline_prefix_audit": { + "baseline_generated_tokens": 128, + "compared_tokens": 128, + "prompt_hash_exact": true, + "generated_prefix_exact": true, + "baseline_hit_eos": false + } + }, + { + "source_id": "gsm8k/test/0144", + "domain": "math", + "condition": "s0_bos", + "generated_tokens": 246, + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "prompt_token_ids_sha256": "a89ab243876f7c105b1c01767c58563ab499075e13f272a28eede5c49f89352c", + "generated_token_ids_sha256": "4b78f623166021d8741fa27bf49b60625955a5df5e6828b9aa5e9310a865eb36", + "text_sha256": "d85925e46352c1d78e0163fe182175dc6f23b738d65adca2b9962166c054594a", + "task_evaluation": { + "gold_final": "20", + "predicted_final": "20", + "extraction_method": "boxed", + "explicit_final_marker": true, + "semantic_terminal": true, + "evaluator_covered": true, + "fixed_budget_numeric_exact": true, + "strict_complete_numeric_exact": true + }, + "completion_class": "NATURAL_EOS", + "baseline_prefix_audit": { + "baseline_generated_tokens": 128, + "compared_tokens": 128, + "prompt_hash_exact": true, + "generated_prefix_exact": true, + "baseline_hit_eos": false + } + }, + { + "source_id": "gsm8k/test/0144", + "domain": "math", + "condition": "s1_bos", + "generated_tokens": 226, + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "prompt_token_ids_sha256": "bbd3ea174b21ab94a23b9e995341c8e3a84cdab258103589011248700967da39", + "generated_token_ids_sha256": "e9d5a030c416715a9fec5527b6375b0ddd29a4e21074fca24a0ed1a0bb4cb031", + "text_sha256": "908f5bcac0889d7033542fa6c81dd8256f69ab7fa6b52591cdf5291def81c911", + "task_evaluation": { + "gold_final": "20", + "predicted_final": "36", + "extraction_method": "answer_phrase", + "explicit_final_marker": true, + "semantic_terminal": true, + "evaluator_covered": true, + "fixed_budget_numeric_exact": false, + "strict_complete_numeric_exact": false + }, + "completion_class": "NATURAL_EOS", + "baseline_prefix_audit": { + "baseline_generated_tokens": 128, + "compared_tokens": 128, + "prompt_hash_exact": true, + "generated_prefix_exact": true, + "baseline_hit_eos": false + } + }, + { + "source_id": "gsm8k/test/0144", + "domain": "math", + "condition": "s0_x", + "generated_tokens": 216, + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "prompt_token_ids_sha256": "08a9801022d9489dc3c5272ce64b74bc8bed58ead7ebbc435c939d5b3cff837e", + "generated_token_ids_sha256": "32727a41edd61f3c9c1778ba36a74b954a1fce658a28bdf4249ab41801848436", + "text_sha256": "5d93df4fa74144e98f8671b8a440c3deab1e0d5baab049463b42ad8497031f79", + "task_evaluation": { + "gold_final": "20", + "predicted_final": "36", + "extraction_method": "answer_phrase", + "explicit_final_marker": true, + "semantic_terminal": true, + "evaluator_covered": true, + "fixed_budget_numeric_exact": false, + "strict_complete_numeric_exact": false + }, + "completion_class": "NATURAL_EOS", + "baseline_prefix_audit": { + "baseline_generated_tokens": 128, + "compared_tokens": 128, + "prompt_hash_exact": true, + "generated_prefix_exact": true, + "baseline_hit_eos": false + } + }, + { + "source_id": "gsm8k/test/0144", + "domain": "math", + "condition": "s1_x", + "generated_tokens": 222, + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "prompt_token_ids_sha256": "e4b78a7bc4de036db8d331132f6847eb184232dbb15949bd7cd731f4b365ee15", + "generated_token_ids_sha256": "6ad30f9ec1cbb8a60e73173f4a7a053653dfcf6b56160fd0c1174890b0edb476", + "text_sha256": "31153af0c3dc838d62c2ce3c3edfec3f3dd2cc4f9868e76381075447493ace0a", + "task_evaluation": { + "gold_final": "20", + "predicted_final": "20", + "extraction_method": "boxed", + "explicit_final_marker": true, + "semantic_terminal": true, + "evaluator_covered": true, + "fixed_budget_numeric_exact": true, + "strict_complete_numeric_exact": true + }, + "completion_class": "NATURAL_EOS", + "baseline_prefix_audit": { + "baseline_generated_tokens": 128, + "compared_tokens": 128, + "prompt_hash_exact": true, + "generated_prefix_exact": true, + "baseline_hit_eos": false + } + }, + { + "source_id": "gsm8k/test/0144", + "domain": "math", + "condition": "s0_period", + "generated_tokens": 272, + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "prompt_token_ids_sha256": "85b762195d6e87a0e483912ff46ed28ae1e6703374a433ef6e8406fe5a258399", + "generated_token_ids_sha256": "92f208c3c4b7d0e80e7a833a778e026981f7fb04ad8c0a85cc6bfb1556286877", + "text_sha256": "bf27183b1280011a32c44f4c10ec869bad36e7f4a93b6b1018120b9a8d756c7b", + "task_evaluation": { + "gold_final": "20", + "predicted_final": "20", + "extraction_method": "boxed", + "explicit_final_marker": true, + "semantic_terminal": true, + "evaluator_covered": true, + "fixed_budget_numeric_exact": true, + "strict_complete_numeric_exact": true + }, + "completion_class": "NATURAL_EOS", + "baseline_prefix_audit": { + "baseline_generated_tokens": 128, + "compared_tokens": 128, + "prompt_hash_exact": true, + "generated_prefix_exact": true, + "baseline_hit_eos": false + } + }, + { + "source_id": "gsm8k/test/0144", + "domain": "math", + "condition": "s1_period", + "generated_tokens": 290, + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "prompt_token_ids_sha256": "8a549e4eefb67f9c7df04d2d81824500fadbeb873948fda10055fbc3bb0ac287", + "generated_token_ids_sha256": "423b22a7577fc76dcdc8fcbe854be2584047ce8bda6b6d9fd1435f243349221e", + "text_sha256": "89387872074e5475d4b5396fe25d39df5fa92968a3b7b3f29cdb231897eca1dc", + "task_evaluation": { + "gold_final": "20", + "predicted_final": "92", + "extraction_method": "answer_phrase", + "explicit_final_marker": true, + "semantic_terminal": true, + "evaluator_covered": true, + "fixed_budget_numeric_exact": false, + "strict_complete_numeric_exact": false + }, + "completion_class": "NATURAL_EOS", + "baseline_prefix_audit": { + "baseline_generated_tokens": 128, + "compared_tokens": 128, + "prompt_hash_exact": true, + "generated_prefix_exact": true, + "baseline_hit_eos": false + } + }, + { + "source_id": "gsm8k/test/1251", + "domain": "math", + "condition": "s0_eos", + "generated_tokens": 258, + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "prompt_token_ids_sha256": "49fe40432f2d059dd188bd35dc10f373d43b74c3d1e0afcb89c1ef642f8d5b6c", + "generated_token_ids_sha256": "fdc36ad60d8d94773dc6e0a32efe4bd64768b6a91f45b6f9529399075118261a", + "text_sha256": "bb1adca5a2bfc7df962745e5f1e5182cab7b2c3055f935b83a33ed74b9a1c265", + "task_evaluation": { + "gold_final": "30", + "predicted_final": "30", + "extraction_method": "boxed", + "explicit_final_marker": true, + "semantic_terminal": true, + "evaluator_covered": true, + "fixed_budget_numeric_exact": true, + "strict_complete_numeric_exact": true + }, + "completion_class": "NATURAL_EOS", + "baseline_prefix_audit": { + "baseline_generated_tokens": 128, + "compared_tokens": 128, + "prompt_hash_exact": true, + "generated_prefix_exact": true, + "baseline_hit_eos": false + } + }, + { + "source_id": "gsm8k/test/1251", + "domain": "math", + "condition": "s1_eos", + "generated_tokens": 200, + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "prompt_token_ids_sha256": "9826fc7ee5c2b9677c860ff687740351402c53395073d397a387bb812035d3ed", + "generated_token_ids_sha256": "2e866946da1744ce7a7031c7332609e3c8ad2af7a026efc1acd7facf4ac421a4", + "text_sha256": "683438d5a90638202b680f307e32fcf49cbce008ae3b0d95b90b12556eae35a2", + "task_evaluation": { + "gold_final": "30", + "predicted_final": "20", + "extraction_method": "boxed", + "explicit_final_marker": true, + "semantic_terminal": true, + "evaluator_covered": true, + "fixed_budget_numeric_exact": false, + "strict_complete_numeric_exact": false + }, + "completion_class": "NATURAL_EOS", + "baseline_prefix_audit": { + "baseline_generated_tokens": 128, + "compared_tokens": 128, + "prompt_hash_exact": true, + "generated_prefix_exact": true, + "baseline_hit_eos": false + } + }, + { + "source_id": "gsm8k/test/1251", + "domain": "math", + "condition": "s0_bos", + "generated_tokens": 176, + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "prompt_token_ids_sha256": "3fd156e5b2f57688543d3cac4a5a66278ee941a2b714b3ec05a13fb86f7cbe17", + "generated_token_ids_sha256": "8151a40b15e865988e5b2856aea16ab62ba85a95f53d0d6953abff0d8760e8e2", + "text_sha256": "313ec857f0e2c347fdb6e21567696e85e357482e6b9b1375cd9e356f69cd9327", + "task_evaluation": { + "gold_final": "30", + "predicted_final": "42.5", + "extraction_method": "boxed", + "explicit_final_marker": true, + "semantic_terminal": true, + "evaluator_covered": true, + "fixed_budget_numeric_exact": false, + "strict_complete_numeric_exact": false + }, + "completion_class": "NATURAL_EOS", + "baseline_prefix_audit": { + "baseline_generated_tokens": 128, + "compared_tokens": 128, + "prompt_hash_exact": true, + "generated_prefix_exact": true, + "baseline_hit_eos": false + } + }, + { + "source_id": "gsm8k/test/1251", + "domain": "math", + "condition": "s1_bos", + "generated_tokens": 172, + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "prompt_token_ids_sha256": "24f575a36c25b0cb1a7946f43dc44c3801f72245c252e1226d835897e20b0059", + "generated_token_ids_sha256": "c8b7222ba2184ffa7cd0ed11b768d50df4aa5ace22a617e7ee1148bdd2c80c9e", + "text_sha256": "04edc5d8cc16f0de4f27d652acc07cc8565b944a32282c048875ee683ba5722b", + "task_evaluation": { + "gold_final": "30", + "predicted_final": "30", + "extraction_method": "answer_phrase", + "explicit_final_marker": true, + "semantic_terminal": true, + "evaluator_covered": true, + "fixed_budget_numeric_exact": true, + "strict_complete_numeric_exact": true + }, + "completion_class": "NATURAL_EOS", + "baseline_prefix_audit": { + "baseline_generated_tokens": 128, + "compared_tokens": 128, + "prompt_hash_exact": true, + "generated_prefix_exact": true, + "baseline_hit_eos": false + } + }, + { + "source_id": "gsm8k/test/1251", + "domain": "math", + "condition": "s0_x", + "generated_tokens": 251, + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "prompt_token_ids_sha256": "64d49f0054db6205880b0687d129a51debca8056dc7a878500dd0e27b170fcbe", + "generated_token_ids_sha256": "4065692127945063597ccea385681a2d6bf54c068e9da5a1fd0fe12fc001eaa2", + "text_sha256": "8b1302ba345b8e6b349b97f74c9a101b98996eee8a15fe4abee3d2fc6c7ed76b", + "task_evaluation": { + "gold_final": "30", + "predicted_final": "33", + "extraction_method": "last_number_fallback", + "explicit_final_marker": false, + "semantic_terminal": true, + "evaluator_covered": true, + "fixed_budget_numeric_exact": false, + "strict_complete_numeric_exact": false + }, + "completion_class": "NATURAL_EOS", + "baseline_prefix_audit": { + "baseline_generated_tokens": 128, + "compared_tokens": 128, + "prompt_hash_exact": true, + "generated_prefix_exact": true, + "baseline_hit_eos": false + } + }, + { + "source_id": "gsm8k/test/1251", + "domain": "math", + "condition": "s1_x", + "generated_tokens": 246, + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "prompt_token_ids_sha256": "344602c1c00a954952d226c6ce8ed07d163c2728ea0b8778732ad9a6432d7d6c", + "generated_token_ids_sha256": "94b7b24e3b427781a9e6487553437db78a87414636a6ac2c096d9ef30d282d51", + "text_sha256": "4a3ad839bfb4307b78ab4ec92ebe34c3c8ea90a9e69284d9edab3401a30efb64", + "task_evaluation": { + "gold_final": "30", + "predicted_final": "6", + "extraction_method": "last_number_fallback", + "explicit_final_marker": false, + "semantic_terminal": true, + "evaluator_covered": true, + "fixed_budget_numeric_exact": false, + "strict_complete_numeric_exact": false + }, + "completion_class": "NATURAL_EOS", + "baseline_prefix_audit": { + "baseline_generated_tokens": 128, + "compared_tokens": 128, + "prompt_hash_exact": true, + "generated_prefix_exact": true, + "baseline_hit_eos": false + } + }, + { + "source_id": "gsm8k/test/1251", + "domain": "math", + "condition": "s0_period", + "generated_tokens": 235, + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "prompt_token_ids_sha256": "44c836c323e7e7a07a5153325738d347e28b910234dfb1a8883184546ecadd9f", + "generated_token_ids_sha256": "b14181466787e63179fc4cc2e8f2aa636a33f88d10155d74adc236dae6d6e795", + "text_sha256": "bea129f0b204165cd5301f144a8ba2c0093708e5b64b8d6eb150c09ec729d01c", + "task_evaluation": { + "gold_final": "30", + "predicted_final": "6", + "extraction_method": "last_number_fallback", + "explicit_final_marker": false, + "semantic_terminal": true, + "evaluator_covered": true, + "fixed_budget_numeric_exact": false, + "strict_complete_numeric_exact": false + }, + "completion_class": "NATURAL_EOS", + "baseline_prefix_audit": { + "baseline_generated_tokens": 128, + "compared_tokens": 128, + "prompt_hash_exact": true, + "generated_prefix_exact": true, + "baseline_hit_eos": false + } + }, + { + "source_id": "gsm8k/test/1251", + "domain": "math", + "condition": "s1_period", + "generated_tokens": 210, + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "prompt_token_ids_sha256": "ff4b886b7a2e0289202dd757d2754cc337b6577268f81cdc2ac0b5db5f2edf9f", + "generated_token_ids_sha256": "78843b3beba7461c2b8990ee73c434808c6034051aa186f4fb896cf8d0486a6b", + "text_sha256": "e69ceefb9dabd0f381009ba2ab15f2000ecf784ad66fc87582141c748f2dfa9d", + "task_evaluation": { + "gold_final": "30", + "predicted_final": "30", + "extraction_method": "last_number_fallback", + "explicit_final_marker": false, + "semantic_terminal": true, + "evaluator_covered": true, + "fixed_budget_numeric_exact": true, + "strict_complete_numeric_exact": true + }, + "completion_class": "NATURAL_EOS", + "baseline_prefix_audit": { + "baseline_generated_tokens": 128, + "compared_tokens": 128, + "prompt_hash_exact": true, + "generated_prefix_exact": true, + "baseline_hit_eos": false + } + } + ], + "summary": { + "outputs": 128, + "natural_eos": 121, + "budget_truncated": 7, + "completion_classes": { + "NATURAL_EOS": 121, + "BUDGET_TRUNCATED_UNRESOLVED": 7 + }, + "baseline_prefix": { + "cells": 128, + "prompt_hash_exact": 128, + "generated_prefix_exact": 128 + }, + "by_condition": { + "s0_bos": { + "outputs": 16, + "natural_eos": 15, + "budget_truncated": 1, + "mean_generated_tokens": 272.5625, + "completion_classes": { + "BUDGET_TRUNCATED_UNRESOLVED": 1, + "NATURAL_EOS": 15 + }, + "math_fixed_budget_exact": 3, + "math_strict_complete_exact": 3, + "math_sources": 4, + "code_ast_parse": 4, + "code_executed": 4, + "code_tests_pass": 4, + "code_sources": 4 + }, + "s0_eos": { + "outputs": 16, + "natural_eos": 15, + "budget_truncated": 1, + "mean_generated_tokens": 278, + "completion_classes": { + "NATURAL_EOS": 15, + "BUDGET_TRUNCATED_UNRESOLVED": 1 + }, + "math_fixed_budget_exact": 3, + "math_strict_complete_exact": 3, + "math_sources": 4, + "code_ast_parse": 4, + "code_executed": 4, + "code_tests_pass": 3, + "code_sources": 4 + }, + "s0_period": { + "outputs": 16, + "natural_eos": 15, + "budget_truncated": 1, + "mean_generated_tokens": 270.875, + "completion_classes": { + "NATURAL_EOS": 15, + "BUDGET_TRUNCATED_UNRESOLVED": 1 + }, + "math_fixed_budget_exact": 3, + "math_strict_complete_exact": 3, + "math_sources": 4, + "code_ast_parse": 4, + "code_executed": 4, + "code_tests_pass": 3, + "code_sources": 4 + }, + "s0_x": { + "outputs": 16, + "natural_eos": 13, + "budget_truncated": 3, + "mean_generated_tokens": 294.375, + "completion_classes": { + "NATURAL_EOS": 13, + "BUDGET_TRUNCATED_UNRESOLVED": 3 + }, + "math_fixed_budget_exact": 2, + "math_strict_complete_exact": 2, + "math_sources": 4, + "code_ast_parse": 4, + "code_executed": 4, + "code_tests_pass": 3, + "code_sources": 4 + }, + "s1_bos": { + "outputs": 16, + "natural_eos": 16, + "budget_truncated": 0, + "mean_generated_tokens": 232.5625, + "completion_classes": { + "NATURAL_EOS": 16 + }, + "math_fixed_budget_exact": 3, + "math_strict_complete_exact": 3, + "math_sources": 4, + "code_ast_parse": 4, + "code_executed": 4, + "code_tests_pass": 4, + "code_sources": 4 + }, + "s1_eos": { + "outputs": 16, + "natural_eos": 15, + "budget_truncated": 1, + "mean_generated_tokens": 229.5625, + "completion_classes": { + "NATURAL_EOS": 15, + "BUDGET_TRUNCATED_UNRESOLVED": 1 + }, + "math_fixed_budget_exact": 3, + "math_strict_complete_exact": 3, + "math_sources": 4, + "code_ast_parse": 3, + "code_executed": 3, + "code_tests_pass": 2, + "code_sources": 4 + }, + "s1_period": { + "outputs": 16, + "natural_eos": 16, + "budget_truncated": 0, + "mean_generated_tokens": 158.3125, + "completion_classes": { + "NATURAL_EOS": 16 + }, + "math_fixed_budget_exact": 3, + "math_strict_complete_exact": 3, + "math_sources": 4, + "code_ast_parse": 4, + "code_executed": 4, + "code_tests_pass": 3, + "code_sources": 4 + }, + "s1_x": { + "outputs": 16, + "natural_eos": 16, + "budget_truncated": 0, + "mean_generated_tokens": 177.3125, + "completion_classes": { + "NATURAL_EOS": 16 + }, + "math_fixed_budget_exact": 3, + "math_strict_complete_exact": 3, + "math_sources": 4, + "code_ast_parse": 4, + "code_executed": 4, + "code_tests_pass": 2, + "code_sources": 4 + } + } + }, + "claim_boundary": [ + "Four math and four code sources are not benchmark estimates.", + "Completion-conditioned metrics are selection-biased diagnostics.", + "A passing HumanEval test is functional evidence, not code-safety evidence.", + "Fallback last-number extraction is not strict completion.", + "Counterfactual token sequences are not official-valid chats." + ], + "content_hash": "42a3dcf66315256c15c61fdffbc78dc7d2e478e53c297c3ad12d960206e877e2" +} diff --git a/src/data/deepseek-v2-lite-chat-completion-512-repro-1pd.json b/src/data/deepseek-v2-lite-chat-completion-512-repro-1pd.json new file mode 100644 index 0000000..985d6b1 --- /dev/null +++ b/src/data/deepseek-v2-lite-chat-completion-512-repro-1pd.json @@ -0,0 +1,9568 @@ +{ + "schema_version": 1, + "captured_at": "2026-07-29T15:42:02.455829+00:00", + "model": { + "repo": "deepseek-ai/DeepSeek-V2-Lite-Chat", + "revision": "85864749cd611b4353ce1decdb286193298f64c7", + "checkpoint_identity": "SFT Chat", + "architecture": "DeepseekV2ForCausalLM", + "dtype": "bfloat16", + "checkpoint_tensor_bytes": 31412968448, + "shard_file_bytes_including_headers": 31413626576, + "download_revision_contract": { + "metadata_root": "/home/wuyang/.cache/llm-atlas/deepseek-v2-lite-chat-85864749/.cache/huggingface/download", + "all_files_same_revision": true, + "files": { + "config.json": { + "revision": "85864749cd611b4353ce1decdb286193298f64c7", + "etag": "a1aa8126bbf462cbec8fcc79e8c98d8d87f5c7ed" + }, + "configuration_deepseek.py": { + "revision": "85864749cd611b4353ce1decdb286193298f64c7", + "etag": "82e0f5d9d33620a66e328fdeae0b8dc12e2cff7c" + }, + "generation_config.json": { + "revision": "85864749cd611b4353ce1decdb286193298f64c7", + "etag": "458e1d985ba3fbaaf62a4d1a9dd6ff795a451f7e" + }, + "model.safetensors.index.json": { + "revision": "85864749cd611b4353ce1decdb286193298f64c7", + "etag": "5a821356160292c668d01f8e7fdf9abba4a7b72d" + }, + "model-00001-of-000004.safetensors": { + "revision": "85864749cd611b4353ce1decdb286193298f64c7", + "etag": "a314b79a30810b1038f9db08345178e16fb5742aa266c4a3dc05054c59800082" + }, + "model-00002-of-000004.safetensors": { + "revision": "85864749cd611b4353ce1decdb286193298f64c7", + "etag": "b0bd088feada0af954614da3a5b179c4d4d5d8bb2482ec83194d101f3fe91796" + }, + "model-00003-of-000004.safetensors": { + "revision": "85864749cd611b4353ce1decdb286193298f64c7", + "etag": "d31b192e488f0b3a04e007d842c3c9ba5783d944cb1cc27402fe8b8bb837c490" + }, + "model-00004-of-000004.safetensors": { + "revision": "85864749cd611b4353ce1decdb286193298f64c7", + "etag": "304499be0ea06bf8a3937d7a3cc515bc3738dbd288bdd0bbc1b2d3560fce4930" + }, + "modeling_deepseek.py": { + "revision": "85864749cd611b4353ce1decdb286193298f64c7", + "etag": "847a458bedcc8df352b1a89315b8e400b9bc6030" + }, + "tokenization_deepseek_fast.py": { + "revision": "85864749cd611b4353ce1decdb286193298f64c7", + "etag": "d24377191dd00e80c44f22e31dc15272258a22de" + }, + "tokenizer.json": { + "revision": "85864749cd611b4353ce1decdb286193298f64c7", + "etag": "8b284e5afe1730e31c97ed5c3bdf240adbd15c86" + }, + "tokenizer_config.json": { + "revision": "85864749cd611b4353ce1decdb286193298f64c7", + "etag": "685b4b63ad1aedad8f98824ab21d2ff422d9e1b1" + } + } + }, + "files": { + "config.json": { + "bytes": 1522, + "sha256": "f346286b0f1c8b044252fd54cb4fa78b9fab6472a6e8bebb9edfe03d414ea03d" + }, + "configuration_deepseek.py": { + "bytes": 10338, + "sha256": "6de5e7445ab490a16482027b131d5bd6a003da9b58a182a11432115fac84ce59" + }, + "generation_config.json": { + "bytes": 181, + "sha256": "63ec07f6cb36bd8359b44f671123518dd6fbf55007e0c74aa96c296a75def8b5" + }, + "model.safetensors.index.json": { + "bytes": 479924, + "sha256": "d2cdb2f325f6682cf3ad1ad2526a9f979d857390b579380c0331d975136e0acf" + }, + "model-00001-of-000004.safetensors": { + "bytes": 8594887408, + "sha256": "a314b79a30810b1038f9db08345178e16fb5742aa266c4a3dc05054c59800082" + }, + "model-00002-of-000004.safetensors": { + "bytes": 8591757448, + "sha256": "b0bd088feada0af954614da3a5b179c4d4d5d8bb2482ec83194d101f3fe91796" + }, + "model-00003-of-000004.safetensors": { + "bytes": 8590718520, + "sha256": "d31b192e488f0b3a04e007d842c3c9ba5783d944cb1cc27402fe8b8bb837c490" + }, + "model-00004-of-000004.safetensors": { + "bytes": 5636263200, + "sha256": "304499be0ea06bf8a3937d7a3cc515bc3738dbd288bdd0bbc1b2d3560fce4930" + }, + "modeling_deepseek.py": { + "bytes": 78672, + "sha256": "7d8e5221095286eea991137760893fd7ba52727c0b4ebf48ec09e8bc56b45b9c" + }, + "tokenization_deepseek_fast.py": { + "bytes": 1368, + "sha256": "702fc7dbadc450f2fecfbc59e248ecca5845b49101e8f58f805261c920a3effa" + }, + "tokenizer.json": { + "bytes": 4607451, + "sha256": "41f3bf64213da8c012d8bd0871a58a1fdf70463e8f08f110ddbb1082f529f669" + }, + "tokenizer_config.json": { + "bytes": 1279, + "sha256": "31181eaf79394ea26728d95ecb54fe7c8413e6f56085dbabc8b0818134380ec8" + } + } + }, + "tokenizer_contract": { + "length": 100002, + "vocab_size": 100000, + "all_special_tokens": [ + "<|begin▁of▁sentence|>", + "<|end▁of▁sentence|>" + ], + "all_special_ids": [ + 100000, + 100001 + ], + "boundary_token_ids": { + "eos": 100001, + "bos": 100000, + "x": 87, + "period": 13 + }, + "pad_token_id": 100001, + "pad_aliases_eos": true + }, + "source_contract": { + "reference_path": "src/data/deepseek-v2-lite-routing-special-token-family-control.json", + "reference_sha256": "c372c1b03a8b15f615b54ded5d9257a8fc2cdb7728001735d3d4c1d8534af5bf", + "reference_model_revision": "604d5664dddd88a0433dbae533b7fe9472482de0", + "sample_salt": "llm-atlas-deepseek-routing-template-control-v1", + "domains": [ + "english", + "chinese", + "code", + "math" + ], + "per_domain": 1, + "sources": 4, + "full_source_text_used": true, + "reference_routing_target_tokens": 23, + "selection_identity": "same source IDs and ranks as the pinned base-routing special-token experiment; full source text is used for generation rather than the 23-token routing prefix" + }, + "generation_contract": { + "conditions": { + "s0_eos": { + "system": 0, + "history": "filler", + "boundary": "eos", + "token_class": "special" + }, + "s1_eos": { + "system": 1, + "history": "filler", + "boundary": "eos", + "token_class": "special" + }, + "s0_bos": { + "system": 0, + "history": "filler", + "boundary": "bos", + "token_class": "special" + }, + "s1_bos": { + "system": 1, + "history": "filler", + "boundary": "bos", + "token_class": "special" + }, + "s0_x": { + "system": 0, + "history": "filler", + "boundary": "x", + "token_class": "ordinary_control" + }, + "s1_x": { + "system": 1, + "history": "filler", + "boundary": "x", + "token_class": "ordinary_control" + }, + "s0_period": { + "system": 0, + "history": "filler", + "boundary": "period", + "token_class": "ordinary_control" + }, + "s1_period": { + "system": 1, + "history": "filler", + "boundary": "period", + "token_class": "ordinary_control" + } + }, + "official_serialization": { + "eos": true, + "bos": false, + "x": false, + "period": false + }, + "decode": "greedy", + "do_sample": false, + "max_new_tokens": 512, + "use_cache": true, + "official_generation_config_recorded_not_used": { + "_from_model_config": true, + "bos_token_id": 100000, + "eos_token_id": 100001, + "do_sample": true, + "temperature": 0.3, + "top_p": 0.95, + "transformers_version": "4.39.3" + }, + "all_eight_conditions_same_source_batch": true, + "batch_padding": "left padding with PAD=EOS and attention_mask=0; generation prefix ends at the same batch column", + "counterfactual_boundary": "BOS/x/period cells edit one pre-target token ID after official rendering and are not valid official chats" + }, + "execution": { + "python": "3.10.14", + "torch": "2.11.0+cu128", + "transformers": "4.41.2", + "accelerate": "1.13.0", + "safetensors": "0.8.0", + "platform": "Linux-7.0.0-28-generic-x86_64-with-glibc2.43", + "gpu": "NVIDIA GeForce RTX 5090", + "gpu_memory_limit": "28GiB", + "cpu_memory_limit": "80GiB", + "pytorch_cuda_alloc_conf": "expandable_segments:True", + "input_device": "cuda:0", + "device_map": { + "model.embed_tokens": 0, + "model.layers.0": 0, + "model.layers.1": 0, + "model.layers.2": 0, + "model.layers.3": 0, + "model.layers.4": 0, + "model.layers.5": 0, + "model.layers.6": 0, + "model.layers.7": 0, + "model.layers.8": 0, + "model.layers.9": 0, + "model.layers.10": 0, + "model.layers.11": 0, + "model.layers.12": 0, + "model.layers.13": 0, + "model.layers.14": 0, + "model.layers.15": 0, + "model.layers.16": 0, + "model.layers.17": 0, + "model.layers.18": 0, + "model.layers.19": 0, + "model.layers.20": 0, + "model.layers.21": 0, + "model.layers.22": 0, + "model.layers.23": 0, + "model.layers.24": "cpu", + "model.layers.25": "cpu", + "model.layers.26": "cpu", + "model.norm": "cpu", + "lm_head": "cpu" + }, + "parameter_bytes_by_runtime_parameter_device": { + "cuda:0": 27484446720, + "meta": 3928521728 + }, + "parameter_bytes_by_dtype": { + "torch.bfloat16": 31412968448 + }, + "offload_parameter_device_note": "Accelerate CPU-offloaded modules expose meta parameters between forwards; hf_device_map is authoritative for their CPU placement.", + "load_seconds": 8.43516024100245, + "load_peak_cuda_memory_allocated_bytes": 28616922624, + "cuda_memory_allocated_after_load_bytes": 28616922624, + "peak_cuda_memory_allocated_bytes": 30861684736, + "process_max_rss_kib": 18825952, + "official_single_gpu_bf16_requirement": "40GB GPU", + "local_single_gpu_capacity_mib": 32607, + "offload_required_by_local_capacity": true + }, + "sources": [ + { + "id": "wikitext2/raw-validation/0443", + "domain": "english", + "label": "English encyclopedia", + "within_domain_index": 0, + "selection_rank": "004b632f55ea14a7a1f99552db185df62bb0bbd0914ca94c411d0325d0e96639", + "source_text_sha256": "d975cf38b1f984b025b2aee92f625916a07cb7f35335865ca9020146ca1458f0", + "source_characters": 506, + "source_tokens": 114, + "prompt_tokens_by_condition": { + "s0_eos": 138, + "s1_eos": 154, + "s0_bos": 138, + "s1_bos": 154, + "s0_x": 138, + "s1_x": 154, + "s0_period": 138, + "s1_period": 154 + }, + "batch_prompt_tokens_after_left_padding": 154, + "batch_padding_side": "left", + "batch_conditions": 8, + "generation_seconds": 119.37449872901198, + "peak_cuda_memory_allocated_bytes": 30861684736, + "generated_tokens_including_batch_padding": 4096, + "outputs": [ + { + "condition": "s0_eos", + "factors": { + "system": 0, + "history": "filler", + "boundary": "eos", + "token_class": "special" + }, + "prompt_tokens": 138, + "left_padding_tokens": 16, + "prompt_token_ids_sha256": "5434667d3541b957f782b64d98c09083bd369ecd7cdc3a7df8696dfb22d896c5", + "generated_tokens": 463, + "generated_token_ids": [ + 429, + 207, + 16, + 24, + 23, + 21, + 11679, + 440, + 2777, + 621, + 279, + 26713, + 1, + 457, + 254, + 4121, + 7682, + 1260, + 8991, + 4219, + 324, + 9701, + 17815, + 245, + 4485, + 8401, + 279, + 895, + 6255, + 3266, + 276, + 254, + 34959, + 96287, + 3093, + 280, + 634, + 280, + 895, + 14720, + 11, + 440, + 57199, + 280, + 18670, + 883, + 429, + 4219, + 438, + 10785, + 276, + 5859, + 20804, + 21121, + 11, + 588, + 661, + 245, + 4971, + 3822, + 366, + 21005, + 21121, + 13, + 3159, + 11, + 21005, + 21121, + 438, + 77491, + 276, + 6255, + 254, + 11679, + 3266, + 276, + 11820, + 786, + 254, + 19151, + 4910, + 280, + 254, + 11679, + 6, + 82, + 28329, + 285, + 254, + 41862, + 20667, + 30106, + 279, + 254, + 5654, + 13, + 185, + 185, + 549, + 5654, + 440, + 57199, + 280, + 18670, + 1084, + 588, + 317, + 786, + 254, + 47161, + 42023, + 364, + 6399, + 275, + 11, + 245, + 8565, + 22429, + 779, + 13185, + 78713, + 6997, + 10606, + 331, + 3807, + 13388, + 430, + 254, + 45522, + 358, + 53012, + 12, + 79158, + 4138, + 1774, + 18928, + 3182, + 2320, + 5427, + 6368, + 4532, + 11, + 438, + 24712, + 1653, + 19151, + 285, + 41862, + 327, + 1272, + 14934, + 13, + 21005, + 21121, + 438, + 10849, + 344, + 254, + 19151, + 4910, + 280, + 254, + 5654, + 285, + 895, + 3605, + 3502, + 744, + 441, + 889, + 64164, + 1313, + 31249, + 548, + 839, + 14565, + 279, + 1190, + 35350, + 285, + 94800, + 13, + 185, + 185, + 2124, + 245, + 1230, + 11, + 21005, + 21121, + 15354, + 276, + 6255, + 440, + 2777, + 621, + 279, + 26713, + 1, + 366, + 895, + 3632, + 28329, + 285, + 3093, + 13, + 1002, + 5426, + 276, + 245, + 8401, + 279, + 254, + 11679, + 6, + 82, + 6255, + 11, + 372, + 324, + 9701, + 6, + 82, + 4988, + 11, + 5859, + 20804, + 21121, + 11, + 661, + 276, + 1275, + 274, + 8615, + 4971, + 7204, + 327, + 254, + 11679, + 13, + 43390, + 11, + 254, + 4219, + 6, + 82, + 11679, + 438, + 12389, + 581, + 457, + 3824, + 539, + 255, + 21121, + 11, + 588, + 10899, + 276, + 27754, + 254, + 11679, + 13, + 185, + 185, + 6501, + 11, + 254, + 35350, + 13254, + 254, + 3093, + 280, + 440, + 57199, + 280, + 18670, + 1, + 285, + 254, + 28329, + 43650, + 13, + 3824, + 539, + 255, + 21121, + 13070, + 441, + 276, + 3433, + 440, + 2777, + 621, + 279, + 26713, + 1, + 279, + 895, + 6269, + 6255, + 10537, + 11, + 588, + 7195, + 344, + 254, + 11679, + 438, + 441, + 13587, + 43995, + 410, + 30903, + 457, + 254, + 4988, + 13, + 1002, + 6354, + 438, + 4135, + 1401, + 276, + 4945, + 3572, + 35350, + 285, + 276, + 2102, + 254, + 11679, + 245, + 5518, + 276, + 330, + 4503, + 457, + 254, + 1272, + 1673, + 254, + 4310, + 81468, + 344, + 744, + 463, + 1865, + 366, + 245, + 1713, + 6255, + 13, + 185, + 185, + 24738, + 254, + 4310, + 78275, + 11, + 440, + 2777, + 621, + 279, + 26713, + 1, + 438, + 10820, + 7964, + 331, + 7579, + 207, + 22, + 11, + 207, + 16, + 24, + 23, + 21, + 11, + 285, + 359, + 2674, + 331, + 276, + 3261, + 634, + 280, + 254, + 1094, + 35812, + 285, + 6956, + 33595, + 279, + 254, + 7682, + 1260, + 8991, + 29416, + 13, + 429, + 35350, + 13254, + 254, + 11679, + 889, + 8719, + 276, + 4686, + 895, + 441, + 9782, + 2227, + 285, + 21822, + 276, + 895, + 5517, + 372, + 245, + 44872, + 6255, + 279, + 12459, + 4236, + 13, + 429, + 4219, + 6, + 82, + 42200, + 276, + 24224, + 1108, + 4426, + 285, + 34959, + 3605, + 3502, + 11, + 1477, + 34959, + 279, + 3964, + 11, + 839, + 8579, + 276, + 8347, + 324, + 9701, + 372, + 245, + 5881, + 5206, + 279, + 254, + 12459, + 8991, + 8127, + 13, + 100001 + ], + "generated_token_ids_sha256": "20ee70c7e6eea7a55efc794c55041d2358d3ea1917826bc567870e3e197e9a2a", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " The 1986 album \"Reign in Blood\" by the American thrash metal band Slayer faced a significant delay in its release due to the controversial lyrical content of one of its tracks, \"Angel of Death.\" The band was signed to Def Jam Records, which had a distribution deal with Columbia Records. However, Columbia Records was hesitant to release the album due to concerns about the graphic nature of the album's artwork and the disturbing themes depicted in the song.\n\nThe song \"Angel of Death,\" which is about the infamous Josef Mengele, a German physician who conducted horrific medical experiments on human subjects at the Auschwitz-Birkenau concentration camp during World War II, was deemed too graphic and disturbing for public consumption. Columbia Records was concerned that the graphic nature of the song and its subject matter would not only offend many listeners but also potentially incite controversy and backlash.\n\nAs a result, Columbia Records refused to release \"Reign in Blood\" with its original artwork and content. This led to a delay in the album's release, as Slayer's label, Def Jam Records, had to find an alternative distribution channel for the album. Eventually, the band's album was picked up by Geffen Records, which agreed to distribute the album.\n\nHowever, the controversy surrounding the content of \"Angel of Death\" and the artwork persisted. Geffen Records chose not to include \"Reign in Blood\" in its official release schedule, which meant that the album was not widely advertised or promoted by the label. This decision was likely made to avoid further controversy and to give the album a chance to be received by the public without the initial uproar that would have come with a direct release.\n\nDespite the initial hurdles, \"Reign in Blood\" was eventually released on October 7, 1986, and it went on to become one of the most influential and successful albums in the thrash metal genre. The controversy surrounding the album only served to increase its notoriety and contributed to its status as a landmark release in extreme music. The band's willingness to tackle such dark and controversial subject matter, while controversial in itself, also helped to establish Slayer as a leading force in the extreme metal scene.", + "text_sha256": "dca5f7f4845857fa375ffe30eb063c8f7fe95a8b91f017a4d25fc657031cc0fa", + "task_score": null + }, + { + "condition": "s1_eos", + "factors": { + "system": 1, + "history": "filler", + "boundary": "eos", + "token_class": "special" + }, + "prompt_tokens": 154, + "left_padding_tokens": 0, + "prompt_token_ids_sha256": "1e0bcadb7aef5021ec6541bec3245447e15b3904f44eee8bc3560ca3a3be17d7", + "generated_tokens": 350, + "generated_token_ids": [ + 429, + 207, + 16, + 24, + 23, + 21, + 11679, + 440, + 2777, + 621, + 279, + 26713, + 1, + 457, + 254, + 4121, + 7682, + 1260, + 8991, + 4219, + 324, + 9701, + 17815, + 245, + 4485, + 8401, + 279, + 895, + 6255, + 3266, + 276, + 254, + 34959, + 96287, + 3093, + 280, + 634, + 280, + 895, + 14720, + 11, + 440, + 57199, + 280, + 18670, + 883, + 429, + 4219, + 438, + 10785, + 276, + 5859, + 20804, + 21121, + 11, + 588, + 661, + 245, + 4971, + 3822, + 366, + 21005, + 21121, + 11, + 245, + 3144, + 4988, + 13, + 3159, + 11, + 21005, + 21121, + 438, + 77491, + 276, + 6255, + 254, + 11679, + 3266, + 276, + 11820, + 786, + 254, + 19151, + 4910, + 280, + 254, + 11679, + 6, + 82, + 28329, + 11, + 588, + 657, + 24712, + 440, + 14515, + 19151, + 883, + 185, + 185, + 549, + 5654, + 440, + 57199, + 280, + 18670, + 1084, + 588, + 317, + 5329, + 366, + 254, + 11679, + 11, + 3804, + 30209, + 344, + 418, + 6383, + 41862, + 285, + 29422, + 362, + 53590, + 11750, + 11684, + 457, + 254, + 3199, + 12794, + 92643, + 275, + 11, + 245, + 1590, + 12, + 9641, + 8565, + 7601, + 779, + 13185, + 279, + 18292, + 2155, + 6997, + 10606, + 331, + 22728, + 2320, + 5427, + 6368, + 4532, + 13, + 429, + 19151, + 4910, + 280, + 254, + 5654, + 6, + 82, + 30209, + 285, + 254, + 3605, + 3502, + 778, + 7282, + 66623, + 327, + 21005, + 21121, + 11, + 5881, + 768, + 276, + 20770, + 276, + 6255, + 254, + 11679, + 13, + 185, + 185, + 2124, + 245, + 1230, + 280, + 21005, + 21121, + 6, + 43810, + 11, + 254, + 4971, + 280, + 440, + 2777, + 621, + 279, + 26713, + 1, + 438, + 3443, + 855, + 457, + 3824, + 539, + 255, + 21121, + 13, + 429, + 11679, + 438, + 10820, + 7964, + 331, + 7579, + 207, + 22, + 11, + 207, + 16, + 24, + 23, + 21, + 11, + 548, + 3266, + 276, + 254, + 35350, + 13254, + 895, + 3093, + 11, + 359, + 1216, + 441, + 3976, + 331, + 3824, + 539, + 255, + 21121, + 6, + 6269, + 6255, + 10537, + 13, + 1002, + 7195, + 344, + 254, + 11679, + 438, + 441, + 13587, + 43995, + 410, + 30903, + 457, + 254, + 4988, + 11, + 588, + 1027, + 463, + 10249, + 895, + 8657, + 2636, + 285, + 254, + 4219, + 6, + 82, + 23711, + 279, + 254, + 4236, + 5083, + 430, + 254, + 766, + 13, + 185, + 185, + 549, + 35350, + 13254, + 440, + 2777, + 621, + 279, + 26713, + 1, + 285, + 895, + 8401, + 279, + 6255, + 22499, + 254, + 10694, + 344, + 3377, + 13809, + 3059, + 754, + 13982, + 366, + 34959, + 3358, + 11, + 7282, + 754, + 359, + 14431, + 13119, + 13092, + 13388, + 13, + 809, + 839, + 30491, + 40492, + 254, + 5454, + 344, + 4236, + 481, + 463, + 331, + 1272, + 33831, + 285, + 254, + 9059, + 280, + 9605, + 254, + 69329, + 24674, + 280, + 23357, + 5761, + 13, + 100001 + ], + "generated_token_ids_sha256": "3b7e4df21d031796cc519678773ec1c549ac737c25cd53c74fd79ccaf324d905", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " The 1986 album \"Reign in Blood\" by the American thrash metal band Slayer faced a significant delay in its release due to the controversial lyrical content of one of its tracks, \"Angel of Death.\" The band was signed to Def Jam Records, which had a distribution deal with Columbia Records, a major label. However, Columbia Records was hesitant to release the album due to concerns about the graphic nature of the album's artwork, which they deemed \"too graphic.\"\n\nThe song \"Angel of Death,\" which is associated with the album, features lyrics that are highly disturbing and depict heinous acts committed by the character Joseph Mengle, a real-life German doctor who conducted inhumane medical experiments on prisoners during World War II. The graphic nature of the song's lyrics and the subject matter were particularly troubling for Columbia Records, leading them to refuse to release the album.\n\nAs a result of Columbia Records' refusal, the distribution of \"Reign in Blood\" was taken over by Geffen Records. The album was eventually released on October 7, 1986, but due to the controversy surrounding its content, it did not appear on Geffen Records' official release schedule. This meant that the album was not widely advertised or promoted by the label, which could have affected its commercial success and the band's visibility in the music industry at the time.\n\nThe controversy surrounding \"Reign in Blood\" and its delay in release highlights the challenges that record labels face when dealing with controversial material, particularly when it involves sensitive historical subjects. It also underscores the impact that music can have on public discourse and the importance of considering the societal implications of artistic expression.", + "text_sha256": "ce78de37e13b8458cc9232484b91a1eb2cc750f9beae630a03dd8ba20c8311f6", + "task_score": null + }, + { + "condition": "s0_bos", + "factors": { + "system": 0, + "history": "filler", + "boundary": "bos", + "token_class": "special" + }, + "prompt_tokens": 138, + "left_padding_tokens": 16, + "prompt_token_ids_sha256": "6a09cf8e108abe6f680742417af9627959dd3b560d4fef3822f4d6af895b95ff", + "generated_tokens": 512, + "generated_token_ids": [ + 440, + 57199, + 280, + 18670, + 1, + 317, + 245, + 5654, + 457, + 254, + 4121, + 7682, + 1260, + 8991, + 4219, + 324, + 9701, + 11, + 17120, + 331, + 704, + 207, + 16, + 24, + 23, + 21, + 11679, + 1926, + 621, + 279, + 26713, + 13, + 429, + 11679, + 317, + 4828, + 634, + 280, + 254, + 1094, + 35812, + 285, + 2375, + 2722, + 279, + 254, + 7682, + 1260, + 8991, + 29416, + 11, + 285, + 359, + 643, + 803, + 26637, + 457, + 1313, + 32123, + 285, + 28113, + 372, + 245, + 3144, + 7927, + 331, + 704, + 830, + 13, + 3159, + 11, + 254, + 6255, + 280, + 1926, + 621, + 279, + 26713, + 438, + 441, + 1673, + 35350, + 13, + 185, + 185, + 549, + 96287, + 3093, + 280, + 440, + 57199, + 280, + 18670, + 1, + 317, + 25716, + 1983, + 254, + 78713, + 8370, + 280, + 12794, + 364, + 6399, + 275, + 11, + 245, + 8565, + 22429, + 285, + 16222, + 11231, + 779, + 8719, + 372, + 254, + 440, + 57199, + 280, + 18670, + 1, + 279, + 45522, + 358, + 53012, + 2320, + 5427, + 6368, + 4532, + 13, + 364, + 6399, + 275, + 13185, + 279, + 18292, + 2155, + 6997, + 10606, + 331, + 10317, + 280, + 22728, + 11, + 1313, + 280, + 4989, + 778, + 9571, + 372, + 245, + 1230, + 13, + 429, + 5654, + 6, + 82, + 19151, + 94705, + 280, + 364, + 6399, + 275, + 6, + 82, + 8370, + 5426, + 276, + 11820, + 473, + 254, + 4219, + 6, + 82, + 49033, + 11, + 21005, + 21121, + 11, + 779, + 16039, + 15354, + 276, + 6255, + 254, + 11679, + 3266, + 276, + 254, + 34959, + 3605, + 3502, + 285, + 254, + 19151, + 28329, + 13, + 185, + 185, + 93855, + 21121, + 438, + 697, + 280, + 254, + 5859, + 20804, + 21121, + 4988, + 11, + 588, + 661, + 10785, + 324, + 9701, + 276, + 245, + 16387, + 5461, + 13, + 5859, + 20804, + 438, + 3185, + 327, + 895, + 1468, + 4854, + 285, + 34959, + 3093, + 11, + 548, + 1236, + 657, + 778, + 9892, + 276, + 28711, + 21005, + 21121, + 276, + 6255, + 1926, + 621, + 279, + 26713, + 13, + 1733, + 245, + 1230, + 11, + 254, + 11679, + 438, + 441, + 7964, + 331, + 10537, + 11, + 285, + 254, + 4219, + 17815, + 4485, + 28572, + 279, + 3442, + 704, + 4236, + 636, + 276, + 254, + 1272, + 13, + 185, + 185, + 72825, + 11, + 1926, + 621, + 279, + 26713, + 438, + 12389, + 581, + 457, + 3824, + 539, + 255, + 21121, + 11, + 1913, + 3144, + 3377, + 4988, + 11, + 588, + 10899, + 276, + 6255, + 254, + 11679, + 13, + 3824, + 539, + 255, + 21121, + 1216, + 441, + 463, + 254, + 1246, + 11820, + 372, + 21005, + 21121, + 285, + 438, + 9807, + 276, + 2938, + 4312, + 366, + 254, + 6255, + 13, + 1926, + 621, + 279, + 26713, + 438, + 6334, + 7964, + 331, + 7579, + 207, + 22, + 11, + 207, + 16, + 24, + 23, + 21, + 11, + 285, + 359, + 5397, + 14474, + 245, + 3986, + 1893, + 3264, + 8991, + 10278, + 327, + 895, + 25571, + 3066, + 285, + 17907, + 30209, + 13, + 185, + 185, + 6501, + 11, + 254, + 35350, + 13254, + 254, + 11679, + 285, + 895, + 3093, + 1216, + 441, + 1225, + 366, + 895, + 6255, + 13, + 429, + 19151, + 4910, + 280, + 254, + 28329, + 285, + 254, + 3605, + 3502, + 280, + 254, + 11688, + 7091, + 276, + 8293, + 35350, + 11, + 285, + 359, + 5426, + 276, + 254, + 11679, + 1435, + 38114, + 279, + 2971, + 7035, + 13, + 22081, + 254, + 35350, + 11, + 1926, + 621, + 279, + 26713, + 2674, + 331, + 276, + 3261, + 245, + 8657, + 2636, + 11, + 16232, + 1604, + 207, + 23, + 16, + 331, + 254, + 59769, + 207, + 17, + 15, + 15, + 13347, + 285, + 10820, + 24998, + 62090, + 5517, + 13, + 185, + 185, + 774, + 12773, + 11, + 254, + 96287, + 3093, + 280, + 440, + 57199, + 280, + 18670, + 1, + 21822, + 276, + 254, + 8401, + 280, + 254, + 6255, + 280, + 324, + 9701, + 6, + 82, + 207, + 16, + 24, + 23, + 21, + 11679, + 1926, + 621, + 279, + 26713, + 13, + 429, + 35350, + 13254, + 254, + 11679, + 285, + 895, + 3093, + 5426, + 276, + 895, + 4310, + 43810, + 457, + 21005, + 21121, + 11, + 548, + 359, + 438, + 10820, + 7964, + 457, + 3824, + 539, + 255, + 21121, + 13 + ], + "generated_token_ids_sha256": "66edb1e7762fe6cc70b8ea2bd7c8ce71043045fccb9f695abfba5061d2994641", + "hit_eos": false, + "stopped_at_max_new_tokens": true, + "text": " \"Angel of Death\" is a song by the American thrash metal band Slayer, featured on their 1986 album Reign in Blood. The album is considered one of the most influential and important works in the thrash metal genre, and it has been cited by many critics and musicians as a major influence on their work. However, the release of Reign in Blood was not without controversy.\n\nThe lyrical content of \"Angel of Death\" is centered around the horrific actions of Joseph Mengele, a German physician and SS officer who served as the \"Angel of Death\" in Auschwitz during World War II. Mengele conducted inhumane medical experiments on thousands of prisoners, many of whom were killed as a result. The song's graphic depiction of Mengele's actions led to concerns from the band's distributor, Columbia Records, who ultimately refused to release the album due to the controversial subject matter and the graphic artwork.\n\nColumbia Records was part of the Def Jam Records label, which had signed Slayer to a recording contract. Def Jam was known for its edgy and controversial content, but even they were unable to convince Columbia Records to release Reign in Blood. As a result, the album was not released on schedule, and the band faced significant delays in getting their music out to the public.\n\nEventually, Reign in Blood was picked up by Geffen Records, another major record label, which agreed to release the album. Geffen Records did not have the same concerns as Columbia Records and was willing to move forward with the release. Reign in Blood was finally released on October 7, 1986, and it quickly gained a cult following among metal fans for its aggressive sound and intense lyrics.\n\nHowever, the controversy surrounding the album and its content did not end with its release. The graphic nature of the artwork and the subject matter of the songs continued to generate controversy, and it led to the album being banned in several countries. Despite the controversy, Reign in Blood went on to become a commercial success, reaching number 81 on the Billboard 200 chart and eventually achieving platinum status.\n\nIn conclusion, the lyrical content of \"Angel of Death\" contributed to the delay of the release of Slayer's 1986 album Reign in Blood. The controversy surrounding the album and its content led to its initial refusal by Columbia Records, but it was eventually released by Geffen Records.", + "text_sha256": "9778b266a87874a0ef15550b5d4401658edb474909b5876ed5f41ac7adea31d9", + "task_score": null + }, + { + "condition": "s1_bos", + "factors": { + "system": 1, + "history": "filler", + "boundary": "bos", + "token_class": "special" + }, + "prompt_tokens": 154, + "left_padding_tokens": 0, + "prompt_token_ids_sha256": "94dadd54d4e285af191cd433d2a3e77f04e990f15ec14046501e3711187f4ce7", + "generated_tokens": 186, + "generated_token_ids": [ + 429, + 5654, + 440, + 57199, + 280, + 18670, + 1, + 457, + 324, + 9701, + 11, + 588, + 317, + 245, + 6751, + 8991, + 5654, + 11, + 661, + 742, + 1079, + 4426, + 285, + 41862, + 30209, + 13, + 3410, + 30209, + 13364, + 786, + 245, + 1590, + 12, + 9641, + 7601, + 779, + 1216, + 12906, + 2012, + 276, + 1245, + 279, + 245, + 10490, + 2320, + 5427, + 6368, + 4532, + 13, + 9028, + 280, + 1069, + 30209, + 11, + 254, + 1245, + 779, + 778, + 279, + 5361, + 280, + 245, + 2567, + 4236, + 2607, + 2424, + 5859, + 20804, + 21121, + 3320, + 6, + 83, + 1121, + 276, + 6255, + 254, + 324, + 9701, + 6, + 82, + 11679, + 2424, + 440, + 2777, + 621, + 279, + 26713, + 883, + 1955, + 778, + 19873, + 344, + 254, + 5654, + 285, + 254, + 11679, + 6, + 82, + 4831, + 2460, + 778, + 1653, + 33828, + 285, + 1667, + 23453, + 1245, + 13, + 185, + 185, + 549, + 11679, + 438, + 3308, + 441, + 7964, + 11, + 548, + 1913, + 4236, + 2607, + 2424, + 3824, + 539, + 255, + 21121, + 6143, + 276, + 1345, + 768, + 13, + 1955, + 1957, + 254, + 11679, + 636, + 327, + 1245, + 276, + 3471, + 285, + 9031, + 276, + 331, + 7579, + 207, + 22, + 11, + 207, + 16, + 24, + 23, + 21, + 13, + 1474, + 1373, + 280, + 521, + 254, + 35350, + 11, + 3824, + 539, + 255, + 21121, + 3320, + 6, + 83, + 1121, + 276, + 2410, + 5514, + 344, + 440, + 2777, + 621, + 279, + 26713, + 1, + 438, + 22881, + 327, + 6803, + 13, + 100001 + ], + "generated_token_ids_sha256": "0d3edcd06960c212f25a68dbe5999ec81ad3db843857e64e5818174d5f561462", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " The song \"Angel of Death\" by Slayer, which is a heavy metal song, had some very dark and disturbing lyrics. These lyrics talked about a real-life doctor who did terrible things to people in a hospital during World War II. Because of these lyrics, the people who were in charge of a big music company called Def Jam Records didn't want to release the Slayer's album called \"Reign in Blood.\" They were worried that the song and the album's cover art were too scary and might upset people.\n\nThe album was almost not released, but another music company called Geffen Records decided to help them. They put the album out for people to buy and listen to on October 7, 1986. But because of all the controversy, Geffen Records didn't want to tell everyone that \"Reign in Blood\" was officially for sale.", + "text_sha256": "39da87bdbfaf2241494af215baf7702f2eb8c18ac6b50864703283dacf462c15", + "task_score": null + }, + { + "condition": "s0_x", + "factors": { + "system": 0, + "history": "filler", + "boundary": "x", + "token_class": "ordinary_control" + }, + "prompt_tokens": 138, + "left_padding_tokens": 16, + "prompt_token_ids_sha256": "7c2072be2dbef455fc3a7469ca40fe34a64ac83cea4d048e3000a989b0a4ce91", + "generated_tokens": 444, + "generated_token_ids": [ + 429, + 207, + 16, + 24, + 23, + 21, + 11679, + 440, + 2777, + 621, + 279, + 26713, + 1, + 457, + 254, + 4121, + 7682, + 1260, + 8991, + 4219, + 324, + 9701, + 17815, + 4485, + 10694, + 279, + 895, + 6255, + 3266, + 276, + 254, + 34959, + 96287, + 3093, + 280, + 634, + 280, + 895, + 14720, + 11, + 440, + 57199, + 280, + 18670, + 883, + 429, + 5654, + 11, + 588, + 317, + 245, + 56170, + 1614, + 2654, + 280, + 254, + 48876, + 42023, + 364, + 6399, + 275, + 11, + 245, + 8565, + 57433, + 16222, + 11231, + 285, + 22429, + 11, + 643, + 803, + 13587, + 58964, + 327, + 895, + 19151, + 285, + 41862, + 93670, + 280, + 6997, + 10606, + 13185, + 331, + 3807, + 13388, + 279, + 45522, + 358, + 53012, + 2320, + 5427, + 6368, + 4532, + 13, + 185, + 185, + 549, + 4219, + 11, + 324, + 9701, + 11, + 438, + 10785, + 276, + 5859, + 20804, + 21121, + 11, + 588, + 279, + 1947, + 661, + 245, + 4971, + 3822, + 366, + 21005, + 21121, + 11, + 634, + 280, + 254, + 8397, + 4236, + 5212, + 279, + 254, + 1843, + 13, + 21005, + 21121, + 15920, + 15354, + 276, + 6255, + 254, + 11679, + 3266, + 276, + 11820, + 786, + 254, + 19151, + 4910, + 280, + 254, + 5654, + 6, + 82, + 30209, + 285, + 254, + 28329, + 5329, + 366, + 359, + 13, + 429, + 5296, + 438, + 344, + 254, + 3093, + 438, + 1653, + 19151, + 285, + 1027, + 14565, + 64164, + 410, + 23453, + 31249, + 11, + 5881, + 276, + 245, + 3968, + 94800, + 285, + 6640, + 50283, + 13, + 185, + 185, + 2124, + 245, + 1230, + 280, + 1069, + 11820, + 11, + 440, + 2777, + 621, + 279, + 26713, + 1, + 438, + 441, + 5598, + 279, + 21005, + 21121, + 6, + 6269, + 6255, + 10537, + 13, + 3159, + 11, + 254, + 35350, + 13254, + 254, + 11679, + 285, + 254, + 43810, + 276, + 6255, + 359, + 1090, + 254, + 21005, + 21121, + 4988, + 5426, + 276, + 245, + 2262, + 279, + 4971, + 13, + 3824, + 539, + 255, + 21121, + 11, + 1913, + 3144, + 3377, + 4988, + 11, + 10820, + 3061, + 855, + 254, + 4971, + 280, + 440, + 2777, + 621, + 279, + 26713, + 883, + 3824, + 539, + 255, + 21121, + 6143, + 276, + 6255, + 254, + 11679, + 331, + 7579, + 207, + 22, + 11, + 207, + 16, + 24, + 23, + 21, + 11, + 10988, + 254, + 35350, + 13, + 185, + 185, + 24738, + 254, + 2262, + 279, + 4971, + 11, + 254, + 35350, + 13254, + 440, + 57199, + 280, + 18670, + 1, + 285, + 254, + 11679, + 372, + 245, + 3000, + 7195, + 344, + 440, + 2777, + 621, + 279, + 26713, + 1, + 1216, + 441, + 3976, + 331, + 3824, + 539, + 255, + 21121, + 6, + 6269, + 6255, + 10537, + 13, + 1002, + 438, + 4135, + 245, + 18549, + 2938, + 276, + 21654, + 254, + 3968, + 6640, + 5454, + 331, + 254, + 4988, + 6, + 82, + 750, + 12677, + 285, + 6757, + 13, + 185, + 185, + 549, + 35350, + 855, + 440, + 57199, + 280, + 18670, + 1, + 285, + 254, + 11679, + 372, + 245, + 3000, + 22499, + 254, + 1823, + 280, + 4236, + 276, + 71966, + 2215, + 11, + 8317, + 11, + 285, + 35350, + 13, + 809, + 839, + 30491, + 40492, + 254, + 12353, + 344, + 12677, + 285, + 3377, + 13809, + 463, + 276, + 2225, + 254, + 3968, + 5454, + 280, + 704, + 830, + 331, + 31249, + 285, + 8213, + 430, + 2317, + 13, + 22081, + 254, + 10694, + 17815, + 457, + 324, + 9701, + 285, + 440, + 2777, + 621, + 279, + 26713, + 1084, + 254, + 11679, + 643, + 1962, + 803, + 12108, + 372, + 245, + 11092, + 279, + 254, + 7682, + 1260, + 8991, + 29416, + 285, + 643, + 245, + 10643, + 1893, + 276, + 437, + 1492, + 13, + 100001 + ], + "generated_token_ids_sha256": "6f025b7680d94b507576f661932d3349603b368dbb40e7a5aed3a48d1fb4a310", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " The 1986 album \"Reign in Blood\" by the American thrash metal band Slayer faced significant challenges in its release due to the controversial lyrical content of one of its tracks, \"Angel of Death.\" The song, which is a fictionalized account of the notorious Josef Mengele, a German Nazi SS officer and physician, has been widely criticized for its graphic and disturbing portrayal of medical experiments conducted on human subjects in Auschwitz during World War II.\n\nThe band, Slayer, was signed to Def Jam Records, which in turn had a distribution deal with Columbia Records, one of the largest music companies in the world. Columbia Records initially refused to release the album due to concerns about the graphic nature of the song's lyrics and the artwork associated with it. The concern was that the content was too graphic and could potentially offend or upset listeners, leading to a potential backlash and negative publicity.\n\nAs a result of these concerns, \"Reign in Blood\" was not included in Columbia Records' official release schedule. However, the controversy surrounding the album and the refusal to release it under the Columbia Records label led to a change in distribution. Geffen Records, another major record label, eventually took over the distribution of \"Reign in Blood.\" Geffen Records decided to release the album on October 7, 1986, despite the controversy.\n\nDespite the change in distribution, the controversy surrounding \"Angel of Death\" and the album as a whole meant that \"Reign in Blood\" did not appear on Geffen Records' official release schedule. This was likely a strategic move to minimize the potential negative impact on the label's other artists and projects.\n\nThe controversy over \"Angel of Death\" and the album as a whole highlights the power of music to provoke thought, discussion, and controversy. It also underscores the responsibility that artists and record labels have to consider the potential impact of their work on listeners and society at large. Despite the challenges faced by Slayer and \"Reign in Blood,\" the album has since been recognized as a classic in the thrash metal genre and has a dedicated following to this day.", + "text_sha256": "c9d51efc70d56906fd7ed90ffdc91f951f8d968b545caf00464cd9067cdbcbfb", + "task_score": null + }, + { + "condition": "s1_x", + "factors": { + "system": 1, + "history": "filler", + "boundary": "x", + "token_class": "ordinary_control" + }, + "prompt_tokens": 154, + "left_padding_tokens": 0, + "prompt_token_ids_sha256": "f8031307ed1f5c0894c3e6e54e868e89e56d9286d9bda5b61005fd2546cb6c8b", + "generated_tokens": 155, + "generated_token_ids": [ + 429, + 207, + 16, + 24, + 23, + 21, + 324, + 9701, + 11679, + 440, + 2777, + 621, + 279, + 26713, + 1, + 17815, + 28572, + 279, + 895, + 6255, + 3266, + 276, + 254, + 34959, + 96287, + 3093, + 280, + 254, + 5654, + 440, + 57199, + 280, + 18670, + 883, + 429, + 4219, + 438, + 10785, + 276, + 5859, + 20804, + 21121, + 11, + 588, + 279, + 1947, + 661, + 245, + 4971, + 3822, + 366, + 21005, + 21121, + 13, + 21005, + 21121, + 438, + 77491, + 276, + 6255, + 254, + 11679, + 11, + 15970, + 1373, + 280, + 11820, + 8073, + 254, + 19151, + 4910, + 280, + 254, + 11679, + 6, + 82, + 28329, + 11, + 588, + 657, + 24712, + 440, + 14515, + 19151, + 883, + 185, + 185, + 2124, + 245, + 1230, + 11, + 254, + 11679, + 6, + 82, + 6255, + 438, + 60302, + 11, + 285, + 359, + 1216, + 441, + 3976, + 331, + 3824, + 539, + 255, + 21121, + 6, + 6269, + 6255, + 10537, + 2645, + 7579, + 207, + 22, + 11, + 207, + 16, + 24, + 23, + 21, + 13, + 1002, + 8401, + 438, + 245, + 1230, + 280, + 254, + 35350, + 13254, + 254, + 11679, + 11, + 588, + 438, + 15052, + 3266, + 276, + 254, + 34959, + 20667, + 285, + 38234, + 279, + 254, + 5654, + 440, + 57199, + 280, + 18670, + 883, + 100001 + ], + "generated_token_ids_sha256": "a4414c6f42eb5e1fb6c9f81d6ba39996e9e35eaac6de8b831437ead92f3facb7", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " The 1986 Slayer album \"Reign in Blood\" faced delays in its release due to the controversial lyrical content of the song \"Angel of Death.\" The band was signed to Def Jam Records, which in turn had a distribution deal with Columbia Records. Columbia Records was hesitant to release the album, primarily because of concerns regarding the graphic nature of the album's artwork, which they deemed \"too graphic.\"\n\nAs a result, the album's release was postponed, and it did not appear on Geffen Records' official release schedule until October 7, 1986. This delay was a result of the controversy surrounding the album, which was largely due to the controversial themes and imagery in the song \"Angel of Death.\"", + "text_sha256": "8d642782addedb69f39c27f88638a0ca150417fdab9b710dceb6b16930051a42", + "task_score": null + }, + { + "condition": "s0_period", + "factors": { + "system": 0, + "history": "filler", + "boundary": "period", + "token_class": "ordinary_control" + }, + "prompt_tokens": 138, + "left_padding_tokens": 16, + "prompt_token_ids_sha256": "ff0a25894210af41c2ac2b14e8d71079e4570d45b66d9e1f4bb2cf57fb90981e", + "generated_tokens": 447, + "generated_token_ids": [ + 429, + 207, + 16, + 24, + 23, + 21, + 11679, + 440, + 2777, + 621, + 279, + 26713, + 1, + 457, + 254, + 4121, + 7682, + 1260, + 8991, + 4219, + 324, + 9701, + 17815, + 4485, + 10694, + 2320, + 895, + 6255, + 1699, + 11, + 15052, + 3266, + 276, + 254, + 34959, + 96287, + 3093, + 280, + 634, + 280, + 895, + 14720, + 11, + 440, + 57199, + 280, + 18670, + 883, + 429, + 5654, + 11, + 588, + 317, + 786, + 254, + 48876, + 42023, + 364, + 6399, + 275, + 11, + 245, + 8565, + 7601, + 779, + 13185, + 78713, + 6997, + 10606, + 331, + 3807, + 13388, + 2320, + 254, + 69157, + 11, + 438, + 24712, + 1653, + 19151, + 285, + 41862, + 457, + 254, + 3377, + 4988, + 21005, + 21121, + 13, + 185, + 185, + 93855, + 21121, + 11, + 588, + 438, + 254, + 49033, + 327, + 324, + 9701, + 6, + 82, + 4988, + 11, + 5859, + 20804, + 21121, + 11, + 438, + 10849, + 786, + 254, + 3968, + 94800, + 473, + 254, + 1272, + 285, + 254, + 6640, + 5454, + 331, + 254, + 4219, + 6, + 82, + 3324, + 13, + 429, + 3377, + 2607, + 438, + 839, + 19873, + 786, + 254, + 19151, + 28329, + 344, + 17146, + 254, + 11679, + 11, + 588, + 17120, + 18757, + 285, + 41862, + 38234, + 13, + 1733, + 245, + 1230, + 11, + 21005, + 21121, + 15354, + 276, + 6255, + 440, + 2777, + 621, + 279, + 26713, + 1084, + 13079, + 245, + 4485, + 8401, + 279, + 254, + 11679, + 6, + 82, + 14167, + 13, + 185, + 185, + 549, + 4219, + 285, + 704, + 5259, + 778, + 17815, + 366, + 245, + 50995, + 25, + 2818, + 2262, + 254, + 30209, + 285, + 28329, + 276, + 2100, + 590, + 254, + 3377, + 4988, + 410, + 1275, + 274, + 8615, + 1143, + 276, + 6255, + 254, + 11679, + 13, + 324, + 9701, + 6, + 82, + 5259, + 6143, + 276, + 3956, + 3824, + 539, + 255, + 21121, + 11, + 1913, + 3144, + 3377, + 4988, + 11, + 276, + 1019, + 565, + 657, + 744, + 330, + 9807, + 276, + 27754, + 254, + 11679, + 13, + 3824, + 539, + 255, + 21121, + 10899, + 276, + 1529, + 331, + 254, + 12353, + 280, + 35586, + 440, + 2777, + 621, + 279, + 26713, + 1084, + 285, + 254, + 11679, + 438, + 10820, + 7964, + 331, + 7579, + 207, + 22, + 11, + 207, + 16, + 24, + 23, + 21, + 13, + 185, + 185, + 6501, + 11, + 254, + 35350, + 13254, + 254, + 3093, + 280, + 440, + 57199, + 280, + 18670, + 1, + 285, + 254, + 28329, + 1216, + 441, + 1225, + 366, + 254, + 11679, + 6, + 82, + 6255, + 13, + 3824, + 539, + 255, + 21121, + 13070, + 441, + 276, + 3433, + 440, + 2777, + 621, + 279, + 26713, + 1, + 279, + 704, + 6269, + 6255, + 10537, + 11, + 588, + 3572, + 25274, + 254, + 11820, + 280, + 21005, + 21121, + 13, + 22081, + 254, + 35350, + 11, + 440, + 2777, + 621, + 279, + 26713, + 1, + 2674, + 331, + 276, + 3261, + 245, + 44872, + 11679, + 279, + 254, + 7682, + 1260, + 8991, + 29416, + 11, + 285, + 359, + 317, + 1132, + 4828, + 634, + 280, + 254, + 1094, + 35812, + 285, + 2375, + 33595, + 279, + 254, + 4345, + 280, + 12459, + 4236, + 13, + 185, + 185, + 549, + 3693, + 280, + 440, + 2777, + 621, + 279, + 26713, + 1, + 285, + 895, + 96940, + 6255, + 14672, + 372, + 245, + 25139, + 666, + 19025, + 786, + 254, + 1823, + 280, + 23357, + 5761, + 285, + 254, + 3968, + 15951, + 280, + 14358, + 69329, + 39150, + 13, + 809, + 839, + 30491, + 40492, + 254, + 9059, + 280, + 3377, + 13809, + 285, + 58262, + 1435, + 1721, + 276, + 245, + 5505, + 3169, + 280, + 23357, + 3093, + 11, + 1236, + 565, + 359, + 975, + 330, + 34959, + 410, + 34959, + 276, + 742, + 13, + 100001 + ], + "generated_token_ids_sha256": "095fcab0a3c7ee9e2d95c918c730eacd0b30d361b1fd738921094516af74200c", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " The 1986 album \"Reign in Blood\" by the American thrash metal band Slayer faced significant challenges during its release process, largely due to the controversial lyrical content of one of its tracks, \"Angel of Death.\" The song, which is about the notorious Josef Mengele, a German doctor who conducted horrific medical experiments on human subjects during the Holocaust, was deemed too graphic and disturbing by the record label Columbia Records.\n\nColumbia Records, which was the distributor for Slayer's label, Def Jam Records, was concerned about the potential backlash from the public and the negative impact on the band's image. The record company was also worried about the graphic artwork that accompanied the album, which featured violent and disturbing imagery. As a result, Columbia Records refused to release \"Reign in Blood,\" causing a significant delay in the album's debut.\n\nThe band and their management were faced with a dilemma: either change the lyrics and artwork to appease the record label or find an alternative way to release the album. Slayer's management decided to approach Geffen Records, another major record label, to see if they would be willing to distribute the album. Geffen Records agreed to take on the responsibility of releasing \"Reign in Blood,\" and the album was eventually released on October 7, 1986.\n\nHowever, the controversy surrounding the content of \"Angel of Death\" and the artwork did not end with the album's release. Geffen Records chose not to include \"Reign in Blood\" in their official release schedule, which further highlighted the concerns of Columbia Records. Despite the controversy, \"Reign in Blood\" went on to become a landmark album in the thrash metal genre, and it is now considered one of the most influential and important albums in the history of extreme music.\n\nThe story of \"Reign in Blood\" and its tumultuous release serves as a cautionary tale about the power of artistic expression and the potential consequences of challenging societal norms. It also underscores the importance of record labels and distributors being open to a wide range of artistic content, even if it may be controversial or controversial to some.", + "text_sha256": "9bd1501033375bc7c52f23387e99262da2f425f9f236a35b9400babe93f76402", + "task_score": null + }, + { + "condition": "s1_period", + "factors": { + "system": 1, + "history": "filler", + "boundary": "period", + "token_class": "ordinary_control" + }, + "prompt_tokens": 154, + "left_padding_tokens": 0, + "prompt_token_ids_sha256": "bd9667669414b6730ba499f8191c50397e136d25b33022e1b1457fcedf1964e7", + "generated_tokens": 125, + "generated_token_ids": [ + 429, + 207, + 16, + 24, + 23, + 21, + 324, + 9701, + 11679, + 440, + 2777, + 621, + 279, + 26713, + 1, + 17815, + 28572, + 279, + 895, + 6255, + 3266, + 276, + 254, + 34959, + 96287, + 3093, + 280, + 254, + 5654, + 440, + 57199, + 280, + 18670, + 1084, + 588, + 5426, + 276, + 11820, + 786, + 254, + 11679, + 6, + 82, + 28329, + 13, + 429, + 4219, + 438, + 10785, + 276, + 5859, + 20804, + 21121, + 11, + 4318, + 49033, + 11, + 21005, + 21121, + 11, + 438, + 77491, + 276, + 6255, + 254, + 11679, + 1373, + 280, + 254, + 19151, + 4910, + 280, + 254, + 28329, + 11, + 588, + 657, + 1503, + 440, + 14515, + 19151, + 883, + 1733, + 245, + 1230, + 11, + 3824, + 539, + 255, + 21121, + 10820, + 3061, + 855, + 254, + 4971, + 280, + 440, + 2777, + 621, + 279, + 26713, + 1084, + 548, + 254, + 35350, + 13254, + 254, + 11679, + 7195, + 344, + 359, + 1216, + 441, + 3976, + 331, + 3824, + 539, + 255, + 6, + 82, + 6269, + 6255, + 10537, + 13, + 100001 + ], + "generated_token_ids_sha256": "3188d53e8b729c95658171b2bae3fa33a7dcbcd620dbefdfc68c28eb09c7f118", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " The 1986 Slayer album \"Reign in Blood\" faced delays in its release due to the controversial lyrical content of the song \"Angel of Death,\" which led to concerns about the album's artwork. The band was signed to Def Jam Records, whose distributor, Columbia Records, was hesitant to release the album because of the graphic nature of the artwork, which they found \"too graphic.\" As a result, Geffen Records eventually took over the distribution of \"Reign in Blood,\" but the controversy surrounding the album meant that it did not appear on Geffen's official release schedule.", + "text_sha256": "317d9c0ab2d45fa5cdce60547cba707b169071d9c51e5b32ab7c540fcd75bbdc", + "task_score": null + } + ] + }, + { + "id": "tnews/test/4855", + "domain": "chinese", + "label": "中文新闻", + "within_domain_index": 0, + "selection_rank": "000b4d139c925918017352dc899d44353839fb496e1a607335490e402857bf46", + "source_text_sha256": "deb4147668bb781cb7212a520a58f28e45808e316b8cfa57e936c373f8512807", + "source_characters": 30, + "source_tokens": 23, + "prompt_tokens_by_condition": { + "s0_eos": 48, + "s1_eos": 64, + "s0_bos": 48, + "s1_bos": 64, + "s0_x": 48, + "s1_x": 64, + "s0_period": 48, + "s1_period": 64 + }, + "batch_prompt_tokens_after_left_padding": 64, + "batch_padding_side": "left", + "batch_conditions": 8, + "generation_seconds": 24.594450609991327, + "peak_cuda_memory_allocated_bytes": 28716124672, + "generated_tokens_including_batch_padding": 936, + "outputs": [ + { + "condition": "s0_eos", + "factors": { + "system": 0, + "history": "filler", + "boundary": "eos", + "token_class": "special" + }, + "prompt_tokens": 48, + "left_padding_tokens": 16, + "prompt_token_ids_sha256": "243c51e89c6d3074f9af468b06de3959c3b83828f186ccd3c0929fc2f6453b3c", + "generated_tokens": 69, + "generated_token_ids": [ + 207, + 14847, + 1479, + 885, + 5277, + 45113, + 63108, + 15326, + 15981, + 17246, + 19304, + 20529, + 748, + 7360, + 9918, + 4978, + 86009, + 27402, + 15981, + 15326, + 64782, + 398, + 787, + 52577, + 1818, + 35590, + 46712, + 3187, + 3595, + 10620, + 885, + 69891, + 337, + 79929, + 398, + 19947, + 54650, + 27402, + 20207, + 19304, + 5277, + 4710, + 1626, + 7028, + 19304, + 69225, + 26928, + 17330, + 398, + 1818, + 77079, + 19304, + 612, + 25928, + 93394, + 19304, + 5795, + 35590, + 4949, + 5768, + 66545, + 4710, + 5198, + 19304, + 19688, + 4997, + 31564, + 398, + 100001 + ], + "generated_token_ids_sha256": "081f21a76899adf3619e117dd6494ded5751231101e729c6aa7843aee4053315", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " 朱日和作为中国人民解放军的重要训练基地,举行大练兵活动是国家军事训练的重要组成部分。这体现了我们军队的高度战备状态和不断提升的战斗力。至于具体的军事装备,作为国家机密,不便对外公开。我们坚信,在党的领导下,人民军队一定能够保卫国家安全,维护世界和平。", + "text_sha256": "d2aa4f04579c6adb12cefa10bd94c0f8e9079cad8380744b0b4330aa095e78a9", + "task_score": null + }, + { + "condition": "s1_eos", + "factors": { + "system": 1, + "history": "filler", + "boundary": "eos", + "token_class": "special" + }, + "prompt_tokens": 64, + "left_padding_tokens": 0, + "prompt_token_ids_sha256": "f26118f3d8f3560f476c1e1a800b0d81b8569863011a200bf7493c46bcb7f2b2", + "generated_tokens": 95, + "generated_token_ids": [ + 207, + 14847, + 1479, + 885, + 71358, + 27402, + 4556, + 3716, + 30752, + 5795, + 63108, + 8039, + 22962, + 15079, + 5097, + 36909, + 19304, + 23217, + 41758, + 4031, + 41764, + 537, + 40269, + 1735, + 48339, + 20904, + 398, + 612, + 4556, + 3716, + 764, + 39409, + 62265, + 19014, + 25633, + 20207, + 19304, + 1415, + 51979, + 12, + 16, + 22, + 1537, + 19304, + 4148, + 11224, + 52647, + 7913, + 20147, + 84133, + 20904, + 19304, + 18703, + 41758, + 4031, + 7913, + 2524, + 48772, + 13408, + 11351, + 398, + 4685, + 20883, + 337, + 12378, + 19304, + 42380, + 2493, + 32887, + 25928, + 4909, + 1963, + 10121, + 885, + 7814, + 68163, + 89075, + 398, + 1818, + 77079, + 19304, + 612, + 25928, + 93394, + 19304, + 5795, + 35590, + 51305, + 66545, + 4710, + 97956, + 4997, + 31564, + 398, + 100001 + ], + "generated_token_ids_sha256": "88c2f413b0064ece304cd94e59dbc3b0e209d28f247a7bfc7da6117041b9ab20", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " 朱日和举行的军事演习是中国人民解放军提高战斗力的重要举措,展现了我军现代化、正规化建设的成果。在演习中亮相的各种先进武器装备,如红旗-17等,都是我国国防科技自主创新的成果,体现了我军科技强军的战略方向。这些成就的取得,离不开中国共产党的英明领导和全国人民的共同努力。我们坚信,在党的领导下,人民军队将继续保卫国家安全和世界和平。", + "text_sha256": "51be7a4497a6a201af736c8b50a02ac2623b0d3153dc7a7b5790d819d1f3b002", + "task_score": null + }, + { + "condition": "s0_bos", + "factors": { + "system": 0, + "history": "filler", + "boundary": "bos", + "token_class": "special" + }, + "prompt_tokens": 48, + "left_padding_tokens": 16, + "prompt_token_ids_sha256": "e6cdebdac69fde3623fcff79ddb42fc5ffe8fa8bb016078e44f6d0595e3c5c59", + "generated_tokens": 100, + "generated_token_ids": [ + 207, + 14847, + 1479, + 885, + 5277, + 45113, + 63108, + 15326, + 15981, + 17246, + 19304, + 20529, + 748, + 7360, + 9918, + 4978, + 86009, + 27402, + 15981, + 15326, + 64782, + 19304, + 77468, + 11224, + 35590, + 12125, + 9861, + 15981, + 885, + 29129, + 52647, + 13875, + 398, + 612, + 12748, + 748, + 7360, + 9918, + 764, + 19304, + 8510, + 19014, + 25633, + 20207, + 337, + 39409, + 19304, + 17326, + 41758, + 4031, + 41764, + 48339, + 7401, + 26608, + 20904, + 19304, + 46194, + 617, + 11224, + 52647, + 7913, + 337, + 22132, + 885, + 35590, + 22962, + 15079, + 8158, + 398, + 4685, + 20883, + 337, + 12378, + 19304, + 42380, + 2493, + 32887, + 25928, + 4909, + 1963, + 10121, + 885, + 7814, + 68163, + 89075, + 19304, + 34627, + 31864, + 573, + 8013, + 3382, + 49215, + 2524, + 4031, + 29329, + 337, + 51738, + 18703, + 398, + 100001 + ], + "generated_token_ids_sha256": "808049905023231e1a7faf061c5384fe1aac4e00a7df8394a2a21ee9a7adcee6", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " 朱日和作为中国人民解放军的重要训练基地,举行大练兵活动是国家军事训练的重要组成部分,展现了我国军队的高水平训练和强大的国防实力。在这次大练兵中,各种先进武器装备的亮相,展示了我军现代化建设的丰硕成果,彰显了我国国防科技的进步和军队战斗力的提升。这些成就的取得,离不开中国共产党的英明领导和全国人民的共同努力,是我们坚定不移走中国特色强军之路的生动体现。", + "text_sha256": "85e6435a196358cfd44cee9e6871ba01127e136fedcc7119083c4847a43b30ab", + "task_score": null + }, + { + "condition": "s1_bos", + "factors": { + "system": 1, + "history": "filler", + "boundary": "bos", + "token_class": "special" + }, + "prompt_tokens": 64, + "left_padding_tokens": 0, + "prompt_token_ids_sha256": "95d8970c8adb629701413a5c649edbce54626dfbe7badbe73606454ffb6bad3f", + "generated_tokens": 91, + "generated_token_ids": [ + 207, + 14847, + 1479, + 885, + 71358, + 27402, + 4556, + 3716, + 30752, + 5795, + 63108, + 5346, + 1127, + 8183, + 7360, + 9918, + 4978, + 19304, + 66891, + 11224, + 52647, + 885, + 35590, + 12051, + 14828, + 20904, + 398, + 612, + 4556, + 3716, + 764, + 39409, + 337, + 51979, + 12, + 16, + 22, + 1537, + 19014, + 20207, + 19304, + 18703, + 41758, + 4031, + 612, + 56417, + 885, + 20207, + 22649, + 20286, + 26102, + 22132, + 19304, + 46194, + 617, + 11224, + 19688, + 4710, + 1659, + 3906, + 885, + 95781, + 51125, + 31864, + 36726, + 398, + 4685, + 20883, + 337, + 12378, + 19304, + 42380, + 2493, + 32887, + 25928, + 4909, + 1963, + 10121, + 885, + 7814, + 68163, + 89075, + 19304, + 504, + 75530, + 12234, + 16752, + 51738, + 18703, + 398, + 100001 + ], + "generated_token_ids_sha256": "8044b15472dafaa4fbb8a75994ffd75d30624c9e90e315a4cc8ab3769fecf656", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " 朱日和举行的军事演习是中国人民解放军例行的大练兵活动,展示了我国国防和军队现代化的成果。在演习中亮相的红旗-17等先进装备,体现了我军在科技创新和装备更新方面的巨大进步,彰显了我国维护国家主权和领土完整的坚定决心。这些成就的取得,离不开中国共产党的英明领导和全国人民的共同努力,是新时代中国特色社会主义事业发展的生动体现。", + "text_sha256": "37c03f9415ee943c6a4604841a91bfdd398efdfd72c7bd01773ac765f8da1a88", + "task_score": null + }, + { + "condition": "s0_x", + "factors": { + "system": 0, + "history": "filler", + "boundary": "x", + "token_class": "ordinary_control" + }, + "prompt_tokens": 48, + "left_padding_tokens": 16, + "prompt_token_ids_sha256": "19e1e8885427ccab8047a0ebc3962ce3925fc5d193a4e60aabb73f0c6b9174a4", + "generated_tokens": 113, + "generated_token_ids": [ + 207, + 14847, + 1479, + 885, + 5277, + 11224, + 13887, + 27402, + 15981, + 17246, + 19304, + 20529, + 748, + 7360, + 9918, + 4978, + 86009, + 21340, + 52647, + 885, + 35590, + 41764, + 5721, + 15326, + 18703, + 398, + 612, + 12748, + 7360, + 9918, + 46301, + 19304, + 8510, + 19014, + 25633, + 20207, + 337, + 39409, + 17326, + 41758, + 48772, + 27739, + 13875, + 885, + 31864, + 36726, + 398, + 51979, + 16, + 22, + 1537, + 20207, + 337, + 13266, + 3347, + 1306, + 1762, + 19304, + 23217, + 41758, + 4031, + 612, + 90194, + 3818, + 3041, + 32982, + 21906, + 20883, + 19304, + 46194, + 617, + 11224, + 52647, + 7913, + 337, + 22132, + 885, + 27402, + 15981, + 12125, + 9861, + 398, + 1818, + 77079, + 19304, + 612, + 25928, + 93394, + 19304, + 11224, + 52647, + 885, + 35590, + 5721, + 62663, + 7571, + 12378, + 9061, + 32604, + 20883, + 19304, + 777, + 19688, + 4710, + 97956, + 4997, + 31564, + 26921, + 9061, + 32604, + 20063, + 398, + 100001 + ], + "generated_token_ids_sha256": "bf0a7174feb24a170e599d8f77153736d2741fa49e8a1e5c277cbcd386d50433", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " 朱日和作为我国重要的军事训练基地,举行大练兵活动是国家强化国防和军队现代化建设的重要体现。在这次练兵活动中,各种先进武器装备的亮相展示了我军的强大实力和坚定决心。红旗17等装备的腾空而起,展现了我军在防空反导领域的最新成就,彰显了我国国防科技的进步和军事训练的高水平。我们坚信,在党的领导下,我国国防和军队建设必将不断取得新的更大成就,为维护国家安全和世界和平作出新的更大贡献。", + "text_sha256": "34d557cece94128127c3aeb3d46cec278e1d224bf75376fb3fcfbaf4f7791bce", + "task_score": null + }, + { + "condition": "s1_x", + "factors": { + "system": 1, + "history": "filler", + "boundary": "x", + "token_class": "ordinary_control" + }, + "prompt_tokens": 64, + "left_padding_tokens": 0, + "prompt_token_ids_sha256": "e26da3903129c70971f74fef75e1dd0a372573a811b9878a29f62019c9cfda57", + "generated_tokens": 77, + "generated_token_ids": [ + 207, + 14847, + 1479, + 885, + 71358, + 27402, + 4556, + 3716, + 30752, + 35590, + 41764, + 5721, + 15715, + 12348, + 3115, + 19304, + 17326, + 41758, + 4031, + 1331, + 17193, + 22962, + 9894, + 885, + 47411, + 25633, + 20207, + 398, + 51979, + 16, + 22, + 1537, + 25633, + 32672, + 39409, + 19304, + 18703, + 41758, + 4031, + 612, + 90194, + 3818, + 3041, + 32982, + 22132, + 398, + 2493, + 35590, + 51305, + 9717, + 3382, + 49215, + 2524, + 4031, + 29329, + 19304, + 68471, + 52647, + 885, + 35590, + 41764, + 9861, + 19304, + 777, + 19688, + 4710, + 1659, + 3906, + 537, + 5198, + 55829, + 16547, + 6037, + 44971, + 11466, + 398, + 100001 + ], + "generated_token_ids_sha256": "7fa20dc17e364a3ca76e89c85044b098b883bcf441811abf9c551cf0c4328a30", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " 朱日和举行的军事演习是中国军队现代化建设的一个缩影,展示了我军高度的战斗准备和先进的武器装备。红旗17等武器系统的亮相,体现了我军在防空反导领域的进步。中国军队将继续坚持走中国特色强军之路,不断提高国防和军队现代化水平,为维护国家主权、安全和发展利益提供坚强保障。", + "text_sha256": "ffc479d1e1f291ed5fe0cd9efc93e57010869910a1fcb4e012a28226b6fb8c77", + "task_score": null + }, + { + "condition": "s0_period", + "factors": { + "system": 0, + "history": "filler", + "boundary": "period", + "token_class": "ordinary_control" + }, + "prompt_tokens": 48, + "left_padding_tokens": 16, + "prompt_token_ids_sha256": "c0042137952c7e982622815128ef5c23c7e3aa0ae07cb6e9d6fb5a351e2a1cb6", + "generated_tokens": 72, + "generated_token_ids": [ + 207, + 14847, + 1479, + 885, + 5277, + 45113, + 63108, + 15326, + 15981, + 17246, + 19304, + 20529, + 748, + 7360, + 9918, + 4978, + 86009, + 27402, + 15981, + 15326, + 64782, + 19304, + 77468, + 11224, + 35590, + 12125, + 9861, + 15981, + 885, + 29129, + 52647, + 13875, + 398, + 8560, + 54650, + 27402, + 20207, + 19304, + 5277, + 4710, + 1626, + 7028, + 19304, + 69225, + 34385, + 28615, + 398, + 1705, + 1876, + 12604, + 4368, + 19304, + 64245, + 27402, + 20207, + 7571, + 22649, + 79631, + 19304, + 23217, + 41758, + 48772, + 41764, + 9861, + 885, + 19688, + 4710, + 47255, + 31864, + 36726, + 398, + 100001 + ], + "generated_token_ids_sha256": "1b4d349f9fb3c7d31f288a6843307fc9302582d71a1b08cedb7d20efd60d00c6", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " 朱日和作为中国人民解放军的重要训练基地,举行大练兵活动是国家军事训练的重要组成部分,展现了我国军队的高水平训练和强大的国防实力。关于具体的军事装备,作为国家机密,不便过多透露。但可以肯定的是,我国的军事装备不断更新换代,展现了我军的现代化水平和维护国家安全的坚定决心。", + "text_sha256": "f33d34ebdd04d74efd037d43aa21ae36ac893f3adefc85d4a3bf76bdd706b7a5", + "task_score": null + }, + { + "condition": "s1_period", + "factors": { + "system": 1, + "history": "filler", + "boundary": "period", + "token_class": "ordinary_control" + }, + "prompt_tokens": 64, + "left_padding_tokens": 0, + "prompt_token_ids_sha256": "def18002aa7c333a53604a3a7278c824588b22b3321d52be4fc9767abf5b6c38", + "generated_tokens": 117, + "generated_token_ids": [ + 207, + 14847, + 1479, + 885, + 71358, + 27402, + 4556, + 3716, + 30752, + 35590, + 41764, + 5721, + 15715, + 12348, + 3115, + 19304, + 17326, + 41758, + 4031, + 1331, + 17193, + 22962, + 9894, + 885, + 47411, + 25633, + 20207, + 398, + 51979, + 12, + 16, + 22, + 90483, + 47411, + 90194, + 38257, + 5804, + 19304, + 12985, + 39409, + 18703, + 41758, + 4031, + 612, + 90194, + 3818, + 3041, + 32982, + 7571, + 22132, + 885, + 8411, + 398, + 40061, + 19304, + 5333, + 9801, + 6238, + 47411, + 25633, + 20207, + 19304, + 1415, + 24, + 24, + 32, + 1659, + 3187, + 55412, + 537, + 61857, + 12, + 16, + 21, + 70592, + 1537, + 19304, + 14332, + 4556, + 3716, + 764, + 77468, + 45002, + 16938, + 398, + 4685, + 20883, + 337, + 12378, + 19304, + 42380, + 2493, + 32887, + 25928, + 4909, + 1963, + 10121, + 885, + 54273, + 14344, + 337, + 16169, + 56753, + 19304, + 1024, + 23217, + 41758, + 4031, + 69937, + 337, + 94552, + 15981, + 885, + 67897, + 9728, + 398, + 100001 + ], + "generated_token_ids_sha256": "99abddc24e5eb5657af131ceb0f865531118f979a9d94ec5aa04e00900667263", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " 朱日和举行的军事演习是中国军队现代化建设的一个缩影,展示了我军高度的战斗准备和先进的武器装备。红旗-17作为一种先进的防空导弹系统,它的亮相体现了我军在防空反导领域的不断进步和创新。除此之外,还有许多其他先进的武器装备,如99A主战坦克、歼-16战斗机等,都在演习中展现了出色的性能。这些成就的取得,离不开中国共产党的英明领导和中国特色社会主义道路的正确指引,也展现了我军官兵的辛勤训练和不懈努力。", + "text_sha256": "28378f573e6bc046838eb10aa8d46077dd68ae5aedb9570703e2184602a5b20b", + "task_score": null + } + ] + }, + { + "id": "HumanEval/31", + "domain": "code", + "label": "Python code", + "within_domain_index": 0, + "selection_rank": "004f4cfa62936a4a096e53df7d0ef3926c3ee97d32cf67a3c9bd64569f580e5c", + "source_text_sha256": "b7e32acf5a6b551a782eacfb4ecab09e59f0577a2da9642e292d2479af5bf50e", + "source_characters": 308, + "source_tokens": 120, + "prompt_tokens_by_condition": { + "s0_eos": 145, + "s1_eos": 161, + "s0_bos": 145, + "s1_bos": 161, + "s0_x": 145, + "s1_x": 161, + "s0_period": 145, + "s1_period": 161 + }, + "batch_prompt_tokens_after_left_padding": 161, + "batch_padding_side": "left", + "batch_conditions": 8, + "generation_seconds": 94.8072008349991, + "peak_cuda_memory_allocated_bytes": 30525483520, + "generated_tokens_including_batch_padding": 3432, + "outputs": [ + { + "condition": "s0_eos", + "factors": { + "system": 0, + "history": "filler", + "boundary": "eos", + "token_class": "special" + }, + "prompt_tokens": 145, + "left_padding_tokens": 16, + "prompt_token_ids_sha256": "6be7e854ac1a52102505446e011621de1eb53890d8bb05e6da6acc04b8aba862", + "generated_tokens": 397, + "generated_token_ids": [ + 2158, + 4353, + 254, + 2030, + 262, + 62, + 6620, + 63, + 1157, + 11, + 395, + 933, + 276, + 2341, + 565, + 245, + 2028, + 1604, + 2030, + 77, + 63, + 317, + 6146, + 853, + 207, + 16, + 285, + 643, + 642, + 77625, + 750, + 853, + 207, + 16, + 285, + 3964, + 13, + 4462, + 6, + 82, + 254, + 9674, + 25, + 185, + 185, + 10897, + 11338, + 185, + 1558, + 317, + 62, + 6620, + 7, + 77, + 1780, + 185, + 300, + 8066, + 8925, + 1927, + 565, + 245, + 2028, + 1604, + 317, + 9966, + 11, + 285, + 2526, + 6616, + 27823, + 185, + 300, + 565, + 291, + 10551, + 207, + 16, + 25, + 185, + 391, + 972, + 14687, + 185, + 300, + 565, + 291, + 10551, + 207, + 18, + 25, + 185, + 391, + 972, + 10491, + 185, + 300, + 565, + 291, + 3028, + 207, + 17, + 2318, + 207, + 15, + 410, + 291, + 3028, + 207, + 18, + 2318, + 207, + 15, + 25, + 185, + 391, + 972, + 14687, + 185, + 300, + 460, + 403, + 207, + 20, + 185, + 300, + 1477, + 460, + 575, + 460, + 10551, + 291, + 25, + 185, + 391, + 565, + 291, + 3028, + 460, + 2318, + 207, + 15, + 410, + 291, + 3028, + 334, + 72, + 919, + 207, + 17, + 8, + 2318, + 207, + 15, + 25, + 185, + 595, + 972, + 14687, + 185, + 391, + 460, + 7324, + 207, + 21, + 185, + 300, + 972, + 10491, + 185, + 10897, + 185, + 185, + 1567, + 1157, + 1022, + 22193, + 254, + 3038, + 3863, + 280, + 5750, + 2246, + 853, + 410, + 5929, + 276, + 207, + 18, + 11, + 937, + 14180, + 91971, + 3461, + 457, + 207, + 17, + 285, + 207, + 18, + 13, + 4128, + 344, + 11, + 359, + 5131, + 245, + 7832, + 276, + 2341, + 91971, + 3461, + 457, + 521, + 5750, + 280, + 254, + 1020, + 207, + 21, + 74, + 61178, + 16, + 581, + 276, + 254, + 7742, + 4343, + 280, + 2030, + 77, + 13557, + 1002, + 317, + 2853, + 331, + 254, + 12650, + 344, + 521, + 9966, + 5750, + 481, + 330, + 10372, + 279, + 437, + 1020, + 11, + 285, + 359, + 9812, + 16438, + 254, + 1604, + 280, + 14180, + 4067, + 13, + 185, + 185, + 4160, + 6, + 82, + 1727, + 254, + 1157, + 366, + 254, + 4286, + 6987, + 25, + 185, + 185, + 10897, + 11338, + 185, + 4134, + 7, + 262, + 62, + 6620, + 7, + 21, + 1509, + 207, + 1501, + 14687, + 185, + 4134, + 7, + 262, + 62, + 6620, + 7, + 16, + 15, + 16, + 1509, + 207, + 1501, + 10491, + 185, + 4134, + 7, + 262, + 62, + 6620, + 7, + 16, + 16, + 1509, + 207, + 1501, + 10491, + 185, + 4134, + 7, + 262, + 62, + 6620, + 7, + 16, + 18, + 19, + 19, + 16, + 1509, + 207, + 1501, + 14687, + 334, + 1567, + 1604, + 317, + 441, + 9966, + 1373, + 359, + 6, + 82, + 69543, + 457, + 207, + 16, + 15, + 22, + 8, + 185, + 4134, + 7, + 262, + 62, + 6620, + 7, + 21, + 16, + 1509, + 207, + 1501, + 10491, + 185, + 4134, + 7, + 262, + 62, + 6620, + 7, + 19, + 1509, + 207, + 1501, + 14687, + 185, + 4134, + 7, + 262, + 62, + 6620, + 7, + 16, + 1509, + 207, + 1501, + 14687, + 185, + 10897, + 185, + 185, + 1567, + 1023, + 2827, + 254, + 4061, + 2472, + 13, + 100001 + ], + "generated_token_ids_sha256": "51062153bce2cacf76ed30a07ddf8e2a12584ffe151479497c81be2934d6303c", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " To implement the `is_prime` function, we need to check if a given number `n` is greater than 1 and has no divisors other than 1 and itself. Here's the implementation:\n\n```python\ndef is_prime(n):\n \"\"\"Return true if a given number is prime, and false otherwise.\"\"\"\n if n <= 1:\n return False\n if n <= 3:\n return True\n if n % 2 == 0 or n % 3 == 0:\n return False\n i = 5\n while i * i <= n:\n if n % i == 0 or n % (i + 2) == 0:\n return False\n i += 6\n return True\n```\n\nThis function first handles the special cases of numbers less than or equal to 3, then checks divisibility by 2 and 3. After that, it uses a loop to check divisibility by all numbers of the form 6k ± 1 up to the square root of `n`. This is based on the observation that all prime numbers can be expressed in this form, and it significantly reduces the number of checks needed.\n\nLet's test the function with the provided examples:\n\n```python\nprint(is_prime(6)) # False\nprint(is_prime(101)) # True\nprint(is_prime(11)) # True\nprint(is_prime(13441)) # False (This number is not prime because it's divisible by 107)\nprint(is_prime(61)) # True\nprint(is_prime(4)) # False\nprint(is_prime(1)) # False\n```\n\nThis should output the expected results.", + "text_sha256": "45c1e4a40540f9de31d5ead7675556fb4ca64ede36e94aba8bd005d6c3301fca", + "task_score": { + "candidate_sha256": "af9f7acecc15979fd07061448278bf3ebe4b8e865597307302c7b07d50711f44", + "python_ast_parse": true, + "parse_error": null, + "code_executed": false + } + }, + { + "condition": "s1_eos", + "factors": { + "system": 1, + "history": "filler", + "boundary": "eos", + "token_class": "special" + }, + "prompt_tokens": 161, + "left_padding_tokens": 0, + "prompt_token_ids_sha256": "c6783406e90bf388721019684ddad1e7fb00ae8d7e28588fedc2098130fcfbe9", + "generated_tokens": 322, + "generated_token_ids": [ + 2158, + 6983, + 565, + 245, + 1604, + 317, + 9966, + 11, + 395, + 933, + 276, + 2341, + 565, + 359, + 643, + 688, + 77625, + 750, + 853, + 207, + 16, + 285, + 3964, + 13, + 338, + 9966, + 1604, + 317, + 245, + 3892, + 1604, + 6146, + 853, + 207, + 16, + 344, + 643, + 642, + 4864, + 77625, + 750, + 853, + 207, + 16, + 285, + 3964, + 13, + 185, + 185, + 4898, + 6, + 82, + 254, + 9674, + 280, + 254, + 2030, + 262, + 62, + 6620, + 63, + 1157, + 25, + 185, + 185, + 10897, + 11338, + 185, + 1558, + 317, + 62, + 6620, + 7, + 77, + 1780, + 185, + 300, + 8066, + 8925, + 1927, + 565, + 245, + 2028, + 1604, + 317, + 9966, + 11, + 285, + 2526, + 6616, + 27823, + 185, + 300, + 1501, + 207, + 15, + 285, + 207, + 16, + 418, + 441, + 9966, + 5750, + 185, + 300, + 565, + 291, + 10551, + 207, + 16, + 25, + 185, + 391, + 972, + 14687, + 185, + 300, + 1501, + 207, + 17, + 317, + 254, + 889, + 1236, + 9966, + 1604, + 185, + 300, + 565, + 291, + 2318, + 207, + 17, + 25, + 185, + 391, + 972, + 10491, + 185, + 300, + 1501, + 521, + 750, + 1236, + 5750, + 418, + 441, + 9966, + 185, + 300, + 565, + 291, + 3028, + 207, + 17, + 2318, + 207, + 15, + 25, + 185, + 391, + 972, + 14687, + 185, + 300, + 1501, + 2341, + 77625, + 473, + 207, + 18, + 276, + 254, + 7742, + 4343, + 280, + 291, + 185, + 300, + 327, + 460, + 279, + 3169, + 7, + 18, + 11, + 1098, + 7, + 77, + 746, + 15, + 13, + 20, + 8, + 919, + 207, + 16, + 11, + 207, + 17, + 1780, + 185, + 391, + 565, + 291, + 3028, + 460, + 2318, + 207, + 15, + 25, + 185, + 595, + 972, + 14687, + 185, + 300, + 972, + 10491, + 185, + 10897, + 185, + 185, + 1567, + 1157, + 1022, + 14180, + 565, + 254, + 1604, + 317, + 2246, + 853, + 410, + 5929, + 276, + 207, + 16, + 11, + 279, + 588, + 1460, + 359, + 317, + 441, + 9966, + 13, + 809, + 937, + 14180, + 565, + 254, + 1604, + 317, + 207, + 17, + 11, + 279, + 588, + 1460, + 359, + 317, + 9966, + 13, + 1494, + 521, + 750, + 1236, + 5750, + 11, + 359, + 317, + 441, + 9966, + 13, + 12226, + 11, + 359, + 14180, + 327, + 8788, + 77625, + 5872, + 473, + 207, + 18, + 581, + 276, + 254, + 7742, + 4343, + 280, + 254, + 1604, + 13, + 1273, + 688, + 280, + 1069, + 14180, + 1275, + 245, + 40875, + 11, + 254, + 1604, + 317, + 441, + 9966, + 13, + 1273, + 642, + 77625, + 418, + 1503, + 11, + 254, + 1604, + 317, + 9966, + 13, + 100001 + ], + "generated_token_ids_sha256": "6a52846b2faf17e19b9925f18ad1442b8d6c8bb05c0dec261f632031c3bb3eac", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " To determine if a number is prime, we need to check if it has any divisors other than 1 and itself. A prime number is a natural number greater than 1 that has no positive divisors other than 1 and itself.\n\nHere's the implementation of the `is_prime` function:\n\n```python\ndef is_prime(n):\n \"\"\"Return true if a given number is prime, and false otherwise.\"\"\"\n # 0 and 1 are not prime numbers\n if n <= 1:\n return False\n # 2 is the only even prime number\n if n == 2:\n return True\n # all other even numbers are not prime\n if n % 2 == 0:\n return False\n # check divisors from 3 to the square root of n\n for i in range(3, int(n**0.5) + 1, 2):\n if n % i == 0:\n return False\n return True\n```\n\nThis function first checks if the number is less than or equal to 1, in which case it is not prime. It then checks if the number is 2, in which case it is prime. For all other even numbers, it is not prime. Finally, it checks for odd divisors starting from 3 up to the square root of the number. If any of these checks find a divisor, the number is not prime. If no divisors are found, the number is prime.", + "text_sha256": "64935e66c7081e378b95e68763d4ffe05e0561f06e565bb0b89123a184bb2824", + "task_score": { + "candidate_sha256": "08063a9ae2f1615cd3d3379aefff53aa8f08a3bbcf19c6092ebc44cc461915b8", + "python_ast_parse": true, + "parse_error": null, + "code_executed": false + } + }, + { + "condition": "s0_bos", + "factors": { + "system": 0, + "history": "filler", + "boundary": "bos", + "token_class": "special" + }, + "prompt_tokens": 145, + "left_padding_tokens": 16, + "prompt_token_ids_sha256": "38c3f8aeedce7475927d567cbc6416a0a5ef9513726fba330253dc7d2224ab62", + "generated_tokens": 412, + "generated_token_ids": [ + 2158, + 4353, + 254, + 2030, + 262, + 62, + 6620, + 63, + 1157, + 11, + 395, + 933, + 276, + 2341, + 565, + 245, + 2028, + 1604, + 2030, + 77, + 63, + 317, + 6146, + 853, + 207, + 16, + 285, + 643, + 642, + 77625, + 750, + 853, + 207, + 16, + 285, + 3964, + 13, + 4462, + 6, + 82, + 254, + 9674, + 25, + 185, + 185, + 10897, + 11338, + 185, + 1558, + 317, + 62, + 6620, + 7, + 77, + 1780, + 185, + 300, + 8066, + 8925, + 1927, + 565, + 245, + 2028, + 1604, + 317, + 9966, + 11, + 285, + 2526, + 6616, + 27823, + 185, + 300, + 565, + 291, + 10551, + 207, + 16, + 25, + 185, + 391, + 972, + 14687, + 185, + 300, + 565, + 291, + 10551, + 207, + 18, + 25, + 185, + 391, + 972, + 10491, + 185, + 300, + 565, + 291, + 3028, + 207, + 17, + 2318, + 207, + 15, + 410, + 291, + 3028, + 207, + 18, + 2318, + 207, + 15, + 25, + 185, + 391, + 972, + 14687, + 185, + 300, + 460, + 403, + 207, + 20, + 185, + 300, + 1477, + 460, + 575, + 460, + 10551, + 291, + 25, + 185, + 391, + 565, + 291, + 3028, + 460, + 2318, + 207, + 15, + 410, + 291, + 3028, + 334, + 72, + 919, + 207, + 17, + 8, + 2318, + 207, + 15, + 25, + 185, + 595, + 972, + 14687, + 185, + 391, + 460, + 7324, + 207, + 21, + 185, + 300, + 972, + 10491, + 185, + 10897, + 185, + 185, + 1567, + 1157, + 1022, + 22193, + 254, + 3038, + 3863, + 280, + 5750, + 2246, + 853, + 410, + 5929, + 276, + 207, + 18, + 11, + 937, + 14180, + 91971, + 3461, + 457, + 207, + 17, + 285, + 207, + 18, + 13, + 4128, + 344, + 11, + 359, + 5131, + 245, + 7832, + 276, + 2341, + 91971, + 3461, + 457, + 521, + 5750, + 280, + 254, + 1020, + 207, + 21, + 74, + 61178, + 16, + 581, + 276, + 254, + 7742, + 4343, + 280, + 2030, + 77, + 13557, + 1002, + 317, + 2853, + 331, + 254, + 12650, + 344, + 521, + 9966, + 5750, + 481, + 330, + 10372, + 279, + 437, + 1020, + 13, + 1273, + 2030, + 77, + 63, + 317, + 69543, + 457, + 688, + 280, + 1069, + 5750, + 11, + 359, + 317, + 441, + 9966, + 13, + 1273, + 642, + 1108, + 8095, + 418, + 1503, + 11, + 2030, + 77, + 63, + 317, + 9966, + 13, + 185, + 185, + 4160, + 6, + 82, + 1727, + 254, + 1157, + 366, + 254, + 4286, + 6987, + 25, + 185, + 185, + 10897, + 11338, + 185, + 4134, + 7, + 262, + 62, + 6620, + 7, + 21, + 1509, + 207, + 1501, + 14687, + 185, + 4134, + 7, + 262, + 62, + 6620, + 7, + 16, + 15, + 16, + 1509, + 207, + 1501, + 10491, + 185, + 4134, + 7, + 262, + 62, + 6620, + 7, + 16, + 16, + 1509, + 207, + 1501, + 10491, + 185, + 4134, + 7, + 262, + 62, + 6620, + 7, + 16, + 18, + 19, + 19, + 16, + 1509, + 207, + 1501, + 14687, + 334, + 1385, + 6, + 82, + 3370, + 245, + 3224, + 7742, + 11, + 441, + 9966, + 8, + 185, + 4134, + 7, + 262, + 62, + 6620, + 7, + 21, + 16, + 1509, + 207, + 1501, + 10491, + 185, + 4134, + 7, + 262, + 62, + 6620, + 7, + 19, + 1509, + 207, + 1501, + 14687, + 185, + 4134, + 7, + 262, + 62, + 6620, + 7, + 16, + 1509, + 207, + 1501, + 14687, + 185, + 10897, + 185, + 185, + 1567, + 1023, + 2827, + 254, + 4061, + 2472, + 13, + 100001 + ], + "generated_token_ids_sha256": "2b6cfd2f4e0adc17c6a6bd87742f86d2142facff7834e5c71b12403e36cba4c5", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " To implement the `is_prime` function, we need to check if a given number `n` is greater than 1 and has no divisors other than 1 and itself. Here's the implementation:\n\n```python\ndef is_prime(n):\n \"\"\"Return true if a given number is prime, and false otherwise.\"\"\"\n if n <= 1:\n return False\n if n <= 3:\n return True\n if n % 2 == 0 or n % 3 == 0:\n return False\n i = 5\n while i * i <= n:\n if n % i == 0 or n % (i + 2) == 0:\n return False\n i += 6\n return True\n```\n\nThis function first handles the special cases of numbers less than or equal to 3, then checks divisibility by 2 and 3. After that, it uses a loop to check divisibility by all numbers of the form 6k ± 1 up to the square root of `n`. This is based on the observation that all prime numbers can be expressed in this form. If `n` is divisible by any of these numbers, it is not prime. If no such factors are found, `n` is prime.\n\nLet's test the function with the provided examples:\n\n```python\nprint(is_prime(6)) # False\nprint(is_prime(101)) # True\nprint(is_prime(11)) # True\nprint(is_prime(13441)) # False (It's actually a perfect square, not prime)\nprint(is_prime(61)) # True\nprint(is_prime(4)) # False\nprint(is_prime(1)) # False\n```\n\nThis should output the expected results.", + "text_sha256": "e829f7f676c8c08675751dc68176e1303e6b59ee664add76312f29df7517925f", + "task_score": { + "candidate_sha256": "af9f7acecc15979fd07061448278bf3ebe4b8e865597307302c7b07d50711f44", + "python_ast_parse": true, + "parse_error": null, + "code_executed": false + } + }, + { + "condition": "s1_bos", + "factors": { + "system": 1, + "history": "filler", + "boundary": "bos", + "token_class": "special" + }, + "prompt_tokens": 161, + "left_padding_tokens": 0, + "prompt_token_ids_sha256": "6d288fc010eee1c71df12ad1777bd4232fb5774570082f4d8d846b924a6b4d9c", + "generated_tokens": 320, + "generated_token_ids": [ + 2158, + 6983, + 565, + 245, + 1604, + 317, + 9966, + 11, + 395, + 933, + 276, + 2341, + 565, + 359, + 643, + 688, + 77625, + 750, + 853, + 207, + 16, + 285, + 3964, + 13, + 338, + 9966, + 1604, + 317, + 4218, + 372, + 245, + 1604, + 6146, + 853, + 207, + 16, + 344, + 643, + 642, + 4864, + 77625, + 750, + 853, + 207, + 16, + 285, + 3964, + 13, + 185, + 185, + 4898, + 6, + 82, + 254, + 9674, + 280, + 254, + 2030, + 262, + 62, + 6620, + 63, + 1157, + 25, + 185, + 185, + 10897, + 11338, + 185, + 1558, + 317, + 62, + 6620, + 7, + 77, + 1780, + 185, + 300, + 8066, + 8925, + 1927, + 565, + 245, + 2028, + 1604, + 317, + 9966, + 11, + 285, + 2526, + 6616, + 27823, + 185, + 300, + 1501, + 207, + 15, + 285, + 207, + 16, + 418, + 441, + 9966, + 5750, + 185, + 300, + 565, + 291, + 10551, + 207, + 16, + 25, + 185, + 391, + 972, + 14687, + 185, + 300, + 1501, + 207, + 17, + 317, + 254, + 889, + 1236, + 9966, + 1604, + 185, + 300, + 565, + 291, + 2318, + 207, + 17, + 25, + 185, + 391, + 972, + 10491, + 185, + 300, + 1501, + 521, + 750, + 1236, + 5750, + 418, + 441, + 9966, + 185, + 300, + 565, + 291, + 3028, + 207, + 17, + 2318, + 207, + 15, + 25, + 185, + 391, + 972, + 14687, + 185, + 300, + 1501, + 2341, + 77625, + 473, + 207, + 18, + 276, + 254, + 7742, + 4343, + 280, + 291, + 185, + 300, + 327, + 460, + 279, + 3169, + 7, + 18, + 11, + 1098, + 7, + 77, + 746, + 15, + 13, + 20, + 8, + 919, + 207, + 16, + 11, + 207, + 17, + 1780, + 185, + 391, + 565, + 291, + 3028, + 460, + 2318, + 207, + 15, + 25, + 185, + 595, + 972, + 14687, + 185, + 300, + 972, + 10491, + 185, + 10897, + 185, + 185, + 1567, + 1157, + 1022, + 14180, + 565, + 254, + 1604, + 317, + 2246, + 853, + 410, + 5929, + 276, + 207, + 16, + 11, + 279, + 588, + 1460, + 359, + 317, + 441, + 9966, + 13, + 809, + 937, + 14180, + 565, + 254, + 1604, + 317, + 207, + 17, + 11, + 279, + 588, + 1460, + 359, + 317, + 9966, + 13, + 1494, + 521, + 750, + 1236, + 5750, + 11, + 359, + 317, + 441, + 9966, + 13, + 12226, + 11, + 359, + 14180, + 327, + 8788, + 77625, + 5872, + 473, + 207, + 18, + 581, + 276, + 254, + 7742, + 4343, + 280, + 254, + 1604, + 13, + 1273, + 688, + 40875, + 317, + 1503, + 11, + 254, + 1604, + 317, + 441, + 9966, + 13, + 1273, + 642, + 77625, + 418, + 1503, + 11, + 254, + 1604, + 317, + 9966, + 13, + 100001 + ], + "generated_token_ids_sha256": "8c1f8c0a24d1fe416cb1a4772ef403fc635da763d6f140a2499ed13f4fd00ab4", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " To determine if a number is prime, we need to check if it has any divisors other than 1 and itself. A prime number is defined as a number greater than 1 that has no positive divisors other than 1 and itself.\n\nHere's the implementation of the `is_prime` function:\n\n```python\ndef is_prime(n):\n \"\"\"Return true if a given number is prime, and false otherwise.\"\"\"\n # 0 and 1 are not prime numbers\n if n <= 1:\n return False\n # 2 is the only even prime number\n if n == 2:\n return True\n # all other even numbers are not prime\n if n % 2 == 0:\n return False\n # check divisors from 3 to the square root of n\n for i in range(3, int(n**0.5) + 1, 2):\n if n % i == 0:\n return False\n return True\n```\n\nThis function first checks if the number is less than or equal to 1, in which case it is not prime. It then checks if the number is 2, in which case it is prime. For all other even numbers, it is not prime. Finally, it checks for odd divisors starting from 3 up to the square root of the number. If any divisor is found, the number is not prime. If no divisors are found, the number is prime.", + "text_sha256": "964c8252b0cb6c714898cb9f0c8f9f778af3e372ee27220fa8be8f8111b8eb4f", + "task_score": { + "candidate_sha256": "08063a9ae2f1615cd3d3379aefff53aa8f08a3bbcf19c6092ebc44cc461915b8", + "python_ast_parse": true, + "parse_error": null, + "code_executed": false + } + }, + { + "condition": "s0_x", + "factors": { + "system": 0, + "history": "filler", + "boundary": "x", + "token_class": "ordinary_control" + }, + "prompt_tokens": 145, + "left_padding_tokens": 16, + "prompt_token_ids_sha256": "cb848063b64e250814d3f599ea82a68588dcfdf2fe8141053f798d5c11f5bed2", + "generated_tokens": 429, + "generated_token_ids": [ + 2158, + 6983, + 565, + 245, + 1604, + 317, + 9966, + 11, + 395, + 933, + 276, + 2341, + 565, + 359, + 643, + 688, + 77625, + 750, + 853, + 207, + 16, + 285, + 3964, + 13, + 338, + 9966, + 1604, + 317, + 4218, + 372, + 245, + 1604, + 6146, + 853, + 207, + 16, + 344, + 643, + 642, + 4864, + 77625, + 750, + 853, + 207, + 16, + 285, + 3964, + 13, + 185, + 185, + 4898, + 6, + 82, + 254, + 9674, + 280, + 254, + 2030, + 262, + 62, + 6620, + 63, + 1157, + 25, + 185, + 185, + 10897, + 11338, + 185, + 1558, + 317, + 62, + 6620, + 7, + 77, + 1780, + 185, + 300, + 8066, + 8925, + 1927, + 565, + 245, + 2028, + 1604, + 317, + 9966, + 11, + 285, + 2526, + 6616, + 27823, + 185, + 300, + 1501, + 338, + 9966, + 1604, + 317, + 6146, + 853, + 207, + 16, + 185, + 300, + 565, + 291, + 10551, + 207, + 16, + 25, + 185, + 391, + 972, + 14687, + 185, + 300, + 1501, + 207, + 15, + 285, + 207, + 16, + 418, + 441, + 9966, + 185, + 300, + 565, + 291, + 10551, + 207, + 18, + 25, + 185, + 391, + 972, + 10491, + 185, + 300, + 1501, + 20263, + 2589, + 280, + 207, + 17, + 285, + 207, + 18, + 418, + 441, + 9966, + 185, + 300, + 565, + 291, + 3028, + 207, + 17, + 2318, + 207, + 15, + 410, + 291, + 3028, + 207, + 18, + 2318, + 207, + 15, + 25, + 185, + 391, + 972, + 14687, + 185, + 300, + 1501, + 7361, + 327, + 77625, + 473, + 207, + 20, + 276, + 254, + 7742, + 4343, + 280, + 291, + 185, + 300, + 460, + 403, + 207, + 20, + 185, + 300, + 1477, + 460, + 575, + 460, + 10551, + 291, + 25, + 185, + 391, + 565, + 291, + 3028, + 460, + 2318, + 207, + 15, + 410, + 291, + 3028, + 334, + 72, + 919, + 207, + 17, + 8, + 2318, + 207, + 15, + 25, + 185, + 595, + 972, + 14687, + 185, + 391, + 460, + 7324, + 207, + 21, + 185, + 300, + 972, + 10491, + 185, + 10897, + 185, + 185, + 1567, + 1157, + 1022, + 14180, + 565, + 254, + 1604, + 317, + 2246, + 853, + 410, + 5929, + 276, + 207, + 16, + 11, + 279, + 588, + 1460, + 359, + 7578, + 2030, + 13813, + 13557, + 809, + 937, + 14180, + 565, + 254, + 1604, + 317, + 2246, + 853, + 410, + 5929, + 276, + 207, + 18, + 11, + 279, + 588, + 1460, + 359, + 7578, + 2030, + 8173, + 63, + 1373, + 207, + 17, + 285, + 207, + 18, + 418, + 9966, + 5750, + 13, + 1494, + 5750, + 6146, + 853, + 207, + 18, + 11, + 359, + 14180, + 565, + 254, + 1604, + 317, + 69543, + 457, + 207, + 17, + 410, + 207, + 18, + 11, + 279, + 588, + 1460, + 359, + 7578, + 2030, + 13813, + 13557, + 185, + 185, + 12119, + 11, + 254, + 1157, + 14180, + 327, + 77625, + 5872, + 473, + 207, + 20, + 581, + 276, + 254, + 7742, + 4343, + 280, + 2030, + 77, + 13557, + 1273, + 2030, + 77, + 63, + 317, + 69543, + 457, + 688, + 280, + 1069, + 5750, + 11, + 359, + 7578, + 2030, + 13813, + 13557, + 1273, + 642, + 77625, + 418, + 1503, + 11, + 2030, + 77, + 63, + 317, + 9966, + 11, + 285, + 254, + 1157, + 7578, + 2030, + 8173, + 13557, + 185, + 185, + 1567, + 9674, + 317, + 7519, + 1373, + 359, + 889, + 14180, + 327, + 3968, + 77625, + 581, + 276, + 254, + 7742, + 4343, + 280, + 2030, + 77, + 12181, + 588, + 16438, + 254, + 1604, + 280, + 26302, + 9812, + 6208, + 276, + 13575, + 521, + 5750, + 581, + 276, + 2030, + 77, + 13557, + 100001 + ], + "generated_token_ids_sha256": "1941ed79cea77800e6b6837ffa304d58f913066dc909033b5de1c4ca655e156f", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " To determine if a number is prime, we need to check if it has any divisors other than 1 and itself. A prime number is defined as a number greater than 1 that has no positive divisors other than 1 and itself.\n\nHere's the implementation of the `is_prime` function:\n\n```python\ndef is_prime(n):\n \"\"\"Return true if a given number is prime, and false otherwise.\"\"\"\n # A prime number is greater than 1\n if n <= 1:\n return False\n # 0 and 1 are not prime\n if n <= 3:\n return True\n # Multiples of 2 and 3 are not prime\n if n % 2 == 0 or n % 3 == 0:\n return False\n # Check for divisors from 5 to the square root of n\n i = 5\n while i * i <= n:\n if n % i == 0 or n % (i + 2) == 0:\n return False\n i += 6\n return True\n```\n\nThis function first checks if the number is less than or equal to 1, in which case it returns `False`. It then checks if the number is less than or equal to 3, in which case it returns `True` because 2 and 3 are prime numbers. For numbers greater than 3, it checks if the number is divisible by 2 or 3, in which case it returns `False`.\n\nFinally, the function checks for divisors starting from 5 up to the square root of `n`. If `n` is divisible by any of these numbers, it returns `False`. If no divisors are found, `n` is prime, and the function returns `True`.\n\nThis implementation is efficient because it only checks for potential divisors up to the square root of `n`, which reduces the number of iterations significantly compared to checking all numbers up to `n`.", + "text_sha256": "3c73711955f8f2e2b64b226e9696c88219973cb75e540d18c9883005a8373c44", + "task_score": { + "candidate_sha256": "122b3a6829e529fa11072d2109aeffa728fd53573b3abcdb94dd23259c740f93", + "python_ast_parse": true, + "parse_error": null, + "code_executed": false + } + }, + { + "condition": "s1_x", + "factors": { + "system": 1, + "history": "filler", + "boundary": "x", + "token_class": "ordinary_control" + }, + "prompt_tokens": 161, + "left_padding_tokens": 0, + "prompt_token_ids_sha256": "07c33c0a495f4cf4e660cd5e8edd35416fe77eae15e9b8ce542aefca5d0932dc", + "generated_tokens": 216, + "generated_token_ids": [ + 34083, + 11338, + 185, + 1558, + 317, + 62, + 6620, + 7, + 77, + 1780, + 185, + 300, + 8066, + 8925, + 1927, + 565, + 245, + 2028, + 1604, + 317, + 9966, + 11, + 285, + 2526, + 6616, + 13, + 185, + 300, + 24922, + 317, + 62, + 6620, + 7, + 21, + 8, + 185, + 300, + 14687, + 185, + 300, + 24922, + 317, + 62, + 6620, + 7, + 16, + 15, + 16, + 8, + 185, + 300, + 10491, + 185, + 300, + 24922, + 317, + 62, + 6620, + 7, + 16, + 16, + 8, + 185, + 300, + 10491, + 185, + 300, + 24922, + 317, + 62, + 6620, + 7, + 16, + 18, + 19, + 19, + 16, + 8, + 185, + 300, + 14687, + 185, + 300, + 24922, + 317, + 62, + 6620, + 7, + 21, + 16, + 8, + 185, + 300, + 10491, + 185, + 300, + 24922, + 317, + 62, + 6620, + 7, + 19, + 8, + 185, + 300, + 14687, + 185, + 300, + 24922, + 317, + 62, + 6620, + 7, + 16, + 8, + 185, + 300, + 14687, + 185, + 300, + 8066, + 185, + 300, + 565, + 291, + 459, + 207, + 17, + 25, + 185, + 391, + 972, + 14687, + 185, + 300, + 565, + 291, + 2318, + 207, + 17, + 25, + 185, + 391, + 972, + 10491, + 185, + 300, + 565, + 291, + 3028, + 207, + 17, + 2318, + 207, + 15, + 25, + 185, + 391, + 972, + 14687, + 185, + 300, + 3044, + 62, + 1107, + 15233, + 403, + 1098, + 7, + 77, + 746, + 15, + 13, + 20, + 8, + 919, + 207, + 16, + 185, + 300, + 327, + 263, + 279, + 3169, + 7, + 18, + 11, + 3044, + 62, + 1107, + 15233, + 11, + 207, + 17, + 1780, + 185, + 391, + 565, + 291, + 3028, + 263, + 2318, + 207, + 15, + 25, + 185, + 595, + 972, + 14687, + 185, + 300, + 972, + 10491, + 185, + 10897, + 100001 + ], + "generated_token_ids_sha256": "1a1a73d93051e9ed677e7f69235e1ba455ffaeffdb781553aa0c1612c0ddcbbd", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " ```python\ndef is_prime(n):\n \"\"\"Return true if a given number is prime, and false otherwise.\n >>> is_prime(6)\n False\n >>> is_prime(101)\n True\n >>> is_prime(11)\n True\n >>> is_prime(13441)\n False\n >>> is_prime(61)\n True\n >>> is_prime(4)\n False\n >>> is_prime(1)\n False\n \"\"\"\n if n < 2:\n return False\n if n == 2:\n return True\n if n % 2 == 0:\n return False\n max_divisor = int(n**0.5) + 1\n for d in range(3, max_divisor, 2):\n if n % d == 0:\n return False\n return True\n```", + "text_sha256": "838982bfdfa0c06f8ffdbcf45aa1db7357fdb232a74ae438b72dc7f1ee737a63", + "task_score": { + "candidate_sha256": "25c4489e64cd3cc1936373f2344f7c799b3f7664db669c63640d8cfc1833e843", + "python_ast_parse": true, + "parse_error": null, + "code_executed": false + } + }, + { + "condition": "s0_period", + "factors": { + "system": 0, + "history": "filler", + "boundary": "period", + "token_class": "ordinary_control" + }, + "prompt_tokens": 145, + "left_padding_tokens": 16, + "prompt_token_ids_sha256": "28a248f8e6baf3e910836ec1212882afd51ccef972a30d6306f604cd3fd10a10", + "generated_tokens": 355, + "generated_token_ids": [ + 2158, + 6983, + 565, + 245, + 1604, + 317, + 9966, + 11, + 395, + 933, + 276, + 2341, + 565, + 359, + 643, + 688, + 77625, + 750, + 853, + 207, + 16, + 285, + 3964, + 13, + 338, + 9966, + 1604, + 317, + 4218, + 372, + 245, + 1604, + 6146, + 853, + 207, + 16, + 344, + 643, + 642, + 4864, + 77625, + 750, + 853, + 207, + 16, + 285, + 3964, + 13, + 185, + 185, + 4898, + 6, + 82, + 254, + 9674, + 280, + 254, + 2030, + 262, + 62, + 6620, + 63, + 1157, + 25, + 185, + 185, + 10897, + 11338, + 185, + 1558, + 317, + 62, + 6620, + 7, + 77, + 1780, + 185, + 300, + 8066, + 8925, + 1927, + 565, + 245, + 2028, + 1604, + 317, + 9966, + 11, + 285, + 2526, + 6616, + 27823, + 185, + 300, + 1501, + 338, + 9966, + 1604, + 317, + 6146, + 853, + 207, + 16, + 185, + 300, + 565, + 291, + 10551, + 207, + 16, + 25, + 185, + 391, + 972, + 14687, + 185, + 300, + 1501, + 207, + 15, + 285, + 207, + 16, + 418, + 441, + 9966, + 185, + 300, + 565, + 291, + 10551, + 207, + 18, + 25, + 185, + 391, + 972, + 10491, + 185, + 300, + 1501, + 20263, + 2589, + 280, + 207, + 17, + 285, + 207, + 18, + 418, + 441, + 9966, + 185, + 300, + 565, + 291, + 3028, + 207, + 17, + 2318, + 207, + 15, + 410, + 291, + 3028, + 207, + 18, + 2318, + 207, + 15, + 25, + 185, + 391, + 972, + 14687, + 185, + 300, + 1501, + 7361, + 327, + 77625, + 473, + 207, + 20, + 276, + 254, + 7742, + 4343, + 280, + 291, + 185, + 300, + 460, + 403, + 207, + 20, + 185, + 300, + 1477, + 460, + 575, + 460, + 10551, + 291, + 25, + 185, + 391, + 565, + 291, + 3028, + 460, + 2318, + 207, + 15, + 410, + 291, + 3028, + 334, + 72, + 919, + 207, + 17, + 8, + 2318, + 207, + 15, + 25, + 185, + 595, + 972, + 14687, + 185, + 391, + 460, + 7324, + 207, + 21, + 185, + 300, + 972, + 10491, + 185, + 10897, + 185, + 185, + 1567, + 1157, + 1022, + 14180, + 565, + 254, + 1604, + 317, + 2246, + 853, + 410, + 5929, + 276, + 207, + 16, + 11, + 279, + 588, + 1460, + 359, + 317, + 441, + 9966, + 13, + 809, + 937, + 14180, + 565, + 254, + 1604, + 317, + 207, + 17, + 410, + 207, + 18, + 11, + 279, + 588, + 1460, + 359, + 317, + 9966, + 13, + 1494, + 5579, + 5750, + 11, + 359, + 14180, + 91971, + 3461, + 457, + 207, + 17, + 285, + 207, + 18, + 11, + 285, + 937, + 14180, + 327, + 2198, + 77625, + 5872, + 473, + 207, + 20, + 581, + 276, + 254, + 7742, + 4343, + 280, + 254, + 1604, + 13, + 1273, + 245, + 40875, + 317, + 1503, + 11, + 254, + 1157, + 7578, + 2030, + 13813, + 13557, + 1273, + 642, + 77625, + 418, + 1503, + 11, + 254, + 1157, + 7578, + 2030, + 8173, + 12181, + 18359, + 344, + 254, + 1604, + 317, + 9966, + 13, + 100001 + ], + "generated_token_ids_sha256": "f41032a4ec778feda5fc3818f94ddc41b5eb4f71172f4b0a220541bc692d49b4", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " To determine if a number is prime, we need to check if it has any divisors other than 1 and itself. A prime number is defined as a number greater than 1 that has no positive divisors other than 1 and itself.\n\nHere's the implementation of the `is_prime` function:\n\n```python\ndef is_prime(n):\n \"\"\"Return true if a given number is prime, and false otherwise.\"\"\"\n # A prime number is greater than 1\n if n <= 1:\n return False\n # 0 and 1 are not prime\n if n <= 3:\n return True\n # Multiples of 2 and 3 are not prime\n if n % 2 == 0 or n % 3 == 0:\n return False\n # Check for divisors from 5 to the square root of n\n i = 5\n while i * i <= n:\n if n % i == 0 or n % (i + 2) == 0:\n return False\n i += 6\n return True\n```\n\nThis function first checks if the number is less than or equal to 1, in which case it is not prime. It then checks if the number is 2 or 3, in which case it is prime. For larger numbers, it checks divisibility by 2 and 3, and then checks for possible divisors starting from 5 up to the square root of the number. If a divisor is found, the function returns `False`. If no divisors are found, the function returns `True`, indicating that the number is prime.", + "text_sha256": "de4736f67189b059194499a3bf15cc1bd75cb44c68285d47dbd8063b6603a451", + "task_score": { + "candidate_sha256": "122b3a6829e529fa11072d2109aeffa728fd53573b3abcdb94dd23259c740f93", + "python_ast_parse": true, + "parse_error": null, + "code_executed": false + } + }, + { + "condition": "s1_period", + "factors": { + "system": 1, + "history": "filler", + "boundary": "period", + "token_class": "ordinary_control" + }, + "prompt_tokens": 161, + "left_padding_tokens": 0, + "prompt_token_ids_sha256": "60e9d47943e9ba8869476dcc61e1a943b7e2dcf88d1d7334c44267baa5a8fd5f", + "generated_tokens": 59, + "generated_token_ids": [ + 977, + 317, + 62, + 6620, + 7, + 77, + 1780, + 185, + 300, + 565, + 291, + 459, + 207, + 17, + 25, + 185, + 391, + 972, + 14687, + 185, + 300, + 327, + 460, + 279, + 3169, + 7, + 17, + 11, + 1098, + 7, + 77, + 746, + 15, + 13, + 20, + 8, + 919, + 207, + 16, + 1780, + 185, + 391, + 565, + 291, + 3028, + 460, + 2318, + 207, + 15, + 25, + 185, + 595, + 972, + 14687, + 185, + 300, + 972, + 10491, + 100001 + ], + "generated_token_ids_sha256": "5cc9c902a87c82327d846c4c6298e61a9d3fddfa00127c92e699bc5bfc3e87ac", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " def is_prime(n):\n if n < 2:\n return False\n for i in range(2, int(n**0.5) + 1):\n if n % i == 0:\n return False\n return True", + "text_sha256": "a0f2b66062d9a781aed1e410e9263412406b1ecc6c3fb51a89e82c6d3022221a", + "task_score": { + "candidate_sha256": "28f166261950fa956e299a50872f539d490af163c1b0fb6d316d346fd7644685", + "python_ast_parse": true, + "parse_error": null, + "code_executed": false + } + } + ] + }, + { + "id": "gsm8k/test/1069", + "domain": "math", + "label": "Grade-school math", + "within_domain_index": 0, + "selection_rank": "000946b459ce33a645f403b9d781a7aefd81f5568412149f4588381fed55b1d7", + "source_text_sha256": "0cc2ca2bdd6ee8d664eb1197e8020bac71c25ba0ce52d813fc4adbf08df22378", + "source_characters": 522, + "source_tokens": 107, + "prompt_tokens_by_condition": { + "s0_eos": 131, + "s1_eos": 147, + "s0_bos": 131, + "s1_bos": 147, + "s0_x": 131, + "s1_x": 147, + "s0_period": 131, + "s1_period": 147 + }, + "batch_prompt_tokens_after_left_padding": 147, + "batch_padding_side": "left", + "batch_conditions": 8, + "generation_seconds": 47.22144840899273, + "peak_cuda_memory_allocated_bytes": 29508014592, + "generated_tokens_including_batch_padding": 1704, + "outputs": [ + { + "condition": "s0_eos", + "factors": { + "system": 0, + "history": "filler", + "boundary": "eos", + "token_class": "special" + }, + "prompt_tokens": 131, + "left_padding_tokens": 16, + "prompt_token_ids_sha256": "af8148f2dd065587b6d5a13e8fe115de24ccbdaa6dacd40254d522b17c1ff83b", + "generated_tokens": 213, + "generated_token_ids": [ + 2195, + 1063, + 60522, + 20570, + 56543, + 207, + 17, + 15, + 29120, + 327, + 9746, + 13, + 185, + 10005, + 15122, + 438, + 13552, + 207, + 17, + 15, + 19121, + 280, + 33732, + 11384, + 13, + 185, + 3139, + 11, + 254, + 3223, + 3744, + 280, + 33732, + 11384, + 344, + 438, + 56543, + 317, + 207, + 17, + 15, + 29120, + 575, + 207, + 17, + 15, + 19121, + 14, + 652, + 2440, + 403, + 207, + 19, + 15, + 15, + 19121, + 13, + 185, + 185, + 12201, + 3821, + 1166, + 254, + 29120, + 661, + 31334, + 11, + 2195, + 1063, + 60522, + 20570, + 2149, + 254, + 4921, + 344, + 245, + 8404, + 280, + 254, + 1604, + 280, + 284, + 256, + 2228, + 56543, + 327, + 9746, + 661, + 16666, + 28715, + 331, + 254, + 4559, + 285, + 1027, + 441, + 7908, + 254, + 33732, + 34317, + 276, + 254, + 20291, + 13, + 185, + 185, + 32, + 8404, + 280, + 254, + 1604, + 280, + 284, + 256, + 2228, + 56543, + 327, + 9746, + 317, + 207, + 16, + 14, + 19, + 575, + 207, + 17, + 15, + 29120, + 403, + 207, + 20, + 29120, + 13, + 185, + 185, + 6723, + 207, + 20, + 29120, + 1027, + 441, + 7908, + 704, + 207, + 20, + 29120, + 575, + 207, + 17, + 15, + 19121, + 14, + 652, + 2440, + 403, + 207, + 16, + 15, + 15, + 19121, + 280, + 33732, + 11384, + 13, + 185, + 185, + 3139, + 11, + 254, + 3223, + 3744, + 280, + 33732, + 11384, + 344, + 6889, + 254, + 20291, + 344, + 1492, + 317, + 207, + 19, + 15, + 15, + 19121, + 570, + 207, + 16, + 15, + 15, + 19121, + 403, + 207, + 18, + 15, + 15, + 19121, + 13, + 185, + 185, + 3139, + 254, + 3510, + 317, + 628, + 63962, + 90, + 18, + 15, + 15, + 3013, + 100001 + ], + "generated_token_ids_sha256": "a0c4de5c6c0c4969c0afed16c01332c372d253d54f6567899c51b9cb7cabf19a", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " Mr Hezekiah dispatched 20 trucks for delivery.\nEach truck was carrying 20 tons of fertiliser.\nSo, the total amount of fertiliser that was dispatched is 20 trucks * 20 tons/truck = 400 tons.\n\nTwo hours after the trucks had departed, Mr Hezekiah got the news that a quarter of the number of lorries dispatched for delivery had mechanical failures on the road and could not deliver the fertilisers to the farmers.\n\nA quarter of the number of lorries dispatched for delivery is 1/4 * 20 trucks = 5 trucks.\n\nThese 5 trucks could not deliver their 5 trucks * 20 tons/truck = 100 tons of fertiliser.\n\nSo, the total amount of fertiliser that reached the farmers that day is 400 tons - 100 tons = 300 tons.\n\nSo the answer is $\\boxed{300}$.", + "text_sha256": "4d8fe3fdd2261d4523c8736a0f065cf8e209595cc2a2f19448a3b35cab3c9c3c", + "task_score": { + "gold_final": "300", + "predicted_final": "300", + "final_numeric_exact": true + } + }, + { + "condition": "s1_eos", + "factors": { + "system": 1, + "history": "filler", + "boundary": "eos", + "token_class": "special" + }, + "prompt_tokens": 147, + "left_padding_tokens": 0, + "prompt_token_ids_sha256": "6fc9f186b31f6926a443a0d8218e5e92ff09af381a872054c954792ca2d2204f", + "generated_tokens": 213, + "generated_token_ids": [ + 2195, + 1063, + 60522, + 20570, + 56543, + 207, + 17, + 15, + 29120, + 327, + 9746, + 13, + 185, + 10005, + 15122, + 438, + 13552, + 207, + 17, + 15, + 19121, + 280, + 33732, + 11384, + 13, + 185, + 3139, + 11, + 254, + 3223, + 3744, + 280, + 33732, + 11384, + 344, + 438, + 56543, + 317, + 207, + 17, + 15, + 29120, + 575, + 207, + 17, + 15, + 19121, + 14, + 652, + 2440, + 403, + 207, + 19, + 15, + 15, + 19121, + 13, + 185, + 185, + 12201, + 3821, + 1166, + 254, + 29120, + 661, + 31334, + 11, + 2195, + 1063, + 60522, + 20570, + 2149, + 254, + 4921, + 344, + 245, + 8404, + 280, + 254, + 1604, + 280, + 284, + 256, + 2228, + 56543, + 327, + 9746, + 661, + 16666, + 28715, + 331, + 254, + 4559, + 285, + 1027, + 441, + 7908, + 254, + 33732, + 34317, + 276, + 254, + 20291, + 13, + 185, + 185, + 32, + 8404, + 280, + 254, + 1604, + 280, + 284, + 256, + 2228, + 56543, + 327, + 9746, + 317, + 207, + 16, + 14, + 19, + 575, + 207, + 17, + 15, + 29120, + 403, + 207, + 20, + 29120, + 13, + 185, + 185, + 6723, + 207, + 20, + 29120, + 1027, + 441, + 7908, + 704, + 207, + 20, + 29120, + 575, + 207, + 17, + 15, + 19121, + 14, + 652, + 2440, + 403, + 207, + 16, + 15, + 15, + 19121, + 280, + 33732, + 11384, + 13, + 185, + 185, + 3139, + 11, + 254, + 3223, + 3744, + 280, + 33732, + 11384, + 344, + 6889, + 254, + 20291, + 344, + 1492, + 317, + 207, + 19, + 15, + 15, + 19121, + 570, + 207, + 16, + 15, + 15, + 19121, + 403, + 207, + 18, + 15, + 15, + 19121, + 13, + 185, + 185, + 3139, + 254, + 3510, + 317, + 628, + 63962, + 90, + 18, + 15, + 15, + 3013, + 100001 + ], + "generated_token_ids_sha256": "a0c4de5c6c0c4969c0afed16c01332c372d253d54f6567899c51b9cb7cabf19a", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " Mr Hezekiah dispatched 20 trucks for delivery.\nEach truck was carrying 20 tons of fertiliser.\nSo, the total amount of fertiliser that was dispatched is 20 trucks * 20 tons/truck = 400 tons.\n\nTwo hours after the trucks had departed, Mr Hezekiah got the news that a quarter of the number of lorries dispatched for delivery had mechanical failures on the road and could not deliver the fertilisers to the farmers.\n\nA quarter of the number of lorries dispatched for delivery is 1/4 * 20 trucks = 5 trucks.\n\nThese 5 trucks could not deliver their 5 trucks * 20 tons/truck = 100 tons of fertiliser.\n\nSo, the total amount of fertiliser that reached the farmers that day is 400 tons - 100 tons = 300 tons.\n\nSo the answer is $\\boxed{300}$.", + "text_sha256": "4d8fe3fdd2261d4523c8736a0f065cf8e209595cc2a2f19448a3b35cab3c9c3c", + "task_score": { + "gold_final": "300", + "predicted_final": "300", + "final_numeric_exact": true + } + }, + { + "condition": "s0_bos", + "factors": { + "system": 0, + "history": "filler", + "boundary": "bos", + "token_class": "special" + }, + "prompt_tokens": 131, + "left_padding_tokens": 16, + "prompt_token_ids_sha256": "24dd306a5686c350327c6a23c72a83fc0e9539674bb9956eb3527c68914b70cc", + "generated_tokens": 211, + "generated_token_ids": [ + 2195, + 1063, + 60522, + 20570, + 56543, + 207, + 17, + 15, + 29120, + 327, + 9746, + 13, + 185, + 10005, + 15122, + 438, + 13552, + 207, + 17, + 15, + 19121, + 280, + 33732, + 11384, + 13, + 185, + 3139, + 11, + 254, + 3223, + 3744, + 280, + 33732, + 11384, + 56543, + 438, + 207, + 17, + 15, + 29120, + 575, + 207, + 17, + 15, + 19121, + 14, + 652, + 2440, + 403, + 207, + 19, + 15, + 15, + 19121, + 13, + 185, + 185, + 12201, + 3821, + 1166, + 254, + 29120, + 661, + 31334, + 11, + 2195, + 1063, + 60522, + 20570, + 2149, + 254, + 4921, + 344, + 245, + 8404, + 280, + 254, + 1604, + 280, + 284, + 256, + 2228, + 56543, + 327, + 9746, + 661, + 16666, + 28715, + 331, + 254, + 4559, + 285, + 1027, + 441, + 7908, + 254, + 33732, + 34317, + 276, + 254, + 20291, + 13, + 185, + 185, + 32, + 8404, + 280, + 254, + 1604, + 280, + 284, + 256, + 2228, + 56543, + 327, + 9746, + 317, + 207, + 16, + 14, + 19, + 575, + 207, + 17, + 15, + 29120, + 403, + 207, + 20, + 29120, + 13, + 185, + 185, + 6723, + 207, + 20, + 29120, + 1027, + 441, + 7908, + 704, + 207, + 20, + 29120, + 575, + 207, + 17, + 15, + 19121, + 14, + 652, + 2440, + 403, + 207, + 16, + 15, + 15, + 19121, + 280, + 33732, + 11384, + 13, + 185, + 185, + 3139, + 11, + 254, + 3223, + 3744, + 280, + 33732, + 11384, + 344, + 6889, + 254, + 20291, + 344, + 1492, + 438, + 207, + 19, + 15, + 15, + 19121, + 570, + 207, + 16, + 15, + 15, + 19121, + 403, + 207, + 18, + 15, + 15, + 19121, + 13, + 185, + 185, + 3139, + 254, + 3510, + 317, + 628, + 63962, + 90, + 18, + 15, + 15, + 3013, + 100001 + ], + "generated_token_ids_sha256": "b738f6a3caaffcb4c50909ea3ccdaed5844ea82db16e73baffffa214396623b7", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " Mr Hezekiah dispatched 20 trucks for delivery.\nEach truck was carrying 20 tons of fertiliser.\nSo, the total amount of fertiliser dispatched was 20 trucks * 20 tons/truck = 400 tons.\n\nTwo hours after the trucks had departed, Mr Hezekiah got the news that a quarter of the number of lorries dispatched for delivery had mechanical failures on the road and could not deliver the fertilisers to the farmers.\n\nA quarter of the number of lorries dispatched for delivery is 1/4 * 20 trucks = 5 trucks.\n\nThese 5 trucks could not deliver their 5 trucks * 20 tons/truck = 100 tons of fertiliser.\n\nSo, the total amount of fertiliser that reached the farmers that day was 400 tons - 100 tons = 300 tons.\n\nSo the answer is $\\boxed{300}$.", + "text_sha256": "ac292517068f24a3c029f08cc0d9d70edcfd32b845825ad0a466af0980cb6ead", + "task_score": { + "gold_final": "300", + "predicted_final": "300", + "final_numeric_exact": true + } + }, + { + "condition": "s1_bos", + "factors": { + "system": 1, + "history": "filler", + "boundary": "bos", + "token_class": "special" + }, + "prompt_tokens": 147, + "left_padding_tokens": 0, + "prompt_token_ids_sha256": "9fb414bf7d783b9126038381d3d05e6c636a850ff5ce0c31e436a722dc0d9eba", + "generated_tokens": 192, + "generated_token_ids": [ + 2195, + 1063, + 60522, + 20570, + 56543, + 207, + 17, + 15, + 29120, + 327, + 9746, + 13, + 185, + 10005, + 15122, + 438, + 13552, + 207, + 17, + 15, + 19121, + 280, + 33732, + 11384, + 13, + 185, + 3139, + 11, + 254, + 3223, + 3744, + 280, + 33732, + 11384, + 56543, + 438, + 207, + 17, + 15, + 29120, + 575, + 207, + 17, + 15, + 19121, + 14, + 652, + 2440, + 403, + 207, + 19, + 15, + 15, + 19121, + 13, + 185, + 185, + 12201, + 3821, + 1166, + 254, + 29120, + 661, + 31334, + 11, + 245, + 8404, + 280, + 254, + 1604, + 280, + 284, + 256, + 2228, + 56543, + 327, + 9746, + 661, + 16666, + 28715, + 13, + 185, + 1567, + 2456, + 344, + 207, + 16, + 14, + 19, + 575, + 207, + 17, + 15, + 29120, + 403, + 207, + 20, + 29120, + 661, + 16666, + 28715, + 13, + 185, + 185, + 549, + 29120, + 344, + 1216, + 441, + 463, + 16666, + 28715, + 778, + 207, + 17, + 15, + 29120, + 570, + 207, + 20, + 29120, + 403, + 207, + 16, + 20, + 29120, + 13, + 185, + 185, + 6723, + 207, + 16, + 20, + 29120, + 778, + 2249, + 276, + 7908, + 254, + 33732, + 34317, + 276, + 254, + 20291, + 13, + 185, + 3139, + 11, + 254, + 3223, + 3744, + 280, + 33732, + 11384, + 344, + 6889, + 254, + 20291, + 438, + 207, + 16, + 20, + 29120, + 575, + 207, + 17, + 15, + 19121, + 14, + 652, + 2440, + 403, + 207, + 18, + 15, + 15, + 19121, + 13, + 185, + 185, + 3139, + 254, + 3510, + 317, + 628, + 63962, + 90, + 18, + 15, + 15, + 3013, + 100001 + ], + "generated_token_ids_sha256": "55777717b0868223d1ea198ec487f5fc8594b132b9802458ac8258ace944894b", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " Mr Hezekiah dispatched 20 trucks for delivery.\nEach truck was carrying 20 tons of fertiliser.\nSo, the total amount of fertiliser dispatched was 20 trucks * 20 tons/truck = 400 tons.\n\nTwo hours after the trucks had departed, a quarter of the number of lorries dispatched for delivery had mechanical failures.\nThis means that 1/4 * 20 trucks = 5 trucks had mechanical failures.\n\nThe trucks that did not have mechanical failures were 20 trucks - 5 trucks = 15 trucks.\n\nThese 15 trucks were able to deliver the fertilisers to the farmers.\nSo, the total amount of fertiliser that reached the farmers was 15 trucks * 20 tons/truck = 300 tons.\n\nSo the answer is $\\boxed{300}$.", + "text_sha256": "c4c5873b576c645844d6dc3be7116075f14516f5f9e6373b20e46c341a51cf51", + "task_score": { + "gold_final": "300", + "predicted_final": "300", + "final_numeric_exact": true + } + }, + { + "condition": "s0_x", + "factors": { + "system": 0, + "history": "filler", + "boundary": "x", + "token_class": "ordinary_control" + }, + "prompt_tokens": 131, + "left_padding_tokens": 16, + "prompt_token_ids_sha256": "649621b617e9d4e0eeb4cd1bfa2abde7beba97e78de3598f23447098686b2252", + "generated_tokens": 184, + "generated_token_ids": [ + 2195, + 1063, + 60522, + 20570, + 56543, + 207, + 17, + 15, + 29120, + 327, + 9746, + 13, + 185, + 10005, + 15122, + 438, + 13552, + 207, + 17, + 15, + 19121, + 280, + 33732, + 11384, + 13, + 185, + 3139, + 11, + 254, + 3223, + 3744, + 280, + 33732, + 11384, + 344, + 438, + 8548, + 276, + 330, + 11803, + 438, + 207, + 17, + 15, + 29120, + 575, + 207, + 17, + 15, + 19121, + 14, + 652, + 2440, + 403, + 207, + 19, + 15, + 15, + 19121, + 13, + 185, + 185, + 6501, + 11, + 245, + 8404, + 280, + 254, + 29120, + 661, + 16666, + 28715, + 285, + 1027, + 441, + 7908, + 254, + 33732, + 34317, + 13, + 185, + 3139, + 11, + 254, + 1604, + 280, + 29120, + 344, + 661, + 16666, + 28715, + 317, + 207, + 17, + 15, + 29120, + 893, + 207, + 19, + 403, + 207, + 20, + 29120, + 13, + 185, + 185, + 6723, + 207, + 20, + 29120, + 778, + 8548, + 276, + 7908, + 207, + 20, + 29120, + 575, + 207, + 17, + 15, + 19121, + 14, + 652, + 2440, + 403, + 207, + 16, + 15, + 15, + 19121, + 280, + 33732, + 11384, + 13, + 185, + 185, + 14494, + 11, + 254, + 3223, + 3744, + 280, + 33732, + 11384, + 344, + 6889, + 254, + 20291, + 344, + 1492, + 438, + 207, + 19, + 15, + 15, + 19121, + 570, + 207, + 16, + 15, + 15, + 19121, + 403, + 207, + 18, + 15, + 15, + 19121, + 13, + 185, + 185, + 3139, + 254, + 3510, + 317, + 628, + 63962, + 90, + 18, + 15, + 15, + 3013, + 100001 + ], + "generated_token_ids_sha256": "4c98c4e91046a2a824091a214e088a761f6ae68023ce6fe04e125539c60882a4", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " Mr Hezekiah dispatched 20 trucks for delivery.\nEach truck was carrying 20 tons of fertiliser.\nSo, the total amount of fertiliser that was supposed to be delivered was 20 trucks * 20 tons/truck = 400 tons.\n\nHowever, a quarter of the trucks had mechanical failures and could not deliver the fertilisers.\nSo, the number of trucks that had mechanical failures is 20 trucks / 4 = 5 trucks.\n\nThese 5 trucks were supposed to deliver 5 trucks * 20 tons/truck = 100 tons of fertiliser.\n\nTherefore, the total amount of fertiliser that reached the farmers that day was 400 tons - 100 tons = 300 tons.\n\nSo the answer is $\\boxed{300}$.", + "text_sha256": "84282454ce6b5b1416b2183303027126d577e0e1e93b62181dbf925922cca498", + "task_score": { + "gold_final": "300", + "predicted_final": "300", + "final_numeric_exact": true + } + }, + { + "condition": "s1_x", + "factors": { + "system": 1, + "history": "filler", + "boundary": "x", + "token_class": "ordinary_control" + }, + "prompt_tokens": 147, + "left_padding_tokens": 0, + "prompt_token_ids_sha256": "a846fa2918690d92f2ebda2b3478d1c61be06006d33f21cc62b46e565398da36", + "generated_tokens": 112, + "generated_token_ids": [ + 2195, + 1063, + 60522, + 20570, + 56543, + 207, + 17, + 15, + 29120, + 11, + 548, + 245, + 8404, + 280, + 768, + 661, + 16666, + 28715, + 13, + 338, + 8404, + 280, + 207, + 17, + 15, + 317, + 207, + 17, + 15, + 14, + 19, + 403, + 207, + 20, + 29120, + 13, + 185, + 3139, + 11, + 207, + 17, + 15, + 570, + 207, + 20, + 403, + 207, + 16, + 20, + 29120, + 778, + 2249, + 276, + 7908, + 254, + 33732, + 34317, + 276, + 254, + 20291, + 13, + 185, + 10005, + 15122, + 438, + 13552, + 207, + 17, + 15, + 19121, + 280, + 33732, + 11384, + 11, + 558, + 254, + 3223, + 1604, + 280, + 19121, + 280, + 33732, + 11384, + 344, + 6889, + 254, + 20291, + 317, + 207, + 16, + 20, + 575, + 207, + 17, + 15, + 403, + 207, + 18, + 15, + 15, + 19121, + 13, + 185, + 549, + 3510, + 317, + 25, + 207, + 18, + 15, + 15, + 100001 + ], + "generated_token_ids_sha256": "38b791aa6f593bb8cc65ab6404ad8b9b9f4026d1f667701d06b7c88597ee07dd", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " Mr Hezekiah dispatched 20 trucks, but a quarter of them had mechanical failures. A quarter of 20 is 20/4 = 5 trucks.\nSo, 20 - 5 = 15 trucks were able to deliver the fertilisers to the farmers.\nEach truck was carrying 20 tons of fertiliser, so the total number of tons of fertiliser that reached the farmers is 15 * 20 = 300 tons.\nThe answer is: 300", + "text_sha256": "79ea0183839c01a5e4e2f93ebc4e65ebfa7c47b626ae808efe0bac0fdf7380b2", + "task_score": { + "gold_final": "300", + "predicted_final": "300", + "final_numeric_exact": true + } + }, + { + "condition": "s0_period", + "factors": { + "system": 0, + "history": "filler", + "boundary": "period", + "token_class": "ordinary_control" + }, + "prompt_tokens": 131, + "left_padding_tokens": 16, + "prompt_token_ids_sha256": "c9871468f54fb12742eb484332b45383b61d6ba4fc0250e2f2d929165251b35b", + "generated_tokens": 194, + "generated_token_ids": [ + 2195, + 1063, + 60522, + 20570, + 56543, + 207, + 17, + 15, + 29120, + 327, + 9746, + 13, + 185, + 10005, + 15122, + 438, + 13552, + 207, + 17, + 15, + 19121, + 280, + 33732, + 11384, + 13, + 185, + 3139, + 11, + 254, + 3223, + 3744, + 280, + 33732, + 11384, + 344, + 438, + 56543, + 317, + 207, + 17, + 15, + 29120, + 575, + 207, + 17, + 15, + 19121, + 14, + 652, + 2440, + 403, + 207, + 19, + 15, + 15, + 19121, + 13, + 185, + 185, + 12201, + 3821, + 1166, + 254, + 29120, + 661, + 31334, + 11, + 245, + 8404, + 280, + 254, + 1604, + 280, + 284, + 256, + 2228, + 56543, + 327, + 9746, + 661, + 16666, + 28715, + 13, + 185, + 1567, + 2456, + 344, + 207, + 16, + 14, + 19, + 575, + 207, + 17, + 15, + 29120, + 403, + 207, + 20, + 29120, + 661, + 16666, + 28715, + 13, + 185, + 185, + 549, + 29120, + 344, + 1216, + 441, + 463, + 16666, + 28715, + 778, + 207, + 17, + 15, + 29120, + 570, + 207, + 20, + 29120, + 403, + 207, + 16, + 20, + 29120, + 13, + 185, + 185, + 6723, + 207, + 16, + 20, + 29120, + 778, + 2249, + 276, + 7908, + 254, + 33732, + 34317, + 276, + 254, + 20291, + 13, + 185, + 3139, + 11, + 254, + 3223, + 3744, + 280, + 33732, + 11384, + 344, + 6889, + 254, + 20291, + 317, + 207, + 16, + 20, + 29120, + 575, + 207, + 17, + 15, + 19121, + 14, + 652, + 2440, + 403, + 207, + 18, + 15, + 15, + 19121, + 13, + 185, + 185, + 3139, + 254, + 3510, + 317, + 628, + 63962, + 90, + 18, + 15, + 15, + 3013, + 100001 + ], + "generated_token_ids_sha256": "856bc8e1e2434f61ca08f9dbb492b079dd8e2c05ddefb24cc992f2dec5bb328b", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " Mr Hezekiah dispatched 20 trucks for delivery.\nEach truck was carrying 20 tons of fertiliser.\nSo, the total amount of fertiliser that was dispatched is 20 trucks * 20 tons/truck = 400 tons.\n\nTwo hours after the trucks had departed, a quarter of the number of lorries dispatched for delivery had mechanical failures.\nThis means that 1/4 * 20 trucks = 5 trucks had mechanical failures.\n\nThe trucks that did not have mechanical failures were 20 trucks - 5 trucks = 15 trucks.\n\nThese 15 trucks were able to deliver the fertilisers to the farmers.\nSo, the total amount of fertiliser that reached the farmers is 15 trucks * 20 tons/truck = 300 tons.\n\nSo the answer is $\\boxed{300}$.", + "text_sha256": "aeb498f00b41e408290a9d50299a1591c11c03e6c77d2de1d01bd6f29321b93a", + "task_score": { + "gold_final": "300", + "predicted_final": "300", + "final_numeric_exact": true + } + }, + { + "condition": "s1_period", + "factors": { + "system": 1, + "history": "filler", + "boundary": "period", + "token_class": "ordinary_control" + }, + "prompt_tokens": 147, + "left_padding_tokens": 0, + "prompt_token_ids_sha256": "c2f1b1ae4a81b97e603806b23729d92b118bc3de70c647ae0d91c62f6b6912cc", + "generated_tokens": 192, + "generated_token_ids": [ + 2195, + 1063, + 60522, + 20570, + 56543, + 207, + 17, + 15, + 29120, + 11, + 1319, + 13552, + 207, + 17, + 15, + 19121, + 280, + 33732, + 11384, + 13, + 2086, + 11, + 254, + 3223, + 3744, + 280, + 33732, + 11384, + 56543, + 317, + 207, + 17, + 15, + 29120, + 575, + 207, + 17, + 15, + 19121, + 14, + 652, + 2440, + 403, + 207, + 19, + 15, + 15, + 19121, + 13, + 185, + 185, + 12201, + 3821, + 1166, + 254, + 29120, + 661, + 31334, + 11, + 245, + 8404, + 280, + 254, + 1604, + 280, + 284, + 256, + 2228, + 56543, + 327, + 9746, + 661, + 16666, + 28715, + 13, + 1002, + 2456, + 207, + 16, + 14, + 19, + 575, + 207, + 17, + 15, + 29120, + 403, + 207, + 20, + 29120, + 661, + 16666, + 28715, + 13, + 185, + 185, + 7094, + 1069, + 207, + 20, + 29120, + 661, + 16666, + 28715, + 11, + 657, + 1027, + 441, + 7908, + 254, + 33732, + 34317, + 276, + 254, + 20291, + 13, + 7536, + 11, + 254, + 3223, + 3744, + 280, + 33732, + 11384, + 344, + 6889, + 254, + 20291, + 317, + 207, + 19, + 15, + 15, + 19121, + 570, + 207, + 20, + 29120, + 575, + 207, + 17, + 15, + 19121, + 14, + 652, + 2440, + 403, + 207, + 19, + 15, + 15, + 19121, + 570, + 207, + 16, + 15, + 15, + 19121, + 403, + 207, + 18, + 15, + 15, + 19121, + 13, + 185, + 185, + 3139, + 11, + 254, + 3223, + 1604, + 280, + 19121, + 280, + 33732, + 11384, + 344, + 6889, + 254, + 20291, + 344, + 1492, + 317, + 628, + 63962, + 90, + 18, + 15, + 15, + 3013, + 100001 + ], + "generated_token_ids_sha256": "338c0ec1841319140ecf9bd5c7416a581dbd88786a5044ada648010791ebcfc1", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " Mr Hezekiah dispatched 20 trucks, each carrying 20 tons of fertiliser. So, the total amount of fertiliser dispatched is 20 trucks * 20 tons/truck = 400 tons.\n\nTwo hours after the trucks had departed, a quarter of the number of lorries dispatched for delivery had mechanical failures. This means 1/4 * 20 trucks = 5 trucks had mechanical failures.\n\nSince these 5 trucks had mechanical failures, they could not deliver the fertilisers to the farmers. Therefore, the total amount of fertiliser that reached the farmers is 400 tons - 5 trucks * 20 tons/truck = 400 tons - 100 tons = 300 tons.\n\nSo, the total number of tons of fertiliser that reached the farmers that day is $\\boxed{300}$.", + "text_sha256": "d9d4408fa27b8aa6f41cb3741927117dd7b4be0b70e085c0efa202769811258e", + "task_score": { + "gold_final": "300", + "predicted_final": "300", + "final_numeric_exact": true + } + } + ] + } + ], + "summary": { + "pairwise": { + "system_eos": [ + { + "left": "s0_eos", + "right": "s1_eos", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 63, + "token_edit_distance": 306, + "normalized_token_similarity": 0.3390928725701944, + "source_id": "wikitext2/raw-validation/0443", + "domain": "english" + }, + { + "left": "s0_eos", + "right": "s1_eos", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 4, + "token_edit_distance": 74, + "normalized_token_similarity": 0.2210526315789474, + "source_id": "tnews/test/4855", + "domain": "chinese" + }, + { + "left": "s0_eos", + "right": "s1_eos", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 1, + "token_edit_distance": 308, + "normalized_token_similarity": 0.22418136020151136, + "source_id": "HumanEval/31", + "domain": "code" + }, + { + "left": "s0_eos", + "right": "s1_eos", + "token_ids_exact": true, + "text_exact": true, + "common_prefix_tokens": 213, + "token_edit_distance": 0, + "normalized_token_similarity": 1.0, + "source_id": "gsm8k/test/1069", + "domain": "math" + } + ], + "system_bos": [ + { + "left": "s0_bos", + "right": "s1_bos", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 0, + "token_edit_distance": 446, + "normalized_token_similarity": 0.12890625, + "source_id": "wikitext2/raw-validation/0443", + "domain": "english" + }, + { + "left": "s0_bos", + "right": "s1_bos", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 4, + "token_edit_distance": 63, + "normalized_token_similarity": 0.37, + "source_id": "tnews/test/4855", + "domain": "chinese" + }, + { + "left": "s0_bos", + "right": "s1_bos", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 1, + "token_edit_distance": 322, + "normalized_token_similarity": 0.2184466019417476, + "source_id": "HumanEval/31", + "domain": "code" + }, + { + "left": "s0_bos", + "right": "s1_bos", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 65, + "token_edit_distance": 83, + "normalized_token_similarity": 0.6066350710900474, + "source_id": "gsm8k/test/1069", + "domain": "math" + } + ], + "system_x": [ + { + "left": "s0_x", + "right": "s1_x", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 6, + "token_edit_distance": 343, + "normalized_token_similarity": 0.22747747747747749, + "source_id": "wikitext2/raw-validation/0443", + "domain": "english" + }, + { + "left": "s0_x", + "right": "s1_x", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 4, + "token_edit_distance": 82, + "normalized_token_similarity": 0.2743362831858407, + "source_id": "tnews/test/4855", + "domain": "chinese" + }, + { + "left": "s0_x", + "right": "s1_x", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 0, + "token_edit_distance": 359, + "normalized_token_similarity": 0.1631701631701632, + "source_id": "HumanEval/31", + "domain": "code" + }, + { + "left": "s0_x", + "right": "s1_x", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 9, + "token_edit_distance": 118, + "normalized_token_similarity": 0.3586956521739131, + "source_id": "gsm8k/test/1069", + "domain": "math" + } + ], + "system_period": [ + { + "left": "s0_period", + "right": "s1_period", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 6, + "token_edit_distance": 376, + "normalized_token_similarity": 0.15883668903803128, + "source_id": "wikitext2/raw-validation/0443", + "domain": "english" + }, + { + "left": "s0_period", + "right": "s1_period", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 4, + "token_edit_distance": 101, + "normalized_token_similarity": 0.1367521367521367, + "source_id": "tnews/test/4855", + "domain": "chinese" + }, + { + "left": "s0_period", + "right": "s1_period", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 0, + "token_edit_distance": 314, + "normalized_token_similarity": 0.11549295774647883, + "source_id": "HumanEval/31", + "domain": "code" + }, + { + "left": "s0_period", + "right": "s1_period", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 9, + "token_edit_distance": 78, + "normalized_token_similarity": 0.5979381443298969, + "source_id": "gsm8k/test/1069", + "domain": "math" + } + ], + "bos_at_s0": [ + { + "left": "s0_eos", + "right": "s0_bos", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 0, + "token_edit_distance": 449, + "normalized_token_similarity": 0.123046875, + "source_id": "wikitext2/raw-validation/0443", + "domain": "english" + }, + { + "left": "s0_eos", + "right": "s0_bos", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 21, + "token_edit_distance": 69, + "normalized_token_similarity": 0.31000000000000005, + "source_id": "tnews/test/4855", + "domain": "chinese" + }, + { + "left": "s0_eos", + "right": "s0_bos", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 248, + "token_edit_distance": 43, + "normalized_token_similarity": 0.8956310679611651, + "source_id": "HumanEval/31", + "domain": "code" + }, + { + "left": "s0_eos", + "right": "s0_bos", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 34, + "token_edit_distance": 4, + "normalized_token_similarity": 0.9812206572769953, + "source_id": "gsm8k/test/1069", + "domain": "math" + } + ], + "bos_at_s1": [ + { + "left": "s1_eos", + "right": "s1_bos", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 1, + "token_edit_distance": 301, + "normalized_token_similarity": 0.14, + "source_id": "wikitext2/raw-validation/0443", + "domain": "english" + }, + { + "left": "s1_eos", + "right": "s1_bos", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 11, + "token_edit_distance": 60, + "normalized_token_similarity": 0.368421052631579, + "source_id": "tnews/test/4855", + "domain": "chinese" + }, + { + "left": "s1_eos", + "right": "s1_bos", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 28, + "token_edit_distance": 9, + "normalized_token_similarity": 0.9720496894409938, + "source_id": "HumanEval/31", + "domain": "code" + }, + { + "left": "s1_eos", + "right": "s1_bos", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 34, + "token_edit_distance": 87, + "normalized_token_similarity": 0.5915492957746479, + "source_id": "gsm8k/test/1069", + "domain": "math" + } + ], + "x_at_s0": [ + { + "left": "s0_eos", + "right": "s0_x", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 23, + "token_edit_distance": 373, + "normalized_token_similarity": 0.1943844492440605, + "source_id": "wikitext2/raw-validation/0443", + "domain": "english" + }, + { + "left": "s0_eos", + "right": "s0_x", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 5, + "token_edit_distance": 77, + "normalized_token_similarity": 0.31858407079646023, + "source_id": "tnews/test/4855", + "domain": "chinese" + }, + { + "left": "s0_eos", + "right": "s0_x", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 1, + "token_edit_distance": 290, + "normalized_token_similarity": 0.32400932400932403, + "source_id": "HumanEval/31", + "domain": "code" + }, + { + "left": "s0_eos", + "right": "s0_x", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 36, + "token_edit_distance": 57, + "normalized_token_similarity": 0.7323943661971831, + "source_id": "gsm8k/test/1069", + "domain": "math" + } + ], + "x_at_s1": [ + { + "left": "s1_eos", + "right": "s1_x", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 6, + "token_edit_distance": 250, + "normalized_token_similarity": 0.2857142857142857, + "source_id": "wikitext2/raw-validation/0443", + "domain": "english" + }, + { + "left": "s1_eos", + "right": "s1_x", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 9, + "token_edit_distance": 69, + "normalized_token_similarity": 0.27368421052631575, + "source_id": "tnews/test/4855", + "domain": "chinese" + }, + { + "left": "s1_eos", + "right": "s1_x", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 0, + "token_edit_distance": 251, + "normalized_token_similarity": 0.22049689440993792, + "source_id": "HumanEval/31", + "domain": "code" + }, + { + "left": "s1_eos", + "right": "s1_x", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 9, + "token_edit_distance": 149, + "normalized_token_similarity": 0.3004694835680751, + "source_id": "gsm8k/test/1069", + "domain": "math" + } + ], + "period_at_s0": [ + { + "left": "s0_eos", + "right": "s0_period", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 23, + "token_edit_distance": 366, + "normalized_token_similarity": 0.20950323974082075, + "source_id": "wikitext2/raw-validation/0443", + "domain": "english" + }, + { + "left": "s0_eos", + "right": "s0_period", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 21, + "token_edit_distance": 35, + "normalized_token_similarity": 0.5138888888888888, + "source_id": "tnews/test/4855", + "domain": "chinese" + }, + { + "left": "s0_eos", + "right": "s0_period", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 1, + "token_edit_distance": 291, + "normalized_token_similarity": 0.2670025188916877, + "source_id": "HumanEval/31", + "domain": "code" + }, + { + "left": "s0_eos", + "right": "s0_period", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 67, + "token_edit_distance": 83, + "normalized_token_similarity": 0.6103286384976525, + "source_id": "gsm8k/test/1069", + "domain": "math" + } + ], + "period_at_s1": [ + { + "left": "s1_eos", + "right": "s1_period", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 6, + "token_edit_distance": 276, + "normalized_token_similarity": 0.2114285714285714, + "source_id": "wikitext2/raw-validation/0443", + "domain": "english" + }, + { + "left": "s1_eos", + "right": "s1_period", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 9, + "token_edit_distance": 85, + "normalized_token_similarity": 0.27350427350427353, + "source_id": "tnews/test/4855", + "domain": "chinese" + }, + { + "left": "s1_eos", + "right": "s1_period", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 0, + "token_edit_distance": 266, + "normalized_token_similarity": 0.17391304347826086, + "source_id": "HumanEval/31", + "domain": "code" + }, + { + "left": "s1_eos", + "right": "s1_period", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 9, + "token_edit_distance": 110, + "normalized_token_similarity": 0.4835680751173709, + "source_id": "gsm8k/test/1069", + "domain": "math" + } + ] + }, + "aggregates": { + "system_eos": { + "sources": 4, + "token_ids_exact": 1, + "text_exact": 1, + "mean_common_prefix_tokens": 70.25, + "mean_token_edit_distance": 172, + "mean_normalized_token_similarity": 0.4460817160876633 + }, + "system_bos": { + "sources": 4, + "token_ids_exact": 0, + "text_exact": 0, + "mean_common_prefix_tokens": 17.5, + "mean_token_edit_distance": 228.5, + "mean_normalized_token_similarity": 0.33099698075794876 + }, + "system_x": { + "sources": 4, + "token_ids_exact": 0, + "text_exact": 0, + "mean_common_prefix_tokens": 4.75, + "mean_token_edit_distance": 225.5, + "mean_normalized_token_similarity": 0.2559198940018486 + }, + "system_period": { + "sources": 4, + "token_ids_exact": 0, + "text_exact": 0, + "mean_common_prefix_tokens": 4.75, + "mean_token_edit_distance": 217.25, + "mean_normalized_token_similarity": 0.2522549819666359 + }, + "bos_at_s0": { + "sources": 4, + "token_ids_exact": 0, + "text_exact": 0, + "mean_common_prefix_tokens": 75.75, + "mean_token_edit_distance": 141.25, + "mean_normalized_token_similarity": 0.5774746500595401 + }, + "bos_at_s1": { + "sources": 4, + "token_ids_exact": 0, + "text_exact": 0, + "mean_common_prefix_tokens": 18.5, + "mean_token_edit_distance": 114.25, + "mean_normalized_token_similarity": 0.5180050094618052 + }, + "x_at_s0": { + "sources": 4, + "token_ids_exact": 0, + "text_exact": 0, + "mean_common_prefix_tokens": 16.25, + "mean_token_edit_distance": 199.25, + "mean_normalized_token_similarity": 0.39234305256175694 + }, + "x_at_s1": { + "sources": 4, + "token_ids_exact": 0, + "text_exact": 0, + "mean_common_prefix_tokens": 6, + "mean_token_edit_distance": 179.75, + "mean_normalized_token_similarity": 0.2700912185546536 + }, + "period_at_s0": { + "sources": 4, + "token_ids_exact": 0, + "text_exact": 0, + "mean_common_prefix_tokens": 28, + "mean_token_edit_distance": 193.75, + "mean_normalized_token_similarity": 0.4001808215047624 + }, + "period_at_s1": { + "sources": 4, + "token_ids_exact": 0, + "text_exact": 0, + "mean_common_prefix_tokens": 6, + "mean_token_edit_distance": 184.25, + "mean_normalized_token_similarity": 0.28560349088211917 + } + }, + "aggregates_by_domain": { + "english": { + "system_eos": { + "sources": 1, + "token_ids_exact": 0, + "text_exact": 0, + "mean_common_prefix_tokens": 63, + "mean_token_edit_distance": 306, + "mean_normalized_token_similarity": 0.3390928725701944 + }, + "system_bos": { + "sources": 1, + "token_ids_exact": 0, + "text_exact": 0, + "mean_common_prefix_tokens": 0, + "mean_token_edit_distance": 446, + "mean_normalized_token_similarity": 0.12890625 + }, + "system_x": { + "sources": 1, + "token_ids_exact": 0, + "text_exact": 0, + "mean_common_prefix_tokens": 6, + "mean_token_edit_distance": 343, + "mean_normalized_token_similarity": 0.22747747747747749 + }, + "system_period": { + "sources": 1, + "token_ids_exact": 0, + "text_exact": 0, + "mean_common_prefix_tokens": 6, + "mean_token_edit_distance": 376, + "mean_normalized_token_similarity": 0.15883668903803128 + }, + "bos_at_s0": { + "sources": 1, + "token_ids_exact": 0, + "text_exact": 0, + "mean_common_prefix_tokens": 0, + "mean_token_edit_distance": 449, + "mean_normalized_token_similarity": 0.123046875 + }, + "bos_at_s1": { + "sources": 1, + "token_ids_exact": 0, + "text_exact": 0, + "mean_common_prefix_tokens": 1, + "mean_token_edit_distance": 301, + "mean_normalized_token_similarity": 0.14 + }, + "x_at_s0": { + "sources": 1, + "token_ids_exact": 0, + "text_exact": 0, + "mean_common_prefix_tokens": 23, + "mean_token_edit_distance": 373, + "mean_normalized_token_similarity": 0.1943844492440605 + }, + "x_at_s1": { + "sources": 1, + "token_ids_exact": 0, + "text_exact": 0, + "mean_common_prefix_tokens": 6, + "mean_token_edit_distance": 250, + "mean_normalized_token_similarity": 0.2857142857142857 + }, + "period_at_s0": { + "sources": 1, + "token_ids_exact": 0, + "text_exact": 0, + "mean_common_prefix_tokens": 23, + "mean_token_edit_distance": 366, + "mean_normalized_token_similarity": 0.20950323974082075 + }, + "period_at_s1": { + "sources": 1, + "token_ids_exact": 0, + "text_exact": 0, + "mean_common_prefix_tokens": 6, + "mean_token_edit_distance": 276, + "mean_normalized_token_similarity": 0.2114285714285714 + } + }, + "chinese": { + "system_eos": { + "sources": 1, + "token_ids_exact": 0, + "text_exact": 0, + "mean_common_prefix_tokens": 4, + "mean_token_edit_distance": 74, + "mean_normalized_token_similarity": 0.2210526315789474 + }, + "system_bos": { + "sources": 1, + "token_ids_exact": 0, + "text_exact": 0, + "mean_common_prefix_tokens": 4, + "mean_token_edit_distance": 63, + "mean_normalized_token_similarity": 0.37 + }, + "system_x": { + "sources": 1, + "token_ids_exact": 0, + "text_exact": 0, + "mean_common_prefix_tokens": 4, + "mean_token_edit_distance": 82, + "mean_normalized_token_similarity": 0.2743362831858407 + }, + "system_period": { + "sources": 1, + "token_ids_exact": 0, + "text_exact": 0, + "mean_common_prefix_tokens": 4, + "mean_token_edit_distance": 101, + "mean_normalized_token_similarity": 0.1367521367521367 + }, + "bos_at_s0": { + "sources": 1, + "token_ids_exact": 0, + "text_exact": 0, + "mean_common_prefix_tokens": 21, + "mean_token_edit_distance": 69, + "mean_normalized_token_similarity": 0.31000000000000005 + }, + "bos_at_s1": { + "sources": 1, + "token_ids_exact": 0, + "text_exact": 0, + "mean_common_prefix_tokens": 11, + "mean_token_edit_distance": 60, + "mean_normalized_token_similarity": 0.368421052631579 + }, + "x_at_s0": { + "sources": 1, + "token_ids_exact": 0, + "text_exact": 0, + "mean_common_prefix_tokens": 5, + "mean_token_edit_distance": 77, + "mean_normalized_token_similarity": 0.31858407079646023 + }, + "x_at_s1": { + "sources": 1, + "token_ids_exact": 0, + "text_exact": 0, + "mean_common_prefix_tokens": 9, + "mean_token_edit_distance": 69, + "mean_normalized_token_similarity": 0.27368421052631575 + }, + "period_at_s0": { + "sources": 1, + "token_ids_exact": 0, + "text_exact": 0, + "mean_common_prefix_tokens": 21, + "mean_token_edit_distance": 35, + "mean_normalized_token_similarity": 0.5138888888888888 + }, + "period_at_s1": { + "sources": 1, + "token_ids_exact": 0, + "text_exact": 0, + "mean_common_prefix_tokens": 9, + "mean_token_edit_distance": 85, + "mean_normalized_token_similarity": 0.27350427350427353 + } + }, + "code": { + "system_eos": { + "sources": 1, + "token_ids_exact": 0, + "text_exact": 0, + "mean_common_prefix_tokens": 1, + "mean_token_edit_distance": 308, + "mean_normalized_token_similarity": 0.22418136020151136 + }, + "system_bos": { + "sources": 1, + "token_ids_exact": 0, + "text_exact": 0, + "mean_common_prefix_tokens": 1, + "mean_token_edit_distance": 322, + "mean_normalized_token_similarity": 0.2184466019417476 + }, + "system_x": { + "sources": 1, + "token_ids_exact": 0, + "text_exact": 0, + "mean_common_prefix_tokens": 0, + "mean_token_edit_distance": 359, + "mean_normalized_token_similarity": 0.1631701631701632 + }, + "system_period": { + "sources": 1, + "token_ids_exact": 0, + "text_exact": 0, + "mean_common_prefix_tokens": 0, + "mean_token_edit_distance": 314, + "mean_normalized_token_similarity": 0.11549295774647883 + }, + "bos_at_s0": { + "sources": 1, + "token_ids_exact": 0, + "text_exact": 0, + "mean_common_prefix_tokens": 248, + "mean_token_edit_distance": 43, + "mean_normalized_token_similarity": 0.8956310679611651 + }, + "bos_at_s1": { + "sources": 1, + "token_ids_exact": 0, + "text_exact": 0, + "mean_common_prefix_tokens": 28, + "mean_token_edit_distance": 9, + "mean_normalized_token_similarity": 0.9720496894409938 + }, + "x_at_s0": { + "sources": 1, + "token_ids_exact": 0, + "text_exact": 0, + "mean_common_prefix_tokens": 1, + "mean_token_edit_distance": 290, + "mean_normalized_token_similarity": 0.32400932400932403 + }, + "x_at_s1": { + "sources": 1, + "token_ids_exact": 0, + "text_exact": 0, + "mean_common_prefix_tokens": 0, + "mean_token_edit_distance": 251, + "mean_normalized_token_similarity": 0.22049689440993792 + }, + "period_at_s0": { + "sources": 1, + "token_ids_exact": 0, + "text_exact": 0, + "mean_common_prefix_tokens": 1, + "mean_token_edit_distance": 291, + "mean_normalized_token_similarity": 0.2670025188916877 + }, + "period_at_s1": { + "sources": 1, + "token_ids_exact": 0, + "text_exact": 0, + "mean_common_prefix_tokens": 0, + "mean_token_edit_distance": 266, + "mean_normalized_token_similarity": 0.17391304347826086 + } + }, + "math": { + "system_eos": { + "sources": 1, + "token_ids_exact": 1, + "text_exact": 1, + "mean_common_prefix_tokens": 213, + "mean_token_edit_distance": 0, + "mean_normalized_token_similarity": 1.0 + }, + "system_bos": { + "sources": 1, + "token_ids_exact": 0, + "text_exact": 0, + "mean_common_prefix_tokens": 65, + "mean_token_edit_distance": 83, + "mean_normalized_token_similarity": 0.6066350710900474 + }, + "system_x": { + "sources": 1, + "token_ids_exact": 0, + "text_exact": 0, + "mean_common_prefix_tokens": 9, + "mean_token_edit_distance": 118, + "mean_normalized_token_similarity": 0.3586956521739131 + }, + "system_period": { + "sources": 1, + "token_ids_exact": 0, + "text_exact": 0, + "mean_common_prefix_tokens": 9, + "mean_token_edit_distance": 78, + "mean_normalized_token_similarity": 0.5979381443298969 + }, + "bos_at_s0": { + "sources": 1, + "token_ids_exact": 0, + "text_exact": 0, + "mean_common_prefix_tokens": 34, + "mean_token_edit_distance": 4, + "mean_normalized_token_similarity": 0.9812206572769953 + }, + "bos_at_s1": { + "sources": 1, + "token_ids_exact": 0, + "text_exact": 0, + "mean_common_prefix_tokens": 34, + "mean_token_edit_distance": 87, + "mean_normalized_token_similarity": 0.5915492957746479 + }, + "x_at_s0": { + "sources": 1, + "token_ids_exact": 0, + "text_exact": 0, + "mean_common_prefix_tokens": 36, + "mean_token_edit_distance": 57, + "mean_normalized_token_similarity": 0.7323943661971831 + }, + "x_at_s1": { + "sources": 1, + "token_ids_exact": 0, + "text_exact": 0, + "mean_common_prefix_tokens": 9, + "mean_token_edit_distance": 149, + "mean_normalized_token_similarity": 0.3004694835680751 + }, + "period_at_s0": { + "sources": 1, + "token_ids_exact": 0, + "text_exact": 0, + "mean_common_prefix_tokens": 67, + "mean_token_edit_distance": 83, + "mean_normalized_token_similarity": 0.6103286384976525 + }, + "period_at_s1": { + "sources": 1, + "token_ids_exact": 0, + "text_exact": 0, + "mean_common_prefix_tokens": 9, + "mean_token_edit_distance": 110, + "mean_normalized_token_similarity": 0.4835680751173709 + } + } + }, + "output_by_condition": { + "s0_eos": { + "sources": 4, + "hit_eos": 4, + "stopped_at_max_new_tokens": 0, + "mean_generated_tokens": 285.5 + }, + "s1_eos": { + "sources": 4, + "hit_eos": 4, + "stopped_at_max_new_tokens": 0, + "mean_generated_tokens": 245 + }, + "s0_bos": { + "sources": 4, + "hit_eos": 3, + "stopped_at_max_new_tokens": 1, + "mean_generated_tokens": 308.75 + }, + "s1_bos": { + "sources": 4, + "hit_eos": 4, + "stopped_at_max_new_tokens": 0, + "mean_generated_tokens": 197.25 + }, + "s0_x": { + "sources": 4, + "hit_eos": 4, + "stopped_at_max_new_tokens": 0, + "mean_generated_tokens": 292.5 + }, + "s1_x": { + "sources": 4, + "hit_eos": 4, + "stopped_at_max_new_tokens": 0, + "mean_generated_tokens": 140 + }, + "s0_period": { + "sources": 4, + "hit_eos": 4, + "stopped_at_max_new_tokens": 0, + "mean_generated_tokens": 267 + }, + "s1_period": { + "sources": 4, + "hit_eos": 4, + "stopped_at_max_new_tokens": 0, + "mean_generated_tokens": 123.25 + } + }, + "task_by_condition": { + "s0_eos": { + "math_numeric_exact": 1, + "math_sources": 1, + "code_ast_parse": 1, + "code_sources": 1 + }, + "s1_eos": { + "math_numeric_exact": 1, + "math_sources": 1, + "code_ast_parse": 1, + "code_sources": 1 + }, + "s0_bos": { + "math_numeric_exact": 1, + "math_sources": 1, + "code_ast_parse": 1, + "code_sources": 1 + }, + "s1_bos": { + "math_numeric_exact": 1, + "math_sources": 1, + "code_ast_parse": 1, + "code_sources": 1 + }, + "s0_x": { + "math_numeric_exact": 1, + "math_sources": 1, + "code_ast_parse": 1, + "code_sources": 1 + }, + "s1_x": { + "math_numeric_exact": 1, + "math_sources": 1, + "code_ast_parse": 1, + "code_sources": 1 + }, + "s0_period": { + "math_numeric_exact": 1, + "math_sources": 1, + "code_ast_parse": 1, + "code_sources": 1 + }, + "s1_period": { + "math_numeric_exact": 1, + "math_sources": 1, + "code_ast_parse": 1, + "code_sources": 1 + } + } + }, + "claim_boundary": [ + "This is a small deterministic behavior probe, not a benchmark.", + "Counterfactual BOS/x/period token sequences are not official-valid chats.", + "Math checks only final numeric text; code is parsed but never executed.", + "Greedy output identity does not establish sampling-distribution robustness.", + "The local 32GB GPU requires CPU offload; this is not single-GPU BF16 execution.", + "Base-routing evidence and Chat-generation behavior remain different evidence layers." + ] +} diff --git a/src/data/deepseek-v2-lite-chat-completion-512.json b/src/data/deepseek-v2-lite-chat-completion-512.json new file mode 100644 index 0000000..25f8974 --- /dev/null +++ b/src/data/deepseek-v2-lite-chat-completion-512.json @@ -0,0 +1,36640 @@ +{ + "schema_version": 1, + "captured_at": "2026-07-29T15:20:25.055618+00:00", + "model": { + "repo": "deepseek-ai/DeepSeek-V2-Lite-Chat", + "revision": "85864749cd611b4353ce1decdb286193298f64c7", + "checkpoint_identity": "SFT Chat", + "architecture": "DeepseekV2ForCausalLM", + "dtype": "bfloat16", + "checkpoint_tensor_bytes": 31412968448, + "shard_file_bytes_including_headers": 31413626576, + "download_revision_contract": { + "metadata_root": "/home/wuyang/.cache/llm-atlas/deepseek-v2-lite-chat-85864749/.cache/huggingface/download", + "all_files_same_revision": true, + "files": { + "config.json": { + "revision": "85864749cd611b4353ce1decdb286193298f64c7", + "etag": "a1aa8126bbf462cbec8fcc79e8c98d8d87f5c7ed" + }, + "configuration_deepseek.py": { + "revision": "85864749cd611b4353ce1decdb286193298f64c7", + "etag": "82e0f5d9d33620a66e328fdeae0b8dc12e2cff7c" + }, + "generation_config.json": { + "revision": "85864749cd611b4353ce1decdb286193298f64c7", + "etag": "458e1d985ba3fbaaf62a4d1a9dd6ff795a451f7e" + }, + "model.safetensors.index.json": { + "revision": "85864749cd611b4353ce1decdb286193298f64c7", + "etag": "5a821356160292c668d01f8e7fdf9abba4a7b72d" + }, + "model-00001-of-000004.safetensors": { + "revision": "85864749cd611b4353ce1decdb286193298f64c7", + "etag": "a314b79a30810b1038f9db08345178e16fb5742aa266c4a3dc05054c59800082" + }, + "model-00002-of-000004.safetensors": { + "revision": "85864749cd611b4353ce1decdb286193298f64c7", + "etag": "b0bd088feada0af954614da3a5b179c4d4d5d8bb2482ec83194d101f3fe91796" + }, + "model-00003-of-000004.safetensors": { + "revision": "85864749cd611b4353ce1decdb286193298f64c7", + "etag": "d31b192e488f0b3a04e007d842c3c9ba5783d944cb1cc27402fe8b8bb837c490" + }, + "model-00004-of-000004.safetensors": { + "revision": "85864749cd611b4353ce1decdb286193298f64c7", + "etag": "304499be0ea06bf8a3937d7a3cc515bc3738dbd288bdd0bbc1b2d3560fce4930" + }, + "modeling_deepseek.py": { + "revision": "85864749cd611b4353ce1decdb286193298f64c7", + "etag": "847a458bedcc8df352b1a89315b8e400b9bc6030" + }, + "tokenization_deepseek_fast.py": { + "revision": "85864749cd611b4353ce1decdb286193298f64c7", + "etag": "d24377191dd00e80c44f22e31dc15272258a22de" + }, + "tokenizer.json": { + "revision": "85864749cd611b4353ce1decdb286193298f64c7", + "etag": "8b284e5afe1730e31c97ed5c3bdf240adbd15c86" + }, + "tokenizer_config.json": { + "revision": "85864749cd611b4353ce1decdb286193298f64c7", + "etag": "685b4b63ad1aedad8f98824ab21d2ff422d9e1b1" + } + } + }, + "files": { + "config.json": { + "bytes": 1522, + "sha256": "f346286b0f1c8b044252fd54cb4fa78b9fab6472a6e8bebb9edfe03d414ea03d" + }, + "configuration_deepseek.py": { + "bytes": 10338, + "sha256": "6de5e7445ab490a16482027b131d5bd6a003da9b58a182a11432115fac84ce59" + }, + "generation_config.json": { + "bytes": 181, + "sha256": "63ec07f6cb36bd8359b44f671123518dd6fbf55007e0c74aa96c296a75def8b5" + }, + "model.safetensors.index.json": { + "bytes": 479924, + "sha256": "d2cdb2f325f6682cf3ad1ad2526a9f979d857390b579380c0331d975136e0acf" + }, + "model-00001-of-000004.safetensors": { + "bytes": 8594887408, + "sha256": "a314b79a30810b1038f9db08345178e16fb5742aa266c4a3dc05054c59800082" + }, + "model-00002-of-000004.safetensors": { + "bytes": 8591757448, + "sha256": "b0bd088feada0af954614da3a5b179c4d4d5d8bb2482ec83194d101f3fe91796" + }, + "model-00003-of-000004.safetensors": { + "bytes": 8590718520, + "sha256": "d31b192e488f0b3a04e007d842c3c9ba5783d944cb1cc27402fe8b8bb837c490" + }, + "model-00004-of-000004.safetensors": { + "bytes": 5636263200, + "sha256": "304499be0ea06bf8a3937d7a3cc515bc3738dbd288bdd0bbc1b2d3560fce4930" + }, + "modeling_deepseek.py": { + "bytes": 78672, + "sha256": "7d8e5221095286eea991137760893fd7ba52727c0b4ebf48ec09e8bc56b45b9c" + }, + "tokenization_deepseek_fast.py": { + "bytes": 1368, + "sha256": "702fc7dbadc450f2fecfbc59e248ecca5845b49101e8f58f805261c920a3effa" + }, + "tokenizer.json": { + "bytes": 4607451, + "sha256": "41f3bf64213da8c012d8bd0871a58a1fdf70463e8f08f110ddbb1082f529f669" + }, + "tokenizer_config.json": { + "bytes": 1279, + "sha256": "31181eaf79394ea26728d95ecb54fe7c8413e6f56085dbabc8b0818134380ec8" + } + } + }, + "tokenizer_contract": { + "length": 100002, + "vocab_size": 100000, + "all_special_tokens": [ + "<|begin▁of▁sentence|>", + "<|end▁of▁sentence|>" + ], + "all_special_ids": [ + 100000, + 100001 + ], + "boundary_token_ids": { + "eos": 100001, + "bos": 100000, + "x": 87, + "period": 13 + }, + "pad_token_id": 100001, + "pad_aliases_eos": true + }, + "source_contract": { + "reference_path": "src/data/deepseek-v2-lite-routing-special-token-family-control.json", + "reference_sha256": "c372c1b03a8b15f615b54ded5d9257a8fc2cdb7728001735d3d4c1d8534af5bf", + "reference_model_revision": "604d5664dddd88a0433dbae533b7fe9472482de0", + "sample_salt": "llm-atlas-deepseek-routing-template-control-v1", + "domains": [ + "english", + "chinese", + "code", + "math" + ], + "per_domain": 4, + "sources": 16, + "full_source_text_used": true, + "reference_routing_target_tokens": 23, + "selection_identity": "same source IDs and ranks as the pinned base-routing special-token experiment; full source text is used for generation rather than the 23-token routing prefix" + }, + "generation_contract": { + "conditions": { + "s0_eos": { + "system": 0, + "history": "filler", + "boundary": "eos", + "token_class": "special" + }, + "s1_eos": { + "system": 1, + "history": "filler", + "boundary": "eos", + "token_class": "special" + }, + "s0_bos": { + "system": 0, + "history": "filler", + "boundary": "bos", + "token_class": "special" + }, + "s1_bos": { + "system": 1, + "history": "filler", + "boundary": "bos", + "token_class": "special" + }, + "s0_x": { + "system": 0, + "history": "filler", + "boundary": "x", + "token_class": "ordinary_control" + }, + "s1_x": { + "system": 1, + "history": "filler", + "boundary": "x", + "token_class": "ordinary_control" + }, + "s0_period": { + "system": 0, + "history": "filler", + "boundary": "period", + "token_class": "ordinary_control" + }, + "s1_period": { + "system": 1, + "history": "filler", + "boundary": "period", + "token_class": "ordinary_control" + } + }, + "official_serialization": { + "eos": true, + "bos": false, + "x": false, + "period": false + }, + "decode": "greedy", + "do_sample": false, + "max_new_tokens": 512, + "use_cache": true, + "official_generation_config_recorded_not_used": { + "_from_model_config": true, + "bos_token_id": 100000, + "eos_token_id": 100001, + "do_sample": true, + "temperature": 0.3, + "top_p": 0.95, + "transformers_version": "4.39.3" + }, + "all_eight_conditions_same_source_batch": true, + "batch_padding": "left padding with PAD=EOS and attention_mask=0; generation prefix ends at the same batch column", + "counterfactual_boundary": "BOS/x/period cells edit one pre-target token ID after official rendering and are not valid official chats" + }, + "execution": { + "python": "3.10.14", + "torch": "2.11.0+cu128", + "transformers": "4.41.2", + "accelerate": "1.13.0", + "safetensors": "0.8.0", + "platform": "Linux-7.0.0-28-generic-x86_64-with-glibc2.43", + "gpu": "NVIDIA GeForce RTX 5090", + "gpu_memory_limit": "28GiB", + "cpu_memory_limit": "80GiB", + "pytorch_cuda_alloc_conf": "expandable_segments:True", + "input_device": "cuda:0", + "device_map": { + "model.embed_tokens": 0, + "model.layers.0": 0, + "model.layers.1": 0, + "model.layers.2": 0, + "model.layers.3": 0, + "model.layers.4": 0, + "model.layers.5": 0, + "model.layers.6": 0, + "model.layers.7": 0, + "model.layers.8": 0, + "model.layers.9": 0, + "model.layers.10": 0, + "model.layers.11": 0, + "model.layers.12": 0, + "model.layers.13": 0, + "model.layers.14": 0, + "model.layers.15": 0, + "model.layers.16": 0, + "model.layers.17": 0, + "model.layers.18": 0, + "model.layers.19": 0, + "model.layers.20": 0, + "model.layers.21": 0, + "model.layers.22": 0, + "model.layers.23": 0, + "model.layers.24": "cpu", + "model.layers.25": "cpu", + "model.layers.26": "cpu", + "model.norm": "cpu", + "lm_head": "cpu" + }, + "parameter_bytes_by_runtime_parameter_device": { + "cuda:0": 27484446720, + "meta": 3928521728 + }, + "parameter_bytes_by_dtype": { + "torch.bfloat16": 31412968448 + }, + "offload_parameter_device_note": "Accelerate CPU-offloaded modules expose meta parameters between forwards; hf_device_map is authoritative for their CPU placement.", + "load_seconds": 8.417238129011821, + "load_peak_cuda_memory_allocated_bytes": 28616922624, + "cuda_memory_allocated_after_load_bytes": 28616922624, + "peak_cuda_memory_allocated_bytes": 31464357376, + "process_max_rss_kib": 18665304, + "official_single_gpu_bf16_requirement": "40GB GPU", + "local_single_gpu_capacity_mib": 32607, + "offload_required_by_local_capacity": true + }, + "sources": [ + { + "id": "wikitext2/raw-validation/0443", + "domain": "english", + "label": "English encyclopedia", + "within_domain_index": 0, + "selection_rank": "004b632f55ea14a7a1f99552db185df62bb0bbd0914ca94c411d0325d0e96639", + "source_text_sha256": "d975cf38b1f984b025b2aee92f625916a07cb7f35335865ca9020146ca1458f0", + "source_characters": 506, + "source_tokens": 114, + "prompt_tokens_by_condition": { + "s0_eos": 138, + "s1_eos": 154, + "s0_bos": 138, + "s1_bos": 154, + "s0_x": 138, + "s1_x": 154, + "s0_period": 138, + "s1_period": 154 + }, + "batch_prompt_tokens_after_left_padding": 154, + "batch_padding_side": "left", + "batch_conditions": 8, + "generation_seconds": 119.56621067901142, + "peak_cuda_memory_allocated_bytes": 30861684736, + "generated_tokens_including_batch_padding": 4096, + "outputs": [ + { + "condition": "s0_eos", + "factors": { + "system": 0, + "history": "filler", + "boundary": "eos", + "token_class": "special" + }, + "prompt_tokens": 138, + "left_padding_tokens": 16, + "prompt_token_ids_sha256": "5434667d3541b957f782b64d98c09083bd369ecd7cdc3a7df8696dfb22d896c5", + "generated_tokens": 463, + "generated_token_ids": [ + 429, + 207, + 16, + 24, + 23, + 21, + 11679, + 440, + 2777, + 621, + 279, + 26713, + 1, + 457, + 254, + 4121, + 7682, + 1260, + 8991, + 4219, + 324, + 9701, + 17815, + 245, + 4485, + 8401, + 279, + 895, + 6255, + 3266, + 276, + 254, + 34959, + 96287, + 3093, + 280, + 634, + 280, + 895, + 14720, + 11, + 440, + 57199, + 280, + 18670, + 883, + 429, + 4219, + 438, + 10785, + 276, + 5859, + 20804, + 21121, + 11, + 588, + 661, + 245, + 4971, + 3822, + 366, + 21005, + 21121, + 13, + 3159, + 11, + 21005, + 21121, + 438, + 77491, + 276, + 6255, + 254, + 11679, + 3266, + 276, + 11820, + 786, + 254, + 19151, + 4910, + 280, + 254, + 11679, + 6, + 82, + 28329, + 285, + 254, + 41862, + 20667, + 30106, + 279, + 254, + 5654, + 13, + 185, + 185, + 549, + 5654, + 440, + 57199, + 280, + 18670, + 1084, + 588, + 317, + 786, + 254, + 47161, + 42023, + 364, + 6399, + 275, + 11, + 245, + 8565, + 22429, + 779, + 13185, + 78713, + 6997, + 10606, + 331, + 3807, + 13388, + 430, + 254, + 45522, + 358, + 53012, + 12, + 79158, + 4138, + 1774, + 18928, + 3182, + 2320, + 5427, + 6368, + 4532, + 11, + 438, + 24712, + 1653, + 19151, + 285, + 41862, + 327, + 1272, + 14934, + 13, + 21005, + 21121, + 438, + 10849, + 344, + 254, + 19151, + 4910, + 280, + 254, + 5654, + 285, + 895, + 3605, + 3502, + 744, + 441, + 889, + 64164, + 1313, + 31249, + 548, + 839, + 14565, + 279, + 1190, + 35350, + 285, + 94800, + 13, + 185, + 185, + 2124, + 245, + 1230, + 11, + 21005, + 21121, + 15354, + 276, + 6255, + 440, + 2777, + 621, + 279, + 26713, + 1, + 366, + 895, + 3632, + 28329, + 285, + 3093, + 13, + 1002, + 5426, + 276, + 245, + 8401, + 279, + 254, + 11679, + 6, + 82, + 6255, + 11, + 372, + 324, + 9701, + 6, + 82, + 4988, + 11, + 5859, + 20804, + 21121, + 11, + 661, + 276, + 1275, + 274, + 8615, + 4971, + 7204, + 327, + 254, + 11679, + 13, + 43390, + 11, + 254, + 4219, + 6, + 82, + 11679, + 438, + 12389, + 581, + 457, + 3824, + 539, + 255, + 21121, + 11, + 588, + 10899, + 276, + 27754, + 254, + 11679, + 13, + 185, + 185, + 6501, + 11, + 254, + 35350, + 13254, + 254, + 3093, + 280, + 440, + 57199, + 280, + 18670, + 1, + 285, + 254, + 28329, + 43650, + 13, + 3824, + 539, + 255, + 21121, + 13070, + 441, + 276, + 3433, + 440, + 2777, + 621, + 279, + 26713, + 1, + 279, + 895, + 6269, + 6255, + 10537, + 11, + 588, + 7195, + 344, + 254, + 11679, + 438, + 441, + 13587, + 43995, + 410, + 30903, + 457, + 254, + 4988, + 13, + 1002, + 6354, + 438, + 4135, + 1401, + 276, + 4945, + 3572, + 35350, + 285, + 276, + 2102, + 254, + 11679, + 245, + 5518, + 276, + 330, + 4503, + 457, + 254, + 1272, + 1673, + 254, + 4310, + 81468, + 344, + 744, + 463, + 1865, + 366, + 245, + 1713, + 6255, + 13, + 185, + 185, + 24738, + 254, + 4310, + 78275, + 11, + 440, + 2777, + 621, + 279, + 26713, + 1, + 438, + 10820, + 7964, + 331, + 7579, + 207, + 22, + 11, + 207, + 16, + 24, + 23, + 21, + 11, + 285, + 359, + 2674, + 331, + 276, + 3261, + 634, + 280, + 254, + 1094, + 35812, + 285, + 6956, + 33595, + 279, + 254, + 7682, + 1260, + 8991, + 29416, + 13, + 429, + 35350, + 13254, + 254, + 11679, + 889, + 8719, + 276, + 4686, + 895, + 441, + 9782, + 2227, + 285, + 21822, + 276, + 895, + 5517, + 372, + 245, + 44872, + 6255, + 279, + 12459, + 4236, + 13, + 429, + 4219, + 6, + 82, + 42200, + 276, + 24224, + 1108, + 4426, + 285, + 34959, + 3605, + 3502, + 11, + 1477, + 34959, + 279, + 3964, + 11, + 839, + 8579, + 276, + 8347, + 324, + 9701, + 372, + 245, + 5881, + 5206, + 279, + 254, + 12459, + 8991, + 8127, + 13, + 100001 + ], + "generated_token_ids_sha256": "20ee70c7e6eea7a55efc794c55041d2358d3ea1917826bc567870e3e197e9a2a", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " The 1986 album \"Reign in Blood\" by the American thrash metal band Slayer faced a significant delay in its release due to the controversial lyrical content of one of its tracks, \"Angel of Death.\" The band was signed to Def Jam Records, which had a distribution deal with Columbia Records. However, Columbia Records was hesitant to release the album due to concerns about the graphic nature of the album's artwork and the disturbing themes depicted in the song.\n\nThe song \"Angel of Death,\" which is about the infamous Josef Mengele, a German physician who conducted horrific medical experiments on human subjects at the Auschwitz-Birkenau concentration camp during World War II, was deemed too graphic and disturbing for public consumption. Columbia Records was concerned that the graphic nature of the song and its subject matter would not only offend many listeners but also potentially incite controversy and backlash.\n\nAs a result, Columbia Records refused to release \"Reign in Blood\" with its original artwork and content. This led to a delay in the album's release, as Slayer's label, Def Jam Records, had to find an alternative distribution channel for the album. Eventually, the band's album was picked up by Geffen Records, which agreed to distribute the album.\n\nHowever, the controversy surrounding the content of \"Angel of Death\" and the artwork persisted. Geffen Records chose not to include \"Reign in Blood\" in its official release schedule, which meant that the album was not widely advertised or promoted by the label. This decision was likely made to avoid further controversy and to give the album a chance to be received by the public without the initial uproar that would have come with a direct release.\n\nDespite the initial hurdles, \"Reign in Blood\" was eventually released on October 7, 1986, and it went on to become one of the most influential and successful albums in the thrash metal genre. The controversy surrounding the album only served to increase its notoriety and contributed to its status as a landmark release in extreme music. The band's willingness to tackle such dark and controversial subject matter, while controversial in itself, also helped to establish Slayer as a leading force in the extreme metal scene.", + "text_sha256": "dca5f7f4845857fa375ffe30eb063c8f7fe95a8b91f017a4d25fc657031cc0fa", + "task_score": null + }, + { + "condition": "s1_eos", + "factors": { + "system": 1, + "history": "filler", + "boundary": "eos", + "token_class": "special" + }, + "prompt_tokens": 154, + "left_padding_tokens": 0, + "prompt_token_ids_sha256": "1e0bcadb7aef5021ec6541bec3245447e15b3904f44eee8bc3560ca3a3be17d7", + "generated_tokens": 350, + "generated_token_ids": [ + 429, + 207, + 16, + 24, + 23, + 21, + 11679, + 440, + 2777, + 621, + 279, + 26713, + 1, + 457, + 254, + 4121, + 7682, + 1260, + 8991, + 4219, + 324, + 9701, + 17815, + 245, + 4485, + 8401, + 279, + 895, + 6255, + 3266, + 276, + 254, + 34959, + 96287, + 3093, + 280, + 634, + 280, + 895, + 14720, + 11, + 440, + 57199, + 280, + 18670, + 883, + 429, + 4219, + 438, + 10785, + 276, + 5859, + 20804, + 21121, + 11, + 588, + 661, + 245, + 4971, + 3822, + 366, + 21005, + 21121, + 11, + 245, + 3144, + 4988, + 13, + 3159, + 11, + 21005, + 21121, + 438, + 77491, + 276, + 6255, + 254, + 11679, + 3266, + 276, + 11820, + 786, + 254, + 19151, + 4910, + 280, + 254, + 11679, + 6, + 82, + 28329, + 11, + 588, + 657, + 24712, + 440, + 14515, + 19151, + 883, + 185, + 185, + 549, + 5654, + 440, + 57199, + 280, + 18670, + 1084, + 588, + 317, + 5329, + 366, + 254, + 11679, + 11, + 3804, + 30209, + 344, + 418, + 6383, + 41862, + 285, + 29422, + 362, + 53590, + 11750, + 11684, + 457, + 254, + 3199, + 12794, + 92643, + 275, + 11, + 245, + 1590, + 12, + 9641, + 8565, + 7601, + 779, + 13185, + 279, + 18292, + 2155, + 6997, + 10606, + 331, + 22728, + 2320, + 5427, + 6368, + 4532, + 13, + 429, + 19151, + 4910, + 280, + 254, + 5654, + 6, + 82, + 30209, + 285, + 254, + 3605, + 3502, + 778, + 7282, + 66623, + 327, + 21005, + 21121, + 11, + 5881, + 768, + 276, + 20770, + 276, + 6255, + 254, + 11679, + 13, + 185, + 185, + 2124, + 245, + 1230, + 280, + 21005, + 21121, + 6, + 43810, + 11, + 254, + 4971, + 280, + 440, + 2777, + 621, + 279, + 26713, + 1, + 438, + 3443, + 855, + 457, + 3824, + 539, + 255, + 21121, + 13, + 429, + 11679, + 438, + 10820, + 7964, + 331, + 7579, + 207, + 22, + 11, + 207, + 16, + 24, + 23, + 21, + 11, + 548, + 3266, + 276, + 254, + 35350, + 13254, + 895, + 3093, + 11, + 359, + 1216, + 441, + 3976, + 331, + 3824, + 539, + 255, + 21121, + 6, + 6269, + 6255, + 10537, + 13, + 1002, + 7195, + 344, + 254, + 11679, + 438, + 441, + 13587, + 43995, + 410, + 30903, + 457, + 254, + 4988, + 11, + 588, + 1027, + 463, + 10249, + 895, + 8657, + 2636, + 285, + 254, + 4219, + 6, + 82, + 23711, + 279, + 254, + 4236, + 5083, + 430, + 254, + 766, + 13, + 185, + 185, + 549, + 35350, + 13254, + 440, + 2777, + 621, + 279, + 26713, + 1, + 285, + 895, + 8401, + 279, + 6255, + 22499, + 254, + 10694, + 344, + 3377, + 13809, + 3059, + 754, + 13982, + 366, + 34959, + 3358, + 11, + 7282, + 754, + 359, + 14431, + 13119, + 13092, + 13388, + 13, + 809, + 839, + 30491, + 40492, + 254, + 5454, + 344, + 4236, + 481, + 463, + 331, + 1272, + 33831, + 285, + 254, + 9059, + 280, + 9605, + 254, + 69329, + 24674, + 280, + 23357, + 5761, + 13, + 100001 + ], + "generated_token_ids_sha256": "3b7e4df21d031796cc519678773ec1c549ac737c25cd53c74fd79ccaf324d905", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " The 1986 album \"Reign in Blood\" by the American thrash metal band Slayer faced a significant delay in its release due to the controversial lyrical content of one of its tracks, \"Angel of Death.\" The band was signed to Def Jam Records, which had a distribution deal with Columbia Records, a major label. However, Columbia Records was hesitant to release the album due to concerns about the graphic nature of the album's artwork, which they deemed \"too graphic.\"\n\nThe song \"Angel of Death,\" which is associated with the album, features lyrics that are highly disturbing and depict heinous acts committed by the character Joseph Mengle, a real-life German doctor who conducted inhumane medical experiments on prisoners during World War II. The graphic nature of the song's lyrics and the subject matter were particularly troubling for Columbia Records, leading them to refuse to release the album.\n\nAs a result of Columbia Records' refusal, the distribution of \"Reign in Blood\" was taken over by Geffen Records. The album was eventually released on October 7, 1986, but due to the controversy surrounding its content, it did not appear on Geffen Records' official release schedule. This meant that the album was not widely advertised or promoted by the label, which could have affected its commercial success and the band's visibility in the music industry at the time.\n\nThe controversy surrounding \"Reign in Blood\" and its delay in release highlights the challenges that record labels face when dealing with controversial material, particularly when it involves sensitive historical subjects. It also underscores the impact that music can have on public discourse and the importance of considering the societal implications of artistic expression.", + "text_sha256": "ce78de37e13b8458cc9232484b91a1eb2cc750f9beae630a03dd8ba20c8311f6", + "task_score": null + }, + { + "condition": "s0_bos", + "factors": { + "system": 0, + "history": "filler", + "boundary": "bos", + "token_class": "special" + }, + "prompt_tokens": 138, + "left_padding_tokens": 16, + "prompt_token_ids_sha256": "6a09cf8e108abe6f680742417af9627959dd3b560d4fef3822f4d6af895b95ff", + "generated_tokens": 512, + "generated_token_ids": [ + 440, + 57199, + 280, + 18670, + 1, + 317, + 245, + 5654, + 457, + 254, + 4121, + 7682, + 1260, + 8991, + 4219, + 324, + 9701, + 11, + 17120, + 331, + 704, + 207, + 16, + 24, + 23, + 21, + 11679, + 1926, + 621, + 279, + 26713, + 13, + 429, + 11679, + 317, + 4828, + 634, + 280, + 254, + 1094, + 35812, + 285, + 2375, + 2722, + 279, + 254, + 7682, + 1260, + 8991, + 29416, + 11, + 285, + 359, + 643, + 803, + 26637, + 457, + 1313, + 32123, + 285, + 28113, + 372, + 245, + 3144, + 7927, + 331, + 704, + 830, + 13, + 3159, + 11, + 254, + 6255, + 280, + 1926, + 621, + 279, + 26713, + 438, + 441, + 1673, + 35350, + 13, + 185, + 185, + 549, + 96287, + 3093, + 280, + 440, + 57199, + 280, + 18670, + 1, + 317, + 25716, + 1983, + 254, + 78713, + 8370, + 280, + 12794, + 364, + 6399, + 275, + 11, + 245, + 8565, + 22429, + 285, + 16222, + 11231, + 779, + 8719, + 372, + 254, + 440, + 57199, + 280, + 18670, + 1, + 279, + 45522, + 358, + 53012, + 2320, + 5427, + 6368, + 4532, + 13, + 364, + 6399, + 275, + 13185, + 279, + 18292, + 2155, + 6997, + 10606, + 331, + 10317, + 280, + 22728, + 11, + 1313, + 280, + 4989, + 778, + 9571, + 372, + 245, + 1230, + 13, + 429, + 5654, + 6, + 82, + 19151, + 94705, + 280, + 364, + 6399, + 275, + 6, + 82, + 8370, + 5426, + 276, + 11820, + 473, + 254, + 4219, + 6, + 82, + 49033, + 11, + 21005, + 21121, + 11, + 779, + 16039, + 15354, + 276, + 6255, + 254, + 11679, + 3266, + 276, + 254, + 34959, + 3605, + 3502, + 285, + 254, + 19151, + 28329, + 13, + 185, + 185, + 93855, + 21121, + 438, + 697, + 280, + 254, + 5859, + 20804, + 21121, + 4988, + 11, + 588, + 661, + 10785, + 324, + 9701, + 276, + 245, + 16387, + 5461, + 13, + 5859, + 20804, + 438, + 3185, + 327, + 895, + 1468, + 4854, + 285, + 34959, + 3093, + 11, + 548, + 1236, + 657, + 778, + 9892, + 276, + 28711, + 21005, + 21121, + 276, + 6255, + 1926, + 621, + 279, + 26713, + 13, + 1733, + 245, + 1230, + 11, + 254, + 11679, + 438, + 441, + 7964, + 331, + 10537, + 11, + 285, + 254, + 4219, + 17815, + 4485, + 28572, + 279, + 3442, + 704, + 4236, + 636, + 276, + 254, + 1272, + 13, + 185, + 185, + 72825, + 11, + 1926, + 621, + 279, + 26713, + 438, + 12389, + 581, + 457, + 3824, + 539, + 255, + 21121, + 11, + 1913, + 3144, + 3377, + 4988, + 11, + 588, + 10899, + 276, + 6255, + 254, + 11679, + 13, + 3824, + 539, + 255, + 21121, + 1216, + 441, + 463, + 254, + 1246, + 11820, + 372, + 21005, + 21121, + 285, + 438, + 9807, + 276, + 2938, + 4312, + 366, + 254, + 6255, + 13, + 1926, + 621, + 279, + 26713, + 438, + 6334, + 7964, + 331, + 7579, + 207, + 22, + 11, + 207, + 16, + 24, + 23, + 21, + 11, + 285, + 359, + 5397, + 14474, + 245, + 3986, + 1893, + 3264, + 8991, + 10278, + 327, + 895, + 25571, + 3066, + 285, + 17907, + 30209, + 13, + 185, + 185, + 6501, + 11, + 254, + 35350, + 13254, + 254, + 11679, + 285, + 895, + 3093, + 1216, + 441, + 1225, + 366, + 895, + 6255, + 13, + 429, + 19151, + 4910, + 280, + 254, + 28329, + 285, + 254, + 3605, + 3502, + 280, + 254, + 11688, + 7091, + 276, + 8293, + 35350, + 11, + 285, + 359, + 5426, + 276, + 254, + 11679, + 1435, + 38114, + 279, + 2971, + 7035, + 13, + 22081, + 254, + 35350, + 11, + 1926, + 621, + 279, + 26713, + 2674, + 331, + 276, + 3261, + 245, + 8657, + 2636, + 11, + 16232, + 1604, + 207, + 23, + 16, + 331, + 254, + 59769, + 207, + 17, + 15, + 15, + 13347, + 285, + 10820, + 24998, + 62090, + 5517, + 13, + 185, + 185, + 774, + 12773, + 11, + 254, + 96287, + 3093, + 280, + 440, + 57199, + 280, + 18670, + 1, + 21822, + 276, + 254, + 8401, + 280, + 254, + 6255, + 280, + 324, + 9701, + 6, + 82, + 207, + 16, + 24, + 23, + 21, + 11679, + 1926, + 621, + 279, + 26713, + 13, + 429, + 35350, + 13254, + 254, + 11679, + 285, + 895, + 3093, + 5426, + 276, + 895, + 4310, + 43810, + 457, + 21005, + 21121, + 11, + 548, + 359, + 438, + 10820, + 7964, + 457, + 3824, + 539, + 255, + 21121, + 13 + ], + "generated_token_ids_sha256": "66edb1e7762fe6cc70b8ea2bd7c8ce71043045fccb9f695abfba5061d2994641", + "hit_eos": false, + "stopped_at_max_new_tokens": true, + "text": " \"Angel of Death\" is a song by the American thrash metal band Slayer, featured on their 1986 album Reign in Blood. The album is considered one of the most influential and important works in the thrash metal genre, and it has been cited by many critics and musicians as a major influence on their work. However, the release of Reign in Blood was not without controversy.\n\nThe lyrical content of \"Angel of Death\" is centered around the horrific actions of Joseph Mengele, a German physician and SS officer who served as the \"Angel of Death\" in Auschwitz during World War II. Mengele conducted inhumane medical experiments on thousands of prisoners, many of whom were killed as a result. The song's graphic depiction of Mengele's actions led to concerns from the band's distributor, Columbia Records, who ultimately refused to release the album due to the controversial subject matter and the graphic artwork.\n\nColumbia Records was part of the Def Jam Records label, which had signed Slayer to a recording contract. Def Jam was known for its edgy and controversial content, but even they were unable to convince Columbia Records to release Reign in Blood. As a result, the album was not released on schedule, and the band faced significant delays in getting their music out to the public.\n\nEventually, Reign in Blood was picked up by Geffen Records, another major record label, which agreed to release the album. Geffen Records did not have the same concerns as Columbia Records and was willing to move forward with the release. Reign in Blood was finally released on October 7, 1986, and it quickly gained a cult following among metal fans for its aggressive sound and intense lyrics.\n\nHowever, the controversy surrounding the album and its content did not end with its release. The graphic nature of the artwork and the subject matter of the songs continued to generate controversy, and it led to the album being banned in several countries. Despite the controversy, Reign in Blood went on to become a commercial success, reaching number 81 on the Billboard 200 chart and eventually achieving platinum status.\n\nIn conclusion, the lyrical content of \"Angel of Death\" contributed to the delay of the release of Slayer's 1986 album Reign in Blood. The controversy surrounding the album and its content led to its initial refusal by Columbia Records, but it was eventually released by Geffen Records.", + "text_sha256": "9778b266a87874a0ef15550b5d4401658edb474909b5876ed5f41ac7adea31d9", + "task_score": null + }, + { + "condition": "s1_bos", + "factors": { + "system": 1, + "history": "filler", + "boundary": "bos", + "token_class": "special" + }, + "prompt_tokens": 154, + "left_padding_tokens": 0, + "prompt_token_ids_sha256": "94dadd54d4e285af191cd433d2a3e77f04e990f15ec14046501e3711187f4ce7", + "generated_tokens": 186, + "generated_token_ids": [ + 429, + 5654, + 440, + 57199, + 280, + 18670, + 1, + 457, + 324, + 9701, + 11, + 588, + 317, + 245, + 6751, + 8991, + 5654, + 11, + 661, + 742, + 1079, + 4426, + 285, + 41862, + 30209, + 13, + 3410, + 30209, + 13364, + 786, + 245, + 1590, + 12, + 9641, + 7601, + 779, + 1216, + 12906, + 2012, + 276, + 1245, + 279, + 245, + 10490, + 2320, + 5427, + 6368, + 4532, + 13, + 9028, + 280, + 1069, + 30209, + 11, + 254, + 1245, + 779, + 778, + 279, + 5361, + 280, + 245, + 2567, + 4236, + 2607, + 2424, + 5859, + 20804, + 21121, + 3320, + 6, + 83, + 1121, + 276, + 6255, + 254, + 324, + 9701, + 6, + 82, + 11679, + 2424, + 440, + 2777, + 621, + 279, + 26713, + 883, + 1955, + 778, + 19873, + 344, + 254, + 5654, + 285, + 254, + 11679, + 6, + 82, + 4831, + 2460, + 778, + 1653, + 33828, + 285, + 1667, + 23453, + 1245, + 13, + 185, + 185, + 549, + 11679, + 438, + 3308, + 441, + 7964, + 11, + 548, + 1913, + 4236, + 2607, + 2424, + 3824, + 539, + 255, + 21121, + 6143, + 276, + 1345, + 768, + 13, + 1955, + 1957, + 254, + 11679, + 636, + 327, + 1245, + 276, + 3471, + 285, + 9031, + 276, + 331, + 7579, + 207, + 22, + 11, + 207, + 16, + 24, + 23, + 21, + 13, + 1474, + 1373, + 280, + 521, + 254, + 35350, + 11, + 3824, + 539, + 255, + 21121, + 3320, + 6, + 83, + 1121, + 276, + 2410, + 5514, + 344, + 440, + 2777, + 621, + 279, + 26713, + 1, + 438, + 22881, + 327, + 6803, + 13, + 100001 + ], + "generated_token_ids_sha256": "0d3edcd06960c212f25a68dbe5999ec81ad3db843857e64e5818174d5f561462", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " The song \"Angel of Death\" by Slayer, which is a heavy metal song, had some very dark and disturbing lyrics. These lyrics talked about a real-life doctor who did terrible things to people in a hospital during World War II. Because of these lyrics, the people who were in charge of a big music company called Def Jam Records didn't want to release the Slayer's album called \"Reign in Blood.\" They were worried that the song and the album's cover art were too scary and might upset people.\n\nThe album was almost not released, but another music company called Geffen Records decided to help them. They put the album out for people to buy and listen to on October 7, 1986. But because of all the controversy, Geffen Records didn't want to tell everyone that \"Reign in Blood\" was officially for sale.", + "text_sha256": "39da87bdbfaf2241494af215baf7702f2eb8c18ac6b50864703283dacf462c15", + "task_score": null + }, + { + "condition": "s0_x", + "factors": { + "system": 0, + "history": "filler", + "boundary": "x", + "token_class": "ordinary_control" + }, + "prompt_tokens": 138, + "left_padding_tokens": 16, + "prompt_token_ids_sha256": "7c2072be2dbef455fc3a7469ca40fe34a64ac83cea4d048e3000a989b0a4ce91", + "generated_tokens": 444, + "generated_token_ids": [ + 429, + 207, + 16, + 24, + 23, + 21, + 11679, + 440, + 2777, + 621, + 279, + 26713, + 1, + 457, + 254, + 4121, + 7682, + 1260, + 8991, + 4219, + 324, + 9701, + 17815, + 4485, + 10694, + 279, + 895, + 6255, + 3266, + 276, + 254, + 34959, + 96287, + 3093, + 280, + 634, + 280, + 895, + 14720, + 11, + 440, + 57199, + 280, + 18670, + 883, + 429, + 5654, + 11, + 588, + 317, + 245, + 56170, + 1614, + 2654, + 280, + 254, + 48876, + 42023, + 364, + 6399, + 275, + 11, + 245, + 8565, + 57433, + 16222, + 11231, + 285, + 22429, + 11, + 643, + 803, + 13587, + 58964, + 327, + 895, + 19151, + 285, + 41862, + 93670, + 280, + 6997, + 10606, + 13185, + 331, + 3807, + 13388, + 279, + 45522, + 358, + 53012, + 2320, + 5427, + 6368, + 4532, + 13, + 185, + 185, + 549, + 4219, + 11, + 324, + 9701, + 11, + 438, + 10785, + 276, + 5859, + 20804, + 21121, + 11, + 588, + 279, + 1947, + 661, + 245, + 4971, + 3822, + 366, + 21005, + 21121, + 11, + 634, + 280, + 254, + 8397, + 4236, + 5212, + 279, + 254, + 1843, + 13, + 21005, + 21121, + 15920, + 15354, + 276, + 6255, + 254, + 11679, + 3266, + 276, + 11820, + 786, + 254, + 19151, + 4910, + 280, + 254, + 5654, + 6, + 82, + 30209, + 285, + 254, + 28329, + 5329, + 366, + 359, + 13, + 429, + 5296, + 438, + 344, + 254, + 3093, + 438, + 1653, + 19151, + 285, + 1027, + 14565, + 64164, + 410, + 23453, + 31249, + 11, + 5881, + 276, + 245, + 3968, + 94800, + 285, + 6640, + 50283, + 13, + 185, + 185, + 2124, + 245, + 1230, + 280, + 1069, + 11820, + 11, + 440, + 2777, + 621, + 279, + 26713, + 1, + 438, + 441, + 5598, + 279, + 21005, + 21121, + 6, + 6269, + 6255, + 10537, + 13, + 3159, + 11, + 254, + 35350, + 13254, + 254, + 11679, + 285, + 254, + 43810, + 276, + 6255, + 359, + 1090, + 254, + 21005, + 21121, + 4988, + 5426, + 276, + 245, + 2262, + 279, + 4971, + 13, + 3824, + 539, + 255, + 21121, + 11, + 1913, + 3144, + 3377, + 4988, + 11, + 10820, + 3061, + 855, + 254, + 4971, + 280, + 440, + 2777, + 621, + 279, + 26713, + 883, + 3824, + 539, + 255, + 21121, + 6143, + 276, + 6255, + 254, + 11679, + 331, + 7579, + 207, + 22, + 11, + 207, + 16, + 24, + 23, + 21, + 11, + 10988, + 254, + 35350, + 13, + 185, + 185, + 24738, + 254, + 2262, + 279, + 4971, + 11, + 254, + 35350, + 13254, + 440, + 57199, + 280, + 18670, + 1, + 285, + 254, + 11679, + 372, + 245, + 3000, + 7195, + 344, + 440, + 2777, + 621, + 279, + 26713, + 1, + 1216, + 441, + 3976, + 331, + 3824, + 539, + 255, + 21121, + 6, + 6269, + 6255, + 10537, + 13, + 1002, + 438, + 4135, + 245, + 18549, + 2938, + 276, + 21654, + 254, + 3968, + 6640, + 5454, + 331, + 254, + 4988, + 6, + 82, + 750, + 12677, + 285, + 6757, + 13, + 185, + 185, + 549, + 35350, + 855, + 440, + 57199, + 280, + 18670, + 1, + 285, + 254, + 11679, + 372, + 245, + 3000, + 22499, + 254, + 1823, + 280, + 4236, + 276, + 71966, + 2215, + 11, + 8317, + 11, + 285, + 35350, + 13, + 809, + 839, + 30491, + 40492, + 254, + 12353, + 344, + 12677, + 285, + 3377, + 13809, + 463, + 276, + 2225, + 254, + 3968, + 5454, + 280, + 704, + 830, + 331, + 31249, + 285, + 8213, + 430, + 2317, + 13, + 22081, + 254, + 10694, + 17815, + 457, + 324, + 9701, + 285, + 440, + 2777, + 621, + 279, + 26713, + 1084, + 254, + 11679, + 643, + 1962, + 803, + 12108, + 372, + 245, + 11092, + 279, + 254, + 7682, + 1260, + 8991, + 29416, + 285, + 643, + 245, + 10643, + 1893, + 276, + 437, + 1492, + 13, + 100001 + ], + "generated_token_ids_sha256": "6f025b7680d94b507576f661932d3349603b368dbb40e7a5aed3a48d1fb4a310", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " The 1986 album \"Reign in Blood\" by the American thrash metal band Slayer faced significant challenges in its release due to the controversial lyrical content of one of its tracks, \"Angel of Death.\" The song, which is a fictionalized account of the notorious Josef Mengele, a German Nazi SS officer and physician, has been widely criticized for its graphic and disturbing portrayal of medical experiments conducted on human subjects in Auschwitz during World War II.\n\nThe band, Slayer, was signed to Def Jam Records, which in turn had a distribution deal with Columbia Records, one of the largest music companies in the world. Columbia Records initially refused to release the album due to concerns about the graphic nature of the song's lyrics and the artwork associated with it. The concern was that the content was too graphic and could potentially offend or upset listeners, leading to a potential backlash and negative publicity.\n\nAs a result of these concerns, \"Reign in Blood\" was not included in Columbia Records' official release schedule. However, the controversy surrounding the album and the refusal to release it under the Columbia Records label led to a change in distribution. Geffen Records, another major record label, eventually took over the distribution of \"Reign in Blood.\" Geffen Records decided to release the album on October 7, 1986, despite the controversy.\n\nDespite the change in distribution, the controversy surrounding \"Angel of Death\" and the album as a whole meant that \"Reign in Blood\" did not appear on Geffen Records' official release schedule. This was likely a strategic move to minimize the potential negative impact on the label's other artists and projects.\n\nThe controversy over \"Angel of Death\" and the album as a whole highlights the power of music to provoke thought, discussion, and controversy. It also underscores the responsibility that artists and record labels have to consider the potential impact of their work on listeners and society at large. Despite the challenges faced by Slayer and \"Reign in Blood,\" the album has since been recognized as a classic in the thrash metal genre and has a dedicated following to this day.", + "text_sha256": "c9d51efc70d56906fd7ed90ffdc91f951f8d968b545caf00464cd9067cdbcbfb", + "task_score": null + }, + { + "condition": "s1_x", + "factors": { + "system": 1, + "history": "filler", + "boundary": "x", + "token_class": "ordinary_control" + }, + "prompt_tokens": 154, + "left_padding_tokens": 0, + "prompt_token_ids_sha256": "f8031307ed1f5c0894c3e6e54e868e89e56d9286d9bda5b61005fd2546cb6c8b", + "generated_tokens": 155, + "generated_token_ids": [ + 429, + 207, + 16, + 24, + 23, + 21, + 324, + 9701, + 11679, + 440, + 2777, + 621, + 279, + 26713, + 1, + 17815, + 28572, + 279, + 895, + 6255, + 3266, + 276, + 254, + 34959, + 96287, + 3093, + 280, + 254, + 5654, + 440, + 57199, + 280, + 18670, + 883, + 429, + 4219, + 438, + 10785, + 276, + 5859, + 20804, + 21121, + 11, + 588, + 279, + 1947, + 661, + 245, + 4971, + 3822, + 366, + 21005, + 21121, + 13, + 21005, + 21121, + 438, + 77491, + 276, + 6255, + 254, + 11679, + 11, + 15970, + 1373, + 280, + 11820, + 8073, + 254, + 19151, + 4910, + 280, + 254, + 11679, + 6, + 82, + 28329, + 11, + 588, + 657, + 24712, + 440, + 14515, + 19151, + 883, + 185, + 185, + 2124, + 245, + 1230, + 11, + 254, + 11679, + 6, + 82, + 6255, + 438, + 60302, + 11, + 285, + 359, + 1216, + 441, + 3976, + 331, + 3824, + 539, + 255, + 21121, + 6, + 6269, + 6255, + 10537, + 2645, + 7579, + 207, + 22, + 11, + 207, + 16, + 24, + 23, + 21, + 13, + 1002, + 8401, + 438, + 245, + 1230, + 280, + 254, + 35350, + 13254, + 254, + 11679, + 11, + 588, + 438, + 15052, + 3266, + 276, + 254, + 34959, + 20667, + 285, + 38234, + 279, + 254, + 5654, + 440, + 57199, + 280, + 18670, + 883, + 100001 + ], + "generated_token_ids_sha256": "a4414c6f42eb5e1fb6c9f81d6ba39996e9e35eaac6de8b831437ead92f3facb7", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " The 1986 Slayer album \"Reign in Blood\" faced delays in its release due to the controversial lyrical content of the song \"Angel of Death.\" The band was signed to Def Jam Records, which in turn had a distribution deal with Columbia Records. Columbia Records was hesitant to release the album, primarily because of concerns regarding the graphic nature of the album's artwork, which they deemed \"too graphic.\"\n\nAs a result, the album's release was postponed, and it did not appear on Geffen Records' official release schedule until October 7, 1986. This delay was a result of the controversy surrounding the album, which was largely due to the controversial themes and imagery in the song \"Angel of Death.\"", + "text_sha256": "8d642782addedb69f39c27f88638a0ca150417fdab9b710dceb6b16930051a42", + "task_score": null + }, + { + "condition": "s0_period", + "factors": { + "system": 0, + "history": "filler", + "boundary": "period", + "token_class": "ordinary_control" + }, + "prompt_tokens": 138, + "left_padding_tokens": 16, + "prompt_token_ids_sha256": "ff0a25894210af41c2ac2b14e8d71079e4570d45b66d9e1f4bb2cf57fb90981e", + "generated_tokens": 447, + "generated_token_ids": [ + 429, + 207, + 16, + 24, + 23, + 21, + 11679, + 440, + 2777, + 621, + 279, + 26713, + 1, + 457, + 254, + 4121, + 7682, + 1260, + 8991, + 4219, + 324, + 9701, + 17815, + 4485, + 10694, + 2320, + 895, + 6255, + 1699, + 11, + 15052, + 3266, + 276, + 254, + 34959, + 96287, + 3093, + 280, + 634, + 280, + 895, + 14720, + 11, + 440, + 57199, + 280, + 18670, + 883, + 429, + 5654, + 11, + 588, + 317, + 786, + 254, + 48876, + 42023, + 364, + 6399, + 275, + 11, + 245, + 8565, + 7601, + 779, + 13185, + 78713, + 6997, + 10606, + 331, + 3807, + 13388, + 2320, + 254, + 69157, + 11, + 438, + 24712, + 1653, + 19151, + 285, + 41862, + 457, + 254, + 3377, + 4988, + 21005, + 21121, + 13, + 185, + 185, + 93855, + 21121, + 11, + 588, + 438, + 254, + 49033, + 327, + 324, + 9701, + 6, + 82, + 4988, + 11, + 5859, + 20804, + 21121, + 11, + 438, + 10849, + 786, + 254, + 3968, + 94800, + 473, + 254, + 1272, + 285, + 254, + 6640, + 5454, + 331, + 254, + 4219, + 6, + 82, + 3324, + 13, + 429, + 3377, + 2607, + 438, + 839, + 19873, + 786, + 254, + 19151, + 28329, + 344, + 17146, + 254, + 11679, + 11, + 588, + 17120, + 18757, + 285, + 41862, + 38234, + 13, + 1733, + 245, + 1230, + 11, + 21005, + 21121, + 15354, + 276, + 6255, + 440, + 2777, + 621, + 279, + 26713, + 1084, + 13079, + 245, + 4485, + 8401, + 279, + 254, + 11679, + 6, + 82, + 14167, + 13, + 185, + 185, + 549, + 4219, + 285, + 704, + 5259, + 778, + 17815, + 366, + 245, + 50995, + 25, + 2818, + 2262, + 254, + 30209, + 285, + 28329, + 276, + 2100, + 590, + 254, + 3377, + 4988, + 410, + 1275, + 274, + 8615, + 1143, + 276, + 6255, + 254, + 11679, + 13, + 324, + 9701, + 6, + 82, + 5259, + 6143, + 276, + 3956, + 3824, + 539, + 255, + 21121, + 11, + 1913, + 3144, + 3377, + 4988, + 11, + 276, + 1019, + 565, + 657, + 744, + 330, + 9807, + 276, + 27754, + 254, + 11679, + 13, + 3824, + 539, + 255, + 21121, + 10899, + 276, + 1529, + 331, + 254, + 12353, + 280, + 35586, + 440, + 2777, + 621, + 279, + 26713, + 1084, + 285, + 254, + 11679, + 438, + 10820, + 7964, + 331, + 7579, + 207, + 22, + 11, + 207, + 16, + 24, + 23, + 21, + 13, + 185, + 185, + 6501, + 11, + 254, + 35350, + 13254, + 254, + 3093, + 280, + 440, + 57199, + 280, + 18670, + 1, + 285, + 254, + 28329, + 1216, + 441, + 1225, + 366, + 254, + 11679, + 6, + 82, + 6255, + 13, + 3824, + 539, + 255, + 21121, + 13070, + 441, + 276, + 3433, + 440, + 2777, + 621, + 279, + 26713, + 1, + 279, + 704, + 6269, + 6255, + 10537, + 11, + 588, + 3572, + 25274, + 254, + 11820, + 280, + 21005, + 21121, + 13, + 22081, + 254, + 35350, + 11, + 440, + 2777, + 621, + 279, + 26713, + 1, + 2674, + 331, + 276, + 3261, + 245, + 44872, + 11679, + 279, + 254, + 7682, + 1260, + 8991, + 29416, + 11, + 285, + 359, + 317, + 1132, + 4828, + 634, + 280, + 254, + 1094, + 35812, + 285, + 2375, + 33595, + 279, + 254, + 4345, + 280, + 12459, + 4236, + 13, + 185, + 185, + 549, + 3693, + 280, + 440, + 2777, + 621, + 279, + 26713, + 1, + 285, + 895, + 96940, + 6255, + 14672, + 372, + 245, + 25139, + 666, + 19025, + 786, + 254, + 1823, + 280, + 23357, + 5761, + 285, + 254, + 3968, + 15951, + 280, + 14358, + 69329, + 39150, + 13, + 809, + 839, + 30491, + 40492, + 254, + 9059, + 280, + 3377, + 13809, + 285, + 58262, + 1435, + 1721, + 276, + 245, + 5505, + 3169, + 280, + 23357, + 3093, + 11, + 1236, + 565, + 359, + 975, + 330, + 34959, + 410, + 34959, + 276, + 742, + 13, + 100001 + ], + "generated_token_ids_sha256": "095fcab0a3c7ee9e2d95c918c730eacd0b30d361b1fd738921094516af74200c", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " The 1986 album \"Reign in Blood\" by the American thrash metal band Slayer faced significant challenges during its release process, largely due to the controversial lyrical content of one of its tracks, \"Angel of Death.\" The song, which is about the notorious Josef Mengele, a German doctor who conducted horrific medical experiments on human subjects during the Holocaust, was deemed too graphic and disturbing by the record label Columbia Records.\n\nColumbia Records, which was the distributor for Slayer's label, Def Jam Records, was concerned about the potential backlash from the public and the negative impact on the band's image. The record company was also worried about the graphic artwork that accompanied the album, which featured violent and disturbing imagery. As a result, Columbia Records refused to release \"Reign in Blood,\" causing a significant delay in the album's debut.\n\nThe band and their management were faced with a dilemma: either change the lyrics and artwork to appease the record label or find an alternative way to release the album. Slayer's management decided to approach Geffen Records, another major record label, to see if they would be willing to distribute the album. Geffen Records agreed to take on the responsibility of releasing \"Reign in Blood,\" and the album was eventually released on October 7, 1986.\n\nHowever, the controversy surrounding the content of \"Angel of Death\" and the artwork did not end with the album's release. Geffen Records chose not to include \"Reign in Blood\" in their official release schedule, which further highlighted the concerns of Columbia Records. Despite the controversy, \"Reign in Blood\" went on to become a landmark album in the thrash metal genre, and it is now considered one of the most influential and important albums in the history of extreme music.\n\nThe story of \"Reign in Blood\" and its tumultuous release serves as a cautionary tale about the power of artistic expression and the potential consequences of challenging societal norms. It also underscores the importance of record labels and distributors being open to a wide range of artistic content, even if it may be controversial or controversial to some.", + "text_sha256": "9bd1501033375bc7c52f23387e99262da2f425f9f236a35b9400babe93f76402", + "task_score": null + }, + { + "condition": "s1_period", + "factors": { + "system": 1, + "history": "filler", + "boundary": "period", + "token_class": "ordinary_control" + }, + "prompt_tokens": 154, + "left_padding_tokens": 0, + "prompt_token_ids_sha256": "bd9667669414b6730ba499f8191c50397e136d25b33022e1b1457fcedf1964e7", + "generated_tokens": 125, + "generated_token_ids": [ + 429, + 207, + 16, + 24, + 23, + 21, + 324, + 9701, + 11679, + 440, + 2777, + 621, + 279, + 26713, + 1, + 17815, + 28572, + 279, + 895, + 6255, + 3266, + 276, + 254, + 34959, + 96287, + 3093, + 280, + 254, + 5654, + 440, + 57199, + 280, + 18670, + 1084, + 588, + 5426, + 276, + 11820, + 786, + 254, + 11679, + 6, + 82, + 28329, + 13, + 429, + 4219, + 438, + 10785, + 276, + 5859, + 20804, + 21121, + 11, + 4318, + 49033, + 11, + 21005, + 21121, + 11, + 438, + 77491, + 276, + 6255, + 254, + 11679, + 1373, + 280, + 254, + 19151, + 4910, + 280, + 254, + 28329, + 11, + 588, + 657, + 1503, + 440, + 14515, + 19151, + 883, + 1733, + 245, + 1230, + 11, + 3824, + 539, + 255, + 21121, + 10820, + 3061, + 855, + 254, + 4971, + 280, + 440, + 2777, + 621, + 279, + 26713, + 1084, + 548, + 254, + 35350, + 13254, + 254, + 11679, + 7195, + 344, + 359, + 1216, + 441, + 3976, + 331, + 3824, + 539, + 255, + 6, + 82, + 6269, + 6255, + 10537, + 13, + 100001 + ], + "generated_token_ids_sha256": "3188d53e8b729c95658171b2bae3fa33a7dcbcd620dbefdfc68c28eb09c7f118", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " The 1986 Slayer album \"Reign in Blood\" faced delays in its release due to the controversial lyrical content of the song \"Angel of Death,\" which led to concerns about the album's artwork. The band was signed to Def Jam Records, whose distributor, Columbia Records, was hesitant to release the album because of the graphic nature of the artwork, which they found \"too graphic.\" As a result, Geffen Records eventually took over the distribution of \"Reign in Blood,\" but the controversy surrounding the album meant that it did not appear on Geffen's official release schedule.", + "text_sha256": "317d9c0ab2d45fa5cdce60547cba707b169071d9c51e5b32ab7c540fcd75bbdc", + "task_score": null + } + ] + }, + { + "id": "wikitext2/raw-validation/0030", + "domain": "english", + "label": "English encyclopedia", + "within_domain_index": 1, + "selection_rank": "0064700bc7cd279cd9669445fce1a5a410d6e0cae091efed9c8f0182e47d7ab0", + "source_text_sha256": "3fa876ef33c7fd8fc094f7d15c183449fdf696aadd239223616f9e6086b319d5", + "source_characters": 213, + "source_tokens": 53, + "prompt_tokens_by_condition": { + "s0_eos": 77, + "s1_eos": 93, + "s0_bos": 77, + "s1_bos": 93, + "s0_x": 77, + "s1_x": 93, + "s0_period": 77, + "s1_period": 93 + }, + "batch_prompt_tokens_after_left_padding": 93, + "batch_padding_side": "left", + "batch_conditions": 8, + "generation_seconds": 99.42410741999629, + "peak_cuda_memory_allocated_bytes": 30591854592, + "generated_tokens_including_batch_padding": 4096, + "outputs": [ + { + "condition": "s0_eos", + "factors": { + "system": 0, + "history": "filler", + "boundary": "eos", + "token_class": "special" + }, + "prompt_tokens": 77, + "left_padding_tokens": 16, + "prompt_token_ids_sha256": "444c608dfc963cb50803bd7d74331726aaf708d2a358596035693bb77df540e1", + "generated_tokens": 416, + "generated_token_ids": [ + 429, + 1853, + 60961, + 271, + 67859, + 8217, + 11, + 13653, + 49238, + 28947, + 3969, + 319, + 11, + 415, + 13, + 41478, + 319, + 11, + 285, + 26955, + 71, + 30640, + 5068, + 313, + 15700, + 319, + 11, + 418, + 3185, + 276, + 3697, + 254, + 1853, + 3185, + 8217, + 280, + 254, + 456, + 95663, + 9538, + 1117, + 36382, + 37333, + 31959, + 12253, + 13, + 429, + 6943, + 280, + 37333, + 31959, + 12253, + 8217, + 331, + 1069, + 20712, + 15979, + 643, + 803, + 13556, + 11, + 548, + 254, + 3052, + 8217, + 331, + 415, + 13, + 28947, + 3969, + 319, + 643, + 441, + 2618, + 803, + 5734, + 410, + 10730, + 13, + 185, + 185, + 34, + 10748, + 31959, + 12253, + 317, + 245, + 10291, + 761, + 285, + 28830, + 10117, + 1117, + 36382, + 11, + 1022, + 9351, + 279, + 207, + 17, + 15, + 16, + 20, + 13, + 809, + 317, + 245, + 2592, + 280, + 1760, + 11, + 456, + 95663, + 48794, + 344, + 778, + 15920, + 23907, + 372, + 21025, + 276, + 254, + 1117, + 36382, + 461, + 17072, + 14624, + 334, + 1036, + 98533, + 8, + 3266, + 276, + 704, + 7256, + 12, + 4018, + 53428, + 13, + 3159, + 11, + 15500, + 72204, + 285, + 19382, + 7535, + 463, + 13558, + 344, + 657, + 2564, + 245, + 8492, + 1117, + 36382, + 366, + 4730, + 72204, + 285, + 27047, + 13968, + 13, + 185, + 185, + 34, + 10748, + 31959, + 12253, + 8217, + 418, + 9184, + 1760, + 11, + 18761, + 889, + 245, + 1860, + 2825, + 54424, + 279, + 3973, + 13, + 1955, + 418, + 21929, + 457, + 704, + 4730, + 1728, + 9170, + 11, + 588, + 14431, + 245, + 4301, + 52869, + 1699, + 344, + 5312, + 4606, + 30184, + 1286, + 15848, + 13, + 429, + 1117, + 36382, + 317, + 839, + 3185, + 327, + 895, + 15965, + 22555, + 6872, + 11, + 372, + 254, + 8361, + 37333, + 31959, + 12253, + 8217, + 418, + 63898, + 331, + 3947, + 26075, + 58160, + 46053, + 985, + 11, + 2847, + 254, + 1853, + 60961, + 271, + 20712, + 15979, + 6346, + 2330, + 13, + 185, + 185, + 549, + 6943, + 280, + 37333, + 31959, + 12253, + 8217, + 331, + 415, + 13, + 28947, + 3969, + 319, + 11, + 415, + 13, + 41478, + 319, + 11, + 285, + 26955, + 71, + 30640, + 5068, + 313, + 15700, + 319, + 643, + 803, + 13556, + 1184, + 3947, + 4786, + 11, + 2847, + 81318, + 11, + 27047, + 64694, + 11, + 285, + 19382, + 9281, + 13, + 3159, + 11, + 254, + 3052, + 8217, + 280, + 37333, + 31959, + 12253, + 331, + 415, + 13, + 28947, + 3969, + 319, + 643, + 441, + 2618, + 803, + 5734, + 410, + 28080, + 7046, + 13, + 1002, + 317, + 4135, + 3266, + 276, + 254, + 1714, + 344, + 254, + 1117, + 36382, + 317, + 1592, + 10291, + 28830, + 10117, + 11, + 285, + 691, + 3977, + 317, + 4067, + 276, + 5595, + 36879, + 254, + 20219, + 280, + 37333, + 31959, + 12253, + 8217, + 285, + 704, + 1728, + 46549, + 13, + 185, + 185, + 16341, + 3977, + 881, + 254, + 37333, + 31959, + 12253, + 1117, + 36382, + 317, + 6027, + 276, + 2018, + 2579, + 895, + 53512, + 5012, + 11, + 372, + 1136, + 372, + 895, + 3968, + 5454, + 331, + 254, + 2802, + 285, + 7125, + 12024, + 280, + 254, + 3697, + 8217, + 13, + 18494, + 11, + 6714, + 254, + 20219, + 285, + 4971, + 280, + 37333, + 31959, + 12253, + 8217, + 543, + 2774, + 11597, + 21625, + 881, + 254, + 9259, + 285, + 99887, + 280, + 63898, + 48794, + 279, + 254, + 26075, + 4342, + 13, + 100001 + ], + "generated_token_ids_sha256": "7422865083f3009e0c8bd7508d286825993e9bd3e7c00bd3da0038ff4366a065", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " The three clawed lobster species, Homarus gammarus, H. americanus, and Nephrops norvegicus, are known to host the three known species of the enigmatic animal phylum Cycliophora. The presence of Cycliophora species on these lobsters has been confirmed, but the specific species on H. gammarus has not yet been described or identified.\n\nCycliophora is a relatively new and poorly understood phylum, first discovered in 2015. It is a group of small, enigmatic organisms that were initially classified as belonging to the phylum Nematoda (roundworms) due to their thread-like morphology. However, subsequent morphological and molecular studies have revealed that they represent a distinct phylum with unique morphological and genetic characteristics.\n\nCycliophora species are typically small, measuring only a few millimeters in length. They are characterized by their unique life cycle, which involves a complex developmental process that includes multiple larval stages. The phylum is also known for its unusual feeding behavior, as the adult Cycliophora species are parasitic on various marine invertebrates, including the three clawed lobsters mentioned above.\n\nThe presence of Cycliophora species on H. gammarus, H. americanus, and Nephrops norvegicus has been confirmed through various methods, including microscopy, genetic sequencing, and molecular techniques. However, the specific species of Cycliophora on H. gammarus has not yet been described or formally named. This is likely due to the fact that the phylum is still relatively poorly understood, and more research is needed to fully characterize the diversity of Cycliophora species and their life histories.\n\nFurther research into the Cycliophora phylum is essential to better understand its ecological role, as well as its potential impact on the health and population dynamics of the host species. Additionally, understanding the diversity and distribution of Cycliophora species will provide valuable insights into the evolution and diversification of parasitic organisms in the marine environment.", + "text_sha256": "b1826ed7efe7a45e440beee465c880031573b1e35ff390314545bc528856ce86", + "task_score": null + }, + { + "condition": "s1_eos", + "factors": { + "system": 1, + "history": "filler", + "boundary": "eos", + "token_class": "special" + }, + "prompt_tokens": 93, + "left_padding_tokens": 0, + "prompt_token_ids_sha256": "31af45583f68bf573d269a75f87c4f45f037d622a9818535efbac90008b392e8", + "generated_tokens": 66, + "generated_token_ids": [ + 429, + 1853, + 60961, + 271, + 67859, + 8217, + 11, + 13653, + 49238, + 28947, + 3969, + 319, + 11, + 415, + 13, + 41478, + 319, + 11, + 285, + 26955, + 71, + 30640, + 5068, + 313, + 15700, + 319, + 11, + 418, + 3185, + 276, + 3697, + 254, + 1853, + 3185, + 8217, + 280, + 254, + 9538, + 1117, + 36382, + 37333, + 31959, + 12253, + 13, + 3159, + 11, + 254, + 8217, + 280, + 37333, + 31959, + 12253, + 1503, + 331, + 415, + 13, + 28947, + 3969, + 319, + 643, + 441, + 803, + 5734, + 2618, + 13, + 100001 + ], + "generated_token_ids_sha256": "bd901e9c241ff4350777860c4253cc83689b692c4e19a751328747be9df762d5", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " The three clawed lobster species, Homarus gammarus, H. americanus, and Nephrops norvegicus, are known to host the three known species of the animal phylum Cycliophora. However, the species of Cycliophora found on H. gammarus has not been described yet.", + "text_sha256": "fe27a666ae2d0d5aabf230ae281b1d7fab4e86f8793039ff3c909bda8e713529", + "task_score": null + }, + { + "condition": "s0_bos", + "factors": { + "system": 0, + "history": "filler", + "boundary": "bos", + "token_class": "special" + }, + "prompt_tokens": 77, + "left_padding_tokens": 16, + "prompt_token_ids_sha256": "d2f84d6f572db24f3d36e048c66d60c778964f3a775b8cf1e3c01baf2832de59", + "generated_tokens": 468, + "generated_token_ids": [ + 429, + 1853, + 60961, + 271, + 67859, + 8217, + 11, + 13653, + 49238, + 28947, + 3969, + 319, + 11, + 415, + 13, + 41478, + 319, + 11, + 285, + 26955, + 71, + 30640, + 5068, + 313, + 15700, + 319, + 11, + 418, + 3185, + 276, + 3697, + 254, + 1853, + 3185, + 8217, + 280, + 254, + 1117, + 36382, + 37333, + 31959, + 12253, + 13, + 429, + 1117, + 36382, + 37333, + 31959, + 12253, + 317, + 245, + 2592, + 280, + 456, + 95663, + 285, + 28830, + 10117, + 26075, + 48794, + 344, + 778, + 1022, + 9351, + 279, + 207, + 17, + 15, + 15, + 17, + 13, + 1955, + 418, + 21929, + 457, + 704, + 4730, + 53428, + 11, + 588, + 5312, + 245, + 4077, + 280, + 2183, + 8601, + 625, + 21180, + 2424, + 440, + 538, + 11117, + 1, + 410, + 440, + 89015, + 1, + 331, + 704, + 1917, + 13, + 3410, + 63083, + 418, + 2215, + 276, + 330, + 6591, + 279, + 33765, + 31639, + 285, + 7057, + 8244, + 2481, + 81111, + 13, + 185, + 185, + 549, + 1853, + 3185, + 8217, + 280, + 37333, + 31959, + 12253, + 418, + 25, + 185, + 185, + 16, + 13, + 20718, + 64861, + 406, + 10748, + 31959, + 12253, + 2703, + 1170, + 25, + 1002, + 8217, + 317, + 1503, + 279, + 254, + 307, + 2771, + 280, + 254, + 60961, + 271, + 67859, + 415, + 13, + 28947, + 3969, + 319, + 13, + 809, + 317, + 245, + 63898, + 54270, + 344, + 643, + 245, + 4301, + 1728, + 9170, + 15231, + 2971, + 52869, + 15848, + 13, + 429, + 8361, + 6351, + 317, + 245, + 1760, + 11, + 38711, + 12, + 4018, + 18588, + 366, + 245, + 1136, + 12, + 43140, + 1917, + 4928, + 8891, + 254, + 63083, + 13, + 185, + 185, + 17, + 13, + 2489, + 33204, + 406, + 10748, + 31959, + 12253, + 386, + 1804, + 36182, + 25, + 1002, + 8217, + 317, + 1503, + 279, + 254, + 307, + 2771, + 280, + 254, + 60961, + 271, + 67859, + 415, + 13, + 41478, + 319, + 13, + 9532, + 20718, + 64861, + 406, + 10748, + 31959, + 12253, + 2703, + 1170, + 11, + 2489, + 33204, + 406, + 10748, + 31959, + 12253, + 386, + 1804, + 36182, + 317, + 839, + 245, + 63898, + 54270, + 366, + 245, + 4301, + 1728, + 9170, + 13, + 429, + 8361, + 6351, + 317, + 245, + 1760, + 11, + 38711, + 12, + 4018, + 18588, + 366, + 245, + 1136, + 12, + 43140, + 1917, + 4928, + 8891, + 254, + 63083, + 13, + 185, + 185, + 18, + 13, + 37333, + 31959, + 12253, + 25965, + 13, + 2489, + 33204, + 406, + 10748, + 31959, + 12253, + 25, + 1002, + 8217, + 317, + 1503, + 279, + 254, + 307, + 2771, + 280, + 254, + 60961, + 271, + 67859, + 26955, + 71, + 30640, + 5068, + 313, + 15700, + 319, + 13, + 429, + 3508, + 9845, + 280, + 437, + 8217, + 317, + 1592, + 9242, + 11, + 372, + 359, + 643, + 441, + 803, + 5595, + 5734, + 13, + 809, + 317, + 4135, + 276, + 330, + 245, + 63898, + 54270, + 366, + 245, + 4301, + 1728, + 9170, + 3083, + 276, + 344, + 280, + 20718, + 64861, + 406, + 10748, + 31959, + 12253, + 2703, + 1170, + 285, + 2489, + 33204, + 406, + 10748, + 31959, + 12253, + 386, + 1804, + 36182, + 13, + 185, + 185, + 549, + 15322, + 280, + 37333, + 31959, + 12253, + 279, + 254, + 60961, + 271, + 20712, + 15979, + 415, + 13, + 28947, + 3969, + 319, + 11, + 415, + 13, + 41478, + 319, + 11, + 285, + 26955, + 71, + 30640, + 5068, + 313, + 15700, + 319, + 11615, + 344, + 1069, + 48794, + 975, + 5043, + 372, + 245, + 3892, + 3697, + 327, + 1069, + 456, + 95663, + 48794, + 13, + 3159, + 11, + 254, + 3508, + 5012, + 280, + 37333, + 31959, + 12253, + 279, + 254, + 74616, + 285, + 35298, + 280, + 1069, + 20712, + 15979, + 7544, + 28830, + 10117, + 13, + 10327, + 3977, + 317, + 4067, + 276, + 72599, + 387, + 254, + 1728, + 9170, + 11, + 3697, + 11781, + 11, + 285, + 53512, + 5012, + 280, + 1069, + 41001, + 48794, + 13, + 100001 + ], + "generated_token_ids_sha256": "cf1e633fcc612e6e6ddb2d2ed66adf927a0d71e49917ad20d03b46687e3ed4e2", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " The three clawed lobster species, Homarus gammarus, H. americanus, and Nephrops norvegicus, are known to host the three known species of the phylum Cycliophora. The phylum Cycliophora is a group of enigmatic and poorly understood marine organisms that were first discovered in 2002. They are characterized by their unique morphology, which includes a series of calcareous plates called \"claws\" or \"plates\" on their head. These claws are thought to be involved in capturing prey and providing protection against predators.\n\nThe three known species of Cycliophora are:\n\n1. Lamarckocycliophora typica: This species is found in the gills of the clawed lobster H. gammarus. It is a parasitic organism that has a complex life cycle involving several developmental stages. The adult stage is a small, worm-like creature with a well-developed head region containing the claws.\n\n2. Orstenocycliophora sepioris: This species is found in the gills of the clawed lobster H. americanus. Like Lamarckocycliophora typica, Orstenocycliophora sepioris is also a parasitic organism with a complex life cycle. The adult stage is a small, worm-like creature with a well-developed head region containing the claws.\n\n3. Cycliophora cf. Orstenocycliophora: This species is found in the gills of the clawed lobster Nephrops norvegicus. The exact identity of this species is still uncertain, as it has not been fully described. It is likely to be a parasitic organism with a complex life cycle similar to that of Lamarckocycliophora typica and Orstenocycliophora sepioris.\n\nThe discovery of Cycliophora in the clawed lobsters H. gammarus, H. americanus, and Nephrops norvegicus suggests that these organisms may serve as a natural host for these enigmatic organisms. However, the exact role of Cycliophora in the ecology and biology of these lobsters remains poorly understood. Further research is needed to elucidate the life cycle, host relationships, and ecological role of these intriguing organisms.", + "text_sha256": "13f3a489610c5730582b2585e4199246c43bac4c938b2bce39212e04fc961fdb", + "task_score": null + }, + { + "condition": "s1_bos", + "factors": { + "system": 1, + "history": "filler", + "boundary": "bos", + "token_class": "special" + }, + "prompt_tokens": 93, + "left_padding_tokens": 0, + "prompt_token_ids_sha256": "fdc04e28401db152d30934024e00dccfcb879f93b48f0e71526c94b728bd68da", + "generated_tokens": 90, + "generated_token_ids": [ + 429, + 1853, + 60961, + 271, + 67859, + 8217, + 340, + 6346, + 11, + 13653, + 49238, + 28947, + 3969, + 319, + 11, + 415, + 13, + 41478, + 319, + 11, + 285, + 26955, + 71, + 30640, + 5068, + 313, + 15700, + 319, + 11, + 418, + 3185, + 276, + 3697, + 254, + 1853, + 3185, + 8217, + 280, + 254, + 9538, + 1117, + 36382, + 37333, + 31959, + 12253, + 13, + 3159, + 11, + 254, + 8217, + 331, + 415, + 13, + 28947, + 3969, + 319, + 643, + 441, + 803, + 5734, + 2618, + 13, + 1002, + 2456, + 344, + 395, + 1113, + 6, + 83, + 1006, + 856, + 2447, + 280, + 12624, + 8466, + 2424, + 37333, + 31959, + 12253, + 3530, + 331, + 254, + 1853, + 60961, + 271, + 20712, + 15979, + 2618, + 13, + 100001 + ], + "generated_token_ids_sha256": "47acda4c7abe0317f94a12fbf28fe537e53ef3f66ff88b7b634ee7a0dc4e28fe", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " The three clawed lobster species you mentioned, Homarus gammarus, H. americanus, and Nephrops norvegicus, are known to host the three known species of the animal phylum Cycliophora. However, the species on H. gammarus has not been described yet. This means that we don't know what kind of tiny animals called Cycliophora live on the three clawed lobsters yet.", + "text_sha256": "89fac9ab28a0afedd8e94281fc497d9cfe455d3be342a33dea5174872519031a", + "task_score": null + }, + { + "condition": "s0_x", + "factors": { + "system": 0, + "history": "filler", + "boundary": "x", + "token_class": "ordinary_control" + }, + "prompt_tokens": 77, + "left_padding_tokens": 16, + "prompt_token_ids_sha256": "e58d86084999d335a8cbf7f2199f33e227083962f560b55cdb23ffc53fa6f643", + "generated_tokens": 512, + "generated_token_ids": [ + 429, + 1853, + 60961, + 271, + 67859, + 8217, + 11, + 13653, + 49238, + 28947, + 3969, + 319, + 11, + 415, + 13, + 41478, + 319, + 11, + 285, + 26955, + 71, + 30640, + 5068, + 313, + 15700, + 319, + 11, + 418, + 3185, + 276, + 3697, + 254, + 1853, + 3185, + 8217, + 280, + 254, + 1117, + 36382, + 37333, + 31959, + 12253, + 13, + 429, + 8217, + 344, + 33095, + 331, + 415, + 13, + 28947, + 3969, + 319, + 11, + 3111, + 11, + 463, + 441, + 2618, + 803, + 5734, + 13, + 185, + 185, + 34, + 10748, + 31959, + 12253, + 317, + 245, + 10291, + 761, + 285, + 28830, + 10117, + 2592, + 280, + 48794, + 11, + 2752, + 11738, + 276, + 372, + 254, + 440, + 849, + 16370, + 53328, + 1, + 410, + 440, + 83733, + 6696, + 53328, + 883, + 1955, + 418, + 245, + 4730, + 2592, + 280, + 8466, + 344, + 418, + 441, + 11489, + 4523, + 276, + 688, + 750, + 1117, + 36382, + 11, + 2883, + 768, + 274, + 5485, + 3605, + 327, + 3437, + 13, + 185, + 185, + 549, + 1117, + 36382, + 37333, + 31959, + 12253, + 317, + 21929, + 457, + 895, + 4730, + 3123, + 4327, + 285, + 1728, + 9170, + 13, + 1955, + 418, + 1760, + 11, + 2838, + 12, + 83952, + 48794, + 344, + 9184, + 54699, + 254, + 28921, + 280, + 704, + 3697, + 67859, + 410, + 49393, + 13, + 429, + 3123, + 280, + 245, + 37333, + 31959, + 12253, + 54270, + 317, + 7665, + 279, + 245, + 30372, + 11, + 6305, + 85, + 2227, + 6270, + 280, + 5539, + 12, + 4018, + 10918, + 2424, + 845, + 7300, + 13, + 3410, + 845, + 7300, + 418, + 2215, + 276, + 1345, + 254, + 54270, + 19463, + 3964, + 276, + 254, + 3697, + 6, + 82, + 28921, + 35589, + 285, + 2774, + 8244, + 473, + 254, + 3697, + 6, + 82, + 52875, + 65090, + 13, + 185, + 185, + 34, + 10748, + 31959, + 12253, + 48794, + 463, + 245, + 4301, + 1728, + 9170, + 344, + 14431, + 2971, + 15848, + 11, + 2847, + 245, + 2094, + 12, + 37101, + 30184, + 1286, + 6351, + 13, + 429, + 8361, + 6351, + 280, + 254, + 54270, + 317, + 9184, + 1503, + 2383, + 254, + 3697, + 6, + 82, + 28921, + 11, + 1066, + 359, + 1584, + 1168, + 285, + 80336, + 13, + 429, + 3508, + 1728, + 9170, + 280, + 254, + 37333, + 31959, + 12253, + 8217, + 344, + 33095, + 331, + 415, + 13, + 28947, + 3969, + 319, + 643, + 441, + 2618, + 803, + 5734, + 11, + 372, + 437, + 8217, + 643, + 441, + 803, + 28080, + 10730, + 285, + 10876, + 13, + 185, + 185, + 549, + 15322, + 280, + 37333, + 31959, + 12253, + 8217, + 279, + 254, + 80135, + 280, + 60961, + 271, + 20712, + 15979, + 643, + 8473, + 4313, + 786, + 254, + 53512, + 5012, + 280, + 1069, + 48794, + 285, + 704, + 3968, + 5454, + 331, + 704, + 3697, + 8217, + 13, + 4754, + 16504, + 3634, + 344, + 37333, + 31959, + 12253, + 975, + 1538, + 245, + 5012, + 279, + 13004, + 1224, + 285, + 33971, + 32315, + 2383, + 254, + 3697, + 6, + 82, + 28921, + 11, + 1477, + 3072, + 66096, + 344, + 657, + 975, + 5043, + 372, + 245, + 3130, + 280, + 3427, + 327, + 254, + 20712, + 15979, + 4449, + 13, + 185, + 185, + 16341, + 3977, + 317, + 4067, + 276, + 2018, + 2579, + 254, + 35298, + 11, + 74616, + 11, + 285, + 40091, + 11781, + 280, + 254, + 37333, + 31959, + 12253, + 13, + 1002, + 5312, + 254, + 6411, + 280, + 254, + 37333, + 31959, + 12253, + 8217, + 344, + 33095, + 331, + 415, + 13, + 28947, + 3969, + 319, + 11, + 588, + 543, + 2774, + 11597, + 1757, + 786, + 254, + 20219, + 285, + 4971, + 280, + 1069, + 4730, + 48794, + 13, + 185, + 185, + 774, + 12773, + 11, + 254, + 1853, + 60961, + 271, + 67859, + 8217, + 13653, + 49238, + 28947, + 3969, + 319, + 11, + 415, + 13, + 41478, + 319, + 11, + 285, + 26955, + 71, + 30640, + 5068, + 313, + 15700, + 319, + 418, + 3185, + 276, + 3697, + 254, + 1853, + 3185, + 8217, + 280, + 254, + 1117, + 36382, + 37333, + 31959, + 12253, + 13, + 429, + 8217, + 344, + 33095, + 331, + 415, + 13, + 28947, + 3969, + 319, + 11, + 3111, + 11, + 463, + 441, + 2618, + 803, + 5734, + 11, + 285, + 691, + 3977, + 317, + 4067, + 276, + 2579, + 704, + 35298, + 11, + 74616, + 11 + ], + "generated_token_ids_sha256": "f996b145920f124fa691aa5ba94f9a65f378cc10ce3dc59498ff88e23d1fb745", + "hit_eos": false, + "stopped_at_max_new_tokens": true, + "text": " The three clawed lobster species, Homarus gammarus, H. americanus, and Nephrops norvegicus, are known to host the three known species of the phylum Cycliophora. The species that reside on H. gammarus, however, have not yet been described.\n\nCycliophora is a relatively new and poorly understood group of organisms, often referred to as the \"velvet worms\" or \"marine glass worms.\" They are a unique group of animals that are not closely related to any other phylum, making them an interesting subject for study.\n\nThe phylum Cycliophora is characterized by its unique body structure and life cycle. They are small, soft-bodied organisms that typically inhabit the gut of their host lobster or shrimp. The body of a Cycliophora organism is covered in a distinctive, velvety layer of hair-like structures called setae. These setae are thought to help the organism anchor itself to the host's gut lining and provide protection from the host's digestive enzymes.\n\nCycliophora organisms have a complex life cycle that involves several stages, including a free-living larval stage. The adult stage of the organism is typically found within the host's gut, where it matures and reproduces. The exact life cycle of the Cycliophora species that reside on H. gammarus has not yet been described, as this species has not been formally identified and studied.\n\nThe discovery of Cycliophora species in the guts of clawed lobsters has raised questions about the ecological role of these organisms and their potential impact on their host species. Some researchers believe that Cycliophora may play a role in breaking down and recycling nutrients within the host's gut, while others speculate that they may serve as a source of food for the lobsters themselves.\n\nFurther research is needed to better understand the biology, ecology, and evolutionary relationships of the Cycliophora. This includes the description of the Cycliophora species that reside on H. gammarus, which will provide valuable information about the diversity and distribution of these unique organisms.\n\nIn conclusion, the three clawed lobster species Homarus gammarus, H. americanus, and Nephrops norvegicus are known to host the three known species of the phylum Cycliophora. The species that reside on H. gammarus, however, have not yet been described, and more research is needed to understand their biology, ecology,", + "text_sha256": "b294a63670c38ed1be7969e4d795723e4cdafa7db9c075839a67f07e2b4ab120", + "task_score": null + }, + { + "condition": "s1_x", + "factors": { + "system": 1, + "history": "filler", + "boundary": "x", + "token_class": "ordinary_control" + }, + "prompt_tokens": 93, + "left_padding_tokens": 0, + "prompt_token_ids_sha256": "622b26d9dd5ab8da251346f4a0a4c323c7bf7f04104aff695c8cc4931ecc16ad", + "generated_tokens": 58, + "generated_token_ids": [ + 429, + 1853, + 60961, + 271, + 67859, + 8217, + 11, + 13653, + 49238, + 28947, + 3969, + 319, + 11, + 415, + 13, + 41478, + 319, + 11, + 285, + 26955, + 71, + 30640, + 5068, + 313, + 15700, + 319, + 11, + 418, + 18813, + 276, + 1853, + 3185, + 8217, + 280, + 254, + 1117, + 36382, + 37333, + 31959, + 12253, + 13, + 3159, + 11, + 254, + 8217, + 331, + 415, + 13, + 28947, + 3969, + 319, + 643, + 441, + 803, + 5734, + 2618, + 13, + 100001 + ], + "generated_token_ids_sha256": "f1f745687024ee6d3c062d1f55a1662aa41fa4c2bb06bcada914ba8cfd46f365", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " The three clawed lobster species, Homarus gammarus, H. americanus, and Nephrops norvegicus, are hosts to three known species of the phylum Cycliophora. However, the species on H. gammarus has not been described yet.", + "text_sha256": "5d5a1c8cbad7049ca2018a2f1169a515c200503225c0dda20aa8d335597ae0c0", + "task_score": null + }, + { + "condition": "s0_period", + "factors": { + "system": 0, + "history": "filler", + "boundary": "period", + "token_class": "ordinary_control" + }, + "prompt_tokens": 77, + "left_padding_tokens": 16, + "prompt_token_ids_sha256": "cb855711f73de3c5b25f372374062c409555268374981b1e9cf7e4bac2ee4b11", + "generated_tokens": 261, + "generated_token_ids": [ + 429, + 1853, + 60961, + 271, + 67859, + 8217, + 11, + 13653, + 49238, + 28947, + 3969, + 319, + 11, + 415, + 13, + 41478, + 319, + 11, + 285, + 26955, + 71, + 30640, + 5068, + 313, + 15700, + 319, + 11, + 418, + 3185, + 276, + 3697, + 254, + 1853, + 3185, + 8217, + 280, + 254, + 1117, + 36382, + 37333, + 31959, + 12253, + 13, + 429, + 1117, + 36382, + 37333, + 31959, + 12253, + 11, + 839, + 3185, + 372, + 254, + 440, + 782, + 62245, + 53328, + 1084, + 317, + 245, + 2592, + 280, + 456, + 95663, + 285, + 28830, + 10117, + 26075, + 48794, + 13, + 1955, + 418, + 21929, + 457, + 704, + 4730, + 3123, + 4327, + 11, + 588, + 5312, + 245, + 4077, + 280, + 88579, + 19352, + 17090, + 9618, + 1760, + 11, + 5539, + 12, + 4018, + 52086, + 845, + 7300, + 13, + 185, + 185, + 34, + 10748, + 31959, + 12253, + 8217, + 418, + 9184, + 1503, + 5329, + 366, + 3947, + 28075, + 585, + 533, + 11, + 2847, + 254, + 1853, + 60961, + 271, + 20712, + 15979, + 6346, + 2330, + 13, + 3410, + 28957, + 481, + 330, + 63898, + 410, + 936, + 660, + 266, + 3737, + 11, + 366, + 254, + 48794, + 87341, + 473, + 254, + 3697, + 6, + 82, + 4342, + 285, + 8244, + 13, + 429, + 5306, + 1439, + 254, + 3697, + 28075, + 585, + 533, + 285, + 254, + 37333, + 31959, + 12253, + 317, + 441, + 1136, + 12, + 68768, + 11, + 285, + 359, + 317, + 2198, + 344, + 745, + 418, + 691, + 3697, + 8217, + 285, + 37333, + 31959, + 12253, + 8217, + 2618, + 276, + 330, + 9351, + 13, + 185, + 185, + 549, + 8217, + 280, + 37333, + 31959, + 12253, + 331, + 415, + 13, + 28947, + 3969, + 319, + 643, + 441, + 803, + 5734, + 11, + 588, + 2456, + 344, + 745, + 317, + 1592, + 1266, + 276, + 3071, + 786, + 437, + 4730, + 2592, + 280, + 48794, + 13, + 1733, + 3977, + 11106, + 11, + 359, + 317, + 4135, + 344, + 769, + 6714, + 280, + 254, + 35298, + 11, + 74616, + 11, + 285, + 9259, + 280, + 37333, + 31959, + 12253, + 543, + 7677, + 11, + 7057, + 11597, + 21625, + 881, + 254, + 20219, + 285, + 13913, + 280, + 26075, + 1728, + 13, + 100001 + ], + "generated_token_ids_sha256": "e23b1febca81e61822e794027287b2b42944cbe1936ef3b6ae801b2744046d3d", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " The three clawed lobster species, Homarus gammarus, H. americanus, and Nephrops norvegicus, are known to host the three known species of the phylum Cycliophora. The phylum Cycliophora, also known as the \"spaghetti worms,\" is a group of enigmatic and poorly understood marine organisms. They are characterized by their unique body structure, which includes a series of articulated rings bearing numerous small, hair-like sensory setae.\n\nCycliophora species are typically found associated with various crustaceans, including the three clawed lobsters mentioned above. These associations can be parasitic or commensalistic, with the organisms benefiting from the host's environment and protection. The relationship between the host crustaceans and the Cycliophora is not well-studied, and it is possible that there are more host species and Cycliophora species yet to be discovered.\n\nThe species of Cycliophora on H. gammarus has not been described, which means that there is still much to learn about this unique group of organisms. As research continues, it is likely that our understanding of the biology, ecology, and evolution of Cycliophora will expand, providing valuable insights into the diversity and complexity of marine life.", + "text_sha256": "1525f681ec388cd77186d4bfe1965fc500d19e328ea1699c0fa3854d699e1842", + "task_score": null + }, + { + "condition": "s1_period", + "factors": { + "system": 1, + "history": "filler", + "boundary": "period", + "token_class": "ordinary_control" + }, + "prompt_tokens": 93, + "left_padding_tokens": 0, + "prompt_token_ids_sha256": "53daf77913f36d0e7e677b84720bb9b1008ef3da6f69ba980ee2716abf6ae18a", + "generated_tokens": 71, + "generated_token_ids": [ + 429, + 1853, + 60961, + 271, + 67859, + 8217, + 6346, + 279, + 254, + 2432, + 418, + 13653, + 49238, + 28947, + 3969, + 319, + 11, + 415, + 13, + 41478, + 319, + 11, + 285, + 26955, + 71, + 30640, + 5068, + 313, + 15700, + 319, + 13, + 3410, + 8217, + 418, + 3185, + 276, + 3697, + 254, + 1853, + 3185, + 8217, + 280, + 254, + 1117, + 36382, + 37333, + 31959, + 12253, + 13, + 3159, + 11, + 254, + 8217, + 280, + 37333, + 31959, + 12253, + 1503, + 331, + 415, + 13, + 28947, + 3969, + 319, + 463, + 441, + 803, + 5734, + 2618, + 13, + 100001 + ], + "generated_token_ids_sha256": "050748807bbfacad32bd2c4cf1f3ed49d5a8ebe88f6978b904885fcae736301a", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " The three clawed lobster species mentioned in the text are Homarus gammarus, H. americanus, and Nephrops norvegicus. These species are known to host the three known species of the phylum Cycliophora. However, the species of Cycliophora found on H. gammarus have not been described yet.", + "text_sha256": "3106fa8213affa199be9a8a121cdbc7fdec645bd8df45dd35bf7e6f4d4b641bd", + "task_score": null + } + ] + }, + { + "id": "wikitext2/raw-validation/2909", + "domain": "english", + "label": "English encyclopedia", + "within_domain_index": 2, + "selection_rank": "00a0c873d028d892e454883e687d7af51aee2831fe2f7884668ca6dfe0d681c8", + "source_text_sha256": "0a2652ac9273b261bc16986c9fa848ca19ccab027dd1ca4a6e1f80f35b07ff4f", + "source_characters": 1135, + "source_tokens": 246, + "prompt_tokens_by_condition": { + "s0_eos": 271, + "s1_eos": 287, + "s0_bos": 271, + "s1_bos": 287, + "s0_x": 271, + "s1_x": 287, + "s0_period": 271, + "s1_period": 287 + }, + "batch_prompt_tokens_after_left_padding": 287, + "batch_padding_side": "left", + "batch_conditions": 8, + "generation_seconds": 95.77568304599845, + "peak_cuda_memory_allocated_bytes": 31451042816, + "generated_tokens_including_batch_padding": 4096, + "outputs": [ + { + "condition": "s0_eos", + "factors": { + "system": 0, + "history": "filler", + "boundary": "eos", + "token_class": "special" + }, + "prompt_tokens": 271, + "left_padding_tokens": 16, + "prompt_token_ids_sha256": "f351730b4ead703efd8bdbb965f9c71dc6dc252bb77ac99dd89451c751701b23", + "generated_tokens": 142, + "generated_token_ids": [ + 685, + 2976, + 3073, + 11, + 207, + 18, + 433, + 1530, + 2674, + 276, + 76858, + 279, + 6175, + 207, + 16, + 24, + 21, + 20, + 285, + 17552, + 745, + 2645, + 6904, + 13, + 1955, + 19556, + 366, + 75649, + 8271, + 1313, + 2602, + 285, + 7629, + 768, + 2567, + 4194, + 13, + 207, + 19, + 433, + 1530, + 661, + 245, + 2246, + 12351, + 766, + 473, + 6511, + 276, + 6692, + 207, + 16, + 24, + 21, + 21, + 13, + 1955, + 839, + 17033, + 254, + 5792, + 285, + 19556, + 254, + 29386, + 3752, + 245, + 1860, + 2602, + 13, + 338, + 3038, + 2592, + 2424, + 254, + 57821, + 49, + 839, + 2674, + 276, + 76858, + 279, + 207, + 16, + 24, + 21, + 20, + 285, + 207, + 16, + 24, + 21, + 21, + 13, + 1955, + 1216, + 6486, + 735, + 4627, + 285, + 12392, + 254, + 29386, + 3752, + 245, + 2603, + 13, + 7065, + 5860, + 837, + 39070, + 11, + 24282, + 11, + 285, + 35986, + 15007, + 839, + 8579, + 13, + 429, + 3207, + 5206, + 3320, + 6, + 83, + 536, + 1266, + 11, + 548, + 657, + 744, + 463, + 2368, + 691, + 565, + 254, + 4429, + 2149, + 11985, + 13, + 100001 + ], + "generated_token_ids_sha256": "33ce06ffe8b475668c9d887ebea300697edec719af0d94e10bc38ee8f76d27ea", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " In simple words, 3 RAR went to Borneo in March 1965 and stayed there until July. They fought with Indonesian forces many times and caused them big problems. 4 RAR had a less exciting time from April to August 1966. They also crossed the border and fought the Indonesians a few times. A special group called the SASR also went to Borneo in 1965 and 1966. They did secret spying and hurt the Indonesians a lot. Other groups like artillery, engineers, and navy ships also helped. The air force didn't do much, but they would have done more if the war got bigger.", + "text_sha256": "e24a82cff6f22d89df8acadc86c213a779f563c7dab2f10f55a4875cc6fb5527", + "task_score": null + }, + { + "condition": "s1_eos", + "factors": { + "system": 1, + "history": "filler", + "boundary": "eos", + "token_class": "special" + }, + "prompt_tokens": 287, + "left_padding_tokens": 0, + "prompt_token_ids_sha256": "828b146d4942f4a056c20318b99f14c8885a9a20b7bf037ea4e88358e43ebc28", + "generated_tokens": 135, + "generated_token_ids": [ + 685, + 2976, + 3073, + 11, + 207, + 18, + 433, + 1530, + 2674, + 276, + 76858, + 279, + 6175, + 207, + 16, + 24, + 21, + 20, + 285, + 17552, + 745, + 2645, + 6904, + 13, + 1955, + 19556, + 366, + 75649, + 8271, + 1313, + 2602, + 285, + 7629, + 768, + 2567, + 16384, + 13, + 207, + 19, + 433, + 1530, + 661, + 245, + 2246, + 12351, + 6973, + 473, + 6511, + 276, + 6692, + 207, + 16, + 24, + 21, + 21, + 13, + 1955, + 839, + 19556, + 366, + 254, + 29386, + 3752, + 285, + 661, + 742, + 2636, + 13, + 338, + 3038, + 2592, + 473, + 254, + 57821, + 49, + 839, + 2674, + 745, + 279, + 207, + 16, + 24, + 21, + 20, + 285, + 207, + 16, + 24, + 21, + 21, + 276, + 28230, + 331, + 254, + 29386, + 3752, + 285, + 12392, + 768, + 13, + 7065, + 5860, + 837, + 39070, + 11, + 24282, + 11, + 285, + 35986, + 15007, + 839, + 8579, + 13, + 429, + 3207, + 5206, + 661, + 245, + 6611, + 697, + 11, + 548, + 657, + 744, + 463, + 803, + 691, + 6591, + 565, + 254, + 4429, + 2149, + 11985, + 13, + 100001 + ], + "generated_token_ids_sha256": "06b654a446b3228f482f7f90f179dd398769214c76636e1ac90da674133c2486", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " In simple words, 3 RAR went to Borneo in March 1965 and stayed there until July. They fought with Indonesian forces many times and caused them big losses. 4 RAR had a less exciting tour from April to August 1966. They also fought with the Indonesians and had some success. A special group from the SASR also went there in 1965 and 1966 to spy on the Indonesians and hurt them. Other groups like artillery, engineers, and navy ships also helped. The air force had a smaller part, but they would have been more involved if the war got bigger.", + "text_sha256": "e6298eb2adbc6b0512a07e5aa5d03f0a36de4fc9e56b2cd2db6a0b6219de8a3f", + "task_score": null + }, + { + "condition": "s0_bos", + "factors": { + "system": 0, + "history": "filler", + "boundary": "bos", + "token_class": "special" + }, + "prompt_tokens": 271, + "left_padding_tokens": 16, + "prompt_token_ids_sha256": "8875f01e38100671f6936d9be4b440b2f9e976bad3b4c5d8f6734bfe4726210f", + "generated_tokens": 235, + "generated_token_ids": [ + 685, + 2976, + 3073, + 11, + 207, + 18, + 433, + 1530, + 11, + 245, + 2592, + 280, + 13474, + 11, + 2674, + 276, + 245, + 1810, + 2424, + 76858, + 279, + 6175, + 207, + 16, + 24, + 21, + 20, + 13, + 1955, + 17552, + 745, + 2645, + 6904, + 285, + 1216, + 8284, + 280, + 2012, + 837, + 13286, + 366, + 742, + 750, + 13474, + 473, + 245, + 1810, + 2424, + 35580, + 13, + 1955, + 661, + 2685, + 2567, + 38594, + 285, + 245, + 14907, + 280, + 6611, + 4866, + 13, + 1955, + 12392, + 254, + 29386, + 3752, + 1921, + 3806, + 279, + 742, + 280, + 1069, + 38594, + 13, + 1474, + 11, + 657, + 839, + 661, + 742, + 26772, + 366, + 28680, + 285, + 4739, + 742, + 13474, + 13, + 185, + 185, + 4631, + 11, + 279, + 207, + 16, + 24, + 21, + 21, + 11, + 1913, + 2592, + 280, + 13474, + 2424, + 207, + 19, + 433, + 1530, + 2674, + 276, + 76858, + 473, + 6511, + 276, + 6692, + 13, + 1955, + 839, + 19556, + 366, + 254, + 29386, + 3752, + 285, + 661, + 742, + 2567, + 38594, + 13, + 338, + 3038, + 2592, + 280, + 13474, + 473, + 57821, + 49, + 839, + 2674, + 745, + 279, + 207, + 16, + 24, + 21, + 20, + 285, + 207, + 16, + 24, + 21, + 21, + 276, + 28230, + 331, + 254, + 29386, + 3752, + 285, + 12392, + 768, + 1653, + 13, + 2071, + 778, + 750, + 5860, + 280, + 13474, + 837, + 2460, + 16716, + 59654, + 285, + 24282, + 779, + 839, + 8579, + 13, + 4754, + 15007, + 473, + 254, + 433, + 1945, + 11, + 245, + 35986, + 11, + 8579, + 457, + 15698, + 430, + 254, + 29386, + 3752, + 285, + 18393, + 768, + 473, + 94326, + 881, + 76858, + 13, + 429, + 433, + 5413, + 37, + 11, + 1913, + 2592, + 280, + 13474, + 11, + 3320, + 6, + 83, + 536, + 372, + 1266, + 11, + 548, + 657, + 744, + 463, + 2368, + 691, + 565, + 254, + 13286, + 2149, + 11985, + 13, + 100001 + ], + "generated_token_ids_sha256": "1ccc9f8691c63cb903fb79acb4a010e484e6fda4311234ee81a8504ee8ca9cd0", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " In simple words, 3 RAR, a group of soldiers, went to a place called Borneo in March 1965. They stayed there until July and did lots of things like fighting with some other soldiers from a place called Indonesia. They had four big fights and a bunch of smaller ones. They hurt the Indonesians really bad in some of these fights. But, they also had some accidents with mines and lost some soldiers.\n\nThen, in 1966, another group of soldiers called 4 RAR went to Borneo from April to August. They also fought with the Indonesians and had some big fights. A special group of soldiers from SASR also went there in 1965 and 1966 to spy on the Indonesians and hurt them too. There were other groups of soldiers like artillerymen and engineers who also helped. Some ships from the RAN, a navy, helped by shooting at the Indonesians and stopping them from sneaking into Borneo. The RAAF, another group of soldiers, didn't do as much, but they would have done more if the fighting got bigger.", + "text_sha256": "0e509e29cd5d4a74f241c1cf13f4508f99275d93602cb8f50703d8ffbe2391ef", + "task_score": null + }, + { + "condition": "s1_bos", + "factors": { + "system": 1, + "history": "filler", + "boundary": "bos", + "token_class": "special" + }, + "prompt_tokens": 287, + "left_padding_tokens": 0, + "prompt_token_ids_sha256": "53b29e76a427cc2665d67389a755451b0650683d3598eb6360670deac081ac74", + "generated_tokens": 213, + "generated_token_ids": [ + 685, + 2976, + 3073, + 11, + 207, + 18, + 433, + 1530, + 2674, + 276, + 76858, + 279, + 6175, + 207, + 16, + 24, + 21, + 20, + 285, + 17552, + 745, + 2645, + 6904, + 13, + 1955, + 5168, + 331, + 1572, + 9226, + 280, + 254, + 5792, + 285, + 661, + 2685, + 2567, + 38594, + 366, + 75649, + 8271, + 13, + 1955, + 839, + 661, + 742, + 6611, + 38594, + 430, + 6171, + 837, + 5071, + 493, + 72, + 27748, + 370, + 3216, + 11, + 20531, + 1774, + 11, + 285, + 18550, + 673, + 13, + 1955, + 12392, + 254, + 29386, + 3752, + 245, + 2603, + 548, + 839, + 661, + 742, + 1245, + 12392, + 279, + 984, + 26772, + 366, + 28680, + 13, + 185, + 185, + 19, + 433, + 1530, + 661, + 245, + 2246, + 12351, + 766, + 473, + 6511, + 276, + 6692, + 207, + 16, + 24, + 21, + 21, + 13, + 1955, + 839, + 19556, + 254, + 29386, + 3752, + 855, + 254, + 5792, + 285, + 661, + 742, + 2567, + 15292, + 366, + 768, + 13, + 338, + 2592, + 473, + 254, + 12354, + 6582, + 7022, + 47163, + 334, + 97374, + 49, + 8, + 839, + 2674, + 745, + 279, + 207, + 16, + 24, + 21, + 20, + 285, + 207, + 16, + 24, + 21, + 21, + 276, + 28230, + 331, + 254, + 29386, + 3752, + 285, + 12392, + 768, + 1653, + 13, + 2071, + 778, + 750, + 5860, + 837, + 39070, + 285, + 24282, + 11, + 285, + 742, + 15007, + 473, + 254, + 433, + 1945, + 8579, + 457, + 15698, + 430, + 75649, + 6171, + 285, + 18393, + 1245, + 473, + 94326, + 3246, + 254, + 22316, + 83248, + 13, + 429, + 433, + 5413, + 37, + 3320, + 6, + 83, + 536, + 1266, + 11, + 548, + 657, + 744, + 463, + 2368, + 691, + 565, + 254, + 4429, + 2149, + 11985, + 13, + 100001 + ], + "generated_token_ids_sha256": "b5b676a9e27211af58670c61bddf8fa9e0b25ab9df5dc10feb4d699415af7f3d", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " In simple words, 3 RAR went to Borneo in March 1965 and stayed there until July. They worked on both sides of the border and had four big fights with Indonesian forces. They also had some smaller fights at places like Sungei Koemba, Kindau, and Babang. They hurt the Indonesians a lot but also had some people hurt in two accidents with mines.\n\n4 RAR had a less exciting time from April to August 1966. They also fought the Indonesians over the border and had some big meetings with them. A group from the Special Air Service Regiment (SASR) also went there in 1965 and 1966 to spy on the Indonesians and hurt them too. There were other groups like artillery and engineers, and some ships from the RAN helped by shooting at Indonesian places and stopping people from sneaking across the Singapore Strait. The RAAF didn't do much, but they would have done more if the war got bigger.", + "text_sha256": "e986a463a6234decd6b19580c7a3d708e92d44301ac853d4dceb25ca2e50a707", + "task_score": null + }, + { + "condition": "s0_x", + "factors": { + "system": 0, + "history": "filler", + "boundary": "x", + "token_class": "ordinary_control" + }, + "prompt_tokens": 271, + "left_padding_tokens": 16, + "prompt_token_ids_sha256": "eac4e491e87635d5b8be53b36d098ac2dbe11dd22939f3c71b565e31ccaae837", + "generated_tokens": 512, + "generated_token_ids": [ + 429, + 1757, + 340, + 6, + 313, + 4286, + 41241, + 254, + 25377, + 285, + 7772, + 280, + 254, + 15287, + 8271, + 11, + 7282, + 254, + 207, + 18, + 6132, + 83053, + 11, + 12040, + 15287, + 47163, + 334, + 18, + 433, + 1530, + 8, + 285, + 254, + 207, + 19, + 393, + 83053, + 11, + 12040, + 15287, + 47163, + 334, + 19, + 433, + 1530, + 654, + 2320, + 254, + 75649, + 1824, + 7657, + 335, + 11, + 839, + 3185, + 372, + 76858, + 37347, + 11, + 588, + 3061, + 1810, + 1439, + 207, + 16, + 24, + 21, + 17, + 285, + 207, + 16, + 24, + 21, + 21, + 13, + 1002, + 14174, + 438, + 245, + 4077, + 280, + 5792, + 97462, + 1439, + 35580, + 285, + 33647, + 334, + 6091, + 6826, + 16401, + 8, + 855, + 254, + 20119, + 280, + 76858, + 11, + 10173, + 254, + 4605, + 280, + 10898, + 2268, + 559, + 285, + 5226, + 76858, + 334, + 2795, + 697, + 280, + 33647, + 633, + 185, + 185, + 4898, + 6, + 82, + 245, + 13569, + 280, + 254, + 2131, + 3487, + 473, + 520, + 2432, + 25, + 185, + 185, + 16, + 13, + 9217, + 18, + 433, + 1530, + 86446, + 59668, + 429, + 207, + 18, + 433, + 1530, + 438, + 30402, + 276, + 76858, + 279, + 6175, + 207, + 16, + 24, + 21, + 20, + 285, + 8719, + 279, + 10898, + 2268, + 559, + 2645, + 254, + 1225, + 280, + 6904, + 13, + 1955, + 21750, + 331, + 1572, + 9226, + 280, + 254, + 5792, + 11, + 22021, + 279, + 2971, + 3144, + 285, + 10398, + 18917, + 366, + 75649, + 8271, + 13, + 429, + 73984, + 57297, + 6751, + 73000, + 331, + 254, + 29386, + 3752, + 430, + 10582, + 1108, + 372, + 5071, + 493, + 72, + 27748, + 370, + 3216, + 11, + 20531, + 1774, + 11, + 285, + 18550, + 673, + 13, + 3159, + 11, + 657, + 839, + 15203, + 73000, + 279, + 984, + 7207, + 27478, + 13, + 185, + 185, + 17, + 13, + 9217, + 19, + 433, + 1530, + 86446, + 59668, + 429, + 207, + 19, + 433, + 1530, + 661, + 245, + 2246, + 99684, + 6973, + 1439, + 6511, + 285, + 6692, + 207, + 16, + 24, + 21, + 21, + 13, + 1955, + 839, + 21750, + 855, + 254, + 5792, + 285, + 10081, + 497, + 8153, + 366, + 254, + 29386, + 3752, + 331, + 4606, + 19356, + 13, + 185, + 185, + 18, + 13, + 9217, + 21971, + 6582, + 7022, + 47163, + 334, + 97374, + 49, + 8, + 59668, + 338, + 57115, + 280, + 254, + 57821, + 49, + 438, + 30402, + 279, + 1572, + 207, + 16, + 24, + 21, + 20, + 285, + 207, + 16, + 24, + 21, + 21, + 13, + 1955, + 29930, + 279, + 4234, + 12, + 12189, + 7772, + 285, + 57297, + 4485, + 73000, + 331, + 254, + 29386, + 3752, + 11, + 2752, + 6591, + 279, + 64969, + 9083, + 98352, + 24346, + 13, + 185, + 185, + 19, + 13, + 9217, + 10978, + 7453, + 59668, + 6596, + 27319, + 285, + 22183, + 8650, + 778, + 839, + 6591, + 11, + 2726, + 366, + 12040, + 15287, + 24552, + 334, + 49, + 1945, + 8, + 15007, + 344, + 8477, + 271, + 75649, + 11275, + 279, + 76858, + 285, + 1447, + 6677, + 59391, + 3416, + 279, + 254, + 22316, + 83248, + 13, + 185, + 185, + 20, + 13, + 9217, + 49, + 5413, + 37, + 35824, + 59668, + 429, + 12040, + 15287, + 6582, + 18095, + 334, + 49, + 5413, + 37, + 8, + 7222, + 245, + 10291, + 10398, + 5012, + 11, + 548, + 359, + 744, + 463, + 803, + 691, + 12885, + 661, + 254, + 14174, + 19221, + 616, + 13, + 185, + 185, + 549, + 75649, + 1824, + 7657, + 335, + 438, + 245, + 15020, + 4429, + 1439, + 35580, + 285, + 254, + 12732, + 12, + 54093, + 33647, + 11, + 366, + 10011, + 285, + 2006, + 18457, + 7057, + 1855, + 276, + 33647, + 13, + 429, + 14174, + 438, + 21929, + 457, + 62309, + 4629, + 42354, + 11, + 366, + 1572, + 9226, + 22021, + 279, + 5906, + 12, + 384, + 12, + 5620, + 32513, + 285, + 1065, + 22847, + 13, + 429, + 15287, + 8271, + 11, + 2726, + 366, + 704, + 32758, + 11, + 778, + 6591, + 279, + 245, + 3169, + 280, + 7772, + 276, + 8159, + 254, + 5792, + 285, + 4088, + 704, + 11582, + 279, + 76858, + 13, + 185, + 185, + 1385, + 6, + 82, + 2375, + 276, + 4347, + 344, + 254, + 75649, + 1824, + 7657, + 335, + 317 + ], + "generated_token_ids_sha256": "bc5ca304310298065d081cb556c715a60012b317f21982845287a8b0787d5d48", + "hit_eos": false, + "stopped_at_max_new_tokens": true, + "text": " The information you've provided outlines the deployment and operations of the Australian forces, particularly the 3rd Battalion, Royal Australian Regiment (3 RAR) and the 4th Battalion, Royal Australian Regiment (4 RAR), during the Indonesian Confrontation, also known as Borneo Campaign, which took place between 1962 and 1966. This conflict was a series of border clashes between Indonesia and Malaysia (then Malaya) over the territory of Borneo, specifically the states of Sarawak and North Borneo (now part of Malaysia).\n\nHere's a summary of the key points from your text:\n\n1. **3 RAR Deployment**: The 3 RAR was deployed to Borneo in March 1965 and served in Sarawak until the end of July. They operated on both sides of the border, engaging in several major and minor contacts with Indonesian forces. The battalion inflicted heavy casualties on the Indonesians at locations such as Sungei Koemba, Kindau, and Babang. However, they also suffered casualties in two mine incidents.\n\n2. **4 RAR Deployment**: The 4 RAR had a less eventful tour between April and August 1966. They also operated over the border and successfully clashed with the Indonesians on multiple occasions.\n\n3. **Special Air Service Regiment (SASR)**: A squadron of the SASR was deployed in both 1965 and 1966. They participated in cross-border operations and inflicted significant casualties on the Indonesians, often involved in covert reconnaissance missions.\n\n4. **Other Units**: Artillery and engineer units were also involved, along with Royal Australian Navy (RAN) ships that shelled Indonesian positions in Borneo and repelled infiltrators in the Singapore Strait.\n\n5. **RAAF Role**: The Royal Australian Air Force (RAAF) played a relatively minor role, but it would have been more extensive had the conflict escalated.\n\nThe Indonesian Confrontation was a proxy war between Indonesia and the Western-backed Malaysia, with Australia and New Zealand providing support to Malaysia. The conflict was characterized by guerrilla warfare, with both sides engaging in hit-and-run tactics and ambushes. The Australian forces, along with their allies, were involved in a range of operations to secure the border and protect their interests in Borneo.\n\nIt's important to note that the Indonesian Confrontation is", + "text_sha256": "023cd2de0ec837b58aa10bde2d4452f0afd5bf9a8673d743e41c5511488acb80", + "task_score": null + }, + { + "condition": "s1_x", + "factors": { + "system": 1, + "history": "filler", + "boundary": "x", + "token_class": "ordinary_control" + }, + "prompt_tokens": 287, + "left_padding_tokens": 0, + "prompt_token_ids_sha256": "b6a531104c06467cbd5f3b44a190f074c190b7b82be815dc9fc28e844c57d119", + "generated_tokens": 142, + "generated_token_ids": [ + 685, + 2976, + 3073, + 11, + 207, + 18, + 433, + 1530, + 2674, + 276, + 76858, + 279, + 6175, + 207, + 16, + 24, + 21, + 20, + 285, + 17552, + 745, + 2645, + 6904, + 13, + 1955, + 19556, + 366, + 75649, + 8271, + 1313, + 2602, + 285, + 661, + 742, + 2567, + 285, + 1760, + 38594, + 13, + 1955, + 12392, + 254, + 29386, + 3752, + 245, + 2603, + 548, + 839, + 661, + 742, + 1245, + 12392, + 279, + 26772, + 13, + 207, + 19, + 433, + 1530, + 661, + 245, + 2246, + 12351, + 766, + 473, + 6511, + 276, + 6692, + 207, + 16, + 24, + 21, + 21, + 11, + 548, + 657, + 839, + 19556, + 254, + 29386, + 3752, + 3246, + 254, + 5792, + 13, + 338, + 3038, + 2592, + 473, + 254, + 57821, + 49, + 839, + 8579, + 11, + 285, + 657, + 1216, + 6486, + 735, + 4627, + 285, + 12392, + 254, + 29386, + 3752, + 1653, + 13, + 7065, + 5860, + 837, + 254, + 39070, + 285, + 24282, + 11, + 285, + 742, + 35986, + 15007, + 8579, + 1653, + 11, + 548, + 254, + 3207, + 5206, + 3320, + 6, + 83, + 536, + 1266, + 1373, + 657, + 2215, + 254, + 4429, + 1667, + 752, + 11985, + 13, + 100001 + ], + "generated_token_ids_sha256": "880bbc18fa94033a371df7a7879c5893e54fae7cf87a7f1234c5104bf79e05a5", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " In simple words, 3 RAR went to Borneo in March 1965 and stayed there until July. They fought with Indonesian forces many times and had some big and small fights. They hurt the Indonesians a lot but also had some people hurt in accidents. 4 RAR had a less exciting time from April to August 1966, but they also fought the Indonesians across the border. A special group from the SASR also helped, and they did secret spying and hurt the Indonesians too. Other groups like the artillery and engineers, and some navy ships helped too, but the air force didn't do much because they thought the war might get bigger.", + "text_sha256": "231053fbdea7cf31e082c1c2266168023f8febe93c05bc71497df7f689fd97cb", + "task_score": null + }, + { + "condition": "s0_period", + "factors": { + "system": 0, + "history": "filler", + "boundary": "period", + "token_class": "ordinary_control" + }, + "prompt_tokens": 271, + "left_padding_tokens": 16, + "prompt_token_ids_sha256": "196d96f2e2e7d02fe46977d4c8c3532719ff777ddb94899be9ffd2549358a744", + "generated_tokens": 236, + "generated_token_ids": [ + 685, + 2976, + 3073, + 11, + 207, + 18, + 433, + 1530, + 334, + 64, + 2592, + 280, + 13474, + 8, + 2674, + 276, + 245, + 1810, + 2424, + 76858, + 279, + 6175, + 207, + 16, + 24, + 21, + 20, + 13, + 1955, + 17552, + 745, + 2645, + 6904, + 285, + 1216, + 1313, + 2012, + 837, + 13286, + 366, + 742, + 750, + 2592, + 2424, + 75649, + 8271, + 13, + 1955, + 661, + 2685, + 2567, + 38594, + 285, + 742, + 6611, + 4866, + 13, + 1955, + 12392, + 254, + 75649, + 8271, + 245, + 2603, + 285, + 839, + 661, + 742, + 1245, + 12392, + 279, + 984, + 26772, + 13, + 185, + 185, + 19, + 433, + 1530, + 334, + 18168, + 2592, + 280, + 13474, + 8, + 2674, + 276, + 76858, + 1439, + 6511, + 285, + 6692, + 207, + 16, + 24, + 21, + 21, + 13, + 1955, + 839, + 19556, + 366, + 254, + 75649, + 8271, + 285, + 661, + 742, + 38594, + 13, + 338, + 3038, + 2592, + 2424, + 57821, + 49, + 334, + 21971, + 6582, + 7022, + 47163, + 8, + 839, + 2674, + 745, + 279, + 207, + 16, + 24, + 21, + 20, + 285, + 207, + 16, + 24, + 21, + 21, + 13, + 1955, + 1216, + 6486, + 2012, + 276, + 1275, + 636, + 786, + 254, + 75649, + 8271, + 285, + 12392, + 768, + 1653, + 13, + 185, + 185, + 2960, + 778, + 750, + 5860, + 837, + 39070, + 334, + 15440, + 779, + 938, + 2567, + 17018, + 8, + 285, + 24282, + 334, + 15440, + 779, + 2297, + 285, + 2876, + 2012, + 8, + 1653, + 13, + 4754, + 15007, + 473, + 254, + 433, + 1945, + 334, + 50602, + 15287, + 24552, + 8, + 8579, + 457, + 15698, + 430, + 254, + 75649, + 8271, + 285, + 18393, + 1245, + 473, + 18960, + 881, + 76858, + 13, + 429, + 433, + 5413, + 37, + 334, + 50602, + 15287, + 6582, + 18095, + 8, + 3320, + 6, + 83, + 536, + 1266, + 11, + 548, + 657, + 744, + 463, + 2368, + 691, + 565, + 254, + 4429, + 2149, + 11985, + 13, + 100001 + ], + "generated_token_ids_sha256": "88a00106018522fc499ca70c3d07f0b86ab5527748a0d961aa60e7e407c0091e", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " In simple words, 3 RAR (a group of soldiers) went to a place called Borneo in March 1965. They stayed there until July and did many things like fighting with some other group called Indonesian forces. They had four big fights and some smaller ones. They hurt the Indonesian forces a lot and also had some people hurt in two accidents.\n\n4 RAR (another group of soldiers) went to Borneo between April and August 1966. They also fought with the Indonesian forces and had some fights. A special group called SASR (Special Air Service Regiment) also went there in 1965 and 1966. They did secret things to find out about the Indonesian forces and hurt them too.\n\nThere were other groups like artillery (people who use big guns) and engineers (people who build and fix things) too. Some ships from the RAN (Royal Australian Navy) helped by shooting at the Indonesian forces and stopping people from crossing into Borneo. The RAAF (Royal Australian Air Force) didn't do much, but they would have done more if the war got bigger.", + "text_sha256": "c8b85ee1dfa223abeb7b2d9af1a84db7efc05df5dbf64c92062cf77983b9df77", + "task_score": null + }, + { + "condition": "s1_period", + "factors": { + "system": 1, + "history": "filler", + "boundary": "period", + "token_class": "ordinary_control" + }, + "prompt_tokens": 287, + "left_padding_tokens": 0, + "prompt_token_ids_sha256": "166f5c3702fbb44766f23f3611d9182bf641293cd2b643e83c2e066b256a0f3f", + "generated_tokens": 229, + "generated_token_ids": [ + 207, + 18, + 433, + 1530, + 438, + 30402, + 276, + 76858, + 279, + 6175, + 207, + 16, + 24, + 21, + 20, + 285, + 8719, + 279, + 10898, + 2268, + 559, + 2645, + 254, + 1225, + 280, + 6904, + 13, + 1955, + 21750, + 331, + 1572, + 9226, + 280, + 254, + 5792, + 285, + 661, + 2685, + 3144, + 18917, + 366, + 75649, + 8271, + 11, + 372, + 1136, + 372, + 2971, + 6611, + 4866, + 13, + 11399, + 1069, + 58129, + 11, + 657, + 57297, + 6751, + 73000, + 331, + 254, + 29386, + 3752, + 548, + 839, + 15203, + 73000, + 279, + 984, + 7207, + 27478, + 13, + 185, + 185, + 19, + 433, + 1530, + 661, + 245, + 2246, + 99684, + 6973, + 1439, + 6511, + 285, + 6692, + 207, + 16, + 24, + 21, + 21, + 11, + 839, + 9190, + 855, + 254, + 5792, + 285, + 497, + 5693, + 366, + 254, + 29386, + 3752, + 331, + 4606, + 19356, + 13, + 338, + 57115, + 280, + 254, + 12354, + 6582, + 7022, + 47163, + 334, + 97374, + 49, + 8, + 438, + 30402, + 279, + 207, + 16, + 24, + 21, + 20, + 285, + 207, + 16, + 24, + 21, + 21, + 11, + 23438, + 279, + 4234, + 12, + 12189, + 7772, + 285, + 1635, + 73367, + 4485, + 73000, + 331, + 254, + 29386, + 3752, + 1184, + 64969, + 9083, + 98352, + 13, + 185, + 185, + 10978, + 8650, + 6591, + 279, + 254, + 14174, + 5598, + 39070, + 285, + 24282, + 11, + 1477, + 245, + 1604, + 280, + 12040, + 15287, + 24552, + 334, + 49, + 1945, + 8, + 15007, + 778, + 6591, + 279, + 8477, + 272, + 75649, + 11275, + 279, + 76858, + 285, + 1447, + 4192, + 59391, + 3416, + 279, + 254, + 22316, + 83248, + 13, + 429, + 12040, + 15287, + 6582, + 18095, + 334, + 49, + 5413, + 37, + 8, + 7222, + 245, + 10291, + 10398, + 5012, + 11, + 548, + 744, + 463, + 803, + 1222, + 691, + 31412, + 661, + 254, + 4429, + 19221, + 616, + 13, + 100001 + ], + "generated_token_ids_sha256": "4ee1e832b867636022c930bf8b3ef942c1bdc40c8ac3d0fc8470fbe197c0fe2b", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " 3 RAR was deployed to Borneo in March 1965 and served in Sarawak until the end of July. They operated on both sides of the border and had four major contacts with Indonesian forces, as well as several smaller ones. During these engagements, they inflicted heavy casualties on the Indonesians but also suffered casualties in two mine incidents.\n\n4 RAR had a less eventful tour between April and August 1966, also operating over the border and clashing with the Indonesians on multiple occasions. A squadron of the Special Air Service Regiment (SASR) was deployed in 1965 and 1966, participating in cross-border operations and inflicting significant casualties on the Indonesians through covert reconnaissance.\n\nOther units involved in the conflict included artillery and engineers, while a number of Royal Australian Navy (RAN) ships were involved in shelling Indonesian positions in Borneo and repelling infiltrators in the Singapore Strait. The Royal Australian Air Force (RAAF) played a relatively minor role, but would have been used more extensively had the war escalated.", + "text_sha256": "ceb73474c27d9ab6b50e8314da2dd8ba5fd7b4f2680ca8437923008d4d3e6f34", + "task_score": null + } + ] + }, + { + "id": "wikitext2/raw-validation/2746", + "domain": "english", + "label": "English encyclopedia", + "within_domain_index": 3, + "selection_rank": "00c7a9a1b242b365225d7fdeec777508a5a3d90a76a7cf4cd2e93cee8f1693f4", + "source_text_sha256": "db6c8fe80331ee2c8bdb59c70bba8ad3e62d8c4bdf7a943331bd72023853a086", + "source_characters": 1358, + "source_tokens": 250, + "prompt_tokens_by_condition": { + "s0_eos": 274, + "s1_eos": 290, + "s0_bos": 274, + "s1_bos": 290, + "s0_x": 274, + "s1_x": 290, + "s0_period": 274, + "s1_period": 290 + }, + "batch_prompt_tokens_after_left_padding": 290, + "batch_padding_side": "left", + "batch_conditions": 8, + "generation_seconds": 123.13212545699207, + "peak_cuda_memory_allocated_bytes": 31464357376, + "generated_tokens_including_batch_padding": 4096, + "outputs": [ + { + "condition": "s0_eos", + "factors": { + "system": 0, + "history": "filler", + "boundary": "eos", + "token_class": "special" + }, + "prompt_tokens": 274, + "left_padding_tokens": 16, + "prompt_token_ids_sha256": "d7caa73b2e4542fc0775a98a4dea21e424ecfebdeab0c0d36068d6828239c4ad", + "generated_tokens": 512, + "generated_token_ids": [ + 429, + 14174, + 1439, + 8713, + 46514, + 285, + 66720, + 1245, + 279, + 10011, + 438, + 245, + 4301, + 285, + 50424, + 306, + 29401, + 3616, + 11, + 366, + 1572, + 9226, + 2497, + 704, + 1377, + 76796, + 285, + 11830, + 13, + 809, + 317, + 2375, + 276, + 13341, + 344, + 254, + 13092, + 3377, + 317, + 2752, + 29444, + 285, + 3605, + 276, + 15818, + 11, + 285, + 4573, + 688, + 94705, + 280, + 254, + 14174, + 1023, + 330, + 20521, + 366, + 25139, + 13, + 185, + 185, + 549, + 25483, + 344, + 254, + 14174, + 438, + 441, + 634, + 12, + 35029, + 285, + 344, + 66720, + 1245, + 778, + 441, + 21019, + 8872, + 327, + 254, + 26197, + 280, + 57409, + 317, + 274, + 2375, + 634, + 13, + 809, + 317, + 1927, + 344, + 254, + 57409, + 661, + 4485, + 31342, + 285, + 65958, + 16037, + 11, + 2847, + 59613, + 11, + 588, + 4366, + 768, + 245, + 4485, + 5941, + 279, + 3769, + 280, + 4043, + 9015, + 285, + 28735, + 13, + 3159, + 11, + 437, + 1217, + 441, + 56975, + 254, + 1714, + 344, + 66720, + 1245, + 778, + 13286, + 327, + 704, + 3114, + 11, + 704, + 1143, + 280, + 1728, + 11, + 285, + 704, + 22685, + 2481, + 245, + 8133, + 285, + 2752, + 83362, + 87519, + 5206, + 13, + 185, + 185, + 32, + 4439, + 312, + 1596, + 32513, + 11, + 372, + 340, + 7183, + 768, + 11, + 778, + 2853, + 331, + 840, + 12, + 32948, + 19386, + 285, + 13286, + 11961, + 13, + 3410, + 32513, + 778, + 5463, + 279, + 2569, + 26250, + 11, + 1108, + 372, + 279, + 62309, + 4629, + 42354, + 285, + 1065, + 22847, + 11, + 548, + 657, + 778, + 441, + 1958, + 6764, + 276, + 7114, + 254, + 8713, + 8931, + 1667, + 13, + 429, + 9123, + 280, + 1313, + 66720, + 5860, + 276, + 7679, + 276, + 254, + 761, + 10694, + 44294, + 457, + 254, + 57409, + 317, + 245, + 4485, + 6088, + 279, + 254, + 15672, + 280, + 254, + 14174, + 13, + 185, + 185, + 1385, + 317, + 839, + 4531, + 25496, + 344, + 254, + 57409, + 778, + 441, + 245, + 47727, + 60702, + 5206, + 13, + 2071, + 778, + 46514, + 779, + 28269, + 66720, + 52047, + 285, + 14144, + 24177, + 96270, + 11, + 1477, + 3072, + 778, + 691, + 25571, + 285, + 10995, + 382, + 279, + 704, + 39072, + 13, + 429, + 5306, + 1439, + 254, + 46514, + 285, + 254, + 66720, + 1245, + 438, + 441, + 1958, + 21929, + 457, + 14174, + 11, + 285, + 745, + 778, + 11705, + 280, + 7271, + 11, + 34343, + 11, + 285, + 1236, + 19422, + 13, + 185, + 185, + 549, + 25483, + 344, + 66720, + 5860, + 1866, + 5322, + 245, + 6082, + 8931, + 8165, + 276, + 254, + 57409, + 317, + 274, + 17935, + 16459, + 2863, + 13, + 5807, + 359, + 317, + 1927, + 344, + 254, + 57409, + 6051, + 661, + 254, + 6909, + 1297, + 11, + 745, + 778, + 28983, + 11705, + 1066, + 66720, + 8271, + 778, + 2249, + 276, + 77361, + 4485, + 73000, + 331, + 254, + 46514, + 13, + 3410, + 4378, + 778, + 2752, + 18202, + 285, + 1216, + 441, + 463, + 245, + 5846, + 5454, + 331, + 254, + 7705, + 14174, + 13, + 185, + 185, + 549, + 93670, + 280, + 2317, + 12, + 6706, + 29244, + 1439, + 66720, + 5860, + 285, + 8713, + 46514, + 317, + 245, + 4301, + 634, + 13, + 5807, + 254, + 57409, + 2752, + 661, + 254, + 7293, + 279, + 3769, + 280, + 4043, + 9015, + 285, + 7902, + 11, + 254, + 66720, + 938, + 280, + 5750, + 285, + 36147, + 1027, + 5024, + 2023, + 276, + 15201, + 18356, + 13, + 3159, + 11, + 1069, + 39935, + 2752, + 19891, + 279, + 6751, + 16384, + 327, + 254, + 66720, + 2387, + 11, + 372, + 254, + 57409, + 661, + 254, + 6177, + 276, + 11700, + 473, + 845, + 22928, + 285, + 4883, + 704, + 7800, + 13, + 185, + 185, + 774, + 12773, + 11, + 254, + 14174, + 1439, + 8713, + 46514, + 285, + 66720, + 1245, + 279, + 10011, + 438, + 245, + 35943, + 13217, + 279, + 254, + 4345, + 280, + 254, + 23948, + 13, + 809, + 317, + 245, + 13184, + 276, + 31237, + 359, + 372, + 634, + 12, + 35029, + 410, + 276, + 7996, + 18449, + 21019, + 276, + 634, + 2387, + 13, + 9848, + 5860, + 661, + 704, + 28512, + 285, + 44463, + 11, + 285, + 254, + 15672, + 438, + 24277 + ], + "generated_token_ids_sha256": "33bd39ced6e5e59e9ce18f9a05d5a7b67bfd42be3c62e250c77c66e759a41247", + "hit_eos": false, + "stopped_at_max_new_tokens": true, + "text": " The conflict between European settlers and Aboriginal people in Australia was a complex and multifaceted issue, with both sides having their own motivations and strategies. It is important to recognize that the historical record is often incomplete and subject to interpretation, and therefore any depiction of the conflict should be approached with caution.\n\nThe assertion that the conflict was not one-sided and that Aboriginal people were not solely responsible for the deaths of Europeans is an important one. It is true that the Europeans had significant technological and logistic advantages, including firearms, which gave them a significant edge in terms of firepower and mobility. However, this does not diminish the fact that Aboriginal people were fighting for their land, their way of life, and their survival against a powerful and often ruthless invading force.\n\nAboriginal tactics, as you describe them, were based on pre-existing hunting and fighting practices. These tactics were effective in certain contexts, such as in guerrilla warfare and ambushes, but they were not always sufficient to counter the European military might. The failure of many Aboriginal groups to adapt to the new challenges posed by the Europeans is a significant factor in the outcome of the conflict.\n\nIt is also worth noting that the Europeans were not a monolithic force. There were settlers who respected Aboriginal sovereignty and sought peaceful coexistence, while others were more aggressive and expansionist in their attitudes. The relationship between the settlers and the Aboriginal people was not always characterized by conflict, and there were instances of trade, alliance, and even friendship.\n\nThe assertion that Aboriginal groups never became a serious military threat to the Europeans is an oversimplification. While it is true that the Europeans generally had the upper hand, there were localized instances where Aboriginal forces were able to inflict significant casualties on the settlers. These events were often isolated and did not have a broad impact on the overall conflict.\n\nThe portrayal of large-scale battles between Aboriginal groups and European settlers is a complex one. While the Europeans often had the advantage in terms of firepower and organization, the Aboriginal use of numbers and terrain could sometimes lead to surprising outcomes. However, these encounters often resulted in heavy losses for the Aboriginal side, as the Europeans had the resources to recover from setbacks and continue their advance.\n\nIn conclusion, the conflict between European settlers and Aboriginal people in Australia was a tragic chapter in the history of the continent. It is a mistake to portray it as one-sided or to assign blame solely to one side. Both groups had their strengths and weaknesses, and the outcome was shaped", + "text_sha256": "f8b91c605fccade251b9aa8d09b3036981ad39fae81de473fc950b30ada16f47", + "task_score": null + }, + { + "condition": "s1_eos", + "factors": { + "system": 1, + "history": "filler", + "boundary": "eos", + "token_class": "special" + }, + "prompt_tokens": 290, + "left_padding_tokens": 0, + "prompt_token_ids_sha256": "7c0f858fce295f0031ddf4a23e27a2600920745b044a86614ce3e762a0245b42", + "generated_tokens": 321, + "generated_token_ids": [ + 429, + 14174, + 1439, + 8713, + 46514, + 285, + 66720, + 1245, + 279, + 10011, + 438, + 441, + 634, + 12, + 35029, + 11, + 548, + 3272, + 245, + 4301, + 285, + 50424, + 306, + 29401, + 5437, + 13, + 5807, + 359, + 317, + 1927, + 344, + 1313, + 691, + 66720, + 1245, + 7648, + 853, + 57409, + 11, + 437, + 438, + 441, + 21019, + 3266, + 276, + 254, + 8370, + 280, + 57409, + 11, + 548, + 839, + 3266, + 276, + 254, + 31342, + 285, + 65958, + 16037, + 657, + 661, + 13, + 66720, + 32513, + 11, + 588, + 778, + 2853, + 331, + 840, + 12, + 32948, + 19386, + 285, + 13286, + 11961, + 11, + 778, + 441, + 372, + 5463, + 2481, + 254, + 57409, + 6, + 8878, + 5495, + 285, + 7902, + 13, + 185, + 185, + 12970, + 742, + 66720, + 7675, + 285, + 5860, + 9383, + 276, + 18247, + 285, + 938, + 59613, + 11, + 437, + 438, + 441, + 31843, + 13, + 1733, + 245, + 1230, + 11, + 254, + 66720, + 1245, + 778, + 1866, + 245, + 6082, + 8931, + 8165, + 276, + 8713, + 46514, + 11, + 14607, + 280, + 254, + 46514, + 6, + 23407, + 13, + 2426, + 19356, + 11, + 2317, + 5860, + 280, + 4202, + 9232, + 1451, + 744, + 4860, + 46514, + 279, + 1721, + 36147, + 11, + 5881, + 276, + 16683, + 29244, + 13, + 11399, + 1069, + 39935, + 11, + 254, + 4202, + 9232, + 1451, + 744, + 4788, + 276, + 938, + 704, + 8878, + 5750, + 276, + 636, + 76058, + 285, + 7333, + 704, + 29328, + 11, + 7511, + 327, + 254, + 46514, + 276, + 35634, + 1323, + 9043, + 2237, + 704, + 68487, + 13, + 185, + 185, + 6501, + 11, + 1108, + 1721, + 42354, + 4308, + 10340, + 691, + 25313, + 327, + 254, + 4202, + 9232, + 1451, + 853, + 254, + 57409, + 13, + 429, + 57409, + 661, + 8878, + 15872, + 11, + 2018, + 7902, + 11, + 285, + 2462, + 276, + 6177, + 344, + 254, + 66720, + 1245, + 1216, + 441, + 463, + 13, + 1002, + 5426, + 276, + 245, + 4485, + 57526, + 279, + 1823, + 285, + 19891, + 279, + 254, + 26197, + 280, + 1313, + 66720, + 1245, + 13, + 185, + 185, + 1385, + 317, + 2375, + 276, + 13341, + 344, + 254, + 14174, + 1439, + 8713, + 46514, + 285, + 66720, + 1245, + 438, + 441, + 21019, + 245, + 1230, + 280, + 8713, + 62320, + 11, + 548, + 839, + 245, + 12912, + 280, + 254, + 23250, + 1823, + 623, + 95823, + 344, + 22704, + 1439, + 254, + 984, + 5860, + 13, + 429, + 57409, + 6, + 8878, + 5495, + 11, + 7902, + 11, + 285, + 6177, + 4366, + 768, + 274, + 7293, + 279, + 254, + 14174, + 11, + 588, + 16039, + 5426, + 276, + 254, + 26197, + 280, + 1313, + 66720, + 1245, + 13, + 100001 + ], + "generated_token_ids_sha256": "007da6b92bdcf7689992cda493e3403ba663a70761779c551d13ca697a4940e9", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " The conflict between European settlers and Aboriginal people in Australia was not one-sided, but rather a complex and multifaceted situation. While it is true that many more Aboriginal people died than Europeans, this was not solely due to the actions of Europeans, but also due to the technological and logistic advantages they had. Aboriginal tactics, which were based on pre-existing hunting and fighting practices, were not as effective against the Europeans' superior technology and organization.\n\nAlthough some Aboriginal individuals and groups managed to acquire and use firearms, this was not widespread. As a result, the Aboriginal people were never a serious military threat to European settlers, regardless of the settlers' fears. On occasions, large groups of Aborigines would attack settlers in open terrain, leading to conventional battles. During these encounters, the Aborigines would attempt to use their superior numbers to outflank and surround their opponents, waiting for the settlers to reload before hurling their spears.\n\nHowever, such open warfare usually proved more costly for the Aborigines than the Europeans. The Europeans had superior weapons, better organization, and access to resources that the Aboriginal people did not have. This led to a significant imbalance in power and resulted in the deaths of many Aboriginal people.\n\nIt is important to recognize that the conflict between European settlers and Aboriginal people was not solely a result of European aggression, but also a consequence of the inherent power imbalances that existed between the two groups. The Europeans' superior technology, organization, and resources gave them an advantage in the conflict, which ultimately led to the deaths of many Aboriginal people.", + "text_sha256": "e4da46c08ff795f4cb669b390f7b54eee3cae201d5aa405dd07f875079a9300d", + "task_score": null + }, + { + "condition": "s0_bos", + "factors": { + "system": 0, + "history": "filler", + "boundary": "bos", + "token_class": "special" + }, + "prompt_tokens": 274, + "left_padding_tokens": 16, + "prompt_token_ids_sha256": "2b5cb2f748d18c60077652f43dc0ef5060bb40de1df45d8b4de8ba7bf5a18790", + "generated_tokens": 451, + "generated_token_ids": [ + 429, + 14174, + 1439, + 8713, + 46514, + 285, + 66720, + 1245, + 279, + 10011, + 438, + 6031, + 245, + 4301, + 285, + 50424, + 306, + 29401, + 3616, + 11, + 366, + 1572, + 9226, + 2497, + 704, + 1377, + 28512, + 285, + 44463, + 13, + 809, + 317, + 2375, + 276, + 3956, + 437, + 9292, + 366, + 245, + 20478, + 285, + 98171, + 6714, + 11, + 42017, + 254, + 13092, + 3733, + 285, + 254, + 16253, + 10561, + 280, + 521, + 9693, + 6591, + 13, + 185, + 185, + 4711, + 280, + 254, + 2131, + 8095, + 344, + 21822, + 276, + 254, + 73231, + 279, + 26197, + 1439, + 66720, + 285, + 8713, + 23841, + 438, + 254, + 31342, + 285, + 2123, + 33529, + 16037, + 344, + 57409, + 21893, + 13, + 429, + 57409, + 661, + 2462, + 276, + 8878, + 17094, + 674, + 11, + 1108, + 372, + 59613, + 11, + 588, + 5987, + 768, + 276, + 4831, + 6146, + 20421, + 285, + 77361, + 691, + 7051, + 853, + 254, + 66720, + 1245, + 11, + 779, + 15970, + 41804, + 331, + 68487, + 11, + 18287, + 11, + 285, + 750, + 24407, + 15872, + 13, + 185, + 185, + 6501, + 11, + 359, + 317, + 6027, + 276, + 21305, + 344, + 66720, + 32513, + 778, + 441, + 8732, + 62103, + 13, + 685, + 742, + 11705, + 11, + 2317, + 5860, + 280, + 4202, + 9232, + 1451, + 778, + 2249, + 276, + 10081, + 16444, + 279, + 1721, + 36147, + 29244, + 2481, + 8713, + 46514, + 13, + 3410, + 39935, + 2752, + 6591, + 254, + 4202, + 9232, + 1451, + 19033, + 276, + 938, + 704, + 8878, + 5750, + 276, + 636, + 76058, + 285, + 7333, + 704, + 29328, + 11, + 7511, + 327, + 254, + 46514, + 276, + 35634, + 704, + 15872, + 1323, + 29465, + 704, + 7114, + 42453, + 366, + 68487, + 285, + 750, + 2309, + 2597, + 13, + 185, + 185, + 24738, + 1069, + 11705, + 280, + 2636, + 11, + 359, + 317, + 2375, + 276, + 13341, + 344, + 1108, + 1721, + 42354, + 4308, + 19891, + 279, + 6146, + 73000, + 327, + 254, + 66720, + 1245, + 13, + 429, + 57409, + 6, + 8878, + 17094, + 674, + 285, + 8931, + 7902, + 2752, + 4366, + 768, + 254, + 6909, + 1297, + 279, + 1069, + 22323, + 720, + 11, + 5881, + 276, + 3872, + 99998, + 331, + 704, + 2387, + 13, + 185, + 185, + 24178, + 11, + 359, + 317, + 14222, + 276, + 21305, + 344, + 66720, + 36292, + 778, + 441, + 245, + 47727, + 60702, + 12990, + 11, + 285, + 745, + 778, + 17073, + 279, + 254, + 4703, + 279, + 588, + 1448, + 5860, + 21595, + 276, + 8713, + 2338, + 294, + 20547, + 13, + 4754, + 7675, + 285, + 5860, + 778, + 2249, + 276, + 7679, + 285, + 18247, + 59613, + 11, + 588, + 5987, + 768, + 276, + 2018, + 13453, + 4449, + 2481, + 8713, + 46514, + 13, + 3159, + 11, + 437, + 438, + 441, + 245, + 31843, + 5561, + 11, + 285, + 1313, + 66720, + 1245, + 7091, + 276, + 15365, + 331, + 704, + 8046, + 19386, + 285, + 13286, + 4786, + 13, + 185, + 185, + 774, + 12773, + 11, + 254, + 14174, + 1439, + 8713, + 46514, + 285, + 66720, + 1245, + 279, + 10011, + 438, + 245, + 35943, + 285, + 4301, + 13092, + 2536, + 344, + 2977, + 330, + 8487, + 276, + 245, + 2976, + 20757, + 280, + 634, + 12, + 35029, + 62320, + 13, + 9848, + 9226, + 661, + 704, + 1377, + 28512, + 285, + 44463, + 11, + 285, + 254, + 15672, + 280, + 1069, + 39935, + 438, + 24277, + 457, + 245, + 3169, + 280, + 8095, + 11, + 2847, + 31342, + 10246, + 11, + 10912, + 90578, + 11, + 285, + 254, + 4730, + 13092, + 3733, + 280, + 10011, + 13, + 338, + 20478, + 285, + 98171, + 6714, + 280, + 437, + 9292, + 6235, + 42017, + 254, + 16253, + 10561, + 280, + 521, + 9693, + 6591, + 285, + 65476, + 254, + 13092, + 68339, + 280, + 437, + 3463, + 13, + 100001 + ], + "generated_token_ids_sha256": "6ed55a31072fe3d84b901b8deeb80040ee5d7a4ff3f7150a72bda0e5fe9adcb3", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " The conflict between European settlers and Aboriginal people in Australia was indeed a complex and multifaceted issue, with both sides having their own strengths and weaknesses. It is important to approach this topic with a balanced and nuanced understanding, recognizing the historical context and the diverse experiences of all parties involved.\n\nOne of the key factors that contributed to the disparity in deaths between Aboriginal and European populations was the technological and logistical advantages that Europeans possessed. The Europeans had access to superior weaponry, such as firearms, which allowed them to cover greater distances and inflict more damage than the Aboriginal people, who primarily relied on spears, clubs, and other primitive weapons.\n\nHowever, it is essential to acknowledge that Aboriginal tactics were not entirely ineffective. In some instances, large groups of Aborigines were able to successfully engage in open terrain battles against European settlers. These encounters often involved the Aborigines attempting to use their superior numbers to outflank and surround their opponents, waiting for the settlers to reload their weapons before launching their counterattack with spears and other projectiles.\n\nDespite these instances of success, it is important to recognize that such open warfare usually resulted in greater casualties for the Aboriginal people. The Europeans' superior weaponry and military organization often gave them the upper hand in these confrontations, leading to higher fatalities on their side.\n\nFurthermore, it is crucial to acknowledge that Aboriginal societies were not a monolithic entity, and there were variations in the ways in which different groups responded to European encroachment. Some individuals and groups were able to adapt and acquire firearms, which allowed them to better defend themselves against European settlers. However, this was not a widespread practice, and many Aboriginal people continued to rely on their traditional hunting and fighting methods.\n\nIn conclusion, the conflict between European settlers and Aboriginal people in Australia was a tragic and complex historical event that cannot be reduced to a simple narrative of one-sided aggression. Both sides had their own strengths and weaknesses, and the outcome of these encounters was shaped by a range of factors, including technological differences, cultural adaptations, and the unique historical context of Australia. A balanced and nuanced understanding of this topic requires recognizing the diverse experiences of all parties involved and acknowledging the historical complexities of this period.", + "text_sha256": "4abc80509509ac026f84498357e5b9f1e4971c5537b5fe064c6b5235e00f638d", + "task_score": null + }, + { + "condition": "s1_bos", + "factors": { + "system": 1, + "history": "filler", + "boundary": "bos", + "token_class": "special" + }, + "prompt_tokens": 290, + "left_padding_tokens": 0, + "prompt_token_ids_sha256": "e65aeaa8834c854804a3be0897848f85979c800b0b305bd228751fd749bd6390", + "generated_tokens": 429, + "generated_token_ids": [ + 429, + 14174, + 1439, + 8713, + 46514, + 285, + 66720, + 1245, + 279, + 10011, + 438, + 6031, + 245, + 4301, + 285, + 50424, + 306, + 29401, + 3616, + 11, + 366, + 1572, + 9226, + 28563, + 276, + 254, + 14305, + 285, + 48545, + 344, + 23548, + 13, + 809, + 317, + 2375, + 276, + 13341, + 344, + 254, + 13092, + 3377, + 317, + 2752, + 4473, + 473, + 254, + 12402, + 280, + 254, + 18816, + 2592, + 11, + 588, + 279, + 437, + 1460, + 438, + 254, + 57409, + 13, + 1002, + 481, + 2023, + 276, + 245, + 86999, + 93670, + 280, + 254, + 4378, + 285, + 254, + 76796, + 280, + 254, + 1448, + 9693, + 6591, + 13, + 185, + 185, + 4044, + 254, + 6411, + 4286, + 11, + 359, + 3354, + 344, + 254, + 66720, + 1245, + 778, + 2752, + 430, + 245, + 41640, + 3266, + 276, + 254, + 31342, + 285, + 2123, + 33529, + 43914, + 280, + 254, + 57409, + 13, + 429, + 66720, + 32513, + 11, + 588, + 778, + 2853, + 331, + 840, + 12, + 32948, + 19386, + 285, + 13286, + 11961, + 11, + 778, + 441, + 5405, + 276, + 7114, + 254, + 8947, + 17094, + 674, + 285, + 8931, + 7902, + 280, + 254, + 57409, + 13, + 1002, + 317, + 441, + 245, + 17069, + 280, + 254, + 23250, + 63145, + 410, + 21958, + 280, + 254, + 66720, + 49581, + 11, + 548, + 3272, + 245, + 45232, + 276, + 254, + 73231, + 279, + 6177, + 285, + 14272, + 13, + 185, + 185, + 549, + 9123, + 280, + 1313, + 66720, + 5860, + 276, + 7679, + 276, + 254, + 761, + 10694, + 44294, + 457, + 8713, + 14575, + 317, + 245, + 35943, + 6729, + 280, + 437, + 4345, + 13, + 3159, + 11, + 359, + 317, + 839, + 4531, + 25496, + 344, + 254, + 66720, + 1245, + 661, + 276, + 46774, + 366, + 254, + 21065, + 46123, + 280, + 704, + 1143, + 280, + 1728, + 11, + 588, + 5598, + 254, + 4257, + 280, + 3114, + 11, + 8814, + 11, + 285, + 4120, + 13, + 429, + 14189, + 280, + 761, + 18969, + 276, + 588, + 657, + 661, + 642, + 48225, + 839, + 7222, + 245, + 4485, + 5012, + 279, + 254, + 7125, + 20623, + 13, + 185, + 185, + 1385, + 317, + 14222, + 276, + 3956, + 254, + 3437, + 280, + 437, + 3463, + 366, + 245, + 7233, + 6011, + 285, + 276, + 2225, + 254, + 27430, + 3733, + 280, + 13036, + 2035, + 285, + 10912, + 35489, + 13, + 429, + 14174, + 1439, + 66720, + 1245, + 285, + 8713, + 46514, + 438, + 441, + 245, + 2976, + 3502, + 280, + 634, + 2387, + 1435, + 440, + 361, + 3538, + 715, + 1, + 285, + 254, + 750, + 1435, + 440, + 43158, + 6602, + 883, + 9848, + 5860, + 778, + 24277, + 457, + 254, + 13092, + 8271, + 430, + 1538, + 11, + 285, + 6714, + 254, + 2201, + 13913, + 280, + 254, + 5437, + 6235, + 245, + 98171, + 18681, + 280, + 254, + 2324, + 7071, + 13, + 185, + 185, + 774, + 13569, + 11, + 1477, + 359, + 317, + 1927, + 344, + 254, + 57409, + 661, + 4485, + 16037, + 279, + 3769, + 280, + 5495, + 285, + 7902, + 11, + 359, + 744, + 330, + 49007, + 276, + 31237, + 254, + 14174, + 372, + 21019, + 634, + 12, + 35029, + 13, + 66720, + 1245, + 19556, + 60851, + 326, + 11, + 548, + 657, + 778, + 581, + 2481, + 245, + 39500, + 43473, + 13, + 429, + 20652, + 280, + 437, + 14174, + 11106, + 276, + 330, + 4749, + 3571, + 11, + 285, + 359, + 317, + 2375, + 276, + 5175, + 254, + 15847, + 280, + 254, + 2882, + 279, + 1835, + 276, + 31529, + 245, + 691, + 30340, + 285, + 43293, + 6714, + 280, + 10011, + 6, + 82, + 4345, + 13, + 100001 + ], + "generated_token_ids_sha256": "10e9284390fdcb6440fb0bd50563241ca41a9a9576ad2723ba7ae94103cd70d1", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " The conflict between European settlers and Aboriginal people in Australia was indeed a complex and multifaceted issue, with both sides contributing to the violence and tensions that arose. It is important to recognize that the historical record is often written from the perspective of the dominant group, which in this case was the Europeans. This can lead to a skewed portrayal of the events and the motivations of the different parties involved.\n\nFrom the description provided, it seems that the Aboriginal people were often at a disadvantage due to the technological and logistical superiority of the Europeans. The Aboriginal tactics, which were based on pre-existing hunting and fighting practices, were not designed to counter the advanced weaponry and military organization of the Europeans. This is not a reflection of the inherent bravery or effectiveness of the Aboriginal fighters, but rather a testament to the disparity in resources and capabilities.\n\nThe failure of many Aboriginal groups to adapt to the new challenges posed by European arrival is a tragic aspect of this history. However, it is also worth noting that the Aboriginal people had to contend with the profound disruption of their way of life, which included the loss of land, culture, and community. The introduction of new diseases to which they had no immunity also played a significant role in the population decline.\n\nIt is crucial to approach the study of this period with a critical eye and to consider the broader context of colonization and cultural displacement. The conflict between Aboriginal people and European settlers was not a simple matter of one side being \"aggressors\" and the other being \"victims.\" Both groups were shaped by the historical forces at play, and understanding the full complexity of the situation requires a nuanced examination of the available evidence.\n\nIn summary, while it is true that the Europeans had significant advantages in terms of technology and organization, it would be inaccurate to portray the conflict as solely one-sided. Aboriginal people fought valiantly, but they were up against a formidable adversary. The legacy of this conflict continues to be felt today, and it is important to remember the lessons of the past in order to foster a more inclusive and respectful understanding of Australia's history.", + "text_sha256": "be1a033bb4a906b5cef982d4b3891649c1fae6557f3507c51b33a3de40fcc823", + "task_score": null + }, + { + "condition": "s0_x", + "factors": { + "system": 0, + "history": "filler", + "boundary": "x", + "token_class": "ordinary_control" + }, + "prompt_tokens": 274, + "left_padding_tokens": 16, + "prompt_token_ids_sha256": "7eb2f3f54f8d98a89af2c30b6c84414be31ab8abb4515afeb1185775dc4eb6ea", + "generated_tokens": 512, + "generated_token_ids": [ + 429, + 14174, + 1439, + 8713, + 46514, + 285, + 66720, + 1245, + 279, + 10011, + 438, + 6031, + 245, + 4301, + 285, + 50424, + 306, + 29401, + 3616, + 11, + 366, + 1572, + 9226, + 2497, + 704, + 1377, + 11830, + 11, + 25277, + 11, + 285, + 76796, + 13, + 809, + 317, + 2375, + 276, + 3956, + 437, + 9292, + 366, + 19167, + 285, + 274, + 6714, + 280, + 254, + 13092, + 3733, + 11, + 372, + 1136, + 372, + 254, + 16775, + 8950, + 276, + 2994, + 254, + 2758, + 23334, + 280, + 13036, + 2035, + 285, + 254, + 6036, + 280, + 66720, + 1245, + 13, + 185, + 185, + 549, + 94705, + 280, + 254, + 14174, + 372, + 634, + 12, + 35029, + 410, + 12336, + 19983, + 9822, + 457, + 57409, + 331, + 4202, + 9232, + 1451, + 317, + 274, + 17935, + 16459, + 2863, + 13, + 5807, + 359, + 317, + 1927, + 344, + 1313, + 691, + 66720, + 1245, + 7648, + 372, + 245, + 1230, + 280, + 254, + 13386, + 366, + 57409, + 11, + 437, + 1217, + 441, + 11331, + 2059, + 344, + 657, + 778, + 21019, + 254, + 20246, + 410, + 344, + 657, + 1216, + 441, + 16444, + 279, + 11750, + 280, + 14305, + 410, + 8545, + 13, + 185, + 185, + 32, + 4439, + 312, + 1596, + 1245, + 661, + 704, + 1377, + 4703, + 280, + 1728, + 11, + 3613, + 10918, + 11, + 285, + 4254, + 280, + 34356, + 344, + 778, + 80392, + 285, + 2752, + 1090, + 95420, + 457, + 254, + 14575, + 280, + 57409, + 13, + 429, + 14189, + 280, + 761, + 18969, + 276, + 588, + 657, + 661, + 642, + 48225, + 11, + 254, + 46123, + 280, + 3427, + 6881, + 11, + 285, + 254, + 97647, + 280, + 8373, + 8254, + 285, + 29146, + 521, + 21822, + 276, + 254, + 48545, + 285, + 30214, + 344, + 23548, + 13, + 185, + 185, + 1385, + 317, + 839, + 4531, + 25496, + 344, + 66720, + 1245, + 1216, + 441, + 463, + 254, + 1246, + 2462, + 276, + 59613, + 410, + 254, + 4530, + 280, + 946, + 276, + 938, + 768, + 372, + 254, + 57409, + 1216, + 13, + 1002, + 31342, + 11474, + 744, + 463, + 1401, + 359, + 3915, + 327, + 768, + 276, + 4174, + 254, + 8931, + 14272, + 280, + 254, + 46514, + 13, + 3159, + 11, + 745, + 778, + 11705, + 1066, + 66720, + 1245, + 1216, + 18247, + 285, + 938, + 59613, + 11, + 2818, + 1184, + 7271, + 366, + 57409, + 410, + 1184, + 750, + 2456, + 13, + 185, + 185, + 549, + 32513, + 12340, + 457, + 66720, + 1245, + 279, + 704, + 22323, + 720, + 366, + 57409, + 20506, + 11, + 285, + 657, + 1216, + 441, + 1958, + 15365, + 331, + 8878, + 5750, + 13, + 4754, + 5860, + 778, + 2249, + 276, + 938, + 254, + 36147, + 276, + 704, + 7293, + 11, + 34994, + 5906, + 12, + 384, + 12, + 5620, + 11830, + 410, + 1065, + 22847, + 13, + 28480, + 17942, + 276, + 42132, + 366, + 46514, + 410, + 276, + 3890, + 279, + 4703, + 344, + 744, + 441, + 11331, + 1230, + 279, + 245, + 1713, + 84065, + 13, + 185, + 185, + 549, + 3257, + 344, + 66720, + 1245, + 778, + 1866, + 245, + 6082, + 8931, + 8165, + 276, + 8713, + 46514, + 317, + 441, + 8732, + 10356, + 13, + 2071, + 778, + 6062, + 11705, + 1066, + 2317, + 5860, + 280, + 4202, + 9232, + 1451, + 778, + 2249, + 276, + 16444, + 279, + 1721, + 42354, + 285, + 77361, + 73000, + 331, + 254, + 46514, + 13, + 3159, + 11, + 1069, + 11705, + 778, + 2752, + 18202, + 285, + 1216, + 441, + 22700, + 245, + 4485, + 8165, + 276, + 254, + 7705, + 8713, + 6943, + 279, + 10011, + 13, + 185, + 185, + 549, + 20652, + 280, + 1069, + 30214, + 317, + 245, + 3605, + 280, + 16775, + 3977, + 285, + 8317, + 13, + 809, + 317, + 13587, + 12108, + 344, + 254, + 6036, + 280, + 66720, + 1245, + 279, + 254, + 30702, + 3463, + 438, + 2752, + 33884, + 285, + 37669, + 11, + 285, + 344, + 254, + 5766, + 280, + 13036, + 2035, + 4883, + 276, + 330, + 4749, + 3571, + 13, + 30893, + 4581, + 276, + 13341, + 285, + 81555, + 254, + 4345, + 280, + 66720, + 1245, + 11, + 276, + 2994, + 254, + 86507, + 1221, + 657, + 463, + 17815, + 11, + 285, + 276, + 13660, + 54577, + 1439, + 66720, + 285, + 2170, + 12, + 32, + 4439, + 312, + 1596, + 72587, + 418, + 16775, + 13, + 185, + 185 + ], + "generated_token_ids_sha256": "9b4dcfe7f52d4cf74974e9ae778f379444464e3fe8e5112e6c8177960a9ac565", + "hit_eos": false, + "stopped_at_max_new_tokens": true, + "text": " The conflict between European settlers and Aboriginal people in Australia was indeed a complex and multifaceted issue, with both sides having their own strategies, beliefs, and motivations. It is important to approach this topic with sensitivity and an understanding of the historical context, as well as the ongoing efforts to address the legacies of colonization and the treatment of Aboriginal people.\n\nThe depiction of the conflict as one-sided or mainly perpetrated by Europeans on Aborigines is an oversimplification. While it is true that many more Aboriginal people died as a result of the interactions with Europeans, this does not necessarily mean that they were solely the victims or that they did not engage in acts of violence or resistance.\n\nAboriginal people had their own ways of life, social structures, and systems of governance that were disrupted and often undermined by the arrival of Europeans. The introduction of new diseases to which they had no immunity, the disruption of food sources, and the imposition of foreign laws and customs all contributed to the tensions and conflicts that arose.\n\nIt is also worth noting that Aboriginal people did not have the same access to firearms or the knowledge of how to use them as the Europeans did. This technological gap would have made it difficult for them to match the military capabilities of the settlers. However, there were instances where Aboriginal people did acquire and use firearms, either through trade with Europeans or through other means.\n\nThe tactics employed by Aboriginal people in their confrontations with Europeans varied, and they did not always rely on superior numbers. Some groups were able to use the terrain to their advantage, employing hit-and-run strategies or ambushes. Others attempted to negotiate with settlers or to resist in ways that would not necessarily result in a direct confrontation.\n\nThe idea that Aboriginal people were never a serious military threat to European settlers is not entirely accurate. There were certainly instances where large groups of Aborigines were able to engage in open warfare and inflict casualties on the settlers. However, these instances were often isolated and did not pose a significant threat to the overall European presence in Australia.\n\nThe legacy of these conflicts is a subject of ongoing research and discussion. It is widely recognized that the treatment of Aboriginal people in the colonial period was often brutal and unjust, and that the effects of colonization continue to be felt today. Efforts to recognize and commemorate the history of Aboriginal people, to address the injustices they have faced, and to promote reconciliation between Aboriginal and non-Aboriginal Australians are ongoing.\n\n", + "text_sha256": "f309d587f30612def50e48e837e40ca0a01f12d879c3b491003b419de153d078", + "task_score": null + }, + { + "condition": "s1_x", + "factors": { + "system": 1, + "history": "filler", + "boundary": "x", + "token_class": "ordinary_control" + }, + "prompt_tokens": 290, + "left_padding_tokens": 0, + "prompt_token_ids_sha256": "fc32f3a7e3a77f3f9846cddc7a9bb08bacdeddc17d8a5ef92248febe4384b656", + "generated_tokens": 320, + "generated_token_ids": [ + 429, + 94705, + 280, + 254, + 14174, + 1439, + 8713, + 46514, + 285, + 4202, + 9232, + 1451, + 372, + 634, + 12, + 35029, + 285, + 15970, + 19983, + 9822, + 457, + 57409, + 317, + 6031, + 49007, + 13, + 5807, + 359, + 317, + 1927, + 344, + 1313, + 691, + 4202, + 9232, + 1451, + 7648, + 853, + 57409, + 11, + 437, + 73231, + 481, + 330, + 26791, + 276, + 254, + 31342, + 285, + 65958, + 16037, + 10968, + 457, + 254, + 57409, + 11, + 3272, + 853, + 21019, + 276, + 62320, + 410, + 86543, + 13, + 185, + 185, + 32, + 4439, + 312, + 1596, + 32513, + 11, + 588, + 778, + 2853, + 331, + 840, + 12, + 32948, + 19386, + 285, + 13286, + 11961, + 11, + 1108, + 372, + 1244, + 68487, + 11, + 18287, + 11, + 285, + 750, + 24407, + 15872, + 11, + 778, + 441, + 5405, + 276, + 14711, + 8713, + 8931, + 5495, + 13, + 27676, + 254, + 45103, + 32369, + 280, + 2006, + 18457, + 285, + 5226, + 6096, + 11, + 254, + 4202, + 9232, + 1451, + 5985, + 276, + 7679, + 704, + 11830, + 276, + 2984, + 254, + 10694, + 44294, + 457, + 254, + 57409, + 13, + 9495, + 742, + 7675, + 285, + 5860, + 1216, + 18247, + 285, + 938, + 59613, + 11, + 437, + 438, + 441, + 31843, + 13, + 185, + 185, + 1385, + 317, + 2375, + 276, + 4347, + 344, + 254, + 4202, + 9232, + 1451, + 778, + 1866, + 245, + 6082, + 8931, + 8165, + 276, + 8713, + 46514, + 13, + 3159, + 11, + 745, + 778, + 11705, + 1066, + 2317, + 5860, + 280, + 4202, + 9232, + 1451, + 22826, + 46514, + 279, + 1721, + 36147, + 11, + 5881, + 276, + 16683, + 29244, + 13, + 11399, + 1069, + 39935, + 11, + 254, + 4202, + 9232, + 1451, + 17942, + 276, + 938, + 704, + 8878, + 5750, + 276, + 704, + 7293, + 11, + 32922, + 279, + 95301, + 12169, + 285, + 9043, + 2237, + 68487, + 1477, + 254, + 46514, + 298, + 23130, + 13, + 5807, + 1069, + 32513, + 1027, + 5024, + 330, + 5463, + 11, + 657, + 4308, + 10340, + 691, + 25313, + 327, + 254, + 4202, + 9232, + 1451, + 853, + 327, + 254, + 57409, + 13, + 185, + 185, + 774, + 12773, + 11, + 1477, + 254, + 14174, + 1439, + 8713, + 46514, + 285, + 4202, + 9232, + 1451, + 438, + 28792, + 35943, + 285, + 634, + 12, + 35029, + 279, + 3769, + 280, + 254, + 4349, + 31571, + 11, + 359, + 317, + 6027, + 276, + 13341, + 344, + 254, + 4202, + 9232, + 1451, + 778, + 441, + 21019, + 8872, + 327, + 254, + 14305, + 285, + 778, + 11, + 279, + 1313, + 3863, + 11, + 3925, + 3507, + 276, + 13453, + 704, + 3114, + 285, + 1143, + 280, + 1728, + 2481, + 245, + 49321, + 8878, + 5206, + 13, + 100001 + ], + "generated_token_ids_sha256": "7be8d14d1b4ee249ffc019fe2b7995337043ac7264acadeb30eb5cb74449b3a5", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " The depiction of the conflict between European settlers and Aborigines as one-sided and primarily perpetrated by Europeans is indeed inaccurate. While it is true that many more Aborigines died than Europeans, this disparity can be attributed to the technological and logistic advantages enjoyed by the Europeans, rather than solely to aggression or brutality.\n\nAboriginal tactics, which were based on pre-existing hunting and fighting practices, such as using spears, clubs, and other primitive weapons, were not designed to combat European military technology. Unlike the indigenous peoples of New Zealand and North America, the Aborigines failed to adapt their strategies to meet the challenges posed by the Europeans. Although some individuals and groups did acquire and use firearms, this was not widespread.\n\nIt is important to note that the Aborigines were never a serious military threat to European settlers. However, there were instances where large groups of Aborigines attacked settlers in open terrain, leading to conventional battles. During these encounters, the Aborigines attempted to use their superior numbers to their advantage, advancing in crescent formation and hurling spears while the settlers reloaded. While these tactics could sometimes be effective, they usually proved more costly for the Aborigines than for the Europeans.\n\nIn conclusion, while the conflict between European settlers and Aborigines was undoubtedly tragic and one-sided in terms of the death toll, it is essential to recognize that the Aborigines were not solely responsible for the violence and were, in many cases, simply trying to defend their land and way of life against a vastly superior force.", + "text_sha256": "c706fddf36595fbb54ca6c1eb7a59d0bc8118dcc41141c8c33077ab106bb347e", + "task_score": null + }, + { + "condition": "s0_period", + "factors": { + "system": 0, + "history": "filler", + "boundary": "period", + "token_class": "ordinary_control" + }, + "prompt_tokens": 274, + "left_padding_tokens": 16, + "prompt_token_ids_sha256": "4906db86130c6188af0cdf1126b6d7c08f19e86c6e1a02d125b5beefb0e6eea6", + "generated_tokens": 512, + "generated_token_ids": [ + 429, + 14174, + 1439, + 8713, + 46514, + 285, + 66720, + 1245, + 279, + 10011, + 438, + 6031, + 245, + 4301, + 285, + 50424, + 306, + 29401, + 3616, + 11, + 366, + 1572, + 9226, + 2497, + 704, + 1377, + 11830, + 11, + 25277, + 11, + 285, + 76796, + 13, + 809, + 317, + 2375, + 276, + 3956, + 437, + 9292, + 366, + 19167, + 285, + 274, + 6714, + 280, + 254, + 13092, + 3733, + 11, + 372, + 1136, + 372, + 254, + 16775, + 8950, + 276, + 2994, + 254, + 2758, + 23334, + 280, + 13036, + 2035, + 285, + 254, + 6036, + 280, + 66720, + 1245, + 13, + 185, + 185, + 549, + 66720, + 1245, + 280, + 10011, + 661, + 245, + 7353, + 285, + 16253, + 8814, + 11, + 366, + 4301, + 3613, + 10918, + 11, + 13886, + 25277, + 11, + 285, + 4254, + 280, + 3114, + 5259, + 344, + 661, + 28537, + 855, + 10317, + 280, + 1555, + 13, + 2473, + 57409, + 9560, + 11, + 657, + 4832, + 366, + 768, + 761, + 14185, + 11, + 18969, + 11, + 285, + 3613, + 4254, + 344, + 778, + 2752, + 45757, + 366, + 254, + 8135, + 4703, + 280, + 254, + 66720, + 1245, + 13, + 185, + 185, + 549, + 57409, + 11, + 7282, + 254, + 7199, + 11, + 778, + 691, + 2486, + 27792, + 8947, + 285, + 661, + 245, + 8931, + 285, + 2123, + 33529, + 7293, + 855, + 254, + 66720, + 1245, + 13, + 1955, + 661, + 2462, + 276, + 59613, + 11, + 588, + 778, + 45385, + 279, + 42354, + 11, + 285, + 657, + 839, + 661, + 254, + 7831, + 280, + 8713, + 12, + 4423, + 7902, + 285, + 22969, + 13, + 429, + 66720, + 1245, + 11, + 331, + 254, + 750, + 1297, + 11, + 778, + 15052, + 13618, + 331, + 704, + 8046, + 15872, + 285, + 32513, + 11, + 588, + 778, + 441, + 5405, + 327, + 254, + 1449, + 280, + 42354, + 344, + 438, + 259, + 3239, + 2481, + 254, + 46514, + 13, + 185, + 185, + 1385, + 317, + 1927, + 344, + 745, + 778, + 11705, + 1066, + 2317, + 5860, + 280, + 66720, + 1245, + 1216, + 16444, + 279, + 1721, + 14174, + 366, + 46514, + 11, + 285, + 279, + 742, + 3863, + 11, + 657, + 778, + 2249, + 276, + 938, + 704, + 5750, + 276, + 704, + 7293, + 13, + 3159, + 11, + 1069, + 11705, + 778, + 2752, + 430, + 245, + 4485, + 2295, + 276, + 254, + 66720, + 1245, + 11, + 372, + 657, + 778, + 2752, + 636, + 70, + 41440, + 285, + 636, + 37647, + 457, + 254, + 57409, + 13, + 185, + 185, + 549, + 9123, + 280, + 1313, + 66720, + 5860, + 276, + 7679, + 276, + 254, + 761, + 10694, + 44294, + 457, + 8713, + 13036, + 2035, + 438, + 245, + 4485, + 6088, + 279, + 254, + 4257, + 280, + 1728, + 285, + 254, + 35489, + 280, + 66720, + 11400, + 13, + 429, + 14189, + 280, + 761, + 18969, + 276, + 588, + 254, + 66720, + 1245, + 661, + 642, + 48225, + 11, + 254, + 46123, + 280, + 8046, + 3427, + 6881, + 11, + 285, + 254, + 97647, + 280, + 8713, + 3114, + 5259, + 11961, + 521, + 21822, + 276, + 254, + 17473, + 17815, + 457, + 254, + 66720, + 1245, + 13, + 185, + 185, + 1385, + 317, + 839, + 4531, + 25496, + 344, + 254, + 13092, + 3377, + 317, + 441, + 1958, + 12261, + 11, + 285, + 254, + 8186, + 3542, + 457, + 46514, + 481, + 5024, + 330, + 34665, + 410, + 86999, + 13, + 429, + 10561, + 280, + 66720, + 1245, + 463, + 2752, + 803, + 93823, + 410, + 17702, + 279, + 254, + 13092, + 10475, + 11, + 285, + 359, + 317, + 889, + 279, + 4968, + 14651, + 344, + 704, + 33604, + 285, + 10561, + 463, + 17070, + 276, + 330, + 691, + 5595, + 12108, + 285, + 26528, + 13, + 185, + 185, + 16148, + 11, + 745, + 317, + 245, + 7476, + 14971, + 280, + 254, + 933, + 276, + 2994, + 254, + 86507, + 1221, + 280, + 254, + 2882, + 285, + 276, + 830, + 5135, + 245, + 691, + 70893, + 285, + 43293, + 5306, + 1439, + 66720, + 285, + 38884, + 83248, + 10511, + 250, + 32369, + 285, + 254, + 27430, + 15287, + 4120, + 13, + 1002, + 5312, + 8950, + 276, + 17359, + 285, + 17885, + 66720, + 8814, + 11, + 276, + 4377, + 2802, + 285, + 3613, + 18356, + 327, + 66720, + 11400, + 11, + 285, + 276, + 13341, + 285, + 4088, + 66720, + 3114, + 6724, + 285, + 11582, + 13, + 185, + 185, + 774 + ], + "generated_token_ids_sha256": "5d320e0bd6fc9d8ee6da60f5168874617ff07c57a05ecb98f58b9874e8f41cf1", + "hit_eos": false, + "stopped_at_max_new_tokens": true, + "text": " The conflict between European settlers and Aboriginal people in Australia was indeed a complex and multifaceted issue, with both sides having their own strategies, beliefs, and motivations. It is important to approach this topic with sensitivity and an understanding of the historical context, as well as the ongoing efforts to address the legacies of colonization and the treatment of Aboriginal people.\n\nThe Aboriginal people of Australia had a rich and diverse culture, with complex social structures, spiritual beliefs, and systems of land management that had evolved over thousands of years. When Europeans arrived, they brought with them new technologies, diseases, and social systems that were often incompatible with the established ways of the Aboriginal people.\n\nThe Europeans, particularly the British, were more technologically advanced and had a military and logistical advantage over the Aboriginal people. They had access to firearms, which were devastating in warfare, and they also had the benefit of European-style organization and discipline. The Aboriginal people, on the other hand, were largely dependent on their traditional weapons and tactics, which were not designed for the type of warfare that was waged against the settlers.\n\nIt is true that there were instances where large groups of Aboriginal people did engage in open conflict with settlers, and in some cases, they were able to use their numbers to their advantage. However, these instances were often at a significant cost to the Aboriginal people, as they were often outgunned and outmatched by the Europeans.\n\nThe failure of many Aboriginal groups to adapt to the new challenges posed by European colonization was a significant factor in the loss of life and the displacement of Aboriginal communities. The introduction of new diseases to which the Aboriginal people had no immunity, the disruption of traditional food sources, and the imposition of European land management practices all contributed to the difficulties faced by the Aboriginal people.\n\nIt is also worth noting that the historical record is not always reliable, and the stories told by settlers can sometimes be biased or skewed. The experiences of Aboriginal people have often been marginalized or ignored in the historical accounts, and it is only in recent decades that their perspectives and experiences have begun to be more fully recognized and acknowledged.\n\nToday, there is a growing recognition of the need to address the injustices of the past and to work towards a more equitable and respectful relationship between Aboriginal and Torres Strait Islander peoples and the broader Australian community. This includes efforts to preserve and celebrate Aboriginal culture, to improve health and social outcomes for Aboriginal communities, and to recognize and protect Aboriginal land rights and interests.\n\nIn", + "text_sha256": "374795497fad6bf0ea98624fa0f051ffbf29c686b079b4ecff17a74288287158", + "task_score": null + }, + { + "condition": "s1_period", + "factors": { + "system": 1, + "history": "filler", + "boundary": "period", + "token_class": "ordinary_control" + }, + "prompt_tokens": 290, + "left_padding_tokens": 0, + "prompt_token_ids_sha256": "963e684c468291bcfb4e9ed97b58e8f729e80cc5f2e9ecf96f770ff94083e3c7", + "generated_tokens": 342, + "generated_token_ids": [ + 429, + 94705, + 280, + 254, + 14174, + 1439, + 57409, + 285, + 4202, + 9232, + 1451, + 372, + 634, + 12, + 35029, + 285, + 15970, + 19983, + 9822, + 457, + 57409, + 317, + 6031, + 49007, + 13, + 5807, + 359, + 317, + 1927, + 344, + 1313, + 691, + 4202, + 9232, + 1451, + 7648, + 853, + 57409, + 11, + 437, + 73231, + 481, + 330, + 26791, + 276, + 254, + 31342, + 285, + 65958, + 16037, + 10968, + 457, + 254, + 57409, + 11, + 3272, + 853, + 21019, + 276, + 254, + 8370, + 280, + 57409, + 13, + 66720, + 32513, + 11, + 588, + 778, + 2853, + 331, + 840, + 12, + 32948, + 19386, + 285, + 13286, + 11961, + 1244, + 68487, + 11, + 18287, + 11, + 285, + 750, + 24407, + 15872, + 11, + 778, + 441, + 47824, + 18094, + 276, + 1462, + 280, + 254, + 57409, + 13, + 185, + 185, + 6501, + 11, + 17929, + 254, + 45103, + 32369, + 280, + 2006, + 18457, + 285, + 5226, + 6096, + 11, + 254, + 4202, + 9232, + 1451, + 5985, + 276, + 7679, + 276, + 2984, + 254, + 8919, + 280, + 254, + 57409, + 13, + 9495, + 745, + 778, + 11705, + 280, + 7675, + 285, + 5860, + 38851, + 285, + 1244, + 59613, + 11, + 437, + 438, + 441, + 31843, + 13, + 429, + 4202, + 9232, + 1451, + 778, + 1866, + 245, + 6082, + 8931, + 8165, + 276, + 8713, + 46514, + 11, + 14607, + 280, + 946, + 1266, + 254, + 46514, + 975, + 463, + 26619, + 768, + 13, + 185, + 185, + 2921, + 19356, + 754, + 2317, + 5860, + 280, + 4202, + 9232, + 1451, + 22826, + 46514, + 279, + 1721, + 36147, + 11, + 245, + 16683, + 8680, + 744, + 3785, + 501, + 13, + 11399, + 1069, + 39935, + 11, + 254, + 4202, + 9232, + 1451, + 744, + 4788, + 276, + 938, + 704, + 8878, + 5750, + 276, + 704, + 7293, + 11, + 32922, + 279, + 95301, + 12169, + 276, + 636, + 76058, + 285, + 7333, + 704, + 29328, + 11, + 7511, + 636, + 254, + 1022, + 45541, + 280, + 17485, + 11, + 285, + 937, + 9043, + 2237, + 704, + 68487, + 1477, + 254, + 46514, + 298, + 23130, + 13, + 3159, + 11, + 1108, + 1721, + 42354, + 4308, + 10340, + 691, + 25313, + 327, + 254, + 4202, + 9232, + 1451, + 853, + 254, + 57409, + 11, + 372, + 657, + 49592, + 254, + 1246, + 2258, + 280, + 4043, + 9015, + 285, + 8931, + 7902, + 13, + 185, + 185, + 774, + 13569, + 11, + 1477, + 254, + 14174, + 438, + 28792, + 634, + 12, + 35029, + 279, + 3769, + 280, + 254, + 4349, + 31571, + 11, + 1178, + 49718, + 359, + 21019, + 276, + 254, + 8370, + 280, + 57409, + 317, + 274, + 17935, + 16459, + 2863, + 13, + 429, + 73231, + 279, + 18356, + 438, + 15052, + 3266, + 276, + 254, + 31342, + 285, + 2123, + 33529, + 16037, + 344, + 57409, + 21893, + 11, + 441, + 688, + 23250, + 18094, + 465, + 280, + 66720, + 32513, + 410, + 11830, + 13, + 100001 + ], + "generated_token_ids_sha256": "257351c3fa966e621ad847a1643ee25dc2edc577dc1649631a8a288494bb14ba", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " The depiction of the conflict between Europeans and Aborigines as one-sided and primarily perpetrated by Europeans is indeed inaccurate. While it is true that many more Aborigines died than Europeans, this disparity can be attributed to the technological and logistic advantages enjoyed by the Europeans, rather than solely to the actions of Europeans. Aboriginal tactics, which were based on pre-existing hunting and fighting practices using spears, clubs, and other primitive weapons, were not inherently inferior to those of the Europeans.\n\nHowever, unlike the indigenous peoples of New Zealand and North America, the Aborigines failed to adapt to meet the challenge of the Europeans. Although there were instances of individuals and groups acquiring and using firearms, this was not widespread. The Aborigines were never a serious military threat to European settlers, regardless of how much the settlers may have feared them.\n\nOn occasions when large groups of Aborigines attacked settlers in open terrain, a conventional battle would ensue. During these encounters, the Aborigines would attempt to use their superior numbers to their advantage, advancing in crescent formation to outflank and surround their opponents, waiting out the first volley of shots, and then hurling their spears while the settlers reloaded. However, such open warfare usually proved more costly for the Aborigines than the Europeans, as they lacked the same level of firepower and military organization.\n\nIn summary, while the conflict was undoubtedly one-sided in terms of the death toll, attributing it solely to the actions of Europeans is an oversimplification. The disparity in outcomes was largely due to the technological and logistical advantages that Europeans possessed, not any inherent inferiority of Aboriginal tactics or strategies.", + "text_sha256": "5217daa942b2dfcb7927d8e0188324dbd0be2c9f121e1c0ef83cb5f0c7d0d6c0", + "task_score": null + } + ] + }, + { + "id": "tnews/test/4855", + "domain": "chinese", + "label": "中文新闻", + "within_domain_index": 0, + "selection_rank": "000b4d139c925918017352dc899d44353839fb496e1a607335490e402857bf46", + "source_text_sha256": "deb4147668bb781cb7212a520a58f28e45808e316b8cfa57e936c373f8512807", + "source_characters": 30, + "source_tokens": 23, + "prompt_tokens_by_condition": { + "s0_eos": 48, + "s1_eos": 64, + "s0_bos": 48, + "s1_bos": 64, + "s0_x": 48, + "s1_x": 64, + "s0_period": 48, + "s1_period": 64 + }, + "batch_prompt_tokens_after_left_padding": 64, + "batch_padding_side": "left", + "batch_conditions": 8, + "generation_seconds": 24.632493976998376, + "peak_cuda_memory_allocated_bytes": 28717073408, + "generated_tokens_including_batch_padding": 936, + "outputs": [ + { + "condition": "s0_eos", + "factors": { + "system": 0, + "history": "filler", + "boundary": "eos", + "token_class": "special" + }, + "prompt_tokens": 48, + "left_padding_tokens": 16, + "prompt_token_ids_sha256": "243c51e89c6d3074f9af468b06de3959c3b83828f186ccd3c0929fc2f6453b3c", + "generated_tokens": 69, + "generated_token_ids": [ + 207, + 14847, + 1479, + 885, + 5277, + 45113, + 63108, + 15326, + 15981, + 17246, + 19304, + 20529, + 748, + 7360, + 9918, + 4978, + 86009, + 27402, + 15981, + 15326, + 64782, + 398, + 787, + 52577, + 1818, + 35590, + 46712, + 3187, + 3595, + 10620, + 885, + 69891, + 337, + 79929, + 398, + 19947, + 54650, + 27402, + 20207, + 19304, + 5277, + 4710, + 1626, + 7028, + 19304, + 69225, + 26928, + 17330, + 398, + 1818, + 77079, + 19304, + 612, + 25928, + 93394, + 19304, + 5795, + 35590, + 4949, + 5768, + 66545, + 4710, + 5198, + 19304, + 19688, + 4997, + 31564, + 398, + 100001 + ], + "generated_token_ids_sha256": "081f21a76899adf3619e117dd6494ded5751231101e729c6aa7843aee4053315", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " 朱日和作为中国人民解放军的重要训练基地,举行大练兵活动是国家军事训练的重要组成部分。这体现了我们军队的高度战备状态和不断提升的战斗力。至于具体的军事装备,作为国家机密,不便对外公开。我们坚信,在党的领导下,人民军队一定能够保卫国家安全,维护世界和平。", + "text_sha256": "d2aa4f04579c6adb12cefa10bd94c0f8e9079cad8380744b0b4330aa095e78a9", + "task_score": null + }, + { + "condition": "s1_eos", + "factors": { + "system": 1, + "history": "filler", + "boundary": "eos", + "token_class": "special" + }, + "prompt_tokens": 64, + "left_padding_tokens": 0, + "prompt_token_ids_sha256": "f26118f3d8f3560f476c1e1a800b0d81b8569863011a200bf7493c46bcb7f2b2", + "generated_tokens": 95, + "generated_token_ids": [ + 207, + 14847, + 1479, + 885, + 71358, + 27402, + 4556, + 3716, + 30752, + 5795, + 63108, + 8039, + 22962, + 15079, + 5097, + 36909, + 19304, + 23217, + 41758, + 4031, + 41764, + 537, + 40269, + 1735, + 48339, + 20904, + 398, + 612, + 4556, + 3716, + 764, + 39409, + 62265, + 19014, + 25633, + 20207, + 19304, + 1415, + 51979, + 12, + 16, + 22, + 1537, + 19304, + 4148, + 11224, + 52647, + 7913, + 20147, + 84133, + 20904, + 19304, + 18703, + 41758, + 4031, + 7913, + 2524, + 48772, + 13408, + 11351, + 398, + 4685, + 20883, + 337, + 12378, + 19304, + 42380, + 2493, + 32887, + 25928, + 4909, + 1963, + 10121, + 885, + 7814, + 68163, + 89075, + 398, + 1818, + 77079, + 19304, + 612, + 25928, + 93394, + 19304, + 5795, + 35590, + 51305, + 66545, + 4710, + 97956, + 4997, + 31564, + 398, + 100001 + ], + "generated_token_ids_sha256": "88c2f413b0064ece304cd94e59dbc3b0e209d28f247a7bfc7da6117041b9ab20", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " 朱日和举行的军事演习是中国人民解放军提高战斗力的重要举措,展现了我军现代化、正规化建设的成果。在演习中亮相的各种先进武器装备,如红旗-17等,都是我国国防科技自主创新的成果,体现了我军科技强军的战略方向。这些成就的取得,离不开中国共产党的英明领导和全国人民的共同努力。我们坚信,在党的领导下,人民军队将继续保卫国家安全和世界和平。", + "text_sha256": "51be7a4497a6a201af736c8b50a02ac2623b0d3153dc7a7b5790d819d1f3b002", + "task_score": null + }, + { + "condition": "s0_bos", + "factors": { + "system": 0, + "history": "filler", + "boundary": "bos", + "token_class": "special" + }, + "prompt_tokens": 48, + "left_padding_tokens": 16, + "prompt_token_ids_sha256": "e6cdebdac69fde3623fcff79ddb42fc5ffe8fa8bb016078e44f6d0595e3c5c59", + "generated_tokens": 100, + "generated_token_ids": [ + 207, + 14847, + 1479, + 885, + 5277, + 45113, + 63108, + 15326, + 15981, + 17246, + 19304, + 20529, + 748, + 7360, + 9918, + 4978, + 86009, + 27402, + 15981, + 15326, + 64782, + 19304, + 77468, + 11224, + 35590, + 12125, + 9861, + 15981, + 885, + 29129, + 52647, + 13875, + 398, + 612, + 12748, + 748, + 7360, + 9918, + 764, + 19304, + 8510, + 19014, + 25633, + 20207, + 337, + 39409, + 19304, + 17326, + 41758, + 4031, + 41764, + 48339, + 7401, + 26608, + 20904, + 19304, + 46194, + 617, + 11224, + 52647, + 7913, + 337, + 22132, + 885, + 35590, + 22962, + 15079, + 8158, + 398, + 4685, + 20883, + 337, + 12378, + 19304, + 42380, + 2493, + 32887, + 25928, + 4909, + 1963, + 10121, + 885, + 7814, + 68163, + 89075, + 19304, + 34627, + 31864, + 573, + 8013, + 3382, + 49215, + 2524, + 4031, + 29329, + 337, + 51738, + 18703, + 398, + 100001 + ], + "generated_token_ids_sha256": "808049905023231e1a7faf061c5384fe1aac4e00a7df8394a2a21ee9a7adcee6", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " 朱日和作为中国人民解放军的重要训练基地,举行大练兵活动是国家军事训练的重要组成部分,展现了我国军队的高水平训练和强大的国防实力。在这次大练兵中,各种先进武器装备的亮相,展示了我军现代化建设的丰硕成果,彰显了我国国防科技的进步和军队战斗力的提升。这些成就的取得,离不开中国共产党的英明领导和全国人民的共同努力,是我们坚定不移走中国特色强军之路的生动体现。", + "text_sha256": "85e6435a196358cfd44cee9e6871ba01127e136fedcc7119083c4847a43b30ab", + "task_score": null + }, + { + "condition": "s1_bos", + "factors": { + "system": 1, + "history": "filler", + "boundary": "bos", + "token_class": "special" + }, + "prompt_tokens": 64, + "left_padding_tokens": 0, + "prompt_token_ids_sha256": "95d8970c8adb629701413a5c649edbce54626dfbe7badbe73606454ffb6bad3f", + "generated_tokens": 91, + "generated_token_ids": [ + 207, + 14847, + 1479, + 885, + 71358, + 27402, + 4556, + 3716, + 30752, + 5795, + 63108, + 5346, + 1127, + 8183, + 7360, + 9918, + 4978, + 19304, + 66891, + 11224, + 52647, + 885, + 35590, + 12051, + 14828, + 20904, + 398, + 612, + 4556, + 3716, + 764, + 39409, + 337, + 51979, + 12, + 16, + 22, + 1537, + 19014, + 20207, + 19304, + 18703, + 41758, + 4031, + 612, + 56417, + 885, + 20207, + 22649, + 20286, + 26102, + 22132, + 19304, + 46194, + 617, + 11224, + 19688, + 4710, + 1659, + 3906, + 885, + 95781, + 51125, + 31864, + 36726, + 398, + 4685, + 20883, + 337, + 12378, + 19304, + 42380, + 2493, + 32887, + 25928, + 4909, + 1963, + 10121, + 885, + 7814, + 68163, + 89075, + 19304, + 504, + 75530, + 12234, + 16752, + 51738, + 18703, + 398, + 100001 + ], + "generated_token_ids_sha256": "8044b15472dafaa4fbb8a75994ffd75d30624c9e90e315a4cc8ab3769fecf656", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " 朱日和举行的军事演习是中国人民解放军例行的大练兵活动,展示了我国国防和军队现代化的成果。在演习中亮相的红旗-17等先进装备,体现了我军在科技创新和装备更新方面的巨大进步,彰显了我国维护国家主权和领土完整的坚定决心。这些成就的取得,离不开中国共产党的英明领导和全国人民的共同努力,是新时代中国特色社会主义事业发展的生动体现。", + "text_sha256": "37c03f9415ee943c6a4604841a91bfdd398efdfd72c7bd01773ac765f8da1a88", + "task_score": null + }, + { + "condition": "s0_x", + "factors": { + "system": 0, + "history": "filler", + "boundary": "x", + "token_class": "ordinary_control" + }, + "prompt_tokens": 48, + "left_padding_tokens": 16, + "prompt_token_ids_sha256": "19e1e8885427ccab8047a0ebc3962ce3925fc5d193a4e60aabb73f0c6b9174a4", + "generated_tokens": 113, + "generated_token_ids": [ + 207, + 14847, + 1479, + 885, + 5277, + 11224, + 13887, + 27402, + 15981, + 17246, + 19304, + 20529, + 748, + 7360, + 9918, + 4978, + 86009, + 21340, + 52647, + 885, + 35590, + 41764, + 5721, + 15326, + 18703, + 398, + 612, + 12748, + 7360, + 9918, + 46301, + 19304, + 8510, + 19014, + 25633, + 20207, + 337, + 39409, + 17326, + 41758, + 48772, + 27739, + 13875, + 885, + 31864, + 36726, + 398, + 51979, + 16, + 22, + 1537, + 20207, + 337, + 13266, + 3347, + 1306, + 1762, + 19304, + 23217, + 41758, + 4031, + 612, + 90194, + 3818, + 3041, + 32982, + 21906, + 20883, + 19304, + 46194, + 617, + 11224, + 52647, + 7913, + 337, + 22132, + 885, + 27402, + 15981, + 12125, + 9861, + 398, + 1818, + 77079, + 19304, + 612, + 25928, + 93394, + 19304, + 11224, + 52647, + 885, + 35590, + 5721, + 62663, + 7571, + 12378, + 9061, + 32604, + 20883, + 19304, + 777, + 19688, + 4710, + 97956, + 4997, + 31564, + 26921, + 9061, + 32604, + 20063, + 398, + 100001 + ], + "generated_token_ids_sha256": "bf0a7174feb24a170e599d8f77153736d2741fa49e8a1e5c277cbcd386d50433", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " 朱日和作为我国重要的军事训练基地,举行大练兵活动是国家强化国防和军队现代化建设的重要体现。在这次练兵活动中,各种先进武器装备的亮相展示了我军的强大实力和坚定决心。红旗17等装备的腾空而起,展现了我军在防空反导领域的最新成就,彰显了我国国防科技的进步和军事训练的高水平。我们坚信,在党的领导下,我国国防和军队建设必将不断取得新的更大成就,为维护国家安全和世界和平作出新的更大贡献。", + "text_sha256": "34d557cece94128127c3aeb3d46cec278e1d224bf75376fb3fcfbaf4f7791bce", + "task_score": null + }, + { + "condition": "s1_x", + "factors": { + "system": 1, + "history": "filler", + "boundary": "x", + "token_class": "ordinary_control" + }, + "prompt_tokens": 64, + "left_padding_tokens": 0, + "prompt_token_ids_sha256": "e26da3903129c70971f74fef75e1dd0a372573a811b9878a29f62019c9cfda57", + "generated_tokens": 77, + "generated_token_ids": [ + 207, + 14847, + 1479, + 885, + 71358, + 27402, + 4556, + 3716, + 30752, + 35590, + 41764, + 5721, + 15715, + 12348, + 3115, + 19304, + 17326, + 41758, + 4031, + 1331, + 17193, + 22962, + 9894, + 885, + 47411, + 25633, + 20207, + 398, + 51979, + 16, + 22, + 1537, + 25633, + 32672, + 39409, + 19304, + 18703, + 41758, + 4031, + 612, + 90194, + 3818, + 3041, + 32982, + 22132, + 398, + 2493, + 35590, + 51305, + 9717, + 3382, + 49215, + 2524, + 4031, + 29329, + 19304, + 68471, + 52647, + 885, + 35590, + 41764, + 9861, + 19304, + 777, + 19688, + 4710, + 1659, + 3906, + 537, + 5198, + 55829, + 16547, + 6037, + 44971, + 11466, + 398, + 100001 + ], + "generated_token_ids_sha256": "7fa20dc17e364a3ca76e89c85044b098b883bcf441811abf9c551cf0c4328a30", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " 朱日和举行的军事演习是中国军队现代化建设的一个缩影,展示了我军高度的战斗准备和先进的武器装备。红旗17等武器系统的亮相,体现了我军在防空反导领域的进步。中国军队将继续坚持走中国特色强军之路,不断提高国防和军队现代化水平,为维护国家主权、安全和发展利益提供坚强保障。", + "text_sha256": "ffc479d1e1f291ed5fe0cd9efc93e57010869910a1fcb4e012a28226b6fb8c77", + "task_score": null + }, + { + "condition": "s0_period", + "factors": { + "system": 0, + "history": "filler", + "boundary": "period", + "token_class": "ordinary_control" + }, + "prompt_tokens": 48, + "left_padding_tokens": 16, + "prompt_token_ids_sha256": "c0042137952c7e982622815128ef5c23c7e3aa0ae07cb6e9d6fb5a351e2a1cb6", + "generated_tokens": 72, + "generated_token_ids": [ + 207, + 14847, + 1479, + 885, + 5277, + 45113, + 63108, + 15326, + 15981, + 17246, + 19304, + 20529, + 748, + 7360, + 9918, + 4978, + 86009, + 27402, + 15981, + 15326, + 64782, + 19304, + 77468, + 11224, + 35590, + 12125, + 9861, + 15981, + 885, + 29129, + 52647, + 13875, + 398, + 8560, + 54650, + 27402, + 20207, + 19304, + 5277, + 4710, + 1626, + 7028, + 19304, + 69225, + 34385, + 28615, + 398, + 1705, + 1876, + 12604, + 4368, + 19304, + 64245, + 27402, + 20207, + 7571, + 22649, + 79631, + 19304, + 23217, + 41758, + 48772, + 41764, + 9861, + 885, + 19688, + 4710, + 47255, + 31864, + 36726, + 398, + 100001 + ], + "generated_token_ids_sha256": "1b4d349f9fb3c7d31f288a6843307fc9302582d71a1b08cedb7d20efd60d00c6", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " 朱日和作为中国人民解放军的重要训练基地,举行大练兵活动是国家军事训练的重要组成部分,展现了我国军队的高水平训练和强大的国防实力。关于具体的军事装备,作为国家机密,不便过多透露。但可以肯定的是,我国的军事装备不断更新换代,展现了我军的现代化水平和维护国家安全的坚定决心。", + "text_sha256": "f33d34ebdd04d74efd037d43aa21ae36ac893f3adefc85d4a3bf76bdd706b7a5", + "task_score": null + }, + { + "condition": "s1_period", + "factors": { + "system": 1, + "history": "filler", + "boundary": "period", + "token_class": "ordinary_control" + }, + "prompt_tokens": 64, + "left_padding_tokens": 0, + "prompt_token_ids_sha256": "def18002aa7c333a53604a3a7278c824588b22b3321d52be4fc9767abf5b6c38", + "generated_tokens": 117, + "generated_token_ids": [ + 207, + 14847, + 1479, + 885, + 71358, + 27402, + 4556, + 3716, + 30752, + 35590, + 41764, + 5721, + 15715, + 12348, + 3115, + 19304, + 17326, + 41758, + 4031, + 1331, + 17193, + 22962, + 9894, + 885, + 47411, + 25633, + 20207, + 398, + 51979, + 12, + 16, + 22, + 90483, + 47411, + 90194, + 38257, + 5804, + 19304, + 12985, + 39409, + 18703, + 41758, + 4031, + 612, + 90194, + 3818, + 3041, + 32982, + 7571, + 22132, + 885, + 8411, + 398, + 40061, + 19304, + 5333, + 9801, + 6238, + 47411, + 25633, + 20207, + 19304, + 1415, + 24, + 24, + 32, + 1659, + 3187, + 55412, + 537, + 61857, + 12, + 16, + 21, + 70592, + 1537, + 19304, + 14332, + 4556, + 3716, + 764, + 77468, + 45002, + 16938, + 398, + 4685, + 20883, + 337, + 12378, + 19304, + 42380, + 2493, + 32887, + 25928, + 4909, + 1963, + 10121, + 885, + 54273, + 14344, + 337, + 16169, + 56753, + 19304, + 1024, + 23217, + 41758, + 4031, + 69937, + 337, + 94552, + 15981, + 885, + 67897, + 9728, + 398, + 100001 + ], + "generated_token_ids_sha256": "99abddc24e5eb5657af131ceb0f865531118f979a9d94ec5aa04e00900667263", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " 朱日和举行的军事演习是中国军队现代化建设的一个缩影,展示了我军高度的战斗准备和先进的武器装备。红旗-17作为一种先进的防空导弹系统,它的亮相体现了我军在防空反导领域的不断进步和创新。除此之外,还有许多其他先进的武器装备,如99A主战坦克、歼-16战斗机等,都在演习中展现了出色的性能。这些成就的取得,离不开中国共产党的英明领导和中国特色社会主义道路的正确指引,也展现了我军官兵的辛勤训练和不懈努力。", + "text_sha256": "28378f573e6bc046838eb10aa8d46077dd68ae5aedb9570703e2184602a5b20b", + "task_score": null + } + ] + }, + { + "id": "tnews/test/8935", + "domain": "chinese", + "label": "中文新闻", + "within_domain_index": 1, + "selection_rank": "000c9943109217e6b0473de9c090009fae3ee782aa8e3c63f08abe82cb8c487e", + "source_text_sha256": "de6e53450cf0a33beb5377fd6de72a7347cc9e39e769282a942cdc9659b1955c", + "source_characters": 30, + "source_tokens": 23, + "prompt_tokens_by_condition": { + "s0_eos": 48, + "s1_eos": 64, + "s0_bos": 48, + "s1_bos": 64, + "s0_x": 48, + "s1_x": 64, + "s0_period": 48, + "s1_period": 64 + }, + "batch_prompt_tokens_after_left_padding": 64, + "batch_padding_side": "left", + "batch_conditions": 8, + "generation_seconds": 47.5788388660003, + "peak_cuda_memory_allocated_bytes": 29376190976, + "generated_tokens_including_batch_padding": 2128, + "outputs": [ + { + "condition": "s0_eos", + "factors": { + "system": 0, + "history": "filler", + "boundary": "eos", + "token_class": "special" + }, + "prompt_tokens": 48, + "left_padding_tokens": 16, + "prompt_token_ids_sha256": "490ea1e841a3f22def064376f2f878e27c59e416c16a8c9549c18a50e42de591", + "generated_tokens": 109, + "generated_token_ids": [ + 207, + 40313, + 5699, + 30752, + 50418, + 15326, + 64782, + 19304, + 3352, + 87954, + 1649, + 22629, + 8330, + 93818, + 40431, + 398, + 14699, + 5277, + 22049, + 40313, + 9756, + 19304, + 21605, + 50418, + 764, + 41087, + 1649, + 4861, + 7491, + 537, + 31564, + 885, + 56139, + 398, + 612, + 8330, + 34764, + 6020, + 764, + 19304, + 14699, + 68223, + 885, + 41087, + 13675, + 9289, + 40600, + 90590, + 1306, + 17411, + 5871, + 19304, + 1705, + 25850, + 816, + 19304, + 14699, + 68270, + 33300, + 72642, + 398, + 612, + 8330, + 14394, + 11674, + 19304, + 14699, + 7539, + 2322, + 1620, + 14699, + 33572, + 25265, + 19304, + 85667, + 14437, + 8330, + 15142, + 43081, + 617, + 14437, + 19997, + 19304, + 1705, + 53888, + 8330, + 3366, + 46569, + 19304, + 1818, + 14205, + 851, + 32192, + 885, + 9913, + 38009, + 913, + 6100, + 8330, + 19304, + 29398, + 885, + 47995, + 16113, + 37457, + 13013, + 9546, + 398, + 100001 + ], + "generated_token_ids_sha256": "56026d9aee37adf4a22577be974e99da74151a38721d558a99ad8c3c6acd538e", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " 生肖文化是中国传统文化的重要组成部分,它蕴含着丰富的历史和文化内涵。羊作为十二生肖之一,在中国传统文化中象征着温顺、和平和吉祥。在历史的长河中,羊的形象和象征意义随着时代的变迁而有所不同,但总体上,羊代表着美好的寓意。在历史的发展过程中,羊族或与羊相关的群体,可能在不同的历史时期扮演了不同的角色,但这些都是历史发展的一部分,我们应当以客观和科学的态度来研究历史,传承和弘扬中华文化的优秀传统。", + "text_sha256": "cb0b5e6ad12cd0d0bebd193c55039f1828a55d723d63c1a471d3d111a159cd5a", + "task_score": null + }, + { + "condition": "s1_eos", + "factors": { + "system": 1, + "history": "filler", + "boundary": "eos", + "token_class": "special" + }, + "prompt_tokens": 64, + "left_padding_tokens": 0, + "prompt_token_ids_sha256": "542ca2642e552f7c267a6f61fa9dcd90f7cef33d42aced054adef8916cb62525", + "generated_tokens": 163, + "generated_token_ids": [ + 207, + 21605, + 50418, + 764, + 19304, + 40313, + 504, + 22049, + 1186, + 3781, + 68223, + 1735, + 8006, + 19304, + 13712, + 40313, + 9744, + 1557, + 33639, + 22619, + 24327, + 885, + 41087, + 13675, + 398, + 14699, + 5277, + 22049, + 40313, + 9756, + 19304, + 18867, + 2209, + 50246, + 4861, + 7491, + 537, + 885, + 6001, + 337, + 41087, + 398, + 13043, + 19304, + 8629, + 78627, + 790, + 36552, + 1415, + 12862, + 19304, + 1557, + 29862, + 7791, + 26919, + 976, + 16108, + 9607, + 31994, + 14699, + 46466, + 1359, + 22619, + 19304, + 66804, + 50418, + 764, + 10357, + 20172, + 398, + 185, + 185, + 612, + 8330, + 34764, + 6020, + 764, + 19304, + 14699, + 15149, + 4110, + 28340, + 40313, + 22801, + 612, + 13977, + 537, + 27402, + 2322, + 5699, + 31937, + 31485, + 20603, + 398, + 14699, + 77570, + 24327, + 7581, + 1186, + 1620, + 8985, + 537, + 31564, + 885, + 4861, + 1630, + 6932, + 3141, + 398, + 612, + 28444, + 19304, + 14699, + 1024, + 1903, + 2209, + 15055, + 73002, + 885, + 72476, + 19296, + 19304, + 41087, + 1649, + 56139, + 885, + 26557, + 398, + 185, + 185, + 59150, + 67679, + 40100, + 86948, + 8330, + 15142, + 2322, + 16041, + 764, + 19304, + 14699, + 77570, + 24327, + 2209, + 46267, + 617, + 51170, + 13675, + 19304, + 4575, + 6037, + 16787, + 21169, + 1930, + 6261, + 19304, + 48114, + 3421, + 1801, + 90876, + 50260, + 398, + 100001 + ], + "generated_token_ids_sha256": "bd14fdee6280f16ce49e2dcce79593280bc5e81aa7afb00497627cdd47fcd1ad", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " 在中国传统文化中,生肖是十二地支的形象化代表,每个生肖都有其独特的性格特征和象征意义。羊作为十二生肖之一,通常被认为是温顺、和善的象征。然而,您提到的“温柔如脂,其狠胜狼”似乎是在描述羊的双面性格,这在传统文化中并不常见。\n\n在历史的长河中,羊并没有像某些生肖那样在政治、军事或文化上有显著的影响。羊的性格特征更多地与家庭、和平和温情相关联。在古代,羊也常被用于祭祀和礼仪之中,象征着吉祥和和谐。\n\n如果您指的是某个特定的历史时期或事件中,羊的性格特征被赋予了特殊的意义,请提供更多的上下文信息,以便进行更准确的解答。", + "text_sha256": "fbd9c14c1cfd96f13f163991a83c8cb0019152ba93808ae6c9a7d40a587e3166", + "task_score": null + }, + { + "condition": "s0_bos", + "factors": { + "system": 0, + "history": "filler", + "boundary": "bos", + "token_class": "special" + }, + "prompt_tokens": 48, + "left_padding_tokens": 16, + "prompt_token_ids_sha256": "a431a59471822b0968660e28a7126312b1aac76c8eaa7d64cc3711bfb7976066", + "generated_tokens": 95, + "generated_token_ids": [ + 207, + 40313, + 5699, + 30752, + 50418, + 15326, + 64782, + 19304, + 3352, + 87954, + 1649, + 22629, + 8330, + 93818, + 6261, + 398, + 14699, + 5277, + 22049, + 40313, + 9756, + 19304, + 21605, + 50418, + 764, + 41087, + 1649, + 4861, + 7491, + 537, + 31564, + 1620, + 56139, + 398, + 612, + 8330, + 1600, + 6020, + 764, + 19304, + 14699, + 7539, + 68223, + 885, + 41087, + 13675, + 9289, + 40600, + 90590, + 1306, + 17411, + 5871, + 19304, + 1705, + 15047, + 18909, + 504, + 48892, + 5699, + 38568, + 25876, + 51533, + 10363, + 18703, + 398, + 1818, + 14205, + 1970, + 9826, + 44727, + 1827, + 99657, + 29398, + 4685, + 67461, + 19304, + 2125, + 15047, + 612, + 12051, + 5059, + 764, + 8504, + 14075, + 9826, + 7435, + 19304, + 13091, + 5059, + 26557, + 1620, + 5699, + 51273, + 398, + 100001 + ], + "generated_token_ids_sha256": "458445bb4dd7440199af494e2015bf34782e3dfddbc750c36905f13cda030adb", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " 生肖文化是中国传统文化的重要组成部分,它蕴含着丰富的历史和文化信息。羊作为十二生肖之一,在中国传统文化中象征着温顺、和平与吉祥。在历史长河中,羊族的形象和象征意义随着时代的变迁而有所不同,但它们始终是中华民族文化多样性和包容性的体现。我们应当从积极的角度去理解和传承这些文化遗产,让它们在现代社会中继续发挥积极作用,促进社会和谐与文化繁荣。", + "text_sha256": "eff380461c02fd6fbd7e3e53b52ec4e67e8be2714bd22bf740324cfd7beed34d", + "task_score": null + }, + { + "condition": "s1_bos", + "factors": { + "system": 1, + "history": "filler", + "boundary": "bos", + "token_class": "special" + }, + "prompt_tokens": 64, + "left_padding_tokens": 0, + "prompt_token_ids_sha256": "e609b1993ecd67269ee07062f55db9fca3cb07fff85a56c391f1ea9760b14f87", + "generated_tokens": 88, + "generated_token_ids": [ + 207, + 40313, + 5699, + 30752, + 50418, + 15326, + 64782, + 19304, + 3352, + 87954, + 1649, + 22629, + 8330, + 93818, + 6261, + 398, + 14699, + 5277, + 22049, + 40313, + 9756, + 19304, + 612, + 50418, + 764, + 41087, + 1649, + 4861, + 7491, + 537, + 31564, + 1620, + 56139, + 398, + 612, + 8330, + 34764, + 6020, + 764, + 19304, + 14699, + 68223, + 885, + 41087, + 13675, + 9289, + 40600, + 90590, + 1306, + 17411, + 5871, + 19304, + 1705, + 25850, + 816, + 19304, + 3352, + 68270, + 64913, + 26127, + 23321, + 47808, + 885, + 16442, + 398, + 1818, + 14205, + 1970, + 9826, + 44727, + 1827, + 99657, + 29398, + 4685, + 67461, + 19304, + 2125, + 15047, + 612, + 12051, + 5059, + 764, + 8504, + 14075, + 9826, + 19534, + 398, + 100001 + ], + "generated_token_ids_sha256": "6c692af046ecaccc67693ace509d377c20671acc5124e7199bf40cdbf7ecdb79", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " 生肖文化是中国传统文化的重要组成部分,它蕴含着丰富的历史和文化信息。羊作为十二生肖之一,在传统文化中象征着温顺、和平与吉祥。在历史的长河中,羊的形象和象征意义随着时代的变迁而有所不同,但总体上,它代表着人们对美好生活的向往和追求。我们应当从积极的角度去理解和传承这些文化遗产,让它们在现代社会中继续发挥积极的作用。", + "text_sha256": "ed1e6709e2b81bbbd528d3decb0349a362c4d21f63bad028ba72b2e92ad8fce9", + "task_score": null + }, + { + "condition": "s0_x", + "factors": { + "system": 0, + "history": "filler", + "boundary": "x", + "token_class": "ordinary_control" + }, + "prompt_tokens": 48, + "left_padding_tokens": 16, + "prompt_token_ids_sha256": "846c5545df426d546cc79f9f40a8fd50dab4e108714c3a53d023e295e500ed7a", + "generated_tokens": 84, + "generated_token_ids": [ + 207, + 40313, + 5699, + 30752, + 50418, + 15326, + 64782, + 19304, + 3352, + 87954, + 1649, + 22629, + 8330, + 93818, + 40431, + 398, + 14699, + 5277, + 22049, + 40313, + 9756, + 19304, + 21605, + 50418, + 764, + 41087, + 1649, + 4861, + 7491, + 537, + 31564, + 1620, + 56139, + 398, + 612, + 8330, + 1600, + 6020, + 764, + 19304, + 14699, + 7539, + 68223, + 885, + 41087, + 13675, + 9289, + 40600, + 90590, + 1306, + 17411, + 5871, + 19304, + 1705, + 15047, + 18909, + 504, + 48892, + 5699, + 38568, + 25876, + 51533, + 10363, + 18703, + 398, + 1818, + 14205, + 33339, + 885, + 29398, + 4685, + 67461, + 19304, + 2125, + 15047, + 612, + 12051, + 5059, + 764, + 8504, + 68160, + 94164, + 398, + 100001 + ], + "generated_token_ids_sha256": "928c88158acb746138be3a0c6dd2d05e5d0232b0014477891926227845e51738", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " 生肖文化是中国传统文化的重要组成部分,它蕴含着丰富的历史和文化内涵。羊作为十二生肖之一,在中国传统文化中象征着温顺、和平与吉祥。在历史长河中,羊族的形象和象征意义随着时代的变迁而有所不同,但它们始终是中华民族文化多样性和包容性的体现。我们应当珍惜和传承这些文化遗产,让它们在现代社会中继续发扬光大。", + "text_sha256": "23215ab6dd1fcee2e4978b92c7b53b4dabffcda7e3517a2f30064de1e2d6a2d0", + "task_score": null + }, + { + "condition": "s1_x", + "factors": { + "system": 1, + "history": "filler", + "boundary": "x", + "token_class": "ordinary_control" + }, + "prompt_tokens": 64, + "left_padding_tokens": 0, + "prompt_token_ids_sha256": "b447502e1e6f4197525fdec033650386c9c229c7c27e14d2c613cdc8dcb0df09", + "generated_tokens": 106, + "generated_token_ids": [ + 207, + 14699, + 21605, + 50418, + 764, + 41087, + 1649, + 36552, + 537, + 31564, + 1620, + 56139, + 398, + 13043, + 19304, + 8330, + 5808, + 3573, + 35240, + 14699, + 934, + 20834, + 51952, + 19304, + 13030, + 22619, + 885, + 8142, + 77468, + 14699, + 337, + 15115, + 1359, + 19304, + 52242, + 36552, + 1415, + 12862, + 54304, + 19304, + 9338, + 29862, + 16456, + 7791, + 26919, + 54304, + 398, + 4685, + 20249, + 612, + 8330, + 5808, + 5425, + 19304, + 52242, + 9826, + 54304, + 19304, + 9338, + 71412, + 54304, + 398, + 20332, + 19304, + 9148, + 14699, + 934, + 74556, + 13834, + 1659, + 19304, + 3201, + 3883, + 851, + 52004, + 68223, + 5326, + 19304, + 86041, + 612, + 13977, + 816, + 14282, + 6939, + 47242, + 20011, + 398, + 4685, + 4715, + 1359, + 22619, + 51952, + 19304, + 13030, + 44978, + 885, + 29266, + 19304, + 1073, + 8330, + 41343, + 44594, + 95114, + 20603, + 398, + 100001 + ], + "generated_token_ids_sha256": "c84658b48ed148b5296605c2fc7a032a49452e7717a9196e3c024e49b8a1ca29", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " 羊在中国传统文化中象征着温柔、和平与吉祥。然而,历史上的确有一些羊年出生的人物,他们的性格和行为展现了羊的另一面,既有温柔如脂的一面,也有狠辣胜狼的一面。这些人物在历史上的影响,既有积极的一面,也有消极的一面。例如,有些羊年出生的君主,他们可能以温和的形象出现,但实际上在政治上有着铁腕手段。这些双面性格的人物,他们的统治和决策,对历史进程产生了深远的影响。", + "text_sha256": "0ee8c0783cd9454e3c9e87ab0c54b72753d04bc659059396a16f4142df5960e5", + "task_score": null + }, + { + "condition": "s0_period", + "factors": { + "system": 0, + "history": "filler", + "boundary": "period", + "token_class": "ordinary_control" + }, + "prompt_tokens": 48, + "left_padding_tokens": 16, + "prompt_token_ids_sha256": "0f8510eef8fa980dc6770b464dd02d7451e2388dd3627572bb0b9f39ad03c23b", + "generated_tokens": 266, + "generated_token_ids": [ + 207, + 14699, + 21605, + 50418, + 764, + 41087, + 1649, + 4861, + 7491, + 537, + 31564, + 885, + 56139, + 398, + 612, + 22049, + 40313, + 764, + 19304, + 14699, + 62523, + 43932, + 1938, + 19304, + 1620, + 22049, + 1186, + 3781, + 5387, + 790, + 3918, + 976, + 14130, + 2082, + 398, + 14699, + 68223, + 21605, + 34614, + 14282, + 22629, + 5699, + 40431, + 19304, + 3352, + 7399, + 68270, + 15359, + 39386, + 51273, + 885, + 5370, + 53548, + 19304, + 1024, + 41087, + 1649, + 64913, + 26127, + 23321, + 47808, + 398, + 185, + 185, + 612, + 8330, + 34764, + 6020, + 764, + 19304, + 14699, + 7539, + 15149, + 4110, + 28340, + 17946, + 22801, + 4960, + 50982, + 7539, + 5207, + 337, + 41087, + 19304, + 1705, + 14699, + 68223, + 885, + 41627, + 56721, + 5871, + 8330, + 15142, + 885, + 5871, + 5699, + 49635, + 2209, + 46267, + 617, + 14437, + 13675, + 398, + 20332, + 19304, + 612, + 28444, + 23440, + 9668, + 764, + 19304, + 14699, + 22908, + 2209, + 25509, + 72451, + 10337, + 58707, + 4861, + 7491, + 537, + 22863, + 31864, + 51952, + 19304, + 5848, + 25509, + 41701, + 36826, + 74081, + 1306, + 94928, + 95028, + 398, + 185, + 185, + 19947, + 790, + 36552, + 1415, + 12862, + 19304, + 1557, + 29862, + 7791, + 26919, + 976, + 55661, + 19304, + 787, + 21873, + 1073, + 14699, + 46466, + 1737, + 22619, + 21246, + 52071, + 31994, + 398, + 14699, + 18867, + 85287, + 22431, + 504, + 4861, + 7491, + 337, + 19304, + 1705, + 15047, + 612, + 11427, + 30680, + 850, + 10712, + 84983, + 50300, + 49719, + 85663, + 19304, + 7214, + 3883, + 13282, + 23834, + 1729, + 398, + 5553, + 4715, + 1359, + 1729, + 612, + 28340, + 22570, + 17416, + 1073, + 8330, + 9309, + 5425, + 19304, + 9125, + 612, + 21168, + 2322, + 38408, + 764, + 19304, + 14699, + 5207, + 17416, + 4960, + 7847, + 41087, + 19304, + 68270, + 36826, + 42688, + 40348, + 885, + 36726, + 398, + 185, + 185, + 85775, + 19304, + 14699, + 21605, + 8330, + 93818, + 764, + 43081, + 1649, + 13887, + 19997, + 19304, + 15047, + 41934, + 15359, + 7216, + 15326, + 64782, + 19304, + 3770, + 5699, + 10025, + 764, + 35970, + 14125, + 398, + 14699, + 68223, + 885, + 41627, + 612, + 14437, + 8330, + 15142, + 93818, + 49635, + 14282, + 14437, + 40684, + 885, + 13675, + 398, + 100001 + ], + "generated_token_ids_sha256": "2230db0da94fd33a6106a3c52cda4c550127c78b8cc6580cbd82b083ce53a984", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " 羊在中国传统文化中象征着温顺、和平和吉祥。在十二生肖中,羊排在第八位,与十二地支中的“未”相对应。羊的形象在中国历史上有着丰富的文化内涵,它不仅代表着农业社会的繁荣和富饶,也象征着人们对美好生活的向往。\n\n在历史的长河中,羊族并没有像某些动物那样成为特定族群的象征,但羊的形象和特性却在不同历史时期和不同文化背景下被赋予了不同的意义。例如,在古代文学作品中,羊常常被用来比喻那些外表温顺、内心坚定的人物,或者用来形容某种柔和而坚韧的品质。\n\n至于“温柔如脂,其狠胜狼”的说法,这可能是对羊的双重性格的一种夸张描述。羊通常给人的印象是温顺的,但它们在面对威胁时也会展现出强烈的防御本能,甚至可能会有攻击性。这种双面性在某些情况下可能会对历史产生影响,比如在战争或冲突中,羊群可能会成为一种象征,代表着某种内在的力量和决心。\n\n总的来说,羊在中国历史和文化中扮演着重要的角色,它们不仅是农业生产的重要组成部分,也是文化艺术中常见的主题。羊的形象和特性在不同的历史时期和文化背景下有着不同的解读和意义。", + "text_sha256": "e84221ab60c0d753c502f8d20b6d82753bca1f50768a702279f70fdb404feac6", + "task_score": null + }, + { + "condition": "s1_period", + "factors": { + "system": 1, + "history": "filler", + "boundary": "period", + "token_class": "ordinary_control" + }, + "prompt_tokens": 64, + "left_padding_tokens": 0, + "prompt_token_ids_sha256": "36427ffc9adcdc5c8b41264cd424d480343c34b044aa76a299f5fce635db1f5f", + "generated_tokens": 148, + "generated_token_ids": [ + 207, + 14699, + 21605, + 50418, + 764, + 41087, + 1649, + 36552, + 537, + 31564, + 1620, + 56139, + 398, + 13043, + 19304, + 8330, + 5808, + 3573, + 35240, + 14699, + 934, + 20834, + 51952, + 19304, + 13030, + 22619, + 885, + 8142, + 77468, + 14699, + 337, + 15115, + 1359, + 19304, + 52242, + 36552, + 1415, + 12862, + 54304, + 19304, + 9338, + 29862, + 16456, + 7791, + 26919, + 54304, + 398, + 4685, + 20249, + 612, + 8330, + 5808, + 5425, + 19304, + 52242, + 9826, + 54304, + 19304, + 9338, + 71412, + 54304, + 398, + 20332, + 19304, + 9148, + 14699, + 934, + 74556, + 13834, + 1659, + 19304, + 3201, + 3883, + 851, + 52004, + 68223, + 5326, + 19304, + 86041, + 4277, + 14282, + 6939, + 47242, + 20011, + 19304, + 1073, + 1785, + 26928, + 9744, + 50300, + 9262, + 13519, + 885, + 38209, + 13519, + 398, + 13030, + 44978, + 6239, + 1073, + 33973, + 13977, + 29848, + 885, + 8330, + 41343, + 44594, + 95114, + 20603, + 398, + 7058, + 19304, + 14699, + 934, + 20834, + 3279, + 612, + 8330, + 5808, + 17212, + 504, + 19381, + 1059, + 11565, + 19304, + 52242, + 36552, + 54304, + 19304, + 9338, + 29862, + 16456, + 54304, + 19304, + 13030, + 8142, + 885, + 29266, + 13317, + 52909, + 33973, + 96000, + 885, + 46764, + 22619, + 15967, + 398, + 100001 + ], + "generated_token_ids_sha256": "44fa42bdfd4e533a577867d6b2eb67ee7aaf948086b6bb1aa928296b8a9e1caa", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " 羊在中国传统文化中象征着温柔、和平与吉祥。然而,历史上的确有一些羊年出生的人物,他们的性格和行为展现了羊的另一面,既有温柔如脂的一面,也有狠辣胜狼的一面。这些人物在历史上的影响,既有积极的一面,也有消极的一面。例如,有些羊年出生的君主,他们可能以温和的形象出现,但实际上却有着铁腕手段,对内对外都有强烈的控制欲和扩张欲。他们的统治方式对当时的政治格局和历史进程产生了深远的影响。因此,羊年出生的人在历史上的形象是复杂多面的,既有温柔的一面,也有狠辣的一面,他们的行为和决策往往取决于当时的具体情况和个人的性格特点。", + "text_sha256": "f48608a107671c50ffb287310bbfc9a10c4702a8bf253548298161a0d64bf665", + "task_score": null + } + ] + }, + { + "id": "tnews/test/3448", + "domain": "chinese", + "label": "中文新闻", + "within_domain_index": 2, + "selection_rank": "001d2b482c8c5d11c08d0fe0d5ce8421759f1ae362e4d6ab339a98cbcf893e3d", + "source_text_sha256": "52325a330490c0bb46eabd76e188e670a81914b32fe111a3a8663670be24ac95", + "source_characters": 30, + "source_tokens": 24, + "prompt_tokens_by_condition": { + "s0_eos": 49, + "s1_eos": 65, + "s0_bos": 49, + "s1_bos": 65, + "s0_x": 49, + "s1_x": 65, + "s0_period": 49, + "s1_period": 65 + }, + "batch_prompt_tokens_after_left_padding": 65, + "batch_padding_side": "left", + "batch_conditions": 8, + "generation_seconds": 64.60698597301962, + "peak_cuda_memory_allocated_bytes": 29836285440, + "generated_tokens_including_batch_padding": 2952, + "outputs": [ + { + "condition": "s0_eos", + "factors": { + "system": 0, + "history": "filler", + "boundary": "eos", + "token_class": "special" + }, + "prompt_tokens": 49, + "left_padding_tokens": 16, + "prompt_token_ids_sha256": "ea3973310bbe06247d12f149529be01af5de4afb533217d003bedc50b239ede5", + "generated_tokens": 153, + "generated_token_ids": [ + 207, + 86484, + 17742, + 8329, + 82173, + 2760, + 67883, + 66198, + 27492, + 52647, + 32921, + 19304, + 6074, + 10016, + 21873, + 42229, + 1059, + 20286, + 12233, + 398, + 11763, + 19304, + 82173, + 2760, + 67883, + 18976, + 27492, + 6074, + 5097, + 46615, + 19304, + 1876, + 2209, + 38811, + 1073, + 65872, + 885, + 51533, + 10363, + 17904, + 19304, + 787, + 38135, + 13977, + 764, + 9629, + 68405, + 25387, + 398, + 26420, + 19304, + 6074, + 82173, + 21873, + 6119, + 21470, + 52647, + 1687, + 17843, + 40348, + 19304, + 44546, + 9061, + 56217, + 885, + 7073, + 913, + 8748, + 4710, + 97956, + 27402, + 13408, + 3448, + 398, + 14302, + 19304, + 28419, + 21873, + 6119, + 31034, + 8733, + 28445, + 5871, + 18736, + 885, + 18351, + 19304, + 84983, + 5613, + 7076, + 612, + 52598, + 84094, + 5808, + 30455, + 25876, + 13812, + 1729, + 398, + 185, + 185, + 13043, + 19304, + 11592, + 6074, + 82173, + 53738, + 3551, + 25236, + 59619, + 885, + 3883, + 9309, + 20603, + 19304, + 4012, + 11271, + 16787, + 20665, + 6261, + 885, + 36506, + 14394, + 30830, + 913, + 9266, + 398, + 5277, + 83984, + 19304, + 1818, + 10966, + 6857, + 17330, + 38024, + 3421, + 97759, + 19304, + 1306, + 9091, + 24481, + 22758, + 5613, + 17843, + 13977, + 337, + 19381, + 25876, + 1059, + 2700, + 1729, + 398, + 100001 + ], + "generated_token_ids_sha256": "dc5839e837ed3e259a234a41137a543e4c6c2aca055e632a01514516eb28832d", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " 美国总统拜登提名非裔司令担任国防部长,这一决定可能是出于多方面的考虑。首先,提名非裔人士担任这一重要职位,可以被视为对多元化和包容性的重视,这在美国政治中是一个积极的信号。其次,这一提名可能是为了平衡国防部内部的力量,引入新的视角和方法来处理国家安全和军事战略问题。此外,这也可能是为了回应国内外的不同声音和期待,展现出美国政府在人事任命上的灵活性和开放性。\n\n然而,具体这一提名背后的深层次意图和可能产生的影响,需要结合更多的背景信息和后续的发展动态来分析。作为外人,我们只能根据公开的信息进行推测,而无法准确把握美国内部政治的复杂性和多变性。", + "text_sha256": "13efb9d5d16109921a847c3e806db78fe5a5a52b4dd7537fb8fe76ac5e871580", + "task_score": null + }, + { + "condition": "s1_eos", + "factors": { + "system": 1, + "history": "filler", + "boundary": "eos", + "token_class": "special" + }, + "prompt_tokens": 65, + "left_padding_tokens": 0, + "prompt_token_ids_sha256": "00da48f0f7f515abe70179bd2a00aaf65c43e20f70950726fe72b72d4e986ac8", + "generated_tokens": 153, + "generated_token_ids": [ + 207, + 86484, + 17742, + 8329, + 82173, + 2760, + 67883, + 66198, + 27492, + 52647, + 32921, + 19304, + 6074, + 10016, + 21873, + 42229, + 1059, + 20286, + 12233, + 398, + 11763, + 19304, + 82173, + 2760, + 67883, + 99027, + 3883, + 50735, + 17326, + 1073, + 65872, + 885, + 51533, + 10363, + 27499, + 19304, + 66804, + 18517, + 5613, + 5059, + 764, + 9629, + 13887, + 4394, + 2475, + 398, + 26420, + 19304, + 5145, + 14139, + 66198, + 27492, + 3808, + 1600, + 3883, + 25054, + 17742, + 8329, + 7076, + 7120, + 612, + 52647, + 8552, + 816, + 9337, + 15263, + 25876, + 59649, + 19304, + 3104, + 66198, + 18867, + 7875, + 22629, + 27402, + 96728, + 6986, + 9492, + 398, + 14302, + 19304, + 6074, + 82173, + 1024, + 21873, + 6119, + 21470, + 885, + 29094, + 5871, + 15199, + 19304, + 851, + 21325, + 24534, + 10127, + 885, + 28843, + 52647, + 13408, + 398, + 185, + 185, + 13043, + 19304, + 11592, + 59619, + 885, + 25387, + 337, + 40684, + 3883, + 4012, + 11271, + 82173, + 4097, + 20665, + 537, + 8552, + 31424, + 5604, + 5613, + 8733, + 28445, + 13977, + 6681, + 913, + 10345, + 9266, + 398, + 5277, + 83984, + 19304, + 1818, + 10966, + 6857, + 17330, + 6261, + 3421, + 97759, + 19304, + 1306, + 9091, + 3573, + 4793, + 4595, + 17742, + 8329, + 51814, + 16010, + 59619, + 398, + 100001 + ], + "generated_token_ids_sha256": "c98d13c82853885bf1d3ae3fc596b439fa405f447991471815c4b4efd14c5074", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " 美国总统拜登提名非裔司令担任国防部长,这一决定可能是出于多方面的考虑。首先,提名非裔候选人可能旨在展示对多元化和包容性的承诺,这在当前美国社会中是一个重要的议题。其次,选择一位司令担任防长可能表明拜登政府希望在国防政策上保持连续性和稳定性,因为司令通常具有丰富的军事经验和专业知识。此外,这一提名也可能是为了平衡和整合不同意见,以制定更为全面和有效的国防战略。\n\n然而,具体意图和信号的解读可能需要结合提名人的背景、政策立场以及美国国内外的政治环境来综合分析。作为外人,我们只能根据公开信息进行推测,而无法确切知道拜登政府的真实意图。", + "text_sha256": "1947e8ca74e69f369e0ecf74c627df84d38891989db17cf7b76f18197999a753", + "task_score": null + }, + { + "condition": "s0_bos", + "factors": { + "system": 0, + "history": "filler", + "boundary": "bos", + "token_class": "special" + }, + "prompt_tokens": 49, + "left_padding_tokens": 16, + "prompt_token_ids_sha256": "6201b139bc73b770b00c6d60eef0536cf0324c8c586f63e2ef6cbf4899497443", + "generated_tokens": 85, + "generated_token_ids": [ + 207, + 86484, + 17742, + 8329, + 82173, + 2760, + 67883, + 66198, + 7557, + 26684, + 4702, + 1681, + 9940, + 4387, + 87882, + 27492, + 52647, + 32921, + 19304, + 6074, + 10016, + 22169, + 43643, + 1073, + 4710, + 97956, + 53338, + 50866, + 89979, + 398, + 2493, + 18909, + 42631, + 2634, + 31564, + 16752, + 14344, + 19304, + 9717, + 573, + 4045, + 10470, + 1147, + 8733, + 2858, + 45084, + 398, + 1818, + 52609, + 7439, + 5059, + 764, + 5871, + 53387, + 13977, + 9818, + 32980, + 31424, + 885, + 12500, + 19304, + 1705, + 18467, + 31424, + 504, + 64193, + 19304, + 1818, + 37931, + 1620, + 6489, + 4710, + 11600, + 55829, + 56377, + 8197, + 7212, + 19304, + 11257, + 19688, + 4997, + 31564, + 94017, + 398, + 100001 + ], + "generated_token_ids_sha256": "92cb250be10ceca2e0f750a90a2bd5b0dffb0b30b5ac9c10f13329fa367b47e6", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " 美国总统拜登提名非裔司令劳埃德·奥斯汀担任国防部长,这一决定反映了他对国家安全和外交政策的考量。中国始终秉持和平发展的道路,坚持不干涉他国内政的原则。我们注意到国际社会中不同国家和政治派别的立场和行动,但中国的立场是明确的,我们致力于与所有国家建立和发展友好合作关系,共同维护世界和平与发展。", + "text_sha256": "5dca819922fbd2d66cf32e2cbb515c9eebf1bb2edbfcd7ab37b35e140ba48b99", + "task_score": null + }, + { + "condition": "s1_bos", + "factors": { + "system": 1, + "history": "filler", + "boundary": "bos", + "token_class": "special" + }, + "prompt_tokens": 65, + "left_padding_tokens": 0, + "prompt_token_ids_sha256": "8c55b5a2c20885b29653f1a280281c68ea69b7692b635419a1876f7814e2dd15", + "generated_tokens": 369, + "generated_token_ids": [ + 207, + 86484, + 17742, + 8329, + 82173, + 2760, + 67883, + 66198, + 7557, + 26684, + 4702, + 1681, + 9940, + 4387, + 87882, + 27492, + 52647, + 32921, + 19304, + 6074, + 10016, + 3883, + 22169, + 1029, + 21138, + 53338, + 8552, + 816, + 25724, + 44648, + 398, + 7557, + 26684, + 4702, + 1681, + 9940, + 4387, + 87882, + 47969, + 11641, + 22629, + 27402, + 66446, + 19304, + 6750, + 82173, + 3883, + 2209, + 38811, + 1073, + 27402, + 885, + 53338, + 8552, + 764, + 2524, + 10033, + 31424, + 21246, + 21470, + 19304, + 5848, + 27411, + 38568, + 25876, + 51533, + 10363, + 17904, + 398, + 185, + 185, + 612, + 34813, + 13977, + 5262, + 4483, + 764, + 19304, + 790, + 36515, + 9818, + 976, + 18867, + 67679, + 34850, + 16175, + 2524, + 10033, + 537, + 9826, + 12500, + 28726, + 2528, + 8552, + 31424, + 19304, + 1306, + 790, + 57925, + 9818, + 976, + 3937, + 81009, + 52004, + 537, + 37145, + 28726, + 2528, + 8552, + 398, + 13043, + 19304, + 82173, + 5115, + 6213, + 27492, + 52647, + 1687, + 18745, + 10016, + 18867, + 504, + 22725, + 1557, + 6213, + 2053, + 4597, + 537, + 6986, + 49352, + 1073, + 50866, + 12814, + 19304, + 1306, + 45416, + 25860, + 790, + 36515, + 9818, + 976, + 2322, + 790, + 57925, + 9818, + 976, + 39783, + 398, + 185, + 185, + 17742, + 8329, + 51814, + 6074, + 82173, + 3883, + 50735, + 2657, + 36854, + 54660, + 1059, + 20286, + 25387, + 45326, + 185, + 185, + 16, + 13, + 9217, + 38568, + 25876, + 51533, + 1729, + 746, + 45326, + 82173, + 2760, + 67883, + 64661, + 27492, + 6074, + 5097, + 46615, + 19304, + 1876, + 2209, + 38811, + 1073, + 38568, + 25876, + 51533, + 10363, + 27499, + 19304, + 787, + 3883, + 37012, + 8158, + 51814, + 17212, + 885, + 19740, + 337, + 11052, + 1825, + 398, + 185, + 185, + 17, + 13, + 9217, + 27402, + 10121, + 1410, + 746, + 45326, + 82173, + 14139, + 11641, + 22629, + 27402, + 66446, + 3883, + 25054, + 17742, + 8329, + 7076, + 17904, + 27402, + 6986, + 83227, + 10121, + 1410, + 19304, + 36717, + 3883, + 22169, + 1029, + 1073, + 4710, + 97956, + 7439, + 48082, + 17904, + 398, + 185, + 185, + 18, + 13, + 9217, + 21470, + 53338, + 8552, + 746, + 45326, + 3146, + 9940, + 4387, + 87882, + 337, + 82173, + 2209, + 38811, + 790, + 36515, + 9818, + 976, + 19304, + 5176, + 787, + 3883, + 20054, + 17742, + 8329, + 7076, + 612, + 8748, + 7439, + 38408, + 885, + 23216, + 62272, + 850, + 19304, + 17416, + 16175, + 24534, + 31864, + 2322, + 68405, + 31424, + 398, + 185, + 185, + 19, + 13, + 9217, + 8552, + 11351, + 746, + 45326, + 82173, + 62671, + 84291, + 1649, + 17742, + 8329, + 7076, + 612, + 52647, + 885, + 53338, + 8552, + 5808, + 46914, + 11351, + 19304, + 18160, + 11592, + 8552, + 84144, + 4341, + 1557, + 8552, + 12500, + 913, + 17788, + 398, + 185, + 185, + 93719, + 19304, + 82173, + 7147, + 35765, + 8161, + 19304, + 39761, + 10244, + 5613, + 3989, + 4394, + 80014, + 22541, + 398, + 7058, + 19304, + 6074, + 10016, + 56434, + 5425, + 885, + 25387, + 23339, + 82173, + 7147, + 885, + 9940, + 4387, + 87882, + 816, + 2922, + 10864, + 8552, + 55766, + 15795, + 58287, + 398, + 100001 + ], + "generated_token_ids_sha256": "9b916fdb5afe18ca1a5b060f95c8ae52d35f7fa38d670e12a20ba6e0cc8d47c8", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " 美国总统拜登提名非裔司令劳埃德·奥斯汀担任国防部长,这一决定可能反映出他在外交政策上的一些倾向。劳埃德·奥斯汀是一位经验丰富的军事领导人,他的提名可能被视为对军事和外交政策中强硬立场的一种平衡,或者是对多样性和包容性的重视。\n\n在美国的政治语境中,“鹰派”通常指的是主张采取强硬、积极行动的外交政策立场,而“鸽派”则倾向于温和、谨慎的外交政策。然而,提名某个人担任国防部长的决定通常是基于其个人资历、专业能力和对政策的理解,而不仅仅是简单的“鹰派”或“鸽派”标签。\n\n拜登政府的这一提名可能旨在向外界传达多方面的信号:\n\n1. **多样性和包容性**:提名非裔美国人担任这一重要职位,可以被视为对多样性和包容性的承诺,这可能有助于提升政府的形象和公众的接受度。\n\n2. **军事领导力**:提名一位经验丰富的军事领导人可能表明拜登政府重视军事专业知识和领导力,同时也可能反映出对国家安全和国际关系的重视。\n\n3. **平衡外交政策**:如果奥斯汀的提名被视为“鹰派”,那么这可能意味着拜登政府在处理国际冲突和紧张局势时,可能会采取更为坚定或积极的立场。\n\n4. **政策方向**:提名也可能预示着拜登政府在国防和外交政策上的潜在方向,尽管具体政策还需通过其政策行动来观察。\n\n需要注意的是,提名过程尚未完成,还需要经过美国参议院的确认。因此,这一决定的具体影响和信号将在提名过程和奥斯汀上任后的政策实践中逐渐显现。", + "text_sha256": "e48144e9b1baf2122eab114217a1469ec7d30798a7e0f7871050b4431f8f959d", + "task_score": null + }, + { + "condition": "s0_x", + "factors": { + "system": 0, + "history": "filler", + "boundary": "x", + "token_class": "ordinary_control" + }, + "prompt_tokens": 49, + "left_padding_tokens": 16, + "prompt_token_ids_sha256": "e76dc359969ff494635248827ff3e5d1d4226ee1b2e021ef35d6cef6fbb53b49", + "generated_tokens": 184, + "generated_token_ids": [ + 207, + 86484, + 17742, + 8329, + 82173, + 2760, + 67883, + 66198, + 27492, + 52647, + 32921, + 19304, + 6074, + 10016, + 21873, + 42229, + 1059, + 20286, + 12233, + 398, + 11763, + 19304, + 82173, + 2760, + 67883, + 27492, + 6074, + 5097, + 46615, + 19304, + 1876, + 2209, + 38811, + 1073, + 31394, + 7539, + 67883, + 21246, + 12604, + 79163, + 19304, + 787, + 38135, + 13977, + 764, + 7875, + 5097, + 13675, + 19304, + 37012, + 23217, + 51814, + 65872, + 885, + 51533, + 1729, + 398, + 26420, + 19304, + 6074, + 82173, + 21873, + 6119, + 21470, + 8733, + 13977, + 13051, + 19304, + 35135, + 7581, + 2760, + 67883, + 3017, + 2193, + 55510, + 19304, + 57121, + 18517, + 95745, + 3448, + 31951, + 337, + 49635, + 398, + 14302, + 19304, + 52647, + 1687, + 18745, + 82173, + 62671, + 22169, + 1029, + 17742, + 8329, + 7076, + 30208, + 2528, + 885, + 27402, + 8552, + 5808, + 44648, + 19304, + 4007, + 8617, + 2524, + 10033, + 2322, + 52004, + 19304, + 787, + 52909, + 82173, + 4097, + 20665, + 885, + 8552, + 44648, + 398, + 185, + 185, + 13043, + 19304, + 11592, + 17742, + 8329, + 51814, + 8552, + 11351, + 19304, + 39761, + 1540, + 10555, + 2002, + 60075, + 3017, + 56434, + 8552, + 31424, + 5604, + 1620, + 17742, + 8329, + 1641, + 4097, + 8552, + 23570, + 4611, + 398, + 5277, + 83984, + 19304, + 1818, + 69225, + 1073, + 34813, + 1785, + 2858, + 3421, + 34385, + 22037, + 19304, + 1705, + 1876, + 12604, + 4368, + 19304, + 8816, + 31215, + 8552, + 5145, + 4148, + 22725, + 1557, + 4710, + 16547, + 885, + 7439, + 29045, + 68598, + 89979, + 398, + 100001 + ], + "generated_token_ids_sha256": "37ec5c6ab69fafaa057b7b5b2df3beec6e26dcdbde8f5cabee218ae5e52734fc", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " 美国总统拜登提名非裔司令担任国防部长,这一决定可能是出于多方面的考虑。首先,提名非裔担任这一重要职位,可以被视为对少数族裔的一种肯定和支持,这在美国政治中具有重要意义,有助于展现政府的多元化和包容性。其次,这一提名可能是为了平衡国内政治力量,争取更多非裔选民的支持,尤其是在当前种族问题敏感的背景下。此外,国防部长的提名也可能反映出拜登政府在外交和军事政策上的倾向,即更加强硬或温和,这取决于提名人的背景和政策倾向。\n\n然而,具体拜登政府的政策方向,还需要看最终提名人选的具体政策立场以及与拜登本人的政策协调情况。作为外人,我们不便对美国的内政进行过多评论,但可以肯定的是,任何国家的政策选择都是基于其国家利益和国际形势的综合考量。", + "text_sha256": "7ee8baa1d09e6dcf9866e85d98eca60d642371f09bbe78aa046a42c6c60f9e06", + "task_score": null + }, + { + "condition": "s1_x", + "factors": { + "system": 1, + "history": "filler", + "boundary": "x", + "token_class": "ordinary_control" + }, + "prompt_tokens": 65, + "left_padding_tokens": 0, + "prompt_token_ids_sha256": "a49e199029086ac332fba766e5af04ea6a4f23bdf53bd453c148b83ec796d6de", + "generated_tokens": 127, + "generated_token_ids": [ + 207, + 86484, + 17742, + 8329, + 82173, + 2760, + 67883, + 40015, + 7557, + 26684, + 4702, + 1681, + 9940, + 4387, + 87882, + 27492, + 52647, + 32921, + 19304, + 6074, + 10016, + 3883, + 50735, + 32115, + 1059, + 1737, + 25387, + 398, + 11763, + 19304, + 82173, + 2760, + 67883, + 40015, + 3883, + 2209, + 38811, + 1073, + 65872, + 885, + 51533, + 10363, + 17904, + 19304, + 787, + 38135, + 13977, + 764, + 9629, + 31951, + 1306, + 5097, + 49570, + 398, + 26420, + 19304, + 9940, + 4387, + 87882, + 40015, + 337, + 27402, + 20665, + 885, + 11641, + 3883, + 2581, + 21138, + 8748, + 52647, + 35383, + 850, + 10645, + 12076, + 25876, + 6986, + 1729, + 398, + 14302, + 19304, + 6074, + 82173, + 62671, + 2209, + 95945, + 27411, + 27402, + 10121, + 5398, + 38568, + 10363, + 12950, + 19304, + 5604, + 1073, + 79901, + 10121, + 4710, + 5198, + 8885, + 3279, + 3017, + 337, + 24239, + 398, + 13043, + 19304, + 11592, + 59619, + 885, + 25387, + 337, + 40684, + 84144, + 11271, + 82173, + 10864, + 8552, + 11351, + 885, + 45938, + 17856, + 913, + 10345, + 9266, + 398, + 100001 + ], + "generated_token_ids_sha256": "c4777d84ebc99cb0f27935a04bf3c8b4113477e60aac69d3a2ea885a01a33020", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " 美国总统拜登提名非裔将军劳埃德·奥斯汀担任国防部长,这一决定可能旨在传递多重信号。首先,提名非裔将军可能被视为对多元化和包容性的重视,这在美国政治中是一个敏感而重要的话题。其次,奥斯汀将军的军事背景和经验可能使他在处理国防事务时带来稳定性和专业性。此外,这一提名也可能被看作是对军事领导层多样性的推动,以及对有能力领导国家安全机构的人选的认可。然而,具体意图和信号的解读还需结合提名后的政策方向和国内外反应来综合分析。", + "text_sha256": "8d2e31fab785214c8d005948406aafb9a86e5300d50dfa645a90c05ece4040df", + "task_score": null + }, + { + "condition": "s0_period", + "factors": { + "system": 0, + "history": "filler", + "boundary": "period", + "token_class": "ordinary_control" + }, + "prompt_tokens": 49, + "left_padding_tokens": 16, + "prompt_token_ids_sha256": "8ed08535881112d8d9ca8c60129404c43c882f19ce8998d12186d55ec00d2112", + "generated_tokens": 110, + "generated_token_ids": [ + 207, + 86484, + 17742, + 8329, + 82173, + 2760, + 67883, + 66198, + 27492, + 52647, + 1687, + 18745, + 10016, + 19304, + 22169, + 43643, + 1073, + 4710, + 97956, + 53338, + 50866, + 89979, + 398, + 6074, + 82173, + 21873, + 6119, + 21470, + 8733, + 5871, + 13977, + 9818, + 32980, + 15199, + 19304, + 36717, + 3883, + 52577, + 1073, + 65872, + 885, + 51533, + 10363, + 17904, + 398, + 5277, + 47921, + 17788, + 1605, + 19304, + 1818, + 2082, + 8354, + 6074, + 82173, + 8866, + 14149, + 34813, + 4710, + 16547, + 19304, + 5604, + 3352, + 1073, + 7439, + 5198, + 6681, + 3883, + 9309, + 20603, + 398, + 2493, + 18909, + 37931, + 19688, + 4997, + 31564, + 94017, + 19304, + 9717, + 3382, + 31564, + 3366, + 14344, + 19304, + 12950, + 28860, + 16386, + 27635, + 11257, + 1514, + 398, + 1818, + 7120, + 43514, + 17338, + 16175, + 5865, + 65954, + 8552, + 19304, + 11257, + 13091, + 7439, + 48082, + 26557, + 1620, + 12076, + 398, + 100001 + ], + "generated_token_ids_sha256": "3ad0e97b3703af98242089a72e811232c33f30a9872734e2c22e95554e2e94bb", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " 美国总统拜登提名非裔司令担任国防部长的决定,反映了他对国家安全和外交政策的考量。这一提名可能是为了平衡国内不同政治派别的意见,同时也可能体现了对多元化和包容性的重视。作为外部观察者,我们应关注这一提名是否符合美国的国家利益,以及它对国际安全环境可能产生的影响。中国始终致力于维护世界和平与发展,坚持走和平发展道路,推动构建人类命运共同体。我们希望各国都能采取负责任的政策,共同促进国际关系的和谐与稳定。", + "text_sha256": "85681dbc48ca2603407e72c6e9c8dff2f4fda2d08ed59e19a4fa62b4652fa212", + "task_score": null + }, + { + "condition": "s1_period", + "factors": { + "system": 1, + "history": "filler", + "boundary": "period", + "token_class": "ordinary_control" + }, + "prompt_tokens": 65, + "left_padding_tokens": 0, + "prompt_token_ids_sha256": "13cd1369f7d47450f952b9e478eb9d8f4dfff3d8759d1ab2c0465e315fbd743d", + "generated_tokens": 113, + "generated_token_ids": [ + 207, + 86484, + 17742, + 8329, + 82173, + 2760, + 67883, + 40015, + 7557, + 26684, + 4702, + 1681, + 9940, + 4387, + 87882, + 27492, + 52647, + 32921, + 19304, + 6074, + 10016, + 3883, + 50735, + 32115, + 1059, + 1737, + 25387, + 398, + 11763, + 19304, + 82173, + 2760, + 67883, + 40015, + 3883, + 2209, + 38811, + 1073, + 65872, + 885, + 51533, + 10363, + 27499, + 19304, + 787, + 38135, + 13977, + 764, + 9629, + 5097, + 4394, + 2475, + 398, + 26420, + 19304, + 9940, + 4387, + 87882, + 40015, + 337, + 27402, + 20665, + 885, + 11641, + 3883, + 2581, + 21138, + 8748, + 4710, + 97956, + 3808, + 2197, + 8552, + 4782, + 7875, + 33639, + 56217, + 885, + 5866, + 398, + 14302, + 19304, + 6074, + 82173, + 62671, + 22169, + 1029, + 17742, + 8329, + 7076, + 4645, + 11707, + 52647, + 885, + 7439, + 72611, + 17904, + 398, + 13043, + 19304, + 11592, + 59619, + 885, + 5425, + 84144, + 17788, + 36506, + 68826, + 77678, + 7439, + 17856, + 398, + 100001 + ], + "generated_token_ids_sha256": "397340c981928cc88fe97bb5c21ed3a255a16e9ede46102a35a5fb27586f9601", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " 美国总统拜登提名非裔将军劳埃德·奥斯汀担任国防部长,这一决定可能旨在传递多重信号。首先,提名非裔将军可能被视为对多元化和包容性的承诺,这在美国政治中是一个重要议题。其次,奥斯汀将军的军事背景和经验可能使他在处理国家安全和防务政策方面具有独特的视角和能力。此外,这一提名也可能反映出拜登政府对于加强国防和国际合作的重视。然而,具体意图和影响还需观察后续的政策发展和国际反应。", + "text_sha256": "f1306a8e2cb7cf24922bca550b66df4da5d45ded0803f9679b0b42945666b6f7", + "task_score": null + } + ] + }, + { + "id": "tnews/test/1059", + "domain": "chinese", + "label": "中文新闻", + "within_domain_index": 3, + "selection_rank": "003c8ebfb96b25b85cd0d61695249921a80438fbed1d314631b98720f7e9d0bd", + "source_text_sha256": "02423d8805b68349a9a70d9b64ce830f1e9fbdd2a0cda7b4a9dd320f6bb6ec8e", + "source_characters": 29, + "source_tokens": 27, + "prompt_tokens_by_condition": { + "s0_eos": 52, + "s1_eos": 68, + "s0_bos": 52, + "s1_bos": 68, + "s0_x": 52, + "s1_x": 68, + "s0_period": 52, + "s1_period": 68 + }, + "batch_prompt_tokens_after_left_padding": 68, + "batch_padding_side": "left", + "batch_conditions": 8, + "generation_seconds": 66.6561332810088, + "peak_cuda_memory_allocated_bytes": 29632793600, + "generated_tokens_including_batch_padding": 2560, + "outputs": [ + { + "condition": "s0_eos", + "factors": { + "system": 0, + "history": "filler", + "boundary": "eos", + "token_class": "special" + }, + "prompt_tokens": 52, + "left_padding_tokens": 16, + "prompt_token_ids_sha256": "0b5785222b0b73c25b0e351aad49f5d08d68c29a92a81928b9169ecc522678d9", + "generated_tokens": 207, + "generated_token_ids": [ + 207, + 2469, + 1850, + 1103, + 227, + 3138, + 22567, + 15149, + 13756, + 17565, + 95304, + 6841, + 5549, + 504, + 4607, + 19304, + 3104, + 13712, + 13532, + 1250, + 8087, + 9744, + 1889, + 33639, + 6841, + 5549, + 885, + 15967, + 398, + 6117, + 19304, + 28620, + 23692, + 4800, + 5277, + 14915, + 3010, + 31501, + 337, + 56965, + 19304, + 6750, + 6841, + 5549, + 885, + 9071, + 4279, + 4148, + 88076, + 19304, + 30146, + 9135, + 3168, + 13532, + 398, + 185, + 185, + 612, + 14915, + 3010, + 31501, + 4296, + 4547, + 2773, + 6869, + 1848, + 764, + 19304, + 28620, + 23692, + 4800, + 19539, + 6804, + 19304, + 84684, + 14504, + 4783, + 398, + 6750, + 6841, + 5549, + 1331, + 2524, + 19304, + 1410, + 748, + 60245, + 19304, + 18119, + 1511, + 12352, + 1029, + 3586, + 1895, + 1735, + 19304, + 2209, + 13551, + 777, + 790, + 18119, + 25219, + 21824, + 84146, + 976, + 398, + 612, + 14915, + 3010, + 31501, + 337, + 19328, + 22962, + 764, + 19304, + 28620, + 23692, + 4800, + 1223, + 8303, + 8219, + 69820, + 337, + 6841, + 5549, + 885, + 10121, + 5866, + 19304, + 60808, + 4004, + 4097, + 65766, + 885, + 2873, + 14322, + 398, + 185, + 185, + 9158, + 19304, + 8833, + 28620, + 23692, + 4800, + 15502, + 19304, + 5260, + 8044, + 537, + 1748, + 7791, + 1537, + 6238, + 13532, + 1250, + 8087, + 1024, + 9744, + 1889, + 33639, + 6841, + 5549, + 885, + 15967, + 19304, + 3201, + 30360, + 612, + 14915, + 3010, + 31501, + 764, + 43081, + 1649, + 13887, + 19997, + 398, + 7058, + 19304, + 89217, + 44343, + 2469, + 1850, + 1103, + 227, + 3138, + 22567, + 6841, + 5549, + 4607, + 51952, + 19304, + 3883, + 13282, + 14437, + 25610, + 19304, + 1705, + 28620, + 23692, + 4800, + 60661, + 6802, + 9756, + 398, + 100001 + ], + "generated_token_ids_sha256": "ea915eb229de7e6c53ef437dc4567f07468fe1c304639035d5006a970ea96bb2", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " 《水浒传》中并没有明确指出谁的武艺是第一,因为每个英雄好汉都有自己独特的武艺和特点。不过,卢俊义作为梁山泊的领袖,他的武艺和威望都是极高的,可以说是盖世英雄。\n\n在梁山泊的一百单八将中,卢俊义排名第二,仅次于宋江。他的武艺高强,力大无穷,枪法更是出神入化,被赞为“枪棒天下无敌”。在梁山泊的多次战斗中,卢俊义都表现出了非凡的武艺和领导能力,赢得了众人的尊敬和爱戴。\n\n当然,除了卢俊义之外,林冲、关胜等其他英雄好汉也都有自己独特的武艺和特点,他们各自在梁山泊中扮演着重要的角色。因此,如果要评选《水浒传》中武艺第一的人物,可能会有不同的答案,但卢俊义无疑是其中之一。", + "text_sha256": "0b6d3c2e4bd03bde8814758238199a96e8a7da68229ea2a9d501ae7946f93977", + "task_score": null + }, + { + "condition": "s1_eos", + "factors": { + "system": 1, + "history": "filler", + "boundary": "eos", + "token_class": "special" + }, + "prompt_tokens": 68, + "left_padding_tokens": 0, + "prompt_token_ids_sha256": "c421681bbd355786697980821e247a14d5ebfd07105626a732092a3212623e4b", + "generated_tokens": 247, + "generated_token_ids": [ + 207, + 2469, + 1850, + 1103, + 227, + 3138, + 22567, + 15149, + 13756, + 17565, + 95304, + 6841, + 5549, + 504, + 4607, + 19304, + 3104, + 13712, + 13532, + 1250, + 8087, + 9744, + 1889, + 33639, + 6841, + 5549, + 885, + 15967, + 398, + 6117, + 19304, + 28620, + 23692, + 4800, + 5277, + 14915, + 3010, + 31501, + 337, + 56965, + 9756, + 19304, + 6750, + 6841, + 5549, + 885, + 9071, + 4279, + 84111, + 13271, + 19304, + 30146, + 9135, + 3168, + 13532, + 398, + 185, + 185, + 612, + 29263, + 764, + 19304, + 28620, + 23692, + 4800, + 337, + 6841, + 5549, + 2209, + 31994, + 777, + 76074, + 2524, + 19304, + 1147, + 12580, + 612, + 3187, + 35685, + 19328, + 3089, + 1155, + 29371, + 29371, + 3187, + 3469, + 19304, + 71068, + 617, + 47068, + 15160, + 1848, + 398, + 14302, + 19304, + 46760, + 12580, + 612, + 85669, + 9475, + 1188, + 8694, + 1398, + 30697, + 80555, + 89072, + 19304, + 70887, + 8510, + 6841, + 5549, + 885, + 9918, + 1511, + 19304, + 28419, + 10487, + 52492, + 6750, + 6841, + 5549, + 9861, + 398, + 185, + 185, + 9158, + 19304, + 8833, + 28620, + 23692, + 4800, + 15502, + 19304, + 5260, + 8044, + 537, + 1748, + 7791, + 1537, + 6238, + 13532, + 1250, + 8087, + 1024, + 9744, + 1889, + 33639, + 6841, + 5549, + 885, + 15967, + 19304, + 3201, + 1024, + 14332, + 29263, + 764, + 14282, + 13887, + 19364, + 885, + 7435, + 398, + 7058, + 19304, + 89217, + 44343, + 2469, + 1850, + 1103, + 227, + 3138, + 22567, + 6841, + 5549, + 11000, + 18397, + 13532, + 1250, + 8087, + 19304, + 3883, + 4012, + 6857, + 14437, + 7992, + 885, + 18061, + 63562, + 18906, + 398, + 185, + 185, + 39736, + 19304, + 28620, + 23692, + 4800, + 5277, + 14915, + 3010, + 31501, + 337, + 56965, + 9756, + 19304, + 6750, + 6841, + 5549, + 885, + 9071, + 4279, + 84111, + 13271, + 19304, + 30146, + 9135, + 3168, + 13532, + 398, + 3635, + 19304, + 6238, + 13532, + 1250, + 8087, + 1024, + 9744, + 1889, + 33639, + 6841, + 5549, + 885, + 15967, + 19304, + 3201, + 1024, + 14332, + 29263, + 764, + 14282, + 13887, + 19364, + 885, + 7435, + 398, + 100001 + ], + "generated_token_ids_sha256": "a135ca270833422b4932c2afcccfec6f035d5de0f233147d1ad2d9705c086a93", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " 《水浒传》中并没有明确指出谁的武艺是第一,因为每个英雄好汉都有自己独特的武艺和特点。不过,卢俊义作为梁山泊的领袖之一,他的武艺和威望都是非常高的,可以说是盖世英雄。\n\n在小说中,卢俊义的武艺被描述为非常高强,他曾经在战场上多次立下赫赫战功,打败了多名敌将。此外,他还曾经在梦中得到过九天玄女的传授,学会了各种武艺和兵法,这也进一步提升了他的武艺水平。\n\n当然,除了卢俊义之外,林冲、关胜等其他英雄好汉也都有自己独特的武艺和特点,他们也都在小说中有着重要的地位和作用。因此,如果要评选《水浒传》中武艺最高强的英雄好汉,可能需要根据不同的标准和角度来进行评价。\n\n总之,卢俊义作为梁山泊的领袖之一,他的武艺和威望都是非常高的,可以说是盖世英雄。但是,其他英雄好汉也都有自己独特的武艺和特点,他们也都在小说中有着重要的地位和作用。", + "text_sha256": "0c79991344ff76ad192cb83ab1825d382279bef31596d6247444e98342933fdd", + "task_score": null + }, + { + "condition": "s0_bos", + "factors": { + "system": 0, + "history": "filler", + "boundary": "bos", + "token_class": "special" + }, + "prompt_tokens": 52, + "left_padding_tokens": 16, + "prompt_token_ids_sha256": "eaa288a9315a5a392ea2aea4c51509f5e192e617d9ab5c5d5f31be20c0635a52", + "generated_tokens": 320, + "generated_token_ids": [ + 207, + 28103, + 1850, + 1103, + 227, + 3138, + 22567, + 19304, + 8560, + 95304, + 6841, + 5549, + 4607, + 19304, + 15149, + 1615, + 64193, + 25610, + 398, + 6117, + 19304, + 28620, + 23692, + 4800, + 18867, + 2209, + 50246, + 14915, + 3010, + 1250, + 8087, + 5387, + 4607, + 51460, + 398, + 185, + 185, + 28620, + 23692, + 4800, + 94941, + 1850, + 1103, + 227, + 58096, + 5387, + 18489, + 20249, + 19304, + 83303, + 4262, + 790, + 9477, + 67938, + 976, + 19304, + 6841, + 5549, + 1331, + 2524, + 19304, + 54795, + 25219, + 21824, + 1854, + 4715, + 398, + 1147, + 27053, + 504, + 28227, + 748, + 2217, + 6240, + 337, + 2276, + 1935, + 19304, + 3104, + 2209, + 12498, + 1082, + 5377, + 16344, + 5580, + 19304, + 10555, + 2209, + 14915, + 3010, + 1250, + 8087, + 72645, + 2628, + 224, + 2153, + 59884, + 14915, + 3010, + 398, + 612, + 14915, + 3010, + 1250, + 8087, + 764, + 19304, + 28620, + 23692, + 4800, + 24500, + 1557, + 45002, + 6841, + 5549, + 885, + 12008, + 21012, + 337, + 22962, + 15190, + 19304, + 71132, + 22111, + 14915, + 3010, + 30121, + 51460, + 398, + 185, + 185, + 13043, + 19304, + 9338, + 4804, + 35804, + 6340, + 5260, + 8044, + 337, + 6841, + 5549, + 20296, + 1331, + 2524, + 19304, + 7214, + 10741, + 6340, + 5260, + 8044, + 337, + 6841, + 5549, + 612, + 28620, + 23692, + 4800, + 42559, + 398, + 5260, + 8044, + 94941, + 1850, + 1103, + 227, + 58096, + 5387, + 6271, + 14139, + 5097, + 20249, + 19304, + 83303, + 4262, + 790, + 45455, + 1205, + 2655, + 976, + 19304, + 54349, + 5118, + 20266, + 6869, + 30262, + 22578, + 398, + 21138, + 14915, + 3010, + 1250, + 8087, + 764, + 19539, + 32453, + 19304, + 3770, + 14139, + 4126, + 12008, + 21012, + 337, + 43327, + 398, + 185, + 185, + 19947, + 1748, + 7791, + 19304, + 28651, + 51073, + 2217, + 1848, + 77517, + 52016, + 2404, + 19304, + 28103, + 1850, + 1103, + 227, + 3138, + 22567, + 19539, + 24630, + 398, + 6750, + 6841, + 5549, + 20296, + 1331, + 2524, + 19304, + 54349, + 5118, + 5038, + 5640, + 1211, + 212, + 1664, + 13942, + 398, + 3635, + 19304, + 1748, + 7791, + 337, + 6841, + 5549, + 15149, + 2209, + 31994, + 777, + 21824, + 1854, + 4715, + 19304, + 7058, + 1147, + 15759, + 14915, + 3010, + 1250, + 8087, + 5387, + 4607, + 51460, + 398, + 185, + 185, + 85775, + 19304, + 6006, + 2469, + 1850, + 1103, + 227, + 3138, + 22567, + 19409, + 6841, + 5549, + 1331, + 18397, + 14915, + 3010, + 1250, + 8087, + 19304, + 3635, + 28620, + 23692, + 4800, + 18867, + 2209, + 50246, + 14915, + 3010, + 1250, + 8087, + 5387, + 4607, + 51460, + 398, + 9158, + 19304, + 61918, + 13950, + 15485, + 19304, + 14437, + 35804, + 3883, + 13282, + 14437, + 31333, + 398, + 100001 + ], + "generated_token_ids_sha256": "f81badbae7db14af318093e587e2e9a6e54a5235c48d62b7b5da0ea569ff2226", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " 在《水浒传》中,关于谁的武艺第一,并没有一个明确的答案。不过,卢俊义通常被认为是梁山好汉中的第一高手。\n\n卢俊义是《水浒传》中的经典人物,绰号“玉麒麟”,武艺高强,棍棒天下无双。他原本是河北大名府的员外,因为被吴用设计陷害,最终被梁山好汉俘虏并加入了梁山。在梁山好汉中,卢俊义凭借其出色的武艺和勇猛的战斗风格,很快就成为了梁山的第一高手。\n\n然而,也有一些读者认为林冲的武艺也很高强,甚至有人认为林冲的武艺在卢俊义之上。林冲是《水浒传》中的另一位重要人物,绰号“豹子头”,擅长使用丈八蛇矛。他在梁山好汉中排名第六,也是一位非常勇猛的战士。\n\n至于关胜,他是三国名将关羽的后代,在《水浒传》中排名第五。他的武艺也很高强,擅长使用青龙偃月刀。但是,关胜的武艺并没有被描述为天下无双,因此他并不是梁山好汉中的第一高手。\n\n总的来说,虽然《水浒传》中有很多武艺高强的梁山好汉,但是卢俊义通常被认为是梁山好汉中的第一高手。当然,这只是一种观点,不同的读者可能会有不同的看法。", + "text_sha256": "18b9b0aa8496822a7ee41a94c69d6a6396697dc28d9978c75027ff1b535e8579", + "task_score": null + }, + { + "condition": "s1_bos", + "factors": { + "system": 1, + "history": "filler", + "boundary": "bos", + "token_class": "special" + }, + "prompt_tokens": 68, + "left_padding_tokens": 0, + "prompt_token_ids_sha256": "d8b996e7614ff74eb3b8ff2f53acd65e6183b6817c6164f9840b1af1b476301f", + "generated_tokens": 231, + "generated_token_ids": [ + 207, + 28103, + 1850, + 1103, + 227, + 3138, + 22567, + 19304, + 8560, + 95304, + 6841, + 5549, + 4607, + 19304, + 15149, + 64193, + 25610, + 19304, + 3104, + 29572, + 29263, + 764, + 19409, + 94340, + 1331, + 18397, + 13532, + 1250, + 8087, + 398, + 6117, + 19304, + 28620, + 23692, + 4800, + 2209, + 50246, + 6802, + 6841, + 5549, + 11000, + 2524, + 51952, + 9756, + 398, + 185, + 185, + 28620, + 23692, + 4800, + 19304, + 83303, + 4262, + 790, + 9477, + 67938, + 976, + 19304, + 2615, + 504, + 28227, + 748, + 2217, + 6240, + 337, + 2276, + 1935, + 19304, + 11931, + 14342, + 14915, + 3010, + 398, + 1147, + 7399, + 6841, + 5549, + 1331, + 2524, + 19304, + 5674, + 32798, + 40254, + 4800, + 19304, + 47209, + 14915, + 3010, + 1250, + 8087, + 337, + 65766, + 398, + 612, + 14915, + 3010, + 1250, + 8087, + 764, + 19304, + 28620, + 23692, + 4800, + 337, + 94340, + 19539, + 4607, + 19304, + 2209, + 50246, + 14915, + 3010, + 1250, + 8087, + 5387, + 56965, + 20249, + 398, + 185, + 185, + 13043, + 19304, + 9338, + 4804, + 35804, + 6340, + 5260, + 8044, + 337, + 94340, + 20296, + 1331, + 2524, + 19304, + 21138, + 14915, + 3010, + 1250, + 8087, + 764, + 19539, + 32453, + 19304, + 1705, + 6750, + 94340, + 10357, + 612, + 28620, + 23692, + 4800, + 24244, + 398, + 14302, + 19304, + 1748, + 7791, + 3770, + 14139, + 94340, + 1331, + 18397, + 99526, + 19304, + 21138, + 14915, + 3010, + 1250, + 8087, + 764, + 19539, + 24630, + 398, + 185, + 185, + 85775, + 19304, + 2469, + 1850, + 1103, + 227, + 3138, + 22567, + 19409, + 94340, + 1331, + 18397, + 13532, + 1250, + 8087, + 19304, + 1306, + 28620, + 23692, + 4800, + 2209, + 50246, + 6802, + 6841, + 5549, + 11000, + 2524, + 51952, + 9756, + 398, + 3635, + 19304, + 8560, + 95304, + 6841, + 5549, + 4607, + 19304, + 15149, + 1615, + 64193, + 25610, + 19304, + 3104, + 29572, + 29263, + 764, + 19409, + 94340, + 1331, + 18397, + 13532, + 1250, + 8087, + 398, + 100001 + ], + "generated_token_ids_sha256": "a5f0da9a88555f8cb3e0c0383639ac29049edfbfa17b647dd2c6ff968ad161e2", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " 在《水浒传》中,关于谁的武艺第一,并没有明确的答案,因为这部小说中有很多武功高强的英雄好汉。不过,卢俊义被认为是其中武艺最高强的人物之一。\n\n卢俊义,绰号“玉麒麟”,原是河北大名府的员外,后来上了梁山。他不仅武艺高强,而且为人仗义,深受梁山好汉的尊敬。在梁山好汉中,卢俊义的武功排名第一,被认为是梁山好汉中的领袖人物。\n\n然而,也有一些读者认为林冲的武功也很高强,他在梁山好汉中排名第六,但他的武功并不在卢俊义之下。此外,关胜也是一位武功高强的将领,他在梁山好汉中排名第五。\n\n总的来说,《水浒传》中有很多武功高强的英雄好汉,而卢俊义被认为是其中武艺最高强的人物之一。但是,关于谁的武艺第一,并没有一个明确的答案,因为这部小说中有很多武功高强的英雄好汉。", + "text_sha256": "4177871a5b4cd7b0c0f3378dcf6a6572e32edfe4bb6e4bb96505e038d978d951", + "task_score": null + }, + { + "condition": "s0_x", + "factors": { + "system": 0, + "history": "filler", + "boundary": "x", + "token_class": "ordinary_control" + }, + "prompt_tokens": 52, + "left_padding_tokens": 16, + "prompt_token_ids_sha256": "0f3b77e93fdc02e48ba7b2eb1e96068020ff6a89f4dcedcbf975a3c36752e64f", + "generated_tokens": 155, + "generated_token_ids": [ + 207, + 28103, + 1850, + 1103, + 227, + 3138, + 22567, + 19304, + 8560, + 95304, + 6841, + 5549, + 4607, + 19304, + 15149, + 64193, + 25610, + 398, + 6117, + 19304, + 28620, + 23692, + 4800, + 2209, + 50246, + 14915, + 3010, + 1250, + 8087, + 5387, + 4607, + 51460, + 19304, + 6750, + 6841, + 5549, + 3963, + 5207, + 19304, + 56923, + 790, + 3889, + 3568, + 4031, + 764, + 6167, + 84146, + 1907, + 19304, + 3889, + 4031, + 70944, + 75028, + 73403, + 1975, + 19304, + 3568, + 4031, + 764, + 43974, + 6841, + 2547, + 24782, + 976, + 398, + 185, + 185, + 28620, + 23692, + 4800, + 337, + 6841, + 5549, + 1331, + 2524, + 19304, + 6750, + 18119, + 1511, + 537, + 54795, + 1511, + 885, + 3889, + 2889, + 48187, + 38101, + 19304, + 12580, + 612, + 19328, + 22962, + 764, + 3089, + 1155, + 29371, + 29371, + 3187, + 3469, + 398, + 6750, + 6841, + 5549, + 7399, + 24990, + 14915, + 3010, + 1250, + 8087, + 337, + 24239, + 19304, + 1024, + 24990, + 15160, + 4097, + 88106, + 398, + 7058, + 19304, + 28620, + 23692, + 4800, + 2209, + 50246, + 2469, + 1850, + 1103, + 227, + 58096, + 5387, + 4607, + 51460, + 398, + 185, + 185, + 9158, + 19304, + 92949, + 6857, + 29263, + 5387, + 31994, + 1336, + 10460, + 38934, + 19304, + 5871, + 3279, + 3883, + 13282, + 14437, + 31333, + 398, + 100001 + ], + "generated_token_ids_sha256": "b200e788b830b9dde24d9bb3ae141e2a50d300497a6e2c264fb1362ef7aa44d8", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " 在《水浒传》中,关于谁的武艺第一,并没有明确的答案。不过,卢俊义被认为是梁山好汉中的第一高手,他的武艺超群,被誉为“马步军中独无敌手,马军中了娄丞相,步军中少了武二郎”。\n\n卢俊义的武艺高强,他的枪法、棍法和马术都非常出色,曾经在多次战斗中立下赫赫战功。他的武艺不仅得到了梁山好汉的认可,也得到了敌人的敬畏。因此,卢俊义被认为是《水浒传》中的第一高手。\n\n当然,这只是根据小说中的描述得出的结论,不同的人可能会有不同的看法。", + "text_sha256": "996ce0a7dfaa950752b650f82dc8e43af1e0e1228e73ba6845b3f1c94c0e9558", + "task_score": null + }, + { + "condition": "s1_x", + "factors": { + "system": 1, + "history": "filler", + "boundary": "x", + "token_class": "ordinary_control" + }, + "prompt_tokens": 68, + "left_padding_tokens": 0, + "prompt_token_ids_sha256": "27059da052bbadbdba194691ad422c105c0a18aba9d2977a159e136d99f8a7a5", + "generated_tokens": 125, + "generated_token_ids": [ + 207, + 28103, + 1850, + 1103, + 227, + 3138, + 22567, + 19304, + 28620, + 23692, + 4800, + 2209, + 31994, + 777, + 6841, + 5549, + 1331, + 2524, + 19304, + 1410, + 748, + 60245, + 19304, + 504, + 14915, + 3010, + 1250, + 8087, + 5387, + 4607, + 51460, + 398, + 1147, + 7399, + 6841, + 5549, + 3963, + 5207, + 19304, + 5674, + 5019, + 12008, + 4715, + 1446, + 19304, + 504, + 14915, + 3010, + 31501, + 337, + 56965, + 9756, + 398, + 13043, + 19304, + 8560, + 8672, + 504, + 6841, + 5549, + 4607, + 11217, + 19304, + 7406, + 2469, + 1850, + 1103, + 227, + 58096, + 5593, + 1687, + 23440, + 9668, + 19304, + 14437, + 35804, + 3883, + 13282, + 14437, + 31333, + 398, + 35757, + 17416, + 6340, + 5260, + 8044, + 337, + 6841, + 5549, + 42709, + 1331, + 2524, + 19304, + 504, + 14915, + 3010, + 4041, + 14329, + 1848, + 1363, + 4090, + 19304, + 1705, + 25850, + 6742, + 19304, + 28620, + 23692, + 4800, + 28103, + 1850, + 1103, + 227, + 3138, + 22567, + 2209, + 16171, + 9104, + 6841, + 5549, + 4607, + 70996, + 17212, + 398, + 100001 + ], + "generated_token_ids_sha256": "31ec50499160b0f70ff16d52a9cb4a0a7799b3fa72368335d8cb5f8164c6a620", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " 在《水浒传》中,卢俊义被描述为武艺高强,力大无穷,是梁山好汉中的第一高手。他不仅武艺超群,而且智勇双全,是梁山泊的领袖之一。然而,关于谁是武艺第一的问题,由于《水浒传》是一部文学作品,不同的读者可能会有不同的看法。有些人可能会认为林冲的武艺也非常高强,是梁山五虎将之首,但总体来说,卢俊义在《水浒传》中被塑造成武艺第一的英雄形象。", + "text_sha256": "7a28480afa946109f4a90bffe928d34bb54e72b4ac48a821a83289a37cbaa5ff", + "task_score": null + }, + { + "condition": "s0_period", + "factors": { + "system": 0, + "history": "filler", + "boundary": "period", + "token_class": "ordinary_control" + }, + "prompt_tokens": 52, + "left_padding_tokens": 16, + "prompt_token_ids_sha256": "e14358af6594705e0109ef78fddae368aa4c0d51dae7058ee59d054fd81676e9", + "generated_tokens": 225, + "generated_token_ids": [ + 207, + 28103, + 1850, + 1103, + 227, + 3138, + 22567, + 19304, + 8560, + 95304, + 6841, + 5549, + 4607, + 11217, + 19304, + 15149, + 1615, + 64193, + 25610, + 398, + 3104, + 2469, + 1850, + 1103, + 227, + 58096, + 5387, + 13532, + 1250, + 8087, + 21158, + 19304, + 85291, + 1889, + 33639, + 6841, + 5549, + 885, + 15967, + 19304, + 5674, + 54132, + 16522, + 13756, + 17565, + 8672, + 504, + 6841, + 5549, + 4607, + 70996, + 398, + 185, + 185, + 6117, + 19304, + 28620, + 23692, + 4800, + 5277, + 14915, + 3010, + 31501, + 337, + 7568, + 3202, + 18659, + 19304, + 6750, + 6841, + 5549, + 885, + 9071, + 4279, + 48187, + 1331, + 19304, + 2209, + 50246, + 14915, + 3010, + 1250, + 8087, + 5387, + 55566, + 51460, + 9756, + 398, + 7058, + 19304, + 35757, + 6340, + 28620, + 23692, + 4800, + 21873, + 2469, + 1850, + 1103, + 227, + 3138, + 22567, + 6841, + 5549, + 4607, + 70996, + 398, + 185, + 185, + 3635, + 19304, + 9338, + 11848, + 6340, + 5260, + 8044, + 337, + 6841, + 5549, + 42709, + 1331, + 2524, + 19304, + 21138, + 2469, + 1850, + 1103, + 227, + 58096, + 5387, + 8303, + 42709, + 38101, + 19304, + 7058, + 84695, + 6340, + 5260, + 8044, + 21873, + 6841, + 5549, + 4607, + 70996, + 398, + 185, + 185, + 19947, + 1748, + 7791, + 19304, + 6006, + 21138, + 2469, + 1850, + 1103, + 227, + 58096, + 5387, + 8303, + 20296, + 38101, + 19304, + 3635, + 6750, + 6841, + 5549, + 15149, + 4110, + 28620, + 23692, + 4800, + 885, + 5260, + 8044, + 22801, + 2209, + 21651, + 3138, + 57408, + 398, + 185, + 185, + 7058, + 19304, + 8560, + 2469, + 1850, + 1103, + 227, + 3138, + 22567, + 95304, + 6841, + 5549, + 4607, + 11217, + 19304, + 15149, + 1615, + 64193, + 25610, + 398, + 22435, + 1073, + 13532, + 1250, + 8087, + 337, + 18906, + 885, + 31333, + 1223, + 5871, + 19304, + 7058, + 4645, + 33334, + 9338, + 14437, + 31333, + 885, + 12814, + 398, + 100001 + ], + "generated_token_ids_sha256": "c697904933e77b26b635b05fe5bf823f427d4b8b92f6a783e06b8c0897b08c30", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " 在《水浒传》中,关于谁的武艺第一的问题,并没有一个明确的答案。因为《水浒传》中的英雄好汉众多,每个人都有自己独特的武艺和特点,而且书中也没有明确指出谁是武艺第一的英雄。\n\n不过,卢俊义作为梁山泊的副统帅,他的武艺和威望都非常高,被认为是梁山好汉中的顶尖高手之一。因此,有些人认为卢俊义可能是《水浒传》中武艺第一的英雄。\n\n但是,也有很多人认为林冲的武艺也非常高强,他在《水浒传》中的表现也非常出色,因此也有人认为林冲可能是武艺第一的英雄。\n\n至于关胜,虽然他在《水浒传》中的表现也很出色,但是他的武艺并没有像卢俊义和林冲那样被广泛传颂。\n\n因此,关于《水浒传》中谁的武艺第一的问题,并没有一个明确的答案。每个人对英雄好汉的评价和看法都不同,因此对于这个问题也有不同的看法和理解。", + "text_sha256": "0bfaabd1058ae7e51e5ab58ae5bd1ad81e71394c4ce8a2ec69160fc7f8556f3b", + "task_score": null + }, + { + "condition": "s1_period", + "factors": { + "system": 1, + "history": "filler", + "boundary": "period", + "token_class": "ordinary_control" + }, + "prompt_tokens": 68, + "left_padding_tokens": 0, + "prompt_token_ids_sha256": "7c421121f0cb46dd7cd004e2b0681fb736a802b45fa7734580f7a5dec93f6d8a", + "generated_tokens": 110, + "generated_token_ids": [ + 207, + 28103, + 1850, + 1103, + 227, + 3138, + 22567, + 19304, + 8560, + 95304, + 6841, + 5549, + 4607, + 19304, + 15149, + 64193, + 31994, + 398, + 6117, + 19304, + 28620, + 23692, + 4800, + 18867, + 2209, + 50246, + 14915, + 3010, + 1250, + 8087, + 5387, + 4607, + 51460, + 398, + 612, + 27194, + 37341, + 885, + 23440, + 9668, + 764, + 19304, + 28620, + 23692, + 4800, + 1903, + 2209, + 62825, + 777, + 6841, + 5549, + 3963, + 5207, + 19304, + 1410, + 748, + 60245, + 19304, + 609, + 790, + 3889, + 3568, + 4031, + 764, + 777, + 12585, + 7784, + 19304, + 1446, + 13908, + 2581, + 25219, + 23554, + 15160, + 976, + 19769, + 15839, + 398, + 612, + 14915, + 3010, + 31501, + 13532, + 19539, + 764, + 19304, + 28620, + 23692, + 4800, + 62928, + 68010, + 19304, + 2209, + 10709, + 777, + 94340, + 75422, + 537, + 64555, + 4477, + 98573, + 2581, + 17351, + 9918, + 3889, + 7568, + 2907, + 2413, + 398, + 100001 + ], + "generated_token_ids_sha256": "023622aa8d36e9f76bb50a6a3bc3d790f6ea590a15dee85a488a01e4fefc9478", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " 在《水浒传》中,关于谁的武艺第一,并没有明确的描述。不过,卢俊义通常被认为是梁山好汉中的第一高手。在民间传说和文学作品中,卢俊义常被描绘为武艺超群,力大无穷,有“马步军中为尊贵,全凭使棒万人敌”的美誉。在梁山泊英雄排名中,卢俊义位居首位,被封为武功大夫、庐州安抚使兼兵马副总管。", + "text_sha256": "566ea4e44fd347d851e9daa6cec446fec1d33bcb3e6cc71910923cbed6a49519", + "task_score": null + } + ] + }, + { + "id": "HumanEval/31", + "domain": "code", + "label": "Python code", + "within_domain_index": 0, + "selection_rank": "004f4cfa62936a4a096e53df7d0ef3926c3ee97d32cf67a3c9bd64569f580e5c", + "source_text_sha256": "b7e32acf5a6b551a782eacfb4ecab09e59f0577a2da9642e292d2479af5bf50e", + "source_characters": 308, + "source_tokens": 120, + "prompt_tokens_by_condition": { + "s0_eos": 145, + "s1_eos": 161, + "s0_bos": 145, + "s1_bos": 161, + "s0_x": 145, + "s1_x": 161, + "s0_period": 145, + "s1_period": 161 + }, + "batch_prompt_tokens_after_left_padding": 161, + "batch_padding_side": "left", + "batch_conditions": 8, + "generation_seconds": 94.73849877199973, + "peak_cuda_memory_allocated_bytes": 30526436864, + "generated_tokens_including_batch_padding": 3432, + "outputs": [ + { + "condition": "s0_eos", + "factors": { + "system": 0, + "history": "filler", + "boundary": "eos", + "token_class": "special" + }, + "prompt_tokens": 145, + "left_padding_tokens": 16, + "prompt_token_ids_sha256": "6be7e854ac1a52102505446e011621de1eb53890d8bb05e6da6acc04b8aba862", + "generated_tokens": 397, + "generated_token_ids": [ + 2158, + 4353, + 254, + 2030, + 262, + 62, + 6620, + 63, + 1157, + 11, + 395, + 933, + 276, + 2341, + 565, + 245, + 2028, + 1604, + 2030, + 77, + 63, + 317, + 6146, + 853, + 207, + 16, + 285, + 643, + 642, + 77625, + 750, + 853, + 207, + 16, + 285, + 3964, + 13, + 4462, + 6, + 82, + 254, + 9674, + 25, + 185, + 185, + 10897, + 11338, + 185, + 1558, + 317, + 62, + 6620, + 7, + 77, + 1780, + 185, + 300, + 8066, + 8925, + 1927, + 565, + 245, + 2028, + 1604, + 317, + 9966, + 11, + 285, + 2526, + 6616, + 27823, + 185, + 300, + 565, + 291, + 10551, + 207, + 16, + 25, + 185, + 391, + 972, + 14687, + 185, + 300, + 565, + 291, + 10551, + 207, + 18, + 25, + 185, + 391, + 972, + 10491, + 185, + 300, + 565, + 291, + 3028, + 207, + 17, + 2318, + 207, + 15, + 410, + 291, + 3028, + 207, + 18, + 2318, + 207, + 15, + 25, + 185, + 391, + 972, + 14687, + 185, + 300, + 460, + 403, + 207, + 20, + 185, + 300, + 1477, + 460, + 575, + 460, + 10551, + 291, + 25, + 185, + 391, + 565, + 291, + 3028, + 460, + 2318, + 207, + 15, + 410, + 291, + 3028, + 334, + 72, + 919, + 207, + 17, + 8, + 2318, + 207, + 15, + 25, + 185, + 595, + 972, + 14687, + 185, + 391, + 460, + 7324, + 207, + 21, + 185, + 300, + 972, + 10491, + 185, + 10897, + 185, + 185, + 1567, + 1157, + 1022, + 22193, + 254, + 3038, + 3863, + 280, + 5750, + 2246, + 853, + 410, + 5929, + 276, + 207, + 18, + 11, + 937, + 14180, + 91971, + 3461, + 457, + 207, + 17, + 285, + 207, + 18, + 13, + 4128, + 344, + 11, + 359, + 5131, + 245, + 7832, + 276, + 2341, + 91971, + 3461, + 457, + 521, + 5750, + 280, + 254, + 1020, + 207, + 21, + 74, + 61178, + 16, + 581, + 276, + 254, + 7742, + 4343, + 280, + 2030, + 77, + 13557, + 1002, + 317, + 2853, + 331, + 254, + 12650, + 344, + 521, + 9966, + 5750, + 481, + 330, + 10372, + 279, + 437, + 1020, + 11, + 285, + 359, + 9812, + 16438, + 254, + 1604, + 280, + 14180, + 4067, + 13, + 185, + 185, + 4160, + 6, + 82, + 1727, + 254, + 1157, + 366, + 254, + 4286, + 6987, + 25, + 185, + 185, + 10897, + 11338, + 185, + 4134, + 7, + 262, + 62, + 6620, + 7, + 21, + 1509, + 207, + 1501, + 14687, + 185, + 4134, + 7, + 262, + 62, + 6620, + 7, + 16, + 15, + 16, + 1509, + 207, + 1501, + 10491, + 185, + 4134, + 7, + 262, + 62, + 6620, + 7, + 16, + 16, + 1509, + 207, + 1501, + 10491, + 185, + 4134, + 7, + 262, + 62, + 6620, + 7, + 16, + 18, + 19, + 19, + 16, + 1509, + 207, + 1501, + 14687, + 334, + 1567, + 1604, + 317, + 441, + 9966, + 1373, + 359, + 6, + 82, + 69543, + 457, + 207, + 16, + 15, + 22, + 8, + 185, + 4134, + 7, + 262, + 62, + 6620, + 7, + 21, + 16, + 1509, + 207, + 1501, + 10491, + 185, + 4134, + 7, + 262, + 62, + 6620, + 7, + 19, + 1509, + 207, + 1501, + 14687, + 185, + 4134, + 7, + 262, + 62, + 6620, + 7, + 16, + 1509, + 207, + 1501, + 14687, + 185, + 10897, + 185, + 185, + 1567, + 1023, + 2827, + 254, + 4061, + 2472, + 13, + 100001 + ], + "generated_token_ids_sha256": "51062153bce2cacf76ed30a07ddf8e2a12584ffe151479497c81be2934d6303c", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " To implement the `is_prime` function, we need to check if a given number `n` is greater than 1 and has no divisors other than 1 and itself. Here's the implementation:\n\n```python\ndef is_prime(n):\n \"\"\"Return true if a given number is prime, and false otherwise.\"\"\"\n if n <= 1:\n return False\n if n <= 3:\n return True\n if n % 2 == 0 or n % 3 == 0:\n return False\n i = 5\n while i * i <= n:\n if n % i == 0 or n % (i + 2) == 0:\n return False\n i += 6\n return True\n```\n\nThis function first handles the special cases of numbers less than or equal to 3, then checks divisibility by 2 and 3. After that, it uses a loop to check divisibility by all numbers of the form 6k ± 1 up to the square root of `n`. This is based on the observation that all prime numbers can be expressed in this form, and it significantly reduces the number of checks needed.\n\nLet's test the function with the provided examples:\n\n```python\nprint(is_prime(6)) # False\nprint(is_prime(101)) # True\nprint(is_prime(11)) # True\nprint(is_prime(13441)) # False (This number is not prime because it's divisible by 107)\nprint(is_prime(61)) # True\nprint(is_prime(4)) # False\nprint(is_prime(1)) # False\n```\n\nThis should output the expected results.", + "text_sha256": "45c1e4a40540f9de31d5ead7675556fb4ca64ede36e94aba8bd005d6c3301fca", + "task_score": { + "candidate_sha256": "af9f7acecc15979fd07061448278bf3ebe4b8e865597307302c7b07d50711f44", + "python_ast_parse": true, + "parse_error": null, + "code_executed": false + } + }, + { + "condition": "s1_eos", + "factors": { + "system": 1, + "history": "filler", + "boundary": "eos", + "token_class": "special" + }, + "prompt_tokens": 161, + "left_padding_tokens": 0, + "prompt_token_ids_sha256": "c6783406e90bf388721019684ddad1e7fb00ae8d7e28588fedc2098130fcfbe9", + "generated_tokens": 322, + "generated_token_ids": [ + 2158, + 6983, + 565, + 245, + 1604, + 317, + 9966, + 11, + 395, + 933, + 276, + 2341, + 565, + 359, + 643, + 688, + 77625, + 750, + 853, + 207, + 16, + 285, + 3964, + 13, + 338, + 9966, + 1604, + 317, + 245, + 3892, + 1604, + 6146, + 853, + 207, + 16, + 344, + 643, + 642, + 4864, + 77625, + 750, + 853, + 207, + 16, + 285, + 3964, + 13, + 185, + 185, + 4898, + 6, + 82, + 254, + 9674, + 280, + 254, + 2030, + 262, + 62, + 6620, + 63, + 1157, + 25, + 185, + 185, + 10897, + 11338, + 185, + 1558, + 317, + 62, + 6620, + 7, + 77, + 1780, + 185, + 300, + 8066, + 8925, + 1927, + 565, + 245, + 2028, + 1604, + 317, + 9966, + 11, + 285, + 2526, + 6616, + 27823, + 185, + 300, + 1501, + 207, + 15, + 285, + 207, + 16, + 418, + 441, + 9966, + 5750, + 185, + 300, + 565, + 291, + 10551, + 207, + 16, + 25, + 185, + 391, + 972, + 14687, + 185, + 300, + 1501, + 207, + 17, + 317, + 254, + 889, + 1236, + 9966, + 1604, + 185, + 300, + 565, + 291, + 2318, + 207, + 17, + 25, + 185, + 391, + 972, + 10491, + 185, + 300, + 1501, + 521, + 750, + 1236, + 5750, + 418, + 441, + 9966, + 185, + 300, + 565, + 291, + 3028, + 207, + 17, + 2318, + 207, + 15, + 25, + 185, + 391, + 972, + 14687, + 185, + 300, + 1501, + 2341, + 77625, + 473, + 207, + 18, + 276, + 254, + 7742, + 4343, + 280, + 291, + 185, + 300, + 327, + 460, + 279, + 3169, + 7, + 18, + 11, + 1098, + 7, + 77, + 746, + 15, + 13, + 20, + 8, + 919, + 207, + 16, + 11, + 207, + 17, + 1780, + 185, + 391, + 565, + 291, + 3028, + 460, + 2318, + 207, + 15, + 25, + 185, + 595, + 972, + 14687, + 185, + 300, + 972, + 10491, + 185, + 10897, + 185, + 185, + 1567, + 1157, + 1022, + 14180, + 565, + 254, + 1604, + 317, + 2246, + 853, + 410, + 5929, + 276, + 207, + 16, + 11, + 279, + 588, + 1460, + 359, + 317, + 441, + 9966, + 13, + 809, + 937, + 14180, + 565, + 254, + 1604, + 317, + 207, + 17, + 11, + 279, + 588, + 1460, + 359, + 317, + 9966, + 13, + 1494, + 521, + 750, + 1236, + 5750, + 11, + 359, + 317, + 441, + 9966, + 13, + 12226, + 11, + 359, + 14180, + 327, + 8788, + 77625, + 5872, + 473, + 207, + 18, + 581, + 276, + 254, + 7742, + 4343, + 280, + 254, + 1604, + 13, + 1273, + 688, + 280, + 1069, + 14180, + 1275, + 245, + 40875, + 11, + 254, + 1604, + 317, + 441, + 9966, + 13, + 1273, + 642, + 77625, + 418, + 1503, + 11, + 254, + 1604, + 317, + 9966, + 13, + 100001 + ], + "generated_token_ids_sha256": "6a52846b2faf17e19b9925f18ad1442b8d6c8bb05c0dec261f632031c3bb3eac", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " To determine if a number is prime, we need to check if it has any divisors other than 1 and itself. A prime number is a natural number greater than 1 that has no positive divisors other than 1 and itself.\n\nHere's the implementation of the `is_prime` function:\n\n```python\ndef is_prime(n):\n \"\"\"Return true if a given number is prime, and false otherwise.\"\"\"\n # 0 and 1 are not prime numbers\n if n <= 1:\n return False\n # 2 is the only even prime number\n if n == 2:\n return True\n # all other even numbers are not prime\n if n % 2 == 0:\n return False\n # check divisors from 3 to the square root of n\n for i in range(3, int(n**0.5) + 1, 2):\n if n % i == 0:\n return False\n return True\n```\n\nThis function first checks if the number is less than or equal to 1, in which case it is not prime. It then checks if the number is 2, in which case it is prime. For all other even numbers, it is not prime. Finally, it checks for odd divisors starting from 3 up to the square root of the number. If any of these checks find a divisor, the number is not prime. If no divisors are found, the number is prime.", + "text_sha256": "64935e66c7081e378b95e68763d4ffe05e0561f06e565bb0b89123a184bb2824", + "task_score": { + "candidate_sha256": "08063a9ae2f1615cd3d3379aefff53aa8f08a3bbcf19c6092ebc44cc461915b8", + "python_ast_parse": true, + "parse_error": null, + "code_executed": false + } + }, + { + "condition": "s0_bos", + "factors": { + "system": 0, + "history": "filler", + "boundary": "bos", + "token_class": "special" + }, + "prompt_tokens": 145, + "left_padding_tokens": 16, + "prompt_token_ids_sha256": "38c3f8aeedce7475927d567cbc6416a0a5ef9513726fba330253dc7d2224ab62", + "generated_tokens": 412, + "generated_token_ids": [ + 2158, + 4353, + 254, + 2030, + 262, + 62, + 6620, + 63, + 1157, + 11, + 395, + 933, + 276, + 2341, + 565, + 245, + 2028, + 1604, + 2030, + 77, + 63, + 317, + 6146, + 853, + 207, + 16, + 285, + 643, + 642, + 77625, + 750, + 853, + 207, + 16, + 285, + 3964, + 13, + 4462, + 6, + 82, + 254, + 9674, + 25, + 185, + 185, + 10897, + 11338, + 185, + 1558, + 317, + 62, + 6620, + 7, + 77, + 1780, + 185, + 300, + 8066, + 8925, + 1927, + 565, + 245, + 2028, + 1604, + 317, + 9966, + 11, + 285, + 2526, + 6616, + 27823, + 185, + 300, + 565, + 291, + 10551, + 207, + 16, + 25, + 185, + 391, + 972, + 14687, + 185, + 300, + 565, + 291, + 10551, + 207, + 18, + 25, + 185, + 391, + 972, + 10491, + 185, + 300, + 565, + 291, + 3028, + 207, + 17, + 2318, + 207, + 15, + 410, + 291, + 3028, + 207, + 18, + 2318, + 207, + 15, + 25, + 185, + 391, + 972, + 14687, + 185, + 300, + 460, + 403, + 207, + 20, + 185, + 300, + 1477, + 460, + 575, + 460, + 10551, + 291, + 25, + 185, + 391, + 565, + 291, + 3028, + 460, + 2318, + 207, + 15, + 410, + 291, + 3028, + 334, + 72, + 919, + 207, + 17, + 8, + 2318, + 207, + 15, + 25, + 185, + 595, + 972, + 14687, + 185, + 391, + 460, + 7324, + 207, + 21, + 185, + 300, + 972, + 10491, + 185, + 10897, + 185, + 185, + 1567, + 1157, + 1022, + 22193, + 254, + 3038, + 3863, + 280, + 5750, + 2246, + 853, + 410, + 5929, + 276, + 207, + 18, + 11, + 937, + 14180, + 91971, + 3461, + 457, + 207, + 17, + 285, + 207, + 18, + 13, + 4128, + 344, + 11, + 359, + 5131, + 245, + 7832, + 276, + 2341, + 91971, + 3461, + 457, + 521, + 5750, + 280, + 254, + 1020, + 207, + 21, + 74, + 61178, + 16, + 581, + 276, + 254, + 7742, + 4343, + 280, + 2030, + 77, + 13557, + 1002, + 317, + 2853, + 331, + 254, + 12650, + 344, + 521, + 9966, + 5750, + 481, + 330, + 10372, + 279, + 437, + 1020, + 13, + 1273, + 2030, + 77, + 63, + 317, + 69543, + 457, + 688, + 280, + 1069, + 5750, + 11, + 359, + 317, + 441, + 9966, + 13, + 1273, + 642, + 1108, + 8095, + 418, + 1503, + 11, + 2030, + 77, + 63, + 317, + 9966, + 13, + 185, + 185, + 4160, + 6, + 82, + 1727, + 254, + 1157, + 366, + 254, + 4286, + 6987, + 25, + 185, + 185, + 10897, + 11338, + 185, + 4134, + 7, + 262, + 62, + 6620, + 7, + 21, + 1509, + 207, + 1501, + 14687, + 185, + 4134, + 7, + 262, + 62, + 6620, + 7, + 16, + 15, + 16, + 1509, + 207, + 1501, + 10491, + 185, + 4134, + 7, + 262, + 62, + 6620, + 7, + 16, + 16, + 1509, + 207, + 1501, + 10491, + 185, + 4134, + 7, + 262, + 62, + 6620, + 7, + 16, + 18, + 19, + 19, + 16, + 1509, + 207, + 1501, + 14687, + 334, + 1385, + 6, + 82, + 3370, + 245, + 3224, + 7742, + 11, + 441, + 9966, + 8, + 185, + 4134, + 7, + 262, + 62, + 6620, + 7, + 21, + 16, + 1509, + 207, + 1501, + 10491, + 185, + 4134, + 7, + 262, + 62, + 6620, + 7, + 19, + 1509, + 207, + 1501, + 14687, + 185, + 4134, + 7, + 262, + 62, + 6620, + 7, + 16, + 1509, + 207, + 1501, + 14687, + 185, + 10897, + 185, + 185, + 1567, + 1023, + 2827, + 254, + 4061, + 2472, + 13, + 100001 + ], + "generated_token_ids_sha256": "2b6cfd2f4e0adc17c6a6bd87742f86d2142facff7834e5c71b12403e36cba4c5", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " To implement the `is_prime` function, we need to check if a given number `n` is greater than 1 and has no divisors other than 1 and itself. Here's the implementation:\n\n```python\ndef is_prime(n):\n \"\"\"Return true if a given number is prime, and false otherwise.\"\"\"\n if n <= 1:\n return False\n if n <= 3:\n return True\n if n % 2 == 0 or n % 3 == 0:\n return False\n i = 5\n while i * i <= n:\n if n % i == 0 or n % (i + 2) == 0:\n return False\n i += 6\n return True\n```\n\nThis function first handles the special cases of numbers less than or equal to 3, then checks divisibility by 2 and 3. After that, it uses a loop to check divisibility by all numbers of the form 6k ± 1 up to the square root of `n`. This is based on the observation that all prime numbers can be expressed in this form. If `n` is divisible by any of these numbers, it is not prime. If no such factors are found, `n` is prime.\n\nLet's test the function with the provided examples:\n\n```python\nprint(is_prime(6)) # False\nprint(is_prime(101)) # True\nprint(is_prime(11)) # True\nprint(is_prime(13441)) # False (It's actually a perfect square, not prime)\nprint(is_prime(61)) # True\nprint(is_prime(4)) # False\nprint(is_prime(1)) # False\n```\n\nThis should output the expected results.", + "text_sha256": "e829f7f676c8c08675751dc68176e1303e6b59ee664add76312f29df7517925f", + "task_score": { + "candidate_sha256": "af9f7acecc15979fd07061448278bf3ebe4b8e865597307302c7b07d50711f44", + "python_ast_parse": true, + "parse_error": null, + "code_executed": false + } + }, + { + "condition": "s1_bos", + "factors": { + "system": 1, + "history": "filler", + "boundary": "bos", + "token_class": "special" + }, + "prompt_tokens": 161, + "left_padding_tokens": 0, + "prompt_token_ids_sha256": "6d288fc010eee1c71df12ad1777bd4232fb5774570082f4d8d846b924a6b4d9c", + "generated_tokens": 320, + "generated_token_ids": [ + 2158, + 6983, + 565, + 245, + 1604, + 317, + 9966, + 11, + 395, + 933, + 276, + 2341, + 565, + 359, + 643, + 688, + 77625, + 750, + 853, + 207, + 16, + 285, + 3964, + 13, + 338, + 9966, + 1604, + 317, + 4218, + 372, + 245, + 1604, + 6146, + 853, + 207, + 16, + 344, + 643, + 642, + 4864, + 77625, + 750, + 853, + 207, + 16, + 285, + 3964, + 13, + 185, + 185, + 4898, + 6, + 82, + 254, + 9674, + 280, + 254, + 2030, + 262, + 62, + 6620, + 63, + 1157, + 25, + 185, + 185, + 10897, + 11338, + 185, + 1558, + 317, + 62, + 6620, + 7, + 77, + 1780, + 185, + 300, + 8066, + 8925, + 1927, + 565, + 245, + 2028, + 1604, + 317, + 9966, + 11, + 285, + 2526, + 6616, + 27823, + 185, + 300, + 1501, + 207, + 15, + 285, + 207, + 16, + 418, + 441, + 9966, + 5750, + 185, + 300, + 565, + 291, + 10551, + 207, + 16, + 25, + 185, + 391, + 972, + 14687, + 185, + 300, + 1501, + 207, + 17, + 317, + 254, + 889, + 1236, + 9966, + 1604, + 185, + 300, + 565, + 291, + 2318, + 207, + 17, + 25, + 185, + 391, + 972, + 10491, + 185, + 300, + 1501, + 521, + 750, + 1236, + 5750, + 418, + 441, + 9966, + 185, + 300, + 565, + 291, + 3028, + 207, + 17, + 2318, + 207, + 15, + 25, + 185, + 391, + 972, + 14687, + 185, + 300, + 1501, + 2341, + 77625, + 473, + 207, + 18, + 276, + 254, + 7742, + 4343, + 280, + 291, + 185, + 300, + 327, + 460, + 279, + 3169, + 7, + 18, + 11, + 1098, + 7, + 77, + 746, + 15, + 13, + 20, + 8, + 919, + 207, + 16, + 11, + 207, + 17, + 1780, + 185, + 391, + 565, + 291, + 3028, + 460, + 2318, + 207, + 15, + 25, + 185, + 595, + 972, + 14687, + 185, + 300, + 972, + 10491, + 185, + 10897, + 185, + 185, + 1567, + 1157, + 1022, + 14180, + 565, + 254, + 1604, + 317, + 2246, + 853, + 410, + 5929, + 276, + 207, + 16, + 11, + 279, + 588, + 1460, + 359, + 317, + 441, + 9966, + 13, + 809, + 937, + 14180, + 565, + 254, + 1604, + 317, + 207, + 17, + 11, + 279, + 588, + 1460, + 359, + 317, + 9966, + 13, + 1494, + 521, + 750, + 1236, + 5750, + 11, + 359, + 317, + 441, + 9966, + 13, + 12226, + 11, + 359, + 14180, + 327, + 8788, + 77625, + 5872, + 473, + 207, + 18, + 581, + 276, + 254, + 7742, + 4343, + 280, + 254, + 1604, + 13, + 1273, + 688, + 40875, + 317, + 1503, + 11, + 254, + 1604, + 317, + 441, + 9966, + 13, + 1273, + 642, + 77625, + 418, + 1503, + 11, + 254, + 1604, + 317, + 9966, + 13, + 100001 + ], + "generated_token_ids_sha256": "8c1f8c0a24d1fe416cb1a4772ef403fc635da763d6f140a2499ed13f4fd00ab4", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " To determine if a number is prime, we need to check if it has any divisors other than 1 and itself. A prime number is defined as a number greater than 1 that has no positive divisors other than 1 and itself.\n\nHere's the implementation of the `is_prime` function:\n\n```python\ndef is_prime(n):\n \"\"\"Return true if a given number is prime, and false otherwise.\"\"\"\n # 0 and 1 are not prime numbers\n if n <= 1:\n return False\n # 2 is the only even prime number\n if n == 2:\n return True\n # all other even numbers are not prime\n if n % 2 == 0:\n return False\n # check divisors from 3 to the square root of n\n for i in range(3, int(n**0.5) + 1, 2):\n if n % i == 0:\n return False\n return True\n```\n\nThis function first checks if the number is less than or equal to 1, in which case it is not prime. It then checks if the number is 2, in which case it is prime. For all other even numbers, it is not prime. Finally, it checks for odd divisors starting from 3 up to the square root of the number. If any divisor is found, the number is not prime. If no divisors are found, the number is prime.", + "text_sha256": "964c8252b0cb6c714898cb9f0c8f9f778af3e372ee27220fa8be8f8111b8eb4f", + "task_score": { + "candidate_sha256": "08063a9ae2f1615cd3d3379aefff53aa8f08a3bbcf19c6092ebc44cc461915b8", + "python_ast_parse": true, + "parse_error": null, + "code_executed": false + } + }, + { + "condition": "s0_x", + "factors": { + "system": 0, + "history": "filler", + "boundary": "x", + "token_class": "ordinary_control" + }, + "prompt_tokens": 145, + "left_padding_tokens": 16, + "prompt_token_ids_sha256": "cb848063b64e250814d3f599ea82a68588dcfdf2fe8141053f798d5c11f5bed2", + "generated_tokens": 429, + "generated_token_ids": [ + 2158, + 6983, + 565, + 245, + 1604, + 317, + 9966, + 11, + 395, + 933, + 276, + 2341, + 565, + 359, + 643, + 688, + 77625, + 750, + 853, + 207, + 16, + 285, + 3964, + 13, + 338, + 9966, + 1604, + 317, + 4218, + 372, + 245, + 1604, + 6146, + 853, + 207, + 16, + 344, + 643, + 642, + 4864, + 77625, + 750, + 853, + 207, + 16, + 285, + 3964, + 13, + 185, + 185, + 4898, + 6, + 82, + 254, + 9674, + 280, + 254, + 2030, + 262, + 62, + 6620, + 63, + 1157, + 25, + 185, + 185, + 10897, + 11338, + 185, + 1558, + 317, + 62, + 6620, + 7, + 77, + 1780, + 185, + 300, + 8066, + 8925, + 1927, + 565, + 245, + 2028, + 1604, + 317, + 9966, + 11, + 285, + 2526, + 6616, + 27823, + 185, + 300, + 1501, + 338, + 9966, + 1604, + 317, + 6146, + 853, + 207, + 16, + 185, + 300, + 565, + 291, + 10551, + 207, + 16, + 25, + 185, + 391, + 972, + 14687, + 185, + 300, + 1501, + 207, + 15, + 285, + 207, + 16, + 418, + 441, + 9966, + 185, + 300, + 565, + 291, + 10551, + 207, + 18, + 25, + 185, + 391, + 972, + 10491, + 185, + 300, + 1501, + 20263, + 2589, + 280, + 207, + 17, + 285, + 207, + 18, + 418, + 441, + 9966, + 185, + 300, + 565, + 291, + 3028, + 207, + 17, + 2318, + 207, + 15, + 410, + 291, + 3028, + 207, + 18, + 2318, + 207, + 15, + 25, + 185, + 391, + 972, + 14687, + 185, + 300, + 1501, + 7361, + 327, + 77625, + 473, + 207, + 20, + 276, + 254, + 7742, + 4343, + 280, + 291, + 185, + 300, + 460, + 403, + 207, + 20, + 185, + 300, + 1477, + 460, + 575, + 460, + 10551, + 291, + 25, + 185, + 391, + 565, + 291, + 3028, + 460, + 2318, + 207, + 15, + 410, + 291, + 3028, + 334, + 72, + 919, + 207, + 17, + 8, + 2318, + 207, + 15, + 25, + 185, + 595, + 972, + 14687, + 185, + 391, + 460, + 7324, + 207, + 21, + 185, + 300, + 972, + 10491, + 185, + 10897, + 185, + 185, + 1567, + 1157, + 1022, + 14180, + 565, + 254, + 1604, + 317, + 2246, + 853, + 410, + 5929, + 276, + 207, + 16, + 11, + 279, + 588, + 1460, + 359, + 7578, + 2030, + 13813, + 13557, + 809, + 937, + 14180, + 565, + 254, + 1604, + 317, + 2246, + 853, + 410, + 5929, + 276, + 207, + 18, + 11, + 279, + 588, + 1460, + 359, + 7578, + 2030, + 8173, + 63, + 1373, + 207, + 17, + 285, + 207, + 18, + 418, + 9966, + 5750, + 13, + 1494, + 5750, + 6146, + 853, + 207, + 18, + 11, + 359, + 14180, + 565, + 254, + 1604, + 317, + 69543, + 457, + 207, + 17, + 410, + 207, + 18, + 11, + 279, + 588, + 1460, + 359, + 7578, + 2030, + 13813, + 13557, + 185, + 185, + 12119, + 11, + 254, + 1157, + 14180, + 327, + 77625, + 5872, + 473, + 207, + 20, + 581, + 276, + 254, + 7742, + 4343, + 280, + 2030, + 77, + 13557, + 1273, + 2030, + 77, + 63, + 317, + 69543, + 457, + 688, + 280, + 1069, + 5750, + 11, + 359, + 7578, + 2030, + 13813, + 13557, + 1273, + 642, + 77625, + 418, + 1503, + 11, + 2030, + 77, + 63, + 317, + 9966, + 11, + 285, + 254, + 1157, + 7578, + 2030, + 8173, + 13557, + 185, + 185, + 1567, + 9674, + 317, + 7519, + 1373, + 359, + 889, + 14180, + 327, + 3968, + 77625, + 581, + 276, + 254, + 7742, + 4343, + 280, + 2030, + 77, + 12181, + 588, + 16438, + 254, + 1604, + 280, + 26302, + 9812, + 6208, + 276, + 13575, + 521, + 5750, + 581, + 276, + 2030, + 77, + 13557, + 100001 + ], + "generated_token_ids_sha256": "1941ed79cea77800e6b6837ffa304d58f913066dc909033b5de1c4ca655e156f", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " To determine if a number is prime, we need to check if it has any divisors other than 1 and itself. A prime number is defined as a number greater than 1 that has no positive divisors other than 1 and itself.\n\nHere's the implementation of the `is_prime` function:\n\n```python\ndef is_prime(n):\n \"\"\"Return true if a given number is prime, and false otherwise.\"\"\"\n # A prime number is greater than 1\n if n <= 1:\n return False\n # 0 and 1 are not prime\n if n <= 3:\n return True\n # Multiples of 2 and 3 are not prime\n if n % 2 == 0 or n % 3 == 0:\n return False\n # Check for divisors from 5 to the square root of n\n i = 5\n while i * i <= n:\n if n % i == 0 or n % (i + 2) == 0:\n return False\n i += 6\n return True\n```\n\nThis function first checks if the number is less than or equal to 1, in which case it returns `False`. It then checks if the number is less than or equal to 3, in which case it returns `True` because 2 and 3 are prime numbers. For numbers greater than 3, it checks if the number is divisible by 2 or 3, in which case it returns `False`.\n\nFinally, the function checks for divisors starting from 5 up to the square root of `n`. If `n` is divisible by any of these numbers, it returns `False`. If no divisors are found, `n` is prime, and the function returns `True`.\n\nThis implementation is efficient because it only checks for potential divisors up to the square root of `n`, which reduces the number of iterations significantly compared to checking all numbers up to `n`.", + "text_sha256": "3c73711955f8f2e2b64b226e9696c88219973cb75e540d18c9883005a8373c44", + "task_score": { + "candidate_sha256": "122b3a6829e529fa11072d2109aeffa728fd53573b3abcdb94dd23259c740f93", + "python_ast_parse": true, + "parse_error": null, + "code_executed": false + } + }, + { + "condition": "s1_x", + "factors": { + "system": 1, + "history": "filler", + "boundary": "x", + "token_class": "ordinary_control" + }, + "prompt_tokens": 161, + "left_padding_tokens": 0, + "prompt_token_ids_sha256": "07c33c0a495f4cf4e660cd5e8edd35416fe77eae15e9b8ce542aefca5d0932dc", + "generated_tokens": 216, + "generated_token_ids": [ + 34083, + 11338, + 185, + 1558, + 317, + 62, + 6620, + 7, + 77, + 1780, + 185, + 300, + 8066, + 8925, + 1927, + 565, + 245, + 2028, + 1604, + 317, + 9966, + 11, + 285, + 2526, + 6616, + 13, + 185, + 300, + 24922, + 317, + 62, + 6620, + 7, + 21, + 8, + 185, + 300, + 14687, + 185, + 300, + 24922, + 317, + 62, + 6620, + 7, + 16, + 15, + 16, + 8, + 185, + 300, + 10491, + 185, + 300, + 24922, + 317, + 62, + 6620, + 7, + 16, + 16, + 8, + 185, + 300, + 10491, + 185, + 300, + 24922, + 317, + 62, + 6620, + 7, + 16, + 18, + 19, + 19, + 16, + 8, + 185, + 300, + 14687, + 185, + 300, + 24922, + 317, + 62, + 6620, + 7, + 21, + 16, + 8, + 185, + 300, + 10491, + 185, + 300, + 24922, + 317, + 62, + 6620, + 7, + 19, + 8, + 185, + 300, + 14687, + 185, + 300, + 24922, + 317, + 62, + 6620, + 7, + 16, + 8, + 185, + 300, + 14687, + 185, + 300, + 8066, + 185, + 300, + 565, + 291, + 459, + 207, + 17, + 25, + 185, + 391, + 972, + 14687, + 185, + 300, + 565, + 291, + 2318, + 207, + 17, + 25, + 185, + 391, + 972, + 10491, + 185, + 300, + 565, + 291, + 3028, + 207, + 17, + 2318, + 207, + 15, + 25, + 185, + 391, + 972, + 14687, + 185, + 300, + 3044, + 62, + 1107, + 15233, + 403, + 1098, + 7, + 77, + 746, + 15, + 13, + 20, + 8, + 919, + 207, + 16, + 185, + 300, + 327, + 263, + 279, + 3169, + 7, + 18, + 11, + 3044, + 62, + 1107, + 15233, + 11, + 207, + 17, + 1780, + 185, + 391, + 565, + 291, + 3028, + 263, + 2318, + 207, + 15, + 25, + 185, + 595, + 972, + 14687, + 185, + 300, + 972, + 10491, + 185, + 10897, + 100001 + ], + "generated_token_ids_sha256": "1a1a73d93051e9ed677e7f69235e1ba455ffaeffdb781553aa0c1612c0ddcbbd", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " ```python\ndef is_prime(n):\n \"\"\"Return true if a given number is prime, and false otherwise.\n >>> is_prime(6)\n False\n >>> is_prime(101)\n True\n >>> is_prime(11)\n True\n >>> is_prime(13441)\n False\n >>> is_prime(61)\n True\n >>> is_prime(4)\n False\n >>> is_prime(1)\n False\n \"\"\"\n if n < 2:\n return False\n if n == 2:\n return True\n if n % 2 == 0:\n return False\n max_divisor = int(n**0.5) + 1\n for d in range(3, max_divisor, 2):\n if n % d == 0:\n return False\n return True\n```", + "text_sha256": "838982bfdfa0c06f8ffdbcf45aa1db7357fdb232a74ae438b72dc7f1ee737a63", + "task_score": { + "candidate_sha256": "25c4489e64cd3cc1936373f2344f7c799b3f7664db669c63640d8cfc1833e843", + "python_ast_parse": true, + "parse_error": null, + "code_executed": false + } + }, + { + "condition": "s0_period", + "factors": { + "system": 0, + "history": "filler", + "boundary": "period", + "token_class": "ordinary_control" + }, + "prompt_tokens": 145, + "left_padding_tokens": 16, + "prompt_token_ids_sha256": "28a248f8e6baf3e910836ec1212882afd51ccef972a30d6306f604cd3fd10a10", + "generated_tokens": 355, + "generated_token_ids": [ + 2158, + 6983, + 565, + 245, + 1604, + 317, + 9966, + 11, + 395, + 933, + 276, + 2341, + 565, + 359, + 643, + 688, + 77625, + 750, + 853, + 207, + 16, + 285, + 3964, + 13, + 338, + 9966, + 1604, + 317, + 4218, + 372, + 245, + 1604, + 6146, + 853, + 207, + 16, + 344, + 643, + 642, + 4864, + 77625, + 750, + 853, + 207, + 16, + 285, + 3964, + 13, + 185, + 185, + 4898, + 6, + 82, + 254, + 9674, + 280, + 254, + 2030, + 262, + 62, + 6620, + 63, + 1157, + 25, + 185, + 185, + 10897, + 11338, + 185, + 1558, + 317, + 62, + 6620, + 7, + 77, + 1780, + 185, + 300, + 8066, + 8925, + 1927, + 565, + 245, + 2028, + 1604, + 317, + 9966, + 11, + 285, + 2526, + 6616, + 27823, + 185, + 300, + 1501, + 338, + 9966, + 1604, + 317, + 6146, + 853, + 207, + 16, + 185, + 300, + 565, + 291, + 10551, + 207, + 16, + 25, + 185, + 391, + 972, + 14687, + 185, + 300, + 1501, + 207, + 15, + 285, + 207, + 16, + 418, + 441, + 9966, + 185, + 300, + 565, + 291, + 10551, + 207, + 18, + 25, + 185, + 391, + 972, + 10491, + 185, + 300, + 1501, + 20263, + 2589, + 280, + 207, + 17, + 285, + 207, + 18, + 418, + 441, + 9966, + 185, + 300, + 565, + 291, + 3028, + 207, + 17, + 2318, + 207, + 15, + 410, + 291, + 3028, + 207, + 18, + 2318, + 207, + 15, + 25, + 185, + 391, + 972, + 14687, + 185, + 300, + 1501, + 7361, + 327, + 77625, + 473, + 207, + 20, + 276, + 254, + 7742, + 4343, + 280, + 291, + 185, + 300, + 460, + 403, + 207, + 20, + 185, + 300, + 1477, + 460, + 575, + 460, + 10551, + 291, + 25, + 185, + 391, + 565, + 291, + 3028, + 460, + 2318, + 207, + 15, + 410, + 291, + 3028, + 334, + 72, + 919, + 207, + 17, + 8, + 2318, + 207, + 15, + 25, + 185, + 595, + 972, + 14687, + 185, + 391, + 460, + 7324, + 207, + 21, + 185, + 300, + 972, + 10491, + 185, + 10897, + 185, + 185, + 1567, + 1157, + 1022, + 14180, + 565, + 254, + 1604, + 317, + 2246, + 853, + 410, + 5929, + 276, + 207, + 16, + 11, + 279, + 588, + 1460, + 359, + 317, + 441, + 9966, + 13, + 809, + 937, + 14180, + 565, + 254, + 1604, + 317, + 207, + 17, + 410, + 207, + 18, + 11, + 279, + 588, + 1460, + 359, + 317, + 9966, + 13, + 1494, + 5579, + 5750, + 11, + 359, + 14180, + 91971, + 3461, + 457, + 207, + 17, + 285, + 207, + 18, + 11, + 285, + 937, + 14180, + 327, + 2198, + 77625, + 5872, + 473, + 207, + 20, + 581, + 276, + 254, + 7742, + 4343, + 280, + 254, + 1604, + 13, + 1273, + 245, + 40875, + 317, + 1503, + 11, + 254, + 1157, + 7578, + 2030, + 13813, + 13557, + 1273, + 642, + 77625, + 418, + 1503, + 11, + 254, + 1157, + 7578, + 2030, + 8173, + 12181, + 18359, + 344, + 254, + 1604, + 317, + 9966, + 13, + 100001 + ], + "generated_token_ids_sha256": "f41032a4ec778feda5fc3818f94ddc41b5eb4f71172f4b0a220541bc692d49b4", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " To determine if a number is prime, we need to check if it has any divisors other than 1 and itself. A prime number is defined as a number greater than 1 that has no positive divisors other than 1 and itself.\n\nHere's the implementation of the `is_prime` function:\n\n```python\ndef is_prime(n):\n \"\"\"Return true if a given number is prime, and false otherwise.\"\"\"\n # A prime number is greater than 1\n if n <= 1:\n return False\n # 0 and 1 are not prime\n if n <= 3:\n return True\n # Multiples of 2 and 3 are not prime\n if n % 2 == 0 or n % 3 == 0:\n return False\n # Check for divisors from 5 to the square root of n\n i = 5\n while i * i <= n:\n if n % i == 0 or n % (i + 2) == 0:\n return False\n i += 6\n return True\n```\n\nThis function first checks if the number is less than or equal to 1, in which case it is not prime. It then checks if the number is 2 or 3, in which case it is prime. For larger numbers, it checks divisibility by 2 and 3, and then checks for possible divisors starting from 5 up to the square root of the number. If a divisor is found, the function returns `False`. If no divisors are found, the function returns `True`, indicating that the number is prime.", + "text_sha256": "de4736f67189b059194499a3bf15cc1bd75cb44c68285d47dbd8063b6603a451", + "task_score": { + "candidate_sha256": "122b3a6829e529fa11072d2109aeffa728fd53573b3abcdb94dd23259c740f93", + "python_ast_parse": true, + "parse_error": null, + "code_executed": false + } + }, + { + "condition": "s1_period", + "factors": { + "system": 1, + "history": "filler", + "boundary": "period", + "token_class": "ordinary_control" + }, + "prompt_tokens": 161, + "left_padding_tokens": 0, + "prompt_token_ids_sha256": "60e9d47943e9ba8869476dcc61e1a943b7e2dcf88d1d7334c44267baa5a8fd5f", + "generated_tokens": 59, + "generated_token_ids": [ + 977, + 317, + 62, + 6620, + 7, + 77, + 1780, + 185, + 300, + 565, + 291, + 459, + 207, + 17, + 25, + 185, + 391, + 972, + 14687, + 185, + 300, + 327, + 460, + 279, + 3169, + 7, + 17, + 11, + 1098, + 7, + 77, + 746, + 15, + 13, + 20, + 8, + 919, + 207, + 16, + 1780, + 185, + 391, + 565, + 291, + 3028, + 460, + 2318, + 207, + 15, + 25, + 185, + 595, + 972, + 14687, + 185, + 300, + 972, + 10491, + 100001 + ], + "generated_token_ids_sha256": "5cc9c902a87c82327d846c4c6298e61a9d3fddfa00127c92e699bc5bfc3e87ac", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " def is_prime(n):\n if n < 2:\n return False\n for i in range(2, int(n**0.5) + 1):\n if n % i == 0:\n return False\n return True", + "text_sha256": "a0f2b66062d9a781aed1e410e9263412406b1ecc6c3fb51a89e82c6d3022221a", + "task_score": { + "candidate_sha256": "28f166261950fa956e299a50872f539d490af163c1b0fb6d316d346fd7644685", + "python_ast_parse": true, + "parse_error": null, + "code_executed": false + } + } + ] + }, + { + "id": "HumanEval/44", + "domain": "code", + "label": "Python code", + "within_domain_index": 1, + "selection_rank": "030cfc7acc71ac4484d25020b2f340973c6cd1e20c2bdb1b3be9d532032eaa24", + "source_text_sha256": "70a0af759ec21f43ca0d40f7b7a3ec39e32388c9b5416fe06e5c658ce89e6666", + "source_characters": 299, + "source_tokens": 108, + "prompt_tokens_by_condition": { + "s0_eos": 133, + "s1_eos": 149, + "s0_bos": 133, + "s1_bos": 149, + "s0_x": 133, + "s1_x": 149, + "s0_period": 133, + "s1_period": 149 + }, + "batch_prompt_tokens_after_left_padding": 149, + "batch_padding_side": "left", + "batch_conditions": 8, + "generation_seconds": 123.00458187400363, + "peak_cuda_memory_allocated_bytes": 30840540672, + "generated_tokens_including_batch_padding": 4096, + "outputs": [ + { + "condition": "s0_eos", + "factors": { + "system": 0, + "history": "filler", + "boundary": "eos", + "token_class": "special" + }, + "prompt_tokens": 133, + "left_padding_tokens": 16, + "prompt_token_ids_sha256": "34636650c2d01d108c0812d19c1b7832fc580fe1251ae8d9fa905b5a0c3dc85b", + "generated_tokens": 512, + "generated_token_ids": [ + 2158, + 4353, + 254, + 2030, + 4874, + 62, + 4915, + 63, + 1157, + 11, + 395, + 933, + 276, + 5447, + 254, + 2028, + 10858, + 2030, + 87, + 63, + 473, + 895, + 1648, + 3252, + 276, + 254, + 7116, + 3252, + 13, + 1002, + 14431, + 2971, + 5610, + 25, + 185, + 185, + 16, + 13, + 23225, + 254, + 10858, + 276, + 245, + 2662, + 8346, + 279, + 895, + 1648, + 3252, + 13, + 185, + 17, + 13, + 63884, + 254, + 2662, + 276, + 11296, + 327, + 254, + 14049, + 276, + 254, + 761, + 3252, + 13, + 185, + 18, + 13, + 23225, + 254, + 34335, + 2662, + 276, + 254, + 761, + 3252, + 13, + 185, + 19, + 13, + 7898, + 254, + 2662, + 8346, + 279, + 254, + 761, + 3252, + 13, + 185, + 185, + 4898, + 6, + 82, + 254, + 9674, + 280, + 254, + 2030, + 4874, + 62, + 4915, + 63, + 1157, + 25, + 185, + 185, + 10897, + 11338, + 185, + 1558, + 2262, + 62, + 4915, + 7, + 87, + 25, + 1098, + 11, + 3252, + 25, + 1098, + 1780, + 185, + 300, + 8066, + 10792, + 12973, + 3252, + 280, + 2782, + 1604, + 1376, + 276, + 3252, + 13, + 185, + 300, + 972, + 2662, + 8346, + 1166, + 254, + 14049, + 13, + 185, + 300, + 3252, + 5750, + 418, + 2246, + 853, + 207, + 16, + 15, + 13, + 185, + 300, + 8066, + 185, + 300, + 1501, + 23225, + 254, + 10858, + 276, + 895, + 2662, + 8346, + 279, + 254, + 1648, + 3252, + 185, + 300, + 1648, + 62, + 4915, + 62, + 2017, + 403, + 15202, + 185, + 300, + 1477, + 1376, + 1879, + 207, + 15, + 25, + 185, + 391, + 1648, + 62, + 4915, + 62, + 2017, + 403, + 1406, + 7, + 87, + 3028, + 3252, + 8, + 919, + 1648, + 62, + 4915, + 62, + 2017, + 185, + 391, + 1376, + 403, + 1376, + 1071, + 3252, + 185, + 251, + 185, + 300, + 1501, + 63884, + 254, + 2662, + 276, + 11296, + 327, + 254, + 14049, + 276, + 254, + 761, + 3252, + 185, + 300, + 1648, + 62, + 4915, + 62, + 2017, + 403, + 1648, + 62, + 4915, + 62, + 2017, + 58, + 73879, + 16, + 60, + 185, + 251, + 185, + 300, + 1501, + 23225, + 254, + 34335, + 2662, + 276, + 254, + 761, + 3252, + 185, + 300, + 761, + 62, + 4915, + 62, + 2017, + 403, + 15202, + 185, + 300, + 327, + 20319, + 279, + 1648, + 62, + 4915, + 62, + 2017, + 25, + 185, + 391, + 1501, + 23225, + 1319, + 20319, + 276, + 895, + 2662, + 8346, + 279, + 254, + 761, + 3252, + 185, + 391, + 761, + 62, + 4915, + 62, + 2017, + 7324, + 1406, + 7, + 694, + 7, + 41557, + 8, + 570, + 4892, + 1504, + 15, + 2519, + 919, + 3252, + 8, + 185, + 251, + 185, + 300, + 972, + 761, + 62, + 4915, + 62, + 2017, + 185, + 185, + 2, + 6517, + 3863, + 185, + 4134, + 7, + 4874, + 62, + 4915, + 7, + 23, + 11, + 207, + 18, + 1509, + 207, + 1501, + 20154, + 25, + 655, + 17, + 17, + 6, + 185, + 4134, + 7, + 4874, + 62, + 4915, + 7, + 23, + 11, + 207, + 17, + 1509, + 207, + 1501, + 20154, + 25, + 655, + 16, + 15, + 15, + 15, + 6, + 185, + 4134, + 7, + 4874, + 62, + 4915, + 7, + 22, + 11, + 207, + 17, + 1509, + 207, + 1501, + 20154, + 25, + 655, + 16, + 16, + 16, + 6, + 185, + 10897, + 185, + 185, + 1567, + 1157, + 1022, + 37926, + 254, + 10858, + 276, + 895, + 2662, + 8346, + 279, + 254, + 1648, + 3252, + 11, + 937, + 94663, + 254, + 2662, + 11, + 285, + 6334, + 37926, + 1319, + 20319, + 276, + 895, + 5939, + 3199, + 279, + 254, + 761, + 3252, + 1244, + 254, + 48516, + 3039, + 280, + 254, + 7445, + 13, + 429, + 48516, + 3039, + 280, + 254, + 33325, + 279, + 3252, + 207, + 18, + 418, + 655, + 17, + 6, + 285, + 655, + 16, + 15, + 1185, + 285, + 279, + 3252, + 207, + 17, + 11, + 657, + 418, + 655, + 16, + 6, + 285, + 655, + 15, + 6767, + 429, + 2030, + 694, + 63, + 1157, + 317, + 1222, + 276, + 752, + 254, + 48516, + 1437, + 280, + 245, + 3199, + 11, + 285, + 2030, + 35293, + 63, + 317, + 1222, + 276, + 752, + 254, + 3199, + 5939, + 276, + 245, + 2028, + 48516, + 1437, + 13, + 100001 + ], + "generated_token_ids_sha256": "7cf70cc66d680d43ea005d9d811b6ca0e2d8c337441db9a6117e55998375c261", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " To implement the `change_base` function, we need to convert the given integer `x` from its current base to the specified base. This involves several steps:\n\n1. Convert the integer to a string representation in its current base.\n2. Reverse the string to prepare for the conversion to the new base.\n3. Convert the reversed string to the new base.\n4. Return the string representation in the new base.\n\nHere's the implementation of the `change_base` function:\n\n```python\ndef change_base(x: int, base: int):\n \"\"\"Change numerical base of input number x to base.\n return string representation after the conversion.\n base numbers are less than 10.\n \"\"\"\n # Convert the integer to its string representation in the current base\n current_base_str = \"\"\n while x > 0:\n current_base_str = str(x % base) + current_base_str\n x = x // base\n \n # Reverse the string to prepare for the conversion to the new base\n current_base_str = current_base_str[::-1]\n \n # Convert the reversed string to the new base\n new_base_str = \"\"\n for digit in current_base_str:\n # Convert each digit to its string representation in the new base\n new_base_str += str(ord(digit) - ord('0') + base)\n \n return new_base_str\n\n# Test cases\nprint(change_base(8, 3)) # Output: '22'\nprint(change_base(8, 2)) # Output: '1000'\nprint(change_base(7, 2)) # Output: '111'\n```\n\nThis function first converts the integer to its string representation in the current base, then reverses the string, and finally converts each digit to its corresponding character in the new base using the ASCII values of the characters. The ASCII values of the digits in base 3 are '2' and '10', and in base 2, they are '1' and '0'. The `ord` function is used to get the ASCII value of a character, and `chr` is used to get the character corresponding to a given ASCII value.", + "text_sha256": "9c22ba225c0285cd24f7234581add0236a3acef41be795108f3d26c6e173376d", + "task_score": { + "candidate_sha256": "dc070836ec6f006332215bf0b91ee2e87eb4bad0c1addae16af8e90cac647502", + "python_ast_parse": true, + "parse_error": null, + "code_executed": false + } + }, + { + "condition": "s1_eos", + "factors": { + "system": 1, + "history": "filler", + "boundary": "eos", + "token_class": "special" + }, + "prompt_tokens": 149, + "left_padding_tokens": 0, + "prompt_token_ids_sha256": "8064601979f18146c339c546016365833f2ca0d6c99b504906e55b54d5a4a7e4", + "generated_tokens": 512, + "generated_token_ids": [ + 2158, + 8708, + 437, + 2066, + 11, + 395, + 543, + 2606, + 245, + 1157, + 2030, + 4874, + 62, + 4915, + 63, + 344, + 4497, + 274, + 10858, + 2030, + 87, + 63, + 285, + 274, + 10858, + 2030, + 4915, + 63, + 372, + 2782, + 13, + 429, + 1157, + 543, + 5447, + 254, + 10858, + 2030, + 87, + 63, + 276, + 254, + 7116, + 3252, + 2030, + 4915, + 63, + 285, + 972, + 254, + 2662, + 8346, + 280, + 254, + 1604, + 13, + 185, + 185, + 4898, + 6, + 82, + 254, + 3956, + 276, + 4353, + 254, + 1157, + 25, + 185, + 185, + 16, + 13, + 23225, + 254, + 10858, + 2030, + 87, + 63, + 276, + 245, + 2662, + 276, + 6428, + 254, + 14049, + 1699, + 13, + 185, + 17, + 13, + 35914, + 274, + 7137, + 2662, + 2030, + 4260, + 63, + 276, + 4743, + 254, + 17045, + 1604, + 13, + 185, + 18, + 13, + 7305, + 245, + 7832, + 276, + 18598, + 2030, + 87, + 63, + 457, + 2030, + 4915, + 63, + 24271, + 2645, + 2030, + 87, + 63, + 6459, + 207, + 15, + 13, + 185, + 19, + 13, + 1494, + 1319, + 19762, + 11, + 11462, + 254, + 22821, + 754, + 2030, + 87, + 63, + 317, + 13429, + 457, + 2030, + 4915, + 63, + 285, + 5447, + 359, + 276, + 245, + 3199, + 1244, + 254, + 48516, + 3039, + 280, + 33325, + 279, + 3252, + 207, + 16, + 15, + 13, + 185, + 20, + 13, + 58313, + 254, + 3199, + 276, + 254, + 2030, + 4260, + 63, + 2662, + 13, + 185, + 21, + 13, + 4128, + 254, + 7832, + 11, + 565, + 2030, + 87, + 63, + 438, + 441, + 207, + 15, + 11, + 13471, + 254, + 3199, + 5939, + 276, + 2030, + 87, + 63, + 279, + 3252, + 207, + 16, + 15, + 276, + 254, + 2030, + 4260, + 63, + 2662, + 13, + 185, + 22, + 13, + 7898, + 254, + 2030, + 4260, + 63, + 2662, + 13, + 185, + 185, + 4388, + 11, + 1632, + 6, + 82, + 4353, + 254, + 2985, + 25, + 185, + 185, + 10897, + 11338, + 185, + 1558, + 2262, + 62, + 4915, + 7, + 87, + 25, + 1098, + 11, + 3252, + 25, + 1098, + 8, + 5052, + 1406, + 25, + 185, + 300, + 33325, + 403, + 440, + 15, + 16, + 17, + 18, + 19, + 20, + 21, + 22, + 23, + 24, + 37190, + 25672, + 1, + 207, + 1501, + 30482, + 254, + 33325, + 327, + 3252, + 207, + 16, + 15, + 185, + 300, + 1230, + 403, + 15202, + 207, + 1501, + 35914, + 254, + 1230, + 2662, + 185, + 251, + 185, + 300, + 1501, + 23225, + 1376, + 276, + 245, + 2662, + 276, + 6428, + 254, + 14049, + 1699, + 185, + 300, + 1376, + 62, + 2017, + 403, + 1406, + 7, + 87, + 8, + 185, + 251, + 185, + 300, + 1501, + 35044, + 2645, + 1376, + 6459, + 207, + 15, + 185, + 300, + 1477, + 1376, + 1879, + 207, + 15, + 25, + 185, + 391, + 1501, + 50586, + 254, + 22821, + 754, + 1376, + 317, + 13429, + 457, + 3252, + 185, + 391, + 22821, + 403, + 1376, + 3028, + 3252, + 185, + 391, + 1501, + 23225, + 254, + 22821, + 276, + 245, + 3199, + 1244, + 254, + 48516, + 3039, + 280, + 33325, + 279, + 3252, + 207, + 16, + 15, + 185, + 391, + 1230, + 403, + 33325, + 58, + 99914, + 60, + 919, + 1230, + 185, + 391, + 1501, + 13167, + 1376, + 276, + 254, + 10858, + 14103, + 280, + 1376, + 457, + 3252, + 185, + 391, + 1376, + 403, + 1376, + 1071, + 3252, + 185, + 251, + 185, + 300, + 1501, + 1273, + 1376, + 438, + 441, + 207, + 15, + 11, + 13471, + 254, + 3199, + 5939, + 276, + 1376, + 279, + 3252, + 207, + 16, + 15, + 185, + 300, + 565, + 1376, + 1879, + 207, + 15, + 25, + 185, + 391, + 1230, + 403, + 33325, + 58, + 87, + 60, + 919, + 1230, + 185, + 251, + 185, + 300, + 972, + 1230, + 185, + 185, + 2, + 6517, + 3863, + 185, + 4134, + 7, + 4874, + 62, + 4915, + 7, + 23, + 11, + 207, + 18, + 1509, + 207, + 1501, + 12816, + 972, + 655, + 17, + 17, + 6, + 185, + 4134, + 7, + 4874, + 62, + 4915, + 7, + 23, + 11, + 207, + 17, + 1509, + 207, + 1501, + 12816, + 972, + 655, + 16, + 15, + 15, + 15, + 6, + 185, + 4134, + 7, + 4874, + 62, + 4915, + 7, + 22, + 11, + 207 + ], + "generated_token_ids_sha256": "24a1ef7b3fb9a974c792a00ae9674339fa76d48fabe82dd0c9b03f152d06cb7f", + "hit_eos": false, + "stopped_at_max_new_tokens": true, + "text": " To solve this problem, we will create a function `change_base` that takes an integer `x` and an integer `base` as input. The function will convert the integer `x` to the specified base `base` and return the string representation of the number.\n\nHere's the approach to implement the function:\n\n1. Convert the integer `x` to a string to handle the conversion process.\n2. Initialize an empty string `result` to store the converted number.\n3. Use a loop to divide `x` by `base` repeatedly until `x` becomes 0.\n4. For each iteration, calculate the remainder when `x` is divided by `base` and convert it to a character using the ASCII values of digits in base 10.\n5. Append the character to the `result` string.\n6. After the loop, if `x` was not 0, append the character corresponding to `x` in base 10 to the `result` string.\n7. Return the `result` string.\n\nNow, let's implement the code:\n\n```python\ndef change_base(x: int, base: int) -> str:\n digits = \"0123456789ABCDEF\" # Define the digits for base 10\n result = \"\" # Initialize the result string\n \n # Convert x to a string to handle the conversion process\n x_str = str(x)\n \n # Loop until x becomes 0\n while x > 0:\n # Calculate the remainder when x is divided by base\n remainder = x % base\n # Convert the remainder to a character using the ASCII values of digits in base 10\n result = digits[remainder] + result\n # Update x to the integer division of x by base\n x = x // base\n \n # If x was not 0, append the character corresponding to x in base 10\n if x > 0:\n result = digits[x] + result\n \n return result\n\n# Test cases\nprint(change_base(8, 3)) # Should return '22'\nprint(change_base(8, 2)) # Should return '1000'\nprint(change_base(7, ", + "text_sha256": "272a7d878efe7ed9484fbd31a60add469176b59216c4cd3c0a7607e299a2297d", + "task_score": { + "candidate_sha256": "a6f290a53e824540f2910c28b470f955445899bade2145ae225e07fb8a8163a7", + "python_ast_parse": false, + "parse_error": { + "type": "SyntaxError", + "line": 3, + "offset": 5 + }, + "code_executed": false + } + }, + { + "condition": "s0_bos", + "factors": { + "system": 0, + "history": "filler", + "boundary": "bos", + "token_class": "special" + }, + "prompt_tokens": 133, + "left_padding_tokens": 16, + "prompt_token_ids_sha256": "a9677eeacfdaa69c7a1febf31256819301807a3737f96a980f4d4bfea0ba7ef9", + "generated_tokens": 331, + "generated_token_ids": [ + 2158, + 8708, + 437, + 2066, + 11, + 395, + 543, + 938, + 245, + 15777, + 276, + 3592, + 1319, + 20319, + 473, + 254, + 2782, + 1604, + 276, + 895, + 7613, + 279, + 254, + 3409, + 3252, + 13, + 1003, + 543, + 937, + 5447, + 254, + 2782, + 1604, + 276, + 254, + 3409, + 3252, + 457, + 24271, + 38176, + 359, + 457, + 254, + 3252, + 285, + 13471, + 272, + 254, + 22821, + 276, + 254, + 1230, + 13, + 185, + 185, + 4898, + 6, + 82, + 254, + 9674, + 280, + 254, + 2030, + 4874, + 62, + 4915, + 63, + 1157, + 25, + 185, + 185, + 10897, + 11338, + 185, + 1558, + 2262, + 62, + 4915, + 7, + 87, + 25, + 1098, + 11, + 3252, + 25, + 1098, + 8, + 5052, + 1406, + 25, + 185, + 300, + 1501, + 30482, + 245, + 15777, + 276, + 3592, + 1319, + 20319, + 276, + 895, + 7613, + 279, + 254, + 3409, + 3252, + 185, + 300, + 20319, + 62, + 4020, + 403, + 509, + 15, + 25, + 655, + 15, + 1185, + 207, + 16, + 25, + 655, + 16, + 1185, + 207, + 17, + 25, + 655, + 17, + 1185, + 207, + 18, + 25, + 655, + 18, + 1185, + 207, + 19, + 25, + 655, + 19, + 1185, + 207, + 20, + 25, + 655, + 20, + 1185, + 207, + 21, + 25, + 655, + 21, + 1185, + 207, + 22, + 25, + 655, + 22, + 1185, + 207, + 23, + 25, + 655, + 23, + 1185, + 207, + 24, + 25, + 655, + 24, + 14004, + 185, + 251, + 185, + 300, + 1501, + 23225, + 254, + 2782, + 1604, + 276, + 254, + 3409, + 3252, + 185, + 300, + 1230, + 403, + 15351, + 185, + 300, + 1477, + 1376, + 1879, + 207, + 15, + 25, + 185, + 391, + 1376, + 11, + 22821, + 403, + 2998, + 1794, + 7, + 87, + 11, + 3252, + 8, + 185, + 391, + 1230, + 403, + 20319, + 62, + 4020, + 58, + 99914, + 60, + 919, + 1230, + 185, + 251, + 185, + 300, + 972, + 1230, + 185, + 185, + 2, + 6517, + 3863, + 185, + 4134, + 7, + 4874, + 62, + 4915, + 7, + 23, + 11, + 207, + 18, + 1509, + 207, + 1501, + 20154, + 25, + 655, + 17, + 17, + 6, + 185, + 4134, + 7, + 4874, + 62, + 4915, + 7, + 23, + 11, + 207, + 17, + 1509, + 207, + 1501, + 20154, + 25, + 655, + 16, + 15, + 15, + 15, + 6, + 185, + 4134, + 7, + 4874, + 62, + 4915, + 7, + 22, + 11, + 207, + 17, + 1509, + 207, + 1501, + 20154, + 25, + 655, + 16, + 16, + 16, + 6, + 185, + 10897, + 185, + 185, + 1567, + 1157, + 543, + 5447, + 254, + 10858, + 2030, + 87, + 63, + 276, + 254, + 7116, + 3252, + 2030, + 4915, + 63, + 285, + 972, + 254, + 2662, + 8346, + 280, + 254, + 1604, + 279, + 344, + 3252, + 13, + 100001 + ], + "generated_token_ids_sha256": "c42b5e65f9c230397204050a125b166034365250cecb16b4590d3a15e991a0d6", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " To solve this problem, we will use a dictionary to map each digit from the input number to its equivalent in the target base. We will then convert the input number to the target base by repeatedly dividing it by the base and appending the remainder to the result.\n\nHere's the implementation of the `change_base` function:\n\n```python\ndef change_base(x: int, base: int) -> str:\n # Define a dictionary to map each digit to its equivalent in the target base\n digit_map = {0: '0', 1: '1', 2: '2', 3: '3', 4: '4', 5: '5', 6: '6', 7: '7', 8: '8', 9: '9'}\n \n # Convert the input number to the target base\n result = ''\n while x > 0:\n x, remainder = divmod(x, base)\n result = digit_map[remainder] + result\n \n return result\n\n# Test cases\nprint(change_base(8, 3)) # Output: '22'\nprint(change_base(8, 2)) # Output: '1000'\nprint(change_base(7, 2)) # Output: '111'\n```\n\nThis function will convert the integer `x` to the specified base `base` and return the string representation of the number in that base.", + "text_sha256": "8a1060f9a8cc1e60c2a2746ff1805437a7210ef0b09b6d095c6ff36de57013df", + "task_score": { + "candidate_sha256": "dcd020b020569fb69a8acf381a6fec51a2d468871005f54f883c2aefb4b43880", + "python_ast_parse": true, + "parse_error": null, + "code_executed": false + } + }, + { + "condition": "s1_bos", + "factors": { + "system": 1, + "history": "filler", + "boundary": "bos", + "token_class": "special" + }, + "prompt_tokens": 149, + "left_padding_tokens": 0, + "prompt_token_ids_sha256": "e1678df6379b9df385290d7b0feb2356a96ea6bd3190ba61d223e5742db049d8", + "generated_tokens": 408, + "generated_token_ids": [ + 2158, + 8708, + 437, + 2066, + 11, + 395, + 933, + 276, + 5447, + 254, + 2028, + 10858, + 2030, + 87, + 63, + 276, + 254, + 7116, + 3252, + 2030, + 4915, + 13557, + 4462, + 6, + 82, + 245, + 3458, + 12, + 1956, + 12, + 9215, + 3956, + 25, + 185, + 185, + 16, + 13, + 9217, + 26642, + 254, + 10858, + 276, + 254, + 761, + 3252, + 59668, + 1003, + 481, + 938, + 254, + 14103, + 285, + 40481, + 7772, + 276, + 5447, + 254, + 1604, + 13, + 429, + 22821, + 280, + 254, + 14103, + 457, + 2030, + 4915, + 63, + 4380, + 450, + 254, + 2754, + 4485, + 20319, + 334, + 43, + 6590, + 654, + 285, + 254, + 35160, + 280, + 254, + 14103, + 4380, + 450, + 254, + 2112, + 4485, + 20319, + 13, + 185, + 185, + 17, + 13, + 9217, + 11494, + 254, + 1230, + 2662, + 59668, + 1003, + 1330, + 457, + 29152, + 254, + 413, + 6590, + 279, + 254, + 1230, + 2662, + 13, + 2928, + 11, + 395, + 4883, + 437, + 1699, + 366, + 254, + 2112, + 35160, + 2645, + 254, + 35160, + 317, + 5858, + 13, + 185, + 185, + 18, + 13, + 9217, + 13203, + 5881, + 37201, + 59668, + 1273, + 254, + 35160, + 317, + 2246, + 853, + 2030, + 4915, + 12181, + 395, + 933, + 276, + 76222, + 37201, + 276, + 254, + 1230, + 2662, + 276, + 3291, + 254, + 33325, + 13, + 185, + 185, + 4898, + 6, + 82, + 254, + 9674, + 280, + 254, + 1157, + 25, + 185, + 185, + 10897, + 11338, + 185, + 1558, + 2262, + 62, + 4915, + 7, + 87, + 25, + 1098, + 11, + 3252, + 25, + 1098, + 8, + 5052, + 1406, + 25, + 185, + 300, + 565, + 1376, + 2318, + 207, + 15, + 25, + 185, + 391, + 972, + 655, + 15, + 6, + 185, + 251, + 185, + 300, + 1230, + 403, + 15351, + 185, + 300, + 1477, + 1376, + 1879, + 207, + 15, + 25, + 185, + 391, + 1501, + 50586, + 254, + 22821, + 276, + 752, + 254, + 413, + 6590, + 185, + 391, + 22821, + 403, + 1376, + 3028, + 3252, + 185, + 391, + 1501, + 23225, + 254, + 22821, + 276, + 245, + 3199, + 334, + 15, + 12, + 24, + 8, + 185, + 391, + 565, + 22821, + 1879, + 207, + 24, + 25, + 185, + 595, + 1230, + 403, + 76803, + 7, + 99914, + 570, + 207, + 16, + 15, + 919, + 4892, + 1504, + 32, + 14201, + 919, + 1230, + 185, + 391, + 1979, + 25, + 185, + 595, + 1230, + 403, + 1406, + 7, + 99914, + 8, + 919, + 1230, + 185, + 391, + 1501, + 36021, + 366, + 254, + 35160, + 185, + 391, + 1376, + 403, + 1376, + 1071, + 3252, + 185, + 251, + 185, + 300, + 972, + 1230, + 185, + 185, + 2, + 6517, + 3863, + 185, + 4134, + 7, + 4874, + 62, + 4915, + 7, + 23, + 11, + 207, + 18, + 1509, + 207, + 1501, + 20154, + 25, + 655, + 17, + 17, + 6, + 185, + 4134, + 7, + 4874, + 62, + 4915, + 7, + 23, + 11, + 207, + 17, + 1509, + 207, + 1501, + 20154, + 25, + 655, + 16, + 15, + 15, + 15, + 6, + 185, + 4134, + 7, + 4874, + 62, + 4915, + 7, + 22, + 11, + 207, + 17, + 1509, + 207, + 1501, + 20154, + 25, + 655, + 16, + 16, + 16, + 6, + 185, + 10897, + 185, + 185, + 1567, + 1157, + 1023, + 1132, + 9695, + 5447, + 254, + 3252, + 280, + 274, + 10858, + 285, + 972, + 254, + 2662, + 8346, + 279, + 254, + 761, + 3252, + 13, + 100001 + ], + "generated_token_ids_sha256": "262dbb91e952aa58c08d5dbf65b4048a388c263ed7b96cb5881e548b51787e3a", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " To solve this problem, we need to convert the given integer `x` to the specified base `base`. Here's a step-by-step approach:\n\n1. **Convert the integer to the new base**: We can use the division and modulo operations to convert the number. The remainder of the division by `base` gives us the least significant digit (LSD), and the quotient of the division gives us the next significant digit.\n\n2. **Build the result string**: We start by storing the LSD in the result string. Then, we continue this process with the next quotient until the quotient is zero.\n\n3. **Handle leading zeros**: If the quotient is less than `base`, we need to prepend zeros to the result string to fill the digits.\n\nHere's the implementation of the function:\n\n```python\ndef change_base(x: int, base: int) -> str:\n if x == 0:\n return '0'\n \n result = ''\n while x > 0:\n # Calculate the remainder to get the LSD\n remainder = x % base\n # Convert the remainder to a character (0-9)\n if remainder > 9:\n result = chr(remainder - 10 + ord('A')) + result\n else:\n result = str(remainder) + result\n # Continue with the quotient\n x = x // base\n \n return result\n\n# Test cases\nprint(change_base(8, 3)) # Output: '22'\nprint(change_base(8, 2)) # Output: '1000'\nprint(change_base(7, 2)) # Output: '111'\n```\n\nThis function should now correctly convert the base of an integer and return the string representation in the new base.", + "text_sha256": "ae074321557273e8ffe399092321f9cefbf8cdd1537e3c95c35bd2d6f5bcfb31", + "task_score": { + "candidate_sha256": "c19ed20142ba780b3ea83ecafce9521832613a119a6920e64ec53f7ef20636e1", + "python_ast_parse": true, + "parse_error": null, + "code_executed": false + } + }, + { + "condition": "s0_x", + "factors": { + "system": 0, + "history": "filler", + "boundary": "x", + "token_class": "ordinary_control" + }, + "prompt_tokens": 133, + "left_padding_tokens": 16, + "prompt_token_ids_sha256": "1a626851d1b4c79591f00401c8b96b6f6383c9930a5e50f7b5d4edd232c67c6b", + "generated_tokens": 351, + "generated_token_ids": [ + 2158, + 8708, + 437, + 2066, + 11, + 395, + 543, + 938, + 254, + 4930, + 12, + 246, + 2030, + 4166, + 46120, + 1157, + 279, + 12974, + 276, + 5447, + 254, + 1604, + 276, + 10038, + 11, + 2030, + 8430, + 46120, + 276, + 5447, + 276, + 21105, + 266, + 11, + 285, + 2030, + 27279, + 46120, + 276, + 5447, + 276, + 94073, + 13, + 1003, + 543, + 937, + 972, + 254, + 2662, + 8346, + 280, + 254, + 1604, + 279, + 254, + 7116, + 3252, + 13, + 185, + 185, + 4898, + 6, + 82, + 254, + 9674, + 280, + 254, + 1157, + 25, + 185, + 185, + 10897, + 11338, + 185, + 1558, + 2262, + 62, + 4915, + 7, + 87, + 25, + 1098, + 11, + 3252, + 25, + 1098, + 8, + 5052, + 1406, + 25, + 185, + 300, + 565, + 3252, + 459, + 207, + 17, + 25, + 185, + 391, + 972, + 15202, + 185, + 251, + 185, + 300, + 14049, + 62, + 20108, + 403, + 509, + 185, + 299, + 17, + 25, + 11289, + 11, + 185, + 299, + 23, + 25, + 38955, + 1376, + 25, + 21105, + 7, + 87, + 16046, + 17, + 2717, + 185, + 299, + 16, + 21, + 25, + 22161, + 185, + 300, + 615, + 185, + 251, + 185, + 300, + 14049, + 62, + 7307, + 403, + 14049, + 62, + 20108, + 13, + 708, + 7, + 4915, + 8, + 185, + 300, + 565, + 441, + 14049, + 62, + 7307, + 25, + 185, + 391, + 8476, + 47304, + 1198, + 7182, + 1534, + 330, + 1439, + 207, + 17, + 285, + 207, + 16, + 21, + 11, + 30340, + 2465, + 185, + 251, + 185, + 300, + 972, + 1406, + 7, + 53079, + 62, + 7307, + 7, + 87, + 1509, + 185, + 185, + 2, + 6517, + 3863, + 185, + 4134, + 7, + 4874, + 62, + 4915, + 7, + 23, + 11, + 207, + 18, + 1509, + 207, + 1501, + 20154, + 25, + 655, + 17, + 17, + 6, + 185, + 4134, + 7, + 4874, + 62, + 4915, + 7, + 23, + 11, + 207, + 17, + 1509, + 207, + 1501, + 20154, + 25, + 655, + 16, + 15, + 15, + 15, + 6, + 185, + 4134, + 7, + 4874, + 62, + 4915, + 7, + 22, + 11, + 207, + 17, + 1509, + 207, + 1501, + 20154, + 25, + 655, + 16, + 16, + 16, + 6, + 185, + 10897, + 185, + 185, + 1567, + 1157, + 1022, + 14180, + 565, + 254, + 3252, + 317, + 2246, + 853, + 207, + 17, + 11, + 279, + 588, + 1460, + 359, + 7578, + 274, + 7137, + 2662, + 1373, + 745, + 317, + 642, + 20878, + 1143, + 276, + 2564, + 245, + 1604, + 279, + 245, + 3252, + 2246, + 853, + 207, + 17, + 13, + 809, + 937, + 17227, + 245, + 15777, + 14237, + 19671, + 276, + 704, + 5939, + 14049, + 4908, + 13, + 429, + 1157, + 937, + 95278, + 254, + 14049, + 1157, + 327, + 254, + 7116, + 3252, + 285, + 14159, + 359, + 276, + 254, + 2782, + 1604, + 13, + 12226, + 11, + 359, + 37926, + 254, + 1230, + 276, + 245, + 2662, + 285, + 7578, + 359, + 13, + 100001 + ], + "generated_token_ids_sha256": "81cd37a3a3efecdd97028e9b942c113961da1dab48447c89d971bd79f686a4c8", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " To solve this problem, we will use the built-in `bin()` function in Python to convert the number to binary, `oct()` to convert to octal, and `hex()` to convert to hexadecimal. We will then return the string representation of the number in the specified base.\n\nHere's the implementation of the function:\n\n```python\ndef change_base(x: int, base: int) -> str:\n if base < 2:\n return \"\"\n \n conversion_functions = {\n 2: bin,\n 8: lambda x: oct(x)[2],\n 16: hex\n }\n \n conversion_func = conversion_functions.get(base)\n if not conversion_func:\n raise ValueError(\"Base must be between 2 and 16, inclusive\")\n \n return str(conversion_func(x))\n\n# Test cases\nprint(change_base(8, 3)) # Output: '22'\nprint(change_base(8, 2)) # Output: '1000'\nprint(change_base(7, 2)) # Output: '111'\n```\n\nThis function first checks if the base is less than 2, in which case it returns an empty string because there is no meaningful way to represent a number in a base less than 2. It then defines a dictionary mapping bases to their corresponding conversion functions. The function then retrieves the conversion function for the specified base and applies it to the input number. Finally, it converts the result to a string and returns it.", + "text_sha256": "e69bd7892ee0ba6739c377a3f923beb05bf277f5fbad92db0e53a743c8905a61", + "task_score": { + "candidate_sha256": "cd92908e60a99feb5c22bd8f4b2790f6f019272e2d0697f90e02ba9b9d8dbfe6", + "python_ast_parse": true, + "parse_error": null, + "code_executed": false + } + }, + { + "condition": "s1_x", + "factors": { + "system": 1, + "history": "filler", + "boundary": "x", + "token_class": "ordinary_control" + }, + "prompt_tokens": 149, + "left_padding_tokens": 0, + "prompt_token_ids_sha256": "56cc86c7774bd2a7f825e55fcbe97ab6f1970e570cdc993b8a1ee5ab606d859c", + "generated_tokens": 456, + "generated_token_ids": [ + 2158, + 8708, + 437, + 2066, + 11, + 395, + 933, + 276, + 5447, + 254, + 2028, + 10858, + 2030, + 87, + 63, + 473, + 895, + 1648, + 3252, + 276, + 254, + 7116, + 3252, + 2030, + 4915, + 13557, + 4462, + 6, + 82, + 245, + 3458, + 12, + 1956, + 12, + 9215, + 3956, + 25, + 185, + 185, + 16, + 13, + 9217, + 26642, + 254, + 1604, + 276, + 245, + 2662, + 59668, + 1003, + 1330, + 457, + 30833, + 254, + 10858, + 2030, + 87, + 63, + 276, + 245, + 2662, + 13, + 1002, + 317, + 1373, + 395, + 933, + 276, + 6428, + 1319, + 20319, + 24652, + 285, + 5447, + 768, + 276, + 254, + 761, + 3252, + 13, + 185, + 185, + 17, + 13, + 9217, + 14165, + 387, + 1184, + 254, + 2662, + 59668, + 1494, + 1319, + 20319, + 279, + 254, + 2662, + 8346, + 280, + 2030, + 87, + 12181, + 395, + 5447, + 359, + 276, + 254, + 761, + 3252, + 13, + 185, + 185, + 18, + 13, + 9217, + 26642, + 1319, + 20319, + 276, + 254, + 761, + 3252, + 59668, + 1494, + 1319, + 20319, + 11, + 395, + 5447, + 359, + 276, + 254, + 761, + 3252, + 457, + 24271, + 38176, + 457, + 2030, + 4915, + 63, + 285, + 8435, + 4184, + 280, + 254, + 22821, + 13, + 429, + 22821, + 317, + 937, + 17045, + 276, + 254, + 5939, + 3199, + 279, + 254, + 761, + 3252, + 13, + 185, + 185, + 19, + 13, + 9217, + 11494, + 254, + 1230, + 2662, + 59668, + 1003, + 2297, + 254, + 1230, + 2662, + 457, + 29500, + 1130, + 254, + 7445, + 5340, + 473, + 1319, + 20319, + 13, + 185, + 185, + 20, + 13, + 9217, + 13203, + 5881, + 37201, + 59668, + 1273, + 254, + 17045, + 20319, + 317, + 2246, + 853, + 2030, + 4915, + 12181, + 395, + 76222, + 359, + 366, + 37201, + 276, + 5462, + 359, + 643, + 254, + 2918, + 3973, + 279, + 254, + 761, + 3252, + 13, + 185, + 185, + 4898, + 6, + 82, + 254, + 9674, + 280, + 254, + 1157, + 25, + 185, + 185, + 10897, + 11338, + 185, + 1558, + 2262, + 62, + 4915, + 7, + 87, + 25, + 1098, + 11, + 3252, + 25, + 1098, + 8, + 5052, + 1406, + 25, + 185, + 300, + 1501, + 23225, + 254, + 1604, + 276, + 245, + 2662, + 185, + 300, + 1183, + 62, + 2017, + 403, + 1406, + 7, + 87, + 8, + 185, + 300, + 1230, + 403, + 9636, + 185, + 251, + 185, + 300, + 1501, + 30068, + 387, + 1184, + 1319, + 20319, + 185, + 300, + 327, + 1563, + 279, + 1183, + 62, + 2017, + 25, + 185, + 391, + 1501, + 23225, + 1319, + 20319, + 276, + 254, + 761, + 3252, + 185, + 391, + 20319, + 403, + 1098, + 7, + 5902, + 8, + 185, + 391, + 1477, + 20319, + 1879, + 207, + 15, + 25, + 185, + 595, + 1230, + 13, + 6880, + 7, + 2017, + 7, + 41557, + 3028, + 3252, + 1509, + 185, + 595, + 20319, + 1071, + 28, + 3252, + 185, + 251, + 185, + 300, + 1501, + 63884, + 254, + 1230, + 276, + 752, + 254, + 2918, + 1835, + 185, + 300, + 972, + 655, + 6767, + 11557, + 7, + 4260, + 58, + 73879, + 16, + 5855, + 185, + 185, + 2, + 6517, + 3863, + 185, + 4134, + 7, + 4874, + 62, + 4915, + 7, + 23, + 11, + 207, + 18, + 1509, + 207, + 1501, + 20154, + 25, + 655, + 17, + 17, + 6, + 185, + 4134, + 7, + 4874, + 62, + 4915, + 7, + 23, + 11, + 207, + 17, + 1509, + 207, + 1501, + 20154, + 25, + 655, + 16, + 15, + 15, + 15, + 6, + 185, + 4134, + 7, + 4874, + 62, + 4915, + 7, + 22, + 11, + 207, + 17, + 1509, + 207, + 1501, + 20154, + 25, + 655, + 16, + 16, + 16, + 6, + 185, + 10897, + 185, + 185, + 1567, + 1157, + 1023, + 830, + 9695, + 327, + 254, + 4286, + 1727, + 3863, + 285, + 688, + 750, + 4640, + 2782, + 13, + 100001 + ], + "generated_token_ids_sha256": "122f420b674dcb35e9d36dd142b92e97bb8a60cea7a643d504589e3ebefb1629", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " To solve this problem, we need to convert the given integer `x` from its current base to the specified base `base`. Here's a step-by-step approach:\n\n1. **Convert the number to a string**: We start by converting the integer `x` to a string. This is because we need to handle each digit individually and convert them to the new base.\n\n2. **Iterate through the string**: For each digit in the string representation of `x`, we convert it to the new base.\n\n3. **Convert each digit to the new base**: For each digit, we convert it to the new base by repeatedly dividing by `base` and keeping track of the remainder. The remainder is then converted to the corresponding character in the new base.\n\n4. **Build the result string**: We build the result string by concatenating the characters obtained from each digit.\n\n5. **Handle leading zeros**: If the converted digit is less than `base`, we prepend it with zeros to ensure it has the correct length in the new base.\n\nHere's the implementation of the function:\n\n```python\ndef change_base(x: int, base: int) -> str:\n # Convert the number to a string\n num_str = str(x)\n result = []\n \n # Iterate through each digit\n for char in num_str:\n # Convert each digit to the new base\n digit = int(char)\n while digit > 0:\n result.append(str(digit % base))\n digit //= base\n \n # Reverse the result to get the correct order\n return ''.join(result[::-1])\n\n# Test cases\nprint(change_base(8, 3)) # Output: '22'\nprint(change_base(8, 2)) # Output: '1000'\nprint(change_base(7, 2)) # Output: '111'\n```\n\nThis function should work correctly for the provided test cases and any other valid input.", + "text_sha256": "7c464bf9f2af8882b9d1ab73a28c11ffc1928e54c893dae173ff298cc2d8ec85", + "task_score": { + "candidate_sha256": "c4f9301b787b076744851b04f39c216fc321fba92dc96783e9a257803ba755c8", + "python_ast_parse": true, + "parse_error": null, + "code_executed": false + } + }, + { + "condition": "s0_period", + "factors": { + "system": 0, + "history": "filler", + "boundary": "period", + "token_class": "ordinary_control" + }, + "prompt_tokens": 133, + "left_padding_tokens": 16, + "prompt_token_ids_sha256": "e71413377a91a13f6e6add6206927e67c2f744738c6124a22048f67a2fb45266", + "generated_tokens": 363, + "generated_token_ids": [ + 2158, + 8708, + 437, + 2066, + 11, + 395, + 543, + 938, + 254, + 4930, + 12, + 246, + 2030, + 4166, + 46120, + 1157, + 279, + 12974, + 276, + 5447, + 254, + 1604, + 276, + 10038, + 11, + 2030, + 8430, + 46120, + 276, + 5447, + 276, + 21105, + 266, + 11, + 285, + 2030, + 27279, + 46120, + 276, + 5447, + 276, + 94073, + 13, + 1003, + 543, + 937, + 972, + 254, + 2662, + 8346, + 280, + 254, + 1604, + 279, + 254, + 7116, + 3252, + 13, + 185, + 185, + 4898, + 6, + 82, + 254, + 9674, + 280, + 254, + 1157, + 25, + 185, + 185, + 10897, + 11338, + 185, + 1558, + 2262, + 62, + 4915, + 7, + 87, + 25, + 1098, + 11, + 3252, + 25, + 1098, + 8, + 5052, + 1406, + 25, + 185, + 300, + 565, + 3252, + 459, + 207, + 17, + 25, + 185, + 391, + 972, + 15202, + 185, + 251, + 185, + 300, + 14049, + 62, + 20108, + 403, + 509, + 185, + 299, + 17, + 25, + 11289, + 11, + 185, + 299, + 23, + 25, + 38955, + 1376, + 25, + 21105, + 7, + 87, + 16046, + 17, + 2717, + 185, + 299, + 16, + 21, + 25, + 22161, + 185, + 300, + 615, + 185, + 251, + 185, + 300, + 14049, + 62, + 7307, + 403, + 14049, + 62, + 20108, + 13, + 708, + 7, + 4915, + 8, + 185, + 300, + 565, + 441, + 14049, + 62, + 7307, + 25, + 185, + 391, + 8476, + 47304, + 1198, + 7182, + 1534, + 330, + 1439, + 207, + 17, + 285, + 207, + 16, + 21, + 2465, + 185, + 251, + 185, + 300, + 972, + 1406, + 7, + 53079, + 62, + 7307, + 7, + 87, + 1509, + 185, + 185, + 2, + 6517, + 3863, + 185, + 4134, + 7, + 4874, + 62, + 4915, + 7, + 23, + 11, + 207, + 18, + 1509, + 207, + 1501, + 12816, + 972, + 655, + 17, + 17, + 6, + 185, + 4134, + 7, + 4874, + 62, + 4915, + 7, + 23, + 11, + 207, + 17, + 1509, + 207, + 1501, + 12816, + 972, + 655, + 16, + 15, + 15, + 15, + 6, + 185, + 4134, + 7, + 4874, + 62, + 4915, + 7, + 22, + 11, + 207, + 17, + 1509, + 207, + 1501, + 12816, + 972, + 655, + 16, + 16, + 16, + 6, + 185, + 10897, + 185, + 185, + 1567, + 1157, + 1022, + 14180, + 565, + 254, + 3252, + 317, + 2246, + 853, + 207, + 17, + 11, + 279, + 588, + 1460, + 359, + 7578, + 274, + 7137, + 2662, + 1373, + 745, + 317, + 642, + 20878, + 1143, + 276, + 2564, + 245, + 1604, + 279, + 245, + 3252, + 2246, + 853, + 207, + 17, + 13, + 809, + 937, + 17227, + 245, + 15777, + 344, + 9831, + 1319, + 4640, + 3252, + 276, + 254, + 6854, + 14049, + 1157, + 13, + 429, + 2030, + 708, + 63, + 2052, + 317, + 1222, + 276, + 24087, + 254, + 14049, + 1157, + 327, + 254, + 7116, + 3252, + 13, + 12226, + 11, + 254, + 14049, + 1157, + 317, + 2424, + 366, + 254, + 2782, + 1604, + 2030, + 87, + 12181, + 285, + 254, + 1230, + 317, + 17045, + 276, + 245, + 2662, + 1323, + 1435, + 5651, + 13, + 100001 + ], + "generated_token_ids_sha256": "53675bd86ddc0e186ca629e3280bc1b8f2d96245572a113930326ef522ef5137", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " To solve this problem, we will use the built-in `bin()` function in Python to convert the number to binary, `oct()` to convert to octal, and `hex()` to convert to hexadecimal. We will then return the string representation of the number in the specified base.\n\nHere's the implementation of the function:\n\n```python\ndef change_base(x: int, base: int) -> str:\n if base < 2:\n return \"\"\n \n conversion_functions = {\n 2: bin,\n 8: lambda x: oct(x)[2],\n 16: hex\n }\n \n conversion_func = conversion_functions.get(base)\n if not conversion_func:\n raise ValueError(\"Base must be between 2 and 16\")\n \n return str(conversion_func(x))\n\n# Test cases\nprint(change_base(8, 3)) # Should return '22'\nprint(change_base(8, 2)) # Should return '1000'\nprint(change_base(7, 2)) # Should return '111'\n```\n\nThis function first checks if the base is less than 2, in which case it returns an empty string because there is no meaningful way to represent a number in a base less than 2. It then defines a dictionary that maps each valid base to the appropriate conversion function. The `get` method is used to retrieve the conversion function for the specified base. Finally, the conversion function is called with the input number `x`, and the result is converted to a string before being returned.", + "text_sha256": "ec3b54d902a4aef184083f161da935a5331579ee69469ba765dcaca6f2ddbb80", + "task_score": { + "candidate_sha256": "cba9c698349b69f75d2ada5e2b47a36dfd07fb13152c1d4a0183b3db321ea1f3", + "python_ast_parse": true, + "parse_error": null, + "code_executed": false + } + }, + { + "condition": "s1_period", + "factors": { + "system": 1, + "history": "filler", + "boundary": "period", + "token_class": "ordinary_control" + }, + "prompt_tokens": 149, + "left_padding_tokens": 0, + "prompt_token_ids_sha256": "4a47efad70aed38e5a3f4ec519584f08d4e9cd89a12fbc9ee9b1f1ee206a651b", + "generated_tokens": 162, + "generated_token_ids": [ + 977, + 2262, + 62, + 4915, + 7, + 87, + 25, + 1098, + 11, + 3252, + 25, + 1098, + 1780, + 185, + 300, + 565, + 3252, + 459, + 207, + 17, + 25, + 185, + 391, + 8476, + 47304, + 1198, + 7182, + 1534, + 330, + 430, + 2754, + 207, + 17, + 2465, + 185, + 251, + 185, + 300, + 33325, + 403, + 440, + 15, + 16, + 17, + 18, + 19, + 20, + 21, + 22, + 23, + 24, + 37190, + 25672, + 1, + 185, + 300, + 1230, + 403, + 15202, + 185, + 251, + 185, + 300, + 1477, + 1376, + 1879, + 207, + 15, + 25, + 185, + 391, + 1230, + 403, + 33325, + 58, + 87, + 3028, + 3252, + 60, + 919, + 1230, + 185, + 391, + 1376, + 1071, + 28, + 3252, + 185, + 251, + 185, + 300, + 972, + 1230, + 185, + 185, + 2, + 6517, + 3863, + 185, + 4134, + 7, + 4874, + 62, + 4915, + 7, + 23, + 11, + 207, + 18, + 1509, + 207, + 1501, + 20154, + 25, + 655, + 17, + 17, + 6, + 185, + 4134, + 7, + 4874, + 62, + 4915, + 7, + 23, + 11, + 207, + 17, + 1509, + 207, + 1501, + 20154, + 25, + 655, + 16, + 15, + 15, + 15, + 6, + 185, + 4134, + 7, + 4874, + 62, + 4915, + 7, + 22, + 11, + 207, + 17, + 1509, + 207, + 1501, + 20154, + 25, + 655, + 16, + 16, + 16, + 6, + 100001 + ], + "generated_token_ids_sha256": "1cc1c58f189ba6c70095114475bfe0f04052cd53d10861328fe3e2f38dcf6081", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " def change_base(x: int, base: int):\n if base < 2:\n raise ValueError(\"Base must be at least 2\")\n \n digits = \"0123456789ABCDEF\"\n result = \"\"\n \n while x > 0:\n result = digits[x % base] + result\n x //= base\n \n return result\n\n# Test cases\nprint(change_base(8, 3)) # Output: '22'\nprint(change_base(8, 2)) # Output: '1000'\nprint(change_base(7, 2)) # Output: '111'", + "text_sha256": "6106b51d81a144e29cde25414fbe97ec08bd01731839b5b1ca5e467c32ef923f", + "task_score": { + "candidate_sha256": "8fcd50f214cb73f5396f66780d535a14b9097e95bbaa75656faa3528df34a7d3", + "python_ast_parse": true, + "parse_error": null, + "code_executed": false + } + } + ] + }, + { + "id": "HumanEval/133", + "domain": "code", + "label": "Python code", + "within_domain_index": 2, + "selection_rank": "03661faa70d0db8ba0c1d391356f9c7cdb8f50ccbeedc0911f6b2a3be0190ed3", + "source_text_sha256": "8c46f1b09d1a8179497c272a2597766eb2a53fbd00cb8cdd8a8446e547103a13", + "source_characters": 466, + "source_tokens": 166, + "prompt_tokens_by_condition": { + "s0_eos": 191, + "s1_eos": 207, + "s0_bos": 191, + "s1_bos": 207, + "s0_x": 191, + "s1_x": 207, + "s0_period": 191, + "s1_period": 207 + }, + "batch_prompt_tokens_after_left_padding": 207, + "batch_padding_side": "left", + "batch_conditions": 8, + "generation_seconds": 95.69674395100446, + "peak_cuda_memory_allocated_bytes": 30672452096, + "generated_tokens_including_batch_padding": 3328, + "outputs": [ + { + "condition": "s0_eos", + "factors": { + "system": 0, + "history": "filler", + "boundary": "eos", + "token_class": "special" + }, + "prompt_tokens": 191, + "left_padding_tokens": 16, + "prompt_token_ids_sha256": "7b84065a1b5a2ed75dc3a7b4946b265f6ddc8294e89dfc581c7da9b0cc5a938c", + "generated_tokens": 391, + "generated_token_ids": [ + 2158, + 8708, + 254, + 2066, + 11, + 395, + 933, + 276, + 1181, + 1069, + 5610, + 25, + 185, + 185, + 16, + 13, + 23243, + 1319, + 3699, + 279, + 254, + 1525, + 276, + 254, + 6909, + 1098, + 7, + 43124, + 5969, + 633, + 185, + 17, + 13, + 18768, + 1319, + 3699, + 279, + 254, + 1525, + 13, + 185, + 18, + 13, + 9142, + 521, + 254, + 37160, + 4899, + 13, + 185, + 19, + 13, + 7898, + 254, + 2555, + 13, + 185, + 185, + 4898, + 6, + 82, + 254, + 9674, + 280, + 254, + 2030, + 1805, + 62, + 72582, + 63, + 1157, + 25, + 185, + 185, + 10897, + 11338, + 185, + 1901, + 16145, + 185, + 185, + 1558, + 2555, + 62, + 72582, + 7, + 32808, + 1780, + 185, + 300, + 1501, + 10925, + 207, + 16, + 25, + 23243, + 1319, + 3699, + 276, + 254, + 6909, + 1098, + 7, + 43124, + 5969, + 8, + 185, + 300, + 27840, + 62, + 2502, + 403, + 825, + 664, + 13, + 26158, + 7, + 87, + 8, + 327, + 1376, + 279, + 90373, + 60, + 185, + 251, + 185, + 300, + 1501, + 10925, + 207, + 17, + 25, + 18768, + 1319, + 3699, + 185, + 300, + 37160, + 62, + 2502, + 403, + 825, + 87, + 9217, + 207, + 17, + 327, + 1376, + 279, + 27840, + 62, + 2502, + 60, + 185, + 251, + 185, + 300, + 1501, + 10925, + 207, + 18, + 25, + 9142, + 521, + 254, + 37160, + 4899, + 185, + 300, + 2555, + 62, + 994, + 62, + 72582, + 403, + 2555, + 7, + 76798, + 62, + 2502, + 8, + 185, + 251, + 185, + 300, + 1501, + 10925, + 207, + 19, + 25, + 7898, + 254, + 2555, + 185, + 300, + 972, + 2555, + 62, + 994, + 62, + 72582, + 185, + 185, + 2, + 18460, + 8175, + 25, + 185, + 4134, + 7, + 1805, + 62, + 72582, + 9244, + 16, + 11, + 207, + 17, + 11, + 207, + 18, + 26034, + 207, + 1501, + 20154, + 25, + 207, + 16, + 19, + 185, + 4134, + 7, + 1805, + 62, + 72582, + 9244, + 16, + 11, + 207, + 19, + 11, + 207, + 24, + 26034, + 207, + 1501, + 20154, + 25, + 207, + 24, + 23, + 185, + 4134, + 7, + 1805, + 62, + 72582, + 9244, + 16, + 11, + 207, + 18, + 11, + 207, + 20, + 11, + 207, + 22, + 26034, + 207, + 1501, + 20154, + 25, + 207, + 23, + 19, + 185, + 4134, + 7, + 1805, + 62, + 72582, + 9244, + 16, + 13, + 19, + 11, + 207, + 19, + 13, + 17, + 11, + 207, + 15, + 26034, + 207, + 1501, + 20154, + 25, + 207, + 17, + 24, + 185, + 4134, + 7, + 1805, + 62, + 72582, + 9244, + 12, + 17, + 13, + 19, + 11, + 207, + 16, + 11, + 207, + 16, + 26034, + 207, + 1501, + 20154, + 25, + 207, + 21, + 185, + 10897, + 185, + 185, + 1567, + 1157, + 5131, + 245, + 1525, + 46950, + 276, + 2111, + 1319, + 3458, + 19662, + 13, + 429, + 2030, + 664, + 13, + 26158, + 46120, + 1157, + 317, + 1222, + 276, + 4078, + 1319, + 3699, + 276, + 254, + 2112, + 10858, + 6146, + 853, + 410, + 5929, + 276, + 254, + 3632, + 1437, + 13, + 2928, + 11, + 1319, + 3699, + 317, + 37160, + 11, + 285, + 6334, + 11, + 254, + 2555, + 280, + 521, + 37160, + 4899, + 317, + 10711, + 285, + 5651, + 13, + 100001 + ], + "generated_token_ids_sha256": "00d8c9083f6292736b3e0bc592529edcca422b65e01fd5b754bf5de3adfc4bd4", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " To solve the problem, we need to follow these steps:\n\n1. Round each element in the list to the upper int(Ceiling).\n2. Square each element in the list.\n3. Sum all the squared elements.\n4. Return the sum.\n\nHere's the implementation of the `sum_squares` function:\n\n```python\nimport math\n\ndef sum_squares(lst):\n # Step 1: Round each element to the upper int(Ceiling)\n rounded_list = [math.ceil(x) for x in lst]\n \n # Step 2: Square each element\n squared_list = [x ** 2 for x in rounded_list]\n \n # Step 3: Sum all the squared elements\n sum_of_squares = sum(squared_list)\n \n # Step 4: Return the sum\n return sum_of_squares\n\n# Example usage:\nprint(sum_squares([1, 2, 3])) # Output: 14\nprint(sum_squares([1, 4, 9])) # Output: 98\nprint(sum_squares([1, 3, 5, 7])) # Output: 84\nprint(sum_squares([1.4, 4.2, 0])) # Output: 29\nprint(sum_squares([-2.4, 1, 1])) # Output: 6\n```\n\nThis function uses a list comprehension to perform each step efficiently. The `math.ceil()` function is used to round each element to the next integer greater than or equal to the original value. Then, each element is squared, and finally, the sum of all squared elements is calculated and returned.", + "text_sha256": "2d0ade27b1f645b083197638d387de4d7ce9c8a29912535e9847ef2e03099177", + "task_score": { + "candidate_sha256": "063c560631d9f3a0c1c2dda3ac8a138961b7049c3b5234ab042357c01185672d", + "python_ast_parse": true, + "parse_error": null, + "code_executed": false + } + }, + { + "condition": "s1_eos", + "factors": { + "system": 1, + "history": "filler", + "boundary": "eos", + "token_class": "special" + }, + "prompt_tokens": 207, + "left_padding_tokens": 0, + "prompt_token_ids_sha256": "e4276f9ff4296a6c846b43bbc3fa2221ec810ffd93bb6b2222e1f3a3228422a0", + "generated_tokens": 416, + "generated_token_ids": [ + 2158, + 8708, + 437, + 2066, + 11, + 395, + 933, + 276, + 1181, + 1069, + 5610, + 25, + 185, + 185, + 16, + 13, + 23225, + 1319, + 3699, + 279, + 254, + 1525, + 276, + 895, + 9530, + 1437, + 334, + 580, + 5462, + 395, + 2225, + 6640, + 5750, + 372, + 4864, + 327, + 254, + 2555, + 633, + 185, + 17, + 13, + 23243, + 1319, + 3699, + 276, + 254, + 2112, + 10858, + 6146, + 853, + 410, + 5929, + 276, + 254, + 3632, + 1437, + 1244, + 254, + 2030, + 664, + 13, + 26158, + 46120, + 1157, + 13, + 185, + 18, + 13, + 18768, + 1319, + 3699, + 13, + 185, + 19, + 13, + 9142, + 521, + 254, + 37160, + 4899, + 13, + 185, + 20, + 13, + 23243, + 254, + 2555, + 276, + 254, + 17016, + 10858, + 1244, + 2030, + 1036, + 46120, + 410, + 2030, + 664, + 13, + 26158, + 826, + 13557, + 185, + 185, + 4898, + 6, + 82, + 254, + 9674, + 280, + 254, + 2030, + 1805, + 62, + 72582, + 63, + 1157, + 25, + 185, + 185, + 10897, + 11338, + 185, + 1901, + 16145, + 185, + 185, + 1558, + 2555, + 62, + 72582, + 7, + 32808, + 1780, + 185, + 300, + 1501, + 23225, + 1319, + 3699, + 276, + 895, + 9530, + 1437, + 185, + 300, + 90373, + 403, + 825, + 5385, + 7, + 87, + 8, + 327, + 1376, + 279, + 90373, + 60, + 185, + 251, + 185, + 300, + 1501, + 23243, + 1319, + 3699, + 276, + 254, + 2112, + 10858, + 6146, + 853, + 410, + 5929, + 276, + 254, + 3632, + 1437, + 185, + 300, + 90373, + 403, + 825, + 664, + 13, + 26158, + 7, + 87, + 8, + 327, + 1376, + 279, + 90373, + 60, + 185, + 251, + 185, + 300, + 1501, + 18768, + 1319, + 3699, + 185, + 300, + 90373, + 403, + 825, + 87, + 746, + 17, + 327, + 1376, + 279, + 90373, + 60, + 185, + 251, + 185, + 300, + 1501, + 9142, + 521, + 254, + 37160, + 4899, + 185, + 300, + 3223, + 62, + 1805, + 403, + 2555, + 7, + 32808, + 8, + 185, + 251, + 185, + 300, + 1501, + 23243, + 254, + 2555, + 276, + 254, + 17016, + 10858, + 185, + 300, + 3223, + 62, + 1805, + 403, + 4078, + 7, + 11666, + 62, + 1805, + 8, + 185, + 251, + 185, + 300, + 972, + 3223, + 62, + 1805, + 185, + 185, + 2, + 6517, + 3863, + 185, + 4134, + 7, + 1805, + 62, + 72582, + 9244, + 16, + 11, + 207, + 17, + 11, + 207, + 18, + 26034, + 207, + 1501, + 20154, + 25, + 207, + 16, + 19, + 185, + 4134, + 7, + 1805, + 62, + 72582, + 9244, + 16, + 11, + 207, + 19, + 11, + 207, + 24, + 26034, + 207, + 1501, + 20154, + 25, + 207, + 24, + 23, + 185, + 4134, + 7, + 1805, + 62, + 72582, + 9244, + 16, + 11, + 207, + 18, + 11, + 207, + 20, + 11, + 207, + 22, + 26034, + 207, + 1501, + 20154, + 25, + 207, + 23, + 19, + 185, + 4134, + 7, + 1805, + 62, + 72582, + 9244, + 16, + 13, + 19, + 11, + 207, + 19, + 13, + 17, + 11, + 207, + 15, + 26034, + 207, + 1501, + 20154, + 25, + 207, + 17, + 24, + 185, + 4134, + 7, + 1805, + 62, + 72582, + 9244, + 12, + 17, + 13, + 19, + 11, + 207, + 16, + 11, + 207, + 16, + 26034, + 207, + 1501, + 20154, + 25, + 207, + 21, + 185, + 10897, + 185, + 185, + 1567, + 2985, + 543, + 9695, + 11462, + 254, + 2555, + 280, + 254, + 26532, + 280, + 254, + 27840, + 5750, + 279, + 254, + 2028, + 1525, + 13, + 100001 + ], + "generated_token_ids_sha256": "19e068e791cc684b5ac5de77217c7e3b25a95bc11a4e3e54ec3215d92d90327b", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " To solve this problem, we need to follow these steps:\n\n1. Convert each element in the list to its absolute value (to ensure we consider negative numbers as positive for the sum).\n2. Round each element to the next integer greater than or equal to the original value using the `math.ceil()` function.\n3. Square each element.\n4. Sum all the squared elements.\n5. Round the sum to the nearest integer using `round()` or `math.ceil()`.\n\nHere's the implementation of the `sum_squares` function:\n\n```python\nimport math\n\ndef sum_squares(lst):\n # Convert each element to its absolute value\n lst = [abs(x) for x in lst]\n \n # Round each element to the next integer greater than or equal to the original value\n lst = [math.ceil(x) for x in lst]\n \n # Square each element\n lst = [x**2 for x in lst]\n \n # Sum all the squared elements\n total_sum = sum(lst)\n \n # Round the sum to the nearest integer\n total_sum = round(total_sum)\n \n return total_sum\n\n# Test cases\nprint(sum_squares([1, 2, 3])) # Output: 14\nprint(sum_squares([1, 4, 9])) # Output: 98\nprint(sum_squares([1, 3, 5, 7])) # Output: 84\nprint(sum_squares([1.4, 4.2, 0])) # Output: 29\nprint(sum_squares([-2.4, 1, 1])) # Output: 6\n```\n\nThis code will correctly calculate the sum of the squares of the rounded numbers in the given list.", + "text_sha256": "837e0a1eb75d96deb472ca3c494837a97c26350dbadb4f9a8ee5eca18c559fd2", + "task_score": { + "candidate_sha256": "43181722452490fe6bfa0addba5498d854915ccbe6d88d45c98438fc26345407", + "python_ast_parse": true, + "parse_error": null, + "code_executed": false + } + }, + { + "condition": "s0_bos", + "factors": { + "system": 0, + "history": "filler", + "boundary": "bos", + "token_class": "special" + }, + "prompt_tokens": 191, + "left_padding_tokens": 16, + "prompt_token_ids_sha256": "ee3860ad1a33de8e8372314fe4db11d3787a9a2f20e9ee7ff23ed6c1d834e044", + "generated_tokens": 361, + "generated_token_ids": [ + 2158, + 8708, + 437, + 2066, + 11, + 395, + 933, + 276, + 1181, + 1069, + 5610, + 25, + 185, + 185, + 16, + 13, + 23243, + 1319, + 3699, + 279, + 254, + 1525, + 276, + 254, + 6909, + 1098, + 7, + 43124, + 5969, + 8, + 276, + 5462, + 344, + 395, + 1958, + 752, + 245, + 3000, + 1604, + 13, + 185, + 17, + 13, + 18768, + 1319, + 3699, + 279, + 254, + 1525, + 13, + 185, + 18, + 13, + 9142, + 521, + 254, + 37160, + 4899, + 13, + 185, + 19, + 13, + 7898, + 254, + 2555, + 13, + 185, + 185, + 4898, + 6, + 82, + 254, + 9674, + 280, + 254, + 2030, + 1805, + 62, + 72582, + 63, + 1157, + 25, + 185, + 185, + 10897, + 11338, + 185, + 1901, + 16145, + 185, + 185, + 1558, + 2555, + 62, + 72582, + 7, + 32808, + 1780, + 185, + 300, + 1501, + 23243, + 1319, + 3699, + 276, + 254, + 6909, + 1098, + 7, + 43124, + 5969, + 8, + 185, + 300, + 27840, + 62, + 2502, + 403, + 825, + 664, + 13, + 26158, + 7, + 87, + 8, + 327, + 1376, + 279, + 90373, + 60, + 185, + 251, + 185, + 300, + 1501, + 18768, + 1319, + 3699, + 185, + 300, + 37160, + 62, + 2502, + 403, + 825, + 87, + 9217, + 207, + 17, + 327, + 1376, + 279, + 27840, + 62, + 2502, + 60, + 185, + 251, + 185, + 300, + 1501, + 9142, + 521, + 254, + 37160, + 4899, + 185, + 300, + 2555, + 62, + 994, + 62, + 72582, + 403, + 2555, + 7, + 76798, + 62, + 2502, + 8, + 185, + 251, + 185, + 300, + 972, + 2555, + 62, + 994, + 62, + 72582, + 185, + 185, + 2, + 6517, + 3863, + 185, + 4134, + 7, + 1805, + 62, + 72582, + 9244, + 16, + 11, + 207, + 17, + 11, + 207, + 18, + 26034, + 207, + 1501, + 20154, + 25, + 207, + 16, + 19, + 185, + 4134, + 7, + 1805, + 62, + 72582, + 9244, + 16, + 11, + 207, + 19, + 11, + 207, + 24, + 26034, + 207, + 1501, + 20154, + 25, + 207, + 24, + 23, + 185, + 4134, + 7, + 1805, + 62, + 72582, + 9244, + 16, + 11, + 207, + 18, + 11, + 207, + 20, + 11, + 207, + 22, + 26034, + 207, + 1501, + 20154, + 25, + 207, + 23, + 19, + 185, + 4134, + 7, + 1805, + 62, + 72582, + 9244, + 16, + 13, + 19, + 11, + 207, + 19, + 13, + 17, + 11, + 207, + 15, + 26034, + 207, + 1501, + 20154, + 25, + 207, + 17, + 24, + 185, + 4134, + 7, + 1805, + 62, + 72582, + 9244, + 12, + 17, + 13, + 19, + 11, + 207, + 16, + 11, + 207, + 16, + 26034, + 207, + 1501, + 20154, + 25, + 207, + 21, + 185, + 10897, + 185, + 185, + 1567, + 1157, + 1022, + 24816, + 1319, + 3699, + 276, + 254, + 17016, + 10858, + 6146, + 853, + 410, + 5929, + 276, + 254, + 3632, + 1437, + 13, + 2928, + 359, + 26532, + 1319, + 3699, + 285, + 28095, + 768, + 581, + 13, + 429, + 1230, + 317, + 254, + 2555, + 280, + 254, + 26532, + 280, + 254, + 27840, + 5750, + 13, + 100001 + ], + "generated_token_ids_sha256": "c6bba52444abc13222e68bc7b1e477ab1ae3090e3f5158bbacf5306a21e5c61d", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " To solve this problem, we need to follow these steps:\n\n1. Round each element in the list to the upper int(Ceiling) to ensure that we always get a whole number.\n2. Square each element in the list.\n3. Sum all the squared elements.\n4. Return the sum.\n\nHere's the implementation of the `sum_squares` function:\n\n```python\nimport math\n\ndef sum_squares(lst):\n # Round each element to the upper int(Ceiling)\n rounded_list = [math.ceil(x) for x in lst]\n \n # Square each element\n squared_list = [x ** 2 for x in rounded_list]\n \n # Sum all the squared elements\n sum_of_squares = sum(squared_list)\n \n return sum_of_squares\n\n# Test cases\nprint(sum_squares([1, 2, 3])) # Output: 14\nprint(sum_squares([1, 4, 9])) # Output: 98\nprint(sum_squares([1, 3, 5, 7])) # Output: 84\nprint(sum_squares([1.4, 4.2, 0])) # Output: 29\nprint(sum_squares([-2.4, 1, 1])) # Output: 6\n```\n\nThis function first rounds each element to the nearest integer greater than or equal to the original value. Then it squares each element and sums them up. The result is the sum of the squares of the rounded numbers.", + "text_sha256": "21a7924a0f49cdcc14c34ade399435faab3b36438a732572d90fab48e28fdd79", + "task_score": { + "candidate_sha256": "19855a3603cdbc2102fee4850d03e96ae4bdb7c54245ce222e33fd7454dc0c47", + "python_ast_parse": true, + "parse_error": null, + "code_executed": false + } + }, + { + "condition": "s1_bos", + "factors": { + "system": 1, + "history": "filler", + "boundary": "bos", + "token_class": "special" + }, + "prompt_tokens": 207, + "left_padding_tokens": 0, + "prompt_token_ids_sha256": "5473c54512924d23c4b17924fbf1d8d7d4afb2d78ff619de2c5b7add1c6fda30", + "generated_tokens": 329, + "generated_token_ids": [ + 2158, + 8708, + 437, + 2066, + 11, + 395, + 933, + 276, + 1181, + 1069, + 5610, + 25, + 185, + 185, + 16, + 13, + 23243, + 1319, + 3699, + 279, + 254, + 1525, + 276, + 254, + 6909, + 1098, + 7, + 43124, + 5969, + 8, + 276, + 5462, + 344, + 395, + 889, + 7742, + 254, + 5750, + 13, + 185, + 17, + 13, + 50586, + 254, + 2555, + 280, + 254, + 37160, + 5750, + 13, + 185, + 18, + 13, + 7898, + 254, + 2555, + 13, + 185, + 185, + 4898, + 6, + 82, + 254, + 9674, + 280, + 254, + 2030, + 1805, + 62, + 72582, + 63, + 1157, + 25, + 185, + 185, + 10897, + 11338, + 185, + 1901, + 16145, + 185, + 185, + 1558, + 2555, + 62, + 72582, + 7, + 32808, + 1780, + 185, + 300, + 1501, + 23243, + 1319, + 3699, + 276, + 254, + 6909, + 1098, + 7, + 43124, + 5969, + 8, + 185, + 300, + 27840, + 62, + 2502, + 403, + 825, + 664, + 13, + 26158, + 7, + 87, + 8, + 327, + 1376, + 279, + 90373, + 60, + 185, + 251, + 185, + 300, + 1501, + 50586, + 254, + 2555, + 280, + 254, + 37160, + 5750, + 185, + 300, + 2555, + 62, + 994, + 62, + 72582, + 403, + 2555, + 7, + 87, + 746, + 17, + 327, + 1376, + 279, + 27840, + 62, + 2502, + 8, + 185, + 251, + 185, + 300, + 972, + 2555, + 62, + 994, + 62, + 72582, + 185, + 185, + 2, + 6517, + 3863, + 185, + 4134, + 7, + 1805, + 62, + 72582, + 9244, + 16, + 11, + 207, + 17, + 11, + 207, + 18, + 26034, + 207, + 1501, + 20154, + 25, + 207, + 16, + 19, + 185, + 4134, + 7, + 1805, + 62, + 72582, + 9244, + 16, + 11, + 207, + 19, + 11, + 207, + 24, + 26034, + 207, + 1501, + 20154, + 25, + 207, + 24, + 23, + 185, + 4134, + 7, + 1805, + 62, + 72582, + 9244, + 16, + 11, + 207, + 18, + 11, + 207, + 20, + 11, + 207, + 22, + 26034, + 207, + 1501, + 20154, + 25, + 207, + 23, + 19, + 185, + 4134, + 7, + 1805, + 62, + 72582, + 9244, + 16, + 13, + 19, + 11, + 207, + 19, + 13, + 17, + 11, + 207, + 15, + 26034, + 207, + 1501, + 20154, + 25, + 207, + 17, + 24, + 185, + 4134, + 7, + 1805, + 62, + 72582, + 9244, + 12, + 17, + 13, + 19, + 11, + 207, + 16, + 11, + 207, + 16, + 26034, + 207, + 1501, + 20154, + 25, + 207, + 21, + 185, + 10897, + 185, + 185, + 1567, + 1157, + 1022, + 24816, + 1319, + 3699, + 276, + 254, + 17016, + 10858, + 6146, + 853, + 410, + 5929, + 276, + 254, + 3632, + 1437, + 13, + 2928, + 11, + 359, + 61927, + 254, + 2555, + 280, + 254, + 26532, + 280, + 1069, + 27840, + 3039, + 285, + 7578, + 254, + 1230, + 13, + 100001 + ], + "generated_token_ids_sha256": "df1b580562352c10a0142464bfc5df450113400698a4bd672757a2c0d6b35ef6", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " To solve this problem, we need to follow these steps:\n\n1. Round each element in the list to the upper int(Ceiling) to ensure that we only square the numbers.\n2. Calculate the sum of the squared numbers.\n3. Return the sum.\n\nHere's the implementation of the `sum_squares` function:\n\n```python\nimport math\n\ndef sum_squares(lst):\n # Round each element to the upper int(Ceiling)\n rounded_list = [math.ceil(x) for x in lst]\n \n # Calculate the sum of the squared numbers\n sum_of_squares = sum(x**2 for x in rounded_list)\n \n return sum_of_squares\n\n# Test cases\nprint(sum_squares([1, 2, 3])) # Output: 14\nprint(sum_squares([1, 4, 9])) # Output: 98\nprint(sum_squares([1, 3, 5, 7])) # Output: 84\nprint(sum_squares([1.4, 4.2, 0])) # Output: 29\nprint(sum_squares([-2.4, 1, 1])) # Output: 6\n```\n\nThis function first rounds each element to the nearest integer greater than or equal to the original value. Then, it calculates the sum of the squares of these rounded values and returns the result.", + "text_sha256": "5657a7b8f10719e5c30e7ff79e6fe3f02008624be7444aeccd7783b11833da13", + "task_score": { + "candidate_sha256": "2330b87cb12c52fe0bd0087d0a37d45af8caec132677cc4a0c15321cdc60409d", + "python_ast_parse": true, + "parse_error": null, + "code_executed": false + } + }, + { + "condition": "s0_x", + "factors": { + "system": 0, + "history": "filler", + "boundary": "x", + "token_class": "ordinary_control" + }, + "prompt_tokens": 191, + "left_padding_tokens": 16, + "prompt_token_ids_sha256": "bf0d4583be831e2c74147cd47eee6fedc28e35effde0efda5728df8186330eef", + "generated_tokens": 361, + "generated_token_ids": [ + 2158, + 8708, + 437, + 2066, + 11, + 395, + 933, + 276, + 1181, + 1069, + 5610, + 25, + 185, + 185, + 16, + 13, + 23243, + 1319, + 3699, + 279, + 254, + 1525, + 276, + 254, + 6909, + 1098, + 7, + 43124, + 5969, + 8, + 276, + 5462, + 344, + 395, + 1958, + 752, + 245, + 3000, + 1604, + 13, + 185, + 17, + 13, + 18768, + 1319, + 3699, + 279, + 254, + 1525, + 13, + 185, + 18, + 13, + 9142, + 521, + 254, + 37160, + 4899, + 13, + 185, + 19, + 13, + 7898, + 254, + 2555, + 13, + 185, + 185, + 4898, + 6, + 82, + 254, + 9674, + 280, + 254, + 2030, + 1805, + 62, + 72582, + 63, + 1157, + 25, + 185, + 185, + 10897, + 11338, + 185, + 1901, + 16145, + 185, + 185, + 1558, + 2555, + 62, + 72582, + 7, + 32808, + 1780, + 185, + 300, + 1501, + 23243, + 1319, + 3699, + 276, + 254, + 6909, + 1098, + 7, + 43124, + 5969, + 8, + 185, + 300, + 27840, + 62, + 2502, + 403, + 825, + 664, + 13, + 26158, + 7, + 87, + 8, + 327, + 1376, + 279, + 90373, + 60, + 185, + 251, + 185, + 300, + 1501, + 18768, + 1319, + 3699, + 185, + 300, + 37160, + 62, + 2502, + 403, + 825, + 87, + 9217, + 207, + 17, + 327, + 1376, + 279, + 27840, + 62, + 2502, + 60, + 185, + 251, + 185, + 300, + 1501, + 9142, + 521, + 254, + 37160, + 4899, + 185, + 300, + 2555, + 62, + 994, + 62, + 72582, + 403, + 2555, + 7, + 76798, + 62, + 2502, + 8, + 185, + 251, + 185, + 300, + 972, + 2555, + 62, + 994, + 62, + 72582, + 185, + 185, + 2, + 6517, + 3863, + 185, + 4134, + 7, + 1805, + 62, + 72582, + 9244, + 16, + 11, + 207, + 17, + 11, + 207, + 18, + 26034, + 207, + 1501, + 20154, + 25, + 207, + 16, + 19, + 185, + 4134, + 7, + 1805, + 62, + 72582, + 9244, + 16, + 11, + 207, + 19, + 11, + 207, + 24, + 26034, + 207, + 1501, + 20154, + 25, + 207, + 24, + 23, + 185, + 4134, + 7, + 1805, + 62, + 72582, + 9244, + 16, + 11, + 207, + 18, + 11, + 207, + 20, + 11, + 207, + 22, + 26034, + 207, + 1501, + 20154, + 25, + 207, + 23, + 19, + 185, + 4134, + 7, + 1805, + 62, + 72582, + 9244, + 16, + 13, + 19, + 11, + 207, + 19, + 13, + 17, + 11, + 207, + 15, + 26034, + 207, + 1501, + 20154, + 25, + 207, + 17, + 24, + 185, + 4134, + 7, + 1805, + 62, + 72582, + 9244, + 12, + 17, + 13, + 19, + 11, + 207, + 16, + 11, + 207, + 16, + 26034, + 207, + 1501, + 20154, + 25, + 207, + 21, + 185, + 10897, + 185, + 185, + 1567, + 1157, + 1022, + 24816, + 1319, + 3699, + 276, + 254, + 17016, + 10858, + 6146, + 853, + 410, + 5929, + 276, + 254, + 3632, + 1437, + 13, + 2928, + 359, + 26532, + 1319, + 3699, + 285, + 28095, + 768, + 581, + 13, + 429, + 1230, + 317, + 254, + 2555, + 280, + 254, + 26532, + 280, + 254, + 27840, + 5750, + 13, + 100001 + ], + "generated_token_ids_sha256": "c6bba52444abc13222e68bc7b1e477ab1ae3090e3f5158bbacf5306a21e5c61d", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " To solve this problem, we need to follow these steps:\n\n1. Round each element in the list to the upper int(Ceiling) to ensure that we always get a whole number.\n2. Square each element in the list.\n3. Sum all the squared elements.\n4. Return the sum.\n\nHere's the implementation of the `sum_squares` function:\n\n```python\nimport math\n\ndef sum_squares(lst):\n # Round each element to the upper int(Ceiling)\n rounded_list = [math.ceil(x) for x in lst]\n \n # Square each element\n squared_list = [x ** 2 for x in rounded_list]\n \n # Sum all the squared elements\n sum_of_squares = sum(squared_list)\n \n return sum_of_squares\n\n# Test cases\nprint(sum_squares([1, 2, 3])) # Output: 14\nprint(sum_squares([1, 4, 9])) # Output: 98\nprint(sum_squares([1, 3, 5, 7])) # Output: 84\nprint(sum_squares([1.4, 4.2, 0])) # Output: 29\nprint(sum_squares([-2.4, 1, 1])) # Output: 6\n```\n\nThis function first rounds each element to the nearest integer greater than or equal to the original value. Then it squares each element and sums them up. The result is the sum of the squares of the rounded numbers.", + "text_sha256": "21a7924a0f49cdcc14c34ade399435faab3b36438a732572d90fab48e28fdd79", + "task_score": { + "candidate_sha256": "19855a3603cdbc2102fee4850d03e96ae4bdb7c54245ce222e33fd7454dc0c47", + "python_ast_parse": true, + "parse_error": null, + "code_executed": false + } + }, + { + "condition": "s1_x", + "factors": { + "system": 1, + "history": "filler", + "boundary": "x", + "token_class": "ordinary_control" + }, + "prompt_tokens": 207, + "left_padding_tokens": 0, + "prompt_token_ids_sha256": "ee2daeb568041b52ce494749ceeb0c6fd06a7f9ce8a2b6ef8ab2377e1e246d66", + "generated_tokens": 342, + "generated_token_ids": [ + 2158, + 8708, + 437, + 2066, + 11, + 395, + 933, + 276, + 2111, + 254, + 1893, + 5610, + 25, + 185, + 185, + 16, + 13, + 23243, + 1319, + 3699, + 279, + 254, + 1525, + 276, + 254, + 6909, + 1098, + 7, + 43124, + 5969, + 8, + 276, + 5462, + 344, + 395, + 889, + 7742, + 3000, + 5750, + 13, + 185, + 17, + 13, + 18768, + 1319, + 3699, + 279, + 254, + 1525, + 13, + 185, + 18, + 13, + 9142, + 521, + 254, + 37160, + 4899, + 13, + 185, + 19, + 13, + 7898, + 254, + 2555, + 13, + 185, + 185, + 4898, + 6, + 82, + 254, + 9674, + 280, + 254, + 2030, + 1805, + 62, + 72582, + 63, + 1157, + 25, + 185, + 185, + 10897, + 11338, + 185, + 1558, + 2555, + 62, + 72582, + 7, + 32808, + 1780, + 185, + 300, + 1501, + 23243, + 1319, + 3699, + 276, + 254, + 6909, + 1098, + 7, + 43124, + 5969, + 8, + 185, + 300, + 27840, + 62, + 2502, + 403, + 825, + 572, + 7, + 1036, + 7, + 87, + 1509, + 327, + 1376, + 279, + 90373, + 60, + 185, + 300, + 1501, + 18768, + 1319, + 3699, + 185, + 300, + 37160, + 62, + 2502, + 403, + 825, + 87, + 746, + 17, + 327, + 1376, + 279, + 27840, + 62, + 2502, + 60, + 185, + 300, + 1501, + 9142, + 521, + 254, + 37160, + 4899, + 185, + 300, + 3223, + 62, + 1805, + 403, + 2555, + 7, + 76798, + 62, + 2502, + 8, + 185, + 300, + 1501, + 7898, + 254, + 2555, + 185, + 300, + 972, + 3223, + 62, + 1805, + 185, + 185, + 2, + 18460, + 8175, + 25, + 185, + 4134, + 7, + 1805, + 62, + 72582, + 9244, + 16, + 11, + 207, + 17, + 11, + 207, + 18, + 26034, + 207, + 1501, + 20154, + 25, + 207, + 16, + 19, + 185, + 4134, + 7, + 1805, + 62, + 72582, + 9244, + 16, + 11, + 207, + 19, + 11, + 207, + 24, + 26034, + 207, + 1501, + 20154, + 25, + 207, + 24, + 23, + 185, + 4134, + 7, + 1805, + 62, + 72582, + 9244, + 16, + 11, + 207, + 18, + 11, + 207, + 20, + 11, + 207, + 22, + 26034, + 207, + 1501, + 20154, + 25, + 207, + 23, + 19, + 185, + 4134, + 7, + 1805, + 62, + 72582, + 9244, + 16, + 13, + 19, + 11, + 207, + 19, + 13, + 17, + 11, + 207, + 15, + 26034, + 207, + 1501, + 20154, + 25, + 207, + 17, + 24, + 185, + 4134, + 7, + 1805, + 62, + 72582, + 9244, + 12, + 17, + 13, + 19, + 11, + 207, + 16, + 11, + 207, + 16, + 26034, + 207, + 1501, + 20154, + 25, + 207, + 21, + 185, + 10897, + 185, + 185, + 1567, + 1157, + 1022, + 24816, + 1319, + 3699, + 276, + 254, + 17016, + 10858, + 6146, + 853, + 410, + 5929, + 276, + 344, + 3699, + 11, + 937, + 26532, + 1319, + 3699, + 11, + 285, + 6334, + 28095, + 521, + 254, + 37160, + 4899, + 13, + 100001 + ], + "generated_token_ids_sha256": "207104a2f47a5f2d5230874c6ec6121dd636a36105e720df626c0dd691ab3419", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " To solve this problem, we need to perform the following steps:\n\n1. Round each element in the list to the upper int(Ceiling) to ensure that we only square whole numbers.\n2. Square each element in the list.\n3. Sum all the squared elements.\n4. Return the sum.\n\nHere's the implementation of the `sum_squares` function:\n\n```python\ndef sum_squares(lst):\n # Round each element to the upper int(Ceiling)\n rounded_list = [int(round(x)) for x in lst]\n # Square each element\n squared_list = [x**2 for x in rounded_list]\n # Sum all the squared elements\n total_sum = sum(squared_list)\n # Return the sum\n return total_sum\n\n# Example usage:\nprint(sum_squares([1, 2, 3])) # Output: 14\nprint(sum_squares([1, 4, 9])) # Output: 98\nprint(sum_squares([1, 3, 5, 7])) # Output: 84\nprint(sum_squares([1.4, 4.2, 0])) # Output: 29\nprint(sum_squares([-2.4, 1, 1])) # Output: 6\n```\n\nThis function first rounds each element to the nearest integer greater than or equal to that element, then squares each element, and finally sums all the squared elements.", + "text_sha256": "349691bb1439aa09a619c0fafd681667e47cf4ce53507035846adcda7ed9dcd3", + "task_score": { + "candidate_sha256": "6f3f83e9dde59ce9c0e53e46daac16f280cb778f391fe050c60bb98d3a20d33b", + "python_ast_parse": true, + "parse_error": null, + "code_executed": false + } + }, + { + "condition": "s0_period", + "factors": { + "system": 0, + "history": "filler", + "boundary": "period", + "token_class": "ordinary_control" + }, + "prompt_tokens": 191, + "left_padding_tokens": 16, + "prompt_token_ids_sha256": "5e556876b30e7de83e1d58a9331853ee7adff92957c6421cf176331235fe7f80", + "generated_tokens": 367, + "generated_token_ids": [ + 2158, + 8708, + 437, + 2066, + 11, + 395, + 933, + 276, + 1181, + 1069, + 5610, + 25, + 185, + 185, + 16, + 13, + 23243, + 1319, + 3699, + 279, + 254, + 1525, + 276, + 254, + 6909, + 1098, + 7, + 43124, + 5969, + 8, + 276, + 5462, + 344, + 395, + 889, + 7742, + 254, + 5750, + 285, + 441, + 254, + 14404, + 13, + 185, + 17, + 13, + 18768, + 1319, + 3699, + 279, + 254, + 1525, + 13, + 185, + 18, + 13, + 9142, + 521, + 254, + 37160, + 4899, + 13, + 185, + 19, + 13, + 7898, + 254, + 2555, + 13, + 185, + 185, + 4898, + 6, + 82, + 254, + 9674, + 280, + 254, + 2030, + 1805, + 62, + 72582, + 63, + 1157, + 25, + 185, + 185, + 10897, + 11338, + 185, + 1901, + 16145, + 185, + 185, + 1558, + 2555, + 62, + 72582, + 7, + 32808, + 1780, + 185, + 300, + 1501, + 23243, + 1319, + 3699, + 276, + 254, + 6909, + 1098, + 7, + 43124, + 5969, + 8, + 185, + 300, + 27840, + 62, + 2502, + 403, + 825, + 664, + 13, + 26158, + 7, + 87, + 8, + 327, + 1376, + 279, + 90373, + 60, + 185, + 251, + 185, + 300, + 1501, + 18768, + 1319, + 3699, + 185, + 300, + 37160, + 62, + 2502, + 403, + 825, + 87, + 9217, + 207, + 17, + 327, + 1376, + 279, + 27840, + 62, + 2502, + 60, + 185, + 251, + 185, + 300, + 1501, + 9142, + 521, + 254, + 37160, + 4899, + 185, + 300, + 2555, + 62, + 994, + 62, + 72582, + 403, + 2555, + 7, + 76798, + 62, + 2502, + 8, + 185, + 251, + 185, + 300, + 972, + 2555, + 62, + 994, + 62, + 72582, + 185, + 185, + 2, + 6517, + 3863, + 185, + 4134, + 7, + 1805, + 62, + 72582, + 9244, + 16, + 11, + 207, + 17, + 11, + 207, + 18, + 26034, + 207, + 1501, + 20154, + 25, + 207, + 16, + 19, + 185, + 4134, + 7, + 1805, + 62, + 72582, + 9244, + 16, + 11, + 207, + 19, + 11, + 207, + 24, + 26034, + 207, + 1501, + 20154, + 25, + 207, + 24, + 23, + 185, + 4134, + 7, + 1805, + 62, + 72582, + 9244, + 16, + 11, + 207, + 18, + 11, + 207, + 20, + 11, + 207, + 22, + 26034, + 207, + 1501, + 20154, + 25, + 207, + 23, + 19, + 185, + 4134, + 7, + 1805, + 62, + 72582, + 9244, + 16, + 13, + 19, + 11, + 207, + 19, + 13, + 17, + 11, + 207, + 15, + 26034, + 207, + 1501, + 20154, + 25, + 207, + 17, + 24, + 185, + 4134, + 7, + 1805, + 62, + 72582, + 9244, + 12, + 17, + 13, + 19, + 11, + 207, + 16, + 11, + 207, + 16, + 26034, + 207, + 1501, + 20154, + 25, + 207, + 21, + 185, + 10897, + 185, + 185, + 1567, + 1157, + 1022, + 24816, + 1319, + 3699, + 276, + 254, + 17016, + 10858, + 6146, + 853, + 410, + 5929, + 276, + 254, + 3632, + 1437, + 13, + 2928, + 359, + 26532, + 1319, + 3699, + 285, + 28095, + 768, + 581, + 13, + 429, + 2030, + 664, + 13, + 26158, + 46120, + 1157, + 317, + 1222, + 276, + 4078, + 276, + 254, + 17016, + 10858, + 13, + 100001 + ], + "generated_token_ids_sha256": "a339ea5740089c54aac78cc9db051688a5368ffcb97346745c4d7f60bf765146", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " To solve this problem, we need to follow these steps:\n\n1. Round each element in the list to the upper int(Ceiling) to ensure that we only square the numbers and not the strings.\n2. Square each element in the list.\n3. Sum all the squared elements.\n4. Return the sum.\n\nHere's the implementation of the `sum_squares` function:\n\n```python\nimport math\n\ndef sum_squares(lst):\n # Round each element to the upper int(Ceiling)\n rounded_list = [math.ceil(x) for x in lst]\n \n # Square each element\n squared_list = [x ** 2 for x in rounded_list]\n \n # Sum all the squared elements\n sum_of_squares = sum(squared_list)\n \n return sum_of_squares\n\n# Test cases\nprint(sum_squares([1, 2, 3])) # Output: 14\nprint(sum_squares([1, 4, 9])) # Output: 98\nprint(sum_squares([1, 3, 5, 7])) # Output: 84\nprint(sum_squares([1.4, 4.2, 0])) # Output: 29\nprint(sum_squares([-2.4, 1, 1])) # Output: 6\n```\n\nThis function first rounds each element to the nearest integer greater than or equal to the original value. Then it squares each element and sums them up. The `math.ceil()` function is used to round to the nearest integer.", + "text_sha256": "21e051a87628c02474b4e2f49663a10864e28cd4db0c833be3ec7bf530179f1b", + "task_score": { + "candidate_sha256": "19855a3603cdbc2102fee4850d03e96ae4bdb7c54245ce222e33fd7454dc0c47", + "python_ast_parse": true, + "parse_error": null, + "code_executed": false + } + }, + { + "condition": "s1_period", + "factors": { + "system": 1, + "history": "filler", + "boundary": "period", + "token_class": "ordinary_control" + }, + "prompt_tokens": 207, + "left_padding_tokens": 0, + "prompt_token_ids_sha256": "537648bc701d6509e6c7925284b842e598400c662918f3b2319d0e54a404019c", + "generated_tokens": 74, + "generated_token_ids": [ + 977, + 2555, + 62, + 72582, + 7, + 32808, + 1780, + 185, + 300, + 1501, + 23243, + 1319, + 3699, + 279, + 254, + 1525, + 276, + 254, + 6909, + 1098, + 7, + 43124, + 5969, + 8, + 185, + 300, + 27840, + 62, + 32808, + 403, + 825, + 572, + 7, + 87, + 8, + 327, + 1376, + 279, + 90373, + 60, + 185, + 300, + 1501, + 50586, + 254, + 2555, + 280, + 37160, + 5750, + 185, + 300, + 37160, + 62, + 1805, + 403, + 2555, + 7, + 87, + 746, + 17, + 327, + 1376, + 279, + 27840, + 62, + 32808, + 8, + 185, + 300, + 972, + 37160, + 62, + 1805, + 100001 + ], + "generated_token_ids_sha256": "a96d4d398ece12ebb86170c95a112480e6781b5c8564676c0bfb99e006de3faa", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " def sum_squares(lst):\n # Round each element in the list to the upper int(Ceiling)\n rounded_lst = [int(x) for x in lst]\n # Calculate the sum of squared numbers\n squared_sum = sum(x**2 for x in rounded_lst)\n return squared_sum", + "text_sha256": "feac86b93f35acaa5792c576d649424cd542a09eb5472c75bac21558be489784", + "task_score": { + "candidate_sha256": "f0f47ad5d481f48cd88b6091c1eceb093e44040c9f22c0cd3f5984bd2533f9ea", + "python_ast_parse": true, + "parse_error": null, + "code_executed": false + } + } + ] + }, + { + "id": "HumanEval/23", + "domain": "code", + "label": "Python code", + "within_domain_index": 3, + "selection_rank": "03b3c7329e474bf8e9660969ed5898d561e718f12a59d2fc1ed641be54b68860", + "source_text_sha256": "0bb479f80d27872f6bebc01618112b372cc8a2e6aee9e4b76337e3b3416418c7", + "source_characters": 132, + "source_tokens": 42, + "prompt_tokens_by_condition": { + "s0_eos": 67, + "s1_eos": 83, + "s0_bos": 67, + "s1_bos": 83, + "s0_x": 67, + "s1_x": 83, + "s0_period": 67, + "s1_period": 83 + }, + "batch_prompt_tokens_after_left_padding": 83, + "batch_padding_side": "left", + "batch_conditions": 8, + "generation_seconds": 43.728562434000196, + "peak_cuda_memory_allocated_bytes": 29128488448, + "generated_tokens_including_batch_padding": 1528, + "outputs": [ + { + "condition": "s0_eos", + "factors": { + "system": 0, + "history": "filler", + "boundary": "eos", + "token_class": "special" + }, + "prompt_tokens": 67, + "left_padding_tokens": 16, + "prompt_token_ids_sha256": "cb47bc5c0e78c4ab62201c207af6c0385abba0c85cc1a22c130a8b6a445a1116", + "generated_tokens": 146, + "generated_token_ids": [ + 4462, + 317, + 254, + 9674, + 280, + 254, + 2030, + 73675, + 63, + 1157, + 25, + 185, + 185, + 10897, + 11338, + 185, + 1558, + 56958, + 7, + 2612, + 25, + 1406, + 8, + 5052, + 1098, + 25, + 185, + 300, + 8066, + 7898, + 3973, + 280, + 2028, + 2662, + 8066, + 185, + 300, + 972, + 10389, + 7, + 2612, + 8, + 185, + 185, + 2, + 6517, + 3863, + 185, + 4134, + 7, + 73675, + 1504, + 14201, + 299, + 1501, + 59545, + 2827, + 25, + 207, + 15, + 185, + 4134, + 7, + 73675, + 1504, + 22654, + 14201, + 663, + 1501, + 59545, + 2827, + 25, + 207, + 18, + 185, + 4134, + 7, + 73675, + 1504, + 17464, + 11, + 5427, + 13797, + 1509, + 207, + 1501, + 59545, + 2827, + 25, + 207, + 16, + 18, + 185, + 10897, + 185, + 185, + 1567, + 1157, + 5131, + 12974, + 6, + 82, + 4930, + 12, + 246, + 2030, + 6449, + 63, + 1157, + 276, + 6983, + 254, + 3973, + 280, + 254, + 2782, + 2662, + 13, + 429, + 2030, + 6449, + 63, + 1157, + 7578, + 254, + 1604, + 280, + 5023, + 279, + 274, + 2159, + 11, + 588, + 279, + 437, + 1460, + 317, + 254, + 1604, + 280, + 7445, + 279, + 254, + 2662, + 13, + 100001 + ], + "generated_token_ids_sha256": "3fa5b21e5c9d1720b2839bec0ed52f74018d7d525c1ec8e05ebbaee700bf11cf", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " Here is the implementation of the `strlen` function:\n\n```python\ndef strlen(string: str) -> int:\n \"\"\" Return length of given string \"\"\"\n return len(string)\n\n# Test cases\nprint(strlen('')) # Expected output: 0\nprint(strlen('abc')) # Expected output: 3\nprint(strlen('Hello, World!')) # Expected output: 13\n```\n\nThis function uses Python's built-in `len` function to determine the length of the input string. The `len` function returns the number of items in an object, which in this case is the number of characters in the string.", + "text_sha256": "53ad1f6a9dbaa9d63818cc7a162c6d57f4e95648f2cb5982c3dae3ceca5e2a0e", + "task_score": { + "candidate_sha256": "7897188c3cb91527449f69dcd0c4473974736a470998152874ccf04e6df93e37", + "python_ast_parse": true, + "parse_error": null, + "code_executed": false + } + }, + { + "condition": "s1_eos", + "factors": { + "system": 1, + "history": "filler", + "boundary": "eos", + "token_class": "special" + }, + "prompt_tokens": 83, + "left_padding_tokens": 0, + "prompt_token_ids_sha256": "82597f376eaa8456e5ef6faa9ca76898c8a26dc24355f8548d4588aca4a36df0", + "generated_tokens": 71, + "generated_token_ids": [ + 4462, + 6, + 82, + 254, + 9674, + 280, + 254, + 2030, + 73675, + 63, + 1157, + 25, + 185, + 185, + 10897, + 11338, + 185, + 1558, + 56958, + 7, + 2612, + 25, + 1406, + 8, + 5052, + 1098, + 25, + 185, + 300, + 8066, + 7898, + 3973, + 280, + 2028, + 2662, + 8066, + 185, + 300, + 972, + 10389, + 7, + 2612, + 8, + 185, + 10897, + 185, + 185, + 1567, + 1157, + 3925, + 7578, + 254, + 3973, + 280, + 254, + 2782, + 2662, + 457, + 1244, + 12974, + 6, + 82, + 4930, + 12, + 246, + 2030, + 6449, + 46120, + 1157, + 13, + 100001 + ], + "generated_token_ids_sha256": "0a81818d1ff5c7a2b2a89805328794df308d6cd4ac7e0d5f47069842174d15b3", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " Here's the implementation of the `strlen` function:\n\n```python\ndef strlen(string: str) -> int:\n \"\"\" Return length of given string \"\"\"\n return len(string)\n```\n\nThis function simply returns the length of the input string by using Python's built-in `len()` function.", + "text_sha256": "c6f4eb869288b3103dbb7b271134cfbe8e870235c6f8e79caeb76689167fbf3c", + "task_score": { + "candidate_sha256": "aac1b2005230da60d09fe75f852bfc4c24e16d9de060c4d7c31b227d860307bf", + "python_ast_parse": true, + "parse_error": null, + "code_executed": false + } + }, + { + "condition": "s0_bos", + "factors": { + "system": 0, + "history": "filler", + "boundary": "bos", + "token_class": "special" + }, + "prompt_tokens": 67, + "left_padding_tokens": 16, + "prompt_token_ids_sha256": "45e00434df50a11d9fc7fcecfdcd2801af37014c711ad35437b6c3b66333f13e", + "generated_tokens": 130, + "generated_token_ids": [ + 429, + 1157, + 2030, + 73675, + 63, + 317, + 4218, + 276, + 972, + 254, + 3973, + 280, + 245, + 2028, + 2662, + 13, + 429, + 1157, + 4497, + 245, + 2662, + 372, + 274, + 6758, + 285, + 7578, + 274, + 10858, + 14357, + 254, + 3973, + 280, + 254, + 2662, + 13, + 185, + 185, + 4898, + 6, + 82, + 254, + 9674, + 280, + 254, + 1157, + 25, + 185, + 185, + 10897, + 11338, + 185, + 1558, + 56958, + 7, + 2612, + 25, + 1406, + 8, + 5052, + 1098, + 25, + 185, + 300, + 8066, + 7898, + 3973, + 280, + 2028, + 2662, + 8066, + 185, + 300, + 972, + 10389, + 7, + 2612, + 8, + 185, + 10897, + 185, + 185, + 1567, + 1157, + 5131, + 12974, + 6, + 82, + 4930, + 12, + 246, + 2030, + 6449, + 63, + 1157, + 276, + 11462, + 254, + 3973, + 280, + 254, + 2662, + 13, + 429, + 2030, + 6449, + 63, + 1157, + 7578, + 254, + 1604, + 280, + 5023, + 279, + 274, + 2159, + 11, + 588, + 279, + 437, + 1460, + 317, + 254, + 1604, + 280, + 7445, + 279, + 254, + 2662, + 13, + 100001 + ], + "generated_token_ids_sha256": "bfd451d0e50fdfb8c654c3b8b34e9a1520766c1763cf1a7c7f9d8a41357e149c", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " The function `strlen` is defined to return the length of a given string. The function takes a string as an argument and returns an integer representing the length of the string.\n\nHere's the implementation of the function:\n\n```python\ndef strlen(string: str) -> int:\n \"\"\" Return length of given string \"\"\"\n return len(string)\n```\n\nThis function uses Python's built-in `len` function to calculate the length of the string. The `len` function returns the number of items in an object, which in this case is the number of characters in the string.", + "text_sha256": "df2f9b9098db8beec0f5828a82404ef284aeef468fd7866a55e3b2d96cdaa0a6", + "task_score": { + "candidate_sha256": "aac1b2005230da60d09fe75f852bfc4c24e16d9de060c4d7c31b227d860307bf", + "python_ast_parse": true, + "parse_error": null, + "code_executed": false + } + }, + { + "condition": "s1_bos", + "factors": { + "system": 1, + "history": "filler", + "boundary": "bos", + "token_class": "special" + }, + "prompt_tokens": 83, + "left_padding_tokens": 0, + "prompt_token_ids_sha256": "fdfddae640dc75ab1b51c7ab606e82efd1d0785b1980843adc823118ba04b9ec", + "generated_tokens": 149, + "generated_token_ids": [ + 2158, + 4353, + 254, + 2030, + 73675, + 63, + 1157, + 279, + 12974, + 11, + 340, + 481, + 938, + 254, + 2030, + 6449, + 63, + 1157, + 11, + 588, + 7578, + 254, + 3973, + 280, + 245, + 2662, + 13, + 4462, + 6, + 82, + 254, + 3938, + 1157, + 25, + 185, + 185, + 10897, + 11338, + 185, + 1558, + 56958, + 7, + 2612, + 25, + 1406, + 8, + 5052, + 1098, + 25, + 185, + 300, + 8066, + 7898, + 3973, + 280, + 2028, + 2662, + 8066, + 185, + 300, + 972, + 10389, + 7, + 2612, + 8, + 185, + 185, + 2, + 18460, + 8175, + 25, + 185, + 4134, + 7, + 73675, + 1504, + 14201, + 207, + 1501, + 20154, + 25, + 207, + 15, + 185, + 4134, + 7, + 73675, + 1504, + 22654, + 14201, + 207, + 1501, + 20154, + 25, + 207, + 18, + 185, + 10897, + 185, + 185, + 1567, + 1157, + 4497, + 245, + 2662, + 372, + 274, + 6758, + 285, + 7578, + 895, + 3973, + 13, + 429, + 2030, + 6449, + 63, + 1157, + 7756, + 18548, + 521, + 7445, + 279, + 254, + 2662, + 11, + 2847, + 9577, + 285, + 42468, + 11, + 558, + 359, + 6, + 82, + 245, + 17236, + 1143, + 276, + 6983, + 254, + 3973, + 280, + 245, + 2662, + 279, + 12974, + 13, + 100001 + ], + "generated_token_ids_sha256": "e4f6ac633d70834c0d9ce2104bbe156e26e6650748815f58f6e2c50559ada36a", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " To implement the `strlen` function in Python, you can use the `len` function, which returns the length of a string. Here's the complete function:\n\n```python\ndef strlen(string: str) -> int:\n \"\"\" Return length of given string \"\"\"\n return len(string)\n\n# Example usage:\nprint(strlen('')) # Output: 0\nprint(strlen('abc')) # Output: 3\n```\n\nThis function takes a string as an argument and returns its length. The `len` function automatically counts all characters in the string, including spaces and punctuation, so it's a straightforward way to determine the length of a string in Python.", + "text_sha256": "61b3aef398e8fd0c4459c22637a78697677e4f448308a1171efc8ce63157c539", + "task_score": { + "candidate_sha256": "74f33e189fe5c71b7a2bc81a0b26b36a45c640674bbf3bdadaa313c6b4404b6d", + "python_ast_parse": true, + "parse_error": null, + "code_executed": false + } + }, + { + "condition": "s0_x", + "factors": { + "system": 0, + "history": "filler", + "boundary": "x", + "token_class": "ordinary_control" + }, + "prompt_tokens": 67, + "left_padding_tokens": 16, + "prompt_token_ids_sha256": "5854ab6a5ff35cb37f7ab3b7a7ebea68ffa4cc02b05d668a2e087e39b28cb1d3", + "generated_tokens": 180, + "generated_token_ids": [ + 2158, + 4353, + 254, + 2030, + 73675, + 63, + 1157, + 11, + 340, + 481, + 938, + 254, + 1893, + 12974, + 2985, + 25, + 185, + 185, + 10897, + 11338, + 185, + 1558, + 56958, + 7, + 2612, + 25, + 1406, + 8, + 5052, + 1098, + 25, + 185, + 300, + 8066, + 7898, + 3973, + 280, + 2028, + 2662, + 8066, + 185, + 300, + 972, + 10389, + 7, + 2612, + 8, + 185, + 10897, + 185, + 185, + 1567, + 1157, + 5131, + 12974, + 6, + 82, + 4930, + 12, + 246, + 2030, + 6449, + 46120, + 1157, + 276, + 6983, + 254, + 3973, + 280, + 254, + 2782, + 2662, + 13, + 429, + 2030, + 6449, + 46120, + 1157, + 7578, + 254, + 1604, + 280, + 5023, + 279, + 274, + 2159, + 11, + 588, + 279, + 437, + 1460, + 317, + 254, + 1604, + 280, + 7445, + 279, + 254, + 2662, + 13, + 185, + 185, + 4898, + 6, + 82, + 946, + 340, + 481, + 1727, + 254, + 1157, + 366, + 254, + 4286, + 6987, + 25, + 185, + 185, + 10897, + 11338, + 185, + 4134, + 7, + 73675, + 1504, + 14201, + 207, + 1501, + 59545, + 2827, + 25, + 207, + 15, + 185, + 4134, + 7, + 73675, + 1504, + 22654, + 14201, + 207, + 1501, + 59545, + 2827, + 25, + 207, + 18, + 185, + 10897, + 185, + 185, + 1567, + 543, + 2827, + 25, + 185, + 185, + 10897, + 185, + 15, + 185, + 18, + 185, + 10897, + 185, + 185, + 1567, + 39185, + 344, + 254, + 1157, + 9695, + 7578, + 254, + 3973, + 280, + 254, + 2662, + 13, + 100001 + ], + "generated_token_ids_sha256": "03607362ece5f82402412df7d58b7537306aa7e6f673cda8b573854529d84308", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " To implement the `strlen` function, you can use the following Python code:\n\n```python\ndef strlen(string: str) -> int:\n \"\"\" Return length of given string \"\"\"\n return len(string)\n```\n\nThis function uses Python's built-in `len()` function to determine the length of the input string. The `len()` function returns the number of items in an object, which in this case is the number of characters in the string.\n\nHere's how you can test the function with the provided examples:\n\n```python\nprint(strlen('')) # Expected output: 0\nprint(strlen('abc')) # Expected output: 3\n```\n\nThis will output:\n\n```\n0\n3\n```\n\nThis confirms that the function correctly returns the length of the string.", + "text_sha256": "ec948a9e93b6daf14082c7b420299e921779987a33705183407385189ede775d", + "task_score": { + "candidate_sha256": "aac1b2005230da60d09fe75f852bfc4c24e16d9de060c4d7c31b227d860307bf", + "python_ast_parse": true, + "parse_error": null, + "code_executed": false + } + }, + { + "condition": "s1_x", + "factors": { + "system": 1, + "history": "filler", + "boundary": "x", + "token_class": "ordinary_control" + }, + "prompt_tokens": 83, + "left_padding_tokens": 0, + "prompt_token_ids_sha256": "7542edb390d1f29af1273083ba591b257398ab4c1eecf864bbc52663edea9850", + "generated_tokens": 53, + "generated_token_ids": [ + 34083, + 11338, + 185, + 1558, + 56958, + 7, + 2612, + 25, + 1406, + 8, + 5052, + 1098, + 25, + 185, + 300, + 8066, + 7898, + 3973, + 280, + 2028, + 2662, + 185, + 300, + 24922, + 56958, + 1504, + 2519, + 185, + 251, + 15, + 185, + 300, + 24922, + 56958, + 1504, + 22654, + 2519, + 185, + 251, + 18, + 185, + 300, + 8066, + 185, + 300, + 972, + 10389, + 7, + 2612, + 8, + 185, + 10897, + 100001 + ], + "generated_token_ids_sha256": "69fad8c4eb2a45c2965c4ca8530af6af58724bd20406d6aa5aafd7c1f239f76f", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " ```python\ndef strlen(string: str) -> int:\n \"\"\" Return length of given string\n >>> strlen('')\n 0\n >>> strlen('abc')\n 3\n \"\"\"\n return len(string)\n```", + "text_sha256": "b6132b60b7e0b2beabaee066e1b4c4f0368072576cd8578e528b8c45fd9abfb3", + "task_score": { + "candidate_sha256": "831c4d6a608f99826ae7fb5dc85b3f25a5aebf7643e2dec1468c8a442c7f751b", + "python_ast_parse": true, + "parse_error": null, + "code_executed": false + } + }, + { + "condition": "s0_period", + "factors": { + "system": 0, + "history": "filler", + "boundary": "period", + "token_class": "ordinary_control" + }, + "prompt_tokens": 67, + "left_padding_tokens": 16, + "prompt_token_ids_sha256": "2f54a215c9dbb510d46c5a9ec14a563ab2d8bcd06081a351221e49244ff23ee7", + "generated_tokens": 191, + "generated_token_ids": [ + 429, + 1157, + 2030, + 73675, + 63, + 317, + 4218, + 276, + 972, + 254, + 3973, + 280, + 245, + 2028, + 2662, + 13, + 3159, + 11, + 254, + 1157, + 1217, + 441, + 3370, + 972, + 254, + 3973, + 280, + 254, + 2662, + 13, + 11987, + 11, + 359, + 7578, + 207, + 15, + 327, + 274, + 7137, + 2662, + 285, + 207, + 18, + 327, + 254, + 2662, + 655, + 22654, + 6767, + 185, + 185, + 1898, + 2876, + 437, + 11, + 340, + 933, + 276, + 43667, + 1184, + 254, + 2662, + 285, + 1690, + 254, + 7445, + 13, + 4462, + 6, + 82, + 254, + 24832, + 1157, + 25, + 185, + 185, + 10897, + 11338, + 185, + 1558, + 56958, + 7, + 2612, + 25, + 1406, + 8, + 5052, + 1098, + 25, + 185, + 300, + 8066, + 7898, + 3973, + 280, + 2028, + 2662, + 185, + 300, + 24922, + 56958, + 1504, + 2519, + 185, + 251, + 15, + 185, + 300, + 24922, + 56958, + 1504, + 22654, + 2519, + 185, + 251, + 18, + 185, + 300, + 8066, + 185, + 300, + 1690, + 403, + 207, + 15, + 185, + 300, + 327, + 1072, + 279, + 2662, + 25, + 185, + 391, + 1690, + 7324, + 207, + 16, + 185, + 300, + 972, + 1690, + 185, + 10897, + 185, + 185, + 1567, + 1157, + 4310, + 5313, + 245, + 7114, + 276, + 207, + 15, + 11, + 937, + 91281, + 1184, + 1319, + 3199, + 279, + 254, + 2662, + 11, + 18765, + 272, + 254, + 7114, + 1319, + 766, + 13, + 4128, + 254, + 7832, + 27628, + 11, + 359, + 7578, + 254, + 7114, + 11, + 588, + 9622, + 254, + 3973, + 280, + 254, + 2662, + 13, + 100001 + ], + "generated_token_ids_sha256": "bc0930e9e75131c62800bdf57817d5483dba76548e035c448881159d0d842738", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " The function `strlen` is defined to return the length of a given string. However, the function does not actually return the length of the string. Instead, it returns 0 for an empty string and 3 for the string 'abc'.\n\nTo fix this, you need to iterate through the string and count the characters. Here's the corrected function:\n\n```python\ndef strlen(string: str) -> int:\n \"\"\" Return length of given string\n >>> strlen('')\n 0\n >>> strlen('abc')\n 3\n \"\"\"\n count = 0\n for _ in string:\n count += 1\n return count\n```\n\nThis function initializes a counter to 0, then iterates through each character in the string, incrementing the counter each time. After the loop completes, it returns the counter, which represents the length of the string.", + "text_sha256": "dc10a29795fe824f4af3638c65bf453c36541fd26d64648945509cba32693694", + "task_score": { + "candidate_sha256": "31d023bb07881f723b75dbf119cf0c53d66ef97775cdd2714bb5a4e6f3c2d0cd", + "python_ast_parse": true, + "parse_error": null, + "code_executed": false + } + }, + { + "condition": "s1_period", + "factors": { + "system": 1, + "history": "filler", + "boundary": "period", + "token_class": "ordinary_control" + }, + "prompt_tokens": 83, + "left_padding_tokens": 0, + "prompt_token_ids_sha256": "19eb1141be8bf17769a49defff6edd7401bce652f18c7df994b21151755aca3a", + "generated_tokens": 48, + "generated_token_ids": [ + 977, + 56958, + 7, + 2612, + 25, + 1406, + 8, + 5052, + 1098, + 25, + 185, + 300, + 8066, + 7898, + 3973, + 280, + 2028, + 2662, + 185, + 300, + 24922, + 56958, + 1504, + 2519, + 185, + 251, + 15, + 185, + 300, + 24922, + 56958, + 1504, + 22654, + 2519, + 185, + 251, + 18, + 185, + 300, + 8066, + 185, + 300, + 972, + 10389, + 7, + 2612, + 8, + 100001 + ], + "generated_token_ids_sha256": "f8eebd031ad078516c8440851176176962b288167d2b641d54ccf57d4676d232", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " def strlen(string: str) -> int:\n \"\"\" Return length of given string\n >>> strlen('')\n 0\n >>> strlen('abc')\n 3\n \"\"\"\n return len(string)", + "text_sha256": "e55ad8094293e4c6fa4fe7efbb83b0c4275a2627227745fffa4cfe85907c8abe", + "task_score": { + "candidate_sha256": "831c4d6a608f99826ae7fb5dc85b3f25a5aebf7643e2dec1468c8a442c7f751b", + "python_ast_parse": true, + "parse_error": null, + "code_executed": false + } + } + ] + }, + { + "id": "gsm8k/test/1069", + "domain": "math", + "label": "Grade-school math", + "within_domain_index": 0, + "selection_rank": "000946b459ce33a645f403b9d781a7aefd81f5568412149f4588381fed55b1d7", + "source_text_sha256": "0cc2ca2bdd6ee8d664eb1197e8020bac71c25ba0ce52d813fc4adbf08df22378", + "source_characters": 522, + "source_tokens": 107, + "prompt_tokens_by_condition": { + "s0_eos": 131, + "s1_eos": 147, + "s0_bos": 131, + "s1_bos": 147, + "s0_x": 131, + "s1_x": 147, + "s0_period": 131, + "s1_period": 147 + }, + "batch_prompt_tokens_after_left_padding": 147, + "batch_padding_side": "left", + "batch_conditions": 8, + "generation_seconds": 46.74546577001456, + "peak_cuda_memory_allocated_bytes": 29508934656, + "generated_tokens_including_batch_padding": 1704, + "outputs": [ + { + "condition": "s0_eos", + "factors": { + "system": 0, + "history": "filler", + "boundary": "eos", + "token_class": "special" + }, + "prompt_tokens": 131, + "left_padding_tokens": 16, + "prompt_token_ids_sha256": "af8148f2dd065587b6d5a13e8fe115de24ccbdaa6dacd40254d522b17c1ff83b", + "generated_tokens": 213, + "generated_token_ids": [ + 2195, + 1063, + 60522, + 20570, + 56543, + 207, + 17, + 15, + 29120, + 327, + 9746, + 13, + 185, + 10005, + 15122, + 438, + 13552, + 207, + 17, + 15, + 19121, + 280, + 33732, + 11384, + 13, + 185, + 3139, + 11, + 254, + 3223, + 3744, + 280, + 33732, + 11384, + 344, + 438, + 56543, + 317, + 207, + 17, + 15, + 29120, + 575, + 207, + 17, + 15, + 19121, + 14, + 652, + 2440, + 403, + 207, + 19, + 15, + 15, + 19121, + 13, + 185, + 185, + 12201, + 3821, + 1166, + 254, + 29120, + 661, + 31334, + 11, + 2195, + 1063, + 60522, + 20570, + 2149, + 254, + 4921, + 344, + 245, + 8404, + 280, + 254, + 1604, + 280, + 284, + 256, + 2228, + 56543, + 327, + 9746, + 661, + 16666, + 28715, + 331, + 254, + 4559, + 285, + 1027, + 441, + 7908, + 254, + 33732, + 34317, + 276, + 254, + 20291, + 13, + 185, + 185, + 32, + 8404, + 280, + 254, + 1604, + 280, + 284, + 256, + 2228, + 56543, + 327, + 9746, + 317, + 207, + 16, + 14, + 19, + 575, + 207, + 17, + 15, + 29120, + 403, + 207, + 20, + 29120, + 13, + 185, + 185, + 6723, + 207, + 20, + 29120, + 1027, + 441, + 7908, + 704, + 207, + 20, + 29120, + 575, + 207, + 17, + 15, + 19121, + 14, + 652, + 2440, + 403, + 207, + 16, + 15, + 15, + 19121, + 280, + 33732, + 11384, + 13, + 185, + 185, + 3139, + 11, + 254, + 3223, + 3744, + 280, + 33732, + 11384, + 344, + 6889, + 254, + 20291, + 344, + 1492, + 317, + 207, + 19, + 15, + 15, + 19121, + 570, + 207, + 16, + 15, + 15, + 19121, + 403, + 207, + 18, + 15, + 15, + 19121, + 13, + 185, + 185, + 3139, + 254, + 3510, + 317, + 628, + 63962, + 90, + 18, + 15, + 15, + 3013, + 100001 + ], + "generated_token_ids_sha256": "a0c4de5c6c0c4969c0afed16c01332c372d253d54f6567899c51b9cb7cabf19a", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " Mr Hezekiah dispatched 20 trucks for delivery.\nEach truck was carrying 20 tons of fertiliser.\nSo, the total amount of fertiliser that was dispatched is 20 trucks * 20 tons/truck = 400 tons.\n\nTwo hours after the trucks had departed, Mr Hezekiah got the news that a quarter of the number of lorries dispatched for delivery had mechanical failures on the road and could not deliver the fertilisers to the farmers.\n\nA quarter of the number of lorries dispatched for delivery is 1/4 * 20 trucks = 5 trucks.\n\nThese 5 trucks could not deliver their 5 trucks * 20 tons/truck = 100 tons of fertiliser.\n\nSo, the total amount of fertiliser that reached the farmers that day is 400 tons - 100 tons = 300 tons.\n\nSo the answer is $\\boxed{300}$.", + "text_sha256": "4d8fe3fdd2261d4523c8736a0f065cf8e209595cc2a2f19448a3b35cab3c9c3c", + "task_score": { + "gold_final": "300", + "predicted_final": "300", + "final_numeric_exact": true + } + }, + { + "condition": "s1_eos", + "factors": { + "system": 1, + "history": "filler", + "boundary": "eos", + "token_class": "special" + }, + "prompt_tokens": 147, + "left_padding_tokens": 0, + "prompt_token_ids_sha256": "6fc9f186b31f6926a443a0d8218e5e92ff09af381a872054c954792ca2d2204f", + "generated_tokens": 213, + "generated_token_ids": [ + 2195, + 1063, + 60522, + 20570, + 56543, + 207, + 17, + 15, + 29120, + 327, + 9746, + 13, + 185, + 10005, + 15122, + 438, + 13552, + 207, + 17, + 15, + 19121, + 280, + 33732, + 11384, + 13, + 185, + 3139, + 11, + 254, + 3223, + 3744, + 280, + 33732, + 11384, + 344, + 438, + 56543, + 317, + 207, + 17, + 15, + 29120, + 575, + 207, + 17, + 15, + 19121, + 14, + 652, + 2440, + 403, + 207, + 19, + 15, + 15, + 19121, + 13, + 185, + 185, + 12201, + 3821, + 1166, + 254, + 29120, + 661, + 31334, + 11, + 2195, + 1063, + 60522, + 20570, + 2149, + 254, + 4921, + 344, + 245, + 8404, + 280, + 254, + 1604, + 280, + 284, + 256, + 2228, + 56543, + 327, + 9746, + 661, + 16666, + 28715, + 331, + 254, + 4559, + 285, + 1027, + 441, + 7908, + 254, + 33732, + 34317, + 276, + 254, + 20291, + 13, + 185, + 185, + 32, + 8404, + 280, + 254, + 1604, + 280, + 284, + 256, + 2228, + 56543, + 327, + 9746, + 317, + 207, + 16, + 14, + 19, + 575, + 207, + 17, + 15, + 29120, + 403, + 207, + 20, + 29120, + 13, + 185, + 185, + 6723, + 207, + 20, + 29120, + 1027, + 441, + 7908, + 704, + 207, + 20, + 29120, + 575, + 207, + 17, + 15, + 19121, + 14, + 652, + 2440, + 403, + 207, + 16, + 15, + 15, + 19121, + 280, + 33732, + 11384, + 13, + 185, + 185, + 3139, + 11, + 254, + 3223, + 3744, + 280, + 33732, + 11384, + 344, + 6889, + 254, + 20291, + 344, + 1492, + 317, + 207, + 19, + 15, + 15, + 19121, + 570, + 207, + 16, + 15, + 15, + 19121, + 403, + 207, + 18, + 15, + 15, + 19121, + 13, + 185, + 185, + 3139, + 254, + 3510, + 317, + 628, + 63962, + 90, + 18, + 15, + 15, + 3013, + 100001 + ], + "generated_token_ids_sha256": "a0c4de5c6c0c4969c0afed16c01332c372d253d54f6567899c51b9cb7cabf19a", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " Mr Hezekiah dispatched 20 trucks for delivery.\nEach truck was carrying 20 tons of fertiliser.\nSo, the total amount of fertiliser that was dispatched is 20 trucks * 20 tons/truck = 400 tons.\n\nTwo hours after the trucks had departed, Mr Hezekiah got the news that a quarter of the number of lorries dispatched for delivery had mechanical failures on the road and could not deliver the fertilisers to the farmers.\n\nA quarter of the number of lorries dispatched for delivery is 1/4 * 20 trucks = 5 trucks.\n\nThese 5 trucks could not deliver their 5 trucks * 20 tons/truck = 100 tons of fertiliser.\n\nSo, the total amount of fertiliser that reached the farmers that day is 400 tons - 100 tons = 300 tons.\n\nSo the answer is $\\boxed{300}$.", + "text_sha256": "4d8fe3fdd2261d4523c8736a0f065cf8e209595cc2a2f19448a3b35cab3c9c3c", + "task_score": { + "gold_final": "300", + "predicted_final": "300", + "final_numeric_exact": true + } + }, + { + "condition": "s0_bos", + "factors": { + "system": 0, + "history": "filler", + "boundary": "bos", + "token_class": "special" + }, + "prompt_tokens": 131, + "left_padding_tokens": 16, + "prompt_token_ids_sha256": "24dd306a5686c350327c6a23c72a83fc0e9539674bb9956eb3527c68914b70cc", + "generated_tokens": 211, + "generated_token_ids": [ + 2195, + 1063, + 60522, + 20570, + 56543, + 207, + 17, + 15, + 29120, + 327, + 9746, + 13, + 185, + 10005, + 15122, + 438, + 13552, + 207, + 17, + 15, + 19121, + 280, + 33732, + 11384, + 13, + 185, + 3139, + 11, + 254, + 3223, + 3744, + 280, + 33732, + 11384, + 56543, + 438, + 207, + 17, + 15, + 29120, + 575, + 207, + 17, + 15, + 19121, + 14, + 652, + 2440, + 403, + 207, + 19, + 15, + 15, + 19121, + 13, + 185, + 185, + 12201, + 3821, + 1166, + 254, + 29120, + 661, + 31334, + 11, + 2195, + 1063, + 60522, + 20570, + 2149, + 254, + 4921, + 344, + 245, + 8404, + 280, + 254, + 1604, + 280, + 284, + 256, + 2228, + 56543, + 327, + 9746, + 661, + 16666, + 28715, + 331, + 254, + 4559, + 285, + 1027, + 441, + 7908, + 254, + 33732, + 34317, + 276, + 254, + 20291, + 13, + 185, + 185, + 32, + 8404, + 280, + 254, + 1604, + 280, + 284, + 256, + 2228, + 56543, + 327, + 9746, + 317, + 207, + 16, + 14, + 19, + 575, + 207, + 17, + 15, + 29120, + 403, + 207, + 20, + 29120, + 13, + 185, + 185, + 6723, + 207, + 20, + 29120, + 1027, + 441, + 7908, + 704, + 207, + 20, + 29120, + 575, + 207, + 17, + 15, + 19121, + 14, + 652, + 2440, + 403, + 207, + 16, + 15, + 15, + 19121, + 280, + 33732, + 11384, + 13, + 185, + 185, + 3139, + 11, + 254, + 3223, + 3744, + 280, + 33732, + 11384, + 344, + 6889, + 254, + 20291, + 344, + 1492, + 438, + 207, + 19, + 15, + 15, + 19121, + 570, + 207, + 16, + 15, + 15, + 19121, + 403, + 207, + 18, + 15, + 15, + 19121, + 13, + 185, + 185, + 3139, + 254, + 3510, + 317, + 628, + 63962, + 90, + 18, + 15, + 15, + 3013, + 100001 + ], + "generated_token_ids_sha256": "b738f6a3caaffcb4c50909ea3ccdaed5844ea82db16e73baffffa214396623b7", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " Mr Hezekiah dispatched 20 trucks for delivery.\nEach truck was carrying 20 tons of fertiliser.\nSo, the total amount of fertiliser dispatched was 20 trucks * 20 tons/truck = 400 tons.\n\nTwo hours after the trucks had departed, Mr Hezekiah got the news that a quarter of the number of lorries dispatched for delivery had mechanical failures on the road and could not deliver the fertilisers to the farmers.\n\nA quarter of the number of lorries dispatched for delivery is 1/4 * 20 trucks = 5 trucks.\n\nThese 5 trucks could not deliver their 5 trucks * 20 tons/truck = 100 tons of fertiliser.\n\nSo, the total amount of fertiliser that reached the farmers that day was 400 tons - 100 tons = 300 tons.\n\nSo the answer is $\\boxed{300}$.", + "text_sha256": "ac292517068f24a3c029f08cc0d9d70edcfd32b845825ad0a466af0980cb6ead", + "task_score": { + "gold_final": "300", + "predicted_final": "300", + "final_numeric_exact": true + } + }, + { + "condition": "s1_bos", + "factors": { + "system": 1, + "history": "filler", + "boundary": "bos", + "token_class": "special" + }, + "prompt_tokens": 147, + "left_padding_tokens": 0, + "prompt_token_ids_sha256": "9fb414bf7d783b9126038381d3d05e6c636a850ff5ce0c31e436a722dc0d9eba", + "generated_tokens": 192, + "generated_token_ids": [ + 2195, + 1063, + 60522, + 20570, + 56543, + 207, + 17, + 15, + 29120, + 327, + 9746, + 13, + 185, + 10005, + 15122, + 438, + 13552, + 207, + 17, + 15, + 19121, + 280, + 33732, + 11384, + 13, + 185, + 3139, + 11, + 254, + 3223, + 3744, + 280, + 33732, + 11384, + 56543, + 438, + 207, + 17, + 15, + 29120, + 575, + 207, + 17, + 15, + 19121, + 14, + 652, + 2440, + 403, + 207, + 19, + 15, + 15, + 19121, + 13, + 185, + 185, + 12201, + 3821, + 1166, + 254, + 29120, + 661, + 31334, + 11, + 245, + 8404, + 280, + 254, + 1604, + 280, + 284, + 256, + 2228, + 56543, + 327, + 9746, + 661, + 16666, + 28715, + 13, + 185, + 1567, + 2456, + 344, + 207, + 16, + 14, + 19, + 575, + 207, + 17, + 15, + 29120, + 403, + 207, + 20, + 29120, + 661, + 16666, + 28715, + 13, + 185, + 185, + 549, + 29120, + 344, + 1216, + 441, + 463, + 16666, + 28715, + 778, + 207, + 17, + 15, + 29120, + 570, + 207, + 20, + 29120, + 403, + 207, + 16, + 20, + 29120, + 13, + 185, + 185, + 6723, + 207, + 16, + 20, + 29120, + 778, + 2249, + 276, + 7908, + 254, + 33732, + 34317, + 276, + 254, + 20291, + 13, + 185, + 3139, + 11, + 254, + 3223, + 3744, + 280, + 33732, + 11384, + 344, + 6889, + 254, + 20291, + 438, + 207, + 16, + 20, + 29120, + 575, + 207, + 17, + 15, + 19121, + 14, + 652, + 2440, + 403, + 207, + 18, + 15, + 15, + 19121, + 13, + 185, + 185, + 3139, + 254, + 3510, + 317, + 628, + 63962, + 90, + 18, + 15, + 15, + 3013, + 100001 + ], + "generated_token_ids_sha256": "55777717b0868223d1ea198ec487f5fc8594b132b9802458ac8258ace944894b", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " Mr Hezekiah dispatched 20 trucks for delivery.\nEach truck was carrying 20 tons of fertiliser.\nSo, the total amount of fertiliser dispatched was 20 trucks * 20 tons/truck = 400 tons.\n\nTwo hours after the trucks had departed, a quarter of the number of lorries dispatched for delivery had mechanical failures.\nThis means that 1/4 * 20 trucks = 5 trucks had mechanical failures.\n\nThe trucks that did not have mechanical failures were 20 trucks - 5 trucks = 15 trucks.\n\nThese 15 trucks were able to deliver the fertilisers to the farmers.\nSo, the total amount of fertiliser that reached the farmers was 15 trucks * 20 tons/truck = 300 tons.\n\nSo the answer is $\\boxed{300}$.", + "text_sha256": "c4c5873b576c645844d6dc3be7116075f14516f5f9e6373b20e46c341a51cf51", + "task_score": { + "gold_final": "300", + "predicted_final": "300", + "final_numeric_exact": true + } + }, + { + "condition": "s0_x", + "factors": { + "system": 0, + "history": "filler", + "boundary": "x", + "token_class": "ordinary_control" + }, + "prompt_tokens": 131, + "left_padding_tokens": 16, + "prompt_token_ids_sha256": "649621b617e9d4e0eeb4cd1bfa2abde7beba97e78de3598f23447098686b2252", + "generated_tokens": 184, + "generated_token_ids": [ + 2195, + 1063, + 60522, + 20570, + 56543, + 207, + 17, + 15, + 29120, + 327, + 9746, + 13, + 185, + 10005, + 15122, + 438, + 13552, + 207, + 17, + 15, + 19121, + 280, + 33732, + 11384, + 13, + 185, + 3139, + 11, + 254, + 3223, + 3744, + 280, + 33732, + 11384, + 344, + 438, + 8548, + 276, + 330, + 11803, + 438, + 207, + 17, + 15, + 29120, + 575, + 207, + 17, + 15, + 19121, + 14, + 652, + 2440, + 403, + 207, + 19, + 15, + 15, + 19121, + 13, + 185, + 185, + 6501, + 11, + 245, + 8404, + 280, + 254, + 29120, + 661, + 16666, + 28715, + 285, + 1027, + 441, + 7908, + 254, + 33732, + 34317, + 13, + 185, + 3139, + 11, + 254, + 1604, + 280, + 29120, + 344, + 661, + 16666, + 28715, + 317, + 207, + 17, + 15, + 29120, + 893, + 207, + 19, + 403, + 207, + 20, + 29120, + 13, + 185, + 185, + 6723, + 207, + 20, + 29120, + 778, + 8548, + 276, + 7908, + 207, + 20, + 29120, + 575, + 207, + 17, + 15, + 19121, + 14, + 652, + 2440, + 403, + 207, + 16, + 15, + 15, + 19121, + 280, + 33732, + 11384, + 13, + 185, + 185, + 14494, + 11, + 254, + 3223, + 3744, + 280, + 33732, + 11384, + 344, + 6889, + 254, + 20291, + 344, + 1492, + 438, + 207, + 19, + 15, + 15, + 19121, + 570, + 207, + 16, + 15, + 15, + 19121, + 403, + 207, + 18, + 15, + 15, + 19121, + 13, + 185, + 185, + 3139, + 254, + 3510, + 317, + 628, + 63962, + 90, + 18, + 15, + 15, + 3013, + 100001 + ], + "generated_token_ids_sha256": "4c98c4e91046a2a824091a214e088a761f6ae68023ce6fe04e125539c60882a4", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " Mr Hezekiah dispatched 20 trucks for delivery.\nEach truck was carrying 20 tons of fertiliser.\nSo, the total amount of fertiliser that was supposed to be delivered was 20 trucks * 20 tons/truck = 400 tons.\n\nHowever, a quarter of the trucks had mechanical failures and could not deliver the fertilisers.\nSo, the number of trucks that had mechanical failures is 20 trucks / 4 = 5 trucks.\n\nThese 5 trucks were supposed to deliver 5 trucks * 20 tons/truck = 100 tons of fertiliser.\n\nTherefore, the total amount of fertiliser that reached the farmers that day was 400 tons - 100 tons = 300 tons.\n\nSo the answer is $\\boxed{300}$.", + "text_sha256": "84282454ce6b5b1416b2183303027126d577e0e1e93b62181dbf925922cca498", + "task_score": { + "gold_final": "300", + "predicted_final": "300", + "final_numeric_exact": true + } + }, + { + "condition": "s1_x", + "factors": { + "system": 1, + "history": "filler", + "boundary": "x", + "token_class": "ordinary_control" + }, + "prompt_tokens": 147, + "left_padding_tokens": 0, + "prompt_token_ids_sha256": "a846fa2918690d92f2ebda2b3478d1c61be06006d33f21cc62b46e565398da36", + "generated_tokens": 112, + "generated_token_ids": [ + 2195, + 1063, + 60522, + 20570, + 56543, + 207, + 17, + 15, + 29120, + 11, + 548, + 245, + 8404, + 280, + 768, + 661, + 16666, + 28715, + 13, + 338, + 8404, + 280, + 207, + 17, + 15, + 317, + 207, + 17, + 15, + 14, + 19, + 403, + 207, + 20, + 29120, + 13, + 185, + 3139, + 11, + 207, + 17, + 15, + 570, + 207, + 20, + 403, + 207, + 16, + 20, + 29120, + 778, + 2249, + 276, + 7908, + 254, + 33732, + 34317, + 276, + 254, + 20291, + 13, + 185, + 10005, + 15122, + 438, + 13552, + 207, + 17, + 15, + 19121, + 280, + 33732, + 11384, + 11, + 558, + 254, + 3223, + 1604, + 280, + 19121, + 280, + 33732, + 11384, + 344, + 6889, + 254, + 20291, + 317, + 207, + 16, + 20, + 575, + 207, + 17, + 15, + 403, + 207, + 18, + 15, + 15, + 19121, + 13, + 185, + 549, + 3510, + 317, + 25, + 207, + 18, + 15, + 15, + 100001 + ], + "generated_token_ids_sha256": "38b791aa6f593bb8cc65ab6404ad8b9b9f4026d1f667701d06b7c88597ee07dd", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " Mr Hezekiah dispatched 20 trucks, but a quarter of them had mechanical failures. A quarter of 20 is 20/4 = 5 trucks.\nSo, 20 - 5 = 15 trucks were able to deliver the fertilisers to the farmers.\nEach truck was carrying 20 tons of fertiliser, so the total number of tons of fertiliser that reached the farmers is 15 * 20 = 300 tons.\nThe answer is: 300", + "text_sha256": "79ea0183839c01a5e4e2f93ebc4e65ebfa7c47b626ae808efe0bac0fdf7380b2", + "task_score": { + "gold_final": "300", + "predicted_final": "300", + "final_numeric_exact": true + } + }, + { + "condition": "s0_period", + "factors": { + "system": 0, + "history": "filler", + "boundary": "period", + "token_class": "ordinary_control" + }, + "prompt_tokens": 131, + "left_padding_tokens": 16, + "prompt_token_ids_sha256": "c9871468f54fb12742eb484332b45383b61d6ba4fc0250e2f2d929165251b35b", + "generated_tokens": 194, + "generated_token_ids": [ + 2195, + 1063, + 60522, + 20570, + 56543, + 207, + 17, + 15, + 29120, + 327, + 9746, + 13, + 185, + 10005, + 15122, + 438, + 13552, + 207, + 17, + 15, + 19121, + 280, + 33732, + 11384, + 13, + 185, + 3139, + 11, + 254, + 3223, + 3744, + 280, + 33732, + 11384, + 344, + 438, + 56543, + 317, + 207, + 17, + 15, + 29120, + 575, + 207, + 17, + 15, + 19121, + 14, + 652, + 2440, + 403, + 207, + 19, + 15, + 15, + 19121, + 13, + 185, + 185, + 12201, + 3821, + 1166, + 254, + 29120, + 661, + 31334, + 11, + 245, + 8404, + 280, + 254, + 1604, + 280, + 284, + 256, + 2228, + 56543, + 327, + 9746, + 661, + 16666, + 28715, + 13, + 185, + 1567, + 2456, + 344, + 207, + 16, + 14, + 19, + 575, + 207, + 17, + 15, + 29120, + 403, + 207, + 20, + 29120, + 661, + 16666, + 28715, + 13, + 185, + 185, + 549, + 29120, + 344, + 1216, + 441, + 463, + 16666, + 28715, + 778, + 207, + 17, + 15, + 29120, + 570, + 207, + 20, + 29120, + 403, + 207, + 16, + 20, + 29120, + 13, + 185, + 185, + 6723, + 207, + 16, + 20, + 29120, + 778, + 2249, + 276, + 7908, + 254, + 33732, + 34317, + 276, + 254, + 20291, + 13, + 185, + 3139, + 11, + 254, + 3223, + 3744, + 280, + 33732, + 11384, + 344, + 6889, + 254, + 20291, + 317, + 207, + 16, + 20, + 29120, + 575, + 207, + 17, + 15, + 19121, + 14, + 652, + 2440, + 403, + 207, + 18, + 15, + 15, + 19121, + 13, + 185, + 185, + 3139, + 254, + 3510, + 317, + 628, + 63962, + 90, + 18, + 15, + 15, + 3013, + 100001 + ], + "generated_token_ids_sha256": "856bc8e1e2434f61ca08f9dbb492b079dd8e2c05ddefb24cc992f2dec5bb328b", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " Mr Hezekiah dispatched 20 trucks for delivery.\nEach truck was carrying 20 tons of fertiliser.\nSo, the total amount of fertiliser that was dispatched is 20 trucks * 20 tons/truck = 400 tons.\n\nTwo hours after the trucks had departed, a quarter of the number of lorries dispatched for delivery had mechanical failures.\nThis means that 1/4 * 20 trucks = 5 trucks had mechanical failures.\n\nThe trucks that did not have mechanical failures were 20 trucks - 5 trucks = 15 trucks.\n\nThese 15 trucks were able to deliver the fertilisers to the farmers.\nSo, the total amount of fertiliser that reached the farmers is 15 trucks * 20 tons/truck = 300 tons.\n\nSo the answer is $\\boxed{300}$.", + "text_sha256": "aeb498f00b41e408290a9d50299a1591c11c03e6c77d2de1d01bd6f29321b93a", + "task_score": { + "gold_final": "300", + "predicted_final": "300", + "final_numeric_exact": true + } + }, + { + "condition": "s1_period", + "factors": { + "system": 1, + "history": "filler", + "boundary": "period", + "token_class": "ordinary_control" + }, + "prompt_tokens": 147, + "left_padding_tokens": 0, + "prompt_token_ids_sha256": "c2f1b1ae4a81b97e603806b23729d92b118bc3de70c647ae0d91c62f6b6912cc", + "generated_tokens": 192, + "generated_token_ids": [ + 2195, + 1063, + 60522, + 20570, + 56543, + 207, + 17, + 15, + 29120, + 11, + 1319, + 13552, + 207, + 17, + 15, + 19121, + 280, + 33732, + 11384, + 13, + 2086, + 11, + 254, + 3223, + 3744, + 280, + 33732, + 11384, + 56543, + 317, + 207, + 17, + 15, + 29120, + 575, + 207, + 17, + 15, + 19121, + 14, + 652, + 2440, + 403, + 207, + 19, + 15, + 15, + 19121, + 13, + 185, + 185, + 12201, + 3821, + 1166, + 254, + 29120, + 661, + 31334, + 11, + 245, + 8404, + 280, + 254, + 1604, + 280, + 284, + 256, + 2228, + 56543, + 327, + 9746, + 661, + 16666, + 28715, + 13, + 1002, + 2456, + 207, + 16, + 14, + 19, + 575, + 207, + 17, + 15, + 29120, + 403, + 207, + 20, + 29120, + 661, + 16666, + 28715, + 13, + 185, + 185, + 7094, + 1069, + 207, + 20, + 29120, + 661, + 16666, + 28715, + 11, + 657, + 1027, + 441, + 7908, + 254, + 33732, + 34317, + 276, + 254, + 20291, + 13, + 7536, + 11, + 254, + 3223, + 3744, + 280, + 33732, + 11384, + 344, + 6889, + 254, + 20291, + 317, + 207, + 19, + 15, + 15, + 19121, + 570, + 207, + 20, + 29120, + 575, + 207, + 17, + 15, + 19121, + 14, + 652, + 2440, + 403, + 207, + 19, + 15, + 15, + 19121, + 570, + 207, + 16, + 15, + 15, + 19121, + 403, + 207, + 18, + 15, + 15, + 19121, + 13, + 185, + 185, + 3139, + 11, + 254, + 3223, + 1604, + 280, + 19121, + 280, + 33732, + 11384, + 344, + 6889, + 254, + 20291, + 344, + 1492, + 317, + 628, + 63962, + 90, + 18, + 15, + 15, + 3013, + 100001 + ], + "generated_token_ids_sha256": "338c0ec1841319140ecf9bd5c7416a581dbd88786a5044ada648010791ebcfc1", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " Mr Hezekiah dispatched 20 trucks, each carrying 20 tons of fertiliser. So, the total amount of fertiliser dispatched is 20 trucks * 20 tons/truck = 400 tons.\n\nTwo hours after the trucks had departed, a quarter of the number of lorries dispatched for delivery had mechanical failures. This means 1/4 * 20 trucks = 5 trucks had mechanical failures.\n\nSince these 5 trucks had mechanical failures, they could not deliver the fertilisers to the farmers. Therefore, the total amount of fertiliser that reached the farmers is 400 tons - 5 trucks * 20 tons/truck = 400 tons - 100 tons = 300 tons.\n\nSo, the total number of tons of fertiliser that reached the farmers that day is $\\boxed{300}$.", + "text_sha256": "d9d4408fa27b8aa6f41cb3741927117dd7b4be0b70e085c0efa202769811258e", + "task_score": { + "gold_final": "300", + "predicted_final": "300", + "final_numeric_exact": true + } + } + ] + }, + { + "id": "gsm8k/test/1228", + "domain": "math", + "label": "Grade-school math", + "within_domain_index": 1, + "selection_rank": "002201d4cbc0b85d338597dcb68c3ffd4d00ef12b7b44e352c5bc1911d6fa984", + "source_text_sha256": "3931b6363f3a060ca7cb0774662127e64007e9f34ce209edddca77425e20a479", + "source_characters": 152, + "source_tokens": 36, + "prompt_tokens_by_condition": { + "s0_eos": 59, + "s1_eos": 75, + "s0_bos": 59, + "s1_bos": 75, + "s0_x": 59, + "s1_x": 75, + "s0_period": 59, + "s1_period": 75 + }, + "batch_prompt_tokens_after_left_padding": 75, + "batch_padding_side": "left", + "batch_conditions": 8, + "generation_seconds": 52.18084531198838, + "peak_cuda_memory_allocated_bytes": 29389477376, + "generated_tokens_including_batch_padding": 2064, + "outputs": [ + { + "condition": "s0_eos", + "factors": { + "system": 0, + "history": "filler", + "boundary": "eos", + "token_class": "special" + }, + "prompt_tokens": 59, + "left_padding_tokens": 16, + "prompt_token_ids_sha256": "32ada50df0fccf416d8c91e21dbb4bdd2246fcd7afaa04a69f1f38fc50f8ca5c", + "generated_tokens": 258, + "generated_token_ids": [ + 3960, + 6, + 82, + 9211, + 254, + 1604, + 280, + 27003, + 1319, + 1491, + 643, + 372, + 4446, + 25, + 185, + 185, + 12, + 73770, + 403, + 324, + 185, + 12, + 61250, + 403, + 1783, + 185, + 12, + 17654, + 403, + 721, + 185, + 185, + 4044, + 254, + 2066, + 11, + 395, + 1006, + 344, + 25, + 185, + 185, + 16, + 13, + 73770, + 643, + 207, + 16, + 17, + 17966, + 27003, + 853, + 61250, + 11, + 558, + 395, + 481, + 3708, + 437, + 372, + 25, + 324, + 403, + 1783, + 570, + 207, + 16, + 17, + 185, + 17, + 13, + 61250, + 643, + 207, + 23, + 691, + 27003, + 853, + 17654, + 11, + 558, + 395, + 481, + 3708, + 437, + 372, + 25, + 1783, + 403, + 721, + 919, + 207, + 23, + 185, + 18, + 13, + 73770, + 643, + 207, + 17, + 22, + 27003, + 11, + 558, + 395, + 481, + 22463, + 324, + 403, + 207, + 17, + 22, + 881, + 254, + 1022, + 6337, + 25, + 207, + 17, + 22, + 403, + 1783, + 570, + 207, + 16, + 17, + 185, + 19, + 13, + 1003, + 481, + 8708, + 437, + 6337, + 327, + 1783, + 276, + 1275, + 636, + 946, + 1313, + 27003, + 61250, + 643, + 13, + 32966, + 207, + 16, + 17, + 276, + 1572, + 9226, + 280, + 254, + 6337, + 4380, + 450, + 25, + 1783, + 403, + 207, + 17, + 22, + 919, + 207, + 16, + 17, + 403, + 207, + 18, + 24, + 185, + 20, + 13, + 4201, + 344, + 395, + 1006, + 61250, + 643, + 207, + 18, + 24, + 27003, + 11, + 395, + 481, + 22463, + 1783, + 403, + 207, + 18, + 24, + 881, + 254, + 1864, + 6337, + 276, + 1275, + 636, + 946, + 1313, + 27003, + 17654, + 643, + 25, + 207, + 18, + 24, + 403, + 721, + 919, + 207, + 23, + 185, + 21, + 13, + 5905, + 83, + 31278, + 207, + 23, + 473, + 1572, + 9226, + 280, + 254, + 6337, + 4380, + 450, + 25, + 721, + 403, + 207, + 18, + 24, + 570, + 207, + 23, + 403, + 207, + 18, + 16, + 185, + 185, + 3139, + 11, + 17654, + 643, + 628, + 63962, + 90, + 18, + 16, + 759, + 27003, + 13, + 100001 + ], + "generated_token_ids_sha256": "9cc560caf3a938fc32017f947e010168e6bcf6b5e598ec3d5be1727a029d9cc9", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " Let's denote the number of paintings each person has as follows:\n\n- Samantha = S\n- Shelley = Sh\n- Kim = K\n\nFrom the problem, we know that:\n\n1. Samantha has 12 fewer paintings than Shelley, so we can write this as: S = Sh - 12\n2. Shelley has 8 more paintings than Kim, so we can write this as: Sh = K + 8\n3. Samantha has 27 paintings, so we can substitute S = 27 into the first equation: 27 = Sh - 12\n4. We can solve this equation for Sh to find out how many paintings Shelley has. Adding 12 to both sides of the equation gives us: Sh = 27 + 12 = 39\n5. Now that we know Shelley has 39 paintings, we can substitute Sh = 39 into the second equation to find out how many paintings Kim has: 39 = K + 8\n6. Subtracting 8 from both sides of the equation gives us: K = 39 - 8 = 31\n\nSo, Kim has $\\boxed{31}$ paintings.", + "text_sha256": "c8a0aac02a6758a7c6f0376d15cd2ef09108e42169487348475591c5ec76d89d", + "task_score": { + "gold_final": "31", + "predicted_final": "31", + "final_numeric_exact": true + } + }, + { + "condition": "s1_eos", + "factors": { + "system": 1, + "history": "filler", + "boundary": "eos", + "token_class": "special" + }, + "prompt_tokens": 75, + "left_padding_tokens": 0, + "prompt_token_ids_sha256": "f30e793e92ed3c09cac2e94c1d37a636ca60e1ff8d4e540bd4bb32914bc9f728", + "generated_tokens": 215, + "generated_token_ids": [ + 3960, + 6, + 82, + 9211, + 254, + 1604, + 280, + 27003, + 1319, + 1491, + 643, + 372, + 4446, + 25, + 185, + 185, + 12, + 73770, + 403, + 324, + 185, + 12, + 61250, + 403, + 1783, + 185, + 12, + 17654, + 403, + 721, + 185, + 185, + 4044, + 254, + 2066, + 11, + 395, + 1006, + 344, + 25, + 185, + 185, + 16, + 13, + 73770, + 643, + 207, + 16, + 17, + 17966, + 27003, + 853, + 61250, + 11, + 558, + 395, + 481, + 3708, + 437, + 372, + 25, + 324, + 403, + 1783, + 570, + 207, + 16, + 17, + 185, + 17, + 13, + 61250, + 643, + 207, + 23, + 691, + 27003, + 853, + 17654, + 11, + 558, + 395, + 481, + 3708, + 437, + 372, + 25, + 1783, + 403, + 721, + 919, + 207, + 23, + 185, + 18, + 13, + 73770, + 643, + 207, + 17, + 22, + 27003, + 11, + 558, + 395, + 481, + 22463, + 324, + 403, + 207, + 17, + 22, + 881, + 254, + 1022, + 6337, + 25, + 207, + 17, + 22, + 403, + 1783, + 570, + 207, + 16, + 17, + 185, + 19, + 13, + 1003, + 481, + 8708, + 437, + 6337, + 327, + 1783, + 276, + 1275, + 636, + 946, + 1313, + 27003, + 61250, + 643, + 25, + 1783, + 403, + 207, + 17, + 22, + 919, + 207, + 16, + 17, + 403, + 207, + 18, + 24, + 185, + 20, + 13, + 4201, + 395, + 481, + 22463, + 1783, + 403, + 207, + 18, + 24, + 881, + 254, + 1864, + 6337, + 276, + 1275, + 636, + 946, + 1313, + 27003, + 17654, + 643, + 25, + 721, + 403, + 1783, + 570, + 207, + 23, + 403, + 207, + 18, + 24, + 570, + 207, + 23, + 403, + 207, + 18, + 16, + 185, + 185, + 3139, + 11, + 17654, + 643, + 628, + 63962, + 90, + 18, + 16, + 759, + 27003, + 13, + 100001 + ], + "generated_token_ids_sha256": "b8c489fbc4938fedc1dbdf1bdcb5e3e83413e50b2c7902608155b89aa75a4379", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " Let's denote the number of paintings each person has as follows:\n\n- Samantha = S\n- Shelley = Sh\n- Kim = K\n\nFrom the problem, we know that:\n\n1. Samantha has 12 fewer paintings than Shelley, so we can write this as: S = Sh - 12\n2. Shelley has 8 more paintings than Kim, so we can write this as: Sh = K + 8\n3. Samantha has 27 paintings, so we can substitute S = 27 into the first equation: 27 = Sh - 12\n4. We can solve this equation for Sh to find out how many paintings Shelley has: Sh = 27 + 12 = 39\n5. Now we can substitute Sh = 39 into the second equation to find out how many paintings Kim has: K = Sh - 8 = 39 - 8 = 31\n\nSo, Kim has $\\boxed{31}$ paintings.", + "text_sha256": "1312a7833a48f3d6c3299ce72be93b235d726dbca1e3a433593197d93dd64331", + "task_score": { + "gold_final": "31", + "predicted_final": "31", + "final_numeric_exact": true + } + }, + { + "condition": "s0_bos", + "factors": { + "system": 0, + "history": "filler", + "boundary": "bos", + "token_class": "special" + }, + "prompt_tokens": 59, + "left_padding_tokens": 16, + "prompt_token_ids_sha256": "d5adb63b1170d4de4efa1a3bd0d7a788716fcbcc0c917b69c18b5337bdc916f2", + "generated_tokens": 228, + "generated_token_ids": [ + 3960, + 6, + 82, + 9211, + 254, + 1604, + 280, + 27003, + 1319, + 1491, + 643, + 372, + 4446, + 25, + 185, + 185, + 12, + 73770, + 403, + 324, + 185, + 12, + 61250, + 403, + 1783, + 185, + 12, + 17654, + 403, + 721, + 185, + 185, + 4044, + 254, + 2066, + 11, + 395, + 1006, + 344, + 25, + 185, + 185, + 16, + 13, + 73770, + 643, + 207, + 16, + 17, + 17966, + 27003, + 853, + 61250, + 11, + 558, + 395, + 481, + 3708, + 437, + 372, + 25, + 324, + 403, + 1783, + 570, + 207, + 16, + 17, + 185, + 17, + 13, + 61250, + 643, + 207, + 23, + 691, + 27003, + 853, + 17654, + 11, + 558, + 395, + 481, + 3708, + 437, + 372, + 25, + 1783, + 403, + 721, + 919, + 207, + 23, + 185, + 18, + 13, + 73770, + 643, + 207, + 17, + 22, + 27003, + 11, + 558, + 395, + 481, + 22463, + 324, + 403, + 207, + 17, + 22, + 881, + 254, + 1022, + 6337, + 25, + 207, + 17, + 22, + 403, + 1783, + 570, + 207, + 16, + 17, + 185, + 19, + 13, + 1003, + 481, + 8708, + 254, + 4443, + 6337, + 327, + 61250, + 6, + 82, + 1604, + 280, + 27003, + 25, + 1783, + 403, + 207, + 17, + 22, + 919, + 207, + 16, + 17, + 403, + 207, + 18, + 24, + 185, + 20, + 13, + 4201, + 395, + 481, + 22463, + 1783, + 403, + 207, + 18, + 24, + 881, + 254, + 1864, + 6337, + 276, + 1275, + 17654, + 6, + 82, + 1604, + 280, + 27003, + 25, + 207, + 18, + 24, + 403, + 721, + 919, + 207, + 23, + 185, + 21, + 13, + 6121, + 3562, + 254, + 11363, + 6337, + 327, + 721, + 4380, + 25, + 721, + 403, + 207, + 18, + 24, + 570, + 207, + 23, + 403, + 207, + 18, + 16, + 185, + 185, + 3139, + 11, + 17654, + 643, + 628, + 63962, + 90, + 18, + 16, + 759, + 27003, + 13, + 100001 + ], + "generated_token_ids_sha256": "3c75f913724f7bd8accd11869d5708e90371845a277702826bc6c0fe3b8d103b", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " Let's denote the number of paintings each person has as follows:\n\n- Samantha = S\n- Shelley = Sh\n- Kim = K\n\nFrom the problem, we know that:\n\n1. Samantha has 12 fewer paintings than Shelley, so we can write this as: S = Sh - 12\n2. Shelley has 8 more paintings than Kim, so we can write this as: Sh = K + 8\n3. Samantha has 27 paintings, so we can substitute S = 27 into the first equation: 27 = Sh - 12\n4. We can solve the third equation for Shelley's number of paintings: Sh = 27 + 12 = 39\n5. Now we can substitute Sh = 39 into the second equation to find Kim's number of paintings: 39 = K + 8\n6. Solving the fourth equation for K gives: K = 39 - 8 = 31\n\nSo, Kim has $\\boxed{31}$ paintings.", + "text_sha256": "4e98146ed4e9a3b3e68ef922b171cec2486f444f9ba788aaa67f8b96efcd5073", + "task_score": { + "gold_final": "31", + "predicted_final": "31", + "final_numeric_exact": true + } + }, + { + "condition": "s1_bos", + "factors": { + "system": 1, + "history": "filler", + "boundary": "bos", + "token_class": "special" + }, + "prompt_tokens": 75, + "left_padding_tokens": 0, + "prompt_token_ids_sha256": "b4cdcd54cc58f8c8f30968af667a84f2bdf51d2e846eacfd3940fe23d6c8d47d", + "generated_tokens": 228, + "generated_token_ids": [ + 3960, + 6, + 82, + 9211, + 254, + 1604, + 280, + 27003, + 1319, + 1491, + 643, + 372, + 4446, + 25, + 185, + 185, + 12, + 73770, + 403, + 324, + 185, + 12, + 61250, + 403, + 1783, + 185, + 12, + 17654, + 403, + 721, + 185, + 185, + 4044, + 254, + 2066, + 11, + 395, + 1006, + 344, + 25, + 185, + 185, + 16, + 13, + 73770, + 643, + 207, + 16, + 17, + 17966, + 27003, + 853, + 61250, + 11, + 558, + 395, + 481, + 3708, + 437, + 372, + 25, + 324, + 403, + 1783, + 570, + 207, + 16, + 17, + 185, + 17, + 13, + 61250, + 643, + 207, + 23, + 691, + 27003, + 853, + 17654, + 11, + 558, + 395, + 481, + 3708, + 437, + 372, + 25, + 1783, + 403, + 721, + 919, + 207, + 23, + 185, + 18, + 13, + 73770, + 643, + 207, + 17, + 22, + 27003, + 11, + 558, + 395, + 481, + 22463, + 324, + 403, + 207, + 17, + 22, + 881, + 254, + 1022, + 6337, + 25, + 207, + 17, + 22, + 403, + 1783, + 570, + 207, + 16, + 17, + 185, + 19, + 13, + 1003, + 481, + 8708, + 254, + 4443, + 6337, + 327, + 61250, + 6, + 82, + 1604, + 280, + 27003, + 25, + 1783, + 403, + 207, + 17, + 22, + 919, + 207, + 16, + 17, + 403, + 207, + 18, + 24, + 185, + 20, + 13, + 4201, + 395, + 481, + 22463, + 1783, + 403, + 207, + 18, + 24, + 881, + 254, + 1864, + 6337, + 276, + 1275, + 17654, + 6, + 82, + 1604, + 280, + 27003, + 25, + 207, + 18, + 24, + 403, + 721, + 919, + 207, + 23, + 185, + 21, + 13, + 6121, + 3562, + 254, + 11363, + 6337, + 327, + 721, + 4380, + 25, + 721, + 403, + 207, + 18, + 24, + 570, + 207, + 23, + 403, + 207, + 18, + 16, + 185, + 185, + 3139, + 11, + 17654, + 643, + 628, + 63962, + 90, + 18, + 16, + 759, + 27003, + 13, + 100001 + ], + "generated_token_ids_sha256": "3c75f913724f7bd8accd11869d5708e90371845a277702826bc6c0fe3b8d103b", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " Let's denote the number of paintings each person has as follows:\n\n- Samantha = S\n- Shelley = Sh\n- Kim = K\n\nFrom the problem, we know that:\n\n1. Samantha has 12 fewer paintings than Shelley, so we can write this as: S = Sh - 12\n2. Shelley has 8 more paintings than Kim, so we can write this as: Sh = K + 8\n3. Samantha has 27 paintings, so we can substitute S = 27 into the first equation: 27 = Sh - 12\n4. We can solve the third equation for Shelley's number of paintings: Sh = 27 + 12 = 39\n5. Now we can substitute Sh = 39 into the second equation to find Kim's number of paintings: 39 = K + 8\n6. Solving the fourth equation for K gives: K = 39 - 8 = 31\n\nSo, Kim has $\\boxed{31}$ paintings.", + "text_sha256": "4e98146ed4e9a3b3e68ef922b171cec2486f444f9ba788aaa67f8b96efcd5073", + "task_score": { + "gold_final": "31", + "predicted_final": "31", + "final_numeric_exact": true + } + }, + { + "condition": "s0_x", + "factors": { + "system": 0, + "history": "filler", + "boundary": "x", + "token_class": "ordinary_control" + }, + "prompt_tokens": 59, + "left_padding_tokens": 16, + "prompt_token_ids_sha256": "4f2aa6f9a7b8d503d88375079069a0eee4c1a3a4f777ada27d9de74dfbb5aa35", + "generated_tokens": 222, + "generated_token_ids": [ + 3960, + 6, + 82, + 9211, + 254, + 1604, + 280, + 27003, + 1319, + 1491, + 643, + 366, + 254, + 1022, + 5371, + 280, + 704, + 1210, + 13, + 2086, + 11, + 324, + 317, + 327, + 73770, + 11, + 1783, + 317, + 327, + 61250, + 11, + 285, + 721, + 317, + 327, + 17654, + 13, + 185, + 185, + 4044, + 254, + 2066, + 11, + 395, + 1006, + 344, + 73770, + 643, + 207, + 17, + 22, + 27003, + 13, + 1003, + 839, + 1006, + 344, + 73770, + 643, + 207, + 16, + 17, + 17966, + 27003, + 853, + 61250, + 13, + 2086, + 11, + 395, + 481, + 3708, + 437, + 372, + 25, + 185, + 185, + 2972, + 403, + 324, + 919, + 207, + 16, + 17, + 185, + 185, + 81089, + 254, + 1437, + 280, + 324, + 334, + 3262, + 317, + 207, + 17, + 22, + 8, + 881, + 254, + 6337, + 11, + 395, + 752, + 25, + 185, + 185, + 2972, + 403, + 207, + 17, + 22, + 919, + 207, + 16, + 17, + 403, + 207, + 18, + 24, + 185, + 185, + 3139, + 11, + 61250, + 643, + 207, + 18, + 24, + 27003, + 13, + 185, + 185, + 1380, + 839, + 1006, + 344, + 61250, + 643, + 207, + 23, + 691, + 27003, + 853, + 17654, + 13, + 2086, + 11, + 395, + 481, + 3708, + 437, + 372, + 25, + 185, + 185, + 42, + 403, + 1783, + 570, + 207, + 23, + 185, + 185, + 81089, + 254, + 1437, + 280, + 1783, + 334, + 3262, + 317, + 207, + 18, + 24, + 8, + 881, + 254, + 6337, + 11, + 395, + 752, + 25, + 185, + 185, + 42, + 403, + 207, + 18, + 24, + 570, + 207, + 23, + 403, + 207, + 18, + 16, + 185, + 185, + 3139, + 11, + 17654, + 643, + 207, + 18, + 16, + 27003, + 13, + 185, + 185, + 14494, + 11, + 254, + 3510, + 317, + 628, + 63962, + 90, + 18, + 16, + 3013, + 100001 + ], + "generated_token_ids_sha256": "d833003847179786efdbcefbbbd242818628157f352490e2b7c57e927a8b8263", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " Let's denote the number of paintings each person has with the first letter of their name. So, S is for Samantha, Sh is for Shelley, and K is for Kim.\n\nFrom the problem, we know that Samantha has 27 paintings. We also know that Samantha has 12 fewer paintings than Shelley. So, we can write this as:\n\nSh = S + 12\n\nSubstituting the value of S (which is 27) into the equation, we get:\n\nSh = 27 + 12 = 39\n\nSo, Shelley has 39 paintings.\n\nWe also know that Shelley has 8 more paintings than Kim. So, we can write this as:\n\nK = Sh - 8\n\nSubstituting the value of Sh (which is 39) into the equation, we get:\n\nK = 39 - 8 = 31\n\nSo, Kim has 31 paintings.\n\nTherefore, the answer is $\\boxed{31}$.", + "text_sha256": "97ef02ababeeef105c0d877953bbbe5eb6622917faaa70f56f988e4a57e75368", + "task_score": { + "gold_final": "31", + "predicted_final": "31", + "final_numeric_exact": true + } + }, + { + "condition": "s1_x", + "factors": { + "system": 1, + "history": "filler", + "boundary": "x", + "token_class": "ordinary_control" + }, + "prompt_tokens": 75, + "left_padding_tokens": 0, + "prompt_token_ids_sha256": "54226ca7cb7587db7663475656cf6e7887cb2a17374c3137ec81a3ac07746e20", + "generated_tokens": 80, + "generated_token_ids": [ + 1273, + 73770, + 643, + 207, + 16, + 17, + 17966, + 27003, + 853, + 61250, + 11, + 285, + 73770, + 643, + 207, + 17, + 22, + 27003, + 11, + 937, + 61250, + 643, + 207, + 17, + 22, + 919, + 207, + 16, + 17, + 403, + 207, + 18, + 24, + 27003, + 13, + 185, + 1847, + 61250, + 643, + 207, + 23, + 27003, + 691, + 853, + 17654, + 11, + 937, + 17654, + 643, + 207, + 18, + 24, + 570, + 207, + 23, + 403, + 207, + 18, + 16, + 27003, + 13, + 185, + 14494, + 11, + 17654, + 643, + 207, + 18, + 16, + 27003, + 13, + 185, + 549, + 3510, + 317, + 25, + 207, + 18, + 16, + 100001 + ], + "generated_token_ids_sha256": "abccf29a6c329726f09ebc2c214b5c259a1661eb1a05bbb7e8c0aca1abcdd74d", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " If Samantha has 12 fewer paintings than Shelley, and Samantha has 27 paintings, then Shelley has 27 + 12 = 39 paintings.\nIf Shelley has 8 paintings more than Kim, then Kim has 39 - 8 = 31 paintings.\nTherefore, Kim has 31 paintings.\nThe answer is: 31", + "text_sha256": "c1d2d377257545cc8805b3f6215df9c84f4d9ad17a7df50edbde11a519f4440a", + "task_score": { + "gold_final": "31", + "predicted_final": "31", + "final_numeric_exact": true + } + }, + { + "condition": "s0_period", + "factors": { + "system": 0, + "history": "filler", + "boundary": "period", + "token_class": "ordinary_control" + }, + "prompt_tokens": 59, + "left_padding_tokens": 16, + "prompt_token_ids_sha256": "945934580628dcd1edf2a85b5c83c6afb72ffde9ddec26f5568f6780c953ee22", + "generated_tokens": 228, + "generated_token_ids": [ + 3960, + 6, + 82, + 9211, + 254, + 1604, + 280, + 27003, + 1319, + 1491, + 643, + 372, + 4446, + 25, + 185, + 185, + 12, + 73770, + 403, + 324, + 185, + 12, + 61250, + 403, + 1783, + 185, + 12, + 17654, + 403, + 721, + 185, + 185, + 4044, + 254, + 2066, + 11, + 395, + 1006, + 344, + 25, + 185, + 185, + 16, + 13, + 73770, + 643, + 207, + 16, + 17, + 17966, + 27003, + 853, + 61250, + 11, + 558, + 395, + 481, + 3708, + 437, + 372, + 25, + 324, + 403, + 1783, + 570, + 207, + 16, + 17, + 185, + 17, + 13, + 61250, + 643, + 207, + 23, + 691, + 27003, + 853, + 17654, + 11, + 558, + 395, + 481, + 3708, + 437, + 372, + 25, + 1783, + 403, + 721, + 919, + 207, + 23, + 185, + 18, + 13, + 73770, + 643, + 207, + 17, + 22, + 27003, + 11, + 558, + 395, + 481, + 22463, + 324, + 403, + 207, + 17, + 22, + 881, + 254, + 1022, + 6337, + 25, + 207, + 17, + 22, + 403, + 1783, + 570, + 207, + 16, + 17, + 185, + 19, + 13, + 1003, + 481, + 8708, + 254, + 4443, + 6337, + 327, + 61250, + 6, + 82, + 1604, + 280, + 27003, + 25, + 1783, + 403, + 207, + 17, + 22, + 919, + 207, + 16, + 17, + 403, + 207, + 18, + 24, + 185, + 20, + 13, + 4201, + 395, + 481, + 22463, + 1783, + 403, + 207, + 18, + 24, + 881, + 254, + 1864, + 6337, + 276, + 1275, + 17654, + 6, + 82, + 1604, + 280, + 27003, + 25, + 207, + 18, + 24, + 403, + 721, + 919, + 207, + 23, + 185, + 21, + 13, + 6121, + 3562, + 254, + 11363, + 6337, + 327, + 721, + 4380, + 25, + 721, + 403, + 207, + 18, + 24, + 570, + 207, + 23, + 403, + 207, + 18, + 16, + 185, + 185, + 3139, + 11, + 17654, + 643, + 628, + 63962, + 90, + 18, + 16, + 759, + 27003, + 13, + 100001 + ], + "generated_token_ids_sha256": "3c75f913724f7bd8accd11869d5708e90371845a277702826bc6c0fe3b8d103b", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " Let's denote the number of paintings each person has as follows:\n\n- Samantha = S\n- Shelley = Sh\n- Kim = K\n\nFrom the problem, we know that:\n\n1. Samantha has 12 fewer paintings than Shelley, so we can write this as: S = Sh - 12\n2. Shelley has 8 more paintings than Kim, so we can write this as: Sh = K + 8\n3. Samantha has 27 paintings, so we can substitute S = 27 into the first equation: 27 = Sh - 12\n4. We can solve the third equation for Shelley's number of paintings: Sh = 27 + 12 = 39\n5. Now we can substitute Sh = 39 into the second equation to find Kim's number of paintings: 39 = K + 8\n6. Solving the fourth equation for K gives: K = 39 - 8 = 31\n\nSo, Kim has $\\boxed{31}$ paintings.", + "text_sha256": "4e98146ed4e9a3b3e68ef922b171cec2486f444f9ba788aaa67f8b96efcd5073", + "task_score": { + "gold_final": "31", + "predicted_final": "31", + "final_numeric_exact": true + } + }, + { + "condition": "s1_period", + "factors": { + "system": 1, + "history": "filler", + "boundary": "period", + "token_class": "ordinary_control" + }, + "prompt_tokens": 75, + "left_padding_tokens": 0, + "prompt_token_ids_sha256": "a3debe06e713b24eeba50430c4ab26a96682361c0ad76de71fc9a9e5c319efda", + "generated_tokens": 243, + "generated_token_ids": [ + 3960, + 6, + 82, + 9211, + 254, + 1604, + 280, + 27003, + 1319, + 1491, + 643, + 366, + 254, + 1893, + 7119, + 25, + 185, + 185, + 12, + 324, + 25, + 254, + 1604, + 280, + 27003, + 73770, + 643, + 185, + 12, + 721, + 25, + 254, + 1604, + 280, + 27003, + 17654, + 643, + 185, + 12, + 461, + 25, + 254, + 1604, + 280, + 27003, + 61250, + 643, + 185, + 185, + 4044, + 254, + 2066, + 11, + 395, + 1006, + 344, + 25, + 185, + 185, + 16, + 13, + 73770, + 643, + 207, + 16, + 17, + 17966, + 27003, + 853, + 61250, + 11, + 558, + 395, + 481, + 3708, + 437, + 372, + 25, + 324, + 403, + 461, + 570, + 207, + 16, + 17, + 185, + 17, + 13, + 61250, + 643, + 207, + 23, + 691, + 27003, + 853, + 17654, + 11, + 558, + 395, + 481, + 3708, + 437, + 372, + 25, + 461, + 403, + 721, + 919, + 207, + 23, + 185, + 18, + 13, + 73770, + 643, + 207, + 17, + 22, + 27003, + 11, + 558, + 395, + 481, + 22463, + 324, + 403, + 207, + 17, + 22, + 881, + 254, + 1022, + 6337, + 25, + 207, + 17, + 22, + 403, + 461, + 570, + 207, + 16, + 17, + 185, + 19, + 13, + 6121, + 3562, + 254, + 6337, + 327, + 461, + 11, + 395, + 752, + 25, + 461, + 403, + 207, + 17, + 22, + 919, + 207, + 16, + 17, + 403, + 207, + 18, + 24, + 185, + 20, + 13, + 37994, + 29878, + 461, + 403, + 207, + 18, + 24, + 881, + 254, + 1864, + 6337, + 11, + 395, + 752, + 25, + 207, + 18, + 24, + 403, + 721, + 919, + 207, + 23, + 185, + 21, + 13, + 6121, + 3562, + 254, + 6337, + 327, + 721, + 11, + 395, + 752, + 25, + 721, + 403, + 207, + 18, + 24, + 570, + 207, + 23, + 403, + 207, + 18, + 16, + 185, + 185, + 3139, + 11, + 17654, + 643, + 207, + 18, + 16, + 27003, + 13, + 7536, + 11, + 254, + 3510, + 317, + 628, + 63962, + 90, + 18, + 16, + 3013, + 100001 + ], + "generated_token_ids_sha256": "0a4c97d4335a6cf64e2507738d2bf4b5e75488f71ce2de23c37b2e6f33254250", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " Let's denote the number of paintings each person has with the following variables:\n\n- S: the number of paintings Samantha has\n- K: the number of paintings Kim has\n- N: the number of paintings Shelley has\n\nFrom the problem, we know that:\n\n1. Samantha has 12 fewer paintings than Shelley, so we can write this as: S = N - 12\n2. Shelley has 8 more paintings than Kim, so we can write this as: N = K + 8\n3. Samantha has 27 paintings, so we can substitute S = 27 into the first equation: 27 = N - 12\n4. Solving the equation for N, we get: N = 27 + 12 = 39\n5. Substituting N = 39 into the second equation, we get: 39 = K + 8\n6. Solving the equation for K, we get: K = 39 - 8 = 31\n\nSo, Kim has 31 paintings. Therefore, the answer is $\\boxed{31}$.", + "text_sha256": "632c2a00ea7441cbd4af33c17cd908e04393fa59c1716b4e444daf013f4d0813", + "task_score": { + "gold_final": "31", + "predicted_final": "31", + "final_numeric_exact": true + } + } + ] + }, + { + "id": "gsm8k/test/0144", + "domain": "math", + "label": "Grade-school math", + "within_domain_index": 2, + "selection_rank": "004a245538bdc42cc175a178c73dfaaaebc9713e3215ffcdfb9400fb63b3a941", + "source_text_sha256": "8f2ecd574d8c8738ec87b6ba3a3af24f9cbf35d832733c98e65546f7ee59725d", + "source_characters": 615, + "source_tokens": 131, + "prompt_tokens_by_condition": { + "s0_eos": 155, + "s1_eos": 171, + "s0_bos": 155, + "s1_bos": 171, + "s0_x": 155, + "s1_x": 171, + "s0_period": 155, + "s1_period": 171 + }, + "batch_prompt_tokens_after_left_padding": 171, + "batch_padding_side": "left", + "batch_conditions": 8, + "generation_seconds": 66.99708888900932, + "peak_cuda_memory_allocated_bytes": 29955756032, + "generated_tokens_including_batch_padding": 2320, + "outputs": [ + { + "condition": "s0_eos", + "factors": { + "system": 0, + "history": "filler", + "boundary": "eos", + "token_class": "special" + }, + "prompt_tokens": 155, + "left_padding_tokens": 16, + "prompt_token_ids_sha256": "d8dc51585cedab0a1ad0851d7e762b43f4e0c384234e27717205b618bdbcd926", + "generated_tokens": 202, + "generated_token_ids": [ + 17654, + 643, + 207, + 18, + 4252, + 6514, + 285, + 317, + 6807, + 276, + 207, + 20, + 3968, + 6514, + 11, + 558, + 362, + 643, + 245, + 3223, + 280, + 207, + 18, + 919, + 207, + 20, + 403, + 207, + 23, + 6514, + 13, + 185, + 10005, + 4661, + 543, + 933, + 207, + 17, + 25209, + 280, + 78288, + 11, + 558, + 362, + 543, + 933, + 207, + 23, + 575, + 207, + 17, + 403, + 207, + 16, + 21, + 25209, + 280, + 78288, + 13, + 185, + 2450, + 543, + 839, + 933, + 207, + 23, + 31230, + 280, + 91542, + 11, + 558, + 362, + 543, + 933, + 207, + 23, + 575, + 207, + 20, + 403, + 207, + 19, + 15, + 31230, + 280, + 91542, + 13, + 185, + 549, + 2295, + 280, + 78288, + 543, + 330, + 207, + 16, + 21, + 575, + 363, + 17, + 403, + 363, + 18, + 17, + 13, + 185, + 549, + 2295, + 280, + 91542, + 543, + 330, + 207, + 19, + 15, + 575, + 363, + 20, + 403, + 363, + 17, + 15, + 15, + 13, + 185, + 11126, + 3223, + 16722, + 543, + 330, + 363, + 18, + 17, + 919, + 363, + 17, + 15, + 15, + 403, + 363, + 17, + 18, + 17, + 13, + 185, + 11126, + 3223, + 9880, + 1319, + 2562, + 543, + 330, + 363, + 24, + 17, + 13, + 185, + 11126, + 13518, + 543, + 330, + 363, + 24, + 17, + 570, + 363, + 17, + 18, + 17, + 403, + 570, + 3, + 16, + 19, + 15, + 13, + 185, + 14494, + 11, + 17654, + 543, + 1099, + 245, + 4257, + 280, + 363, + 16, + 19, + 15, + 1319, + 2562, + 13, + 185, + 549, + 3510, + 317, + 25, + 207, + 16, + 19, + 15, + 100001 + ], + "generated_token_ids_sha256": "29a8e89d23a4b3c9bc018a89a32814230f16555bf998ca4be8091d41a4f6c1ee", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " Kim has 3 regular clients and is talking to 5 potential clients, so he has a total of 3 + 5 = 8 clients.\nEach client will need 2 bottles of bleach, so he will need 8 * 2 = 16 bottles of bleach.\nHe will also need 8 packs of cloths, so he will need 8 * 5 = 40 packs of cloths.\nThe cost of bleach will be 16 * $2 = $32.\nThe cost of cloths will be 40 * $5 = $200.\nHis total expenses will be $32 + $200 = $232.\nHis total income each week will be $92.\nHis profit will be $92 - $232 = -$140.\nTherefore, Kim will make a loss of $140 each week.\nThe answer is: 140", + "text_sha256": "58210a2f71f94c40fbe2ca3d690318a2faf67a194e711d0cb070808f381b34f9", + "task_score": { + "gold_final": "20", + "predicted_final": "140", + "final_numeric_exact": false + } + }, + { + "condition": "s1_eos", + "factors": { + "system": 1, + "history": "filler", + "boundary": "eos", + "token_class": "special" + }, + "prompt_tokens": 171, + "left_padding_tokens": 0, + "prompt_token_ids_sha256": "e9be7845cdbf1b842381628cfb7fc89a2856e64d6ad742734daccb7870279f73", + "generated_tokens": 194, + "generated_token_ids": [ + 17654, + 643, + 207, + 18, + 6287, + 6514, + 285, + 317, + 6807, + 276, + 207, + 20, + 3968, + 6514, + 11, + 558, + 362, + 543, + 463, + 245, + 3223, + 280, + 207, + 18, + 919, + 207, + 20, + 403, + 207, + 23, + 6514, + 13, + 185, + 10005, + 4661, + 543, + 933, + 207, + 17, + 25209, + 280, + 78288, + 11, + 558, + 362, + 543, + 933, + 207, + 23, + 575, + 207, + 17, + 403, + 207, + 16, + 21, + 25209, + 280, + 78288, + 13, + 185, + 2450, + 543, + 839, + 933, + 207, + 16, + 2390, + 280, + 91542, + 327, + 1319, + 4661, + 11, + 558, + 362, + 543, + 933, + 207, + 23, + 575, + 207, + 16, + 403, + 207, + 23, + 31230, + 280, + 91542, + 13, + 185, + 549, + 2295, + 280, + 207, + 16, + 21, + 25209, + 280, + 78288, + 543, + 330, + 207, + 16, + 21, + 575, + 363, + 17, + 403, + 363, + 18, + 17, + 13, + 185, + 549, + 2295, + 280, + 207, + 23, + 31230, + 280, + 91542, + 543, + 330, + 207, + 23, + 575, + 363, + 20, + 403, + 363, + 19, + 15, + 13, + 185, + 11126, + 3223, + 16722, + 1319, + 2562, + 543, + 330, + 363, + 18, + 17, + 919, + 363, + 19, + 15, + 403, + 363, + 22, + 17, + 13, + 185, + 11126, + 3223, + 9880, + 1319, + 2562, + 543, + 330, + 363, + 24, + 17, + 13, + 185, + 11126, + 13518, + 1319, + 2562, + 543, + 330, + 363, + 24, + 17, + 570, + 363, + 22, + 17, + 403, + 363, + 17, + 15, + 13, + 185, + 549, + 3510, + 317, + 25, + 207, + 17, + 15, + 100001 + ], + "generated_token_ids_sha256": "e60c5ea3aee55c1bb4a624fda24628ad0aa940ee88d1114ede272b13c627a74c", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " Kim has 3 existing clients and is talking to 5 potential clients, so he will have a total of 3 + 5 = 8 clients.\nEach client will need 2 bottles of bleach, so he will need 8 * 2 = 16 bottles of bleach.\nHe will also need 1 pack of cloths for each client, so he will need 8 * 1 = 8 packs of cloths.\nThe cost of 16 bottles of bleach will be 16 * $2 = $32.\nThe cost of 8 packs of cloths will be 8 * $5 = $40.\nHis total expenses each week will be $32 + $40 = $72.\nHis total income each week will be $92.\nHis profit each week will be $92 - $72 = $20.\nThe answer is: 20", + "text_sha256": "ab90643cacfadd43de611cbf836699f0153968d6ef44dfff2939113ca4a439e3", + "task_score": { + "gold_final": "20", + "predicted_final": "20", + "final_numeric_exact": true + } + }, + { + "condition": "s0_bos", + "factors": { + "system": 0, + "history": "filler", + "boundary": "bos", + "token_class": "special" + }, + "prompt_tokens": 155, + "left_padding_tokens": 16, + "prompt_token_ids_sha256": "a89ab243876f7c105b1c01767c58563ab499075e13f272a28eede5c49f89352c", + "generated_tokens": 246, + "generated_token_ids": [ + 3960, + 6, + 82, + 2973, + 1224, + 254, + 2066, + 3458, + 457, + 3458, + 13, + 185, + 185, + 6306, + 11, + 1632, + 6, + 82, + 11462, + 254, + 2295, + 280, + 78288, + 285, + 91542, + 327, + 634, + 4661, + 13, + 207, + 185, + 185, + 41868, + 3277, + 207, + 17, + 25209, + 280, + 78288, + 285, + 245, + 2390, + 280, + 91542, + 276, + 3920, + 1319, + 4661, + 6, + 82, + 1719, + 13, + 429, + 2295, + 280, + 78288, + 317, + 363, + 17, + 513, + 14529, + 285, + 254, + 2295, + 280, + 245, + 2390, + 280, + 91542, + 317, + 363, + 20, + 13, + 207, + 185, + 185, + 3139, + 11, + 254, + 3223, + 2295, + 327, + 78288, + 285, + 91542, + 327, + 634, + 4661, + 317, + 207, + 17, + 575, + 363, + 17, + 919, + 363, + 20, + 403, + 363, + 19, + 919, + 363, + 20, + 403, + 363, + 24, + 13, + 185, + 185, + 4388, + 11, + 1632, + 6, + 82, + 11462, + 254, + 2295, + 327, + 521, + 254, + 6514, + 13, + 17654, + 643, + 207, + 18, + 1648, + 6514, + 285, + 317, + 6807, + 276, + 207, + 20, + 3968, + 6514, + 13, + 2086, + 11, + 362, + 643, + 207, + 18, + 919, + 207, + 20, + 403, + 207, + 23, + 6514, + 279, + 3223, + 13, + 185, + 185, + 14494, + 11, + 254, + 3223, + 2295, + 327, + 78288, + 285, + 91542, + 327, + 521, + 254, + 6514, + 317, + 207, + 23, + 575, + 363, + 24, + 403, + 363, + 22, + 17, + 13, + 185, + 185, + 41868, + 6, + 82, + 3223, + 9880, + 1319, + 2562, + 317, + 363, + 24, + 17, + 13, + 207, + 185, + 185, + 3139, + 11, + 586, + 13518, + 1319, + 2562, + 317, + 254, + 3223, + 9880, + 30317, + 254, + 3223, + 16722, + 13, + 2608, + 317, + 363, + 24, + 17, + 570, + 363, + 22, + 17, + 403, + 363, + 17, + 15, + 13, + 185, + 185, + 3139, + 11, + 17654, + 543, + 1099, + 245, + 13518, + 280, + 628, + 63962, + 90, + 17, + 15, + 759, + 11182, + 1319, + 2562, + 13, + 100001 + ], + "generated_token_ids_sha256": "4b78f623166021d8741fa27bf49b60625955a5df5e6828b9aa5e9310a865eb36", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " Let's break down the problem step by step.\n\nFirst, let's calculate the cost of bleach and cloths for one client. \n\nKim needs 2 bottles of bleach and a pack of cloths to clean each client's home. The cost of bleach is $2 per bottle and the cost of a pack of cloths is $5. \n\nSo, the total cost for bleach and cloths for one client is 2 * $2 + $5 = $4 + $5 = $9.\n\nNow, let's calculate the cost for all the clients. Kim has 3 current clients and is talking to 5 potential clients. So, he has 3 + 5 = 8 clients in total.\n\nTherefore, the total cost for bleach and cloths for all the clients is 8 * $9 = $72.\n\nKim's total income each week is $92. \n\nSo, his profit each week is the total income minus the total expenses. That is $92 - $72 = $20.\n\nSo, Kim will make a profit of $\\boxed{20}$ dollars each week.", + "text_sha256": "d85925e46352c1d78e0163fe182175dc6f23b738d65adca2b9962166c054594a", + "task_score": { + "gold_final": "20", + "predicted_final": "20", + "final_numeric_exact": true + } + }, + { + "condition": "s1_bos", + "factors": { + "system": 1, + "history": "filler", + "boundary": "bos", + "token_class": "special" + }, + "prompt_tokens": 171, + "left_padding_tokens": 0, + "prompt_token_ids_sha256": "bbd3ea174b21ab94a23b9e995341c8e3a84cdab258103589011248700967da39", + "generated_tokens": 226, + "generated_token_ids": [ + 17654, + 643, + 207, + 18, + 4252, + 6514, + 285, + 317, + 6807, + 276, + 207, + 20, + 3968, + 6514, + 11, + 558, + 362, + 543, + 463, + 245, + 3223, + 280, + 207, + 18, + 919, + 207, + 20, + 403, + 207, + 23, + 6514, + 13, + 185, + 10005, + 4661, + 543, + 933, + 207, + 17, + 25209, + 280, + 78288, + 11, + 558, + 362, + 543, + 933, + 245, + 3223, + 280, + 207, + 23, + 575, + 207, + 17, + 403, + 207, + 16, + 21, + 25209, + 280, + 78288, + 13, + 185, + 2450, + 543, + 839, + 933, + 207, + 23, + 31230, + 280, + 91542, + 11, + 558, + 362, + 543, + 933, + 245, + 3223, + 280, + 207, + 23, + 575, + 207, + 16, + 403, + 207, + 23, + 31230, + 280, + 91542, + 13, + 185, + 549, + 2295, + 280, + 78288, + 327, + 1319, + 4661, + 317, + 363, + 17, + 11, + 558, + 254, + 3223, + 2295, + 280, + 78288, + 543, + 330, + 207, + 23, + 575, + 363, + 17, + 403, + 363, + 16, + 21, + 13, + 185, + 549, + 2295, + 280, + 91542, + 327, + 1319, + 4661, + 317, + 363, + 20, + 11, + 558, + 254, + 3223, + 2295, + 280, + 91542, + 543, + 330, + 207, + 23, + 575, + 363, + 20, + 403, + 363, + 19, + 15, + 13, + 185, + 11126, + 3223, + 16722, + 1319, + 2562, + 543, + 330, + 363, + 16, + 21, + 919, + 363, + 19, + 15, + 403, + 363, + 20, + 21, + 13, + 185, + 11126, + 3223, + 9880, + 1319, + 2562, + 543, + 330, + 363, + 24, + 17, + 11, + 558, + 586, + 13518, + 543, + 330, + 363, + 24, + 17, + 570, + 363, + 20, + 21, + 403, + 363, + 18, + 21, + 13, + 185, + 14494, + 11, + 17654, + 543, + 1099, + 245, + 13518, + 280, + 363, + 18, + 21, + 1319, + 2562, + 13, + 185, + 549, + 3510, + 317, + 25, + 207, + 18, + 21, + 100001 + ], + "generated_token_ids_sha256": "e9d5a030c416715a9fec5527b6375b0ddd29a4e21074fca24a0ed1a0bb4cb031", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " Kim has 3 regular clients and is talking to 5 potential clients, so he will have a total of 3 + 5 = 8 clients.\nEach client will need 2 bottles of bleach, so he will need a total of 8 * 2 = 16 bottles of bleach.\nHe will also need 8 packs of cloths, so he will need a total of 8 * 1 = 8 packs of cloths.\nThe cost of bleach for each client is $2, so the total cost of bleach will be 8 * $2 = $16.\nThe cost of cloths for each client is $5, so the total cost of cloths will be 8 * $5 = $40.\nHis total expenses each week will be $16 + $40 = $56.\nHis total income each week will be $92, so his profit will be $92 - $56 = $36.\nTherefore, Kim will make a profit of $36 each week.\nThe answer is: 36", + "text_sha256": "908f5bcac0889d7033542fa6c81dd8256f69ab7fa6b52591cdf5291def81c911", + "task_score": { + "gold_final": "20", + "predicted_final": "36", + "final_numeric_exact": false + } + }, + { + "condition": "s0_x", + "factors": { + "system": 0, + "history": "filler", + "boundary": "x", + "token_class": "ordinary_control" + }, + "prompt_tokens": 155, + "left_padding_tokens": 16, + "prompt_token_ids_sha256": "08a9801022d9489dc3c5272ce64b74bc8bed58ead7ebbc435c939d5b3cff837e", + "generated_tokens": 216, + "generated_token_ids": [ + 17654, + 643, + 207, + 18, + 4252, + 6514, + 285, + 317, + 6807, + 276, + 207, + 20, + 3968, + 6514, + 11, + 558, + 362, + 543, + 463, + 245, + 3223, + 280, + 207, + 18, + 919, + 207, + 20, + 403, + 207, + 23, + 6514, + 13, + 185, + 10005, + 4661, + 543, + 933, + 207, + 17, + 25209, + 280, + 78288, + 11, + 558, + 362, + 543, + 933, + 245, + 3223, + 280, + 207, + 23, + 575, + 207, + 17, + 403, + 207, + 16, + 21, + 25209, + 280, + 78288, + 13, + 185, + 2450, + 543, + 839, + 933, + 207, + 16, + 2390, + 280, + 91542, + 327, + 1319, + 4661, + 11, + 558, + 362, + 543, + 933, + 245, + 3223, + 280, + 207, + 23, + 575, + 207, + 16, + 403, + 207, + 23, + 31230, + 280, + 91542, + 13, + 185, + 549, + 2295, + 280, + 78288, + 327, + 1319, + 4661, + 317, + 363, + 17, + 11, + 558, + 254, + 3223, + 2295, + 280, + 78288, + 543, + 330, + 207, + 23, + 575, + 363, + 17, + 403, + 363, + 16, + 21, + 13, + 185, + 549, + 2295, + 280, + 91542, + 327, + 1319, + 4661, + 317, + 363, + 20, + 11, + 558, + 254, + 3223, + 2295, + 280, + 91542, + 543, + 330, + 207, + 23, + 575, + 363, + 20, + 403, + 363, + 19, + 15, + 13, + 185, + 11126, + 3223, + 16722, + 1319, + 2562, + 543, + 330, + 363, + 16, + 21, + 919, + 363, + 19, + 15, + 403, + 363, + 20, + 21, + 13, + 185, + 11126, + 3223, + 9880, + 1319, + 2562, + 543, + 330, + 363, + 24, + 17, + 13, + 185, + 11126, + 13518, + 1319, + 2562, + 543, + 330, + 363, + 24, + 17, + 570, + 363, + 20, + 21, + 403, + 363, + 18, + 21, + 13, + 185, + 549, + 3510, + 317, + 25, + 207, + 18, + 21, + 100001 + ], + "generated_token_ids_sha256": "32727a41edd61f3c9c1778ba36a74b954a1fce658a28bdf4249ab41801848436", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " Kim has 3 regular clients and is talking to 5 potential clients, so he will have a total of 3 + 5 = 8 clients.\nEach client will need 2 bottles of bleach, so he will need a total of 8 * 2 = 16 bottles of bleach.\nHe will also need 1 pack of cloths for each client, so he will need a total of 8 * 1 = 8 packs of cloths.\nThe cost of bleach for each client is $2, so the total cost of bleach will be 8 * $2 = $16.\nThe cost of cloths for each client is $5, so the total cost of cloths will be 8 * $5 = $40.\nHis total expenses each week will be $16 + $40 = $56.\nHis total income each week will be $92.\nHis profit each week will be $92 - $56 = $36.\nThe answer is: 36", + "text_sha256": "5d93df4fa74144e98f8671b8a440c3deab1e0d5baab049463b42ad8497031f79", + "task_score": { + "gold_final": "20", + "predicted_final": "36", + "final_numeric_exact": false + } + }, + { + "condition": "s1_x", + "factors": { + "system": 1, + "history": "filler", + "boundary": "x", + "token_class": "ordinary_control" + }, + "prompt_tokens": 171, + "left_padding_tokens": 0, + "prompt_token_ids_sha256": "e4b78a7bc4de036db8d331132f6847eb184232dbb15949bd7cd731f4b365ee15", + "generated_tokens": 222, + "generated_token_ids": [ + 5904, + 11, + 1632, + 6, + 82, + 11462, + 254, + 3223, + 2295, + 280, + 78288, + 285, + 91542, + 327, + 634, + 4661, + 13, + 185, + 185, + 41868, + 3277, + 207, + 17, + 25209, + 280, + 78288, + 285, + 245, + 2390, + 280, + 91542, + 327, + 1319, + 4661, + 13, + 429, + 2295, + 280, + 78288, + 317, + 363, + 17, + 513, + 14529, + 11, + 558, + 327, + 634, + 4661, + 11, + 254, + 2295, + 280, + 78288, + 317, + 207, + 17, + 575, + 363, + 17, + 403, + 363, + 19, + 13, + 429, + 2295, + 280, + 245, + 2390, + 280, + 91542, + 317, + 363, + 20, + 13, + 7536, + 11, + 254, + 3223, + 2295, + 280, + 78288, + 285, + 91542, + 327, + 634, + 4661, + 317, + 363, + 19, + 919, + 363, + 20, + 403, + 363, + 24, + 13, + 185, + 185, + 41868, + 643, + 207, + 18, + 1648, + 6514, + 285, + 317, + 6807, + 276, + 207, + 20, + 3968, + 6514, + 13, + 2086, + 11, + 362, + 543, + 463, + 207, + 18, + 919, + 207, + 20, + 403, + 207, + 23, + 6514, + 279, + 3223, + 13, + 185, + 185, + 14494, + 11, + 254, + 3223, + 2295, + 280, + 78288, + 285, + 91542, + 327, + 521, + 6514, + 543, + 330, + 207, + 23, + 575, + 363, + 24, + 403, + 363, + 22, + 17, + 13, + 185, + 185, + 41868, + 6, + 82, + 3223, + 9880, + 1319, + 2562, + 317, + 363, + 24, + 17, + 13, + 2086, + 11, + 586, + 13518, + 1319, + 2562, + 543, + 330, + 586, + 3223, + 9880, + 30317, + 586, + 3223, + 16722, + 13, + 2608, + 317, + 363, + 24, + 17, + 570, + 363, + 22, + 17, + 403, + 363, + 17, + 15, + 13, + 185, + 185, + 3139, + 11, + 17654, + 543, + 1099, + 245, + 13518, + 280, + 628, + 63962, + 90, + 17, + 15, + 759, + 11182, + 1319, + 2562, + 13, + 100001 + ], + "generated_token_ids_sha256": "6ad30f9ec1cbb8a60e73173f4a7a053653dfcf6b56160fd0c1174890b0edb476", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " First, let's calculate the total cost of bleach and cloths for one client.\n\nKim needs 2 bottles of bleach and a pack of cloths for each client. The cost of bleach is $2 per bottle, so for one client, the cost of bleach is 2 * $2 = $4. The cost of a pack of cloths is $5. Therefore, the total cost of bleach and cloths for one client is $4 + $5 = $9.\n\nKim has 3 current clients and is talking to 5 potential clients. So, he will have 3 + 5 = 8 clients in total.\n\nTherefore, the total cost of bleach and cloths for all clients will be 8 * $9 = $72.\n\nKim's total income each week is $92. So, his profit each week will be his total income minus his total expenses. That is $92 - $72 = $20.\n\nSo, Kim will make a profit of $\\boxed{20}$ dollars each week.", + "text_sha256": "31153af0c3dc838d62c2ce3c3edfec3f3dd2cc4f9868e76381075447493ace0a", + "task_score": { + "gold_final": "20", + "predicted_final": "20", + "final_numeric_exact": true + } + }, + { + "condition": "s0_period", + "factors": { + "system": 0, + "history": "filler", + "boundary": "period", + "token_class": "ordinary_control" + }, + "prompt_tokens": 155, + "left_padding_tokens": 16, + "prompt_token_ids_sha256": "85b762195d6e87a0e483912ff46ed28ae1e6703374a433ef6e8406fe5a258399", + "generated_tokens": 272, + "generated_token_ids": [ + 3960, + 6, + 82, + 2973, + 1224, + 254, + 2066, + 3458, + 457, + 3458, + 25, + 185, + 185, + 16, + 13, + 17654, + 643, + 207, + 18, + 6287, + 6514, + 285, + 317, + 6807, + 276, + 207, + 20, + 3968, + 6514, + 13, + 2086, + 11, + 362, + 543, + 463, + 207, + 18, + 919, + 207, + 20, + 403, + 207, + 23, + 6514, + 279, + 3223, + 13, + 185, + 185, + 17, + 13, + 7915, + 4661, + 543, + 933, + 207, + 17, + 25209, + 280, + 78288, + 285, + 245, + 2390, + 280, + 91542, + 276, + 3920, + 13, + 207, + 185, + 185, + 18, + 13, + 429, + 2295, + 280, + 1319, + 14529, + 280, + 78288, + 317, + 363, + 17, + 285, + 254, + 2295, + 280, + 1319, + 2390, + 280, + 91542, + 317, + 363, + 20, + 13, + 207, + 185, + 185, + 19, + 13, + 2086, + 11, + 254, + 3223, + 2295, + 327, + 78288, + 327, + 1319, + 4661, + 317, + 207, + 17, + 575, + 363, + 17, + 403, + 363, + 19, + 285, + 254, + 3223, + 2295, + 327, + 91542, + 327, + 1319, + 4661, + 317, + 207, + 16, + 575, + 363, + 20, + 403, + 363, + 20, + 13, + 185, + 185, + 20, + 13, + 7536, + 11, + 254, + 3223, + 2295, + 327, + 78288, + 285, + 91542, + 327, + 1319, + 4661, + 317, + 363, + 19, + 919, + 363, + 20, + 403, + 363, + 24, + 13, + 185, + 185, + 21, + 13, + 5512, + 17654, + 543, + 463, + 207, + 23, + 6514, + 11, + 254, + 3223, + 2295, + 327, + 78288, + 285, + 91542, + 327, + 521, + 6514, + 543, + 330, + 207, + 23, + 575, + 363, + 24, + 403, + 363, + 22, + 17, + 13, + 185, + 185, + 22, + 13, + 17654, + 6, + 82, + 3223, + 9880, + 1319, + 2562, + 317, + 363, + 24, + 17, + 13, + 207, + 185, + 185, + 23, + 13, + 2086, + 11, + 254, + 13518, + 17654, + 543, + 1099, + 1319, + 2562, + 317, + 254, + 3223, + 9880, + 30317, + 254, + 3223, + 16722, + 11, + 588, + 317, + 363, + 24, + 17, + 570, + 363, + 22, + 17, + 403, + 363, + 17, + 15, + 13, + 185, + 185, + 3139, + 11, + 17654, + 543, + 1099, + 245, + 13518, + 280, + 628, + 63962, + 90, + 17, + 15, + 759, + 11182, + 1319, + 2562, + 13, + 100001 + ], + "generated_token_ids_sha256": "92f208c3c4b7d0e80e7a833a778e026981f7fb04ad8c0a85cc6bfb1556286877", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " Let's break down the problem step by step:\n\n1. Kim has 3 existing clients and is talking to 5 potential clients. So, he will have 3 + 5 = 8 clients in total.\n\n2. Each client will need 2 bottles of bleach and a pack of cloths to clean. \n\n3. The cost of each bottle of bleach is $2 and the cost of each pack of cloths is $5. \n\n4. So, the total cost for bleach for each client is 2 * $2 = $4 and the total cost for cloths for each client is 1 * $5 = $5.\n\n5. Therefore, the total cost for bleach and cloths for each client is $4 + $5 = $9.\n\n6. Since Kim will have 8 clients, the total cost for bleach and cloths for all clients will be 8 * $9 = $72.\n\n7. Kim's total income each week is $92. \n\n8. So, the profit Kim will make each week is the total income minus the total expenses, which is $92 - $72 = $20.\n\nSo, Kim will make a profit of $\\boxed{20}$ dollars each week.", + "text_sha256": "bf27183b1280011a32c44f4c10ec869bad36e7f4a93b6b1018120b9a8d756c7b", + "task_score": { + "gold_final": "20", + "predicted_final": "20", + "final_numeric_exact": true + } + }, + { + "condition": "s1_period", + "factors": { + "system": 1, + "history": "filler", + "boundary": "period", + "token_class": "ordinary_control" + }, + "prompt_tokens": 171, + "left_padding_tokens": 0, + "prompt_token_ids_sha256": "8a549e4eefb67f9c7df04d2d81824500fadbeb873948fda10055fbc3bb0ac287", + "generated_tokens": 290, + "generated_token_ids": [ + 2158, + 11462, + 254, + 13518, + 11, + 395, + 1022, + 933, + 276, + 6983, + 254, + 3223, + 16722, + 285, + 3223, + 9880, + 13, + 185, + 185, + 41868, + 643, + 207, + 18, + 4252, + 6514, + 285, + 317, + 6807, + 276, + 207, + 20, + 3968, + 6514, + 13, + 7915, + 4661, + 3277, + 207, + 17, + 25209, + 280, + 78288, + 285, + 245, + 2390, + 280, + 91542, + 13, + 185, + 185, + 1988, + 254, + 4252, + 6514, + 25, + 185, + 12, + 16634, + 280, + 78288, + 513, + 4661, + 403, + 207, + 17, + 25209, + 575, + 363, + 17, + 513, + 14529, + 403, + 363, + 19, + 185, + 12, + 16634, + 280, + 91542, + 513, + 4661, + 403, + 207, + 16, + 2390, + 575, + 363, + 20, + 513, + 2390, + 403, + 363, + 20, + 185, + 12, + 19008, + 2295, + 513, + 4252, + 4661, + 403, + 363, + 19, + 919, + 363, + 20, + 403, + 363, + 24, + 185, + 12, + 19008, + 2295, + 327, + 207, + 18, + 4252, + 6514, + 403, + 207, + 18, + 575, + 363, + 24, + 403, + 363, + 17, + 22, + 185, + 185, + 1988, + 254, + 3968, + 6514, + 25, + 185, + 12, + 16634, + 280, + 78288, + 513, + 3968, + 4661, + 403, + 207, + 17, + 25209, + 575, + 363, + 17, + 513, + 14529, + 403, + 363, + 19, + 185, + 12, + 16634, + 280, + 91542, + 513, + 3968, + 4661, + 403, + 207, + 16, + 2390, + 575, + 363, + 20, + 513, + 2390, + 403, + 363, + 20, + 185, + 12, + 19008, + 2295, + 513, + 3968, + 4661, + 403, + 363, + 19, + 919, + 363, + 20, + 403, + 363, + 24, + 185, + 12, + 19008, + 2295, + 327, + 207, + 20, + 3968, + 6514, + 403, + 207, + 20, + 575, + 363, + 24, + 403, + 363, + 19, + 20, + 185, + 185, + 14179, + 16722, + 327, + 521, + 6514, + 403, + 363, + 17, + 22, + 334, + 13358, + 6514, + 8, + 919, + 363, + 19, + 20, + 334, + 36876, + 6514, + 8, + 403, + 363, + 22, + 17, + 185, + 185, + 41868, + 6, + 82, + 3223, + 9880, + 1319, + 2562, + 317, + 363, + 24, + 17, + 13, + 185, + 185, + 1432, + 7470, + 403, + 19008, + 9880, + 570, + 19008, + 16722, + 185, + 1432, + 7470, + 403, + 363, + 24, + 17, + 570, + 363, + 22, + 17, + 403, + 363, + 17, + 15, + 185, + 185, + 41868, + 543, + 1099, + 363, + 17, + 15, + 279, + 13518, + 1319, + 2562, + 13, + 100001 + ], + "generated_token_ids_sha256": "423b22a7577fc76dcdc8fcbe854be2584047ce8bda6b6d9fd1435f243349221e", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " To calculate the profit, we first need to determine the total expenses and total income.\n\nKim has 3 regular clients and is talking to 5 potential clients. Each client needs 2 bottles of bleach and a pack of cloths.\n\nFor the regular clients:\n- Cost of bleach per client = 2 bottles * $2 per bottle = $4\n- Cost of cloths per client = 1 pack * $5 per pack = $5\n- Total cost per regular client = $4 + $5 = $9\n- Total cost for 3 regular clients = 3 * $9 = $27\n\nFor the potential clients:\n- Cost of bleach per potential client = 2 bottles * $2 per bottle = $4\n- Cost of cloths per potential client = 1 pack * $5 per pack = $5\n- Total cost per potential client = $4 + $5 = $9\n- Total cost for 5 potential clients = 5 * $9 = $45\n\nTotal expenses for all clients = $27 (regular clients) + $45 (potential clients) = $72\n\nKim's total income each week is $92.\n\nProfit = Total income - Total expenses\nProfit = $92 - $72 = $20\n\nKim will make $20 in profit each week.", + "text_sha256": "89387872074e5475d4b5396fe25d39df5fa92968a3b7b3f29cdb231897eca1dc", + "task_score": { + "gold_final": "20", + "predicted_final": "20", + "final_numeric_exact": true + } + } + ] + }, + { + "id": "gsm8k/test/1251", + "domain": "math", + "label": "Grade-school math", + "within_domain_index": 3, + "selection_rank": "0056e66a635febc5b2ace25221ed8fe25366682898fc2d4d0132b30812f59e30", + "source_text_sha256": "a45936495f064c16cf6621fe21bf0d84f54f5850bf6bfe19ced45b30c591aa36", + "source_characters": 269, + "source_tokens": 75, + "prompt_tokens_by_condition": { + "s0_eos": 99, + "s1_eos": 115, + "s0_bos": 99, + "s1_bos": 115, + "s0_x": 99, + "s1_x": 115, + "s0_period": 99, + "s1_period": 115 + }, + "batch_prompt_tokens_after_left_padding": 115, + "batch_padding_side": "left", + "batch_conditions": 8, + "generation_seconds": 60.80932862201007, + "peak_cuda_memory_allocated_bytes": 29566449152, + "generated_tokens_including_batch_padding": 2064, + "outputs": [ + { + "condition": "s0_eos", + "factors": { + "system": 0, + "history": "filler", + "boundary": "eos", + "token_class": "special" + }, + "prompt_tokens": 99, + "left_padding_tokens": 16, + "prompt_token_ids_sha256": "49fe40432f2d059dd188bd35dc10f373d43b74c3d1e0afcb89c1ef642f8d5b6c", + "generated_tokens": 258, + "generated_token_ids": [ + 2158, + 8708, + 437, + 2066, + 11, + 395, + 933, + 276, + 11462, + 254, + 766, + 359, + 4497, + 327, + 3326, + 276, + 8708, + 1319, + 2387, + 280, + 254, + 15383, + 1923, + 6, + 82, + 32949, + 285, + 937, + 962, + 768, + 2854, + 13, + 185, + 185, + 16, + 13, + 429, + 1022, + 2387, + 4497, + 207, + 20, + 4063, + 13, + 185, + 185, + 17, + 13, + 429, + 1864, + 285, + 4443, + 9226, + 1319, + 1529, + 9682, + 372, + 1234, + 372, + 254, + 1022, + 2387, + 13, + 2086, + 11, + 207, + 17, + 575, + 207, + 20, + 403, + 207, + 16, + 15, + 4063, + 13, + 5512, + 745, + 418, + 984, + 9226, + 344, + 1529, + 207, + 16, + 15, + 4063, + 1319, + 11, + 254, + 3223, + 766, + 327, + 1069, + 984, + 9226, + 317, + 207, + 16, + 15, + 575, + 207, + 17, + 403, + 207, + 17, + 15, + 4063, + 13, + 185, + 185, + 18, + 13, + 429, + 1562, + 207, + 17, + 9226, + 1319, + 1529, + 3222, + 372, + 1234, + 372, + 254, + 1022, + 2387, + 13, + 2086, + 11, + 207, + 15, + 13, + 20, + 575, + 207, + 20, + 403, + 207, + 17, + 13, + 20, + 4063, + 13, + 5512, + 745, + 418, + 984, + 9226, + 344, + 1529, + 207, + 17, + 13, + 20, + 4063, + 1319, + 11, + 254, + 3223, + 766, + 327, + 1069, + 984, + 9226, + 317, + 207, + 17, + 13, + 20, + 575, + 207, + 17, + 403, + 207, + 20, + 4063, + 13, + 185, + 185, + 19, + 13, + 2158, + 1275, + 254, + 3223, + 766, + 359, + 4497, + 327, + 3326, + 276, + 8708, + 521, + 207, + 21, + 9226, + 280, + 254, + 15383, + 1923, + 6, + 82, + 32949, + 11, + 395, + 962, + 254, + 766, + 359, + 4497, + 327, + 1319, + 2387, + 25, + 207, + 20, + 334, + 6102, + 2387, + 8, + 919, + 207, + 17, + 15, + 334, + 9345, + 285, + 4443, + 9226, + 8, + 919, + 207, + 20, + 334, + 6355, + 984, + 9226, + 8, + 403, + 207, + 18, + 15, + 4063, + 13, + 185, + 185, + 3139, + 254, + 3510, + 317, + 628, + 63962, + 90, + 18, + 15, + 3013, + 100001 + ], + "generated_token_ids_sha256": "fdc36ad60d8d94773dc6e0a32efe4bd64768b6a91f45b6f9529399075118261a", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " To solve this problem, we need to calculate the time it takes for John to solve each side of the Rubik's cube and then add them together.\n\n1. The first side takes 5 minutes.\n\n2. The second and third sides each take twice as long as the first side. So, 2 * 5 = 10 minutes. Since there are two sides that take 10 minutes each, the total time for these two sides is 10 * 2 = 20 minutes.\n\n3. The last 2 sides each take half as long as the first side. So, 0.5 * 5 = 2.5 minutes. Since there are two sides that take 2.5 minutes each, the total time for these two sides is 2.5 * 2 = 5 minutes.\n\n4. To find the total time it takes for John to solve all 6 sides of the Rubik's cube, we add the time it takes for each side: 5 (first side) + 20 (second and third sides) + 5 (last two sides) = 30 minutes.\n\nSo the answer is $\\boxed{30}$.", + "text_sha256": "bb1adca5a2bfc7df962745e5f1e5182cab7b2c3055f935b83a33ed74b9a1c265", + "task_score": { + "gold_final": "30", + "predicted_final": "30", + "final_numeric_exact": true + } + }, + { + "condition": "s1_eos", + "factors": { + "system": 1, + "history": "filler", + "boundary": "eos", + "token_class": "special" + }, + "prompt_tokens": 115, + "left_padding_tokens": 0, + "prompt_token_ids_sha256": "9826fc7ee5c2b9677c860ff687740351402c53395073d397a387bb812035d3ed", + "generated_tokens": 200, + "generated_token_ids": [ + 2158, + 8708, + 437, + 2066, + 11, + 395, + 933, + 276, + 11462, + 254, + 766, + 359, + 4497, + 327, + 3326, + 276, + 8708, + 1319, + 2387, + 280, + 254, + 15383, + 1923, + 6, + 82, + 32949, + 285, + 937, + 962, + 768, + 2854, + 13, + 185, + 185, + 16, + 13, + 429, + 1022, + 2387, + 4497, + 207, + 20, + 4063, + 13, + 185, + 17, + 13, + 429, + 1864, + 285, + 4443, + 9226, + 1319, + 1529, + 9682, + 372, + 1234, + 372, + 254, + 1022, + 2387, + 11, + 558, + 207, + 17, + 575, + 207, + 20, + 403, + 207, + 16, + 15, + 4063, + 13, + 185, + 18, + 13, + 429, + 1562, + 207, + 17, + 9226, + 1319, + 1529, + 3222, + 372, + 1234, + 372, + 254, + 1022, + 2387, + 11, + 558, + 207, + 15, + 13, + 20, + 575, + 207, + 20, + 403, + 207, + 17, + 13, + 20, + 4063, + 1319, + 13, + 185, + 185, + 4388, + 11, + 1632, + 6, + 82, + 962, + 581, + 254, + 766, + 327, + 521, + 254, + 9226, + 25, + 185, + 185, + 20, + 4063, + 334, + 6102, + 2387, + 8, + 919, + 207, + 16, + 15, + 4063, + 334, + 9345, + 285, + 4443, + 9226, + 8, + 919, + 207, + 17, + 13, + 20, + 4063, + 334, + 58239, + 2387, + 8, + 919, + 207, + 17, + 13, + 20, + 4063, + 334, + 73195, + 2387, + 8, + 403, + 207, + 17, + 15, + 4063, + 13, + 185, + 185, + 3139, + 11, + 254, + 15383, + 1923, + 6, + 82, + 32949, + 4497, + 207, + 17, + 15, + 4063, + 276, + 8708, + 13, + 185, + 185, + 3139, + 254, + 3510, + 317, + 628, + 63962, + 90, + 17, + 15, + 3013, + 100001 + ], + "generated_token_ids_sha256": "2e866946da1744ce7a7031c7332609e3c8ad2af7a026efc1acd7facf4ac421a4", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " To solve this problem, we need to calculate the time it takes for John to solve each side of the Rubik's cube and then add them together.\n\n1. The first side takes 5 minutes.\n2. The second and third sides each take twice as long as the first side, so 2 * 5 = 10 minutes.\n3. The last 2 sides each take half as long as the first side, so 0.5 * 5 = 2.5 minutes each.\n\nNow, let's add up the time for all the sides:\n\n5 minutes (first side) + 10 minutes (second and third sides) + 2.5 minutes (fourth side) + 2.5 minutes (fifth side) = 20 minutes.\n\nSo, the Rubik's cube takes 20 minutes to solve.\n\nSo the answer is $\\boxed{20}$.", + "text_sha256": "683438d5a90638202b680f307e32fcf49cbce008ae3b0d95b90b12556eae35a2", + "task_score": { + "gold_final": "30", + "predicted_final": "20", + "final_numeric_exact": false + } + }, + { + "condition": "s0_bos", + "factors": { + "system": 0, + "history": "filler", + "boundary": "bos", + "token_class": "special" + }, + "prompt_tokens": 99, + "left_padding_tokens": 16, + "prompt_token_ids_sha256": "3fd156e5b2f57688543d3cac4a5a66278ee941a2b714b3ec05a13fb86f7cbe17", + "generated_tokens": 176, + "generated_token_ids": [ + 429, + 1022, + 2387, + 4497, + 207, + 20, + 4063, + 13, + 185, + 549, + 1864, + 2387, + 4497, + 9682, + 372, + 1234, + 372, + 254, + 1022, + 11, + 558, + 359, + 4497, + 207, + 20, + 575, + 207, + 17, + 403, + 207, + 16, + 15, + 4063, + 13, + 185, + 549, + 4443, + 2387, + 839, + 4497, + 9682, + 372, + 1234, + 372, + 254, + 1022, + 11, + 558, + 359, + 4497, + 207, + 20, + 575, + 207, + 17, + 575, + 207, + 17, + 403, + 207, + 17, + 15, + 4063, + 13, + 185, + 549, + 11363, + 2387, + 4497, + 3222, + 372, + 1234, + 372, + 254, + 1022, + 11, + 558, + 359, + 4497, + 207, + 20, + 893, + 207, + 17, + 403, + 207, + 17, + 13, + 20, + 4063, + 13, + 185, + 549, + 18097, + 2387, + 839, + 4497, + 3222, + 372, + 1234, + 372, + 254, + 1022, + 11, + 558, + 359, + 4497, + 207, + 20, + 893, + 207, + 17, + 575, + 207, + 17, + 403, + 207, + 20, + 4063, + 13, + 185, + 185, + 39726, + 581, + 521, + 254, + 2602, + 11, + 254, + 15383, + 1923, + 6, + 82, + 32949, + 4497, + 207, + 20, + 919, + 207, + 16, + 15, + 919, + 207, + 17, + 15, + 919, + 207, + 17, + 13, + 20, + 919, + 207, + 20, + 403, + 207, + 19, + 17, + 13, + 20, + 4063, + 13, + 185, + 185, + 3139, + 254, + 3510, + 317, + 628, + 63962, + 90, + 19, + 17, + 13, + 20, + 3013, + 100001 + ], + "generated_token_ids_sha256": "8151a40b15e865988e5b2856aea16ab62ba85a95f53d0d6953abff0d8760e8e2", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " The first side takes 5 minutes.\nThe second side takes twice as long as the first, so it takes 5 * 2 = 10 minutes.\nThe third side also takes twice as long as the first, so it takes 5 * 2 * 2 = 20 minutes.\nThe fourth side takes half as long as the first, so it takes 5 / 2 = 2.5 minutes.\nThe fifth side also takes half as long as the first, so it takes 5 / 2 * 2 = 5 minutes.\n\nAdding up all the times, the Rubik's cube takes 5 + 10 + 20 + 2.5 + 5 = 42.5 minutes.\n\nSo the answer is $\\boxed{42.5}$.", + "text_sha256": "313ec857f0e2c347fdb6e21567696e85e357482e6b9b1375cd9e356f69cd9327", + "task_score": { + "gold_final": "30", + "predicted_final": "42.5", + "final_numeric_exact": false + } + }, + { + "condition": "s1_bos", + "factors": { + "system": 1, + "history": "filler", + "boundary": "bos", + "token_class": "special" + }, + "prompt_tokens": 115, + "left_padding_tokens": 0, + "prompt_token_ids_sha256": "24f575a36c25b0cb1a7946f43dc44c3801f72245c252e1226d835897e20b0059", + "generated_tokens": 172, + "generated_token_ids": [ + 429, + 1022, + 2387, + 4497, + 207, + 20, + 4063, + 13, + 185, + 549, + 1864, + 2387, + 4497, + 9682, + 372, + 1234, + 372, + 254, + 1022, + 11, + 558, + 207, + 20, + 1376, + 207, + 17, + 403, + 207, + 16, + 15, + 4063, + 13, + 185, + 549, + 4443, + 2387, + 839, + 4497, + 9682, + 372, + 1234, + 372, + 254, + 1022, + 11, + 558, + 207, + 20, + 1376, + 207, + 17, + 403, + 207, + 16, + 15, + 4063, + 13, + 185, + 549, + 11363, + 2387, + 4497, + 3222, + 372, + 1234, + 372, + 254, + 1022, + 11, + 558, + 207, + 20, + 893, + 207, + 17, + 403, + 207, + 17, + 13, + 20, + 4063, + 13, + 185, + 549, + 18097, + 2387, + 839, + 4497, + 3222, + 372, + 1234, + 372, + 254, + 1022, + 11, + 558, + 207, + 20, + 893, + 207, + 17, + 403, + 207, + 17, + 13, + 20, + 4063, + 13, + 185, + 185, + 1898, + 1275, + 254, + 3223, + 766, + 11, + 395, + 962, + 581, + 521, + 254, + 2602, + 25, + 185, + 20, + 919, + 207, + 16, + 15, + 919, + 207, + 16, + 15, + 919, + 207, + 17, + 13, + 20, + 919, + 207, + 17, + 13, + 20, + 403, + 207, + 18, + 15, + 4063, + 13, + 185, + 185, + 549, + 15383, + 1923, + 6, + 82, + 32949, + 4497, + 207, + 18, + 15, + 4063, + 13, + 185, + 549, + 3510, + 317, + 25, + 207, + 18, + 15, + 100001 + ], + "generated_token_ids_sha256": "c8b7222ba2184ffa7cd0ed11b768d50df4aa5ace22a617e7ee1148bdd2c80c9e", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " The first side takes 5 minutes.\nThe second side takes twice as long as the first, so 5 x 2 = 10 minutes.\nThe third side also takes twice as long as the first, so 5 x 2 = 10 minutes.\nThe fourth side takes half as long as the first, so 5 / 2 = 2.5 minutes.\nThe fifth side also takes half as long as the first, so 5 / 2 = 2.5 minutes.\n\nTo find the total time, we add up all the times:\n5 + 10 + 10 + 2.5 + 2.5 = 30 minutes.\n\nThe Rubik's cube takes 30 minutes.\nThe answer is: 30", + "text_sha256": "04edc5d8cc16f0de4f27d652acc07cc8565b944a32282c048875ee683ba5722b", + "task_score": { + "gold_final": "30", + "predicted_final": "30", + "final_numeric_exact": true + } + }, + { + "condition": "s0_x", + "factors": { + "system": 0, + "history": "filler", + "boundary": "x", + "token_class": "ordinary_control" + }, + "prompt_tokens": 99, + "left_padding_tokens": 16, + "prompt_token_ids_sha256": "64d49f0054db6205880b0687d129a51debca8056dc7a878500dd0e27b170fcbe", + "generated_tokens": 251, + "generated_token_ids": [ + 3960, + 6, + 82, + 2973, + 1224, + 254, + 766, + 359, + 4497, + 327, + 3326, + 276, + 8708, + 1319, + 2387, + 280, + 254, + 15383, + 1923, + 6, + 82, + 32949, + 25, + 185, + 185, + 16, + 13, + 429, + 1022, + 2387, + 4497, + 207, + 20, + 4063, + 13, + 185, + 17, + 13, + 429, + 1864, + 2387, + 4497, + 9682, + 372, + 1234, + 372, + 254, + 1022, + 11, + 558, + 359, + 4497, + 207, + 17, + 575, + 207, + 20, + 403, + 207, + 16, + 15, + 4063, + 13, + 185, + 18, + 13, + 429, + 4443, + 2387, + 839, + 4497, + 9682, + 372, + 1234, + 372, + 254, + 1022, + 11, + 558, + 359, + 4497, + 207, + 17, + 575, + 207, + 20, + 403, + 207, + 16, + 15, + 4063, + 13, + 185, + 19, + 13, + 429, + 11363, + 2387, + 4497, + 3222, + 372, + 1234, + 372, + 254, + 1022, + 11, + 558, + 359, + 4497, + 207, + 20, + 893, + 207, + 17, + 403, + 207, + 17, + 13, + 20, + 4063, + 13, + 185, + 20, + 13, + 429, + 18097, + 2387, + 839, + 4497, + 3222, + 372, + 1234, + 372, + 254, + 1022, + 11, + 558, + 359, + 4497, + 207, + 20, + 893, + 207, + 17, + 403, + 207, + 17, + 13, + 20, + 4063, + 13, + 185, + 185, + 4388, + 11, + 1632, + 6, + 82, + 962, + 581, + 254, + 766, + 359, + 4497, + 327, + 3326, + 276, + 8708, + 521, + 207, + 21, + 9226, + 25, + 185, + 185, + 20, + 334, + 6102, + 2387, + 8, + 919, + 207, + 16, + 15, + 334, + 9345, + 2387, + 8, + 919, + 207, + 16, + 15, + 334, + 20783, + 2387, + 8, + 919, + 207, + 17, + 13, + 20, + 334, + 58239, + 2387, + 8, + 919, + 207, + 17, + 13, + 20, + 334, + 73195, + 2387, + 8, + 919, + 207, + 17, + 13, + 20, + 334, + 22276, + 393, + 2387, + 8, + 403, + 207, + 18, + 18, + 4063, + 13, + 185, + 185, + 3139, + 11, + 359, + 4497, + 3326, + 207, + 18, + 18, + 4063, + 276, + 8708, + 254, + 15383, + 1923, + 6, + 82, + 32949, + 13, + 100001 + ], + "generated_token_ids_sha256": "4065692127945063597ccea385681a2d6bf54c068e9da5a1fd0fe12fc001eaa2", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " Let's break down the time it takes for John to solve each side of the Rubik's cube:\n\n1. The first side takes 5 minutes.\n2. The second side takes twice as long as the first, so it takes 2 * 5 = 10 minutes.\n3. The third side also takes twice as long as the first, so it takes 2 * 5 = 10 minutes.\n4. The fourth side takes half as long as the first, so it takes 5 / 2 = 2.5 minutes.\n5. The fifth side also takes half as long as the first, so it takes 5 / 2 = 2.5 minutes.\n\nNow, let's add up the time it takes for John to solve all 6 sides:\n\n5 (first side) + 10 (second side) + 10 (third side) + 2.5 (fourth side) + 2.5 (fifth side) + 2.5 (sixth side) = 33 minutes.\n\nSo, it takes John 33 minutes to solve the Rubik's cube.", + "text_sha256": "8b1302ba345b8e6b349b97f74c9a101b98996eee8a15fe4abee3d2fc6c7ed76b", + "task_score": { + "gold_final": "30", + "predicted_final": "33", + "final_numeric_exact": false + } + }, + { + "condition": "s1_x", + "factors": { + "system": 1, + "history": "filler", + "boundary": "x", + "token_class": "ordinary_control" + }, + "prompt_tokens": 115, + "left_padding_tokens": 0, + "prompt_token_ids_sha256": "344602c1c00a954952d226c6ce8ed07d163c2728ea0b8778732ad9a6432d7d6c", + "generated_tokens": 246, + "generated_token_ids": [ + 2158, + 8708, + 437, + 2066, + 11, + 395, + 933, + 276, + 11462, + 254, + 766, + 359, + 4497, + 327, + 3326, + 276, + 8708, + 1319, + 2387, + 280, + 254, + 15383, + 1923, + 6, + 82, + 32949, + 285, + 937, + 962, + 768, + 2854, + 13, + 185, + 185, + 16, + 13, + 429, + 1022, + 2387, + 4497, + 207, + 20, + 4063, + 13, + 185, + 17, + 13, + 429, + 1864, + 2387, + 4497, + 9682, + 372, + 1234, + 372, + 254, + 1022, + 11, + 558, + 207, + 17, + 575, + 207, + 20, + 4063, + 403, + 207, + 16, + 15, + 4063, + 13, + 185, + 18, + 13, + 429, + 4443, + 2387, + 839, + 4497, + 9682, + 372, + 1234, + 372, + 254, + 1022, + 11, + 558, + 207, + 17, + 575, + 207, + 20, + 4063, + 403, + 207, + 16, + 15, + 4063, + 13, + 185, + 19, + 13, + 429, + 11363, + 2387, + 4497, + 3222, + 372, + 1234, + 372, + 254, + 1022, + 11, + 558, + 207, + 20, + 4063, + 893, + 207, + 17, + 403, + 207, + 17, + 13, + 20, + 4063, + 13, + 185, + 20, + 13, + 429, + 18097, + 2387, + 4497, + 3222, + 372, + 1234, + 372, + 254, + 1022, + 11, + 558, + 207, + 20, + 4063, + 893, + 207, + 17, + 403, + 207, + 17, + 13, + 20, + 4063, + 13, + 185, + 185, + 4388, + 11, + 395, + 962, + 581, + 254, + 766, + 327, + 521, + 254, + 9226, + 25, + 185, + 20, + 4063, + 334, + 6102, + 2387, + 8, + 919, + 207, + 16, + 15, + 4063, + 334, + 9345, + 2387, + 8, + 919, + 207, + 16, + 15, + 4063, + 334, + 20783, + 2387, + 8, + 919, + 207, + 17, + 13, + 20, + 4063, + 334, + 58239, + 2387, + 8, + 919, + 207, + 17, + 13, + 20, + 4063, + 334, + 73195, + 2387, + 8, + 403, + 207, + 18, + 15, + 4063, + 13, + 185, + 185, + 14494, + 11, + 359, + 4497, + 3326, + 207, + 18, + 15, + 4063, + 276, + 8708, + 521, + 207, + 21, + 9226, + 280, + 254, + 15383, + 1923, + 6, + 82, + 32949, + 13, + 100001 + ], + "generated_token_ids_sha256": "94b7b24e3b427781a9e6487553437db78a87414636a6ac2c096d9ef30d282d51", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " To solve this problem, we need to calculate the time it takes for John to solve each side of the Rubik's cube and then add them together.\n\n1. The first side takes 5 minutes.\n2. The second side takes twice as long as the first, so 2 * 5 minutes = 10 minutes.\n3. The third side also takes twice as long as the first, so 2 * 5 minutes = 10 minutes.\n4. The fourth side takes half as long as the first, so 5 minutes / 2 = 2.5 minutes.\n5. The fifth side takes half as long as the first, so 5 minutes / 2 = 2.5 minutes.\n\nNow, we add up the time for all the sides:\n5 minutes (first side) + 10 minutes (second side) + 10 minutes (third side) + 2.5 minutes (fourth side) + 2.5 minutes (fifth side) = 30 minutes.\n\nTherefore, it takes John 30 minutes to solve all 6 sides of the Rubik's cube.", + "text_sha256": "4a3ad839bfb4307b78ab4ec92ebe34c3c8ea90a9e69284d9edab3401a30efb64", + "task_score": { + "gold_final": "30", + "predicted_final": "6", + "final_numeric_exact": false + } + }, + { + "condition": "s0_period", + "factors": { + "system": 0, + "history": "filler", + "boundary": "period", + "token_class": "ordinary_control" + }, + "prompt_tokens": 99, + "left_padding_tokens": 16, + "prompt_token_ids_sha256": "44c836c323e7e7a07a5153325738d347e28b910234dfb1a8883184546ecadd9f", + "generated_tokens": 235, + "generated_token_ids": [ + 2158, + 8708, + 437, + 2066, + 11, + 395, + 933, + 276, + 11462, + 254, + 766, + 359, + 4497, + 327, + 3326, + 276, + 8708, + 1319, + 2387, + 280, + 254, + 15383, + 1923, + 6, + 82, + 32949, + 285, + 937, + 962, + 768, + 2854, + 13, + 185, + 185, + 16, + 13, + 429, + 1022, + 2387, + 4497, + 207, + 20, + 4063, + 13, + 185, + 17, + 13, + 429, + 1864, + 2387, + 4497, + 9682, + 372, + 1234, + 372, + 254, + 1022, + 11, + 558, + 207, + 17, + 575, + 207, + 20, + 403, + 207, + 16, + 15, + 4063, + 13, + 185, + 18, + 13, + 429, + 4443, + 2387, + 839, + 4497, + 9682, + 372, + 1234, + 372, + 254, + 1022, + 11, + 558, + 207, + 17, + 575, + 207, + 20, + 403, + 207, + 16, + 15, + 4063, + 13, + 185, + 19, + 13, + 429, + 11363, + 2387, + 4497, + 3222, + 372, + 1234, + 372, + 254, + 1022, + 11, + 558, + 207, + 20, + 893, + 207, + 17, + 403, + 207, + 17, + 13, + 20, + 4063, + 13, + 185, + 20, + 13, + 429, + 18097, + 2387, + 839, + 4497, + 3222, + 372, + 1234, + 372, + 254, + 1022, + 11, + 558, + 207, + 17, + 13, + 20, + 4063, + 13, + 185, + 185, + 4388, + 11, + 395, + 962, + 581, + 521, + 254, + 2602, + 25, + 185, + 185, + 20, + 4063, + 334, + 6102, + 2387, + 8, + 919, + 207, + 16, + 15, + 4063, + 334, + 9345, + 2387, + 8, + 919, + 207, + 16, + 15, + 4063, + 334, + 20783, + 2387, + 8, + 919, + 207, + 17, + 13, + 20, + 4063, + 334, + 58239, + 2387, + 8, + 919, + 207, + 17, + 13, + 20, + 4063, + 334, + 73195, + 2387, + 8, + 403, + 207, + 18, + 15, + 4063, + 13, + 185, + 185, + 3139, + 11, + 359, + 4497, + 3326, + 207, + 18, + 15, + 4063, + 276, + 8708, + 521, + 207, + 21, + 9226, + 280, + 254, + 15383, + 1923, + 6, + 82, + 32949, + 13, + 100001 + ], + "generated_token_ids_sha256": "b14181466787e63179fc4cc2e8f2aa636a33f88d10155d74adc236dae6d6e795", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " To solve this problem, we need to calculate the time it takes for John to solve each side of the Rubik's cube and then add them together.\n\n1. The first side takes 5 minutes.\n2. The second side takes twice as long as the first, so 2 * 5 = 10 minutes.\n3. The third side also takes twice as long as the first, so 2 * 5 = 10 minutes.\n4. The fourth side takes half as long as the first, so 5 / 2 = 2.5 minutes.\n5. The fifth side also takes half as long as the first, so 2.5 minutes.\n\nNow, we add up all the times:\n\n5 minutes (first side) + 10 minutes (second side) + 10 minutes (third side) + 2.5 minutes (fourth side) + 2.5 minutes (fifth side) = 30 minutes.\n\nSo, it takes John 30 minutes to solve all 6 sides of the Rubik's cube.", + "text_sha256": "bea129f0b204165cd5301f144a8ba2c0093708e5b64b8d6eb150c09ec729d01c", + "task_score": { + "gold_final": "30", + "predicted_final": "6", + "final_numeric_exact": false + } + }, + { + "condition": "s1_period", + "factors": { + "system": 1, + "history": "filler", + "boundary": "period", + "token_class": "ordinary_control" + }, + "prompt_tokens": 115, + "left_padding_tokens": 0, + "prompt_token_ids_sha256": "ff4b886b7a2e0289202dd757d2754cc337b6577268f81cdc2ac0b5db5f2edf9f", + "generated_tokens": 210, + "generated_token_ids": [ + 2158, + 8708, + 437, + 2066, + 11, + 395, + 933, + 276, + 6983, + 254, + 3223, + 766, + 359, + 4497, + 327, + 3326, + 276, + 8708, + 254, + 15383, + 1923, + 6, + 82, + 32949, + 13, + 1003, + 1006, + 254, + 766, + 359, + 4497, + 327, + 1319, + 2387, + 285, + 254, + 7937, + 280, + 254, + 766, + 359, + 4497, + 276, + 8708, + 1319, + 2387, + 13, + 185, + 185, + 16, + 13, + 429, + 1022, + 2387, + 4497, + 207, + 20, + 4063, + 13, + 185, + 17, + 13, + 429, + 1864, + 285, + 4443, + 9226, + 1319, + 1529, + 9682, + 372, + 1234, + 372, + 254, + 1022, + 11, + 558, + 207, + 17, + 575, + 207, + 20, + 403, + 207, + 16, + 15, + 4063, + 1319, + 13, + 185, + 18, + 13, + 429, + 1562, + 207, + 17, + 9226, + 1319, + 1529, + 3222, + 372, + 1234, + 372, + 254, + 1022, + 11, + 558, + 207, + 15, + 13, + 20, + 575, + 207, + 20, + 403, + 207, + 17, + 13, + 20, + 4063, + 1319, + 13, + 185, + 185, + 4388, + 11, + 1632, + 6, + 82, + 962, + 581, + 254, + 766, + 327, + 1319, + 2387, + 25, + 185, + 185, + 20, + 4063, + 334, + 6102, + 2387, + 8, + 919, + 207, + 16, + 15, + 4063, + 334, + 9345, + 2387, + 8, + 919, + 207, + 16, + 15, + 4063, + 334, + 20783, + 2387, + 8, + 919, + 207, + 17, + 13, + 20, + 4063, + 334, + 58239, + 2387, + 8, + 919, + 207, + 17, + 13, + 20, + 4063, + 334, + 73195, + 2387, + 8, + 403, + 207, + 18, + 15, + 4063, + 13, + 185, + 185, + 14494, + 11, + 359, + 4497, + 3326, + 207, + 18, + 15, + 4063, + 276, + 8708, + 254, + 15383, + 1923, + 6, + 82, + 32949, + 13, + 100001 + ], + "generated_token_ids_sha256": "78843b3beba7461c2b8990ee73c434808c6034051aa186f4fb896cf8d0486a6b", + "hit_eos": true, + "stopped_at_max_new_tokens": false, + "text": " To solve this problem, we need to determine the total time it takes for John to solve the Rubik's cube. We know the time it takes for each side and the pattern of the time it takes to solve each side.\n\n1. The first side takes 5 minutes.\n2. The second and third sides each take twice as long as the first, so 2 * 5 = 10 minutes each.\n3. The last 2 sides each take half as long as the first, so 0.5 * 5 = 2.5 minutes each.\n\nNow, let's add up the time for each side:\n\n5 minutes (first side) + 10 minutes (second side) + 10 minutes (third side) + 2.5 minutes (fourth side) + 2.5 minutes (fifth side) = 30 minutes.\n\nTherefore, it takes John 30 minutes to solve the Rubik's cube.", + "text_sha256": "e69ceefb9dabd0f381009ba2ab15f2000ecf784ad66fc87582141c748f2dfa9d", + "task_score": { + "gold_final": "30", + "predicted_final": "30", + "final_numeric_exact": true + } + } + ] + } + ], + "summary": { + "pairwise": { + "system_eos": [ + { + "left": "s0_eos", + "right": "s1_eos", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 63, + "token_edit_distance": 306, + "normalized_token_similarity": 0.3390928725701944, + "source_id": "wikitext2/raw-validation/0443", + "domain": "english" + }, + { + "left": "s0_eos", + "right": "s1_eos", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 37, + "token_edit_distance": 352, + "normalized_token_similarity": 0.15384615384615385, + "source_id": "wikitext2/raw-validation/0030", + "domain": "english" + }, + { + "left": "s0_eos", + "right": "s1_eos", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 35, + "token_edit_distance": 32, + "normalized_token_similarity": 0.7746478873239436, + "source_id": "wikitext2/raw-validation/2909", + "domain": "english" + }, + { + "left": "s0_eos", + "right": "s1_eos", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 11, + "token_edit_distance": 437, + "normalized_token_similarity": 0.146484375, + "source_id": "wikitext2/raw-validation/2746", + "domain": "english" + }, + { + "left": "s0_eos", + "right": "s1_eos", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 4, + "token_edit_distance": 74, + "normalized_token_similarity": 0.2210526315789474, + "source_id": "tnews/test/4855", + "domain": "chinese" + }, + { + "left": "s0_eos", + "right": "s1_eos", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 1, + "token_edit_distance": 136, + "normalized_token_similarity": 0.16564417177914115, + "source_id": "tnews/test/8935", + "domain": "chinese" + }, + { + "left": "s0_eos", + "right": "s1_eos", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 25, + "token_edit_distance": 99, + "normalized_token_similarity": 0.3529411764705882, + "source_id": "tnews/test/3448", + "domain": "chinese" + }, + { + "left": "s0_eos", + "right": "s1_eos", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 40, + "token_edit_distance": 142, + "normalized_token_similarity": 0.4251012145748988, + "source_id": "tnews/test/1059", + "domain": "chinese" + }, + { + "left": "s0_eos", + "right": "s1_eos", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 1, + "token_edit_distance": 308, + "normalized_token_similarity": 0.22418136020151136, + "source_id": "HumanEval/31", + "domain": "code" + }, + { + "left": "s0_eos", + "right": "s1_eos", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 1, + "token_edit_distance": 467, + "normalized_token_similarity": 0.087890625, + "source_id": "HumanEval/44", + "domain": "code" + }, + { + "left": "s0_eos", + "right": "s1_eos", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 2, + "token_edit_distance": 202, + "normalized_token_similarity": 0.5144230769230769, + "source_id": "HumanEval/133", + "domain": "code" + }, + { + "left": "s0_eos", + "right": "s1_eos", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 1, + "token_edit_distance": 92, + "normalized_token_similarity": 0.36986301369863017, + "source_id": "HumanEval/23", + "domain": "code" + }, + { + "left": "s0_eos", + "right": "s1_eos", + "token_ids_exact": true, + "text_exact": true, + "common_prefix_tokens": 213, + "token_edit_distance": 0, + "normalized_token_similarity": 1.0, + "source_id": "gsm8k/test/1069", + "domain": "math" + }, + { + "left": "s0_eos", + "right": "s1_eos", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 144, + "token_edit_distance": 46, + "normalized_token_similarity": 0.8217054263565892, + "source_id": "gsm8k/test/1228", + "domain": "math" + }, + { + "left": "s0_eos", + "right": "s1_eos", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 4, + "token_edit_distance": 55, + "normalized_token_similarity": 0.7277227722772277, + "source_id": "gsm8k/test/0144", + "domain": "math" + }, + { + "left": "s0_eos", + "right": "s1_eos", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 45, + "token_edit_distance": 129, + "normalized_token_similarity": 0.5, + "source_id": "gsm8k/test/1251", + "domain": "math" + } + ], + "system_bos": [ + { + "left": "s0_bos", + "right": "s1_bos", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 0, + "token_edit_distance": 446, + "normalized_token_similarity": 0.12890625, + "source_id": "wikitext2/raw-validation/0443", + "domain": "english" + }, + { + "left": "s0_bos", + "right": "s1_bos", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 6, + "token_edit_distance": 407, + "normalized_token_similarity": 0.13034188034188032, + "source_id": "wikitext2/raw-validation/0030", + "domain": "english" + }, + { + "left": "s0_bos", + "right": "s1_bos", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 8, + "token_edit_distance": 134, + "normalized_token_similarity": 0.42978723404255315, + "source_id": "wikitext2/raw-validation/2909", + "domain": "english" + }, + { + "left": "s0_bos", + "right": "s1_bos", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 23, + "token_edit_distance": 388, + "normalized_token_similarity": 0.13968957871396892, + "source_id": "wikitext2/raw-validation/2746", + "domain": "english" + }, + { + "left": "s0_bos", + "right": "s1_bos", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 4, + "token_edit_distance": 63, + "normalized_token_similarity": 0.37, + "source_id": "tnews/test/4855", + "domain": "chinese" + }, + { + "left": "s0_bos", + "right": "s1_bos", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 22, + "token_edit_distance": 22, + "normalized_token_similarity": 0.7684210526315789, + "source_id": "tnews/test/8935", + "domain": "chinese" + }, + { + "left": "s0_bos", + "right": "s1_bos", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 21, + "token_edit_distance": 332, + "normalized_token_similarity": 0.10027100271002709, + "source_id": "tnews/test/3448", + "domain": "chinese" + }, + { + "left": "s0_bos", + "right": "s1_bos", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 15, + "token_edit_distance": 225, + "normalized_token_similarity": 0.296875, + "source_id": "tnews/test/1059", + "domain": "chinese" + }, + { + "left": "s0_bos", + "right": "s1_bos", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 1, + "token_edit_distance": 322, + "normalized_token_similarity": 0.2184466019417476, + "source_id": "HumanEval/31", + "domain": "code" + }, + { + "left": "s0_bos", + "right": "s1_bos", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 6, + "token_edit_distance": 278, + "normalized_token_similarity": 0.31862745098039214, + "source_id": "HumanEval/44", + "domain": "code" + }, + { + "left": "s0_bos", + "right": "s1_bos", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 34, + "token_edit_distance": 72, + "normalized_token_similarity": 0.8005540166204986, + "source_id": "HumanEval/133", + "domain": "code" + }, + { + "left": "s0_bos", + "right": "s1_bos", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 0, + "token_edit_distance": 100, + "normalized_token_similarity": 0.32885906040268453, + "source_id": "HumanEval/23", + "domain": "code" + }, + { + "left": "s0_bos", + "right": "s1_bos", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 65, + "token_edit_distance": 83, + "normalized_token_similarity": 0.6066350710900474, + "source_id": "gsm8k/test/1069", + "domain": "math" + }, + { + "left": "s0_bos", + "right": "s1_bos", + "token_ids_exact": true, + "text_exact": true, + "common_prefix_tokens": 228, + "token_edit_distance": 0, + "normalized_token_similarity": 1.0, + "source_id": "gsm8k/test/1228", + "domain": "math" + }, + { + "left": "s0_bos", + "right": "s1_bos", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 0, + "token_edit_distance": 205, + "normalized_token_similarity": 0.16666666666666663, + "source_id": "gsm8k/test/0144", + "domain": "math" + }, + { + "left": "s0_bos", + "right": "s1_bos", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 21, + "token_edit_distance": 56, + "normalized_token_similarity": 0.6818181818181819, + "source_id": "gsm8k/test/1251", + "domain": "math" + } + ], + "system_x": [ + { + "left": "s0_x", + "right": "s1_x", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 6, + "token_edit_distance": 343, + "normalized_token_similarity": 0.22747747747747749, + "source_id": "wikitext2/raw-validation/0443", + "domain": "english" + }, + { + "left": "s0_x", + "right": "s1_x", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 28, + "token_edit_distance": 458, + "normalized_token_similarity": 0.10546875, + "source_id": "wikitext2/raw-validation/0030", + "domain": "english" + }, + { + "left": "s0_x", + "right": "s1_x", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 0, + "token_edit_distance": 451, + "normalized_token_similarity": 0.119140625, + "source_id": "wikitext2/raw-validation/2909", + "domain": "english" + }, + { + "left": "s0_x", + "right": "s1_x", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 1, + "token_edit_distance": 438, + "normalized_token_similarity": 0.14453125, + "source_id": "wikitext2/raw-validation/2746", + "domain": "english" + }, + { + "left": "s0_x", + "right": "s1_x", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 4, + "token_edit_distance": 82, + "normalized_token_similarity": 0.2743362831858407, + "source_id": "tnews/test/4855", + "domain": "chinese" + }, + { + "left": "s0_x", + "right": "s1_x", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 1, + "token_edit_distance": 94, + "normalized_token_similarity": 0.1132075471698113, + "source_id": "tnews/test/8935", + "domain": "chinese" + }, + { + "left": "s0_x", + "right": "s1_x", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 7, + "token_edit_distance": 148, + "normalized_token_similarity": 0.19565217391304346, + "source_id": "tnews/test/3448", + "domain": "chinese" + }, + { + "left": "s0_x", + "right": "s1_x", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 8, + "token_edit_distance": 118, + "normalized_token_similarity": 0.2387096774193549, + "source_id": "tnews/test/1059", + "domain": "chinese" + }, + { + "left": "s0_x", + "right": "s1_x", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 0, + "token_edit_distance": 359, + "normalized_token_similarity": 0.1631701631701632, + "source_id": "HumanEval/31", + "domain": "code" + }, + { + "left": "s0_x", + "right": "s1_x", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 6, + "token_edit_distance": 373, + "normalized_token_similarity": 0.18201754385964908, + "source_id": "HumanEval/44", + "domain": "code" + }, + { + "left": "s0_x", + "right": "s1_x", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 8, + "token_edit_distance": 59, + "normalized_token_similarity": 0.8365650969529086, + "source_id": "HumanEval/133", + "domain": "code" + }, + { + "left": "s0_x", + "right": "s1_x", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 0, + "token_edit_distance": 147, + "normalized_token_similarity": 0.18333333333333335, + "source_id": "HumanEval/23", + "domain": "code" + }, + { + "left": "s0_x", + "right": "s1_x", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 9, + "token_edit_distance": 118, + "normalized_token_similarity": 0.3586956521739131, + "source_id": "gsm8k/test/1069", + "domain": "math" + }, + { + "left": "s0_x", + "right": "s1_x", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 0, + "token_edit_distance": 163, + "normalized_token_similarity": 0.2657657657657657, + "source_id": "gsm8k/test/1228", + "domain": "math" + }, + { + "left": "s0_x", + "right": "s1_x", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 0, + "token_edit_distance": 187, + "normalized_token_similarity": 0.1576576576576577, + "source_id": "gsm8k/test/0144", + "domain": "math" + }, + { + "left": "s0_x", + "right": "s1_x", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 0, + "token_edit_distance": 62, + "normalized_token_similarity": 0.7529880478087649, + "source_id": "gsm8k/test/1251", + "domain": "math" + } + ], + "system_period": [ + { + "left": "s0_period", + "right": "s1_period", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 6, + "token_edit_distance": 376, + "normalized_token_similarity": 0.15883668903803128, + "source_id": "wikitext2/raw-validation/0443", + "domain": "english" + }, + { + "left": "s0_period", + "right": "s1_period", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 6, + "token_edit_distance": 209, + "normalized_token_similarity": 0.1992337164750958, + "source_id": "wikitext2/raw-validation/0030", + "domain": "english" + }, + { + "left": "s0_period", + "right": "s1_period", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 0, + "token_edit_distance": 186, + "normalized_token_similarity": 0.211864406779661, + "source_id": "wikitext2/raw-validation/2909", + "domain": "english" + }, + { + "left": "s0_period", + "right": "s1_period", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 1, + "token_edit_distance": 450, + "normalized_token_similarity": 0.12109375, + "source_id": "wikitext2/raw-validation/2746", + "domain": "english" + }, + { + "left": "s0_period", + "right": "s1_period", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 4, + "token_edit_distance": 101, + "normalized_token_similarity": 0.1367521367521367, + "source_id": "tnews/test/4855", + "domain": "chinese" + }, + { + "left": "s0_period", + "right": "s1_period", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 7, + "token_edit_distance": 227, + "normalized_token_similarity": 0.14661654135338342, + "source_id": "tnews/test/8935", + "domain": "chinese" + }, + { + "left": "s0_period", + "right": "s1_period", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 7, + "token_edit_distance": 99, + "normalized_token_similarity": 0.12389380530973448, + "source_id": "tnews/test/3448", + "domain": "chinese" + }, + { + "left": "s0_period", + "right": "s1_period", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 13, + "token_edit_distance": 182, + "normalized_token_similarity": 0.19111111111111112, + "source_id": "tnews/test/1059", + "domain": "chinese" + }, + { + "left": "s0_period", + "right": "s1_period", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 0, + "token_edit_distance": 314, + "normalized_token_similarity": 0.11549295774647883, + "source_id": "HumanEval/31", + "domain": "code" + }, + { + "left": "s0_period", + "right": "s1_period", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 0, + "token_edit_distance": 264, + "normalized_token_similarity": 0.2727272727272727, + "source_id": "HumanEval/44", + "domain": "code" + }, + { + "left": "s0_period", + "right": "s1_period", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 0, + "token_edit_distance": 318, + "normalized_token_similarity": 0.13351498637602177, + "source_id": "HumanEval/133", + "domain": "code" + }, + { + "left": "s0_period", + "right": "s1_period", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 0, + "token_edit_distance": 148, + "normalized_token_similarity": 0.22513089005235598, + "source_id": "HumanEval/23", + "domain": "code" + }, + { + "left": "s0_period", + "right": "s1_period", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 9, + "token_edit_distance": 78, + "normalized_token_similarity": 0.5979381443298969, + "source_id": "gsm8k/test/1069", + "domain": "math" + }, + { + "left": "s0_period", + "right": "s1_period", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 11, + "token_edit_distance": 72, + "normalized_token_similarity": 0.7037037037037037, + "source_id": "gsm8k/test/1228", + "domain": "math" + }, + { + "left": "s0_period", + "right": "s1_period", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 0, + "token_edit_distance": 219, + "normalized_token_similarity": 0.2448275862068966, + "source_id": "gsm8k/test/0144", + "domain": "math" + }, + { + "left": "s0_period", + "right": "s1_period", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 8, + "token_edit_distance": 96, + "normalized_token_similarity": 0.5914893617021277, + "source_id": "gsm8k/test/1251", + "domain": "math" + } + ], + "bos_at_s0": [ + { + "left": "s0_eos", + "right": "s0_bos", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 0, + "token_edit_distance": 449, + "normalized_token_similarity": 0.123046875, + "source_id": "wikitext2/raw-validation/0443", + "domain": "english" + }, + { + "left": "s0_eos", + "right": "s0_bos", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 37, + "token_edit_distance": 392, + "normalized_token_similarity": 0.16239316239316237, + "source_id": "wikitext2/raw-validation/0030", + "domain": "english" + }, + { + "left": "s0_eos", + "right": "s0_bos", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 8, + "token_edit_distance": 155, + "normalized_token_similarity": 0.34042553191489366, + "source_id": "wikitext2/raw-validation/2909", + "domain": "english" + }, + { + "left": "s0_eos", + "right": "s0_bos", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 11, + "token_edit_distance": 436, + "normalized_token_similarity": 0.1484375, + "source_id": "wikitext2/raw-validation/2746", + "domain": "english" + }, + { + "left": "s0_eos", + "right": "s0_bos", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 21, + "token_edit_distance": 69, + "normalized_token_similarity": 0.31000000000000005, + "source_id": "tnews/test/4855", + "domain": "chinese" + }, + { + "left": "s0_eos", + "right": "s0_bos", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 14, + "token_edit_distance": 56, + "normalized_token_similarity": 0.4862385321100917, + "source_id": "tnews/test/8935", + "domain": "chinese" + }, + { + "left": "s0_eos", + "right": "s0_bos", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 8, + "token_edit_distance": 131, + "normalized_token_similarity": 0.14379084967320266, + "source_id": "tnews/test/3448", + "domain": "chinese" + }, + { + "left": "s0_eos", + "right": "s0_bos", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 1, + "token_edit_distance": 264, + "normalized_token_similarity": 0.17500000000000004, + "source_id": "tnews/test/1059", + "domain": "chinese" + }, + { + "left": "s0_eos", + "right": "s0_bos", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 248, + "token_edit_distance": 43, + "normalized_token_similarity": 0.8956310679611651, + "source_id": "HumanEval/31", + "domain": "code" + }, + { + "left": "s0_eos", + "right": "s0_bos", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 1, + "token_edit_distance": 335, + "normalized_token_similarity": 0.345703125, + "source_id": "HumanEval/44", + "domain": "code" + }, + { + "left": "s0_eos", + "right": "s0_bos", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 2, + "token_edit_distance": 76, + "normalized_token_similarity": 0.8056265984654731, + "source_id": "HumanEval/133", + "domain": "code" + }, + { + "left": "s0_eos", + "right": "s0_bos", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 0, + "token_edit_distance": 86, + "normalized_token_similarity": 0.410958904109589, + "source_id": "HumanEval/23", + "domain": "code" + }, + { + "left": "s0_eos", + "right": "s0_bos", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 34, + "token_edit_distance": 4, + "normalized_token_similarity": 0.9812206572769953, + "source_id": "gsm8k/test/1069", + "domain": "math" + }, + { + "left": "s0_eos", + "right": "s0_bos", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 132, + "token_edit_distance": 50, + "normalized_token_similarity": 0.8062015503875969, + "source_id": "gsm8k/test/1228", + "domain": "math" + }, + { + "left": "s0_eos", + "right": "s0_bos", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 0, + "token_edit_distance": 201, + "normalized_token_similarity": 0.18292682926829273, + "source_id": "gsm8k/test/0144", + "domain": "math" + }, + { + "left": "s0_eos", + "right": "s0_bos", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 0, + "token_edit_distance": 164, + "normalized_token_similarity": 0.3643410852713178, + "source_id": "gsm8k/test/1251", + "domain": "math" + } + ], + "bos_at_s1": [ + { + "left": "s1_eos", + "right": "s1_bos", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 1, + "token_edit_distance": 301, + "normalized_token_similarity": 0.14, + "source_id": "wikitext2/raw-validation/0443", + "domain": "english" + }, + { + "left": "s1_eos", + "right": "s1_bos", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 6, + "token_edit_distance": 34, + "normalized_token_similarity": 0.6222222222222222, + "source_id": "wikitext2/raw-validation/0030", + "domain": "english" + }, + { + "left": "s1_eos", + "right": "s1_bos", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 25, + "token_edit_distance": 106, + "normalized_token_similarity": 0.5023474178403755, + "source_id": "wikitext2/raw-validation/2909", + "domain": "english" + }, + { + "left": "s1_eos", + "right": "s1_bos", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 11, + "token_edit_distance": 351, + "normalized_token_similarity": 0.18181818181818177, + "source_id": "wikitext2/raw-validation/2746", + "domain": "english" + }, + { + "left": "s1_eos", + "right": "s1_bos", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 11, + "token_edit_distance": 60, + "normalized_token_similarity": 0.368421052631579, + "source_id": "tnews/test/4855", + "domain": "chinese" + }, + { + "left": "s1_eos", + "right": "s1_bos", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 1, + "token_edit_distance": 138, + "normalized_token_similarity": 0.15337423312883436, + "source_id": "tnews/test/8935", + "domain": "chinese" + }, + { + "left": "s1_eos", + "right": "s1_bos", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 8, + "token_edit_distance": 325, + "normalized_token_similarity": 0.1192411924119241, + "source_id": "tnews/test/3448", + "domain": "chinese" + }, + { + "left": "s1_eos", + "right": "s1_bos", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 1, + "token_edit_distance": 209, + "normalized_token_similarity": 0.15384615384615385, + "source_id": "tnews/test/1059", + "domain": "chinese" + }, + { + "left": "s1_eos", + "right": "s1_bos", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 28, + "token_edit_distance": 9, + "normalized_token_similarity": 0.9720496894409938, + "source_id": "HumanEval/31", + "domain": "code" + }, + { + "left": "s1_eos", + "right": "s1_bos", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 6, + "token_edit_distance": 371, + "normalized_token_similarity": 0.275390625, + "source_id": "HumanEval/44", + "domain": "code" + }, + { + "left": "s1_eos", + "right": "s1_bos", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 16, + "token_edit_distance": 189, + "normalized_token_similarity": 0.5456730769230769, + "source_id": "HumanEval/133", + "domain": "code" + }, + { + "left": "s1_eos", + "right": "s1_bos", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 0, + "token_edit_distance": 100, + "normalized_token_similarity": 0.32885906040268453, + "source_id": "HumanEval/23", + "domain": "code" + }, + { + "left": "s1_eos", + "right": "s1_bos", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 34, + "token_edit_distance": 87, + "normalized_token_similarity": 0.5915492957746479, + "source_id": "gsm8k/test/1069", + "domain": "math" + }, + { + "left": "s1_eos", + "right": "s1_bos", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 132, + "token_edit_distance": 34, + "normalized_token_similarity": 0.8508771929824561, + "source_id": "gsm8k/test/1228", + "domain": "math" + }, + { + "left": "s1_eos", + "right": "s1_bos", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 4, + "token_edit_distance": 70, + "normalized_token_similarity": 0.6902654867256637, + "source_id": "gsm8k/test/0144", + "domain": "math" + }, + { + "left": "s1_eos", + "right": "s1_bos", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 0, + "token_edit_distance": 128, + "normalized_token_similarity": 0.36, + "source_id": "gsm8k/test/1251", + "domain": "math" + } + ], + "x_at_s0": [ + { + "left": "s0_eos", + "right": "s0_x", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 23, + "token_edit_distance": 373, + "normalized_token_similarity": 0.1943844492440605, + "source_id": "wikitext2/raw-validation/0443", + "domain": "english" + }, + { + "left": "s0_eos", + "right": "s0_x", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 37, + "token_edit_distance": 408, + "normalized_token_similarity": 0.203125, + "source_id": "wikitext2/raw-validation/0030", + "domain": "english" + }, + { + "left": "s0_eos", + "right": "s0_x", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 0, + "token_edit_distance": 432, + "normalized_token_similarity": 0.15625, + "source_id": "wikitext2/raw-validation/2909", + "domain": "english" + }, + { + "left": "s0_eos", + "right": "s0_x", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 11, + "token_edit_distance": 440, + "normalized_token_similarity": 0.140625, + "source_id": "wikitext2/raw-validation/2746", + "domain": "english" + }, + { + "left": "s0_eos", + "right": "s0_x", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 5, + "token_edit_distance": 77, + "normalized_token_similarity": 0.31858407079646023, + "source_id": "tnews/test/4855", + "domain": "chinese" + }, + { + "left": "s0_eos", + "right": "s0_x", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 31, + "token_edit_distance": 54, + "normalized_token_similarity": 0.5045871559633027, + "source_id": "tnews/test/8935", + "domain": "chinese" + }, + { + "left": "s0_eos", + "right": "s0_x", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 25, + "token_edit_distance": 117, + "normalized_token_similarity": 0.36413043478260865, + "source_id": "tnews/test/3448", + "domain": "chinese" + }, + { + "left": "s0_eos", + "right": "s0_x", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 1, + "token_edit_distance": 163, + "normalized_token_similarity": 0.2125603864734299, + "source_id": "tnews/test/1059", + "domain": "chinese" + }, + { + "left": "s0_eos", + "right": "s0_x", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 1, + "token_edit_distance": 290, + "normalized_token_similarity": 0.32400932400932403, + "source_id": "HumanEval/31", + "domain": "code" + }, + { + "left": "s0_eos", + "right": "s0_x", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 1, + "token_edit_distance": 348, + "normalized_token_similarity": 0.3203125, + "source_id": "HumanEval/44", + "domain": "code" + }, + { + "left": "s0_eos", + "right": "s0_x", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 2, + "token_edit_distance": 76, + "normalized_token_similarity": 0.8056265984654731, + "source_id": "HumanEval/133", + "domain": "code" + }, + { + "left": "s0_eos", + "right": "s0_x", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 0, + "token_edit_distance": 132, + "normalized_token_similarity": 0.2666666666666667, + "source_id": "HumanEval/23", + "domain": "code" + }, + { + "left": "s0_eos", + "right": "s0_x", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 36, + "token_edit_distance": 57, + "normalized_token_similarity": 0.7323943661971831, + "source_id": "gsm8k/test/1069", + "domain": "math" + }, + { + "left": "s0_eos", + "right": "s0_x", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 11, + "token_edit_distance": 188, + "normalized_token_similarity": 0.2713178294573644, + "source_id": "gsm8k/test/1228", + "domain": "math" + }, + { + "left": "s0_eos", + "right": "s0_x", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 17, + "token_edit_distance": 87, + "normalized_token_similarity": 0.5972222222222222, + "source_id": "gsm8k/test/0144", + "domain": "math" + }, + { + "left": "s0_eos", + "right": "s0_x", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 0, + "token_edit_distance": 154, + "normalized_token_similarity": 0.4031007751937985, + "source_id": "gsm8k/test/1251", + "domain": "math" + } + ], + "x_at_s1": [ + { + "left": "s1_eos", + "right": "s1_x", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 6, + "token_edit_distance": 250, + "normalized_token_similarity": 0.2857142857142857, + "source_id": "wikitext2/raw-validation/0443", + "domain": "english" + }, + { + "left": "s1_eos", + "right": "s1_x", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 28, + "token_edit_distance": 9, + "normalized_token_similarity": 0.8636363636363636, + "source_id": "wikitext2/raw-validation/0030", + "domain": "english" + }, + { + "left": "s1_eos", + "right": "s1_x", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 32, + "token_edit_distance": 71, + "normalized_token_similarity": 0.5, + "source_id": "wikitext2/raw-validation/2909", + "domain": "english" + }, + { + "left": "s1_eos", + "right": "s1_x", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 1, + "token_edit_distance": 245, + "normalized_token_similarity": 0.23676012461059193, + "source_id": "wikitext2/raw-validation/2746", + "domain": "english" + }, + { + "left": "s1_eos", + "right": "s1_x", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 9, + "token_edit_distance": 69, + "normalized_token_similarity": 0.27368421052631575, + "source_id": "tnews/test/4855", + "domain": "chinese" + }, + { + "left": "s1_eos", + "right": "s1_x", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 1, + "token_edit_distance": 139, + "normalized_token_similarity": 0.14723926380368102, + "source_id": "tnews/test/8935", + "domain": "chinese" + }, + { + "left": "s1_eos", + "right": "s1_x", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 7, + "token_edit_distance": 108, + "normalized_token_similarity": 0.2941176470588235, + "source_id": "tnews/test/3448", + "domain": "chinese" + }, + { + "left": "s1_eos", + "right": "s1_x", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 1, + "token_edit_distance": 212, + "normalized_token_similarity": 0.1417004048582996, + "source_id": "tnews/test/1059", + "domain": "chinese" + }, + { + "left": "s1_eos", + "right": "s1_x", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 0, + "token_edit_distance": 251, + "normalized_token_similarity": 0.22049689440993792, + "source_id": "HumanEval/31", + "domain": "code" + }, + { + "left": "s1_eos", + "right": "s1_x", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 6, + "token_edit_distance": 399, + "normalized_token_similarity": 0.220703125, + "source_id": "HumanEval/44", + "domain": "code" + }, + { + "left": "s1_eos", + "right": "s1_x", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 8, + "token_edit_distance": 170, + "normalized_token_similarity": 0.5913461538461539, + "source_id": "HumanEval/133", + "domain": "code" + }, + { + "left": "s1_eos", + "right": "s1_x", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 0, + "token_edit_distance": 46, + "normalized_token_similarity": 0.352112676056338, + "source_id": "HumanEval/23", + "domain": "code" + }, + { + "left": "s1_eos", + "right": "s1_x", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 9, + "token_edit_distance": 149, + "normalized_token_similarity": 0.3004694835680751, + "source_id": "gsm8k/test/1069", + "domain": "math" + }, + { + "left": "s1_eos", + "right": "s1_x", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 0, + "token_edit_distance": 171, + "normalized_token_similarity": 0.20465116279069773, + "source_id": "gsm8k/test/1228", + "domain": "math" + }, + { + "left": "s1_eos", + "right": "s1_x", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 0, + "token_edit_distance": 176, + "normalized_token_similarity": 0.2072072072072072, + "source_id": "gsm8k/test/0144", + "domain": "math" + }, + { + "left": "s1_eos", + "right": "s1_x", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 49, + "token_edit_distance": 104, + "normalized_token_similarity": 0.5772357723577235, + "source_id": "gsm8k/test/1251", + "domain": "math" + } + ], + "period_at_s0": [ + { + "left": "s0_eos", + "right": "s0_period", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 23, + "token_edit_distance": 366, + "normalized_token_similarity": 0.20950323974082075, + "source_id": "wikitext2/raw-validation/0443", + "domain": "english" + }, + { + "left": "s0_eos", + "right": "s0_period", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 37, + "token_edit_distance": 301, + "normalized_token_similarity": 0.2764423076923077, + "source_id": "wikitext2/raw-validation/0030", + "domain": "english" + }, + { + "left": "s0_eos", + "right": "s0_period", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 8, + "token_edit_distance": 144, + "normalized_token_similarity": 0.38983050847457623, + "source_id": "wikitext2/raw-validation/2909", + "domain": "english" + }, + { + "left": "s0_eos", + "right": "s0_period", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 11, + "token_edit_distance": 453, + "normalized_token_similarity": 0.115234375, + "source_id": "wikitext2/raw-validation/2746", + "domain": "english" + }, + { + "left": "s0_eos", + "right": "s0_period", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 21, + "token_edit_distance": 35, + "normalized_token_similarity": 0.5138888888888888, + "source_id": "tnews/test/4855", + "domain": "chinese" + }, + { + "left": "s0_eos", + "right": "s0_period", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 1, + "token_edit_distance": 229, + "normalized_token_similarity": 0.13909774436090228, + "source_id": "tnews/test/8935", + "domain": "chinese" + }, + { + "left": "s0_eos", + "right": "s0_period", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 10, + "token_edit_distance": 127, + "normalized_token_similarity": 0.16993464052287577, + "source_id": "tnews/test/3448", + "domain": "chinese" + }, + { + "left": "s0_eos", + "right": "s0_period", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 1, + "token_edit_distance": 180, + "normalized_token_similarity": 0.19999999999999996, + "source_id": "tnews/test/1059", + "domain": "chinese" + }, + { + "left": "s0_eos", + "right": "s0_period", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 1, + "token_edit_distance": 291, + "normalized_token_similarity": 0.2670025188916877, + "source_id": "HumanEval/31", + "domain": "code" + }, + { + "left": "s0_eos", + "right": "s0_period", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 1, + "token_edit_distance": 355, + "normalized_token_similarity": 0.306640625, + "source_id": "HumanEval/44", + "domain": "code" + }, + { + "left": "s0_eos", + "right": "s0_period", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 2, + "token_edit_distance": 83, + "normalized_token_similarity": 0.7877237851662404, + "source_id": "HumanEval/133", + "domain": "code" + }, + { + "left": "s0_eos", + "right": "s0_period", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 0, + "token_edit_distance": 158, + "normalized_token_similarity": 0.17277486910994766, + "source_id": "HumanEval/23", + "domain": "code" + }, + { + "left": "s0_eos", + "right": "s0_period", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 67, + "token_edit_distance": 83, + "normalized_token_similarity": 0.6103286384976525, + "source_id": "gsm8k/test/1069", + "domain": "math" + }, + { + "left": "s0_eos", + "right": "s0_period", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 132, + "token_edit_distance": 50, + "normalized_token_similarity": 0.8062015503875969, + "source_id": "gsm8k/test/1228", + "domain": "math" + }, + { + "left": "s0_eos", + "right": "s0_period", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 0, + "token_edit_distance": 196, + "normalized_token_similarity": 0.27941176470588236, + "source_id": "gsm8k/test/0144", + "domain": "math" + }, + { + "left": "s0_eos", + "right": "s0_period", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 45, + "token_edit_distance": 148, + "normalized_token_similarity": 0.4263565891472868, + "source_id": "gsm8k/test/1251", + "domain": "math" + } + ], + "period_at_s1": [ + { + "left": "s1_eos", + "right": "s1_period", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 6, + "token_edit_distance": 276, + "normalized_token_similarity": 0.2114285714285714, + "source_id": "wikitext2/raw-validation/0443", + "domain": "english" + }, + { + "left": "s1_eos", + "right": "s1_period", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 6, + "token_edit_distance": 10, + "normalized_token_similarity": 0.8591549295774648, + "source_id": "wikitext2/raw-validation/0030", + "domain": "english" + }, + { + "left": "s1_eos", + "right": "s1_period", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 0, + "token_edit_distance": 158, + "normalized_token_similarity": 0.3100436681222707, + "source_id": "wikitext2/raw-validation/2909", + "domain": "english" + }, + { + "left": "s1_eos", + "right": "s1_period", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 1, + "token_edit_distance": 241, + "normalized_token_similarity": 0.29532163742690054, + "source_id": "wikitext2/raw-validation/2746", + "domain": "english" + }, + { + "left": "s1_eos", + "right": "s1_period", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 9, + "token_edit_distance": 85, + "normalized_token_similarity": 0.27350427350427353, + "source_id": "tnews/test/4855", + "domain": "chinese" + }, + { + "left": "s1_eos", + "right": "s1_period", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 1, + "token_edit_distance": 142, + "normalized_token_similarity": 0.1288343558282209, + "source_id": "tnews/test/8935", + "domain": "chinese" + }, + { + "left": "s1_eos", + "right": "s1_period", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 7, + "token_edit_distance": 111, + "normalized_token_similarity": 0.27450980392156865, + "source_id": "tnews/test/3448", + "domain": "chinese" + }, + { + "left": "s1_eos", + "right": "s1_period", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 1, + "token_edit_distance": 209, + "normalized_token_similarity": 0.15384615384615385, + "source_id": "tnews/test/1059", + "domain": "chinese" + }, + { + "left": "s1_eos", + "right": "s1_period", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 0, + "token_edit_distance": 266, + "normalized_token_similarity": 0.17391304347826086, + "source_id": "HumanEval/31", + "domain": "code" + }, + { + "left": "s1_eos", + "right": "s1_period", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 0, + "token_edit_distance": 409, + "normalized_token_similarity": 0.201171875, + "source_id": "HumanEval/44", + "domain": "code" + }, + { + "left": "s1_eos", + "right": "s1_period", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 0, + "token_edit_distance": 373, + "normalized_token_similarity": 0.10336538461538458, + "source_id": "HumanEval/133", + "domain": "code" + }, + { + "left": "s1_eos", + "right": "s1_period", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 0, + "token_edit_distance": 49, + "normalized_token_similarity": 0.3098591549295775, + "source_id": "HumanEval/23", + "domain": "code" + }, + { + "left": "s1_eos", + "right": "s1_period", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 9, + "token_edit_distance": 110, + "normalized_token_similarity": 0.4835680751173709, + "source_id": "gsm8k/test/1069", + "domain": "math" + }, + { + "left": "s1_eos", + "right": "s1_period", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 11, + "token_edit_distance": 88, + "normalized_token_similarity": 0.6378600823045267, + "source_id": "gsm8k/test/1228", + "domain": "math" + }, + { + "left": "s1_eos", + "right": "s1_period", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 0, + "token_edit_distance": 216, + "normalized_token_similarity": 0.2551724137931034, + "source_id": "gsm8k/test/0144", + "domain": "math" + }, + { + "left": "s1_eos", + "right": "s1_period", + "token_ids_exact": false, + "text_exact": false, + "common_prefix_tokens": 8, + "token_edit_distance": 64, + "normalized_token_similarity": 0.6952380952380952, + "source_id": "gsm8k/test/1251", + "domain": "math" + } + ] + }, + "aggregates": { + "system_eos": { + "sources": 16, + "token_ids_exact": 1, + "text_exact": 1, + "mean_common_prefix_tokens": 39.1875, + "mean_token_edit_distance": 179.8125, + "mean_normalized_token_similarity": 0.4265372973500564 + }, + "system_bos": { + "sources": 16, + "token_ids_exact": 1, + "text_exact": 1, + "mean_common_prefix_tokens": 28.375, + "mean_token_edit_distance": 195.8125, + "mean_normalized_token_similarity": 0.40536869049751423 + }, + "system_x": { + "sources": 16, + "token_ids_exact": 0, + "text_exact": 0, + "mean_common_prefix_tokens": 4.875, + "mean_token_edit_distance": 225, + "mean_normalized_token_similarity": 0.2699198153054802 + }, + "system_period": { + "sources": 16, + "token_ids_exact": 0, + "text_exact": 0, + "mean_common_prefix_tokens": 4.5, + "mean_token_edit_distance": 208.6875, + "mean_normalized_token_similarity": 0.26088919122899423 + }, + "bos_at_s0": { + "sources": 16, + "token_ids_exact": 0, + "text_exact": 0, + "mean_common_prefix_tokens": 32.3125, + "mean_token_edit_distance": 181.9375, + "mean_normalized_token_similarity": 0.41762139180198626 + }, + "bos_at_s1": { + "sources": 16, + "token_ids_exact": 0, + "text_exact": 0, + "mean_common_prefix_tokens": 17.75, + "mean_token_edit_distance": 157, + "mean_normalized_token_similarity": 0.4284959300717996 + }, + "x_at_s0": { + "sources": 16, + "token_ids_exact": 0, + "text_exact": 0, + "mean_common_prefix_tokens": 12.5625, + "mean_token_edit_distance": 212.25, + "mean_normalized_token_similarity": 0.3634310487169934 + }, + "x_at_s1": { + "sources": 16, + "token_ids_exact": 0, + "text_exact": 0, + "mean_common_prefix_tokens": 9.8125, + "mean_token_edit_distance": 160.5625, + "mean_normalized_token_similarity": 0.3385671734652809 + }, + "period_at_s0": { + "sources": 16, + "token_ids_exact": 0, + "text_exact": 0, + "mean_common_prefix_tokens": 22.5, + "mean_token_edit_distance": 199.9375, + "mean_normalized_token_similarity": 0.3543982528491666 + }, + "period_at_s1": { + "sources": 16, + "token_ids_exact": 0, + "text_exact": 0, + "mean_common_prefix_tokens": 3.6875, + "mean_token_edit_distance": 175.4375, + "mean_normalized_token_similarity": 0.335424469883234 + } + }, + "aggregates_by_domain": { + "english": { + "system_eos": { + "sources": 4, + "token_ids_exact": 0, + "text_exact": 0, + "mean_common_prefix_tokens": 36.5, + "mean_token_edit_distance": 281.75, + "mean_normalized_token_similarity": 0.353517822185073 + }, + "system_bos": { + "sources": 4, + "token_ids_exact": 0, + "text_exact": 0, + "mean_common_prefix_tokens": 9.25, + "mean_token_edit_distance": 343.75, + "mean_normalized_token_similarity": 0.2071812357746006 + }, + "system_x": { + "sources": 4, + "token_ids_exact": 0, + "text_exact": 0, + "mean_common_prefix_tokens": 8.75, + "mean_token_edit_distance": 422.5, + "mean_normalized_token_similarity": 0.14915452561936937 + }, + "system_period": { + "sources": 4, + "token_ids_exact": 0, + "text_exact": 0, + "mean_common_prefix_tokens": 3.25, + "mean_token_edit_distance": 305.25, + "mean_normalized_token_similarity": 0.17275714057319702 + }, + "bos_at_s0": { + "sources": 4, + "token_ids_exact": 0, + "text_exact": 0, + "mean_common_prefix_tokens": 14, + "mean_token_edit_distance": 358, + "mean_normalized_token_similarity": 0.193575767327014 + }, + "bos_at_s1": { + "sources": 4, + "token_ids_exact": 0, + "text_exact": 0, + "mean_common_prefix_tokens": 10.75, + "mean_token_edit_distance": 198, + "mean_normalized_token_similarity": 0.3615969554701949 + }, + "x_at_s0": { + "sources": 4, + "token_ids_exact": 0, + "text_exact": 0, + "mean_common_prefix_tokens": 17.75, + "mean_token_edit_distance": 413.25, + "mean_normalized_token_similarity": 0.17359611231101513 + }, + "x_at_s1": { + "sources": 4, + "token_ids_exact": 0, + "text_exact": 0, + "mean_common_prefix_tokens": 16.75, + "mean_token_edit_distance": 143.75, + "mean_normalized_token_similarity": 0.4715276934903103 + }, + "period_at_s0": { + "sources": 4, + "token_ids_exact": 0, + "text_exact": 0, + "mean_common_prefix_tokens": 19.75, + "mean_token_edit_distance": 316, + "mean_normalized_token_similarity": 0.24775260772692617 + }, + "period_at_s1": { + "sources": 4, + "token_ids_exact": 0, + "text_exact": 0, + "mean_common_prefix_tokens": 3.25, + "mean_token_edit_distance": 171.25, + "mean_normalized_token_similarity": 0.4189872016388019 + } + }, + "chinese": { + "system_eos": { + "sources": 4, + "token_ids_exact": 0, + "text_exact": 0, + "mean_common_prefix_tokens": 17.5, + "mean_token_edit_distance": 112.75, + "mean_normalized_token_similarity": 0.29118479860089386 + }, + "system_bos": { + "sources": 4, + "token_ids_exact": 0, + "text_exact": 0, + "mean_common_prefix_tokens": 15.5, + "mean_token_edit_distance": 160.5, + "mean_normalized_token_similarity": 0.38389176383540147 + }, + "system_x": { + "sources": 4, + "token_ids_exact": 0, + "text_exact": 0, + "mean_common_prefix_tokens": 5, + "mean_token_edit_distance": 110.5, + "mean_normalized_token_similarity": 0.20547642042201258 + }, + "system_period": { + "sources": 4, + "token_ids_exact": 0, + "text_exact": 0, + "mean_common_prefix_tokens": 7.75, + "mean_token_edit_distance": 152.25, + "mean_normalized_token_similarity": 0.14959339863159143 + }, + "bos_at_s0": { + "sources": 4, + "token_ids_exact": 0, + "text_exact": 0, + "mean_common_prefix_tokens": 11, + "mean_token_edit_distance": 130, + "mean_normalized_token_similarity": 0.27875734544582365 + }, + "bos_at_s1": { + "sources": 4, + "token_ids_exact": 0, + "text_exact": 0, + "mean_common_prefix_tokens": 5.25, + "mean_token_edit_distance": 183, + "mean_normalized_token_similarity": 0.19872065800462282 + }, + "x_at_s0": { + "sources": 4, + "token_ids_exact": 0, + "text_exact": 0, + "mean_common_prefix_tokens": 15.5, + "mean_token_edit_distance": 102.75, + "mean_normalized_token_similarity": 0.3499655120039504 + }, + "x_at_s1": { + "sources": 4, + "token_ids_exact": 0, + "text_exact": 0, + "mean_common_prefix_tokens": 4.5, + "mean_token_edit_distance": 132, + "mean_normalized_token_similarity": 0.21418538156177996 + }, + "period_at_s0": { + "sources": 4, + "token_ids_exact": 0, + "text_exact": 0, + "mean_common_prefix_tokens": 8.25, + "mean_token_edit_distance": 142.75, + "mean_normalized_token_similarity": 0.25573031844316674 + }, + "period_at_s1": { + "sources": 4, + "token_ids_exact": 0, + "text_exact": 0, + "mean_common_prefix_tokens": 4.5, + "mean_token_edit_distance": 136.75, + "mean_normalized_token_similarity": 0.20767364677505423 + } + }, + "code": { + "system_eos": { + "sources": 4, + "token_ids_exact": 0, + "text_exact": 0, + "mean_common_prefix_tokens": 1.25, + "mean_token_edit_distance": 267.25, + "mean_normalized_token_similarity": 0.2990895189558046 + }, + "system_bos": { + "sources": 4, + "token_ids_exact": 0, + "text_exact": 0, + "mean_common_prefix_tokens": 10.25, + "mean_token_edit_distance": 193, + "mean_normalized_token_similarity": 0.41662178248633075 + }, + "system_x": { + "sources": 4, + "token_ids_exact": 0, + "text_exact": 0, + "mean_common_prefix_tokens": 3.5, + "mean_token_edit_distance": 234.5, + "mean_normalized_token_similarity": 0.3412715343290136 + }, + "system_period": { + "sources": 4, + "token_ids_exact": 0, + "text_exact": 0, + "mean_common_prefix_tokens": 0, + "mean_token_edit_distance": 261, + "mean_normalized_token_similarity": 0.18671652672553232 + }, + "bos_at_s0": { + "sources": 4, + "token_ids_exact": 0, + "text_exact": 0, + "mean_common_prefix_tokens": 62.75, + "mean_token_edit_distance": 135, + "mean_normalized_token_similarity": 0.6144799238840568 + }, + "bos_at_s1": { + "sources": 4, + "token_ids_exact": 0, + "text_exact": 0, + "mean_common_prefix_tokens": 12.5, + "mean_token_edit_distance": 167.25, + "mean_normalized_token_similarity": 0.5304931129416888 + }, + "x_at_s0": { + "sources": 4, + "token_ids_exact": 0, + "text_exact": 0, + "mean_common_prefix_tokens": 1, + "mean_token_edit_distance": 211.5, + "mean_normalized_token_similarity": 0.429153772285366 + }, + "x_at_s1": { + "sources": 4, + "token_ids_exact": 0, + "text_exact": 0, + "mean_common_prefix_tokens": 3.5, + "mean_token_edit_distance": 216.5, + "mean_normalized_token_similarity": 0.3461647123281074 + }, + "period_at_s0": { + "sources": 4, + "token_ids_exact": 0, + "text_exact": 0, + "mean_common_prefix_tokens": 1, + "mean_token_edit_distance": 221.75, + "mean_normalized_token_similarity": 0.38353544954196894 + }, + "period_at_s1": { + "sources": 4, + "token_ids_exact": 0, + "text_exact": 0, + "mean_common_prefix_tokens": 0, + "mean_token_edit_distance": 274.25, + "mean_normalized_token_similarity": 0.19707736450580574 + } + }, + "math": { + "system_eos": { + "sources": 4, + "token_ids_exact": 1, + "text_exact": 1, + "mean_common_prefix_tokens": 101.5, + "mean_token_edit_distance": 57.5, + "mean_normalized_token_similarity": 0.7623570496584542 + }, + "system_bos": { + "sources": 4, + "token_ids_exact": 1, + "text_exact": 1, + "mean_common_prefix_tokens": 78.5, + "mean_token_edit_distance": 86, + "mean_normalized_token_similarity": 0.613779979893724 + }, + "system_x": { + "sources": 4, + "token_ids_exact": 0, + "text_exact": 0, + "mean_common_prefix_tokens": 2.25, + "mean_token_edit_distance": 132.5, + "mean_normalized_token_similarity": 0.38377678085152533 + }, + "system_period": { + "sources": 4, + "token_ids_exact": 0, + "text_exact": 0, + "mean_common_prefix_tokens": 7, + "mean_token_edit_distance": 116.25, + "mean_normalized_token_similarity": 0.5344896989856562 + }, + "bos_at_s0": { + "sources": 4, + "token_ids_exact": 0, + "text_exact": 0, + "mean_common_prefix_tokens": 41.5, + "mean_token_edit_distance": 104.75, + "mean_normalized_token_similarity": 0.5836725305510506 + }, + "bos_at_s1": { + "sources": 4, + "token_ids_exact": 0, + "text_exact": 0, + "mean_common_prefix_tokens": 42.5, + "mean_token_edit_distance": 79.75, + "mean_normalized_token_similarity": 0.6231729938706919 + }, + "x_at_s0": { + "sources": 4, + "token_ids_exact": 0, + "text_exact": 0, + "mean_common_prefix_tokens": 16, + "mean_token_edit_distance": 121.5, + "mean_normalized_token_similarity": 0.5010087982676421 + }, + "x_at_s1": { + "sources": 4, + "token_ids_exact": 0, + "text_exact": 0, + "mean_common_prefix_tokens": 14.5, + "mean_token_edit_distance": 150, + "mean_normalized_token_similarity": 0.3223909064809259 + }, + "period_at_s0": { + "sources": 4, + "token_ids_exact": 0, + "text_exact": 0, + "mean_common_prefix_tokens": 61, + "mean_token_edit_distance": 119.25, + "mean_normalized_token_similarity": 0.5305746356846046 + }, + "period_at_s1": { + "sources": 4, + "token_ids_exact": 0, + "text_exact": 0, + "mean_common_prefix_tokens": 7, + "mean_token_edit_distance": 119.5, + "mean_normalized_token_similarity": 0.5179596666132741 + } + } + }, + "output_by_condition": { + "s0_eos": { + "sources": 16, + "hit_eos": 15, + "stopped_at_max_new_tokens": 1, + "mean_generated_tokens": 278 + }, + "s1_eos": { + "sources": 16, + "hit_eos": 15, + "stopped_at_max_new_tokens": 1, + "mean_generated_tokens": 229.5625 + }, + "s0_bos": { + "sources": 16, + "hit_eos": 15, + "stopped_at_max_new_tokens": 1, + "mean_generated_tokens": 272.5625 + }, + "s1_bos": { + "sources": 16, + "hit_eos": 16, + "stopped_at_max_new_tokens": 0, + "mean_generated_tokens": 232.5625 + }, + "s0_x": { + "sources": 16, + "hit_eos": 13, + "stopped_at_max_new_tokens": 3, + "mean_generated_tokens": 294.375 + }, + "s1_x": { + "sources": 16, + "hit_eos": 16, + "stopped_at_max_new_tokens": 0, + "mean_generated_tokens": 177.3125 + }, + "s0_period": { + "sources": 16, + "hit_eos": 15, + "stopped_at_max_new_tokens": 1, + "mean_generated_tokens": 270.875 + }, + "s1_period": { + "sources": 16, + "hit_eos": 16, + "stopped_at_max_new_tokens": 0, + "mean_generated_tokens": 158.3125 + } + }, + "task_by_condition": { + "s0_eos": { + "math_numeric_exact": 3, + "math_sources": 4, + "code_ast_parse": 4, + "code_sources": 4 + }, + "s1_eos": { + "math_numeric_exact": 3, + "math_sources": 4, + "code_ast_parse": 3, + "code_sources": 4 + }, + "s0_bos": { + "math_numeric_exact": 3, + "math_sources": 4, + "code_ast_parse": 4, + "code_sources": 4 + }, + "s1_bos": { + "math_numeric_exact": 3, + "math_sources": 4, + "code_ast_parse": 4, + "code_sources": 4 + }, + "s0_x": { + "math_numeric_exact": 2, + "math_sources": 4, + "code_ast_parse": 4, + "code_sources": 4 + }, + "s1_x": { + "math_numeric_exact": 3, + "math_sources": 4, + "code_ast_parse": 4, + "code_sources": 4 + }, + "s0_period": { + "math_numeric_exact": 3, + "math_sources": 4, + "code_ast_parse": 4, + "code_sources": 4 + }, + "s1_period": { + "math_numeric_exact": 4, + "math_sources": 4, + "code_ast_parse": 4, + "code_sources": 4 + } + } + }, + "claim_boundary": [ + "This is a small deterministic behavior probe, not a benchmark.", + "Counterfactual BOS/x/period token sequences are not official-valid chats.", + "Math checks only final numeric text; code is parsed but never executed.", + "Greedy output identity does not establish sampling-distribution robustness.", + "The local 32GB GPU requires CPU offload; this is not single-GPU BF16 execution.", + "Base-routing evidence and Chat-generation behavior remain different evidence layers." + ] +} diff --git a/src/data/deepseek-v2-lite-chat-completion-depth-compact.json b/src/data/deepseek-v2-lite-chat-completion-depth-compact.json new file mode 100644 index 0000000..40f79d3 --- /dev/null +++ b/src/data/deepseek-v2-lite-chat-completion-depth-compact.json @@ -0,0 +1,28492 @@ +{ + "schemaVersion": 1, + "artifacts": { + "baseline": { + "bytes": 542559, + "sha256": "54496955d0dd20a3116e6b758a55f56e2444c43dd99bfef94a2cb7b140e6196e" + }, + "completion": { + "bytes": 871946, + "sha256": "6af40512c5868caab0ef58356aaa7728384f2b7acc7c502aa89478fdf5a2a468" + }, + "completionEval": { + "bytes": 138837, + "sha256": "73f4616359d664377405dd989ee15cbf18e540e2f7b916b0ff99a99143091427" + }, + "completionRepro": { + "bytes": 233300, + "sha256": "6c89f85ae783de5dfbe71694ba23307e79ca04f9522dd8684aef8f6f5295424d" + }, + "depth": { + "bytes": 36019346, + "sha256": "5678ed238f13e3b0d5cf7a3db2268dbddf13f047cdc3730771ba1c66d96426e8" + }, + "depthRepro": { + "bytes": 9166628, + "sha256": "17c367cccce3698df6fa8a0c0455d2b0e52cd27e1f66717a66989a586dfd1098" + } + }, + "model": { + "repo": "deepseek-ai/DeepSeek-V2-Lite-Chat", + "revision": "85864749cd611b4353ce1decdb286193298f64c7", + "checkpointIdentity": "SFT Chat", + "architecture": "DeepseekV2ForCausalLM", + "dtype": "bfloat16" + }, + "contract": { + "conditions": [ + "s0_eos", + "s1_eos", + "s0_bos", + "s1_bos", + "s0_x", + "s1_x", + "s0_period", + "s1_period" + ], + "conditionFactors": { + "s0_eos": { + "system": 0, + "history": "filler", + "boundary": "eos", + "token_class": "special" + }, + "s1_eos": { + "system": 1, + "history": "filler", + "boundary": "eos", + "token_class": "special" + }, + "s0_bos": { + "system": 0, + "history": "filler", + "boundary": "bos", + "token_class": "special" + }, + "s1_bos": { + "system": 1, + "history": "filler", + "boundary": "bos", + "token_class": "special" + }, + "s0_x": { + "system": 0, + "history": "filler", + "boundary": "x", + "token_class": "ordinary_control" + }, + "s1_x": { + "system": 1, + "history": "filler", + "boundary": "x", + "token_class": "ordinary_control" + }, + "s0_period": { + "system": 0, + "history": "filler", + "boundary": "period", + "token_class": "ordinary_control" + }, + "s1_period": { + "system": 1, + "history": "filler", + "boundary": "period", + "token_class": "ordinary_control" + } + }, + "edgeOrder": [ + "system_eos", + "system_bos", + "system_x", + "system_period", + "bos_at_s0", + "bos_at_s1", + "x_at_s0", + "x_at_s1", + "period_at_s0", + "period_at_s1" + ], + "edgePairs": { + "system_eos": [ + "s0_eos", + "s1_eos" + ], + "system_bos": [ + "s0_bos", + "s1_bos" + ], + "system_x": [ + "s0_x", + "s1_x" + ], + "system_period": [ + "s0_period", + "s1_period" + ], + "bos_at_s0": [ + "s0_eos", + "s0_bos" + ], + "bos_at_s1": [ + "s1_eos", + "s1_bos" + ], + "x_at_s0": [ + "s0_eos", + "s0_x" + ], + "x_at_s1": [ + "s1_eos", + "s1_x" + ], + "period_at_s0": [ + "s0_eos", + "s0_period" + ], + "period_at_s1": [ + "s1_eos", + "s1_period" + ] + }, + "edgeLabels": { + "system_eos": "System on − off · EOS", + "system_bos": "System on − off · BOS", + "system_x": "System on − off · x", + "system_period": "System on − off · 句点", + "bos_at_s0": "BOS − EOS · system off", + "bos_at_s1": "BOS − EOS · system on", + "x_at_s0": "x − EOS · system off", + "x_at_s1": "x − EOS · system on", + "period_at_s0": "句点 − EOS · system off", + "period_at_s1": "句点 − EOS · system on" + }, + "domains": [ + "all", + "english", + "chinese", + "code", + "math" + ], + "targetScope": "byte-identical interior content tokens; tokens whose offset crosses the content boundary are excluded", + "decode": "greedy", + "maxNewTokens": 512, + "useCacheGeneration": true, + "useCacheTrace": false + }, + "completion": { + "budgetLadder": [ + { + "maxNewTokens": 128, + "naturalEos": 31, + "truncated": 97, + "outputs": 128 + }, + { + "maxNewTokens": 512, + "naturalEos": 121, + "truncated": 7, + "outputs": 128 + } + ], + "summary": { + "outputs": 128, + "natural_eos": 121, + "budget_truncated": 7, + "completion_classes": { + "NATURAL_EOS": 121, + "BUDGET_TRUNCATED_UNRESOLVED": 7 + }, + "baseline_prefix": { + "cells": 128, + "prompt_hash_exact": 128, + "generated_prefix_exact": 128 + }, + "by_condition": { + "s0_bos": { + "outputs": 16, + "natural_eos": 15, + "budget_truncated": 1, + "mean_generated_tokens": 272.5625, + "completion_classes": { + "BUDGET_TRUNCATED_UNRESOLVED": 1, + "NATURAL_EOS": 15 + }, + "math_fixed_budget_exact": 3, + "math_strict_complete_exact": 3, + "math_sources": 4, + "code_ast_parse": 4, + "code_executed": 4, + "code_tests_pass": 4, + "code_sources": 4 + }, + "s0_eos": { + "outputs": 16, + "natural_eos": 15, + "budget_truncated": 1, + "mean_generated_tokens": 278, + "completion_classes": { + "NATURAL_EOS": 15, + "BUDGET_TRUNCATED_UNRESOLVED": 1 + }, + "math_fixed_budget_exact": 3, + "math_strict_complete_exact": 3, + "math_sources": 4, + "code_ast_parse": 4, + "code_executed": 4, + "code_tests_pass": 3, + "code_sources": 4 + }, + "s0_period": { + "outputs": 16, + "natural_eos": 15, + "budget_truncated": 1, + "mean_generated_tokens": 270.875, + "completion_classes": { + "NATURAL_EOS": 15, + "BUDGET_TRUNCATED_UNRESOLVED": 1 + }, + "math_fixed_budget_exact": 3, + "math_strict_complete_exact": 3, + "math_sources": 4, + "code_ast_parse": 4, + "code_executed": 4, + "code_tests_pass": 3, + "code_sources": 4 + }, + "s0_x": { + "outputs": 16, + "natural_eos": 13, + "budget_truncated": 3, + "mean_generated_tokens": 294.375, + "completion_classes": { + "NATURAL_EOS": 13, + "BUDGET_TRUNCATED_UNRESOLVED": 3 + }, + "math_fixed_budget_exact": 2, + "math_strict_complete_exact": 2, + "math_sources": 4, + "code_ast_parse": 4, + "code_executed": 4, + "code_tests_pass": 3, + "code_sources": 4 + }, + "s1_bos": { + "outputs": 16, + "natural_eos": 16, + "budget_truncated": 0, + "mean_generated_tokens": 232.5625, + "completion_classes": { + "NATURAL_EOS": 16 + }, + "math_fixed_budget_exact": 3, + "math_strict_complete_exact": 3, + "math_sources": 4, + "code_ast_parse": 4, + "code_executed": 4, + "code_tests_pass": 4, + "code_sources": 4 + }, + "s1_eos": { + "outputs": 16, + "natural_eos": 15, + "budget_truncated": 1, + "mean_generated_tokens": 229.5625, + "completion_classes": { + "NATURAL_EOS": 15, + "BUDGET_TRUNCATED_UNRESOLVED": 1 + }, + "math_fixed_budget_exact": 3, + "math_strict_complete_exact": 3, + "math_sources": 4, + "code_ast_parse": 3, + "code_executed": 3, + "code_tests_pass": 2, + "code_sources": 4 + }, + "s1_period": { + "outputs": 16, + "natural_eos": 16, + "budget_truncated": 0, + "mean_generated_tokens": 158.3125, + "completion_classes": { + "NATURAL_EOS": 16 + }, + "math_fixed_budget_exact": 3, + "math_strict_complete_exact": 3, + "math_sources": 4, + "code_ast_parse": 4, + "code_executed": 4, + "code_tests_pass": 3, + "code_sources": 4 + }, + "s1_x": { + "outputs": 16, + "natural_eos": 16, + "budget_truncated": 0, + "mean_generated_tokens": 177.3125, + "completion_classes": { + "NATURAL_EOS": 16 + }, + "math_fixed_budget_exact": 3, + "math_strict_complete_exact": 3, + "math_sources": 4, + "code_ast_parse": 4, + "code_executed": 4, + "code_tests_pass": 2, + "code_sources": 4 + } + } + }, + "incompleteRows": [ + { + "sourceId": "wikitext2/raw-validation/0443", + "domain": "english", + "condition": "s0_bos", + "generatedTokens": 512, + "hitEos": false, + "completionClass": "BUDGET_TRUNCATED_UNRESOLVED", + "taskEvaluation": null + }, + { + "sourceId": "wikitext2/raw-validation/0030", + "domain": "english", + "condition": "s0_x", + "generatedTokens": 512, + "hitEos": false, + "completionClass": "BUDGET_TRUNCATED_UNRESOLVED", + "taskEvaluation": null + }, + { + "sourceId": "wikitext2/raw-validation/2909", + "domain": "english", + "condition": "s0_x", + "generatedTokens": 512, + "hitEos": false, + "completionClass": "BUDGET_TRUNCATED_UNRESOLVED", + "taskEvaluation": null + }, + { + "sourceId": "wikitext2/raw-validation/2746", + "domain": "english", + "condition": "s0_eos", + "generatedTokens": 512, + "hitEos": false, + "completionClass": "BUDGET_TRUNCATED_UNRESOLVED", + "taskEvaluation": null + }, + { + "sourceId": "wikitext2/raw-validation/2746", + "domain": "english", + "condition": "s0_x", + "generatedTokens": 512, + "hitEos": false, + "completionClass": "BUDGET_TRUNCATED_UNRESOLVED", + "taskEvaluation": null + }, + { + "sourceId": "wikitext2/raw-validation/2746", + "domain": "english", + "condition": "s0_period", + "generatedTokens": 512, + "hitEos": false, + "completionClass": "BUDGET_TRUNCATED_UNRESOLVED", + "taskEvaluation": null + }, + { + "sourceId": "HumanEval/44", + "domain": "code", + "condition": "s1_eos", + "generatedTokens": 512, + "hitEos": false, + "completionClass": "BUDGET_TRUNCATED_UNRESOLVED", + "taskEvaluation": { + "candidate_sha256": "5479975e8b92c1f8a63012932817fd2cb2bb9c0b8a66f11625d070ae8ac4aebf", + "extraction_mode": "fenced", + "contains_entry_point_definition": true, + "closed_code_fence": false, + "python_ast_parse": false, + "parse_error": { + "line": 26, + "offset": 18, + "type": "SyntaxError" + }, + "semantic_terminal": false, + "evaluator_covered": false, + "execution": { + "status": "not_run", + "return_code": null, + "runtime_ms": null, + "harness_sha256": null + }, + "fixed_budget_tests_pass": false, + "strict_complete_tests_pass": false + } + } + ], + "taskRows": [ + { + "sourceId": "HumanEval/31", + "domain": "code", + "condition": "s0_eos", + "generatedTokens": 397, + "hitEos": true, + "completionClass": "NATURAL_EOS", + "taskEvaluation": { + "candidate_sha256": "af9f7acecc15979fd07061448278bf3ebe4b8e865597307302c7b07d50711f44", + "extraction_mode": "fenced", + "contains_entry_point_definition": true, + "closed_code_fence": true, + "python_ast_parse": true, + "parse_error": null, + "semantic_terminal": true, + "evaluator_covered": true, + "execution": { + "status": "passed", + "return_code": 0, + "runtime_ms": 364.7789540118538, + "harness_sha256": "cad7d81e40d6a4afddc7951f7ec580342e4ccb52230b48f85feb73eb1c0b3d27" + }, + "fixed_budget_tests_pass": true, + "strict_complete_tests_pass": true + } + }, + { + "sourceId": "HumanEval/31", + "domain": "code", + "condition": "s1_eos", + "generatedTokens": 322, + "hitEos": true, + "completionClass": "NATURAL_EOS", + "taskEvaluation": { + "candidate_sha256": "08063a9ae2f1615cd3d3379aefff53aa8f08a3bbcf19c6092ebc44cc461915b8", + "extraction_mode": "fenced", + "contains_entry_point_definition": true, + "closed_code_fence": true, + "python_ast_parse": true, + "parse_error": null, + "semantic_terminal": true, + "evaluator_covered": true, + "execution": { + "status": "passed", + "return_code": 0, + "runtime_ms": 314.3631999846548, + "harness_sha256": "32e3d841119f5a063e0d2d5ed86cec9eafc1df6d9926a622ff04a8d56dbf20a1" + }, + "fixed_budget_tests_pass": true, + "strict_complete_tests_pass": true + } + }, + { + "sourceId": "HumanEval/31", + "domain": "code", + "condition": "s0_bos", + "generatedTokens": 412, + "hitEos": true, + "completionClass": "NATURAL_EOS", + "taskEvaluation": { + "candidate_sha256": "af9f7acecc15979fd07061448278bf3ebe4b8e865597307302c7b07d50711f44", + "extraction_mode": "fenced", + "contains_entry_point_definition": true, + "closed_code_fence": true, + "python_ast_parse": true, + "parse_error": null, + "semantic_terminal": true, + "evaluator_covered": true, + "execution": { + "status": "passed", + "return_code": 0, + "runtime_ms": 314.4568419957068, + "harness_sha256": "cad7d81e40d6a4afddc7951f7ec580342e4ccb52230b48f85feb73eb1c0b3d27" + }, + "fixed_budget_tests_pass": true, + "strict_complete_tests_pass": true + } + }, + { + "sourceId": "HumanEval/31", + "domain": "code", + "condition": "s1_bos", + "generatedTokens": 320, + "hitEos": true, + "completionClass": "NATURAL_EOS", + "taskEvaluation": { + "candidate_sha256": "08063a9ae2f1615cd3d3379aefff53aa8f08a3bbcf19c6092ebc44cc461915b8", + "extraction_mode": "fenced", + "contains_entry_point_definition": true, + "closed_code_fence": true, + "python_ast_parse": true, + "parse_error": null, + "semantic_terminal": true, + "evaluator_covered": true, + "execution": { + "status": "passed", + "return_code": 0, + "runtime_ms": 314.4663749844767, + "harness_sha256": "32e3d841119f5a063e0d2d5ed86cec9eafc1df6d9926a622ff04a8d56dbf20a1" + }, + "fixed_budget_tests_pass": true, + "strict_complete_tests_pass": true + } + }, + { + "sourceId": "HumanEval/31", + "domain": "code", + "condition": "s0_x", + "generatedTokens": 429, + "hitEos": true, + "completionClass": "NATURAL_EOS", + "taskEvaluation": { + "candidate_sha256": "122b3a6829e529fa11072d2109aeffa728fd53573b3abcdb94dd23259c740f93", + "extraction_mode": "fenced", + "contains_entry_point_definition": true, + "closed_code_fence": true, + "python_ast_parse": true, + "parse_error": null, + "semantic_terminal": true, + "evaluator_covered": true, + "execution": { + "status": "passed", + "return_code": 0, + "runtime_ms": 314.73573099356145, + "harness_sha256": "dd6e1ba85655799f4e2793e729b73fd8c3f032d5f8d41791c8868568b57224ab" + }, + "fixed_budget_tests_pass": true, + "strict_complete_tests_pass": true + } + }, + { + "sourceId": "HumanEval/31", + "domain": "code", + "condition": "s1_x", + "generatedTokens": 216, + "hitEos": true, + "completionClass": "NATURAL_EOS", + "taskEvaluation": { + "candidate_sha256": "25c4489e64cd3cc1936373f2344f7c799b3f7664db669c63640d8cfc1833e843", + "extraction_mode": "fenced", + "contains_entry_point_definition": true, + "closed_code_fence": true, + "python_ast_parse": true, + "parse_error": null, + "semantic_terminal": true, + "evaluator_covered": true, + "execution": { + "status": "passed", + "return_code": 0, + "runtime_ms": 314.4173300242983, + "harness_sha256": "569042a5117094e33fd0e99c53a5979a16def6adb1b892dc48b1f19c56f771ed" + }, + "fixed_budget_tests_pass": true, + "strict_complete_tests_pass": true + } + }, + { + "sourceId": "HumanEval/31", + "domain": "code", + "condition": "s0_period", + "generatedTokens": 355, + "hitEos": true, + "completionClass": "NATURAL_EOS", + "taskEvaluation": { + "candidate_sha256": "122b3a6829e529fa11072d2109aeffa728fd53573b3abcdb94dd23259c740f93", + "extraction_mode": "fenced", + "contains_entry_point_definition": true, + "closed_code_fence": true, + "python_ast_parse": true, + "parse_error": null, + "semantic_terminal": true, + "evaluator_covered": true, + "execution": { + "status": "passed", + "return_code": 0, + "runtime_ms": 314.49275999329984, + "harness_sha256": "dd6e1ba85655799f4e2793e729b73fd8c3f032d5f8d41791c8868568b57224ab" + }, + "fixed_budget_tests_pass": true, + "strict_complete_tests_pass": true + } + }, + { + "sourceId": "HumanEval/31", + "domain": "code", + "condition": "s1_period", + "generatedTokens": 59, + "hitEos": true, + "completionClass": "NATURAL_EOS", + "taskEvaluation": { + "candidate_sha256": "28f166261950fa956e299a50872f539d490af163c1b0fb6d316d346fd7644685", + "extraction_mode": "direct_definition", + "contains_entry_point_definition": true, + "closed_code_fence": false, + "python_ast_parse": true, + "parse_error": null, + "semantic_terminal": true, + "evaluator_covered": true, + "execution": { + "status": "passed", + "return_code": 0, + "runtime_ms": 314.4734380184673, + "harness_sha256": "c3402f42179ae84b6c6382d262fe7a6cd646472dae79c24c2f0e2e79afe01d49" + }, + "fixed_budget_tests_pass": true, + "strict_complete_tests_pass": true + } + }, + { + "sourceId": "HumanEval/44", + "domain": "code", + "condition": "s0_eos", + "generatedTokens": 512, + "hitEos": true, + "completionClass": "NATURAL_EOS", + "taskEvaluation": { + "candidate_sha256": "dc070836ec6f006332215bf0b91ee2e87eb4bad0c1addae16af8e90cac647502", + "extraction_mode": "fenced", + "contains_entry_point_definition": true, + "closed_code_fence": true, + "python_ast_parse": true, + "parse_error": null, + "semantic_terminal": true, + "evaluator_covered": true, + "execution": { + "status": "assertion_failed", + "return_code": 10, + "runtime_ms": 314.38884101225995, + "harness_sha256": "23ba7d00d20ad960abe277ccd0ce5a88182a67bef06246eabf9982041deb09d4" + }, + "fixed_budget_tests_pass": false, + "strict_complete_tests_pass": false + } + }, + { + "sourceId": "HumanEval/44", + "domain": "code", + "condition": "s1_eos", + "generatedTokens": 512, + "hitEos": false, + "completionClass": "BUDGET_TRUNCATED_UNRESOLVED", + "taskEvaluation": { + "candidate_sha256": "5479975e8b92c1f8a63012932817fd2cb2bb9c0b8a66f11625d070ae8ac4aebf", + "extraction_mode": "fenced", + "contains_entry_point_definition": true, + "closed_code_fence": false, + "python_ast_parse": false, + "parse_error": { + "line": 26, + "offset": 18, + "type": "SyntaxError" + }, + "semantic_terminal": false, + "evaluator_covered": false, + "execution": { + "status": "not_run", + "return_code": null, + "runtime_ms": null, + "harness_sha256": null + }, + "fixed_budget_tests_pass": false, + "strict_complete_tests_pass": false + } + }, + { + "sourceId": "HumanEval/44", + "domain": "code", + "condition": "s0_bos", + "generatedTokens": 331, + "hitEos": true, + "completionClass": "NATURAL_EOS", + "taskEvaluation": { + "candidate_sha256": "dcd020b020569fb69a8acf381a6fec51a2d468871005f54f883c2aefb4b43880", + "extraction_mode": "fenced", + "contains_entry_point_definition": true, + "closed_code_fence": true, + "python_ast_parse": true, + "parse_error": null, + "semantic_terminal": true, + "evaluator_covered": true, + "execution": { + "status": "passed", + "return_code": 0, + "runtime_ms": 314.43385398597457, + "harness_sha256": "990307c9f8412878a71634f44ae97ca78c6a768c0a4aa7fedc2807eadb8d4165" + }, + "fixed_budget_tests_pass": true, + "strict_complete_tests_pass": true + } + }, + { + "sourceId": "HumanEval/44", + "domain": "code", + "condition": "s1_bos", + "generatedTokens": 408, + "hitEos": true, + "completionClass": "NATURAL_EOS", + "taskEvaluation": { + "candidate_sha256": "c19ed20142ba780b3ea83ecafce9521832613a119a6920e64ec53f7ef20636e1", + "extraction_mode": "fenced", + "contains_entry_point_definition": true, + "closed_code_fence": true, + "python_ast_parse": true, + "parse_error": null, + "semantic_terminal": true, + "evaluator_covered": true, + "execution": { + "status": "passed", + "return_code": 0, + "runtime_ms": 364.66425299295224, + "harness_sha256": "a24856466ecae0c571185ca35329d960b432519112c71f1e99ee608c2a1d7b7f" + }, + "fixed_budget_tests_pass": true, + "strict_complete_tests_pass": true + } + }, + { + "sourceId": "HumanEval/44", + "domain": "code", + "condition": "s0_x", + "generatedTokens": 351, + "hitEos": true, + "completionClass": "NATURAL_EOS", + "taskEvaluation": { + "candidate_sha256": "cd92908e60a99feb5c22bd8f4b2790f6f019272e2d0697f90e02ba9b9d8dbfe6", + "extraction_mode": "fenced", + "contains_entry_point_definition": true, + "closed_code_fence": true, + "python_ast_parse": true, + "parse_error": null, + "semantic_terminal": true, + "evaluator_covered": true, + "execution": { + "status": "runtime_error", + "return_code": 11, + "runtime_ms": 314.5527970045805, + "harness_sha256": "c69b021bcdea7dda4ca041d95513843acf6a2150301ee8155f04df9bcf3b16d9" + }, + "fixed_budget_tests_pass": false, + "strict_complete_tests_pass": false + } + }, + { + "sourceId": "HumanEval/44", + "domain": "code", + "condition": "s1_x", + "generatedTokens": 456, + "hitEos": true, + "completionClass": "NATURAL_EOS", + "taskEvaluation": { + "candidate_sha256": "c4f9301b787b076744851b04f39c216fc321fba92dc96783e9a257803ba755c8", + "extraction_mode": "fenced", + "contains_entry_point_definition": true, + "closed_code_fence": true, + "python_ast_parse": true, + "parse_error": null, + "semantic_terminal": true, + "evaluator_covered": true, + "execution": { + "status": "assertion_failed", + "return_code": 10, + "runtime_ms": 364.60569500923157, + "harness_sha256": "c55ea4f3a4d566f64aed9956a1bcad07fb9d1da70ff797a65ce82daaa390bacb" + }, + "fixed_budget_tests_pass": false, + "strict_complete_tests_pass": false + } + }, + { + "sourceId": "HumanEval/44", + "domain": "code", + "condition": "s0_period", + "generatedTokens": 363, + "hitEos": true, + "completionClass": "NATURAL_EOS", + "taskEvaluation": { + "candidate_sha256": "cba9c698349b69f75d2ada5e2b47a36dfd07fb13152c1d4a0183b3db321ea1f3", + "extraction_mode": "fenced", + "contains_entry_point_definition": true, + "closed_code_fence": true, + "python_ast_parse": true, + "parse_error": null, + "semantic_terminal": true, + "evaluator_covered": true, + "execution": { + "status": "runtime_error", + "return_code": 11, + "runtime_ms": 314.7800369770266, + "harness_sha256": "37901be215c128cad275087194785cf32ee477e8af5f1bce5d856f247f8ce5e5" + }, + "fixed_budget_tests_pass": false, + "strict_complete_tests_pass": false + } + }, + { + "sourceId": "HumanEval/44", + "domain": "code", + "condition": "s1_period", + "generatedTokens": 162, + "hitEos": true, + "completionClass": "NATURAL_EOS", + "taskEvaluation": { + "candidate_sha256": "8fcd50f214cb73f5396f66780d535a14b9097e95bbaa75656faa3528df34a7d3", + "extraction_mode": "direct_definition", + "contains_entry_point_definition": true, + "closed_code_fence": false, + "python_ast_parse": true, + "parse_error": null, + "semantic_terminal": true, + "evaluator_covered": true, + "execution": { + "status": "passed", + "return_code": 0, + "runtime_ms": 314.39152397797443, + "harness_sha256": "31a8143131621fcedad61d6972b336d771c003be7f2fcafdf8cf056e254af50b" + }, + "fixed_budget_tests_pass": true, + "strict_complete_tests_pass": true + } + }, + { + "sourceId": "HumanEval/133", + "domain": "code", + "condition": "s0_eos", + "generatedTokens": 391, + "hitEos": true, + "completionClass": "NATURAL_EOS", + "taskEvaluation": { + "candidate_sha256": "063c560631d9f3a0c1c2dda3ac8a138961b7049c3b5234ab042357c01185672d", + "extraction_mode": "fenced", + "contains_entry_point_definition": true, + "closed_code_fence": true, + "python_ast_parse": true, + "parse_error": null, + "semantic_terminal": true, + "evaluator_covered": true, + "execution": { + "status": "passed", + "return_code": 0, + "runtime_ms": 314.50751298689283, + "harness_sha256": "38fbf7139d8ff026985f0322065866f77fdcb46e3e883d4d880cfecb25282c38" + }, + "fixed_budget_tests_pass": true, + "strict_complete_tests_pass": true + } + }, + { + "sourceId": "HumanEval/133", + "domain": "code", + "condition": "s1_eos", + "generatedTokens": 416, + "hitEos": true, + "completionClass": "NATURAL_EOS", + "taskEvaluation": { + "candidate_sha256": "43181722452490fe6bfa0addba5498d854915ccbe6d88d45c98438fc26345407", + "extraction_mode": "fenced", + "contains_entry_point_definition": true, + "closed_code_fence": true, + "python_ast_parse": true, + "parse_error": null, + "semantic_terminal": true, + "evaluator_covered": true, + "execution": { + "status": "assertion_failed", + "return_code": 10, + "runtime_ms": 314.23531801556237, + "harness_sha256": "fd16610a3fa2849d01e52ad01a059fbfa5278682acd761d8d2a4515b2db639dc" + }, + "fixed_budget_tests_pass": false, + "strict_complete_tests_pass": false + } + }, + { + "sourceId": "HumanEval/133", + "domain": "code", + "condition": "s0_bos", + "generatedTokens": 361, + "hitEos": true, + "completionClass": "NATURAL_EOS", + "taskEvaluation": { + "candidate_sha256": "19855a3603cdbc2102fee4850d03e96ae4bdb7c54245ce222e33fd7454dc0c47", + "extraction_mode": "fenced", + "contains_entry_point_definition": true, + "closed_code_fence": true, + "python_ast_parse": true, + "parse_error": null, + "semantic_terminal": true, + "evaluator_covered": true, + "execution": { + "status": "passed", + "return_code": 0, + "runtime_ms": 314.48952498612925, + "harness_sha256": "945365d23121de01d747be6323dfc2636e5ef59ee1d7fafd64acaf260e8290d4" + }, + "fixed_budget_tests_pass": true, + "strict_complete_tests_pass": true + } + }, + { + "sourceId": "HumanEval/133", + "domain": "code", + "condition": "s1_bos", + "generatedTokens": 329, + "hitEos": true, + "completionClass": "NATURAL_EOS", + "taskEvaluation": { + "candidate_sha256": "2330b87cb12c52fe0bd0087d0a37d45af8caec132677cc4a0c15321cdc60409d", + "extraction_mode": "fenced", + "contains_entry_point_definition": true, + "closed_code_fence": true, + "python_ast_parse": true, + "parse_error": null, + "semantic_terminal": true, + "evaluator_covered": true, + "execution": { + "status": "passed", + "return_code": 0, + "runtime_ms": 314.2013059987221, + "harness_sha256": "361f7491047e4602f19053308dc490f39255f8c79d991e2562565c46efad3332" + }, + "fixed_budget_tests_pass": true, + "strict_complete_tests_pass": true + } + }, + { + "sourceId": "HumanEval/133", + "domain": "code", + "condition": "s0_x", + "generatedTokens": 361, + "hitEos": true, + "completionClass": "NATURAL_EOS", + "taskEvaluation": { + "candidate_sha256": "19855a3603cdbc2102fee4850d03e96ae4bdb7c54245ce222e33fd7454dc0c47", + "extraction_mode": "fenced", + "contains_entry_point_definition": true, + "closed_code_fence": true, + "python_ast_parse": true, + "parse_error": null, + "semantic_terminal": true, + "evaluator_covered": true, + "execution": { + "status": "passed", + "return_code": 0, + "runtime_ms": 314.33891199412756, + "harness_sha256": "945365d23121de01d747be6323dfc2636e5ef59ee1d7fafd64acaf260e8290d4" + }, + "fixed_budget_tests_pass": true, + "strict_complete_tests_pass": true + } + }, + { + "sourceId": "HumanEval/133", + "domain": "code", + "condition": "s1_x", + "generatedTokens": 342, + "hitEos": true, + "completionClass": "NATURAL_EOS", + "taskEvaluation": { + "candidate_sha256": "6f3f83e9dde59ce9c0e53e46daac16f280cb778f391fe050c60bb98d3a20d33b", + "extraction_mode": "fenced", + "contains_entry_point_definition": true, + "closed_code_fence": true, + "python_ast_parse": true, + "parse_error": null, + "semantic_terminal": true, + "evaluator_covered": true, + "execution": { + "status": "assertion_failed", + "return_code": 10, + "runtime_ms": 314.2733109998517, + "harness_sha256": "12506957684c37b4b79afbecfe8fa6842b7382eddd709f314d394bc074925847" + }, + "fixed_budget_tests_pass": false, + "strict_complete_tests_pass": false + } + }, + { + "sourceId": "HumanEval/133", + "domain": "code", + "condition": "s0_period", + "generatedTokens": 367, + "hitEos": true, + "completionClass": "NATURAL_EOS", + "taskEvaluation": { + "candidate_sha256": "19855a3603cdbc2102fee4850d03e96ae4bdb7c54245ce222e33fd7454dc0c47", + "extraction_mode": "fenced", + "contains_entry_point_definition": true, + "closed_code_fence": true, + "python_ast_parse": true, + "parse_error": null, + "semantic_terminal": true, + "evaluator_covered": true, + "execution": { + "status": "passed", + "return_code": 0, + "runtime_ms": 314.3206940148957, + "harness_sha256": "945365d23121de01d747be6323dfc2636e5ef59ee1d7fafd64acaf260e8290d4" + }, + "fixed_budget_tests_pass": true, + "strict_complete_tests_pass": true + } + }, + { + "sourceId": "HumanEval/133", + "domain": "code", + "condition": "s1_period", + "generatedTokens": 74, + "hitEos": true, + "completionClass": "NATURAL_EOS", + "taskEvaluation": { + "candidate_sha256": "f0f47ad5d481f48cd88b6091c1eceb093e44040c9f22c0cd3f5984bd2533f9ea", + "extraction_mode": "direct_definition", + "contains_entry_point_definition": true, + "closed_code_fence": false, + "python_ast_parse": true, + "parse_error": null, + "semantic_terminal": true, + "evaluator_covered": true, + "execution": { + "status": "assertion_failed", + "return_code": 10, + "runtime_ms": 314.3881849828176, + "harness_sha256": "88fa4b0e5793c96dac9c96afee722ccf5a0738a22c51cd36589a2f479c81d1e3" + }, + "fixed_budget_tests_pass": false, + "strict_complete_tests_pass": false + } + }, + { + "sourceId": "HumanEval/23", + "domain": "code", + "condition": "s0_eos", + "generatedTokens": 146, + "hitEos": true, + "completionClass": "NATURAL_EOS", + "taskEvaluation": { + "candidate_sha256": "7897188c3cb91527449f69dcd0c4473974736a470998152874ccf04e6df93e37", + "extraction_mode": "fenced", + "contains_entry_point_definition": true, + "closed_code_fence": true, + "python_ast_parse": true, + "parse_error": null, + "semantic_terminal": true, + "evaluator_covered": true, + "execution": { + "status": "passed", + "return_code": 0, + "runtime_ms": 314.44897601613775, + "harness_sha256": "1f8be36a0ff375dbdfe72ba64b71760e81f7763864312ddd859eabeea4f25151" + }, + "fixed_budget_tests_pass": true, + "strict_complete_tests_pass": true + } + }, + { + "sourceId": "HumanEval/23", + "domain": "code", + "condition": "s1_eos", + "generatedTokens": 71, + "hitEos": true, + "completionClass": "NATURAL_EOS", + "taskEvaluation": { + "candidate_sha256": "aac1b2005230da60d09fe75f852bfc4c24e16d9de060c4d7c31b227d860307bf", + "extraction_mode": "fenced", + "contains_entry_point_definition": true, + "closed_code_fence": true, + "python_ast_parse": true, + "parse_error": null, + "semantic_terminal": true, + "evaluator_covered": true, + "execution": { + "status": "passed", + "return_code": 0, + "runtime_ms": 314.3976960272994, + "harness_sha256": "4f4764de384658f51552b0456a9e65f920396f05985c0476f43f6b190d5b422e" + }, + "fixed_budget_tests_pass": true, + "strict_complete_tests_pass": true + } + }, + { + "sourceId": "HumanEval/23", + "domain": "code", + "condition": "s0_bos", + "generatedTokens": 130, + "hitEos": true, + "completionClass": "NATURAL_EOS", + "taskEvaluation": { + "candidate_sha256": "aac1b2005230da60d09fe75f852bfc4c24e16d9de060c4d7c31b227d860307bf", + "extraction_mode": "fenced", + "contains_entry_point_definition": true, + "closed_code_fence": true, + "python_ast_parse": true, + "parse_error": null, + "semantic_terminal": true, + "evaluator_covered": true, + "execution": { + "status": "passed", + "return_code": 0, + "runtime_ms": 314.27101101144217, + "harness_sha256": "4f4764de384658f51552b0456a9e65f920396f05985c0476f43f6b190d5b422e" + }, + "fixed_budget_tests_pass": true, + "strict_complete_tests_pass": true + } + }, + { + "sourceId": "HumanEval/23", + "domain": "code", + "condition": "s1_bos", + "generatedTokens": 149, + "hitEos": true, + "completionClass": "NATURAL_EOS", + "taskEvaluation": { + "candidate_sha256": "74f33e189fe5c71b7a2bc81a0b26b36a45c640674bbf3bdadaa313c6b4404b6d", + "extraction_mode": "fenced", + "contains_entry_point_definition": true, + "closed_code_fence": true, + "python_ast_parse": true, + "parse_error": null, + "semantic_terminal": true, + "evaluator_covered": true, + "execution": { + "status": "passed", + "return_code": 0, + "runtime_ms": 314.4300209823996, + "harness_sha256": "67333f4ad29040664c2cee7fbf330b7627af5ef1401567a639da63e2e6f38891" + }, + "fixed_budget_tests_pass": true, + "strict_complete_tests_pass": true + } + }, + { + "sourceId": "HumanEval/23", + "domain": "code", + "condition": "s0_x", + "generatedTokens": 180, + "hitEos": true, + "completionClass": "NATURAL_EOS", + "taskEvaluation": { + "candidate_sha256": "aac1b2005230da60d09fe75f852bfc4c24e16d9de060c4d7c31b227d860307bf", + "extraction_mode": "fenced", + "contains_entry_point_definition": true, + "closed_code_fence": true, + "python_ast_parse": true, + "parse_error": null, + "semantic_terminal": true, + "evaluator_covered": true, + "execution": { + "status": "passed", + "return_code": 0, + "runtime_ms": 314.35666198376566, + "harness_sha256": "4f4764de384658f51552b0456a9e65f920396f05985c0476f43f6b190d5b422e" + }, + "fixed_budget_tests_pass": true, + "strict_complete_tests_pass": true + } + }, + { + "sourceId": "HumanEval/23", + "domain": "code", + "condition": "s1_x", + "generatedTokens": 53, + "hitEos": true, + "completionClass": "NATURAL_EOS", + "taskEvaluation": { + "candidate_sha256": "831c4d6a608f99826ae7fb5dc85b3f25a5aebf7643e2dec1468c8a442c7f751b", + "extraction_mode": "fenced", + "contains_entry_point_definition": true, + "closed_code_fence": true, + "python_ast_parse": true, + "parse_error": null, + "semantic_terminal": true, + "evaluator_covered": true, + "execution": { + "status": "passed", + "return_code": 0, + "runtime_ms": 314.5247499924153, + "harness_sha256": "e4e27b8f12797e58c1403da41903b81918a277a69c402102b0dc61e23c9cb10a" + }, + "fixed_budget_tests_pass": true, + "strict_complete_tests_pass": true + } + }, + { + "sourceId": "HumanEval/23", + "domain": "code", + "condition": "s0_period", + "generatedTokens": 191, + "hitEos": true, + "completionClass": "NATURAL_EOS", + "taskEvaluation": { + "candidate_sha256": "31d023bb07881f723b75dbf119cf0c53d66ef97775cdd2714bb5a4e6f3c2d0cd", + "extraction_mode": "fenced", + "contains_entry_point_definition": true, + "closed_code_fence": true, + "python_ast_parse": true, + "parse_error": null, + "semantic_terminal": true, + "evaluator_covered": true, + "execution": { + "status": "passed", + "return_code": 0, + "runtime_ms": 314.2992399807554, + "harness_sha256": "702682a7208424bb605d3ebbe4df63f42855fda32208e4b3766ef4ad95f5e3cb" + }, + "fixed_budget_tests_pass": true, + "strict_complete_tests_pass": true + } + }, + { + "sourceId": "HumanEval/23", + "domain": "code", + "condition": "s1_period", + "generatedTokens": 48, + "hitEos": true, + "completionClass": "NATURAL_EOS", + "taskEvaluation": { + "candidate_sha256": "831c4d6a608f99826ae7fb5dc85b3f25a5aebf7643e2dec1468c8a442c7f751b", + "extraction_mode": "direct_definition", + "contains_entry_point_definition": true, + "closed_code_fence": false, + "python_ast_parse": true, + "parse_error": null, + "semantic_terminal": true, + "evaluator_covered": true, + "execution": { + "status": "passed", + "return_code": 0, + "runtime_ms": 314.36260099872015, + "harness_sha256": "e4e27b8f12797e58c1403da41903b81918a277a69c402102b0dc61e23c9cb10a" + }, + "fixed_budget_tests_pass": true, + "strict_complete_tests_pass": true + } + }, + { + "sourceId": "gsm8k/test/1069", + "domain": "math", + "condition": "s0_eos", + "generatedTokens": 213, + "hitEos": true, + "completionClass": "NATURAL_EOS", + "taskEvaluation": { + "gold_final": "300", + "predicted_final": "300", + "extraction_method": "boxed", + "explicit_final_marker": true, + "semantic_terminal": true, + "evaluator_covered": true, + "fixed_budget_numeric_exact": true, + "strict_complete_numeric_exact": true + } + }, + { + "sourceId": "gsm8k/test/1069", + "domain": "math", + "condition": "s1_eos", + "generatedTokens": 213, + "hitEos": true, + "completionClass": "NATURAL_EOS", + "taskEvaluation": { + "gold_final": "300", + "predicted_final": "300", + "extraction_method": "boxed", + "explicit_final_marker": true, + "semantic_terminal": true, + "evaluator_covered": true, + "fixed_budget_numeric_exact": true, + "strict_complete_numeric_exact": true + } + }, + { + "sourceId": "gsm8k/test/1069", + "domain": "math", + "condition": "s0_bos", + "generatedTokens": 211, + "hitEos": true, + "completionClass": "NATURAL_EOS", + "taskEvaluation": { + "gold_final": "300", + "predicted_final": "300", + "extraction_method": "boxed", + "explicit_final_marker": true, + "semantic_terminal": true, + "evaluator_covered": true, + "fixed_budget_numeric_exact": true, + "strict_complete_numeric_exact": true + } + }, + { + "sourceId": "gsm8k/test/1069", + "domain": "math", + "condition": "s1_bos", + "generatedTokens": 192, + "hitEos": true, + "completionClass": "NATURAL_EOS", + "taskEvaluation": { + "gold_final": "300", + "predicted_final": "300", + "extraction_method": "boxed", + "explicit_final_marker": true, + "semantic_terminal": true, + "evaluator_covered": true, + "fixed_budget_numeric_exact": true, + "strict_complete_numeric_exact": true + } + }, + { + "sourceId": "gsm8k/test/1069", + "domain": "math", + "condition": "s0_x", + "generatedTokens": 184, + "hitEos": true, + "completionClass": "NATURAL_EOS", + "taskEvaluation": { + "gold_final": "300", + "predicted_final": "300", + "extraction_method": "boxed", + "explicit_final_marker": true, + "semantic_terminal": true, + "evaluator_covered": true, + "fixed_budget_numeric_exact": true, + "strict_complete_numeric_exact": true + } + }, + { + "sourceId": "gsm8k/test/1069", + "domain": "math", + "condition": "s1_x", + "generatedTokens": 112, + "hitEos": true, + "completionClass": "NATURAL_EOS", + "taskEvaluation": { + "gold_final": "300", + "predicted_final": "300", + "extraction_method": "answer_phrase", + "explicit_final_marker": true, + "semantic_terminal": true, + "evaluator_covered": true, + "fixed_budget_numeric_exact": true, + "strict_complete_numeric_exact": true + } + }, + { + "sourceId": "gsm8k/test/1069", + "domain": "math", + "condition": "s0_period", + "generatedTokens": 194, + "hitEos": true, + "completionClass": "NATURAL_EOS", + "taskEvaluation": { + "gold_final": "300", + "predicted_final": "300", + "extraction_method": "boxed", + "explicit_final_marker": true, + "semantic_terminal": true, + "evaluator_covered": true, + "fixed_budget_numeric_exact": true, + "strict_complete_numeric_exact": true + } + }, + { + "sourceId": "gsm8k/test/1069", + "domain": "math", + "condition": "s1_period", + "generatedTokens": 192, + "hitEos": true, + "completionClass": "NATURAL_EOS", + "taskEvaluation": { + "gold_final": "300", + "predicted_final": "300", + "extraction_method": "boxed", + "explicit_final_marker": true, + "semantic_terminal": true, + "evaluator_covered": true, + "fixed_budget_numeric_exact": true, + "strict_complete_numeric_exact": true + } + }, + { + "sourceId": "gsm8k/test/1228", + "domain": "math", + "condition": "s0_eos", + "generatedTokens": 258, + "hitEos": true, + "completionClass": "NATURAL_EOS", + "taskEvaluation": { + "gold_final": "31", + "predicted_final": "31", + "extraction_method": "boxed", + "explicit_final_marker": true, + "semantic_terminal": true, + "evaluator_covered": true, + "fixed_budget_numeric_exact": true, + "strict_complete_numeric_exact": true + } + }, + { + "sourceId": "gsm8k/test/1228", + "domain": "math", + "condition": "s1_eos", + "generatedTokens": 215, + "hitEos": true, + "completionClass": "NATURAL_EOS", + "taskEvaluation": { + "gold_final": "31", + "predicted_final": "31", + "extraction_method": "boxed", + "explicit_final_marker": true, + "semantic_terminal": true, + "evaluator_covered": true, + "fixed_budget_numeric_exact": true, + "strict_complete_numeric_exact": true + } + }, + { + "sourceId": "gsm8k/test/1228", + "domain": "math", + "condition": "s0_bos", + "generatedTokens": 228, + "hitEos": true, + "completionClass": "NATURAL_EOS", + "taskEvaluation": { + "gold_final": "31", + "predicted_final": "31", + "extraction_method": "boxed", + "explicit_final_marker": true, + "semantic_terminal": true, + "evaluator_covered": true, + "fixed_budget_numeric_exact": true, + "strict_complete_numeric_exact": true + } + }, + { + "sourceId": "gsm8k/test/1228", + "domain": "math", + "condition": "s1_bos", + "generatedTokens": 228, + "hitEos": true, + "completionClass": "NATURAL_EOS", + "taskEvaluation": { + "gold_final": "31", + "predicted_final": "31", + "extraction_method": "boxed", + "explicit_final_marker": true, + "semantic_terminal": true, + "evaluator_covered": true, + "fixed_budget_numeric_exact": true, + "strict_complete_numeric_exact": true + } + }, + { + "sourceId": "gsm8k/test/1228", + "domain": "math", + "condition": "s0_x", + "generatedTokens": 222, + "hitEos": true, + "completionClass": "NATURAL_EOS", + "taskEvaluation": { + "gold_final": "31", + "predicted_final": "31", + "extraction_method": "boxed", + "explicit_final_marker": true, + "semantic_terminal": true, + "evaluator_covered": true, + "fixed_budget_numeric_exact": true, + "strict_complete_numeric_exact": true + } + }, + { + "sourceId": "gsm8k/test/1228", + "domain": "math", + "condition": "s1_x", + "generatedTokens": 80, + "hitEos": true, + "completionClass": "NATURAL_EOS", + "taskEvaluation": { + "gold_final": "31", + "predicted_final": "31", + "extraction_method": "answer_phrase", + "explicit_final_marker": true, + "semantic_terminal": true, + "evaluator_covered": true, + "fixed_budget_numeric_exact": true, + "strict_complete_numeric_exact": true + } + }, + { + "sourceId": "gsm8k/test/1228", + "domain": "math", + "condition": "s0_period", + "generatedTokens": 228, + "hitEos": true, + "completionClass": "NATURAL_EOS", + "taskEvaluation": { + "gold_final": "31", + "predicted_final": "31", + "extraction_method": "boxed", + "explicit_final_marker": true, + "semantic_terminal": true, + "evaluator_covered": true, + "fixed_budget_numeric_exact": true, + "strict_complete_numeric_exact": true + } + }, + { + "sourceId": "gsm8k/test/1228", + "domain": "math", + "condition": "s1_period", + "generatedTokens": 243, + "hitEos": true, + "completionClass": "NATURAL_EOS", + "taskEvaluation": { + "gold_final": "31", + "predicted_final": "31", + "extraction_method": "boxed", + "explicit_final_marker": true, + "semantic_terminal": true, + "evaluator_covered": true, + "fixed_budget_numeric_exact": true, + "strict_complete_numeric_exact": true + } + }, + { + "sourceId": "gsm8k/test/0144", + "domain": "math", + "condition": "s0_eos", + "generatedTokens": 202, + "hitEos": true, + "completionClass": "NATURAL_EOS", + "taskEvaluation": { + "gold_final": "20", + "predicted_final": "140", + "extraction_method": "answer_phrase", + "explicit_final_marker": true, + "semantic_terminal": true, + "evaluator_covered": true, + "fixed_budget_numeric_exact": false, + "strict_complete_numeric_exact": false + } + }, + { + "sourceId": "gsm8k/test/0144", + "domain": "math", + "condition": "s1_eos", + "generatedTokens": 194, + "hitEos": true, + "completionClass": "NATURAL_EOS", + "taskEvaluation": { + "gold_final": "20", + "predicted_final": "20", + "extraction_method": "answer_phrase", + "explicit_final_marker": true, + "semantic_terminal": true, + "evaluator_covered": true, + "fixed_budget_numeric_exact": true, + "strict_complete_numeric_exact": true + } + }, + { + "sourceId": "gsm8k/test/0144", + "domain": "math", + "condition": "s0_bos", + "generatedTokens": 246, + "hitEos": true, + "completionClass": "NATURAL_EOS", + "taskEvaluation": { + "gold_final": "20", + "predicted_final": "20", + "extraction_method": "boxed", + "explicit_final_marker": true, + "semantic_terminal": true, + "evaluator_covered": true, + "fixed_budget_numeric_exact": true, + "strict_complete_numeric_exact": true + } + }, + { + "sourceId": "gsm8k/test/0144", + "domain": "math", + "condition": "s1_bos", + "generatedTokens": 226, + "hitEos": true, + "completionClass": "NATURAL_EOS", + "taskEvaluation": { + "gold_final": "20", + "predicted_final": "36", + "extraction_method": "answer_phrase", + "explicit_final_marker": true, + "semantic_terminal": true, + "evaluator_covered": true, + "fixed_budget_numeric_exact": false, + "strict_complete_numeric_exact": false + } + }, + { + "sourceId": "gsm8k/test/0144", + "domain": "math", + "condition": "s0_x", + "generatedTokens": 216, + "hitEos": true, + "completionClass": "NATURAL_EOS", + "taskEvaluation": { + "gold_final": "20", + "predicted_final": "36", + "extraction_method": "answer_phrase", + "explicit_final_marker": true, + "semantic_terminal": true, + "evaluator_covered": true, + "fixed_budget_numeric_exact": false, + "strict_complete_numeric_exact": false + } + }, + { + "sourceId": "gsm8k/test/0144", + "domain": "math", + "condition": "s1_x", + "generatedTokens": 222, + "hitEos": true, + "completionClass": "NATURAL_EOS", + "taskEvaluation": { + "gold_final": "20", + "predicted_final": "20", + "extraction_method": "boxed", + "explicit_final_marker": true, + "semantic_terminal": true, + "evaluator_covered": true, + "fixed_budget_numeric_exact": true, + "strict_complete_numeric_exact": true + } + }, + { + "sourceId": "gsm8k/test/0144", + "domain": "math", + "condition": "s0_period", + "generatedTokens": 272, + "hitEos": true, + "completionClass": "NATURAL_EOS", + "taskEvaluation": { + "gold_final": "20", + "predicted_final": "20", + "extraction_method": "boxed", + "explicit_final_marker": true, + "semantic_terminal": true, + "evaluator_covered": true, + "fixed_budget_numeric_exact": true, + "strict_complete_numeric_exact": true + } + }, + { + "sourceId": "gsm8k/test/0144", + "domain": "math", + "condition": "s1_period", + "generatedTokens": 290, + "hitEos": true, + "completionClass": "NATURAL_EOS", + "taskEvaluation": { + "gold_final": "20", + "predicted_final": "92", + "extraction_method": "answer_phrase", + "explicit_final_marker": true, + "semantic_terminal": true, + "evaluator_covered": true, + "fixed_budget_numeric_exact": false, + "strict_complete_numeric_exact": false + } + }, + { + "sourceId": "gsm8k/test/1251", + "domain": "math", + "condition": "s0_eos", + "generatedTokens": 258, + "hitEos": true, + "completionClass": "NATURAL_EOS", + "taskEvaluation": { + "gold_final": "30", + "predicted_final": "30", + "extraction_method": "boxed", + "explicit_final_marker": true, + "semantic_terminal": true, + "evaluator_covered": true, + "fixed_budget_numeric_exact": true, + "strict_complete_numeric_exact": true + } + }, + { + "sourceId": "gsm8k/test/1251", + "domain": "math", + "condition": "s1_eos", + "generatedTokens": 200, + "hitEos": true, + "completionClass": "NATURAL_EOS", + "taskEvaluation": { + "gold_final": "30", + "predicted_final": "20", + "extraction_method": "boxed", + "explicit_final_marker": true, + "semantic_terminal": true, + "evaluator_covered": true, + "fixed_budget_numeric_exact": false, + "strict_complete_numeric_exact": false + } + }, + { + "sourceId": "gsm8k/test/1251", + "domain": "math", + "condition": "s0_bos", + "generatedTokens": 176, + "hitEos": true, + "completionClass": "NATURAL_EOS", + "taskEvaluation": { + "gold_final": "30", + "predicted_final": "42.5", + "extraction_method": "boxed", + "explicit_final_marker": true, + "semantic_terminal": true, + "evaluator_covered": true, + "fixed_budget_numeric_exact": false, + "strict_complete_numeric_exact": false + } + }, + { + "sourceId": "gsm8k/test/1251", + "domain": "math", + "condition": "s1_bos", + "generatedTokens": 172, + "hitEos": true, + "completionClass": "NATURAL_EOS", + "taskEvaluation": { + "gold_final": "30", + "predicted_final": "30", + "extraction_method": "answer_phrase", + "explicit_final_marker": true, + "semantic_terminal": true, + "evaluator_covered": true, + "fixed_budget_numeric_exact": true, + "strict_complete_numeric_exact": true + } + }, + { + "sourceId": "gsm8k/test/1251", + "domain": "math", + "condition": "s0_x", + "generatedTokens": 251, + "hitEos": true, + "completionClass": "NATURAL_EOS", + "taskEvaluation": { + "gold_final": "30", + "predicted_final": "33", + "extraction_method": "last_number_fallback", + "explicit_final_marker": false, + "semantic_terminal": true, + "evaluator_covered": true, + "fixed_budget_numeric_exact": false, + "strict_complete_numeric_exact": false + } + }, + { + "sourceId": "gsm8k/test/1251", + "domain": "math", + "condition": "s1_x", + "generatedTokens": 246, + "hitEos": true, + "completionClass": "NATURAL_EOS", + "taskEvaluation": { + "gold_final": "30", + "predicted_final": "6", + "extraction_method": "last_number_fallback", + "explicit_final_marker": false, + "semantic_terminal": true, + "evaluator_covered": true, + "fixed_budget_numeric_exact": false, + "strict_complete_numeric_exact": false + } + }, + { + "sourceId": "gsm8k/test/1251", + "domain": "math", + "condition": "s0_period", + "generatedTokens": 235, + "hitEos": true, + "completionClass": "NATURAL_EOS", + "taskEvaluation": { + "gold_final": "30", + "predicted_final": "6", + "extraction_method": "last_number_fallback", + "explicit_final_marker": false, + "semantic_terminal": true, + "evaluator_covered": true, + "fixed_budget_numeric_exact": false, + "strict_complete_numeric_exact": false + } + }, + { + "sourceId": "gsm8k/test/1251", + "domain": "math", + "condition": "s1_period", + "generatedTokens": 210, + "hitEos": true, + "completionClass": "NATURAL_EOS", + "taskEvaluation": { + "gold_final": "30", + "predicted_final": "30", + "extraction_method": "last_number_fallback", + "explicit_final_marker": false, + "semantic_terminal": true, + "evaluator_covered": true, + "fixed_budget_numeric_exact": true, + "strict_complete_numeric_exact": true + } + } + ], + "taskTotals": { + "math": { + "strictCorrect": 23, + "total": 32, + "extractionMethods": { + "boxed": 20, + "answer_phrase": 8, + "last_number_fallback": 4 + } + }, + "code": { + "testsPassed": 24, + "total": 32, + "statuses": { + "passed": 24, + "assertion_failed": 5, + "not_run": 1, + "runtime_error": 2 + } + } + }, + "sandbox": { + "image": "python:3.11-alpine@sha256:25976e9d34a0fab1f278cae931f34c8303d97bf0c0d7f85b6b4dcf641d7702a4", + "timeout_seconds": 5, + "code_execution_skipped": false, + "network": "none", + "filesystem": "read-only", + "user": "65534:65534", + "capabilities": "ALL dropped", + "memory": "256m", + "memory_swap": "256m", + "pids_limit": 64, + "cpus": 0.5, + "tmpfs": "/tmp:rw,noexec,nosuid,size=16m", + "host_mounts": 0 + }, + "reproduction": { + "sources": 4, + "cells": 32, + "promptHashExact": 32, + "generatedTokenIdsExact": 32, + "generatedTextExact": 32, + "eosStateExact": 32, + "truncationStateExact": 32 + }, + "execution": { + "python": "3.10.14", + "torch": "2.11.0+cu128", + "transformers": "4.41.2", + "accelerate": "1.13.0", + "safetensors": "0.8.0", + "platform": "Linux-7.0.0-28-generic-x86_64-with-glibc2.43", + "gpu": "NVIDIA GeForce RTX 5090", + "gpu_memory_limit": "28GiB", + "cpu_memory_limit": "80GiB", + "pytorch_cuda_alloc_conf": "expandable_segments:True", + "input_device": "cuda:0", + "device_map": { + "model.embed_tokens": 0, + "model.layers.0": 0, + "model.layers.1": 0, + "model.layers.2": 0, + "model.layers.3": 0, + "model.layers.4": 0, + "model.layers.5": 0, + "model.layers.6": 0, + "model.layers.7": 0, + "model.layers.8": 0, + "model.layers.9": 0, + "model.layers.10": 0, + "model.layers.11": 0, + "model.layers.12": 0, + "model.layers.13": 0, + "model.layers.14": 0, + "model.layers.15": 0, + "model.layers.16": 0, + "model.layers.17": 0, + "model.layers.18": 0, + "model.layers.19": 0, + "model.layers.20": 0, + "model.layers.21": 0, + "model.layers.22": 0, + "model.layers.23": 0, + "model.layers.24": "cpu", + "model.layers.25": "cpu", + "model.layers.26": "cpu", + "model.norm": "cpu", + "lm_head": "cpu" + }, + "parameter_bytes_by_runtime_parameter_device": { + "cuda:0": 27484446720, + "meta": 3928521728 + }, + "parameter_bytes_by_dtype": { + "torch.bfloat16": 31412968448 + }, + "offload_parameter_device_note": "Accelerate CPU-offloaded modules expose meta parameters between forwards; hf_device_map is authoritative for their CPU placement.", + "load_seconds": 8.417238129011821, + "load_peak_cuda_memory_allocated_bytes": 28616922624, + "cuda_memory_allocated_after_load_bytes": 28616922624, + "peak_cuda_memory_allocated_bytes": 31464357376, + "process_max_rss_kib": 18665304, + "official_single_gpu_bf16_requirement": "40GB GPU", + "local_single_gpu_capacity_mib": 32607, + "offload_required_by_local_capacity": true + }, + "claimBoundary": [ + "Four math and four code sources are not benchmark estimates.", + "Completion-conditioned metrics are selection-biased diagnostics.", + "A passing HumanEval test is functional evidence, not code-safety evidence.", + "Fallback last-number extraction is not strict completion.", + "Counterfactual token sequences are not official-valid chats." + ] + }, + "depth": { + "summary": { + "sources": 16, + "conditions_per_source": 8, + "decoder_layers_executed": 27, + "moe_gates_executed": 26, + "hidden_stages": 29, + "target_content_tokens_per_condition": 1537, + "target_route_decisions": 1918176 + }, + "hiddenSeries": { + "all": { + "system_eos": [ + { + "stage": "embedding", + "tokens": 1537, + "exactRows": 1537, + "meanCosine": 1, + "meanRelativeL2": 0, + "maxAbsDelta": 0 + }, + { + "stage": "layer_00", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9995740788977256, + "meanRelativeL2": 0.026541569794062525, + "maxAbsDelta": 0.171875 + }, + { + "stage": "layer_01", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9990745525741701, + "meanRelativeL2": 0.041919392184354365, + "maxAbsDelta": 0.2109375 + }, + { + "stage": "layer_02", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9988076181557556, + "meanRelativeL2": 0.04928529146127403, + "maxAbsDelta": 0.3125 + }, + { + "stage": "layer_03", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9987378821562232, + "meanRelativeL2": 0.05012279818765819, + "maxAbsDelta": 0.3125 + }, + { + "stage": "layer_04", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9987564588337652, + "meanRelativeL2": 0.04912583786062896, + "maxAbsDelta": 0.21875 + }, + { + "stage": "layer_05", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9982688488243614, + "meanRelativeL2": 0.05803673341870308, + "maxAbsDelta": 0.3515625 + }, + { + "stage": "layer_06", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9980427927992603, + "meanRelativeL2": 0.06077818898484111, + "maxAbsDelta": 0.625 + }, + { + "stage": "layer_07", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9976431092970853, + "meanRelativeL2": 0.06538312137126923, + "maxAbsDelta": 0.9375 + }, + { + "stage": "layer_08", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9970279263845108, + "meanRelativeL2": 0.07258906331844628, + "maxAbsDelta": 1 + }, + { + "stage": "layer_09", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9971079260556823, + "meanRelativeL2": 0.07105764513835311, + "maxAbsDelta": 1.296875 + }, + { + "stage": "layer_10", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9966923841114702, + "meanRelativeL2": 0.07547172368504107, + "maxAbsDelta": 1.75 + }, + { + "stage": "layer_11", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9969381400339775, + "meanRelativeL2": 0.07296121632680297, + "maxAbsDelta": 1.875 + }, + { + "stage": "layer_12", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9963385728790765, + "meanRelativeL2": 0.07891326025128365, + "maxAbsDelta": 1.71875 + }, + { + "stage": "layer_13", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9961696515706893, + "meanRelativeL2": 0.08070490043610334, + "maxAbsDelta": 2.21875 + }, + { + "stage": "layer_14", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9960505612189691, + "meanRelativeL2": 0.08195926831103861, + "maxAbsDelta": 2.0625 + }, + { + "stage": "layer_15", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9959217394491877, + "meanRelativeL2": 0.08303570747375488, + "maxAbsDelta": 2.375 + }, + { + "stage": "layer_16", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9958026031821132, + "meanRelativeL2": 0.08420354872941971, + "maxAbsDelta": 2.46875 + }, + { + "stage": "layer_17", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9960135465794441, + "meanRelativeL2": 0.08217688277363777, + "maxAbsDelta": 2.5625 + }, + { + "stage": "layer_18", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.995988845902755, + "meanRelativeL2": 0.08214063243940473, + "maxAbsDelta": 2.9375 + }, + { + "stage": "layer_19", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9958618525258116, + "meanRelativeL2": 0.08356876182369888, + "maxAbsDelta": 4.3125 + }, + { + "stage": "layer_20", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9959022400436575, + "meanRelativeL2": 0.0838350560516119, + "maxAbsDelta": 6.4375 + }, + { + "stage": "layer_21", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9954525232315063, + "meanRelativeL2": 0.08917711256071925, + "maxAbsDelta": 6.25 + }, + { + "stage": "layer_22", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9952690807269934, + "meanRelativeL2": 0.08997178031131625, + "maxAbsDelta": 10.375 + }, + { + "stage": "layer_23", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9957798085355417, + "meanRelativeL2": 0.08500573574565351, + "maxAbsDelta": 11 + }, + { + "stage": "layer_24", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.995608764068601, + "meanRelativeL2": 0.07959229638800025, + "maxAbsDelta": 336.8359375 + }, + { + "stage": "layer_25", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9965445137908107, + "meanRelativeL2": 0.06958195590414107, + "maxAbsDelta": 338.359375 + }, + { + "stage": "layer_26", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9965245394095555, + "meanRelativeL2": 0.07579565513879061, + "maxAbsDelta": 60.25 + }, + { + "stage": "final_norm", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9953002745870964, + "meanRelativeL2": 0.08473945129662752, + "maxAbsDelta": 6.92578125 + } + ], + "system_bos": [ + { + "stage": "embedding", + "tokens": 1537, + "exactRows": 1537, + "meanCosine": 1, + "meanRelativeL2": 0, + "maxAbsDelta": 0 + }, + { + "stage": "layer_00", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9993778440420241, + "meanRelativeL2": 0.03268232592381537, + "maxAbsDelta": 0.171875 + }, + { + "stage": "layer_01", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9969392231942464, + "meanRelativeL2": 0.07685172208584845, + "maxAbsDelta": 0.3330078125 + }, + { + "stage": "layer_02", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9963408525919247, + "meanRelativeL2": 0.0867034113034606, + "maxAbsDelta": 0.404296875 + }, + { + "stage": "layer_03", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.996292127675644, + "meanRelativeL2": 0.08758943434804678, + "maxAbsDelta": 0.34375 + }, + { + "stage": "layer_04", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9965691402816276, + "meanRelativeL2": 0.08456931868568063, + "maxAbsDelta": 0.34375 + }, + { + "stage": "layer_05", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.995865110615747, + "meanRelativeL2": 0.091684325132519, + "maxAbsDelta": 0.4375 + }, + { + "stage": "layer_06", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9957885297770305, + "meanRelativeL2": 0.09088909346610308, + "maxAbsDelta": 0.875 + }, + { + "stage": "layer_07", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9952103213668257, + "meanRelativeL2": 0.09576857043430209, + "maxAbsDelta": 1.1875 + }, + { + "stage": "layer_08", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.994552351005991, + "meanRelativeL2": 0.10126419179141521, + "maxAbsDelta": 1.28125 + }, + { + "stage": "layer_09", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9950019388751078, + "meanRelativeL2": 0.09663280518725514, + "maxAbsDelta": 1.65625 + }, + { + "stage": "layer_10", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9943990580975117, + "meanRelativeL2": 0.10175536246970296, + "maxAbsDelta": 1.84375 + }, + { + "stage": "layer_11", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9951220515802764, + "meanRelativeL2": 0.09516267012804747, + "maxAbsDelta": 2.25 + }, + { + "stage": "layer_12", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9943868957251485, + "meanRelativeL2": 0.10157283348962665, + "maxAbsDelta": 2.5625 + }, + { + "stage": "layer_13", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9941997341157247, + "meanRelativeL2": 0.10259270062670112, + "maxAbsDelta": 2.5625 + }, + { + "stage": "layer_14", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.994281703726223, + "meanRelativeL2": 0.10208113910630345, + "maxAbsDelta": 2.75 + }, + { + "stage": "layer_15", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.994253098460553, + "meanRelativeL2": 0.10191086959093809, + "maxAbsDelta": 2.75 + }, + { + "stage": "layer_16", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9941233933631212, + "meanRelativeL2": 0.10283792112022638, + "maxAbsDelta": 3.6875 + }, + { + "stage": "layer_17", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9944117009911199, + "meanRelativeL2": 0.10046469513326883, + "maxAbsDelta": 3.875 + }, + { + "stage": "layer_18", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9945154444071559, + "meanRelativeL2": 0.09908437542617321, + "maxAbsDelta": 4.625 + }, + { + "stage": "layer_19", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9943937815158648, + "meanRelativeL2": 0.10056838346645236, + "maxAbsDelta": 4.640625 + }, + { + "stage": "layer_20", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.994575797425669, + "meanRelativeL2": 0.09960785415023565, + "maxAbsDelta": 7.5625 + }, + { + "stage": "layer_21", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9941505370934287, + "meanRelativeL2": 0.10403220262378454, + "maxAbsDelta": 6.875 + }, + { + "stage": "layer_22", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9939644304125357, + "meanRelativeL2": 0.10505827376618981, + "maxAbsDelta": 11.1875 + }, + { + "stage": "layer_23", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9945515960396771, + "meanRelativeL2": 0.09907629783265293, + "maxAbsDelta": 13 + }, + { + "stage": "layer_24", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9949187377325963, + "meanRelativeL2": 0.09368397342041135, + "maxAbsDelta": 536.9375 + }, + { + "stage": "layer_25", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9960013827334462, + "meanRelativeL2": 0.0817512848880142, + "maxAbsDelta": 542.34375 + }, + { + "stage": "layer_26", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9955047235600578, + "meanRelativeL2": 0.08790485421195626, + "maxAbsDelta": 74.5 + }, + { + "stage": "final_norm", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9944039278008678, + "meanRelativeL2": 0.0961449178867042, + "maxAbsDelta": 4.4375 + } + ], + "system_x": [ + { + "stage": "embedding", + "tokens": 1537, + "exactRows": 1537, + "meanCosine": 1, + "meanRelativeL2": 0, + "maxAbsDelta": 0 + }, + { + "stage": "layer_00", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9994067405056628, + "meanRelativeL2": 0.03226005844771862, + "maxAbsDelta": 0.171875 + }, + { + "stage": "layer_01", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9958411259703924, + "meanRelativeL2": 0.08964474685490131, + "maxAbsDelta": 0.3212890625 + }, + { + "stage": "layer_02", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9949375862569567, + "meanRelativeL2": 0.10124093946069479, + "maxAbsDelta": 0.421875 + }, + { + "stage": "layer_03", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9946176968539157, + "meanRelativeL2": 0.10508272983133793, + "maxAbsDelta": 0.40625 + }, + { + "stage": "layer_04", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9948968496040315, + "meanRelativeL2": 0.10330007504671812, + "maxAbsDelta": 0.5 + }, + { + "stage": "layer_05", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9935454737853135, + "meanRelativeL2": 0.11548144975677133, + "maxAbsDelta": 0.46875 + }, + { + "stage": "layer_06", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9932173994662472, + "meanRelativeL2": 0.11608999129384756, + "maxAbsDelta": 0.8125 + }, + { + "stage": "layer_07", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9923224972685825, + "meanRelativeL2": 0.12191515136510134, + "maxAbsDelta": 1.03125 + }, + { + "stage": "layer_08", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9909093995798541, + "meanRelativeL2": 0.1315021812915802, + "maxAbsDelta": 0.9140625 + }, + { + "stage": "layer_09", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9909707909678979, + "meanRelativeL2": 0.1287030722014606, + "maxAbsDelta": 1.875 + }, + { + "stage": "layer_10", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9899965980724615, + "meanRelativeL2": 0.13429195526987314, + "maxAbsDelta": 2.265625 + }, + { + "stage": "layer_11", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9907366159525334, + "meanRelativeL2": 0.1278938027098775, + "maxAbsDelta": 5.9375 + }, + { + "stage": "layer_12", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9894831287604924, + "meanRelativeL2": 0.13532286463305354, + "maxAbsDelta": 7.375 + }, + { + "stage": "layer_13", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9891657818426307, + "meanRelativeL2": 0.13655134150758386, + "maxAbsDelta": 5.4375 + }, + { + "stage": "layer_14", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.989056746255444, + "meanRelativeL2": 0.13760423194617033, + "maxAbsDelta": 6.4375 + }, + { + "stage": "layer_15", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9887929590553453, + "meanRelativeL2": 0.13958916626870632, + "maxAbsDelta": 6.5 + }, + { + "stage": "layer_16", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9884776922503926, + "meanRelativeL2": 0.14084367640316486, + "maxAbsDelta": 7.5 + }, + { + "stage": "layer_17", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9890573364849128, + "meanRelativeL2": 0.13747553993016481, + "maxAbsDelta": 7.78125 + }, + { + "stage": "layer_18", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9890297648964101, + "meanRelativeL2": 0.137291400693357, + "maxAbsDelta": 9.5 + }, + { + "stage": "layer_19", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9887662842898843, + "meanRelativeL2": 0.13902735663577914, + "maxAbsDelta": 9 + }, + { + "stage": "layer_20", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9888663863546289, + "meanRelativeL2": 0.1401374926790595, + "maxAbsDelta": 8.5 + }, + { + "stage": "layer_21", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9877016143358289, + "meanRelativeL2": 0.14937674580141902, + "maxAbsDelta": 8.375 + }, + { + "stage": "layer_22", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9874797748836822, + "meanRelativeL2": 0.15085909282788634, + "maxAbsDelta": 9.25 + }, + { + "stage": "layer_23", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.989057035669539, + "meanRelativeL2": 0.14142292411997914, + "maxAbsDelta": 12.625 + }, + { + "stage": "layer_24", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9896389956433973, + "meanRelativeL2": 0.13531467784196138, + "maxAbsDelta": 509 + }, + { + "stage": "layer_25", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9918477306834428, + "meanRelativeL2": 0.11801284598186612, + "maxAbsDelta": 514.421875 + }, + { + "stage": "layer_26", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.990289631763215, + "meanRelativeL2": 0.1377094043418765, + "maxAbsDelta": 57 + }, + { + "stage": "final_norm", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9877148998504967, + "meanRelativeL2": 0.14813534216955304, + "maxAbsDelta": 7.46875 + } + ], + "system_period": [ + { + "stage": "embedding", + "tokens": 1537, + "exactRows": 1537, + "meanCosine": 1, + "meanRelativeL2": 0, + "maxAbsDelta": 0 + }, + { + "stage": "layer_00", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9994327905275795, + "meanRelativeL2": 0.03135601186659187, + "maxAbsDelta": 0.1796875 + }, + { + "stage": "layer_01", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.995944818856271, + "meanRelativeL2": 0.08837105240672827, + "maxAbsDelta": 0.2998046875 + }, + { + "stage": "layer_02", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9950908737750355, + "meanRelativeL2": 0.09975895704701543, + "maxAbsDelta": 0.4375 + }, + { + "stage": "layer_03", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9947301580212531, + "meanRelativeL2": 0.10403680335730314, + "maxAbsDelta": 0.484375 + }, + { + "stage": "layer_04", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9948939370814281, + "meanRelativeL2": 0.10321774752810597, + "maxAbsDelta": 0.46875 + }, + { + "stage": "layer_05", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.99339776521545, + "meanRelativeL2": 0.11647011851891875, + "maxAbsDelta": 0.484375 + }, + { + "stage": "layer_06", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9928957691965121, + "meanRelativeL2": 0.11857915809378028, + "maxAbsDelta": 1 + }, + { + "stage": "layer_07", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9919988514544054, + "meanRelativeL2": 0.12480698665603995, + "maxAbsDelta": 1.0625 + }, + { + "stage": "layer_08", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9906470607687454, + "meanRelativeL2": 0.13463967526331544, + "maxAbsDelta": 1.125 + }, + { + "stage": "layer_09", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9910515145814954, + "meanRelativeL2": 0.1298412261530757, + "maxAbsDelta": 1.8125 + }, + { + "stage": "layer_10", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9902105037857358, + "meanRelativeL2": 0.13498050067573786, + "maxAbsDelta": 2.296875 + }, + { + "stage": "layer_11", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9909482988817938, + "meanRelativeL2": 0.12909179087728262, + "maxAbsDelta": 5.84375 + }, + { + "stage": "layer_12", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.98974432410865, + "meanRelativeL2": 0.13664561277255416, + "maxAbsDelta": 7.03125 + }, + { + "stage": "layer_13", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9895077488526324, + "meanRelativeL2": 0.13774158712476492, + "maxAbsDelta": 5.484375 + }, + { + "stage": "layer_14", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9892897145966857, + "meanRelativeL2": 0.1395717691630125, + "maxAbsDelta": 5.6875 + }, + { + "stage": "layer_15", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9890423821953108, + "meanRelativeL2": 0.1414533075876534, + "maxAbsDelta": 6.125 + }, + { + "stage": "layer_16", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9888618330173703, + "meanRelativeL2": 0.14244661526754498, + "maxAbsDelta": 7.25 + }, + { + "stage": "layer_17", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9894422549432024, + "meanRelativeL2": 0.13881344813853502, + "maxAbsDelta": 6 + }, + { + "stage": "layer_18", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9892772920890217, + "meanRelativeL2": 0.13932511024177074, + "maxAbsDelta": 7.5 + }, + { + "stage": "layer_19", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9891711986910312, + "meanRelativeL2": 0.14056314248591661, + "maxAbsDelta": 7.25 + }, + { + "stage": "layer_20", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9890742379888436, + "meanRelativeL2": 0.14310038881376386, + "maxAbsDelta": 7.375 + }, + { + "stage": "layer_21", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9877942779580726, + "meanRelativeL2": 0.15267642959952354, + "maxAbsDelta": 7.25 + }, + { + "stage": "layer_22", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9874594717655542, + "meanRelativeL2": 0.15457809250801802, + "maxAbsDelta": 8.5 + }, + { + "stage": "layer_23", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9888993718830423, + "meanRelativeL2": 0.14484320161864161, + "maxAbsDelta": 13.5 + }, + { + "stage": "layer_24", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9894277875347423, + "meanRelativeL2": 0.1382684507407248, + "maxAbsDelta": 503.21875 + }, + { + "stage": "layer_25", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9917068674569015, + "meanRelativeL2": 0.12029860401526093, + "maxAbsDelta": 508.90625 + }, + { + "stage": "layer_26", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9902793217108633, + "meanRelativeL2": 0.14080877183005214, + "maxAbsDelta": 64.25 + }, + { + "stage": "final_norm", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9874725330938514, + "meanRelativeL2": 0.1523011322133243, + "maxAbsDelta": 6.984375 + } + ], + "bos_at_s0": [ + { + "stage": "embedding", + "tokens": 1537, + "exactRows": 1537, + "meanCosine": 1, + "meanRelativeL2": 0, + "maxAbsDelta": 0 + }, + { + "stage": "layer_00", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9905310608228461, + "meanRelativeL2": 0.14540393417701125, + "maxAbsDelta": 0.28125 + }, + { + "stage": "layer_01", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9899734908214388, + "meanRelativeL2": 0.14902647864073515, + "maxAbsDelta": 0.3740234375 + }, + { + "stage": "layer_02", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9905966647507389, + "meanRelativeL2": 0.14468843303620815, + "maxAbsDelta": 0.5 + }, + { + "stage": "layer_03", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9915156176746396, + "meanRelativeL2": 0.13808333594352007, + "maxAbsDelta": 0.4375 + }, + { + "stage": "layer_04", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9931829456935553, + "meanRelativeL2": 0.12286349851638079, + "maxAbsDelta": 0.546875 + }, + { + "stage": "layer_05", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9923924711825558, + "meanRelativeL2": 0.1280195559374988, + "maxAbsDelta": 0.65625 + }, + { + "stage": "layer_06", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.992939200584347, + "meanRelativeL2": 0.12104662135243416, + "maxAbsDelta": 0.84375 + }, + { + "stage": "layer_07", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.992334475126372, + "meanRelativeL2": 0.12483719317242503, + "maxAbsDelta": 0.8125 + }, + { + "stage": "layer_08", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9915874468946736, + "meanRelativeL2": 0.1296531236730516, + "maxAbsDelta": 0.875 + }, + { + "stage": "layer_09", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9924058293706811, + "meanRelativeL2": 0.1217851648107171, + "maxAbsDelta": 1.15625 + }, + { + "stage": "layer_10", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9917043754243199, + "meanRelativeL2": 0.1265001487918198, + "maxAbsDelta": 1.4375 + }, + { + "stage": "layer_11", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9929384198294263, + "meanRelativeL2": 0.11521973181515932, + "maxAbsDelta": 1.9375 + }, + { + "stage": "layer_12", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9920087038268497, + "meanRelativeL2": 0.12231476092711091, + "maxAbsDelta": 3.0625 + }, + { + "stage": "layer_13", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9918414746000926, + "meanRelativeL2": 0.12311934446915984, + "maxAbsDelta": 3.1875 + }, + { + "stage": "layer_14", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9920692522182973, + "meanRelativeL2": 0.12110459385439754, + "maxAbsDelta": 3.0625 + }, + { + "stage": "layer_15", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9920807843015965, + "meanRelativeL2": 0.12005874095484614, + "maxAbsDelta": 3.3125 + }, + { + "stage": "layer_16", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9919948737653882, + "meanRelativeL2": 0.12028177874162793, + "maxAbsDelta": 3.25 + }, + { + "stage": "layer_17", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9924716346048269, + "meanRelativeL2": 0.11645399266853929, + "maxAbsDelta": 4 + }, + { + "stage": "layer_18", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9926294501756955, + "meanRelativeL2": 0.11428670166060328, + "maxAbsDelta": 4.3671875 + }, + { + "stage": "layer_19", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9924766993708788, + "meanRelativeL2": 0.11606868589296937, + "maxAbsDelta": 4.515625 + }, + { + "stage": "layer_20", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9927070290916681, + "meanRelativeL2": 0.11401394521817565, + "maxAbsDelta": 5.15625 + }, + { + "stage": "layer_21", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9921452617521168, + "meanRelativeL2": 0.1183754033409059, + "maxAbsDelta": 5.375 + }, + { + "stage": "layer_22", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9918372711347309, + "meanRelativeL2": 0.11890412913635373, + "maxAbsDelta": 6 + }, + { + "stage": "layer_23", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9925004018151923, + "meanRelativeL2": 0.11235564248636365, + "maxAbsDelta": 9.8125 + }, + { + "stage": "layer_24", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9925661708289489, + "meanRelativeL2": 0.11576898698695004, + "maxAbsDelta": 542.53125 + }, + { + "stage": "layer_25", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.994345393131209, + "meanRelativeL2": 0.09666740242391825, + "maxAbsDelta": 547.6875 + }, + { + "stage": "layer_26", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9948390861494477, + "meanRelativeL2": 0.09100685967132449, + "maxAbsDelta": 66.5 + }, + { + "stage": "final_norm", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9932140656780251, + "meanRelativeL2": 0.10376310441643, + "maxAbsDelta": 7.55078125 + } + ], + "bos_at_s1": [ + { + "stage": "embedding", + "tokens": 1537, + "exactRows": 1537, + "meanCosine": 1, + "meanRelativeL2": 0, + "maxAbsDelta": 0 + }, + { + "stage": "layer_00", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9916161531043193, + "meanRelativeL2": 0.1371695720590651, + "maxAbsDelta": 0.28125 + }, + { + "stage": "layer_01", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9897871118283691, + "meanRelativeL2": 0.1497314884327352, + "maxAbsDelta": 0.283203125 + }, + { + "stage": "layer_02", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9890504890086981, + "meanRelativeL2": 0.155851062387228, + "maxAbsDelta": 0.46484375 + }, + { + "stage": "layer_03", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9897284091643568, + "meanRelativeL2": 0.15129210241138935, + "maxAbsDelta": 0.5 + }, + { + "stage": "layer_04", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9914855783297477, + "meanRelativeL2": 0.13679034356027842, + "maxAbsDelta": 0.625 + }, + { + "stage": "layer_05", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9906212865104129, + "meanRelativeL2": 0.1419921857304871, + "maxAbsDelta": 0.78125 + }, + { + "stage": "layer_06", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9912765381703845, + "meanRelativeL2": 0.13424320425838232, + "maxAbsDelta": 1.09375 + }, + { + "stage": "layer_07", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9906607424972425, + "meanRelativeL2": 0.13691103039309382, + "maxAbsDelta": 0.921875 + }, + { + "stage": "layer_08", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9898841879781998, + "meanRelativeL2": 0.14126913016662002, + "maxAbsDelta": 0.984375 + }, + { + "stage": "layer_09", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9908176204874365, + "meanRelativeL2": 0.1330389860086143, + "maxAbsDelta": 1.96875 + }, + { + "stage": "layer_10", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9900243535938399, + "meanRelativeL2": 0.1379852443933487, + "maxAbsDelta": 1.75 + }, + { + "stage": "layer_11", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9914110281596187, + "meanRelativeL2": 0.12632144195958972, + "maxAbsDelta": 2.375 + }, + { + "stage": "layer_12", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9903529083565915, + "meanRelativeL2": 0.13309124717488885, + "maxAbsDelta": 2.75 + }, + { + "stage": "layer_13", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9902535940271426, + "meanRelativeL2": 0.13294092053547502, + "maxAbsDelta": 4.21875 + }, + { + "stage": "layer_14", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9905572459925749, + "meanRelativeL2": 0.1308679049834609, + "maxAbsDelta": 3.375 + }, + { + "stage": "layer_15", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9906467874095125, + "meanRelativeL2": 0.12960797222331166, + "maxAbsDelta": 3.9375 + }, + { + "stage": "layer_16", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9905522137240458, + "meanRelativeL2": 0.12959027662873268, + "maxAbsDelta": 4.4296875 + }, + { + "stage": "layer_17", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9910918136812606, + "meanRelativeL2": 0.12583672255277634, + "maxAbsDelta": 4.9140625 + }, + { + "stage": "layer_18", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.991184282434708, + "meanRelativeL2": 0.12451910367235541, + "maxAbsDelta": 6.5703125 + }, + { + "stage": "layer_19", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9909968717034637, + "meanRelativeL2": 0.12577811861410737, + "maxAbsDelta": 8.25 + }, + { + "stage": "layer_20", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9913093525244961, + "meanRelativeL2": 0.12396937888115644, + "maxAbsDelta": 7.0703125 + }, + { + "stage": "layer_21", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9907553524030984, + "meanRelativeL2": 0.12834413954988122, + "maxAbsDelta": 7.3583984375 + }, + { + "stage": "layer_22", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9905285162823342, + "meanRelativeL2": 0.12840275280177593, + "maxAbsDelta": 8.75 + }, + { + "stage": "layer_23", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9918078541678117, + "meanRelativeL2": 0.11986028775572777, + "maxAbsDelta": 14.8125 + }, + { + "stage": "layer_24", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9927823700219218, + "meanRelativeL2": 0.11138605140149593, + "maxAbsDelta": 58 + }, + { + "stage": "layer_25", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9948858311599776, + "meanRelativeL2": 0.09530238364823163, + "maxAbsDelta": 58 + }, + { + "stage": "layer_26", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.994685711144005, + "meanRelativeL2": 0.09948121523484588, + "maxAbsDelta": 74.5 + }, + { + "stage": "final_norm", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9930446012189191, + "meanRelativeL2": 0.11122636962682009, + "maxAbsDelta": 8.625 + } + ], + "x_at_s0": [ + { + "stage": "embedding", + "tokens": 1537, + "exactRows": 1537, + "meanCosine": 1, + "meanRelativeL2": 0, + "maxAbsDelta": 0 + }, + { + "stage": "layer_00", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9912487028788342, + "meanRelativeL2": 0.14065681165084243, + "maxAbsDelta": 0.296875 + }, + { + "stage": "layer_01", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9910026412934705, + "meanRelativeL2": 0.1409186371602118, + "maxAbsDelta": 0.361328125 + }, + { + "stage": "layer_02", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9906254368473666, + "meanRelativeL2": 0.1447152253240347, + "maxAbsDelta": 0.546875 + }, + { + "stage": "layer_03", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9912194356021745, + "meanRelativeL2": 0.1396624566987157, + "maxAbsDelta": 0.5703125 + }, + { + "stage": "layer_04", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9923721776042732, + "meanRelativeL2": 0.1292660259641707, + "maxAbsDelta": 0.68359375 + }, + { + "stage": "layer_05", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.991314663465099, + "meanRelativeL2": 0.1362163727171719, + "maxAbsDelta": 0.80859375 + }, + { + "stage": "layer_06", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9915831145250572, + "meanRelativeL2": 0.13237616093829274, + "maxAbsDelta": 1.46875 + }, + { + "stage": "layer_07", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9907520912495541, + "meanRelativeL2": 0.13715392397716641, + "maxAbsDelta": 1.21875 + }, + { + "stage": "layer_08", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9896609200311312, + "meanRelativeL2": 0.1444848789833486, + "maxAbsDelta": 1.65625 + }, + { + "stage": "layer_09", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9906214988689261, + "meanRelativeL2": 0.13574171718209982, + "maxAbsDelta": 2.0625 + }, + { + "stage": "layer_10", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9895962426704328, + "meanRelativeL2": 0.14143533306196332, + "maxAbsDelta": 2.40625 + }, + { + "stage": "layer_11", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9911314777608188, + "meanRelativeL2": 0.12941231625154614, + "maxAbsDelta": 3.5 + }, + { + "stage": "layer_12", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.989916208159559, + "meanRelativeL2": 0.1372022582218051, + "maxAbsDelta": 4.8125 + }, + { + "stage": "layer_13", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9895561478629699, + "meanRelativeL2": 0.13809488527476788, + "maxAbsDelta": 4.5625 + }, + { + "stage": "layer_14", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9898444432753126, + "meanRelativeL2": 0.1353558930568397, + "maxAbsDelta": 4.28125 + }, + { + "stage": "layer_15", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9899548817627136, + "meanRelativeL2": 0.1338134645484388, + "maxAbsDelta": 4.25 + }, + { + "stage": "layer_16", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9897977836192546, + "meanRelativeL2": 0.13414883241057396, + "maxAbsDelta": 4.28125 + }, + { + "stage": "layer_17", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9903329377369828, + "meanRelativeL2": 0.1305353231728077, + "maxAbsDelta": 4.75 + }, + { + "stage": "layer_18", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9905130799202928, + "meanRelativeL2": 0.1281941719353199, + "maxAbsDelta": 5.5 + }, + { + "stage": "layer_19", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.990344346306428, + "meanRelativeL2": 0.12993225222453475, + "maxAbsDelta": 4.5625 + }, + { + "stage": "layer_20", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9906660057773975, + "meanRelativeL2": 0.1280153263360262, + "maxAbsDelta": 7 + }, + { + "stage": "layer_21", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9899953917085775, + "meanRelativeL2": 0.13280894793570042, + "maxAbsDelta": 8.375 + }, + { + "stage": "layer_22", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9898093298572026, + "meanRelativeL2": 0.13281093025580049, + "maxAbsDelta": 9.375 + }, + { + "stage": "layer_23", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9911148698979876, + "meanRelativeL2": 0.12408364657312632, + "maxAbsDelta": 14 + }, + { + "stage": "layer_24", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9917528756888718, + "meanRelativeL2": 0.11558779142796993, + "maxAbsDelta": 336.828125 + }, + { + "stage": "layer_25", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.993960324129503, + "meanRelativeL2": 0.09886522917076945, + "maxAbsDelta": 338.3671875 + }, + { + "stage": "layer_26", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9943997008349109, + "meanRelativeL2": 0.09856285154819489, + "maxAbsDelta": 68.25 + }, + { + "stage": "final_norm", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9925193790886878, + "meanRelativeL2": 0.11333498079329729, + "maxAbsDelta": 8.15625 + } + ], + "x_at_s1": [ + { + "stage": "embedding", + "tokens": 1537, + "exactRows": 1537, + "meanCosine": 1, + "meanRelativeL2": 0, + "maxAbsDelta": 0 + }, + { + "stage": "layer_00", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9921616222770011, + "meanRelativeL2": 0.13338942639529705, + "maxAbsDelta": 0.3125 + }, + { + "stage": "layer_01", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9891226440183358, + "meanRelativeL2": 0.154518723487854, + "maxAbsDelta": 0.361328125 + }, + { + "stage": "layer_02", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9873158718055149, + "meanRelativeL2": 0.1682691229507327, + "maxAbsDelta": 0.5859375 + }, + { + "stage": "layer_03", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9876250262840583, + "meanRelativeL2": 0.16548986174166203, + "maxAbsDelta": 0.55859375 + }, + { + "stage": "layer_04", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9888794481870643, + "meanRelativeL2": 0.1566438302397728, + "maxAbsDelta": 0.728515625 + }, + { + "stage": "layer_05", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9872317085734574, + "meanRelativeL2": 0.16580600198358297, + "maxAbsDelta": 0.888671875 + }, + { + "stage": "layer_06", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9873037938181269, + "meanRelativeL2": 0.16218275018036366, + "maxAbsDelta": 1.28125 + }, + { + "stage": "layer_07", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.986149796511961, + "meanRelativeL2": 0.16754659451544285, + "maxAbsDelta": 1.78125 + }, + { + "stage": "layer_08", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.984661516580166, + "meanRelativeL2": 0.17571741808205843, + "maxAbsDelta": 1.8125 + }, + { + "stage": "layer_09", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9856630797190719, + "meanRelativeL2": 0.16735188383609056, + "maxAbsDelta": 2.25 + }, + { + "stage": "layer_10", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9844063717045408, + "meanRelativeL2": 0.17393207643181086, + "maxAbsDelta": 3.28125 + }, + { + "stage": "layer_11", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.98641570225581, + "meanRelativeL2": 0.16075804829597473, + "maxAbsDelta": 5.25 + }, + { + "stage": "layer_12", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9849228393977233, + "meanRelativeL2": 0.16919163055717945, + "maxAbsDelta": 6.75 + }, + { + "stage": "layer_13", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9848020629752512, + "meanRelativeL2": 0.16920572984963655, + "maxAbsDelta": 5.25 + }, + { + "stage": "layer_14", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9851722280236135, + "meanRelativeL2": 0.16702135559171438, + "maxAbsDelta": 5.5625 + }, + { + "stage": "layer_15", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9852528750857674, + "meanRelativeL2": 0.1662092744372785, + "maxAbsDelta": 5.875 + }, + { + "stage": "layer_16", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9851331300524511, + "meanRelativeL2": 0.16608077054843307, + "maxAbsDelta": 6.25 + }, + { + "stage": "layer_17", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9860594003093499, + "meanRelativeL2": 0.1615998544730246, + "maxAbsDelta": 6.53125 + }, + { + "stage": "layer_18", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9861804217429773, + "meanRelativeL2": 0.16022778488695621, + "maxAbsDelta": 8.625 + }, + { + "stage": "layer_19", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9858189701801318, + "meanRelativeL2": 0.16261915676295757, + "maxAbsDelta": 8.125 + }, + { + "stage": "layer_20", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9861356278247623, + "meanRelativeL2": 0.1620227205567062, + "maxAbsDelta": 10.0625 + }, + { + "stage": "layer_21", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9849942062067071, + "meanRelativeL2": 0.16988718276843429, + "maxAbsDelta": 10.25 + }, + { + "stage": "layer_22", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.984825845965334, + "meanRelativeL2": 0.17013862449675798, + "maxAbsDelta": 16.375 + }, + { + "stage": "layer_23", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9868230607576315, + "meanRelativeL2": 0.15913673862814903, + "maxAbsDelta": 14.5 + }, + { + "stage": "layer_24", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.98772665511189, + "meanRelativeL2": 0.15182778192684054, + "maxAbsDelta": 508.3125 + }, + { + "stage": "layer_25", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9907389262626911, + "meanRelativeL2": 0.13018729304894805, + "maxAbsDelta": 513.078125 + }, + { + "stage": "layer_26", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9902665031444895, + "meanRelativeL2": 0.1390487770549953, + "maxAbsDelta": 63.5 + }, + { + "stage": "final_norm", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9870622614101691, + "meanRelativeL2": 0.1569378967396915, + "maxAbsDelta": 4.859375 + } + ], + "period_at_s0": [ + { + "stage": "embedding", + "tokens": 1537, + "exactRows": 1537, + "meanCosine": 1, + "meanRelativeL2": 0, + "maxAbsDelta": 0 + }, + { + "stage": "layer_00", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9913677308337597, + "meanRelativeL2": 0.13959865784272552, + "maxAbsDelta": 0.3125 + }, + { + "stage": "layer_01", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9911534263471853, + "meanRelativeL2": 0.13982344418764114, + "maxAbsDelta": 0.33203125 + }, + { + "stage": "layer_02", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9906815106634513, + "meanRelativeL2": 0.1446462362073362, + "maxAbsDelta": 0.5234375 + }, + { + "stage": "layer_03", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9913112722051245, + "meanRelativeL2": 0.1387676759622991, + "maxAbsDelta": 0.55859375 + }, + { + "stage": "layer_04", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9923054571266522, + "meanRelativeL2": 0.12942433496937156, + "maxAbsDelta": 0.6826171875 + }, + { + "stage": "layer_05", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9912980949250458, + "meanRelativeL2": 0.13625301187857985, + "maxAbsDelta": 0.791015625 + }, + { + "stage": "layer_06", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9914597264341356, + "meanRelativeL2": 0.13297382602468133, + "maxAbsDelta": 1.28125 + }, + { + "stage": "layer_07", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9906365653486631, + "meanRelativeL2": 0.13781993091106415, + "maxAbsDelta": 1.21875 + }, + { + "stage": "layer_08", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9895275011416295, + "meanRelativeL2": 0.1453725416213274, + "maxAbsDelta": 1.40625 + }, + { + "stage": "layer_09", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.990560646520936, + "meanRelativeL2": 0.1366005023010075, + "maxAbsDelta": 1.625 + }, + { + "stage": "layer_10", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9897032802804538, + "meanRelativeL2": 0.14191102888435125, + "maxAbsDelta": 2.1875 + }, + { + "stage": "layer_11", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9911595838909112, + "meanRelativeL2": 0.13030020659789443, + "maxAbsDelta": 2.875 + }, + { + "stage": "layer_12", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9899704309353676, + "meanRelativeL2": 0.1380782425403595, + "maxAbsDelta": 4.15625 + }, + { + "stage": "layer_13", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9897377157490519, + "meanRelativeL2": 0.13846481684595346, + "maxAbsDelta": 5.15625 + }, + { + "stage": "layer_14", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9899931244828442, + "meanRelativeL2": 0.13577316608279943, + "maxAbsDelta": 5.1875 + }, + { + "stage": "layer_15", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9900374315586972, + "meanRelativeL2": 0.1344242268241942, + "maxAbsDelta": 4.625 + }, + { + "stage": "layer_16", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9899030202537988, + "meanRelativeL2": 0.13460144167765975, + "maxAbsDelta": 4.3125 + }, + { + "stage": "layer_17", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9904399328442774, + "meanRelativeL2": 0.13083440531045198, + "maxAbsDelta": 4.25 + }, + { + "stage": "layer_18", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.990607984436745, + "meanRelativeL2": 0.12857991131022573, + "maxAbsDelta": 6 + }, + { + "stage": "layer_19", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9904838290087341, + "meanRelativeL2": 0.13026659796014428, + "maxAbsDelta": 6.25 + }, + { + "stage": "layer_20", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9908316717879991, + "meanRelativeL2": 0.12793055223301053, + "maxAbsDelta": 6.5 + }, + { + "stage": "layer_21", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9901581769960611, + "meanRelativeL2": 0.13237037044018507, + "maxAbsDelta": 8 + }, + { + "stage": "layer_22", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9899658100048132, + "meanRelativeL2": 0.13250939780846238, + "maxAbsDelta": 9.75 + }, + { + "stage": "layer_23", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9912239337169123, + "meanRelativeL2": 0.12398684304207563, + "maxAbsDelta": 12.5 + }, + { + "stage": "layer_24", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9916742700373266, + "meanRelativeL2": 0.11640575202181935, + "maxAbsDelta": 336.765625 + }, + { + "stage": "layer_25", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9939006833806779, + "meanRelativeL2": 0.09944069408811629, + "maxAbsDelta": 338.28125 + }, + { + "stage": "layer_26", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.994291977441846, + "meanRelativeL2": 0.09839509148150682, + "maxAbsDelta": 64.5 + }, + { + "stage": "final_norm", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9925206691782895, + "meanRelativeL2": 0.11367968819104135, + "maxAbsDelta": 8.171875 + } + ], + "period_at_s1": [ + { + "stage": "embedding", + "tokens": 1537, + "exactRows": 1537, + "meanCosine": 1, + "meanRelativeL2": 0, + "maxAbsDelta": 0 + }, + { + "stage": "layer_00", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9922365242192399, + "meanRelativeL2": 0.13263636687770486, + "maxAbsDelta": 0.328125 + }, + { + "stage": "layer_01", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9892073139480437, + "meanRelativeL2": 0.15368623193353415, + "maxAbsDelta": 0.3515625 + }, + { + "stage": "layer_02", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9873156044183804, + "meanRelativeL2": 0.16817105188965797, + "maxAbsDelta": 0.5703125 + }, + { + "stage": "layer_03", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9875148849667243, + "meanRelativeL2": 0.16567408945411444, + "maxAbsDelta": 0.57421875 + }, + { + "stage": "layer_04", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.988684248482165, + "meanRelativeL2": 0.15744845429435372, + "maxAbsDelta": 0.7734375 + }, + { + "stage": "layer_05", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.987085975100642, + "meanRelativeL2": 0.16655867919325829, + "maxAbsDelta": 0.9765625 + }, + { + "stage": "layer_06", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9869693501785194, + "meanRelativeL2": 0.16439994145184755, + "maxAbsDelta": 1.3095703125 + }, + { + "stage": "layer_07", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9858203111876895, + "meanRelativeL2": 0.16989469528198242, + "maxAbsDelta": 1.5 + }, + { + "stage": "layer_08", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9845106013424613, + "meanRelativeL2": 0.17714062053710222, + "maxAbsDelta": 1.5625 + }, + { + "stage": "layer_09", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9858082986219253, + "meanRelativeL2": 0.16744133923202753, + "maxAbsDelta": 1.96875 + }, + { + "stage": "layer_10", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9846719586003811, + "meanRelativeL2": 0.17404363863170147, + "maxAbsDelta": 3.1875 + }, + { + "stage": "layer_11", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9866424700852409, + "meanRelativeL2": 0.16121394699439406, + "maxAbsDelta": 5.3125 + }, + { + "stage": "layer_12", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9851258467293903, + "meanRelativeL2": 0.17011642176657915, + "maxAbsDelta": 6.78125 + }, + { + "stage": "layer_13", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9850540166949792, + "meanRelativeL2": 0.17014211136847734, + "maxAbsDelta": 5.9375 + }, + { + "stage": "layer_14", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9853125570575836, + "meanRelativeL2": 0.16862528678029776, + "maxAbsDelta": 5.84375 + }, + { + "stage": "layer_15", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9852848308149994, + "meanRelativeL2": 0.1681548785418272, + "maxAbsDelta": 6.46875 + }, + { + "stage": "layer_16", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9852509769279614, + "meanRelativeL2": 0.16798654524609447, + "maxAbsDelta": 6.4375 + }, + { + "stage": "layer_17", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9861871432234268, + "meanRelativeL2": 0.16316866362467408, + "maxAbsDelta": 7.5 + }, + { + "stage": "layer_18", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9862177442558105, + "meanRelativeL2": 0.16224791901186109, + "maxAbsDelta": 8.6875 + }, + { + "stage": "layer_19", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9860598866863536, + "meanRelativeL2": 0.1639427193440497, + "maxAbsDelta": 9.75 + }, + { + "stage": "layer_20", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9862555542314836, + "meanRelativeL2": 0.16424277517944574, + "maxAbsDelta": 10 + }, + { + "stage": "layer_21", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9851655210468314, + "meanRelativeL2": 0.17159152682870626, + "maxAbsDelta": 12 + }, + { + "stage": "layer_22", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9849589154870773, + "meanRelativeL2": 0.1720419297926128, + "maxAbsDelta": 14.875 + }, + { + "stage": "layer_23", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9868503496409549, + "meanRelativeL2": 0.16081331530585885, + "maxAbsDelta": 18.25 + }, + { + "stage": "layer_24", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9877277420725851, + "meanRelativeL2": 0.15351457288488746, + "maxAbsDelta": 502.3125 + }, + { + "stage": "layer_25", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9907616865115269, + "meanRelativeL2": 0.1313898889347911, + "maxAbsDelta": 507.078125 + }, + { + "stage": "layer_26", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.990635792970192, + "meanRelativeL2": 0.14024129882454872, + "maxAbsDelta": 88 + }, + { + "stage": "final_norm", + "tokens": 1537, + "exactRows": 0, + "meanCosine": 0.9875410248803566, + "meanRelativeL2": 0.15810229536145926, + "maxAbsDelta": 4.65625 + } + ] + }, + "english": { + "system_eos": [ + { + "stage": "embedding", + "tokens": 660, + "exactRows": 660, + "meanCosine": 1, + "meanRelativeL2": 0, + "maxAbsDelta": 0 + }, + { + "stage": "layer_00", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9998383744196458, + "meanRelativeL2": 0.017410974483937025, + "maxAbsDelta": 0.171875 + }, + { + "stage": "layer_01", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9994762240034161, + "meanRelativeL2": 0.030672501772642136, + "maxAbsDelta": 0.1328125 + }, + { + "stage": "layer_02", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.999213816631924, + "meanRelativeL2": 0.03861169330775738, + "maxAbsDelta": 0.2109375 + }, + { + "stage": "layer_03", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9991166881539605, + "meanRelativeL2": 0.040376429446041584, + "maxAbsDelta": 0.171875 + }, + { + "stage": "layer_04", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9990538520343376, + "meanRelativeL2": 0.041052467189729214, + "maxAbsDelta": 0.169921875 + }, + { + "stage": "layer_05", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.998628026969505, + "meanRelativeL2": 0.05014906544238329, + "maxAbsDelta": 0.3515625 + }, + { + "stage": "layer_06", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9983556415095474, + "meanRelativeL2": 0.05456127133220434, + "maxAbsDelta": 0.53125 + }, + { + "stage": "layer_07", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9980245154915434, + "meanRelativeL2": 0.05873462185263634, + "maxAbsDelta": 0.9375 + }, + { + "stage": "layer_08", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9973916827729254, + "meanRelativeL2": 0.06657726876437664, + "maxAbsDelta": 1 + }, + { + "stage": "layer_09", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9975100913734147, + "meanRelativeL2": 0.06518307235091925, + "maxAbsDelta": 1.09375 + }, + { + "stage": "layer_10", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9970151282621152, + "meanRelativeL2": 0.07145565189421177, + "maxAbsDelta": 1.1875 + }, + { + "stage": "layer_11", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.997385343096473, + "meanRelativeL2": 0.06776400376111269, + "maxAbsDelta": 1.625 + }, + { + "stage": "layer_12", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9969345520843159, + "meanRelativeL2": 0.0733747174963355, + "maxAbsDelta": 1.125 + }, + { + "stage": "layer_13", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9968199432799311, + "meanRelativeL2": 0.0745116975158453, + "maxAbsDelta": 1.46875 + }, + { + "stage": "layer_14", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9968465224359975, + "meanRelativeL2": 0.07441916409879923, + "maxAbsDelta": 1.5 + }, + { + "stage": "layer_15", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9967747311700474, + "meanRelativeL2": 0.0753285102546215, + "maxAbsDelta": 1.5625 + }, + { + "stage": "layer_16", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9966872644243818, + "meanRelativeL2": 0.07618360593914986, + "maxAbsDelta": 1.515625 + }, + { + "stage": "layer_17", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.996803451126272, + "meanRelativeL2": 0.07446411810815334, + "maxAbsDelta": 1.890625 + }, + { + "stage": "layer_18", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9967479542349325, + "meanRelativeL2": 0.07464642077684402, + "maxAbsDelta": 2.9375 + }, + { + "stage": "layer_19", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9966599351528919, + "meanRelativeL2": 0.07554458919912577, + "maxAbsDelta": 4.296875 + }, + { + "stage": "layer_20", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9966401009848623, + "meanRelativeL2": 0.07580786664038897, + "maxAbsDelta": 6.4375 + }, + { + "stage": "layer_21", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.996322930671952, + "meanRelativeL2": 0.07989191450178623, + "maxAbsDelta": 6.25 + }, + { + "stage": "layer_22", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9962928446856412, + "meanRelativeL2": 0.0800821790471673, + "maxAbsDelta": 10.375 + }, + { + "stage": "layer_23", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.996691871953733, + "meanRelativeL2": 0.07648127805441618, + "maxAbsDelta": 11 + }, + { + "stage": "layer_24", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9966873084053849, + "meanRelativeL2": 0.07220007106661797, + "maxAbsDelta": 126 + }, + { + "stage": "layer_25", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9973883580077778, + "meanRelativeL2": 0.06486429180949926, + "maxAbsDelta": 126 + }, + { + "stage": "layer_26", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9971792942646778, + "meanRelativeL2": 0.0732917869463563, + "maxAbsDelta": 39 + }, + { + "stage": "final_norm", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9963571273919308, + "meanRelativeL2": 0.0761182103306055, + "maxAbsDelta": 4.1015625 + } + ], + "system_bos": [ + { + "stage": "embedding", + "tokens": 660, + "exactRows": 660, + "meanCosine": 1, + "meanRelativeL2": 0, + "maxAbsDelta": 0 + }, + { + "stage": "layer_00", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9997192162455935, + "meanRelativeL2": 0.023205887991935015, + "maxAbsDelta": 0.16015625 + }, + { + "stage": "layer_01", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9974225026188475, + "meanRelativeL2": 0.06833389680832624, + "maxAbsDelta": 0.2421875 + }, + { + "stage": "layer_02", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9968300814881469, + "meanRelativeL2": 0.07796961814165115, + "maxAbsDelta": 0.23828125 + }, + { + "stage": "layer_03", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9967446819399343, + "meanRelativeL2": 0.07967397756874561, + "maxAbsDelta": 0.28125 + }, + { + "stage": "layer_04", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.996901514674678, + "meanRelativeL2": 0.0780675858259201, + "maxAbsDelta": 0.34375 + }, + { + "stage": "layer_05", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9962158933733449, + "meanRelativeL2": 0.08573543094098568, + "maxAbsDelta": 0.4375 + }, + { + "stage": "layer_06", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.996063910108624, + "meanRelativeL2": 0.08698566071689129, + "maxAbsDelta": 0.53125 + }, + { + "stage": "layer_07", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9954929341872533, + "meanRelativeL2": 0.09211955592036247, + "maxAbsDelta": 1.1875 + }, + { + "stage": "layer_08", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9947244932254156, + "meanRelativeL2": 0.09917301312088966, + "maxAbsDelta": 1.28125 + }, + { + "stage": "layer_09", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9952118161952856, + "meanRelativeL2": 0.09401226602494717, + "maxAbsDelta": 1.65625 + }, + { + "stage": "layer_10", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9945029446572968, + "meanRelativeL2": 0.10065455734729767, + "maxAbsDelta": 1.84375 + }, + { + "stage": "layer_11", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9953573844649575, + "meanRelativeL2": 0.09262942895293236, + "maxAbsDelta": 2.25 + }, + { + "stage": "layer_12", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9946180834011598, + "meanRelativeL2": 0.09937872923910618, + "maxAbsDelta": 2.5625 + }, + { + "stage": "layer_13", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9943706622629455, + "meanRelativeL2": 0.10117910616099834, + "maxAbsDelta": 2.5625 + }, + { + "stage": "layer_14", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9946374105684685, + "meanRelativeL2": 0.09933209978044033, + "maxAbsDelta": 2.75 + }, + { + "stage": "layer_15", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9946491215265159, + "meanRelativeL2": 0.09930861927568913, + "maxAbsDelta": 2.5 + }, + { + "stage": "layer_16", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9946027209361394, + "meanRelativeL2": 0.10001024417579174, + "maxAbsDelta": 2.625 + }, + { + "stage": "layer_17", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9948238120837645, + "meanRelativeL2": 0.09782304242253304, + "maxAbsDelta": 2.5625 + }, + { + "stage": "layer_18", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9948582189552712, + "meanRelativeL2": 0.09734773635864258, + "maxAbsDelta": 3.359375 + }, + { + "stage": "layer_19", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9946840558991288, + "meanRelativeL2": 0.09840172901749611, + "maxAbsDelta": 4.640625 + }, + { + "stage": "layer_20", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.994781904148333, + "meanRelativeL2": 0.09754860401153564, + "maxAbsDelta": 7.5625 + }, + { + "stage": "layer_21", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9943855776931301, + "meanRelativeL2": 0.10152490064501762, + "maxAbsDelta": 6.875 + }, + { + "stage": "layer_22", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9942694970152595, + "meanRelativeL2": 0.10248343460261822, + "maxAbsDelta": 11.1875 + }, + { + "stage": "layer_23", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9944983857147621, + "meanRelativeL2": 0.09886816516518593, + "maxAbsDelta": 13 + }, + { + "stage": "layer_24", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9943548513181282, + "meanRelativeL2": 0.09946427121758461, + "maxAbsDelta": 536.9375 + }, + { + "stage": "layer_25", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.995153799291813, + "meanRelativeL2": 0.0899738222360611, + "maxAbsDelta": 542.34375 + }, + { + "stage": "layer_26", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9946823251969886, + "meanRelativeL2": 0.09886824525892735, + "maxAbsDelta": 74.5 + }, + { + "stage": "final_norm", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9934608902895089, + "meanRelativeL2": 0.10028192587196827, + "maxAbsDelta": 4.375 + } + ], + "system_x": [ + { + "stage": "embedding", + "tokens": 660, + "exactRows": 660, + "meanCosine": 1, + "meanRelativeL2": 0, + "maxAbsDelta": 0 + }, + { + "stage": "layer_00", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9997239772117499, + "meanRelativeL2": 0.023387102875858545, + "maxAbsDelta": 0.15625 + }, + { + "stage": "layer_01", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9964189237717426, + "meanRelativeL2": 0.07988259755074978, + "maxAbsDelta": 0.2578125 + }, + { + "stage": "layer_02", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9955780830347176, + "meanRelativeL2": 0.09158097393810749, + "maxAbsDelta": 0.3125 + }, + { + "stage": "layer_03", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9952502245252782, + "meanRelativeL2": 0.09482170827686787, + "maxAbsDelta": 0.40625 + }, + { + "stage": "layer_04", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9952570882710543, + "meanRelativeL2": 0.09546027705073357, + "maxAbsDelta": 0.380859375 + }, + { + "stage": "layer_05", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.994035160089984, + "meanRelativeL2": 0.10660291090607643, + "maxAbsDelta": 0.46875 + }, + { + "stage": "layer_06", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.993471180399259, + "meanRelativeL2": 0.11099451221525669, + "maxAbsDelta": 0.8125 + }, + { + "stage": "layer_07", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9926211858337576, + "meanRelativeL2": 0.11689208075404167, + "maxAbsDelta": 0.59375 + }, + { + "stage": "layer_08", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9912498670093941, + "meanRelativeL2": 0.1273498572409153, + "maxAbsDelta": 0.90625 + }, + { + "stage": "layer_09", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.991580946337093, + "meanRelativeL2": 0.12384228780865669, + "maxAbsDelta": 1.265625 + }, + { + "stage": "layer_10", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9904530708536957, + "meanRelativeL2": 0.13212950341403484, + "maxAbsDelta": 1.375 + }, + { + "stage": "layer_11", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9915137207869328, + "meanRelativeL2": 0.12423164211213589, + "maxAbsDelta": 1.75 + }, + { + "stage": "layer_12", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9901788537249421, + "meanRelativeL2": 0.13241401128470898, + "maxAbsDelta": 3.1875 + }, + { + "stage": "layer_13", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9896989176670711, + "meanRelativeL2": 0.13373020850121975, + "maxAbsDelta": 3 + }, + { + "stage": "layer_14", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9898144227988792, + "meanRelativeL2": 0.13306442834436893, + "maxAbsDelta": 2.5 + }, + { + "stage": "layer_15", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9898171365261078, + "meanRelativeL2": 0.13355082646012306, + "maxAbsDelta": 3.25 + }, + { + "stage": "layer_16", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9896981074954524, + "meanRelativeL2": 0.13448631949722767, + "maxAbsDelta": 2.828125 + }, + { + "stage": "layer_17", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9901533691268979, + "meanRelativeL2": 0.1311669871211052, + "maxAbsDelta": 4 + }, + { + "stage": "layer_18", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9900735102819674, + "meanRelativeL2": 0.13088831678032875, + "maxAbsDelta": 4.25 + }, + { + "stage": "layer_19", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9899596641461055, + "meanRelativeL2": 0.13149518705904484, + "maxAbsDelta": 8.0625 + }, + { + "stage": "layer_20", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9900715464895422, + "meanRelativeL2": 0.1316900420933962, + "maxAbsDelta": 6.625 + }, + { + "stage": "layer_21", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.989259186296752, + "meanRelativeL2": 0.1382054928690195, + "maxAbsDelta": 6.9375 + }, + { + "stage": "layer_22", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9891867727041245, + "meanRelativeL2": 0.13852321542799473, + "maxAbsDelta": 7 + }, + { + "stage": "layer_23", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9899367574489478, + "meanRelativeL2": 0.13268372789025307, + "maxAbsDelta": 12.625 + }, + { + "stage": "layer_24", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9893785879467473, + "meanRelativeL2": 0.1394543219357729, + "maxAbsDelta": 509 + }, + { + "stage": "layer_25", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9910178195346485, + "meanRelativeL2": 0.12179666012525558, + "maxAbsDelta": 514.421875 + }, + { + "stage": "layer_26", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9901476086089105, + "meanRelativeL2": 0.14056963473558426, + "maxAbsDelta": 54 + }, + { + "stage": "final_norm", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9881591202634754, + "meanRelativeL2": 0.14390143007040024, + "maxAbsDelta": 5.8671875 + } + ], + "system_period": [ + { + "stage": "embedding", + "tokens": 660, + "exactRows": 660, + "meanCosine": 1, + "meanRelativeL2": 0, + "maxAbsDelta": 0 + }, + { + "stage": "layer_00", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9997404913107554, + "meanRelativeL2": 0.022662337869405746, + "maxAbsDelta": 0.16015625 + }, + { + "stage": "layer_01", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9965431002956449, + "meanRelativeL2": 0.07840682193636894, + "maxAbsDelta": 0.2421875 + }, + { + "stage": "layer_02", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9957620826634493, + "meanRelativeL2": 0.08970174752175808, + "maxAbsDelta": 0.2734375 + }, + { + "stage": "layer_03", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.995425732569261, + "meanRelativeL2": 0.09281333722174168, + "maxAbsDelta": 0.3125 + }, + { + "stage": "layer_04", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9953061600526174, + "meanRelativeL2": 0.09499243274331093, + "maxAbsDelta": 0.37109375 + }, + { + "stage": "layer_05", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9940027855562441, + "meanRelativeL2": 0.1071258932352066, + "maxAbsDelta": 0.421875 + }, + { + "stage": "layer_06", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9932774448033536, + "meanRelativeL2": 0.11286675930023193, + "maxAbsDelta": 1 + }, + { + "stage": "layer_07", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9924143925760731, + "meanRelativeL2": 0.11916903965175152, + "maxAbsDelta": 0.96875 + }, + { + "stage": "layer_08", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9910504044908466, + "meanRelativeL2": 0.1293829306960106, + "maxAbsDelta": 1.125 + }, + { + "stage": "layer_09", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9915446070107546, + "meanRelativeL2": 0.12528078071773052, + "maxAbsDelta": 1.3125 + }, + { + "stage": "layer_10", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9905004119331187, + "meanRelativeL2": 0.13345904648303986, + "maxAbsDelta": 1.40625 + }, + { + "stage": "layer_11", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9914659447742231, + "meanRelativeL2": 0.12660309113562107, + "maxAbsDelta": 1.875 + }, + { + "stage": "layer_12", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9902609751983122, + "meanRelativeL2": 0.13450899720191956, + "maxAbsDelta": 3.0625 + }, + { + "stage": "layer_13", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9899752218614924, + "meanRelativeL2": 0.1354039330035448, + "maxAbsDelta": 2.6875 + }, + { + "stage": "layer_14", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9900178347573135, + "meanRelativeL2": 0.1347039509564638, + "maxAbsDelta": 2.46875 + }, + { + "stage": "layer_15", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9899974755265496, + "meanRelativeL2": 0.13542243093252182, + "maxAbsDelta": 2.40625 + }, + { + "stage": "layer_16", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9898908093120112, + "meanRelativeL2": 0.13643186539411545, + "maxAbsDelta": 3.5625 + }, + { + "stage": "layer_17", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9903253381902521, + "meanRelativeL2": 0.13333946466445923, + "maxAbsDelta": 3.5 + }, + { + "stage": "layer_18", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9901665495200591, + "meanRelativeL2": 0.13395525701344013, + "maxAbsDelta": 3.5 + }, + { + "stage": "layer_19", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9900693108638128, + "meanRelativeL2": 0.1347117070108652, + "maxAbsDelta": 5.875 + }, + { + "stage": "layer_20", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9899683663339326, + "meanRelativeL2": 0.13680052012205124, + "maxAbsDelta": 4.875 + }, + { + "stage": "layer_21", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9889380550745762, + "meanRelativeL2": 0.14400805346667767, + "maxAbsDelta": 7.25 + }, + { + "stage": "layer_22", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9888275150999878, + "meanRelativeL2": 0.1443861722946167, + "maxAbsDelta": 6.25 + }, + { + "stage": "layer_23", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9895560896757877, + "meanRelativeL2": 0.1379630733281374, + "maxAbsDelta": 13.5 + }, + { + "stage": "layer_24", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9886430548899101, + "meanRelativeL2": 0.14611458964645863, + "maxAbsDelta": 503.21875 + }, + { + "stage": "layer_25", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9905086934566498, + "meanRelativeL2": 0.1265154965221882, + "maxAbsDelta": 508.90625 + }, + { + "stage": "layer_26", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9901488282463767, + "meanRelativeL2": 0.14424989186227322, + "maxAbsDelta": 60.5 + }, + { + "stage": "final_norm", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9880861494577292, + "meanRelativeL2": 0.1466124840080738, + "maxAbsDelta": 6.1953125 + } + ], + "bos_at_s0": [ + { + "stage": "embedding", + "tokens": 660, + "exactRows": 660, + "meanCosine": 1, + "meanRelativeL2": 0, + "maxAbsDelta": 0 + }, + { + "stage": "layer_00", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9916613664590951, + "meanRelativeL2": 0.13167561404407024, + "maxAbsDelta": 0.265625 + }, + { + "stage": "layer_01", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9912885572874185, + "meanRelativeL2": 0.13477948680520058, + "maxAbsDelta": 0.25 + }, + { + "stage": "layer_02", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9919971543731112, + "meanRelativeL2": 0.13150629587471485, + "maxAbsDelta": 0.3046875 + }, + { + "stage": "layer_03", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9926733589533604, + "meanRelativeL2": 0.12598542869091034, + "maxAbsDelta": 0.296875 + }, + { + "stage": "layer_04", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.994018344355352, + "meanRelativeL2": 0.11349336430430412, + "maxAbsDelta": 0.46875 + }, + { + "stage": "layer_05", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9932138824101651, + "meanRelativeL2": 0.12019945681095123, + "maxAbsDelta": 0.484375 + }, + { + "stage": "layer_06", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9934748133926681, + "meanRelativeL2": 0.11636726185679436, + "maxAbsDelta": 0.53125 + }, + { + "stage": "layer_07", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9927909157492898, + "meanRelativeL2": 0.12097947113215923, + "maxAbsDelta": 0.8125 + }, + { + "stage": "layer_08", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9920535720659025, + "meanRelativeL2": 0.12666113302111626, + "maxAbsDelta": 0.78125 + }, + { + "stage": "layer_09", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9929217110077541, + "meanRelativeL2": 0.1196605134755373, + "maxAbsDelta": 0.875 + }, + { + "stage": "layer_10", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9922487860376185, + "meanRelativeL2": 0.1256364993751049, + "maxAbsDelta": 1.25 + }, + { + "stage": "layer_11", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9937053628943183, + "meanRelativeL2": 0.11245799250900745, + "maxAbsDelta": 1.625 + }, + { + "stage": "layer_12", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9928885890678926, + "meanRelativeL2": 0.11916589923202991, + "maxAbsDelta": 1.75 + }, + { + "stage": "layer_13", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9928420446135781, + "meanRelativeL2": 0.11974689178168774, + "maxAbsDelta": 2.46875 + }, + { + "stage": "layer_14", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9932601893490011, + "meanRelativeL2": 0.11648978665471077, + "maxAbsDelta": 2.8125 + }, + { + "stage": "layer_15", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9933878444360964, + "meanRelativeL2": 0.11541983857750893, + "maxAbsDelta": 3.3125 + }, + { + "stage": "layer_16", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9933733624942375, + "meanRelativeL2": 0.1158029306679964, + "maxAbsDelta": 2.6875 + }, + { + "stage": "layer_17", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9937556435664495, + "meanRelativeL2": 0.11210096254944801, + "maxAbsDelta": 3.125 + }, + { + "stage": "layer_18", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9939805956500949, + "meanRelativeL2": 0.10987625643610954, + "maxAbsDelta": 2.875 + }, + { + "stage": "layer_19", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9937332233696273, + "meanRelativeL2": 0.11160730011761189, + "maxAbsDelta": 2.375 + }, + { + "stage": "layer_20", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.99393221365683, + "meanRelativeL2": 0.10967269539833069, + "maxAbsDelta": 4.3125 + }, + { + "stage": "layer_21", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9934939086437226, + "meanRelativeL2": 0.1139211505651474, + "maxAbsDelta": 5.375 + }, + { + "stage": "layer_22", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9934386655236735, + "meanRelativeL2": 0.11390647664666176, + "maxAbsDelta": 6 + }, + { + "stage": "layer_23", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9934761185537685, + "meanRelativeL2": 0.11083511635661125, + "maxAbsDelta": 9.8125 + }, + { + "stage": "layer_24", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9934115392692161, + "meanRelativeL2": 0.1481393426656723, + "maxAbsDelta": 542.53125 + }, + { + "stage": "layer_25", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9946754744558624, + "meanRelativeL2": 0.11903809569776058, + "maxAbsDelta": 547.6875 + }, + { + "stage": "layer_26", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9947162693197077, + "meanRelativeL2": 0.1007002592086792, + "maxAbsDelta": 46.5 + }, + { + "stage": "final_norm", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9933254346703038, + "meanRelativeL2": 0.10621745139360428, + "maxAbsDelta": 4.671875 + } + ], + "bos_at_s1": [ + { + "stage": "embedding", + "tokens": 660, + "exactRows": 660, + "meanCosine": 1, + "meanRelativeL2": 0, + "maxAbsDelta": 0 + }, + { + "stage": "layer_00", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.992711300109372, + "meanRelativeL2": 0.12319199927151203, + "maxAbsDelta": 0.28125 + }, + { + "stage": "layer_01", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9910400957772226, + "meanRelativeL2": 0.13497466780245304, + "maxAbsDelta": 0.24609375 + }, + { + "stage": "layer_02", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9904259523659041, + "meanRelativeL2": 0.1416977010667324, + "maxAbsDelta": 0.392578125 + }, + { + "stage": "layer_03", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9908601149465098, + "meanRelativeL2": 0.1390330120921135, + "maxAbsDelta": 0.4140625 + }, + { + "stage": "layer_04", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9922524538907138, + "meanRelativeL2": 0.12754570879042149, + "maxAbsDelta": 0.4375 + }, + { + "stage": "layer_05", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9914395447933313, + "meanRelativeL2": 0.13350411504507065, + "maxAbsDelta": 0.6640625 + }, + { + "stage": "layer_06", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9916897473913251, + "meanRelativeL2": 0.13014104217290878, + "maxAbsDelta": 0.71875 + }, + { + "stage": "layer_07", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9910238738312865, + "meanRelativeL2": 0.13397183641791344, + "maxAbsDelta": 0.640625 + }, + { + "stage": "layer_08", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9902354835560827, + "meanRelativeL2": 0.13988076150417328, + "maxAbsDelta": 0.96875 + }, + { + "stage": "layer_09", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.991231966470227, + "meanRelativeL2": 0.13288544304668903, + "maxAbsDelta": 1.28125 + }, + { + "stage": "layer_10", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9904712922645338, + "meanRelativeL2": 0.13917524181306362, + "maxAbsDelta": 1.5 + }, + { + "stage": "layer_11", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9921704950657758, + "meanRelativeL2": 0.12533525750041008, + "maxAbsDelta": 2.375 + }, + { + "stage": "layer_12", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9912152183778358, + "meanRelativeL2": 0.13249659724533558, + "maxAbsDelta": 2.6875 + }, + { + "stage": "layer_13", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9912483252359159, + "meanRelativeL2": 0.13234966062009335, + "maxAbsDelta": 3.0625 + }, + { + "stage": "layer_14", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9917907558607333, + "meanRelativeL2": 0.1284463331103325, + "maxAbsDelta": 3.375 + }, + { + "stage": "layer_15", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9919598659782699, + "meanRelativeL2": 0.12734460085630417, + "maxAbsDelta": 3.625 + }, + { + "stage": "layer_16", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.991950790087382, + "meanRelativeL2": 0.12759715504944324, + "maxAbsDelta": 3.25 + }, + { + "stage": "layer_17", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9923782121954542, + "meanRelativeL2": 0.12410886026918888, + "maxAbsDelta": 3 + }, + { + "stage": "layer_18", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.992478874054822, + "meanRelativeL2": 0.12319638952612877, + "maxAbsDelta": 3.625 + }, + { + "stage": "layer_19", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9923802457975619, + "meanRelativeL2": 0.12402922287583351, + "maxAbsDelta": 3.625 + }, + { + "stage": "layer_20", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9925677145069296, + "meanRelativeL2": 0.12220226973295212, + "maxAbsDelta": 5.25 + }, + { + "stage": "layer_21", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9921939170721805, + "meanRelativeL2": 0.12603248469531536, + "maxAbsDelta": 5 + }, + { + "stage": "layer_22", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.992107999866659, + "meanRelativeL2": 0.1261014509946108, + "maxAbsDelta": 6.375 + }, + { + "stage": "layer_23", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9929408652312828, + "meanRelativeL2": 0.11985820345580578, + "maxAbsDelta": 14.8125 + }, + { + "stage": "layer_24", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9934448835524645, + "meanRelativeL2": 0.11312815174460411, + "maxAbsDelta": 58 + }, + { + "stage": "layer_25", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9950972598610502, + "meanRelativeL2": 0.0996815375983715, + "maxAbsDelta": 58 + }, + { + "stage": "layer_26", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9947499640963294, + "meanRelativeL2": 0.11006934009492397, + "maxAbsDelta": 50.5 + }, + { + "stage": "final_norm", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9937070602720434, + "meanRelativeL2": 0.11509563587605953, + "maxAbsDelta": 4.375 + } + ], + "x_at_s0": [ + { + "stage": "embedding", + "tokens": 660, + "exactRows": 660, + "meanCosine": 1, + "meanRelativeL2": 0, + "maxAbsDelta": 0 + }, + { + "stage": "layer_00", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9923507731972319, + "meanRelativeL2": 0.12615713477134705, + "maxAbsDelta": 0.296875 + }, + { + "stage": "layer_01", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9923896485205853, + "meanRelativeL2": 0.1254491824656725, + "maxAbsDelta": 0.29296875 + }, + { + "stage": "layer_02", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9924908743663268, + "meanRelativeL2": 0.1264837346971035, + "maxAbsDelta": 0.388671875 + }, + { + "stage": "layer_03", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9930206453258341, + "meanRelativeL2": 0.12178868055343628, + "maxAbsDelta": 0.38671875 + }, + { + "stage": "layer_04", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9939318548549305, + "meanRelativeL2": 0.11268832720816135, + "maxAbsDelta": 0.46484375 + }, + { + "stage": "layer_05", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9929863275903644, + "meanRelativeL2": 0.11996766179800034, + "maxAbsDelta": 0.65625 + }, + { + "stage": "layer_06", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9928465015960463, + "meanRelativeL2": 0.11985529959201813, + "maxAbsDelta": 0.734375 + }, + { + "stage": "layer_07", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9920144413456772, + "meanRelativeL2": 0.12490621581673622, + "maxAbsDelta": 1.21875 + }, + { + "stage": "layer_08", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9908812330527739, + "meanRelativeL2": 0.13313623145222664, + "maxAbsDelta": 1.65625 + }, + { + "stage": "layer_09", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9917166728865017, + "meanRelativeL2": 0.12683211080729961, + "maxAbsDelta": 2.0625 + }, + { + "stage": "layer_10", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.990354025183302, + "meanRelativeL2": 0.13628951832652092, + "maxAbsDelta": 2.40625 + }, + { + "stage": "layer_11", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9919147240393089, + "meanRelativeL2": 0.12385286949574947, + "maxAbsDelta": 3.5 + }, + { + "stage": "layer_12", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9906002487197066, + "meanRelativeL2": 0.13225219026207924, + "maxAbsDelta": 4.8125 + }, + { + "stage": "layer_13", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9900670341470025, + "meanRelativeL2": 0.13398647122085094, + "maxAbsDelta": 4.5625 + }, + { + "stage": "layer_14", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9904925030289274, + "meanRelativeL2": 0.13064230792224407, + "maxAbsDelta": 4.28125 + }, + { + "stage": "layer_15", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9906365110115571, + "meanRelativeL2": 0.12950710766017437, + "maxAbsDelta": 4.25 + }, + { + "stage": "layer_16", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9905347376158743, + "meanRelativeL2": 0.12995304353535175, + "maxAbsDelta": 4.28125 + }, + { + "stage": "layer_17", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9909037546678023, + "meanRelativeL2": 0.12618041411042213, + "maxAbsDelta": 4.75 + }, + { + "stage": "layer_18", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9910667826731999, + "meanRelativeL2": 0.12377023883163929, + "maxAbsDelta": 4.3125 + }, + { + "stage": "layer_19", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9908064213666049, + "meanRelativeL2": 0.12509087473154068, + "maxAbsDelta": 4.5625 + }, + { + "stage": "layer_20", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9911261106079275, + "meanRelativeL2": 0.12306488119065762, + "maxAbsDelta": 5.5 + }, + { + "stage": "layer_21", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9905118427493356, + "meanRelativeL2": 0.12798877991735935, + "maxAbsDelta": 7 + }, + { + "stage": "layer_22", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9904056239308733, + "meanRelativeL2": 0.12789402529597282, + "maxAbsDelta": 9.375 + }, + { + "stage": "layer_23", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9915188322464625, + "meanRelativeL2": 0.12077665887773037, + "maxAbsDelta": 9.75 + }, + { + "stage": "layer_24", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.992468945907824, + "meanRelativeL2": 0.11363924294710159, + "maxAbsDelta": 124 + }, + { + "stage": "layer_25", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9942773029659734, + "meanRelativeL2": 0.09989927522838116, + "maxAbsDelta": 124 + }, + { + "stage": "layer_26", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9939814194585338, + "meanRelativeL2": 0.10673405788838863, + "maxAbsDelta": 45.5 + }, + { + "stage": "final_norm", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9923824751918966, + "meanRelativeL2": 0.11294566094875336, + "maxAbsDelta": 3.84375 + } + ], + "x_at_s1": [ + { + "stage": "embedding", + "tokens": 660, + "exactRows": 660, + "meanCosine": 1, + "meanRelativeL2": 0, + "maxAbsDelta": 0 + }, + { + "stage": "layer_00", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9932849685351054, + "meanRelativeL2": 0.11826690100133419, + "maxAbsDelta": 0.3125 + }, + { + "stage": "layer_01", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9906487982381474, + "meanRelativeL2": 0.13720474392175674, + "maxAbsDelta": 0.328125 + }, + { + "stage": "layer_02", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9894424389709126, + "meanRelativeL2": 0.14829450100660324, + "maxAbsDelta": 0.4765625 + }, + { + "stage": "layer_03", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9896984331535571, + "meanRelativeL2": 0.14653590694069862, + "maxAbsDelta": 0.515625 + }, + { + "stage": "layer_04", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9906691266731782, + "meanRelativeL2": 0.1387987807393074, + "maxAbsDelta": 0.6171875 + }, + { + "stage": "layer_05", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.989205623034275, + "meanRelativeL2": 0.14766842126846313, + "maxAbsDelta": 0.7421875 + }, + { + "stage": "layer_06", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9887486023433281, + "meanRelativeL2": 0.1494276039302349, + "maxAbsDelta": 1.21875 + }, + { + "stage": "layer_07", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9874740140004592, + "meanRelativeL2": 0.15563824027776718, + "maxAbsDelta": 1.78125 + }, + { + "stage": "layer_08", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9861660587065147, + "meanRelativeL2": 0.1638489067554474, + "maxAbsDelta": 1.8125 + }, + { + "stage": "layer_09", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9872894091136528, + "meanRelativeL2": 0.1567065715789795, + "maxAbsDelta": 1.9375 + }, + { + "stage": "layer_10", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.985960198171211, + "meanRelativeL2": 0.1646011769771576, + "maxAbsDelta": 2.21875 + }, + { + "stage": "layer_11", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9881161214727344, + "meanRelativeL2": 0.15025852248072624, + "maxAbsDelta": 2.5625 + }, + { + "stage": "layer_12", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9865502134417042, + "meanRelativeL2": 0.15936696901917458, + "maxAbsDelta": 2.71875 + }, + { + "stage": "layer_13", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9863839943300594, + "meanRelativeL2": 0.1592903770506382, + "maxAbsDelta": 2.75 + }, + { + "stage": "layer_14", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9869289959018881, + "meanRelativeL2": 0.15567494183778763, + "maxAbsDelta": 2.84375 + }, + { + "stage": "layer_15", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9871221334645243, + "meanRelativeL2": 0.15474346838891506, + "maxAbsDelta": 3.5 + }, + { + "stage": "layer_16", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9869815850799734, + "meanRelativeL2": 0.1551517527550459, + "maxAbsDelta": 3.625 + }, + { + "stage": "layer_17", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9876209377339392, + "meanRelativeL2": 0.15099025331437588, + "maxAbsDelta": 3.3125 + }, + { + "stage": "layer_18", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9877193120392886, + "meanRelativeL2": 0.14986752718687057, + "maxAbsDelta": 4.625 + }, + { + "stage": "layer_19", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9874269977663502, + "meanRelativeL2": 0.15138272941112518, + "maxAbsDelta": 6.5625 + }, + { + "stage": "layer_20", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9876312378681067, + "meanRelativeL2": 0.1507016234099865, + "maxAbsDelta": 10.0625 + }, + { + "stage": "layer_21", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9868112886493856, + "meanRelativeL2": 0.15691541507840157, + "maxAbsDelta": 10.25 + }, + { + "stage": "layer_22", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9866738223668301, + "meanRelativeL2": 0.15686259604990482, + "maxAbsDelta": 16.375 + }, + { + "stage": "layer_23", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9877920284415737, + "meanRelativeL2": 0.14953981898725033, + "maxAbsDelta": 12.625 + }, + { + "stage": "layer_24", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9874463824611721, + "meanRelativeL2": 0.15680026076734066, + "maxAbsDelta": 508.3125 + }, + { + "stage": "layer_25", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9896268585414597, + "meanRelativeL2": 0.1349406223744154, + "maxAbsDelta": 513.078125 + }, + { + "stage": "layer_26", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9890838088411273, + "meanRelativeL2": 0.14998130314052105, + "maxAbsDelta": 63.5 + }, + { + "stage": "final_norm", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9866185042894248, + "meanRelativeL2": 0.15634902566671371, + "maxAbsDelta": 4.859375 + } + ], + "period_at_s0": [ + { + "stage": "embedding", + "tokens": 660, + "exactRows": 660, + "meanCosine": 1, + "meanRelativeL2": 0, + "maxAbsDelta": 0 + }, + { + "stage": "layer_00", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9924232031359818, + "meanRelativeL2": 0.1256095990538597, + "maxAbsDelta": 0.3125 + }, + { + "stage": "layer_01", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9925276544961062, + "meanRelativeL2": 0.1242147870361805, + "maxAbsDelta": 0.2890625 + }, + { + "stage": "layer_02", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9925166527430217, + "meanRelativeL2": 0.12634228356182575, + "maxAbsDelta": 0.3984375 + }, + { + "stage": "layer_03", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9930595675201127, + "meanRelativeL2": 0.12139072641730309, + "maxAbsDelta": 0.3984375 + }, + { + "stage": "layer_04", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9938883085142483, + "meanRelativeL2": 0.11279642581939697, + "maxAbsDelta": 0.47265625 + }, + { + "stage": "layer_05", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9929919297948028, + "meanRelativeL2": 0.1201384849846363, + "maxAbsDelta": 0.59375 + }, + { + "stage": "layer_06", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9928132462682147, + "meanRelativeL2": 0.12044329941272736, + "maxAbsDelta": 0.703125 + }, + { + "stage": "layer_07", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9920139095096877, + "meanRelativeL2": 0.12569634988904, + "maxAbsDelta": 1.140625 + }, + { + "stage": "layer_08", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.990858501737768, + "meanRelativeL2": 0.1343111004680395, + "maxAbsDelta": 1.40625 + }, + { + "stage": "layer_09", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9917690949909614, + "meanRelativeL2": 0.1278384793549776, + "maxAbsDelta": 1.625 + }, + { + "stage": "layer_10", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9906480944517887, + "meanRelativeL2": 0.1361193023622036, + "maxAbsDelta": 1.84375 + }, + { + "stage": "layer_11", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9921999483397512, + "meanRelativeL2": 0.12349652498960495, + "maxAbsDelta": 2.875 + }, + { + "stage": "layer_12", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9910461552215345, + "meanRelativeL2": 0.13135760836303234, + "maxAbsDelta": 3.5 + }, + { + "stage": "layer_13", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9908145735661189, + "meanRelativeL2": 0.1322189513593912, + "maxAbsDelta": 3.25 + }, + { + "stage": "layer_14", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9912509031368024, + "meanRelativeL2": 0.12865562364459038, + "maxAbsDelta": 3.21875 + }, + { + "stage": "layer_15", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9913968678676721, + "meanRelativeL2": 0.12753208354115486, + "maxAbsDelta": 3.15625 + }, + { + "stage": "layer_16", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9912904869426381, + "meanRelativeL2": 0.12775540351867676, + "maxAbsDelta": 3.34375 + }, + { + "stage": "layer_17", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9916422234340148, + "meanRelativeL2": 0.12431109696626663, + "maxAbsDelta": 3.25 + }, + { + "stage": "layer_18", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9918629731192733, + "meanRelativeL2": 0.12207120098173618, + "maxAbsDelta": 3.3125 + }, + { + "stage": "layer_19", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9916970198804682, + "meanRelativeL2": 0.1230116430670023, + "maxAbsDelta": 3.6875 + }, + { + "stage": "layer_20", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9920230487982432, + "meanRelativeL2": 0.12094726972281933, + "maxAbsDelta": 4.40625 + }, + { + "stage": "layer_21", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.991420295473301, + "meanRelativeL2": 0.1258913241326809, + "maxAbsDelta": 4.0625 + }, + { + "stage": "layer_22", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9913518892093138, + "meanRelativeL2": 0.12563960812985897, + "maxAbsDelta": 6.125 + }, + { + "stage": "layer_23", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9923663604440112, + "meanRelativeL2": 0.11877061054110527, + "maxAbsDelta": 9 + }, + { + "stage": "layer_24", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9933048976190162, + "meanRelativeL2": 0.11205022409558296, + "maxAbsDelta": 84 + }, + { + "stage": "layer_25", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9948995578469653, + "meanRelativeL2": 0.09878682345151901, + "maxAbsDelta": 84 + }, + { + "stage": "layer_26", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9944188011415077, + "meanRelativeL2": 0.10650407522916794, + "maxAbsDelta": 53 + }, + { + "stage": "final_norm", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9930806219577789, + "meanRelativeL2": 0.11231600493192673, + "maxAbsDelta": 3.921875 + } + ], + "period_at_s1": [ + { + "stage": "embedding", + "tokens": 660, + "exactRows": 660, + "meanCosine": 1, + "meanRelativeL2": 0, + "maxAbsDelta": 0 + }, + { + "stage": "layer_00", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9933323294827432, + "meanRelativeL2": 0.11790181510150433, + "maxAbsDelta": 0.328125 + }, + { + "stage": "layer_01", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9906923360896833, + "meanRelativeL2": 0.1367037408053875, + "maxAbsDelta": 0.328125 + }, + { + "stage": "layer_02", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9893834696574645, + "meanRelativeL2": 0.14855152368545532, + "maxAbsDelta": 0.486328125 + }, + { + "stage": "layer_03", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9896298903407472, + "meanRelativeL2": 0.1468077003955841, + "maxAbsDelta": 0.513671875 + }, + { + "stage": "layer_04", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9904879734371648, + "meanRelativeL2": 0.1401131134480238, + "maxAbsDelta": 0.6171875 + }, + { + "stage": "layer_05", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9892252263697711, + "meanRelativeL2": 0.14822788536548615, + "maxAbsDelta": 0.734375 + }, + { + "stage": "layer_06", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9887196413495324, + "meanRelativeL2": 0.15064414218068123, + "maxAbsDelta": 1.015625 + }, + { + "stage": "layer_07", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9876095856681014, + "meanRelativeL2": 0.15644538775086403, + "maxAbsDelta": 1.5 + }, + { + "stage": "layer_08", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9863679257306186, + "meanRelativeL2": 0.16410905867815018, + "maxAbsDelta": 1.5625 + }, + { + "stage": "layer_09", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9875928410978029, + "meanRelativeL2": 0.15615110844373703, + "maxAbsDelta": 1.625 + }, + { + "stage": "layer_10", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9863324494072885, + "meanRelativeL2": 0.16390962526202202, + "maxAbsDelta": 1.625 + }, + { + "stage": "layer_11", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9884271668665336, + "meanRelativeL2": 0.149991100654006, + "maxAbsDelta": 2.15625 + }, + { + "stage": "layer_12", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9869572022647569, + "meanRelativeL2": 0.15871379524469376, + "maxAbsDelta": 2.84375 + }, + { + "stage": "layer_13", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9869559841625618, + "meanRelativeL2": 0.15773751959204674, + "maxAbsDelta": 2.9375 + }, + { + "stage": "layer_14", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9874372403730046, + "meanRelativeL2": 0.15428628772497177, + "maxAbsDelta": 3.75 + }, + { + "stage": "layer_15", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9875693845929522, + "meanRelativeL2": 0.15358425676822662, + "maxAbsDelta": 3.8125 + }, + { + "stage": "layer_16", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9875254884813771, + "meanRelativeL2": 0.1539417076855898, + "maxAbsDelta": 3.75 + }, + { + "stage": "layer_17", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9881879902247227, + "meanRelativeL2": 0.1495396178215742, + "maxAbsDelta": 3.75 + }, + { + "stage": "layer_18", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9882346206542217, + "meanRelativeL2": 0.14879650436341763, + "maxAbsDelta": 4.5625 + }, + { + "stage": "layer_19", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9881283115256917, + "meanRelativeL2": 0.14952527731657028, + "maxAbsDelta": 5.5625 + }, + { + "stage": "layer_20", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9881921548735012, + "meanRelativeL2": 0.15007702447474003, + "maxAbsDelta": 7.9375 + }, + { + "stage": "layer_21", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9873679260412852, + "meanRelativeL2": 0.15627493523061275, + "maxAbsDelta": 8.625 + }, + { + "stage": "layer_22", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9872596198862249, + "meanRelativeL2": 0.15628508664667606, + "maxAbsDelta": 14.875 + }, + { + "stage": "layer_23", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9883182251995261, + "meanRelativeL2": 0.14862355962395668, + "maxAbsDelta": 14 + }, + { + "stage": "layer_24", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9877762866742683, + "meanRelativeL2": 0.15612166933715343, + "maxAbsDelta": 502.3125 + }, + { + "stage": "layer_25", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9899765132051526, + "meanRelativeL2": 0.13341837003827095, + "maxAbsDelta": 507.078125 + }, + { + "stage": "layer_26", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9902380594701478, + "meanRelativeL2": 0.14548932760953903, + "maxAbsDelta": 65 + }, + { + "stage": "final_norm", + "tokens": 660, + "exactRows": 0, + "meanCosine": 0.9878921084331743, + "meanRelativeL2": 0.15024198964238167, + "maxAbsDelta": 4.2265625 + } + ] + }, + "chinese": { + "system_eos": [ + { + "stage": "embedding", + "tokens": 97, + "exactRows": 97, + "meanCosine": 1, + "meanRelativeL2": 0, + "maxAbsDelta": 0 + }, + { + "stage": "layer_00", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9997278150823927, + "meanRelativeL2": 0.021354191936552525, + "maxAbsDelta": 0.125 + }, + { + "stage": "layer_01", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9990285075816911, + "meanRelativeL2": 0.04200923815369606, + "maxAbsDelta": 0.078125 + }, + { + "stage": "layer_02", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9983915803358727, + "meanRelativeL2": 0.054608000442385674, + "maxAbsDelta": 0.203125 + }, + { + "stage": "layer_03", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9983789337050054, + "meanRelativeL2": 0.05479492153972387, + "maxAbsDelta": 0.203125 + }, + { + "stage": "layer_04", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9983461689703244, + "meanRelativeL2": 0.05465173162519932, + "maxAbsDelta": 0.21875 + }, + { + "stage": "layer_05", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9974389235997937, + "meanRelativeL2": 0.06646795943379402, + "maxAbsDelta": 0.26953125 + }, + { + "stage": "layer_06", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9971279409742847, + "meanRelativeL2": 0.06960178539156914, + "maxAbsDelta": 0.625 + }, + { + "stage": "layer_07", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9968822414113074, + "meanRelativeL2": 0.07224956527352333, + "maxAbsDelta": 0.40625 + }, + { + "stage": "layer_08", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9962676861851486, + "meanRelativeL2": 0.07988382503390312, + "maxAbsDelta": 0.46875 + }, + { + "stage": "layer_09", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.996572299101918, + "meanRelativeL2": 0.07733356952667236, + "maxAbsDelta": 0.6875 + }, + { + "stage": "layer_10", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9964269903517261, + "meanRelativeL2": 0.07916884124279022, + "maxAbsDelta": 0.625 + }, + { + "stage": "layer_11", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9970645326928994, + "meanRelativeL2": 0.07234667427837849, + "maxAbsDelta": 1.375 + }, + { + "stage": "layer_12", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9967680032720271, + "meanRelativeL2": 0.07594819366931915, + "maxAbsDelta": 0.875 + }, + { + "stage": "layer_13", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.996654085891763, + "meanRelativeL2": 0.07674743048846722, + "maxAbsDelta": 0.75 + }, + { + "stage": "layer_14", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9965731065297864, + "meanRelativeL2": 0.07787453383207321, + "maxAbsDelta": 0.8125 + }, + { + "stage": "layer_15", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9965342326262563, + "meanRelativeL2": 0.07793460227549076, + "maxAbsDelta": 1.125 + }, + { + "stage": "layer_16", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9964359064692074, + "meanRelativeL2": 0.0792039055377245, + "maxAbsDelta": 1.5 + }, + { + "stage": "layer_17", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9965965895308662, + "meanRelativeL2": 0.07750366628170013, + "maxAbsDelta": 1.75 + }, + { + "stage": "layer_18", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9966315430464204, + "meanRelativeL2": 0.07743625529110432, + "maxAbsDelta": 1.875 + }, + { + "stage": "layer_19", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9964653425609943, + "meanRelativeL2": 0.07939279824495316, + "maxAbsDelta": 1.75 + }, + { + "stage": "layer_20", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9961399816975152, + "meanRelativeL2": 0.08321552164852619, + "maxAbsDelta": 2.5 + }, + { + "stage": "layer_21", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9955947675655797, + "meanRelativeL2": 0.08963215909898281, + "maxAbsDelta": 2.25 + }, + { + "stage": "layer_22", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9955689692005669, + "meanRelativeL2": 0.09014282375574112, + "maxAbsDelta": 3 + }, + { + "stage": "layer_23", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9959872414156333, + "meanRelativeL2": 0.08659941889345646, + "maxAbsDelta": 3.8125 + }, + { + "stage": "layer_24", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9965117622896568, + "meanRelativeL2": 0.07984889671206474, + "maxAbsDelta": 14 + }, + { + "stage": "layer_25", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9973395294749859, + "meanRelativeL2": 0.07017899863421917, + "maxAbsDelta": 14 + }, + { + "stage": "layer_26", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9979920983314514, + "meanRelativeL2": 0.06423328630626202, + "maxAbsDelta": 18 + }, + { + "stage": "final_norm", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.995756564681063, + "meanRelativeL2": 0.0879269689321518, + "maxAbsDelta": 1.1982421875 + } + ], + "system_bos": [ + { + "stage": "embedding", + "tokens": 97, + "exactRows": 97, + "meanCosine": 1, + "meanRelativeL2": 0, + "maxAbsDelta": 0 + }, + { + "stage": "layer_00", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9995741076076153, + "meanRelativeL2": 0.027483507990837097, + "maxAbsDelta": 0.1171875 + }, + { + "stage": "layer_01", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9967599793807748, + "meanRelativeL2": 0.07844813540577888, + "maxAbsDelta": 0.125 + }, + { + "stage": "layer_02", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9952748596053762, + "meanRelativeL2": 0.09531884826719761, + "maxAbsDelta": 0.140625 + }, + { + "stage": "layer_03", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9952014395871114, + "meanRelativeL2": 0.09640289656817913, + "maxAbsDelta": 0.28125 + }, + { + "stage": "layer_04", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9952960026632879, + "meanRelativeL2": 0.09575735591351986, + "maxAbsDelta": 0.267578125 + }, + { + "stage": "layer_05", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9943492480160034, + "meanRelativeL2": 0.10277693904936314, + "maxAbsDelta": 0.375 + }, + { + "stage": "layer_06", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9945803598030326, + "meanRelativeL2": 0.10017473250627518, + "maxAbsDelta": 0.875 + }, + { + "stage": "layer_07", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9942168273876623, + "meanRelativeL2": 0.10319926030933857, + "maxAbsDelta": 0.359375 + }, + { + "stage": "layer_08", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.993706552638221, + "meanRelativeL2": 0.10804466344416142, + "maxAbsDelta": 0.53125 + }, + { + "stage": "layer_09", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9941297339409897, + "meanRelativeL2": 0.10398266837000847, + "maxAbsDelta": 0.78125 + }, + { + "stage": "layer_10", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9937055479619921, + "meanRelativeL2": 0.10803826712071896, + "maxAbsDelta": 1.1875 + }, + { + "stage": "layer_11", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9948511381739193, + "meanRelativeL2": 0.0986206978559494, + "maxAbsDelta": 1.5 + }, + { + "stage": "layer_12", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9943699904323853, + "meanRelativeL2": 0.10324335470795631, + "maxAbsDelta": 1 + }, + { + "stage": "layer_13", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.994513535007988, + "meanRelativeL2": 0.10182490199804306, + "maxAbsDelta": 1 + }, + { + "stage": "layer_14", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9945809202095897, + "meanRelativeL2": 0.10131420940160751, + "maxAbsDelta": 1.25 + }, + { + "stage": "layer_15", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9947292847731679, + "meanRelativeL2": 0.09988914802670479, + "maxAbsDelta": 1.375 + }, + { + "stage": "layer_16", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9946724926073527, + "meanRelativeL2": 0.1004158053547144, + "maxAbsDelta": 1.25 + }, + { + "stage": "layer_17", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9947637110641322, + "meanRelativeL2": 0.09910064935684204, + "maxAbsDelta": 1.75 + }, + { + "stage": "layer_18", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9948370923701021, + "meanRelativeL2": 0.09800739586353302, + "maxAbsDelta": 3.0625 + }, + { + "stage": "layer_19", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9944896003634659, + "meanRelativeL2": 0.10101618058979511, + "maxAbsDelta": 3.25 + }, + { + "stage": "layer_20", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9941840276275713, + "meanRelativeL2": 0.10361112095415592, + "maxAbsDelta": 3.625 + }, + { + "stage": "layer_21", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.993651958470492, + "meanRelativeL2": 0.10846854746341705, + "maxAbsDelta": 4.5 + }, + { + "stage": "layer_22", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.99350929321702, + "meanRelativeL2": 0.10999257490038872, + "maxAbsDelta": 5.75 + }, + { + "stage": "layer_23", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9942051977226415, + "meanRelativeL2": 0.10542715154588223, + "maxAbsDelta": 7.75 + }, + { + "stage": "layer_24", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9950127878139928, + "meanRelativeL2": 0.09759864024817944, + "maxAbsDelta": 28 + }, + { + "stage": "layer_25", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9961420844510659, + "meanRelativeL2": 0.08596109598875046, + "maxAbsDelta": 28 + }, + { + "stage": "layer_26", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9970201782344543, + "meanRelativeL2": 0.07684881053864956, + "maxAbsDelta": 24 + }, + { + "stage": "final_norm", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.994003298356361, + "meanRelativeL2": 0.10527877509593964, + "maxAbsDelta": 1.1171875 + } + ], + "system_x": [ + { + "stage": "embedding", + "tokens": 97, + "exactRows": 97, + "meanCosine": 1, + "meanRelativeL2": 0, + "maxAbsDelta": 0 + }, + { + "stage": "layer_00", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9995940395237244, + "meanRelativeL2": 0.02725130133330822, + "maxAbsDelta": 0.1171875 + }, + { + "stage": "layer_01", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9951923108592475, + "meanRelativeL2": 0.0941197294741869, + "maxAbsDelta": 0.109375 + }, + { + "stage": "layer_02", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.993585379467797, + "meanRelativeL2": 0.10994799993932247, + "maxAbsDelta": 0.21875 + }, + { + "stage": "layer_03", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9928062306236975, + "meanRelativeL2": 0.11698048003017902, + "maxAbsDelta": 0.17578125 + }, + { + "stage": "layer_04", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9925303035175678, + "meanRelativeL2": 0.11999712511897087, + "maxAbsDelta": 0.30859375 + }, + { + "stage": "layer_05", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9900871416957108, + "meanRelativeL2": 0.13560060039162636, + "maxAbsDelta": 0.408203125 + }, + { + "stage": "layer_06", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9904405204291197, + "meanRelativeL2": 0.1332143284380436, + "maxAbsDelta": 0.515625 + }, + { + "stage": "layer_07", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9899343946545395, + "meanRelativeL2": 0.13648460432887077, + "maxAbsDelta": 0.546875 + }, + { + "stage": "layer_08", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9879287339977383, + "meanRelativeL2": 0.1464591659605503, + "maxAbsDelta": 0.9140625 + }, + { + "stage": "layer_09", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9879707147165672, + "meanRelativeL2": 0.14187175035476685, + "maxAbsDelta": 1.421875 + }, + { + "stage": "layer_10", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9871790882238408, + "meanRelativeL2": 0.1445232853293419, + "maxAbsDelta": 2.265625 + }, + { + "stage": "layer_11", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9881748901200049, + "meanRelativeL2": 0.1329319979995489, + "maxAbsDelta": 5.9375 + }, + { + "stage": "layer_12", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9868043888475477, + "meanRelativeL2": 0.13770302198827267, + "maxAbsDelta": 7.375 + }, + { + "stage": "layer_13", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.98746973767723, + "meanRelativeL2": 0.13682954385876656, + "maxAbsDelta": 5.4375 + }, + { + "stage": "layer_14", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9875597191840103, + "meanRelativeL2": 0.13743109069764614, + "maxAbsDelta": 6.4375 + }, + { + "stage": "layer_15", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.987538432952055, + "meanRelativeL2": 0.138390326872468, + "maxAbsDelta": 6 + }, + { + "stage": "layer_16", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9874229295966551, + "meanRelativeL2": 0.1384222600609064, + "maxAbsDelta": 7.5 + }, + { + "stage": "layer_17", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9881044663104814, + "meanRelativeL2": 0.13623051904141903, + "maxAbsDelta": 6.125 + }, + { + "stage": "layer_18", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9883388889204595, + "meanRelativeL2": 0.137216005474329, + "maxAbsDelta": 6.0234375 + }, + { + "stage": "layer_19", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9879366743195918, + "meanRelativeL2": 0.13978548720479012, + "maxAbsDelta": 6.125 + }, + { + "stage": "layer_20", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9868025914909914, + "meanRelativeL2": 0.14658279344439507, + "maxAbsDelta": 5.875 + }, + { + "stage": "layer_21", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9849072055718333, + "meanRelativeL2": 0.156336210668087, + "maxAbsDelta": 5.875 + }, + { + "stage": "layer_22", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9840894888356789, + "meanRelativeL2": 0.1610594242811203, + "maxAbsDelta": 6.9375 + }, + { + "stage": "layer_23", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9865242955610924, + "meanRelativeL2": 0.1530241183936596, + "maxAbsDelta": 7.5 + }, + { + "stage": "layer_24", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9886723486418577, + "meanRelativeL2": 0.14170140400528908, + "maxAbsDelta": 48 + }, + { + "stage": "layer_25", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9912356304139206, + "meanRelativeL2": 0.125793794170022, + "maxAbsDelta": 48 + }, + { + "stage": "layer_26", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9916805225549284, + "meanRelativeL2": 0.1317878421396017, + "maxAbsDelta": 57 + }, + { + "stage": "final_norm", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9848582388199482, + "meanRelativeL2": 0.16382448747754097, + "maxAbsDelta": 3.5 + } + ], + "system_period": [ + { + "stage": "embedding", + "tokens": 97, + "exactRows": 97, + "meanCosine": 1, + "meanRelativeL2": 0, + "maxAbsDelta": 0 + }, + { + "stage": "layer_00", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9996328802452874, + "meanRelativeL2": 0.025834542233496904, + "maxAbsDelta": 0.1171875 + }, + { + "stage": "layer_01", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.995439287313481, + "meanRelativeL2": 0.09167180396616459, + "maxAbsDelta": 0.109375 + }, + { + "stage": "layer_02", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9938186855660271, + "meanRelativeL2": 0.1078334916383028, + "maxAbsDelta": 0.1875 + }, + { + "stage": "layer_03", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.992950210251759, + "meanRelativeL2": 0.11553386971354485, + "maxAbsDelta": 0.21875 + }, + { + "stage": "layer_04", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9926751391174867, + "meanRelativeL2": 0.11892696842551231, + "maxAbsDelta": 0.3203125 + }, + { + "stage": "layer_05", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9900972247123718, + "meanRelativeL2": 0.13482848554849625, + "maxAbsDelta": 0.41015625 + }, + { + "stage": "layer_06", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9900901286872392, + "meanRelativeL2": 0.1345287337899208, + "maxAbsDelta": 0.625 + }, + { + "stage": "layer_07", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9891889672918418, + "meanRelativeL2": 0.14007674530148506, + "maxAbsDelta": 0.6875 + }, + { + "stage": "layer_08", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9871134063632218, + "meanRelativeL2": 0.1510649435222149, + "maxAbsDelta": 1.09375 + }, + { + "stage": "layer_09", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9874667900124776, + "meanRelativeL2": 0.1439126543700695, + "maxAbsDelta": 1.625 + }, + { + "stage": "layer_10", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9865474762375822, + "meanRelativeL2": 0.14710644260048866, + "maxAbsDelta": 2.296875 + }, + { + "stage": "layer_11", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9879459154974554, + "meanRelativeL2": 0.13615785539150238, + "maxAbsDelta": 5.84375 + }, + { + "stage": "layer_12", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9863077291508311, + "meanRelativeL2": 0.14219044893980026, + "maxAbsDelta": 7.03125 + }, + { + "stage": "layer_13", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9865887232662476, + "meanRelativeL2": 0.14210287854075432, + "maxAbsDelta": 5.484375 + }, + { + "stage": "layer_14", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9864604755775216, + "meanRelativeL2": 0.14437734335660934, + "maxAbsDelta": 5.6875 + }, + { + "stage": "layer_15", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9864120323633411, + "meanRelativeL2": 0.1452188864350319, + "maxAbsDelta": 6.125 + }, + { + "stage": "layer_16", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9862592767194375, + "meanRelativeL2": 0.1458124779164791, + "maxAbsDelta": 7.25 + }, + { + "stage": "layer_17", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9870108279985251, + "meanRelativeL2": 0.14333085343241692, + "maxAbsDelta": 6 + }, + { + "stage": "layer_18", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9870883994495746, + "meanRelativeL2": 0.1443272866308689, + "maxAbsDelta": 6.75 + }, + { + "stage": "layer_19", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9866148141241565, + "meanRelativeL2": 0.14682819321751595, + "maxAbsDelta": 7 + }, + { + "stage": "layer_20", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9851806034746858, + "meanRelativeL2": 0.15571225062012672, + "maxAbsDelta": 7.375 + }, + { + "stage": "layer_21", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9830453580187768, + "meanRelativeL2": 0.16682759672403336, + "maxAbsDelta": 6.625 + }, + { + "stage": "layer_22", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.982215902240006, + "meanRelativeL2": 0.17226819694042206, + "maxAbsDelta": 8.5 + }, + { + "stage": "layer_23", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9847757545943113, + "meanRelativeL2": 0.16396857425570488, + "maxAbsDelta": 11.25 + }, + { + "stage": "layer_24", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.987124487911303, + "meanRelativeL2": 0.15173299238085747, + "maxAbsDelta": 46 + }, + { + "stage": "layer_25", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9899020797198581, + "meanRelativeL2": 0.13509309850633144, + "maxAbsDelta": 46 + }, + { + "stage": "layer_26", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9899883257974055, + "meanRelativeL2": 0.14376903511583805, + "maxAbsDelta": 64.25 + }, + { + "stage": "final_norm", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9822142032003894, + "meanRelativeL2": 0.1791980266571045, + "maxAbsDelta": 4.1953125 + } + ], + "bos_at_s0": [ + { + "stage": "embedding", + "tokens": 97, + "exactRows": 97, + "meanCosine": 1, + "meanRelativeL2": 0, + "maxAbsDelta": 0 + }, + { + "stage": "layer_00", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9855623466452372, + "meanRelativeL2": 0.16798052191734314, + "maxAbsDelta": 0.28125 + }, + { + "stage": "layer_01", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9850948778624388, + "meanRelativeL2": 0.16919215396046638, + "maxAbsDelta": 0.234375 + }, + { + "stage": "layer_02", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9858747536374122, + "meanRelativeL2": 0.16575990989804268, + "maxAbsDelta": 0.31640625 + }, + { + "stage": "layer_03", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.987007278756997, + "meanRelativeL2": 0.1597733423113823, + "maxAbsDelta": 0.359375 + }, + { + "stage": "layer_04", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9896026886615557, + "meanRelativeL2": 0.14310913532972336, + "maxAbsDelta": 0.375 + }, + { + "stage": "layer_05", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9889185281143975, + "meanRelativeL2": 0.1479317732155323, + "maxAbsDelta": 0.640625 + }, + { + "stage": "layer_06", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9900152750850952, + "meanRelativeL2": 0.1397433541715145, + "maxAbsDelta": 0.84375 + }, + { + "stage": "layer_07", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9896352684374937, + "meanRelativeL2": 0.14146534726023674, + "maxAbsDelta": 0.53125 + }, + { + "stage": "layer_08", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9891359541834015, + "meanRelativeL2": 0.14464572072029114, + "maxAbsDelta": 0.5625 + }, + { + "stage": "layer_09", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9909220251840415, + "meanRelativeL2": 0.1324737537652254, + "maxAbsDelta": 0.75 + }, + { + "stage": "layer_10", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.990455228643319, + "meanRelativeL2": 0.135239003226161, + "maxAbsDelta": 0.875 + }, + { + "stage": "layer_11", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9927045598472517, + "meanRelativeL2": 0.11845307424664497, + "maxAbsDelta": 1.25 + }, + { + "stage": "layer_12", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.992015404185069, + "meanRelativeL2": 0.12381835281848907, + "maxAbsDelta": 0.8125 + }, + { + "stage": "layer_13", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9921337157180629, + "meanRelativeL2": 0.12242449447512627, + "maxAbsDelta": 1.125 + }, + { + "stage": "layer_14", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9925166657290507, + "meanRelativeL2": 0.11928459629416466, + "maxAbsDelta": 1.4375 + }, + { + "stage": "layer_15", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.992767982876178, + "meanRelativeL2": 0.11662261001765728, + "maxAbsDelta": 1.875 + }, + { + "stage": "layer_16", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9926488848076653, + "meanRelativeL2": 0.11689411103725433, + "maxAbsDelta": 2.3125 + }, + { + "stage": "layer_17", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9930331233850459, + "meanRelativeL2": 0.11374974064528942, + "maxAbsDelta": 2.25 + }, + { + "stage": "layer_18", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9932082258548933, + "meanRelativeL2": 0.11232166364789009, + "maxAbsDelta": 2.4375 + }, + { + "stage": "layer_19", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9927780935444783, + "meanRelativeL2": 0.11576293408870697, + "maxAbsDelta": 3.125 + }, + { + "stage": "layer_20", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9926223607407403, + "meanRelativeL2": 0.11651438847184181, + "maxAbsDelta": 3.3125 + }, + { + "stage": "layer_21", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9921091512306449, + "meanRelativeL2": 0.12066283635795116, + "maxAbsDelta": 4 + }, + { + "stage": "layer_22", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9919373608127082, + "meanRelativeL2": 0.12176932208240032, + "maxAbsDelta": 5.25 + }, + { + "stage": "layer_23", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9925518656514355, + "meanRelativeL2": 0.11676900833845139, + "maxAbsDelta": 7.75 + }, + { + "stage": "layer_24", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9935799609754503, + "meanRelativeL2": 0.10737251676619053, + "maxAbsDelta": 9 + }, + { + "stage": "layer_25", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9950387527033225, + "meanRelativeL2": 0.09470877610147, + "maxAbsDelta": 18.5 + }, + { + "stage": "layer_26", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9962858520832258, + "meanRelativeL2": 0.08583181723952293, + "maxAbsDelta": 41.5 + }, + { + "stage": "final_norm", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9926720458207671, + "meanRelativeL2": 0.11509397998452187, + "maxAbsDelta": 1.9375 + } + ], + "bos_at_s1": [ + { + "stage": "embedding", + "tokens": 97, + "exactRows": 97, + "meanCosine": 1, + "meanRelativeL2": 0, + "maxAbsDelta": 0 + }, + { + "stage": "layer_00", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9870740728279979, + "meanRelativeL2": 0.15929966419935226, + "maxAbsDelta": 0.28125 + }, + { + "stage": "layer_01", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9849771334952915, + "meanRelativeL2": 0.169498972594738, + "maxAbsDelta": 0.2734375 + }, + { + "stage": "layer_02", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9830065074655199, + "meanRelativeL2": 0.18126491084694862, + "maxAbsDelta": 0.453125 + }, + { + "stage": "layer_03", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9839818072073239, + "meanRelativeL2": 0.17743343114852905, + "maxAbsDelta": 0.5 + }, + { + "stage": "layer_04", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9867722127855438, + "meanRelativeL2": 0.16199912875890732, + "maxAbsDelta": 0.46875 + }, + { + "stage": "layer_05", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9859495316584086, + "meanRelativeL2": 0.167092002928257, + "maxAbsDelta": 0.78125 + }, + { + "stage": "layer_06", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9876472218749449, + "meanRelativeL2": 0.1559966765344143, + "maxAbsDelta": 1.09375 + }, + { + "stage": "layer_07", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9876224533798769, + "meanRelativeL2": 0.15487154200673103, + "maxAbsDelta": 0.625 + }, + { + "stage": "layer_08", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.987518262002886, + "meanRelativeL2": 0.15535762533545494, + "maxAbsDelta": 0.8125 + }, + { + "stage": "layer_09", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9894268549594682, + "meanRelativeL2": 0.14253136701881886, + "maxAbsDelta": 0.875 + }, + { + "stage": "layer_10", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9890437113870051, + "meanRelativeL2": 0.1450185440480709, + "maxAbsDelta": 1 + }, + { + "stage": "layer_11", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9916280735399305, + "meanRelativeL2": 0.12710379250347614, + "maxAbsDelta": 1.1875 + }, + { + "stage": "layer_12", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9911990202579302, + "meanRelativeL2": 0.13004891574382782, + "maxAbsDelta": 1.125 + }, + { + "stage": "layer_13", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.991630099483372, + "meanRelativeL2": 0.1266753412783146, + "maxAbsDelta": 1.0625 + }, + { + "stage": "layer_14", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9919762795733422, + "meanRelativeL2": 0.12408100627362728, + "maxAbsDelta": 1.46875 + }, + { + "stage": "layer_15", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9922710601816472, + "meanRelativeL2": 0.12124410830438137, + "maxAbsDelta": 2 + }, + { + "stage": "layer_16", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9922543383136238, + "meanRelativeL2": 0.12069976329803467, + "maxAbsDelta": 2.625 + }, + { + "stage": "layer_17", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9924754168569427, + "meanRelativeL2": 0.11820420809090137, + "maxAbsDelta": 2.8125 + }, + { + "stage": "layer_18", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9924781033673238, + "meanRelativeL2": 0.11797713115811348, + "maxAbsDelta": 4.875 + }, + { + "stage": "layer_19", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9922099568180203, + "meanRelativeL2": 0.11959602497518063, + "maxAbsDelta": 5.125 + }, + { + "stage": "layer_20", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9918930874657386, + "meanRelativeL2": 0.12193520925939083, + "maxAbsDelta": 5.375 + }, + { + "stage": "layer_21", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9912710361873981, + "meanRelativeL2": 0.12639532797038555, + "maxAbsDelta": 6.75 + }, + { + "stage": "layer_22", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9912667913535207, + "meanRelativeL2": 0.12660370953381062, + "maxAbsDelta": 8.75 + }, + { + "stage": "layer_23", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9920402242965305, + "meanRelativeL2": 0.12052100896835327, + "maxAbsDelta": 11.75 + }, + { + "stage": "layer_24", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9930276200943386, + "meanRelativeL2": 0.11182089149951935, + "maxAbsDelta": 17.5 + }, + { + "stage": "layer_25", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9945531622650697, + "meanRelativeL2": 0.09870370849967003, + "maxAbsDelta": 27.5 + }, + { + "stage": "layer_26", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9959616470582706, + "meanRelativeL2": 0.0886292178183794, + "maxAbsDelta": 34 + }, + { + "stage": "final_norm", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9918942242553553, + "meanRelativeL2": 0.12131679244339466, + "maxAbsDelta": 1.34375 + } + ], + "x_at_s0": [ + { + "stage": "embedding", + "tokens": 97, + "exactRows": 97, + "meanCosine": 1, + "meanRelativeL2": 0, + "maxAbsDelta": 0 + }, + { + "stage": "layer_00", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9857299475325751, + "meanRelativeL2": 0.16715656220912933, + "maxAbsDelta": 0.28125 + }, + { + "stage": "layer_01", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9862984455737871, + "meanRelativeL2": 0.1617695353925228, + "maxAbsDelta": 0.3125 + }, + { + "stage": "layer_02", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9845005021881812, + "meanRelativeL2": 0.17236297950148582, + "maxAbsDelta": 0.42578125 + }, + { + "stage": "layer_03", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9855202202944412, + "meanRelativeL2": 0.16725724190473557, + "maxAbsDelta": 0.38671875 + }, + { + "stage": "layer_04", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.987119938909393, + "meanRelativeL2": 0.15757427364587784, + "maxAbsDelta": 0.5 + }, + { + "stage": "layer_05", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9854203216808358, + "meanRelativeL2": 0.1667724959552288, + "maxAbsDelta": 0.71875 + }, + { + "stage": "layer_06", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9860688392648992, + "meanRelativeL2": 0.16327888518571854, + "maxAbsDelta": 1.46875 + }, + { + "stage": "layer_07", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.985531786053451, + "meanRelativeL2": 0.16529816389083862, + "maxAbsDelta": 0.78125 + }, + { + "stage": "layer_08", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9840985008121765, + "meanRelativeL2": 0.17350280657410622, + "maxAbsDelta": 0.8125 + }, + { + "stage": "layer_09", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9868857295242781, + "meanRelativeL2": 0.15810532495379448, + "maxAbsDelta": 1.5 + }, + { + "stage": "layer_10", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9863044324609422, + "meanRelativeL2": 0.160899568349123, + "maxAbsDelta": 1.625 + }, + { + "stage": "layer_11", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9894767440471453, + "meanRelativeL2": 0.14169731363654137, + "maxAbsDelta": 1.3125 + }, + { + "stage": "layer_12", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9886181028847841, + "meanRelativeL2": 0.1472502276301384, + "maxAbsDelta": 1.5 + }, + { + "stage": "layer_13", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9889430692515422, + "meanRelativeL2": 0.14480170980095863, + "maxAbsDelta": 1.625 + }, + { + "stage": "layer_14", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9895356905829046, + "meanRelativeL2": 0.14041361957788467, + "maxAbsDelta": 2.1875 + }, + { + "stage": "layer_15", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9899366602455217, + "meanRelativeL2": 0.1365135833621025, + "maxAbsDelta": 2.84375 + }, + { + "stage": "layer_16", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9898462535179767, + "meanRelativeL2": 0.13632966205477715, + "maxAbsDelta": 3.53125 + }, + { + "stage": "layer_17", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9901737220508536, + "meanRelativeL2": 0.1336316391825676, + "maxAbsDelta": 3.5 + }, + { + "stage": "layer_18", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9904008427846063, + "meanRelativeL2": 0.1321335956454277, + "maxAbsDelta": 4.375 + }, + { + "stage": "layer_19", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.989908014376139, + "meanRelativeL2": 0.13521841913461685, + "maxAbsDelta": 4.5 + }, + { + "stage": "layer_20", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9897035046951058, + "meanRelativeL2": 0.13660063222050667, + "maxAbsDelta": 4.5 + }, + { + "stage": "layer_21", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.988918354830791, + "meanRelativeL2": 0.14128533191978931, + "maxAbsDelta": 5.25 + }, + { + "stage": "layer_22", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9888845055373674, + "meanRelativeL2": 0.14138422161340714, + "maxAbsDelta": 6.75 + }, + { + "stage": "layer_23", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9898396349444831, + "meanRelativeL2": 0.13478419557213783, + "maxAbsDelta": 8.5 + }, + { + "stage": "layer_24", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9911610742205197, + "meanRelativeL2": 0.12447572126984596, + "maxAbsDelta": 12 + }, + { + "stage": "layer_25", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9930965095451197, + "meanRelativeL2": 0.109977962449193, + "maxAbsDelta": 23 + }, + { + "stage": "layer_26", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9950187335309294, + "meanRelativeL2": 0.09866621531546116, + "maxAbsDelta": 27.921875 + }, + { + "stage": "final_norm", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.989424593669852, + "meanRelativeL2": 0.1366533860564232, + "maxAbsDelta": 2.203125 + } + ], + "x_at_s1": [ + { + "stage": "embedding", + "tokens": 97, + "exactRows": 97, + "meanCosine": 1, + "meanRelativeL2": 0, + "maxAbsDelta": 0 + }, + { + "stage": "layer_00", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.987258933254124, + "meanRelativeL2": 0.15823524445295334, + "maxAbsDelta": 0.265625 + }, + { + "stage": "layer_01", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.983414727387969, + "meanRelativeL2": 0.1771986447274685, + "maxAbsDelta": 0.353515625 + }, + { + "stage": "layer_02", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9784017377292987, + "meanRelativeL2": 0.20230015739798546, + "maxAbsDelta": 0.55859375 + }, + { + "stage": "layer_03", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.978956913210682, + "meanRelativeL2": 0.20035411044955254, + "maxAbsDelta": 0.55859375 + }, + { + "stage": "layer_04", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9806660161804908, + "meanRelativeL2": 0.19339075312018394, + "maxAbsDelta": 0.6484375 + }, + { + "stage": "layer_05", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9783857403342257, + "meanRelativeL2": 0.20384261384606361, + "maxAbsDelta": 0.7109375 + }, + { + "stage": "layer_06", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9795657642108878, + "meanRelativeL2": 0.197702556848526, + "maxAbsDelta": 1.28125 + }, + { + "stage": "layer_07", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.97901451587677, + "meanRelativeL2": 0.1995401605963707, + "maxAbsDelta": 0.78125 + }, + { + "stage": "layer_08", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9764673900358456, + "meanRelativeL2": 0.2088669240474701, + "maxAbsDelta": 1.2109375 + }, + { + "stage": "layer_09", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9785239592040937, + "meanRelativeL2": 0.19566521793603897, + "maxAbsDelta": 2.15625 + }, + { + "stage": "layer_10", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.977015875663954, + "meanRelativeL2": 0.20075420290231705, + "maxAbsDelta": 3.03125 + }, + { + "stage": "layer_11", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9807667400419098, + "meanRelativeL2": 0.17968588694930077, + "maxAbsDelta": 5.25 + }, + { + "stage": "layer_12", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.978957971346747, + "meanRelativeL2": 0.18526341766119003, + "maxAbsDelta": 6.75 + }, + { + "stage": "layer_13", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9797757771826282, + "meanRelativeL2": 0.18275190889835358, + "maxAbsDelta": 5.25 + }, + { + "stage": "layer_14", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9803268442448881, + "meanRelativeL2": 0.1799004152417183, + "maxAbsDelta": 5.5625 + }, + { + "stage": "layer_15", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9807738907558402, + "meanRelativeL2": 0.17694386467337608, + "maxAbsDelta": 5.625 + }, + { + "stage": "layer_16", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9805516748084235, + "meanRelativeL2": 0.17629863694310188, + "maxAbsDelta": 5.875 + }, + { + "stage": "layer_17", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9813417466645388, + "meanRelativeL2": 0.1734682284295559, + "maxAbsDelta": 6.53125 + }, + { + "stage": "layer_18", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9816750103665381, + "meanRelativeL2": 0.1729007251560688, + "maxAbsDelta": 7.5546875 + }, + { + "stage": "layer_19", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9807378662001226, + "meanRelativeL2": 0.17656870558857918, + "maxAbsDelta": 8.125 + }, + { + "stage": "layer_20", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9798698597347614, + "meanRelativeL2": 0.1810380555689335, + "maxAbsDelta": 8.375 + }, + { + "stage": "layer_21", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9776560535135957, + "meanRelativeL2": 0.18994921445846558, + "maxAbsDelta": 9 + }, + { + "stage": "layer_22", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9770329527019226, + "meanRelativeL2": 0.19187524914741516, + "maxAbsDelta": 11 + }, + { + "stage": "layer_23", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9799174359164287, + "meanRelativeL2": 0.18264348804950714, + "maxAbsDelta": 14.5 + }, + { + "stage": "layer_24", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9830111775201621, + "meanRelativeL2": 0.1685798205435276, + "maxAbsDelta": 70 + }, + { + "stage": "layer_25", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9865406155586243, + "meanRelativeL2": 0.15046337991952896, + "maxAbsDelta": 70 + }, + { + "stage": "layer_26", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9876895620650852, + "meanRelativeL2": 0.14754068292677402, + "maxAbsDelta": 55 + }, + { + "stage": "final_norm", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9768674207716873, + "meanRelativeL2": 0.19814925640821457, + "maxAbsDelta": 4.59375 + } + ], + "period_at_s0": [ + { + "stage": "embedding", + "tokens": 97, + "exactRows": 97, + "meanCosine": 1, + "meanRelativeL2": 0, + "maxAbsDelta": 0 + }, + { + "stage": "layer_00", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9860546183340329, + "meanRelativeL2": 0.16530156880617142, + "maxAbsDelta": 0.28125 + }, + { + "stage": "layer_01", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9864795982223196, + "meanRelativeL2": 0.16053880006074905, + "maxAbsDelta": 0.3125 + }, + { + "stage": "layer_02", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9845318400982729, + "meanRelativeL2": 0.17228179425001144, + "maxAbsDelta": 0.431640625 + }, + { + "stage": "layer_03", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9857709358647927, + "meanRelativeL2": 0.16581114754080772, + "maxAbsDelta": 0.3984375 + }, + { + "stage": "layer_04", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9870004236083669, + "meanRelativeL2": 0.15812790393829346, + "maxAbsDelta": 0.53125 + }, + { + "stage": "layer_05", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9853649440499925, + "meanRelativeL2": 0.1673477292060852, + "maxAbsDelta": 0.671875 + }, + { + "stage": "layer_06", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9859525376988441, + "meanRelativeL2": 0.1638312228024006, + "maxAbsDelta": 1.28125 + }, + { + "stage": "layer_07", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.985222402921657, + "meanRelativeL2": 0.1668432094156742, + "maxAbsDelta": 0.6875 + }, + { + "stage": "layer_08", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9839105741264894, + "meanRelativeL2": 0.17452574521303177, + "maxAbsDelta": 0.84375 + }, + { + "stage": "layer_09", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9865447454845783, + "meanRelativeL2": 0.15971745923161507, + "maxAbsDelta": 1.5625 + }, + { + "stage": "layer_10", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9857189968689201, + "meanRelativeL2": 0.16313006728887558, + "maxAbsDelta": 1.25 + }, + { + "stage": "layer_11", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9889325763761383, + "meanRelativeL2": 0.14422748982906342, + "maxAbsDelta": 1.0625 + }, + { + "stage": "layer_12", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9881422390642854, + "meanRelativeL2": 0.14896738529205322, + "maxAbsDelta": 1.3125 + }, + { + "stage": "layer_13", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9885254465427595, + "meanRelativeL2": 0.14572157710790634, + "maxAbsDelta": 1.6875 + }, + { + "stage": "layer_14", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9891707897186279, + "meanRelativeL2": 0.14102599769830704, + "maxAbsDelta": 2.1875 + }, + { + "stage": "layer_15", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9896253027866796, + "meanRelativeL2": 0.13681676425039768, + "maxAbsDelta": 2.8125 + }, + { + "stage": "layer_16", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9894861499058831, + "meanRelativeL2": 0.1370016299188137, + "maxAbsDelta": 3.59375 + }, + { + "stage": "layer_17", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9899161089326918, + "meanRelativeL2": 0.13395394943654537, + "maxAbsDelta": 4.25 + }, + { + "stage": "layer_18", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9901459696366615, + "meanRelativeL2": 0.13262955844402313, + "maxAbsDelta": 6 + }, + { + "stage": "layer_19", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9895389719107717, + "meanRelativeL2": 0.13614565134048462, + "maxAbsDelta": 6.25 + }, + { + "stage": "layer_20", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9893845270589455, + "meanRelativeL2": 0.1366540901362896, + "maxAbsDelta": 6.5 + }, + { + "stage": "layer_21", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9886982901809142, + "meanRelativeL2": 0.14058993011713028, + "maxAbsDelta": 8 + }, + { + "stage": "layer_22", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.988594343981792, + "meanRelativeL2": 0.1412343494594097, + "maxAbsDelta": 9.75 + }, + { + "stage": "layer_23", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9893394481275499, + "meanRelativeL2": 0.13511443510651588, + "maxAbsDelta": 12.5 + }, + { + "stage": "layer_24", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9905871349511687, + "meanRelativeL2": 0.12528366036713123, + "maxAbsDelta": 19 + }, + { + "stage": "layer_25", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.992682158946991, + "meanRelativeL2": 0.11021177656948566, + "maxAbsDelta": 33 + }, + { + "stage": "layer_26", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9949770993793133, + "meanRelativeL2": 0.09602981619536877, + "maxAbsDelta": 35 + }, + { + "stage": "final_norm", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9895670438550183, + "meanRelativeL2": 0.13415822386741638, + "maxAbsDelta": 1.8671875 + } + ], + "period_at_s1": [ + { + "stage": "embedding", + "tokens": 97, + "exactRows": 97, + "meanCosine": 1, + "meanRelativeL2": 0, + "maxAbsDelta": 0 + }, + { + "stage": "layer_00", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9875103302837647, + "meanRelativeL2": 0.15669699013233185, + "maxAbsDelta": 0.265625 + }, + { + "stage": "layer_01", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9836940181624029, + "meanRelativeL2": 0.1756085455417633, + "maxAbsDelta": 0.3515625 + }, + { + "stage": "layer_02", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.978542071642335, + "meanRelativeL2": 0.2015603743493557, + "maxAbsDelta": 0.5546875 + }, + { + "stage": "layer_03", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9790770995248225, + "meanRelativeL2": 0.1997307986021042, + "maxAbsDelta": 0.57421875 + }, + { + "stage": "layer_04", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9806557641815894, + "meanRelativeL2": 0.19303227216005325, + "maxAbsDelta": 0.6640625 + }, + { + "stage": "layer_05", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9783789300426995, + "meanRelativeL2": 0.20344063267111778, + "maxAbsDelta": 0.765625 + }, + { + "stage": "layer_06", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9790865232035056, + "meanRelativeL2": 0.1994520053267479, + "maxAbsDelta": 1.21875 + }, + { + "stage": "layer_07", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9784575430388304, + "meanRelativeL2": 0.20170090720057487, + "maxAbsDelta": 0.859375 + }, + { + "stage": "layer_08", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9765694786592857, + "meanRelativeL2": 0.2084583267569542, + "maxAbsDelta": 1.28125 + }, + { + "stage": "layer_09", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9786674662963631, + "meanRelativeL2": 0.19452110677957535, + "maxAbsDelta": 1.96875 + }, + { + "stage": "layer_10", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9764244021828642, + "meanRelativeL2": 0.20228378847241402, + "maxAbsDelta": 2.875 + }, + { + "stage": "layer_11", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9803957465997676, + "meanRelativeL2": 0.18189718946814537, + "maxAbsDelta": 4.71875 + }, + { + "stage": "layer_12", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9780741297092634, + "meanRelativeL2": 0.18935932591557503, + "maxAbsDelta": 6.78125 + }, + { + "stage": "layer_13", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9785463662491631, + "meanRelativeL2": 0.1877504698932171, + "maxAbsDelta": 5.359375 + }, + { + "stage": "layer_14", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9789047437844817, + "meanRelativeL2": 0.18634135276079178, + "maxAbsDelta": 5.5625 + }, + { + "stage": "layer_15", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9792118447343099, + "meanRelativeL2": 0.18387595936655998, + "maxAbsDelta": 5.875 + }, + { + "stage": "layer_16", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9788104461640427, + "meanRelativeL2": 0.18400337174534798, + "maxAbsDelta": 6.4375 + }, + { + "stage": "layer_17", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9795692483174432, + "meanRelativeL2": 0.18118667975068092, + "maxAbsDelta": 7.5 + }, + { + "stage": "layer_18", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.979665995258646, + "meanRelativeL2": 0.18127166479825974, + "maxAbsDelta": 8.6875 + }, + { + "stage": "layer_19", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.978536312727584, + "meanRelativeL2": 0.1849892996251583, + "maxAbsDelta": 9.75 + }, + { + "stage": "layer_20", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9772731403714603, + "meanRelativeL2": 0.19106340035796165, + "maxAbsDelta": 10 + }, + { + "stage": "layer_21", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9752495135228658, + "meanRelativeL2": 0.19905337691307068, + "maxAbsDelta": 12 + }, + { + "stage": "layer_22", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9746075229546458, + "meanRelativeL2": 0.20136453211307526, + "maxAbsDelta": 14.5 + }, + { + "stage": "layer_23", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.977466256962609, + "meanRelativeL2": 0.19206217676401138, + "maxAbsDelta": 18.25 + }, + { + "stage": "layer_24", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9805533953548706, + "meanRelativeL2": 0.17854344472289085, + "maxAbsDelta": 66 + }, + { + "stage": "layer_25", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9843295081374571, + "meanRelativeL2": 0.15997817367315292, + "maxAbsDelta": 66 + }, + { + "stage": "layer_26", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9854521093909273, + "meanRelativeL2": 0.16074728593230247, + "maxAbsDelta": 88 + }, + { + "stage": "final_norm", + "tokens": 97, + "exactRows": 0, + "meanCosine": 0.9736688204647339, + "meanRelativeL2": 0.21141131967306137, + "maxAbsDelta": 4.65625 + } + ] + }, + "code": { + "system_eos": [ + { + "stage": "embedding", + "tokens": 436, + "exactRows": 436, + "meanCosine": 1, + "meanRelativeL2": 0, + "maxAbsDelta": 0 + }, + { + "stage": "layer_00", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9991194564814961, + "meanRelativeL2": 0.0423756567761302, + "maxAbsDelta": 0.1640625 + }, + { + "stage": "layer_01", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9984984403356499, + "meanRelativeL2": 0.053866494446992874, + "maxAbsDelta": 0.2109375 + }, + { + "stage": "layer_02", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9982073389062094, + "meanRelativeL2": 0.058640980161726475, + "maxAbsDelta": 0.3125 + }, + { + "stage": "layer_03", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9981082789941665, + "meanRelativeL2": 0.05978950299322605, + "maxAbsDelta": 0.3125 + }, + { + "stage": "layer_04", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9982615911632503, + "meanRelativeL2": 0.0557299442589283, + "maxAbsDelta": 0.21875 + }, + { + "stage": "layer_05", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.997707590870901, + "meanRelativeL2": 0.06310795061290264, + "maxAbsDelta": 0.21875 + }, + { + "stage": "layer_06", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9974405079259785, + "meanRelativeL2": 0.06609529443085194, + "maxAbsDelta": 0.546875 + }, + { + "stage": "layer_07", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9968606214457696, + "meanRelativeL2": 0.07271319255232811, + "maxAbsDelta": 0.421875 + }, + { + "stage": "layer_08", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9961938691248587, + "meanRelativeL2": 0.0804244801402092, + "maxAbsDelta": 0.828125 + }, + { + "stage": "layer_09", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9961407417004261, + "meanRelativeL2": 0.08025349862873554, + "maxAbsDelta": 1.296875 + }, + { + "stage": "layer_10", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9957117837503415, + "meanRelativeL2": 0.08525238558650017, + "maxAbsDelta": 1.75 + }, + { + "stage": "layer_11", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.995812740347801, + "meanRelativeL2": 0.08578886650502682, + "maxAbsDelta": 1.875 + }, + { + "stage": "layer_12", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9947921371241228, + "meanRelativeL2": 0.09458448179066181, + "maxAbsDelta": 1.71875 + }, + { + "stage": "layer_13", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9945308172374691, + "meanRelativeL2": 0.09745250083506107, + "maxAbsDelta": 2.21875 + }, + { + "stage": "layer_14", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9939997103236137, + "meanRelativeL2": 0.1019438598304987, + "maxAbsDelta": 2.0625 + }, + { + "stage": "layer_15", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9936883712033613, + "meanRelativeL2": 0.10486324317753315, + "maxAbsDelta": 2.375 + }, + { + "stage": "layer_16", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9933987429382605, + "meanRelativeL2": 0.10753732174634933, + "maxAbsDelta": 2.46875 + }, + { + "stage": "layer_17", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9938608041597069, + "meanRelativeL2": 0.10391135700047016, + "maxAbsDelta": 2.5625 + }, + { + "stage": "layer_18", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9936918556143385, + "meanRelativeL2": 0.1056858990341425, + "maxAbsDelta": 2.8125 + }, + { + "stage": "layer_19", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9935262837541212, + "meanRelativeL2": 0.10634918697178364, + "maxAbsDelta": 4.3125 + }, + { + "stage": "layer_20", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9936115550338676, + "meanRelativeL2": 0.10562202334403992, + "maxAbsDelta": 3.75 + }, + { + "stage": "layer_21", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9928051222354994, + "meanRelativeL2": 0.11259733326733112, + "maxAbsDelta": 4.8125 + }, + { + "stage": "layer_22", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.992168383587391, + "meanRelativeL2": 0.11565688066184521, + "maxAbsDelta": 5.125 + }, + { + "stage": "layer_23", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9928845481588207, + "meanRelativeL2": 0.10940071754157543, + "maxAbsDelta": 8.375 + }, + { + "stage": "layer_24", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.991869709633906, + "meanRelativeL2": 0.10436085239052773, + "maxAbsDelta": 336.8359375 + }, + { + "stage": "layer_25", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9934643668319108, + "meanRelativeL2": 0.0910520926117897, + "maxAbsDelta": 338.359375 + }, + { + "stage": "layer_26", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9937676451074968, + "meanRelativeL2": 0.1048441119492054, + "maxAbsDelta": 60.25 + }, + { + "stage": "final_norm", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9914303643440981, + "meanRelativeL2": 0.11346270330250263, + "maxAbsDelta": 6.92578125 + } + ], + "system_bos": [ + { + "stage": "embedding", + "tokens": 436, + "exactRows": 436, + "meanCosine": 1, + "meanRelativeL2": 0, + "maxAbsDelta": 0 + }, + { + "stage": "layer_00", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9988313787574068, + "meanRelativeL2": 0.04715094808489084, + "maxAbsDelta": 0.171875 + }, + { + "stage": "layer_01", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9971417462060211, + "meanRelativeL2": 0.07287385873496532, + "maxAbsDelta": 0.1796875 + }, + { + "stage": "layer_02", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9965506677233845, + "meanRelativeL2": 0.08043256215751171, + "maxAbsDelta": 0.359375 + }, + { + "stage": "layer_03", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9961963952134508, + "meanRelativeL2": 0.0843890830874443, + "maxAbsDelta": 0.34375 + }, + { + "stage": "layer_04", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9965450184060893, + "meanRelativeL2": 0.07991911098361015, + "maxAbsDelta": 0.34375 + }, + { + "stage": "layer_05", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9959048328049686, + "meanRelativeL2": 0.0863291583955288, + "maxAbsDelta": 0.3125 + }, + { + "stage": "layer_06", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9956963270082386, + "meanRelativeL2": 0.08752267621457577, + "maxAbsDelta": 0.375 + }, + { + "stage": "layer_07", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9950055127296973, + "meanRelativeL2": 0.0947727132588625, + "maxAbsDelta": 0.5625 + }, + { + "stage": "layer_08", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9944864976296731, + "meanRelativeL2": 0.09948013722896576, + "maxAbsDelta": 0.625 + }, + { + "stage": "layer_09", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9946902137283885, + "meanRelativeL2": 0.09697967022657394, + "maxAbsDelta": 0.671875 + }, + { + "stage": "layer_10", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9941473441933273, + "meanRelativeL2": 0.10222268290817738, + "maxAbsDelta": 1 + }, + { + "stage": "layer_11", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9947673063212579, + "meanRelativeL2": 0.09712001495063305, + "maxAbsDelta": 1.375 + }, + { + "stage": "layer_12", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9938803473743824, + "meanRelativeL2": 0.10491310246288776, + "maxAbsDelta": 1.5078125 + }, + { + "stage": "layer_13", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9935682888971556, + "meanRelativeL2": 0.1080907043069601, + "maxAbsDelta": 1.796875 + }, + { + "stage": "layer_14", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9931642579922982, + "meanRelativeL2": 0.1111039500683546, + "maxAbsDelta": 1.625 + }, + { + "stage": "layer_15", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9929409103656034, + "meanRelativeL2": 0.11284764297306538, + "maxAbsDelta": 2.75 + }, + { + "stage": "layer_16", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9924542625016028, + "meanRelativeL2": 0.11639132723212242, + "maxAbsDelta": 3.6875 + }, + { + "stage": "layer_17", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9929123898164942, + "meanRelativeL2": 0.11279741860926151, + "maxAbsDelta": 3.875 + }, + { + "stage": "layer_18", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9929069983303, + "meanRelativeL2": 0.11296755634248257, + "maxAbsDelta": 4.625 + }, + { + "stage": "layer_19", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9929201067040819, + "meanRelativeL2": 0.11314405128359795, + "maxAbsDelta": 4.09375 + }, + { + "stage": "layer_20", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9931587363601825, + "meanRelativeL2": 0.11143541522324085, + "maxAbsDelta": 3.65625 + }, + { + "stage": "layer_21", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9925297200679779, + "meanRelativeL2": 0.11713584326207638, + "maxAbsDelta": 4.25 + }, + { + "stage": "layer_22", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9919617873266202, + "meanRelativeL2": 0.12026701867580414, + "maxAbsDelta": 4.5 + }, + { + "stage": "layer_23", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9929464451216776, + "meanRelativeL2": 0.11278097331523895, + "maxAbsDelta": 8.25 + }, + { + "stage": "layer_24", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9938668469223407, + "meanRelativeL2": 0.10502118431031704, + "maxAbsDelta": 40 + }, + { + "stage": "layer_25", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9955622931139185, + "meanRelativeL2": 0.09030215814709663, + "maxAbsDelta": 42 + }, + { + "stage": "layer_26", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9945072862533254, + "meanRelativeL2": 0.10809551365673542, + "maxAbsDelta": 69.25 + }, + { + "stage": "final_norm", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9933934452336862, + "meanRelativeL2": 0.10973822884261608, + "maxAbsDelta": 4.4375 + } + ], + "system_x": [ + { + "stage": "embedding", + "tokens": 436, + "exactRows": 436, + "meanCosine": 1, + "meanRelativeL2": 0, + "maxAbsDelta": 0 + }, + { + "stage": "layer_00", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9988875911323303, + "meanRelativeL2": 0.04603985045105219, + "maxAbsDelta": 0.171875 + }, + { + "stage": "layer_01", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9961212657460379, + "meanRelativeL2": 0.08296489156782627, + "maxAbsDelta": 0.2109375 + }, + { + "stage": "layer_02", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9951648209073128, + "meanRelativeL2": 0.09281536564230919, + "maxAbsDelta": 0.421875 + }, + { + "stage": "layer_03", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9945436634054972, + "meanRelativeL2": 0.09775794297456741, + "maxAbsDelta": 0.375 + }, + { + "stage": "layer_04", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9951895223845035, + "meanRelativeL2": 0.09226137213408947, + "maxAbsDelta": 0.5 + }, + { + "stage": "layer_05", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9938999239457856, + "meanRelativeL2": 0.10358164831995964, + "maxAbsDelta": 0.40625 + }, + { + "stage": "layer_06", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9933307832534161, + "meanRelativeL2": 0.1080581545829773, + "maxAbsDelta": 0.625 + }, + { + "stage": "layer_07", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.992109465216278, + "meanRelativeL2": 0.11739796586334705, + "maxAbsDelta": 0.71875 + }, + { + "stage": "layer_08", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9904218198509391, + "meanRelativeL2": 0.1293300725519657, + "maxAbsDelta": 0.90625 + }, + { + "stage": "layer_09", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9895320821792708, + "meanRelativeL2": 0.13296411000192165, + "maxAbsDelta": 1.875 + }, + { + "stage": "layer_10", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9884432611662314, + "meanRelativeL2": 0.13973545096814632, + "maxAbsDelta": 1.9375 + }, + { + "stage": "layer_11", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9887660047329894, + "meanRelativeL2": 0.13756592571735382, + "maxAbsDelta": 2.75 + }, + { + "stage": "layer_12", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9874530664277733, + "meanRelativeL2": 0.14710105955600739, + "maxAbsDelta": 3 + }, + { + "stage": "layer_13", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.987011491978934, + "meanRelativeL2": 0.15006505511701107, + "maxAbsDelta": 2.9375 + }, + { + "stage": "layer_14", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9861624426797989, + "meanRelativeL2": 0.15577708557248116, + "maxAbsDelta": 4.8125 + }, + { + "stage": "layer_15", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9851333148982546, + "meanRelativeL2": 0.1618238277733326, + "maxAbsDelta": 6.5 + }, + { + "stage": "layer_16", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9841615199495893, + "meanRelativeL2": 0.16639337688684464, + "maxAbsDelta": 7.375 + }, + { + "stage": "layer_17", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9850781043188288, + "meanRelativeL2": 0.1615433730185032, + "maxAbsDelta": 7.78125 + }, + { + "stage": "layer_18", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9846651280691864, + "meanRelativeL2": 0.1637960970401764, + "maxAbsDelta": 9.5 + }, + { + "stage": "layer_19", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9841507197520055, + "meanRelativeL2": 0.16579585894942284, + "maxAbsDelta": 9 + }, + { + "stage": "layer_20", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9843055947658119, + "meanRelativeL2": 0.16549821570515633, + "maxAbsDelta": 8.5 + }, + { + "stage": "layer_21", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9825171623208108, + "meanRelativeL2": 0.17738549411296844, + "maxAbsDelta": 8.375 + }, + { + "stage": "layer_22", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9818479210958568, + "meanRelativeL2": 0.18003661930561066, + "maxAbsDelta": 9.25 + }, + { + "stage": "layer_23", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9846197035881358, + "meanRelativeL2": 0.16819001361727715, + "maxAbsDelta": 12.25 + }, + { + "stage": "layer_24", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9862009409917604, + "meanRelativeL2": 0.15782863460481167, + "maxAbsDelta": 106 + }, + { + "stage": "layer_25", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9898593103120087, + "meanRelativeL2": 0.13615765422582626, + "maxAbsDelta": 108 + }, + { + "stage": "layer_26", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9868213982757078, + "meanRelativeL2": 0.16346241906285286, + "maxAbsDelta": 56.25 + }, + { + "stage": "final_norm", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9830478984828389, + "meanRelativeL2": 0.17389409989118576, + "maxAbsDelta": 7.46875 + } + ], + "system_period": [ + { + "stage": "embedding", + "tokens": 436, + "exactRows": 436, + "meanCosine": 1, + "meanRelativeL2": 0, + "maxAbsDelta": 0 + }, + { + "stage": "layer_00", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9989169929005685, + "meanRelativeL2": 0.045541681349277496, + "maxAbsDelta": 0.1796875 + }, + { + "stage": "layer_01", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9961837521933634, + "meanRelativeL2": 0.08237910456955433, + "maxAbsDelta": 0.21875 + }, + { + "stage": "layer_02", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.995217052621579, + "meanRelativeL2": 0.09228567592799664, + "maxAbsDelta": 0.4375 + }, + { + "stage": "layer_03", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9945830970729163, + "meanRelativeL2": 0.09757843986153603, + "maxAbsDelta": 0.484375 + }, + { + "stage": "layer_04", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9951190702412107, + "meanRelativeL2": 0.09287460707128048, + "maxAbsDelta": 0.46875 + }, + { + "stage": "layer_05", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9936683484173696, + "meanRelativeL2": 0.10544364899396896, + "maxAbsDelta": 0.484375 + }, + { + "stage": "layer_06", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9929138720035553, + "meanRelativeL2": 0.11135821044445038, + "maxAbsDelta": 0.65625 + }, + { + "stage": "layer_07", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9918480436189459, + "meanRelativeL2": 0.11926894262433052, + "maxAbsDelta": 0.59375 + }, + { + "stage": "layer_08", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9905357527623483, + "meanRelativeL2": 0.12973038479685783, + "maxAbsDelta": 0.84375 + }, + { + "stage": "layer_09", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9903614179256859, + "meanRelativeL2": 0.12959151342511177, + "maxAbsDelta": 1.8125 + }, + { + "stage": "layer_10", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9896867504907311, + "meanRelativeL2": 0.13434532843530178, + "maxAbsDelta": 1.625 + }, + { + "stage": "layer_11", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.99009041529183, + "meanRelativeL2": 0.1318844836205244, + "maxAbsDelta": 3.09375 + }, + { + "stage": "layer_12", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9888051037394673, + "meanRelativeL2": 0.14103817753493786, + "maxAbsDelta": 2.3125 + }, + { + "stage": "layer_13", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9883531676519901, + "meanRelativeL2": 0.14417490363121033, + "maxAbsDelta": 2.375 + }, + { + "stage": "layer_14", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9873698536955983, + "meanRelativeL2": 0.15036264434456825, + "maxAbsDelta": 3.875 + }, + { + "stage": "layer_15", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9865091620782099, + "meanRelativeL2": 0.15567086450755596, + "maxAbsDelta": 5.625 + }, + { + "stage": "layer_16", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9859397463295438, + "meanRelativeL2": 0.15873435884714127, + "maxAbsDelta": 5.53125 + }, + { + "stage": "layer_17", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9867675345425212, + "meanRelativeL2": 0.15354274213314056, + "maxAbsDelta": 5.875 + }, + { + "stage": "layer_18", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9861044536489959, + "meanRelativeL2": 0.15690761618316174, + "maxAbsDelta": 7.5 + }, + { + "stage": "layer_19", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9861427682255386, + "meanRelativeL2": 0.15676414966583252, + "maxAbsDelta": 7.25 + }, + { + "stage": "layer_20", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9860008626902869, + "meanRelativeL2": 0.1578931100666523, + "maxAbsDelta": 6.25 + }, + { + "stage": "layer_21", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9841809794990295, + "meanRelativeL2": 0.1691933497786522, + "maxAbsDelta": 6.75 + }, + { + "stage": "layer_22", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9831356630412811, + "meanRelativeL2": 0.17287222668528557, + "maxAbsDelta": 8.25 + }, + { + "stage": "layer_23", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9853334938167432, + "meanRelativeL2": 0.16135307773947716, + "maxAbsDelta": 9 + }, + { + "stage": "layer_24", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.987104848437353, + "meanRelativeL2": 0.1499003078788519, + "maxAbsDelta": 34 + }, + { + "stage": "layer_25", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9905271254001408, + "meanRelativeL2": 0.12915202789008617, + "maxAbsDelta": 36 + }, + { + "stage": "layer_26", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9872343236700111, + "meanRelativeL2": 0.15454679355025291, + "maxAbsDelta": 41 + }, + { + "stage": "final_norm", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9829476472981479, + "meanRelativeL2": 0.1691609974950552, + "maxAbsDelta": 6.984375 + } + ], + "bos_at_s0": [ + { + "stage": "embedding", + "tokens": 436, + "exactRows": 436, + "meanCosine": 1, + "meanRelativeL2": 0, + "maxAbsDelta": 0 + }, + { + "stage": "layer_00", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9911926530916756, + "meanRelativeL2": 0.13123413547873497, + "maxAbsDelta": 0.1845703125 + }, + { + "stage": "layer_01", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9904460767540363, + "meanRelativeL2": 0.13668670505285263, + "maxAbsDelta": 0.259765625 + }, + { + "stage": "layer_02", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.99036056842279, + "meanRelativeL2": 0.1351760532706976, + "maxAbsDelta": 0.4375 + }, + { + "stage": "layer_03", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9911814340210836, + "meanRelativeL2": 0.12904848903417587, + "maxAbsDelta": 0.4375 + }, + { + "stage": "layer_04", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9928033813970898, + "meanRelativeL2": 0.1148658636957407, + "maxAbsDelta": 0.546875 + }, + { + "stage": "layer_05", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9917409365330268, + "meanRelativeL2": 0.12141995877027512, + "maxAbsDelta": 0.65625 + }, + { + "stage": "layer_06", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9923090486351503, + "meanRelativeL2": 0.11547669768333435, + "maxAbsDelta": 0.6953125 + }, + { + "stage": "layer_07", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.991800206243445, + "meanRelativeL2": 0.11948767676949501, + "maxAbsDelta": 0.724609375 + }, + { + "stage": "layer_08", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9910042980395326, + "meanRelativeL2": 0.12471842393279076, + "maxAbsDelta": 0.875 + }, + { + "stage": "layer_09", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9913740130739475, + "meanRelativeL2": 0.12115719728171825, + "maxAbsDelta": 1.15625 + }, + { + "stage": "layer_10", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9906387618922312, + "meanRelativeL2": 0.12623348645865917, + "maxAbsDelta": 1.4375 + }, + { + "stage": "layer_11", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9915118838122131, + "meanRelativeL2": 0.11899441666901112, + "maxAbsDelta": 1.9375 + }, + { + "stage": "layer_12", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9903362705073225, + "meanRelativeL2": 0.12766661867499352, + "maxAbsDelta": 3.0625 + }, + { + "stage": "layer_13", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9898317568345901, + "meanRelativeL2": 0.13106823153793812, + "maxAbsDelta": 3.1875 + }, + { + "stage": "layer_14", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9894943639225916, + "meanRelativeL2": 0.13329048827290535, + "maxAbsDelta": 3.0625 + }, + { + "stage": "layer_15", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9890566503782885, + "meanRelativeL2": 0.13531123660504818, + "maxAbsDelta": 3.25 + }, + { + "stage": "layer_16", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9886680633649914, + "meanRelativeL2": 0.13705525547266006, + "maxAbsDelta": 3.25 + }, + { + "stage": "layer_17", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9893275316155284, + "meanRelativeL2": 0.13265522569417953, + "maxAbsDelta": 4 + }, + { + "stage": "layer_18", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9889921748310054, + "meanRelativeL2": 0.13338383473455906, + "maxAbsDelta": 4.3671875 + }, + { + "stage": "layer_19", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.989014241400115, + "meanRelativeL2": 0.1341438852250576, + "maxAbsDelta": 4.515625 + }, + { + "stage": "layer_20", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9891245756127419, + "meanRelativeL2": 0.13220215402543545, + "maxAbsDelta": 5.15625 + }, + { + "stage": "layer_21", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9880053376385926, + "meanRelativeL2": 0.1392743568867445, + "maxAbsDelta": 5.3359375 + }, + { + "stage": "layer_22", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.986820875504695, + "meanRelativeL2": 0.14312139339745045, + "maxAbsDelta": 5.078125 + }, + { + "stage": "layer_23", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9882332753697667, + "meanRelativeL2": 0.13457008264958858, + "maxAbsDelta": 6.875 + }, + { + "stage": "layer_24", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.987808633561528, + "meanRelativeL2": 0.12794343382120132, + "maxAbsDelta": 336.8125 + }, + { + "stage": "layer_25", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9909984794778561, + "meanRelativeL2": 0.10722514800727367, + "maxAbsDelta": 338.375 + }, + { + "stage": "layer_26", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9924384601619265, + "meanRelativeL2": 0.10887778177857399, + "maxAbsDelta": 66.5 + }, + { + "stage": "final_norm", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9898423454083434, + "meanRelativeL2": 0.12262017838656902, + "maxAbsDelta": 7.55078125 + } + ], + "bos_at_s1": [ + { + "stage": "embedding", + "tokens": 436, + "exactRows": 436, + "meanCosine": 1, + "meanRelativeL2": 0, + "maxAbsDelta": 0 + }, + { + "stage": "layer_00", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9918786511508697, + "meanRelativeL2": 0.12637696042656898, + "maxAbsDelta": 0.181640625 + }, + { + "stage": "layer_01", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9900115022965528, + "meanRelativeL2": 0.14080525562167168, + "maxAbsDelta": 0.283203125 + }, + { + "stage": "layer_02", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9888776970019034, + "meanRelativeL2": 0.14558952674269676, + "maxAbsDelta": 0.46484375 + }, + { + "stage": "layer_03", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.989349613495923, + "meanRelativeL2": 0.14174732565879822, + "maxAbsDelta": 0.453125 + }, + { + "stage": "layer_04", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9912085051930278, + "meanRelativeL2": 0.12722913920879364, + "maxAbsDelta": 0.625 + }, + { + "stage": "layer_05", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.990101782006955, + "meanRelativeL2": 0.13337349146604538, + "maxAbsDelta": 0.67626953125 + }, + { + "stage": "layer_06", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9907305114859835, + "meanRelativeL2": 0.12712056748569012, + "maxAbsDelta": 0.6025390625 + }, + { + "stage": "layer_07", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9899718868076255, + "meanRelativeL2": 0.1323926318436861, + "maxAbsDelta": 0.8125 + }, + { + "stage": "layer_08", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9891329013973201, + "meanRelativeL2": 0.1376308798789978, + "maxAbsDelta": 0.984375 + }, + { + "stage": "layer_09", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9896110233363755, + "meanRelativeL2": 0.13350358791649342, + "maxAbsDelta": 1.25 + }, + { + "stage": "layer_10", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9886804657791732, + "meanRelativeL2": 0.13905898481607437, + "maxAbsDelta": 1.21875 + }, + { + "stage": "layer_11", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9895902978717734, + "meanRelativeL2": 0.132523562759161, + "maxAbsDelta": 1.96875 + }, + { + "stage": "layer_12", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9881147985611487, + "meanRelativeL2": 0.14249234087765217, + "maxAbsDelta": 2.75 + }, + { + "stage": "layer_13", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9876180354061477, + "meanRelativeL2": 0.1454981155693531, + "maxAbsDelta": 4.21875 + }, + { + "stage": "layer_14", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9872912969611106, + "meanRelativeL2": 0.1476045735180378, + "maxAbsDelta": 3.255859375 + }, + { + "stage": "layer_15", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9870676365467387, + "meanRelativeL2": 0.14880304411053658, + "maxAbsDelta": 3.9375 + }, + { + "stage": "layer_16", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9865698147257533, + "meanRelativeL2": 0.15107734873890877, + "maxAbsDelta": 4.4296875 + }, + { + "stage": "layer_17", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9874222839097364, + "meanRelativeL2": 0.14589251950383186, + "maxAbsDelta": 4.9140625 + }, + { + "stage": "layer_18", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9871056514595626, + "meanRelativeL2": 0.14690981805324554, + "maxAbsDelta": 6.5703125 + }, + { + "stage": "layer_19", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9868342356944303, + "meanRelativeL2": 0.1476350650191307, + "maxAbsDelta": 8.25 + }, + { + "stage": "layer_20", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9872573340704681, + "meanRelativeL2": 0.14487668685615063, + "maxAbsDelta": 7.0703125 + }, + { + "stage": "layer_21", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9861745585542206, + "meanRelativeL2": 0.15164575725793839, + "maxAbsDelta": 7.3583984375 + }, + { + "stage": "layer_22", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9852565434000907, + "meanRelativeL2": 0.15443995967507362, + "maxAbsDelta": 7.7265625 + }, + { + "stage": "layer_23", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9874258374949114, + "meanRelativeL2": 0.14288105815649033, + "maxAbsDelta": 9.1953125 + }, + { + "stage": "layer_24", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9892272481677729, + "meanRelativeL2": 0.13306567631661892, + "maxAbsDelta": 44 + }, + { + "stage": "layer_25", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9927789418522371, + "meanRelativeL2": 0.11050700023770332, + "maxAbsDelta": 46 + }, + { + "stage": "layer_26", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9924827095018615, + "meanRelativeL2": 0.1211932860314846, + "maxAbsDelta": 74.5 + }, + { + "stage": "final_norm", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9894528123763723, + "meanRelativeL2": 0.1271127350628376, + "maxAbsDelta": 8.625 + } + ], + "x_at_s0": [ + { + "stage": "embedding", + "tokens": 436, + "exactRows": 436, + "meanCosine": 1, + "meanRelativeL2": 0, + "maxAbsDelta": 0 + }, + { + "stage": "layer_00", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9919555611019835, + "meanRelativeL2": 0.12448691017925739, + "maxAbsDelta": 0.193359375 + }, + { + "stage": "layer_01", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9909806617903053, + "meanRelativeL2": 0.13147465139627457, + "maxAbsDelta": 0.3359375 + }, + { + "stage": "layer_02", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9899655003613288, + "meanRelativeL2": 0.13491247594356537, + "maxAbsDelta": 0.546875 + }, + { + "stage": "layer_03", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.99022535118488, + "meanRelativeL2": 0.13139390386641026, + "maxAbsDelta": 0.5703125 + }, + { + "stage": "layer_04", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9913948077127475, + "meanRelativeL2": 0.12058020196855068, + "maxAbsDelta": 0.68359375 + }, + { + "stage": "layer_05", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9900982497482125, + "meanRelativeL2": 0.12676756642758846, + "maxAbsDelta": 0.80859375 + }, + { + "stage": "layer_06", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9904499157853083, + "meanRelativeL2": 0.12313635274767876, + "maxAbsDelta": 1.0302734375 + }, + { + "stage": "layer_07", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9896034272985721, + "meanRelativeL2": 0.12925012223422527, + "maxAbsDelta": 1.1875 + }, + { + "stage": "layer_08", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9886725629688403, + "meanRelativeL2": 0.13555365242064, + "maxAbsDelta": 1.328125 + }, + { + "stage": "layer_09", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.989127384413273, + "meanRelativeL2": 0.13246910274028778, + "maxAbsDelta": 1.640625 + }, + { + "stage": "layer_10", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.988255127034056, + "meanRelativeL2": 0.13822259940207005, + "maxAbsDelta": 1.96875 + }, + { + "stage": "layer_11", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9896429257655363, + "meanRelativeL2": 0.12962806411087513, + "maxAbsDelta": 2.40625 + }, + { + "stage": "layer_12", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9883824972384566, + "meanRelativeL2": 0.13912185095250607, + "maxAbsDelta": 3.5625 + }, + { + "stage": "layer_13", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9878951570856462, + "meanRelativeL2": 0.142718393355608, + "maxAbsDelta": 4.375 + }, + { + "stage": "layer_14", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.987606309696075, + "meanRelativeL2": 0.14458194188773632, + "maxAbsDelta": 4 + }, + { + "stage": "layer_15", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9874009170116634, + "meanRelativeL2": 0.1460558157414198, + "maxAbsDelta": 4.125 + }, + { + "stage": "layer_16", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9868665507080359, + "meanRelativeL2": 0.14868313632905483, + "maxAbsDelta": 3.9375 + }, + { + "stage": "layer_17", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9877244354388036, + "meanRelativeL2": 0.14427532441914082, + "maxAbsDelta": 4.09375 + }, + { + "stage": "layer_18", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9874619464261816, + "meanRelativeL2": 0.1449620109051466, + "maxAbsDelta": 5.5 + }, + { + "stage": "layer_19", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9875397704063206, + "meanRelativeL2": 0.14569714479148388, + "maxAbsDelta": 4.5625 + }, + { + "stage": "layer_20", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.987720442747851, + "meanRelativeL2": 0.1440585944801569, + "maxAbsDelta": 7 + }, + { + "stage": "layer_21", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9865790873492529, + "meanRelativeL2": 0.15099207311868668, + "maxAbsDelta": 8.375 + }, + { + "stage": "layer_22", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9858467983543326, + "meanRelativeL2": 0.15345454961061478, + "maxAbsDelta": 8.5 + }, + { + "stage": "layer_23", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9876964770325827, + "meanRelativeL2": 0.14259721897542477, + "maxAbsDelta": 14 + }, + { + "stage": "layer_24", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9875880187257714, + "meanRelativeL2": 0.13430839218199253, + "maxAbsDelta": 336.828125 + }, + { + "stage": "layer_25", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9911591875443765, + "meanRelativeL2": 0.11123156547546387, + "maxAbsDelta": 338.3671875 + }, + { + "stage": "layer_26", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9926733683555498, + "meanRelativeL2": 0.11269650235772133, + "maxAbsDelta": 68.25 + }, + { + "stage": "final_norm", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9901158973711346, + "meanRelativeL2": 0.12422864511609077, + "maxAbsDelta": 8.15625 + } + ], + "x_at_s1": [ + { + "stage": "embedding", + "tokens": 436, + "exactRows": 436, + "meanCosine": 1, + "meanRelativeL2": 0, + "maxAbsDelta": 0 + }, + { + "stage": "layer_00", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.992377631161191, + "meanRelativeL2": 0.12194844149053097, + "maxAbsDelta": 0.203125 + }, + { + "stage": "layer_01", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9894753497674924, + "meanRelativeL2": 0.14314178004860878, + "maxAbsDelta": 0.361328125 + }, + { + "stage": "layer_02", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9871937473979565, + "meanRelativeL2": 0.15273893997073174, + "maxAbsDelta": 0.5859375 + }, + { + "stage": "layer_03", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.98701295365981, + "meanRelativeL2": 0.15109222754836082, + "maxAbsDelta": 0.55859375 + }, + { + "stage": "layer_04", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9884619786651856, + "meanRelativeL2": 0.14075205102562904, + "maxAbsDelta": 0.728515625 + }, + { + "stage": "layer_05", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9866733570164496, + "meanRelativeL2": 0.14962919056415558, + "maxAbsDelta": 0.888671875 + }, + { + "stage": "layer_06", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9865544077453263, + "meanRelativeL2": 0.14804479107260704, + "maxAbsDelta": 1.234375 + }, + { + "stage": "layer_07", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9854384152167434, + "meanRelativeL2": 0.15619122609496117, + "maxAbsDelta": 1.4111328125 + }, + { + "stage": "layer_08", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9838378530576688, + "meanRelativeL2": 0.1640043631196022, + "maxAbsDelta": 1.474609375 + }, + { + "stage": "layer_09", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.983780496711031, + "meanRelativeL2": 0.16231698170304298, + "maxAbsDelta": 2.25 + }, + { + "stage": "layer_10", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.982418273293644, + "meanRelativeL2": 0.16961415112018585, + "maxAbsDelta": 3.28125 + }, + { + "stage": "layer_11", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9840792666334625, + "meanRelativeL2": 0.16106581315398216, + "maxAbsDelta": 3.96875 + }, + { + "stage": "layer_12", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9826871722663214, + "meanRelativeL2": 0.17142564430832863, + "maxAbsDelta": 2.875 + }, + { + "stage": "layer_13", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9822351380225716, + "meanRelativeL2": 0.17431879043579102, + "maxAbsDelta": 3.71875 + }, + { + "stage": "layer_14", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9819118771531167, + "meanRelativeL2": 0.1768936552107334, + "maxAbsDelta": 4.4375 + }, + { + "stage": "layer_15", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9815095991169641, + "meanRelativeL2": 0.17953868210315704, + "maxAbsDelta": 5.875 + }, + { + "stage": "layer_16", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9810705586857752, + "meanRelativeL2": 0.18152374401688576, + "maxAbsDelta": 6.25 + }, + { + "stage": "layer_17", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9826062592344547, + "meanRelativeL2": 0.17522775381803513, + "maxAbsDelta": 6.375 + }, + { + "stage": "layer_18", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9820898393972204, + "meanRelativeL2": 0.17763835191726685, + "maxAbsDelta": 8.625 + }, + { + "stage": "layer_19", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9817086119170583, + "meanRelativeL2": 0.1797352135181427, + "maxAbsDelta": 7.5 + }, + { + "stage": "layer_20", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9822053160142461, + "meanRelativeL2": 0.17752514779567719, + "maxAbsDelta": 7.625 + }, + { + "stage": "layer_21", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9804867328306951, + "meanRelativeL2": 0.18693525344133377, + "maxAbsDelta": 8.375 + }, + { + "stage": "layer_22", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9798573034072141, + "meanRelativeL2": 0.18893539533019066, + "maxAbsDelta": 9.5 + }, + { + "stage": "layer_23", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9830525911182438, + "meanRelativeL2": 0.17575684189796448, + "maxAbsDelta": 14 + }, + { + "stage": "layer_24", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9850258023367016, + "meanRelativeL2": 0.16378528624773026, + "maxAbsDelta": 42 + }, + { + "stage": "layer_25", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9899301586347983, + "meanRelativeL2": 0.13561217114329338, + "maxAbsDelta": 44 + }, + { + "stage": "layer_26", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9895667726293617, + "meanRelativeL2": 0.1439517606049776, + "maxAbsDelta": 53 + }, + { + "stage": "final_norm", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9852169481439328, + "meanRelativeL2": 0.1573041807860136, + "maxAbsDelta": 4.328125 + } + ], + "period_at_s0": [ + { + "stage": "embedding", + "tokens": 436, + "exactRows": 436, + "meanCosine": 1, + "meanRelativeL2": 0, + "maxAbsDelta": 0 + }, + { + "stage": "layer_00", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9920772929257209, + "meanRelativeL2": 0.12367427162826061, + "maxAbsDelta": 0.19140625 + }, + { + "stage": "layer_01", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9911181639640703, + "meanRelativeL2": 0.13064318895339966, + "maxAbsDelta": 0.33203125 + }, + { + "stage": "layer_02", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9900573995135246, + "meanRelativeL2": 0.13482662476599216, + "maxAbsDelta": 0.5234375 + }, + { + "stage": "layer_03", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9902892667766011, + "meanRelativeL2": 0.1308216229081154, + "maxAbsDelta": 0.55859375 + }, + { + "stage": "layer_04", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9912564054541632, + "meanRelativeL2": 0.1207958273589611, + "maxAbsDelta": 0.6826171875 + }, + { + "stage": "layer_05", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.98994127872887, + "meanRelativeL2": 0.1273414734750986, + "maxAbsDelta": 0.791015625 + }, + { + "stage": "layer_06", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9901148028876803, + "meanRelativeL2": 0.12460602447390556, + "maxAbsDelta": 1.0771484375 + }, + { + "stage": "layer_07", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9892882991821395, + "meanRelativeL2": 0.13003427162766457, + "maxAbsDelta": 1.21875 + }, + { + "stage": "layer_08", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9883502601483546, + "meanRelativeL2": 0.1366587169468403, + "maxAbsDelta": 1.375 + }, + { + "stage": "layer_09", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9889951679137868, + "meanRelativeL2": 0.13284514471888542, + "maxAbsDelta": 1.5625 + }, + { + "stage": "layer_10", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9884250287069093, + "meanRelativeL2": 0.13740808703005314, + "maxAbsDelta": 2.1875 + }, + { + "stage": "layer_11", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9896221141749566, + "meanRelativeL2": 0.1297496184706688, + "maxAbsDelta": 2.53125 + }, + { + "stage": "layer_12", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9882686824426739, + "meanRelativeL2": 0.13963762111961842, + "maxAbsDelta": 4.15625 + }, + { + "stage": "layer_13", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9877476098887418, + "meanRelativeL2": 0.1431239563971758, + "maxAbsDelta": 5.15625 + }, + { + "stage": "layer_14", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9873503028252802, + "meanRelativeL2": 0.14538584649562836, + "maxAbsDelta": 5.1875 + }, + { + "stage": "layer_15", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9869502391837058, + "meanRelativeL2": 0.1477912776172161, + "maxAbsDelta": 4.625 + }, + { + "stage": "layer_16", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.986513271244294, + "meanRelativeL2": 0.14972533285617828, + "maxAbsDelta": 4.3125 + }, + { + "stage": "layer_17", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.987328071659858, + "meanRelativeL2": 0.14541717991232872, + "maxAbsDelta": 3.75 + }, + { + "stage": "layer_18", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9869068620401785, + "meanRelativeL2": 0.14630809426307678, + "maxAbsDelta": 4.3125 + }, + { + "stage": "layer_19", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9870125779864984, + "meanRelativeL2": 0.14715410768985748, + "maxAbsDelta": 3.75 + }, + { + "stage": "layer_20", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9872034583069863, + "meanRelativeL2": 0.1453571729362011, + "maxAbsDelta": 5.375 + }, + { + "stage": "layer_21", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.985969761642841, + "meanRelativeL2": 0.15224121138453484, + "maxAbsDelta": 6 + }, + { + "stage": "layer_22", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9851547616337417, + "meanRelativeL2": 0.15503445267677307, + "maxAbsDelta": 5.5 + }, + { + "stage": "layer_23", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9869438303173135, + "meanRelativeL2": 0.1447755265980959, + "maxAbsDelta": 9.5 + }, + { + "stage": "layer_24", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.986180342665506, + "meanRelativeL2": 0.1393674612045288, + "maxAbsDelta": 336.765625 + }, + { + "stage": "layer_25", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9900815549793593, + "meanRelativeL2": 0.1153418980538845, + "maxAbsDelta": 338.28125 + }, + { + "stage": "layer_26", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9916209794512583, + "meanRelativeL2": 0.11605134047567844, + "maxAbsDelta": 64.5 + }, + { + "stage": "final_norm", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9888813096448916, + "meanRelativeL2": 0.1308672595769167, + "maxAbsDelta": 8.171875 + } + ], + "period_at_s1": [ + { + "stage": "embedding", + "tokens": 436, + "exactRows": 436, + "meanCosine": 1, + "meanRelativeL2": 0, + "maxAbsDelta": 0 + }, + { + "stage": "layer_00", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9924457218122045, + "meanRelativeL2": 0.12145237065851688, + "maxAbsDelta": 0.201171875 + }, + { + "stage": "layer_01", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9895621759629031, + "meanRelativeL2": 0.14251042157411575, + "maxAbsDelta": 0.3515625 + }, + { + "stage": "layer_02", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9872771271871864, + "meanRelativeL2": 0.15250164270401, + "maxAbsDelta": 0.5703125 + }, + { + "stage": "layer_03", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9866907820789093, + "meanRelativeL2": 0.1520272009074688, + "maxAbsDelta": 0.5234375 + }, + { + "stage": "layer_04", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.988213484166959, + "meanRelativeL2": 0.14172053709626198, + "maxAbsDelta": 0.7734375 + }, + { + "stage": "layer_05", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9862976779631518, + "meanRelativeL2": 0.15089420974254608, + "maxAbsDelta": 0.9765625 + }, + { + "stage": "layer_06", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9858368296142018, + "meanRelativeL2": 0.1512051410973072, + "maxAbsDelta": 1.3095703125 + }, + { + "stage": "layer_07", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9845484916223298, + "meanRelativeL2": 0.15973972901701927, + "maxAbsDelta": 1.404296875 + }, + { + "stage": "layer_08", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9833391543922074, + "meanRelativeL2": 0.16725898534059525, + "maxAbsDelta": 1.34375 + }, + { + "stage": "layer_09", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9840219471979579, + "meanRelativeL2": 0.16274740174412727, + "maxAbsDelta": 1.96875 + }, + { + "stage": "layer_10", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9830993200660846, + "meanRelativeL2": 0.16823813691735268, + "maxAbsDelta": 3.1875 + }, + { + "stage": "layer_11", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9847076010266576, + "meanRelativeL2": 0.1595040038228035, + "maxAbsDelta": 5.3125 + }, + { + "stage": "layer_12", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9832263129566787, + "meanRelativeL2": 0.1699879877269268, + "maxAbsDelta": 5.40625 + }, + { + "stage": "layer_13", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.982762464962968, + "meanRelativeL2": 0.1728735901415348, + "maxAbsDelta": 5.9375 + }, + { + "stage": "layer_14", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.98222841910266, + "meanRelativeL2": 0.17618471011519432, + "maxAbsDelta": 5.84375 + }, + { + "stage": "layer_15", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9815463642461584, + "meanRelativeL2": 0.17952292785048485, + "maxAbsDelta": 6.46875 + }, + { + "stage": "layer_16", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9812680094613941, + "meanRelativeL2": 0.1807045340538025, + "maxAbsDelta": 6.4375 + }, + { + "stage": "layer_17", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9828099209234256, + "meanRelativeL2": 0.17383917793631554, + "maxAbsDelta": 4.25 + }, + { + "stage": "layer_18", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.982156737135091, + "meanRelativeL2": 0.17658643051981926, + "maxAbsDelta": 6 + }, + { + "stage": "layer_19", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9822373865941249, + "meanRelativeL2": 0.1766989752650261, + "maxAbsDelta": 5.375 + }, + { + "stage": "layer_20", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9825526128668304, + "meanRelativeL2": 0.17551331967115402, + "maxAbsDelta": 5.125 + }, + { + "stage": "layer_21", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9809031196690481, + "meanRelativeL2": 0.1838664449751377, + "maxAbsDelta": 5.25 + }, + { + "stage": "layer_22", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9800995227393754, + "meanRelativeL2": 0.1861586943268776, + "maxAbsDelta": 6.5 + }, + { + "stage": "layer_23", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9829965605648285, + "meanRelativeL2": 0.17253012210130692, + "maxAbsDelta": 9.5 + }, + { + "stage": "layer_24", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9850951651914404, + "meanRelativeL2": 0.16069379076361656, + "maxAbsDelta": 22.34375 + }, + { + "stage": "layer_25", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.989940248771545, + "meanRelativeL2": 0.13226859085261822, + "maxAbsDelta": 23.15625 + }, + { + "stage": "layer_26", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9895058498470062, + "meanRelativeL2": 0.13580158166587353, + "maxAbsDelta": 31 + }, + { + "stage": "final_norm", + "tokens": 436, + "exactRows": 0, + "meanCosine": 0.9854131630801279, + "meanRelativeL2": 0.1546247284859419, + "maxAbsDelta": 4.5 + } + ] + }, + "math": { + "system_eos": [ + { + "stage": "embedding", + "tokens": 344, + "exactRows": 344, + "meanCosine": 1, + "meanRelativeL2": 0, + "maxAbsDelta": 0 + }, + { + "stage": "layer_00", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9995998577323071, + "meanRelativeL2": 0.02502545597963035, + "maxAbsDelta": 0.125 + }, + { + "stage": "layer_01", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9990470762862715, + "meanRelativeL2": 0.04112933436408639, + "maxAbsDelta": 0.1171875 + }, + { + "stage": "layer_02", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9989064159088357, + "meanRelativeL2": 0.045280491933226585, + "maxAbsDelta": 0.140625 + }, + { + "stage": "layer_03", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9989103037257527, + "meanRelativeL2": 0.045530338771641254, + "maxAbsDelta": 0.10546875 + }, + { + "stage": "layer_04", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9989287870567899, + "meanRelativeL2": 0.04506920836865902, + "maxAbsDelta": 0.125 + }, + { + "stage": "layer_05", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.998525109401969, + "meanRelativeL2": 0.052421958185732365, + "maxAbsDelta": 0.203125 + }, + { + "stage": "layer_06", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9984638878079348, + "meanRelativeL2": 0.05285440478473902, + "maxAbsDelta": 0.1875 + }, + { + "stage": "layer_07", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9981176465056664, + "meanRelativeL2": 0.05783510580658913, + "maxAbsDelta": 0.359375 + }, + { + "stage": "layer_08", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9976015108269315, + "meanRelativeL2": 0.06347067933529615, + "maxAbsDelta": 0.375 + }, + { + "stage": "layer_09", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9977132140897041, + "meanRelativeL2": 0.061460440047085285, + "maxAbsDelta": 0.5 + }, + { + "stage": "layer_10", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9973908544972886, + "meanRelativeL2": 0.06601001601666212, + "maxAbsDelta": 0.4375 + }, + { + "stage": "layer_11", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9974708730398223, + "meanRelativeL2": 0.06594532076269388, + "maxAbsDelta": 0.625 + }, + { + "stage": "layer_12", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9970340524301973, + "meanRelativeL2": 0.07174564804881811, + "maxAbsDelta": 0.5625 + }, + { + "stage": "layer_13", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.996862526896388, + "meanRelativeL2": 0.07410797290503979, + "maxAbsDelta": 0.6875 + }, + { + "stage": "layer_14", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.996975414974745, + "meanRelativeL2": 0.07359951548278332, + "maxAbsDelta": 0.6875 + }, + { + "stage": "layer_15", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9969431411388309, + "meanRelativeL2": 0.07401647418737411, + "maxAbsDelta": 1.0625 + }, + { + "stage": "layer_16", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9969734643087831, + "meanRelativeL2": 0.07388936169445515, + "maxAbsDelta": 1 + }, + { + "stage": "layer_17", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9970621033463367, + "meanRelativeL2": 0.07282838970422745, + "maxAbsDelta": 1.25 + }, + { + "stage": "layer_18", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9972624931224557, + "meanRelativeL2": 0.07079395465552807, + "maxAbsDelta": 1.625 + }, + { + "stage": "layer_19", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9971206749594489, + "meanRelativeL2": 0.07298847287893295, + "maxAbsDelta": 1.375 + }, + { + "stage": "layer_20", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9973228490629862, + "meanRelativeL2": 0.07069481257349253, + "maxAbsDelta": 1.5 + }, + { + "stage": "layer_21", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.997097872717436, + "meanRelativeL2": 0.07458704337477684, + "maxAbsDelta": 2.125 + }, + { + "stage": "layer_22", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.997150274210198, + "meanRelativeL2": 0.07400523778051138, + "maxAbsDelta": 2.25 + }, + { + "stage": "layer_23", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9976410023694815, + "meanRelativeL2": 0.06754152849316597, + "maxAbsDelta": 3.5 + }, + { + "stage": "layer_24", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9980238734982735, + "meanRelativeL2": 0.061959365382790565, + "maxAbsDelta": 4 + }, + { + "stage": "layer_25", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9986052416091742, + "meanRelativeL2": 0.05223244056105614, + "maxAbsDelta": 7 + }, + { + "stage": "layer_26", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9983487094557563, + "meanRelativeL2": 0.06081343535333872, + "maxAbsDelta": 38 + }, + { + "stage": "final_norm", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9980488149232642, + "meanRelativeL2": 0.06144992262125015, + "maxAbsDelta": 1.65625 + } + ], + "system_bos": [ + { + "stage": "embedding", + "tokens": 344, + "exactRows": 344, + "meanCosine": 1, + "meanRelativeL2": 0, + "maxAbsDelta": 0 + }, + { + "stage": "layer_00", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9993601569602656, + "meanRelativeL2": 0.032888959627598524, + "maxAbsDelta": 0.15625 + }, + { + "stage": "layer_01", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9958058574865031, + "meanRelativeL2": 0.08775099739432335, + "maxAbsDelta": 0.3330078125 + }, + { + "stage": "layer_02", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9954368725072505, + "meanRelativeL2": 0.09309261664748192, + "maxAbsDelta": 0.404296875 + }, + { + "stage": "layer_03", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9958527389653894, + "meanRelativeL2": 0.08989178016781807, + "maxAbsDelta": 0.31298828125 + }, + { + "stage": "layer_04", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9963210135005242, + "meanRelativeL2": 0.0845332220196724, + "maxAbsDelta": 0.3203125 + }, + { + "stage": "layer_05", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9955691896205725, + "meanRelativeL2": 0.09189577214419842, + "maxAbsDelta": 0.34375 + }, + { + "stage": "layer_06", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.995717721276505, + "meanRelativeL2": 0.08887330442667007, + "maxAbsDelta": 0.78125 + }, + { + "stage": "layer_07", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9952078243327696, + "meanRelativeL2": 0.09298275224864483, + "maxAbsDelta": 1.15625 + }, + { + "stage": "layer_08", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9945440389389215, + "meanRelativeL2": 0.09835895337164402, + "maxAbsDelta": 0.84375 + }, + { + "stage": "layer_09", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9952403022799381, + "meanRelativeL2": 0.091556616127491, + "maxAbsDelta": 0.75 + }, + { + "stage": "layer_10", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.994714327329813, + "meanRelativeL2": 0.09610594250261784, + "maxAbsDelta": 0.65625 + }, + { + "stage": "layer_11", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9951965510845184, + "meanRelativeL2": 0.09228053875267506, + "maxAbsDelta": 0.9375 + }, + { + "stage": "layer_12", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.994590125458185, + "meanRelativeL2": 0.09875614754855633, + "maxAbsDelta": 1.125 + }, + { + "stage": "layer_13", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9945836261261342, + "meanRelativeL2": 0.09927609004080296, + "maxAbsDelta": 1.3125 + }, + { + "stage": "layer_14", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9949311683344286, + "meanRelativeL2": 0.09657429717481136, + "maxAbsDelta": 1.0625 + }, + { + "stage": "layer_15", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9950221354185149, + "meanRelativeL2": 0.09559806808829308, + "maxAbsDelta": 1.4375 + }, + { + "stage": "layer_16", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.995164446359457, + "meanRelativeL2": 0.09453430771827698, + "maxAbsDelta": 1.5 + }, + { + "stage": "layer_17", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9954220538222512, + "meanRelativeL2": 0.09213767014443874, + "maxAbsDelta": 1.625 + }, + { + "stage": "layer_18", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9958057102075842, + "meanRelativeL2": 0.08801481314003468, + "maxAbsDelta": 1.875 + }, + { + "stage": "layer_19", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9956776381925095, + "meanRelativeL2": 0.08971157297492027, + "maxAbsDelta": 2.125 + }, + { + "stage": "layer_20", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9960868725943011, + "meanRelativeL2": 0.08583627641201019, + "maxAbsDelta": 2.75 + }, + { + "stage": "layer_21", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.995894466028657, + "meanRelativeL2": 0.08899951912462711, + "maxAbsDelta": 3.25 + }, + { + "stage": "layer_22", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9960456999928452, + "meanRelativeL2": 0.08749006688594818, + "maxAbsDelta": 3.5 + }, + { + "stage": "layer_23", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9967857973520146, + "meanRelativeL2": 0.0792289013043046, + "maxAbsDelta": 5.5 + }, + { + "stage": "layer_24", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.997307303339936, + "meanRelativeL2": 0.07265179790556431, + "maxAbsDelta": 6.5 + }, + { + "stage": "layer_25", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9981444062188615, + "meanRelativeL2": 0.0607680631801486, + "maxAbsDelta": 9.625 + }, + { + "stage": "layer_26", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9979194517052451, + "meanRelativeL2": 0.06780684739351273, + "maxAbsDelta": 22 + }, + { + "stage": "final_norm", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9976069400476855, + "meanRelativeL2": 0.06928074173629284, + "maxAbsDelta": 1.93359375 + } + ], + "system_x": [ + { + "stage": "embedding", + "tokens": 344, + "exactRows": 344, + "meanCosine": 1, + "meanRelativeL2": 0, + "maxAbsDelta": 0 + }, + { + "stage": "layer_00", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.999403266366138, + "meanRelativeL2": 0.03236197913065553, + "maxAbsDelta": 0.125 + }, + { + "stage": "layer_01", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9945604503154755, + "meanRelativeL2": 0.10161176882684231, + "maxAbsDelta": 0.3212890625 + }, + { + "stage": "layer_02", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9938020103199537, + "meanRelativeL2": 0.11061941832304001, + "maxAbsDelta": 0.384765625 + }, + { + "stage": "layer_03", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9940087507630504, + "meanRelativeL2": 0.11077078804373741, + "maxAbsDelta": 0.2861328125 + }, + { + "stage": "layer_04", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9945020592489908, + "meanRelativeL2": 0.10548152588307858, + "maxAbsDelta": 0.2841796875 + }, + { + "stage": "layer_05", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9931318836156712, + "meanRelativeL2": 0.11614063940942287, + "maxAbsDelta": 0.40625 + }, + { + "stage": "layer_06", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9933698021395262, + "meanRelativeL2": 0.11209296993911266, + "maxAbsDelta": 0.6875 + }, + { + "stage": "layer_07", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9926928271387898, + "meanRelativeL2": 0.11688595451414585, + "maxAbsDelta": 1.03125 + }, + { + "stage": "layer_08", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.991714634521063, + "meanRelativeL2": 0.12286962941288948, + "maxAbsDelta": 0.90625 + }, + { + "stage": "layer_09", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9924695755160132, + "meanRelativeL2": 0.11613414064049721, + "maxAbsDelta": 1.125 + }, + { + "stage": "layer_10", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9918840437434441, + "meanRelativeL2": 0.12077958136796951, + "maxAbsDelta": 0.9375 + }, + { + "stage": "layer_11", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9924656412629194, + "meanRelativeL2": 0.11684564501047134, + "maxAbsDelta": 1.3125 + }, + { + "stage": "layer_12", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9914766359467839, + "meanRelativeL2": 0.12407336570322514, + "maxAbsDelta": 1.375 + }, + { + "stage": "layer_13", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9913515871347383, + "meanRelativeL2": 0.12558055855333805, + "maxAbsDelta": 1.5625 + }, + { + "stage": "layer_14", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.99169355284336, + "meanRelativeL2": 0.12414432317018509, + "maxAbsDelta": 1.5 + }, + { + "stage": "layer_15", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9918201007815295, + "meanRelativeL2": 0.12459168396890163, + "maxAbsDelta": 1.625 + }, + { + "stage": "layer_16", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.991904113874879, + "meanRelativeL2": 0.12407274916768074, + "maxAbsDelta": 1.75 + }, + { + "stage": "layer_17", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9922666158093962, + "meanRelativeL2": 0.12096128053963184, + "maxAbsDelta": 2.125 + }, + { + "stage": "layer_18", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9927539645239364, + "meanRelativeL2": 0.11726518347859383, + "maxAbsDelta": 2.375 + }, + { + "stage": "layer_19", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.992560550570488, + "meanRelativeL2": 0.11903289332985878, + "maxAbsDelta": 2.75 + }, + { + "stage": "layer_20", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9929166408472283, + "meanRelativeL2": 0.11677891947329044, + "maxAbsDelta": 3 + }, + { + "stage": "layer_21", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9920721993196843, + "meanRelativeL2": 0.12557978555560112, + "maxAbsDelta": 5.375 + }, + { + "stage": "layer_22", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9922987499902415, + "meanRelativeL2": 0.12381711229681969, + "maxAbsDelta": 5.25 + }, + { + "stage": "layer_23", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9937074316102404, + "meanRelativeL2": 0.11179383657872677, + "maxAbsDelta": 7.25 + }, + { + "stage": "layer_24", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9947687214197114, + "meanRelativeL2": 0.1022743508219719, + "maxAbsDelta": 7 + }, + { + "stage": "layer_25", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9961328073296436, + "meanRelativeL2": 0.08830327540636063, + "maxAbsDelta": 21.5 + }, + { + "stage": "layer_26", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9945657034946043, + "meanRelativeL2": 0.1150177214294672, + "maxAbsDelta": 47.375 + }, + { + "stage": "final_norm", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9935832813728688, + "meanRelativeL2": 0.1109213512390852, + "maxAbsDelta": 4.6982421875 + } + ], + "system_period": [ + { + "stage": "embedding", + "tokens": 344, + "exactRows": 344, + "meanCosine": 1, + "meanRelativeL2": 0, + "maxAbsDelta": 0 + }, + { + "stage": "layer_00", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9994397572306699, + "meanRelativeL2": 0.031385486014187336, + "maxAbsDelta": 0.1171875 + }, + { + "stage": "layer_01", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9946366673292115, + "meanRelativeL2": 0.10102647915482521, + "maxAbsDelta": 0.2998046875 + }, + { + "stage": "layer_02", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9940018924169762, + "meanRelativeL2": 0.1092149131000042, + "maxAbsDelta": 0.3349609375 + }, + { + "stage": "layer_03", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9940839205370393, + "meanRelativeL2": 0.11022156663239002, + "maxAbsDelta": 0.259765625 + }, + { + "stage": "layer_04", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9944433504065802, + "meanRelativeL2": 0.10607698187232018, + "maxAbsDelta": 0.2626953125 + }, + { + "stage": "layer_05", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9928246975638145, + "meanRelativeL2": 0.1184824462980032, + "maxAbsDelta": 0.40625 + }, + { + "stage": "layer_06", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.992931665722714, + "meanRelativeL2": 0.115562928840518, + "maxAbsDelta": 0.6875 + }, + { + "stage": "layer_07", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.992185054476871, + "meanRelativeL2": 0.12071321904659271, + "maxAbsDelta": 1.0625 + }, + { + "stage": "layer_08", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9910106884185658, + "meanRelativeL2": 0.12838044203817844, + "maxAbsDelta": 0.8125 + }, + { + "stage": "layer_09", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9919909315053806, + "meanRelativeL2": 0.12057995609939098, + "maxAbsDelta": 1.1875 + }, + { + "stage": "layer_10", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.991351000098295, + "meanRelativeL2": 0.12501118518412113, + "maxAbsDelta": 1.125 + }, + { + "stage": "layer_11", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9918890609297641, + "meanRelativeL2": 0.12172173336148262, + "maxAbsDelta": 1.25 + }, + { + "stage": "layer_12", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9909125219943912, + "meanRelativeL2": 0.12884482741355896, + "maxAbsDelta": 1.1875 + }, + { + "stage": "layer_13", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9908973148395849, + "meanRelativeL2": 0.12928463332355022, + "maxAbsDelta": 1.8125 + }, + { + "stage": "layer_14", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9911238315493561, + "meanRelativeL2": 0.1288431379944086, + "maxAbsDelta": 1.5 + }, + { + "stage": "layer_15", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9911623423875764, + "meanRelativeL2": 0.12950104847550392, + "maxAbsDelta": 2.25 + }, + { + "stage": "layer_16", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9913250696520473, + "meanRelativeL2": 0.12880775891244411, + "maxAbsDelta": 1.625 + }, + { + "stage": "layer_17", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9918236257724984, + "meanRelativeL2": 0.12504073232412338, + "maxAbsDelta": 1.875 + }, + { + "stage": "layer_18", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9922097637209781, + "meanRelativeL2": 0.1221102811396122, + "maxAbsDelta": 2.75 + }, + { + "stage": "layer_19", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9920072770395945, + "meanRelativeL2": 0.12394852004945278, + "maxAbsDelta": 3.375 + }, + { + "stage": "layer_20", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9923519980768825, + "meanRelativeL2": 0.12199567444622517, + "maxAbsDelta": 3.625 + }, + { + "stage": "layer_21", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9915185525666835, + "meanRelativeL2": 0.13067671842873096, + "maxAbsDelta": 4 + }, + { + "stage": "layer_22", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9917934782976328, + "meanRelativeL2": 0.12878577411174774, + "maxAbsDelta": 5.25 + }, + { + "stage": "layer_23", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9933216973792675, + "meanRelativeL2": 0.11608808115124702, + "maxAbsDelta": 8.5 + }, + { + "stage": "layer_24", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9945270464170811, + "meanRelativeL2": 0.10532591305673122, + "maxAbsDelta": 8.5 + }, + { + "stage": "layer_25", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9960098523040151, + "meanRelativeL2": 0.09043379314243793, + "maxAbsDelta": 13 + }, + { + "stage": "layer_26", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9944710991410322, + "meanRelativeL2": 0.12066936679184437, + "maxAbsDelta": 45 + }, + { + "stage": "final_norm", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9935130022985991, + "meanRelativeL2": 0.11423302069306374, + "maxAbsDelta": 3.0859375 + } + ], + "bos_at_s0": [ + { + "stage": "embedding", + "tokens": 344, + "exactRows": 344, + "meanCosine": 1, + "meanRelativeL2": 0, + "maxAbsDelta": 0 + }, + { + "stage": "layer_00", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.988924983282422, + "meanRelativeL2": 0.15072546526789665, + "maxAbsDelta": 0.217529296875 + }, + { + "stage": "layer_01", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9882270783879036, + "meanRelativeL2": 0.155447568744421, + "maxAbsDelta": 0.3740234375 + }, + { + "stage": "layer_02", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9895403863385667, + "meanRelativeL2": 0.1463114731013775, + "maxAbsDelta": 0.5 + }, + { + "stage": "layer_03", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9909891749537268, + "meanRelativeL2": 0.13752608373761177, + "maxAbsDelta": 0.3984375 + }, + { + "stage": "layer_04", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9930707708347676, + "meanRelativeL2": 0.11998563073575497, + "maxAbsDelta": 0.453125 + }, + { + "stage": "layer_05", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9926218612249508, + "meanRelativeL2": 0.12252703495323658, + "maxAbsDelta": 0.40625 + }, + { + "stage": "layer_06", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9935347313104674, + "meanRelativeL2": 0.11259917169809341, + "maxAbsDelta": 0.5625 + }, + { + "stage": "layer_07", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9928970142852428, + "meanRelativeL2": 0.11741627752780914, + "maxAbsDelta": 0.671875 + }, + { + "stage": "layer_08", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9921235081761383, + "meanRelativeL2": 0.12258721701800823, + "maxAbsDelta": 0.78125 + }, + { + "stage": "layer_09", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9931422219026921, + "meanRelativeL2": 0.11384919472038746, + "maxAbsDelta": 0.984375 + }, + { + "stage": "layer_10", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9923627002294674, + "meanRelativeL2": 0.11889160610735416, + "maxAbsDelta": 1.0625 + }, + { + "stage": "layer_11", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9933409538379935, + "meanRelativeL2": 0.11097344383597374, + "maxAbsDelta": 1.125 + }, + { + "stage": "layer_12", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9924383745637051, + "meanRelativeL2": 0.11860817298293114, + "maxAbsDelta": 1.125 + }, + { + "stage": "layer_13", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9923865715431612, + "meanRelativeL2": 0.11923776008188725, + "maxAbsDelta": 1.4375 + }, + { + "stage": "layer_14", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9929216757070186, + "meanRelativeL2": 0.11535350419580936, + "maxAbsDelta": 1.625 + }, + { + "stage": "layer_15", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9932121925575789, + "meanRelativeL2": 0.11288127861917019, + "maxAbsDelta": 1.75 + }, + { + "stage": "layer_16", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9933822217375733, + "meanRelativeL2": 0.11137481778860092, + "maxAbsDelta": 2.125 + }, + { + "stage": "layer_17", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9938347700030304, + "meanRelativeL2": 0.10731004178524017, + "maxAbsDelta": 2.25 + }, + { + "stage": "layer_18", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9944839699323788, + "meanRelativeL2": 0.10156505182385445, + "maxAbsDelta": 2.5 + }, + { + "stage": "layer_19", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9943694046070409, + "meanRelativeL2": 0.10276062414050102, + "maxAbsDelta": 2.75 + }, + { + "stage": "layer_20", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9949208102947058, + "meanRelativeL2": 0.09766654297709465, + "maxAbsDelta": 3.125 + }, + { + "stage": "layer_21", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.994815037001011, + "meanRelativeL2": 0.09964326955378056, + "maxAbsDelta": 3.25 + }, + { + "stage": "layer_22", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9950945952603983, + "meanRelativeL2": 0.0968193244189024, + "maxAbsDelta": 3.75 + }, + { + "stage": "layer_23", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9960222102181856, + "meanRelativeL2": 0.08724836260080338, + "maxAbsDelta": 4 + }, + { + "stage": "layer_24", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9966882796481599, + "meanRelativeL2": 0.079620654694736, + "maxAbsDelta": 5 + }, + { + "stage": "layer_25", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9977586047593937, + "meanRelativeL2": 0.06569758988916874, + "maxAbsDelta": 8 + }, + { + "stage": "layer_26", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9977094226105269, + "meanRelativeL2": 0.06861758045852184, + "maxAbsDelta": 17.5 + }, + { + "stage": "final_norm", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9974266890176507, + "meanRelativeL2": 0.07112080790102482, + "maxAbsDelta": 1.75 + } + ], + "bos_at_s1": [ + { + "stage": "embedding", + "tokens": 344, + "exactRows": 344, + "meanCosine": 1, + "meanRelativeL2": 0, + "maxAbsDelta": 0 + }, + { + "stage": "layer_00", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9904630589623784, + "meanRelativeL2": 0.13980966433882713, + "maxAbsDelta": 0.2158203125 + }, + { + "stage": "layer_01", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9884550311537676, + "meanRelativeL2": 0.1536470577120781, + "maxAbsDelta": 0.20703125 + }, + { + "stage": "layer_02", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.98833478467409, + "meanRelativeL2": 0.15485211089253426, + "maxAbsDelta": 0.38671875 + }, + { + "stage": "layer_03", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9896576227836831, + "meanRelativeL2": 0.14695464074611664, + "maxAbsDelta": 0.38671875 + }, + { + "stage": "layer_04", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9916944808738176, + "meanRelativeL2": 0.13038739748299122, + "maxAbsDelta": 0.4375 + }, + { + "stage": "layer_05", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9910271403401397, + "meanRelativeL2": 0.13399913348257542, + "maxAbsDelta": 0.5 + }, + { + "stage": "layer_06", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9921991929065349, + "meanRelativeL2": 0.12371453084051609, + "maxAbsDelta": 0.53125 + }, + { + "stage": "layer_07", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9916938484408134, + "meanRelativeL2": 0.12640811130404472, + "maxAbsDelta": 0.921875 + }, + { + "stage": "layer_08", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9908295388138572, + "meanRelativeL2": 0.13220725394785404, + "maxAbsDelta": 0.96875 + }, + { + "stage": "layer_09", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9919441096311392, + "meanRelativeL2": 0.1232355460524559, + "maxAbsDelta": 1.96875 + }, + { + "stage": "layer_10", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9911466729502345, + "meanRelativeL2": 0.12868820689618587, + "maxAbsDelta": 1.75 + }, + { + "stage": "layer_11", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9922003794548123, + "meanRelativeL2": 0.12032315507531166, + "maxAbsDelta": 1.25 + }, + { + "stage": "layer_12", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9912965665029925, + "meanRelativeL2": 0.12732713483273983, + "maxAbsDelta": 1.4375 + }, + { + "stage": "layer_13", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9912973728983902, + "meanRelativeL2": 0.12724056467413902, + "maxAbsDelta": 2.125 + }, + { + "stage": "layer_14", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9919298942698989, + "meanRelativeL2": 0.12333970703184605, + "maxAbsDelta": 2.3125 + }, + { + "stage": "layer_15", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9922058672405952, + "meanRelativeL2": 0.12104013562202454, + "maxAbsDelta": 2.625 + }, + { + "stage": "layer_16", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9924363982538844, + "meanRelativeL2": 0.11898683942854404, + "maxAbsDelta": 3.125 + }, + { + "stage": "layer_17", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9928844952306082, + "meanRelativeL2": 0.11514130234718323, + "maxAbsDelta": 3.25 + }, + { + "stage": "layer_18", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9935050731481507, + "meanRelativeL2": 0.10999307595193386, + "maxAbsDelta": 3.875 + }, + { + "stage": "layer_19", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.993276561068934, + "meanRelativeL2": 0.11185216158628464, + "maxAbsDelta": 4.125 + }, + { + "stage": "layer_20", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9938661515019661, + "meanRelativeL2": 0.1068633496761322, + "maxAbsDelta": 4.625 + }, + { + "stage": "layer_21", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9936557945817016, + "meanRelativeL2": 0.10930298827588558, + "maxAbsDelta": 5 + }, + { + "stage": "layer_22", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9939718544483185, + "meanRelativeL2": 0.1064658910036087, + "maxAbsDelta": 5.75 + }, + { + "stage": "layer_23", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9951224822637647, + "meanRelativeL2": 0.0961808804422617, + "maxAbsDelta": 5.5 + }, + { + "stage": "layer_24", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9959480239208355, + "meanRelativeL2": 0.08752948604524136, + "maxAbsDelta": 6 + }, + { + "stage": "layer_25", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9972443476665852, + "meanRelativeL2": 0.07231728825718164, + "maxAbsDelta": 9.0625 + }, + { + "stage": "layer_26", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9969948273758555, + "meanRelativeL2": 0.07803301699459553, + "maxAbsDelta": 25 + }, + { + "stage": "final_norm", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9966503672821577, + "meanRelativeL2": 0.08138031512498856, + "maxAbsDelta": 2.625 + } + ], + "x_at_s0": [ + { + "stage": "embedding", + "tokens": 344, + "exactRows": 344, + "meanCosine": 1, + "meanRelativeL2": 0, + "maxAbsDelta": 0 + }, + { + "stage": "layer_00", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9897945246031118, + "meanRelativeL2": 0.14482663944363594, + "maxAbsDelta": 0.224609375 + }, + { + "stage": "layer_01", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9896958543117657, + "meanRelativeL2": 0.14498117938637733, + "maxAbsDelta": 0.361328125 + }, + { + "stage": "layer_02", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.989609920008238, + "meanRelativeL2": 0.14510171115398407, + "maxAbsDelta": 0.53125 + }, + { + "stage": "layer_03", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9906306166288464, + "meanRelativeL2": 0.13821000047028065, + "maxAbsDelta": 0.435546875 + }, + { + "stage": "layer_04", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9920995422573977, + "meanRelativeL2": 0.1262213010340929, + "maxAbsDelta": 0.39453125 + }, + { + "stage": "layer_05", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9913112018690553, + "meanRelativeL2": 0.13135776668787003, + "maxAbsDelta": 0.5625 + }, + { + "stage": "layer_06", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.992150335117828, + "meanRelativeL2": 0.12323410622775555, + "maxAbsDelta": 0.625 + }, + { + "stage": "layer_07", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9912580099216727, + "meanRelativeL2": 0.12916119396686554, + "maxAbsDelta": 0.734375 + }, + { + "stage": "layer_08", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9901407797669255, + "meanRelativeL2": 0.13574682548642159, + "maxAbsDelta": 0.96875 + }, + { + "stage": "layer_09", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9914673961872278, + "meanRelativeL2": 0.1255603302270174, + "maxAbsDelta": 1.328125 + }, + { + "stage": "layer_10", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9907703576392906, + "meanRelativeL2": 0.1303296461701393, + "maxAbsDelta": 1.78125 + }, + { + "stage": "layer_11", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.991981987343278, + "meanRelativeL2": 0.12247101776301861, + "maxAbsDelta": 1.65625 + }, + { + "stage": "layer_12", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9909137296815251, + "meanRelativeL2": 0.13018476404249668, + "maxAbsDelta": 1.3125 + }, + { + "stage": "layer_13", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9908540422140166, + "meanRelativeL2": 0.13087296672165394, + "maxAbsDelta": 1.875 + }, + { + "stage": "layer_14", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9915248380843983, + "meanRelativeL2": 0.12578570283949375, + "maxAbsDelta": 2.1875 + }, + { + "stage": "layer_15", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9918892445952393, + "meanRelativeL2": 0.12317735143005848, + "maxAbsDelta": 2.25 + }, + { + "stage": "layer_16", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9920853601638661, + "meanRelativeL2": 0.1216294877231121, + "maxAbsDelta": 2.5625 + }, + { + "stage": "layer_17", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9925887858451798, + "meanRelativeL2": 0.11805391497910023, + "maxAbsDelta": 2.625 + }, + { + "stage": "layer_18", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9933495258176049, + "meanRelativeL2": 0.11191084235906601, + "maxAbsDelta": 2.875 + }, + { + "stage": "layer_19", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9931354793005212, + "meanRelativeL2": 0.11372257024049759, + "maxAbsDelta": 3 + }, + { + "stage": "layer_20", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9937879793172659, + "meanRelativeL2": 0.10833719745278358, + "maxAbsDelta": 3.25 + }, + { + "stage": "layer_21", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9936381928449454, + "meanRelativeL2": 0.11096960678696632, + "maxAbsDelta": 3 + }, + { + "stage": "layer_22", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9939483345247978, + "meanRelativeL2": 0.1085109245032072, + "maxAbsDelta": 3.25 + }, + { + "stage": "layer_23", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9950320266706999, + "meanRelativeL2": 0.0981765128672123, + "maxAbsDelta": 4.5 + }, + { + "stage": "layer_24", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9958246083453645, + "meanRelativeL2": 0.08992780931293964, + "maxAbsDelta": 5.5 + }, + { + "stage": "layer_25", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9971460204484851, + "meanRelativeL2": 0.07435211353003979, + "maxAbsDelta": 8.5 + }, + { + "stage": "layer_26", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9972156906543777, + "meanRelativeL2": 0.07615463063120842, + "maxAbsDelta": 35 + }, + { + "stage": "final_norm", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9967009743978811, + "meanRelativeL2": 0.07951223105192184, + "maxAbsDelta": 2.2578125 + } + ], + "x_at_s1": [ + { + "stage": "embedding", + "tokens": 344, + "exactRows": 344, + "meanCosine": 1, + "meanRelativeL2": 0, + "maxAbsDelta": 0 + }, + { + "stage": "layer_00", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9911150305077087, + "meanRelativeL2": 0.1351071186363697, + "maxAbsDelta": 0.22216796875 + }, + { + "stage": "layer_01", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9873570231504218, + "meanRelativeL2": 0.160529725253582, + "maxAbsDelta": 0.28125 + }, + { + "stage": "layer_02", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9859041942413463, + "meanRelativeL2": 0.1697428934276104, + "maxAbsDelta": 0.48828125 + }, + { + "stage": "layer_03", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9868669509887695, + "meanRelativeL2": 0.16397720202803612, + "maxAbsDelta": 0.48828125 + }, + { + "stage": "layer_04", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9882908778828244, + "meanRelativeL2": 0.1536337360739708, + "maxAbsDelta": 0.5400390625 + }, + { + "stage": "layer_05", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9866465825674146, + "meanRelativeL2": 0.16208378225564957, + "maxAbsDelta": 0.578125 + }, + { + "stage": "layer_06", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9876635251350181, + "meanRelativeL2": 0.15355604887008667, + "maxAbsDelta": 0.96875 + }, + { + "stage": "layer_07", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9865227643140527, + "meanRelativeL2": 0.15881675109267235, + "maxAbsDelta": 1.125 + }, + { + "stage": "layer_08", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9851293938104496, + "meanRelativeL2": 0.16614947840571404, + "maxAbsDelta": 1.21875 + }, + { + "stage": "layer_09", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9869419270476629, + "meanRelativeL2": 0.1547187641263008, + "maxAbsDelta": 1.75 + }, + { + "stage": "layer_10", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9860289401786272, + "meanRelativeL2": 0.16075877472758293, + "maxAbsDelta": 1.625 + }, + { + "stage": "layer_11", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9877074423224427, + "meanRelativeL2": 0.15202197059988976, + "maxAbsDelta": 1.4375 + }, + { + "stage": "layer_12", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9863160841686781, + "meanRelativeL2": 0.16071049124002457, + "maxAbsDelta": 1.8125 + }, + { + "stage": "layer_13", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.986437685960947, + "meanRelativeL2": 0.16046184301376343, + "maxAbsDelta": 2.4375 + }, + { + "stage": "layer_14", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9873002757166707, + "meanRelativeL2": 0.1556164100766182, + "maxAbsDelta": 2.6875 + }, + { + "stage": "layer_15", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9876738613428071, + "meanRelativeL2": 0.15361108258366585, + "maxAbsDelta": 3.125 + }, + { + "stage": "layer_16", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9880276124837787, + "meanRelativeL2": 0.15134894847869873, + "maxAbsDelta": 3.4375 + }, + { + "stage": "layer_17", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9887703515069429, + "meanRelativeL2": 0.14671318233013153, + "maxAbsDelta": 3.5625 + }, + { + "stage": "layer_18", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9896828961926837, + "meanRelativeL2": 0.14050453528761864, + "maxAbsDelta": 4.5 + }, + { + "stage": "layer_19", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9893761942552965, + "meanRelativeL2": 0.14278997853398323, + "maxAbsDelta": 4.5 + }, + { + "stage": "layer_20", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9900143860384475, + "meanRelativeL2": 0.1388260554522276, + "maxAbsDelta": 4.875 + }, + { + "stage": "layer_21", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9892900922270709, + "meanRelativeL2": 0.14574884809553623, + "maxAbsDelta": 4.75 + }, + { + "stage": "layer_22", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.989775063340054, + "meanRelativeL2": 0.1428812574595213, + "maxAbsDelta": 5.25 + }, + { + "stage": "layer_23", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9916900715162588, + "meanRelativeL2": 0.12860680557787418, + "maxAbsDelta": 6 + }, + { + "stage": "layer_24", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9930172164079755, + "meanRelativeL2": 0.11814576014876366, + "maxAbsDelta": 10.25 + }, + { + "stage": "layer_25", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9950814364954482, + "meanRelativeL2": 0.09973299875855446, + "maxAbsDelta": 15.5 + }, + { + "stage": "layer_26", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9941491311372712, + "meanRelativeL2": 0.11472136154770851, + "maxAbsDelta": 33 + }, + { + "stage": "final_norm", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9931271911360496, + "meanRelativeL2": 0.1159491240978241, + "maxAbsDelta": 4.1875 + } + ], + "period_at_s0": [ + { + "stage": "embedding", + "tokens": 344, + "exactRows": 344, + "meanCosine": 1, + "meanRelativeL2": 0, + "maxAbsDelta": 0 + }, + { + "stage": "layer_00", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9899415422317593, + "meanRelativeL2": 0.14380919188261032, + "maxAbsDelta": 0.2255859375 + }, + { + "stage": "layer_01", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9898794296869012, + "meanRelativeL2": 0.14389700070023537, + "maxAbsDelta": 0.326171875 + }, + { + "stage": "layer_02", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9896856872148292, + "meanRelativeL2": 0.1451342422515154, + "maxAbsDelta": 0.515625 + }, + { + "stage": "layer_03", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9908145631468573, + "meanRelativeL2": 0.13704720698297024, + "maxAbsDelta": 0.3828125 + }, + { + "stage": "layer_04", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9920940991750983, + "meanRelativeL2": 0.1259771827608347, + "maxAbsDelta": 0.3671875 + }, + { + "stage": "layer_05", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.991440991676131, + "meanRelativeL2": 0.1301843598484993, + "maxAbsDelta": 0.59375 + }, + { + "stage": "layer_06", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9921203685361285, + "meanRelativeL2": 0.12301475740969181, + "maxAbsDelta": 0.59375 + }, + { + "stage": "layer_07", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9912295033072316, + "meanRelativeL2": 0.12870589271187782, + "maxAbsDelta": 0.71875 + }, + { + "stage": "layer_08", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9900497645139694, + "meanRelativeL2": 0.13599460385739803, + "maxAbsDelta": 0.90625 + }, + { + "stage": "layer_09", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9913586554832237, + "meanRelativeL2": 0.12600092589855194, + "maxAbsDelta": 1.203125 + }, + { + "stage": "layer_10", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9906341402336608, + "meanRelativeL2": 0.1309866588562727, + "maxAbsDelta": 1.40625 + }, + { + "stage": "layer_11", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.991740153625954, + "meanRelativeL2": 0.12372719310224056, + "maxAbsDelta": 1.375 + }, + { + "stage": "layer_12", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9905789161837378, + "meanRelativeL2": 0.132350355386734, + "maxAbsDelta": 1.3125 + }, + { + "stage": "layer_13", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9905358265305675, + "meanRelativeL2": 0.13279478251934052, + "maxAbsDelta": 1.875 + }, + { + "stage": "layer_14", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9911614465852117, + "meanRelativeL2": 0.12802519649267197, + "maxAbsDelta": 2 + }, + { + "stage": "layer_15", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9914582583100296, + "meanRelativeL2": 0.12555678188800812, + "maxAbsDelta": 2.0625 + }, + { + "stage": "layer_16", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.991654877745828, + "meanRelativeL2": 0.12392340041697025, + "maxAbsDelta": 2.4375 + }, + { + "stage": "layer_17", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9922250218169634, + "meanRelativeL2": 0.11965539492666721, + "maxAbsDelta": 2.4375 + }, + { + "stage": "layer_18", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9930213921984961, + "meanRelativeL2": 0.1133107915520668, + "maxAbsDelta": 2.6875 + }, + { + "stage": "layer_19", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9928222319414449, + "meanRelativeL2": 0.11475498974323273, + "maxAbsDelta": 3.0625 + }, + { + "stage": "layer_20", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9935525011184604, + "meanRelativeL2": 0.1087636761367321, + "maxAbsDelta": 3.4375 + }, + { + "stage": "layer_21", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.993456897694011, + "meanRelativeL2": 0.11075901612639427, + "maxAbsDelta": 3.21875 + }, + { + "stage": "layer_22", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9937909176183302, + "meanRelativeL2": 0.10812918096780777, + "maxAbsDelta": 4.5 + }, + { + "stage": "layer_23", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9949882318114125, + "meanRelativeL2": 0.09728679992258549, + "maxAbsDelta": 6 + }, + { + "stage": "layer_24", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.995815520716268, + "meanRelativeL2": 0.08892166242003441, + "maxAbsDelta": 5 + }, + { + "stage": "layer_25", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.997168356942576, + "meanRelativeL2": 0.07342227827757597, + "maxAbsDelta": 7.5 + }, + { + "stage": "layer_26", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9972407991109893, + "meanRelativeL2": 0.07499513402581215, + "maxAbsDelta": 35 + }, + { + "stage": "final_norm", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9968918714412424, + "meanRelativeL2": 0.0773772643879056, + "maxAbsDelta": 1.5 + } + ], + "period_at_s1": [ + { + "stage": "embedding", + "tokens": 344, + "exactRows": 344, + "meanCosine": 1, + "meanRelativeL2": 0, + "maxAbsDelta": 0 + }, + { + "stage": "layer_00", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9912016381357991, + "meanRelativeL2": 0.13449429161846638, + "maxAbsDelta": 0.22607421875 + }, + { + "stage": "layer_01", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9874629977830621, + "meanRelativeL2": 0.15992221981287003, + "maxAbsDelta": 0.28515625 + }, + { + "stage": "layer_02", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9858708884133849, + "meanRelativeL2": 0.17007066681981087, + "maxAbsDelta": 0.4921875 + }, + { + "stage": "layer_03", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9868807875832846, + "meanRelativeL2": 0.16413065791130066, + "maxAbsDelta": 0.4921875 + }, + { + "stage": "layer_04", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9880841256574143, + "meanRelativeL2": 0.15492789447307587, + "maxAbsDelta": 0.541015625 + }, + { + "stage": "layer_05", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9864359026731446, + "meanRelativeL2": 0.16367198899388313, + "maxAbsDelta": 0.58203125 + }, + { + "stage": "layer_06", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9872694112533746, + "meanRelativeL2": 0.15629847720265388, + "maxAbsDelta": 0.84375 + }, + { + "stage": "layer_07", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9860754875942718, + "meanRelativeL2": 0.1616927571594715, + "maxAbsDelta": 1 + }, + { + "stage": "layer_08", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.984671082954074, + "meanRelativeL2": 0.16873611137270927, + "maxAbsDelta": 1.1875 + }, + { + "stage": "layer_09", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9866621123496876, + "meanRelativeL2": 0.15634573996067047, + "maxAbsDelta": 1.71875 + }, + { + "stage": "layer_10", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9858049802308859, + "meanRelativeL2": 0.16174300387501717, + "maxAbsDelta": 1.75 + }, + { + "stage": "layer_11", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9874321073293686, + "meanRelativeL2": 0.15346349403262138, + "maxAbsDelta": 1.8125 + }, + { + "stage": "layer_12", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9860081683064617, + "meanRelativeL2": 0.16240457817912102, + "maxAbsDelta": 1.875 + }, + { + "stage": "layer_13", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.986144307740899, + "meanRelativeL2": 0.16220686584711075, + "maxAbsDelta": 2.625 + }, + { + "stage": "layer_14", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9869519496379897, + "meanRelativeL2": 0.15768879652023315, + "maxAbsDelta": 2.875 + }, + { + "stage": "layer_15", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9873524051766063, + "meanRelativeL2": 0.15563637018203735, + "maxAbsDelta": 3.375 + }, + { + "stage": "layer_16", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9877513480740924, + "meanRelativeL2": 0.1532965674996376, + "maxAbsDelta": 3.75 + }, + { + "stage": "layer_17", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9884948342345482, + "meanRelativeL2": 0.14810917899012566, + "maxAbsDelta": 4.125 + }, + { + "stage": "layer_18", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9893426870883897, + "meanRelativeL2": 0.14233707636594772, + "maxAbsDelta": 5.25 + }, + { + "stage": "layer_19", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9890576666870783, + "meanRelativeL2": 0.14455732516944408, + "maxAbsDelta": 5.25 + }, + { + "stage": "layer_20", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9897660779398542, + "meanRelativeL2": 0.14031735621392727, + "maxAbsDelta": 5 + }, + { + "stage": "layer_21", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9891384060299674, + "meanRelativeL2": 0.14717135019600391, + "maxAbsDelta": 6.25 + }, + { + "stage": "layer_22", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9896226230748865, + "meanRelativeL2": 0.14435940608382225, + "maxAbsDelta": 7.5 + }, + { + "stage": "layer_23", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9915646262640176, + "meanRelativeL2": 0.13003740273416042, + "maxAbsDelta": 9.5 + }, + { + "stage": "layer_24", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.992994241243185, + "meanRelativeL2": 0.11869938671588898, + "maxAbsDelta": 9.5 + }, + { + "stage": "layer_25", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9951229729624682, + "meanRelativeL2": 0.09989442117512226, + "maxAbsDelta": 15 + }, + { + "stage": "layer_26", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9942927017461421, + "meanRelativeL2": 0.11892700009047985, + "maxAbsDelta": 35.5 + }, + { + "stage": "final_norm", + "tokens": 344, + "exactRows": 0, + "meanCosine": 0.9934760144976682, + "meanRelativeL2": 0.1161311436444521, + "maxAbsDelta": 3.203125 + } + ] + } + }, + "routerSeries": { + "all": { + "system_eos": [ + { + "layer": "layer_01", + "tokens": 1537, + "orderedExact": 1051, + "orderedExactRate": 0.6837996096291477, + "setExact": 1179, + "setExactRate": 0.7670787247885491, + "meanSetJaccard": 0.9299811010936582, + "meanTokenWeightedTv": 0.011249926180288658, + "meanAggregateLoadTv": 0.036702517657193026 + }, + { + "layer": "layer_02", + "tokens": 1537, + "orderedExact": 1130, + "orderedExactRate": 0.7351984385165907, + "setExact": 1265, + "setExactRate": 0.8230318802862719, + "meanSetJaccard": 0.9484927347646931, + "meanTokenWeightedTv": 0.010742563571886573, + "meanAggregateLoadTv": 0.02502592192671146 + }, + { + "layer": "layer_03", + "tokens": 1537, + "orderedExact": 1221, + "orderedExactRate": 0.7944046844502277, + "setExact": 1331, + "setExactRate": 0.8659726740403383, + "meanSetJaccard": 0.961288223812622, + "meanTokenWeightedTv": 0.00904095205349414, + "meanAggregateLoadTv": 0.018555566236889004 + }, + { + "layer": "layer_04", + "tokens": 1537, + "orderedExact": 1228, + "orderedExactRate": 0.7989590110605075, + "setExact": 1353, + "setExactRate": 0.8802862719583604, + "meanSetJaccard": 0.9653778232177713, + "meanTokenWeightedTv": 0.008654591025436543, + "meanAggregateLoadTv": 0.01789895910877534 + }, + { + "layer": "layer_05", + "tokens": 1537, + "orderedExact": 1208, + "orderedExactRate": 0.785946649316851, + "setExact": 1336, + "setExactRate": 0.8692257644762524, + "meanSetJaccard": 0.962078260061344, + "meanTokenWeightedTv": 0.009569958323105877, + "meanAggregateLoadTv": 0.0192001007774026 + }, + { + "layer": "layer_06", + "tokens": 1537, + "orderedExact": 1203, + "orderedExactRate": 0.7826935588809368, + "setExact": 1316, + "setExactRate": 0.8562134027325959, + "meanSetJaccard": 0.9584998605818384, + "meanTokenWeightedTv": 0.010558898963902684, + "meanAggregateLoadTv": 0.020779777579280314 + }, + { + "layer": "layer_07", + "tokens": 1537, + "orderedExact": 1142, + "orderedExactRate": 0.7430058555627846, + "setExact": 1306, + "setExactRate": 0.8497072218607677, + "meanSetJaccard": 0.9566409517613161, + "meanTokenWeightedTv": 0.011289585623603573, + "meanAggregateLoadTv": 0.02213596615147395 + }, + { + "layer": "layer_08", + "tokens": 1537, + "orderedExact": 1128, + "orderedExactRate": 0.7338972023422251, + "setExact": 1279, + "setExactRate": 0.8321405335068315, + "meanSetJaccard": 0.9509248071382099, + "meanTokenWeightedTv": 0.012054591210469786, + "meanAggregateLoadTv": 0.0233023649083014 + }, + { + "layer": "layer_09", + "tokens": 1537, + "orderedExact": 1114, + "orderedExactRate": 0.7247885491216656, + "setExact": 1279, + "setExactRate": 0.8321405335068315, + "meanSetJaccard": 0.9514824797843666, + "meanTokenWeightedTv": 0.012398783399025596, + "meanAggregateLoadTv": 0.026902681771784752 + }, + { + "layer": "layer_10", + "tokens": 1537, + "orderedExact": 1107, + "orderedExactRate": 0.7202342225113858, + "setExact": 1260, + "setExactRate": 0.8197787898503578, + "meanSetJaccard": 0.9473928803792174, + "meanTokenWeightedTv": 0.012218733600283187, + "meanAggregateLoadTv": 0.023888913500266243 + }, + { + "layer": "layer_11", + "tokens": 1537, + "orderedExact": 1072, + "orderedExactRate": 0.697462589459987, + "setExact": 1246, + "setExactRate": 0.8106701366297983, + "meanSetJaccard": 0.9446509898689469, + "meanTokenWeightedTv": 0.012140599647144978, + "meanAggregateLoadTv": 0.026074736068592324 + }, + { + "layer": "layer_12", + "tokens": 1537, + "orderedExact": 1029, + "orderedExactRate": 0.6694860117111255, + "setExact": 1194, + "setExactRate": 0.7768379960962914, + "meanSetJaccard": 0.9339003005235926, + "meanTokenWeightedTv": 0.014282638654638354, + "meanAggregateLoadTv": 0.02688014277734084 + }, + { + "layer": "layer_13", + "tokens": 1537, + "orderedExact": 958, + "orderedExactRate": 0.623292127521145, + "setExact": 1149, + "setExactRate": 0.7475601821730644, + "meanSetJaccard": 0.9253957926697028, + "meanTokenWeightedTv": 0.014866076469208012, + "meanAggregateLoadTv": 0.03452319028348645 + }, + { + "layer": "layer_14", + "tokens": 1537, + "orderedExact": 929, + "orderedExactRate": 0.6044242029928432, + "setExact": 1121, + "setExactRate": 0.7293428757319453, + "meanSetJaccard": 0.9198810298354865, + "meanTokenWeightedTv": 0.016102934504306197, + "meanAggregateLoadTv": 0.03496223442237913 + }, + { + "layer": "layer_15", + "tokens": 1537, + "orderedExact": 922, + "orderedExactRate": 0.5998698763825634, + "setExact": 1113, + "setExactRate": 0.7241379310344828, + "meanSetJaccard": 0.9179198810298357, + "meanTokenWeightedTv": 0.01656291626322963, + "meanAggregateLoadTv": 0.03597864095102585 + }, + { + "layer": "layer_16", + "tokens": 1537, + "orderedExact": 948, + "orderedExactRate": 0.6167859466493169, + "setExact": 1144, + "setExactRate": 0.7443070917371503, + "meanSetJaccard": 0.9235213929423427, + "meanTokenWeightedTv": 0.01665692373459701, + "meanAggregateLoadTv": 0.03309232779079227 + }, + { + "layer": "layer_17", + "tokens": 1537, + "orderedExact": 972, + "orderedExactRate": 0.6324007807417046, + "setExact": 1152, + "setExactRate": 0.7495120364346128, + "meanSetJaccard": 0.9241720110295255, + "meanTokenWeightedTv": 0.01642448985054584, + "meanAggregateLoadTv": 0.03224050768673641 + }, + { + "layer": "layer_18", + "tokens": 1537, + "orderedExact": 918, + "orderedExactRate": 0.5972674040338322, + "setExact": 1113, + "setExactRate": 0.7241379310344828, + "meanSetJaccard": 0.9177897574123991, + "meanTokenWeightedTv": 0.017882878425619756, + "meanAggregateLoadTv": 0.03492032417615495 + }, + { + "layer": "layer_19", + "tokens": 1537, + "orderedExact": 918, + "orderedExactRate": 0.5972674040338322, + "setExact": 1108, + "setExactRate": 0.7208848405985686, + "meanSetJaccard": 0.9165504848653842, + "meanTokenWeightedTv": 0.01774002281412407, + "meanAggregateLoadTv": 0.03497283464575753 + }, + { + "layer": "layer_20", + "tokens": 1537, + "orderedExact": 849, + "orderedExactRate": 0.5523747560182173, + "setExact": 1051, + "setExactRate": 0.6837996096291477, + "meanSetJaccard": 0.9041267775815598, + "meanTokenWeightedTv": 0.01848019173574969, + "meanAggregateLoadTv": 0.03778564832843407 + }, + { + "layer": "layer_21", + "tokens": 1537, + "orderedExact": 834, + "orderedExactRate": 0.5426154847104749, + "setExact": 1055, + "setExactRate": 0.686402081977879, + "meanSetJaccard": 0.9039718685131828, + "meanTokenWeightedTv": 0.018954909475148933, + "meanAggregateLoadTv": 0.037622393792017435 + }, + { + "layer": "layer_22", + "tokens": 1537, + "orderedExact": 875, + "orderedExactRate": 0.5692908262849707, + "setExact": 1067, + "setExactRate": 0.6942094990240729, + "meanSetJaccard": 0.9068129008272143, + "meanTokenWeightedTv": 0.018660762936707667, + "meanAggregateLoadTv": 0.03719598050340803 + }, + { + "layer": "layer_23", + "tokens": 1537, + "orderedExact": 909, + "orderedExactRate": 0.5914118412491868, + "setExact": 1106, + "setExactRate": 0.719583604424203, + "meanSetJaccard": 0.9170926666047031, + "meanTokenWeightedTv": 0.018437061259919653, + "meanAggregateLoadTv": 0.04014749251303099 + }, + { + "layer": "layer_24", + "tokens": 1537, + "orderedExact": 809, + "orderedExactRate": 0.5263500325309044, + "setExact": 1000, + "setExactRate": 0.6506180871828237, + "meanSetJaccard": 0.8933605973293677, + "meanTokenWeightedTv": 0.018398516893559664, + "meanAggregateLoadTv": 0.04142456379096684 + }, + { + "layer": "layer_25", + "tokens": 1537, + "orderedExact": 882, + "orderedExactRate": 0.5738451528952505, + "setExact": 1062, + "setExactRate": 0.6909564085881588, + "meanSetJaccard": 0.9059670973138766, + "meanTokenWeightedTv": 0.019059286855684747, + "meanAggregateLoadTv": 0.040582969529921575 + }, + { + "layer": "layer_26", + "tokens": 1537, + "orderedExact": 926, + "orderedExactRate": 0.6024723487312947, + "setExact": 1100, + "setExactRate": 0.715679895901106, + "meanSetJaccard": 0.9122254236763019, + "meanTokenWeightedTv": 0.018045328756854915, + "meanAggregateLoadTv": 0.03438627183542763 + } + ], + "system_bos": [ + { + "layer": "layer_01", + "tokens": 1537, + "orderedExact": 859, + "orderedExactRate": 0.5588809368900456, + "setExact": 1034, + "setExactRate": 0.6727391021470397, + "meanSetJaccard": 0.9005019053815413, + "meanTokenWeightedTv": 0.016074599835792475, + "meanAggregateLoadTv": 0.048324184064077236 + }, + { + "layer": "layer_02", + "tokens": 1537, + "orderedExact": 946, + "orderedExactRate": 0.6154847104749512, + "setExact": 1138, + "setExactRate": 0.7404033832140533, + "meanSetJaccard": 0.9227933203209717, + "meanTokenWeightedTv": 0.017421457082468454, + "meanAggregateLoadTv": 0.03390538344066165 + }, + { + "layer": "layer_03", + "tokens": 1537, + "orderedExact": 1028, + "orderedExactRate": 0.6688353936239427, + "setExact": 1181, + "setExactRate": 0.7683799609629147, + "meanSetJaccard": 0.9325680825355517, + "meanTokenWeightedTv": 0.01583038489832135, + "meanAggregateLoadTv": 0.02984544214425355 + }, + { + "layer": "layer_04", + "tokens": 1537, + "orderedExact": 1060, + "orderedExactRate": 0.6896551724137931, + "setExact": 1218, + "setExactRate": 0.7924528301886793, + "meanSetJaccard": 0.9388883725253275, + "meanTokenWeightedTv": 0.015393865140490726, + "meanAggregateLoadTv": 0.029846041233440077 + }, + { + "layer": "layer_05", + "tokens": 1537, + "orderedExact": 1042, + "orderedExactRate": 0.6779440468445023, + "setExact": 1201, + "setExactRate": 0.7813923227065712, + "meanSetJaccard": 0.9360070638535181, + "meanTokenWeightedTv": 0.015718072748287203, + "meanAggregateLoadTv": 0.02910635034858453 + }, + { + "layer": "layer_06", + "tokens": 1537, + "orderedExact": 1025, + "orderedExactRate": 0.6668835393623943, + "setExact": 1199, + "setExactRate": 0.7800910865322056, + "meanSetJaccard": 0.9357747002509527, + "meanTokenWeightedTv": 0.016079513011898857, + "meanAggregateLoadTv": 0.03041713202619696 + }, + { + "layer": "layer_07", + "tokens": 1537, + "orderedExact": 1005, + "orderedExactRate": 0.6538711776187378, + "setExact": 1197, + "setExactRate": 0.77878985035784, + "meanSetJaccard": 0.9351240821637701, + "meanTokenWeightedTv": 0.01716776921345759, + "meanAggregateLoadTv": 0.030679448881263276 + }, + { + "layer": "layer_08", + "tokens": 1537, + "orderedExact": 1007, + "orderedExactRate": 0.6551724137931034, + "setExact": 1188, + "setExactRate": 0.7729342875731945, + "meanSetJaccard": 0.9325061189082007, + "meanTokenWeightedTv": 0.016348323122452744, + "meanAggregateLoadTv": 0.030226786693617273 + }, + { + "layer": "layer_09", + "tokens": 1537, + "orderedExact": 1004, + "orderedExactRate": 0.653220559531555, + "setExact": 1178, + "setExactRate": 0.7664281067013663, + "meanSetJaccard": 0.9322892462124733, + "meanTokenWeightedTv": 0.017294838370005196, + "meanAggregateLoadTv": 0.032098456976488055 + }, + { + "layer": "layer_10", + "tokens": 1537, + "orderedExact": 984, + "orderedExactRate": 0.6402081977878985, + "setExact": 1178, + "setExactRate": 0.7664281067013663, + "meanSetJaccard": 0.930678191901354, + "meanTokenWeightedTv": 0.01728675614880697, + "meanAggregateLoadTv": 0.027552565370264168 + }, + { + "layer": "layer_11", + "tokens": 1537, + "orderedExact": 956, + "orderedExactRate": 0.6219908913467794, + "setExact": 1153, + "setExactRate": 0.7501626545217958, + "meanSetJaccard": 0.9259689562226971, + "meanTokenWeightedTv": 0.01639338080691022, + "meanAggregateLoadTv": 0.032019981720742496 + }, + { + "layer": "layer_12", + "tokens": 1537, + "orderedExact": 924, + "orderedExactRate": 0.6011711125569291, + "setExact": 1124, + "setExactRate": 0.7312947299934938, + "meanSetJaccard": 0.9191839390277904, + "meanTokenWeightedTv": 0.018935301163208886, + "meanAggregateLoadTv": 0.03746640922531232 + }, + { + "layer": "layer_13", + "tokens": 1537, + "orderedExact": 829, + "orderedExactRate": 0.5393623942745608, + "setExact": 1073, + "setExactRate": 0.6981132075471698, + "meanSetJaccard": 0.9100133221798804, + "meanTokenWeightedTv": 0.017957704723593194, + "meanAggregateLoadTv": 0.03525719579362689 + }, + { + "layer": "layer_14", + "tokens": 1537, + "orderedExact": 846, + "orderedExactRate": 0.5504229017566689, + "setExact": 1058, + "setExactRate": 0.6883539362394274, + "meanSetJaccard": 0.9051336865260093, + "meanTokenWeightedTv": 0.020121105119267402, + "meanAggregateLoadTv": 0.037771697537249196 + }, + { + "layer": "layer_15", + "tokens": 1537, + "orderedExact": 797, + "orderedExactRate": 0.5185426154847105, + "setExact": 1022, + "setExactRate": 0.6649316851008458, + "meanSetJaccard": 0.8988753601635839, + "meanTokenWeightedTv": 0.0210517533783297, + "meanAggregateLoadTv": 0.040483933318493134 + }, + { + "layer": "layer_16", + "tokens": 1537, + "orderedExact": 851, + "orderedExactRate": 0.5536759921925829, + "setExact": 1077, + "setExactRate": 0.7007156798959011, + "meanSetJaccard": 0.9089754314217554, + "meanTokenWeightedTv": 0.02050282647789827, + "meanAggregateLoadTv": 0.0364119302616824 + }, + { + "layer": "layer_17", + "tokens": 1537, + "orderedExact": 828, + "orderedExactRate": 0.538711776187378, + "setExact": 1044, + "setExactRate": 0.6792452830188679, + "meanSetJaccard": 0.9016947052080431, + "meanTokenWeightedTv": 0.021689449608113177, + "meanAggregateLoadTv": 0.037493082922287556 + }, + { + "layer": "layer_18", + "tokens": 1537, + "orderedExact": 827, + "orderedExactRate": 0.5380611581001952, + "setExact": 1032, + "setExactRate": 0.6714378659726741, + "meanSetJaccard": 0.9001611054311119, + "meanTokenWeightedTv": 0.02122904823074768, + "meanAggregateLoadTv": 0.040362086945613544 + }, + { + "layer": "layer_19", + "tokens": 1537, + "orderedExact": 838, + "orderedExactRate": 0.5452179570592063, + "setExact": 1034, + "setExactRate": 0.6727391021470397, + "meanSetJaccard": 0.8997583418533321, + "meanTokenWeightedTv": 0.022217802933969282, + "meanAggregateLoadTv": 0.0410376566418681 + }, + { + "layer": "layer_20", + "tokens": 1537, + "orderedExact": 779, + "orderedExactRate": 0.5068314899154196, + "setExact": 1001, + "setExactRate": 0.6512687052700065, + "meanSetJaccard": 0.8952659788704032, + "meanTokenWeightedTv": 0.02213112878534239, + "meanAggregateLoadTv": 0.04296597073594246 + }, + { + "layer": "layer_21", + "tokens": 1537, + "orderedExact": 762, + "orderedExactRate": 0.49577098243331164, + "setExact": 999, + "setExactRate": 0.6499674690956408, + "meanSetJaccard": 0.8934442482262911, + "meanTokenWeightedTv": 0.02256348250729517, + "meanAggregateLoadTv": 0.04545517948547406 + }, + { + "layer": "layer_22", + "tokens": 1537, + "orderedExact": 779, + "orderedExactRate": 0.5068314899154196, + "setExact": 980, + "setExactRate": 0.6376057254391672, + "meanSetJaccard": 0.8891935433900299, + "meanTokenWeightedTv": 0.02229193779277735, + "meanAggregateLoadTv": 0.041153562823930144 + }, + { + "layer": "layer_23", + "tokens": 1537, + "orderedExact": 840, + "orderedExactRate": 0.5465191932335719, + "setExact": 1045, + "setExactRate": 0.6798959011060507, + "meanSetJaccard": 0.9024692505499273, + "meanTokenWeightedTv": 0.021586262537002337, + "meanAggregateLoadTv": 0.043277315305073824 + }, + { + "layer": "layer_24", + "tokens": 1537, + "orderedExact": 722, + "orderedExactRate": 0.4697462589459987, + "setExact": 952, + "setExactRate": 0.6193884189980482, + "meanSetJaccard": 0.8820429407937539, + "meanTokenWeightedTv": 0.02123861009093641, + "meanAggregateLoadTv": 0.042791302661528016 + }, + { + "layer": "layer_25", + "tokens": 1537, + "orderedExact": 848, + "orderedExactRate": 0.5517241379310345, + "setExact": 1046, + "setExactRate": 0.6805465191932336, + "meanSetJaccard": 0.9030269231960839, + "meanTokenWeightedTv": 0.020319173005634746, + "meanAggregateLoadTv": 0.04021799730532043 + }, + { + "layer": "layer_26", + "tokens": 1537, + "orderedExact": 874, + "orderedExactRate": 0.5686402081977879, + "setExact": 1073, + "setExactRate": 0.6981132075471698, + "meanSetJaccard": 0.9087740496328656, + "meanTokenWeightedTv": 0.020392470883088595, + "meanAggregateLoadTv": 0.038065208876058694 + } + ], + "system_x": [ + { + "layer": "layer_01", + "tokens": 1537, + "orderedExact": 826, + "orderedExactRate": 0.5374105400130124, + "setExact": 999, + "setExactRate": 0.6499674690956408, + "meanSetJaccard": 0.891966415713976, + "meanTokenWeightedTv": 0.0187517248438091, + "meanAggregateLoadTv": 0.05609844993581721 + }, + { + "layer": "layer_02", + "tokens": 1537, + "orderedExact": 902, + "orderedExactRate": 0.586857514638907, + "setExact": 1097, + "setExactRate": 0.7137280416395576, + "meanSetJaccard": 0.9143662670012703, + "meanTokenWeightedTv": 0.019542182226957944, + "meanAggregateLoadTv": 0.038815912684124786 + }, + { + "layer": "layer_03", + "tokens": 1537, + "orderedExact": 967, + "orderedExactRate": 0.6291476903057905, + "setExact": 1136, + "setExactRate": 0.7391021470396877, + "meanSetJaccard": 0.9235059020355054, + "meanTokenWeightedTv": 0.018731231904945363, + "meanAggregateLoadTv": 0.03298280865684854 + }, + { + "layer": "layer_04", + "tokens": 1537, + "orderedExact": 992, + "orderedExactRate": 0.6454131424853611, + "setExact": 1170, + "setExactRate": 0.7612231620039037, + "meanSetJaccard": 0.9290206648697215, + "meanTokenWeightedTv": 0.018778190070801545, + "meanAggregateLoadTv": 0.036299206002557045 + }, + { + "layer": "layer_05", + "tokens": 1537, + "orderedExact": 961, + "orderedExactRate": 0.6252439817826936, + "setExact": 1145, + "setExactRate": 0.7449577098243331, + "meanSetJaccard": 0.9252099017876506, + "meanTokenWeightedTv": 0.019248309235809804, + "meanAggregateLoadTv": 0.0339928178997305 + }, + { + "layer": "layer_06", + "tokens": 1537, + "orderedExact": 952, + "orderedExactRate": 0.6193884189980482, + "setExact": 1151, + "setExactRate": 0.74886141834743, + "meanSetJaccard": 0.9257365926201319, + "meanTokenWeightedTv": 0.019067212386159688, + "meanAggregateLoadTv": 0.0334447617293746 + }, + { + "layer": "layer_07", + "tokens": 1537, + "orderedExact": 910, + "orderedExactRate": 0.5920624593363696, + "setExact": 1128, + "setExactRate": 0.7338972023422251, + "meanSetJaccard": 0.9215757350435296, + "meanTokenWeightedTv": 0.021458783229618805, + "meanAggregateLoadTv": 0.03713857926618528 + }, + { + "layer": "layer_08", + "tokens": 1537, + "orderedExact": 913, + "orderedExactRate": 0.594014313597918, + "setExact": 1108, + "setExactRate": 0.7208848405985686, + "meanSetJaccard": 0.9172292682377262, + "meanTokenWeightedTv": 0.02064951265317314, + "meanAggregateLoadTv": 0.03545682116405945 + }, + { + "layer": "layer_09", + "tokens": 1537, + "orderedExact": 851, + "orderedExactRate": 0.5536759921925829, + "setExact": 1088, + "setExactRate": 0.7078724788549121, + "meanSetJaccard": 0.9123276636614306, + "meanTokenWeightedTv": 0.021976738575979163, + "meanAggregateLoadTv": 0.039059544844951305 + }, + { + "layer": "layer_10", + "tokens": 1537, + "orderedExact": 831, + "orderedExactRate": 0.5406636304489265, + "setExact": 1052, + "setExactRate": 0.6844502277163305, + "meanSetJaccard": 0.9039408866995076, + "meanTokenWeightedTv": 0.023709640984163567, + "meanAggregateLoadTv": 0.038919017317636716 + }, + { + "layer": "layer_11", + "tokens": 1537, + "orderedExact": 855, + "orderedExactRate": 0.5562784645413142, + "setExact": 1069, + "setExactRate": 0.6955107351984385, + "meanSetJaccard": 0.9060445518480652, + "meanTokenWeightedTv": 0.021766459634661173, + "meanAggregateLoadTv": 0.04168738998513087 + }, + { + "layer": "layer_12", + "tokens": 1537, + "orderedExact": 811, + "orderedExactRate": 0.52765126870527, + "setExact": 1023, + "setExactRate": 0.6655823031880286, + "meanSetJaccard": 0.8976670694302444, + "meanTokenWeightedTv": 0.02400924101420237, + "meanAggregateLoadTv": 0.04171021098843332 + }, + { + "layer": "layer_13", + "tokens": 1537, + "orderedExact": 714, + "orderedExactRate": 0.4645413142485361, + "setExact": 940, + "setExactRate": 0.6115810019518543, + "meanSetJaccard": 0.879041084701462, + "meanTokenWeightedTv": 0.025087891411380767, + "meanAggregateLoadTv": 0.04823776494854727 + }, + { + "layer": "layer_14", + "tokens": 1537, + "orderedExact": 743, + "orderedExactRate": 0.483409238776838, + "setExact": 953, + "setExactRate": 0.620039037085231, + "meanSetJaccard": 0.8826161043467484, + "meanTokenWeightedTv": 0.026620091468175344, + "meanAggregateLoadTv": 0.04877311163940475 + }, + { + "layer": "layer_15", + "tokens": 1537, + "orderedExact": 710, + "orderedExactRate": 0.46193884189980483, + "setExact": 912, + "setExactRate": 0.5933636955107352, + "meanSetJaccard": 0.8737026365523437, + "meanTokenWeightedTv": 0.0278290441034733, + "meanAggregateLoadTv": 0.0516124351401803 + }, + { + "layer": "layer_16", + "tokens": 1537, + "orderedExact": 698, + "orderedExactRate": 0.4541314248536109, + "setExact": 913, + "setExactRate": 0.594014313597918, + "meanSetJaccard": 0.8723456331133624, + "meanTokenWeightedTv": 0.02881247030609558, + "meanAggregateLoadTv": 0.050720793925177345 + }, + { + "layer": "layer_17", + "tokens": 1537, + "orderedExact": 703, + "orderedExactRate": 0.45738451528952506, + "setExact": 934, + "setExactRate": 0.6076772934287573, + "meanSetJaccard": 0.8767267432199115, + "meanTokenWeightedTv": 0.028389884232298858, + "meanAggregateLoadTv": 0.0464335129486422 + }, + { + "layer": "layer_18", + "tokens": 1537, + "orderedExact": 689, + "orderedExactRate": 0.4482758620689655, + "setExact": 925, + "setExactRate": 0.6018217306441119, + "meanSetJaccard": 0.8760758434798772, + "meanTokenWeightedTv": 0.029279512437690502, + "meanAggregateLoadTv": 0.054163951824827083 + }, + { + "layer": "layer_19", + "tokens": 1537, + "orderedExact": 687, + "orderedExactRate": 0.44697462589459985, + "setExact": 904, + "setExactRate": 0.5881587508132726, + "meanSetJaccard": 0.8677510301453047, + "meanTokenWeightedTv": 0.02880012102514489, + "meanAggregateLoadTv": 0.049191267333055 + }, + { + "layer": "layer_20", + "tokens": 1537, + "orderedExact": 618, + "orderedExactRate": 0.40208197787898503, + "setExact": 846, + "setExactRate": 0.5504229017566689, + "meanSetJaccard": 0.8564364717910585, + "meanTokenWeightedTv": 0.03076215960120747, + "meanAggregateLoadTv": 0.053702510574427764 + }, + { + "layer": "layer_21", + "tokens": 1537, + "orderedExact": 624, + "orderedExactRate": 0.405985686402082, + "setExact": 857, + "setExactRate": 0.5575797007156799, + "meanSetJaccard": 0.8555596864640455, + "meanTokenWeightedTv": 0.03187286964604458, + "meanAggregateLoadTv": 0.05776467248780488 + }, + { + "layer": "layer_22", + "tokens": 1537, + "orderedExact": 652, + "orderedExactRate": 0.42420299284320107, + "setExact": 852, + "setExactRate": 0.5543266102797658, + "meanSetJaccard": 0.8567589643061344, + "meanTokenWeightedTv": 0.032078837982438824, + "meanAggregateLoadTv": 0.056569638616240876 + }, + { + "layer": "layer_23", + "tokens": 1537, + "orderedExact": 674, + "orderedExactRate": 0.4385165907612232, + "setExact": 891, + "setExactRate": 0.5797007156798959, + "meanSetJaccard": 0.8654183812284008, + "meanTokenWeightedTv": 0.029906224589843416, + "meanAggregateLoadTv": 0.05420125994379827 + }, + { + "layer": "layer_24", + "tokens": 1537, + "orderedExact": 585, + "orderedExactRate": 0.38061158100195186, + "setExact": 804, + "setExactRate": 0.5230969420949902, + "meanSetJaccard": 0.8475542674631809, + "meanTokenWeightedTv": 0.02938401135260775, + "meanAggregateLoadTv": 0.05676206921364493 + }, + { + "layer": "layer_25", + "tokens": 1537, + "orderedExact": 699, + "orderedExactRate": 0.4547820429407938, + "setExact": 905, + "setExactRate": 0.5888093689004554, + "meanSetJaccard": 0.8716578368497693, + "meanTokenWeightedTv": 0.028566219526761322, + "meanAggregateLoadTv": 0.05090031714061417 + }, + { + "layer": "layer_26", + "tokens": 1537, + "orderedExact": 703, + "orderedExactRate": 0.45738451528952506, + "setExact": 930, + "setExactRate": 0.605074821080026, + "meanSetJaccard": 0.8755987235492766, + "meanTokenWeightedTv": 0.02995261285955214, + "meanAggregateLoadTv": 0.053941861972116686 + } + ], + "system_period": [ + { + "layer": "layer_01", + "tokens": 1537, + "orderedExact": 829, + "orderedExactRate": 0.5393623942745608, + "setExact": 1006, + "setExactRate": 0.6545217957059206, + "meanSetJaccard": 0.8935464882114198, + "meanTokenWeightedTv": 0.018303350693876237, + "meanAggregateLoadTv": 0.05396061318171945 + }, + { + "layer": "layer_02", + "tokens": 1537, + "orderedExact": 896, + "orderedExactRate": 0.58295380611581, + "setExact": 1094, + "setExactRate": 0.7117761873780091, + "meanSetJaccard": 0.9137311398209251, + "meanTokenWeightedTv": 0.02023893964401127, + "meanAggregateLoadTv": 0.04231286705581256 + }, + { + "layer": "layer_03", + "tokens": 1537, + "orderedExact": 980, + "orderedExactRate": 0.6376057254391672, + "setExact": 1142, + "setExactRate": 0.7430058555627846, + "meanSetJaccard": 0.9246212473278186, + "meanTokenWeightedTv": 0.01839802386984429, + "meanAggregateLoadTv": 0.03398715532956604 + }, + { + "layer": "layer_04", + "tokens": 1537, + "orderedExact": 991, + "orderedExactRate": 0.6447625243981783, + "setExact": 1157, + "setExactRate": 0.752765126870527, + "meanSetJaccard": 0.9270533197013354, + "meanTokenWeightedTv": 0.018825190473306507, + "meanAggregateLoadTv": 0.03704265904328575 + }, + { + "layer": "layer_05", + "tokens": 1537, + "orderedExact": 955, + "orderedExactRate": 0.6213402732595966, + "setExact": 1128, + "setExactRate": 0.7338972023422251, + "meanSetJaccard": 0.9218793568175483, + "meanTokenWeightedTv": 0.020018341779837894, + "meanAggregateLoadTv": 0.03585022050074503 + }, + { + "layer": "layer_06", + "tokens": 1537, + "orderedExact": 958, + "orderedExactRate": 0.623292127521145, + "setExact": 1150, + "setExactRate": 0.7482108002602472, + "meanSetJaccard": 0.9251634290671376, + "meanTokenWeightedTv": 0.019382337979483372, + "meanAggregateLoadTv": 0.03259468153401429 + }, + { + "layer": "layer_07", + "tokens": 1537, + "orderedExact": 906, + "orderedExactRate": 0.5894599869876382, + "setExact": 1119, + "setExactRate": 0.7280416395575797, + "meanSetJaccard": 0.9201815534281378, + "meanTokenWeightedTv": 0.022929825683213126, + "meanAggregateLoadTv": 0.037581706993039844 + }, + { + "layer": "layer_08", + "tokens": 1537, + "orderedExact": 901, + "orderedExactRate": 0.5862068965517241, + "setExact": 1091, + "setExactRate": 0.7098243331164606, + "meanSetJaccard": 0.9137593051060845, + "meanTokenWeightedTv": 0.022408862467023172, + "meanAggregateLoadTv": 0.04212730113579182 + }, + { + "layer": "layer_09", + "tokens": 1537, + "orderedExact": 859, + "orderedExactRate": 0.5588809368900456, + "setExact": 1087, + "setExactRate": 0.7072218607677293, + "meanSetJaccard": 0.9124890507453941, + "meanTokenWeightedTv": 0.021957376860038826, + "meanAggregateLoadTv": 0.03950568908216402 + }, + { + "layer": "layer_10", + "tokens": 1537, + "orderedExact": 851, + "orderedExactRate": 0.5536759921925829, + "setExact": 1070, + "setExactRate": 0.6961613532856213, + "meanSetJaccard": 0.9087895405397032, + "meanTokenWeightedTv": 0.022936704817994594, + "meanAggregateLoadTv": 0.04078097785405086 + }, + { + "layer": "layer_11", + "tokens": 1537, + "orderedExact": 820, + "orderedExactRate": 0.5335068314899154, + "setExact": 1030, + "setExactRate": 0.6701366297983083, + "meanSetJaccard": 0.9002664435976083, + "meanTokenWeightedTv": 0.0223463410087179, + "meanAggregateLoadTv": 0.04257724774543393 + }, + { + "layer": "layer_12", + "tokens": 1537, + "orderedExact": 787, + "orderedExactRate": 0.5120364346128823, + "setExact": 1014, + "setExactRate": 0.6597267404033832, + "meanSetJaccard": 0.8969699786225486, + "meanTokenWeightedTv": 0.02463133813155915, + "meanAggregateLoadTv": 0.04238982388310015 + }, + { + "layer": "layer_13", + "tokens": 1537, + "orderedExact": 688, + "orderedExactRate": 0.4476252439817827, + "setExact": 931, + "setExactRate": 0.6057254391672089, + "meanSetJaccard": 0.8762465251079433, + "meanTokenWeightedTv": 0.02577913362330953, + "meanAggregateLoadTv": 0.04816015486701687 + }, + { + "layer": "layer_14", + "tokens": 1537, + "orderedExact": 718, + "orderedExactRate": 0.4671437865972674, + "setExact": 952, + "setExactRate": 0.6193884189980482, + "meanSetJaccard": 0.8820401242652383, + "meanTokenWeightedTv": 0.02699134144494545, + "meanAggregateLoadTv": 0.048797296516031784 + }, + { + "layer": "layer_15", + "tokens": 1537, + "orderedExact": 684, + "orderedExactRate": 0.4450227716330514, + "setExact": 890, + "setExactRate": 0.5790500975927131, + "meanSetJaccard": 0.8688849645258234, + "meanTokenWeightedTv": 0.027814849487177034, + "meanAggregateLoadTv": 0.05052609032030526 + }, + { + "layer": "layer_16", + "tokens": 1537, + "orderedExact": 686, + "orderedExactRate": 0.44632400780741704, + "setExact": 910, + "setExactRate": 0.5920624593363696, + "meanSetJaccard": 0.873699538370976, + "meanTokenWeightedTv": 0.02867086917869072, + "meanAggregateLoadTv": 0.051653658717336334 + }, + { + "layer": "layer_17", + "tokens": 1537, + "orderedExact": 698, + "orderedExactRate": 0.4541314248536109, + "setExact": 934, + "setExactRate": 0.6076772934287573, + "meanSetJaccard": 0.8789602503330544, + "meanTokenWeightedTv": 0.028507432505393653, + "meanAggregateLoadTv": 0.04852099891007626 + }, + { + "layer": "layer_18", + "tokens": 1537, + "orderedExact": 679, + "orderedExactRate": 0.4417696811971373, + "setExact": 909, + "setExactRate": 0.5914118412491868, + "meanSetJaccard": 0.8721814295008831, + "meanTokenWeightedTv": 0.029858638900959453, + "meanAggregateLoadTv": 0.054710701816540475 + }, + { + "layer": "layer_19", + "tokens": 1537, + "orderedExact": 668, + "orderedExactRate": 0.4346128822381262, + "setExact": 899, + "setExactRate": 0.5849056603773585, + "meanSetJaccard": 0.8667534157449578, + "meanTokenWeightedTv": 0.029781576118595367, + "meanAggregateLoadTv": 0.051437238409451594 + }, + { + "layer": "layer_20", + "tokens": 1537, + "orderedExact": 572, + "orderedExactRate": 0.37215354586857513, + "setExact": 806, + "setExactRate": 0.5243981782693559, + "meanSetJaccard": 0.8511850543730828, + "meanTokenWeightedTv": 0.03160760452313694, + "meanAggregateLoadTv": 0.05836111636272424 + }, + { + "layer": "layer_21", + "tokens": 1537, + "orderedExact": 612, + "orderedExactRate": 0.39817826935588807, + "setExact": 835, + "setExactRate": 0.5432661027976577, + "meanSetJaccard": 0.8521888651361651, + "meanTokenWeightedTv": 0.03323829115468648, + "meanAggregateLoadTv": 0.06199235824541923 + }, + { + "layer": "layer_22", + "tokens": 1537, + "orderedExact": 635, + "orderedExactRate": 0.41314248536109305, + "setExact": 846, + "setExactRate": 0.5504229017566689, + "meanSetJaccard": 0.8576326514517796, + "meanTokenWeightedTv": 0.03308550439165309, + "meanAggregateLoadTv": 0.058062825810715 + }, + { + "layer": "layer_23", + "tokens": 1537, + "orderedExact": 688, + "orderedExactRate": 0.4476252439817827, + "setExact": 911, + "setExactRate": 0.5927130774235524, + "meanSetJaccard": 0.8720299002667252, + "meanTokenWeightedTv": 0.02932248196605026, + "meanAggregateLoadTv": 0.05121101600082662 + }, + { + "layer": "layer_24", + "tokens": 1537, + "orderedExact": 563, + "orderedExactRate": 0.36629798308392975, + "setExact": 797, + "setExactRate": 0.5185426154847105, + "meanSetJaccard": 0.8411568045920681, + "meanTokenWeightedTv": 0.03074698778893931, + "meanAggregateLoadTv": 0.05959426474720382 + }, + { + "layer": "layer_25", + "tokens": 1537, + "orderedExact": 689, + "orderedExactRate": 0.4482758620689655, + "setExact": 901, + "setExactRate": 0.5862068965517241, + "meanSetJaccard": 0.8687052700065063, + "meanTokenWeightedTv": 0.029909098364762986, + "meanAggregateLoadTv": 0.05331014474276567 + }, + { + "layer": "layer_26", + "tokens": 1537, + "orderedExact": 680, + "orderedExactRate": 0.4424202992843201, + "setExact": 909, + "setExactRate": 0.5914118412491868, + "meanSetJaccard": 0.871781764104471, + "meanTokenWeightedTv": 0.03058150654115589, + "meanAggregateLoadTv": 0.05445142375449176 + } + ], + "bos_at_s0": [ + { + "layer": "layer_01", + "tokens": 1537, + "orderedExact": 646, + "orderedExactRate": 0.4202992843201041, + "setExact": 840, + "setExactRate": 0.5465191932335719, + "meanSetJaccard": 0.8476004585308424, + "meanTokenWeightedTv": 0.028301049866100478, + "meanAggregateLoadTv": 0.07973784976827858 + }, + { + "layer": "layer_02", + "tokens": 1537, + "orderedExact": 718, + "orderedExactRate": 0.4671437865972674, + "setExact": 928, + "setExactRate": 0.6037735849056604, + "meanSetJaccard": 0.876150199832698, + "meanTokenWeightedTv": 0.027644492576563654, + "meanAggregateLoadTv": 0.051470170798457414 + }, + { + "layer": "layer_03", + "tokens": 1537, + "orderedExact": 852, + "orderedExactRate": 0.5543266102797658, + "setExact": 1045, + "setExactRate": 0.6798959011060507, + "meanSetJaccard": 0.9054744864764382, + "meanTokenWeightedTv": 0.02424368888417117, + "meanAggregateLoadTv": 0.04083558650926075 + }, + { + "layer": "layer_04", + "tokens": 1537, + "orderedExact": 886, + "orderedExactRate": 0.5764476252439817, + "setExact": 1093, + "setExactRate": 0.7111255692908263, + "meanSetJaccard": 0.9149549214611022, + "meanTokenWeightedTv": 0.022016210258004647, + "meanAggregateLoadTv": 0.036896555948820096 + }, + { + "layer": "layer_05", + "tokens": 1537, + "orderedExact": 885, + "orderedExactRate": 0.5757970071567989, + "setExact": 1086, + "setExactRate": 0.7065712426805465, + "meanSetJaccard": 0.9124299036465593, + "meanTokenWeightedTv": 0.02248908771313056, + "meanAggregateLoadTv": 0.03699357316338857 + }, + { + "layer": "layer_06", + "tokens": 1537, + "orderedExact": 886, + "orderedExactRate": 0.5764476252439817, + "setExact": 1102, + "setExactRate": 0.7169811320754716, + "meanSetJaccard": 0.9167673575611115, + "meanTokenWeightedTv": 0.022119315432437326, + "meanAggregateLoadTv": 0.037864718743131486 + }, + { + "layer": "layer_07", + "tokens": 1537, + "orderedExact": 901, + "orderedExactRate": 0.5862068965517241, + "setExact": 1100, + "setExactRate": 0.715679895901106, + "meanSetJaccard": 0.91517179415683, + "meanTokenWeightedTv": 0.022656454762253052, + "meanAggregateLoadTv": 0.041494431401472465 + }, + { + "layer": "layer_08", + "tokens": 1537, + "orderedExact": 917, + "orderedExactRate": 0.5966167859466494, + "setExact": 1106, + "setExactRate": 0.719583604424203, + "meanSetJaccard": 0.9168138302816248, + "meanTokenWeightedTv": 0.021496876962131928, + "meanAggregateLoadTv": 0.03669762916968094 + }, + { + "layer": "layer_09", + "tokens": 1537, + "orderedExact": 874, + "orderedExactRate": 0.5686402081977879, + "setExact": 1084, + "setExactRate": 0.7052700065061809, + "meanSetJaccard": 0.9130030671995539, + "meanTokenWeightedTv": 0.02164115825958039, + "meanAggregateLoadTv": 0.04109293395054996 + }, + { + "layer": "layer_10", + "tokens": 1537, + "orderedExact": 879, + "orderedExactRate": 0.571893298633702, + "setExact": 1091, + "setExactRate": 0.7098243331164606, + "meanSetJaccard": 0.9128016854106639, + "meanTokenWeightedTv": 0.022073499121497562, + "meanAggregateLoadTv": 0.03652217232188096 + }, + { + "layer": "layer_11", + "tokens": 1537, + "orderedExact": 862, + "orderedExactRate": 0.560832791151594, + "setExact": 1059, + "setExactRate": 0.6890045543266102, + "meanSetJaccard": 0.9066672863029404, + "meanTokenWeightedTv": 0.020524518524441978, + "meanAggregateLoadTv": 0.038459227055440845 + }, + { + "layer": "layer_12", + "tokens": 1537, + "orderedExact": 821, + "orderedExactRate": 0.5341574495770982, + "setExact": 1063, + "setExactRate": 0.6916070266753416, + "meanSetJaccard": 0.9065898317687516, + "meanTokenWeightedTv": 0.022568930897481927, + "meanAggregateLoadTv": 0.03876930343992388 + }, + { + "layer": "layer_13", + "tokens": 1537, + "orderedExact": 754, + "orderedExactRate": 0.49056603773584906, + "setExact": 997, + "setExactRate": 0.6486662329212752, + "meanSetJaccard": 0.892849397403724, + "meanTokenWeightedTv": 0.022266344380338084, + "meanAggregateLoadTv": 0.040957688370190114 + }, + { + "layer": "layer_14", + "tokens": 1537, + "orderedExact": 750, + "orderedExactRate": 0.48796356538711777, + "setExact": 965, + "setExactRate": 0.6278464541314248, + "meanSetJaccard": 0.8860333983951421, + "meanTokenWeightedTv": 0.024466630488835298, + "meanAggregateLoadTv": 0.04542120754023409 + }, + { + "layer": "layer_15", + "tokens": 1537, + "orderedExact": 752, + "orderedExactRate": 0.4892648015614834, + "setExact": 989, + "setExactRate": 0.6434612882238127, + "meanSetJaccard": 0.890974997676364, + "meanTokenWeightedTv": 0.024500549376768165, + "meanAggregateLoadTv": 0.0481569425665839 + }, + { + "layer": "layer_16", + "tokens": 1537, + "orderedExact": 772, + "orderedExactRate": 0.5022771633051398, + "setExact": 986, + "setExactRate": 0.6415094339622641, + "meanSetJaccard": 0.8901075068934535, + "meanTokenWeightedTv": 0.024869546101940847, + "meanAggregateLoadTv": 0.04664692374245791 + }, + { + "layer": "layer_17", + "tokens": 1537, + "orderedExact": 785, + "orderedExactRate": 0.5107351984385166, + "setExact": 1003, + "setExactRate": 0.6525699414443722, + "meanSetJaccard": 0.8936301391083433, + "meanTokenWeightedTv": 0.023906719469897895, + "meanAggregateLoadTv": 0.040638162746976084 + }, + { + "layer": "layer_18", + "tokens": 1537, + "orderedExact": 742, + "orderedExactRate": 0.4827586206896552, + "setExact": 957, + "setExactRate": 0.6226415094339622, + "meanSetJaccard": 0.8864516528797595, + "meanTokenWeightedTv": 0.02470566270668977, + "meanAggregateLoadTv": 0.04367843565414766 + }, + { + "layer": "layer_19", + "tokens": 1537, + "orderedExact": 761, + "orderedExactRate": 0.4951203643461288, + "setExact": 962, + "setExactRate": 0.6258945998698764, + "meanSetJaccard": 0.8847941258481272, + "meanTokenWeightedTv": 0.0252494098056852, + "meanAggregateLoadTv": 0.045622639399559343 + }, + { + "layer": "layer_20", + "tokens": 1537, + "orderedExact": 701, + "orderedExactRate": 0.4560832791151594, + "setExact": 930, + "setExactRate": 0.605074821080026, + "meanSetJaccard": 0.8771075378752672, + "meanTokenWeightedTv": 0.025885613356434994, + "meanAggregateLoadTv": 0.04746007602386389 + }, + { + "layer": "layer_21", + "tokens": 1537, + "orderedExact": 743, + "orderedExactRate": 0.483409238776838, + "setExact": 968, + "setExactRate": 0.6297983083929733, + "meanSetJaccard": 0.881661864485547, + "meanTokenWeightedTv": 0.02559193475271567, + "meanAggregateLoadTv": 0.04908973892220742 + }, + { + "layer": "layer_22", + "tokens": 1537, + "orderedExact": 731, + "orderedExactRate": 0.47560182173064414, + "setExact": 959, + "setExactRate": 0.623942745608328, + "meanSetJaccard": 0.8834773987669239, + "meanTokenWeightedTv": 0.024929705449367186, + "meanAggregateLoadTv": 0.04567557369992671 + }, + { + "layer": "layer_23", + "tokens": 1537, + "orderedExact": 792, + "orderedExactRate": 0.5152895250487963, + "setExact": 1000, + "setExactRate": 0.6506180871828237, + "meanSetJaccard": 0.8917805248319236, + "meanTokenWeightedTv": 0.024309954603993274, + "meanAggregateLoadTv": 0.043814492061942906 + }, + { + "layer": "layer_24", + "tokens": 1537, + "orderedExact": 704, + "orderedExactRate": 0.45803513337670787, + "setExact": 919, + "setExactRate": 0.597918022121015, + "meanSetJaccard": 0.8748461471298167, + "meanTokenWeightedTv": 0.02300058938638734, + "meanAggregateLoadTv": 0.042382797779067706 + }, + { + "layer": "layer_25", + "tokens": 1537, + "orderedExact": 756, + "orderedExactRate": 0.49186727391021473, + "setExact": 963, + "setExactRate": 0.6265452179570592, + "meanSetJaccard": 0.8870619946091642, + "meanTokenWeightedTv": 0.02430862456580542, + "meanAggregateLoadTv": 0.04722629188410021 + }, + { + "layer": "layer_26", + "tokens": 1537, + "orderedExact": 831, + "orderedExactRate": 0.5406636304489265, + "setExact": 1030, + "setExactRate": 0.6701366297983083, + "meanSetJaccard": 0.8970164513430615, + "meanTokenWeightedTv": 0.024087703640342583, + "meanAggregateLoadTv": 0.0427684669196576 + } + ], + "bos_at_s1": [ + { + "layer": "layer_01", + "tokens": 1537, + "orderedExact": 629, + "orderedExactRate": 0.4092387768379961, + "setExact": 798, + "setExactRate": 0.5191932335718933, + "meanSetJaccard": 0.8426433683427828, + "meanTokenWeightedTv": 0.028436056012126548, + "meanAggregateLoadTv": 0.08336380853020339 + }, + { + "layer": "layer_02", + "tokens": 1537, + "orderedExact": 717, + "orderedExactRate": 0.4664931685100846, + "setExact": 930, + "setExactRate": 0.605074821080026, + "meanSetJaccard": 0.8787216903677542, + "meanTokenWeightedTv": 0.027796439077860405, + "meanAggregateLoadTv": 0.052827456860081744 + }, + { + "layer": "layer_03", + "tokens": 1537, + "orderedExact": 790, + "orderedExactRate": 0.5139882888744307, + "setExact": 984, + "setExactRate": 0.6402081977878985, + "meanSetJaccard": 0.894135142671252, + "meanTokenWeightedTv": 0.025892070609476705, + "meanAggregateLoadTv": 0.04314318162254377 + }, + { + "layer": "layer_04", + "tokens": 1537, + "orderedExact": 809, + "orderedExactRate": 0.5263500325309044, + "setExact": 1024, + "setExactRate": 0.6662329212752115, + "meanSetJaccard": 0.9014313597918022, + "meanTokenWeightedTv": 0.025611694903799664, + "meanAggregateLoadTv": 0.04628600629838937 + }, + { + "layer": "layer_05", + "tokens": 1537, + "orderedExact": 834, + "orderedExactRate": 0.5426154847104749, + "setExact": 1055, + "setExactRate": 0.686402081977879, + "meanSetJaccard": 0.9074728134585, + "meanTokenWeightedTv": 0.024688092537298992, + "meanAggregateLoadTv": 0.03982725348998757 + }, + { + "layer": "layer_06", + "tokens": 1537, + "orderedExact": 859, + "orderedExactRate": 0.5588809368900456, + "setExact": 1067, + "setExactRate": 0.6942094990240729, + "meanSetJaccard": 0.9092852495585092, + "meanTokenWeightedTv": 0.0232126639621011, + "meanAggregateLoadTv": 0.038748243178779 + }, + { + "layer": "layer_07", + "tokens": 1537, + "orderedExact": 841, + "orderedExactRate": 0.5471698113207547, + "setExact": 1061, + "setExactRate": 0.690305790500976, + "meanSetJaccard": 0.905644886451653, + "meanTokenWeightedTv": 0.024812069514052362, + "meanAggregateLoadTv": 0.04281897719300778 + }, + { + "layer": "layer_08", + "tokens": 1537, + "orderedExact": 850, + "orderedExactRate": 0.5530253741054001, + "setExact": 1068, + "setExactRate": 0.6948601171112557, + "meanSetJaccard": 0.9078600861294421, + "meanTokenWeightedTv": 0.02264231249064118, + "meanAggregateLoadTv": 0.0409394614852217 + }, + { + "layer": "layer_09", + "tokens": 1537, + "orderedExact": 834, + "orderedExactRate": 0.5426154847104749, + "setExact": 1036, + "setExactRate": 0.6740403383214053, + "meanSetJaccard": 0.9022988505747126, + "meanTokenWeightedTv": 0.023487768001056127, + "meanAggregateLoadTv": 0.04148669019942915 + }, + { + "layer": "layer_10", + "tokens": 1537, + "orderedExact": 846, + "orderedExactRate": 0.5504229017566689, + "setExact": 1056, + "setExactRate": 0.6870527000650618, + "meanSetJaccard": 0.9052111410601975, + "meanTokenWeightedTv": 0.024089388161684842, + "meanAggregateLoadTv": 0.03984087450916336 + }, + { + "layer": "layer_11", + "tokens": 1537, + "orderedExact": 791, + "orderedExactRate": 0.5146389069616135, + "setExact": 995, + "setExactRate": 0.6473649967469096, + "meanSetJaccard": 0.894274560832791, + "meanTokenWeightedTv": 0.022374741052122695, + "meanAggregateLoadTv": 0.04061112013529044 + }, + { + "layer": "layer_12", + "tokens": 1537, + "orderedExact": 779, + "orderedExactRate": 0.5068314899154196, + "setExact": 1026, + "setExactRate": 0.6675341574495771, + "meanSetJaccard": 0.8983176875174271, + "meanTokenWeightedTv": 0.02331077608682419, + "meanAggregateLoadTv": 0.03817500052333886 + }, + { + "layer": "layer_13", + "tokens": 1537, + "orderedExact": 702, + "orderedExactRate": 0.4567338972023422, + "setExact": 949, + "setExactRate": 0.6174365647364997, + "meanSetJaccard": 0.882981689748118, + "meanTokenWeightedTv": 0.023704338354208196, + "meanAggregateLoadTv": 0.046497597242930136 + }, + { + "layer": "layer_14", + "tokens": 1537, + "orderedExact": 731, + "orderedExactRate": 0.47560182173064414, + "setExact": 956, + "setExactRate": 0.6219908913467794, + "meanSetJaccard": 0.8837872169036777, + "meanTokenWeightedTv": 0.025598520291411117, + "meanAggregateLoadTv": 0.04520255176520509 + }, + { + "layer": "layer_15", + "tokens": 1537, + "orderedExact": 705, + "orderedExactRate": 0.4586857514638907, + "setExact": 924, + "setExactRate": 0.6011711125569291, + "meanSetJaccard": 0.8763887597979987, + "meanTokenWeightedTv": 0.026813246747409324, + "meanAggregateLoadTv": 0.0523222091583764 + }, + { + "layer": "layer_16", + "tokens": 1537, + "orderedExact": 726, + "orderedExactRate": 0.47234873129473, + "setExact": 949, + "setExactRate": 0.6174365647364997, + "meanSetJaccard": 0.8805558137373359, + "meanTokenWeightedTv": 0.026265081016136376, + "meanAggregateLoadTv": 0.04877844428665126 + }, + { + "layer": "layer_17", + "tokens": 1537, + "orderedExact": 733, + "orderedExactRate": 0.47690305790500975, + "setExact": 952, + "setExactRate": 0.6193884189980482, + "meanSetJaccard": 0.8801158719831459, + "meanTokenWeightedTv": 0.02673861818636805, + "meanAggregateLoadTv": 0.04345158187357359 + }, + { + "layer": "layer_18", + "tokens": 1537, + "orderedExact": 721, + "orderedExactRate": 0.4690956408588159, + "setExact": 930, + "setExactRate": 0.605074821080026, + "meanSetJaccard": 0.8777271741487747, + "meanTokenWeightedTv": 0.026463184913484757, + "meanAggregateLoadTv": 0.04677630782258108 + }, + { + "layer": "layer_19", + "tokens": 1537, + "orderedExact": 738, + "orderedExactRate": 0.4801561483409239, + "setExact": 940, + "setExactRate": 0.6115810019518543, + "meanSetJaccard": 0.8766954797533849, + "meanTokenWeightedTv": 0.02624875567280102, + "meanAggregateLoadTv": 0.04772607280901515 + }, + { + "layer": "layer_20", + "tokens": 1537, + "orderedExact": 679, + "orderedExactRate": 0.4417696811971373, + "setExact": 920, + "setExactRate": 0.5985686402081978, + "meanSetJaccard": 0.8743194562973352, + "meanTokenWeightedTv": 0.027572294749182543, + "meanAggregateLoadTv": 0.050957242400728915 + }, + { + "layer": "layer_21", + "tokens": 1537, + "orderedExact": 657, + "orderedExactRate": 0.42745608327911516, + "setExact": 891, + "setExactRate": 0.5797007156798959, + "meanSetJaccard": 0.8691018372215509, + "meanTokenWeightedTv": 0.027510928380942403, + "meanAggregateLoadTv": 0.048174926911159224 + }, + { + "layer": "layer_22", + "tokens": 1537, + "orderedExact": 701, + "orderedExactRate": 0.4560832791151594, + "setExact": 923, + "setExactRate": 0.6005204944697463, + "meanSetJaccard": 0.8725194129227962, + "meanTokenWeightedTv": 0.02679224214832216, + "meanAggregateLoadTv": 0.047770929895173356 + }, + { + "layer": "layer_23", + "tokens": 1537, + "orderedExact": 733, + "orderedExactRate": 0.47690305790500975, + "setExact": 947, + "setExactRate": 0.616135328562134, + "meanSetJaccard": 0.880952380952381, + "meanTokenWeightedTv": 0.0265667266056681, + "meanAggregateLoadTv": 0.05225609895410459 + }, + { + "layer": "layer_24", + "tokens": 1537, + "orderedExact": 628, + "orderedExactRate": 0.4085881587508133, + "setExact": 868, + "setExactRate": 0.564736499674691, + "meanSetJaccard": 0.8612014747343308, + "meanTokenWeightedTv": 0.02521083873054497, + "meanAggregateLoadTv": 0.050894801071186546 + }, + { + "layer": "layer_25", + "tokens": 1537, + "orderedExact": 755, + "orderedExactRate": 0.49121665582303187, + "setExact": 962, + "setExactRate": 0.6258945998698764, + "meanSetJaccard": 0.8855903584595842, + "meanTokenWeightedTv": 0.02478673275232344, + "meanAggregateLoadTv": 0.04620045922000084 + }, + { + "layer": "layer_26", + "tokens": 1537, + "orderedExact": 778, + "orderedExactRate": 0.5061808718282368, + "setExact": 997, + "setExactRate": 0.6486662329212752, + "meanSetJaccard": 0.8895870124237072, + "meanTokenWeightedTv": 0.02547277288976468, + "meanAggregateLoadTv": 0.04798015014992105 + } + ], + "x_at_s0": [ + { + "layer": "layer_01", + "tokens": 1537, + "orderedExact": 695, + "orderedExactRate": 0.4521795705920625, + "setExact": 876, + "setExactRate": 0.5699414443721535, + "meanSetJaccard": 0.858583511478762, + "meanTokenWeightedTv": 0.02535410929254247, + "meanAggregateLoadTv": 0.07274003618994834 + }, + { + "layer": "layer_02", + "tokens": 1537, + "orderedExact": 730, + "orderedExactRate": 0.4749512036434613, + "setExact": 941, + "setExactRate": 0.6122316200390371, + "meanSetJaccard": 0.8807974718840041, + "meanTokenWeightedTv": 0.026915455656915742, + "meanAggregateLoadTv": 0.05207202027136524 + }, + { + "layer": "layer_03", + "tokens": 1537, + "orderedExact": 867, + "orderedExactRate": 0.5640858815875082, + "setExact": 1053, + "setExactRate": 0.6851008458035134, + "meanSetJaccard": 0.9068221953713168, + "meanTokenWeightedTv": 0.023964068789937704, + "meanAggregateLoadTv": 0.04184601758380808 + }, + { + "layer": "layer_04", + "tokens": 1537, + "orderedExact": 907, + "orderedExactRate": 0.590110605074821, + "setExact": 1106, + "setExactRate": 0.719583604424203, + "meanSetJaccard": 0.9172320847662425, + "meanTokenWeightedTv": 0.023104916749586837, + "meanAggregateLoadTv": 0.04027438015443487 + }, + { + "layer": "layer_05", + "tokens": 1537, + "orderedExact": 880, + "orderedExactRate": 0.5725439167208849, + "setExact": 1096, + "setExactRate": 0.7130774235523748, + "meanSetJaccard": 0.914288812467082, + "meanTokenWeightedTv": 0.022998452694965543, + "meanAggregateLoadTv": 0.03730260647370324 + }, + { + "layer": "layer_06", + "tokens": 1537, + "orderedExact": 880, + "orderedExactRate": 0.5725439167208849, + "setExact": 1099, + "setExactRate": 0.7150292778139232, + "meanSetJaccard": 0.9156520122687982, + "meanTokenWeightedTv": 0.023177302340740013, + "meanAggregateLoadTv": 0.04174895788345432 + }, + { + "layer": "layer_07", + "tokens": 1537, + "orderedExact": 874, + "orderedExactRate": 0.5686402081977879, + "setExact": 1067, + "setExactRate": 0.6942094990240729, + "meanSetJaccard": 0.9079220497567928, + "meanTokenWeightedTv": 0.025582174587481514, + "meanAggregateLoadTv": 0.044142566805186925 + }, + { + "layer": "layer_08", + "tokens": 1537, + "orderedExact": 861, + "orderedExactRate": 0.5601821730644112, + "setExact": 1068, + "setExactRate": 0.6948601171112557, + "meanSetJaccard": 0.9089134677944049, + "meanTokenWeightedTv": 0.024681358851677195, + "meanAggregateLoadTv": 0.04290167479365357 + }, + { + "layer": "layer_09", + "tokens": 1537, + "orderedExact": 837, + "orderedExactRate": 0.5445673389720235, + "setExact": 1054, + "setExactRate": 0.6857514638906962, + "meanSetJaccard": 0.9065123772345635, + "meanTokenWeightedTv": 0.023987334135094487, + "meanAggregateLoadTv": 0.043713943454953136 + }, + { + "layer": "layer_10", + "tokens": 1537, + "orderedExact": 827, + "orderedExactRate": 0.5380611581001952, + "setExact": 1051, + "setExactRate": 0.6837996096291477, + "meanSetJaccard": 0.9050562319918211, + "meanTokenWeightedTv": 0.024719085028322315, + "meanAggregateLoadTv": 0.03953920697416336 + }, + { + "layer": "layer_11", + "tokens": 1537, + "orderedExact": 835, + "orderedExactRate": 0.5432661027976577, + "setExact": 1040, + "setExactRate": 0.6766428106701367, + "meanSetJaccard": 0.9026396505251416, + "meanTokenWeightedTv": 0.022758268359074702, + "meanAggregateLoadTv": 0.04119097042242572 + }, + { + "layer": "layer_12", + "tokens": 1537, + "orderedExact": 784, + "orderedExactRate": 0.5100845803513337, + "setExact": 1020, + "setExactRate": 0.6636304489264802, + "meanSetJaccard": 0.8969080149951977, + "meanTokenWeightedTv": 0.0253894122524635, + "meanAggregateLoadTv": 0.04263988097898465 + }, + { + "layer": "layer_13", + "tokens": 1537, + "orderedExact": 695, + "orderedExactRate": 0.4521795705920625, + "setExact": 926, + "setExactRate": 0.6024723487312947, + "meanSetJaccard": 0.8780710722805711, + "meanTokenWeightedTv": 0.026110371678370232, + "meanAggregateLoadTv": 0.049699933631819945 + }, + { + "layer": "layer_14", + "tokens": 1537, + "orderedExact": 712, + "orderedExactRate": 0.46324007807417045, + "setExact": 950, + "setExactRate": 0.6180871828236825, + "meanSetJaccard": 0.881200235461784, + "meanTokenWeightedTv": 0.025964909544069523, + "meanAggregateLoadTv": 0.04356629380459143 + }, + { + "layer": "layer_15", + "tokens": 1537, + "orderedExact": 722, + "orderedExactRate": 0.4697462589459987, + "setExact": 926, + "setExactRate": 0.6024723487312947, + "meanSetJaccard": 0.8756544908138923, + "meanTokenWeightedTv": 0.027897486312657913, + "meanAggregateLoadTv": 0.050392746049081734 + }, + { + "layer": "layer_16", + "tokens": 1537, + "orderedExact": 703, + "orderedExactRate": 0.45738451528952506, + "setExact": 935, + "setExactRate": 0.6083279115159401, + "meanSetJaccard": 0.8775505778108249, + "meanTokenWeightedTv": 0.0280610302625136, + "meanAggregateLoadTv": 0.05345207158463827 + }, + { + "layer": "layer_17", + "tokens": 1537, + "orderedExact": 698, + "orderedExactRate": 0.4541314248536109, + "setExact": 912, + "setExactRate": 0.5933636955107352, + "meanSetJaccard": 0.8730987728385257, + "meanTokenWeightedTv": 0.029008729085187722, + "meanAggregateLoadTv": 0.049002086862261866 + }, + { + "layer": "layer_18", + "tokens": 1537, + "orderedExact": 695, + "orderedExactRate": 0.4521795705920625, + "setExact": 916, + "setExactRate": 0.5959661678594665, + "meanSetJaccard": 0.8743997273600397, + "meanTokenWeightedTv": 0.027894349473513595, + "meanAggregateLoadTv": 0.045598788360559035 + }, + { + "layer": "layer_19", + "tokens": 1537, + "orderedExact": 725, + "orderedExactRate": 0.4716981132075472, + "setExact": 934, + "setExactRate": 0.6076772934287573, + "meanSetJaccard": 0.8760262725779967, + "meanTokenWeightedTv": 0.027797304011889727, + "meanAggregateLoadTv": 0.05165355934476638 + }, + { + "layer": "layer_20", + "tokens": 1537, + "orderedExact": 636, + "orderedExactRate": 0.41379310344827586, + "setExact": 878, + "setExactRate": 0.5712426805465192, + "meanSetJaccard": 0.8650711032623848, + "meanTokenWeightedTv": 0.0281137916663822, + "meanAggregateLoadTv": 0.05060234331657911 + }, + { + "layer": "layer_21", + "tokens": 1537, + "orderedExact": 631, + "orderedExactRate": 0.41054001301236176, + "setExact": 865, + "setExactRate": 0.5627846454131424, + "meanSetJaccard": 0.8616507110326237, + "meanTokenWeightedTv": 0.0292221343358467, + "meanAggregateLoadTv": 0.05807525841142451 + }, + { + "layer": "layer_22", + "tokens": 1537, + "orderedExact": 709, + "orderedExactRate": 0.46128822381262197, + "setExact": 910, + "setExactRate": 0.5920624593363696, + "meanSetJaccard": 0.8705672770083961, + "meanTokenWeightedTv": 0.02844415133592819, + "meanAggregateLoadTv": 0.05011636269676991 + }, + { + "layer": "layer_23", + "tokens": 1537, + "orderedExact": 737, + "orderedExactRate": 0.47950553025374104, + "setExact": 943, + "setExactRate": 0.6135328562134027, + "meanSetJaccard": 0.8776469030860702, + "meanTokenWeightedTv": 0.027484588005944003, + "meanAggregateLoadTv": 0.049432514376506656 + }, + { + "layer": "layer_24", + "tokens": 1537, + "orderedExact": 668, + "orderedExactRate": 0.4346128822381262, + "setExact": 885, + "setExactRate": 0.5757970071567989, + "meanSetJaccard": 0.8640115252346873, + "meanTokenWeightedTv": 0.02523022131270678, + "meanAggregateLoadTv": 0.0480897632063151 + }, + { + "layer": "layer_25", + "tokens": 1537, + "orderedExact": 717, + "orderedExactRate": 0.4664931685100846, + "setExact": 946, + "setExactRate": 0.6154847104749512, + "meanSetJaccard": 0.8809430864082785, + "meanTokenWeightedTv": 0.02608540725018258, + "meanAggregateLoadTv": 0.049459694628323884 + }, + { + "layer": "layer_26", + "tokens": 1537, + "orderedExact": 755, + "orderedExactRate": 0.49121665582303187, + "setExact": 978, + "setExactRate": 0.6363044892648015, + "meanSetJaccard": 0.8883787216903678, + "meanTokenWeightedTv": 0.02567393316955161, + "meanAggregateLoadTv": 0.04771765906095577 + } + ], + "x_at_s1": [ + { + "layer": "layer_01", + "tokens": 1537, + "orderedExact": 644, + "orderedExactRate": 0.41899804814573843, + "setExact": 810, + "setExactRate": 0.5270006506180872, + "meanSetJaccard": 0.8461133314744245, + "meanTokenWeightedTv": 0.02843186556733575, + "meanAggregateLoadTv": 0.08266480695583903 + }, + { + "layer": "layer_02", + "tokens": 1537, + "orderedExact": 721, + "orderedExactRate": 0.4690956408588159, + "setExact": 933, + "setExactRate": 0.6070266753415745, + "meanSetJaccard": 0.8794497629891255, + "meanTokenWeightedTv": 0.02877742215713689, + "meanAggregateLoadTv": 0.054791045030037566 + }, + { + "layer": "layer_03", + "tokens": 1537, + "orderedExact": 800, + "orderedExactRate": 0.5204944697462589, + "setExact": 982, + "setExactRate": 0.6389069616135329, + "meanSetJaccard": 0.8923691792917556, + "meanTokenWeightedTv": 0.02719589854516042, + "meanAggregateLoadTv": 0.0423642523515134 + }, + { + "layer": "layer_04", + "tokens": 1537, + "orderedExact": 792, + "orderedExactRate": 0.5152895250487963, + "setExact": 987, + "setExactRate": 0.6421600520494469, + "meanSetJaccard": 0.8934380518635562, + "meanTokenWeightedTv": 0.028902006683415075, + "meanAggregateLoadTv": 0.05329845453294438 + }, + { + "layer": "layer_05", + "tokens": 1537, + "orderedExact": 809, + "orderedExactRate": 0.5263500325309044, + "setExact": 1006, + "setExactRate": 0.6545217957059206, + "meanSetJaccard": 0.8954208879387802, + "meanTokenWeightedTv": 0.027664900514590664, + "meanAggregateLoadTv": 0.04409616684552901 + }, + { + "layer": "layer_06", + "tokens": 1537, + "orderedExact": 797, + "orderedExactRate": 0.5185426154847105, + "setExact": 1016, + "setExactRate": 0.6610279765777488, + "meanSetJaccard": 0.8993865600892275, + "meanTokenWeightedTv": 0.027334693396407275, + "meanAggregateLoadTv": 0.04720595147498408 + }, + { + "layer": "layer_07", + "tokens": 1537, + "orderedExact": 773, + "orderedExactRate": 0.5029277813923227, + "setExact": 986, + "setExactRate": 0.6415094339622641, + "meanSetJaccard": 0.8880905908231866, + "meanTokenWeightedTv": 0.030348595656053693, + "meanAggregateLoadTv": 0.050139313555635306 + }, + { + "layer": "layer_08", + "tokens": 1537, + "orderedExact": 768, + "orderedExactRate": 0.4996746909564086, + "setExact": 1004, + "setExactRate": 0.653220559531555, + "meanSetJaccard": 0.8952228859841092, + "meanTokenWeightedTv": 0.028067847457445488, + "meanAggregateLoadTv": 0.0500166808993892 + }, + { + "layer": "layer_09", + "tokens": 1537, + "orderedExact": 741, + "orderedExactRate": 0.48210800260247233, + "setExact": 951, + "setExactRate": 0.6187378009108653, + "meanSetJaccard": 0.8826070914554974, + "meanTokenWeightedTv": 0.029586217234967505, + "meanAggregateLoadTv": 0.049074857471432434 + }, + { + "layer": "layer_10", + "tokens": 1537, + "orderedExact": 725, + "orderedExactRate": 0.4716981132075472, + "setExact": 963, + "setExactRate": 0.6265452179570592, + "meanSetJaccard": 0.8846856895002633, + "meanTokenWeightedTv": 0.03064324513547245, + "meanAggregateLoadTv": 0.04915088645406652 + }, + { + "layer": "layer_11", + "tokens": 1537, + "orderedExact": 707, + "orderedExactRate": 0.45998698763825635, + "setExact": 936, + "setExactRate": 0.6089785296031229, + "meanSetJaccard": 0.8780434703011151, + "meanTokenWeightedTv": 0.0284736674871754, + "meanAggregateLoadTv": 0.05329879550375635 + }, + { + "layer": "layer_12", + "tokens": 1537, + "orderedExact": 707, + "orderedExactRate": 0.45998698763825635, + "setExact": 940, + "setExactRate": 0.6115810019518543, + "meanSetJaccard": 0.8778449050407411, + "meanTokenWeightedTv": 0.03002483967419746, + "meanAggregateLoadTv": 0.05048157188500825 + }, + { + "layer": "layer_13", + "tokens": 1537, + "orderedExact": 587, + "orderedExactRate": 0.3819128171763175, + "setExact": 832, + "setExactRate": 0.5413142485361093, + "meanSetJaccard": 0.8547324720389132, + "meanTokenWeightedTv": 0.03227433694299723, + "meanAggregateLoadTv": 0.06016053432101613 + }, + { + "layer": "layer_14", + "tokens": 1537, + "orderedExact": 643, + "orderedExactRate": 0.4183474300585556, + "setExact": 866, + "setExactRate": 0.5634352635003254, + "meanSetJaccard": 0.8620751618799762, + "meanTokenWeightedTv": 0.03237705103326531, + "meanAggregateLoadTv": 0.053209525521887534 + }, + { + "layer": "layer_15", + "tokens": 1537, + "orderedExact": 613, + "orderedExactRate": 0.39882888744307093, + "setExact": 829, + "setExactRate": 0.5393623942745608, + "meanSetJaccard": 0.8525299467394456, + "meanTokenWeightedTv": 0.0330186027161274, + "meanAggregateLoadTv": 0.05886529558000585 + }, + { + "layer": "layer_16", + "tokens": 1537, + "orderedExact": 613, + "orderedExactRate": 0.39882888744307093, + "setExact": 822, + "setExactRate": 0.534808067664281, + "meanSetJaccard": 0.8522973014840287, + "meanTokenWeightedTv": 0.0340603657090726, + "meanAggregateLoadTv": 0.06477413250779611 + }, + { + "layer": "layer_17", + "tokens": 1537, + "orderedExact": 619, + "orderedExactRate": 0.40273259596616784, + "setExact": 858, + "setExactRate": 0.5582303188028627, + "meanSetJaccard": 0.856585466149552, + "meanTokenWeightedTv": 0.03426664612246665, + "meanAggregateLoadTv": 0.05591773393470037 + }, + { + "layer": "layer_18", + "tokens": 1537, + "orderedExact": 640, + "orderedExactRate": 0.41639557579700714, + "setExact": 880, + "setExactRate": 0.5725439167208849, + "meanSetJaccard": 0.8629088543206955, + "meanTokenWeightedTv": 0.03344863221120644, + "meanAggregateLoadTv": 0.05920730929584487 + }, + { + "layer": "layer_19", + "tokens": 1537, + "orderedExact": 592, + "orderedExactRate": 0.38516590761223163, + "setExact": 812, + "setExactRate": 0.5283018867924528, + "meanSetJaccard": 0.8467952130281343, + "meanTokenWeightedTv": 0.034400958812632026, + "meanAggregateLoadTv": 0.05634622940335547 + }, + { + "layer": "layer_20", + "tokens": 1537, + "orderedExact": 550, + "orderedExactRate": 0.357839947950553, + "setExact": 749, + "setExactRate": 0.48731294729993496, + "meanSetJaccard": 0.8340681656231429, + "meanTokenWeightedTv": 0.03576564053596308, + "meanAggregateLoadTv": 0.06388787568777203 + }, + { + "layer": "layer_21", + "tokens": 1537, + "orderedExact": 537, + "orderedExactRate": 0.34938191281717634, + "setExact": 765, + "setExactRate": 0.4977228366948601, + "meanSetJaccard": 0.8355085383061961, + "meanTokenWeightedTv": 0.037453105368974615, + "meanAggregateLoadTv": 0.06836896556437379 + }, + { + "layer": "layer_22", + "tokens": 1537, + "orderedExact": 576, + "orderedExactRate": 0.3747560182173064, + "setExact": 786, + "setExactRate": 0.5113858165256994, + "meanSetJaccard": 0.8406791213557643, + "meanTokenWeightedTv": 0.03716098654884562, + "meanAggregateLoadTv": 0.0651168909166684 + }, + { + "layer": "layer_23", + "tokens": 1537, + "orderedExact": 638, + "orderedExactRate": 0.41509433962264153, + "setExact": 859, + "setExactRate": 0.5588809368900456, + "meanSetJaccard": 0.8574064842119494, + "meanTokenWeightedTv": 0.03376972938647538, + "meanAggregateLoadTv": 0.059675004854406424 + }, + { + "layer": "layer_24", + "tokens": 1537, + "orderedExact": 505, + "orderedExactRate": 0.328562134027326, + "setExact": 751, + "setExactRate": 0.4886141834743006, + "meanSetJaccard": 0.8286117049292065, + "meanTokenWeightedTv": 0.033279068751787266, + "meanAggregateLoadTv": 0.05936982185137106 + }, + { + "layer": "layer_25", + "tokens": 1537, + "orderedExact": 681, + "orderedExactRate": 0.44307091737150295, + "setExact": 886, + "setExactRate": 0.5764476252439817, + "meanSetJaccard": 0.863261765343743, + "meanTokenWeightedTv": 0.03183821934976099, + "meanAggregateLoadTv": 0.05433789440833124 + }, + { + "layer": "layer_26", + "tokens": 1537, + "orderedExact": 685, + "orderedExactRate": 0.44567338972023424, + "setExact": 905, + "setExactRate": 0.5888093689004554, + "meanSetJaccard": 0.8701428261610435, + "meanTokenWeightedTv": 0.03273093623056109, + "meanAggregateLoadTv": 0.05709114582683336 + } + ], + "period_at_s0": [ + { + "layer": "layer_01", + "tokens": 1537, + "orderedExact": 707, + "orderedExactRate": 0.45998698763825635, + "setExact": 888, + "setExactRate": 0.5777488614183475, + "meanSetJaccard": 0.8597298385847506, + "meanTokenWeightedTv": 0.025262315880045856, + "meanAggregateLoadTv": 0.07275855638233325 + }, + { + "layer": "layer_02", + "tokens": 1537, + "orderedExact": 747, + "orderedExactRate": 0.4860117111255693, + "setExact": 951, + "setExactRate": 0.6187378009108653, + "meanSetJaccard": 0.8815720172258883, + "meanTokenWeightedTv": 0.026615304367816076, + "meanAggregateLoadTv": 0.05194328097863623 + }, + { + "layer": "layer_03", + "tokens": 1537, + "orderedExact": 887, + "orderedExactRate": 0.5770982433311646, + "setExact": 1063, + "setExactRate": 0.6916070266753416, + "meanSetJaccard": 0.9085416860303002, + "meanTokenWeightedTv": 0.02338236118382425, + "meanAggregateLoadTv": 0.03941988483680818 + }, + { + "layer": "layer_04", + "tokens": 1537, + "orderedExact": 892, + "orderedExactRate": 0.5803513337670787, + "setExact": 1092, + "setExactRate": 0.7104749512036435, + "meanSetJaccard": 0.9144901942559718, + "meanTokenWeightedTv": 0.023341507263199456, + "meanAggregateLoadTv": 0.04226227418547699 + }, + { + "layer": "layer_05", + "tokens": 1537, + "orderedExact": 883, + "orderedExactRate": 0.5744957709824333, + "setExact": 1095, + "setExactRate": 0.7124268054651919, + "meanSetJaccard": 0.9141339033987049, + "meanTokenWeightedTv": 0.022927892122113606, + "meanAggregateLoadTv": 0.038180790057900975 + }, + { + "layer": "layer_06", + "tokens": 1537, + "orderedExact": 878, + "orderedExactRate": 0.5712426805465192, + "setExact": 1082, + "setExactRate": 0.7039687703318153, + "meanSetJaccard": 0.9120736127892927, + "meanTokenWeightedTv": 0.02346260943196006, + "meanAggregateLoadTv": 0.04185591627983 + }, + { + "layer": "layer_07", + "tokens": 1537, + "orderedExact": 884, + "orderedExactRate": 0.5751463890696161, + "setExact": 1075, + "setExactRate": 0.6994144437215355, + "meanSetJaccard": 0.9081389224525204, + "meanTokenWeightedTv": 0.025782059827987945, + "meanAggregateLoadTv": 0.044891585356105906 + }, + { + "layer": "layer_08", + "tokens": 1537, + "orderedExact": 862, + "orderedExactRate": 0.560832791151594, + "setExact": 1069, + "setExactRate": 0.6955107351984385, + "meanSetJaccard": 0.908262849707222, + "meanTokenWeightedTv": 0.024750174654811552, + "meanAggregateLoadTv": 0.04509242806389058 + }, + { + "layer": "layer_09", + "tokens": 1537, + "orderedExact": 835, + "orderedExactRate": 0.5432661027976577, + "setExact": 1055, + "setExactRate": 0.686402081977879, + "meanSetJaccard": 0.9060011773089196, + "meanTokenWeightedTv": 0.024215596424442203, + "meanAggregateLoadTv": 0.04368912425679966 + }, + { + "layer": "layer_10", + "tokens": 1537, + "orderedExact": 822, + "orderedExactRate": 0.534808067664281, + "setExact": 1050, + "setExactRate": 0.6831489915419648, + "meanSetJaccard": 0.9046224866003655, + "meanTokenWeightedTv": 0.02467059878842953, + "meanAggregateLoadTv": 0.04045079364782796 + }, + { + "layer": "layer_11", + "tokens": 1537, + "orderedExact": 814, + "orderedExactRate": 0.5296031229668184, + "setExact": 1034, + "setExactRate": 0.6727391021470397, + "meanSetJaccard": 0.9011587198314589, + "meanTokenWeightedTv": 0.02355943715317893, + "meanAggregateLoadTv": 0.04369558423321273 + }, + { + "layer": "layer_12", + "tokens": 1537, + "orderedExact": 773, + "orderedExactRate": 0.5029277813923227, + "setExact": 1001, + "setExactRate": 0.6512687052700065, + "meanSetJaccard": 0.8934380518635562, + "meanTokenWeightedTv": 0.025969711625392126, + "meanAggregateLoadTv": 0.04197008047950515 + }, + { + "layer": "layer_13", + "tokens": 1537, + "orderedExact": 679, + "orderedExactRate": 0.4417696811971373, + "setExact": 926, + "setExactRate": 0.6024723487312947, + "meanSetJaccard": 0.8777612541438173, + "meanTokenWeightedTv": 0.025478433187552323, + "meanAggregateLoadTv": 0.050083481662263576 + }, + { + "layer": "layer_14", + "tokens": 1537, + "orderedExact": 732, + "orderedExactRate": 0.47625243981782694, + "setExact": 955, + "setExactRate": 0.6213402732595966, + "meanSetJaccard": 0.882826780679741, + "meanTokenWeightedTv": 0.025598363679382168, + "meanAggregateLoadTv": 0.04463239466656334 + }, + { + "layer": "layer_15", + "tokens": 1537, + "orderedExact": 713, + "orderedExactRate": 0.4638906961613533, + "setExact": 920, + "setExactRate": 0.5985686402081978, + "meanSetJaccard": 0.8750875236236328, + "meanTokenWeightedTv": 0.027824263985347455, + "meanAggregateLoadTv": 0.04973965461941469 + }, + { + "layer": "layer_16", + "tokens": 1537, + "orderedExact": 718, + "orderedExactRate": 0.4671437865972674, + "setExact": 951, + "setExactRate": 0.6187378009108653, + "meanSetJaccard": 0.8817176317501628, + "meanTokenWeightedTv": 0.02767099217302788, + "meanAggregateLoadTv": 0.051006409261571094 + }, + { + "layer": "layer_17", + "tokens": 1537, + "orderedExact": 717, + "orderedExactRate": 0.4664931685100846, + "setExact": 941, + "setExactRate": 0.6122316200390371, + "meanSetJaccard": 0.8780558630265852, + "meanTokenWeightedTv": 0.028515844174036728, + "meanAggregateLoadTv": 0.04843520738224058 + }, + { + "layer": "layer_18", + "tokens": 1537, + "orderedExact": 671, + "orderedExactRate": 0.4365647364996747, + "setExact": 896, + "setExactRate": 0.58295380611581, + "meanSetJaccard": 0.8714564550608792, + "meanTokenWeightedTv": 0.028591746637299985, + "meanAggregateLoadTv": 0.051277640935969 + }, + { + "layer": "layer_19", + "tokens": 1537, + "orderedExact": 726, + "orderedExactRate": 0.47234873129473, + "setExact": 946, + "setExactRate": 0.6154847104749512, + "meanSetJaccard": 0.8767140688415898, + "meanTokenWeightedTv": 0.02816846707659017, + "meanAggregateLoadTv": 0.05093524862544819 + }, + { + "layer": "layer_20", + "tokens": 1537, + "orderedExact": 663, + "orderedExactRate": 0.4313597918022121, + "setExact": 904, + "setExactRate": 0.5881587508132726, + "meanSetJaccard": 0.8699104625584781, + "meanTokenWeightedTv": 0.027975821274924196, + "meanAggregateLoadTv": 0.04956997129315635 + }, + { + "layer": "layer_21", + "tokens": 1537, + "orderedExact": 670, + "orderedExactRate": 0.4359141184124919, + "setExact": 904, + "setExactRate": 0.5881587508132726, + "meanSetJaccard": 0.8679926882919725, + "meanTokenWeightedTv": 0.02818629532419489, + "meanAggregateLoadTv": 0.04996717594818891 + }, + { + "layer": "layer_22", + "tokens": 1537, + "orderedExact": 681, + "orderedExactRate": 0.44307091737150295, + "setExact": 891, + "setExactRate": 0.5797007156798959, + "meanSetJaccard": 0.8687145645506088, + "meanTokenWeightedTv": 0.027966191965922257, + "meanAggregateLoadTv": 0.04924903121028716 + }, + { + "layer": "layer_23", + "tokens": 1537, + "orderedExact": 717, + "orderedExactRate": 0.4664931685100846, + "setExact": 941, + "setExactRate": 0.6122316200390371, + "meanSetJaccard": 0.8783223066241934, + "meanTokenWeightedTv": 0.027787813643804588, + "meanAggregateLoadTv": 0.0502464820684301 + }, + { + "layer": "layer_24", + "tokens": 1537, + "orderedExact": 657, + "orderedExactRate": 0.42745608327911516, + "setExact": 878, + "setExactRate": 0.5712426805465192, + "meanSetJaccard": 0.8632679617064783, + "meanTokenWeightedTv": 0.02541124148569418, + "meanAggregateLoadTv": 0.049356223226906304 + }, + { + "layer": "layer_25", + "tokens": 1537, + "orderedExact": 748, + "orderedExactRate": 0.4866623292127521, + "setExact": 971, + "setExactRate": 0.6317501626545218, + "meanSetJaccard": 0.8848932676518884, + "meanTokenWeightedTv": 0.025672375959218077, + "meanAggregateLoadTv": 0.05006669066443995 + }, + { + "layer": "layer_26", + "tokens": 1537, + "orderedExact": 751, + "orderedExactRate": 0.4886141834743006, + "setExact": 980, + "setExactRate": 0.6376057254391672, + "meanSetJaccard": 0.8865786783158287, + "meanTokenWeightedTv": 0.026402440508733374, + "meanAggregateLoadTv": 0.04980515556291979 + } + ], + "period_at_s1": [ + { + "layer": "layer_01", + "tokens": 1537, + "orderedExact": 641, + "orderedExactRate": 0.41704619388418995, + "setExact": 811, + "setExactRate": 0.52765126870527, + "meanSetJaccard": 0.8470892586051988, + "meanTokenWeightedTv": 0.02821337037240353, + "meanAggregateLoadTv": 0.08240120120956554 + }, + { + "layer": "layer_02", + "tokens": 1537, + "orderedExact": 721, + "orderedExactRate": 0.4690956408588159, + "setExact": 928, + "setExactRate": 0.6037735849056604, + "meanSetJaccard": 0.8790469994113453, + "meanTokenWeightedTv": 0.028851513014984037, + "meanAggregateLoadTv": 0.05504115757341841 + }, + { + "layer": "layer_03", + "tokens": 1537, + "orderedExact": 803, + "orderedExactRate": 0.5224463240078074, + "setExact": 986, + "setExactRate": 0.6415094339622641, + "meanSetJaccard": 0.8919819066208137, + "meanTokenWeightedTv": 0.027359608744659418, + "meanAggregateLoadTv": 0.04369452097746563 + }, + { + "layer": "layer_04", + "tokens": 1537, + "orderedExact": 783, + "orderedExactRate": 0.5094339622641509, + "setExact": 980, + "setExactRate": 0.6376057254391672, + "meanSetJaccard": 0.8922762338507294, + "meanTokenWeightedTv": 0.029144952449752765, + "meanAggregateLoadTv": 0.05315175712158464 + }, + { + "layer": "layer_05", + "tokens": 1537, + "orderedExact": 802, + "orderedExactRate": 0.5217957059206246, + "setExact": 1001, + "setExactRate": 0.6512687052700065, + "meanSetJaccard": 0.8942900517396289, + "meanTokenWeightedTv": 0.028352535430366786, + "meanAggregateLoadTv": 0.04665361650526173 + }, + { + "layer": "layer_06", + "tokens": 1537, + "orderedExact": 800, + "orderedExactRate": 0.5204944697462589, + "setExact": 1011, + "setExactRate": 0.6577748861418348, + "meanSetJaccard": 0.8983176875174274, + "meanTokenWeightedTv": 0.027171416278698853, + "meanAggregateLoadTv": 0.046601918408095 + }, + { + "layer": "layer_07", + "tokens": 1537, + "orderedExact": 765, + "orderedExactRate": 0.4977228366948601, + "setExact": 1000, + "setExactRate": 0.6506180871828237, + "meanSetJaccard": 0.8923134120271398, + "meanTokenWeightedTv": 0.029897704336317908, + "meanAggregateLoadTv": 0.04868773165847369 + }, + { + "layer": "layer_08", + "tokens": 1537, + "orderedExact": 758, + "orderedExactRate": 0.49316851008458035, + "setExact": 997, + "setExactRate": 0.6486662329212752, + "meanSetJaccard": 0.8955636859345384, + "meanTokenWeightedTv": 0.027351098760140816, + "meanAggregateLoadTv": 0.04751746086520971 + }, + { + "layer": "layer_09", + "tokens": 1537, + "orderedExact": 742, + "orderedExactRate": 0.4827586206896552, + "setExact": 969, + "setExactRate": 0.6304489264801562, + "meanSetJaccard": 0.8872078907862905, + "meanTokenWeightedTv": 0.02862950872100726, + "meanAggregateLoadTv": 0.04579333608817778 + }, + { + "layer": "layer_10", + "tokens": 1537, + "orderedExact": 744, + "orderedExactRate": 0.4840598568640208, + "setExact": 983, + "setExactRate": 0.6395575797007157, + "meanSetJaccard": 0.8900920159866159, + "meanTokenWeightedTv": 0.030029274480660527, + "meanAggregateLoadTv": 0.04991180170204927 + }, + { + "layer": "layer_11", + "tokens": 1537, + "orderedExact": 698, + "orderedExactRate": 0.4541314248536109, + "setExact": 922, + "setExactRate": 0.5998698763825634, + "meanSetJaccard": 0.875224125256656, + "meanTokenWeightedTv": 0.029047784795438087, + "meanAggregateLoadTv": 0.05415344902521147 + }, + { + "layer": "layer_12", + "tokens": 1537, + "orderedExact": 679, + "orderedExactRate": 0.4417696811971373, + "setExact": 919, + "setExactRate": 0.597918022121015, + "meanSetJaccard": 0.8735384329398644, + "meanTokenWeightedTv": 0.03139834694470757, + "meanAggregateLoadTv": 0.05181198927223271 + }, + { + "layer": "layer_13", + "tokens": 1537, + "orderedExact": 606, + "orderedExactRate": 0.39427456083279117, + "setExact": 838, + "setExactRate": 0.5452179570592063, + "meanSetJaccard": 0.8552966227006567, + "meanTokenWeightedTv": 0.03172857640303474, + "meanAggregateLoadTv": 0.05608480895326229 + }, + { + "layer": "layer_14", + "tokens": 1537, + "orderedExact": 642, + "orderedExactRate": 0.4176968119713728, + "setExact": 866, + "setExactRate": 0.5634352635003254, + "meanSetJaccard": 0.8617963255568979, + "meanTokenWeightedTv": 0.03285454202423708, + "meanAggregateLoadTv": 0.05588021158082045 + }, + { + "layer": "layer_15", + "tokens": 1537, + "orderedExact": 616, + "orderedExactRate": 0.4007807417046194, + "setExact": 837, + "setExactRate": 0.5445673389720235, + "meanSetJaccard": 0.854181277408343, + "meanTokenWeightedTv": 0.03308601943894244, + "meanAggregateLoadTv": 0.05687390175384553 + }, + { + "layer": "layer_16", + "tokens": 1537, + "orderedExact": 606, + "orderedExactRate": 0.39427456083279117, + "setExact": 832, + "setExactRate": 0.5413142485361093, + "meanSetJaccard": 0.8531740868110418, + "meanTokenWeightedTv": 0.03489247977623433, + "meanAggregateLoadTv": 0.06440750770501773 + }, + { + "layer": "layer_17", + "tokens": 1537, + "orderedExact": 623, + "orderedExactRate": 0.4053350683148991, + "setExact": 853, + "setExactRate": 0.5549772283669486, + "meanSetJaccard": 0.8547699318681751, + "meanTokenWeightedTv": 0.03440082986261053, + "meanAggregateLoadTv": 0.05777132194934027 + }, + { + "layer": "layer_18", + "tokens": 1537, + "orderedExact": 646, + "orderedExactRate": 0.4202992843201041, + "setExact": 858, + "setExactRate": 0.5582303188028627, + "meanSetJaccard": 0.8563004334637387, + "meanTokenWeightedTv": 0.035020203909758824, + "meanAggregateLoadTv": 0.0629106439982979 + }, + { + "layer": "layer_19", + "tokens": 1537, + "orderedExact": 601, + "orderedExactRate": 0.391021470396877, + "setExact": 823, + "setExactRate": 0.5354586857514639, + "meanSetJaccard": 0.8480775784614432, + "meanTokenWeightedTv": 0.03499010982189806, + "meanAggregateLoadTv": 0.05807666584031799 + }, + { + "layer": "layer_20", + "tokens": 1537, + "orderedExact": 550, + "orderedExactRate": 0.357839947950553, + "setExact": 771, + "setExactRate": 0.501626545217957, + "meanSetJaccard": 0.837844567057319, + "meanTokenWeightedTv": 0.036426914787458235, + "meanAggregateLoadTv": 0.06361825468244978 + }, + { + "layer": "layer_21", + "tokens": 1537, + "orderedExact": 550, + "orderedExactRate": 0.357839947950553, + "setExact": 788, + "setExactRate": 0.5126870527000651, + "meanSetJaccard": 0.8402270685289553, + "meanTokenWeightedTv": 0.037542081795380725, + "meanAggregateLoadTv": 0.06886572928521775 + }, + { + "layer": "layer_22", + "tokens": 1537, + "orderedExact": 598, + "orderedExactRate": 0.3890696161353286, + "setExact": 798, + "setExactRate": 0.5191932335718933, + "meanSetJaccard": 0.8428199646807322, + "meanTokenWeightedTv": 0.03788796818742536, + "meanAggregateLoadTv": 0.06550296087390844 + }, + { + "layer": "layer_23", + "tokens": 1537, + "orderedExact": 634, + "orderedExactRate": 0.41249186727391024, + "setExact": 858, + "setExactRate": 0.5582303188028627, + "meanSetJaccard": 0.8582925640830651, + "meanTokenWeightedTv": 0.03448616089717084, + "meanAggregateLoadTv": 0.060996090351735234 + }, + { + "layer": "layer_24", + "tokens": 1537, + "orderedExact": 535, + "orderedExactRate": 0.34808067664281067, + "setExact": 751, + "setExactRate": 0.4886141834743006, + "meanSetJaccard": 0.8274034141958672, + "meanTokenWeightedTv": 0.03437318650585078, + "meanAggregateLoadTv": 0.06424316413617533 + }, + { + "layer": "layer_25", + "tokens": 1537, + "orderedExact": 657, + "orderedExactRate": 0.42745608327911516, + "setExact": 856, + "setExactRate": 0.556929082628497, + "meanSetJaccard": 0.859481984075348, + "meanTokenWeightedTv": 0.0328607540130906, + "meanAggregateLoadTv": 0.056496181008437174 + }, + { + "layer": "layer_26", + "tokens": 1537, + "orderedExact": 667, + "orderedExactRate": 0.4339622641509434, + "setExact": 879, + "setExactRate": 0.571893298633702, + "meanSetJaccard": 0.8637636707252841, + "meanTokenWeightedTv": 0.03421398528609809, + "meanAggregateLoadTv": 0.0614079015456082 + } + ] + }, + "english": { + "system_eos": [ + { + "layer": "layer_01", + "tokens": 660, + "orderedExact": 530, + "orderedExactRate": 0.803030303030303, + "setExact": 570, + "setExactRate": 0.8636363636363636, + "meanSetJaccard": 0.9600649350649352, + "meanTokenWeightedTv": 0.007050064176194849, + "meanAggregateLoadTv": 0.020243286288879194 + }, + { + "layer": "layer_02", + "tokens": 660, + "orderedExact": 524, + "orderedExactRate": 0.793939393939394, + "setExact": 573, + "setExactRate": 0.8681818181818182, + "meanSetJaccard": 0.9616883116883118, + "meanTokenWeightedTv": 0.00857455469977457, + "meanAggregateLoadTv": 0.018750844751100903 + }, + { + "layer": "layer_03", + "tokens": 660, + "orderedExact": 556, + "orderedExactRate": 0.8424242424242424, + "setExact": 592, + "setExactRate": 0.896969696969697, + "meanSetJaccard": 0.9705627705627705, + "meanTokenWeightedTv": 0.007042477250223474, + "meanAggregateLoadTv": 0.011538302618011045 + }, + { + "layer": "layer_04", + "tokens": 660, + "orderedExact": 552, + "orderedExactRate": 0.8363636363636363, + "setExact": 603, + "setExactRate": 0.9136363636363637, + "meanSetJaccard": 0.9753246753246754, + "meanTokenWeightedTv": 0.006912117233070883, + "meanAggregateLoadTv": 0.013617196736382958 + }, + { + "layer": "layer_05", + "tokens": 660, + "orderedExact": 549, + "orderedExactRate": 0.8318181818181818, + "setExact": 596, + "setExactRate": 0.9030303030303031, + "meanSetJaccard": 0.9716450216450218, + "meanTokenWeightedTv": 0.007986601797292173, + "meanAggregateLoadTv": 0.012752579190004913 + }, + { + "layer": "layer_06", + "tokens": 660, + "orderedExact": 533, + "orderedExactRate": 0.8075757575757576, + "setExact": 574, + "setExactRate": 0.8696969696969697, + "meanSetJaccard": 0.9624458874458875, + "meanTokenWeightedTv": 0.010075083699158039, + "meanAggregateLoadTv": 0.021942390397621858 + }, + { + "layer": "layer_07", + "tokens": 660, + "orderedExact": 513, + "orderedExactRate": 0.7772727272727272, + "setExact": 581, + "setExactRate": 0.8803030303030303, + "meanSetJaccard": 0.9654761904761906, + "meanTokenWeightedTv": 0.009012772778627394, + "meanAggregateLoadTv": 0.017212318366427573 + }, + { + "layer": "layer_08", + "tokens": 660, + "orderedExact": 513, + "orderedExactRate": 0.7772727272727272, + "setExact": 570, + "setExactRate": 0.8636363636363636, + "meanSetJaccard": 0.9603896103896105, + "meanTokenWeightedTv": 0.01072447693044067, + "meanAggregateLoadTv": 0.02111725221962415 + }, + { + "layer": "layer_09", + "tokens": 660, + "orderedExact": 503, + "orderedExactRate": 0.7621212121212121, + "setExact": 571, + "setExactRate": 0.8651515151515151, + "meanSetJaccard": 0.9611471861471862, + "meanTokenWeightedTv": 0.01062749335142216, + "meanAggregateLoadTv": 0.020345948344230053 + }, + { + "layer": "layer_10", + "tokens": 660, + "orderedExact": 492, + "orderedExactRate": 0.7454545454545455, + "setExact": 553, + "setExactRate": 0.8378787878787879, + "meanSetJaccard": 0.9533549783549784, + "meanTokenWeightedTv": 0.01129729271131312, + "meanAggregateLoadTv": 0.016652130029690564 + }, + { + "layer": "layer_11", + "tokens": 660, + "orderedExact": 483, + "orderedExactRate": 0.7318181818181818, + "setExact": 554, + "setExactRate": 0.8393939393939394, + "meanSetJaccard": 0.9534632034632033, + "meanTokenWeightedTv": 0.010035339157563302, + "meanAggregateLoadTv": 0.019357072092295306 + }, + { + "layer": "layer_12", + "tokens": 660, + "orderedExact": 461, + "orderedExactRate": 0.6984848484848485, + "setExact": 530, + "setExactRate": 0.803030303030303, + "meanSetJaccard": 0.9424963924963925, + "meanTokenWeightedTv": 0.01259116973686369, + "meanAggregateLoadTv": 0.022446104324096543 + }, + { + "layer": "layer_13", + "tokens": 660, + "orderedExact": 436, + "orderedExactRate": 0.6606060606060606, + "setExact": 517, + "setExactRate": 0.7833333333333333, + "meanSetJaccard": 0.9364718614718615, + "meanTokenWeightedTv": 0.012260348390849935, + "meanAggregateLoadTv": 0.025223883074289664 + }, + { + "layer": "layer_14", + "tokens": 660, + "orderedExact": 434, + "orderedExactRate": 0.6575757575757576, + "setExact": 515, + "setExactRate": 0.7803030303030303, + "meanSetJaccard": 0.93495670995671, + "meanTokenWeightedTv": 0.012698273620551339, + "meanAggregateLoadTv": 0.02248896283579697 + }, + { + "layer": "layer_15", + "tokens": 660, + "orderedExact": 436, + "orderedExactRate": 0.6606060606060606, + "setExact": 514, + "setExactRate": 0.7787878787878788, + "meanSetJaccard": 0.9341991341991344, + "meanTokenWeightedTv": 0.013620651623920843, + "meanAggregateLoadTv": 0.02460633265099782 + }, + { + "layer": "layer_16", + "tokens": 660, + "orderedExact": 443, + "orderedExactRate": 0.6712121212121213, + "setExact": 525, + "setExactRate": 0.7954545454545454, + "meanSetJaccard": 0.9409090909090909, + "meanTokenWeightedTv": 0.013337266826193454, + "meanAggregateLoadTv": 0.025126223401300836 + }, + { + "layer": "layer_17", + "tokens": 660, + "orderedExact": 463, + "orderedExactRate": 0.7015151515151515, + "setExact": 536, + "setExactRate": 0.8121212121212121, + "meanSetJaccard": 0.9450216450216451, + "meanTokenWeightedTv": 0.012852110304406698, + "meanAggregateLoadTv": 0.01863066741165907 + }, + { + "layer": "layer_18", + "tokens": 660, + "orderedExact": 449, + "orderedExactRate": 0.6803030303030303, + "setExact": 514, + "setExactRate": 0.7787878787878788, + "meanSetJaccard": 0.9355699855699856, + "meanTokenWeightedTv": 0.014333621787150613, + "meanAggregateLoadTv": 0.02473701485448343 + }, + { + "layer": "layer_19", + "tokens": 660, + "orderedExact": 425, + "orderedExactRate": 0.6439393939393939, + "setExact": 503, + "setExactRate": 0.7621212121212121, + "meanSetJaccard": 0.9304112554112554, + "meanTokenWeightedTv": 0.014676064580195138, + "meanAggregateLoadTv": 0.02412714373407892 + }, + { + "layer": "layer_20", + "tokens": 660, + "orderedExact": 384, + "orderedExactRate": 0.5818181818181818, + "setExact": 475, + "setExactRate": 0.7196969696969697, + "meanSetJaccard": 0.9155122655122654, + "meanTokenWeightedTv": 0.015915491203325353, + "meanAggregateLoadTv": 0.027433748342420808 + }, + { + "layer": "layer_21", + "tokens": 660, + "orderedExact": 396, + "orderedExactRate": 0.6, + "setExact": 483, + "setExactRate": 0.7318181818181818, + "meanSetJaccard": 0.9187229437229437, + "meanTokenWeightedTv": 0.016501787772588643, + "meanAggregateLoadTv": 0.025895003164295095 + }, + { + "layer": "layer_22", + "tokens": 660, + "orderedExact": 404, + "orderedExactRate": 0.6121212121212121, + "setExact": 494, + "setExactRate": 0.7484848484848485, + "meanSetJaccard": 0.9243867243867243, + "meanTokenWeightedTv": 0.016849776600783354, + "meanAggregateLoadTv": 0.028020754505178058 + }, + { + "layer": "layer_23", + "tokens": 660, + "orderedExact": 420, + "orderedExactRate": 0.6363636363636364, + "setExact": 496, + "setExactRate": 0.7515151515151515, + "meanSetJaccard": 0.928030303030303, + "meanTokenWeightedTv": 0.01645540421613592, + "meanAggregateLoadTv": 0.03092998783447282 + }, + { + "layer": "layer_24", + "tokens": 660, + "orderedExact": 391, + "orderedExactRate": 0.5924242424242424, + "setExact": 468, + "setExactRate": 0.7090909090909091, + "meanSetJaccard": 0.9133838383838384, + "meanTokenWeightedTv": 0.015407257777412583, + "meanAggregateLoadTv": 0.027425296663917454 + }, + { + "layer": "layer_25", + "tokens": 660, + "orderedExact": 423, + "orderedExactRate": 0.6409090909090909, + "setExact": 487, + "setExactRate": 0.7378787878787879, + "meanSetJaccard": 0.9227056277056277, + "meanTokenWeightedTv": 0.01622304400120772, + "meanAggregateLoadTv": 0.026222698105621556 + }, + { + "layer": "layer_26", + "tokens": 660, + "orderedExact": 435, + "orderedExactRate": 0.6590909090909091, + "setExact": 502, + "setExactRate": 0.7606060606060606, + "meanSetJaccard": 0.9282251082251082, + "meanTokenWeightedTv": 0.015897950203459264, + "meanAggregateLoadTv": 0.02932869203935013 + } + ], + "system_bos": [ + { + "layer": "layer_01", + "tokens": 660, + "orderedExact": 402, + "orderedExactRate": 0.6090909090909091, + "setExact": 467, + "setExactRate": 0.7075757575757575, + "meanSetJaccard": 0.9115800865800865, + "meanTokenWeightedTv": 0.01404234494332868, + "meanAggregateLoadTv": 0.04003172321689755 + }, + { + "layer": "layer_02", + "tokens": 660, + "orderedExact": 439, + "orderedExactRate": 0.6651515151515152, + "setExact": 506, + "setExactRate": 0.7666666666666667, + "meanSetJaccard": 0.9317099567099566, + "meanTokenWeightedTv": 0.015860749506197095, + "meanAggregateLoadTv": 0.029308987431570573 + }, + { + "layer": "layer_03", + "tokens": 660, + "orderedExact": 452, + "orderedExactRate": 0.6848484848484848, + "setExact": 514, + "setExactRate": 0.7787878787878788, + "meanSetJaccard": 0.9354978354978354, + "meanTokenWeightedTv": 0.016112760113448605, + "meanAggregateLoadTv": 0.029670258485557453 + }, + { + "layer": "layer_04", + "tokens": 660, + "orderedExact": 500, + "orderedExactRate": 0.7575757575757576, + "setExact": 560, + "setExactRate": 0.8484848484848485, + "meanSetJaccard": 0.9550865800865801, + "meanTokenWeightedTv": 0.013392632123897585, + "meanAggregateLoadTv": 0.020791816754807506 + }, + { + "layer": "layer_05", + "tokens": 660, + "orderedExact": 463, + "orderedExactRate": 0.7015151515151515, + "setExact": 532, + "setExactRate": 0.806060606060606, + "meanSetJaccard": 0.9432900432900434, + "meanTokenWeightedTv": 0.014749425254554796, + "meanAggregateLoadTv": 0.025522673664100805 + }, + { + "layer": "layer_06", + "tokens": 660, + "orderedExact": 472, + "orderedExactRate": 0.7151515151515152, + "setExact": 541, + "setExactRate": 0.8196969696969697, + "meanSetJaccard": 0.9481601731601731, + "meanTokenWeightedTv": 0.014476347313114323, + "meanAggregateLoadTv": 0.02383911014171859 + }, + { + "layer": "layer_07", + "tokens": 660, + "orderedExact": 453, + "orderedExactRate": 0.6863636363636364, + "setExact": 527, + "setExactRate": 0.7984848484848485, + "meanSetJaccard": 0.941125541125541, + "meanTokenWeightedTv": 0.01605854382456868, + "meanAggregateLoadTv": 0.024871063698806137 + }, + { + "layer": "layer_08", + "tokens": 660, + "orderedExact": 458, + "orderedExactRate": 0.693939393939394, + "setExact": 515, + "setExactRate": 0.7803030303030303, + "meanSetJaccard": 0.93502886002886, + "meanTokenWeightedTv": 0.016009742508826027, + "meanAggregateLoadTv": 0.026914341021460196 + }, + { + "layer": "layer_09", + "tokens": 660, + "orderedExact": 458, + "orderedExactRate": 0.693939393939394, + "setExact": 526, + "setExactRate": 0.796969696969697, + "meanSetJaccard": 0.941991341991342, + "meanTokenWeightedTv": 0.014283852868028834, + "meanAggregateLoadTv": 0.02260709949218137 + }, + { + "layer": "layer_10", + "tokens": 660, + "orderedExact": 447, + "orderedExactRate": 0.6772727272727272, + "setExact": 525, + "setExactRate": 0.7954545454545454, + "meanSetJaccard": 0.9390331890331891, + "meanTokenWeightedTv": 0.01606150680041523, + "meanAggregateLoadTv": 0.022506060675872453 + }, + { + "layer": "layer_11", + "tokens": 660, + "orderedExact": 433, + "orderedExactRate": 0.656060606060606, + "setExact": 519, + "setExactRate": 0.7863636363636364, + "meanSetJaccard": 0.9373376623376622, + "meanTokenWeightedTv": 0.01365146127648731, + "meanAggregateLoadTv": 0.0239201095615367 + }, + { + "layer": "layer_12", + "tokens": 660, + "orderedExact": 423, + "orderedExactRate": 0.6409090909090909, + "setExact": 493, + "setExactRate": 0.746969696969697, + "meanSetJaccard": 0.9247835497835497, + "meanTokenWeightedTv": 0.017045240499020856, + "meanAggregateLoadTv": 0.028830765373336478 + }, + { + "layer": "layer_13", + "tokens": 660, + "orderedExact": 381, + "orderedExactRate": 0.5772727272727273, + "setExact": 471, + "setExactRate": 0.7136363636363636, + "meanSetJaccard": 0.9155844155844156, + "meanTokenWeightedTv": 0.016256317865545176, + "meanAggregateLoadTv": 0.026307076668759748 + }, + { + "layer": "layer_14", + "tokens": 660, + "orderedExact": 395, + "orderedExactRate": 0.5984848484848485, + "setExact": 484, + "setExactRate": 0.7333333333333333, + "meanSetJaccard": 0.9203102453102453, + "meanTokenWeightedTv": 0.017779566266179325, + "meanAggregateLoadTv": 0.030179090789653047 + }, + { + "layer": "layer_15", + "tokens": 660, + "orderedExact": 368, + "orderedExactRate": 0.5575757575757576, + "setExact": 461, + "setExactRate": 0.6984848484848485, + "meanSetJaccard": 0.9094516594516594, + "meanTokenWeightedTv": 0.018442150802069613, + "meanAggregateLoadTv": 0.029671043363656467 + }, + { + "layer": "layer_16", + "tokens": 660, + "orderedExact": 405, + "orderedExactRate": 0.6136363636363636, + "setExact": 497, + "setExactRate": 0.753030303030303, + "meanSetJaccard": 0.926911976911977, + "meanTokenWeightedTv": 0.016626295477684266, + "meanAggregateLoadTv": 0.023396286085749958 + }, + { + "layer": "layer_17", + "tokens": 660, + "orderedExact": 401, + "orderedExactRate": 0.6075757575757575, + "setExact": 485, + "setExactRate": 0.7348484848484849, + "meanSetJaccard": 0.920995670995671, + "meanTokenWeightedTv": 0.018860884880087102, + "meanAggregateLoadTv": 0.028184794027871714 + }, + { + "layer": "layer_18", + "tokens": 660, + "orderedExact": 394, + "orderedExactRate": 0.5969696969696969, + "setExact": 476, + "setExactRate": 0.7212121212121212, + "meanSetJaccard": 0.9155483405483404, + "meanTokenWeightedTv": 0.019535194439041212, + "meanAggregateLoadTv": 0.03460885179018776 + }, + { + "layer": "layer_19", + "tokens": 660, + "orderedExact": 390, + "orderedExactRate": 0.5909090909090909, + "setExact": 476, + "setExactRate": 0.7212121212121212, + "meanSetJaccard": 0.9164502164502165, + "meanTokenWeightedTv": 0.019253841364360168, + "meanAggregateLoadTv": 0.02999951068059895 + }, + { + "layer": "layer_20", + "tokens": 660, + "orderedExact": 362, + "orderedExactRate": 0.5484848484848485, + "setExact": 454, + "setExactRate": 0.6878787878787879, + "meanSetJaccard": 0.9062770562770562, + "meanTokenWeightedTv": 0.019790439832118256, + "meanAggregateLoadTv": 0.03237163942425632 + }, + { + "layer": "layer_21", + "tokens": 660, + "orderedExact": 369, + "orderedExactRate": 0.5590909090909091, + "setExact": 458, + "setExactRate": 0.693939393939394, + "meanSetJaccard": 0.9085281385281384, + "meanTokenWeightedTv": 0.02079484696809323, + "meanAggregateLoadTv": 0.0334470009077136 + }, + { + "layer": "layer_22", + "tokens": 660, + "orderedExact": 354, + "orderedExactRate": 0.5363636363636364, + "setExact": 444, + "setExactRate": 0.6727272727272727, + "meanSetJaccard": 0.9007215007215007, + "meanTokenWeightedTv": 0.022782842584420374, + "meanAggregateLoadTv": 0.03586034825405215 + }, + { + "layer": "layer_23", + "tokens": 660, + "orderedExact": 419, + "orderedExactRate": 0.6348484848484849, + "setExact": 491, + "setExactRate": 0.7439393939393939, + "meanSetJaccard": 0.9222943722943724, + "meanTokenWeightedTv": 0.01906285133528282, + "meanAggregateLoadTv": 0.032797869212381134 + }, + { + "layer": "layer_24", + "tokens": 660, + "orderedExact": 348, + "orderedExactRate": 0.5272727272727272, + "setExact": 448, + "setExactRate": 0.6787878787878788, + "meanSetJaccard": 0.900050505050505, + "meanTokenWeightedTv": 0.02053371722965833, + "meanAggregateLoadTv": 0.029996697621925493 + }, + { + "layer": "layer_25", + "tokens": 660, + "orderedExact": 409, + "orderedExactRate": 0.6196969696969697, + "setExact": 482, + "setExactRate": 0.7303030303030303, + "meanSetJaccard": 0.9185425685425684, + "meanTokenWeightedTv": 0.019049045079667724, + "meanAggregateLoadTv": 0.026522757002874105 + }, + { + "layer": "layer_26", + "tokens": 660, + "orderedExact": 411, + "orderedExactRate": 0.6227272727272727, + "setExact": 506, + "setExactRate": 0.7666666666666667, + "meanSetJaccard": 0.9294733044733045, + "meanTokenWeightedTv": 0.020301489691609026, + "meanAggregateLoadTv": 0.02809793719477133 + } + ], + "system_x": [ + { + "layer": "layer_01", + "tokens": 660, + "orderedExact": 399, + "orderedExactRate": 0.6045454545454545, + "setExact": 465, + "setExactRate": 0.7045454545454546, + "meanSetJaccard": 0.9087662337662337, + "meanTokenWeightedTv": 0.015456161933534555, + "meanAggregateLoadTv": 0.04435818592461352 + }, + { + "layer": "layer_02", + "tokens": 660, + "orderedExact": 413, + "orderedExactRate": 0.6257575757575757, + "setExact": 494, + "setExactRate": 0.7484848484848485, + "meanSetJaccard": 0.9265151515151515, + "meanTokenWeightedTv": 0.018222490418593147, + "meanAggregateLoadTv": 0.030199650428352848 + }, + { + "layer": "layer_03", + "tokens": 660, + "orderedExact": 445, + "orderedExactRate": 0.6742424242424242, + "setExact": 508, + "setExactRate": 0.7696969696969697, + "meanSetJaccard": 0.9325757575757576, + "meanTokenWeightedTv": 0.01786802726363325, + "meanAggregateLoadTv": 0.029329245621513764 + }, + { + "layer": "layer_04", + "tokens": 660, + "orderedExact": 465, + "orderedExactRate": 0.7045454545454546, + "setExact": 536, + "setExactRate": 0.8121212121212121, + "meanSetJaccard": 0.9443722943722943, + "meanTokenWeightedTv": 0.01580918469408872, + "meanAggregateLoadTv": 0.024952765341419027 + }, + { + "layer": "layer_05", + "tokens": 660, + "orderedExact": 429, + "orderedExactRate": 0.65, + "setExact": 510, + "setExactRate": 0.7727272727272727, + "meanSetJaccard": 0.9340909090909091, + "meanTokenWeightedTv": 0.01764901318554176, + "meanAggregateLoadTv": 0.027868120719886084 + }, + { + "layer": "layer_06", + "tokens": 660, + "orderedExact": 439, + "orderedExactRate": 0.6651515151515152, + "setExact": 519, + "setExactRate": 0.7863636363636364, + "meanSetJaccard": 0.9383116883116882, + "meanTokenWeightedTv": 0.01742643925614026, + "meanAggregateLoadTv": 0.0265532887609257 + }, + { + "layer": "layer_07", + "tokens": 660, + "orderedExact": 411, + "orderedExactRate": 0.6227272727272727, + "setExact": 501, + "setExactRate": 0.759090909090909, + "meanSetJaccard": 0.9284415584415585, + "meanTokenWeightedTv": 0.019445573392201165, + "meanAggregateLoadTv": 0.030077349750549345 + }, + { + "layer": "layer_08", + "tokens": 660, + "orderedExact": 430, + "orderedExactRate": 0.6515151515151515, + "setExact": 506, + "setExactRate": 0.7666666666666667, + "meanSetJaccard": 0.931060606060606, + "meanTokenWeightedTv": 0.018323759597963615, + "meanAggregateLoadTv": 0.027934901343629068 + }, + { + "layer": "layer_09", + "tokens": 660, + "orderedExact": 386, + "orderedExactRate": 0.5848484848484848, + "setExact": 479, + "setExactRate": 0.7257575757575757, + "meanSetJaccard": 0.9177489177489176, + "meanTokenWeightedTv": 0.02095491758446676, + "meanAggregateLoadTv": 0.035204656922642616 + }, + { + "layer": "layer_10", + "tokens": 660, + "orderedExact": 372, + "orderedExactRate": 0.5636363636363636, + "setExact": 471, + "setExactRate": 0.7136363636363636, + "meanSetJaccard": 0.9136363636363637, + "meanTokenWeightedTv": 0.021701050099685027, + "meanAggregateLoadTv": 0.03239872188616659 + }, + { + "layer": "layer_11", + "tokens": 660, + "orderedExact": 389, + "orderedExactRate": 0.5893939393939394, + "setExact": 477, + "setExactRate": 0.7227272727272728, + "meanSetJaccard": 0.9147546897546899, + "meanTokenWeightedTv": 0.018506255129556493, + "meanAggregateLoadTv": 0.029130039392490016 + }, + { + "layer": "layer_12", + "tokens": 660, + "orderedExact": 368, + "orderedExactRate": 0.5575757575757576, + "setExact": 460, + "setExactRate": 0.696969696969697, + "meanSetJaccard": 0.9070707070707071, + "meanTokenWeightedTv": 0.021734649081125008, + "meanAggregateLoadTv": 0.032023649480120084 + }, + { + "layer": "layer_13", + "tokens": 660, + "orderedExact": 326, + "orderedExactRate": 0.49393939393939396, + "setExact": 411, + "setExactRate": 0.6227272727272727, + "meanSetJaccard": 0.8823888232979141, + "meanTokenWeightedTv": 0.023655245849372782, + "meanAggregateLoadTv": 0.043378922692935695 + }, + { + "layer": "layer_14", + "tokens": 660, + "orderedExact": 330, + "orderedExactRate": 0.5, + "setExact": 426, + "setExactRate": 0.6454545454545455, + "meanSetJaccard": 0.8921717171717171, + "meanTokenWeightedTv": 0.02306605637126633, + "meanAggregateLoadTv": 0.035380940543680864 + }, + { + "layer": "layer_15", + "tokens": 660, + "orderedExact": 339, + "orderedExactRate": 0.5136363636363637, + "setExact": 414, + "setExactRate": 0.6272727272727273, + "meanSetJaccard": 0.8825757575757576, + "meanTokenWeightedTv": 0.024470326643237186, + "meanAggregateLoadTv": 0.035100586254207866 + }, + { + "layer": "layer_16", + "tokens": 660, + "orderedExact": 322, + "orderedExactRate": 0.48787878787878786, + "setExact": 411, + "setExactRate": 0.6227272727272727, + "meanSetJaccard": 0.8837085137085138, + "meanTokenWeightedTv": 0.02485710393434075, + "meanAggregateLoadTv": 0.03862962948330427 + }, + { + "layer": "layer_17", + "tokens": 660, + "orderedExact": 330, + "orderedExactRate": 0.5, + "setExact": 416, + "setExactRate": 0.6303030303030303, + "meanSetJaccard": 0.8872012331103241, + "meanTokenWeightedTv": 0.025873307241056825, + "meanAggregateLoadTv": 0.0358142634071571 + }, + { + "layer": "layer_18", + "tokens": 660, + "orderedExact": 333, + "orderedExactRate": 0.5045454545454545, + "setExact": 432, + "setExactRate": 0.6545454545454545, + "meanSetJaccard": 0.8925468975468975, + "meanTokenWeightedTv": 0.025317169818279157, + "meanAggregateLoadTv": 0.03624251373545009 + }, + { + "layer": "layer_19", + "tokens": 660, + "orderedExact": 318, + "orderedExactRate": 0.4818181818181818, + "setExact": 417, + "setExactRate": 0.6318181818181818, + "meanSetJaccard": 0.8820490620490621, + "meanTokenWeightedTv": 0.026270706961261183, + "meanAggregateLoadTv": 0.037025094850503974 + }, + { + "layer": "layer_20", + "tokens": 660, + "orderedExact": 297, + "orderedExactRate": 0.45, + "setExact": 385, + "setExactRate": 0.5833333333333334, + "meanSetJaccard": 0.8713203463203463, + "meanTokenWeightedTv": 0.02751314929595073, + "meanAggregateLoadTv": 0.03979740793188193 + }, + { + "layer": "layer_21", + "tokens": 660, + "orderedExact": 306, + "orderedExactRate": 0.4636363636363636, + "setExact": 416, + "setExactRate": 0.6303030303030303, + "meanSetJaccard": 0.8813131313131313, + "meanTokenWeightedTv": 0.026794543670426788, + "meanAggregateLoadTv": 0.03882823628772675 + }, + { + "layer": "layer_22", + "tokens": 660, + "orderedExact": 312, + "orderedExactRate": 0.4727272727272727, + "setExact": 399, + "setExactRate": 0.6045454545454545, + "meanSetJaccard": 0.8733484192575101, + "meanTokenWeightedTv": 0.02960325114854974, + "meanAggregateLoadTv": 0.04442441296619287 + }, + { + "layer": "layer_23", + "tokens": 660, + "orderedExact": 351, + "orderedExactRate": 0.5318181818181819, + "setExact": 435, + "setExactRate": 0.6590909090909091, + "meanSetJaccard": 0.8945244654335562, + "meanTokenWeightedTv": 0.025235446536630023, + "meanAggregateLoadTv": 0.03665346757310446 + }, + { + "layer": "layer_24", + "tokens": 660, + "orderedExact": 285, + "orderedExactRate": 0.4318181818181818, + "setExact": 374, + "setExactRate": 0.5666666666666667, + "meanSetJaccard": 0.8651233110324018, + "meanTokenWeightedTv": 0.027394931705948457, + "meanAggregateLoadTv": 0.04384990303518723 + }, + { + "layer": "layer_25", + "tokens": 660, + "orderedExact": 337, + "orderedExactRate": 0.5106060606060606, + "setExact": 425, + "setExactRate": 0.6439393939393939, + "meanSetJaccard": 0.888059163059163, + "meanTokenWeightedTv": 0.02673585245091102, + "meanAggregateLoadTv": 0.038859734904463136 + }, + { + "layer": "layer_26", + "tokens": 660, + "orderedExact": 351, + "orderedExactRate": 0.5318181818181819, + "setExact": 457, + "setExactRate": 0.6924242424242424, + "meanSetJaccard": 0.9037878787878788, + "meanTokenWeightedTv": 0.0278093537247141, + "meanAggregateLoadTv": 0.03643666757217983 + } + ], + "system_period": [ + { + "layer": "layer_01", + "tokens": 660, + "orderedExact": 408, + "orderedExactRate": 0.6181818181818182, + "setExact": 468, + "setExactRate": 0.7090909090909091, + "meanSetJaccard": 0.9113636363636364, + "meanTokenWeightedTv": 0.01490961606297821, + "meanAggregateLoadTv": 0.043188172309909637 + }, + { + "layer": "layer_02", + "tokens": 660, + "orderedExact": 418, + "orderedExactRate": 0.6333333333333333, + "setExact": 502, + "setExactRate": 0.7606060606060606, + "meanSetJaccard": 0.9296536796536795, + "meanTokenWeightedTv": 0.017927507332515986, + "meanAggregateLoadTv": 0.031359460627769564 + }, + { + "layer": "layer_03", + "tokens": 660, + "orderedExact": 450, + "orderedExactRate": 0.6818181818181818, + "setExact": 511, + "setExactRate": 0.7742424242424243, + "meanSetJaccard": 0.933874458874459, + "meanTokenWeightedTv": 0.016978667698148903, + "meanAggregateLoadTv": 0.027232133996256104 + }, + { + "layer": "layer_04", + "tokens": 660, + "orderedExact": 463, + "orderedExactRate": 0.7015151515151515, + "setExact": 525, + "setExactRate": 0.7954545454545454, + "meanSetJaccard": 0.9405844155844155, + "meanTokenWeightedTv": 0.016252759327875784, + "meanAggregateLoadTv": 0.031235165109346277 + }, + { + "layer": "layer_05", + "tokens": 660, + "orderedExact": 435, + "orderedExactRate": 0.6590909090909091, + "setExact": 506, + "setExactRate": 0.7666666666666667, + "meanSetJaccard": 0.9326839826839827, + "meanTokenWeightedTv": 0.017889146283459386, + "meanAggregateLoadTv": 0.027433529548968424 + }, + { + "layer": "layer_06", + "tokens": 660, + "orderedExact": 442, + "orderedExactRate": 0.6696969696969697, + "setExact": 526, + "setExactRate": 0.796969696969697, + "meanSetJaccard": 0.9393939393939394, + "meanTokenWeightedTv": 0.01767136384091285, + "meanAggregateLoadTv": 0.026711123579142813 + }, + { + "layer": "layer_07", + "tokens": 660, + "orderedExact": 407, + "orderedExactRate": 0.6166666666666667, + "setExact": 491, + "setExactRate": 0.7439393939393939, + "meanSetJaccard": 0.9246392496392497, + "meanTokenWeightedTv": 0.020572919157395, + "meanAggregateLoadTv": 0.032801512991591245 + }, + { + "layer": "layer_08", + "tokens": 660, + "orderedExact": 416, + "orderedExactRate": 0.6303030303030303, + "setExact": 501, + "setExactRate": 0.759090909090909, + "meanSetJaccard": 0.9288961038961039, + "meanTokenWeightedTv": 0.01872344917364066, + "meanAggregateLoadTv": 0.027774542413012117 + }, + { + "layer": "layer_09", + "tokens": 660, + "orderedExact": 387, + "orderedExactRate": 0.5863636363636363, + "setExact": 481, + "setExactRate": 0.7287878787878788, + "meanSetJaccard": 0.9183621933621933, + "meanTokenWeightedTv": 0.021168040819524257, + "meanAggregateLoadTv": 0.03362621358268419 + }, + { + "layer": "layer_10", + "tokens": 660, + "orderedExact": 373, + "orderedExactRate": 0.5651515151515152, + "setExact": 466, + "setExactRate": 0.706060606060606, + "meanSetJaccard": 0.9124458874458875, + "meanTokenWeightedTv": 0.021809375175743106, + "meanAggregateLoadTv": 0.03582242613938684 + }, + { + "layer": "layer_11", + "tokens": 660, + "orderedExact": 372, + "orderedExactRate": 0.5636363636363636, + "setExact": 463, + "setExactRate": 0.7015151515151515, + "meanSetJaccard": 0.9088167388167389, + "meanTokenWeightedTv": 0.01901376261539968, + "meanAggregateLoadTv": 0.029464009191114242 + }, + { + "layer": "layer_12", + "tokens": 660, + "orderedExact": 335, + "orderedExactRate": 0.5075757575757576, + "setExact": 439, + "setExactRate": 0.6651515151515152, + "meanSetJaccard": 0.8992063492063492, + "meanTokenWeightedTv": 0.022271140591521486, + "meanAggregateLoadTv": 0.031463461143383074 + }, + { + "layer": "layer_13", + "tokens": 660, + "orderedExact": 303, + "orderedExactRate": 0.4590909090909091, + "setExact": 398, + "setExactRate": 0.603030303030303, + "meanSetJaccard": 0.8765873015873016, + "meanTokenWeightedTv": 0.02412033129973504, + "meanAggregateLoadTv": 0.039987456092113224 + }, + { + "layer": "layer_14", + "tokens": 660, + "orderedExact": 320, + "orderedExactRate": 0.48484848484848486, + "setExact": 423, + "setExactRate": 0.6409090909090909, + "meanSetJaccard": 0.8902892561983472, + "meanTokenWeightedTv": 0.022729667737573372, + "meanAggregateLoadTv": 0.03756673089164397 + }, + { + "layer": "layer_15", + "tokens": 660, + "orderedExact": 322, + "orderedExactRate": 0.48787878787878786, + "setExact": 396, + "setExactRate": 0.6, + "meanSetJaccard": 0.8769841269841271, + "meanTokenWeightedTv": 0.025293167651084573, + "meanAggregateLoadTv": 0.04182907322616494 + }, + { + "layer": "layer_16", + "tokens": 660, + "orderedExact": 310, + "orderedExactRate": 0.4696969696969697, + "setExact": 408, + "setExactRate": 0.6181818181818182, + "meanSetJaccard": 0.8845598845598847, + "meanTokenWeightedTv": 0.024542951224835134, + "meanAggregateLoadTv": 0.0363098604438397 + }, + { + "layer": "layer_17", + "tokens": 660, + "orderedExact": 314, + "orderedExactRate": 0.47575757575757577, + "setExact": 419, + "setExactRate": 0.6348484848484849, + "meanSetJaccard": 0.888939393939394, + "meanTokenWeightedTv": 0.026528259323139534, + "meanAggregateLoadTv": 0.04127560636320151 + }, + { + "layer": "layer_18", + "tokens": 660, + "orderedExact": 311, + "orderedExactRate": 0.4712121212121212, + "setExact": 419, + "setExactRate": 0.6348484848484849, + "meanSetJaccard": 0.8872438672438672, + "meanTokenWeightedTv": 0.02691166890994974, + "meanAggregateLoadTv": 0.03951323691218409 + }, + { + "layer": "layer_19", + "tokens": 660, + "orderedExact": 310, + "orderedExactRate": 0.4696969696969697, + "setExact": 413, + "setExactRate": 0.6257575757575757, + "meanSetJaccard": 0.881096681096681, + "meanTokenWeightedTv": 0.027957790381260884, + "meanAggregateLoadTv": 0.03520347127050544 + }, + { + "layer": "layer_20", + "tokens": 660, + "orderedExact": 250, + "orderedExactRate": 0.3787878787878788, + "setExact": 349, + "setExactRate": 0.5287878787878788, + "meanSetJaccard": 0.854163059163059, + "meanTokenWeightedTv": 0.030631580660982337, + "meanAggregateLoadTv": 0.047331039527783544 + }, + { + "layer": "layer_21", + "tokens": 660, + "orderedExact": 310, + "orderedExactRate": 0.4696969696969697, + "setExact": 406, + "setExactRate": 0.6151515151515151, + "meanSetJaccard": 0.8782828282828282, + "meanTokenWeightedTv": 0.02887095163224089, + "meanAggregateLoadTv": 0.04119056239013513 + }, + { + "layer": "layer_22", + "tokens": 660, + "orderedExact": 314, + "orderedExactRate": 0.47575757575757577, + "setExact": 395, + "setExactRate": 0.5984848484848485, + "meanSetJaccard": 0.8748635707726616, + "meanTokenWeightedTv": 0.03083312170407581, + "meanAggregateLoadTv": 0.04808052795951943 + }, + { + "layer": "layer_23", + "tokens": 660, + "orderedExact": 349, + "orderedExactRate": 0.5287878787878788, + "setExact": 438, + "setExactRate": 0.6636363636363637, + "meanSetJaccard": 0.896075691984783, + "meanTokenWeightedTv": 0.025781802740009643, + "meanAggregateLoadTv": 0.036083075821080286 + }, + { + "layer": "layer_24", + "tokens": 660, + "orderedExact": 260, + "orderedExactRate": 0.3939393939393939, + "setExact": 359, + "setExactRate": 0.543939393939394, + "meanSetJaccard": 0.8562062180243998, + "meanTokenWeightedTv": 0.030373305684618695, + "meanAggregateLoadTv": 0.051086301294992746 + }, + { + "layer": "layer_25", + "tokens": 660, + "orderedExact": 331, + "orderedExactRate": 0.5015151515151515, + "setExact": 415, + "setExactRate": 0.6287878787878788, + "meanSetJaccard": 0.8835281385281385, + "meanTokenWeightedTv": 0.028634968268990865, + "meanAggregateLoadTv": 0.03786859917601858 + }, + { + "layer": "layer_26", + "tokens": 660, + "orderedExact": 333, + "orderedExactRate": 0.5045454545454545, + "setExact": 432, + "setExactRate": 0.6545454545454545, + "meanSetJaccard": 0.8912337662337664, + "meanTokenWeightedTv": 0.02950233740485337, + "meanAggregateLoadTv": 0.04436641464217016 + } + ], + "bos_at_s0": [ + { + "layer": "layer_01", + "tokens": 660, + "orderedExact": 328, + "orderedExactRate": 0.49696969696969695, + "setExact": 417, + "setExactRate": 0.6318181818181818, + "meanSetJaccard": 0.8806637806637806, + "meanTokenWeightedTv": 0.022260614476183976, + "meanAggregateLoadTv": 0.05060597256837429 + }, + { + "layer": "layer_02", + "tokens": 660, + "orderedExact": 334, + "orderedExactRate": 0.5060606060606061, + "setExact": 421, + "setExactRate": 0.6378787878787879, + "meanSetJaccard": 0.8923160173160172, + "meanTokenWeightedTv": 0.0252661691606592, + "meanAggregateLoadTv": 0.04383688656122662 + }, + { + "layer": "layer_03", + "tokens": 660, + "orderedExact": 383, + "orderedExactRate": 0.5803030303030303, + "setExact": 460, + "setExactRate": 0.696969696969697, + "meanSetJaccard": 0.9111471861471861, + "meanTokenWeightedTv": 0.022506147606574923, + "meanAggregateLoadTv": 0.033809242987879615 + }, + { + "layer": "layer_04", + "tokens": 660, + "orderedExact": 410, + "orderedExactRate": 0.6212121212121212, + "setExact": 487, + "setExactRate": 0.7378787878787879, + "meanSetJaccard": 0.9247835497835497, + "meanTokenWeightedTv": 0.020062079956334834, + "meanAggregateLoadTv": 0.0293809690882387 + }, + { + "layer": "layer_05", + "tokens": 660, + "orderedExact": 404, + "orderedExactRate": 0.6121212121212121, + "setExact": 484, + "setExactRate": 0.7333333333333333, + "meanSetJaccard": 0.9212121212121213, + "meanTokenWeightedTv": 0.019986548273942535, + "meanAggregateLoadTv": 0.029860678247366594 + }, + { + "layer": "layer_06", + "tokens": 660, + "orderedExact": 405, + "orderedExactRate": 0.6136363636363636, + "setExact": 490, + "setExactRate": 0.7424242424242424, + "meanSetJaccard": 0.9251082251082251, + "meanTokenWeightedTv": 0.02107306167471569, + "meanAggregateLoadTv": 0.03077467712865553 + }, + { + "layer": "layer_07", + "tokens": 660, + "orderedExact": 399, + "orderedExactRate": 0.6045454545454545, + "setExact": 478, + "setExactRate": 0.7242424242424242, + "meanSetJaccard": 0.9195887445887446, + "meanTokenWeightedTv": 0.02155648995138827, + "meanAggregateLoadTv": 0.03435417551703546 + }, + { + "layer": "layer_08", + "tokens": 660, + "orderedExact": 404, + "orderedExactRate": 0.6121212121212121, + "setExact": 492, + "setExactRate": 0.7454545454545455, + "meanSetJaccard": 0.9262987012987014, + "meanTokenWeightedTv": 0.019362187600514218, + "meanAggregateLoadTv": 0.030135092468253088 + }, + { + "layer": "layer_09", + "tokens": 660, + "orderedExact": 404, + "orderedExactRate": 0.6121212121212121, + "setExact": 481, + "setExactRate": 0.7287878787878788, + "meanSetJaccard": 0.9205627705627706, + "meanTokenWeightedTv": 0.020081635714007937, + "meanAggregateLoadTv": 0.030375483960003342 + }, + { + "layer": "layer_10", + "tokens": 660, + "orderedExact": 401, + "orderedExactRate": 0.6075757575757575, + "setExact": 493, + "setExactRate": 0.746969696969697, + "meanSetJaccard": 0.9247835497835498, + "meanTokenWeightedTv": 0.01902939499154042, + "meanAggregateLoadTv": 0.027716845537746018 + }, + { + "layer": "layer_11", + "tokens": 660, + "orderedExact": 399, + "orderedExactRate": 0.6045454545454545, + "setExact": 484, + "setExactRate": 0.7333333333333333, + "meanSetJaccard": 0.9205627705627706, + "meanTokenWeightedTv": 0.017846600866583445, + "meanAggregateLoadTv": 0.03178481524208485 + }, + { + "layer": "layer_12", + "tokens": 660, + "orderedExact": 369, + "orderedExactRate": 0.5590909090909091, + "setExact": 470, + "setExactRate": 0.7121212121212122, + "meanSetJaccard": 0.9145021645021643, + "meanTokenWeightedTv": 0.019563120886234, + "meanAggregateLoadTv": 0.025494033948475502 + }, + { + "layer": "layer_13", + "tokens": 660, + "orderedExact": 340, + "orderedExactRate": 0.5151515151515151, + "setExact": 442, + "setExactRate": 0.6696969696969697, + "meanSetJaccard": 0.9018037518037517, + "meanTokenWeightedTv": 0.020241770636777505, + "meanAggregateLoadTv": 0.035224915112585804 + }, + { + "layer": "layer_14", + "tokens": 660, + "orderedExact": 356, + "orderedExactRate": 0.5393939393939394, + "setExact": 448, + "setExactRate": 0.6787878787878788, + "meanSetJaccard": 0.9014069264069262, + "meanTokenWeightedTv": 0.020826529905048505, + "meanAggregateLoadTv": 0.0341737771899277 + }, + { + "layer": "layer_15", + "tokens": 660, + "orderedExact": 348, + "orderedExactRate": 0.5272727272727272, + "setExact": 445, + "setExactRate": 0.6742424242424242, + "meanSetJaccard": 0.9025252525252525, + "meanTokenWeightedTv": 0.021474500183897433, + "meanAggregateLoadTv": 0.0346365704895659 + }, + { + "layer": "layer_16", + "tokens": 660, + "orderedExact": 384, + "orderedExactRate": 0.5818181818181818, + "setExact": 469, + "setExactRate": 0.7106060606060606, + "meanSetJaccard": 0.9121933621933622, + "meanTokenWeightedTv": 0.020892903905869727, + "meanAggregateLoadTv": 0.033934654005618854 + }, + { + "layer": "layer_17", + "tokens": 660, + "orderedExact": 376, + "orderedExactRate": 0.5696969696969697, + "setExact": 471, + "setExactRate": 0.7136363636363636, + "meanSetJaccard": 0.9144805194805196, + "meanTokenWeightedTv": 0.020985946393517137, + "meanAggregateLoadTv": 0.03179115608470954 + }, + { + "layer": "layer_18", + "tokens": 660, + "orderedExact": 356, + "orderedExactRate": 0.5393939393939394, + "setExact": 444, + "setExactRate": 0.6727272727272727, + "meanSetJaccard": 0.9037157287157287, + "meanTokenWeightedTv": 0.02273704085739029, + "meanAggregateLoadTv": 0.03329718018109508 + }, + { + "layer": "layer_19", + "tokens": 660, + "orderedExact": 360, + "orderedExactRate": 0.5454545454545454, + "setExact": 444, + "setExactRate": 0.6727272727272727, + "meanSetJaccard": 0.9023448773448773, + "meanTokenWeightedTv": 0.022603024821854716, + "meanAggregateLoadTv": 0.03256127430796645 + }, + { + "layer": "layer_20", + "tokens": 660, + "orderedExact": 329, + "orderedExactRate": 0.4984848484848485, + "setExact": 422, + "setExactRate": 0.6393939393939394, + "meanSetJaccard": 0.889191919191919, + "meanTokenWeightedTv": 0.02392093584524305, + "meanAggregateLoadTv": 0.04069775410174238 + }, + { + "layer": "layer_21", + "tokens": 660, + "orderedExact": 374, + "orderedExactRate": 0.5666666666666667, + "setExact": 461, + "setExactRate": 0.6984848484848485, + "meanSetJaccard": 0.9071789321789321, + "meanTokenWeightedTv": 0.021624548531455505, + "meanAggregateLoadTv": 0.03200698922694936 + }, + { + "layer": "layer_22", + "tokens": 660, + "orderedExact": 343, + "orderedExactRate": 0.5196969696969697, + "setExact": 445, + "setExactRate": 0.6742424242424242, + "meanSetJaccard": 0.901154401154401, + "meanTokenWeightedTv": 0.023852993717088163, + "meanAggregateLoadTv": 0.03519749786196427 + }, + { + "layer": "layer_23", + "tokens": 660, + "orderedExact": 385, + "orderedExactRate": 0.5833333333333334, + "setExact": 468, + "setExactRate": 0.7090909090909091, + "meanSetJaccard": 0.9115079365079365, + "meanTokenWeightedTv": 0.023210200226673278, + "meanAggregateLoadTv": 0.03346361531844669 + }, + { + "layer": "layer_24", + "tokens": 660, + "orderedExact": 337, + "orderedExactRate": 0.5106060606060606, + "setExact": 430, + "setExactRate": 0.6515151515151515, + "meanSetJaccard": 0.8936081595172504, + "meanTokenWeightedTv": 0.023137505037206307, + "meanAggregateLoadTv": 0.03288229361795697 + }, + { + "layer": "layer_25", + "tokens": 660, + "orderedExact": 375, + "orderedExactRate": 0.5681818181818182, + "setExact": 456, + "setExactRate": 0.6909090909090909, + "meanSetJaccard": 0.9075396825396824, + "meanTokenWeightedTv": 0.022133632078451114, + "meanAggregateLoadTv": 0.033839151010946325 + }, + { + "layer": "layer_26", + "tokens": 660, + "orderedExact": 384, + "orderedExactRate": 0.5818181818181818, + "setExact": 473, + "setExactRate": 0.7166666666666667, + "meanSetJaccard": 0.9132395382395382, + "meanTokenWeightedTv": 0.023161708087161656, + "meanAggregateLoadTv": 0.03559998751863231 + } + ], + "bos_at_s1": [ + { + "layer": "layer_01", + "tokens": 660, + "orderedExact": 322, + "orderedExactRate": 0.48787878787878786, + "setExact": 384, + "setExactRate": 0.5818181818181818, + "meanSetJaccard": 0.8672799422799423, + "meanTokenWeightedTv": 0.022642751510757658, + "meanAggregateLoadTv": 0.06049562623692621 + }, + { + "layer": "layer_02", + "tokens": 660, + "orderedExact": 329, + "orderedExactRate": 0.4984848484848485, + "setExact": 420, + "setExactRate": 0.6363636363636364, + "meanSetJaccard": 0.8922077922077921, + "meanTokenWeightedTv": 0.02573767074346818, + "meanAggregateLoadTv": 0.039521701093170436 + }, + { + "layer": "layer_03", + "tokens": 660, + "orderedExact": 340, + "orderedExactRate": 0.5151515151515151, + "setExact": 430, + "setExactRate": 0.6515151515151515, + "meanSetJaccard": 0.8978354978354978, + "meanTokenWeightedTv": 0.02514755501056193, + "meanAggregateLoadTv": 0.0389823703709779 + }, + { + "layer": "layer_04", + "tokens": 660, + "orderedExact": 380, + "orderedExactRate": 0.5757575757575758, + "setExact": 465, + "setExactRate": 0.7045454545454546, + "meanSetJaccard": 0.9139610389610389, + "meanTokenWeightedTv": 0.023467753529396795, + "meanAggregateLoadTv": 0.03612077914229322 + }, + { + "layer": "layer_05", + "tokens": 660, + "orderedExact": 388, + "orderedExactRate": 0.5878787878787879, + "setExact": 478, + "setExactRate": 0.7242424242424242, + "meanSetJaccard": 0.9182900432900433, + "meanTokenWeightedTv": 0.02266058289735956, + "meanAggregateLoadTv": 0.03392274469598551 + }, + { + "layer": "layer_06", + "tokens": 660, + "orderedExact": 377, + "orderedExactRate": 0.5712121212121212, + "setExact": 465, + "setExactRate": 0.7045454545454546, + "meanSetJaccard": 0.9133116883116882, + "meanTokenWeightedTv": 0.02344002126235294, + "meanAggregateLoadTv": 0.03182703751631741 + }, + { + "layer": "layer_07", + "tokens": 660, + "orderedExact": 375, + "orderedExactRate": 0.5681818181818182, + "setExact": 465, + "setExactRate": 0.7045454545454546, + "meanSetJaccard": 0.9107864357864357, + "meanTokenWeightedTv": 0.0230600592389646, + "meanAggregateLoadTv": 0.03252045647932346 + }, + { + "layer": "layer_08", + "tokens": 660, + "orderedExact": 376, + "orderedExactRate": 0.5696969696969697, + "setExact": 468, + "setExactRate": 0.7090909090909091, + "meanSetJaccard": 0.9127344877344877, + "meanTokenWeightedTv": 0.021899103133216018, + "meanAggregateLoadTv": 0.03446381465247887 + }, + { + "layer": "layer_09", + "tokens": 660, + "orderedExact": 375, + "orderedExactRate": 0.5681818181818182, + "setExact": 452, + "setExactRate": 0.6848484848484848, + "meanSetJaccard": 0.9067099567099567, + "meanTokenWeightedTv": 0.02296036038243806, + "meanAggregateLoadTv": 0.03496152252504013 + }, + { + "layer": "layer_10", + "tokens": 660, + "orderedExact": 395, + "orderedExactRate": 0.5984848484848485, + "setExact": 481, + "setExactRate": 0.7287878787878788, + "meanSetJaccard": 0.9182900432900433, + "meanTokenWeightedTv": 0.021741622657015992, + "meanAggregateLoadTv": 0.030560921482339732 + }, + { + "layer": "layer_11", + "tokens": 660, + "orderedExact": 356, + "orderedExactRate": 0.5393939393939394, + "setExact": 445, + "setExactRate": 0.6742424242424242, + "meanSetJaccard": 0.9036796536796535, + "meanTokenWeightedTv": 0.020228388268211446, + "meanAggregateLoadTv": 0.03395083082944717 + }, + { + "layer": "layer_12", + "tokens": 660, + "orderedExact": 345, + "orderedExactRate": 0.5227272727272727, + "setExact": 439, + "setExactRate": 0.6651515151515152, + "meanSetJaccard": 0.899134199134199, + "meanTokenWeightedTv": 0.022448947190708612, + "meanAggregateLoadTv": 0.03147296233587546 + }, + { + "layer": "layer_13", + "tokens": 660, + "orderedExact": 311, + "orderedExactRate": 0.4712121212121212, + "setExact": 410, + "setExactRate": 0.6212121212121212, + "meanSetJaccard": 0.8863997113997115, + "meanTokenWeightedTv": 0.02315392138571158, + "meanAggregateLoadTv": 0.04110586223535105 + }, + { + "layer": "layer_14", + "tokens": 660, + "orderedExact": 349, + "orderedExactRate": 0.5287878787878788, + "setExact": 440, + "setExactRate": 0.6666666666666666, + "meanSetJaccard": 0.8984126984126984, + "meanTokenWeightedTv": 0.02190069346974498, + "meanAggregateLoadTv": 0.0326091352020289 + }, + { + "layer": "layer_15", + "tokens": 660, + "orderedExact": 329, + "orderedExactRate": 0.4984848484848485, + "setExact": 415, + "setExactRate": 0.6287878787878788, + "meanSetJaccard": 0.888167388167388, + "meanTokenWeightedTv": 0.024008378315617276, + "meanAggregateLoadTv": 0.03427143686291653 + }, + { + "layer": "layer_16", + "tokens": 660, + "orderedExact": 349, + "orderedExactRate": 0.5287878787878788, + "setExact": 438, + "setExactRate": 0.6636363636363637, + "meanSetJaccard": 0.8977994227994228, + "meanTokenWeightedTv": 0.023092176730349516, + "meanAggregateLoadTv": 0.03649767343794477 + }, + { + "layer": "layer_17", + "tokens": 660, + "orderedExact": 344, + "orderedExactRate": 0.5212121212121212, + "setExact": 437, + "setExactRate": 0.6621212121212121, + "meanSetJaccard": 0.8962626262626262, + "meanTokenWeightedTv": 0.02397774541360435, + "meanAggregateLoadTv": 0.037731724770539425 + }, + { + "layer": "layer_18", + "tokens": 660, + "orderedExact": 332, + "orderedExactRate": 0.503030303030303, + "setExact": 420, + "setExactRate": 0.6363636363636364, + "meanSetJaccard": 0.8893578643578643, + "meanTokenWeightedTv": 0.025546612387604254, + "meanAggregateLoadTv": 0.037713577416474915 + }, + { + "layer": "layer_19", + "tokens": 660, + "orderedExact": 334, + "orderedExactRate": 0.5060606060606061, + "setExact": 426, + "setExactRate": 0.6454545454545455, + "meanSetJaccard": 0.890981240981241, + "meanTokenWeightedTv": 0.024866560853973117, + "meanAggregateLoadTv": 0.03633957398383763 + }, + { + "layer": "layer_20", + "tokens": 660, + "orderedExact": 325, + "orderedExactRate": 0.49242424242424243, + "setExact": 426, + "setExactRate": 0.6454545454545455, + "meanSetJaccard": 0.8896399055489963, + "meanTokenWeightedTv": 0.024881518326994534, + "meanAggregateLoadTv": 0.037264631311333986 + }, + { + "layer": "layer_21", + "tokens": 660, + "orderedExact": 319, + "orderedExactRate": 0.48333333333333334, + "setExact": 420, + "setExactRate": 0.6363636363636364, + "meanSetJaccard": 0.8882756132756132, + "meanTokenWeightedTv": 0.025633564423688304, + "meanAggregateLoadTv": 0.035250258340195254 + }, + { + "layer": "layer_22", + "tokens": 660, + "orderedExact": 323, + "orderedExactRate": 0.4893939393939394, + "setExact": 421, + "setExactRate": 0.6378787878787879, + "meanSetJaccard": 0.8855417814508724, + "meanTokenWeightedTv": 0.02761563694615407, + "meanAggregateLoadTv": 0.03889943306629585 + }, + { + "layer": "layer_23", + "tokens": 660, + "orderedExact": 354, + "orderedExactRate": 0.5363636363636364, + "setExact": 437, + "setExactRate": 0.6621212121212121, + "meanSetJaccard": 0.8967171717171716, + "meanTokenWeightedTv": 0.02617171032596523, + "meanAggregateLoadTv": 0.04096114668928805 + }, + { + "layer": "layer_24", + "tokens": 660, + "orderedExact": 309, + "orderedExactRate": 0.4681818181818182, + "setExact": 413, + "setExactRate": 0.6257575757575757, + "meanSetJaccard": 0.8847041847041845, + "meanTokenWeightedTv": 0.02403220899909659, + "meanAggregateLoadTv": 0.03718679224138359 + }, + { + "layer": "layer_25", + "tokens": 660, + "orderedExact": 369, + "orderedExactRate": 0.5590909090909091, + "setExact": 451, + "setExactRate": 0.6833333333333333, + "meanSetJaccard": 0.9045959595959595, + "meanTokenWeightedTv": 0.02401377708298382, + "meanAggregateLoadTv": 0.03409100172294218 + }, + { + "layer": "layer_26", + "tokens": 660, + "orderedExact": 374, + "orderedExactRate": 0.5666666666666667, + "setExact": 467, + "setExactRate": 0.7075757575757575, + "meanSetJaccard": 0.9117748917748917, + "meanTokenWeightedTv": 0.024392576595490045, + "meanAggregateLoadTv": 0.03664100468130749 + } + ], + "x_at_s0": [ + { + "layer": "layer_01", + "tokens": 660, + "orderedExact": 351, + "orderedExactRate": 0.5318181818181819, + "setExact": 430, + "setExactRate": 0.6515151515151515, + "meanSetJaccard": 0.8884920634920636, + "meanTokenWeightedTv": 0.019163086805352985, + "meanAggregateLoadTv": 0.04759251993001365 + }, + { + "layer": "layer_02", + "tokens": 660, + "orderedExact": 348, + "orderedExactRate": 0.5272727272727272, + "setExact": 443, + "setExactRate": 0.6712121212121213, + "meanSetJaccard": 0.9031385281385281, + "meanTokenWeightedTv": 0.02270568007467593, + "meanAggregateLoadTv": 0.038577203793784556 + }, + { + "layer": "layer_03", + "tokens": 660, + "orderedExact": 398, + "orderedExactRate": 0.603030303030303, + "setExact": 478, + "setExactRate": 0.7242424242424242, + "meanSetJaccard": 0.9192640692640692, + "meanTokenWeightedTv": 0.02115688164711557, + "meanAggregateLoadTv": 0.03338415300945434 + }, + { + "layer": "layer_04", + "tokens": 660, + "orderedExact": 428, + "orderedExactRate": 0.6484848484848484, + "setExact": 499, + "setExactRate": 0.7560606060606061, + "meanSetJaccard": 0.9290043290043289, + "meanTokenWeightedTv": 0.02003864838187728, + "meanAggregateLoadTv": 0.03237724123121963 + }, + { + "layer": "layer_05", + "tokens": 660, + "orderedExact": 404, + "orderedExactRate": 0.6121212121212121, + "setExact": 500, + "setExactRate": 0.7575757575757576, + "meanSetJaccard": 0.9278138528138529, + "meanTokenWeightedTv": 0.019172693493624306, + "meanAggregateLoadTv": 0.02964978150216188 + }, + { + "layer": "layer_06", + "tokens": 660, + "orderedExact": 394, + "orderedExactRate": 0.5969696969696969, + "setExact": 493, + "setExactRate": 0.746969696969697, + "meanSetJaccard": 0.9238095238095237, + "meanTokenWeightedTv": 0.021550211354925835, + "meanAggregateLoadTv": 0.03354859330618616 + }, + { + "layer": "layer_07", + "tokens": 660, + "orderedExact": 408, + "orderedExactRate": 0.6181818181818182, + "setExact": 492, + "setExactRate": 0.7454545454545455, + "meanSetJaccard": 0.9253246753246754, + "meanTokenWeightedTv": 0.02108716027035617, + "meanAggregateLoadTv": 0.03168967968149585 + }, + { + "layer": "layer_08", + "tokens": 660, + "orderedExact": 403, + "orderedExactRate": 0.6106060606060606, + "setExact": 489, + "setExactRate": 0.740909090909091, + "meanSetJaccard": 0.9233766233766234, + "meanTokenWeightedTv": 0.020306223159882744, + "meanAggregateLoadTv": 0.03011505307176228 + }, + { + "layer": "layer_09", + "tokens": 660, + "orderedExact": 394, + "orderedExactRate": 0.5969696969696969, + "setExact": 481, + "setExactRate": 0.7287878787878788, + "meanSetJaccard": 0.9202380952380953, + "meanTokenWeightedTv": 0.02128092280880828, + "meanAggregateLoadTv": 0.03506166046799117 + }, + { + "layer": "layer_10", + "tokens": 660, + "orderedExact": 381, + "orderedExactRate": 0.5772727272727273, + "setExact": 469, + "setExactRate": 0.7106060606060606, + "meanSetJaccard": 0.9147186147186148, + "meanTokenWeightedTv": 0.021542689030273673, + "meanAggregateLoadTv": 0.03173640076585876 + }, + { + "layer": "layer_11", + "tokens": 660, + "orderedExact": 393, + "orderedExactRate": 0.5954545454545455, + "setExact": 481, + "setExactRate": 0.7287878787878788, + "meanSetJaccard": 0.918939393939394, + "meanTokenWeightedTv": 0.018416536822754986, + "meanAggregateLoadTv": 0.02867166224767794 + }, + { + "layer": "layer_12", + "tokens": 660, + "orderedExact": 353, + "orderedExactRate": 0.5348484848484848, + "setExact": 444, + "setExactRate": 0.6727272727272727, + "meanSetJaccard": 0.9022727272727272, + "meanTokenWeightedTv": 0.022800102591536954, + "meanAggregateLoadTv": 0.03277265448251356 + }, + { + "layer": "layer_13", + "tokens": 660, + "orderedExact": 322, + "orderedExactRate": 0.48787878787878786, + "setExact": 415, + "setExactRate": 0.6287878787878788, + "meanSetJaccard": 0.8883116883116882, + "meanTokenWeightedTv": 0.022717791400515164, + "meanAggregateLoadTv": 0.03647537456494415 + }, + { + "layer": "layer_14", + "tokens": 660, + "orderedExact": 312, + "orderedExactRate": 0.4727272727272727, + "setExact": 412, + "setExactRate": 0.6242424242424243, + "meanSetJaccard": 0.8871933621933622, + "meanTokenWeightedTv": 0.02383783059712076, + "meanAggregateLoadTv": 0.04066481422654983 + }, + { + "layer": "layer_15", + "tokens": 660, + "orderedExact": 332, + "orderedExactRate": 0.503030303030303, + "setExact": 410, + "setExactRate": 0.6212121212121212, + "meanSetJaccard": 0.8821789321789321, + "meanTokenWeightedTv": 0.025054898446457773, + "meanAggregateLoadTv": 0.04008667301881709 + }, + { + "layer": "layer_16", + "tokens": 660, + "orderedExact": 333, + "orderedExactRate": 0.5045454545454545, + "setExact": 430, + "setExactRate": 0.6515151515151515, + "meanSetJaccard": 0.8938311688311686, + "meanTokenWeightedTv": 0.024203533921812213, + "meanAggregateLoadTv": 0.038550889539995976 + }, + { + "layer": "layer_17", + "tokens": 660, + "orderedExact": 327, + "orderedExactRate": 0.4954545454545455, + "setExact": 426, + "setExactRate": 0.6454545454545455, + "meanSetJaccard": 0.8929292929292928, + "meanTokenWeightedTv": 0.02345381309421493, + "meanAggregateLoadTv": 0.03803029656689819 + }, + { + "layer": "layer_18", + "tokens": 660, + "orderedExact": 321, + "orderedExactRate": 0.4863636363636364, + "setExact": 411, + "setExactRate": 0.6227272727272727, + "meanSetJaccard": 0.8854617604617605, + "meanTokenWeightedTv": 0.02527786682850996, + "meanAggregateLoadTv": 0.0363441387792949 + }, + { + "layer": "layer_19", + "tokens": 660, + "orderedExact": 338, + "orderedExactRate": 0.5121212121212121, + "setExact": 427, + "setExactRate": 0.646969696969697, + "meanSetJaccard": 0.8930519480519481, + "meanTokenWeightedTv": 0.024985601459987766, + "meanAggregateLoadTv": 0.03480954512010529 + }, + { + "layer": "layer_20", + "tokens": 660, + "orderedExact": 305, + "orderedExactRate": 0.4621212121212121, + "setExact": 405, + "setExactRate": 0.6136363636363636, + "meanSetJaccard": 0.8788528138528138, + "meanTokenWeightedTv": 0.026360579194845177, + "meanAggregateLoadTv": 0.04056292037932067 + }, + { + "layer": "layer_21", + "tokens": 660, + "orderedExact": 321, + "orderedExactRate": 0.4863636363636364, + "setExact": 411, + "setExactRate": 0.6227272727272727, + "meanSetJaccard": 0.8830086580086579, + "meanTokenWeightedTv": 0.02589291941960323, + "meanAggregateLoadTv": 0.043636412024761456 + }, + { + "layer": "layer_22", + "tokens": 660, + "orderedExact": 327, + "orderedExactRate": 0.4954545454545455, + "setExact": 413, + "setExactRate": 0.6257575757575757, + "meanSetJaccard": 0.8833694083694081, + "meanTokenWeightedTv": 0.02775063684254071, + "meanAggregateLoadTv": 0.039142832099788354 + }, + { + "layer": "layer_23", + "tokens": 660, + "orderedExact": 366, + "orderedExactRate": 0.5545454545454546, + "setExact": 448, + "setExactRate": 0.6787878787878788, + "meanSetJaccard": 0.9011117670208579, + "meanTokenWeightedTv": 0.02357747633585491, + "meanAggregateLoadTv": 0.035898224526279804 + }, + { + "layer": "layer_24", + "tokens": 660, + "orderedExact": 329, + "orderedExactRate": 0.4984848484848485, + "setExact": 413, + "setExactRate": 0.6257575757575757, + "meanSetJaccard": 0.8841630591630592, + "meanTokenWeightedTv": 0.022232442084443863, + "meanAggregateLoadTv": 0.03512830495358601 + }, + { + "layer": "layer_25", + "tokens": 660, + "orderedExact": 354, + "orderedExactRate": 0.5363636363636364, + "setExact": 438, + "setExactRate": 0.6636363636363637, + "meanSetJaccard": 0.8965007215007215, + "meanTokenWeightedTv": 0.02293397174857208, + "meanAggregateLoadTv": 0.035174459953302276 + }, + { + "layer": "layer_26", + "tokens": 660, + "orderedExact": 360, + "orderedExactRate": 0.5454545454545454, + "setExact": 456, + "setExactRate": 0.6909090909090909, + "meanSetJaccard": 0.9073376623376623, + "meanTokenWeightedTv": 0.02258738326168729, + "meanAggregateLoadTv": 0.03434545920264209 + } + ], + "x_at_s1": [ + { + "layer": "layer_01", + "tokens": 660, + "orderedExact": 323, + "orderedExactRate": 0.4893939393939394, + "setExact": 387, + "setExactRate": 0.5863636363636363, + "meanSetJaccard": 0.8676046176046176, + "meanTokenWeightedTv": 0.022365250060824744, + "meanAggregateLoadTv": 0.06350703819222941 + }, + { + "layer": "layer_02", + "tokens": 660, + "orderedExact": 339, + "orderedExactRate": 0.5136363636363637, + "setExact": 427, + "setExactRate": 0.646969696969697, + "meanSetJaccard": 0.8955627705627707, + "meanTokenWeightedTv": 0.025791478618992992, + "meanAggregateLoadTv": 0.039980631820146155 + }, + { + "layer": "layer_03", + "tokens": 660, + "orderedExact": 344, + "orderedExactRate": 0.5212121212121212, + "setExact": 429, + "setExactRate": 0.65, + "meanSetJaccard": 0.8967532467532469, + "meanTokenWeightedTv": 0.025920201324875665, + "meanAggregateLoadTv": 0.040427318448777255 + }, + { + "layer": "layer_04", + "tokens": 660, + "orderedExact": 383, + "orderedExactRate": 0.5803030303030303, + "setExact": 460, + "setExactRate": 0.696969696969697, + "meanSetJaccard": 0.9101731601731603, + "meanTokenWeightedTv": 0.024534681617835858, + "meanAggregateLoadTv": 0.038434909561927896 + }, + { + "layer": "layer_05", + "tokens": 660, + "orderedExact": 386, + "orderedExactRate": 0.5848484848484848, + "setExact": 465, + "setExactRate": 0.7045454545454546, + "meanSetJaccard": 0.9095598845598847, + "meanTokenWeightedTv": 0.02412765425794955, + "meanAggregateLoadTv": 0.03125008612821617 + }, + { + "layer": "layer_06", + "tokens": 660, + "orderedExact": 368, + "orderedExactRate": 0.5575757575757576, + "setExact": 460, + "setExactRate": 0.696969696969697, + "meanSetJaccard": 0.911147186147186, + "meanTokenWeightedTv": 0.025271454727445603, + "meanAggregateLoadTv": 0.03556570918317711 + }, + { + "layer": "layer_07", + "tokens": 660, + "orderedExact": 347, + "orderedExactRate": 0.5257575757575758, + "setExact": 437, + "setExactRate": 0.6621212121212121, + "meanSetJaccard": 0.8972366522366522, + "meanTokenWeightedTv": 0.027061356738742246, + "meanAggregateLoadTv": 0.035639466887012645 + }, + { + "layer": "layer_08", + "tokens": 660, + "orderedExact": 367, + "orderedExactRate": 0.556060606060606, + "setExact": 469, + "setExactRate": 0.7106060606060606, + "meanSetJaccard": 0.9110894660894662, + "meanTokenWeightedTv": 0.024359688597495262, + "meanAggregateLoadTv": 0.03988497601734815 + }, + { + "layer": "layer_09", + "tokens": 660, + "orderedExact": 340, + "orderedExactRate": 0.5151515151515151, + "setExact": 432, + "setExactRate": 0.6545454545454545, + "meanSetJaccard": 0.8941558441558441, + "meanTokenWeightedTv": 0.02741725182881611, + "meanAggregateLoadTv": 0.03867499960492154 + }, + { + "layer": "layer_10", + "tokens": 660, + "orderedExact": 344, + "orderedExactRate": 0.5212121212121212, + "setExact": 455, + "setExactRate": 0.6893939393939394, + "meanSetJaccard": 0.9055555555555554, + "meanTokenWeightedTv": 0.02425724485789265, + "meanAggregateLoadTv": 0.0316827394142699 + }, + { + "layer": "layer_11", + "tokens": 660, + "orderedExact": 334, + "orderedExactRate": 0.5060606060606061, + "setExact": 433, + "setExactRate": 0.656060606060606, + "meanSetJaccard": 0.8946182605273514, + "meanTokenWeightedTv": 0.02320907112601425, + "meanAggregateLoadTv": 0.03547291575440216 + }, + { + "layer": "layer_12", + "tokens": 660, + "orderedExact": 317, + "orderedExactRate": 0.4803030303030303, + "setExact": 411, + "setExactRate": 0.6227272727272727, + "meanSetJaccard": 0.8822294372294373, + "meanTokenWeightedTv": 0.026702159551972166, + "meanAggregateLoadTv": 0.0377384830571796 + }, + { + "layer": "layer_13", + "tokens": 660, + "orderedExact": 280, + "orderedExactRate": 0.42424242424242425, + "setExact": 372, + "setExactRate": 0.5636363636363636, + "meanSetJaccard": 0.8652236652236652, + "meanTokenWeightedTv": 0.027458431018058494, + "meanAggregateLoadTv": 0.04440396932275194 + }, + { + "layer": "layer_14", + "tokens": 660, + "orderedExact": 299, + "orderedExactRate": 0.453030303030303, + "setExact": 396, + "setExactRate": 0.6, + "meanSetJaccard": 0.8747113997113996, + "meanTokenWeightedTv": 0.02690833883242824, + "meanAggregateLoadTv": 0.03715127824385923 + }, + { + "layer": "layer_15", + "tokens": 660, + "orderedExact": 304, + "orderedExactRate": 0.46060606060606063, + "setExact": 392, + "setExactRate": 0.593939393939394, + "meanSetJaccard": 0.8727928637019545, + "meanTokenWeightedTv": 0.027790556230014054, + "meanAggregateLoadTv": 0.04041726367412123 + }, + { + "layer": "layer_16", + "tokens": 660, + "orderedExact": 291, + "orderedExactRate": 0.4409090909090909, + "setExact": 386, + "setExactRate": 0.5848484848484848, + "meanSetJaccard": 0.8706854256854256, + "meanTokenWeightedTv": 0.02847061794218083, + "meanAggregateLoadTv": 0.044528678117696396 + }, + { + "layer": "layer_17", + "tokens": 660, + "orderedExact": 292, + "orderedExactRate": 0.44242424242424244, + "setExact": 395, + "setExactRate": 0.5984848484848485, + "meanSetJaccard": 0.8733844942935851, + "meanTokenWeightedTv": 0.029636818269530234, + "meanAggregateLoadTv": 0.04481796751501515 + }, + { + "layer": "layer_18", + "tokens": 660, + "orderedExact": 300, + "orderedExactRate": 0.45454545454545453, + "setExact": 402, + "setExactRate": 0.6090909090909091, + "meanSetJaccard": 0.8776990686081595, + "meanTokenWeightedTv": 0.030490313548001764, + "meanAggregateLoadTv": 0.038261670295498464 + }, + { + "layer": "layer_19", + "tokens": 660, + "orderedExact": 279, + "orderedExactRate": 0.42272727272727273, + "setExact": 377, + "setExactRate": 0.5712121212121212, + "meanSetJaccard": 0.8634855043945954, + "meanTokenWeightedTv": 0.03193055818119913, + "meanAggregateLoadTv": 0.037968034896174827 + }, + { + "layer": "layer_20", + "tokens": 660, + "orderedExact": 278, + "orderedExactRate": 0.4212121212121212, + "setExact": 354, + "setExactRate": 0.5363636363636364, + "meanSetJaccard": 0.8520641479732389, + "meanTokenWeightedTv": 0.033115332110829385, + "meanAggregateLoadTv": 0.05021867620687247 + }, + { + "layer": "layer_21", + "tokens": 660, + "orderedExact": 279, + "orderedExactRate": 0.42272727272727273, + "setExact": 376, + "setExactRate": 0.5696969696969697, + "meanSetJaccard": 0.8616096025186935, + "meanTokenWeightedTv": 0.03195491236789365, + "meanAggregateLoadTv": 0.047029654672751345 + }, + { + "layer": "layer_22", + "tokens": 660, + "orderedExact": 276, + "orderedExactRate": 0.41818181818181815, + "setExact": 366, + "setExactRate": 0.5545454545454546, + "meanSetJaccard": 0.8558946608946609, + "meanTokenWeightedTv": 0.03563402212975071, + "meanAggregateLoadTv": 0.048794572546552194 + }, + { + "layer": "layer_23", + "tokens": 660, + "orderedExact": 326, + "orderedExactRate": 0.49393939393939396, + "setExact": 418, + "setExactRate": 0.6333333333333333, + "meanSetJaccard": 0.883067033976125, + "meanTokenWeightedTv": 0.029864711059995896, + "meanAggregateLoadTv": 0.040544219443092507 + }, + { + "layer": "layer_24", + "tokens": 660, + "orderedExact": 252, + "orderedExactRate": 0.38181818181818183, + "setExact": 353, + "setExactRate": 0.5348484848484848, + "meanSetJaccard": 0.8515656565656565, + "meanTokenWeightedTv": 0.03082027919443861, + "meanAggregateLoadTv": 0.04565746062723613 + }, + { + "layer": "layer_25", + "tokens": 660, + "orderedExact": 327, + "orderedExactRate": 0.4954545454545455, + "setExact": 417, + "setExactRate": 0.6318181818181818, + "meanSetJaccard": 0.8822871572871573, + "meanTokenWeightedTv": 0.029387731465064244, + "meanAggregateLoadTv": 0.040188438368304394 + }, + { + "layer": "layer_26", + "tokens": 660, + "orderedExact": 346, + "orderedExactRate": 0.5242424242424243, + "setExact": 440, + "setExactRate": 0.6666666666666666, + "meanSetJaccard": 0.8955266955266955, + "meanTokenWeightedTv": 0.029740127550415354, + "meanAggregateLoadTv": 0.036079259090855444 + } + ], + "period_at_s0": [ + { + "layer": "layer_01", + "tokens": 660, + "orderedExact": 357, + "orderedExactRate": 0.5409090909090909, + "setExact": 435, + "setExactRate": 0.6590909090909091, + "meanSetJaccard": 0.8903318903318903, + "meanTokenWeightedTv": 0.018803733224510566, + "meanAggregateLoadTv": 0.04668772079246049 + }, + { + "layer": "layer_02", + "tokens": 660, + "orderedExact": 359, + "orderedExactRate": 0.543939393939394, + "setExact": 452, + "setExactRate": 0.6848484848484848, + "meanSetJaccard": 0.9061327561327561, + "meanTokenWeightedTv": 0.022276477822791282, + "meanAggregateLoadTv": 0.03849980231073891 + }, + { + "layer": "layer_03", + "tokens": 660, + "orderedExact": 401, + "orderedExactRate": 0.6075757575757575, + "setExact": 472, + "setExactRate": 0.7151515151515152, + "meanSetJaccard": 0.9163419913419912, + "meanTokenWeightedTv": 0.02079926824360122, + "meanAggregateLoadTv": 0.030848852276506557 + }, + { + "layer": "layer_04", + "tokens": 660, + "orderedExact": 424, + "orderedExactRate": 0.6424242424242425, + "setExact": 493, + "setExactRate": 0.746969696969697, + "meanSetJaccard": 0.9254329004329004, + "meanTokenWeightedTv": 0.020000970094550034, + "meanAggregateLoadTv": 0.03412076110537775 + }, + { + "layer": "layer_05", + "tokens": 660, + "orderedExact": 404, + "orderedExactRate": 0.6121212121212121, + "setExact": 492, + "setExactRate": 0.7454545454545455, + "meanSetJaccard": 0.9234487734487734, + "meanTokenWeightedTv": 0.019199267014040643, + "meanAggregateLoadTv": 0.03012181135840245 + }, + { + "layer": "layer_06", + "tokens": 660, + "orderedExact": 398, + "orderedExactRate": 0.603030303030303, + "setExact": 489, + "setExactRate": 0.740909090909091, + "meanSetJaccard": 0.9227272727272727, + "meanTokenWeightedTv": 0.021235937126178196, + "meanAggregateLoadTv": 0.03395932835038817 + }, + { + "layer": "layer_07", + "tokens": 660, + "orderedExact": 410, + "orderedExactRate": 0.6212121212121212, + "setExact": 490, + "setExactRate": 0.7424242424242424, + "meanSetJaccard": 0.9244588744588744, + "meanTokenWeightedTv": 0.02155185240545483, + "meanAggregateLoadTv": 0.032793614895251524 + }, + { + "layer": "layer_08", + "tokens": 660, + "orderedExact": 409, + "orderedExactRate": 0.6196969696969697, + "setExact": 492, + "setExactRate": 0.7454545454545455, + "meanSetJaccard": 0.9243506493506494, + "meanTokenWeightedTv": 0.019955937265883274, + "meanAggregateLoadTv": 0.031701221557045675 + }, + { + "layer": "layer_09", + "tokens": 660, + "orderedExact": 388, + "orderedExactRate": 0.5878787878787879, + "setExact": 482, + "setExactRate": 0.7303030303030303, + "meanSetJaccard": 0.9206709956709956, + "meanTokenWeightedTv": 0.021289149727201483, + "meanAggregateLoadTv": 0.035768926625494496 + }, + { + "layer": "layer_10", + "tokens": 660, + "orderedExact": 372, + "orderedExactRate": 0.5636363636363636, + "setExact": 470, + "setExactRate": 0.7121212121212122, + "meanSetJaccard": 0.9148268398268398, + "meanTokenWeightedTv": 0.020957337794691937, + "meanAggregateLoadTv": 0.030284995850175845 + }, + { + "layer": "layer_11", + "tokens": 660, + "orderedExact": 394, + "orderedExactRate": 0.5969696969696969, + "setExact": 493, + "setExactRate": 0.746969696969697, + "meanSetJaccard": 0.9251803751803753, + "meanTokenWeightedTv": 0.017557637299021368, + "meanAggregateLoadTv": 0.02773914441074664 + }, + { + "layer": "layer_12", + "tokens": 660, + "orderedExact": 355, + "orderedExactRate": 0.5378787878787878, + "setExact": 446, + "setExactRate": 0.6757575757575758, + "meanSetJaccard": 0.9032106782106784, + "meanTokenWeightedTv": 0.022527871563475427, + "meanAggregateLoadTv": 0.03086335585136097 + }, + { + "layer": "layer_13", + "tokens": 660, + "orderedExact": 307, + "orderedExactRate": 0.46515151515151515, + "setExact": 406, + "setExactRate": 0.6151515151515151, + "meanSetJaccard": 0.8848484848484849, + "meanTokenWeightedTv": 0.02243877548437958, + "meanAggregateLoadTv": 0.037009401456018054 + }, + { + "layer": "layer_14", + "tokens": 660, + "orderedExact": 335, + "orderedExactRate": 0.5075757575757576, + "setExact": 429, + "setExactRate": 0.65, + "meanSetJaccard": 0.8944805194805195, + "meanTokenWeightedTv": 0.02256989064902824, + "meanAggregateLoadTv": 0.037926296051284676 + }, + { + "layer": "layer_15", + "tokens": 660, + "orderedExact": 334, + "orderedExactRate": 0.5060606060606061, + "setExact": 419, + "setExactRate": 0.6348484848484849, + "meanSetJaccard": 0.8876262626262625, + "meanTokenWeightedTv": 0.023900002209790598, + "meanAggregateLoadTv": 0.03690588436974695 + }, + { + "layer": "layer_16", + "tokens": 660, + "orderedExact": 349, + "orderedExactRate": 0.5287878787878788, + "setExact": 436, + "setExactRate": 0.6606060606060606, + "meanSetJaccard": 0.8968614718614719, + "meanTokenWeightedTv": 0.023298352655636158, + "meanAggregateLoadTv": 0.03778140755420693 + }, + { + "layer": "layer_17", + "tokens": 660, + "orderedExact": 351, + "orderedExactRate": 0.5318181818181819, + "setExact": 440, + "setExactRate": 0.6666666666666666, + "meanSetJaccard": 0.8989898989898989, + "meanTokenWeightedTv": 0.023252109370692192, + "meanAggregateLoadTv": 0.03591756169997584 + }, + { + "layer": "layer_18", + "tokens": 660, + "orderedExact": 319, + "orderedExactRate": 0.48333333333333334, + "setExact": 413, + "setExactRate": 0.6257575757575757, + "meanSetJaccard": 0.8859307359307359, + "meanTokenWeightedTv": 0.02537740867552291, + "meanAggregateLoadTv": 0.03971274042247013 + }, + { + "layer": "layer_19", + "tokens": 660, + "orderedExact": 349, + "orderedExactRate": 0.5287878787878788, + "setExact": 440, + "setExactRate": 0.6666666666666666, + "meanSetJaccard": 0.8971861471861471, + "meanTokenWeightedTv": 0.024869714053045548, + "meanAggregateLoadTv": 0.03353059459275278 + }, + { + "layer": "layer_20", + "tokens": 660, + "orderedExact": 309, + "orderedExactRate": 0.4681818181818182, + "setExact": 416, + "setExactRate": 0.6303030303030303, + "meanSetJaccard": 0.88497113997114, + "meanTokenWeightedTv": 0.025476470395879584, + "meanAggregateLoadTv": 0.04123768424853621 + }, + { + "layer": "layer_21", + "tokens": 660, + "orderedExact": 327, + "orderedExactRate": 0.4954545454545455, + "setExact": 418, + "setExactRate": 0.6333333333333333, + "meanSetJaccard": 0.8852597402597401, + "meanTokenWeightedTv": 0.025733150826226722, + "meanAggregateLoadTv": 0.03642773246433408 + }, + { + "layer": "layer_22", + "tokens": 660, + "orderedExact": 326, + "orderedExactRate": 0.49393939393939396, + "setExact": 410, + "setExactRate": 0.6212121212121212, + "meanSetJaccard": 0.8829725829725831, + "meanTokenWeightedTv": 0.027323311629839225, + "meanAggregateLoadTv": 0.03928990992055467 + }, + { + "layer": "layer_23", + "tokens": 660, + "orderedExact": 360, + "orderedExactRate": 0.5454545454545454, + "setExact": 446, + "setExactRate": 0.6757575757575758, + "meanSetJaccard": 0.9003181162272071, + "meanTokenWeightedTv": 0.024158366715349225, + "meanAggregateLoadTv": 0.03432590323549368 + }, + { + "layer": "layer_24", + "tokens": 660, + "orderedExact": 317, + "orderedExactRate": 0.4803030303030303, + "setExact": 410, + "setExactRate": 0.6212121212121212, + "meanSetJaccard": 0.8818686868686868, + "meanTokenWeightedTv": 0.022806740216638043, + "meanAggregateLoadTv": 0.03540528009973892 + }, + { + "layer": "layer_25", + "tokens": 660, + "orderedExact": 362, + "orderedExactRate": 0.5484848484848485, + "setExact": 450, + "setExactRate": 0.6818181818181818, + "meanSetJaccard": 0.9033189033189033, + "meanTokenWeightedTv": 0.022429143607180173, + "meanAggregateLoadTv": 0.03615053852472879 + }, + { + "layer": "layer_26", + "tokens": 660, + "orderedExact": 351, + "orderedExactRate": 0.5318181818181819, + "setExact": 464, + "setExactRate": 0.703030303030303, + "meanSetJaccard": 0.9114502164502164, + "meanTokenWeightedTv": 0.021742501013541717, + "meanAggregateLoadTv": 0.02956956696044279 + } + ], + "period_at_s1": [ + { + "layer": "layer_01", + "tokens": 660, + "orderedExact": 322, + "orderedExactRate": 0.48787878787878786, + "setExact": 388, + "setExactRate": 0.5878787878787879, + "meanSetJaccard": 0.8693362193362194, + "meanTokenWeightedTv": 0.021967170176175287, + "meanAggregateLoadTv": 0.06113295142081884 + }, + { + "layer": "layer_02", + "tokens": 660, + "orderedExact": 342, + "orderedExactRate": 0.5181818181818182, + "setExact": 430, + "setExactRate": 0.6515151515151515, + "meanSetJaccard": 0.8968614718614717, + "meanTokenWeightedTv": 0.025622540922720233, + "meanAggregateLoadTv": 0.04141790059505818 + }, + { + "layer": "layer_03", + "tokens": 660, + "orderedExact": 348, + "orderedExactRate": 0.5272727272727272, + "setExact": 434, + "setExactRate": 0.6575757575757576, + "meanSetJaccard": 0.8982683982683981, + "meanTokenWeightedTv": 0.025387100052938035, + "meanAggregateLoadTv": 0.03668612266951772 + }, + { + "layer": "layer_04", + "tokens": 660, + "orderedExact": 372, + "orderedExactRate": 0.5636363636363636, + "setExact": 454, + "setExactRate": 0.6878787878787879, + "meanSetJaccard": 0.9075757575757574, + "meanTokenWeightedTv": 0.024155030493036696, + "meanAggregateLoadTv": 0.03806977593527853 + }, + { + "layer": "layer_05", + "tokens": 660, + "orderedExact": 390, + "orderedExactRate": 0.5909090909090909, + "setExact": 463, + "setExactRate": 0.7015151515151515, + "meanSetJaccard": 0.9090187590187591, + "meanTokenWeightedTv": 0.02421743947072419, + "meanAggregateLoadTv": 0.031556820656804666 + }, + { + "layer": "layer_06", + "tokens": 660, + "orderedExact": 369, + "orderedExactRate": 0.5590909090909091, + "setExact": 457, + "setExactRate": 0.6924242424242424, + "meanSetJaccard": 0.9098484848484848, + "meanTokenWeightedTv": 0.025178898431258274, + "meanAggregateLoadTv": 0.034935844508719435 + }, + { + "layer": "layer_07", + "tokens": 660, + "orderedExact": 352, + "orderedExactRate": 0.5333333333333333, + "setExact": 444, + "setExactRate": 0.6727272727272727, + "meanSetJaccard": 0.9017676767676767, + "meanTokenWeightedTv": 0.02676974875794278, + "meanAggregateLoadTv": 0.03720797144757393 + }, + { + "layer": "layer_08", + "tokens": 660, + "orderedExact": 353, + "orderedExactRate": 0.5348484848484848, + "setExact": 456, + "setExactRate": 0.6909090909090909, + "meanSetJaccard": 0.907987012987013, + "meanTokenWeightedTv": 0.02455531298027198, + "meanAggregateLoadTv": 0.03948804232520578 + }, + { + "layer": "layer_09", + "tokens": 660, + "orderedExact": 349, + "orderedExactRate": 0.5287878787878788, + "setExact": 440, + "setExactRate": 0.6666666666666666, + "meanSetJaccard": 0.8980158730158729, + "meanTokenWeightedTv": 0.02607600201919881, + "meanAggregateLoadTv": 0.03589425915542382 + }, + { + "layer": "layer_10", + "tokens": 660, + "orderedExact": 356, + "orderedExactRate": 0.5393939393939394, + "setExact": 454, + "setExactRate": 0.6878787878787879, + "meanSetJaccard": 0.9064213564213564, + "meanTokenWeightedTv": 0.024505082247930042, + "meanAggregateLoadTv": 0.03558514915506664 + }, + { + "layer": "layer_11", + "tokens": 660, + "orderedExact": 328, + "orderedExactRate": 0.49696969696969695, + "setExact": 430, + "setExactRate": 0.6515151515151515, + "meanSetJaccard": 0.8933917093008, + "meanTokenWeightedTv": 0.02294072620191088, + "meanAggregateLoadTv": 0.03419734437036973 + }, + { + "layer": "layer_12", + "tokens": 660, + "orderedExact": 310, + "orderedExactRate": 0.4696969696969697, + "setExact": 403, + "setExactRate": 0.6106060606060606, + "meanSetJaccard": 0.8793434343434343, + "meanTokenWeightedTv": 0.02667997647679787, + "meanAggregateLoadTv": 0.03524751543434304 + }, + { + "layer": "layer_13", + "tokens": 660, + "orderedExact": 289, + "orderedExactRate": 0.43787878787878787, + "setExact": 372, + "setExactRate": 0.5636363636363636, + "meanSetJaccard": 0.8654040404040404, + "meanTokenWeightedTv": 0.026385312927022963, + "meanAggregateLoadTv": 0.04113346493947031 + }, + { + "layer": "layer_14", + "tokens": 660, + "orderedExact": 299, + "orderedExactRate": 0.453030303030303, + "setExact": 406, + "setExactRate": 0.6151515151515151, + "meanSetJaccard": 0.8793650793650792, + "meanTokenWeightedTv": 0.025435469059724818, + "meanAggregateLoadTv": 0.04009887127472405 + }, + { + "layer": "layer_15", + "tokens": 660, + "orderedExact": 301, + "orderedExactRate": 0.45606060606060606, + "setExact": 394, + "setExactRate": 0.5969696969696969, + "meanSetJaccard": 0.8739177489177489, + "meanTokenWeightedTv": 0.027187497057049363, + "meanAggregateLoadTv": 0.044281197718089034 + }, + { + "layer": "layer_16", + "tokens": 660, + "orderedExact": 293, + "orderedExactRate": 0.44393939393939397, + "setExact": 390, + "setExactRate": 0.5909090909090909, + "meanSetJaccard": 0.8722943722943722, + "meanTokenWeightedTv": 0.02804703512347826, + "meanAggregateLoadTv": 0.04370973214169223 + }, + { + "layer": "layer_17", + "tokens": 660, + "orderedExact": 293, + "orderedExactRate": 0.44393939393939397, + "setExact": 386, + "setExactRate": 0.5848484848484848, + "meanSetJaccard": 0.8703902662993571, + "meanTokenWeightedTv": 0.029687719133199463, + "meanAggregateLoadTv": 0.0463469927071961 + }, + { + "layer": "layer_18", + "tokens": 660, + "orderedExact": 304, + "orderedExactRate": 0.46060606060606063, + "setExact": 398, + "setExactRate": 0.603030303030303, + "meanSetJaccard": 0.8743440902531813, + "meanTokenWeightedTv": 0.030296618371685367, + "meanAggregateLoadTv": 0.04321799767767212 + }, + { + "layer": "layer_19", + "tokens": 660, + "orderedExact": 290, + "orderedExactRate": 0.4393939393939394, + "setExact": 378, + "setExactRate": 0.5727272727272728, + "meanSetJaccard": 0.8657647907647908, + "meanTokenWeightedTv": 0.031264409205431644, + "meanAggregateLoadTv": 0.03551428716520878 + }, + { + "layer": "layer_20", + "tokens": 660, + "orderedExact": 263, + "orderedExactRate": 0.3984848484848485, + "setExact": 349, + "setExactRate": 0.5287878787878788, + "meanSetJaccard": 0.8497048406139315, + "meanTokenWeightedTv": 0.03404382265604515, + "meanAggregateLoadTv": 0.05285727523263899 + }, + { + "layer": "layer_21", + "tokens": 660, + "orderedExact": 293, + "orderedExactRate": 0.44393939393939397, + "setExact": 388, + "setExactRate": 0.5878787878787879, + "meanSetJaccard": 0.8672012331103239, + "meanTokenWeightedTv": 0.03116389645431184, + "meanAggregateLoadTv": 0.04632083126153299 + }, + { + "layer": "layer_22", + "tokens": 660, + "orderedExact": 286, + "orderedExactRate": 0.43333333333333335, + "setExact": 376, + "setExactRate": 0.5696969696969697, + "meanSetJaccard": 0.8608008658008657, + "meanTokenWeightedTv": 0.035153888947969954, + "meanAggregateLoadTv": 0.04766915667784955 + }, + { + "layer": "layer_23", + "tokens": 660, + "orderedExact": 330, + "orderedExactRate": 0.5, + "setExact": 420, + "setExactRate": 0.6363636363636364, + "meanSetJaccard": 0.884062704971796, + "meanTokenWeightedTv": 0.029902901320934275, + "meanAggregateLoadTv": 0.04198916752089188 + }, + { + "layer": "layer_24", + "tokens": 660, + "orderedExact": 267, + "orderedExactRate": 0.40454545454545454, + "setExact": 355, + "setExactRate": 0.5378787878787878, + "meanSetJaccard": 0.8504617604617603, + "meanTokenWeightedTv": 0.03194250173433721, + "meanAggregateLoadTv": 0.052949515079250296 + }, + { + "layer": "layer_25", + "tokens": 660, + "orderedExact": 318, + "orderedExactRate": 0.4818181818181818, + "setExact": 402, + "setExactRate": 0.6090909090909091, + "meanSetJaccard": 0.878102453102453, + "meanTokenWeightedTv": 0.029523365737169936, + "meanAggregateLoadTv": 0.03949523819875071 + }, + { + "layer": "layer_26", + "tokens": 660, + "orderedExact": 328, + "orderedExactRate": 0.49696969696969695, + "setExact": 419, + "setExactRate": 0.6348484848484849, + "meanSetJaccard": 0.8861832611832611, + "meanTokenWeightedTv": 0.03090712781187394, + "meanAggregateLoadTv": 0.0421440406398044 + } + ] + }, + "chinese": { + "system_eos": [ + { + "layer": "layer_01", + "tokens": 97, + "orderedExact": 72, + "orderedExactRate": 0.7422680412371134, + "setExact": 82, + "setExactRate": 0.845360824742268, + "meanSetJaccard": 0.9558173784977909, + "meanTokenWeightedTv": 0.00922738359090962, + "meanAggregateLoadTv": 0.026293276972624798 + }, + { + "layer": "layer_02", + "tokens": 97, + "orderedExact": 79, + "orderedExactRate": 0.8144329896907216, + "setExact": 83, + "setExactRate": 0.8556701030927835, + "meanSetJaccard": 0.9587628865979382, + "meanTokenWeightedTv": 0.010264958072215283, + "meanAggregateLoadTv": 0.019592055823939882 + }, + { + "layer": "layer_03", + "tokens": 97, + "orderedExact": 79, + "orderedExactRate": 0.8144329896907216, + "setExact": 87, + "setExactRate": 0.8969072164948454, + "meanSetJaccard": 0.9705449189985272, + "meanTokenWeightedTv": 0.009447211296522193, + "meanAggregateLoadTv": 0.017352724100912507 + }, + { + "layer": "layer_04", + "tokens": 97, + "orderedExact": 82, + "orderedExactRate": 0.845360824742268, + "setExact": 86, + "setExactRate": 0.8865979381443299, + "meanSetJaccard": 0.96759941089838, + "meanTokenWeightedTv": 0.009431469449392878, + "meanAggregateLoadTv": 0.017235305958132045 + }, + { + "layer": "layer_05", + "tokens": 97, + "orderedExact": 71, + "orderedExactRate": 0.7319587628865979, + "setExact": 85, + "setExactRate": 0.8762886597938144, + "meanSetJaccard": 0.9646539027982328, + "meanTokenWeightedTv": 0.010703796706043916, + "meanAggregateLoadTv": 0.020439143853998927 + }, + { + "layer": "layer_06", + "tokens": 97, + "orderedExact": 81, + "orderedExactRate": 0.8350515463917526, + "setExact": 84, + "setExactRate": 0.865979381443299, + "meanSetJaccard": 0.9617083946980857, + "meanTokenWeightedTv": 0.011205655957749128, + "meanAggregateLoadTv": 0.018820450885668277 + }, + { + "layer": "layer_07", + "tokens": 97, + "orderedExact": 66, + "orderedExactRate": 0.6804123711340206, + "setExact": 79, + "setExactRate": 0.8144329896907216, + "meanSetJaccard": 0.9469808541973491, + "meanTokenWeightedTv": 0.013908579323698366, + "meanAggregateLoadTv": 0.028146806226516368 + }, + { + "layer": "layer_08", + "tokens": 97, + "orderedExact": 68, + "orderedExactRate": 0.7010309278350515, + "setExact": 80, + "setExactRate": 0.8247422680412371, + "meanSetJaccard": 0.9477172312223859, + "meanTokenWeightedTv": 0.014114830382035193, + "meanAggregateLoadTv": 0.02699778582930757 + }, + { + "layer": "layer_09", + "tokens": 97, + "orderedExact": 64, + "orderedExactRate": 0.6597938144329897, + "setExact": 76, + "setExactRate": 0.7835051546391752, + "meanSetJaccard": 0.9359351988217967, + "meanTokenWeightedTv": 0.01462667611595948, + "meanAggregateLoadTv": 0.03725509930220075 + }, + { + "layer": "layer_10", + "tokens": 97, + "orderedExact": 70, + "orderedExactRate": 0.7216494845360825, + "setExact": 84, + "setExactRate": 0.865979381443299, + "meanSetJaccard": 0.9594992636229751, + "meanTokenWeightedTv": 0.01244510078241062, + "meanAggregateLoadTv": 0.02386943102522813 + }, + { + "layer": "layer_11", + "tokens": 97, + "orderedExact": 69, + "orderedExactRate": 0.711340206185567, + "setExact": 80, + "setExactRate": 0.8247422680412371, + "meanSetJaccard": 0.9499263622974966, + "meanTokenWeightedTv": 0.012395334824698118, + "meanAggregateLoadTv": 0.029153247450348897 + }, + { + "layer": "layer_12", + "tokens": 97, + "orderedExact": 70, + "orderedExactRate": 0.7216494845360825, + "setExact": 83, + "setExactRate": 0.8556701030927835, + "meanSetJaccard": 0.9543446244477174, + "meanTokenWeightedTv": 0.013072053636589212, + "meanAggregateLoadTv": 0.027299718196457327 + }, + { + "layer": "layer_13", + "tokens": 97, + "orderedExact": 62, + "orderedExactRate": 0.6391752577319587, + "setExact": 72, + "setExactRate": 0.7422680412371134, + "meanSetJaccard": 0.9263622974963182, + "meanTokenWeightedTv": 0.01514639071115381, + "meanAggregateLoadTv": 0.03948604401502952 + }, + { + "layer": "layer_14", + "tokens": 97, + "orderedExact": 59, + "orderedExactRate": 0.6082474226804123, + "setExact": 70, + "setExactRate": 0.7216494845360825, + "meanSetJaccard": 0.9204712812960235, + "meanTokenWeightedTv": 0.017342095677739, + "meanAggregateLoadTv": 0.039410560923242084 + }, + { + "layer": "layer_15", + "tokens": 97, + "orderedExact": 63, + "orderedExactRate": 0.6494845360824743, + "setExact": 73, + "setExactRate": 0.7525773195876289, + "meanSetJaccard": 0.9248895434462445, + "meanTokenWeightedTv": 0.016388260853145386, + "meanAggregateLoadTv": 0.03994732957595276 + }, + { + "layer": "layer_16", + "tokens": 97, + "orderedExact": 64, + "orderedExactRate": 0.6597938144329897, + "setExact": 73, + "setExactRate": 0.7525773195876289, + "meanSetJaccard": 0.9270986745213549, + "meanTokenWeightedTv": 0.016737367314968526, + "meanAggregateLoadTv": 0.03458803005904455 + }, + { + "layer": "layer_17", + "tokens": 97, + "orderedExact": 68, + "orderedExactRate": 0.7010309278350515, + "setExact": 82, + "setExactRate": 0.845360824742268, + "meanSetJaccard": 0.95139911634757, + "meanTokenWeightedTv": 0.013625641159402829, + "meanAggregateLoadTv": 0.02753455448201825 + }, + { + "layer": "layer_18", + "tokens": 97, + "orderedExact": 52, + "orderedExactRate": 0.5360824742268041, + "setExact": 72, + "setExactRate": 0.7422680412371134, + "meanSetJaccard": 0.9241531664212076, + "meanTokenWeightedTv": 0.017658675671086442, + "meanAggregateLoadTv": 0.035829307568438 + }, + { + "layer": "layer_19", + "tokens": 97, + "orderedExact": 57, + "orderedExactRate": 0.5876288659793815, + "setExact": 73, + "setExactRate": 0.7525773195876289, + "meanSetJaccard": 0.9248895434462445, + "meanTokenWeightedTv": 0.017079837989609842, + "meanAggregateLoadTv": 0.0424969806763285 + }, + { + "layer": "layer_20", + "tokens": 97, + "orderedExact": 68, + "orderedExactRate": 0.7010309278350515, + "setExact": 72, + "setExactRate": 0.7422680412371134, + "meanSetJaccard": 0.9241531664212076, + "meanTokenWeightedTv": 0.01900982542433806, + "meanAggregateLoadTv": 0.03967894524959742 + }, + { + "layer": "layer_21", + "tokens": 97, + "orderedExact": 56, + "orderedExactRate": 0.5773195876288659, + "setExact": 68, + "setExactRate": 0.7010309278350515, + "meanSetJaccard": 0.9101620029455082, + "meanTokenWeightedTv": 0.020051105538671447, + "meanAggregateLoadTv": 0.04499630971551262 + }, + { + "layer": "layer_22", + "tokens": 97, + "orderedExact": 65, + "orderedExactRate": 0.6701030927835051, + "setExact": 77, + "setExactRate": 0.7938144329896907, + "meanSetJaccard": 0.9410898379970546, + "meanTokenWeightedTv": 0.01589814161493941, + "meanAggregateLoadTv": 0.034554482018250135 + }, + { + "layer": "layer_23", + "tokens": 97, + "orderedExact": 57, + "orderedExactRate": 0.5876288659793815, + "setExact": 68, + "setExactRate": 0.7010309278350515, + "meanSetJaccard": 0.9123711340206188, + "meanTokenWeightedTv": 0.019838787377828838, + "meanAggregateLoadTv": 0.0482001476113795 + }, + { + "layer": "layer_24", + "tokens": 97, + "orderedExact": 61, + "orderedExactRate": 0.6288659793814433, + "setExact": 71, + "setExactRate": 0.7319587628865979, + "meanSetJaccard": 0.91899852724595, + "meanTokenWeightedTv": 0.016863117572556128, + "meanAggregateLoadTv": 0.045281468062265164 + }, + { + "layer": "layer_25", + "tokens": 97, + "orderedExact": 57, + "orderedExactRate": 0.5876288659793815, + "setExact": 67, + "setExactRate": 0.6907216494845361, + "meanSetJaccard": 0.9094256259204714, + "meanTokenWeightedTv": 0.01969057086838489, + "meanAggregateLoadTv": 0.04669887278582931 + }, + { + "layer": "layer_26", + "tokens": 97, + "orderedExact": 68, + "orderedExactRate": 0.7010309278350515, + "setExact": 79, + "setExactRate": 0.8144329896907216, + "meanSetJaccard": 0.9403534609720177, + "meanTokenWeightedTv": 0.01727296253012031, + "meanAggregateLoadTv": 0.03247450348899624 + } + ], + "system_bos": [ + { + "layer": "layer_01", + "tokens": 97, + "orderedExact": 58, + "orderedExactRate": 0.5979381443298969, + "setExact": 73, + "setExactRate": 0.7525773195876289, + "meanSetJaccard": 0.927098674521355, + "meanTokenWeightedTv": 0.014734588796507204, + "meanAggregateLoadTv": 0.04160795759527643 + }, + { + "layer": "layer_02", + "tokens": 97, + "orderedExact": 63, + "orderedExactRate": 0.6494845360824743, + "setExact": 74, + "setExactRate": 0.7628865979381443, + "meanSetJaccard": 0.9322533136966126, + "meanTokenWeightedTv": 0.018427548419771154, + "meanAggregateLoadTv": 0.03466351315083199 + }, + { + "layer": "layer_03", + "tokens": 97, + "orderedExact": 72, + "orderedExactRate": 0.7422680412371134, + "setExact": 81, + "setExactRate": 0.8350515463917526, + "meanSetJaccard": 0.9528718703976438, + "meanTokenWeightedTv": 0.015742019305606307, + "meanAggregateLoadTv": 0.027685520665593134 + }, + { + "layer": "layer_04", + "tokens": 97, + "orderedExact": 68, + "orderedExactRate": 0.7010309278350515, + "setExact": 79, + "setExactRate": 0.8144329896907216, + "meanSetJaccard": 0.9469808541973491, + "meanTokenWeightedTv": 0.01718933322697866, + "meanAggregateLoadTv": 0.0293461486849168 + }, + { + "layer": "layer_05", + "tokens": 97, + "orderedExact": 64, + "orderedExactRate": 0.6597938144329897, + "setExact": 79, + "setExactRate": 0.8144329896907216, + "meanSetJaccard": 0.9447717231222387, + "meanTokenWeightedTv": 0.016616686448157163, + "meanAggregateLoadTv": 0.029698403113258186 + }, + { + "layer": "layer_06", + "tokens": 97, + "orderedExact": 64, + "orderedExactRate": 0.6597938144329897, + "setExact": 79, + "setExactRate": 0.8144329896907216, + "meanSetJaccard": 0.9469808541973491, + "meanTokenWeightedTv": 0.016660066961307805, + "meanAggregateLoadTv": 0.0293461486849168 + }, + { + "layer": "layer_07", + "tokens": 97, + "orderedExact": 65, + "orderedExactRate": 0.6701030927835051, + "setExact": 74, + "setExactRate": 0.7628865979381443, + "meanSetJaccard": 0.9322533136966126, + "meanTokenWeightedTv": 0.019175446848347544, + "meanAggregateLoadTv": 0.033120303274288776 + }, + { + "layer": "layer_08", + "tokens": 97, + "orderedExact": 63, + "orderedExactRate": 0.6494845360824743, + "setExact": 78, + "setExactRate": 0.8041237113402062, + "meanSetJaccard": 0.9374079528718706, + "meanTokenWeightedTv": 0.018524349963466073, + "meanAggregateLoadTv": 0.03401771336553945 + }, + { + "layer": "layer_09", + "tokens": 97, + "orderedExact": 51, + "orderedExactRate": 0.5257731958762887, + "setExact": 63, + "setExactRate": 0.6494845360824743, + "meanSetJaccard": 0.8932253313696612, + "meanTokenWeightedTv": 0.022414704131156704, + "meanAggregateLoadTv": 0.05140398550724637 + }, + { + "layer": "layer_10", + "tokens": 97, + "orderedExact": 62, + "orderedExactRate": 0.6391752577319587, + "setExact": 75, + "setExactRate": 0.7731958762886598, + "meanSetJaccard": 0.9351988217967601, + "meanTokenWeightedTv": 0.01935470023223584, + "meanAggregateLoadTv": 0.027685520665593134 + }, + { + "layer": "layer_11", + "tokens": 97, + "orderedExact": 51, + "orderedExactRate": 0.5257731958762887, + "setExact": 68, + "setExactRate": 0.7010309278350515, + "meanSetJaccard": 0.9145802650957291, + "meanTokenWeightedTv": 0.018548314613202024, + "meanAggregateLoadTv": 0.03960346215780998 + }, + { + "layer": "layer_12", + "tokens": 97, + "orderedExact": 51, + "orderedExactRate": 0.5257731958762887, + "setExact": 70, + "setExactRate": 0.7216494845360825, + "meanSetJaccard": 0.9138438880706922, + "meanTokenWeightedTv": 0.020857720228096534, + "meanAggregateLoadTv": 0.04873691626409018 + }, + { + "layer": "layer_13", + "tokens": 97, + "orderedExact": 56, + "orderedExactRate": 0.5773195876288659, + "setExact": 73, + "setExactRate": 0.7525773195876289, + "meanSetJaccard": 0.9248895434462445, + "meanTokenWeightedTv": 0.018127900773189563, + "meanAggregateLoadTv": 0.044040190552871714 + }, + { + "layer": "layer_14", + "tokens": 97, + "orderedExact": 55, + "orderedExactRate": 0.5670103092783505, + "setExact": 70, + "setExactRate": 0.7216494845360825, + "meanSetJaccard": 0.9182621502209133, + "meanTokenWeightedTv": 0.020740386726722366, + "meanAggregateLoadTv": 0.04144860440150295 + }, + { + "layer": "layer_15", + "tokens": 97, + "orderedExact": 58, + "orderedExactRate": 0.5979381443298969, + "setExact": 71, + "setExactRate": 0.7319587628865979, + "meanSetJaccard": 0.9145802650957291, + "meanTokenWeightedTv": 0.021606470321126257, + "meanAggregateLoadTv": 0.04414922168545357 + }, + { + "layer": "layer_16", + "tokens": 97, + "orderedExact": 50, + "orderedExactRate": 0.5154639175257731, + "setExact": 70, + "setExactRate": 0.7216494845360825, + "meanSetJaccard": 0.9138438880706922, + "meanTokenWeightedTv": 0.021729371422080094, + "meanAggregateLoadTv": 0.04126409017713366 + }, + { + "layer": "layer_17", + "tokens": 97, + "orderedExact": 58, + "orderedExactRate": 0.5979381443298969, + "setExact": 72, + "setExactRate": 0.7422680412371134, + "meanSetJaccard": 0.9197349042709867, + "meanTokenWeightedTv": 0.02061460294471881, + "meanAggregateLoadTv": 0.03651704240472356 + }, + { + "layer": "layer_18", + "tokens": 97, + "orderedExact": 54, + "orderedExactRate": 0.5567010309278351, + "setExact": 73, + "setExactRate": 0.7525773195876289, + "meanSetJaccard": 0.927098674521355, + "meanTokenWeightedTv": 0.020043035437489427, + "meanAggregateLoadTv": 0.03991378153515835 + }, + { + "layer": "layer_19", + "tokens": 97, + "orderedExact": 52, + "orderedExactRate": 0.5360824742268041, + "setExact": 63, + "setExactRate": 0.6494845360824743, + "meanSetJaccard": 0.8888070692194404, + "meanTokenWeightedTv": 0.02375986104948827, + "meanAggregateLoadTv": 0.05803811057434246 + }, + { + "layer": "layer_20", + "tokens": 97, + "orderedExact": 50, + "orderedExactRate": 0.5154639175257731, + "setExact": 63, + "setExactRate": 0.6494845360824743, + "meanSetJaccard": 0.8998527245949925, + "meanTokenWeightedTv": 0.024560218858436997, + "meanAggregateLoadTv": 0.051445920558239405 + }, + { + "layer": "layer_21", + "tokens": 97, + "orderedExact": 55, + "orderedExactRate": 0.5670103092783505, + "setExact": 65, + "setExactRate": 0.6701030927835051, + "meanSetJaccard": 0.9035346097201767, + "meanTokenWeightedTv": 0.023574039351642012, + "meanAggregateLoadTv": 0.0558323268921095 + }, + { + "layer": "layer_22", + "tokens": 97, + "orderedExact": 58, + "orderedExactRate": 0.5979381443298969, + "setExact": 70, + "setExactRate": 0.7216494845360825, + "meanSetJaccard": 0.9204712812960236, + "meanTokenWeightedTv": 0.020908651369002957, + "meanAggregateLoadTv": 0.043344068706387545 + }, + { + "layer": "layer_23", + "tokens": 97, + "orderedExact": 47, + "orderedExactRate": 0.4845360824742268, + "setExact": 62, + "setExactRate": 0.6391752577319587, + "meanSetJaccard": 0.8924889543446246, + "meanTokenWeightedTv": 0.024248838265103642, + "meanAggregateLoadTv": 0.05776133923778851 + }, + { + "layer": "layer_24", + "tokens": 97, + "orderedExact": 55, + "orderedExactRate": 0.5670103092783505, + "setExact": 68, + "setExactRate": 0.7010309278350515, + "meanSetJaccard": 0.9123711340206185, + "meanTokenWeightedTv": 0.01972864874179997, + "meanAggregateLoadTv": 0.04654790660225443 + }, + { + "layer": "layer_25", + "tokens": 97, + "orderedExact": 54, + "orderedExactRate": 0.5567010309278351, + "setExact": 66, + "setExactRate": 0.6804123711340206, + "meanSetJaccard": 0.9042709867452137, + "meanTokenWeightedTv": 0.022177473874340856, + "meanAggregateLoadTv": 0.046355005367686525 + }, + { + "layer": "layer_26", + "tokens": 97, + "orderedExact": 59, + "orderedExactRate": 0.6082474226804123, + "setExact": 73, + "setExactRate": 0.7525773195876289, + "meanSetJaccard": 0.9270986745213551, + "meanTokenWeightedTv": 0.021203626913099884, + "meanAggregateLoadTv": 0.04141505636070854 + } + ], + "system_x": [ + { + "layer": "layer_01", + "tokens": 97, + "orderedExact": 53, + "orderedExactRate": 0.5463917525773195, + "setExact": 69, + "setExactRate": 0.711340206185567, + "meanSetJaccard": 0.910898379970545, + "meanTokenWeightedTv": 0.018202506441852805, + "meanAggregateLoadTv": 0.05194075415995706 + }, + { + "layer": "layer_02", + "tokens": 97, + "orderedExact": 67, + "orderedExactRate": 0.6907216494845361, + "setExact": 80, + "setExactRate": 0.8247422680412371, + "meanSetJaccard": 0.9499263622974963, + "meanTokenWeightedTv": 0.01722715725650225, + "meanAggregateLoadTv": 0.028960346215780995 + }, + { + "layer": "layer_03", + "tokens": 97, + "orderedExact": 64, + "orderedExactRate": 0.6597938144329897, + "setExact": 74, + "setExactRate": 0.7628865979381443, + "meanSetJaccard": 0.9322533136966127, + "meanTokenWeightedTv": 0.018966912004233213, + "meanAggregateLoadTv": 0.034780931293612455 + }, + { + "layer": "layer_04", + "tokens": 97, + "orderedExact": 58, + "orderedExactRate": 0.5979381443298969, + "setExact": 71, + "setExactRate": 0.7319587628865979, + "meanSetJaccard": 0.9234167893961708, + "meanTokenWeightedTv": 0.023515861441966917, + "meanAggregateLoadTv": 0.04330213365539452 + }, + { + "layer": "layer_05", + "tokens": 97, + "orderedExact": 58, + "orderedExactRate": 0.5979381443298969, + "setExact": 74, + "setExactRate": 0.7628865979381443, + "meanSetJaccard": 0.9300441826215023, + "meanTokenWeightedTv": 0.021870350513309947, + "meanAggregateLoadTv": 0.03744800053676865 + }, + { + "layer": "layer_06", + "tokens": 97, + "orderedExact": 62, + "orderedExactRate": 0.6391752577319587, + "setExact": 78, + "setExactRate": 0.8041237113402062, + "meanSetJaccard": 0.9418262150220914, + "meanTokenWeightedTv": 0.019779266486706994, + "meanAggregateLoadTv": 0.03093129361245303 + }, + { + "layer": "layer_07", + "tokens": 97, + "orderedExact": 53, + "orderedExactRate": 0.5463917525773195, + "setExact": 67, + "setExactRate": 0.6907216494845361, + "meanSetJaccard": 0.9054982817869417, + "meanTokenWeightedTv": 0.02636790619228574, + "meanAggregateLoadTv": 0.049860775630703166 + }, + { + "layer": "layer_08", + "tokens": 97, + "orderedExact": 61, + "orderedExactRate": 0.6288659793814433, + "setExact": 75, + "setExactRate": 0.7731958762886598, + "meanSetJaccard": 0.9287722586691659, + "meanTokenWeightedTv": 0.023556178447587235, + "meanAggregateLoadTv": 0.0390666935050993 + }, + { + "layer": "layer_09", + "tokens": 97, + "orderedExact": 46, + "orderedExactRate": 0.4742268041237113, + "setExact": 65, + "setExactRate": 0.6701030927835051, + "meanSetJaccard": 0.8938144329896909, + "meanTokenWeightedTv": 0.0256553899517696, + "meanAggregateLoadTv": 0.04924852388620504 + }, + { + "layer": "layer_10", + "tokens": 97, + "orderedExact": 52, + "orderedExactRate": 0.5360824742268041, + "setExact": 62, + "setExactRate": 0.6391752577319587, + "meanSetJaccard": 0.8907707412862051, + "meanTokenWeightedTv": 0.02765074774102516, + "meanAggregateLoadTv": 0.04156602254428341 + }, + { + "layer": "layer_11", + "tokens": 97, + "orderedExact": 54, + "orderedExactRate": 0.5567010309278351, + "setExact": 60, + "setExactRate": 0.6185567010309279, + "meanSetJaccard": 0.8773686794305352, + "meanTokenWeightedTv": 0.027601696542738273, + "meanAggregateLoadTv": 0.061854200214707465 + }, + { + "layer": "layer_12", + "tokens": 97, + "orderedExact": 47, + "orderedExactRate": 0.4845360824742268, + "setExact": 65, + "setExactRate": 0.6701030927835051, + "meanSetJaccard": 0.8983799705449191, + "meanTokenWeightedTv": 0.02682505729512631, + "meanAggregateLoadTv": 0.04905562265163715 + }, + { + "layer": "layer_13", + "tokens": 97, + "orderedExact": 44, + "orderedExactRate": 0.4536082474226804, + "setExact": 58, + "setExactRate": 0.5979381443298969, + "meanSetJaccard": 0.8754050073637702, + "meanTokenWeightedTv": 0.028072455938513305, + "meanAggregateLoadTv": 0.05984970477724101 + }, + { + "layer": "layer_14", + "tokens": 97, + "orderedExact": 38, + "orderedExactRate": 0.3917525773195876, + "setExact": 57, + "setExactRate": 0.5876288659793815, + "meanSetJaccard": 0.872459499263623, + "meanTokenWeightedTv": 0.03143505509362568, + "meanAggregateLoadTv": 0.06297805958132045 + }, + { + "layer": "layer_15", + "tokens": 97, + "orderedExact": 40, + "orderedExactRate": 0.41237113402061853, + "setExact": 52, + "setExactRate": 0.5360824742268041, + "meanSetJaccard": 0.8546882670594012, + "meanTokenWeightedTv": 0.03186516913230308, + "meanAggregateLoadTv": 0.07222893183038111 + }, + { + "layer": "layer_16", + "tokens": 97, + "orderedExact": 36, + "orderedExactRate": 0.3711340206185567, + "setExact": 50, + "setExactRate": 0.5154639175257731, + "meanSetJaccard": 0.8549337260677469, + "meanTokenWeightedTv": 0.03172250068573103, + "meanAggregateLoadTv": 0.06998960010735372 + }, + { + "layer": "layer_17", + "tokens": 97, + "orderedExact": 45, + "orderedExactRate": 0.4639175257731959, + "setExact": 64, + "setExactRate": 0.6597938144329897, + "meanSetJaccard": 0.8939617083946981, + "meanTokenWeightedTv": 0.028580156472354495, + "meanAggregateLoadTv": 0.05232655662909286 + }, + { + "layer": "layer_18", + "tokens": 97, + "orderedExact": 37, + "orderedExactRate": 0.38144329896907214, + "setExact": 50, + "setExactRate": 0.5154639175257731, + "meanSetJaccard": 0.8496318114874816, + "meanTokenWeightedTv": 0.03447851376693685, + "meanAggregateLoadTv": 0.07847725442834139 + }, + { + "layer": "layer_19", + "tokens": 97, + "orderedExact": 43, + "orderedExactRate": 0.44329896907216493, + "setExact": 65, + "setExactRate": 0.6701030927835051, + "meanSetJaccard": 0.8916053019145803, + "meanTokenWeightedTv": 0.028167868688895297, + "meanAggregateLoadTv": 0.05931293612453033 + }, + { + "layer": "layer_20", + "tokens": 97, + "orderedExact": 41, + "orderedExactRate": 0.422680412371134, + "setExact": 60, + "setExactRate": 0.6185567010309279, + "meanSetJaccard": 0.8821796759941091, + "meanTokenWeightedTv": 0.03247268172407458, + "meanAggregateLoadTv": 0.05534588030059045 + }, + { + "layer": "layer_21", + "tokens": 97, + "orderedExact": 40, + "orderedExactRate": 0.41237113402061853, + "setExact": 56, + "setExactRate": 0.5773195876288659, + "meanSetJaccard": 0.8562592047128131, + "meanTokenWeightedTv": 0.03718420723467224, + "meanAggregateLoadTv": 0.07700952764358562 + }, + { + "layer": "layer_22", + "tokens": 97, + "orderedExact": 41, + "orderedExactRate": 0.422680412371134, + "setExact": 49, + "setExactRate": 0.5051546391752577, + "meanSetJaccard": 0.8458517427589595, + "meanTokenWeightedTv": 0.03687916829419658, + "meanAggregateLoadTv": 0.07095410628019325 + }, + { + "layer": "layer_23", + "tokens": 97, + "orderedExact": 37, + "orderedExactRate": 0.38144329896907214, + "setExact": 50, + "setExactRate": 0.5154639175257731, + "meanSetJaccard": 0.8505154639175257, + "meanTokenWeightedTv": 0.03259517639943274, + "meanAggregateLoadTv": 0.07369665861513688 + }, + { + "layer": "layer_24", + "tokens": 97, + "orderedExact": 40, + "orderedExactRate": 0.41237113402061853, + "setExact": 55, + "setExactRate": 0.5670103092783505, + "meanSetJaccard": 0.8635247913598428, + "meanTokenWeightedTv": 0.03027802224251641, + "meanAggregateLoadTv": 0.0716502281266774 + }, + { + "layer": "layer_25", + "tokens": 97, + "orderedExact": 51, + "orderedExactRate": 0.5257731958762887, + "setExact": 61, + "setExactRate": 0.6288659793814433, + "meanSetJaccard": 0.8856161021109475, + "meanTokenWeightedTv": 0.030237730503959233, + "meanAggregateLoadTv": 0.05788714439076758 + }, + { + "layer": "layer_26", + "tokens": 97, + "orderedExact": 36, + "orderedExactRate": 0.3711340206185567, + "setExact": 52, + "setExactRate": 0.5360824742268041, + "meanSetJaccard": 0.8541973490427099, + "meanTokenWeightedTv": 0.03411364327552286, + "meanAggregateLoadTv": 0.07705146269457863 + } + ], + "system_period": [ + { + "layer": "layer_01", + "tokens": 97, + "orderedExact": 52, + "orderedExactRate": 0.5360824742268041, + "setExact": 72, + "setExactRate": 0.7422680412371134, + "meanSetJaccard": 0.9219440353460973, + "meanTokenWeightedTv": 0.016980679730296842, + "meanAggregateLoadTv": 0.04310923242082662 + }, + { + "layer": "layer_02", + "tokens": 97, + "orderedExact": 59, + "orderedExactRate": 0.6082474226804123, + "setExact": 71, + "setExactRate": 0.7319587628865979, + "meanSetJaccard": 0.9212076583210606, + "meanTokenWeightedTv": 0.020156627367291863, + "meanAggregateLoadTv": 0.04303374932903919 + }, + { + "layer": "layer_03", + "tokens": 97, + "orderedExact": 63, + "orderedExactRate": 0.6494845360824743, + "setExact": 72, + "setExactRate": 0.7422680412371134, + "meanSetJaccard": 0.9241531664212078, + "meanTokenWeightedTv": 0.019506506089907703, + "meanAggregateLoadTv": 0.0402157139023081 + }, + { + "layer": "layer_04", + "tokens": 97, + "orderedExact": 61, + "orderedExactRate": 0.6288659793814433, + "setExact": 71, + "setExactRate": 0.7319587628865979, + "meanSetJaccard": 0.9234167893961707, + "meanTokenWeightedTv": 0.022873157863053398, + "meanAggregateLoadTv": 0.03840411969940956 + }, + { + "layer": "layer_05", + "tokens": 97, + "orderedExact": 62, + "orderedExactRate": 0.6391752577319587, + "setExact": 71, + "setExactRate": 0.7319587628865979, + "meanSetJaccard": 0.9189985272459499, + "meanTokenWeightedTv": 0.02313400514993926, + "meanAggregateLoadTv": 0.042421497584541064 + }, + { + "layer": "layer_06", + "tokens": 97, + "orderedExact": 62, + "orderedExactRate": 0.6391752577319587, + "setExact": 78, + "setExactRate": 0.8041237113402062, + "meanSetJaccard": 0.9378988708885615, + "meanTokenWeightedTv": 0.020070824641831842, + "meanAggregateLoadTv": 0.030394524959742347 + }, + { + "layer": "layer_07", + "tokens": 97, + "orderedExact": 51, + "orderedExactRate": 0.5257731958762887, + "setExact": 61, + "setExactRate": 0.6288659793814433, + "meanSetJaccard": 0.884241531664212, + "meanTokenWeightedTv": 0.03095193898365098, + "meanAggregateLoadTv": 0.05495169082125603 + }, + { + "layer": "layer_08", + "tokens": 97, + "orderedExact": 55, + "orderedExactRate": 0.5670103092783505, + "setExact": 65, + "setExactRate": 0.6701030927835051, + "meanSetJaccard": 0.8971080465925827, + "meanTokenWeightedTv": 0.027979253625835407, + "meanAggregateLoadTv": 0.05815552871712292 + }, + { + "layer": "layer_09", + "tokens": 97, + "orderedExact": 50, + "orderedExactRate": 0.5154639175257731, + "setExact": 67, + "setExactRate": 0.6907216494845361, + "meanSetJaccard": 0.9029990627928772, + "meanTokenWeightedTv": 0.025140305555871, + "meanAggregateLoadTv": 0.05263687600644122 + }, + { + "layer": "layer_10", + "tokens": 97, + "orderedExact": 60, + "orderedExactRate": 0.6185567010309279, + "setExact": 69, + "setExactRate": 0.711340206185567, + "meanSetJaccard": 0.9069710358370153, + "meanTokenWeightedTv": 0.026691710404791506, + "meanAggregateLoadTv": 0.048049181427804614 + }, + { + "layer": "layer_11", + "tokens": 97, + "orderedExact": 45, + "orderedExactRate": 0.4639175257731959, + "setExact": 56, + "setExactRate": 0.5773195876288659, + "meanSetJaccard": 0.8695139911634758, + "meanTokenWeightedTv": 0.028217592319187183, + "meanAggregateLoadTv": 0.06204710144927535 + }, + { + "layer": "layer_12", + "tokens": 97, + "orderedExact": 49, + "orderedExactRate": 0.5051546391752577, + "setExact": 63, + "setExactRate": 0.6494845360824743, + "meanSetJaccard": 0.8880706921944035, + "meanTokenWeightedTv": 0.029242538666501103, + "meanAggregateLoadTv": 0.0556478126677402 + }, + { + "layer": "layer_13", + "tokens": 97, + "orderedExact": 40, + "orderedExactRate": 0.41237113402061853, + "setExact": 58, + "setExactRate": 0.5979381443298969, + "meanSetJaccard": 0.8720712277413308, + "meanTokenWeightedTv": 0.030040366957642756, + "meanAggregateLoadTv": 0.0702999194847021 + }, + { + "layer": "layer_14", + "tokens": 97, + "orderedExact": 48, + "orderedExactRate": 0.4948453608247423, + "setExact": 56, + "setExactRate": 0.5773195876288659, + "meanSetJaccard": 0.8686794305351007, + "meanTokenWeightedTv": 0.03364781971252073, + "meanAggregateLoadTv": 0.06336386205045626 + }, + { + "layer": "layer_15", + "tokens": 97, + "orderedExact": 42, + "orderedExactRate": 0.4329896907216495, + "setExact": 58, + "setExactRate": 0.5979381443298969, + "meanSetJaccard": 0.8745704467353953, + "meanTokenWeightedTv": 0.03052417089920431, + "meanAggregateLoadTv": 0.058457461084272674 + }, + { + "layer": "layer_16", + "tokens": 97, + "orderedExact": 37, + "orderedExactRate": 0.38144329896907214, + "setExact": 55, + "setExactRate": 0.5670103092783505, + "meanSetJaccard": 0.8674521354933725, + "meanTokenWeightedTv": 0.03253852598953635, + "meanAggregateLoadTv": 0.06559480676328502 + }, + { + "layer": "layer_17", + "tokens": 97, + "orderedExact": 44, + "orderedExactRate": 0.4536082474226804, + "setExact": 60, + "setExactRate": 0.6185567010309279, + "meanSetJaccard": 0.8821796759941091, + "meanTokenWeightedTv": 0.03059706272324547, + "meanAggregateLoadTv": 0.060310990338164255 + }, + { + "layer": "layer_18", + "tokens": 97, + "orderedExact": 48, + "orderedExactRate": 0.4948453608247423, + "setExact": 58, + "setExactRate": 0.5979381443298969, + "meanSetJaccard": 0.8687776141384389, + "meanTokenWeightedTv": 0.03361427586256854, + "meanAggregateLoadTv": 0.06709608158883522 + }, + { + "layer": "layer_19", + "tokens": 97, + "orderedExact": 47, + "orderedExactRate": 0.4845360824742268, + "setExact": 60, + "setExactRate": 0.6185567010309279, + "meanSetJaccard": 0.8738340697103584, + "meanTokenWeightedTv": 0.031381358573908336, + "meanAggregateLoadTv": 0.06694511540526032 + }, + { + "layer": "layer_20", + "tokens": 97, + "orderedExact": 44, + "orderedExactRate": 0.4536082474226804, + "setExact": 58, + "setExactRate": 0.5979381443298969, + "meanSetJaccard": 0.8767795778105055, + "meanTokenWeightedTv": 0.034584614072289716, + "meanAggregateLoadTv": 0.07115539452495975 + }, + { + "layer": "layer_21", + "tokens": 97, + "orderedExact": 38, + "orderedExactRate": 0.3917525773195876, + "setExact": 50, + "setExactRate": 0.5154639175257731, + "meanSetJaccard": 0.8385861561119293, + "meanTokenWeightedTv": 0.04050832562829629, + "meanAggregateLoadTv": 0.08973262211486849 + }, + { + "layer": "layer_22", + "tokens": 97, + "orderedExact": 36, + "orderedExactRate": 0.3711340206185567, + "setExact": 53, + "setExactRate": 0.5463917525773195, + "meanSetJaccard": 0.8606774668630339, + "meanTokenWeightedTv": 0.03855817821630443, + "meanAggregateLoadTv": 0.07095410628019323 + }, + { + "layer": "layer_23", + "tokens": 97, + "orderedExact": 36, + "orderedExactRate": 0.3711340206185567, + "setExact": 53, + "setExactRate": 0.5463917525773195, + "meanSetJaccard": 0.8637702503681884, + "meanTokenWeightedTv": 0.033290909437519674, + "meanAggregateLoadTv": 0.06332192699946323 + }, + { + "layer": "layer_24", + "tokens": 97, + "orderedExact": 38, + "orderedExactRate": 0.3917525773195876, + "setExact": 55, + "setExactRate": 0.5670103092783505, + "meanSetJaccard": 0.8618065783014237, + "meanTokenWeightedTv": 0.03187972063590001, + "meanAggregateLoadTv": 0.07123087761674718 + }, + { + "layer": "layer_25", + "tokens": 97, + "orderedExact": 40, + "orderedExactRate": 0.41237113402061853, + "setExact": 56, + "setExactRate": 0.5773195876288659, + "meanSetJaccard": 0.8681885125184093, + "meanTokenWeightedTv": 0.03432013273439535, + "meanAggregateLoadTv": 0.06231548577563071 + }, + { + "layer": "layer_26", + "tokens": 97, + "orderedExact": 39, + "orderedExactRate": 0.4020618556701031, + "setExact": 52, + "setExactRate": 0.5360824742268041, + "meanSetJaccard": 0.8564064801178205, + "meanTokenWeightedTv": 0.037210779072371525, + "meanAggregateLoadTv": 0.0706857219538379 + } + ], + "bos_at_s0": [ + { + "layer": "layer_01", + "tokens": 97, + "orderedExact": 37, + "orderedExactRate": 0.38144329896907214, + "setExact": 53, + "setExactRate": 0.5463917525773195, + "meanSetJaccard": 0.8527245949926363, + "meanTokenWeightedTv": 0.031503091420464285, + "meanAggregateLoadTv": 0.08691458668813741 + }, + { + "layer": "layer_02", + "tokens": 97, + "orderedExact": 56, + "orderedExactRate": 0.5773195876288659, + "setExact": 72, + "setExactRate": 0.7422680412371134, + "meanSetJaccard": 0.9263622974963182, + "meanTokenWeightedTv": 0.026248247169303872, + "meanAggregateLoadTv": 0.03632414117015566 + }, + { + "layer": "layer_03", + "tokens": 97, + "orderedExact": 54, + "orderedExactRate": 0.5567010309278351, + "setExact": 69, + "setExactRate": 0.711340206185567, + "meanSetJaccard": 0.9131075110456554, + "meanTokenWeightedTv": 0.028469914414433632, + "meanAggregateLoadTv": 0.04295826623725175 + }, + { + "layer": "layer_04", + "tokens": 97, + "orderedExact": 56, + "orderedExactRate": 0.5773195876288659, + "setExact": 71, + "setExactRate": 0.7319587628865979, + "meanSetJaccard": 0.923416789396171, + "meanTokenWeightedTv": 0.024944818187656852, + "meanAggregateLoadTv": 0.03733058239398819 + }, + { + "layer": "layer_05", + "tokens": 97, + "orderedExact": 52, + "orderedExactRate": 0.5360824742268041, + "setExact": 73, + "setExactRate": 0.7525773195876289, + "meanSetJaccard": 0.927098674521355, + "meanTokenWeightedTv": 0.02446892363395716, + "meanAggregateLoadTv": 0.039645397208803 + }, + { + "layer": "layer_06", + "tokens": 97, + "orderedExact": 52, + "orderedExactRate": 0.5360824742268041, + "setExact": 69, + "setExactRate": 0.711340206185567, + "meanSetJaccard": 0.9131075110456554, + "meanTokenWeightedTv": 0.026071392613760798, + "meanAggregateLoadTv": 0.04616210413311862 + }, + { + "layer": "layer_07", + "tokens": 97, + "orderedExact": 49, + "orderedExactRate": 0.5051546391752577, + "setExact": 65, + "setExactRate": 0.6701030927835051, + "meanSetJaccard": 0.9057437407952872, + "meanTokenWeightedTv": 0.026356309492843247, + "meanAggregateLoadTv": 0.052284621578099835 + }, + { + "layer": "layer_08", + "tokens": 97, + "orderedExact": 53, + "orderedExactRate": 0.5463917525773195, + "setExact": 64, + "setExactRate": 0.6597938144329897, + "meanSetJaccard": 0.9005891016200295, + "meanTokenWeightedTv": 0.026622192749878072, + "meanAggregateLoadTv": 0.04662338969404187 + }, + { + "layer": "layer_09", + "tokens": 97, + "orderedExact": 46, + "orderedExactRate": 0.4742268041237113, + "setExact": 62, + "setExactRate": 0.6391752577319587, + "meanSetJaccard": 0.8946980854197348, + "meanTokenWeightedTv": 0.02409306662548041, + "meanAggregateLoadTv": 0.05167236983360172 + }, + { + "layer": "layer_10", + "tokens": 97, + "orderedExact": 49, + "orderedExactRate": 0.5051546391752577, + "setExact": 63, + "setExactRate": 0.6494845360824743, + "meanSetJaccard": 0.8976435935198822, + "meanTokenWeightedTv": 0.026837707266457837, + "meanAggregateLoadTv": 0.04404019055287171 + }, + { + "layer": "layer_11", + "tokens": 97, + "orderedExact": 49, + "orderedExactRate": 0.5051546391752577, + "setExact": 61, + "setExactRate": 0.6288659793814433, + "meanSetJaccard": 0.893961708394698, + "meanTokenWeightedTv": 0.022921318105122393, + "meanAggregateLoadTv": 0.048091116478797644 + }, + { + "layer": "layer_12", + "tokens": 97, + "orderedExact": 53, + "orderedExactRate": 0.5463917525773195, + "setExact": 65, + "setExactRate": 0.6701030927835051, + "meanSetJaccard": 0.9035346097201767, + "meanTokenWeightedTv": 0.02368576170667787, + "meanAggregateLoadTv": 0.047545960815888355 + }, + { + "layer": "layer_13", + "tokens": 97, + "orderedExact": 53, + "orderedExactRate": 0.5463917525773195, + "setExact": 69, + "setExactRate": 0.711340206185567, + "meanSetJaccard": 0.9131075110456554, + "meanTokenWeightedTv": 0.021470520572690742, + "meanAggregateLoadTv": 0.040953770799785294 + }, + { + "layer": "layer_14", + "tokens": 97, + "orderedExact": 44, + "orderedExactRate": 0.4536082474226804, + "setExact": 62, + "setExactRate": 0.6391752577319587, + "meanSetJaccard": 0.8946980854197348, + "meanTokenWeightedTv": 0.025654940662535142, + "meanAggregateLoadTv": 0.04851046698872786 + }, + { + "layer": "layer_15", + "tokens": 97, + "orderedExact": 44, + "orderedExactRate": 0.4536082474226804, + "setExact": 57, + "setExactRate": 0.5876288659793815, + "meanSetJaccard": 0.8711340206185567, + "meanTokenWeightedTv": 0.028138085915002185, + "meanAggregateLoadTv": 0.06918444712828771 + }, + { + "layer": "layer_16", + "tokens": 97, + "orderedExact": 43, + "orderedExactRate": 0.44329896907216493, + "setExact": 61, + "setExactRate": 0.6288659793814433, + "meanSetJaccard": 0.8873343151693669, + "meanTokenWeightedTv": 0.025738546602143392, + "meanAggregateLoadTv": 0.055069108964036495 + }, + { + "layer": "layer_17", + "tokens": 97, + "orderedExact": 59, + "orderedExactRate": 0.6082474226804123, + "setExact": 75, + "setExactRate": 0.7731958762886598, + "meanSetJaccard": 0.9290623465881198, + "meanTokenWeightedTv": 0.020706636336727306, + "meanAggregateLoadTv": 0.03847960279119699 + }, + { + "layer": "layer_18", + "tokens": 97, + "orderedExact": 53, + "orderedExactRate": 0.5463917525773195, + "setExact": 68, + "setExactRate": 0.7010309278350515, + "meanSetJaccard": 0.9123711340206185, + "meanTokenWeightedTv": 0.023344331846548837, + "meanAggregateLoadTv": 0.043268585614600105 + }, + { + "layer": "layer_19", + "tokens": 97, + "orderedExact": 48, + "orderedExactRate": 0.4948453608247423, + "setExact": 62, + "setExactRate": 0.6391752577319587, + "meanSetJaccard": 0.8924889543446246, + "meanTokenWeightedTv": 0.025075340710590473, + "meanAggregateLoadTv": 0.05784520933977455 + }, + { + "layer": "layer_20", + "tokens": 97, + "orderedExact": 46, + "orderedExactRate": 0.4742268041237113, + "setExact": 61, + "setExactRate": 0.6288659793814433, + "meanSetJaccard": 0.8917525773195878, + "meanTokenWeightedTv": 0.026715182748894263, + "meanAggregateLoadTv": 0.05113560118089104 + }, + { + "layer": "layer_21", + "tokens": 97, + "orderedExact": 54, + "orderedExactRate": 0.5567010309278351, + "setExact": 61, + "setExactRate": 0.6288659793814433, + "meanSetJaccard": 0.8873343151693667, + "meanTokenWeightedTv": 0.02750241630003921, + "meanAggregateLoadTv": 0.05818907675791734 + }, + { + "layer": "layer_22", + "tokens": 97, + "orderedExact": 52, + "orderedExactRate": 0.5360824742268041, + "setExact": 64, + "setExactRate": 0.6597938144329897, + "meanSetJaccard": 0.90279823269514, + "meanTokenWeightedTv": 0.02493111860069286, + "meanAggregateLoadTv": 0.05209172034353193 + }, + { + "layer": "layer_23", + "tokens": 97, + "orderedExact": 51, + "orderedExactRate": 0.5257731958762887, + "setExact": 64, + "setExactRate": 0.6597938144329897, + "meanSetJaccard": 0.8983799705449191, + "meanTokenWeightedTv": 0.024736597918644368, + "meanAggregateLoadTv": 0.05167236983360172 + }, + { + "layer": "layer_24", + "tokens": 97, + "orderedExact": 62, + "orderedExactRate": 0.6391752577319587, + "setExact": 77, + "setExactRate": 0.7938144329896907, + "meanSetJaccard": 0.9388807069219441, + "meanTokenWeightedTv": 0.018779568250049644, + "meanAggregateLoadTv": 0.02846551261406334 + }, + { + "layer": "layer_25", + "tokens": 97, + "orderedExact": 51, + "orderedExactRate": 0.5257731958762887, + "setExact": 62, + "setExactRate": 0.6391752577319587, + "meanSetJaccard": 0.8858615611192932, + "meanTokenWeightedTv": 0.026215827105932038, + "meanAggregateLoadTv": 0.0573419887278583 + }, + { + "layer": "layer_26", + "tokens": 97, + "orderedExact": 53, + "orderedExactRate": 0.5463917525773195, + "setExact": 67, + "setExactRate": 0.6907216494845361, + "meanSetJaccard": 0.90279823269514, + "meanTokenWeightedTv": 0.026395146059531843, + "meanAggregateLoadTv": 0.04913110574342459 + } + ], + "bos_at_s1": [ + { + "layer": "layer_01", + "tokens": 97, + "orderedExact": 36, + "orderedExactRate": 0.3711340206185567, + "setExact": 49, + "setExactRate": 0.5051546391752577, + "meanSetJaccard": 0.8387334315169367, + "meanTokenWeightedTv": 0.03355628000382048, + "meanAggregateLoadTv": 0.09543578904991948 + }, + { + "layer": "layer_02", + "tokens": 97, + "orderedExact": 53, + "orderedExactRate": 0.5463917525773195, + "setExact": 69, + "setExactRate": 0.711340206185567, + "meanSetJaccard": 0.9153166421207658, + "meanTokenWeightedTv": 0.028197747561387005, + "meanAggregateLoadTv": 0.04669887278582931 + }, + { + "layer": "layer_03", + "tokens": 97, + "orderedExact": 62, + "orderedExactRate": 0.6391752577319587, + "setExact": 74, + "setExactRate": 0.7628865979381443, + "meanSetJaccard": 0.9300441826215023, + "meanTokenWeightedTv": 0.0276075201818604, + "meanAggregateLoadTv": 0.03874798711755234 + }, + { + "layer": "layer_04", + "tokens": 97, + "orderedExact": 51, + "orderedExactRate": 0.5257731958762887, + "setExact": 66, + "setExactRate": 0.6804123711340206, + "meanSetJaccard": 0.9042709867452137, + "meanTokenWeightedTv": 0.031043872505560635, + "meanAggregateLoadTv": 0.05267881105743425 + }, + { + "layer": "layer_05", + "tokens": 97, + "orderedExact": 44, + "orderedExactRate": 0.4536082474226804, + "setExact": 66, + "setExactRate": 0.6804123711340206, + "meanSetJaccard": 0.906480117820324, + "meanTokenWeightedTv": 0.028104186184114165, + "meanAggregateLoadTv": 0.047394994632313475 + }, + { + "layer": "layer_06", + "tokens": 97, + "orderedExact": 51, + "orderedExactRate": 0.5257731958762887, + "setExact": 67, + "setExactRate": 0.6907216494845361, + "meanSetJaccard": 0.9094256259204714, + "meanTokenWeightedTv": 0.026904244980123945, + "meanAggregateLoadTv": 0.046430488459473965 + }, + { + "layer": "layer_07", + "tokens": 97, + "orderedExact": 49, + "orderedExactRate": 0.5051546391752577, + "setExact": 63, + "setExactRate": 0.6494845360824743, + "meanSetJaccard": 0.8976435935198823, + "meanTokenWeightedTv": 0.02863374743964928, + "meanAggregateLoadTv": 0.05194075415995705 + }, + { + "layer": "layer_08", + "tokens": 97, + "orderedExact": 56, + "orderedExactRate": 0.5773195876288659, + "setExact": 73, + "setExactRate": 0.7525773195876289, + "meanSetJaccard": 0.9226804123711341, + "meanTokenWeightedTv": 0.024400463031478158, + "meanAggregateLoadTv": 0.04227053140096618 + }, + { + "layer": "layer_09", + "tokens": 97, + "orderedExact": 45, + "orderedExactRate": 0.4639175257731959, + "setExact": 62, + "setExactRate": 0.6391752577319587, + "meanSetJaccard": 0.894698085419735, + "meanTokenWeightedTv": 0.02459688453348136, + "meanAggregateLoadTv": 0.04669887278582931 + }, + { + "layer": "layer_10", + "tokens": 97, + "orderedExact": 50, + "orderedExactRate": 0.5154639175257731, + "setExact": 63, + "setExactRate": 0.6494845360824743, + "meanSetJaccard": 0.8998527245949925, + "meanTokenWeightedTv": 0.02721836478984615, + "meanAggregateLoadTv": 0.041297638217928076 + }, + { + "layer": "layer_11", + "tokens": 97, + "orderedExact": 48, + "orderedExactRate": 0.4948453608247423, + "setExact": 60, + "setExactRate": 0.6185567010309279, + "meanSetJaccard": 0.8910162002945509, + "meanTokenWeightedTv": 0.02377187282134008, + "meanAggregateLoadTv": 0.04500469672571122 + }, + { + "layer": "layer_12", + "tokens": 97, + "orderedExact": 51, + "orderedExactRate": 0.5257731958762887, + "setExact": 72, + "setExactRate": 0.7422680412371134, + "meanSetJaccard": 0.9241531664212076, + "meanTokenWeightedTv": 0.022259666457237606, + "meanAggregateLoadTv": 0.039561527106816964 + }, + { + "layer": "layer_13", + "tokens": 97, + "orderedExact": 47, + "orderedExactRate": 0.4845360824742268, + "setExact": 63, + "setExactRate": 0.6494845360824743, + "meanSetJaccard": 0.8976435935198822, + "meanTokenWeightedTv": 0.0232869899032552, + "meanAggregateLoadTv": 0.056184581320450885 + }, + { + "layer": "layer_14", + "tokens": 97, + "orderedExact": 45, + "orderedExactRate": 0.4639175257731959, + "setExact": 60, + "setExactRate": 0.6185567010309279, + "meanSetJaccard": 0.8888070692194404, + "meanTokenWeightedTv": 0.0270769946787888, + "meanAggregateLoadTv": 0.04824208266237252 + }, + { + "layer": "layer_15", + "tokens": 97, + "orderedExact": 44, + "orderedExactRate": 0.4536082474226804, + "setExact": 55, + "setExactRate": 0.5670103092783505, + "meanSetJaccard": 0.8657339224349534, + "meanTokenWeightedTv": 0.02911586871438348, + "meanAggregateLoadTv": 0.07284118357487923 + }, + { + "layer": "layer_16", + "tokens": 97, + "orderedExact": 42, + "orderedExactRate": 0.4329896907216495, + "setExact": 61, + "setExactRate": 0.6288659793814433, + "meanSetJaccard": 0.8895434462444772, + "meanTokenWeightedTv": 0.025927980626019764, + "meanAggregateLoadTv": 0.05333299785292539 + }, + { + "layer": "layer_17", + "tokens": 97, + "orderedExact": 51, + "orderedExactRate": 0.5257731958762887, + "setExact": 70, + "setExactRate": 0.7216494845360825, + "meanSetJaccard": 0.9182621502209133, + "meanTokenWeightedTv": 0.02467185695315021, + "meanAggregateLoadTv": 0.03945249597423511 + }, + { + "layer": "layer_18", + "tokens": 97, + "orderedExact": 48, + "orderedExactRate": 0.4948453608247423, + "setExact": 62, + "setExactRate": 0.6391752577319587, + "meanSetJaccard": 0.8924889543446246, + "meanTokenWeightedTv": 0.026098267508803036, + "meanAggregateLoadTv": 0.05205817230273752 + }, + { + "layer": "layer_19", + "tokens": 97, + "orderedExact": 52, + "orderedExactRate": 0.5360824742268041, + "setExact": 65, + "setExactRate": 0.6701030927835051, + "meanSetJaccard": 0.9013254786450663, + "meanTokenWeightedTv": 0.024161479440453985, + "meanAggregateLoadTv": 0.0485859500805153 + }, + { + "layer": "layer_20", + "tokens": 97, + "orderedExact": 38, + "orderedExactRate": 0.3917525773195876, + "setExact": 51, + "setExactRate": 0.5257731958762887, + "meanSetJaccard": 0.862297496318115, + "meanTokenWeightedTv": 0.031429679689251394, + "meanAggregateLoadTv": 0.060428408480944704 + }, + { + "layer": "layer_21", + "tokens": 97, + "orderedExact": 48, + "orderedExactRate": 0.4948453608247423, + "setExact": 59, + "setExactRate": 0.6082474226804123, + "meanSetJaccard": 0.8814432989690721, + "meanTokenWeightedTv": 0.030081369226073677, + "meanAggregateLoadTv": 0.057492954911433164 + }, + { + "layer": "layer_22", + "tokens": 97, + "orderedExact": 55, + "orderedExactRate": 0.5670103092783505, + "setExact": 66, + "setExactRate": 0.6804123711340206, + "meanSetJaccard": 0.906480117820324, + "meanTokenWeightedTv": 0.02524225713924922, + "meanAggregateLoadTv": 0.053601382179280725 + }, + { + "layer": "layer_23", + "tokens": 97, + "orderedExact": 37, + "orderedExactRate": 0.38144329896907214, + "setExact": 57, + "setExactRate": 0.5876288659793815, + "meanSetJaccard": 0.8760432007854689, + "meanTokenWeightedTv": 0.027836293170784246, + "meanAggregateLoadTv": 0.06559480676328502 + }, + { + "layer": "layer_24", + "tokens": 97, + "orderedExact": 47, + "orderedExactRate": 0.4845360824742268, + "setExact": 66, + "setExactRate": 0.6804123711340206, + "meanSetJaccard": 0.9064801178203239, + "meanTokenWeightedTv": 0.023432528588017705, + "meanAggregateLoadTv": 0.05113560118089104 + }, + { + "layer": "layer_25", + "tokens": 97, + "orderedExact": 51, + "orderedExactRate": 0.5257731958762887, + "setExact": 67, + "setExactRate": 0.6907216494845361, + "meanSetJaccard": 0.9027982326951399, + "meanTokenWeightedTv": 0.02588265118646194, + "meanAggregateLoadTv": 0.05152140365002684 + }, + { + "layer": "layer_26", + "tokens": 97, + "orderedExact": 47, + "orderedExactRate": 0.4845360824742268, + "setExact": 62, + "setExactRate": 0.6391752577319587, + "meanSetJaccard": 0.8946980854197348, + "meanTokenWeightedTv": 0.028183838898457, + "meanAggregateLoadTv": 0.05475878958668814 + } + ], + "x_at_s0": [ + { + "layer": "layer_01", + "tokens": 97, + "orderedExact": 39, + "orderedExactRate": 0.4020618556701031, + "setExact": 54, + "setExactRate": 0.5567010309278351, + "meanSetJaccard": 0.8645066273932254, + "meanTokenWeightedTv": 0.02829642885526936, + "meanAggregateLoadTv": 0.07627147074610843 + }, + { + "layer": "layer_02", + "tokens": 97, + "orderedExact": 53, + "orderedExactRate": 0.5463917525773195, + "setExact": 66, + "setExactRate": 0.6804123711340206, + "meanSetJaccard": 0.9086892488954345, + "meanTokenWeightedTv": 0.028369565580498378, + "meanAggregateLoadTv": 0.051554951690821256 + }, + { + "layer": "layer_03", + "tokens": 97, + "orderedExact": 56, + "orderedExactRate": 0.5773195876288659, + "setExact": 70, + "setExactRate": 0.7216494845360825, + "meanSetJaccard": 0.9160530191458027, + "meanTokenWeightedTv": 0.02708559179785039, + "meanAggregateLoadTv": 0.041146672034353196 + }, + { + "layer": "layer_04", + "tokens": 97, + "orderedExact": 52, + "orderedExactRate": 0.5360824742268041, + "setExact": 71, + "setExactRate": 0.7319587628865979, + "meanSetJaccard": 0.9212076583210604, + "meanTokenWeightedTv": 0.027406425062192444, + "meanAggregateLoadTv": 0.0426898819108964 + }, + { + "layer": "layer_05", + "tokens": 97, + "orderedExact": 47, + "orderedExactRate": 0.4845360824742268, + "setExact": 69, + "setExactRate": 0.711340206185567, + "meanSetJaccard": 0.9153166421207658, + "meanTokenWeightedTv": 0.026899691916664387, + "meanAggregateLoadTv": 0.04315116747181964 + }, + { + "layer": "layer_06", + "tokens": 97, + "orderedExact": 53, + "orderedExactRate": 0.5463917525773195, + "setExact": 65, + "setExactRate": 0.6701030927835051, + "meanSetJaccard": 0.899116347569956, + "meanTokenWeightedTv": 0.028797555660574743, + "meanAggregateLoadTv": 0.055186527106816964 + }, + { + "layer": "layer_07", + "tokens": 97, + "orderedExact": 41, + "orderedExactRate": 0.422680412371134, + "setExact": 61, + "setExactRate": 0.6288659793814433, + "meanSetJaccard": 0.887825233186058, + "meanTokenWeightedTv": 0.03125670961633545, + "meanAggregateLoadTv": 0.05872584541062802 + }, + { + "layer": "layer_08", + "tokens": 97, + "orderedExact": 41, + "orderedExactRate": 0.422680412371134, + "setExact": 56, + "setExactRate": 0.5773195876288659, + "meanSetJaccard": 0.8681885125184093, + "meanTokenWeightedTv": 0.034350842269154, + "meanAggregateLoadTv": 0.06752381910896404 + }, + { + "layer": "layer_09", + "tokens": 97, + "orderedExact": 41, + "orderedExactRate": 0.422680412371134, + "setExact": 64, + "setExactRate": 0.6597938144329897, + "meanSetJaccard": 0.8983799705449191, + "meanTokenWeightedTv": 0.026842941454781936, + "meanAggregateLoadTv": 0.049592391304347824 + }, + { + "layer": "layer_10", + "tokens": 97, + "orderedExact": 47, + "orderedExactRate": 0.4845360824742268, + "setExact": 63, + "setExactRate": 0.6494845360824743, + "meanSetJaccard": 0.8976435935198823, + "meanTokenWeightedTv": 0.031136275539930154, + "meanAggregateLoadTv": 0.04604468599033816 + }, + { + "layer": "layer_11", + "tokens": 97, + "orderedExact": 47, + "orderedExactRate": 0.4845360824742268, + "setExact": 58, + "setExactRate": 0.5979381443298969, + "meanSetJaccard": 0.8829160530191459, + "meanTokenWeightedTv": 0.026673980352402052, + "meanAggregateLoadTv": 0.049365942028985504 + }, + { + "layer": "layer_12", + "tokens": 97, + "orderedExact": 46, + "orderedExactRate": 0.4742268041237113, + "setExact": 61, + "setExactRate": 0.6288659793814433, + "meanSetJaccard": 0.8851251840942563, + "meanTokenWeightedTv": 0.028686988357740983, + "meanAggregateLoadTv": 0.05082528180354268 + }, + { + "layer": "layer_13", + "tokens": 97, + "orderedExact": 42, + "orderedExactRate": 0.4329896907216495, + "setExact": 57, + "setExactRate": 0.5876288659793815, + "meanSetJaccard": 0.8755522827687778, + "meanTokenWeightedTv": 0.028142848207820405, + "meanAggregateLoadTv": 0.0594639023081052 + }, + { + "layer": "layer_14", + "tokens": 97, + "orderedExact": 43, + "orderedExactRate": 0.44329896907216493, + "setExact": 69, + "setExactRate": 0.711340206185567, + "meanSetJaccard": 0.910898379970545, + "meanTokenWeightedTv": 0.02715525560099939, + "meanAggregateLoadTv": 0.039527979066022546 + }, + { + "layer": "layer_15", + "tokens": 97, + "orderedExact": 37, + "orderedExactRate": 0.38144329896907214, + "setExact": 51, + "setExactRate": 0.5257731958762887, + "meanSetJaccard": 0.8600883652430046, + "meanTokenWeightedTv": 0.031491083052870184, + "meanAggregateLoadTv": 0.063665794417606 + }, + { + "layer": "layer_16", + "tokens": 97, + "orderedExact": 36, + "orderedExactRate": 0.3711340206185567, + "setExact": 52, + "setExactRate": 0.5360824742268041, + "meanSetJaccard": 0.8568973981345116, + "meanTokenWeightedTv": 0.03139306803921165, + "meanAggregateLoadTv": 0.07450181159420291 + }, + { + "layer": "layer_17", + "tokens": 97, + "orderedExact": 45, + "orderedExactRate": 0.4639175257731959, + "setExact": 59, + "setExactRate": 0.6082474226804123, + "meanSetJaccard": 0.8753068237604321, + "meanTokenWeightedTv": 0.0308893731385267, + "meanAggregateLoadTv": 0.05406266774020397 + }, + { + "layer": "layer_18", + "tokens": 97, + "orderedExact": 48, + "orderedExactRate": 0.4948453608247423, + "setExact": 61, + "setExactRate": 0.6288659793814433, + "meanSetJaccard": 0.8873343151693667, + "meanTokenWeightedTv": 0.02954204345109607, + "meanAggregateLoadTv": 0.04797369833601718 + }, + { + "layer": "layer_19", + "tokens": 97, + "orderedExact": 42, + "orderedExactRate": 0.4329896907216495, + "setExact": 57, + "setExactRate": 0.5876288659793815, + "meanSetJaccard": 0.8711340206185567, + "meanTokenWeightedTv": 0.029546062192223867, + "meanAggregateLoadTv": 0.06494061996779388 + }, + { + "layer": "layer_20", + "tokens": 97, + "orderedExact": 40, + "orderedExactRate": 0.41237113402061853, + "setExact": 60, + "setExactRate": 0.6185567010309279, + "meanSetJaccard": 0.8910162002945509, + "meanTokenWeightedTv": 0.028465240666668654, + "meanAggregateLoadTv": 0.04886272141706924 + }, + { + "layer": "layer_21", + "tokens": 97, + "orderedExact": 37, + "orderedExactRate": 0.38144329896907214, + "setExact": 48, + "setExactRate": 0.4948453608247423, + "meanSetJaccard": 0.853460972017673, + "meanTokenWeightedTv": 0.032399616186486804, + "meanAggregateLoadTv": 0.06675221417069242 + }, + { + "layer": "layer_22", + "tokens": 97, + "orderedExact": 49, + "orderedExactRate": 0.5051546391752577, + "setExact": 57, + "setExactRate": 0.5876288659793815, + "meanSetJaccard": 0.8711340206185567, + "meanTokenWeightedTv": 0.030546668761064138, + "meanAggregateLoadTv": 0.06385869565217392 + }, + { + "layer": "layer_23", + "tokens": 97, + "orderedExact": 39, + "orderedExactRate": 0.4020618556701031, + "setExact": 53, + "setExactRate": 0.5463917525773195, + "meanSetJaccard": 0.8606774668630339, + "meanTokenWeightedTv": 0.03152399774038663, + "meanAggregateLoadTv": 0.07072765700483093 + }, + { + "layer": "layer_24", + "tokens": 97, + "orderedExact": 41, + "orderedExactRate": 0.422680412371134, + "setExact": 60, + "setExactRate": 0.6185567010309279, + "meanSetJaccard": 0.8865979381443299, + "meanTokenWeightedTv": 0.02594561803340517, + "meanAggregateLoadTv": 0.05256139291465378 + }, + { + "layer": "layer_25", + "tokens": 97, + "orderedExact": 36, + "orderedExactRate": 0.3711340206185567, + "setExact": 55, + "setExactRate": 0.5670103092783505, + "meanSetJaccard": 0.8674521354933725, + "meanTokenWeightedTv": 0.0312515868828407, + "meanAggregateLoadTv": 0.061627750939345145 + }, + { + "layer": "layer_26", + "tokens": 97, + "orderedExact": 35, + "orderedExactRate": 0.36082474226804123, + "setExact": 51, + "setExactRate": 0.5257731958762887, + "meanSetJaccard": 0.8600883652430045, + "meanTokenWeightedTv": 0.03201441707774913, + "meanAggregateLoadTv": 0.0693438003220612 + } + ], + "x_at_s1": [ + { + "layer": "layer_01", + "tokens": 97, + "orderedExact": 37, + "orderedExactRate": 0.38144329896907214, + "setExact": 48, + "setExactRate": 0.4948453608247423, + "meanSetJaccard": 0.833578792341679, + "meanTokenWeightedTv": 0.03473385901052742, + "meanAggregateLoadTv": 0.09879059312936125 + }, + { + "layer": "layer_02", + "tokens": 97, + "orderedExact": 54, + "orderedExactRate": 0.5567010309278351, + "setExact": 67, + "setExactRate": 0.6907216494845361, + "meanSetJaccard": 0.9094256259204714, + "meanTokenWeightedTv": 0.03037694020004832, + "meanAggregateLoadTv": 0.04951690821256039 + }, + { + "layer": "layer_03", + "tokens": 97, + "orderedExact": 58, + "orderedExactRate": 0.5979381443298969, + "setExact": 72, + "setExactRate": 0.7422680412371134, + "meanSetJaccard": 0.9219440353460974, + "meanTokenWeightedTv": 0.02931724932725615, + "meanAggregateLoadTv": 0.04040861513687601 + }, + { + "layer": "layer_04", + "tokens": 97, + "orderedExact": 41, + "orderedExactRate": 0.422680412371134, + "setExact": 59, + "setExactRate": 0.6082474226804123, + "meanSetJaccard": 0.8858615611192932, + "meanTokenWeightedTv": 0.03763273631883546, + "meanAggregateLoadTv": 0.06146839774557166 + }, + { + "layer": "layer_05", + "tokens": 97, + "orderedExact": 50, + "orderedExactRate": 0.5154639175257731, + "setExact": 65, + "setExactRate": 0.6701030927835051, + "meanSetJaccard": 0.9057437407952872, + "meanTokenWeightedTv": 0.03034455833702398, + "meanAggregateLoadTv": 0.04898013955984971 + }, + { + "layer": "layer_06", + "tokens": 97, + "orderedExact": 46, + "orderedExactRate": 0.4742268041237113, + "setExact": 59, + "setExactRate": 0.6082474226804123, + "meanSetJaccard": 0.8836524300441827, + "meanTokenWeightedTv": 0.03292442546569144, + "meanAggregateLoadTv": 0.060277442297369824 + }, + { + "layer": "layer_07", + "tokens": 97, + "orderedExact": 44, + "orderedExactRate": 0.4536082474226804, + "setExact": 59, + "setExactRate": 0.6082474226804123, + "meanSetJaccard": 0.8783505154639177, + "meanTokenWeightedTv": 0.036148754448430076, + "meanAggregateLoadTv": 0.06197161835748793 + }, + { + "layer": "layer_08", + "tokens": 97, + "orderedExact": 41, + "orderedExactRate": 0.422680412371134, + "setExact": 60, + "setExactRate": 0.6185567010309279, + "meanSetJaccard": 0.8801713750167359, + "meanTokenWeightedTv": 0.03468285880088859, + "meanAggregateLoadTv": 0.06652576489533012 + }, + { + "layer": "layer_09", + "tokens": 97, + "orderedExact": 38, + "orderedExactRate": 0.3917525773195876, + "setExact": 54, + "setExactRate": 0.5567010309278351, + "meanSetJaccard": 0.8580800642656312, + "meanTokenWeightedTv": 0.035463920759418434, + "meanAggregateLoadTv": 0.06425288513150831 + }, + { + "layer": "layer_10", + "tokens": 97, + "orderedExact": 44, + "orderedExactRate": 0.4536082474226804, + "setExact": 55, + "setExactRate": 0.5670103092783505, + "meanSetJaccard": 0.8701521845851742, + "meanTokenWeightedTv": 0.03829149963659829, + "meanAggregateLoadTv": 0.06139291465378422 + }, + { + "layer": "layer_11", + "tokens": 97, + "orderedExact": 38, + "orderedExactRate": 0.3917525773195876, + "setExact": 52, + "setExactRate": 0.5360824742268041, + "meanSetJaccard": 0.8511045655375552, + "meanTokenWeightedTv": 0.03439950385211926, + "meanAggregateLoadTv": 0.069729602791197 + }, + { + "layer": "layer_12", + "tokens": 97, + "orderedExact": 40, + "orderedExactRate": 0.41237113402061853, + "setExact": 62, + "setExactRate": 0.6391752577319587, + "meanSetJaccard": 0.8873343151693669, + "meanTokenWeightedTv": 0.033056302951523606, + "meanAggregateLoadTv": 0.05818907675791734 + }, + { + "layer": "layer_13", + "tokens": 97, + "orderedExact": 24, + "orderedExactRate": 0.24742268041237114, + "setExact": 39, + "setExactRate": 0.4020618556701031, + "meanSetJaccard": 0.8083946980854197, + "meanTokenWeightedTv": 0.040279996282042, + "meanAggregateLoadTv": 0.08383655394524958 + }, + { + "layer": "layer_14", + "tokens": 97, + "orderedExact": 40, + "orderedExactRate": 0.41237113402061853, + "setExact": 54, + "setExactRate": 0.5567010309278351, + "meanSetJaccard": 0.8592047128129602, + "meanTokenWeightedTv": 0.039623736792824035, + "meanAggregateLoadTv": 0.06780059044551798 + }, + { + "layer": "layer_15", + "tokens": 97, + "orderedExact": 37, + "orderedExactRate": 0.38144329896907214, + "setExact": 49, + "setExactRate": 0.5051546391752577, + "meanSetJaccard": 0.8387334315169367, + "meanTokenWeightedTv": 0.03845218201357221, + "meanAggregateLoadTv": 0.08075013419216318 + }, + { + "layer": "layer_16", + "tokens": 97, + "orderedExact": 29, + "orderedExactRate": 0.29896907216494845, + "setExact": 40, + "setExactRate": 0.41237113402061853, + "meanSetJaccard": 0.8259695630829652, + "meanTokenWeightedTv": 0.04011173561789416, + "meanAggregateLoadTv": 0.09305387815351585 + }, + { + "layer": "layer_17", + "tokens": 97, + "orderedExact": 42, + "orderedExactRate": 0.4329896907216495, + "setExact": 59, + "setExactRate": 0.6082474226804123, + "meanSetJaccard": 0.8708885616102111, + "meanTokenWeightedTv": 0.03753000056934798, + "meanAggregateLoadTv": 0.06239096886741814 + }, + { + "layer": "layer_18", + "tokens": 97, + "orderedExact": 45, + "orderedExactRate": 0.4639175257731959, + "setExact": 54, + "setExactRate": 0.5567010309278351, + "meanSetJaccard": 0.8569955817378498, + "meanTokenWeightedTv": 0.037228779842686764, + "meanAggregateLoadTv": 0.0796346618357488 + }, + { + "layer": "layer_19", + "tokens": 97, + "orderedExact": 33, + "orderedExactRate": 0.3402061855670103, + "setExact": 52, + "setExactRate": 0.5360824742268041, + "meanSetJaccard": 0.849386352479136, + "meanTokenWeightedTv": 0.03784817061527601, + "meanAggregateLoadTv": 0.0691844471282877 + }, + { + "layer": "layer_20", + "tokens": 97, + "orderedExact": 35, + "orderedExactRate": 0.36082474226804123, + "setExact": 47, + "setExactRate": 0.4845360824742268, + "meanSetJaccard": 0.8382425135002455, + "meanTokenWeightedTv": 0.041925424527279036, + "meanAggregateLoadTv": 0.07092055823939883 + }, + { + "layer": "layer_21", + "tokens": 97, + "orderedExact": 27, + "orderedExactRate": 0.27835051546391754, + "setExact": 44, + "setExactRate": 0.4536082474226804, + "meanSetJaccard": 0.8142857142857144, + "meanTokenWeightedTv": 0.04731976740765603, + "meanAggregateLoadTv": 0.09463063607085345 + }, + { + "layer": "layer_22", + "tokens": 97, + "orderedExact": 34, + "orderedExactRate": 0.35051546391752575, + "setExact": 45, + "setExactRate": 0.4639175257731959, + "meanSetJaccard": 0.8267059401080019, + "meanTokenWeightedTv": 0.04462604000155879, + "meanAggregateLoadTv": 0.0872668411164788 + }, + { + "layer": "layer_23", + "tokens": 97, + "orderedExact": 30, + "orderedExactRate": 0.30927835051546393, + "setExact": 45, + "setExactRate": 0.4639175257731959, + "meanSetJaccard": 0.8340697103583701, + "meanTokenWeightedTv": 0.039717258647001374, + "meanAggregateLoadTv": 0.08599201556629092 + }, + { + "layer": "layer_24", + "tokens": 97, + "orderedExact": 31, + "orderedExactRate": 0.31958762886597936, + "setExact": 53, + "setExactRate": 0.5463917525773195, + "meanSetJaccard": 0.8487972508591066, + "meanTokenWeightedTv": 0.03569773062225008, + "meanAggregateLoadTv": 0.06810252281266774 + }, + { + "layer": "layer_25", + "tokens": 97, + "orderedExact": 40, + "orderedExactRate": 0.41237113402061853, + "setExact": 59, + "setExactRate": 0.6082474226804123, + "meanSetJaccard": 0.869170348551792, + "meanTokenWeightedTv": 0.03674592476159307, + "meanAggregateLoadTv": 0.06162775093934514 + }, + { + "layer": "layer_26", + "tokens": 97, + "orderedExact": 36, + "orderedExactRate": 0.3711340206185567, + "setExact": 48, + "setExactRate": 0.4948453608247423, + "meanSetJaccard": 0.8406971035837015, + "meanTokenWeightedTv": 0.040215058901216745, + "meanAggregateLoadTv": 0.08033078368223295 + } + ], + "period_at_s0": [ + { + "layer": "layer_01", + "tokens": 97, + "orderedExact": 38, + "orderedExactRate": 0.3917525773195876, + "setExact": 55, + "setExactRate": 0.5670103092783505, + "meanSetJaccard": 0.8630338733431517, + "meanTokenWeightedTv": 0.028516096813987035, + "meanAggregateLoadTv": 0.07800758185721952 + }, + { + "layer": "layer_02", + "tokens": 97, + "orderedExact": 55, + "orderedExactRate": 0.5670103092783505, + "setExact": 68, + "setExactRate": 0.7010309278350515, + "meanSetJaccard": 0.9145802650957291, + "meanTokenWeightedTv": 0.02739659756702864, + "meanAggregateLoadTv": 0.04793176328502415 + }, + { + "layer": "layer_03", + "tokens": 97, + "orderedExact": 56, + "orderedExactRate": 0.5773195876288659, + "setExact": 72, + "setExactRate": 0.7422680412371134, + "meanSetJaccard": 0.9219440353460974, + "meanTokenWeightedTv": 0.026289606558090758, + "meanAggregateLoadTv": 0.03752348362855609 + }, + { + "layer": "layer_04", + "tokens": 97, + "orderedExact": 51, + "orderedExactRate": 0.5257731958762887, + "setExact": 70, + "setExactRate": 0.7216494845360825, + "meanSetJaccard": 0.9182621502209133, + "meanTokenWeightedTv": 0.02818719694518744, + "meanAggregateLoadTv": 0.045851784755770265 + }, + { + "layer": "layer_05", + "tokens": 97, + "orderedExact": 49, + "orderedExactRate": 0.5051546391752577, + "setExact": 67, + "setExactRate": 0.6907216494845361, + "meanSetJaccard": 0.9094256259204714, + "meanTokenWeightedTv": 0.027599311797319493, + "meanAggregateLoadTv": 0.04785628019323671 + }, + { + "layer": "layer_06", + "tokens": 97, + "orderedExact": 50, + "orderedExactRate": 0.5154639175257731, + "setExact": 63, + "setExactRate": 0.6494845360824743, + "meanSetJaccard": 0.8976435935198822, + "meanTokenWeightedTv": 0.028789889310505735, + "meanAggregateLoadTv": 0.05325751476113795 + }, + { + "layer": "layer_07", + "tokens": 97, + "orderedExact": 45, + "orderedExactRate": 0.4639175257731959, + "setExact": 61, + "setExactRate": 0.6288659793814433, + "meanSetJaccard": 0.8895434462444772, + "meanTokenWeightedTv": 0.031166266255114816, + "meanAggregateLoadTv": 0.058457461084272674 + }, + { + "layer": "layer_08", + "tokens": 97, + "orderedExact": 41, + "orderedExactRate": 0.422680412371134, + "setExact": 57, + "setExactRate": 0.5876288659793815, + "meanSetJaccard": 0.8711340206185567, + "meanTokenWeightedTv": 0.03365115281961177, + "meanAggregateLoadTv": 0.06914251207729469 + }, + { + "layer": "layer_09", + "tokens": 97, + "orderedExact": 42, + "orderedExactRate": 0.4329896907216495, + "setExact": 66, + "setExactRate": 0.6804123711340206, + "meanSetJaccard": 0.8976435935198822, + "meanTokenWeightedTv": 0.027403419072407592, + "meanAggregateLoadTv": 0.05094269994632313 + }, + { + "layer": "layer_10", + "tokens": 97, + "orderedExact": 46, + "orderedExactRate": 0.4742268041237113, + "setExact": 64, + "setExactRate": 0.6597938144329897, + "meanSetJaccard": 0.8961708394698086, + "meanTokenWeightedTv": 0.03169639004213884, + "meanAggregateLoadTv": 0.05094269994632313 + }, + { + "layer": "layer_11", + "tokens": 97, + "orderedExact": 37, + "orderedExactRate": 0.38144329896907214, + "setExact": 52, + "setExactRate": 0.5360824742268041, + "meanSetJaccard": 0.8608247422680413, + "meanTokenWeightedTv": 0.02939792726123848, + "meanAggregateLoadTv": 0.05916196994095545 + }, + { + "layer": "layer_12", + "tokens": 97, + "orderedExact": 40, + "orderedExactRate": 0.41237113402061853, + "setExact": 59, + "setExactRate": 0.6082474226804123, + "meanSetJaccard": 0.8836524300441827, + "meanTokenWeightedTv": 0.02933247228041134, + "meanAggregateLoadTv": 0.04962593934514224 + }, + { + "layer": "layer_13", + "tokens": 97, + "orderedExact": 42, + "orderedExactRate": 0.4329896907216495, + "setExact": 61, + "setExactRate": 0.6288659793814433, + "meanSetJaccard": 0.8851251840942563, + "meanTokenWeightedTv": 0.027213157693204593, + "meanAggregateLoadTv": 0.05784520933977456 + }, + { + "layer": "layer_14", + "tokens": 97, + "orderedExact": 42, + "orderedExactRate": 0.4329896907216495, + "setExact": 66, + "setExactRate": 0.6804123711340206, + "meanSetJaccard": 0.9064801178203239, + "meanTokenWeightedTv": 0.02654060406307427, + "meanAggregateLoadTv": 0.04461889425657542 + }, + { + "layer": "layer_15", + "tokens": 97, + "orderedExact": 43, + "orderedExactRate": 0.44329896907216493, + "setExact": 54, + "setExactRate": 0.5567010309278351, + "meanSetJaccard": 0.8689248895434463, + "meanTokenWeightedTv": 0.03110457271510539, + "meanAggregateLoadTv": 0.06378321256038647 + }, + { + "layer": "layer_16", + "tokens": 97, + "orderedExact": 34, + "orderedExactRate": 0.35051546391752575, + "setExact": 54, + "setExactRate": 0.5567010309278351, + "meanSetJaccard": 0.8645066273932254, + "meanTokenWeightedTv": 0.03147214234716802, + "meanAggregateLoadTv": 0.0687986446591519 + }, + { + "layer": "layer_17", + "tokens": 97, + "orderedExact": 48, + "orderedExactRate": 0.4948453608247423, + "setExact": 60, + "setExactRate": 0.6185567010309279, + "meanSetJaccard": 0.8799705449189986, + "meanTokenWeightedTv": 0.03039923174790033, + "meanAggregateLoadTv": 0.05398718464841653 + }, + { + "layer": "layer_18", + "tokens": 97, + "orderedExact": 38, + "orderedExactRate": 0.3917525773195876, + "setExact": 55, + "setExactRate": 0.5670103092783505, + "meanSetJaccard": 0.8718703976435935, + "meanTokenWeightedTv": 0.031390662907286065, + "meanAggregateLoadTv": 0.06525093934514224 + }, + { + "layer": "layer_19", + "tokens": 97, + "orderedExact": 41, + "orderedExactRate": 0.422680412371134, + "setExact": 53, + "setExactRate": 0.5463917525773195, + "meanSetJaccard": 0.8576337751595483, + "meanTokenWeightedTv": 0.03128823289278769, + "meanAggregateLoadTv": 0.06474771873322598 + }, + { + "layer": "layer_20", + "tokens": 97, + "orderedExact": 46, + "orderedExactRate": 0.4742268041237113, + "setExact": 61, + "setExactRate": 0.6288659793814433, + "meanSetJaccard": 0.8873343151693669, + "meanTokenWeightedTv": 0.029767100700605044, + "meanAggregateLoadTv": 0.0524104267310789 + }, + { + "layer": "layer_21", + "tokens": 97, + "orderedExact": 37, + "orderedExactRate": 0.38144329896907214, + "setExact": 54, + "setExactRate": 0.5567010309278351, + "meanSetJaccard": 0.8711340206185567, + "meanTokenWeightedTv": 0.030521269388843312, + "meanAggregateLoadTv": 0.059849704777241004 + }, + { + "layer": "layer_22", + "tokens": 97, + "orderedExact": 44, + "orderedExactRate": 0.4536082474226804, + "setExact": 56, + "setExactRate": 0.5773195876288659, + "meanSetJaccard": 0.8726067746686305, + "meanTokenWeightedTv": 0.02962654252061748, + "meanAggregateLoadTv": 0.05333299785292539 + }, + { + "layer": "layer_23", + "tokens": 97, + "orderedExact": 37, + "orderedExactRate": 0.38144329896907214, + "setExact": 52, + "setExactRate": 0.5360824742268041, + "meanSetJaccard": 0.8551791850760924, + "meanTokenWeightedTv": 0.0327798600519307, + "meanAggregateLoadTv": 0.07512245034889962 + }, + { + "layer": "layer_24", + "tokens": 97, + "orderedExact": 48, + "orderedExactRate": 0.4948453608247423, + "setExact": 61, + "setExactRate": 0.6288659793814433, + "meanSetJaccard": 0.8895434462444771, + "meanTokenWeightedTv": 0.02544641529045156, + "meanAggregateLoadTv": 0.055882648953301126 + }, + { + "layer": "layer_25", + "tokens": 97, + "orderedExact": 43, + "orderedExactRate": 0.44329896907216493, + "setExact": 63, + "setExactRate": 0.6494845360824743, + "meanSetJaccard": 0.8910162002945509, + "meanTokenWeightedTv": 0.027558081779276933, + "meanAggregateLoadTv": 0.058348429951690824 + }, + { + "layer": "layer_26", + "tokens": 97, + "orderedExact": 41, + "orderedExactRate": 0.422680412371134, + "setExact": 55, + "setExactRate": 0.5670103092783505, + "meanSetJaccard": 0.859106529209622, + "meanTokenWeightedTv": 0.03226812630795256, + "meanAggregateLoadTv": 0.07362956253354805 + } + ], + "period_at_s1": [ + { + "layer": "layer_01", + "tokens": 97, + "orderedExact": 35, + "orderedExactRate": 0.36082474226804123, + "setExact": 48, + "setExactRate": 0.4948453608247423, + "meanSetJaccard": 0.833578792341679, + "meanTokenWeightedTv": 0.03464083635706032, + "meanAggregateLoadTv": 0.09905897745571658 + }, + { + "layer": "layer_02", + "tokens": 97, + "orderedExact": 53, + "orderedExactRate": 0.5463917525773195, + "setExact": 67, + "setExactRate": 0.6907216494845361, + "meanSetJaccard": 0.9072164948453608, + "meanTokenWeightedTv": 0.030791253081786082, + "meanAggregateLoadTv": 0.051253019323671496 + }, + { + "layer": "layer_03", + "tokens": 97, + "orderedExact": 57, + "orderedExactRate": 0.5876288659793815, + "setExact": 72, + "setExactRate": 0.7422680412371134, + "meanSetJaccard": 0.9197349042709868, + "meanTokenWeightedTv": 0.029386255355435986, + "meanAggregateLoadTv": 0.040484098228663445 + }, + { + "layer": "layer_04", + "tokens": 97, + "orderedExact": 39, + "orderedExactRate": 0.4020618556701031, + "setExact": 57, + "setExactRate": 0.5876288659793815, + "meanSetJaccard": 0.8799705449189986, + "meanTokenWeightedTv": 0.0390577309826035, + "meanAggregateLoadTv": 0.06312902576489533 + }, + { + "layer": "layer_05", + "tokens": 97, + "orderedExact": 43, + "orderedExactRate": 0.44329896907216493, + "setExact": 59, + "setExactRate": 0.6082474226804123, + "meanSetJaccard": 0.8880706921944035, + "meanTokenWeightedTv": 0.03311880171377153, + "meanAggregateLoadTv": 0.058306494900697795 + }, + { + "layer": "layer_06", + "tokens": 97, + "orderedExact": 43, + "orderedExactRate": 0.44329896907216493, + "setExact": 59, + "setExactRate": 0.6082474226804123, + "meanSetJaccard": 0.8836524300441827, + "meanTokenWeightedTv": 0.0326927344615353, + "meanAggregateLoadTv": 0.058272946859903384 + }, + { + "layer": "layer_07", + "tokens": 97, + "orderedExact": 40, + "orderedExactRate": 0.41237113402061853, + "setExact": 56, + "setExactRate": 0.5773195876288659, + "meanSetJaccard": 0.8739322533136966, + "meanTokenWeightedTv": 0.036166694589233286, + "meanAggregateLoadTv": 0.06204710144927537 + }, + { + "layer": "layer_08", + "tokens": 97, + "orderedExact": 41, + "orderedExactRate": 0.422680412371134, + "setExact": 63, + "setExactRate": 0.6494845360824743, + "meanSetJaccard": 0.8912170303922882, + "meanTokenWeightedTv": 0.03238274620707378, + "meanAggregateLoadTv": 0.055807165861513686 + }, + { + "layer": "layer_09", + "tokens": 97, + "orderedExact": 34, + "orderedExactRate": 0.35051546391752575, + "setExact": 54, + "setExactRate": 0.5567010309278351, + "meanSetJaccard": 0.8624983264158522, + "meanTokenWeightedTv": 0.03470962973320542, + "meanAggregateLoadTv": 0.0607806629092861 + }, + { + "layer": "layer_10", + "tokens": 97, + "orderedExact": 42, + "orderedExactRate": 0.4329896907216495, + "setExact": 57, + "setExactRate": 0.5876288659793815, + "meanSetJaccard": 0.8738340697103584, + "meanTokenWeightedTv": 0.03906709979296341, + "meanAggregateLoadTv": 0.06305354267310789 + }, + { + "layer": "layer_11", + "tokens": 97, + "orderedExact": 36, + "orderedExactRate": 0.3711340206185567, + "setExact": 50, + "setExactRate": 0.5154639175257731, + "meanSetJaccard": 0.8385861561119294, + "meanTokenWeightedTv": 0.03698931229222062, + "meanAggregateLoadTv": 0.07323537305421364 + }, + { + "layer": "layer_12", + "tokens": 97, + "orderedExact": 33, + "orderedExactRate": 0.3402061855670103, + "setExact": 54, + "setExactRate": 0.5567010309278351, + "meanSetJaccard": 0.8593519882179677, + "meanTokenWeightedTv": 0.03828914521357469, + "meanAggregateLoadTv": 0.06644189479334406 + }, + { + "layer": "layer_13", + "tokens": 97, + "orderedExact": 28, + "orderedExactRate": 0.28865979381443296, + "setExact": 46, + "setExactRate": 0.4742268041237113, + "meanSetJaccard": 0.8300977373142322, + "meanTokenWeightedTv": 0.03916138418563589, + "meanAggregateLoadTv": 0.07485406602254428 + }, + { + "layer": "layer_14", + "tokens": 97, + "orderedExact": 35, + "orderedExactRate": 0.36082474226804123, + "setExact": 49, + "setExactRate": 0.5051546391752577, + "meanSetJaccard": 0.8488954344624448, + "meanTokenWeightedTv": 0.04251573367333775, + "meanAggregateLoadTv": 0.07161668008588298 + }, + { + "layer": "layer_15", + "tokens": 97, + "orderedExact": 40, + "orderedExactRate": 0.41237113402061853, + "setExact": 48, + "setExactRate": 0.4948453608247423, + "meanSetJaccard": 0.8367697594501718, + "meanTokenWeightedTv": 0.04015490146170688, + "meanAggregateLoadTv": 0.07438439345142243 + }, + { + "layer": "layer_16", + "tokens": 97, + "orderedExact": 33, + "orderedExactRate": 0.3402061855670103, + "setExact": 44, + "setExactRate": 0.4536082474226804, + "meanSetJaccard": 0.8200785468826707, + "meanTokenWeightedTv": 0.04384629021832891, + "meanAggregateLoadTv": 0.09131776704240471 + }, + { + "layer": "layer_17", + "tokens": 97, + "orderedExact": 42, + "orderedExactRate": 0.4329896907216495, + "setExact": 58, + "setExactRate": 0.5979381443298969, + "meanSetJaccard": 0.8674521354933725, + "meanTokenWeightedTv": 0.03911649143961056, + "meanAggregateLoadTv": 0.07211151368760065 + }, + { + "layer": "layer_18", + "tokens": 97, + "orderedExact": 42, + "orderedExactRate": 0.4329896907216495, + "setExact": 49, + "setExactRate": 0.5051546391752577, + "meanSetJaccard": 0.8378497790868925, + "meanTokenWeightedTv": 0.04151129826234846, + "meanAggregateLoadTv": 0.08491847826086957 + }, + { + "layer": "layer_19", + "tokens": 97, + "orderedExact": 31, + "orderedExactRate": 0.31958762886597936, + "setExact": 49, + "setExactRate": 0.5051546391752577, + "meanSetJaccard": 0.8286696121747668, + "meanTokenWeightedTv": 0.041921697188558316, + "meanAggregateLoadTv": 0.07893853998926462 + }, + { + "layer": "layer_20", + "tokens": 97, + "orderedExact": 37, + "orderedExactRate": 0.38144329896907214, + "setExact": 49, + "setExactRate": 0.5051546391752577, + "meanSetJaccard": 0.8339224349533628, + "meanTokenWeightedTv": 0.04463669016851178, + "meanAggregateLoadTv": 0.07439278046162104 + }, + { + "layer": "layer_21", + "tokens": 97, + "orderedExact": 24, + "orderedExactRate": 0.24742268041237114, + "setExact": 41, + "setExactRate": 0.422680412371134, + "meanSetJaccard": 0.8081492390770741, + "meanTokenWeightedTv": 0.049068724698984725, + "meanAggregateLoadTv": 0.10399892646269457 + }, + { + "layer": "layer_22", + "tokens": 97, + "orderedExact": 33, + "orderedExactRate": 0.3402061855670103, + "setExact": 43, + "setExactRate": 0.44329896907216493, + "meanSetJaccard": 0.8201767304860089, + "meanTokenWeightedTv": 0.04692106390900193, + "meanAggregateLoadTv": 0.09047067901234568 + }, + { + "layer": "layer_23", + "tokens": 97, + "orderedExact": 28, + "orderedExactRate": 0.28865979381443296, + "setExact": 41, + "setExactRate": 0.422680412371134, + "meanSetJaccard": 0.8134511536573391, + "meanTokenWeightedTv": 0.043785801544047265, + "meanAggregateLoadTv": 0.09744867149758454 + }, + { + "layer": "layer_24", + "tokens": 97, + "orderedExact": 34, + "orderedExactRate": 0.35051546391752575, + "setExact": 51, + "setExactRate": 0.5257731958762887, + "meanSetJaccard": 0.8429062346588121, + "meanTokenWeightedTv": 0.03898948317493412, + "meanAggregateLoadTv": 0.07508890230810521 + }, + { + "layer": "layer_25", + "tokens": 97, + "orderedExact": 41, + "orderedExactRate": 0.422680412371134, + "setExact": 54, + "setExactRate": 0.5567010309278351, + "meanSetJaccard": 0.8588610702012764, + "meanTokenWeightedTv": 0.03999002695826165, + "meanAggregateLoadTv": 0.07253925120772947 + }, + { + "layer": "layer_26", + "tokens": 97, + "orderedExact": 34, + "orderedExactRate": 0.35051546391752575, + "setExact": 46, + "setExactRate": 0.4742268041237113, + "meanSetJaccard": 0.8321060382916053, + "meanTokenWeightedTv": 0.044460304072160485, + "meanAggregateLoadTv": 0.09125067096081588 + } + ] + }, + "code": { + "system_eos": [ + { + "layer": "layer_01", + "tokens": 436, + "orderedExact": 227, + "orderedExactRate": 0.5206422018348624, + "setExact": 278, + "setExactRate": 0.6376146788990825, + "meanSetJaccard": 0.8885430318916558, + "meanTokenWeightedTv": 0.01627564375481467, + "meanAggregateLoadTv": 0.05773776322220097 + }, + { + "layer": "layer_02", + "tokens": 436, + "orderedExact": 272, + "orderedExactRate": 0.6238532110091743, + "setExact": 324, + "setExactRate": 0.7431192660550459, + "meanSetJaccard": 0.9242573176059417, + "meanTokenWeightedTv": 0.013849336175056145, + "meanAggregateLoadTv": 0.03552490384819702 + }, + { + "layer": "layer_03", + "tokens": 436, + "orderedExact": 316, + "orderedExactRate": 0.7247706422018348, + "setExact": 357, + "setExactRate": 0.8188073394495413, + "meanSetJaccard": 0.9472477064220185, + "meanTokenWeightedTv": 0.011012405972687765, + "meanAggregateLoadTv": 0.024376341344212828 + }, + { + "layer": "layer_04", + "tokens": 436, + "orderedExact": 316, + "orderedExactRate": 0.7247706422018348, + "setExact": 360, + "setExactRate": 0.8256880733944955, + "meanSetJaccard": 0.949213630406291, + "meanTokenWeightedTv": 0.009556420794727348, + "meanAggregateLoadTv": 0.02150739200186991 + }, + { + "layer": "layer_05", + "tokens": 436, + "orderedExact": 307, + "orderedExactRate": 0.7041284403669725, + "setExact": 349, + "setExactRate": 0.8004587155963303, + "meanSetJaccard": 0.9424967234600262, + "meanTokenWeightedTv": 0.011405710005813346, + "meanAggregateLoadTv": 0.027656127154119123 + }, + { + "layer": "layer_06", + "tokens": 436, + "orderedExact": 309, + "orderedExactRate": 0.7087155963302753, + "setExact": 353, + "setExactRate": 0.8096330275229358, + "meanSetJaccard": 0.9446264744429883, + "meanTokenWeightedTv": 0.012164324714365678, + "meanAggregateLoadTv": 0.02605640817237203 + }, + { + "layer": "layer_07", + "tokens": 436, + "orderedExact": 299, + "orderedExactRate": 0.6857798165137615, + "setExact": 348, + "setExactRate": 0.7981651376146789, + "meanSetJaccard": 0.9413499344692006, + "meanTokenWeightedTv": 0.012956704655669305, + "meanAggregateLoadTv": 0.02607387220841036 + }, + { + "layer": "layer_08", + "tokens": 436, + "orderedExact": 286, + "orderedExactRate": 0.6559633027522935, + "setExact": 334, + "setExactRate": 0.7660550458715596, + "meanSetJaccard": 0.932175622542595, + "meanTokenWeightedTv": 0.01400287279704358, + "meanAggregateLoadTv": 0.029968883470389493 + }, + { + "layer": "layer_09", + "tokens": 436, + "orderedExact": 282, + "orderedExactRate": 0.6467889908256881, + "setExact": 339, + "setExactRate": 0.7775229357798165, + "meanSetJaccard": 0.9354521625163827, + "meanTokenWeightedTv": 0.014139556049411665, + "meanAggregateLoadTv": 0.028976819978326 + }, + { + "layer": "layer_10", + "tokens": 436, + "orderedExact": 289, + "orderedExactRate": 0.6628440366972477, + "setExact": 332, + "setExactRate": 0.7614678899082569, + "meanSetJaccard": 0.9293905635648755, + "meanTokenWeightedTv": 0.01466102707443314, + "meanAggregateLoadTv": 0.03296665497970719 + }, + { + "layer": "layer_11", + "tokens": 436, + "orderedExact": 265, + "orderedExactRate": 0.6077981651376146, + "setExact": 317, + "setExactRate": 0.7270642201834863, + "meanSetJaccard": 0.9185779816513762, + "meanTokenWeightedTv": 0.01656402020943362, + "meanAggregateLoadTv": 0.03455508542104928 + }, + { + "layer": "layer_12", + "tokens": 436, + "orderedExact": 261, + "orderedExactRate": 0.5986238532110092, + "setExact": 311, + "setExactRate": 0.713302752293578, + "meanSetJaccard": 0.9146461336828311, + "meanTokenWeightedTv": 0.018367807644465252, + "meanAggregateLoadTv": 0.03159635898089713 + }, + { + "layer": "layer_13", + "tokens": 436, + "orderedExact": 256, + "orderedExactRate": 0.5871559633027523, + "setExact": 318, + "setExactRate": 0.7293577981651376, + "meanSetJaccard": 0.9173765836609873, + "meanTokenWeightedTv": 0.017853625122255634, + "meanAggregateLoadTv": 0.03798872739635792 + }, + { + "layer": "layer_14", + "tokens": 436, + "orderedExact": 218, + "orderedExactRate": 0.5, + "setExact": 272, + "setExactRate": 0.6238532110091743, + "meanSetJaccard": 0.8871231979030144, + "meanTokenWeightedTv": 0.020834094008798706, + "meanAggregateLoadTv": 0.04558013801236692 + }, + { + "layer": "layer_15", + "tokens": 436, + "orderedExact": 215, + "orderedExactRate": 0.49311926605504586, + "setExact": 269, + "setExactRate": 0.6169724770642202, + "meanSetJaccard": 0.8849606815203146, + "meanTokenWeightedTv": 0.022182955420434736, + "meanAggregateLoadTv": 0.0466199453900257 + }, + { + "layer": "layer_16", + "tokens": 436, + "orderedExact": 216, + "orderedExactRate": 0.4954128440366973, + "setExact": 283, + "setExactRate": 0.6490825688073395, + "meanSetJaccard": 0.8896352118829183, + "meanTokenWeightedTv": 0.023356224936242117, + "meanAggregateLoadTv": 0.04309765517094834 + }, + { + "layer": "layer_17", + "tokens": 436, + "orderedExact": 228, + "orderedExactRate": 0.5229357798165137, + "setExact": 279, + "setExactRate": 0.6399082568807339, + "meanSetJaccard": 0.8879969418960245, + "meanTokenWeightedTv": 0.02379856369693953, + "meanAggregateLoadTv": 0.0485629688064427 + }, + { + "layer": "layer_18", + "tokens": 436, + "orderedExact": 209, + "orderedExactRate": 0.4793577981651376, + "setExact": 270, + "setExactRate": 0.6192660550458715, + "meanSetJaccard": 0.8825906509392749, + "meanTokenWeightedTv": 0.024824676396220824, + "meanAggregateLoadTv": 0.04223142570281124 + }, + { + "layer": "layer_19", + "tokens": 436, + "orderedExact": 205, + "orderedExactRate": 0.4701834862385321, + "setExact": 266, + "setExactRate": 0.6100917431192661, + "meanSetJaccard": 0.8819353429445173, + "meanTokenWeightedTv": 0.02405222292135936, + "meanAggregateLoadTv": 0.04177238052740061 + }, + { + "layer": "layer_20", + "tokens": 436, + "orderedExact": 204, + "orderedExactRate": 0.46788990825688076, + "setExact": 266, + "setExactRate": 0.6100917431192661, + "meanSetJaccard": 0.8776212319790302, + "meanTokenWeightedTv": 0.02382663553142461, + "meanAggregateLoadTv": 0.04784096704277427 + }, + { + "layer": "layer_21", + "tokens": 436, + "orderedExact": 190, + "orderedExactRate": 0.43577981651376146, + "setExact": 257, + "setExactRate": 0.5894495412844036, + "meanSetJaccard": 0.8710135430318918, + "meanTokenWeightedTv": 0.023735314341153307, + "meanAggregateLoadTv": 0.04482573149741824 + }, + { + "layer": "layer_22", + "tokens": 436, + "orderedExact": 199, + "orderedExactRate": 0.45642201834862384, + "setExact": 254, + "setExactRate": 0.5825688073394495, + "meanSetJaccard": 0.8682503276539975, + "meanTokenWeightedTv": 0.02553942991454251, + "meanAggregateLoadTv": 0.049394735024755096 + }, + { + "layer": "layer_23", + "tokens": 436, + "orderedExact": 209, + "orderedExactRate": 0.4793577981651376, + "setExact": 279, + "setExactRate": 0.6399082568807339, + "meanSetJaccard": 0.8902359108781128, + "meanTokenWeightedTv": 0.022982943021282273, + "meanAggregateLoadTv": 0.047239752661439406 + }, + { + "layer": "layer_24", + "tokens": 436, + "orderedExact": 155, + "orderedExactRate": 0.3555045871559633, + "setExact": 215, + "setExactRate": 0.49311926605504586, + "meanSetJaccard": 0.8402686762778506, + "meanTokenWeightedTv": 0.02711247473225036, + "meanAggregateLoadTv": 0.05458381143622107 + }, + { + "layer": "layer_25", + "tokens": 436, + "orderedExact": 200, + "orderedExactRate": 0.45871559633027525, + "setExact": 258, + "setExactRate": 0.591743119266055, + "meanSetJaccard": 0.869724770642202, + "meanTokenWeightedTv": 0.02643646380175685, + "meanAggregateLoadTv": 0.05271861254541977 + }, + { + "layer": "layer_26", + "tokens": 436, + "orderedExact": 206, + "orderedExactRate": 0.4724770642201835, + "setExact": 255, + "setExactRate": 0.5848623853211009, + "meanSetJaccard": 0.8683595456531237, + "meanTokenWeightedTv": 0.02546590735273304, + "meanAggregateLoadTv": 0.04578406217462442 + } + ], + "system_bos": [ + { + "layer": "layer_01", + "tokens": 436, + "orderedExact": 221, + "orderedExactRate": 0.5068807339449541, + "setExact": 272, + "setExactRate": 0.6238532110091743, + "meanSetJaccard": 0.8866317169069462, + "meanTokenWeightedTv": 0.017378780399586905, + "meanAggregateLoadTv": 0.056051720107945 + }, + { + "layer": "layer_02", + "tokens": 436, + "orderedExact": 234, + "orderedExactRate": 0.536697247706422, + "setExact": 296, + "setExactRate": 0.6788990825688074, + "meanSetJaccard": 0.9014853647881171, + "meanTokenWeightedTv": 0.019321468626097127, + "meanAggregateLoadTv": 0.042405269225048337 + }, + { + "layer": "layer_03", + "tokens": 436, + "orderedExact": 278, + "orderedExactRate": 0.6376146788990825, + "setExact": 321, + "setExactRate": 0.7362385321100917, + "meanSetJaccard": 0.9231651376146789, + "meanTokenWeightedTv": 0.016152954205759296, + "meanAggregateLoadTv": 0.03362690178704235 + }, + { + "layer": "layer_04", + "tokens": 436, + "orderedExact": 247, + "orderedExactRate": 0.5665137614678899, + "setExact": 301, + "setExactRate": 0.6903669724770642, + "meanSetJaccard": 0.908584534731324, + "meanTokenWeightedTv": 0.01685840317797318, + "meanAggregateLoadTv": 0.03935032457873823 + }, + { + "layer": "layer_05", + "tokens": 436, + "orderedExact": 277, + "orderedExactRate": 0.6353211009174312, + "setExact": 325, + "setExactRate": 0.7454128440366973, + "meanSetJaccard": 0.925294888597641, + "meanTokenWeightedTv": 0.0157294184287894, + "meanAggregateLoadTv": 0.02872833928305816 + }, + { + "layer": "layer_06", + "tokens": 436, + "orderedExact": 255, + "orderedExactRate": 0.5848623853211009, + "setExact": 315, + "setExactRate": 0.7224770642201835, + "meanSetJaccard": 0.917267365661861, + "meanTokenWeightedTv": 0.017422517444706437, + "meanAggregateLoadTv": 0.037087636259323 + }, + { + "layer": "layer_07", + "tokens": 436, + "orderedExact": 260, + "orderedExactRate": 0.5963302752293578, + "setExact": 323, + "setExactRate": 0.7408256880733946, + "meanSetJaccard": 0.9234927916120578, + "meanTokenWeightedTv": 0.018033779960667073, + "meanAggregateLoadTv": 0.0380998863177578 + }, + { + "layer": "layer_08", + "tokens": 436, + "orderedExact": 259, + "orderedExactRate": 0.5940366972477065, + "setExact": 318, + "setExactRate": 0.7293577981651376, + "meanSetJaccard": 0.92021625163827, + "meanTokenWeightedTv": 0.01665615482197813, + "meanAggregateLoadTv": 0.03319262499734387 + }, + { + "layer": "layer_09", + "tokens": 436, + "orderedExact": 267, + "orderedExactRate": 0.6123853211009175, + "setExact": 320, + "setExactRate": 0.7339449541284404, + "meanSetJaccard": 0.9230013106159897, + "meanTokenWeightedTv": 0.017467403105996537, + "meanAggregateLoadTv": 0.029882293725165206 + }, + { + "layer": "layer_10", + "tokens": 436, + "orderedExact": 261, + "orderedExactRate": 0.5986238532110092, + "setExact": 312, + "setExactRate": 0.7155963302752294, + "meanSetJaccard": 0.9153014416775884, + "meanTokenWeightedTv": 0.01854807786212738, + "meanAggregateLoadTv": 0.033112476360468324 + }, + { + "layer": "layer_11", + "tokens": 436, + "orderedExact": 261, + "orderedExactRate": 0.5986238532110092, + "setExact": 310, + "setExactRate": 0.7110091743119266, + "meanSetJaccard": 0.912516382699869, + "meanTokenWeightedTv": 0.017621606697550415, + "meanAggregateLoadTv": 0.03568427147744417 + }, + { + "layer": "layer_12", + "tokens": 436, + "orderedExact": 253, + "orderedExactRate": 0.5802752293577982, + "setExact": 321, + "setExactRate": 0.7362385321100917, + "meanSetJaccard": 0.9211992136304064, + "meanTokenWeightedTv": 0.018649103591445858, + "meanAggregateLoadTv": 0.03403541414334587 + }, + { + "layer": "layer_13", + "tokens": 436, + "orderedExact": 217, + "orderedExactRate": 0.49770642201834864, + "setExact": 290, + "setExactRate": 0.6651376146788991, + "meanSetJaccard": 0.8989187418086501, + "meanTokenWeightedTv": 0.020437384647043214, + "meanAggregateLoadTv": 0.03979628832791483 + }, + { + "layer": "layer_14", + "tokens": 436, + "orderedExact": 222, + "orderedExactRate": 0.5091743119266054, + "setExact": 277, + "setExactRate": 0.6353211009174312, + "meanSetJaccard": 0.8854849279161205, + "meanTokenWeightedTv": 0.02256875323289794, + "meanAggregateLoadTv": 0.040824873568347464 + }, + { + "layer": "layer_15", + "tokens": 436, + "orderedExact": 201, + "orderedExactRate": 0.4610091743119266, + "setExact": 268, + "setExactRate": 0.6146788990825688, + "meanSetJaccard": 0.881389252948886, + "meanTokenWeightedTv": 0.024558003834183995, + "meanAggregateLoadTv": 0.04816913155266569 + }, + { + "layer": "layer_16", + "tokens": 436, + "orderedExact": 207, + "orderedExactRate": 0.47477064220183485, + "setExact": 269, + "setExactRate": 0.6169724770642202, + "meanSetJaccard": 0.8798602009611185, + "meanTokenWeightedTv": 0.025437567441946893, + "meanAggregateLoadTv": 0.04412371709058456 + }, + { + "layer": "layer_17", + "tokens": 436, + "orderedExact": 193, + "orderedExactRate": 0.4426605504587156, + "setExact": 261, + "setExactRate": 0.5986238532110092, + "meanSetJaccard": 0.8726518130187855, + "meanTokenWeightedTv": 0.026431989296746658, + "meanAggregateLoadTv": 0.046512239433926184 + }, + { + "layer": "layer_18", + "tokens": 436, + "orderedExact": 196, + "orderedExactRate": 0.44954128440366975, + "setExact": 255, + "setExactRate": 0.5848623853211009, + "meanSetJaccard": 0.8700851900393185, + "meanTokenWeightedTv": 0.02644362488503831, + "meanAggregateLoadTv": 0.04557163840547375 + }, + { + "layer": "layer_19", + "tokens": 436, + "orderedExact": 194, + "orderedExactRate": 0.44495412844036697, + "setExact": 248, + "setExactRate": 0.5688073394495413, + "meanSetJaccard": 0.8646242900830057, + "meanTokenWeightedTv": 0.02777137854361721, + "meanAggregateLoadTv": 0.04483469592656339 + }, + { + "layer": "layer_20", + "tokens": 436, + "orderedExact": 192, + "orderedExactRate": 0.44036697247706424, + "setExact": 254, + "setExactRate": 0.5825688073394495, + "meanSetJaccard": 0.8710135430318918, + "meanTokenWeightedTv": 0.025006142527545912, + "meanAggregateLoadTv": 0.046803417373196494 + }, + { + "layer": "layer_21", + "tokens": 436, + "orderedExact": 171, + "orderedExactRate": 0.3922018348623853, + "setExact": 242, + "setExactRate": 0.555045871559633, + "meanSetJaccard": 0.8583442551332461, + "meanTokenWeightedTv": 0.026782221860707264, + "meanAggregateLoadTv": 0.050023307515777396 + }, + { + "layer": "layer_22", + "tokens": 436, + "orderedExact": 167, + "orderedExactRate": 0.3830275229357798, + "setExact": 224, + "setExactRate": 0.5137614678899083, + "meanSetJaccard": 0.8486238532110092, + "meanTokenWeightedTv": 0.028459195258319542, + "meanAggregateLoadTv": 0.050129619005121015 + }, + { + "layer": "layer_23", + "tokens": 436, + "orderedExact": 167, + "orderedExactRate": 0.3830275229357798, + "setExact": 236, + "setExactRate": 0.5412844036697247, + "meanSetJaccard": 0.8578527741371778, + "meanTokenWeightedTv": 0.02685247251001552, + "meanAggregateLoadTv": 0.049870580204415545 + }, + { + "layer": "layer_24", + "tokens": 436, + "orderedExact": 143, + "orderedExactRate": 0.32798165137614677, + "setExact": 209, + "setExactRate": 0.4793577981651376, + "meanSetJaccard": 0.8339886413280908, + "meanTokenWeightedTv": 0.02782748583990869, + "meanAggregateLoadTv": 0.05696589267121396 + }, + { + "layer": "layer_25", + "tokens": 436, + "orderedExact": 195, + "orderedExactRate": 0.44724770642201833, + "setExact": 255, + "setExactRate": 0.5848623853211009, + "meanSetJaccard": 0.8713958060288336, + "meanTokenWeightedTv": 0.024434078319289038, + "meanAggregateLoadTv": 0.04892951435371114 + }, + { + "layer": "layer_26", + "tokens": 436, + "orderedExact": 191, + "orderedExactRate": 0.4380733944954128, + "setExact": 254, + "setExactRate": 0.5825688073394495, + "meanSetJaccard": 0.8724879860200961, + "meanTokenWeightedTv": 0.023300060069739434, + "meanAggregateLoadTv": 0.04526459010645757 + } + ], + "system_x": [ + { + "layer": "layer_01", + "tokens": 436, + "orderedExact": 206, + "orderedExactRate": 0.4724770642201835, + "setExact": 257, + "setExactRate": 0.5894495412844036, + "meanSetJaccard": 0.8739624290083006, + "meanTokenWeightedTv": 0.020610971715792972, + "meanAggregateLoadTv": 0.061363642400288985 + }, + { + "layer": "layer_02", + "tokens": 436, + "orderedExact": 219, + "orderedExactRate": 0.5022935779816514, + "setExact": 284, + "setExactRate": 0.6513761467889908, + "meanSetJaccard": 0.8927479248580167, + "meanTokenWeightedTv": 0.021133389436719503, + "meanAggregateLoadTv": 0.04729187915683899 + }, + { + "layer": "layer_03", + "tokens": 436, + "orderedExact": 246, + "orderedExactRate": 0.5642201834862385, + "setExact": 298, + "setExactRate": 0.6834862385321101, + "meanSetJaccard": 0.9056356487549149, + "meanTokenWeightedTv": 0.0196474081930674, + "meanAggregateLoadTv": 0.03748585612290431 + }, + { + "layer": "layer_04", + "tokens": 436, + "orderedExact": 241, + "orderedExactRate": 0.5527522935779816, + "setExact": 305, + "setExactRate": 0.6995412844036697, + "meanSetJaccard": 0.9097313237221495, + "meanTokenWeightedTv": 0.017887300413071395, + "meanAggregateLoadTv": 0.04152688797518114 + }, + { + "layer": "layer_05", + "tokens": 436, + "orderedExact": 254, + "orderedExactRate": 0.5825688073394495, + "setExact": 306, + "setExactRate": 0.7018348623853211, + "meanSetJaccard": 0.9109873307121014, + "meanTokenWeightedTv": 0.018271055306684256, + "meanAggregateLoadTv": 0.033888463908544234 + }, + { + "layer": "layer_06", + "tokens": 436, + "orderedExact": 227, + "orderedExactRate": 0.5206422018348624, + "setExact": 294, + "setExactRate": 0.6743119266055045, + "meanSetJaccard": 0.9010484927916121, + "meanTokenWeightedTv": 0.02129895343323416, + "meanAggregateLoadTv": 0.043622173880708014 + }, + { + "layer": "layer_07", + "tokens": 436, + "orderedExact": 245, + "orderedExactRate": 0.5619266055045872, + "setExact": 300, + "setExactRate": 0.6880733944954128, + "meanSetJaccard": 0.9079292267365663, + "meanTokenWeightedTv": 0.021425218684516873, + "meanAggregateLoadTv": 0.039220107945007535 + }, + { + "layer": "layer_08", + "tokens": 436, + "orderedExact": 214, + "orderedExactRate": 0.4908256880733945, + "setExact": 274, + "setExactRate": 0.6284403669724771, + "meanSetJaccard": 0.889525993883792, + "meanTokenWeightedTv": 0.0221992742454806, + "meanAggregateLoadTv": 0.0433911572214785 + }, + { + "layer": "layer_09", + "tokens": 436, + "orderedExact": 231, + "orderedExactRate": 0.5298165137614679, + "setExact": 305, + "setExactRate": 0.6995412844036697, + "meanSetJaccard": 0.9102228047182176, + "meanTokenWeightedTv": 0.021675910241083694, + "meanAggregateLoadTv": 0.033084919041244346 + }, + { + "layer": "layer_10", + "tokens": 436, + "orderedExact": 227, + "orderedExactRate": 0.5206422018348624, + "setExact": 281, + "setExactRate": 0.6444954128440367, + "meanSetJaccard": 0.8906727828746178, + "meanTokenWeightedTv": 0.0241446166251766, + "meanAggregateLoadTv": 0.04125636142453411 + }, + { + "layer": "layer_11", + "tokens": 436, + "orderedExact": 218, + "orderedExactRate": 0.5, + "setExact": 285, + "setExactRate": 0.6536697247706422, + "meanSetJaccard": 0.8918195718654435, + "meanTokenWeightedTv": 0.02255987441139035, + "meanAggregateLoadTv": 0.04137555513057521 + }, + { + "layer": "layer_12", + "tokens": 436, + "orderedExact": 212, + "orderedExactRate": 0.48623853211009177, + "setExact": 263, + "setExactRate": 0.6032110091743119, + "meanSetJaccard": 0.8802424639580604, + "meanTokenWeightedTv": 0.026027457539674746, + "meanAggregateLoadTv": 0.04322973109368691 + }, + { + "layer": "layer_13", + "tokens": 436, + "orderedExact": 193, + "orderedExactRate": 0.4426605504587156, + "setExact": 264, + "setExactRate": 0.6055045871559633, + "meanSetJaccard": 0.8748034076015727, + "meanTokenWeightedTv": 0.026642426887226688, + "meanAggregateLoadTv": 0.042116149784322474 + }, + { + "layer": "layer_14", + "tokens": 436, + "orderedExact": 198, + "orderedExactRate": 0.4541284403669725, + "setExact": 251, + "setExactRate": 0.5756880733944955, + "meanSetJaccard": 0.8669724770642202, + "meanTokenWeightedTv": 0.028570618132499608, + "meanAggregateLoadTv": 0.04881649614330337 + }, + { + "layer": "layer_15", + "tokens": 436, + "orderedExact": 184, + "orderedExactRate": 0.42201834862385323, + "setExact": 248, + "setExactRate": 0.5688073394495413, + "meanSetJaccard": 0.86347750109218, + "meanTokenWeightedTv": 0.03016409385755971, + "meanAggregateLoadTv": 0.051443870720979154 + }, + { + "layer": "layer_16", + "tokens": 436, + "orderedExact": 175, + "orderedExactRate": 0.4013761467889908, + "setExact": 235, + "setExactRate": 0.5389908256880734, + "meanSetJaccard": 0.8454565312363477, + "meanTokenWeightedTv": 0.035530502595282044, + "meanAggregateLoadTv": 0.055410066190688674 + }, + { + "layer": "layer_17", + "tokens": 436, + "orderedExact": 166, + "orderedExactRate": 0.38073394495412843, + "setExact": 231, + "setExactRate": 0.5298165137614679, + "meanSetJaccard": 0.8448558322411535, + "meanTokenWeightedTv": 0.03484403362413665, + "meanAggregateLoadTv": 0.0567082483372644 + }, + { + "layer": "layer_18", + "tokens": 436, + "orderedExact": 153, + "orderedExactRate": 0.35091743119266056, + "setExact": 222, + "setExactRate": 0.5091743119266054, + "meanSetJaccard": 0.8418195718654433, + "meanTokenWeightedTv": 0.03546955708308661, + "meanAggregateLoadTv": 0.05733403189477486 + }, + { + "layer": "layer_19", + "tokens": 436, + "orderedExact": 153, + "orderedExactRate": 0.35091743119266056, + "setExact": 212, + "setExactRate": 0.48623853211009177, + "meanSetJaccard": 0.8300567933595457, + "meanTokenWeightedTv": 0.03607520013722725, + "meanAggregateLoadTv": 0.05801745341152971 + }, + { + "layer": "layer_20", + "tokens": 436, + "orderedExact": 135, + "orderedExactRate": 0.30963302752293576, + "setExact": 209, + "setExactRate": 0.4793577981651376, + "meanSetJaccard": 0.8226518130187856, + "meanTokenWeightedTv": 0.038564325338455656, + "meanAggregateLoadTv": 0.06680870306623318 + }, + { + "layer": "layer_21", + "tokens": 436, + "orderedExact": 126, + "orderedExactRate": 0.2889908256880734, + "setExact": 192, + "setExactRate": 0.44036697247706424, + "meanSetJaccard": 0.8115115771079073, + "meanTokenWeightedTv": 0.03764259318477259, + "meanAggregateLoadTv": 0.06375787541701196 + }, + { + "layer": "layer_22", + "tokens": 436, + "orderedExact": 134, + "orderedExactRate": 0.3073394495412844, + "setExact": 186, + "setExactRate": 0.42660550458715596, + "meanSetJaccard": 0.8137287024901704, + "meanTokenWeightedTv": 0.038952032840585404, + "meanAggregateLoadTv": 0.06561318023416417 + }, + { + "layer": "layer_23", + "tokens": 436, + "orderedExact": 122, + "orderedExactRate": 0.2798165137614679, + "setExact": 192, + "setExactRate": 0.44036697247706424, + "meanSetJaccard": 0.8120358235037134, + "meanTokenWeightedTv": 0.03828486067892433, + "meanAggregateLoadTv": 0.060333861902637 + }, + { + "layer": "layer_24", + "tokens": 436, + "orderedExact": 104, + "orderedExactRate": 0.23853211009174313, + "setExact": 170, + "setExactRate": 0.38990825688073394, + "meanSetJaccard": 0.7954783748361729, + "meanTokenWeightedTv": 0.03805825534433327, + "meanAggregateLoadTv": 0.06384054737468392 + }, + { + "layer": "layer_25", + "tokens": 436, + "orderedExact": 150, + "orderedExactRate": 0.3440366972477064, + "setExact": 206, + "setExactRate": 0.4724770642201835, + "meanSetJaccard": 0.8312581913499345, + "meanTokenWeightedTv": 0.03530299082881115, + "meanAggregateLoadTv": 0.05631945772508021 + }, + { + "layer": "layer_26", + "tokens": 436, + "orderedExact": 149, + "orderedExactRate": 0.34174311926605505, + "setExact": 218, + "setExactRate": 0.5, + "meanSetJaccard": 0.8401813018785497, + "meanTokenWeightedTv": 0.034069269118719714, + "meanAggregateLoadTv": 0.05559699113915981 + } + ], + "system_period": [ + { + "layer": "layer_01", + "tokens": 436, + "orderedExact": 208, + "orderedExactRate": 0.47706422018348627, + "setExact": 263, + "setExactRate": 0.6032110091743119, + "meanSetJaccard": 0.8793687199650503, + "meanTokenWeightedTv": 0.01993405541724769, + "meanAggregateLoadTv": 0.059985776439089686 + }, + { + "layer": "layer_02", + "tokens": 436, + "orderedExact": 220, + "orderedExactRate": 0.5045871559633027, + "setExact": 281, + "setExactRate": 0.6444954128440367, + "meanSetJaccard": 0.8905089558759284, + "meanTokenWeightedTv": 0.021373305073660972, + "meanAggregateLoadTv": 0.047592486347506416 + }, + { + "layer": "layer_03", + "tokens": 436, + "orderedExact": 252, + "orderedExactRate": 0.5779816513761468, + "setExact": 306, + "setExactRate": 0.7018348623853211, + "meanSetJaccard": 0.9123525557011797, + "meanTokenWeightedTv": 0.018679140629814694, + "meanAggregateLoadTv": 0.035410557574212194 + }, + { + "layer": "layer_04", + "tokens": 436, + "orderedExact": 244, + "orderedExactRate": 0.5596330275229358, + "setExact": 305, + "setExactRate": 0.6995412844036697, + "meanSetJaccard": 0.9097313237221495, + "meanTokenWeightedTv": 0.018104245986400834, + "meanAggregateLoadTv": 0.04191222562206498 + }, + { + "layer": "layer_05", + "tokens": 436, + "orderedExact": 245, + "orderedExactRate": 0.5619266055045872, + "setExact": 299, + "setExactRate": 0.6857798165137615, + "meanSetJaccard": 0.9062909567496725, + "meanTokenWeightedTv": 0.019428581638060147, + "meanAggregateLoadTv": 0.03638608667474129 + }, + { + "layer": "layer_06", + "tokens": 436, + "orderedExact": 232, + "orderedExactRate": 0.5321100917431193, + "setExact": 293, + "setExactRate": 0.6720183486238532, + "meanSetJaccard": 0.9023591087811271, + "meanTokenWeightedTv": 0.02103372465522698, + "meanAggregateLoadTv": 0.04210054503729203 + }, + { + "layer": "layer_07", + "tokens": 436, + "orderedExact": 245, + "orderedExactRate": 0.5619266055045872, + "setExact": 310, + "setExactRate": 0.7110091743119266, + "meanSetJaccard": 0.9164482306684143, + "meanTokenWeightedTv": 0.020540520753017807, + "meanAggregateLoadTv": 0.029940396506661568 + }, + { + "layer": "layer_08", + "tokens": 436, + "orderedExact": 234, + "orderedExactRate": 0.536697247706422, + "setExact": 282, + "setExactRate": 0.6467889908256881, + "meanSetJaccard": 0.8956422018348624, + "meanTokenWeightedTv": 0.02218894788546941, + "meanAggregateLoadTv": 0.04435128078451371 + }, + { + "layer": "layer_09", + "tokens": 436, + "orderedExact": 243, + "orderedExactRate": 0.5573394495412844, + "setExact": 310, + "setExactRate": 0.7110091743119266, + "meanSetJaccard": 0.9144823066841417, + "meanTokenWeightedTv": 0.020879952407665277, + "meanAggregateLoadTv": 0.03563672680138544 + }, + { + "layer": "layer_10", + "tokens": 436, + "orderedExact": 235, + "orderedExactRate": 0.5389908256880734, + "setExact": 293, + "setExactRate": 0.6720183486238532, + "meanSetJaccard": 0.901485364788117, + "meanTokenWeightedTv": 0.0224011521546207, + "meanAggregateLoadTv": 0.0386448572066042 + }, + { + "layer": "layer_11", + "tokens": 436, + "orderedExact": 219, + "orderedExactRate": 0.5022935779816514, + "setExact": 278, + "setExactRate": 0.6376146788990825, + "meanSetJaccard": 0.8900720838794233, + "meanTokenWeightedTv": 0.022633385619800425, + "meanAggregateLoadTv": 0.04359023395167973 + }, + { + "layer": "layer_12", + "tokens": 436, + "orderedExact": 233, + "orderedExactRate": 0.5344036697247706, + "setExact": 288, + "setExactRate": 0.6605504587155964, + "meanSetJaccard": 0.8987003058103975, + "meanTokenWeightedTv": 0.024118931550229233, + "meanAggregateLoadTv": 0.03621728979409702 + }, + { + "layer": "layer_13", + "tokens": 436, + "orderedExact": 185, + "orderedExactRate": 0.4243119266055046, + "setExact": 253, + "setExactRate": 0.5802752293577982, + "meanSetJaccard": 0.8679008300567934, + "meanTokenWeightedTv": 0.028025087020332254, + "meanAggregateLoadTv": 0.04055687033849685 + }, + { + "layer": "layer_14", + "tokens": 436, + "orderedExact": 191, + "orderedExactRate": 0.4380733944954128, + "setExact": 259, + "setExactRate": 0.5940366972477065, + "meanSetJaccard": 0.8697575360419397, + "meanTokenWeightedTv": 0.027841565740838715, + "meanAggregateLoadTv": 0.04760603259599243 + }, + { + "layer": "layer_15", + "tokens": 436, + "orderedExact": 167, + "orderedExactRate": 0.3830275229357798, + "setExact": 236, + "setExactRate": 0.5412844036697247, + "meanSetJaccard": 0.8497160332022717, + "meanTokenWeightedTv": 0.030829298993492342, + "meanAggregateLoadTv": 0.051992028962410494 + }, + { + "layer": "layer_16", + "tokens": 436, + "orderedExact": 173, + "orderedExactRate": 0.3967889908256881, + "setExact": 238, + "setExactRate": 0.5458715596330275, + "meanSetJaccard": 0.8518894713848841, + "meanTokenWeightedTv": 0.033890231558438406, + "meanAggregateLoadTv": 0.05701642549032107 + }, + { + "layer": "layer_17", + "tokens": 436, + "orderedExact": 172, + "orderedExactRate": 0.3944954128440367, + "setExact": 229, + "setExactRate": 0.5252293577981652, + "meanSetJaccard": 0.8484054172127565, + "meanTokenWeightedTv": 0.03347591920056733, + "meanAggregateLoadTv": 0.05189534593400055 + }, + { + "layer": "layer_18", + "tokens": 436, + "orderedExact": 154, + "orderedExactRate": 0.3532110091743119, + "setExact": 218, + "setExactRate": 0.5, + "meanSetJaccard": 0.8364460463084317, + "meanTokenWeightedTv": 0.035428992899104936, + "meanAggregateLoadTv": 0.0672560612821657 + }, + { + "layer": "layer_19", + "tokens": 436, + "orderedExact": 141, + "orderedExactRate": 0.32339449541284404, + "setExact": 211, + "setExactRate": 0.48394495412844035, + "meanSetJaccard": 0.8297509829619921, + "meanTokenWeightedTv": 0.035168531190230966, + "meanAggregateLoadTv": 0.057373076963940416 + }, + { + "layer": "layer_20", + "tokens": 436, + "orderedExact": 130, + "orderedExactRate": 0.2981651376146789, + "setExact": 205, + "setExactRate": 0.4701834862385321, + "meanSetJaccard": 0.8286369593709042, + "meanTokenWeightedTv": 0.03659581329417411, + "meanAggregateLoadTv": 0.061294915110176144 + }, + { + "layer": "layer_21", + "tokens": 436, + "orderedExact": 131, + "orderedExactRate": 0.30045871559633025, + "setExact": 192, + "setExactRate": 0.44036697247706424, + "meanSetJaccard": 0.8083660987330713, + "meanTokenWeightedTv": 0.03815571934874936, + "meanAggregateLoadTv": 0.06268015182422812 + }, + { + "layer": "layer_22", + "tokens": 436, + "orderedExact": 131, + "orderedExactRate": 0.30045871559633025, + "setExact": 190, + "setExactRate": 0.43577981651376146, + "meanSetJaccard": 0.8140563564875491, + "meanTokenWeightedTv": 0.039397097308757525, + "meanAggregateLoadTv": 0.0658455913601496 + }, + { + "layer": "layer_23", + "tokens": 436, + "orderedExact": 146, + "orderedExactRate": 0.3348623853211009, + "setExact": 209, + "setExactRate": 0.4793577981651376, + "meanSetJaccard": 0.8292595019659239, + "meanTokenWeightedTv": 0.03496019131068906, + "meanAggregateLoadTv": 0.06122147319436476 + }, + { + "layer": "layer_24", + "tokens": 436, + "orderedExact": 108, + "orderedExactRate": 0.24770642201834864, + "setExact": 175, + "setExactRate": 0.4013761467889908, + "meanSetJaccard": 0.7853320227173438, + "meanTokenWeightedTv": 0.03994640537139375, + "meanAggregateLoadTv": 0.06846765368351714 + }, + { + "layer": "layer_25", + "tokens": 436, + "orderedExact": 154, + "orderedExactRate": 0.3532110091743119, + "setExact": 218, + "setExactRate": 0.5, + "meanSetJaccard": 0.8369375273044999, + "meanTokenWeightedTv": 0.03441458560219232, + "meanAggregateLoadTv": 0.06121709058456046 + }, + { + "layer": "layer_26", + "tokens": 436, + "orderedExact": 129, + "orderedExactRate": 0.2958715596330275, + "setExact": 209, + "setExactRate": 0.4793577981651376, + "meanSetJaccard": 0.8342616863259067, + "meanTokenWeightedTv": 0.03368756370353782, + "meanAggregateLoadTv": 0.05781698221457258 + } + ], + "bos_at_s0": [ + { + "layer": "layer_01", + "tokens": 436, + "orderedExact": 148, + "orderedExactRate": 0.3394495412844037, + "setExact": 191, + "setExactRate": 0.4380733944954128, + "meanSetJaccard": 0.797346002621232, + "meanTokenWeightedTv": 0.03139132929121752, + "meanAggregateLoadTv": 0.10909272008669599 + }, + { + "layer": "layer_02", + "tokens": 436, + "orderedExact": 167, + "orderedExactRate": 0.3830275229357798, + "setExact": 225, + "setExactRate": 0.5160550458715596, + "meanSetJaccard": 0.8409239842726081, + "meanTokenWeightedTv": 0.0307258715422224, + "meanAggregateLoadTv": 0.06952220256688127 + }, + { + "layer": "layer_03", + "tokens": 436, + "orderedExact": 219, + "orderedExactRate": 0.5022935779816514, + "setExact": 276, + "setExactRate": 0.6330275229357798, + "meanSetJaccard": 0.8922018348623854, + "meanTokenWeightedTv": 0.023166637583023727, + "meanAggregateLoadTv": 0.04637173030747328 + }, + { + "layer": "layer_04", + "tokens": 436, + "orderedExact": 207, + "orderedExactRate": 0.47477064220183485, + "setExact": 280, + "setExactRate": 0.6422018348623854, + "meanSetJaccard": 0.8923656618610748, + "meanTokenWeightedTv": 0.021918269522820832, + "meanAggregateLoadTv": 0.04273688670024011 + }, + { + "layer": "layer_05", + "tokens": 436, + "orderedExact": 221, + "orderedExactRate": 0.5068807339449541, + "setExact": 280, + "setExactRate": 0.6422018348623854, + "meanSetJaccard": 0.8910004368719965, + "meanTokenWeightedTv": 0.023989134152718153, + "meanAggregateLoadTv": 0.0442518752257708 + }, + { + "layer": "layer_06", + "tokens": 436, + "orderedExact": 226, + "orderedExactRate": 0.518348623853211, + "setExact": 288, + "setExactRate": 0.6605504587155964, + "meanSetJaccard": 0.8980996068152033, + "meanTokenWeightedTv": 0.022863633553125547, + "meanAggregateLoadTv": 0.04196322326342406 + }, + { + "layer": "layer_07", + "tokens": 436, + "orderedExact": 247, + "orderedExactRate": 0.5665137614678899, + "setExact": 308, + "setExactRate": 0.7064220183486238, + "meanSetJaccard": 0.9082568807339451, + "meanTokenWeightedTv": 0.02221298477068808, + "meanAggregateLoadTv": 0.040622543082382445 + }, + { + "layer": "layer_08", + "tokens": 436, + "orderedExact": 244, + "orderedExactRate": 0.5596330275229358, + "setExact": 296, + "setExactRate": 0.6788990825688074, + "meanSetJaccard": 0.9023591087811271, + "meanTokenWeightedTv": 0.021512298381066317, + "meanAggregateLoadTv": 0.035950216208750344 + }, + { + "layer": "layer_09", + "tokens": 436, + "orderedExact": 219, + "orderedExactRate": 0.5022935779816514, + "setExact": 296, + "setExactRate": 0.6788990825688074, + "meanSetJaccard": 0.9033420707732636, + "meanTokenWeightedTv": 0.0225715659485827, + "meanAggregateLoadTv": 0.044803220819787076 + }, + { + "layer": "layer_10", + "tokens": 436, + "orderedExact": 230, + "orderedExactRate": 0.5275229357798165, + "setExact": 296, + "setExactRate": 0.6788990825688074, + "meanSetJaccard": 0.901485364788117, + "meanTokenWeightedTv": 0.02181595860325543, + "meanAggregateLoadTv": 0.03935789454112747 + }, + { + "layer": "layer_11", + "tokens": 436, + "orderedExact": 214, + "orderedExactRate": 0.4908256880733945, + "setExact": 270, + "setExactRate": 0.6192660550458715, + "meanSetJaccard": 0.8828090869375274, + "meanTokenWeightedTv": 0.023161419953610523, + "meanAggregateLoadTv": 0.04205047704043688 + }, + { + "layer": "layer_12", + "tokens": 436, + "orderedExact": 214, + "orderedExactRate": 0.4908256880733945, + "setExact": 302, + "setExactRate": 0.6926605504587156, + "meanSetJaccard": 0.9043250327653998, + "meanTokenWeightedTv": 0.023662107772988918, + "meanAggregateLoadTv": 0.03622738307728267 + }, + { + "layer": "layer_13", + "tokens": 436, + "orderedExact": 197, + "orderedExactRate": 0.4518348623853211, + "setExact": 271, + "setExactRate": 0.6215596330275229, + "meanSetJaccard": 0.8821537789427698, + "meanTokenWeightedTv": 0.025528782938132294, + "meanAggregateLoadTv": 0.046377905803106606 + }, + { + "layer": "layer_14", + "tokens": 436, + "orderedExact": 200, + "orderedExactRate": 0.45871559633027525, + "setExact": 250, + "setExactRate": 0.573394495412844, + "meanSetJaccard": 0.8644604630843163, + "meanTokenWeightedTv": 0.028573058452809556, + "meanAggregateLoadTv": 0.057325997110133656 + }, + { + "layer": "layer_15", + "tokens": 436, + "orderedExact": 199, + "orderedExactRate": 0.45642201834862384, + "setExact": 263, + "setExactRate": 0.6032110091743119, + "meanSetJaccard": 0.8754368719965051, + "meanTokenWeightedTv": 0.02665519306261213, + "meanAggregateLoadTv": 0.04856801544803553 + }, + { + "layer": "layer_16", + "tokens": 436, + "orderedExact": 183, + "orderedExactRate": 0.4197247706422018, + "setExact": 246, + "setExactRate": 0.5642201834862385, + "meanSetJaccard": 0.8623307121013545, + "meanTokenWeightedTv": 0.030062058232092088, + "meanAggregateLoadTv": 0.05385191559890355 + }, + { + "layer": "layer_17", + "tokens": 436, + "orderedExact": 177, + "orderedExactRate": 0.4059633027522936, + "setExact": 246, + "setExactRate": 0.5642201834862385, + "meanSetJaccard": 0.8623307121013544, + "meanTokenWeightedTv": 0.030187488466196503, + "meanAggregateLoadTv": 0.04603367172393277 + }, + { + "layer": "layer_18", + "tokens": 436, + "orderedExact": 168, + "orderedExactRate": 0.3853211009174312, + "setExact": 223, + "setExactRate": 0.5114678899082569, + "meanSetJaccard": 0.8463848842289209, + "meanTokenWeightedTv": 0.03171987853509375, + "meanAggregateLoadTv": 0.05360987601198445 + }, + { + "layer": "layer_19", + "tokens": 436, + "orderedExact": 175, + "orderedExactRate": 0.4013761467889908, + "setExact": 232, + "setExactRate": 0.5321100917431193, + "meanSetJaccard": 0.8475862822193098, + "meanTokenWeightedTv": 0.03133271619998014, + "meanAggregateLoadTv": 0.04932242196298421 + }, + { + "layer": "layer_20", + "tokens": 436, + "orderedExact": 172, + "orderedExactRate": 0.3944954128440367, + "setExact": 236, + "setExactRate": 0.5412844036697247, + "meanSetJaccard": 0.8477173438182614, + "meanTokenWeightedTv": 0.031235406113266674, + "meanAggregateLoadTv": 0.052691520048447765 + }, + { + "layer": "layer_21", + "tokens": 436, + "orderedExact": 149, + "orderedExactRate": 0.34174311926605505, + "setExact": 224, + "setExactRate": 0.5137614678899083, + "meanSetJaccard": 0.8351245085190039, + "meanTokenWeightedTv": 0.03182093551554749, + "meanAggregateLoadTv": 0.05474663203076857 + }, + { + "layer": "layer_22", + "tokens": 436, + "orderedExact": 157, + "orderedExactRate": 0.36009174311926606, + "setExact": 212, + "setExactRate": 0.48623853211009177, + "meanSetJaccard": 0.8343709043250329, + "meanTokenWeightedTv": 0.03149710036703847, + "meanAggregateLoadTv": 0.055324870912220304 + }, + { + "layer": "layer_23", + "tokens": 436, + "orderedExact": 152, + "orderedExactRate": 0.3486238532110092, + "setExact": 231, + "setExactRate": 0.5298165137614679, + "meanSetJaccard": 0.8484054172127568, + "meanTokenWeightedTv": 0.030968382684925723, + "meanAggregateLoadTv": 0.051944749899067166 + }, + { + "layer": "layer_24", + "tokens": 436, + "orderedExact": 135, + "orderedExactRate": 0.30963302752293576, + "setExact": 195, + "setExactRate": 0.44724770642201833, + "meanSetJaccard": 0.8191349934469201, + "meanTokenWeightedTv": 0.03257072841071467, + "meanAggregateLoadTv": 0.06548203395592953 + }, + { + "layer": "layer_25", + "tokens": 436, + "orderedExact": 161, + "orderedExactRate": 0.36926605504587157, + "setExact": 219, + "setExactRate": 0.5022935779816514, + "meanSetJaccard": 0.8465159458278724, + "meanTokenWeightedTv": 0.031295359787007294, + "meanAggregateLoadTv": 0.055181572852255584 + }, + { + "layer": "layer_26", + "tokens": 436, + "orderedExact": 183, + "orderedExactRate": 0.4197247706422018, + "setExact": 241, + "setExactRate": 0.5527522935779816, + "meanSetJaccard": 0.8536478811708168, + "meanTokenWeightedTv": 0.03039054622371001, + "meanAggregateLoadTv": 0.05080892352478697 + } + ], + "bos_at_s1": [ + { + "layer": "layer_01", + "tokens": 436, + "orderedExact": 129, + "orderedExactRate": 0.2958715596330275, + "setExact": 170, + "setExactRate": 0.38990825688073394, + "meanSetJaccard": 0.7934141546526867, + "meanTokenWeightedTv": 0.033111598341051526, + "meanAggregateLoadTv": 0.1132635701536304 + }, + { + "layer": "layer_02", + "tokens": 436, + "orderedExact": 167, + "orderedExactRate": 0.3830275229357798, + "setExact": 230, + "setExactRate": 0.5275229357798165, + "meanSetJaccard": 0.8494975972040193, + "meanTokenWeightedTv": 0.029801638441508536, + "meanAggregateLoadTv": 0.06701793948279891 + }, + { + "layer": "layer_03", + "tokens": 436, + "orderedExact": 204, + "orderedExactRate": 0.46788990825688076, + "setExact": 254, + "setExactRate": 0.5825688073394495, + "meanSetJaccard": 0.8768020969855833, + "meanTokenWeightedTv": 0.02628030459030761, + "meanAggregateLoadTv": 0.050824528271817423 + }, + { + "layer": "layer_04", + "tokens": 436, + "orderedExact": 182, + "orderedExactRate": 0.41743119266055045, + "setExact": 250, + "setExactRate": 0.573394495412844, + "meanSetJaccard": 0.8717234600262123, + "meanTokenWeightedTv": 0.025548477560175514, + "meanAggregateLoadTv": 0.05144433554323112 + }, + { + "layer": "layer_05", + "tokens": 436, + "orderedExact": 215, + "orderedExactRate": 0.49311926605504586, + "setExact": 278, + "setExactRate": 0.6376146788990825, + "meanSetJaccard": 0.8935124508519003, + "meanTokenWeightedTv": 0.024641537019955282, + "meanAggregateLoadTv": 0.0428168361275791 + }, + { + "layer": "layer_06", + "tokens": 436, + "orderedExact": 219, + "orderedExactRate": 0.5022935779816514, + "setExact": 284, + "setExactRate": 0.6513761467889908, + "meanSetJaccard": 0.8935124508519003, + "meanTokenWeightedTv": 0.022682302516437297, + "meanAggregateLoadTv": 0.04018693822910689 + }, + { + "layer": "layer_07", + "tokens": 436, + "orderedExact": 224, + "orderedExactRate": 0.5137614678899083, + "setExact": 285, + "setExactRate": 0.6536697247706422, + "meanSetJaccard": 0.8926933158584536, + "meanTokenWeightedTv": 0.024966455788368723, + "meanAggregateLoadTv": 0.04277201398185334 + }, + { + "layer": "layer_08", + "tokens": 436, + "orderedExact": 223, + "orderedExactRate": 0.5114678899082569, + "setExact": 285, + "setExactRate": 0.6536697247706422, + "meanSetJaccard": 0.8951507208387942, + "meanTokenWeightedTv": 0.023264727773519137, + "meanAggregateLoadTv": 0.042803489088629645 + }, + { + "layer": "layer_09", + "tokens": 436, + "orderedExact": 217, + "orderedExactRate": 0.49770642201834864, + "setExact": 287, + "setExactRate": 0.658256880733945, + "meanSetJaccard": 0.8940039318479686, + "meanTokenWeightedTv": 0.024469105029676176, + "meanAggregateLoadTv": 0.042811523873270856 + }, + { + "layer": "layer_10", + "tokens": 436, + "orderedExact": 220, + "orderedExactRate": 0.5045871559633027, + "setExact": 281, + "setExactRate": 0.6444954128440367, + "meanSetJaccard": 0.8887068588903452, + "meanTokenWeightedTv": 0.02479530288045607, + "meanAggregateLoadTv": 0.04009988366163064 + }, + { + "layer": "layer_11", + "tokens": 436, + "orderedExact": 200, + "orderedExactRate": 0.45871559633027525, + "setExact": 255, + "setExactRate": 0.5848623853211009, + "meanSetJaccard": 0.871122761031018, + "meanTokenWeightedTv": 0.025374795588936294, + "meanAggregateLoadTv": 0.04721518348526381 + }, + { + "layer": "layer_12", + "tokens": 436, + "orderedExact": 201, + "orderedExactRate": 0.4610091743119266, + "setExact": 280, + "setExactRate": 0.6422018348623854, + "meanSetJaccard": 0.8879423328964614, + "meanTokenWeightedTv": 0.0270855399173064, + "meanAggregateLoadTv": 0.04507075922738574 + }, + { + "layer": "layer_13", + "tokens": 436, + "orderedExact": 197, + "orderedExactRate": 0.4518348623853211, + "setExact": 269, + "setExactRate": 0.6169724770642202, + "meanSetJaccard": 0.8787680209698561, + "meanTokenWeightedTv": 0.02628684842167337, + "meanAggregateLoadTv": 0.04349839835532607 + }, + { + "layer": "layer_14", + "tokens": 436, + "orderedExact": 189, + "orderedExactRate": 0.4334862385321101, + "setExact": 243, + "setExactRate": 0.5573394495412844, + "meanSetJaccard": 0.8599825251201398, + "meanTokenWeightedTv": 0.02938444882563237, + "meanAggregateLoadTv": 0.05242285278680861 + }, + { + "layer": "layer_15", + "tokens": 436, + "orderedExact": 181, + "orderedExactRate": 0.4151376146788991, + "setExact": 248, + "setExactRate": 0.5688073394495413, + "meanSetJaccard": 0.8592398427260811, + "meanTokenWeightedTv": 0.030427715217921, + "meanAggregateLoadTv": 0.055199700920082445 + }, + { + "layer": "layer_16", + "tokens": 436, + "orderedExact": 163, + "orderedExactRate": 0.3738532110091743, + "setExact": 230, + "setExactRate": 0.5275229357798165, + "meanSetJaccard": 0.8419287898645698, + "meanTokenWeightedTv": 0.03402183431371272, + "meanAggregateLoadTv": 0.05865538875077028 + }, + { + "layer": "layer_17", + "tokens": 436, + "orderedExact": 178, + "orderedExactRate": 0.40825688073394495, + "setExact": 237, + "setExactRate": 0.5435779816513762, + "meanSetJaccard": 0.8476190476190476, + "meanTokenWeightedTv": 0.03459574652816409, + "meanAggregateLoadTv": 0.05482033955929538 + }, + { + "layer": "layer_18", + "tokens": 436, + "orderedExact": 170, + "orderedExactRate": 0.38990825688073394, + "setExact": 223, + "setExactRate": 0.5114678899082569, + "meanSetJaccard": 0.8417868064657056, + "meanTokenWeightedTv": 0.03228188852487383, + "meanAggregateLoadTv": 0.05369301279190837 + }, + { + "layer": "layer_19", + "tokens": 436, + "orderedExact": 163, + "orderedExactRate": 0.3738532110091743, + "setExact": 224, + "setExactRate": 0.5137614678899083, + "meanSetJaccard": 0.8342179991262562, + "meanTokenWeightedTv": 0.03416518238324362, + "meanAggregateLoadTv": 0.06241447270563735 + }, + { + "layer": "layer_20", + "tokens": 436, + "orderedExact": 168, + "orderedExactRate": 0.3853211009174312, + "setExact": 240, + "setExactRate": 0.5504587155963303, + "meanSetJaccard": 0.8522280471821757, + "meanTokenWeightedTv": 0.03186396060441355, + "meanAggregateLoadTv": 0.055786439408427355 + }, + { + "layer": "layer_21", + "tokens": 436, + "orderedExact": 147, + "orderedExactRate": 0.33715596330275227, + "setExact": 222, + "setExactRate": 0.5091743119266054, + "meanSetJaccard": 0.8389034512887724, + "meanTokenWeightedTv": 0.03073872583027997, + "meanAggregateLoadTv": 0.05217483691379274 + }, + { + "layer": "layer_22", + "tokens": 436, + "orderedExact": 155, + "orderedExactRate": 0.3555045871559633, + "setExact": 218, + "setExactRate": 0.5, + "meanSetJaccard": 0.832645259938838, + "meanTokenWeightedTv": 0.033091163311162616, + "meanAggregateLoadTv": 0.05803099966001572 + }, + { + "layer": "layer_23", + "tokens": 436, + "orderedExact": 145, + "orderedExactRate": 0.33256880733944955, + "setExact": 215, + "setExactRate": 0.49311926605504586, + "meanSetJaccard": 0.8371559633027523, + "meanTokenWeightedTv": 0.032743069203196834, + "meanAggregateLoadTv": 0.05943549329593506 + }, + { + "layer": "layer_24", + "tokens": 436, + "orderedExact": 116, + "orderedExactRate": 0.26605504587155965, + "setExact": 178, + "setExactRate": 0.40825688073394495, + "meanSetJaccard": 0.7981105286151158, + "meanTokenWeightedTv": 0.033862821874185864, + "meanAggregateLoadTv": 0.06854620864410021 + }, + { + "layer": "layer_25", + "tokens": 436, + "orderedExact": 161, + "orderedExactRate": 0.36926605504587157, + "setExact": 221, + "setExactRate": 0.5068807339449541, + "meanSetJaccard": 0.845948012232416, + "meanTokenWeightedTv": 0.031496111523948093, + "meanAggregateLoadTv": 0.05413990618558892 + }, + { + "layer": "layer_26", + "tokens": 436, + "orderedExact": 169, + "orderedExactRate": 0.3876146788990826, + "setExact": 241, + "setExactRate": 0.5527522935779816, + "meanSetJaccard": 0.8503167321974662, + "meanTokenWeightedTv": 0.029894333798746286, + "meanAggregateLoadTv": 0.05289936199825758 + } + ], + "x_at_s0": [ + { + "layer": "layer_01", + "tokens": 436, + "orderedExact": 158, + "orderedExactRate": 0.3623853211009174, + "setExact": 202, + "setExactRate": 0.463302752293578, + "meanSetJaccard": 0.814001747487986, + "meanTokenWeightedTv": 0.02881983916208361, + "meanAggregateLoadTv": 0.09945018167909733 + }, + { + "layer": "layer_02", + "tokens": 436, + "orderedExact": 168, + "orderedExactRate": 0.3853211009174312, + "setExact": 220, + "setExactRate": 0.5045871559633027, + "meanSetJaccard": 0.8425622542595019, + "meanTokenWeightedTv": 0.030102835804240682, + "meanAggregateLoadTv": 0.06754770404368798 + }, + { + "layer": "layer_03", + "tokens": 436, + "orderedExact": 219, + "orderedExactRate": 0.5022935779816514, + "setExact": 266, + "setExactRate": 0.6100917431192661, + "meanSetJaccard": 0.8841743119266054, + "meanTokenWeightedTv": 0.02559389858184617, + "meanAggregateLoadTv": 0.051890299292407724 + }, + { + "layer": "layer_04", + "tokens": 436, + "orderedExact": 212, + "orderedExactRate": 0.48623853211009177, + "setExact": 283, + "setExactRate": 0.6490825688073395, + "meanSetJaccard": 0.8972804718217561, + "meanTokenWeightedTv": 0.022853712807843974, + "meanAggregateLoadTv": 0.0399170757102484 + }, + { + "layer": "layer_05", + "tokens": 436, + "orderedExact": 230, + "orderedExactRate": 0.5275229357798165, + "setExact": 282, + "setExactRate": 0.6467889908256881, + "meanSetJaccard": 0.8937854958497159, + "meanTokenWeightedTv": 0.024107134216418746, + "meanAggregateLoadTv": 0.04201627940332759 + }, + { + "layer": "layer_06", + "tokens": 436, + "orderedExact": 226, + "orderedExactRate": 0.518348623853211, + "setExact": 287, + "setExactRate": 0.658256880733945, + "meanSetJaccard": 0.9003931847968546, + "meanTokenWeightedTv": 0.02309016345716143, + "meanAggregateLoadTv": 0.042884102547757166 + }, + { + "layer": "layer_07", + "tokens": 436, + "orderedExact": 231, + "orderedExactRate": 0.5298165137614679, + "setExact": 277, + "setExactRate": 0.6353211009174312, + "meanSetJaccard": 0.8879423328964613, + "meanTokenWeightedTv": 0.026219961082114582, + "meanAggregateLoadTv": 0.044420871315951634 + }, + { + "layer": "layer_08", + "tokens": 436, + "orderedExact": 231, + "orderedExactRate": 0.5298165137614679, + "setExact": 291, + "setExactRate": 0.6674311926605505, + "meanSetJaccard": 0.9000655307994758, + "meanTokenWeightedTv": 0.02297498720614593, + "meanAggregateLoadTv": 0.03667221797241878 + }, + { + "layer": "layer_09", + "tokens": 436, + "orderedExact": 207, + "orderedExactRate": 0.47477064220183485, + "setExact": 275, + "setExactRate": 0.6307339449541285, + "meanSetJaccard": 0.8878331148973352, + "meanTokenWeightedTv": 0.025862111460499722, + "meanAggregateLoadTv": 0.05037717005588491 + }, + { + "layer": "layer_10", + "tokens": 436, + "orderedExact": 221, + "orderedExactRate": 0.5068807339449541, + "setExact": 286, + "setExactRate": 0.6559633027522935, + "meanSetJaccard": 0.8938401048492792, + "meanTokenWeightedTv": 0.024219072512734127, + "meanAggregateLoadTv": 0.04456762234121671 + }, + { + "layer": "layer_11", + "tokens": 436, + "orderedExact": 216, + "orderedExactRate": 0.4954128440366973, + "setExact": 264, + "setExactRate": 0.6055045871559633, + "meanSetJaccard": 0.8786041939711664, + "meanTokenWeightedTv": 0.0251796217891355, + "meanAggregateLoadTv": 0.05078707687894435 + }, + { + "layer": "layer_12", + "tokens": 436, + "orderedExact": 212, + "orderedExactRate": 0.48623853211009177, + "setExact": 283, + "setExactRate": 0.6490825688073395, + "meanSetJaccard": 0.8892529488859764, + "meanTokenWeightedTv": 0.0268559206636916, + "meanAggregateLoadTv": 0.045741564140158515 + }, + { + "layer": "layer_13", + "tokens": 436, + "orderedExact": 182, + "orderedExactRate": 0.41743119266055045, + "setExact": 258, + "setExactRate": 0.591743119266055, + "meanSetJaccard": 0.8730340760157275, + "meanTokenWeightedTv": 0.028273861461952488, + "meanAggregateLoadTv": 0.05059968710822124 + }, + { + "layer": "layer_14", + "tokens": 436, + "orderedExact": 196, + "orderedExactRate": 0.44954128440366975, + "setExact": 255, + "setExactRate": 0.5848623853211009, + "meanSetJaccard": 0.8647335080821319, + "meanTokenWeightedTv": 0.02895318418541403, + "meanAggregateLoadTv": 0.05409627929708251 + }, + { + "layer": "layer_15", + "tokens": 436, + "orderedExact": 189, + "orderedExactRate": 0.4334862385321101, + "setExact": 247, + "setExactRate": 0.5665137614678899, + "meanSetJaccard": 0.8593818261249454, + "meanTokenWeightedTv": 0.030857553317809948, + "meanAggregateLoadTv": 0.050976525148211896 + }, + { + "layer": "layer_16", + "tokens": 436, + "orderedExact": 174, + "orderedExactRate": 0.39908256880733944, + "setExact": 244, + "setExactRate": 0.5596330275229358, + "meanSetJaccard": 0.8551441677588467, + "meanTokenWeightedTv": 0.033019100966946976, + "meanAggregateLoadTv": 0.058253981534604024 + }, + { + "layer": "layer_17", + "tokens": 436, + "orderedExact": 163, + "orderedExactRate": 0.3738532110091743, + "setExact": 227, + "setExactRate": 0.5206422018348624, + "meanSetJaccard": 0.8421263751538982, + "meanTokenWeightedTv": 0.03540025480403604, + "meanAggregateLoadTv": 0.05292439599668515 + }, + { + "layer": "layer_18", + "tokens": 436, + "orderedExact": 163, + "orderedExactRate": 0.3738532110091743, + "setExact": 221, + "setExactRate": 0.5068807339449541, + "meanSetJaccard": 0.8384119702927042, + "meanTokenWeightedTv": 0.03479084830164127, + "meanAggregateLoadTv": 0.056895173285735526 + }, + { + "layer": "layer_19", + "tokens": 436, + "orderedExact": 173, + "orderedExactRate": 0.3967889908256881, + "setExact": 233, + "setExactRate": 0.5344036697247706, + "meanSetJaccard": 0.8414482306684142, + "meanTokenWeightedTv": 0.033554562561164486, + "meanAggregateLoadTv": 0.05789208420985529 + }, + { + "layer": "layer_20", + "tokens": 436, + "orderedExact": 142, + "orderedExactRate": 0.3256880733944954, + "setExact": 210, + "setExactRate": 0.481651376146789, + "meanSetJaccard": 0.8295653123634776, + "meanTokenWeightedTv": 0.03463954018102533, + "meanAggregateLoadTv": 0.0600415551093262 + }, + { + "layer": "layer_21", + "tokens": 436, + "orderedExact": 135, + "orderedExactRate": 0.30963302752293576, + "setExact": 211, + "setExactRate": 0.48394495412844035, + "meanSetJaccard": 0.8254150283966798, + "meanTokenWeightedTv": 0.034054320634501256, + "meanAggregateLoadTv": 0.06351191804254053 + }, + { + "layer": "layer_22", + "tokens": 436, + "orderedExact": 158, + "orderedExactRate": 0.3623853211009174, + "setExact": 211, + "setExactRate": 0.48394495412844035, + "meanSetJaccard": 0.828123634775011, + "meanTokenWeightedTv": 0.0348101829868825, + "meanAggregateLoadTv": 0.05760960508701472 + }, + { + "layer": "layer_23", + "tokens": 436, + "orderedExact": 153, + "orderedExactRate": 0.35091743119266056, + "setExact": 222, + "setExactRate": 0.5091743119266054, + "meanSetJaccard": 0.8372105723023155, + "meanTokenWeightedTv": 0.03314117355553739, + "meanAggregateLoadTv": 0.047747272157412715 + }, + { + "layer": "layer_24", + "tokens": 436, + "orderedExact": 137, + "orderedExactRate": 0.31422018348623854, + "setExact": 194, + "setExactRate": 0.44495412844036697, + "meanSetJaccard": 0.8090541721275666, + "meanTokenWeightedTv": 0.03405325911531877, + "meanAggregateLoadTv": 0.06366258685535794 + }, + { + "layer": "layer_25", + "tokens": 436, + "orderedExact": 168, + "orderedExactRate": 0.3853211009174312, + "setExact": 231, + "setExactRate": 0.5298165137614679, + "meanSetJaccard": 0.8503385757972914, + "meanTokenWeightedTv": 0.030861982699720993, + "meanAggregateLoadTv": 0.057312915683899616 + }, + { + "layer": "layer_26", + "tokens": 436, + "orderedExact": 178, + "orderedExactRate": 0.40825688073394495, + "setExact": 242, + "setExactRate": 0.555045871559633, + "meanSetJaccard": 0.8576889471384884, + "meanTokenWeightedTv": 0.029297899436500394, + "meanAggregateLoadTv": 0.052253391874375804 + } + ], + "x_at_s1": [ + { + "layer": "layer_01", + "tokens": 436, + "orderedExact": 136, + "orderedExactRate": 0.3119266055045872, + "setExact": 182, + "setExactRate": 0.41743119266055045, + "meanSetJaccard": 0.8052643075578855, + "meanTokenWeightedTv": 0.031983250400818355, + "meanAggregateLoadTv": 0.10285148530630457 + }, + { + "layer": "layer_02", + "tokens": 436, + "orderedExact": 162, + "orderedExactRate": 0.37155963302752293, + "setExact": 233, + "setExactRate": 0.5344036697247706, + "meanSetJaccard": 0.8535386631716909, + "meanTokenWeightedTv": 0.02945238640409078, + "meanAggregateLoadTv": 0.0621869090117082 + }, + { + "layer": "layer_03", + "tokens": 436, + "orderedExact": 211, + "orderedExactRate": 0.48394495412844035, + "setExact": 253, + "setExactRate": 0.5802752293577982, + "meanSetJaccard": 0.874180865006553, + "meanTokenWeightedTv": 0.02785931935211559, + "meanAggregateLoadTv": 0.04742050211427721 + }, + { + "layer": "layer_04", + "tokens": 436, + "orderedExact": 183, + "orderedExactRate": 0.4197247706422018, + "setExact": 242, + "setExactRate": 0.555045871559633, + "meanSetJaccard": 0.8669724770642203, + "meanTokenWeightedTv": 0.02781943375918583, + "meanAggregateLoadTv": 0.05738317024712607 + }, + { + "layer": "layer_05", + "tokens": 436, + "orderedExact": 203, + "orderedExactRate": 0.46559633027522934, + "setExact": 260, + "setExactRate": 0.5963302752293578, + "meanSetJaccard": 0.8788772389689823, + "meanTokenWeightedTv": 0.028297022852541487, + "meanAggregateLoadTv": 0.04856323441915811 + }, + { + "layer": "layer_06", + "tokens": 436, + "orderedExact": 191, + "orderedExactRate": 0.4380733944954128, + "setExact": 261, + "setExactRate": 0.5986238532110092, + "meanSetJaccard": 0.8774574049803407, + "meanTokenWeightedTv": 0.027673329236861492, + "meanAggregateLoadTv": 0.050745973311234344 + }, + { + "layer": "layer_07", + "tokens": 436, + "orderedExact": 211, + "orderedExactRate": 0.48394495412844035, + "setExact": 263, + "setExactRate": 0.6032110091743119, + "meanSetJaccard": 0.8719418960244649, + "meanTokenWeightedTv": 0.03080850577103067, + "meanAggregateLoadTv": 0.05295952327829838 + }, + { + "layer": "layer_08", + "tokens": 436, + "orderedExact": 185, + "orderedExactRate": 0.4243119266055046, + "setExact": 250, + "setExactRate": 0.573394495412844, + "meanSetJaccard": 0.8741808650065532, + "meanTokenWeightedTv": 0.027805086359543648, + "meanAggregateLoadTv": 0.05025432417500691 + }, + { + "layer": "layer_09", + "tokens": 436, + "orderedExact": 191, + "orderedExactRate": 0.4380733944954128, + "setExact": 256, + "setExactRate": 0.5871559633027523, + "meanSetJaccard": 0.8702490170380079, + "meanTokenWeightedTv": 0.02895239059388134, + "meanAggregateLoadTv": 0.0457188542529908 + }, + { + "layer": "layer_10", + "tokens": 436, + "orderedExact": 183, + "orderedExactRate": 0.4197247706422018, + "setExact": 242, + "setExactRate": 0.555045871559633, + "meanSetJaccard": 0.8590541721275667, + "meanTokenWeightedTv": 0.03173259957171923, + "meanAggregateLoadTv": 0.05032159059518497 + }, + { + "layer": "layer_11", + "tokens": 436, + "orderedExact": 183, + "orderedExactRate": 0.4197247706422018, + "setExact": 241, + "setExactRate": 0.5527522935779816, + "meanSetJaccard": 0.8568152031454784, + "meanTokenWeightedTv": 0.029949197341691866, + "meanAggregateLoadTv": 0.060576831134060045 + }, + { + "layer": "layer_12", + "tokens": 436, + "orderedExact": 192, + "orderedExactRate": 0.44036697247706424, + "setExact": 256, + "setExactRate": 0.5871559633027523, + "meanSetJaccard": 0.8714504150283967, + "meanTokenWeightedTv": 0.03141902282532844, + "meanAggregateLoadTv": 0.05252112949151101 + }, + { + "layer": "layer_13", + "tokens": 436, + "orderedExact": 161, + "orderedExactRate": 0.36926605504587157, + "setExact": 232, + "setExactRate": 0.5321100917431193, + "meanSetJaccard": 0.8496614242027086, + "meanTokenWeightedTv": 0.03338189883087934, + "meanAggregateLoadTv": 0.058179809183825246 + }, + { + "layer": "layer_14", + "tokens": 436, + "orderedExact": 169, + "orderedExactRate": 0.3876146788990826, + "setExact": 226, + "setExactRate": 0.518348623853211, + "meanSetJaccard": 0.8448012232415901, + "meanTokenWeightedTv": 0.03384689610285557, + "meanAggregateLoadTv": 0.05251103620832536 + }, + { + "layer": "layer_15", + "tokens": 436, + "orderedExact": 149, + "orderedExactRate": 0.34174311926605505, + "setExact": 213, + "setExactRate": 0.48853211009174313, + "meanSetJaccard": 0.8301332459589341, + "meanTokenWeightedTv": 0.035846309397035626, + "meanAggregateLoadTv": 0.05220744087460954 + }, + { + "layer": "layer_16", + "tokens": 436, + "orderedExact": 141, + "orderedExactRate": 0.32339449541284404, + "setExact": 200, + "setExactRate": 0.45871559633027525, + "meanSetJaccard": 0.8170489296636084, + "meanTokenWeightedTv": 0.04030861388051696, + "meanAggregateLoadTv": 0.06878067826863007 + }, + { + "layer": "layer_17", + "tokens": 436, + "orderedExact": 139, + "orderedExactRate": 0.31880733944954126, + "setExact": 203, + "setExactRate": 0.46559633027522934, + "meanSetJaccard": 0.8159021406727829, + "meanTokenWeightedTv": 0.04125657209715311, + "meanAggregateLoadTv": 0.06743149848069527 + }, + { + "layer": "layer_18", + "tokens": 436, + "orderedExact": 139, + "orderedExactRate": 0.31880733944954126, + "setExact": 208, + "setExactRate": 0.47706422018348627, + "meanSetJaccard": 0.8229576234163389, + "meanTokenWeightedTv": 0.040476153897610834, + "meanAggregateLoadTv": 0.06639786659866981 + }, + { + "layer": "layer_19", + "tokens": 436, + "orderedExact": 132, + "orderedExactRate": 0.30275229357798167, + "setExact": 190, + "setExactRate": 0.43577981651376146, + "meanSetJaccard": 0.8057994757536042, + "meanTokenWeightedTv": 0.03975898203688886, + "meanAggregateLoadTv": 0.0646029886742738 + }, + { + "layer": "layer_20", + "tokens": 436, + "orderedExact": 108, + "orderedExactRate": 0.24770642201834864, + "setExact": 179, + "setExactRate": 0.4105504587155963, + "meanSetJaccard": 0.7976855713094245, + "meanTokenWeightedTv": 0.0400457874145985, + "meanAggregateLoadTv": 0.0734047964344149 + }, + { + "layer": "layer_21", + "tokens": 436, + "orderedExact": 114, + "orderedExactRate": 0.26146788990825687, + "setExact": 179, + "setExactRate": 0.4105504587155963, + "meanSetJaccard": 0.7985910878112713, + "meanTokenWeightedTv": 0.04033652240747708, + "meanAggregateLoadTv": 0.06927810448141773 + }, + { + "layer": "layer_22", + "tokens": 436, + "orderedExact": 127, + "orderedExactRate": 0.29128440366972475, + "setExact": 178, + "setExactRate": 0.40825688073394495, + "meanSetJaccard": 0.8020860637833115, + "meanTokenWeightedTv": 0.041978636609127526, + "meanAggregateLoadTv": 0.0700264683070908 + }, + { + "layer": "layer_23", + "tokens": 436, + "orderedExact": 114, + "orderedExactRate": 0.26146788990825687, + "setExact": 179, + "setExactRate": 0.4105504587155963, + "meanSetJaccard": 0.8030253385757973, + "meanTokenWeightedTv": 0.040305238837922544, + "meanAggregateLoadTv": 0.05923090510188904 + }, + { + "layer": "layer_24", + "tokens": 436, + "orderedExact": 92, + "orderedExactRate": 0.21100917431192662, + "setExact": 156, + "setExactRate": 0.3577981651376147, + "meanSetJaccard": 0.7682830930537353, + "meanTokenWeightedTv": 0.041432713854716675, + "meanAggregateLoadTv": 0.0697858231869276 + }, + { + "layer": "layer_25", + "tokens": 436, + "orderedExact": 155, + "orderedExactRate": 0.3555045871559633, + "setExact": 214, + "setExactRate": 0.4908256880733945, + "meanSetJaccard": 0.8300021843599824, + "meanTokenWeightedTv": 0.036468938862680315, + "meanAggregateLoadTv": 0.05613000945581266 + }, + { + "layer": "layer_26", + "tokens": 436, + "orderedExact": 147, + "orderedExactRate": 0.33715596330275227, + "setExact": 214, + "setExactRate": 0.4908256880733945, + "meanSetJaccard": 0.8326343381389254, + "meanTokenWeightedTv": 0.03641505881000281, + "meanAggregateLoadTv": 0.06363224060262213 + } + ], + "period_at_s0": [ + { + "layer": "layer_01", + "tokens": 436, + "orderedExact": 164, + "orderedExactRate": 0.3761467889908257, + "setExact": 208, + "setExactRate": 0.47706422018348627, + "meanSetJaccard": 0.8168414154652688, + "meanTokenWeightedTv": 0.02849596914135209, + "meanAggregateLoadTv": 0.09933397611610462 + }, + { + "layer": "layer_02", + "tokens": 436, + "orderedExact": 169, + "orderedExactRate": 0.3876146788990826, + "setExact": 220, + "setExactRate": 0.5045871559633027, + "meanSetJaccard": 0.8410878112712974, + "meanTokenWeightedTv": 0.03022694613952581, + "meanAggregateLoadTv": 0.06640178438622213 + }, + { + "layer": "layer_03", + "tokens": 436, + "orderedExact": 229, + "orderedExactRate": 0.5252293577981652, + "setExact": 278, + "setExactRate": 0.6376146788990825, + "meanSetJaccard": 0.8935124508519003, + "meanTokenWeightedTv": 0.02402666860811853, + "meanAggregateLoadTv": 0.04979089638979197 + }, + { + "layer": "layer_04", + "tokens": 436, + "orderedExact": 211, + "orderedExactRate": 0.48394495412844035, + "setExact": 280, + "setExactRate": 0.6422018348623854, + "meanSetJaccard": 0.8958060288335518, + "meanTokenWeightedTv": 0.02282572111685493, + "meanAggregateLoadTv": 0.04367682369690402 + }, + { + "layer": "layer_05", + "tokens": 436, + "orderedExact": 221, + "orderedExactRate": 0.5068807339449541, + "setExact": 282, + "setExactRate": 0.6467889908256881, + "meanSetJaccard": 0.8942769768457841, + "meanTokenWeightedTv": 0.024210225445610335, + "meanAggregateLoadTv": 0.042228703172478274 + }, + { + "layer": "layer_06", + "tokens": 436, + "orderedExact": 223, + "orderedExactRate": 0.5114678899082569, + "setExact": 282, + "setExactRate": 0.6467889908256881, + "meanSetJaccard": 0.8936762778505898, + "meanTokenWeightedTv": 0.02379206909045234, + "meanAggregateLoadTv": 0.04287214997556363 + }, + { + "layer": "layer_07", + "tokens": 436, + "orderedExact": 226, + "orderedExactRate": 0.518348623853211, + "setExact": 281, + "setExactRate": 0.6444954128440367, + "meanSetJaccard": 0.8860856269113151, + "meanTokenWeightedTv": 0.02753554729156608, + "meanAggregateLoadTv": 0.049886184951446 + }, + { + "layer": "layer_08", + "tokens": 436, + "orderedExact": 226, + "orderedExactRate": 0.518348623853211, + "setExact": 287, + "setExactRate": 0.658256880733945, + "meanSetJaccard": 0.895478374836173, + "meanTokenWeightedTv": 0.024166171962995666, + "meanAggregateLoadTv": 0.04224981938335352 + }, + { + "layer": "layer_09", + "tokens": 436, + "orderedExact": 206, + "orderedExactRate": 0.4724770642201835, + "setExact": 266, + "setExactRate": 0.6100917431192661, + "meanSetJaccard": 0.8814438619484493, + "meanTokenWeightedTv": 0.02706891063460126, + "meanAggregateLoadTv": 0.04902593176940566 + }, + { + "layer": "layer_10", + "tokens": 436, + "orderedExact": 222, + "orderedExactRate": 0.5091743119266054, + "setExact": 286, + "setExactRate": 0.6559633027522935, + "meanSetJaccard": 0.8948230668414157, + "meanTokenWeightedTv": 0.023213170071964332, + "meanAggregateLoadTv": 0.03893995293342682 + }, + { + "layer": "layer_11", + "tokens": 436, + "orderedExact": 212, + "orderedExactRate": 0.48623853211009177, + "setExact": 264, + "setExactRate": 0.6055045871559633, + "meanSetJaccard": 0.8770969855832242, + "meanTokenWeightedTv": 0.025381033124512054, + "meanAggregateLoadTv": 0.04944526784386222 + }, + { + "layer": "layer_12", + "tokens": 436, + "orderedExact": 205, + "orderedExactRate": 0.4701834862385321, + "setExact": 272, + "setExactRate": 0.6238532110091743, + "meanSetJaccard": 0.8811708169506334, + "meanTokenWeightedTv": 0.02760048428994822, + "meanAggregateLoadTv": 0.04624357217228703 + }, + { + "layer": "layer_13", + "tokens": 436, + "orderedExact": 181, + "orderedExactRate": 0.4151376146788991, + "setExact": 254, + "setExactRate": 0.5825688073394495, + "meanSetJaccard": 0.8691568370467453, + "meanTokenWeightedTv": 0.02778243192953767, + "meanAggregateLoadTv": 0.05337494156520261 + }, + { + "layer": "layer_14", + "tokens": 436, + "orderedExact": 205, + "orderedExactRate": 0.4701834862385321, + "setExact": 259, + "setExactRate": 0.5940366972477065, + "meanSetJaccard": 0.8683377020532984, + "meanTokenWeightedTv": 0.028367505363318026, + "meanAggregateLoadTv": 0.05310813359257134 + }, + { + "layer": "layer_15", + "tokens": 436, + "orderedExact": 180, + "orderedExactRate": 0.41284403669724773, + "setExact": 240, + "setExactRate": 0.5504587155963303, + "meanSetJaccard": 0.8550895587592836, + "meanTokenWeightedTv": 0.030977346171633672, + "meanAggregateLoadTv": 0.04723424119759461 + }, + { + "layer": "layer_16", + "tokens": 436, + "orderedExact": 178, + "orderedExactRate": 0.40825688073394495, + "setExact": 249, + "setExactRate": 0.5711009174311926, + "meanSetJaccard": 0.8625709916994321, + "meanTokenWeightedTv": 0.031442143159833985, + "meanAggregateLoadTv": 0.05090122394339262 + }, + { + "layer": "layer_17", + "tokens": 436, + "orderedExact": 161, + "orderedExactRate": 0.36926605504587157, + "setExact": 229, + "setExactRate": 0.5252293577981652, + "meanSetJaccard": 0.8431093371460344, + "meanTokenWeightedTv": 0.034857096023889735, + "meanAggregateLoadTv": 0.05646275578504494 + }, + { + "layer": "layer_18", + "tokens": 436, + "orderedExact": 161, + "orderedExactRate": 0.36926605504587157, + "setExact": 208, + "setExactRate": 0.47706422018348627, + "meanSetJaccard": 0.8327326343381389, + "meanTokenWeightedTv": 0.034942170550404564, + "meanAggregateLoadTv": 0.05904809715050679 + }, + { + "layer": "layer_19", + "tokens": 436, + "orderedExact": 165, + "orderedExactRate": 0.37844036697247707, + "setExact": 233, + "setExactRate": 0.5344036697247706, + "meanSetJaccard": 0.8392529488859766, + "meanTokenWeightedTv": 0.03288639055693975, + "meanAggregateLoadTv": 0.05571140381632349 + }, + { + "layer": "layer_20", + "tokens": 436, + "orderedExact": 151, + "orderedExactRate": 0.3463302752293578, + "setExact": 220, + "setExactRate": 0.5045871559633027, + "meanSetJaccard": 0.8356705985146353, + "meanTokenWeightedTv": 0.03340307407027265, + "meanAggregateLoadTv": 0.05836215231295553 + }, + { + "layer": "layer_21", + "tokens": 436, + "orderedExact": 146, + "orderedExactRate": 0.3348623853211009, + "setExact": 217, + "setExactRate": 0.49770642201834864, + "meanSetJaccard": 0.827217125382263, + "meanTokenWeightedTv": 0.03357903553655757, + "meanAggregateLoadTv": 0.05361884044112959 + }, + { + "layer": "layer_22", + "tokens": 436, + "orderedExact": 147, + "orderedExactRate": 0.33715596330275227, + "setExact": 199, + "setExactRate": 0.45642201834862384, + "meanSetJaccard": 0.8243228484054173, + "meanTokenWeightedTv": 0.0340185900275473, + "meanAggregateLoadTv": 0.061912464673508846 + }, + { + "layer": "layer_23", + "tokens": 436, + "orderedExact": 135, + "orderedExactRate": 0.30963302752293576, + "setExact": 219, + "setExactRate": 0.5022935779816514, + "meanSetJaccard": 0.8371231979030144, + "meanTokenWeightedTv": 0.03380755031831559, + "meanAggregateLoadTv": 0.0540471409447313 + }, + { + "layer": "layer_24", + "tokens": 436, + "orderedExact": 131, + "orderedExactRate": 0.30045871559633025, + "setExact": 191, + "setExactRate": 0.4380733944954128, + "meanSetJaccard": 0.8105613805155089, + "meanTokenWeightedTv": 0.034325315751985316, + "meanAggregateLoadTv": 0.06387315133550073 + }, + { + "layer": "layer_25", + "tokens": 436, + "orderedExact": 170, + "orderedExactRate": 0.38990825688073394, + "setExact": 233, + "setExactRate": 0.5344036697247706, + "meanSetJaccard": 0.8482088248143295, + "meanTokenWeightedTv": 0.032934684280950165, + "meanAggregateLoadTv": 0.057859679458575036 + }, + { + "layer": "layer_26", + "tokens": 436, + "orderedExact": 169, + "orderedExactRate": 0.3876146788990826, + "setExact": 229, + "setExactRate": 0.5252293577981652, + "meanSetJaccard": 0.8428789864569681, + "meanTokenWeightedTv": 0.032453027639194956, + "meanAggregateLoadTv": 0.056417070397994096 + } + ], + "period_at_s1": [ + { + "layer": "layer_01", + "tokens": 436, + "orderedExact": 137, + "orderedExactRate": 0.31422018348623854, + "setExact": 183, + "setExactRate": 0.4197247706422018, + "meanSetJaccard": 0.8077217125382263, + "meanTokenWeightedTv": 0.03166715780712426, + "meanAggregateLoadTv": 0.10325634548777118 + }, + { + "layer": "layer_02", + "tokens": 436, + "orderedExact": 163, + "orderedExactRate": 0.3738532110091743, + "setExact": 232, + "setExactRate": 0.5321100917431193, + "meanSetJaccard": 0.8547400611620797, + "meanTokenWeightedTv": 0.029229457874082213, + "meanAggregateLoadTv": 0.06270750993391555 + }, + { + "layer": "layer_03", + "tokens": 436, + "orderedExact": 211, + "orderedExactRate": 0.48394495412844035, + "setExact": 253, + "setExactRate": 0.5802752293577982, + "meanSetJaccard": 0.8711773700305812, + "meanTokenWeightedTv": 0.028748021381300563, + "meanAggregateLoadTv": 0.05199090010836999 + }, + { + "layer": "layer_04", + "tokens": 436, + "orderedExact": 189, + "orderedExactRate": 0.4334862385321101, + "setExact": 246, + "setExactRate": 0.5642201834862385, + "meanSetJaccard": 0.8695937090432505, + "meanTokenWeightedTv": 0.027607897470336363, + "meanAggregateLoadTv": 0.05672637640509126 + }, + { + "layer": "layer_05", + "tokens": 436, + "orderedExact": 195, + "orderedExactRate": 0.44724770642201833, + "setExact": 259, + "setExactRate": 0.5940366972477065, + "meanSetJaccard": 0.8756553079947577, + "meanTokenWeightedTv": 0.029164625444732112, + "meanAggregateLoadTv": 0.05251887178343002 + }, + { + "layer": "layer_06", + "tokens": 436, + "orderedExact": 192, + "orderedExactRate": 0.44036697247706424, + "setExact": 258, + "setExactRate": 0.591743119266055, + "meanSetJaccard": 0.8754914809960683, + "meanTokenWeightedTv": 0.027509872619485412, + "meanAggregateLoadTv": 0.0530892750897771 + }, + { + "layer": "layer_07", + "tokens": 436, + "orderedExact": 204, + "orderedExactRate": 0.46788990825688076, + "setExact": 269, + "setExactRate": 0.6169724770642202, + "meanSetJaccard": 0.8769659239842725, + "meanTokenWeightedTv": 0.030219718817291717, + "meanAggregateLoadTv": 0.04934652631690784 + }, + { + "layer": "layer_08", + "tokens": 436, + "orderedExact": 187, + "orderedExactRate": 0.4288990825688073, + "setExact": 250, + "setExactRate": 0.573394495412844, + "meanSetJaccard": 0.8746723460026212, + "meanTokenWeightedTv": 0.027766343987965087, + "meanAggregateLoadTv": 0.04886543528611802 + }, + { + "layer": "layer_09", + "tokens": 436, + "orderedExact": 183, + "orderedExactRate": 0.4197247706422018, + "setExact": 262, + "setExactRate": 0.6009174311926605, + "meanSetJaccard": 0.877129750982962, + "meanTokenWeightedTv": 0.027888926100855003, + "meanAggregateLoadTv": 0.040859336818172165 + }, + { + "layer": "layer_10", + "tokens": 436, + "orderedExact": 182, + "orderedExactRate": 0.41743119266055045, + "setExact": 252, + "setExactRate": 0.5779816513761468, + "meanSetJaccard": 0.8674639580602883, + "meanTokenWeightedTv": 0.030273998431795235, + "meanAggregateLoadTv": 0.050155781857589087 + }, + { + "layer": "layer_11", + "tokens": 436, + "orderedExact": 181, + "orderedExactRate": 0.4151376146788991, + "setExact": 235, + "setExactRate": 0.5389908256880734, + "meanSetJaccard": 0.8521188291830495, + "meanTokenWeightedTv": 0.03016052008610575, + "meanAggregateLoadTv": 0.05987388708272242 + }, + { + "layer": "layer_12", + "tokens": 436, + "orderedExact": 181, + "orderedExactRate": 0.4151376146788991, + "setExact": 253, + "setExactRate": 0.5802752293577982, + "meanSetJaccard": 0.8679008300567935, + "meanTokenWeightedTv": 0.03209878508056007, + "meanAggregateLoadTv": 0.0553960551199507 + }, + { + "layer": "layer_13", + "tokens": 436, + "orderedExact": 163, + "orderedExactRate": 0.3738532110091743, + "setExact": 228, + "setExactRate": 0.5229357798165137, + "meanSetJaccard": 0.8449650502402797, + "meanTokenWeightedTv": 0.03408339916231971, + "meanAggregateLoadTv": 0.05486489609230573 + }, + { + "layer": "layer_14", + "tokens": 436, + "orderedExact": 176, + "orderedExactRate": 0.4036697247706422, + "setExact": 225, + "setExactRate": 0.5160550458715596, + "meanSetJaccard": 0.8423984272608126, + "meanTokenWeightedTv": 0.03418231313858813, + "meanAggregateLoadTv": 0.056143090882046706 + }, + { + "layer": "layer_15", + "tokens": 436, + "orderedExact": 143, + "orderedExactRate": 0.32798165137614677, + "setExact": 210, + "setExactRate": 0.481651376146789, + "meanSetJaccard": 0.8266611064776203, + "meanTokenWeightedTv": 0.03662366621195706, + "meanAggregateLoadTv": 0.054983160153842886 + }, + { + "layer": "layer_16", + "tokens": 436, + "orderedExact": 136, + "orderedExactRate": 0.3119266055045872, + "setExact": 208, + "setExactRate": 0.47706422018348627, + "meanSetJaccard": 0.8234381826124947, + "meanTokenWeightedTv": 0.0398225833945772, + "meanAggregateLoadTv": 0.0669193971653811 + }, + { + "layer": "layer_17", + "tokens": 436, + "orderedExact": 146, + "orderedExactRate": 0.3348623853211009, + "setExact": 210, + "setExactRate": 0.481651376146789, + "meanSetJaccard": 0.816601135867191, + "meanTokenWeightedTv": 0.040817804300527866, + "meanAggregateLoadTv": 0.06440384554089373 + }, + { + "layer": "layer_18", + "tokens": 436, + "orderedExact": 151, + "orderedExactRate": 0.3463302752293578, + "setExact": 208, + "setExactRate": 0.47706422018348627, + "meanSetJaccard": 0.8175185670598516, + "meanTokenWeightedTv": 0.042103479182736235, + "meanAggregateLoadTv": 0.07311036473938079 + }, + { + "layer": "layer_19", + "tokens": 436, + "orderedExact": 125, + "orderedExactRate": 0.286697247706422, + "setExact": 198, + "setExactRate": 0.4541284403669725, + "meanSetJaccard": 0.8068370467453037, + "meanTokenWeightedTv": 0.039621991971036205, + "meanAggregateLoadTv": 0.06584100954080874 + }, + { + "layer": "layer_20", + "tokens": 436, + "orderedExact": 119, + "orderedExactRate": 0.27293577981651373, + "setExact": 191, + "setExactRate": 0.4380733944954128, + "meanSetJaccard": 0.8077217125382264, + "meanTokenWeightedTv": 0.039888082906736164, + "meanAggregateLoadTv": 0.07090763849046981 + }, + { + "layer": "layer_21", + "tokens": 436, + "orderedExact": 116, + "orderedExactRate": 0.26605504587155965, + "setExact": 189, + "setExactRate": 0.4334862385321101, + "meanSetJaccard": 0.8061817387505461, + "meanTokenWeightedTv": 0.04012510875068978, + "meanAggregateLoadTv": 0.0628108332802108 + }, + { + "layer": "layer_22", + "tokens": 436, + "orderedExact": 140, + "orderedExactRate": 0.3211009174311927, + "setExact": 184, + "setExactRate": 0.42201834862385323, + "meanSetJaccard": 0.8030034949759721, + "meanTokenWeightedTv": 0.04245473293043342, + "meanAggregateLoadTv": 0.07237481672722636 + }, + { + "layer": "layer_23", + "tokens": 436, + "orderedExact": 114, + "orderedExactRate": 0.26146788990825687, + "setExact": 185, + "setExactRate": 0.4243119266055046, + "meanSetJaccard": 0.8098514635211882, + "meanTokenWeightedTv": 0.03887504619988082, + "meanAggregateLoadTv": 0.05673972344404071 + }, + { + "layer": "layer_24", + "tokens": 436, + "orderedExact": 103, + "orderedExactRate": 0.23623853211009174, + "setExact": 156, + "setExactRate": 0.3577981651376147, + "meanSetJaccard": 0.7662407164700744, + "meanTokenWeightedTv": 0.041695939522246164, + "meanAggregateLoadTv": 0.07278545398525318 + }, + { + "layer": "layer_25", + "tokens": 436, + "orderedExact": 153, + "orderedExactRate": 0.35091743119266056, + "setExact": 213, + "setExactRate": 0.48853211009174313, + "meanSetJaccard": 0.8313128003494976, + "meanTokenWeightedTv": 0.036628514844027814, + "meanAggregateLoadTv": 0.058761036208325367 + }, + { + "layer": "layer_26", + "tokens": 436, + "orderedExact": 145, + "orderedExactRate": 0.33256880733944955, + "setExact": 212, + "setExactRate": 0.48623853211009177, + "meanSetJaccard": 0.8277304499781564, + "meanTokenWeightedTv": 0.03718966004781547, + "meanAggregateLoadTv": 0.06572799133040097 + } + ] + }, + "math": { + "system_eos": [ + { + "layer": "layer_01", + "tokens": 344, + "orderedExact": 222, + "orderedExactRate": 0.6453488372093024, + "setExact": 249, + "setExactRate": 0.7238372093023255, + "meanSetJaccard": 0.9174972314507197, + "meanTokenWeightedTv": 0.012446613199235488, + "meanAggregateLoadTv": 0.04253574414506711 + }, + { + "layer": "layer_02", + "tokens": 344, + "orderedExact": 255, + "orderedExactRate": 0.7412790697674418, + "setExact": 285, + "setExactRate": 0.8284883720930233, + "meanSetJaccard": 0.9509966777408638, + "meanTokenWeightedTv": 0.010281405340500285, + "meanAggregateLoadTv": 0.026235883283608034 + }, + { + "layer": "layer_03", + "tokens": 344, + "orderedExact": 270, + "orderedExactRate": 0.7848837209302325, + "setExact": 295, + "setExactRate": 0.8575581395348837, + "meanSetJaccard": 0.9586794019933557, + "meanTokenWeightedTv": 0.008661713694543133, + "meanAggregateLoadTv": 0.020954896884419635 + }, + { + "layer": "layer_04", + "tokens": 344, + "orderedExact": 278, + "orderedExactRate": 0.8081395348837209, + "setExact": 304, + "setExactRate": 0.8837209302325582, + "meanSetJaccard": 0.966154485049834, + "meanTokenWeightedTv": 0.008718356624555064, + "meanAggregateLoadTv": 0.019235941738716435 + }, + { + "layer": "layer_05", + "tokens": 344, + "orderedExact": 281, + "orderedExactRate": 0.8168604651162791, + "setExact": 306, + "setExactRate": 0.8895348837209303, + "meanSetJaccard": 0.9678156146179403, + "meanTokenWeightedTv": 0.008183724783274074, + "meanAggregateLoadTv": 0.01595255291148743 + }, + { + "layer": "layer_06", + "tokens": 344, + "orderedExact": 280, + "orderedExactRate": 0.813953488372093, + "setExact": 305, + "setExactRate": 0.8866279069767442, + "meanSetJaccard": 0.9676079734219271, + "meanTokenWeightedTv": 0.008790531484337887, + "meanAggregateLoadTv": 0.016299860861459087 + }, + { + "layer": "layer_07", + "tokens": 344, + "orderedExact": 264, + "orderedExactRate": 0.7674418604651163, + "setExact": 298, + "setExactRate": 0.8662790697674418, + "meanSetJaccard": 0.961794019933555, + "meanTokenWeightedTv": 0.00928028573641923, + "meanAggregateLoadTv": 0.0171108678045415 + }, + { + "layer": "layer_08", + "tokens": 344, + "orderedExact": 261, + "orderedExactRate": 0.7587209302325582, + "setExact": 295, + "setExactRate": 0.8575581395348837, + "meanSetJaccard": 0.9574335548172759, + "meanTokenWeightedTv": 0.00937618473235969, + "meanAggregateLoadTv": 0.015125538113884394 + }, + { + "layer": "layer_09", + "tokens": 344, + "orderedExact": 265, + "orderedExactRate": 0.7703488372093024, + "setExact": 293, + "setExactRate": 0.8517441860465116, + "meanSetJaccard": 0.9576411960132892, + "meanTokenWeightedTv": 0.010201408079309075, + "meanAggregateLoadTv": 0.021032859462382217 + }, + { + "layer": "layer_10", + "tokens": 344, + "orderedExact": 256, + "orderedExactRate": 0.7441860465116279, + "setExact": 291, + "setExactRate": 0.8459302325581395, + "meanSetJaccard": 0.9553571428571431, + "meanTokenWeightedTv": 0.010471513832975864, + "meanAggregateLoadTv": 0.022067437966439077 + }, + { + "layer": "layer_11", + "tokens": 344, + "orderedExact": 255, + "orderedExactRate": 0.7412790697674418, + "setExact": 295, + "setExactRate": 0.8575581395348837, + "meanSetJaccard": 0.9593023255813955, + "meanTokenWeightedTv": 0.009567704396884874, + "meanAggregateLoadTv": 0.021233539310675828 + }, + { + "layer": "layer_12", + "tokens": 344, + "orderedExact": 237, + "orderedExactRate": 0.688953488372093, + "setExact": 270, + "setExactRate": 0.7848837209302325, + "meanSetJaccard": 0.936046511627907, + "meanTokenWeightedTv": 0.013099523600635266, + "meanAggregateLoadTv": 0.026178389607912363 + }, + { + "layer": "layer_13", + "tokens": 344, + "orderedExact": 204, + "orderedExactRate": 0.5930232558139535, + "setExact": 242, + "setExactRate": 0.7034883720930233, + "meanSetJaccard": 0.9140365448504983, + "meanTokenWeightedTv": 0.014203941652572659, + "meanAggregateLoadTv": 0.03539410664826868 + }, + { + "layer": "layer_14", + "tokens": 344, + "orderedExact": 218, + "orderedExactRate": 0.6337209302325582, + "setExact": 264, + "setExactRate": 0.7674418604651163, + "meanSetJaccard": 0.9323089700996678, + "meanTokenWeightedTv": 0.013537274710135739, + "meanAggregateLoadTv": 0.03236927591811055 + }, + { + "layer": "layer_15", + "tokens": 344, + "orderedExact": 208, + "orderedExactRate": 0.6046511627906976, + "setExact": 257, + "setExactRate": 0.747093023255814, + "meanSetJaccard": 0.9264950166112959, + "meanTokenWeightedTv": 0.01405979715541755, + "meanAggregateLoadTv": 0.03274095618712711 + }, + { + "layer": "layer_16", + "tokens": 344, + "orderedExact": 225, + "orderedExactRate": 0.6540697674418605, + "setExact": 263, + "setExactRate": 0.7645348837209303, + "meanSetJaccard": 0.9321013289036547, + "meanTokenWeightedTv": 0.013196835860983934, + "meanAggregateLoadTv": 0.029557402531875335 + }, + { + "layer": "layer_17", + "tokens": 344, + "orderedExact": 213, + "orderedExactRate": 0.6191860465116279, + "setExact": 255, + "setExactRate": 0.7412790697674418, + "meanSetJaccard": 0.9223421926910299, + "meanTokenWeightedTv": 0.015421644241434315, + "meanAggregateLoadTv": 0.034233840046825614 + }, + { + "layer": "layer_18", + "tokens": 344, + "orderedExact": 208, + "orderedExactRate": 0.6046511627906976, + "setExact": 257, + "setExactRate": 0.747093023255814, + "meanSetJaccard": 0.9264950166112959, + "meanTokenWeightedTv": 0.014714539848021145, + "meanAggregateLoadTv": 0.03688354857888709 + }, + { + "layer": "layer_19", + "tokens": 344, + "orderedExact": 231, + "orderedExactRate": 0.6715116279069767, + "setExact": 266, + "setExactRate": 0.7732558139534884, + "meanSetJaccard": 0.9314784053156147, + "meanTokenWeightedTv": 0.015151965765331944, + "meanAggregateLoadTv": 0.031494833645222105 + }, + { + "layer": "layer_20", + "tokens": 344, + "orderedExact": 193, + "orderedExactRate": 0.561046511627907, + "setExact": 238, + "setExactRate": 0.6918604651162791, + "meanSetJaccard": 0.9102297895902546, + "meanTokenWeightedTv": 0.015168814783910722, + "meanAggregateLoadTv": 0.036188932678943776 + }, + { + "layer": "layer_21", + "tokens": 344, + "orderedExact": 192, + "orderedExactRate": 0.5581395348837209, + "setExact": 247, + "setExactRate": 0.7180232558139535, + "meanSetJaccard": 0.9156976744186046, + "meanTokenWeightedTv": 0.015531430248182345, + "meanAggregateLoadTv": 0.03477253079084378 + }, + { + "layer": "layer_22", + "tokens": 344, + "orderedExact": 207, + "orderedExactRate": 0.6017441860465116, + "setExact": 242, + "setExactRate": 0.7034883720930233, + "meanSetJaccard": 0.9123062015503877, + "meanTokenWeightedTv": 0.016355703616565374, + "meanAggregateLoadTv": 0.0368139504654488 + }, + { + "layer": "layer_23", + "tokens": 344, + "orderedExact": 223, + "orderedExactRate": 0.6482558139534884, + "setExact": 263, + "setExactRate": 0.7645348837209303, + "meanSetJaccard": 0.9314784053156147, + "meanTokenWeightedTv": 0.014471110424431579, + "meanAggregateLoadTv": 0.034220081944832226 + }, + { + "layer": "layer_24", + "tokens": 344, + "orderedExact": 202, + "orderedExactRate": 0.5872093023255814, + "setExact": 246, + "setExactRate": 0.7151162790697675, + "meanSetJaccard": 0.9150055370985604, + "meanTokenWeightedTv": 0.014211217492019573, + "meanAggregateLoadTv": 0.03840767900146368 + }, + { + "layer": "layer_25", + "tokens": 344, + "orderedExact": 202, + "orderedExactRate": 0.5872093023255814, + "setExact": 250, + "setExactRate": 0.7267441860465116, + "meanSetJaccard": 0.9188122923588039, + "meanTokenWeightedTv": 0.013887068751389536, + "meanAggregateLoadTv": 0.03669169468281566 + }, + { + "layer": "layer_26", + "tokens": 344, + "orderedExact": 217, + "orderedExactRate": 0.6308139534883721, + "setExact": 264, + "setExactRate": 0.7674418604651163, + "meanSetJaccard": 0.9291943521594683, + "meanTokenWeightedTv": 0.013544494941107025, + "meanAggregateLoadTv": 0.029957829638739737 + } + ], + "system_bos": [ + { + "layer": "layer_01", + "tokens": 344, + "orderedExact": 178, + "orderedExactRate": 0.5174418604651163, + "setExact": 222, + "setExactRate": 0.6453488372093024, + "meanSetJaccard": 0.889327242524917, + "meanTokenWeightedTv": 0.01814268520374711, + "meanAggregateLoadTv": 0.05560533533618994 + }, + { + "layer": "layer_02", + "tokens": 344, + "orderedExact": 210, + "orderedExactRate": 0.6104651162790697, + "setExact": 262, + "setExactRate": 0.7616279069767442, + "meanSetJaccard": 0.9300249169435216, + "meanTokenWeightedTv": 0.01607606177780845, + "meanAggregateLoadTv": 0.0292437639551957 + }, + { + "layer": "layer_03", + "tokens": 344, + "orderedExact": 226, + "orderedExactRate": 0.6569767441860465, + "setExact": 265, + "setExactRate": 0.7703488372093024, + "meanSetJaccard": 0.9331395348837209, + "meanTokenWeightedTv": 0.015313805968471194, + "meanAggregateLoadTv": 0.02839908763882127 + }, + { + "layer": "layer_04", + "tokens": 344, + "orderedExact": 245, + "orderedExactRate": 0.7122093023255814, + "setExact": 278, + "setExactRate": 0.8081395348837209, + "meanSetJaccard": 0.9439368770764119, + "meanTokenWeightedTv": 0.014135092033113465, + "meanAggregateLoadTv": 0.029895874915297785 + }, + { + "layer": "layer_05", + "tokens": 344, + "orderedExact": 238, + "orderedExactRate": 0.6918604651162791, + "setExact": 265, + "setExactRate": 0.7703488372093024, + "meanSetJaccard": 0.9331395348837209, + "meanTokenWeightedTv": 0.015776760861647462, + "meanAggregateLoadTv": 0.032475985333920966 + }, + { + "layer": "layer_06", + "tokens": 344, + "orderedExact": 234, + "orderedExactRate": 0.6802325581395349, + "setExact": 264, + "setExactRate": 0.7674418604651163, + "meanSetJaccard": 0.9323089700996678, + "meanTokenWeightedTv": 0.015759120328466856, + "meanAggregateLoadTv": 0.031395633018829465 + }, + { + "layer": "layer_07", + "tokens": 344, + "orderedExact": 227, + "orderedExactRate": 0.6598837209302325, + "setExact": 273, + "setExactRate": 0.7936046511627907, + "meanSetJaccard": 0.9391611295681064, + "meanTokenWeightedTv": 0.015403306220247074, + "meanAggregateLoadTv": 0.026626542234200395 + }, + { + "layer": "layer_08", + "tokens": 344, + "orderedExact": 227, + "orderedExactRate": 0.6598837209302325, + "setExact": 277, + "setExactRate": 0.8052325581395349, + "meanSetJaccard": 0.9418604651162791, + "meanTokenWeightedTv": 0.014203045195540744, + "meanAggregateLoadTv": 0.026782467390125544 + }, + { + "layer": "layer_09", + "tokens": 344, + "orderedExact": 228, + "orderedExactRate": 0.6627906976744186, + "setExact": 269, + "setExactRate": 0.7819767441860465, + "meanSetJaccard": 0.9364617940199337, + "meanTokenWeightedTv": 0.015013393374838702, + "meanAggregateLoadTv": 0.024500449181359282 + }, + { + "layer": "layer_10", + "tokens": 344, + "orderedExact": 214, + "orderedExactRate": 0.622093023255814, + "setExact": 266, + "setExactRate": 0.7732558139534884, + "meanSetJaccard": 0.9328626799557033, + "meanTokenWeightedTv": 0.015182739700449428, + "meanAggregateLoadTv": 0.026906203779122756 + }, + { + "layer": "layer_11", + "tokens": 344, + "orderedExact": 211, + "orderedExactRate": 0.6133720930232558, + "setExact": 256, + "setExactRate": 0.7441860465116279, + "meanSetJaccard": 0.9244186046511628, + "meanTokenWeightedTv": 0.015752140640401133, + "meanAggregateLoadTv": 0.02887208368617914 + }, + { + "layer": "layer_12", + "tokens": 344, + "orderedExact": 197, + "orderedExactRate": 0.5726744186046512, + "setExact": 240, + "setExactRate": 0.6976744186046512, + "meanSetJaccard": 0.9073920265780732, + "meanTokenWeightedTv": 0.01918914033427229, + "meanAggregateLoadTv": 0.03826254112047675 + }, + { + "layer": "layer_13", + "tokens": 344, + "orderedExact": 175, + "orderedExactRate": 0.5087209302325582, + "setExact": 239, + "setExactRate": 0.6947674418604651, + "meanSetJaccard": 0.9091915836101884, + "meanTokenWeightedTv": 0.017009215608594825, + "meanAggregateLoadTv": 0.03088522762496125 + }, + { + "layer": "layer_14", + "tokens": 344, + "orderedExact": 174, + "orderedExactRate": 0.5058139534883721, + "setExact": 227, + "setExactRate": 0.6598837209302325, + "meanSetJaccard": 0.8972176079734219, + "meanTokenWeightedTv": 0.01939571425126998, + "meanAggregateLoadTv": 0.03863422138949331 + }, + { + "layer": "layer_15", + "tokens": 344, + "orderedExact": 170, + "orderedExactRate": 0.4941860465116279, + "setExact": 222, + "setExactRate": 0.6453488372093024, + "meanSetJaccard": 0.8963178294573645, + "meanTokenWeightedTv": 0.019600388555938944, + "meanAggregateLoadTv": 0.039946336672196825 + }, + { + "layer": "layer_16", + "tokens": 344, + "orderedExact": 189, + "orderedExactRate": 0.5494186046511628, + "setExact": 241, + "setExactRate": 0.7005813953488372, + "meanSetJaccard": 0.9100913621262458, + "meanTokenWeightedTv": 0.01821807156988185, + "meanAggregateLoadTv": 0.03686362769326143 + }, + { + "layer": "layer_17", + "tokens": 344, + "orderedExact": 176, + "orderedExactRate": 0.5116279069767442, + "setExact": 226, + "setExactRate": 0.6569767441860465, + "meanSetJaccard": 0.8963870431893689, + "meanTokenWeightedTv": 0.02085032131090013, + "meanAggregateLoadTv": 0.03875825582262874 + }, + { + "layer": "layer_18", + "tokens": 344, + "orderedExact": 183, + "orderedExactRate": 0.5319767441860465, + "setExact": 228, + "setExactRate": 0.6627906976744186, + "meanSetJaccard": 0.9011627906976745, + "meanTokenWeightedTv": 0.01889433816142175, + "meanAggregateLoadTv": 0.041354076051634325 + }, + { + "layer": "layer_19", + "tokens": 344, + "orderedExact": 202, + "orderedExactRate": 0.5872093023255814, + "setExact": 247, + "setExactRate": 0.7180232558139535, + "meanSetJaccard": 0.9153516057585825, + "meanTokenWeightedTv": 0.018086130778411487, + "meanAggregateLoadTv": 0.03127830938596755 + }, + { + "layer": "layer_20", + "tokens": 344, + "orderedExact": 175, + "orderedExactRate": 0.5087209302325582, + "setExact": 230, + "setExactRate": 0.6686046511627907, + "meanSetJaccard": 0.9035852713178294, + "meanTokenWeightedTv": 0.019167713923268388, + "meanAggregateLoadTv": 0.041242905588077625 + }, + { + "layer": "layer_21", + "tokens": 344, + "orderedExact": 167, + "orderedExactRate": 0.48546511627906974, + "setExact": 234, + "setExactRate": 0.6802325581395349, + "meanSetJaccard": 0.9061461794019934, + "meanTokenWeightedTv": 0.01910282184873818, + "meanAggregateLoadTv": 0.04251808262629572 + }, + { + "layer": "layer_22", + "tokens": 344, + "orderedExact": 200, + "orderedExactRate": 0.5813953488372093, + "setExact": 242, + "setExactRate": 0.7034883720930233, + "meanSetJaccard": 0.9096760797342193, + "meanTokenWeightedTv": 0.01701706195936655, + "meanAggregateLoadTv": 0.035280215330159834 + }, + { + "layer": "layer_23", + "tokens": 344, + "orderedExact": 207, + "orderedExactRate": 0.6017441860465116, + "setExact": 256, + "setExactRate": 0.7441860465116279, + "meanSetJaccard": 0.923795681063123, + "meanTokenWeightedTv": 0.016180888037607345, + "meanAggregateLoadTv": 0.032679472565710084 + }, + { + "layer": "layer_24", + "tokens": 344, + "orderedExact": 176, + "orderedExactRate": 0.5116279069767442, + "setExact": 227, + "setExactRate": 0.6598837209302325, + "meanSetJaccard": 0.8998477297895903, + "meanTokenWeightedTv": 0.01686458855237863, + "meanAggregateLoadTv": 0.03765471375071819 + }, + { + "layer": "layer_25", + "tokens": 344, + "orderedExact": 190, + "orderedExactRate": 0.5523255813953488, + "setExact": 243, + "setExactRate": 0.7063953488372093, + "meanSetJaccard": 0.9129983388704318, + "meanTokenWeightedTv": 0.015616094749241366, + "meanAggregateLoadTv": 0.03906471249700994 + }, + { + "layer": "layer_26", + "tokens": 344, + "orderedExact": 213, + "orderedExactRate": 0.6191860465116279, + "setExact": 240, + "setExactRate": 0.6976744186046512, + "meanSetJaccard": 0.9098837209302325, + "meanTokenWeightedTv": 0.01676470685790605, + "meanAggregateLoadTv": 0.037483251842297345 + } + ], + "system_x": [ + { + "layer": "layer_01", + "tokens": 344, + "orderedExact": 168, + "orderedExactRate": 0.4883720930232558, + "setExact": 208, + "setExactRate": 0.6046511627906976, + "meanSetJaccard": 0.8772148394241419, + "meanTokenWeightedTv": 0.020737259284056078, + "meanAggregateLoadTv": 0.06673121725840928 + }, + { + "layer": "layer_02", + "tokens": 344, + "orderedExact": 203, + "orderedExactRate": 0.5901162790697675, + "setExact": 239, + "setExactRate": 0.6947674418604651, + "meanSetJaccard": 0.9084302325581395, + "meanTokenWeightedTv": 0.021585691796016875, + "meanAggregateLoadTv": 0.04881177493552632 + }, + { + "layer": "layer_03", + "tokens": 344, + "orderedExact": 212, + "orderedExactRate": 0.6162790697674418, + "setExact": 256, + "setExactRate": 0.7441860465116279, + "meanSetJaccard": 0.9262873754152825, + "meanTokenWeightedTv": 0.018442580158847588, + "meanAggregateLoadTv": 0.030335201589363626 + }, + { + "layer": "layer_04", + "tokens": 344, + "orderedExact": 228, + "orderedExactRate": 0.6627906976744186, + "setExact": 258, + "setExactRate": 0.75, + "meanSetJaccard": 0.9255952380952381, + "meanTokenWeightedTv": 0.01790041373407916, + "meanAggregateLoadTv": 0.03541503703823348 + }, + { + "layer": "layer_05", + "tokens": 344, + "orderedExact": 220, + "orderedExactRate": 0.6395348837209303, + "setExact": 255, + "setExactRate": 0.7412790697674418, + "meanSetJaccard": 0.9248338870431895, + "meanTokenWeightedTv": 0.01920281793770327, + "meanAggregateLoadTv": 0.03676668643372306 + }, + { + "layer": "layer_06", + "tokens": 344, + "orderedExact": 224, + "orderedExactRate": 0.6511627906976745, + "setExact": 260, + "setExactRate": 0.7558139534883721, + "meanSetJaccard": 0.9283637873754154, + "meanTokenWeightedTv": 0.01776419036855733, + "meanAggregateLoadTv": 0.03267229066341164 + }, + { + "layer": "layer_07", + "tokens": 344, + "orderedExact": 201, + "orderedExactRate": 0.5843023255813954, + "setExact": 260, + "setExactRate": 0.7558139534883721, + "meanSetJaccard": 0.9302325581395349, + "meanTokenWeightedTv": 0.01859643464947145, + "meanAggregateLoadTv": 0.029396083738481075 + }, + { + "layer": "layer_08", + "tokens": 344, + "orderedExact": 208, + "orderedExactRate": 0.6046511627906976, + "setExact": 253, + "setExactRate": 0.7354651162790697, + "meanSetJaccard": 0.9225498338870433, + "meanTokenWeightedTv": 0.0185188383216611, + "meanAggregateLoadTv": 0.03143453258603092 + }, + { + "layer": "layer_09", + "tokens": 344, + "orderedExact": 188, + "orderedExactRate": 0.5465116279069767, + "setExact": 239, + "setExactRate": 0.6947674418604651, + "meanSetJaccard": 0.9098145071982281, + "meanTokenWeightedTv": 0.019620736526596586, + "meanAggregateLoadTv": 0.03870007952971327 + }, + { + "layer": "layer_10", + "tokens": 344, + "orderedExact": 180, + "orderedExactRate": 0.5232558139534884, + "setExact": 238, + "setExactRate": 0.6918604651162791, + "meanSetJaccard": 0.9058693244739756, + "meanTokenWeightedTv": 0.021342149470767457, + "meanAggregateLoadTv": 0.04045496341556275 + }, + { + "layer": "layer_11", + "tokens": 344, + "orderedExact": 194, + "orderedExactRate": 0.563953488372093, + "setExact": 247, + "setExactRate": 0.7180232558139535, + "meanSetJaccard": 0.9154485049833887, + "meanTokenWeightedTv": 0.018398012454959565, + "meanAggregateLoadTv": 0.03438976520275078 + }, + { + "layer": "layer_12", + "tokens": 344, + "orderedExact": 184, + "orderedExactRate": 0.5348837209302325, + "setExact": 235, + "setExactRate": 0.6831395348837209, + "meanSetJaccard": 0.9015088593576969, + "meanTokenWeightedTv": 0.021449800140883407, + "meanAggregateLoadTv": 0.042531840728289125 + }, + { + "layer": "layer_13", + "tokens": 344, + "orderedExact": 151, + "orderedExactRate": 0.438953488372093, + "setExact": 207, + "setExactRate": 0.6017441860465116, + "meanSetJaccard": 0.879014396456257, + "meanTokenWeightedTv": 0.021981436970410294, + "meanAggregateLoadTv": 0.04760628253968986 + }, + { + "layer": "layer_14", + "tokens": 344, + "orderedExact": 177, + "orderedExactRate": 0.5145348837209303, + "setExact": 219, + "setExactRate": 0.6366279069767442, + "meanSetJaccard": 0.8869739756367663, + "meanTokenWeightedTv": 0.02340863627530974, + "meanAggregateLoadTv": 0.047916950289314336 + }, + { + "layer": "layer_15", + "tokens": 344, + "orderedExact": 147, + "orderedExactRate": 0.4273255813953488, + "setExact": 198, + "setExactRate": 0.5755813953488372, + "meanSetJaccard": 0.875, + "meanTokenWeightedTv": 0.024816586780793223, + "meanAggregateLoadTv": 0.047676351755153085 + }, + { + "layer": "layer_16", + "tokens": 344, + "orderedExact": 165, + "orderedExactRate": 0.4796511627906977, + "setExact": 217, + "setExactRate": 0.6308139534883721, + "meanSetJaccard": 0.8895348837209303, + "meanTokenWeightedTv": 0.023139774009028502, + "meanAggregateLoadTv": 0.03885387991936272 + }, + { + "layer": "layer_17", + "tokens": 344, + "orderedExact": 162, + "orderedExactRate": 0.47093023255813954, + "setExact": 223, + "setExactRate": 0.6482558139534884, + "meanSetJaccard": 0.8921650055370984, + "meanTokenWeightedTv": 0.024262039591647473, + "meanAggregateLoadTv": 0.040884983421054455 + }, + { + "layer": "layer_18", + "tokens": 344, + "orderedExact": 166, + "orderedExactRate": 0.48255813953488375, + "setExact": 221, + "setExactRate": 0.6424418604651163, + "meanSetJaccard": 0.8953488372093024, + "meanTokenWeightedTv": 0.02185280908245941, + "meanAggregateLoadTv": 0.04460200724074198 + }, + { + "layer": "layer_19", + "tokens": 344, + "orderedExact": 173, + "orderedExactRate": 0.502906976744186, + "setExact": 210, + "setExactRate": 0.6104651162790697, + "meanSetJaccard": 0.8813676633444074, + "meanTokenWeightedTv": 0.02468670831319586, + "meanAggregateLoadTv": 0.04240958494565598 + }, + { + "layer": "layer_20", + "tokens": 344, + "orderedExact": 145, + "orderedExactRate": 0.42151162790697677, + "setExact": 192, + "setExactRate": 0.5581395348837209, + "meanSetJaccard": 0.8634413067552602, + "meanTokenWeightedTv": 0.024498482046348892, + "meanAggregateLoadTv": 0.05285805099900549 + }, + { + "layer": "layer_21", + "tokens": 344, + "orderedExact": 152, + "orderedExactRate": 0.4418604651162791, + "setExact": 193, + "setExactRate": 0.561046511627907, + "meanSetJaccard": 0.8617801771871539, + "meanTokenWeightedTv": 0.02587013449430669, + "meanAggregateLoadTv": 0.051463050602895216 + }, + { + "layer": "layer_22", + "tokens": 344, + "orderedExact": 165, + "orderedExactRate": 0.4796511627906977, + "setExact": 218, + "setExactRate": 0.6337209302325582, + "meanSetJaccard": 0.8825442967884828, + "meanTokenWeightedTv": 0.02288089964642359, + "meanAggregateLoadTv": 0.04528685498441325 + }, + { + "layer": "layer_23", + "tokens": 344, + "orderedExact": 164, + "orderedExactRate": 0.47674418604651164, + "setExact": 214, + "setExactRate": 0.622093023255814, + "meanSetJaccard": 0.8814368770764119, + "meanTokenWeightedTv": 0.023509414744386566, + "meanAggregateLoadTv": 0.046121051684314726 + }, + { + "layer": "layer_24", + "tokens": 344, + "orderedExact": 156, + "orderedExactRate": 0.45348837209302323, + "setExact": 205, + "setExactRate": 0.5959302325581395, + "meanSetJaccard": 0.8753460686600222, + "meanTokenWeightedTv": 0.02180483611763285, + "meanAggregateLoadTv": 0.047707598318031175 + }, + { + "layer": "layer_25", + "tokens": 344, + "orderedExact": 161, + "orderedExactRate": 0.4680232558139535, + "setExact": 213, + "setExactRate": 0.6191860465116279, + "meanSetJaccard": 0.8874584717607973, + "meanTokenWeightedTv": 0.021988304323363895, + "meanAggregateLoadTv": 0.05053493154214575 + }, + { + "layer": "layer_26", + "tokens": 344, + "orderedExact": 167, + "orderedExactRate": 0.48546511627906974, + "setExact": 203, + "setExactRate": 0.5901162790697675, + "meanSetJaccard": 0.8724390919158362, + "meanTokenWeightedTv": 0.02381818531925187, + "meanAggregateLoadTv": 0.046682326482548456 + } + ], + "system_period": [ + { + "layer": "layer_01", + "tokens": 344, + "orderedExact": 161, + "orderedExactRate": 0.4680232558139535, + "setExact": 203, + "setExactRate": 0.5901162790697675, + "meanSetJaccard": 0.8693244739756367, + "meanTokenWeightedTv": 0.021389051564982185, + "meanAggregateLoadTv": 0.0695592715570518 + }, + { + "layer": "layer_02", + "tokens": 344, + "orderedExact": 199, + "orderedExactRate": 0.5784883720930233, + "setExact": 240, + "setExactRate": 0.6976744186046512, + "meanSetJaccard": 0.9105066445182725, + "meanTokenWeightedTv": 0.021498318802576265, + "meanAggregateLoadTv": 0.04726577191893508 + }, + { + "layer": "layer_03", + "tokens": 344, + "orderedExact": 215, + "orderedExactRate": 0.625, + "setExact": 253, + "setExactRate": 0.7354651162790697, + "meanSetJaccard": 0.9225498338870433, + "meanTokenWeightedTv": 0.01842778106150585, + "meanAggregateLoadTv": 0.03309021584548777 + }, + { + "layer": "layer_04", + "tokens": 344, + "orderedExact": 223, + "orderedExactRate": 0.6482558139534884, + "setExact": 256, + "setExactRate": 0.7441860465116279, + "meanSetJaccard": 0.9240725359911407, + "meanTokenWeightedTv": 0.01807059871589601, + "meanAggregateLoadTv": 0.03661912574232219 + }, + { + "layer": "layer_05", + "tokens": 344, + "orderedExact": 213, + "orderedExactRate": 0.6191860465116279, + "setExact": 252, + "setExactRate": 0.7325581395348837, + "meanSetJaccard": 0.92171926910299, + "meanTokenWeightedTv": 0.019621634047892775, + "meanAggregateLoadTv": 0.037159768194729347 + }, + { + "layer": "layer_06", + "tokens": 344, + "orderedExact": 222, + "orderedExactRate": 0.6453488372093024, + "setExact": 253, + "setExactRate": 0.7354651162790697, + "meanSetJaccard": 0.9231727574750832, + "meanTokenWeightedTv": 0.01875343877996182, + "meanAggregateLoadTv": 0.03117253255987995 + }, + { + "layer": "layer_07", + "tokens": 344, + "orderedExact": 203, + "orderedExactRate": 0.5901162790697675, + "setExact": 257, + "setExactRate": 0.747093023255814, + "meanSetJaccard": 0.9264950166112959, + "meanTokenWeightedTv": 0.01965392383878872, + "meanAggregateLoadTv": 0.03263322765265052 + }, + { + "layer": "layer_08", + "tokens": 344, + "orderedExact": 196, + "orderedExactRate": 0.5697674418604651, + "setExact": 243, + "setExactRate": 0.7063953488372093, + "meanSetJaccard": 0.9123754152823921, + "meanTokenWeightedTv": 0.0207437991831472, + "meanAggregateLoadTv": 0.03822785262851855 + }, + { + "layer": "layer_09", + "tokens": 344, + "orderedExact": 179, + "orderedExactRate": 0.5203488372093024, + "setExact": 229, + "setExactRate": 0.6656976744186046, + "meanSetJaccard": 0.9013704318936877, + "meanTokenWeightedTv": 0.02064120865709476, + "meanAggregateLoadTv": 0.03612293993814526 + }, + { + "layer": "layer_10", + "tokens": 344, + "orderedExact": 183, + "orderedExactRate": 0.5319767441860465, + "setExact": 242, + "setExactRate": 0.7034883720930233, + "meanSetJaccard": 0.9115448504983388, + "meanTokenWeightedTv": 0.020844581536823073, + "meanAggregateLoadTv": 0.04060744664240779 + }, + { + "layer": "layer_11", + "tokens": 344, + "orderedExact": 184, + "orderedExactRate": 0.5348837209302325, + "setExact": 233, + "setExactRate": 0.6773255813953488, + "meanSetJaccard": 0.9054540420819491, + "meanTokenWeightedTv": 0.019520623480484334, + "meanAggregateLoadTv": 0.03520764638966637 + }, + { + "layer": "layer_12", + "tokens": 344, + "orderedExact": 170, + "orderedExactRate": 0.4941860465116279, + "setExact": 224, + "setExactRate": 0.6511627906976745, + "meanSetJaccard": 0.8929955703211517, + "meanTokenWeightedTv": 0.022892741717984805, + "meanAggregateLoadTv": 0.046230731927180316 + }, + { + "layer": "layer_13", + "tokens": 344, + "orderedExact": 160, + "orderedExactRate": 0.46511627906976744, + "setExact": 222, + "setExactRate": 0.6453488372093024, + "meanSetJaccard": 0.8873477297895903, + "meanTokenWeightedTv": 0.02093074921552805, + "meanAggregateLoadTv": 0.041796373552755346 + }, + { + "layer": "layer_14", + "tokens": 344, + "orderedExact": 159, + "orderedExactRate": 0.4622093023255814, + "setExact": 214, + "setExactRate": 0.622093023255814, + "meanSetJaccard": 0.8855481727574751, + "meanTokenWeightedTv": 0.023746312588848968, + "meanAggregateLoadTv": 0.046652560526034455 + }, + { + "layer": "layer_15", + "tokens": 344, + "orderedExact": 153, + "orderedExactRate": 0.44476744186046513, + "setExact": 200, + "setExactRate": 0.5813953488372093, + "meanSetJaccard": 0.8760382059800665, + "meanTokenWeightedTv": 0.02461276040492691, + "meanAggregateLoadTv": 0.049825798008372925 + }, + { + "layer": "layer_16", + "tokens": 344, + "orderedExact": 166, + "orderedExactRate": 0.48255813953488375, + "setExact": 209, + "setExactRate": 0.6075581395348837, + "meanSetJaccard": 0.8822674418604652, + "meanTokenWeightedTv": 0.023711767941952976, + "meanAggregateLoadTv": 0.047693542171899556 + }, + { + "layer": "layer_17", + "tokens": 344, + "orderedExact": 168, + "orderedExactRate": 0.4883720930232558, + "setExact": 226, + "setExactRate": 0.6569767441860465, + "meanSetJaccard": 0.8976328903654485, + "meanTokenWeightedTv": 0.023428488774622256, + "meanAggregateLoadTv": 0.04060205300493869 + }, + { + "layer": "layer_18", + "tokens": 344, + "orderedExact": 166, + "orderedExactRate": 0.48255813953488375, + "setExact": 214, + "setExactRate": 0.622093023255814, + "meanSetJaccard": 0.8895348837209304, + "meanTokenWeightedTv": 0.023479617932214578, + "meanAggregateLoadTv": 0.04497742748297687 + }, + { + "layer": "layer_19", + "tokens": 344, + "orderedExact": 170, + "orderedExactRate": 0.4941860465116279, + "setExact": 215, + "setExactRate": 0.625, + "meanSetJaccard": 0.8841362126245846, + "meanTokenWeightedTv": 0.024618624328981303, + "meanAggregateLoadTv": 0.046227289998100204 + }, + { + "layer": "layer_20", + "tokens": 344, + "orderedExact": 148, + "orderedExactRate": 0.43023255813953487, + "setExact": 194, + "setExactRate": 0.563953488372093, + "meanSetJaccard": 0.8668327796234774, + "meanTokenWeightedTv": 0.02461841006510162, + "meanAggregateLoadTv": 0.053663116287977555 + }, + { + "layer": "layer_21", + "tokens": 344, + "orderedExact": 133, + "orderedExactRate": 0.3866279069767442, + "setExact": 187, + "setExactRate": 0.5436046511627907, + "meanSetJaccard": 0.8615033222591363, + "meanTokenWeightedTv": 0.025418168009459386, + "meanAggregateLoadTv": 0.05436609665244516 + }, + { + "layer": "layer_22", + "tokens": 344, + "orderedExact": 154, + "orderedExactRate": 0.4476744186046512, + "setExact": 208, + "setExactRate": 0.6046511627906976, + "meanSetJaccard": 0.8789451827242526, + "meanTokenWeightedTv": 0.023553620337474577, + "meanAggregateLoadTv": 0.047371077642997736 + }, + { + "layer": "layer_23", + "tokens": 344, + "orderedExact": 157, + "orderedExactRate": 0.4563953488372093, + "setExact": 211, + "setExactRate": 0.6133720930232558, + "meanSetJaccard": 0.8824335548172758, + "meanTokenWeightedTv": 0.023257024375982656, + "meanAggregateLoadTv": 0.04421758798839819 + }, + { + "layer": "layer_24", + "tokens": 344, + "orderedExact": 157, + "orderedExactRate": 0.4563953488372093, + "setExact": 208, + "setExactRate": 0.6046511627906976, + "meanSetJaccard": 0.8772148394241419, + "meanTokenWeightedTv": 0.020788519463844784, + "meanAggregateLoadTv": 0.04759222639355825 + }, + { + "layer": "layer_25", + "tokens": 344, + "orderedExact": 164, + "orderedExactRate": 0.47674418604651164, + "setExact": 212, + "setExactRate": 0.6162790697674418, + "meanSetJaccard": 0.8806755260243633, + "meanTokenWeightedTv": 0.022266706853473376, + "meanAggregateLoadTv": 0.05183940343485294 + }, + { + "layer": "layer_26", + "tokens": 344, + "orderedExact": 179, + "orderedExactRate": 0.5203488372093024, + "setExact": 216, + "setExactRate": 0.627906976744186, + "meanSetJaccard": 0.8863510520487267, + "meanTokenWeightedTv": 0.021925345983860808, + "meanAggregateLoadTv": 0.04493657620738642 + } + ], + "bos_at_s0": [ + { + "layer": "layer_01", + "tokens": 344, + "orderedExact": 133, + "orderedExactRate": 0.3866279069767442, + "setExact": 179, + "setExactRate": 0.5203488372093024, + "meanSetJaccard": 0.8464147286821706, + "meanTokenWeightedTv": 0.028049164276536136, + "meanAggregateLoadTv": 0.07233811972990663 + }, + { + "layer": "layer_02", + "tokens": 344, + "orderedExact": 161, + "orderedExactRate": 0.4680232558139535, + "setExact": 210, + "setExactRate": 0.6104651162790697, + "meanSetJaccard": 0.8756229235880398, + "meanTokenWeightedTv": 0.02833768243406915, + "meanAggregateLoadTv": 0.0561974528955661 + }, + { + "layer": "layer_03", + "tokens": 344, + "orderedExact": 196, + "orderedExactRate": 0.5697674418604651, + "setExact": 240, + "setExactRate": 0.6976744186046512, + "meanSetJaccard": 0.9092607973421927, + "meanTokenWeightedTv": 0.022832055932652393, + "meanAggregateLoadTv": 0.040203106504438355 + }, + { + "layer": "layer_04", + "tokens": 344, + "orderedExact": 213, + "orderedExactRate": 0.6191860465116279, + "setExact": 255, + "setExactRate": 0.7412790697674418, + "meanSetJaccard": 0.9223421926910299, + "meanTokenWeightedTv": 0.021139673365206047, + "meanAggregateLoadTv": 0.038137785612813356 + }, + { + "layer": "layer_05", + "tokens": 344, + "orderedExact": 208, + "orderedExactRate": 0.6046511627906976, + "setExact": 249, + "setExactRate": 0.7238372093023255, + "meanSetJaccard": 0.9186046511627907, + "meanTokenWeightedTv": 0.021511744791904402, + "meanAggregateLoadTv": 0.03421634197161389 + }, + { + "layer": "layer_06", + "tokens": 344, + "orderedExact": 203, + "orderedExactRate": 0.5901162790697675, + "setExact": 255, + "setExactRate": 0.7412790697674418, + "meanSetJaccard": 0.9254568106312293, + "meanTokenWeightedTv": 0.018469173888147266, + "meanAggregateLoadTv": 0.03255887044732772 + }, + { + "layer": "layer_07", + "tokens": 344, + "orderedExact": 206, + "orderedExactRate": 0.5988372093023255, + "setExact": 249, + "setExactRate": 0.7238372093023255, + "meanSetJaccard": 0.9181201550387597, + "meanTokenWeightedTv": 0.020500034834092584, + "meanAggregateLoadTv": 0.038716385428372115 + }, + { + "layer": "layer_08", + "tokens": 344, + "orderedExact": 216, + "orderedExactRate": 0.627906976744186, + "setExact": 254, + "setExactRate": 0.7383720930232558, + "meanSetJaccard": 0.9215116279069767, + "meanTokenWeightedTv": 0.018490829117069105, + "meanAggregateLoadTv": 0.03408181830767846 + }, + { + "layer": "layer_09", + "tokens": 344, + "orderedExact": 205, + "orderedExactRate": 0.5959302325581395, + "setExact": 245, + "setExactRate": 0.7122093023255814, + "meanSetJaccard": 0.9159053156146181, + "meanTokenWeightedTv": 0.019818364750250506, + "meanAggregateLoadTv": 0.03752066118880769 + }, + { + "layer": "layer_10", + "tokens": 344, + "orderedExact": 199, + "orderedExactRate": 0.5784883720930233, + "setExact": 239, + "setExactRate": 0.6947674418604651, + "meanSetJaccard": 0.9084302325581395, + "meanTokenWeightedTv": 0.020610935624736575, + "meanAggregateLoadTv": 0.03497375865577863 + }, + { + "layer": "layer_11", + "tokens": 344, + "orderedExact": 200, + "orderedExactRate": 0.5813953488372093, + "setExact": 244, + "setExactRate": 0.7093023255813954, + "meanSetJaccard": 0.9138289036544851, + "meanTokenWeightedTv": 0.01816873517245157, + "meanAggregateLoadTv": 0.03191049946044397 + }, + { + "layer": "layer_12", + "tokens": 344, + "orderedExact": 185, + "orderedExactRate": 0.5377906976744186, + "setExact": 226, + "setExactRate": 0.6569767441860465, + "meanSetJaccard": 0.8951411960132891, + "meanTokenWeightedTv": 0.02336473322402691, + "meanAggregateLoadTv": 0.045809835918049005 + }, + { + "layer": "layer_13", + "tokens": 344, + "orderedExact": 164, + "orderedExactRate": 0.47674418604651164, + "setExact": 215, + "setExactRate": 0.625, + "meanSetJaccard": 0.8835132890365449, + "meanTokenWeightedTv": 0.021824303373751804, + "meanAggregateLoadTv": 0.041274161765282744 + }, + { + "layer": "layer_14", + "tokens": 344, + "orderedExact": 150, + "orderedExactRate": 0.436046511627907, + "setExact": 205, + "setExactRate": 0.5959302325581395, + "meanSetJaccard": 0.8814368770764119, + "meanTokenWeightedTv": 0.022811992934947987, + "meanAggregateLoadTv": 0.04167458887214714 + }, + { + "layer": "layer_15", + "tokens": 344, + "orderedExact": 161, + "orderedExactRate": 0.4680232558139535, + "setExact": 224, + "setExactRate": 0.6511627906976745, + "meanSetJaccard": 0.8941029900332227, + "meanTokenWeightedTv": 0.021734418345560926, + "meanAggregateLoadTv": 0.04023873720044642 + }, + { + "layer": "layer_16", + "tokens": 344, + "orderedExact": 162, + "orderedExactRate": 0.47093023255813954, + "setExact": 210, + "setExactRate": 0.6104651162790697, + "meanSetJaccard": 0.8837209302325582, + "meanTokenWeightedTv": 0.022784675667658183, + "meanAggregateLoadTv": 0.04373201640127278 + }, + { + "layer": "layer_17", + "tokens": 344, + "orderedExact": 173, + "orderedExactRate": 0.502906976744186, + "setExact": 211, + "setExactRate": 0.6133720930232558, + "meanSetJaccard": 0.8833056478405314, + "meanTokenWeightedTv": 0.02374680668315063, + "meanAggregateLoadTv": 0.046248220388065 + }, + { + "layer": "layer_18", + "tokens": 344, + "orderedExact": 165, + "orderedExactRate": 0.4796511627906977, + "setExact": 222, + "setExactRate": 0.6453488372093024, + "meanSetJaccard": 0.8968023255813954, + "meanTokenWeightedTv": 0.021021399587726187, + "meanAggregateLoadTv": 0.04453810080891102 + }, + { + "layer": "layer_19", + "tokens": 344, + "orderedExact": 178, + "orderedExactRate": 0.5174418604651163, + "setExact": 224, + "setExactRate": 0.6511627906976745, + "meanSetJaccard": 0.896110188261351, + "meanTokenWeightedTv": 0.021986557490315473, + "meanAggregateLoadTv": 0.042761651987512146 + }, + { + "layer": "layer_20", + "tokens": 344, + "orderedExact": 154, + "orderedExactRate": 0.4476744186046512, + "setExact": 211, + "setExactRate": 0.6133720930232558, + "meanSetJaccard": 0.8870431893687708, + "meanTokenWeightedTv": 0.021670928718335973, + "meanAggregateLoadTv": 0.04531542876437438 + }, + { + "layer": "layer_21", + "tokens": 344, + "orderedExact": 166, + "orderedExactRate": 0.48255813953488375, + "setExact": 222, + "setExactRate": 0.6453488372093024, + "meanSetJaccard": 0.8900885935769659, + "meanTokenWeightedTv": 0.021419838663820485, + "meanAggregateLoadTv": 0.05141625767319441 + }, + { + "layer": "layer_22", + "tokens": 344, + "orderedExact": 179, + "orderedExactRate": 0.5203488372093024, + "setExact": 238, + "setExactRate": 0.6918604651162791, + "meanSetJaccard": 0.9063538205980066, + "meanTokenWeightedTv": 0.019437609112649273, + "meanAggregateLoadTv": 0.04008820568199037 + }, + { + "layer": "layer_23", + "tokens": 344, + "orderedExact": 204, + "orderedExactRate": 0.5930232558139535, + "setExact": 237, + "setExactRate": 0.688953488372093, + "meanSetJaccard": 0.9070459579180509, + "meanTokenWeightedTv": 0.01832463758572974, + "meanAggregateLoadTv": 0.03817723319665606 + }, + { + "layer": "layer_24", + "tokens": 344, + "orderedExact": 170, + "orderedExactRate": 0.4941860465116279, + "setExact": 217, + "setExactRate": 0.6308139534883721, + "meanSetJaccard": 0.8914036544850499, + "meanTokenWeightedTv": 0.017514555847578744, + "meanAggregateLoadTv": 0.04270135092832096 + }, + { + "layer": "layer_25", + "tokens": 344, + "orderedExact": 169, + "orderedExactRate": 0.49127906976744184, + "setExact": 226, + "setExactRate": 0.6569767441860465, + "meanSetJaccard": 0.8995016611295682, + "meanTokenWeightedTv": 0.01758967929183124, + "meanAggregateLoadTv": 0.042542454945340626 + }, + { + "layer": "layer_26", + "tokens": 344, + "orderedExact": 211, + "orderedExactRate": 0.6133720930232558, + "setExact": 249, + "setExactRate": 0.7238372093023255, + "meanSetJaccard": 0.9192275747508306, + "meanTokenWeightedTv": 0.016403414190966817, + "meanAggregateLoadTv": 0.03553385089178652 + } + ], + "bos_at_s1": [ + { + "layer": "layer_01", + "tokens": 344, + "orderedExact": 142, + "orderedExactRate": 0.4127906976744186, + "setExact": 195, + "setExactRate": 0.5668604651162791, + "meanSetJaccard": 0.8588732004429679, + "meanTokenWeightedTv": 0.024433594192876527, + "meanAggregateLoadTv": 0.06426024868033747 + }, + { + "layer": "layer_02", + "tokens": 344, + "orderedExact": 168, + "orderedExactRate": 0.4883720930232558, + "setExact": 211, + "setExactRate": 0.6133720930232558, + "meanSetJaccard": 0.8795681063122923, + "meanTokenWeightedTv": 0.027448699565077877, + "meanAggregateLoadTv": 0.05807131407852828 + }, + { + "layer": "layer_03", + "tokens": 344, + "orderedExact": 184, + "orderedExactRate": 0.5348837209302325, + "setExact": 226, + "setExactRate": 0.6569767441860465, + "meanSetJaccard": 0.8988787375415282, + "meanTokenWeightedTv": 0.024532902655176846, + "meanAggregateLoadTv": 0.04401784072982741 + }, + { + "layer": "layer_04", + "tokens": 344, + "orderedExact": 196, + "orderedExactRate": 0.5697674418604651, + "setExact": 243, + "setExactRate": 0.7063953488372093, + "meanSetJaccard": 0.9142441860465116, + "meanTokenWeightedTv": 0.02238667602006571, + "meanAggregateLoadTv": 0.04490009945059889 + }, + { + "layer": "layer_05", + "tokens": 344, + "orderedExact": 187, + "orderedExactRate": 0.5436046511627907, + "setExact": 233, + "setExactRate": 0.6773255813953488, + "meanSetJaccard": 0.9046926910299004, + "meanTokenWeightedTv": 0.023346064047766957, + "meanAggregateLoadTv": 0.035174438504072245 + }, + { + "layer": "layer_06", + "tokens": 344, + "orderedExact": 212, + "orderedExactRate": 0.6162790697674418, + "setExact": 251, + "setExactRate": 0.7296511627906976, + "meanSetJaccard": 0.9215116279069767, + "meanTokenWeightedTv": 0.019824087089490218, + "meanAggregateLoadTv": 0.03654850851021772 + }, + { + "layer": "layer_07", + "tokens": 344, + "orderedExact": 193, + "orderedExactRate": 0.561046511627907, + "setExact": 248, + "setExactRate": 0.7209302325581395, + "meanSetJaccard": 0.9144518272425248, + "meanTokenWeightedTv": 0.022588015589226837, + "meanAggregateLoadTv": 0.044042684150897245 + }, + { + "layer": "layer_08", + "tokens": 344, + "orderedExact": 195, + "orderedExactRate": 0.5668604651162791, + "setExact": 242, + "setExactRate": 0.7034883720930233, + "meanSetJaccard": 0.910437430786268, + "meanTokenWeightedTv": 0.021004956024351436, + "meanAggregateLoadTv": 0.04422001079881213 + }, + { + "layer": "layer_09", + "tokens": 344, + "orderedExact": 197, + "orderedExactRate": 0.5726744186046512, + "setExact": 235, + "setExactRate": 0.6831395348837209, + "meanSetJaccard": 0.9064922480620156, + "meanTokenWeightedTv": 0.021924722058628908, + "meanAggregateLoadTv": 0.041474841613576355 + }, + { + "layer": "layer_10", + "tokens": 344, + "orderedExact": 181, + "orderedExactRate": 0.5261627906976745, + "setExact": 231, + "setExactRate": 0.6715116279069767, + "meanSetJaccard": 0.9025470653377632, + "meanTokenWeightedTv": 0.022602262319421147, + "meanAggregateLoadTv": 0.04740505467475501 + }, + { + "layer": "layer_11", + "tokens": 344, + "orderedExact": 187, + "orderedExactRate": 0.5436046511627907, + "setExact": 235, + "setExactRate": 0.6831395348837209, + "meanSetJaccard": 0.9064922480620154, + "meanTokenWeightedTv": 0.020123907530002958, + "meanAggregateLoadTv": 0.03627376950073953 + }, + { + "layer": "layer_12", + "tokens": 344, + "orderedExact": 182, + "orderedExactRate": 0.5290697674418605, + "setExact": 235, + "setExactRate": 0.6831395348837209, + "meanSetJaccard": 0.9026162790697675, + "meanTokenWeightedTv": 0.021448950782044132, + "meanAggregateLoadTv": 0.03659475342327728 + }, + { + "layer": "layer_13", + "tokens": 344, + "orderedExact": 147, + "orderedExactRate": 0.4273255813953488, + "setExact": 207, + "setExactRate": 0.6017441860465116, + "meanSetJaccard": 0.8776301218161684, + "meanTokenWeightedTv": 0.022089593706192637, + "meanAggregateLoadTv": 0.04520154706059255 + }, + { + "layer": "layer_14", + "tokens": 344, + "orderedExact": 148, + "orderedExactRate": 0.43023255813953487, + "setExact": 213, + "setExactRate": 0.6191860465116279, + "meanSetJaccard": 0.884482281284607, + "meanTokenWeightedTv": 0.024031944191478312, + "meanAggregateLoadTv": 0.04753613640961033 + }, + { + "layer": "layer_15", + "tokens": 344, + "orderedExact": 151, + "orderedExactRate": 0.438953488372093, + "setExact": 206, + "setExactRate": 0.5988372093023255, + "meanSetJaccard": 0.8785299003322259, + "meanTokenWeightedTv": 0.02370102474171554, + "meanAggregateLoadTv": 0.04697651527562737 + }, + { + "layer": "layer_16", + "tokens": 344, + "orderedExact": 172, + "orderedExactRate": 0.5, + "setExact": 220, + "setExactRate": 0.6395348837209303, + "meanSetJaccard": 0.8938953488372093, + "meanTokenWeightedTv": 0.022018332394463498, + "meanAggregateLoadTv": 0.04662771710496461 + }, + { + "layer": "layer_17", + "tokens": 344, + "orderedExact": 160, + "orderedExactRate": 0.46511627906976744, + "setExact": 208, + "setExactRate": 0.6046511627906976, + "meanSetJaccard": 0.8795681063122924, + "meanTokenWeightedTv": 0.023709123850553536, + "meanAggregateLoadTv": 0.041801767190224465 + }, + { + "layer": "layer_18", + "tokens": 344, + "orderedExact": 171, + "orderedExactRate": 0.49709302325581395, + "setExact": 225, + "setExactRate": 0.6540697674418605, + "meanSetJaccard": 0.8968023255813954, + "meanTokenWeightedTv": 0.02192597123265794, + "meanAggregateLoadTv": 0.04364046877920352 + }, + { + "layer": "layer_19", + "tokens": 344, + "orderedExact": 189, + "orderedExactRate": 0.5494186046511628, + "setExact": 225, + "setExactRate": 0.6540697674418605, + "meanSetJaccard": 0.8961794019933557, + "meanTokenWeightedTv": 0.021801800013533355, + "meanAggregateLoadTv": 0.04356429446607027 + }, + { + "layer": "layer_20", + "tokens": 344, + "orderedExact": 148, + "orderedExactRate": 0.43023255813953487, + "setExact": 203, + "setExactRate": 0.5901162790697675, + "meanSetJaccard": 0.8763150609080842, + "meanTokenWeightedTv": 0.022114020376070697, + "meanAggregateLoadTv": 0.050349490402209596 + }, + { + "layer": "layer_21", + "tokens": 344, + "orderedExact": 143, + "orderedExactRate": 0.41569767441860467, + "setExact": 190, + "setExactRate": 0.5523255813953488, + "meanSetJaccard": 0.8671096345514951, + "meanTokenWeightedTv": 0.02359005404372766, + "meanAggregateLoadTv": 0.047781657479215756 + }, + { + "layer": "layer_22", + "tokens": 344, + "orderedExact": 168, + "orderedExactRate": 0.4883720930232558, + "setExact": 218, + "setExactRate": 0.6337209302325582, + "meanSetJaccard": 0.8884966777408638, + "meanTokenWeightedTv": 0.02121991119672273, + "meanAggregateLoadTv": 0.04055190467510112 + }, + { + "layer": "layer_23", + "tokens": 344, + "orderedExact": 197, + "orderedExactRate": 0.5726744186046512, + "setExact": 238, + "setExactRate": 0.6918604651162791, + "meanSetJaccard": 0.9075996677740864, + "meanTokenWeightedTv": 0.01951583372272611, + "meanAggregateLoadTv": 0.04303294906791022 + }, + { + "layer": "layer_24", + "tokens": 344, + "orderedExact": 156, + "orderedExactRate": 0.45348837209302323, + "setExact": 211, + "setExactRate": 0.6133720930232558, + "meanSetJaccard": 0.8833056478405317, + "meanTokenWeightedTv": 0.01951579546087972, + "meanAggregateLoadTv": 0.046710602218371367 + }, + { + "layer": "layer_25", + "tokens": 344, + "orderedExact": 174, + "orderedExactRate": 0.5058139534883721, + "setExact": 223, + "setExactRate": 0.6482558139534884, + "meanSetJaccard": 0.8945182724252492, + "meanTokenWeightedTv": 0.01775439121589991, + "meanAggregateLoadTv": 0.04504952532144541 + }, + { + "layer": "layer_26", + "tokens": 344, + "orderedExact": 188, + "orderedExactRate": 0.5465116279069767, + "setExact": 227, + "setExactRate": 0.6598837209302325, + "meanSetJaccard": 0.8953488372093024, + "meanTokenWeightedTv": 0.019420342266365402, + "meanAggregateLoadTv": 0.04762144433343102 + } + ], + "x_at_s0": [ + { + "layer": "layer_01", + "tokens": 344, + "orderedExact": 147, + "orderedExactRate": 0.4273255813953488, + "setExact": 190, + "setExactRate": 0.5523255813953488, + "meanSetJaccard": 0.8560354374307863, + "meanTokenWeightedTv": 0.02513708234746391, + "meanAggregateLoadTv": 0.06764597240457396 + }, + { + "layer": "layer_02", + "tokens": 344, + "orderedExact": 161, + "orderedExactRate": 0.4680232558139535, + "setExact": 212, + "setExactRate": 0.6162790697674418, + "meanSetJaccard": 0.8785299003322259, + "meanTokenWeightedTv": 0.026483741168247976, + "meanAggregateLoadTv": 0.05060822155716717 + }, + { + "layer": "layer_03", + "tokens": 344, + "orderedExact": 194, + "orderedExactRate": 0.563953488372093, + "setExact": 239, + "setExactRate": 0.6947674418604651, + "meanSetJaccard": 0.9090531561461794, + "meanTokenWeightedTv": 0.022019903132938685, + "meanAggregateLoadTv": 0.04096294599901702 + }, + { + "layer": "layer_04", + "tokens": 344, + "orderedExact": 215, + "orderedExactRate": 0.625, + "setExact": 253, + "setExactRate": 0.7354651162790697, + "meanSetJaccard": 0.9188122923588039, + "meanTokenWeightedTv": 0.022120880746433664, + "meanAggregateLoadTv": 0.04611332176537504 + }, + { + "layer": "layer_05", + "tokens": 344, + "orderedExact": 199, + "orderedExactRate": 0.5784883720930233, + "setExact": 245, + "setExactRate": 0.7122093023255814, + "meanSetJaccard": 0.9140365448504983, + "meanTokenWeightedTv": 0.021814291153154728, + "meanAggregateLoadTv": 0.034393197517503846 + }, + { + "layer": "layer_06", + "tokens": 344, + "orderedExact": 207, + "orderedExactRate": 0.6017441860465116, + "setExact": 254, + "setExactRate": 0.7383720930232558, + "meanSetJaccard": 0.9240033222591363, + "meanTokenWeightedTv": 0.019271278890298057, + "meanAggregateLoadTv": 0.03537660857305697 + }, + { + "layer": "layer_07", + "tokens": 344, + "orderedExact": 194, + "orderedExactRate": 0.563953488372093, + "setExact": 237, + "setExactRate": 0.688953488372093, + "meanSetJaccard": 0.9055232558139535, + "meanTokenWeightedTv": 0.023764867381119853, + "meanAggregateLoadTv": 0.041733870812672144 + }, + { + "layer": "layer_08", + "tokens": 344, + "orderedExact": 186, + "orderedExactRate": 0.5406976744186046, + "setExact": 232, + "setExactRate": 0.6744186046511628, + "meanSetJaccard": 0.9038621262458473, + "meanTokenWeightedTv": 0.021093382771526104, + "meanAggregateLoadTv": 0.03729560902146918 + }, + { + "layer": "layer_09", + "tokens": 344, + "orderedExact": 195, + "orderedExactRate": 0.5668604651162791, + "setExact": 234, + "setExactRate": 0.6802325581395349, + "meanSetJaccard": 0.9061461794019934, + "meanTokenWeightedTv": 0.02196336081628802, + "meanAggregateLoadTv": 0.039824551991588616 + }, + { + "layer": "layer_10", + "tokens": 344, + "orderedExact": 178, + "orderedExactRate": 0.5174418604651163, + "setExact": 233, + "setExactRate": 0.6773255813953488, + "meanSetJaccard": 0.9028239202657807, + "meanTokenWeightedTv": 0.021978303030351302, + "meanAggregateLoadTv": 0.03580811879923978 + }, + { + "layer": "layer_11", + "tokens": 344, + "orderedExact": 179, + "orderedExactRate": 0.5203488372093024, + "setExact": 237, + "setExactRate": 0.688953488372093, + "meanSetJaccard": 0.9073920265780732, + "meanTokenWeightedTv": 0.02076293447200627, + "meanAggregateLoadTv": 0.03593920053409509 + }, + { + "layer": "layer_12", + "tokens": 344, + "orderedExact": 173, + "orderedExactRate": 0.502906976744186, + "setExact": 232, + "setExactRate": 0.6744186046511628, + "meanSetJaccard": 0.899640088593577, + "meanTokenWeightedTv": 0.023214637396884463, + "meanAggregateLoadTv": 0.04122002348972382 + }, + { + "layer": "layer_13", + "tokens": 344, + "orderedExact": 149, + "orderedExactRate": 0.4331395348837209, + "setExact": 196, + "setExactRate": 0.5697674418604651, + "meanSetJaccard": 0.8655177187153932, + "meanTokenWeightedTv": 0.025306985643192895, + "meanAggregateLoadTv": 0.052260770546009166 + }, + { + "layer": "layer_14", + "tokens": 344, + "orderedExact": 161, + "orderedExactRate": 0.4680232558139535, + "setExact": 214, + "setExactRate": 0.622093023255814, + "meanSetJaccard": 0.8821982281284607, + "meanTokenWeightedTv": 0.0239133677927439, + "meanAggregateLoadTv": 0.03997610262871084 + }, + { + "layer": "layer_15", + "tokens": 344, + "orderedExact": 164, + "orderedExactRate": 0.47674418604651164, + "setExact": 218, + "setExactRate": 0.6337209302325582, + "meanSetJaccard": 0.8881506090808416, + "meanTokenWeightedTv": 0.024186410433493753, + "meanAggregateLoadTv": 0.04684199161169194 + }, + { + "layer": "layer_16", + "tokens": 344, + "orderedExact": 160, + "orderedExactRate": 0.46511627906976744, + "setExact": 209, + "setExactRate": 0.6075581395348837, + "meanSetJaccard": 0.8805370985603544, + "meanTokenWeightedTv": 0.02362841812208355, + "meanAggregateLoadTv": 0.04250160366975017 + }, + { + "layer": "layer_17", + "tokens": 344, + "orderedExact": 163, + "orderedExactRate": 0.4738372093023256, + "setExact": 200, + "setExactRate": 0.5813953488372093, + "meanSetJaccard": 0.8736849390919158, + "meanTokenWeightedTv": 0.02629147530397322, + "meanAggregateLoadTv": 0.05099098714526018 + }, + { + "layer": "layer_18", + "tokens": 344, + "orderedExact": 163, + "orderedExactRate": 0.4738372093023256, + "setExact": 223, + "setExactRate": 0.6482558139534884, + "meanSetJaccard": 0.8951411960132891, + "meanTokenWeightedTv": 0.021966639312807082, + "meanAggregateLoadTv": 0.04118214304118854 + }, + { + "layer": "layer_19", + "tokens": 344, + "orderedExact": 172, + "orderedExactRate": 0.5, + "setExact": 217, + "setExactRate": 0.6308139534883721, + "meanSetJaccard": 0.8885658914728682, + "meanTokenWeightedTv": 0.023102989834182804, + "meanAggregateLoadTv": 0.048971988081311056 + }, + { + "layer": "layer_20", + "tokens": 344, + "orderedExact": 149, + "orderedExactRate": 0.4331395348837209, + "setExact": 203, + "setExactRate": 0.5901162790697675, + "meanSetJaccard": 0.8763150609080842, + "meanTokenWeightedTv": 0.022989806622989627, + "meanAggregateLoadTv": 0.052942176360600335 + }, + { + "layer": "layer_21", + "tokens": 344, + "orderedExact": 138, + "orderedExactRate": 0.4011627906976744, + "setExact": 195, + "setExactRate": 0.5668604651162791, + "meanSetJaccard": 0.8689091915836102, + "meanTokenWeightedTv": 0.02454168110279552, + "meanAggregateLoadTv": 0.05840048940770362 + }, + { + "layer": "layer_22", + "tokens": 344, + "orderedExact": 175, + "orderedExactRate": 0.5087209302325582, + "setExact": 229, + "setExactRate": 0.6656976744186046, + "meanSetJaccard": 0.899640088593577, + "meanTokenWeightedTv": 0.02066911675322541, + "meanAggregateLoadTv": 0.03985431794810263 + }, + { + "layer": "layer_23", + "tokens": 344, + "orderedExact": 179, + "orderedExactRate": 0.5203488372093024, + "setExact": 220, + "setExactRate": 0.6395348837209303, + "meanSetJaccard": 0.8886627906976744, + "meanTokenWeightedTv": 0.02169570439199709, + "meanAggregateLoadTv": 0.04335690381750315 + }, + { + "layer": "layer_24", + "tokens": 344, + "orderedExact": 161, + "orderedExactRate": 0.4680232558139535, + "setExact": 218, + "setExactRate": 0.6337209302325582, + "meanSetJaccard": 0.8886351052048729, + "meanTokenWeightedTv": 0.01868956601765934, + "meanAggregateLoadTv": 0.04100676810166266 + }, + { + "layer": "layer_25", + "tokens": 344, + "orderedExact": 159, + "orderedExactRate": 0.4622093023255814, + "setExact": 222, + "setExactRate": 0.6453488372093024, + "meanSetJaccard": 0.8936877076411961, + "meanTokenWeightedTv": 0.019294087669596553, + "meanAggregateLoadTv": 0.0437236519367485 + }, + { + "layer": "layer_26", + "tokens": 344, + "orderedExact": 182, + "orderedExactRate": 0.5290697674418605, + "setExact": 229, + "setExactRate": 0.6656976744186046, + "meanSetJaccard": 0.8988787375415282, + "meanTokenWeightedTv": 0.018796032902269607, + "meanAggregateLoadTv": 0.034927984844744 + } + ], + "x_at_s1": [ + { + "layer": "layer_01", + "tokens": 344, + "orderedExact": 148, + "orderedExactRate": 0.43023255813953487, + "setExact": 193, + "setExactRate": 0.561046511627907, + "meanSetJaccard": 0.8601882613510521, + "meanTokenWeightedTv": 0.024645102797172476, + "meanAggregateLoadTv": 0.06551011119546081 + }, + { + "layer": "layer_02", + "tokens": 344, + "orderedExact": 166, + "orderedExactRate": 0.48255813953488375, + "setExact": 206, + "setExactRate": 0.5988372093023255, + "meanSetJaccard": 0.8729235880398672, + "meanTokenWeightedTv": 0.02948888340541548, + "meanAggregateLoadTv": 0.06747973107573552 + }, + { + "layer": "layer_03", + "tokens": 344, + "orderedExact": 187, + "orderedExactRate": 0.5436046511627907, + "setExact": 228, + "setExactRate": 0.6627906976744186, + "meanSetJaccard": 0.898671096345515, + "meanTokenWeightedTv": 0.025686824176394285, + "meanAggregateLoadTv": 0.041200573706123095 + }, + { + "layer": "layer_04", + "tokens": 344, + "orderedExact": 185, + "orderedExactRate": 0.5377906976744186, + "setExact": 226, + "setExactRate": 0.6569767441860465, + "meanSetJaccard": 0.8970099667774086, + "meanTokenWeightedTv": 0.025621175037803152, + "meanAggregateLoadTv": 0.0559073405771519 + }, + { + "layer": "layer_05", + "tokens": 344, + "orderedExact": 170, + "orderedExactRate": 0.4941860465116279, + "setExact": 216, + "setExactRate": 0.627906976744186, + "meanSetJaccard": 0.8863510520487266, + "meanTokenWeightedTv": 0.02789036661084765, + "meanAggregateLoadTv": 0.047591207274892064 + }, + { + "layer": "layer_06", + "tokens": 344, + "orderedExact": 192, + "orderedExactRate": 0.5581395348837209, + "setExact": 236, + "setExactRate": 0.686046511627907, + "meanSetJaccard": 0.9090531561461794, + "meanTokenWeightedTv": 0.02346956415563056, + "meanAggregateLoadTv": 0.04223468110815502 + }, + { + "layer": "layer_07", + "tokens": 344, + "orderedExact": 171, + "orderedExactRate": 0.49709302325581395, + "setExact": 227, + "setExactRate": 0.6598837209302325, + "meanSetJaccard": 0.8937569213732005, + "meanTokenWeightedTv": 0.027375765666011777, + "meanAggregateLoadTv": 0.04998664569974226 + }, + { + "layer": "layer_08", + "tokens": 344, + "orderedExact": 175, + "orderedExactRate": 0.5087209302325582, + "setExact": 225, + "setExactRate": 0.6540697674418605, + "meanSetJaccard": 0.8956949058693245, + "meanTokenWeightedTv": 0.02542375607185445, + "meanAggregateLoadTv": 0.0434016585098716 + }, + { + "layer": "layer_09", + "tokens": 344, + "orderedExact": 172, + "orderedExactRate": 0.5, + "setExact": 209, + "setExactRate": 0.6075581395348837, + "meanSetJaccard": 0.8830287929125138, + "meanTokenWeightedTv": 0.026511305757754136, + "meanAggregateLoadTv": 0.047652690896309094 + }, + { + "layer": "layer_10", + "tokens": 344, + "orderedExact": 154, + "orderedExactRate": 0.4476744186046512, + "setExact": 211, + "setExactRate": 0.6133720930232558, + "meanSetJaccard": 0.8812292358803987, + "meanTokenWeightedTv": 0.028291636475679623, + "meanAggregateLoadTv": 0.05320630115302701 + }, + { + "layer": "layer_11", + "tokens": 344, + "orderedExact": 152, + "orderedExactRate": 0.4418604651162791, + "setExact": 210, + "setExactRate": 0.6104651162790697, + "meanSetJaccard": 0.8807447397563677, + "meanTokenWeightedTv": 0.026336897628876192, + "meanAggregateLoadTv": 0.047415832335366184 + }, + { + "layer": "layer_12", + "tokens": 344, + "orderedExact": 158, + "orderedExactRate": 0.45930232558139533, + "setExact": 211, + "setExactRate": 0.6133720930232558, + "meanSetJaccard": 0.8748615725359912, + "meanTokenWeightedTv": 0.028921873367965617, + "meanAggregateLoadTv": 0.05347759823342509 + }, + { + "layer": "layer_13", + "tokens": 344, + "orderedExact": 122, + "orderedExactRate": 0.3546511627906977, + "setExact": 189, + "setExactRate": 0.5494186046511628, + "meanSetJaccard": 0.8540974529346623, + "meanTokenWeightedTv": 0.02797702164100909, + "meanAggregateLoadTv": 0.05422180483223768 + }, + { + "layer": "layer_14", + "tokens": 344, + "orderedExact": 135, + "orderedExactRate": 0.39244186046511625, + "setExact": 190, + "setExactRate": 0.5523255813953488, + "meanSetJaccard": 0.8605343300110742, + "meanTokenWeightedTv": 0.029129232404953413, + "meanAggregateLoadTv": 0.05537519718984758 + }, + { + "layer": "layer_15", + "tokens": 344, + "orderedExact": 123, + "orderedExactRate": 0.35755813953488375, + "setExact": 175, + "setExactRate": 0.5087209302325582, + "meanSetJaccard": 0.8459302325581395, + "meanTokenWeightedTv": 0.02998536322388774, + "meanAggregateLoadTv": 0.06208634357912937 + }, + { + "layer": "layer_16", + "tokens": 344, + "orderedExact": 152, + "orderedExactRate": 0.4418604651162791, + "setExact": 196, + "setExactRate": 0.5697674418604651, + "meanSetJaccard": 0.8691168327796235, + "meanTokenWeightedTv": 0.027350495395698456, + "meanAggregateLoadTv": 0.052733295491342105 + }, + { + "layer": "layer_17", + "tokens": 344, + "orderedExact": 146, + "orderedExactRate": 0.42441860465116277, + "setExact": 201, + "setExactRate": 0.5843023255813954, + "meanSetJaccard": 0.8718853820598007, + "meanTokenWeightedTv": 0.028643193553835274, + "meanAggregateLoadTv": 0.0490305008756729 + }, + { + "layer": "layer_18", + "tokens": 344, + "orderedExact": 156, + "orderedExactRate": 0.45348837209302323, + "setExact": 216, + "setExactRate": 0.627906976744186, + "meanSetJaccard": 0.8868355481727574, + "meanTokenWeightedTv": 0.025599281556526406, + "meanAggregateLoadTv": 0.052535038453462427 + }, + { + "layer": "layer_19", + "tokens": 344, + "orderedExact": 148, + "orderedExactRate": 0.43023255813953487, + "setExact": 193, + "setExactRate": 0.561046511627907, + "meanSetJaccard": 0.8660022148394242, + "meanTokenWeightedTv": 0.028066124417164127, + "meanAggregateLoadTv": 0.05362944691468555 + }, + { + "layer": "layer_20", + "tokens": 344, + "orderedExact": 129, + "orderedExactRate": 0.375, + "setExact": 169, + "setExactRate": 0.49127906976744184, + "meanSetJaccard": 0.8444767441860465, + "meanTokenWeightedTv": 0.02797601809114541, + "meanAggregateLoadTv": 0.06100747187040195 + }, + { + "layer": "layer_21", + "tokens": 344, + "orderedExact": 117, + "orderedExactRate": 0.34011627906976744, + "setExact": 166, + "setExactRate": 0.48255813953488375, + "meanSetJaccard": 0.8382059800664452, + "meanTokenWeightedTv": 0.030201219292871673, + "meanAggregateLoadTv": 0.06253746703247257 + }, + { + "layer": "layer_22", + "tokens": 344, + "orderedExact": 139, + "orderedExactRate": 0.40406976744186046, + "setExact": 197, + "setExactRate": 0.5726744186046512, + "meanSetJaccard": 0.8643410852713179, + "meanTokenWeightedTv": 0.026405247454945456, + "meanAggregateLoadTv": 0.05437968169655184 + }, + { + "layer": "layer_23", + "tokens": 344, + "orderedExact": 168, + "orderedExactRate": 0.4883720930232558, + "setExact": 217, + "setExactRate": 0.6308139534883721, + "meanSetJaccard": 0.8836794019933554, + "meanTokenWeightedTv": 0.025191709000981718, + "meanAggregateLoadTv": 0.05293287930635322 + }, + { + "layer": "layer_24", + "tokens": 344, + "orderedExact": 130, + "orderedExactRate": 0.37790697674418605, + "setExact": 189, + "setExactRate": 0.5494186046511628, + "meanSetJaccard": 0.8553433001107421, + "meanTokenWeightedTv": 0.025165551335743698, + "meanAggregateLoadTv": 0.0539334807786528 + }, + { + "layer": "layer_25", + "tokens": 344, + "orderedExact": 159, + "orderedExactRate": 0.4622093023255814, + "setExact": 196, + "setExactRate": 0.5697674418604651, + "meanSetJaccard": 0.867248062015504, + "meanTokenWeightedTv": 0.024750282309706335, + "meanAggregateLoadTv": 0.05940537886986278 + }, + { + "layer": "layer_26", + "tokens": 344, + "orderedExact": 156, + "orderedExactRate": 0.45348837209302323, + "setExact": 203, + "setExactRate": 0.5901162790697675, + "meanSetJaccard": 0.8772840531561461, + "meanTokenWeightedTv": 0.02455349966060949, + "meanAggregateLoadTv": 0.0483222999316229 + } + ], + "period_at_s0": [ + { + "layer": "layer_01", + "tokens": 344, + "orderedExact": 148, + "orderedExactRate": 0.43023255813953487, + "setExact": 190, + "setExactRate": 0.5523255813953488, + "meanSetJaccard": 0.8544435215946844, + "meanTokenWeightedTv": 0.025233464340333717, + "meanAggregateLoadTv": 0.06700494676354832 + }, + { + "layer": "layer_02", + "tokens": 344, + "orderedExact": 164, + "orderedExactRate": 0.47674418604651164, + "setExact": 211, + "setExactRate": 0.6133720930232558, + "meanSetJaccard": 0.876453488372093, + "meanTokenWeightedTv": 0.026561195941918567, + "meanAggregateLoadTv": 0.05493977393255973 + }, + { + "layer": "layer_03", + "tokens": 344, + "orderedExact": 201, + "orderedExactRate": 0.5843023255813954, + "setExact": 241, + "setExactRate": 0.7005813953488372, + "meanSetJaccard": 0.908845514950166, + "meanTokenWeightedTv": 0.022413901325486506, + "meanAggregateLoadTv": 0.03951630705237809 + }, + { + "layer": "layer_04", + "tokens": 344, + "orderedExact": 206, + "orderedExactRate": 0.5988372093023255, + "setExact": 249, + "setExactRate": 0.7238372093023255, + "meanSetJaccard": 0.9161129568106311, + "meanTokenWeightedTv": 0.02235214089620543, + "meanAggregateLoadTv": 0.045399727183855924 + }, + { + "layer": "layer_05", + "tokens": 344, + "orderedExact": 209, + "orderedExactRate": 0.6075581395348837, + "setExact": 254, + "setExactRate": 0.7383720930232558, + "meanSetJaccard": 0.9227574750830565, + "meanTokenWeightedTv": 0.02070276423148396, + "meanAggregateLoadTv": 0.03251636550748649 + }, + { + "layer": "layer_06", + "tokens": 344, + "orderedExact": 207, + "orderedExactRate": 0.6017441860465116, + "setExact": 248, + "setExactRate": 0.7209302325581395, + "meanSetJaccard": 0.9190199335548171, + "meanTokenWeightedTv": 0.02003254220070396, + "meanAggregateLoadTv": 0.0373346720322303 + }, + { + "layer": "layer_07", + "tokens": 344, + "orderedExact": 203, + "orderedExactRate": 0.5901162790697675, + "setExact": 243, + "setExactRate": 0.7063953488372093, + "meanSetJaccard": 0.9100221483942413, + "meanTokenWeightedTv": 0.022874573359816047, + "meanAggregateLoadTv": 0.03842908049345342 + }, + { + "layer": "layer_08", + "tokens": 344, + "orderedExact": 186, + "orderedExactRate": 0.5406976744186046, + "setExact": 233, + "setExactRate": 0.6773255813953488, + "meanSetJaccard": 0.9040697674418605, + "meanTokenWeightedTv": 0.0212274365707555, + "meanAggregateLoadTv": 0.03727615923786845 + }, + { + "layer": "layer_09", + "tokens": 344, + "orderedExact": 199, + "orderedExactRate": 0.5784883720930233, + "setExact": 241, + "setExactRate": 0.7005813953488372, + "meanSetJaccard": 0.9113372093023258, + "meanTokenWeightedTv": 0.02110090626355847, + "meanAggregateLoadTv": 0.03901893868597531 + }, + { + "layer": "layer_10", + "tokens": 344, + "orderedExact": 182, + "orderedExactRate": 0.5290697674418605, + "setExact": 230, + "setExactRate": 0.6686046511627907, + "meanSetJaccard": 0.8998477297895904, + "meanTokenWeightedTv": 0.022815497244923003, + "meanAggregateLoadTv": 0.04163552586138602 + }, + { + "layer": "layer_11", + "tokens": 344, + "orderedExact": 171, + "orderedExactRate": 0.49709302325581395, + "setExact": 225, + "setExactRate": 0.6540697674418605, + "meanSetJaccard": 0.8969407530454042, + "meanTokenWeightedTv": 0.021901150927943827, + "meanAggregateLoadTv": 0.03843595473728659 + }, + { + "layer": "layer_12", + "tokens": 344, + "orderedExact": 173, + "orderedExactRate": 0.502906976744186, + "setExact": 224, + "setExactRate": 0.6511627906976745, + "meanSetJaccard": 0.892995570321152, + "meanTokenWeightedTv": 0.024418018367733517, + "meanAggregateLoadTv": 0.041147454549230356 + }, + { + "layer": "layer_13", + "tokens": 344, + "orderedExact": 149, + "orderedExactRate": 0.4331395348837209, + "setExact": 205, + "setExactRate": 0.5959302325581395, + "meanSetJaccard": 0.8729928017718717, + "meanTokenWeightedTv": 0.02447936764308746, + "meanAggregateLoadTv": 0.05210437428805908 + }, + { + "layer": "layer_14", + "tokens": 344, + "orderedExact": 150, + "orderedExactRate": 0.436046511627907, + "setExact": 201, + "setExactRate": 0.5843023255813954, + "meanSetJaccard": 0.8721622369878184, + "meanTokenWeightedTv": 0.024915454642108134, + "meanAggregateLoadTv": 0.042876254765821915 + }, + { + "layer": "layer_15", + "tokens": 344, + "orderedExact": 156, + "orderedExactRate": 0.45348837209302323, + "setExact": 207, + "setExactRate": 0.6017441860465116, + "meanSetJaccard": 0.8781146179401993, + "meanTokenWeightedTv": 0.02531513484486015, + "meanAggregateLoadTv": 0.05103528034993074 + }, + { + "layer": "layer_16", + "tokens": 344, + "orderedExact": 157, + "orderedExactRate": 0.4563953488372093, + "setExact": 212, + "setExactRate": 0.6162790697674418, + "meanSetJaccard": 0.8817829457364342, + "meanTokenWeightedTv": 0.024471330529473354, + "meanAggregateLoadTv": 0.04654436088953291 + }, + { + "layer": "layer_17", + "tokens": 344, + "orderedExact": 157, + "orderedExactRate": 0.4563953488372093, + "setExact": 212, + "setExactRate": 0.6162790697674418, + "meanSetJaccard": 0.8816445182724254, + "meanTokenWeightedTv": 0.025554939553664655, + "meanAggregateLoadTv": 0.04737332739552495 + }, + { + "layer": "layer_18", + "tokens": 344, + "orderedExact": 153, + "orderedExactRate": 0.44476744186046513, + "setExact": 220, + "setExactRate": 0.6395348837209303, + "meanSetJaccard": 0.8926495016611296, + "meanTokenWeightedTv": 0.022656744415986394, + "meanAggregateLoadTv": 0.041098786825756864 + }, + { + "layer": "layer_19", + "tokens": 344, + "orderedExact": 171, + "orderedExactRate": 0.49709302325581395, + "setExact": 220, + "setExactRate": 0.6395348837209303, + "meanSetJaccard": 0.8902962347729791, + "meanTokenWeightedTv": 0.023629530803587692, + "meanAggregateLoadTv": 0.04975127735949045 + }, + { + "layer": "layer_20", + "tokens": 344, + "orderedExact": 157, + "orderedExactRate": 0.4563953488372093, + "setExact": 207, + "setExactRate": 0.6017441860465116, + "meanSetJaccard": 0.879498892580288, + "meanTokenWeightedTv": 0.02325663993293951, + "meanAggregateLoadTv": 0.046269621880054734 + }, + { + "layer": "layer_21", + "tokens": 344, + "orderedExact": 160, + "orderedExactRate": 0.46511627906976744, + "setExact": 215, + "setExactRate": 0.625, + "meanSetJaccard": 0.8856589147286822, + "meanTokenWeightedTv": 0.022911725545151945, + "meanAggregateLoadTv": 0.04997242611005097 + }, + { + "layer": "layer_22", + "tokens": 344, + "orderedExact": 164, + "orderedExactRate": 0.47674418604651164, + "setExact": 226, + "setExactRate": 0.6569767441860465, + "meanSetJaccard": 0.8965254706533777, + "meanTokenWeightedTv": 0.020896323685685038, + "meanAggregateLoadTv": 0.042460752394159716 + }, + { + "layer": "layer_23", + "tokens": 344, + "orderedExact": 185, + "orderedExactRate": 0.5377906976744186, + "setExact": 224, + "setExactRate": 0.6511627906976745, + "meanSetJaccard": 0.8948643410852715, + "meanTokenWeightedTv": 0.020405477489622823, + "meanAggregateLoadTv": 0.037490433744595784 + }, + { + "layer": "layer_24", + "tokens": 344, + "orderedExact": 161, + "orderedExactRate": 0.4680232558139535, + "setExact": 216, + "setExactRate": 0.627906976744186, + "meanSetJaccard": 0.8869739756367664, + "meanTokenWeightedTv": 0.019066494683701793, + "meanAggregateLoadTv": 0.04226381251908444 + }, + { + "layer": "layer_25", + "tokens": 344, + "orderedExact": 173, + "orderedExactRate": 0.502906976744186, + "setExact": 225, + "setExactRate": 0.6540697674418605, + "meanSetJaccard": 0.8943106312292359, + "meanTokenWeightedTv": 0.019767594169465053, + "meanAggregateLoadTv": 0.047908114722765106 + }, + { + "layer": "layer_26", + "tokens": 344, + "orderedExact": 190, + "orderedExactRate": 0.5523255813953488, + "setExact": 232, + "setExactRate": 0.6744186046511628, + "meanSetJaccard": 0.9019933554817278, + "meanTokenWeightedTv": 0.019146107074244266, + "meanAggregateLoadTv": 0.039604422359694275 + } + ], + "period_at_s1": [ + { + "layer": "layer_01", + "tokens": 344, + "orderedExact": 147, + "orderedExactRate": 0.4273255813953488, + "setExact": 192, + "setExactRate": 0.5581395348837209, + "meanSetJaccard": 0.8581118493909192, + "meanTokenWeightedTv": 0.02457831714925426, + "meanAggregateLoadTv": 0.06615653047395556 + }, + { + "layer": "layer_02", + "tokens": 344, + "orderedExact": 163, + "orderedExactRate": 0.4738372093023256, + "setExact": 199, + "setExactRate": 0.5784883720930233, + "meanSetJaccard": 0.8677325581395349, + "meanTokenWeightedTv": 0.02976280018134762, + "meanAggregateLoadTv": 0.06478620044102841 + }, + { + "layer": "layer_03", + "tokens": 344, + "orderedExact": 187, + "orderedExactRate": 0.5436046511627907, + "setExact": 227, + "setExactRate": 0.6598837209302325, + "meanSetJaccard": 0.8984634551495018, + "meanTokenWeightedTv": 0.025917058188963085, + "meanAggregateLoadTv": 0.04561696290331141 + }, + { + "layer": "layer_04", + "tokens": 344, + "orderedExact": 183, + "orderedExactRate": 0.5319767441860465, + "setExact": 223, + "setExactRate": 0.6482558139534884, + "meanSetJaccard": 0.8951411960132891, + "meanTokenWeightedTv": 0.025759150853034506, + "meanAggregateLoadTv": 0.05468185038107347 + }, + { + "layer": "layer_05", + "tokens": 344, + "orderedExact": 174, + "orderedExactRate": 0.5058139534883721, + "setExact": 220, + "setExactRate": 0.6395348837209303, + "meanSetJaccard": 0.8914036544850499, + "meanTokenWeightedTv": 0.026909275092239296, + "meanAggregateLoadTv": 0.04423227868011442 + }, + { + "layer": "layer_06", + "tokens": 344, + "orderedExact": 196, + "orderedExactRate": 0.5697674418604651, + "setExact": 237, + "setExactRate": 0.688953488372093, + "meanSetJaccard": 0.9092607973421927, + "meanTokenWeightedTv": 0.023304159602516444, + "meanAggregateLoadTv": 0.04010960717398009 + }, + { + "layer": "layer_07", + "tokens": 344, + "orderedExact": 169, + "orderedExactRate": 0.49127906976744184, + "setExact": 231, + "setExactRate": 0.6715116279069767, + "meanSetJaccard": 0.8988095238095238, + "meanTokenWeightedTv": 0.02643465518080384, + "meanAggregateLoadTv": 0.04614932742013763 + }, + { + "layer": "layer_08", + "tokens": 344, + "orderedExact": 177, + "orderedExactRate": 0.5145348837209303, + "setExact": 228, + "setExactRate": 0.6627906976744186, + "meanSetJaccard": 0.8994324473975638, + "meanTokenWeightedTv": 0.024699991865252416, + "meanAggregateLoadTv": 0.045909199988001324 + }, + { + "layer": "layer_09", + "tokens": 344, + "orderedExact": 176, + "orderedExactRate": 0.5116279069767442, + "setExact": 213, + "setExactRate": 0.6191860465116279, + "meanSetJaccard": 0.8862126245847177, + "meanTokenWeightedTv": 0.0258434770307698, + "meanAggregateLoadTv": 0.04563908546982909 + }, + { + "layer": "layer_10", + "tokens": 344, + "orderedExact": 164, + "orderedExactRate": 0.47674418604651164, + "setExact": 220, + "setExactRate": 0.6395348837209303, + "meanSetJaccard": 0.8920265780730898, + "meanTokenWeightedTv": 0.026270917449953402, + "meanAggregateLoadTv": 0.05085273312243346 + }, + { + "layer": "layer_11", + "tokens": 344, + "orderedExact": 153, + "orderedExactRate": 0.44476744186046513, + "setExact": 207, + "setExactRate": 0.6017441860465116, + "meanSetJaccard": 0.8799833887043189, + "meanTokenWeightedTv": 0.02610058060151509, + "meanAggregateLoadTv": 0.04930719159354009 + }, + { + "layer": "layer_12", + "tokens": 344, + "orderedExact": 155, + "orderedExactRate": 0.45058139534883723, + "setExact": 209, + "setExactRate": 0.6075581395348837, + "meanSetJaccard": 0.873546511627907, + "meanTokenWeightedTv": 0.028525481007897646, + "meanAggregateLoadTv": 0.05016249174129307 + }, + { + "layer": "layer_13", + "tokens": 344, + "orderedExact": 126, + "orderedExactRate": 0.36627906976744184, + "setExact": 192, + "setExactRate": 0.5581395348837209, + "meanSetJaccard": 0.8561046511627907, + "meanTokenWeightedTv": 0.027284209337160376, + "meanAggregateLoadTv": 0.05348680875872884 + }, + { + "layer": "layer_14", + "tokens": 344, + "orderedExact": 132, + "orderedExactRate": 0.38372093023255816, + "setExact": 186, + "setExactRate": 0.5406976744186046, + "meanSetJaccard": 0.8563122923588039, + "meanTokenWeightedTv": 0.02928465222529761, + "meanAggregateLoadTv": 0.05566220408062805 + }, + { + "layer": "layer_15", + "tokens": 344, + "orderedExact": 132, + "orderedExactRate": 0.38372093023255816, + "setExact": 185, + "setExactRate": 0.5377906976744186, + "meanSetJaccard": 0.8561046511627907, + "meanTokenWeightedTv": 0.02837801302505648, + "meanAggregateLoadTv": 0.053846855692027726 + }, + { + "layer": "layer_16", + "tokens": 344, + "orderedExact": 144, + "orderedExactRate": 0.4186046511627907, + "setExact": 190, + "setExactRate": 0.5523255813953488, + "meanSetJaccard": 0.8635105204872646, + "meanTokenWeightedTv": 0.02785401036855295, + "meanAggregateLoadTv": 0.05568313447059285 + }, + { + "layer": "layer_17", + "tokens": 344, + "orderedExact": 142, + "orderedExactRate": 0.4127906976744186, + "setExact": 199, + "setExactRate": 0.5784883720930233, + "meanSetJaccard": 0.8696013289036546, + "meanTokenWeightedTv": 0.027981304577104227, + "meanAggregateLoadTv": 0.048222935861670604 + }, + { + "layer": "layer_18", + "tokens": 344, + "orderedExact": 149, + "orderedExactRate": 0.4331395348837209, + "setExact": 203, + "setExactRate": 0.5901162790697675, + "meanSetJaccard": 0.8760382059800665, + "meanTokenWeightedTv": 0.026169419822265224, + "meanAggregateLoadTv": 0.05039573531526917 + }, + { + "layer": "layer_19", + "tokens": 344, + "orderedExact": 155, + "orderedExactRate": 0.45058139534883723, + "setExact": 198, + "setExactRate": 0.5755813953488372, + "meanSetJaccard": 0.8718853820598007, + "meanTokenWeightedTv": 0.027152340922566104, + "meanAggregateLoadTv": 0.05201282666598982 + }, + { + "layer": "layer_20", + "tokens": 344, + "orderedExact": 131, + "orderedExactRate": 0.3808139534883721, + "setExact": 182, + "setExactRate": 0.5290697674418605, + "meanSetJaccard": 0.85437430786268, + "meanTokenWeightedTv": 0.027139063418539812, + "meanAggregateLoadTv": 0.056315324545069274 + }, + { + "layer": "layer_21", + "tokens": 344, + "orderedExact": 117, + "orderedExactRate": 0.34011627906976744, + "setExact": 170, + "setExactRate": 0.4941860465116279, + "meanSetJaccard": 0.8406699889258029, + "meanTokenWeightedTv": 0.029810597277536592, + "meanAggregateLoadTv": 0.06233232613643269 + }, + { + "layer": "layer_22", + "tokens": 344, + "orderedExact": 139, + "orderedExactRate": 0.40406976744186046, + "setExact": 195, + "setExactRate": 0.5668604651162791, + "meanSetJaccard": 0.8651716500553711, + "meanTokenWeightedTv": 0.027022186962296125, + "meanAggregateLoadTv": 0.05149719107821216 + }, + { + "layer": "layer_23", + "tokens": 344, + "orderedExact": 162, + "orderedExactRate": 0.47093023255813954, + "setExact": 212, + "setExactRate": 0.6162790697674418, + "meanSetJaccard": 0.882890365448505, + "meanTokenWeightedTv": 0.025380894523821022, + "meanAggregateLoadTv": 0.0478067989444238 + }, + { + "layer": "layer_24", + "tokens": 344, + "orderedExact": 131, + "orderedExactRate": 0.3808139534883721, + "setExact": 189, + "setExactRate": 0.5494186046511628, + "meanSetJaccard": 0.8563122923588039, + "meanTokenWeightedTv": 0.024864821591885654, + "meanAggregateLoadTv": 0.0561487851720926 + }, + { + "layer": "layer_25", + "tokens": 344, + "orderedExact": 145, + "orderedExactRate": 0.42151162790697677, + "setExact": 187, + "setExactRate": 0.5436046511627907, + "meanSetJaccard": 0.8596345514950167, + "meanTokenWeightedTv": 0.025301108512903007, + "meanAggregateLoadTv": 0.055189198418943146 + }, + { + "layer": "layer_26", + "tokens": 344, + "orderedExact": 160, + "orderedExactRate": 0.46511627906976744, + "setExact": 202, + "setExactRate": 0.5872093023255814, + "meanSetJaccard": 0.8753460686600222, + "meanTokenWeightedTv": 0.024298849212542453, + "meanAggregateLoadTv": 0.046508903251411576 + } + ] + } + }, + "hiddenStages": [ + "embedding", + "layer_00", + "layer_01", + "layer_02", + "layer_03", + "layer_04", + "layer_05", + "layer_06", + "layer_07", + "layer_08", + "layer_09", + "layer_10", + "layer_11", + "layer_12", + "layer_13", + "layer_14", + "layer_15", + "layer_16", + "layer_17", + "layer_18", + "layer_19", + "layer_20", + "layer_21", + "layer_22", + "layer_23", + "layer_24", + "layer_25", + "layer_26", + "final_norm" + ], + "routerLayers": [ + "layer_01", + "layer_02", + "layer_03", + "layer_04", + "layer_05", + "layer_06", + "layer_07", + "layer_08", + "layer_09", + "layer_10", + "layer_11", + "layer_12", + "layer_13", + "layer_14", + "layer_15", + "layer_16", + "layer_17", + "layer_18", + "layer_19", + "layer_20", + "layer_21", + "layer_22", + "layer_23", + "layer_24", + "layer_25", + "layer_26" + ], + "boundaryCrossingTokens": 56, + "sources": [ + { + "id": "wikitext2/raw-validation/0443", + "domain": "english", + "label": "English encyclopedia", + "contentTokens": 113, + "contentTokenIdsSha256": "10896deb639b620f1a6bf8efdb19850401765d0c8ec23461f6a6f9d5307755d8", + "boundaryCrossingTokensByCondition": { + "s0_eos": 1, + "s1_eos": 1, + "s0_bos": 1, + "s1_bos": 1, + "s0_x": 1, + "s1_x": 1, + "s0_period": 1, + "s1_period": 1 + } + }, + { + "id": "wikitext2/raw-validation/0030", + "domain": "english", + "label": "English encyclopedia", + "contentTokens": 52, + "contentTokenIdsSha256": "2b6a05b0fcb5ee34d10ced7cbac994105394a3609b1eae46c5e576fc55ccdaf1", + "boundaryCrossingTokensByCondition": { + "s0_eos": 1, + "s1_eos": 1, + "s0_bos": 1, + "s1_bos": 1, + "s0_x": 1, + "s1_x": 1, + "s0_period": 1, + "s1_period": 1 + } + }, + { + "id": "wikitext2/raw-validation/2909", + "domain": "english", + "label": "English encyclopedia", + "contentTokens": 246, + "contentTokenIdsSha256": "60cc9bc9e2f8d84a575d576ba1112dddb5b657c801d6b621212db1e9010c9ef1", + "boundaryCrossingTokensByCondition": { + "s0_eos": 0, + "s1_eos": 0, + "s0_bos": 0, + "s1_bos": 0, + "s0_x": 0, + "s1_x": 0, + "s0_period": 0, + "s1_period": 0 + } + }, + { + "id": "wikitext2/raw-validation/2746", + "domain": "english", + "label": "English encyclopedia", + "contentTokens": 249, + "contentTokenIdsSha256": "4882cf630c33f9a7efc5345f4d05852d4eb66b893eea6fc233870fdbe94b6fb7", + "boundaryCrossingTokensByCondition": { + "s0_eos": 1, + "s1_eos": 1, + "s0_bos": 1, + "s1_bos": 1, + "s0_x": 1, + "s1_x": 1, + "s0_period": 1, + "s1_period": 1 + } + }, + { + "id": "tnews/test/4855", + "domain": "chinese", + "label": "中文新闻", + "contentTokens": 23, + "contentTokenIdsSha256": "f6727c5b619c00c37bbef16c2b28820c61713b846f0fc7ea5b00cf2cdbc1dc2a", + "boundaryCrossingTokensByCondition": { + "s0_eos": 0, + "s1_eos": 0, + "s0_bos": 0, + "s1_bos": 0, + "s0_x": 0, + "s1_x": 0, + "s0_period": 0, + "s1_period": 0 + } + }, + { + "id": "tnews/test/8935", + "domain": "chinese", + "label": "中文新闻", + "contentTokens": 23, + "contentTokenIdsSha256": "5c79fb63483889b5fe78559027c887b8b30e81a2d4a9a85fce68fd7db2724bdb", + "boundaryCrossingTokensByCondition": { + "s0_eos": 0, + "s1_eos": 0, + "s0_bos": 0, + "s1_bos": 0, + "s0_x": 0, + "s1_x": 0, + "s0_period": 0, + "s1_period": 0 + } + }, + { + "id": "tnews/test/3448", + "domain": "chinese", + "label": "中文新闻", + "contentTokens": 24, + "contentTokenIdsSha256": "748d2e221574cdfad884a87d0ff65bd770188bac3f4947d9df50fd2727ec2353", + "boundaryCrossingTokensByCondition": { + "s0_eos": 0, + "s1_eos": 0, + "s0_bos": 0, + "s1_bos": 0, + "s0_x": 0, + "s1_x": 0, + "s0_period": 0, + "s1_period": 0 + } + }, + { + "id": "tnews/test/1059", + "domain": "chinese", + "label": "中文新闻", + "contentTokens": 27, + "contentTokenIdsSha256": "63a87e13e168c4240f0949aa0a3e3e762f46d35cb2b163d6cb8d0f38b7f563df", + "boundaryCrossingTokensByCondition": { + "s0_eos": 0, + "s1_eos": 0, + "s0_bos": 0, + "s1_bos": 0, + "s0_x": 0, + "s1_x": 0, + "s0_period": 0, + "s1_period": 0 + } + }, + { + "id": "HumanEval/31", + "domain": "code", + "label": "Python code", + "contentTokens": 120, + "contentTokenIdsSha256": "d22768ea5348c0fe94bfddb93cbb9077aa4bc72a17b096b152e684ac5a485596", + "boundaryCrossingTokensByCondition": { + "s0_eos": 0, + "s1_eos": 0, + "s0_bos": 0, + "s1_bos": 0, + "s0_x": 0, + "s1_x": 0, + "s0_period": 0, + "s1_period": 0 + } + }, + { + "id": "HumanEval/44", + "domain": "code", + "label": "Python code", + "contentTokens": 108, + "contentTokenIdsSha256": "5343fd5759da7a3acd6ab4c0bde9c7a2789e292eb4824dd8cd461571a0f1f5f2", + "boundaryCrossingTokensByCondition": { + "s0_eos": 0, + "s1_eos": 0, + "s0_bos": 0, + "s1_bos": 0, + "s0_x": 0, + "s1_x": 0, + "s0_period": 0, + "s1_period": 0 + } + }, + { + "id": "HumanEval/133", + "domain": "code", + "label": "Python code", + "contentTokens": 166, + "contentTokenIdsSha256": "d9f876e3ac32a3f92a85e04db7e4b065951a1b97636049b0c85a8fdea09100db", + "boundaryCrossingTokensByCondition": { + "s0_eos": 0, + "s1_eos": 0, + "s0_bos": 0, + "s1_bos": 0, + "s0_x": 0, + "s1_x": 0, + "s0_period": 0, + "s1_period": 0 + } + }, + { + "id": "HumanEval/23", + "domain": "code", + "label": "Python code", + "contentTokens": 42, + "contentTokenIdsSha256": "1d8f3287aa0ecec28fd21d2e9db06b60386320bde229230ed104606876efb387", + "boundaryCrossingTokensByCondition": { + "s0_eos": 0, + "s1_eos": 0, + "s0_bos": 0, + "s1_bos": 0, + "s0_x": 0, + "s1_x": 0, + "s0_period": 0, + "s1_period": 0 + } + }, + { + "id": "gsm8k/test/1069", + "domain": "math", + "label": "Grade-school math", + "contentTokens": 106, + "contentTokenIdsSha256": "4352631307b8b721b2b062c1b5231bc7b86c810c027c92464ac415d75ff73c57", + "boundaryCrossingTokensByCondition": { + "s0_eos": 1, + "s1_eos": 1, + "s0_bos": 1, + "s1_bos": 1, + "s0_x": 1, + "s1_x": 1, + "s0_period": 1, + "s1_period": 1 + } + }, + { + "id": "gsm8k/test/1228", + "domain": "math", + "label": "Grade-school math", + "contentTokens": 34, + "contentTokenIdsSha256": "293a0ffdedad6508bd41e76e8d3cc23a311524a092c6425d28126c76b50b50f6", + "boundaryCrossingTokensByCondition": { + "s0_eos": 1, + "s1_eos": 1, + "s0_bos": 1, + "s1_bos": 1, + "s0_x": 1, + "s1_x": 1, + "s0_period": 1, + "s1_period": 1 + } + }, + { + "id": "gsm8k/test/0144", + "domain": "math", + "label": "Grade-school math", + "contentTokens": 130, + "contentTokenIdsSha256": "eb11c5f163d8bd4a0f4ef34db9d62f5380ded55677f5767d1262696fe23b6f08", + "boundaryCrossingTokensByCondition": { + "s0_eos": 1, + "s1_eos": 1, + "s0_bos": 1, + "s1_bos": 1, + "s0_x": 1, + "s1_x": 1, + "s0_period": 1, + "s1_period": 1 + } + }, + { + "id": "gsm8k/test/1251", + "domain": "math", + "label": "Grade-school math", + "contentTokens": 74, + "contentTokenIdsSha256": "b334bff623f54ef427c7c3e29cdbf323c0cceac25302b6c53d6925130817209c", + "boundaryCrossingTokensByCondition": { + "s0_eos": 1, + "s1_eos": 1, + "s0_bos": 1, + "s1_bos": 1, + "s0_x": 1, + "s1_x": 1, + "s0_period": 1, + "s1_period": 1 + } + } + ], + "reproduction": { + "sources": 4, + "sourceObjectsExactAfterRuntimeStrip": 4, + "hiddenStagesPerSource": 29, + "routerLayersPerSource": 26, + "hiddenTensorHashesExact": 1856, + "hiddenTensorHashesCompared": 1856, + "orderedRouteHashesExact": 1664, + "orderedRouteHashesCompared": 1664, + "routeWeightHashesExact": 1664, + "routeWeightHashesCompared": 1664 + }, + "execution": { + "python": "3.10.14", + "torch": "2.11.0+cu128", + "transformers": "4.41.2", + "accelerate": "1.13.0", + "safetensors": "0.8.0", + "platform": "Linux-7.0.0-28-generic-x86_64-with-glibc2.43", + "gpu": "NVIDIA GeForce RTX 5090", + "gpu_memory_limit": "28GiB", + "cpu_memory_limit": "80GiB", + "pytorch_cuda_alloc_conf": "expandable_segments:True", + "input_device": "cuda:0", + "device_map": { + "model.embed_tokens": 0, + "model.layers.0": 0, + "model.layers.1": 0, + "model.layers.2": 0, + "model.layers.3": 0, + "model.layers.4": 0, + "model.layers.5": 0, + "model.layers.6": 0, + "model.layers.7": 0, + "model.layers.8": 0, + "model.layers.9": 0, + "model.layers.10": 0, + "model.layers.11": 0, + "model.layers.12": 0, + "model.layers.13": 0, + "model.layers.14": 0, + "model.layers.15": 0, + "model.layers.16": 0, + "model.layers.17": 0, + "model.layers.18": 0, + "model.layers.19": 0, + "model.layers.20": 0, + "model.layers.21": 0, + "model.layers.22": 0, + "model.layers.23": 0, + "model.layers.24": "cpu", + "model.layers.25": "cpu", + "model.layers.26": "cpu", + "model.norm": "cpu", + "lm_head": "cpu" + }, + "load_seconds": 8.372377096995478, + "forward_seconds": 13.551748474012129, + "load_peak_cuda_memory_allocated_bytes": 28616922624, + "peak_cuda_memory_allocated_bytes": 28754760704, + "process_max_rss_kib": 18807600 + }, + "claimBoundary": [ + "The trace observes one fixed SFT Chat checkpoint, not the Base checkpoint.", + "Target comparisons exclude boundary-crossing tokens and require exact token IDs.", + "Router and hidden associations do not establish mediation or capability causality.", + "CPU in hf_device_map is offload residency, not proof of CPU matrix execution.", + "Prompt-only use_cache=False traces are not generation-time KV or serving traces." + ] + } +} diff --git a/src/data/deepseek-v2-lite-chat-full-depth-repro-1pd.json b/src/data/deepseek-v2-lite-chat-full-depth-repro-1pd.json new file mode 100644 index 0000000..203447e --- /dev/null +++ b/src/data/deepseek-v2-lite-chat-full-depth-repro-1pd.json @@ -0,0 +1,288050 @@ +{ + "schema_version": 1, + "captured_at": "2026-07-29T16:19:00+00:00", + "model": { + "repo": "deepseek-ai/DeepSeek-V2-Lite-Chat", + "revision": "85864749cd611b4353ce1decdb286193298f64c7", + "checkpoint_identity": "SFT Chat", + "architecture": "DeepseekV2ForCausalLM", + "dtype": "bfloat16", + "download_revision_contract": { + "metadata_root": "/home/wuyang/.cache/llm-atlas/deepseek-v2-lite-chat-85864749/.cache/huggingface/download", + "all_files_same_revision": true, + "files": { + "config.json": { + "revision": "85864749cd611b4353ce1decdb286193298f64c7", + "etag": "a1aa8126bbf462cbec8fcc79e8c98d8d87f5c7ed" + }, + "configuration_deepseek.py": { + "revision": "85864749cd611b4353ce1decdb286193298f64c7", + "etag": "82e0f5d9d33620a66e328fdeae0b8dc12e2cff7c" + }, + "generation_config.json": { + "revision": "85864749cd611b4353ce1decdb286193298f64c7", + "etag": "458e1d985ba3fbaaf62a4d1a9dd6ff795a451f7e" + }, + "model.safetensors.index.json": { + "revision": "85864749cd611b4353ce1decdb286193298f64c7", + "etag": "5a821356160292c668d01f8e7fdf9abba4a7b72d" + }, + "model-00001-of-000004.safetensors": { + "revision": "85864749cd611b4353ce1decdb286193298f64c7", + "etag": "a314b79a30810b1038f9db08345178e16fb5742aa266c4a3dc05054c59800082" + }, + "model-00002-of-000004.safetensors": { + "revision": "85864749cd611b4353ce1decdb286193298f64c7", + "etag": "b0bd088feada0af954614da3a5b179c4d4d5d8bb2482ec83194d101f3fe91796" + }, + "model-00003-of-000004.safetensors": { + "revision": "85864749cd611b4353ce1decdb286193298f64c7", + "etag": "d31b192e488f0b3a04e007d842c3c9ba5783d944cb1cc27402fe8b8bb837c490" + }, + "model-00004-of-000004.safetensors": { + "revision": "85864749cd611b4353ce1decdb286193298f64c7", + "etag": "304499be0ea06bf8a3937d7a3cc515bc3738dbd288bdd0bbc1b2d3560fce4930" + }, + "modeling_deepseek.py": { + "revision": "85864749cd611b4353ce1decdb286193298f64c7", + "etag": "847a458bedcc8df352b1a89315b8e400b9bc6030" + }, + "tokenization_deepseek_fast.py": { + "revision": "85864749cd611b4353ce1decdb286193298f64c7", + "etag": "d24377191dd00e80c44f22e31dc15272258a22de" + }, + "tokenizer.json": { + "revision": "85864749cd611b4353ce1decdb286193298f64c7", + "etag": "8b284e5afe1730e31c97ed5c3bdf240adbd15c86" + }, + "tokenizer_config.json": { + "revision": "85864749cd611b4353ce1decdb286193298f64c7", + "etag": "685b4b63ad1aedad8f98824ab21d2ff422d9e1b1" + } + } + }, + "files": { + "config.json": { + "bytes": 1522, + "sha256": "f346286b0f1c8b044252fd54cb4fa78b9fab6472a6e8bebb9edfe03d414ea03d" + }, + "configuration_deepseek.py": { + "bytes": 10338, + "sha256": "6de5e7445ab490a16482027b131d5bd6a003da9b58a182a11432115fac84ce59" + }, + "generation_config.json": { + "bytes": 181, + "sha256": "63ec07f6cb36bd8359b44f671123518dd6fbf55007e0c74aa96c296a75def8b5" + }, + "model.safetensors.index.json": { + "bytes": 479924, + "sha256": "d2cdb2f325f6682cf3ad1ad2526a9f979d857390b579380c0331d975136e0acf" + }, + "model-00001-of-000004.safetensors": { + "bytes": 8594887408, + "sha256": "a314b79a30810b1038f9db08345178e16fb5742aa266c4a3dc05054c59800082" + }, + "model-00002-of-000004.safetensors": { + "bytes": 8591757448, + "sha256": "b0bd088feada0af954614da3a5b179c4d4d5d8bb2482ec83194d101f3fe91796" + }, + "model-00003-of-000004.safetensors": { + "bytes": 8590718520, + "sha256": "d31b192e488f0b3a04e007d842c3c9ba5783d944cb1cc27402fe8b8bb837c490" + }, + "model-00004-of-000004.safetensors": { + "bytes": 5636263200, + "sha256": "304499be0ea06bf8a3937d7a3cc515bc3738dbd288bdd0bbc1b2d3560fce4930" + }, + "modeling_deepseek.py": { + "bytes": 78672, + "sha256": "7d8e5221095286eea991137760893fd7ba52727c0b4ebf48ec09e8bc56b45b9c" + }, + "tokenization_deepseek_fast.py": { + "bytes": 1368, + "sha256": "702fc7dbadc450f2fecfbc59e248ecca5845b49101e8f58f805261c920a3effa" + }, + "tokenizer.json": { + "bytes": 4607451, + "sha256": "41f3bf64213da8c012d8bd0871a58a1fdf70463e8f08f110ddbb1082f529f669" + }, + "tokenizer_config.json": { + "bytes": 1279, + "sha256": "31181eaf79394ea26728d95ecb54fe7c8413e6f56085dbabc8b0818134380ec8" + } + } + }, + "tokenizer_contract": { + "length": 100002, + "vocab_size": 100000, + "all_special_ids": [ + 100000, + 100001 + ], + "pad_token_id": 100001, + "conditions": { + "s0_eos": { + "system": 0, + "history": "filler", + "boundary": "eos", + "token_class": "special" + }, + "s1_eos": { + "system": 1, + "history": "filler", + "boundary": "eos", + "token_class": "special" + }, + "s0_bos": { + "system": 0, + "history": "filler", + "boundary": "bos", + "token_class": "special" + }, + "s1_bos": { + "system": 1, + "history": "filler", + "boundary": "bos", + "token_class": "special" + }, + "s0_x": { + "system": 0, + "history": "filler", + "boundary": "x", + "token_class": "ordinary_control" + }, + "s1_x": { + "system": 1, + "history": "filler", + "boundary": "x", + "token_class": "ordinary_control" + }, + "s0_period": { + "system": 0, + "history": "filler", + "boundary": "period", + "token_class": "ordinary_control" + }, + "s1_period": { + "system": 1, + "history": "filler", + "boundary": "period", + "token_class": "ordinary_control" + } + } + }, + "source_contract": { + "reference_path": "src/data/deepseek-v2-lite-routing-special-token-family-control.json", + "reference_sha256": "c372c1b03a8b15f615b54ded5d9257a8fc2cdb7728001735d3d4c1d8534af5bf", + "reference_model_revision": "604d5664dddd88a0433dbae533b7fe9472482de0", + "sample_salt": "llm-atlas-deepseek-routing-template-control-v1", + "domains": [ + "english", + "chinese", + "code", + "math" + ], + "per_domain": 1, + "sources": 4, + "full_source_text_used": true, + "target_scope": "byte-identical interior content tokens; tokens whose offset crosses the content boundary are excluded" + }, + "trace_contract": { + "conditions": [ + "s0_eos", + "s1_eos", + "s0_bos", + "s1_bos", + "s0_x", + "s1_x", + "s0_period", + "s1_period" + ], + "scopes": [ + "target_content", + "full_input" + ], + "edge_pairs": { + "system_eos": [ + "s0_eos", + "s1_eos" + ], + "system_bos": [ + "s0_bos", + "s1_bos" + ], + "system_x": [ + "s0_x", + "s1_x" + ], + "system_period": [ + "s0_period", + "s1_period" + ], + "bos_at_s0": [ + "s0_eos", + "s0_bos" + ], + "bos_at_s1": [ + "s1_eos", + "s1_bos" + ], + "x_at_s0": [ + "s0_eos", + "s0_x" + ], + "x_at_s1": [ + "s1_eos", + "s1_x" + ], + "period_at_s0": [ + "s0_eos", + "s0_period" + ], + "period_at_s1": [ + "s1_eos", + "s1_period" + ] + }, + "decoder_layers": 27, + "moe_gate_layers": [ + 1, + 2, + 3, + 4, + 5, + 6, + 7, + 8, + 9, + 10, + 11, + 12, + 13, + 14, + 15, + 16, + 17, + 18, + 19, + 20, + 21, + 22, + 23, + 24, + 25, + 26 + ], + "experts": 64, + "top_k": 6, + "use_cache": false, + "raw_hidden_tensors_saved": false, + "raw_route_ids_saved": false, + "load_vectors_saved": true, + "hashes_cover_exact_bfloat16_hidden_and_route_values": true + }, + "execution": { + "python": "3.10.14", + "torch": "2.11.0+cu128", + "transformers": "4.41.2", + "accelerate": "1.13.0", + "safetensors": "0.8.0", + "platform": "Linux-7.0.0-28-generic-x86_64-with-glibc2.43", + "gpu": "NVIDIA GeForce RTX 5090", + "gpu_memory_limit": "28GiB", + "cpu_memory_limit": "80GiB", + "pytorch_cuda_alloc_conf": "expandable_segments:True", + "input_device": "cuda:0", + "device_map": { + "model.embed_tokens": 0, + "model.layers.0": 0, + "model.layers.1": 0, + "model.layers.2": 0, + "model.layers.3": 0, + "model.layers.4": 0, + "model.layers.5": 0, + "model.layers.6": 0, + "model.layers.7": 0, + "model.layers.8": 0, + "model.layers.9": 0, + "model.layers.10": 0, + "model.layers.11": 0, + "model.layers.12": 0, + "model.layers.13": 0, + "model.layers.14": 0, + "model.layers.15": 0, + "model.layers.16": 0, + "model.layers.17": 0, + "model.layers.18": 0, + "model.layers.19": 0, + "model.layers.20": 0, + "model.layers.21": 0, + "model.layers.22": 0, + "model.layers.23": 0, + "model.layers.24": "cpu", + "model.layers.25": "cpu", + "model.layers.26": "cpu", + "model.norm": "cpu", + "lm_head": "cpu" + }, + "load_seconds": 8.439978401002008, + "forward_seconds": 3.848583782033529, + "load_peak_cuda_memory_allocated_bytes": 28616922624, + "peak_cuda_memory_allocated_bytes": 28754760704, + "process_max_rss_kib": 18559088 + }, + "sources": [ + { + "id": "wikitext2/raw-validation/0443", + "domain": "english", + "label": "English encyclopedia", + "within_domain_index": 0, + "selection_rank": "004b632f55ea14a7a1f99552db185df62bb0bbd0914ca94c411d0325d0e96639", + "source_text_sha256": "d975cf38b1f984b025b2aee92f625916a07cb7f35335865ca9020146ca1458f0", + "source_characters": 506, + "source_tokens": 114, + "content_token_ids_sha256": "10896deb639b620f1a6bf8efdb19850401765d0c8ec23461f6a6f9d5307755d8", + "prompt_tokens_by_condition": { + "s0_eos": 138, + "s1_eos": 154, + "s0_bos": 138, + "s1_bos": 154, + "s0_x": 138, + "s1_x": 154, + "s0_period": 138, + "s1_period": 154 + }, + "batch_prompt_tokens": 154, + "content_tokens": 113, + "boundary_crossing_tokens_by_condition": { + "s0_eos": 1, + "s1_eos": 1, + "s0_bos": 1, + "s1_bos": 1, + "s0_x": 1, + "s1_x": 1, + "s0_period": 1, + "s1_period": 1 + }, + "forward_seconds": 1.503095314023085, + "peak_cuda_memory_allocated_bytes": 28754760704, + "hidden_stages": { + "embedding": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d53c0716736484e930f7088bb8e19dabbe2b7f0d6811be1665adda77ed6a9d39", + "mean": -0.00043402970186434686, + "std": 0.09982675313949585, + "rms": 0.09982769191265106, + "max_abs": 1.6875 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d3383f03d4e2ae5778e2a9982356a13d52f998772a8accfc5eac2cd1c22e127c", + "mean": -0.0005247168010100722, + "std": 0.09743694216012955, + "rms": 0.09743835777044296, + "max_abs": 2.046875 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d53c0716736484e930f7088bb8e19dabbe2b7f0d6811be1665adda77ed6a9d39", + "mean": -0.00043402970186434686, + "std": 0.09982675313949585, + "rms": 0.09982769191265106, + "max_abs": 1.6875 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2c2d2e87b43f747b1d78225e2cfa4b3da81913f8d21751854449f16805ff1c4d", + "mean": -0.0006984685314819217, + "std": 0.09822402894496918, + "rms": 0.09822650998830795, + "max_abs": 2.046875 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d53c0716736484e930f7088bb8e19dabbe2b7f0d6811be1665adda77ed6a9d39", + "mean": -0.00043402970186434686, + "std": 0.09982675313949585, + "rms": 0.09982769191265106, + "max_abs": 1.6875 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5db779cb8c13e3e0be83e25fb72f9bf9cc06f173ac4506e0074449b53132e84e", + "mean": -0.0005136067047715187, + "std": 0.09729783236980438, + "rms": 0.09729919582605362, + "max_abs": 2.046875 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d53c0716736484e930f7088bb8e19dabbe2b7f0d6811be1665adda77ed6a9d39", + "mean": -0.00043402970186434686, + "std": 0.09982675313949585, + "rms": 0.09982769191265106, + "max_abs": 1.6875 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b64a6d9705b151c569efc426f74e575a3d26a7ef6d1906643fc4a0dca8a9583f", + "mean": -0.0006885126931592822, + "std": 0.09810040146112442, + "rms": 0.09810281544923782, + "max_abs": 2.046875 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d53c0716736484e930f7088bb8e19dabbe2b7f0d6811be1665adda77ed6a9d39", + "mean": -0.00043402970186434686, + "std": 0.09982675313949585, + "rms": 0.09982769191265106, + "max_abs": 1.6875 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ff2697ba5c44ae21ef5b915989f74d84971e46619eb04bbbd2a2cb1721dbeec7", + "mean": -0.0005408708821050823, + "std": 0.09739165753126144, + "rms": 0.09739316254854202, + "max_abs": 2.046875 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d53c0716736484e930f7088bb8e19dabbe2b7f0d6811be1665adda77ed6a9d39", + "mean": -0.00043402970186434686, + "std": 0.09982675313949585, + "rms": 0.09982769191265106, + "max_abs": 1.6875 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2613a760ad9339e3f67ec57a15ca5c6581a94a5a81bd4c3063452b0bcf85a2d6", + "mean": -0.0007129443110898137, + "std": 0.09818375110626221, + "rms": 0.09818633645772934, + "max_abs": 2.046875 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d53c0716736484e930f7088bb8e19dabbe2b7f0d6811be1665adda77ed6a9d39", + "mean": -0.00043402970186434686, + "std": 0.09982675313949585, + "rms": 0.09982769191265106, + "max_abs": 1.6875 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "78828c0fef2990035d371374770d4829fa5c6657616b1ea3610273d5794d576c", + "mean": -0.0005414588376879692, + "std": 0.09728485345840454, + "rms": 0.09728635847568512, + "max_abs": 2.046875 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d53c0716736484e930f7088bb8e19dabbe2b7f0d6811be1665adda77ed6a9d39", + "mean": -0.00043402970186434686, + "std": 0.09982675313949585, + "rms": 0.09982769191265106, + "max_abs": 1.6875 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "760ee49a1e785a35bc42df9726c13dd0698a7c678d75fc57f105baf842097b80", + "mean": -0.0007134712068364024, + "std": 0.0980888158082962, + "rms": 0.09809140861034393, + "max_abs": 2.046875 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 113, + "exact_hidden_rows": 113, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999999403953552, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "system_bos": { + "tokens": 113, + "exact_hidden_rows": 113, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999999403953552, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "system_x": { + "tokens": 113, + "exact_hidden_rows": 113, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999999403953552, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "system_period": { + "tokens": 113, + "exact_hidden_rows": 113, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999999403953552, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "bos_at_s0": { + "tokens": 113, + "exact_hidden_rows": 113, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999999403953552, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "bos_at_s1": { + "tokens": 113, + "exact_hidden_rows": 113, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999999403953552, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "x_at_s0": { + "tokens": 113, + "exact_hidden_rows": 113, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999999403953552, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "x_at_s1": { + "tokens": 113, + "exact_hidden_rows": 113, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999999403953552, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "period_at_s0": { + "tokens": 113, + "exact_hidden_rows": 113, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999999403953552, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "period_at_s1": { + "tokens": 113, + "exact_hidden_rows": 113, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999999403953552, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + } + } + }, + "layer_00": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2f1bbdffcf323da8053d12716261cde814cd58d98ee13af6a5ea721dd93dc660", + "mean": -0.0010536519112065434, + "std": 0.09251875430345535, + "rms": 0.09252475202083588, + "max_abs": 2.703125 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9599e27e6f7b301cac43cd391dc365e6a95f053573967ca12340ea60ff1b8360", + "mean": -0.0011447048746049404, + "std": 0.0920712873339653, + "rms": 0.09207840263843536, + "max_abs": 2.703125 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9d5d9949477929a1f6d10e59caffae529a01732760cde047e448e7f9888598cf", + "mean": -0.0010563991963863373, + "std": 0.09249912947416306, + "rms": 0.09250516444444656, + "max_abs": 2.71875 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e5c36add7aa0e95d832101398b271e0a5db6868c66a405fb953888b88929e047", + "mean": -0.0012680164072662592, + "std": 0.09271085262298584, + "rms": 0.09271952509880066, + "max_abs": 2.71875 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "46db6749ea8811fdcdadbaf1f193fea672bfc86fb3256de0b436a62b283ad2f2", + "mean": -0.0009914825204759836, + "std": 0.09217599034309387, + "rms": 0.09218131750822067, + "max_abs": 2.65625 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "78df5dd7fbd6eb27bae90885664d5596664936cdf7454eaedceb939529773bfe", + "mean": -0.0010781977325677872, + "std": 0.09155725687742233, + "rms": 0.09156360477209091, + "max_abs": 2.65625 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f8499e2ebfb93508862f166372a31c481d28a93565ca29ac8513fc1b650caaf2", + "mean": -0.0010176958749070764, + "std": 0.09207440167665482, + "rms": 0.0920800268650055, + "max_abs": 2.671875 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fbeebeace4bc737169dd6c6aa441f967392093457eec095953dc750070764d21", + "mean": -0.001227085362188518, + "std": 0.09220237284898758, + "rms": 0.09221053868532181, + "max_abs": 2.671875 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "97483c46b663832d36223b9a7b9692b8c440af18dcd6315db0fe5100c6687547", + "mean": -0.0010011948179453611, + "std": 0.09181138128042221, + "rms": 0.09181684255599976, + "max_abs": 2.65625 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "090cca53e1f1bb9b130506ae6d3ba3ccd40c62fcd1c7be614d17f75279e9f9ee", + "mean": -0.001102607580833137, + "std": 0.09135772287845612, + "rms": 0.09136437624692917, + "max_abs": 2.65625 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "46176a008b3ec671d2a3be2f44d1335f56840a68e6cb47e4c6535940d45b3019", + "mean": -0.0010377498110756278, + "std": 0.09179408848285675, + "rms": 0.09179995208978653, + "max_abs": 2.671875 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "28e78c534831c029256e4426ee9d636b7678cc0bc07ec43e027271d624f25ca9", + "mean": -0.0012593102874234319, + "std": 0.09210041165351868, + "rms": 0.09210902452468872, + "max_abs": 2.671875 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "932229495aa97307968c6a2e57d1f8abc15f7665c634b00cb77beff06dcea65f", + "mean": -0.000992701854556799, + "std": 0.09182782471179962, + "rms": 0.09183319658041, + "max_abs": 2.65625 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "517d95b752630a987dfced7df0975741877fdedc817709ef339461f185b1a3f4", + "mean": -0.001094943261705339, + "std": 0.09120003134012222, + "rms": 0.09120660275220871, + "max_abs": 2.65625 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "11d583ca0efd13a29ae785817e6b1de93993f9304dcd80d2b988701980a4201d", + "mean": -0.0010309192584827542, + "std": 0.09182051569223404, + "rms": 0.09182630479335785, + "max_abs": 2.671875 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "dffbd4dd6bf0111b15aa0b1ea0767ca314462a42eeeafe34954b7ec35eff7322", + "mean": -0.0012522534234449267, + "std": 0.0919509083032608, + "rms": 0.09195943176746368, + "max_abs": 2.671875 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9997221827507019, + "min_cosine_similarity": 0.9980820417404175, + "mean_relative_l2": 0.021312547847628593, + "max_abs_delta": 0.1484375 + }, + "system_bos": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9995481371879578, + "min_cosine_similarity": 0.9963990449905396, + "mean_relative_l2": 0.02772281877696514, + "max_abs_delta": 0.1328125 + }, + "system_x": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9995695948600769, + "min_cosine_similarity": 0.9969266057014465, + "mean_relative_l2": 0.027342643588781357, + "max_abs_delta": 0.1328125 + }, + "system_period": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.999589204788208, + "min_cosine_similarity": 0.9971126317977905, + "mean_relative_l2": 0.026808325201272964, + "max_abs_delta": 0.1328125 + }, + "bos_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9906498789787292, + "min_cosine_similarity": 0.9718236923217773, + "mean_relative_l2": 0.1344381421804428, + "max_abs_delta": 0.2421875 + }, + "bos_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9917864799499512, + "min_cosine_similarity": 0.9739056825637817, + "mean_relative_l2": 0.12585008144378662, + "max_abs_delta": 0.21875 + }, + "x_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9914627075195312, + "min_cosine_similarity": 0.972315788269043, + "mean_relative_l2": 0.12793302536010742, + "max_abs_delta": 0.2421875 + }, + "x_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9924183487892151, + "min_cosine_similarity": 0.9746434688568115, + "mean_relative_l2": 0.1204017773270607, + "max_abs_delta": 0.22265625 + }, + "period_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9915669560432434, + "min_cosine_similarity": 0.9727926850318909, + "mean_relative_l2": 0.1272892951965332, + "max_abs_delta": 0.24609375 + }, + "period_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9924859404563904, + "min_cosine_similarity": 0.9750243425369263, + "mean_relative_l2": 0.11998613178730011, + "max_abs_delta": 0.23046875 + } + } + }, + "layer_01": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "17662f543527b3bb30c5d8b8ecbe726432e1e5afa78f7f0f1034dbf2745e69b6", + "mean": -0.0014351572608575225, + "std": 0.1079927310347557, + "rms": 0.10800226777791977, + "max_abs": 3.34375 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "814327de6bae4611bd3be9868e6e7b6f31c9b6aded18dd8d5763f882091bcc12", + "mean": -0.003496825462207198, + "std": 0.6859102845191956, + "rms": 0.6859192252159119, + "max_abs": 126.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "921091a54324b6c91c2118b33a8155e47eacd0be7cd929f4fbeaa0e5526bcdf4", + "mean": -0.001431984594091773, + "std": 0.10797784477472305, + "rms": 0.10798734426498413, + "max_abs": 3.34375 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "54b29864ecb275aa5a4bac667a4b770dd752b391e0b53c514ad17ece99a6530b", + "mean": -0.0035769084934145212, + "std": 0.6744586229324341, + "rms": 0.6744681000709534, + "max_abs": 135.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fc0bb528fac1dec2504bfec054398b9ed7b5d1a30211824cd68be059ffe7ddbd", + "mean": -0.0014403036329895258, + "std": 0.10820881277322769, + "rms": 0.10821840167045593, + "max_abs": 3.28125 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "006cc86947dc8040a20fd61fe029b9ffa74dbe5278d108df404df2b459605a13", + "mean": -0.0014370157150551677, + "std": 0.10940384119749069, + "rms": 0.109413281083107, + "max_abs": 4.71875 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ab96b9e901b53fce37eb7a598e5724e36f7dfe0604ae577ce2721a4f65bedd81", + "mean": -0.001535512157715857, + "std": 0.10768002271652222, + "rms": 0.1076909676194191, + "max_abs": 3.3125 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6e6174a6fc8d9029ebcb98368783a960ec281db9933527f88b2916a344197485", + "mean": -0.001703433459624648, + "std": 0.1094687357544899, + "rms": 0.10948198288679123, + "max_abs": 4.71875 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f106a0efc2a95d2ac59c57c6d0fdb429da5ac9775fe5dd5302c6c3d92ac7b225", + "mean": -0.001444854075089097, + "std": 0.10840662568807602, + "rms": 0.10841625183820724, + "max_abs": 3.328125 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9c42ac560b959394ff634691f619c3d742d98d72dc9c7935cb8f0e055477e540", + "mean": -0.001441582920961082, + "std": 0.10958254337310791, + "rms": 0.1095920279622078, + "max_abs": 4.71875 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "901a96160c704a2220a68443936760999d4a631bcf5bcb74ec4d7750a582ab6f", + "mean": -0.0015392918139696121, + "std": 0.10752952843904495, + "rms": 0.1075405478477478, + "max_abs": 3.3125 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ddfde994d4f3618715c8b1d48615241e69088fed0d710cb7631adc31ecf4f46d", + "mean": -0.0017091283807531, + "std": 0.10939668118953705, + "rms": 0.10941003262996674, + "max_abs": 4.71875 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7433216fee3d602ea666a697f00eff8968d06d3e7848fcb350802ff03b61e6cd", + "mean": -0.0014393111923709512, + "std": 0.10834342241287231, + "rms": 0.10835298150777817, + "max_abs": 3.328125 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d91ab041961c0d94c5f1599ee7e05486d0107bacdc023c9aaa36e5a56a2b0121", + "mean": -0.0014489397872239351, + "std": 0.10928400605916977, + "rms": 0.10929360240697861, + "max_abs": 4.71875 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a6d0020b5ab07752ff4dc8b4dffa8d435bf0273260c8c3e0ca7166f1cb97585b", + "mean": -0.001538389129564166, + "std": 0.10751010477542877, + "rms": 0.10752111673355103, + "max_abs": 3.328125 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "238d75239612836a12dd682c51cfe107207626fc9ab53afd6b1c835cc7c18276", + "mean": -0.001717252191156149, + "std": 0.10916383564472198, + "rms": 0.10917734354734421, + "max_abs": 4.71875 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.999332070350647, + "min_cosine_similarity": 0.9877874851226807, + "mean_relative_l2": 0.03250262513756752, + "max_abs_delta": 0.095703125 + }, + "system_bos": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9969303607940674, + "min_cosine_similarity": 0.9613133072853088, + "mean_relative_l2": 0.07191566377878189, + "max_abs_delta": 0.2421875 + }, + "system_x": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9955715537071228, + "min_cosine_similarity": 0.9573301672935486, + "mean_relative_l2": 0.08516521006822586, + "max_abs_delta": 0.2578125 + }, + "system_period": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9956812262535095, + "min_cosine_similarity": 0.959312915802002, + "mean_relative_l2": 0.08394642919301987, + "max_abs_delta": 0.2421875 + }, + "bos_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9908356070518494, + "min_cosine_similarity": 0.9685279130935669, + "mean_relative_l2": 0.13316646218299866, + "max_abs_delta": 0.21630859375 + }, + "bos_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.990551769733429, + "min_cosine_similarity": 0.9661278128623962, + "mean_relative_l2": 0.13329610228538513, + "max_abs_delta": 0.21484375 + }, + "x_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9920395016670227, + "min_cosine_similarity": 0.969312846660614, + "mean_relative_l2": 0.12379526346921921, + "max_abs_delta": 0.27734375 + }, + "x_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9899810552597046, + "min_cosine_similarity": 0.9559794664382935, + "mean_relative_l2": 0.13584262132644653, + "max_abs_delta": 0.287109375 + }, + "period_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9921920895576477, + "min_cosine_similarity": 0.9716655015945435, + "mean_relative_l2": 0.12266384065151215, + "max_abs_delta": 0.26953125 + }, + "period_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9899620413780212, + "min_cosine_similarity": 0.9546369314193726, + "mean_relative_l2": 0.13586027920246124, + "max_abs_delta": 0.28515625 + } + } + }, + "layer_02": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1ac82c30960f5164b8ed860f2f164470ea74c58ff275b0722c16ae2353c1cdee", + "mean": -0.0011392420856282115, + "std": 0.12930455803871155, + "rms": 0.12930957973003387, + "max_abs": 3.5 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "774c8e6852615fad4bab5adee65f2fcdf5562ac93562b10064d5c02cd13a9754", + "mean": -0.008064049296081066, + "std": 2.047982931137085, + "rms": 2.0479986667633057, + "max_abs": 392.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0a304e5aa12bc379f1092356753ecd26e86442900b501bc667cd9ca78c7ca60a", + "mean": -0.0010662305867299438, + "std": 0.12929953634738922, + "rms": 0.1293039321899414, + "max_abs": 3.53125 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ed14157d108a16c6e5dca201d416b5aae2248770d216a8ab68227f4c8c2cf1db", + "mean": -0.008485733531415462, + "std": 2.1478500366210938, + "rms": 2.14786696434021, + "max_abs": 436.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0e4f730a5aefbafb2b60a48ea93c06dc67a1beee80dd6792af834577e9f3c086", + "mean": -0.001176035962998867, + "std": 0.13076217472553253, + "rms": 0.13076744973659515, + "max_abs": 3.5 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "af9c3e215c9691ec90039b9eaec2bccaee8fab99067732a49b3f1d50aa16e2ec", + "mean": -0.0014768254477530718, + "std": 0.1905517280101776, + "rms": 0.19055746495723724, + "max_abs": 23.875 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5957b0c2aa7fc62c2182c7b7fa84c08b302cebe8816e7b292a18961d8d47b811", + "mean": -0.0010270543862134218, + "std": 0.1306433081626892, + "rms": 0.13064734637737274, + "max_abs": 3.578125 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "968b0b13a7c19aa58d1c5470d751fb3b16fd549b4ef5ec0cf288e003ebdd7952", + "mean": -0.0014481215039268136, + "std": 0.18547135591506958, + "rms": 0.18547698855400085, + "max_abs": 23.875 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ddbccdff9d180749178d518e75d071dd8b059bd8dcded48e2e1fdc2e60bba025", + "mean": -0.0012168713146820664, + "std": 0.13061565160751343, + "rms": 0.1306213140487671, + "max_abs": 3.53125 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e0c708677e87cd7ab2625cbe50e7b04e9d2da76e2f575856b1abed9a1dc2fb04", + "mean": -0.0015086422208696604, + "std": 0.1904982179403305, + "rms": 0.19050419330596924, + "max_abs": 23.875 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3083a66a978f2953a9f65c8e759279d0391b5df63dc7484b57532abba443d000", + "mean": -0.0010128418216481805, + "std": 0.13025224208831787, + "rms": 0.13025617599487305, + "max_abs": 3.578125 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "22fb44a1071820e1933f28f12deac34584e8f3c5a2590725899453d769c92f69", + "mean": -0.0014351537683978677, + "std": 0.18530724942684174, + "rms": 0.18531279265880585, + "max_abs": 23.875 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "088d90326c2491b28e94ac0c880d5a29573a0e96b5a6258061b993ff24fb5ce5", + "mean": -0.00119820109102875, + "std": 0.13041427731513977, + "rms": 0.1304197907447815, + "max_abs": 3.53125 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "519da5cac0dbff6cfac22317aa48e055134eae891d5b0d22f12a9375e301525c", + "mean": -0.0015355455689132214, + "std": 0.19013944268226624, + "rms": 0.19014564156532288, + "max_abs": 23.875 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "84ce32fc40f936ec7c62688fbc712a5d276e318655ac0ea32df84af008a9635f", + "mean": -0.0010107774287462234, + "std": 0.13007238507270813, + "rms": 0.1300763189792633, + "max_abs": 3.578125 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c2a4d69e88347e8bcbbc9ef34c59ac7c204b2ea00fd21b2be507c77103c518e5", + "mean": -0.0014644251205027103, + "std": 0.18495875597000122, + "rms": 0.18496455252170563, + "max_abs": 23.875 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9990944266319275, + "min_cosine_similarity": 0.9909971952438354, + "mean_relative_l2": 0.03915632888674736, + "max_abs_delta": 0.078125 + }, + "system_bos": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9961217045783997, + "min_cosine_similarity": 0.9523675441741943, + "mean_relative_l2": 0.08167710900306702, + "max_abs_delta": 0.23828125 + }, + "system_x": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9942656755447388, + "min_cosine_similarity": 0.944365918636322, + "mean_relative_l2": 0.0986102893948555, + "max_abs_delta": 0.24072265625 + }, + "system_period": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9944137930870056, + "min_cosine_similarity": 0.9442073702812195, + "mean_relative_l2": 0.09727276861667633, + "max_abs_delta": 0.23291015625 + }, + "bos_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9914987683296204, + "min_cosine_similarity": 0.9611548185348511, + "mean_relative_l2": 0.1284102499485016, + "max_abs_delta": 0.2890625 + }, + "bos_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9899072051048279, + "min_cosine_similarity": 0.9663558006286621, + "mean_relative_l2": 0.13895556330680847, + "max_abs_delta": 0.384765625 + }, + "x_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9919906854629517, + "min_cosine_similarity": 0.9596129059791565, + "mean_relative_l2": 0.12389137595891953, + "max_abs_delta": 0.37890625 + }, + "x_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9883956909179688, + "min_cosine_similarity": 0.9546267986297607, + "mean_relative_l2": 0.14745238423347473, + "max_abs_delta": 0.4765625 + }, + "period_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9920236468315125, + "min_cosine_similarity": 0.9620989561080933, + "mean_relative_l2": 0.12375875562429428, + "max_abs_delta": 0.3828125 + }, + "period_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9882157444953918, + "min_cosine_similarity": 0.9553108811378479, + "mean_relative_l2": 0.14835992455482483, + "max_abs_delta": 0.486328125 + } + } + }, + "layer_03": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1bc538abbc171b9b18ea03cc6d97274fd4e47bd3ec4239a7beda2a14e09e6f9b", + "mean": -0.002146470593288541, + "std": 0.1557542383670807, + "rms": 0.15576902031898499, + "max_abs": 4.1875 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f2b5ad5ae951b83ff411f0409518c9448ace49ece46f7df32233ac2ff6512a3e", + "mean": -0.01128356996923685, + "std": 6.138321399688721, + "rms": 6.138331890106201, + "max_abs": 1136.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "97a6036b774ab67965df1aae26dadd9f6d93d301a152672c06ccd2366b7dd782", + "mean": -0.0020910128951072693, + "std": 0.15602900087833405, + "rms": 0.15604300796985626, + "max_abs": 4.25 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0e063fe0f3ce736e892859338f769b45d9d6e0928cd0d9ea834c8e92c01d3cf2", + "mean": -0.011624856851994991, + "std": 5.996391773223877, + "rms": 5.996402740478516, + "max_abs": 1136.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bbdc4f08b24184af52df35f78d5a8793e0a430821346e666d59ae0796764c542", + "mean": -0.002216243650764227, + "std": 0.15773901343345642, + "rms": 0.157754585146904, + "max_abs": 4.1875 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b955038ace16f89defbc7b4d72740ec89551146bc8da3585926d5fe443ec5b12", + "mean": -0.003955663647502661, + "std": 5.469537258148193, + "rms": 5.469539642333984, + "max_abs": 1136.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4096b3e0b0acabbb933fc9242bbf2d3a4934d798484b8c750fff3b6fcaa620c9", + "mean": -0.0021844145376235247, + "std": 0.15809990465641022, + "rms": 0.1581149846315384, + "max_abs": 4.34375 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "54de9bb9cbc1b879b1e18a72d9ff4908a24a59fa26bf51cc14de20dd9e8d7914", + "mean": -0.003920757211744785, + "std": 5.177855968475342, + "rms": 5.177857875823975, + "max_abs": 1136.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cdc5ee0fe7e8ca9a461825d00096837c1ad22d387ae28a1a76e2a3bc9c9f8a69", + "mean": -0.0022846157662570477, + "std": 0.15701398253440857, + "rms": 0.1570305973291397, + "max_abs": 4.1875 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ea3dc151b34f72d12865f49a05b9dcd61c3cd3af8d48e3a505d7c41496d2437f", + "mean": -0.0040422058664262295, + "std": 5.469508647918701, + "rms": 5.469510555267334, + "max_abs": 1136.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9275d79a77e28105d0b15e175891c07212d02b36e0139f8c2e893bdccf5d4aed", + "mean": -0.002238604938611388, + "std": 0.15756608545780182, + "rms": 0.15758199989795685, + "max_abs": 4.34375 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "458f1e9a8da3f5abd4cf6338558ba895e8505d7391c7c77e93c0bea79aa136fe", + "mean": -0.003985793329775333, + "std": 5.177837371826172, + "rms": 5.1778388023376465, + "max_abs": 1136.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "79dd6724ec3062f2eebdb518ddc006f9c7c4a5ce4a1e820c8ef5f68772098ded", + "mean": -0.0022784704342484474, + "std": 0.15694479644298553, + "rms": 0.1569613367319107, + "max_abs": 4.1875 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8fc1413f59c11ddcc7befc06adf7e4c5c5f28ca8625d003f632b9dc7c0b04bad", + "mean": -0.004039406310766935, + "std": 5.469499111175537, + "rms": 5.46950101852417, + "max_abs": 1136.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "30771e4914109067068ca77964b60fb82c3ac677c026bfb00b5ac5db04460d39", + "mean": -0.0022118063643574715, + "std": 0.15754744410514832, + "rms": 0.1575629562139511, + "max_abs": 4.3125 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9954568e21398497fed83c12e39406d2ce23292f0cdecd45cc8ccbfa5a4bb332", + "mean": -0.00396459037438035, + "std": 5.177829265594482, + "rms": 5.177831172943115, + "max_abs": 1136.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9990189671516418, + "min_cosine_similarity": 0.9899377822875977, + "mean_relative_l2": 0.04074745252728462, + "max_abs_delta": 0.09375 + }, + "system_bos": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9960381388664246, + "min_cosine_similarity": 0.9599736928939819, + "mean_relative_l2": 0.08257518708705902, + "max_abs_delta": 0.2275390625 + }, + "system_x": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9938066005706787, + "min_cosine_similarity": 0.951924204826355, + "mean_relative_l2": 0.10164394974708557, + "max_abs_delta": 0.2763671875 + }, + "system_period": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9938927888870239, + "min_cosine_similarity": 0.9515929222106934, + "mean_relative_l2": 0.10117707401514053, + "max_abs_delta": 0.27294921875 + }, + "bos_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9923728108406067, + "min_cosine_similarity": 0.9625496864318848, + "mean_relative_l2": 0.12159082293510437, + "max_abs_delta": 0.25390625 + }, + "bos_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9905562400817871, + "min_cosine_similarity": 0.9669970273971558, + "mean_relative_l2": 0.13422562181949615, + "max_abs_delta": 0.375 + }, + "x_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9927719235420227, + "min_cosine_similarity": 0.9654824733734131, + "mean_relative_l2": 0.1171141266822815, + "max_abs_delta": 0.37109375 + }, + "x_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.988713264465332, + "min_cosine_similarity": 0.9572775363922119, + "mean_relative_l2": 0.14481878280639648, + "max_abs_delta": 0.48828125 + }, + "period_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9927834272384644, + "min_cosine_similarity": 0.9669764637947083, + "mean_relative_l2": 0.11733114719390869, + "max_abs_delta": 0.3828125 + }, + "period_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9883951544761658, + "min_cosine_similarity": 0.95557701587677, + "mean_relative_l2": 0.14672580361366272, + "max_abs_delta": 0.494140625 + } + } + }, + "layer_04": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fdc80fc6ce20bd43c37d046dda8671444fb8595968b876334f5d9b2e0ae00124", + "mean": -0.0019429582171142101, + "std": 0.18456611037254333, + "rms": 0.1845763474702835, + "max_abs": 5.0 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f77352180532482a44872f4bfb9841dcddc8d54f1fe36f56fd3e5a2f325c8579", + "mean": -0.010954242199659348, + "std": 6.405308246612549, + "rms": 6.405317306518555, + "max_abs": 1152.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e58e2eb33e672beccbc02cd09b79078cbe809d9e7a81bda5667f7efe38140a5a", + "mean": -0.0018568086670711637, + "std": 0.18476955592632294, + "rms": 0.18477889895439148, + "max_abs": 5.0 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "aca31e889502d3bc8e72b8ee30ddc6f6208f3312839a7ef6aee4cb396724a659", + "mean": -0.011348272673785686, + "std": 6.240849018096924, + "rms": 6.240859508514404, + "max_abs": 1152.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ae3a782ff3d16f86da5b0c767ea0f5f1588d3808e22a77dcde2afb56240b4411", + "mean": -0.0020650746300816536, + "std": 0.18701042234897614, + "rms": 0.18702183663845062, + "max_abs": 5.09375 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d59cc49afa5473f762c24663e9205e78993a43e21d935ffeafbe6b8257eaf2f6", + "mean": -0.0036842869594693184, + "std": 5.73739767074585, + "rms": 5.737399101257324, + "max_abs": 1152.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8a08b449d49f8a284bc233047fb3527d5ea9f72d44cf881ef14e32abacc23737", + "mean": -0.001971755176782608, + "std": 0.18734772503376007, + "rms": 0.18735811114311218, + "max_abs": 5.125 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1f878b588f8f1484342f80cb925b604502fec3673f961e33287b584c5fc22e5d", + "mean": -0.0036513933446258307, + "std": 5.425801753997803, + "rms": 5.425802707672119, + "max_abs": 1152.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7cfab6fa697893605068c9904a7278e03c4aac94520eee45ffdba7e939d56ac5", + "mean": -0.002056541619822383, + "std": 0.18552634119987488, + "rms": 0.18553772568702698, + "max_abs": 5.09375 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ad719890dfd6b5f6ae1defc797ad03475be258bae415c813c13aca96b98ae89f", + "mean": -0.003647914854809642, + "std": 5.737334251403809, + "rms": 5.737335205078125, + "max_abs": 1152.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "14c772d7c3a342a5a7d1397fd4f15c71c644a11cdf457a9b8c8976a282cc3606", + "mean": -0.0019418577430769801, + "std": 0.18632382154464722, + "rms": 0.18633392453193665, + "max_abs": 5.15625 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "89917efe6a9cceade393b929579e8195c8abd944d6d9dbcef903dac96eacb93e", + "mean": -0.0036098554264754057, + "std": 5.425754070281982, + "rms": 5.425755023956299, + "max_abs": 1152.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7c83334ec3c72766ac5315de7966db8375a6c0f4c46cebd6948b1a3312445313", + "mean": -0.0019809191580861807, + "std": 0.18558306992053986, + "rms": 0.1855936497449875, + "max_abs": 5.125 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a4940a12eea0adf6d26837e2d56fbe4ba8d8c235209d5a3b641339c96802bb89", + "mean": -0.0035976353101432323, + "std": 5.73732852935791, + "rms": 5.737329006195068, + "max_abs": 1152.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "313317789deb86aabd4b2b95799668c58ce5a2da6da50e4cf38defc3ad8d5f76", + "mean": -0.0019313957309350371, + "std": 0.1863587647676468, + "rms": 0.18636876344680786, + "max_abs": 5.15625 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9d294ce0f946130b0585d078f53e37e4b81d6599cdf98c33a33f82a398078f04", + "mean": -0.003604280762374401, + "std": 5.425747394561768, + "rms": 5.425748348236084, + "max_abs": 1152.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9988705515861511, + "min_cosine_similarity": 0.991459846496582, + "mean_relative_l2": 0.04283842816948891, + "max_abs_delta": 0.09375 + }, + "system_bos": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9962909817695618, + "min_cosine_similarity": 0.9734877943992615, + "mean_relative_l2": 0.08173518627882004, + "max_abs_delta": 0.306640625 + }, + "system_x": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9938160181045532, + "min_cosine_similarity": 0.9654372334480286, + "mean_relative_l2": 0.1044437438249588, + "max_abs_delta": 0.380859375 + }, + "system_period": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9937536716461182, + "min_cosine_similarity": 0.9649587273597717, + "mean_relative_l2": 0.10505062341690063, + "max_abs_delta": 0.37109375 + }, + "bos_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.993809163570404, + "min_cosine_similarity": 0.9742564558982849, + "mean_relative_l2": 0.10977648943662643, + "max_abs_delta": 0.40625 + }, + "bos_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9918197989463806, + "min_cosine_similarity": 0.9751914739608765, + "mean_relative_l2": 0.12556292116641998, + "max_abs_delta": 0.3515625 + }, + "x_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9937109351158142, + "min_cosine_similarity": 0.9765484929084778, + "mean_relative_l2": 0.10878957062959671, + "max_abs_delta": 0.3828125 + }, + "x_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9893700480461121, + "min_cosine_similarity": 0.9668853282928467, + "mean_relative_l2": 0.14126060903072357, + "max_abs_delta": 0.53515625 + }, + "period_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9935994744300842, + "min_cosine_similarity": 0.9773837924003601, + "mean_relative_l2": 0.10994137823581696, + "max_abs_delta": 0.390625 + }, + "period_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.988925576210022, + "min_cosine_similarity": 0.9648511409759521, + "mean_relative_l2": 0.14423632621765137, + "max_abs_delta": 0.5546875 + } + } + }, + "layer_05": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d8f4a0fa5cb188de4d122d4efa5db155dc5fffce692bdba9e86157c00374b7dd", + "mean": -0.0010589959565550089, + "std": 0.20785583555698395, + "rms": 0.20785853266716003, + "max_abs": 5.4375 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "45bb7c5453d0a1ba4b9c4f10f94f97b9e5317a225d1f913cb1c570cbebbe02ef", + "mean": -0.011359811760485172, + "std": 6.600690841674805, + "rms": 6.600700855255127, + "max_abs": 1152.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8888c22b573d008bb992f64d15052a3351ff4a83060b6b05068fa8ed907a8e10", + "mean": -0.0010844425996765494, + "std": 0.2081674337387085, + "rms": 0.20817026495933533, + "max_abs": 5.53125 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e1502e75341c3fd3cc83ebbb093faa927130c789e215b7de34fb18ef8fdd1a0c", + "mean": -0.011714259162545204, + "std": 6.433863162994385, + "rms": 6.433874130249023, + "max_abs": 1152.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5313a7b72846969df471cc91586e2a70a2fbfe79cc37079dfa4253c205333208", + "mean": -0.001218360266648233, + "std": 0.21087661385536194, + "rms": 0.21088014543056488, + "max_abs": 5.5 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f3e83e41e1bae301ad7053eacd6ef0581da930af6ea0dbc8230f973ff6707331", + "mean": -0.003398354398086667, + "std": 5.838001251220703, + "rms": 5.8380022048950195, + "max_abs": 1152.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5f66106a0b0d4035a09176e1833a2685246af71b6dcc8426050fee03d1939649", + "mean": -0.0012629317352548242, + "std": 0.21139420568943024, + "rms": 0.21139799058437347, + "max_abs": 5.8125 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ac921c4ee4c40658776df9f0eaedcfeddc723fad511d8eb6758c42e17057a5ee", + "mean": -0.003395708743482828, + "std": 5.5205583572387695, + "rms": 5.520558834075928, + "max_abs": 1152.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "aa19f1949821805d68db992701635c481243b21cc00fa0bbd8fec7a9ffe43a0b", + "mean": -0.0013567798305302858, + "std": 0.2089119404554367, + "rms": 0.2089163362979889, + "max_abs": 5.53125 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5d4d88842594902bd39189a712dd6b1560d956b695863d35c3c1ed174941546e", + "mean": -0.0034581965301185846, + "std": 5.837919235229492, + "rms": 5.83791971206665, + "max_abs": 1152.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1a53f190a5613560be0f80f2e0c90a58e35eac915ecafe117a219262cdde0b2c", + "mean": -0.0014642545720562339, + "std": 0.2099093347787857, + "rms": 0.209914430975914, + "max_abs": 5.875 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "da618ecec084333ae1bb55293855c2d86dc967e2af34dbe8e202837624e0e23e", + "mean": -0.0035084972623735666, + "std": 5.52049446105957, + "rms": 5.520496368408203, + "max_abs": 1152.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "67fd70634f498ccd0c4bccf28539d955de04a0d311cdf0c7784c98a5e5ec1e73", + "mean": -0.001320706564001739, + "std": 0.20955637097358704, + "rms": 0.20956052839756012, + "max_abs": 5.5625 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4718345a5dd34cb178085615c4b87d0508b4d052cd9f94fbe3e3873271d78695", + "mean": -0.0034368413034826517, + "std": 5.837925434112549, + "rms": 5.837926387786865, + "max_abs": 1152.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "be9daaf541d4b6aacc94f6aebff0def3fefd6953b772d19d120a019dfebeb48c", + "mean": -0.0015042772283777595, + "std": 0.21036064624786377, + "rms": 0.21036602556705475, + "max_abs": 5.84375 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3f93218342e37dec8aec63fb2bc634835c68f5e13aa9da65ac2b7850d49ff07f", + "mean": -0.0035582920536398888, + "std": 5.520496845245361, + "rms": 5.520497798919678, + "max_abs": 1152.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9985262155532837, + "min_cosine_similarity": 0.9921691417694092, + "mean_relative_l2": 0.050230033695697784, + "max_abs_delta": 0.15625 + }, + "system_bos": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9956742525100708, + "min_cosine_similarity": 0.977787971496582, + "mean_relative_l2": 0.08865790069103241, + "max_abs_delta": 0.32763671875 + }, + "system_x": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9924167990684509, + "min_cosine_similarity": 0.9642490148544312, + "mean_relative_l2": 0.11603672802448273, + "max_abs_delta": 0.433837890625 + }, + "system_period": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9922227263450623, + "min_cosine_similarity": 0.9611437320709229, + "mean_relative_l2": 0.11764302849769592, + "max_abs_delta": 0.421875 + }, + "bos_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9929938912391663, + "min_cosine_similarity": 0.9765225648880005, + "mean_relative_l2": 0.11710509657859802, + "max_abs_delta": 0.484375 + }, + "bos_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9910252094268799, + "min_cosine_similarity": 0.9707159996032715, + "mean_relative_l2": 0.13181264698505402, + "max_abs_delta": 0.5625 + }, + "x_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9929341077804565, + "min_cosine_similarity": 0.975569486618042, + "mean_relative_l2": 0.1154162660241127, + "max_abs_delta": 0.453125 + }, + "x_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9880233407020569, + "min_cosine_similarity": 0.9616934657096863, + "mean_relative_l2": 0.14944978058338165, + "max_abs_delta": 0.5703125 + }, + "period_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.992841899394989, + "min_cosine_similarity": 0.9783788919448853, + "mean_relative_l2": 0.11716505885124207, + "max_abs_delta": 0.390625 + }, + "period_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9875551462173462, + "min_cosine_similarity": 0.9587463736534119, + "mean_relative_l2": 0.15314026176929474, + "max_abs_delta": 0.578125 + } + } + }, + "layer_06": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9131db709462ae8b0ed3b067c64f132932a42db610d5931c4b764da602ddc24b", + "mean": -0.0022660589311271906, + "std": 0.23981525003910065, + "rms": 0.23982594907283783, + "max_abs": 6.78125 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d4d38da394cdaf171afa70a9f8adf11230b1a4ef5ee28f5f61a1083ac13440e3", + "mean": -0.01280540507286787, + "std": 6.721546173095703, + "rms": 6.721558094024658, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8e75d7c7fed95124f4ecd05a7304db36028fe60d466c3dc4199597233a7eea6b", + "mean": -0.002330823801457882, + "std": 0.23985303938388824, + "rms": 0.23986436426639557, + "max_abs": 6.78125 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3157a36c7b2ee33629e31c3bb067e2245ccd1aa4d03a1600fb2c5dd145622efe", + "mean": -0.013145051896572113, + "std": 6.550924301147461, + "rms": 6.550938129425049, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c3b861c9ebd860d80109e616af2e4065ce4c94e5fd278d2bf8dd67f585e67db2", + "mean": -0.0023989614564925432, + "std": 0.24243973195552826, + "rms": 0.24245159327983856, + "max_abs": 6.8125 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0becae16295d66afcfe9076f5f1003ab36ea5af857ab0cc9f9179fb4ec496405", + "mean": -0.004597831983119249, + "std": 5.932371616363525, + "rms": 5.932373046875, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4f774c4b0bac860d052a042ce86a47164a55b0144c922c3e6ab69cbf427fd64a", + "mean": -0.0024276841431856155, + "std": 0.24316303431987762, + "rms": 0.24317514896392822, + "max_abs": 6.8125 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d4d2bd252bd3f741367b8e7147bdf9e2127b3b3e865ac1c1732bc23aad327a4a", + "mean": -0.004555906169116497, + "std": 5.6099958419799805, + "rms": 5.609997749328613, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "41ee7a49904a110e19276283cd81c67e193d6cdd19ce7c1049a2a31e14ddb045", + "mean": -0.0023832640144973993, + "std": 0.2409551739692688, + "rms": 0.24096696078777313, + "max_abs": 6.78125 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f6be5e9f03480925c0a617f4055c898b7d5fc180309895980651d710aad5da95", + "mean": -0.004500598646700382, + "std": 5.932292938232422, + "rms": 5.9322943687438965, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4af3982f65dc07da169d71a867b65f830adaa9246f3b70abc8f1a3700b60574c", + "mean": -0.002502556424587965, + "std": 0.24149030447006226, + "rms": 0.2415032535791397, + "max_abs": 6.90625 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d46f61b9f2029655c9c9ed8c772743cf17f1ba7dd164d44bac9711f4fba52fee", + "mean": -0.004549815319478512, + "std": 5.609914302825928, + "rms": 5.609916687011719, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e60f016ccc2cf547be9128eec190b19411f55939c62b8143d954a8bf716a5173", + "mean": -0.0024247150868177414, + "std": 0.2407974898815155, + "rms": 0.24080969393253326, + "max_abs": 6.75 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d61bf4b261a691322eca3dbfc912e87fbfb0cc7b5d3d9b92115b0b54d113e483", + "mean": -0.004521306604146957, + "std": 5.932281017303467, + "rms": 5.9322829246521, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "53e6aed47a6a0114efb6731515fdedb40a2b6e4372e7476cc8fd0e694c482efe", + "mean": -0.002587525872513652, + "std": 0.2411433309316635, + "rms": 0.24115721881389618, + "max_abs": 6.9375 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ead3e78de9fe7a8de571178116931d91b3059ffaaac570a253376960ec20d40c", + "mean": -0.004624545574188232, + "std": 5.609897136688232, + "rms": 5.609899520874023, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9982527494430542, + "min_cosine_similarity": 0.9911060333251953, + "mean_relative_l2": 0.05462394654750824, + "max_abs_delta": 0.1875 + }, + "system_bos": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9954628944396973, + "min_cosine_similarity": 0.9771460294723511, + "mean_relative_l2": 0.0912398099899292, + "max_abs_delta": 0.53125 + }, + "system_x": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9913433194160461, + "min_cosine_similarity": 0.9602885246276855, + "mean_relative_l2": 0.12508413195610046, + "max_abs_delta": 0.6875 + }, + "system_period": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9911192059516907, + "min_cosine_similarity": 0.9540954232215881, + "mean_relative_l2": 0.12696748971939087, + "max_abs_delta": 0.75 + }, + "bos_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9934759736061096, + "min_cosine_similarity": 0.9766287803649902, + "mean_relative_l2": 0.11210053414106369, + "max_abs_delta": 0.46875 + }, + "bos_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9913944602012634, + "min_cosine_similarity": 0.9699451923370361, + "mean_relative_l2": 0.128859743475914, + "max_abs_delta": 0.53125 + }, + "x_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9930292367935181, + "min_cosine_similarity": 0.9730231761932373, + "mean_relative_l2": 0.11472073942422867, + "max_abs_delta": 0.5 + }, + "x_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9876500964164734, + "min_cosine_similarity": 0.9572745561599731, + "mean_relative_l2": 0.15276019275188446, + "max_abs_delta": 0.6328125 + }, + "period_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9929952621459961, + "min_cosine_similarity": 0.9805446863174438, + "mean_relative_l2": 0.11564838141202927, + "max_abs_delta": 0.44140625 + }, + "period_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9868640303611755, + "min_cosine_similarity": 0.9580013751983643, + "mean_relative_l2": 0.15783262252807617, + "max_abs_delta": 0.6875 + } + } + }, + "layer_07": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "63c3082fcf9c3aa49b75df9cc17f9c65598dbce39259a4a0465806f3b859758a", + "mean": -0.0031761289574205875, + "std": 0.26246175169944763, + "rms": 0.2624809443950653, + "max_abs": 7.0625 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ca4708fe1332963ee9deaacbea7628ae60fb98baa5e8291a22a77c3ef69d91ea", + "mean": -0.013564765453338623, + "std": 6.741655349731445, + "rms": 6.741668224334717, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0dc1e493bbdf6e3833dbc00b531855ac722c643cf20dce326c81fa947424bb6b", + "mean": -0.0031756374519318342, + "std": 0.26280346512794495, + "rms": 0.26282262802124023, + "max_abs": 7.0625 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "53a7a95b36f952d21515bcfb560721f5e38f57505b4c6b5baf29880f327f99a1", + "mean": -0.014111128635704517, + "std": 6.570806980133057, + "rms": 6.570821762084961, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e06887e7ff9302e20b432d83e6adbd4ab5cf5341c416369c751aded6a3284b17", + "mean": -0.003171108663082123, + "std": 0.26432257890701294, + "rms": 0.2643415629863739, + "max_abs": 7.09375 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0274970d08ca62a4648324da97ec269da65a64092bf421680ee0f53a87137321", + "mean": -0.005217272788286209, + "std": 5.943832874298096, + "rms": 5.9438347816467285, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a70877edde40af1adf259ee05f9efbc2c586d0e3ac27be4dbb65c5d060663b84", + "mean": -0.003255383810028434, + "std": 0.26539868116378784, + "rms": 0.2654186189174652, + "max_abs": 7.1875 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "da29fe19a41a7a22c0fb6a5ef194a040b2b2fc17edb5b1cf716521f885e6b531", + "mean": -0.005482131615281105, + "std": 5.620984077453613, + "rms": 5.620986461639404, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "50fc855e09bf0752feafed52748141617c9f3cec7093e803bb4a52ce95ca1214", + "mean": -0.0031929141841828823, + "std": 0.26268765330314636, + "rms": 0.26270705461502075, + "max_abs": 7.125 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a6edb8d2caaa12bba6b22af1573ec3e0bde8606d2225cc38e3c664820582fa3d", + "mean": -0.005254304967820644, + "std": 5.9437384605407715, + "rms": 5.9437408447265625, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9510b3717728a6f20f8e8c5e055fc5cd9d16c9fe9e23cfb06ea173f27bf3a5f3", + "mean": -0.0033660405315458775, + "std": 0.2643415033817291, + "rms": 0.2643629312515259, + "max_abs": 7.1875 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "aaa1c6d428d5e8ff90429a9f3635d14b36a2a737c0748b2dff9e0a26d9355c92", + "mean": -0.005573672708123922, + "std": 5.620914936065674, + "rms": 5.620917320251465, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "87f0cdd6748104bb1212d0f2f5e634e2f2c8c882a26e7d2276df6c65d8c821f2", + "mean": -0.0032365473452955484, + "std": 0.26256033778190613, + "rms": 0.2625803053379059, + "max_abs": 7.125 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "794961c5f7d2dbe965ef900ff800d817d18ea5ecd1d8ee6468e6dbdea00e6a9e", + "mean": -0.005207936279475689, + "std": 5.943735122680664, + "rms": 5.943737506866455, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5bf5d1caa1a4661bacd220a6e7fff8e43d8f11b65b4090332ee8bcd734290058", + "mean": -0.003427712479606271, + "std": 0.2643836736679077, + "rms": 0.26440590620040894, + "max_abs": 7.25 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9e360c4453ece1c65d20feb3d2750ae8279a71bac01b0511724d8c47994a1899", + "mean": -0.00556659372523427, + "std": 5.620918273925781, + "rms": 5.6209211349487305, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9979904890060425, + "min_cosine_similarity": 0.988330066204071, + "mean_relative_l2": 0.058342523872852325, + "max_abs_delta": 0.265625 + }, + "system_bos": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9949450492858887, + "min_cosine_similarity": 0.9669644832611084, + "mean_relative_l2": 0.09542916715145111, + "max_abs_delta": 0.359375 + }, + "system_x": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9900511503219604, + "min_cosine_similarity": 0.9349111318588257, + "mean_relative_l2": 0.1325308233499527, + "max_abs_delta": 0.5625 + }, + "system_period": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.990019679069519, + "min_cosine_similarity": 0.9388324022293091, + "mean_relative_l2": 0.1335073709487915, + "max_abs_delta": 0.515625 + }, + "bos_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9929670691490173, + "min_cosine_similarity": 0.9675246477127075, + "mean_relative_l2": 0.11486538499593735, + "max_abs_delta": 0.5 + }, + "bos_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9907457232475281, + "min_cosine_similarity": 0.9523415565490723, + "mean_relative_l2": 0.13184085488319397, + "max_abs_delta": 0.515625 + }, + "x_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9923909902572632, + "min_cosine_similarity": 0.9745655059814453, + "mean_relative_l2": 0.11893667280673981, + "max_abs_delta": 0.59375 + }, + "x_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9864311814308167, + "min_cosine_similarity": 0.9301891326904297, + "mean_relative_l2": 0.15871040523052216, + "max_abs_delta": 0.6953125 + }, + "period_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9923813939094543, + "min_cosine_similarity": 0.9814035892486572, + "mean_relative_l2": 0.11963316053152084, + "max_abs_delta": 0.5234375 + }, + "period_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9858137369155884, + "min_cosine_similarity": 0.9416147470474243, + "mean_relative_l2": 0.16337455809116364, + "max_abs_delta": 0.71875 + } + } + }, + "layer_08": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "62fc2d444b617d779767b7ea7129c1878ce762dc4843091c7bd6231b9ea70782", + "mean": -0.005683980882167816, + "std": 0.2998650372028351, + "rms": 0.29991888999938965, + "max_abs": 8.125 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "21db61c50252b5c6a269ef82061e0d299b16a6c301348a811521a2107540fb50", + "mean": -0.015827935189008713, + "std": 6.765299320220947, + "rms": 6.765318393707275, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0db6022934b386bd637a5b11699dffd5a2475e8371d3bc329179e8bf0ef847ed", + "mean": -0.005652768537402153, + "std": 0.3001452088356018, + "rms": 0.30019843578338623, + "max_abs": 8.25 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "60304bd1985e4f9330e4e4132a3ed9832a9b115e0b00f0b7e669bbe8cca9a576", + "mean": -0.01596379280090332, + "std": 6.594196319580078, + "rms": 6.594215393066406, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9d23360e54f0a387fa8e0a6f878b7cebdcb3b055499a12f3e1311ee5a0b8379c", + "mean": -0.0055963327176868916, + "std": 0.3014891445636749, + "rms": 0.3015410900115967, + "max_abs": 8.3125 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d231e801efbefb1c6cf5672996b3cbab9a85964dd03fe069e21b92ae01d46631", + "mean": -0.0074537587352097034, + "std": 5.957518100738525, + "rms": 5.957522869110107, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "16bcfd2ba69446729dd01e8a470f0b93d1c10c9d527bcd3c6fff76fd9e31999d", + "mean": -0.0056669083423912525, + "std": 0.30371928215026855, + "rms": 0.3037721514701843, + "max_abs": 8.625 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9855ec24d279c401121b2b714352543c2a25c4da073b4ccab2e169b90f1dcf7b", + "mean": -0.007356957066804171, + "std": 5.6340837478637695, + "rms": 5.634088516235352, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5716f66f59da623c320ba658ed71cf20738e5a1c15052f7c94aff8a6338cd57a", + "mean": -0.005774355493485928, + "std": 0.2991870939731598, + "rms": 0.2992428243160248, + "max_abs": 8.25 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7b23b884b8eb3889b75f25016eb4372ed2c272cceac7d31842ea04965db8ef23", + "mean": -0.007593107409775257, + "std": 5.957398891448975, + "rms": 5.957404613494873, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c61a21bc96a01a567868c02e4c543e4bc8ee1d9dfd3204e46f57018bc10c3c43", + "mean": -0.0057924892753362656, + "std": 0.30237647891044617, + "rms": 0.30243194103240967, + "max_abs": 8.625 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "223099a5d9017a7da0307c84142bf924c20dd111d6b33d3e7340ec1ba20e19cb", + "mean": -0.007408363278955221, + "std": 5.634010314941406, + "rms": 5.634015083312988, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "73ccebec26339e98df953f9e45478e895705252429083148de936e56b6ee16ee", + "mean": -0.005885384976863861, + "std": 0.29884210228919983, + "rms": 0.2989000380039215, + "max_abs": 8.25 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d8152105db03550b98b138db61d658cfc50f95f6056a6acd7bb94deec7c77ba1", + "mean": -0.007683950010687113, + "std": 5.957385063171387, + "rms": 5.957390308380127, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2ac764a1e26177945d8624c9ca8ca46e6926d09793f43dbc7d98247b66e4586a", + "mean": -0.005831951275467873, + "std": 0.3015359342098236, + "rms": 0.30159232020378113, + "max_abs": 8.5625 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "27100bb00aeb0a7dbb549ac44bdc372a63ba914201b4b1efe9add3c3b89eab42", + "mean": -0.007392780389636755, + "std": 5.633974075317383, + "rms": 5.633979320526123, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9974679946899414, + "min_cosine_similarity": 0.9877510666847229, + "mean_relative_l2": 0.06510790437459946, + "max_abs_delta": 0.4375 + }, + "system_bos": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9943881630897522, + "min_cosine_similarity": 0.9664707779884338, + "mean_relative_l2": 0.10105594992637634, + "max_abs_delta": 0.5625 + }, + "system_x": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9885627031326294, + "min_cosine_similarity": 0.9312549829483032, + "mean_relative_l2": 0.14342200756072998, + "max_abs_delta": 0.875 + }, + "system_period": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.988574206829071, + "min_cosine_similarity": 0.9382044672966003, + "mean_relative_l2": 0.1440514624118805, + "max_abs_delta": 0.875 + }, + "bos_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9925498366355896, + "min_cosine_similarity": 0.9662308096885681, + "mean_relative_l2": 0.11791577935218811, + "max_abs_delta": 0.53125 + }, + "bos_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9901475310325623, + "min_cosine_similarity": 0.9428545832633972, + "mean_relative_l2": 0.13635852932929993, + "max_abs_delta": 0.6875 + }, + "x_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9915470480918884, + "min_cosine_similarity": 0.9723999500274658, + "mean_relative_l2": 0.12465959787368774, + "max_abs_delta": 0.8125 + }, + "x_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.985365092754364, + "min_cosine_similarity": 0.9122870564460754, + "mean_relative_l2": 0.16450965404510498, + "max_abs_delta": 0.75 + }, + "period_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9913360476493835, + "min_cosine_similarity": 0.9732851982116699, + "mean_relative_l2": 0.12711019814014435, + "max_abs_delta": 0.75 + }, + "period_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9848883152008057, + "min_cosine_similarity": 0.9323902130126953, + "mean_relative_l2": 0.16818088293075562, + "max_abs_delta": 0.84375 + } + } + }, + "layer_09": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cdb234029b77c0c0350e0ffc1f46c18c9b954ae0f763b9b4113b0471aa99184f", + "mean": -0.006967094726860523, + "std": 0.3532663881778717, + "rms": 0.35333508253097534, + "max_abs": 11.3125 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bb61887eb035977eaa9bf72f244ee2d45cf7b4c000aafcdc4d96dd7a498e36d0", + "mean": -0.016696970909833908, + "std": 6.768218517303467, + "rms": 6.7682390213012695, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f7140bf0896da1e2f52f72e806749d4210bc5c116e2af0ea2c77ca22b8e20be1", + "mean": -0.006980285048484802, + "std": 0.3534722626209259, + "rms": 0.35354116559028625, + "max_abs": 11.5 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a7dfba9494374629cb33d6c3ccce36d87e89356d55eb524c2ae4c533a3bf1421", + "mean": -0.01722230762243271, + "std": 6.597047328948975, + "rms": 6.59706974029541, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a40ff35489edec771008545855c5e4b02bf02ad0b997e912eb5da259aeb9ffa7", + "mean": -0.00715146167203784, + "std": 0.3561810553073883, + "rms": 0.35625284910202026, + "max_abs": 11.125 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c036e6dfa9363746931876e45bf0f8c97c9d67a5c6e376ba6ea281c9b3c6089f", + "mean": -0.008630791679024696, + "std": 5.9608259201049805, + "rms": 5.960832118988037, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4ac363aef2504478f5afafd0c764780c03b6999ea3a47926286ac977a7336e3a", + "mean": -0.006976454984396696, + "std": 0.3569134771823883, + "rms": 0.35698166489601135, + "max_abs": 11.4375 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4dc11093021391887bd96711e80043c7fd5a16829e898373cea62d82b1516cd9", + "mean": -0.008706695400178432, + "std": 5.637425422668457, + "rms": 5.63743257522583, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "df4dbcf0bb064ad5fb592277d8b9ac55b75e15132f9a926e8ade1c401182dbc6", + "mean": -0.007251422386616468, + "std": 0.3531748950481415, + "rms": 0.35324934124946594, + "max_abs": 11.0 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9e89e7255e3a9d7aa2abc97433f17b637d8a49b8aad8993cdf6b4ab9ddb016a0", + "mean": -0.008684864267706871, + "std": 5.960655689239502, + "rms": 5.960661888122559, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "229fd1bf1239a39e23ccaf93e959d4be8cb90269cc95e24e3288dfca4993ba18", + "mean": -0.007069807033985853, + "std": 0.35293880105018616, + "rms": 0.3530096113681793, + "max_abs": 11.375 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8949ede31716a4d58d9d89fc4c2c85684dccce54b08cb2f467d30280f1445e9b", + "mean": -0.008746644482016563, + "std": 5.637200832366943, + "rms": 5.637207984924316, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cb46f3b7f5db601f16d41b4d082124f07cfef7ee74798340402c645287e2dbfb", + "mean": -0.007350392173975706, + "std": 0.3521765172481537, + "rms": 0.3522532284259796, + "max_abs": 10.9375 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "645e82d962cc861b41a2b98f7972b170cf941226389c1caf49a4db21fdded965", + "mean": -0.008689849637448788, + "std": 5.960585117340088, + "rms": 5.960590839385986, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7fda9d24b675771f4104ff38cc3e756ac204c3f7ee1818519858d87b245c2242", + "mean": -0.007312544621527195, + "std": 0.3527224361896515, + "rms": 0.352798193693161, + "max_abs": 11.375 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3526fcadc71f07ca551604c4c01962d1b86900af2792137c6d0630a34491f39a", + "mean": -0.008811186999082565, + "std": 5.637167453765869, + "rms": 5.637174606323242, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9976502656936646, + "min_cosine_similarity": 0.9896465539932251, + "mean_relative_l2": 0.06331700831651688, + "max_abs_delta": 0.5625 + }, + "system_bos": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9948639273643494, + "min_cosine_similarity": 0.9760004281997681, + "mean_relative_l2": 0.09626422077417374, + "max_abs_delta": 0.6875 + }, + "system_x": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9889329075813293, + "min_cosine_similarity": 0.9420279860496521, + "mean_relative_l2": 0.1401238739490509, + "max_abs_delta": 1.03125 + }, + "system_period": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9891225099563599, + "min_cosine_similarity": 0.9542107582092285, + "mean_relative_l2": 0.14024055004119873, + "max_abs_delta": 1.3125 + }, + "bos_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9933048486709595, + "min_cosine_similarity": 0.9757208824157715, + "mean_relative_l2": 0.11197496205568314, + "max_abs_delta": 0.6875 + }, + "bos_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9910955429077148, + "min_cosine_similarity": 0.9575067162513733, + "mean_relative_l2": 0.12979727983474731, + "max_abs_delta": 1.03125 + }, + "x_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.992343008518219, + "min_cosine_similarity": 0.9772577285766602, + "mean_relative_l2": 0.118791364133358, + "max_abs_delta": 0.78125 + }, + "x_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.985938549041748, + "min_cosine_similarity": 0.9251168370246887, + "mean_relative_l2": 0.1604180783033371, + "max_abs_delta": 1.3125 + }, + "period_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9921755790710449, + "min_cosine_similarity": 0.9791029095649719, + "mean_relative_l2": 0.12123650312423706, + "max_abs_delta": 0.90625 + }, + "period_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9859663248062134, + "min_cosine_similarity": 0.9496022462844849, + "mean_relative_l2": 0.16167277097702026, + "max_abs_delta": 1.28125 + } + } + }, + "layer_10": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7c98958d5bb1f9eeff83ed1d0623e2a0372efd82ce15ef3fdc6ad7b70779a48a", + "mean": -0.00500774709507823, + "std": 0.3983820676803589, + "rms": 0.3984135687351227, + "max_abs": 12.5625 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7001782a257df4a67f7bdbbc88b6a62696d93bf5a6410813f1d4e0d884699ea4", + "mean": -0.01554434560239315, + "std": 6.776191711425781, + "rms": 6.776209354400635, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "88a20c097d65709cbe5652b7c45ce51aedeb18523048896199d9ecad1caf0fb7", + "mean": -0.005140254274010658, + "std": 0.3989020586013794, + "rms": 0.3989351987838745, + "max_abs": 12.625 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "52f78b31137473302a037a06ef0ad5c2763779a2917a88cfea94d0bc2eb2bef9", + "mean": -0.01639482192695141, + "std": 6.604781150817871, + "rms": 6.604801177978516, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "557da05f14840d5a8d033a04545949392cd42059fdfcf385bed2bc47b73c2fb2", + "mean": -0.005299775395542383, + "std": 0.40175899863243103, + "rms": 0.4017939269542694, + "max_abs": 12.5625 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5cdc372b1c64e462222fe05832b495531778cb1cd096c3b7b08326afe7a51714", + "mean": -0.007616246119141579, + "std": 5.969588756561279, + "rms": 5.969593524932861, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5208503cfc3a7ddded9362a388bd6c0dc7c02951ecd6fb113eab0c6ad75f9e5c", + "mean": -0.005464000627398491, + "std": 0.4031049311161041, + "rms": 0.40314194560050964, + "max_abs": 12.75 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "21ae79e38b6d04b404c198283c5dcacebd59dd25e8cc375085e210498a516748", + "mean": -0.008126338012516499, + "std": 5.646072864532471, + "rms": 5.646079063415527, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d1377571021358832b484b33291fc69bc55bf34e91c598b223c3e798d5d5ac40", + "mean": -0.0055068782530725, + "std": 0.3988889157772064, + "rms": 0.39892691373825073, + "max_abs": 12.375 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6e8fd2453875b73d20ae312a4d6639dfcc4e43cc39f2c26f80cfe5ca429a5e9c", + "mean": -0.007768102455884218, + "std": 5.96940279006958, + "rms": 5.969407558441162, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1c370a143642ce0ed45e67bf1bd1ff96e05e20ba2325edcd0a34140c677ee16c", + "mean": -0.005965178366750479, + "std": 0.4002460837364197, + "rms": 0.4002905488014221, + "max_abs": 12.6875 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "96b715b9478916ed1608119c4af5a4aabbd184399bbcbafa34865b15b924078b", + "mean": -0.008476253598928452, + "std": 5.64586877822876, + "rms": 5.645874977111816, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e444ac911ddb2e095669a35f8b769523738bc27eea19ca2627f0d527973337bf", + "mean": -0.005610155873000622, + "std": 0.3979409337043762, + "rms": 0.3979804813861847, + "max_abs": 12.25 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d6612aa364b1333c7afd2c20902d38daa872fb4a7fa5b099bb55ba86dd459bf6", + "mean": -0.007724568247795105, + "std": 5.96933126449585, + "rms": 5.969336032867432, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bb9288f2c48a28a94317f4ff7b403c72e7c41bb53681ebf4bd6df3d8b9834a2d", + "mean": -0.0060975030064582825, + "std": 0.3996521234512329, + "rms": 0.3996986448764801, + "max_abs": 12.75 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "33da38ca295c14c045ba7d666b8a03b4809d143a6849c7e3cde5fbb292b65ea7", + "mean": -0.008443649858236313, + "std": 5.645818710327148, + "rms": 5.645824432373047, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9971579909324646, + "min_cosine_similarity": 0.9901207685470581, + "mean_relative_l2": 0.06969459354877472, + "max_abs_delta": 0.5 + }, + "system_bos": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9940230846405029, + "min_cosine_similarity": 0.9746941328048706, + "mean_relative_l2": 0.10462448000907898, + "max_abs_delta": 0.75 + }, + "system_x": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.987547755241394, + "min_cosine_similarity": 0.9279312491416931, + "mean_relative_l2": 0.14928068220615387, + "max_abs_delta": 1.1875 + }, + "system_period": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9874391555786133, + "min_cosine_similarity": 0.9477257132530212, + "mean_relative_l2": 0.1512371152639389, + "max_abs_delta": 1.3125 + }, + "bos_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9925563931465149, + "min_cosine_similarity": 0.9755402207374573, + "mean_relative_l2": 0.11805038154125214, + "max_abs_delta": 0.65625 + }, + "bos_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9900986552238464, + "min_cosine_similarity": 0.9581678509712219, + "mean_relative_l2": 0.13693684339523315, + "max_abs_delta": 0.75 + }, + "x_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9912657737731934, + "min_cosine_similarity": 0.9770196080207825, + "mean_relative_l2": 0.12729060649871826, + "max_abs_delta": 0.8125 + }, + "x_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9842873811721802, + "min_cosine_similarity": 0.9120314121246338, + "mean_relative_l2": 0.1702626347541809, + "max_abs_delta": 1.0 + }, + "period_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9911600351333618, + "min_cosine_similarity": 0.9786127805709839, + "mean_relative_l2": 0.12916970252990723, + "max_abs_delta": 0.9375 + }, + "period_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9841408729553223, + "min_cosine_similarity": 0.9439095258712769, + "mean_relative_l2": 0.1722390204668045, + "max_abs_delta": 1.0 + } + } + }, + "layer_11": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7e66ca9c1b91c5967a770e87e262ed1fd98e455d2e3bb076864bd34cdb7a35e1", + "mean": -0.008473815396428108, + "std": 0.506109893321991, + "rms": 0.5061808228492737, + "max_abs": 17.0 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ef2d98b2dac9c64fa66e8256f73e9801674769c25416dfc82b0e42fb2cce6c0a", + "mean": -0.018045218661427498, + "std": 6.817704677581787, + "rms": 6.8177289962768555, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "45b7cea7d184f8feb38d520d063050941779ec2700ab0fa36cac758eadf44101", + "mean": -0.008607870899140835, + "std": 0.5052498579025269, + "rms": 0.5053231716156006, + "max_abs": 17.0 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d2cbf763bae9dbfff9a62d3a10df31c9ab656890ed94ac61a57688790d254dfa", + "mean": -0.018668949604034424, + "std": 6.6443939208984375, + "rms": 6.6444196701049805, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1982d19f01fc3342a3cb3739fa58535dc515f20491eff9e047fda6a5b384d7b9", + "mean": -0.008884627372026443, + "std": 0.5089828372001648, + "rms": 0.5090603828430176, + "max_abs": 17.0 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "235067efbb80d480de76af8ba968095141cc9cca1c48b5aca9cafa3733694edf", + "mean": -0.010183221660554409, + "std": 6.005112648010254, + "rms": 6.00512170791626, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8e76314e251cc9724e0d593995d15243284a5d462e3ce72c066b1f5466d167f3", + "mean": -0.008691788651049137, + "std": 0.509784460067749, + "rms": 0.5098585486412048, + "max_abs": 16.875 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fda87c27e9c7dc76512945d1d89b082dfbe7460a4e07cf7eb1abb9873a53bb4f", + "mean": -0.01021071057766676, + "std": 5.680197715759277, + "rms": 5.680206775665283, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "94fbcec40f58bb7591b18bfdf4e2ac58a2320b3abb0ecea7a64cf0908ef72c53", + "mean": -0.008990786969661713, + "std": 0.5059683322906494, + "rms": 0.5060482025146484, + "max_abs": 16.875 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a72879dba195ce0f382a3c995d44e3c9d6b1a6fed921b387332a83565526057c", + "mean": -0.01019312720745802, + "std": 6.0049004554748535, + "rms": 6.004909038543701, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d838065c3874d3f21b48b47f501d2416c15d52516d74e4e055a695666e210811", + "mean": -0.009201301261782646, + "std": 0.5057496428489685, + "rms": 0.5058333277702332, + "max_abs": 16.875 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2db58d3e78103e33a3eb87e1f8cdc60f7eb59994c58b0a0011777c406582f167", + "mean": -0.010463867336511612, + "std": 5.6798224449157715, + "rms": 5.6798319816589355, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "988c4da5b4ec751caea9d49acdb99a759e7d60f5e6bc09848090e1832e039244", + "mean": -0.009232824668288231, + "std": 0.5043060183525085, + "rms": 0.5043905377388, + "max_abs": 17.0 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "625a6750da2c739ae0ac90ee5a67a67c5a6108b1668ce2c4a97277a1b48b36ce", + "mean": -0.010273966006934643, + "std": 6.004742622375488, + "rms": 6.004751682281494, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4d12a57a5b9edb755b6aa09df823225b07e89c266608c354b3f8aed8c23bb8e2", + "mean": -0.00936164055019617, + "std": 0.505280077457428, + "rms": 0.5053668022155762, + "max_abs": 16.625 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e2535790b157e32054e82e583b1f7fa789631517f3557fe84bbc47d3bf30060a", + "mean": -0.010447312146425247, + "std": 5.679773807525635, + "rms": 5.679783344268799, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9974430203437805, + "min_cosine_similarity": 0.9903321862220764, + "mean_relative_l2": 0.06676697731018066, + "max_abs_delta": 0.5625 + }, + "system_bos": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9949392676353455, + "min_cosine_similarity": 0.9818789958953857, + "mean_relative_l2": 0.09678909182548523, + "max_abs_delta": 0.75 + }, + "system_x": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9891856908798218, + "min_cosine_similarity": 0.9437886476516724, + "mean_relative_l2": 0.14053873717784882, + "max_abs_delta": 1.25 + }, + "system_period": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9886032342910767, + "min_cosine_similarity": 0.9565185308456421, + "mean_relative_l2": 0.14484968781471252, + "max_abs_delta": 1.3125 + }, + "bos_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9938875436782837, + "min_cosine_similarity": 0.962144672870636, + "mean_relative_l2": 0.1061655580997467, + "max_abs_delta": 1.0625 + }, + "bos_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9917424321174622, + "min_cosine_similarity": 0.9602886438369751, + "mean_relative_l2": 0.12478458881378174, + "max_abs_delta": 0.875 + }, + "x_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.992633581161499, + "min_cosine_similarity": 0.9722225666046143, + "mean_relative_l2": 0.11727353930473328, + "max_abs_delta": 1.0 + }, + "x_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9867178201675415, + "min_cosine_similarity": 0.9362244606018066, + "mean_relative_l2": 0.1572560966014862, + "max_abs_delta": 1.125 + }, + "period_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.992561399936676, + "min_cosine_similarity": 0.9712584614753723, + "mean_relative_l2": 0.11842527985572815, + "max_abs_delta": 1.0 + }, + "period_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9863747358322144, + "min_cosine_similarity": 0.9546806216239929, + "mean_relative_l2": 0.16018842160701752, + "max_abs_delta": 1.21875 + } + } + }, + "layer_12": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "830df3747b02b49b78b2018efc4a5071aacf27354bb94579c9127e995b01c615", + "mean": -0.009097037836909294, + "std": 0.5334962606430054, + "rms": 0.5335738062858582, + "max_abs": 17.0 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "73d27858d91c12d57e6bf0b408d09a00f83c97e63647fcb01eff8ffbdaf57040", + "mean": -0.019059089943766594, + "std": 6.865880489349365, + "rms": 6.865907192230225, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2719b1f9eae7c883eeecda3c4931ea23e11e13c75b639ddd41e74894c8f5c564", + "mean": -0.009007297456264496, + "std": 0.5330325961112976, + "rms": 0.533108651638031, + "max_abs": 16.875 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5a238bdc161591d8b81a84221b5ab96fef5e124914d0b67557c3eda647332b43", + "mean": -0.019125960767269135, + "std": 6.693582057952881, + "rms": 6.693609237670898, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "faf21ba64332a7ca183815877caf4eaf3998ce4d9a3323368f5964e3bfb95965", + "mean": -0.009303851053118706, + "std": 0.5369843244552612, + "rms": 0.5370649099349976, + "max_abs": 17.0 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bf2529b88ee6ade5c7627580ccfb3d647ae2f9b1af3ed8d941cbbaa9f127272a", + "mean": -0.010838540270924568, + "std": 6.016930103302002, + "rms": 6.016939640045166, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1315b3714a02b925d86f6b53e01c26b1596e3f4032b6c170dacba9d286f7afb0", + "mean": -0.008742349222302437, + "std": 0.5365563631057739, + "rms": 0.5366275906562805, + "max_abs": 16.875 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6357400ee9a50cccfa02505133e2279231c9dc07233b21694a69269fee48835f", + "mean": -0.010352193377912045, + "std": 5.691924095153809, + "rms": 5.691933631896973, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a228fe159ec4c56978321095b70576364f5b7997046416b101cbd118ba03d65e", + "mean": -0.009561057202517986, + "std": 0.5342397093772888, + "rms": 0.5343252420425415, + "max_abs": 16.75 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "06d97878e1cda69b4ee9a3904a2b5d4bd72f1a98d78232323f6f8f6ab93b4fdb", + "mean": -0.011240043677389622, + "std": 6.016730308532715, + "rms": 6.016740798950195, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0dfb0a1fe02b3bca179e213986590854cbd421e8007f8d5b9a74959ce39b8724", + "mean": -0.009416756220161915, + "std": 0.5325754880905151, + "rms": 0.5326586961746216, + "max_abs": 16.75 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8bc4231c3cf5da8b491e8dfb830d6fcbf2e70711cd564c8ddb9be2ca9a389e8c", + "mean": -0.010825703851878643, + "std": 5.69148588180542, + "rms": 5.691495895385742, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b36aa3d6c938f1fd50011c1d7db4b1babdaa5c890ee127e72b52a34a839cbdf2", + "mean": -0.00974983349442482, + "std": 0.5337862968444824, + "rms": 0.5338753461837769, + "max_abs": 16.75 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b07f7cea6c2d8d23f21a58bdac5d01ea96167b23b8efa5ef278db6003ab1ab11", + "mean": -0.011171416379511356, + "std": 6.016642093658447, + "rms": 6.0166521072387695, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "181b8aa30333f350ef7a060757411e2944473f3f4ba472e457126176d2d1ca58", + "mean": -0.009544776752591133, + "std": 0.5334251523017883, + "rms": 0.5335105061531067, + "max_abs": 16.625 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2706d53450dcb1fe66607df83fafa301a0dc2b382b1fc8a95e590950b865a1dd", + "mean": -0.010708224028348923, + "std": 5.691556453704834, + "rms": 5.691566467285156, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9968933463096619, + "min_cosine_similarity": 0.9859265089035034, + "mean_relative_l2": 0.07362473011016846, + "max_abs_delta": 0.5 + }, + "system_bos": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9939222931861877, + "min_cosine_similarity": 0.9766981601715088, + "mean_relative_l2": 0.10553818941116333, + "max_abs_delta": 0.75 + }, + "system_x": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9874807596206665, + "min_cosine_similarity": 0.9428878426551819, + "mean_relative_l2": 0.15097659826278687, + "max_abs_delta": 1.125 + }, + "system_period": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9868152141571045, + "min_cosine_similarity": 0.9549368619918823, + "mean_relative_l2": 0.156192347407341, + "max_abs_delta": 1.1875 + }, + "bos_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9928309917449951, + "min_cosine_similarity": 0.9695798754692078, + "mean_relative_l2": 0.11549156159162521, + "max_abs_delta": 0.875 + }, + "bos_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9902839064598083, + "min_cosine_similarity": 0.9654521942138672, + "mean_relative_l2": 0.1353396773338318, + "max_abs_delta": 1.0 + }, + "x_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9912378787994385, + "min_cosine_similarity": 0.9726595878601074, + "mean_relative_l2": 0.12864109873771667, + "max_abs_delta": 1.0625 + }, + "x_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9845338463783264, + "min_cosine_similarity": 0.9311631321907043, + "mean_relative_l2": 0.17037063837051392, + "max_abs_delta": 1.6875 + }, + "period_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9912070631980896, + "min_cosine_similarity": 0.9714773297309875, + "mean_relative_l2": 0.1290285289287567, + "max_abs_delta": 1.125 + }, + "period_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9840646982192993, + "min_cosine_similarity": 0.952465295791626, + "mean_relative_l2": 0.1739063709974289, + "max_abs_delta": 1.390625 + } + } + }, + "layer_13": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "426190d33777587cb0651bbec68cd83c49899afe221fff375f8fe2c4b2c62ee2", + "mean": -0.008361594751477242, + "std": 0.5909140110015869, + "rms": 0.5909731388092041, + "max_abs": 19.25 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9a48c9878ed46b0a5c44b42bcd84e8b59d22478de83f70b6b1e6e773a141710b", + "mean": -0.018548866733908653, + "std": 6.874675273895264, + "rms": 6.874700546264648, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0a063d1a7c52920020aabe6e89b6fdd1c8bd78662d763b070688f181be069b6b", + "mean": -0.008293856866657734, + "std": 0.5910078883171082, + "rms": 0.5910660624504089, + "max_abs": 19.125 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c7aed3227d62c1cca16526591d1ef78c665ddcaffb0bc700422d2a17e68b726a", + "mean": -0.019101286306977272, + "std": 6.702455043792725, + "rms": 6.7024827003479, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b1ade8507547b9b9368c6a8f1465030ea0da83700fd0ef17dd5a85dcb95977a5", + "mean": -0.008620317094027996, + "std": 0.5956765413284302, + "rms": 0.5957388877868652, + "max_abs": 19.25 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "48cd1c84b9d6b72de5d6af22370db41d67eec4d2237d0fb6fe5db858b1c2e71b", + "mean": -0.01036227960139513, + "std": 6.025634288787842, + "rms": 6.025643348693848, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "92716b108d1f676f709a49cc7676cc3dc41c3d6134156bc76db77795152e6bd1", + "mean": -0.008065733127295971, + "std": 0.595078706741333, + "rms": 0.595133364200592, + "max_abs": 19.125 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d5d730cca1cb32e6cecd7a3a030bba2b57f6985844a5dff2700eb99dbf98a216", + "mean": -0.010347804054617882, + "std": 5.700866222381592, + "rms": 5.700876235961914, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "45a1b7ee33d60b6f521bfc4dc0653b1d005e94c87aa98bb9d67743723f809d88", + "mean": -0.008683810010552406, + "std": 0.5926710367202759, + "rms": 0.5927346348762512, + "max_abs": 19.25 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a2feebfb18a3acc725d5111e59514beffcac058f898a15196befe95e3646d87e", + "mean": -0.01064276322722435, + "std": 6.025452136993408, + "rms": 6.025461196899414, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e59d9a6c6c9f4ddf94c5ee6fe87d33d4a867664ce9b3ae5404eef3aedd35c68b", + "mean": -0.008507237769663334, + "std": 0.5903785228729248, + "rms": 0.5904397964477539, + "max_abs": 18.75 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a6c9cc189ceb7cb0b836ec0b81f003510a4947550ea029454e52b44dbecd1b26", + "mean": -0.01060454547405243, + "std": 5.700380802154541, + "rms": 5.700390338897705, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0b48a50d09f0eb5b08d7c175ea8cd78bd81b5288324957fb6794b8a11cff2fd6", + "mean": -0.008823106065392494, + "std": 0.5917252898216248, + "rms": 0.5917910933494568, + "max_abs": 19.125 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "33bf5af267860bc95d47a6249ea759256e0895c3dd92c76aac04cce3de69b79d", + "mean": -0.010540226474404335, + "std": 6.025302410125732, + "rms": 6.02531099319458, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "33606b16e836c044d3ee89331e08f59b6d596c6abae681e8bb25ba5d99f0c6a9", + "mean": -0.00893173273652792, + "std": 0.5905401110649109, + "rms": 0.5906076431274414, + "max_abs": 18.75 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d35ccf788f89f1a1ebc7749d6c0c2bf8356e70561437359ef5eeef801d6c95a7", + "mean": -0.010739774443209171, + "std": 5.7004008293151855, + "rms": 5.700410842895508, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9968598484992981, + "min_cosine_similarity": 0.9874759316444397, + "mean_relative_l2": 0.0740702673792839, + "max_abs_delta": 0.75 + }, + "system_bos": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9936150312423706, + "min_cosine_similarity": 0.9725015163421631, + "mean_relative_l2": 0.1077328771352768, + "max_abs_delta": 0.875 + }, + "system_x": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.987345814704895, + "min_cosine_similarity": 0.9514749050140381, + "mean_relative_l2": 0.15202055871486664, + "max_abs_delta": 1.15625 + }, + "system_period": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9866088628768921, + "min_cosine_similarity": 0.9589805603027344, + "mean_relative_l2": 0.15721698105335236, + "max_abs_delta": 1.21875 + }, + "bos_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9924392104148865, + "min_cosine_similarity": 0.9722787141799927, + "mean_relative_l2": 0.11866473406553268, + "max_abs_delta": 1.125 + }, + "bos_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9899708032608032, + "min_cosine_similarity": 0.9695903658866882, + "mean_relative_l2": 0.1372028887271881, + "max_abs_delta": 1.5 + }, + "x_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9906883835792542, + "min_cosine_similarity": 0.9752545356750488, + "mean_relative_l2": 0.13198144733905792, + "max_abs_delta": 1.0625 + }, + "x_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9841785430908203, + "min_cosine_similarity": 0.940581202507019, + "mean_relative_l2": 0.17194147408008575, + "max_abs_delta": 1.75 + }, + "period_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9908919930458069, + "min_cosine_similarity": 0.9739128351211548, + "mean_relative_l2": 0.13076704740524292, + "max_abs_delta": 1.1875 + }, + "period_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9839559197425842, + "min_cosine_similarity": 0.9537861347198486, + "mean_relative_l2": 0.1739121675491333, + "max_abs_delta": 1.6875 + } + } + }, + "layer_14": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d3a98a8eff267c9749cda55ed6c4a7bb9aebd9478c49f39b275362a38aafe0b5", + "mean": -0.008190703578293324, + "std": 0.6763670444488525, + "rms": 0.6764166355133057, + "max_abs": 22.25 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "22691e09c7de06090ccbdcf3a9050d0caa623c93364b75b659f423811bf11983", + "mean": -0.018050789833068848, + "std": 6.893535614013672, + "rms": 6.893559455871582, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f2d083f14dce85ec56c493ea13471393d1cfbe466dd85470e4bd6fc9ab49e625", + "mean": -0.00836133025586605, + "std": 0.6765623092651367, + "rms": 0.6766139268875122, + "max_abs": 22.25 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a2323fdd6177b342d9c79420eaa0503153445619759afa5f21454445f1dc8e1c", + "mean": -0.018999764695763588, + "std": 6.720197677612305, + "rms": 6.720224380493164, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ba60c5823e17d24ea8c81844da7896e443ac89e4e7d515169287036a6a45d100", + "mean": -0.008417034521698952, + "std": 0.6814781427383423, + "rms": 0.6815301179885864, + "max_abs": 22.375 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8e70057d00766146dd76fa65432aaaf43496ba430e452aa6400e7abd2cc3ec93", + "mean": -0.009835334494709969, + "std": 6.046422481536865, + "rms": 6.0464301109313965, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "23763c71e4707631139e000ad30862bcdb75095322be851eed4f6d583a00981b", + "mean": -0.008188930340111256, + "std": 0.68116694688797, + "rms": 0.6812161803245544, + "max_abs": 22.625 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b45e31b16e724f215e86f7ce52adf27b1d9d878d10a7a1b2d7a686831e7ef7a1", + "mean": -0.010234578512609005, + "std": 5.720993995666504, + "rms": 5.72100305557251, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9a41e2af10510d3c35b2eb29baf5014b9f578330181ade955540777a10995a0a", + "mean": -0.008439389988780022, + "std": 0.6781485676765442, + "rms": 0.6782011389732361, + "max_abs": 22.5 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e63a0f88c2f05746766ff94ddbf4751168c3b6fc7dc94ed59d1086bcb3da7d98", + "mean": -0.010079050436615944, + "std": 6.046213150024414, + "rms": 6.046221733093262, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "826537e71e552ac430b662524cab9787c745ad014bfa25ac1449eef5901af1ad", + "mean": -0.008803287521004677, + "std": 0.675789475440979, + "rms": 0.6758467555046082, + "max_abs": 22.5 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1ebd989df9641b5918df22213b682d10c9f69c71a1baa589b9c1ba4668d6ec32", + "mean": -0.010616917163133621, + "std": 5.7204461097717285, + "rms": 5.720456123352051, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1efa25b4495bceca9b8558530b731d6411fb455ac541aba29d642ee11e27af5e", + "mean": -0.008748472668230534, + "std": 0.6765644550323486, + "rms": 0.6766210198402405, + "max_abs": 22.5 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fbf845f093b2c3c7d1539ae4f5e49241cfc02f79ab5cbe0aa60e482702549dad", + "mean": -0.0101168816909194, + "std": 6.045981407165527, + "rms": 6.045989990234375, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "85b8b5ebccfdfbfea6a82864af685269b0f968689a5263d4fe82fd5a7aa38a21", + "mean": -0.009116822853684425, + "std": 0.675266444683075, + "rms": 0.6753280162811279, + "max_abs": 22.5 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "09101d6ca9208dddae25fcea830094fc05426593af2933cbd15a2a2e160de40b", + "mean": -0.010693863965570927, + "std": 5.7203779220581055, + "rms": 5.720387935638428, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9968206882476807, + "min_cosine_similarity": 0.988024115562439, + "mean_relative_l2": 0.07478779554367065, + "max_abs_delta": 0.875 + }, + "system_bos": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9937336444854736, + "min_cosine_similarity": 0.9713619947433472, + "mean_relative_l2": 0.10649891197681427, + "max_abs_delta": 0.875 + }, + "system_x": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9873447418212891, + "min_cosine_similarity": 0.9526000022888184, + "mean_relative_l2": 0.15168479084968567, + "max_abs_delta": 1.3125 + }, + "system_period": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9866495132446289, + "min_cosine_similarity": 0.9606350064277649, + "mean_relative_l2": 0.15632665157318115, + "max_abs_delta": 1.4375 + }, + "bos_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9925382733345032, + "min_cosine_similarity": 0.973783016204834, + "mean_relative_l2": 0.1177758276462555, + "max_abs_delta": 1.0 + }, + "bos_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9904077053070068, + "min_cosine_similarity": 0.970794141292572, + "mean_relative_l2": 0.13404320180416107, + "max_abs_delta": 1.5625 + }, + "x_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9910219311714172, + "min_cosine_similarity": 0.9762903451919556, + "mean_relative_l2": 0.12988750636577606, + "max_abs_delta": 1.25 + }, + "x_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9846665263175964, + "min_cosine_similarity": 0.9414781332015991, + "mean_relative_l2": 0.16873949766159058, + "max_abs_delta": 2.125 + }, + "period_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.991299569606781, + "min_cosine_similarity": 0.9757561683654785, + "mean_relative_l2": 0.12779346108436584, + "max_abs_delta": 1.3125 + }, + "period_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9844070076942444, + "min_cosine_similarity": 0.9479917287826538, + "mean_relative_l2": 0.17074964940547943, + "max_abs_delta": 2.125 + } + } + }, + "layer_15": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8d488371264e279b79fc0f2f11cfbccc08528bb0a4c6fefe75d9a281337eb523", + "mean": -0.011030556634068489, + "std": 0.7495222091674805, + "rms": 0.7496033906936646, + "max_abs": 24.5 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "47eee0fdf48ec0e8c3463d67506b866b96af17318c44ce342c551607e789cbc5", + "mean": -0.0200137160718441, + "std": 6.903679847717285, + "rms": 6.9037089347839355, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c2227a516675b048cf4253ae55829dd273beae7c7ecc97d3764319bcf003582d", + "mean": -0.011272658593952656, + "std": 0.7486189007759094, + "rms": 0.7487037777900696, + "max_abs": 24.25 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "613747ab70a288c6f54ce070bdb3e36089796e941ae6df0022e52ccff585c0d8", + "mean": -0.021030094474554062, + "std": 6.730649471282959, + "rms": 6.730682373046875, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7c44159e6e81dabb6ef7a76a30deb4a482b3da13d7f8a6720642eb17934fc1e1", + "mean": -0.011255279183387756, + "std": 0.7544611096382141, + "rms": 0.7545450925827026, + "max_abs": 24.375 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0c56acd2c62e1bc5c7b02a0b8d6d50b19bb11627f6fa7cdea64f7d25e322ccd0", + "mean": -0.011812282726168633, + "std": 6.057451248168945, + "rms": 6.0574631690979, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "40d4508ae6cb60ea60383051e428ded96cd86afe61787073814ee555806b83de", + "mean": -0.010992174968123436, + "std": 0.7524078488349915, + "rms": 0.7524880766868591, + "max_abs": 23.875 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ef95bccee5067edc9ec7624a9ea52ffea34ed245ddd7e8319ed9af3ea2fe743f", + "mean": -0.012203142046928406, + "std": 5.732516288757324, + "rms": 5.732529163360596, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e453a494be8ca52ec3c7232154b09c1195338f9af0ebbab4920104ed91274fdc", + "mean": -0.011056126095354557, + "std": 0.7492140531539917, + "rms": 0.7492955923080444, + "max_abs": 24.5 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cb68ce379a34f23ef70c9d97188fbd1af32501bf2d4fab0fc0d1bb45b2ea0729", + "mean": -0.011858676560223103, + "std": 6.056987762451172, + "rms": 6.056999683380127, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8588bbd361556267c8a8ff7ef1026b29622cc9aa37e7829f5ad21bd3690d4574", + "mean": -0.011928100138902664, + "std": 0.745028555393219, + "rms": 0.7451239824295044, + "max_abs": 23.75 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1c10a9b203291db0cc3dc7687ffa57f926d99a56d1804c70153d56a4034a1b9c", + "mean": -0.012843593023717403, + "std": 5.731661796569824, + "rms": 5.731677055358887, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a1bf7e664dd97125fbad7e57fa63c24fc3dee06a66f34e5cfede9b55188c3315", + "mean": -0.011384653858840466, + "std": 0.747865617275238, + "rms": 0.7479522228240967, + "max_abs": 24.125 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "391cc399e9cb7b08efbba7cbd57162bc42b9da5ccbac07bc65da082af3f73771", + "mean": -0.011903929524123669, + "std": 6.0567779541015625, + "rms": 6.056789875030518, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "01822066bfa686c210a7f48074da4f32cc530a900153a7f2e6828eac10d952ca", + "mean": -0.012267732992768288, + "std": 0.7441877126693726, + "rms": 0.7442888617515564, + "max_abs": 23.75 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "442c7fab8d700e43578f9314c28d487c37f36b4a613019096488440210535c1b", + "mean": -0.012918665073812008, + "std": 5.731585502624512, + "rms": 5.731599807739258, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9966205954551697, + "min_cosine_similarity": 0.9866850972175598, + "mean_relative_l2": 0.07705523073673248, + "max_abs_delta": 0.9375 + }, + "system_bos": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9935474395751953, + "min_cosine_similarity": 0.97100830078125, + "mean_relative_l2": 0.10792209208011627, + "max_abs_delta": 1.5 + }, + "system_x": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9868021607398987, + "min_cosine_similarity": 0.9528759717941284, + "mean_relative_l2": 0.15483619272708893, + "max_abs_delta": 1.75 + }, + "system_period": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9861184358596802, + "min_cosine_similarity": 0.9597011208534241, + "mean_relative_l2": 0.15924608707427979, + "max_abs_delta": 1.75 + }, + "bos_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9924470782279968, + "min_cosine_similarity": 0.9727170467376709, + "mean_relative_l2": 0.11825092136859894, + "max_abs_delta": 1.25 + }, + "bos_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9902967214584351, + "min_cosine_similarity": 0.9661417007446289, + "mean_relative_l2": 0.13469430804252625, + "max_abs_delta": 2.125 + }, + "x_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9909073114395142, + "min_cosine_similarity": 0.9740807414054871, + "mean_relative_l2": 0.13058312237262726, + "max_abs_delta": 1.5625 + }, + "x_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9842464327812195, + "min_cosine_similarity": 0.9388010501861572, + "mean_relative_l2": 0.17054550349712372, + "max_abs_delta": 2.375 + }, + "period_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.991210401058197, + "min_cosine_similarity": 0.9754184484481812, + "mean_relative_l2": 0.12825140357017517, + "max_abs_delta": 1.75 + }, + "period_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9840248823165894, + "min_cosine_similarity": 0.9475868940353394, + "mean_relative_l2": 0.1724759042263031, + "max_abs_delta": 2.25 + } + } + }, + "layer_16": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ac78cc74336a5198712589bb1cfd1fdc2d548b4c669262aea6e361e3a378f65e", + "mean": -0.014605400152504444, + "std": 0.874299168586731, + "rms": 0.8744211196899414, + "max_abs": 26.875 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4d0322a6933558e3277396b722a55ca64997593bbe61de8ab4d1940a6ed9f479", + "mean": -0.022860143333673477, + "std": 6.920103549957275, + "rms": 6.920141220092773, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9fa6880dc8c19ad2cc8dfbe7a868814f00da6f02f0826f66d9578a667a1e7964", + "mean": -0.014898142777383327, + "std": 0.8745629787445068, + "rms": 0.8746898770332336, + "max_abs": 26.875 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f2b3eeb5d587988630efb9fe9d5a36e6b7928e94513bc32dcc1d9393dd59591e", + "mean": -0.023448742926120758, + "std": 6.746831893920898, + "rms": 6.746872425079346, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "68acfa93381ac5878558f6c975ed3fe6f085b254ec8be99547f143e363142da2", + "mean": -0.014635613188147545, + "std": 0.8793728947639465, + "rms": 0.8794946670532227, + "max_abs": 26.75 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9d2bb8247c9a2a18a85d7bc639f292e405087f3d44aff4a9e7cabb981f1f3149", + "mean": -0.014420702122151852, + "std": 6.07533073425293, + "rms": 6.075347423553467, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cbca934215d908619563e7268d4df8b77bf5ee812943efc4561ee64122c1258e", + "mean": -0.014216422103345394, + "std": 0.8775417804718018, + "rms": 0.8776569366455078, + "max_abs": 26.75 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "da2d0ef2010c06585d3d3e7a9e6479f172b907a4139d4cd350be417f42176ee7", + "mean": -0.014216741546988487, + "std": 5.750737190246582, + "rms": 5.7507548332214355, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f676a1b013c06bb09255c77a564110cc6e0bb7165aca53b33f9bfaa4d3cc40c1", + "mean": -0.014613153412938118, + "std": 0.8746819496154785, + "rms": 0.8748040199279785, + "max_abs": 27.0 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "eb7bfe3e48889df74e6ece7c3255943f85deb6937ae37f953c38a70e0971058b", + "mean": -0.014647606760263443, + "std": 6.075003147125244, + "rms": 6.075019836425781, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "30cfc7742152c6714f3061a1a1674f7c5add73e19dcd386b4817921af1f16176", + "mean": -0.015306792221963406, + "std": 0.8698534369468689, + "rms": 0.8699880838394165, + "max_abs": 26.875 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "72d621f78f53ba3dc33c1fdde9e9cc29b9a68ef5f20dca76c6e936c60b64b458", + "mean": -0.015047239139676094, + "std": 5.7499098777771, + "rms": 5.749929904937744, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "03f00f86fbcf6e94f4f43497f6a87c60fbcfb99526e8294b268a2b499efe3f91", + "mean": -0.014883922412991524, + "std": 0.8738458156585693, + "rms": 0.8739725351333618, + "max_abs": 27.0 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fc585f8c438889c5b4bb15aec6e9abc6f498dea5e429f11ed02c8076e0ec4349", + "mean": -0.014609167352318764, + "std": 6.074709415435791, + "rms": 6.074726581573486, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2719c16217694c4dabcc592e4bf2a2b9b3a56abb10d1e68a7746278fe6fda338", + "mean": -0.015615910291671753, + "std": 0.8696047067642212, + "rms": 0.8697449564933777, + "max_abs": 26.875 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "21fd501fee0f912fbef59868e43ab159a38315b4a490c359e7041b69ea04b35d", + "mean": -0.0150176752358675, + "std": 5.749770164489746, + "rms": 5.749789714813232, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9965681433677673, + "min_cosine_similarity": 0.9813411831855774, + "mean_relative_l2": 0.07716744393110275, + "max_abs_delta": 1.0 + }, + "system_bos": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9935207962989807, + "min_cosine_similarity": 0.9690133333206177, + "mean_relative_l2": 0.10781941562891006, + "max_abs_delta": 1.75 + }, + "system_x": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9867204427719116, + "min_cosine_similarity": 0.9537458419799805, + "mean_relative_l2": 0.15510664880275726, + "max_abs_delta": 2.5625 + }, + "system_period": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9860380291938782, + "min_cosine_similarity": 0.9500013589859009, + "mean_relative_l2": 0.1593114584684372, + "max_abs_delta": 2.4375 + }, + "bos_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9922894239425659, + "min_cosine_similarity": 0.9693018198013306, + "mean_relative_l2": 0.11912427842617035, + "max_abs_delta": 1.25 + }, + "bos_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9902918934822083, + "min_cosine_similarity": 0.9625864028930664, + "mean_relative_l2": 0.1341562122106552, + "max_abs_delta": 1.875 + }, + "x_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9907318949699402, + "min_cosine_similarity": 0.9681297540664673, + "mean_relative_l2": 0.1315622180700302, + "max_abs_delta": 1.875 + }, + "x_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9840769171714783, + "min_cosine_similarity": 0.9438816905021667, + "mean_relative_l2": 0.17075064778327942, + "max_abs_delta": 2.125 + }, + "period_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9911770224571228, + "min_cosine_similarity": 0.9750142097473145, + "mean_relative_l2": 0.12822824716567993, + "max_abs_delta": 1.875 + }, + "period_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9838196039199829, + "min_cosine_similarity": 0.9372920989990234, + "mean_relative_l2": 0.17292051017284393, + "max_abs_delta": 2.75 + } + } + }, + "layer_17": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2759c81595cd97a2de055975183d1bb6184c7e404644e32dc49bc274089d99ff", + "mean": -0.01575958915054798, + "std": 0.9915484189987183, + "rms": 0.9916736483573914, + "max_abs": 31.0 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "961f491f90fbeffe6520560a75e84cbdc57de842a35bfd1e851d3f3ff229b7b7", + "mean": -0.024228664115071297, + "std": 6.937838554382324, + "rms": 6.937880992889404, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bae1a5847ba7e6617787b18f74ad693d1296624f87590957267f795a705848fb", + "mean": -0.016172105446457863, + "std": 0.9922819137573242, + "rms": 0.9924136996269226, + "max_abs": 30.5 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3bd3fb8879ab67a17cf629e8801fe5a3464eef07b7adb53cc353bf7d72779d8d", + "mean": -0.025231439620256424, + "std": 6.764952182769775, + "rms": 6.764998912811279, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "16f256809f3e16249d935f311a0bae5b7b7e9a19382482993d5598c58a6e042a", + "mean": -0.015427665784955025, + "std": 0.9977209568023682, + "rms": 0.9978402256965637, + "max_abs": 31.75 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3678cc7b0468acc1ed09a690a1cd460621fad3c9400a5f7605564a01cea411f7", + "mean": -0.015468902885913849, + "std": 6.09515380859375, + "rms": 6.095173358917236, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "596794a4abff816b7043f75ddf56fc09e3ce5547bd5427fc0ef866807fb9a18b", + "mean": -0.01513487659394741, + "std": 0.996783435344696, + "rms": 0.996898353099823, + "max_abs": 31.75 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b8f5539b16826f4937dbf8b78a32dec751f1e4aa804ea7dbe354f074247a0d4b", + "mean": -0.015803802758455276, + "std": 5.771748065948486, + "rms": 5.771770000457764, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0a810cf88c072359f783c3d493689fcc4cc5644e23aff13eb2e93d9370a872d7", + "mean": -0.015368625521659851, + "std": 0.9941262006759644, + "rms": 0.9942449927330017, + "max_abs": 32.0 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "44c81873969f6318dd42e2adc3b324a6cf6951ab912854c56b984c113147dc93", + "mean": -0.015694404020905495, + "std": 6.094983100891113, + "rms": 6.095003128051758, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9b09ecf5f6735201827758c4991d3e301f5e2f727089299c5e482be3c6f6d766", + "mean": -0.01650046929717064, + "std": 0.9907698631286621, + "rms": 0.9909071922302246, + "max_abs": 32.0 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1c5e2bd6fef48e483c6f2ae64fd1b2a2df396999086a44c89c5b0afb47389896", + "mean": -0.0168377123773098, + "std": 5.771087646484375, + "rms": 5.771111488342285, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d8e6ff7feabb2181bbfc9db69bc475b60e8bf9ad31e7ff8e8f4ec544de99267c", + "mean": -0.015629921108484268, + "std": 0.9921820759773254, + "rms": 0.9923051595687866, + "max_abs": 31.625 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "124201bab7cdaf4fa76ca844c23645cb82c262595a3a6417e6fad50d35a50aaf", + "mean": -0.015602398663759232, + "std": 6.094485759735107, + "rms": 6.094505786895752, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "61e9b1fa3c612f54a15fd1f4a804a8490d6a07836253c4545b801f95a31abb92", + "mean": -0.01659388840198517, + "std": 0.989604115486145, + "rms": 0.9897432327270508, + "max_abs": 31.75 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "dea1b97863c156a70c144461c7ac45627b3c5579b62754ab1a1cab4cce70b885", + "mean": -0.016620444133877754, + "std": 5.770886421203613, + "rms": 5.770909786224365, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9967402815818787, + "min_cosine_similarity": 0.980531632900238, + "mean_relative_l2": 0.075264111161232, + "max_abs_delta": 1.125 + }, + "system_bos": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9938520789146423, + "min_cosine_similarity": 0.9703764319419861, + "mean_relative_l2": 0.10473588109016418, + "max_abs_delta": 2.4375 + }, + "system_x": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9876254796981812, + "min_cosine_similarity": 0.9554654359817505, + "mean_relative_l2": 0.14961731433868408, + "max_abs_delta": 2.625 + }, + "system_period": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9870441555976868, + "min_cosine_similarity": 0.9446736574172974, + "mean_relative_l2": 0.15321564674377441, + "max_abs_delta": 2.9375 + }, + "bos_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9928451180458069, + "min_cosine_similarity": 0.9637051224708557, + "mean_relative_l2": 0.11463769525289536, + "max_abs_delta": 1.25 + }, + "bos_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9908984303474426, + "min_cosine_similarity": 0.9586648344993591, + "mean_relative_l2": 0.12979596853256226, + "max_abs_delta": 2.125 + }, + "x_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9912985563278198, + "min_cosine_similarity": 0.9590681791305542, + "mean_relative_l2": 0.1270831972360611, + "max_abs_delta": 2.625 + }, + "x_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9849752187728882, + "min_cosine_similarity": 0.9380594491958618, + "mean_relative_l2": 0.16565687954425812, + "max_abs_delta": 2.5 + }, + "period_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9918233752250671, + "min_cosine_similarity": 0.9667336344718933, + "mean_relative_l2": 0.12313149869441986, + "max_abs_delta": 1.9375 + }, + "period_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9849222898483276, + "min_cosine_similarity": 0.928604245185852, + "mean_relative_l2": 0.166459321975708, + "max_abs_delta": 3.0 + } + } + }, + "layer_18": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3e3c0434463f21ad56dfba59bc6d0c843112f215b0b38bc043c002b8e809c2e3", + "mean": -0.017454968765378, + "std": 1.109922170639038, + "rms": 1.110059380531311, + "max_abs": 33.0 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ea3831f0aa60aca61e81da8a310d1145ad603e078e3076216a862216a2bd9581", + "mean": -0.025540418922901154, + "std": 6.960414409637451, + "rms": 6.960461139678955, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7fdf14cab99467af81ebe552aff04d9e6b62e13125aadcfd90f3d0e7ad0d8fc1", + "mean": -0.01814289391040802, + "std": 1.1102652549743652, + "rms": 1.1104135513305664, + "max_abs": 33.0 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e0bf17b5f5af37f590bf6a0ab66b74e6984c7694b358a6ef388c026c85164711", + "mean": -0.02646399848163128, + "std": 6.787914752960205, + "rms": 6.787966728210449, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "62d6c8ba158b8ea4cb458a969360a00738d1ab78d9e323426c80b1f1ed29d12c", + "mean": -0.017329925671219826, + "std": 1.1157066822052002, + "rms": 1.115841269493103, + "max_abs": 33.5 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "03d4ecfa5d441deaf863037e7f528b204e0f05370d89c6374ea03a82fd5b0b7e", + "mean": -0.016910361126065254, + "std": 6.118509292602539, + "rms": 6.118532657623291, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e123171219386b056a72f33f443666af31d52d740779b00d0105afab5bafa97c", + "mean": -0.016961131244897842, + "std": 1.114111304283142, + "rms": 1.1142404079437256, + "max_abs": 33.5 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d48b6bd96ccc16fe2348c5d29f1b01b29a6228a7f5bc020f69b8ba3259fdb5e1", + "mean": -0.016866007819771767, + "std": 5.796339511871338, + "rms": 5.796364784240723, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5f555fad4fcc379f9f1710639d088271b9628a7f7db399ef2ea1d60ece0327b8", + "mean": -0.017085831612348557, + "std": 1.1112498044967651, + "rms": 1.11138117313385, + "max_abs": 33.75 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0672bbcce31b98240f5ec43b8daa68773b510072ddf1da44d73828fc69b0cf75", + "mean": -0.01703629270195961, + "std": 6.118136405944824, + "rms": 6.118160724639893, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "da61449e8af42ef16eccd056b5e24ea19951a19e0cba679edc021f127f8fd451", + "mean": -0.01838141493499279, + "std": 1.1067662239074707, + "rms": 1.1069188117980957, + "max_abs": 33.5 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cea5f51ede58840e4ff1c6bd990ee471556c9e9164411fb15413c76e3eb17636", + "mean": -0.017970437183976173, + "std": 5.795490741729736, + "rms": 5.7955193519592285, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ca8b5cd5ce67d78db96399a33688ecb51d9e29945be7324fc71ea81aa383c367", + "mean": -0.0174399483948946, + "std": 1.1096875667572021, + "rms": 1.109824538230896, + "max_abs": 33.25 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "89ee6382e724acf81c5da14b37000aae7b2fec177314690a80f34b9e3a326a0f", + "mean": -0.017006555572152138, + "std": 6.117672920227051, + "rms": 6.117696285247803, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "36e2866acb6f327c3c78f630db7dbfe882606b447edb5588ae9669d29737569e", + "mean": -0.01852489821612835, + "std": 1.104721188545227, + "rms": 1.1048765182495117, + "max_abs": 33.75 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7854bd6b13fc674168ac803d9d963ac6fb65a99b20675dc081b7dc8539302b9a", + "mean": -0.01784634031355381, + "std": 5.7950825691223145, + "rms": 5.79511022567749, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9967058300971985, + "min_cosine_similarity": 0.97922283411026, + "mean_relative_l2": 0.07589522004127502, + "max_abs_delta": 1.4375 + }, + "system_bos": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9938108921051025, + "min_cosine_similarity": 0.9654548168182373, + "mean_relative_l2": 0.1048687994480133, + "max_abs_delta": 3.0 + }, + "system_x": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9875888228416443, + "min_cosine_similarity": 0.9541311860084534, + "mean_relative_l2": 0.15029999613761902, + "max_abs_delta": 3.375 + }, + "system_period": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9868279099464417, + "min_cosine_similarity": 0.9373139142990112, + "mean_relative_l2": 0.1545809507369995, + "max_abs_delta": 3.5 + }, + "bos_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9929950833320618, + "min_cosine_similarity": 0.9620134234428406, + "mean_relative_l2": 0.11334570497274399, + "max_abs_delta": 1.75 + }, + "bos_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9909623861312866, + "min_cosine_similarity": 0.9540720582008362, + "mean_relative_l2": 0.12912067770957947, + "max_abs_delta": 3.1875 + }, + "x_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9914416670799255, + "min_cosine_similarity": 0.958753228187561, + "mean_relative_l2": 0.12582646310329437, + "max_abs_delta": 3.25 + }, + "x_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9849521517753601, + "min_cosine_similarity": 0.932593584060669, + "mean_relative_l2": 0.16570121049880981, + "max_abs_delta": 3.0 + }, + "period_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9919962882995605, + "min_cosine_similarity": 0.9678667187690735, + "mean_relative_l2": 0.12193173170089722, + "max_abs_delta": 2.0 + }, + "period_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9847778677940369, + "min_cosine_similarity": 0.9169935584068298, + "mean_relative_l2": 0.16704003512859344, + "max_abs_delta": 3.5 + } + } + }, + "layer_19": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c33112891dee5db9936e518eb60cca826d290a59606ff2d0619c012679663b2d", + "mean": -0.01964775286614895, + "std": 1.2651469707489014, + "rms": 1.2652994394302368, + "max_abs": 34.25 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "802acb4424eee96a1e2732938f07fee99879ae8da5150c4368c790d072d9dd57", + "mean": -0.02693236991763115, + "std": 6.982442855834961, + "rms": 6.982495307922363, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b93f190bf00f5366402bdbda04439e299c4d397a8f3f8462389d99fe795fce7c", + "mean": -0.020356766879558563, + "std": 1.2655278444290161, + "rms": 1.2656916379928589, + "max_abs": 34.5 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f20f5eab87ebec8c5098bbfe0e1396b64e8ab03910cfb09301f60a6e87e7da9e", + "mean": -0.027339866384863853, + "std": 6.810430526733398, + "rms": 6.81048583984375, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3ce64ba0027fc217f9bc305c37161ad5f13a656c6bcd3f7ec693e29ffb28bb7c", + "mean": -0.019220001995563507, + "std": 1.2712427377700806, + "rms": 1.2713879346847534, + "max_abs": 34.75 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1ed337872c96934f277e6ea672b3151ed3fcf51e638966dcdba350b9cb7010a0", + "mean": -0.018184097483754158, + "std": 6.144125938415527, + "rms": 6.144152641296387, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "889325d6495b0a12787840b011be3a0fd497af86e9660da8fc568dc6a3ec7f1b", + "mean": -0.018695008009672165, + "std": 1.2704991102218628, + "rms": 1.2706365585327148, + "max_abs": 35.25 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ddadbeb5eb8cfb209893a7fd7f6e842ed4af4d660428f8d4979d74c22b393366", + "mean": -0.01740601472556591, + "std": 5.8229169845581055, + "rms": 5.822943210601807, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "afb3965981e2764ec1abc2aed8f2e7644abf0ab98f42a1fd0202939fbaa856e1", + "mean": -0.018799209967255592, + "std": 1.267333745956421, + "rms": 1.2674731016159058, + "max_abs": 33.5 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7a6b056811f701223f845963c83368f33549591edf3acb4b774309369a46b457", + "mean": -0.018137773498892784, + "std": 6.143889427185059, + "rms": 6.14391565322876, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b622f5b91118e38648d945d8c79458f8143ec53a95edd05350092c123459ff07", + "mean": -0.01917024701833725, + "std": 1.2639389038085938, + "rms": 1.2640843391418457, + "max_abs": 34.75 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4c56284e99339a8d6c6ab483d228bd222aaac05011a316a872be6a3802b880b7", + "mean": -0.01780497096478939, + "std": 5.822002410888672, + "rms": 5.8220295906066895, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e2eeacb5e09626defdd37b1993bd863db0432f19873802ef8d7e380fd1813a07", + "mean": -0.019252851605415344, + "std": 1.265727162361145, + "rms": 1.265873670578003, + "max_abs": 34.0 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e72ca1d6e12c825ede08fd7556a15438eeef68a932be34f79791df1e28ea83e4", + "mean": -0.018311534076929092, + "std": 6.1432576179504395, + "rms": 6.143284797668457, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e1ef31c10a0295462dda834853aed5293539c6e71beaa1a37ad94c5e65ad9928", + "mean": -0.019415734335780144, + "std": 1.260269045829773, + "rms": 1.2604185342788696, + "max_abs": 35.25 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a5dc7ed0ca2fcec78615541c2f5eb96c2be74c591ac165a4939ab0392c7bfc67", + "mean": -0.017930347472429276, + "std": 5.821345329284668, + "rms": 5.821372985839844, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9965598583221436, + "min_cosine_similarity": 0.9768079519271851, + "mean_relative_l2": 0.07722535729408264, + "max_abs_delta": 1.5 + }, + "system_bos": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.993600070476532, + "min_cosine_similarity": 0.9567068219184875, + "mean_relative_l2": 0.10613559931516647, + "max_abs_delta": 2.75 + }, + "system_x": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9874021410942078, + "min_cosine_similarity": 0.9421955347061157, + "mean_relative_l2": 0.15111297369003296, + "max_abs_delta": 3.125 + }, + "system_period": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9868850111961365, + "min_cosine_similarity": 0.9436914324760437, + "mean_relative_l2": 0.15414276719093323, + "max_abs_delta": 3.375 + }, + "bos_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9920409917831421, + "min_cosine_similarity": 0.8967671990394592, + "mean_relative_l2": 0.11705456674098969, + "max_abs_delta": 2.06640625 + }, + "bos_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9906220436096191, + "min_cosine_similarity": 0.9111320972442627, + "mean_relative_l2": 0.1299925148487091, + "max_abs_delta": 2.875 + }, + "x_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9908041954040527, + "min_cosine_similarity": 0.9096177816390991, + "mean_relative_l2": 0.1278671771287918, + "max_abs_delta": 3.125 + }, + "x_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9840444326400757, + "min_cosine_similarity": 0.8821195363998413, + "mean_relative_l2": 0.16880297660827637, + "max_abs_delta": 3.0625 + }, + "period_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9916431307792664, + "min_cosine_similarity": 0.9350706934928894, + "mean_relative_l2": 0.12314600497484207, + "max_abs_delta": 2.125 + }, + "period_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9845706820487976, + "min_cosine_similarity": 0.9110816717147827, + "mean_relative_l2": 0.1671755313873291, + "max_abs_delta": 3.4375 + } + } + }, + "layer_20": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e352e8e7d825d7314b21d0e2a44acb50216a175d9317eb337bdeecc95a910315", + "mean": -0.020985499024391174, + "std": 1.4328689575195312, + "rms": 1.4330226182937622, + "max_abs": 39.0 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5fd1d5a931f484a2c8dec07abbc946154502af0e65b48f8b0fcabfee942df1dd", + "mean": -0.02804986573755741, + "std": 7.220231533050537, + "rms": 7.220285415649414, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0655def8479ebeca539c2a39cf0a3d83fdd1338be7021aead3b17b45445c52c2", + "mean": -0.021776877343654633, + "std": 1.434328556060791, + "rms": 1.434493899345398, + "max_abs": 39.5 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5763be525d75312c039f4f62b1f49aa86a4c70a18f8a063d75f416031cc431bc", + "mean": -0.028388533741235733, + "std": 7.050578594207764, + "rms": 7.050635814666748, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "387fc9dae98a3275a04488cd8e5db0270c702e66207150a35ca06eb8b15626f8", + "mean": -0.020092546939849854, + "std": 1.4392282962799072, + "rms": 1.4393686056137085, + "max_abs": 39.0 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7f7ca79c3412563a4b46aba9bf7b9a488b9153be04893ab0cfdb9b6d8adbbb25", + "mean": -0.01929420419037342, + "std": 6.179800987243652, + "rms": 6.179831027984619, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d30c1f095a2247b4cf3edcfb70567b81df542c7a1c6fcbfcd1762d69fd643e14", + "mean": -0.019994117319583893, + "std": 1.4401345252990723, + "rms": 1.4402732849121094, + "max_abs": 39.0 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4c3b23f82c97c1649db7eec9604de23515e9ea1a42c5fdbd1652b8fedc29864a", + "mean": -0.01865246705710888, + "std": 5.8606672286987305, + "rms": 5.860696792602539, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2e30028a296c74148b195b0303cb7de30d899ff8fecab80c069c5a87b35731ee", + "mean": -0.01970151625573635, + "std": 1.4350277185440063, + "rms": 1.435162901878357, + "max_abs": 39.0 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "740e30f726092f87f083941fea67d8d4cf36be562a0a9774e7587c6c66c7808c", + "mean": -0.019283419474959373, + "std": 6.179568767547607, + "rms": 6.179598808288574, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cb87bd3bef6b2c82eb7ea247e25baf33f2f6635542ff733dff9863c2be4c6629", + "mean": -0.02039310522377491, + "std": 1.433814287185669, + "rms": 1.4339593648910522, + "max_abs": 39.5 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b3a25eef37e61c88edf868759a3d4115f64d47a1d3576c53be7269e325dc78b1", + "mean": -0.01906578242778778, + "std": 5.859890460968018, + "rms": 5.859921455383301, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5586fcc0b801cbebf8e72224710f2a8de40f6d136f583ae143f59b2e7fd6136b", + "mean": -0.020236652344465256, + "std": 1.4329090118408203, + "rms": 1.4330519437789917, + "max_abs": 39.0 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "217a239b5219d361217fefd61d09dc724ea99c20074fc829eba29c6e7134ecae", + "mean": -0.019447363913059235, + "std": 6.178759574890137, + "rms": 6.178790092468262, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b8691b1cb5da13a3ca8c36ad49ca97375f381285d118f24011cfed2e6a965afb", + "mean": -0.0215887650847435, + "std": 1.430235505104065, + "rms": 1.4303983449935913, + "max_abs": 39.25 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8d09d8de1d152ddad4fd31bc8485c9a3a731fa3cab0323b1a19c9fc6f42bf99e", + "mean": -0.019890565425157547, + "std": 5.859067440032959, + "rms": 5.85910177230835, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9965575337409973, + "min_cosine_similarity": 0.9778860807418823, + "mean_relative_l2": 0.07789141684770584, + "max_abs_delta": 1.875 + }, + "system_bos": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9937185645103455, + "min_cosine_similarity": 0.9604488015174866, + "mean_relative_l2": 0.1054714247584343, + "max_abs_delta": 2.8125 + }, + "system_x": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9871711134910583, + "min_cosine_similarity": 0.9409354329109192, + "mean_relative_l2": 0.1527373343706131, + "max_abs_delta": 3.4375 + }, + "system_period": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9863001108169556, + "min_cosine_similarity": 0.941483199596405, + "mean_relative_l2": 0.15783260762691498, + "max_abs_delta": 3.3125 + }, + "bos_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9922077655792236, + "min_cosine_similarity": 0.9011150598526001, + "mean_relative_l2": 0.1157752126455307, + "max_abs_delta": 3.0 + }, + "bos_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9908453822135925, + "min_cosine_similarity": 0.9118919968605042, + "mean_relative_l2": 0.12837736308574677, + "max_abs_delta": 3.875 + }, + "x_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9910663366317749, + "min_cosine_similarity": 0.9136289358139038, + "mean_relative_l2": 0.12582169473171234, + "max_abs_delta": 3.125 + }, + "x_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9839425086975098, + "min_cosine_similarity": 0.880715548992157, + "mean_relative_l2": 0.1691112220287323, + "max_abs_delta": 4.375 + }, + "period_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.991897463798523, + "min_cosine_similarity": 0.9391651153564453, + "mean_relative_l2": 0.12132816016674042, + "max_abs_delta": 2.25 + }, + "period_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9842372536659241, + "min_cosine_similarity": 0.9071357846260071, + "mean_relative_l2": 0.1689172387123108, + "max_abs_delta": 4.5 + } + } + }, + "layer_21": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9c50ba90870180deb315646630e79679d994af77c4c2ffafec3d9586f542ec02", + "mean": -0.019701967015862465, + "std": 1.5594888925552368, + "rms": 1.5596133470535278, + "max_abs": 52.75 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "797123d686560789d77939ad3cf44965b6759a89f75d8efe93a9711c641fe3c6", + "mean": -0.026378119364380836, + "std": 7.309744834899902, + "rms": 7.3097920417785645, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d464a4ee8a6fd0301f09249dd005130cf55dd7472fbaefe82232c21cf1c911f1", + "mean": -0.02055787667632103, + "std": 1.5622005462646484, + "rms": 1.5623358488082886, + "max_abs": 52.25 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "15cd012884833720e104f256c10f80918d25898c0ca6eb9e6ac6f2bfaeae0adc", + "mean": -0.02669024094939232, + "std": 7.135456562042236, + "rms": 7.135506629943848, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ec3e9bddec8d3d75e76d370a73ee7e7a86ba0f881cd1015b5a4e8aed7b1e7a84", + "mean": -0.018928958103060722, + "std": 1.5680365562438965, + "rms": 1.5681507587432861, + "max_abs": 53.5 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "588dbe56a1cf7135ed60b93320f5721eb126e05b96fb0575a2acc914de2f494d", + "mean": -0.01768864132463932, + "std": 6.1951799392700195, + "rms": 6.195205211639404, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "57cc93af1e788949a871e8963abec0143c2eba893ea3b6efb535f747d9b42543", + "mean": -0.01894203945994377, + "std": 1.567179799079895, + "rms": 1.5672942399978638, + "max_abs": 53.5 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b3baffcd2360e98765f79e4f87e8bcb5929f2465705b882316346d3f2b736f8a", + "mean": -0.01693946309387684, + "std": 5.880422592163086, + "rms": 5.880446910858154, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b0b2ebac7c815a0a8336100cf0a678a88713780700a07897311471f9ed53bcef", + "mean": -0.01831328496336937, + "std": 1.5654451847076416, + "rms": 1.5655522346496582, + "max_abs": 51.0 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "07ac09f4689d7aa8472586be9150f92bf002e8f207181c74d9ad24a56cad3b19", + "mean": -0.01742786355316639, + "std": 6.195614337921143, + "rms": 6.195638656616211, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8cba98c74f1f64b5196ddfbaf774c9af01b263d14859a0ef6df0101d41b59753", + "mean": -0.019822057336568832, + "std": 1.564339518547058, + "rms": 1.564465045928955, + "max_abs": 48.5 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "36cd0809d7bbff810df73cd3b3eea5d0b4a4f5c31737f2919ee8b5998ead18d8", + "mean": -0.018003854900598526, + "std": 5.880865573883057, + "rms": 5.880893230438232, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "288457e720f0edfc730c3ff8d5cabc8faafe625c51fad4664c75815306cf5ce8", + "mean": -0.019244655966758728, + "std": 1.5631389617919922, + "rms": 1.5632574558258057, + "max_abs": 51.0 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7eb4e8deef9962a48700e85ed7d2f275a2d8dabcc413cbc8e8740708ca7ba997", + "mean": -0.017970312386751175, + "std": 6.1943511962890625, + "rms": 6.1943769454956055, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b9aa139320a98312d0eb1288e31127a1463739ea6318fde741e3cbe896f95a59", + "mean": -0.020821724086999893, + "std": 1.5604044198989868, + "rms": 1.5605432987213135, + "max_abs": 48.0 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "33c9c3d67dc3b5da9cfa756a68160baca37c941855e31df047ebe5f32e249f04", + "mean": -0.018608005717396736, + "std": 5.879360675811768, + "rms": 5.879389762878418, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.996186375617981, + "min_cosine_similarity": 0.9795420169830322, + "mean_relative_l2": 0.08246654272079468, + "max_abs_delta": 1.75 + }, + "system_bos": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9932109117507935, + "min_cosine_similarity": 0.9614323377609253, + "mean_relative_l2": 0.10990652441978455, + "max_abs_delta": 2.75 + }, + "system_x": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9859945178031921, + "min_cosine_similarity": 0.9397321939468384, + "mean_relative_l2": 0.16007840633392334, + "max_abs_delta": 3.75 + }, + "system_period": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9846076369285583, + "min_cosine_similarity": 0.9338674545288086, + "mean_relative_l2": 0.16751202940940857, + "max_abs_delta": 3.25 + }, + "bos_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9916022419929504, + "min_cosine_similarity": 0.8851878643035889, + "mean_relative_l2": 0.12002845108509064, + "max_abs_delta": 3.25 + }, + "bos_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9901674389839172, + "min_cosine_similarity": 0.8987550735473633, + "mean_relative_l2": 0.13307879865169525, + "max_abs_delta": 3.375 + }, + "x_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9903320074081421, + "min_cosine_similarity": 0.9013464450836182, + "mean_relative_l2": 0.13103912770748138, + "max_abs_delta": 2.875 + }, + "x_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9823949337005615, + "min_cosine_similarity": 0.8649215698242188, + "mean_relative_l2": 0.17758488655090332, + "max_abs_delta": 4.5 + }, + "period_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9912014007568359, + "min_cosine_similarity": 0.9273707866668701, + "mean_relative_l2": 0.12632286548614502, + "max_abs_delta": 2.75 + }, + "period_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9825854301452637, + "min_cosine_similarity": 0.8994073867797852, + "mean_relative_l2": 0.17814919352531433, + "max_abs_delta": 4.25 + } + } + }, + "layer_22": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "eb35ba3086ecfa41b32aac2a02d906558b3709aafccc6a50aa855c716a71fe5a", + "mean": -0.02802419103682041, + "std": 1.8098907470703125, + "rms": 1.810107707977295, + "max_abs": 70.0 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "303fbd92624b6b9fba1691260c7fc43e2064a301cb4dd188e4de600f728a32d2", + "mean": -0.033454395830631256, + "std": 7.361957550048828, + "rms": 7.362033843994141, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c2e58e82a6919d2728bc880b0d23e4d21d1d06225b58f121d4bfd954fc1b4a18", + "mean": -0.028435928747057915, + "std": 1.8139822483062744, + "rms": 1.8142051696777344, + "max_abs": 69.0 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "22f6c84e9a6004157ae31555264cd28d5eb0b4802cf76df352b86298f8c752ed", + "mean": -0.032900549471378326, + "std": 7.191290855407715, + "rms": 7.191366195678711, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "08de9a6fd2d8fc0e63947864e9381e55978a6e6864867559efac80ff1461e2b9", + "mean": -0.027663137763738632, + "std": 1.8197054862976074, + "rms": 1.819915771484375, + "max_abs": 71.0 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4d8045aed5d66606909e70759be9df183765e146738eb4a4bcc493d5787ba4eb", + "mean": -0.025178877636790276, + "std": 6.257797718048096, + "rms": 6.257848262786865, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3ed7ae0a191a04bcf37979d44dcabad761df59eda074e301ab5cebae727c44f5", + "mean": -0.02710416167974472, + "std": 1.8182072639465332, + "rms": 1.8184092044830322, + "max_abs": 70.5 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "972189b6e2a4b42a37cb65128325fbcfb5cadb6262c6b6b3faf4b3f9c6c90e7d", + "mean": -0.023336201906204224, + "std": 5.948661804199219, + "rms": 5.948707580566406, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2d49a7eb1ada6672ca1ee33de08eebe3cc20ac799372ef89676521214c00ede4", + "mean": -0.026558592915534973, + "std": 1.8141261339187622, + "rms": 1.81432044506073, + "max_abs": 68.0 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "603ef6bef9e142ccf0d0680e68d10a00497c6dc08f118892f4419dffa2c0f0be", + "mean": -0.02436046674847603, + "std": 6.257664203643799, + "rms": 6.257711887359619, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e08a59b1022e9b96fec44bbed402abd05a6b437c502815804dec5aabdbda0fd3", + "mean": -0.027848834171891212, + "std": 1.8161499500274658, + "rms": 1.8163634538650513, + "max_abs": 64.5 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e9ea75bbc7e352082bb3713a4ec261a0588f4930d558f2e30d1986db302f2423", + "mean": -0.024111559614539146, + "std": 5.949745178222656, + "rms": 5.949793338775635, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "28f5546249b05f66bad3d9fd66ea3cf79abf954d8376e11203537ee8a9cb2154", + "mean": -0.027552595362067223, + "std": 1.8107985258102417, + "rms": 1.8110082149505615, + "max_abs": 68.0 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "14d1d7167e37c55caa2fad96cde13c9b6b27fd535d1dc6e1459039b724235a3e", + "mean": -0.025095771998167038, + "std": 6.255931377410889, + "rms": 6.2559814453125, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d93f6c749cc10dde71e94d23ec92b65ce533747f3600d77f7765d5b76b3aa501", + "mean": -0.028978174552321434, + "std": 1.8104026317596436, + "rms": 1.8106346130371094, + "max_abs": 64.0 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f86e98e076995f2c197c833fa8f42cbda7fa7804b2110c4f385fcba9390274f0", + "mean": -0.024818535894155502, + "std": 5.947561264038086, + "rms": 5.947612762451172, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9961153268814087, + "min_cosine_similarity": 0.9792107939720154, + "mean_relative_l2": 0.08325718343257904, + "max_abs_delta": 2.0625 + }, + "system_bos": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9930847883224487, + "min_cosine_similarity": 0.9666670560836792, + "mean_relative_l2": 0.1108260303735733, + "max_abs_delta": 3.25 + }, + "system_x": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9859416484832764, + "min_cosine_similarity": 0.9463651180267334, + "mean_relative_l2": 0.16049824655056, + "max_abs_delta": 5.25 + }, + "system_period": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9844979047775269, + "min_cosine_similarity": 0.9338734149932861, + "mean_relative_l2": 0.16824458539485931, + "max_abs_delta": 4.5 + }, + "bos_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9914088249206543, + "min_cosine_similarity": 0.8882110714912415, + "mean_relative_l2": 0.12104206532239914, + "max_abs_delta": 4.5 + }, + "bos_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9900698661804199, + "min_cosine_similarity": 0.9019773602485657, + "mean_relative_l2": 0.13360022008419037, + "max_abs_delta": 5.25 + }, + "x_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9901754856109619, + "min_cosine_similarity": 0.9024501442909241, + "mean_relative_l2": 0.13156838715076447, + "max_abs_delta": 3.5 + }, + "x_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9823263883590698, + "min_cosine_similarity": 0.8649990558624268, + "mean_relative_l2": 0.17790468037128448, + "max_abs_delta": 6.25 + }, + "period_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9911506175994873, + "min_cosine_similarity": 0.9270023107528687, + "mean_relative_l2": 0.12612448632717133, + "max_abs_delta": 4.25 + }, + "period_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9826027750968933, + "min_cosine_similarity": 0.90034019947052, + "mean_relative_l2": 0.1783154308795929, + "max_abs_delta": 6.0 + } + } + }, + "layer_23": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "00be9576cb42901175d14e1bed7ac507cddf2d22587a83c77e65edc34a43af85", + "mean": -0.035699427127838135, + "std": 2.1930501461029053, + "rms": 2.193340539932251, + "max_abs": 90.0 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "037d288e65e06b6378009d99eefbfb98629886c75ecfca179a0981a4f68150e9", + "mean": -0.039802324026823044, + "std": 7.430131435394287, + "rms": 7.430237770080566, + "max_abs": 1160.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "37c2d6e123324bab0d605e6dcd92fed9c0e332680157e10e0d5540a5e30d945a", + "mean": -0.036287613213062286, + "std": 2.2042882442474365, + "rms": 2.2045867443084717, + "max_abs": 89.0 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "30f663892f41e76629d5defd6b06b63c63ae9eb0bf9509a6f4594bbb217d82bc", + "mean": -0.03785325586795807, + "std": 7.265896320343018, + "rms": 7.265994548797607, + "max_abs": 1160.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2da38a5869a683de73e9b374f550932fe1047423ad6846f9c3e65a69d6d05aeb", + "mean": -0.03588642179965973, + "std": 2.2061843872070312, + "rms": 2.2064762115478516, + "max_abs": 91.0 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9dbb3c8292aaacb8c71614c2a38c48e5f01e24a036712f1504805b145f46c880", + "mean": -0.0319436639547348, + "std": 6.348278999328613, + "rms": 6.348359107971191, + "max_abs": 1160.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "021d57def2363a5eaf9da0dd9a1bc206fd61a5529d9edb357e9d872c3275e03a", + "mean": -0.034877050668001175, + "std": 2.2022173404693604, + "rms": 2.20249342918396, + "max_abs": 90.0 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "181d1e0307095dd64404d34a9fa9fac6c868d8fd4218bddec8c290bd5ad4a14f", + "mean": -0.028152698650956154, + "std": 6.048316478729248, + "rms": 6.04838228225708, + "max_abs": 1160.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0228e018c6c8b9fcacb5f6e2a6aba19440a02b8df530f0eb51c6fc19a8d267d7", + "mean": -0.034013163298368454, + "std": 2.1944844722747803, + "rms": 2.1947481632232666, + "max_abs": 87.0 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e2cdbc95dfd4cc2f448498c900b525e934ed27c9dc6f62645e56de1995c90536", + "mean": -0.03038511425256729, + "std": 6.347356796264648, + "rms": 6.347429275512695, + "max_abs": 1160.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9014998bd00f4d0218fdbf08e11d3c73463d2f9ca91ef22b9525161d946d55d1", + "mean": -0.035458870232105255, + "std": 2.2049334049224854, + "rms": 2.20521879196167, + "max_abs": 87.0 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bb338c7b5601fc1b97217de0c24c1ea59d4d484d3f79a27572b6e9c61a5a4cbd", + "mean": -0.029017813503742218, + "std": 6.0522918701171875, + "rms": 6.052361488342285, + "max_abs": 1160.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2444922c565201d6346a0737f4fc732fb138922805128236bf09481be4e1e387", + "mean": -0.03532535582780838, + "std": 2.1881930828094482, + "rms": 2.1884782314300537, + "max_abs": 87.0 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a40be97ea2600c8337fc52819e3f659991622c28c8bf8304d5c7bc7a30854b6d", + "mean": -0.03160236030817032, + "std": 6.343695640563965, + "rms": 6.343774318695068, + "max_abs": 1160.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b62b33c79a74ea4771f25d1acb08c214f53e6e323541909371ced8fe35a986d6", + "mean": -0.03690863028168678, + "std": 2.198089599609375, + "rms": 2.198399305343628, + "max_abs": 87.0 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "dc40bab2164af0fb7588151707d606d1dfb909d73d94027bfeaa38f10ded73a0", + "mean": -0.030113911256194115, + "std": 6.048816204071045, + "rms": 6.048891067504883, + "max_abs": 1160.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.996443510055542, + "min_cosine_similarity": 0.9779228568077087, + "mean_relative_l2": 0.07981536537408829, + "max_abs_delta": 3.25 + }, + "system_bos": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9916804432868958, + "min_cosine_similarity": 0.7494205236434937, + "mean_relative_l2": 0.10960721224546432, + "max_abs_delta": 7.94140625 + }, + "system_x": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9872086048126221, + "min_cosine_similarity": 0.9381478428840637, + "mean_relative_l2": 0.1528700441122055, + "max_abs_delta": 7.5 + }, + "system_period": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9859322905540466, + "min_cosine_similarity": 0.9146924018859863, + "mean_relative_l2": 0.16019432246685028, + "max_abs_delta": 6.0 + }, + "bos_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9890386462211609, + "min_cosine_similarity": 0.5948775410652161, + "mean_relative_l2": 0.12327371537685394, + "max_abs_delta": 9.8125 + }, + "bos_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9910528063774109, + "min_cosine_similarity": 0.9163330793380737, + "mean_relative_l2": 0.1263757199048996, + "max_abs_delta": 7.5 + }, + "x_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9911704659461975, + "min_cosine_similarity": 0.9197101593017578, + "mean_relative_l2": 0.1243780329823494, + "max_abs_delta": 5.0 + }, + "x_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9841524362564087, + "min_cosine_similarity": 0.8893861174583435, + "mean_relative_l2": 0.16820377111434937, + "max_abs_delta": 8.0 + }, + "period_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9921171069145203, + "min_cosine_similarity": 0.939386248588562, + "mean_relative_l2": 0.11889084428548813, + "max_abs_delta": 5.5 + }, + "period_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9843916296958923, + "min_cosine_similarity": 0.9163578748703003, + "mean_relative_l2": 0.16848134994506836, + "max_abs_delta": 8.0 + } + } + }, + "layer_24": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a5cad7808b47bf99801ad7da26e037962726a2d09d43ec29801ebabbf714f2d5", + "mean": -0.047737445682287216, + "std": 4.3528852462768555, + "rms": 4.353146553039551, + "max_abs": 544.0 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "11df0c5af806294c9ddf42ed2987f6f70ebe5299c525c132d1ceebe7579df540", + "mean": -0.05078449100255966, + "std": 7.780366897583008, + "rms": 7.7805328369140625, + "max_abs": 1008.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1e14b9d8022b01e4bcda7348181c7fab62e8123d5558ef05ed209231e9497c0c", + "mean": -0.04791897535324097, + "std": 4.30634880065918, + "rms": 4.306615352630615, + "max_abs": 532.0 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "009082c76435f119495ca46505182c8ec35be9fb799ef1b714a86c0870a8c8f4", + "mean": -0.047168850898742676, + "std": 7.734245300292969, + "rms": 7.734388828277588, + "max_abs": 1120.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fb27874c79cc370d006bec05a3221dda8c60185a5f8bb5720810c6ad76f446a5", + "mean": -0.047552842646837234, + "std": 4.457462310791016, + "rms": 4.45771598815918, + "max_abs": 544.0 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "51e5ece8ea3793c4cc95a55f6b78af5fc93cfd480b32f3790ca32782780b258d", + "mean": -0.04157073423266411, + "std": 5.7931413650512695, + "rms": 5.793290615081787, + "max_abs": 840.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "beb82f9dd94cc9c3789c49a9e46044d23a4304ea5bd4877deda71920804a6eb1", + "mean": -0.045800644904375076, + "std": 4.306339263916016, + "rms": 4.306582927703857, + "max_abs": 532.0 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "db7c604bdfaea714dbec5d9bffcabbe78717d6b5b5ffa021453221f339010f08", + "mean": -0.03603067249059677, + "std": 5.471087455749512, + "rms": 5.471206188201904, + "max_abs": 840.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4ed078cac175a40519cb3d266d8bff0ed0787d7b3cd4eaecbe7db0772bd965dd", + "mean": -0.044987887144088745, + "std": 4.380701065063477, + "rms": 4.380931854248047, + "max_abs": 552.0 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1e4efa13da45b9c1f700869f709a51a4b6a07017c7e7d8b5cdd05fc2321d2b69", + "mean": -0.03958379849791527, + "std": 5.748540878295898, + "rms": 5.7486772537231445, + "max_abs": 840.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f89891215aec5648047ebe30e689741e1d44d7fca7a46ae0213dc82575ed092e", + "mean": -0.04613427445292473, + "std": 4.320428848266602, + "rms": 4.320674896240234, + "max_abs": 536.0 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "38792070e8ae34802f28e853129724fa9db1335f0fbf30c97d91e8b7e6ba0e1b", + "mean": -0.03694961220026016, + "std": 5.4844560623168945, + "rms": 5.484580039978027, + "max_abs": 840.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "249f57a1ffbbb8898c887391b2f01f8b560f21f7d68d87e0c98cb94227f7001a", + "mean": -0.0464622899889946, + "std": 4.3760528564453125, + "rms": 4.376299858093262, + "max_abs": 552.0 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3ed002f9103771f7b39dcb2be23a0058e6f08fa7f408bdf17fe101f400b839cb", + "mean": -0.04077095910906792, + "std": 5.743256092071533, + "rms": 5.743400573730469, + "max_abs": 840.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "517f7d4dd8606cdc7fcc45c74a7eabd6ae6844ca056581f41784bf2948abbe02", + "mean": -0.04738312587141991, + "std": 4.303414821624756, + "rms": 4.303675174713135, + "max_abs": 532.0 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b33b81b82e6a2343dd64223d4e0a4fe848057b5a4dd267512ecee7a1e3d210ec", + "mean": -0.037691108882427216, + "std": 5.472176551818848, + "rms": 5.472306251525879, + "max_abs": 840.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9970229864120483, + "min_cosine_similarity": 0.9832577109336853, + "mean_relative_l2": 0.07280184328556061, + "max_abs_delta": 12.0 + }, + "system_bos": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9879795908927917, + "min_cosine_similarity": 0.2779192626476288, + "mean_relative_l2": 0.126705139875412, + "max_abs_delta": 536.9375 + }, + "system_x": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9877621531486511, + "min_cosine_similarity": 0.7974647879600525, + "mean_relative_l2": 0.14456374943256378, + "max_abs_delta": 20.265625 + }, + "system_period": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9856801629066467, + "min_cosine_similarity": 0.647202730178833, + "mean_relative_l2": 0.15368202328681946, + "max_abs_delta": 31.6015625 + }, + "bos_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9852491617202759, + "min_cosine_similarity": 0.09400931000709534, + "mean_relative_l2": 0.289397269487381, + "max_abs_delta": 542.53125 + }, + "bos_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9921980500221252, + "min_cosine_similarity": 0.9369434118270874, + "mean_relative_l2": 0.1171364039182663, + "max_abs_delta": 8.5 + }, + "x_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9924269318580627, + "min_cosine_similarity": 0.9387621283531189, + "mean_relative_l2": 0.11437739431858063, + "max_abs_delta": 8.0 + }, + "x_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9850351214408875, + "min_cosine_similarity": 0.7854456901550293, + "mean_relative_l2": 0.15945737063884735, + "max_abs_delta": 20.3203125 + }, + "period_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9932123422622681, + "min_cosine_similarity": 0.9524458050727844, + "mean_relative_l2": 0.10948647558689117, + "max_abs_delta": 8.0 + }, + "period_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9842430949211121, + "min_cosine_similarity": 0.6483789086341858, + "mean_relative_l2": 0.1620362251996994, + "max_abs_delta": 31.4453125 + } + } + }, + "layer_25": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0c4823efbcfbd0c84cc761f86ece3c247ac78d24232f2d9f57e88f93565e6502", + "mean": -0.07854839414358139, + "std": 4.898215293884277, + "rms": 4.898845195770264, + "max_abs": 548.0 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c32818e4b188c67c87cbdc28f84d0ef8faaee14f4025baf5d4dc041d1fd80c40", + "mean": -0.07891132682561874, + "std": 6.700925827026367, + "rms": 6.701390266418457, + "max_abs": 872.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6ed80072a0a56f9d2611338e8d78f7f08c9edfcb4cb4e984a3b679905c76f3a0", + "mean": -0.07710490375757217, + "std": 4.864954948425293, + "rms": 4.865565776824951, + "max_abs": 536.0 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "49d5e3419ab105d88bd77f4f595589e3b32bb478bbbe5adc39cebb803b728627", + "mean": -0.07228472083806992, + "std": 6.76425313949585, + "rms": 6.764639854431152, + "max_abs": 984.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d089c80a2a9692bdfcfd9e5fb1f17fa6937f90e9e8d26f9c1a139b37aab9a4e4", + "mean": -0.07824323326349258, + "std": 5.00306510925293, + "rms": 5.003676891326904, + "max_abs": 548.0 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "26cd70a3f668ce371b598427d016e2f9753fb273c06b6b360ffeeccb089d9c6d", + "mean": -0.06897006183862686, + "std": 4.875951766967773, + "rms": 4.876439571380615, + "max_abs": 548.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "37ad5d5f2bf2a0d49769aee958cab16e156cfc0391407014d6f30f4a9c0bf9a4", + "mean": -0.07603790611028671, + "std": 4.867063999176025, + "rms": 4.867657661437988, + "max_abs": 536.0 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7e9880388460f6e5e1e199b5376039f95506b780ae12a34cc90d9ad02fa2eb07", + "mean": -0.061283841729164124, + "std": 4.664547443389893, + "rms": 4.664950370788574, + "max_abs": 536.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2101867bb6986bd8ce92b37a40b3bb8c2d70cfdb6763f2263c1d5262d9314b02", + "mean": -0.07514001429080963, + "std": 4.924431800842285, + "rms": 4.9250054359436035, + "max_abs": 556.0 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "40ed2ae879257b4e3a27f24801d7658070816b68308c144bcb825eb1877cc23e", + "mean": -0.06695438921451569, + "std": 4.818663597106934, + "rms": 4.819128513336182, + "max_abs": 556.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "875597b3e562184bd10c2c6fd632a4f62689647522367da525e0e83e936b5eff", + "mean": -0.07370245456695557, + "std": 4.87979793548584, + "rms": 4.880354881286621, + "max_abs": 540.0 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f015bf7da76e418cd75a0e095a900657c3505f10c427d68b350a3268ce2199dd", + "mean": -0.059993185102939606, + "std": 4.685618877410889, + "rms": 4.6860032081604, + "max_abs": 540.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d3a17b8a59304484a007ecfd4cc18fdaea1c94626fd358e4dbdc002ae411cb0f", + "mean": -0.07778959721326828, + "std": 4.922356605529785, + "rms": 4.922970771789551, + "max_abs": 556.0 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "60ffad79aae4e61051403928c06bc7c5d3685a3a40778e9e4b0963f9ceea6738", + "mean": -0.06891989707946777, + "std": 4.811600208282471, + "rms": 4.812093734741211, + "max_abs": 556.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "65cf3a324714b27c726f10a3ec6bb46dd529d6ea2927f8d6c97f27a1e28a5662", + "mean": -0.07562432438135147, + "std": 4.858972072601318, + "rms": 4.859560489654541, + "max_abs": 536.0 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "42baee9bafe395d9ea6ce2d42f171bb597a989ab5d2fc07f0f60f59d3977c5d4", + "mean": -0.061183422803878784, + "std": 4.664764404296875, + "rms": 4.665165901184082, + "max_abs": 536.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9976603984832764, + "min_cosine_similarity": 0.987959623336792, + "mean_relative_l2": 0.0652039498090744, + "max_abs_delta": 12.0 + }, + "system_bos": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9882203340530396, + "min_cosine_similarity": 0.1910419762134552, + "mean_relative_l2": 0.1148790717124939, + "max_abs_delta": 542.34375 + }, + "system_x": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9904977083206177, + "min_cosine_similarity": 0.8815234899520874, + "mean_relative_l2": 0.1296372264623642, + "max_abs_delta": 21.64453125 + }, + "system_period": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9890085458755493, + "min_cosine_similarity": 0.7626643776893616, + "mean_relative_l2": 0.13601279258728027, + "max_abs_delta": 33.83203125 + }, + "bos_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.986666738986969, + "min_cosine_similarity": 0.10051020979881287, + "mean_relative_l2": 0.20894944667816162, + "max_abs_delta": 547.6875 + }, + "bos_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9941928386688232, + "min_cosine_similarity": 0.9575831890106201, + "mean_relative_l2": 0.10219673812389374, + "max_abs_delta": 10.0 + }, + "x_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9941614270210266, + "min_cosine_similarity": 0.9584795236587524, + "mean_relative_l2": 0.0999574214220047, + "max_abs_delta": 8.25 + }, + "x_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9885734915733337, + "min_cosine_similarity": 0.8775192499160767, + "mean_relative_l2": 0.1412428617477417, + "max_abs_delta": 21.6953125 + }, + "period_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9947760701179504, + "min_cosine_similarity": 0.9674731492996216, + "mean_relative_l2": 0.09562500566244125, + "max_abs_delta": 8.0 + }, + "period_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9881600141525269, + "min_cosine_similarity": 0.7637943625450134, + "mean_relative_l2": 0.14112012088298798, + "max_abs_delta": 33.6953125 + } + } + }, + "layer_26": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "022b0ebd062d9659cf39a8fc444cd62e5d4af6b439dcc86c83ae298145a2d6cc", + "mean": -0.11754771322011948, + "std": 3.7796082496643066, + "rms": 3.781435489654541, + "max_abs": 292.0 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b69dc68d9dd7dc10da4a5536a97d563c3d6a69d60a4ec3f8b0721a5fb660aaa6", + "mean": -0.11784318834543228, + "std": 6.111133098602295, + "rms": 6.112269401550293, + "max_abs": 840.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fca1fb1e23f65e9972b1e78e485e43cc3fc65a983daea5c7ccaf89ca01acba34", + "mean": -0.11257413774728775, + "std": 3.7401299476623535, + "rms": 3.741823673248291, + "max_abs": 276.0 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "48acfa42ed6b130dd9926ccfb1847ffbf193939ea09f7a1d35e342e4c12cdaf5", + "mean": -0.10084252804517746, + "std": 6.307148456573486, + "rms": 6.307954788208008, + "max_abs": 872.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a3d0fe5fa24b3fbbf2f654d324fa8cea3cdbe81c32cc24fb53f6eb070cf30470", + "mean": -0.11627980321645737, + "std": 3.801626205444336, + "rms": 3.8034040927886963, + "max_abs": 300.0 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c74f6dbfa87f4951692a5e32135199b81903ae6a6e3d0bdf1433cfc41dd2ea22", + "mean": -0.10517682135105133, + "std": 4.357218265533447, + "rms": 4.358487606048584, + "max_abs": 768.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c116c3fd283b6bad71635d1f86b05cc37f47e96371c4f56935b8f9b101a9d77e", + "mean": -0.11177762597799301, + "std": 3.7658777236938477, + "rms": 3.767536163330078, + "max_abs": 300.0 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6500cf20b8ed04431eff5b4594a797c8f50173849f89904955a201268143f22c", + "mean": -0.08873739838600159, + "std": 4.453985214233398, + "rms": 4.454868793487549, + "max_abs": 768.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "745a6496d8f661e5e3ce43f952532c53b3b1dff8d44432c642de61adf72bd845", + "mean": -0.11389226466417313, + "std": 3.805082321166992, + "rms": 3.80678653717041, + "max_abs": 274.0 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ba60ec44290cf49ef20e62ad4bce3f15f98519d572482d43435fde6a9cb63233", + "mean": -0.10429387539625168, + "std": 4.373155117034912, + "rms": 4.374398708343506, + "max_abs": 768.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7f57b6efc9b58c769ca797279ebbfcbfb2858a56719b271c3677a712f0c3bc34", + "mean": -0.10504551231861115, + "std": 3.741670608520508, + "rms": 3.7431447505950928, + "max_abs": 222.0 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fcd53c8c101de1cbd227c7c1484c5c51201b808dadeadc431f3fad9268cb570d", + "mean": -0.08370555192232132, + "std": 4.447371006011963, + "rms": 4.448158264160156, + "max_abs": 768.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "16e9c90cb63611f977d896e4dec2772fcc55593b664468149e1ac7515650bd55", + "mean": -0.11637266725301743, + "std": 3.782198190689087, + "rms": 3.7839879989624023, + "max_abs": 268.0 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7ded9efc3035ed1653cbd1fa41a9e1c76c7d70a1cdff0a86f575df363c66240a", + "mean": -0.10591582953929901, + "std": 4.341578006744385, + "rms": 4.342869758605957, + "max_abs": 768.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bb8bb655ee748fb683f77bc08a0040e85d167718812b6ec7fd0d616f1bf6daa2", + "mean": -0.1051512286067009, + "std": 3.649883508682251, + "rms": 3.651397943496704, + "max_abs": 211.0 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6534e5888458b95a6186e8addeff8a5bec911bf5e3d8f5706bf073605e74b3ca", + "mean": -0.08372847735881805, + "std": 4.378088474273682, + "rms": 4.378889083862305, + "max_abs": 768.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9967420697212219, + "min_cosine_similarity": 0.9813876152038574, + "mean_relative_l2": 0.07858797907829285, + "max_abs_delta": 16.0 + }, + "system_bos": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9884387254714966, + "min_cosine_similarity": 0.6793320775032043, + "mean_relative_l2": 0.11741674691438675, + "max_abs_delta": 40.0 + }, + "system_x": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9850279092788696, + "min_cosine_similarity": 0.8989631533622742, + "mean_relative_l2": 0.16809670627117157, + "max_abs_delta": 52.0 + }, + "system_period": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9842096567153931, + "min_cosine_similarity": 0.8585271239280701, + "mean_relative_l2": 0.1726963222026825, + "max_abs_delta": 57.0 + }, + "bos_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9876506328582764, + "min_cosine_similarity": 0.6543735861778259, + "mean_relative_l2": 0.11975479125976562, + "max_abs_delta": 39.0 + }, + "bos_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9922128915786743, + "min_cosine_similarity": 0.9563272595405579, + "mean_relative_l2": 0.12074700742959976, + "max_abs_delta": 31.5 + }, + "x_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9925398230552673, + "min_cosine_similarity": 0.941789448261261, + "mean_relative_l2": 0.1141623929142952, + "max_abs_delta": 19.0 + }, + "x_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9828919172286987, + "min_cosine_similarity": 0.915803849697113, + "mean_relative_l2": 0.1805131435394287, + "max_abs_delta": 54.0 + }, + "period_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9933307766914368, + "min_cosine_similarity": 0.9599606990814209, + "mean_relative_l2": 0.10898343473672867, + "max_abs_delta": 24.0 + }, + "period_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9841140508651733, + "min_cosine_similarity": 0.8535122871398926, + "mean_relative_l2": 0.17175793647766113, + "max_abs_delta": 65.0 + } + } + }, + "final_norm": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f1ba0f1903d5aceda141fecfa97c78cd9f210d250403d4f04ab6d032c8324828", + "mean": -0.02115202136337757, + "std": 0.6914010643959045, + "rms": 0.6917245388031006, + "max_abs": 19.125 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0cd4841c1380aa97ec7cf712863746649b610d9de05057a37877a39a1beecd41", + "mean": -0.018728071823716164, + "std": 0.6751999258995056, + "rms": 0.6754595637321472, + "max_abs": 19.125 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b4d0f1cba4d20032e44e05d2c2471502f5f21be14bd6d1dbe60d3d0241d5f509", + "mean": -0.020380960777401924, + "std": 0.687268078327179, + "rms": 0.6875702142715454, + "max_abs": 19.25 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d026d47f1838c46788d7abc4fd049007943bcd0ea24e9d2d99f0f1d96c75f741", + "mean": -0.015555482357740402, + "std": 0.6539818048477173, + "rms": 0.6541667580604553, + "max_abs": 19.25 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8ae0c8bbff80c894a9a765cd8f8fc0044ad9b6b9d02dcf4aeba9934c31cfc840", + "mean": -0.020871499553322792, + "std": 0.6958492398262024, + "rms": 0.696162223815918, + "max_abs": 19.375 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d44e31ded12544742c1799d39b8270e6cc199e1d794181b4dbed88d907ce5b04", + "mean": -0.018223466351628304, + "std": 0.6784814596176147, + "rms": 0.6787261366844177, + "max_abs": 20.375 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0d8e4a298118b6de972540cf1a1b9c1a0abc8c4a55d3824b51d10faba51755d3", + "mean": -0.020113689824938774, + "std": 0.6903103590011597, + "rms": 0.6906033158302307, + "max_abs": 19.375 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "01546bda21dd69ea4a800c7d04c083e9e1723d66a03fd0192f63b029db510b61", + "mean": -0.015165945515036583, + "std": 0.656859278678894, + "rms": 0.6570343375205994, + "max_abs": 19.375 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8a26a2326a3d440426eada07823e5c6cfca4fc0c17968fed80822ac4497e1b70", + "mean": -0.019925175234675407, + "std": 0.6819267868995667, + "rms": 0.6822177767753601, + "max_abs": 18.875 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2d45fe526c555619525975cdf80f2ae0a4a4b79a2777841f936963bbb4683b1e", + "mean": -0.017576711252331734, + "std": 0.6649170517921448, + "rms": 0.6651493310928345, + "max_abs": 18.875 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6040333074cb5063aef7be4982543c4fe92b66f2e038a0f39704b27dda035470", + "mean": -0.01824580691754818, + "std": 0.6619762778282166, + "rms": 0.6622276306152344, + "max_abs": 19.5 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e1163c78fc29122a4abf6d3792f4ef53c59a588fe77710641f2a3828888faf08", + "mean": -0.013770660385489464, + "std": 0.6326709389686584, + "rms": 0.6328208446502686, + "max_abs": 19.5 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d65a3626bca2029c399457d5619c94e717b303d38f447ee1892bdfa69a2aa3b1", + "mean": -0.02075923979282379, + "std": 0.6906752586364746, + "rms": 0.6909871697425842, + "max_abs": 19.125 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e870a03e9eb29b6151163c55fff7630e4ba8e82c7d37db8d948ba543291615a8", + "mean": -0.018316633999347687, + "std": 0.6744245886802673, + "rms": 0.6746732592582703, + "max_abs": 19.125 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "21666d9c580a559f3a085f99b75e7bc36eed42704984041481eb23b0ea4c263b", + "mean": -0.019020913168787956, + "std": 0.6757084727287292, + "rms": 0.6759760975837708, + "max_abs": 19.25 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a3f3599da0939a77a8e9bfd31132c15841452feafb8b04a6b567a4b9da7f6a4b", + "mean": -0.014406450092792511, + "std": 0.6454811096191406, + "rms": 0.6456418633460999, + "max_abs": 19.625 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9964771270751953, + "min_cosine_similarity": 0.9816595315933228, + "mean_relative_l2": 0.07881716638803482, + "max_abs_delta": 2.359375 + }, + "system_bos": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.985511064529419, + "min_cosine_similarity": 0.48463115096092224, + "mean_relative_l2": 0.11758219450712204, + "max_abs_delta": 4.375 + }, + "system_x": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9840049147605896, + "min_cosine_similarity": 0.8626371026039124, + "mean_relative_l2": 0.16604167222976685, + "max_abs_delta": 4.7578125 + }, + "system_period": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9833887219429016, + "min_cosine_similarity": 0.7544017434120178, + "mean_relative_l2": 0.1699935495853424, + "max_abs_delta": 4.25 + }, + "bos_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9845415353775024, + "min_cosine_similarity": 0.451196551322937, + "mean_relative_l2": 0.12244438380002975, + "max_abs_delta": 4.671875 + }, + "bos_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9918462634086609, + "min_cosine_similarity": 0.9655454158782959, + "mean_relative_l2": 0.121504046022892, + "max_abs_delta": 2.40625 + }, + "x_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9920994639396667, + "min_cosine_similarity": 0.9518811702728271, + "mean_relative_l2": 0.11726148426532745, + "max_abs_delta": 2.65625 + }, + "x_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9812418818473816, + "min_cosine_similarity": 0.8399401307106018, + "mean_relative_l2": 0.18315312266349792, + "max_abs_delta": 4.1640625 + }, + "period_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9930456876754761, + "min_cosine_similarity": 0.9649147391319275, + "mean_relative_l2": 0.110467329621315, + "max_abs_delta": 1.84375 + }, + "period_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9828068614006042, + "min_cosine_similarity": 0.742523193359375, + "mean_relative_l2": 0.1738423854112625, + "max_abs_delta": 4.18359375 + } + } + } + }, + "router_layers": { + "layer_01": { + "layer": 1, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "9f92d443785fff2792412dd51ff8da1294d00a9f326fca199656d3d76b4a16da", + "route_weight_sha256": "fe8d48295271716fd7b9cba7bddff54deef82defc307a7fae6b25d0847c2e673", + "loads": [ + 8, + 12, + 15, + 15, + 9, + 10, + 6, + 13, + 22, + 3, + 15, + 7, + 6, + 27, + 8, + 6, + 2, + 1, + 20, + 8, + 0, + 8, + 7, + 12, + 17, + 16, + 15, + 10, + 16, + 15, + 12, + 8, + 0, + 1, + 9, + 12, + 4, + 18, + 11, + 11, + 18, + 8, + 8, + 9, + 14, + 8, + 13, + 10, + 10, + 14, + 3, + 7, + 7, + 18, + 23, + 16, + 6, + 4, + 17, + 12, + 9, + 12, + 6, + 11 + ], + "weighted_loads": [ + 0.4310906697064638, + 0.49878833815455437, + 0.9792825058102608, + 1.461191687732935, + 0.5227417442947626, + 0.786855760961771, + 0.2442566156387329, + 0.831889258697629, + 0.9376737251877785, + 0.12043197080492973, + 1.0711841154843569, + 0.48097066208720207, + 0.18098467588424683, + 1.582610983401537, + 0.6380659881979227, + 0.3874790892004967, + 0.05594553053379059, + 0.02781652845442295, + 1.159206073731184, + 0.5811289139091969, + 0.0, + 0.8238248974084854, + 0.3657431975007057, + 0.7740329205989838, + 1.1733825840055943, + 1.1594135351479053, + 0.4709204602986574, + 0.49300768598914146, + 0.856335585936904, + 1.0668931603431702, + 0.8872846476733685, + 0.45299815759062767, + 0.0, + 0.0277322456240654, + 0.4471137523651123, + 0.5212863963097334, + 0.24275343865156174, + 1.3774929568171501, + 0.8147946782410145, + 0.8284859135746956, + 1.1637447942048311, + 0.6557619273662567, + 0.8242757990956306, + 0.6006031651049852, + 0.8540051523596048, + 0.33996752835810184, + 1.037992212921381, + 0.5602144151926041, + 0.36273693293333054, + 0.6305986978113651, + 0.10242769680917263, + 0.6496144980192184, + 0.6032258123159409, + 0.6785713899880648, + 1.6229120716452599, + 0.6788872051984072, + 0.19722753018140793, + 0.15219096653163433, + 0.7154896836727858, + 0.6702961549162865, + 0.7582856137305498, + 1.0926156416535378, + 0.30801542289555073, + 0.5692898854613304 + ], + "unique_experts": 62, + "load_cv": 0.5312929225741313, + "normalized_load_entropy": 0.961847236959854, + "max_load_share": 0.03982300884955752 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "3dfaf0c510b2b13459546ab5f3f1252aedc1a8e1427c4261a7b66c9cdd5f993c", + "route_weight_sha256": "4f471a7980d49dc3316cf0c699b39cbaf6bba186694d5477f056dafd1db4e737", + "loads": [ + 9, + 12, + 17, + 15, + 13, + 11, + 7, + 15, + 39, + 3, + 17, + 9, + 6, + 27, + 8, + 15, + 2, + 2, + 20, + 8, + 3, + 8, + 8, + 12, + 17, + 20, + 28, + 10, + 16, + 15, + 12, + 13, + 2, + 3, + 9, + 12, + 4, + 18, + 11, + 14, + 19, + 18, + 8, + 14, + 15, + 19, + 14, + 10, + 11, + 14, + 7, + 8, + 11, + 18, + 26, + 20, + 9, + 12, + 19, + 23, + 10, + 16, + 6, + 11 + ], + "weighted_loads": [ + 0.5101463887840509, + 0.49878833815455437, + 1.081498745828867, + 1.461191687732935, + 0.6786534916609526, + 0.8184053227305412, + 0.3060809075832367, + 1.0994584877043962, + 1.8800595477223396, + 0.12043197080492973, + 1.3425502721220255, + 0.5366910044103861, + 0.18098467588424683, + 1.582610983401537, + 0.6380659881979227, + 1.00511659309268, + 0.05594553053379059, + 0.09927813895046711, + 1.159206073731184, + 0.5811289139091969, + 0.358273983001709, + 0.8238248974084854, + 0.3958726543933153, + 0.7740329205989838, + 1.1733825840055943, + 1.3304713666439056, + 1.281051630154252, + 0.49300768598914146, + 0.856335585936904, + 1.0668931603431702, + 0.8872846476733685, + 0.8353116193320602, + 0.09308639168739319, + 0.2102363407611847, + 0.4471137523651123, + 0.5212863963097334, + 0.24275343865156174, + 1.3774929568171501, + 0.8147946782410145, + 1.0609317608177662, + 1.2075622249394655, + 1.0690368823707104, + 0.8242757990956306, + 0.7101400145329535, + 1.8384117428213358, + 1.16094288835302, + 1.1223372481763363, + 0.5602144151926041, + 0.407622579485178, + 0.6305986978113651, + 0.2145108189433813, + 0.6502195622306317, + 0.8829199708998203, + 0.6785713899880648, + 1.6683343876502477, + 1.2077601719647646, + 0.4746612273156643, + 0.6290383469313383, + 0.762040575966239, + 1.3876002095639706, + 0.8492099959403276, + 1.3116969801485538, + 0.30801542289555073, + 0.5692898854613304 + ], + "unique_experts": 64, + "load_cv": 0.5261710139880056, + "normalized_load_entropy": 0.9669046358549277, + "max_load_share": 0.04710144927536232 + } + }, + "s1_eos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "6552d828c12b2a0a7f05f0e7da91a6d005d2d04545b3b2f0423100e509bff9e5", + "route_weight_sha256": "1a54da03cf25091a6374c669445c6d5a0519eb7e5da75aa833d756b9cc40b7ea", + "loads": [ + 9, + 14, + 15, + 15, + 8, + 10, + 5, + 11, + 20, + 3, + 15, + 8, + 6, + 27, + 9, + 6, + 2, + 1, + 20, + 8, + 0, + 8, + 8, + 12, + 17, + 16, + 13, + 10, + 16, + 15, + 12, + 8, + 0, + 1, + 9, + 12, + 3, + 18, + 11, + 12, + 17, + 8, + 8, + 9, + 16, + 8, + 13, + 10, + 10, + 14, + 3, + 7, + 7, + 17, + 23, + 16, + 5, + 4, + 17, + 13, + 11, + 13, + 6, + 10 + ], + "weighted_loads": [ + 0.4575401321053505, + 0.5530715938657522, + 0.9759455434978008, + 1.4764769189059734, + 0.48976703360676765, + 0.7946233972907066, + 0.20834205485880375, + 0.7816475611180067, + 0.8445519786328077, + 0.1209307387471199, + 1.0688425973057747, + 0.5184651780873537, + 0.17678910493850708, + 1.5833231508731842, + 0.6524205077439547, + 0.3885685633867979, + 0.05647804215550423, + 0.026249190792441368, + 1.1678046062588692, + 0.582488588988781, + 0.0, + 0.8195468075573444, + 0.39579480327665806, + 0.7798003256320953, + 1.1352984700351954, + 1.147726520895958, + 0.41617592982947826, + 0.47637538611888885, + 0.8641138467937708, + 1.0821937043219805, + 0.8954988904297352, + 0.44438471272587776, + 0.0, + 0.025435710325837135, + 0.44917857833206654, + 0.5125812273472548, + 0.20894897356629372, + 1.3730754870921373, + 0.8164026793092489, + 0.8422418218106031, + 1.1107171531766653, + 0.6623454391956329, + 0.8211002834141254, + 0.5943368375301361, + 0.9110684804618359, + 0.33759346418082714, + 1.037424761801958, + 0.5759780667722225, + 0.3609323054552078, + 0.641106866300106, + 0.10348146222531796, + 0.6521870270371437, + 0.6121897660195827, + 0.6582686342298985, + 1.6333387047052383, + 0.6811371631920338, + 0.17330152168869972, + 0.16075166314840317, + 0.7238342110067606, + 0.6921763084828854, + 0.8106515649706125, + 1.1169063299894333, + 0.31571088917553425, + 0.5465519428253174 + ], + "unique_experts": 62, + "load_cv": 0.5265548696990368, + "normalized_load_entropy": 0.9619388281493825, + "max_load_share": 0.03982300884955752 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "20618d60a687f236bf60495fc9d9a07a1943c136c9f125912dcb8d8bfffb9f7c", + "route_weight_sha256": "d43e81d149d7f1bb0c1551673c8b021b43f574c042efd3b15071e04fc92cb02b", + "loads": [ + 12, + 14, + 18, + 15, + 15, + 13, + 6, + 14, + 43, + 3, + 20, + 11, + 6, + 28, + 9, + 18, + 2, + 6, + 21, + 9, + 3, + 10, + 13, + 13, + 19, + 21, + 32, + 11, + 16, + 17, + 13, + 15, + 2, + 3, + 9, + 12, + 4, + 19, + 11, + 17, + 18, + 20, + 11, + 15, + 18, + 19, + 14, + 14, + 13, + 14, + 12, + 11, + 12, + 17, + 28, + 20, + 14, + 16, + 20, + 24, + 13, + 18, + 6, + 14 + ], + "weighted_loads": [ + 0.6394137293100357, + 0.5530715938657522, + 1.1423093639314175, + 1.4764769189059734, + 0.881378723308444, + 0.9615719020366669, + 0.25366939045488834, + 1.019009618088603, + 2.193310659378767, + 0.1209307387471199, + 1.5296629928052425, + 0.7260848563164473, + 0.17678910493850708, + 1.6233634538948536, + 0.6524205077439547, + 1.091652175411582, + 0.05647804215550423, + 0.22789298556745052, + 1.2068871594965458, + 0.6485559344291687, + 0.29438310861587524, + 1.0246771834790707, + 0.6671482989622746, + 0.8141419477760792, + 1.2071190234273672, + 1.3441898133605719, + 1.6928076203912497, + 0.5185502804815769, + 0.8641138467937708, + 1.244247054681182, + 0.9817571006715298, + 1.0553124813304748, + 0.081205103546381, + 0.166266156360507, + 0.44917857833206654, + 0.5125812273472548, + 0.4680723287165165, + 1.4067352581769228, + 0.8164026793092489, + 1.1929765846580267, + 1.1554132010787725, + 1.2363913971930742, + 1.0287069045007229, + 0.7921143267303705, + 2.0521134547889233, + 1.1066465635376517, + 1.120165441185236, + 0.6782295515877195, + 0.5579123757779598, + 0.641106866300106, + 0.4995556380599737, + 1.017007503658533, + 0.955494835972786, + 0.6582686342298985, + 1.7273120565223508, + 1.1877054311335087, + 0.6069942507892847, + 0.8625152967870235, + 0.8242883551865816, + 1.3642258681356907, + 0.926450977101922, + 1.427088152617216, + 0.31571088917553425, + 1.0387816056609154 + ], + "unique_experts": 64, + "load_cv": 0.4932596025551127, + "normalized_load_entropy": 0.9705432860446815, + "max_load_share": 0.046536796536796536 + } + }, + "s0_bos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "40151ca51e6acf33e54f26b13210f4fd78ad6d012e0debd3b3dab756c480d9dd", + "route_weight_sha256": "e3c252eeda316b2664c54e54dce2d0587a1f029b5ecd1fb79713a61e03cd1ad0", + "loads": [ + 8, + 12, + 16, + 15, + 7, + 9, + 5, + 13, + 18, + 4, + 14, + 8, + 5, + 27, + 10, + 8, + 2, + 2, + 18, + 8, + 0, + 8, + 10, + 13, + 18, + 16, + 10, + 10, + 17, + 15, + 12, + 8, + 0, + 1, + 10, + 8, + 4, + 17, + 11, + 12, + 14, + 8, + 8, + 11, + 20, + 7, + 14, + 10, + 12, + 15, + 5, + 7, + 7, + 14, + 23, + 17, + 6, + 4, + 15, + 12, + 10, + 14, + 6, + 10 + ], + "weighted_loads": [ + 0.45655080303549767, + 0.5176762044429779, + 1.0361466631293297, + 1.4827047735452652, + 0.4655347913503647, + 0.6763010676950216, + 0.19779606722295284, + 0.8068755678832531, + 0.690797321498394, + 0.14700280129909515, + 0.9796926993876696, + 0.5293922089040279, + 0.1682005226612091, + 1.5473501645028591, + 0.7253572233021259, + 0.44961257837712765, + 0.05505375936627388, + 0.06248755566775799, + 1.0547207444906235, + 0.5802704505622387, + 0.0, + 0.7705280035734177, + 0.45012785121798515, + 0.8631640207022429, + 1.081586703658104, + 1.1807066053152084, + 0.353559672832489, + 0.48801469802856445, + 0.9180005565285683, + 1.181615611538291, + 0.8745007999241352, + 0.44951721280813217, + 0.0, + 0.03304962068796158, + 0.520813474431634, + 0.3901381380856037, + 0.25204215571284294, + 1.2583307400345802, + 0.8475220147520304, + 0.828593272715807, + 0.8953013531863689, + 0.5745030231773853, + 0.8293747529387474, + 0.6559469029307365, + 1.0634075328707695, + 0.3105973917990923, + 1.0697421971708536, + 0.6046383939683437, + 0.4085490480065346, + 0.6698495429009199, + 0.16626188345253468, + 0.6588511243462563, + 0.6216302514076233, + 0.5136165209114552, + 1.63561387732625, + 0.7329218424856663, + 0.20152444764971733, + 0.14285781979560852, + 0.6617513727396727, + 0.6364647224545479, + 0.7300750222057104, + 1.1596723981201649, + 0.32377474941313267, + 0.5384714864194393 + ], + "unique_experts": 62, + "load_cv": 0.5093516397756153, + "normalized_load_entropy": 0.9648731482596529, + "max_load_share": 0.03982300884955752 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "88989ba7c7652771bc4b7938f9f4c726adaf3be29abaa21efef07c61884d206f", + "route_weight_sha256": "2ab237d9b35ddbade176cf493981d25b042d10025fcd2ab28d7687b60e043430", + "loads": [ + 10, + 12, + 18, + 15, + 11, + 10, + 6, + 15, + 34, + 4, + 16, + 11, + 5, + 27, + 11, + 17, + 2, + 4, + 18, + 8, + 3, + 8, + 11, + 13, + 18, + 20, + 23, + 10, + 17, + 15, + 12, + 12, + 2, + 3, + 10, + 8, + 4, + 17, + 11, + 15, + 15, + 19, + 9, + 15, + 20, + 17, + 16, + 10, + 13, + 15, + 9, + 7, + 11, + 14, + 25, + 21, + 10, + 13, + 15, + 22, + 12, + 18, + 6, + 10 + ], + "weighted_loads": [ + 0.5603278428316116, + 0.5176762044429779, + 1.1211858615279198, + 1.4827047735452652, + 0.6256112046539783, + 0.7118507195264101, + 0.2596203591674566, + 1.0663447715342045, + 1.5499581918120384, + 0.14700280129909515, + 1.242254400625825, + 0.6055086106061935, + 0.1682005226612091, + 1.5473501645028591, + 0.7495209500193596, + 1.067250082269311, + 0.05505375936627388, + 0.16873029805719852, + 1.0547207444906235, + 0.5802704505622387, + 0.30439577996730804, + 0.7705280035734177, + 0.48025730811059475, + 0.8631640207022429, + 1.081586703658104, + 1.3580787405371666, + 1.1623942535370588, + 0.48801469802856445, + 0.9180005565285683, + 1.181615611538291, + 0.8745007999241352, + 0.8518923968076706, + 0.09178755059838295, + 0.21310533583164215, + 0.520813474431634, + 0.3901381380856037, + 0.25204215571284294, + 1.2583307400345802, + 0.8475220147520304, + 1.0665852166712284, + 0.9301802292466164, + 1.0088363252580166, + 0.8723193928599358, + 0.7650038357824087, + 1.0634075328707695, + 1.1310739535838366, + 1.1937542855739594, + 0.6046383939683437, + 0.45362795889377594, + 0.6698495429009199, + 0.28660221956670284, + 0.6588511243462563, + 0.8870839625597, + 0.5136165209114552, + 1.680586313828826, + 1.2622813247144222, + 0.5415415838360786, + 0.6997077912092209, + 0.6617513727396727, + 1.3203236386179924, + 0.9261238407343626, + 1.38164734095335, + 0.32377474941313267, + 0.5384714864194393 + ], + "unique_experts": 64, + "load_cv": 0.4787973373385439, + "normalized_load_entropy": 0.9714906295697996, + "max_load_share": 0.04106280193236715 + } + }, + "s1_bos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "4e54773213daf7cb9650248de31d0f4dd1f42b15815843c8d2e3fee2e9b4e579", + "route_weight_sha256": "e1ef46208c7e07a774ebc9de9cc932d408406197d576391771ba742b65e7d543", + "loads": [ + 7, + 12, + 15, + 15, + 7, + 9, + 5, + 14, + 19, + 3, + 12, + 9, + 6, + 27, + 10, + 10, + 4, + 1, + 18, + 8, + 0, + 8, + 11, + 13, + 16, + 16, + 24, + 10, + 17, + 15, + 12, + 9, + 0, + 0, + 12, + 7, + 4, + 17, + 11, + 12, + 14, + 10, + 8, + 9, + 20, + 7, + 14, + 11, + 12, + 14, + 4, + 7, + 7, + 13, + 23, + 15, + 6, + 3, + 12, + 10, + 7, + 14, + 6, + 7 + ], + "weighted_loads": [ + 0.41948225907981396, + 0.5123022887855768, + 0.9488701075315475, + 1.4736719354987144, + 0.4718651659786701, + 0.7288840189576149, + 0.20535698719322681, + 0.8498407918959856, + 0.7231195531785488, + 0.1232566349208355, + 0.9010447226464748, + 0.5583630036562681, + 0.18709300458431244, + 1.5514335669577122, + 0.6882699877023697, + 0.500947767868638, + 0.09915012493729591, + 0.03602084890007973, + 1.0632659085094929, + 0.5761692672967911, + 0.0, + 0.8028721828013659, + 0.47959519177675247, + 0.8348348271101713, + 1.0311004221439362, + 1.1350175738334656, + 0.7651900053024292, + 0.4551369436085224, + 0.916347885504365, + 1.1459817290306091, + 0.8979262076318264, + 0.47259710170328617, + 0.0, + 0.0, + 0.5651880968362093, + 0.3637690842151642, + 0.25226297974586487, + 1.2181445509195328, + 0.8420293983072042, + 0.8169910535216331, + 0.813265722244978, + 0.7301173638552427, + 0.8060858622193336, + 0.5906931087374687, + 1.0757527612149715, + 0.306053226813674, + 1.066765496507287, + 0.6531040817499161, + 0.4117564018815756, + 0.6369186080992222, + 0.14447963424026966, + 0.6691547185182571, + 0.6223343648016453, + 0.5048311837017536, + 1.689693532884121, + 0.6731801331043243, + 0.20157569833099842, + 0.13134818896651268, + 0.5607643239200115, + 0.599893594160676, + 0.6371931973844767, + 1.1477267798036337, + 0.33638504706323147, + 0.46767496317625046 + ], + "unique_experts": 61, + "load_cv": 0.5307685609276278, + "normalized_load_entropy": 0.96153619120174, + "max_load_share": 0.03982300884955752 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "f1abfba7234a51ce9a1b4cb62f5bc904cf7152a152b8be71ef6f116019ab931e", + "route_weight_sha256": "5e980d3707fe5f3b69b09678b827beed498fb4a370beaf21d10f0eb9dec95b44", + "loads": [ + 11, + 12, + 18, + 16, + 14, + 12, + 6, + 17, + 41, + 3, + 17, + 12, + 6, + 28, + 11, + 22, + 4, + 6, + 19, + 9, + 3, + 10, + 15, + 14, + 18, + 21, + 43, + 11, + 17, + 17, + 13, + 15, + 2, + 2, + 12, + 7, + 5, + 18, + 11, + 17, + 15, + 22, + 12, + 15, + 21, + 17, + 16, + 14, + 15, + 14, + 13, + 11, + 12, + 13, + 27, + 19, + 16, + 17, + 14, + 20, + 10, + 19, + 6, + 11 + ], + "weighted_loads": [ + 0.6177708227187395, + 0.5123022887855768, + 1.101556271314621, + 1.5055582225322723, + 0.873100882396102, + 0.9004049338400364, + 0.2506843227893114, + 1.0779887977987528, + 1.9878660645335913, + 0.1232566349208355, + 1.3535852283239365, + 0.7603855412453413, + 0.18709300458431244, + 1.5914738699793816, + 0.7104012668132782, + 1.2040313798934221, + 0.09915012493729591, + 0.23766464367508888, + 1.1023484617471695, + 0.6422366127371788, + 0.24650394171476364, + 1.008002558723092, + 0.7506411038339138, + 0.8691764492541552, + 1.102920975536108, + 1.339545102789998, + 2.0404519606381655, + 0.4973118379712105, + 0.916347885504365, + 1.3080350793898106, + 0.984184417873621, + 1.1003076303750277, + 0.07933318614959717, + 0.13819904252886772, + 0.5651880968362093, + 0.3637690842151642, + 0.5113863348960876, + 1.2518043220043182, + 0.8420293983072042, + 1.1742445416748524, + 0.8466511070728302, + 1.304163321852684, + 1.0501163341104984, + 0.7884705979377031, + 1.2277306579053402, + 1.0746423471719027, + 1.1945238951593637, + 0.7559161651879549, + 0.6082110311836004, + 0.6369186080992222, + 0.5550203118473291, + 1.0339751951396465, + 0.9404770918190479, + 0.5048311837017536, + 1.7832467406988144, + 1.1761221811175346, + 0.6892067193984985, + 0.9351468905806541, + 0.63583704829216, + 1.2373746503144503, + 0.8553835470229387, + 1.4601441454142332, + 0.33638504706323147, + 0.9599046260118484 + ], + "unique_experts": 64, + "load_cv": 0.5152606381568312, + "normalized_load_entropy": 0.9693589383041239, + "max_load_share": 0.046536796536796536 + } + }, + "s0_x": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "cce691f3dbb6eea9d27f6229a49cc6c139b6ea1ae85875619ff75120eb559e71", + "route_weight_sha256": "924073df64dd9ecc6a87370665ec7956f627ba4166eac6521b413c69770065a6", + "loads": [ + 7, + 13, + 15, + 15, + 7, + 9, + 5, + 12, + 19, + 3, + 14, + 8, + 5, + 27, + 10, + 7, + 1, + 3, + 19, + 8, + 0, + 8, + 8, + 13, + 18, + 16, + 13, + 10, + 17, + 15, + 12, + 8, + 0, + 0, + 10, + 9, + 4, + 17, + 11, + 12, + 15, + 9, + 8, + 11, + 19, + 7, + 14, + 10, + 14, + 14, + 4, + 7, + 7, + 15, + 23, + 17, + 6, + 4, + 19, + 9, + 9, + 14, + 6, + 9 + ], + "weighted_loads": [ + 0.43245565332472324, + 0.5319562368094921, + 0.9808088690042496, + 1.4375396445393562, + 0.46008745953440666, + 0.7285825330764055, + 0.20517828688025475, + 0.7798460572957993, + 0.7645306959748268, + 0.12091328948736191, + 1.0224044974893332, + 0.512791084125638, + 0.16411083191633224, + 1.6099937334656715, + 0.7348201610147953, + 0.41413443349301815, + 0.03042985126376152, + 0.07988021522760391, + 1.137541987001896, + 0.5811079367995262, + 0.0, + 0.7855551745742559, + 0.40098118409514427, + 0.8390077203512192, + 1.1445133537054062, + 1.1586236245930195, + 0.44147974252700806, + 0.4923867806792259, + 0.9084052704274654, + 1.146687975153327, + 0.867480743676424, + 0.4566359147429466, + 0.0, + 0.0, + 0.49964291974902153, + 0.41794816963374615, + 0.24415528774261475, + 1.3430536054074764, + 0.8237341400235891, + 0.8161948211491108, + 1.0294834561645985, + 0.6414794400334358, + 0.8305891901254654, + 0.6618422064930201, + 1.0215483102947474, + 0.31553620658814907, + 1.0518265049904585, + 0.5858144573867321, + 0.4608604796230793, + 0.6329746190458536, + 0.13962368108332157, + 0.6583578437566757, + 0.600869607180357, + 0.5536005329340696, + 1.669261272996664, + 0.7374592926353216, + 0.19772201776504517, + 0.145479129627347, + 0.785712094977498, + 0.5682401098310947, + 0.7149999998509884, + 1.1431787200272083, + 0.3244603779166937, + 0.5186940096318722 + ], + "unique_experts": 61, + "load_cv": 0.5284024942053063, + "normalized_load_entropy": 0.9614490555770567, + "max_load_share": 0.03982300884955752 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "24ba0b653bff302e66e3f728c9710a99c5fde92e595d818c70ca03358432bd4c", + "route_weight_sha256": "7f0df0cdecbfe76a2a04a2661245ba0b4060f3434cf09e111c21c8a2fb64c82b", + "loads": [ + 8, + 13, + 17, + 15, + 11, + 10, + 6, + 15, + 35, + 4, + 16, + 9, + 5, + 27, + 11, + 17, + 1, + 4, + 19, + 8, + 3, + 8, + 10, + 13, + 18, + 20, + 27, + 10, + 17, + 15, + 12, + 12, + 2, + 2, + 10, + 9, + 4, + 17, + 11, + 15, + 16, + 21, + 8, + 15, + 19, + 18, + 15, + 10, + 15, + 14, + 8, + 7, + 11, + 15, + 25, + 21, + 9, + 12, + 20, + 20, + 10, + 18, + 6, + 9 + ], + "weighted_loads": [ + 0.5120250601321459, + 0.5319562368094921, + 1.075236015021801, + 1.4375396445393562, + 0.6189505644142628, + 0.7697162944823503, + 0.26700257882475853, + 1.0786935035139322, + 1.6257178001105785, + 0.14716748893260956, + 1.2921100836247206, + 0.533793855458498, + 0.16411083191633224, + 1.6099937334656715, + 0.7618492767214775, + 1.148846672847867, + 0.03042985126376152, + 0.15134182572364807, + 1.137541987001896, + 0.5811079367995262, + 0.300245501101017, + 0.7855551745742559, + 0.46209025755524635, + 0.8390077203512192, + 1.1445133537054062, + 1.3402047120034695, + 1.2813789919018745, + 0.4923867806792259, + 0.9084052704274654, + 1.146687975153327, + 0.867480743676424, + 0.8647268041968346, + 0.09269380196928978, + 0.18061702325940132, + 0.49964291974902153, + 0.41794816963374615, + 0.24415528774261475, + 1.3430536054074764, + 0.8237341400235891, + 1.0764725990593433, + 1.0667249858379364, + 1.1306576766073704, + 0.8305891901254654, + 0.7708991393446922, + 1.0215483102947474, + 1.1697115544229746, + 1.1507099028676748, + 0.5858144573867321, + 0.5108705870807171, + 0.6329746190458536, + 0.257695022970438, + 0.6583578437566757, + 0.8519274406135082, + 0.5536005329340696, + 1.71423370949924, + 1.283082952722907, + 0.39027227833867073, + 0.6211354359984398, + 0.814101891592145, + 1.3506282903254032, + 0.8059243820607662, + 1.3619598187506199, + 0.3244603779166937, + 0.5186940096318722 + ], + "unique_experts": 64, + "load_cv": 0.5062792713049835, + "normalized_load_entropy": 0.9680758487574751, + "max_load_share": 0.042270531400966184 + } + }, + "s1_x": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "76154b19bb567b87189ad392e5ec9830983a38529c91dc23436c61bd0e93f67a", + "route_weight_sha256": "7af1bbc490709fc5606cfaeb0f0131be2b3b862dd30f8dfe720fa709b8ca24e5", + "loads": [ + 7, + 13, + 15, + 15, + 7, + 9, + 5, + 13, + 19, + 3, + 12, + 9, + 6, + 27, + 9, + 9, + 3, + 0, + 18, + 8, + 0, + 8, + 10, + 13, + 16, + 16, + 30, + 10, + 17, + 15, + 12, + 9, + 0, + 0, + 12, + 8, + 4, + 17, + 10, + 12, + 14, + 11, + 8, + 9, + 18, + 6, + 14, + 11, + 14, + 12, + 4, + 7, + 7, + 13, + 24, + 15, + 6, + 3, + 13, + 10, + 6, + 13, + 6, + 8 + ], + "weighted_loads": [ + 0.4170054513961077, + 0.5342677608132362, + 0.9212164506316185, + 1.433000858873129, + 0.4633423164486885, + 0.7513056229799986, + 0.21117744036018848, + 0.8197353109717369, + 0.7286057434976101, + 0.12148726359009743, + 0.9087736140936613, + 0.5474333111196756, + 0.1817784644663334, + 1.6019552163779736, + 0.6622259300202131, + 0.4698865469545126, + 0.07612842507660389, + 0.0, + 1.0702097564935684, + 0.5728895794600248, + 0.0, + 0.8154617119580507, + 0.4534067567437887, + 0.8244671933352947, + 1.0662193596363068, + 1.1123305521905422, + 0.9766803607344627, + 0.4550929591059685, + 0.9144507981836796, + 1.127229493111372, + 0.9032616093754768, + 0.47538210824131966, + 0.0, + 0.0, + 0.5504229906946421, + 0.3904499541968107, + 0.24833344668149948, + 1.2478574365377426, + 0.7995395194739103, + 0.811399795114994, + 0.8747508823871613, + 0.7886647935956717, + 0.7977884784340858, + 0.5893797930330038, + 1.0334083065390587, + 0.2842815201729536, + 1.0585200060158968, + 0.6421183608472347, + 0.46751357801258564, + 0.5757046677172184, + 0.14154284447431564, + 0.6640126034617424, + 0.6109987422823906, + 0.5109298974275589, + 1.7167633920907974, + 0.6790575459599495, + 0.20276171155273914, + 0.13333509862422943, + 0.5971836857497692, + 0.6063010357320309, + 0.6182718053460121, + 1.110851589590311, + 0.34005027264356613, + 0.4944537580013275 + ], + "unique_experts": 60, + "load_cv": 0.5598739240536832, + "normalized_load_entropy": 0.9579676490481371, + "max_load_share": 0.04424778761061947 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "47947d8d025c02c4c52d632049a37c4fe582aeb13a187eaed049b7518a863930", + "route_weight_sha256": "38f7b40ff4bc9d57e9c4c1884cb2d253dd743575f1f0a8429065c6bbb46f1d37", + "loads": [ + 10, + 13, + 18, + 15, + 14, + 12, + 6, + 17, + 41, + 4, + 17, + 12, + 6, + 28, + 9, + 22, + 3, + 5, + 19, + 9, + 3, + 10, + 14, + 14, + 18, + 21, + 50, + 11, + 17, + 17, + 13, + 15, + 2, + 2, + 12, + 8, + 5, + 18, + 10, + 17, + 15, + 24, + 11, + 15, + 19, + 17, + 16, + 14, + 17, + 12, + 13, + 11, + 12, + 13, + 28, + 19, + 15, + 15, + 16, + 21, + 8, + 18, + 6, + 12 + ], + "weighted_loads": [ + 0.5896717924624681, + 0.5342677608132362, + 1.0812027864158154, + 1.433000858873129, + 0.8623203169554472, + 0.9251433182507753, + 0.2565047759562731, + 1.0851283464580774, + 1.9900007005780935, + 0.1463700756430626, + 1.3619546461850405, + 0.7461076974868774, + 0.1817784644663334, + 1.641995519399643, + 0.6622259300202131, + 1.2837810274213552, + 0.07612842507660389, + 0.20164379477500916, + 1.109292309731245, + 0.6389569249004126, + 0.24268075823783875, + 1.020592087879777, + 0.72445266880095, + 0.8588088154792786, + 1.1380399130284786, + 1.321187635883689, + 2.2910483088344336, + 0.49726785346865654, + 0.9144507981836796, + 1.2892828434705734, + 0.9895198196172714, + 1.105784397572279, + 0.080379668623209, + 0.14046062901616096, + 0.5504229906946421, + 0.3904499541968107, + 0.5074568018317223, + 1.281517207622528, + 0.7995395194739103, + 1.1865313239395618, + 0.9092794135212898, + 1.4293826892971992, + 1.0053950995206833, + 0.7871572822332382, + 1.1853862032294273, + 1.0876050237566233, + 1.1911660265177488, + 0.744529752060771, + 0.6674933526664972, + 0.5757046677172184, + 0.5504958853125572, + 1.0288330800831318, + 0.9150674901902676, + 0.5109298974275589, + 1.8103165999054909, + 1.1917506530880928, + 0.5615178719162941, + 0.8305004872381687, + 0.6991412155330181, + 1.3380434848368168, + 0.7340712174773216, + 1.4195545092225075, + 0.34005027264356613, + 0.9866834208369255 + ], + "unique_experts": 64, + "load_cv": 0.5538250065598059, + "normalized_load_entropy": 0.9662779601737247, + "max_load_share": 0.05411255411255411 + } + }, + "s0_period": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "39506ad33ab05bf9aaf9e5911449ded533804d5329e006a59e3f8cc645b0ca65", + "route_weight_sha256": "e6d32c3ab5bafd41ad4f094af700ea4ed4a544ce0069813ea8cce82af5df7459", + "loads": [ + 7, + 13, + 15, + 15, + 7, + 9, + 5, + 12, + 19, + 3, + 14, + 8, + 5, + 27, + 10, + 7, + 2, + 3, + 19, + 8, + 0, + 8, + 8, + 13, + 18, + 16, + 13, + 11, + 16, + 15, + 12, + 8, + 0, + 0, + 10, + 10, + 4, + 17, + 11, + 12, + 15, + 9, + 8, + 10, + 19, + 7, + 14, + 10, + 14, + 14, + 4, + 7, + 7, + 15, + 23, + 16, + 6, + 3, + 18, + 10, + 10, + 14, + 6, + 9 + ], + "weighted_loads": [ + 0.43022140488028526, + 0.5323326848447323, + 0.97996836155653, + 1.4342798590660095, + 0.46027911454439163, + 0.7307032011449337, + 0.2127726934850216, + 0.7845686879009008, + 0.7636340390890837, + 0.1207202672958374, + 1.014655837789178, + 0.5146663933992386, + 0.16453199088573456, + 1.609252329915762, + 0.7325516082346439, + 0.41121574863791466, + 0.05394698493182659, + 0.07954757288098335, + 1.1246392503380775, + 0.5794210340827703, + 0.0, + 0.7904620505869389, + 0.40060570277273655, + 0.8401866462081671, + 1.1667656023055315, + 1.1582680940628052, + 0.439991757273674, + 0.5200496576726437, + 0.8775247093290091, + 1.1352018043398857, + 0.8703412376344204, + 0.4535296559333801, + 0.0, + 0.0, + 0.49571431055665016, + 0.4437296148389578, + 0.2441369816660881, + 1.3404290340840816, + 0.8286557495594025, + 0.818822817876935, + 1.0348035749047995, + 0.6407611835747957, + 0.8285158351063728, + 0.6363290902227163, + 1.0210409592837095, + 0.3162572309374809, + 1.0554576329886913, + 0.583323035389185, + 0.4582759477198124, + 0.62890999391675, + 0.13857735320925713, + 0.6572994962334633, + 0.6042108796536922, + 0.5572982355952263, + 1.667523242533207, + 0.7146178036928177, + 0.19834688119590282, + 0.12197839841246605, + 0.7600747067481279, + 0.59431510604918, + 0.7387114837765694, + 1.1402496434748173, + 0.32766519859433174, + 0.5185793060809374 + ], + "unique_experts": 61, + "load_cv": 0.5217737939281516, + "normalized_load_entropy": 0.962383410056441, + "max_load_share": 0.03982300884955752 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "1d0d8920eadebfe355fa274be9baaf888c0f7893861d9b428ad2ea80d38eae80", + "route_weight_sha256": "cd506e4a8b45c9c68bc77e5004ba0f83c568fd92dacc4b33a4080690bac0ef54", + "loads": [ + 8, + 13, + 17, + 15, + 12, + 10, + 6, + 14, + 35, + 4, + 16, + 11, + 5, + 27, + 11, + 16, + 2, + 4, + 19, + 8, + 3, + 8, + 9, + 13, + 18, + 20, + 26, + 11, + 16, + 15, + 12, + 12, + 2, + 2, + 10, + 11, + 4, + 17, + 11, + 15, + 16, + 20, + 8, + 15, + 19, + 17, + 15, + 10, + 16, + 14, + 8, + 8, + 11, + 15, + 25, + 20, + 9, + 10, + 19, + 21, + 11, + 18, + 6, + 9 + ], + "weighted_loads": [ + 0.5103385485708714, + 0.5323326848447323, + 1.065568346530199, + 1.4342798590660095, + 0.7407124750316143, + 0.7675009742379189, + 0.2745969854295254, + 1.0357172172516584, + 1.5993999298661947, + 0.14627580530941486, + 1.283050687983632, + 0.6973529886454344, + 0.16453199088573456, + 1.609252329915762, + 0.7590602990239859, + 1.028853252530098, + 0.05394698493182659, + 0.1510091833770275, + 1.1246392503380775, + 0.5794210340827703, + 0.2927856668829918, + 0.7904620505869389, + 0.43073515966534615, + 0.8401866462081671, + 1.1667656023055315, + 1.3394538760185242, + 1.2501786015927792, + 0.5200496576726437, + 0.8775247093290091, + 1.1352018043398857, + 0.8703412376344204, + 0.8641818016767502, + 0.09234577044844627, + 0.1805097907781601, + 0.49571431055665016, + 0.4650566428899765, + 0.2441369816660881, + 1.3404290340840816, + 0.8286557495594025, + 1.0593094285577536, + 1.071754114702344, + 1.073934068903327, + 0.8285158351063728, + 0.7711842432618141, + 1.0210409592837095, + 1.1367337927222252, + 1.1519863121211529, + 0.583323035389185, + 0.5297568663954735, + 0.62890999391675, + 0.2565356623381376, + 0.7103001549839973, + 0.8685650415718555, + 0.5572982355952263, + 1.7124956790357828, + 1.2627066671848297, + 0.3912359606474638, + 0.5691037587821484, + 0.7881407272070646, + 1.3082103822380304, + 0.8296358659863472, + 1.3562274537980556, + 0.32766519859433174, + 0.5185793060809374 + ], + "unique_experts": 64, + "load_cv": 0.4939598762129051, + "normalized_load_entropy": 0.9698081290003171, + "max_load_share": 0.042270531400966184 + } + }, + "s1_period": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "2d9da99984f1e515a32ab5d8608b2ba47fcaae4608b451284c204af21365d27e", + "route_weight_sha256": "701db676b99e27cd66923e117dc454a12cde19b45a1e06a036b4a8dbf59d4d1b", + "loads": [ + 7, + 14, + 15, + 15, + 7, + 9, + 5, + 13, + 19, + 3, + 12, + 9, + 6, + 27, + 9, + 9, + 3, + 0, + 18, + 8, + 0, + 8, + 10, + 13, + 16, + 16, + 29, + 10, + 17, + 15, + 12, + 9, + 0, + 0, + 12, + 8, + 3, + 17, + 10, + 12, + 14, + 11, + 8, + 9, + 18, + 6, + 14, + 11, + 13, + 12, + 4, + 7, + 7, + 14, + 24, + 15, + 6, + 3, + 14, + 10, + 6, + 13, + 6, + 8 + ], + "weighted_loads": [ + 0.4168581012636423, + 0.5658595263957977, + 0.9225921370089054, + 1.4268815778195858, + 0.462684603407979, + 0.7506632506847382, + 0.21278253942728043, + 0.8222252484411001, + 0.7259762175381184, + 0.12164574861526489, + 0.9087150078266859, + 0.5484927278012037, + 0.18240210227668285, + 1.6052479036152363, + 0.6617155205458403, + 0.4713637437671423, + 0.0764320157468319, + 0.0, + 1.0696254465728998, + 0.572398891672492, + 0.0, + 0.8189983461052179, + 0.45415032655000687, + 0.8241357151418924, + 1.0731004420667887, + 1.1102380529046059, + 0.9562346804887056, + 0.4547193795442581, + 0.9123700279742479, + 1.123426180332899, + 0.9029653109610081, + 0.4744484703987837, + 0.0, + 0.0, + 0.5509807746857405, + 0.39058549515902996, + 0.21558713167905807, + 1.2512853406369686, + 0.8014865983277559, + 0.8134506028145552, + 0.8805633652955294, + 0.790747981518507, + 0.7970231026411057, + 0.5894600804895163, + 1.031789431348443, + 0.28438129648566246, + 1.0588866118341684, + 0.6410722434520721, + 0.4369104541838169, + 0.5745956115424633, + 0.14069220423698425, + 0.6615384072065353, + 0.6112938188016415, + 0.5443817246705294, + 1.716533936560154, + 0.6790482793003321, + 0.20193804800510406, + 0.13318390399217606, + 0.6170123238116503, + 0.6072609443217516, + 0.6199930887669325, + 1.1096912864595652, + 0.3427874092012644, + 0.49376511201262474 + ], + "unique_experts": 60, + "load_cv": 0.55837988673549, + "normalized_load_entropy": 0.9577650621163397, + "max_load_share": 0.04277286135693215 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "861e4565ec6e4f7b02aa7442c23e5f18ecbeb11a3b06f8e9c23707b74522a10e", + "route_weight_sha256": "ba1894e0d4dae9f6756eed53e3b122c869cb6f632197210bbc809cf5d92558f0", + "loads": [ + 10, + 14, + 18, + 15, + 15, + 12, + 6, + 16, + 40, + 3, + 17, + 14, + 6, + 28, + 9, + 21, + 3, + 5, + 19, + 9, + 3, + 10, + 14, + 14, + 18, + 21, + 49, + 11, + 17, + 17, + 14, + 15, + 2, + 2, + 12, + 8, + 5, + 18, + 10, + 17, + 15, + 24, + 11, + 15, + 19, + 16, + 15, + 14, + 16, + 12, + 13, + 12, + 13, + 14, + 28, + 19, + 15, + 15, + 17, + 20, + 8, + 18, + 6, + 12 + ], + "weighted_loads": [ + 0.5915699917823076, + 0.5658595263957977, + 1.0720035322010517, + 1.4268815778195858, + 0.981889333575964, + 0.9226139709353447, + 0.258109875023365, + 1.0377412047237158, + 1.9438502062112093, + 0.12164574861526489, + 1.3618501890450716, + 0.9146875385195017, + 0.18240210227668285, + 1.6452882066369057, + 0.6617155205458403, + 1.1744473557919264, + 0.0764320157468319, + 0.20164379477500916, + 1.1087079998105764, + 0.6384662371128798, + 0.23236003145575523, + 1.0241287220269442, + 0.7251962386071682, + 0.8584773372858763, + 1.1449209954589605, + 1.3181982357054949, + 2.26093433983624, + 0.4968942739069462, + 0.9123700279742479, + 1.2854795306921005, + 1.0100762825459242, + 1.1066114362329245, + 0.0802991185337305, + 0.14061115309596062, + 0.5509807746857405, + 0.39058549515902996, + 0.49669439531862736, + 1.284945111721754, + 0.8014865983277559, + 1.169296944513917, + 0.9149664100259542, + 1.4001730922609568, + 1.004629723727703, + 0.7872375696897507, + 1.1837673280388117, + 1.0529704168438911, + 1.1557987947016954, + 0.7433943375945091, + 0.6392318569123745, + 0.5745956115424633, + 0.5495761707425117, + 1.069136556237936, + 0.9500712361186743, + 0.5443817246705294, + 1.8100871443748474, + 1.1930204723030329, + 0.5639970060437918, + 0.8301893230527639, + 0.7187995482236147, + 1.2447420004755259, + 0.735792500898242, + 1.413269093260169, + 0.3427874092012644, + 0.9859947748482227 + ], + "unique_experts": 64, + "load_cv": 0.5430269623980645, + "normalized_load_entropy": 0.9669834840236917, + "max_load_share": 0.05303030303030303 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 113, + "ordered_topk_exact_tokens": 91, + "set_exact_tokens": 97, + "mean_set_jaccard": 0.9595448798988622, + "mean_token_weighted_tv": 0.006617110098951158, + "aggregate_load_tv": 0.019174041297935103 + }, + "system_bos": { + "tokens": 113, + "ordered_topk_exact_tokens": 64, + "set_exact_tokens": 77, + "mean_set_jaccard": 0.9032869785082176, + "mean_token_weighted_tv": 0.01493981765764477, + "aggregate_load_tv": 0.04277286135693215 + }, + "system_x": { + "tokens": 113, + "ordered_topk_exact_tokens": 64, + "set_exact_tokens": 77, + "mean_set_jaccard": 0.899494310998736, + "mean_token_weighted_tv": 0.01680662349459872, + "aggregate_load_tv": 0.05014749262536873 + }, + "system_period": { + "tokens": 113, + "ordered_topk_exact_tokens": 64, + "set_exact_tokens": 77, + "mean_set_jaccard": 0.9032869785082176, + "mean_token_weighted_tv": 0.0163658810037691, + "aggregate_load_tv": 0.048672566371681415 + }, + "bos_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 50, + "set_exact_tokens": 72, + "mean_set_jaccard": 0.8792667509481668, + "mean_token_weighted_tv": 0.022493343206897245, + "aggregate_load_tv": 0.05014749262536873 + }, + "bos_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 48, + "set_exact_tokens": 62, + "mean_set_jaccard": 0.8634639696586599, + "mean_token_weighted_tv": 0.022391963610013502, + "aggregate_load_tv": 0.06637168141592921 + }, + "x_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 55, + "set_exact_tokens": 77, + "mean_set_jaccard": 0.9013906447534766, + "mean_token_weighted_tv": 0.017598708976159054, + "aggregate_load_tv": 0.0471976401179941 + }, + "x_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 48, + "set_exact_tokens": 62, + "mean_set_jaccard": 0.8615676359039192, + "mean_token_weighted_tv": 0.02224793066723948, + "aggregate_load_tv": 0.06932153392330384 + }, + "period_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 58, + "set_exact_tokens": 78, + "mean_set_jaccard": 0.9039190897597977, + "mean_token_weighted_tv": 0.017172280196265308, + "aggregate_load_tv": 0.04424778761061947 + }, + "period_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 50, + "set_exact_tokens": 64, + "mean_set_jaccard": 0.8666245259165615, + "mean_token_weighted_tv": 0.02168539954365882, + "aggregate_load_tv": 0.06489675516224189 + } + } + }, + "layer_02": { + "layer": 2, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "6ccb1fcbdbfcaa236d05caa3a13161bf1bc6c887b5b01d7d188cbcba81edc520", + "route_weight_sha256": "2aa09bbf04e681c8ad7a7eaee721860d5f2d1c1353299952bdb51621802971ce", + "loads": [ + 12, + 7, + 7, + 7, + 20, + 14, + 12, + 4, + 10, + 17, + 11, + 12, + 8, + 11, + 7, + 17, + 14, + 5, + 7, + 13, + 4, + 11, + 11, + 7, + 9, + 9, + 9, + 12, + 8, + 5, + 13, + 18, + 11, + 16, + 11, + 13, + 16, + 5, + 6, + 8, + 7, + 11, + 10, + 3, + 9, + 12, + 10, + 23, + 10, + 9, + 7, + 3, + 8, + 20, + 19, + 10, + 12, + 8, + 8, + 13, + 18, + 8, + 8, + 15 + ], + "weighted_loads": [ + 1.257627584040165, + 0.8062581140547991, + 0.3478984273970127, + 0.3806343823671341, + 1.6284459494054317, + 0.9865749664604664, + 1.0959984585642815, + 0.2529724333435297, + 0.778778363019228, + 1.4269851241260767, + 0.6363959349691868, + 0.7393904896453023, + 0.3397318050265312, + 0.43136640451848507, + 0.6323488540947437, + 1.1559832077473402, + 0.6958173476159573, + 0.2079916838556528, + 0.5037330035120249, + 0.6658981665968895, + 0.23142065852880478, + 1.0011192541569471, + 1.70342817902565, + 0.4453459493815899, + 0.4154962692409754, + 0.7156070843338966, + 0.6569900885224342, + 0.7625524047762156, + 0.28221777454018593, + 0.21804799139499664, + 0.8562207650393248, + 1.4364844746887684, + 0.7074352093040943, + 1.3709700498729944, + 0.8890311624854803, + 0.6781282443553209, + 1.3029143568128347, + 0.7781452164053917, + 0.33403889648616314, + 0.5164963006973267, + 0.5327165070921183, + 0.7073261458426714, + 0.6215034704655409, + 0.17158585041761398, + 0.6044112630188465, + 0.9019400700926781, + 0.6437846012413502, + 1.7306092530488968, + 0.7746948562562466, + 0.39615749567747116, + 1.0263854041695595, + 0.10629564337432384, + 0.5602163337171078, + 1.7086336202919483, + 1.252440918236971, + 0.5434330720454454, + 1.2728244066238403, + 0.6645894311368465, + 0.7652639336884022, + 1.058414101600647, + 1.5892551727592945, + 1.1079711131751537, + 0.34041498228907585, + 1.030752670019865 + ], + "unique_experts": 64, + "load_cv": 0.41204065251577265, + "normalized_load_entropy": 0.9798515560848667, + "max_load_share": 0.03392330383480826 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "0c142e763f44e2f6290c1c92e1c392d97ad772491404d40756bf3fc546419ab9", + "route_weight_sha256": "753628cc72ec4443b185529eca3f12296637c3b620ca921fd986117c5a47073d", + "loads": [ + 12, + 17, + 7, + 9, + 20, + 14, + 12, + 6, + 13, + 17, + 14, + 12, + 8, + 12, + 15, + 17, + 14, + 6, + 8, + 17, + 7, + 20, + 11, + 7, + 12, + 9, + 10, + 14, + 10, + 5, + 13, + 19, + 11, + 16, + 16, + 29, + 16, + 5, + 9, + 8, + 7, + 11, + 17, + 3, + 9, + 12, + 12, + 27, + 11, + 9, + 7, + 10, + 8, + 21, + 19, + 10, + 12, + 16, + 16, + 16, + 28, + 12, + 13, + 25 + ], + "weighted_loads": [ + 1.257627584040165, + 1.7551977168768644, + 0.3478984273970127, + 2.0821705013513565, + 1.6284459494054317, + 0.9865749664604664, + 1.0959984585642815, + 0.4331082608550787, + 1.0316516607999802, + 1.4269851241260767, + 0.762042447924614, + 0.7393904896453023, + 0.3397318050265312, + 0.45374682545661926, + 0.9815660733729601, + 1.1559832077473402, + 0.6958173476159573, + 0.20868774672271684, + 0.5053217097884044, + 1.4181066527962685, + 0.5671926382929087, + 1.6954613123089075, + 1.70342817902565, + 0.4453459493815899, + 0.5745908226817846, + 0.7156070843338966, + 0.6578330655465834, + 0.9990632776170969, + 0.49050090834498405, + 0.21804799139499664, + 0.8562207650393248, + 1.4371772802551277, + 0.7074352093040943, + 1.3709700498729944, + 1.1137714143842459, + 2.6888953056186438, + 1.3029143568128347, + 0.7781452164053917, + 0.4274270748719573, + 0.5164963006973267, + 0.5327165070921183, + 0.7073261458426714, + 1.3910841215401888, + 0.17158585041761398, + 0.6044112630188465, + 0.9019400700926781, + 0.7104635369032621, + 1.9872192181646824, + 0.8001037072390318, + 0.39615749567747116, + 1.0263854041695595, + 0.7407476808875799, + 0.5602163337171078, + 1.7099395400146022, + 1.252440918236971, + 0.5434330720454454, + 1.2728244066238403, + 1.107911717146635, + 1.1290354169905186, + 1.1694084014743567, + 2.420602535828948, + 1.3046471755951643, + 0.735254991799593, + 1.7061240896582603 + ], + "unique_experts": 64, + "load_cv": 0.42597082339488884, + "normalized_load_entropy": 0.979060357421996, + "max_load_share": 0.035024154589371984 + } + }, + "s1_eos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "3a5a997cbe860f477c7ee85927f49fe55fb467c1c4c0d744109e758efae1cfb6", + "route_weight_sha256": "ce90cc1154037b21e924f2f6458bd382d6babc6d7810987746d6904090b5c9e9", + "loads": [ + 12, + 8, + 9, + 7, + 21, + 14, + 11, + 4, + 10, + 17, + 11, + 14, + 7, + 10, + 6, + 17, + 13, + 5, + 7, + 14, + 4, + 13, + 11, + 7, + 9, + 9, + 9, + 11, + 7, + 5, + 12, + 16, + 11, + 15, + 11, + 13, + 16, + 5, + 6, + 8, + 7, + 11, + 10, + 3, + 9, + 12, + 10, + 23, + 10, + 9, + 7, + 3, + 9, + 20, + 20, + 10, + 12, + 8, + 7, + 13, + 19, + 8, + 8, + 15 + ], + "weighted_loads": [ + 1.2610518112778664, + 0.8294902574270964, + 0.4235735069960356, + 0.3824677001684904, + 1.663620663806796, + 0.999355161562562, + 1.0838614255189896, + 0.2523601297289133, + 0.7829720042645931, + 1.4524933956563473, + 0.6373534165322781, + 0.8084631245583296, + 0.3146130032837391, + 0.3831057120114565, + 0.5994122289121151, + 1.176393212750554, + 0.6711416970938444, + 0.20614172518253326, + 0.4992532916367054, + 0.6847474928945303, + 0.2324567213654518, + 1.0450603235512972, + 1.7148431725800037, + 0.4445422440767288, + 0.4103023298084736, + 0.708341596648097, + 0.6500478461384773, + 0.7351676914840937, + 0.2616771049797535, + 0.2159135788679123, + 0.8342366963624954, + 1.3650184404104948, + 0.7012460865080357, + 1.340246400795877, + 0.8967858348041773, + 0.6658966224640608, + 1.3226881194859743, + 0.7973855920135975, + 0.3292633332312107, + 0.520919993519783, + 0.5544734615832567, + 0.7143536545336246, + 0.6217635665088892, + 0.17110217735171318, + 0.6043708510696888, + 0.887582141906023, + 0.6523185856640339, + 1.7156649846583605, + 0.7807152159512043, + 0.39370145089924335, + 1.024290006607771, + 0.10803090780973434, + 0.5916301682591438, + 1.7235052436590195, + 1.3009254354983568, + 0.546204773709178, + 1.2703441083431244, + 0.6372292898595333, + 0.7248791698366404, + 1.0549819841980934, + 1.6280057542026043, + 1.111131202429533, + 0.3245614543557167, + 1.0672096069902182 + ], + "unique_experts": 64, + "load_cv": 0.4174119473506227, + "normalized_load_entropy": 0.9794149042581166, + "max_load_share": 0.03392330383480826 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "4b736816a63e128d23b2b7533302caa49dc2435e5e7d7be1742d1e21be94188b", + "route_weight_sha256": "f3c9a2f6167dc88cfd26d461db1dd7252404c2ea825d5710097571a12449c074", + "loads": [ + 16, + 19, + 10, + 10, + 22, + 15, + 11, + 8, + 19, + 18, + 18, + 14, + 7, + 13, + 18, + 18, + 15, + 6, + 8, + 20, + 7, + 23, + 12, + 7, + 16, + 10, + 10, + 14, + 11, + 5, + 13, + 18, + 11, + 15, + 20, + 30, + 16, + 6, + 11, + 11, + 7, + 11, + 20, + 4, + 12, + 12, + 16, + 30, + 12, + 10, + 8, + 12, + 10, + 24, + 20, + 10, + 16, + 16, + 9, + 24, + 29, + 15, + 18, + 28 + ], + "weighted_loads": [ + 1.7803549095988274, + 1.8347449246793985, + 0.4490436315536499, + 2.118647215887904, + 1.6938614696264267, + 1.14093435741961, + 1.0838614255189896, + 0.49759054370224476, + 1.5805969219654799, + 1.569318015128374, + 0.9426504224538803, + 0.8084631245583296, + 0.3146130032837391, + 0.4314292600611225, + 1.202762633562088, + 1.20880070887506, + 0.7348331641405821, + 0.20672544708941132, + 0.5006353731732816, + 1.474550561979413, + 0.5435169190168381, + 1.8158693872392178, + 1.753690391778946, + 0.4445422440767288, + 0.7289188764989376, + 0.7586464192718267, + 0.6508754950482398, + 1.3686918262392282, + 0.4816889651119709, + 0.2159135788679123, + 0.8681668601930141, + 1.407976085320115, + 0.7012460865080357, + 1.340246400795877, + 1.2639201935380697, + 2.4001368079334497, + 1.3226881194859743, + 0.8392249383032322, + 0.4845104143023491, + 0.8744435235857964, + 0.5544734615832567, + 0.7143536545336246, + 1.8387540224939585, + 0.35193372890353203, + 1.2542722262442112, + 0.887582141906023, + 1.226427424699068, + 2.0932788532227278, + 0.8495678827166557, + 0.43661646731197834, + 1.0504794083535671, + 0.9943315573036671, + 0.7678443416953087, + 1.9078547793906182, + 1.3009254354983568, + 0.546204773709178, + 1.5244903713464737, + 1.0107342228293419, + 0.8355190139263868, + 1.5112702157348394, + 2.3030202854424715, + 1.5823511481285095, + 1.1652425806969404, + 2.126653414219618 + ], + "unique_experts": 64, + "load_cv": 0.4250147577130798, + "normalized_load_entropy": 0.9787896491538832, + "max_load_share": 0.032467532467532464 + } + }, + "s0_bos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "7afa2e07fcab185e3ecc48b79ef128354540a27b62ce3ca923903f4956afa0ad", + "route_weight_sha256": "42b237157c0c16eb48bf6c5510e65851962c839a26d5ea2f84b19cf705548568", + "loads": [ + 12, + 9, + 4, + 7, + 24, + 14, + 12, + 5, + 10, + 16, + 9, + 12, + 3, + 9, + 7, + 18, + 12, + 5, + 8, + 10, + 4, + 13, + 11, + 8, + 10, + 8, + 9, + 12, + 11, + 5, + 13, + 18, + 12, + 11, + 11, + 11, + 16, + 5, + 6, + 8, + 7, + 11, + 11, + 3, + 8, + 12, + 9, + 22, + 11, + 11, + 7, + 2, + 9, + 21, + 19, + 10, + 13, + 9, + 8, + 13, + 20, + 8, + 11, + 15 + ], + "weighted_loads": [ + 1.2742939330637455, + 0.8920192699879408, + 0.2716250382363796, + 0.3936138227581978, + 1.7953807227313519, + 0.9927097726613283, + 1.1217158045619726, + 0.2956387046724558, + 0.7449038736522198, + 1.3951705433428288, + 0.587088456377387, + 0.7031573764979839, + 0.13777168653905392, + 0.3451238479465246, + 0.6067880000919104, + 1.225813440978527, + 0.6405481044203043, + 0.2234120424836874, + 0.5381968393921852, + 0.5467770732939243, + 0.22729076817631721, + 1.061757568269968, + 1.7301992401480675, + 0.4775362368673086, + 0.42803086899220943, + 0.6830386593937874, + 0.6163661703467369, + 0.7861775122582912, + 0.41705342568457127, + 0.21992026641964912, + 0.8909706510603428, + 1.4064831007272005, + 0.7766120992600918, + 1.086887788027525, + 0.8710125461220741, + 0.6034861523658037, + 1.3580881394445896, + 0.8303696252405643, + 0.3364532720297575, + 0.5326100066304207, + 0.5437158942222595, + 0.7250543683767319, + 0.68708211556077, + 0.1764221303164959, + 0.584789328277111, + 0.8789849653840065, + 0.6365829892456532, + 1.7696723379194736, + 0.8555091265588999, + 0.4500102885067463, + 1.0437460616230965, + 0.08189664222300053, + 0.6185534000396729, + 1.7258672807365656, + 1.2407335061579943, + 0.5221192352473736, + 1.2985100373625755, + 0.6293084789067507, + 0.7985769212245941, + 1.0377757214009762, + 1.789999732747674, + 1.167627975344658, + 0.4852119144052267, + 1.0980104003101587 + ], + "unique_experts": 64, + "load_cv": 0.43441022755413927, + "normalized_load_entropy": 0.9774789075438387, + "max_load_share": 0.035398230088495575 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "44689769aa065bff1085c3f6599cf83316760e6d720a7f2bddce3d0205cdf878", + "route_weight_sha256": "ebadc5b3cc2246e44c2f7ec61fa46ba5e5db8d668cfada120c354741b504ff9e", + "loads": [ + 12, + 19, + 4, + 8, + 24, + 14, + 12, + 7, + 13, + 16, + 12, + 12, + 4, + 9, + 13, + 18, + 13, + 5, + 8, + 14, + 6, + 22, + 11, + 8, + 12, + 8, + 9, + 14, + 13, + 5, + 13, + 18, + 12, + 11, + 16, + 27, + 16, + 6, + 10, + 8, + 7, + 11, + 19, + 3, + 8, + 12, + 11, + 26, + 12, + 11, + 7, + 8, + 9, + 21, + 19, + 10, + 13, + 18, + 16, + 19, + 31, + 12, + 17, + 26 + ], + "weighted_loads": [ + 1.2742939330637455, + 1.8409588728100061, + 0.2716250382363796, + 1.122272677719593, + 1.7953807227313519, + 0.9927097726613283, + 1.1217158045619726, + 0.4545133765786886, + 1.0083626061677933, + 1.3951705433428288, + 0.7127349693328142, + 0.7031573764979839, + 0.16979272849857807, + 0.3451238479465246, + 0.8492991887032986, + 1.225813440978527, + 0.6705860886722803, + 0.2234120424836874, + 0.5381968393921852, + 1.2586903758347034, + 0.5180194266140461, + 1.766925361007452, + 1.7301992401480675, + 0.4775362368673086, + 0.5478667635470629, + 0.6830386593937874, + 0.6163661703467369, + 1.031311970204115, + 0.6756304446607828, + 0.21992026641964912, + 0.8909706510603428, + 1.4064831007272005, + 0.7766120992600918, + 1.086887788027525, + 1.0957527980208397, + 2.640682255849242, + 1.3580881394445896, + 0.8513332400470972, + 0.5167777007445693, + 0.5326100066304207, + 0.5437158942222595, + 0.7250543683767319, + 1.4929923601448536, + 0.1764221303164959, + 0.584789328277111, + 0.8789849653840065, + 0.7032619249075651, + 2.022088013589382, + 0.8809179775416851, + 0.4500102885067463, + 1.0437460616230965, + 0.7264735866338015, + 0.6185534000396729, + 1.7258672807365656, + 1.2407335061579943, + 0.5221192352473736, + 1.2985100373625755, + 1.083434259518981, + 1.1623484045267105, + 1.2583678234368563, + 2.653981864452362, + 1.360415618866682, + 0.965904338285327, + 2.0493373330682516 + ], + "unique_experts": 64, + "load_cv": 0.45969934173918986, + "normalized_load_entropy": 0.9754366171045112, + "max_load_share": 0.03743961352657005 + } + }, + "s1_bos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "ad8c590d9487f4fb6b615c767e776e6be1c29e612e435799ef7a63f40e2e2cfd", + "route_weight_sha256": "1f09f3b3b87ada29a3701169200d39b89343c41bbabd852c35aa473fd96686b7", + "loads": [ + 12, + 10, + 6, + 7, + 24, + 14, + 12, + 4, + 10, + 16, + 8, + 12, + 5, + 9, + 3, + 20, + 12, + 5, + 7, + 11, + 4, + 13, + 12, + 7, + 10, + 9, + 9, + 13, + 10, + 5, + 14, + 18, + 13, + 13, + 11, + 11, + 18, + 5, + 5, + 8, + 8, + 11, + 11, + 3, + 7, + 11, + 9, + 23, + 11, + 10, + 7, + 1, + 9, + 20, + 20, + 10, + 12, + 8, + 8, + 13, + 21, + 8, + 7, + 15 + ], + "weighted_loads": [ + 1.2139898501336575, + 0.9198179170489311, + 0.32138753682374954, + 0.40150702372193336, + 1.7871187683194876, + 1.0051715299487114, + 1.132369976490736, + 0.26851264014840126, + 0.7844171337783337, + 1.416027458384633, + 0.5663810018450022, + 0.7162230322137475, + 0.21376118808984756, + 0.3463907949626446, + 0.45262644067406654, + 1.3595051746815443, + 0.6393811143934727, + 0.21184934675693512, + 0.500379528850317, + 0.5532082580029964, + 0.23086653277277946, + 1.0455870758742094, + 1.813698111101985, + 0.4379209354519844, + 0.4204396139830351, + 0.709363067522645, + 0.6211600508540869, + 0.8035409059375525, + 0.38861597143113613, + 0.20725075528025627, + 0.9130263105034828, + 1.4543136339634657, + 0.7854796331375837, + 1.321712994016707, + 0.8851928655058146, + 0.6234319638460875, + 1.493002975359559, + 0.8177985846996307, + 0.3110523074865341, + 0.5232209824025631, + 0.6071262303739786, + 0.7378494590520859, + 0.6770423911511898, + 0.1628151312470436, + 0.5507282391190529, + 0.8094000853598118, + 0.6528970412909985, + 1.793428234755993, + 0.8512058537453413, + 0.4130524042993784, + 1.042389051988721, + 0.05068482086062431, + 0.6071085035800934, + 1.6904046516865492, + 1.321016876026988, + 0.553051920607686, + 1.2546878904104233, + 0.5873189121484756, + 0.7757686041295528, + 1.049938853830099, + 1.8010486867278814, + 1.1572126969695091, + 0.2931574173271656, + 1.0843681674450636 + ], + "unique_experts": 64, + "load_cv": 0.4623558582646061, + "normalized_load_entropy": 0.9743763157308244, + "max_load_share": 0.035398230088495575 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "d593944c41bf38d6800a60aa4618513007608543520a269e87e3a312733c6abb", + "route_weight_sha256": "2a24087c5dda51f4751ce4f067646243e8ab6ba725eb505c44f4905178e0f0b9", + "loads": [ + 16, + 21, + 7, + 10, + 25, + 15, + 12, + 8, + 19, + 17, + 15, + 12, + 6, + 11, + 12, + 21, + 15, + 5, + 7, + 17, + 8, + 23, + 13, + 7, + 16, + 10, + 9, + 16, + 14, + 5, + 15, + 20, + 13, + 13, + 20, + 29, + 18, + 6, + 11, + 11, + 8, + 11, + 22, + 4, + 10, + 11, + 16, + 30, + 13, + 11, + 8, + 10, + 10, + 23, + 20, + 10, + 16, + 14, + 10, + 25, + 32, + 15, + 18, + 29 + ], + "weighted_loads": [ + 1.7332929484546185, + 1.9250725843012333, + 0.34685766138136387, + 1.1946916729211807, + 1.8173595741391182, + 1.1467507258057594, + 1.132369976490736, + 0.4913860894739628, + 1.600877931341529, + 1.53285207785666, + 0.8716780077666044, + 0.7162230322137475, + 0.24147947132587433, + 0.39329705759882927, + 0.9299733396619558, + 1.3919126708060503, + 0.731676334515214, + 0.21184934675693512, + 0.500379528850317, + 1.2860977873206139, + 0.5457649007439613, + 1.8390474952757359, + 1.8525453303009272, + 0.4379209354519844, + 0.703729247674346, + 0.7596678901463747, + 0.6211600508540869, + 1.4501194711774588, + 0.6546277236193419, + 0.20725075528025627, + 0.9469564743340015, + 1.497271278873086, + 0.7854796331375837, + 1.321712994016707, + 1.252327224239707, + 2.4536224100738764, + 1.493002975359559, + 0.8596379309892654, + 0.5792668387293816, + 0.8767445124685764, + 0.6071262303739786, + 0.7378494590520859, + 1.9255293440073729, + 0.34364668279886246, + 1.2006296142935753, + 0.8094000853598118, + 1.267615806311369, + 2.1668290682137012, + 0.9200585205107927, + 0.4559674207121134, + 1.068578453734517, + 1.0138114504516125, + 0.7833226770162582, + 1.873665178194642, + 1.321016876026988, + 0.553051920607686, + 1.5088341534137726, + 0.8572966083884239, + 0.8864084482192993, + 1.5329771284013987, + 2.5080189555883408, + 1.6348698884248734, + 1.2155531775206327, + 2.355600882321596 + ], + "unique_experts": 64, + "load_cv": 0.4481930890061662, + "normalized_load_entropy": 0.9766203744736915, + "max_load_share": 0.03463203463203463 + } + }, + "s0_x": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "bb9e8ce221ef1e6286792cc13d4ad935e4d0ea16649beefee91dc8e1035159e3", + "route_weight_sha256": "3d33b9853f2690643c201112eb9773cf33ca49abb5d677e466d5c99ed520d633", + "loads": [ + 12, + 8, + 6, + 7, + 23, + 14, + 9, + 5, + 10, + 16, + 8, + 12, + 5, + 8, + 7, + 18, + 13, + 5, + 8, + 10, + 4, + 12, + 11, + 7, + 9, + 9, + 9, + 13, + 11, + 5, + 12, + 17, + 13, + 12, + 11, + 12, + 16, + 5, + 6, + 8, + 7, + 11, + 12, + 3, + 9, + 12, + 10, + 23, + 10, + 11, + 8, + 3, + 9, + 21, + 20, + 10, + 12, + 8, + 8, + 13, + 19, + 8, + 9, + 16 + ], + "weighted_loads": [ + 1.3001432456076145, + 0.8571769427508116, + 0.32732950523495674, + 0.3842336777597666, + 1.747902611270547, + 1.0068878959864378, + 1.0196757968515158, + 0.28526866994798183, + 0.7559238448739052, + 1.4125098250806332, + 0.5434947237372398, + 0.7055157264694571, + 0.21026502177119255, + 0.31742413714528084, + 0.6136816181242466, + 1.2071892526000738, + 0.6687171850353479, + 0.22559796646237373, + 0.5325779281556606, + 0.5593609362840652, + 0.23221785575151443, + 1.0099104326218367, + 1.722238551825285, + 0.447725934907794, + 0.4019505511969328, + 0.731070464476943, + 0.6333728656172752, + 0.812107415869832, + 0.4101183842867613, + 0.22443876042962074, + 0.8392355479300022, + 1.3608366772532463, + 0.8112891986966133, + 1.0927289631217718, + 0.8857899717986584, + 0.6493917927145958, + 1.3511311654001474, + 0.7974454797804356, + 0.3354568798094988, + 0.5316873788833618, + 0.5214101914316416, + 0.7147518079727888, + 0.6972295716404915, + 0.17825203388929367, + 0.6145581100136042, + 0.882262472063303, + 0.6599348373711109, + 1.7709157783538103, + 0.813959039747715, + 0.447615722194314, + 1.0845999717712402, + 0.10574301518499851, + 0.6336659826338291, + 1.7044701278209686, + 1.2646825090050697, + 0.5183171592652798, + 1.2426579147577286, + 0.611287783831358, + 0.7751523666083813, + 1.0624727830290794, + 1.7243429813534021, + 1.1920946091413498, + 0.41619932278990746, + 1.0915335603058338 + ], + "unique_experts": 64, + "load_cv": 0.42566892961931174, + "normalized_load_entropy": 0.978985502648963, + "max_load_share": 0.03392330383480826 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "ed531eff54b08ebbf9f9a97860e7feb11e9cf815ab73cbcb1f7a5deff1108ede", + "route_weight_sha256": "4b87e9ac54d75b657fa304fc9e3ec28523ae2d55a07f2192289a3b4476392ad6", + "loads": [ + 12, + 18, + 6, + 8, + 23, + 14, + 10, + 7, + 13, + 16, + 13, + 13, + 6, + 8, + 14, + 18, + 14, + 5, + 8, + 14, + 8, + 22, + 11, + 7, + 11, + 9, + 9, + 15, + 13, + 5, + 12, + 17, + 13, + 12, + 16, + 27, + 16, + 5, + 9, + 8, + 7, + 11, + 19, + 3, + 9, + 12, + 12, + 28, + 11, + 11, + 8, + 9, + 9, + 21, + 20, + 10, + 12, + 15, + 17, + 17, + 31, + 11, + 14, + 26 + ], + "weighted_loads": [ + 1.3001432456076145, + 1.806116545572877, + 0.32732950523495674, + 1.1128925327211618, + 1.747902611270547, + 1.0068878959864378, + 1.054718853905797, + 0.4487244877964258, + 1.0153409130871296, + 1.4125098250806332, + 0.7783913426101208, + 0.740670464001596, + 0.24023711495101452, + 0.31742413714528084, + 0.8875943310558796, + 1.2071892526000738, + 0.6996322125196457, + 0.22559796646237373, + 0.5325779281556606, + 1.2804742455482483, + 0.575291458517313, + 2.0124739911407232, + 1.722238551825285, + 0.447725934907794, + 0.5197234880179167, + 0.731070464476943, + 0.6333728656172752, + 1.0543651152402163, + 0.6705457400530577, + 0.22443876042962074, + 0.8392355479300022, + 1.3608366772532463, + 0.8112891986966133, + 1.0927289631217718, + 1.110530223697424, + 2.633698958903551, + 1.3511311654001474, + 0.7974454797804356, + 0.43011710327118635, + 0.5316873788833618, + 0.5214101914316416, + 0.7147518079727888, + 1.4155852422118187, + 0.17825203388929367, + 0.6145581100136042, + 0.882262472063303, + 0.7266137730330229, + 2.0577346738427877, + 0.8393678907305002, + 0.447615722194314, + 1.0845999717712402, + 0.6988477874547243, + 0.6336659826338291, + 1.7044701278209686, + 1.2646825090050697, + 0.5183171592652798, + 1.2426579147577286, + 0.9912524074316025, + 1.2674454860389233, + 1.243994863703847, + 2.6416602209210396, + 1.3571527414023876, + 0.8464286848902702, + 1.7356405667960644 + ], + "unique_experts": 64, + "load_cv": 0.45046852108903995, + "normalized_load_entropy": 0.9769425021752794, + "max_load_share": 0.03743961352657005 + } + }, + "s1_x": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "8d58d454da9157f639c9c90ccddef138a7881da87d6a5bc2e8246ab9560d3846", + "route_weight_sha256": "60005a0958ddddbbd73d3176fc2427071b2ac3f21c6e6593c0354e5d3084ecbc", + "loads": [ + 12, + 8, + 6, + 7, + 24, + 14, + 11, + 4, + 10, + 16, + 8, + 12, + 7, + 9, + 3, + 18, + 12, + 5, + 6, + 11, + 4, + 13, + 12, + 6, + 10, + 11, + 10, + 13, + 9, + 5, + 14, + 17, + 13, + 14, + 10, + 12, + 18, + 5, + 5, + 8, + 8, + 10, + 10, + 3, + 8, + 11, + 11, + 24, + 11, + 9, + 8, + 1, + 9, + 20, + 20, + 10, + 12, + 8, + 8, + 13, + 21, + 8, + 8, + 15 + ], + "weighted_loads": [ + 1.2556018084287643, + 0.8518331274390221, + 0.3218979351222515, + 0.3886003792285919, + 1.7626989018172026, + 1.000068435445428, + 1.09317940287292, + 0.26522438786923885, + 0.7918501049280167, + 1.4253472872078419, + 0.5620467606931925, + 0.7246231054887176, + 0.2981331702321768, + 0.34308812767267227, + 0.43121689558029175, + 1.2944463025778532, + 0.6397987958043814, + 0.20417870953679085, + 0.4633927345275879, + 0.5586262494325638, + 0.23371494188904762, + 1.0210325997322798, + 1.832712097093463, + 0.4075928255915642, + 0.41636794432997704, + 0.7695405520498753, + 0.6564848870038986, + 0.8043207488954067, + 0.33877985551953316, + 0.2048870287835598, + 0.8919133078306913, + 1.4134676661342382, + 0.7863552048802376, + 1.3481018878519535, + 0.857798496261239, + 0.6862280461937189, + 1.4894854240119457, + 0.8023486062884331, + 0.3045407049357891, + 0.5209965575486422, + 0.6004149466753006, + 0.6990097686648369, + 0.6392182968556881, + 0.15811840817332268, + 0.577636668458581, + 0.8058607690036297, + 0.725297225639224, + 1.812169460579753, + 0.8540980126708746, + 0.38736227340996265, + 1.0704065319150686, + 0.04661120846867561, + 0.6118663176894188, + 1.6851036697626114, + 1.3335921671241522, + 0.5554269179701805, + 1.2288816291838884, + 0.6000922583043575, + 0.7676777876913548, + 1.0651986878365278, + 1.760458093136549, + 1.1551193557679653, + 0.3066409919410944, + 1.046374574303627 + ], + "unique_experts": 64, + "load_cv": 0.4575125191797325, + "normalized_load_entropy": 0.97494590426279, + "max_load_share": 0.035398230088495575 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "b28955e0a75a021b4f3308ecb65d6ceab267b61eef588727f760341104e25cf9", + "route_weight_sha256": "713b5181c6341409a3da9119e723bb082e46e787aabb993dbba9148a2c3d85d1", + "loads": [ + 16, + 19, + 7, + 9, + 25, + 15, + 11, + 8, + 19, + 17, + 17, + 13, + 8, + 11, + 11, + 19, + 15, + 5, + 6, + 17, + 8, + 24, + 13, + 6, + 16, + 12, + 10, + 16, + 13, + 5, + 15, + 19, + 13, + 14, + 19, + 30, + 18, + 6, + 10, + 11, + 8, + 10, + 20, + 4, + 11, + 11, + 18, + 32, + 13, + 10, + 9, + 9, + 10, + 23, + 20, + 10, + 16, + 14, + 11, + 25, + 33, + 15, + 18, + 28 + ], + "weighted_loads": [ + 1.7749049067497253, + 1.8570877946913242, + 0.34736805967986584, + 1.149351492524147, + 1.7929397076368332, + 1.141647631302476, + 1.09317940287292, + 0.48320996575057507, + 1.6023473981767893, + 1.5421719066798687, + 0.9812502544373274, + 0.7595077371224761, + 0.3244545999914408, + 0.38998207077383995, + 0.8770244028419256, + 1.3268537987023592, + 0.737578859552741, + 0.20417870953679085, + 0.4633927345275879, + 1.296866100281477, + 0.5512146633118391, + 2.096266184002161, + 1.8715593162924051, + 0.4075928255915642, + 0.6979471184313297, + 0.819845374673605, + 0.6564848870038986, + 1.4555940888822079, + 0.6047100089490414, + 0.2048870287835598, + 0.9258434716612101, + 1.4564253110438585, + 0.7863552048802376, + 1.3481018878519535, + 1.2249328549951315, + 2.482799058780074, + 1.4894854240119457, + 0.8441879525780678, + 0.4568127207458019, + 0.8745200876146555, + 0.6004149466753006, + 0.6990097686648369, + 1.8217317126691341, + 0.3389499597251415, + 1.2275380436331034, + 0.8058607690036297, + 1.3390446286648512, + 2.215278809890151, + 0.922950679436326, + 0.43027728982269764, + 1.0965959336608648, + 0.9499771259725094, + 0.7880804911255836, + 1.8683641962707043, + 1.3335921671241522, + 0.5554269179701805, + 1.4830278921872377, + 0.8697970323264599, + 0.9842947646975517, + 1.5537323970347643, + 2.5150366965681314, + 1.6322959922254086, + 1.1750802844762802, + 2.0523621048778296 + ], + "unique_experts": 64, + "load_cv": 0.45235506046577706, + "normalized_load_entropy": 0.9763979679957857, + "max_load_share": 0.03571428571428571 + } + }, + "s0_period": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "7a2311c2c84f1dfb46b73041843078e92e518943725c6f0643b02418c2386c97", + "route_weight_sha256": "13d100e53fa84d07f03fc281a71f06f4cc6526cd0cb2fe1b5798668ccb5f3a12", + "loads": [ + 12, + 9, + 5, + 7, + 24, + 14, + 9, + 5, + 10, + 16, + 8, + 12, + 5, + 8, + 7, + 18, + 13, + 5, + 8, + 10, + 4, + 12, + 11, + 7, + 9, + 8, + 8, + 12, + 11, + 5, + 13, + 17, + 13, + 12, + 11, + 12, + 16, + 5, + 6, + 8, + 7, + 11, + 12, + 3, + 9, + 12, + 9, + 23, + 10, + 11, + 8, + 3, + 9, + 21, + 20, + 10, + 12, + 8, + 9, + 13, + 19, + 8, + 11, + 15 + ], + "weighted_loads": [ + 1.2903693169355392, + 0.8748083338141441, + 0.2945513501763344, + 0.3795353639870882, + 1.7830105666071177, + 1.005855130031705, + 1.0214022248983383, + 0.2857730593532324, + 0.7468097098171711, + 1.4065504781901836, + 0.5445968527346849, + 0.7080021221190691, + 0.20885652676224709, + 0.31952323392033577, + 0.6182381641119719, + 1.2120620775967836, + 0.6757689863443375, + 0.22051734291017056, + 0.5317062437534332, + 0.5575252436101437, + 0.2311481572687626, + 1.0074696205556393, + 1.7202477157115936, + 0.4487274568527937, + 0.40263273380696774, + 0.694177832454443, + 0.6019102521240711, + 0.7808296103030443, + 0.4099295809864998, + 0.2261948138475418, + 0.8686237800866365, + 1.3626349307596684, + 0.8143956623971462, + 1.1133863339200616, + 0.8900217786431313, + 0.6430769339203835, + 1.3558271173387766, + 0.7941402494907379, + 0.331907669082284, + 0.530536200851202, + 0.5259446129202843, + 0.7180023398250341, + 0.6976963989436626, + 0.1760544218122959, + 0.6177188381552696, + 0.8761108666658401, + 0.6225830838084221, + 1.758747247979045, + 0.8124919086694717, + 0.4476670175790787, + 1.0821078307926655, + 0.10381517373025417, + 0.6312347799539566, + 1.7016731891781092, + 1.2691413387656212, + 0.5196984689682722, + 1.2480082660913467, + 0.6089079566299915, + 0.7938594948500395, + 1.0634950324892998, + 1.7110734730958939, + 1.1925340108573437, + 0.4842170048505068, + 1.056099435314536 + ], + "unique_experts": 64, + "load_cv": 0.4298998902609776, + "normalized_load_entropy": 0.9786082002181933, + "max_load_share": 0.035398230088495575 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "6dbdb63cef857741cadd4339f206fbbeb34180d43211ebac36689619fc5c3140", + "route_weight_sha256": "ba1ac41629c6bf916038469a21373cad251d4b2de2f555a4b10bed979ef9fea1", + "loads": [ + 13, + 19, + 5, + 9, + 24, + 14, + 9, + 7, + 14, + 16, + 11, + 12, + 5, + 8, + 14, + 19, + 13, + 5, + 8, + 14, + 8, + 21, + 11, + 7, + 12, + 8, + 8, + 14, + 13, + 5, + 13, + 17, + 13, + 13, + 16, + 26, + 16, + 5, + 10, + 8, + 7, + 11, + 19, + 3, + 9, + 12, + 12, + 28, + 12, + 11, + 8, + 9, + 9, + 21, + 20, + 10, + 12, + 15, + 17, + 17, + 32, + 11, + 16, + 24 + ], + "weighted_loads": [ + 1.583320751786232, + 1.8237479366362095, + 0.2945513501763344, + 1.1410220470279455, + 1.7830105666071177, + 1.005855130031705, + 1.0214022248983383, + 0.445515314117074, + 1.0502821765840054, + 1.4065504781901836, + 0.6702433656901121, + 0.7080021221190691, + 0.20885652676224709, + 0.31952323392033577, + 0.8902361746877432, + 1.2568950448185205, + 0.6757689863443375, + 0.22051734291017056, + 0.5317062437534332, + 1.301710482686758, + 0.5161238461732864, + 1.8802701644599438, + 1.7202477157115936, + 0.4487274568527937, + 0.550646772608161, + 0.694177832454443, + 0.6019102521240711, + 1.0261676330119371, + 0.6415497213602066, + 0.2261948138475418, + 0.8686237800866365, + 1.3626349307596684, + 0.8143956623971462, + 1.16204531211406, + 1.1147620305418968, + 2.5656020119786263, + 1.3558271173387766, + 0.7941402494907379, + 0.4866881584748626, + 0.530536200851202, + 0.5259446129202843, + 0.7180023398250341, + 1.4389013312757015, + 0.1760544218122959, + 0.6177188381552696, + 0.8761108666658401, + 0.7153593264520168, + 2.047384472563863, + 0.8639516420662403, + 0.4476670175790787, + 1.0821078307926655, + 0.6702580507844687, + 0.6312347799539566, + 1.7016731891781092, + 1.2691413387656212, + 0.5196984689682722, + 1.2480082660913467, + 0.987613569945097, + 1.1576309781521559, + 1.2441734969615936, + 2.6346143521368504, + 1.3677936270833015, + 0.9135386738926172, + 1.6543498691171408 + ], + "unique_experts": 64, + "load_cv": 0.45336047297175436, + "normalized_load_entropy": 0.9764134445834722, + "max_load_share": 0.03864734299516908 + } + }, + "s1_period": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "8e8918ea80f8ec798d13df29bef88ef2bd429f242243cd79ff0815a12ab110d3", + "route_weight_sha256": "49e06ba81d6a83e29caea102174683548217fb581898a30c631989b0da84a806", + "loads": [ + 12, + 8, + 5, + 7, + 24, + 14, + 11, + 4, + 10, + 16, + 8, + 12, + 7, + 9, + 3, + 20, + 13, + 5, + 6, + 11, + 4, + 13, + 11, + 7, + 10, + 10, + 10, + 13, + 9, + 5, + 14, + 18, + 13, + 13, + 11, + 12, + 18, + 5, + 4, + 8, + 8, + 12, + 11, + 3, + 8, + 11, + 10, + 23, + 12, + 9, + 7, + 1, + 9, + 20, + 20, + 10, + 12, + 8, + 8, + 13, + 20, + 8, + 8, + 14 + ], + "weighted_loads": [ + 1.2470287084579468, + 0.8501687832176685, + 0.2889111712574959, + 0.38985327258706093, + 1.7620613500475883, + 0.9987250305712223, + 1.0946335885673761, + 0.26574521139264107, + 0.7819512821733952, + 1.4251801911741495, + 0.5634691137820482, + 0.7259439900517464, + 0.2956359051167965, + 0.34289237670600414, + 0.4273205101490021, + 1.3578625041991472, + 0.666296923533082, + 0.20414666086435318, + 0.463820468634367, + 0.5581010952591896, + 0.23382487520575523, + 1.0199110079556704, + 1.7946354821324348, + 0.4348279181867838, + 0.4181716311722994, + 0.7309970464557409, + 0.6550763957202435, + 0.8033828604966402, + 0.34285879880189896, + 0.2060367316007614, + 0.8913131766021252, + 1.4473844189196825, + 0.7916999198496342, + 1.3468017000705004, + 0.8880511745810509, + 0.6831583939492702, + 1.4892646074295044, + 0.8040018528699875, + 0.28338606283068657, + 0.5185041781514883, + 0.6026840023696423, + 0.7656766325235367, + 0.6630575321614742, + 0.1561267040669918, + 0.5779635459184647, + 0.8061795309185982, + 0.6859497707337141, + 1.7695081811398268, + 0.8936206642538309, + 0.38849559240043163, + 1.0399579592049122, + 0.04516907036304474, + 0.6151346042752266, + 1.683019632473588, + 1.3329587057232857, + 0.5582558941096067, + 1.2286410219967365, + 0.5936208181083202, + 0.7603248544037342, + 1.06184540130198, + 1.7167240753769875, + 1.1509284488856792, + 0.31059920229017735, + 0.9998276326805353 + ], + "unique_experts": 64, + "load_cv": 0.45963775985530647, + "normalized_load_entropy": 0.9744968810875915, + "max_load_share": 0.035398230088495575 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "4e01ef814638bbefea659566f557190e6d874d1d1a8a56dbea93475752e7a3b0", + "route_weight_sha256": "452f08a5d025384d5ed3831d97fa5cc0a5a47ccb3c477845c37d8b2d9195bc01", + "loads": [ + 17, + 19, + 6, + 10, + 25, + 15, + 11, + 8, + 20, + 17, + 15, + 12, + 7, + 11, + 11, + 22, + 16, + 5, + 6, + 17, + 8, + 23, + 12, + 7, + 16, + 11, + 10, + 16, + 13, + 5, + 15, + 20, + 13, + 14, + 20, + 28, + 18, + 6, + 10, + 11, + 8, + 12, + 21, + 4, + 11, + 11, + 18, + 31, + 15, + 10, + 8, + 9, + 10, + 23, + 20, + 10, + 16, + 14, + 10, + 25, + 33, + 15, + 18, + 26 + ], + "weighted_loads": [ + 2.0338003784418106, + 1.8554234504699707, + 0.3143812958151102, + 1.1857937686145306, + 1.792302155867219, + 1.1403042264282703, + 1.0946335885673761, + 0.48577769473195076, + 1.634245315566659, + 1.5420048106461763, + 0.8687661197036505, + 0.7259439900517464, + 0.2956359051167965, + 0.38980095461010933, + 0.8694242108613253, + 1.425336441025138, + 0.7631633635610342, + 0.20414666086435318, + 0.463820468634367, + 1.3274220265448093, + 0.5090886242687702, + 1.9212994277477264, + 1.833482701331377, + 0.4348279181867838, + 0.6999033261090517, + 0.7813018690794706, + 0.6550763957202435, + 1.457875119522214, + 0.5788961723446846, + 0.2060367316007614, + 0.9252433404326439, + 1.4903420638293028, + 0.7916999198496342, + 1.3867157381027937, + 1.2551855333149433, + 2.38116766884923, + 1.4892646074295044, + 0.8458411991596222, + 0.5046179667115211, + 0.8720277082175016, + 0.6026840023696423, + 0.7656766325235367, + 1.8632646761834621, + 0.33695825561881065, + 1.227864921092987, + 0.8061795309185982, + 1.3256393168121576, + 2.177156852558255, + 0.986979654058814, + 0.4314106088131666, + 1.0661473609507084, + 0.905496209859848, + 0.7913487777113914, + 1.8662801589816809, + 1.3329587057232857, + 0.5582558941096067, + 1.4827872850000858, + 0.862940039485693, + 0.8709646984934807, + 1.5540458355098963, + 2.4880945570766926, + 1.6396571435034275, + 1.179645113646984, + 1.948257613927126 + ], + "unique_experts": 64, + "load_cv": 0.447356048236377, + "normalized_load_entropy": 0.9765592513686546, + "max_load_share": 0.03571428571428571 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 113, + "ordered_topk_exact_tokens": 85, + "set_exact_tokens": 98, + "mean_set_jaccard": 0.9620733249051834, + "mean_token_weighted_tv": 0.008283837104990947, + "aggregate_load_tv": 0.017699115044247787 + }, + "system_bos": { + "tokens": 113, + "ordered_topk_exact_tokens": 69, + "set_exact_tokens": 84, + "mean_set_jaccard": 0.9266750948166879, + "mean_token_weighted_tv": 0.016978048546388087, + "aggregate_load_tv": 0.030973451327433628 + }, + "system_x": { + "tokens": 113, + "ordered_topk_exact_tokens": 64, + "set_exact_tokens": 79, + "mean_set_jaccard": 0.9140328697850824, + "mean_token_weighted_tv": 0.02072923596684648, + "aggregate_load_tv": 0.0368731563421829 + }, + "system_period": { + "tokens": 113, + "ordered_topk_exact_tokens": 62, + "set_exact_tokens": 80, + "mean_set_jaccard": 0.9146649810366625, + "mean_token_weighted_tv": 0.020659981530357516, + "aggregate_load_tv": 0.038348082595870206 + }, + "bos_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 53, + "set_exact_tokens": 74, + "mean_set_jaccard": 0.8938053097345132, + "mean_token_weighted_tv": 0.02512209286781407, + "aggregate_load_tv": 0.04424778761061947 + }, + "bos_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 57, + "set_exact_tokens": 74, + "mean_set_jaccard": 0.8975979772439949, + "mean_token_weighted_tv": 0.024596805210365395, + "aggregate_load_tv": 0.045722713864306784 + }, + "x_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 57, + "set_exact_tokens": 78, + "mean_set_jaccard": 0.9058154235145386, + "mean_token_weighted_tv": 0.022000965110100475, + "aggregate_load_tv": 0.03687315634218289 + }, + "x_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 58, + "set_exact_tokens": 76, + "mean_set_jaccard": 0.9007585335018965, + "mean_token_weighted_tv": 0.024138355693590324, + "aggregate_load_tv": 0.04129793510324484 + }, + "period_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 56, + "set_exact_tokens": 79, + "mean_set_jaccard": 0.9083438685208597, + "mean_token_weighted_tv": 0.02137335534083896, + "aggregate_load_tv": 0.04129793510324484 + }, + "period_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 56, + "set_exact_tokens": 76, + "mean_set_jaccard": 0.9007585335018964, + "mean_token_weighted_tv": 0.023909700239093695, + "aggregate_load_tv": 0.04129793510324484 + } + } + }, + "layer_03": { + "layer": 3, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "8610a4200590c4deaaa179e071c01fef9ea0c94e6db8d45fa602d5c4251edbfe", + "route_weight_sha256": "fbeaeea5525b26b0d60dc1a01fe986f5bc2f49f31e619b64cbf21b1fa3e42d22", + "loads": [ + 2, + 14, + 7, + 11, + 7, + 12, + 6, + 4, + 11, + 12, + 9, + 16, + 6, + 6, + 16, + 11, + 11, + 13, + 6, + 10, + 18, + 12, + 9, + 10, + 7, + 12, + 2, + 8, + 15, + 2, + 10, + 10, + 24, + 5, + 7, + 6, + 9, + 17, + 10, + 17, + 10, + 16, + 1, + 18, + 10, + 13, + 18, + 16, + 7, + 7, + 34, + 2, + 8, + 5, + 10, + 14, + 13, + 13, + 5, + 11, + 11, + 16, + 18, + 2 + ], + "weighted_loads": [ + 0.08814897388219833, + 1.1043955013155937, + 0.4455699734389782, + 0.7405131831765175, + 0.4496558550745249, + 0.7000440899282694, + 0.23834986612200737, + 0.25241008028388023, + 0.7750371266156435, + 0.671327967196703, + 1.1559685170650482, + 0.8945362530648708, + 0.3591437377035618, + 0.30926375463604927, + 2.043415602296591, + 1.3456047251820564, + 0.7572074215859175, + 1.0657993648201227, + 0.2536870576441288, + 0.6189726945012808, + 1.3211510851979256, + 0.9494247436523438, + 0.5295337587594986, + 0.9707304257899523, + 0.5199023522436619, + 0.9612938426434994, + 0.07666663825511932, + 0.5890651028603315, + 1.2034997083246708, + 0.13288690894842148, + 0.9432330392301083, + 0.44116015546023846, + 1.9947272203862667, + 0.34938162937760353, + 1.0108899623155594, + 0.2849382497370243, + 0.34352363273501396, + 1.0005111582577229, + 0.8734832741320133, + 1.6175800487399101, + 0.577646266669035, + 1.44739094004035, + 0.032675690948963165, + 1.7558037899434566, + 0.9545713253319263, + 1.2698316238820553, + 1.1847308650612831, + 1.3161971122026443, + 0.3697753958404064, + 0.6871449463069439, + 2.8420648146420717, + 0.18051773123443127, + 0.8064396753907204, + 0.40550729259848595, + 1.2141683660447598, + 1.1723427139222622, + 1.6236082706600428, + 0.4754192717373371, + 0.2892104908823967, + 0.6071649305522442, + 0.4818867966532707, + 1.3162374384701252, + 1.8335256949067116, + 0.08815117180347443 + ], + "unique_experts": 64, + "load_cv": 0.5349490627476604, + "normalized_load_entropy": 0.9657824395081648, + "max_load_share": 0.05014749262536873 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "be3332afefd73eb84b7a6144522fe3da1590c50f3bef0fdd250319078a691b89", + "route_weight_sha256": "6c7515b2c5f8df85e463b7d846999c603c6d1d77a33d5d9cd896d4cdf4174b99", + "loads": [ + 11, + 14, + 7, + 21, + 10, + 15, + 6, + 12, + 11, + 17, + 11, + 17, + 8, + 10, + 23, + 11, + 11, + 13, + 6, + 10, + 20, + 14, + 13, + 12, + 7, + 14, + 2, + 14, + 15, + 5, + 11, + 10, + 24, + 5, + 16, + 6, + 9, + 17, + 10, + 17, + 10, + 17, + 11, + 18, + 10, + 15, + 30, + 16, + 14, + 17, + 35, + 2, + 9, + 5, + 15, + 15, + 13, + 14, + 6, + 11, + 19, + 16, + 21, + 4 + ], + "weighted_loads": [ + 1.4192206040024757, + 1.1043955013155937, + 0.4455699734389782, + 1.3297344669699669, + 0.5285133001161739, + 0.8710028287023306, + 0.23834986612200737, + 1.5334779918193817, + 0.7750371266156435, + 0.9127481819014065, + 1.2289321757853031, + 0.8954158620908856, + 0.3710678250354249, + 0.6626562215387821, + 2.558222610503435, + 1.3456047251820564, + 0.7572074215859175, + 1.0657993648201227, + 0.2536870576441288, + 0.6189726945012808, + 1.389810549095273, + 1.1157871410250664, + 0.8601634167134762, + 1.0284560918807983, + 0.5199023522436619, + 0.9748470005579293, + 0.07666663825511932, + 0.8137225899845362, + 1.2034997083246708, + 0.2800425700843334, + 0.9901626668870449, + 0.44116015546023846, + 1.9947272203862667, + 0.34938162937760353, + 2.047143794596195, + 0.2849382497370243, + 0.34352363273501396, + 1.0005111582577229, + 0.8734832741320133, + 1.6175800487399101, + 0.577646266669035, + 1.4587178071960807, + 0.6307468004524708, + 1.7558037899434566, + 0.9545713253319263, + 1.3932122774422169, + 2.7836224548518658, + 1.3161971122026443, + 1.1247998885810375, + 1.3020375482738018, + 2.8962098825722933, + 0.18051773123443127, + 0.8210413996130228, + 0.40550729259848595, + 3.206452611833811, + 1.2502006776630878, + 1.6236082706600428, + 0.4881095727905631, + 0.324651338160038, + 0.6071649305522442, + 1.0707102362066507, + 1.3162374384701252, + 2.1595487147569656, + 0.1595315933227539 + ], + "unique_experts": 64, + "load_cv": 0.46514991408945033, + "normalized_load_entropy": 0.9743161693824962, + "max_load_share": 0.042270531400966184 + } + }, + "s1_eos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "59a0cf2b6fbe54a148c34e6abc6fd58264bb549c3393617659ec7b72b7cddb31", + "route_weight_sha256": "5f57d120a0e0520c6b153a2070d944e855852a0ea14b995c4520708f96df8366", + "loads": [ + 2, + 14, + 7, + 12, + 7, + 13, + 6, + 4, + 11, + 11, + 9, + 15, + 6, + 5, + 16, + 12, + 11, + 13, + 6, + 10, + 18, + 12, + 9, + 11, + 7, + 12, + 2, + 8, + 16, + 2, + 10, + 10, + 24, + 5, + 8, + 5, + 9, + 17, + 10, + 17, + 10, + 16, + 1, + 17, + 10, + 13, + 17, + 16, + 7, + 7, + 34, + 2, + 8, + 5, + 10, + 13, + 14, + 13, + 5, + 12, + 10, + 16, + 18, + 2 + ], + "weighted_loads": [ + 0.08584564179182053, + 1.0934759303927422, + 0.44359051808714867, + 0.7661150544881821, + 0.44794722832739353, + 0.7500055525451899, + 0.2391734141856432, + 0.252227108925581, + 0.7677481360733509, + 0.6316709257662296, + 1.1568679846823215, + 0.8744641281664371, + 0.3586242254823446, + 0.2813643701374531, + 2.03692989051342, + 1.4107287749648094, + 0.7657789047807455, + 1.0763183552771807, + 0.2518801037222147, + 0.6191379800438881, + 1.3011974655091763, + 0.9622106179594994, + 0.5334632657468319, + 1.0023382157087326, + 0.5232969708740711, + 0.9676497392356396, + 0.07676158100366592, + 0.5899395495653152, + 1.2730677910149097, + 0.13022495433688164, + 0.9414462558925152, + 0.44194612838327885, + 2.0147406421601772, + 0.3428857885301113, + 1.026470785960555, + 0.24768859706819057, + 0.34413216821849346, + 1.0255917087197304, + 0.8842173777520657, + 1.6142334938049316, + 0.582002080976963, + 1.4440412186086178, + 0.030766084790229797, + 1.7101147547364235, + 0.9502034354954958, + 1.2460477240383625, + 1.1687840670347214, + 1.3260768428444862, + 0.3770965076982975, + 0.6802084557712078, + 2.8313957136124372, + 0.180276645347476, + 0.792748212814331, + 0.4096313491463661, + 1.2362082675099373, + 1.147073969244957, + 1.653331022709608, + 0.46998852118849754, + 0.2819400876760483, + 0.6515154484659433, + 0.42362701892852783, + 1.3180155660957098, + 1.8444133140146732, + 0.09062907472252846 + ], + "unique_experts": 64, + "load_cv": 0.5341677108103174, + "normalized_load_entropy": 0.9656785914818933, + "max_load_share": 0.05014749262536873 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "589edb9857449e0878f804ceac16cd2e4bd2bdbdf7a556e7daa5f95da3231278", + "route_weight_sha256": "5e574147b2661036b5d77e60421249e58818706067ce850c6a661938da5fa7d4", + "loads": [ + 15, + 16, + 7, + 23, + 9, + 18, + 6, + 15, + 11, + 19, + 12, + 16, + 10, + 10, + 25, + 13, + 13, + 13, + 7, + 10, + 20, + 17, + 18, + 12, + 9, + 15, + 2, + 11, + 16, + 5, + 11, + 10, + 24, + 7, + 16, + 5, + 9, + 22, + 10, + 18, + 11, + 17, + 16, + 19, + 10, + 18, + 33, + 16, + 16, + 17, + 35, + 8, + 12, + 10, + 16, + 18, + 14, + 14, + 13, + 13, + 24, + 17, + 23, + 9 + ], + "weighted_loads": [ + 1.7808852307498455, + 1.167781751602888, + 0.44359051808714867, + 1.422420296818018, + 0.49924232333432883, + 1.018436485901475, + 0.2391734141856432, + 1.6185870189219713, + 0.7677481360733509, + 1.0538501084665768, + 1.2420406509190798, + 0.875343737192452, + 0.44793309763190337, + 0.6953482180833817, + 2.7301559560000896, + 1.459928222000599, + 0.9803098123520613, + 1.0763183552771807, + 0.30712644197046757, + 0.6191379800438881, + 1.3675706125795841, + 1.2240016125142574, + 1.3748825043439865, + 1.0321498289704323, + 0.6266159303486347, + 1.0244888518936932, + 0.07676158100366592, + 0.6861121896654367, + 1.2730677910149097, + 0.26990843936800957, + 0.9827100783586502, + 0.44194612838327885, + 2.0147406421601772, + 0.4156319499015808, + 1.943521263077855, + 0.24768859706819057, + 0.34413216821849346, + 1.4434712640941143, + 0.8842173777520657, + 1.6644629836082458, + 0.6568230390548706, + 1.452879031188786, + 0.760128416121006, + 1.7836544811725616, + 0.9502034354954958, + 1.6115207187831402, + 3.3424200899899006, + 1.3260768428444862, + 1.4440325498580933, + 1.1451022885739803, + 2.8806522507220507, + 0.9601177629083395, + 1.0029918001964688, + 1.1260246858000755, + 3.327549397945404, + 1.4589816462248564, + 1.653331022709608, + 0.47900614235550165, + 0.8047396615147591, + 0.6821664571762085, + 1.2869487144052982, + 1.3680536542087793, + 2.257288586348295, + 0.5333637334406376 + ], + "unique_experts": 64, + "load_cv": 0.42342442563379495, + "normalized_load_entropy": 0.9788971334902337, + "max_load_share": 0.03787878787878788 + } + }, + "s0_bos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "9724ed2c2e0c585122c939003331f271b6f67557ec1affbd843f94305b083bdf", + "route_weight_sha256": "98de73fac44b726bc7f2fc4e290ac810eea34f58736062d61faa7bdc5bfafd13", + "loads": [ + 2, + 14, + 7, + 12, + 7, + 12, + 5, + 5, + 12, + 10, + 9, + 19, + 6, + 7, + 16, + 12, + 9, + 13, + 6, + 9, + 18, + 12, + 8, + 11, + 8, + 12, + 2, + 8, + 15, + 2, + 10, + 7, + 23, + 5, + 8, + 7, + 8, + 17, + 10, + 17, + 11, + 15, + 2, + 18, + 9, + 15, + 17, + 17, + 7, + 6, + 36, + 2, + 8, + 5, + 11, + 14, + 13, + 10, + 5, + 10, + 12, + 15, + 18, + 2 + ], + "weighted_loads": [ + 0.08295648545026779, + 1.1187514960765839, + 0.43340643867850304, + 0.79853580519557, + 0.45555152371525764, + 0.6608870774507523, + 0.20349366031587124, + 0.2685241065919399, + 0.7944137807935476, + 0.583137784153223, + 1.182255793362856, + 1.0229561422020197, + 0.3663814924657345, + 0.35599055141210556, + 2.016292069107294, + 1.4220135491341352, + 0.6824209298938513, + 1.0607825294137, + 0.23756710067391396, + 0.597009290009737, + 1.3062902316451073, + 0.9650948829948902, + 0.4755161590874195, + 1.014612728729844, + 0.535608047619462, + 0.9430629592388868, + 0.07322748750448227, + 0.5805175248533487, + 1.233035733923316, + 0.1241503618657589, + 0.9365261346101761, + 0.349227549508214, + 1.9245151281356812, + 0.33107802271842957, + 1.0069270115345716, + 0.30644883774220943, + 0.2989233825355768, + 1.0432770401239395, + 0.8914834093302488, + 1.5834410451352596, + 0.6068080589175224, + 1.4254916124045849, + 0.06123148091137409, + 1.7392067983746529, + 0.940204918384552, + 1.3438123185187578, + 1.158907750621438, + 1.374602546915412, + 0.35750490613281727, + 0.6141469813883305, + 3.0779562275856733, + 0.175762340426445, + 0.8280453830957413, + 0.4113040380179882, + 1.253414936363697, + 1.190815281122923, + 1.700534138828516, + 0.3517856150865555, + 0.3072333950549364, + 0.5965550541877747, + 0.5083535276353359, + 1.293717373162508, + 1.8283106982707977, + 0.08360182866454124 + ], + "unique_experts": 64, + "load_cv": 0.546789995174262, + "normalized_load_entropy": 0.9654531962432634, + "max_load_share": 0.05309734513274336 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "254da6a55b287a1a68ac3f57c71844e7213d208a29c9a9d63da3075e96f47d6b", + "route_weight_sha256": "3798ef2f6591d515df830da9831a47f73cb1d94a4fe782544344e397b64fb94b", + "loads": [ + 12, + 14, + 7, + 22, + 10, + 14, + 5, + 14, + 12, + 15, + 11, + 20, + 7, + 11, + 23, + 12, + 9, + 13, + 7, + 9, + 20, + 15, + 13, + 13, + 8, + 13, + 2, + 14, + 15, + 6, + 11, + 7, + 23, + 5, + 16, + 7, + 8, + 17, + 10, + 17, + 11, + 15, + 13, + 18, + 9, + 17, + 29, + 17, + 15, + 16, + 37, + 2, + 8, + 5, + 15, + 16, + 13, + 10, + 6, + 10, + 19, + 15, + 21, + 4 + ], + "weighted_loads": [ + 1.5200119614601135, + 1.1187514960765839, + 0.43340643867850304, + 1.3877570889890194, + 0.5395305984420702, + 0.7570328712463379, + 0.20349366031587124, + 1.5310297422111034, + 0.7944137807935476, + 0.8428670742432587, + 1.2552194520831108, + 1.0238357512280345, + 0.36685747306910343, + 0.7303153276443481, + 2.548483934253454, + 1.4220135491341352, + 0.6824209298938513, + 1.0607825294137, + 0.27371105179190636, + 0.597009290009737, + 1.3781386446207762, + 1.2124567292630672, + 0.858897726982832, + 1.072060488164425, + 0.535608047619462, + 0.9435911974869668, + 0.07322748750448227, + 0.8051750119775534, + 1.233035733923316, + 0.31015191227197647, + 0.9834557622671127, + 0.349227549508214, + 1.9245151281356812, + 0.33107802271842957, + 2.005665263161063, + 0.30644883774220943, + 0.2989233825355768, + 1.0432770401239395, + 0.8914834093302488, + 1.5834410451352596, + 0.6068080589175224, + 1.4254916124045849, + 0.777913635596633, + 1.7392067983746529, + 0.940204918384552, + 1.4702555779367685, + 2.7577993404120207, + 1.374602546915412, + 1.1899532917886972, + 1.2290395833551884, + 3.1264236699789762, + 0.175762340426445, + 0.8280453830957413, + 0.4113040380179882, + 2.5062829330563545, + 1.3481087945401669, + 1.700534138828516, + 0.3517856150865555, + 0.3471342418342829, + 0.5965550541877747, + 0.9772026035934687, + 1.293717373162508, + 2.154333718121052, + 0.15496474504470825 + ], + "unique_experts": 64, + "load_cv": 0.4762559841319863, + "normalized_load_entropy": 0.9733570402979108, + "max_load_share": 0.04468599033816425 + } + }, + "s1_bos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "e84633124924187836af8e54c578401ff6ef14b570d47490447f274d6fdb93a0", + "route_weight_sha256": "c87d83a25eb47e159b944a027552091acadad8bf6bf04438bad0c310b43005ac", + "loads": [ + 2, + 15, + 8, + 12, + 6, + 11, + 6, + 5, + 13, + 10, + 10, + 16, + 6, + 7, + 16, + 12, + 10, + 14, + 4, + 9, + 18, + 11, + 9, + 11, + 6, + 14, + 2, + 7, + 17, + 2, + 10, + 8, + 25, + 5, + 8, + 6, + 9, + 16, + 10, + 17, + 11, + 16, + 1, + 18, + 9, + 15, + 18, + 16, + 7, + 6, + 36, + 2, + 8, + 5, + 10, + 13, + 14, + 12, + 4, + 12, + 8, + 15, + 17, + 2 + ], + "weighted_loads": [ + 0.07718052342534065, + 1.162921231240034, + 0.476915180683136, + 0.7973973117768764, + 0.4296656660735607, + 0.6147272661328316, + 0.22813740745186806, + 0.27016428858041763, + 0.8324912320822477, + 0.5507519356906414, + 1.2122898027300835, + 0.943191472440958, + 0.3687174152582884, + 0.3465677946805954, + 2.0268551521003246, + 1.44986255094409, + 0.7239296324551105, + 1.1139755249023438, + 0.18278010562062263, + 0.577603105455637, + 1.267395455390215, + 0.9232773631811142, + 0.5345389246940613, + 1.0329885445535183, + 0.4733853340148926, + 0.9744893293827772, + 0.07481546327471733, + 0.542250495404005, + 1.3881647866219282, + 0.12832308188080788, + 0.9246474355459213, + 0.38251789286732674, + 2.0394746400415897, + 0.3353896252810955, + 0.9894572645425797, + 0.25734226033091545, + 0.3377057146281004, + 0.9684228859841824, + 0.90434255823493, + 1.5678672976791859, + 0.5897270925343037, + 1.4617554787546396, + 0.03685847669839859, + 1.6837321668863297, + 0.9053080454468727, + 1.3386733941733837, + 1.2341972906142473, + 1.353967720642686, + 0.356299078091979, + 0.6105141919106245, + 3.0272944159805775, + 0.17662381567060947, + 0.8133990466594696, + 0.4153428189456463, + 1.2252172082662582, + 1.1362794116139412, + 1.7341012209653854, + 0.41727349162101746, + 0.2608276791870594, + 0.6830632034689188, + 0.33860702998936176, + 1.2953255102038383, + 1.7147967927157879, + 0.09156659990549088 + ], + "unique_experts": 64, + "load_cv": 0.5601225428326894, + "normalized_load_entropy": 0.9632096937600108, + "max_load_share": 0.05309734513274336 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "c13ccfe6eb3f717d5bb5be639ce53563ae0f3cac22a9d3da3532c9fcf77b2220", + "route_weight_sha256": "b2d0491922e02e091a2434f843b8991991c743b1b3bc539ca37cac27839d1323", + "loads": [ + 15, + 17, + 8, + 23, + 8, + 16, + 6, + 16, + 13, + 18, + 13, + 17, + 9, + 12, + 25, + 13, + 12, + 14, + 6, + 9, + 20, + 17, + 19, + 12, + 8, + 16, + 2, + 10, + 17, + 5, + 11, + 8, + 25, + 7, + 16, + 6, + 9, + 21, + 10, + 18, + 12, + 16, + 17, + 20, + 9, + 20, + 35, + 16, + 17, + 16, + 37, + 8, + 11, + 10, + 15, + 19, + 14, + 12, + 12, + 13, + 21, + 16, + 22, + 9 + ], + "weighted_loads": [ + 1.779062245041132, + 1.23722705245018, + 0.476915180683136, + 1.4537025541067123, + 0.47835647396277636, + 0.8644671179354191, + 0.22813740745186806, + 1.583215182647109, + 0.8324912320822477, + 0.9872743167798035, + 1.2974624689668417, + 0.9440710814669728, + 0.4500696754839737, + 0.7818337790668011, + 2.73773156106472, + 1.4990619979798794, + 0.9384605400264263, + 1.1139755249023438, + 0.2744436748325825, + 0.577603105455637, + 1.337862428277731, + 1.2569563165307045, + 1.4103245250880718, + 1.0636103078722954, + 0.5767042934894562, + 1.0225118934176862, + 0.07481546327471733, + 0.6384231355041265, + 1.3881647866219282, + 0.26655104756355286, + 0.9659112580120564, + 0.38251789286732674, + 2.0394746400415897, + 0.408135786652565, + 1.9148315861821175, + 0.25734226033091545, + 0.3377057146281004, + 1.3863024413585663, + 0.90434255823493, + 1.6180967874825, + 0.6645480506122112, + 1.4617554787546396, + 0.908607542514801, + 1.7572718933224678, + 0.9053080454468727, + 1.7227765507996082, + 3.445489166304469, + 1.353967720642686, + 1.4824903476983309, + 1.075408024713397, + 3.0685183480381966, + 0.956464933231473, + 1.0132211335003376, + 1.1317361555993557, + 2.4852437898516655, + 1.5135179441422224, + 1.7341012209653854, + 0.41727349162101746, + 0.787179484963417, + 0.713714212179184, + 1.0773392263799906, + 1.3453635983169079, + 2.12767206504941, + 0.5342279095202684 + ], + "unique_experts": 64, + "load_cv": 0.4402620814062992, + "normalized_load_entropy": 0.977559739663468, + "max_load_share": 0.04004329004329004 + } + }, + "s0_x": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "295eeb69965c1dee564167f6ca93833b2582dac110bc228a3a84b9687df5ad4c", + "route_weight_sha256": "90a251c50d7e4d1beadba263a2b19a320d80910dde19f9fc4b99affb02c6d51d", + "loads": [ + 2, + 16, + 8, + 12, + 7, + 12, + 6, + 5, + 13, + 10, + 10, + 17, + 6, + 7, + 16, + 11, + 9, + 13, + 7, + 10, + 18, + 12, + 8, + 11, + 7, + 11, + 2, + 8, + 16, + 2, + 10, + 9, + 23, + 5, + 7, + 7, + 7, + 17, + 10, + 17, + 11, + 15, + 1, + 18, + 10, + 15, + 14, + 17, + 7, + 6, + 36, + 2, + 8, + 5, + 11, + 14, + 13, + 10, + 5, + 10, + 11, + 15, + 18, + 2 + ], + "weighted_loads": [ + 0.08511894568800926, + 1.2130346037447453, + 0.47327568754553795, + 0.7817303463816643, + 0.46572697907686234, + 0.6531151179224253, + 0.23217814229428768, + 0.27341387793421745, + 0.8418025374412537, + 0.5761948935687542, + 1.2093515284359455, + 0.9416172821074724, + 0.370482599362731, + 0.34434718638658524, + 2.0104737877845764, + 1.412263184785843, + 0.6855783127248287, + 1.0486473981291056, + 0.27076859027147293, + 0.6266512162983418, + 1.3134641461074352, + 0.9577058814466, + 0.48076165094971657, + 1.0084256175905466, + 0.49282592721283436, + 0.8987775892019272, + 0.07525213807821274, + 0.5726559534668922, + 1.2893677596002817, + 0.12477816268801689, + 0.9438252337276936, + 0.41496201045811176, + 1.9607911333441734, + 0.34063368290662766, + 0.9572299085557461, + 0.3089644405990839, + 0.276597710326314, + 1.0339228101074696, + 0.8863656222820282, + 1.612360417842865, + 0.5987379215657711, + 1.424418492242694, + 0.02910364232957363, + 1.7103293985128403, + 0.9707748051732779, + 1.352881295606494, + 1.083214396610856, + 1.392927573993802, + 0.3558090701699257, + 0.6254608538001776, + 3.0188596472144127, + 0.17792098596692085, + 0.8431193493306637, + 0.4088495150208473, + 1.2639673110097647, + 1.1995686329901218, + 1.6730905435979366, + 0.3566972501575947, + 0.30356689542531967, + 0.5879209246486425, + 0.46086713299155235, + 1.283421590924263, + 1.8555784933269024, + 0.08619973808526993 + ], + "unique_experts": 64, + "load_cv": 0.5419305378874573, + "normalized_load_entropy": 0.9656578916017385, + "max_load_share": 0.05309734513274336 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "11601385c2f6083400102ea676b5b95e7d1ec37ad5c754beef32bd1ed4f0c9f6", + "route_weight_sha256": "17186c566c07baec257d46b8e78c2a509670d7d06916274176d37b3cd6febe5e", + "loads": [ + 10, + 16, + 8, + 23, + 11, + 13, + 6, + 14, + 13, + 15, + 12, + 18, + 7, + 11, + 23, + 11, + 9, + 13, + 7, + 10, + 19, + 15, + 13, + 13, + 7, + 12, + 3, + 15, + 16, + 6, + 11, + 9, + 23, + 5, + 16, + 7, + 8, + 17, + 10, + 17, + 11, + 15, + 12, + 18, + 10, + 17, + 26, + 17, + 13, + 17, + 37, + 2, + 8, + 5, + 15, + 16, + 13, + 10, + 6, + 10, + 18, + 15, + 21, + 4 + ], + "weighted_loads": [ + 1.21512695774436, + 1.2130346037447453, + 0.47327568754553795, + 1.5051954463124275, + 0.5706023041857406, + 0.7008450869470835, + 0.23217814229428768, + 1.5554364770650864, + 0.8418025374412537, + 0.8587708600680344, + 1.2823151871562004, + 0.9424968911334872, + 0.37095857996609993, + 0.7188738584518433, + 2.486701510846615, + 1.412263184785843, + 0.6855783127248287, + 1.0486473981291056, + 0.27076859027147293, + 0.6266512162983418, + 1.3402491230517626, + 1.2076518908143044, + 0.8576620519161224, + 1.0666017290204763, + 0.49282592721283436, + 0.8993058274500072, + 0.11744838207960129, + 0.8448158875107765, + 1.2893677596002817, + 0.3192397393286228, + 0.9907548613846302, + 0.41496201045811176, + 1.9607911333441734, + 0.34063368290662766, + 2.0579171366989613, + 0.3089644405990839, + 0.3254286628216505, + 1.0339228101074696, + 0.8863656222820282, + 1.612360417842865, + 0.5987379215657711, + 1.424418492242694, + 0.6960657555609941, + 1.7103293985128403, + 0.9707748051732779, + 1.477423807606101, + 2.6821059864014387, + 1.392927573993802, + 1.0361434817314148, + 1.3042957466095686, + 3.0687312334775925, + 0.17792098596692085, + 0.8431193493306637, + 0.4088495150208473, + 2.47745961509645, + 1.3571166954934597, + 1.6730905435979366, + 0.3566972501575947, + 0.35943976044654846, + 0.5879209246486425, + 0.9720094818621874, + 1.283421590924263, + 2.1816015131771564, + 0.15853552147746086 + ], + "unique_experts": 64, + "load_cv": 0.45990236674267915, + "normalized_load_entropy": 0.9752589262293403, + "max_load_share": 0.04468599033816425 + } + }, + "s1_x": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "3645a80cb179cfbd56feee74f0a4f1d5925e0e4fdfdfb8c76565277d35a31493", + "route_weight_sha256": "9c44e7b69a51631aa10a65e54f2a28e30e664c73fee81ebfa41cc5bf3027f6d7", + "loads": [ + 2, + 16, + 8, + 11, + 6, + 10, + 6, + 5, + 12, + 10, + 11, + 16, + 6, + 6, + 16, + 12, + 10, + 14, + 6, + 10, + 18, + 12, + 9, + 11, + 7, + 12, + 2, + 9, + 17, + 2, + 10, + 9, + 25, + 5, + 7, + 6, + 7, + 18, + 10, + 17, + 11, + 14, + 1, + 18, + 9, + 15, + 18, + 17, + 7, + 5, + 35, + 2, + 8, + 5, + 11, + 13, + 13, + 11, + 4, + 11, + 8, + 15, + 17, + 4 + ], + "weighted_loads": [ + 0.07662270963191986, + 1.213723324239254, + 0.4821670465171337, + 0.7588973864912987, + 0.4281396120786667, + 0.5627562776207924, + 0.2274281233549118, + 0.27199486643075943, + 0.8158508725464344, + 0.5442070066928864, + 1.243698488920927, + 0.9392900671809912, + 0.3710799813270569, + 0.2896928619593382, + 2.038871541619301, + 1.4702061377465725, + 0.7284565940499306, + 1.106667835265398, + 0.24226240999996662, + 0.599185898900032, + 1.2610854506492615, + 0.9587151072919369, + 0.5421987771987915, + 1.0307127758860588, + 0.5007717087864876, + 0.9157609511166811, + 0.07504476234316826, + 0.5827723909169436, + 1.4218955803662539, + 0.12922349572181702, + 0.9272147007286549, + 0.4133438281714916, + 2.048171080648899, + 0.334144476801157, + 0.956867516040802, + 0.25963587313890457, + 0.26419452391564846, + 1.0242017153650522, + 0.9082876089960337, + 1.5867796391248703, + 0.5878829658031464, + 1.3953815810382366, + 0.03870626911520958, + 1.6480903327465057, + 0.8984333127737045, + 1.3232236541807652, + 1.2829506192356348, + 1.3963010795414448, + 0.3524947613477707, + 0.5916416589170694, + 2.9456055220216513, + 0.1889960914850235, + 0.817219115793705, + 0.4115756154060364, + 1.2510784789919853, + 1.1383196748793125, + 1.6796864904463291, + 0.3943228591233492, + 0.25452451407909393, + 0.6494127344340086, + 0.32808598689734936, + 1.2689478993415833, + 1.7158002220094204, + 0.15566225908696651 + ], + "unique_experts": 64, + "load_cv": 0.5493303381059106, + "normalized_load_entropy": 0.9648151105817157, + "max_load_share": 0.051622418879056046 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "aeba10f4062e8fd0bf373c371b24746c8c972ce7130966fd388092a943d90641", + "route_weight_sha256": "6cf1a14ab2524343941ec2e007800e9659ba126ae60aebb259662ae58f09ed20", + "loads": [ + 13, + 18, + 8, + 23, + 8, + 14, + 6, + 16, + 12, + 18, + 14, + 17, + 9, + 11, + 25, + 13, + 12, + 14, + 7, + 10, + 19, + 18, + 19, + 12, + 9, + 14, + 3, + 13, + 17, + 6, + 11, + 9, + 25, + 7, + 15, + 6, + 8, + 23, + 10, + 18, + 12, + 14, + 17, + 20, + 9, + 20, + 35, + 17, + 16, + 16, + 36, + 8, + 11, + 10, + 16, + 19, + 13, + 11, + 12, + 12, + 21, + 16, + 22, + 11 + ], + "weighted_loads": [ + 1.5009062960743904, + 1.2880291454494, + 0.4821670465171337, + 1.5629694573581219, + 0.4595001832349226, + 0.7604339234530926, + 0.2274281233549118, + 1.591287275776267, + 0.8158508725464344, + 0.9974369124392979, + 1.3288711551576853, + 0.940169676207006, + 0.4524322415527422, + 0.7196445185691118, + 2.714473158121109, + 1.519405584782362, + 0.9429875016212463, + 1.106667835265398, + 0.2975087482482195, + 0.599185898900032, + 1.2932459153234959, + 1.2943465784192085, + 1.4152844995260239, + 1.062201827764511, + 0.6040906682610512, + 0.9637835151515901, + 0.11412451043725014, + 0.7242413684725761, + 1.4218955803662539, + 0.31267832964658737, + 0.9684785231947899, + 0.4133438281714916, + 2.048171080648899, + 0.4068906381726265, + 1.9262205511331558, + 0.25963587313890457, + 0.30442692898213863, + 1.4420812707394361, + 0.9082876089960337, + 1.6370091289281845, + 0.6627039238810539, + 1.3953815810382366, + 0.8249912858009338, + 1.721630059182644, + 0.8984333127737045, + 1.7108005285263062, + 3.497370271012187, + 1.3963010795414448, + 1.3596851043403149, + 1.1157208438962698, + 2.985531782731414, + 0.968837209045887, + 1.017041202634573, + 1.1279689520597458, + 2.4730587154626846, + 1.5105764847248793, + 1.6796864904463291, + 0.3943228591233492, + 0.7904084287583828, + 0.6800637431442738, + 1.1212836001068354, + 1.3189859874546528, + 2.1286754943430424, + 0.5991213005036116 + ], + "unique_experts": 64, + "load_cv": 0.43062170819052503, + "normalized_load_entropy": 0.978944911629887, + "max_load_share": 0.03896103896103896 + } + }, + "s0_period": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "dd1500cea9d47aeda8812c1ab6ea4b5cad74a6cc1e88738c71fee9dc625a378e", + "route_weight_sha256": "aada0706bb58896290135f6796e34160c39d81d1d68aa2e51ac8cd19ba6148b2", + "loads": [ + 2, + 16, + 8, + 12, + 7, + 12, + 6, + 5, + 13, + 10, + 9, + 17, + 6, + 7, + 16, + 11, + 9, + 13, + 6, + 10, + 18, + 12, + 8, + 11, + 7, + 11, + 2, + 8, + 16, + 3, + 10, + 10, + 24, + 5, + 7, + 6, + 7, + 17, + 10, + 17, + 10, + 15, + 1, + 18, + 10, + 15, + 15, + 17, + 7, + 5, + 36, + 2, + 8, + 5, + 11, + 14, + 13, + 10, + 5, + 11, + 11, + 15, + 18, + 2 + ], + "weighted_loads": [ + 0.08503296971321106, + 1.2116437889635563, + 0.47440529987215996, + 0.7766201384365559, + 0.46398729272186756, + 0.653139840811491, + 0.23562258668243885, + 0.2703859508037567, + 0.842064468190074, + 0.5711537450551987, + 1.174745749682188, + 0.9435747992247343, + 0.3684555198997259, + 0.3410024903714657, + 2.011736299842596, + 1.4132257550954819, + 0.6796971000730991, + 1.0465683415532112, + 0.2397949881851673, + 0.628960944712162, + 1.3067687302827835, + 0.9647679291665554, + 0.4724593237042427, + 1.0084377992898226, + 0.503075260668993, + 0.9060190469026566, + 0.07539540529251099, + 0.5760048814117908, + 1.294241914525628, + 0.1509807389229536, + 0.947410237044096, + 0.4476771764457226, + 1.9993785619735718, + 0.3402770459651947, + 0.9618614129722118, + 0.26961364783346653, + 0.27725074626505375, + 1.0124887395650148, + 0.886763347312808, + 1.6163884699344635, + 0.5619492940604687, + 1.4264559522271156, + 0.028721189126372337, + 1.7287076562643051, + 0.9609265122562647, + 1.3641107138246298, + 1.1053637135773897, + 1.3882348593324423, + 0.35222276486456394, + 0.6006992384791374, + 3.018972121179104, + 0.17770884931087494, + 0.8434000164270401, + 0.4085448682308197, + 1.2483192663639784, + 1.1909480094909668, + 1.6840186472982168, + 0.3595760352909565, + 0.30622396245598793, + 0.6294801067560911, + 0.4624324142932892, + 1.2962101958692074, + 1.8708871565759182, + 0.08648088946938515 + ], + "unique_experts": 64, + "load_cv": 0.5475533355618746, + "normalized_load_entropy": 0.9651984768708047, + "max_load_share": 0.05309734513274336 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "cff2ea74505a0790aaa87d72c60ea2a560e0d2f6317370af9f1af5374adc5c56", + "route_weight_sha256": "8450698983968bcbd6629d8c9f13a18ffa79f637b2474b73fcbdb70e0621f704", + "loads": [ + 10, + 17, + 8, + 23, + 11, + 13, + 6, + 14, + 13, + 16, + 11, + 18, + 7, + 11, + 23, + 11, + 9, + 13, + 6, + 10, + 19, + 15, + 13, + 13, + 7, + 12, + 2, + 14, + 16, + 7, + 11, + 10, + 24, + 5, + 15, + 6, + 7, + 17, + 10, + 17, + 10, + 15, + 12, + 18, + 10, + 18, + 27, + 17, + 13, + 15, + 37, + 2, + 8, + 5, + 15, + 16, + 13, + 10, + 7, + 11, + 19, + 15, + 21, + 4 + ], + "weighted_loads": [ + 1.1465929634869099, + 1.358049426227808, + 0.47440529987215996, + 1.4356224723160267, + 0.5794473876012489, + 0.7008698098361492, + 0.23562258668243885, + 1.5946689695119858, + 0.842064468190074, + 1.0109815985779278, + 1.247709408402443, + 0.9444544082507491, + 0.36893150050309487, + 0.7132477276027203, + 2.611047688871622, + 1.4132257550954819, + 0.6796971000730991, + 1.0465683415532112, + 0.2397949881851673, + 0.628960944712162, + 1.3335537072271109, + 1.2131070159375668, + 0.8481306210160255, + 1.0670520029962063, + 0.503075260668993, + 0.9065472851507366, + 0.07539540529251099, + 0.8006623685359955, + 1.294241914525628, + 0.3378917705267668, + 0.9943398647010326, + 0.4476771764457226, + 1.9993785619735718, + 0.3402770459651947, + 1.9605996645987034, + 0.26961364783346653, + 0.27725074626505375, + 1.0124887395650148, + 0.886763347312808, + 1.6163884699344635, + 0.5619492940604687, + 1.4264559522271156, + 0.6978536266833544, + 1.7287076562643051, + 0.9609265122562647, + 1.5415012445300817, + 2.7042553033679724, + 1.3882348593324423, + 1.0282638315111399, + 1.2155918404459953, + 3.0689187422394753, + 0.17770884931087494, + 0.8434000164270401, + 0.4085448682308197, + 2.4600889664143324, + 1.3444741442799568, + 1.6840186472982168, + 0.3595760352909565, + 0.3960682898759842, + 0.6294801067560911, + 0.9862056467682123, + 1.2962101958692074, + 2.1969101764261723, + 0.1583944819867611 + ], + "unique_experts": 64, + "load_cv": 0.46874841983599486, + "normalized_load_entropy": 0.9741890431854172, + "max_load_share": 0.04468599033816425 + } + }, + "s1_period": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "f6a127463ff479b78a33c8b363291795dd429100ee5b2aa98a99bab0ecf0157e", + "route_weight_sha256": "844728e9247a01b0e070019ac2f232b99be67e0141d00c643939e396560a5f6b", + "loads": [ + 2, + 15, + 8, + 11, + 6, + 10, + 6, + 5, + 13, + 10, + 12, + 16, + 6, + 6, + 16, + 12, + 10, + 14, + 6, + 10, + 18, + 12, + 8, + 11, + 7, + 12, + 2, + 8, + 17, + 2, + 10, + 9, + 25, + 5, + 7, + 6, + 7, + 17, + 10, + 17, + 12, + 14, + 1, + 17, + 9, + 15, + 18, + 17, + 7, + 5, + 35, + 2, + 8, + 5, + 11, + 13, + 13, + 11, + 4, + 12, + 9, + 15, + 17, + 4 + ], + "weighted_loads": [ + 0.07698150724172592, + 1.173631265759468, + 0.48213252052664757, + 0.7585455402731895, + 0.4228206016123295, + 0.5621391274034977, + 0.22985115461051464, + 0.2714751996099949, + 0.8631131127476692, + 0.5437052138149738, + 1.266712475568056, + 0.9239583630114794, + 0.36868416145443916, + 0.28901122137904167, + 2.0475671477615833, + 1.4690941721200943, + 0.7342929616570473, + 1.1011873856186867, + 0.2428572177886963, + 0.5991790238767862, + 1.2587486542761326, + 0.9544055573642254, + 0.47965938225388527, + 1.0281428471207619, + 0.5038622207939625, + 0.9154624007642269, + 0.07398698851466179, + 0.5619718451052904, + 1.422558005899191, + 0.12992101162672043, + 0.9287689588963985, + 0.4130138624459505, + 2.063356928527355, + 0.3334907367825508, + 0.9564345218241215, + 0.26128225587308407, + 0.26567902602255344, + 0.9847568646073341, + 0.9052903652191162, + 1.5850430056452751, + 0.628177534788847, + 1.3959187865257263, + 0.03914829343557358, + 1.610716674476862, + 0.8902850151062012, + 1.3303390182554722, + 1.2832521069794893, + 1.4007194191217422, + 0.34603191539645195, + 0.5873753447085619, + 2.96285630017519, + 0.18915152549743652, + 0.823098823428154, + 0.4116642437875271, + 1.2491285875439644, + 1.137488029897213, + 1.6926308423280716, + 0.3948185332119465, + 0.2552111968398094, + 0.681240938603878, + 0.3777226749807596, + 1.2867542766034603, + 1.7274860627949238, + 0.15612155012786388 + ], + "unique_experts": 64, + "load_cv": 0.5462805090010924, + "normalized_load_entropy": 0.9650820615625794, + "max_load_share": 0.051622418879056046 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "c2f38bcbf03a680d6694955df66915cfbcaa807928260a60b049382651d27630", + "route_weight_sha256": "cdc10c4bbd426357b2c9ba7b7b06016cf94d341ea67903e8e53e529c92bb13b1", + "loads": [ + 12, + 18, + 8, + 23, + 9, + 14, + 6, + 17, + 13, + 19, + 15, + 17, + 9, + 11, + 25, + 13, + 12, + 14, + 7, + 10, + 19, + 18, + 18, + 12, + 9, + 14, + 2, + 11, + 17, + 6, + 11, + 9, + 25, + 7, + 14, + 6, + 7, + 22, + 10, + 18, + 13, + 14, + 18, + 19, + 9, + 21, + 34, + 17, + 15, + 15, + 36, + 8, + 11, + 10, + 16, + 19, + 13, + 11, + 13, + 13, + 23, + 16, + 22, + 11 + ], + "weighted_loads": [ + 1.4024168401956558, + 1.357040572911501, + 0.48213252052664757, + 1.4730482697486877, + 0.49999108992051333, + 0.7618463821709156, + 0.22985115461051464, + 1.6721385661512613, + 0.8631131127476692, + 1.1229798548738472, + 1.3518851418048143, + 0.9248379720374942, + 0.4500364216801245, + 0.7173389345407486, + 2.799802877008915, + 1.5182936191558838, + 0.948823869228363, + 1.1011873856186867, + 0.29810355603694916, + 0.5991790238767862, + 1.290909118950367, + 1.2874228581786156, + 1.3712889775633812, + 1.0596387721598148, + 0.6071811802685261, + 0.9634849647991359, + 0.07398698851466179, + 0.6581444852054119, + 1.422558005899191, + 0.308152437210083, + 0.9700327813625336, + 0.4130138624459505, + 2.063356928527355, + 0.4062368981540203, + 1.833938118070364, + 0.26128225587308407, + 0.26567902602255344, + 1.402636419981718, + 0.9052903652191162, + 1.6352724954485893, + 0.7029984928667545, + 1.3959187865257263, + 0.9135217778384686, + 1.684256400913, + 0.8902850151062012, + 1.780003860592842, + 3.4568881299346685, + 1.4007194191217422, + 1.3086742162704468, + 1.0522691775113344, + 3.002699188888073, + 0.9689926430583, + 1.022920910269022, + 1.1280575804412365, + 2.463449988514185, + 1.5067317131906748, + 1.6926308423280716, + 0.3948185332119465, + 0.8346546106040478, + 0.7118919473141432, + 1.1773528512567282, + 1.3367923647165298, + 2.1403613351285458, + 0.5997918266803026 + ], + "unique_experts": 64, + "load_cv": 0.43114362137048784, + "normalized_load_entropy": 0.9785322770899254, + "max_load_share": 0.03896103896103896 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 113, + "ordered_topk_exact_tokens": 93, + "set_exact_tokens": 102, + "mean_set_jaccard": 0.9721871049304678, + "mean_token_weighted_tv": 0.007465748413078553, + "aggregate_load_tv": 0.011799410029498525 + }, + "system_bos": { + "tokens": 113, + "ordered_topk_exact_tokens": 71, + "set_exact_tokens": 85, + "mean_set_jaccard": 0.9254108723135273, + "mean_token_weighted_tv": 0.016994532568594522, + "aggregate_load_tv": 0.03392330383480826 + }, + "system_x": { + "tokens": 113, + "ordered_topk_exact_tokens": 70, + "set_exact_tokens": 81, + "mean_set_jaccard": 0.913400758533502, + "mean_token_weighted_tv": 0.02079993590251007, + "aggregate_load_tv": 0.028023598820058997 + }, + "system_period": { + "tokens": 113, + "ordered_topk_exact_tokens": 69, + "set_exact_tokens": 79, + "mean_set_jaccard": 0.9102402022756005, + "mean_token_weighted_tv": 0.020955893878651932, + "aggregate_load_tv": 0.02654867256637168 + }, + "bos_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 73, + "set_exact_tokens": 81, + "mean_set_jaccard": 0.9152970922882429, + "mean_token_weighted_tv": 0.020890740265624715, + "aggregate_load_tv": 0.030973451327433628 + }, + "bos_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 65, + "set_exact_tokens": 78, + "mean_set_jaccard": 0.9077117572692796, + "mean_token_weighted_tv": 0.023021293235365795, + "aggregate_load_tv": 0.032448377581120944 + }, + "x_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 70, + "set_exact_tokens": 84, + "mean_set_jaccard": 0.9247787610619469, + "mean_token_weighted_tv": 0.018962100065783062, + "aggregate_load_tv": 0.030973451327433628 + }, + "x_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 58, + "set_exact_tokens": 71, + "mean_set_jaccard": 0.8900126422250317, + "mean_token_weighted_tv": 0.025928669403084612, + "aggregate_load_tv": 0.03687315634218289 + }, + "period_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 72, + "set_exact_tokens": 83, + "mean_set_jaccard": 0.9222503160556259, + "mean_token_weighted_tv": 0.019259649922296538, + "aggregate_load_tv": 0.02654867256637168 + }, + "period_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 59, + "set_exact_tokens": 70, + "mean_set_jaccard": 0.8855878634639698, + "mean_token_weighted_tv": 0.026883867453882652, + "aggregate_load_tv": 0.035398230088495575 + } + } + }, + "layer_04": { + "layer": 4, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "467cf283799077a21c859aef036ba1ab9b8d5cb819f1788fb7b9baf8836fdc5f", + "route_weight_sha256": "1321edb6c09e3e15ee960c7d998cbd073be71967a4554cb61985fa98d15b024b", + "loads": [ + 11, + 23, + 13, + 5, + 2, + 8, + 24, + 13, + 11, + 3, + 11, + 5, + 15, + 0, + 7, + 13, + 10, + 16, + 4, + 12, + 14, + 9, + 14, + 12, + 10, + 5, + 10, + 9, + 21, + 9, + 9, + 16, + 7, + 25, + 3, + 6, + 6, + 21, + 10, + 14, + 4, + 5, + 2, + 12, + 7, + 14, + 7, + 9, + 2, + 12, + 19, + 12, + 15, + 6, + 5, + 11, + 8, + 23, + 19, + 15, + 3, + 8, + 9, + 15 + ], + "weighted_loads": [ + 0.7636147886514664, + 1.9705647509545088, + 0.9848261699080467, + 0.3311116397380829, + 0.19651171192526817, + 0.49396470189094543, + 1.6015387624502182, + 0.7499450445175171, + 0.8425483293831348, + 0.12561440467834473, + 1.0678624510765076, + 0.17491971142590046, + 1.2443137727677822, + 0.0, + 0.9953942857682705, + 0.8390298672020435, + 0.8855725526809692, + 1.334542691707611, + 0.29770132154226303, + 1.1563678104430437, + 1.3018806874752045, + 0.3776037208735943, + 1.1990999206900597, + 0.8721703067421913, + 1.009591531008482, + 0.19999301992356777, + 0.5729375127702951, + 0.4942375645041466, + 1.8273709863424301, + 0.47914931923151016, + 0.6286627948284149, + 0.708179822191596, + 0.3088661693036556, + 1.7948863115161657, + 0.14363104104995728, + 0.22777397744357586, + 0.3950049914419651, + 1.8551276791840792, + 0.946995422244072, + 1.1287868320941925, + 0.1683915201574564, + 0.23358221724629402, + 0.14689235016703606, + 1.1192397996783257, + 0.4024772457778454, + 2.1710003800690174, + 0.23421345092356205, + 0.4469077382236719, + 0.06538514420390129, + 0.8523341044783592, + 1.2285170648247004, + 0.4971781559288502, + 1.373536005616188, + 0.28749528899788857, + 0.45988593250513077, + 0.8854592405259609, + 0.6058381628245115, + 1.6338493078947067, + 1.3330596163868904, + 1.2665404956787825, + 0.14076712355017662, + 0.5752274915575981, + 0.5077791679650545, + 1.169136967509985 + ], + "unique_experts": 63, + "load_cv": 0.5490768327014587, + "normalized_load_entropy": 0.9620972410947348, + "max_load_share": 0.03687315634218289 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "021d5f385d6fefc28eaa16e7fed24df123afcbefa4f0aaf5da2b9248b50c063c", + "route_weight_sha256": "7e2c6050af8f9646ed1dce737d009a766b30430413a545399945c08a136ebc17", + "loads": [ + 11, + 26, + 15, + 9, + 2, + 8, + 25, + 13, + 11, + 4, + 21, + 7, + 15, + 13, + 9, + 16, + 10, + 16, + 9, + 12, + 14, + 11, + 16, + 12, + 10, + 11, + 15, + 10, + 21, + 25, + 10, + 18, + 7, + 27, + 14, + 6, + 6, + 23, + 12, + 14, + 7, + 7, + 10, + 12, + 7, + 15, + 18, + 9, + 3, + 14, + 21, + 12, + 15, + 6, + 5, + 11, + 8, + 23, + 19, + 30, + 7, + 8, + 12, + 15 + ], + "weighted_loads": [ + 0.7636147886514664, + 2.1212868820875883, + 1.1063427180051804, + 0.6369358079973608, + 0.19651171192526817, + 0.49396470189094543, + 1.658218514174223, + 0.7499450445175171, + 0.8425483293831348, + 0.15610678121447563, + 1.725509863346815, + 0.20146007742732763, + 1.2443137727677822, + 0.9363741986453533, + 1.0417938902974129, + 1.0307010039687157, + 0.8855725526809692, + 1.334542691707611, + 0.6111712640558835, + 1.1563678104430437, + 1.3018806874752045, + 1.444650899618864, + 1.3295119404792786, + 0.8721703067421913, + 1.009591531008482, + 0.6410168167203665, + 1.0654136631637812, + 0.5022308640182018, + 1.8273709863424301, + 1.7732226915541105, + 0.6774008683860302, + 0.739018720574677, + 0.3088661693036556, + 1.8350743120536208, + 1.2038020086765755, + 0.22777397744357586, + 0.3950049914419651, + 1.9424098413437605, + 2.077481135725975, + 1.1287868320941925, + 0.30978778563439846, + 0.3444770276546478, + 0.5051693543791771, + 1.1192397996783257, + 0.4024772457778454, + 2.2010571099817753, + 1.3885537777096033, + 0.4469077382236719, + 0.10233510658144951, + 0.9026215597987175, + 1.3257382977753878, + 0.4971781559288502, + 1.373536005616188, + 0.28749528899788857, + 0.45988593250513077, + 0.8854592405259609, + 0.6058381628245115, + 1.6338493078947067, + 1.3330596163868904, + 2.045004015788436, + 0.5397477466904093, + 0.5752274915575981, + 0.7280960660427809, + 1.169136967509985 + ], + "unique_experts": 64, + "load_cv": 0.47468531186559854, + "normalized_load_entropy": 0.9734582412037852, + "max_load_share": 0.036231884057971016 + } + }, + "s1_eos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "7967914d5da72ac5de28c27aaf6930dc73fc7ae46204dd8896ee7a58b2ea20c0", + "route_weight_sha256": "4f3a86de2edb1b8f57f5004d90dc39debd56aef671134b37f7237897774688ee", + "loads": [ + 11, + 24, + 13, + 5, + 2, + 8, + 25, + 13, + 11, + 3, + 11, + 5, + 15, + 0, + 7, + 13, + 10, + 16, + 5, + 12, + 14, + 9, + 14, + 11, + 8, + 4, + 10, + 9, + 20, + 11, + 8, + 16, + 7, + 25, + 3, + 5, + 6, + 21, + 10, + 15, + 5, + 5, + 2, + 12, + 7, + 14, + 8, + 9, + 1, + 12, + 18, + 12, + 15, + 6, + 5, + 11, + 8, + 21, + 19, + 16, + 4, + 9, + 9, + 15 + ], + "weighted_loads": [ + 0.7708200924098492, + 2.003603182733059, + 0.9689081683754921, + 0.32789697870612144, + 0.19755887612700462, + 0.4891172908246517, + 1.6185921654105186, + 0.7480660602450371, + 0.8489699922502041, + 0.1262354739010334, + 1.0575830452144146, + 0.17471917159855366, + 1.250089980661869, + 0.0, + 0.996245376765728, + 0.8421153649687767, + 0.861808355897665, + 1.328057486563921, + 0.3440489396452904, + 1.1442170403897762, + 1.308970257639885, + 0.3774632140994072, + 1.2058491297066212, + 0.8425498269498348, + 0.9433274921029806, + 0.171719865873456, + 0.5706060715019703, + 0.5018299296498299, + 1.791905738413334, + 0.5688479635864496, + 0.5782107412815094, + 0.7078323196619749, + 0.3091206159442663, + 1.790620120242238, + 0.15140013583004475, + 0.19377153366804123, + 0.39271383360028267, + 1.8644815534353256, + 0.9352241419255733, + 1.1973504163324833, + 0.19478454254567623, + 0.2288241982460022, + 0.14274248853325844, + 1.1163420155644417, + 0.3983706720173359, + 2.1853068098425865, + 0.27184937708079815, + 0.43522758036851883, + 0.038281526416540146, + 0.8505459427833557, + 1.1787382327020168, + 0.5070982966572046, + 1.3712426461279392, + 0.29157349094748497, + 0.4556051418185234, + 0.8883518390357494, + 0.6027708258479834, + 1.5187468156218529, + 1.3391468729823828, + 1.2892286833375692, + 0.16835206001996994, + 0.6219749636948109, + 0.5078694932162762, + 1.177068330347538 + ], + "unique_experts": 63, + "load_cv": 0.5475533355618746, + "normalized_load_entropy": 0.9620631583384144, + "max_load_share": 0.03687315634218289 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "6ca5a6e813b2140fb63907b7ddfdbdd994b4523155565eae5bbed1b7c87e784d", + "route_weight_sha256": "310cdccde5486134dcf8b8c409cabaa7197bf3f8d58333828f95b30f7a2cb556", + "loads": [ + 11, + 26, + 16, + 14, + 3, + 8, + 28, + 13, + 11, + 11, + 20, + 7, + 16, + 14, + 10, + 17, + 12, + 18, + 13, + 14, + 15, + 12, + 19, + 12, + 8, + 14, + 18, + 10, + 20, + 31, + 9, + 18, + 7, + 27, + 18, + 5, + 7, + 24, + 14, + 18, + 8, + 10, + 11, + 12, + 9, + 16, + 18, + 13, + 2, + 15, + 21, + 12, + 19, + 10, + 11, + 11, + 13, + 23, + 19, + 32, + 11, + 11, + 13, + 16 + ], + "weighted_loads": [ + 0.7708200924098492, + 2.1308022178709507, + 1.1396535746753216, + 1.0964393695467152, + 0.22885703667998314, + 0.4891172908246517, + 1.8322658725082874, + 0.7480660602450371, + 0.8489699922502041, + 1.1729160211980343, + 1.6473294720053673, + 0.2012461144477129, + 1.3559556603431702, + 0.9958263076841831, + 1.0710131395608187, + 1.1131697781383991, + 1.2246929369866848, + 1.3986774068325758, + 0.9784189809288364, + 1.2345329783856869, + 1.3579006716609001, + 1.4743774458765984, + 1.6313896663486958, + 0.9367409087717533, + 0.9433274921029806, + 0.8890535030514002, + 1.3412018902599812, + 0.5101495366543531, + 1.791905738413334, + 1.8009640574455261, + 0.6248473115265369, + 0.7384012043476105, + 0.3091206159442663, + 1.8312914837151766, + 1.5068176338390913, + 0.19377153366804123, + 0.42002736404538155, + 1.9908448606729507, + 2.268294133245945, + 1.4087184928357601, + 0.3553051855415106, + 0.4425166722503491, + 0.574986819177866, + 1.1163420155644417, + 0.46795017644762993, + 2.2158414347213693, + 1.459361432120204, + 0.7722809389233589, + 0.06782120652496815, + 0.9375076536089182, + 1.3169235289096832, + 0.5070982966572046, + 1.8075552992522717, + 0.474678460508585, + 1.005950704216957, + 0.8883518390357494, + 1.0266514848917723, + 1.5916092339903116, + 1.3391468729823828, + 2.155410112813115, + 1.043900977820158, + 0.8173931501805782, + 0.7998716272413731, + 1.2214993610978127 + ], + "unique_experts": 64, + "load_cv": 0.4260716813412665, + "normalized_load_entropy": 0.9783615823338556, + "max_load_share": 0.03463203463203463 + } + }, + "s0_bos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "ab055421675ff1485183ee2388909b7160cc2f437066105f9a291ef195fb8f68", + "route_weight_sha256": "8d3c59036b48de6eb750e1b44c616e21cd63386267850608ac8f311e2dea9e30", + "loads": [ + 11, + 24, + 13, + 5, + 2, + 8, + 26, + 16, + 11, + 3, + 11, + 5, + 15, + 0, + 7, + 13, + 10, + 16, + 4, + 11, + 15, + 12, + 14, + 11, + 9, + 5, + 9, + 9, + 20, + 7, + 8, + 16, + 7, + 25, + 3, + 5, + 8, + 21, + 10, + 14, + 5, + 5, + 2, + 12, + 6, + 16, + 7, + 9, + 0, + 12, + 23, + 12, + 15, + 6, + 5, + 11, + 7, + 22, + 18, + 15, + 3, + 8, + 7, + 13 + ], + "weighted_loads": [ + 0.7702208794653416, + 2.041252803057432, + 1.0291740745306015, + 0.3296382836997509, + 0.20127757638692856, + 0.5275130458176136, + 1.690748343244195, + 0.8287348579615355, + 0.8578537665307522, + 0.13430487364530563, + 1.027601718902588, + 0.18477222509682178, + 1.2955851145088673, + 0.0, + 1.0088941976428032, + 0.8552093096077442, + 0.8788646273314953, + 1.3510849364101887, + 0.2716129831969738, + 1.116501647979021, + 1.3827883303165436, + 0.4700554069131613, + 1.199750043451786, + 0.8139422331005335, + 1.0142118092626333, + 0.18906359560787678, + 0.5366902872920036, + 0.5073791723698378, + 1.7976427860558033, + 0.37365031242370605, + 0.6146350987255573, + 0.72417251765728, + 0.32410621643066406, + 1.8173322416841984, + 0.13187121413648129, + 0.18713063560426235, + 0.4868917390704155, + 1.8228240814059973, + 0.9353122711181641, + 1.1537208780646324, + 0.20346785336732864, + 0.23464453220367432, + 0.14429201930761337, + 1.1371890790760517, + 0.3581145144999027, + 2.3155028223991394, + 0.24357043579220772, + 0.46917697228491306, + 0.0, + 0.839758213609457, + 1.40583367459476, + 0.5301135499030352, + 1.349891658872366, + 0.2959009185433388, + 0.453646682202816, + 0.9020982831716537, + 0.574723694473505, + 1.6013577673584223, + 1.3225159645080566, + 1.2805765736848116, + 0.1443246342241764, + 0.5844286046922207, + 0.45914771407842636, + 1.0920408740639687 + ], + "unique_experts": 62, + "load_cv": 0.5743583271151282, + "normalized_load_entropy": 0.9581366770484531, + "max_load_share": 0.038348082595870206 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "6b21c567c064a6a3bf74af507d7ffc20c50b78b6a17f4cd5f6928ec0cebcab33", + "route_weight_sha256": "b8da4fa6f1aab7608f3052f53341234b00bf26d15c54b2c334fb484d26a00f55", + "loads": [ + 11, + 27, + 15, + 10, + 2, + 8, + 27, + 16, + 11, + 3, + 21, + 6, + 15, + 13, + 9, + 16, + 10, + 16, + 9, + 11, + 15, + 13, + 16, + 11, + 9, + 11, + 14, + 9, + 20, + 26, + 9, + 17, + 7, + 26, + 15, + 5, + 8, + 23, + 12, + 15, + 8, + 7, + 10, + 12, + 6, + 17, + 18, + 10, + 1, + 13, + 25, + 12, + 15, + 6, + 5, + 11, + 7, + 22, + 18, + 29, + 8, + 8, + 10, + 13 + ], + "weighted_loads": [ + 0.7702208794653416, + 2.1851026713848114, + 1.1506906226277351, + 0.678969636792317, + 0.20127757638692856, + 0.5275130458176136, + 1.7427776623517275, + 0.8287348579615355, + 0.8578537665307522, + 0.13430487364530563, + 1.6852491311728954, + 0.20189966447651386, + 1.2955851145088673, + 0.9226667881011963, + 1.0552938021719456, + 1.0485254898667336, + 0.8788646273314953, + 1.3510849364101887, + 0.6614987327193376, + 1.116501647979021, + 1.3827883303165436, + 0.7610557731240988, + 1.321050189435482, + 0.8139422331005335, + 1.0142118092626333, + 0.6437153983861208, + 1.0441773682832718, + 0.5073791723698378, + 1.7976427860558033, + 1.9122579984250478, + 0.6603419370949268, + 0.7425446975976229, + 0.32410621643066406, + 1.842684743925929, + 1.2571089514822233, + 0.18713063560426235, + 0.4868917390704155, + 1.9112423975020647, + 2.0541470274329185, + 1.1855285242199898, + 0.3448641188442707, + 0.35130003094673157, + 0.5025690235197544, + 1.1371890790760517, + 0.3581145144999027, + 2.3455595523118973, + 1.397910762578249, + 0.5030025485903025, + 0.03694996237754822, + 0.8677579089999199, + 1.5037054736167192, + 0.5301135499030352, + 1.349891658872366, + 0.2959009185433388, + 0.453646682202816, + 0.9020982831716537, + 0.574723694473505, + 1.6013577673584223, + 1.3225159645080566, + 2.020347783342004, + 0.7469127942167688, + 0.5844286046922207, + 0.6804347708821297, + 1.0920408740639687 + ], + "unique_experts": 64, + "load_cv": 0.4918766469019062, + "normalized_load_entropy": 0.9708528120706339, + "max_load_share": 0.035024154589371984 + } + }, + "s1_bos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "38ad88d591fc0bef5027be241892f3c2cdb49583c96501ef4ac5e93d4e30bd78", + "route_weight_sha256": "d907f12215fb9b01a71dff6547b6477bd5c592fbf4cd03bca132c7290f226f74", + "loads": [ + 11, + 24, + 15, + 4, + 2, + 8, + 24, + 17, + 11, + 2, + 10, + 5, + 15, + 0, + 8, + 13, + 10, + 17, + 5, + 11, + 16, + 11, + 13, + 13, + 8, + 4, + 9, + 8, + 19, + 7, + 8, + 15, + 8, + 25, + 3, + 5, + 8, + 21, + 10, + 14, + 5, + 5, + 3, + 12, + 6, + 14, + 7, + 9, + 0, + 12, + 21, + 12, + 15, + 6, + 5, + 11, + 8, + 20, + 18, + 15, + 5, + 8, + 8, + 16 + ], + "weighted_loads": [ + 0.7825876660645008, + 2.009973803535104, + 1.0527299232780933, + 0.28713173419237137, + 0.20420075953006744, + 0.5287723578512669, + 1.5808883402496576, + 0.8723694980144501, + 0.8820333741605282, + 0.0989869236946106, + 1.0222649313509464, + 0.18454615026712418, + 1.3043841123580933, + 0.0, + 1.0207858476787806, + 0.8706140033900738, + 0.8637445829808712, + 1.4100909605622292, + 0.31414756178855896, + 1.0773590989410877, + 1.4315470643341541, + 0.4417289774864912, + 1.1156046725809574, + 0.9006673283874989, + 0.977567920461297, + 0.17483524233102798, + 0.5636634230613708, + 0.4778047427535057, + 1.7813385985791683, + 0.37190018221735954, + 0.6067181527614594, + 0.7000565975904465, + 0.36314259469509125, + 1.8074223045259714, + 0.13194071501493454, + 0.1765956413000822, + 0.4958265833556652, + 1.8147356119006872, + 0.9268936552107334, + 1.1501953229308128, + 0.2014898546040058, + 0.23211708292365074, + 0.17426520213484764, + 1.1413489952683449, + 0.3563723359256983, + 2.200502585619688, + 0.23990699462592602, + 0.4498285409063101, + 0.0, + 0.8552203290164471, + 1.3255974985659122, + 0.5189947225153446, + 1.276998095214367, + 0.31140876933932304, + 0.4661070331931114, + 0.8992676101624966, + 0.6215709745883942, + 1.5485288463532925, + 1.3297307416796684, + 1.316587494686246, + 0.20924660190939903, + 0.5970409363508224, + 0.4867212362587452, + 1.2316231206059456 + ], + "unique_experts": 62, + "load_cv": 0.5556303845325287, + "normalized_load_entropy": 0.9601201729417176, + "max_load_share": 0.03687315634218289 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "3a2674b4391c2d20f9a923c2f85a93eaf9893a01ea286ba5d2978dd719ff36ef", + "route_weight_sha256": "12feea1590a96daa52f3892d870885d9a568bb8561ac0f9d5c3028ae2fa00cd5", + "loads": [ + 11, + 26, + 18, + 14, + 3, + 8, + 27, + 17, + 11, + 10, + 19, + 6, + 16, + 14, + 11, + 17, + 12, + 19, + 13, + 13, + 17, + 13, + 18, + 14, + 8, + 14, + 17, + 8, + 19, + 28, + 9, + 16, + 8, + 26, + 19, + 5, + 9, + 24, + 14, + 17, + 8, + 10, + 12, + 12, + 8, + 16, + 18, + 13, + 1, + 14, + 24, + 12, + 19, + 10, + 11, + 11, + 13, + 22, + 18, + 30, + 14, + 10, + 12, + 18 + ], + "weighted_loads": [ + 0.7825876660645008, + 2.134657980874181, + 1.2234753295779228, + 1.0960617629461922, + 0.24057356640696526, + 0.5287723578512669, + 1.7767619956284761, + 0.8723694980144501, + 0.8820333741605282, + 1.1456674709916115, + 1.612011358141899, + 0.20167358964681625, + 1.4102497920393944, + 0.9804045744240284, + 1.0955536104738712, + 1.1523764804005623, + 1.226629164069891, + 1.480710880830884, + 1.0123284582223278, + 1.1676750369369984, + 1.4804774783551693, + 0.7728454153984785, + 1.5210551135241985, + 0.9948584102094173, + 0.977567920461297, + 0.8722478710114956, + 1.3446549326181412, + 0.4778047427535057, + 1.7813385985791683, + 1.6829558927565813, + 0.6535818055272102, + 0.7184287775307894, + 0.36314259469509125, + 1.832774806767702, + 1.5096009677217808, + 0.1765956413000822, + 0.5231401138007641, + 1.9415046442300081, + 2.2530923783779144, + 1.3615633994340897, + 0.36201049759984016, + 0.4582857404020615, + 0.6065095327794552, + 1.1413489952683449, + 0.4259518403559923, + 2.231037210498471, + 1.4756264183670282, + 0.7868818994611502, + 0.029539680108428, + 0.9193025343120098, + 1.463809259235859, + 0.5189947225153446, + 1.7133107483386993, + 0.49451373890042305, + 1.016452595591545, + 0.8992676101624966, + 1.045451633632183, + 1.6213912647217512, + 1.3297307416796684, + 2.1372364722192287, + 1.3266797251999378, + 0.7924591228365898, + 0.7876310609281063, + 1.3096019439399242 + ], + "unique_experts": 64, + "load_cv": 0.41139209394170506, + "normalized_load_entropy": 0.978915277725728, + "max_load_share": 0.032467532467532464 + } + }, + "s0_x": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "c67d187e839cf376b2c6720715775575da886730fc7b51942dbc6f006df2e169", + "route_weight_sha256": "c22df296b4362ae5bd94672c3c21a943bedd8751860fa8fcb29ad2f69216e606", + "loads": [ + 11, + 23, + 14, + 5, + 2, + 8, + 25, + 15, + 11, + 3, + 10, + 5, + 15, + 0, + 8, + 12, + 10, + 16, + 5, + 11, + 16, + 10, + 15, + 11, + 9, + 4, + 10, + 9, + 19, + 6, + 8, + 16, + 8, + 25, + 3, + 6, + 7, + 21, + 10, + 14, + 5, + 5, + 2, + 12, + 6, + 14, + 8, + 9, + 2, + 12, + 21, + 11, + 15, + 6, + 5, + 11, + 7, + 22, + 18, + 16, + 4, + 9, + 9, + 13 + ], + "weighted_loads": [ + 0.7715515121817589, + 2.0110651087015867, + 1.0446713715791702, + 0.341861579567194, + 0.19759390130639076, + 0.5250356942415237, + 1.6705789770931005, + 0.7955616265535355, + 0.8421204835176468, + 0.13209332525730133, + 1.0015756152570248, + 0.1815808340907097, + 1.2760974392294884, + 0.0, + 1.0241996012628078, + 0.8297888487577438, + 0.8925707116723061, + 1.36830735206604, + 0.32667524740099907, + 1.1178390197455883, + 1.4078424274921417, + 0.4099895264953375, + 1.2851977609097958, + 0.8263186514377594, + 0.9716284908354282, + 0.1489062923938036, + 0.5971701890230179, + 0.5067035928368568, + 1.7732058111578226, + 0.32571809366345406, + 0.607483733445406, + 0.7161152213811874, + 0.34917018562555313, + 1.8079214300960302, + 0.1492882054299116, + 0.22981054708361626, + 0.44592104107141495, + 1.8217848930507898, + 0.9320004992187023, + 1.1437001042068005, + 0.20441198907792568, + 0.2379142828285694, + 0.1478237845003605, + 1.1340271569788456, + 0.35941075161099434, + 2.2494788095355034, + 0.2772061564028263, + 0.4647688511759043, + 0.0648290142416954, + 0.8487155996263027, + 1.307763695716858, + 0.4794146195054054, + 1.3679146282374859, + 0.2906148359179497, + 0.4639918804168701, + 0.899406835436821, + 0.5641018450260162, + 1.6130688600242138, + 1.340336736291647, + 1.2959510181099176, + 0.17972614988684654, + 0.6324287354946136, + 0.534321766346693, + 1.078035969287157 + ], + "unique_experts": 63, + "load_cv": 0.5490768327014587, + "normalized_load_entropy": 0.9623980248621323, + "max_load_share": 0.03687315634218289 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "73714549da7d0d35ecf26f1ba95dafc656c3a03b5a144b3ff76f1c02a0a9f87e", + "route_weight_sha256": "d5c4646c635712ebe4870f0c5abe7896c9a214b6b5103903a8998cfd5d2a6981", + "loads": [ + 11, + 27, + 17, + 9, + 2, + 8, + 25, + 15, + 11, + 3, + 21, + 6, + 15, + 12, + 10, + 15, + 10, + 16, + 10, + 11, + 16, + 11, + 17, + 11, + 9, + 10, + 15, + 9, + 19, + 22, + 9, + 17, + 8, + 26, + 13, + 6, + 7, + 23, + 12, + 14, + 9, + 7, + 11, + 12, + 6, + 15, + 21, + 10, + 4, + 13, + 23, + 11, + 15, + 6, + 5, + 11, + 7, + 22, + 18, + 31, + 8, + 9, + 12, + 14 + ], + "weighted_loads": [ + 0.7715515121817589, + 2.2032726239413023, + 1.1974125169217587, + 0.6569632703904063, + 0.19759390130639076, + 0.5250356942415237, + 1.6705789770931005, + 0.7955616265535355, + 0.8421204835176468, + 0.13209332525730133, + 1.8749561831355095, + 0.19870827347040176, + 1.2760974392294884, + 0.8834008239209652, + 1.0705992057919502, + 1.0305568426847458, + 0.8925707116723061, + 1.36830735206604, + 0.6164910307561513, + 1.1178390197455883, + 1.4078424274921417, + 0.700989892706275, + 1.4163864254951477, + 0.8263186514377594, + 0.9716284908354282, + 0.5401966515928507, + 1.1451401039958, + 0.5067035928368568, + 1.7732058111578226, + 1.560729014861863, + 0.6603634916245937, + 0.7344874013215303, + 0.34917018562555313, + 1.833273932337761, + 1.0583536126941908, + 0.22981054708361626, + 0.44592104107141495, + 1.912523465231061, + 2.041487541049719, + 1.1437001042068005, + 0.4033719878643751, + 0.3536565788090229, + 0.5414817370474339, + 1.1340271569788456, + 0.35941075161099434, + 2.2795355394482613, + 1.678048986941576, + 0.49992471747100353, + 0.14526980370283127, + 0.8767152950167656, + 1.4061480276286602, + 0.4794146195054054, + 1.3679146282374859, + 0.2906148359179497, + 0.4639918804168701, + 0.899406835436821, + 0.5641018450260162, + 1.6130688600242138, + 1.340336736291647, + 2.105268247425556, + 0.5677177924953867, + 0.6324287354946136, + 0.7492525279521942, + 1.1095207743346691 + ], + "unique_experts": 64, + "load_cv": 0.47310942516542015, + "normalized_load_entropy": 0.9737027217842901, + "max_load_share": 0.03743961352657005 + } + }, + "s1_x": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "1730868fe3d2592968f9866523c0b09fbc975aec191823397839f53ed4f71387", + "route_weight_sha256": "243786eda8f036ff0a37fa2800a254b85f139c183b0dac66fa3ea6f5fc4e94cb", + "loads": [ + 11, + 23, + 14, + 5, + 2, + 8, + 24, + 16, + 11, + 4, + 10, + 4, + 15, + 0, + 8, + 14, + 10, + 16, + 5, + 11, + 16, + 11, + 13, + 13, + 8, + 4, + 9, + 8, + 19, + 7, + 8, + 16, + 8, + 24, + 2, + 5, + 8, + 21, + 10, + 14, + 6, + 7, + 2, + 12, + 5, + 14, + 7, + 9, + 0, + 12, + 19, + 11, + 15, + 6, + 5, + 11, + 8, + 22, + 19, + 15, + 5, + 8, + 8, + 17 + ], + "weighted_loads": [ + 0.7813452258706093, + 1.9752704910933971, + 1.0299147237092257, + 0.34835294634103775, + 0.19985084235668182, + 0.5345141217112541, + 1.5556268766522408, + 0.8236050177365541, + 0.8716587647795677, + 0.16041307523846626, + 1.0337831862270832, + 0.15634506940841675, + 1.2823116295039654, + 0.0, + 1.011567261070013, + 0.8889144919812679, + 0.8766944147646427, + 1.3928977996110916, + 0.3237160034477711, + 1.0672550834715366, + 1.4345792271196842, + 0.4485944230109453, + 1.114845123142004, + 0.9135311301797628, + 0.9563826955854893, + 0.16318370401859283, + 0.5589432418346405, + 0.48749174922704697, + 1.768411174416542, + 0.3609909936785698, + 0.6112442389130592, + 0.7113770842552185, + 0.35938379541039467, + 1.7708023991435766, + 0.11542906239628792, + 0.17855260707437992, + 0.48670654743909836, + 1.808633990585804, + 0.9178262203931808, + 1.1566846668720245, + 0.2305291909724474, + 0.3019447438418865, + 0.14259163290262222, + 1.115898236632347, + 0.3226798363029957, + 2.2371090464293957, + 0.24006754718720913, + 0.44924366287887096, + 0.0, + 0.8549975119531155, + 1.2509274557232857, + 0.48309015296399593, + 1.3034214563667774, + 0.30978209152817726, + 0.4701043516397476, + 0.8890995308756828, + 0.6191466432064772, + 1.6214634329080582, + 1.3783816397190094, + 1.3289197236299515, + 0.20519248582422733, + 0.5983041450381279, + 0.49343112856149673, + 1.2312670834362507 + ], + "unique_experts": 62, + "load_cv": 0.5485694704422482, + "normalized_load_entropy": 0.9608302797145738, + "max_load_share": 0.035398230088495575 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "98b7901f01e35a4b64311b403d7216d534bce0f12710ad76e010f5d13491eb01", + "route_weight_sha256": "b45dc2d5494fd94a35c9e593e631ddc63ef0b380414f73f2c1910ce6afb24639", + "loads": [ + 11, + 26, + 18, + 14, + 3, + 8, + 26, + 16, + 11, + 12, + 20, + 5, + 16, + 13, + 11, + 18, + 12, + 18, + 12, + 13, + 17, + 13, + 18, + 14, + 8, + 14, + 17, + 8, + 19, + 27, + 9, + 17, + 8, + 25, + 16, + 5, + 9, + 24, + 14, + 17, + 10, + 12, + 12, + 12, + 7, + 16, + 19, + 14, + 1, + 14, + 22, + 11, + 19, + 10, + 11, + 11, + 13, + 24, + 19, + 30, + 13, + 10, + 12, + 20 + ], + "weighted_loads": [ + 0.7813452258706093, + 2.1485542356967926, + 1.235315253958106, + 1.1243513641529717, + 0.2370040826499462, + 0.5345141217112541, + 1.7011380307376385, + 0.8236050177365541, + 0.8716587647795677, + 1.2070936225354671, + 1.814215138554573, + 0.17347250878810883, + 1.3881773091852665, + 0.9384488947689533, + 1.0863350238651037, + 1.1730396300554276, + 1.2395789958536625, + 1.4635177198797464, + 0.8673213582660537, + 1.1575710214674473, + 1.4835096411406994, + 0.7797108609229326, + 1.5221572779119015, + 1.0077222120016813, + 0.9563826955854893, + 0.8107090480625629, + 1.3619306460022926, + 0.48749174922704697, + 1.768411174416542, + 1.4960693698376417, + 0.6664314866065979, + 0.7297492641955614, + 0.35938379541039467, + 1.7961549013853073, + 1.2710651909874287, + 0.17855260707437992, + 0.5140200778841972, + 1.9362761750817299, + 2.232450809329748, + 1.3680527433753014, + 0.4454087521880865, + 0.5322678972152062, + 0.6153358072042465, + 1.115898236632347, + 0.3922593407332897, + 2.2676436713081785, + 1.6823240499943495, + 0.818833427503705, + 0.029539680108428, + 0.9190797172486782, + 1.388508390635252, + 0.48309015296399593, + 1.7397341094911098, + 0.49288706108927727, + 1.0204499140381813, + 0.8890995308756828, + 1.043027302250266, + 1.694325851276517, + 1.3783816397190094, + 2.188050128519535, + 1.102604916319251, + 0.7937223315238953, + 0.7821266241371632, + 1.3392140213400126 + ], + "unique_experts": 64, + "load_cv": 0.4064425602787489, + "normalized_load_entropy": 0.9791978539290548, + "max_load_share": 0.032467532467532464 + } + }, + "s0_period": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "9af9adbe6e818bda2c9c1f0aab1f1c8b9d264a40c200c6aff5892b92d9e93751", + "route_weight_sha256": "866f32c371a8cf6c5b2554e82d91609ac619f710aa1671e3c268e7ddf0a0a283", + "loads": [ + 11, + 23, + 14, + 5, + 2, + 8, + 25, + 13, + 11, + 3, + 11, + 5, + 15, + 0, + 9, + 14, + 10, + 16, + 5, + 11, + 16, + 10, + 15, + 11, + 9, + 4, + 10, + 9, + 19, + 5, + 8, + 16, + 7, + 25, + 3, + 5, + 7, + 20, + 10, + 14, + 6, + 6, + 2, + 12, + 6, + 14, + 8, + 9, + 1, + 12, + 22, + 10, + 15, + 6, + 5, + 11, + 7, + 22, + 19, + 15, + 4, + 9, + 10, + 13 + ], + "weighted_loads": [ + 0.7750578075647354, + 2.0162599459290504, + 1.048441305756569, + 0.33976512774825096, + 0.19706618413329124, + 0.5234549939632416, + 1.649307046085596, + 0.733697198331356, + 0.8476705923676491, + 0.13252266868948936, + 1.0404817312955856, + 0.1821571420878172, + 1.2846615053713322, + 0.0, + 1.0524911172688007, + 0.902578204870224, + 0.8932399749755859, + 1.3727494850754738, + 0.32865243032574654, + 1.1279512234032154, + 1.4024151600897312, + 0.40669216215610504, + 1.2416276186704636, + 0.8340569511055946, + 0.971938980743289, + 0.1504061073064804, + 0.5999187380075455, + 0.49910290725529194, + 1.7908932529389858, + 0.2742865402251482, + 0.6067739389836788, + 0.7199935335665941, + 0.3127170354127884, + 1.802229167893529, + 0.15227794460952282, + 0.19176398031413555, + 0.44552792608737946, + 1.7896274235099554, + 0.9170895479619503, + 1.1412051282823086, + 0.23210625909268856, + 0.27614183351397514, + 0.1464257538318634, + 1.1403612457215786, + 0.35979827493429184, + 2.266570806503296, + 0.27496884018182755, + 0.46413302049040794, + 0.03868436440825462, + 0.8434738107025623, + 1.3378053270280361, + 0.44591338001191616, + 1.3810522966086864, + 0.28690414130687714, + 0.46747488155961037, + 0.9018818624317646, + 0.5690268501639366, + 1.6257081665098667, + 1.3612176142632961, + 1.246892061084509, + 0.16902501694858074, + 0.6305546350777149, + 0.5642418712377548, + 1.069791067391634 + ], + "unique_experts": 63, + "load_cv": 0.5518589873368365, + "normalized_load_entropy": 0.9616653308798828, + "max_load_share": 0.03687315634218289 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "b2b59688967e96982e91793a553494e08a35e37e9b8bec6d6255190937c4fc53", + "route_weight_sha256": "605080cae391f1623546ebfd26b583e123953593861e84f6c125789974a69313", + "loads": [ + 11, + 27, + 16, + 9, + 2, + 8, + 25, + 13, + 11, + 3, + 21, + 6, + 15, + 12, + 11, + 17, + 10, + 16, + 10, + 11, + 16, + 11, + 18, + 11, + 9, + 10, + 16, + 9, + 19, + 22, + 9, + 17, + 7, + 26, + 13, + 5, + 7, + 22, + 12, + 14, + 9, + 8, + 10, + 12, + 6, + 15, + 20, + 10, + 3, + 13, + 24, + 11, + 16, + 6, + 5, + 11, + 7, + 22, + 19, + 29, + 8, + 9, + 13, + 15 + ], + "weighted_loads": [ + 0.7750578075647354, + 2.2170069478452206, + 1.1699578538537025, + 0.6544680858496577, + 0.19706618413329124, + 0.5234549939632416, + 1.649307046085596, + 0.733697198331356, + 0.8476705923676491, + 0.13252266868948936, + 1.6981291435658932, + 0.19928458146750927, + 1.2846615053713322, + 0.8605449236929417, + 1.0988907217979431, + 1.0871838219463825, + 0.8932399749755859, + 1.3727494850754738, + 0.619573164585745, + 1.1279512234032154, + 1.4024151600897312, + 0.6976925283670425, + 1.4042021706700325, + 0.8340569511055946, + 0.971938980743289, + 0.5256543718278408, + 1.4157700538635254, + 0.49910290725529194, + 1.7908932529389858, + 1.5282065953942947, + 0.6610744744539261, + 0.738365713506937, + 0.3127170354127884, + 1.8275816701352596, + 1.0457946197420824, + 0.19176398031413555, + 0.44552792608737946, + 1.8793061804026365, + 2.0443087480962276, + 1.1412051282823086, + 0.3735025245696306, + 0.3921314887702465, + 0.5047027580440044, + 1.1403612457215786, + 0.35979827493429184, + 2.2966275364160538, + 1.5894176289439201, + 0.4981592521071434, + 0.129856925457716, + 0.8714735060930252, + 1.4350356422364712, + 0.5704857166856527, + 1.4456287808716297, + 0.28690414130687714, + 0.46747488155961037, + 0.9018818624317646, + 0.5690268501639366, + 1.6257081665098667, + 1.3612176142632961, + 2.031690414994955, + 0.54938650506665, + 0.6305546350777149, + 0.7800515182316303, + 1.1296830978244543 + ], + "unique_experts": 64, + "load_cv": 0.47172620575906243, + "normalized_load_entropy": 0.9733562344084696, + "max_load_share": 0.035024154589371984 + } + }, + "s1_period": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "58a50c55765ae1415d30db13e26b0b55d6b908377a571f38c79f1c676f6ecb86", + "route_weight_sha256": "2131d3613116537d57ed358ad7a7574002389059ccad549e1b003a62c7764f08", + "loads": [ + 11, + 24, + 14, + 4, + 2, + 8, + 24, + 17, + 11, + 4, + 10, + 4, + 15, + 0, + 8, + 14, + 10, + 16, + 5, + 11, + 16, + 11, + 14, + 12, + 9, + 4, + 10, + 8, + 18, + 5, + 8, + 15, + 7, + 24, + 2, + 5, + 8, + 21, + 10, + 15, + 6, + 7, + 2, + 13, + 5, + 14, + 7, + 9, + 0, + 12, + 21, + 11, + 15, + 6, + 5, + 11, + 7, + 21, + 20, + 15, + 5, + 8, + 8, + 16 + ], + "weighted_loads": [ + 0.7896550968289375, + 2.0082090236246586, + 1.0177884344011545, + 0.292669840157032, + 0.20097876340150833, + 0.531642809510231, + 1.5420687440782785, + 0.8669588584452868, + 0.8699009381234646, + 0.15908825397491455, + 1.034621063619852, + 0.15890631265938282, + 1.2944851368665695, + 0.0, + 1.0136263277381659, + 0.8901655040681362, + 0.8793454356491566, + 1.38534339889884, + 0.3215969540178776, + 1.0750136226415634, + 1.430153839290142, + 0.4456370584666729, + 1.12058749422431, + 0.8988555073738098, + 0.9610484577715397, + 0.1673869676887989, + 0.6081767491996288, + 0.48201559484004974, + 1.7480798438191414, + 0.2714271992444992, + 0.6072315163910389, + 0.6883841026574373, + 0.3168616332113743, + 1.7637904454022646, + 0.11330025643110275, + 0.17441053688526154, + 0.48071910068392754, + 1.8158229943364859, + 0.9012540802359581, + 1.21371228992939, + 0.22883703745901585, + 0.30002943240106106, + 0.141665767878294, + 1.165630016475916, + 0.32402848824858665, + 2.2401240654289722, + 0.2392363902181387, + 0.4528157003223896, + 0.0, + 0.855757474899292, + 1.3149802032858133, + 0.47873600013554096, + 1.282607477158308, + 0.30819278210401535, + 0.4694722220301628, + 0.8873571455478668, + 0.5885913781821728, + 1.5696753803640604, + 1.3999982867389917, + 1.3183987513184547, + 0.20529144257307053, + 0.5956949852406979, + 0.48847870901227, + 1.1917744651436806 + ], + "unique_experts": 62, + "load_cv": 0.5591274044196046, + "normalized_load_entropy": 0.9594280865563126, + "max_load_share": 0.035398230088495575 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "cf97cc1a740bbaeaa48f48962cfd0fd3093ce268569d86a2a95eeff416ff984f", + "route_weight_sha256": "0eedf6cf47fce2622eb48791478fd62ac3e92600f1702dce57f72be307c52c3d", + "loads": [ + 11, + 27, + 17, + 13, + 3, + 8, + 26, + 17, + 11, + 12, + 19, + 5, + 16, + 13, + 11, + 18, + 12, + 18, + 12, + 13, + 17, + 13, + 20, + 13, + 9, + 13, + 19, + 8, + 18, + 25, + 9, + 16, + 7, + 25, + 15, + 5, + 9, + 25, + 14, + 18, + 9, + 12, + 11, + 13, + 7, + 16, + 18, + 14, + 1, + 14, + 24, + 12, + 20, + 10, + 11, + 11, + 12, + 23, + 20, + 30, + 13, + 10, + 12, + 21 + ], + "weighted_loads": [ + 0.7896550968289375, + 2.169387847185135, + 1.188533840700984, + 1.0703387526446022, + 0.23542147502303123, + 0.531642809510231, + 1.6875798981636763, + 0.8669588584452868, + 0.8699009381234646, + 1.2057688012719154, + 1.6243674904108047, + 0.1760337520390749, + 1.4003508165478706, + 0.9086652882397175, + 1.0883940905332565, + 1.1802559532225132, + 1.2422300167381763, + 1.4559633191674948, + 0.8646695476199966, + 1.165329560637474, + 1.4790842533111572, + 0.7767534963786602, + 1.5611452832818031, + 0.9930465891957283, + 0.9610484577715397, + 0.7556372694671154, + 1.7122477404773235, + 0.48201559484004974, + 1.7480798438191414, + 1.3939635399729013, + 0.6607262790203094, + 0.7067562825977802, + 0.3168616332113743, + 1.7891429476439953, + 1.213326011406025, + 0.17441053688526154, + 0.5080326311290264, + 1.9852342139929533, + 2.2215134240686893, + 1.4250803664326668, + 0.3893576804548502, + 0.5275077156838961, + 0.5739100985229015, + 1.165630016475916, + 0.3936079926788807, + 2.270658690307755, + 1.534289812669158, + 0.8209748044610023, + 0.029539680108428, + 0.9198396801948547, + 1.451848117634654, + 0.5745320785790682, + 1.771216657012701, + 0.49129775166511536, + 1.0198177844285965, + 0.8873571455478668, + 1.0124720372259617, + 1.6425377987325191, + 1.3999982867389917, + 2.2309391498565674, + 1.1019629538059235, + 0.7911131717264652, + 0.7898636870086193, + 1.3634085152298212 + ], + "unique_experts": 64, + "load_cv": 0.41266561590790524, + "normalized_load_entropy": 0.9786194042689351, + "max_load_share": 0.032467532467532464 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 113, + "ordered_topk_exact_tokens": 92, + "set_exact_tokens": 102, + "mean_set_jaccard": 0.9721871049304678, + "mean_token_weighted_tv": 0.007287137737843842, + "aggregate_load_tv": 0.016224188790560472 + }, + "system_bos": { + "tokens": 113, + "ordered_topk_exact_tokens": 81, + "set_exact_tokens": 92, + "mean_set_jaccard": 0.9431099873577751, + "mean_token_weighted_tv": 0.014143970522996598, + "aggregate_load_tv": 0.02654867256637168 + }, + "system_x": { + "tokens": 113, + "ordered_topk_exact_tokens": 70, + "set_exact_tokens": 84, + "mean_set_jaccard": 0.9247787610619469, + "mean_token_weighted_tv": 0.018035399628621815, + "aggregate_load_tv": 0.028023598820058997 + }, + "system_period": { + "tokens": 113, + "ordered_topk_exact_tokens": 74, + "set_exact_tokens": 87, + "mean_set_jaccard": 0.9342604298356512, + "mean_token_weighted_tv": 0.016931161919064755, + "aggregate_load_tv": 0.028023598820058997 + }, + "bos_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 71, + "set_exact_tokens": 83, + "mean_set_jaccard": 0.9241466498103666, + "mean_token_weighted_tv": 0.01947674826117216, + "aggregate_load_tv": 0.028023598820058997 + }, + "bos_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 61, + "set_exact_tokens": 74, + "mean_set_jaccard": 0.8994943109987359, + "mean_token_weighted_tv": 0.023384518558736397, + "aggregate_load_tv": 0.03392330383480826 + }, + "x_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 69, + "set_exact_tokens": 84, + "mean_set_jaccard": 0.9266750948166879, + "mean_token_weighted_tv": 0.018710116344809003, + "aggregate_load_tv": 0.028023598820058997 + }, + "x_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 67, + "set_exact_tokens": 77, + "mean_set_jaccard": 0.9051833122629585, + "mean_token_weighted_tv": 0.023406912350153502, + "aggregate_load_tv": 0.035398230088495575 + }, + "period_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 72, + "set_exact_tokens": 82, + "mean_set_jaccard": 0.915929203539823, + "mean_token_weighted_tv": 0.020028952212460274, + "aggregate_load_tv": 0.030973451327433628 + }, + "period_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 65, + "set_exact_tokens": 77, + "mean_set_jaccard": 0.9032869785082173, + "mean_token_weighted_tv": 0.02375141884801926, + "aggregate_load_tv": 0.038348082595870206 + } + } + }, + "layer_05": { + "layer": 5, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "5ccf99c62db8d467b2c6ac87dabeee257ecc84e1256f28affb2e8598480d664f", + "route_weight_sha256": "0f3594c8fdfa3551600f50c733525008be3dfb33a303ecc6013d01ed4d1df158", + "loads": [ + 11, + 8, + 8, + 12, + 12, + 12, + 10, + 15, + 9, + 10, + 6, + 4, + 11, + 10, + 4, + 14, + 5, + 6, + 8, + 6, + 9, + 12, + 15, + 14, + 6, + 9, + 9, + 15, + 13, + 10, + 23, + 3, + 4, + 28, + 10, + 12, + 6, + 10, + 0, + 9, + 9, + 1, + 20, + 15, + 15, + 16, + 11, + 18, + 9, + 1, + 2, + 5, + 11, + 12, + 7, + 13, + 13, + 19, + 15, + 2, + 16, + 22, + 13, + 15 + ], + "weighted_loads": [ + 0.7520563714206219, + 0.42348581925034523, + 0.41498891450464725, + 0.8063372112810612, + 0.7261637188494205, + 1.502757664769888, + 0.7348427586257458, + 1.1850281208753586, + 0.8684238940477371, + 0.6242943368852139, + 0.2501914370805025, + 0.20013273134827614, + 0.8356817327439785, + 0.49212370067834854, + 0.15062214620411396, + 0.9084823727607727, + 0.3076595962047577, + 0.4087873324751854, + 0.4429421816021204, + 0.23035231605172157, + 0.679608915001154, + 0.9601630829274654, + 1.0007244162261486, + 0.9337265454232693, + 0.3923995550721884, + 0.5298118386417627, + 0.44911474362015724, + 1.5395793281495571, + 2.4002824872732162, + 0.6055063456296921, + 2.0566510930657387, + 0.12593630701303482, + 0.16000417061150074, + 2.122057933360338, + 0.6591532379388809, + 0.7181500624865294, + 0.46630265191197395, + 0.8123530931770802, + 0.0, + 0.7288748323917389, + 0.9019800163805485, + 0.03229616954922676, + 2.112451173365116, + 1.041653361171484, + 0.9879346191883087, + 1.1732805371284485, + 0.7268065437674522, + 1.0365749327465892, + 1.1663751900196075, + 0.038688063621520996, + 0.11076517030596733, + 0.22394349798560143, + 0.47287091333419085, + 0.8205071464180946, + 0.6129233725368977, + 1.1047033444046974, + 1.0168467685580254, + 1.8129305690526962, + 1.3442523013800383, + 0.12365100160241127, + 1.8026262037456036, + 1.3234475683420897, + 0.72841358743608, + 1.27054001390934 + ], + "unique_experts": 63, + "load_cv": 0.5153300304970148, + "normalized_load_entropy": 0.965079307578016, + "max_load_share": 0.04129793510324484 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "226c5106fd67deec001942c677916fcd5d8f4dd14b0620bcac5ac2d5607377fc", + "route_weight_sha256": "97e7e82d4781c7d8916c1978bde74243a9db8877869171639a0af3fab6e8b009", + "loads": [ + 11, + 9, + 8, + 12, + 13, + 14, + 12, + 17, + 10, + 11, + 16, + 4, + 14, + 10, + 4, + 26, + 7, + 12, + 17, + 7, + 11, + 12, + 15, + 14, + 6, + 17, + 9, + 15, + 13, + 10, + 23, + 3, + 4, + 28, + 10, + 17, + 7, + 10, + 11, + 16, + 13, + 9, + 28, + 17, + 16, + 16, + 11, + 20, + 9, + 5, + 10, + 5, + 13, + 21, + 10, + 22, + 13, + 19, + 15, + 3, + 16, + 22, + 13, + 17 + ], + "weighted_loads": [ + 0.7520563714206219, + 0.4269884880632162, + 0.41498891450464725, + 0.8063372112810612, + 0.7279265399556607, + 1.5713072419166565, + 0.8084959276020527, + 1.2337681846693158, + 0.8717762706801295, + 0.6288196421228349, + 0.8457591366022825, + 0.20013273134827614, + 1.0392996668815613, + 0.49212370067834854, + 0.15062214620411396, + 2.8901914753951132, + 0.44828425347805023, + 0.7059692889451981, + 1.360794683918357, + 0.24342724215239286, + 0.6950465166009963, + 0.9601630829274654, + 1.0007244162261486, + 0.9337265454232693, + 0.3923995550721884, + 1.4335969295352697, + 0.44911474362015724, + 1.5395793281495571, + 2.4002824872732162, + 0.6055063456296921, + 2.0566510930657387, + 0.12593630701303482, + 0.16000417061150074, + 2.122057933360338, + 0.6591532379388809, + 1.1397244092077017, + 0.5088948607444763, + 0.8123530931770802, + 1.0665963999927044, + 1.3944200463593006, + 1.0785182788968086, + 0.8344189673662186, + 2.6105422526597977, + 1.1549513079226017, + 1.0686769261956215, + 1.1732805371284485, + 0.7268065437674522, + 1.0545313118491322, + 1.1663751900196075, + 0.22723414283245802, + 0.8056873269379139, + 0.22394349798560143, + 2.1025635870173573, + 1.4167574346065521, + 0.629782028729096, + 1.788255948573351, + 1.0168467685580254, + 1.8129305690526962, + 1.3442523013800383, + 0.1700356788933277, + 1.8026262037456036, + 1.3234475683420897, + 0.72841358743608, + 2.20635399594903 + ], + "unique_experts": 64, + "load_cv": 0.4416790674336617, + "normalized_load_entropy": 0.976181993626385, + "max_load_share": 0.033816425120772944 + } + }, + "s1_eos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "1e9b8f8d47b42a7a65bd30f5fd31f407fb120a5226f4a21354912a3f3a78cbdc", + "route_weight_sha256": "f44d8bfdaa926a09dca9e37a609efa2b664767949332617a392fcfd48786f892", + "loads": [ + 10, + 8, + 7, + 12, + 12, + 13, + 8, + 15, + 8, + 10, + 6, + 4, + 11, + 11, + 4, + 15, + 5, + 6, + 9, + 6, + 10, + 12, + 15, + 15, + 5, + 9, + 11, + 15, + 13, + 9, + 23, + 3, + 4, + 28, + 10, + 12, + 7, + 10, + 1, + 8, + 9, + 1, + 20, + 15, + 15, + 16, + 10, + 18, + 9, + 1, + 2, + 5, + 11, + 12, + 7, + 13, + 13, + 19, + 15, + 2, + 16, + 21, + 13, + 15 + ], + "weighted_loads": [ + 0.7137001678347588, + 0.4182802103459835, + 0.38380105793476105, + 0.8075918592512608, + 0.7319436855614185, + 1.557663906365633, + 0.6679480075836182, + 1.1812196671962738, + 0.8434167951345444, + 0.6289450563490391, + 0.24908766150474548, + 0.19986720755696297, + 0.8234878107905388, + 0.5242042075842619, + 0.15280523337423801, + 0.9652178268879652, + 0.30834751203656197, + 0.4083970710635185, + 0.47959543764591217, + 0.22920429520308971, + 0.6897627133876085, + 0.9539844132959843, + 1.0087495185434818, + 0.9731966704130173, + 0.3542798589915037, + 0.5258651450276375, + 0.5196348018944263, + 1.5205484330654144, + 2.3748322874307632, + 0.5677915159612894, + 2.0722253285348415, + 0.12686173990368843, + 0.15644936822354794, + 2.1276621408760548, + 0.6525665186345577, + 0.722749026492238, + 0.5043356828391552, + 0.8127310872077942, + 0.034322161227464676, + 0.6699745692312717, + 0.8985938504338264, + 0.033249348402023315, + 2.140344560146332, + 1.0359265021979809, + 0.9926612451672554, + 1.1707171350717545, + 0.7014786973595619, + 1.0572918532416224, + 1.193001389503479, + 0.04049775376915932, + 0.11435816437005997, + 0.22320623323321342, + 0.47098246216773987, + 0.8172753751277924, + 0.6099386177957058, + 1.0958959236741066, + 1.0311439335346222, + 1.8093556892126799, + 1.3493054695427418, + 0.12092079967260361, + 1.8065658621490002, + 1.2943748645484447, + 0.7349589709192514, + 1.2752714455127716 + ], + "unique_experts": 64, + "load_cv": 0.5145188858242123, + "normalized_load_entropy": 0.9659021871269874, + "max_load_share": 0.04129793510324484 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "83f6a4cfe60325d547cc1ba640ab2a4291333b17fbc779e7518f08d5fa9af90e", + "route_weight_sha256": "513044a13cfcb622140911331cb442959d4c088327693f9e5872157163e44a8e", + "loads": [ + 11, + 9, + 7, + 18, + 13, + 15, + 17, + 18, + 9, + 11, + 19, + 7, + 16, + 11, + 5, + 29, + 8, + 17, + 21, + 16, + 12, + 12, + 16, + 15, + 6, + 17, + 11, + 17, + 13, + 10, + 23, + 3, + 5, + 29, + 11, + 17, + 9, + 13, + 13, + 19, + 13, + 14, + 33, + 20, + 16, + 16, + 10, + 21, + 9, + 15, + 12, + 7, + 13, + 22, + 11, + 23, + 13, + 19, + 16, + 3, + 17, + 21, + 13, + 19 + ], + "weighted_loads": [ + 0.750152450054884, + 0.4218486456666142, + 0.38380105793476105, + 1.2223216332495213, + 0.7337130055529997, + 1.62935359030962, + 1.6906784065067768, + 1.2796603976748884, + 0.8467762738000602, + 0.6333768158219755, + 1.0432662833482027, + 0.5629830844700336, + 1.2596875838935375, + 0.5242042075842619, + 0.18713638372719288, + 3.4472791240550578, + 0.5314244590699673, + 1.0862288177013397, + 1.7355049550533295, + 1.0806293273344636, + 0.7051087631843984, + 0.9539844132959843, + 1.0463803745806217, + 0.9731966704130173, + 0.4304592292755842, + 1.242084639146924, + 0.5196348018944263, + 1.6939840838313103, + 2.3748322874307632, + 0.6166029367595911, + 2.0722253285348415, + 0.12686173990368843, + 0.2753459420055151, + 2.1708237044513226, + 0.6871853247284889, + 1.261150212958455, + 0.5893941037356853, + 0.9654997698962688, + 1.2411885485053062, + 1.7970787286758423, + 1.0614116080105305, + 1.244467407464981, + 2.9751305542886257, + 1.3460804261267185, + 1.054401259869337, + 1.1707171350717545, + 0.7014786973595619, + 1.1083980749826878, + 1.193001389503479, + 0.8717432944104075, + 1.1945234574377537, + 0.290747057646513, + 2.1003375947475433, + 1.622005421668291, + 0.6652686991728842, + 1.7095349542796612, + 1.0311439335346222, + 1.8093556892126799, + 1.4193246848881245, + 0.16859709843993187, + 1.8527458012104034, + 1.2943748645484447, + 0.7349589709192514, + 2.4530786126852036 + ], + "unique_experts": 64, + "load_cv": 0.41321020950139137, + "normalized_load_entropy": 0.97916166036892, + "max_load_share": 0.03571428571428571 + } + }, + "s0_bos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "a3f9bf41e230d58161da797fab3746b17219407d11ddc6e60dc77ee0a028e14b", + "route_weight_sha256": "234ca369d091a27cbb8aabdd5eacf67f6eba6dac19273d3c88236eef1fdf6abc", + "loads": [ + 10, + 9, + 8, + 12, + 12, + 13, + 8, + 15, + 8, + 9, + 5, + 5, + 11, + 11, + 5, + 14, + 4, + 6, + 8, + 5, + 8, + 11, + 15, + 15, + 5, + 7, + 12, + 16, + 13, + 10, + 23, + 3, + 3, + 28, + 11, + 12, + 7, + 9, + 1, + 8, + 9, + 0, + 19, + 15, + 15, + 16, + 11, + 16, + 9, + 0, + 2, + 5, + 11, + 12, + 7, + 16, + 15, + 19, + 15, + 2, + 16, + 23, + 13, + 17 + ], + "weighted_loads": [ + 0.7413857635110617, + 0.4316615145653486, + 0.4162696208804846, + 0.8508611619472504, + 0.6808502189815044, + 1.5869144685566425, + 0.6435490772128105, + 1.2055113315582275, + 0.8177654650062323, + 0.5811270736157894, + 0.21117259934544563, + 0.22653394378721714, + 0.8231107145547867, + 0.5401355400681496, + 0.1752056796103716, + 0.9446943309158087, + 0.2833532467484474, + 0.4191335327923298, + 0.4732369128614664, + 0.18976176343858242, + 0.6354130320250988, + 0.9377686269581318, + 1.0202167257666588, + 0.982852503657341, + 0.36181867867708206, + 0.4674174599349499, + 0.5594132542610168, + 1.5633099898695946, + 2.466436017304659, + 0.6235706359148026, + 2.066515728831291, + 0.12768958508968353, + 0.12610588036477566, + 2.1785055361688137, + 0.701371144503355, + 0.7357013933360577, + 0.49292879924178123, + 0.7937517836689949, + 0.029924655333161354, + 0.66970269754529, + 0.8977590203285217, + 0.0, + 2.1185077764093876, + 1.0350214280188084, + 1.001475878059864, + 1.173043329268694, + 0.7346299514174461, + 1.0006800284609199, + 1.1578406319022179, + 0.0, + 0.11922808736562729, + 0.22170360386371613, + 0.4515390647575259, + 0.8146647326648235, + 0.6035857535898685, + 1.2154869548976421, + 1.110953962430358, + 1.8595340866595507, + 1.4175970815122128, + 0.13573257625102997, + 1.8851681165397167, + 1.3810092061758041, + 0.7391492184251547, + 1.3584905229508877 + ], + "unique_experts": 62, + "load_cv": 0.5328629115465746, + "normalized_load_entropy": 0.9619240683108221, + "max_load_share": 0.04129793510324484 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "7fba417396a4860580ed9286aa151d1dcf9f8885044d7cd9c9eec92ccf14e65a", + "route_weight_sha256": "ff8e1181b2ae0259e321f2e06ce8e6da68690222d631ac8cd83164e1faee4dfe", + "loads": [ + 10, + 10, + 8, + 12, + 12, + 15, + 10, + 17, + 9, + 9, + 15, + 5, + 14, + 11, + 5, + 27, + 6, + 12, + 18, + 6, + 9, + 11, + 15, + 15, + 5, + 15, + 12, + 16, + 13, + 10, + 23, + 4, + 3, + 28, + 11, + 17, + 7, + 9, + 13, + 16, + 13, + 8, + 28, + 17, + 16, + 16, + 11, + 17, + 9, + 4, + 10, + 5, + 12, + 21, + 9, + 26, + 15, + 19, + 15, + 3, + 16, + 23, + 13, + 19 + ], + "weighted_loads": [ + 0.7413857635110617, + 0.4351641833782196, + 0.4162696208804846, + 0.8508611619472504, + 0.6808502189815044, + 1.655464045703411, + 0.7134940922260284, + 1.2524697156623006, + 0.8211178416386247, + 0.5811270736157894, + 0.8175829723477364, + 0.22653394378721714, + 1.030843984335661, + 0.5401355400681496, + 0.1752056796103716, + 2.9788836245425045, + 0.4242519289255142, + 0.7163154892623425, + 1.5280534643679857, + 0.2028366895392537, + 0.64796482026577, + 0.9377686269581318, + 1.0202167257666588, + 0.982852503657341, + 0.36181867867708206, + 1.3712025508284569, + 0.5594132542610168, + 1.5633099898695946, + 2.466436017304659, + 0.6235706359148026, + 2.066515728831291, + 0.16426602751016617, + 0.12610588036477566, + 2.1785055361688137, + 0.701371144503355, + 1.1568964533507824, + 0.49292879924178123, + 0.7937517836689949, + 1.270081153139472, + 1.3589573614299297, + 1.0742972828447819, + 0.8376574516296387, + 2.6869797818362713, + 1.1542567871510983, + 1.0822181850671768, + 1.173043329268694, + 0.7346299514174461, + 1.0162402028217912, + 1.1578406319022179, + 0.19281354825943708, + 0.8089026883244514, + 0.22170360386371613, + 1.1166067970916629, + 1.410915020853281, + 0.6185412390623242, + 1.8993325494229794, + 1.110953962430358, + 1.8595340866595507, + 1.4175970815122128, + 0.1821172535419464, + 1.8851681165397167, + 1.3810092061758041, + 0.7391492184251547, + 2.2943045049905777 + ], + "unique_experts": 64, + "load_cv": 0.4611186395885092, + "normalized_load_entropy": 0.9743353927342158, + "max_load_share": 0.033816425120772944 + } + }, + "s1_bos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "3253f255d9cc281899e2559ca84ef9dae07494eea9b7211ce449b8557545953a", + "route_weight_sha256": "cda06ac41a81bb89220ad23263562b31118f87413892baa5e073406acad95d90", + "loads": [ + 9, + 9, + 8, + 11, + 12, + 15, + 8, + 15, + 9, + 9, + 5, + 4, + 11, + 12, + 4, + 14, + 4, + 7, + 7, + 6, + 8, + 13, + 16, + 15, + 4, + 7, + 11, + 15, + 13, + 9, + 23, + 3, + 5, + 28, + 11, + 11, + 7, + 10, + 2, + 8, + 9, + 0, + 19, + 15, + 15, + 16, + 11, + 17, + 10, + 1, + 3, + 5, + 10, + 12, + 7, + 14, + 13, + 18, + 15, + 2, + 16, + 23, + 13, + 16 + ], + "weighted_loads": [ + 0.7315899096429348, + 0.430695328861475, + 0.42526909336447716, + 0.8203851766884327, + 0.6941553615033627, + 1.6919504087418318, + 0.6410212330520153, + 1.1944989934563637, + 0.8816110771149397, + 0.5742736347019672, + 0.20677009038627148, + 0.1937081255018711, + 0.7905673459172249, + 0.5947759114205837, + 0.1396988406777382, + 1.0351719483733177, + 0.2819485627114773, + 0.47420288249850273, + 0.4219122529029846, + 0.2291226778179407, + 0.6234670523554087, + 1.0020225904881954, + 1.0502126775681973, + 0.9860626477748156, + 0.3263871967792511, + 0.4662526287138462, + 0.516853827983141, + 1.5288125164806843, + 2.401792924851179, + 0.6080838833004236, + 2.0872348994016647, + 0.13175849243998528, + 0.18647455051541328, + 2.1408712156116962, + 0.7038773633539677, + 0.7095801681280136, + 0.48638737574219704, + 0.818010039627552, + 0.06466633267700672, + 0.6031018570065498, + 0.902687132358551, + 0.0, + 2.1568495482206345, + 1.0362186580896378, + 1.028696108609438, + 1.1870621852576733, + 0.7546614520251751, + 1.0442095631733537, + 1.2329322323203087, + 0.04174322262406349, + 0.16423721611499786, + 0.22258893214166164, + 0.43304030038416386, + 0.8079503774642944, + 0.5932225026190281, + 1.102474207058549, + 1.0606381185352802, + 1.8144525699317455, + 1.4167647883296013, + 0.12888528406620026, + 1.901013307273388, + 1.384052287787199, + 0.7348085027188063, + 1.3263792507350445 + ], + "unique_experts": 63, + "load_cv": 0.5207053710245587, + "normalized_load_entropy": 0.9648886047058032, + "max_load_share": 0.04129793510324484 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "52ef361c2eda1ece079196485537e3efe4c3df9cb10b805406339944ff9b4e9f", + "route_weight_sha256": "b43ac15f9156814c5f11208ce3ce7f233a416c5696ff4b170f101dcb85104b99", + "loads": [ + 10, + 10, + 8, + 17, + 12, + 17, + 17, + 18, + 10, + 9, + 18, + 7, + 16, + 12, + 5, + 29, + 8, + 18, + 21, + 16, + 9, + 13, + 17, + 15, + 5, + 15, + 11, + 17, + 13, + 10, + 23, + 4, + 6, + 29, + 12, + 16, + 8, + 13, + 15, + 19, + 12, + 13, + 33, + 20, + 16, + 16, + 11, + 19, + 10, + 14, + 14, + 7, + 11, + 22, + 10, + 25, + 13, + 18, + 16, + 3, + 17, + 23, + 13, + 20 + ], + "weighted_loads": [ + 0.76804219186306, + 0.43426376418210566, + 0.42526909336447716, + 1.2351149506866932, + 0.6941553615033627, + 1.7636400926858187, + 1.6592467091977596, + 1.2911139666102827, + 0.8849705557804555, + 0.5742736347019672, + 1.0084868371486664, + 0.5568240024149418, + 1.2389603070914745, + 0.5947759114205837, + 0.17402999103069305, + 3.5757224303670228, + 0.5425161197781563, + 1.152034629136324, + 1.8354492746293545, + 1.0805477099493146, + 0.6360188405960798, + 1.0020225904881954, + 1.0878435336053371, + 0.9860626477748156, + 0.4025665670633316, + 1.1824721228331327, + 0.516853827983141, + 1.7022481672465801, + 2.401792924851179, + 0.6568953040987253, + 2.0872348994016647, + 0.1688118577003479, + 0.30537112429738045, + 2.184032779186964, + 0.7384961694478989, + 1.24460569024086, + 0.5319030210375786, + 0.9707787223160267, + 1.439414257183671, + 1.6873757801949978, + 1.0308337956666946, + 1.2229496538639069, + 3.0414187610149384, + 1.3531983084976673, + 1.0904361233115196, + 1.1870621852576733, + 0.7546614520251751, + 1.0928694596514106, + 1.2329322323203087, + 0.8405308937653899, + 1.295500461012125, + 0.2901297565549612, + 1.0981080327183008, + 1.6126804240047932, + 0.6465556430630386, + 1.7380375284701586, + 1.0606381185352802, + 1.8144525699317455, + 1.486784003674984, + 0.17656158283352852, + 1.9471932463347912, + 1.384052287787199, + 0.7348085027188063, + 2.5041864179074764 + ], + "unique_experts": 64, + "load_cv": 0.4161026710821413, + "normalized_load_entropy": 0.9791408028526498, + "max_load_share": 0.03571428571428571 + } + }, + "s0_x": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "3f98f7a9c7bf2f34c0dd86fcc61a65440502447445c7832cea06383f49b0315a", + "route_weight_sha256": "e70174ac05bb4e2dd5f79497bc6fc0d1d5e4214b3ef1ba63ed07baea17c6623b", + "loads": [ + 10, + 10, + 8, + 12, + 11, + 13, + 8, + 15, + 7, + 10, + 5, + 4, + 11, + 11, + 3, + 15, + 4, + 5, + 9, + 6, + 9, + 10, + 16, + 15, + 5, + 8, + 11, + 16, + 13, + 9, + 23, + 3, + 3, + 27, + 10, + 13, + 7, + 9, + 1, + 9, + 9, + 0, + 19, + 15, + 15, + 16, + 11, + 17, + 9, + 2, + 3, + 5, + 12, + 12, + 7, + 13, + 15, + 19, + 15, + 2, + 16, + 23, + 13, + 16 + ], + "weighted_loads": [ + 0.7259682100266218, + 0.4757905378937721, + 0.4096757546067238, + 0.8231569714844227, + 0.6577835083007812, + 1.6216964833438396, + 0.6400393471121788, + 1.1791357956826687, + 0.7756582424044609, + 0.605239050462842, + 0.21718242019414902, + 0.19776728004217148, + 0.8207761012017727, + 0.5369523726403713, + 0.11925678327679634, + 0.9948686063289642, + 0.28268279135227203, + 0.373512651771307, + 0.5133129246532917, + 0.23877568170428276, + 0.6720223128795624, + 0.9002271704375744, + 1.009505471214652, + 0.9653579220175743, + 0.35242412611842155, + 0.49543839506804943, + 0.5184986218810081, + 1.5675888434052467, + 2.4409660547971725, + 0.57970280200243, + 2.0775582380592823, + 0.12843221798539162, + 0.12407650984823704, + 2.154736716300249, + 0.669839795678854, + 0.770213296636939, + 0.49238921515643597, + 0.7853518798947334, + 0.02910199761390686, + 0.7017534878104925, + 0.9012308605015278, + 0.0, + 2.092798825353384, + 1.0273124873638153, + 0.9969141967594624, + 1.1761493310332298, + 0.7340792156755924, + 1.0381984943524003, + 1.133024238049984, + 0.0878097377717495, + 0.17238060384988785, + 0.2258463278412819, + 0.47611898742616177, + 0.807268038392067, + 0.5971846990287304, + 1.0919308308511972, + 1.1025335919111967, + 1.8381802011281252, + 1.4017753638327122, + 0.13416371494531631, + 1.8831303156912327, + 1.379436206072569, + 0.7292002234607935, + 1.2927088364958763 + ], + "unique_experts": 63, + "load_cv": 0.5239041031170542, + "normalized_load_entropy": 0.9639893024284767, + "max_load_share": 0.03982300884955752 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "6cdbd6b8e51069e42e4ceb573ca22b87101d07e9be72286c057c3d91e7d04b55", + "route_weight_sha256": "32c4f895d7cf118fecf7f5f5921f06041c4e4303977396dda9c454e6184d5799", + "loads": [ + 10, + 11, + 8, + 12, + 11, + 15, + 10, + 17, + 8, + 10, + 16, + 4, + 14, + 11, + 3, + 28, + 6, + 11, + 18, + 7, + 10, + 10, + 16, + 15, + 5, + 17, + 11, + 16, + 13, + 9, + 23, + 4, + 3, + 27, + 10, + 18, + 7, + 9, + 11, + 16, + 15, + 8, + 27, + 17, + 16, + 16, + 11, + 18, + 9, + 5, + 11, + 5, + 13, + 23, + 9, + 23, + 15, + 19, + 15, + 3, + 16, + 23, + 13, + 18 + ], + "weighted_loads": [ + 0.7259682100266218, + 0.4792932067066431, + 0.4096757546067238, + 0.8231569714844227, + 0.6577835083007812, + 1.6902460604906082, + 0.7078676633536816, + 1.2252647476270795, + 0.7790106190368533, + 0.605239050462842, + 0.9161739721894264, + 0.19776728004217148, + 1.036718174815178, + 0.5369523726403713, + 0.11925678327679634, + 3.215117479208857, + 0.4247220903635025, + 0.6706946082413197, + 1.4372450299561024, + 0.25185060780495405, + 0.6845741011202335, + 0.9002271704375744, + 1.009505471214652, + 0.9653579220175743, + 0.35242412611842155, + 1.4850279856473207, + 0.5184986218810081, + 1.5675888434052467, + 2.4409660547971725, + 0.57970280200243, + 2.0775582380592823, + 0.16657429933547974, + 0.12407650984823704, + 2.154736716300249, + 0.669839795678854, + 1.1855471711605787, + 0.49238921515643597, + 0.7853518798947334, + 0.9527336545288563, + 1.3616142813116312, + 1.1923151090741158, + 0.8001177161931992, + 2.5444188341498375, + 1.1488180384039879, + 1.0776565037667751, + 1.1761493310332298, + 0.7340792156755924, + 1.0537586687132716, + 1.133024238049984, + 0.2377600846812129, + 0.8439557403326035, + 0.2258463278412819, + 1.1411867197602987, + 1.51832165569067, + 0.612140184501186, + 1.8521380256861448, + 1.1025335919111967, + 1.8381802011281252, + 1.4017753638327122, + 0.18054839223623276, + 1.8831303156912327, + 1.379436206072569, + 0.7292002234607935, + 2.2285228185355663 + ], + "unique_experts": 64, + "load_cv": 0.461927708993789, + "normalized_load_entropy": 0.9737999298572727, + "max_load_share": 0.033816425120772944 + } + }, + "s1_x": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "56dedbe93490c91865d057fc7dd1209f97c913ab2720a6e33b856a22eac866f1", + "route_weight_sha256": "463e7301157c65a7c142a2cf55dd53f4f3f21258772bb33238d1acf836bf53c3", + "loads": [ + 10, + 10, + 8, + 11, + 12, + 15, + 8, + 14, + 8, + 9, + 6, + 5, + 11, + 12, + 3, + 15, + 4, + 7, + 7, + 6, + 10, + 11, + 15, + 15, + 5, + 7, + 11, + 16, + 13, + 10, + 23, + 3, + 6, + 28, + 10, + 13, + 6, + 9, + 0, + 8, + 9, + 1, + 19, + 15, + 15, + 16, + 11, + 17, + 10, + 1, + 3, + 5, + 11, + 12, + 7, + 12, + 14, + 18, + 15, + 2, + 16, + 21, + 13, + 15 + ], + "weighted_loads": [ + 0.7508333660662174, + 0.47345952689647675, + 0.45266385190188885, + 0.768928125500679, + 0.6942722070962191, + 1.7726110219955444, + 0.6419016569852829, + 1.1391183324158192, + 0.8533648997545242, + 0.5741677060723305, + 0.23876766487956047, + 0.2337048463523388, + 0.7860650755465031, + 0.5967766456305981, + 0.11530150659382343, + 1.0767342150211334, + 0.28066572546958923, + 0.4688641056418419, + 0.418811010196805, + 0.23602841794490814, + 0.6733889579772949, + 0.9408680684864521, + 0.9823311939835548, + 0.9974226355552673, + 0.3642832338809967, + 0.4647568576037884, + 0.5121885724365711, + 1.5582850761711597, + 2.3842359371483326, + 0.6266426928341389, + 2.038250047713518, + 0.13341794908046722, + 0.21770762465894222, + 2.101134527474642, + 0.6709130257368088, + 0.7845523841679096, + 0.4546300172805786, + 0.7713422775268555, + 0.0, + 0.5644701384007931, + 0.9102020636200905, + 0.029117237776517868, + 2.12441673129797, + 1.0259520895779133, + 1.0488762818276882, + 1.1888985671103, + 0.7560626342892647, + 1.0432324847206473, + 1.241159662604332, + 0.04189733788371086, + 0.16784914955496788, + 0.2246606331318617, + 0.4738123491406441, + 0.8273939192295074, + 0.5887698344886303, + 1.0378079153597355, + 1.0811422243714333, + 1.801623022183776, + 1.3774973154067993, + 0.12808562442660332, + 1.9319328516721725, + 1.2771343272179365, + 0.738603301346302, + 1.2698994502425194 + ], + "unique_experts": 63, + "load_cv": 0.5112614380341307, + "normalized_load_entropy": 0.9655236761501466, + "max_load_share": 0.04129793510324484 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "857a284ddbf84ea57b685f69b27aa0fccc0e6fbe21da8d6546cbf7090ffade1f", + "route_weight_sha256": "d970c57f3cec2746c12d1996b9d66341dadabd5d320977c0f251e701aa1a605a", + "loads": [ + 11, + 11, + 8, + 17, + 12, + 17, + 16, + 17, + 9, + 9, + 20, + 8, + 16, + 12, + 4, + 30, + 8, + 18, + 20, + 16, + 11, + 11, + 16, + 15, + 6, + 16, + 11, + 18, + 13, + 11, + 23, + 4, + 7, + 30, + 11, + 19, + 7, + 12, + 11, + 19, + 13, + 13, + 32, + 20, + 16, + 16, + 11, + 19, + 10, + 14, + 12, + 7, + 12, + 24, + 10, + 23, + 14, + 18, + 16, + 3, + 17, + 22, + 13, + 19 + ], + "weighted_loads": [ + 0.7872856482863426, + 0.4770279622171074, + 0.45266385190188885, + 1.1836578994989395, + 0.6942722070962191, + 1.8443007059395313, + 1.6230838224291801, + 1.2343997745774686, + 0.85672437842004, + 0.5741677060723305, + 1.1336134057492018, + 0.5968207232654095, + 1.2440082728862762, + 0.5967766456305981, + 0.1496326569467783, + 3.826481253374368, + 0.5521242320537567, + 1.146695852279663, + 1.6557720210403204, + 1.087453450076282, + 0.6859407462179661, + 0.9408680684864521, + 1.0199620500206947, + 0.9974226355552673, + 0.4404626041650772, + 1.259071884676814, + 0.5121885724365711, + 1.7317207269370556, + 2.3842359371483326, + 0.6754541136324406, + 2.038250047713518, + 0.17559172585606575, + 0.3366041984409094, + 2.1885413005948067, + 0.70553183183074, + 1.3550439551472664, + 0.5001456625759602, + 0.9241109602153301, + 1.0410803519189358, + 1.6479899361729622, + 1.1129106730222702, + 1.1590114645659924, + 2.9223951809108257, + 1.3459535837173462, + 1.11061629652977, + 1.1888985671103, + 0.7560626342892647, + 1.0918923811987042, + 1.241159662604332, + 0.8369960626587272, + 1.1812391020357609, + 0.29220145754516125, + 1.138880081474781, + 1.7433283925056458, + 0.6421029749326408, + 1.749457061290741, + 1.0811422243714333, + 1.801623022183776, + 1.447516530752182, + 0.17576192319393158, + 1.9781127907335758, + 1.31346276961267, + 0.738603301346302, + 2.4477066174149513 + ], + "unique_experts": 64, + "load_cv": 0.4153814439407656, + "normalized_load_entropy": 0.9792858338295932, + "max_load_share": 0.03463203463203463 + } + }, + "s0_period": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "85884a702e4406980bdaf94cca2e547528d76665bc5f3cc933ca62317b901746", + "route_weight_sha256": "ae640b3bf91eae145c6087d4ef36abb9e7d7be1744f1518cf6fad49387ec140f", + "loads": [ + 10, + 10, + 8, + 12, + 11, + 13, + 7, + 15, + 8, + 10, + 5, + 4, + 11, + 11, + 4, + 13, + 4, + 5, + 8, + 6, + 8, + 10, + 15, + 15, + 5, + 8, + 11, + 16, + 13, + 10, + 23, + 3, + 3, + 27, + 10, + 12, + 7, + 9, + 1, + 9, + 9, + 0, + 19, + 15, + 15, + 16, + 11, + 18, + 9, + 2, + 3, + 5, + 13, + 12, + 7, + 15, + 15, + 19, + 15, + 2, + 16, + 23, + 13, + 16 + ], + "weighted_loads": [ + 0.7281474079936743, + 0.47283319756388664, + 0.41016246378421783, + 0.8270475976169109, + 0.6612086445093155, + 1.611762948334217, + 0.5961024314165115, + 1.1848080530762672, + 0.8288253024220467, + 0.6087603457272053, + 0.2138615995645523, + 0.19565458595752716, + 0.8053443469107151, + 0.5298758428543806, + 0.1458914764225483, + 0.8977293744683266, + 0.28699666261672974, + 0.37411320582032204, + 0.46369507908821106, + 0.23603545129299164, + 0.6406813710927963, + 0.9026511162519455, + 0.9877877160906792, + 0.9700462371110916, + 0.3548799194395542, + 0.4974473174661398, + 0.5188130289316177, + 1.5701489858329296, + 2.4466408863663673, + 0.6241939142346382, + 2.082782816141844, + 0.12701516598463058, + 0.12203089334070683, + 2.141734629869461, + 0.6619761437177658, + 0.7339464388787746, + 0.4928162284195423, + 0.780078511685133, + 0.028719525784254074, + 0.6854615360498428, + 0.8999545499682426, + 0.0, + 2.0846197344362736, + 1.019383255392313, + 0.9980302229523659, + 1.182505790144205, + 0.7356436401605606, + 1.063064948655665, + 1.1440139301121235, + 0.08673711866140366, + 0.1692425012588501, + 0.22537201270461082, + 0.5136809479445219, + 0.8106113411486149, + 0.5991273261606693, + 1.178852828219533, + 1.0888526402413845, + 1.8465689085423946, + 1.4058873821049929, + 0.13602468371391296, + 1.8806859105825424, + 1.3813181705772877, + 0.7182221747934818, + 1.2902578543871641 + ], + "unique_experts": 63, + "load_cv": 0.5233723387366856, + "normalized_load_entropy": 0.964222449167267, + "max_load_share": 0.03982300884955752 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "6b4d8b4e10a98894740d853dcca8d5b70bb4ab525507e0eccdc4928fa83674df", + "route_weight_sha256": "37dd0ed05b960c36eac672cd626acceb8b8ed1a2c0d104c108b561cf88d4804f", + "loads": [ + 10, + 11, + 8, + 12, + 11, + 15, + 9, + 17, + 9, + 10, + 16, + 4, + 14, + 11, + 4, + 26, + 7, + 12, + 17, + 7, + 9, + 10, + 15, + 15, + 5, + 16, + 11, + 16, + 13, + 10, + 23, + 4, + 3, + 27, + 10, + 18, + 7, + 9, + 11, + 16, + 14, + 8, + 27, + 17, + 17, + 16, + 11, + 19, + 9, + 5, + 11, + 5, + 14, + 21, + 9, + 25, + 15, + 19, + 15, + 3, + 16, + 23, + 13, + 18 + ], + "weighted_loads": [ + 0.7281474079936743, + 0.4763358663767576, + 0.41016246378421783, + 0.8270475976169109, + 0.6612086445093155, + 1.6803125254809856, + 0.6646109968423843, + 1.2307410994544625, + 0.8321776790544391, + 0.6087603457272053, + 0.9132693111896515, + 0.19565458595752716, + 1.017653927206993, + 0.5298758428543806, + 0.1458914764225483, + 2.951079996768385, + 0.46564507484436035, + 0.7281926050782204, + 1.3302229940891266, + 0.24911037739366293, + 0.6532331593334675, + 0.9026511162519455, + 0.9877877160906792, + 0.9700462371110916, + 0.3548799194395542, + 1.4012324083596468, + 0.5188130289316177, + 1.5701489858329296, + 2.4466408863663673, + 0.6241939142346382, + 2.082782816141844, + 0.17067019268870354, + 0.12203089334070683, + 2.141734629869461, + 0.6619761437177658, + 1.1934050843119621, + 0.4928162284195423, + 0.780078511685133, + 0.9156903438270092, + 1.3317123539745808, + 1.1341105960309505, + 0.8307992815971375, + 2.5497665256261826, + 1.1347635686397552, + 1.1339209377765656, + 1.182505790144205, + 0.7356436401605606, + 1.0786251230165362, + 1.1440139301121235, + 0.23721595760434866, + 0.8611583784222603, + 0.22537201270461082, + 1.1787486802786589, + 1.4068616293370724, + 0.614082811633125, + 2.0685177948325872, + 1.0888526402413845, + 1.8465689085423946, + 1.4058873821049929, + 0.1824093610048294, + 1.8806859105825424, + 1.3813181705772877, + 0.7182221747934818, + 2.226071836426854 + ], + "unique_experts": 64, + "load_cv": 0.45274232410163834, + "normalized_load_entropy": 0.9748810246210935, + "max_load_share": 0.03260869565217391 + } + }, + "s1_period": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "976323c7645b79ec20f06b0d47a45ea41b2514636601e0e39c5f1829b9f95998", + "route_weight_sha256": "5d1b95dc837df408f103e1f730b97ff353cc92e00a3ffdffdf083a974733007e", + "loads": [ + 10, + 10, + 8, + 11, + 12, + 15, + 8, + 14, + 8, + 10, + 5, + 5, + 11, + 12, + 3, + 15, + 4, + 7, + 7, + 6, + 10, + 11, + 14, + 15, + 5, + 7, + 11, + 16, + 13, + 10, + 23, + 4, + 5, + 28, + 10, + 12, + 7, + 9, + 0, + 8, + 9, + 1, + 19, + 15, + 15, + 16, + 11, + 18, + 10, + 1, + 3, + 5, + 11, + 12, + 7, + 13, + 14, + 18, + 15, + 2, + 16, + 21, + 12, + 15 + ], + "weighted_loads": [ + 0.7512223124504089, + 0.4712861031293869, + 0.4492055308073759, + 0.7775050066411495, + 0.7043263502418995, + 1.7838439121842384, + 0.6365928612649441, + 1.1542139127850533, + 0.8585483022034168, + 0.601594740524888, + 0.20419986359775066, + 0.23281043022871017, + 0.7805494740605354, + 0.5946877337992191, + 0.11579072661697865, + 1.037274707108736, + 0.28252626955509186, + 0.46648746728897095, + 0.4059854634106159, + 0.234014131128788, + 0.6724670734256506, + 0.9549824967980385, + 0.9415025860071182, + 0.9809645786881447, + 0.36601347476243973, + 0.4729434475302696, + 0.5121910348534584, + 1.5589847341179848, + 2.3935477696359158, + 0.6084830220788717, + 2.056576482951641, + 0.16167946718633175, + 0.1828828528523445, + 2.1220009066164494, + 0.6692030765116215, + 0.7508984692394733, + 0.4900223836302757, + 0.7719856649637222, + 0.0, + 0.5579553227871656, + 0.9146534539759159, + 0.028916174545884132, + 2.1365575566887856, + 1.02932083979249, + 1.0499290898442268, + 1.1928638499230146, + 0.7582115232944489, + 1.0661136098206043, + 1.2405805811285973, + 0.04098374769091606, + 0.16176972165703773, + 0.22438384033739567, + 0.4741022866219282, + 0.8270713686943054, + 0.5914319306612015, + 1.0820852406322956, + 1.0950331278145313, + 1.7923036571592093, + 1.3770523145794868, + 0.13315509259700775, + 1.9709534458816051, + 1.2881976217031479, + 0.710394412279129, + 1.2788192965090275 + ], + "unique_experts": 63, + "load_cv": 0.5109890467188498, + "normalized_load_entropy": 0.9656559932110541, + "max_load_share": 0.04129793510324484 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "5a203209081bb959a1f5add0cb53b136c93a9a6b5a17d75617703efcb899d9f3", + "route_weight_sha256": "3dbe0cd19a78ff390b8334385401d9a4f87791edbdd2d0f9d76f6a6b21b116b7", + "loads": [ + 11, + 11, + 8, + 17, + 12, + 17, + 16, + 17, + 9, + 10, + 19, + 8, + 16, + 12, + 4, + 31, + 8, + 19, + 20, + 16, + 11, + 11, + 15, + 15, + 6, + 15, + 11, + 18, + 13, + 11, + 23, + 5, + 6, + 29, + 11, + 18, + 8, + 12, + 11, + 19, + 13, + 14, + 32, + 20, + 17, + 16, + 11, + 20, + 10, + 14, + 12, + 7, + 12, + 22, + 10, + 24, + 14, + 18, + 16, + 3, + 17, + 22, + 12, + 19 + ], + "weighted_loads": [ + 0.7876745946705341, + 0.47485453845001757, + 0.4492055308073759, + 1.19223478063941, + 0.7043263502418995, + 1.8555335961282253, + 1.6177750267088413, + 1.2490890487097204, + 0.8619077808689326, + 0.601594740524888, + 1.1088803075253963, + 0.5959263071417809, + 1.2378835119307041, + 0.5946877337992191, + 0.1501218769699335, + 3.6554444138891995, + 0.5755721479654312, + 1.186703983694315, + 1.6085186414420605, + 1.0854391632601619, + 0.6850188616663218, + 0.9549824967980385, + 0.9791334420442581, + 0.9809645786881447, + 0.44219284504652023, + 1.1891629416495562, + 0.5121910348534584, + 1.7324203848838806, + 2.3935477696359158, + 0.6572944428771734, + 2.056576482951641, + 0.2074363436549902, + 0.3017794266343117, + 2.165162470191717, + 0.7038218826055527, + 1.3545702658593655, + 0.5355380289256573, + 0.9247543476521969, + 0.999813262373209, + 1.6457739938050508, + 1.0942644216120243, + 1.2748917993158102, + 2.9594633728265762, + 1.3420531898736954, + 1.1570092216134071, + 1.1928638499230146, + 0.7582115232944489, + 1.1147735062986612, + 1.2405805811285973, + 0.834421924315393, + 1.1766742803156376, + 0.29192466475069523, + 1.1391700189560652, + 1.6318014152348042, + 0.644765071105212, + 1.8726392462849617, + 1.0950331278145313, + 1.7923036571592093, + 1.4470715299248695, + 0.180831391364336, + 2.0171333849430084, + 1.3250942267477512, + 0.710394412279129, + 2.4566264636814594 + ], + "unique_experts": 64, + "load_cv": 0.41175635928717513, + "normalized_load_entropy": 0.9797503460435102, + "max_load_share": 0.03463203463203463 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 113, + "ordered_topk_exact_tokens": 100, + "set_exact_tokens": 103, + "mean_set_jaccard": 0.974715549936789, + "mean_token_weighted_tv": 0.007267593426745286, + "aggregate_load_tv": 0.014749262536873156 + }, + "system_bos": { + "tokens": 113, + "ordered_topk_exact_tokens": 82, + "set_exact_tokens": 92, + "mean_set_jaccard": 0.9450063211125157, + "mean_token_weighted_tv": 0.014817337592058213, + "aggregate_load_tv": 0.025073746312684365 + }, + "system_x": { + "tokens": 113, + "ordered_topk_exact_tokens": 69, + "set_exact_tokens": 86, + "mean_set_jaccard": 0.9317319848293301, + "mean_token_weighted_tv": 0.019053700652006452, + "aggregate_load_tv": 0.02654867256637168 + }, + "system_period": { + "tokens": 113, + "ordered_topk_exact_tokens": 70, + "set_exact_tokens": 82, + "mean_set_jaccard": 0.9216182048040454, + "mean_token_weighted_tv": 0.020317327762764376, + "aggregate_load_tv": 0.028023598820058997 + }, + "bos_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 73, + "set_exact_tokens": 85, + "mean_set_jaccard": 0.9254108723135273, + "mean_token_weighted_tv": 0.01957741208308566, + "aggregate_load_tv": 0.030973451327433628 + }, + "bos_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 74, + "set_exact_tokens": 88, + "mean_set_jaccard": 0.9348925410872313, + "mean_token_weighted_tv": 0.02018755479855875, + "aggregate_load_tv": 0.028023598820058997 + }, + "x_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 74, + "set_exact_tokens": 86, + "mean_set_jaccard": 0.9260429835651074, + "mean_token_weighted_tv": 0.01878761067838136, + "aggregate_load_tv": 0.030973451327433628 + }, + "x_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 74, + "set_exact_tokens": 89, + "mean_set_jaccard": 0.9355246523388117, + "mean_token_weighted_tv": 0.021192341062149643, + "aggregate_load_tv": 0.025073746312684365 + }, + "period_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 76, + "set_exact_tokens": 86, + "mean_set_jaccard": 0.9245680573114199, + "mean_token_weighted_tv": 0.01874515651189516, + "aggregate_load_tv": 0.029498525073746312 + }, + "period_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 74, + "set_exact_tokens": 87, + "mean_set_jaccard": 0.9285714285714285, + "mean_token_weighted_tv": 0.022233325118545148, + "aggregate_load_tv": 0.02359882005899705 + } + } + }, + "layer_06": { + "layer": 6, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "0fa01a2bd960a537e62ff4df9d92f507b0555d13af835337829a771bae912cb5", + "route_weight_sha256": "eb30b8bb66c9a71fc84d56eca24c8447e2e4778ec2ffe4221c12700fe9416354", + "loads": [ + 1, + 12, + 15, + 6, + 2, + 11, + 19, + 15, + 2, + 13, + 6, + 5, + 16, + 18, + 17, + 3, + 15, + 4, + 16, + 4, + 17, + 7, + 11, + 8, + 17, + 6, + 9, + 3, + 1, + 23, + 11, + 14, + 12, + 23, + 3, + 2, + 15, + 14, + 18, + 3, + 7, + 13, + 10, + 11, + 3, + 5, + 2, + 11, + 28, + 15, + 10, + 12, + 4, + 4, + 24, + 2, + 11, + 4, + 5, + 7, + 24, + 22, + 14, + 13 + ], + "weighted_loads": [ + 0.03946894779801369, + 0.6723145693540573, + 0.9950683936476707, + 0.24390483647584915, + 0.11249645054340363, + 0.7260293737053871, + 1.7828047312796116, + 1.0046605505049229, + 0.16307033970952034, + 0.8757769577205181, + 0.448979614302516, + 0.38153771683573723, + 1.370425671339035, + 1.549985058605671, + 0.9722368214279413, + 0.29072748124599457, + 0.9514599069952965, + 0.16946909949183464, + 1.325703538954258, + 0.21606852114200592, + 1.287685103714466, + 0.41985294595360756, + 0.9268845468759537, + 0.5031461976468563, + 0.8150125648826361, + 0.3151438757777214, + 0.463063171133399, + 0.3757452368736267, + 0.04858769103884697, + 2.0927886441349983, + 0.49992084316909313, + 1.0800599865615368, + 0.8714993670582771, + 1.6506792679429054, + 0.22091348841786385, + 0.0599915087223053, + 1.3379700630903244, + 0.7700986228883266, + 1.0187822859734297, + 0.1612851694226265, + 0.4073825739324093, + 1.0617287121713161, + 0.41098999977111816, + 0.754502672702074, + 0.0979455653578043, + 0.30022478103637695, + 0.10632675513625145, + 1.0061353296041489, + 2.91931214556098, + 1.3566115833818913, + 0.6407872512936592, + 1.2688394375145435, + 0.20714374631643295, + 0.16905507072806358, + 1.8943494334816933, + 0.08376114070415497, + 0.8032366260886192, + 0.4650142267346382, + 0.1973896063864231, + 0.32135019823908806, + 1.610462848097086, + 1.5420575439929962, + 0.7629565969109535, + 0.8372689038515091 + ], + "unique_experts": 64, + "load_cv": 0.6336005772781643, + "normalized_load_entropy": 0.949076423149661, + "max_load_share": 0.04129793510324484 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "77e6d90c2ef932d604f596ce6da9d059b4c8821b4467767f11ce527a7d1b3550", + "route_weight_sha256": "5e08538396202b7f3375536fe04f9f6e6bd2c5482b4878f2b0a6299d8a555ce9", + "loads": [ + 1, + 15, + 15, + 6, + 3, + 11, + 27, + 15, + 2, + 13, + 6, + 11, + 16, + 20, + 19, + 3, + 20, + 5, + 16, + 12, + 18, + 10, + 13, + 9, + 17, + 7, + 9, + 3, + 1, + 26, + 11, + 14, + 15, + 23, + 4, + 7, + 16, + 23, + 18, + 12, + 7, + 18, + 12, + 11, + 3, + 10, + 14, + 13, + 32, + 15, + 17, + 19, + 4, + 5, + 24, + 12, + 21, + 5, + 5, + 16, + 24, + 22, + 14, + 13 + ], + "weighted_loads": [ + 0.03946894779801369, + 0.7432736158370972, + 0.9950683936476707, + 0.24390483647584915, + 0.14132205210626125, + 0.7260293737053871, + 2.66039165109396, + 1.0046605505049229, + 0.16307033970952034, + 0.8757769577205181, + 0.448979614302516, + 0.7786858137696981, + 1.370425671339035, + 1.5780503582209349, + 1.144961567595601, + 0.29072748124599457, + 1.2856572307646275, + 0.17355844331905246, + 1.325703538954258, + 0.7654728889465332, + 1.3313340209424496, + 0.5742479953914881, + 2.420633092522621, + 0.538861021399498, + 0.8150125648826361, + 0.34301861748099327, + 0.463063171133399, + 0.3757452368736267, + 0.04858769103884697, + 2.2681008391082287, + 0.49992084316909313, + 1.0800599865615368, + 0.9597135446965694, + 1.6506792679429054, + 0.2555124759674072, + 0.5302604660391808, + 1.4211438745260239, + 1.5371072739362717, + 1.0187822859734297, + 0.5253588631749153, + 0.4073825739324093, + 1.460469551384449, + 0.46886423975229263, + 0.754502672702074, + 0.0979455653578043, + 0.4351046700030565, + 1.5095973014831543, + 1.0285016384441406, + 3.1099190749228, + 1.3566115833818913, + 1.0730703845620155, + 1.5758305974304676, + 0.20714374631643295, + 0.2152569778263569, + 1.8943494334816933, + 0.8452574871480465, + 1.935561828315258, + 0.5022161267697811, + 0.1973896063864231, + 1.279756586998701, + 1.610462848097086, + 1.5420575439929962, + 0.7629565969109535, + 0.8372689038515091 + ], + "unique_experts": 64, + "load_cv": 0.5424197959034875, + "normalized_load_entropy": 0.9613700589561139, + "max_load_share": 0.03864734299516908 + } + }, + "s1_eos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "890a9bef817310c66f296c697209b276131e3c49d24ce9198b962c59a925a4e3", + "route_weight_sha256": "6b5025b88ca9ed97ee267c3ce00bdda3f93559d6bf3155b130e836b7601176d3", + "loads": [ + 2, + 11, + 14, + 6, + 2, + 12, + 19, + 15, + 2, + 12, + 5, + 5, + 15, + 18, + 16, + 3, + 15, + 5, + 15, + 4, + 17, + 7, + 11, + 7, + 16, + 6, + 9, + 3, + 1, + 22, + 11, + 14, + 11, + 24, + 3, + 2, + 15, + 15, + 18, + 2, + 8, + 13, + 10, + 11, + 3, + 6, + 3, + 13, + 28, + 15, + 10, + 12, + 4, + 3, + 25, + 2, + 11, + 4, + 5, + 8, + 25, + 22, + 14, + 13 + ], + "weighted_loads": [ + 0.0713663212954998, + 0.630460225045681, + 0.952939298003912, + 0.24381045997142792, + 0.10849396511912346, + 0.7647351436316967, + 1.7771213874220848, + 1.004925787448883, + 0.16415156051516533, + 0.8451849222183228, + 0.420129781588912, + 0.3892771862447262, + 1.3267512433230877, + 1.5639128722250462, + 0.9261825643479824, + 0.2923572286963463, + 0.9468717835843563, + 0.22184161469340324, + 1.2708134427666664, + 0.21680103242397308, + 1.3088871091604233, + 0.4137274734675884, + 0.9161780513823032, + 0.48339948058128357, + 0.7613046448677778, + 0.29897046834230423, + 0.4573170728981495, + 0.3810785636305809, + 0.04660407826304436, + 2.0228826738893986, + 0.49328818917274475, + 1.0801709108054638, + 0.8244576565921307, + 1.6867125928401947, + 0.21923400461673737, + 0.05983761511743069, + 1.3270288072526455, + 0.8296053521335125, + 1.0174414329230785, + 0.13434256240725517, + 0.43311517871916294, + 1.051271267235279, + 0.421528447419405, + 0.7596477344632149, + 0.11320812627673149, + 0.32406179793179035, + 0.14883390069007874, + 1.0641916245222092, + 2.8897796757519245, + 1.3708972930908203, + 0.6360278241336346, + 1.2654272690415382, + 0.20499640703201294, + 0.14330944791436195, + 1.9088033810257912, + 0.08416185900568962, + 0.7980913743376732, + 0.46060171723365784, + 0.20166331343352795, + 0.36336807161569595, + 1.6430318169295788, + 1.5302463732659817, + 0.7673891577869654, + 0.8466372974216938 + ], + "unique_experts": 64, + "load_cv": 0.6327210150697298, + "normalized_load_entropy": 0.9497835569031596, + "max_load_share": 0.04129793510324484 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "0f7835bf3f3d1e15079ab81327906a0bea2493c1e5a0d406a7668156b92c7d65", + "route_weight_sha256": "ff1e098138d8ada354cac78b9db90e610864005ada6f41f47abb5f789e3021ba", + "loads": [ + 2, + 13, + 17, + 7, + 4, + 12, + 34, + 16, + 7, + 18, + 5, + 15, + 19, + 20, + 25, + 4, + 24, + 6, + 17, + 14, + 19, + 11, + 13, + 8, + 18, + 8, + 9, + 4, + 2, + 25, + 11, + 17, + 17, + 25, + 7, + 9, + 17, + 32, + 18, + 11, + 8, + 18, + 12, + 11, + 4, + 9, + 19, + 16, + 31, + 15, + 18, + 18, + 5, + 7, + 25, + 13, + 28, + 4, + 5, + 19, + 30, + 22, + 14, + 13 + ], + "weighted_loads": [ + 0.0713663212954998, + 0.6700617526657879, + 1.0964314602315426, + 0.2813148833811283, + 0.25970192812383175, + 0.7647351436316967, + 3.0782361030578613, + 1.0663639605045319, + 0.5016474612057209, + 1.5460865944623947, + 0.420129781588912, + 1.0597663596272469, + 1.6563800945878029, + 1.5922102737240493, + 1.627602394670248, + 0.40401284396648407, + 1.6627409905195236, + 0.22590534249320626, + 1.4185368493199348, + 0.9734250120818615, + 1.4011723436415195, + 0.6465761009603739, + 2.4084617532789707, + 0.5187483727931976, + 0.8283414114266634, + 0.3770594671368599, + 0.4573170728981495, + 0.4074756130576134, + 0.08397511392831802, + 2.217928070574999, + 0.49328818917274475, + 1.280000638216734, + 1.008313324302435, + 1.7202638946473598, + 0.47698497772216797, + 0.7426958177238703, + 1.4408915378153324, + 2.15642586350441, + 1.0174414329230785, + 0.6120760515332222, + 0.43311517871916294, + 1.4624137617647648, + 0.47944340482354164, + 0.7596477344632149, + 0.19774015620350838, + 0.39111356576904655, + 1.865174738690257, + 1.1178414325695485, + 3.0448794700205326, + 1.3708972930908203, + 1.1548344120383263, + 1.505429670214653, + 0.24164627119898796, + 0.35426752269268036, + 1.9088033810257912, + 1.0946363806724548, + 2.54691469296813, + 0.46060171723365784, + 0.20166331343352795, + 1.4174998216331005, + 1.907243985682726, + 1.5302463732659817, + 0.7673891577869654, + 0.8466372974216938 + ], + "unique_experts": 64, + "load_cv": 0.5413679110892492, + "normalized_load_entropy": 0.9635692470456365, + "max_load_share": 0.0367965367965368 + } + }, + "s0_bos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "8a91378c75f114093dd86393582c77471e9390af1285f3333d31f7f5d24e4812", + "route_weight_sha256": "d827a314a04eb9aa954262f4ff17989fd2ecdf07557129acf3c2269be8a3cec3", + "loads": [ + 1, + 12, + 14, + 8, + 2, + 11, + 19, + 15, + 2, + 14, + 5, + 5, + 16, + 18, + 16, + 3, + 14, + 4, + 13, + 5, + 17, + 7, + 12, + 7, + 15, + 5, + 7, + 3, + 1, + 23, + 11, + 13, + 13, + 22, + 3, + 1, + 15, + 14, + 17, + 4, + 8, + 13, + 11, + 11, + 3, + 5, + 4, + 14, + 29, + 15, + 10, + 12, + 4, + 3, + 26, + 2, + 12, + 4, + 6, + 6, + 24, + 22, + 14, + 13 + ], + "weighted_loads": [ + 0.03882932290434837, + 0.6960358396172523, + 0.9516721554100513, + 0.31626690551638603, + 0.09088815748691559, + 0.742596760392189, + 1.7688585929572582, + 0.9814328290522099, + 0.1663617342710495, + 0.9332338869571686, + 0.43924352526664734, + 0.3925188481807709, + 1.3565678223967552, + 1.5921863205730915, + 0.9795842245221138, + 0.2937086597084999, + 0.9113319218158722, + 0.1581687070429325, + 1.1464247442781925, + 0.24801921844482422, + 1.3065392822027206, + 0.4205728620290756, + 0.9622441157698631, + 0.4805437698960304, + 0.7662015855312347, + 0.25000983476638794, + 0.35477165132761, + 0.36357004940509796, + 0.04729964956641197, + 2.115516260266304, + 0.5036591161042452, + 1.0403213761746883, + 0.9310504030436277, + 1.5755207501351833, + 0.21835415810346603, + 0.040237147361040115, + 1.3328585028648376, + 0.7705092281103134, + 1.0099498517811298, + 0.18575453758239746, + 0.44841501489281654, + 1.066710114479065, + 0.4474583975970745, + 0.7548514623194933, + 0.09975954331457615, + 0.28067266568541527, + 0.20127496495842934, + 1.134770331904292, + 3.2039255015552044, + 1.3854627758264542, + 0.6569726206362247, + 1.2626877017319202, + 0.20488103106617928, + 0.14884928613901138, + 2.0174087919294834, + 0.08329407498240471, + 0.9164433889091015, + 0.4603504091501236, + 0.2252567671239376, + 0.2785522975027561, + 1.6486424170434475, + 1.5603085812181234, + 0.7795151434838772, + 0.8256540559232235 + ], + "unique_experts": 64, + "load_cv": 0.6327210150697298, + "normalized_load_entropy": 0.9494801028855939, + "max_load_share": 0.04277286135693215 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "0b71f4d2b2382850a8d4940674707f1ec27cf3ec6675b397ccd61be4b4184884", + "route_weight_sha256": "e6204a9ad687483b772dbf000d0818b5f1ed7c3ec801bd1153698a373344e72a", + "loads": [ + 1, + 14, + 14, + 8, + 3, + 11, + 27, + 15, + 2, + 14, + 5, + 11, + 16, + 19, + 19, + 4, + 20, + 4, + 13, + 13, + 18, + 10, + 13, + 8, + 15, + 6, + 7, + 3, + 1, + 27, + 11, + 13, + 16, + 22, + 4, + 6, + 16, + 25, + 17, + 13, + 8, + 18, + 13, + 11, + 3, + 9, + 17, + 15, + 33, + 15, + 17, + 19, + 4, + 4, + 26, + 12, + 22, + 4, + 6, + 15, + 24, + 22, + 14, + 13 + ], + "weighted_loads": [ + 0.03882932290434837, + 0.7622457593679428, + 0.9516721554100513, + 0.31626690551638603, + 0.11971375904977322, + 0.742596760392189, + 2.6568586751818657, + 0.9814328290522099, + 0.1663617342710495, + 0.9332338869571686, + 0.43924352526664734, + 0.7998995278030634, + 1.3565678223967552, + 1.6152828969061375, + 1.2017821408808231, + 0.34046391770243645, + 1.2899640910327435, + 0.1581687070429325, + 1.1464247442781925, + 0.7834959998726845, + 1.3501881994307041, + 0.5739259663969278, + 1.5086130127310753, + 0.5162585936486721, + 0.7662015855312347, + 0.2778845764696598, + 0.35477165132761, + 0.36357004940509796, + 0.04729964956641197, + 2.3371352963149548, + 0.5036591161042452, + 1.0403213761746883, + 1.01926458068192, + 1.5755207501351833, + 0.2529531456530094, + 0.5055522508919239, + 1.4034733846783638, + 1.6292112618684769, + 1.0099498517811298, + 0.545995868742466, + 0.44841501489281654, + 1.4654509536921978, + 0.505332637578249, + 0.7548514623194933, + 0.09975954331457615, + 0.41150614619255066, + 1.830832228064537, + 1.153868542984128, + 3.3992748633027077, + 1.3854627758264542, + 1.1399118416011333, + 1.5696788616478443, + 0.20488103106617928, + 0.19173604995012283, + 2.0174087919294834, + 0.8447904214262962, + 2.1213696636259556, + 0.4603504091501236, + 0.2252567671239376, + 1.2369586862623692, + 1.6486424170434475, + 1.5603085812181234, + 0.7795151434838772, + 0.8256540559232235 + ], + "unique_experts": 64, + "load_cv": 0.5578612101003704, + "normalized_load_entropy": 0.9595719738476434, + "max_load_share": 0.03985507246376811 + } + }, + "s1_bos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "68354c4c6d68aa6efc0b72857c73accbc8cb3f6769dcb2b1871e572c304d7278", + "route_weight_sha256": "71c7513a76202cb615f93fcb70fdf13f5ecfdca675759c12b40e678ede76e7b3", + "loads": [ + 2, + 12, + 14, + 7, + 1, + 12, + 20, + 15, + 2, + 14, + 6, + 5, + 16, + 18, + 16, + 3, + 15, + 4, + 13, + 4, + 17, + 7, + 11, + 7, + 15, + 5, + 8, + 3, + 1, + 23, + 10, + 15, + 12, + 22, + 3, + 1, + 15, + 13, + 18, + 2, + 8, + 13, + 12, + 10, + 2, + 6, + 4, + 12, + 29, + 14, + 10, + 11, + 5, + 4, + 25, + 2, + 12, + 4, + 5, + 7, + 24, + 25, + 14, + 13 + ], + "weighted_loads": [ + 0.06849403120577335, + 0.6813866831362247, + 0.9533292464911938, + 0.29505282640457153, + 0.05040765553712845, + 0.8016930632293224, + 1.8102809898555279, + 1.0015359185636044, + 0.16698185727000237, + 0.9528837259858847, + 0.45988378301262856, + 0.4085451737046242, + 1.4045266211032867, + 1.590182475745678, + 0.9689014367759228, + 0.3172632306814194, + 0.9394194558262825, + 0.16374525614082813, + 1.1532362289726734, + 0.22007280588150024, + 1.302312046289444, + 0.4197215661406517, + 0.9047185555100441, + 0.4837937168776989, + 0.7695258744060993, + 0.25098566338419914, + 0.37910142727196217, + 0.37898722290992737, + 0.04632246121764183, + 2.057575646787882, + 0.4702215902507305, + 1.120906699448824, + 0.8807005323469639, + 1.5615837760269642, + 0.21743762865662575, + 0.03740205615758896, + 1.3310570530593395, + 0.7140782997012138, + 1.046380802989006, + 0.12610599398612976, + 0.4287542309612036, + 1.06113875284791, + 0.4934284891933203, + 0.7372427098453045, + 0.06867319159209728, + 0.30470626428723335, + 0.23051408305764198, + 1.0758126303553581, + 3.1719255819916725, + 1.3389009311795235, + 0.6548407711088657, + 1.203217327594757, + 0.24048027768731117, + 0.18984327837824821, + 1.9733872190117836, + 0.08553622290492058, + 0.9428906813263893, + 0.4642191082239151, + 0.20476960763335228, + 0.31871717795729637, + 1.6623695716261864, + 1.6445976588875055, + 0.7842077203094959, + 0.81357267126441 + ], + "unique_experts": 64, + "load_cv": 0.6423299601379041, + "normalized_load_entropy": 0.9480131554580061, + "max_load_share": 0.04277286135693215 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "b07698510635c8fe4cd27935bb8bed500dbcdeb5f1a19fb1fdfeee1842a652b2", + "route_weight_sha256": "6c1a82c1b63f5297548fe749d261d1da626af3bb02aa8bdfc2bc16208f2fb7d1", + "loads": [ + 2, + 13, + 17, + 8, + 3, + 12, + 36, + 16, + 7, + 20, + 6, + 15, + 20, + 19, + 25, + 5, + 25, + 4, + 15, + 14, + 19, + 11, + 12, + 8, + 17, + 7, + 8, + 4, + 2, + 26, + 10, + 18, + 18, + 23, + 7, + 8, + 17, + 30, + 18, + 11, + 8, + 18, + 14, + 10, + 3, + 8, + 21, + 15, + 32, + 14, + 19, + 17, + 6, + 8, + 25, + 13, + 29, + 4, + 5, + 18, + 29, + 25, + 14, + 13 + ], + "weighted_loads": [ + 0.06849403120577335, + 0.7162269875407219, + 1.0968214087188244, + 0.3325572498142719, + 0.20161561854183674, + 0.8016930632293224, + 3.1774885691702366, + 1.0629740916192532, + 0.5044777579605579, + 1.6537853982299566, + 0.45988378301262856, + 1.0979215577244759, + 1.734155472368002, + 1.613279052078724, + 1.6782009862363338, + 0.4807828217744827, + 1.6995205469429493, + 0.16374525614082813, + 1.3009596355259418, + 0.9683698080480099, + 1.3945972807705402, + 0.6519301291555166, + 1.4510874524712563, + 0.519142609089613, + 0.8355273529887199, + 0.3290746621787548, + 0.37910142727196217, + 0.40538427233695984, + 0.0836934968829155, + 2.251876626163721, + 0.4702215902507305, + 1.320736426860094, + 1.0688451454043388, + 1.5951350778341293, + 0.47518860176205635, + 0.7254731468856335, + 1.4325469247996807, + 2.079446420073509, + 1.046380802989006, + 0.6038394831120968, + 0.4287542309612036, + 1.4722812473773956, + 0.5513434465974569, + 0.7372427098453045, + 0.15320522151887417, + 0.3679743353277445, + 2.1045066732913256, + 1.1834225207567215, + 3.340184696018696, + 1.3389009311795235, + 1.2669788785278797, + 1.4432197287678719, + 0.2771301418542862, + 0.39923010393977165, + 1.9733872190117836, + 1.0960107445716858, + 2.763538431376219, + 0.4642191082239151, + 0.20476960763335228, + 1.372848927974701, + 1.9265817403793335, + 1.6445976588875055, + 0.7842077203094959, + 0.81357267126441 + ], + "unique_experts": 64, + "load_cv": 0.555041834406712, + "normalized_load_entropy": 0.961791941273844, + "max_load_share": 0.03896103896103896 + } + }, + "s0_x": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "2eafc9fad2f70b04730a8be4e1b354d5a579848b80a6679e01b65b515be1f408", + "route_weight_sha256": "969326d9034cd779372410b0551e8192a491a0d734171d7c1d396786e15afacd", + "loads": [ + 1, + 12, + 12, + 6, + 2, + 11, + 19, + 14, + 2, + 13, + 5, + 5, + 16, + 17, + 17, + 3, + 15, + 3, + 14, + 5, + 17, + 7, + 13, + 8, + 17, + 6, + 9, + 4, + 1, + 23, + 10, + 13, + 14, + 22, + 3, + 1, + 15, + 12, + 16, + 3, + 9, + 13, + 11, + 11, + 3, + 6, + 4, + 12, + 29, + 15, + 10, + 12, + 4, + 3, + 26, + 1, + 12, + 4, + 5, + 8, + 24, + 23, + 14, + 13 + ], + "weighted_loads": [ + 0.03846403583884239, + 0.6932062357664108, + 0.8565048538148403, + 0.255322840064764, + 0.09384877234697342, + 0.7375819534063339, + 1.722742035984993, + 0.9510126151144505, + 0.16379966959357262, + 0.8758775033056736, + 0.44074074551463127, + 0.3950742036104202, + 1.3492403589189053, + 1.5352381467819214, + 1.0479805562645197, + 0.28645894676446915, + 0.9649251215159893, + 0.11169444769620895, + 1.1783475764095783, + 0.25416402146220207, + 1.2941257767379284, + 0.4321901239454746, + 0.9942900277674198, + 0.5011440441012383, + 0.8376962579786777, + 0.2966048903763294, + 0.4206908270716667, + 0.41770675778388977, + 0.047954343259334564, + 2.0944791175425053, + 0.4675343930721283, + 1.011192463338375, + 0.9700250066816807, + 1.5581197999417782, + 0.21736545115709305, + 0.03546394780278206, + 1.3438856080174446, + 0.7187206465750933, + 0.9795774072408676, + 0.16242125630378723, + 0.47622692957520485, + 1.0510826222598553, + 0.45168359763920307, + 0.7701435089111328, + 0.10418341867625713, + 0.30641575902700424, + 0.21224288269877434, + 1.067158890888095, + 3.159216407686472, + 1.3739684596657753, + 0.6804144494235516, + 1.2555789947509766, + 0.2056657001376152, + 0.15090196207165718, + 1.991483185440302, + 0.04671692103147507, + 0.9198126867413521, + 0.4415115863084793, + 0.20369400084018707, + 0.34935103729367256, + 1.6342421658337116, + 1.6372515223920345, + 0.7646211124956608, + 0.8234276063740253 + ], + "unique_experts": 64, + "load_cv": 0.6342594484826288, + "normalized_load_entropy": 0.9489256398781014, + "max_load_share": 0.04277286135693215 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "eeef5cfa41edaa364d0eefb413398b9c19675e2d443b666170c8c33b41fcca48", + "route_weight_sha256": "be1457c850b8d69cd765cbb2eb72e28a07e0b1bfdc8c3c83bc41242c16479fea", + "loads": [ + 1, + 14, + 12, + 6, + 3, + 11, + 29, + 14, + 2, + 13, + 5, + 10, + 16, + 18, + 20, + 4, + 20, + 3, + 14, + 14, + 18, + 10, + 14, + 9, + 17, + 7, + 9, + 4, + 1, + 26, + 10, + 13, + 17, + 22, + 4, + 6, + 16, + 23, + 16, + 11, + 9, + 20, + 13, + 11, + 3, + 10, + 16, + 13, + 33, + 15, + 15, + 20, + 4, + 4, + 26, + 12, + 21, + 4, + 5, + 18, + 24, + 23, + 14, + 13 + ], + "weighted_loads": [ + 0.03846403583884239, + 0.7594161555171013, + 0.8565048538148403, + 0.255322840064764, + 0.12267437390983105, + 0.7375819534063339, + 2.9008623994886875, + 0.9510126151144505, + 0.16379966959357262, + 0.8758775033056736, + 0.44074074551463127, + 0.74867526255548, + 1.3492403589189053, + 1.5583347231149673, + 1.2672341149300337, + 0.32992810010910034, + 1.2971219159662724, + 0.11169444769620895, + 1.1783475764095783, + 0.8583422861993313, + 1.3377746939659119, + 0.5811284687370062, + 1.540658924728632, + 0.5368588678538799, + 0.8376962579786777, + 0.3244796320796013, + 0.4206908270716667, + 0.41770675778388977, + 0.047954343259334564, + 2.2678851932287216, + 0.4675343930721283, + 1.011192463338375, + 1.058239184319973, + 1.5581197999417782, + 0.25196443870663643, + 0.5311524532735348, + 1.4112335965037346, + 1.528773421421647, + 0.9795774072408676, + 0.47979073598980904, + 0.47622692957520485, + 1.5883827432990074, + 0.5095578376203775, + 0.7701435089111328, + 0.10418341867625713, + 0.43724923953413963, + 1.5638214573264122, + 1.0862571019679308, + 3.3598732613027096, + 1.3739684596657753, + 1.0365943424403667, + 1.597910389304161, + 0.2056657001376152, + 0.19308293983340263, + 1.991483185440302, + 0.8639698587357998, + 1.9862638637423515, + 0.4415115863084793, + 0.20369400084018707, + 1.3837015964090824, + 1.6342421658337116, + 1.6372515223920345, + 0.7646211124956608, + 0.8234276063740253 + ], + "unique_experts": 64, + "load_cv": 0.5606987302606412, + "normalized_load_entropy": 0.9592776372237166, + "max_load_share": 0.03985507246376811 + } + }, + "s1_x": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "dd90746a239431370bdff1688de012c2f944f81af682fb77e2d149a766841062", + "route_weight_sha256": "5e5478a0fe4673c13c2880c4800b609bdfba1ea3bcaf4d31a5420d17ea4da748", + "loads": [ + 2, + 11, + 15, + 7, + 1, + 11, + 20, + 15, + 2, + 14, + 5, + 5, + 17, + 16, + 16, + 3, + 14, + 3, + 15, + 4, + 17, + 8, + 10, + 7, + 17, + 4, + 9, + 4, + 1, + 24, + 10, + 15, + 12, + 21, + 3, + 1, + 15, + 12, + 17, + 3, + 8, + 13, + 11, + 11, + 3, + 5, + 5, + 13, + 29, + 16, + 10, + 11, + 5, + 3, + 26, + 1, + 12, + 4, + 5, + 8, + 24, + 23, + 13, + 13 + ], + "weighted_loads": [ + 0.0706738755106926, + 0.6532066240906715, + 0.9995359107851982, + 0.2973179891705513, + 0.04919445514678955, + 0.7644265070557594, + 1.837066389620304, + 0.9982003606855869, + 0.166516475379467, + 0.952228706330061, + 0.4389739762991667, + 0.4215863198041916, + 1.4508023411035538, + 1.5085983760654926, + 0.976655125617981, + 0.30331042408943176, + 0.8849215768277645, + 0.13397954031825066, + 1.2332330420613289, + 0.22540080174803734, + 1.3104124665260315, + 0.45026494935154915, + 0.8526132702827454, + 0.47471676394343376, + 0.821739898994565, + 0.2174988128244877, + 0.408511396497488, + 0.4170246794819832, + 0.04772625491023064, + 2.0320422276854515, + 0.4648972228169441, + 1.0880876556038857, + 0.8693753927946091, + 1.4978569000959396, + 0.2191750891506672, + 0.03569555655121803, + 1.343751072883606, + 0.6688993759453297, + 1.0138688459992409, + 0.158341433852911, + 0.42095103301107883, + 1.0564846061170101, + 0.46648704819381237, + 0.7812205404043198, + 0.11247760057449341, + 0.2699040025472641, + 0.283553633838892, + 1.127920351922512, + 3.152892593294382, + 1.424738820642233, + 0.6653259173035622, + 1.2124751321971416, + 0.23956676945090294, + 0.15460727736353874, + 1.937595073133707, + 0.04991426691412926, + 0.8647458739578724, + 0.4397832825779915, + 0.21261965483427048, + 0.35432257503271103, + 1.6657191067934036, + 1.589487724006176, + 0.7383554093539715, + 0.8034014515578747 + ], + "unique_experts": 64, + "load_cv": 0.6421131719071592, + "normalized_load_entropy": 0.9478362617896782, + "max_load_share": 0.04277286135693215 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "7b83eb337001c24f96cfecc44e951686de6bc310a88be4135ef501eb253b97b9", + "route_weight_sha256": "2a5a01732476811dea0225ed43d34695c07f1fa3b9b7426fa673469d89b68d77", + "loads": [ + 2, + 12, + 18, + 8, + 3, + 11, + 38, + 16, + 7, + 20, + 5, + 14, + 21, + 17, + 25, + 5, + 23, + 3, + 17, + 16, + 19, + 12, + 11, + 8, + 19, + 6, + 9, + 5, + 2, + 27, + 10, + 18, + 17, + 22, + 7, + 8, + 17, + 28, + 17, + 12, + 8, + 20, + 13, + 11, + 4, + 7, + 21, + 15, + 32, + 16, + 18, + 18, + 6, + 6, + 26, + 13, + 28, + 4, + 5, + 20, + 29, + 23, + 13, + 13 + ], + "weighted_loads": [ + 0.0706738755106926, + 0.6880469284951687, + 1.1430280730128288, + 0.3348224125802517, + 0.20040241815149784, + 0.7644265070557594, + 3.5223602689802647, + 1.0596385337412357, + 0.5040123760700226, + 1.653130378574133, + 0.4389739762991667, + 1.061646930873394, + 1.780431192368269, + 1.5316949523985386, + 1.676030494272709, + 0.48158277571201324, + 1.6030369848012924, + 0.13397954031825066, + 1.3809564486145973, + 1.066883347928524, + 1.4026977010071278, + 0.6826058123260736, + 1.3989821672439575, + 0.5100656561553478, + 0.8875425588339567, + 0.29558781161904335, + 0.408511396497488, + 0.44342172890901566, + 0.0850972905755043, + 2.2227812223136425, + 0.4648972228169441, + 1.2879173830151558, + 1.0185298770666122, + 1.5314082019031048, + 0.4769260622560978, + 0.7174566760659218, + 1.4507046043872833, + 1.8910458236932755, + 1.0138688459992409, + 0.636074922978878, + 0.42095103301107883, + 1.5998234301805496, + 0.524402005597949, + 0.7812205404043198, + 0.1970096305012703, + 0.33317207358777523, + 1.8797506038099527, + 1.1782917343080044, + 3.3253347650170326, + 1.424738820642233, + 1.195102270692587, + 1.4818799421191216, + 0.27621663361787796, + 0.3221423365175724, + 1.937595073133707, + 1.131151132285595, + 2.507738944143057, + 0.4397832825779915, + 0.21261965483427048, + 1.4797358103096485, + 1.9299312755465508, + 1.589487724006176, + 0.7383554093539715, + 0.8034014515578747 + ], + "unique_experts": 64, + "load_cv": 0.5586764162673811, + "normalized_load_entropy": 0.9612206685177217, + "max_load_share": 0.04112554112554113 + } + }, + "s0_period": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "114fd575808236b2d7735c96dcf93a4148568660e018c2108031359b3fb58536", + "route_weight_sha256": "61ebc434f8f2122397478f5efd4d51e71203c68d09f3656198c33126e0811c00", + "loads": [ + 1, + 12, + 13, + 6, + 2, + 11, + 19, + 15, + 2, + 13, + 5, + 5, + 16, + 17, + 17, + 3, + 13, + 4, + 14, + 5, + 17, + 8, + 13, + 8, + 16, + 6, + 9, + 4, + 1, + 23, + 11, + 13, + 13, + 22, + 3, + 1, + 15, + 13, + 16, + 3, + 8, + 13, + 11, + 11, + 4, + 5, + 5, + 12, + 29, + 15, + 10, + 12, + 4, + 3, + 26, + 1, + 12, + 4, + 5, + 7, + 24, + 22, + 14, + 13 + ], + "weighted_loads": [ + 0.03826751559972763, + 0.70836416259408, + 0.8958458453416824, + 0.2515309862792492, + 0.09444597363471985, + 0.744594395160675, + 1.7335949391126633, + 0.989568367600441, + 0.16487639397382736, + 0.8881603367626667, + 0.4412927906960249, + 0.39790206402540207, + 1.335306953638792, + 1.5399391204118729, + 1.0332710072398186, + 0.27698586136102676, + 0.8732999712228775, + 0.15806437656283379, + 1.1838009916245937, + 0.2615789845585823, + 1.291201751679182, + 0.4727856144309044, + 0.9942555781453848, + 0.5064235422760248, + 0.8006845638155937, + 0.29799698665738106, + 0.42726720310747623, + 0.4138571061193943, + 0.0484037920832634, + 2.0877601467072964, + 0.5270842127501965, + 1.0212924033403397, + 0.9351459313184023, + 1.5257344469428062, + 0.21557868272066116, + 0.032292407006025314, + 1.3439760617911816, + 0.7682214789092541, + 0.9659988284111023, + 0.16293277218937874, + 0.4380842372775078, + 1.0622088089585304, + 0.45808470994234085, + 0.7457568868994713, + 0.14167595654726028, + 0.27669813111424446, + 0.2545675225555897, + 1.0796112082898617, + 3.153835780918598, + 1.3740929700434208, + 0.6881099976599216, + 1.258351631462574, + 0.20791346579790115, + 0.15033763274550438, + 1.9641702435910702, + 0.046788908541202545, + 0.8893986828625202, + 0.44384123384952545, + 0.19956394284963608, + 0.3151729740202427, + 1.6283733993768692, + 1.5844030976295471, + 0.7573638297617435, + 0.8191839978098869 + ], + "unique_experts": 64, + "load_cv": 0.6269737848623093, + "normalized_load_entropy": 0.9501888152440686, + "max_load_share": 0.04277286135693215 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "03afa9bb24771f516b4a9db40d73c76f17364fa6913806b280123e3cb22d021d", + "route_weight_sha256": "7a5dffd3ff003047e40dd1c06c4db9b2abeb11f992729165b68f07996d637b20", + "loads": [ + 1, + 14, + 13, + 6, + 3, + 11, + 29, + 15, + 2, + 13, + 5, + 10, + 17, + 18, + 19, + 4, + 18, + 4, + 14, + 15, + 18, + 11, + 14, + 9, + 16, + 7, + 9, + 4, + 2, + 26, + 11, + 13, + 16, + 22, + 4, + 6, + 16, + 24, + 16, + 11, + 8, + 19, + 13, + 11, + 4, + 9, + 17, + 13, + 33, + 15, + 15, + 20, + 4, + 4, + 26, + 12, + 21, + 4, + 5, + 16, + 24, + 22, + 14, + 13 + ], + "weighted_loads": [ + 0.03826751559972763, + 0.7745740823447704, + 0.8958458453416824, + 0.2515309862792492, + 0.12327157519757748, + 0.744594395160675, + 2.789269495755434, + 0.989568367600441, + 0.16487639397382736, + 0.8881603367626667, + 0.4412927906960249, + 0.7544310074299574, + 1.388823539018631, + 1.5630356967449188, + 1.2136120721697807, + 0.314785722643137, + 1.1971716061234474, + 0.15806437656283379, + 1.1838009916245937, + 0.9599874503910542, + 1.3348506689071655, + 0.621326444670558, + 1.540624475106597, + 0.5421383660286665, + 0.8006845638155937, + 0.3258717283606529, + 0.42726720310747623, + 0.4138571061193943, + 0.15565130859613419, + 2.2650827541947365, + 0.5270842127501965, + 1.0212924033403397, + 1.0233601089566946, + 1.5257344469428062, + 0.25017767027020454, + 0.530557956546545, + 1.4116543047130108, + 1.6678839176893234, + 0.9659988284111023, + 0.48030225187540054, + 0.4380842372775078, + 1.5170309282839298, + 0.5159589499235153, + 0.7457568868994713, + 0.14167595654726028, + 0.40753161162137985, + 1.605277094990015, + 1.0987094193696976, + 3.3491124734282494, + 1.3740929700434208, + 1.039135403931141, + 1.5994877479970455, + 0.20791346579790115, + 0.19378318265080452, + 1.9641702435910702, + 0.9553478099405766, + 1.9388507641851902, + 0.44384123384952545, + 0.19956394284963608, + 1.2735793627798557, + 1.6283733993768692, + 1.5844030976295471, + 0.7573638297617435, + 0.8191839978098869 + ], + "unique_experts": 64, + "load_cv": 0.5511270671376233, + "normalized_load_entropy": 0.9611304694291884, + "max_load_share": 0.03985507246376811 + } + }, + "s1_period": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "10b5c0f158882875b2609646d8d190ad1b6ee9170d20dcb9a7c69ccca618fb26", + "route_weight_sha256": "8e6a1635ac0b89a8427653fe578aaa6d46bc9fab70b2bf2d4417c44562de7d3d", + "loads": [ + 3, + 12, + 15, + 7, + 1, + 11, + 20, + 13, + 2, + 15, + 5, + 5, + 16, + 17, + 15, + 3, + 14, + 3, + 15, + 5, + 17, + 8, + 11, + 7, + 17, + 5, + 9, + 3, + 1, + 24, + 10, + 14, + 12, + 21, + 3, + 1, + 15, + 13, + 17, + 3, + 7, + 13, + 10, + 10, + 4, + 5, + 4, + 13, + 29, + 16, + 10, + 11, + 5, + 4, + 26, + 2, + 12, + 4, + 5, + 8, + 24, + 22, + 13, + 13 + ], + "weighted_loads": [ + 0.10410761460661888, + 0.6999278552830219, + 1.0062052235007286, + 0.29284700378775597, + 0.0521697998046875, + 0.7610584087669849, + 1.8396432437002659, + 0.9213757626712322, + 0.16671405360102654, + 0.984296727925539, + 0.43306330777704716, + 0.42444758117198944, + 1.3799001425504684, + 1.5683387331664562, + 0.9440341033041477, + 0.30327627062797546, + 0.883914690464735, + 0.13458960130810738, + 1.209705427289009, + 0.2714052349328995, + 1.2929770089685917, + 0.45048240944743156, + 0.9006719812750816, + 0.4820687361061573, + 0.8402833621948957, + 0.2575766071677208, + 0.41391964070498943, + 0.3769245222210884, + 0.048067621886730194, + 2.0369062460958958, + 0.4653695747256279, + 1.052579514682293, + 0.8802495449781418, + 1.4859676659107208, + 0.21974441036581993, + 0.03542037308216095, + 1.335906032472849, + 0.7085429988801479, + 1.0039122514426708, + 0.159232459962368, + 0.3783791419118643, + 1.0533422082662582, + 0.4296747352927923, + 0.7259972840547562, + 0.14190992526710033, + 0.27075763791799545, + 0.2505369707942009, + 1.1414689905941486, + 3.1511393636465073, + 1.4110489934682846, + 0.6831909157335758, + 1.2052989453077316, + 0.24382515624165535, + 0.1886322721838951, + 1.9386779963970184, + 0.0855451263487339, + 0.860433753579855, + 0.4412192106246948, + 0.20798511989414692, + 0.3600013814866543, + 1.6411398611962795, + 1.5541391130536795, + 0.7190139349550009, + 0.7968595623970032 + ], + "unique_experts": 64, + "load_cv": 0.631619839888225, + "normalized_load_entropy": 0.9501347097837612, + "max_load_share": 0.04277286135693215 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "dddcee01381f9255517dfd4d55c3b7595975bfba292544a431ada5309ac06e48", + "route_weight_sha256": "fb2b7be55b617e03ad881312279c8581621a12194105883e1a2dbb05d1d5f715", + "loads": [ + 3, + 13, + 18, + 8, + 3, + 11, + 38, + 14, + 7, + 21, + 5, + 14, + 21, + 18, + 24, + 5, + 23, + 3, + 17, + 17, + 19, + 12, + 12, + 8, + 19, + 7, + 9, + 4, + 3, + 27, + 10, + 17, + 17, + 22, + 7, + 8, + 17, + 30, + 17, + 12, + 7, + 19, + 12, + 10, + 5, + 7, + 21, + 15, + 31, + 16, + 17, + 18, + 6, + 7, + 26, + 14, + 28, + 4, + 5, + 19, + 29, + 22, + 13, + 13 + ], + "weighted_loads": [ + 0.10410761460661888, + 0.7347681596875191, + 1.1496973857283592, + 0.33035142719745636, + 0.2033777628093958, + 0.7610584087669849, + 3.3798410519957542, + 0.982813935726881, + 0.5042099542915821, + 1.685198400169611, + 0.43306330777704716, + 1.0642514526844025, + 1.7745277173817158, + 1.5914353094995022, + 1.6442875005304813, + 0.4685034565627575, + 1.5973105728626251, + 0.13458960130810738, + 1.3574288338422775, + 1.210355643182993, + 1.385262243449688, + 0.6821568999439478, + 1.4470408782362938, + 0.5174176283180714, + 0.9076451007276773, + 0.33566560596227646, + 0.41391964070498943, + 0.4033215716481209, + 0.207847710698843, + 2.230131860822439, + 0.4653695747256279, + 1.252409242093563, + 1.029404029250145, + 1.519518967717886, + 0.47749538347125053, + 0.7251684702932835, + 1.4436232559382915, + 2.06837709620595, + 1.0039122514426708, + 0.636965949088335, + 0.3783791419118643, + 1.507604356855154, + 0.487589692696929, + 0.7259972840547562, + 0.22644195519387722, + 0.3340257089585066, + 1.8812571298331022, + 1.191840372979641, + 3.2479730546474457, + 1.4110489934682846, + 1.1514646857976913, + 1.4780306816101074, + 0.28047502040863037, + 0.35616733133792877, + 1.9386779963970184, + 1.2284270599484444, + 2.484011210501194, + 0.4412192106246948, + 0.20798511989414692, + 1.4141331315040588, + 1.9053520299494267, + 1.5541391130536795, + 0.7190139349550009, + 0.7968595623970032 + ], + "unique_experts": 64, + "load_cv": 0.5526054992853132, + "normalized_load_entropy": 0.962569030886594, + "max_load_share": 0.04112554112554113 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 113, + "ordered_topk_exact_tokens": 86, + "set_exact_tokens": 95, + "mean_set_jaccard": 0.95448798988622, + "mean_token_weighted_tv": 0.01004271876825168, + "aggregate_load_tv": 0.019174041297935103 + }, + "system_bos": { + "tokens": 113, + "ordered_topk_exact_tokens": 70, + "set_exact_tokens": 86, + "mean_set_jaccard": 0.9317319848293301, + "mean_token_weighted_tv": 0.01635250299179976, + "aggregate_load_tv": 0.025073746312684365 + }, + "system_x": { + "tokens": 113, + "ordered_topk_exact_tokens": 61, + "set_exact_tokens": 80, + "mean_set_jaccard": 0.9165613147914032, + "mean_token_weighted_tv": 0.02091681480045076, + "aggregate_load_tv": 0.028023598820058997 + }, + "system_period": { + "tokens": 113, + "ordered_topk_exact_tokens": 64, + "set_exact_tokens": 80, + "mean_set_jaccard": 0.9146649810366625, + "mean_token_weighted_tv": 0.02101340883337291, + "aggregate_load_tv": 0.029498525073746312 + }, + "bos_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 63, + "set_exact_tokens": 87, + "mean_set_jaccard": 0.9342604298356512, + "mean_token_weighted_tv": 0.018446932266573464, + "aggregate_load_tv": 0.028023598820058997 + }, + "bos_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 61, + "set_exact_tokens": 78, + "mean_set_jaccard": 0.911504424778761, + "mean_token_weighted_tv": 0.02308486859454254, + "aggregate_load_tv": 0.029498525073746312 + }, + "x_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 60, + "set_exact_tokens": 85, + "mean_set_jaccard": 0.9292035398230089, + "mean_token_weighted_tv": 0.0190681795861605, + "aggregate_load_tv": 0.028023598820058997 + }, + "x_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 50, + "set_exact_tokens": 70, + "mean_set_jaccard": 0.8912768647281922, + "mean_token_weighted_tv": 0.026833187318942714, + "aggregate_load_tv": 0.035398230088495575 + }, + "period_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 61, + "set_exact_tokens": 87, + "mean_set_jaccard": 0.934260429835651, + "mean_token_weighted_tv": 0.018240922633393677, + "aggregate_load_tv": 0.025073746312684365 + }, + "period_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 50, + "set_exact_tokens": 70, + "mean_set_jaccard": 0.8893805309734514, + "mean_token_weighted_tv": 0.027462334957270497, + "aggregate_load_tv": 0.035398230088495575 + } + } + }, + "layer_07": { + "layer": 7, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "7bd7e8a424721f3e3eeb411e1807ea82457b8604c7ae1b4f4ffc9ffa1e6c2dae", + "route_weight_sha256": "570281a4d1c708e71f6bd1873cb584eaae18642a93a2be612a457639a05bfd2f", + "loads": [ + 18, + 8, + 6, + 9, + 9, + 14, + 9, + 16, + 9, + 8, + 33, + 9, + 10, + 0, + 2, + 10, + 5, + 11, + 19, + 24, + 1, + 14, + 17, + 19, + 14, + 13, + 8, + 13, + 1, + 6, + 8, + 0, + 2, + 4, + 10, + 7, + 7, + 12, + 14, + 14, + 8, + 4, + 14, + 9, + 16, + 17, + 15, + 30, + 4, + 12, + 1, + 17, + 11, + 2, + 9, + 1, + 3, + 14, + 10, + 14, + 24, + 5, + 15, + 10 + ], + "weighted_loads": [ + 1.0898468159139156, + 0.4594305269420147, + 0.465043094009161, + 0.39319685474038124, + 0.5699567385017872, + 1.061343315988779, + 0.40316291898489, + 1.0912520457059145, + 0.5911301970481873, + 0.7628420107066631, + 2.106365382671356, + 0.559883788228035, + 0.5142667889595032, + 0.0, + 0.07369593903422356, + 0.508346538990736, + 0.21187811717391014, + 0.5411485359072685, + 2.03215947188437, + 2.129897002130747, + 0.03271441161632538, + 1.017968539148569, + 1.0838972590863705, + 1.2581139504909515, + 1.4372550677508116, + 0.8126889411360025, + 0.5479713119566441, + 1.0519598759710789, + 0.0358380526304245, + 0.5186114571988583, + 0.4907345771789551, + 0.0, + 0.2024650201201439, + 0.15034755691885948, + 0.5247956290841103, + 0.365797258913517, + 0.5302286371588707, + 0.8749684318900108, + 1.1194360479712486, + 0.8390320762991905, + 0.5121629349887371, + 0.29832189716398716, + 1.1319434493780136, + 0.6392915789037943, + 1.289870884269476, + 1.0257311146706343, + 1.535991381853819, + 2.382527556270361, + 0.26863639801740646, + 0.6654179338365793, + 0.12560832500457764, + 1.1905469968914986, + 1.054607082158327, + 0.07599660381674767, + 0.5091579183936119, + 0.08254557847976685, + 0.11862294375896454, + 0.7923920936882496, + 0.5962066873908043, + 0.6221186891198158, + 1.6394779328256845, + 0.2594622652977705, + 1.0585936978459358, + 0.6732296012341976 + ], + "unique_experts": 62, + "load_cv": 0.6408109023823972, + "normalized_load_entropy": 0.9473718345827732, + "max_load_share": 0.048672566371681415 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "045a60220d3056b417d84e838b778a7e7af1c9967aa11d09c6ffd9984d0f2e91", + "route_weight_sha256": "f69dd0eb0e3e610dc00e43b1edd00b180042e71baa07dc30d51002726c968978", + "loads": [ + 18, + 8, + 6, + 12, + 9, + 15, + 14, + 16, + 17, + 8, + 35, + 12, + 10, + 5, + 2, + 10, + 19, + 14, + 21, + 25, + 1, + 14, + 20, + 21, + 19, + 13, + 11, + 13, + 4, + 6, + 8, + 0, + 5, + 6, + 10, + 7, + 7, + 12, + 24, + 17, + 8, + 15, + 19, + 11, + 20, + 17, + 17, + 32, + 4, + 12, + 17, + 17, + 11, + 3, + 9, + 8, + 3, + 14, + 14, + 14, + 24, + 11, + 17, + 17 + ], + "weighted_loads": [ + 1.0898468159139156, + 0.4594305269420147, + 0.465043094009161, + 0.50423988327384, + 0.5699567385017872, + 1.1030422300100327, + 0.8850494176149368, + 1.0912520457059145, + 1.2432815544307232, + 0.7628420107066631, + 2.191924747079611, + 1.0563188791275024, + 0.5142667889595032, + 0.28649481758475304, + 0.07369593903422356, + 0.508346538990736, + 2.1794180274009705, + 0.7147650010883808, + 2.073599634692073, + 2.2063278444111347, + 0.03271441161632538, + 1.017968539148569, + 1.2569033056497574, + 1.395538255572319, + 1.597553368192166, + 0.8126889411360025, + 0.8072088696062565, + 1.0519598759710789, + 0.0991812041029334, + 0.5186114571988583, + 0.4907345771789551, + 0.0, + 0.3173840530216694, + 0.24837295338511467, + 0.5247956290841103, + 0.365797258913517, + 0.5302286371588707, + 0.8749684318900108, + 2.0797024331986904, + 0.9693925492465496, + 0.5121629349887371, + 1.278035907074809, + 1.4936259798705578, + 0.6712839854881167, + 2.8099156469106674, + 1.0257311146706343, + 1.6218138299882412, + 2.5581984855234623, + 0.26863639801740646, + 0.6654179338365793, + 1.301146935671568, + 1.1905469968914986, + 1.054607082158327, + 0.10756539180874825, + 0.5091579183936119, + 0.7381862998008728, + 0.11862294375896454, + 0.7923920936882496, + 0.681786285713315, + 0.6221186891198158, + 1.6394779328256845, + 0.5568417403846979, + 1.078942786436528, + 0.9377822056412697 + ], + "unique_experts": 63, + "load_cv": 0.5368843138941909, + "normalized_load_entropy": 0.9632167415837158, + "max_load_share": 0.042270531400966184 + } + }, + "s1_eos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "c334703c91003c0109d86e5ba23bb502aa78bf2c3a04ee247c46d482046af70a", + "route_weight_sha256": "2f1850b5e72ebd13f1b6aeeec96c59f0958daf2b3050f22a449634ed3e66e72b", + "loads": [ + 18, + 8, + 7, + 10, + 9, + 14, + 10, + 14, + 9, + 8, + 32, + 10, + 10, + 0, + 1, + 9, + 6, + 11, + 19, + 24, + 1, + 14, + 16, + 19, + 14, + 13, + 8, + 14, + 1, + 6, + 8, + 0, + 2, + 5, + 10, + 6, + 8, + 12, + 15, + 15, + 8, + 5, + 13, + 9, + 15, + 17, + 15, + 30, + 4, + 13, + 1, + 17, + 11, + 3, + 8, + 1, + 2, + 14, + 9, + 15, + 23, + 4, + 15, + 10 + ], + "weighted_loads": [ + 1.081038124859333, + 0.46179596334695816, + 0.48968226835131645, + 0.43039226345717907, + 0.5688354633748531, + 1.0467173289507627, + 0.4478680044412613, + 1.0163831003010273, + 0.5682492032647133, + 0.7503737732768059, + 2.072446061298251, + 0.5839007534086704, + 0.5051739141345024, + 0.0, + 0.040344223380088806, + 0.46323130652308464, + 0.26224174350500107, + 0.5206697583198547, + 2.040370650589466, + 2.0957432240247726, + 0.03125135600566864, + 1.023384340107441, + 1.0600931402295828, + 1.251553263515234, + 1.419770972803235, + 0.8159808162599802, + 0.5195806957781315, + 1.0950205512344837, + 0.034843891859054565, + 0.5288903005421162, + 0.49619220942258835, + 0.0, + 0.21196208521723747, + 0.1829508487135172, + 0.5278544202446938, + 0.32162561267614365, + 0.557525122538209, + 0.8830615729093552, + 1.1462016999721527, + 0.8618530482053757, + 0.5080443359911442, + 0.32164001651108265, + 1.0855248533189297, + 0.6314961388707161, + 1.2558768205344677, + 1.0254517626017332, + 1.5460022948682308, + 2.352774728089571, + 0.2632385976612568, + 0.6925834361463785, + 0.11998140066862106, + 1.1851415745913982, + 1.0550073869526386, + 0.12792951241135597, + 0.4631420634686947, + 0.08323346078395844, + 0.08764339983463287, + 0.7951640486717224, + 0.5611063651740551, + 0.6672938242554665, + 1.574825331568718, + 0.21825066953897476, + 1.0535923801362514, + 0.6682313419878483 + ], + "unique_experts": 62, + "load_cv": 0.630958212307409, + "normalized_load_entropy": 0.9481182612172783, + "max_load_share": 0.0471976401179941 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "a11c367f18e2beeec139676e54d6b91f35324f8cee005a9e0053094df99f1419", + "route_weight_sha256": "6c309e18d9346f83b3b9bd2d8caf9ce98c4f51b14eea619f9f0875603273fda6", + "loads": [ + 18, + 8, + 7, + 12, + 10, + 15, + 17, + 14, + 25, + 10, + 40, + 15, + 10, + 6, + 3, + 10, + 21, + 15, + 21, + 25, + 1, + 14, + 18, + 22, + 19, + 13, + 15, + 15, + 4, + 12, + 8, + 0, + 8, + 14, + 10, + 6, + 8, + 16, + 32, + 19, + 10, + 21, + 23, + 12, + 25, + 17, + 17, + 36, + 4, + 13, + 23, + 17, + 11, + 3, + 12, + 10, + 2, + 20, + 12, + 15, + 23, + 10, + 19, + 13 + ], + "weighted_loads": [ + 1.081038124859333, + 0.46179596334695816, + 0.48968226835131645, + 0.4933751877397299, + 0.616231057792902, + 1.0912575107067823, + 0.9283902551978827, + 1.0163831003010273, + 1.9280467703938484, + 0.8523112274706364, + 2.6802389342337847, + 1.214361671358347, + 0.5051739141345024, + 0.33542478270828724, + 0.10942089930176735, + 0.5177191868424416, + 2.638251133263111, + 0.7481208741664886, + 2.081403186544776, + 2.1719148084521294, + 0.03125135600566864, + 1.023384340107441, + 1.1812670696526766, + 1.423345860093832, + 1.576999428216368, + 0.8159808162599802, + 1.1286906152963638, + 1.1254470366984606, + 0.09836767893284559, + 1.3030217252671719, + 0.49619220942258835, + 0.0, + 0.5971831455826759, + 0.766825282946229, + 0.5278544202446938, + 0.32162561267614365, + 0.557525122538209, + 1.1103532798588276, + 2.938235193490982, + 1.037314873188734, + 0.7296496517956257, + 1.7589456383138895, + 1.88832276314497, + 0.7030839892104268, + 3.317248187959194, + 1.0254517626017332, + 1.6521652713418007, + 2.7159672807902098, + 0.2632385976612568, + 0.6925834361463785, + 1.7059569079428911, + 1.1851415745913982, + 1.0550073869526386, + 0.12792951241135597, + 0.6705231070518494, + 0.8466494251042604, + 0.08764339983463287, + 1.3317276537418365, + 0.6181864738464355, + 0.6672938242554665, + 1.574825331568718, + 0.5138698853552341, + 1.139656106941402, + 0.7577254921197891 + ], + "unique_experts": 63, + "load_cv": 0.5413679110892492, + "normalized_load_entropy": 0.9630619120325722, + "max_load_share": 0.04329004329004329 + } + }, + "s0_bos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "1836a72bae3e2e1cacff4bf6dc0d502d73ea280c2683da5f30a1e4716179fabf", + "route_weight_sha256": "f2309a9d4a9acc1f1f456d13b6d6085bcdd9dff47b1507bad487ac72ea8cda2b", + "loads": [ + 18, + 7, + 6, + 12, + 9, + 13, + 9, + 14, + 9, + 8, + 30, + 10, + 11, + 0, + 1, + 10, + 4, + 9, + 21, + 25, + 1, + 14, + 16, + 19, + 13, + 14, + 11, + 15, + 0, + 6, + 7, + 0, + 2, + 5, + 10, + 6, + 7, + 13, + 15, + 13, + 8, + 4, + 14, + 9, + 16, + 17, + 16, + 29, + 5, + 12, + 1, + 17, + 13, + 2, + 8, + 1, + 3, + 13, + 9, + 15, + 22, + 5, + 16, + 10 + ], + "weighted_loads": [ + 1.0932834036648273, + 0.41835255548357964, + 0.46446526050567627, + 0.5204672757536173, + 0.5696207545697689, + 1.029200367629528, + 0.36018500477075577, + 1.021076150238514, + 0.5912203378975391, + 0.7676211781799793, + 1.98919677734375, + 0.5982874091714621, + 0.566284216940403, + 0.0, + 0.043017223477363586, + 0.5008507035672665, + 0.19229432940483093, + 0.44052961468696594, + 2.135210642591119, + 2.1865744180977345, + 0.03411341458559036, + 0.9989212937653065, + 1.061894241720438, + 1.263408763334155, + 1.4071564190089703, + 0.8423566333949566, + 0.6858142539858818, + 1.110007654875517, + 0.0, + 0.5554775260388851, + 0.48267941549420357, + 0.0, + 0.20639599114656448, + 0.19599532894790173, + 0.5226102881133556, + 0.3487814888358116, + 0.5110166426748037, + 0.9378774575889111, + 1.1971799060702324, + 0.7947076708078384, + 0.5199146829545498, + 0.2961503341794014, + 1.1272060312330723, + 0.6689741834998131, + 1.290111031383276, + 1.0044317804276943, + 1.541314024478197, + 2.347107905894518, + 0.31977538019418716, + 0.6900633573532104, + 0.12618039548397064, + 1.178679745644331, + 1.1251365914940834, + 0.07661217451095581, + 0.49736700020730495, + 0.08338556438684464, + 0.11504081636667252, + 0.790917282924056, + 0.5465185828506947, + 0.6454730648547411, + 1.5378219820559025, + 0.23609009012579918, + 1.107588917016983, + 0.6728252731263638 + ], + "unique_experts": 61, + "load_cv": 0.630958212307409, + "normalized_load_entropy": 0.946531136285117, + "max_load_share": 0.04424778761061947 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "598e6549dfd7c051bc56714bd2f78275e6a5d265ec422d42358cb054643611cc", + "route_weight_sha256": "ef2579b698746bca9aed90ad6149227cf9578eb07eecc253eb499638f632e86c", + "loads": [ + 18, + 7, + 6, + 15, + 9, + 14, + 15, + 14, + 17, + 8, + 32, + 14, + 11, + 5, + 1, + 10, + 18, + 12, + 24, + 27, + 1, + 14, + 19, + 21, + 17, + 14, + 15, + 15, + 2, + 6, + 7, + 0, + 5, + 7, + 10, + 6, + 7, + 13, + 25, + 16, + 8, + 15, + 19, + 10, + 20, + 17, + 18, + 31, + 5, + 12, + 16, + 17, + 13, + 4, + 8, + 8, + 3, + 13, + 12, + 15, + 22, + 11, + 17, + 17 + ], + "weighted_loads": [ + 1.0932834036648273, + 0.41835255548357964, + 0.46446526050567627, + 0.631510304287076, + 0.5696207545697689, + 1.0708992816507816, + 0.9433463290333748, + 1.021076150238514, + 1.2391132824122906, + 0.7676211781799793, + 2.0711292922496796, + 1.1891053970903158, + 0.566284216940403, + 0.28649481758475304, + 0.043017223477363586, + 0.5008507035672665, + 2.1723080910742283, + 0.6051928289234638, + 2.2175191398710012, + 2.331649549305439, + 0.03411341458559036, + 0.9989212937653065, + 1.234900288283825, + 1.399440323933959, + 1.5603742878884077, + 0.8423566333949566, + 1.0169824957847595, + 1.110007654875517, + 0.05013463832437992, + 0.5554775260388851, + 0.48267941549420357, + 0.0, + 0.32131502404809, + 0.30966747365891933, + 0.5226102881133556, + 0.3487814888358116, + 0.5110166426748037, + 0.9378774575889111, + 2.215751949697733, + 0.9237569309771061, + 0.5199146829545498, + 1.269710212945938, + 1.491573490202427, + 0.6865651272237301, + 1.9849397279322147, + 1.0044317804276943, + 1.6425310410559177, + 2.516911495476961, + 0.31977538019418716, + 0.6900633573532104, + 1.3359824009239674, + 1.178679745644331, + 1.1251365914940834, + 0.15236689522862434, + 0.49736700020730495, + 0.7390262857079506, + 0.11504081636667252, + 0.790917282924056, + 0.6169957593083382, + 0.6454730648547411, + 1.5378219820559025, + 0.5334695652127266, + 1.1222924031317234, + 0.9373778775334358 + ], + "unique_experts": 63, + "load_cv": 0.531466838253681, + "normalized_load_entropy": 0.9628184353214592, + "max_load_share": 0.03864734299516908 + } + }, + "s1_bos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "a614b67121af0f4f8e9e7a240c822d514add20b828ddd553efa3dbbe3baf9d8b", + "route_weight_sha256": "ce253972e84a4d16bf48eb6d4090dde65bac780c4380a0cd3c889155ed338976", + "loads": [ + 18, + 5, + 6, + 11, + 9, + 12, + 11, + 13, + 9, + 11, + 32, + 10, + 11, + 0, + 1, + 10, + 5, + 9, + 21, + 27, + 0, + 14, + 16, + 19, + 13, + 14, + 9, + 14, + 0, + 6, + 8, + 0, + 2, + 5, + 10, + 5, + 7, + 14, + 15, + 13, + 8, + 4, + 13, + 9, + 17, + 17, + 15, + 30, + 5, + 12, + 2, + 17, + 13, + 3, + 8, + 1, + 3, + 14, + 7, + 15, + 20, + 3, + 17, + 10 + ], + "weighted_loads": [ + 1.105887208133936, + 0.342334121465683, + 0.47697849944233894, + 0.48892442882061005, + 0.5701309703290462, + 0.9850076418370008, + 0.47160089388489723, + 0.9728334285318851, + 0.5706171244382858, + 0.8459061086177826, + 2.012756310403347, + 0.5979936178773642, + 0.5561023689806461, + 0.0, + 0.03801173344254494, + 0.4746856093406677, + 0.2606624197214842, + 0.4372192621231079, + 2.098077056929469, + 2.291270647197962, + 0.0, + 1.0052508302032948, + 1.0701613649725914, + 1.252571664750576, + 1.4190661869943142, + 0.8611015006899834, + 0.5959432795643806, + 1.0763883702456951, + 0.0, + 0.5630168877542019, + 0.5215694531798363, + 0.0, + 0.21103836223483086, + 0.19800809770822525, + 0.5181383602321148, + 0.32646629959344864, + 0.517754090949893, + 0.9698178879916668, + 1.1602782793343067, + 0.7889270670711994, + 0.5272138006985188, + 0.29620683938264847, + 1.09848165884614, + 0.6437996719032526, + 1.3659251853823662, + 1.0085982456803322, + 1.543699987232685, + 2.344513826072216, + 0.32359135150909424, + 0.6823107488453388, + 0.15527791529893875, + 1.1835806220769882, + 1.1153888907283545, + 0.11278935894370079, + 0.46471885964274406, + 0.08128878474235535, + 0.11378019861876965, + 0.7825397308915854, + 0.49796082079410553, + 0.6513348296284676, + 1.4477918334305286, + 0.16959119960665703, + 1.129520632326603, + 0.6603369638323784 + ], + "unique_experts": 60, + "load_cv": 0.6490144793974197, + "normalized_load_entropy": 0.9443059318824458, + "max_load_share": 0.0471976401179941 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "ddce3a7004cbf104da1ec08a5b207da1e9723716675e3e69dbdc492c445223ee", + "route_weight_sha256": "a4b795c2eba916b52a5e208bf78854c1b0e85cc17c376c8a5bed05ba264f38ea", + "loads": [ + 18, + 5, + 6, + 13, + 10, + 13, + 19, + 13, + 24, + 13, + 40, + 15, + 11, + 6, + 3, + 11, + 20, + 13, + 24, + 29, + 1, + 14, + 18, + 23, + 17, + 14, + 17, + 15, + 2, + 12, + 8, + 0, + 8, + 14, + 10, + 5, + 7, + 18, + 32, + 17, + 10, + 20, + 23, + 11, + 27, + 17, + 18, + 36, + 5, + 12, + 23, + 17, + 13, + 3, + 12, + 10, + 3, + 20, + 9, + 15, + 20, + 9, + 20, + 13 + ], + "weighted_loads": [ + 1.105887208133936, + 0.342334121465683, + 0.47697849944233894, + 0.5519073531031609, + 0.6175265647470951, + 1.0295478235930204, + 1.084930645301938, + 0.9728334285318851, + 1.8826807662844658, + 0.9478435628116131, + 2.620866883546114, + 1.2499600108712912, + 0.5561023689806461, + 0.33542478270828724, + 0.10708840936422348, + 0.5291734896600246, + 2.647111577913165, + 0.6509392410516739, + 2.1772877760231495, + 2.436901655048132, + 0.04004080593585968, + 1.0052508302032948, + 1.1913352943956852, + 1.4739567562937737, + 1.569123363122344, + 0.8611015006899834, + 1.2693012356758118, + 1.106814855709672, + 0.049777647480368614, + 1.3371483124792576, + 0.5215694531798363, + 0.0, + 0.5962594226002693, + 0.794840894639492, + 0.5181383602321148, + 0.32646629959344864, + 0.517754090949893, + 1.1971095949411392, + 2.9658200442790985, + 0.9640909135341644, + 0.7488191165030003, + 1.721844855695963, + 1.9034365750849247, + 0.7014894653111696, + 2.5896771363914013, + 1.0085982456803322, + 1.6982644759118557, + 2.7050552908331156, + 0.32359135150909424, + 0.6823107488453388, + 1.8242459055036306, + 1.1835806220769882, + 1.1153888907283545, + 0.11278935894370079, + 0.6720999032258987, + 0.8447047490626574, + 0.11378019861876965, + 1.3191033359616995, + 0.5396285317838192, + 0.6513348296284676, + 1.4477918334305286, + 0.4652104154229164, + 1.2100463472306728, + 0.7498311139643192 + ], + "unique_experts": 63, + "load_cv": 0.557736391585177, + "normalized_load_entropy": 0.9607869131695742, + "max_load_share": 0.04329004329004329 + } + }, + "s0_x": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "b734f227d0b1b59e2d17743c1623211d025e65cc970500ee628de0c43e36ce9d", + "route_weight_sha256": "fbc8cd81e3d79802b30c410ebfcffe4b85324f5b765b9cf2760ba4a427e83190", + "loads": [ + 18, + 6, + 6, + 13, + 9, + 14, + 7, + 14, + 8, + 8, + 32, + 11, + 11, + 0, + 1, + 12, + 4, + 9, + 19, + 24, + 1, + 14, + 16, + 20, + 13, + 14, + 12, + 13, + 0, + 6, + 7, + 0, + 2, + 5, + 10, + 6, + 7, + 12, + 15, + 13, + 8, + 3, + 14, + 9, + 16, + 17, + 15, + 29, + 4, + 13, + 1, + 17, + 13, + 2, + 9, + 1, + 3, + 14, + 10, + 14, + 23, + 5, + 15, + 11 + ], + "weighted_loads": [ + 1.1041758470237255, + 0.37887638434767723, + 0.47620515897870064, + 0.5368270222097635, + 0.5686936862766743, + 1.0523656010627747, + 0.2797660119831562, + 1.0161223039031029, + 0.544223491102457, + 0.7743635140359402, + 2.0776560567319393, + 0.6315065678209066, + 0.5790525581687689, + 0.0, + 0.04843658208847046, + 0.5594804752618074, + 0.19821836985647678, + 0.44789985567331314, + 2.0567850451916456, + 2.1529688090085983, + 0.033818796277046204, + 0.9922931827604771, + 1.0877800025045872, + 1.3199889473617077, + 1.424989314749837, + 0.8491654619574547, + 0.8030023947358131, + 1.0270406790077686, + 0.0, + 0.5265813991427422, + 0.48137273639440536, + 0.0, + 0.20875532180070877, + 0.1856484618037939, + 0.5176239907741547, + 0.34646905213594437, + 0.5190118439495564, + 0.8983090035617352, + 1.1824140809476376, + 0.792176004499197, + 0.5179599449038506, + 0.27516650035977364, + 1.1233131438493729, + 0.6481275502592325, + 1.3015480674803257, + 1.0101295076310635, + 1.5120030976831913, + 2.36862713098526, + 0.28643567860126495, + 0.728426106274128, + 0.11312054097652435, + 1.182311337441206, + 1.1409562528133392, + 0.07648437470197678, + 0.5213290471583605, + 0.08449123799800873, + 0.1194726936519146, + 0.8192904777824879, + 0.5865491814911366, + 0.616436317563057, + 1.6059485767036676, + 0.23538921400904655, + 1.078546941280365, + 0.7170988544821739 + ], + "unique_experts": 61, + "load_cv": 0.639505980963127, + "normalized_load_entropy": 0.9452994948269567, + "max_load_share": 0.0471976401179941 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "2aea13ed989d33b1f4191549d8191f0c7880a110dfe050a6ea159fc4c26ddab1", + "route_weight_sha256": "4c6c498caf2305b684cc7f89ce04930f2f55ecd85238f49c36f6e8a1a17f5795", + "loads": [ + 18, + 6, + 6, + 16, + 9, + 16, + 11, + 14, + 15, + 8, + 34, + 15, + 11, + 6, + 1, + 12, + 20, + 12, + 21, + 25, + 1, + 14, + 19, + 22, + 17, + 14, + 16, + 13, + 2, + 6, + 7, + 0, + 5, + 7, + 10, + 6, + 7, + 12, + 25, + 16, + 8, + 14, + 19, + 10, + 19, + 17, + 18, + 32, + 4, + 13, + 15, + 17, + 13, + 3, + 9, + 8, + 3, + 14, + 13, + 14, + 23, + 12, + 16, + 19 + ], + "weighted_loads": [ + 1.1041758470237255, + 0.37887638434767723, + 0.47620515897870064, + 0.6478700507432222, + 0.5686936862766743, + 1.150087732821703, + 0.6456362940371037, + 1.0161223039031029, + 1.1440846771001816, + 0.7743635140359402, + 2.1624989360570908, + 1.2144437786191702, + 0.5790525581687689, + 0.3200710527598858, + 0.04843658208847046, + 0.5594804752618074, + 2.507128881290555, + 0.6269183233380318, + 2.0982252079993486, + 2.2313776463270187, + 0.033818796277046204, + 0.9922931827604771, + 1.260786049067974, + 1.4534726366400719, + 1.5782071836292744, + 0.8491654619574547, + 1.1213934682309628, + 1.0270406790077686, + 0.05013463832437992, + 0.5265813991427422, + 0.48137273639440536, + 0.0, + 0.32367435470223427, + 0.3068129476159811, + 0.5176239907741547, + 0.34646905213594437, + 0.5190118439495564, + 0.8983090035617352, + 2.111520003527403, + 0.9193119145929813, + 0.5179599449038506, + 1.1866047903895378, + 1.4913437068462372, + 0.6657184939831495, + 1.9497096166014671, + 1.0101295076310635, + 1.6430727392435074, + 2.5868805646896362, + 0.28643567860126495, + 0.728426106274128, + 1.1416287533938885, + 1.182311337441206, + 1.1409562528133392, + 0.10805316269397736, + 0.5213290471583605, + 0.7401319593191147, + 0.1194726936519146, + 0.8192904777824879, + 0.6570263579487801, + 0.616436317563057, + 1.6059485767036676, + 0.5852095782756805, + 1.0932504273951054, + 1.0610913075506687 + ], + "unique_experts": 63, + "load_cv": 0.5381000664245907, + "normalized_load_entropy": 0.9620445256310076, + "max_load_share": 0.04106280193236715 + } + }, + "s1_x": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "a96734c601d4a01de832a7088d4187abbb5abbaf44d0e9aedd7ae6eaa169ffea", + "route_weight_sha256": "0ed48fe88438633a61daa1be62a31dbd5ac1150530580abb0399173f03fbe205", + "loads": [ + 18, + 7, + 7, + 11, + 9, + 13, + 11, + 12, + 8, + 11, + 30, + 10, + 10, + 0, + 1, + 9, + 3, + 10, + 21, + 27, + 0, + 14, + 16, + 20, + 14, + 14, + 10, + 13, + 0, + 6, + 8, + 0, + 2, + 5, + 10, + 6, + 7, + 13, + 15, + 11, + 8, + 4, + 14, + 8, + 16, + 19, + 16, + 29, + 6, + 12, + 2, + 17, + 12, + 2, + 9, + 1, + 4, + 13, + 9, + 15, + 19, + 4, + 17, + 10 + ], + "weighted_loads": [ + 1.1197080984711647, + 0.4224967919290066, + 0.5062870942056179, + 0.4776720870286226, + 0.5654415376484394, + 1.0118079334497452, + 0.46040911599993706, + 0.9242433644831181, + 0.5232657045125961, + 0.8573475759476423, + 1.886695558205247, + 0.5905362162739038, + 0.5299318097531796, + 0.0, + 0.03891462832689285, + 0.4097190126776695, + 0.1905758287757635, + 0.49822357296943665, + 2.0810951068997383, + 2.2553606424480677, + 0.0, + 0.9988116323947906, + 1.0898522548377514, + 1.285687681287527, + 1.4519718158990145, + 0.874541025608778, + 0.6937066167593002, + 1.037573467940092, + 0.0, + 0.5352550186216831, + 0.5258315093815327, + 0.0, + 0.21187447383999825, + 0.1877058707177639, + 0.5156154036521912, + 0.3538079671561718, + 0.5216733645647764, + 0.9406490735709667, + 1.1380891911685467, + 0.7067390084266663, + 0.5296727009117603, + 0.27851129323244095, + 1.142750095576048, + 0.6009626463055611, + 1.3477148097008467, + 1.0933192502707243, + 1.5705587323755026, + 2.2741288654506207, + 0.3889925517141819, + 0.6738659404218197, + 0.1462216041982174, + 1.1894354335963726, + 1.1112267188727856, + 0.07344085350632668, + 0.46398735605180264, + 0.08252796530723572, + 0.15371772460639477, + 0.751640209928155, + 0.5664990730583668, + 0.6637422516942024, + 1.421750832349062, + 0.20166650041937828, + 1.1359625235199928, + 0.6652148179709911 + ], + "unique_experts": 60, + "load_cv": 0.6329410202103808, + "normalized_load_entropy": 0.9460886260115204, + "max_load_share": 0.04424778761061947 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "3d33b26f52292b57be09bb5038395e3b3ec04ecb5531adf8b74403c59f605993", + "route_weight_sha256": "6f1e7a2edc434534124efec9fd1b11e0856a76d52349c1392d4ae003faedeee6", + "loads": [ + 18, + 7, + 7, + 13, + 10, + 15, + 17, + 12, + 24, + 13, + 38, + 15, + 10, + 7, + 3, + 10, + 19, + 14, + 23, + 28, + 0, + 14, + 18, + 24, + 19, + 14, + 17, + 14, + 2, + 12, + 8, + 0, + 8, + 14, + 10, + 6, + 7, + 17, + 31, + 15, + 10, + 19, + 24, + 10, + 25, + 19, + 20, + 36, + 6, + 12, + 23, + 17, + 12, + 2, + 13, + 10, + 4, + 19, + 11, + 15, + 19, + 11, + 20, + 14 + ], + "weighted_loads": [ + 1.1197080984711647, + 0.4224967919290066, + 0.5062870942056179, + 0.5406550113111734, + 0.6128371320664883, + 1.1096414513885975, + 0.8440165389329195, + 0.9242433644831181, + 1.8614340610802174, + 0.9592850301414728, + 2.489586642012, + 1.2559133265167475, + 0.5299318097531796, + 0.3652608785778284, + 0.1079913042485714, + 0.46420689299702644, + 2.8397120106965303, + 0.7297863736748695, + 2.122127642855048, + 2.326680952683091, + 0.0, + 0.9988116323947906, + 1.2110261842608452, + 1.4901299253106117, + 1.6353642381727695, + 0.874541025608778, + 1.2956013046205044, + 1.067999953404069, + 0.049777647480368614, + 1.3093864433467388, + 0.5258315093815327, + 0.0, + 0.5970955342054367, + 0.7915532924234867, + 0.5156154036521912, + 0.3538079671561718, + 0.5216733645647764, + 1.1679407805204391, + 2.8305255509912968, + 0.8816325180232525, + 0.7512780167162418, + 1.5781503356993198, + 1.9469707570970058, + 0.6586524397134781, + 2.5350617226213217, + 1.0933192502707243, + 1.7593504022806883, + 2.6952786128968, + 0.3889925517141819, + 0.6738659404218197, + 1.6240304429084063, + 1.1894354335963726, + 1.1112267188727856, + 0.07344085350632668, + 0.6713683996349573, + 0.8459439296275377, + 0.15371772460639477, + 1.288203814998269, + 0.6081667840480804, + 0.6637422516942024, + 1.421750832349062, + 0.5501409694552422, + 1.2164882384240627, + 0.8232252225279808 + ], + "unique_experts": 62, + "load_cv": 0.5376163269519825, + "normalized_load_entropy": 0.9625070203993676, + "max_load_share": 0.04112554112554113 + } + }, + "s0_period": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "18ec830d964738f829af1cdf0130848e3963d6090f643d09c578d3174df52b83", + "route_weight_sha256": "23c5f6d0d860ec75fa33a4eed3e54ffabe1aded66f9b4bd0ac66491ec32b9216", + "loads": [ + 18, + 7, + 6, + 13, + 9, + 14, + 7, + 14, + 9, + 8, + 32, + 10, + 11, + 0, + 1, + 12, + 4, + 11, + 18, + 24, + 1, + 13, + 16, + 20, + 13, + 14, + 10, + 13, + 1, + 6, + 7, + 0, + 2, + 5, + 10, + 6, + 6, + 13, + 15, + 13, + 8, + 3, + 13, + 9, + 17, + 17, + 15, + 29, + 4, + 12, + 1, + 17, + 13, + 2, + 9, + 1, + 3, + 14, + 10, + 14, + 23, + 5, + 17, + 10 + ], + "weighted_loads": [ + 1.111059758812189, + 0.42741716653108597, + 0.4737146496772766, + 0.5453413464128971, + 0.5641464814543724, + 1.0563062261790037, + 0.28004729375243187, + 1.0137034729123116, + 0.6024939753115177, + 0.7606952711939812, + 2.0718478709459305, + 0.6024354845285416, + 0.57664018496871, + 0.0, + 0.048123668879270554, + 0.5801164079457521, + 0.20215297676622868, + 0.5439996123313904, + 2.035643246024847, + 2.0984279438853264, + 0.031705256551504135, + 0.9443763270974159, + 1.099730011075735, + 1.3175696618855, + 1.4206964373588562, + 0.8474324215203524, + 0.7122452259063721, + 1.03266217187047, + 0.03400430083274841, + 0.5262322090566158, + 0.4783880151808262, + 0.0, + 0.21477092802524567, + 0.18394671380519867, + 0.5132642462849617, + 0.34059322997927666, + 0.4851304180920124, + 0.9244331233203411, + 1.1836601085960865, + 0.7924861796200275, + 0.5230325758457184, + 0.2790372893214226, + 1.0780028477311134, + 0.6573261730372906, + 1.3187943771481514, + 1.0071836896240711, + 1.5120369233191013, + 2.3850617855787277, + 0.2912968546152115, + 0.6992910392582417, + 0.12075488269329071, + 1.1837456822395325, + 1.1292496994137764, + 0.07802939042448997, + 0.5057032946497202, + 0.08543646335601807, + 0.11975453794002533, + 0.8179279081523418, + 0.6213260404765606, + 0.6137772276997566, + 1.606831008568406, + 0.24965349957346916, + 1.1575517281889915, + 0.6701577454805374 + ], + "unique_experts": 62, + "load_cv": 0.6371066833683652, + "normalized_load_entropy": 0.946551106226679, + "max_load_share": 0.0471976401179941 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "9ea7d2a3ec9f0d6fef5463d6363c9790884cf921174f83c0b1f6289280d7eab4", + "route_weight_sha256": "0db0e6b7ae2d23228096b03ca379481b43568ce083c7e741e1df3a57de6b71d7", + "loads": [ + 18, + 7, + 6, + 16, + 9, + 15, + 12, + 14, + 17, + 8, + 34, + 14, + 11, + 5, + 1, + 12, + 20, + 14, + 20, + 25, + 1, + 13, + 20, + 22, + 17, + 14, + 13, + 13, + 3, + 6, + 7, + 0, + 5, + 7, + 10, + 6, + 6, + 13, + 26, + 16, + 8, + 15, + 18, + 10, + 20, + 17, + 16, + 31, + 4, + 12, + 18, + 17, + 13, + 3, + 9, + 8, + 3, + 14, + 13, + 14, + 23, + 11, + 18, + 17 + ], + "weighted_loads": [ + 1.111059758812189, + 0.42741716653108597, + 0.4737146496772766, + 0.6563843749463558, + 0.5641464814543724, + 1.0980051402002573, + 0.6826478205621243, + 1.0137034729123116, + 1.2918726354837418, + 0.7606952711939812, + 2.1573428250849247, + 1.1910517290234566, + 0.57664018496871, + 0.28649481758475304, + 0.048123668879270554, + 0.5801164079457521, + 2.496643817052245, + 0.7101009748876095, + 2.07708340883255, + 2.1734340339899063, + 0.031705256551504135, + 0.9443763270974159, + 1.317050863057375, + 1.4497923851013184, + 1.5739143062382936, + 0.8474324215203524, + 0.9686300121247768, + 1.03266217187047, + 0.08413893915712833, + 0.5262322090566158, + 0.4783880151808262, + 0.0, + 0.32968996092677116, + 0.2992440089583397, + 0.5132642462849617, + 0.34059322997927666, + 0.4851304180920124, + 0.9244331233203411, + 2.2175167687237263, + 0.920452568680048, + 0.5230325758457184, + 1.2546321377158165, + 1.4398655146360397, + 0.6749171167612076, + 1.966638907790184, + 1.0071836896240711, + 1.5671482123434544, + 2.5570336133241653, + 0.2912968546152115, + 0.6992910392582417, + 1.5531067550182343, + 1.1837456822395325, + 1.1292496994137764, + 0.10959817841649055, + 0.5057032946497202, + 0.741077184677124, + 0.11975453794002533, + 0.8179279081523418, + 0.6918032169342041, + 0.6137772276997566, + 1.606831008568406, + 0.5470329746603966, + 1.172255214303732, + 0.9347103498876095 + ], + "unique_experts": 63, + "load_cv": 0.536362433514332, + "normalized_load_entropy": 0.9623537132924279, + "max_load_share": 0.04106280193236715 + } + }, + "s1_period": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "5ace31832d9a74a8dcc80476fc5d3f80ad005edd67bc9774c81195a651f807c4", + "route_weight_sha256": "edca6da6e54ab743f6a096a6d3b396d184fc72beb747bbc4ac5b680579cc8d7d", + "loads": [ + 18, + 7, + 7, + 12, + 9, + 13, + 12, + 13, + 8, + 10, + 29, + 10, + 10, + 0, + 1, + 9, + 3, + 10, + 21, + 27, + 0, + 14, + 16, + 20, + 14, + 14, + 10, + 13, + 0, + 6, + 7, + 0, + 2, + 5, + 10, + 6, + 8, + 14, + 14, + 12, + 8, + 4, + 13, + 8, + 16, + 18, + 16, + 29, + 6, + 12, + 2, + 17, + 12, + 3, + 8, + 1, + 4, + 13, + 9, + 14, + 20, + 4, + 17, + 10 + ], + "weighted_loads": [ + 1.1123233251273632, + 0.43047767877578735, + 0.5123833268880844, + 0.5182651840150356, + 0.5634765215218067, + 1.0118392053991556, + 0.49854077957570553, + 0.9794836305081844, + 0.5106374695897102, + 0.8246550690382719, + 1.8487067185342312, + 0.595243152230978, + 0.549133101478219, + 0.0, + 0.038893651217222214, + 0.4084657747298479, + 0.19586899131536484, + 0.49397213384509087, + 2.109040781855583, + 2.2326147202402353, + 0.0, + 0.9971909187734127, + 1.0936290137469769, + 1.2899486124515533, + 1.4479778502136469, + 0.8663937076926231, + 0.7226677089929581, + 1.0406312458217144, + 0.0, + 0.5390236638486385, + 0.4918387085199356, + 0.0, + 0.21584006771445274, + 0.18398340605199337, + 0.5135388486087322, + 0.354405514895916, + 0.554259717464447, + 0.9693651776760817, + 1.1117517240345478, + 0.7452632188796997, + 0.5347695052623749, + 0.2858220934867859, + 1.0834006629884243, + 0.6240472197532654, + 1.3185707703232765, + 1.050778890028596, + 1.56232301145792, + 2.2724235244095325, + 0.37788505107164383, + 0.6689589507877827, + 0.1387043111026287, + 1.1963821984827518, + 1.1091476082801819, + 0.12513887137174606, + 0.42392653226852417, + 0.08339336514472961, + 0.14517574198544025, + 0.7522344943135977, + 0.5935852564871311, + 0.6101578399538994, + 1.4619773551821709, + 0.20332608744502068, + 1.1245120018720627, + 0.6609039604663849 + ], + "unique_experts": 60, + "load_cv": 0.6269737848623093, + "normalized_load_entropy": 0.9469429559220881, + "max_load_share": 0.04277286135693215 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "9bf2ef6f20221df1a3d30c5c2fa556fde6a2622f58480dd491c00b758c8714b0", + "route_weight_sha256": "4bdbfdfbb0f3af466de52433beeed3ca4143a3b1b38242fafe5b689964b51ff3", + "loads": [ + 18, + 7, + 7, + 14, + 10, + 14, + 19, + 13, + 25, + 12, + 37, + 15, + 10, + 6, + 3, + 10, + 19, + 14, + 23, + 27, + 0, + 14, + 19, + 23, + 18, + 14, + 18, + 14, + 2, + 12, + 7, + 0, + 9, + 14, + 10, + 6, + 8, + 18, + 31, + 16, + 10, + 21, + 23, + 10, + 25, + 18, + 18, + 35, + 6, + 12, + 25, + 17, + 12, + 3, + 12, + 10, + 4, + 19, + 11, + 14, + 20, + 10, + 20, + 13 + ], + "weighted_loads": [ + 1.1123233251273632, + 0.43047767877578735, + 0.5123833268880844, + 0.5812481082975864, + 0.6108721159398556, + 1.0563793871551752, + 0.9200380109250546, + 0.9794836305081844, + 1.9042310789227486, + 0.9265925232321024, + 2.4524343349039555, + 1.2179734148085117, + 0.549133101478219, + 0.33542478270828724, + 0.10797032713890076, + 0.4629536550492048, + 2.786659959703684, + 0.7119925245642662, + 2.150073317810893, + 2.2326147202402353, + 0.0, + 0.9971909187734127, + 1.2473972253501415, + 1.4600530490279198, + 1.5980350263416767, + 0.8663937076926231, + 1.3843527622520924, + 1.0710577312856913, + 0.049777647480368614, + 1.3131550885736942, + 0.4918387085199356, + 0.0, + 0.6350613199174404, + 0.7832431811839342, + 0.5135388486087322, + 0.354405514895916, + 0.554259717464447, + 1.196656884625554, + 2.889727760106325, + 0.9217000976204872, + 0.7563748210668564, + 1.6980417929589748, + 1.8826910480856895, + 0.6817370131611824, + 2.506781056523323, + 1.050778890028596, + 1.66848598793149, + 2.6267746593803167, + 0.37788505107164383, + 0.6689589507877827, + 2.058019118383527, + 1.1963821984827518, + 1.1091476082801819, + 0.12513887137174606, + 0.6313075758516788, + 0.8468093294650316, + 0.14517574198544025, + 1.2887980993837118, + 0.6352529674768448, + 0.6101578399538994, + 1.4619773551821709, + 0.49894530326128006, + 1.2050377167761326, + 0.7503981105983257 + ], + "unique_experts": 62, + "load_cv": 0.5329951983709411, + "normalized_load_entropy": 0.9630050831356506, + "max_load_share": 0.04004329004329004 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 113, + "ordered_topk_exact_tokens": 85, + "set_exact_tokens": 97, + "mean_set_jaccard": 0.9595448798988622, + "mean_token_weighted_tv": 0.009632760469298975, + "aggregate_load_tv": 0.02064896755162242 + }, + "system_bos": { + "tokens": 113, + "ordered_topk_exact_tokens": 74, + "set_exact_tokens": 87, + "mean_set_jaccard": 0.9323640960809103, + "mean_token_weighted_tv": 0.015951610425800348, + "aggregate_load_tv": 0.02654867256637168 + }, + "system_x": { + "tokens": 113, + "ordered_topk_exact_tokens": 60, + "set_exact_tokens": 75, + "mean_set_jaccard": 0.8993678887484198, + "mean_token_weighted_tv": 0.023446180907168747, + "aggregate_load_tv": 0.04277286135693215 + }, + "system_period": { + "tokens": 113, + "ordered_topk_exact_tokens": 64, + "set_exact_tokens": 79, + "mean_set_jaccard": 0.9068689422671724, + "mean_token_weighted_tv": 0.023045503443716902, + "aggregate_load_tv": 0.03982300884955752 + }, + "bos_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 65, + "set_exact_tokens": 80, + "mean_set_jaccard": 0.9146649810366625, + "mean_token_weighted_tv": 0.01999782644772688, + "aggregate_load_tv": 0.03392330383480826 + }, + "bos_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 60, + "set_exact_tokens": 75, + "mean_set_jaccard": 0.8986514959966289, + "mean_token_weighted_tv": 0.02339831042408416, + "aggregate_load_tv": 0.03687315634218289 + }, + "x_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 66, + "set_exact_tokens": 83, + "mean_set_jaccard": 0.9222503160556259, + "mean_token_weighted_tv": 0.019590700416108674, + "aggregate_load_tv": 0.030973451327433628 + }, + "x_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 51, + "set_exact_tokens": 65, + "mean_set_jaccard": 0.8721871049304677, + "mean_token_weighted_tv": 0.028939135380880495, + "aggregate_load_tv": 0.04277286135693215 + }, + "period_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 70, + "set_exact_tokens": 85, + "mean_set_jaccard": 0.927307206068268, + "mean_token_weighted_tv": 0.018719892355456815, + "aggregate_load_tv": 0.029498525073746312 + }, + "period_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 53, + "set_exact_tokens": 68, + "mean_set_jaccard": 0.8828487147071219, + "mean_token_weighted_tv": 0.027716150630957784, + "aggregate_load_tv": 0.04129793510324484 + } + } + }, + "layer_08": { + "layer": 8, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "8682bc4c8be100d8c9d07d81f87ceaf86417cf7168cef44bfd13f6e149dceebd", + "route_weight_sha256": "b3ff7dac1e5d3ce154b7c879d9e072ec3e76b1d2ff79577064f508f3515681c4", + "loads": [ + 7, + 0, + 3, + 15, + 23, + 4, + 14, + 12, + 2, + 15, + 16, + 15, + 1, + 8, + 6, + 42, + 3, + 12, + 10, + 15, + 17, + 14, + 0, + 6, + 3, + 8, + 0, + 0, + 8, + 21, + 27, + 15, + 12, + 8, + 12, + 8, + 5, + 13, + 4, + 31, + 22, + 21, + 7, + 16, + 10, + 15, + 6, + 11, + 5, + 1, + 3, + 6, + 10, + 6, + 13, + 8, + 6, + 13, + 9, + 21, + 8, + 15, + 8, + 3 + ], + "weighted_loads": [ + 0.4863005094230175, + 0.0, + 0.10210791788995266, + 1.187927383929491, + 1.6196674797683954, + 0.19405537471175194, + 0.9921583719551563, + 0.6256895251572132, + 0.09759335219860077, + 1.0737364068627357, + 1.19861426576972, + 1.0121262650936842, + 0.08367142826318741, + 0.48601341620087624, + 0.27114856988191605, + 3.033617600798607, + 0.11215728335082531, + 0.6896109730005264, + 0.42829716205596924, + 0.8301431089639664, + 1.487342443317175, + 0.8446661531925201, + 0.0, + 0.2630412019789219, + 0.1792222000658512, + 0.5445207878947258, + 0.0, + 0.0, + 0.4766284339129925, + 1.453214704990387, + 1.9620783887803555, + 1.2711460702121258, + 1.2761738076806068, + 0.3921111263334751, + 0.7810390200465918, + 0.3445527143776417, + 0.23712321557104588, + 0.552119268104434, + 0.19469923339784145, + 2.807823272421956, + 2.2413169369101524, + 1.0576818995177746, + 0.38801918737590313, + 0.6631424091756344, + 0.4239979740232229, + 1.128167163580656, + 0.3404344655573368, + 0.8424321748316288, + 0.3954007774591446, + 0.053510796278715134, + 0.09559409879148006, + 0.3819539397954941, + 0.5141952820122242, + 0.42653801292181015, + 1.165522351861, + 0.5042714755982161, + 0.21986592188477516, + 0.8696366008371115, + 0.4561733454465866, + 1.820412889122963, + 0.4098195806145668, + 0.6563861966133118, + 0.46457473933696747, + 0.1382068246603012 + ], + "unique_experts": 60, + "load_cv": 0.7387069157284544, + "normalized_load_entropy": 0.9348754161937023, + "max_load_share": 0.061946902654867256 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "6383ec901a2edfd9491b401d76f0eb4a46dfc63944ec80212afa62c36b41140a", + "route_weight_sha256": "7757252d82bffeba14bd72eb9579daa9478d1e68742ce6cf14201e166afdaa07", + "loads": [ + 7, + 6, + 5, + 16, + 25, + 4, + 19, + 13, + 10, + 15, + 18, + 18, + 8, + 15, + 6, + 42, + 3, + 15, + 11, + 15, + 18, + 14, + 2, + 6, + 3, + 19, + 0, + 0, + 8, + 21, + 30, + 16, + 16, + 20, + 12, + 8, + 5, + 13, + 4, + 38, + 29, + 21, + 7, + 16, + 10, + 21, + 13, + 15, + 5, + 4, + 6, + 6, + 22, + 6, + 17, + 15, + 6, + 13, + 13, + 21, + 8, + 15, + 9, + 6 + ], + "weighted_loads": [ + 0.4863005094230175, + 0.36991639994084835, + 0.1410921085625887, + 1.2534795887768269, + 1.68329449580051, + 0.19405537471175194, + 1.4613376297056675, + 0.670819852501154, + 0.6827173717319965, + 1.0737364068627357, + 1.3236435502767563, + 1.1145607829093933, + 0.46313852816820145, + 0.9588487967848778, + 0.27114856988191605, + 3.033617600798607, + 0.11215728335082531, + 0.8577098697423935, + 0.4627268724143505, + 0.8301431089639664, + 1.5501733906567097, + 0.8446661531925201, + 0.0734008401632309, + 0.2630412019789219, + 0.1792222000658512, + 1.3140952996909618, + 0.0, + 0.0, + 0.4766284339129925, + 1.453214704990387, + 2.0227112164720893, + 1.4101794324815273, + 1.4478779956698418, + 1.350179424509406, + 0.7810390200465918, + 0.3445527143776417, + 0.23712321557104588, + 0.552119268104434, + 0.19469923339784145, + 3.0161511502228677, + 2.6292183473706245, + 1.0576818995177746, + 0.38801918737590313, + 0.6631424091756344, + 0.4239979740232229, + 1.610469039529562, + 1.086998913437128, + 0.9655435653403401, + 0.3954007774591446, + 0.19962386414408684, + 0.265663193538785, + 0.3819539397954941, + 1.2037605345249176, + 0.42653801292181015, + 2.7450628019869328, + 0.9667108096182346, + 0.21986592188477516, + 0.8696366008371115, + 0.5726308724842966, + 1.820412889122963, + 0.4098195806145668, + 0.6563861966133118, + 0.5107761137187481, + 0.34443502128124237 + ], + "unique_experts": 62, + "load_cv": 0.6456644182670487, + "normalized_load_entropy": 0.9502260776845914, + "max_load_share": 0.050724637681159424 + } + }, + "s1_eos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "ffe596bdd733182a5a9b0eabe30b3128040d7e2ea5debd473977f3f98ee70715", + "route_weight_sha256": "16717bdd40c65e4108ca64b606f949065d3a94ec47ab6e3872d709abf703e79a", + "loads": [ + 8, + 0, + 3, + 15, + 22, + 4, + 14, + 12, + 2, + 15, + 15, + 17, + 1, + 8, + 6, + 40, + 4, + 12, + 9, + 14, + 17, + 14, + 0, + 6, + 3, + 9, + 0, + 0, + 8, + 21, + 26, + 15, + 12, + 8, + 12, + 7, + 5, + 15, + 4, + 31, + 22, + 21, + 7, + 17, + 11, + 15, + 5, + 12, + 5, + 1, + 3, + 5, + 9, + 7, + 13, + 8, + 6, + 13, + 8, + 21, + 8, + 16, + 8, + 3 + ], + "weighted_loads": [ + 0.5138419438153505, + 0.0, + 0.10224665515124798, + 1.183340061455965, + 1.5621241182088852, + 0.19814854115247726, + 0.9711174108088017, + 0.6316834054887295, + 0.10107388347387314, + 1.0712325349450111, + 1.1512309946119785, + 1.0822483468800783, + 0.08448847383260727, + 0.4814327023923397, + 0.27432993799448013, + 2.9371370300650597, + 0.14813009835779667, + 0.6413164809346199, + 0.37487529404461384, + 0.795176412910223, + 1.4923511110246181, + 0.8440710939466953, + 0.0, + 0.2607504427433014, + 0.17292747646570206, + 0.5859408266842365, + 0.0, + 0.0, + 0.4696418344974518, + 1.449520718306303, + 1.9146867096424103, + 1.274258591234684, + 1.2673061713576317, + 0.3888235129415989, + 0.7822106909006834, + 0.3197608757764101, + 0.23851412534713745, + 0.6331490855664015, + 0.18600880540907383, + 2.7691425308585167, + 2.2482678666710854, + 1.0406224094331264, + 0.3891558237373829, + 0.7173690535128117, + 0.45780493319034576, + 1.0696085020899773, + 0.2949296608567238, + 0.8882189318537712, + 0.3952544629573822, + 0.05221438407897949, + 0.094027791172266, + 0.3437003009021282, + 0.4835144877433777, + 0.47353821992874146, + 1.146439790725708, + 0.49516360834240913, + 0.22196675837039948, + 0.8588798567652702, + 0.42641399428248405, + 1.8115136250853539, + 0.41050664335489273, + 0.689010152593255, + 0.462118960916996, + 0.14136509969830513 + ], + "unique_experts": 60, + "load_cv": 0.7259694298116959, + "normalized_load_entropy": 0.9358908112059359, + "max_load_share": 0.058997050147492625 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "36a3a2c5a8446a46a5b1d5f91570f321e2dea93385ccc02f8b2ed167e4da9f7d", + "route_weight_sha256": "489c164d97673d489d23c654163371605c2f7ff86453076391ec58e5a34cf77d", + "loads": [ + 9, + 5, + 13, + 17, + 23, + 5, + 25, + 12, + 15, + 15, + 19, + 21, + 10, + 15, + 6, + 40, + 4, + 26, + 11, + 14, + 18, + 14, + 1, + 10, + 3, + 20, + 0, + 2, + 9, + 21, + 28, + 16, + 16, + 27, + 12, + 7, + 5, + 15, + 11, + 37, + 35, + 21, + 9, + 17, + 11, + 27, + 20, + 16, + 8, + 6, + 7, + 5, + 19, + 13, + 17, + 17, + 6, + 13, + 11, + 23, + 8, + 20, + 10, + 8 + ], + "weighted_loads": [ + 0.5530566778033972, + 0.28076453506946564, + 0.7243006806820631, + 1.30506107583642, + 1.6031821705400944, + 0.24230623990297318, + 1.936606515198946, + 0.6316834054887295, + 0.970268614590168, + 1.0712325349450111, + 1.3670977465808392, + 1.2009150262456387, + 0.6168560013175011, + 0.9307111650705338, + 0.27432993799448013, + 2.9371370300650597, + 0.14813009835779667, + 1.6409377567470074, + 0.4702386911958456, + 0.795176412910223, + 1.5570348836481571, + 0.8440710939466953, + 0.039504680782556534, + 0.4490201584994793, + 0.17292747646570206, + 1.6954353973269463, + 0.0, + 0.11953316256403923, + 0.5117103196680546, + 1.449520718306303, + 1.9374784817919135, + 1.4023413732647896, + 1.4121616296470165, + 1.6570885237306356, + 0.7822106909006834, + 0.3197608757764101, + 0.23851412534713745, + 0.6331490855664015, + 0.6216683853417635, + 2.932557923719287, + 2.854237448424101, + 1.0406224094331264, + 0.5576583929359913, + 0.7173690535128117, + 0.45780493319034576, + 2.1200736314058304, + 1.3856060579419136, + 1.0056803319603205, + 0.7124243155121803, + 0.36285538971424103, + 0.3149389438331127, + 0.3437003009021282, + 1.0386938340961933, + 1.1459486931562424, + 2.7317858021706343, + 1.1551702357828617, + 0.22196675837039948, + 0.8588798567652702, + 0.5294236999470741, + 1.884594488888979, + 0.41050664335489273, + 0.8772835228592157, + 0.5626129917800426, + 0.4399961531162262 + ], + "unique_experts": 63, + "load_cv": 0.58656011850807, + "normalized_load_entropy": 0.9577528017579576, + "max_load_share": 0.04329004329004329 + } + }, + "s0_bos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "b02cb11e94c1fa3b09d8a22625eb66e79c975c54bc280f29d54fc57734af1119", + "route_weight_sha256": "5872e140d962bed1701cd35c8f85aa4f82de3a760767f5198903c28cc07edaef", + "loads": [ + 7, + 0, + 3, + 15, + 24, + 4, + 14, + 12, + 1, + 14, + 15, + 15, + 1, + 7, + 5, + 41, + 3, + 12, + 10, + 13, + 17, + 15, + 0, + 7, + 3, + 10, + 0, + 0, + 8, + 21, + 27, + 15, + 12, + 7, + 12, + 9, + 5, + 15, + 4, + 30, + 22, + 21, + 7, + 18, + 10, + 15, + 8, + 10, + 6, + 1, + 2, + 7, + 10, + 6, + 12, + 8, + 6, + 12, + 8, + 22, + 8, + 16, + 8, + 2 + ], + "weighted_loads": [ + 0.4814317524433136, + 0.0, + 0.10560544766485691, + 1.1857411190867424, + 1.6119701713323593, + 0.19710035249590874, + 1.0313972048461437, + 0.6423572935163975, + 0.03912126645445824, + 1.0448158793151379, + 1.1562987342476845, + 1.0178844518959522, + 0.0836123526096344, + 0.45338378101587296, + 0.23790903761982918, + 2.988150965422392, + 0.1274254471063614, + 0.6664185095578432, + 0.41574275121092796, + 0.7330062836408615, + 1.4660033509135246, + 0.8979056105017662, + 0.0, + 0.3154584988951683, + 0.18198485672473907, + 0.6423737518489361, + 0.0, + 0.0, + 0.4821358323097229, + 1.4911190010607243, + 1.9529376924037933, + 1.289539996534586, + 1.308090627193451, + 0.3720797151327133, + 0.7973226495087147, + 0.38343068957328796, + 0.21965735778212547, + 0.6416038107126951, + 0.18530592136085033, + 2.782063828781247, + 2.2195134311914444, + 1.0554480738937855, + 0.3968250248581171, + 0.7529949974268675, + 0.429844006896019, + 1.0682000778615475, + 0.4474055599421263, + 0.824598602950573, + 0.4286949411034584, + 0.051521286368370056, + 0.06329973414540291, + 0.40843939781188965, + 0.5257677547633648, + 0.4389331191778183, + 1.1443712785840034, + 0.5108595322817564, + 0.20412016287446022, + 0.8611776363104582, + 0.4166507013142109, + 1.8397299405187368, + 0.41261737048625946, + 0.664947371929884, + 0.468765314668417, + 0.10186972841620445 + ], + "unique_experts": 60, + "load_cv": 0.7377639504439095, + "normalized_load_entropy": 0.9337660487642032, + "max_load_share": 0.06047197640117994 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "b8b3381a4025cc21a5732a623aa095550baf15d8b12a29ffa62042ec8af432cc", + "route_weight_sha256": "3014f8219b389ff253785f49c8d44ff83485998802fb8a977044665616bb6b30", + "loads": [ + 7, + 6, + 5, + 16, + 25, + 4, + 19, + 13, + 9, + 14, + 16, + 18, + 8, + 14, + 5, + 42, + 3, + 16, + 11, + 13, + 18, + 15, + 2, + 7, + 4, + 21, + 0, + 0, + 8, + 21, + 30, + 16, + 16, + 21, + 12, + 9, + 5, + 15, + 4, + 36, + 28, + 21, + 7, + 18, + 10, + 22, + 15, + 13, + 6, + 4, + 5, + 7, + 22, + 6, + 16, + 15, + 6, + 12, + 11, + 22, + 8, + 16, + 9, + 5 + ], + "weighted_loads": [ + 0.4814317524433136, + 0.36991639994084835, + 0.14458963833749294, + 1.2480055056512356, + 1.6727659553289413, + 0.19710035249590874, + 1.5211376212537289, + 0.6874876208603382, + 0.6433715038001537, + 1.0448158793151379, + 1.2260397896170616, + 1.1214040163904428, + 0.46307945251464844, + 0.9275977909564972, + 0.23790903761982918, + 3.033568948507309, + 0.1274254471063614, + 0.8889959622174501, + 0.45127303525805473, + 0.7330062836408615, + 1.528795599937439, + 0.8979056105017662, + 0.0734008401632309, + 0.3154584988951683, + 0.2268514260649681, + 1.4119482636451721, + 0.0, + 0.0, + 0.4821358323097229, + 1.4911190010607243, + 2.062741132453084, + 1.429536823183298, + 1.4797948151826859, + 1.4901341702789068, + 0.7973226495087147, + 0.38343068957328796, + 0.21965735778212547, + 0.6416038107126951, + 0.18530592136085033, + 3.0018035247921944, + 2.592655036598444, + 1.0554480738937855, + 0.3968250248581171, + 0.7529949974268675, + 0.429844006896019, + 1.6008253023028374, + 1.1331116650253534, + 0.938265566714108, + 0.4286949411034584, + 0.1975853219628334, + 0.23336882889270782, + 0.40843939781188965, + 1.2210449017584324, + 0.4389331191778183, + 1.8529853969812393, + 0.9968943186104298, + 0.20412016287446022, + 0.8611776363104582, + 0.5300524905323982, + 1.8397299405187368, + 0.41261737048625946, + 0.664947371929884, + 0.5149666890501976, + 0.3080979250371456 + ], + "unique_experts": 62, + "load_cv": 0.6411667292318393, + "normalized_load_entropy": 0.9506443807382737, + "max_load_share": 0.050724637681159424 + } + }, + "s1_bos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "c5012be3e9f9756dd2a193dfc3bd80fa140a9b829300fa84e5224ae488d53966", + "route_weight_sha256": "857588c4185b90e6041a68175064bdb96e093a82997e5650885c66021fc76d57", + "loads": [ + 8, + 0, + 3, + 15, + 23, + 4, + 14, + 11, + 2, + 13, + 15, + 15, + 2, + 7, + 6, + 42, + 3, + 10, + 8, + 15, + 17, + 15, + 0, + 7, + 3, + 11, + 0, + 0, + 8, + 21, + 27, + 16, + 12, + 8, + 12, + 9, + 7, + 13, + 4, + 30, + 23, + 23, + 7, + 18, + 10, + 13, + 6, + 10, + 6, + 1, + 1, + 6, + 10, + 6, + 12, + 8, + 6, + 13, + 7, + 22, + 8, + 17, + 8, + 1 + ], + "weighted_loads": [ + 0.5057813730090857, + 0.0, + 0.10734625719487667, + 1.1984300166368484, + 1.5144634190946817, + 0.19629968330264091, + 1.0175257846713066, + 0.6064326446503401, + 0.09941359609365463, + 0.9814801923930645, + 1.1551968194544315, + 0.9990055412054062, + 0.11639952845871449, + 0.44520482048392296, + 0.2806374467909336, + 3.038444347679615, + 0.1267915889620781, + 0.584055058658123, + 0.34219950810074806, + 0.8195374347269535, + 1.4646294340491295, + 0.9019836485385895, + 0.0, + 0.31668735295534134, + 0.17470843344926834, + 0.6838490404188633, + 0.0, + 0.0, + 0.4755407087504864, + 1.4765943586826324, + 1.943597950041294, + 1.306909192353487, + 1.2840163558721542, + 0.4122207947075367, + 0.784348089247942, + 0.39550573378801346, + 0.2921988647431135, + 0.5677599683403969, + 0.17631058767437935, + 2.7446404676884413, + 2.296033451333642, + 1.1098339408636093, + 0.39451603405177593, + 0.7663717232644558, + 0.4443403631448746, + 0.9950593672692776, + 0.34213571809232235, + 0.8414218723773956, + 0.43673809990286827, + 0.05314088240265846, + 0.02863653004169464, + 0.36736237443983555, + 0.507399283349514, + 0.43940266221761703, + 1.127423882484436, + 0.4992491640150547, + 0.20230194739997387, + 0.8727001026272774, + 0.3698292262852192, + 1.8319546934217215, + 0.4154729060828686, + 0.6882401760667562, + 0.45717403292655945, + 0.03829321637749672 + ], + "unique_experts": 60, + "load_cv": 0.7473263720979709, + "normalized_load_entropy": 0.9329448423221669, + "max_load_share": 0.061946902654867256 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "812add15028e739646c7bb8feff3d3b26dfa27008b69ff58e7f3fff019133bec", + "route_weight_sha256": "9262c139d16cda78b91144ba5c0f6ffd6921734321cd5f23b1cc9ffc3bd423db", + "loads": [ + 9, + 5, + 13, + 17, + 25, + 5, + 25, + 11, + 15, + 13, + 18, + 18, + 11, + 14, + 6, + 43, + 3, + 25, + 10, + 15, + 18, + 15, + 1, + 11, + 4, + 22, + 0, + 2, + 9, + 21, + 30, + 17, + 16, + 30, + 12, + 9, + 7, + 13, + 10, + 35, + 35, + 23, + 9, + 18, + 10, + 26, + 21, + 13, + 9, + 6, + 5, + 6, + 20, + 12, + 15, + 17, + 6, + 13, + 9, + 23, + 8, + 21, + 10, + 6 + ], + "weighted_loads": [ + 0.5449961069971323, + 0.28076453506946564, + 0.7294002827256918, + 1.3185150176286697, + 1.6016055401414633, + 0.24045738205313683, + 1.9950526356697083, + 0.6064326446503401, + 0.9986587129533291, + 0.9814801923930645, + 1.3124508745968342, + 1.1144995670765638, + 0.6487670559436083, + 0.8975194692611694, + 0.2806374467909336, + 3.0793315656483173, + 0.1267915889620781, + 1.6421303674578667, + 0.4419943019747734, + 0.8195374347269535, + 1.532922551035881, + 0.9019836485385895, + 0.039504680782556534, + 0.5049570687115192, + 0.214723888784647, + 1.793343611061573, + 0.0, + 0.11953316256403923, + 0.5176091939210892, + 1.4765943586826324, + 2.0511144790798426, + 1.4249586798250675, + 1.428871814161539, + 1.902002016082406, + 0.784348089247942, + 0.39550573378801346, + 0.2921988647431135, + 0.5677599683403969, + 0.5716686993837357, + 2.916030164808035, + 2.899977931752801, + 1.1098339408636093, + 0.5630186032503843, + 0.7663717232644558, + 0.4443403631448746, + 2.1124202460050583, + 1.3952693548053503, + 0.9498223485425115, + 0.7539079524576664, + 0.3645022623240948, + 0.24954768270254135, + 0.36736237443983555, + 1.0644259825348854, + 1.111813135445118, + 1.7991945799440145, + 1.1824939958751202, + 0.20230194739997387, + 0.8727001026272774, + 0.4699179008603096, + 1.8653652612119913, + 0.4154729060828686, + 0.8765135463327169, + 0.5576680637896061, + 0.3369242697954178 + ], + "unique_experts": 63, + "load_cv": 0.6041869615627301, + "normalized_load_entropy": 0.9560604534321847, + "max_load_share": 0.046536796536796536 + } + }, + "s0_x": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "52d187becb13dd60cd47af7cd95ed6f239f8bff70986dd366b6693393daaa240", + "route_weight_sha256": "5572d48f7bca6a2f38e47f786ff7a81bf9a7f9c781f53f182739a8b6f5a65bbc", + "loads": [ + 8, + 0, + 3, + 15, + 22, + 4, + 14, + 10, + 2, + 15, + 15, + 15, + 1, + 7, + 5, + 40, + 3, + 10, + 9, + 13, + 17, + 15, + 0, + 7, + 3, + 9, + 0, + 0, + 8, + 20, + 26, + 15, + 12, + 7, + 12, + 8, + 6, + 17, + 5, + 30, + 22, + 21, + 7, + 18, + 9, + 16, + 7, + 10, + 5, + 1, + 1, + 7, + 11, + 6, + 14, + 8, + 7, + 13, + 9, + 23, + 8, + 17, + 8, + 2 + ], + "weighted_loads": [ + 0.5152359120547771, + 0.0, + 0.10448875650763512, + 1.1883134506642818, + 1.5599743537604809, + 0.19694945961236954, + 0.9875225126743317, + 0.5596761554479599, + 0.10320746898651123, + 1.0886605866253376, + 1.1463571675121784, + 1.0077811852097511, + 0.08035346865653992, + 0.4404907375574112, + 0.23371151089668274, + 2.944959692656994, + 0.11204952374100685, + 0.5772828478366137, + 0.3971513696014881, + 0.7239569798111916, + 1.4527764469385147, + 0.8998147062957287, + 0.0, + 0.2936658523976803, + 0.18621864169836044, + 0.5995239224284887, + 0.0, + 0.0, + 0.47049228101968765, + 1.4256347976624966, + 1.8969201371073723, + 1.2881252504885197, + 1.2808186747133732, + 0.38190294802188873, + 0.7897071670740843, + 0.350052896887064, + 0.2723441254347563, + 0.7408640254288912, + 0.22828124649822712, + 2.815890334546566, + 2.2388201728463173, + 1.0475482791662216, + 0.3886789456009865, + 0.7641418147832155, + 0.4009641706943512, + 1.1558430790901184, + 0.4104286376386881, + 0.8313777409493923, + 0.3892502412199974, + 0.052733976393938065, + 0.029371410608291626, + 0.41693538054823875, + 0.5354161784052849, + 0.42616239562630653, + 1.2340512070804834, + 0.5124741829931736, + 0.23912101052701473, + 0.8708706349134445, + 0.45917798578739166, + 1.8726689778268337, + 0.40487683936953545, + 0.7238516695797443, + 0.46956151723861694, + 0.10036332160234451 + ], + "unique_experts": 60, + "load_cv": 0.72922239381455, + "normalized_load_entropy": 0.9346013271439658, + "max_load_share": 0.058997050147492625 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "4b38276f1afe8b6270c5510c621073fdc6182c24c8f32cdc8dc1711c9ff19b85", + "route_weight_sha256": "c7ab8562dd9572bf2af251e8ff0f5243a600c73c11b9de871d1d7275e1e656a1", + "loads": [ + 8, + 7, + 6, + 17, + 23, + 4, + 20, + 11, + 12, + 15, + 16, + 18, + 8, + 15, + 5, + 40, + 3, + 13, + 10, + 13, + 17, + 15, + 2, + 7, + 3, + 21, + 0, + 0, + 8, + 20, + 27, + 16, + 17, + 19, + 12, + 8, + 6, + 17, + 6, + 35, + 28, + 21, + 7, + 18, + 9, + 23, + 14, + 13, + 5, + 5, + 5, + 7, + 22, + 6, + 16, + 15, + 7, + 13, + 12, + 23, + 8, + 17, + 9, + 5 + ], + "weighted_loads": [ + 0.5152359120547771, + 0.4226067941635847, + 0.18557675555348396, + 1.3024635836482048, + 1.620770137757063, + 0.19694945961236954, + 1.5024360306560993, + 0.6048064827919006, + 0.8278368338942528, + 1.0886605866253376, + 1.2135962508618832, + 1.1127200853079557, + 0.45982056856155396, + 1.0017395466566086, + 0.23371151089668274, + 2.944959692656994, + 0.11204952374100685, + 0.7513782475143671, + 0.4327034205198288, + 0.7239569798111916, + 1.4527764469385147, + 0.8998147062957287, + 0.0734008401632309, + 0.2936658523976803, + 0.18621864169836044, + 1.4682873133569956, + 0.0, + 0.0, + 0.47049228101968765, + 1.4256347976624966, + 1.9130875039845705, + 1.4149524457752705, + 1.49589654058218, + 1.2774137426167727, + 0.7897071670740843, + 0.350052896887064, + 0.2723441254347563, + 0.7408640254288912, + 0.2660846132785082, + 2.9808445293456316, + 2.5834984593093395, + 1.0475482791662216, + 0.3886789456009865, + 0.7641418147832155, + 0.4009641706943512, + 1.6735406443476677, + 1.1098977979272604, + 0.9450447047129273, + 0.3892502412199974, + 0.249109897762537, + 0.2532318979501724, + 0.41693538054823875, + 1.1904647164046764, + 0.42616239562630653, + 1.859645077958703, + 0.9925181698054075, + 0.23912101052701473, + 0.8708706349134445, + 0.572579775005579, + 1.8726689778268337, + 0.40487683936953545, + 0.7238516695797443, + 0.5157628916203976, + 0.3065915182232857 + ], + "unique_experts": 62, + "load_cv": 0.6156151448602044, + "normalized_load_entropy": 0.9536198031684306, + "max_load_share": 0.04830917874396135 + } + }, + "s1_x": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "d5cf3dc49ff2659d2731bcd0922b400e37ec7796ec23ea6636d6c39f852bfae2", + "route_weight_sha256": "7b7eb8300bee787933af9997166b3c8faefabc1cb0bb0ba8f294069d3276672a", + "loads": [ + 9, + 0, + 3, + 15, + 22, + 4, + 14, + 11, + 2, + 14, + 15, + 15, + 2, + 8, + 6, + 42, + 3, + 9, + 8, + 14, + 17, + 16, + 0, + 9, + 3, + 11, + 0, + 0, + 7, + 21, + 27, + 15, + 12, + 6, + 12, + 8, + 5, + 14, + 4, + 30, + 23, + 22, + 7, + 18, + 11, + 14, + 7, + 10, + 6, + 1, + 1, + 5, + 10, + 6, + 12, + 8, + 6, + 14, + 7, + 23, + 8, + 16, + 8, + 2 + ], + "weighted_loads": [ + 0.5408566631376743, + 0.0, + 0.10609967447817326, + 1.1921210922300816, + 1.4530936423689127, + 0.19775725156068802, + 0.998966246843338, + 0.6191567629575729, + 0.10088370740413666, + 1.0049166269600391, + 1.1371793113648891, + 1.0034531373530626, + 0.11608597449958324, + 0.4747159108519554, + 0.2825150489807129, + 2.995354510843754, + 0.12255289405584335, + 0.4988464303314686, + 0.33737316727638245, + 0.7786050364375114, + 1.4483546800911427, + 0.9525852538645267, + 0.0, + 0.3870411515235901, + 0.16889160126447678, + 0.7269835956394672, + 0.0, + 0.0, + 0.41940281353890896, + 1.469971802085638, + 1.9414863474667072, + 1.2596610821783543, + 1.2830958664417267, + 0.28071050345897675, + 0.788315175101161, + 0.3564399518072605, + 0.2327086254954338, + 0.5871480330824852, + 0.1782460492104292, + 2.735503090545535, + 2.333783321082592, + 1.0758715961128473, + 0.3861377239227295, + 0.7591423653066158, + 0.46350525692105293, + 1.0556599386036396, + 0.4351951330900192, + 0.8617442958056927, + 0.4189790189266205, + 0.05395779013633728, + 0.028894294053316116, + 0.3359145186841488, + 0.5104569084942341, + 0.4186795651912689, + 1.1301539093255997, + 0.5105168465524912, + 0.20021123997867107, + 0.8985097613185644, + 0.3671660088002682, + 1.8625179696828127, + 0.41496313735842705, + 0.6687229666858912, + 0.4607737623155117, + 0.08728508278727531 + ], + "unique_experts": 60, + "load_cv": 0.7462077415228177, + "normalized_load_entropy": 0.933240029143851, + "max_load_share": 0.061946902654867256 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "6f095cc02917e1996c519e0115e6edf5123444a69d507d135fece077a74ba0e8", + "route_weight_sha256": "ecc3800aa8f66b118543ef3405e29b76d0b3a5e09b2c86d62507668bb2bee900", + "loads": [ + 10, + 6, + 14, + 17, + 22, + 5, + 26, + 11, + 17, + 14, + 19, + 19, + 11, + 17, + 6, + 42, + 3, + 23, + 10, + 14, + 18, + 16, + 1, + 13, + 3, + 24, + 0, + 2, + 8, + 21, + 29, + 16, + 17, + 25, + 12, + 8, + 5, + 14, + 11, + 34, + 35, + 22, + 9, + 18, + 11, + 26, + 21, + 13, + 9, + 7, + 6, + 5, + 19, + 12, + 14, + 16, + 6, + 14, + 9, + 24, + 8, + 20, + 10, + 7 + ], + "weighted_loads": [ + 0.580071397125721, + 0.32456282153725624, + 0.7650436218827963, + 1.3098020479083061, + 1.4530936423689127, + 0.24191495031118393, + 2.0053777880966663, + 0.6191567629575729, + 1.068318422883749, + 1.0049166269600391, + 1.3518828451633453, + 1.15727973356843, + 0.648453501984477, + 1.0617369525134563, + 0.2825150489807129, + 2.995354510843754, + 0.12255289405584335, + 1.5064518228173256, + 0.4458388313651085, + 0.7786050364375114, + 1.5117137990891933, + 0.9525852538645267, + 0.039504680782556534, + 0.575310867279768, + 0.16889160126447678, + 2.0064756758511066, + 0.0, + 0.11953316256403923, + 0.46147129870951176, + 1.469971802085638, + 1.9994392488151789, + 1.371322300285101, + 1.469550296664238, + 1.4704342242330313, + 0.788315175101161, + 0.3564399518072605, + 0.2327086254954338, + 0.5871480330824852, + 0.6156021784991026, + 2.8604893907904625, + 2.8807263486087322, + 1.0758715961128473, + 0.5546402931213379, + 0.7591423653066158, + 0.46350525692105293, + 2.0855514891445637, + 1.4199988171458244, + 0.9701447719708085, + 0.7361488714814186, + 0.41674575209617615, + 0.32160480692982674, + 0.3359145186841488, + 1.0327963829040527, + 1.0910900384187698, + 1.7553747836500406, + 1.0918562654405832, + 0.20021123997867107, + 0.8985097613185644, + 0.4672546833753586, + 1.8959285374730825, + 0.41496313735842705, + 0.8569963369518518, + 0.5612677931785583, + 0.3859161362051964 + ], + "unique_experts": 63, + "load_cv": 0.5852807448957791, + "normalized_load_entropy": 0.9577889338648837, + "max_load_share": 0.045454545454545456 + } + }, + "s0_period": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "00482ea8807ec8e80ec07d6f306074a5781be3e7eec87dc9a771f9a6bd399882", + "route_weight_sha256": "8b3df02aaa8f12262d2a8daaf5eae7060c3463205309f8b7aed48514bb610e43", + "loads": [ + 9, + 0, + 3, + 15, + 23, + 4, + 14, + 11, + 1, + 15, + 15, + 15, + 1, + 7, + 5, + 41, + 2, + 11, + 10, + 13, + 17, + 15, + 0, + 6, + 3, + 8, + 0, + 0, + 8, + 20, + 26, + 15, + 12, + 8, + 12, + 9, + 7, + 16, + 5, + 30, + 22, + 21, + 7, + 18, + 11, + 15, + 8, + 10, + 5, + 1, + 1, + 7, + 9, + 6, + 14, + 8, + 6, + 12, + 8, + 22, + 8, + 17, + 8, + 2 + ], + "weighted_loads": [ + 0.5640036668628454, + 0.0, + 0.1043520700186491, + 1.1951484642922878, + 1.6046205591410398, + 0.19495154544711113, + 0.9908866081386805, + 0.6113610342144966, + 0.043783511966466904, + 1.0907847620546818, + 1.1461368426680565, + 0.9992912858724594, + 0.08246488869190216, + 0.43580497801303864, + 0.2374090999364853, + 2.9667657800018787, + 0.07979697734117508, + 0.6343901343643665, + 0.42582344077527523, + 0.7339503206312656, + 1.4669329151511192, + 0.91718390583992, + 0.0, + 0.26854662597179413, + 0.18217211216688156, + 0.5694792922586203, + 0.0, + 0.0, + 0.47775560803711414, + 1.433229360729456, + 1.8950587771832943, + 1.3034319542348385, + 1.301208756864071, + 0.4029605854302645, + 0.7893407680094242, + 0.39115341380238533, + 0.30519241094589233, + 0.6983521860092878, + 0.22858816385269165, + 2.7921413220465183, + 2.209990967065096, + 1.03044768050313, + 0.39197457395493984, + 0.7793475147336721, + 0.4715367555618286, + 1.106242822483182, + 0.47103472612798214, + 0.8371070325374603, + 0.39300649985671043, + 0.054850466549396515, + 0.029108813032507896, + 0.41766760125756264, + 0.4755783900618553, + 0.4298669956624508, + 1.229909509420395, + 0.513351334258914, + 0.20694725029170513, + 0.8443750273436308, + 0.42367151379585266, + 1.8339968007057905, + 0.41009534150362015, + 0.7219052966684103, + 0.47190116345882416, + 0.0997607558965683 + ], + "unique_experts": 60, + "load_cv": 0.7351172127064941, + "normalized_load_entropy": 0.9333790664540301, + "max_load_share": 0.06047197640117994 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "7eb30389aea0f3323d0760034d97a7ad9954f579f4ceb0a30faefd3b9ad690d5", + "route_weight_sha256": "7b25e49ba00e11b96496b8c8920255c2f6320c077c605dbfb5c62cc27efec8df", + "loads": [ + 9, + 6, + 5, + 17, + 24, + 4, + 22, + 12, + 10, + 15, + 16, + 18, + 8, + 15, + 5, + 41, + 2, + 14, + 11, + 13, + 18, + 15, + 2, + 6, + 3, + 20, + 0, + 0, + 8, + 20, + 27, + 16, + 16, + 20, + 12, + 9, + 7, + 16, + 6, + 35, + 27, + 21, + 7, + 18, + 11, + 22, + 16, + 13, + 5, + 6, + 4, + 7, + 20, + 6, + 16, + 15, + 6, + 12, + 11, + 22, + 8, + 17, + 9, + 6 + ], + "weighted_loads": [ + 0.5640036668628454, + 0.36991639994084835, + 0.14333626069128513, + 1.3134484142065048, + 1.6654163431376219, + 0.19495154544711113, + 1.6444542575627565, + 0.6564913615584373, + 0.7563030272722244, + 1.0907847620546818, + 1.2157664895057678, + 1.1043316293507814, + 0.4619319885969162, + 0.9530499130487442, + 0.2374090999364853, + 2.9667657800018787, + 0.07979697734117508, + 0.800586748868227, + 0.46172250621020794, + 0.7339503206312656, + 1.5294543206691742, + 0.91718390583992, + 0.0734008401632309, + 0.26854662597179413, + 0.18217211216688156, + 1.428137855604291, + 0.0, + 0.0, + 0.47775560803711414, + 1.433229360729456, + 1.9112261440604925, + 1.4351131282746792, + 1.4729129448533058, + 1.3083459362387657, + 0.7893407680094242, + 0.39115341380238533, + 0.30519241094589233, + 0.6983521860092878, + 0.266084011644125, + 2.958059201017022, + 2.511033356189728, + 1.03044768050313, + 0.39197457395493984, + 0.7793475147336721, + 0.4715367555618286, + 1.618804769590497, + 1.2199533265084028, + 0.9507739963009953, + 0.39300649985671043, + 0.2837141379714012, + 0.1991779077798128, + 0.41766760125756264, + 1.1306269280612469, + 0.4298669956624508, + 1.8555033802986145, + 0.9750991724431515, + 0.20694725029170513, + 0.8443750273436308, + 0.53707330301404, + 1.8339968007057905, + 0.41009534150362015, + 0.7219052966684103, + 0.5181025378406048, + 0.427209734916687 + ], + "unique_experts": 62, + "load_cv": 0.6181876276362187, + "normalized_load_entropy": 0.9530380186892761, + "max_load_share": 0.049516908212560384 + } + }, + "s1_period": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "8854455c1a633423ac5aa8b7c42d58d36c7a594fd3959f78341502b72e75884b", + "route_weight_sha256": "e822d784bd6c2cf2672a3de139caf9e58aeb33002a5dd197dbd9f08d39c4da8e", + "loads": [ + 10, + 0, + 3, + 15, + 22, + 4, + 14, + 12, + 2, + 13, + 16, + 15, + 2, + 7, + 6, + 42, + 3, + 9, + 7, + 13, + 17, + 16, + 0, + 9, + 3, + 9, + 0, + 0, + 8, + 20, + 26, + 16, + 12, + 5, + 12, + 9, + 7, + 13, + 4, + 30, + 23, + 22, + 7, + 18, + 11, + 13, + 7, + 10, + 6, + 1, + 1, + 6, + 11, + 7, + 11, + 8, + 6, + 14, + 7, + 22, + 8, + 17, + 8, + 3 + ], + "weighted_loads": [ + 0.5811895970255136, + 0.0, + 0.10466567426919937, + 1.1944859698414803, + 1.4506910480558872, + 0.19860191643238068, + 0.9905173666775227, + 0.6669354662299156, + 0.10756297409534454, + 0.9592701084911823, + 1.191233817487955, + 0.9964330494403839, + 0.1169196106493473, + 0.43536921218037605, + 0.2843112573027611, + 3.0000555403530598, + 0.1210595890879631, + 0.49869708716869354, + 0.3110007233917713, + 0.745687447488308, + 1.449966412037611, + 0.9573358371853828, + 0.0, + 0.3855369873344898, + 0.16739239543676376, + 0.6325521618127823, + 0.0, + 0.0, + 0.46235192008316517, + 1.4211611188948154, + 1.8926357366144657, + 1.3271656185388565, + 1.2955931574106216, + 0.23540162667632103, + 0.7929083444178104, + 0.3911914825439453, + 0.3049235586076975, + 0.5637848228216171, + 0.17728446796536446, + 2.7323376554995775, + 2.264900991693139, + 1.07941335439682, + 0.3938964754343033, + 0.7757632024586201, + 0.46638037264347076, + 1.0203862003982067, + 0.4152175821363926, + 0.872124258428812, + 0.4223795160651207, + 0.057273294776678085, + 0.0286405049264431, + 0.3647170979529619, + 0.5396861881017685, + 0.4601925350725651, + 1.0812222994863987, + 0.5169591121375561, + 0.21499351598322392, + 0.8988653644919395, + 0.3720599636435509, + 1.8373245652765036, + 0.4157068468630314, + 0.713583929464221, + 0.4531806707382202, + 0.12214856222271919 + ], + "unique_experts": 60, + "load_cv": 0.7360635687138763, + "normalized_load_entropy": 0.9350332131915258, + "max_load_share": 0.061946902654867256 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "a0a6635849b6fa754d64b8f7c4ab997dffa2a4810ede0bec4c055dc85d782075", + "route_weight_sha256": "db9ab22c3ba33d6c446dfd1c3cb82d12e9b36d866417304deceaeeeb4601f62e", + "loads": [ + 11, + 5, + 13, + 17, + 22, + 5, + 27, + 12, + 17, + 13, + 20, + 18, + 11, + 14, + 6, + 42, + 3, + 24, + 9, + 13, + 18, + 16, + 1, + 13, + 3, + 22, + 0, + 2, + 9, + 20, + 28, + 17, + 16, + 24, + 12, + 9, + 7, + 13, + 11, + 34, + 35, + 22, + 9, + 18, + 11, + 24, + 23, + 13, + 9, + 9, + 5, + 6, + 20, + 13, + 13, + 17, + 6, + 14, + 9, + 23, + 8, + 21, + 10, + 9 + ], + "weighted_loads": [ + 0.6204043310135603, + 0.28076453506946564, + 0.7267196998000145, + 1.3117177821695805, + 1.4506910480558872, + 0.2427596151828766, + 2.093178078532219, + 0.6669354662299156, + 1.091171257197857, + 0.9592701084911823, + 1.4037224762141705, + 1.1119270753115416, + 0.6492871381342411, + 0.8882384337484837, + 0.2843112573027611, + 3.0000555403530598, + 0.1210595890879631, + 1.5600064061582088, + 0.4194357246160507, + 0.745687447488308, + 1.5117910616099834, + 0.9573358371853828, + 0.039504680782556534, + 0.5738067030906677, + 0.16739239543676376, + 1.8724790439009666, + 0.0, + 0.11953316256403923, + 0.504420405253768, + 1.4211611188948154, + 1.9503304492682219, + 1.4442479982972145, + 1.4404486157000065, + 1.4376271534711123, + 0.7929083444178104, + 0.3911914825439453, + 0.3049235586076975, + 0.5637848228216171, + 0.6156210042536259, + 2.85887797921896, + 2.8243277315050364, + 1.07941335439682, + 0.5623990446329117, + 0.7757632024586201, + 0.46638037264347076, + 2.020017482340336, + 1.5452176630496979, + 0.9805247345939279, + 0.7395493686199188, + 0.5166861824691296, + 0.2495516575872898, + 0.3647170979529619, + 1.0620256625115871, + 1.132603008300066, + 1.7064431738108397, + 1.1366584859788418, + 0.21499351598322392, + 0.8988653644919395, + 0.4721486382186413, + 1.8707351330667734, + 0.4157068468630314, + 0.9018572997301817, + 0.5536747016012669, + 0.5014912262558937 + ], + "unique_experts": 63, + "load_cv": 0.5755948082266162, + "normalized_load_entropy": 0.9592661763231656, + "max_load_share": 0.045454545454545456 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 113, + "ordered_topk_exact_tokens": 90, + "set_exact_tokens": 99, + "mean_set_jaccard": 0.9646017699115044, + "mean_token_weighted_tv": 0.009205944704270996, + "aggregate_load_tv": 0.017699115044247787 + }, + "system_bos": { + "tokens": 113, + "ordered_topk_exact_tokens": 74, + "set_exact_tokens": 87, + "mean_set_jaccard": 0.934260429835651, + "mean_token_weighted_tv": 0.015227202202432451, + "aggregate_load_tv": 0.025073746312684365 + }, + "system_x": { + "tokens": 113, + "ordered_topk_exact_tokens": 65, + "set_exact_tokens": 84, + "mean_set_jaccard": 0.924778761061947, + "mean_token_weighted_tv": 0.01956155998385058, + "aggregate_load_tv": 0.030973451327433628 + }, + "system_period": { + "tokens": 113, + "ordered_topk_exact_tokens": 58, + "set_exact_tokens": 76, + "mean_set_jaccard": 0.9045512010113781, + "mean_token_weighted_tv": 0.022235007808271763, + "aggregate_load_tv": 0.03392330383480826 + }, + "bos_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 79, + "set_exact_tokens": 90, + "mean_set_jaccard": 0.9418457648546145, + "mean_token_weighted_tv": 0.015420447482801644, + "aggregate_load_tv": 0.02359882005899705 + }, + "bos_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 63, + "set_exact_tokens": 79, + "mean_set_jaccard": 0.9102402022756005, + "mean_token_weighted_tv": 0.019929339614721524, + "aggregate_load_tv": 0.03687315634218289 + }, + "x_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 70, + "set_exact_tokens": 86, + "mean_set_jaccard": 0.9279393173198484, + "mean_token_weighted_tv": 0.017389184869496168, + "aggregate_load_tv": 0.032448377581120944 + }, + "x_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 60, + "set_exact_tokens": 82, + "mean_set_jaccard": 0.9163506110408767, + "mean_token_weighted_tv": 0.02137427679798772, + "aggregate_load_tv": 0.03392330383480826 + }, + "period_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 73, + "set_exact_tokens": 86, + "mean_set_jaccard": 0.9279393173198484, + "mean_token_weighted_tv": 0.017750870922695748, + "aggregate_load_tv": 0.029498525073746312 + }, + "period_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 50, + "set_exact_tokens": 69, + "mean_set_jaccard": 0.8887484197218712, + "mean_token_weighted_tv": 0.02448400895449176, + "aggregate_load_tv": 0.04129793510324484 + } + } + }, + "layer_09": { + "layer": 9, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "ae2d3ee74f85f970c71ab9466ad86bf32b1ffb4dbaf98a193cd73078ccc3f91d", + "route_weight_sha256": "9b9e27c2021e4752c2704943125305c6d344fd71528727f0452a75217d4388cb", + "loads": [ + 10, + 11, + 8, + 28, + 22, + 9, + 16, + 18, + 1, + 12, + 5, + 5, + 4, + 27, + 2, + 13, + 17, + 28, + 14, + 6, + 15, + 7, + 10, + 9, + 6, + 12, + 3, + 2, + 3, + 12, + 11, + 2, + 0, + 2, + 4, + 11, + 18, + 2, + 3, + 2, + 12, + 6, + 11, + 20, + 11, + 9, + 10, + 12, + 16, + 7, + 11, + 13, + 15, + 4, + 7, + 19, + 3, + 24, + 16, + 13, + 16, + 5, + 12, + 16 + ], + "weighted_loads": [ + 0.458599966019392, + 0.824776966124773, + 0.4680120050907135, + 1.6634619235992432, + 1.8201797604560852, + 0.5178702846169472, + 0.9530260749161243, + 1.1214269548654556, + 0.09114360809326172, + 0.963594526052475, + 0.22282152250409126, + 0.2479603812098503, + 0.22922391816973686, + 2.3825539145618677, + 0.09381073340773582, + 0.9831677228212357, + 1.6504700295627117, + 1.3841461669653654, + 0.757279297336936, + 0.44039979577064514, + 0.6919101402163506, + 0.41422196477651596, + 0.45754830725491047, + 0.4346744157373905, + 0.2523500323295593, + 0.4768478088080883, + 0.1188352108001709, + 0.11177776753902435, + 0.18118445575237274, + 0.6481343880295753, + 0.6506941169500351, + 0.12640522047877312, + 0.0, + 0.11488255485892296, + 0.18438943848013878, + 0.8116068355739117, + 1.5462963115423918, + 0.08136586844921112, + 0.10518039390444756, + 0.14388536661863327, + 0.673828985542059, + 0.39490818977355957, + 0.5808664113283157, + 1.189456008374691, + 1.2216671276837587, + 0.3909592963755131, + 0.7604684792459011, + 1.0122012346982956, + 1.283323958516121, + 0.424745824187994, + 0.5345280058681965, + 0.9012230485677719, + 0.9998836405575275, + 0.13470392674207687, + 0.5058226101100445, + 1.6473957188427448, + 0.156975656747818, + 1.234812244772911, + 1.307936791330576, + 1.4063937924802303, + 1.0425042435526848, + 0.22938058525323868, + 0.7912022713571787, + 1.0072189830243587 + ], + "unique_experts": 63, + "load_cv": 0.6399412504252155, + "normalized_load_entropy": 0.9484629879102389, + "max_load_share": 0.04129793510324484 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "9502c4713e519a995c5fb97e8150cb7c49a4c472aa2b77f39423dd1b1056ab2f", + "route_weight_sha256": "7f7475d799cbc1a716bec270026525ba097a9a98be3e56f28e3873f52fa882ee", + "loads": [ + 17, + 13, + 8, + 28, + 24, + 9, + 16, + 18, + 3, + 12, + 16, + 5, + 7, + 32, + 2, + 13, + 18, + 30, + 14, + 15, + 15, + 7, + 16, + 12, + 9, + 14, + 3, + 3, + 3, + 12, + 12, + 8, + 1, + 2, + 13, + 18, + 18, + 2, + 6, + 2, + 12, + 16, + 11, + 20, + 15, + 16, + 22, + 13, + 19, + 7, + 15, + 14, + 15, + 7, + 7, + 24, + 8, + 24, + 18, + 17, + 16, + 5, + 14, + 17 + ], + "weighted_loads": [ + 0.9354554302990437, + 1.0015054605901241, + 0.4680120050907135, + 1.6634619235992432, + 2.0699415504932404, + 0.5178702846169472, + 0.9530260749161243, + 1.1214269548654556, + 0.18506445735692978, + 0.963594526052475, + 1.3914694227278233, + 0.2479603812098503, + 0.2836588337086141, + 2.535061941947788, + 0.09381073340773582, + 0.9831677228212357, + 1.6917611099779606, + 1.45833626575768, + 0.757279297336936, + 1.3043069057166576, + 0.6919101402163506, + 0.41422196477651596, + 2.0771001502871513, + 0.6519409008324146, + 0.3833424113690853, + 0.6200529001653194, + 0.1188352108001709, + 0.1247774176299572, + 0.18118445575237274, + 0.6481343880295753, + 0.6903637684881687, + 0.31708876602351665, + 0.003740650601685047, + 0.11488255485892296, + 0.6772228255867958, + 1.3106638751924038, + 1.5462963115423918, + 0.08136586844921112, + 0.24650102108716965, + 0.14388536661863327, + 0.673828985542059, + 1.3424324505031109, + 0.5808664113283157, + 1.189456008374691, + 1.4926902130246162, + 0.9742541611194611, + 1.807266741991043, + 1.08456489443779, + 1.4915088713169098, + 0.424745824187994, + 0.737446241080761, + 0.9350328557193279, + 0.9998836405575275, + 0.2539845183491707, + 0.5058226101100445, + 1.9272484686225653, + 0.3993503078818321, + 1.234812244772911, + 1.456972248852253, + 1.5791940093040466, + 1.0425042435526848, + 0.22938058525323868, + 0.8471089489758015, + 1.0433651693165302 + ], + "unique_experts": 64, + "load_cv": 0.5427638890605451, + "normalized_load_entropy": 0.961432970615452, + "max_load_share": 0.03864734299516908 + } + }, + "s1_eos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "baf4631936a95e821247b11194c2b81ff9b35bae8a4252f00857070fb8fa29fd", + "route_weight_sha256": "721bf8bd405c343b3bfc6b235e94110bd29f12161a2bb968bb080b1dc62abfec", + "loads": [ + 9, + 11, + 8, + 28, + 23, + 9, + 17, + 18, + 1, + 12, + 4, + 5, + 4, + 29, + 2, + 13, + 17, + 26, + 13, + 6, + 15, + 7, + 12, + 10, + 5, + 11, + 2, + 2, + 3, + 12, + 11, + 2, + 1, + 2, + 4, + 10, + 18, + 2, + 2, + 2, + 12, + 6, + 13, + 20, + 10, + 9, + 9, + 12, + 16, + 7, + 11, + 13, + 15, + 5, + 7, + 18, + 3, + 24, + 16, + 13, + 16, + 7, + 12, + 16 + ], + "weighted_loads": [ + 0.41186427511274815, + 0.801963709294796, + 0.4649016372859478, + 1.6634031012654305, + 1.8381430767476559, + 0.5266414768993855, + 0.9819358438253403, + 1.1213671490550041, + 0.09163057804107666, + 0.9544434100389481, + 0.17794357240200043, + 0.24966659396886826, + 0.22380047291517258, + 2.4607050232589245, + 0.09656093642115593, + 0.9568185582756996, + 1.6824498064815998, + 1.3101542871445417, + 0.718896646052599, + 0.43168020993471146, + 0.6890832111239433, + 0.41668838262557983, + 0.5372377522289753, + 0.48195967450737953, + 0.22070852480828762, + 0.44706576131284237, + 0.08598056435585022, + 0.1290588155388832, + 0.17189190536737442, + 0.6416671425104141, + 0.6558253988623619, + 0.12721120938658714, + 0.029023263603448868, + 0.1159806102514267, + 0.1856335997581482, + 0.7623502984642982, + 1.5710350014269352, + 0.07915263622999191, + 0.07736963778734207, + 0.14316222071647644, + 0.670633926987648, + 0.39885980635881424, + 0.6368843447417021, + 1.2024127542972565, + 1.2005526944994926, + 0.4208238795399666, + 0.6877527125179768, + 1.0034716539084911, + 1.2738511003553867, + 0.44381316006183624, + 0.5283735170960426, + 0.8826407082378864, + 0.9913904964923859, + 0.1727311834692955, + 0.4941651448607445, + 1.6077704392373562, + 0.15569880977272987, + 1.2382034100592136, + 1.2824732773005962, + 1.3783045075833797, + 1.0383469946682453, + 0.31093258783221245, + 0.7838405892252922, + 1.0126091912388802 + ], + "unique_experts": 64, + "load_cv": 0.643196382380308, + "normalized_load_entropy": 0.9485031713623056, + "max_load_share": 0.04277286135693215 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "32717cbbff10312387cdc2fef570934820e860c417759f680df0cae8280d5737", + "route_weight_sha256": "63f230dcfc781100a296ae6ac98e0b2541632bd4fc0f957132da064e52b50e44", + "loads": [ + 20, + 15, + 8, + 28, + 25, + 9, + 17, + 18, + 8, + 14, + 15, + 7, + 7, + 33, + 3, + 13, + 18, + 28, + 13, + 15, + 15, + 10, + 17, + 21, + 10, + 20, + 6, + 3, + 9, + 12, + 13, + 7, + 2, + 5, + 10, + 22, + 18, + 5, + 7, + 3, + 18, + 21, + 15, + 20, + 15, + 21, + 30, + 13, + 23, + 12, + 13, + 14, + 15, + 8, + 8, + 23, + 8, + 24, + 21, + 17, + 16, + 8, + 14, + 18 + ], + "weighted_loads": [ + 1.1219653096050024, + 1.0667539052665234, + 0.4649016372859478, + 1.6634031012654305, + 2.1238324157893658, + 0.5266414768993855, + 0.9819358438253403, + 1.1213671490550041, + 0.5109858065843582, + 1.0446118526160717, + 1.2637414559721947, + 0.34518785774707794, + 0.2779584061354399, + 2.554072314640507, + 0.13594774156808853, + 0.9568185582756996, + 1.7288742028176785, + 1.4009142499417067, + 0.718896646052599, + 1.3927823826670647, + 0.6890832111239433, + 0.5439722798764706, + 2.109720077365637, + 1.3012567423284054, + 0.4111304450780153, + 0.9513519909232855, + 0.3391325920820236, + 0.14205846562981606, + 0.5923646688461304, + 0.6416671425104141, + 0.7937217615544796, + 0.27267335425131023, + 0.032645973144099116, + 0.33911238238215446, + 0.4926150254905224, + 1.5850015059113503, + 1.5710350014269352, + 0.2199496142566204, + 0.3413209393620491, + 0.21022822707891464, + 1.0730423219501972, + 1.8349925242364407, + 0.7297226097434759, + 1.2024127542972565, + 1.3848586780950427, + 1.3970554508268833, + 2.553631830960512, + 1.0711149163544178, + 1.7217502258718014, + 0.7714425586163998, + 0.6429865062236786, + 0.9157150574028492, + 0.9913904964923859, + 0.32179420068860054, + 0.5356332659721375, + 1.8786757569760084, + 0.3902898021042347, + 1.2382034100592136, + 1.5873058773577213, + 1.5605840496718884, + 1.0383469946682453, + 0.34928881749510765, + 0.9406528249382973, + 1.0831765346229076 + ], + "unique_experts": 64, + "load_cv": 0.4837456536099118, + "normalized_load_entropy": 0.9705564953325931, + "max_load_share": 0.03571428571428571 + } + }, + "s0_bos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "8e02a7625be8fcf1b22c13e762519f07454a81de20485ab1be1bd8924ffa3543", + "route_weight_sha256": "8b7cf3a80fb30cd18fd216b74be19545fdf9c80ec9cd3054a766984b467c498b", + "loads": [ + 10, + 11, + 8, + 27, + 24, + 9, + 16, + 18, + 1, + 12, + 4, + 4, + 5, + 27, + 3, + 12, + 17, + 27, + 14, + 6, + 16, + 7, + 11, + 9, + 7, + 9, + 2, + 1, + 3, + 12, + 13, + 3, + 2, + 1, + 3, + 11, + 18, + 2, + 2, + 2, + 11, + 7, + 10, + 21, + 13, + 8, + 10, + 13, + 16, + 7, + 11, + 13, + 15, + 2, + 7, + 19, + 3, + 26, + 15, + 13, + 16, + 6, + 11, + 16 + ], + "weighted_loads": [ + 0.4459460247308016, + 0.806099783629179, + 0.4630704093724489, + 1.655295804142952, + 1.9102263636887074, + 0.5107480809092522, + 0.9423794411122799, + 1.1175699084997177, + 0.09402232617139816, + 0.9785377904772758, + 0.18330060690641403, + 0.21215807646512985, + 0.25449782609939575, + 2.377779148519039, + 0.13230635970830917, + 0.8788815774023533, + 1.6614297516644, + 1.3574241138994694, + 0.7735853418707848, + 0.46746427938342094, + 0.7133388519287109, + 0.4192805774509907, + 0.4802439995110035, + 0.45410656183958054, + 0.26750335842370987, + 0.3878719210624695, + 0.08645006269216537, + 0.06223537027835846, + 0.17130275070667267, + 0.618653479963541, + 0.7300965525209904, + 0.15896338783204556, + 0.07184363715350628, + 0.08509936928749084, + 0.16472919285297394, + 0.8044626675546169, + 1.6014981921762228, + 0.08428249880671501, + 0.06920557096600533, + 0.13863014057278633, + 0.6526736915111542, + 0.44449272751808167, + 0.5469229407608509, + 1.225055530667305, + 1.3361248467117548, + 0.4138946384191513, + 0.7849446833133698, + 1.0427029244601727, + 1.289588749408722, + 0.4225662797689438, + 0.5575851909816265, + 0.8939133733510971, + 0.9891489110887051, + 0.07179096341133118, + 0.4895462393760681, + 1.6318567134439945, + 0.15381092578172684, + 1.311243437230587, + 1.2322432436048985, + 1.3792981542646885, + 1.0476474799215794, + 0.2838917709887028, + 0.7690829895436764, + 1.0256111435592175 + ], + "unique_experts": 64, + "load_cv": 0.6507283701362738, + "normalized_load_entropy": 0.9470033827904424, + "max_load_share": 0.03982300884955752 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "205a08b847d6f6cde7e991cd0c867bceae63b6a47d5825dd5f4e97bdeab15a43", + "route_weight_sha256": "c0e9facf963a45c26ca7fc257e905bdb6eab008e6c6f1dfda7d063c1bcb42504", + "loads": [ + 18, + 13, + 8, + 27, + 27, + 9, + 16, + 18, + 3, + 12, + 15, + 4, + 7, + 31, + 3, + 12, + 18, + 31, + 14, + 15, + 16, + 7, + 16, + 12, + 10, + 11, + 2, + 2, + 3, + 12, + 14, + 8, + 2, + 1, + 12, + 18, + 18, + 2, + 4, + 3, + 11, + 17, + 10, + 21, + 16, + 15, + 22, + 14, + 19, + 7, + 17, + 14, + 15, + 5, + 7, + 24, + 8, + 26, + 17, + 17, + 16, + 6, + 13, + 17 + ], + "weighted_loads": [ + 0.9715041387826204, + 0.9740501530468464, + 0.4630704093724489, + 1.655295804142952, + 2.2149966917932034, + 0.5107480809092522, + 0.9423794411122799, + 1.1175699084997177, + 0.18794317543506622, + 0.9785377904772758, + 1.351948507130146, + 0.21215807646512985, + 0.3014967404305935, + 2.5424520894885063, + 0.13230635970830917, + 0.8788815774023533, + 1.702720832079649, + 1.509895447641611, + 0.7735853418707848, + 1.3313713893294334, + 0.7133388519287109, + 0.4192805774509907, + 1.1646482478827238, + 0.7228907607495785, + 0.39849573746323586, + 0.5319627523422241, + 0.08645006269216537, + 0.0752350203692913, + 0.17130275070667267, + 0.618653479963541, + 0.769766204059124, + 0.34690573532134295, + 0.07184363715350628, + 0.08509936928749084, + 0.657562579959631, + 1.286870326846838, + 1.6014981921762228, + 0.08428249880671501, + 0.16567032039165497, + 0.18372667208313942, + 0.6526736915111542, + 1.4328493662178516, + 0.5469229407608509, + 1.225055530667305, + 1.5994775909930468, + 1.151921235024929, + 1.8393112979829311, + 1.119961928576231, + 1.4939667023718357, + 0.4225662797689438, + 0.8372614793479443, + 0.9277231805026531, + 0.9891489110887051, + 0.19376497343182564, + 0.4895462393760681, + 1.914830094203353, + 0.39618557691574097, + 1.311243437230587, + 1.3796256557106972, + 1.5520983710885048, + 1.0476474799215794, + 0.2838917709887028, + 0.8249896671622992, + 1.061757329851389 + ], + "unique_experts": 64, + "load_cv": 0.5591983072714328, + "normalized_load_entropy": 0.9592378051463987, + "max_load_share": 0.03743961352657005 + } + }, + "s1_bos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "54179a93e48aaf52d0d78f286185e66f755625cde354d920959bdadfbc005168", + "route_weight_sha256": "b0bd34cd8c439a24caa3665a3fac81fd47fcd7274fb3fc2bb80c7737ad4ad13d", + "loads": [ + 11, + 12, + 8, + 27, + 23, + 9, + 16, + 18, + 1, + 12, + 4, + 4, + 4, + 26, + 3, + 14, + 17, + 28, + 13, + 6, + 15, + 8, + 11, + 10, + 7, + 10, + 3, + 1, + 3, + 13, + 12, + 3, + 2, + 1, + 3, + 11, + 18, + 2, + 2, + 2, + 11, + 5, + 10, + 20, + 13, + 7, + 9, + 13, + 16, + 7, + 11, + 12, + 15, + 4, + 7, + 18, + 3, + 25, + 16, + 13, + 16, + 7, + 11, + 16 + ], + "weighted_loads": [ + 0.49126265943050385, + 0.8455229811370373, + 0.4582324344664812, + 1.6357812583446503, + 1.8553748242557049, + 0.5208595469594002, + 0.9177728332579136, + 1.124919105321169, + 0.09388162195682526, + 0.9532117992639542, + 0.1769532784819603, + 0.2102452740073204, + 0.21559405326843262, + 2.3317535929381847, + 0.1354951225221157, + 0.9723572954535484, + 1.6713678427040577, + 1.4189183730632067, + 0.7286341339349747, + 0.48652446642518044, + 0.6795591302216053, + 0.44956613704562187, + 0.49377746134996414, + 0.5068463943898678, + 0.27238825149834156, + 0.4175354689359665, + 0.11801521852612495, + 0.06139064580202103, + 0.17251379042863846, + 0.6411284953355789, + 0.6803436279296875, + 0.16358009912073612, + 0.0728638805449009, + 0.0859706699848175, + 0.1656523495912552, + 0.7891955859959126, + 1.6130450386554003, + 0.08293667808175087, + 0.07292409986257553, + 0.12896651402115822, + 0.6391147524118423, + 0.34245777875185013, + 0.5431908126920462, + 1.1704363021999598, + 1.3234059810638428, + 0.3526521064341068, + 0.6922480724751949, + 1.0271252542734146, + 1.2987331859767437, + 0.4351302981376648, + 0.5549772791564465, + 0.8274413868784904, + 0.9971083961427212, + 0.13696689158678055, + 0.46552596613764763, + 1.5937479678541422, + 0.14986368268728256, + 1.2937859259545803, + 1.2803694382309914, + 1.3365040123462677, + 1.0280522145330906, + 0.315384216606617, + 0.7715485952794552, + 1.0334974825382233 + ], + "unique_experts": 64, + "load_cv": 0.6384165089635208, + "normalized_load_entropy": 0.9489147635179267, + "max_load_share": 0.04129793510324484 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "6671c8cdfc58d10248f127ddd410823b9f8b33679ec82dd32435b11b6bbd06f7", + "route_weight_sha256": "3b4cc6b7586652929c9f9e96393601d0076a51bdfa2da44f1c91a09fcefdba24", + "loads": [ + 23, + 16, + 8, + 27, + 26, + 9, + 16, + 18, + 8, + 14, + 15, + 6, + 6, + 31, + 4, + 14, + 18, + 33, + 13, + 15, + 15, + 11, + 15, + 21, + 12, + 19, + 7, + 2, + 9, + 13, + 14, + 7, + 2, + 4, + 9, + 23, + 18, + 5, + 6, + 4, + 17, + 19, + 12, + 20, + 16, + 19, + 30, + 14, + 23, + 12, + 15, + 13, + 15, + 7, + 8, + 23, + 8, + 25, + 21, + 17, + 16, + 8, + 13, + 17 + ], + "weighted_loads": [ + 1.2948631942272186, + 1.100781835615635, + 0.4582324344664812, + 1.6357812583446503, + 2.179892558604479, + 0.5208595469594002, + 0.9177728332579136, + 1.124919105321169, + 0.5132368505001068, + 1.0433802418410778, + 1.2627511620521545, + 0.3057665377855301, + 0.2627962250262499, + 2.512569446116686, + 0.1748819276690483, + 0.9723572954535484, + 1.7177922390401363, + 1.6336024980992079, + 0.7286341339349747, + 1.4476266391575336, + 0.6795591302216053, + 0.5768500342965126, + 1.1350616067647934, + 1.3413963727653027, + 0.46281017176806927, + 0.9192017167806625, + 0.37116724625229836, + 0.07439029589295387, + 0.5929865539073944, + 0.6411284953355789, + 0.8182399906218052, + 0.30621686298400164, + 0.0728638805449009, + 0.3091024421155453, + 0.4726337753236294, + 1.5892517194151878, + 1.6130450386554003, + 0.22373365610837936, + 0.28821590170264244, + 0.24037783592939377, + 1.0415231473743916, + 1.7882640957832336, + 0.63602907769382, + 1.1704363021999598, + 1.4533875994384289, + 1.5370668955147266, + 2.5758812688291073, + 1.1067134588956833, + 1.7406555898487568, + 0.7627596966922283, + 0.7450569178909063, + 0.8605157360434532, + 0.9971083961427212, + 0.2903978191316128, + 0.5069940872490406, + 1.860386174172163, + 0.3844546750187874, + 1.2937859259545803, + 1.5793763473629951, + 1.5187835544347763, + 1.0280522145330906, + 0.3537404462695122, + 0.9283608309924603, + 1.0694957040250301 + ], + "unique_experts": 64, + "load_cv": 0.4932596025551127, + "normalized_load_entropy": 0.9695479440298346, + "max_load_share": 0.03571428571428571 + } + }, + "s0_x": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "1e8005e80494628714ec935839277e584dc9db85aeebb0534128c52145adb70c", + "route_weight_sha256": "8b69c272207621e91c880a6549ed1bc65662ae647609778a3e285a06e98e71a6", + "loads": [ + 10, + 12, + 8, + 27, + 24, + 9, + 14, + 18, + 1, + 12, + 3, + 4, + 5, + 26, + 2, + 12, + 17, + 26, + 14, + 6, + 14, + 7, + 12, + 9, + 6, + 10, + 3, + 3, + 3, + 11, + 13, + 2, + 1, + 2, + 4, + 11, + 17, + 2, + 2, + 2, + 11, + 7, + 12, + 21, + 13, + 6, + 12, + 14, + 16, + 7, + 12, + 13, + 15, + 3, + 7, + 17, + 3, + 26, + 16, + 13, + 17, + 6, + 11, + 16 + ], + "weighted_loads": [ + 0.47654102370142937, + 0.8610666245222092, + 0.4729067664593458, + 1.6528886444866657, + 1.8928333520889282, + 0.5184055268764496, + 0.8496043793857098, + 1.1094020754098892, + 0.0939408466219902, + 0.9801961667835712, + 0.1395791918039322, + 0.2108379490673542, + 0.25652673840522766, + 2.333064954727888, + 0.09044491872191429, + 0.9015141502022743, + 1.6336567662656307, + 1.3368789814412594, + 0.775726243853569, + 0.4590403214097023, + 0.6512614078819752, + 0.4189603142440319, + 0.506818201392889, + 0.4383510425686836, + 0.2512296997010708, + 0.44924940168857574, + 0.11924678832292557, + 0.15212589502334595, + 0.17602065205574036, + 0.5854554250836372, + 0.7270972635596991, + 0.12116800248622894, + 0.028876299038529396, + 0.11943369358778, + 0.18570602126419544, + 0.8145558722317219, + 1.5509110242128372, + 0.08230610564351082, + 0.06994841620326042, + 0.1417924426496029, + 0.6391404680907726, + 0.45514024421572685, + 0.6154309511184692, + 1.2313581220805645, + 1.3745553828775883, + 0.250483063980937, + 0.8784302249550819, + 1.1114698722958565, + 1.2843071073293686, + 0.3978339210152626, + 0.6102226004004478, + 0.8818212077021599, + 1.000941462814808, + 0.10317904688417912, + 0.5117471888661385, + 1.5612274315208197, + 0.15255143120884895, + 1.3061855882406235, + 1.2719139158725739, + 1.3913389556109905, + 1.079280536621809, + 0.2842077314853668, + 0.7622911781072617, + 1.00461221113801 + ], + "unique_experts": 64, + "load_cv": 0.6375435909024695, + "normalized_load_entropy": 0.9489957241561013, + "max_load_share": 0.03982300884955752 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "d5d87eab2e1a87f40216c3c05490481f7f320442eefec8ffe224a69c32f63034", + "route_weight_sha256": "e23e619919e8d21c7df71076466feb1a9880dd69a6e552454cb8249d58806d4f", + "loads": [ + 19, + 14, + 8, + 27, + 26, + 9, + 14, + 18, + 3, + 12, + 15, + 4, + 7, + 30, + 2, + 12, + 19, + 28, + 14, + 15, + 14, + 7, + 17, + 12, + 9, + 13, + 3, + 4, + 3, + 11, + 14, + 7, + 1, + 2, + 14, + 17, + 17, + 2, + 5, + 2, + 11, + 17, + 12, + 21, + 16, + 13, + 24, + 15, + 19, + 7, + 16, + 14, + 15, + 6, + 7, + 22, + 8, + 26, + 18, + 18, + 17, + 6, + 13, + 17 + ], + "weighted_loads": [ + 1.1246052086353302, + 1.0327472016215324, + 0.4729067664593458, + 1.6528886444866657, + 2.143942967057228, + 0.5184055268764496, + 0.8496043793857098, + 1.1094020754098892, + 0.18786169588565826, + 0.9801961667835712, + 1.4591574966907501, + 0.2108379490673542, + 0.3035256527364254, + 2.4719553031027317, + 0.09044491872191429, + 0.9015141502022743, + 1.7111067399382591, + 1.4123039171099663, + 0.775726243853569, + 1.3229474313557148, + 0.6512614078819752, + 0.4189603142440319, + 1.184641843661666, + 0.6667811386287212, + 0.38222207874059677, + 0.6514350213110447, + 0.11924678832292557, + 0.1651255451142788, + 0.17602065205574036, + 0.5854554250836372, + 0.7667669150978327, + 0.30911034997552633, + 0.028876299038529396, + 0.11943369358778, + 0.774009695276618, + 1.2555811554193497, + 1.5509110242128372, + 0.08230610564351082, + 0.2130211666226387, + 0.1417924426496029, + 0.6391404680907726, + 1.3831937722861767, + 0.6154309511184692, + 1.2313581220805645, + 1.6379081271588802, + 0.7725993264466524, + 1.8733144402503967, + 1.1897879391908646, + 1.4897112362086773, + 0.3978339210152626, + 0.8133532367646694, + 0.9156310148537159, + 1.000941462814808, + 0.22214948199689388, + 0.5117471888661385, + 1.8484192192554474, + 0.3949260823428631, + 1.3061855882406235, + 1.4220895282924175, + 1.6047646291553974, + 1.079280536621809, + 0.2842077314853668, + 0.8181978557258844, + 1.0407583974301815 + ], + "unique_experts": 64, + "load_cv": 0.543107764212844, + "normalized_load_entropy": 0.9610967068290223, + "max_load_share": 0.036231884057971016 + } + }, + "s1_x": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "a4a6ec84b0ec027fdf836de70fe51d284e099441ce58873dff0ff2b878ced06d", + "route_weight_sha256": "90594c82f51552bba0a04b55229b075984eddba468b59ef34b51683c8b46adad", + "loads": [ + 12, + 11, + 8, + 26, + 22, + 8, + 16, + 18, + 1, + 12, + 3, + 4, + 4, + 28, + 3, + 14, + 17, + 29, + 13, + 7, + 13, + 7, + 12, + 8, + 6, + 12, + 3, + 1, + 3, + 12, + 12, + 3, + 2, + 2, + 3, + 10, + 18, + 2, + 3, + 2, + 11, + 7, + 12, + 19, + 13, + 10, + 9, + 13, + 16, + 6, + 14, + 13, + 15, + 3, + 7, + 16, + 3, + 24, + 16, + 13, + 16, + 6, + 11, + 15 + ], + "weighted_loads": [ + 0.5659188143908978, + 0.8058200143277645, + 0.45730105973780155, + 1.5577044654637575, + 1.7895498014986515, + 0.4810415804386139, + 0.8851449079811573, + 1.103361316025257, + 0.09205561131238937, + 0.9409482553601265, + 0.13864946737885475, + 0.2044997401535511, + 0.2030923143029213, + 2.4271867759525776, + 0.12857608497142792, + 0.9778533354401588, + 1.6324871703982353, + 1.4648710638284683, + 0.7313898019492626, + 0.523322094231844, + 0.6330858431756496, + 0.4109704792499542, + 0.5121532250195742, + 0.37736877240240574, + 0.22578029707074165, + 0.5209796596318483, + 0.12460330873727798, + 0.057533279061317444, + 0.17264645546674728, + 0.5980334989726543, + 0.6802512407302856, + 0.1559463795274496, + 0.07407976873219013, + 0.11528389900922775, + 0.1590997539460659, + 0.7501781657338142, + 1.6095935255289078, + 0.08310283347964287, + 0.10726230964064598, + 0.129744004458189, + 0.6444635763764381, + 0.4519738033413887, + 0.600802743807435, + 1.1091280803084373, + 1.3533740397542715, + 0.4381547346711159, + 0.7059475444257259, + 1.0504664182662964, + 1.2820196822285652, + 0.36619235947728157, + 0.6864187493920326, + 0.8785101436078548, + 0.991321288049221, + 0.10783601924777031, + 0.47324832156300545, + 1.5059085320681334, + 0.14758720248937607, + 1.2557141240686178, + 1.2600554078817368, + 1.3323988616466522, + 1.008952610194683, + 0.2727503664791584, + 0.7641717717051506, + 0.9589363597333431 + ], + "unique_experts": 64, + "load_cv": 0.6344789201727484, + "normalized_load_entropy": 0.9498238745047322, + "max_load_share": 0.04277286135693215 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "a086e4dbcbe5b8b6884f9c1429a8795bb22b3ea7c07ddda5fb14474ee088be71", + "route_weight_sha256": "ad6a54b2e4f0219d098ed63abf604e85aaa7c061a3cdfcfd85793c49e6fe8e64", + "loads": [ + 26, + 15, + 8, + 26, + 24, + 8, + 16, + 18, + 9, + 14, + 15, + 6, + 6, + 31, + 4, + 14, + 19, + 32, + 13, + 17, + 13, + 10, + 16, + 19, + 11, + 22, + 8, + 2, + 9, + 12, + 14, + 7, + 2, + 5, + 10, + 21, + 18, + 5, + 8, + 4, + 17, + 22, + 14, + 19, + 16, + 19, + 29, + 14, + 23, + 11, + 16, + 14, + 15, + 5, + 8, + 21, + 8, + 24, + 22, + 18, + 16, + 7, + 13, + 16 + ], + "weighted_loads": [ + 1.5007205717265606, + 1.0522164404392242, + 0.45730105973780155, + 1.5577044654637575, + 2.057632427662611, + 0.4810415804386139, + 0.8851449079811573, + 1.103361316025257, + 0.5526573769748211, + 1.0311166979372501, + 1.3843671344220638, + 0.3000210039317608, + 0.25029448606073856, + 2.516061283648014, + 0.16796289011836052, + 0.9778533354401588, + 1.7192192822694778, + 1.6038052923977375, + 0.7313898019492626, + 1.5315389148890972, + 0.6330858431756496, + 0.538254376500845, + 1.1542799193412066, + 1.2186893355101347, + 0.41620221734046936, + 1.071299159899354, + 0.42392636463046074, + 0.07053292915225029, + 0.5931192189455032, + 0.5980334989726543, + 0.8181476034224033, + 0.2985831433907151, + 0.07407976873219013, + 0.3384156711399555, + 0.5254425182938576, + 1.4967567026615143, + 1.6095935255289078, + 0.22389981150627136, + 0.37428533658385277, + 0.23966596275568008, + 1.0468719713389874, + 1.797042015939951, + 0.6936410088092089, + 1.1091280803084373, + 1.4833556581288576, + 1.19801864027977, + 2.4362933337688446, + 1.1140157505869865, + 1.7289789021015167, + 0.6938217580318451, + 0.8018210306763649, + 0.9115844927728176, + 0.991321288049221, + 0.20829478278756142, + 0.5147164426743984, + 1.7556338049471378, + 0.3821781948208809, + 1.2557141240686178, + 1.6182380318641663, + 1.567619413137436, + 1.008952610194683, + 0.3111065961420536, + 0.9209840074181557, + 0.99493458122015 + ], + "unique_experts": 64, + "load_cv": 0.48652693397969066, + "normalized_load_entropy": 0.9701477012961263, + "max_load_share": 0.03463203463203463 + } + }, + "s0_period": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "b82464e0a66e3ea1eda4643ed2fdffb7b45a6acba75a7086f784c38b59a84ca8", + "route_weight_sha256": "c5487846a9700d28907e9e2c354efacc08823de16e14461c541bd1737283dadb", + "loads": [ + 8, + 12, + 8, + 27, + 22, + 9, + 16, + 18, + 1, + 12, + 3, + 4, + 5, + 27, + 2, + 13, + 17, + 27, + 14, + 6, + 15, + 7, + 12, + 8, + 5, + 9, + 2, + 3, + 3, + 12, + 12, + 2, + 2, + 1, + 4, + 11, + 17, + 2, + 2, + 2, + 11, + 6, + 14, + 21, + 13, + 7, + 10, + 14, + 16, + 7, + 12, + 13, + 15, + 5, + 7, + 18, + 3, + 26, + 16, + 13, + 16, + 6, + 11, + 16 + ], + "weighted_loads": [ + 0.4073794521391392, + 0.8606990240514278, + 0.47122601605951786, + 1.6727622374892235, + 1.817771714180708, + 0.5097201876342297, + 0.9234691224992275, + 1.107745487242937, + 0.0957978293299675, + 0.989404235035181, + 0.14515746757388115, + 0.21638263016939163, + 0.2585507705807686, + 2.361942835152149, + 0.0908498503267765, + 0.9458016566932201, + 1.6290559396147728, + 1.3610332198441029, + 0.7880452945828438, + 0.4444301463663578, + 0.6966823861002922, + 0.4226906783878803, + 0.5097088478505611, + 0.4058065824210644, + 0.2184360008686781, + 0.401964258402586, + 0.0852699913084507, + 0.15231683105230331, + 0.17740308493375778, + 0.6343349479138851, + 0.6874289326369762, + 0.12148281931877136, + 0.06854708679020405, + 0.08869598805904388, + 0.18497945368289948, + 0.8143847808241844, + 1.5843256004154682, + 0.08315291255712509, + 0.07016192749142647, + 0.1425778567790985, + 0.6415366418659687, + 0.40047865360975266, + 0.6897272132337093, + 1.233888540416956, + 1.371675668284297, + 0.30540903471410275, + 0.7953518740832806, + 1.1180215887725353, + 1.2751289457082748, + 0.4054329991340637, + 0.6067536622285843, + 0.8788020275533199, + 0.98328647762537, + 0.16978632099926472, + 0.5111378356814384, + 1.625192018225789, + 0.15963318571448326, + 1.318544838577509, + 1.274023000150919, + 1.4116556197404861, + 1.0506287924945354, + 0.2814582847058773, + 0.7630584016442299, + 1.006178829818964 + ], + "unique_experts": 64, + "load_cv": 0.6444938318026373, + "normalized_load_entropy": 0.9480857165374542, + "max_load_share": 0.03982300884955752 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "8412ee87d33de7d94da9f6e5e3621b1fda999e4f76e66ad71e716599aed1ac89", + "route_weight_sha256": "f4c0a7f5b919d5c30cae45721a8c62d67537489eda1977d0da98a791b8240d83", + "loads": [ + 17, + 14, + 8, + 27, + 24, + 9, + 16, + 18, + 3, + 12, + 15, + 4, + 7, + 31, + 2, + 13, + 18, + 31, + 14, + 15, + 15, + 7, + 16, + 11, + 8, + 11, + 2, + 4, + 3, + 12, + 13, + 7, + 2, + 1, + 14, + 17, + 17, + 2, + 5, + 2, + 11, + 17, + 14, + 21, + 16, + 14, + 23, + 15, + 19, + 7, + 16, + 14, + 15, + 7, + 7, + 23, + 9, + 26, + 18, + 17, + 16, + 6, + 13, + 17 + ], + "weighted_loads": [ + 1.0317474007606506, + 1.024428479373455, + 0.47122601605951786, + 1.6727622374892235, + 2.063997011631727, + 0.5097201876342297, + 0.9234691224992275, + 1.107745487242937, + 0.18971867859363556, + 0.989404235035181, + 1.408421192318201, + 0.21638263016939163, + 0.3055496849119663, + 2.502977643162012, + 0.0908498503267765, + 0.9458016566932201, + 1.6703470200300217, + 1.5249145068228245, + 0.7880452945828438, + 1.3083372563123703, + 0.6966823861002922, + 0.4226906783878803, + 1.1576763298362494, + 0.6354328989982605, + 0.3494283799082041, + 0.5541389994323254, + 0.0852699913084507, + 0.16531648114323616, + 0.17740308493375778, + 0.6343349479138851, + 0.7270985841751099, + 0.30942516680806875, + 0.06854708679020405, + 0.08869598805904388, + 0.735149122774601, + 1.242127638310194, + 1.5843256004154682, + 0.08315291255712509, + 0.2090359441936016, + 0.1425778567790985, + 0.6415366418659687, + 1.3747503645718098, + 0.6897272132337093, + 1.233888540416956, + 1.635028412565589, + 0.8435707520693541, + 1.9176005125045776, + 1.1934447474777699, + 1.4729863107204437, + 0.4054329991340637, + 0.8093175515532494, + 0.912611834704876, + 0.98328647762537, + 0.2461542058736086, + 0.5111378356814384, + 1.9193850420415401, + 0.4405609145760536, + 1.318544838577509, + 1.4216491803526878, + 1.5844558365643024, + 1.0506287924945354, + 0.2814582847058773, + 0.8189650792628527, + 1.0423250161111355 + ], + "unique_experts": 64, + "load_cv": 0.5475584892869249, + "normalized_load_entropy": 0.9606150136919185, + "max_load_share": 0.03743961352657005 + } + }, + "s1_period": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "d177dd4f7d7a33ea7859446eaf2335dc750a953c28e2fb3dce03e3b7cfd2e98d", + "route_weight_sha256": "8e8695d70202b8cf98ebd79a7eb04641bb9638ef846fa697012513301c254294", + "loads": [ + 11, + 12, + 8, + 26, + 23, + 8, + 16, + 18, + 1, + 12, + 3, + 4, + 4, + 27, + 3, + 16, + 17, + 27, + 13, + 6, + 15, + 8, + 11, + 10, + 5, + 13, + 3, + 2, + 3, + 13, + 12, + 3, + 1, + 2, + 3, + 10, + 17, + 2, + 2, + 2, + 11, + 5, + 10, + 20, + 13, + 6, + 9, + 14, + 16, + 7, + 12, + 12, + 15, + 4, + 7, + 19, + 3, + 26, + 16, + 13, + 16, + 6, + 10, + 16 + ], + "weighted_loads": [ + 0.525948029011488, + 0.8480211347341537, + 0.45328633673489094, + 1.5913215056061745, + 1.826709784567356, + 0.4744126833975315, + 0.8880761973559856, + 1.102161716669798, + 0.09376752376556396, + 0.9416886530816555, + 0.13821760937571526, + 0.2050824649631977, + 0.21512197330594063, + 2.39510864764452, + 0.12945480272173882, + 1.0767681747674942, + 1.6274889186024666, + 1.3794198334217072, + 0.7371585741639137, + 0.4556427076458931, + 0.7003289200365543, + 0.4539599195122719, + 0.4641838036477566, + 0.46913905441761017, + 0.20887631550431252, + 0.5497964657843113, + 0.11820271611213684, + 0.11660151556134224, + 0.16859960928559303, + 0.6491984501481056, + 0.6780569553375244, + 0.1589117906987667, + 0.0304997731000185, + 0.11629528924822807, + 0.16232068464159966, + 0.7555672340095043, + 1.5657226331532001, + 0.08370986208319664, + 0.07396387308835983, + 0.1310247853398323, + 0.6338370591402054, + 0.34535956010222435, + 0.5434129051864147, + 1.1334919296205044, + 1.3326340354979038, + 0.26371060498058796, + 0.7074929773807526, + 1.0914048179984093, + 1.2787455096840858, + 0.4205964170396328, + 0.6021297946572304, + 0.8152645826339722, + 0.9971519559621811, + 0.13723069056868553, + 0.48049332574009895, + 1.6218085587024689, + 0.15047666430473328, + 1.338472431525588, + 1.2660928219556808, + 1.3443387933075428, + 1.0169232487678528, + 0.27985040098428726, + 0.7317420318722725, + 1.0300758555531502 + ], + "unique_experts": 64, + "load_cv": 0.6453573489532756, + "normalized_load_entropy": 0.9479439840625623, + "max_load_share": 0.03982300884955752 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "2c12c3dd49b5ac78d5cfa0d5c6aba3eef13f103b72e851c924d9faf09977bded", + "route_weight_sha256": "ee2eb9bc8386a1ab63334281fa2d13c8d3122b42918fca13568bfa3a3d46f9a5", + "loads": [ + 24, + 16, + 8, + 26, + 25, + 8, + 16, + 18, + 8, + 14, + 15, + 6, + 6, + 30, + 4, + 16, + 18, + 31, + 13, + 15, + 15, + 11, + 15, + 21, + 10, + 24, + 7, + 3, + 9, + 13, + 14, + 7, + 1, + 5, + 9, + 22, + 17, + 5, + 7, + 3, + 17, + 21, + 12, + 20, + 16, + 15, + 31, + 15, + 23, + 12, + 14, + 13, + 15, + 7, + 8, + 24, + 9, + 26, + 22, + 17, + 16, + 7, + 12, + 17 + ], + "weighted_loads": [ + 1.362174291163683, + 1.0882015712559223, + 0.45328633673489094, + 1.5913215056061745, + 2.0934756994247437, + 0.4744126833975315, + 0.8880761973559856, + 1.102161716669798, + 0.5131227523088455, + 1.0318570956587791, + 1.2960383854806423, + 0.3006037287414074, + 0.2623241450637579, + 2.484458066523075, + 0.16884160786867142, + 1.0767681747674942, + 1.6739133149385452, + 1.573410276323557, + 0.7371585741639137, + 1.4167448803782463, + 0.7003289200365543, + 0.5812438167631626, + 1.1098358929157257, + 1.2955402582883835, + 0.3992982357740402, + 1.138056505471468, + 0.37135474383831024, + 0.12960116565227509, + 0.589072372764349, + 0.6491984501481056, + 0.8159533180296421, + 0.3015485545620322, + 0.0304997731000185, + 0.33942706137895584, + 0.46930211037397385, + 1.543293684720993, + 1.5657226331532001, + 0.22450684010982513, + 0.35509075596928596, + 0.1980907917022705, + 1.0362454541027546, + 1.783430840820074, + 0.6362511701881886, + 1.1334919296205044, + 1.46261565387249, + 1.0229417402297258, + 2.66940825805068, + 1.1633886396884918, + 1.7190175279974937, + 0.7482258155941963, + 0.7174232415854931, + 0.8483389317989349, + 0.9971519559621811, + 0.2859950587153435, + 0.5219614468514919, + 1.8757743332535028, + 0.4260110855102539, + 1.338472431525588, + 1.6222005523741245, + 1.5266183353960514, + 1.0169232487678528, + 0.31820663064718246, + 0.8885542675852776, + 1.066074077039957 + ], + "unique_experts": 64, + "load_cv": 0.4953826265652117, + "normalized_load_entropy": 0.9690475868633367, + "max_load_share": 0.03354978354978355 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 113, + "ordered_topk_exact_tokens": 85, + "set_exact_tokens": 98, + "mean_set_jaccard": 0.9620733249051834, + "mean_token_weighted_tv": 0.009331835812963216, + "aggregate_load_tv": 0.019174041297935103 + }, + "system_bos": { + "tokens": 113, + "ordered_topk_exact_tokens": 78, + "set_exact_tokens": 92, + "mean_set_jaccard": 0.9469026548672567, + "mean_token_weighted_tv": 0.013857472061583427, + "aggregate_load_tv": 0.02064896755162242 + }, + "system_x": { + "tokens": 113, + "ordered_topk_exact_tokens": 59, + "set_exact_tokens": 74, + "mean_set_jaccard": 0.8919089759797725, + "mean_token_weighted_tv": 0.02389869993898721, + "aggregate_load_tv": 0.038348082595870206 + }, + "system_period": { + "tokens": 113, + "ordered_topk_exact_tokens": 60, + "set_exact_tokens": 77, + "mean_set_jaccard": 0.9051833122629583, + "mean_token_weighted_tv": 0.022033721628903814, + "aggregate_load_tv": 0.029498525073746312 + }, + "bos_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 65, + "set_exact_tokens": 80, + "mean_set_jaccard": 0.9146649810366625, + "mean_token_weighted_tv": 0.018981930882200203, + "aggregate_load_tv": 0.029498525073746312 + }, + "bos_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 63, + "set_exact_tokens": 78, + "mean_set_jaccard": 0.9096080910240203, + "mean_token_weighted_tv": 0.020180256715852076, + "aggregate_load_tv": 0.030973451327433628 + }, + "x_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 74, + "set_exact_tokens": 84, + "mean_set_jaccard": 0.9266750948166879, + "mean_token_weighted_tv": 0.01844422014809288, + "aggregate_load_tv": 0.035398230088495575 + }, + "x_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 56, + "set_exact_tokens": 70, + "mean_set_jaccard": 0.879898862199747, + "mean_token_weighted_tv": 0.028066870451500987, + "aggregate_load_tv": 0.03687315634218289 + }, + "period_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 68, + "set_exact_tokens": 85, + "mean_set_jaccard": 0.9292035398230089, + "mean_token_weighted_tv": 0.017438162810507075, + "aggregate_load_tv": 0.030973451327433628 + }, + "period_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 56, + "set_exact_tokens": 75, + "mean_set_jaccard": 0.8982300884955754, + "mean_token_weighted_tv": 0.024425820068382058, + "aggregate_load_tv": 0.035398230088495575 + } + } + }, + "layer_10": { + "layer": 10, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "8a7acf0a74b70545a21cd50d6da9a963733d337822b399f58deefb110cbc4724", + "route_weight_sha256": "a0f023277b72e14ebd76d7940e2819a4047edd04e7659cf8621b2258c87517bc", + "loads": [ + 11, + 12, + 5, + 2, + 4, + 32, + 5, + 3, + 9, + 9, + 13, + 14, + 4, + 12, + 21, + 11, + 11, + 6, + 12, + 59, + 3, + 4, + 3, + 25, + 12, + 9, + 11, + 16, + 5, + 15, + 6, + 3, + 7, + 36, + 9, + 20, + 0, + 5, + 9, + 4, + 8, + 18, + 15, + 9, + 0, + 5, + 2, + 7, + 6, + 10, + 0, + 4, + 10, + 15, + 11, + 14, + 20, + 12, + 10, + 7, + 14, + 7, + 17, + 0 + ], + "weighted_loads": [ + 0.6812670901417732, + 0.5739321410655975, + 0.264189500361681, + 0.07278962060809135, + 0.1990804821252823, + 3.012853156775236, + 0.2206736095249653, + 0.1731429547071457, + 0.6672159507870674, + 0.5956339910626411, + 0.6183896455913782, + 0.8974006772041321, + 0.171706635504961, + 0.6057542562484741, + 1.4735977463424206, + 0.6805027835071087, + 0.8928137831389904, + 0.3941708505153656, + 0.7324567586183548, + 4.318052414804697, + 0.17627396062016487, + 0.242381501942873, + 0.12674634158611298, + 1.579126138240099, + 0.9175399914383888, + 1.0431972816586494, + 0.8560307696461678, + 0.8423999398946762, + 0.30929985269904137, + 1.1797926500439644, + 0.29311130568385124, + 0.13204515352845192, + 0.5849816054105759, + 2.525009511038661, + 0.6284988410770893, + 1.3123273365199566, + 0.0, + 0.24950815737247467, + 0.6463355384767056, + 0.13650712370872498, + 0.4111579582095146, + 1.148875791579485, + 1.1959371343255043, + 0.35177823528647423, + 0.0, + 0.19520608708262444, + 0.08015887998044491, + 0.5236195102334023, + 0.31754567474126816, + 0.5597972646355629, + 0.0, + 0.19650883227586746, + 0.537651464343071, + 1.1021484807133675, + 0.7519744597375393, + 1.1442830823361874, + 1.4057334512472153, + 1.0249578580260277, + 0.4615063965320587, + 0.3169124126434326, + 0.97836884111166, + 0.4466065280139446, + 1.036698218435049, + 0.0 + ], + "unique_experts": 60, + "load_cv": 0.8761359906735648, + "normalized_load_entropy": 0.925149204087473, + "max_load_share": 0.08702064896755163 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "2adcabafb4a564d8a62e76bfe68dcb6a8af28efb8195cf4701b934f31eef8c21", + "route_weight_sha256": "c578aa6bd67ead2d40a2c7427231cc84cff6863d6409ef34c2fbb2eaaf4fe935", + "loads": [ + 11, + 12, + 7, + 2, + 4, + 32, + 5, + 7, + 9, + 11, + 15, + 16, + 5, + 15, + 23, + 11, + 11, + 9, + 19, + 62, + 7, + 6, + 4, + 25, + 12, + 11, + 11, + 22, + 6, + 16, + 8, + 4, + 7, + 44, + 10, + 21, + 0, + 5, + 9, + 4, + 8, + 28, + 19, + 11, + 4, + 8, + 8, + 10, + 6, + 12, + 2, + 10, + 10, + 18, + 11, + 23, + 20, + 18, + 10, + 18, + 19, + 20, + 17, + 0 + ], + "weighted_loads": [ + 0.6812670901417732, + 0.5739321410655975, + 0.28326747054234147, + 0.07278962060809135, + 0.1990804821252823, + 3.012853156775236, + 0.2206736095249653, + 0.34960633888840675, + 0.6672159507870674, + 0.620167157612741, + 0.7138296980410814, + 0.9976061321794987, + 0.20442868396639824, + 2.0207618586719036, + 1.6299076415598392, + 0.6805027835071087, + 0.8928137831389904, + 0.6442260295152664, + 1.118708221707493, + 4.460063721984625, + 0.3415391109883785, + 0.3260929696261883, + 0.1305218779016286, + 1.579126138240099, + 0.9175399914383888, + 1.106742860749364, + 0.8560307696461678, + 1.5232557989656925, + 0.3557187207043171, + 1.22255365177989, + 0.49457355216145515, + 0.14582176320254803, + 0.5849816054105759, + 2.8934065867215395, + 0.6583226770162582, + 1.3492250517010689, + 0.0, + 0.24950815737247467, + 0.6463355384767056, + 0.13650712370872498, + 0.4111579582095146, + 2.192329455167055, + 1.308997499756515, + 0.44936367124319077, + 0.20984120294451714, + 0.34040922671556473, + 0.35175509192049503, + 0.654289411380887, + 0.31754567474126816, + 0.6481592729687691, + 0.0953390821814537, + 0.5011109746992588, + 0.537651464343071, + 1.2632692232728004, + 0.7519744597375393, + 1.812581617385149, + 1.4057334512472153, + 1.371927160769701, + 0.4615063965320587, + 0.9922777973115444, + 1.3266097456216812, + 1.6634543649852276, + 1.036698218435049, + 0.0 + ], + "unique_experts": 62, + "load_cv": 0.7763061061134586, + "normalized_load_entropy": 0.9395499113333339, + "max_load_share": 0.0748792270531401 + } + }, + "s1_eos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "f7aa95741eb7657a420d0170b9c93cbb139f6616950ffb874e2ec7ca7c522698", + "route_weight_sha256": "09734aacda41b3c15485f519e971d5ea2688a8c2745ca149a1622a5635223933", + "loads": [ + 11, + 11, + 7, + 3, + 2, + 32, + 6, + 4, + 9, + 9, + 12, + 14, + 3, + 11, + 21, + 10, + 11, + 5, + 12, + 58, + 3, + 4, + 3, + 24, + 13, + 9, + 11, + 15, + 7, + 16, + 6, + 3, + 8, + 36, + 8, + 20, + 0, + 4, + 9, + 3, + 7, + 17, + 14, + 7, + 0, + 5, + 2, + 8, + 7, + 11, + 0, + 4, + 10, + 15, + 11, + 15, + 22, + 12, + 10, + 9, + 14, + 8, + 17, + 0 + ], + "weighted_loads": [ + 0.690702274441719, + 0.5410025957971811, + 0.32427636347711086, + 0.10363573394715786, + 0.12106626480817795, + 3.00227677449584, + 0.2641117759048939, + 0.216746736317873, + 0.657540712505579, + 0.5916899405419827, + 0.5909645557403564, + 0.8788365162909031, + 0.13541516289114952, + 0.5743775106966496, + 1.4700428619980812, + 0.6354884579777718, + 0.894153282046318, + 0.36719101294875145, + 0.7329237423837185, + 4.337589526548982, + 0.16895397379994392, + 0.23708976432681084, + 0.13637837767601013, + 1.5499602518975735, + 0.9481330066919327, + 1.0296810045838356, + 0.8585255965590477, + 0.7774694804102182, + 0.41525137424468994, + 1.1969313584268093, + 0.28687750548124313, + 0.13714835792779922, + 0.6138659827411175, + 2.5225294455885887, + 0.5848949141800404, + 1.2915052846074104, + 0.0, + 0.20611091703176498, + 0.648036852478981, + 0.10778313502669334, + 0.37354234606027603, + 1.1213805824518204, + 1.1624702028930187, + 0.2798479665070772, + 0.0, + 0.19741474092006683, + 0.07703603804111481, + 0.5635727494955063, + 0.35590649396181107, + 0.5918557569384575, + 0.0, + 0.1987420730292797, + 0.5463153999298811, + 1.0840053334832191, + 0.7325859218835831, + 1.1652281004935503, + 1.4784357473254204, + 1.0158991143107414, + 0.4629274979233742, + 0.3952650800347328, + 0.9635750465095043, + 0.49323103204369545, + 1.0456710644066334, + 0.0 + ], + "unique_experts": 60, + "load_cv": 0.8671914168882181, + "normalized_load_entropy": 0.9258649271267104, + "max_load_share": 0.0855457227138643 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "ad2943c6851494a9e72e940b2b89094bfed78929e05efe92a9cadd22a2029cdc", + "route_weight_sha256": "832d0705298ff9cf79ee86620868ea83fdf43fe02bb7d022a614190d1e5bb50a", + "loads": [ + 12, + 11, + 10, + 3, + 6, + 32, + 6, + 6, + 9, + 11, + 15, + 18, + 7, + 13, + 24, + 10, + 11, + 10, + 18, + 59, + 4, + 5, + 4, + 24, + 14, + 12, + 12, + 35, + 7, + 19, + 14, + 4, + 13, + 53, + 10, + 22, + 3, + 7, + 10, + 3, + 8, + 33, + 18, + 9, + 3, + 10, + 7, + 11, + 15, + 14, + 3, + 17, + 11, + 19, + 11, + 28, + 23, + 19, + 10, + 28, + 24, + 19, + 17, + 1 + ], + "weighted_loads": [ + 0.725331824272871, + 0.5410025957971811, + 0.38372126733884215, + 0.10363573394715786, + 0.3235265351831913, + 3.00227677449584, + 0.2641117759048939, + 0.30309902131557465, + 0.657540712505579, + 0.6168348165228963, + 0.7069120407104492, + 1.0992307364940643, + 0.3347127176821232, + 1.9489105977118015, + 1.699765369296074, + 0.6354884579777718, + 0.894153282046318, + 0.7259656153619289, + 1.1025731661356986, + 4.380007794126868, + 0.2091146670281887, + 0.28655286878347397, + 0.1402948764152825, + 1.5499602518975735, + 0.9894626922905445, + 1.3561622817069292, + 0.9005032330751419, + 2.089595390483737, + 0.41525137424468994, + 1.3292242549359798, + 0.9509292468428612, + 0.15092496760189533, + 1.10189962759614, + 3.3592990040779114, + 0.7279025875031948, + 1.4569624997675419, + 0.11324933357536793, + 0.33467984572052956, + 0.6840062364935875, + 0.10778313502669334, + 0.415881909430027, + 2.4739439226686954, + 1.2600493440404534, + 0.34828547574579716, + 0.17843879759311676, + 0.44974327459931374, + 0.3597046732902527, + 0.6865020710974932, + 1.005658246576786, + 0.7562179528176785, + 0.18131470307707787, + 0.991741381585598, + 0.6157781612128019, + 1.2833707593381405, + 0.7325859218835831, + 2.077828975394368, + 1.5506972298026085, + 1.4074305295944214, + 0.4629274979233742, + 1.575259804725647, + 1.6992592997848988, + 1.559942588210106, + 1.0456710644066334, + 0.03558279946446419 + ], + "unique_experts": 64, + "load_cv": 0.7484922345460173, + "normalized_load_entropy": 0.9431959872181559, + "max_load_share": 0.06385281385281386 + } + }, + "s0_bos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "bcf422656ce658a555d52b721f41577894bf8ba115a4f1e9fde8a1eb1a6fd0ac", + "route_weight_sha256": "b13c7216833eb2ca151b39340546a01fe328d1a7c1a49d86e4b95c6ede0d4926", + "loads": [ + 12, + 12, + 6, + 2, + 4, + 34, + 6, + 4, + 10, + 10, + 9, + 14, + 5, + 13, + 22, + 12, + 11, + 6, + 12, + 60, + 2, + 5, + 2, + 24, + 12, + 9, + 11, + 14, + 5, + 15, + 6, + 1, + 9, + 31, + 8, + 20, + 0, + 6, + 9, + 4, + 7, + 18, + 14, + 7, + 0, + 5, + 1, + 11, + 6, + 12, + 0, + 4, + 10, + 15, + 11, + 13, + 21, + 12, + 9, + 8, + 14, + 7, + 16, + 0 + ], + "weighted_loads": [ + 0.7239778153598309, + 0.5717508513480425, + 0.316086795181036, + 0.0706072449684143, + 0.1940728761255741, + 3.083538692444563, + 0.27113062888383865, + 0.22620944306254387, + 0.733267679810524, + 0.6184351965785027, + 0.46831123530864716, + 0.8672312796115875, + 0.20622911304235458, + 0.655517190694809, + 1.5216158144176006, + 0.7202263809740543, + 0.89136066660285, + 0.41367189958691597, + 0.7209521681070328, + 4.393473979085684, + 0.13565387949347496, + 0.2758206520229578, + 0.08515391126275063, + 1.5509424023330212, + 0.8980570919811726, + 1.0421965941786766, + 0.8644367940723896, + 0.7292328849434853, + 0.25615041330456734, + 1.1589152738451958, + 0.28596213832497597, + 0.04158833250403404, + 0.6587745305150747, + 2.470801493152976, + 0.59375936165452, + 1.3024477809667587, + 0.0, + 0.2718323562294245, + 0.6428219117224216, + 0.14065865986049175, + 0.36031055077910423, + 1.1441319100558758, + 1.1190634071826935, + 0.2798077464103699, + 0.0, + 0.19155091792345047, + 0.04328287020325661, + 0.6926891766488552, + 0.30683398246765137, + 0.6330832205712795, + 0.0, + 0.20300740376114845, + 0.5200576800853014, + 1.0753733664751053, + 0.7757954336702824, + 1.081402812153101, + 1.470299605280161, + 1.0153514482080936, + 0.4367777928709984, + 0.34364113956689835, + 0.9681598916649818, + 0.46849463507533073, + 1.0059923715889454, + 0.0 + ], + "unique_experts": 60, + "load_cv": 0.8713556733796454, + "normalized_load_entropy": 0.9250487168047746, + "max_load_share": 0.08849557522123894 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "3b7cfdda0adda8083ea141891641f4076ef6d732c414353ee17e94e228c6823b", + "route_weight_sha256": "46b968cd3465c8f79c269bdbb24ca612ca39aa83553480fccc9bc549a823647e", + "loads": [ + 12, + 12, + 7, + 2, + 5, + 34, + 6, + 9, + 10, + 11, + 11, + 16, + 6, + 16, + 25, + 12, + 11, + 9, + 18, + 62, + 7, + 7, + 2, + 24, + 12, + 11, + 11, + 21, + 6, + 16, + 9, + 2, + 9, + 39, + 9, + 21, + 0, + 6, + 9, + 4, + 7, + 28, + 18, + 9, + 3, + 8, + 7, + 14, + 6, + 14, + 2, + 10, + 10, + 17, + 11, + 22, + 21, + 18, + 9, + 20, + 19, + 20, + 16, + 0 + ], + "weighted_loads": [ + 0.7239778153598309, + 0.5717508513480425, + 0.33023743238300085, + 0.0706072449684143, + 0.22460591048002243, + 3.083538692444563, + 0.27113062888383865, + 0.43705974891781807, + 0.733267679810524, + 0.634660804644227, + 0.5637512877583504, + 0.9676373079419136, + 0.2389511615037918, + 1.202819962054491, + 1.7308865897357464, + 0.7202263809740543, + 0.89136066660285, + 0.6638939119875431, + 1.1247543841600418, + 4.50740048289299, + 0.370608139783144, + 0.3595321197062731, + 0.08515391126275063, + 1.5509424023330212, + 0.8980570919811726, + 1.105742173269391, + 0.8644367940723896, + 1.5425981357693672, + 0.30256928130984306, + 1.2016762755811214, + 0.5256843902170658, + 0.05536494217813015, + 0.6587745305150747, + 2.8446465637534857, + 0.623583197593689, + 1.339345496147871, + 0.0, + 0.2718323562294245, + 0.6428219117224216, + 0.14065865986049175, + 0.36031055077910423, + 2.375883176922798, + 1.2731572818011045, + 0.3773931823670864, + 0.1989169791340828, + 0.33675405755639076, + 0.31487908214330673, + 0.8172207083553076, + 0.30683398246765137, + 0.7618308514356613, + 0.0953390821814537, + 0.4827173203229904, + 0.5200576800853014, + 1.1975115463137627, + 0.7757954336702824, + 1.75791409984231, + 1.470299605280161, + 1.362320750951767, + 0.4367777928709984, + 1.0826417841017246, + 1.3168574199080467, + 1.6948219798505306, + 1.0059923715889454, + 0.0 + ], + "unique_experts": 62, + "load_cv": 0.7634531704965752, + "normalized_load_entropy": 0.9402289075623739, + "max_load_share": 0.0748792270531401 + } + }, + "s1_bos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "1a4f31311640aced099f61e23aa3458832498d38e969de4ed29da2f49bfd6592", + "route_weight_sha256": "6f04ff7900fd9b45f31b059e53b4eda900ddc5a24e0400ea2f53278f23a03054", + "loads": [ + 12, + 9, + 7, + 3, + 3, + 34, + 5, + 4, + 12, + 10, + 9, + 13, + 5, + 11, + 22, + 11, + 10, + 6, + 13, + 60, + 4, + 5, + 2, + 24, + 13, + 9, + 11, + 13, + 6, + 15, + 6, + 3, + 8, + 33, + 10, + 20, + 0, + 5, + 9, + 4, + 7, + 18, + 14, + 5, + 0, + 6, + 2, + 9, + 6, + 13, + 0, + 4, + 10, + 15, + 10, + 14, + 21, + 12, + 10, + 7, + 13, + 7, + 16, + 0 + ], + "weighted_loads": [ + 0.735542144626379, + 0.47351012378931046, + 0.359417287632823, + 0.09699719771742821, + 0.1527775041759014, + 3.0558594465255737, + 0.2365993596613407, + 0.23974477499723434, + 0.7921432815492153, + 0.6049152202904224, + 0.45697208121418953, + 0.8358311429619789, + 0.2062874399125576, + 0.6027469635009766, + 1.512870479375124, + 0.6654079109430313, + 0.850309282541275, + 0.4159414619207382, + 0.784567978233099, + 4.372835278511047, + 0.18102319911122322, + 0.2704723384231329, + 0.09145405888557434, + 1.539270680397749, + 0.9553514868021011, + 1.0521191284060478, + 0.8571772947907448, + 0.6974921897053719, + 0.31219498813152313, + 1.1788009032607079, + 0.28640804439783096, + 0.12795012071728706, + 0.6204012483358383, + 2.432513114064932, + 0.6726655140519142, + 1.3003857024013996, + 0.0, + 0.23455654084682465, + 0.6614929027855396, + 0.14902428723871708, + 0.3467443771660328, + 1.1455328688025475, + 1.143799364566803, + 0.19997570291161537, + 0.0, + 0.23469848558306694, + 0.05691876262426376, + 0.6363107599318027, + 0.31367776542901993, + 0.6617796383798122, + 0.0, + 0.2075079083442688, + 0.5191618856042624, + 1.0945682190358639, + 0.7331068068742752, + 1.1063915602862835, + 1.472978688776493, + 1.0209004431962967, + 0.47180215269327164, + 0.3226254768669605, + 0.9311430864036083, + 0.45449893176555634, + 1.0074837915599346, + 0.0 + ], + "unique_experts": 60, + "load_cv": 0.872154212454046, + "normalized_load_entropy": 0.9269553649658959, + "max_load_share": 0.08849557522123894 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "337875b6e06be0dcdfcb7d49ee7016c5f7d46112d07be0cb9ea38420a0e172d7", + "route_weight_sha256": "f485d3864db5420481e318768213f6138e44858d3510983fb7419c0201c36861", + "loads": [ + 12, + 10, + 9, + 3, + 8, + 34, + 5, + 6, + 12, + 11, + 12, + 17, + 9, + 13, + 26, + 11, + 10, + 10, + 18, + 62, + 6, + 6, + 2, + 24, + 14, + 12, + 12, + 34, + 6, + 18, + 15, + 4, + 13, + 50, + 12, + 22, + 3, + 8, + 10, + 4, + 8, + 35, + 16, + 7, + 3, + 11, + 7, + 12, + 14, + 17, + 3, + 17, + 11, + 18, + 10, + 26, + 22, + 19, + 10, + 27, + 23, + 18, + 16, + 1 + ], + "weighted_loads": [ + 0.735542144626379, + 0.5009004678577185, + 0.41384624410420656, + 0.09699719771742821, + 0.3978022150695324, + 3.0558594465255737, + 0.2365993596613407, + 0.326097059994936, + 0.7921432815492153, + 0.6211408283561468, + 0.5729195661842823, + 1.0571423135697842, + 0.40558499470353127, + 1.1117987148463726, + 1.7870094887912273, + 0.6654079109430313, + 0.850309282541275, + 0.7201101258397102, + 1.183809146285057, + 4.46301232278347, + 0.27960092946887016, + 0.31993544287979603, + 0.09145405888557434, + 1.539270680397749, + 0.996681172400713, + 1.3786004055291414, + 0.899154931306839, + 2.0936800464987755, + 0.31219498813152313, + 1.3110937997698784, + 0.9969736263155937, + 0.14172673039138317, + 1.1084348931908607, + 3.2807822301983833, + 0.8156731873750687, + 1.465842917561531, + 0.11324933357536793, + 0.3631254695355892, + 0.6974622868001461, + 0.14902428723871708, + 0.38908394053578377, + 2.7998422645032406, + 1.1896079778671265, + 0.2684132121503353, + 0.2164098098874092, + 0.48702701926231384, + 0.33958739787340164, + 0.7537628095597029, + 0.9634295180439949, + 0.8903249017894268, + 0.18131470307707787, + 0.971027348190546, + 0.5886246468871832, + 1.2543558590114117, + 0.7331068068742752, + 2.0087463296949863, + 1.5452401712536812, + 1.4124318584799767, + 0.47180215269327164, + 1.594485528767109, + 1.6715194061398506, + 1.5270527563989162, + 1.0074837915599346, + 0.03558279946446419 + ], + "unique_experts": 64, + "load_cv": 0.7483920783572243, + "normalized_load_entropy": 0.9438250211063727, + "max_load_share": 0.0670995670995671 + } + }, + "s0_x": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "63e77a00a6cd130265d9ad35b83839ec455c72eccfa015d831fc3ecc2aceae10", + "route_weight_sha256": "cc7e280da72f36cee6512ced6eb09925c6001eaa567d39bca0c60163954669b5", + "loads": [ + 11, + 11, + 5, + 2, + 4, + 33, + 6, + 6, + 10, + 9, + 13, + 15, + 4, + 12, + 21, + 11, + 11, + 6, + 12, + 58, + 3, + 4, + 3, + 25, + 12, + 9, + 11, + 15, + 5, + 15, + 5, + 3, + 8, + 33, + 8, + 21, + 0, + 6, + 9, + 4, + 7, + 19, + 13, + 8, + 0, + 5, + 1, + 8, + 6, + 11, + 0, + 4, + 10, + 15, + 10, + 16, + 20, + 12, + 9, + 8, + 14, + 6, + 17, + 0 + ], + "weighted_loads": [ + 0.678056426346302, + 0.5317815821617842, + 0.2691688910126686, + 0.07116349972784519, + 0.20734617859125137, + 3.0100554935634136, + 0.26885300129652023, + 0.2831943966448307, + 0.7422931045293808, + 0.5785355716943741, + 0.6071807444095612, + 0.9174744412302971, + 0.17214712128043175, + 0.6179765239357948, + 1.469125673174858, + 0.6763543970882893, + 0.8823933228850365, + 0.4245273806154728, + 0.7152373939752579, + 4.289641294628382, + 0.1557413749396801, + 0.23887045681476593, + 0.13211147114634514, + 1.5864348970353603, + 0.8936139419674873, + 1.0439591780304909, + 0.8679133094847202, + 0.7929977420717478, + 0.3104318492114544, + 1.17187837138772, + 0.24964307248592377, + 0.1268870271742344, + 0.6369944699108601, + 2.551853146404028, + 0.5850070789456367, + 1.3443143963813782, + 0.0, + 0.27083105221390724, + 0.6456138230860233, + 0.13816403597593307, + 0.3593631386756897, + 1.1786207780241966, + 1.094904288649559, + 0.32118137180805206, + 0.0, + 0.1925223208963871, + 0.029108894988894463, + 0.5654750317335129, + 0.31800856813788414, + 0.5934597477316856, + 0.0, + 0.20248007774353027, + 0.5475649572908878, + 1.0653406754136086, + 0.7282252609729767, + 1.1644753776490688, + 1.4118925128132105, + 1.019837610423565, + 0.4381469897925854, + 0.34968892112374306, + 0.9807559996843338, + 0.4196658320724964, + 1.0430708527565002, + 0.0 + ], + "unique_experts": 60, + "load_cv": 0.8613922892488709, + "normalized_load_entropy": 0.9265649427215014, + "max_load_share": 0.0855457227138643 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "2172f3a87ad249ae0617eb68dc46a0cb3947bfe761be59a64d19fbd8f0eeb627", + "route_weight_sha256": "25397c126249930009373edd81e5fb5c1d69638c292b638b486c34569202484b", + "loads": [ + 12, + 12, + 6, + 2, + 4, + 33, + 6, + 11, + 10, + 10, + 15, + 17, + 5, + 14, + 23, + 11, + 11, + 10, + 17, + 60, + 7, + 6, + 3, + 25, + 12, + 11, + 11, + 20, + 6, + 16, + 8, + 4, + 8, + 42, + 9, + 22, + 0, + 6, + 9, + 4, + 7, + 28, + 16, + 10, + 4, + 9, + 8, + 11, + 6, + 14, + 2, + 10, + 10, + 17, + 10, + 25, + 20, + 19, + 9, + 19, + 19, + 20, + 17, + 0 + ], + "weighted_loads": [ + 0.7221391052007675, + 0.5695659797638655, + 0.28331952821463346, + 0.07116349972784519, + 0.20734617859125137, + 3.0100554935634136, + 0.26885300129652023, + 0.49927138164639473, + 0.7422931045293808, + 0.5947611797600985, + 0.7026207968592644, + 1.019431784749031, + 0.20486916974186897, + 1.1218897588551044, + 1.6325651705265045, + 0.6763543970882893, + 0.8823933228850365, + 0.7097883857786655, + 1.0556236803531647, + 4.404006335884333, + 0.32100652530789375, + 0.3225819244980812, + 0.13211147114634514, + 1.5864348970353603, + 0.8936139419674873, + 1.1075047571212053, + 0.8679133094847202, + 1.4155970606952906, + 0.3568507172167301, + 1.2146393731236458, + 0.49743688851594925, + 0.1406636368483305, + 0.6369944699108601, + 2.9687794595956802, + 0.6148309148848057, + 1.3812121115624905, + 0.0, + 0.27083105221390724, + 0.6456138230860233, + 0.13816403597593307, + 0.3593631386756897, + 2.1348277404904366, + 1.1998585890978575, + 0.4187668077647686, + 0.21429362148046494, + 0.40737176686525345, + 0.35065227560698986, + 0.6939049009233713, + 0.31800856813788414, + 0.7216415777802467, + 0.0953390821814537, + 0.527699176222086, + 0.5475649572908878, + 1.1847114451229572, + 0.7282252609729767, + 1.768900003284216, + 1.4118925128132105, + 1.4298608042299747, + 0.4381469897925854, + 1.0407503545284271, + 1.3140496239066124, + 1.7099474482238293, + 1.0430708527565002, + 0.0 + ], + "unique_experts": 62, + "load_cv": 0.75768446134115, + "normalized_load_entropy": 0.9413324044070033, + "max_load_share": 0.07246376811594203 + } + }, + "s1_x": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "7caec5108f1208b45fd5a5e07c761071f80c1b1dda809f8cf495cd48954fcee9", + "route_weight_sha256": "a76cc36171846b0836c9576135391fa242e45deb075924c12b541fd0a80f1701", + "loads": [ + 12, + 9, + 5, + 3, + 6, + 35, + 5, + 7, + 11, + 9, + 8, + 13, + 4, + 12, + 21, + 12, + 10, + 6, + 12, + 59, + 3, + 5, + 3, + 25, + 13, + 9, + 11, + 13, + 6, + 15, + 5, + 2, + 7, + 36, + 9, + 20, + 0, + 5, + 9, + 5, + 7, + 17, + 13, + 4, + 0, + 7, + 1, + 8, + 7, + 12, + 0, + 4, + 10, + 15, + 10, + 16, + 22, + 12, + 9, + 8, + 13, + 7, + 16, + 0 + ], + "weighted_loads": [ + 0.7247263304889202, + 0.4619203582406044, + 0.2691211514174938, + 0.09997307322919369, + 0.27803267538547516, + 3.064236279577017, + 0.23630085587501526, + 0.3182873837649822, + 0.7596395425498486, + 0.5614344961941242, + 0.4132898077368736, + 0.8385934457182884, + 0.16983967274427414, + 0.6077163685113192, + 1.4343175813555717, + 0.6900399178266525, + 0.828387513756752, + 0.43814176693558693, + 0.7536230310797691, + 4.322050258517265, + 0.17254000157117844, + 0.25896042212843895, + 0.12495705485343933, + 1.562013752758503, + 0.944519966840744, + 1.0155229270458221, + 0.8508158326148987, + 0.7081909980624914, + 0.296200105920434, + 1.1711872518062592, + 0.2382960207760334, + 0.08749353140592575, + 0.5871642865240574, + 2.45816595479846, + 0.631546750664711, + 1.2807796970009804, + 0.0, + 0.23279742896556854, + 0.6558698117733002, + 0.17155303247272968, + 0.3398120701313019, + 1.0858463421463966, + 1.0866022258996964, + 0.16521500796079636, + 0.0, + 0.2734462209045887, + 0.040921635925769806, + 0.5811607204377651, + 0.3662247583270073, + 0.6167579609900713, + 0.0, + 0.2154591679573059, + 0.5318680815398693, + 1.0646582916378975, + 0.7177278064191341, + 1.1395052373409271, + 1.4910470824688673, + 1.0240027979016304, + 0.4381492957472801, + 0.3725368119776249, + 0.8988127075135708, + 0.4586667940020561, + 0.9995825663208961, + 0.0 + ], + "unique_experts": 60, + "load_cv": 0.8815223465077654, + "normalized_load_entropy": 0.9253798291029898, + "max_load_share": 0.08702064896755163 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "dabe58f1cc2d2e3b28f9bf548f28d48ed452f23b03eed58438467158b327b75f", + "route_weight_sha256": "8d9f8d2324972d1daa493ad315230a7849558e059599a42ede466be7c6e9aecd", + "loads": [ + 13, + 10, + 7, + 3, + 11, + 35, + 5, + 10, + 11, + 10, + 12, + 18, + 8, + 13, + 25, + 12, + 10, + 11, + 16, + 60, + 4, + 6, + 3, + 25, + 14, + 12, + 12, + 31, + 6, + 18, + 14, + 3, + 12, + 53, + 11, + 22, + 3, + 8, + 10, + 5, + 8, + 33, + 15, + 6, + 2, + 13, + 7, + 12, + 15, + 16, + 5, + 17, + 11, + 19, + 10, + 26, + 23, + 20, + 9, + 26, + 23, + 19, + 16, + 1 + ], + "weighted_loads": [ + 0.7638712674379349, + 0.5084399096667767, + 0.3235501078888774, + 0.09997307322919369, + 0.5333351455628872, + 3.064236279577017, + 0.23630085587501526, + 0.45536670833826065, + 0.7596395425498486, + 0.5776601042598486, + 0.578946053981781, + 1.101375225931406, + 0.3691372275352478, + 1.076814966276288, + 1.7284290418028831, + 0.6900399178266525, + 0.828387513756752, + 0.7601695396006107, + 1.083723772317171, + 4.352614125236869, + 0.21270069479942322, + 0.3084235265851021, + 0.12495705485343933, + 1.562013752758503, + 0.9858496524393559, + 1.3420042041689157, + 0.8927934691309929, + 1.9064043518155813, + 0.296200105920434, + 1.3034801483154297, + 0.9549427069723606, + 0.10127014108002186, + 1.0751979313790798, + 3.313241794705391, + 0.7745544239878654, + 1.4462369121611118, + 0.11324933357536793, + 0.3613663576543331, + 0.6918391957879066, + 0.17155303247272968, + 0.38215163350105286, + 2.3895450942218304, + 1.1324108392000198, + 0.2336525171995163, + 0.14353502541780472, + 0.5892666429281235, + 0.38886435329914093, + 0.749143959954381, + 1.0159765109419823, + 0.8191435225307941, + 0.28028983250260353, + 1.031411912292242, + 0.6013308428227901, + 1.2616786062717438, + 0.7177278064191341, + 1.8573313280940056, + 1.5633085649460554, + 1.4669390805065632, + 0.4381492957472801, + 1.5294439308345318, + 1.6174814850091934, + 1.603799406439066, + 0.9995825663208961, + 0.03558279946446419 + ], + "unique_experts": 64, + "load_cv": 0.7419539610823641, + "normalized_load_entropy": 0.9446501228848057, + "max_load_share": 0.06493506493506493 + } + }, + "s0_period": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "6246b6d01ddf90740afda8fa88dc62996db7a919822334d491cb1b26832f0431", + "route_weight_sha256": "bd4c0b21305595b3b1c7cbb17b3cd892552fdade2b85f467f55c1abef6999cd8", + "loads": [ + 11, + 11, + 6, + 2, + 5, + 34, + 6, + 6, + 9, + 9, + 14, + 15, + 4, + 12, + 21, + 11, + 11, + 6, + 12, + 58, + 2, + 4, + 3, + 25, + 13, + 9, + 11, + 14, + 5, + 15, + 6, + 3, + 8, + 32, + 8, + 20, + 0, + 5, + 9, + 3, + 7, + 18, + 14, + 8, + 0, + 4, + 2, + 9, + 7, + 11, + 0, + 4, + 10, + 15, + 10, + 15, + 21, + 12, + 9, + 7, + 14, + 6, + 17, + 0 + ], + "weighted_loads": [ + 0.6779155731201172, + 0.5390140414237976, + 0.301670802757144, + 0.07135829143226147, + 0.23827063106000423, + 3.083126410841942, + 0.27040474861860275, + 0.29071126878261566, + 0.6856319755315781, + 0.5811275541782379, + 0.6551112234592438, + 0.9208270907402039, + 0.16911553964018822, + 0.6086516231298447, + 1.4788947440683842, + 0.6719607785344124, + 0.8810550197958946, + 0.4134144261479378, + 0.7203638404607773, + 4.350620340555906, + 0.1252772957086563, + 0.2472144477069378, + 0.13454055413603783, + 1.573528353124857, + 0.9368532560765743, + 1.0406563505530357, + 0.8588255196809769, + 0.7642356585711241, + 0.3146544620394707, + 1.177488025277853, + 0.2936960868537426, + 0.13208486512303352, + 0.6387103646993637, + 2.3998287990689278, + 0.5813428945839405, + 1.2826013565063477, + 0.0, + 0.23999077454209328, + 0.6586737558245659, + 0.11335509642958641, + 0.36617404967546463, + 1.162541702389717, + 1.1542234532535076, + 0.3227428775280714, + 0.0, + 0.15387577190995216, + 0.06234603747725487, + 0.6148612983524799, + 0.35466695576906204, + 0.5977358557283878, + 0.0, + 0.20353557169437408, + 0.5448291804641485, + 1.0810825116932392, + 0.7245469614863396, + 1.1387089379131794, + 1.4567452799528837, + 1.0175139904022217, + 0.44135382771492004, + 0.31360963732004166, + 0.9984513372182846, + 0.418474018573761, + 1.0605031736195087, + 0.0 + ], + "unique_experts": 60, + "load_cv": 0.8599363968286343, + "normalized_load_entropy": 0.9268825214115761, + "max_load_share": 0.0855457227138643 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "9f393f4750f3b28a70b6e598aed466deae1e2166fbae6b95129e6cf8536c8d70", + "route_weight_sha256": "34920765bbffa9c0391fc2c1811a3fdc71591e3f1552a347202ee937f915bb16", + "loads": [ + 12, + 11, + 7, + 2, + 6, + 34, + 6, + 10, + 9, + 10, + 16, + 17, + 5, + 14, + 23, + 11, + 11, + 9, + 17, + 60, + 6, + 6, + 3, + 25, + 13, + 11, + 11, + 20, + 6, + 16, + 10, + 4, + 8, + 40, + 9, + 21, + 0, + 5, + 9, + 3, + 7, + 28, + 17, + 10, + 3, + 8, + 8, + 12, + 7, + 14, + 3, + 11, + 10, + 17, + 10, + 24, + 21, + 19, + 9, + 18, + 20, + 19, + 17, + 0 + ], + "weighted_loads": [ + 0.7112540118396282, + 0.5390140414237976, + 0.31582143995910883, + 0.07135829143226147, + 0.27051798067986965, + 3.083126410841942, + 0.27040474861860275, + 0.4671746529638767, + 0.6856319755315781, + 0.5973531622439623, + 0.750551275908947, + 1.0233502425253391, + 0.20183758810162544, + 1.1125648580491543, + 1.6374559290707111, + 0.6719607785344124, + 0.8810550197958946, + 0.6659762375056744, + 1.060750126838684, + 4.462305676192045, + 0.29054244607686996, + 0.33092591539025307, + 0.13454055413603783, + 1.573528353124857, + 0.9368532560765743, + 1.1042019296437502, + 0.8588255196809769, + 1.4338417258113623, + 0.3610733300447464, + 1.2202490270137787, + 0.616232767701149, + 0.14586147479712963, + 0.6387103646993637, + 2.7634001709520817, + 0.6111667305231094, + 1.31949907168746, + 0.0, + 0.23999077454209328, + 0.6586737558245659, + 0.11335509642958641, + 0.36617404967546463, + 2.2045607678592205, + 1.259177753701806, + 0.42032831348478794, + 0.1670902594923973, + 0.3432583771646023, + 0.333942249417305, + 0.742656646296382, + 0.35466695576906204, + 0.7398306503891945, + 0.1327262558043003, + 0.5952351130545139, + 0.5448291804641485, + 1.2017512395977974, + 0.7245469614863396, + 1.7635826505720615, + 1.4567452799528837, + 1.4415610991418362, + 0.44135382771492004, + 1.01907454803586, + 1.3810410760343075, + 1.6524226516485214, + 1.0605031736195087, + 0.0 + ], + "unique_experts": 62, + "load_cv": 0.7513746960166355, + "normalized_load_entropy": 0.9420517579327076, + "max_load_share": 0.07246376811594203 + } + }, + "s1_period": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "60bfbcc4c8fd0d95187d26ee9fffec40bbe1aae445a007aff7515659f74c0062", + "route_weight_sha256": "fa82e5a6f2b8ff4511b48e4895c19f1d33d03cc3be3da3d2c15128646f96632e", + "loads": [ + 12, + 10, + 6, + 3, + 5, + 37, + 5, + 7, + 13, + 9, + 9, + 14, + 3, + 12, + 21, + 12, + 10, + 6, + 13, + 57, + 3, + 5, + 4, + 25, + 13, + 9, + 11, + 13, + 5, + 15, + 5, + 2, + 7, + 36, + 8, + 21, + 0, + 5, + 9, + 5, + 7, + 17, + 13, + 3, + 0, + 6, + 1, + 7, + 7, + 12, + 0, + 4, + 10, + 15, + 11, + 14, + 21, + 12, + 10, + 7, + 13, + 7, + 16, + 0 + ], + "weighted_loads": [ + 0.7159565910696983, + 0.5022943168878555, + 0.30056553333997726, + 0.09825088270008564, + 0.2372027039527893, + 3.137226365506649, + 0.2334914356470108, + 0.3164300248026848, + 0.8136249929666519, + 0.5646794177591801, + 0.4415724612772465, + 0.8805082254111767, + 0.12891097739338875, + 0.6035246960818768, + 1.4440840408205986, + 0.6925224028527737, + 0.8283985815942287, + 0.43607043102383614, + 0.7812062464654446, + 4.288698587566614, + 0.15259819850325584, + 0.2727534119039774, + 0.16771872527897358, + 1.5499414689838886, + 0.9410322979092598, + 1.018476165831089, + 0.8556598275899887, + 0.7143149524927139, + 0.33445268496870995, + 1.18114298209548, + 0.2399577833712101, + 0.09020133316516876, + 0.5869273096323013, + 2.4297655038535595, + 0.5895446948707104, + 1.3240301050245762, + 0.0, + 0.2364494651556015, + 0.6628145277500153, + 0.18013433180749416, + 0.3411203734576702, + 1.0958626791834831, + 1.0914880707859993, + 0.12749889865517616, + 0.0, + 0.23811695352196693, + 0.042054057121276855, + 0.5408661589026451, + 0.3677189126610756, + 0.6166657581925392, + 0.0, + 0.21907328441739082, + 0.5436645969748497, + 1.0586881302297115, + 0.7642869912087917, + 1.0561062172055244, + 1.4821650311350822, + 1.0258605293929577, + 0.4787490740418434, + 0.315236359834671, + 0.9085541814565659, + 0.45615404099226, + 1.0146004781126976, + 0.0 + ], + "unique_experts": 60, + "load_cv": 0.8774063433701951, + "normalized_load_entropy": 0.9247840371713556, + "max_load_share": 0.084070796460177 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "0c2380f58486d8884d426726e98921f086a9f46ea049db5d277e1d9fd3e85e77", + "route_weight_sha256": "cbda3588cee0b85485acef8cf2572bf6f67cbe54027711938aa468e1d99e9b1b", + "loads": [ + 12, + 11, + 8, + 4, + 10, + 37, + 5, + 9, + 13, + 10, + 12, + 18, + 7, + 13, + 25, + 12, + 10, + 11, + 17, + 58, + 4, + 6, + 4, + 25, + 14, + 12, + 12, + 31, + 5, + 18, + 15, + 3, + 12, + 53, + 10, + 23, + 3, + 8, + 10, + 5, + 8, + 34, + 15, + 5, + 2, + 12, + 6, + 11, + 15, + 15, + 4, + 18, + 11, + 19, + 11, + 25, + 22, + 20, + 10, + 26, + 24, + 19, + 16, + 1 + ], + "weighted_loads": [ + 0.7159565910696983, + 0.536544930189848, + 0.35499448981136084, + 0.15467547066509724, + 0.4968842640519142, + 3.137226365506649, + 0.2334914356470108, + 0.40278230980038643, + 0.8136249929666519, + 0.5809050258249044, + 0.5575199462473392, + 1.098873034119606, + 0.3282085321843624, + 1.0726232938468456, + 1.7153183221817017, + 0.6925224028527737, + 0.8283985815942287, + 0.8100170604884624, + 1.1113069877028465, + 4.318814292550087, + 0.19275889173150063, + 0.3222165163606405, + 0.16771872527897358, + 1.5499414689838886, + 0.9823619835078716, + 1.3449574429541826, + 0.8976374641060829, + 1.9173343926668167, + 0.33445268496870995, + 1.3134358786046505, + 1.0470680333673954, + 0.10397794283926487, + 1.0749609544873238, + 3.264480046927929, + 0.7325523681938648, + 1.4894873201847076, + 0.11324933357536793, + 0.3650183938443661, + 0.6987839117646217, + 0.18013433180749416, + 0.3834599368274212, + 2.448925018310547, + 1.1372966840863228, + 0.1959364078938961, + 0.14353502541780472, + 0.5274401344358921, + 0.32472269237041473, + 0.707827040925622, + 1.0174706652760506, + 0.7768145203590393, + 0.24727822467684746, + 1.1280598193407059, + 0.6131273582577705, + 1.2520137801766396, + 0.7642869912087917, + 1.833800669759512, + 1.5544265136122704, + 1.549158338457346, + 0.4787490740418434, + 1.5031606182456017, + 1.6572118625044823, + 1.5794510506093502, + 1.0146004781126976, + 0.03558279946446419 + ], + "unique_experts": 64, + "load_cv": 0.7410441149588947, + "normalized_load_entropy": 0.9443290465229598, + "max_load_share": 0.06277056277056277 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 113, + "ordered_topk_exact_tokens": 78, + "set_exact_tokens": 89, + "mean_set_jaccard": 0.9374209860935525, + "mean_token_weighted_tv": 0.012970006612615775, + "aggregate_load_tv": 0.028023598820059 + }, + "system_bos": { + "tokens": 113, + "ordered_topk_exact_tokens": 66, + "set_exact_tokens": 78, + "mean_set_jaccard": 0.911504424778761, + "mean_token_weighted_tv": 0.018721727085654186, + "aggregate_load_tv": 0.029498525073746312 + }, + "system_x": { + "tokens": 113, + "ordered_topk_exact_tokens": 52, + "set_exact_tokens": 72, + "mean_set_jaccard": 0.8887484197218712, + "mean_token_weighted_tv": 0.025923009516786687, + "aggregate_load_tv": 0.0368731563421829 + }, + "system_period": { + "tokens": 113, + "ordered_topk_exact_tokens": 56, + "set_exact_tokens": 69, + "mean_set_jaccard": 0.8830594184576486, + "mean_token_weighted_tv": 0.026076982861005626, + "aggregate_load_tv": 0.04129793510324484 + }, + "bos_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 66, + "set_exact_tokens": 81, + "mean_set_jaccard": 0.9190897597977244, + "mean_token_weighted_tv": 0.019308793284328638, + "aggregate_load_tv": 0.03687315634218288 + }, + "bos_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 57, + "set_exact_tokens": 73, + "mean_set_jaccard": 0.8969658659924147, + "mean_token_weighted_tv": 0.02335464992288467, + "aggregate_load_tv": 0.03982300884955752 + }, + "x_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 70, + "set_exact_tokens": 87, + "mean_set_jaccard": 0.934260429835651, + "mean_token_weighted_tv": 0.017431594629203323, + "aggregate_load_tv": 0.023598820058997053 + }, + "x_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 46, + "set_exact_tokens": 67, + "mean_set_jaccard": 0.8780025284450064, + "mean_token_weighted_tv": 0.028090034347785786, + "aggregate_load_tv": 0.04277286135693216 + }, + "period_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 65, + "set_exact_tokens": 85, + "mean_set_jaccard": 0.927307206068268, + "mean_token_weighted_tv": 0.01806223834246661, + "aggregate_load_tv": 0.026548672566371685 + }, + "period_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 53, + "set_exact_tokens": 69, + "mean_set_jaccard": 0.8849557522123895, + "mean_token_weighted_tv": 0.026764698788128066, + "aggregate_load_tv": 0.04424778761061947 + } + } + }, + "layer_11": { + "layer": 11, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "f569ba6e8cfe238d384a487794e180857a7886d37eebfd5a96c69443399e5ba6", + "route_weight_sha256": "ba263a2920e5a33b3c0fa40513d346ac4f597db64e9f1adb785349443fe5bc01", + "loads": [ + 9, + 11, + 12, + 6, + 13, + 3, + 7, + 1, + 12, + 7, + 7, + 8, + 6, + 14, + 2, + 12, + 9, + 18, + 2, + 16, + 14, + 13, + 13, + 9, + 9, + 5, + 12, + 11, + 4, + 3, + 0, + 13, + 6, + 36, + 21, + 12, + 14, + 1, + 13, + 6, + 21, + 38, + 9, + 4, + 13, + 6, + 12, + 6, + 12, + 15, + 17, + 9, + 18, + 0, + 2, + 13, + 6, + 9, + 4, + 21, + 27, + 13, + 13, + 0 + ], + "weighted_loads": [ + 0.5452217161655426, + 0.5745788551867008, + 0.8666536808013916, + 0.2625165395438671, + 0.8105362057685852, + 0.16075067222118378, + 0.47457049414515495, + 0.10170896351337433, + 0.8275441378355026, + 0.25999701023101807, + 0.3665805757045746, + 0.4072125144302845, + 0.21673712879419327, + 0.9366390593349934, + 0.06647331640124321, + 0.6345595363527536, + 0.4360719732940197, + 0.7334641981869936, + 0.07313431054353714, + 0.8754462338984013, + 0.8464730866253376, + 0.957587044686079, + 0.7282353825867176, + 0.6215967163443565, + 0.41239284351468086, + 0.252555925399065, + 0.5438171941787004, + 0.5421699583530426, + 0.22462986409664154, + 0.15544601902365685, + 0.0, + 1.6339779011905193, + 0.245444405823946, + 2.7853749692440033, + 1.5542614832520485, + 0.9180498383939266, + 0.9313388355076313, + 0.027268828824162483, + 0.597539521753788, + 0.25675916858017445, + 1.6626920476555824, + 2.4708259031176567, + 0.4455612786114216, + 0.19562023878097534, + 1.655762828886509, + 0.21745665185153484, + 0.7107751704752445, + 0.3849397264420986, + 0.6615470349788666, + 1.3068951703608036, + 1.0095007307827473, + 1.047146949917078, + 1.176844384521246, + 0.0, + 0.06973643787205219, + 0.5708836130797863, + 0.3628488518297672, + 0.42380794882774353, + 0.1660480536520481, + 1.8971427008509636, + 1.4766536988317966, + 0.6997247748076916, + 0.7511755153536797, + 0.0 + ], + "unique_experts": 61, + "load_cv": 0.7001970641765374, + "normalized_load_entropy": 0.9418361874582664, + "max_load_share": 0.05604719764011799 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "751cbd60e813e34db3ff92a44f9128bf57b21f7c21ffcd89f884f18ff517dc04", + "route_weight_sha256": "f1dd8ae201c39115a039ea7f6c163685b02a59151eea7335c60425b58c4b0f50", + "loads": [ + 9, + 12, + 13, + 6, + 17, + 3, + 7, + 1, + 16, + 9, + 10, + 11, + 6, + 14, + 2, + 18, + 15, + 20, + 14, + 16, + 14, + 13, + 14, + 14, + 9, + 6, + 13, + 12, + 10, + 3, + 6, + 20, + 8, + 36, + 25, + 15, + 14, + 1, + 13, + 6, + 27, + 38, + 9, + 26, + 16, + 6, + 12, + 14, + 12, + 17, + 17, + 10, + 18, + 0, + 8, + 18, + 6, + 9, + 7, + 22, + 27, + 17, + 21, + 0 + ], + "weighted_loads": [ + 0.5452217161655426, + 0.6079163625836372, + 0.925380278378725, + 0.2625165395438671, + 1.0082122050225735, + 0.16075067222118378, + 0.47457049414515495, + 0.10170896351337433, + 1.084361720830202, + 0.3181065134704113, + 0.43921150639653206, + 0.46117025800049305, + 0.21673712879419327, + 0.9366390593349934, + 0.06647331640124321, + 0.8633959423750639, + 1.0178073607385159, + 0.7633755216374993, + 2.142073653638363, + 0.8754462338984013, + 0.8464730866253376, + 0.957587044686079, + 0.7321806997060776, + 0.8721589110791683, + 0.41239284351468086, + 0.35268722102046013, + 0.5471883772406727, + 0.5547699183225632, + 0.642209853976965, + 0.15544601902365685, + 0.29325506649911404, + 1.9523523077368736, + 0.31262417510151863, + 2.7853749692440033, + 1.720641978085041, + 1.217430468648672, + 0.9313388355076313, + 0.027268828824162483, + 0.597539521753788, + 0.25675916858017445, + 1.979866862297058, + 2.4708259031176567, + 0.4455612786114216, + 2.3302236162126064, + 1.819233451038599, + 0.21745665185153484, + 0.7107751704752445, + 0.9952860474586487, + 0.6615470349788666, + 1.4026677943766117, + 1.0095007307827473, + 1.147384125739336, + 1.176844384521246, + 0.0, + 0.38832040317356586, + 0.7855989672243595, + 0.3628488518297672, + 0.42380794882774353, + 0.30318134650588036, + 1.9368562288582325, + 1.4766536988317966, + 0.8773432541638613, + 1.2406844906508923, + 0.0 + ], + "unique_experts": 62, + "load_cv": 0.5963591527528443, + "normalized_load_entropy": 0.9550487588323694, + "max_load_share": 0.04589371980676329 + } + }, + "s1_eos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "5ea0ba193549c3f522eb35a3b230a3a0ea6cb7d710befd363682408bd81cfbf6", + "route_weight_sha256": "e2b7f081a3b7a6f4891d111a5b70ece6125c022c9fb7443ed7e5ea7855b6612d", + "loads": [ + 11, + 11, + 12, + 7, + 13, + 3, + 8, + 1, + 12, + 6, + 8, + 8, + 5, + 14, + 3, + 14, + 9, + 17, + 2, + 16, + 13, + 14, + 12, + 9, + 9, + 5, + 10, + 11, + 4, + 3, + 0, + 13, + 6, + 35, + 20, + 11, + 13, + 0, + 12, + 6, + 21, + 38, + 8, + 4, + 13, + 6, + 13, + 6, + 12, + 15, + 17, + 9, + 18, + 0, + 1, + 15, + 6, + 10, + 4, + 21, + 28, + 14, + 13, + 0 + ], + "weighted_loads": [ + 0.6187312919646502, + 0.5735314376652241, + 0.8441456072032452, + 0.31026728078722954, + 0.8275060541927814, + 0.16164352372288704, + 0.518216896802187, + 0.10134657472372055, + 0.8211480155587196, + 0.22902203537523746, + 0.4006691873073578, + 0.41871941462159157, + 0.18745818734169006, + 0.9417894706130028, + 0.09925394505262375, + 0.6801284197717905, + 0.41664859279990196, + 0.7011655420064926, + 0.07303105294704437, + 0.9066048059612513, + 0.8019127659499645, + 0.9920951426029205, + 0.7055571582168341, + 0.6255751177668571, + 0.4093790054321289, + 0.2491618786007166, + 0.45131603069603443, + 0.5428114347159863, + 0.2152954526245594, + 0.17033061012625694, + 0.0, + 1.619294460862875, + 0.24854148924350739, + 2.709008540958166, + 1.4919220469892025, + 0.8822726272046566, + 0.8934696093201637, + 0.0, + 0.553746473044157, + 0.25069576129317284, + 1.6680064052343369, + 2.4835611283779144, + 0.40955791994929314, + 0.19703255593776703, + 1.6441722512245178, + 0.22094234265387058, + 0.7363403346389532, + 0.3859739527106285, + 0.6664654072374105, + 1.3161896839737892, + 1.0112063754349947, + 1.0436263233423233, + 1.178492221981287, + 0.0, + 0.04152107238769531, + 0.6418528519570827, + 0.36479736492037773, + 0.4545953404158354, + 0.16681377217173576, + 1.889679066836834, + 1.4698905311524868, + 0.7523521017283201, + 0.726976877078414, + 0.0 + ], + "unique_experts": 60, + "load_cv": 0.6988038090929548, + "normalized_load_entropy": 0.940748341641824, + "max_load_share": 0.05604719764011799 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "d937ea6fd271dc2a2cfdf525ebfc158015bb40072b9a04f06050a59e862c917d", + "route_weight_sha256": "ba76d64674b593d7a28be65d32ed4a5d5383171534ad8f8276d5527e54796570", + "loads": [ + 13, + 12, + 13, + 7, + 24, + 7, + 8, + 3, + 22, + 6, + 12, + 11, + 5, + 14, + 3, + 15, + 26, + 19, + 13, + 17, + 14, + 15, + 15, + 14, + 9, + 7, + 13, + 13, + 14, + 3, + 8, + 20, + 6, + 35, + 25, + 16, + 13, + 0, + 12, + 7, + 28, + 38, + 8, + 31, + 15, + 6, + 14, + 19, + 12, + 18, + 17, + 10, + 18, + 5, + 20, + 26, + 12, + 11, + 6, + 25, + 29, + 22, + 24, + 1 + ], + "weighted_loads": [ + 0.7668782267719507, + 0.6061463914811611, + 0.8931396715342999, + 0.31026728078722954, + 1.408820018172264, + 0.29896536469459534, + 0.518216896802187, + 0.2307860553264618, + 1.4388052597641945, + 0.22902203537523746, + 0.514993651304394, + 0.47191001288592815, + 0.18745818734169006, + 0.9417894706130028, + 0.09925394505262375, + 0.7199479695409536, + 2.0007844902575016, + 0.7302591968327761, + 2.1300984621047974, + 0.9452262837439775, + 0.8752023167908192, + 1.0636801645159721, + 0.8186092982068658, + 0.8475331328809261, + 0.4093790054321289, + 0.36771312169730663, + 0.529850299237296, + 0.5946830995380878, + 0.9418963901698589, + 0.17033061012625694, + 0.40727002918720245, + 1.9267430789768696, + 0.24854148924350739, + 2.709008540958166, + 1.7136149741709232, + 1.383968535810709, + 0.8934696093201637, + 0.0, + 0.553746473044157, + 0.29765158519148827, + 2.00694103166461, + 2.4835611283779144, + 0.40955791994929314, + 2.669618584215641, + 1.778093047440052, + 0.22094234265387058, + 0.7826799917966127, + 1.3994589745998383, + 0.6664654072374105, + 1.534649707376957, + 1.0112063754349947, + 1.1384004801511765, + 1.178492221981287, + 0.3026953712105751, + 1.2156538516283035, + 1.1566739231348038, + 0.8342693448066711, + 0.49709864519536495, + 0.26865051686763763, + 2.0556755624711514, + 1.5083685368299484, + 1.1128861214965582, + 1.303236985579133, + 0.04126733914017677 + ], + "unique_experts": 63, + "load_cv": 0.5669343138492422, + "normalized_load_entropy": 0.9599673173913618, + "max_load_share": 0.04112554112554113 + } + }, + "s0_bos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "d22f44197633f71d302d146e509d40ddad423574f7cb761e9c95d63abe1f277d", + "route_weight_sha256": "4ffda4b5b46ed88c0c8fa87e1e19177b0f0126d4285d8f7bc07de219db9abacb", + "loads": [ + 11, + 10, + 13, + 6, + 13, + 3, + 7, + 1, + 12, + 6, + 7, + 9, + 6, + 13, + 3, + 12, + 9, + 18, + 2, + 16, + 13, + 13, + 13, + 9, + 15, + 5, + 11, + 11, + 4, + 3, + 0, + 13, + 5, + 37, + 20, + 11, + 13, + 1, + 12, + 6, + 23, + 39, + 9, + 4, + 13, + 4, + 11, + 6, + 11, + 15, + 17, + 9, + 19, + 0, + 1, + 11, + 7, + 8, + 5, + 21, + 28, + 12, + 13, + 0 + ], + "weighted_loads": [ + 0.624966699630022, + 0.5445742830634117, + 0.9101826064288616, + 0.263886995613575, + 0.821196012198925, + 0.1679331213235855, + 0.48102133721113205, + 0.10367902368307114, + 0.8316140547394753, + 0.21268513798713684, + 0.37270740792155266, + 0.4620332159101963, + 0.21900513395667076, + 0.9026755094528198, + 0.09667197801172733, + 0.6704506166279316, + 0.4503762386739254, + 0.7424321416765451, + 0.07858362793922424, + 0.8710836805403233, + 0.807519219815731, + 0.9599716439843178, + 0.7257448621094227, + 0.6205665245652199, + 0.6075770147144794, + 0.2653708029538393, + 0.5077282749116421, + 0.5471224784851074, + 0.2343733124434948, + 0.12598769553005695, + 0.0, + 1.651712141931057, + 0.20749356970191002, + 2.8018020167946815, + 1.4788000229746103, + 0.8660085760056973, + 0.9112282246351242, + 0.026490619406104088, + 0.5448663532733917, + 0.25525184348225594, + 1.7424429897218943, + 2.474969470873475, + 0.41890471056103706, + 0.19900179654359818, + 1.6883946657180786, + 0.1599748358130455, + 0.6845278218388557, + 0.3849467672407627, + 0.628869891166687, + 1.3150581903755665, + 1.0148229487240314, + 1.0190240144729614, + 1.2151392847299576, + 0.0, + 0.04660545662045479, + 0.4788508974015713, + 0.409291572868824, + 0.37568100541830063, + 0.19748110696673393, + 1.9175292737782001, + 1.5062940008938313, + 0.6810747478157282, + 0.7256792224943638, + 0.0 + ], + "unique_experts": 61, + "load_cv": 0.7184510971608776, + "normalized_load_entropy": 0.939784435853531, + "max_load_share": 0.05752212389380531 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "5271dc438d279e1aab5463178312f5e2b806a6eed3ec517d11666e258da300b8", + "route_weight_sha256": "ead00e148619edc57608369f971ffa668d07c6fe31f9d024bc9b4c969650b04b", + "loads": [ + 11, + 11, + 14, + 6, + 17, + 3, + 7, + 1, + 16, + 9, + 9, + 11, + 6, + 13, + 3, + 19, + 15, + 19, + 13, + 16, + 13, + 13, + 13, + 14, + 15, + 6, + 11, + 13, + 10, + 3, + 6, + 20, + 7, + 37, + 24, + 14, + 13, + 1, + 12, + 6, + 30, + 39, + 9, + 27, + 16, + 4, + 11, + 14, + 11, + 17, + 17, + 10, + 19, + 0, + 6, + 15, + 7, + 8, + 8, + 22, + 28, + 18, + 22, + 0 + ], + "weighted_loads": [ + 0.624966699630022, + 0.5779117904603481, + 0.9689092040061951, + 0.263886995613575, + 1.0188720114529133, + 0.1679331213235855, + 0.48102133721113205, + 0.10367902368307114, + 1.089145664125681, + 0.3068477660417557, + 0.4401847533881664, + 0.5038371346890926, + 0.21900513395667076, + 0.9026755094528198, + 0.09667197801172733, + 0.9313894435763359, + 1.0553865171968937, + 0.7572723729535937, + 1.2521617263555527, + 0.8710836805403233, + 0.807519219815731, + 0.9599716439843178, + 0.7257448621094227, + 0.8711287193000317, + 0.6075770147144794, + 0.3663641232997179, + 0.5077282749116421, + 0.604220911860466, + 0.6489458382129669, + 0.12598769553005695, + 0.29325506649911404, + 1.9700865484774113, + 0.27467333897948265, + 2.8018020167946815, + 1.6485798228532076, + 1.169994805008173, + 0.9112282246351242, + 0.026490619406104088, + 0.5448663532733917, + 0.25525184348225594, + 2.1485075186938047, + 2.474969470873475, + 0.41890471056103706, + 2.53300953283906, + 1.8518652878701687, + 0.1599748358130455, + 0.6845278218388557, + 0.9868521653115749, + 0.628869891166687, + 1.4108308143913746, + 1.0148229487240314, + 1.130337730050087, + 1.2151392847299576, + 0.0, + 0.3258390985429287, + 0.6346407830715179, + 0.409291572868824, + 0.37568100541830063, + 0.3346143998205662, + 1.9541367553174496, + 1.5062940008938313, + 0.9528114311397076, + 1.289653204381466, + 0.0 + ], + "unique_experts": 62, + "load_cv": 0.6162214010739513, + "normalized_load_entropy": 0.9531763362944112, + "max_load_share": 0.04710144927536232 + } + }, + "s1_bos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "4dd5bde2ccee9b0034284ef7e6fb814eeef13831d6efeb6006ccd8c59e7108c1", + "route_weight_sha256": "abe5ae60886288ffea48b8068a1165b4fdf71d47905c3a6924df88c517e5f69d", + "loads": [ + 11, + 10, + 13, + 6, + 13, + 3, + 7, + 1, + 12, + 9, + 7, + 8, + 5, + 13, + 2, + 12, + 9, + 17, + 2, + 16, + 14, + 14, + 14, + 9, + 12, + 4, + 11, + 10, + 4, + 2, + 0, + 13, + 6, + 35, + 21, + 11, + 13, + 1, + 10, + 7, + 24, + 39, + 8, + 4, + 13, + 5, + 12, + 6, + 11, + 16, + 17, + 9, + 19, + 1, + 1, + 12, + 6, + 8, + 5, + 21, + 27, + 14, + 13, + 0 + ], + "weighted_loads": [ + 0.6342646963894367, + 0.5312606059014797, + 0.9030870832502842, + 0.26411348208785057, + 0.8131646513938904, + 0.16485105454921722, + 0.4873998500406742, + 0.10079003870487213, + 0.8247618712484837, + 0.31450374238193035, + 0.37009262293577194, + 0.41767580434679985, + 0.1836700662970543, + 0.9205390773713589, + 0.06970202922821045, + 0.6615368537604809, + 0.4322919510304928, + 0.6989286560565233, + 0.07134762033820152, + 0.8999843783676624, + 0.8242417089641094, + 1.0046694688498974, + 0.772957207635045, + 0.6275189183652401, + 0.5106372088193893, + 0.22002984769642353, + 0.5165026392787695, + 0.5120059661567211, + 0.2258184775710106, + 0.10683409124612808, + 0.0, + 1.6279216334223747, + 0.2470153607428074, + 2.666933361440897, + 1.4930066000670195, + 0.8636413663625717, + 0.888894896954298, + 0.026095332577824593, + 0.4621421806514263, + 0.28518445417284966, + 1.7980278264731169, + 2.432186832651496, + 0.380813617259264, + 0.19253677502274513, + 1.68646789342165, + 0.193178229033947, + 0.7171905264258385, + 0.37984225153923035, + 0.6297786198556423, + 1.3532824590802193, + 1.0074510388076305, + 1.0385700277984142, + 1.2202140875160694, + 0.027517816051840782, + 0.04627794027328491, + 0.526226531714201, + 0.37591950967907906, + 0.3912631385028362, + 0.19775860756635666, + 1.916791945695877, + 1.4450801014900208, + 0.7577119674533606, + 0.7151048630475998, + 0.0 + ], + "unique_experts": 62, + "load_cv": 0.7106573667022178, + "normalized_load_entropy": 0.9407154448705654, + "max_load_share": 0.05752212389380531 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "731a6c18163b82848eeadfda77b01bb7cd99905b5861b39c9f0654a1f5e65317", + "route_weight_sha256": "55102cabe846c22fc940836358adecc4766fed7d9c25c1592974de7914fe71d5", + "loads": [ + 13, + 11, + 14, + 6, + 24, + 7, + 7, + 3, + 22, + 10, + 10, + 10, + 5, + 13, + 2, + 15, + 26, + 18, + 12, + 17, + 15, + 15, + 16, + 14, + 12, + 6, + 13, + 12, + 13, + 2, + 8, + 20, + 6, + 35, + 26, + 16, + 13, + 1, + 10, + 8, + 31, + 39, + 8, + 32, + 15, + 5, + 13, + 20, + 11, + 19, + 17, + 10, + 19, + 6, + 20, + 22, + 12, + 9, + 7, + 25, + 28, + 24, + 25, + 1 + ], + "weighted_loads": [ + 0.7824116311967373, + 0.5638755597174168, + 0.9520811475813389, + 0.26411348208785057, + 1.394478615373373, + 0.3021728955209255, + 0.4873998500406742, + 0.23022951930761337, + 1.4490680806338787, + 0.3482091035693884, + 0.4792626090347767, + 0.4594435319304466, + 0.1836700662970543, + 0.9205390773713589, + 0.06970202922821045, + 0.7750720754265785, + 2.0739534609019756, + 0.7137688873335719, + 1.2304494194686413, + 0.9386058561503887, + 0.8975312598049641, + 1.076254490762949, + 0.8822254966944456, + 0.8494769334793091, + 0.5106372088193893, + 0.34757119975984097, + 0.5918619651347399, + 0.5638776309788227, + 0.9221933446824551, + 0.10683409124612808, + 0.40727002918720245, + 1.9353702515363693, + 0.2470153607428074, + 2.666933361440897, + 1.7117070090025663, + 1.3732288032770157, + 0.888894896954298, + 0.026095332577824593, + 0.4621421806514263, + 0.3321402780711651, + 2.1994468215852976, + 2.432186832651496, + 0.380813617259264, + 2.9691508896648884, + 1.8203886896371841, + 0.193178229033947, + 0.763530183583498, + 1.445154558867216, + 0.6297786198556423, + 1.571742482483387, + 1.0074510388076305, + 1.1495711393654346, + 1.2202140875160694, + 0.3302131872624159, + 1.2357654832303524, + 0.988005954772234, + 0.8453914895653725, + 0.4337664432823658, + 0.29959535226225853, + 2.0762481950223446, + 1.4835581071674824, + 1.1966579835861921, + 1.3378165401518345, + 0.04126733914017677 + ], + "unique_experts": 64, + "load_cv": 0.5801350370663592, + "normalized_load_entropy": 0.9588859119729726, + "max_load_share": 0.04220779220779221 + } + }, + "s0_x": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "3e4d991111fbfb2521bf2ef4e7cc9bfdf0770e6bfda91520d4fe00d8f7fa9519", + "route_weight_sha256": "dfcd458826e4bcd0defaf5ebb92487d65683725f1848c084dd817d35f95f0fb9", + "loads": [ + 11, + 10, + 13, + 7, + 13, + 3, + 7, + 1, + 12, + 5, + 8, + 10, + 6, + 13, + 3, + 10, + 9, + 17, + 2, + 16, + 12, + 13, + 14, + 9, + 13, + 4, + 11, + 10, + 4, + 3, + 0, + 13, + 5, + 38, + 20, + 11, + 13, + 1, + 13, + 7, + 23, + 38, + 8, + 5, + 13, + 6, + 12, + 6, + 12, + 15, + 17, + 9, + 18, + 0, + 1, + 11, + 6, + 9, + 5, + 21, + 28, + 11, + 14, + 0 + ], + "weighted_loads": [ + 0.6211899928748608, + 0.5253672823309898, + 0.8975119367241859, + 0.3082200363278389, + 0.8524491004645824, + 0.16592884808778763, + 0.4863918498158455, + 0.10678078234195709, + 0.8235749825835228, + 0.17424430698156357, + 0.4117200542241335, + 0.4873679094016552, + 0.22058606892824173, + 0.8929971344769001, + 0.09772587567567825, + 0.5710889585316181, + 0.4536834917962551, + 0.6978243421763182, + 0.07371391355991364, + 0.8631018064916134, + 0.7743725590407848, + 0.9584144353866577, + 0.7562132123857737, + 0.6201076321303844, + 0.5599810779094696, + 0.20878199115395546, + 0.5164121836423874, + 0.49960771203041077, + 0.22621337324380875, + 0.16562259942293167, + 0.0, + 1.6611684933304787, + 0.21317698806524277, + 2.872825402766466, + 1.5082447081804276, + 0.8490726836025715, + 0.9142251424491405, + 0.028064506128430367, + 0.5946672484278679, + 0.295530341565609, + 1.7808790616691113, + 2.439962200820446, + 0.3790030237287283, + 0.21451513841748238, + 1.698493778705597, + 0.22676950320601463, + 0.7267626505345106, + 0.3778249956667423, + 0.6694601029157639, + 1.3035720810294151, + 1.0478205531835556, + 1.031584583222866, + 1.1796673983335495, + 0.0, + 0.04411016404628754, + 0.4907703399658203, + 0.3639419972896576, + 0.407573439180851, + 0.1947658695280552, + 1.911422822624445, + 1.5108624082058668, + 0.638784121721983, + 0.7823374196887016, + 0.0 + ], + "unique_experts": 61, + "load_cv": 0.7124183898769926, + "normalized_load_entropy": 0.9408276940283045, + "max_load_share": 0.05604719764011799 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "81f69a36d638552bc7d4255fa5a7be2245693b300aeaa34db75151cfd9232ee4", + "route_weight_sha256": "6b65f42a3a57f687947f48955a207a8e9e2cd5d562e216a410634ac7712421e1", + "loads": [ + 11, + 11, + 14, + 7, + 17, + 3, + 7, + 1, + 16, + 7, + 10, + 12, + 6, + 13, + 3, + 16, + 13, + 19, + 14, + 16, + 12, + 13, + 14, + 14, + 13, + 5, + 11, + 11, + 10, + 3, + 6, + 21, + 7, + 38, + 24, + 14, + 13, + 1, + 13, + 7, + 28, + 38, + 8, + 27, + 16, + 6, + 12, + 14, + 12, + 19, + 17, + 10, + 18, + 1, + 6, + 17, + 6, + 9, + 9, + 22, + 28, + 16, + 23, + 0 + ], + "weighted_loads": [ + 0.6211899928748608, + 0.5587047897279263, + 0.9562385343015194, + 0.3082200363278389, + 1.0501250997185707, + 0.16592884808778763, + 0.4863918498158455, + 0.10678078234195709, + 1.0840371884405613, + 0.2323538102209568, + 0.47919739969074726, + 0.5291718281805515, + 0.22058606892824173, + 0.8929971344769001, + 0.09772587567567825, + 0.7999253645539284, + 0.9349433518946171, + 0.7477057678624988, + 1.3374889194965363, + 0.8631018064916134, + 0.7743725590407848, + 0.9584144353866577, + 0.7562132123857737, + 0.8706698268651962, + 0.5599810779094696, + 0.2973279841244221, + 0.5164121836423874, + 0.5122076719999313, + 0.6514872461557388, + 0.16562259942293167, + 0.29325506649911404, + 2.028781022876501, + 0.2803567573428154, + 2.872825402766466, + 1.7127686366438866, + 1.1328924857079983, + 0.9142251424491405, + 0.028064506128430367, + 0.5946672484278679, + 0.295530341565609, + 2.0636861510574818, + 2.439962200820446, + 0.3790030237287283, + 2.2456631176173687, + 1.861964400857687, + 0.22676950320601463, + 0.7267626505345106, + 0.980003897100687, + 0.6694601029157639, + 1.4901786856353283, + 1.0478205531835556, + 1.1337203979492188, + 1.1796673983335495, + 0.054990898817777634, + 0.3325299955904484, + 0.7540313377976418, + 0.3639419972896576, + 0.407573439180851, + 0.3921099528670311, + 1.9476002641022205, + 1.5108624082058668, + 0.8778533395379782, + 1.3040953800082207, + 0.0 + ], + "unique_experts": 63, + "load_cv": 0.6073714604896193, + "normalized_load_entropy": 0.9551652151346316, + "max_load_share": 0.04589371980676329 + } + }, + "s1_x": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "6cbc980b05a93480e85caa58c658bf3a9d13b5806c55778687f0b19ccf410dc8", + "route_weight_sha256": "8477abe511bba319d88bfdb89a95c7b03e0aa120a2822402c6b57e8decb68a47", + "loads": [ + 10, + 10, + 13, + 5, + 15, + 3, + 7, + 1, + 12, + 8, + 7, + 9, + 6, + 13, + 3, + 11, + 8, + 14, + 2, + 16, + 14, + 14, + 14, + 9, + 14, + 4, + 11, + 10, + 4, + 2, + 0, + 13, + 6, + 35, + 21, + 12, + 13, + 0, + 11, + 7, + 24, + 38, + 8, + 5, + 13, + 5, + 13, + 7, + 11, + 15, + 17, + 9, + 19, + 1, + 1, + 11, + 5, + 8, + 5, + 21, + 28, + 12, + 15, + 0 + ], + "weighted_loads": [ + 0.5925728157162666, + 0.5181953758001328, + 0.8845669068396091, + 0.2173255980014801, + 0.9056285973638296, + 0.1608944572508335, + 0.48650482669472694, + 0.10152118653059006, + 0.8300282247364521, + 0.28984787687659264, + 0.37854788452386856, + 0.4417881853878498, + 0.20925897918641567, + 0.9081636518239975, + 0.10414297133684158, + 0.6271641813218594, + 0.36601391434669495, + 0.5593294445425272, + 0.07298365980386734, + 0.8900920003652573, + 0.8383970055729151, + 0.9816505387425423, + 0.7629358060657978, + 0.6165577061474323, + 0.5865098014473915, + 0.19172901660203934, + 0.526233471930027, + 0.49856559559702873, + 0.2178131751716137, + 0.09536127373576164, + 0.0, + 1.6057534217834473, + 0.2541215531527996, + 2.6428430695086718, + 1.47799489274621, + 0.8921046480536461, + 0.8850981332361698, + 0.0, + 0.5119662061333656, + 0.28707359731197357, + 1.8044634908437729, + 2.401093700900674, + 0.3722533565014601, + 0.20903225243091583, + 1.6924617886543274, + 0.19410912692546844, + 0.7612072862684727, + 0.41899893805384636, + 0.6393488645553589, + 1.3179655484855175, + 1.0195659026503563, + 1.0221534259617329, + 1.2007658518850803, + 0.030308814719319344, + 0.03886999562382698, + 0.48910312727093697, + 0.32637402042746544, + 0.38787636533379555, + 0.1985812932252884, + 1.8975756205618382, + 1.4601828008890152, + 0.6804357431828976, + 0.832637645304203, + 0.0 + ], + "unique_experts": 61, + "load_cv": 0.707319027192558, + "normalized_load_entropy": 0.9404385468912055, + "max_load_share": 0.05604719764011799 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "2ef585644a598e931cb44abed915ea7c2f2d3da9aa7ac0fb7d2d7e25ea5cb1e7", + "route_weight_sha256": "ffe21da33a663d56932f054a56d1b71b09df9baa775121995b1602aae698df2e", + "loads": [ + 12, + 11, + 14, + 5, + 26, + 7, + 7, + 3, + 22, + 8, + 10, + 11, + 6, + 13, + 3, + 12, + 24, + 15, + 13, + 17, + 15, + 15, + 16, + 14, + 14, + 6, + 13, + 13, + 14, + 2, + 8, + 21, + 6, + 35, + 26, + 17, + 13, + 0, + 11, + 8, + 30, + 38, + 8, + 32, + 15, + 5, + 14, + 19, + 11, + 20, + 17, + 10, + 19, + 7, + 21, + 23, + 11, + 9, + 8, + 24, + 29, + 20, + 27, + 1 + ], + "weighted_loads": [ + 0.7407197505235672, + 0.5508103296160698, + 0.9335609711706638, + 0.2173255980014801, + 1.4869425613433123, + 0.2982162982225418, + 0.48650482669472694, + 0.2309606671333313, + 1.4580900333821774, + 0.28984787687659264, + 0.4877178706228733, + 0.4835559129714966, + 0.20925897918641567, + 0.9081636518239975, + 0.10414297133684158, + 0.6669837310910225, + 1.8953743316233158, + 0.5741696758195758, + 1.308908835053444, + 0.9287134781479836, + 0.9116865564137697, + 1.0532355606555939, + 0.8722040951251984, + 0.8385157212615013, + 0.5865098014473915, + 0.2891796790063381, + 0.6015927977859974, + 0.5946205221116543, + 0.9683920927345753, + 0.09536127373576164, + 0.40727002918720245, + 1.962897788733244, + 0.2541215531527996, + 2.6428430695086718, + 1.7253931164741516, + 1.3612329363822937, + 0.8850981332361698, + 0.0, + 0.5119662061333656, + 0.334029421210289, + 2.089325789362192, + 2.401093700900674, + 0.3722533565014601, + 2.535295072942972, + 1.8263825848698616, + 0.19410912692546844, + 0.8075469434261322, + 1.3648945204913616, + 0.6393488645553589, + 1.6211680807173252, + 1.0195659026503563, + 1.1164102964103222, + 1.2007658518850803, + 0.38556049205362797, + 1.2280321065336466, + 1.068705789744854, + 0.7958460003137589, + 0.4303796701133251, + 0.34738441929221153, + 2.0226555801928043, + 1.4986608065664768, + 1.0400626547634602, + 1.4582385942339897, + 0.04126733914017677 + ], + "unique_experts": 63, + "load_cv": 0.5752039782319853, + "normalized_load_entropy": 0.9590129184150138, + "max_load_share": 0.04112554112554113 + } + }, + "s0_period": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "b174ed5264d3ad98178de0cb36a6486c83d92d7dfa91865b64f4d03ff9ce88b0", + "route_weight_sha256": "33202c0f7a9128aeaeaac32e02c7615187dd256800068600690e5741f44e4c29", + "loads": [ + 11, + 10, + 13, + 7, + 12, + 4, + 7, + 1, + 12, + 6, + 8, + 9, + 6, + 14, + 4, + 9, + 9, + 16, + 2, + 16, + 13, + 13, + 14, + 9, + 13, + 3, + 11, + 10, + 4, + 3, + 0, + 13, + 5, + 38, + 21, + 11, + 13, + 1, + 11, + 7, + 23, + 38, + 8, + 4, + 13, + 6, + 12, + 6, + 12, + 15, + 17, + 10, + 18, + 0, + 2, + 11, + 7, + 9, + 5, + 21, + 27, + 11, + 14, + 0 + ], + "weighted_loads": [ + 0.6295146010816097, + 0.5322942696511745, + 0.9075727835297585, + 0.3079010471701622, + 0.8064866475760937, + 0.20023801922798157, + 0.48873908817768097, + 0.10792254656553268, + 0.8293855860829353, + 0.20564362592995167, + 0.4130053836852312, + 0.44716233387589455, + 0.2306545339524746, + 0.9308472461998463, + 0.13221820443868637, + 0.5488264299929142, + 0.44131555408239365, + 0.6629244163632393, + 0.07395383343100548, + 0.877803735435009, + 0.8064561169594526, + 0.9540336020290852, + 0.7495289146900177, + 0.6255721971392632, + 0.5613407716155052, + 0.17691030353307724, + 0.5160289276391268, + 0.5055701732635498, + 0.2305285558104515, + 0.16703401319682598, + 0.0, + 1.6729280464351177, + 0.21720993891358376, + 2.899369541555643, + 1.5547941122204065, + 0.874333668500185, + 0.9201184809207916, + 0.027470020577311516, + 0.4950843118131161, + 0.3025183789432049, + 1.7912229150533676, + 2.4413328245282173, + 0.38143029622733593, + 0.19528904557228088, + 1.6955513134598732, + 0.22563230618834496, + 0.7160047106444836, + 0.3806154653429985, + 0.6704379022121429, + 1.2967489063739777, + 1.0473088938742876, + 1.067965367808938, + 1.182692687958479, + 0.0, + 0.08202117308974266, + 0.4944794028997421, + 0.40382178500294685, + 0.4178829751908779, + 0.19532708451151848, + 1.8981103859841824, + 1.4657943975180387, + 0.650032177567482, + 0.7735214587301016, + 0.0 + ], + "unique_experts": 61, + "load_cv": 0.7063341599117122, + "normalized_load_entropy": 0.9422480714791959, + "max_load_share": 0.05604719764011799 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "88aa31b0a54aa7ab46372381a0f2e4ae330c6b5be01867b65b26618d26a24291", + "route_weight_sha256": "b6dca97034d53695599191769b8eb9ebf8a52af263b1975d20ff2f727cd200af", + "loads": [ + 11, + 11, + 14, + 7, + 17, + 4, + 7, + 1, + 16, + 8, + 10, + 11, + 6, + 14, + 4, + 16, + 14, + 17, + 14, + 16, + 13, + 13, + 14, + 14, + 13, + 4, + 11, + 11, + 11, + 3, + 6, + 21, + 7, + 38, + 25, + 15, + 13, + 1, + 11, + 7, + 28, + 38, + 8, + 26, + 16, + 6, + 12, + 14, + 12, + 18, + 17, + 11, + 18, + 0, + 7, + 18, + 7, + 9, + 8, + 22, + 27, + 16, + 21, + 0 + ], + "weighted_loads": [ + 0.6295146010816097, + 0.565631777048111, + 0.9662993811070919, + 0.3079010471701622, + 1.089486837387085, + 0.20023801922798157, + 0.48873908817768097, + 0.10792254656553268, + 1.0841064117848873, + 0.2637531291693449, + 0.480482729151845, + 0.4889662526547909, + 0.2306545339524746, + 0.9308472461998463, + 0.13221820443868637, + 0.8180275112390518, + 0.974370252341032, + 0.6777646476402879, + 1.2889812402427197, + 0.877803735435009, + 0.8064561169594526, + 0.9540336020290852, + 0.7495289146900177, + 0.8761343918740749, + 0.5613407716155052, + 0.2755681052803993, + 0.5160289276391268, + 0.5181701332330704, + 0.6887643337249756, + 0.16703401319682598, + 0.29325506649911404, + 2.0326428562402725, + 0.2843897081911564, + 2.899369541555643, + 1.7279823627322912, + 1.3281249441206455, + 0.9201184809207916, + 0.027470020577311516, + 0.4950843118131161, + 0.3025183789432049, + 2.07673666626215, + 2.4413328245282173, + 0.38143029622733593, + 2.2807490304112434, + 1.8590219356119633, + 0.22563230618834496, + 0.7160047106444836, + 0.977271493524313, + 0.6704379022121429, + 1.4431194812059402, + 1.0473088938742876, + 1.175639333203435, + 1.182692687958479, + 0.0, + 0.37334034591913223, + 0.7774162888526917, + 0.40382178500294685, + 0.4178829751908779, + 0.3324603773653507, + 1.9328538104891777, + 1.4657943975180387, + 0.8897001463919878, + 1.2180621679872274, + 0.0 + ], + "unique_experts": 62, + "load_cv": 0.5985466306254812, + "normalized_load_entropy": 0.955774914522417, + "max_load_share": 0.04589371980676329 + } + }, + "s1_period": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "2a3ef638ec3210c7f4df23b1bd5944952ebda35dd91108d6e6dd0234a17d04e9", + "route_weight_sha256": "4135825c86e3340a42373aafda6a4fb91c87aef3ca2ba2f9fd4a454b56a682d4", + "loads": [ + 9, + 10, + 12, + 8, + 13, + 3, + 7, + 1, + 12, + 9, + 8, + 10, + 6, + 13, + 3, + 9, + 7, + 17, + 2, + 16, + 13, + 14, + 14, + 9, + 12, + 4, + 12, + 10, + 4, + 1, + 0, + 13, + 6, + 36, + 21, + 12, + 13, + 2, + 11, + 7, + 23, + 38, + 8, + 4, + 13, + 5, + 12, + 6, + 11, + 16, + 17, + 9, + 19, + 1, + 1, + 12, + 6, + 10, + 5, + 21, + 27, + 12, + 13, + 0 + ], + "weighted_loads": [ + 0.5556900203227997, + 0.5307380743324757, + 0.8527499139308929, + 0.33831632509827614, + 0.8226642236113548, + 0.16572869569063187, + 0.489840492606163, + 0.10197113454341888, + 0.8070897497236729, + 0.322220241650939, + 0.4139496125280857, + 0.46555691212415695, + 0.22684443555772305, + 0.9127850420773029, + 0.10700182989239693, + 0.5159173160791397, + 0.2836859002709389, + 0.6947874091565609, + 0.07365021109580994, + 0.8830431662499905, + 0.7936155013740063, + 0.9865601360797882, + 0.7602238655090332, + 0.6199735775589943, + 0.5084847956895828, + 0.2042996920645237, + 0.5601714979857206, + 0.4952588491141796, + 0.2295980006456375, + 0.09158666431903839, + 0.0, + 1.619466945528984, + 0.259360171854496, + 2.6856942251324654, + 1.4905980359762907, + 0.89401501044631, + 0.8896935880184174, + 0.06271449103951454, + 0.514339517802, + 0.2903916295617819, + 1.762776918709278, + 2.3702822849154472, + 0.3718568067997694, + 0.1627865470945835, + 1.6775860115885735, + 0.19935031607747078, + 0.7184760868549347, + 0.3817961812019348, + 0.6419241167604923, + 1.3620765767991543, + 1.0306035168468952, + 1.0140501596033573, + 1.2044063117355108, + 0.03021560050547123, + 0.03655866160988808, + 0.5277777202427387, + 0.36458177492022514, + 0.473614651709795, + 0.1980956606566906, + 1.8906424678862095, + 1.4329523611813784, + 0.6710715834051371, + 0.7186887599527836, + 0.0 + ], + "unique_experts": 62, + "load_cv": 0.7013890800447158, + "normalized_load_entropy": 0.9424055019025245, + "max_load_share": 0.05604719764011799 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "86c7d727528331af660efa6c3f6297b4403daa903d67952d523a65e6ff93785c", + "route_weight_sha256": "426a6ba49f043cdef414947ef75efcc306768b581d18962db8d4ebb401194299", + "loads": [ + 11, + 11, + 13, + 8, + 25, + 8, + 7, + 3, + 22, + 9, + 11, + 12, + 6, + 13, + 4, + 12, + 23, + 18, + 12, + 17, + 14, + 15, + 16, + 14, + 12, + 6, + 14, + 12, + 15, + 1, + 9, + 20, + 6, + 36, + 26, + 18, + 13, + 2, + 11, + 8, + 29, + 38, + 8, + 31, + 15, + 5, + 13, + 19, + 11, + 20, + 17, + 10, + 19, + 6, + 20, + 24, + 12, + 11, + 7, + 24, + 28, + 20, + 23, + 1 + ], + "weighted_loads": [ + 0.7038369551301003, + 0.5633530281484127, + 0.9017439782619476, + 0.33831632509827614, + 1.471376944333315, + 0.3454647697508335, + 0.489840492606163, + 0.23141061514616013, + 1.4234895668923855, + 0.322220241650939, + 0.5231195986270905, + 0.5073246397078037, + 0.22684443555772305, + 0.9127850420773029, + 0.14662592858076096, + 0.6217728145420551, + 1.8302983343601227, + 0.7096276404336095, + 1.2327520102262497, + 0.9216646440327168, + 0.8669050522148609, + 1.0581451579928398, + 0.8694921545684338, + 0.8419315926730633, + 0.5084847956895828, + 0.3124408572912216, + 0.635530823841691, + 0.5471305139362812, + 1.0435160174965858, + 0.09158666431903839, + 0.4459274262189865, + 1.9269155636429787, + 0.259360171854496, + 2.6856942251324654, + 1.7255863789469004, + 1.4595856070518494, + 0.8896935880184174, + 0.06271449103951454, + 0.514339517802, + 0.3373474534600973, + 2.03605598770082, + 2.3702822849154472, + 0.3718568067997694, + 2.5260899364948273, + 1.8115068078041077, + 0.19935031607747078, + 0.7648157440125942, + 1.3682925775647163, + 0.6419241167604923, + 1.6207167617976665, + 1.0306035168468952, + 1.1198958493769169, + 1.2044063117355108, + 0.33291097171604633, + 1.180562112480402, + 1.088582582771778, + 0.8340537548065186, + 0.5161179564893246, + 0.29993240535259247, + 2.0157224275171757, + 1.47143036685884, + 1.0307829808443785, + 1.2401459030807018, + 0.04126733914017677 + ], + "unique_experts": 64, + "load_cv": 0.5563907441897383, + "normalized_load_entropy": 0.9623015909055022, + "max_load_share": 0.04112554112554113 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 113, + "ordered_topk_exact_tokens": 87, + "set_exact_tokens": 96, + "mean_set_jaccard": 0.9570164348925411, + "mean_token_weighted_tv": 0.009713162635082165, + "aggregate_load_tv": 0.022123893805309734 + }, + "system_bos": { + "tokens": 113, + "ordered_topk_exact_tokens": 72, + "set_exact_tokens": 88, + "mean_set_jaccard": 0.9329962073324906, + "mean_token_weighted_tv": 0.014820935699132691, + "aggregate_load_tv": 0.025073746312684365 + }, + "system_x": { + "tokens": 113, + "ordered_topk_exact_tokens": 59, + "set_exact_tokens": 77, + "mean_set_jaccard": 0.9051833122629583, + "mean_token_weighted_tv": 0.021395493933387036, + "aggregate_load_tv": 0.029498525073746312 + }, + "system_period": { + "tokens": 113, + "ordered_topk_exact_tokens": 59, + "set_exact_tokens": 81, + "mean_set_jaccard": 0.9152970922882427, + "mean_token_weighted_tv": 0.020186524541504616, + "aggregate_load_tv": 0.028023598820058997 + }, + "bos_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 69, + "set_exact_tokens": 81, + "mean_set_jaccard": 0.9152970922882427, + "mean_token_weighted_tv": 0.017576645944366413, + "aggregate_load_tv": 0.028023598820058997 + }, + "bos_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 59, + "set_exact_tokens": 72, + "mean_set_jaccard": 0.8963337547408345, + "mean_token_weighted_tv": 0.02078397147588234, + "aggregate_load_tv": 0.032448377581120944 + }, + "x_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 65, + "set_exact_tokens": 79, + "mean_set_jaccard": 0.9121365360303413, + "mean_token_weighted_tv": 0.01851332677215074, + "aggregate_load_tv": 0.032448377581120944 + }, + "x_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 55, + "set_exact_tokens": 67, + "mean_set_jaccard": 0.8817951959544881, + "mean_token_weighted_tv": 0.024432140542606336, + "aggregate_load_tv": 0.04277286135693216 + }, + "period_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 64, + "set_exact_tokens": 80, + "mean_set_jaccard": 0.9146649810366625, + "mean_token_weighted_tv": 0.01817645797654327, + "aggregate_load_tv": 0.03392330383480826 + }, + "period_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 47, + "set_exact_tokens": 64, + "mean_set_jaccard": 0.8761061946902655, + "mean_token_weighted_tv": 0.024457289070814056, + "aggregate_load_tv": 0.038348082595870206 + } + } + }, + "layer_12": { + "layer": 12, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "29c0fb37fa7e43ea554d40a9bfa082131cefd6ee71acce789cd13e19cd479856", + "route_weight_sha256": "86d6fc5f95154c14fda0172e92e543772038cda8bd58f6f2b8c7157b3a1b3da5", + "loads": [ + 9, + 13, + 6, + 10, + 11, + 3, + 0, + 10, + 7, + 1, + 0, + 16, + 16, + 19, + 31, + 1, + 23, + 5, + 11, + 47, + 9, + 16, + 19, + 7, + 10, + 10, + 9, + 5, + 7, + 7, + 1, + 18, + 2, + 16, + 6, + 0, + 25, + 11, + 11, + 11, + 3, + 1, + 5, + 15, + 40, + 10, + 10, + 12, + 18, + 2, + 13, + 5, + 22, + 6, + 11, + 3, + 15, + 7, + 0, + 9, + 5, + 14, + 8, + 5 + ], + "weighted_loads": [ + 0.5357415042817593, + 0.8064684588462114, + 0.23847866989672184, + 0.7131032235920429, + 0.7378521859645844, + 0.12464231997728348, + 0.0, + 0.5870099924504757, + 0.32218915969133377, + 0.11419637501239777, + 0.0, + 1.030076127499342, + 1.2591290138661861, + 1.0840373411774635, + 1.9370010420680046, + 0.04442603513598442, + 1.5256754606962204, + 0.3344622850418091, + 0.5848332606256008, + 2.5331476610153913, + 0.54406981728971, + 1.1042860969901085, + 1.5292658768594265, + 0.5448596216738224, + 0.4845541641116142, + 0.6966162249445915, + 0.5522351488471031, + 0.22648689895868301, + 0.5282237604260445, + 0.4122467674314976, + 0.03901141509413719, + 1.4208157025277615, + 0.07563943788409233, + 1.5221850760281086, + 0.43545572087168694, + 0.0, + 1.3580692000687122, + 0.8924253284931183, + 0.8872969169169664, + 0.6507806852459908, + 0.1047336682677269, + 0.06124860793352127, + 0.20182431116700172, + 1.3250801973044872, + 2.9059934355318546, + 0.7095184661448002, + 0.5977438390254974, + 0.6491967737674713, + 1.0799640379846096, + 0.08096171170473099, + 1.2058640290051699, + 0.34632252529263496, + 1.6823630183935165, + 0.37062517926096916, + 1.0904815830290318, + 0.13527879118919373, + 1.0448884814977646, + 0.3603721000254154, + 0.0, + 0.5778870172798634, + 0.2566861920058727, + 1.0734401419758797, + 0.6889595575630665, + 0.23086999729275703 + ], + "unique_experts": 60, + "load_cv": 0.8346310411559059, + "normalized_load_entropy": 0.923100604961383, + "max_load_share": 0.06932153392330384 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "9d20f197012e411d34cdd2e7b7115c863b054db7d4a4b3cc247d9115671936ff", + "route_weight_sha256": "85c6fdb3bd32799f0f361b1036f4cd96789bbb580b12cdfa6c5c4ce56c555025", + "loads": [ + 9, + 13, + 6, + 15, + 16, + 4, + 0, + 13, + 13, + 1, + 0, + 16, + 21, + 20, + 31, + 1, + 24, + 5, + 11, + 47, + 10, + 16, + 20, + 12, + 10, + 10, + 10, + 12, + 22, + 17, + 3, + 23, + 3, + 18, + 6, + 7, + 25, + 15, + 25, + 11, + 3, + 8, + 12, + 15, + 42, + 11, + 11, + 17, + 23, + 2, + 14, + 5, + 22, + 6, + 11, + 3, + 18, + 7, + 0, + 12, + 5, + 19, + 13, + 8 + ], + "weighted_loads": [ + 0.5357415042817593, + 0.8064684588462114, + 0.23847866989672184, + 0.8388375865761191, + 2.38627970777452, + 0.12871320126578212, + 0.0, + 0.789154626429081, + 0.6992990169674158, + 0.11419637501239777, + 0.0, + 1.030076127499342, + 1.493634656071663, + 1.1978077366948128, + 1.9370010420680046, + 0.04442603513598442, + 1.5639901384711266, + 0.3344622850418091, + 0.5848332606256008, + 2.5331476610153913, + 0.5463824949692935, + 1.1042860969901085, + 1.5793804563581944, + 0.9978060908615589, + 0.4845541641116142, + 0.6966162249445915, + 0.5849483236670494, + 0.6231987327337265, + 2.4720663242042065, + 1.798696968704462, + 0.10302337259054184, + 1.7164225168526173, + 0.12183145433664322, + 1.612506315112114, + 0.43545572087168694, + 0.4992538057267666, + 1.3580692000687122, + 1.0064331218600273, + 2.045182505622506, + 0.6507806852459908, + 0.1047336682677269, + 0.6744534596800804, + 0.63824313133955, + 1.3250801973044872, + 3.0269056372344494, + 0.7491656094789505, + 0.6449755541980267, + 0.9590609762817621, + 1.4056693129241467, + 0.08096171170473099, + 1.2188035417348146, + 0.34632252529263496, + 1.6823630183935165, + 0.37062517926096916, + 1.0904815830290318, + 0.13527879118919373, + 1.150759382173419, + 0.3603721000254154, + 0.0, + 0.6718954890966415, + 0.2566861920058727, + 1.2621940113604069, + 0.885124709457159, + 0.32767594791948795 + ], + "unique_experts": 61, + "load_cv": 0.706421604035699, + "normalized_load_entropy": 0.9397475530066529, + "max_load_share": 0.05676328502415459 + } + }, + "s1_eos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "7a9925b6e54ce602792c38d5b68e8a2378ef566899be2a4c606353818840dca0", + "route_weight_sha256": "c333c348fd02c640767069b186aa6f2d4433b506d247486c9f257102fe492e23", + "loads": [ + 9, + 13, + 5, + 11, + 13, + 2, + 0, + 10, + 6, + 1, + 0, + 15, + 16, + 19, + 32, + 2, + 21, + 5, + 9, + 49, + 8, + 16, + 21, + 7, + 10, + 10, + 9, + 5, + 6, + 7, + 1, + 18, + 2, + 16, + 8, + 0, + 24, + 11, + 12, + 11, + 2, + 1, + 6, + 16, + 40, + 10, + 9, + 12, + 17, + 3, + 13, + 5, + 23, + 6, + 12, + 3, + 14, + 5, + 0, + 10, + 5, + 13, + 8, + 5 + ], + "weighted_loads": [ + 0.5263665206730366, + 0.8076748009771109, + 0.21193350851535797, + 0.7593868672847748, + 0.8185937162488699, + 0.09060166776180267, + 0.0, + 0.5778435319662094, + 0.2895127981901169, + 0.11026296764612198, + 0.0, + 1.0082545541226864, + 1.2909435145556927, + 1.0945056043565273, + 2.0116617809981108, + 0.08818885684013367, + 1.4216446448117495, + 0.3318910263478756, + 0.4884674735367298, + 2.652706377208233, + 0.5065485276281834, + 1.1120357438921928, + 1.590404575690627, + 0.5620597824454308, + 0.47473038733005524, + 0.6987662203609943, + 0.5464760400354862, + 0.22251015156507492, + 0.48850272968411446, + 0.4012641739100218, + 0.03616056963801384, + 1.4082864373922348, + 0.07530347257852554, + 1.5113048665225506, + 0.5099315140396357, + 0.0, + 1.317143065854907, + 0.8857209496200085, + 0.9502529446035624, + 0.6526476107537746, + 0.07094304263591766, + 0.061246052384376526, + 0.23813223093748093, + 1.3449102975428104, + 2.8618911132216454, + 0.7091214023530483, + 0.5461713187396526, + 0.6503757890313864, + 1.0097112320363522, + 0.11546854302287102, + 1.1822410356253386, + 0.34815720841288567, + 1.7266172282397747, + 0.37138646468520164, + 1.135619580745697, + 0.13538912683725357, + 1.0142537243664265, + 0.2949011102318764, + 0.0, + 0.6192819662392139, + 0.25346317887306213, + 1.044501319527626, + 0.6914819367229939, + 0.22793859243392944 + ], + "unique_experts": 60, + "load_cv": 0.8500029559896943, + "normalized_load_entropy": 0.9215809708279931, + "max_load_share": 0.07227138643067847 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "f7d88e26d9d7d3af5fc18ad81fbf5b40ab71e771c3ea72374e795fe0c85d0691", + "route_weight_sha256": "22c2b1d6ce1ec4569f42cf7c35f71cfa8d44d76da17ca1fc21943ac8cb9afe34", + "loads": [ + 13, + 13, + 5, + 14, + 17, + 3, + 0, + 17, + 13, + 4, + 1, + 15, + 20, + 20, + 32, + 2, + 24, + 7, + 10, + 49, + 9, + 18, + 23, + 13, + 10, + 10, + 12, + 12, + 23, + 22, + 12, + 23, + 6, + 21, + 13, + 7, + 24, + 15, + 30, + 11, + 2, + 14, + 15, + 18, + 53, + 14, + 12, + 19, + 25, + 3, + 15, + 5, + 23, + 9, + 12, + 3, + 17, + 11, + 0, + 14, + 7, + 22, + 13, + 5 + ], + "weighted_loads": [ + 0.7181279435753822, + 0.8076748009771109, + 0.21193350851535797, + 0.8157149995677173, + 2.442134914919734, + 0.09454396227374673, + 0.0, + 0.9581753388047218, + 0.8038387075066566, + 0.42916812002658844, + 0.04140305519104004, + 1.0082545541226864, + 1.4665378890931606, + 1.203286100178957, + 2.0116617809981108, + 0.08818885684013367, + 1.6162689793854952, + 0.44406668096780777, + 0.5241948589682579, + 2.652706377208233, + 0.5088803181424737, + 1.2023907601833344, + 1.6773347724229097, + 1.0274771936237812, + 0.47473038733005524, + 0.6987662203609943, + 0.6687186323106289, + 0.5788014493882656, + 2.7197862789034843, + 2.5797007512301207, + 0.8965141512453556, + 1.6974993590265512, + 0.2526818569749594, + 1.8047632239758968, + 0.7658211644738913, + 0.5671764742583036, + 1.317143065854907, + 1.0588112939149141, + 2.3901180643588305, + 0.6526476107537746, + 0.07094304263591766, + 1.1747115962207317, + 0.7725125625729561, + 1.4535880535840988, + 4.076430566608906, + 1.0175308547914028, + 0.6796662248671055, + 1.04811230301857, + 1.4509273767471313, + 0.11546854302287102, + 1.2486938554793596, + 0.34815720841288567, + 1.7266172282397747, + 0.524515688419342, + 1.135619580745697, + 0.13538912683725357, + 1.092778808902949, + 0.5482664946466684, + 0.0, + 0.7419991195201874, + 0.32293055579066277, + 1.4813333041965961, + 0.9082169607281685, + 0.22793859243392944 + ], + "unique_experts": 62, + "load_cv": 0.6819384213362346, + "normalized_load_entropy": 0.9459610491333871, + "max_load_share": 0.05735930735930736 + } + }, + "s0_bos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "c976d53a25d4f1db37f0ec6c2475d652ef064942ae4de9d4a0ab6c0c74ae00fe", + "route_weight_sha256": "855ac0eb9c8366fd846f32d20838d950f6d7b86f8af89a2ee7fc1b3eba3b513b", + "loads": [ + 8, + 13, + 6, + 10, + 13, + 2, + 0, + 10, + 6, + 1, + 0, + 16, + 16, + 19, + 30, + 1, + 23, + 5, + 9, + 47, + 8, + 15, + 21, + 6, + 10, + 9, + 8, + 6, + 6, + 8, + 1, + 18, + 2, + 17, + 6, + 0, + 25, + 10, + 11, + 11, + 3, + 2, + 4, + 15, + 40, + 10, + 10, + 12, + 19, + 2, + 13, + 5, + 23, + 6, + 12, + 3, + 16, + 7, + 0, + 11, + 5, + 13, + 9, + 5 + ], + "weighted_loads": [ + 0.4829664006829262, + 0.7929439339786768, + 0.2515803687274456, + 0.7095599584281445, + 0.7753945849835873, + 0.09008025750517845, + 0.0, + 0.5931533873081207, + 0.28662750124931335, + 0.11626743525266647, + 0.0, + 1.0702445469796658, + 1.265392404049635, + 1.0860624350607395, + 1.9605130683630705, + 0.046906035393476486, + 1.5157247725874186, + 0.3272602967917919, + 0.4931623041629791, + 2.6713525503873825, + 0.533463642001152, + 1.04964330047369, + 1.5892851520329714, + 0.5349779389798641, + 0.4984627962112427, + 0.618782889097929, + 0.5245230682194233, + 0.26548123359680176, + 0.49175725504755974, + 0.4334730748087168, + 0.03484668955206871, + 1.4154449552297592, + 0.07692350819706917, + 1.5265985541045666, + 0.43510641157627106, + 0.0, + 1.3706445302814245, + 0.8434591107070446, + 0.8900297582149506, + 0.6627661660313606, + 0.09888025373220444, + 0.10266099870204926, + 0.166059672832489, + 1.3340594042092562, + 2.953882407397032, + 0.7411278039216995, + 0.5992005132138729, + 0.6463015042245388, + 1.132204683497548, + 0.07987247407436371, + 1.150755012407899, + 0.3608834743499756, + 1.7186584621667862, + 0.35311318933963776, + 1.1295583695173264, + 0.1378878466784954, + 1.062019843608141, + 0.3568437024950981, + 0.0, + 0.6396057121455669, + 0.263215322047472, + 1.0372744128108025, + 0.7252273634076118, + 0.23062092438340187 + ], + "unique_experts": 60, + "load_cv": 0.8412770417790623, + "normalized_load_entropy": 0.9218900875397107, + "max_load_share": 0.06932153392330384 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "8d597437b0f2b08c3cf5691ce49385a720a34257ce4647e564d13d286625f07c", + "route_weight_sha256": "32b4ae506cbf5b0a2cdb291135b3a320c23f269511cfaf5ce29b79b5f2c652ad", + "loads": [ + 8, + 13, + 6, + 14, + 17, + 2, + 0, + 13, + 12, + 1, + 0, + 16, + 22, + 20, + 30, + 1, + 27, + 5, + 9, + 47, + 8, + 15, + 22, + 11, + 10, + 9, + 10, + 13, + 22, + 18, + 3, + 24, + 3, + 19, + 6, + 7, + 25, + 14, + 25, + 11, + 3, + 9, + 10, + 16, + 42, + 11, + 11, + 17, + 24, + 2, + 14, + 5, + 23, + 6, + 12, + 3, + 18, + 7, + 0, + 14, + 5, + 17, + 13, + 8 + ], + "weighted_loads": [ + 0.4829664006829262, + 0.7929439339786768, + 0.2515803687274456, + 0.8321964647620916, + 1.473428012803197, + 0.09008025750517845, + 0.0, + 0.8092033043503761, + 0.7054149862378836, + 0.11626743525266647, + 0.0, + 1.0702445469796658, + 1.5661859139800072, + 1.2011032663285732, + 1.9605130683630705, + 0.046906035393476486, + 1.667761953547597, + 0.3272602967917919, + 0.4931623041629791, + 2.6713525503873825, + 0.533463642001152, + 1.04964330047369, + 1.6393997315317392, + 0.9879244081676006, + 0.4984627962112427, + 0.618782889097929, + 0.5985338389873505, + 0.6621930673718452, + 2.4608830735087395, + 1.9364567827433348, + 0.09885864704847336, + 1.7712494917213917, + 0.12311552464962006, + 1.6229735389351845, + 0.43510641157627106, + 0.4992538057267666, + 1.3706445302814245, + 0.9574669040739536, + 2.11930163949728, + 0.6627661660313606, + 0.09888025373220444, + 0.738005917519331, + 0.5653178691864014, + 1.3685554545372725, + 3.0578346624970436, + 0.7807749472558498, + 0.6458702720701694, + 0.9627510663121939, + 1.4502253476530313, + 0.07987247407436371, + 1.1636945251375437, + 0.3608834743499756, + 1.7186584621667862, + 0.35311318933963776, + 1.1295583695173264, + 0.1378878466784954, + 1.163324585184455, + 0.3568437024950981, + 0.0, + 0.7833899892866611, + 0.263215322047472, + 1.1941842809319496, + 0.8725792765617371, + 0.3274268750101328 + ], + "unique_experts": 61, + "load_cv": 0.721717141986349, + "normalized_load_entropy": 0.9370560038760609, + "max_load_share": 0.05676328502415459 + } + }, + "s1_bos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "7c5ab3f797c5b0efd1e491f2d01dd5d50f7efe4c6df032a10371ca09daf90831", + "route_weight_sha256": "9785bfd90554d8a8a23edccdcf7816cdfe8a3c5af17c3e4041b0e43901c1cd2a", + "loads": [ + 8, + 12, + 6, + 11, + 12, + 3, + 0, + 10, + 6, + 1, + 0, + 16, + 17, + 21, + 33, + 1, + 23, + 5, + 9, + 47, + 8, + 15, + 20, + 6, + 10, + 9, + 7, + 6, + 6, + 8, + 1, + 18, + 2, + 17, + 8, + 0, + 24, + 12, + 11, + 12, + 2, + 2, + 6, + 14, + 42, + 10, + 9, + 11, + 17, + 2, + 10, + 5, + 24, + 5, + 10, + 2, + 15, + 7, + 0, + 10, + 6, + 13, + 10, + 5 + ], + "weighted_loads": [ + 0.5085743814706802, + 0.7450804766267538, + 0.25479090586304665, + 0.7423924505710602, + 0.7454900592565536, + 0.1268416941165924, + 0.0, + 0.5884980224072933, + 0.28783368319272995, + 0.11342049390077591, + 0.0, + 1.0720770806074142, + 1.32263595610857, + 1.2063946202397346, + 2.0670966003090143, + 0.04633001983165741, + 1.501122971996665, + 0.32667088881134987, + 0.5027615576982498, + 2.7258109021931887, + 0.5124705173075199, + 1.0421199351549149, + 1.5371148828417063, + 0.5279052555561066, + 0.49529625847935677, + 0.6199415177106857, + 0.467024851590395, + 0.26815587654709816, + 0.48007672280073166, + 0.4094683211296797, + 0.0356452502310276, + 1.4170307479798794, + 0.07264421880245209, + 1.5532790906727314, + 0.5009320136159658, + 0.0, + 1.3278051298111677, + 0.9409603998064995, + 0.9055472388863564, + 0.6951414868235588, + 0.06849686428904533, + 0.10994876176118851, + 0.2270665504038334, + 1.2644932940602303, + 3.0604846887290478, + 0.7546840235590935, + 0.5590806975960732, + 0.5922664366662502, + 1.040243737399578, + 0.08266220614314079, + 1.0197432450950146, + 0.3563765548169613, + 1.7590224221348763, + 0.32229161262512207, + 1.0566509552299976, + 0.0939803309738636, + 1.0538490191102028, + 0.3507418278604746, + 0.0, + 0.5978924594819546, + 0.2941114492714405, + 1.060418151319027, + 0.7902355566620827, + 0.22778641805052757 + ], + "unique_experts": 60, + "load_cv": 0.8576667630457507, + "normalized_load_entropy": 0.9204323153809469, + "max_load_share": 0.06932153392330384 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "b9e448ffd0bdb850221f3097cf0cf216d30772f3b8f42cda93ea2318a3f92ef4", + "route_weight_sha256": "62b9438fe700a9229863d7a1585e78088cfcf715d1b6ac30685ce25d13bea8b2", + "loads": [ + 12, + 12, + 6, + 13, + 15, + 3, + 0, + 17, + 13, + 4, + 1, + 16, + 22, + 22, + 33, + 1, + 27, + 7, + 10, + 47, + 8, + 17, + 22, + 12, + 10, + 9, + 10, + 13, + 23, + 25, + 12, + 24, + 6, + 22, + 13, + 7, + 24, + 16, + 29, + 12, + 2, + 15, + 14, + 17, + 55, + 14, + 12, + 18, + 26, + 2, + 12, + 5, + 24, + 8, + 10, + 2, + 17, + 13, + 0, + 14, + 8, + 21, + 15, + 5 + ], + "weighted_loads": [ + 0.7003358043730259, + 0.7450804766267538, + 0.25479090586304665, + 0.7957789022475481, + 1.4187076762318611, + 0.1268416941165924, + 0.0, + 0.9782759100198746, + 0.843581423163414, + 0.43232564628124237, + 0.04140305519104004, + 1.0720770806074142, + 1.575168427079916, + 1.3134738877415657, + 2.0670966003090143, + 0.04633001983165741, + 1.7455955278128386, + 0.43884654343128204, + 0.5384889431297779, + 2.7258109021931887, + 0.5124705173075199, + 1.1324749514460564, + 1.624045079573989, + 0.993322666734457, + 0.49529625847935677, + 0.6199415177106857, + 0.5892674438655376, + 0.6244471743702888, + 2.8323051892220974, + 2.818140434101224, + 0.8959988318383694, + 1.7428891006857157, + 0.2500226031988859, + 1.8494816944003105, + 0.7568216640502214, + 0.5671764742583036, + 1.3278051298111677, + 1.1140507441014051, + 2.4428738355636597, + 0.6951414868235588, + 0.06849686428904533, + 1.2428123652935028, + 0.7369703836739063, + 1.409114696085453, + 4.269410602748394, + 1.063093475997448, + 0.6913704797625542, + 1.0175145994871855, + 1.500811979174614, + 0.08266220614314079, + 1.0861960649490356, + 0.3563765548169613, + 1.7590224221348763, + 0.47542083635926247, + 1.0566509552299976, + 0.0939803309738636, + 1.1192634757608175, + 0.6041072122752666, + 0.0, + 0.7549643740057945, + 0.36357882618904114, + 1.4629860743880272, + 1.0069705806672573, + 0.22778641805052757 + ], + "unique_experts": 62, + "load_cv": 0.6995194146021492, + "normalized_load_entropy": 0.9428242877322466, + "max_load_share": 0.05952380952380952 + } + }, + "s0_x": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "183e979ac00ebc814149ff98dd9fada76280e8cb2916908dfff6d4259f6cf1c6", + "route_weight_sha256": "d0309467ad04172a05dc6db15197c82658df776fc22a6ac5d3505b019774e7a5", + "loads": [ + 9, + 10, + 8, + 10, + 12, + 2, + 0, + 10, + 6, + 1, + 0, + 16, + 17, + 20, + 36, + 1, + 22, + 5, + 10, + 50, + 8, + 16, + 20, + 6, + 9, + 9, + 9, + 6, + 6, + 7, + 1, + 18, + 2, + 16, + 7, + 0, + 24, + 12, + 11, + 13, + 3, + 2, + 5, + 14, + 41, + 10, + 10, + 11, + 18, + 2, + 13, + 5, + 22, + 5, + 11, + 3, + 15, + 5, + 0, + 9, + 4, + 13, + 7, + 5 + ], + "weighted_loads": [ + 0.5374045297503471, + 0.700346328318119, + 0.3218889385461807, + 0.7270379960536957, + 0.7492045573890209, + 0.08102023601531982, + 0.0, + 0.5892237611114979, + 0.28730081021785736, + 0.1100221648812294, + 0.0, + 1.0574853532016277, + 1.3001324087381363, + 1.1457719262689352, + 2.213483879342675, + 0.04675993695855141, + 1.499350594356656, + 0.3325493559241295, + 0.5383752696216106, + 2.777370249852538, + 0.5364935882389545, + 1.1108927987515926, + 1.5510372444987297, + 0.517455268651247, + 0.4651053063571453, + 0.6243381835520267, + 0.5394299551844597, + 0.26875995472073555, + 0.4750386755913496, + 0.3896345254033804, + 0.0326557494699955, + 1.4126248098909855, + 0.07903734594583511, + 1.4806113690137863, + 0.46487862430512905, + 0.0, + 1.3256340119987726, + 0.9341282173991203, + 0.8970401287078857, + 0.7399242632091045, + 0.0978911779820919, + 0.10544648766517639, + 0.20977137982845306, + 1.3279965184628963, + 2.985473047941923, + 0.734825175255537, + 0.6140298284590244, + 0.5873140692710876, + 1.109422691166401, + 0.07808035612106323, + 1.1763629540801048, + 0.3576078899204731, + 1.6754470467567444, + 0.32146144285798073, + 1.116877768188715, + 0.1370251066982746, + 1.0476959645748138, + 0.2928774990141392, + 0.0, + 0.5847729481756687, + 0.22610359638929367, + 1.04385831579566, + 0.6252852901816368, + 0.23490749672055244 + ], + "unique_experts": 60, + "load_cv": 0.8789917024222362, + "normalized_load_entropy": 0.9182481525609714, + "max_load_share": 0.07374631268436578 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "57c12d267b60dc2f7d4609e34038fdbda3e274fc93f26bf7c3f4774b6bc07557", + "route_weight_sha256": "027a9242c5865a0caadb1c844a6379e50befa95ab54bec3bf17e772b6cb396e9", + "loads": [ + 9, + 10, + 8, + 14, + 16, + 2, + 0, + 13, + 12, + 1, + 0, + 16, + 22, + 21, + 36, + 1, + 23, + 5, + 10, + 50, + 8, + 16, + 21, + 12, + 9, + 9, + 10, + 14, + 23, + 17, + 4, + 23, + 3, + 18, + 7, + 8, + 24, + 16, + 25, + 13, + 3, + 9, + 11, + 14, + 43, + 12, + 11, + 16, + 23, + 2, + 14, + 5, + 22, + 5, + 11, + 3, + 17, + 5, + 0, + 11, + 4, + 19, + 11, + 8 + ], + "weighted_loads": [ + 0.5374045297503471, + 0.700346328318119, + 0.3218889385461807, + 0.8496745023876429, + 1.4472379852086306, + 0.08102023601531982, + 0.0, + 0.8176232911646366, + 0.663960887119174, + 0.1100221648812294, + 0.0, + 1.0574853532016277, + 1.5330689698457718, + 1.243108144029975, + 2.213483879342675, + 0.04675993695855141, + 1.5445987228304148, + 0.3325493559241295, + 0.5383752696216106, + 2.777370249852538, + 0.5364935882389545, + 1.1108927987515926, + 1.6011518239974976, + 1.119993183761835, + 0.4651053063571453, + 0.6243381835520267, + 0.572143130004406, + 0.7226120121777058, + 2.653837548568845, + 1.5682258252054453, + 0.15083926543593407, + 1.7337057627737522, + 0.125229362398386, + 1.5785358101129532, + 0.46487862430512905, + 0.575243417173624, + 1.3256340119987726, + 1.0481360107660294, + 1.9753665924072266, + 0.7399242632091045, + 0.0978911779820919, + 0.7253800742328167, + 0.6048959791660309, + 1.3279965184628963, + 3.0792274065315723, + 0.8258559517562389, + 0.6608081944286823, + 0.879143325611949, + 1.4422212652862072, + 0.07808035612106323, + 1.1893024668097496, + 0.3576078899204731, + 1.6754470467567444, + 0.32146144285798073, + 1.116877768188715, + 0.1370251066982746, + 1.1490007061511278, + 0.2928774990141392, + 0.0, + 0.670352429151535, + 0.22610359638929367, + 1.3003366459161043, + 0.772637203335762, + 0.33171344734728336 + ], + "unique_experts": 61, + "load_cv": 0.742123962319415, + "normalized_load_entropy": 0.935577419609889, + "max_load_share": 0.06038647342995169 + } + }, + "s1_x": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "6efba095416b53ba175b97a8c3d71482b4e8cf23a3e0b4b166f111b5a9b9b299", + "route_weight_sha256": "7e9bb712513eada4bd2142d22345a93ce5b139a235231378ed89640ae4fe52b4", + "loads": [ + 8, + 10, + 6, + 11, + 14, + 2, + 0, + 10, + 6, + 2, + 0, + 16, + 17, + 21, + 36, + 1, + 20, + 5, + 9, + 48, + 8, + 15, + 20, + 6, + 9, + 9, + 8, + 6, + 6, + 6, + 1, + 18, + 2, + 17, + 8, + 0, + 23, + 12, + 11, + 11, + 2, + 2, + 6, + 14, + 42, + 10, + 9, + 14, + 17, + 2, + 12, + 5, + 24, + 5, + 10, + 2, + 16, + 7, + 0, + 9, + 6, + 13, + 8, + 5 + ], + "weighted_loads": [ + 0.49761252850294113, + 0.6724265627563, + 0.25459063798189163, + 0.7279746271669865, + 0.8188291862607002, + 0.08390000462532043, + 0.0, + 0.5865889862179756, + 0.28220266103744507, + 0.15182948857545853, + 0.0, + 1.0596635024994612, + 1.3113325126469135, + 1.2328430823981762, + 2.2662082109600306, + 0.043088771402835846, + 1.395538005977869, + 0.3284978121519089, + 0.49011093005537987, + 2.795800097286701, + 0.502226747572422, + 1.095953855663538, + 1.4998080357909203, + 0.5323840752243996, + 0.4468856453895569, + 0.6087234243750572, + 0.5153337940573692, + 0.27193351089954376, + 0.44259675592184067, + 0.32580796256661415, + 0.03690639138221741, + 1.3968322053551674, + 0.06985203176736832, + 1.5322633013129234, + 0.5051638148725033, + 0.0, + 1.2645968440920115, + 0.9431179855018854, + 0.9358387030661106, + 0.6496861465275288, + 0.0678720735013485, + 0.10911659896373749, + 0.2512180022895336, + 1.3207945264875889, + 2.883256621658802, + 0.7524089738726616, + 0.5639282763004303, + 0.6815196070820093, + 1.0369822792708874, + 0.07837862521409988, + 1.0891529731452465, + 0.34339389204978943, + 1.7430515512824059, + 0.31571466848254204, + 1.062795765697956, + 0.09452763944864273, + 1.1027915365993977, + 0.34429887495934963, + 0.0, + 0.5587230008095503, + 0.2909807413816452, + 1.049409069120884, + 0.6753531582653522, + 0.2364150509238243 + ], + "unique_experts": 60, + "load_cv": 0.8715154397283984, + "normalized_load_entropy": 0.9190724409727419, + "max_load_share": 0.07079646017699115 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "990499c360b6ef6adf5cd302f61bf0ee51290a469f0b191d68580a913ec3e30a", + "route_weight_sha256": "8fac4b98c3a4c4e8827b871ea3898af41ec7e27eda34cbab7ccde7fe83ccd1b7", + "loads": [ + 12, + 10, + 6, + 13, + 17, + 2, + 0, + 17, + 13, + 5, + 1, + 16, + 21, + 22, + 36, + 1, + 23, + 7, + 10, + 48, + 8, + 18, + 22, + 13, + 9, + 9, + 11, + 14, + 25, + 21, + 13, + 23, + 6, + 22, + 13, + 8, + 23, + 16, + 28, + 11, + 2, + 15, + 14, + 16, + 56, + 15, + 12, + 21, + 25, + 2, + 14, + 5, + 24, + 8, + 10, + 2, + 17, + 13, + 0, + 12, + 8, + 22, + 13, + 5 + ], + "weighted_loads": [ + 0.6893739514052868, + 0.6724265627563, + 0.25459063798189163, + 0.7813610788434744, + 1.4920468032360077, + 0.08390000462532043, + 0.0, + 0.9858992509543896, + 0.7567583508789539, + 0.470734640955925, + 0.04140305519104004, + 1.0596635024994612, + 1.487254697829485, + 1.3355869837105274, + 2.2662082109600306, + 0.043088771402835846, + 1.5883488021790981, + 0.44067346677184105, + 0.525838315486908, + 2.795800097286701, + 0.502226747572422, + 1.2188882417976856, + 1.586738232523203, + 1.1305859722197056, + 0.4468856453895569, + 0.6087234243750572, + 0.6375763863325119, + 0.7020803652703762, + 2.9832461662590504, + 2.2133412435650826, + 0.9353776648640633, + 1.689834775403142, + 0.24723041616380215, + 1.824510220438242, + 0.7610534653067589, + 0.6647388692945242, + 1.2645968440920115, + 1.116208329796791, + 2.231411661952734, + 0.6496861465275288, + 0.0678720735013485, + 1.213646337389946, + 0.7428695671260357, + 1.4294722825288773, + 4.125014238059521, + 1.1041382811963558, + 0.700861319899559, + 1.0172810144722462, + 1.4644865207374096, + 0.07837862521409988, + 1.1556057929992676, + 0.34339389204978943, + 1.7430515512824059, + 0.46884389221668243, + 1.062795765697956, + 0.09452763944864273, + 1.1305327471345663, + 0.5976642593741417, + 0.0, + 0.6735749151557684, + 0.36044811829924583, + 1.505643516778946, + 0.8920881822705269, + 0.2364150509238243 + ], + "unique_experts": 62, + "load_cv": 0.7053886403513813, + "normalized_load_entropy": 0.9424137171554406, + "max_load_share": 0.06060606060606061 + } + }, + "s0_period": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "07b40988dbbe95985b27393e50cbcfe89560517aab41532f0264aeeb03158ffc", + "route_weight_sha256": "58e38cbc87f020e1ef160b4a96f3e72f31e19aabda71f005e84af8817c02c1cc", + "loads": [ + 8, + 10, + 7, + 9, + 11, + 1, + 0, + 10, + 6, + 2, + 0, + 15, + 17, + 19, + 36, + 1, + 22, + 5, + 9, + 49, + 8, + 16, + 21, + 6, + 10, + 9, + 9, + 6, + 7, + 6, + 1, + 16, + 2, + 15, + 7, + 0, + 25, + 11, + 11, + 13, + 3, + 2, + 5, + 15, + 42, + 10, + 10, + 13, + 18, + 2, + 13, + 5, + 22, + 6, + 11, + 3, + 15, + 6, + 0, + 10, + 6, + 13, + 7, + 5 + ], + "weighted_loads": [ + 0.48237550258636475, + 0.6971274092793465, + 0.28020204231143, + 0.6827746517956257, + 0.7079756110906601, + 0.04299018904566765, + 0.0, + 0.5949830152094364, + 0.2814205400645733, + 0.14723535627126694, + 0.0, + 1.0186760239303112, + 1.282484944909811, + 1.0975275784730911, + 2.214439880102873, + 0.04988817498087883, + 1.5055423211306334, + 0.33307787775993347, + 0.504638809710741, + 2.7307958863675594, + 0.5348973274230957, + 1.107239842414856, + 1.5860427673906088, + 0.5155440308153629, + 0.5030750967562199, + 0.6153869368135929, + 0.557111207395792, + 0.26266881078481674, + 0.5238393042236567, + 0.38327643647789955, + 0.03313592076301575, + 1.3202803954482079, + 0.07923935726284981, + 1.4326997995376587, + 0.47335394099354744, + 0.0, + 1.3732022233307362, + 0.8710450362414122, + 0.9121006019413471, + 0.7404675893485546, + 0.09715302288532257, + 0.10616837814450264, + 0.20967231690883636, + 1.3711399883031845, + 3.116534136235714, + 0.739655401557684, + 0.6232173219323158, + 0.6579361576586962, + 1.0932400785386562, + 0.08060267567634583, + 1.1749233696609735, + 0.35588889569044113, + 1.6773004196584225, + 0.3721700832247734, + 1.1123832874000072, + 0.13448406383395195, + 1.0308061204850674, + 0.31967633962631226, + 0.0, + 0.6173526346683502, + 0.2993564084172249, + 1.041844580322504, + 0.6279584877192974, + 0.2297626994550228 + ], + "unique_experts": 60, + "load_cv": 0.8747046385876508, + "normalized_load_entropy": 0.919261877363748, + "max_load_share": 0.07227138643067847 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "aa5f58fbdf15742e6d769f91df74204577b74b10785b86be667ddc9863b6cee9", + "route_weight_sha256": "277a352f525027fb654bca4f908cfdc8bdbf1909160a001e327ec93191b95757", + "loads": [ + 8, + 10, + 7, + 13, + 15, + 1, + 0, + 13, + 12, + 2, + 0, + 15, + 22, + 20, + 36, + 1, + 25, + 5, + 9, + 49, + 8, + 16, + 22, + 12, + 10, + 9, + 10, + 14, + 23, + 15, + 4, + 21, + 3, + 17, + 7, + 8, + 25, + 15, + 25, + 13, + 3, + 10, + 11, + 15, + 44, + 11, + 11, + 19, + 22, + 2, + 14, + 5, + 22, + 6, + 11, + 3, + 17, + 6, + 0, + 12, + 6, + 18, + 12, + 8 + ], + "weighted_loads": [ + 0.48237550258636475, + 0.6971274092793465, + 0.28020204231143, + 0.8054111581295729, + 1.4060090389102697, + 0.04299018904566765, + 0.0, + 0.8256037048995495, + 0.6635543890297413, + 0.14723535627126694, + 0.0, + 1.0186760239303112, + 1.5188861712813377, + 1.2089520245790482, + 2.214439880102873, + 0.04988817498087883, + 1.6501270476728678, + 0.33307787775993347, + 0.504638809710741, + 2.7307958863675594, + 0.5348973274230957, + 1.107239842414856, + 1.6361573468893766, + 1.0208742916584015, + 0.5030750967562199, + 0.6153869368135929, + 0.5898243822157383, + 0.7004270926117897, + 2.7320968117564917, + 1.5430976375937462, + 0.12794384732842445, + 1.6379000023007393, + 0.1254313737154007, + 1.5323193930089474, + 0.47335394099354744, + 0.5540821105241776, + 1.3732022233307362, + 0.9850528296083212, + 2.004484612494707, + 0.7404675893485546, + 0.09715302288532257, + 0.8094039671123028, + 0.6088339611887932, + 1.3711399883031845, + 3.212611261755228, + 0.7793025448918343, + 0.6710379086434841, + 0.9848220199346542, + 1.3883232399821281, + 0.08060267567634583, + 1.1878628823906183, + 0.35588889569044113, + 1.6773004196584225, + 0.3721700832247734, + 1.1123832874000072, + 0.13448406383395195, + 1.1321108620613813, + 0.31967633962631226, + 0.0, + 0.7029321156442165, + 0.2993564084172249, + 1.2504348680377007, + 0.8251405358314514, + 0.32656865008175373 + ], + "unique_experts": 61, + "load_cv": 0.7378347394140351, + "normalized_load_entropy": 0.9366118527383884, + "max_load_share": 0.059178743961352656 + } + }, + "s1_period": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "8997af98f1b9c6caa400a3872358cbe3aef0e3702826d8e99a76a1e8c159a07a", + "route_weight_sha256": "79e09bcafa52228eb3d54fdb14bef0135f9722748f6f9b7e276341cbdf4a23f0", + "loads": [ + 8, + 12, + 6, + 10, + 13, + 3, + 0, + 10, + 7, + 1, + 0, + 17, + 16, + 22, + 34, + 0, + 20, + 5, + 9, + 49, + 8, + 15, + 20, + 6, + 9, + 9, + 8, + 6, + 8, + 7, + 1, + 17, + 2, + 17, + 8, + 0, + 21, + 12, + 11, + 11, + 2, + 2, + 5, + 14, + 41, + 10, + 10, + 12, + 18, + 2, + 12, + 5, + 24, + 5, + 11, + 4, + 15, + 6, + 0, + 9, + 6, + 13, + 9, + 5 + ], + "weighted_loads": [ + 0.49562834575772285, + 0.7620110064744949, + 0.2555302754044533, + 0.7046574987471104, + 0.7952020913362503, + 0.12748314812779427, + 0.0, + 0.5860925242304802, + 0.3165179565548897, + 0.11119259893894196, + 0.0, + 1.0952524710446596, + 1.2849334850907326, + 1.2679262794554234, + 2.139210008084774, + 0.0, + 1.3884618934243917, + 0.33302193880081177, + 0.4875193387269974, + 2.8270203713327646, + 0.5210826992988586, + 1.0813274830579758, + 1.504178248345852, + 0.5419823452830315, + 0.4546971991658211, + 0.610564861446619, + 0.5054169818758965, + 0.26771798729896545, + 0.5292983241379261, + 0.34434080496430397, + 0.037411730736494064, + 1.3422847613692284, + 0.07085343077778816, + 1.5124628283083439, + 0.5054796505719423, + 0.0, + 1.2022173814475536, + 0.9306114390492439, + 0.9150207340717316, + 0.6388092413544655, + 0.06657519564032555, + 0.10818907245993614, + 0.22844843938946724, + 1.3159385174512863, + 2.877571675926447, + 0.7218016162514687, + 0.5992806926369667, + 0.6146717071533203, + 1.0546197816729546, + 0.07757024466991425, + 1.0926070734858513, + 0.3435707874596119, + 1.757289171218872, + 0.32189858704805374, + 1.0860778279602528, + 0.17495772615075111, + 1.0676688514649868, + 0.31088415533304214, + 0.0, + 0.5628750175237656, + 0.2905859537422657, + 1.0581901483237743, + 0.7201349437236786, + 0.2339225485920906 + ], + "unique_experts": 59, + "load_cv": 0.8588023297080623, + "normalized_load_entropy": 0.9203566556190939, + "max_load_share": 0.07227138643067847 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "fb013bdcc0b08d11761f28d0ced828a2f87d4624438574df1a54575aeab82593", + "route_weight_sha256": "979da96a3570db8f8d98765831c22093f870057d5cc630cfb281230c8d4dc0e6", + "loads": [ + 12, + 12, + 6, + 12, + 16, + 3, + 0, + 18, + 14, + 4, + 1, + 17, + 20, + 23, + 34, + 0, + 23, + 7, + 10, + 49, + 8, + 17, + 22, + 13, + 9, + 9, + 11, + 13, + 27, + 21, + 13, + 22, + 6, + 22, + 13, + 8, + 21, + 16, + 29, + 11, + 2, + 16, + 14, + 16, + 55, + 14, + 13, + 19, + 26, + 2, + 14, + 5, + 24, + 8, + 11, + 4, + 16, + 12, + 0, + 12, + 8, + 22, + 14, + 5 + ], + "weighted_loads": [ + 0.6873897686600685, + 0.7620110064744949, + 0.2555302754044533, + 0.7580439504235983, + 1.4684197083115578, + 0.12748314812779427, + 0.0, + 1.0237291939556599, + 0.8025455176830292, + 0.4300977513194084, + 0.04140305519104004, + 1.0952524710446596, + 1.4547605887055397, + 1.3703018836677074, + 2.139210008084774, + 0.0, + 1.5927456077188253, + 0.44519759342074394, + 0.5232467241585255, + 2.8270203713327646, + 0.5210826992988586, + 1.1716824993491173, + 1.5911084450781345, + 1.0586970448493958, + 0.4546971991658211, + 0.610564861446619, + 0.6276595741510391, + 0.6240092851221561, + 3.0877647884190083, + 2.1955770291388035, + 0.9347972720861435, + 1.6306186933070421, + 0.248231815174222, + 1.8104099035263062, + 0.7613693010061979, + 0.6246759127825499, + 1.2022173814475536, + 1.1037017833441496, + 2.248675998300314, + 0.6388092413544655, + 0.06657519564032555, + 1.3399293348193169, + 0.770120695233345, + 1.4246162734925747, + 4.118849590420723, + 1.0302110686898232, + 0.7476242072880268, + 0.9757019635289907, + 1.4630708135664463, + 0.07757024466991425, + 1.1590598933398724, + 0.3435707874596119, + 1.757289171218872, + 0.47502781078219414, + 1.0860778279602528, + 0.17495772615075111, + 1.0954100620001554, + 0.5642495397478342, + 0.0, + 0.6777269318699837, + 0.36005333065986633, + 1.5158598497509956, + 0.9368699677288532, + 0.2339225485920906 + ], + "unique_experts": 61, + "load_cv": 0.6996265672722684, + "normalized_load_entropy": 0.9430076800012339, + "max_load_share": 0.05952380952380952 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 113, + "ordered_topk_exact_tokens": 82, + "set_exact_tokens": 90, + "mean_set_jaccard": 0.9418457648546146, + "mean_token_weighted_tv": 0.01268765944328192, + "aggregate_load_tv": 0.02654867256637168 + }, + "system_bos": { + "tokens": 113, + "ordered_topk_exact_tokens": 72, + "set_exact_tokens": 86, + "mean_set_jaccard": 0.9298356510745891, + "mean_token_weighted_tv": 0.01759576495835739, + "aggregate_load_tv": 0.029498525073746312 + }, + "system_x": { + "tokens": 113, + "ordered_topk_exact_tokens": 64, + "set_exact_tokens": 81, + "mean_set_jaccard": 0.9119258322798147, + "mean_token_weighted_tv": 0.022746936797238555, + "aggregate_load_tv": 0.029498525073746312 + }, + "system_period": { + "tokens": 113, + "ordered_topk_exact_tokens": 59, + "set_exact_tokens": 78, + "mean_set_jaccard": 0.9096080910240204, + "mean_token_weighted_tv": 0.023386791397908092, + "aggregate_load_tv": 0.03687315634218289 + }, + "bos_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 68, + "set_exact_tokens": 81, + "mean_set_jaccard": 0.9190897597977244, + "mean_token_weighted_tv": 0.01911261269773266, + "aggregate_load_tv": 0.022123893805309734 + }, + "bos_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 61, + "set_exact_tokens": 75, + "mean_set_jaccard": 0.9001264222503161, + "mean_token_weighted_tv": 0.023444288731676286, + "aggregate_load_tv": 0.035398230088495575 + }, + "x_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 61, + "set_exact_tokens": 77, + "mean_set_jaccard": 0.90897597977244, + "mean_token_weighted_tv": 0.021521027175198614, + "aggregate_load_tv": 0.030973451327433624 + }, + "x_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 54, + "set_exact_tokens": 73, + "mean_set_jaccard": 0.8935946059839865, + "mean_token_weighted_tv": 0.027350549544908304, + "aggregate_load_tv": 0.0368731563421829 + }, + "period_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 63, + "set_exact_tokens": 76, + "mean_set_jaccard": 0.9045512010113781, + "mean_token_weighted_tv": 0.022428705085035975, + "aggregate_load_tv": 0.032448377581120944 + }, + "period_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 52, + "set_exact_tokens": 70, + "mean_set_jaccard": 0.8874841972187105, + "mean_token_weighted_tv": 0.027710926620108364, + "aggregate_load_tv": 0.03687315634218289 + } + } + }, + "layer_13": { + "layer": 13, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "793ee1f08aa80320930a5e173ff9223067516b285e1ecd42bccb37f9c5d82743", + "route_weight_sha256": "335a4762bbaec9e3b9b63d99fcf70cd447936e6def0ed7c1ad526308ae2190c1", + "loads": [ + 3, + 8, + 5, + 32, + 13, + 26, + 6, + 5, + 4, + 10, + 20, + 8, + 5, + 4, + 12, + 10, + 6, + 10, + 25, + 0, + 4, + 9, + 17, + 5, + 21, + 1, + 14, + 6, + 62, + 2, + 0, + 10, + 19, + 11, + 4, + 12, + 8, + 0, + 9, + 2, + 5, + 2, + 8, + 7, + 3, + 13, + 1, + 19, + 15, + 0, + 1, + 39, + 1, + 7, + 13, + 3, + 19, + 28, + 6, + 1, + 17, + 18, + 10, + 14 + ], + "weighted_loads": [ + 0.30967239290475845, + 0.3859378509223461, + 0.2614700347185135, + 1.8738345094025135, + 0.5176747534424067, + 1.6696167942136526, + 0.23837072402238846, + 0.5438841041177511, + 0.19516339153051376, + 0.6469909735023975, + 2.433656994253397, + 0.40550856478512287, + 0.30391450226306915, + 0.22046275436878204, + 0.8293169122189283, + 0.885864831507206, + 0.37247587367892265, + 0.44095344468951225, + 1.789912186563015, + 0.0, + 0.30214730091392994, + 0.4442568998783827, + 1.1355512533336878, + 0.23316795006394386, + 1.509323988109827, + 0.033698670566082, + 0.44651661068201065, + 0.2965441048145294, + 3.985853288322687, + 0.07184989750385284, + 0.0, + 0.6641501449048519, + 1.3736566230654716, + 0.781109169125557, + 0.2904188595712185, + 1.2596010006964207, + 0.40994912944734097, + 0.0, + 0.6044968143105507, + 0.1356223151087761, + 0.28367235884070396, + 0.0633488018065691, + 0.3186853062361479, + 0.4130329489707947, + 0.16732198372483253, + 0.8518361356109381, + 0.029694635421037674, + 0.7285761311650276, + 1.858482737094164, + 0.0, + 0.02939492091536522, + 2.2704515121877193, + 0.03179901838302612, + 0.3177940584719181, + 1.1533552762120962, + 0.12174995616078377, + 0.8999421671032906, + 1.3428305238485336, + 0.294010516256094, + 0.03597467765212059, + 1.043434266000986, + 1.0359587725251913, + 0.6414567604660988, + 0.9130614027380943 + ], + "unique_experts": 60, + "load_cv": 0.9902677274511279, + "normalized_load_entropy": 0.9019691529414059, + "max_load_share": 0.09144542772861357 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "bd6c978ea69edfabba49240ebd7c1f906ee3c235b1d7ca2e518c1bfa8eb7af97", + "route_weight_sha256": "f7b78809b7886f8ad24ed833226ae465d26410b9ddd90070e146f5476468424d", + "loads": [ + 3, + 12, + 5, + 32, + 13, + 27, + 24, + 5, + 4, + 13, + 31, + 14, + 5, + 4, + 13, + 16, + 6, + 12, + 26, + 1, + 4, + 11, + 17, + 6, + 25, + 1, + 17, + 6, + 62, + 15, + 1, + 10, + 20, + 17, + 5, + 12, + 12, + 1, + 9, + 4, + 5, + 5, + 11, + 9, + 13, + 23, + 2, + 21, + 16, + 1, + 2, + 39, + 4, + 10, + 15, + 3, + 22, + 28, + 12, + 5, + 17, + 19, + 10, + 15 + ], + "weighted_loads": [ + 0.30967239290475845, + 0.5966190434992313, + 0.2614700347185135, + 1.8738345094025135, + 0.5176747534424067, + 1.7002775482833385, + 1.6873721592128277, + 0.5438841041177511, + 0.19516339153051376, + 0.7639213427901268, + 3.1435314137488604, + 0.6959338709712029, + 0.30391450226306915, + 0.22046275436878204, + 0.8747852575033903, + 1.194450855255127, + 0.37247587367892265, + 0.4884208934381604, + 1.8319259583950043, + 0.04486439377069473, + 0.30214730091392994, + 0.5502777118235826, + 1.1355512533336878, + 0.29070791602134705, + 1.6516026016324759, + 0.033698670566082, + 0.5707198083400726, + 0.2965441048145294, + 3.985853288322687, + 0.9014979973435402, + 0.04403387010097504, + 0.6641501449048519, + 1.4067957513034344, + 1.4779571518301964, + 0.31323971413075924, + 1.2596010006964207, + 0.6515406351536512, + 0.03363347426056862, + 0.6044968143105507, + 0.20351024717092514, + 0.28367235884070396, + 0.22148125432431698, + 0.4545788113027811, + 0.5092822052538395, + 0.9590831510722637, + 1.8178092297166586, + 0.0614328496158123, + 1.920248605310917, + 1.8905494697391987, + 0.04069572314620018, + 0.06800621375441551, + 2.2704515121877193, + 0.14199085906147957, + 0.45243264734745026, + 1.242462059482932, + 0.12174995616078377, + 1.0598587319254875, + 1.3428305238485336, + 0.5904791597276926, + 0.24388130381703377, + 1.043434266000986, + 1.0649494882673025, + 0.6414567604660988, + 0.9504639431834221 + ], + "unique_experts": 64, + "load_cv": 0.8241353334368607, + "normalized_load_entropy": 0.927486401437966, + "max_load_share": 0.0748792270531401 + } + }, + "s1_eos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "4d90cec3b9694fb304564d94d2956b35e5d6925b2801913810081042e6902ccb", + "route_weight_sha256": "f77aeabd8bb2d6f137c196879c57e579953c938f2e2e783efb42fd0d53b66d67", + "loads": [ + 3, + 8, + 6, + 32, + 12, + 26, + 6, + 5, + 4, + 9, + 19, + 9, + 5, + 3, + 11, + 10, + 6, + 11, + 26, + 0, + 4, + 9, + 17, + 5, + 22, + 1, + 12, + 6, + 60, + 3, + 0, + 10, + 18, + 11, + 4, + 12, + 8, + 0, + 9, + 2, + 6, + 2, + 7, + 7, + 4, + 13, + 1, + 20, + 16, + 0, + 1, + 40, + 1, + 7, + 13, + 4, + 20, + 27, + 6, + 1, + 18, + 17, + 10, + 13 + ], + "weighted_loads": [ + 0.31304042786359787, + 0.39081030897796154, + 0.2937844693660736, + 1.8830100558698177, + 0.4960523024201393, + 1.6670920830219984, + 0.2297748662531376, + 0.5465597100555897, + 0.19967031851410866, + 0.6292049027979374, + 2.381270255893469, + 0.45194162614643574, + 0.302794374525547, + 0.18672452867031097, + 0.7764777969568968, + 0.891458423808217, + 0.3746252991259098, + 0.47861431166529655, + 1.8034401945769787, + 0.0, + 0.29512419179081917, + 0.44778743013739586, + 1.1377133522182703, + 0.2313031069934368, + 1.5330358743667603, + 0.03489447385072708, + 0.3864535056054592, + 0.29071252793073654, + 3.883212059736252, + 0.11384803056716919, + 0.0, + 0.6553130932152271, + 1.345388911664486, + 0.8088880442082882, + 0.28900402784347534, + 1.2604048177599907, + 0.40877615846693516, + 0.0, + 0.6033806763589382, + 0.13465721905231476, + 0.320630069822073, + 0.05812655948102474, + 0.2710101529955864, + 0.41018839552998543, + 0.21199501864612103, + 0.8500929176807404, + 0.02935118041932583, + 0.7729767989367247, + 1.901008140295744, + 0.0, + 0.02821650542318821, + 2.289920812472701, + 0.03294793516397476, + 0.3235815688967705, + 1.1584194134920835, + 0.15261885151267052, + 0.9496741965413094, + 1.2936023212969303, + 0.29125904478132725, + 0.037115681916475296, + 1.0789475794881582, + 1.017621774226427, + 0.6391923986375332, + 0.8488911651074886 + ], + "unique_experts": 60, + "load_cv": 0.977389904802158, + "normalized_load_entropy": 0.9039787052830128, + "max_load_share": 0.08849557522123894 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "86bfd0ac2420df032cfc9835f661e85819b2a4a9d7d638532b5a227294c4e4db", + "route_weight_sha256": "ea86763f025f0221b0f3c3f4438822d44053588137b2945d87ef2027fd249d7a", + "loads": [ + 8, + 12, + 6, + 32, + 12, + 27, + 35, + 5, + 4, + 12, + 31, + 21, + 5, + 3, + 12, + 17, + 6, + 14, + 28, + 3, + 4, + 14, + 17, + 9, + 26, + 1, + 16, + 6, + 60, + 21, + 8, + 11, + 19, + 22, + 7, + 13, + 13, + 1, + 10, + 3, + 8, + 7, + 15, + 8, + 20, + 24, + 3, + 23, + 18, + 6, + 2, + 40, + 4, + 9, + 15, + 6, + 23, + 38, + 14, + 5, + 19, + 19, + 10, + 14 + ], + "weighted_loads": [ + 0.5167880393564701, + 0.6304043363779783, + 0.2937844693660736, + 1.8830100558698177, + 0.4960523024201393, + 1.7033479791134596, + 2.599177001044154, + 0.5465597100555897, + 0.19967031851410866, + 0.7512592040002346, + 3.1285173688083887, + 1.2437371206469834, + 0.302794374525547, + 0.18672452867031097, + 0.8201611321419477, + 1.2661095391958952, + 0.3746252991259098, + 0.5633981935679913, + 1.8684769365936518, + 0.12323972955346107, + 0.29512419179081917, + 0.71075289696455, + 1.1377133522182703, + 0.3966735564172268, + 1.69512930046767, + 0.03489447385072708, + 0.546816261485219, + 0.29071252793073654, + 3.883212059736252, + 1.62798722833395, + 0.45467234030365944, + 0.6953903883695602, + 1.379877407103777, + 2.006660118699074, + 0.5154600385576487, + 1.3140684887766838, + 0.7422919180244207, + 0.03331625834107399, + 0.6467354856431484, + 0.17777244746685028, + 0.4010188840329647, + 0.2950842175632715, + 0.9310726504772902, + 0.48587843403220177, + 1.4343495983630419, + 1.8119281232357025, + 0.10360612533986568, + 2.0024784933775663, + 2.1539652459323406, + 0.2797306440770626, + 0.06537091918289661, + 2.289920812472701, + 0.1382041834294796, + 0.4064418561756611, + 1.2287434935569763, + 0.22459368035197258, + 1.1022094711661339, + 2.0052558071911335, + 0.6567287594079971, + 0.24167470261454582, + 1.1067663431167603, + 1.1004365533590317, + 0.6391923986375332, + 0.9053668938577175 + ], + "unique_experts": 64, + "load_cv": 0.7584410642628211, + "normalized_load_entropy": 0.9375414663612482, + "max_load_share": 0.06493506493506493 + } + }, + "s0_bos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "7fe13098d0b9da6dccb0abd5a3e9f80d32036d4be5fe275f6a405cf9b6254653", + "route_weight_sha256": "35599145ff0c12c412f7dc924d749d69d9550d972e2b9a0b9b52cb6da4fac1b6", + "loads": [ + 3, + 10, + 5, + 31, + 11, + 29, + 7, + 4, + 4, + 9, + 20, + 7, + 5, + 3, + 12, + 12, + 6, + 7, + 24, + 0, + 4, + 9, + 17, + 5, + 19, + 1, + 12, + 7, + 63, + 3, + 0, + 11, + 19, + 11, + 4, + 13, + 8, + 0, + 10, + 2, + 5, + 0, + 7, + 6, + 3, + 13, + 1, + 18, + 15, + 0, + 1, + 41, + 1, + 8, + 14, + 4, + 20, + 27, + 8, + 2, + 15, + 19, + 10, + 13 + ], + "weighted_loads": [ + 0.3125205412507057, + 0.4785002302378416, + 0.2633998580276966, + 1.8466512449085712, + 0.4370547700673342, + 1.7671466525644064, + 0.26523416116833687, + 0.5259480625391006, + 0.2068357653915882, + 0.6072420664131641, + 2.444651026278734, + 0.4250531233847141, + 0.30479956790804863, + 0.18101456388831139, + 0.8505115266889334, + 0.9239441007375717, + 0.35097577795386314, + 0.33285546861588955, + 1.788383400067687, + 0.0, + 0.2879051882773638, + 0.4459702670574188, + 1.126487910747528, + 0.23387008160352707, + 1.4163302145898342, + 0.03448734059929848, + 0.3894835878163576, + 0.3411576449871063, + 4.087816517800093, + 0.1082441583275795, + 0.0, + 0.6822700314223766, + 1.3586628157645464, + 0.800957690924406, + 0.29432497173547745, + 1.2832272630184889, + 0.41586167737841606, + 0.0, + 0.6476873327046633, + 0.13539379090070724, + 0.2835710868239403, + 0.0, + 0.2859759647399187, + 0.308422327041626, + 0.16030795127153397, + 0.8518060017377138, + 0.02781997062265873, + 0.6714098267257214, + 1.847738642245531, + 0.0, + 0.03225398808717728, + 2.339998608455062, + 0.039224397391080856, + 0.35818679071962833, + 1.2016007732599974, + 0.15377946943044662, + 0.9295737445354462, + 1.3055146411061287, + 0.34969289042055607, + 0.06679743900895119, + 0.9550308585166931, + 1.0693049188703299, + 0.6419615745544434, + 0.8868700712919235 + ], + "unique_experts": 59, + "load_cv": 1.0024248148549184, + "normalized_load_entropy": 0.9003250321794455, + "max_load_share": 0.09292035398230089 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "78c507e74e80d99a93ae4e49e674262d88c18e3dbf14e7cf6d34ccd91b817e3b", + "route_weight_sha256": "7f4362ff46e6199c1249865ce9aa1fc32432a536f2fd73a1acf9774877b6f655", + "loads": [ + 3, + 16, + 6, + 31, + 12, + 30, + 24, + 4, + 4, + 14, + 31, + 11, + 5, + 3, + 12, + 18, + 6, + 8, + 25, + 1, + 4, + 12, + 17, + 6, + 22, + 1, + 15, + 7, + 63, + 17, + 0, + 11, + 20, + 16, + 5, + 13, + 11, + 1, + 10, + 4, + 5, + 3, + 10, + 8, + 13, + 23, + 2, + 19, + 16, + 1, + 2, + 41, + 4, + 12, + 16, + 4, + 24, + 27, + 14, + 6, + 15, + 20, + 10, + 14 + ], + "weighted_loads": [ + 0.3125205412507057, + 0.7955231796950102, + 0.3324033133685589, + 1.8466512449085712, + 0.4850969407707453, + 1.7978074066340923, + 1.7376408837735653, + 0.5259480625391006, + 0.2068357653915882, + 0.8358592949807644, + 3.0976603757590055, + 0.6457502227276564, + 0.30479956790804863, + 0.18101456388831139, + 0.8505115266889334, + 1.2325301244854927, + 0.35097577795386314, + 0.3673322256654501, + 1.8303971718996763, + 0.04486439377069473, + 0.2879051882773638, + 0.5978346168994904, + 1.126487910747528, + 0.2935442514717579, + 1.570180095732212, + 0.03448734059929848, + 0.5136867854744196, + 0.3411576449871063, + 4.087816517800093, + 0.9461118020117283, + 0.0, + 0.6822700314223766, + 1.3948414493352175, + 1.479456078261137, + 0.3171458262950182, + 1.2832272630184889, + 0.6048458553850651, + 0.03363347426056862, + 0.6476873327046633, + 0.2032817229628563, + 0.2835710868239403, + 0.15404748916625977, + 0.4464260842651129, + 0.41691796481609344, + 0.948575846850872, + 1.8177790958434343, + 0.05955818481743336, + 1.0323501341044903, + 1.8798053748905659, + 0.04579374939203262, + 0.07086528092622757, + 2.339998608455062, + 0.1494162380695343, + 0.5533351134508848, + 1.2907075565308332, + 0.15377946943044662, + 1.1990790888667107, + 1.3055146411061287, + 0.6429014075547457, + 0.27470406517386436, + 0.9550308585166931, + 1.098295634612441, + 0.6419615745544434, + 0.9242726117372513 + ], + "unique_experts": 63, + "load_cv": 0.837394710007015, + "normalized_load_entropy": 0.9249753243251041, + "max_load_share": 0.07608695652173914 + } + }, + "s1_bos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "6fb8e2a1a124cc8d5229e09c30463fe21edae559aa6a68fd9fbd14d260ec1df3", + "route_weight_sha256": "bc06b49fb30e05107f80bfdde2684e186549d24e1ce261085088d947c3b1a498", + "loads": [ + 3, + 11, + 5, + 30, + 10, + 26, + 6, + 5, + 4, + 10, + 19, + 7, + 5, + 3, + 12, + 12, + 6, + 9, + 26, + 0, + 4, + 9, + 17, + 4, + 21, + 1, + 13, + 7, + 63, + 3, + 0, + 12, + 18, + 11, + 5, + 12, + 7, + 0, + 9, + 2, + 5, + 1, + 8, + 6, + 4, + 13, + 2, + 18, + 15, + 0, + 1, + 40, + 1, + 7, + 13, + 4, + 20, + 26, + 8, + 1, + 17, + 19, + 10, + 12 + ], + "weighted_loads": [ + 0.31150712072849274, + 0.4981250520795584, + 0.2651234269142151, + 1.7846559919416904, + 0.4128183089196682, + 1.6799496281892061, + 0.25345588102936745, + 0.5739285610616207, + 0.1853724792599678, + 0.6481989398598671, + 2.3813577443361282, + 0.41417899541556835, + 0.30434830859303474, + 0.18050827831029892, + 0.8521398268640041, + 0.9221588838845491, + 0.3399563282728195, + 0.40726842544972897, + 1.9085435681045055, + 0.0, + 0.28789002262055874, + 0.4496016651391983, + 1.1629275232553482, + 0.21022294461727142, + 1.5223551541566849, + 0.038604121655225754, + 0.4263016637414694, + 0.3324216976761818, + 4.160520303994417, + 0.11448181420564651, + 0.0, + 0.7160426285117865, + 1.360990971326828, + 0.7830423079431057, + 0.3285914659500122, + 1.2515937872231007, + 0.38760647363960743, + 0.0, + 0.6283484995365143, + 0.13502376526594162, + 0.2887384742498398, + 0.029994376003742218, + 0.3115955740213394, + 0.31260713562369347, + 0.200631370767951, + 0.8505830857902765, + 0.06895493157207966, + 0.6685535125434399, + 1.8805554937571287, + 0.0, + 0.027004338800907135, + 2.305843349546194, + 0.03757914528250694, + 0.3244904726743698, + 1.1656377110630274, + 0.15117978677153587, + 0.9455855786800385, + 1.2666888236999512, + 0.3304353579878807, + 0.04040089622139931, + 1.0124565958976746, + 1.098432594910264, + 0.6390922926366329, + 0.8435452058911324 + ], + "unique_experts": 60, + "load_cv": 0.9884383106841172, + "normalized_load_entropy": 0.9034881828948003, + "max_load_share": 0.09292035398230089 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "a2713000fcd5b6d02cdfc2ed19f89bbeabce1f33584049b9710a0889dcbed2f4", + "route_weight_sha256": "65ac89abeb9815130d7615c13839bd0f616c53efca947b26ee93fbab8b3ab769", + "loads": [ + 8, + 16, + 6, + 30, + 10, + 27, + 34, + 5, + 4, + 14, + 32, + 17, + 5, + 3, + 12, + 19, + 6, + 11, + 28, + 3, + 4, + 14, + 17, + 8, + 25, + 1, + 17, + 7, + 63, + 21, + 9, + 13, + 19, + 22, + 8, + 13, + 13, + 1, + 10, + 3, + 7, + 6, + 16, + 7, + 20, + 24, + 4, + 20, + 17, + 6, + 2, + 40, + 4, + 9, + 15, + 6, + 23, + 37, + 16, + 5, + 18, + 21, + 10, + 13 + ], + "weighted_loads": [ + 0.515254732221365, + 0.8078279215842485, + 0.30527445301413536, + 1.7846559919416904, + 0.4128183089196682, + 1.7162055242806673, + 2.6616674829274416, + 0.5739285610616207, + 0.1853724792599678, + 0.836665615439415, + 3.1649888660758734, + 1.1479098349809647, + 0.30434830859303474, + 0.18050827831029892, + 0.8521398268640041, + 1.2968099992722273, + 0.3399563282728195, + 0.4783517364412546, + 1.9735803101211786, + 0.12323972955346107, + 0.28789002262055874, + 0.716407835483551, + 1.1629275232553482, + 0.38807127997279167, + 1.7535055615007877, + 0.038604121655225754, + 0.5866644196212292, + 0.3324216976761818, + 4.160520303994417, + 1.6436135321855545, + 0.48755278065800667, + 0.7561199236661196, + 1.395784679800272, + 2.0075166076421738, + 0.5550474766641855, + 1.3052574582397938, + 0.7642750646919012, + 0.03331625834107399, + 0.6717033088207245, + 0.17813899368047714, + 0.3691272884607315, + 0.2639608681201935, + 0.9873627331107855, + 0.3889929987490177, + 1.4320011008530855, + 1.8124182913452387, + 0.14320987649261951, + 1.0686922185122967, + 2.1335125993937254, + 0.2872663289308548, + 0.06415875256061554, + 2.305843349546194, + 0.14283539354801178, + 0.4073507599532604, + 1.2359617911279202, + 0.22315461561083794, + 1.098120853304863, + 1.9783423095941544, + 0.6740458831191063, + 0.24495991691946983, + 1.0402753595262766, + 1.1812473740428686, + 0.6390922926366329, + 0.9000209346413612 + ], + "unique_experts": 64, + "load_cv": 0.7630722067201786, + "normalized_load_entropy": 0.937692390181523, + "max_load_share": 0.06818181818181818 + } + }, + "s0_x": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "461d032f97bd4cda43daa05b3d11782963fc3f270dba36bfbd837078bc4faccc", + "route_weight_sha256": "d4ddbefeae7ffa61a6584f328b03c145b15aa252862831c3483f2c560dcbc760", + "loads": [ + 3, + 9, + 4, + 31, + 12, + 29, + 8, + 5, + 3, + 10, + 17, + 7, + 5, + 4, + 13, + 11, + 5, + 10, + 26, + 0, + 4, + 9, + 17, + 5, + 20, + 1, + 14, + 8, + 62, + 2, + 0, + 11, + 17, + 11, + 5, + 13, + 8, + 0, + 9, + 2, + 5, + 1, + 7, + 5, + 4, + 13, + 1, + 16, + 14, + 0, + 0, + 44, + 1, + 7, + 14, + 4, + 20, + 28, + 7, + 1, + 15, + 19, + 11, + 11 + ], + "weighted_loads": [ + 0.31161534786224365, + 0.4317316636443138, + 0.21682675927877426, + 1.8913067318499088, + 0.49033331498503685, + 1.7439520135521889, + 0.31002928875386715, + 0.5730433892458677, + 0.16937381029129028, + 0.6090287640690804, + 2.313371527940035, + 0.37958126328885555, + 0.30911509320139885, + 0.21248589269816875, + 0.9018879681825638, + 0.9077927935868502, + 0.3359624855220318, + 0.45177863724529743, + 1.8820122499018908, + 0.0, + 0.2870981153100729, + 0.44690582901239395, + 1.1481084022670984, + 0.2310483269393444, + 1.4800593666732311, + 0.03442692011594772, + 0.47343771159648895, + 0.3785895109176636, + 4.0428575202822685, + 0.07242341712117195, + 0.0, + 0.698504064232111, + 1.310139998793602, + 0.7950904481112957, + 0.3265690226107836, + 1.2817035764455795, + 0.44722344167530537, + 0.0, + 0.6037759743630886, + 0.1337157040834427, + 0.28509023413062096, + 0.030812999233603477, + 0.293386846780777, + 0.2610494941473007, + 0.20226198807358742, + 0.8413476217538118, + 0.028179841116070747, + 0.5958437118679285, + 1.812774233520031, + 0.0, + 0.0, + 2.6116680800914764, + 0.0358496755361557, + 0.31152201630175114, + 1.2016128525137901, + 0.14888495206832886, + 0.9274304378777742, + 1.353442346677184, + 0.32228255830705166, + 0.037724778056144714, + 0.9589179903268814, + 1.0619920901954174, + 0.6896543204784393, + 0.8056768216192722 + ], + "unique_experts": 59, + "load_cv": 1.010172673390976, + "normalized_load_entropy": 0.8988338388240678, + "max_load_share": 0.09144542772861357 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "16058d74042a429dd19eb5a1a1ebd2b08586096a4956a8973ebe990f2abad71c", + "route_weight_sha256": "299ca98f8769c6579ce9ee7763586a1721fb3b81ff428eb700a2f2cc64413c0f", + "loads": [ + 3, + 13, + 4, + 31, + 12, + 30, + 26, + 5, + 3, + 13, + 29, + 12, + 5, + 4, + 13, + 18, + 5, + 11, + 27, + 1, + 4, + 12, + 17, + 6, + 25, + 1, + 17, + 8, + 62, + 15, + 0, + 11, + 18, + 17, + 6, + 13, + 11, + 1, + 9, + 4, + 5, + 4, + 10, + 6, + 16, + 24, + 3, + 17, + 15, + 1, + 1, + 44, + 4, + 10, + 16, + 4, + 23, + 28, + 12, + 5, + 15, + 20, + 11, + 12 + ], + "weighted_loads": [ + 0.31161534786224365, + 0.6376753561198711, + 0.21682675927877426, + 1.8913067318499088, + 0.49033331498503685, + 1.7746127676218748, + 1.7609581518918276, + 0.5730433892458677, + 0.16937381029129028, + 0.7148948684334755, + 2.96561043523252, + 0.6548673622310162, + 0.30911509320139885, + 0.21248589269816875, + 0.9018879681825638, + 1.4353408757597208, + 0.3359624855220318, + 0.486255394294858, + 1.92402602173388, + 0.04486439377069473, + 0.2870981153100729, + 0.6004440374672413, + 1.1481084022670984, + 0.300696175545454, + 1.716965425759554, + 0.03442692011594772, + 0.5976409092545509, + 0.3785895109176636, + 4.0428575202822685, + 0.859947182238102, + 0.0, + 0.698504064232111, + 1.3511055372655392, + 1.4966059513390064, + 0.3493898771703243, + 1.2817035764455795, + 0.6355931628495455, + 0.03363347426056862, + 0.6037759743630886, + 0.20160363614559174, + 0.28509023413062096, + 0.18345692194998264, + 0.428426131606102, + 0.30597251653671265, + 1.105568215250969, + 2.006820799782872, + 0.08845829218626022, + 0.9567840192466974, + 1.8448409661650658, + 0.04005884751677513, + 0.03861129283905029, + 2.6116680800914764, + 0.14604151621460915, + 0.4461606051772833, + 1.290719635784626, + 0.14888495206832886, + 1.0873470026999712, + 1.353442346677184, + 0.5998622458428144, + 0.2456314042210579, + 0.9589179903268814, + 1.0909828059375286, + 0.6896543204784393, + 0.8430793620646 + ], + "unique_experts": 63, + "load_cv": 0.8468173251970944, + "normalized_load_entropy": 0.9234959597084696, + "max_load_share": 0.0748792270531401 + } + }, + "s1_x": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "5606c048e337ecf9d34cdebe5dbd7b68b4fc805d3ef6a163d05c0d345a814eae", + "route_weight_sha256": "96818e94fdcda942092eab64a00f1c92412690c1ff927c87b2a8e7eb6ee262d1", + "loads": [ + 3, + 10, + 5, + 31, + 9, + 25, + 7, + 7, + 3, + 9, + 19, + 7, + 5, + 4, + 10, + 11, + 6, + 10, + 26, + 0, + 4, + 9, + 17, + 4, + 20, + 1, + 15, + 8, + 66, + 4, + 0, + 12, + 18, + 11, + 4, + 12, + 5, + 0, + 10, + 2, + 6, + 2, + 5, + 6, + 4, + 13, + 2, + 19, + 14, + 0, + 0, + 41, + 1, + 7, + 13, + 4, + 19, + 27, + 7, + 1, + 16, + 18, + 12, + 12 + ], + "weighted_loads": [ + 0.31411728262901306, + 0.4721650183200836, + 0.26921702548861504, + 1.8522570095956326, + 0.36298086680471897, + 1.62266393750906, + 0.28449302539229393, + 0.6206185296177864, + 0.14008234813809395, + 0.5825487710535526, + 2.3507160656154156, + 0.3871390875428915, + 0.3052821345627308, + 0.1828626524657011, + 0.7499103136360645, + 0.9202548526227474, + 0.35557541996240616, + 0.44871455058455467, + 1.9390539340674877, + 0.0, + 0.28476671874523163, + 0.46795405074954033, + 1.1474278140813112, + 0.19420252367854118, + 1.496190082281828, + 0.038145098835229874, + 0.5065288618206978, + 0.37100400030612946, + 4.283207958564162, + 0.14826574362814426, + 0.0, + 0.7257302515208721, + 1.3564760498702526, + 0.777377612888813, + 0.29265257716178894, + 1.2198737896978855, + 0.33323555439710617, + 0.0, + 0.6646988391876221, + 0.13261505216360092, + 0.32118842750787735, + 0.07035408914089203, + 0.2240505963563919, + 0.28761620074510574, + 0.19989335536956787, + 0.8609320987015963, + 0.07428330928087234, + 0.7008531652390957, + 1.847330991178751, + 0.0, + 0.0, + 2.435401914641261, + 0.031726349145174026, + 0.3169249650090933, + 1.1512712519615889, + 0.151184793561697, + 0.9221468903124332, + 1.256738904863596, + 0.2935237865895033, + 0.04094327986240387, + 0.9839529916644096, + 1.03719075396657, + 0.7140018902719021, + 0.8531538248062134 + ], + "unique_experts": 59, + "load_cv": 1.0152593559121454, + "normalized_load_entropy": 0.9007247159894398, + "max_load_share": 0.09734513274336283 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "ddbb0d42cc0ebc0263209e27412bdaa120cdbd1ed25bdb237ecb946a9c6b58d0", + "route_weight_sha256": "bb62647a747074601fbf0c1281ddad6ed212690dc7475fdc1600a6704c382739", + "loads": [ + 8, + 14, + 5, + 31, + 9, + 26, + 34, + 7, + 3, + 10, + 30, + 17, + 5, + 4, + 10, + 19, + 6, + 12, + 28, + 3, + 4, + 14, + 17, + 8, + 25, + 1, + 20, + 8, + 66, + 22, + 8, + 13, + 19, + 23, + 7, + 13, + 10, + 1, + 11, + 3, + 8, + 8, + 13, + 6, + 22, + 25, + 5, + 21, + 16, + 6, + 1, + 41, + 4, + 9, + 15, + 7, + 22, + 39, + 14, + 5, + 17, + 21, + 12, + 13 + ], + "weighted_loads": [ + 0.5178648941218853, + 0.693855807185173, + 0.26921702548861504, + 1.8522570095956326, + 0.36298086680471897, + 1.658919833600521, + 2.4942547623068094, + 0.6206185296177864, + 0.14008234813809395, + 0.6131141372025013, + 2.9730802197009325, + 1.1310464069247246, + 0.3052821345627308, + 0.1828626524657011, + 0.7499103136360645, + 1.4374406263232231, + 0.35557541996240616, + 0.5197978615760803, + 2.004090676084161, + 0.12323972955346107, + 0.28476671874523163, + 0.7310996688902378, + 1.1474278140813112, + 0.35894374176859856, + 1.7180835455656052, + 0.038145098835229874, + 0.6993310134857893, + 0.37100400030612946, + 4.283207958564162, + 1.5897672977298498, + 0.45162419974803925, + 0.7658075466752052, + 1.4001988396048546, + 1.9768727831542492, + 0.5191085878759623, + 1.2735374607145786, + 0.641910295933485, + 0.03331625834107399, + 0.7080536484718323, + 0.17573028057813644, + 0.4015772417187691, + 0.3217272087931633, + 0.8831712435930967, + 0.28761620074510574, + 1.535714142024517, + 1.967707784846425, + 0.19186757504940033, + 1.1009918712079525, + 2.1002880968153477, + 0.2791612930595875, + 0.037154413759708405, + 2.435401914641261, + 0.13698259741067886, + 0.3997852522879839, + 1.2215953320264816, + 0.2634291797876358, + 1.0746821649372578, + 2.012357261031866, + 0.5620088782161474, + 0.2455023005604744, + 1.0117717552930117, + 1.154626488685608, + 0.7140018902719021, + 0.9096295535564423 + ], + "unique_experts": 64, + "load_cv": 0.7854369658354754, + "normalized_load_entropy": 0.935503505271892, + "max_load_share": 0.07142857142857142 + } + }, + "s0_period": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "07bc98c467fcc3563b2032a02899ad82f38cde9f61644e5c697c2e6f1584b6aa", + "route_weight_sha256": "5ae44d4f190798d863363a8844ecbd17856cc44fb793989bcd63b4e10e3aa8de", + "loads": [ + 3, + 9, + 5, + 31, + 11, + 27, + 7, + 4, + 3, + 9, + 17, + 6, + 6, + 3, + 12, + 11, + 6, + 8, + 26, + 0, + 4, + 9, + 17, + 5, + 21, + 1, + 16, + 6, + 62, + 3, + 0, + 11, + 17, + 11, + 5, + 13, + 8, + 0, + 9, + 2, + 6, + 1, + 9, + 5, + 4, + 13, + 1, + 16, + 14, + 0, + 1, + 43, + 1, + 7, + 14, + 4, + 21, + 30, + 7, + 1, + 16, + 19, + 10, + 11 + ], + "weighted_loads": [ + 0.31067442148923874, + 0.4455770459026098, + 0.2524085231125355, + 1.8741290047764778, + 0.45051291957497597, + 1.6613039895892143, + 0.2701768334954977, + 0.5334329642355442, + 0.1627153567969799, + 0.586241576820612, + 2.291632067412138, + 0.3526708781719208, + 0.33933467231690884, + 0.18265590444207191, + 0.8643570207059383, + 0.9070309177041054, + 0.36565786600112915, + 0.3727499172091484, + 1.8916526101529598, + 0.0, + 0.2969129905104637, + 0.45220425724983215, + 1.1578820459544659, + 0.22308814711868763, + 1.4982593022286892, + 0.036098163574934006, + 0.5351515393704176, + 0.3057759329676628, + 4.035850798711181, + 0.11907409876585007, + 0.0, + 0.708732258528471, + 1.3274923339486122, + 0.810566421598196, + 0.31788746640086174, + 1.2947879564017057, + 0.4227155800908804, + 0.0, + 0.6099862419068813, + 0.1346270963549614, + 0.3143453262746334, + 0.030591147020459175, + 0.3549668975174427, + 0.2679666504263878, + 0.22036872431635857, + 0.828586757183075, + 0.027518998831510544, + 0.5966470446437597, + 1.8015317134559155, + 0.0, + 0.028971726074814796, + 2.550957404077053, + 0.03461509570479393, + 0.31632976047694683, + 1.212731571868062, + 0.15016206353902817, + 0.9675207026302814, + 1.4455867260694504, + 0.3270433060824871, + 0.03727874159812927, + 0.9901718385517597, + 1.0655525960028172, + 0.6494862511754036, + 0.8035980351269245 + ], + "unique_experts": 60, + "load_cv": 1.0083793691179532, + "normalized_load_entropy": 0.9000085035265539, + "max_load_share": 0.09144542772861357 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "d5dfad644757940d45e5ae4e1d85cfd88f9b874333c11b9350c82c2b272ee041", + "route_weight_sha256": "747dd7a0b80922a25fbdee36ab6a21ac2f8b69965bec07695c8a8ea254086e09", + "loads": [ + 3, + 14, + 5, + 31, + 11, + 28, + 24, + 4, + 3, + 12, + 28, + 11, + 6, + 3, + 12, + 17, + 6, + 9, + 27, + 1, + 4, + 13, + 17, + 6, + 25, + 1, + 19, + 6, + 62, + 17, + 0, + 11, + 18, + 18, + 6, + 13, + 12, + 1, + 9, + 4, + 6, + 5, + 12, + 7, + 15, + 23, + 2, + 17, + 15, + 1, + 2, + 43, + 4, + 10, + 16, + 4, + 24, + 30, + 12, + 5, + 16, + 20, + 10, + 12 + ], + "weighted_loads": [ + 0.31067442148923874, + 0.8367386888712645, + 0.2524085231125355, + 1.8741290047764778, + 0.45051291957497597, + 1.6919647436589003, + 1.6507193613797426, + 0.5334329642355442, + 0.1627153567969799, + 0.7033576890826225, + 2.966867921873927, + 0.6416330654174089, + 0.33933467231690884, + 0.18265590444207191, + 0.8643570207059383, + 1.2156169414520264, + 0.36565786600112915, + 0.40722667425870895, + 1.9336663819849491, + 0.04486439377069473, + 0.2969129905104637, + 0.6286794822663069, + 1.1578820459544659, + 0.2898601535707712, + 1.7700376734137535, + 0.036098163574934006, + 0.6593547370284796, + 0.3057759329676628, + 4.035850798711181, + 0.9781070463359356, + 0.0, + 0.708732258528471, + 1.3676671460270882, + 1.5532119199633598, + 0.3407083209604025, + 1.2947879564017057, + 0.6829613018780947, + 0.03363347426056862, + 0.6099862419068813, + 0.20251502841711044, + 0.3143453262746334, + 0.23103838227689266, + 0.4791176952421665, + 0.37714382261037827, + 1.0633741468191147, + 1.7945598512887955, + 0.05925721302628517, + 0.9575873520225286, + 1.8335984461009502, + 0.05212266743183136, + 0.06758301891386509, + 2.550957404077053, + 0.14480693638324738, + 0.450968349352479, + 1.301838355138898, + 0.15016206353902817, + 1.1274372674524784, + 1.4455867260694504, + 0.5799253545701504, + 0.24518536776304245, + 0.9901718385517597, + 1.0945433117449284, + 0.6494862511754036, + 0.8410005755722523 + ], + "unique_experts": 63, + "load_cv": 0.839732484359913, + "normalized_load_entropy": 0.924638873289332, + "max_load_share": 0.0748792270531401 + } + }, + "s1_period": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "31990000f633445732ce62bf27594d5ac29e031bb9a147143e750ebdc525c854", + "route_weight_sha256": "101e91ebda5e1fec7e886fc2bf6fb2db2df4f5eb61c4d3e811cabcfee75a483b", + "loads": [ + 3, + 10, + 7, + 30, + 11, + 26, + 5, + 6, + 3, + 9, + 20, + 6, + 5, + 4, + 11, + 12, + 6, + 8, + 25, + 0, + 4, + 7, + 17, + 4, + 20, + 1, + 16, + 8, + 64, + 3, + 0, + 12, + 18, + 11, + 4, + 13, + 5, + 0, + 10, + 2, + 6, + 2, + 6, + 7, + 4, + 13, + 2, + 21, + 14, + 0, + 0, + 40, + 1, + 8, + 13, + 4, + 20, + 28, + 5, + 1, + 16, + 18, + 10, + 13 + ], + "weighted_loads": [ + 0.3197691813111305, + 0.4596596974879503, + 0.32789270393550396, + 1.8227486200630665, + 0.42970204912126064, + 1.6319231763482094, + 0.18214446492493153, + 0.5881987437605858, + 0.13112960010766983, + 0.5729351341724396, + 2.379440937191248, + 0.3583257123827934, + 0.30184306763112545, + 0.20393719337880611, + 0.7906094826757908, + 0.9352857209742069, + 0.34143930673599243, + 0.3744928129017353, + 1.9229166619479656, + 0.0, + 0.29369769990444183, + 0.3849138803780079, + 1.168974980711937, + 0.18821245431900024, + 1.4908010885119438, + 0.038351453840732574, + 0.5151486452668905, + 0.36839088797569275, + 4.194001443684101, + 0.12369414791464806, + 0.0, + 0.7244881018996239, + 1.3618021681904793, + 0.7621573694050312, + 0.28328029811382294, + 1.2526179160922766, + 0.3260273989289999, + 0.0, + 0.6780324578285217, + 0.13076994568109512, + 0.31225381046533585, + 0.07796939834952354, + 0.263967489823699, + 0.3666658215224743, + 0.1975112184882164, + 0.8607034869492054, + 0.06971308775246143, + 0.7753980476409197, + 1.86498449370265, + 0.0, + 0.0, + 2.383940586820245, + 0.032482896000146866, + 0.3524318765848875, + 1.1456200685352087, + 0.1528732255101204, + 0.9379392117261887, + 1.2845022641122341, + 0.25506292656064034, + 0.039660707116127014, + 0.9838219881057739, + 1.0418289806693792, + 0.6470668613910675, + 0.8681045137345791 + ], + "unique_experts": 59, + "load_cv": 1.0046445858622506, + "normalized_load_entropy": 0.9004940700223947, + "max_load_share": 0.0943952802359882 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "75138b4e8fbf979f8a95dee4a85414ae8cc5d66633be4ae9e6369b3c59138680", + "route_weight_sha256": "f0bf45444afeb3079c276959d4d320a240c7fb921ad575c8e2e932ba5e5aafeb", + "loads": [ + 8, + 15, + 7, + 30, + 11, + 27, + 32, + 6, + 3, + 11, + 31, + 17, + 5, + 4, + 11, + 19, + 6, + 10, + 27, + 3, + 4, + 12, + 17, + 8, + 24, + 1, + 20, + 8, + 64, + 22, + 8, + 14, + 19, + 24, + 7, + 14, + 11, + 1, + 11, + 3, + 8, + 7, + 14, + 8, + 22, + 25, + 4, + 23, + 16, + 6, + 1, + 40, + 4, + 10, + 15, + 6, + 23, + 40, + 11, + 5, + 17, + 20, + 10, + 14 + ], + "weighted_loads": [ + 0.5235167928040028, + 0.8411257434636354, + 0.32789270393550396, + 1.8227486200630665, + 0.42970204912126064, + 1.6681790724396706, + 2.366128586232662, + 0.5881987437605858, + 0.13112960010766983, + 0.6337869577109814, + 3.0676841903477907, + 1.1303145196288824, + 0.30184306763112545, + 0.20393719337880611, + 0.7906094826757908, + 1.309936836361885, + 0.34143930673599243, + 0.44557612389326096, + 1.9879534039646387, + 0.12323972955346107, + 0.29369769990444183, + 0.6498249545693398, + 1.168974980711937, + 0.3446517698466778, + 1.7922507263720036, + 0.038351453840732574, + 0.6755114011466503, + 0.36839088797569275, + 4.194001443684101, + 1.6429852098226547, + 0.46401742100715637, + 0.797667920589447, + 1.4072511941194534, + 2.0192465260624886, + 0.5097363088279963, + 1.3062815871089697, + 0.707493806257844, + 0.03331625834107399, + 0.7213872671127319, + 0.17388517409563065, + 0.39264262467622757, + 0.3148205354809761, + 0.9096214435994625, + 0.4061349406838417, + 1.5179716404527426, + 1.8542395420372486, + 0.1439680326730013, + 1.1755367536097765, + 2.1179415993392467, + 0.28607814759016037, + 0.037154413759708405, + 2.383940586820245, + 0.1377391442656517, + 0.4352921638637781, + 1.2159441486001015, + 0.22484805434942245, + 1.0904744863510132, + 2.031106561422348, + 0.4888218007981777, + 0.24421972781419754, + 1.011640751734376, + 1.1246437598019838, + 0.6470668613910675, + 0.924580242484808 + ], + "unique_experts": 64, + "load_cv": 0.772930357587977, + "normalized_load_entropy": 0.9366130497579199, + "max_load_share": 0.06926406926406926 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 113, + "ordered_topk_exact_tokens": 80, + "set_exact_tokens": 95, + "mean_set_jaccard": 0.95448798988622, + "mean_token_weighted_tv": 0.010893615902261396, + "aggregate_load_tv": 0.02064896755162242 + }, + "system_bos": { + "tokens": 113, + "ordered_topk_exact_tokens": 63, + "set_exact_tokens": 81, + "mean_set_jaccard": 0.9190897597977244, + "mean_token_weighted_tv": 0.017072739079594612, + "aggregate_load_tv": 0.02654867256637168 + }, + "system_x": { + "tokens": 113, + "ordered_topk_exact_tokens": 57, + "set_exact_tokens": 77, + "mean_set_jaccard": 0.9032869785082174, + "mean_token_weighted_tv": 0.02238993069766897, + "aggregate_load_tv": 0.03982300884955752 + }, + "system_period": { + "tokens": 113, + "ordered_topk_exact_tokens": 53, + "set_exact_tokens": 70, + "mean_set_jaccard": 0.8836915297092288, + "mean_token_weighted_tv": 0.02514080474960857, + "aggregate_load_tv": 0.04277286135693216 + }, + "bos_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 58, + "set_exact_tokens": 77, + "mean_set_jaccard": 0.90897597977244, + "mean_token_weighted_tv": 0.018650927185286992, + "aggregate_load_tv": 0.035398230088495575 + }, + "bos_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 58, + "set_exact_tokens": 73, + "mean_set_jaccard": 0.8988621997471556, + "mean_token_weighted_tv": 0.021615223044249336, + "aggregate_load_tv": 0.03097345132743363 + }, + "x_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 55, + "set_exact_tokens": 74, + "mean_set_jaccard": 0.8994943109987359, + "mean_token_weighted_tv": 0.02161774361522588, + "aggregate_load_tv": 0.038348082595870206 + }, + "x_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 46, + "set_exact_tokens": 63, + "mean_set_jaccard": 0.8697850821744629, + "mean_token_weighted_tv": 0.027749968486615515, + "aggregate_load_tv": 0.04129793510324484 + }, + "period_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 53, + "set_exact_tokens": 74, + "mean_set_jaccard": 0.9013906447534766, + "mean_token_weighted_tv": 0.02162716312713064, + "aggregate_load_tv": 0.03982300884955753 + }, + "period_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 48, + "set_exact_tokens": 64, + "mean_set_jaccard": 0.8723135271807839, + "mean_token_weighted_tv": 0.026882632874545797, + "aggregate_load_tv": 0.03982300884955752 + } + } + }, + "layer_14": { + "layer": 14, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "300655b9abc2b7c2a04c742b5d92aae985acd7583d89018b4db6e1c00d20f1b6", + "route_weight_sha256": "1803354ee6019f45b5b42d0a608eaaa26b0793401fbed8a336a05987a0337695", + "loads": [ + 14, + 4, + 18, + 5, + 12, + 7, + 2, + 11, + 13, + 4, + 17, + 4, + 2, + 12, + 12, + 14, + 2, + 10, + 3, + 15, + 19, + 16, + 1, + 6, + 2, + 17, + 9, + 13, + 5, + 19, + 12, + 13, + 4, + 1, + 5, + 12, + 6, + 11, + 17, + 7, + 14, + 22, + 10, + 0, + 27, + 6, + 21, + 19, + 9, + 7, + 1, + 14, + 8, + 0, + 8, + 12, + 11, + 7, + 11, + 20, + 10, + 9, + 13, + 43 + ], + "weighted_loads": [ + 1.3853178769350052, + 0.15825817734003067, + 0.9020190052688122, + 0.1947254203259945, + 0.786377988755703, + 0.5806219819933176, + 0.05168576259166002, + 0.4107742942869663, + 0.7234119158238173, + 0.23907045274972916, + 0.9473387598991394, + 0.12302392162382603, + 0.08156740665435791, + 2.047683723270893, + 0.5677811093628407, + 0.8178716469556093, + 0.06792281195521355, + 0.7358936704695225, + 0.44514933973550797, + 2.3602857291698456, + 1.4336611069738865, + 1.2745176069438457, + 0.04899193346500397, + 0.3022715114057064, + 0.07415148988366127, + 0.9198133964091539, + 0.8904303219169378, + 0.7113047055900097, + 0.30886833369731903, + 1.2145694606006145, + 0.626499243080616, + 0.5440214909613132, + 0.302767988294363, + 0.0887451171875, + 0.28093789517879486, + 0.637175539508462, + 0.2942458651959896, + 0.8086006939411163, + 1.2751230839639902, + 0.665047861635685, + 0.6123009081929922, + 1.0981168579310179, + 0.4377239290624857, + 0.0, + 1.2751786354929209, + 0.40071477741003036, + 2.1085922475904226, + 2.2157474476844072, + 0.8095018956810236, + 0.780225396156311, + 0.047414205968379974, + 0.7869613021612167, + 0.8076848648488522, + 0.0, + 0.35719545744359493, + 0.66086295992136, + 1.286632776260376, + 0.30621681548655033, + 0.5152053833007812, + 1.3704711440950632, + 0.5418385043740273, + 0.6023517958819866, + 1.0737792328000069, + 2.8403061758726835 + ], + "unique_experts": 62, + "load_cv": 0.6905868701946164, + "normalized_load_entropy": 0.9429703632220787, + "max_load_share": 0.06342182890855458 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "7bc29d49ff91cf638eb3faa9a3e82c23788952f49607358ec510b18fe37e2b1a", + "route_weight_sha256": "e9a67acecbfa605a9b2a356a45a65b36594c53b2b6c4ca6efdbea712e5724cd1", + "loads": [ + 20, + 4, + 18, + 7, + 12, + 18, + 2, + 13, + 13, + 12, + 19, + 7, + 2, + 12, + 13, + 19, + 2, + 10, + 8, + 16, + 19, + 16, + 1, + 17, + 3, + 17, + 15, + 19, + 13, + 19, + 15, + 18, + 4, + 8, + 5, + 12, + 8, + 12, + 19, + 7, + 14, + 22, + 11, + 1, + 29, + 6, + 27, + 21, + 9, + 8, + 4, + 19, + 14, + 6, + 8, + 16, + 11, + 7, + 11, + 33, + 10, + 10, + 13, + 44 + ], + "weighted_loads": [ + 2.042597534134984, + 0.15825817734003067, + 0.9020190052688122, + 0.2713233679533005, + 0.786377988755703, + 1.5476653333753347, + 0.05168576259166002, + 0.4836384579539299, + 0.7234119158238173, + 0.8788185343146324, + 1.0135764796286821, + 0.3130842987447977, + 0.08156740665435791, + 2.047683723270893, + 0.6073777265846729, + 1.1519594099372625, + 0.06792281195521355, + 0.7358936704695225, + 0.8285802211612463, + 2.400155909359455, + 1.4336611069738865, + 1.2745176069438457, + 0.04899193346500397, + 0.7790824398398399, + 0.09674151241779327, + 0.9198133964091539, + 1.2359440568834543, + 1.1032017534598708, + 1.4245471507310867, + 1.2145694606006145, + 0.8273217082023621, + 0.7453546244651079, + 0.302767988294363, + 0.6944915242493153, + 0.28093789517879486, + 0.637175539508462, + 0.39049579203128815, + 0.8511809259653091, + 1.3811889048665762, + 0.665047861635685, + 0.6123009081929922, + 1.0981168579310179, + 0.48677302710711956, + 0.0483388714492321, + 1.3390313144773245, + 0.40071477741003036, + 2.4078409634530544, + 2.3021250776946545, + 0.8095018956810236, + 0.82291579246521, + 0.172641322016716, + 2.07997564971447, + 1.5538046024739742, + 0.42256834730505943, + 0.35719545744359493, + 1.0206436663866043, + 1.286632776260376, + 0.30621681548655033, + 0.5152053833007812, + 1.9312129616737366, + 0.5418385043740273, + 0.6073736762627959, + 1.0737792328000069, + 2.8873485904186964 + ], + "unique_experts": 64, + "load_cv": 0.6024330855248143, + "normalized_load_entropy": 0.9570405813995845, + "max_load_share": 0.05314009661835749 + } + }, + "s1_eos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "96d3ef3ef4bb26defa79c9e771f2d3c0fb8d54b9c84142a20746ab1ce9ec5182", + "route_weight_sha256": "4c92717a417df31d7b4a1d32819c5d2c09d5a9eddc841b3463590d88b54df730", + "loads": [ + 14, + 3, + 18, + 5, + 12, + 7, + 2, + 10, + 13, + 4, + 17, + 4, + 3, + 11, + 14, + 13, + 2, + 11, + 3, + 14, + 18, + 18, + 1, + 6, + 2, + 16, + 9, + 13, + 6, + 19, + 11, + 11, + 3, + 1, + 5, + 12, + 6, + 12, + 17, + 7, + 16, + 22, + 9, + 0, + 29, + 6, + 21, + 18, + 10, + 7, + 1, + 13, + 8, + 0, + 9, + 12, + 11, + 7, + 10, + 19, + 9, + 9, + 13, + 46 + ], + "weighted_loads": [ + 1.3827023729681969, + 0.11838678643107414, + 0.9090910814702511, + 0.18794164434075356, + 0.7930141277611256, + 0.5853247717022896, + 0.05529021192342043, + 0.3805636391043663, + 0.7132590133696795, + 0.2549484372138977, + 0.9767118263989687, + 0.12341206707060337, + 0.11008875630795956, + 2.0257479324936867, + 0.6164971571415663, + 0.795685563236475, + 0.06852759420871735, + 0.7723817620426416, + 0.4403417631983757, + 2.290616098791361, + 1.3981495089828968, + 1.2958588562905788, + 0.050103332847356796, + 0.3059343919157982, + 0.07264624536037445, + 0.8828270938247442, + 0.8771179169416428, + 0.7288373615592718, + 0.3300487454980612, + 1.2016018815338612, + 0.6105866394937038, + 0.486269298940897, + 0.2736956402659416, + 0.08862610906362534, + 0.2776339016854763, + 0.6442971453070641, + 0.3020603284239769, + 0.8452299274504185, + 1.2787559311836958, + 0.6678959056735039, + 0.6987574622035027, + 1.091245710849762, + 0.38914231583476067, + 0.0, + 1.3010297771543264, + 0.40562883391976357, + 2.1045980267226696, + 2.17695989087224, + 0.8220638707280159, + 0.77215276658535, + 0.049934133887290955, + 0.7695418410003185, + 0.8146742396056652, + 0.0, + 0.3874204698950052, + 0.6525385305285454, + 1.287665892392397, + 0.3111446127295494, + 0.4779910482466221, + 1.293343560770154, + 0.4985335245728493, + 0.5979385003447533, + 1.0771161913871765, + 2.935846623033285 + ], + "unique_experts": 62, + "load_cv": 0.7141750707086623, + "normalized_load_entropy": 0.9411927495807031, + "max_load_share": 0.06784660766961652 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "75833e64ea364af831c7931a249137be29a45422706ca2c1cd531979751faa71", + "route_weight_sha256": "4d9ebeed642c893d01003e48ff875091dd6413d55f1a5b5d12fd755b0b7f98aa", + "loads": [ + 21, + 4, + 18, + 8, + 16, + 24, + 2, + 14, + 15, + 15, + 17, + 7, + 8, + 11, + 15, + 19, + 2, + 11, + 10, + 18, + 20, + 21, + 1, + 16, + 8, + 18, + 14, + 21, + 19, + 20, + 16, + 14, + 5, + 12, + 6, + 13, + 7, + 15, + 20, + 8, + 16, + 22, + 11, + 1, + 31, + 6, + 27, + 20, + 13, + 8, + 15, + 17, + 16, + 9, + 11, + 15, + 12, + 8, + 11, + 39, + 12, + 11, + 15, + 49 + ], + "weighted_loads": [ + 2.1252007707953453, + 0.17004387080669403, + 0.9090910814702511, + 0.29837751761078835, + 1.0449002869427204, + 1.772517278790474, + 0.05529021192342043, + 0.5448580123484135, + 0.8821964580565691, + 1.172533005475998, + 0.9767118263989687, + 0.3390010576695204, + 0.46147878654301167, + 2.0257479324936867, + 0.648022660985589, + 1.1714945137500763, + 0.06852759420871735, + 0.7723817620426416, + 0.9835284538567066, + 2.492898980155587, + 1.6277130953967571, + 1.4187832958996296, + 0.050103332847356796, + 0.7276570722460747, + 0.35078008845448494, + 0.9566913917660713, + 1.2457466796040535, + 1.0365675296634436, + 1.9680524375289679, + 1.249828401952982, + 0.859689936041832, + 0.5757725350558758, + 0.3524645157158375, + 1.1900415010750294, + 0.3239506930112839, + 0.72372617572546, + 0.3477604016661644, + 1.19862412661314, + 1.4736125562340021, + 0.7272237502038479, + 0.6987574622035027, + 1.091245710849762, + 0.4885425232350826, + 0.044879086315631866, + 1.3648066315799952, + 0.40562883391976357, + 2.4283870607614517, + 2.2448618914932013, + 0.980165284126997, + 0.8063059784471989, + 0.950529407709837, + 2.03394578024745, + 1.6201713681221008, + 0.7027744203805923, + 0.46890891529619694, + 0.956123523414135, + 1.3387274257838726, + 0.34846485778689384, + 0.5876605324447155, + 2.3831408713012934, + 0.7506521791219711, + 0.6441238061524928, + 1.1814611293375492, + 3.0431526824831963 + ], + "unique_experts": 64, + "load_cv": 0.5645493035320418, + "normalized_load_entropy": 0.9632411742423105, + "max_load_share": 0.05303030303030303 + } + }, + "s0_bos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "eab88191f0dd55ff3bb36bc1807ff8a4c22ae9ad6a3bdacfd4977dc77ded3e96", + "route_weight_sha256": "e16f96ff85848ecd1bb25fe5f1d3917a2f305f1a96dfcdd5003e2a0db4a3e33e", + "loads": [ + 15, + 7, + 21, + 6, + 13, + 6, + 1, + 10, + 13, + 4, + 18, + 4, + 2, + 12, + 10, + 14, + 1, + 9, + 3, + 15, + 19, + 15, + 1, + 6, + 2, + 17, + 9, + 11, + 7, + 19, + 11, + 11, + 5, + 1, + 5, + 13, + 9, + 12, + 15, + 9, + 13, + 21, + 11, + 0, + 22, + 7, + 23, + 18, + 10, + 7, + 2, + 13, + 8, + 0, + 7, + 12, + 11, + 5, + 9, + 19, + 9, + 10, + 13, + 47 + ], + "weighted_loads": [ + 1.4151131585240364, + 0.26475576870143414, + 1.0481959655880928, + 0.2190736960619688, + 0.8270639330148697, + 0.5579511690884829, + 0.03887490555644035, + 0.3692683819681406, + 0.727811211720109, + 0.2332441285252571, + 0.980379119515419, + 0.1277425792068243, + 0.0835212767124176, + 2.108085388317704, + 0.5351917874068022, + 0.8156836945563555, + 0.033646050840616226, + 0.7075842395424843, + 0.45137258991599083, + 2.3569474555552006, + 1.471623845398426, + 1.2758109495043755, + 0.046299129724502563, + 0.3023458495736122, + 0.0785495974123478, + 0.9159314818680286, + 0.8819649629294872, + 0.6812140066176653, + 0.3747711982578039, + 1.1965072825551033, + 0.5905018039047718, + 0.46407627686858177, + 0.3385479375720024, + 0.07731172442436218, + 0.2716740369796753, + 0.6818228885531425, + 0.4034188333898783, + 0.8445385619997978, + 1.2059783264994621, + 0.7439510226249695, + 0.5795643664896488, + 1.1100515276193619, + 0.4678043033927679, + 0.0, + 1.077199007384479, + 0.40017977729439735, + 2.162655744701624, + 2.1297057438641787, + 0.855118976905942, + 0.77801663428545, + 0.07084564305841923, + 0.7446699645370245, + 0.7844538316130638, + 0.0, + 0.31174342706799507, + 0.6758706979453564, + 1.2973931021988392, + 0.2373809739947319, + 0.4352791868150234, + 1.3394684754312038, + 0.4919152408838272, + 0.6194373145699501, + 1.074938803911209, + 3.054120283573866 + ], + "unique_experts": 62, + "load_cv": 0.7003958743707236, + "normalized_load_entropy": 0.9432536197657088, + "max_load_share": 0.06932153392330384 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "cdab40582d7043dd3575fd46f20b18410b675e1d6029513854a43b89b437c933", + "route_weight_sha256": "839e638b8440ac3a8d190b61cfcb6190193090b56f71041c1a1e6b45ab446a75", + "loads": [ + 21, + 7, + 21, + 9, + 13, + 16, + 1, + 11, + 13, + 12, + 20, + 7, + 2, + 12, + 11, + 19, + 1, + 9, + 9, + 16, + 19, + 15, + 1, + 16, + 3, + 17, + 15, + 17, + 16, + 19, + 14, + 15, + 5, + 8, + 5, + 13, + 11, + 13, + 17, + 9, + 13, + 21, + 11, + 1, + 25, + 7, + 29, + 20, + 10, + 8, + 5, + 18, + 14, + 6, + 7, + 16, + 11, + 6, + 10, + 32, + 9, + 10, + 13, + 48 + ], + "weighted_loads": [ + 2.0723928157240152, + 0.26475576870143414, + 1.0481959655880928, + 0.33729483745992184, + 0.8270639330148697, + 1.4880311731249094, + 0.03887490555644035, + 0.402808615937829, + 0.727811211720109, + 0.9107369855046272, + 1.0466168392449617, + 0.317802956327796, + 0.0835212767124176, + 2.108085388317704, + 0.5748162847012281, + 1.1551158968359232, + 0.033646050840616226, + 0.7075842395424843, + 0.9112540315836668, + 2.39681763574481, + 1.471623845398426, + 1.2758109495043755, + 0.046299129724502563, + 0.7514582481235266, + 0.1011396199464798, + 0.9159314818680286, + 1.2274786978960037, + 1.133663496002555, + 1.5736506190150976, + 1.1965072825551033, + 0.7909302562475204, + 0.6663490459322929, + 0.3385479375720024, + 0.683987207710743, + 0.2716740369796753, + 0.6818228885531425, + 0.5017784032970667, + 0.8871187940239906, + 1.3186684548854828, + 0.7439510226249695, + 0.5795643664896488, + 1.1100515276193619, + 0.4678043033927679, + 0.0483388714492321, + 1.2130056014284492, + 0.40017977729439735, + 2.448198078200221, + 2.216083373874426, + 0.855118976905942, + 0.8207070305943489, + 0.2041232418268919, + 1.232919979840517, + 1.5305735692381859, + 0.42256834730505943, + 0.31174342706799507, + 1.0697933174669743, + 1.2973931021988392, + 0.28014538809657097, + 0.47662319988012314, + 1.9055679589509964, + 0.4919152408838272, + 0.6194373145699501, + 1.074938803911209, + 3.1043093502521515 + ], + "unique_experts": 64, + "load_cv": 0.6053701043133372, + "normalized_load_entropy": 0.9575352226659748, + "max_load_share": 0.057971014492753624 + } + }, + "s1_bos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "1648f74f0c8864a5065feb1afe731125ec93654a3e1832f524674eb3e75a897a", + "route_weight_sha256": "6a1d3ce8f65aaa015d9e808febf0499efc491f4f9b8ddac395acb9aa51a4f42a", + "loads": [ + 13, + 6, + 19, + 6, + 12, + 8, + 2, + 9, + 13, + 4, + 19, + 4, + 2, + 12, + 12, + 14, + 0, + 10, + 3, + 15, + 19, + 17, + 1, + 6, + 2, + 17, + 9, + 12, + 5, + 19, + 11, + 12, + 3, + 1, + 4, + 11, + 11, + 12, + 15, + 8, + 13, + 17, + 11, + 0, + 27, + 6, + 22, + 18, + 10, + 7, + 2, + 13, + 8, + 1, + 10, + 12, + 11, + 6, + 9, + 19, + 10, + 10, + 13, + 45 + ], + "weighted_loads": [ + 1.3585282918065786, + 0.2240984309464693, + 0.9517062455415726, + 0.23122150637209415, + 0.8034353591501713, + 0.6419350113719702, + 0.055869968608021736, + 0.33240113593637943, + 0.7143960669636726, + 0.22279700636863708, + 1.0314881019294262, + 0.12869605980813503, + 0.0874063428491354, + 2.1150277499109507, + 0.6020008213818073, + 0.7958043925464153, + 0.0, + 0.7576247453689575, + 0.45462358742952347, + 2.390444589778781, + 1.4566316958516836, + 1.3356285281479359, + 0.04709051921963692, + 0.31686877831816673, + 0.07896909490227699, + 0.9042965415865183, + 0.873102804645896, + 0.6842697160318494, + 0.2755446322262287, + 1.1971873883157969, + 0.6160730421543121, + 0.490203145891428, + 0.2676481604576111, + 0.08202286064624786, + 0.2342274710536003, + 0.6120180357247591, + 0.4745290484279394, + 0.8477688729763031, + 1.208660189062357, + 0.7197159379720688, + 0.5767647661268711, + 0.9542996324598789, + 0.46273026801645756, + 0.0, + 1.2711026687175035, + 0.37847596779465675, + 2.134106282144785, + 2.158664895221591, + 0.833759393543005, + 0.7654229253530502, + 0.08683522790670395, + 0.7573177423328161, + 0.7817010208964348, + 0.043491773307323456, + 0.41473823599517345, + 0.6592497229576111, + 1.2960505187511444, + 0.2720479816198349, + 0.4458084888756275, + 1.3960869051516056, + 0.5212466195225716, + 0.6042981222271919, + 1.0722974464297295, + 2.9780516419559717 + ], + "unique_experts": 62, + "load_cv": 0.6909899634534302, + "normalized_load_entropy": 0.9438403843452136, + "max_load_share": 0.06637168141592921 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "7500a9311103d252890fe088768d840e3bfbaa1cdaba3e4ff71900643cb79f0a", + "route_weight_sha256": "03613b6db4928f439b0bc96c00ff937bcae58ef29d95c54bed9e04c64d410688", + "loads": [ + 20, + 7, + 19, + 8, + 15, + 24, + 2, + 12, + 15, + 15, + 20, + 7, + 7, + 12, + 13, + 21, + 0, + 10, + 10, + 19, + 21, + 19, + 1, + 15, + 8, + 19, + 14, + 20, + 19, + 20, + 16, + 15, + 5, + 12, + 5, + 12, + 12, + 15, + 18, + 9, + 13, + 17, + 12, + 1, + 29, + 7, + 28, + 21, + 13, + 8, + 17, + 17, + 16, + 10, + 12, + 15, + 12, + 8, + 10, + 39, + 13, + 11, + 15, + 49 + ], + "weighted_loads": [ + 2.101026689633727, + 0.2757555153220892, + 0.9517062455415726, + 0.3203724753111601, + 1.0115616619586945, + 1.7714848201721907, + 0.055869968608021736, + 0.45923307351768017, + 0.8833335116505623, + 1.1519402638077736, + 1.063355766236782, + 0.34428505040705204, + 0.4387963730841875, + 2.1150277499109507, + 0.6390617899596691, + 1.1999038979411125, + 0.0, + 0.7576247453689575, + 0.9438732676208019, + 2.5927274711430073, + 1.686195282265544, + 1.4103594720363617, + 0.04709051921963692, + 0.7110342439264059, + 0.3571029379963875, + 0.9781608395278454, + 1.2417315673083067, + 1.0776746040210128, + 2.098697926849127, + 1.2454139087349176, + 0.8795739039778709, + 0.6281200535595417, + 0.34641703590750694, + 1.168538935482502, + 0.2805442623794079, + 0.6914470661431551, + 0.5191552359610796, + 1.2011630721390247, + 1.410771906375885, + 0.7790437825024128, + 0.5767647661268711, + 0.9542996324598789, + 0.5171365570276976, + 0.044879086315631866, + 1.3348795231431723, + 0.4145926795899868, + 2.454964142292738, + 2.2620047703385353, + 0.9918608069419861, + 0.7995761372148991, + 1.021764937788248, + 1.197121148929, + 1.5871981494128704, + 0.7462661936879158, + 0.49622668139636517, + 1.0137799680233002, + 1.34711205214262, + 0.3522444777190685, + 0.5554779730737209, + 2.505114868283272, + 0.7733652740716934, + 0.645727202296257, + 1.1766423843801022, + 3.129499452188611 + ], + "unique_experts": 63, + "load_cv": 0.5576019729794809, + "normalized_load_entropy": 0.9633299104563955, + "max_load_share": 0.05303030303030303 + } + }, + "s0_x": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "fca0dfe61036908773a6f2e0ec2505c08838ea9bfa2f11b094c7cba36df7921d", + "route_weight_sha256": "df08ecf2dca9390d6468b4851f3122ad871fbe0f00b14e0d8479055531c6b31c", + "loads": [ + 15, + 7, + 20, + 4, + 13, + 7, + 1, + 10, + 13, + 4, + 20, + 4, + 2, + 12, + 10, + 14, + 1, + 10, + 2, + 14, + 19, + 17, + 1, + 4, + 2, + 17, + 9, + 11, + 5, + 19, + 12, + 10, + 4, + 1, + 5, + 13, + 9, + 11, + 15, + 8, + 10, + 21, + 10, + 0, + 28, + 8, + 22, + 17, + 9, + 7, + 2, + 14, + 8, + 1, + 9, + 12, + 11, + 6, + 9, + 20, + 10, + 10, + 13, + 46 + ], + "weighted_loads": [ + 1.4131400417536497, + 0.2849206496030092, + 1.0188711620867252, + 0.15341676771640778, + 0.8406344018876553, + 0.6087673120200634, + 0.03802157938480377, + 0.3694916646927595, + 0.7604851759970188, + 0.23222488164901733, + 1.069637168198824, + 0.12838007509708405, + 0.08258378878235817, + 2.127371709793806, + 0.5179925505071878, + 0.8229077607393265, + 0.033921029418706894, + 0.749396063387394, + 0.4063337445259094, + 2.307077817618847, + 1.458470195531845, + 1.3275664653629065, + 0.04892537742853165, + 0.23192963376641273, + 0.08033640310168266, + 0.9266910664737225, + 0.8800222333520651, + 0.6920921970158815, + 0.3042237348854542, + 1.2273902632296085, + 0.6409672237932682, + 0.41781967878341675, + 0.29697103053331375, + 0.08316697180271149, + 0.2913414537906647, + 0.6491418480873108, + 0.3908988069742918, + 0.786852914839983, + 1.1898055970668793, + 0.7114843539893627, + 0.46312365122139454, + 1.1234187707304955, + 0.4592744577676058, + 0.0, + 1.287600421346724, + 0.42978932801634073, + 2.1317853406071663, + 2.1178524643182755, + 0.8502205163240433, + 0.7988850995898247, + 0.08482294157147408, + 0.772992093116045, + 0.7736947871744633, + 0.04281598702073097, + 0.3956922683864832, + 0.6758575513958931, + 1.3342644199728966, + 0.2773122005164623, + 0.4219488874077797, + 1.4483429789543152, + 0.5251596700400114, + 0.6165726780891418, + 1.0827426724135876, + 3.0216636043041945 + ], + "unique_experts": 63, + "load_cv": 0.7149544322808808, + "normalized_load_entropy": 0.9413986384618138, + "max_load_share": 0.06784660766961652 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "46073004d30da1d481569a6ee0e1a57cf6b3e0cbbd44010bda7f0b8295511634", + "route_weight_sha256": "98e2b4c5cb46d9b72d481d74cc551b19526480fe628a7a8ed2e37f73d3e8579a", + "loads": [ + 22, + 7, + 20, + 6, + 14, + 20, + 1, + 12, + 13, + 11, + 22, + 7, + 2, + 12, + 11, + 19, + 1, + 10, + 7, + 16, + 19, + 17, + 1, + 14, + 3, + 17, + 16, + 16, + 13, + 19, + 15, + 14, + 4, + 8, + 5, + 13, + 11, + 13, + 16, + 8, + 10, + 21, + 10, + 1, + 30, + 8, + 28, + 19, + 9, + 8, + 5, + 17, + 14, + 8, + 9, + 16, + 11, + 7, + 9, + 34, + 10, + 10, + 13, + 46 + ], + "weighted_loads": [ + 2.175740025937557, + 0.2849206496030092, + 1.0188711620867252, + 0.23678869009017944, + 0.8887633830308914, + 1.7478372976183891, + 0.03802157938480377, + 0.45068938843905926, + 0.7604851759970188, + 0.7402095422148705, + 1.1358748879283667, + 0.3184404522180557, + 0.08258378878235817, + 2.127371709793806, + 0.5552769992500544, + 1.1141047962009907, + 0.033921029418706894, + 0.749396063387394, + 0.7728440929204226, + 2.42111986130476, + 1.458470195531845, + 1.3275664653629065, + 0.04892537742853165, + 0.6810420323163271, + 0.10292642563581467, + 0.9266910664737225, + 1.3354510013014078, + 1.0719506721943617, + 1.2812169678509235, + 1.2273902632296085, + 0.8366974219679832, + 0.614736907184124, + 0.29697103053331375, + 0.7119397819042206, + 0.2913414537906647, + 0.6491418480873108, + 0.4929788466542959, + 0.9046629704535007, + 1.2489096596837044, + 0.7114843539893627, + 0.46312365122139454, + 1.1234187707304955, + 0.4592744577676058, + 0.0483388714492321, + 1.3514531003311276, + 0.42978932801634073, + 2.421560013666749, + 2.2042300943285227, + 0.8502205163240433, + 0.8415754958987236, + 0.22041378170251846, + 1.1816654037684202, + 1.5198145247995853, + 0.5499134659767151, + 0.3956922683864832, + 1.0304083451628685, + 1.3342644199728966, + 0.3180411197245121, + 0.4219488874077797, + 2.0707715898752213, + 0.5251596700400114, + 0.6165726780891418, + 1.0827426724135876, + 3.0216636043041945 + ], + "unique_experts": 64, + "load_cv": 0.6147046394332898, + "normalized_load_entropy": 0.956185771574257, + "max_load_share": 0.05555555555555555 + } + }, + "s1_x": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "5c4dff62cb14cfb6bb53d0873a5a8b21d991ca4fbbe44d0a1de6fa9e3d00e957", + "route_weight_sha256": "87a58a348cf27977fd3cb620af1c16bfe9c352e9466eed1b1f1c4a606171b940", + "loads": [ + 13, + 7, + 20, + 4, + 12, + 7, + 1, + 10, + 12, + 4, + 19, + 4, + 2, + 12, + 13, + 14, + 2, + 13, + 4, + 14, + 17, + 17, + 1, + 6, + 2, + 17, + 8, + 10, + 4, + 20, + 11, + 9, + 3, + 2, + 5, + 10, + 13, + 12, + 16, + 8, + 12, + 18, + 9, + 0, + 29, + 8, + 23, + 16, + 9, + 7, + 3, + 13, + 9, + 1, + 10, + 12, + 11, + 6, + 8, + 19, + 9, + 10, + 13, + 45 + ], + "weighted_loads": [ + 1.3658260498195887, + 0.27902355417609215, + 0.994837686419487, + 0.14335530437529087, + 0.8083643279969692, + 0.6265622563660145, + 0.04850160330533981, + 0.3591654412448406, + 0.7100427597761154, + 0.2353963814675808, + 1.0110644064843655, + 0.1286752913147211, + 0.08456932567059994, + 2.086280722171068, + 0.6094551719725132, + 0.8079900164157152, + 0.0717097856104374, + 0.8696876130998135, + 0.48035916686058044, + 2.329794403165579, + 1.3539730310440063, + 1.3331349231302738, + 0.045183781534433365, + 0.3114771395921707, + 0.0805496908724308, + 0.9172048978507519, + 0.8410633783787489, + 0.6283308230340481, + 0.21883191168308258, + 1.232613818719983, + 0.6533390507102013, + 0.39501651749014854, + 0.261396586894989, + 0.11036601662635803, + 0.26686806604266167, + 0.5804693698883057, + 0.5341307483613491, + 0.8390983678400517, + 1.2135555781424046, + 0.7250700891017914, + 0.528472263365984, + 0.9827537573873997, + 0.4013976491987705, + 0.0, + 1.326076460070908, + 0.42722547613084316, + 2.168952226638794, + 2.1018768548965454, + 0.8202384114265442, + 0.7878722175955772, + 0.11945950426161289, + 0.7371596712619066, + 0.8022235799580812, + 0.04370740428566933, + 0.4181532543152571, + 0.6761324517428875, + 1.2986932918429375, + 0.2981199398636818, + 0.3855340704321861, + 1.3460870198905468, + 0.495579332113266, + 0.5884130820631981, + 1.0837025046348572, + 2.924073724076152 + ], + "unique_experts": 63, + "load_cv": 0.6952083319618879, + "normalized_load_entropy": 0.9453072872254312, + "max_load_share": 0.06637168141592921 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "af8acdb17bf6821ae49880a60af1b68a1bafb2fce8a813ba73a6e7729d0543bc", + "route_weight_sha256": "1ec338a9b12f30f06ebf2afdea635c41484fdfba051da621f6066f2fd13f6db3", + "loads": [ + 21, + 8, + 20, + 6, + 16, + 27, + 1, + 14, + 14, + 14, + 19, + 8, + 7, + 12, + 13, + 19, + 2, + 13, + 10, + 18, + 19, + 19, + 1, + 16, + 8, + 20, + 14, + 17, + 17, + 21, + 17, + 11, + 5, + 13, + 7, + 11, + 14, + 16, + 19, + 9, + 12, + 18, + 11, + 1, + 31, + 8, + 29, + 18, + 12, + 8, + 17, + 16, + 17, + 11, + 12, + 15, + 12, + 7, + 9, + 38, + 12, + 11, + 15, + 48 + ], + "weighted_loads": [ + 2.1882851738482714, + 0.33068063855171204, + 0.994837686419487, + 0.21739915944635868, + 1.0628933645784855, + 2.0603235587477684, + 0.04850160330533981, + 0.5260644741356373, + 0.8789802044630051, + 0.962567899376154, + 1.0110644064843655, + 0.3915728013962507, + 0.43595935590565205, + 2.086280722171068, + 0.6094551719725132, + 1.1052613575011492, + 0.0717097856104374, + 0.8696876130998135, + 0.9329091869294643, + 2.532077284529805, + 1.5835366174578667, + 1.4078658670186996, + 0.045183781534433365, + 0.760049493983388, + 0.3586835339665413, + 1.0220204181969166, + 1.312899535521865, + 0.9230992812663317, + 1.6310600563883781, + 1.280840339139104, + 0.9257406964898109, + 0.4737543500959873, + 0.3401654623448849, + 1.166434284299612, + 0.34587693586945534, + 0.6598984003067017, + 0.5778044834733009, + 1.2863858416676521, + 1.390547476708889, + 0.7843979336321354, + 0.528472263365984, + 0.9827537573873997, + 0.5116956979036331, + 0.044879086315631866, + 1.3898533144965768, + 0.42722547613084316, + 2.4805486127734184, + 2.1697788555175066, + 0.9783398248255253, + 0.8220254294574261, + 1.0148217137902975, + 1.1489805858582258, + 1.6077207084745169, + 0.8672365956008434, + 0.4996416997164488, + 0.9183867461979389, + 1.3497548252344131, + 0.33544018492102623, + 0.49520355463027954, + 2.410743620246649, + 0.7476979866623878, + 0.6298421621322632, + 1.1880474425852299, + 3.031379783526063 + ], + "unique_experts": 64, + "load_cv": 0.552334132011305, + "normalized_load_entropy": 0.9647147836321752, + "max_load_share": 0.05194805194805195 + } + }, + "s0_period": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "a86cf2e4a7bdb6ad2f27044b2d7692a559453773e787dd1592a09f4d7ada4b44", + "route_weight_sha256": "61ac41c7908213759a1b10db21fe63c9f675c04946b94a19c528f6a535023881", + "loads": [ + 13, + 7, + 20, + 4, + 12, + 8, + 1, + 11, + 13, + 4, + 19, + 4, + 2, + 12, + 11, + 13, + 2, + 10, + 2, + 14, + 19, + 17, + 1, + 5, + 2, + 16, + 9, + 11, + 6, + 19, + 11, + 10, + 4, + 2, + 4, + 13, + 10, + 11, + 15, + 8, + 11, + 21, + 9, + 0, + 27, + 9, + 21, + 17, + 10, + 7, + 2, + 14, + 8, + 0, + 9, + 12, + 11, + 7, + 9, + 21, + 10, + 10, + 13, + 45 + ], + "weighted_loads": [ + 1.3507851865142584, + 0.277728620916605, + 1.0110667645931244, + 0.1531916745007038, + 0.8097617626190186, + 0.6274883300065994, + 0.03575447201728821, + 0.4001103825867176, + 0.7497424259781837, + 0.25452838465571404, + 1.0469575058668852, + 0.12547699362039566, + 0.08231167122721672, + 2.101372465491295, + 0.558685652911663, + 0.8356067724525928, + 0.06751852855086327, + 0.7442486993968487, + 0.396877259016037, + 2.3039722703397274, + 1.4472458809614182, + 1.3267148323357105, + 0.05106906220316887, + 0.2649698071181774, + 0.07689693942666054, + 0.8804296869784594, + 0.8925951160490513, + 0.6980951204895973, + 0.36960354819893837, + 1.226507306098938, + 0.6112036108970642, + 0.42734570801258087, + 0.2956971116364002, + 0.12424829229712486, + 0.2527666687965393, + 0.6584274657070637, + 0.4238912742584944, + 0.7831214517354965, + 1.1929459124803543, + 0.7108032591640949, + 0.5143924430012703, + 1.120144683867693, + 0.4127887338399887, + 0.0, + 1.2611921411007643, + 0.44460275676101446, + 2.1064961142838, + 2.1122276354581118, + 0.8559036944061518, + 0.7987797930836678, + 0.08733337000012398, + 0.76814254373312, + 0.7561198435723782, + 0.0, + 0.4021169953048229, + 0.6725190691649914, + 1.322672601789236, + 0.31792918406426907, + 0.4204428158700466, + 1.4496055208146572, + 0.5234454814344645, + 0.6182630509138107, + 1.090240877121687, + 2.960776664316654 + ], + "unique_experts": 62, + "load_cv": 0.6944068088756595, + "normalized_load_entropy": 0.9438794132299714, + "max_load_share": 0.06637168141592921 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "345c4c723c2b185987a842d492626b862b3b135287a7fb37d8431f139a3c6be6", + "route_weight_sha256": "54505e1e9ee22291c12ca2a01b53894a266a93a1526b53ea783050e3763c49ec", + "loads": [ + 20, + 7, + 20, + 6, + 13, + 20, + 1, + 13, + 13, + 11, + 21, + 7, + 2, + 12, + 11, + 18, + 2, + 10, + 7, + 15, + 19, + 17, + 1, + 15, + 3, + 16, + 16, + 16, + 14, + 19, + 14, + 14, + 4, + 9, + 4, + 13, + 12, + 13, + 16, + 8, + 11, + 21, + 9, + 1, + 29, + 9, + 26, + 20, + 10, + 9, + 6, + 17, + 14, + 7, + 9, + 16, + 11, + 8, + 9, + 35, + 10, + 11, + 13, + 45 + ], + "weighted_loads": [ + 2.053019940853119, + 0.277728620916605, + 1.0110667645931244, + 0.23547568172216415, + 0.8554541245102882, + 1.6728871427476406, + 0.03575447201728821, + 0.48159413039684296, + 0.7497424259781837, + 0.7885775826871395, + 1.113195225596428, + 0.31553737074136734, + 0.08231167122721672, + 2.101372465491295, + 0.558685652911663, + 1.1456362269818783, + 0.06751852855086327, + 0.7442486993968487, + 0.7675264049321413, + 2.343842450529337, + 1.4472458809614182, + 1.3267148323357105, + 0.05106906220316887, + 0.7140822056680918, + 0.09948696196079254, + 0.8804296869784594, + 1.2905891053378582, + 1.08168563246727, + 1.4303074963390827, + 1.226507306098938, + 0.8058698698878288, + 0.6184529028832912, + 0.2956971116364002, + 0.7457445189356804, + 0.2527666687965393, + 0.6584274657070637, + 0.5234180111438036, + 0.8853178322315216, + 1.2520499750971794, + 0.7108032591640949, + 0.5143924430012703, + 1.120144683867693, + 0.4127887338399887, + 0.0483388714492321, + 1.3250448200851679, + 0.44460275676101446, + 2.339539946988225, + 2.264546874910593, + 0.8559036944061518, + 0.8883950263261795, + 0.269879836589098, + 1.1750357318669558, + 1.5022395811975002, + 0.5094132982194424, + 0.4021169953048229, + 1.0885040201246738, + 1.322672601789236, + 0.35700770281255245, + 0.4204428158700466, + 2.0518658366054296, + 0.5234454814344645, + 0.6592210568487644, + 1.090240877121687, + 2.960776664316654 + ], + "unique_experts": 64, + "load_cv": 0.5968285729523263, + "normalized_load_entropy": 0.9585740567734211, + "max_load_share": 0.05434782608695652 + } + }, + "s1_period": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "663b9fa35393c9199b7947ea24808d5183366cc30f7963837b53ebd076d4e365", + "route_weight_sha256": "41187da323ee7b3bdcc59d23e55f7424694e4c9e398898e93259b4e1abb32b5b", + "loads": [ + 17, + 6, + 19, + 6, + 12, + 8, + 1, + 10, + 12, + 4, + 19, + 4, + 2, + 12, + 12, + 14, + 2, + 11, + 3, + 14, + 18, + 15, + 1, + 6, + 2, + 21, + 8, + 12, + 4, + 20, + 10, + 10, + 3, + 1, + 4, + 9, + 12, + 12, + 15, + 9, + 11, + 17, + 10, + 0, + 31, + 8, + 21, + 17, + 9, + 7, + 2, + 12, + 9, + 1, + 10, + 12, + 11, + 6, + 7, + 20, + 9, + 10, + 13, + 45 + ], + "weighted_loads": [ + 1.4757135696709156, + 0.2433641441166401, + 0.9526084177196026, + 0.22293450869619846, + 0.7871844843029976, + 0.6574552021920681, + 0.044361330568790436, + 0.3652147725224495, + 0.7013254389166832, + 0.2293013595044613, + 1.0228628683835268, + 0.1297012809664011, + 0.08302950114011765, + 2.1186836287379265, + 0.5633137691766024, + 0.79750095307827, + 0.06817660853266716, + 0.7951220106333494, + 0.4283182956278324, + 2.3273042254149914, + 1.3815485537052155, + 1.2467474974691868, + 0.047591451555490494, + 0.321246225386858, + 0.07904966175556183, + 1.0709629580378532, + 0.8603022899478674, + 0.693987812846899, + 0.21129538118839264, + 1.2460024878382683, + 0.6004430316388607, + 0.42622682824730873, + 0.25332553684711456, + 0.06644337624311447, + 0.2391672134399414, + 0.5372366867959499, + 0.507664093747735, + 0.8374930247664452, + 1.1620951257646084, + 0.7286721039563417, + 0.5192468464374542, + 0.9214177429676056, + 0.4373148940503597, + 0.0, + 1.3952221861109138, + 0.466234028339386, + 2.1218426302075386, + 2.1644204016774893, + 0.8072835989296436, + 0.7852178514003754, + 0.0881488285958767, + 0.7147613037377596, + 0.7775247115641832, + 0.04144864156842232, + 0.4228479228913784, + 0.6713474877178669, + 1.2863015606999397, + 0.3043841887265444, + 0.34760598838329315, + 1.3605693764984608, + 0.48263879865407944, + 0.5778677277266979, + 1.0744332447648048, + 2.9609856866300106 + ], + "unique_experts": 63, + "load_cv": 0.7088919688227073, + "normalized_load_entropy": 0.9428730975549705, + "max_load_share": 0.06637168141592921 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "1533d017aa2cee23840adaed0847c5acb793aa29f9dc00f8484546a64ebcf2b7", + "route_weight_sha256": "2d2ff9aa3fbacaa0aa514f67dd10379abe7bfdd0b28265fce756b0c450b4a7d9", + "loads": [ + 25, + 7, + 19, + 8, + 15, + 26, + 1, + 14, + 14, + 15, + 19, + 7, + 7, + 12, + 12, + 19, + 2, + 11, + 9, + 18, + 20, + 17, + 1, + 15, + 9, + 23, + 14, + 18, + 17, + 21, + 17, + 12, + 5, + 11, + 5, + 10, + 13, + 16, + 17, + 11, + 11, + 17, + 11, + 1, + 33, + 8, + 26, + 20, + 12, + 9, + 16, + 15, + 17, + 11, + 12, + 15, + 12, + 9, + 8, + 40, + 12, + 12, + 15, + 50 + ], + "weighted_loads": [ + 2.277084417641163, + 0.29502122849226, + 0.9526084177196026, + 0.29526606388390064, + 0.9953107871115208, + 1.9029474668204784, + 0.044361330568790436, + 0.5319897383451462, + 0.8702628836035728, + 1.0371689647436142, + 1.0228628683835268, + 0.3452902715653181, + 0.43441953137516975, + 2.1186836287379265, + 0.5633137691766024, + 1.0917274244129658, + 0.06817660853266716, + 0.7951220106333494, + 0.9065572917461395, + 2.5295871067792177, + 1.6111121401190758, + 1.3214784413576126, + 0.047591451555490494, + 0.7154116909950972, + 0.3940095007419586, + 1.1448272559791803, + 1.2706471737474203, + 0.9447839464992285, + 1.6000971794128418, + 1.294229008257389, + 0.918600294739008, + 0.5049646608531475, + 0.3320944122970104, + 1.1000881157815456, + 0.285484004765749, + 0.6166657172143459, + 0.5545696374028921, + 1.2972463630139828, + 1.3033208958804607, + 0.823586942628026, + 0.5192468464374542, + 0.9214177429676056, + 0.49172118306159973, + 0.044879086315631866, + 1.4589990405365825, + 0.466234028339386, + 2.3953081592917442, + 2.275993950664997, + 0.9653850123286247, + 0.8607081510126591, + 0.993001863360405, + 1.1300263833254576, + 1.5830218400806189, + 0.8255739398300648, + 0.5043363682925701, + 0.9856608472764492, + 1.3373630940914154, + 0.4304762203246355, + 0.45727547258138657, + 2.4555598106235266, + 0.7347574532032013, + 0.6560289077460766, + 1.1787781827151775, + 3.1456868574023247 + ], + "unique_experts": 64, + "load_cv": 0.5728533987615897, + "normalized_load_entropy": 0.9630248617044694, + "max_load_share": 0.05411255411255411 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 113, + "ordered_topk_exact_tokens": 80, + "set_exact_tokens": 91, + "mean_set_jaccard": 0.9443742098609356, + "mean_token_weighted_tv": 0.01221811529084117, + "aggregate_load_tv": 0.025073746312684362 + }, + "system_bos": { + "tokens": 113, + "ordered_topk_exact_tokens": 68, + "set_exact_tokens": 78, + "mean_set_jaccard": 0.9039190897597977, + "mean_token_weighted_tv": 0.0194288295636003, + "aggregate_load_tv": 0.035398230088495575 + }, + "system_x": { + "tokens": 113, + "ordered_topk_exact_tokens": 49, + "set_exact_tokens": 71, + "mean_set_jaccard": 0.8824273072060683, + "mean_token_weighted_tv": 0.02594051645673086, + "aggregate_load_tv": 0.038348082595870206 + }, + "system_period": { + "tokens": 113, + "ordered_topk_exact_tokens": 56, + "set_exact_tokens": 71, + "mean_set_jaccard": 0.8843236409608093, + "mean_token_weighted_tv": 0.026633906532573488, + "aggregate_load_tv": 0.04424778761061947 + }, + "bos_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 64, + "set_exact_tokens": 78, + "mean_set_jaccard": 0.9058154235145386, + "mean_token_weighted_tv": 0.01962075316536743, + "aggregate_load_tv": 0.045722713864306784 + }, + "bos_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 60, + "set_exact_tokens": 74, + "mean_set_jaccard": 0.8957016434892541, + "mean_token_weighted_tv": 0.02274017063159067, + "aggregate_load_tv": 0.04129793510324484 + }, + "x_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 53, + "set_exact_tokens": 70, + "mean_set_jaccard": 0.8874841972187105, + "mean_token_weighted_tv": 0.02347355037185866, + "aggregate_load_tv": 0.039823008849557515 + }, + "x_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 46, + "set_exact_tokens": 63, + "mean_set_jaccard": 0.8584070796460178, + "mean_token_weighted_tv": 0.029319015298599163, + "aggregate_load_tv": 0.05014749262536873 + }, + "period_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 57, + "set_exact_tokens": 74, + "mean_set_jaccard": 0.8957016434892541, + "mean_token_weighted_tv": 0.022227335902573787, + "aggregate_load_tv": 0.03982300884955752 + }, + "period_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 53, + "set_exact_tokens": 67, + "mean_set_jaccard": 0.8704171934260431, + "mean_token_weighted_tv": 0.027731994488400167, + "aggregate_load_tv": 0.05604719764011799 + } + } + }, + "layer_15": { + "layer": 15, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "1a9d52ac732de053854b368d83ec304d9217c0c25d29c0b3e50c5d20bd5430dd", + "route_weight_sha256": "d3c15472220a2210e60dc727172b0304cd8d41e01c55461e601a9da826d07794", + "loads": [ + 8, + 8, + 7, + 0, + 11, + 10, + 11, + 9, + 0, + 0, + 10, + 16, + 12, + 6, + 5, + 4, + 6, + 5, + 1, + 10, + 15, + 14, + 8, + 2, + 1, + 24, + 19, + 22, + 10, + 27, + 10, + 5, + 7, + 18, + 3, + 6, + 21, + 8, + 67, + 6, + 8, + 10, + 12, + 13, + 8, + 5, + 8, + 12, + 18, + 5, + 21, + 11, + 21, + 6, + 6, + 10, + 8, + 8, + 11, + 0, + 26, + 7, + 11, + 1 + ], + "weighted_loads": [ + 0.4784231297671795, + 0.7812559343874454, + 0.7035963535308838, + 0.0, + 0.5991037860512733, + 0.41297199577093124, + 1.4410947188735008, + 0.4506859611719847, + 0.0, + 0.0, + 0.890509270131588, + 1.2401829175651073, + 0.735245194286108, + 0.29155729338526726, + 0.27630533650517464, + 0.2147519774734974, + 0.34427595511078835, + 0.3113905154168606, + 0.04040059447288513, + 0.6670567188411951, + 1.0526718627661467, + 0.8809431903064251, + 0.4191586375236511, + 0.25632851384580135, + 0.10368835180997849, + 1.566629733890295, + 1.5536364912986755, + 1.6666214521974325, + 0.4918686654418707, + 1.3356763310730457, + 0.5522306133061647, + 0.17821460217237473, + 0.2930297404527664, + 1.29255885258317, + 0.1727612055838108, + 0.4070710763335228, + 2.210596337914467, + 0.42613306269049644, + 5.4746222058311105, + 0.25065633095800877, + 0.8875570674426854, + 0.5697252321988344, + 0.8925366476178169, + 0.8221309147775173, + 0.30594904720783234, + 0.33032144978642464, + 0.750445768237114, + 1.169141311198473, + 1.0534863714128733, + 0.3029012903571129, + 2.3992308005690575, + 0.41716896183788776, + 3.197825960814953, + 0.335500979796052, + 0.2644004411995411, + 0.6855177953839302, + 0.3636443391442299, + 0.6038638390600681, + 1.4160248935222626, + 0.0, + 1.4510110057890415, + 0.36338866129517555, + 0.9493442848324776, + 0.018797336146235466 + ], + "unique_experts": 60, + "load_cv": 0.903517238971692, + "normalized_load_entropy": 0.9239808522117873, + "max_load_share": 0.09882005899705015 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "726aa5f7c48c549459181c0ec35c8b606d5b09969bc76e00c57ea45577bbf9da", + "route_weight_sha256": "3ea6a381a2f6e58758d2e96d644a9aadebafa9ae5142d669096d854282eac355", + "loads": [ + 11, + 8, + 7, + 0, + 17, + 13, + 18, + 11, + 7, + 1, + 15, + 17, + 17, + 6, + 16, + 5, + 13, + 7, + 1, + 12, + 15, + 14, + 8, + 8, + 3, + 25, + 29, + 22, + 14, + 28, + 14, + 5, + 12, + 20, + 3, + 7, + 26, + 8, + 68, + 6, + 14, + 12, + 12, + 15, + 8, + 5, + 9, + 13, + 19, + 13, + 27, + 13, + 26, + 6, + 6, + 14, + 8, + 8, + 12, + 0, + 26, + 9, + 11, + 5 + ], + "weighted_loads": [ + 0.675926685333252, + 0.7812559343874454, + 0.7035963535308838, + 0.0, + 0.9517239648848772, + 0.4937500348314643, + 2.0412021540105343, + 0.5173577833920717, + 0.44384774193167686, + 0.03147429600358009, + 1.078908046707511, + 1.2703895010054111, + 1.130170788615942, + 0.29155729338526726, + 0.681778084486723, + 0.24574628472328186, + 1.056616261601448, + 0.40426139160990715, + 0.04040059447288513, + 0.7766408566385508, + 1.0526718627661467, + 0.8809431903064251, + 0.4191586375236511, + 0.56391298212111, + 0.1336538048926741, + 1.59515973739326, + 2.2150986827909946, + 1.6666214521974325, + 0.6331689786165953, + 1.43688440695405, + 0.7277968917042017, + 0.17821460217237473, + 0.6952169854193926, + 1.382089588791132, + 0.1727612055838108, + 0.43311718851327896, + 2.9292182717472315, + 0.42613306269049644, + 5.504410562105477, + 0.25065633095800877, + 1.263735645217821, + 0.6101668579503894, + 0.8925366476178169, + 0.9054044522345066, + 0.30594904720783234, + 0.33032144978642464, + 0.8603634536266327, + 1.20364735648036, + 1.0669971937313676, + 1.1242468878626823, + 2.7604507878422737, + 0.5025408063083887, + 3.346664692275226, + 0.335500979796052, + 0.2644004411995411, + 2.3604568988084793, + 0.3636443391442299, + 0.6038638390600681, + 1.4674692898988724, + 0.0, + 1.4510110057890415, + 0.4394125398248434, + 0.9493442848324776, + 0.19175161980092525 + ], + "unique_experts": 62, + "load_cv": 0.764674940704876, + "normalized_load_entropy": 0.9418516946800626, + "max_load_share": 0.0821256038647343 + } + }, + "s1_eos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "cfca1e97a8b9e2b2b21986ab4300e160febe864263271f7952d162d157a48fe2", + "route_weight_sha256": "e1b77f928b4acdc8b5c64ff804a1487bcafca833929cfe970c30e3ae14d3ddba", + "loads": [ + 8, + 9, + 8, + 0, + 12, + 10, + 11, + 7, + 1, + 0, + 9, + 16, + 13, + 6, + 6, + 5, + 6, + 6, + 1, + 10, + 15, + 15, + 8, + 2, + 1, + 24, + 19, + 21, + 10, + 26, + 9, + 7, + 7, + 17, + 3, + 6, + 21, + 8, + 67, + 6, + 8, + 10, + 12, + 13, + 7, + 4, + 8, + 11, + 17, + 4, + 22, + 12, + 20, + 6, + 6, + 11, + 8, + 7, + 11, + 0, + 24, + 7, + 13, + 1 + ], + "weighted_loads": [ + 0.47114984691143036, + 0.8084664363414049, + 0.707164378836751, + 0.0, + 0.6325167752802372, + 0.4216608349233866, + 1.4734348058700562, + 0.38090184703469276, + 0.03401865437626839, + 0.0, + 0.8356923758983612, + 1.229620199650526, + 0.7799402549862862, + 0.27845901623368263, + 0.33499354869127274, + 0.2728518694639206, + 0.3416716828942299, + 0.3360607512295246, + 0.04431542381644249, + 0.6933051589876413, + 1.0657830238342285, + 0.908570327796042, + 0.418941643089056, + 0.2520956974476576, + 0.10238712280988693, + 1.5482167843729258, + 1.5578964687883854, + 1.6262936741113663, + 0.4820840172469616, + 1.3103197365999222, + 0.5067960415035486, + 0.2507975809276104, + 0.2902895137667656, + 1.262421878054738, + 0.17024911381304264, + 0.43817731738090515, + 2.1794978491961956, + 0.42207771725952625, + 5.501998422667384, + 0.24958843365311623, + 0.8825154742226005, + 0.5829445403069258, + 0.9013477563858032, + 0.8085316270589828, + 0.26935206912457943, + 0.29792390018701553, + 0.752153504639864, + 1.118619330227375, + 1.0036805123090744, + 0.2623979263007641, + 2.41076722368598, + 0.4615014400333166, + 3.1679762192070484, + 0.3333236873149872, + 0.2693124860525131, + 0.7148105278611183, + 0.3705171849578619, + 0.5737940594553947, + 1.4144035689532757, + 0.0, + 1.3759358935058117, + 0.35922454111278057, + 1.019526582211256, + 0.019076189026236534 + ], + "unique_experts": 61, + "load_cv": 0.8920414461876105, + "normalized_load_entropy": 0.926658385748092, + "max_load_share": 0.09882005899705015 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "15f5e9dc2db6fc7267160450ebe771d8a72bfec3b7f331eadeb8990d082185d5", + "route_weight_sha256": "8eed2657a640b5efab795fa898ae2efd22ceaf3fe69999a3683567136f39162b", + "loads": [ + 29, + 10, + 8, + 0, + 20, + 15, + 24, + 8, + 13, + 1, + 14, + 20, + 19, + 7, + 12, + 14, + 18, + 11, + 2, + 14, + 16, + 16, + 8, + 7, + 4, + 25, + 29, + 23, + 15, + 28, + 15, + 11, + 12, + 19, + 5, + 6, + 27, + 8, + 70, + 7, + 13, + 13, + 12, + 16, + 7, + 5, + 9, + 12, + 20, + 16, + 30, + 15, + 22, + 7, + 6, + 15, + 8, + 13, + 13, + 4, + 24, + 14, + 15, + 5 + ], + "weighted_loads": [ + 1.8514112178236246, + 0.8348903078585863, + 0.707164378836751, + 0.0, + 1.0800710916519165, + 0.6278226645663381, + 2.539025966078043, + 0.4122419133782387, + 0.6333302771672606, + 0.031008608639240265, + 1.068972323089838, + 1.565150037407875, + 1.2954089753329754, + 0.36007601395249367, + 0.5408100010827184, + 0.928214818239212, + 1.507741130888462, + 0.5362498536705971, + 0.09405451640486717, + 0.9566979743540287, + 1.0953534133732319, + 0.9891960928216577, + 0.418941643089056, + 0.5015591438859701, + 0.16857272968627512, + 1.5766316782683134, + 2.260888710618019, + 1.7521956153213978, + 0.8674845658242702, + 1.4363016225397587, + 0.7363343853503466, + 0.6981600634753704, + 0.6921726353466511, + 1.3813408445566893, + 0.3179625701159239, + 0.43817731738090515, + 2.903303364291787, + 0.42207771725952625, + 5.594224398955703, + 0.28562669828534126, + 1.160015489673242, + 0.7103128889575601, + 0.9013477563858032, + 1.1240829043090343, + 0.26935206912457943, + 0.3355106860399246, + 0.8753393329679966, + 1.1527107805013657, + 1.1479695355519652, + 1.8885543122887611, + 2.8276837449520826, + 0.5575657431036234, + 3.2160483291372657, + 0.48025910556316376, + 0.2693124860525131, + 2.360664412379265, + 0.3705171849578619, + 1.2399472296237946, + 1.4957189969718456, + 0.1735280230641365, + 1.3759358935058117, + 0.7303051520138979, + 1.135431032627821, + 0.17962465062737465 + ], + "unique_experts": 63, + "load_cv": 0.6948962193076231, + "normalized_load_entropy": 0.9513867918980157, + "max_load_share": 0.07575757575757576 + } + }, + "s0_bos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "3af8098307dcb086a995b06890ff4140beb8e19b8ee0c4c1f42b26d02db833a8", + "route_weight_sha256": "977d3c8e5552b80b36ad90cbbf5db5660122145faabdef0bb3968f3ed7dab3d6", + "loads": [ + 8, + 9, + 8, + 1, + 13, + 11, + 11, + 10, + 0, + 0, + 10, + 16, + 14, + 6, + 6, + 5, + 6, + 6, + 1, + 11, + 14, + 16, + 8, + 1, + 2, + 24, + 17, + 22, + 10, + 26, + 10, + 5, + 7, + 15, + 3, + 5, + 22, + 9, + 66, + 3, + 8, + 8, + 12, + 12, + 8, + 5, + 8, + 12, + 17, + 4, + 19, + 15, + 20, + 6, + 6, + 11, + 7, + 7, + 11, + 0, + 25, + 7, + 12, + 1 + ], + "weighted_loads": [ + 0.4741343967616558, + 0.8341049663722515, + 0.7504002191126347, + 0.03280482813715935, + 0.6616745498031378, + 0.44523425959050655, + 1.4304388165473938, + 0.49472889490425587, + 0.0, + 0.0, + 0.8876446671783924, + 1.2366391941905022, + 0.796511011198163, + 0.2844341844320297, + 0.3108895383775234, + 0.28104810789227486, + 0.3317016176879406, + 0.33571920171380043, + 0.03838183730840683, + 0.7039586994796991, + 1.038060212507844, + 0.9196601873263717, + 0.4165107272565365, + 0.24909017980098724, + 0.13538772240281105, + 1.5344142857939005, + 1.4351619370281696, + 1.6776570156216621, + 0.4668169394135475, + 1.3774594627320766, + 0.5045307986438274, + 0.17713149636983871, + 0.2993067279458046, + 1.2283745594322681, + 0.17458294704556465, + 0.28000298514962196, + 2.2456223368644714, + 0.4622882716357708, + 5.499355612322688, + 0.13906733319163322, + 0.8863881705328822, + 0.5254263840615749, + 0.9047155231237411, + 0.7721414752304554, + 0.29717329889535904, + 0.35438771545886993, + 0.7230149619281292, + 1.147820109501481, + 0.9625506196171045, + 0.26758693531155586, + 2.3857777025550604, + 0.6206208765506744, + 3.1538199931383133, + 0.3439176455140114, + 0.2550499588251114, + 0.7169584706425667, + 0.32484340481460094, + 0.5755444280803204, + 1.4527860172092915, + 0.0, + 1.432922950014472, + 0.35619443096220493, + 1.0133204869925976, + 0.018800299614667892 + ], + "unique_experts": 61, + "load_cv": 0.8849901664891552, + "normalized_load_entropy": 0.9265626943390454, + "max_load_share": 0.09734513274336283 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "4eb7eddcaad1a1f806c8bb184eb5afa5ea63094069f2664c36a34c3e0803a0bf", + "route_weight_sha256": "bde951b733ac3e702acf040c29489134d678f342b7587aba3b51f8c46e4e8c85", + "loads": [ + 12, + 9, + 8, + 1, + 19, + 14, + 18, + 12, + 5, + 1, + 15, + 17, + 19, + 6, + 16, + 6, + 13, + 8, + 1, + 13, + 14, + 16, + 8, + 7, + 3, + 25, + 27, + 22, + 14, + 27, + 14, + 5, + 12, + 18, + 3, + 6, + 27, + 9, + 67, + 3, + 15, + 8, + 12, + 14, + 8, + 5, + 9, + 13, + 18, + 13, + 25, + 18, + 25, + 6, + 8, + 13, + 7, + 7, + 12, + 0, + 25, + 9, + 12, + 6 + ], + "weighted_loads": [ + 0.7724895030260086, + 0.8341049663722515, + 0.7504002191126347, + 0.03280482813715935, + 0.9697185102850199, + 0.5556582659482956, + 1.96244166046381, + 0.5614007171243429, + 0.35928834415972233, + 0.03147429600358009, + 1.0760434437543154, + 1.266845777630806, + 1.2072912100702524, + 0.2844341844320297, + 0.7069045174866915, + 0.3120424151420593, + 1.0430948212742805, + 0.4182327426970005, + 0.03838183730840683, + 0.8135428372770548, + 1.038060212507844, + 0.9196601873263717, + 0.4165107272565365, + 0.5566746480762959, + 0.1616661511361599, + 1.5629442892968655, + 2.0966241285204887, + 1.6776570156216621, + 0.6081172525882721, + 1.4867387898266315, + 0.6800970770418644, + 0.17713149636983871, + 0.7014939729124308, + 1.3658208027482033, + 0.17458294704556465, + 0.35630350932478905, + 3.002057636156678, + 0.4622882716357708, + 5.533926384523511, + 0.13906733319163322, + 1.3758844202384353, + 0.5254263840615749, + 0.9047155231237411, + 0.8554150126874447, + 0.29717329889535904, + 0.35438771545886993, + 0.827050443738699, + 1.182326154783368, + 0.9760614419355989, + 1.1634925790131092, + 2.7996261809021235, + 0.7512050233781338, + 3.3026587245985866, + 0.3439176455140114, + 0.3549908362329006, + 1.3622624725103378, + 0.32484340481460094, + 0.5755444280803204, + 1.5042304135859013, + 0.0, + 1.432922950014472, + 0.4322183094918728, + 1.0133204869925976, + 0.23177799209952354 + ], + "unique_experts": 63, + "load_cv": 0.7512504453735904, + "normalized_load_entropy": 0.9434210652898808, + "max_load_share": 0.08091787439613526 + } + }, + "s1_bos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "94802d83c2d05b37c7544809b4854e5370291a6ea21c11e339897ba10ef3593c", + "route_weight_sha256": "30c3968b538ec531f37b126ad978f26dfab6ff6b283b3ba51ac31528f27b5439", + "loads": [ + 8, + 8, + 7, + 1, + 11, + 10, + 11, + 7, + 0, + 0, + 10, + 15, + 15, + 5, + 9, + 3, + 6, + 6, + 1, + 11, + 14, + 14, + 9, + 2, + 1, + 24, + 16, + 22, + 10, + 26, + 11, + 6, + 9, + 15, + 3, + 4, + 22, + 7, + 67, + 5, + 8, + 8, + 12, + 13, + 6, + 5, + 8, + 11, + 17, + 5, + 21, + 16, + 21, + 6, + 7, + 12, + 8, + 7, + 11, + 0, + 25, + 6, + 12, + 2 + ], + "weighted_loads": [ + 0.4673411715775728, + 0.7955981753766537, + 0.6943856738507748, + 0.03267651051282883, + 0.5981169659644365, + 0.42390344105660915, + 1.4477115720510483, + 0.36511390656232834, + 0.0, + 0.0, + 0.9174101054668427, + 1.2093972116708755, + 0.8555112387984991, + 0.23893695324659348, + 0.43692243564873934, + 0.20182913169264793, + 0.32464461401104927, + 0.3259282521903515, + 0.04434928297996521, + 0.7161648739129305, + 1.0466433241963387, + 0.8755978047847748, + 0.4580344706773758, + 0.2686546556651592, + 0.09136080741882324, + 1.5580632258206606, + 1.4446666911244392, + 1.6534082479774952, + 0.471119312569499, + 1.3341813739389181, + 0.5471940357238054, + 0.2068856842815876, + 0.38526543602347374, + 1.2163968905806541, + 0.16845137253403664, + 0.275461632758379, + 2.2122942823916674, + 0.3930848017334938, + 5.596449816599488, + 0.2215355671942234, + 0.9076324300840497, + 0.519369576126337, + 0.9015522263944149, + 0.8216130211949348, + 0.21828998625278473, + 0.3551444411277771, + 0.7417595945298672, + 1.121193539351225, + 0.9580863248556852, + 0.3059266395866871, + 2.3988196924328804, + 0.7151409797370434, + 3.232544459402561, + 0.3333220612257719, + 0.30323346704244614, + 0.7366824112832546, + 0.3728369288146496, + 0.5649031102657318, + 1.4299478232860565, + 0.0, + 1.368642870336771, + 0.3218473345041275, + 1.0419990792870522, + 0.047734228894114494 + ], + "unique_experts": 61, + "load_cv": 0.8956239954693701, + "normalized_load_entropy": 0.9260862125459569, + "max_load_share": 0.09882005899705015 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "0d6e899d2f7693d235c7b742d29958ebbb964a7cf67c1ed0f2c587fda6b995c6", + "route_weight_sha256": "98ff90a43339107baf17f4e30fcefeffe72c954129cdada25789d0fd4dc4356e", + "loads": [ + 29, + 9, + 7, + 1, + 20, + 15, + 24, + 8, + 10, + 1, + 15, + 19, + 21, + 6, + 15, + 12, + 18, + 11, + 2, + 15, + 15, + 15, + 9, + 7, + 4, + 25, + 26, + 24, + 15, + 28, + 17, + 10, + 14, + 17, + 5, + 4, + 29, + 7, + 70, + 6, + 14, + 9, + 12, + 15, + 6, + 6, + 9, + 12, + 20, + 19, + 30, + 18, + 23, + 7, + 7, + 15, + 8, + 13, + 13, + 4, + 25, + 13, + 14, + 7 + ], + "weighted_loads": [ + 1.913251707330346, + 0.8220220468938351, + 0.6943856738507748, + 0.03267651051282883, + 1.0262488145381212, + 0.6647180654108524, + 2.436974711716175, + 0.39645397290587425, + 0.516762531362474, + 0.031008608639240265, + 1.1506900526583195, + 1.5449270494282246, + 1.381999896839261, + 0.3205539509654045, + 0.6609389455989003, + 0.8571920804679394, + 1.4956304468214512, + 0.5191549174487591, + 0.09408837556838989, + 0.9795576892793179, + 1.076213713735342, + 0.9562235698103905, + 0.4580344706773758, + 0.5181181021034718, + 0.20575020276010036, + 1.5864781197160482, + 2.147658932954073, + 1.7793101891875267, + 0.8565198611468077, + 1.4706374425441027, + 0.7767323795706034, + 0.6542481668293476, + 0.7871485576033592, + 1.3353158570826054, + 0.3161648288369179, + 0.275461632758379, + 3.010625157505274, + 0.3930848017334938, + 5.695445874705911, + 0.25757383182644844, + 1.3632541736587882, + 0.6070456020534039, + 0.9015522263944149, + 1.0928863808512688, + 0.21828998625278473, + 0.3927312269806862, + 0.8464293964207172, + 1.1552849896252155, + 1.102375348098576, + 2.0885063000023365, + 2.8580007944256067, + 0.7858288176357746, + 3.2806165693327785, + 0.4802574794739485, + 0.30323346704244614, + 1.4542099870741367, + 0.3728369288146496, + 1.2310562804341316, + 1.5112632513046265, + 0.1735280230641365, + 1.368642870336771, + 0.6929279454052448, + 1.157903529703617, + 0.25038847513496876 + ], + "unique_experts": 64, + "load_cv": 0.7014456582704971, + "normalized_load_entropy": 0.9508218105187, + "max_load_share": 0.07575757575757576 + } + }, + "s0_x": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "a32090435027397902bb1b54a8449e2bb2de8b1a49aa33cf2ecea3bc449e9015", + "route_weight_sha256": "0d6747a636191bc4830dc274024eb6fc4b8d55987b7929e5e9fc403a75b84b32", + "loads": [ + 8, + 9, + 8, + 1, + 11, + 9, + 11, + 8, + 0, + 0, + 10, + 14, + 14, + 6, + 8, + 4, + 6, + 7, + 1, + 10, + 14, + 15, + 8, + 1, + 2, + 23, + 18, + 22, + 10, + 26, + 10, + 6, + 7, + 16, + 3, + 4, + 23, + 9, + 68, + 4, + 8, + 8, + 12, + 12, + 6, + 6, + 8, + 11, + 16, + 5, + 23, + 16, + 21, + 7, + 5, + 10, + 7, + 7, + 11, + 0, + 25, + 7, + 11, + 2 + ], + "weighted_loads": [ + 0.4780065044760704, + 0.8412970434874296, + 0.7251608353108168, + 0.032514024525880814, + 0.5749306045472622, + 0.39087636582553387, + 1.4442210532724857, + 0.43093983083963394, + 0.0, + 0.0, + 0.9117548391222954, + 1.1398634910583496, + 0.7912398278713226, + 0.2981681674718857, + 0.37748065404593945, + 0.23746293410658836, + 0.3397003076970577, + 0.3570971190929413, + 0.03850968927145004, + 0.6583606861531734, + 1.0327762868255377, + 0.8868245398625731, + 0.4142373241484165, + 0.2398812472820282, + 0.13729078322649002, + 1.453645559027791, + 1.4741176012903452, + 1.6648273803293705, + 0.47499919310212135, + 1.4424141570925713, + 0.5201159883290529, + 0.21443657018244267, + 0.3008737098425627, + 1.259945623576641, + 0.1715072151273489, + 0.26090889051556587, + 2.3066027127206326, + 0.46346720308065414, + 5.66850462090224, + 0.17560723796486855, + 0.8778963703662157, + 0.5282036662101746, + 0.8974356167018414, + 0.7862791940569878, + 0.2322036474943161, + 0.3790522888302803, + 0.7404071129858494, + 1.1269846092909575, + 1.0009003356099129, + 0.3155297040939331, + 2.537381464615464, + 0.6641602274030447, + 3.2162125445902348, + 0.3792933113873005, + 0.22822996973991394, + 0.7020731717348099, + 0.32885668985545635, + 0.5756030343472958, + 1.423640489578247, + 0.0, + 1.4583727456629276, + 0.36561874859035015, + 0.9888079538941383, + 0.05307677574455738 + ], + "unique_experts": 61, + "load_cv": 0.9062866764399783, + "normalized_load_entropy": 0.9255072714399714, + "max_load_share": 0.10029498525073746 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "5988b7c160cc881113a691cf1c28f4572a22a070e82f72b2576b19ab661b7647", + "route_weight_sha256": "27079a2343611ea5d3c31ef1ec9a477bed379de0b7931f4c0b6ac11524c522ff", + "loads": [ + 11, + 9, + 8, + 1, + 17, + 10, + 18, + 10, + 7, + 1, + 16, + 15, + 19, + 6, + 18, + 5, + 13, + 9, + 1, + 13, + 14, + 15, + 8, + 8, + 3, + 24, + 29, + 22, + 14, + 27, + 14, + 6, + 12, + 18, + 3, + 5, + 28, + 9, + 69, + 4, + 14, + 9, + 12, + 15, + 6, + 6, + 9, + 12, + 17, + 13, + 29, + 18, + 27, + 7, + 5, + 13, + 7, + 7, + 12, + 0, + 25, + 10, + 11, + 5 + ], + "weighted_loads": [ + 0.7034310474991798, + 0.8412970434874296, + 0.7251608353108168, + 0.032514024525880814, + 0.9119548369199038, + 0.40961040928959846, + 2.062116004526615, + 0.497611653059721, + 0.4715958684682846, + 0.03147429600358009, + 1.1713590901345015, + 1.1700700744986534, + 1.176939234137535, + 0.2981681674718857, + 0.7674590796232224, + 0.26845724135637283, + 1.0418770238757133, + 0.46236395463347435, + 0.03850968927145004, + 0.8173586986958981, + 1.0327762868255377, + 0.8868245398625731, + 0.4142373241484165, + 0.6411988697946072, + 0.16356921195983887, + 1.482175562530756, + 2.252518964931369, + 1.6648273803293705, + 0.6162995062768459, + 1.559401772916317, + 0.6956822667270899, + 0.21443657018244267, + 0.7030609548091888, + 1.3494763597846031, + 0.1715072151273489, + 0.2859567981213331, + 3.0231871511787176, + 0.46346720308065414, + 5.69839679915458, + 0.17560723796486855, + 1.2935151625424623, + 0.5694559551775455, + 0.8974356167018414, + 0.9489032328128815, + 0.2322036474943161, + 0.3790522888302803, + 0.8434028215706348, + 1.1614906545728445, + 1.0144111579284072, + 1.0960892960429192, + 2.8652790132910013, + 0.7495320718735456, + 3.402414041571319, + 0.3792933113873005, + 0.22822996973991394, + 1.3960436172783375, + 0.32885668985545635, + 0.5756030343472958, + 1.4750848859548569, + 0.0, + 1.4583727456629276, + 0.50565305352211, + 0.9888079538941383, + 0.183536471799016 + ], + "unique_experts": 63, + "load_cv": 0.7775076795696447, + "normalized_load_entropy": 0.9410015975709186, + "max_load_share": 0.08333333333333333 + } + }, + "s1_x": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "a4c01bb08d6b46c505d7408a2d05349019d4917818a773f2187cb1a92343a762", + "route_weight_sha256": "b7d8b35c32647ca946b5d9f3b1513263c00a093d5bf3f2a8774df8301d730ace", + "loads": [ + 6, + 8, + 8, + 0, + 11, + 9, + 11, + 6, + 0, + 0, + 10, + 16, + 14, + 4, + 8, + 4, + 5, + 6, + 0, + 10, + 14, + 14, + 9, + 1, + 1, + 25, + 17, + 21, + 9, + 26, + 11, + 5, + 9, + 18, + 3, + 6, + 22, + 8, + 69, + 6, + 8, + 8, + 12, + 13, + 6, + 5, + 8, + 12, + 15, + 6, + 23, + 16, + 20, + 7, + 7, + 11, + 8, + 7, + 12, + 0, + 23, + 6, + 13, + 2 + ], + "weighted_loads": [ + 0.383222833275795, + 0.7848704978823662, + 0.711112517863512, + 0.0, + 0.5775565803050995, + 0.380849689245224, + 1.4672889411449432, + 0.3231431618332863, + 0.0, + 0.0, + 0.9124847203493118, + 1.2138737849891186, + 0.8096226546913385, + 0.20210369303822517, + 0.3947059605270624, + 0.23212118074297905, + 0.27213846147060394, + 0.305284708738327, + 0.0, + 0.6602246277034283, + 1.0336200781166553, + 0.8879924872890115, + 0.4551375098526478, + 0.23823381960391998, + 0.0937328115105629, + 1.5762667171657085, + 1.5048245284706354, + 1.6011637561023235, + 0.41689577884972095, + 1.3803466632962227, + 0.5466862544417381, + 0.1768631413578987, + 0.3927442394196987, + 1.3471223637461662, + 0.16196287982165813, + 0.3352735862135887, + 2.2052131574600935, + 0.42117126658558846, + 5.841848093084991, + 0.2533133700489998, + 0.9218908231705427, + 0.5212074145674706, + 0.89557945728302, + 0.8227491416037083, + 0.233265221118927, + 0.3361591175198555, + 0.7339350208640099, + 1.1728875543922186, + 0.9267323724925518, + 0.3246706426143646, + 2.412873525172472, + 0.7329390197992325, + 3.195005588233471, + 0.3668567109853029, + 0.2974393889307976, + 0.7001865562051535, + 0.38847155310213566, + 0.5610056109726429, + 1.43816133774817, + 0.0, + 1.3089912123978138, + 0.3167296536266804, + 1.059864167124033, + 0.048289138823747635 + ], + "unique_experts": 59, + "load_cv": 0.9175843281656286, + "normalized_load_entropy": 0.9219041621262443, + "max_load_share": 0.10176991150442478 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "02bd17dc60bfdecaa49188e6dfb7bc7d74fa3c48fce32a92ba7ef3a578317829", + "route_weight_sha256": "607c78bb6b66265a993786015ac6f58cf92c40178de1ae6ff3cb3da6739617d0", + "loads": [ + 27, + 9, + 8, + 0, + 18, + 12, + 25, + 7, + 13, + 1, + 16, + 20, + 20, + 5, + 13, + 13, + 17, + 11, + 1, + 15, + 16, + 15, + 9, + 7, + 3, + 26, + 28, + 23, + 14, + 28, + 17, + 9, + 15, + 20, + 5, + 6, + 28, + 8, + 71, + 7, + 12, + 10, + 12, + 16, + 7, + 6, + 9, + 13, + 18, + 18, + 30, + 19, + 23, + 8, + 7, + 14, + 8, + 13, + 14, + 4, + 23, + 14, + 15, + 5 + ], + "weighted_loads": [ + 1.7813233900815248, + 0.8112943693995476, + 0.711112517863512, + 0.0, + 0.9194378890097141, + 0.531871410086751, + 2.530984379351139, + 0.3544832281768322, + 0.6877578860148787, + 0.031008608639240265, + 1.2002253457903862, + 1.5494036227464676, + 1.3092613611370325, + 0.2837206907570362, + 0.5889872424304485, + 0.8874841295182705, + 1.3946264386177063, + 0.5122255049645901, + 0.04973909258842468, + 0.9733653422445059, + 1.0906813386827707, + 0.9686182523146272, + 0.4551375098526478, + 0.562992550432682, + 0.156255716457963, + 1.6046816110610962, + 2.3318067397922277, + 1.727065697312355, + 0.8022963274270296, + 1.5005495212972164, + 0.7762245982885361, + 0.6242256239056587, + 0.8376317173242569, + 1.4660413302481174, + 0.3096763361245394, + 0.3352735862135887, + 2.831906992942095, + 0.42117126658558846, + 5.908007903955877, + 0.2893516346812248, + 1.1942417584359646, + 0.6547617502510548, + 0.89557945728302, + 1.2201674617826939, + 0.270073302090168, + 0.3737459033727646, + 0.8566912934184074, + 1.2069790046662092, + 1.0710213957354426, + 1.7974655106663704, + 2.6914251875132322, + 0.8385530337691307, + 3.2742051566019654, + 0.5137921292334795, + 0.2974393889307976, + 1.3837407287210226, + 0.38847155310213566, + 1.2271587811410427, + 1.5194767657667398, + 0.1735280230641365, + 1.3089912123978138, + 0.738899577409029, + 1.175768617540598, + 0.16389271803200245 + ], + "unique_experts": 63, + "load_cv": 0.7049634352400082, + "normalized_load_entropy": 0.9496580653503319, + "max_load_share": 0.07683982683982683 + } + }, + "s0_period": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "c2204a5c0fcb11a92526b5b5fafe27f169f681b5c1a7d12c4a3a029c5993db5f", + "route_weight_sha256": "6596ceac6c5339990b5267d9baead60896d87618b7ac607126d6aebdcdc22d3f", + "loads": [ + 8, + 9, + 8, + 1, + 12, + 8, + 11, + 9, + 0, + 0, + 10, + 15, + 13, + 6, + 8, + 4, + 6, + 7, + 0, + 11, + 14, + 14, + 8, + 1, + 2, + 23, + 18, + 22, + 9, + 25, + 10, + 5, + 9, + 16, + 3, + 3, + 22, + 9, + 67, + 4, + 8, + 8, + 12, + 12, + 8, + 6, + 8, + 11, + 18, + 5, + 21, + 16, + 21, + 7, + 6, + 10, + 7, + 7, + 11, + 0, + 25, + 7, + 12, + 2 + ], + "weighted_loads": [ + 0.48637864366173744, + 0.8143746256828308, + 0.7455559987574816, + 0.03247430920600891, + 0.6219252627342939, + 0.35276201739907265, + 1.4627420380711555, + 0.44557851925492287, + 0.0, + 0.0, + 0.9118849523365498, + 1.1923965513706207, + 0.7622951976954937, + 0.2865275852382183, + 0.382547240704298, + 0.2434188798069954, + 0.35199256986379623, + 0.3583442308008671, + 0.0, + 0.7000384163111448, + 1.0399142187088728, + 0.8719117818400264, + 0.42836107686161995, + 0.2366477996110916, + 0.13306770473718643, + 1.4414394963532686, + 1.5031847413629293, + 1.6748285368084908, + 0.4402695745229721, + 1.391825819388032, + 0.5061155539005995, + 0.17764628492295742, + 0.3747372105717659, + 1.2622537054121494, + 0.16787843219935894, + 0.2385094277560711, + 2.2470707818865776, + 0.4644988663494587, + 5.596325673162937, + 0.17660735175013542, + 0.873942659702152, + 0.5193336270749569, + 0.8933165892958641, + 0.7964135259389877, + 0.2959658596664667, + 0.38551517575979233, + 0.7519860863685608, + 1.1422414872795343, + 1.0503226183354855, + 0.31272872909903526, + 2.406180350109935, + 0.6700252592563629, + 3.226669952273369, + 0.36727670952677727, + 0.2591129504144192, + 0.7031287811696529, + 0.3288310803472996, + 0.5826452821493149, + 1.4417106658220291, + 0.0, + 1.4262786600738764, + 0.36032450571656227, + 1.0132179707288742, + 0.05310562066733837 + ], + "unique_experts": 60, + "load_cv": 0.8925095507493177, + "normalized_load_entropy": 0.925829726706679, + "max_load_share": 0.09882005899705015 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "fab71c16736cbfd82a0af98566537b5206a3b8b40cbbfbc338f4094afdc33ffd", + "route_weight_sha256": "c937918f21ffecda1b44760b4f08f6c5deda5730cb3ddf78dd8898a8cd39fbaf", + "loads": [ + 11, + 9, + 8, + 1, + 18, + 9, + 19, + 11, + 7, + 1, + 15, + 17, + 18, + 6, + 18, + 5, + 13, + 9, + 0, + 13, + 14, + 14, + 8, + 8, + 3, + 24, + 29, + 22, + 13, + 26, + 14, + 5, + 14, + 18, + 3, + 3, + 28, + 9, + 68, + 4, + 14, + 9, + 12, + 14, + 8, + 6, + 9, + 12, + 19, + 13, + 27, + 18, + 26, + 7, + 6, + 13, + 7, + 7, + 13, + 0, + 25, + 10, + 12, + 6 + ], + "weighted_loads": [ + 0.711514126509428, + 0.8143746256828308, + 0.7455559987574816, + 0.03247430920600891, + 1.001217134296894, + 0.37149606086313725, + 2.1122110672295094, + 0.5122503414750099, + 0.46036234125494957, + 0.03147429600358009, + 1.1002837289124727, + 1.2548459693789482, + 1.1282069720327854, + 0.2865275852382183, + 0.7722576055675745, + 0.27441318705677986, + 1.0471463091671467, + 0.4602053053677082, + 0.0, + 0.8096225541085005, + 1.0399142187088728, + 0.8719117818400264, + 0.42836107686161995, + 0.6170492880046368, + 0.15934613347053528, + 1.4699694998562336, + 2.21105713583529, + 1.6748285368084908, + 0.5815698876976967, + 1.5193186942487955, + 0.6816818322986364, + 0.17764628492295742, + 0.7769244555383921, + 1.3517844416201115, + 0.16787843219935894, + 0.2385094277560711, + 3.0222066696733236, + 0.4644988663494587, + 5.629521802067757, + 0.17660735175013542, + 1.3609698838554323, + 0.561216726899147, + 0.8933165892958641, + 0.879687063395977, + 0.2959658596664667, + 0.38551517575979233, + 0.8575848713517189, + 1.1767475325614214, + 1.0638334406539798, + 1.1188914440572262, + 2.738675219938159, + 0.7553971037268639, + 3.375508683733642, + 0.36727670952677727, + 0.2591129504144192, + 1.4082235507667065, + 0.3288310803472996, + 0.5826452821493149, + 1.546087671071291, + 0.0, + 1.4262786600738764, + 0.5878786351531744, + 1.0132179707288742, + 0.21137679554522038 + ], + "unique_experts": 62, + "load_cv": 0.7668692218777102, + "normalized_load_entropy": 0.9409777214890784, + "max_load_share": 0.0821256038647343 + } + }, + "s1_period": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "9ea5c510b699459baf5c7716ede2017100b318fb112f95c93acff613598c8509", + "route_weight_sha256": "68e1b76986d8ac4437f28f69050d374e0ac41f3bc19d596afd975b1cd846ef42", + "loads": [ + 8, + 7, + 8, + 0, + 11, + 9, + 11, + 7, + 0, + 0, + 10, + 16, + 14, + 4, + 6, + 3, + 6, + 6, + 1, + 10, + 14, + 13, + 9, + 1, + 2, + 25, + 18, + 21, + 8, + 25, + 12, + 4, + 8, + 18, + 3, + 8, + 21, + 7, + 71, + 5, + 9, + 8, + 12, + 13, + 5, + 5, + 8, + 12, + 14, + 4, + 25, + 18, + 20, + 7, + 7, + 10, + 8, + 7, + 12, + 0, + 23, + 6, + 13, + 2 + ], + "weighted_loads": [ + 0.4145476296544075, + 0.735637066885829, + 0.6966583728790283, + 0.0, + 0.5874376110732555, + 0.3654940649867058, + 1.4982953071594238, + 0.3710609935224056, + 0.0, + 0.0, + 0.9131618067622185, + 1.2158584855496883, + 0.8068098649382591, + 0.19749359041452408, + 0.3061833940446377, + 0.17102490738034248, + 0.29389507696032524, + 0.3079066798090935, + 0.04073628410696983, + 0.646879555657506, + 1.0410972461104393, + 0.841590465977788, + 0.4631194658577442, + 0.2466978132724762, + 0.1344381459057331, + 1.5812203511595726, + 1.5745551902800798, + 1.572450626641512, + 0.37681817822158337, + 1.3799210134893656, + 0.5741503443568945, + 0.1423747055232525, + 0.34534114226698875, + 1.3751049786806107, + 0.16790246590971947, + 0.5094865337014198, + 2.151025664061308, + 0.38363008201122284, + 5.8683586195111275, + 0.20658930949866772, + 0.9342043721117079, + 0.50373575091362, + 0.8952937088906765, + 0.8120771870017052, + 0.19557470828294754, + 0.3250090964138508, + 0.7415256574749947, + 1.2035337258130312, + 0.8590269275009632, + 0.2510293945670128, + 2.4739301465451717, + 0.806604890152812, + 3.2179586179554462, + 0.3669068403542042, + 0.30310240760445595, + 0.6609728932380676, + 0.38662280328571796, + 0.5610660575330257, + 1.4338745195418596, + 0.0, + 1.298441968858242, + 0.31702196411788464, + 1.0411609038710594, + 0.053043562918901443 + ], + "unique_experts": 60, + "load_cv": 0.9387346552789243, + "normalized_load_entropy": 0.9207685868071209, + "max_load_share": 0.10471976401179942 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "5779be3110e22ee7b2d0a73465f83c70c48700a5f506699d896ba0891ca10fc8", + "route_weight_sha256": "2586456bcb3f48631c6743750f67a8ecdb432cdbc2c3648fccfab22665663701", + "loads": [ + 30, + 8, + 8, + 0, + 19, + 12, + 24, + 8, + 13, + 1, + 16, + 20, + 20, + 5, + 11, + 13, + 18, + 11, + 2, + 14, + 16, + 14, + 9, + 6, + 4, + 26, + 29, + 23, + 13, + 27, + 18, + 8, + 13, + 21, + 5, + 8, + 27, + 7, + 73, + 6, + 14, + 10, + 12, + 16, + 5, + 6, + 9, + 13, + 17, + 15, + 33, + 21, + 22, + 8, + 7, + 13, + 8, + 13, + 15, + 4, + 23, + 14, + 15, + 5 + ], + "weighted_loads": [ + 1.8211697656661272, + 0.7620609384030104, + 0.6966583728790283, + 0.0, + 1.0102216489613056, + 0.5165157858282328, + 2.5773861594498158, + 0.40240105986595154, + 0.6387868961319327, + 0.031008608639240265, + 1.1763103809207678, + 1.5513883233070374, + 1.3006446696817875, + 0.2791105881333351, + 0.5004646759480238, + 0.8628750704228878, + 1.421619452536106, + 0.5070559158921242, + 0.09047537669539452, + 0.9102723710238934, + 1.100216442719102, + 0.9222162310034037, + 0.4631194658577442, + 0.4961612597107887, + 0.1969610508531332, + 1.6096352450549603, + 2.3241933528333902, + 1.6983525678515434, + 0.762218726798892, + 1.500450847670436, + 0.8036886882036924, + 0.5897371880710125, + 0.7472242638468742, + 1.525905717164278, + 0.3156159222126007, + 0.5094865337014198, + 2.924813548102975, + 0.38363008201122284, + 5.934518430382013, + 0.24262757413089275, + 1.303657487500459, + 0.633794978260994, + 0.8952937088906765, + 1.1415104269981384, + 0.19557470828294754, + 0.3625958822667599, + 0.8636238798499107, + 1.2376251760870218, + 1.003315950743854, + 1.7372515723109245, + 2.8088908325880766, + 0.9054133202880621, + 3.2660307278856635, + 0.5138422586023808, + 0.30310240760445595, + 1.3453163020312786, + 0.38662280328571796, + 1.2272192277014256, + 1.5767373833805323, + 0.1735280230641365, + 1.298441968858242, + 0.8685120213776827, + 1.1570653542876244, + 0.16864714212715626 + ], + "unique_experts": 63, + "load_cv": 0.7266411398958667, + "normalized_load_entropy": 0.9479208783439772, + "max_load_share": 0.07900432900432901 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 113, + "ordered_topk_exact_tokens": 80, + "set_exact_tokens": 91, + "mean_set_jaccard": 0.9443742098609356, + "mean_token_weighted_tv": 0.0135992850337705, + "aggregate_load_tv": 0.02359882005899705 + }, + "system_bos": { + "tokens": 113, + "ordered_topk_exact_tokens": 65, + "set_exact_tokens": 79, + "mean_set_jaccard": 0.9121365360303414, + "mean_token_weighted_tv": 0.020834722284194643, + "aggregate_load_tv": 0.033923303834808266 + }, + "system_x": { + "tokens": 113, + "ordered_topk_exact_tokens": 58, + "set_exact_tokens": 75, + "mean_set_jaccard": 0.8925410872313526, + "mean_token_weighted_tv": 0.02731178025921098, + "aggregate_load_tv": 0.0368731563421829 + }, + "system_period": { + "tokens": 113, + "ordered_topk_exact_tokens": 51, + "set_exact_tokens": 65, + "mean_set_jaccard": 0.8691529709228825, + "mean_token_weighted_tv": 0.030403740374387894, + "aggregate_load_tv": 0.05014749262536873 + }, + "bos_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 60, + "set_exact_tokens": 79, + "mean_set_jaccard": 0.9121365360303413, + "mean_token_weighted_tv": 0.021358112930278995, + "aggregate_load_tv": 0.035398230088495575 + }, + "bos_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 51, + "set_exact_tokens": 70, + "mean_set_jaccard": 0.8855878634639698, + "mean_token_weighted_tv": 0.026244964326970873, + "aggregate_load_tv": 0.038348082595870206 + }, + "x_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 54, + "set_exact_tokens": 72, + "mean_set_jaccard": 0.8849557522123894, + "mean_token_weighted_tv": 0.02635218375527292, + "aggregate_load_tv": 0.039823008849557515 + }, + "x_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 47, + "set_exact_tokens": 67, + "mean_set_jaccard": 0.8742098609355249, + "mean_token_weighted_tv": 0.030752989100869252, + "aggregate_load_tv": 0.03982300884955753 + }, + "period_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 57, + "set_exact_tokens": 74, + "mean_set_jaccard": 0.8938053097345132, + "mean_token_weighted_tv": 0.024396200792089238, + "aggregate_load_tv": 0.03687315634218289 + }, + "period_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 45, + "set_exact_tokens": 70, + "mean_set_jaccard": 0.8761061946902655, + "mean_token_weighted_tv": 0.030514022040766028, + "aggregate_load_tv": 0.0471976401179941 + } + } + }, + "layer_16": { + "layer": 16, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "85b221c982584780c36bb1db31c36db8d6f810a6204626f8f2284a223bb8b2cb", + "route_weight_sha256": "475a098e4877be9797d3e8fa6655dc6e6accfee000196da2bb79b820e1632b5e", + "loads": [ + 12, + 16, + 16, + 8, + 8, + 14, + 14, + 11, + 5, + 7, + 1, + 7, + 3, + 11, + 16, + 15, + 13, + 10, + 15, + 9, + 3, + 7, + 4, + 13, + 11, + 11, + 19, + 18, + 12, + 16, + 20, + 4, + 10, + 8, + 47, + 8, + 10, + 12, + 10, + 0, + 10, + 5, + 14, + 5, + 7, + 10, + 1, + 8, + 4, + 10, + 0, + 8, + 48, + 15, + 7, + 1, + 15, + 2, + 9, + 1, + 17, + 10, + 5, + 12 + ], + "weighted_loads": [ + 0.9243872761726379, + 1.040847323834896, + 0.6469918508082628, + 0.8720357306301594, + 0.293531134724617, + 0.7963905818760395, + 0.6232181377708912, + 0.9231308307498693, + 0.3641140013933182, + 0.3281082324683666, + 0.023163143545389175, + 0.24006377719342709, + 0.11845256388187408, + 0.7613212913274765, + 1.5192790739238262, + 1.275358809158206, + 1.5240070056170225, + 0.8880950883030891, + 0.7111533880233765, + 0.7192115969955921, + 0.15803981572389603, + 1.7642894480377436, + 0.17908071354031563, + 0.8283585906028748, + 1.44269909709692, + 0.6579558178782463, + 0.9911466557532549, + 1.134988222271204, + 0.9998659640550613, + 0.7535527795553207, + 1.8666991516947746, + 0.19619789719581604, + 0.5375312510877848, + 0.33462691865861416, + 2.9529872573912144, + 0.9846210852265358, + 0.45297938771545887, + 1.5609206715598702, + 0.6971847116947174, + 0.0, + 0.5198085084557533, + 0.22492528520524502, + 0.7669416889548302, + 0.21305166743695736, + 0.2548111453652382, + 0.7340374998748302, + 0.014370146207511425, + 0.9054967500269413, + 0.1925479993224144, + 0.5165519742295146, + 0.0, + 0.4178710840642452, + 4.642154103145003, + 3.4022392434999347, + 0.38064178824424744, + 0.13748101890087128, + 0.8662738427519798, + 0.06395970098674297, + 0.4705229885876179, + 0.03912677988409996, + 2.7163743264973164, + 0.45795088820159435, + 0.38857611641287804, + 0.9397841095924377 + ], + "unique_experts": 62, + "load_cv": 0.7808533170739506, + "normalized_load_entropy": 0.9385451597301593, + "max_load_share": 0.07079646017699115 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "49f95236a38fdc78ac64ff822078da41f2a90cf113796a52921c69eeb28ca7c4", + "route_weight_sha256": "db1ace0b9c7749761be44f7b6ade8f62fca1ceac86d5a7e7e1dc527fb9b04795", + "loads": [ + 12, + 17, + 16, + 8, + 8, + 22, + 19, + 11, + 5, + 9, + 4, + 8, + 3, + 14, + 16, + 22, + 22, + 15, + 20, + 11, + 14, + 9, + 6, + 13, + 19, + 11, + 23, + 18, + 12, + 16, + 23, + 4, + 11, + 15, + 47, + 8, + 10, + 20, + 11, + 0, + 11, + 12, + 16, + 5, + 11, + 11, + 1, + 8, + 4, + 10, + 0, + 10, + 48, + 26, + 7, + 11, + 15, + 2, + 10, + 1, + 20, + 13, + 5, + 19 + ], + "weighted_loads": [ + 0.9243872761726379, + 1.0733417980372906, + 0.6469918508082628, + 0.8720357306301594, + 0.293531134724617, + 1.5911157503724098, + 0.8455196134746075, + 0.9231308307498693, + 0.3641140013933182, + 1.656286459416151, + 0.19824504479765892, + 0.2757705021649599, + 0.11845256388187408, + 0.8551740031689405, + 1.5192790739238262, + 1.8938329424709082, + 1.9921487653627992, + 1.2634791266173124, + 1.258298745378852, + 0.7600073299836367, + 1.1288716737180948, + 1.843846844509244, + 0.3015963286161423, + 0.8283585906028748, + 2.1374106407165527, + 0.6579558178782463, + 1.2324229404330254, + 1.134988222271204, + 0.9998659640550613, + 0.7535527795553207, + 1.9971690196543932, + 0.19619789719581604, + 0.5772993620485067, + 0.7059867205098271, + 2.9529872573912144, + 0.9846210852265358, + 0.45297938771545887, + 1.9957029139623046, + 0.7309737205505371, + 0.0, + 0.5646556802093983, + 1.2243166845291853, + 0.8333196751773357, + 0.21305166743695736, + 0.41693592444062233, + 0.8003100194036961, + 0.014370146207511425, + 0.9054967500269413, + 0.1925479993224144, + 0.5165519742295146, + 0.0, + 0.5179079435765743, + 4.642154103145003, + 4.167158004827797, + 0.38064178824424744, + 0.9467918500304222, + 0.8662738427519798, + 0.06395970098674297, + 0.5590977184474468, + 0.03912677988409996, + 2.9132755286991596, + 0.5888928436907008, + 0.38857611641287804, + 1.2728928001597524 + ], + "unique_experts": 62, + "load_cv": 0.6789287488930046, + "normalized_load_entropy": 0.9479874825302943, + "max_load_share": 0.057971014492753624 + } + }, + "s1_eos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "a6d25502d5333bccc7857f9dcb6e30194b4aab5d3ebce2ad3f1baede134061c1", + "route_weight_sha256": "b51cce2ea8481fd3648b977fde982a3659bd924394586a195c2435b916283fd1", + "loads": [ + 14, + 15, + 14, + 8, + 8, + 13, + 13, + 11, + 5, + 7, + 1, + 5, + 2, + 9, + 16, + 14, + 14, + 10, + 14, + 9, + 3, + 8, + 4, + 12, + 11, + 12, + 18, + 18, + 12, + 16, + 20, + 4, + 10, + 8, + 50, + 8, + 12, + 12, + 10, + 0, + 10, + 6, + 14, + 5, + 7, + 10, + 1, + 10, + 3, + 11, + 0, + 10, + 49, + 15, + 9, + 1, + 14, + 2, + 9, + 1, + 17, + 7, + 5, + 12 + ], + "weighted_loads": [ + 0.9745507184416056, + 0.99021240696311, + 0.5889286249876022, + 0.8454056084156036, + 0.29653964936733246, + 0.7715161461383104, + 0.5973194427788258, + 0.9315954130142927, + 0.38002992793917656, + 0.32685951329767704, + 0.024012774229049683, + 0.18201898597180843, + 0.07434712070971727, + 0.7089541312307119, + 1.5216886159032583, + 1.2586434930562973, + 1.5267160311341286, + 0.8666860461235046, + 0.689885450527072, + 0.7388216014951468, + 0.1622627004981041, + 1.809661379083991, + 0.17631662636995316, + 0.8169749937951565, + 1.460955198854208, + 0.6735885143280029, + 0.9634795822203159, + 1.1340757757425308, + 0.9977703150361776, + 0.7443082816898823, + 1.8676601443439722, + 0.20119339227676392, + 0.5336643606424332, + 0.3277285397052765, + 3.1466882526874542, + 0.9682054296135902, + 0.5168425031006336, + 1.5427636308595538, + 0.6990132555365562, + 0.0, + 0.5164378304034472, + 0.2618327774107456, + 0.7543225698173046, + 0.2148570381104946, + 0.25626079738140106, + 0.729838278144598, + 0.014805961400270462, + 0.9332448579370975, + 0.16234774142503738, + 0.5468200854957104, + 0.0, + 0.4754751306027174, + 4.67571160197258, + 3.3703809771686792, + 0.448764443397522, + 0.13869915902614594, + 0.823876416310668, + 0.06657397374510765, + 0.48018378019332886, + 0.0422610379755497, + 2.696420907974243, + 0.36531080305576324, + 0.3948654569685459, + 0.926144546829164 + ], + "unique_experts": 62, + "load_cv": 0.8040445181238839, + "normalized_load_entropy": 0.9364423012716226, + "max_load_share": 0.07374631268436578 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "9194943fa194ca45f147b201c129a1c457c6c13520aae68748fc3f1dfe6400fe", + "route_weight_sha256": "af250583e3b9b9aeab18039c9cc1f36afdafd7fc8625a4e8839eb19eaa8733dc", + "loads": [ + 14, + 19, + 14, + 10, + 8, + 21, + 18, + 12, + 5, + 11, + 6, + 8, + 2, + 12, + 17, + 25, + 22, + 22, + 21, + 10, + 14, + 10, + 7, + 13, + 25, + 12, + 27, + 18, + 12, + 16, + 25, + 4, + 15, + 15, + 51, + 10, + 12, + 21, + 13, + 3, + 14, + 20, + 17, + 7, + 10, + 15, + 2, + 17, + 6, + 14, + 7, + 11, + 49, + 27, + 9, + 12, + 16, + 2, + 10, + 2, + 21, + 9, + 8, + 19 + ], + "weighted_loads": [ + 0.9745507184416056, + 1.1434233821928501, + 0.5889286249876022, + 0.9354970678687096, + 0.29653964936733246, + 1.6174430567771196, + 0.8662807606160641, + 0.9577621705830097, + 0.38002992793917656, + 1.7191735543310642, + 0.20590129122138023, + 0.27024081349372864, + 0.07434712070971727, + 0.8026206865906715, + 1.5770708080381155, + 2.346609715372324, + 1.8912645201198757, + 1.705386495217681, + 1.4812072478234768, + 0.7412799301091582, + 1.1073151472955942, + 1.9000473339110613, + 0.30031146109104156, + 0.8935426883399487, + 2.673875868320465, + 0.6735885143280029, + 2.084644390270114, + 1.1340757757425308, + 0.9977703150361776, + 0.7443082816898823, + 2.0630587358027697, + 0.20119339227676392, + 0.7539990786463022, + 0.6198884816840291, + 3.1823170594871044, + 1.0868975147604942, + 0.5168425031006336, + 2.0269892821088433, + 0.8557503968477249, + 0.17629733681678772, + 0.6613872144371271, + 2.35369561240077, + 0.8476136568933725, + 0.30891847610473633, + 0.3628600500524044, + 0.9650263302028179, + 0.04555107466876507, + 1.262145459651947, + 0.28733163326978683, + 0.7079495154321194, + 0.28631974570453167, + 0.5156235489994287, + 4.67571160197258, + 4.4476225432008505, + 0.448764443397522, + 1.0815634839236736, + 0.9320628400892019, + 0.06657397374510765, + 0.5746055319905281, + 0.24346036091446877, + 2.8806122541427612, + 0.45843983930535614, + 0.7246135175228119, + 1.2807610547170043 + ], + "unique_experts": 64, + "load_cv": 0.6251627849701424, + "normalized_load_entropy": 0.9578764639738219, + "max_load_share": 0.05519480519480519 + } + }, + "s0_bos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "6eacbd3360dbde5c07eb75953619e00184971404a1ac5848750f1225bc49544c", + "route_weight_sha256": "3cf1bd9a80f1b43e3c64b10741d04262cc9f9a568fc97fe11a50f8a9a55a08e2", + "loads": [ + 15, + 15, + 16, + 8, + 6, + 15, + 13, + 11, + 6, + 9, + 1, + 7, + 4, + 10, + 16, + 14, + 12, + 10, + 14, + 6, + 3, + 9, + 4, + 13, + 11, + 11, + 18, + 19, + 11, + 15, + 20, + 3, + 11, + 7, + 48, + 8, + 11, + 13, + 11, + 0, + 10, + 7, + 13, + 4, + 8, + 10, + 0, + 9, + 3, + 11, + 0, + 9, + 48, + 15, + 7, + 1, + 13, + 2, + 8, + 0, + 18, + 10, + 5, + 13 + ], + "weighted_loads": [ + 1.0168251544237137, + 1.0008904412388802, + 0.6225686296820641, + 0.852946300059557, + 0.23646866157650948, + 0.7907026745378971, + 0.6078190095722675, + 0.9485548045486212, + 0.3865317590534687, + 0.3756288979202509, + 0.022167567163705826, + 0.24480637349188328, + 0.15378319844603539, + 0.718959454447031, + 1.5977533925324678, + 1.2841751147061586, + 1.4666591919958591, + 0.8723857887089252, + 0.6613014061003923, + 0.6245073303580284, + 0.16973568499088287, + 1.818493926897645, + 0.1850540153682232, + 0.8454662319272757, + 1.5200980305671692, + 0.6388401389122009, + 0.9834402725100517, + 1.1935606226325035, + 0.9798750765621662, + 0.7446565739810467, + 1.8432093653827906, + 0.15612198039889336, + 0.5759076923131943, + 0.32219178788363934, + 3.0990889836102724, + 1.00708182528615, + 0.4693525359034538, + 1.5919931819662452, + 0.7623002678155899, + 0.0, + 0.5136880576610565, + 0.289072684943676, + 0.7309851720929146, + 0.17904601246118546, + 0.2763763777911663, + 0.733724769204855, + 0.0, + 0.9148873053491116, + 0.16589709371328354, + 0.5533759444952011, + 0.0, + 0.45693669095635414, + 4.661240939050913, + 3.354463736526668, + 0.3913751654326916, + 0.13520695269107819, + 0.7957689389586449, + 0.07003772258758545, + 0.43021225929260254, + 0.0, + 2.7863253001123667, + 0.4653836861252785, + 0.3895100876688957, + 0.96188950445503 + ], + "unique_experts": 60, + "load_cv": 0.7897179942801195, + "normalized_load_entropy": 0.9356767929381283, + "max_load_share": 0.07079646017699115 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "05b5418bb708c82e55bec705d63fc778575da059d6e1f58c47b7f324957e8220", + "route_weight_sha256": "57a89ab8f7fa972823041aaaa6a9846271e7e1d2a9ecc6f8bc6ddb8619386c58", + "loads": [ + 15, + 15, + 16, + 8, + 6, + 24, + 18, + 11, + 6, + 11, + 4, + 9, + 5, + 13, + 16, + 21, + 19, + 15, + 19, + 8, + 14, + 11, + 6, + 13, + 18, + 11, + 21, + 19, + 11, + 15, + 23, + 3, + 12, + 13, + 49, + 8, + 12, + 21, + 12, + 0, + 11, + 15, + 15, + 4, + 12, + 11, + 0, + 10, + 3, + 12, + 2, + 11, + 48, + 26, + 7, + 11, + 13, + 2, + 9, + 0, + 20, + 12, + 5, + 18 + ], + "weighted_loads": [ + 1.0168251544237137, + 1.0008904412388802, + 0.6225686296820641, + 0.852946300059557, + 0.23646866157650948, + 1.6263449303805828, + 0.822792049497366, + 0.9485548045486212, + 0.3865317590534687, + 0.7951950486749411, + 0.19724946841597557, + 0.31666543520987034, + 0.22679365798830986, + 0.8158674780279398, + 1.5977533925324678, + 1.9117713924497366, + 2.3604584261775017, + 1.2317193355411291, + 1.219454549252987, + 0.6933644767850637, + 1.1405675429850817, + 1.8980513233691454, + 0.30756963044404984, + 0.8454662319272757, + 2.1657386645674706, + 0.6388401389122009, + 1.1578037645667791, + 1.1935606226325035, + 0.9798750765621662, + 0.7446565739810467, + 1.9730611220002174, + 0.15612198039889336, + 0.6156758032739162, + 0.6648491472005844, + 3.2128037828952074, + 1.00708182528615, + 0.5017146654427052, + 2.0267754243686795, + 0.7948438860476017, + 0.0, + 0.5585352294147015, + 1.3781654872000217, + 0.7915613502264023, + 0.17904601246118546, + 0.4244705084711313, + 0.7999972887337208, + 0.0, + 0.9482018314301968, + 0.16589709371328354, + 0.5986295454204082, + 0.06915747560560703, + 0.5569735504686832, + 4.661240939050913, + 4.119382497854531, + 0.3913751654326916, + 0.9445177838206291, + 0.7957689389586449, + 0.07003772258758545, + 0.5056184008717537, + 0.0, + 2.914063611999154, + 0.5827451981604099, + 0.3895100876688957, + 1.2489375127479434 + ], + "unique_experts": 61, + "load_cv": 0.6803023353437451, + "normalized_load_entropy": 0.947890211012192, + "max_load_share": 0.059178743961352656 + } + }, + "s1_bos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "cb5d6658fdadb8da896300d888244358376e9838589d7545008e5b68e6c320e2", + "route_weight_sha256": "0a01ddd88cc49a1d133fdc2c12c77f3807f61fc028d6c90903d2d87010e886f0", + "loads": [ + 16, + 15, + 15, + 8, + 7, + 14, + 14, + 11, + 6, + 9, + 0, + 6, + 3, + 9, + 16, + 14, + 12, + 10, + 15, + 8, + 3, + 9, + 4, + 13, + 11, + 12, + 18, + 20, + 11, + 16, + 21, + 4, + 10, + 7, + 52, + 8, + 8, + 13, + 10, + 0, + 11, + 7, + 13, + 4, + 7, + 10, + 0, + 9, + 3, + 10, + 0, + 9, + 48, + 15, + 7, + 1, + 12, + 2, + 8, + 0, + 17, + 10, + 5, + 12 + ], + "weighted_loads": [ + 1.05601585842669, + 0.9908299334347248, + 0.5957386139780283, + 0.8477979488670826, + 0.272017739713192, + 0.7883686572313309, + 0.6477370355278254, + 0.9382229913026094, + 0.41045571118593216, + 0.3900180794298649, + 0.0, + 0.2084201332181692, + 0.10558622889220715, + 0.6831123437732458, + 1.5812875870615244, + 1.2239895183593035, + 1.4871427193284035, + 0.8428269531577826, + 0.6971663516014814, + 0.6809627916663885, + 0.17366105690598488, + 1.8360708951950073, + 0.17840543761849403, + 0.8607549779117107, + 1.5263326466083527, + 0.6691682487726212, + 1.0257618390023708, + 1.2064360789954662, + 0.9348273724317551, + 0.7782748565077782, + 1.8639267329126596, + 0.1907226089388132, + 0.5421000774949789, + 0.3010943830013275, + 3.2629315201193094, + 0.9980716928839684, + 0.37623341381549835, + 1.5391951026394963, + 0.7100547030568123, + 0.0, + 0.5562126860022545, + 0.2795368041843176, + 0.7127035707235336, + 0.17657973989844322, + 0.2590296473354101, + 0.738064106553793, + 0.0, + 0.9339232593774796, + 0.1592547856271267, + 0.5189903508871794, + 0.0, + 0.4627176783978939, + 4.821722216904163, + 3.380277829244733, + 0.3910326659679413, + 0.1330862045288086, + 0.7651764638721943, + 0.0661080814898014, + 0.4188680239021778, + 0.0, + 2.782982612028718, + 0.4609217196702957, + 0.3984334282577038, + 0.9279001727700233 + ], + "unique_experts": 59, + "load_cv": 0.821686168190861, + "normalized_load_entropy": 0.9318868809686179, + "max_load_share": 0.07669616519174041 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "d15a2a4d4d205e0470c1864a65cd31b3668f8e971e971cff8053d74ac68f9e9f", + "route_weight_sha256": "1b93a3809194b16e171409a188b37910edd9f79acc12abed7bd72d9a4072bdd5", + "loads": [ + 16, + 19, + 15, + 10, + 7, + 22, + 19, + 12, + 6, + 12, + 5, + 10, + 3, + 13, + 17, + 25, + 20, + 21, + 22, + 8, + 14, + 11, + 6, + 14, + 24, + 12, + 27, + 20, + 11, + 16, + 26, + 4, + 15, + 15, + 53, + 10, + 8, + 22, + 13, + 3, + 15, + 22, + 16, + 6, + 12, + 15, + 1, + 15, + 6, + 14, + 7, + 10, + 48, + 27, + 7, + 12, + 14, + 2, + 9, + 1, + 22, + 11, + 8, + 18 + ], + "weighted_loads": [ + 1.05601585842669, + 1.1420774031430483, + 0.5957386139780283, + 0.9378894083201885, + 0.272017739713192, + 1.63429556787014, + 0.9065499771386385, + 0.9643897488713264, + 0.41045571118593216, + 0.839935913681984, + 0.18188851699233055, + 0.3267914317548275, + 0.10558622889220715, + 0.8079379498958588, + 1.6366697791963816, + 2.311713559553027, + 2.291570331901312, + 1.6301102489233017, + 1.4818215258419514, + 0.6809627916663885, + 1.118713503703475, + 1.9264568500220776, + 0.2616952620446682, + 0.9373226724565029, + 2.7138296216726303, + 0.6691682487726212, + 2.1506710555404425, + 1.2064360789954662, + 0.9348273724317551, + 0.7782748565077782, + 2.059136999770999, + 0.1907226089388132, + 0.762434795498848, + 0.6636102925986052, + 3.2985603269189596, + 1.1167637780308723, + 0.37623341381549835, + 2.023420753888786, + 0.8648733347654343, + 0.17629733681678772, + 0.7013070210814476, + 2.465182600542903, + 0.8001219071447849, + 0.27064117789268494, + 0.4476580526679754, + 0.9732521586120129, + 0.030745113268494606, + 1.2306600622832775, + 0.28423867747187614, + 0.7189514879137278, + 0.29959522746503353, + 0.5028660967946053, + 4.821722216904163, + 4.457519395276904, + 0.3910326659679413, + 1.0759505294263363, + 0.8733628876507282, + 0.0661080814898014, + 0.4988640584051609, + 0.20119932293891907, + 3.0107251554727554, + 0.534896157681942, + 0.7281814888119698, + 1.268572747707367 + ], + "unique_experts": 64, + "load_cv": 0.6395069173048761, + "normalized_load_entropy": 0.9554122227619153, + "max_load_share": 0.05735930735930736 + } + }, + "s0_x": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "10ef4a3a7e5e69cb172a3fffdf8afd1ef13eed5c81e396664826cb5c1485f495", + "route_weight_sha256": "b96dfcb5e059218a3343f6a9199ca2af817b2807fc124adcec1626e6fb7c2ca8", + "loads": [ + 13, + 16, + 14, + 9, + 6, + 14, + 13, + 11, + 6, + 10, + 2, + 6, + 3, + 9, + 16, + 17, + 12, + 10, + 13, + 4, + 4, + 9, + 4, + 14, + 11, + 13, + 18, + 21, + 11, + 14, + 20, + 3, + 11, + 7, + 50, + 8, + 10, + 12, + 11, + 0, + 10, + 6, + 13, + 3, + 7, + 10, + 1, + 9, + 4, + 11, + 0, + 9, + 49, + 15, + 8, + 1, + 12, + 2, + 8, + 1, + 18, + 10, + 5, + 11 + ], + "weighted_loads": [ + 0.9518147967755795, + 1.0460978616029024, + 0.5634649936109781, + 0.8809064161032438, + 0.2396844644099474, + 0.7618866451084614, + 0.596117727458477, + 0.927681565284729, + 0.4166284780949354, + 0.42481797747313976, + 0.047403398901224136, + 0.20479287579655647, + 0.14963681623339653, + 0.6805113069713116, + 1.5823570843786001, + 1.3231993075460196, + 1.5436819605529308, + 0.8505041375756264, + 0.6396941523998976, + 0.562350258231163, + 0.18915283493697643, + 1.8186741638928652, + 0.18434960395097733, + 0.9031548462808132, + 1.4633855260908604, + 0.7096290811896324, + 1.013686964288354, + 1.362191915512085, + 0.9888834729790688, + 0.7320014573633671, + 1.8277125488966703, + 0.15405455976724625, + 0.5735953282564878, + 0.33661807887256145, + 3.1672612465918064, + 1.0084430277347565, + 0.4547360334545374, + 1.5598666025325656, + 0.745085259899497, + 0.0, + 0.5154268946498632, + 0.24948528222739697, + 0.7300266027450562, + 0.14662214368581772, + 0.2384762279689312, + 0.7497862093150616, + 0.014286392368376255, + 0.9035557024180889, + 0.19976389221847057, + 0.5371394120156765, + 0.0, + 0.4612809494137764, + 4.794610023498535, + 3.357957597821951, + 0.4300270639359951, + 0.12737323343753815, + 0.7855804041028023, + 0.0693267323076725, + 0.43453356623649597, + 0.033860765397548676, + 2.8339817449450493, + 0.478090500459075, + 0.3916223496198654, + 0.940868305042386 + ], + "unique_experts": 62, + "load_cv": 0.8095665853133387, + "normalized_load_entropy": 0.9361193560599889, + "max_load_share": 0.07374631268436578 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "ff5bf314af3db05af25afbfb687b65c65d2ec915e55561fcd88bb3e407b48520", + "route_weight_sha256": "a381ce951b349bbce6444ca8b18a891badf301f03fbea8057b53d578c7494c38", + "loads": [ + 13, + 17, + 14, + 9, + 6, + 22, + 18, + 11, + 6, + 11, + 5, + 6, + 3, + 11, + 16, + 24, + 19, + 16, + 18, + 5, + 17, + 12, + 7, + 14, + 20, + 13, + 22, + 21, + 11, + 14, + 24, + 3, + 13, + 11, + 50, + 8, + 10, + 21, + 12, + 0, + 11, + 13, + 15, + 3, + 10, + 11, + 1, + 9, + 4, + 11, + 1, + 11, + 49, + 27, + 8, + 12, + 12, + 2, + 9, + 1, + 21, + 12, + 5, + 17 + ], + "weighted_loads": [ + 0.9518147967755795, + 1.0788850951939821, + 0.5634649936109781, + 0.8809064161032438, + 0.2396844644099474, + 1.5566118136048317, + 0.8317029885947704, + 0.927681565284729, + 0.4166284780949354, + 0.8028522711247206, + 0.22248530015349388, + 0.20479287579655647, + 0.14963681623339653, + 0.7440648879855871, + 1.5823570843786001, + 1.9473610017448664, + 1.8883324414491653, + 1.2437039222568274, + 1.260658498853445, + 0.6006790660321712, + 1.448893640190363, + 1.9332795422524214, + 0.3443468436598778, + 0.9031548462808132, + 2.2516326792538166, + 0.7096290811896324, + 1.2392043843865395, + 1.362191915512085, + 0.9888834729790688, + 0.7320014573633671, + 2.006532959640026, + 0.15405455976724625, + 0.6855548191815615, + 0.6018555238842964, + 3.1672612465918064, + 1.0084430277347565, + 0.4547360334545374, + 2.028783448971808, + 0.779385419562459, + 0.0, + 0.5602740664035082, + 1.2113736774772406, + 0.7952894754707813, + 0.14662214368581772, + 0.35338733345270157, + 0.8160587288439274, + 0.014286392368376255, + 0.9035557024180889, + 0.19976389221847057, + 0.5371394120156765, + 0.035098299384117126, + 0.5613178089261055, + 4.794610023498535, + 4.254671020433307, + 0.4300270639359951, + 1.04984899610281, + 0.7855804041028023, + 0.0693267323076725, + 0.5294105783104897, + 0.033860765397548676, + 3.0322481095790863, + 0.6164306867867708, + 0.3916223496198654, + 1.2658158782869577 + ], + "unique_experts": 63, + "load_cv": 0.7033756701981413, + "normalized_load_entropy": 0.9460462613276857, + "max_load_share": 0.06038647342995169 + } + }, + "s1_x": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "887509343b554b6332c07324b2deb15e5845b248bc9076f3a05e279a127701e5", + "route_weight_sha256": "38d67cac36d3facefa0178a405f4ea2326564ec5a0273e36207562af77d36e14", + "loads": [ + 16, + 16, + 16, + 8, + 4, + 14, + 15, + 11, + 5, + 7, + 1, + 5, + 3, + 10, + 16, + 15, + 13, + 10, + 14, + 5, + 3, + 8, + 4, + 12, + 12, + 13, + 19, + 23, + 11, + 15, + 20, + 5, + 11, + 9, + 50, + 8, + 8, + 13, + 10, + 0, + 10, + 5, + 12, + 4, + 6, + 10, + 0, + 9, + 4, + 9, + 0, + 9, + 48, + 15, + 8, + 2, + 12, + 2, + 9, + 2, + 17, + 11, + 5, + 11 + ], + "weighted_loads": [ + 1.0429339446127415, + 1.061733417212963, + 0.630443524569273, + 0.823756817728281, + 0.15516878478229046, + 0.7776506990194321, + 0.707258140668273, + 0.926374401897192, + 0.3788321577012539, + 0.32214280031621456, + 0.024978477507829666, + 0.16893604025244713, + 0.14057327061891556, + 0.7276436779648066, + 1.5621809121221304, + 1.1556719178333879, + 1.5327173750847578, + 0.7768733836710453, + 0.6687073614448309, + 0.5734325125813484, + 0.17523175850510597, + 1.7786348480731249, + 0.1762320064008236, + 0.8250490576028824, + 1.4635083377361298, + 0.6835084296762943, + 0.9926879499107599, + 1.445047777146101, + 0.9412569180130959, + 0.7436819113790989, + 1.8462422639131546, + 0.2138237040489912, + 0.5718057304620743, + 0.36852006055414677, + 3.174587246030569, + 0.9723844490945339, + 0.37325428053736687, + 1.5295336544513702, + 0.7213589251041412, + 0.0, + 0.5371662750840187, + 0.2205219306051731, + 0.6723178662359715, + 0.17560510337352753, + 0.2316268254071474, + 0.7395989969372749, + 0.0, + 0.9047503340989351, + 0.1930418536067009, + 0.4822249710559845, + 0.0, + 0.4616626128554344, + 4.765153057873249, + 3.3206992940977216, + 0.42771054431796074, + 0.15048156306147575, + 0.7552737165242434, + 0.07247451692819595, + 0.4649575799703598, + 0.06161281652748585, + 2.8237055595964193, + 0.5097892954945564, + 0.40866655111312866, + 0.9090064913034439 + ], + "unique_experts": 61, + "load_cv": 0.8140256826797292, + "normalized_load_entropy": 0.9343612477382262, + "max_load_share": 0.07374631268436578 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "b41702fdd97aafbda0e80ce8522673c8e4efdf7219e59c999ca6958518b51f04", + "route_weight_sha256": "eab8626bb3e3b1516d807c798b110744a479d40800eda7d1832579352d0a1be5", + "loads": [ + 16, + 20, + 16, + 10, + 4, + 22, + 20, + 12, + 5, + 9, + 7, + 8, + 3, + 13, + 17, + 26, + 20, + 22, + 21, + 5, + 17, + 11, + 8, + 13, + 27, + 13, + 30, + 23, + 11, + 16, + 25, + 5, + 17, + 14, + 51, + 10, + 8, + 22, + 13, + 3, + 13, + 19, + 13, + 7, + 8, + 15, + 1, + 15, + 8, + 12, + 6, + 10, + 48, + 28, + 8, + 14, + 14, + 3, + 10, + 3, + 20, + 12, + 8, + 16 + ], + "weighted_loads": [ + 1.0429339446127415, + 1.2267113775014877, + 0.630443524569273, + 0.913848277181387, + 0.15516878478229046, + 1.6235776096582413, + 0.9769940208643675, + 0.952541159465909, + 0.3788321577012539, + 0.7353414911776781, + 0.2345176450908184, + 0.25980738177895546, + 0.14057327061891556, + 0.8213102333247662, + 1.6175631042569876, + 2.1906840102747083, + 1.7931920569390059, + 1.5986529383808374, + 1.4193531088531017, + 0.5734325125813484, + 1.5005931984633207, + 1.9068970028311014, + 0.3291374705731869, + 0.9016167521476746, + 2.7819000892341137, + 0.6835084296762943, + 2.153070591390133, + 1.445047777146101, + 0.9412569180130959, + 0.7741872873157263, + 2.032576136291027, + 0.2138237040489912, + 0.8578860405832529, + 0.5927772857248783, + 3.2102160528302193, + 1.091076534241438, + 0.37325428053736687, + 2.0137593057006598, + 0.8790913484990597, + 0.17629733681678772, + 0.6466610692441463, + 2.1814547032117844, + 0.7090785354375839, + 0.29621025547385216, + 0.30177117325365543, + 0.9747870489954948, + 0.030745113268494606, + 1.201487137004733, + 0.3531060740351677, + 0.6433544009923935, + 0.24622689001262188, + 0.5018110312521458, + 4.765153057873249, + 4.493537315167487, + 0.42771054431796074, + 1.2250885888934135, + 0.8634601403027773, + 0.13529742509126663, + 0.5499951764941216, + 0.2628121394664049, + 2.9588849749416113, + 0.5827137231826782, + 0.7384146116673946, + 1.1754132732748985 + ], + "unique_experts": 64, + "load_cv": 0.6403269109413532, + "normalized_load_entropy": 0.9557412483379889, + "max_load_share": 0.05519480519480519 + } + }, + "s0_period": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "30a4a0c1b5c14bc5e28ac8a8fa5d7ea56f74f0b9b52d992fcf1dda8dc160aabb", + "route_weight_sha256": "8abee61528ac82bdaed7ef468e20dbb79f67b6276a71fd2cb9c83d9af7c4fea2", + "loads": [ + 14, + 16, + 15, + 8, + 5, + 12, + 13, + 11, + 5, + 7, + 1, + 7, + 4, + 8, + 16, + 14, + 12, + 10, + 14, + 5, + 3, + 9, + 3, + 14, + 11, + 12, + 19, + 20, + 11, + 15, + 20, + 3, + 11, + 7, + 49, + 8, + 10, + 13, + 11, + 0, + 10, + 7, + 15, + 4, + 8, + 10, + 0, + 9, + 4, + 12, + 0, + 9, + 49, + 15, + 8, + 1, + 13, + 2, + 8, + 2, + 19, + 10, + 5, + 12 + ], + "weighted_loads": [ + 0.9896045848727226, + 1.0472560804337263, + 0.6091785524040461, + 0.8452400788664818, + 0.19292812794446945, + 0.701594166457653, + 0.6013306528329849, + 0.935012225061655, + 0.38160801865160465, + 0.33016515523195267, + 0.02298974245786667, + 0.2449881974607706, + 0.15582137368619442, + 0.6625381838530302, + 1.571221748366952, + 1.2662432212382555, + 1.556311497464776, + 0.8898075595498085, + 0.6800089627504349, + 0.5886611379683018, + 0.16678722575306892, + 1.8315059002488852, + 0.15229172259569168, + 0.9042070806026459, + 1.5033776015043259, + 0.6741709969937801, + 1.0386886224150658, + 1.2981395982205868, + 0.9759463034570217, + 0.7436442449688911, + 1.846982877701521, + 0.15674392133951187, + 0.5701915863901377, + 0.34031103551387787, + 3.090330131351948, + 0.9859817177057266, + 0.45647554099559784, + 1.5504426304250956, + 0.740183075889945, + 0.0, + 0.5150561779737473, + 0.2885501142591238, + 0.7871369626373053, + 0.16664107330143452, + 0.269474133849144, + 0.7375675775110722, + 0.0, + 0.8927402123808861, + 0.19887324795126915, + 0.5680691562592983, + 0.0, + 0.44589070603251457, + 4.812543231993914, + 3.361724656075239, + 0.4405885748565197, + 0.12426050007343292, + 0.8036693353205919, + 0.06766112893819809, + 0.44316552206873894, + 0.07413528487086296, + 2.8519237525761127, + 0.4684674609452486, + 0.3844227306544781, + 0.9562286958098412 + ], + "unique_experts": 61, + "load_cv": 0.8069828212202366, + "normalized_load_entropy": 0.9350647705319761, + "max_load_share": 0.07227138643067847 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "cf4b668faf3b104d7a39f36f73689a12c4bbc7fafc2096606ab241e1b0540c7f", + "route_weight_sha256": "d9d46c048a5b1c3e1054b576bd4cedd534505000a1e14d52821c19cdf122a942", + "loads": [ + 14, + 17, + 15, + 8, + 5, + 21, + 18, + 11, + 5, + 8, + 5, + 8, + 4, + 10, + 16, + 21, + 19, + 16, + 19, + 6, + 16, + 11, + 7, + 14, + 20, + 12, + 23, + 20, + 11, + 15, + 24, + 3, + 12, + 11, + 49, + 8, + 10, + 21, + 12, + 0, + 11, + 14, + 17, + 4, + 12, + 11, + 0, + 10, + 4, + 12, + 0, + 11, + 49, + 26, + 8, + 12, + 13, + 2, + 9, + 2, + 22, + 12, + 5, + 17 + ], + "weighted_loads": [ + 0.9896045848727226, + 1.0798310283571482, + 0.6091785524040461, + 0.8452400788664818, + 0.19292812794446945, + 1.5433808378875256, + 0.8319539241492748, + 0.935012225061655, + 0.38160801865160465, + 0.7081994488835335, + 0.24553289636969566, + 0.27779251895844936, + 0.15582137368619442, + 0.7298281639814377, + 1.571221748366952, + 1.8713746946305037, + 1.9392395112663507, + 1.388376286253333, + 1.2546593826264143, + 0.62698994576931, + 1.2656780052930117, + 1.9110632967203856, + 0.3544282838702202, + 0.9042070806026459, + 2.33326243981719, + 0.6741709969937801, + 1.2889988627284765, + 1.2981395982205868, + 0.9759463034570217, + 0.7436442449688911, + 2.038953272625804, + 0.15674392133951187, + 0.6099596973508596, + 0.6025740001350641, + 3.090330131351948, + 0.9859817177057266, + 0.45647554099559784, + 1.98522487282753, + 0.7746065836399794, + 0.0, + 0.5599033497273922, + 1.2797789704054594, + 0.8510566279292107, + 0.16664107330143452, + 0.43310228548943996, + 0.803840097039938, + 0.0, + 0.9323276244103909, + 0.19887324795126915, + 0.5680691562592983, + 0.0, + 0.5459275655448437, + 4.812543231993914, + 4.126643417403102, + 0.4405885748565197, + 0.9967989847064018, + 0.8036693353205919, + 0.06766112893819809, + 0.5349666513502598, + 0.07413528487086296, + 3.042889293283224, + 0.608972018584609, + 0.3844227306544781, + 1.2351221404969692 + ], + "unique_experts": 61, + "load_cv": 0.6948297607774111, + "normalized_load_entropy": 0.9460055874763086, + "max_load_share": 0.059178743961352656 + } + }, + "s1_period": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "fa1a9bc172f520aff3e0fb6363e6866a9f8ef8edb191c17b77f2f3ae12711b52", + "route_weight_sha256": "ffca61289bd3fca295fcf61a392ed3d2f384d2e44178509df9c54ada7e3bda49", + "loads": [ + 16, + 16, + 16, + 7, + 5, + 15, + 15, + 11, + 6, + 7, + 1, + 5, + 4, + 9, + 16, + 14, + 12, + 10, + 13, + 5, + 3, + 9, + 5, + 12, + 12, + 12, + 18, + 23, + 11, + 14, + 20, + 3, + 13, + 8, + 49, + 9, + 9, + 13, + 11, + 0, + 11, + 5, + 13, + 4, + 5, + 10, + 0, + 9, + 4, + 10, + 0, + 9, + 48, + 15, + 8, + 1, + 13, + 2, + 9, + 2, + 17, + 9, + 5, + 12 + ], + "weighted_loads": [ + 1.0409871265292168, + 1.0539720356464386, + 0.636623527854681, + 0.827298529446125, + 0.1922121588140726, + 0.81128915771842, + 0.699305709451437, + 0.9242831636220217, + 0.39943901635706425, + 0.32111850194633007, + 0.024243704974651337, + 0.17417697422206402, + 0.16421914100646973, + 0.6523865219205618, + 1.5509670823812485, + 1.1192289404571056, + 1.4983219299465418, + 0.7686045654118061, + 0.642821965739131, + 0.5773235335946083, + 0.17379231378436089, + 1.8294586464762688, + 0.2037467323243618, + 0.8221348524093628, + 1.5088998936116695, + 0.6493298318237066, + 0.9778865203261375, + 1.4540349766612053, + 0.9380993936210871, + 0.6817607171833515, + 1.8553852625191212, + 0.15725760906934738, + 0.6401905324310064, + 0.3373150862753391, + 3.1202200446277857, + 1.0138927698135376, + 0.4015032444149256, + 1.531398263759911, + 0.7374364323914051, + 0.0, + 0.5756283048540354, + 0.18828319013118744, + 0.6936888210475445, + 0.1711888574063778, + 0.185315553098917, + 0.7405444532632828, + 0.0, + 0.9022158402949572, + 0.19425421208143234, + 0.4982616789638996, + 0.0, + 0.4491240046918392, + 4.807516997680068, + 3.3213118109852076, + 0.42706509307026863, + 0.12783174216747284, + 0.7889195587486029, + 0.07211926206946373, + 0.47248170897364616, + 0.06502142362296581, + 2.8341957833617926, + 0.4373450856655836, + 0.4096289500594139, + 0.9520055083557963 + ], + "unique_experts": 61, + "load_cv": 0.8059469962845209, + "normalized_load_entropy": 0.9347888745438647, + "max_load_share": 0.07227138643067847 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "89204e231872f7bac14c31085647fea07bfbdc624d370502bf24ab569b6f0579", + "route_weight_sha256": "c59166166fe647f022e0dea935db441d5d72a22ec1a473ff009779ad673f9ebd", + "loads": [ + 16, + 20, + 16, + 9, + 5, + 24, + 20, + 12, + 6, + 9, + 6, + 8, + 4, + 12, + 17, + 25, + 18, + 23, + 20, + 5, + 15, + 11, + 8, + 13, + 27, + 12, + 28, + 23, + 11, + 15, + 26, + 3, + 20, + 13, + 50, + 11, + 9, + 22, + 15, + 3, + 15, + 20, + 14, + 7, + 7, + 15, + 1, + 16, + 7, + 13, + 5, + 10, + 48, + 28, + 8, + 13, + 15, + 2, + 10, + 4, + 21, + 10, + 8, + 17 + ], + "weighted_loads": [ + 1.0409871265292168, + 1.215444266796112, + 0.636623527854681, + 0.917389988899231, + 0.1922121588140726, + 1.6931947395205498, + 0.9729826711118221, + 0.9504499211907387, + 0.39943901635706425, + 0.7343171928077936, + 0.2061322219669819, + 0.26263981498777866, + 0.16421914100646973, + 0.7460530772805214, + 1.6063492745161057, + 2.1647599563002586, + 1.722558492794633, + 1.682153007015586, + 1.4351021833717823, + 0.5773235335946083, + 1.1762921009212732, + 1.919844601303339, + 0.33035649359226227, + 0.898702546954155, + 2.8481755442917347, + 0.6493298318237066, + 2.12090702727437, + 1.4540349766612053, + 0.9380993936210871, + 0.7117935288697481, + 2.1203822549432516, + 0.15725760906934738, + 0.9230988994240761, + 0.5616312231868505, + 3.155848851427436, + 1.1325848549604416, + 0.4015032444149256, + 2.0156239150092006, + 0.9347626715898514, + 0.17629733681678772, + 0.7269681971520185, + 2.190732952207327, + 0.730449490249157, + 0.29382891207933426, + 0.25545990094542503, + 0.9757325053215027, + 0.030745113268494606, + 1.232344588264823, + 0.3192381039261818, + 0.6593911089003086, + 0.21978558972477913, + 0.48927242308855057, + 4.807516997680068, + 4.459034727886319, + 0.42706509307026863, + 1.1194009259343147, + 0.8971059825271368, + 0.07211926206946373, + 0.5808946453034878, + 0.2963090632110834, + 3.0344296526163816, + 0.5140575226396322, + 0.7393770106136799, + 1.2281501097604632 + ], + "unique_experts": 64, + "load_cv": 0.6395069173048761, + "normalized_load_entropy": 0.9552714146015384, + "max_load_share": 0.05411255411255411 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 113, + "ordered_topk_exact_tokens": 74, + "set_exact_tokens": 91, + "mean_set_jaccard": 0.9443742098609356, + "mean_token_weighted_tv": 0.013264969036609462, + "aggregate_load_tv": 0.028023598820058997 + }, + "system_bos": { + "tokens": 113, + "ordered_topk_exact_tokens": 73, + "set_exact_tokens": 91, + "mean_set_jaccard": 0.9443742098609356, + "mean_token_weighted_tv": 0.016552752411339137, + "aggregate_load_tv": 0.02359882005899705 + }, + "system_x": { + "tokens": 113, + "ordered_topk_exact_tokens": 58, + "set_exact_tokens": 74, + "mean_set_jaccard": 0.8938053097345132, + "mean_token_weighted_tv": 0.027189296859819276, + "aggregate_load_tv": 0.038348082595870206 + }, + "system_period": { + "tokens": 113, + "ordered_topk_exact_tokens": 54, + "set_exact_tokens": 73, + "mean_set_jaccard": 0.8931731984829332, + "mean_token_weighted_tv": 0.02723795067584884, + "aggregate_load_tv": 0.032448377581120944 + }, + "bos_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 64, + "set_exact_tokens": 78, + "mean_set_jaccard": 0.9096080910240202, + "mean_token_weighted_tv": 0.020628219243732437, + "aggregate_load_tv": 0.035398230088495575 + }, + "bos_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 61, + "set_exact_tokens": 77, + "mean_set_jaccard": 0.9018120522545302, + "mean_token_weighted_tv": 0.023493484305465117, + "aggregate_load_tv": 0.035398230088495575 + }, + "x_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 54, + "set_exact_tokens": 66, + "mean_set_jaccard": 0.8792667509481671, + "mean_token_weighted_tv": 0.026012520627242273, + "aggregate_load_tv": 0.04424778761061947 + }, + "x_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 46, + "set_exact_tokens": 62, + "mean_set_jaccard": 0.8653603034134009, + "mean_token_weighted_tv": 0.031057339841582342, + "aggregate_load_tv": 0.04424778761061947 + }, + "period_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 58, + "set_exact_tokens": 74, + "mean_set_jaccard": 0.8994943109987359, + "mean_token_weighted_tv": 0.02259359736226301, + "aggregate_load_tv": 0.03982300884955753 + }, + "period_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 49, + "set_exact_tokens": 62, + "mean_set_jaccard": 0.8638853771597134, + "mean_token_weighted_tv": 0.031096695374235907, + "aggregate_load_tv": 0.045722713864306784 + } + } + }, + "layer_17": { + "layer": 17, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "c37ca16bcf153207281ec466d0c9d583ab9418e4400d1cdf7c6b64175e726df6", + "route_weight_sha256": "f9b01d79c0bb4afdbd7abe9f7804c94f5295659f53edda282ba7e2baac24b458", + "loads": [ + 18, + 12, + 6, + 9, + 6, + 12, + 0, + 10, + 14, + 9, + 10, + 15, + 8, + 10, + 30, + 25, + 13, + 2, + 11, + 13, + 15, + 5, + 17, + 10, + 8, + 6, + 9, + 12, + 10, + 10, + 11, + 3, + 4, + 13, + 14, + 4, + 2, + 7, + 14, + 14, + 5, + 11, + 9, + 21, + 4, + 29, + 10, + 17, + 9, + 13, + 17, + 11, + 9, + 17, + 6, + 9, + 3, + 8, + 17, + 2, + 7, + 10, + 13, + 0 + ], + "weighted_loads": [ + 0.7599770240485668, + 0.5342848524451256, + 0.26625537127256393, + 0.7852261886000633, + 0.4370600301772356, + 2.5016480572521687, + 0.0, + 0.7035322934389114, + 0.9200507886707783, + 0.7362701278179884, + 0.7564677260816097, + 1.3068786412477493, + 0.3852225150913, + 0.696218766272068, + 2.2339639123529196, + 2.3947639381513, + 0.812125263735652, + 0.07499215379357338, + 0.9295459985733032, + 0.6538136079907417, + 0.5589093659073114, + 0.21266703493893147, + 1.287388313561678, + 1.053070480003953, + 0.6647535003721714, + 0.3762059696018696, + 0.6160593768581748, + 0.5450461618602276, + 1.2025283388793468, + 0.850158728659153, + 1.5989324860274792, + 0.16804016381502151, + 0.1745738834142685, + 0.9455954190343618, + 1.278450857847929, + 0.4939828924834728, + 0.1109774298965931, + 0.2964802011847496, + 2.5257538687437773, + 0.8606781885027885, + 0.3398201912641525, + 0.6279997322708368, + 0.7433136254549026, + 1.0333878248929977, + 0.282572977244854, + 4.172600696794689, + 0.48177274875342846, + 1.0364813581109047, + 0.7544817486777902, + 0.6032291296869516, + 0.9683999586850405, + 0.7568620759993792, + 0.5830367095768452, + 1.4445582143962383, + 0.29205792024731636, + 0.7501205541193485, + 0.12601425498723984, + 0.618947422131896, + 1.2402200419455767, + 0.08332090079784393, + 0.3012461382895708, + 0.5736253391951323, + 1.4198947586119175, + 0.0 + ], + "unique_experts": 62, + "load_cv": 0.5680208903906516, + "normalized_load_entropy": 0.9596898277125613, + "max_load_share": 0.04424778761061947 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "deb6b0a18a92ed7bf71e6d4c81b1704295e803bcac08c667c3c8f8224e464478", + "route_weight_sha256": "8d46af31d71debb182b289a2bbca81409b07e145daae00f5bb7ba77afc6fff13", + "loads": [ + 26, + 13, + 8, + 16, + 6, + 12, + 2, + 10, + 14, + 12, + 16, + 16, + 11, + 18, + 30, + 28, + 14, + 9, + 13, + 13, + 18, + 5, + 17, + 16, + 14, + 14, + 18, + 16, + 15, + 12, + 11, + 3, + 12, + 13, + 15, + 4, + 3, + 7, + 18, + 14, + 12, + 17, + 10, + 23, + 4, + 33, + 10, + 17, + 9, + 14, + 18, + 11, + 11, + 17, + 6, + 14, + 3, + 12, + 17, + 2, + 7, + 11, + 18, + 0 + ], + "weighted_loads": [ + 1.017500557936728, + 0.5704154297709465, + 0.36120210215449333, + 1.371796116232872, + 0.4370600301772356, + 2.5016480572521687, + 0.09579388424754143, + 0.7035322934389114, + 0.9200507886707783, + 0.8466667700558901, + 1.1517121195793152, + 1.3253548499196768, + 0.48527117259800434, + 1.2907082587480545, + 2.2339639123529196, + 2.5749512864276767, + 0.9058110024780035, + 0.7303306348621845, + 0.9830682091414928, + 0.6538136079907417, + 0.8493575770407915, + 0.21266703493893147, + 1.287388313561678, + 1.3226583749055862, + 1.1560980901122093, + 0.8606897965073586, + 2.2594297556206584, + 0.7259550653398037, + 1.3976452182978392, + 0.8904258762486279, + 1.5989324860274792, + 0.16804016381502151, + 0.49816265469416976, + 0.9455954190343618, + 1.359040830284357, + 0.4939828924834728, + 0.14470494538545609, + 0.2964802011847496, + 2.687613820657134, + 0.8606781885027885, + 1.2838774807751179, + 0.8215769599191844, + 0.8500671535730362, + 1.0554041529539973, + 0.282572977244854, + 4.923728439025581, + 0.48177274875342846, + 1.0364813581109047, + 0.7544817486777902, + 0.6371368486434221, + 1.0361576545983553, + 0.7568620759993792, + 0.7514789812266827, + 1.4445582143962383, + 0.29205792024731636, + 1.0702085308730602, + 0.12601425498723984, + 0.8481368850916624, + 1.2402200419455767, + 0.08332090079784393, + 0.3012461382895708, + 0.6370423641055822, + 1.7800012454390526, + 0.0 + ], + "unique_experts": 63, + "load_cv": 0.5010898528518146, + "normalized_load_entropy": 0.9673591426007514, + "max_load_share": 0.03985507246376811 + } + }, + "s1_eos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "59dabaa7938d3b2acb0d6013930f19e953de609419144d84444e1fc0c54666b6", + "route_weight_sha256": "76f68bc9533d2fbbad78cd67199e26920111719ad7e744cd9b5a9803cc9bd5fc", + "loads": [ + 16, + 13, + 6, + 9, + 6, + 11, + 0, + 10, + 14, + 10, + 10, + 15, + 8, + 10, + 30, + 26, + 12, + 2, + 12, + 12, + 13, + 8, + 16, + 8, + 8, + 5, + 10, + 13, + 11, + 10, + 11, + 3, + 4, + 12, + 14, + 4, + 2, + 7, + 13, + 15, + 5, + 11, + 10, + 22, + 4, + 29, + 10, + 17, + 10, + 13, + 16, + 11, + 10, + 17, + 6, + 9, + 3, + 7, + 17, + 2, + 7, + 10, + 13, + 0 + ], + "weighted_loads": [ + 0.6889019552618265, + 0.5579199157655239, + 0.2544308602809906, + 0.8052055407315493, + 0.4281291216611862, + 2.432578695937991, + 0.0, + 0.7010586448013783, + 0.9252528250217438, + 0.7670089453458786, + 0.7627300508320332, + 1.2916955053806305, + 0.41445961222052574, + 0.7036039680242538, + 2.303857147693634, + 2.416217894293368, + 0.7864168211817741, + 0.06776401773095131, + 0.9513266030699015, + 0.6189870052039623, + 0.4917482025921345, + 0.3561840485781431, + 1.2718394361436367, + 1.0078110806643963, + 0.6614557318389416, + 0.34584062546491623, + 0.6535701686516404, + 0.5926793944090605, + 1.2159334495663643, + 0.833764374256134, + 1.5596676766872406, + 0.1724151410162449, + 0.17148232646286488, + 0.9150950759649277, + 1.272795107215643, + 0.4806854650378227, + 0.11154432222247124, + 0.3052014745771885, + 2.448186555877328, + 0.9041539151221514, + 0.3432075008749962, + 0.6403952613472939, + 0.7796280477195978, + 1.0384267568588257, + 0.278907835483551, + 4.169506403617561, + 0.4881978314369917, + 1.0362032689154148, + 0.7711061788722873, + 0.6209051199257374, + 0.9251156244426966, + 0.7521938160061836, + 0.633278276771307, + 1.4439531899988651, + 0.28466087579727173, + 0.7268413826823235, + 0.12501356191933155, + 0.5844734702259302, + 1.229479942470789, + 0.08228200674057007, + 0.28726546093821526, + 0.551787119358778, + 1.4467436894774437, + 0.0 + ], + "unique_experts": 62, + "load_cv": 0.5648255074950481, + "normalized_load_entropy": 0.9602607533285464, + "max_load_share": 0.04424778761061947 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "fd674cbb62068b23268e83fcb17498e1e535eddc75dbb6cb7f8c1cf984e457a5", + "route_weight_sha256": "409a42752c3f33fdd6771e86ea6164706ee06a089d8269778f63fb999fff3d55", + "loads": [ + 24, + 14, + 8, + 16, + 12, + 11, + 3, + 11, + 14, + 15, + 17, + 17, + 8, + 18, + 30, + 33, + 15, + 7, + 14, + 12, + 14, + 9, + 16, + 17, + 18, + 27, + 25, + 16, + 14, + 12, + 12, + 4, + 10, + 12, + 15, + 4, + 8, + 9, + 16, + 16, + 17, + 18, + 12, + 23, + 6, + 34, + 12, + 19, + 10, + 14, + 17, + 17, + 15, + 17, + 7, + 17, + 10, + 20, + 18, + 4, + 8, + 15, + 21, + 0 + ], + "weighted_loads": [ + 1.001840359531343, + 0.6005626581609249, + 0.3359610587358475, + 1.460361810401082, + 0.8199413120746613, + 2.432578695937991, + 0.12018890678882599, + 0.7561891339719296, + 0.9252528250217438, + 0.926132008433342, + 1.2493264563381672, + 1.358524238690734, + 0.41445961222052574, + 1.314617034047842, + 2.303857147693634, + 2.770286181010306, + 1.04025923833251, + 0.6002118848264217, + 1.01709327660501, + 0.6189870052039623, + 0.5628040321171284, + 0.4334136825054884, + 1.2718394361436367, + 1.6682838425040245, + 1.3216027654707432, + 1.808729762211442, + 2.5442517073825, + 0.7188250627368689, + 1.3494123071432114, + 0.919096440076828, + 1.6197833716869354, + 0.21111874654889107, + 0.3860434917733073, + 0.9150950759649277, + 1.35250848159194, + 0.4806854650378227, + 0.41919586807489395, + 0.378918319940567, + 2.744517805054784, + 0.9375979881733656, + 1.9338444285094738, + 1.0238486141897738, + 0.8782731872051954, + 1.0572301037609577, + 0.5133610889315605, + 5.354728805832565, + 0.7069028671830893, + 1.1686003468930721, + 0.7711061788722873, + 0.6555676385760307, + 1.0586907211691141, + 1.0488853510469198, + 0.9509171769022942, + 1.4439531899988651, + 0.37268100678920746, + 1.2425142657011747, + 0.7427666503936052, + 1.3320016656070948, + 1.2528457175940275, + 0.17473744973540306, + 0.32211029902100563, + 0.8375863581895828, + 2.0704507790505886, + 0.0 + ], + "unique_experts": 63, + "load_cv": 0.4592622717995216, + "normalized_load_entropy": 0.9732919888928689, + "max_load_share": 0.0367965367965368 + } + }, + "s0_bos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "e88370caae99ef7e50f74dbe3c8b6d4ba6bab93dedd0852140ab0fc75e4b3ec0", + "route_weight_sha256": "99d7cb37643c3eaeab765be09b61575ebff8aa6e6d86ec59f41d83c88b8e05be", + "loads": [ + 16, + 16, + 5, + 9, + 6, + 11, + 0, + 10, + 14, + 12, + 10, + 15, + 7, + 10, + 30, + 24, + 13, + 1, + 12, + 14, + 14, + 6, + 18, + 8, + 8, + 5, + 11, + 12, + 11, + 9, + 10, + 3, + 4, + 12, + 15, + 5, + 2, + 6, + 14, + 13, + 5, + 10, + 8, + 21, + 4, + 28, + 11, + 18, + 8, + 11, + 18, + 10, + 9, + 18, + 6, + 9, + 3, + 9, + 17, + 2, + 8, + 10, + 14, + 0 + ], + "weighted_loads": [ + 0.6805600598454475, + 0.6517712567001581, + 0.2210159543901682, + 0.7718475908041, + 0.4427971728146076, + 2.5295944772660732, + 0.0, + 0.6882455237209797, + 0.9275330193340778, + 0.8197940438985825, + 0.7656967882066965, + 1.2787205465137959, + 0.3773828521370888, + 0.7180394195020199, + 2.340896848589182, + 2.4167343247681856, + 0.8316990491002798, + 0.04715060442686081, + 0.96710748039186, + 0.6697230823338032, + 0.5347242187708616, + 0.25722858496010303, + 1.3822756372392178, + 0.999787962064147, + 0.6620308868587017, + 0.34150515496730804, + 0.6747751049697399, + 0.5355890579521656, + 1.230122447013855, + 0.7870612777769566, + 1.523689629510045, + 0.1735796257853508, + 0.16713116131722927, + 0.9332377500832081, + 1.313825972378254, + 0.5359593518078327, + 0.11049500107765198, + 0.2568547297269106, + 2.4997705165296793, + 0.8182776868343353, + 0.3223940208554268, + 0.567690771073103, + 0.7400081474334002, + 1.020330274477601, + 0.2853984385728836, + 4.158054863102734, + 0.549684189260006, + 1.0918447487056255, + 0.7418858055025339, + 0.5238810181617737, + 0.9672351917251945, + 0.7360035330057144, + 0.5984513461589813, + 1.4524590391665697, + 0.2950999513268471, + 0.7498108148574829, + 0.12824991531670094, + 0.6493752505630255, + 1.2332205008715391, + 0.0858919583261013, + 0.32461852580308914, + 0.5585919842123985, + 1.4676979128271341, + 0.0 + ], + "unique_experts": 62, + "load_cv": 0.5709546021964007, + "normalized_load_entropy": 0.9586464048169571, + "max_load_share": 0.04424778761061947 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "8d5918ba6d59af73a76a24e0b0049cd87f93a94347ff48f4a4127df37b44696c", + "route_weight_sha256": "1e3c9469d50c075242730f505f7fbbe6b59948064488f221b4432c1218f4b2f8", + "loads": [ + 23, + 18, + 6, + 16, + 6, + 11, + 2, + 10, + 14, + 15, + 16, + 16, + 11, + 18, + 30, + 27, + 14, + 8, + 14, + 15, + 17, + 6, + 18, + 14, + 14, + 13, + 19, + 15, + 16, + 11, + 10, + 3, + 11, + 12, + 16, + 5, + 2, + 6, + 18, + 13, + 13, + 15, + 9, + 22, + 4, + 32, + 11, + 18, + 8, + 13, + 19, + 10, + 11, + 19, + 6, + 14, + 3, + 13, + 17, + 3, + 8, + 11, + 20, + 0 + ], + "weighted_loads": [ + 0.9567090589553118, + 0.7370058875530958, + 0.274265231564641, + 1.3584175184369087, + 0.4427971728146076, + 2.5295944772660732, + 0.09579388424754143, + 0.6882455237209797, + 0.9275330193340778, + 0.9301906861364841, + 1.160941181704402, + 1.2971967551857233, + 0.6345183923840523, + 1.3125289119780064, + 2.340896848589182, + 2.608246335759759, + 0.9316444080322981, + 0.702489085495472, + 1.0206296909600496, + 0.7261111028492451, + 0.8391913529485464, + 0.25722858496010303, + 1.3822756372392178, + 1.2693758569657803, + 1.165618747472763, + 0.8326087221503258, + 1.3938303515315056, + 0.6644208207726479, + 1.4159962143748999, + 0.8502208851277828, + 1.523689629510045, + 0.1735796257853508, + 0.48144297301769257, + 0.9332377500832081, + 1.3990164324641228, + 0.5359593518078327, + 0.11049500107765198, + 0.2568547297269106, + 2.661630468443036, + 0.8182776868343353, + 1.2889529280364513, + 0.7562387976795435, + 0.8467616755515337, + 1.039133621379733, + 0.2853984385728836, + 4.895266165025532, + 0.549684189260006, + 1.0918447487056255, + 0.7418858055025339, + 0.6947720274329185, + 1.0349928876385093, + 0.7360035330057144, + 0.7553454264998436, + 1.5033303368836641, + 0.2950999513268471, + 1.0722557865083218, + 0.12824991531670094, + 0.8951839301735163, + 1.2332205008715391, + 0.12864326685667038, + 0.32461852580308914, + 0.6172716058790684, + 1.897663725540042, + 0.0 + ], + "unique_experts": 63, + "load_cv": 0.4979127476273403, + "normalized_load_entropy": 0.9673642756668034, + "max_load_share": 0.03864734299516908 + } + }, + "s1_bos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "4bb25d285eca95d66e0702398bfc706469bff4f43d8977cba917632b3b7fb7c8", + "route_weight_sha256": "beaf2fc9154fc10c2427ab45589a6986abad0408101f8d1d22ebda882647218e", + "loads": [ + 16, + 10, + 4, + 9, + 6, + 13, + 0, + 10, + 14, + 11, + 10, + 15, + 9, + 10, + 30, + 25, + 13, + 1, + 11, + 13, + 12, + 8, + 19, + 9, + 10, + 6, + 11, + 11, + 12, + 10, + 10, + 4, + 3, + 13, + 15, + 5, + 2, + 6, + 14, + 13, + 5, + 8, + 10, + 21, + 4, + 30, + 11, + 18, + 8, + 12, + 17, + 11, + 9, + 15, + 6, + 9, + 3, + 7, + 18, + 1, + 8, + 11, + 13, + 0 + ], + "weighted_loads": [ + 0.6728924624621868, + 0.4318574108183384, + 0.1741284318268299, + 0.8089119289070368, + 0.4477897137403488, + 2.529888354241848, + 0.0, + 0.6832499094307423, + 0.954858485609293, + 0.8062473032623529, + 0.7774734813719988, + 1.292812269181013, + 0.4723463077098131, + 0.7171242590993643, + 2.446122284978628, + 2.3832209445536137, + 0.7996147125959396, + 0.04324270039796829, + 0.9947628621011972, + 0.6287441998720169, + 0.45031451247632504, + 0.34226433653384447, + 1.4190746769309044, + 1.0328739993274212, + 0.7411404512822628, + 0.35349513217806816, + 0.6901032589375973, + 0.5300831906497478, + 1.2927084993571043, + 0.8284488767385483, + 1.5177053045481443, + 0.18167520873248577, + 0.13997107930481434, + 0.9932003393769264, + 1.3526672162115574, + 0.5267472974956036, + 0.11313768476247787, + 0.26185803581029177, + 2.48728396743536, + 0.8204869478940964, + 0.31765561923384666, + 0.5299501642584801, + 0.8262231666594744, + 1.00485472753644, + 0.2845485173165798, + 4.19969729334116, + 0.5351131428033113, + 1.089925603941083, + 0.7275773314759135, + 0.5604451652616262, + 0.8938091322779655, + 0.7702139653265476, + 0.6020859256386757, + 1.3759492691606283, + 0.28723419830203056, + 0.7284873016178608, + 0.13033586367964745, + 0.6004633121192455, + 1.2905086185783148, + 0.040666550397872925, + 0.3095857035368681, + 0.6082612685859203, + 1.4842344224452972, + 0.0 + ], + "unique_experts": 62, + "load_cv": 0.574842928315784, + "normalized_load_entropy": 0.9582883245235402, + "max_load_share": 0.04424778761061947 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "ea121a6900a54f6442a98651b1d016323e8b77fcc04ed1f7f5d4cf276390da78", + "route_weight_sha256": "cc2e031438a99c978c19c0e7d1b279aaf66a5b93288571769c4e5359f6f8c637", + "loads": [ + 22, + 13, + 6, + 16, + 12, + 13, + 3, + 11, + 14, + 17, + 17, + 17, + 11, + 18, + 30, + 32, + 16, + 6, + 13, + 13, + 13, + 9, + 19, + 18, + 19, + 28, + 25, + 14, + 13, + 11, + 11, + 5, + 8, + 13, + 16, + 5, + 7, + 8, + 17, + 14, + 18, + 14, + 12, + 22, + 6, + 35, + 13, + 20, + 8, + 14, + 19, + 17, + 14, + 15, + 7, + 17, + 11, + 20, + 19, + 3, + 9, + 16, + 22, + 0 + ], + "weighted_loads": [ + 0.9338198453187943, + 0.5774485729634762, + 0.2556586302816868, + 1.4640681985765696, + 0.8396019041538239, + 2.529888354241848, + 0.12018890678882599, + 0.7383803986012936, + 0.954858485609293, + 1.0152041483670473, + 1.2640698868781328, + 1.3596410024911165, + 0.5667705591768026, + 1.3281373251229525, + 2.446122284978628, + 2.7558888755738735, + 1.0609243847429752, + 0.5756905674934387, + 1.0605295356363058, + 0.6287441998720169, + 0.5476652588695288, + 0.41949397046118975, + 1.4190746769309044, + 1.6933467611670494, + 1.4115554988384247, + 1.8221437837928534, + 1.6657718922942877, + 0.6634700857102871, + 1.3316772114485502, + 0.9085752964019775, + 1.5778209995478392, + 0.22037881426513195, + 0.33827568404376507, + 0.9932003393769264, + 1.4360751248896122, + 0.5267472974956036, + 0.37524667009711266, + 0.3355748811736703, + 2.783615216612816, + 0.8539310209453106, + 1.9395940452814102, + 0.9190965946763754, + 0.924868306145072, + 1.023658074438572, + 0.5190017707645893, + 5.504293657839298, + 0.7538181785494089, + 1.2223226819187403, + 0.7275773314759135, + 0.6326145231723785, + 1.0802555419504642, + 1.0669055003672838, + 0.9188746400177479, + 1.3759492691606283, + 0.3752543292939663, + 1.2444156426936388, + 0.7876611277461052, + 1.394943356513977, + 1.3138743937015533, + 0.13312199339270592, + 0.34443054161965847, + 0.8920478112995625, + 2.1581403091549873, + 0.0 + ], + "unique_experts": 63, + "load_cv": 0.4676727382971575, + "normalized_load_entropy": 0.9722669813664303, + "max_load_share": 0.03787878787878788 + } + }, + "s0_x": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "440d52c96c8b5438111b8e679f8b45c8d076ede5857c434c23c1c9d3368bd416", + "route_weight_sha256": "6d9d6c2444e56746bdf1a0a26b3a66fe94f466a180a3b3b8f49e76d6000b85b7", + "loads": [ + 17, + 12, + 6, + 9, + 6, + 13, + 0, + 12, + 14, + 10, + 8, + 15, + 9, + 10, + 32, + 25, + 13, + 1, + 12, + 14, + 15, + 6, + 20, + 7, + 9, + 7, + 10, + 11, + 11, + 10, + 10, + 3, + 4, + 12, + 15, + 6, + 3, + 7, + 13, + 13, + 5, + 6, + 8, + 21, + 4, + 31, + 10, + 17, + 9, + 10, + 15, + 10, + 9, + 18, + 7, + 9, + 3, + 8, + 16, + 2, + 7, + 9, + 14, + 0 + ], + "weighted_loads": [ + 0.7209475375711918, + 0.5313081685453653, + 0.2531247455626726, + 0.7972368393093348, + 0.45905495434999466, + 2.5860714334994555, + 0.0, + 0.7719717193394899, + 0.9379546865820885, + 0.7687435168772936, + 0.6943903267383575, + 1.2842643111944199, + 0.41930959932506084, + 0.6960742603987455, + 2.5087480172514915, + 2.4178127190098166, + 0.8157064933329821, + 0.04030349478125572, + 0.9794963151216507, + 0.707976084202528, + 0.5938061494380236, + 0.27684699930250645, + 1.4854991659522057, + 0.9697771426290274, + 0.7148045673966408, + 0.41622336208820343, + 0.6299797771498561, + 0.5112382918596268, + 1.2040249668061733, + 0.8307850658893585, + 1.5087919756770134, + 0.17590123042464256, + 0.1742402371019125, + 0.9298545457422733, + 1.3326020911335945, + 0.5587735483422875, + 0.13865243270993233, + 0.313786999322474, + 2.504295475780964, + 0.824319738894701, + 0.3242945410311222, + 0.44147490337491035, + 0.7411008980125189, + 0.9767115786671638, + 0.2910842187702656, + 4.236397814936936, + 0.5128260962665081, + 1.0711474604904652, + 0.7298367889598012, + 0.44777459278702736, + 0.8815437350422144, + 0.774236835539341, + 0.5945228040218353, + 1.4678657781332731, + 0.3252552840858698, + 0.7492759972810745, + 0.1319508533924818, + 0.6406091451644897, + 1.1794368997216225, + 0.08677688613533974, + 0.2676221113651991, + 0.5114147402346134, + 1.5119774863123894, + 0.0 + ], + "unique_experts": 62, + "load_cv": 0.5877761551436418, + "normalized_load_entropy": 0.9582666619538274, + "max_load_share": 0.0471976401179941 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "2a6b573365acbc85b7a16a5b6d32d14bcca1672a222685da39ffb0306132db72", + "route_weight_sha256": "2ac3cd0635ad482b27080eeacc1399600437bb5c17506e2b9b7aa74150d845ca", + "loads": [ + 23, + 13, + 8, + 17, + 6, + 13, + 2, + 12, + 14, + 14, + 15, + 16, + 11, + 19, + 32, + 28, + 14, + 9, + 14, + 14, + 17, + 6, + 20, + 14, + 15, + 15, + 18, + 14, + 16, + 12, + 10, + 3, + 11, + 12, + 16, + 6, + 4, + 7, + 17, + 13, + 12, + 11, + 9, + 22, + 4, + 35, + 10, + 17, + 10, + 11, + 17, + 10, + 11, + 18, + 7, + 15, + 3, + 12, + 16, + 2, + 7, + 10, + 19, + 0 + ], + "weighted_loads": [ + 0.9389003496617079, + 0.5674387458711863, + 0.3545906115323305, + 1.5334139931946993, + 0.45905495434999466, + 2.5860714334994555, + 0.09579388424754143, + 0.7719717193394899, + 0.9379546865820885, + 0.9229021463543177, + 1.2403910346329212, + 1.3027405198663473, + 0.4822486136108637, + 1.3290506061166525, + 2.5087480172514915, + 2.6149753918871284, + 0.9086881224066019, + 0.7411671429872513, + 1.0330185256898403, + 0.707976084202528, + 0.8016587365418673, + 0.27684699930250645, + 1.4854991659522057, + 1.2969272285699844, + 1.199800718575716, + 0.9099651984870434, + 1.3018037406727672, + 0.640070054680109, + 1.3968767430633307, + 0.8997862860560417, + 1.5087919756770134, + 0.17590123042464256, + 0.4943132996559143, + 0.9298545457422733, + 1.4106053188443184, + 0.5587735483422875, + 0.18031594157218933, + 0.313786999322474, + 2.6661554276943207, + 0.824319738894701, + 1.217261180281639, + 0.6433544587343931, + 0.8478544261306524, + 0.9955149255692959, + 0.2910842187702656, + 5.016550925560296, + 0.5128260962665081, + 1.0711474604904652, + 0.7713567772880197, + 0.4847235567867756, + 1.0194905418902636, + 0.774236835539341, + 0.7489488124847412, + 1.4678657781332731, + 0.3252552840858698, + 1.1033110432326794, + 0.1319508533924818, + 0.8609835803508759, + 1.1794368997216225, + 0.08677688613533974, + 0.2676221113651991, + 0.572146225720644, + 1.8529304526746273, + 0.0 + ], + "unique_experts": 63, + "load_cv": 0.5035058772765278, + "normalized_load_entropy": 0.9680251657624377, + "max_load_share": 0.042270531400966184 + } + }, + "s1_x": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "a0fa0ba33b40b8769ad5a579d34f35c8a58a2a7fb5dc6c3ea7064bf12c7b4eb5", + "route_weight_sha256": "ac75f8d5dff38dcdd56912d0dbb11b9cf4f396ddaffac20698b427430a6475cf", + "loads": [ + 17, + 12, + 5, + 10, + 6, + 11, + 0, + 13, + 14, + 8, + 10, + 15, + 10, + 10, + 34, + 26, + 14, + 0, + 11, + 13, + 14, + 8, + 19, + 7, + 10, + 6, + 12, + 9, + 13, + 11, + 10, + 4, + 4, + 13, + 15, + 4, + 2, + 5, + 13, + 13, + 5, + 5, + 10, + 22, + 4, + 30, + 11, + 17, + 8, + 10, + 17, + 11, + 9, + 17, + 6, + 9, + 3, + 7, + 18, + 1, + 5, + 8, + 14, + 0 + ], + "weighted_loads": [ + 0.6992369201034307, + 0.5274491179734468, + 0.21010060980916023, + 0.8259200863540173, + 0.4463189635425806, + 2.5201270263642073, + 0.0, + 0.8079398348927498, + 0.9242614842951298, + 0.7204856779426336, + 0.7631232049316168, + 1.285636130720377, + 0.5225696079432964, + 0.6903998218476772, + 2.6985154319554567, + 2.4086756948381662, + 0.8381892163306475, + 0.0, + 0.9772769473493099, + 0.6585576124489307, + 0.4989264141768217, + 0.3237130679190159, + 1.4092187583446503, + 0.95775499753654, + 0.725877096876502, + 0.39931511506438255, + 0.6969917695969343, + 0.46135640889406204, + 1.3156643435359001, + 0.8827761597931385, + 1.5047071352601051, + 0.20502686873078346, + 0.1681780442595482, + 0.9924649391323328, + 1.3539223372936249, + 0.5150694660842419, + 0.1140146255493164, + 0.23294264823198318, + 2.449583800509572, + 0.8058469630777836, + 0.2875903844833374, + 0.3867380768060684, + 0.864721953868866, + 0.9374825116246939, + 0.2850918658077717, + 4.22008653357625, + 0.5337813459336758, + 1.0564429126679897, + 0.7029221821576357, + 0.4799619223922491, + 0.9128119088709354, + 0.7943268977105618, + 0.6119009964168072, + 1.4346368722617626, + 0.27825961634516716, + 0.685851227492094, + 0.1377793848514557, + 0.6000160817056894, + 1.264529699459672, + 0.038611892610788345, + 0.18695631437003613, + 0.48513465747237206, + 1.4982042107731104, + 0.0 + ], + "unique_experts": 61, + "load_cv": 0.6157706709483216, + "normalized_load_entropy": 0.9530804931860031, + "max_load_share": 0.05014749262536873 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "cc69d302c209ad7f9dde768ae40c2a3f0107dbedd9061211faa9d731f521cd6c", + "route_weight_sha256": "bd29ec83b898a79ba13a4a62f7f34c329461edf81fb86c88be3a39d716b3f556", + "loads": [ + 23, + 13, + 8, + 18, + 12, + 11, + 3, + 14, + 14, + 14, + 18, + 17, + 10, + 19, + 34, + 34, + 17, + 6, + 13, + 13, + 14, + 9, + 19, + 17, + 19, + 29, + 24, + 11, + 14, + 12, + 11, + 5, + 9, + 13, + 16, + 4, + 8, + 7, + 16, + 14, + 17, + 11, + 12, + 23, + 6, + 35, + 13, + 19, + 9, + 10, + 19, + 17, + 14, + 17, + 7, + 17, + 10, + 21, + 20, + 3, + 6, + 14, + 22, + 0 + ], + "weighted_loads": [ + 0.9591496977955103, + 0.5700918603688478, + 0.35102376714348793, + 1.6444805823266506, + 0.8381311539560556, + 2.5201270263642073, + 0.12018890678882599, + 0.8630703240633011, + 0.9242614842951298, + 0.9167904797941446, + 1.390996491536498, + 1.3524648640304804, + 0.5225696079432964, + 1.3610470071434975, + 2.6985154319554567, + 2.8178361784666777, + 1.0887429397553205, + 0.5826075561344624, + 1.0430436208844185, + 0.6585576124489307, + 0.4989264141768217, + 0.40094270184636116, + 1.4092187583446503, + 1.6473665609955788, + 1.3610287699848413, + 1.8694831524044275, + 1.5414163116365671, + 0.5372592099010944, + 1.355828084051609, + 0.9629025794565678, + 1.5648228302598, + 0.24373047426342964, + 0.3961944542825222, + 0.9924649391323328, + 1.4373454600572586, + 0.5150694660842419, + 0.43046820908784866, + 0.3066594935953617, + 2.745915049687028, + 0.8392910361289978, + 1.800684604793787, + 0.7501998972147703, + 0.9633670933544636, + 0.9562858585268259, + 0.5195451192557812, + 5.346814315766096, + 0.7524863816797733, + 1.188839990645647, + 0.7414548080414534, + 0.4799619223922491, + 1.134972419589758, + 1.091018432751298, + 0.9253736697137356, + 1.4346368722617626, + 0.3662797473371029, + 1.1916381623595953, + 0.7555324733257294, + 1.3848298843950033, + 1.3390793204307556, + 0.13106733560562134, + 0.2218011524528265, + 0.7911876048892736, + 2.056645268574357, + 0.0 + ], + "unique_experts": 63, + "load_cv": 0.49356345080295033, + "normalized_load_entropy": 0.9699229112211392, + "max_load_share": 0.03787878787878788 + } + }, + "s0_period": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "681cb2f1503c93d434ea49291670ee0e6fb7d15dbe537f30744c02c2ed1e1d39", + "route_weight_sha256": "8e36cc8049a4c3b7eb2e4ed4042f68953b91384c8e61c45257d77989b689e67f", + "loads": [ + 16, + 12, + 5, + 9, + 6, + 13, + 0, + 12, + 14, + 9, + 8, + 16, + 8, + 10, + 32, + 25, + 13, + 1, + 12, + 14, + 14, + 6, + 17, + 8, + 10, + 7, + 10, + 12, + 12, + 10, + 10, + 3, + 4, + 12, + 15, + 6, + 3, + 6, + 14, + 13, + 6, + 7, + 8, + 22, + 4, + 29, + 11, + 18, + 8, + 10, + 16, + 12, + 9, + 16, + 6, + 9, + 3, + 7, + 16, + 2, + 8, + 10, + 14, + 0 + ], + "weighted_loads": [ + 0.6851665880531073, + 0.5207733865827322, + 0.2137047816067934, + 0.7930908426642418, + 0.4548501167446375, + 2.6010486632585526, + 0.0, + 0.770253948867321, + 0.9238932877779007, + 0.7419583667069674, + 0.7030784487724304, + 1.325161885470152, + 0.3831594195216894, + 0.7060352265834808, + 2.4867449067533016, + 2.375706799328327, + 0.8223829064518213, + 0.044182296842336655, + 0.9808077085763216, + 0.7053304016590118, + 0.5429530907422304, + 0.284783030860126, + 1.4139168187975883, + 1.003560472279787, + 0.7071549035608768, + 0.4390154704451561, + 0.6093583358451724, + 0.54387410543859, + 1.22695395629853, + 0.8191177770495415, + 1.4772937167435884, + 0.17333970218896866, + 0.1730236280709505, + 0.9258275032043457, + 1.3463242948055267, + 0.5569157153367996, + 0.13251196406781673, + 0.30255548283457756, + 2.518164472654462, + 0.8259915933012962, + 0.3928345739841461, + 0.493844386190176, + 0.742888392880559, + 1.0253363847732544, + 0.28984905034303665, + 4.145354769192636, + 0.5484874881803989, + 1.0724284211173654, + 0.7125462340191007, + 0.45979876443743706, + 0.9201157335191965, + 0.8365252781659365, + 0.597898542881012, + 1.391696736216545, + 0.28947364166378975, + 0.7642447724938393, + 0.13226924650371075, + 0.5917509943246841, + 1.1895774882286787, + 0.09260769188404083, + 0.32581848092377186, + 0.5525096617639065, + 1.5379951372742653, + 0.0 + ], + "unique_experts": 62, + "load_cv": 0.5762942869395777, + "normalized_load_entropy": 0.9591665243487582, + "max_load_share": 0.0471976401179941 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "6a48a503af9f6da0286277f662168b5896b2e7208a08e4fdae4d72a767d69073", + "route_weight_sha256": "4e2802c5d594b4acfd4bf3f618933c68ad19e818b7aa28b1553c84ae7b27f77e", + "loads": [ + 22, + 13, + 7, + 17, + 6, + 13, + 2, + 12, + 14, + 12, + 14, + 17, + 10, + 18, + 32, + 28, + 14, + 8, + 14, + 14, + 17, + 6, + 17, + 14, + 16, + 17, + 18, + 16, + 17, + 12, + 10, + 3, + 11, + 12, + 16, + 6, + 4, + 6, + 18, + 13, + 14, + 12, + 10, + 23, + 4, + 33, + 11, + 18, + 8, + 10, + 18, + 12, + 11, + 16, + 6, + 16, + 3, + 11, + 16, + 2, + 8, + 11, + 19, + 0 + ], + "weighted_loads": [ + 0.9074783511459827, + 0.5569039639085531, + 0.3319316301494837, + 1.4205289594829082, + 0.4548501167446375, + 2.6010486632585526, + 0.09579388424754143, + 0.770253948867321, + 0.9238932877779007, + 0.852355008944869, + 1.0983228422701359, + 1.3436380941420794, + 0.44609843380749226, + 1.3005247190594673, + 2.4867449067533016, + 2.5662049390375614, + 0.9132407251745462, + 0.6995207779109478, + 1.0343299191445112, + 0.7053304016590118, + 0.8034818153828382, + 0.284783030860126, + 1.4139168187975883, + 1.2731483671814203, + 1.1739942654967308, + 1.024154145270586, + 1.2739265924319625, + 0.7083829138427973, + 1.4153289655223489, + 0.8879081308841705, + 1.4772937167435884, + 0.17333970218896866, + 0.502714853733778, + 0.9258275032043457, + 1.4338630214333534, + 0.5569157153367996, + 0.17123816721141338, + 0.30255548283457756, + 2.6800244245678186, + 0.8259915933012962, + 1.3353694677352905, + 0.7013331260532141, + 0.8913385663181543, + 1.0441397316753864, + 0.28984905034303665, + 4.9893287336453795, + 0.5484874881803989, + 1.0724284211173654, + 0.7125462340191007, + 0.45979876443743706, + 1.0553261060267687, + 0.8365252781659365, + 0.7559100687503815, + 1.391696736216545, + 0.28947364166378975, + 1.3151462525129318, + 0.13226924650371075, + 0.8057934939861298, + 1.1895774882286787, + 0.09260769188404083, + 0.32581848092377186, + 0.6124504469335079, + 1.88887345418334, + 0.0 + ], + "unique_experts": 63, + "load_cv": 0.49978407902867444, + "normalized_load_entropy": 0.9679248238806188, + "max_load_share": 0.03985507246376811 + } + }, + "s1_period": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "7ef7e77fe30b550b6c70b8714bbf7382b082a190a911e309f181e385bd3bddb2", + "route_weight_sha256": "0f741561053b7d55706a2d199776e31e3f0db1d3a8705c74b5bc618ec4d30209", + "loads": [ + 17, + 12, + 6, + 9, + 6, + 13, + 0, + 12, + 14, + 8, + 9, + 14, + 11, + 10, + 32, + 26, + 14, + 0, + 13, + 15, + 13, + 7, + 18, + 9, + 8, + 7, + 12, + 11, + 10, + 11, + 10, + 4, + 4, + 13, + 15, + 5, + 2, + 5, + 13, + 13, + 5, + 5, + 10, + 22, + 4, + 28, + 9, + 17, + 9, + 11, + 17, + 12, + 9, + 17, + 7, + 8, + 3, + 6, + 18, + 2, + 5, + 9, + 14, + 0 + ], + "weighted_loads": [ + 0.698191462084651, + 0.5265700407326221, + 0.23820790834724903, + 0.796196885406971, + 0.44718078151345253, + 2.594941545277834, + 0.0, + 0.7645702287554741, + 0.9169225078076124, + 0.725453058257699, + 0.7574976850301027, + 1.2425338625907898, + 0.5500407759100199, + 0.6897667236626148, + 2.516151662915945, + 2.3769024945795536, + 0.8400743212550879, + 0.0, + 1.0469925496727228, + 0.7334735840559006, + 0.5117076430469751, + 0.2927030883729458, + 1.389654230326414, + 1.0158193707466125, + 0.6229121349751949, + 0.4492447152733803, + 0.6859039952978492, + 0.526320293545723, + 1.204431228339672, + 0.8691059518605471, + 1.5036456417292356, + 0.2035214677453041, + 0.16420290060341358, + 1.004174791276455, + 1.3440706431865692, + 0.5232296576723456, + 0.11244714632630348, + 0.23597919568419456, + 2.4537208769470453, + 0.8024504706263542, + 0.2620422951877117, + 0.3856211379170418, + 0.8341421578079462, + 0.9656254835426807, + 0.28671738132834435, + 4.1508580055087805, + 0.4735211245715618, + 1.0336711071431637, + 0.735103570856154, + 0.5301975291222334, + 0.9000678434967995, + 0.8312966860830784, + 0.5949459187686443, + 1.4280432984232903, + 0.3226666282862425, + 0.6220215708017349, + 0.13428421318531036, + 0.5669645834714174, + 1.2744778450578451, + 0.08142600953578949, + 0.18274754658341408, + 0.518005758523941, + 1.4792326427996159, + 0.0 + ], + "unique_experts": 61, + "load_cv": 0.5901400936187331, + "normalized_load_entropy": 0.9561162543609026, + "max_load_share": 0.0471976401179941 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "75287e629c76f198cc476abc6df15c11efaeb7d3042f645a5ee85111be3abaae", + "route_weight_sha256": "f0b20aa172722e043d28601dbcc4423e37d0c2d9ec766c8a1f34f9c084eed4e1", + "loads": [ + 23, + 13, + 9, + 17, + 12, + 13, + 3, + 13, + 14, + 13, + 16, + 16, + 11, + 18, + 32, + 33, + 17, + 5, + 15, + 15, + 13, + 8, + 18, + 18, + 17, + 31, + 25, + 13, + 12, + 12, + 11, + 5, + 9, + 13, + 16, + 5, + 8, + 7, + 16, + 14, + 18, + 11, + 14, + 23, + 6, + 33, + 11, + 19, + 9, + 11, + 19, + 18, + 14, + 17, + 8, + 18, + 10, + 21, + 19, + 4, + 6, + 15, + 21, + 0 + ], + "weighted_loads": [ + 0.9589152056723833, + 0.5692127831280231, + 0.3626890014857054, + 1.5094365254044533, + 0.8389929719269276, + 2.594941545277834, + 0.12018890678882599, + 0.8197007179260254, + 0.9169225078076124, + 0.8845761213451624, + 1.2440940905362368, + 1.3093625959008932, + 0.5500407759100199, + 1.300779789686203, + 2.516151662915945, + 2.7295511215925217, + 1.0974966082721949, + 0.5324478670954704, + 1.1127592232078314, + 0.7334735840559006, + 0.5117076430469751, + 0.36993272230029106, + 1.389654230326414, + 1.6762921325862408, + 1.2519882023334503, + 2.036165753379464, + 1.5575881404802203, + 0.6022230945527554, + 1.271786404773593, + 0.9492323715239763, + 1.5637613367289305, + 0.2422250732779503, + 0.3754818569868803, + 1.004174791276455, + 1.4303513318300247, + 0.5232296576723456, + 0.4323095828294754, + 0.3096960410475731, + 2.7500521261245012, + 0.8358945436775684, + 1.8222959116101265, + 0.7529994677752256, + 1.0143070351332426, + 0.9844288304448128, + 0.5211706347763538, + 5.478324456140399, + 0.6922261603176594, + 1.166068185120821, + 0.735103570856154, + 0.5301975291222334, + 1.1051381677389145, + 1.1279882211238146, + 0.9198762811720371, + 1.4280432984232903, + 0.4106867592781782, + 1.3387434463948011, + 0.752037301659584, + 1.4100379291921854, + 1.2978436201810837, + 0.17388145253062248, + 0.21759238466620445, + 0.8262892793864012, + 1.983704499900341, + 0.0 + ], + "unique_experts": 63, + "load_cv": 0.47656419809469813, + "normalized_load_entropy": 0.9717290283993872, + "max_load_share": 0.03571428571428571 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 113, + "ordered_topk_exact_tokens": 78, + "set_exact_tokens": 92, + "mean_set_jaccard": 0.9469026548672567, + "mean_token_weighted_tv": 0.013518173527796712, + "aggregate_load_tv": 0.022123893805309734 + }, + "system_bos": { + "tokens": 113, + "ordered_topk_exact_tokens": 67, + "set_exact_tokens": 81, + "mean_set_jaccard": 0.9190897597977244, + "mean_token_weighted_tv": 0.01976169465703115, + "aggregate_load_tv": 0.035398230088495575 + }, + "system_x": { + "tokens": 113, + "ordered_topk_exact_tokens": 53, + "set_exact_tokens": 74, + "mean_set_jaccard": 0.8957016434892542, + "mean_token_weighted_tv": 0.027547210817579673, + "aggregate_load_tv": 0.04129793510324484 + }, + "system_period": { + "tokens": 113, + "ordered_topk_exact_tokens": 49, + "set_exact_tokens": 72, + "mean_set_jaccard": 0.8839022334597556, + "mean_token_weighted_tv": 0.028845682810266726, + "aggregate_load_tv": 0.03982300884955752 + }, + "bos_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 70, + "set_exact_tokens": 82, + "mean_set_jaccard": 0.9178255372945638, + "mean_token_weighted_tv": 0.019550023938372598, + "aggregate_load_tv": 0.03392330383480826 + }, + "bos_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 58, + "set_exact_tokens": 70, + "mean_set_jaccard": 0.8912768647281922, + "mean_token_weighted_tv": 0.02465929660072501, + "aggregate_load_tv": 0.03982300884955752 + }, + "x_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 63, + "set_exact_tokens": 76, + "mean_set_jaccard": 0.9026548672566371, + "mean_token_weighted_tv": 0.023045990805644376, + "aggregate_load_tv": 0.038348082595870206 + }, + "x_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 41, + "set_exact_tokens": 60, + "mean_set_jaccard": 0.8531394858828488, + "mean_token_weighted_tv": 0.033344380780065484, + "aggregate_load_tv": 0.05014749262536873 + }, + "period_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 63, + "set_exact_tokens": 75, + "mean_set_jaccard": 0.9039190897597977, + "mean_token_weighted_tv": 0.02253552527883939, + "aggregate_load_tv": 0.038348082595870206 + }, + "period_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 48, + "set_exact_tokens": 64, + "mean_set_jaccard": 0.8613569321533923, + "mean_token_weighted_tv": 0.03218984322424615, + "aggregate_load_tv": 0.04867256637168142 + } + } + }, + "layer_18": { + "layer": 18, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "003a92e71e30783a7f26eb110b664bb44ef544c70e403f77466f568e5b99e734", + "route_weight_sha256": "3b3b8436e889ecdd0069f66be66000db84050c41e4dda6c979b98eb98f460034", + "loads": [ + 8, + 11, + 21, + 6, + 6, + 13, + 11, + 16, + 10, + 0, + 5, + 14, + 1, + 7, + 19, + 5, + 13, + 4, + 8, + 11, + 17, + 1, + 10, + 18, + 13, + 5, + 17, + 11, + 8, + 10, + 14, + 8, + 13, + 8, + 3, + 4, + 8, + 35, + 5, + 15, + 11, + 9, + 6, + 19, + 3, + 18, + 6, + 15, + 16, + 19, + 27, + 7, + 10, + 9, + 13, + 7, + 11, + 9, + 12, + 15, + 6, + 4, + 0, + 14 + ], + "weighted_loads": [ + 0.5664918068796396, + 0.46079470589756966, + 2.1773136034607887, + 0.3459447808563709, + 0.3918048180639744, + 0.8709587380290031, + 0.8925063889473677, + 1.3544674180448055, + 1.3483004458248615, + 0.0, + 0.21748564019799232, + 0.7073699496686459, + 0.08200376480817795, + 0.7549933884292841, + 1.539990458637476, + 0.11503099277615547, + 0.9465133640915155, + 0.14410283043980598, + 0.4148006737232208, + 0.6912436485290527, + 1.328526895493269, + 0.02822551503777504, + 2.107482884079218, + 1.0511502660810947, + 0.652875532861799, + 0.25362055748701096, + 0.743111340329051, + 0.565369158051908, + 1.575169812887907, + 0.5740464869886637, + 1.1893945317715406, + 0.31053026020526886, + 1.0907119745388627, + 0.42411788180470467, + 0.42328596115112305, + 0.15392956137657166, + 0.3432709388434887, + 2.1137979570776224, + 0.202702596783638, + 0.533845629543066, + 0.6236581727862358, + 0.4518641773611307, + 0.23220455460250378, + 1.3650217670947313, + 0.10466626659035683, + 1.252630591392517, + 0.5089246369898319, + 1.2408609380945563, + 0.6733484379947186, + 1.972502637654543, + 1.2251861225813627, + 0.3292568624019623, + 1.0341813638806343, + 0.6507493332028389, + 1.2434470877051353, + 0.6773216892033815, + 0.4305240362882614, + 0.46537341363728046, + 3.145773157477379, + 0.919614901766181, + 0.32581086084246635, + 0.118300287052989, + 0.0, + 0.7518191933631897 + ], + "unique_experts": 62, + "load_cv": 0.5939028241739067, + "normalized_load_entropy": 0.9564432416145123, + "max_load_share": 0.051622418879056046 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "879328da2f2cd438f6414d72f1f2b721b74e700964b60e5b5be17c4fd9bcac22", + "route_weight_sha256": "b680a8c971f34634bd67c18aa5a45c9d7d3214575e012b70e60cd9c61e7b3890", + "loads": [ + 14, + 12, + 33, + 6, + 6, + 16, + 11, + 16, + 18, + 0, + 6, + 18, + 2, + 7, + 24, + 10, + 13, + 4, + 26, + 11, + 17, + 2, + 10, + 18, + 13, + 5, + 17, + 12, + 8, + 10, + 22, + 8, + 13, + 8, + 3, + 7, + 9, + 37, + 5, + 18, + 17, + 10, + 9, + 19, + 4, + 18, + 13, + 15, + 19, + 31, + 30, + 10, + 19, + 17, + 13, + 7, + 13, + 10, + 13, + 18, + 6, + 6, + 0, + 16 + ], + "weighted_loads": [ + 0.9509093817323446, + 0.531625110656023, + 3.2088122069835663, + 0.3459447808563709, + 0.3918048180639744, + 0.9419459663331509, + 0.8925063889473677, + 1.3544674180448055, + 1.8300997912883759, + 0.0, + 0.22853907570242882, + 1.111284550279379, + 0.11841418594121933, + 0.7549933884292841, + 2.4730900898575783, + 0.27524989284574986, + 0.9465133640915155, + 0.14410283043980598, + 1.5478402003645897, + 0.6912436485290527, + 1.328526895493269, + 0.05374618247151375, + 2.107482884079218, + 1.0511502660810947, + 0.652875532861799, + 0.25362055748701096, + 0.743111340329051, + 0.6366418963298202, + 1.575169812887907, + 0.5740464869886637, + 1.5331780826672912, + 0.31053026020526886, + 1.0907119745388627, + 0.42411788180470467, + 0.42328596115112305, + 0.2825479060411453, + 0.3669428415596485, + 2.1737546399235725, + 0.202702596783638, + 0.638939343392849, + 0.9666054770350456, + 0.4802536107599735, + 0.32220860198140144, + 1.3650217670947313, + 0.14330678060650826, + 1.252630591392517, + 2.0137055553495884, + 1.2408609380945563, + 0.8179671503603458, + 2.5097756441682577, + 1.3157213237136602, + 0.5288363117724657, + 1.646943999454379, + 1.2303197756409645, + 1.2434470877051353, + 0.6773216892033815, + 1.42724609375, + 0.5012693833559752, + 3.175057178363204, + 1.011128008365631, + 0.32581086084246635, + 0.17278343252837658, + 0.0, + 0.8421918824315071 + ], + "unique_experts": 62, + "load_cv": 0.5962025972201204, + "normalized_load_entropy": 0.956073183685554, + "max_load_share": 0.04468599033816425 + } + }, + "s1_eos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "fb173e2211a8bafaed94b2d616f4d2677f5e75e9520bf96ab86da36905aa80e3", + "route_weight_sha256": "a86fd30ed81a7e458e11e4aba25e99d67dde23e6c0197ac31f53c74574026498", + "loads": [ + 7, + 9, + 21, + 6, + 6, + 12, + 11, + 16, + 11, + 1, + 5, + 14, + 1, + 7, + 19, + 5, + 13, + 4, + 9, + 10, + 18, + 1, + 10, + 18, + 16, + 5, + 17, + 11, + 7, + 9, + 14, + 7, + 12, + 8, + 3, + 7, + 6, + 36, + 5, + 15, + 11, + 9, + 5, + 19, + 3, + 19, + 6, + 15, + 16, + 19, + 26, + 7, + 10, + 9, + 13, + 7, + 9, + 9, + 12, + 14, + 9, + 5, + 0, + 14 + ], + "weighted_loads": [ + 0.5755189801566303, + 0.38161771930754185, + 2.1616953015327454, + 0.3418510630726814, + 0.42653269693255424, + 0.8096174970269203, + 0.8671439457684755, + 1.345440287142992, + 1.415489268489182, + 0.033566638827323914, + 0.2149205207824707, + 0.7015881463885307, + 0.10567093640565872, + 0.7619553953409195, + 1.5514942314475775, + 0.12795850820839405, + 0.9488352574408054, + 0.1453357320278883, + 0.4398137889802456, + 0.6314290408045053, + 1.3608131632208824, + 0.02488451637327671, + 2.120649851858616, + 1.0596197117120028, + 0.7183171520009637, + 0.2530501075088978, + 0.73799386061728, + 0.5758795272558928, + 1.5442277304828167, + 0.5294341035187244, + 1.1775484345853329, + 0.26834658719599247, + 1.0391665305942297, + 0.42307473346590996, + 0.4183674678206444, + 0.25100869685411453, + 0.2781815342605114, + 2.1652768459171057, + 0.20598543994128704, + 0.5334967747330666, + 0.6234597079455853, + 0.4592064209282398, + 0.20669449865818024, + 1.3690494615584612, + 0.1029942687600851, + 1.2903830744326115, + 0.49843863397836685, + 1.215593472123146, + 0.6835286691784859, + 1.96720627322793, + 1.1617843192070723, + 0.33166615292429924, + 1.070546429604292, + 0.6255691647529602, + 1.248137367889285, + 0.6650181580334902, + 0.35843590274453163, + 0.45065861102193594, + 3.126860499382019, + 0.9164734799414873, + 0.4352302588522434, + 0.1379524003714323, + 0.0, + 0.7758407555520535 + ], + "unique_experts": 63, + "load_cv": 0.5962424725752327, + "normalized_load_entropy": 0.9574996643581383, + "max_load_share": 0.05309734513274336 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "6ee176aeb4e6c36595d2812e1ea54dcc959bd6af6e204832a42a12bb65b73667", + "route_weight_sha256": "953c7aa6fb443b5d3fc6af8fcd7f1321267266528a7198a359264b4ba0c2454c", + "loads": [ + 15, + 13, + 34, + 6, + 7, + 16, + 12, + 18, + 21, + 2, + 6, + 18, + 1, + 8, + 28, + 8, + 13, + 14, + 32, + 11, + 18, + 1, + 10, + 18, + 16, + 5, + 17, + 12, + 7, + 10, + 25, + 9, + 13, + 9, + 7, + 21, + 7, + 42, + 6, + 18, + 17, + 9, + 8, + 25, + 4, + 19, + 23, + 19, + 19, + 33, + 27, + 10, + 19, + 21, + 15, + 8, + 12, + 14, + 14, + 19, + 9, + 7, + 0, + 19 + ], + "weighted_loads": [ + 1.0186130995862186, + 0.5467004887759686, + 3.2303677797317505, + 0.3418510630726814, + 0.4648919217288494, + 0.9258981700986624, + 0.8974640667438507, + 1.414024768397212, + 2.2683421904221177, + 0.07038159668445587, + 0.22663975227624178, + 1.1021485105156898, + 0.10567093640565872, + 0.8075400851666927, + 2.663260269910097, + 0.21206008829176426, + 0.9488352574408054, + 0.7424988877028227, + 2.3471375051885843, + 0.7668693009763956, + 1.3608131632208824, + 0.02488451637327671, + 2.120649851858616, + 1.0596197117120028, + 0.7183171520009637, + 0.2530501075088978, + 0.73799386061728, + 0.6659802626818419, + 1.5442277304828167, + 0.5659844875335693, + 1.7775003043934703, + 0.510906221345067, + 1.0961424577981234, + 0.4986261986196041, + 0.8429937697947025, + 1.5037126615643501, + 0.3015830647200346, + 2.4236679431051016, + 0.2412255685776472, + 0.6238809283822775, + 0.9479296579957008, + 0.4592064209282398, + 0.2945739645510912, + 1.8511877562850714, + 0.14429318718612194, + 1.2903830744326115, + 3.0965681001544, + 1.3972225077450275, + 0.7784492075443268, + 2.5831099320203066, + 1.1880390830338001, + 0.525836206972599, + 1.650247098878026, + 1.382171893492341, + 1.368618069216609, + 0.7001335266977549, + 1.3707378096878529, + 0.6848249854519963, + 3.462311502546072, + 1.1813412066549063, + 0.4352302588522434, + 0.2023510541766882, + 0.0, + 0.9811942335218191 + ], + "unique_experts": 63, + "load_cv": 0.5847682117167288, + "normalized_load_entropy": 0.9577766923025319, + "max_load_share": 0.045454545454545456 + } + }, + "s0_bos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "76fcef633f585d03b23818362a647e3f4c11431a9cbab0abf8f0c74c7029af5f", + "route_weight_sha256": "36640d6fcd9fcef343909e96d60cc1660d1f1b9a15295620204dedd10818784e", + "loads": [ + 9, + 8, + 20, + 6, + 8, + 14, + 11, + 16, + 10, + 0, + 5, + 14, + 1, + 7, + 21, + 5, + 12, + 3, + 8, + 10, + 17, + 2, + 10, + 17, + 16, + 4, + 18, + 11, + 8, + 10, + 13, + 9, + 13, + 8, + 3, + 7, + 6, + 38, + 4, + 14, + 10, + 7, + 5, + 20, + 3, + 17, + 6, + 14, + 17, + 18, + 28, + 7, + 10, + 8, + 13, + 7, + 11, + 9, + 12, + 14, + 8, + 4, + 0, + 14 + ], + "weighted_loads": [ + 0.6373610347509384, + 0.35816652700304985, + 2.1360584907233715, + 0.3423166088759899, + 0.6200051307678223, + 0.9035730771720409, + 0.9018640285357833, + 1.3808284848928452, + 1.3497376032173634, + 0.0, + 0.22607120126485825, + 0.703546442091465, + 0.07017813622951508, + 0.7525233440101147, + 1.6280533764511347, + 0.126212352886796, + 0.9138059448450804, + 0.09381081350147724, + 0.4204181134700775, + 0.63617760874331, + 1.3255631849169731, + 0.057794131338596344, + 2.0978888235986233, + 1.001253079622984, + 0.7097074594348669, + 0.20918118581175804, + 0.7552749402821064, + 0.5492408238351345, + 1.5824766270816326, + 0.5743918847292662, + 1.102362321689725, + 0.38484466075897217, + 1.0944646503776312, + 0.4291115403175354, + 0.4205300509929657, + 0.2631484568119049, + 0.25844324566423893, + 2.307048335671425, + 0.1733367219567299, + 0.5001151338219643, + 0.5917903184890747, + 0.34913269616663456, + 0.20741270296275616, + 1.4249841403216124, + 0.12121795490384102, + 1.2274549454450607, + 0.48145876079797745, + 1.1597932148724794, + 0.7138255704194307, + 1.9445607885718346, + 1.2409753929823637, + 0.32796093448996544, + 1.0335536375641823, + 0.6100724693387747, + 1.2506503406912088, + 0.6754741296172142, + 0.4308534525334835, + 0.45668381080031395, + 3.086156778037548, + 0.9243789128959179, + 0.3738537076860666, + 0.10570231266319752, + 0.0, + 0.7711696736514568 + ], + "unique_experts": 62, + "load_cv": 0.6171257830658811, + "normalized_load_entropy": 0.9548571455033225, + "max_load_share": 0.05604719764011799 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "9aaafc113617ae6d90f5ec98dae8051e6f930e4e340b634469c6f4871ea9e87d", + "route_weight_sha256": "410fae798fe238557ad24293e7136c064f9888b87c7c4addffc54c1179ec1c00", + "loads": [ + 15, + 9, + 31, + 6, + 8, + 17, + 11, + 16, + 18, + 0, + 5, + 18, + 2, + 7, + 26, + 8, + 12, + 3, + 27, + 10, + 17, + 3, + 10, + 20, + 16, + 4, + 18, + 12, + 8, + 10, + 19, + 9, + 13, + 8, + 3, + 11, + 6, + 40, + 4, + 18, + 17, + 9, + 8, + 20, + 4, + 17, + 14, + 14, + 20, + 29, + 31, + 10, + 19, + 16, + 13, + 7, + 12, + 10, + 13, + 17, + 8, + 6, + 0, + 16 + ], + "weighted_loads": [ + 1.0217786096036434, + 0.4289969317615032, + 3.1408343389630318, + 0.3423166088759899, + 0.6200051307678223, + 0.9739310592412949, + 0.9018640285357833, + 1.3808284848928452, + 1.8315369486808777, + 0.0, + 0.22607120126485825, + 1.0257662534713745, + 0.24881970882415771, + 0.7525233440101147, + 2.477873472496867, + 0.22315574996173382, + 0.9138059448450804, + 0.09381081350147724, + 1.5717540849000216, + 0.63617760874331, + 1.3255631849169731, + 0.08331479877233505, + 2.0978888235986233, + 1.1116611156612635, + 0.7097074594348669, + 0.20918118581175804, + 0.7552749402821064, + 0.6258576847612858, + 1.5824766270816326, + 0.5743918847292662, + 1.4205245729535818, + 0.38484466075897217, + 1.0944646503776312, + 0.4291115403175354, + 0.4205300509929657, + 0.44697393476963043, + 0.25844324566423893, + 2.367005018517375, + 0.1733367219567299, + 0.6828101240098476, + 0.995314497500658, + 0.44331372156739235, + 0.3202352486550808, + 1.4249841403216124, + 0.16633370146155357, + 1.2274549454450607, + 1.9890507832169533, + 1.1597932148724794, + 0.858444282785058, + 2.442989757284522, + 1.3338014595210552, + 0.5259279366582632, + 1.646316273137927, + 1.2061337810009718, + 1.2506503406912088, + 0.6754741296172142, + 0.6539251618087292, + 0.4918382875621319, + 3.1154407989233732, + 1.0730727165937424, + 0.3738537076860666, + 0.1601854581385851, + 0.0, + 0.8615423627197742 + ], + "unique_experts": 62, + "load_cv": 0.6093662435992381, + "normalized_load_entropy": 0.9545502457298117, + "max_load_share": 0.04830917874396135 + } + }, + "s1_bos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "365d4e9fa2e123571e206f092ff55024c17bba45c8f771e953079e3e4c8a3fb6", + "route_weight_sha256": "99b85860d8c6d52ca483f03a8babff4c49a5fbf26fd81fe1585833df12ba5e53", + "loads": [ + 9, + 8, + 21, + 6, + 8, + 13, + 8, + 16, + 8, + 2, + 6, + 15, + 2, + 9, + 20, + 7, + 12, + 4, + 7, + 11, + 17, + 2, + 10, + 19, + 16, + 4, + 16, + 11, + 7, + 8, + 13, + 8, + 14, + 8, + 3, + 6, + 5, + 40, + 4, + 9, + 11, + 7, + 4, + 20, + 4, + 19, + 6, + 15, + 17, + 19, + 25, + 7, + 10, + 8, + 12, + 7, + 10, + 9, + 12, + 15, + 10, + 4, + 0, + 15 + ], + "weighted_loads": [ + 0.6474348520860076, + 0.34554655477404594, + 2.165873911231756, + 0.35008513554930687, + 0.640224039554596, + 0.8237058445811272, + 0.804622832685709, + 1.375305712223053, + 1.2906611114740372, + 0.051102180033922195, + 0.24741928279399872, + 0.7347503211349249, + 0.0982643086463213, + 0.8438402488827705, + 1.5832874421030283, + 0.19328100234270096, + 0.9098449349403381, + 0.12708639912307262, + 0.4024902321398258, + 0.6627722531557083, + 1.3711793012917042, + 0.05697932280600071, + 2.1155043337494135, + 1.0914265122264624, + 0.6902454989030957, + 0.20563770458102226, + 0.6766433473676443, + 0.583367089740932, + 1.5783979073166847, + 0.5227232091128826, + 1.1591155901551247, + 0.3464199807494879, + 1.130040667951107, + 0.4157958123832941, + 0.4242809861898422, + 0.24140673503279686, + 0.24880529381334782, + 2.4051016326993704, + 0.17775620892643929, + 0.34531921334564686, + 0.6164229661226273, + 0.32904029078781605, + 0.17456747964024544, + 1.4019927941262722, + 0.16082974709570408, + 1.313219828531146, + 0.4632074683904648, + 1.1814062912017107, + 0.695549450814724, + 1.975008212029934, + 1.1310495249927044, + 0.33137693256139755, + 1.066508311778307, + 0.5784324258565903, + 1.249490113928914, + 0.687251852825284, + 0.3836536817252636, + 0.46376492362469435, + 3.1382725089788437, + 0.9634920731186867, + 0.46609569154679775, + 0.10224247723817825, + 0.0, + 0.7673586700111628 + ], + "unique_experts": 63, + "load_cv": 0.619602457887031, + "normalized_load_entropy": 0.9569902408058533, + "max_load_share": 0.058997050147492625 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "292e3023a7b98519533a8b978bfdeed320475bdf4a349d7ffbfe6c80bb71bf04", + "route_weight_sha256": "9d87581074854fb85f4cbfdf0c96d72901e4e29eb836121d24b553045791dca7", + "loads": [ + 16, + 12, + 32, + 6, + 9, + 16, + 9, + 18, + 18, + 3, + 6, + 19, + 2, + 10, + 29, + 9, + 12, + 14, + 30, + 12, + 17, + 2, + 10, + 21, + 16, + 4, + 16, + 12, + 7, + 9, + 22, + 10, + 15, + 9, + 7, + 20, + 5, + 45, + 5, + 12, + 18, + 8, + 8, + 26, + 5, + 19, + 24, + 19, + 20, + 33, + 27, + 10, + 19, + 20, + 14, + 8, + 12, + 16, + 14, + 19, + 10, + 9, + 0, + 20 + ], + "weighted_loads": [ + 1.0561852855607867, + 0.5110433008521795, + 3.1701606065034866, + 0.35008513554930687, + 0.6785832643508911, + 0.912420304492116, + 0.8349429536610842, + 1.443890193477273, + 2.143514033406973, + 0.08791713789105415, + 0.24741928279399872, + 1.106249986216426, + 0.0982643086463213, + 0.8894249387085438, + 2.8196591958403587, + 0.25121608190238476, + 0.9098449349403381, + 0.724249554798007, + 2.2962364815175533, + 0.7982125133275986, + 1.3711793012917042, + 0.05697932280600071, + 2.1155043337494135, + 1.1592725683003664, + 0.6902454989030957, + 0.20563770458102226, + 0.6766433473676443, + 0.664872813038528, + 1.5783979073166847, + 0.5592735931277275, + 1.7167656868696213, + 0.5889796148985624, + 1.1870165951550007, + 0.49134727753698826, + 0.8489072881639004, + 1.5183427594602108, + 0.24880529381334782, + 2.62473470531404, + 0.21299633756279945, + 0.43226856738328934, + 0.9933511540293694, + 0.360953526571393, + 0.3101582992821932, + 1.8841310888528824, + 0.202970577403903, + 1.313219828531146, + 3.0818001329898834, + 1.3630353268235922, + 0.7904699891805649, + 2.607898348942399, + 1.1885508839040995, + 0.5303891822695732, + 1.646208981052041, + 1.3213773276656866, + 1.369970815256238, + 0.7223672214895487, + 0.6441975496709347, + 0.76800945866853, + 3.4737235121428967, + 1.2762831151485443, + 0.46609569154679775, + 0.26519592478871346, + 0.0, + 0.9727121479809284 + ], + "unique_experts": 63, + "load_cv": 0.5823275187601382, + "normalized_load_entropy": 0.9593384681470286, + "max_load_share": 0.048701298701298704 + } + }, + "s0_x": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "8a2f323074986689e62bf2ff90765da722ecdf7e8560768592bc4807aff4df2e", + "route_weight_sha256": "f1679779d25d716303bdc77b0405f2bd767cd4ae9e2dcc715538789242ae0ed2", + "loads": [ + 9, + 8, + 21, + 6, + 7, + 13, + 9, + 16, + 10, + 1, + 5, + 13, + 1, + 8, + 21, + 4, + 14, + 3, + 8, + 10, + 17, + 2, + 10, + 20, + 15, + 5, + 18, + 11, + 7, + 9, + 14, + 8, + 13, + 10, + 3, + 6, + 7, + 39, + 4, + 7, + 11, + 9, + 4, + 19, + 3, + 18, + 6, + 15, + 15, + 19, + 28, + 7, + 10, + 8, + 12, + 7, + 11, + 9, + 12, + 14, + 10, + 4, + 0, + 15 + ], + "weighted_loads": [ + 0.6421577483415604, + 0.36205534264445305, + 2.1945154778659344, + 0.35134653747081757, + 0.5210755690932274, + 0.8750421479344368, + 0.8523215670138597, + 1.3906418085098267, + 1.3364267153665423, + 0.018851378932595253, + 0.22569579258561134, + 0.6773369070142508, + 0.10683582723140717, + 0.7688011955469847, + 1.5936719086021185, + 0.09312549140304327, + 1.0004668738692999, + 0.09567277505993843, + 0.4315965212881565, + 0.6338923256844282, + 1.3481642417609692, + 0.06160210259258747, + 2.1555069517344236, + 1.1479219980537891, + 0.6724343858659267, + 0.24795613065361977, + 0.7881069835275412, + 0.5545889670029283, + 1.5686309561133385, + 0.5590211115777493, + 1.2332287803292274, + 0.33560241013765335, + 1.138797402381897, + 0.48292206414043903, + 0.426336333155632, + 0.23468583449721336, + 0.28472073562443256, + 2.273098623380065, + 0.18120716884732246, + 0.262251490727067, + 0.6211697496473789, + 0.4055750221014023, + 0.19383174553513527, + 1.4266050159931183, + 0.10989063791930676, + 1.2676911912858486, + 0.5035518892109394, + 1.2497585592791438, + 0.6377254128456116, + 2.0550114326179028, + 1.227534707635641, + 0.3241228386759758, + 1.0728845857083797, + 0.5910220518708229, + 1.24385591968894, + 0.6940131951123476, + 0.42611935548484325, + 0.4735815357416868, + 3.0714480504393578, + 0.9350185347720981, + 0.44733483530581, + 0.10598087683320045, + 0.0, + 0.7957103103399277 + ], + "unique_experts": 63, + "load_cv": 0.6287477587532833, + "normalized_load_entropy": 0.9545928365975981, + "max_load_share": 0.05752212389380531 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "7c0de88a931a0ab6f404a37b1c46cab8ce69c00f2fd6737ce19979fa64c59492", + "route_weight_sha256": "6b7a8c6c4ebfcc16bf6c85fd8b1ff24bc5719f59740b63f25aaaec65359c62b6", + "loads": [ + 17, + 9, + 34, + 6, + 7, + 15, + 9, + 16, + 18, + 1, + 5, + 17, + 2, + 8, + 26, + 8, + 14, + 3, + 26, + 10, + 17, + 3, + 10, + 20, + 15, + 5, + 18, + 12, + 7, + 9, + 20, + 8, + 13, + 10, + 3, + 10, + 7, + 42, + 4, + 10, + 17, + 10, + 6, + 19, + 4, + 18, + 13, + 15, + 19, + 31, + 29, + 11, + 20, + 16, + 12, + 7, + 12, + 10, + 15, + 16, + 10, + 6, + 0, + 18 + ], + "weighted_loads": [ + 1.1071479879319668, + 0.4328857474029064, + 3.3959196507930756, + 0.35134653747081757, + 0.5210755690932274, + 0.9237195551395416, + 0.8523215670138597, + 1.3906418085098267, + 1.8182260608300567, + 0.018851378932595253, + 0.22569579258561134, + 1.0570214372128248, + 0.13198873959481716, + 0.7688011955469847, + 2.529712224379182, + 0.2281114710494876, + 1.0004668738692999, + 0.09567277505993843, + 1.593103177845478, + 0.6338923256844282, + 1.3481642417609692, + 0.08712277002632618, + 2.1555069517344236, + 1.1479219980537891, + 0.6724343858659267, + 0.24795613065361977, + 0.7881069835275412, + 0.6208587000146508, + 1.5686309561133385, + 0.5590211115777493, + 1.5369051340967417, + 0.33560241013765335, + 1.138797402381897, + 0.48292206414043903, + 0.426336333155632, + 0.3964253105223179, + 0.28472073562443256, + 2.3685115054249763, + 0.18120716884732246, + 0.37205720506608486, + 0.986805722117424, + 0.4353357832878828, + 0.24882554076611996, + 1.4266050159931183, + 0.14371839724481106, + 1.2676911912858486, + 1.9279556162655354, + 1.2497585592791438, + 0.8254214599728584, + 2.6020120698958635, + 1.2538123037666082, + 0.5666210539638996, + 1.7851460073143244, + 1.1354420520365238, + 1.24385591968894, + 0.6940131951123476, + 0.6491910647600889, + 0.5132957492023706, + 3.201630273833871, + 1.0126418275758624, + 0.44733483530581, + 0.16046402230858803, + 0.0, + 0.9651625156402588 + ], + "unique_experts": 63, + "load_cv": 0.6219513618156393, + "normalized_load_entropy": 0.954499006451163, + "max_load_share": 0.050724637681159424 + } + }, + "s1_x": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "e964b48dc5d73356fca1fd81a83b203e53306e694925cdccdf9eb864a56bca3c", + "route_weight_sha256": "03d096df35298b092e73d151c055d7f2a58b4f5a14bd6576489b771508dd13ca", + "loads": [ + 8, + 8, + 21, + 6, + 7, + 13, + 10, + 17, + 7, + 1, + 7, + 16, + 1, + 8, + 20, + 6, + 14, + 3, + 8, + 9, + 18, + 2, + 10, + 19, + 16, + 4, + 17, + 12, + 7, + 9, + 14, + 7, + 13, + 7, + 3, + 7, + 4, + 38, + 4, + 8, + 12, + 9, + 4, + 21, + 4, + 18, + 6, + 16, + 15, + 19, + 24, + 7, + 10, + 8, + 14, + 8, + 10, + 9, + 12, + 14, + 11, + 4, + 0, + 14 + ], + "weighted_loads": [ + 0.6204150766134262, + 0.3366690147668123, + 2.1920743621885777, + 0.35671868175268173, + 0.6739825382828712, + 0.8355556279420853, + 0.86065514665097, + 1.3837115429341793, + 1.2848528511822224, + 0.01771647110581398, + 0.27357970736920834, + 0.7774398289620876, + 0.08914574235677719, + 0.784817099571228, + 1.511683264747262, + 0.15993881784379482, + 0.9934952892363071, + 0.1006386112421751, + 0.44201268441975117, + 0.5948182400316, + 1.4009455554187298, + 0.061775295063853264, + 2.1200787238776684, + 1.1242043003439903, + 0.6877863905392587, + 0.19543364271521568, + 0.743010837584734, + 0.6316891275346279, + 1.5606102123856544, + 0.5545815639197826, + 1.2340038530528545, + 0.30598822608590126, + 1.0916056148707867, + 0.3265508208423853, + 0.41586166620254517, + 0.2880791164934635, + 0.20126079581677914, + 2.32209718413651, + 0.17127341404557228, + 0.30656702257692814, + 0.6410908661782742, + 0.4176139086484909, + 0.1604103296995163, + 1.4236740823835135, + 0.14599133282899857, + 1.2568662092089653, + 0.4892454743385315, + 1.2222266914322972, + 0.6515601743012667, + 1.989162351936102, + 1.1123809423297644, + 0.33403242006897926, + 1.1178095303475857, + 0.4563545621931553, + 1.3570929635316133, + 0.7285952623933554, + 0.36325105279684067, + 0.4830952640622854, + 3.1109107732772827, + 0.9314250340685248, + 0.49289910309016705, + 0.10492748580873013, + 0.0, + 0.7815460711717606 + ], + "unique_experts": 63, + "load_cv": 0.6157706709483216, + "normalized_load_entropy": 0.9555334211351474, + "max_load_share": 0.05604719764011799 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "b0a5535e78310d088959d7bfd6f920b4226f309951d3c977cbc9c8b1a566056c", + "route_weight_sha256": "407cddc9a73d22370b5feb067671b4946ea1c3554829dea45009f3f6741d7a60", + "loads": [ + 18, + 11, + 33, + 6, + 9, + 16, + 11, + 19, + 18, + 2, + 7, + 20, + 1, + 9, + 29, + 9, + 14, + 13, + 30, + 10, + 18, + 2, + 10, + 20, + 16, + 4, + 17, + 13, + 7, + 10, + 23, + 9, + 14, + 8, + 7, + 20, + 4, + 44, + 5, + 11, + 18, + 9, + 6, + 28, + 5, + 18, + 23, + 20, + 20, + 33, + 25, + 11, + 20, + 20, + 16, + 9, + 12, + 14, + 14, + 17, + 12, + 6, + 1, + 20 + ], + "weighted_loads": [ + 1.2508380487561226, + 0.4732071030884981, + 3.316834069788456, + 0.35671868175268173, + 0.7455200627446175, + 0.9242700878530741, + 0.8909752676263452, + 1.4522960241883993, + 2.1784419678151608, + 0.05453142896294594, + 0.27357970736920834, + 1.0906966887414455, + 0.08914574235677719, + 0.8304017893970013, + 2.4763572812080383, + 0.2445031087845564, + 0.9934952892363071, + 0.6978017669171095, + 2.3606393933296204, + 0.7302585002034903, + 1.4009455554187298, + 0.061775295063853264, + 2.1200787238776684, + 1.1635984741151333, + 0.6877863905392587, + 0.19543364271521568, + 0.743010837584734, + 0.733748484402895, + 1.5606102123856544, + 0.5911319479346275, + 1.7660012505948544, + 0.5485478602349758, + 1.1485815420746803, + 0.40210228599607944, + 0.8404879681766033, + 1.5238884463906288, + 0.20126079581677914, + 2.580843796953559, + 0.20651354268193245, + 0.398995004594326, + 0.9641169644892216, + 0.4176139086484909, + 0.21238341741263866, + 1.9614418167620897, + 0.1790463924407959, + 1.2568662092089653, + 2.9591762870550156, + 1.4038557270541787, + 0.8147546369582415, + 2.5986610297113657, + 1.1386357061564922, + 0.5820294246077538, + 1.7754135746508837, + 1.131241051480174, + 1.4775736648589373, + 0.76371063105762, + 0.6237949207425117, + 0.7172616384923458, + 3.4463617764413357, + 1.1529910219833255, + 0.5227782055735588, + 0.16932613961398602, + 0.03053954802453518, + 1.0525093469768763 + ], + "unique_experts": 64, + "load_cv": 0.5871987600152292, + "normalized_load_entropy": 0.958386795714221, + "max_load_share": 0.047619047619047616 + } + }, + "s0_period": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "64db915624c59a15c735ae26a826ee78c4fc9a6ec5cad62b4b8edd6a7e189312", + "route_weight_sha256": "76f45882c58b29f93d336d3c6018fe5dc2154681423a7061f578dd6b3226e30f", + "loads": [ + 9, + 8, + 21, + 6, + 6, + 15, + 9, + 16, + 9, + 0, + 5, + 13, + 1, + 7, + 20, + 3, + 14, + 3, + 9, + 9, + 17, + 2, + 10, + 20, + 17, + 4, + 17, + 10, + 7, + 11, + 15, + 7, + 13, + 11, + 3, + 7, + 7, + 36, + 4, + 9, + 11, + 9, + 4, + 19, + 3, + 17, + 6, + 16, + 17, + 19, + 26, + 7, + 10, + 8, + 12, + 7, + 11, + 8, + 13, + 15, + 11, + 4, + 0, + 15 + ], + "weighted_loads": [ + 0.6415237579494715, + 0.3638099767267704, + 2.195810906589031, + 0.36561109870672226, + 0.3980015851557255, + 0.9543567448854446, + 0.8578550983220339, + 1.4032042995095253, + 1.3161287438124418, + 0.0, + 0.21422179602086544, + 0.6750249806791544, + 0.11879909038543701, + 0.7593634575605392, + 1.54063961468637, + 0.07979153282940388, + 0.9914475716650486, + 0.09704683162271976, + 0.45377909950912, + 0.6055305227637291, + 1.3446241989731789, + 0.061501169577240944, + 2.1123224645853043, + 1.1335750594735146, + 0.7358118374831975, + 0.2083573155105114, + 0.7674279175698757, + 0.553268488496542, + 1.5625619664788246, + 0.6122657414525747, + 1.2707269433885813, + 0.3038951363414526, + 1.1192427016794682, + 0.51365065574646, + 0.424025721848011, + 0.2725394666194916, + 0.2883313656784594, + 2.1624209117144346, + 0.1875324882566929, + 0.3258808497339487, + 0.6152327805757523, + 0.4069326352328062, + 0.19004372507333755, + 1.419852651655674, + 0.11152028478682041, + 1.2257311083376408, + 0.5642955712974072, + 1.2887632120400667, + 0.7137310393154621, + 2.03306370601058, + 1.1599783897399902, + 0.3289298191666603, + 1.0584346503019333, + 0.6179510354995728, + 1.245812464505434, + 0.671469759196043, + 0.4267749711871147, + 0.4376112297177315, + 3.1245324797928333, + 0.9623694401234388, + 0.48263400234282017, + 0.10595819912850857, + 0.0, + 0.7859816551208496 + ], + "unique_experts": 62, + "load_cv": 0.613278521966303, + "normalized_load_entropy": 0.9540270244078074, + "max_load_share": 0.05309734513274336 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "3d3f811acdbefa7c85d6a5dbb33cf30eb9435cecbd0f83068dfe5416dfe14b36", + "route_weight_sha256": "3fa95b351fa53cc1b7921169510e7299285b67f83a18ff6f6601a3790c03605e", + "loads": [ + 17, + 9, + 32, + 6, + 6, + 17, + 9, + 16, + 17, + 0, + 5, + 17, + 2, + 7, + 25, + 7, + 14, + 3, + 29, + 9, + 17, + 3, + 10, + 20, + 17, + 4, + 17, + 11, + 7, + 11, + 22, + 8, + 13, + 11, + 3, + 10, + 7, + 38, + 4, + 12, + 17, + 10, + 6, + 19, + 4, + 17, + 14, + 16, + 21, + 31, + 28, + 9, + 20, + 17, + 12, + 7, + 12, + 10, + 15, + 17, + 11, + 6, + 0, + 17 + ], + "weighted_loads": [ + 1.1047125235199928, + 0.43464038148522377, + 3.2005867548286915, + 0.36561109870672226, + 0.3980015851557255, + 1.0030341520905495, + 0.8578550983220339, + 1.4032042995095253, + 1.7979280892759562, + 0.0, + 0.21422179602086544, + 1.0419828984886408, + 0.1445593275129795, + 0.7593634575605392, + 2.5532878283411264, + 0.21238375268876553, + 0.9914475716650486, + 0.09704683162271976, + 1.6824255492538214, + 0.6055305227637291, + 1.3446241989731789, + 0.08702183701097965, + 2.1123224645853043, + 1.1335750594735146, + 0.7358118374831975, + 0.2083573155105114, + 0.7674279175698757, + 0.6282975114881992, + 1.5625619664788246, + 0.6122657414525747, + 1.5963118690997362, + 0.3328653648495674, + 1.1192427016794682, + 0.51365065574646, + 0.424025721848011, + 0.39989976957440376, + 0.2883313656784594, + 2.2223775945603848, + 0.1875324882566929, + 0.4376907516270876, + 0.9602826572954655, + 0.4364285320043564, + 0.24503752030432224, + 1.419852651655674, + 0.14743426255881786, + 1.2257311083376408, + 2.200915690511465, + 1.2887632120400667, + 0.8900578990578651, + 2.5736134108155966, + 1.2197590116411448, + 0.500626340508461, + 1.7426228504627943, + 1.235169593244791, + 1.245812464505434, + 0.671469759196043, + 0.6498466804623604, + 0.5217706076800823, + 3.191160986199975, + 1.0405637566000223, + 0.48263400234282017, + 0.16044134460389614, + 0.0, + 0.876354344189167 + ], + "unique_experts": 62, + "load_cv": 0.6122700053894836, + "normalized_load_entropy": 0.9537221914553742, + "max_load_share": 0.04589371980676329 + } + }, + "s1_period": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "a5b998a51dd7fb16db11eb2bfed188e47a6ff9c8558c995a6dbd4540d04e7aec", + "route_weight_sha256": "fe0654bb78c0f02ddf914c232b5b693cc1c3de8aed2fd6b125d8ccdd5ea9fdcf", + "loads": [ + 8, + 7, + 22, + 6, + 7, + 15, + 8, + 17, + 7, + 1, + 6, + 16, + 1, + 9, + 20, + 4, + 12, + 3, + 7, + 10, + 18, + 3, + 10, + 20, + 16, + 4, + 16, + 12, + 8, + 9, + 14, + 7, + 13, + 8, + 3, + 9, + 5, + 38, + 4, + 7, + 12, + 6, + 5, + 20, + 3, + 18, + 6, + 17, + 17, + 19, + 25, + 7, + 10, + 8, + 13, + 7, + 10, + 9, + 12, + 14, + 11, + 4, + 0, + 15 + ], + "weighted_loads": [ + 0.6289081340655684, + 0.30832715332508087, + 2.2136168349534273, + 0.35467175021767616, + 0.6103803031146526, + 0.8938399609178305, + 0.8219539243727922, + 1.3913110680878162, + 1.2294281097128987, + 0.017640192061662674, + 0.23760410770773888, + 0.7703035101294518, + 0.08391173928976059, + 0.8269382026046515, + 1.5155189465731382, + 0.10843494907021523, + 0.9148630816489458, + 0.09924396686255932, + 0.36713397316634655, + 0.6399329397827387, + 1.3887085691094398, + 0.08033800683915615, + 2.130390401929617, + 1.143350224941969, + 0.7042097146622837, + 0.1971583552658558, + 0.7110329791903496, + 0.6249043997377157, + 1.5670603439211845, + 0.55559241771698, + 1.2334371283650398, + 0.29677939042449, + 1.0824362896382809, + 0.39584244787693024, + 0.4154357388615608, + 0.3356279730796814, + 0.23207387141883373, + 2.2874332554638386, + 0.17504677549004555, + 0.27094317227602005, + 0.6226801238954067, + 0.30568158254027367, + 0.19090046919882298, + 1.397052763029933, + 0.1109754778444767, + 1.2565346136689186, + 0.47520672902464867, + 1.2446534279733896, + 0.7216397020965815, + 1.9607535749673843, + 1.1423209719359875, + 0.34060022607445717, + 1.1241622902452946, + 0.4326005559414625, + 1.3384564071893692, + 0.6788654513657093, + 0.36865489557385445, + 0.4897053800523281, + 3.1193571984767914, + 0.9489613585174084, + 0.5144218672066927, + 0.1039978638291359, + 0.0, + 0.8124007247388363 + ], + "unique_experts": 63, + "load_cv": 0.6269737848623093, + "normalized_load_entropy": 0.9542321253889366, + "max_load_share": 0.05604719764011799 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "627c190951bdc62e75341d523f4e6fdc26e4c495852c2119397fcf110ae43f77", + "route_weight_sha256": "1004703342a311368a1c9eb20a918064c962bb86639605f8eea2bef0df1008dc", + "loads": [ + 16, + 10, + 33, + 6, + 9, + 18, + 9, + 19, + 17, + 3, + 6, + 20, + 1, + 10, + 29, + 7, + 12, + 13, + 29, + 11, + 18, + 4, + 10, + 20, + 16, + 4, + 16, + 13, + 8, + 10, + 22, + 9, + 14, + 9, + 7, + 23, + 5, + 44, + 5, + 10, + 18, + 6, + 7, + 27, + 4, + 18, + 24, + 21, + 20, + 33, + 26, + 12, + 20, + 21, + 15, + 8, + 12, + 15, + 14, + 17, + 12, + 7, + 1, + 21 + ], + "weighted_loads": [ + 1.0756387105211616, + 0.44486524164676666, + 3.2179035302251577, + 0.35467175021767616, + 0.6775873526930809, + 0.9825544208288193, + 0.8522740453481674, + 1.4598955493420362, + 2.0822810316458344, + 0.10060107707977295, + 0.23760410770773888, + 1.1364631727337837, + 0.08391173928976059, + 0.8725228924304247, + 2.6595710031688213, + 0.19324782490730286, + 0.9148630816489458, + 0.6964071225374937, + 2.2446088567376137, + 0.7753731999546289, + 1.3887085691094398, + 0.11215384863317013, + 2.130390401929617, + 1.143350224941969, + 0.7042097146622837, + 0.1971583552658558, + 0.7110329791903496, + 0.7377009373158216, + 1.5670603439211845, + 0.5921428017318249, + 1.7366359010338783, + 0.5393390245735645, + 1.1394122168421745, + 0.4713939130306244, + 0.840062040835619, + 1.5897310450673103, + 0.23207387141883373, + 2.543005134910345, + 0.21028690412640572, + 0.3712104018777609, + 0.9297868348658085, + 0.30568158254027367, + 0.24287355691194534, + 1.9137046989053488, + 0.14972910284996033, + 1.2565346136689186, + 3.0384629108011723, + 1.426282463595271, + 0.8165602404624224, + 2.5799588169902563, + 1.1685757357627153, + 0.6527654938399792, + 1.765941260382533, + 1.162936232984066, + 1.4589371085166931, + 0.713980820029974, + 0.6291987635195255, + 0.7956667710095644, + 3.4548082016408443, + 1.1763359531760216, + 0.5398837793618441, + 0.19990353286266327, + 0.03196365013718605, + 1.0509567987173796 + ], + "unique_experts": 64, + "load_cv": 0.5883465677761888, + "normalized_load_entropy": 0.9587766812127879, + "max_load_share": 0.047619047619047616 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 113, + "ordered_topk_exact_tokens": 76, + "set_exact_tokens": 86, + "mean_set_jaccard": 0.9317319848293298, + "mean_token_weighted_tv": 0.014295953779225856, + "aggregate_load_tv": 0.02359882005899705 + }, + "system_bos": { + "tokens": 113, + "ordered_topk_exact_tokens": 64, + "set_exact_tokens": 78, + "mean_set_jaccard": 0.9039190897597977, + "mean_token_weighted_tv": 0.020566869143858156, + "aggregate_load_tv": 0.03982300884955752 + }, + "system_x": { + "tokens": 113, + "ordered_topk_exact_tokens": 52, + "set_exact_tokens": 68, + "mean_set_jaccard": 0.8805309734513276, + "mean_token_weighted_tv": 0.028525905660971736, + "aggregate_load_tv": 0.03392330383480826 + }, + "system_period": { + "tokens": 113, + "ordered_topk_exact_tokens": 44, + "set_exact_tokens": 62, + "mean_set_jaccard": 0.8638853771597135, + "mean_token_weighted_tv": 0.030150206617401105, + "aggregate_load_tv": 0.04129793510324484 + }, + "bos_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 51, + "set_exact_tokens": 72, + "mean_set_jaccard": 0.8944374209860937, + "mean_token_weighted_tv": 0.022342589055394046, + "aggregate_load_tv": 0.03392330383480826 + }, + "bos_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 54, + "set_exact_tokens": 69, + "mean_set_jaccard": 0.8830594184576486, + "mean_token_weighted_tv": 0.024842689194988492, + "aggregate_load_tv": 0.045722713864306784 + }, + "x_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 49, + "set_exact_tokens": 68, + "mean_set_jaccard": 0.8786346396965865, + "mean_token_weighted_tv": 0.025334479421195863, + "aggregate_load_tv": 0.03982300884955752 + }, + "x_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 47, + "set_exact_tokens": 63, + "mean_set_jaccard": 0.867888748419722, + "mean_token_weighted_tv": 0.031083437103151746, + "aggregate_load_tv": 0.04129793510324484 + }, + "period_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 44, + "set_exact_tokens": 64, + "mean_set_jaccard": 0.8723135271807839, + "mean_token_weighted_tv": 0.025196285335248154, + "aggregate_load_tv": 0.045722713864306784 + }, + "period_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 42, + "set_exact_tokens": 61, + "mean_set_jaccard": 0.8594605983986515, + "mean_token_weighted_tv": 0.03156904618264036, + "aggregate_load_tv": 0.04867256637168141 + } + } + }, + "layer_19": { + "layer": 19, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "e1f712a2f92372863a5e3b2ee750469a89ebd106672a1d3ac26e6f88293e0e26", + "route_weight_sha256": "2feecedce259f5ce046782dbc3f0785c428c907a2eb0c35f65fbcb620eaba23d", + "loads": [ + 8, + 12, + 28, + 8, + 17, + 4, + 9, + 2, + 9, + 24, + 10, + 8, + 17, + 10, + 16, + 11, + 12, + 0, + 7, + 15, + 10, + 17, + 10, + 5, + 11, + 11, + 5, + 11, + 5, + 11, + 11, + 11, + 0, + 23, + 31, + 9, + 5, + 6, + 11, + 12, + 5, + 4, + 12, + 8, + 12, + 9, + 7, + 9, + 4, + 12, + 11, + 7, + 14, + 31, + 0, + 16, + 7, + 22, + 11, + 12, + 6, + 7, + 5, + 5 + ], + "weighted_loads": [ + 0.3134255539625883, + 1.8712856322526932, + 2.552396665327251, + 1.6300215581431985, + 1.587804388254881, + 0.16403701156377792, + 0.6287503093481064, + 0.09311724826693535, + 0.7577088922262192, + 1.7331925686448812, + 0.3874602187424898, + 0.4648941829800606, + 0.7458050064742565, + 0.32887441478669643, + 1.1547943577170372, + 0.49343057721853256, + 0.7074574679136276, + 0.0, + 0.36162157356739044, + 1.2007657755166292, + 0.6552116982638836, + 0.9119651280343533, + 0.7883230596780777, + 0.2134320829063654, + 0.9956534989178181, + 1.3482003696262836, + 0.21131739020347595, + 0.579288337379694, + 0.3043777346611023, + 1.968261806294322, + 0.5772759728133678, + 1.1075014509260654, + 0.0, + 1.4107628781348467, + 5.297150671482086, + 0.9326094090938568, + 0.19401980936527252, + 0.22041558101773262, + 1.2010170109570026, + 0.9740659967064857, + 0.1728897150605917, + 0.22010445222258568, + 0.41895447485148907, + 0.317614508792758, + 0.7142517305910587, + 0.4745713286101818, + 0.246070496737957, + 0.7856616303324699, + 0.21629207953810692, + 0.939218282699585, + 0.37923180870711803, + 0.3045494370162487, + 0.9927002433687449, + 3.326908399350941, + 0.0, + 0.9610562417656183, + 0.8125467803329229, + 1.386770335957408, + 1.729314174503088, + 0.5927569810301065, + 0.19495346397161484, + 0.42720822244882584, + 0.1080295480787754, + 0.5598758421838284 + ], + "unique_experts": 61, + "load_cv": 0.6171257830658811, + "normalized_load_entropy": 0.9549217839254414, + "max_load_share": 0.045722713864306784 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "40bed1fd8279ba3bb893a71aa3e5051b9c81ab4f3074abaffa2c30d5c2f9a95d", + "route_weight_sha256": "4919b20457f265bd556d23e753862e3c3dc1449923d279a1b12def026722cd1d", + "loads": [ + 10, + 14, + 30, + 8, + 22, + 5, + 19, + 2, + 9, + 28, + 10, + 8, + 25, + 11, + 21, + 11, + 15, + 1, + 7, + 21, + 10, + 17, + 15, + 14, + 20, + 12, + 5, + 13, + 5, + 16, + 18, + 11, + 0, + 23, + 31, + 10, + 7, + 13, + 12, + 13, + 7, + 8, + 20, + 9, + 13, + 9, + 7, + 14, + 5, + 12, + 12, + 7, + 14, + 34, + 6, + 17, + 7, + 22, + 16, + 12, + 7, + 11, + 12, + 5 + ], + "weighted_loads": [ + 0.3568987655453384, + 2.0061989054083824, + 2.60991592425853, + 1.6300215581431985, + 2.2965243104845285, + 0.17721997201442719, + 1.0414684731513262, + 0.09311724826693535, + 0.7577088922262192, + 1.9762968998402357, + 0.3874602187424898, + 0.4648941829800606, + 1.2876507081091404, + 0.36813528276979923, + 1.6820486895740032, + 0.49343057721853256, + 0.8200335167348385, + 0.049435749650001526, + 0.36162157356739044, + 1.547876002267003, + 0.6552116982638836, + 0.9119651280343533, + 0.970909932628274, + 0.529895469546318, + 1.564948839135468, + 1.5567897744476795, + 0.21131739020347595, + 0.7174890786409378, + 0.3043777346611023, + 2.1623988021165133, + 0.8555751405656338, + 1.1075014509260654, + 0.0, + 1.4107628781348467, + 5.297150671482086, + 0.9930124282836914, + 0.23688366846181452, + 0.5228319894522429, + 1.2425424605607986, + 1.021276205778122, + 0.18805248057469726, + 0.39800984039902687, + 1.0047979149967432, + 0.3741866145282984, + 0.7249695565551519, + 0.4745713286101818, + 0.246070496737957, + 1.2330043390393257, + 0.25368764996528625, + 0.939218282699585, + 0.42062179185450077, + 0.3045494370162487, + 0.9927002433687449, + 3.568766829557717, + 1.7409261129796505, + 1.0083001274615526, + 0.8125467803329229, + 1.386770335957408, + 1.957456536591053, + 0.5927569810301065, + 0.2237052097916603, + 0.6487600617110729, + 0.6469449456781149, + 0.5598758421838284 + ], + "unique_experts": 63, + "load_cv": 0.5524804623263203, + "normalized_load_entropy": 0.9630903219602841, + "max_load_share": 0.04106280193236715 + } + }, + "s1_eos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "927f70b91221f3cc910d40b4276b6c2b3df96100acca97e9cfc9bc0a97295fa9", + "route_weight_sha256": "2079fd2706290d6e0b7a5a9247dd53a15eec58ea75004dcd73a71d33554c885b", + "loads": [ + 7, + 12, + 25, + 8, + 18, + 5, + 8, + 2, + 9, + 22, + 7, + 8, + 18, + 9, + 16, + 12, + 13, + 1, + 8, + 17, + 10, + 17, + 9, + 5, + 10, + 12, + 6, + 13, + 5, + 11, + 9, + 11, + 0, + 23, + 31, + 9, + 5, + 6, + 11, + 12, + 5, + 4, + 13, + 8, + 12, + 9, + 8, + 9, + 4, + 12, + 12, + 6, + 15, + 31, + 0, + 14, + 6, + 22, + 10, + 11, + 8, + 7, + 6, + 6 + ], + "weighted_loads": [ + 0.26947541534900665, + 1.8712616711854935, + 2.465374430641532, + 1.635446305386722, + 1.6299328282475471, + 0.1978707779198885, + 0.5962949693202972, + 0.09675025939941406, + 0.737329788506031, + 1.620819192379713, + 0.3073740042746067, + 0.4586475268006325, + 0.7612324543297291, + 0.2971442211419344, + 1.1665263250470161, + 0.5238484814763069, + 0.7223804444074631, + 0.04895969107747078, + 0.3925925325602293, + 1.2606819132342935, + 0.6524989679455757, + 0.915845425799489, + 0.747686505317688, + 0.2125568427145481, + 0.9822222329676151, + 1.363034300506115, + 0.23927556350827217, + 0.6386361476033926, + 0.30037789419293404, + 1.9853381179273129, + 0.4895993862301111, + 1.124327477067709, + 0.0, + 1.4131857436150312, + 5.3433246202766895, + 0.9224291034042835, + 0.20933801122009754, + 0.23220232129096985, + 1.1947373449802399, + 0.9714804422110319, + 0.17453571036458015, + 0.234494149684906, + 0.44592653401196003, + 0.31234570778906345, + 0.6849721316248178, + 0.48401325568556786, + 0.2883766256272793, + 0.7665489800274372, + 0.25003189593553543, + 0.9569671414792538, + 0.42148598842322826, + 0.28395677730441093, + 1.0204546172171831, + 3.27105310279876, + 0.0, + 0.9113895762711763, + 0.7723457347601652, + 1.3862120788544416, + 1.6885140389204025, + 0.5613492578268051, + 0.2559147849678993, + 0.42857571318745613, + 0.13955537136644125, + 0.5711447596549988 + ], + "unique_experts": 62, + "load_cv": 0.6020518166693284, + "normalized_load_entropy": 0.9574930288408071, + "max_load_share": 0.045722713864306784 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "c1c04f44dd88e62a109386d871806e2a276f4af0fe9bf97f41ae19999e23e4af", + "route_weight_sha256": "4b29f6c13640377b67b4bdbc84902cf31a8b45c9e0851423734257506a132aff", + "loads": [ + 9, + 17, + 27, + 8, + 30, + 7, + 21, + 3, + 9, + 29, + 8, + 15, + 29, + 9, + 27, + 14, + 16, + 6, + 9, + 26, + 14, + 18, + 14, + 12, + 22, + 13, + 6, + 15, + 6, + 12, + 15, + 11, + 4, + 23, + 31, + 9, + 8, + 10, + 13, + 14, + 9, + 13, + 23, + 9, + 13, + 9, + 8, + 21, + 5, + 13, + 17, + 6, + 18, + 40, + 5, + 15, + 8, + 24, + 19, + 12, + 9, + 16, + 15, + 8 + ], + "weighted_loads": [ + 0.29494780488312244, + 2.166736427694559, + 2.5260854568332434, + 1.635446305386722, + 3.0600850488990545, + 0.29134236462414265, + 1.2053340654820204, + 0.12948039174079895, + 0.737329788506031, + 1.9453099519014359, + 0.3727846033871174, + 1.1955910474061966, + 1.4112348817288876, + 0.2971442211419344, + 2.0761082153767347, + 0.6339074820280075, + 1.1200006566941738, + 0.27362885139882565, + 0.4924247171729803, + 1.7344665573909879, + 0.9849449675530195, + 0.9703303184360266, + 0.9522542059421539, + 0.43697520438581705, + 1.8057703962549567, + 1.5801541581749916, + 0.23927556350827217, + 0.7685913685709238, + 0.33931904658675194, + 2.0213350281119347, + 0.7212095186114311, + 1.124327477067709, + 0.15090540051460266, + 1.4131857436150312, + 5.3433246202766895, + 0.9224291034042835, + 0.29330818774178624, + 0.40613256953656673, + 1.2785637713968754, + 1.074172193184495, + 0.27084537222981453, + 0.6456513591110706, + 1.194917468354106, + 0.3505513872951269, + 0.6956899575889111, + 0.48401325568556786, + 0.2883766256272793, + 1.605217780917883, + 0.28392692282795906, + 1.0017326325178146, + 0.7693994026631117, + 0.28395677730441093, + 1.164316836744547, + 4.0598314525559545, + 1.7157514616847038, + 0.9510252792388201, + 0.8534339908510447, + 1.4745814483612776, + 2.1356352269649506, + 0.5959288738667965, + 0.29501495137810707, + 0.8252838831394911, + 0.8514803489670157, + 0.7338588945567608 + ], + "unique_experts": 64, + "load_cv": 0.5353807611035646, + "normalized_load_entropy": 0.9676383271825074, + "max_load_share": 0.04329004329004329 + } + }, + "s0_bos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "5028b21ebe8af0bf2bd5bdf47b82c1b1974e6f5e6ef656a73b963533a8a29c13", + "route_weight_sha256": "4bbee080ec0c4128db3344b1256f4d5b43d246b919932216974346f4de4956a7", + "loads": [ + 8, + 14, + 26, + 8, + 17, + 5, + 8, + 2, + 9, + 25, + 9, + 10, + 18, + 11, + 17, + 11, + 13, + 0, + 9, + 17, + 10, + 16, + 10, + 5, + 12, + 12, + 3, + 14, + 5, + 11, + 10, + 10, + 0, + 21, + 31, + 9, + 5, + 6, + 11, + 13, + 5, + 4, + 10, + 10, + 11, + 9, + 9, + 8, + 3, + 12, + 11, + 6, + 14, + 29, + 0, + 16, + 6, + 22, + 10, + 10, + 6, + 7, + 5, + 4 + ], + "weighted_loads": [ + 0.3187960982322693, + 1.8876162506639957, + 2.5062478128820658, + 1.6411616802215576, + 1.558092139661312, + 0.1931743435561657, + 0.5877952668815851, + 0.09235148504376411, + 0.7568725384771824, + 1.8637050781399012, + 0.33941194601356983, + 0.5076282732188702, + 0.7553535476326942, + 0.34743313305079937, + 1.2331632860004902, + 0.4763843920081854, + 0.7288585361093283, + 0.0, + 0.4235390219837427, + 1.2805300755426288, + 0.6702690534293652, + 0.8940481673926115, + 0.8172839190810919, + 0.21505964547395706, + 1.0700604021549225, + 1.3981898725032806, + 0.13975152373313904, + 0.6743633504956961, + 0.29699672013521194, + 2.0055681951344013, + 0.519262045621872, + 1.1001567728817463, + 0.0, + 1.3922952339053154, + 5.023019025102258, + 0.9294132608920336, + 0.20396323315799236, + 0.23861942812800407, + 1.2168755121529102, + 0.9928435571491718, + 0.1792416926473379, + 0.22411702200770378, + 0.34312284644693136, + 0.40137165784835815, + 0.6964980103075504, + 0.4708847291767597, + 0.312665730714798, + 0.7155125439167023, + 0.16265388578176498, + 0.9473358616232872, + 0.39721731655299664, + 0.27258638478815556, + 1.023381743580103, + 3.2004345385357738, + 0.0, + 0.9651716612279415, + 0.8241120912134647, + 1.3987772706896067, + 1.6821440197527409, + 0.5555002763867378, + 0.20073573291301727, + 0.441423024982214, + 0.10014996025711298, + 0.5139469038695097 + ], + "unique_experts": 61, + "load_cv": 0.6098637251008181, + "normalized_load_entropy": 0.954656333947171, + "max_load_share": 0.045722713864306784 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "bbd373d34497de0cdc97286d8f71c849e9d8844d2826f6e2b9238ab5fc502c56", + "route_weight_sha256": "2e059d4b30a1c30e659081dcd39e370e827708ffda289341d6414c5b54a33ca3", + "loads": [ + 9, + 16, + 28, + 8, + 22, + 6, + 17, + 2, + 9, + 29, + 9, + 10, + 26, + 14, + 22, + 11, + 16, + 1, + 9, + 24, + 10, + 16, + 15, + 11, + 20, + 13, + 4, + 16, + 5, + 16, + 19, + 10, + 0, + 21, + 32, + 11, + 5, + 13, + 12, + 14, + 6, + 9, + 18, + 11, + 12, + 10, + 9, + 13, + 5, + 12, + 12, + 6, + 14, + 32, + 5, + 17, + 6, + 22, + 15, + 10, + 7, + 10, + 12, + 4 + ], + "weighted_loads": [ + 0.35785724595189095, + 2.0169546380639076, + 2.567643102258444, + 1.6411616802215576, + 2.178714783862233, + 0.20635730400681496, + 0.9622248113155365, + 0.09235148504376411, + 0.7568725384771824, + 2.130515879020095, + 0.33941194601356983, + 0.5076282732188702, + 1.3051688447594643, + 0.4692942854017019, + 1.7607171460986137, + 0.4763843920081854, + 0.8414345849305391, + 0.7229619026184082, + 0.4235390219837427, + 1.8875018497928977, + 0.6702690534293652, + 0.8940481673926115, + 0.9998707920312881, + 0.44562442507594824, + 1.7085254043340683, + 1.5981359630823135, + 0.17238032072782516, + 0.7949373591691256, + 0.29699672013521194, + 2.1997051909565926, + 0.8725262843072414, + 1.1001567728817463, + 0.0, + 1.3922952339053154, + 5.067962719127536, + 1.0069755483418703, + 0.20396323315799236, + 0.537811990827322, + 1.2584009617567062, + 1.040053766220808, + 0.18984840996563435, + 0.4399494603276253, + 0.9289662865921855, + 0.45794376358389854, + 0.7072158362716436, + 0.49751292541623116, + 0.312665730714798, + 1.1613657176494598, + 0.23800018802285194, + 0.9473358616232872, + 0.43156289868056774, + 0.27258638478815556, + 1.023381743580103, + 3.399605861864984, + 0.7971097491681576, + 1.0203285738825798, + 0.8241120912134647, + 1.3987772706896067, + 1.9102863818407059, + 0.5555002763867378, + 0.236362524330616, + 0.6286029666662216, + 0.6390653578564525, + 0.5139469038695097 + ], + "unique_experts": 63, + "load_cv": 0.5531559181755157, + "normalized_load_entropy": 0.9624316144219034, + "max_load_share": 0.03864734299516908 + } + }, + "s1_bos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "7a96d46473c1fbb20106e91a2518fd4e12c6a94272d4b761c84019c95926d1c0", + "route_weight_sha256": "ceb07320a00813519e382ed46c3951d6ca80ffa56ac19db3ede035b45d355970", + "loads": [ + 9, + 15, + 24, + 8, + 17, + 4, + 8, + 2, + 9, + 23, + 10, + 10, + 19, + 9, + 17, + 10, + 13, + 0, + 7, + 17, + 10, + 16, + 10, + 5, + 11, + 11, + 4, + 13, + 6, + 12, + 11, + 10, + 0, + 21, + 31, + 10, + 5, + 7, + 13, + 14, + 4, + 4, + 10, + 8, + 12, + 8, + 8, + 8, + 6, + 12, + 9, + 5, + 14, + 30, + 0, + 14, + 7, + 22, + 10, + 9, + 10, + 7, + 6, + 4 + ], + "weighted_loads": [ + 0.3442492224276066, + 1.8934589941054583, + 2.4445660933852196, + 1.6664171181619167, + 1.6709261126816273, + 0.16092360764741898, + 0.5718580782413483, + 0.10077336430549622, + 0.7583042420446873, + 1.6610250510275364, + 0.38951797783374786, + 0.506717698648572, + 0.7967012748122215, + 0.25213233940303326, + 1.2114418223500252, + 0.432056974619627, + 0.7517142165452242, + 0.0, + 0.3502930738031864, + 1.323485697619617, + 0.6666869111359119, + 0.9082818645983934, + 0.8079812191426754, + 0.21872908622026443, + 1.0746138747781515, + 1.3666994869709015, + 0.16488154791295528, + 0.6440456211566925, + 0.3281663004308939, + 2.0214263601228595, + 0.5529842171818018, + 1.1433435808867216, + 0.0, + 1.421079870313406, + 5.06304494664073, + 0.9721469506621361, + 0.21996807493269444, + 0.26642657816410065, + 1.2442802414298058, + 1.0119656156748533, + 0.14642711356282234, + 0.2331855669617653, + 0.35532858967781067, + 0.33109079860150814, + 0.7058572098612785, + 0.45082923024892807, + 0.29058258049190044, + 0.6994899734854698, + 0.24582338146865368, + 0.9639021120965481, + 0.34881905652582645, + 0.23556800186634064, + 1.0535466149449348, + 3.310008179396391, + 0.0, + 0.9053157567977905, + 0.8277571778744459, + 1.3959906660020351, + 1.6727300621569157, + 0.49910538271069527, + 0.3198731020092964, + 0.43766388669610023, + 0.12884882744401693, + 0.4940034653991461 + ], + "unique_experts": 61, + "load_cv": 0.5969425789511856, + "normalized_load_entropy": 0.9565997461763562, + "max_load_share": 0.045722713864306784 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "2ad5b4f60d3d157d5831cf1a3df8e9e1893065309114ce352383f3c44184e958", + "route_weight_sha256": "0bb1815adcae26efadf31c28c2c1398eba877567601e45e45dd3bfcf6bc33779", + "loads": [ + 10, + 20, + 26, + 8, + 29, + 6, + 19, + 2, + 9, + 32, + 11, + 17, + 30, + 11, + 28, + 12, + 16, + 5, + 8, + 27, + 14, + 17, + 15, + 10, + 22, + 12, + 4, + 15, + 7, + 13, + 19, + 10, + 3, + 21, + 32, + 11, + 7, + 11, + 15, + 17, + 8, + 13, + 20, + 10, + 13, + 8, + 8, + 19, + 7, + 13, + 14, + 5, + 17, + 39, + 4, + 15, + 9, + 24, + 19, + 10, + 12, + 15, + 15, + 6 + ], + "weighted_loads": [ + 0.36537012830376625, + 2.188690820708871, + 2.505277119576931, + 1.6664171181619167, + 3.218755530193448, + 0.2543951943516731, + 1.098241439089179, + 0.10077336430549622, + 0.7583042420446873, + 2.077943153679371, + 0.45492857694625854, + 1.243661219254136, + 1.4567604698240757, + 0.33176049776375294, + 2.118554448708892, + 0.5421159751713276, + 1.149334428831935, + 0.22466916032135487, + 0.4501252584159374, + 2.088713306002319, + 0.9991329107433558, + 0.962766757234931, + 1.0125489197671413, + 0.3970177536830306, + 1.9398794956505299, + 1.5634972751140594, + 0.16488154791295528, + 0.7562061473727226, + 0.3671074528247118, + 2.0574232703074813, + 0.8642314076423645, + 1.1433435808867216, + 0.11529303342103958, + 1.421079870313406, + 5.102341890335083, + 1.0241183154284954, + 0.3000212963670492, + 0.42485913448035717, + 1.3281066678464413, + 1.1542560663074255, + 0.25628671795129776, + 0.6587839536368847, + 1.087149653583765, + 0.39867046289145947, + 0.7165750358253717, + 0.45082923024892807, + 0.29058258049190044, + 1.5079785287380219, + 0.2797184083610773, + 1.008667603135109, + 0.6910167317837477, + 0.23556800186634064, + 1.1974088344722986, + 4.0612749718129635, + 0.7740064188838005, + 0.9568983726203442, + 0.9088454339653254, + 1.484360035508871, + 2.1198512502014637, + 0.5336849987506866, + 0.3894905000925064, + 0.8000632878392935, + 0.8407738050445914, + 0.6567176003009081 + ], + "unique_experts": 64, + "load_cv": 0.5438545901786016, + "normalized_load_entropy": 0.9658224664187045, + "max_load_share": 0.04220779220779221 + } + }, + "s0_x": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "b7dd4c4206731284d0cd046dfe994f551bde9fb46c9be9c96b416beb0afd8950", + "route_weight_sha256": "eb3d99e84a19d237700e64d620a78f3d607f242d324c3888625b9ed1c64b4c1e", + "loads": [ + 7, + 12, + 25, + 8, + 16, + 5, + 9, + 2, + 9, + 24, + 9, + 10, + 20, + 11, + 17, + 10, + 12, + 2, + 8, + 19, + 10, + 17, + 9, + 4, + 12, + 11, + 4, + 12, + 5, + 12, + 10, + 10, + 0, + 23, + 32, + 9, + 4, + 6, + 12, + 13, + 4, + 4, + 11, + 7, + 12, + 8, + 9, + 9, + 4, + 12, + 12, + 7, + 15, + 29, + 0, + 15, + 5, + 22, + 11, + 9, + 8, + 7, + 4, + 4 + ], + "weighted_loads": [ + 0.28912870958447456, + 1.8962054122239351, + 2.514251932501793, + 1.6665768660604954, + 1.5540700908750296, + 0.19228996895253658, + 0.6081408839672804, + 0.09438158944249153, + 0.7878668829798698, + 1.8157130405306816, + 0.34823686070740223, + 0.5246230494230986, + 0.8421416319906712, + 0.3369649164378643, + 1.2050801180303097, + 0.4602660797536373, + 0.6826826706528664, + 0.07637520134449005, + 0.39212206564843655, + 1.4009008780121803, + 0.6685492694377899, + 0.9258905909955502, + 0.7881952654570341, + 0.16623820550739765, + 1.0831643901765347, + 1.415806908160448, + 0.17912327498197556, + 0.5991197321563959, + 0.29476361349225044, + 2.059141393750906, + 0.5235103890299797, + 1.084151403978467, + 0.0, + 1.490297781303525, + 5.206909954547882, + 0.9365255981683731, + 0.17723479121923447, + 0.22441696375608444, + 1.229536347091198, + 0.9780356977134943, + 0.14603392966091633, + 0.1715375524945557, + 0.4155629314482212, + 0.2645172607153654, + 0.7459151539951563, + 0.4246148206293583, + 0.32176485657691956, + 0.8020286560058594, + 0.23106964118778706, + 0.9318634606897831, + 0.42240177281200886, + 0.3080711718648672, + 1.0538867972791195, + 3.1840569395571947, + 0.0, + 0.9365992043167353, + 0.7558172531425953, + 1.3863565158098936, + 1.7122331038117409, + 0.5334627460688353, + 0.27717035729438066, + 0.4541565254330635, + 0.06451687775552273, + 0.5228542797267437 + ], + "unique_experts": 62, + "load_cv": 0.6173513458953219, + "normalized_load_entropy": 0.9551174046055966, + "max_load_share": 0.0471976401179941 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "44d839b380b3fa49652bee87d7f1cb7ba31b28a51db59da8a8111d5d158ab3ea", + "route_weight_sha256": "fb01433eeee8c1c6788f29b3b8a330dc80c2333b8938a55be93bb23247bcb689", + "loads": [ + 8, + 14, + 26, + 8, + 22, + 7, + 19, + 2, + 9, + 28, + 9, + 10, + 31, + 12, + 23, + 10, + 15, + 3, + 8, + 25, + 10, + 17, + 15, + 11, + 18, + 12, + 4, + 14, + 5, + 17, + 17, + 10, + 0, + 23, + 33, + 10, + 4, + 12, + 13, + 15, + 6, + 8, + 20, + 9, + 13, + 8, + 9, + 15, + 5, + 12, + 13, + 7, + 15, + 31, + 5, + 16, + 5, + 22, + 17, + 9, + 8, + 10, + 12, + 4 + ], + "weighted_loads": [ + 0.3281898573040962, + 2.02862417511642, + 2.5388140361756086, + 1.6665768660604954, + 2.2786821145564318, + 0.2914001550525427, + 1.0367930456995964, + 0.09438158944249153, + 0.7878668829798698, + 2.0820035561919212, + 0.34823686070740223, + 0.5246230494230986, + 1.574868943542242, + 0.3762257844209671, + 1.7543629109859467, + 0.4602660797536373, + 0.7952587194740772, + 0.13011642172932625, + 0.39212206564843655, + 1.7246855273842812, + 0.6685492694377899, + 0.9258905909955502, + 1.0200361609458923, + 0.43226116243749857, + 1.5714344009757042, + 1.6388767249882221, + 0.17912327498197556, + 0.747556721791625, + 0.29476361349225044, + 2.2532783895730972, + 0.8026176393032074, + 1.084151403978467, + 0.0, + 1.490297781303525, + 5.236890407279134, + 0.9969286173582077, + 0.17723479121923447, + 0.45803337544202805, + 1.271061796694994, + 1.0578917916864157, + 0.20423043705523014, + 0.34204279677942395, + 1.142223671078682, + 0.3594758789986372, + 0.7566329799592495, + 0.4246148206293583, + 0.32176485657691956, + 1.3360796943306923, + 0.2684652116149664, + 0.9318634606897831, + 0.46413842774927616, + 0.3080711718648672, + 1.0538867972791195, + 3.357598038390279, + 0.7971097491681576, + 0.9767836090177298, + 0.7558172531425953, + 1.3863565158098936, + 1.9860195629298687, + 0.5334627460688353, + 0.27717035729438066, + 0.6413364671170712, + 0.6518899500370026, + 0.5228542797267437 + ], + "unique_experts": 63, + "load_cv": 0.5679770772479464, + "normalized_load_entropy": 0.9613836988516363, + "max_load_share": 0.03985507246376811 + } + }, + "s1_x": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "3764ab9f4ad59b3a1918af0d0943f331018afdf111cb40cd1fa26f481c222d49", + "route_weight_sha256": "192392c48a9773bdf6a8dc531d6f56a6342c351f49e99a0b890a5744d83bb060", + "loads": [ + 7, + 16, + 24, + 8, + 17, + 4, + 9, + 2, + 8, + 24, + 9, + 9, + 18, + 8, + 15, + 10, + 14, + 1, + 7, + 15, + 10, + 17, + 10, + 4, + 11, + 11, + 4, + 11, + 6, + 12, + 9, + 10, + 0, + 21, + 31, + 10, + 5, + 7, + 13, + 14, + 5, + 4, + 10, + 9, + 13, + 9, + 9, + 10, + 6, + 13, + 12, + 7, + 14, + 32, + 0, + 13, + 5, + 22, + 10, + 9, + 9, + 7, + 5, + 4 + ], + "weighted_loads": [ + 0.25890821404755116, + 2.0269719380885363, + 2.4587099961936474, + 1.6786419861018658, + 1.6355076432228088, + 0.1605616044253111, + 0.5868979338556528, + 0.09005249664187431, + 0.7275576330721378, + 1.6437216475605965, + 0.33504339307546616, + 0.46199133805930614, + 0.777869326993823, + 0.23208182863891125, + 1.024126349017024, + 0.429984737187624, + 0.7585986144840717, + 0.037703774869441986, + 0.33263866417109966, + 1.36799868196249, + 0.6658283732831478, + 0.9295125585049391, + 0.8247712478041649, + 0.16296738013625145, + 1.0723901074379683, + 1.4008748028427362, + 0.16140766069293022, + 0.5602782294154167, + 0.3193127475678921, + 2.0626273062080145, + 0.45760309882462025, + 1.0923293735831976, + 0.0, + 1.4179279953241348, + 5.245507786050439, + 0.9915257282555103, + 0.22212818264961243, + 0.26586671732366085, + 1.2026023659855127, + 1.015921575948596, + 0.1770207118242979, + 0.2315739467740059, + 0.3657497148960829, + 0.3610902577638626, + 0.7704561203718185, + 0.47243890166282654, + 0.32513242959976196, + 0.7785419896245003, + 0.26594890654087067, + 0.9908637180924416, + 0.44813728146255016, + 0.30362942814826965, + 1.0066840201616287, + 3.3030962692573667, + 0.0, + 0.8810612540692091, + 0.7252304293215275, + 1.3795313723385334, + 1.6801227107644081, + 0.4961522985249758, + 0.2822407325729728, + 0.4464670531451702, + 0.10419031232595444, + 0.49355051666498184 + ], + "unique_experts": 62, + "load_cv": 0.6045902444216343, + "normalized_load_entropy": 0.9569018038290072, + "max_load_share": 0.0471976401179941 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "94d40993bccc0b308ccdd4bc9ca01e23df5fd932f0e6f9779e28695b25a39774", + "route_weight_sha256": "8d91a7547d46d2ed1c0786948389d3d5375111ce4f4ac8f4c73b069cb7737903", + "loads": [ + 8, + 22, + 26, + 8, + 29, + 7, + 21, + 3, + 8, + 31, + 10, + 16, + 31, + 8, + 27, + 12, + 17, + 8, + 8, + 23, + 14, + 18, + 16, + 9, + 20, + 12, + 4, + 13, + 7, + 13, + 15, + 10, + 5, + 21, + 31, + 10, + 7, + 9, + 15, + 16, + 7, + 13, + 21, + 11, + 14, + 9, + 9, + 22, + 7, + 14, + 17, + 7, + 17, + 41, + 4, + 14, + 7, + 24, + 20, + 10, + 10, + 17, + 15, + 6 + ], + "weighted_loads": [ + 0.2800291199237108, + 2.377023031935096, + 2.519421022385359, + 1.6786419861018658, + 2.9479996021836996, + 0.2998222280293703, + 1.1455997973680496, + 0.13505959510803223, + 0.7275576330721378, + 1.9514380283653736, + 0.40045399218797684, + 1.1989348586648703, + 1.5562230180948973, + 0.23208182863891125, + 1.914421882480383, + 0.5400437377393246, + 1.1562188267707825, + 0.3369352202862501, + 0.43247084878385067, + 1.774754125624895, + 0.9982743728905916, + 0.9839974511414766, + 1.0648374781012535, + 0.3412560475990176, + 1.7493065632879734, + 1.6089240554720163, + 0.16140766069293022, + 0.7068115435540676, + 0.35825389996171, + 2.0986242163926363, + 0.6840809099376202, + 1.0923293735831976, + 0.21223727613687515, + 1.4179279953241348, + 5.245507786050439, + 0.9915257282555103, + 0.3021814040839672, + 0.33252850361168385, + 1.2864287924021482, + 1.118613326922059, + 0.23002936504781246, + 0.6400480270385742, + 1.2933926116675138, + 0.44626692309975624, + 0.7811739463359118, + 0.47243890166282654, + 0.32513242959976196, + 1.6457222998142242, + 0.2998439334332943, + 1.0356292091310024, + 0.806164575740695, + 0.30362942814826965, + 1.1505462396889925, + 4.021562946029007, + 0.7740064188838005, + 0.9155152160674334, + 0.8063186854124069, + 1.4679007418453693, + 2.1594146452844143, + 0.5307319145649672, + 0.3213408989831805, + 0.9005620423704386, + 0.9014196172356606, + 0.6562646515667439 + ], + "unique_experts": 64, + "load_cv": 0.5435788542637086, + "normalized_load_entropy": 0.9666604927869162, + "max_load_share": 0.044372294372294376 + } + }, + "s0_period": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "2dc03f9a557c743b4fececf1cfd3673bc88089da3528f9f8219afda8f0f3a312", + "route_weight_sha256": "16e8a0883ed1bfd959791433471e6885fbdab9d1848af9523eb967cef06f1c5a", + "loads": [ + 7, + 12, + 25, + 8, + 17, + 3, + 9, + 2, + 9, + 25, + 9, + 11, + 17, + 10, + 17, + 10, + 13, + 2, + 8, + 19, + 10, + 17, + 9, + 5, + 12, + 11, + 3, + 14, + 5, + 12, + 11, + 10, + 0, + 23, + 31, + 9, + 4, + 5, + 11, + 13, + 4, + 4, + 11, + 8, + 14, + 9, + 7, + 9, + 4, + 12, + 14, + 7, + 14, + 28, + 0, + 16, + 5, + 22, + 11, + 8, + 7, + 7, + 5, + 4 + ], + "weighted_loads": [ + 0.29169273748993874, + 1.9042025953531265, + 2.504460794851184, + 1.657316274009645, + 1.5766732413321733, + 0.1345772072672844, + 0.6012703906744719, + 0.09660208597779274, + 0.7858465425670147, + 1.8239827435463667, + 0.355176305398345, + 0.5439667701721191, + 0.7437206041067839, + 0.3238238636404276, + 1.2320066392421722, + 0.460302896797657, + 0.7282297946512699, + 0.07365670427680016, + 0.3863677754998207, + 1.3713484816253185, + 0.6692521274089813, + 0.9271202441304922, + 0.7799331862479448, + 0.2003794852644205, + 1.1077948343008757, + 1.4163623247295618, + 0.1566765308380127, + 0.6649217773228884, + 0.2780403681099415, + 2.021644866093993, + 0.5514188874512911, + 1.1001172419637442, + 0.0, + 1.473088437691331, + 5.195834511891007, + 0.9345131535083055, + 0.1757817268371582, + 0.1718104500323534, + 1.20121631026268, + 0.9868286941200495, + 0.14656027778983116, + 0.20031890273094177, + 0.39975283527746797, + 0.30278995260596275, + 0.7937821205705404, + 0.46592944487929344, + 0.2606586664915085, + 0.8162085488438606, + 0.24919073283672333, + 0.9384356737136841, + 0.4765563067048788, + 0.3054504171013832, + 1.0127838272601366, + 3.161115356720984, + 0.0, + 0.9879040811210871, + 0.7758386321365833, + 1.3889372292906046, + 1.6975071541965008, + 0.4784008003771305, + 0.24646390974521637, + 0.44986608624458313, + 0.09787644725292921, + 0.5211420189589262 + ], + "unique_experts": 62, + "load_cv": 0.6155445288897122, + "normalized_load_entropy": 0.9545913885968185, + "max_load_share": 0.045722713864306784 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "7dfb8f6188c5dac170a68ebb1aa33e0a93369f63627aec9926f3cb1cb9ee429c", + "route_weight_sha256": "e812815727172fc08c57fbf85497ac6aa9f9d2ab62f2dfa3fdc892a2ccbd64b0", + "loads": [ + 8, + 14, + 26, + 8, + 23, + 5, + 18, + 2, + 9, + 30, + 9, + 11, + 26, + 11, + 23, + 10, + 16, + 3, + 8, + 26, + 10, + 17, + 14, + 12, + 18, + 12, + 3, + 16, + 5, + 17, + 18, + 10, + 0, + 23, + 33, + 10, + 5, + 12, + 12, + 14, + 6, + 8, + 19, + 9, + 15, + 9, + 7, + 16, + 5, + 12, + 15, + 7, + 14, + 30, + 5, + 17, + 5, + 22, + 16, + 8, + 8, + 11, + 13, + 4 + ], + "weighted_loads": [ + 0.3307538852095604, + 2.050218217074871, + 2.5290228985249996, + 1.657316274009645, + 2.3465244825929403, + 0.2242325097322464, + 0.9756999351084232, + 0.09660208597779274, + 0.7858465425670147, + 2.11671693995595, + 0.355176305398345, + 0.5439667701721191, + 1.3471103180199862, + 0.3630847316235304, + 1.8107888922095299, + 0.460302896797657, + 0.8408058434724808, + 0.1328156515955925, + 0.3863677754998207, + 1.7458489686250687, + 0.6692521274089813, + 0.9271202441304922, + 0.9625200591981411, + 0.4601704003289342, + 1.5624501127749681, + 1.6355467084795237, + 0.1566765308380127, + 0.8130714204162359, + 0.2780403681099415, + 2.2157818619161844, + 0.8305621389299631, + 1.1001172419637442, + 0.0, + 1.473088437691331, + 5.293262157589197, + 0.9949161726981401, + 0.22866292297840118, + 0.43455307371914387, + 1.242741759866476, + 1.0340389031916857, + 0.20263323187828064, + 0.36959460750222206, + 0.9855962754227221, + 0.35936205834150314, + 0.8044999465346336, + 0.46592944487929344, + 0.2606586664915085, + 1.4141862578690052, + 0.28658630326390266, + 0.9384356737136841, + 0.5214025806635618, + 0.3054504171013832, + 1.0127838272601366, + 3.364960760809481, + 0.7971097491681576, + 1.0353457126766443, + 0.7758386321365833, + 1.3889372292906046, + 1.9256495162844658, + 0.4784008003771305, + 0.2721019499003887, + 0.7269915007054806, + 0.6716148452833295, + 0.5211420189589262 + ], + "unique_experts": 63, + "load_cv": 0.5646803675333986, + "normalized_load_entropy": 0.9612230120561487, + "max_load_share": 0.03985507246376811 + } + }, + "s1_period": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "15194d76946f481901350b0c26a94b9bf3ba5b387925c6b7cd52e080b81d7787", + "route_weight_sha256": "a19a4b10772a4811722380a480029572c97b7695042ce63fddb3dd61c6dafbec", + "loads": [ + 8, + 16, + 25, + 8, + 17, + 4, + 9, + 2, + 8, + 24, + 10, + 9, + 18, + 8, + 16, + 10, + 13, + 0, + 7, + 15, + 10, + 17, + 10, + 4, + 9, + 12, + 5, + 12, + 5, + 12, + 10, + 10, + 0, + 23, + 31, + 10, + 5, + 6, + 11, + 14, + 4, + 4, + 11, + 10, + 12, + 9, + 6, + 10, + 5, + 12, + 13, + 6, + 14, + 30, + 0, + 14, + 5, + 22, + 12, + 9, + 10, + 7, + 6, + 4 + ], + "weighted_loads": [ + 0.31331581622362137, + 1.9883734844624996, + 2.5045378878712654, + 1.7023599967360497, + 1.6082498971372843, + 0.1595546416938305, + 0.5774850696325302, + 0.09726916626095772, + 0.719108272343874, + 1.583032999187708, + 0.39534609392285347, + 0.4624408408999443, + 0.7800976354628801, + 0.23100712522864342, + 1.0550169833004475, + 0.4211024306714535, + 0.7453944589942694, + 0.0, + 0.32655126973986626, + 1.3395309513434768, + 0.6555457673966885, + 0.9355624411255121, + 0.820931663736701, + 0.1787915825843811, + 1.0024446807801723, + 1.4178784545511007, + 0.20326352305710316, + 0.5917744543403387, + 0.2748102769255638, + 2.029719417914748, + 0.48887857235968113, + 1.1067115515470505, + 0.0, + 1.457209262996912, + 5.262207269668579, + 0.9916725791990757, + 0.2186142187565565, + 0.21797754801809788, + 1.119133424013853, + 1.0133618619292974, + 0.1421719528734684, + 0.23416007682681084, + 0.40000013168901205, + 0.3911469206213951, + 0.6996536552906036, + 0.46459344401955605, + 0.2422019187361002, + 0.7457846216857433, + 0.23024677485227585, + 0.9500758200883865, + 0.4862552843987942, + 0.27303410321474075, + 1.0104535017162561, + 3.2930812491104007, + 0.0, + 0.9110853169113398, + 0.7367539219558239, + 1.359511736780405, + 1.748659247532487, + 0.48875254578888416, + 0.29467776976525784, + 0.43294884264469147, + 0.12586971186101437, + 0.5059938486665487 + ], + "unique_experts": 61, + "load_cv": 0.6103201352585569, + "normalized_load_entropy": 0.9548681407769455, + "max_load_share": 0.045722713864306784 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "514cdcca0f6f1874d7f2744aaa73db98319a8b8a5cfbd8fcd121132ebf16876c", + "route_weight_sha256": "baf452dd7457ba824fb4648ee7cb73d719593ecdb009fb004bc918c997230c47", + "loads": [ + 9, + 21, + 27, + 8, + 29, + 7, + 20, + 3, + 8, + 32, + 11, + 16, + 30, + 8, + 29, + 12, + 16, + 6, + 8, + 24, + 14, + 18, + 15, + 9, + 17, + 13, + 5, + 14, + 6, + 13, + 16, + 11, + 4, + 23, + 32, + 10, + 7, + 7, + 13, + 17, + 6, + 13, + 21, + 11, + 13, + 9, + 6, + 23, + 6, + 13, + 18, + 6, + 17, + 40, + 4, + 15, + 7, + 24, + 21, + 10, + 13, + 18, + 16, + 6 + ], + "weighted_loads": [ + 0.33443672209978104, + 2.30139883980155, + 2.565248914062977, + 1.7023599967360497, + 3.0332199186086655, + 0.29672127217054367, + 1.103868430480361, + 0.14615510776638985, + 0.719108272343874, + 1.908997394144535, + 0.46075669303536415, + 1.1993843615055084, + 1.474375730380416, + 0.23100712522864342, + 1.9866033177822828, + 0.5311614312231541, + 1.14301467128098, + 0.25845914892852306, + 0.42638345435261726, + 1.799520100466907, + 0.9879917670041323, + 0.9900473337620497, + 1.025499364361167, + 0.3570802500471473, + 1.6245824079960585, + 1.6251047905534506, + 0.20326352305710316, + 0.7273969668895006, + 0.3137514293193817, + 2.06571632809937, + 0.7168469578027725, + 1.139511700719595, + 0.1702577956020832, + 1.457209262996912, + 5.321351796388626, + 0.9916725791990757, + 0.2986674401909113, + 0.24731017090380192, + 1.2029598504304886, + 1.1626043189316988, + 0.19518060609698296, + 0.6604056991636753, + 1.1481159841641784, + 0.4293526001274586, + 0.7103714812546968, + 0.46459344401955605, + 0.2422019187361002, + 1.7007910050451756, + 0.2641418017446995, + 0.9948413111269474, + 0.8434240706264973, + 0.27303410321474075, + 1.15431572124362, + 4.078226561658084, + 0.7740064188838005, + 0.9472640138119459, + 0.8178421780467033, + 1.447881106287241, + 2.195780435577035, + 0.5233321618288755, + 0.41912047006189823, + 0.919222055003047, + 0.8801945764571428, + 0.6687079835683107 + ], + "unique_experts": 64, + "load_cv": 0.5584079992601069, + "normalized_load_entropy": 0.9643822793253232, + "max_load_share": 0.04329004329004329 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 113, + "ordered_topk_exact_tokens": 73, + "set_exact_tokens": 82, + "mean_set_jaccard": 0.9216182048040454, + "mean_token_weighted_tv": 0.0168901613534354, + "aggregate_load_tv": 0.030973451327433628 + }, + "system_bos": { + "tokens": 113, + "ordered_topk_exact_tokens": 66, + "set_exact_tokens": 77, + "mean_set_jaccard": 0.9051833122629582, + "mean_token_weighted_tv": 0.021073142598193567, + "aggregate_load_tv": 0.035398230088495575 + }, + "system_x": { + "tokens": 113, + "ordered_topk_exact_tokens": 51, + "set_exact_tokens": 66, + "mean_set_jaccard": 0.8645174884112937, + "mean_token_weighted_tv": 0.03143696344160862, + "aggregate_load_tv": 0.04129793510324484 + }, + "system_period": { + "tokens": 113, + "ordered_topk_exact_tokens": 47, + "set_exact_tokens": 67, + "mean_set_jaccard": 0.8685208596713022, + "mean_token_weighted_tv": 0.03213200748453032, + "aggregate_load_tv": 0.04129793510324484 + }, + "bos_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 69, + "set_exact_tokens": 77, + "mean_set_jaccard": 0.9051833122629583, + "mean_token_weighted_tv": 0.024029042097879986, + "aggregate_load_tv": 0.035398230088495575 + }, + "bos_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 60, + "set_exact_tokens": 73, + "mean_set_jaccard": 0.8912768647281922, + "mean_token_weighted_tv": 0.027475723943186807, + "aggregate_load_tv": 0.04424778761061947 + }, + "x_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 61, + "set_exact_tokens": 71, + "mean_set_jaccard": 0.8881163084702908, + "mean_token_weighted_tv": 0.027467815883342274, + "aggregate_load_tv": 0.03982300884955752 + }, + "x_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 45, + "set_exact_tokens": 68, + "mean_set_jaccard": 0.8710493046776234, + "mean_token_weighted_tv": 0.03415330282651481, + "aggregate_load_tv": 0.045722713864306784 + }, + "period_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 66, + "set_exact_tokens": 79, + "mean_set_jaccard": 0.9007585335018964, + "mean_token_weighted_tv": 0.026579907409170957, + "aggregate_load_tv": 0.03687315634218289 + }, + "period_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 54, + "set_exact_tokens": 69, + "mean_set_jaccard": 0.8792667509481669, + "mean_token_weighted_tv": 0.032477730930477906, + "aggregate_load_tv": 0.03982300884955752 + } + } + }, + "layer_20": { + "layer": 20, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "5eadb619baec7126a8cd36c81427af18bb272e7e26583c45439ea8b2e86446c5", + "route_weight_sha256": "3d283153e85d490557d454d9d8c39daf0762613b742469d8e41dbd81e801773f", + "loads": [ + 15, + 13, + 11, + 10, + 32, + 21, + 11, + 5, + 10, + 5, + 12, + 11, + 30, + 12, + 11, + 4, + 10, + 28, + 10, + 2, + 2, + 8, + 8, + 15, + 8, + 5, + 8, + 7, + 13, + 9, + 4, + 4, + 20, + 6, + 9, + 8, + 9, + 8, + 11, + 12, + 9, + 26, + 7, + 12, + 21, + 14, + 0, + 4, + 7, + 5, + 4, + 11, + 7, + 25, + 11, + 10, + 6, + 3, + 7, + 13, + 12, + 10, + 8, + 9 + ], + "weighted_loads": [ + 0.7055004313588142, + 0.5412053242325783, + 0.422545631416142, + 0.719927903264761, + 2.7294206582009792, + 1.4426519758999348, + 1.5465937033295631, + 0.18854781612753868, + 0.513981394469738, + 0.2939998544752598, + 1.6173675041645765, + 0.4869682043790817, + 3.2892583832144737, + 1.5416875518858433, + 0.44431701116263866, + 0.3372759744524956, + 0.4914180636405945, + 2.3870017156004906, + 0.6452367175370455, + 0.05582423694431782, + 0.08382381126284599, + 0.35678259283304214, + 0.5456716902554035, + 0.8107247445732355, + 0.5118765234947205, + 0.1766914427280426, + 0.2778488826006651, + 0.5210971459746361, + 1.4128946959972382, + 0.3358386680483818, + 0.15102005004882812, + 0.13522673957049847, + 1.9295446369796991, + 0.20148604176938534, + 0.2966352067887783, + 0.4823552295565605, + 0.8124279603362083, + 0.28068231232464314, + 0.37283565383404493, + 0.6867132484912872, + 0.38117679953575134, + 2.3381775580346584, + 0.3873176071792841, + 2.557582700625062, + 1.1586997527629137, + 1.020014975219965, + 0.0, + 0.16939402744174004, + 0.24335357546806335, + 0.25762518867850304, + 0.19637966714799404, + 0.5542238336056471, + 0.20330373058095574, + 1.8580085150897503, + 0.4967803359031677, + 0.5325324721634388, + 0.25215655378997326, + 0.10195626877248287, + 0.2843846771866083, + 0.5767805222421885, + 0.878187594935298, + 0.4198617022484541, + 0.4733489193022251, + 0.45247200690209866 + ], + "unique_experts": 63, + "load_cv": 0.623857192590845, + "normalized_load_entropy": 0.9574523039204643, + "max_load_share": 0.0471976401179941 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "de35d4c386410b39c4744760aa1d5e14d72020157eae940fd5dfca078c502630", + "route_weight_sha256": "9faea989f645eaffcc652b693db513583d6e53407135dfb65b9daa99ba4925f4", + "loads": [ + 15, + 15, + 11, + 18, + 40, + 25, + 16, + 11, + 10, + 5, + 13, + 12, + 32, + 12, + 11, + 11, + 11, + 29, + 20, + 2, + 6, + 8, + 15, + 15, + 8, + 11, + 9, + 7, + 13, + 11, + 4, + 4, + 20, + 8, + 11, + 8, + 11, + 11, + 13, + 13, + 10, + 28, + 10, + 16, + 31, + 14, + 0, + 4, + 9, + 6, + 12, + 11, + 7, + 31, + 11, + 13, + 6, + 9, + 7, + 13, + 24, + 14, + 8, + 9 + ], + "weighted_loads": [ + 0.7055004313588142, + 0.5857710856944323, + 0.422545631416142, + 1.3128067143261433, + 3.12667378783226, + 1.6049326285719872, + 1.6989280264824629, + 0.5367433000355959, + 0.513981394469738, + 0.2939998544752598, + 1.650794232264161, + 0.5372664220631123, + 3.3473490476608276, + 1.5416875518858433, + 0.44431701116263866, + 0.6122275795787573, + 0.5292717777192593, + 2.4531059488654137, + 1.529521582648158, + 0.05582423694431782, + 0.18676726520061493, + 0.35678259283304214, + 0.9952310584485531, + 0.8107247445732355, + 0.5118765234947205, + 0.6508703455328941, + 0.2952951844781637, + 0.5210971459746361, + 1.4128946959972382, + 0.4009233880788088, + 0.15102005004882812, + 0.13522673957049847, + 1.9295446369796991, + 0.30232877656817436, + 0.37774036452174187, + 0.4823552295565605, + 0.8591913487762213, + 0.3654209319502115, + 1.6918123541399837, + 0.7494647577404976, + 0.4353986009955406, + 2.4137132614851, + 0.5631126891821623, + 2.69710512063466, + 1.5135221928358078, + 1.020014975219965, + 0.0, + 0.16939402744174004, + 0.2806444234447554, + 0.29721320047974586, + 1.2439865712076426, + 0.5542238336056471, + 0.20330373058095574, + 2.1610748283565044, + 0.4967803359031677, + 0.9584621042013168, + 0.25215655378997326, + 0.2985660172998905, + 0.2843846771866083, + 0.5767805222421885, + 2.1540161771699786, + 0.6669093575328588, + 0.4733489193022251, + 0.45247200690209866 + ], + "unique_experts": 63, + "load_cv": 0.5925904046728496, + "normalized_load_entropy": 0.9614302301743418, + "max_load_share": 0.04830917874396135 + } + }, + "s1_eos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "0744268b046ecc2280a5876ce0b9d396b66eca8a2c24b825a7ffac171a216a5f", + "route_weight_sha256": "d923a52e334f70a2d275d1668cfab432dd08f18edffb64ece6693746d16719ba", + "loads": [ + 14, + 13, + 9, + 9, + 31, + 19, + 11, + 5, + 12, + 5, + 15, + 11, + 27, + 12, + 11, + 5, + 8, + 29, + 10, + 2, + 3, + 8, + 7, + 14, + 8, + 6, + 7, + 7, + 13, + 10, + 5, + 4, + 20, + 6, + 11, + 8, + 10, + 8, + 10, + 13, + 7, + 27, + 7, + 12, + 22, + 13, + 0, + 4, + 7, + 5, + 4, + 10, + 9, + 27, + 10, + 11, + 6, + 3, + 7, + 13, + 13, + 8, + 8, + 9 + ], + "weighted_loads": [ + 0.6770756542682648, + 0.5529663022607565, + 0.37147846911102533, + 0.6695705242455006, + 2.6551406905055046, + 1.2959845941513777, + 1.5681606270372868, + 0.1948479227721691, + 0.5570603436790407, + 0.298640888184309, + 1.7014707550406456, + 0.4540370684117079, + 3.190020339563489, + 1.52161156386137, + 0.4538954757153988, + 0.34947565756738186, + 0.44523803889751434, + 2.4111076686531305, + 0.625241132453084, + 0.05553903803229332, + 0.12034332752227783, + 0.35536210611462593, + 0.4999306835234165, + 0.7698232568800449, + 0.5020368956029415, + 0.21869791485369205, + 0.2449604645371437, + 0.5231936294585466, + 1.400757934898138, + 0.35277690179646015, + 0.19075125083327293, + 0.1317017488181591, + 1.9166476298123598, + 0.1895820964127779, + 0.35973528772592545, + 0.4761266801506281, + 0.8343803137540817, + 0.28216785565018654, + 0.33900238992646337, + 0.7127127647399902, + 0.3072606585919857, + 2.365367190912366, + 0.3736403379589319, + 2.5876336451619864, + 1.2166099976748228, + 1.001819383352995, + 0.0, + 0.16968198120594025, + 0.2484726868569851, + 0.2523826640099287, + 0.19307827576994896, + 0.5520389694720507, + 0.2859871028922498, + 1.8809947818517685, + 0.4648112580180168, + 0.5572574138641357, + 0.2589977104216814, + 0.10138902254402637, + 0.2795012854039669, + 0.5691101811826229, + 0.9261681018397212, + 0.368030171841383, + 0.47727954760193825, + 0.41789630241692066 + ], + "unique_experts": 63, + "load_cv": 0.6173513458953219, + "normalized_load_entropy": 0.9585963978500672, + "max_load_share": 0.045722713864306784 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "68885c0d4fc8f64617313bb37ff2441e2b94c0ea643575cca56a2720f4a77401", + "route_weight_sha256": "e6d68e3758064bd1cbd9764db0bf14357574e4e31d41902f9253052d3892a936", + "loads": [ + 19, + 15, + 9, + 20, + 39, + 24, + 13, + 11, + 12, + 7, + 18, + 11, + 29, + 13, + 12, + 18, + 13, + 30, + 20, + 3, + 7, + 9, + 18, + 16, + 9, + 19, + 8, + 9, + 13, + 15, + 5, + 5, + 21, + 7, + 14, + 10, + 13, + 16, + 13, + 18, + 11, + 28, + 10, + 19, + 35, + 14, + 0, + 4, + 8, + 10, + 16, + 10, + 9, + 36, + 11, + 23, + 9, + 11, + 9, + 16, + 26, + 10, + 9, + 9 + ], + "weighted_loads": [ + 0.9085485134273767, + 0.5971554424613714, + 0.37147846911102533, + 1.4267020672559738, + 3.07626299187541, + 1.502362372353673, + 1.6367278695106506, + 0.6460687909275293, + 0.5570603436790407, + 0.5311088748276234, + 1.8239198997616768, + 0.4540370684117079, + 3.256786933168769, + 1.805360846221447, + 0.5137853659689426, + 1.0807813480496407, + 0.7456087097525597, + 2.4842002037912607, + 1.6001353729516268, + 0.08805892243981361, + 0.23358436091803014, + 0.3912128582596779, + 1.2124410010874271, + 0.9428183026611805, + 0.5224734470248222, + 1.08548722602427, + 0.26240676641464233, + 0.604035934433341, + 1.400757934898138, + 0.5129637494683266, + 0.19075125083327293, + 0.1624217052012682, + 1.9666462261229753, + 0.2522993180900812, + 0.49803796224296093, + 0.6533338073641062, + 0.937511220574379, + 0.5672698467969894, + 1.697354041505605, + 0.9583895020186901, + 0.48742977902293205, + 2.4198749121278524, + 0.5543482955545187, + 2.873009300092235, + 2.041096992790699, + 1.0745061822235584, + 0.0, + 0.16968198120594025, + 0.25020938692614436, + 0.5602735225111246, + 1.7595369517803192, + 0.5520389694720507, + 0.2859871028922498, + 2.2757311649620533, + 0.49673646315932274, + 1.6484239287674427, + 0.3757337983697653, + 0.6714240536093712, + 0.3509545661509037, + 0.6494905296713114, + 2.338051243685186, + 0.5151486210525036, + 0.5373066700994968, + 0.41789630241692066 + ], + "unique_experts": 63, + "load_cv": 0.546192725264341, + "normalized_load_entropy": 0.9657703205992612, + "max_load_share": 0.04220779220779221 + } + }, + "s0_bos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "2f51c87fed8507695344e4b19e2c3c9acb0c3c409b4fa80af0b45f7b8650cbe8", + "route_weight_sha256": "7ec24e840919d8c788a080f942350a1adaacd627948f8166208057756dd5e553", + "loads": [ + 15, + 14, + 8, + 10, + 34, + 19, + 11, + 6, + 8, + 5, + 15, + 9, + 30, + 12, + 10, + 4, + 8, + 29, + 11, + 1, + 3, + 7, + 8, + 16, + 9, + 6, + 6, + 7, + 14, + 12, + 6, + 4, + 17, + 5, + 9, + 8, + 10, + 7, + 8, + 12, + 6, + 25, + 6, + 12, + 19, + 15, + 0, + 5, + 8, + 5, + 4, + 12, + 7, + 28, + 12, + 10, + 6, + 3, + 8, + 12, + 12, + 11, + 7, + 12 + ], + "weighted_loads": [ + 0.7152804527431726, + 0.5589262451976538, + 0.3474535644054413, + 0.7207947783172131, + 2.892183570191264, + 1.1567206680774689, + 1.5629153586924076, + 0.22314751520752907, + 0.4694678131490946, + 0.3030474800616503, + 1.6729147639125586, + 0.4070074427872896, + 3.2734591364860535, + 1.5080807209014893, + 0.4380401112139225, + 0.3335467278957367, + 0.45449623838067055, + 2.441060170531273, + 0.6893465649336576, + 0.036687400192022324, + 0.12402983754873276, + 0.33323824405670166, + 0.5370253659784794, + 0.8592742420732975, + 0.547044426202774, + 0.19784537889063358, + 0.2195751741528511, + 0.5326546467840672, + 1.437293142080307, + 0.4239931870251894, + 0.22955762967467308, + 0.13529561832547188, + 1.8046920150518417, + 0.16792254708707333, + 0.31090428680181503, + 0.4929381310939789, + 0.8494970481842756, + 0.24690407887101173, + 0.2861459730193019, + 0.691660588607192, + 0.26874126493930817, + 2.3286472465842962, + 0.35645192489027977, + 2.530594954267144, + 1.0266258902847767, + 1.0508533418178558, + 0.0, + 0.20175953023135662, + 0.26712217926979065, + 0.2549427505582571, + 0.18422409519553185, + 0.5552366259507835, + 0.20561117585748434, + 2.033874113112688, + 0.5499410349875689, + 0.5377946887165308, + 0.24037770554423332, + 0.10485407151281834, + 0.32495576702058315, + 0.5473509449511766, + 0.8569371337071061, + 0.44564513489603996, + 0.4454679302871227, + 0.5642310678958893 + ], + "unique_experts": 63, + "load_cv": 0.6392882350970672, + "normalized_load_entropy": 0.9560032107057901, + "max_load_share": 0.05014749262536873 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "9687833c2c5e0c6a8f3e2bead48a5923602b7dc62dd9da8efb2b2124af74fe52", + "route_weight_sha256": "14bed3c8169c4a568f2d11390c7c7b28aec24a90072b89339e58eef8c1798e4f", + "loads": [ + 15, + 15, + 8, + 18, + 42, + 23, + 16, + 12, + 8, + 5, + 16, + 10, + 33, + 12, + 10, + 10, + 9, + 30, + 21, + 1, + 6, + 7, + 16, + 16, + 9, + 13, + 9, + 7, + 14, + 14, + 7, + 5, + 17, + 7, + 10, + 8, + 12, + 10, + 9, + 13, + 7, + 27, + 9, + 16, + 30, + 15, + 1, + 6, + 9, + 5, + 12, + 12, + 7, + 34, + 12, + 13, + 6, + 8, + 8, + 12, + 23, + 14, + 7, + 12 + ], + "weighted_loads": [ + 0.7152804527431726, + 0.583053220063448, + 0.3474535644054413, + 1.3136735893785954, + 3.289436699822545, + 1.3195645567029715, + 1.7152496818453074, + 0.5545982103794813, + 0.4694678131490946, + 0.3030474800616503, + 1.706397632136941, + 1.0831165183335543, + 3.375106520950794, + 1.5080807209014893, + 0.4380401112139225, + 0.6374536231160164, + 0.4923499524593353, + 2.5039630830287933, + 1.5736314300447702, + 0.036687400192022324, + 0.22384017705917358, + 0.33323824405670166, + 1.0648916140198708, + 0.8592742420732975, + 0.547044426202774, + 0.6863502915948629, + 0.3227218668907881, + 0.5326546467840672, + 1.437293142080307, + 0.4890779070556164, + 0.2679041400551796, + 0.14890731032937765, + 1.8046920150518417, + 0.2598247416317463, + 0.35280682891607285, + 0.4929381310939789, + 0.8962604366242886, + 0.3316426984965801, + 0.6506644962355494, + 0.7349238190799952, + 0.31431031599640846, + 2.3811585577204823, + 0.527331380173564, + 2.750361366197467, + 1.40149194188416, + 1.0508533418178558, + 0.13811376690864563, + 0.21541334595531225, + 0.3027818165719509, + 0.2549427505582571, + 1.2783753648400307, + 0.5552366259507835, + 0.20561117585748434, + 2.360844559967518, + 0.5499410349875689, + 0.9754243325442076, + 0.24037770554423332, + 0.264388844370842, + 0.32495576702058315, + 0.5473509449511766, + 2.1313769770786166, + 0.6640994176268578, + 0.4454679302871227, + 0.5642310678958893 + ], + "unique_experts": 64, + "load_cv": 0.6090597791334602, + "normalized_load_entropy": 0.9605966523726593, + "max_load_share": 0.050724637681159424 + } + }, + "s1_bos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "1e47479ee85915d67c7278822e47fb659fa8db5edaa4b04adb8edd8af038e136", + "route_weight_sha256": "8d8906d7f3791ced78a50a4bd6079ee8b217d2be0342f1d926fb4638346d026b", + "loads": [ + 15, + 14, + 7, + 10, + 35, + 19, + 11, + 6, + 10, + 6, + 12, + 7, + 31, + 13, + 10, + 5, + 9, + 29, + 10, + 1, + 2, + 7, + 7, + 15, + 9, + 6, + 7, + 7, + 13, + 10, + 5, + 6, + 17, + 5, + 10, + 8, + 10, + 6, + 11, + 12, + 6, + 28, + 7, + 12, + 21, + 14, + 0, + 3, + 7, + 7, + 4, + 11, + 8, + 28, + 10, + 10, + 7, + 3, + 7, + 13, + 12, + 9, + 7, + 11 + ], + "weighted_loads": [ + 0.6891882810741663, + 0.5586270708590746, + 0.3220329796895385, + 0.7128060720860958, + 2.9392052926123142, + 1.1751119382679462, + 1.5954316183924675, + 0.22804053500294685, + 0.4788227314129472, + 0.3261699713766575, + 1.5434569735080004, + 0.33030401170253754, + 3.4388560224324465, + 1.5342317447066307, + 0.430431941524148, + 0.3544367738068104, + 0.47468830086290836, + 2.501428533345461, + 0.6288476847112179, + 0.03680837154388428, + 0.09282806888222694, + 0.3307183086872101, + 0.47941984236240387, + 0.8209651671350002, + 0.54695232398808, + 0.21022072434425354, + 0.2442810870707035, + 0.5372315123677254, + 1.4222039133310318, + 0.35750153101980686, + 0.20020882785320282, + 0.21185040846467018, + 1.754038518294692, + 0.17143219895660877, + 0.34409045800566673, + 0.49626465514302254, + 0.8535697441548109, + 0.23034586384892464, + 0.3640902601182461, + 0.6842045783996582, + 0.28094709664583206, + 2.3862347919493914, + 0.3862630445510149, + 2.570688819512725, + 1.092961834743619, + 1.035691635683179, + 0.0, + 0.1338503733277321, + 0.24217347986996174, + 0.3107139226049185, + 0.18821300566196442, + 0.5470416806638241, + 0.23750356771051884, + 1.8038901686668396, + 0.4887441098690033, + 0.5437148921191692, + 0.27015718445181847, + 0.10769130848348141, + 0.29966842755675316, + 0.5816137827932835, + 0.8429988427087665, + 0.4135462027043104, + 0.43398623168468475, + 0.6224540304392576 + ], + "unique_experts": 63, + "load_cv": 0.6571156491233984, + "normalized_load_entropy": 0.9544866715656688, + "max_load_share": 0.051622418879056046 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "f4a90a2aac21aea3eb8f40edeb0eadee8de22369a2b55605afb613678bc35e76", + "route_weight_sha256": "39d9707985fc8b7033027279351b0656680bd2542b881c6b4408603ebaabd83a", + "loads": [ + 19, + 16, + 7, + 21, + 43, + 25, + 13, + 14, + 10, + 8, + 15, + 7, + 33, + 14, + 11, + 19, + 14, + 30, + 20, + 2, + 7, + 8, + 19, + 17, + 10, + 19, + 9, + 8, + 13, + 14, + 5, + 7, + 18, + 6, + 12, + 10, + 13, + 13, + 13, + 17, + 10, + 30, + 10, + 19, + 34, + 15, + 0, + 4, + 7, + 12, + 17, + 11, + 8, + 38, + 11, + 21, + 8, + 11, + 8, + 16, + 24, + 12, + 8, + 11 + ], + "weighted_loads": [ + 0.8836881369352341, + 0.6084013171494007, + 0.3220329796895385, + 1.469937615096569, + 3.3603275939822197, + 1.445016510784626, + 1.6639988608658314, + 0.7488783877342939, + 0.4788227314129472, + 0.5586379580199718, + 1.6677796561270952, + 0.33030401170253754, + 3.5056226160377264, + 1.8179810270667076, + 0.49032183177769184, + 1.1677270159125328, + 0.7750589717179537, + 2.5715244822204113, + 1.6037419252097607, + 0.06932825595140457, + 0.2836488541215658, + 0.36656906083226204, + 1.2457264438271523, + 0.9939602129161358, + 0.5673888754099607, + 1.0508278273046017, + 0.309224471449852, + 0.574085608124733, + 1.4222039133310318, + 0.4701268598437309, + 0.20020882785320282, + 0.24257036484777927, + 1.8040371146053076, + 0.2339706141501665, + 0.4216711353510618, + 0.6734717823565006, + 0.9567006509751081, + 0.48880498483777046, + 0.7715975046157837, + 0.9304477274417877, + 0.4574459604918957, + 2.4758906196802855, + 0.5731189455837011, + 2.932517511770129, + 1.9206584766507149, + 1.1083784345537424, + 0.0, + 0.17170444503426552, + 0.24217347986996174, + 0.6429246235638857, + 1.8908124044537544, + 0.5470416806638241, + 0.23750356771051884, + 2.266347724944353, + 0.5206693150103092, + 1.6540851518511772, + 0.31567031517624855, + 0.6765540950000286, + 0.3356621600687504, + 0.6619941312819719, + 2.253015742637217, + 0.5936334114521742, + 0.49401335418224335, + 0.6224540304392576 + ], + "unique_experts": 63, + "load_cv": 0.5781935902570361, + "normalized_load_entropy": 0.9624842004261805, + "max_load_share": 0.046536796536796536 + } + }, + "s0_x": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "77272744960714b3d6900dfbede77d61eddc974248c902d8f308e32b9b7f8e69", + "route_weight_sha256": "a27d65831268f9e8bd8e67b239a0ab78144176c7721ff772b250e1f73a7f04f1", + "loads": [ + 12, + 13, + 8, + 9, + 36, + 21, + 11, + 5, + 11, + 4, + 14, + 10, + 27, + 13, + 10, + 5, + 8, + 27, + 10, + 1, + 3, + 7, + 7, + 14, + 9, + 7, + 7, + 7, + 14, + 9, + 5, + 4, + 20, + 6, + 9, + 8, + 9, + 7, + 9, + 11, + 8, + 27, + 6, + 11, + 19, + 15, + 0, + 5, + 8, + 6, + 5, + 10, + 8, + 26, + 11, + 12, + 6, + 5, + 8, + 13, + 12, + 10, + 8, + 12 + ], + "weighted_loads": [ + 0.6116918846964836, + 0.5338407903909683, + 0.3571406891569495, + 0.6631963588297367, + 2.891660165041685, + 1.3805909119546413, + 1.5375759415328503, + 0.18878763914108276, + 0.5283276359550655, + 0.2766998242586851, + 1.663412667810917, + 0.4207393638789654, + 3.316025462001562, + 1.5145889427512884, + 0.4422068763524294, + 0.3698909841477871, + 0.46739503741264343, + 2.412243992090225, + 0.6392217297106981, + 0.029461951926350594, + 0.12312322482466698, + 0.33537886291742325, + 0.5032723359763622, + 0.8004814460873604, + 0.5458150915801525, + 0.23871437087655067, + 0.2516409959644079, + 0.5342957675457001, + 1.4546994753181934, + 0.34965156577527523, + 0.19203126803040504, + 0.1531263031065464, + 1.9087414015084505, + 0.2048964500427246, + 0.2996447719633579, + 0.486879575997591, + 0.7993651144206524, + 0.25770118832588196, + 0.3001720807515085, + 0.65721720084548, + 0.33686302974820137, + 2.4002047441899776, + 0.35994474589824677, + 2.5826536267995834, + 1.081101244315505, + 1.0521283894777298, + 0.0, + 0.20596311055123806, + 0.2619721069931984, + 0.29954707995057106, + 0.2326780054718256, + 0.5474663861095905, + 0.2383298692293465, + 1.9330900833010674, + 0.5130299739539623, + 0.585194343701005, + 0.24070726707577705, + 0.16589348763227463, + 0.3201564271003008, + 0.5895409490913153, + 0.869496806524694, + 0.41860780492424965, + 0.4867228679358959, + 0.5663232319056988 + ], + "unique_experts": 63, + "load_cv": 0.6251947773869049, + "normalized_load_entropy": 0.9584596842265484, + "max_load_share": 0.05309734513274336 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "823dcb1f644fec5ac5973b226d89269bf943a23bab9b80407ac7d9dda1a92238", + "route_weight_sha256": "2af60edde193c423cdf98aa3e003f7541ae189a85931fd60e4b89b2b7c31cd92", + "loads": [ + 12, + 15, + 8, + 17, + 45, + 24, + 17, + 11, + 12, + 4, + 15, + 10, + 29, + 14, + 10, + 11, + 9, + 28, + 21, + 1, + 6, + 7, + 14, + 14, + 9, + 14, + 8, + 7, + 14, + 13, + 5, + 4, + 20, + 8, + 10, + 8, + 12, + 10, + 10, + 12, + 9, + 29, + 8, + 14, + 30, + 15, + 0, + 5, + 9, + 7, + 13, + 10, + 8, + 31, + 11, + 16, + 6, + 11, + 8, + 13, + 24, + 13, + 8, + 12 + ], + "weighted_loads": [ + 0.6116918846964836, + 0.5948664043098688, + 0.3571406891569495, + 1.256075169891119, + 3.412589877843857, + 1.4910872541368008, + 1.728589380159974, + 0.5036047473549843, + 0.5527191790752113, + 0.2766998242586851, + 1.6922340225428343, + 0.4207393638789654, + 3.374116126447916, + 1.5420579928904772, + 0.4422068763524294, + 0.6413872689008713, + 0.5052487514913082, + 2.4827102050185204, + 1.6241826619952917, + 0.029461951926350594, + 0.2229335643351078, + 0.33537886291742325, + 0.9442271292209625, + 0.8004814460873604, + 0.5458150915801525, + 0.7297106757760048, + 0.26908729784190655, + 0.5342957675457001, + 1.4546994753181934, + 0.4809028431773186, + 0.19203126803040504, + 0.1531263031065464, + 1.9087414015084505, + 0.3312069680541754, + 0.33652057126164436, + 0.486879575997591, + 0.8788120839744806, + 0.34243980795145035, + 0.664690603967756, + 0.7198746763169765, + 0.3688995838165283, + 2.4692037738859653, + 0.5061586275696754, + 2.7311806175857782, + 1.474477306008339, + 1.0521283894777298, + 0.0, + 0.20596311055123806, + 0.29763174429535866, + 0.337971493601799, + 1.2989868689328432, + 0.5474663861095905, + 0.2383298692293465, + 2.2123251147568226, + 0.5130299739539623, + 1.0398652981966734, + 0.24070726707577705, + 0.37276546470820904, + 0.3201564271003008, + 0.5895409490913153, + 2.3250119844451547, + 0.610356729477644, + 0.4867228679358959, + 0.5663232319056988 + ], + "unique_experts": 63, + "load_cv": 0.6061406387107756, + "normalized_load_entropy": 0.960185032429216, + "max_load_share": 0.05434782608695652 + } + }, + "s1_x": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "54ffe5727358f133f9519c7811b5234e5c619c779ef01c766ca1b640220636d0", + "route_weight_sha256": "4dc31f47459ee6bb873c1bdf805e4680ca89d730a42bdacdec904ba250a4e099", + "loads": [ + 13, + 14, + 7, + 10, + 39, + 29, + 11, + 7, + 11, + 6, + 13, + 7, + 28, + 13, + 8, + 5, + 10, + 31, + 11, + 1, + 2, + 8, + 6, + 14, + 8, + 7, + 5, + 7, + 13, + 9, + 5, + 6, + 17, + 5, + 9, + 8, + 10, + 7, + 10, + 11, + 3, + 27, + 6, + 12, + 21, + 14, + 0, + 5, + 7, + 7, + 5, + 10, + 6, + 25, + 10, + 9, + 6, + 5, + 5, + 13, + 13, + 9, + 8, + 11 + ], + "weighted_loads": [ + 0.6115936990827322, + 0.5679449122399092, + 0.2750238059088588, + 0.66702975705266, + 3.0642894878983498, + 1.8443847857415676, + 1.5801628269255161, + 0.25855477154254913, + 0.5380744026042521, + 0.33729702793061733, + 1.5930292587727308, + 0.33742234483361244, + 3.283916736021638, + 1.535808015614748, + 0.3647054061293602, + 0.35888809338212013, + 0.5530382096767426, + 2.582270096987486, + 0.6601564735174179, + 0.03295508027076721, + 0.08497709035873413, + 0.363790612667799, + 0.3769501503556967, + 0.7757518030703068, + 0.5008905194699764, + 0.24414629861712456, + 0.17924180999398232, + 0.5177941508591175, + 1.4280656091868877, + 0.3276703618466854, + 0.1863038819283247, + 0.22363187745213509, + 1.742045046761632, + 0.18897168524563313, + 0.3088805805891752, + 0.4893938675522804, + 0.84157426469028, + 0.2640537638217211, + 0.3479000460356474, + 0.6505600456148386, + 0.1691066212952137, + 2.383353315293789, + 0.3645809255540371, + 2.6087922379374504, + 1.1107718776911497, + 1.0277775060385466, + 0.0, + 0.20795896276831627, + 0.23821092955768108, + 0.2999904304742813, + 0.17692861706018448, + 0.5113208796828985, + 0.16839660797268152, + 1.6784184481948614, + 0.4645282384008169, + 0.4848477765917778, + 0.2343048993498087, + 0.18348263576626778, + 0.22900628298521042, + 0.5898136422038078, + 0.895983848720789, + 0.3929320462048054, + 0.4804496057331562, + 0.6280210837721825 + ], + "unique_experts": 63, + "load_cv": 0.6905868701946164, + "normalized_load_entropy": 0.951356154181656, + "max_load_share": 0.05752212389380531 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "3faaa96658d622a8c1eae46d215a7733b3f1370b8a4de57430d425a37a8906d9", + "route_weight_sha256": "ef10931d37b2f0b951272f68b7e1e007870e3d4e0ace299c0f32df15010ce27d", + "loads": [ + 17, + 15, + 7, + 22, + 50, + 36, + 14, + 13, + 11, + 8, + 15, + 7, + 31, + 14, + 9, + 17, + 16, + 32, + 22, + 2, + 5, + 9, + 17, + 16, + 10, + 19, + 6, + 10, + 13, + 14, + 5, + 8, + 18, + 6, + 13, + 10, + 13, + 16, + 12, + 16, + 6, + 28, + 8, + 17, + 35, + 15, + 0, + 5, + 7, + 11, + 18, + 10, + 6, + 34, + 11, + 20, + 7, + 13, + 6, + 16, + 26, + 11, + 9, + 11 + ], + "weighted_loads": [ + 0.8060935549438, + 0.5920718871057034, + 0.2750238059088588, + 1.4565012827515602, + 3.6630187071859837, + 2.1228293739259243, + 1.6881464719772339, + 0.678643150255084, + 0.5380744026042521, + 0.5697650145739317, + 1.6848261822015047, + 0.33742234483361244, + 3.3851186018437147, + 1.819557297974825, + 0.42459529638290405, + 1.084599930793047, + 0.9916602149605751, + 2.6550686918199062, + 1.7447587251663208, + 0.0654749646782875, + 0.19502695836126804, + 0.39964136481285095, + 1.0287508312612772, + 0.9487468488514423, + 0.5629372298717499, + 1.015868853777647, + 0.19668811187148094, + 0.6609153300523758, + 1.4280656091868877, + 0.47642201371490955, + 0.1863038819283247, + 0.2849343419075012, + 1.7920436430722475, + 0.23998360894620419, + 0.4458829239010811, + 0.6666009947657585, + 0.9447051715105772, + 0.6034117694944143, + 0.755407290533185, + 0.8803461622446775, + 0.3083977550268173, + 2.4378610365092754, + 0.5171904526650906, + 2.8525850996375084, + 1.9640394560992718, + 1.10046430490911, + 0.0, + 0.20795896276831627, + 0.23821092955768108, + 0.5402802415192127, + 1.7358598411083221, + 0.5113208796828985, + 0.16839660797268152, + 2.0551645662635565, + 0.49645344354212284, + 1.5685730315744877, + 0.2798180300742388, + 0.7680384442210197, + 0.26500001549720764, + 0.6701939906924963, + 2.3999345619231462, + 0.502081360667944, + 0.5404767282307148, + 0.6280210837721825 + ], + "unique_experts": 63, + "load_cv": 0.6268392289107669, + "normalized_load_entropy": 0.9573225595151663, + "max_load_share": 0.05411255411255411 + } + }, + "s0_period": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "86162931b016286549ceb0fba8e160fec0ea9519bf6e6d1cb12ec0639d03dcb1", + "route_weight_sha256": "04b3d4f6342b6612e62124f0a48ebdcd471caf8f28a7b64874955d3fcc43ec07", + "loads": [ + 13, + 13, + 8, + 10, + 33, + 24, + 10, + 7, + 8, + 4, + 14, + 7, + 29, + 13, + 11, + 5, + 8, + 28, + 10, + 2, + 3, + 6, + 7, + 14, + 8, + 6, + 8, + 7, + 14, + 12, + 5, + 3, + 20, + 6, + 9, + 8, + 10, + 8, + 9, + 11, + 7, + 27, + 6, + 11, + 21, + 14, + 0, + 6, + 8, + 7, + 6, + 11, + 6, + 26, + 12, + 11, + 6, + 3, + 7, + 13, + 12, + 9, + 8, + 10 + ], + "weighted_loads": [ + 0.6372822318226099, + 0.5398688595741987, + 0.3541309414431453, + 0.7015020474791527, + 2.827573072165251, + 1.4888597168028355, + 1.5340579897165298, + 0.2617754153907299, + 0.4384265895932913, + 0.2641379348933697, + 1.6352804824709892, + 0.32670953311026096, + 3.325628224760294, + 1.5274908188730478, + 0.46788783743977547, + 0.36340490356087685, + 0.46420175768435, + 2.445603657513857, + 0.6614208221435547, + 0.05340801924467087, + 0.12309559062123299, + 0.29735350608825684, + 0.5071759782731533, + 0.7836356777697802, + 0.49970515444874763, + 0.21071786805987358, + 0.29372046142816544, + 0.5385324470698833, + 1.4422663561999798, + 0.44133499450981617, + 0.18993601202964783, + 0.11402736231684685, + 1.8806442562490702, + 0.20544542372226715, + 0.302360650151968, + 0.49286121129989624, + 0.8324063271284103, + 0.28626816533505917, + 0.29657991230487823, + 0.6617018058896065, + 0.30172691494226456, + 2.373823754489422, + 0.3609127998352051, + 2.6077595353126526, + 1.1411702018231153, + 1.0241357553750277, + 0.0, + 0.22850119695067406, + 0.27011098340153694, + 0.33809018321335316, + 0.2724458575248718, + 0.5508384010754526, + 0.17857370525598526, + 1.9328432250767946, + 0.5503319501876831, + 0.5490590948611498, + 0.24470717459917068, + 0.10099703073501587, + 0.28168891929090023, + 0.5860029794275761, + 0.8543692147359252, + 0.3899067770689726, + 0.4887259937822819, + 0.48480249755084515 + ], + "unique_experts": 63, + "load_cv": 0.6351368802123226, + "normalized_load_entropy": 0.9571422693913767, + "max_load_share": 0.048672566371681415 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "7da3dee987491df36f061d415615c0de8ac08a564cd5cce55a1742e9f0e02faa", + "route_weight_sha256": "65b015dc7a28560d53d17cf0d2af4e17ced5fcbe3128a2a4e5d8fdc5b20c8500", + "loads": [ + 13, + 15, + 8, + 18, + 42, + 27, + 16, + 14, + 8, + 4, + 15, + 7, + 32, + 13, + 11, + 11, + 9, + 29, + 20, + 2, + 7, + 6, + 14, + 14, + 8, + 13, + 9, + 7, + 14, + 15, + 5, + 3, + 20, + 8, + 10, + 8, + 12, + 11, + 10, + 13, + 8, + 29, + 9, + 14, + 34, + 14, + 0, + 6, + 9, + 8, + 14, + 11, + 6, + 31, + 12, + 14, + 6, + 8, + 7, + 13, + 23, + 13, + 8, + 10 + ], + "weighted_loads": [ + 0.6372822318226099, + 0.6071208603680134, + 0.3541309414431453, + 1.294380858540535, + 3.272724822163582, + 1.5903237834572792, + 1.7474520932883024, + 0.7442254591733217, + 0.4384265895932913, + 0.2641379348933697, + 1.6681202128529549, + 0.32670953311026096, + 3.4295258969068527, + 1.5274908188730478, + 0.46788783743977547, + 0.6118440292775631, + 0.5020554717630148, + 2.5225998125970364, + 1.5457056872546673, + 0.05340801924467087, + 0.26842543855309486, + 0.29735350608825684, + 0.9538210146129131, + 0.7836356777697802, + 0.49970515444874763, + 0.7573461048305035, + 0.31116676330566406, + 0.5385324470698833, + 1.4422663561999798, + 0.541704710572958, + 0.18993601202964783, + 0.11402736231684685, + 1.8806442562490702, + 0.32016429118812084, + 0.33777160197496414, + 0.49286121129989624, + 0.8791697155684233, + 0.37100678496062756, + 0.6610984355211258, + 0.7682957910001278, + 0.3568846210837364, + 2.4452147260308266, + 0.5351905357092619, + 2.748155504465103, + 1.6049181744456291, + 1.0241357553750277, + 0.0, + 0.22850119695067406, + 0.3057706207036972, + 0.39802353642880917, + 1.3190668486058712, + 0.5508384010754526, + 0.17857370525598526, + 2.218560701236129, + 0.5503319501876831, + 0.9674832280725241, + 0.24470717459917068, + 0.25769722275435925, + 0.28168891929090023, + 0.5860029794275761, + 2.1288090581074357, + 0.622304180637002, + 0.4887259937822819, + 0.48480249755084515 + ], + "unique_experts": 63, + "load_cv": 0.6213506963897563, + "normalized_load_entropy": 0.9583628344819635, + "max_load_share": 0.050724637681159424 + } + }, + "s1_period": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "4836d900346123473fac7694fb71062408ea3aac7e3538430d813921dde56a99", + "route_weight_sha256": "770075a18617be6611c56c934d7db7ad1cab2056c43e5d7803d8f1430a8637dd", + "loads": [ + 13, + 11, + 9, + 10, + 39, + 33, + 10, + 7, + 10, + 5, + 14, + 5, + 27, + 12, + 9, + 5, + 10, + 29, + 11, + 2, + 3, + 8, + 6, + 15, + 8, + 9, + 4, + 7, + 13, + 10, + 5, + 4, + 19, + 6, + 12, + 8, + 10, + 7, + 9, + 11, + 2, + 27, + 6, + 12, + 19, + 14, + 0, + 5, + 6, + 9, + 3, + 10, + 8, + 23, + 11, + 8, + 6, + 4, + 6, + 13, + 13, + 9, + 8, + 11 + ], + "weighted_loads": [ + 0.6212623938918114, + 0.47736310213804245, + 0.3365529994480312, + 0.6624434608966112, + 3.1078417859971523, + 2.153358282521367, + 1.563451997935772, + 0.25560190714895725, + 0.4882493307814002, + 0.29856599122285843, + 1.6150238402187824, + 0.2621052786707878, + 3.258284291252494, + 1.52303727529943, + 0.3949936833232641, + 0.3374864384531975, + 0.5391483809798956, + 2.5152344591915607, + 0.649481788277626, + 0.04738103039562702, + 0.1203464176505804, + 0.3625299669802189, + 0.3601101730018854, + 0.7932642083615065, + 0.49335773289203644, + 0.2930599804967642, + 0.14822044223546982, + 0.5295158438384533, + 1.4223741367459297, + 0.3576078098267317, + 0.18757998943328857, + 0.14738715812563896, + 1.8162315040826797, + 0.19734418392181396, + 0.38553596660494804, + 0.4865443557500839, + 0.8287397027015686, + 0.2625712789595127, + 0.317069286480546, + 0.6507335416972637, + 0.12491874769330025, + 2.381767049431801, + 0.36411015316843987, + 2.5881865713745356, + 1.002664739266038, + 1.0238289590924978, + 0.0, + 0.21460429579019547, + 0.21252621710300446, + 0.37587567046284676, + 0.11167820170521736, + 0.5304708033800125, + 0.2266971431672573, + 1.5740424580872059, + 0.49527619034051895, + 0.449021402746439, + 0.2412033285945654, + 0.15591313131153584, + 0.2657324820756912, + 0.5931561104953289, + 0.8897833209484816, + 0.39811802096664906, + 0.4681897684931755, + 0.5940203722566366 + ], + "unique_experts": 63, + "load_cv": 0.6919966693300013, + "normalized_load_entropy": 0.951017730192851, + "max_load_share": 0.05752212389380531 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "e2ae7000a9b47428e58de2a11ed6ed9e3bc98deb5d7f9afbfaafe652d793c7c5", + "route_weight_sha256": "98d392baa6abba57843f1b264024a08fa0c87c07b1db66257096c19980e0b9d4", + "loads": [ + 17, + 12, + 9, + 21, + 49, + 39, + 13, + 14, + 10, + 7, + 16, + 5, + 30, + 13, + 10, + 16, + 16, + 30, + 21, + 3, + 7, + 9, + 17, + 17, + 9, + 23, + 5, + 9, + 13, + 14, + 5, + 5, + 20, + 7, + 15, + 10, + 13, + 18, + 11, + 16, + 6, + 29, + 8, + 17, + 33, + 15, + 0, + 5, + 6, + 14, + 16, + 10, + 8, + 32, + 12, + 20, + 7, + 11, + 7, + 16, + 26, + 12, + 9, + 11 + ], + "weighted_loads": [ + 0.8157622497528791, + 0.5014900770038366, + 0.3365529994480312, + 1.4195750039070845, + 3.595245774835348, + 2.390616411343217, + 1.674874883145094, + 0.7441005147993565, + 0.4882493307814002, + 0.5310339778661728, + 1.7068207636475563, + 0.2621052786707878, + 3.3666903246194124, + 1.8067865576595068, + 0.454883573576808, + 1.0298122838139534, + 0.8773045111447573, + 2.5881929360330105, + 1.6243760287761688, + 0.07990091480314732, + 0.27138175815343857, + 0.39838071912527084, + 1.032644895836711, + 0.966259254142642, + 0.5137942843139172, + 1.1838625874370337, + 0.16566674411296844, + 0.6376412995159626, + 1.4223741367459297, + 0.47023313865065575, + 0.18757998943328857, + 0.17810711450874805, + 1.8662301003932953, + 0.24684011563658714, + 0.4852174539119005, + 0.663751482963562, + 0.9318706095218658, + 0.6718408651649952, + 0.7245765309780836, + 0.8947495929896832, + 0.3045933283865452, + 2.4778470173478127, + 0.517301220446825, + 2.8338663559406996, + 1.8558161035180092, + 1.0965157579630613, + 0.0, + 0.21460429579019547, + 0.21252621710300446, + 0.7023411318659782, + 1.663522843271494, + 0.5304708033800125, + 0.2266971431672573, + 1.9404023997485638, + 0.5272013954818249, + 1.5462329722940922, + 0.2867164593189955, + 0.6947325672954321, + 0.30172621458768845, + 0.6735364589840174, + 2.3427034951746464, + 0.546966390684247, + 0.5282168909907341, + 0.5940203722566366 + ], + "unique_experts": 63, + "load_cv": 0.6202271328876285, + "normalized_load_entropy": 0.9579777460314823, + "max_load_share": 0.05303030303030303 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 113, + "ordered_topk_exact_tokens": 62, + "set_exact_tokens": 77, + "mean_set_jaccard": 0.90897597977244, + "mean_token_weighted_tv": 0.017232996246785717, + "aggregate_load_tv": 0.03392330383480826 + }, + "system_bos": { + "tokens": 113, + "ordered_topk_exact_tokens": 54, + "set_exact_tokens": 71, + "mean_set_jaccard": 0.8881163084702908, + "mean_token_weighted_tv": 0.022379976027620447, + "aggregate_load_tv": 0.038348082595870206 + }, + "system_x": { + "tokens": 113, + "ordered_topk_exact_tokens": 36, + "set_exact_tokens": 49, + "mean_set_jaccard": 0.8286978508217446, + "mean_token_weighted_tv": 0.03472565159003819, + "aggregate_load_tv": 0.05309734513274336 + }, + "system_period": { + "tokens": 113, + "ordered_topk_exact_tokens": 33, + "set_exact_tokens": 49, + "mean_set_jaccard": 0.8234302570585758, + "mean_token_weighted_tv": 0.03596648824425925, + "aggregate_load_tv": 0.06047197640117995 + }, + "bos_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 49, + "set_exact_tokens": 66, + "mean_set_jaccard": 0.877370417193426, + "mean_token_weighted_tv": 0.025542346855411225, + "aggregate_load_tv": 0.04867256637168142 + }, + "bos_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 48, + "set_exact_tokens": 66, + "mean_set_jaccard": 0.8716814159292036, + "mean_token_weighted_tv": 0.028190439684415418, + "aggregate_load_tv": 0.04424778761061947 + }, + "x_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 50, + "set_exact_tokens": 66, + "mean_set_jaccard": 0.8683101559207754, + "mean_token_weighted_tv": 0.026559856823291136, + "aggregate_load_tv": 0.045722713864306784 + }, + "x_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 37, + "set_exact_tokens": 50, + "mean_set_jaccard": 0.8198482932996207, + "mean_token_weighted_tv": 0.03754679502639095, + "aggregate_load_tv": 0.06342182890855456 + }, + "period_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 49, + "set_exact_tokens": 68, + "mean_set_jaccard": 0.8786346396965866, + "mean_token_weighted_tv": 0.02514066770507962, + "aggregate_load_tv": 0.04424778761061947 + }, + "period_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 40, + "set_exact_tokens": 51, + "mean_set_jaccard": 0.8246944795617364, + "mean_token_weighted_tv": 0.038146204055509475, + "aggregate_load_tv": 0.06489675516224189 + } + } + }, + "layer_21": { + "layer": 21, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "2b252e6f7b977da1f92cdb95916c001561d9b82e79cb1e858328810a685e78d0", + "route_weight_sha256": "46167e743e19a96b514e08f20d48865d5e0d7bda1625749eb62e803dbf5970f3", + "loads": [ + 17, + 11, + 15, + 6, + 6, + 7, + 8, + 14, + 13, + 6, + 20, + 10, + 14, + 4, + 2, + 4, + 3, + 14, + 19, + 25, + 8, + 7, + 16, + 10, + 12, + 9, + 12, + 0, + 6, + 8, + 31, + 23, + 4, + 7, + 2, + 0, + 7, + 12, + 9, + 5, + 5, + 11, + 15, + 3, + 4, + 10, + 16, + 13, + 23, + 9, + 8, + 14, + 18, + 22, + 4, + 16, + 10, + 5, + 9, + 7, + 12, + 30, + 4, + 4 + ], + "weighted_loads": [ + 0.7036740668118, + 1.0581659656018019, + 1.1580993505194783, + 0.6522097289562225, + 0.263705488294363, + 0.39525948092341423, + 0.4059264063835144, + 2.1257400158792734, + 0.6296234615147114, + 0.5681930091232061, + 1.5030624326318502, + 0.4392616041004658, + 1.1882850211113691, + 0.17127656191587448, + 0.07806726172566414, + 0.1700026299804449, + 0.1259545348584652, + 1.3850944954901934, + 1.3858141116797924, + 0.9071520157158375, + 0.5336713120341301, + 0.667534701526165, + 1.0711629409343004, + 0.487365385517478, + 0.9907606244087219, + 0.3884617816656828, + 0.6286954041570425, + 0.0, + 0.2199063077569008, + 0.6859280467033386, + 3.8059105426073074, + 1.010208056308329, + 0.1783692017197609, + 0.3228747546672821, + 0.07819516584277153, + 0.0, + 0.34976390190422535, + 0.802344836294651, + 0.6635448634624481, + 0.19062522426247597, + 0.21022302471101284, + 0.5274159722030163, + 0.8882268033921719, + 0.3582672197371721, + 0.17803311720490456, + 0.3936790693551302, + 1.3961565773934126, + 0.9668685235083103, + 1.029977997764945, + 0.6128685250878334, + 0.609472494572401, + 0.9227129276841879, + 1.2748167533427477, + 1.282160671427846, + 0.15643754042685032, + 1.6995912063866854, + 1.271782048046589, + 0.46944141760468483, + 0.35913082771003246, + 1.0019216239452362, + 0.5428833365440369, + 3.4663774706423283, + 0.15004366263747215, + 0.2099389974027872 + ], + "unique_experts": 62, + "load_cv": 0.6418963104603301, + "normalized_load_entropy": 0.9507058237017265, + "max_load_share": 0.045722713864306784 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "2f6cc74f1ff054744c003b7c9a8a6fc178b807f8d60dbc25d41a96690ff703c9", + "route_weight_sha256": "4cab09bb0da54b192a005b90df9942ee43135e71793467fc0c74b23dd51221f1", + "loads": [ + 17, + 12, + 18, + 6, + 13, + 7, + 11, + 14, + 15, + 6, + 29, + 10, + 19, + 9, + 4, + 10, + 5, + 17, + 20, + 28, + 8, + 14, + 16, + 11, + 12, + 10, + 20, + 5, + 9, + 8, + 33, + 23, + 5, + 7, + 3, + 10, + 7, + 12, + 9, + 7, + 6, + 11, + 18, + 3, + 4, + 10, + 16, + 13, + 37, + 10, + 8, + 21, + 28, + 23, + 8, + 19, + 11, + 5, + 13, + 9, + 12, + 32, + 8, + 4 + ], + "weighted_loads": [ + 0.7036740668118, + 1.1012782473117113, + 1.231386121129617, + 0.6522097289562225, + 0.5206451248377562, + 0.39525948092341423, + 0.6551690921187401, + 2.1257400158792734, + 0.7632911913096905, + 0.5681930091232061, + 1.9828958865255117, + 0.4392616041004658, + 1.4056804720312357, + 0.4884115420281887, + 0.16955874115228653, + 0.36659861356019974, + 0.17569336853921413, + 1.4710508496500552, + 1.435907982289791, + 2.428895141929388, + 0.5336713120341301, + 1.1010281089693308, + 1.0711629409343004, + 0.5324922855943441, + 0.9907606244087219, + 0.424605680629611, + 0.9992099534720182, + 0.4941320903599262, + 0.28021790413185954, + 0.6859280467033386, + 3.9442822225391865, + 1.010208056308329, + 0.20121771469712257, + 0.3228747546672821, + 0.12707333639264107, + 0.5778346601873636, + 0.34976390190422535, + 0.802344836294651, + 0.6635448634624481, + 0.27255965769290924, + 0.26381452940404415, + 0.5274159722030163, + 1.0775885432958603, + 0.3582672197371721, + 0.17803311720490456, + 0.3936790693551302, + 1.3961565773934126, + 0.9668685235083103, + 1.7457025591284037, + 0.737825982272625, + 0.609472494572401, + 1.2420369032770395, + 1.9040898885577917, + 1.295172043144703, + 0.2843864103779197, + 1.973747344687581, + 1.3127949200570583, + 0.46944141760468483, + 0.5192513130605221, + 1.0724510252475739, + 0.5428833365440369, + 3.5845682732760906, + 0.3206421919167042, + 0.2099389974027872 + ], + "unique_experts": 64, + "load_cv": 0.5983906473977038, + "normalized_load_entropy": 0.9607187905674157, + "max_load_share": 0.04468599033816425 + } + }, + "s1_eos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "c65c69f852de4373a9f89b4a40754ea9738099020962dd651e5e7cb22e7c31d9", + "route_weight_sha256": "99ac84890409e4355aef2ebfab1526402755924d2051c8d56c45be976e12e525", + "loads": [ + 17, + 10, + 15, + 7, + 7, + 7, + 8, + 13, + 12, + 6, + 20, + 10, + 15, + 3, + 2, + 4, + 2, + 14, + 20, + 26, + 8, + 8, + 15, + 9, + 12, + 10, + 12, + 0, + 7, + 8, + 31, + 18, + 4, + 4, + 2, + 0, + 6, + 13, + 9, + 5, + 6, + 11, + 16, + 3, + 4, + 13, + 16, + 13, + 24, + 10, + 8, + 12, + 20, + 23, + 5, + 16, + 10, + 4, + 10, + 6, + 12, + 30, + 3, + 4 + ], + "weighted_loads": [ + 0.7260330766439438, + 1.0228882115334272, + 1.1757649332284927, + 0.7014345936477184, + 0.317869883030653, + 0.37589733488857746, + 0.4107625652104616, + 2.0882038194686174, + 0.5895669981837273, + 0.5671276524662971, + 1.5154481306672096, + 0.44098713248968124, + 1.2515685856342316, + 0.13383767753839493, + 0.07483746856451035, + 0.1678796075284481, + 0.08676058799028397, + 1.368769096210599, + 1.3877740986645222, + 0.9636184293776751, + 0.5312576498836279, + 0.7139394916594028, + 1.055791575461626, + 0.4498806782066822, + 0.9720153920352459, + 0.4222425054758787, + 0.6055270545184612, + 0.0, + 0.23974736221134663, + 0.6822957433760166, + 3.7747241258621216, + 0.8249610057100654, + 0.17700987681746483, + 0.2080216407775879, + 0.08752188086509705, + 0.0, + 0.31909414380788803, + 0.8328089155256748, + 0.6599517948925495, + 0.19185758754611015, + 0.23954624868929386, + 0.5197621434926987, + 0.9284762386232615, + 0.36726467311382294, + 0.17545568197965622, + 0.4927063658833504, + 1.371787704527378, + 0.9714044742286205, + 1.084583468735218, + 0.6466332711279392, + 0.6005570720881224, + 0.910568755120039, + 1.359496222808957, + 1.2752796337008476, + 0.19151877611875534, + 1.6737255547195673, + 1.2582107074558735, + 0.42588132433593273, + 0.3964429497718811, + 0.9433370940387249, + 0.5395517144352198, + 3.5379881635308266, + 0.11047955974936485, + 0.21508699841797352 + ], + "unique_experts": 62, + "load_cv": 0.650086190622402, + "normalized_load_entropy": 0.9490055852765861, + "max_load_share": 0.045722713864306784 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "193db4eebf85ee2157f69758a22528103a12fc4822ed4b348565b059e1928782", + "route_weight_sha256": "f15e55ccc3935476d251054314a9d91b5f1cae38c282248753546d8039843098", + "loads": [ + 26, + 12, + 18, + 7, + 7, + 8, + 13, + 14, + 16, + 9, + 31, + 10, + 20, + 13, + 10, + 7, + 4, + 22, + 22, + 30, + 9, + 18, + 16, + 14, + 13, + 12, + 20, + 8, + 10, + 9, + 36, + 18, + 5, + 8, + 2, + 18, + 7, + 14, + 10, + 5, + 6, + 13, + 25, + 3, + 5, + 14, + 16, + 13, + 37, + 14, + 9, + 22, + 30, + 24, + 17, + 26, + 15, + 4, + 13, + 10, + 13, + 33, + 6, + 5 + ], + "weighted_loads": [ + 1.277364132925868, + 1.1031816471368074, + 1.869390720501542, + 0.7014345936477184, + 0.317869883030653, + 0.39129644725471735, + 0.6576383132487535, + 2.1703685987740755, + 0.7943314909934998, + 0.7434910554438829, + 2.0464170202612877, + 0.44098713248968124, + 1.4971306137740612, + 0.7295217663049698, + 0.3958623856306076, + 0.255981826223433, + 0.13485191948711872, + 1.6489125355146825, + 1.4410670958459377, + 2.5009805765002966, + 0.5795619171112776, + 1.246652954723686, + 1.0858995709568262, + 0.9377779345959425, + 1.0082206055521965, + 0.4996047802269459, + 0.899195458739996, + 0.7930489405989647, + 0.2751897284761071, + 0.731393177062273, + 4.03053998015821, + 0.8249610057100654, + 0.1997333224862814, + 0.8035734444856644, + 0.08752188086509705, + 0.9654335658997297, + 0.3899565488100052, + 0.873615175485611, + 0.7118697725236416, + 0.19185758754611015, + 0.23954624868929386, + 0.6445150300860405, + 1.3707526121288538, + 0.36726467311382294, + 0.236747395247221, + 0.550501961261034, + 1.371787704527378, + 0.9714044742286205, + 1.9931633956730366, + 1.5928405597805977, + 0.6543328817933798, + 1.6266976408660412, + 1.954905552789569, + 1.2882910054177046, + 0.8968725437298417, + 2.301791476085782, + 1.4637911915779114, + 0.42588132433593273, + 0.5250996295362711, + 1.140639642253518, + 0.561940161511302, + 3.7071130014955997, + 0.22712887451052666, + 0.3017688114196062 + ], + "unique_experts": 64, + "load_cv": 0.5767657091991808, + "normalized_load_entropy": 0.9616307906541239, + "max_load_share": 0.04004329004329004 + } + }, + "s0_bos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "9b714229af2ea9022315b3d5dfa51d23edd7c9cb65af0d13b18d2c9b24cfbb63", + "route_weight_sha256": "c5095c8e7a0ade31be8779451c1601de1c635e18ab0ec5f7bcf3d0f4437cf926", + "loads": [ + 18, + 10, + 16, + 6, + 6, + 7, + 6, + 12, + 13, + 6, + 21, + 10, + 14, + 5, + 2, + 4, + 3, + 14, + 20, + 22, + 8, + 7, + 15, + 9, + 12, + 13, + 11, + 1, + 5, + 9, + 31, + 22, + 2, + 6, + 2, + 0, + 7, + 12, + 9, + 5, + 6, + 11, + 16, + 3, + 4, + 12, + 18, + 14, + 22, + 8, + 9, + 13, + 17, + 28, + 4, + 16, + 9, + 5, + 9, + 6, + 10, + 30, + 3, + 4 + ], + "weighted_loads": [ + 0.7718486301600933, + 1.035841683857143, + 1.150883355177939, + 0.6409434080123901, + 0.26041264086961746, + 0.4114123061299324, + 0.345179945230484, + 2.0800513550639153, + 0.6422350704669952, + 0.5808901246637106, + 1.5169578902423382, + 0.428450383245945, + 1.186854314059019, + 0.24436426535248756, + 0.07423286139965057, + 0.16771924309432507, + 0.12093400955200195, + 1.4020247235894203, + 1.4309146106243134, + 0.8066104985773563, + 0.5586230903863907, + 0.6663991585373878, + 1.0552392899990082, + 0.44832993671298027, + 0.9926519133150578, + 0.5347369257360697, + 0.5870502833276987, + 0.03557770699262619, + 0.18896079156547785, + 0.7265173867344856, + 4.007658068090677, + 0.9633134379982948, + 0.1052979938685894, + 0.28195893950760365, + 0.08536920323967934, + 0.0, + 0.356865506619215, + 0.7981018014252186, + 0.6575335189700127, + 0.19299956783652306, + 0.23948865942656994, + 0.530247587710619, + 0.8865359546616673, + 0.3881918881088495, + 0.17136656120419502, + 0.4674561023712158, + 1.5130647402256727, + 1.0231698714196682, + 0.9853425715118647, + 0.5449361987411976, + 0.6478089988231659, + 0.8655473943799734, + 1.2667069248855114, + 1.4917349070310593, + 0.15327597595751286, + 1.649431822821498, + 1.228685948997736, + 0.4494636803865433, + 0.358768105506897, + 0.939405657351017, + 0.472539059817791, + 3.490307904779911, + 0.11275143548846245, + 0.20995660312473774 + ], + "unique_experts": 63, + "load_cv": 0.6585971009665047, + "normalized_load_entropy": 0.9490202265743142, + "max_load_share": 0.045722713864306784 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "55c0f8ed5c1eea4c2b9ddbe82a6d95ca8a81460c1f9b251b2b106c6f3960ac24", + "route_weight_sha256": "30dad3ea47af2233cb9b8dd7d3ee721dfa168a6c1f6a23e05c419c8b45fb7f48", + "loads": [ + 18, + 12, + 18, + 7, + 12, + 7, + 8, + 12, + 16, + 6, + 28, + 10, + 19, + 10, + 5, + 9, + 5, + 16, + 22, + 24, + 8, + 13, + 15, + 10, + 12, + 14, + 19, + 6, + 7, + 9, + 33, + 24, + 3, + 6, + 3, + 10, + 7, + 12, + 9, + 8, + 8, + 11, + 19, + 3, + 4, + 13, + 18, + 14, + 35, + 9, + 9, + 20, + 27, + 29, + 8, + 20, + 10, + 5, + 11, + 8, + 10, + 33, + 8, + 4 + ], + "weighted_loads": [ + 0.7718486301600933, + 1.1198327532038093, + 1.2216320736333728, + 0.8413521498441696, + 0.48186529241502285, + 0.4114123061299324, + 0.5298273600637913, + 2.0800513550639153, + 0.8095948249101639, + 0.5808901246637106, + 1.8867009580135345, + 0.428450383245945, + 1.40094462223351, + 0.5583337843418121, + 0.20726525411009789, + 0.34835959412157536, + 0.17309715412557125, + 1.4839384444057941, + 1.5363138616085052, + 1.3860494904220104, + 0.5586230903863907, + 1.0983794862404466, + 1.0552392899990082, + 0.4934568367898464, + 0.9926519133150578, + 0.5708808246999979, + 0.9575648326426744, + 0.5370080694556236, + 0.2448524972423911, + 0.7265173867344856, + 4.15739207342267, + 1.121938779950142, + 0.12814650684595108, + 0.28195893950760365, + 0.13424737378954887, + 0.5778346601873636, + 0.356865506619215, + 0.7981018014252186, + 0.6575335189700127, + 0.3094700761139393, + 0.37042143009603024, + 0.530247587710619, + 1.0758976945653558, + 0.3881918881088495, + 0.17136656120419502, + 0.5652915313839912, + 1.5130647402256727, + 1.0231698714196682, + 1.655291235074401, + 0.6698936559259892, + 0.6478089988231659, + 1.184871369972825, + 1.8959800601005554, + 1.5047462787479162, + 0.2812248459085822, + 1.9469414055347443, + 1.2696988210082054, + 0.4494636803865433, + 0.4192373435944319, + 1.0099350586533546, + 0.472539059817791, + 3.6455895379185677, + 0.3413870744407177, + 0.20995660312473774 + ], + "unique_experts": 64, + "load_cv": 0.5999486547145312, + "normalized_load_entropy": 0.9602848558221505, + "max_load_share": 0.042270531400966184 + } + }, + "s1_bos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "e246e5ad9d13b3b12fb0f8c629da57b6a71b5358e3bd969ae72eb5d14186db9e", + "route_weight_sha256": "b86b3eb87b2b546c916c30f46c0f919fe429202998dc97ce975afc3e4197df88", + "loads": [ + 19, + 11, + 15, + 6, + 7, + 10, + 8, + 13, + 13, + 6, + 20, + 9, + 17, + 6, + 2, + 4, + 2, + 13, + 17, + 23, + 8, + 7, + 16, + 8, + 12, + 11, + 10, + 0, + 6, + 9, + 31, + 20, + 2, + 5, + 2, + 0, + 6, + 13, + 9, + 5, + 4, + 11, + 15, + 3, + 4, + 12, + 19, + 13, + 22, + 8, + 9, + 12, + 18, + 24, + 5, + 16, + 10, + 6, + 10, + 6, + 12, + 31, + 3, + 4 + ], + "weighted_loads": [ + 0.8150116112083197, + 1.0706785768270493, + 1.1797457188367844, + 0.6656684689223766, + 0.2966809459030628, + 0.533270388841629, + 0.3892149031162262, + 2.0804705433547497, + 0.6307046338915825, + 0.5733412560075521, + 1.4916677605360746, + 0.39147841557860374, + 1.3161228951066732, + 0.2424482498317957, + 0.07618752121925354, + 0.16195496544241905, + 0.08654515445232391, + 1.3602490574121475, + 1.3154352754354477, + 0.8731433860957623, + 0.5602129586040974, + 0.6535698287189007, + 1.096831489354372, + 0.3955223187804222, + 1.0081911459565163, + 0.47079029120504856, + 0.5611027218401432, + 0.0, + 0.21217653155326843, + 0.71975352242589, + 3.858652364462614, + 0.8640876235440373, + 0.10221928358078003, + 0.23999459110200405, + 0.0831122100353241, + 0.0, + 0.32679084315896034, + 0.8506738357245922, + 0.6726385839283466, + 0.18883945420384407, + 0.16576096788048744, + 0.5079584885388613, + 0.8534679505974054, + 0.4258090239018202, + 0.17043321020901203, + 0.46931598521769047, + 1.5261327382177114, + 0.9772400707006454, + 0.991727476939559, + 0.5435986444354057, + 0.6388122551143169, + 0.8865452259778976, + 1.2637494429945946, + 1.3402714300900698, + 0.1879056990146637, + 1.6010792944580317, + 1.255460076034069, + 0.49029574170708656, + 0.4156952239573002, + 0.9164804071187973, + 0.5407529249787331, + 3.620056577026844, + 0.11868399009108543, + 0.22282898053526878 + ], + "unique_experts": 62, + "load_cv": 0.6464351232865075, + "normalized_load_entropy": 0.949318389134653, + "max_load_share": 0.045722713864306784 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "e78f7c69870f4081291e3eb30280abe203c0ae046b2e9c5a6b8b7c8d8e580962", + "route_weight_sha256": "51685212a001eceeac7da650a957df72cefc14949ee9b9fb1b8b249437223f68", + "loads": [ + 28, + 13, + 18, + 6, + 9, + 11, + 13, + 15, + 17, + 9, + 28, + 10, + 22, + 15, + 9, + 7, + 4, + 19, + 20, + 26, + 9, + 16, + 17, + 13, + 13, + 13, + 18, + 10, + 9, + 10, + 37, + 21, + 3, + 9, + 2, + 17, + 7, + 14, + 10, + 8, + 5, + 13, + 24, + 3, + 5, + 13, + 19, + 13, + 34, + 12, + 10, + 22, + 28, + 25, + 16, + 26, + 14, + 6, + 11, + 10, + 13, + 34, + 8, + 5 + ], + "weighted_loads": [ + 1.3660336583852768, + 1.1610484682023525, + 1.9133576024323702, + 0.6656684689223766, + 0.3670838847756386, + 0.5486695012077689, + 0.6595990620553493, + 2.199024397879839, + 0.8485013023018837, + 0.7497046589851379, + 1.9315145295113325, + 0.42948174849152565, + 1.5565735176205635, + 0.8042206298559904, + 0.3819085657596588, + 0.282726988196373, + 0.1349861677736044, + 1.5944003127515316, + 1.4322683364152908, + 1.4703357219696045, + 0.608517225831747, + 1.1801375346258283, + 1.1269394848495722, + 0.8834195751696825, + 1.0443963594734669, + 0.5481525659561157, + 0.8547711260616779, + 0.9136567674577236, + 0.27297058515250683, + 0.7688509561121464, + 4.148228140547872, + 0.9581625433638692, + 0.1249427292495966, + 0.8355463948100805, + 0.0831122100353241, + 0.9363676831126213, + 0.3976532481610775, + 0.8914800956845284, + 0.7245565615594387, + 0.2942022494971752, + 0.21013549715280533, + 0.6327113751322031, + 1.301034426316619, + 0.4258090239018202, + 0.2317249234765768, + 0.5271115805953741, + 1.5261327382177114, + 0.9772400707006454, + 1.8732840921729803, + 1.572514433413744, + 0.6925880648195744, + 1.6026741117238998, + 1.8591587729752064, + 1.3532828018069267, + 0.8602424236014485, + 2.245516212657094, + 1.417016141116619, + 0.49029574170708656, + 0.4406632650643587, + 1.1137829553335905, + 0.5631413720548153, + 3.80472145229578, + 0.3398223780095577, + 0.3095107935369015 + ], + "unique_experts": 64, + "load_cv": 0.5509752908309398, + "normalized_load_entropy": 0.9646477839233996, + "max_load_share": 0.04004329004329004 + } + }, + "s0_x": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "629fcab8ab877e2eb7dedc0dda77c8916c05bfdd60709ada02016bac4d52a01d", + "route_weight_sha256": "8871c90d6a503921e95793f23d8292287c3ddce5b44dbad00ac7f6595a2f689e", + "loads": [ + 17, + 12, + 14, + 6, + 6, + 5, + 5, + 14, + 11, + 6, + 18, + 9, + 14, + 3, + 2, + 4, + 3, + 14, + 21, + 21, + 8, + 8, + 15, + 8, + 12, + 13, + 11, + 0, + 7, + 9, + 33, + 23, + 3, + 5, + 1, + 0, + 7, + 12, + 9, + 5, + 7, + 11, + 17, + 3, + 4, + 13, + 18, + 13, + 23, + 7, + 9, + 12, + 18, + 32, + 5, + 16, + 8, + 4, + 10, + 7, + 11, + 30, + 2, + 4 + ], + "weighted_loads": [ + 0.7473902609199286, + 1.0990842720493674, + 1.1076917359605432, + 0.6670963652431965, + 0.26413678377866745, + 0.3362768366932869, + 0.30178842321038246, + 2.1751260552555323, + 0.5793935209512711, + 0.5847317632287741, + 1.426359748467803, + 0.3894842267036438, + 1.14378073066473, + 0.14722131937742233, + 0.07242414355278015, + 0.16538903303444386, + 0.11934585496783257, + 1.3965580947697163, + 1.4298788607120514, + 0.7810210064053535, + 0.5485133901238441, + 0.6739459931850433, + 1.0427971854805946, + 0.44598977640271187, + 1.0065918117761612, + 0.5122153703123331, + 0.5907064285129309, + 0.0, + 0.25181494001299143, + 0.7499261610209942, + 4.141757819801569, + 1.00415672454983, + 0.1453358195722103, + 0.24560505524277687, + 0.038556307554244995, + 0.0, + 0.3674146868288517, + 0.8067007251083851, + 0.6443157978355885, + 0.1843319647014141, + 0.2934107631444931, + 0.5332070142030716, + 0.935031889937818, + 0.36004173941910267, + 0.18922946974635124, + 0.5161323733627796, + 1.5055636391043663, + 0.9738351404666901, + 0.990578219294548, + 0.5096824802458286, + 0.5983690246939659, + 0.8213621824979782, + 1.3084669150412083, + 1.6582766063511372, + 0.19173500500619411, + 1.725119449198246, + 1.1942149847745895, + 0.47758181765675545, + 0.38822992891073227, + 0.9690415151417255, + 0.4904113281518221, + 3.5267056971788406, + 0.07458597049117088, + 0.18979857303202152 + ], + "unique_experts": 62, + "load_cv": 0.689981788761798, + "normalized_load_entropy": 0.9441215988902374, + "max_load_share": 0.048672566371681415 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "90422ae6e5c35f837103b5eb6edcaf73e2b124dcc8aa4298b5e7ae7370095735", + "route_weight_sha256": "7a4aacf2d59fccf018e23d58dd0225e74d2b51e0eb4d529ec170c577b73b4276", + "loads": [ + 17, + 13, + 16, + 6, + 12, + 5, + 8, + 14, + 13, + 6, + 28, + 9, + 20, + 7, + 5, + 8, + 5, + 18, + 22, + 23, + 8, + 13, + 15, + 9, + 12, + 14, + 19, + 5, + 10, + 9, + 35, + 23, + 4, + 5, + 2, + 11, + 7, + 12, + 9, + 6, + 8, + 11, + 22, + 3, + 4, + 13, + 18, + 13, + 39, + 9, + 9, + 19, + 29, + 33, + 9, + 19, + 10, + 4, + 11, + 9, + 11, + 32, + 6, + 4 + ], + "weighted_loads": [ + 0.7473902609199286, + 1.1337103201076388, + 1.178440454415977, + 0.6670963652431965, + 0.48558943532407284, + 0.3362768366932869, + 0.5343606472015381, + 2.1751260552555323, + 0.7196847945451736, + 0.5847317632287741, + 1.9236088786274195, + 0.3894842267036438, + 1.4092005640268326, + 0.4161101430654526, + 0.188653614372015, + 0.31200470589101315, + 0.16949274949729443, + 1.5476675145328045, + 1.4728697389364243, + 1.3604599982500076, + 0.5485133901238441, + 1.0639276253059506, + 1.0427971854805946, + 0.491116676479578, + 1.0065918117761612, + 0.5483592692762613, + 0.9612209778279066, + 0.494839821010828, + 0.3499867422506213, + 0.7499261610209942, + 4.293386436998844, + 1.00415672454983, + 0.168184332549572, + 0.24560505524277687, + 0.08743447810411453, + 0.6732313949614763, + 0.3674146868288517, + 0.8067007251083851, + 0.6443157978355885, + 0.22426464408636093, + 0.3324612192809582, + 0.5332070142030716, + 1.2141142701730132, + 0.36004173941910267, + 0.18922946974635124, + 0.5161323733627796, + 1.5055636391043663, + 0.9738351404666901, + 1.8223524410277605, + 0.6984411887824535, + 0.5983690246939659, + 1.1406861580908298, + 2.127379424870014, + 1.6712879780679941, + 0.31968387495726347, + 1.9971931241452694, + 1.2813746556639671, + 0.47758181765675545, + 0.4128906633704901, + 1.0395709164440632, + 0.4904113281518221, + 3.6530414521694183, + 0.23259497806429863, + 0.18979857303202152 + ], + "unique_experts": 64, + "load_cv": 0.6408754718302988, + "normalized_load_entropy": 0.9553735780738233, + "max_load_share": 0.04710144927536232 + } + }, + "s1_x": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "bccc161451ed9a53f8b8104e4a47390432a5cb62e70b010103d1075dd0faeef3", + "route_weight_sha256": "bc062f1db04e1304b70a9b5b98dd01ea457dcc91d83b80dd8d6b0729d77af003", + "loads": [ + 18, + 12, + 18, + 7, + 7, + 10, + 6, + 15, + 11, + 6, + 20, + 9, + 14, + 4, + 2, + 3, + 4, + 14, + 17, + 28, + 8, + 6, + 15, + 10, + 12, + 11, + 10, + 0, + 7, + 9, + 31, + 17, + 3, + 3, + 1, + 0, + 6, + 12, + 9, + 3, + 5, + 11, + 17, + 3, + 4, + 7, + 18, + 13, + 24, + 7, + 8, + 12, + 17, + 34, + 4, + 16, + 9, + 6, + 9, + 8, + 10, + 32, + 3, + 3 + ], + "weighted_loads": [ + 0.7843876127153635, + 1.1101789865642786, + 1.2416220735758543, + 0.7285437323153019, + 0.311415895819664, + 0.523720633238554, + 0.31864840909838676, + 2.0935631040483713, + 0.5445523522794247, + 0.5779508985579014, + 1.5043826568871737, + 0.4038066416978836, + 1.2067520190030336, + 0.1699051521718502, + 0.06973185762763023, + 0.1288544051349163, + 0.15714797005057335, + 1.3893485758453608, + 1.2810858897864819, + 1.0735246259719133, + 0.5454824529588223, + 0.5977600067853928, + 1.003146581351757, + 0.5431775189936161, + 1.0061021223664284, + 0.45673450641334057, + 0.5270547308027744, + 0.0, + 0.25302241556346416, + 0.7133479006588459, + 3.7746046110987663, + 0.7231069002300501, + 0.13048101402819157, + 0.16821351274847984, + 0.03795845806598663, + 0.0, + 0.34340694546699524, + 0.821590568870306, + 0.6609804779291153, + 0.09877759963274002, + 0.20155347511172295, + 0.5165025368332863, + 0.9769416367635131, + 0.3922599758952856, + 0.17602046951651573, + 0.26826703175902367, + 1.486422535032034, + 0.9451723378151655, + 1.1289558410644531, + 0.4760631062090397, + 0.5812957305461168, + 0.8718326985836029, + 1.236719835549593, + 1.7406978327780962, + 0.13944785110652447, + 1.6585619449615479, + 1.247030958533287, + 0.4912101197987795, + 0.3552051167935133, + 0.9412438962608576, + 0.44451090320944786, + 3.683461509644985, + 0.11023636534810066, + 0.17697127163410187 + ], + "unique_experts": 62, + "load_cv": 0.7110490821007417, + "normalized_load_entropy": 0.9418739803715294, + "max_load_share": 0.05014749262536873 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "f9412eb0460c9b73186f685f44e2a21056196614137c8d1f7c9c330709243360", + "route_weight_sha256": "8b26b6b562f16598cace7b8f21eb5cdc9a0b3ebfdec3837d0d85bd69033bcdbb", + "loads": [ + 27, + 13, + 20, + 8, + 7, + 11, + 10, + 16, + 14, + 9, + 30, + 9, + 21, + 13, + 9, + 6, + 6, + 19, + 19, + 32, + 9, + 14, + 16, + 16, + 13, + 16, + 18, + 8, + 9, + 10, + 37, + 17, + 4, + 7, + 1, + 19, + 7, + 13, + 10, + 5, + 5, + 14, + 28, + 3, + 7, + 8, + 18, + 13, + 38, + 10, + 9, + 22, + 28, + 36, + 15, + 25, + 13, + 6, + 11, + 12, + 11, + 35, + 5, + 4 + ], + "weighted_loads": [ + 1.3295623399317265, + 1.1581522729247808, + 1.93258960172534, + 0.7614718116819859, + 0.311415895819664, + 0.5391197456046939, + 0.46702270582318306, + 2.1757278833538294, + 0.7124865353107452, + 0.7543143015354872, + 1.990146180614829, + 0.4038066416978836, + 1.5604233089834452, + 0.66907112672925, + 0.33843692392110825, + 0.24862969294190407, + 0.20550856925547123, + 1.59243137948215, + 1.3343788869678974, + 1.7003147266805172, + 0.5937867201864719, + 1.084874209947884, + 1.0332545768469572, + 1.0881651397794485, + 1.042307335883379, + 0.6566292531788349, + 0.8207231350243092, + 0.7869820073246956, + 0.2841218877583742, + 0.7624453343451023, + 4.059808084741235, + 0.7231069002300501, + 0.15320445969700813, + 0.7637653164565563, + 0.03795845806598663, + 1.0389614030718803, + 0.4142693504691124, + 0.8623968288302422, + 0.7128984555602074, + 0.1707974225282669, + 0.20155347511172295, + 0.7146736979484558, + 1.524869698099792, + 0.3922599758952856, + 0.32508915290236473, + 0.3260626271367073, + 1.486422535032034, + 0.9451723378151655, + 2.232801530510187, + 1.379888143390417, + 0.6350715402513742, + 1.587961584329605, + 2.0321834832429886, + 1.7888641841709614, + 0.8117845756933093, + 2.2793465182185173, + 1.408587023615837, + 0.4912101197987795, + 0.41517431288957596, + 1.1385464444756508, + 0.4668993502855301, + 3.8494879007339478, + 0.18133410811424255, + 0.26365308463573456 + ], + "unique_experts": 64, + "load_cv": 0.6147643419368224, + "normalized_load_entropy": 0.9575551343874064, + "max_load_share": 0.04112554112554113 + } + }, + "s0_period": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "fabfe1403095aae82985c5c88526d83b6d4e5c268a81178886b701bd1d60d47c", + "route_weight_sha256": "901ff10f965ebc55fa48382ca9a3b746e20ef3a5500eb86c0e83050b2410b3ac", + "loads": [ + 18, + 11, + 16, + 6, + 6, + 6, + 6, + 15, + 13, + 6, + 18, + 10, + 14, + 4, + 2, + 5, + 2, + 14, + 20, + 22, + 8, + 7, + 15, + 10, + 12, + 11, + 11, + 1, + 6, + 9, + 32, + 22, + 3, + 5, + 1, + 0, + 7, + 12, + 9, + 5, + 7, + 11, + 16, + 3, + 4, + 10, + 20, + 12, + 24, + 8, + 9, + 11, + 18, + 28, + 3, + 16, + 9, + 4, + 8, + 8, + 12, + 30, + 3, + 4 + ], + "weighted_loads": [ + 0.7727402560412884, + 1.0667872233316302, + 1.174811251461506, + 0.6742513030767441, + 0.2631511986255646, + 0.3717287816107273, + 0.34239552915096283, + 2.1897958256304264, + 0.6645540930330753, + 0.5836441479623318, + 1.4071485251188278, + 0.43328792601823807, + 1.151028174906969, + 0.19371522590517998, + 0.07350209727883339, + 0.19641463086009026, + 0.08351822197437286, + 1.3886246010661125, + 1.4096281081438065, + 0.8321629855781794, + 0.5491382069885731, + 0.6455216221511364, + 1.0542227979749441, + 0.5045669488608837, + 0.9861478209495544, + 0.4652871657162905, + 0.597605012357235, + 0.025647150352597237, + 0.2241181582212448, + 0.73783028870821, + 4.0407280549407005, + 0.9917452083900571, + 0.1453365832567215, + 0.2368803545832634, + 0.035286128520965576, + 0.0, + 0.37336285784840584, + 0.8221718594431877, + 0.6540024057030678, + 0.18965303525328636, + 0.2933900076895952, + 0.5278158076107502, + 0.9079059129580855, + 0.379931865260005, + 0.18974311277270317, + 0.40488307923078537, + 1.5734551008790731, + 0.9450068734586239, + 1.0539868641644716, + 0.5379583463072777, + 0.5920358821749687, + 0.7996091395616531, + 1.286563541740179, + 1.5136845745146275, + 0.10785119608044624, + 1.7245451007038355, + 1.231638077646494, + 0.4847807474434376, + 0.34510741010308266, + 1.0238384883850813, + 0.5155056957155466, + 3.5382123216986656, + 0.10730809345841408, + 0.1895631831139326 + ], + "unique_experts": 63, + "load_cv": 0.6705385255035886, + "normalized_load_entropy": 0.9470658953807266, + "max_load_share": 0.0471976401179941 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "fd355cbd76775196227d594676768d0ed9e1f7b00932e0529e35ff2ca9067c48", + "route_weight_sha256": "ebb23289f39b0dc84799146d369016180c78c043840bac8c8e2436934d25902e", + "loads": [ + 18, + 12, + 18, + 6, + 14, + 6, + 9, + 15, + 15, + 6, + 25, + 10, + 20, + 9, + 5, + 10, + 3, + 18, + 22, + 24, + 8, + 12, + 15, + 11, + 12, + 12, + 19, + 6, + 9, + 9, + 34, + 22, + 4, + 5, + 2, + 11, + 7, + 12, + 9, + 6, + 7, + 11, + 20, + 3, + 4, + 10, + 20, + 12, + 37, + 10, + 9, + 19, + 28, + 29, + 7, + 21, + 10, + 4, + 10, + 12, + 12, + 32, + 7, + 4 + ], + "weighted_loads": [ + 0.7727402560412884, + 1.102100103162229, + 1.2455599699169397, + 0.6742513030767441, + 0.5575823169201612, + 0.3717287816107273, + 0.607901506125927, + 2.1897958256304264, + 0.8007307834923267, + 0.5836441479623318, + 1.7850069664418697, + 0.43328792601823807, + 1.4328871667385101, + 0.4813134968280792, + 0.19986893609166145, + 0.39615678787231445, + 0.09678754396736622, + 1.5425706394016743, + 1.4950079545378685, + 1.4116019774228334, + 0.5491382069885731, + 1.0355032542720437, + 1.0542227979749441, + 0.5496938489377499, + 0.9861478209495544, + 0.5014310646802187, + 0.9681195616722107, + 0.49840432219207287, + 0.3202566560357809, + 0.73783028870821, + 4.200451001524925, + 0.9917452083900571, + 0.16818509623408318, + 0.2368803545832634, + 0.08416429907083511, + 0.6350622233003378, + 0.37336285784840584, + 0.8221718594431877, + 0.6540024057030678, + 0.2295614778995514, + 0.2933900076895952, + 0.5278158076107502, + 1.145390204153955, + 0.379931865260005, + 0.18974311277270317, + 0.40488307923078537, + 1.5734551008790731, + 0.9450068734586239, + 1.7565844859927893, + 0.7853118255734444, + 0.5920358821749687, + 1.1756592392921448, + 1.915836676955223, + 1.5266959462314844, + 0.2358000660315156, + 2.120456440374255, + 1.2726509496569633, + 0.4847807474434376, + 0.40168206207454205, + 1.2301568146795034, + 0.5155056957155466, + 3.6639786921441555, + 0.2861597202718258, + 0.1895631831139326 + ], + "unique_experts": 64, + "load_cv": 0.6121175192392103, + "normalized_load_entropy": 0.9580692564616076, + "max_load_share": 0.04468599033816425 + } + }, + "s1_period": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "bb24992034283b4056e56ea697d3710e9fc984f9e12c2fa629aa5fa1af669aed", + "route_weight_sha256": "852389932ff8f3ef2029a544d71ca1fa5889df56c554cb8621d4d5dd746912c3", + "loads": [ + 18, + 12, + 17, + 7, + 8, + 11, + 7, + 13, + 11, + 6, + 19, + 9, + 14, + 4, + 1, + 3, + 4, + 14, + 18, + 28, + 8, + 6, + 16, + 11, + 12, + 11, + 10, + 0, + 6, + 10, + 31, + 19, + 2, + 3, + 1, + 0, + 7, + 13, + 9, + 1, + 4, + 12, + 16, + 3, + 4, + 7, + 16, + 12, + 22, + 8, + 9, + 13, + 18, + 30, + 3, + 16, + 10, + 6, + 10, + 7, + 12, + 33, + 3, + 4 + ], + "weighted_loads": [ + 0.7826808709651232, + 1.107405537739396, + 1.2146985288709402, + 0.7227014526724815, + 0.35791920125484467, + 0.5595651417970657, + 0.34992849081754684, + 2.026542814448476, + 0.5533712804317474, + 0.5746583826839924, + 1.491788025945425, + 0.4034540355205536, + 1.1957901939749718, + 0.17367584630846977, + 0.03532404825091362, + 0.12874500267207623, + 0.1623917780816555, + 1.3697662819176912, + 1.3134152553975582, + 1.0912055559456348, + 0.5334936007857323, + 0.5948781110346317, + 1.054789075627923, + 0.628183776512742, + 0.982996266335249, + 0.4624491557478905, + 0.5331623777747154, + 0.0, + 0.2255171686410904, + 0.7513921819627285, + 3.716106627136469, + 0.8039356023073196, + 0.09538566693663597, + 0.17101228795945644, + 0.03541649505496025, + 0.0, + 0.3868064135313034, + 0.8627918809652328, + 0.6728960946202278, + 0.03298738971352577, + 0.16405373811721802, + 0.5477710328996181, + 0.9099141089245677, + 0.4421357102692127, + 0.17664671689271927, + 0.2528562005609274, + 1.4151024147868156, + 0.8947110958397388, + 0.977677034214139, + 0.5212689265608788, + 0.59331632591784, + 0.8546905778348446, + 1.2582514937967062, + 1.584622859954834, + 0.11118392273783684, + 1.694509258493781, + 1.2911084741353989, + 0.49362785927951336, + 0.4057484529912472, + 0.9356211572885513, + 0.5275313854217529, + 3.7291129771620035, + 0.11825988441705704, + 0.2195402756333351 + ], + "unique_experts": 62, + "load_cv": 0.6982058486868735, + "normalized_load_entropy": 0.9414613369067674, + "max_load_share": 0.048672566371681415 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "eab2c94933bed356eb7b7ae6182a13b6dc199c5575960d4d205b55e54243b84f", + "route_weight_sha256": "4842bd006c27b0b708558302495546155499e316a8c0713642ab0d9e43294eba", + "loads": [ + 27, + 13, + 19, + 7, + 9, + 12, + 12, + 14, + 14, + 9, + 27, + 9, + 20, + 14, + 8, + 6, + 6, + 19, + 21, + 34, + 9, + 14, + 17, + 17, + 13, + 13, + 18, + 8, + 8, + 11, + 36, + 19, + 3, + 7, + 1, + 20, + 8, + 14, + 10, + 2, + 5, + 14, + 27, + 3, + 6, + 8, + 16, + 12, + 35, + 12, + 10, + 24, + 28, + 31, + 16, + 26, + 14, + 6, + 11, + 13, + 13, + 36, + 5, + 5 + ], + "weighted_loads": [ + 1.3246138989925385, + 1.1553788240998983, + 1.9056660570204258, + 0.7227014526724815, + 0.4021199122071266, + 0.5749642541632056, + 0.5569762885570526, + 2.108707593753934, + 0.71269316598773, + 0.7510217856615782, + 1.9262119121849537, + 0.4034540355205536, + 1.5291911996901035, + 0.7078243792057037, + 0.3274019956588745, + 0.25390094332396984, + 0.20691022276878357, + 1.5728490855544806, + 1.4091342389583588, + 1.7882702350616455, + 0.581797868013382, + 1.081992314197123, + 1.0848970711231232, + 1.1733813174068928, + 1.0192014798521996, + 0.5398114304989576, + 0.8268307819962502, + 0.7804790958762169, + 0.25661664083600044, + 0.8004896156489849, + 3.9569693077355623, + 0.8039356023073196, + 0.11810911260545254, + 0.7665640916675329, + 0.03541649505496025, + 1.0569332018494606, + 0.45766881853342056, + 0.903598140925169, + 0.7248140722513199, + 0.06262165307998657, + 0.19526942446827888, + 0.67252391949296, + 1.4779542675241828, + 0.4421357102692127, + 0.2747622951865196, + 0.31065179593861103, + 1.4151024147868156, + 0.8947110958397388, + 1.9229823183268309, + 1.5737053863704205, + 0.6470921356230974, + 1.631730068475008, + 1.853660823777318, + 1.597634231671691, + 0.8466546954587102, + 2.3712427262216806, + 1.452664539217949, + 0.49362785927951336, + 0.4307164940983057, + 1.2383564580231905, + 0.5499198324978352, + 3.878966147080064, + 0.19020681828260422, + 0.3062220886349678 + ], + "unique_experts": 64, + "load_cv": 0.5982019872801138, + "normalized_load_entropy": 0.9583962295468439, + "max_load_share": 0.03896103896103896 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 113, + "ordered_topk_exact_tokens": 66, + "set_exact_tokens": 79, + "mean_set_jaccard": 0.9087652760219133, + "mean_token_weighted_tv": 0.0187729542737052, + "aggregate_load_tv": 0.030973451327433628 + }, + "system_bos": { + "tokens": 113, + "ordered_topk_exact_tokens": 52, + "set_exact_tokens": 70, + "mean_set_jaccard": 0.8855878634639697, + "mean_token_weighted_tv": 0.0239225646637512, + "aggregate_load_tv": 0.038348082595870206 + }, + "system_x": { + "tokens": 113, + "ordered_topk_exact_tokens": 41, + "set_exact_tokens": 63, + "mean_set_jaccard": 0.8489254108723135, + "mean_token_weighted_tv": 0.034562589823210664, + "aggregate_load_tv": 0.05457227138643068 + }, + "system_period": { + "tokens": 113, + "ordered_topk_exact_tokens": 41, + "set_exact_tokens": 64, + "mean_set_jaccard": 0.8560893383902234, + "mean_token_weighted_tv": 0.03425914697777645, + "aggregate_load_tv": 0.05457227138643068 + }, + "bos_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 63, + "set_exact_tokens": 82, + "mean_set_jaccard": 0.9106616097766541, + "mean_token_weighted_tv": 0.022218868111680567, + "aggregate_load_tv": 0.03687315634218289 + }, + "bos_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 44, + "set_exact_tokens": 68, + "mean_set_jaccard": 0.8733670459334177, + "mean_token_weighted_tv": 0.027760981936502244, + "aggregate_load_tv": 0.038348082595870206 + }, + "x_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 47, + "set_exact_tokens": 67, + "mean_set_jaccard": 0.8727349346818374, + "mean_token_weighted_tv": 0.027413471424704895, + "aggregate_load_tv": 0.05014749262536873 + }, + "x_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 43, + "set_exact_tokens": 60, + "mean_set_jaccard": 0.8459755583649389, + "mean_token_weighted_tv": 0.0358596285969942, + "aggregate_load_tv": 0.0575221238938053 + }, + "period_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 45, + "set_exact_tokens": 69, + "mean_set_jaccard": 0.8789296249473242, + "mean_token_weighted_tv": 0.026905767796808377, + "aggregate_load_tv": 0.038348082595870206 + }, + "period_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 50, + "set_exact_tokens": 67, + "mean_set_jaccard": 0.8603034134007586, + "mean_token_weighted_tv": 0.03459210056745637, + "aggregate_load_tv": 0.05752212389380531 + } + } + }, + "layer_22": { + "layer": 22, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "7f2c13b0afde1acd2db9b5d38f79f6efef083130b99752a6602d45d9608f9ddc", + "route_weight_sha256": "b19876dbf371fc4a07122b679a326afe6468b7920618d5e72da263e3af04a71e", + "loads": [ + 23, + 17, + 9, + 12, + 4, + 7, + 7, + 6, + 32, + 7, + 24, + 16, + 21, + 9, + 4, + 11, + 18, + 9, + 11, + 11, + 13, + 6, + 5, + 9, + 2, + 1, + 3, + 7, + 8, + 4, + 6, + 8, + 11, + 20, + 9, + 6, + 14, + 11, + 10, + 6, + 4, + 8, + 14, + 5, + 41, + 9, + 7, + 7, + 0, + 12, + 14, + 7, + 4, + 10, + 3, + 10, + 11, + 22, + 9, + 15, + 5, + 29, + 4, + 11 + ], + "weighted_loads": [ + 2.125399261713028, + 0.6463698130100965, + 1.468717560172081, + 1.454757310450077, + 0.22029630467295647, + 0.2409614846110344, + 1.0276880767196417, + 0.2703419029712677, + 2.1631792187690735, + 0.43930509500205517, + 1.510054673999548, + 2.254868349060416, + 1.3145237118005753, + 0.4798885900527239, + 0.13597587123513222, + 0.4109351821243763, + 1.0871257074177265, + 0.8954645432531834, + 0.691674280911684, + 0.46015864238142967, + 0.7843165677040815, + 0.3502910491079092, + 0.17456350475549698, + 0.6464731507003307, + 0.11768829822540283, + 0.0330805741250515, + 0.12267431244254112, + 0.4404536671936512, + 0.3816222921013832, + 0.13637636974453926, + 0.23088889382779598, + 0.5996175035834312, + 0.49923528358340263, + 1.9159542620182037, + 0.7132026813924313, + 0.2832205183804035, + 1.0548827275633812, + 0.4659088924527168, + 0.8276583850383759, + 0.8332082964479923, + 0.14972471445798874, + 0.637323934584856, + 1.0123625881969929, + 0.22340548411011696, + 6.0948844365775585, + 0.4234863631427288, + 0.8851424306631088, + 0.4714876860380173, + 0.0, + 1.9213518612086773, + 0.47869694977998734, + 0.43038225546479225, + 0.11205075494945049, + 0.49212269857525826, + 0.08222251012921333, + 0.5495365839451551, + 0.8682771660387516, + 1.4893805384635925, + 0.46743451803922653, + 1.0438464898616076, + 0.4283268302679062, + 2.078779384493828, + 0.12203075736761093, + 0.4940088987350464 + ], + "unique_experts": 63, + "load_cv": 0.7035691972371629, + "normalized_load_entropy": 0.9481045150005163, + "max_load_share": 0.06047197640117994 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "07673773141e7bceb02170e90b5e6b23800d4797be5fc3d492aa6b6ac9ec2dfe", + "route_weight_sha256": "f4837c787d3df8149f2723d40448d65f8946d1e72ba6aca7cf8ddf98b07ae788", + "loads": [ + 27, + 18, + 11, + 21, + 4, + 9, + 11, + 7, + 45, + 12, + 24, + 18, + 21, + 9, + 10, + 11, + 18, + 10, + 11, + 11, + 13, + 13, + 6, + 10, + 2, + 3, + 3, + 11, + 8, + 4, + 6, + 8, + 13, + 27, + 11, + 10, + 14, + 13, + 10, + 6, + 8, + 9, + 18, + 5, + 43, + 11, + 8, + 7, + 3, + 14, + 17, + 7, + 5, + 12, + 3, + 24, + 14, + 25, + 10, + 15, + 13, + 37, + 4, + 17 + ], + "weighted_loads": [ + 2.302129856310785, + 0.6963264215737581, + 1.5494127720594406, + 3.326844923198223, + 0.22029630467295647, + 0.31344569101929665, + 1.2522597899660468, + 0.32277555018663406, + 3.347036262974143, + 0.6346625350415707, + 1.510054673999548, + 2.284192966297269, + 1.3145237118005753, + 0.4798885900527239, + 0.9050452332012355, + 0.4109351821243763, + 1.0871257074177265, + 0.9211988262832165, + 0.691674280911684, + 0.46015864238142967, + 0.7843165677040815, + 0.9482381213456392, + 0.20370755344629288, + 0.7089930586516857, + 0.11768829822540283, + 0.09729443490505219, + 0.12267431244254112, + 0.6040000077337027, + 0.3816222921013832, + 0.13637636974453926, + 0.23088889382779598, + 0.5996175035834312, + 0.5412293281406164, + 2.170619949698448, + 0.8204241991043091, + 0.4412112347781658, + 1.0548827275633812, + 0.5335799772292376, + 0.8276583850383759, + 0.8332082964479923, + 0.35761570557951927, + 0.7139199711382389, + 1.2776814438402653, + 0.22340548411011696, + 6.201179191470146, + 0.4925796873867512, + 0.9268524646759033, + 0.4714876860380173, + 0.14382335171103477, + 2.1102175898849964, + 0.6409892365336418, + 0.43038225546479225, + 0.14318331331014633, + 0.6077563688158989, + 0.08222251012921333, + 1.6791351474821568, + 0.9871603604406118, + 1.5945649817585945, + 0.5029229260981083, + 1.0438464898616076, + 1.53260712698102, + 2.3647091574966908, + 0.12203075736761093, + 0.7269982732832432 + ], + "unique_experts": 64, + "load_cv": 0.6782409124883682, + "normalized_load_entropy": 0.9525431268663964, + "max_load_share": 0.05434782608695652 + } + }, + "s1_eos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "33ae000686ddfbcde1e0ffa3d9e0d2f4d85354482ba16e8a3599e9e6916a2c2f", + "route_weight_sha256": "5a44283ec14e14a5382c6b5d0441d3383787bd26fc927c0191d4dd330b0070f1", + "loads": [ + 25, + 16, + 10, + 13, + 4, + 6, + 7, + 8, + 37, + 7, + 25, + 16, + 21, + 8, + 3, + 11, + 18, + 9, + 10, + 12, + 13, + 6, + 4, + 9, + 3, + 1, + 3, + 7, + 8, + 3, + 8, + 7, + 11, + 20, + 8, + 6, + 14, + 8, + 11, + 7, + 5, + 8, + 14, + 6, + 41, + 8, + 6, + 7, + 0, + 11, + 12, + 7, + 2, + 8, + 4, + 10, + 12, + 22, + 10, + 14, + 5, + 27, + 4, + 12 + ], + "weighted_loads": [ + 2.1691674180328846, + 0.5968665406107903, + 1.5336510073393583, + 1.4838433703407645, + 0.21247016079723835, + 0.20561417192220688, + 1.02564219199121, + 0.33275884203612804, + 2.235276399180293, + 0.4571441784501076, + 1.5110555402934551, + 2.267310969531536, + 1.3213303312659264, + 0.4561545364558697, + 0.12529315799474716, + 0.4035351313650608, + 1.0981014259159565, + 0.8860106877982616, + 0.6430290006101131, + 0.5186988897621632, + 0.7740597799420357, + 0.34924725256860256, + 0.13984757848083973, + 0.600837554782629, + 0.13545944914221764, + 0.033796437084674835, + 0.12643931061029434, + 0.4341496117413044, + 0.3975252825766802, + 0.09923088550567627, + 0.30266488529741764, + 0.5579613484442234, + 0.5057925172150135, + 1.9160307087004185, + 0.7183259315788746, + 0.26621267944574356, + 1.035615250468254, + 0.3662826642394066, + 0.860507857054472, + 0.8685357831418514, + 0.18517150729894638, + 0.6427539326250553, + 0.9861229732632637, + 0.25782094709575176, + 6.0347430016845465, + 0.3800390623509884, + 0.8466948643326759, + 0.47353947907686234, + 0.0, + 1.8788146264851093, + 0.4259342644363642, + 0.4231758303940296, + 0.059853533282876015, + 0.4322327896952629, + 0.11945709586143494, + 0.545558562502265, + 0.8861597720533609, + 1.5178405418992043, + 0.5074967537075281, + 1.0157261863350868, + 0.43322447314858437, + 1.9894524868577719, + 0.13547633402049541, + 0.532260574400425 + ], + "unique_experts": 63, + "load_cv": 0.7282671480096987, + "normalized_load_entropy": 0.9454672955249289, + "max_load_share": 0.06047197640117994 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "2c4520d347ec64cfce4a641c1d9af1c5a797b7c7da53929779871b76dfd8ad4c", + "route_weight_sha256": "4620bbc14342414db31063f55140f7c28f2ccc14f204357f2d4b94a6046efd02", + "loads": [ + 27, + 21, + 10, + 24, + 4, + 8, + 13, + 9, + 57, + 16, + 25, + 21, + 24, + 8, + 8, + 15, + 21, + 11, + 11, + 12, + 14, + 18, + 5, + 10, + 3, + 2, + 3, + 11, + 9, + 3, + 9, + 7, + 13, + 29, + 16, + 14, + 16, + 10, + 11, + 8, + 16, + 10, + 18, + 8, + 43, + 10, + 7, + 9, + 3, + 14, + 22, + 10, + 7, + 11, + 4, + 30, + 16, + 24, + 13, + 14, + 19, + 37, + 6, + 17 + ], + "weighted_loads": [ + 2.2908374881371856, + 1.0528149716556072, + 1.5336510073393583, + 3.6218181839212775, + 0.21247016079723835, + 0.2670662850141525, + 1.3363820184022188, + 0.3758385609835386, + 3.928538367152214, + 0.9221043158322573, + 1.5110555402934551, + 2.566453205421567, + 1.4610535614192486, + 0.4561545364558697, + 0.7979649659246206, + 0.6385427713394165, + 1.2441203780472279, + 0.9359273687005043, + 0.6829872727394104, + 0.5186988897621632, + 0.8232165053486824, + 1.3898310493677855, + 0.1827604677528143, + 0.661799967288971, + 0.13545944914221764, + 0.05929065681993961, + 0.12643931061029434, + 0.5901958271861076, + 0.4810879472643137, + 0.09923088550567627, + 0.36090523190796375, + 0.5579613484442234, + 0.5602418445050716, + 2.2413402814418077, + 1.0897841155529022, + 0.6202236674726009, + 1.126382753252983, + 0.4381201006472111, + 0.860507857054472, + 0.9079729951918125, + 0.8721690028905869, + 0.7295013405382633, + 1.297821570187807, + 0.393287917599082, + 6.109826574102044, + 0.4602787308394909, + 0.8811094351112843, + 0.5408977158367634, + 0.14514778554439545, + 2.3910026773810387, + 0.9149768836796284, + 0.6344785988330841, + 0.609351733699441, + 0.571904867887497, + 0.11945709586143494, + 2.2439712989144027, + 1.1118255089968443, + 1.5809563733637333, + 0.6106103658676147, + 1.0157261863350868, + 2.3387168273329735, + 2.413326980546117, + 0.20446200482547283, + 0.7647480554878712 + ], + "unique_experts": 64, + "load_cv": 0.6775272108046907, + "normalized_load_entropy": 0.952505957582771, + "max_load_share": 0.06168831168831169 + } + }, + "s0_bos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "b4c3ccacfc96cfd5eb4ae9b92311a029e64f5ac425f757541e7eec7790b1836f", + "route_weight_sha256": "f016e77cf416046720181ccc024c981dad7ec6bb42c3e8f46be072680ff1004e", + "loads": [ + 24, + 14, + 9, + 12, + 3, + 6, + 7, + 7, + 31, + 6, + 26, + 16, + 21, + 8, + 5, + 11, + 19, + 9, + 12, + 9, + 12, + 6, + 3, + 8, + 2, + 0, + 3, + 8, + 7, + 4, + 6, + 8, + 14, + 20, + 9, + 6, + 14, + 10, + 10, + 7, + 1, + 8, + 14, + 6, + 44, + 9, + 10, + 8, + 0, + 10, + 13, + 8, + 1, + 9, + 5, + 8, + 11, + 22, + 12, + 16, + 5, + 31, + 5, + 10 + ], + "weighted_loads": [ + 2.0768576096743345, + 0.5152727849781513, + 1.4796573612838984, + 1.4448043163865805, + 0.1831361185759306, + 0.21799442172050476, + 1.0452465638518333, + 0.31343272142112255, + 2.039202218875289, + 0.4245700128376484, + 1.542944671586156, + 2.1595106571912766, + 1.3278202190995216, + 0.46345869451761246, + 0.18280582875013351, + 0.4079754650592804, + 1.1318904906511307, + 0.9083348475396633, + 0.7255637608468533, + 0.390826940536499, + 0.7431978601962328, + 0.3226429522037506, + 0.09081321768462658, + 0.616190243512392, + 0.09515548124909401, + 0.0, + 0.12534744292497635, + 0.4582000896334648, + 0.34000073559582233, + 0.13770632818341255, + 0.24344263412058353, + 0.6006006319075823, + 0.6133643761277199, + 1.9696737192571163, + 0.7342096548527479, + 0.27229846082627773, + 1.0606747046113014, + 0.443075442686677, + 0.8323044143617153, + 0.8813495859503746, + 0.04261494427919388, + 0.619917381554842, + 1.003560595214367, + 0.2662094570696354, + 6.276626341044903, + 0.4215903412550688, + 1.0128853768110275, + 0.5207822397351265, + 0.0, + 1.7966118678450584, + 0.44836328364908695, + 0.46297242119908333, + 0.05649228021502495, + 0.48364894837141037, + 0.14575008675456047, + 0.4822809360921383, + 0.8610377833247185, + 1.4894057717174292, + 0.5953579805791378, + 1.0810059569776058, + 0.38432805240154266, + 2.3196329586207867, + 0.15627875179052353, + 0.45287853851914406 + ], + "unique_experts": 62, + "load_cv": 0.7420916696194871, + "normalized_load_entropy": 0.9415981848638463, + "max_load_share": 0.06489675516224189 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "cd449cb2af2be88790784e66cd3ba124da9d152f9e6928f9399f6cf8420d9372", + "route_weight_sha256": "678ec6d1354cd1dbb15fa864f7875e1a8902552894e68def6282d33b7505eacb", + "loads": [ + 28, + 14, + 11, + 20, + 3, + 7, + 11, + 8, + 43, + 11, + 27, + 18, + 21, + 8, + 8, + 12, + 19, + 10, + 12, + 9, + 12, + 13, + 4, + 9, + 3, + 2, + 3, + 13, + 7, + 4, + 6, + 8, + 15, + 27, + 11, + 11, + 14, + 13, + 10, + 7, + 5, + 9, + 19, + 6, + 46, + 10, + 11, + 8, + 4, + 12, + 15, + 8, + 1, + 11, + 5, + 21, + 14, + 26, + 13, + 16, + 14, + 39, + 5, + 18 + ], + "weighted_loads": [ + 2.2535882042720914, + 0.5152727849781513, + 1.560352573171258, + 2.4255435671657324, + 0.1831361185759306, + 0.23058537766337395, + 1.2871312983334064, + 1.239900914952159, + 3.181857578456402, + 0.6199274528771639, + 1.559725858271122, + 2.2036932706832886, + 1.3278202190995216, + 0.46345869451761246, + 0.8626250848174095, + 0.4511525146663189, + 1.1318904906511307, + 0.9340691305696964, + 0.7255637608468533, + 0.390826940536499, + 0.7431978601962328, + 0.9287151955068111, + 0.11995726637542248, + 0.6810137741267681, + 0.0990415511187166, + 0.06421386078000069, + 0.12534744292497635, + 0.6538243088871241, + 0.34000073559582233, + 0.13770632818341255, + 0.24344263412058353, + 0.6006006319075823, + 0.6488642022013664, + 2.2255050241947174, + 0.8380906786769629, + 0.5034336652606726, + 1.0606747046113014, + 0.5638749673962593, + 0.8323044143617153, + 0.8813495859503746, + 0.25249190628528595, + 0.6947006396949291, + 1.2039972757920623, + 0.2662094570696354, + 6.3951158337295055, + 0.45356845296919346, + 1.054595410823822, + 0.5207822397351265, + 0.24763204529881477, + 1.926893389550969, + 0.568482855334878, + 0.46297242119908333, + 0.05649228021502495, + 0.5936694405972958, + 0.14575008675456047, + 1.5899160588160157, + 0.9799209777265787, + 1.6014137999154627, + 0.6279277913272381, + 1.0810059569776058, + 1.579844567924738, + 2.6055627316236496, + 0.15627875179052353, + 0.7837051562964916 + ], + "unique_experts": 64, + "load_cv": 0.6989822335397847, + "normalized_load_entropy": 0.9494803233325129, + "max_load_share": 0.05555555555555555 + } + }, + "s1_bos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "5e47d393891319b4f645d8438034d684645b3024dd01a100d36828b5308778ef", + "route_weight_sha256": "2054500609da13929f09cfaaa0c18202f076da62e961d64aec2053f78cde1ebb", + "loads": [ + 23, + 12, + 9, + 12, + 3, + 6, + 6, + 7, + 32, + 7, + 24, + 16, + 21, + 9, + 4, + 10, + 19, + 9, + 10, + 9, + 12, + 6, + 4, + 8, + 2, + 1, + 4, + 9, + 8, + 2, + 7, + 7, + 14, + 19, + 9, + 7, + 14, + 9, + 11, + 8, + 2, + 8, + 13, + 6, + 44, + 10, + 8, + 8, + 0, + 11, + 10, + 9, + 1, + 11, + 7, + 9, + 12, + 23, + 12, + 16, + 5, + 28, + 4, + 12 + ], + "weighted_loads": [ + 2.0602710116654634, + 0.43175170570611954, + 1.5333829578012228, + 1.4556519342586398, + 0.17697983793914318, + 0.20741279050707817, + 0.98212069272995, + 0.3053679410368204, + 2.0296124555170536, + 0.48080219328403473, + 1.5116934943944216, + 2.1286025680601597, + 1.3348224349319935, + 0.46980202943086624, + 0.1465547550469637, + 0.35298522748053074, + 1.1427065916359425, + 0.9004936963319778, + 0.6622462831437588, + 0.40125085040926933, + 0.7268695887178183, + 0.3268041219562292, + 0.13665458746254444, + 0.5939875096082687, + 0.0943558868020773, + 0.034277111291885376, + 0.15100188180804253, + 0.47473436780273914, + 0.380316773429513, + 0.07731515541672707, + 0.2597018461674452, + 0.563637163490057, + 0.6057127360254526, + 1.806162403896451, + 0.7982051353901625, + 0.3039847929030657, + 1.0693172477185726, + 0.4000669773668051, + 0.8731513321399689, + 0.9026289079338312, + 0.07869809493422508, + 0.6229301430284977, + 0.9491547904908657, + 0.2753099575638771, + 6.275468165054917, + 0.4655618015676737, + 0.9268964901566505, + 0.5302815437316895, + 0.0, + 1.8535536639392376, + 0.36100627295672894, + 0.5118120387196541, + 0.04169423133134842, + 0.5644792020320892, + 0.22272672317922115, + 0.4896993227303028, + 0.9251561164855957, + 1.5916135050356388, + 0.5755341574549675, + 1.0823469907045364, + 0.4161715395748615, + 2.146503895521164, + 0.1376822330057621, + 0.5379106141626835 + ], + "unique_experts": 63, + "load_cv": 0.7198063240138198, + "normalized_load_entropy": 0.9457075566201073, + "max_load_share": 0.06489675516224189 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "33c6dbbbb9581204e489aa226551e2851166c1ce50b1d4b7652cf6b18a29aeb6", + "route_weight_sha256": "1eb0837f2a5f0bb44bc99560aa9de84c59782d5df9e0686a64364d1af36c6317", + "loads": [ + 25, + 17, + 9, + 22, + 3, + 7, + 11, + 8, + 52, + 16, + 24, + 22, + 24, + 9, + 8, + 15, + 22, + 11, + 11, + 9, + 13, + 18, + 5, + 9, + 2, + 2, + 4, + 12, + 9, + 2, + 8, + 7, + 16, + 28, + 17, + 16, + 16, + 12, + 11, + 9, + 13, + 10, + 18, + 8, + 46, + 10, + 9, + 10, + 5, + 14, + 19, + 12, + 6, + 15, + 7, + 29, + 16, + 26, + 13, + 16, + 20, + 38, + 5, + 18 + ], + "weighted_loads": [ + 2.1819410817697644, + 0.8877001367509365, + 1.5333829578012228, + 2.6989758713170886, + 0.17697983793914318, + 0.22000374644994736, + 1.2847253270447254, + 0.348447659984231, + 3.7107770275324583, + 0.9457623306661844, + 1.5116934943944216, + 2.492487460374832, + 1.4745456650853157, + 0.46980202943086624, + 0.8754787594079971, + 0.6292241457849741, + 1.2887255437672138, + 0.9504103772342205, + 0.702204555273056, + 0.40125085040926933, + 0.776026314124465, + 1.397438993677497, + 0.179567476734519, + 0.6562195308506489, + 0.0943558868020773, + 0.059771331027150154, + 0.15100188180804253, + 0.5967682767659426, + 0.4638794381171465, + 0.07731515541672707, + 0.3053428400307894, + 0.563637163490057, + 0.6959924716502428, + 2.1314719766378403, + 1.1685559544712305, + 0.711654556915164, + 1.1600847505033016, + 0.5152451265603304, + 0.8731513321399689, + 0.9420661199837923, + 0.7740847878158092, + 0.7213319316506386, + 1.2715342044830322, + 0.41077692806720734, + 6.367583701387048, + 0.4655618015676737, + 0.9613110609352589, + 0.5976397804915905, + 0.30726853013038635, + 2.3758253641426563, + 0.8068392798304558, + 0.7231148071587086, + 0.5911924317479134, + 0.7407002672553062, + 0.22272672317922115, + 2.2106671994552016, + 1.150821853429079, + 1.696744680404663, + 0.6232994012534618, + 1.0823469907045364, + 2.463726118206978, + 2.570378389209509, + 0.16650033369660378, + 0.8378045931458473 + ], + "unique_experts": 64, + "load_cv": 0.6586776048287512, + "normalized_load_entropy": 0.9541994478506421, + "max_load_share": 0.05627705627705628 + } + }, + "s0_x": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "fec1efe4c0a2a32409f6daa170d89dd63064f55ad8403dccca8b006114a65a35", + "route_weight_sha256": "d4c77344e7739fe84ee38daef98da0bff970d33db05d4f4d30e98c9b9a8a4a94", + "loads": [ + 24, + 13, + 10, + 12, + 3, + 7, + 6, + 7, + 30, + 6, + 24, + 16, + 21, + 8, + 4, + 9, + 18, + 10, + 11, + 9, + 12, + 6, + 4, + 8, + 2, + 1, + 4, + 9, + 7, + 2, + 7, + 8, + 13, + 20, + 8, + 8, + 14, + 7, + 10, + 6, + 3, + 8, + 14, + 7, + 44, + 8, + 8, + 9, + 1, + 11, + 13, + 9, + 1, + 10, + 6, + 11, + 11, + 21, + 11, + 16, + 5, + 31, + 5, + 11 + ], + "weighted_loads": [ + 2.0726051311939955, + 0.517648858949542, + 1.489731289446354, + 1.403750577941537, + 0.16200952976942062, + 0.24769942089915276, + 1.0245118588209152, + 0.315604817122221, + 2.1013059113174677, + 0.4322572611272335, + 1.4836170077323914, + 2.2330546770244837, + 1.3294119611382484, + 0.47726231813430786, + 0.13540924340486526, + 0.31570360623300076, + 1.0852502323687077, + 0.9401833862066269, + 0.6856849230825901, + 0.37833721935749054, + 0.7334555815905333, + 0.3248910326510668, + 0.13954950869083405, + 0.6365412324666977, + 0.09496859833598137, + 0.0365154966711998, + 0.16138275153934956, + 0.4930658470839262, + 0.3325343281030655, + 0.07675191760063171, + 0.2576957270503044, + 0.5908057931810617, + 0.5606579780578613, + 1.9777796436101198, + 0.6905197724699974, + 0.32932292111217976, + 1.0750507302582264, + 0.3180915042757988, + 0.8462690077722073, + 0.8357547298073769, + 0.12064855545759201, + 0.6224446222186089, + 0.9994448386132717, + 0.2982311248779297, + 6.312804980203509, + 0.38159093260765076, + 0.9448599368333817, + 0.5325681753456593, + 0.040556371212005615, + 1.844301626086235, + 0.45323263108730316, + 0.49373751506209373, + 0.02233874797821045, + 0.491841621696949, + 0.18388048000633717, + 0.5924828685820103, + 0.853124026209116, + 1.4802622310817242, + 0.5391479022800922, + 1.091165842488408, + 0.39240384846925735, + 2.3811833262443542, + 0.16897097043693066, + 0.4945768043398857 + ], + "unique_experts": 64, + "load_cv": 0.719225825195413, + "normalized_load_entropy": 0.9470590249132207, + "max_load_share": 0.06489675516224189 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "2a0c182fd35d7a12fc8b80dc77a85ca940a794e4ab134b07ea7765bac65235c2", + "route_weight_sha256": "5fd48ee9d12ebb3343b89946a2dd9ef2e1c9dc1f890cc98a9a052a55ddf212e5", + "loads": [ + 28, + 14, + 12, + 21, + 3, + 8, + 10, + 7, + 43, + 12, + 24, + 17, + 21, + 8, + 8, + 9, + 18, + 12, + 11, + 9, + 12, + 14, + 5, + 9, + 2, + 3, + 4, + 12, + 7, + 2, + 8, + 8, + 14, + 29, + 10, + 12, + 14, + 8, + 10, + 6, + 7, + 9, + 18, + 7, + 46, + 10, + 9, + 9, + 3, + 13, + 17, + 9, + 2, + 12, + 6, + 26, + 14, + 23, + 12, + 16, + 13, + 40, + 5, + 18 + ], + "weighted_loads": [ + 2.2493357257917523, + 0.5594485457986593, + 1.5704265013337135, + 2.4677005652338266, + 0.16200952976942062, + 0.26029037684202194, + 1.3076760210096836, + 0.315604817122221, + 3.2815739884972572, + 0.6596784461289644, + 1.4836170077323914, + 2.245509719476104, + 1.3294119611382484, + 0.47726231813430786, + 0.7906631976366043, + 0.31570360623300076, + 1.0852502323687077, + 1.0015103109180927, + 0.6856849230825901, + 0.37833721935749054, + 0.7334555815905333, + 0.9958437513560057, + 0.16869355738162994, + 0.6941921226680279, + 0.09496859833598137, + 0.10072935745120049, + 0.16138275153934956, + 0.6106689088046551, + 0.3325343281030655, + 0.07675191760063171, + 0.3018800877034664, + 0.5908057931810617, + 0.5961578041315079, + 2.3236423898488283, + 0.7996593415737152, + 0.4890174549072981, + 1.0750507302582264, + 0.35850078612565994, + 0.8462690077722073, + 0.8357547298073769, + 0.3359998017549515, + 0.7001971378922462, + 1.269109208136797, + 0.2982311248779297, + 6.428896168246865, + 0.448715265840292, + 0.9865699708461761, + 0.5325681753456593, + 0.13671700656414032, + 2.1024152487516403, + 0.6612329855561256, + 0.49373751506209373, + 0.05363057553768158, + 0.5831076689064503, + 0.18388048000633717, + 1.9123042533174157, + 0.9720072206109762, + 1.5367715787142515, + 0.5773385241627693, + 1.091165842488408, + 1.531665463000536, + 2.7215685695409775, + 0.16897097043693066, + 0.7627916298806667 + ], + "unique_experts": 64, + "load_cv": 0.7008494793928951, + "normalized_load_entropy": 0.9498554195920887, + "max_load_share": 0.05555555555555555 + } + }, + "s1_x": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "5856c7b4c2aa3e21260016403f079f1cbd270505d12b4bcbcceb1d384223378f", + "route_weight_sha256": "86656ec8332d234b80d52bede649ef16e2407457e0b1e461f7bdd8b297e54889", + "loads": [ + 25, + 7, + 10, + 12, + 3, + 6, + 6, + 5, + 34, + 5, + 24, + 16, + 22, + 11, + 4, + 7, + 20, + 8, + 10, + 9, + 11, + 6, + 2, + 10, + 3, + 1, + 4, + 8, + 7, + 1, + 8, + 7, + 11, + 18, + 9, + 6, + 14, + 8, + 11, + 8, + 4, + 8, + 12, + 7, + 44, + 7, + 10, + 9, + 0, + 11, + 10, + 9, + 1, + 10, + 7, + 16, + 11, + 23, + 9, + 16, + 5, + 34, + 3, + 15 + ], + "weighted_loads": [ + 2.155078962445259, + 0.2682105489075184, + 1.5310325603932142, + 1.4221312450245023, + 0.18567988090217113, + 0.20649483986198902, + 1.0261062383651733, + 0.22878142073750496, + 2.1034409683197737, + 0.41019435226917267, + 1.4641390349715948, + 2.1342726051807404, + 1.3847238421440125, + 0.5494155623018742, + 0.1386696621775627, + 0.23213055357336998, + 1.1233131773769855, + 0.8615086600184441, + 0.6690894328057766, + 0.37754400819540024, + 0.6759461984038353, + 0.3155802544206381, + 0.07965323328971863, + 0.6753849424421787, + 0.1366813573986292, + 0.04234215244650841, + 0.15036969631910324, + 0.43188816122710705, + 0.35199401527643204, + 0.03983170911669731, + 0.28362030163407326, + 0.5497581772506237, + 0.499587494879961, + 1.7839135639369488, + 0.7537009157240391, + 0.2310304157435894, + 1.0798906832933426, + 0.34024082124233246, + 0.8715222701430321, + 0.9041564241051674, + 0.18647590652108192, + 0.6090709902346134, + 0.8928232043981552, + 0.2956365514546633, + 6.19331144541502, + 0.3548574335873127, + 0.9786258041858673, + 0.544671218842268, + 0.0, + 1.8263345062732697, + 0.33998666144907475, + 0.49461983516812325, + 0.018639838322997093, + 0.5058716218918562, + 0.2560224439948797, + 0.7890438307076693, + 0.8527107574045658, + 1.61200993321836, + 0.43513137847185135, + 1.0867985486984253, + 0.3812962584197521, + 2.5409982427954674, + 0.12764529511332512, + 0.6303748954087496 + ], + "unique_experts": 63, + "load_cv": 0.7682709495999438, + "normalized_load_entropy": 0.9394832865585743, + "max_load_share": 0.06489675516224189 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "969ad110003ebd9d97c2c0174ccd8d6b5292950c8bca68642fb8b226341ba6c3", + "route_weight_sha256": "420df2763909ae9c636cd334abc85091fac3b4d6c4257c028f7ff6a3af0d951f", + "loads": [ + 28, + 12, + 10, + 23, + 3, + 7, + 12, + 7, + 56, + 15, + 24, + 21, + 25, + 11, + 8, + 11, + 23, + 10, + 11, + 9, + 12, + 19, + 3, + 11, + 3, + 2, + 4, + 10, + 8, + 1, + 8, + 7, + 13, + 27, + 17, + 13, + 16, + 9, + 11, + 9, + 16, + 10, + 16, + 9, + 45, + 7, + 11, + 11, + 2, + 14, + 21, + 12, + 6, + 13, + 7, + 39, + 15, + 25, + 11, + 16, + 19, + 46, + 5, + 19 + ], + "weighted_loads": [ + 2.3166766157373786, + 0.7241589799523354, + 1.5310325603932142, + 2.715373885817826, + 0.18567988090217113, + 0.2190857958048582, + 1.3708200193941593, + 0.31690792366862297, + 3.8703608363866806, + 0.9202994164079428, + 1.4641390349715948, + 2.4526851028203964, + 1.5244470722973347, + 0.5494155623018742, + 0.6763283628970385, + 0.4671381935477257, + 1.269332129508257, + 0.9114253409206867, + 0.7090477049350739, + 0.37754400819540024, + 0.725102923810482, + 1.4417666997760534, + 0.12256612256169319, + 0.7379429452121258, + 0.1366813573986292, + 0.06783637218177319, + 0.15036969631910324, + 0.51281245239079, + 0.43555667996406555, + 0.03983170911669731, + 0.28362030163407326, + 0.5497581772506237, + 0.5848558098077774, + 2.109223136678338, + 1.1310572139918804, + 0.5231305658817291, + 1.1706581860780716, + 0.3739784397184849, + 0.8715222701430321, + 0.9435936361551285, + 0.9076438173651695, + 0.680694468319416, + 1.2505807541310787, + 0.4311035219579935, + 6.232752826064825, + 0.3548574335873127, + 1.0130403749644756, + 0.612029455602169, + 0.09518440067768097, + 2.3648726642131805, + 0.8911322206258774, + 0.7059226036071777, + 0.568138038739562, + 0.637535871937871, + 0.2560224439948797, + 2.8448027772828937, + 1.0783764943480492, + 1.6751719620078802, + 0.5356951393187046, + 1.0867985486984253, + 2.310672588646412, + 3.1247082129120827, + 0.19653427600860596, + 0.8169269766658545 + ], + "unique_experts": 64, + "load_cv": 0.7297294108260223, + "normalized_load_entropy": 0.9457225184406989, + "max_load_share": 0.06060606060606061 + } + }, + "s0_period": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "7df761b127862fac65b2f4c16c266f48f30942e7ccc2c1f419f3d5cbed2c1b1b", + "route_weight_sha256": "ddd4c68a1977591355ae93a400c16836232a6768250cdd2061422c4b7c5f304a", + "loads": [ + 24, + 14, + 10, + 12, + 3, + 6, + 6, + 6, + 29, + 5, + 23, + 16, + 21, + 8, + 4, + 9, + 19, + 11, + 11, + 10, + 13, + 7, + 2, + 8, + 2, + 1, + 4, + 10, + 6, + 3, + 6, + 8, + 12, + 21, + 9, + 7, + 14, + 9, + 11, + 7, + 3, + 8, + 12, + 7, + 43, + 8, + 9, + 9, + 1, + 11, + 13, + 8, + 2, + 11, + 6, + 10, + 11, + 21, + 11, + 16, + 5, + 28, + 5, + 13 + ], + "weighted_loads": [ + 2.0884329341351986, + 0.5564757399260998, + 1.4875387959182262, + 1.4170807795599103, + 0.16826225444674492, + 0.22370611503720284, + 1.0047618299722672, + 0.29445173777639866, + 2.040344091132283, + 0.3934998922049999, + 1.4673462212085724, + 2.234721688553691, + 1.3253312893211842, + 0.47292594239115715, + 0.14015944115817547, + 0.32567431777715683, + 1.123115424066782, + 0.9762764871120453, + 0.6881278865039349, + 0.42041658237576485, + 0.778848284855485, + 0.38812728598713875, + 0.074444979429245, + 0.6124199330806732, + 0.0968925766646862, + 0.03864491358399391, + 0.16495171934366226, + 0.5380434896796942, + 0.2990302499383688, + 0.11047236993908882, + 0.2406021449714899, + 0.5846052914857864, + 0.5432026870548725, + 1.9827679060399532, + 0.7343458272516727, + 0.30154414288699627, + 1.0739712342619896, + 0.39054254442453384, + 0.8715631850063801, + 0.8838857598602772, + 0.11960437148809433, + 0.6269745416939259, + 0.9139348492026329, + 0.29059422947466373, + 6.145575821399689, + 0.38421766459941864, + 0.9598790816962719, + 0.5192593615502119, + 0.03860712796449661, + 1.853160072118044, + 0.45139656215906143, + 0.4552750326693058, + 0.04117819294333458, + 0.5283883176743984, + 0.17455756291747093, + 0.5442203152924776, + 0.8628972247242928, + 1.4990454949438572, + 0.531655365601182, + 1.0808910485357046, + 0.44309068471193314, + 2.178189430385828, + 0.1680579725652933, + 0.5471123978495598 + ], + "unique_experts": 64, + "load_cv": 0.6999981975172176, + "normalized_load_entropy": 0.9488007874535168, + "max_load_share": 0.06342182890855458 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "ce8380e857f00dbd770d886bb4d279caab94b6310555c5bed256762513cc7fd4", + "route_weight_sha256": "f187da32692d1d6953d92e9a5fc3a6b6bf156feae6fdade4948719f76cb6381f", + "loads": [ + 28, + 15, + 12, + 20, + 3, + 7, + 10, + 6, + 41, + 10, + 23, + 18, + 21, + 8, + 9, + 9, + 19, + 13, + 11, + 10, + 13, + 16, + 3, + 9, + 2, + 3, + 4, + 13, + 6, + 4, + 6, + 8, + 13, + 28, + 11, + 11, + 14, + 10, + 11, + 8, + 8, + 9, + 16, + 7, + 45, + 9, + 10, + 9, + 4, + 12, + 18, + 8, + 2, + 14, + 6, + 24, + 14, + 24, + 12, + 16, + 14, + 36, + 5, + 20 + ], + "weighted_loads": [ + 2.2651635287329555, + 0.6495301760733128, + 1.5682340078055859, + 2.397820030339062, + 0.16826225444674492, + 0.23629707098007202, + 1.255697201937437, + 0.29445173777639866, + 3.182999450713396, + 0.5888573322445154, + 1.4673462212085724, + 2.2838673759251833, + 1.3253312893211842, + 0.47292594239115715, + 0.828028092160821, + 0.32567431777715683, + 1.123115424066782, + 1.054510872811079, + 0.6881278865039349, + 0.42041658237576485, + 0.778848284855485, + 1.120707456022501, + 0.1035890281200409, + 0.6751996949315071, + 0.0968925766646862, + 0.1028587743639946, + 0.16495171934366226, + 0.6544772833585739, + 0.2990302499383688, + 0.16117765381932259, + 0.2406021449714899, + 0.5846052914857864, + 0.5787025131285191, + 2.2432500645518303, + 0.8489109240472317, + 0.45663012005388737, + 1.0739712342619896, + 0.4356844760477543, + 0.8715631850063801, + 0.917432751506567, + 0.3928600214421749, + 0.7032621912658215, + 1.1451657637953758, + 0.29059422947466373, + 6.250621791929007, + 0.4161957763135433, + 1.0015891157090664, + 0.5192593615502119, + 0.1733708344399929, + 1.9798791743814945, + 0.7404954433441162, + 0.4552750326693058, + 0.04117819294333458, + 0.6781840324401855, + 0.17455756291747093, + 1.7655080324038863, + 0.981780419126153, + 1.6013402808457613, + 0.5724005680531263, + 1.0808910485357046, + 1.6608043499290943, + 2.464119203388691, + 0.1680579725652933, + 0.8225991278886795 + ], + "unique_experts": 64, + "load_cv": 0.6703496948525278, + "normalized_load_entropy": 0.9529027170299923, + "max_load_share": 0.05434782608695652 + } + }, + "s1_period": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "1402914f519667dd104c5e15ed3a723133ff3e0ce64dc40e178f1052f4426e33", + "route_weight_sha256": "61cf51ed80d9caf1dbb6c99387518dec38a13d7a45f7a3042bc2a01072bf91aa", + "loads": [ + 24, + 9, + 10, + 12, + 4, + 6, + 6, + 8, + 33, + 5, + 24, + 17, + 22, + 9, + 5, + 8, + 19, + 8, + 10, + 9, + 12, + 6, + 2, + 9, + 3, + 1, + 3, + 8, + 8, + 1, + 7, + 7, + 12, + 17, + 8, + 6, + 14, + 8, + 11, + 8, + 6, + 8, + 12, + 8, + 43, + 7, + 8, + 10, + 1, + 10, + 10, + 9, + 2, + 10, + 8, + 16, + 11, + 24, + 9, + 15, + 5, + 31, + 2, + 14 + ], + "weighted_loads": [ + 2.158752277493477, + 0.341457050293684, + 1.5363514441996813, + 1.4303722456097603, + 0.22898227162659168, + 0.2019770685583353, + 0.9878670126199722, + 0.322339104488492, + 1.9528418071568012, + 0.3876037448644638, + 1.4845020323991776, + 2.1560997888445854, + 1.3817719891667366, + 0.48348257318139076, + 0.17288633435964584, + 0.2782528195530176, + 1.0914025288075209, + 0.8607436083257198, + 0.6543705984950066, + 0.3899562545120716, + 0.7195879183709621, + 0.32516595534980297, + 0.07099302113056183, + 0.6171400211751461, + 0.1343446895480156, + 0.038309965282678604, + 0.1158594898879528, + 0.44603321328759193, + 0.38513354770839214, + 0.035051438957452774, + 0.2497081384062767, + 0.5419271737337112, + 0.5419439934194088, + 1.6915635839104652, + 0.7606030181050301, + 0.23921826854348183, + 1.0711210556328297, + 0.34394471533596516, + 0.8554494790732861, + 0.9148904979228973, + 0.2794172950088978, + 0.610705878585577, + 0.8781924955546856, + 0.3433861881494522, + 6.2064093463122845, + 0.3452954590320587, + 0.8840761780738831, + 0.5742276534438133, + 0.03790692612528801, + 1.7737328447401524, + 0.3365483917295933, + 0.4965734928846359, + 0.05687141232192516, + 0.49869011901319027, + 0.2861356195062399, + 0.7801461387425661, + 0.8481278717517853, + 1.609078947454691, + 0.44217229448258877, + 1.0331624448299408, + 0.38141709566116333, + 2.3679594676941633, + 0.11298790574073792, + 0.6009516529738903 + ], + "unique_experts": 64, + "load_cv": 0.733410694652436, + "normalized_load_entropy": 0.9451016784644938, + "max_load_share": 0.06342182890855458 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "57d88d6eaa1c9d05bf830a97da7a0de6154409dace19142886875faaff823835", + "route_weight_sha256": "be0cae35cda3bb2916234ab925bf29c068b4b4dd7af827d65a113aff87b7bbc0", + "loads": [ + 26, + 15, + 10, + 22, + 4, + 7, + 11, + 10, + 54, + 14, + 24, + 22, + 25, + 9, + 9, + 12, + 22, + 10, + 11, + 9, + 13, + 20, + 3, + 10, + 3, + 2, + 3, + 10, + 9, + 1, + 7, + 7, + 13, + 27, + 16, + 12, + 16, + 10, + 11, + 10, + 19, + 10, + 17, + 10, + 44, + 7, + 9, + 12, + 3, + 13, + 22, + 12, + 7, + 13, + 8, + 38, + 15, + 26, + 11, + 15, + 20, + 42, + 4, + 18 + ], + "weighted_loads": [ + 2.280422347597778, + 0.8412930034101009, + 1.5363514441996813, + 2.673696182668209, + 0.22898227162659168, + 0.2145680245012045, + 1.2985516414046288, + 0.4042497258633375, + 3.6747880075126886, + 0.8525638822466135, + 1.4845020323991776, + 2.477243833243847, + 1.5214952193200588, + 0.48348257318139076, + 0.7335936706513166, + 0.5132604595273733, + 1.2374214809387922, + 0.9106602892279625, + 0.6943288706243038, + 0.3899562545120716, + 0.7687446437776089, + 1.494327476248145, + 0.11390591040253639, + 0.6749232336878777, + 0.1343446895480156, + 0.06380418501794338, + 0.1158594898879528, + 0.5259584337472916, + 0.46869621239602566, + 0.035051438957452774, + 0.2497081384062767, + 0.5419271737337112, + 0.5903197675943375, + 2.055799560621381, + 1.1350013613700867, + 0.49317925050854683, + 1.1618885584175587, + 0.40763620659708977, + 0.8554494790732861, + 0.9811980072408915, + 1.0475228019058704, + 0.684492502361536, + 1.2592486292123795, + 0.47885315865278244, + 6.234614294022322, + 0.3452954590320587, + 0.9184907488524914, + 0.6415858902037144, + 0.13309132680296898, + 2.2695170305669308, + 0.9640526790171862, + 0.7078762613236904, + 0.6063696127384901, + 0.6508243959397078, + 0.2861356195062399, + 2.7393984934315085, + 1.0737936086952686, + 1.6729213036596775, + 0.5442103240638971, + 1.0331624448299408, + 2.375506140291691, + 2.8327369447797537, + 0.18442651629447937, + 0.7849536836147308 + ], + "unique_experts": 64, + "load_cv": 0.6989834048574486, + "normalized_load_entropy": 0.9491177511702267, + "max_load_share": 0.05844155844155844 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 113, + "ordered_topk_exact_tokens": 63, + "set_exact_tokens": 75, + "mean_set_jaccard": 0.9020227560050569, + "mean_token_weighted_tv": 0.019042699148598234, + "aggregate_load_tv": 0.035398230088495575 + }, + "system_bos": { + "tokens": 113, + "ordered_topk_exact_tokens": 57, + "set_exact_tokens": 71, + "mean_set_jaccard": 0.8885377159713443, + "mean_token_weighted_tv": 0.02533486067210283, + "aggregate_load_tv": 0.03687315634218289 + }, + "system_x": { + "tokens": 113, + "ordered_topk_exact_tokens": 45, + "set_exact_tokens": 60, + "mean_set_jaccard": 0.8512431521281079, + "mean_token_weighted_tv": 0.03500670856029718, + "aggregate_load_tv": 0.05604719764011799 + }, + "system_period": { + "tokens": 113, + "ordered_topk_exact_tokens": 44, + "set_exact_tokens": 56, + "mean_set_jaccard": 0.8437420986093553, + "mean_token_weighted_tv": 0.036479559640474286, + "aggregate_load_tv": 0.05752212389380531 + }, + "bos_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 57, + "set_exact_tokens": 70, + "mean_set_jaccard": 0.881795195954488, + "mean_token_weighted_tv": 0.02636054609036815, + "aggregate_load_tv": 0.04424778761061947 + }, + "bos_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 49, + "set_exact_tokens": 61, + "mean_set_jaccard": 0.8537715971344291, + "mean_token_weighted_tv": 0.03064697939671774, + "aggregate_load_tv": 0.05162241887905604 + }, + "x_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 50, + "set_exact_tokens": 65, + "mean_set_jaccard": 0.8672566371681416, + "mean_token_weighted_tv": 0.030093421236471792, + "aggregate_load_tv": 0.048672566371681415 + }, + "x_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 36, + "set_exact_tokens": 50, + "mean_set_jaccard": 0.812684365781711, + "mean_token_weighted_tv": 0.04118028494933274, + "aggregate_load_tv": 0.07079646017699115 + }, + "period_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 50, + "set_exact_tokens": 63, + "mean_set_jaccard": 0.8640960809102403, + "mean_token_weighted_tv": 0.028850492918286966, + "aggregate_load_tv": 0.05162241887905605 + }, + "period_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 40, + "set_exact_tokens": 53, + "mean_set_jaccard": 0.8240623683101559, + "mean_token_weighted_tv": 0.03956271650731168, + "aggregate_load_tv": 0.06342182890855458 + } + } + }, + "layer_23": { + "layer": 23, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "ac4c8e6e37f6bce07303e72efca3dda1ac6366ef3d8843fd46bed367665f998d", + "route_weight_sha256": "d8e9a0d12843f70381538e0ce35facfe5f0326558bc6d7c9ed82949f16a9d800", + "loads": [ + 16, + 9, + 10, + 11, + 2, + 12, + 6, + 8, + 15, + 6, + 15, + 13, + 14, + 12, + 10, + 15, + 14, + 15, + 20, + 12, + 12, + 6, + 15, + 10, + 11, + 0, + 15, + 20, + 8, + 8, + 12, + 3, + 15, + 0, + 12, + 6, + 6, + 13, + 11, + 5, + 21, + 12, + 12, + 4, + 9, + 11, + 22, + 7, + 12, + 11, + 2, + 17, + 16, + 8, + 14, + 8, + 3, + 9, + 4, + 0, + 21, + 7, + 19, + 6 + ], + "weighted_loads": [ + 1.594980463385582, + 0.6849879771471024, + 0.6562668848782778, + 1.7923833467066288, + 0.13852345198392868, + 0.6227304972708225, + 0.4763026814907789, + 0.39408764615654945, + 1.6709753014147282, + 0.3049000781029463, + 0.8138181418180466, + 0.5250105559825897, + 0.6968452986329794, + 0.5934126358479261, + 0.6575586423277855, + 1.0800267457962036, + 1.2605876084417105, + 1.0668121464550495, + 1.235424805432558, + 0.588313365355134, + 0.6138328667730093, + 0.21923489682376385, + 1.9776012673974037, + 0.6803000941872597, + 0.47132606245577335, + 0.0, + 2.842313291504979, + 1.339709796011448, + 0.44225207157433033, + 0.5132206305861473, + 0.5820710379630327, + 0.15722084790468216, + 0.8772406317293644, + 0.0, + 0.5920038409531116, + 0.5090154781937599, + 0.41757121309638023, + 0.6127308718860149, + 0.7309654708951712, + 0.25431943126022816, + 1.835772953927517, + 0.7761850822716951, + 0.47678722999989986, + 0.16790563985705376, + 0.6337564010173082, + 1.095470767468214, + 1.5587237849831581, + 0.5846809446811676, + 0.8946588821709156, + 0.48128187470138073, + 0.09700081497430801, + 1.0885704010725021, + 1.43679378926754, + 0.4159828685224056, + 0.6509782187640667, + 0.5612034238874912, + 0.2029264196753502, + 0.5843394510447979, + 0.18580080941319466, + 0.0, + 0.9904425144195557, + 0.43890266865491867, + 1.061001617461443, + 0.25150309316813946 + ], + "unique_experts": 61, + "load_cv": 0.5016397438676795, + "normalized_load_entropy": 0.9637441190876402, + "max_load_share": 0.032448377581120944 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "efec099afe40da4a4770b73b93202f590559917e2c984eaf0b3b797c09126ada", + "route_weight_sha256": "206b338bddb3e0ee150796d6f7973c1a7ae4695510be62b25dad7dd431dda371", + "loads": [ + 21, + 12, + 10, + 20, + 8, + 14, + 12, + 12, + 16, + 14, + 15, + 13, + 15, + 17, + 12, + 15, + 17, + 15, + 20, + 12, + 12, + 6, + 17, + 20, + 15, + 1, + 15, + 20, + 8, + 8, + 12, + 3, + 17, + 4, + 12, + 7, + 7, + 13, + 16, + 7, + 28, + 13, + 15, + 4, + 9, + 17, + 33, + 10, + 13, + 11, + 3, + 19, + 16, + 8, + 24, + 10, + 3, + 18, + 6, + 0, + 22, + 7, + 22, + 7 + ], + "weighted_loads": [ + 1.792639530962333, + 0.8508179932832718, + 0.6562668848782778, + 2.0498032823670655, + 0.4027333538979292, + 0.6786199742928147, + 0.8782775308936834, + 0.5637357085943222, + 1.6717230581562035, + 0.5927872825413942, + 0.8138181418180466, + 0.5250105559825897, + 0.70703708473593, + 0.8006716966629028, + 0.77439771220088, + 1.0800267457962036, + 1.3123713750392199, + 1.0668121464550495, + 1.235424805432558, + 0.588313365355134, + 0.6138328667730093, + 0.21923489682376385, + 2.0755612943321466, + 1.9171302169561386, + 0.6169626954942942, + 0.02790551260113716, + 2.842313291504979, + 1.339709796011448, + 0.44225207157433033, + 0.5132206305861473, + 0.5820710379630327, + 0.15722084790468216, + 0.9981715753674507, + 0.25232404842972755, + 0.5920038409531116, + 0.5403135940432549, + 0.462299857288599, + 0.6127308718860149, + 0.9456897880882025, + 0.3051595352590084, + 2.2063596211373806, + 0.8320432994514704, + 0.5572086311876774, + 0.16790563985705376, + 0.6337564010173082, + 3.0968690030276775, + 2.520374059677124, + 0.6477668664883822, + 0.933334942907095, + 0.48128187470138073, + 0.16247226297855377, + 1.2155861593782902, + 1.43679378926754, + 0.4159828685224056, + 1.5729538314044476, + 0.6314159743487835, + 0.2029264196753502, + 1.5553213767707348, + 0.28848326206207275, + 0.0, + 1.0204299222677946, + 0.43890266865491867, + 1.153856586664915, + 0.31909447722136974 + ], + "unique_experts": 63, + "load_cv": 0.49016560110518054, + "normalized_load_entropy": 0.9682959685663832, + "max_load_share": 0.03985507246376811 + } + }, + "s1_eos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "223a5921dbdedcb9f2c482b5c5f8ea9a3510539b141fb17cfa29ca49d079f456", + "route_weight_sha256": "2620ba3c73f4c0371b67744816206db8876fb1b9c40cc08877e1d499f8013685", + "loads": [ + 15, + 10, + 11, + 11, + 2, + 12, + 5, + 8, + 14, + 5, + 13, + 16, + 14, + 11, + 10, + 15, + 14, + 15, + 20, + 14, + 12, + 6, + 15, + 9, + 10, + 0, + 13, + 20, + 10, + 8, + 11, + 3, + 19, + 0, + 12, + 6, + 6, + 12, + 11, + 3, + 20, + 11, + 10, + 4, + 9, + 10, + 22, + 6, + 12, + 11, + 2, + 17, + 14, + 12, + 17, + 8, + 3, + 9, + 4, + 0, + 22, + 7, + 20, + 7 + ], + "weighted_loads": [ + 1.5293552801012993, + 0.732260774821043, + 0.6826744321733713, + 1.792738312855363, + 0.12540678679943085, + 0.6246515680104494, + 0.4443509876728058, + 0.38291675969958305, + 1.6418480202555656, + 0.2647145166993141, + 0.7591077424585819, + 0.6475243866443634, + 0.7281319927424192, + 0.5676716677844524, + 0.6296557430177927, + 1.0666353292763233, + 1.238477610051632, + 1.0398114249110222, + 1.2360777668654919, + 0.6299190055578947, + 0.591487867757678, + 0.21843396313488483, + 1.9367854669690132, + 0.7082394100725651, + 0.4709545597434044, + 0.0, + 2.803522050380707, + 1.3713044039905071, + 0.4964149836450815, + 0.5028975363820791, + 0.5408601611852646, + 0.15257900580763817, + 1.0316689722239971, + 0.0, + 0.5965772680938244, + 0.5249144211411476, + 0.3676127679646015, + 0.5627906899899244, + 0.7241892497986555, + 0.16798260435461998, + 1.7198290470987558, + 0.7395281530916691, + 0.4118479900062084, + 0.18524600565433502, + 0.6253237389028072, + 1.0726906191557646, + 1.5045487098395824, + 0.5588427670300007, + 0.8960881568491459, + 0.46999997831881046, + 0.08296076580882072, + 1.0638048388063908, + 1.3618956618010998, + 0.5401361044496298, + 0.7591165788471699, + 0.5331034101545811, + 0.19664204120635986, + 0.595037117600441, + 0.17290658131241798, + 0.0, + 1.0147720575332642, + 0.42056069150567055, + 1.1392411272972822, + 0.3048403337597847 + ], + "unique_experts": 61, + "load_cv": 0.5147894093936639, + "normalized_load_entropy": 0.9620622893521638, + "max_load_share": 0.032448377581120944 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "785c3f91c53485e1f3850d566a40caf8c11304c0a9d604e0a4ebf01fa3e18349", + "route_weight_sha256": "0cd78fc4fd4bc14a73dc57d83bfb911ffa28f2c7a0c9773124916c25fb3aab7b", + "loads": [ + 21, + 16, + 17, + 20, + 8, + 15, + 18, + 15, + 16, + 9, + 15, + 17, + 15, + 16, + 12, + 18, + 18, + 16, + 22, + 15, + 13, + 6, + 17, + 23, + 13, + 1, + 13, + 20, + 10, + 9, + 11, + 3, + 22, + 12, + 12, + 6, + 12, + 13, + 19, + 4, + 29, + 12, + 12, + 4, + 11, + 15, + 38, + 10, + 19, + 14, + 2, + 28, + 20, + 13, + 27, + 9, + 3, + 26, + 5, + 0, + 24, + 8, + 27, + 10 + ], + "weighted_loads": [ + 1.854246592381969, + 1.0931919142603874, + 1.0003417897969484, + 2.2860636317636818, + 0.3502296395599842, + 0.7253067484125495, + 1.2134889103472233, + 0.6151602100580931, + 1.6765206747222692, + 0.42200359143316746, + 0.853489987552166, + 0.6785390116274357, + 0.7383234482258558, + 0.7714807149022818, + 0.7733197342604399, + 1.1882173847407103, + 1.3156060576438904, + 1.0990526117384434, + 1.327752746641636, + 0.6598462406545877, + 0.6397134494036436, + 0.21843396313488483, + 2.0168742313981056, + 2.494832444936037, + 0.5937933921813965, + 0.03683112934231758, + 2.803522050380707, + 1.3713044039905071, + 0.4964149836450815, + 0.5477677267044783, + 0.5408601611852646, + 0.15257900580763817, + 1.1888092048466206, + 0.7210606241133064, + 0.5965772680938244, + 0.5249144211411476, + 0.8014653511345387, + 0.6108258981257677, + 1.1905073821544647, + 0.19136868044734, + 2.11327513307333, + 0.7947557456791401, + 0.4698906224220991, + 0.18524600565433502, + 0.7267732061445713, + 3.064504014328122, + 3.126245092600584, + 0.7869743795599788, + 1.1872828919440508, + 0.6206714008003473, + 0.08296076580882072, + 1.7627177257090807, + 2.0019700303673744, + 0.5716019812971354, + 1.725050125271082, + 0.5715976431965828, + 0.19664204120635986, + 2.2048185765743256, + 0.25544266775250435, + 0.0, + 1.0875192750245333, + 0.5449419729411602, + 1.4011895041912794, + 0.44600023701786995 + ], + "unique_experts": 63, + "load_cv": 0.5108775375747654, + "normalized_load_entropy": 0.9655776826793543, + "max_load_share": 0.04112554112554113 + } + }, + "s0_bos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "23421b0b7548caa63d6c8ab96e222fa78653631f1d00714cc3c54da40f1ecc3b", + "route_weight_sha256": "c059e23fc5fc175f695c3e6073d66bfa4a222db4aba7c5fc74a9081a20293dc1", + "loads": [ + 14, + 9, + 11, + 11, + 3, + 11, + 6, + 7, + 15, + 8, + 13, + 13, + 13, + 12, + 10, + 14, + 15, + 14, + 19, + 13, + 12, + 6, + 15, + 10, + 13, + 0, + 14, + 20, + 9, + 8, + 11, + 3, + 20, + 1, + 9, + 6, + 6, + 19, + 11, + 7, + 21, + 12, + 8, + 4, + 9, + 10, + 25, + 7, + 12, + 12, + 1, + 15, + 17, + 8, + 11, + 7, + 3, + 9, + 5, + 1, + 21, + 7, + 14, + 8 + ], + "weighted_loads": [ + 1.5306667312979698, + 0.6960835717618465, + 0.7175667770206928, + 1.8191826194524765, + 0.18038169667124748, + 0.5795443560928106, + 0.4650793503969908, + 0.35477165319025517, + 1.67333959415555, + 0.37972552329301834, + 0.7237693816423416, + 0.5202175043523312, + 0.8014384247362614, + 0.5931599643081427, + 0.6072066221386194, + 1.062861867249012, + 1.2500619608908892, + 1.0522205047309399, + 1.2126137465238571, + 0.6282910257577896, + 0.6495856735855341, + 0.21691730991005898, + 1.9664395917207003, + 0.6946982499212027, + 0.5480737257748842, + 0.0, + 2.8324013501405716, + 1.3632503002882004, + 0.4739827774465084, + 0.509667782112956, + 0.5274946875870228, + 0.15212838351726532, + 1.0679729096591473, + 0.022534891963005066, + 0.43426528945565224, + 0.5601694248616695, + 0.3918989934027195, + 0.8240531627088785, + 0.7604885995388031, + 0.3163468334823847, + 1.819183612242341, + 0.7891236059367657, + 0.34359353221952915, + 0.16796842217445374, + 0.6326407231390476, + 1.0984630584716797, + 1.6372417453676462, + 0.6181422211229801, + 0.8652661684900522, + 0.5312269143760204, + 0.04264064133167267, + 1.022197987884283, + 1.4877004139125347, + 0.38028671965003014, + 0.5718752946704626, + 0.5057684518396854, + 0.20353714376688004, + 0.5670510940253735, + 0.23153342679142952, + 0.029850197955965996, + 0.9482452794909477, + 0.4258558452129364, + 0.9062662683427334, + 0.3158622067421675 + ], + "unique_experts": 63, + "load_cv": 0.49941447255253174, + "normalized_load_entropy": 0.9663162600498862, + "max_load_share": 0.03687315634218289 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "734db4ba1c1478d9d5babdfeed6647c5655f8d98194c646889a5525754a59741", + "route_weight_sha256": "9688603ccd3dfe4361f2a8e5ce8a6be772f866aeea6829dba3595d9ffadc6843", + "loads": [ + 17, + 12, + 11, + 19, + 8, + 13, + 12, + 14, + 15, + 14, + 13, + 13, + 15, + 17, + 11, + 14, + 18, + 14, + 19, + 14, + 12, + 6, + 18, + 21, + 16, + 0, + 15, + 20, + 9, + 8, + 11, + 3, + 22, + 4, + 9, + 7, + 6, + 19, + 15, + 9, + 30, + 13, + 10, + 6, + 9, + 15, + 37, + 9, + 13, + 12, + 2, + 16, + 17, + 9, + 21, + 10, + 3, + 19, + 8, + 2, + 22, + 7, + 16, + 9 + ], + "weighted_loads": [ + 1.6587257063947618, + 0.861913587898016, + 0.7175667770206928, + 2.073020261246711, + 0.40761775337159634, + 0.6354338331148028, + 0.8702350649982691, + 0.622808899730444, + 1.67333959415555, + 0.5997295714914799, + 0.7237693816423416, + 0.5202175043523312, + 0.8401335319504142, + 0.8004190251231194, + 0.6807251144200563, + 1.062861867249012, + 1.3018457274883986, + 1.0522205047309399, + 1.2126137465238571, + 0.815368264913559, + 0.6495856735855341, + 0.21691730991005898, + 2.108064942061901, + 2.0295852217823267, + 0.6482975725084543, + 0.0, + 2.9434741362929344, + 1.3632503002882004, + 0.4739827774465084, + 0.509667782112956, + 0.5274946875870228, + 0.15212838351726532, + 1.183913554996252, + 0.2832709029316902, + 0.43426528945565224, + 0.5914675407111645, + 0.3918989934027195, + 0.8240531627088785, + 0.9431345127522945, + 0.36718693748116493, + 2.2782606221735477, + 0.8467227108776569, + 0.3966650851070881, + 0.2281016744673252, + 0.6326407231390476, + 2.1235524117946625, + 2.646268868818879, + 0.6773800905793905, + 0.9039422292262316, + 0.5312269143760204, + 0.1031368263065815, + 1.1108491607010365, + 1.4877004139125347, + 0.4201143607497215, + 1.4938509073108435, + 0.62007662281394, + 0.20353714376688004, + 1.580610316246748, + 0.3870687372982502, + 0.29232813231647015, + 0.9793169070035219, + 0.4258558452129364, + 0.9741585347801447, + 0.3797312658280134 + ], + "unique_experts": 63, + "load_cv": 0.4954694505505408, + "normalized_load_entropy": 0.9689842707936394, + "max_load_share": 0.04468599033816425 + } + }, + "s1_bos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "e213bd2a114ce5b52db70295aa2c0f0b1cfc644f8cf7ba8cde464dd57a40f538", + "route_weight_sha256": "b92dd2aca25fadcd8d82d262cf8bbe54874bd7ec1d75f9f9d17fe6ec6892181f", + "loads": [ + 13, + 9, + 11, + 11, + 1, + 13, + 6, + 8, + 16, + 7, + 13, + 16, + 14, + 10, + 10, + 15, + 13, + 15, + 22, + 12, + 12, + 6, + 16, + 9, + 9, + 0, + 13, + 20, + 7, + 8, + 10, + 3, + 16, + 0, + 10, + 6, + 8, + 18, + 11, + 7, + 26, + 12, + 8, + 4, + 9, + 10, + 22, + 9, + 12, + 10, + 2, + 17, + 16, + 8, + 13, + 8, + 1, + 10, + 5, + 1, + 20, + 7, + 18, + 6 + ], + "weighted_loads": [ + 1.426680777221918, + 0.7030132748186588, + 0.7168477438390255, + 1.8209393694996834, + 0.09239096939563751, + 0.6553468238562346, + 0.4707036428153515, + 0.37673957273364067, + 1.7422413416206837, + 0.3488582596182823, + 0.7106089815497398, + 0.6518498230725527, + 0.8250860404223204, + 0.5572236217558384, + 0.5766470246016979, + 1.0895757880061865, + 1.174832634627819, + 1.0780285131186247, + 1.3010117188096046, + 0.5959382243454456, + 0.6457748170942068, + 0.22561512514948845, + 1.9720660634338856, + 0.6548097617924213, + 0.44164857640862465, + 0.0, + 2.790720898658037, + 1.3600486926734447, + 0.4137326255440712, + 0.5101661682128906, + 0.5031053386628628, + 0.14450915157794952, + 0.9371445253491402, + 0.0, + 0.5116629078984261, + 0.5791029185056686, + 0.43718698620796204, + 0.7841055858880281, + 0.7222729176282883, + 0.32239479571580887, + 1.9513699393719435, + 0.785219568759203, + 0.3295898884534836, + 0.16028714552521706, + 0.6333161033689976, + 1.0637632850557566, + 1.4972293507307768, + 0.6779781933873892, + 0.8728430047631264, + 0.42662751488387585, + 0.08539938926696777, + 1.0702650845050812, + 1.5021023154258728, + 0.35082766227424145, + 0.6381922792643309, + 0.5385180115699768, + 0.11118630319833755, + 0.6197820417582989, + 0.2282509095966816, + 0.03780065476894379, + 0.9468235392123461, + 0.434362031519413, + 1.0896345898509026, + 0.23823762498795986 + ], + "unique_experts": 62, + "load_cv": 0.5228400335155401, + "normalized_load_entropy": 0.9621936111617022, + "max_load_share": 0.038348082595870206 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "a0643e7354aceeb1d70cb8864d48a6d001713edce5965dcbbee16e8ccf4ee262", + "route_weight_sha256": "6fffdaba6cb6d0d3ca212896d28e9a39535c3dbaf9144fc774f89b0cba046edf", + "loads": [ + 18, + 15, + 17, + 19, + 5, + 16, + 18, + 16, + 18, + 11, + 15, + 17, + 15, + 15, + 11, + 18, + 17, + 16, + 24, + 12, + 13, + 6, + 19, + 24, + 11, + 1, + 13, + 20, + 7, + 9, + 11, + 3, + 18, + 11, + 10, + 6, + 14, + 19, + 18, + 8, + 37, + 13, + 10, + 4, + 11, + 14, + 38, + 12, + 19, + 13, + 2, + 28, + 22, + 11, + 23, + 9, + 1, + 28, + 9, + 1, + 23, + 8, + 24, + 10 + ], + "weighted_loads": [ + 1.7633064626716077, + 1.0639444142580032, + 1.0345151014626026, + 2.3107234206981957, + 0.24722009524703026, + 0.7517765341326594, + 1.2083872631192207, + 0.6672934051603079, + 1.822594776749611, + 0.5071288552135229, + 0.8049912266433239, + 0.682864448055625, + 0.835277495905757, + 0.7610326688736677, + 0.6744041480123997, + 1.2111578434705734, + 1.2519610822200775, + 1.1372696999460459, + 1.3926866985857487, + 0.5959382243454456, + 0.6940003987401724, + 0.22561512514948845, + 2.1207601577043533, + 2.5884267948567867, + 0.5210471302270889, + 0.028327468782663345, + 2.790720898658037, + 1.3600486926734447, + 0.4137326255440712, + 0.5550363585352898, + 0.5429668128490448, + 0.14450915157794952, + 1.0564165860414505, + 0.7245877217501402, + 0.5116629078984261, + 0.5791029185056686, + 0.8710395693778992, + 0.8321407940238714, + 1.1353615690022707, + 0.3457808718085289, + 2.4604721665382385, + 0.8436702787876129, + 0.38443557918071747, + 0.16028714552521706, + 0.7347655706107616, + 2.0795490723103285, + 3.1189257334917784, + 0.9024060145020485, + 1.1640377398580313, + 0.5772989373654127, + 0.08539938926696777, + 1.723359091207385, + 2.1421766839921474, + 0.49747089855372906, + 1.604125825688243, + 0.5872767344117165, + 0.11118630319833755, + 2.282244499772787, + 0.4538852907717228, + 0.03780065476894379, + 1.050559526309371, + 0.5587433129549026, + 1.3239365965127945, + 0.41977729089558125 + ], + "unique_experts": 64, + "load_cv": 0.5256309785758209, + "normalized_load_entropy": 0.9648434453642606, + "max_load_share": 0.04112554112554113 + } + }, + "s0_x": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "3317dfef2e76866b5f524398bbdad093046f2b3d4a45ce9196eb6a3e57acdeeb", + "route_weight_sha256": "e4f4c43e9d9707b668a62d40b6632ee43d54c240707401e5ea2ae24e923c5670", + "loads": [ + 13, + 9, + 11, + 11, + 1, + 12, + 6, + 8, + 15, + 5, + 14, + 13, + 13, + 11, + 9, + 15, + 14, + 15, + 19, + 17, + 12, + 6, + 13, + 10, + 10, + 1, + 12, + 21, + 8, + 8, + 11, + 3, + 17, + 2, + 10, + 6, + 7, + 16, + 11, + 6, + 23, + 12, + 12, + 4, + 8, + 10, + 25, + 6, + 10, + 9, + 1, + 16, + 14, + 9, + 18, + 7, + 3, + 10, + 4, + 2, + 21, + 8, + 17, + 8 + ], + "weighted_loads": [ + 1.448136493563652, + 0.6978050470352173, + 0.7176293693482876, + 1.7879789359867573, + 0.08668147027492523, + 0.6334932576864958, + 0.45789568684995174, + 0.3815543223172426, + 1.6861382815986872, + 0.272647500038147, + 0.7594050876796246, + 0.5018568430095911, + 0.7837367616593838, + 0.536197217181325, + 0.5540179759263992, + 1.0971143171191216, + 1.2231410946696997, + 1.0842578448355198, + 1.2041532881557941, + 0.7637469656765461, + 0.6431996934115887, + 0.21954231522977352, + 1.9242765493690968, + 0.7024168353527784, + 0.46641068905591965, + 0.031599223613739014, + 2.774391807615757, + 1.3914607390761375, + 0.4547199048101902, + 0.5214376654475927, + 0.5154343638569117, + 0.16047624498605728, + 0.9399590473622084, + 0.050123609602451324, + 0.496652752161026, + 0.5298779420554638, + 0.44871437922120094, + 0.7383082173764706, + 0.7509603258222342, + 0.27985617332160473, + 1.955615809187293, + 0.7752382457256317, + 0.4688624646514654, + 0.18298490718007088, + 0.6172155980020761, + 1.0856112875044346, + 1.6941319201141596, + 0.5696303900331259, + 0.7948872074484825, + 0.39830517023801804, + 0.047431983053684235, + 1.0802153944969177, + 1.4202297367155552, + 0.416900334879756, + 0.8284665625542402, + 0.49308522790670395, + 0.2016126811504364, + 0.6168058589100838, + 0.18968822434544563, + 0.09193890541791916, + 0.9750388022512197, + 0.4676764905452728, + 1.0117103550583124, + 0.32063909992575645 + ], + "unique_experts": 64, + "load_cv": 0.5079831022501297, + "normalized_load_entropy": 0.9663047664051296, + "max_load_share": 0.03687315634218289 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "a6b91f05e30d17aa3d5fbd68df62e3c1183b7647e0a76b0279b7d463b68b6e76", + "route_weight_sha256": "6b04bcfe153a6518e2117cb7eb4582af15f119a9706bd933c262262956852aa9", + "loads": [ + 17, + 12, + 11, + 21, + 6, + 14, + 13, + 15, + 15, + 11, + 14, + 14, + 14, + 16, + 11, + 15, + 18, + 15, + 19, + 17, + 12, + 6, + 15, + 21, + 14, + 1, + 12, + 21, + 8, + 8, + 11, + 3, + 19, + 6, + 10, + 7, + 8, + 16, + 16, + 8, + 30, + 13, + 14, + 4, + 8, + 16, + 39, + 8, + 11, + 9, + 1, + 18, + 14, + 9, + 29, + 8, + 3, + 19, + 5, + 2, + 22, + 8, + 19, + 9 + ], + "weighted_loads": [ + 1.648116064723581, + 0.8636350631713867, + 0.7176293693482876, + 2.1808484089560807, + 0.3056886773556471, + 0.689382734708488, + 0.8988373260945082, + 0.6282642595469952, + 1.6861382815986872, + 0.4740736521780491, + 0.7594050876796246, + 0.5287314783781767, + 0.7939285477623343, + 0.7434562779963017, + 0.672618743032217, + 1.0971143171191216, + 1.3045731540769339, + 1.0842578448355198, + 1.2041532881557941, + 0.7637469656765461, + 0.6431996934115887, + 0.21954231522977352, + 2.0197904985398054, + 1.982466982677579, + 0.6074395403265953, + 0.031599223613739014, + 2.774391807615757, + 1.3914607390761375, + 0.4547199048101902, + 0.5214376654475927, + 0.5154343638569117, + 0.16047624498605728, + 1.0744482968002558, + 0.35178597643971443, + 0.496652752161026, + 0.5611760579049587, + 0.488860622048378, + 0.7383082173764706, + 0.9913415815681219, + 0.330696277320385, + 2.306589787825942, + 0.8254673331975937, + 0.5219340175390244, + 0.18298490718007088, + 0.6172155980020761, + 2.1479838863015175, + 2.8635427188128233, + 0.6288682594895363, + 0.8335632681846619, + 0.39830517023801804, + 0.047431983053684235, + 1.2154037058353424, + 1.4202297367155552, + 0.416900334879756, + 1.8868512939661741, + 0.5276432819664478, + 0.2016126811504364, + 1.591940812766552, + 0.2465522587299347, + 0.09193890541791916, + 1.0034214407205582, + 0.4676764905452728, + 1.0796026214957237, + 0.3784114830195904 + ], + "unique_experts": 64, + "load_cv": 0.529178488170496, + "normalized_load_entropy": 0.966072352442975, + "max_load_share": 0.04710144927536232 + } + }, + "s1_x": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "2ef7e4c508e91210fc7e93ad7160e71bc5aa030adf36c9622f3456d90284177c", + "route_weight_sha256": "3c2b122751cdf06c1636f8ec3480976a331d277096b24408aa0de2d00fe6bf73", + "loads": [ + 12, + 9, + 11, + 11, + 1, + 10, + 6, + 6, + 16, + 6, + 12, + 15, + 13, + 11, + 10, + 16, + 14, + 14, + 19, + 16, + 9, + 6, + 15, + 10, + 9, + 0, + 12, + 21, + 8, + 7, + 11, + 3, + 18, + 1, + 11, + 6, + 8, + 16, + 11, + 6, + 18, + 12, + 13, + 4, + 9, + 10, + 23, + 8, + 10, + 9, + 1, + 18, + 15, + 9, + 20, + 8, + 3, + 10, + 4, + 2, + 20, + 7, + 20, + 9 + ], + "weighted_loads": [ + 1.3426901437342167, + 0.696366086602211, + 0.7004779316484928, + 1.795765869319439, + 0.08416576683521271, + 0.5323031581938267, + 0.42559538781642914, + 0.29475902393460274, + 1.6931488141417503, + 0.3149612993001938, + 0.6600371040403843, + 0.6006033346056938, + 0.8199749868363142, + 0.5765194892883301, + 0.5866173468530178, + 1.110853474587202, + 1.2274259235709906, + 1.0352555699646473, + 1.213453745469451, + 0.7454638630151749, + 0.5450208559632301, + 0.2367603313177824, + 1.9083755556493998, + 0.7274086847901344, + 0.4116126820445061, + 0.0, + 2.737100560218096, + 1.4261818826198578, + 0.42747394554317, + 0.4673825390636921, + 0.5237014032900333, + 0.16491330042481422, + 0.9949250258505344, + 0.02672533690929413, + 0.5209341086447239, + 0.5689495541155338, + 0.4780171886086464, + 0.7098010331392288, + 0.7090868391096592, + 0.2916176375001669, + 1.6557171195745468, + 0.7720030099153519, + 0.4950569160282612, + 0.15223588794469833, + 0.631312008947134, + 1.066167626529932, + 1.5420227237045765, + 0.6388775911182165, + 0.7797111719846725, + 0.35766580142080784, + 0.04345787316560745, + 1.108030242845416, + 1.4379457011818886, + 0.37723915465176105, + 1.0071509890258312, + 0.5407984554767609, + 0.1866377256810665, + 0.6212647818028927, + 0.1799497753381729, + 0.08317049592733383, + 0.9588415790349245, + 0.4329427145421505, + 1.160143706947565, + 0.36213963851332664 + ], + "unique_experts": 63, + "load_cv": 0.5068856119040192, + "normalized_load_entropy": 0.9649170535232737, + "max_load_share": 0.03392330383480826 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "aeca2ddeaf1e88d5f1dca605368736b076147625b58cf17dc9d828f451785219", + "route_weight_sha256": "a478d26883c93d3eeab4825ac6d595c8169b8f5469526eaca127c71466f8329e", + "loads": [ + 17, + 16, + 17, + 20, + 5, + 12, + 19, + 12, + 17, + 9, + 14, + 17, + 14, + 16, + 11, + 19, + 19, + 15, + 21, + 16, + 10, + 6, + 17, + 26, + 11, + 1, + 12, + 21, + 8, + 8, + 11, + 3, + 20, + 11, + 11, + 6, + 14, + 17, + 19, + 7, + 27, + 13, + 15, + 4, + 11, + 14, + 42, + 11, + 18, + 12, + 1, + 30, + 21, + 11, + 33, + 8, + 3, + 27, + 6, + 3, + 22, + 8, + 27, + 12 + ], + "weighted_loads": [ + 1.6489987797103822, + 1.0875740926712751, + 1.01814528927207, + 2.3482716497965157, + 0.23349165171384811, + 0.5763180488720536, + 1.1767162792384624, + 0.4903970118612051, + 1.7270971722900867, + 0.4293551091104746, + 0.7544193491339684, + 0.6586364917457104, + 0.8301664423197508, + 0.7803285364061594, + 0.6843744702637196, + 1.232435530051589, + 1.3438814599066973, + 1.0944967567920685, + 1.305128725245595, + 0.7454638630151749, + 0.5932464376091957, + 0.2367603313177824, + 1.9866320323199034, + 2.6010509617626667, + 0.49101123586297035, + 0.044620100408792496, + 2.737100560218096, + 1.4261818826198578, + 0.42747394554317, + 0.5122527293860912, + 0.5237014032900333, + 0.16491330042481422, + 1.098097376525402, + 0.6722669620066881, + 0.5209341086447239, + 0.5689495541155338, + 0.9118697717785835, + 0.7578362412750721, + 1.1806835010647774, + 0.3150037135928869, + 1.9925573896616697, + 0.8263545595109463, + 0.5545819755643606, + 0.15223588794469833, + 0.7327614761888981, + 2.081953413784504, + 3.4592268019914627, + 0.8633054122328758, + 1.1406472455710173, + 0.5083372239023447, + 0.04345787316560745, + 1.9135936237871647, + 2.0780200697481632, + 0.4472597222775221, + 2.2069659791886806, + 0.5407984554767609, + 0.1866377256810665, + 2.2047354839742184, + 0.30024708434939384, + 0.11923936009407043, + 1.0315887965261936, + 0.5573239959776402, + 1.4292591735720634, + 0.4885808452963829 + ], + "unique_experts": 64, + "load_cv": 0.5412294272573258, + "normalized_load_entropy": 0.9641289700088596, + "max_load_share": 0.045454545454545456 + } + }, + "s0_period": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "e624c09b7defe477a115e2bf2387b2932f84140da48de373abbd603d5799af1b", + "route_weight_sha256": "dfc600549aa32faf7c0121a265daa2bd908aba1ee34833fd4c0d84396d69810f", + "loads": [ + 13, + 9, + 11, + 11, + 1, + 11, + 6, + 8, + 15, + 6, + 13, + 15, + 13, + 11, + 10, + 16, + 14, + 15, + 20, + 16, + 10, + 6, + 13, + 10, + 11, + 1, + 14, + 20, + 8, + 7, + 12, + 3, + 17, + 2, + 11, + 6, + 7, + 13, + 11, + 6, + 21, + 12, + 12, + 4, + 8, + 10, + 24, + 6, + 12, + 11, + 1, + 15, + 14, + 7, + 17, + 8, + 3, + 9, + 5, + 2, + 21, + 7, + 17, + 10 + ], + "weighted_loads": [ + 1.4091240521520376, + 0.695165328681469, + 0.7146722339093685, + 1.8038840740919113, + 0.0835648700594902, + 0.5854244437068701, + 0.4642728101462126, + 0.379977161064744, + 1.671188473701477, + 0.30003682896494865, + 0.7171220071613789, + 0.5685021970421076, + 0.7659506779164076, + 0.5583302583545446, + 0.587064953520894, + 1.1255777813494205, + 1.1836151331663132, + 1.0733137391507626, + 1.2309034764766693, + 0.7350424397736788, + 0.5839031059294939, + 0.2309287954121828, + 1.8881978206336498, + 0.720653735101223, + 0.5006788969039917, + 0.030728641897439957, + 2.79895231500268, + 1.3584943152964115, + 0.45489269495010376, + 0.4862233139574528, + 0.5694497600197792, + 0.1601690836250782, + 0.9363220427185297, + 0.051657216623425484, + 0.5431056320667267, + 0.5292471460998058, + 0.4322461299598217, + 0.6360396705567837, + 0.7308965809643269, + 0.28662512451410294, + 1.8425938226282597, + 0.7712012566626072, + 0.4800590705126524, + 0.17671245336532593, + 0.6081442963331938, + 1.064732389524579, + 1.6482076030224562, + 0.5710605476051569, + 0.8515876363962889, + 0.4874708876013756, + 0.04310400038957596, + 1.034301783889532, + 1.4160644114017487, + 0.35713718831539154, + 0.78406254760921, + 0.5589346326887608, + 0.2015046402812004, + 0.597793310880661, + 0.229655921459198, + 0.07937255874276161, + 0.9807831887155771, + 0.4431096129119396, + 1.0056259986013174, + 0.40371459908783436 + ], + "unique_experts": 64, + "load_cv": 0.4909798883582398, + "normalized_load_entropy": 0.967928610330309, + "max_load_share": 0.035398230088495575 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "1c164f860ccad70255c3c4da29712d9ec954acd7c27844a141cbbcf823ef307e", + "route_weight_sha256": "61fb0aa1c3351ccd3d7bcd263fd6e7ad9e052eda0c25ee0cc126212954b2afe0", + "loads": [ + 17, + 12, + 12, + 19, + 7, + 13, + 14, + 14, + 15, + 13, + 13, + 16, + 14, + 16, + 11, + 16, + 17, + 15, + 20, + 16, + 10, + 6, + 15, + 20, + 14, + 2, + 14, + 20, + 8, + 7, + 12, + 3, + 19, + 6, + 11, + 7, + 7, + 13, + 17, + 8, + 29, + 13, + 14, + 4, + 8, + 15, + 37, + 8, + 13, + 11, + 2, + 17, + 14, + 8, + 28, + 9, + 3, + 19, + 6, + 2, + 22, + 7, + 19, + 11 + ], + "weighted_loads": [ + 1.602151486556977, + 0.8609953448176384, + 0.7617178522050381, + 2.057721715886146, + 0.3536286186426878, + 0.6413139207288623, + 0.9733057375997305, + 0.6097462847828865, + 1.671188473701477, + 0.5616315007209778, + 0.7171220071613789, + 0.5938745085150003, + 0.7761424640193582, + 0.7655893191695213, + 0.660583445802331, + 1.1255777813494205, + 1.2353988997638226, + 1.0733137391507626, + 1.2309034764766693, + 0.7350424397736788, + 0.5839031059294939, + 0.2309287954121828, + 1.9894956704229116, + 1.9849646016955376, + 0.6009027436375618, + 0.06016812473535538, + 2.79895231500268, + 1.3584943152964115, + 0.45489269495010376, + 0.4862233139574528, + 0.5694497600197792, + 0.1601690836250782, + 1.0662599932402372, + 0.3694710563868284, + 0.5431056320667267, + 0.5605452619493008, + 0.4322461299598217, + 0.6360396705567837, + 1.1027216762304306, + 0.3374652285128832, + 2.245661586523056, + 0.8250245377421379, + 0.5331306234002113, + 0.17671245336532593, + 0.6081442963331938, + 2.089821742847562, + 2.7000182326883078, + 0.6302984170615673, + 0.8902636971324682, + 0.4874708876013756, + 0.09137922152876854, + 1.1738021932542324, + 1.4160644114017487, + 0.4026857353746891, + 1.7514313999563456, + 0.5934926867485046, + 0.2015046402812004, + 1.6198251955211163, + 0.28651995584368706, + 0.07937255874276161, + 1.0101001858711243, + 0.4431096129119396, + 1.0735182650387287, + 0.461208114400506 + ], + "unique_experts": 64, + "load_cv": 0.5012761143034111, + "normalized_load_entropy": 0.969458455810088, + "max_load_share": 0.04468599033816425 + } + }, + "s1_period": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "e67cd08689c9215868a600d755204a88f7f719b2c39a67c628dede8781fa9881", + "route_weight_sha256": "fb7e83b237578ef3367c9de1d1d5b679957524f7d203348b5a2222b18913de88", + "loads": [ + 12, + 10, + 12, + 11, + 2, + 10, + 7, + 6, + 16, + 7, + 12, + 14, + 12, + 11, + 9, + 16, + 14, + 15, + 17, + 15, + 10, + 6, + 16, + 8, + 10, + 1, + 12, + 20, + 8, + 7, + 9, + 3, + 17, + 1, + 12, + 6, + 8, + 14, + 11, + 7, + 20, + 13, + 12, + 5, + 10, + 10, + 21, + 8, + 11, + 10, + 1, + 18, + 16, + 7, + 20, + 8, + 2, + 10, + 4, + 2, + 22, + 7, + 18, + 9 + ], + "weighted_loads": [ + 1.359023556113243, + 0.7403183542191982, + 0.7557142823934555, + 1.8108294401317835, + 0.11462696269154549, + 0.5625517480075359, + 0.4559454694390297, + 0.28893963247537613, + 1.6966300196945667, + 0.31723025254905224, + 0.6541282944381237, + 0.5798193477094173, + 0.7413710243999958, + 0.594941757619381, + 0.5592713039368391, + 1.1173909902572632, + 1.2080644201487303, + 1.0378171745687723, + 1.132412575185299, + 0.7051540575921535, + 0.5845548287034035, + 0.23250054381787777, + 1.9644333962351084, + 0.5942620970308781, + 0.4669831059873104, + 0.032741252332925797, + 2.7519624792039394, + 1.3647709786891937, + 0.42868736386299133, + 0.46073080599308014, + 0.447661641985178, + 0.15505940094590187, + 0.9536306746304035, + 0.026796521618962288, + 0.5620940513908863, + 0.5723084136843681, + 0.4697846844792366, + 0.6195798702538013, + 0.6873783208429813, + 0.3349860683083534, + 1.6819941885769367, + 0.8125948458909988, + 0.46270410902798176, + 0.18409965187311172, + 0.674227874726057, + 1.064601507037878, + 1.3970191068947315, + 0.6298597697168589, + 0.8169890530407429, + 0.4027486518025398, + 0.041632696986198425, + 1.1111809108406305, + 1.4652923233807087, + 0.30315260775387287, + 0.9873049296438694, + 0.5263171046972275, + 0.13968628644943237, + 0.6574840098619461, + 0.17901970073580742, + 0.09068407490849495, + 1.004572195932269, + 0.4282720573246479, + 1.1113559808582067, + 0.3575749881565571 + ], + "unique_experts": 64, + "load_cv": 0.48955999632509534, + "normalized_load_entropy": 0.9678502614585377, + "max_load_share": 0.032448377581120944 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "5ae71b3dfd1ecdff7e714aec74c5fbb890ea514ac8a968ff41df28903a193553", + "route_weight_sha256": "ba91e9ba53b9b877e4081135e6ae09465600a2423d81a5ea98d69f8815505f67", + "loads": [ + 18, + 16, + 18, + 20, + 6, + 12, + 21, + 14, + 17, + 12, + 14, + 15, + 13, + 16, + 10, + 19, + 18, + 16, + 19, + 15, + 11, + 6, + 18, + 23, + 12, + 2, + 12, + 20, + 8, + 8, + 9, + 3, + 19, + 12, + 12, + 6, + 14, + 15, + 20, + 8, + 29, + 14, + 16, + 5, + 12, + 14, + 40, + 11, + 18, + 13, + 1, + 29, + 22, + 9, + 32, + 8, + 2, + 27, + 5, + 3, + 24, + 8, + 24, + 11 + ], + "weighted_loads": [ + 1.689900433178991, + 1.1012494936585426, + 1.0733816400170326, + 2.3413508222438395, + 0.26561011373996735, + 0.6065666386857629, + 1.2741107866168022, + 0.5536207575351, + 1.7305783778429031, + 0.5067763067781925, + 0.7485105395317078, + 0.6108339726924896, + 0.7515624798834324, + 0.7987508047372103, + 0.6570284273475409, + 1.2389730457216501, + 1.2851928677409887, + 1.0970583613961935, + 1.224087554961443, + 0.7051540575921535, + 0.632780410349369, + 0.23250054381787777, + 2.0397802125662565, + 2.4223680086433887, + 0.5463816598057747, + 0.07832732796669006, + 2.7519624792039394, + 1.3647709786891937, + 0.42868736386299133, + 0.5056009963154793, + 0.447661641985178, + 0.15505940094590187, + 1.0453548207879066, + 0.7823711596429348, + 0.5620940513908863, + 0.5723084136843681, + 0.9036372676491737, + 0.6676150783896446, + 1.308795589953661, + 0.35837214440107346, + 2.0339557360857725, + 0.8660480342805386, + 0.5796235557645559, + 0.18409965187311172, + 0.7756773419678211, + 2.08038729429245, + 3.1592383347451687, + 0.8542875908315182, + 1.1081837881356478, + 0.5534200742840767, + 0.041632696986198425, + 1.8155355006456375, + 2.1053666919469833, + 0.37800254859030247, + 2.0591538175940514, + 0.5263171046972275, + 0.13968628644943237, + 2.230378843843937, + 0.2615557871758938, + 0.1269012726843357, + 1.0773194134235382, + 0.5526533387601376, + 1.3456579875200987, + 0.4409688264131546 + ], + "unique_experts": 64, + "load_cv": 0.5229143364926354, + "normalized_load_entropy": 0.9660767337408966, + "max_load_share": 0.04329004329004329 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 113, + "ordered_topk_exact_tokens": 57, + "set_exact_tokens": 76, + "mean_set_jaccard": 0.904551201011378, + "mean_token_weighted_tv": 0.019058955858041227, + "aggregate_load_tv": 0.03392330383480826 + }, + "system_bos": { + "tokens": 113, + "ordered_topk_exact_tokens": 55, + "set_exact_tokens": 68, + "mean_set_jaccard": 0.8767383059418459, + "mean_token_weighted_tv": 0.024199162486248312, + "aggregate_load_tv": 0.051622418879056046 + }, + "system_x": { + "tokens": 113, + "ordered_topk_exact_tokens": 48, + "set_exact_tokens": 63, + "mean_set_jaccard": 0.8678887484197219, + "mean_token_weighted_tv": 0.029095157890259165, + "aggregate_load_tv": 0.03687315634218289 + }, + "system_period": { + "tokens": 113, + "ordered_topk_exact_tokens": 40, + "set_exact_tokens": 57, + "mean_set_jaccard": 0.8527180783817953, + "mean_token_weighted_tv": 0.03221178741350902, + "aggregate_load_tv": 0.04424778761061947 + }, + "bos_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 48, + "set_exact_tokens": 64, + "mean_set_jaccard": 0.8647281921618205, + "mean_token_weighted_tv": 0.02780055869535535, + "aggregate_load_tv": 0.0471976401179941 + }, + "bos_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 35, + "set_exact_tokens": 55, + "mean_set_jaccard": 0.8419721871049304, + "mean_token_weighted_tv": 0.0322302869578774, + "aggregate_load_tv": 0.05309734513274336 + }, + "x_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 44, + "set_exact_tokens": 61, + "mean_set_jaccard": 0.8609355246523389, + "mean_token_weighted_tv": 0.02881282974298285, + "aggregate_load_tv": 0.048672566371681415 + }, + "x_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 32, + "set_exact_tokens": 57, + "mean_set_jaccard": 0.8432364096080911, + "mean_token_weighted_tv": 0.03585167769012989, + "aggregate_load_tv": 0.05309734513274336 + }, + "period_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 45, + "set_exact_tokens": 62, + "mean_set_jaccard": 0.8691529709228825, + "mean_token_weighted_tv": 0.02736847312807773, + "aggregate_load_tv": 0.03982300884955752 + }, + "period_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 34, + "set_exact_tokens": 54, + "mean_set_jaccard": 0.8280657395701645, + "mean_token_weighted_tv": 0.03799735607200228, + "aggregate_load_tv": 0.057522123893805316 + } + } + }, + "layer_24": { + "layer": 24, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "52409db1382f23eeafb1352e74cca5d21262c68d992a22e1b9bae2e769ec202e", + "route_weight_sha256": "d25ae5a8b3fe2e46da2cbb2a817635cf8390c91e82b360d612dbb215599c56ff", + "loads": [ + 5, + 4, + 6, + 11, + 6, + 23, + 11, + 12, + 11, + 19, + 9, + 13, + 13, + 13, + 6, + 20, + 1, + 12, + 11, + 10, + 23, + 7, + 1, + 11, + 17, + 14, + 73, + 1, + 4, + 10, + 1, + 10, + 17, + 8, + 4, + 6, + 10, + 7, + 20, + 14, + 6, + 8, + 8, + 6, + 8, + 17, + 3, + 2, + 11, + 10, + 8, + 6, + 4, + 11, + 10, + 5, + 9, + 4, + 3, + 9, + 20, + 15, + 12, + 9 + ], + "weighted_loads": [ + 0.16217878460884094, + 0.15322330966591835, + 0.25778225250542164, + 0.42529639787971973, + 0.40694041922688484, + 1.1880128774791956, + 0.45641077496111393, + 0.6671585738658905, + 1.1429186537861824, + 1.0775475017726421, + 1.63333335891366, + 0.8005472999066114, + 0.8949442263692617, + 0.8022743053734303, + 0.31138115003705025, + 1.0577745772898197, + 0.15097501873970032, + 0.67689492367208, + 0.403324281796813, + 0.35145479413336034, + 1.1317709106951952, + 0.3475962057709694, + 0.038277313113212585, + 0.8110296502709389, + 0.7123282346874475, + 0.8814443182200193, + 6.842646215111017, + 0.021231068298220634, + 0.1849086731672287, + 0.5738197509199381, + 0.04485439509153366, + 0.3466642632381536, + 0.8897286765277386, + 1.3478128634233144, + 0.1508113369345665, + 0.4111598879098892, + 0.44385302998125553, + 0.2602677902425512, + 0.8072035387158394, + 0.6686062049120665, + 0.3633312061429024, + 0.38975939899683, + 0.25786082155855183, + 0.1873369049280882, + 0.348234536126256, + 1.3611086569726467, + 0.10141656175255775, + 0.06400881335139275, + 1.4048718810081482, + 0.7379662003368139, + 1.4041409734636545, + 0.33197519183158875, + 0.1178341694176197, + 0.9023063704371452, + 0.8686469309031963, + 0.2228431161493063, + 0.4628967419266701, + 0.22604705020785332, + 0.2906516343355179, + 0.33001103810966015, + 1.0596327744424343, + 1.155642420053482, + 0.6418972108513117, + 0.33790676668286324 + ], + "unique_experts": 64, + "load_cv": 0.8974874746254566, + "normalized_load_entropy": 0.9359054055603252, + "max_load_share": 0.10766961651917405 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "9b301ddcacbbd04c952dccfc6b9d5958a262a02ac4a3e24a9acb1109cf06ed9b", + "route_weight_sha256": "2d68e9a3148b0667d47c7dfa9487f6b6096c54caa3a1ae4ec81eaddcdc08cbce", + "loads": [ + 5, + 4, + 8, + 11, + 6, + 28, + 11, + 13, + 19, + 19, + 18, + 13, + 15, + 13, + 7, + 20, + 2, + 12, + 11, + 11, + 24, + 7, + 6, + 11, + 26, + 14, + 75, + 1, + 12, + 15, + 1, + 14, + 18, + 12, + 11, + 7, + 11, + 9, + 21, + 15, + 6, + 9, + 12, + 6, + 8, + 19, + 3, + 7, + 11, + 10, + 14, + 12, + 7, + 14, + 10, + 5, + 9, + 5, + 11, + 9, + 24, + 32, + 16, + 13 + ], + "weighted_loads": [ + 0.16217878460884094, + 0.15322330966591835, + 0.32435514219105244, + 0.42529639787971973, + 0.40694041922688484, + 1.376686312025413, + 0.45641077496111393, + 0.7221277244389057, + 1.4966022842563689, + 1.0775475017726421, + 1.9624417060986161, + 0.8005472999066114, + 0.9341604337096214, + 0.8022743053734303, + 0.3442511521279812, + 1.0577745772898197, + 0.18958460539579391, + 0.67689492367208, + 0.403324281796813, + 0.38034359897142167, + 1.1652185935527086, + 0.3475962057709694, + 0.4877289943397045, + 0.8110296502709389, + 1.0434644212946296, + 0.8814443182200193, + 6.9552678763866425, + 0.021231068298220634, + 0.496707322075963, + 0.7694410961121321, + 0.04485439509153366, + 0.4716257139341451, + 0.9188315104693174, + 1.5335614032883313, + 0.40320378728210926, + 0.458065252751112, + 0.5362287703901529, + 1.157962106003879, + 0.846412543207407, + 0.7136907186359167, + 0.3633312061429024, + 0.45080266147851944, + 0.3755353124611247, + 0.1873369049280882, + 0.348234536126256, + 1.4559575878083706, + 0.10141656175255775, + 0.42296276916749775, + 1.4048718810081482, + 0.7379662003368139, + 1.6450645364820957, + 0.7557175122201443, + 0.20235403068363667, + 1.04052809253335, + 0.8686469309031963, + 0.2228431161493063, + 0.4628967419266701, + 0.2775775082409382, + 0.552179598424118, + 0.33001103810966015, + 1.1987427733838558, + 2.3840759438462555, + 0.7287461466621608, + 2.36962403729558 + ], + "unique_experts": 64, + "load_cv": 0.7770272731567923, + "normalized_load_entropy": 0.9480195936333069, + "max_load_share": 0.09057971014492754 + } + }, + "s1_eos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "881f539078100523b9aac5d4894bf80032051ce6a4a9212d631eae9d152b6bdf", + "route_weight_sha256": "863b907fdfb671fc3284ea7ac74fc5e6780fdf0a130f1130abbb37ff7fa73f5f", + "loads": [ + 4, + 3, + 6, + 11, + 7, + 22, + 9, + 11, + 11, + 18, + 9, + 13, + 12, + 13, + 6, + 20, + 1, + 12, + 10, + 9, + 22, + 6, + 2, + 11, + 19, + 14, + 74, + 1, + 4, + 10, + 1, + 11, + 18, + 8, + 3, + 7, + 10, + 8, + 22, + 15, + 6, + 8, + 8, + 4, + 8, + 17, + 3, + 3, + 11, + 9, + 8, + 6, + 5, + 11, + 10, + 5, + 10, + 4, + 3, + 10, + 20, + 14, + 13, + 9 + ], + "weighted_loads": [ + 0.13432378508150578, + 0.11166523024439812, + 0.2602315191179514, + 0.43656102754175663, + 0.44421581365168095, + 1.156537540256977, + 0.37477219477295876, + 0.6571148671209812, + 1.1400533951818943, + 1.0497221145778894, + 1.625712838023901, + 0.795949874445796, + 0.8647915683686733, + 0.7872817888855934, + 0.3032638356089592, + 1.039932420477271, + 0.10470721870660782, + 0.6908332798629999, + 0.3700303751975298, + 0.33225995652287565, + 0.992169389501214, + 0.30415749177336693, + 0.06349502690136433, + 0.804223857820034, + 0.7547536473721266, + 0.8911879863590002, + 6.834602268412709, + 0.02082090638577938, + 0.17721635103225708, + 0.5725798159837723, + 0.0436924546957016, + 0.38075355708951975, + 0.9223725236952305, + 1.3280926487132092, + 0.11724337562918663, + 0.4319525081664324, + 0.43728615529835224, + 0.2833277050046945, + 0.8934303838759661, + 0.6885739732533693, + 0.37314489483833313, + 0.4002605490386486, + 0.25288073847104897, + 0.13535224087536335, + 0.33455357886850834, + 1.3495330065488815, + 0.10128104873001575, + 0.0890057273209095, + 1.3735344968736172, + 0.7086120024323463, + 1.3916978035122156, + 0.3246702216565609, + 0.1463414542376995, + 0.9088039882481098, + 0.8474053107202053, + 0.22108159959316254, + 0.5150314420461655, + 0.24866283312439919, + 0.2998625710606575, + 0.34774817712605, + 1.0496089681982994, + 1.1194053627550602, + 0.6506182011216879, + 0.33893162570893764 + ], + "unique_experts": 64, + "load_cv": 0.9090476767839046, + "normalized_load_entropy": 0.9350841464247384, + "max_load_share": 0.10914454277286136 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "a0b0b4f99d57a22e7957ccb6fca2f7673f114d6bc682204b8803beb871ff74f5", + "route_weight_sha256": "f9fd4496575cb5a0a857ea9b241f5cee0951c3dd00d45f493317342311726678", + "loads": [ + 4, + 3, + 7, + 12, + 9, + 31, + 9, + 12, + 20, + 21, + 16, + 15, + 15, + 13, + 9, + 20, + 2, + 12, + 11, + 13, + 26, + 6, + 12, + 12, + 28, + 14, + 76, + 2, + 24, + 16, + 1, + 15, + 19, + 14, + 10, + 9, + 17, + 11, + 23, + 16, + 7, + 15, + 13, + 6, + 10, + 18, + 3, + 10, + 11, + 9, + 14, + 20, + 12, + 15, + 12, + 7, + 11, + 6, + 17, + 10, + 24, + 33, + 22, + 14 + ], + "weighted_loads": [ + 0.13432378508150578, + 0.11166523024439812, + 0.2853097431361675, + 0.551492827013135, + 0.5051760207861662, + 1.467299367999658, + 0.37477219477295876, + 0.6945958733558655, + 1.7321050129830837, + 1.1809472423046827, + 1.9189108535647392, + 0.8624071329832077, + 0.9252902527805418, + 0.7872817888855934, + 0.40014662593603134, + 1.039932420477271, + 0.13341465219855309, + 0.6908332798629999, + 0.40298409946262836, + 0.46737822867839895, + 1.1772066783159971, + 0.30415749177336693, + 0.7713301535695791, + 0.8290664367377758, + 1.0809756787493825, + 0.8911879863590002, + 6.9472358878701925, + 0.05266354791820049, + 1.1428226698189974, + 0.8285471890121698, + 0.0436924546957016, + 0.5475242853945019, + 0.95124327018857, + 1.6318140002622386, + 0.37020566454157233, + 0.5324673447757959, + 0.9586868193000555, + 1.2269914175956274, + 0.9424630720168352, + 0.7366579342633486, + 0.4875612407922745, + 0.814671665430069, + 0.3961447089727699, + 0.3413379918783903, + 0.4362471494823694, + 1.4082521386444569, + 0.10128104873001575, + 0.6347499313997105, + 1.3735344968736172, + 0.7086120024323463, + 1.6226657051593065, + 1.3041545078158379, + 0.35297284089028835, + 1.1920747309923172, + 1.0230133011937141, + 0.3178491182625294, + 0.5433612503111362, + 0.33655573800206184, + 0.8676945246406831, + 0.34774817712605, + 1.204936584457755, + 2.966595380101353, + 1.0902881029760465, + 2.4100809413939714 + ], + "unique_experts": 64, + "load_cv": 0.7136295031097202, + "normalized_load_entropy": 0.9531694113947106, + "max_load_share": 0.08225108225108226 + } + }, + "s0_bos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "9bbff5ceaf05437ad8c80bfd32d18a4cc9d080eb0ee53f8384dba701ad234430", + "route_weight_sha256": "212757381b0a89adbc0faf5b6a42c34a5f4b66c84189a21c7b86eb93e8a726c7", + "loads": [ + 3, + 3, + 7, + 12, + 6, + 20, + 10, + 12, + 11, + 19, + 10, + 13, + 13, + 13, + 7, + 21, + 1, + 12, + 11, + 11, + 18, + 7, + 1, + 11, + 18, + 14, + 76, + 1, + 3, + 10, + 1, + 9, + 18, + 9, + 4, + 6, + 9, + 8, + 19, + 15, + 5, + 7, + 8, + 6, + 10, + 18, + 3, + 2, + 10, + 10, + 9, + 6, + 8, + 10, + 10, + 6, + 8, + 3, + 3, + 9, + 20, + 15, + 12, + 8 + ], + "weighted_loads": [ + 0.1010700948536396, + 0.11649460718035698, + 0.24721531942486763, + 0.4486390855163336, + 0.42215265706181526, + 1.152339607477188, + 0.4492125641554594, + 0.6644875053316355, + 1.141843982040882, + 1.0751948151737452, + 1.6351149193942547, + 0.8167113922536373, + 0.9015033524483442, + 0.7982097938656807, + 0.3577951565384865, + 1.0908976197242737, + 0.0846279188990593, + 0.6362416563260922, + 0.39566587656736374, + 0.33969372083174676, + 0.9214369934052229, + 0.3674047850072384, + 0.036726076155900955, + 0.8206705562770367, + 0.7366314493119717, + 0.8966486398130655, + 6.973973769694567, + 0.021511653438210487, + 0.1387959159910679, + 0.5875812955200672, + 0.05111432820558548, + 0.30110226731721923, + 0.9025573544204235, + 1.35628940247625, + 0.150575190782547, + 0.4204771500080824, + 0.4109163098037243, + 0.259741908772412, + 0.8000690173357725, + 0.6938717477023602, + 0.27885303273797035, + 0.35098855197429657, + 0.2111181485306588, + 0.18717225454747677, + 0.4150455668568611, + 1.3867649864405394, + 0.10883273556828499, + 0.06364953517913818, + 1.3705423213541508, + 0.739213963970542, + 2.405634567141533, + 0.3209085091948509, + 0.2167779542505741, + 0.8740279302001, + 0.872980922460556, + 0.26090285927057266, + 0.4269781578332186, + 0.12104387395083904, + 0.3001598287373781, + 0.2979861907660961, + 1.0282516535371542, + 1.170982301235199, + 0.6564968712627888, + 0.28971211053431034 + ], + "unique_experts": 64, + "load_cv": 0.9192518550376393, + "normalized_load_entropy": 0.9344289841874135, + "max_load_share": 0.11209439528023599 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "15cd9a88df3934f79b312827b8fb83d1e09729ecbb254c0690dcf69f568008a7", + "route_weight_sha256": "69affd8b5a8eb1fc4ff4b7eed2bfd97272a06426ae0573385da4ed4c841229f4", + "loads": [ + 3, + 3, + 10, + 12, + 6, + 25, + 11, + 13, + 18, + 19, + 18, + 13, + 14, + 13, + 8, + 21, + 1, + 12, + 11, + 13, + 19, + 7, + 7, + 11, + 26, + 14, + 79, + 2, + 11, + 16, + 2, + 14, + 19, + 13, + 11, + 6, + 10, + 10, + 19, + 16, + 5, + 8, + 13, + 6, + 10, + 20, + 4, + 6, + 10, + 10, + 16, + 12, + 11, + 13, + 10, + 6, + 8, + 4, + 10, + 9, + 24, + 33, + 14, + 10 + ], + "weighted_loads": [ + 0.1010700948536396, + 0.11649460718035698, + 0.3394218888133764, + 0.4486390855163336, + 0.42215265706181526, + 1.3437948094215244, + 0.5040861647576094, + 0.7194566559046507, + 1.4909917823970318, + 1.0751948151737452, + 1.9507395420223475, + 0.8167113922536373, + 0.9042462073266506, + 0.7982097938656807, + 0.3906651586294174, + 1.0908976197242737, + 0.0846279188990593, + 0.6362416563260922, + 0.39566587656736374, + 0.41316930335688085, + 0.9548846762627363, + 0.3674047850072384, + 0.6048392578959465, + 0.8206705562770367, + 1.0395134529098868, + 0.8966486398130655, + 7.534128505736589, + 0.050898993387818336, + 0.45456184819340706, + 0.8191467300057411, + 0.09146208688616753, + 0.45384549695972964, + 0.9316601883620024, + 1.542037942341267, + 0.37427409552037716, + 0.4204771500080824, + 0.5032920502126217, + 1.1603168723122508, + 0.8000690173357725, + 0.7374618910253048, + 0.27885303273797035, + 0.412031814455986, + 0.43995728379377397, + 0.18717225454747677, + 0.4150455668568611, + 1.4999660979956388, + 0.1646651178598404, + 0.45380057231523097, + 1.3705423213541508, + 0.739213963970542, + 2.7112280670553446, + 0.7206267043948174, + 0.30129781551659107, + 1.0122496522963047, + 0.872980922460556, + 0.26090285927057266, + 0.4269781578332186, + 0.1729451473802328, + 0.5594290513545275, + 0.2979861907660961, + 1.1678649801760912, + 2.4630995211191475, + 0.7169200801290572, + 1.3075516317039728 + ], + "unique_experts": 64, + "load_cv": 0.7999947489850773, + "normalized_load_entropy": 0.9470516142667882, + "max_load_share": 0.09541062801932366 + } + }, + "s1_bos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "7c87025fc34fcd04e64c62679bfed39af747e98e56b3b93a4665ece264c415c4", + "route_weight_sha256": "8a129170b622a01ebe38ff24a98949582a0b522a9cecdcf0dfc27d3cc65b9159", + "loads": [ + 4, + 4, + 6, + 10, + 6, + 21, + 9, + 12, + 12, + 19, + 10, + 13, + 12, + 13, + 6, + 21, + 1, + 12, + 11, + 10, + 20, + 8, + 0, + 11, + 17, + 13, + 76, + 2, + 4, + 10, + 1, + 9, + 20, + 8, + 4, + 6, + 7, + 7, + 22, + 15, + 5, + 7, + 7, + 6, + 9, + 17, + 3, + 2, + 11, + 9, + 9, + 6, + 8, + 10, + 10, + 5, + 10, + 5, + 4, + 10, + 19, + 14, + 12, + 8 + ], + "weighted_loads": [ + 0.1310253944247961, + 0.1396113969385624, + 0.2481540683656931, + 0.3887315168976784, + 0.43089114129543304, + 1.124867307022214, + 0.39061676152050495, + 0.7050850335508585, + 1.1877075172960758, + 1.060148486867547, + 1.5754183009266853, + 0.8396523036062717, + 0.8808629792183638, + 0.8008613996207714, + 0.3111923187971115, + 1.0961532890796661, + 0.12156334519386292, + 0.6979886535555124, + 0.4062072429805994, + 0.3389671675968202, + 0.9459899142384529, + 0.37496077828109264, + 0.0, + 0.7900545075535774, + 0.6929367482662201, + 0.8687673769891262, + 6.9976682141423225, + 0.05708060413599014, + 0.17079193331301212, + 0.5732980705797672, + 0.04516725242137909, + 0.3016372827877376, + 0.985306553542614, + 1.3664787994548533, + 0.1465202234685421, + 0.4205366764217615, + 0.31317598186433315, + 0.2577639433641252, + 0.9062040466815233, + 0.6913402527570724, + 0.31888408213853836, + 0.34776794351637363, + 0.2147723147634224, + 0.18259866908192635, + 0.38051898777484894, + 1.3457645662128925, + 0.10747676901519299, + 0.06330579146742821, + 1.3900117576122284, + 0.7177694998681545, + 1.5157132018357515, + 0.3180413208901882, + 0.21534219197928905, + 0.889241348952055, + 0.9110260270535946, + 0.24460476636886597, + 0.5298827309161425, + 0.2518170475959778, + 0.32407232373952866, + 0.3517376687377691, + 0.9699035231024027, + 1.105770442634821, + 0.6483872104436159, + 0.28893336094915867 + ], + "unique_experts": 63, + "load_cv": 0.9228796371619997, + "normalized_load_entropy": 0.9343300757068485, + "max_load_share": 0.11209439528023599 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "0073a6164d2b97eac234bf16523a44013aeb09cd767bb6ff397708223d71179e", + "route_weight_sha256": "89c1ca2441aadddda7dc70de8d6efb668205bfbce9c3351a45d6119ec337af5e", + "loads": [ + 4, + 4, + 9, + 11, + 8, + 30, + 9, + 13, + 20, + 22, + 16, + 15, + 15, + 13, + 9, + 21, + 2, + 12, + 12, + 15, + 24, + 8, + 11, + 12, + 26, + 13, + 78, + 3, + 25, + 16, + 1, + 14, + 20, + 14, + 11, + 8, + 15, + 10, + 22, + 16, + 6, + 14, + 13, + 9, + 10, + 19, + 3, + 9, + 11, + 9, + 16, + 20, + 15, + 14, + 12, + 7, + 10, + 6, + 17, + 10, + 22, + 34, + 20, + 11 + ], + "weighted_loads": [ + 0.1310253944247961, + 0.1396113969385624, + 0.3402332440018654, + 0.5036633163690567, + 0.4918513484299183, + 1.4336599686648697, + 0.39061676152050495, + 0.7425660397857428, + 1.7754182294011116, + 1.1913736145943403, + 1.8556324075907469, + 0.9061095621436834, + 0.9413616636302322, + 0.8008613996207714, + 0.4096353203058243, + 1.0961532890796661, + 0.15027077868580818, + 0.6979886535555124, + 0.439160967245698, + 0.5062858693408998, + 1.131027203053236, + 0.37496077828109264, + 0.8247713260352612, + 0.8148970864713192, + 1.019158779643476, + 0.8687673769891262, + 7.116295073181391, + 0.0871540792286396, + 1.1790313832461834, + 0.8384604025632143, + 0.04516725242137909, + 0.5084630047966812, + 0.985306553542614, + 1.6702001510038826, + 0.38604785269126296, + 0.5210515130311251, + 0.8906072769314051, + 1.1978515374560175, + 0.9062040466815233, + 0.7375226691365242, + 0.4333004280924797, + 0.762179059907794, + 0.5084402691561536, + 0.44968774914741516, + 0.41939807683229446, + 1.4489728659391403, + 0.10747676901519299, + 0.6628376415465027, + 1.3900117576122284, + 0.7177694998681545, + 1.856754457578063, + 1.2575917281210423, + 0.4219735786318779, + 1.1725120916962624, + 1.0866340175271034, + 0.3413722850382328, + 0.5298827309161425, + 0.2965398021042347, + 0.8911439068615437, + 0.3517376687377691, + 1.0767641142010689, + 3.0179023281671107, + 1.1205625836737454, + 1.3475217949599028 + ], + "unique_experts": 64, + "load_cv": 0.7172965535140796, + "normalized_load_entropy": 0.9542716630388438, + "max_load_share": 0.08441558441558442 + } + }, + "s0_x": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "82422aeac3d9bcf0e0d4c545c15ea513305c541da1b6b9a17d56f3885de53197", + "route_weight_sha256": "4191ac7e291260d4586c708a622859aa9640ae7d90129523d0f5d96825a570b5", + "loads": [ + 6, + 5, + 8, + 11, + 7, + 22, + 11, + 10, + 11, + 19, + 10, + 13, + 12, + 13, + 6, + 19, + 1, + 11, + 10, + 9, + 21, + 6, + 0, + 10, + 19, + 16, + 74, + 1, + 5, + 11, + 1, + 12, + 17, + 8, + 5, + 7, + 9, + 7, + 20, + 14, + 6, + 7, + 8, + 6, + 9, + 18, + 3, + 2, + 10, + 10, + 7, + 6, + 4, + 10, + 10, + 5, + 8, + 4, + 2, + 10, + 19, + 15, + 14, + 8 + ], + "weighted_loads": [ + 0.18160458095371723, + 0.1777641847729683, + 0.32700804993510246, + 0.4079790133982897, + 0.4466863591223955, + 1.1799666713923216, + 0.4518816042691469, + 0.6076803859323263, + 1.1361995302140713, + 1.0619532708078623, + 1.6746764443814754, + 0.8098339419811964, + 0.8659907188266516, + 0.8195398896932602, + 0.3155125416815281, + 1.0219117384403944, + 0.12339372932910919, + 0.6372031904757023, + 0.3728528991341591, + 0.30744258674485536, + 1.0639707334339619, + 0.3127230368554592, + 0.0, + 0.7618926130235195, + 0.8025926798582077, + 0.9839663319289684, + 6.955335829406977, + 0.02231246791779995, + 0.21049227938055992, + 0.6130736339837313, + 0.04518627002835274, + 0.3968158908899113, + 0.9061456024646759, + 1.347486663302334, + 0.19385038316249847, + 0.4430125281214714, + 0.4198770150542259, + 0.25561735619999126, + 0.8131997082382441, + 0.676804918795824, + 0.34942200779914856, + 0.37378718331456184, + 0.2612518836892832, + 0.1904759258031845, + 0.3752111401408911, + 1.332725239917636, + 0.11307428032159805, + 0.06688189134001732, + 1.3964034356176853, + 0.7312480248510838, + 1.3783349059522152, + 0.32307662442326546, + 0.12207969091832638, + 0.8641536608338356, + 0.892664197832346, + 0.21163203567266464, + 0.45326560549438, + 0.2323385663330555, + 0.2574802413582802, + 0.3552284352481365, + 0.9985406547784805, + 1.1788478270173073, + 0.7040813732892275, + 0.28140266984701157 + ], + "unique_experts": 63, + "load_cv": 0.9029006548356666, + "normalized_load_entropy": 0.9351558595064862, + "max_load_share": 0.10914454277286136 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "c6b190901c24314b50722878a4e89defc57459f5e70536844eaf4434ef2c91a8", + "route_weight_sha256": "355d42f98e99631017540c28e16dba4da1d6b3dbece905eeed77b4dcd865c523", + "loads": [ + 6, + 5, + 11, + 11, + 7, + 28, + 11, + 12, + 19, + 19, + 19, + 13, + 13, + 13, + 7, + 19, + 2, + 12, + 10, + 10, + 22, + 6, + 5, + 10, + 28, + 16, + 75, + 1, + 14, + 17, + 1, + 14, + 18, + 12, + 13, + 8, + 11, + 9, + 21, + 15, + 6, + 8, + 11, + 6, + 9, + 20, + 3, + 7, + 10, + 10, + 13, + 12, + 7, + 14, + 10, + 5, + 8, + 4, + 10, + 10, + 23, + 32, + 16, + 11 + ], + "weighted_loads": [ + 0.18160458095371723, + 0.1777641847729683, + 0.4281576797366142, + 0.4079790133982897, + 0.4466863591223955, + 1.400235125562176, + 0.4518816042691469, + 0.6974707897752523, + 1.5660682618618011, + 1.0619532708078623, + 2.0428485069423914, + 0.8098339419811964, + 0.868733573704958, + 0.8195398896932602, + 0.34838254377245903, + 1.0219117384403944, + 0.1682874709367752, + 0.665613466873765, + 0.3728528991341591, + 0.337076049173902, + 1.0974184162914753, + 0.3127230368554592, + 0.4109025150537491, + 0.7618926130235195, + 1.133716662414372, + 0.9839663319289684, + 7.023997630923986, + 0.02231246791779995, + 0.5685318484902382, + 0.8445353303104639, + 0.04518627002835274, + 0.45847515619948354, + 0.9352484364062548, + 1.5332352031673508, + 0.4747448656708002, + 0.47650786861777306, + 0.5548874251544476, + 1.157653006065857, + 0.8506693858653307, + 0.7197113372385502, + 0.34942200779914856, + 0.4348304457962513, + 0.3430417372062493, + 0.1904759258031845, + 0.3752111401408911, + 1.417482240125537, + 0.11307428032159805, + 0.489753375062719, + 1.3964034356176853, + 0.7312480248510838, + 1.6148904878646135, + 0.752922061830759, + 0.20659955218434334, + 1.0509168319404125, + 0.892664197832346, + 0.21163203567266464, + 0.45326560549438, + 0.2323385663330555, + 0.5477951783686876, + 0.3552284352481365, + 1.1345530524849892, + 2.4108949792571366, + 0.7548350621946156, + 1.347423069179058 + ], + "unique_experts": 64, + "load_cv": 0.7782277331412786, + "normalized_load_entropy": 0.9478937172063048, + "max_load_share": 0.09057971014492754 + } + }, + "s1_x": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "1ce8e5bc134ff03777a843feecce8ecabaebf0b151387ddaa478d9d44adf18ea", + "route_weight_sha256": "bd58d5d7e73cb7048b9b9cf9ac72e554bfcab5e596f519c83d15293d3dc69ef6", + "loads": [ + 6, + 6, + 6, + 13, + 6, + 20, + 9, + 11, + 11, + 19, + 10, + 12, + 12, + 13, + 5, + 19, + 1, + 12, + 10, + 7, + 24, + 6, + 0, + 10, + 21, + 15, + 75, + 3, + 9, + 8, + 1, + 11, + 20, + 8, + 3, + 7, + 7, + 7, + 18, + 12, + 5, + 5, + 7, + 7, + 10, + 17, + 4, + 2, + 11, + 10, + 9, + 6, + 2, + 11, + 10, + 6, + 8, + 4, + 5, + 12, + 19, + 14, + 13, + 8 + ], + "weighted_loads": [ + 0.18900352157652378, + 0.2100028246641159, + 0.2461850717663765, + 0.4942086488008499, + 0.4128693528473377, + 1.0509729012846947, + 0.3713250048458576, + 0.682938614860177, + 1.1534201614558697, + 1.0575234908610582, + 1.6041954942047596, + 0.7934728264808655, + 0.83751524053514, + 0.7920942530035973, + 0.25112004950642586, + 1.0111777186393738, + 0.11390595883131027, + 0.6715865544974804, + 0.3623317461460829, + 0.22997828493203087, + 1.1635650675743818, + 0.31214121729135513, + 0.0, + 0.7392916418612003, + 0.8178476169705391, + 0.9293595589697361, + 6.9526691026985645, + 0.08404145017266273, + 0.4255909975618124, + 0.4765626937150955, + 0.042789164930582047, + 0.36078142506084987, + 0.9886975027620792, + 1.3222967516776407, + 0.1078508235514164, + 0.4427661430090666, + 0.2977682389318943, + 0.23216743536977447, + 0.7353840991854668, + 0.6080808974802494, + 0.28488363325595856, + 0.28363493271172047, + 0.21329415862032874, + 0.21792479418218136, + 0.3917831964790821, + 1.2759207431226969, + 0.1406191848218441, + 0.06145675107836723, + 1.362947165966034, + 0.7132079750299454, + 1.6100168973207474, + 0.3257181718945503, + 0.06556905247271061, + 0.9379658252000809, + 0.8976772949099541, + 0.24946177192032337, + 0.4666398037225008, + 0.21896949969232082, + 0.35327849350869656, + 0.4041487071663141, + 0.9925387501716614, + 1.1263691522181034, + 0.651752756908536, + 0.29116478376090527 + ], + "unique_experts": 63, + "load_cv": 0.9150012637563207, + "normalized_load_entropy": 0.9348016073315802, + "max_load_share": 0.11061946902654868 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "b5bf0dfeddedaa8cab81de627db5c465a8d7b54a7e92a4a5dcb41e241da8fb1d", + "route_weight_sha256": "9d7c4dcd7963201e1ed4b6db9341dcbe113ed7cf20a616b3b865f251e8c8fcc7", + "loads": [ + 6, + 6, + 8, + 14, + 8, + 30, + 10, + 12, + 20, + 22, + 16, + 14, + 15, + 13, + 8, + 19, + 3, + 12, + 11, + 10, + 30, + 6, + 9, + 11, + 30, + 15, + 76, + 4, + 31, + 15, + 1, + 15, + 20, + 15, + 10, + 10, + 16, + 9, + 18, + 13, + 6, + 13, + 11, + 9, + 11, + 18, + 4, + 7, + 11, + 10, + 13, + 20, + 9, + 16, + 12, + 8, + 9, + 5, + 19, + 12, + 23, + 34, + 21, + 12 + ], + "weighted_loads": [ + 0.18900352157652378, + 0.2100028246641159, + 0.30804635025560856, + 0.6091404482722282, + 0.47382955998182297, + 1.3845856913831085, + 0.40030381083488464, + 0.7204196210950613, + 1.791252974420786, + 1.1887486185878515, + 1.8844096008688211, + 0.8599300850182772, + 0.8980139249470085, + 0.7920942530035973, + 0.3526194542646408, + 1.0111777186393738, + 0.17672495916485786, + 0.6715865544974804, + 0.39528547041118145, + 0.320183267019047, + 1.4185903575271368, + 0.31214121729135513, + 0.609371080994606, + 0.7641342207789421, + 1.144069648347795, + 0.9293595589697361, + 7.026264172047377, + 0.11020923033356667, + 1.4678641315549612, + 0.762430252507329, + 0.042789164930582047, + 0.5255573684444244, + 0.9886975027620792, + 1.664205852910527, + 0.34796125581488013, + 0.5959701593965292, + 0.9392785541713238, + 1.1401766701856104, + 0.7353840991854668, + 0.6573359109461308, + 0.3992999792098999, + 0.735724302008748, + 0.31272167146721586, + 0.4239105451852083, + 0.43066228553652763, + 1.3346398752182722, + 0.1406191848218441, + 0.5706537126097828, + 1.362947165966034, + 0.7132079750299454, + 1.771222461014986, + 1.3028924278914928, + 0.27220043912529945, + 1.2541928552091122, + 1.073285285383463, + 0.3462292905896902, + 0.49565851874649525, + 0.25073392130434513, + 0.9682373870164156, + 0.4041487071663141, + 1.1443043444305658, + 2.9931072131730616, + 1.0894930590875447, + 1.4059955682605505 + ], + "unique_experts": 64, + "load_cv": 0.7235396874766685, + "normalized_load_entropy": 0.9535618868193099, + "max_load_share": 0.08225108225108226 + } + }, + "s0_period": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "a9a9ed1f1f662fcbde6170f4d4323b73046fa162632a1d245464e87d5bb4f964", + "route_weight_sha256": "b2cf3d3f828e96409818a09bcf61aa22ff039ab9e4a60f2294d4f57ca5edda34", + "loads": [ + 5, + 5, + 7, + 11, + 7, + 21, + 12, + 9, + 11, + 19, + 9, + 13, + 13, + 13, + 6, + 20, + 1, + 11, + 10, + 11, + 22, + 6, + 1, + 11, + 14, + 12, + 75, + 1, + 5, + 10, + 1, + 13, + 19, + 8, + 5, + 7, + 9, + 7, + 20, + 14, + 6, + 7, + 8, + 6, + 10, + 18, + 4, + 1, + 10, + 10, + 7, + 6, + 5, + 10, + 10, + 6, + 10, + 5, + 3, + 8, + 19, + 15, + 13, + 7 + ], + "weighted_loads": [ + 0.16043119877576828, + 0.17547062784433365, + 0.30364572070539, + 0.41038618609309196, + 0.44766586273908615, + 1.1665918957442045, + 0.4793427214026451, + 0.5864730626344681, + 1.128184787929058, + 1.0650728158652782, + 1.6253177598118782, + 0.8109072148799896, + 0.8887226209044456, + 0.8077875301241875, + 0.3071996308863163, + 1.0593750029802322, + 0.07646474987268448, + 0.6556956134736538, + 0.37137193605303764, + 0.3801012585611261, + 1.0805099159479141, + 0.31494269520044327, + 0.03817764297127724, + 0.7729128152132034, + 0.6208173800259829, + 0.8093016222119331, + 7.033615853637457, + 0.022103190422058105, + 0.22327602468430996, + 0.5712723135948181, + 0.04328759014606476, + 0.43100723914494665, + 0.9581530168652534, + 1.3614878692642378, + 0.19821710139513016, + 0.43769773095846176, + 0.4279606584459543, + 0.25668522389128157, + 0.8166093770414591, + 0.6767132431268692, + 0.3624274283647537, + 0.370117774233222, + 0.26265360382581093, + 0.18696070462465286, + 0.4037222769111395, + 1.3460173718631268, + 0.1431209221482277, + 0.023903587833046913, + 1.3936362713575363, + 0.7275689970701933, + 1.3604938630014658, + 0.3292115144431591, + 0.14918594621121883, + 0.8618498165160418, + 0.9052397944033146, + 0.23454776220023632, + 0.5111270602792501, + 0.253815608099103, + 0.29476233199238777, + 0.28014278411865234, + 0.9970836527645588, + 1.1861763335764408, + 0.6834800075739622, + 0.26279422640800476 + ], + "unique_experts": 64, + "load_cv": 0.9065938694921772, + "normalized_load_entropy": 0.936748032198713, + "max_load_share": 0.11061946902654868 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "572bc728e8df22473e5e8cf56087a2f47aad2207d6b23d714b7d6d3d2072d451", + "route_weight_sha256": "e9cbbe0206074ce094fa2758a2bd89074d0e791910fc19ac020d9ea0644e171b", + "loads": [ + 5, + 5, + 10, + 11, + 7, + 27, + 12, + 11, + 18, + 19, + 17, + 13, + 14, + 13, + 7, + 20, + 2, + 12, + 10, + 12, + 23, + 6, + 6, + 11, + 22, + 12, + 76, + 1, + 14, + 15, + 1, + 15, + 20, + 13, + 12, + 7, + 10, + 10, + 20, + 15, + 6, + 9, + 12, + 7, + 10, + 19, + 4, + 6, + 10, + 10, + 14, + 13, + 8, + 13, + 10, + 6, + 11, + 6, + 10, + 8, + 23, + 33, + 16, + 10 + ], + "weighted_loads": [ + 0.16043119877576828, + 0.17547062784433365, + 0.3999024089425802, + 0.41038618609309196, + 0.44766586273908615, + 1.3913087917026132, + 0.4793427214026451, + 0.6806206665933132, + 1.4773325882852077, + 1.0650728158652782, + 1.940942382439971, + 0.8109072148799896, + 0.891465475782752, + 0.8077875301241875, + 0.34006963297724724, + 1.0593750029802322, + 0.14853005856275558, + 0.6840934678912163, + 0.37137193605303764, + 0.41174492488812575, + 1.1139575988054276, + 0.31494269520044327, + 0.46162738278508186, + 0.7729128152132034, + 0.923699383623898, + 0.8093016222119331, + 7.103651870042086, + 0.022103190422058105, + 0.5792212467640638, + 0.7668936587870121, + 0.04328759014606476, + 0.49430166847696455, + 0.9872558508068323, + 1.5850164593175577, + 0.4497308563441038, + 0.43769773095846176, + 0.5203363988548517, + 1.1882715639610524, + 0.8166093770414591, + 0.7231802493333817, + 0.3624274283647537, + 0.49190555326640606, + 0.3805646916405294, + 0.22433705255389214, + 0.4037222769111395, + 1.3955126963555813, + 0.1431209221482277, + 0.45058887102641165, + 1.3936362713575363, + 0.7275689970701933, + 1.6814159639179707, + 0.8377767130732536, + 0.2337058074772358, + 1.0000715386122465, + 0.9052397944033146, + 0.23454776220023632, + 0.5419809762388468, + 0.2850186061114073, + 0.5545330382883549, + 0.28014278411865234, + 1.1312103532254696, + 2.503108431119472, + 0.7698812861926854, + 1.340317029505968 + ], + "unique_experts": 64, + "load_cv": 0.7707547417600943, + "normalized_load_entropy": 0.9502532380025009, + "max_load_share": 0.09178743961352658 + } + }, + "s1_period": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "b4f589689bc495caa15ca416415bb259a7a2d5a15419e674a3330ad7be6ebd11", + "route_weight_sha256": "a021340a3a51aa43bb9db6d343e5f54ca25ad78e4f65fca9fd32d44469e71022", + "loads": [ + 6, + 4, + 6, + 12, + 7, + 19, + 9, + 11, + 10, + 19, + 10, + 12, + 11, + 13, + 5, + 18, + 1, + 11, + 10, + 8, + 27, + 6, + 1, + 11, + 18, + 16, + 75, + 2, + 11, + 9, + 1, + 13, + 21, + 8, + 3, + 7, + 5, + 7, + 17, + 13, + 5, + 6, + 7, + 7, + 10, + 17, + 5, + 1, + 11, + 10, + 8, + 7, + 3, + 11, + 10, + 6, + 8, + 5, + 4, + 11, + 19, + 14, + 12, + 8 + ], + "weighted_loads": [ + 0.19587824121117592, + 0.14931166544556618, + 0.24184269085526466, + 0.4737309664487839, + 0.45586055144667625, + 1.012491075322032, + 0.37190745398402214, + 0.6765782628208399, + 1.11674515157938, + 1.0609829500317574, + 1.6124340929090977, + 0.7878100648522377, + 0.813513670116663, + 0.7884362079203129, + 0.23977255076169968, + 0.9717947319149971, + 0.09001347422599792, + 0.63082573749125, + 0.369946613907814, + 0.25850632335527735, + 1.3050954043865204, + 0.31153156980872154, + 0.037878695875406265, + 0.7941526733338833, + 0.6910426393151283, + 0.9543611835688353, + 6.88190334290266, + 0.06083895079791546, + 0.5287759024649858, + 0.5067802332341671, + 0.04034273326396942, + 0.4222714321855392, + 1.0106430687010288, + 1.318923096105209, + 0.10797679424285889, + 0.4459196701645851, + 0.22686109691858292, + 0.22655459360998975, + 0.7122815307229757, + 0.6370507944375277, + 0.30495699867606163, + 0.31388239935040474, + 0.22132513806377574, + 0.21937711350619793, + 0.382929103448987, + 1.2642895504832268, + 0.1630220077931881, + 0.024864306673407555, + 1.4051507338881493, + 0.7080210708081722, + 1.6058617066591978, + 0.37748127430677414, + 0.09019703231751919, + 0.9409385733306408, + 0.8991914764046669, + 0.242742870002985, + 0.48619814217090607, + 0.23092983290553093, + 0.32266996800899506, + 0.3618062883615494, + 0.9872186277061701, + 1.090332467108965, + 0.6117993108928204, + 0.2962784245610237 + ], + "unique_experts": 64, + "load_cv": 0.9154576282591836, + "normalized_load_entropy": 0.9353938376685453, + "max_load_share": 0.11061946902654868 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "5d73b80eb1264ead35515e144d4425983963f5d6877254f732ee2967816df9fb", + "route_weight_sha256": "ac239c809caf5d21bc567029a16eda82d970726e88eb20ceeb0c3b05a1dc0c2a", + "loads": [ + 6, + 4, + 8, + 13, + 9, + 29, + 9, + 13, + 18, + 22, + 16, + 14, + 14, + 13, + 9, + 18, + 2, + 11, + 11, + 11, + 32, + 6, + 10, + 12, + 28, + 16, + 76, + 3, + 33, + 15, + 1, + 16, + 22, + 14, + 10, + 9, + 12, + 10, + 17, + 14, + 6, + 15, + 10, + 10, + 11, + 18, + 5, + 7, + 11, + 10, + 15, + 22, + 10, + 16, + 12, + 8, + 9, + 5, + 19, + 11, + 22, + 34, + 20, + 12 + ], + "weighted_loads": [ + 0.19587824121117592, + 0.14931166544556618, + 0.30380977503955364, + 0.5886627659201622, + 0.5168207585811615, + 1.3416909349616617, + 0.37190745398402214, + 0.7531316410750151, + 1.7044558636844158, + 1.1922080777585506, + 1.8926481995731592, + 0.8542673233896494, + 0.8740123545285314, + 0.7884362079203129, + 0.36592536233365536, + 0.9717947319149971, + 0.11872090771794319, + 0.63082573749125, + 0.4029003381729126, + 0.3474268439738353, + 1.5213482026010752, + 0.31153156980872154, + 0.6547763012349606, + 0.8189952522516251, + 1.0545676751062274, + 0.9543611835688353, + 6.951636612415314, + 0.08942510560154915, + 1.594226874411106, + 0.7665511388331652, + 0.04034273326396942, + 0.5612044090572681, + 1.044046562165022, + 1.6226444476542383, + 0.3537015705369413, + 0.5464345067739487, + 0.7482617609202862, + 1.1700580702893149, + 0.7122815307229757, + 0.6833957452327013, + 0.419373344630003, + 0.8174592740833759, + 0.2950170807928316, + 0.47367661260068417, + 0.42180819250643253, + 1.323008682578802, + 0.1630220077931881, + 0.6114289837423712, + 1.4051507338881493, + 0.7080210708081722, + 1.905409274622798, + 1.396904917433858, + 0.29682841897010803, + 1.268230862915516, + 1.0747994668781757, + 0.33951038867235184, + 0.5147860944271088, + 0.23092983290553093, + 0.9673456326127052, + 0.3618062883615494, + 1.0997433364391327, + 2.952216359321028, + 1.0525741004385054, + 1.4176887162029743 + ], + "unique_experts": 64, + "load_cv": 0.7269505573783525, + "normalized_load_entropy": 0.9527289232722663, + "max_load_share": 0.08225108225108226 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 113, + "ordered_topk_exact_tokens": 70, + "set_exact_tokens": 86, + "mean_set_jaccard": 0.9279393173198484, + "mean_token_weighted_tv": 0.014700354675527407, + "aggregate_load_tv": 0.025073746312684362 + }, + "system_bos": { + "tokens": 113, + "ordered_topk_exact_tokens": 56, + "set_exact_tokens": 77, + "mean_set_jaccard": 0.8987357774968395, + "mean_token_weighted_tv": 0.024286282780028975, + "aggregate_load_tv": 0.030973451327433628 + }, + "system_x": { + "tokens": 113, + "ordered_topk_exact_tokens": 46, + "set_exact_tokens": 61, + "mean_set_jaccard": 0.8537715971344291, + "mean_token_weighted_tv": 0.029555195849385416, + "aggregate_load_tv": 0.04867256637168142 + }, + "system_period": { + "tokens": 113, + "ordered_topk_exact_tokens": 36, + "set_exact_tokens": 54, + "mean_set_jaccard": 0.8360724820901811, + "mean_token_weighted_tv": 0.032845959117259724, + "aggregate_load_tv": 0.05604719764011799 + }, + "bos_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 54, + "set_exact_tokens": 72, + "mean_set_jaccard": 0.8908171474543156, + "mean_token_weighted_tv": 0.025442712343185354, + "aggregate_load_tv": 0.03392330383480825 + }, + "bos_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 48, + "set_exact_tokens": 73, + "mean_set_jaccard": 0.8893805309734514, + "mean_token_weighted_tv": 0.022586345653447165, + "aggregate_load_tv": 0.03687315634218289 + }, + "x_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 60, + "set_exact_tokens": 79, + "mean_set_jaccard": 0.9121365360303414, + "mean_token_weighted_tv": 0.01882340106826793, + "aggregate_load_tv": 0.032448377581120944 + }, + "x_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 43, + "set_exact_tokens": 56, + "mean_set_jaccard": 0.8392330383480827, + "mean_token_weighted_tv": 0.032212978042937004, + "aggregate_load_tv": 0.054572271386430685 + }, + "period_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 57, + "set_exact_tokens": 75, + "mean_set_jaccard": 0.902022756005057, + "mean_token_weighted_tv": 0.01939667118019911, + "aggregate_load_tv": 0.035398230088495575 + }, + "period_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 34, + "set_exact_tokens": 52, + "mean_set_jaccard": 0.8268015170670038, + "mean_token_weighted_tv": 0.0344842473821039, + "aggregate_load_tv": 0.05899705014749264 + } + } + }, + "layer_25": { + "layer": 25, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "3afb80f9de0636066f3f3bf74839d2d4c31aa2e48011cfcafa131a63f52f947d", + "route_weight_sha256": "88fce0c3a88127f1efeb853be8620f99b20ee707a4ea1f572c7c2ccf9d0e6aed", + "loads": [ + 7, + 8, + 5, + 17, + 16, + 9, + 21, + 9, + 10, + 21, + 6, + 8, + 7, + 7, + 12, + 9, + 9, + 16, + 21, + 10, + 10, + 6, + 9, + 31, + 8, + 12, + 2, + 13, + 12, + 9, + 25, + 12, + 7, + 4, + 3, + 13, + 12, + 8, + 10, + 4, + 14, + 6, + 10, + 7, + 7, + 12, + 3, + 8, + 9, + 4, + 11, + 5, + 12, + 16, + 18, + 13, + 20, + 5, + 9, + 7, + 8, + 9, + 9, + 18 + ], + "weighted_loads": [ + 0.46984798088669777, + 0.7195708639919758, + 0.19322295300662518, + 1.4414246324449778, + 0.913110263645649, + 0.5720708407461643, + 1.5836561881005764, + 1.2062031738460064, + 0.4663160089403391, + 0.9340682215988636, + 0.2989922743290663, + 0.3990663979202509, + 0.43629996106028557, + 0.32077566161751747, + 0.9079345595091581, + 0.4144850391894579, + 0.44567546620965004, + 1.1441188920289278, + 2.7249234057962894, + 0.8824440222233534, + 0.705306887626648, + 0.20772827044129372, + 0.481731291860342, + 1.8307508025318384, + 0.5588349960744381, + 1.3515926394611597, + 0.08951601386070251, + 0.7409630231559277, + 0.48922632448375225, + 0.3659679424017668, + 1.7248467281460762, + 0.9383057300001383, + 0.29828903265297413, + 0.15915045142173767, + 0.08386771567165852, + 1.2985860519111156, + 0.6477810461074114, + 0.3650849387049675, + 1.353062480688095, + 0.9931624718010426, + 0.7682829983532429, + 0.2846454381942749, + 0.6387712750583887, + 0.328085582703352, + 0.5785873513668776, + 0.7423425298184156, + 0.11972241848707199, + 1.0925307385623455, + 1.5479917209595442, + 0.1244593895971775, + 0.6249904725700617, + 0.20415384881198406, + 1.1170402057468891, + 0.993158521130681, + 1.218974780291319, + 0.9799095280468464, + 0.7901131883263588, + 0.19916815124452114, + 0.37614746391773224, + 0.27325122617185116, + 0.477207001298666, + 0.6867856234312057, + 1.2080823350697756, + 1.2885102704167366 + ], + "unique_experts": 64, + "load_cv": 0.5215068934118596, + "normalized_load_entropy": 0.9699168904809683, + "max_load_share": 0.045722713864306784 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "ece8c6236a0608e5c24e2914864b7a2827736c49dd87f00bc31c3a2c4db2fc9a", + "route_weight_sha256": "e2e66793d416f3c62a278d7ce65478a7004be3ee0dbcd5244f9419212b57e808", + "loads": [ + 9, + 26, + 11, + 18, + 17, + 9, + 27, + 10, + 10, + 21, + 15, + 12, + 10, + 8, + 12, + 9, + 9, + 20, + 23, + 10, + 10, + 7, + 9, + 35, + 8, + 12, + 2, + 13, + 13, + 11, + 25, + 13, + 9, + 5, + 5, + 14, + 12, + 9, + 20, + 6, + 20, + 7, + 10, + 8, + 13, + 22, + 6, + 9, + 9, + 4, + 21, + 5, + 18, + 16, + 27, + 13, + 21, + 7, + 9, + 7, + 10, + 9, + 15, + 18 + ], + "weighted_loads": [ + 0.5794898457825184, + 2.188596841180697, + 0.5464115999639034, + 1.5066372994333506, + 1.0429935827851295, + 0.5720708407461643, + 1.9948021285235882, + 1.2426435761153698, + 0.4663160089403391, + 0.9340682215988636, + 1.1987530644983053, + 1.0832346328534186, + 0.5893984027206898, + 0.3867740295827389, + 0.9079345595091581, + 0.4144850391894579, + 0.44567546620965004, + 1.2741716280579567, + 2.8097302634269, + 0.8824440222233534, + 0.705306887626648, + 0.2626446783542633, + 0.481731291860342, + 1.9785483609884977, + 0.5588349960744381, + 1.3515926394611597, + 0.08951601386070251, + 0.7409630231559277, + 0.5307217258960009, + 0.43501745350658894, + 1.7248467281460762, + 1.0271514374762774, + 0.4047431033104658, + 0.21967210993170738, + 0.19103826023638248, + 1.4067825488746166, + 0.6477810461074114, + 0.4190319813787937, + 2.780224597081542, + 1.1925073862075806, + 1.0208359584212303, + 0.3137774094939232, + 0.6387712750583887, + 0.3609098345041275, + 1.043204603716731, + 1.6166490726172924, + 0.2107921369606629, + 1.1292852498590946, + 1.5479917209595442, + 0.1244593895971775, + 1.2145367246121168, + 0.20415384881198406, + 1.4176724995486438, + 0.993158521130681, + 1.6556839845143259, + 0.9799095280468464, + 0.8241625130176544, + 0.27021064050495625, + 0.37614746391773224, + 0.27325122617185116, + 0.5712879821658134, + 0.6867856234312057, + 1.6558994706720114, + 1.2885102704167366 + ], + "unique_experts": 64, + "load_cv": 0.5094041979944324, + "normalized_load_entropy": 0.9707589966266863, + "max_load_share": 0.042270531400966184 + } + }, + "s1_eos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "c23bd90c14067c62e658d09369f52e26628452672bd69401642c7bd073c285e1", + "route_weight_sha256": "720337b9a202dc9c8c03664d91b6c413542ec1faf173d61d4533352c6ee9211c", + "loads": [ + 9, + 8, + 6, + 18, + 15, + 9, + 22, + 9, + 11, + 21, + 5, + 7, + 7, + 8, + 11, + 11, + 9, + 16, + 21, + 9, + 10, + 6, + 7, + 29, + 9, + 12, + 3, + 13, + 11, + 9, + 25, + 12, + 7, + 4, + 4, + 13, + 13, + 8, + 10, + 4, + 13, + 5, + 9, + 6, + 7, + 12, + 3, + 9, + 8, + 4, + 10, + 6, + 12, + 16, + 17, + 14, + 23, + 5, + 9, + 6, + 8, + 9, + 9, + 17 + ], + "weighted_loads": [ + 0.5402358863502741, + 0.695597268640995, + 0.24615989066660404, + 1.475718593224883, + 0.9273258708417416, + 0.5691359750926495, + 1.6124835498631, + 1.203844852745533, + 0.4826690685003996, + 0.8866237327456474, + 0.26640986278653145, + 0.3700059801340103, + 0.4207024946808815, + 0.33458653278648853, + 0.8798870332539082, + 0.470943808555603, + 0.4362664744257927, + 1.1248939577490091, + 2.6955220755189657, + 0.8087718021124601, + 0.7113596834242344, + 0.20408395491540432, + 0.42751217633485794, + 1.7602299191057682, + 0.5766264442354441, + 1.3596787191927433, + 0.12010127864778042, + 0.73320447281003, + 0.46164637617766857, + 0.36969044245779514, + 1.7585480827838182, + 0.9298524986952543, + 0.2972311582416296, + 0.16566544398665428, + 0.11414578929543495, + 1.2573823891580105, + 0.6883191522210836, + 0.3207793887704611, + 1.3456119522452354, + 1.0119578167796135, + 0.7094968482851982, + 0.25883008912205696, + 0.6056522503495216, + 0.30606265366077423, + 0.5598400123417377, + 0.7281482089310884, + 0.11127943731844425, + 1.114153603091836, + 1.485433004796505, + 0.1191400308161974, + 0.6047500222921371, + 0.22159921191632748, + 1.1240645051002502, + 1.0055478494614363, + 1.1723042633384466, + 1.0260672215372324, + 0.8956281468272209, + 0.19171585515141487, + 0.37373244762420654, + 0.25453620962798595, + 0.46255174092948437, + 0.6847259700298309, + 1.2471514008939266, + 1.245991112664342 + ], + "unique_experts": 64, + "load_cv": 0.5174868670456882, + "normalized_load_entropy": 0.9705682886564048, + "max_load_share": 0.04277286135693215 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "5edec84ddf1c8713a90dd5354c92a637d078a79f8e3908f88853468b32e7cc83", + "route_weight_sha256": "975bd90cc06662dc4bd9cf3dce42b891bb359515280fa91bb91e2f0251065239", + "loads": [ + 12, + 32, + 14, + 20, + 16, + 11, + 28, + 10, + 13, + 22, + 26, + 11, + 12, + 9, + 11, + 12, + 10, + 24, + 23, + 10, + 13, + 14, + 7, + 35, + 9, + 12, + 4, + 13, + 12, + 12, + 25, + 15, + 12, + 4, + 6, + 14, + 14, + 14, + 20, + 8, + 20, + 5, + 10, + 7, + 17, + 27, + 5, + 9, + 8, + 6, + 22, + 7, + 19, + 23, + 30, + 15, + 25, + 8, + 10, + 7, + 12, + 10, + 14, + 19 + ], + "weighted_loads": [ + 0.8137191366404295, + 2.6941283775959164, + 0.6987604890018702, + 1.604802655056119, + 1.0385063476860523, + 0.6446959599852562, + 2.171883776783943, + 1.2383361533284187, + 0.5969071183353662, + 0.914631076157093, + 2.120581228286028, + 1.0899914456531405, + 0.7059844695031643, + 0.3769619558006525, + 0.8798870332539082, + 0.5168388187885284, + 0.4714602269232273, + 1.7723117042332888, + 2.802653880789876, + 0.8321314696222544, + 0.9696442596614361, + 0.8914500139653683, + 0.42751217633485794, + 1.979870043694973, + 0.5766264442354441, + 1.3596787191927433, + 0.1538983192294836, + 0.73320447281003, + 0.5063063409179449, + 0.47574801556766033, + 1.7585480827838182, + 1.400441063567996, + 0.5246015302836895, + 0.16566544398665428, + 0.22301923111081123, + 1.3575879447162151, + 0.7343154419213533, + 0.5943583380430937, + 3.0320179164409637, + 1.3922453373670578, + 1.0316571444272995, + 0.25883008912205696, + 0.6916855946183205, + 0.3362751603126526, + 1.3213637731969357, + 2.0635420344769955, + 0.15387121075764298, + 1.114153603091836, + 1.485433004796505, + 0.19409888423979282, + 1.34290018863976, + 0.26859605498611927, + 1.5588860153220594, + 1.5124668758362532, + 1.9898262056522071, + 1.0525682885199785, + 0.9773616027086973, + 0.30254006013274193, + 0.41162316128611565, + 0.34205679409205914, + 0.6952626761049032, + 0.728229220956564, + 1.6683992370963097, + 1.3048068825155497 + ], + "unique_experts": 64, + "load_cv": 0.5010997818406346, + "normalized_load_entropy": 0.9713064311380174, + "max_load_share": 0.03787878787878788 + } + }, + "s0_bos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "1f619effffa8334c3f7acff1f42fc3254e8ca88a4bbbcf55b78e9038c90d302b", + "route_weight_sha256": "d5a3efe903a4dd8c53f4a81ea655d5fab35dec50ce8b22ba654466056aab0386", + "loads": [ + 8, + 8, + 8, + 17, + 15, + 11, + 20, + 9, + 10, + 23, + 5, + 8, + 8, + 5, + 11, + 9, + 9, + 16, + 21, + 9, + 10, + 5, + 8, + 31, + 9, + 12, + 2, + 13, + 11, + 9, + 24, + 13, + 7, + 5, + 3, + 13, + 11, + 7, + 10, + 4, + 14, + 6, + 9, + 6, + 8, + 13, + 5, + 9, + 8, + 3, + 12, + 6, + 12, + 16, + 18, + 13, + 19, + 5, + 8, + 6, + 9, + 9, + 9, + 18 + ], + "weighted_loads": [ + 0.515064524486661, + 0.701490955427289, + 0.28572000190615654, + 1.4428296592086554, + 0.9169931523501873, + 0.6333314292132854, + 1.5826994702219963, + 1.2114786505699158, + 0.4588698148727417, + 0.9748660791665316, + 0.2664767988026142, + 0.3936125822365284, + 0.4555455781519413, + 0.22634144313633442, + 0.884814914315939, + 0.38198799826204777, + 0.44578592106699944, + 1.0892927255481482, + 2.70759155228734, + 0.8591313846409321, + 0.7238882146775723, + 0.17876118049025536, + 0.45597900077700615, + 1.783814411610365, + 0.5735101848840714, + 1.347472906112671, + 0.0901545099914074, + 0.7352316975593567, + 0.474359679967165, + 0.37024736404418945, + 1.7793646492064, + 0.9630938582122326, + 0.29355368949472904, + 0.17601303942501545, + 0.09797091968357563, + 1.3108651116490364, + 0.5932695865631104, + 0.2999366484582424, + 1.3269020207226276, + 0.9362048879265785, + 0.7867819517850876, + 0.2903874609619379, + 0.6088369563221931, + 0.24128069542348385, + 0.5973011609166861, + 0.7780338246375322, + 0.19471650943160057, + 1.1261786259710789, + 1.4941807687282562, + 0.10544686950743198, + 0.6711681112647057, + 0.23535613529384136, + 1.1210823580622673, + 0.99521928653121, + 1.2403181158006191, + 1.0177044365555048, + 0.7453243210911751, + 0.1958903670310974, + 0.33756910637021065, + 0.2292834408581257, + 0.523410614579916, + 0.694607213139534, + 1.1709075011312962, + 1.738835446536541 + ], + "unique_experts": 64, + "load_cv": 0.5161399004091037, + "normalized_load_entropy": 0.9705836103634566, + "max_load_share": 0.045722713864306784 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "8f979e3f798e170249225cdcf3f41b2d4157a62ab5649f0c04b23ef1e3d17bbc", + "route_weight_sha256": "a79547363d5b75cbbcd9d049b03247a33854632d5317d1e536bccb3e749601de", + "loads": [ + 9, + 26, + 15, + 18, + 16, + 11, + 26, + 11, + 10, + 23, + 15, + 11, + 11, + 6, + 11, + 9, + 9, + 20, + 23, + 9, + 10, + 6, + 8, + 34, + 9, + 12, + 2, + 13, + 12, + 10, + 25, + 14, + 8, + 6, + 5, + 14, + 11, + 8, + 19, + 5, + 20, + 8, + 9, + 8, + 14, + 22, + 8, + 9, + 8, + 4, + 22, + 6, + 17, + 16, + 28, + 13, + 19, + 9, + 9, + 6, + 10, + 9, + 15, + 19 + ], + "weighted_loads": [ + 0.5688643958419561, + 2.136278437683359, + 0.7439120039343834, + 1.573084807023406, + 1.0580060444772243, + 0.6333314292132854, + 1.993845410645008, + 1.2987494952976704, + 0.4588698148727417, + 0.9748660791665316, + 1.2338033020496368, + 1.0685530491173267, + 0.6438477709889412, + 0.2880632486194372, + 0.884814914315939, + 0.38198799826204777, + 0.44578592106699944, + 1.219345461577177, + 2.789842428639531, + 0.8591313846409321, + 0.7238882146775723, + 0.23631004244089127, + 0.45597900077700615, + 1.909278567880392, + 0.5735101848840714, + 1.347472906112671, + 0.0901545099914074, + 0.7352316975593567, + 0.5158550813794136, + 0.40356022119522095, + 1.9608647264540195, + 1.0519395656883717, + 0.3459726069122553, + 0.23653469793498516, + 0.21330168657004833, + 1.423109531402588, + 0.5932695865631104, + 0.3513510972261429, + 1.844252998009324, + 1.0905950590968132, + 1.039334911853075, + 0.35715329088270664, + 0.6088369563221931, + 0.31198023818433285, + 1.0558571312576532, + 1.6090785786509514, + 0.3313440904021263, + 1.1261786259710789, + 1.4941807687282562, + 0.14941503293812275, + 1.2607143633067608, + 0.23535613529384136, + 1.417526300996542, + 0.99521928653121, + 1.7328681773506105, + 1.0177044365555048, + 0.7453243210911751, + 0.3363856691867113, + 0.3648632876574993, + 0.2292834408581257, + 0.5766190811991692, + 0.694607213139534, + 1.618724636733532, + 1.7704566977918148 + ], + "unique_experts": 64, + "load_cv": 0.5077522207471783, + "normalized_load_entropy": 0.9708181102597224, + "max_load_share": 0.04106280193236715 + } + }, + "s1_bos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "424f69b1d4b817e8b169b57277a6dc0f17cf20f603057d6ab4142bfcf122c436", + "route_weight_sha256": "c68f4fdabfcd0b4069245c39c202084e210e765ecdb45f099ba6ca522c9da9b0", + "loads": [ + 8, + 8, + 8, + 18, + 15, + 10, + 20, + 9, + 8, + 20, + 5, + 6, + 7, + 7, + 12, + 11, + 10, + 16, + 20, + 9, + 10, + 6, + 7, + 31, + 10, + 12, + 4, + 13, + 10, + 8, + 24, + 13, + 8, + 5, + 2, + 13, + 11, + 8, + 10, + 4, + 14, + 7, + 10, + 6, + 8, + 12, + 4, + 9, + 9, + 3, + 12, + 6, + 12, + 16, + 17, + 14, + 19, + 4, + 8, + 8, + 9, + 9, + 9, + 17 + ], + "weighted_loads": [ + 0.5265239551663399, + 0.701538810506463, + 0.2973198052495718, + 1.4946216903626919, + 0.9624660275876522, + 0.6046716794371605, + 1.5672033727169037, + 1.179590456187725, + 0.38020288944244385, + 0.8287207260727882, + 0.2749561481177807, + 0.3416343741118908, + 0.41336972638964653, + 0.2950810883194208, + 0.9106337167322636, + 0.47902221977710724, + 0.4855803232640028, + 1.091461069881916, + 2.6427884213626385, + 0.8524873144924641, + 0.705417700111866, + 0.20567450486123562, + 0.4234921261668205, + 1.8101661410182714, + 0.6201310083270073, + 1.3937614243477583, + 0.1458497066050768, + 0.7343931458890438, + 0.44688801281154156, + 0.34319281205534935, + 1.8159984145313501, + 0.9526789840310812, + 0.31036668457090855, + 0.1962397787719965, + 0.06085896119475365, + 1.310241762548685, + 0.5989205688238144, + 0.3264046646654606, + 1.337613306939602, + 0.9329242892563343, + 0.760663740336895, + 0.3366430178284645, + 0.6318698357790709, + 0.28120565973222256, + 0.5747190937399864, + 0.7286081481724977, + 0.15876001864671707, + 1.046388067305088, + 1.5313777178525925, + 0.10552020370960236, + 0.6768196374177933, + 0.23592353984713554, + 1.1548644304275513, + 1.0260296445339918, + 1.1888024061918259, + 1.0696574933826923, + 0.7590538635849953, + 0.18123528361320496, + 0.3275830056518316, + 0.2776837460696697, + 0.5028692930936813, + 0.6976168155670166, + 1.3656022418290377, + 1.2531732879579067 + ], + "unique_experts": 64, + "load_cv": 0.4991356160812761, + "normalized_load_entropy": 0.9723247030134036, + "max_load_share": 0.045722713864306784 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "e4996da069b85180857f41c1f199e3f05ce7a9107981f5770c712d03367234c5", + "route_weight_sha256": "c89b4e46b27b087b6e30ac169ea2c2f0cf54c5323e9901f154690c56e5d6be97", + "loads": [ + 11, + 33, + 18, + 19, + 16, + 12, + 26, + 10, + 12, + 21, + 27, + 9, + 14, + 7, + 12, + 11, + 10, + 24, + 22, + 10, + 13, + 14, + 7, + 37, + 10, + 12, + 5, + 13, + 11, + 10, + 24, + 16, + 14, + 5, + 4, + 14, + 12, + 13, + 19, + 7, + 21, + 7, + 11, + 7, + 18, + 27, + 6, + 9, + 9, + 5, + 24, + 7, + 18, + 23, + 31, + 15, + 22, + 7, + 9, + 9, + 12, + 10, + 14, + 19 + ], + "weighted_loads": [ + 0.7687878347933292, + 2.699652742827311, + 0.8729798253625631, + 1.5601240880787373, + 1.1010634265840054, + 0.6802316643297672, + 2.126603599637747, + 1.2145615369081497, + 0.5798309184610844, + 0.8567280694842339, + 2.2542826160788536, + 1.0370976328849792, + 0.7859023679047823, + 0.2950810883194208, + 0.9106337167322636, + 0.47902221977710724, + 0.4855803232640028, + 1.7388788163661957, + 2.7482821457087994, + 0.8758469820022583, + 0.9637022763490677, + 0.9034661240875721, + 0.4234921261668205, + 2.0354833137243986, + 0.6201310083270073, + 1.3937614243477583, + 0.17964674718677998, + 0.7343931458890438, + 0.4915479775518179, + 0.4136359840631485, + 1.8159984145313501, + 1.423267548903823, + 0.5886024236679077, + 0.1962397787719965, + 0.16757765784859657, + 1.4191228784620762, + 0.6449168585240841, + 0.5598331950604916, + 2.123062938451767, + 1.2617463059723377, + 1.0828240364789963, + 0.3366430178284645, + 0.7179031800478697, + 0.3114181663841009, + 1.3530967943370342, + 2.0297621693462133, + 0.2596678175032139, + 1.046388067305088, + 1.5313777178525925, + 0.19796960055828094, + 1.4149698037654161, + 0.26520245522260666, + 1.5854927226901054, + 1.5329486709088087, + 2.048824371304363, + 1.0961585603654385, + 0.9080683831125498, + 0.3103192187845707, + 0.3598995488137007, + 0.3652043305337429, + 0.6799687631428242, + 0.7411200664937496, + 1.7868500780314207, + 1.3119890578091145 + ], + "unique_experts": 64, + "load_cv": 0.5064565051049563, + "normalized_load_entropy": 0.971042114340632, + "max_load_share": 0.04004329004329004 + } + }, + "s0_x": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "54e1f37df06472a88567cbad813d2519a2e825d88cf3810822384c07aac4f858", + "route_weight_sha256": "1670ca72fdf66caf05c5915e962f662b82aeb1e2185c62ab464b41c6b96af685", + "loads": [ + 8, + 8, + 6, + 16, + 16, + 10, + 20, + 9, + 9, + 24, + 5, + 8, + 7, + 6, + 13, + 10, + 8, + 16, + 20, + 10, + 10, + 5, + 8, + 30, + 8, + 12, + 2, + 13, + 10, + 8, + 24, + 12, + 7, + 5, + 4, + 13, + 13, + 8, + 10, + 4, + 15, + 7, + 10, + 8, + 7, + 12, + 4, + 9, + 8, + 3, + 12, + 6, + 12, + 15, + 18, + 13, + 18, + 5, + 8, + 6, + 10, + 9, + 10, + 18 + ], + "weighted_loads": [ + 0.5010751951485872, + 0.7185431607067585, + 0.2206195704638958, + 1.397525031119585, + 0.943205701187253, + 0.6011333502829075, + 1.6012839786708355, + 1.2304082624614239, + 0.418149009346962, + 1.038935525342822, + 0.28590577095746994, + 0.4059045631438494, + 0.42499564588069916, + 0.2841861341148615, + 0.928921289741993, + 0.4470368269830942, + 0.3934016413986683, + 1.1030561588704586, + 2.712655331939459, + 0.906389057636261, + 0.7248802743852139, + 0.1741417646408081, + 0.45407386124134064, + 1.8155471440404654, + 0.5539322830736637, + 1.3657539151608944, + 0.08709350228309631, + 0.7403108067810535, + 0.4241259917616844, + 0.33541647903621197, + 1.7802602015435696, + 0.9021918624639511, + 0.288645813241601, + 0.18578578904271126, + 0.117610614746809, + 1.3170045390725136, + 0.6566339824348688, + 0.33926589600741863, + 1.3294577598571777, + 0.9600542075932026, + 0.7949438747018576, + 0.3011744040995836, + 0.6332836486399174, + 0.36556245386600494, + 0.5893582608550787, + 0.7216613460332155, + 0.1646956093609333, + 1.1194425448775291, + 1.4949816726148129, + 0.10332453437149525, + 0.677859490737319, + 0.2283787652850151, + 1.131233997642994, + 0.956607423722744, + 1.2654914539307356, + 0.9906044416129589, + 0.7044617272913456, + 0.19804706424474716, + 0.33047050796449184, + 0.21474295482039452, + 0.5342877749353647, + 0.7034982852637768, + 1.3111298717558384, + 1.2393544986844063 + ], + "unique_experts": 64, + "load_cv": 0.5079831022501297, + "normalized_load_entropy": 0.9713828797475117, + "max_load_share": 0.04424778761061947 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "fb4b96b061c60d53f8c3bb5814414c9a0ad139f517ea68f9717831517bdf656b", + "route_weight_sha256": "65267f5716231381a2855a0435fa5fb813028f31e0b2f7e6355dc2b85c3cb28d", + "loads": [ + 10, + 27, + 11, + 17, + 17, + 10, + 28, + 10, + 9, + 24, + 14, + 11, + 9, + 6, + 13, + 10, + 8, + 20, + 23, + 10, + 10, + 6, + 8, + 34, + 8, + 12, + 2, + 13, + 11, + 10, + 24, + 14, + 8, + 6, + 5, + 14, + 13, + 9, + 20, + 5, + 22, + 7, + 10, + 9, + 13, + 21, + 7, + 9, + 9, + 3, + 22, + 6, + 18, + 15, + 28, + 13, + 18, + 8, + 9, + 6, + 12, + 9, + 17, + 18 + ], + "weighted_loads": [ + 0.5896503236144781, + 2.23870137357153, + 0.5474441796541214, + 1.4339955262839794, + 1.0509354192763567, + 0.6011333502829075, + 2.1332164518535137, + 1.2616493422538042, + 0.418149009346962, + 1.038935525342822, + 1.161284290254116, + 1.113021420314908, + 0.5535895898938179, + 0.2841861341148615, + 0.928921289741993, + 0.4470368269830942, + 0.3934016413986683, + 1.2331088948994875, + 2.818714965134859, + 0.906389057636261, + 0.7248802743852139, + 0.21865010634064674, + 0.45407386124134064, + 1.9652794916182756, + 0.5539322830736637, + 1.3657539151608944, + 0.08709350228309631, + 0.7403108067810535, + 0.46562139317393303, + 0.39977844804525375, + 1.7802602015435696, + 1.086230255663395, + 0.34106473065912724, + 0.24630744755268097, + 0.17719368264079094, + 1.4218433946371078, + 0.6566339824348688, + 0.4045768063515425, + 1.9615834187716246, + 1.1144443787634373, + 1.0956702288240194, + 0.3011744040995836, + 0.6332836486399174, + 0.39838670566678047, + 1.0429303925484419, + 1.5778631791472435, + 0.29818883165717125, + 1.1194425448775291, + 1.5353406853973866, + 0.10332453437149525, + 1.2674057427793741, + 0.2283787652850151, + 1.5411805994808674, + 0.956607423722744, + 1.7840428608469665, + 0.9906044416129589, + 0.7044617272913456, + 0.2865061108022928, + 0.35820805467665195, + 0.21474295482039452, + 0.6308729518204927, + 0.7034982852637768, + 1.7977118343114853, + 1.2393544986844063 + ], + "unique_experts": 64, + "load_cv": 0.519205693823082, + "normalized_load_entropy": 0.9695040487651876, + "max_load_share": 0.04106280193236715 + } + }, + "s1_x": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "59a989139acf9c2c00ae0649e5aad758b5b553d83b0eae83a10ff882d3155c53", + "route_weight_sha256": "9f11b9d86cc2397cdc15e3f27b130dc56217821e8edb6f6175119b420d8e2d86", + "loads": [ + 7, + 8, + 10, + 18, + 16, + 11, + 21, + 9, + 8, + 23, + 5, + 7, + 7, + 6, + 11, + 8, + 9, + 18, + 19, + 10, + 10, + 7, + 7, + 29, + 9, + 13, + 4, + 13, + 9, + 9, + 22, + 12, + 6, + 8, + 2, + 14, + 10, + 7, + 10, + 4, + 16, + 7, + 9, + 6, + 9, + 12, + 6, + 8, + 9, + 3, + 12, + 6, + 12, + 16, + 17, + 13, + 19, + 6, + 8, + 6, + 9, + 9, + 9, + 15 + ], + "weighted_loads": [ + 0.4548567868769169, + 0.6887263506650925, + 0.36566444858908653, + 1.4624125957489014, + 0.9597303420305252, + 0.6465829107910395, + 1.6390115227550268, + 1.0891711078584194, + 0.3481954410672188, + 0.959328792989254, + 0.3267166092991829, + 0.37877022475004196, + 0.38203224912285805, + 0.2602008320391178, + 0.8460768815129995, + 0.36961219273507595, + 0.4329867847263813, + 1.1516176033765078, + 2.648593533784151, + 0.8320414442569017, + 0.6973969824612141, + 0.23545063473284245, + 0.42536308243870735, + 1.8309088982641697, + 0.590629804879427, + 1.4087985586374998, + 0.13242286443710327, + 0.7361516878008842, + 0.39715483970940113, + 0.3678225688636303, + 1.75462881103158, + 0.8817586414515972, + 0.23662742599844933, + 0.264153691008687, + 0.0616089291870594, + 1.3414187617599964, + 0.5485920738428831, + 0.29276949912309647, + 1.350685015320778, + 0.9323673285543919, + 0.7689707297831774, + 0.3154690060764551, + 0.5924782939255238, + 0.23224281147122383, + 0.6210118476301432, + 0.6843903735280037, + 0.2233223281800747, + 1.0721668675541878, + 1.5111106224358082, + 0.09609201736748219, + 0.6591816544532776, + 0.23196019977331161, + 1.1744184978306293, + 1.0381961949169636, + 1.1449756938964128, + 0.9684632625430822, + 0.7526679076254368, + 0.2308902908116579, + 0.31199913285672665, + 0.2105349749326706, + 0.4672092627733946, + 0.6896556578576565, + 1.3382362201809883, + 1.3989206477999687 + ], + "unique_experts": 64, + "load_cv": 0.4901284467463649, + "normalized_load_entropy": 0.973345493175044, + "max_load_share": 0.04277286135693215 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "f00a7cdbc67d53b902d6de605fe4195ecc724133206de6d943cee7153c2857ef", + "route_weight_sha256": "746ea4df80b419ff89a0a5adcddfb8f96450b992384152df57779e8b1c7b0e8a", + "loads": [ + 9, + 33, + 19, + 18, + 17, + 13, + 29, + 10, + 10, + 24, + 26, + 11, + 12, + 6, + 11, + 9, + 10, + 27, + 21, + 11, + 13, + 15, + 7, + 35, + 9, + 13, + 5, + 14, + 10, + 11, + 22, + 16, + 11, + 8, + 4, + 15, + 11, + 12, + 20, + 7, + 23, + 7, + 10, + 7, + 20, + 26, + 7, + 8, + 9, + 4, + 26, + 7, + 20, + 23, + 30, + 14, + 20, + 9, + 9, + 7, + 13, + 10, + 14, + 17 + ], + "weighted_loads": [ + 0.6490717232227325, + 2.696576157817617, + 0.8616665359586477, + 1.4624125957489014, + 1.036220759153366, + 0.7221428956836462, + 2.398057060316205, + 1.125687774270773, + 0.46243349090218544, + 0.9873361364006996, + 2.1556650325655937, + 1.1552658714354038, + 0.6563450433313847, + 0.2602008320391178, + 0.8460768815129995, + 0.4205119963735342, + 0.483010645955801, + 1.8442052695900202, + 2.7466027587652206, + 0.855401111766696, + 0.9556815586984158, + 0.918418649584055, + 0.42536308243870735, + 2.0604059919714928, + 0.590629804879427, + 1.4087985586374998, + 0.16621990501880646, + 0.7723547965288162, + 0.44181480444967747, + 0.43826574087142944, + 1.75462881103158, + 1.4595504216849804, + 0.4639977980405092, + 0.264153691008687, + 0.16781560704112053, + 1.4396075569093227, + 0.5945883635431528, + 0.5169083550572395, + 2.198874481022358, + 1.2611893452703953, + 1.0911310259252787, + 0.3154690060764551, + 0.6785116381943226, + 0.2624553181231022, + 1.3998046945780516, + 1.9779524244368076, + 0.2645806297659874, + 1.0721668675541878, + 1.5111106224358082, + 0.14470612816512585, + 1.5386086348444223, + 0.2916025146842003, + 1.7766843177378178, + 1.5451152212917805, + 2.0186856272630394, + 0.9949643295258284, + 0.7826727349311113, + 0.3352451715618372, + 0.3546303305774927, + 0.2980555593967438, + 0.6812076773494482, + 0.7331589087843895, + 1.7594840563833714, + 1.4577364176511765 + ], + "unique_experts": 64, + "load_cv": 0.5142412562590393, + "normalized_load_entropy": 0.9700367762916434, + "max_load_share": 0.03787878787878788 + } + }, + "s0_period": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "da955e33e5f2c4d8dd6b7535afcd08b3d4f2ae336972240e2294c4228877adf2", + "route_weight_sha256": "d62e233bc9bdb82353032384bf6bc3df7195085b4a89efc575b676fa8ab393cb", + "loads": [ + 9, + 8, + 7, + 18, + 15, + 10, + 20, + 9, + 10, + 22, + 5, + 7, + 7, + 7, + 13, + 12, + 9, + 16, + 21, + 9, + 10, + 4, + 9, + 30, + 8, + 12, + 2, + 13, + 10, + 10, + 24, + 12, + 7, + 4, + 3, + 13, + 13, + 8, + 10, + 4, + 16, + 6, + 8, + 7, + 7, + 12, + 4, + 8, + 9, + 3, + 12, + 6, + 12, + 15, + 18, + 13, + 18, + 5, + 8, + 5, + 9, + 9, + 10, + 18 + ], + "weighted_loads": [ + 0.5544426925480366, + 0.7146453969180584, + 0.2589972522109747, + 1.4750242475420237, + 0.9113165214657784, + 0.598876865580678, + 1.575582679361105, + 1.1643209494650364, + 0.46447998844087124, + 0.9028206821531057, + 0.31987860053777695, + 0.3915792554616928, + 0.4134159982204437, + 0.33095584623515606, + 0.9237124882638454, + 0.5112743582576513, + 0.4370745923370123, + 1.0927119348198175, + 2.7686972487717867, + 0.876758610829711, + 0.7281606644392014, + 0.1537784207612276, + 0.4901231862604618, + 1.7789728250354528, + 0.5576996356248856, + 1.3481545243412256, + 0.09264439344406128, + 0.7403681129217148, + 0.42675564624369144, + 0.3897790554910898, + 1.8002755157649517, + 0.9128541443496943, + 0.2983943708240986, + 0.14518963545560837, + 0.0914103202521801, + 1.3157486114650965, + 0.664707163348794, + 0.35157992877066135, + 1.3295142091810703, + 0.9835333079099655, + 0.8319066390395164, + 0.27463739179074764, + 0.5648391023278236, + 0.3406286481767893, + 0.5816751308739185, + 0.7320228461176157, + 0.1648392602801323, + 1.0543824881315231, + 1.5263116154819727, + 0.10183586366474628, + 0.6739148963242769, + 0.234881192445755, + 1.1138280220329762, + 0.9491117410361767, + 1.2400231342762709, + 1.009232895448804, + 0.698737371712923, + 0.20249056816101074, + 0.3371814861893654, + 0.19183292798697948, + 0.5208337940275669, + 0.6929428055882454, + 1.2940724212676287, + 1.2516392804682255 + ], + "unique_experts": 64, + "load_cv": 0.5134353661888076, + "normalized_load_entropy": 0.970226147165311, + "max_load_share": 0.04424778761061947 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "fdb714dbdd32b5620b971b8c3c1126bc97092b0e6fe6e54f9e9b9f851fab7d13", + "route_weight_sha256": "2f340fa1b554ddb1117d23f1b37a6da13c238dcad1d72a9f6e2651ee8c96ec81", + "loads": [ + 11, + 27, + 12, + 18, + 16, + 10, + 26, + 10, + 10, + 22, + 15, + 10, + 11, + 9, + 13, + 13, + 9, + 20, + 23, + 9, + 10, + 5, + 9, + 32, + 8, + 12, + 2, + 13, + 11, + 12, + 25, + 13, + 8, + 5, + 5, + 14, + 13, + 9, + 19, + 5, + 22, + 6, + 8, + 9, + 13, + 22, + 7, + 8, + 9, + 3, + 22, + 6, + 18, + 15, + 28, + 13, + 18, + 8, + 9, + 5, + 11, + 9, + 16, + 19 + ], + "weighted_loads": [ + 0.6534338518977165, + 2.3069689909461886, + 0.5821144189685583, + 1.4750242475420237, + 1.0395391508936882, + 0.598876865580678, + 1.9867286197841167, + 1.196591354906559, + 0.46447998844087124, + 0.9028206821531057, + 1.2876331582665443, + 1.0945272743701935, + 0.6141041107475758, + 0.4137792680412531, + 0.9237124882638454, + 0.5541267786175013, + 0.4370745923370123, + 1.2227646708488464, + 2.845479916781187, + 0.876758610829711, + 0.7281606644392014, + 0.19894309155642986, + 0.4901231862604618, + 1.870367182418704, + 0.5576996356248856, + 1.3481545243412256, + 0.09264439344406128, + 0.7403681129217148, + 0.46825104765594006, + 0.4554475899785757, + 1.8299582824110985, + 1.0016998518258333, + 0.35081328824162483, + 0.20571129396557808, + 0.19807396456599236, + 1.4240367133170366, + 0.664707163348794, + 0.4119363706558943, + 1.8468651864677668, + 1.1379234790802002, + 1.084459599107504, + 0.27463739179074764, + 0.5648391023278236, + 0.40165700018405914, + 1.0305727794766426, + 1.7081963568925858, + 0.2984466105699539, + 1.0543824881315231, + 1.5263116154819727, + 0.10183586366474628, + 1.263461148366332, + 0.234881192445755, + 1.4476891942322254, + 0.9491117410361767, + 1.7129907901398838, + 1.009232895448804, + 0.698737371712923, + 0.2923710625618696, + 0.36606357991695404, + 0.19183292798697948, + 0.6145594418048859, + 0.6929428055882454, + 1.7418895568698645, + 1.3859330601990223 + ], + "unique_experts": 64, + "load_cv": 0.5066479101242318, + "normalized_load_entropy": 0.9703192434639679, + "max_load_share": 0.03864734299516908 + } + }, + "s1_period": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "2cfef66afde2ac9ba3c54f4fd4af59fdac7f572d4105023bc282e346f44546b5", + "route_weight_sha256": "7dd6038468aafffbe831c355b8abd839dfe80cbeb0487d8607d98e0f5f3b2b81", + "loads": [ + 7, + 8, + 8, + 18, + 17, + 11, + 21, + 10, + 8, + 20, + 6, + 7, + 6, + 7, + 12, + 10, + 10, + 16, + 20, + 10, + 10, + 7, + 8, + 30, + 8, + 13, + 2, + 12, + 10, + 8, + 24, + 12, + 7, + 4, + 2, + 14, + 10, + 6, + 10, + 4, + 16, + 6, + 9, + 4, + 11, + 12, + 6, + 9, + 9, + 2, + 11, + 6, + 12, + 16, + 17, + 13, + 18, + 7, + 9, + 8, + 9, + 9, + 9, + 17 + ], + "weighted_loads": [ + 0.4549016188830137, + 0.6716205701231956, + 0.3022332638502121, + 1.45810953900218, + 1.0196208097040653, + 0.6370042376220226, + 1.6282140798866749, + 1.14274051040411, + 0.34346294589340687, + 0.8094415161758661, + 0.3029379602521658, + 0.35963270626962185, + 0.3262433260679245, + 0.2902242857962847, + 0.9325662478804588, + 0.4338106494396925, + 0.46817406080663204, + 1.0566817745566368, + 2.692799888551235, + 0.8630937319248915, + 0.7051950730383396, + 0.2428395412862301, + 0.45597903057932854, + 1.8685455303639174, + 0.5511208921670914, + 1.4168655909597874, + 0.06654395908117294, + 0.7019411101937294, + 0.4264646451920271, + 0.336233077570796, + 1.8005470484495163, + 0.884745754301548, + 0.255003921687603, + 0.13954354636371136, + 0.06053902395069599, + 1.342579672113061, + 0.5460872501134872, + 0.2608477920293808, + 1.344299703836441, + 0.9292334876954556, + 0.7616804633289576, + 0.2950098551809788, + 0.58014084585011, + 0.17053799331188202, + 0.6886470541357994, + 0.6595984883606434, + 0.2268066592514515, + 1.0347652733325958, + 1.4964504223316908, + 0.05938214808702469, + 0.6272379644215107, + 0.2281169593334198, + 1.1835719160735607, + 1.0239660497754812, + 1.1451032441109419, + 0.9886681996285915, + 0.7171374727040529, + 0.2510151732712984, + 0.3500137124210596, + 0.26329088024795055, + 0.4847872033715248, + 0.6906332820653915, + 1.3064943812787533, + 1.5833063926547766 + ], + "unique_experts": 64, + "load_cv": 0.5033022407581372, + "normalized_load_entropy": 0.9711273168678292, + "max_load_share": 0.04424778761061947 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "bbbdf8b57405bc1be44eb6e04319ff9b3d71478b0f68c6537b09c078a5725a8d", + "route_weight_sha256": "3f182e3231936e79aa2f9b8f2680f7664dfbc436e02b3598d456d81d0677511f", + "loads": [ + 10, + 33, + 16, + 19, + 18, + 13, + 27, + 11, + 10, + 21, + 27, + 10, + 12, + 7, + 12, + 12, + 11, + 24, + 21, + 11, + 13, + 14, + 8, + 35, + 8, + 13, + 3, + 12, + 11, + 10, + 25, + 15, + 13, + 4, + 5, + 15, + 11, + 11, + 19, + 7, + 23, + 6, + 10, + 5, + 22, + 27, + 7, + 9, + 9, + 3, + 23, + 7, + 19, + 23, + 31, + 14, + 20, + 11, + 10, + 9, + 13, + 10, + 14, + 22 + ], + "weighted_loads": [ + 0.7125412914901972, + 2.7250524370465428, + 0.7756358720362186, + 1.497651383280754, + 1.0988376773893833, + 0.7125642225146294, + 2.187614306807518, + 1.1779861152172089, + 0.4577009957283735, + 0.8374488595873117, + 2.1390402782708406, + 1.078403351828456, + 0.6398504003882408, + 0.2902242857962847, + 0.9325662478804588, + 0.524689732119441, + 0.5178481806069613, + 1.7040995210409164, + 2.746368497610092, + 0.8864533994346857, + 0.9634796492755413, + 0.8834402579814196, + 0.45597903057932854, + 2.0604850593954325, + 0.5511208921670914, + 1.4168655909597874, + 0.10034099966287613, + 0.7019411101937294, + 0.47112460993230343, + 0.40667624957859516, + 1.8451478444039822, + 1.3553343191742897, + 0.5186680015176535, + 0.13954354636371136, + 0.21865723095834255, + 1.4383633900433779, + 0.5920835398137569, + 0.46904432214796543, + 2.129749335348606, + 1.258055504411459, + 1.0838407594710588, + 0.2950098551809788, + 0.6661741901189089, + 0.20075049996376038, + 1.4711985532194376, + 2.0079160816967487, + 0.2680649608373642, + 1.0347652733325958, + 1.4964504223316908, + 0.10799625888466835, + 1.3653881307691336, + 0.28527116775512695, + 1.66685850918293, + 1.5308850761502981, + 1.9944907980971038, + 1.0151692666113377, + 0.8002393282949924, + 0.3904795665293932, + 0.390488950535655, + 0.35081146471202374, + 0.7056840099394321, + 0.7341365329921246, + 1.7277422174811363, + 1.9525294620543718 + ], + "unique_experts": 64, + "load_cv": 0.5133658892756793, + "normalized_load_entropy": 0.9694536787776364, + "max_load_share": 0.03787878787878788 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 113, + "ordered_topk_exact_tokens": 75, + "set_exact_tokens": 82, + "mean_set_jaccard": 0.9216182048040455, + "mean_token_weighted_tv": 0.016209357080206408, + "aggregate_load_tv": 0.028023598820058997 + }, + "system_bos": { + "tokens": 113, + "ordered_topk_exact_tokens": 67, + "set_exact_tokens": 81, + "mean_set_jaccard": 0.9138221660345553, + "mean_token_weighted_tv": 0.022399567693999384, + "aggregate_load_tv": 0.028023598820058997 + }, + "system_x": { + "tokens": 113, + "ordered_topk_exact_tokens": 56, + "set_exact_tokens": 70, + "mean_set_jaccard": 0.8803202697008007, + "mean_token_weighted_tv": 0.02847050835864734, + "aggregate_load_tv": 0.04572271386430678 + }, + "system_period": { + "tokens": 113, + "ordered_topk_exact_tokens": 55, + "set_exact_tokens": 67, + "mean_set_jaccard": 0.8746312684365782, + "mean_token_weighted_tv": 0.030690414575546717, + "aggregate_load_tv": 0.04277286135693215 + }, + "bos_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 63, + "set_exact_tokens": 77, + "mean_set_jaccard": 0.9056047197640119, + "mean_token_weighted_tv": 0.024230399754195088, + "aggregate_load_tv": 0.029498525073746312 + }, + "bos_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 56, + "set_exact_tokens": 69, + "mean_set_jaccard": 0.888748419721871, + "mean_token_weighted_tv": 0.023980917013456338, + "aggregate_load_tv": 0.035398230088495575 + }, + "x_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 65, + "set_exact_tokens": 81, + "mean_set_jaccard": 0.9152970922882427, + "mean_token_weighted_tv": 0.020310607920112335, + "aggregate_load_tv": 0.030973451327433628 + }, + "x_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 43, + "set_exact_tokens": 61, + "mean_set_jaccard": 0.8594605983986516, + "mean_token_weighted_tv": 0.0323191912251368, + "aggregate_load_tv": 0.05162241887905604 + }, + "period_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 72, + "set_exact_tokens": 84, + "mean_set_jaccard": 0.9266750948166879, + "mean_token_weighted_tv": 0.018740036228127713, + "aggregate_load_tv": 0.029498525073746312 + }, + "period_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 43, + "set_exact_tokens": 60, + "mean_set_jaccard": 0.8550358196375896, + "mean_token_weighted_tv": 0.03381310467632998, + "aggregate_load_tv": 0.05014749262536873 + } + } + }, + "layer_26": { + "layer": 26, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "3150edb138408ada5238c304858bf1db86fa58d80d7ab0aca7605b9982e7c8a4", + "route_weight_sha256": "4aa42e0b5f1f67f99a6fc4327710ae5d55aaed63a64a9bcdb6a3536e8e699ea4", + "loads": [ + 8, + 10, + 15, + 3, + 10, + 3, + 17, + 3, + 6, + 8, + 15, + 12, + 13, + 7, + 6, + 3, + 11, + 9, + 2, + 12, + 12, + 10, + 8, + 11, + 6, + 12, + 9, + 19, + 14, + 19, + 5, + 12, + 25, + 15, + 9, + 7, + 12, + 6, + 22, + 5, + 14, + 2, + 7, + 21, + 1, + 11, + 16, + 14, + 3, + 9, + 6, + 24, + 18, + 19, + 6, + 6, + 10, + 11, + 14, + 18, + 5, + 11, + 15, + 6 + ], + "weighted_loads": [ + 0.4098007082939148, + 0.9111402407288551, + 1.1208324413746595, + 0.12982161715626717, + 0.9972531646490097, + 0.1327309012413025, + 1.9037433937191963, + 0.11547920107841492, + 0.22139618173241615, + 0.7649858891963959, + 0.880771417170763, + 1.6210011411458254, + 1.4858587197959423, + 0.3142661452293396, + 0.5082293264567852, + 0.32199856638908386, + 0.766695648431778, + 0.7121121808886528, + 0.0745297484099865, + 0.6877893302589655, + 0.9638790246099234, + 0.8629248775541782, + 0.29267290234565735, + 0.5670629478991032, + 0.43593571707606316, + 0.9581973217427731, + 0.6751778144389391, + 1.5557878129184246, + 0.9036831595003605, + 0.7716093813069165, + 0.15682009607553482, + 0.5435751080513, + 3.6597239077091217, + 0.747779805213213, + 0.5649421960115433, + 0.4818073697388172, + 1.065186232328415, + 0.2972949370741844, + 1.4038485288619995, + 0.6833616495132446, + 1.2524448446929455, + 0.06655892357230186, + 0.2528027445077896, + 2.3881069011986256, + 0.07020463049411774, + 0.506439246237278, + 0.5766713358461857, + 0.9855667967349291, + 0.24525839276611805, + 0.9691369161009789, + 0.2915620431303978, + 2.6601684037595987, + 1.969874082133174, + 0.8755778539925814, + 0.43179285526275635, + 0.3386482037603855, + 0.8519523721188307, + 1.640692062675953, + 0.9311990160495043, + 1.196626476943493, + 0.2278265431523323, + 0.6777802109718323, + 1.303569434210658, + 1.5422395803034306 + ], + "unique_experts": 64, + "load_cv": 0.5305061857463081, + "normalized_load_entropy": 0.9650247556964137, + "max_load_share": 0.03687315634218289 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "990aef89baeac823d748ed4d5d38c11057271f7a5f4c414e5ce1094c091857e0", + "route_weight_sha256": "de214feeaa2a71ea294879374c065fb12b46837e54aa8c4a62219eee33304627", + "loads": [ + 8, + 11, + 15, + 4, + 10, + 3, + 17, + 4, + 6, + 13, + 19, + 17, + 14, + 8, + 21, + 5, + 11, + 20, + 3, + 13, + 12, + 11, + 8, + 11, + 13, + 12, + 15, + 26, + 14, + 19, + 12, + 12, + 28, + 15, + 12, + 7, + 18, + 6, + 22, + 5, + 15, + 2, + 8, + 24, + 2, + 11, + 20, + 15, + 5, + 10, + 15, + 25, + 22, + 19, + 7, + 6, + 24, + 19, + 20, + 19, + 6, + 11, + 16, + 7 + ], + "weighted_loads": [ + 0.4098007082939148, + 1.0258329659700394, + 1.1208324413746595, + 0.1579680349677801, + 0.9972531646490097, + 0.1327309012413025, + 1.9037433937191963, + 0.20496196299791336, + 0.22139618173241615, + 1.0733483377844095, + 1.1474365331232548, + 1.925599040929228, + 1.6178444735705853, + 0.3737354688346386, + 1.1803503037663177, + 0.4188370630145073, + 0.766695648431778, + 1.2519012985285372, + 0.10735908523201942, + 0.74571299739182, + 0.9638790246099234, + 0.8949922546744347, + 0.29267290234565735, + 0.5670629478991032, + 0.8298199474811554, + 0.9581973217427731, + 1.6571068689227104, + 1.8396468590945005, + 0.9036831595003605, + 0.7716093813069165, + 0.7769309878349304, + 0.5435751080513, + 3.7846369482576847, + 0.747779805213213, + 0.7497548013925552, + 0.4818073697388172, + 1.3541969116777182, + 0.2972949370741844, + 1.4038485288619995, + 0.6833616495132446, + 1.2933346070349216, + 0.06655892357230186, + 0.31413255631923676, + 2.5401302836835384, + 0.12557406723499298, + 0.506439246237278, + 0.7944742627441883, + 1.0189102981239557, + 0.357693949714303, + 1.955472432076931, + 0.6698714103549719, + 2.845593446865678, + 2.43093997053802, + 0.8755778539925814, + 0.4787084236741066, + 0.3386482037603855, + 1.9310259390622377, + 2.035876414272934, + 1.1661842558532953, + 1.2442596517503262, + 0.22862459113821387, + 0.6777802109718323, + 1.34450145624578, + 1.5861011520028114 + ], + "unique_experts": 64, + "load_cv": 0.4994103737112333, + "normalized_load_entropy": 0.968221838432933, + "max_load_share": 0.033816425120772944 + } + }, + "s1_eos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "e4190c48ae70dda206c9e37e70d8bf5249ab33b62acaec8fe4faaed2f8a591b5", + "route_weight_sha256": "28b90a2e4c93bdab7a28158cc106a5b1eaedcec17b12abe3f5a095d54be81acf", + "loads": [ + 8, + 10, + 16, + 5, + 10, + 2, + 17, + 3, + 4, + 8, + 15, + 11, + 14, + 8, + 6, + 3, + 11, + 9, + 2, + 12, + 12, + 11, + 6, + 10, + 6, + 12, + 10, + 20, + 14, + 20, + 6, + 11, + 26, + 17, + 8, + 7, + 12, + 6, + 21, + 5, + 14, + 2, + 6, + 21, + 2, + 11, + 14, + 13, + 2, + 9, + 4, + 25, + 18, + 18, + 5, + 6, + 10, + 11, + 13, + 19, + 6, + 11, + 15, + 9 + ], + "weighted_loads": [ + 0.40398554131388664, + 0.8979808837175369, + 1.1542838364839554, + 0.21411550417542458, + 0.9739883467555046, + 0.08897582814097404, + 1.8948765527456999, + 0.1136541273444891, + 0.17099386639893055, + 0.7661946751177311, + 0.8726729825139046, + 1.5713921263813972, + 1.4929617326706648, + 0.3583138473331928, + 0.5171647109091282, + 0.3221340999007225, + 0.7652413919568062, + 0.7162084840238094, + 0.073712058365345, + 0.688119426369667, + 0.9081720281392336, + 0.8967905063182116, + 0.23185144551098347, + 0.548373494297266, + 0.4360206760466099, + 0.952519379556179, + 0.6927976869046688, + 1.5750658065080643, + 0.8766268044710159, + 0.7938771485351026, + 0.17708702757954597, + 0.5180765390396118, + 3.6152227353304625, + 0.8145895265042782, + 0.5762639557942748, + 0.48778702318668365, + 1.0621766820549965, + 0.29908666014671326, + 1.385860126465559, + 0.6470484286546707, + 1.2353621181100607, + 0.06616934575140476, + 0.2212146818637848, + 2.3665526434779167, + 0.0977129302918911, + 0.5125541146844625, + 0.4957381095737219, + 0.9667738564312458, + 0.20872458815574646, + 0.942684831097722, + 0.2101597636938095, + 2.629630584269762, + 2.013406565412879, + 0.8207880016416311, + 0.4208682104945183, + 0.3409117292612791, + 0.8344247527420521, + 1.6328904554247856, + 0.9242649674415588, + 1.2259370628744364, + 0.25650161877274513, + 0.693574383854866, + 1.2852300517261028, + 1.6236827969551086 + ], + "unique_experts": 64, + "load_cv": 0.5432135571443619, + "normalized_load_entropy": 0.9637130624590795, + "max_load_share": 0.038348082595870206 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "fe7e8dce1b5738afd549454e29aed2801b852f0923091999e7388767ad34492d", + "route_weight_sha256": "6b0b0a1407deb13fce38e8352c96c690bef8a99a17adb6e0108cbd3b04fa435b", + "loads": [ + 8, + 11, + 16, + 5, + 13, + 2, + 17, + 5, + 4, + 16, + 22, + 18, + 15, + 9, + 21, + 8, + 11, + 16, + 3, + 13, + 12, + 17, + 13, + 10, + 15, + 14, + 22, + 28, + 14, + 24, + 15, + 12, + 31, + 18, + 14, + 7, + 24, + 11, + 24, + 6, + 15, + 2, + 8, + 25, + 2, + 12, + 18, + 15, + 4, + 12, + 12, + 26, + 28, + 20, + 8, + 8, + 28, + 19, + 23, + 26, + 9, + 11, + 18, + 11 + ], + "weighted_loads": [ + 0.40398554131388664, + 1.0086669027805328, + 1.1542838364839554, + 0.21411550417542458, + 1.1542546730488539, + 0.08897582814097404, + 1.8948765527456999, + 0.2685545887798071, + 0.17099386639893055, + 1.2401927895843983, + 1.6138063222169876, + 2.19051532051526, + 1.6200241278856993, + 0.41247623413801193, + 1.3477783771813847, + 0.6237317398190498, + 0.7652413919568062, + 1.116978695616126, + 0.12979916855692863, + 0.7505596987903118, + 0.9081720281392336, + 1.2490736544132233, + 0.7334856893867254, + 0.548373494297266, + 0.8935527801513672, + 1.0576207675039768, + 2.1755571737885475, + 1.8935480527579784, + 0.8766268044710159, + 0.9313399842940271, + 1.065703060477972, + 0.5976662933826447, + 3.828152282163501, + 0.8591920658946037, + 0.9214402614161372, + 0.48778702318668365, + 1.6934181042015553, + 0.6002868562936783, + 1.6648760475218296, + 0.6807246170938015, + 1.2647515572607517, + 0.06616934575140476, + 0.3160935901105404, + 2.5658475756645203, + 0.0977129302918911, + 0.5300366375595331, + 0.7522670608013868, + 1.0708638429641724, + 0.2894403673708439, + 2.0829429049044847, + 0.5322518460452557, + 2.7530417554080486, + 2.8580976016819477, + 1.0129708219319582, + 0.6340858228504658, + 0.45625571347773075, + 2.5191537514328957, + 2.340452378615737, + 1.499424859881401, + 1.5505987033247948, + 0.5024537895806134, + 0.693574383854866, + 1.4087489005178213, + 1.69906372949481 + ], + "unique_experts": 64, + "load_cv": 0.4999016038561761, + "normalized_load_entropy": 0.9679123093883935, + "max_load_share": 0.03354978354978355 + } + }, + "s0_bos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "a5d415cb95c4a5768d877381a00d24c287aa47b231785135341fdf021a25e351", + "route_weight_sha256": "6b358a920aaededfe6856eaec61d9a1ca78b575d6e540b3295ca80b183c7d4c0", + "loads": [ + 9, + 11, + 15, + 4, + 10, + 3, + 17, + 4, + 5, + 8, + 16, + 11, + 14, + 8, + 6, + 3, + 11, + 9, + 1, + 12, + 12, + 11, + 6, + 12, + 6, + 14, + 11, + 20, + 15, + 18, + 5, + 12, + 27, + 15, + 10, + 5, + 12, + 8, + 21, + 6, + 12, + 2, + 5, + 21, + 2, + 9, + 10, + 14, + 4, + 9, + 3, + 24, + 18, + 17, + 5, + 5, + 10, + 11, + 14, + 18, + 5, + 10, + 16, + 11 + ], + "weighted_loads": [ + 0.4707849845290184, + 0.9467094484716654, + 1.123169282451272, + 0.17636956833302975, + 0.9838038645684719, + 0.13606615364551544, + 1.968364767730236, + 0.15916475281119347, + 0.19597358256578445, + 0.7503120116889477, + 0.9135836120694876, + 1.5948258712887764, + 1.5355953332036734, + 0.36182693764567375, + 0.5165239498019218, + 0.32580431550741196, + 0.7767375223338604, + 0.7304653115570545, + 0.044872015714645386, + 0.6876012906432152, + 0.9396217633038759, + 0.8736583953723311, + 0.24159790761768818, + 0.6202293038368225, + 0.43729014694690704, + 1.0272475089877844, + 0.7358905663713813, + 1.5832058116793633, + 0.9405412804335356, + 0.7850328702479601, + 0.14021399058401585, + 0.5448546968400478, + 3.676196290180087, + 0.7191983945667744, + 0.6028278153389692, + 0.38927531614899635, + 1.0446483790874481, + 0.37122261337935925, + 1.4216012097895145, + 0.7632230520248413, + 1.1398726888000965, + 0.06687702983617783, + 0.19150006212294102, + 2.479765312746167, + 0.09034009091556072, + 0.4439428634941578, + 0.3921621348708868, + 1.0013051647692919, + 0.11804202012717724, + 0.9120310451835394, + 0.17025526612997055, + 2.636314520612359, + 1.9849347826093435, + 0.7910248320549726, + 0.4087856151163578, + 0.2552550248801708, + 0.88001106120646, + 1.6474936977028847, + 0.9505978170782328, + 1.2555668447166681, + 0.2073859479278326, + 0.5837564039975405, + 1.3586843614466488, + 2.3454829286783934 + ], + "unique_experts": 64, + "load_cv": 0.5349490627476604, + "normalized_load_entropy": 0.9645769005236275, + "max_load_share": 0.03982300884955752 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "b23f684e26e8a937ed2dbc64d0c986a8a8b093dc4e7cd200f6299b329df192b7", + "route_weight_sha256": "f511d0f8659ae23ab456665af8375e5d44a3ad1fd82789fce9828678bf8cc43c", + "loads": [ + 9, + 12, + 15, + 5, + 10, + 3, + 17, + 5, + 5, + 14, + 19, + 15, + 15, + 9, + 19, + 5, + 11, + 18, + 1, + 13, + 12, + 12, + 7, + 12, + 12, + 14, + 18, + 28, + 15, + 18, + 13, + 12, + 29, + 16, + 14, + 5, + 18, + 8, + 21, + 7, + 13, + 3, + 7, + 24, + 5, + 9, + 12, + 15, + 6, + 9, + 12, + 25, + 22, + 17, + 6, + 5, + 24, + 18, + 20, + 19, + 5, + 10, + 17, + 14 + ], + "weighted_loads": [ + 0.4707849845290184, + 1.0634444523602724, + 1.123169282451272, + 0.20381302759051323, + 0.9838038645684719, + 0.13606615364551544, + 1.968364767730236, + 0.23285316303372383, + 0.19597358256578445, + 1.0952637996524572, + 1.154074577614665, + 1.8973509911447763, + 1.671741297468543, + 0.42129626125097275, + 1.1064957212656736, + 0.4424820877611637, + 0.7767375223338604, + 1.1920777186751366, + 0.044872015714645386, + 0.7474049478769302, + 0.9396217633038759, + 0.9057257724925876, + 0.27461867593228817, + 0.6202293038368225, + 0.7913272455334663, + 1.0272475089877844, + 1.8718672832474113, + 1.9340667147189379, + 0.9405412804335356, + 0.7850328702479601, + 0.8960845079272985, + 0.5448546968400478, + 3.767481477931142, + 0.7691918238997459, + 0.8590269591659307, + 0.38927531614899635, + 1.3363013043999672, + 0.37122261337935925, + 1.4216012097895145, + 0.7852681633085012, + 1.1807624511420727, + 0.4574049934744835, + 0.2924599628895521, + 2.63178869523108, + 0.23388447053730488, + 0.4439428634941578, + 0.5156739223748446, + 1.0294720735400915, + 0.23900398798286915, + 0.9120310451835394, + 0.5480486787855625, + 2.823825502768159, + 2.4402596782892942, + 0.7910248320549726, + 0.45570118352770805, + 0.2552550248801708, + 1.9660463016480207, + 2.0377942118793726, + 1.1855830568820238, + 1.3032000195235014, + 0.2073859479278326, + 0.5837564039975405, + 1.3996163834817708, + 2.4889107290655375 + ], + "unique_experts": 64, + "load_cv": 0.4884485615150724, + "normalized_load_entropy": 0.9698474298227052, + "max_load_share": 0.035024154589371984 + } + }, + "s1_bos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "c39df137cbea80d8cfe46f6cfcb75fe37a187f2bc34242b4e56b9e018df05844", + "route_weight_sha256": "b115c5a8cda3d008988f54f988d2e12de90f7e2291852779bf1ab3e7cd328942", + "loads": [ + 8, + 11, + 15, + 4, + 10, + 2, + 17, + 4, + 5, + 8, + 14, + 12, + 14, + 8, + 7, + 3, + 11, + 9, + 1, + 12, + 12, + 12, + 7, + 13, + 6, + 13, + 9, + 21, + 14, + 18, + 6, + 12, + 26, + 16, + 10, + 6, + 12, + 7, + 21, + 6, + 14, + 2, + 5, + 21, + 2, + 10, + 13, + 14, + 4, + 9, + 3, + 25, + 17, + 17, + 5, + 6, + 8, + 11, + 14, + 18, + 4, + 10, + 15, + 9 + ], + "weighted_loads": [ + 0.4438144452869892, + 0.9559636004269123, + 1.134571647271514, + 0.18342943862080574, + 0.9843025021255016, + 0.08690427988767624, + 1.9541756212711334, + 0.15994957461953163, + 0.18541353940963745, + 0.745840560644865, + 0.8488354440778494, + 1.6045396905392408, + 1.546317296102643, + 0.3461662922054529, + 0.5613902695477009, + 0.317058689892292, + 0.7888652458786964, + 0.7338573299348354, + 0.042935263365507126, + 0.6980182752013206, + 0.9242663905024529, + 0.9133336506783962, + 0.27295149117708206, + 0.6656883917748928, + 0.44061730429530144, + 1.03022401034832, + 0.649360223673284, + 1.6069906428456306, + 0.9390714205801487, + 0.7343969824723899, + 0.1763820555061102, + 0.5174189824610949, + 3.7000440396368504, + 0.7855412773787975, + 0.5881906831637025, + 0.46425311639904976, + 1.049759216606617, + 0.3325201515108347, + 1.4630964286625385, + 0.779204860329628, + 1.1822895854711533, + 0.06925859674811363, + 0.18332197703421116, + 2.3871314208954573, + 0.08912798762321472, + 0.48872455582022667, + 0.4867877680808306, + 1.0285849180072546, + 0.30021159909665585, + 0.9641629010438919, + 0.1680842973291874, + 2.6522019039839506, + 1.8693633768707514, + 0.8065228760242462, + 0.40211246348917484, + 0.36114631965756416, + 0.7535948641598225, + 1.6462812162935734, + 0.9287226740270853, + 1.2161503173410892, + 0.16866757534444332, + 0.6136092618107796, + 1.319163334555924, + 1.6043195258826017 + ], + "unique_experts": 64, + "load_cv": 0.5341677108103174, + "normalized_load_entropy": 0.9645102014612099, + "max_load_share": 0.038348082595870206 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "019f4a8eca324594747fbe52b0868ffb2eea674b1e876db95c78988110437f8a", + "route_weight_sha256": "f9f4c693023aebda51eda5d723d4c418c2e47d50eb02a7a369de263d008b963d", + "loads": [ + 8, + 12, + 15, + 4, + 13, + 3, + 17, + 6, + 5, + 17, + 22, + 18, + 15, + 9, + 21, + 8, + 11, + 15, + 1, + 13, + 12, + 18, + 14, + 13, + 15, + 15, + 22, + 28, + 14, + 22, + 17, + 13, + 30, + 17, + 18, + 6, + 24, + 12, + 24, + 7, + 15, + 2, + 8, + 26, + 4, + 11, + 16, + 16, + 5, + 11, + 11, + 26, + 26, + 19, + 8, + 8, + 26, + 18, + 24, + 25, + 6, + 10, + 18, + 11 + ], + "weighted_loads": [ + 0.4438144452869892, + 1.0686258412897587, + 1.134571647271514, + 0.18342943862080574, + 1.164568828418851, + 0.12335279956459999, + 1.9541756212711334, + 0.295061107724905, + 0.18541353940963745, + 1.2599483653903008, + 1.7123844604939222, + 2.2214051578193903, + 1.6788910496979952, + 0.400328679010272, + 1.3484160974621773, + 0.6356176696717739, + 0.7888652458786964, + 1.1533342339098454, + 0.042935263365507126, + 0.760654404759407, + 0.9242663905024529, + 1.265616798773408, + 0.7598167285323143, + 0.6656883917748928, + 0.8973858654499054, + 1.1353253982961178, + 2.327456413768232, + 1.8873356059193611, + 0.9390714205801487, + 0.8718598182313144, + 1.210966283455491, + 0.5970087368041277, + 3.8730082027614117, + 0.8316079005599022, + 1.0441912719979882, + 0.46425311639904976, + 1.6887101717293262, + 0.6337203476577997, + 1.7421123497188091, + 0.8128810487687588, + 1.2116790246218443, + 0.06925859674811363, + 0.3110977988690138, + 2.6489737015217543, + 0.1634327583014965, + 0.5062070786952972, + 0.6920538228005171, + 1.111136706545949, + 0.33560158126056194, + 1.1195711642503738, + 0.4883385580033064, + 2.8218378853052855, + 2.6620981376618147, + 0.9987056963145733, + 0.6153300758451223, + 0.4764903038740158, + 2.468318931758404, + 2.348574910312891, + 1.5038825664669275, + 1.5408119577914476, + 0.4136813711374998, + 0.6136092618107796, + 1.4426821833476424, + 1.727025719359517 + ], + "unique_experts": 64, + "load_cv": 0.4860644924329953, + "normalized_load_entropy": 0.9692914131680962, + "max_load_share": 0.032467532467532464 + } + }, + "s0_x": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "5e8416e4d79e142d62058640354dd0ab2524d34325b447faf9bacc6c5de2259e", + "route_weight_sha256": "f2812efc2e67b393a6db23a964b8241184508fc2ba667d4cfd5285d08091223c", + "loads": [ + 8, + 11, + 16, + 4, + 10, + 2, + 18, + 3, + 4, + 8, + 15, + 12, + 12, + 9, + 6, + 4, + 11, + 8, + 1, + 11, + 12, + 9, + 7, + 12, + 6, + 12, + 10, + 19, + 15, + 18, + 5, + 11, + 27, + 15, + 9, + 7, + 12, + 7, + 20, + 5, + 14, + 2, + 4, + 21, + 1, + 8, + 16, + 13, + 4, + 10, + 7, + 24, + 18, + 19, + 5, + 6, + 12, + 11, + 16, + 17, + 4, + 10, + 15, + 10 + ], + "weighted_loads": [ + 0.4390263296663761, + 0.9443572424352169, + 1.150593688711524, + 0.17251061275601387, + 1.005765724927187, + 0.08642781153321266, + 1.9792323308065534, + 0.11383875086903572, + 0.1743462923914194, + 0.7426759079098701, + 0.9054653234779835, + 1.6241156347095966, + 1.4944772943854332, + 0.3955880533903837, + 0.5128786675632, + 0.362332995980978, + 0.8010259754955769, + 0.6590278781950474, + 0.04207481071352959, + 0.6306440774351358, + 0.9770583491772413, + 0.8298728317022324, + 0.2708000149577856, + 0.6158706098794937, + 0.4391306862235069, + 0.9788336008787155, + 0.7298526801168919, + 1.5639932919293642, + 0.9349890425801277, + 0.7632364253513515, + 0.14897317811846733, + 0.4916674233973026, + 3.668389340862632, + 0.7297265753149986, + 0.5837300699204206, + 0.5008144043385983, + 1.0121276080608368, + 0.32724886760115623, + 1.3185802102088928, + 0.765619296580553, + 1.2189277913421392, + 0.06709694862365723, + 0.1607826165854931, + 2.4784634094685316, + 0.05991377308964729, + 0.4299309141933918, + 0.5748543236404657, + 0.9403930008411407, + 0.25844549015164375, + 0.9789294004440308, + 0.35344882495701313, + 2.6912464313209057, + 1.9422369450330734, + 0.8680588789284229, + 0.408101262524724, + 0.3453541975468397, + 0.8901196047663689, + 1.6416268646717072, + 1.010448293760419, + 1.1562584657222033, + 0.16286342032253742, + 0.6139311138540506, + 1.3316261135041714, + 1.6460594646632671 + ], + "unique_experts": 64, + "load_cv": 0.5388388275225972, + "normalized_load_entropy": 0.963587118033054, + "max_load_share": 0.03982300884955752 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "78d9d2596892f1f3c70ae5b0676595efdf70310fc080df8e7fd95a0d4f3debf1", + "route_weight_sha256": "f7a8981bc8b020d12ec92b219647648c16f419101b467c62d2ec40f661c63440", + "loads": [ + 8, + 12, + 16, + 5, + 10, + 2, + 18, + 4, + 4, + 13, + 19, + 18, + 13, + 10, + 20, + 6, + 11, + 20, + 1, + 12, + 12, + 10, + 7, + 12, + 13, + 12, + 16, + 28, + 15, + 19, + 11, + 11, + 29, + 15, + 11, + 7, + 18, + 7, + 20, + 5, + 15, + 2, + 4, + 26, + 2, + 8, + 19, + 14, + 5, + 10, + 15, + 25, + 22, + 19, + 6, + 6, + 29, + 19, + 22, + 18, + 4, + 10, + 16, + 12 + ], + "weighted_loads": [ + 0.4390263296663761, + 1.0540203638374805, + 1.150593688711524, + 0.20091543719172478, + 1.005765724927187, + 0.08642781153321266, + 1.9792323308065534, + 0.18366596475243568, + 0.1743462923914194, + 1.0519244614988565, + 1.176770057529211, + 2.073983469977975, + 1.6173989698290825, + 0.4550573769956827, + 1.2069066781550646, + 0.45750363543629646, + 0.8010259754955769, + 1.310901764780283, + 0.04207481071352959, + 0.6874785702675581, + 0.9770583491772413, + 0.8619402088224888, + 0.2708000149577856, + 0.6158706098794937, + 0.8311965502798557, + 0.9788336008787155, + 1.7129382863640785, + 1.9136536717414856, + 0.9349890425801277, + 0.8110248516313732, + 0.7508972026407719, + 0.4916674233973026, + 3.7586540523916483, + 0.7297265753149986, + 0.7339395042508841, + 0.5008144043385983, + 1.292253227904439, + 0.32724886760115623, + 1.3185802102088928, + 0.765619296580553, + 1.2598175536841154, + 0.06709694862365723, + 0.1607826165854931, + 2.7242616545408964, + 0.11299775913357735, + 0.4299309141933918, + 0.7480463702231646, + 0.975151464343071, + 0.310365904122591, + 0.9789294004440308, + 0.7030993644148111, + 2.8655259869992733, + 2.380364991724491, + 0.8680588789284229, + 0.45501683093607426, + 0.3453541975468397, + 2.1024100705981255, + 2.140793891623616, + 1.24543353356421, + 1.2038916405290365, + 0.16286342032253742, + 0.6139311138540506, + 1.3725581355392933, + 1.7276336252689362 + ], + "unique_experts": 64, + "load_cv": 0.5360142309727137, + "normalized_load_entropy": 0.9632522519314553, + "max_load_share": 0.035024154589371984 + } + }, + "s1_x": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "031f44e6f81317d9df8180774debb9eda20033224331428987f3d45c57ec6317", + "route_weight_sha256": "6e2c9c17d1b059415a22dafca972edbc36301ade1bd3eef9eb72dfd38f35770c", + "loads": [ + 9, + 11, + 15, + 3, + 10, + 3, + 18, + 3, + 5, + 8, + 15, + 11, + 13, + 8, + 9, + 4, + 11, + 8, + 2, + 12, + 12, + 10, + 6, + 13, + 6, + 12, + 11, + 20, + 14, + 17, + 5, + 10, + 25, + 17, + 9, + 6, + 12, + 6, + 21, + 6, + 13, + 2, + 5, + 21, + 1, + 11, + 14, + 14, + 2, + 9, + 4, + 23, + 18, + 16, + 5, + 7, + 9, + 10, + 16, + 19, + 6, + 10, + 17, + 10 + ], + "weighted_loads": [ + 0.4971645139157772, + 0.9401619173586369, + 1.1443980559706688, + 0.15493136644363403, + 0.9856861755251884, + 0.13076532632112503, + 1.9735311474651098, + 0.10919010266661644, + 0.19376832991838455, + 0.7475582025945187, + 0.8437630869448185, + 1.603992410004139, + 1.5101798977702856, + 0.34450277872383595, + 0.6233233325183392, + 0.3620092570781708, + 0.7992734499275684, + 0.6931090950965881, + 0.06963908299803734, + 0.6845761407166719, + 0.882794177159667, + 0.8496983386576176, + 0.2286202646791935, + 0.6730036959052086, + 0.4337055366486311, + 0.967064380645752, + 0.772092055529356, + 1.6181275751441717, + 0.9050463736057281, + 0.7087778514251113, + 0.16503026336431503, + 0.45241396129131317, + 3.531112778931856, + 0.8405964821577072, + 0.5741551239043474, + 0.40488155372440815, + 0.9939928762614727, + 0.29392740689218044, + 1.4582239426672459, + 0.7254314832389355, + 1.0665472783148289, + 0.0669294036924839, + 0.18403352983295918, + 2.2367175947874784, + 0.05285221338272095, + 0.5336606465280056, + 0.487228000536561, + 1.0075224936008453, + 0.24347300454974174, + 0.9933533705770969, + 0.20940405130386353, + 2.487922824919224, + 1.8110067918896675, + 0.6869878768920898, + 0.39108114317059517, + 0.35684050992131233, + 0.7103034313768148, + 1.5921631753444672, + 1.029456326738, + 1.1901320591568947, + 0.2515533473342657, + 0.6215487197041512, + 1.4070234652608633, + 1.6245248299092054 + ], + "unique_experts": 64, + "load_cv": 0.527875261377356, + "normalized_load_entropy": 0.9648937508855936, + "max_load_share": 0.03687315634218289 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "2889a947c3d896a9d6870c5dd1ad3812b798e56cd437a05ec7522b7572663d42", + "route_weight_sha256": "bdeac8f845d280889036680c930aff76cdd5a3fb821d09f5a73421c922fe645d", + "loads": [ + 9, + 12, + 15, + 3, + 13, + 4, + 18, + 5, + 5, + 16, + 23, + 19, + 14, + 9, + 24, + 9, + 11, + 14, + 2, + 13, + 12, + 16, + 12, + 13, + 15, + 14, + 23, + 29, + 14, + 22, + 13, + 11, + 29, + 17, + 16, + 6, + 24, + 11, + 24, + 7, + 14, + 3, + 7, + 25, + 1, + 12, + 17, + 16, + 3, + 11, + 11, + 24, + 27, + 18, + 8, + 9, + 29, + 19, + 27, + 27, + 8, + 10, + 20, + 12 + ], + "weighted_loads": [ + 0.4971645139157772, + 1.0358745642006397, + 1.1443980559706688, + 0.15493136644363403, + 1.1659525018185377, + 0.17545843496918678, + 1.9735311474651098, + 0.24383793026208878, + 0.19376832991838455, + 1.2242716178297997, + 1.6344255283474922, + 2.3873323164880276, + 1.6268998887389898, + 0.39866516552865505, + 1.5230153501033783, + 0.6691503338515759, + 0.7992734499275684, + 1.1110101342201233, + 0.06963908299803734, + 0.7513043005019426, + 0.882794177159667, + 1.2019814867526293, + 0.6798880696296692, + 0.6730036959052086, + 0.8738116454333067, + 1.0721657685935497, + 2.213193867355585, + 1.9689020719379187, + 0.9050463736057281, + 0.9115865705534816, + 1.0030162036418915, + 0.532003715634346, + 3.704213999211788, + 0.8405964821577072, + 0.9469327013939619, + 0.40488155372440815, + 1.6399489492177963, + 0.5951276030391455, + 1.7372398637235165, + 0.7591076716780663, + 1.09593671746552, + 0.09927967563271523, + 0.27714343555271626, + 2.436012526974082, + 0.05285221338272095, + 0.5511431694030762, + 0.6880621965974569, + 1.1244215704500675, + 0.27886298671364784, + 1.1487616337835789, + 0.5003593787550926, + 2.5674705654382706, + 2.587627809494734, + 0.8791706971824169, + 0.6042987555265427, + 0.472184494137764, + 2.466394456103444, + 2.455645725131035, + 1.668357016518712, + 1.560036500915885, + 0.4965671431273222, + 0.6215487197041512, + 1.5305423140525818, + 1.7086284030228853 + ], + "unique_experts": 64, + "load_cv": 0.5069003435061565, + "normalized_load_entropy": 0.9669348305120089, + "max_load_share": 0.031385281385281384 + } + }, + "s0_period": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "4a0f4b09c2b0e1c43fbdf217bdcbb02018341f45294a5f55b5745555b385fbbc", + "route_weight_sha256": "48c1d287656ad7f367785f44df40fa87ea8f2766c2cb278351ffb786ea3485a0", + "loads": [ + 8, + 11, + 16, + 4, + 10, + 2, + 17, + 3, + 4, + 8, + 15, + 12, + 13, + 9, + 6, + 3, + 11, + 8, + 1, + 12, + 12, + 10, + 6, + 12, + 6, + 11, + 9, + 19, + 15, + 18, + 6, + 12, + 25, + 17, + 12, + 7, + 13, + 7, + 20, + 5, + 14, + 2, + 6, + 22, + 2, + 9, + 15, + 14, + 3, + 9, + 4, + 23, + 18, + 19, + 5, + 6, + 11, + 11, + 15, + 17, + 5, + 10, + 15, + 8 + ], + "weighted_loads": [ + 0.44205542653799057, + 0.9391667060554028, + 1.1549221202731133, + 0.18279866501688957, + 0.9958506338298321, + 0.08863753080368042, + 1.9708078932017088, + 0.11774645000696182, + 0.16859558410942554, + 0.7363282404839993, + 0.9054279029369354, + 1.6169863268733025, + 1.5312450006604195, + 0.39901953376829624, + 0.5134064145386219, + 0.3231185972690582, + 0.7892177775502205, + 0.6518914066255093, + 0.04357273504137993, + 0.6807105243206024, + 0.9407193008810282, + 0.862838895060122, + 0.23586901277303696, + 0.6150685213506222, + 0.4310971796512604, + 0.9463466051965952, + 0.6751870298758149, + 1.543796731159091, + 0.9402106888592243, + 0.757751839235425, + 0.18211989663541317, + 0.5453517381101847, + 3.5515216048806906, + 0.7996535431593657, + 0.6622840501368046, + 0.5069783516228199, + 1.0517524760216475, + 0.32895420491695404, + 1.3199828751385212, + 0.7450376264750957, + 1.2242602352052927, + 0.06895612180233002, + 0.21354984864592552, + 2.4914685543626547, + 0.08875376917421818, + 0.4401924442499876, + 0.5450545605272055, + 0.9929858688265085, + 0.23889733478426933, + 0.9306291323155165, + 0.21843987330794334, + 2.6346586979925632, + 1.948485791683197, + 0.8499763030558825, + 0.39645288698375225, + 0.33787570148706436, + 0.8851331360638142, + 1.634811632335186, + 0.9668187499046326, + 1.1634763088077307, + 0.20508938655257225, + 0.6167562529444695, + 1.3099854453466833, + 1.608225543051958 + ], + "unique_experts": 64, + "load_cv": 0.531554909422771, + "normalized_load_entropy": 0.9642457778511406, + "max_load_share": 0.03687315634218289 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "b0925f200dd43c5918889216bf8563728f9ac27bd8c1357cbe22aac8a72144f7", + "route_weight_sha256": "803b7653e00cd26fd82aff414d0c03d808bd01e43555997b958906bb082cfb25", + "loads": [ + 8, + 12, + 16, + 5, + 10, + 2, + 17, + 4, + 4, + 13, + 19, + 16, + 14, + 10, + 20, + 4, + 11, + 18, + 1, + 13, + 12, + 11, + 6, + 12, + 13, + 11, + 15, + 26, + 15, + 18, + 14, + 12, + 28, + 18, + 15, + 7, + 20, + 7, + 20, + 5, + 15, + 2, + 7, + 25, + 4, + 9, + 19, + 15, + 4, + 9, + 13, + 24, + 23, + 19, + 6, + 6, + 27, + 18, + 21, + 18, + 5, + 10, + 16, + 11 + ], + "weighted_loads": [ + 0.44205542653799057, + 1.0568277426064014, + 1.1549221202731133, + 0.21181631088256836, + 0.9958506338298321, + 0.08863753080368042, + 1.9708078932017088, + 0.19416235387325287, + 0.16859558410942554, + 1.0401168633252382, + 1.1787618659436703, + 1.9195114467293024, + 1.6591408476233482, + 0.45848885737359524, + 1.1390967424958944, + 0.38073692470788956, + 0.7892177775502205, + 1.2047224044799805, + 0.04357273504137993, + 0.7392708286643028, + 0.9407193008810282, + 0.8949062721803784, + 0.23586901277303696, + 0.6150685213506222, + 0.8762071765959263, + 0.9463466051965952, + 1.6770123923197389, + 1.827655777335167, + 0.9402106888592243, + 0.757751839235425, + 0.855659618973732, + 0.5453517381101847, + 3.6773543152958155, + 0.8383545521646738, + 0.8455073684453964, + 0.5069783516228199, + 1.3986791912466288, + 0.32895420491695404, + 1.3199828751385212, + 0.7450376264750957, + 1.2651499975472689, + 0.06895612180233002, + 0.26652590557932854, + 2.6434919368475676, + 0.18050841055810452, + 0.4401924442499876, + 0.758115915581584, + 1.0322764087468386, + 0.30637814477086067, + 0.9306291323155165, + 0.5973257310688496, + 2.8166527338325977, + 2.464201644062996, + 0.8499763030558825, + 0.4433684553951025, + 0.33787570148706436, + 2.1280272640287876, + 2.025112146511674, + 1.2018039897084236, + 1.211109483614564, + 0.20508938655257225, + 0.6167562529444695, + 1.3509174673818052, + 1.773804172873497 + ], + "unique_experts": 64, + "load_cv": 0.5117809734205674, + "normalized_load_entropy": 0.9659815052301706, + "max_load_share": 0.033816425120772944 + } + }, + "s1_period": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "56a93fc78b6053ee6e583989474609d58b5a91a78f2a1274fe81829464021278", + "route_weight_sha256": "b610d0f42b2a6beec405aed4a00637bf19978430a9adee27d1da5095e7d6981d", + "loads": [ + 10, + 11, + 15, + 3, + 10, + 3, + 18, + 2, + 5, + 8, + 15, + 11, + 14, + 7, + 9, + 3, + 11, + 10, + 2, + 13, + 12, + 11, + 8, + 13, + 6, + 13, + 12, + 20, + 14, + 17, + 5, + 11, + 24, + 19, + 10, + 5, + 12, + 6, + 21, + 6, + 13, + 1, + 6, + 21, + 1, + 9, + 16, + 14, + 2, + 10, + 5, + 23, + 17, + 12, + 4, + 7, + 6, + 10, + 16, + 20, + 5, + 10, + 15, + 10 + ], + "weighted_loads": [ + 0.5359042286872864, + 0.9466025941073895, + 1.1353438682854176, + 0.15924567729234695, + 0.9885377623140812, + 0.13973693549633026, + 1.98554090783, + 0.0931520126760006, + 0.1931562926620245, + 0.7697622142732143, + 0.82985994592309, + 1.5883266180753708, + 1.5312615297734737, + 0.31260576844215393, + 0.6215834878385067, + 0.30999794602394104, + 0.7873528636991978, + 0.7713203709572554, + 0.07032232359051704, + 0.7014852222055197, + 0.8686033096164465, + 0.8977413345128298, + 0.2926410995423794, + 0.6675385944545269, + 0.43717610463500023, + 0.9992437995970249, + 0.7741354051977396, + 1.594460129737854, + 0.8906681425869465, + 0.6950110667385161, + 0.15882041677832603, + 0.4885600619018078, + 3.5323834735900164, + 0.8713115341961384, + 0.6257867198437452, + 0.3845636211335659, + 0.9774257019162178, + 0.3020842280238867, + 1.467555545270443, + 0.750116128474474, + 1.0874977819621563, + 0.027836298570036888, + 0.2230842560529709, + 2.224847486242652, + 0.05506996437907219, + 0.44636896438896656, + 0.580589197576046, + 1.0020441208034754, + 0.2182174138724804, + 1.0190004706382751, + 0.2515432573854923, + 2.5271024592220783, + 1.7894616462290287, + 0.5544687155634165, + 0.35962141677737236, + 0.336787935346365, + 0.5658974088728428, + 1.5845559611916542, + 1.0357823986560106, + 1.2333306055516005, + 0.21880827844142914, + 0.6090709697455168, + 1.3045968925580382, + 1.7002001143991947 + ], + "unique_experts": 64, + "load_cv": 0.5341677108103174, + "normalized_load_entropy": 0.9631369291312307, + "max_load_share": 0.035398230088495575 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "1bdcb5d82159d82fdd2dbb824333d064657d9599e8c7e3a233c3252078cb8a12", + "route_weight_sha256": "c3f556de1c09e9da8123432e433143f0f44eaaf8e08435d5a3d11e21c24009f0", + "loads": [ + 10, + 12, + 15, + 3, + 13, + 3, + 18, + 3, + 5, + 16, + 23, + 17, + 15, + 8, + 24, + 8, + 11, + 16, + 2, + 14, + 12, + 17, + 14, + 13, + 16, + 15, + 23, + 29, + 14, + 21, + 14, + 12, + 28, + 20, + 17, + 5, + 25, + 12, + 24, + 7, + 14, + 1, + 9, + 25, + 1, + 10, + 20, + 16, + 3, + 12, + 13, + 24, + 27, + 14, + 8, + 9, + 26, + 17, + 26, + 27, + 7, + 10, + 18, + 13 + ], + "weighted_loads": [ + 0.5359042286872864, + 1.043578702956438, + 1.1353438682854176, + 0.15924567729234695, + 1.1688040886074305, + 0.13973693549633026, + 1.98554090783, + 0.18147089704871178, + 0.1931562926620245, + 1.2435031682252884, + 1.6494427882134914, + 2.2051920853555202, + 1.6442338787019253, + 0.36676815524697304, + 1.509061861783266, + 0.6132128313183784, + 0.7873528636991978, + 1.2414831649512053, + 0.07032232359051704, + 0.7650153990834951, + 0.8686033096164465, + 1.2500244826078415, + 0.7439089044928551, + 0.6675385944545269, + 0.9509427174925804, + 1.1043451875448227, + 2.190320434048772, + 1.9396976083517075, + 0.8906681425869465, + 0.8324739024974406, + 1.036519542336464, + 0.5681498162448406, + 3.7004568334668875, + 0.9072658196091652, + 0.997613413259387, + 0.3845636211335659, + 1.6799576729536057, + 0.6340193562209606, + 1.7465714663267136, + 0.7837923169136047, + 1.1168872211128473, + 0.027836298570036888, + 0.3546927683055401, + 2.4241424184292555, + 0.05506996437907219, + 0.46385148726403713, + 0.8285842463374138, + 1.1201453264802694, + 0.2536073960363865, + 1.174408733844757, + 0.5758846811950207, + 2.6070424802601337, + 2.614834789186716, + 0.7466515358537436, + 0.6111180521547794, + 0.4521319195628166, + 2.3905793838202953, + 2.286849655210972, + 1.6109422910958529, + 1.5579922460019588, + 0.4638220742344856, + 0.6090709697455168, + 1.4281157413497567, + 1.8736704215407372 + ], + "unique_experts": 64, + "load_cv": 0.5057159088103765, + "normalized_load_entropy": 0.9656036920086813, + "max_load_share": 0.031385281385281384 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 113, + "ordered_topk_exact_tokens": 71, + "set_exact_tokens": 89, + "mean_set_jaccard": 0.9393173198482933, + "mean_token_weighted_tv": 0.014341651676305099, + "aggregate_load_tv": 0.029498525073746312 + }, + "system_bos": { + "tokens": 113, + "ordered_topk_exact_tokens": 73, + "set_exact_tokens": 91, + "mean_set_jaccard": 0.936156763590392, + "mean_token_weighted_tv": 0.024379006442737525, + "aggregate_load_tv": 0.025073746312684365 + }, + "system_x": { + "tokens": 113, + "ordered_topk_exact_tokens": 51, + "set_exact_tokens": 73, + "mean_set_jaccard": 0.8912768647281922, + "mean_token_weighted_tv": 0.0296500940596998, + "aggregate_load_tv": 0.042772861356932146 + }, + "system_period": { + "tokens": 113, + "ordered_topk_exact_tokens": 47, + "set_exact_tokens": 64, + "mean_set_jaccard": 0.8670459334176149, + "mean_token_weighted_tv": 0.03317239930836764, + "aggregate_load_tv": 0.05457227138643067 + }, + "bos_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 66, + "set_exact_tokens": 78, + "mean_set_jaccard": 0.9013906447534766, + "mean_token_weighted_tv": 0.02824515056079336, + "aggregate_load_tv": 0.04277286135693215 + }, + "bos_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 58, + "set_exact_tokens": 82, + "mean_set_jaccard": 0.9216182048040454, + "mean_token_weighted_tv": 0.022204195998147526, + "aggregate_load_tv": 0.030973451327433628 + }, + "x_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 64, + "set_exact_tokens": 75, + "mean_set_jaccard": 0.9039190897597978, + "mean_token_weighted_tv": 0.022786574718435253, + "aggregate_load_tv": 0.035398230088495575 + }, + "x_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 47, + "set_exact_tokens": 72, + "mean_set_jaccard": 0.8925410872313527, + "mean_token_weighted_tv": 0.029351348397363208, + "aggregate_load_tv": 0.03392330383480826 + }, + "period_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 69, + "set_exact_tokens": 86, + "mean_set_jaccard": 0.9317319848293298, + "mean_token_weighted_tv": 0.019341009261037132, + "aggregate_load_tv": 0.030973451327433628 + }, + "period_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 44, + "set_exact_tokens": 63, + "mean_set_jaccard": 0.8683101559207754, + "mean_token_weighted_tv": 0.033187482699718884, + "aggregate_load_tv": 0.051622418879056046 + } + } + } + } + }, + { + "id": "tnews/test/4855", + "domain": "chinese", + "label": "中文新闻", + "within_domain_index": 0, + "selection_rank": "000b4d139c925918017352dc899d44353839fb496e1a607335490e402857bf46", + "source_text_sha256": "deb4147668bb781cb7212a520a58f28e45808e316b8cfa57e936c373f8512807", + "source_characters": 30, + "source_tokens": 23, + "content_token_ids_sha256": "f6727c5b619c00c37bbef16c2b28820c61713b846f0fc7ea5b00cf2cdbc1dc2a", + "prompt_tokens_by_condition": { + "s0_eos": 48, + "s1_eos": 64, + "s0_bos": 48, + "s1_bos": 64, + "s0_x": 48, + "s1_x": 64, + "s0_period": 48, + "s1_period": 64 + }, + "batch_prompt_tokens": 64, + "content_tokens": 23, + "boundary_crossing_tokens_by_condition": { + "s0_eos": 0, + "s1_eos": 0, + "s0_bos": 0, + "s1_bos": 0, + "s0_x": 0, + "s1_x": 0, + "s0_period": 0, + "s1_period": 0 + }, + "forward_seconds": 0.6315774229879025, + "peak_cuda_memory_allocated_bytes": 27587582976, + "hidden_stages": { + "embedding": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6131f203fa8740bfb2e4669ab8ffafdc58b5519951c99190fe11c5633038b898", + "mean": -0.0013041805941611528, + "std": 0.11127576231956482, + "rms": 0.11128340661525726, + "max_abs": 2.015625 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8ef44ef67c0ef553c73ac87e9dbfd62f6d12636f43df0c9ba15f11b3c8cc2c5c", + "mean": -0.001113120117224753, + "std": 0.09857547283172607, + "rms": 0.09858175367116928, + "max_abs": 2.046875 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6131f203fa8740bfb2e4669ab8ffafdc58b5519951c99190fe11c5633038b898", + "mean": -0.0013041805941611528, + "std": 0.11127576231956482, + "rms": 0.11128340661525726, + "max_abs": 2.015625 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "dadd82b279be3a44686dcec70f6aabe1b046029da42be788c0c73ca9043f25bb", + "mean": -0.0013841092586517334, + "std": 0.10015734285116196, + "rms": 0.10016690194606781, + "max_abs": 2.046875 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6131f203fa8740bfb2e4669ab8ffafdc58b5519951c99190fe11c5633038b898", + "mean": -0.0013041805941611528, + "std": 0.11127576231956482, + "rms": 0.11128340661525726, + "max_abs": 2.015625 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9c6bde7062b88a07b74feeaa46dd0c44c7fde7a9cd49e5e257abc773f9e010f2", + "mean": -0.0010811785468831658, + "std": 0.09817982465028763, + "rms": 0.09818577766418457, + "max_abs": 2.046875 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6131f203fa8740bfb2e4669ab8ffafdc58b5519951c99190fe11c5633038b898", + "mean": -0.0013041805941611528, + "std": 0.11127576231956482, + "rms": 0.11128340661525726, + "max_abs": 2.015625 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "36e81515de0ad1b5eeeab885db19464436478d16725225b67d55a8680974cf9c", + "mean": -0.001360153080895543, + "std": 0.09986551851034164, + "rms": 0.09987477958202362, + "max_abs": 2.046875 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6131f203fa8740bfb2e4669ab8ffafdc58b5519951c99190fe11c5633038b898", + "mean": -0.0013041805941611528, + "std": 0.11127576231956482, + "rms": 0.11128340661525726, + "max_abs": 2.015625 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "66d13f253b329c39a312df200c545a5716e3b2d0ad7ec42582eebc090697190d", + "mean": -0.0011595631949603558, + "std": 0.09844643622636795, + "rms": 0.09845326840877533, + "max_abs": 2.046875 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6131f203fa8740bfb2e4669ab8ffafdc58b5519951c99190fe11c5633038b898", + "mean": -0.0013041805941611528, + "std": 0.11127576231956482, + "rms": 0.11128340661525726, + "max_abs": 2.015625 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "818c97022ebe6dbfd54e21ec866b399e6c30aabf42a597d1e70bbf850679090f", + "mean": -0.001418941537849605, + "std": 0.10006202012300491, + "rms": 0.10007207840681076, + "max_abs": 2.046875 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6131f203fa8740bfb2e4669ab8ffafdc58b5519951c99190fe11c5633038b898", + "mean": -0.0013041805941611528, + "std": 0.11127576231956482, + "rms": 0.11128340661525726, + "max_abs": 2.015625 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "aa558159dbad510c777bcced1be325a9c3f62c20bc97e7b4bf297f55e047aed8", + "mean": -0.0011612535454332829, + "std": 0.0981423407793045, + "rms": 0.09814921021461487, + "max_abs": 2.046875 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6131f203fa8740bfb2e4669ab8ffafdc58b5519951c99190fe11c5633038b898", + "mean": -0.0013041805941611528, + "std": 0.11127576231956482, + "rms": 0.11128340661525726, + "max_abs": 2.015625 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a551a0392d4c385d788fea5a7ce4d3e4fbf6923382e72f71afceb6736f23ea4e", + "mean": -0.0014202093007043004, + "std": 0.09983772039413452, + "rms": 0.09984782338142395, + "max_abs": 2.046875 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "exact_hidden_rows": 23, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999998211860657, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "system_bos": { + "tokens": 23, + "exact_hidden_rows": 23, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999998211860657, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "system_x": { + "tokens": 23, + "exact_hidden_rows": 23, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999998211860657, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "system_period": { + "tokens": 23, + "exact_hidden_rows": 23, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999998211860657, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "bos_at_s0": { + "tokens": 23, + "exact_hidden_rows": 23, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999998211860657, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "bos_at_s1": { + "tokens": 23, + "exact_hidden_rows": 23, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999998211860657, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "x_at_s0": { + "tokens": 23, + "exact_hidden_rows": 23, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999998211860657, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "x_at_s1": { + "tokens": 23, + "exact_hidden_rows": 23, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999998211860657, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "period_at_s0": { + "tokens": 23, + "exact_hidden_rows": 23, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999998211860657, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "period_at_s1": { + "tokens": 23, + "exact_hidden_rows": 23, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999998211860657, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + } + } + }, + "layer_00": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b7ef62087d913c2d9a1a63ccb9e3110c6521881079ee85ec28b513c6071b13b0", + "mean": -0.0019739801064133644, + "std": 0.10446448624134064, + "rms": 0.10448314249515533, + "max_abs": 2.484375 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "479dc0d5e6d48b4132b26c6546f0fd8287e2dfcf3eefdc9aa737b4c3c2f0a348", + "mean": -0.001754326862283051, + "std": 0.09691625833511353, + "rms": 0.09693213552236557, + "max_abs": 2.484375 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0eb0e9fcfecbb23bc351435ca8fcae2d990d56010eda6873a108f57e8fea7259", + "mean": -0.0019738026894629, + "std": 0.10446838289499283, + "rms": 0.10448702424764633, + "max_abs": 2.515625 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2c9b4ea02411dd61fe77d4f8330c772ca9826178acc5c188a0a68da63f191c0d", + "mean": -0.00189383199904114, + "std": 0.0972166359424591, + "rms": 0.09723508358001709, + "max_abs": 2.515625 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b43836004f6676e811aa778c33433d6a2d16877d471f5078771a45df987459c4", + "mean": -0.001943552982993424, + "std": 0.10223494470119476, + "rms": 0.10225341469049454, + "max_abs": 2.359375 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a73319e82816ef4594e8956372ffbb799efec4f22fdf9e195eb163165ed7b798", + "mean": -0.0016920628258958459, + "std": 0.09516999870538712, + "rms": 0.09518503397703171, + "max_abs": 2.4375 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0111fef3cc7f392246ebdf74ce61ce411635e3140eb4b0e2663cfd833a5744cb", + "mean": -0.001955712214112282, + "std": 0.10221771150827408, + "rms": 0.10223641246557236, + "max_abs": 2.390625 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8829256e91a2a5bca9ce20eaab2727f8bc713fa8d58ead3547438d7ad78cd94c", + "mean": -0.001851374632678926, + "std": 0.09589194506406784, + "rms": 0.09590981900691986, + "max_abs": 2.4375 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5dd90864831d6d223a1ab542b2ea5a030c0308ee53fd7df707d928cc316cdedf", + "mean": -0.001935943029820919, + "std": 0.1019064337015152, + "rms": 0.1019248217344284, + "max_abs": 2.359375 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d54e542b1ed46892506d3bc67ec16f72c2a7f89490cfafa805e8093beb38a825", + "mean": -0.001733708195388317, + "std": 0.09527389705181122, + "rms": 0.09528966248035431, + "max_abs": 2.4375 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c58d9ee61b02ba87795f6558c84a0bacb73a8b70a1611c9dd9fcb38f4196719a", + "mean": -0.0019568607676774263, + "std": 0.10197316110134125, + "rms": 0.1019919365644455, + "max_abs": 2.40625 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0ed0ad3c0379ce3b2f2e9a8dc5bdc2b2e201235ca701b57fdff10caa6caa1174", + "mean": -0.0018932834500446916, + "std": 0.09604513645172119, + "rms": 0.09606379270553589, + "max_abs": 2.4375 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d8fc2a083210eab19a07bb0e078dff4e79ad15a25e9f99a1cc2246d8ec7851d4", + "mean": -0.0019394791452214122, + "std": 0.10201609879732132, + "rms": 0.1020345389842987, + "max_abs": 2.375 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2d22d4fc98b11da312523cadd709f06e8091883fce2d8ecb341315145b52bbfe", + "mean": -0.0017348158871755004, + "std": 0.09485828876495361, + "rms": 0.09487415105104446, + "max_abs": 2.4375 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bfcfbfe25259ab791fb5898628a59b44a9f2fb0cb0560f243e4d4d861c241093", + "mean": -0.001961284317076206, + "std": 0.10209859907627106, + "rms": 0.10211742669343948, + "max_abs": 2.40625 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "96dd7d344243680a4deb4105873527a44f5c17ecf539dfeca65b38d4b565a4c3", + "mean": -0.0018907077610492706, + "std": 0.09570757299661636, + "rms": 0.09572625160217285, + "max_abs": 2.4375 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9997454881668091, + "min_cosine_similarity": 0.9986011385917664, + "mean_relative_l2": 0.02010003849864006, + "max_abs_delta": 0.078125 + }, + "system_bos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9995680451393127, + "min_cosine_similarity": 0.9988576173782349, + "mean_relative_l2": 0.027715452015399933, + "max_abs_delta": 0.09375 + }, + "system_x": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9995983839035034, + "min_cosine_similarity": 0.9989045262336731, + "mean_relative_l2": 0.026905369013547897, + "max_abs_delta": 0.09375 + }, + "system_period": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9996473789215088, + "min_cosine_similarity": 0.9989703893661499, + "mean_relative_l2": 0.0251851137727499, + "max_abs_delta": 0.0703125 + }, + "bos_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9852129817008972, + "min_cosine_similarity": 0.9771109819412231, + "mean_relative_l2": 0.17025598883628845, + "max_abs_delta": 0.25244140625 + }, + "bos_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9866507053375244, + "min_cosine_similarity": 0.9795020818710327, + "mean_relative_l2": 0.16206979751586914, + "max_abs_delta": 0.2421875 + }, + "x_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9853930473327637, + "min_cosine_similarity": 0.978178083896637, + "mean_relative_l2": 0.16936171054840088, + "max_abs_delta": 0.25048828125 + }, + "x_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9868424534797668, + "min_cosine_similarity": 0.9793598651885986, + "mean_relative_l2": 0.16098155081272125, + "max_abs_delta": 0.2421875 + }, + "period_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9857376217842102, + "min_cosine_similarity": 0.978829026222229, + "mean_relative_l2": 0.16739177703857422, + "max_abs_delta": 0.265625 + }, + "period_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9871396422386169, + "min_cosine_similarity": 0.9796642065048218, + "mean_relative_l2": 0.15918798744678497, + "max_abs_delta": 0.25 + } + } + }, + "layer_01": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6619bcd08c17700fbef82081f93dd43fd49cf1b0ce4a73ac559186f397459826", + "mean": -0.002482388634234667, + "std": 0.11761102825403214, + "rms": 0.11763722449541092, + "max_abs": 2.875 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8ad990783ce424e0d79f1ae3672a9eaaf1970c674ec02a36e77d3de47e60186e", + "mean": -0.007867041043937206, + "std": 1.154313325881958, + "rms": 1.154340147972107, + "max_abs": 126.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d9ae7cbd015158a481311cf61a9dcfea393688fe5c2750996acf684cb676904f", + "mean": -0.0024607721716165543, + "std": 0.11748752743005753, + "rms": 0.11751329898834229, + "max_abs": 2.859375 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cc149cb53d4c13551dc73d0c0d2ad4cf45b7c51b044b0598bb539b5acd253682", + "mean": -0.006937483325600624, + "std": 1.0358202457427979, + "rms": 1.0358434915542603, + "max_abs": 135.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "efccf1ca6ed1af0fe4626d921e01cce036f2496908fd01d0511a5c026571915f", + "mean": -0.002661635633558035, + "std": 0.11496595293283463, + "rms": 0.1149967610836029, + "max_abs": 2.828125 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c85ff2d14bb1e55bb87e667439107e472d66ed183b6c67c39e4c0d5438d5b02a", + "mean": -0.002033679746091366, + "std": 0.1146402582526207, + "rms": 0.11465829610824585, + "max_abs": 4.6875 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "49e379382fadf6672d787a0df8d558c7c846da8e3441be43f749d2c55a2b5b63", + "mean": -0.0027737757191061974, + "std": 0.11502844840288162, + "rms": 0.11506188660860062, + "max_abs": 2.8125 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1c3fc48054474537d235882124b232ed72491c7e51c779b5fbf320f4ac7df4d7", + "mean": -0.0023935558274388313, + "std": 0.11431015282869339, + "rms": 0.11433520168066025, + "max_abs": 4.6875 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b1c3300d88bb68333a1d3785f5f2b968736e854d669f65f9936cf0c595059099", + "mean": -0.002581552369520068, + "std": 0.115144744515419, + "rms": 0.11517368257045746, + "max_abs": 2.78125 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3b5bb6a5d5fcda2eaec96eaafaf7fa68229ca37e981f713831785bbb2b943bb3", + "mean": -0.0019949718844145536, + "std": 0.11489132046699524, + "rms": 0.11490864306688309, + "max_abs": 4.6875 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "acaffa20bc38fcdeeefa5bd8390ac633060a769742f7ecfd8bb08d656465bdb9", + "mean": -0.0027400332037359476, + "std": 0.1149948313832283, + "rms": 0.11502747237682343, + "max_abs": 2.78125 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "56c82ae31cfc9685c5ba9348ecc27f5f78a6501057e0aaff93bee2b89c7e75b1", + "mean": -0.002392732072621584, + "std": 0.11440826207399368, + "rms": 0.11443327367305756, + "max_abs": 4.6875 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bbbdfaec651245bd5a106cd825f6af75c38d7e288277c17ae65228d578f3f5c4", + "mean": -0.002594259800389409, + "std": 0.11498653888702393, + "rms": 0.11501579731702805, + "max_abs": 2.75 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "297a11e1f0feedd3b775c912683202abc7170bd4624b7864ff5e7950908bea08", + "mean": -0.0020400125067681074, + "std": 0.11415214091539383, + "rms": 0.1141703650355339, + "max_abs": 4.6875 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c9a5843d5f59bd832483401827b9125f4ba8374d8c93e3379103543f8d896fc5", + "mean": -0.002753135049715638, + "std": 0.11496302485466003, + "rms": 0.11499598622322083, + "max_abs": 2.75 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c8015469121d65460542f6b633b8df22dc56f2e8f49cfd85404917d00dce9df5", + "mean": -0.0024225206580013037, + "std": 0.1139068529009819, + "rms": 0.11393260955810547, + "max_abs": 4.6875 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9989041090011597, + "min_cosine_similarity": 0.9963462948799133, + "mean_relative_l2": 0.044399410486221313, + "max_abs_delta": 0.0625 + }, + "system_bos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9965267777442932, + "min_cosine_similarity": 0.991642415523529, + "mean_relative_l2": 0.08164683729410172, + "max_abs_delta": 0.09375 + }, + "system_x": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9947412610054016, + "min_cosine_similarity": 0.9872044324874878, + "mean_relative_l2": 0.09983272850513458, + "max_abs_delta": 0.1015625 + }, + "system_period": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9950743913650513, + "min_cosine_similarity": 0.9869435429573059, + "mean_relative_l2": 0.09643316268920898, + "max_abs_delta": 0.109375 + }, + "bos_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9842036962509155, + "min_cosine_similarity": 0.9624834656715393, + "mean_relative_l2": 0.17475971579551697, + "max_abs_delta": 0.21875 + }, + "bos_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.984399139881134, + "min_cosine_similarity": 0.9666893482208252, + "mean_relative_l2": 0.17321360111236572, + "max_abs_delta": 0.234375 + }, + "x_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9859660863876343, + "min_cosine_similarity": 0.9645609259605408, + "mean_relative_l2": 0.16459313035011292, + "max_abs_delta": 0.2783203125 + }, + "x_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9826960563659668, + "min_cosine_similarity": 0.9631816148757935, + "mean_relative_l2": 0.1815011203289032, + "max_abs_delta": 0.294921875 + }, + "period_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9861570596694946, + "min_cosine_similarity": 0.9648560285568237, + "mean_relative_l2": 0.16366927325725555, + "max_abs_delta": 0.25 + }, + "period_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9831608533859253, + "min_cosine_similarity": 0.9653186798095703, + "mean_relative_l2": 0.1793922483921051, + "max_abs_delta": 0.294921875 + } + } + }, + "layer_02": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a37280a1e4934958233d6ed7f3693317ea532483233a119f95d4e36ca738bbb6", + "mean": -0.001991121331229806, + "std": 0.13904155790805817, + "rms": 0.13905581831932068, + "max_abs": 3.15625 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "96748429c82ba74a719c38bd5c55ce5d8f4f942fa070307d86739e72af0330c6", + "mean": -0.02143874205648899, + "std": 3.465128183364868, + "rms": 3.4651944637298584, + "max_abs": 392.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c35c0e1a50495628eb82adc268befc76bd94e8daf2cd6dc480d47e9c8dd0e986", + "mean": -0.0018582188058644533, + "std": 0.13849607110023499, + "rms": 0.13850852847099304, + "max_abs": 3.125 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c5b28c5dafe17d5e7cb0ea18356aaf073a8afc0780be294f501fc63dbafbe1cf", + "mean": -0.019196288660168648, + "std": 3.3241984844207764, + "rms": 3.324253797531128, + "max_abs": 436.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6847ac848ca4f4b870cd072aa5cba8bb3d6d2b112ae3bd9e6e0cb27f0403ee87", + "mean": -0.0021432763896882534, + "std": 0.13700105249881744, + "rms": 0.13701781630516052, + "max_abs": 3.171875 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bd0a54833ed9daedbb08955d2e1390fd1c122b96ecc7eaf60b8ae821a1d91c06", + "mean": -0.0025249116588383913, + "std": 0.2694056034088135, + "rms": 0.2694174349308014, + "max_abs": 23.75 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "09f01c0b00a8a31560c9682bc489e0d130a340428c8370bef865e610c27f90d5", + "mean": -0.001923379022628069, + "std": 0.13653524219989777, + "rms": 0.13654878735542297, + "max_abs": 3.125 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f72e38efe2c5f97114e05170a63dfb8ad7f3a8ea76bde312d6dfbfb322a50dac", + "mean": -0.002393826376646757, + "std": 0.2424994260072708, + "rms": 0.24251124262809753, + "max_abs": 23.75 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "65d4600e904a18e64036b7b00809740c300ac76508037fce449ff7e2b113d10b", + "mean": -0.002016215119510889, + "std": 0.13652880489826202, + "rms": 0.13654369115829468, + "max_abs": 3.1875 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d18ca844e183a55663d513a6521a010d71fe3c21ae4abe50f0366c255c74eb10", + "mean": -0.0024544033221900463, + "std": 0.2695099413394928, + "rms": 0.26952114701271057, + "max_abs": 23.75 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fd4c3699cb3d3193a3e3af71ea993f8dc1ed9a88dda8e3672792522835052d19", + "mean": -0.0018170038238167763, + "std": 0.13549277186393738, + "rms": 0.13550496101379395, + "max_abs": 3.125 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b11b317129311e62a6e459fa5c171f948b5dd29fc2963dc7e688e77198de3c0a", + "mean": -0.002361967461183667, + "std": 0.24237661063671112, + "rms": 0.24238811433315277, + "max_abs": 23.75 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5c97f8949b02f66050708ea38a7c064235c6c93a2e3670044f8d082c3812fbbc", + "mean": -0.002007841831073165, + "std": 0.13603131473064423, + "rms": 0.1360461413860321, + "max_abs": 3.1875 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0e81a57ffa108ef9e8d166f69acce9f024201bee5694715ce286e8b62c4578fb", + "mean": -0.0025683699641376734, + "std": 0.2687988579273224, + "rms": 0.26881110668182373, + "max_abs": 23.75 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b04539464ea1100970e911f9302be49f813a561c613489ee65cef78a12358163", + "mean": -0.0018266616389155388, + "std": 0.13537311553955078, + "rms": 0.1353854387998581, + "max_abs": 3.09375 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2acf888e892c50460f5da303accb344c7454484ee5cf589f7444b76b0d4c7ad2", + "mean": -0.0024336143396794796, + "std": 0.24188584089279175, + "rms": 0.2418980896472931, + "max_abs": 23.75 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.998278021812439, + "min_cosine_similarity": 0.9942852258682251, + "mean_relative_l2": 0.05634090676903725, + "max_abs_delta": 0.09375 + }, + "system_bos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9944888353347778, + "min_cosine_similarity": 0.9843660593032837, + "mean_relative_l2": 0.10265032202005386, + "max_abs_delta": 0.12109375 + }, + "system_x": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9928478598594666, + "min_cosine_similarity": 0.9777247905731201, + "mean_relative_l2": 0.11614783108234406, + "max_abs_delta": 0.140625 + }, + "system_period": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9930605888366699, + "min_cosine_similarity": 0.975597083568573, + "mean_relative_l2": 0.11397268623113632, + "max_abs_delta": 0.140625 + }, + "bos_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9853609204292297, + "min_cosine_similarity": 0.9709770679473877, + "mean_relative_l2": 0.16946548223495483, + "max_abs_delta": 0.28125 + }, + "bos_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9825354218482971, + "min_cosine_similarity": 0.9679908752441406, + "mean_relative_l2": 0.1840258538722992, + "max_abs_delta": 0.37890625 + }, + "x_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9842504262924194, + "min_cosine_similarity": 0.9631236791610718, + "mean_relative_l2": 0.1739681214094162, + "max_abs_delta": 0.3369140625 + }, + "x_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9776814579963684, + "min_cosine_similarity": 0.951835036277771, + "mean_relative_l2": 0.20559491217136383, + "max_abs_delta": 0.458984375 + }, + "period_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9843562841415405, + "min_cosine_similarity": 0.9628318548202515, + "mean_relative_l2": 0.17359915375709534, + "max_abs_delta": 0.34375 + }, + "period_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9780557751655579, + "min_cosine_similarity": 0.9538074731826782, + "mean_relative_l2": 0.20390230417251587, + "max_abs_delta": 0.462890625 + } + } + }, + "layer_03": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "df8de4e7d4d1260f9c85e06c59a6518be878dcedfdfdb2a857f771fd0b9a8a70", + "mean": -0.0020450325682759285, + "std": 0.1658955067396164, + "rms": 0.1659080982208252, + "max_abs": 3.78125 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8752178fffb03c3e6d880eb24c7bb1bba570dfd95ec6a25b39130f4a665a5f57", + "mean": -0.028270287439227104, + "std": 10.389381408691406, + "rms": 10.389419555664062, + "max_abs": 1136.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "aec08f80c67a7d1e7a25b7b66cc9a928dcc404839ec318625226e337b366246d", + "mean": -0.001937886350788176, + "std": 0.16597004234790802, + "rms": 0.16598135232925415, + "max_abs": 3.75 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bda7f58027336af1b915e640defd459764723f672a0335919969ff12fcda46c6", + "mean": -0.024906061589717865, + "std": 9.292015075683594, + "rms": 9.292047500610352, + "max_abs": 1136.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f50003049b44a6e147aea6e606ddbd38ac78061055b8300483181a0b41a6315d", + "mean": -0.0023095004726201296, + "std": 0.16624513268470764, + "rms": 0.16626116633415222, + "max_abs": 3.8125 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b8f1fb41b678f54e8e36436a13bc31744d7026cf37f3b8c4f967616c909abdd6", + "mean": -0.007231568917632103, + "std": 9.261480331420898, + "rms": 9.261482238769531, + "max_abs": 1136.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "07f25037480dbb63b7b2f32cee681f1c0323034465bba3d5f2b7364f75ab4e70", + "mean": -0.0022180569358170033, + "std": 0.1672428995370865, + "rms": 0.16725759208202362, + "max_abs": 3.8125 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7d1285ebc8d9ba4c6d6155dc82dce1a722a31cddc5ae49611564878ed698c049", + "mean": -0.00632179481908679, + "std": 8.021040916442871, + "rms": 8.02104377746582, + "max_abs": 1136.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "add103aca5db385c633dda6cb199a54bffadfd2013b349843b888f887d508fe0", + "mean": -0.002350191818550229, + "std": 0.16490864753723145, + "rms": 0.16492538154125214, + "max_abs": 3.8125 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "aea3eefb3f61b612a6beece66411ee87a7cefa74698eaa1cd939268fb8f2b3b7", + "mean": -0.007331494241952896, + "std": 9.261454582214355, + "rms": 9.261457443237305, + "max_abs": 1136.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e47adcb1eb476b793410c0c1128df6f9e02d190ad7b46b97baec152feb813ba7", + "mean": -0.0023389754351228476, + "std": 0.16571329534053802, + "rms": 0.1657298058271408, + "max_abs": 3.765625 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9d0851551cb0d019cc0b2761fc94e5f398f263e354782ee310d2e20de76739f6", + "mean": -0.006460496224462986, + "std": 8.021018981933594, + "rms": 8.021021842956543, + "max_abs": 1136.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cadd12cfe1745dc12da069d4dd14c26c3e8362ecf8e7bc5ab2a74aec298a99cc", + "mean": -0.0023686394561082125, + "std": 0.16439023613929749, + "rms": 0.16440731287002563, + "max_abs": 3.78125 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d27dc1ec223f752353ba259ece3ad04999ec51defa9d7e6cb8ab405f5dd5e7e0", + "mean": -0.007349178194999695, + "std": 9.261439323425293, + "rms": 9.261441230773926, + "max_abs": 1136.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e185ecf60f81c222dcb627278a1a26088e7c6a91f2e597c45ecb299f5337e907", + "mean": -0.002305185655131936, + "std": 0.16571734845638275, + "rms": 0.16573336720466614, + "max_abs": 3.78125 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "364d35fef7cf758d7fd5a6d344f50ba7a2c47012a6839b903ed814eb0971ecc1", + "mean": -0.006443801335990429, + "std": 8.021007537841797, + "rms": 8.021010398864746, + "max_abs": 1136.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9982519745826721, + "min_cosine_similarity": 0.9935152530670166, + "mean_relative_l2": 0.05665694177150726, + "max_abs_delta": 0.203125 + }, + "system_bos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9945566654205322, + "min_cosine_similarity": 0.986998438835144, + "mean_relative_l2": 0.10338301211595535, + "max_abs_delta": 0.28125 + }, + "system_x": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9926035404205322, + "min_cosine_similarity": 0.9789166450500488, + "mean_relative_l2": 0.11917021870613098, + "max_abs_delta": 0.171875 + }, + "system_period": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9924659729003906, + "min_cosine_similarity": 0.9757165908813477, + "mean_relative_l2": 0.12007642537355423, + "max_abs_delta": 0.21875 + }, + "bos_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9867748022079468, + "min_cosine_similarity": 0.9789139628410339, + "mean_relative_l2": 0.16224287450313568, + "max_abs_delta": 0.359375 + }, + "bos_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9840227365493774, + "min_cosine_similarity": 0.972393810749054, + "mean_relative_l2": 0.17792430520057678, + "max_abs_delta": 0.46875 + }, + "x_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9858384132385254, + "min_cosine_similarity": 0.9737833738327026, + "mean_relative_l2": 0.16641457378864288, + "max_abs_delta": 0.30859375 + }, + "x_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9792351126670837, + "min_cosine_similarity": 0.9587982296943665, + "mean_relative_l2": 0.1994030624628067, + "max_abs_delta": 0.46875 + }, + "period_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9862668514251709, + "min_cosine_similarity": 0.9746779203414917, + "mean_relative_l2": 0.163752943277359, + "max_abs_delta": 0.30859375 + }, + "period_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9795163869857788, + "min_cosine_similarity": 0.9578590393066406, + "mean_relative_l2": 0.19815534353256226, + "max_abs_delta": 0.47265625 + } + } + }, + "layer_04": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1874257d257479b761eb906be444de0a6bf4d965a3f7d810b743ad0e6a1ada51", + "mean": -0.0026567818131297827, + "std": 0.20140515267848969, + "rms": 0.20142266154289246, + "max_abs": 5.5625 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3ca15eb496b0db52d32b64428cb222617e3661927ed13e254ecd565360eaf7eb", + "mean": -0.02831266075372696, + "std": 10.844250679016113, + "rms": 10.844287872314453, + "max_abs": 1152.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "81188e7e6a71d3d06677e98467c966bf20ac058b967656ff99d97c718b04ab10", + "mean": -0.002690061926841736, + "std": 0.20209483802318573, + "rms": 0.20211273431777954, + "max_abs": 5.53125 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8c9c02e8319fcc4265decbdf833ccbfae9c56841c04c9648d5ad5eb2ed938e59", + "mean": -0.02505638636648655, + "std": 9.670823097229004, + "rms": 9.670855522155762, + "max_abs": 1152.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7fd686c34d0adfca775d365baabbac39babcd9297c0fdd2ac60c834c2f1d38b7", + "mean": -0.003070756560191512, + "std": 0.2025836855173111, + "rms": 0.2026069462299347, + "max_abs": 5.6875 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ee2c3ad002d4b45eaf3bf9dac87c000bc9b4f5289404d3590b6655b4fc9820c4", + "mean": -0.007333592977374792, + "std": 9.717960357666016, + "rms": 9.717963218688965, + "max_abs": 1152.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "35c0d327d74ac9040eff6f9da89bcdde941ae4a7c70ee77a76de21554048edc5", + "mean": -0.0030126734636723995, + "std": 0.20446395874023438, + "rms": 0.2044861614704132, + "max_abs": 5.59375 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "73b3e6a94b119ee7318db01ced21cdd78858cfba0dfbf4f8b8abac7ef0edfef2", + "mean": -0.006476394832134247, + "std": 8.40512466430664, + "rms": 8.40512752532959, + "max_abs": 1152.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "54ad88e366d449b037f72abdd5576a973b614a50302364c652c9f22f7aad7e60", + "mean": -0.002692209556698799, + "std": 0.19987162947654724, + "rms": 0.19988976418972015, + "max_abs": 5.5625 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "54b1baf449117e5fb95859573174df110caee9936a326425d606705e24c34725", + "mean": -0.007103146519511938, + "std": 9.717900276184082, + "rms": 9.717903137207031, + "max_abs": 1152.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e2cc3bc2a839688ece5d5ec20316a59977cf5c4eea784f1e6392520b7baf1a0c", + "mean": -0.002782050985842943, + "std": 0.20118626952171326, + "rms": 0.20120550692081451, + "max_abs": 5.40625 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "03793157d987d8e905608eefaf32ba2e6efa86afe594353be1fb7c693306a131", + "mean": -0.0063655786216259, + "std": 8.405061721801758, + "rms": 8.405064582824707, + "max_abs": 1152.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ba595cf5ce99fe6656c6807ddd069f7ed44092ea49737ba00e9d122e0019c067", + "mean": -0.0026946754660457373, + "std": 0.19906829297542572, + "rms": 0.199086531996727, + "max_abs": 5.53125 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "807e74afe80303d7f1675db55dd8ddd80db795b5fe1745bbd86cd72534c06577", + "mean": -0.0071105267852544785, + "std": 9.717879295349121, + "rms": 9.717883110046387, + "max_abs": 1152.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d2e08d7c459725ba545ac843e9fccd225298b2551a407afbca2970a65af1e36d", + "mean": -0.0027799003291875124, + "std": 0.20108628273010254, + "rms": 0.2011054903268814, + "max_abs": 5.40625 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "128b6268ff046cb5aad7355d7926681cfb9e6102c94caa7984abe94bb6ddca93", + "mean": -0.0063619110733270645, + "std": 8.405047416687012, + "rms": 8.405050277709961, + "max_abs": 1152.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9983493089675903, + "min_cosine_similarity": 0.9941012859344482, + "mean_relative_l2": 0.05518539622426033, + "max_abs_delta": 0.21875 + }, + "system_bos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9947391152381897, + "min_cosine_similarity": 0.9886678457260132, + "mean_relative_l2": 0.1029403954744339, + "max_abs_delta": 0.2265625 + }, + "system_x": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9924773573875427, + "min_cosine_similarity": 0.9778090715408325, + "mean_relative_l2": 0.12229625880718231, + "max_abs_delta": 0.265625 + }, + "system_period": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9926024675369263, + "min_cosine_similarity": 0.9782159328460693, + "mean_relative_l2": 0.12126688659191132, + "max_abs_delta": 0.3125 + }, + "bos_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9901548624038696, + "min_cosine_similarity": 0.9839790463447571, + "mean_relative_l2": 0.14075036346912384, + "max_abs_delta": 0.3125 + }, + "bos_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9879652857780457, + "min_cosine_similarity": 0.9787405729293823, + "mean_relative_l2": 0.15601249039173126, + "max_abs_delta": 0.34375 + }, + "x_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9880385994911194, + "min_cosine_similarity": 0.976788341999054, + "mean_relative_l2": 0.1535804718732834, + "max_abs_delta": 0.37255859375 + }, + "x_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9819841980934143, + "min_cosine_similarity": 0.9652224183082581, + "mean_relative_l2": 0.18800297379493713, + "max_abs_delta": 0.541015625 + }, + "period_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9887306094169617, + "min_cosine_similarity": 0.9783805012702942, + "mean_relative_l2": 0.14897777140140533, + "max_abs_delta": 0.3125 + }, + "period_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9822667241096497, + "min_cosine_similarity": 0.9607294201850891, + "mean_relative_l2": 0.18569473922252655, + "max_abs_delta": 0.4921875 + } + } + }, + "layer_05": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6e381b2e0f57beb755ca09bde7c2acf6aa5014ad55b47e74ef2c45fd47e04d5f", + "mean": -0.0012904830509796739, + "std": 0.22307559847831726, + "rms": 0.2230793535709381, + "max_abs": 5.0625 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6caa148df8ce2b1a4a6a52be2b63678953d726df196d034cf5140a6f5d1af1f6", + "mean": -0.030875710770487785, + "std": 11.173591613769531, + "rms": 11.173635482788086, + "max_abs": 1152.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "52be7254c9332b1e4476e787d30f9ce4ca3abc3fa983daf9aad1c351a9c27bea", + "mean": -0.001246691681444645, + "std": 0.22322766482830048, + "rms": 0.22323113679885864, + "max_abs": 5.15625 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5b7cbaa042e2d9c42081921bc03fc88ed9c96bf5ff044555621b794344931400", + "mean": -0.026724737137556076, + "std": 9.969710350036621, + "rms": 9.969745635986328, + "max_abs": 1152.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9a7f02c0a831bc8e033af37a869cec5003b5c0c7f516ce9382724da8cb1c3785", + "mean": -0.001476881792768836, + "std": 0.22422896325588226, + "rms": 0.22423382103443146, + "max_abs": 5.1875 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "502155c6de671f71950d0f8382e41aca2cc799b719ebf44f8525111d79867a61", + "mean": -0.007698590401560068, + "std": 9.887016296386719, + "rms": 9.887020111083984, + "max_abs": 1152.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "12a8faebb594621d653a9463aebf9b0b4aa298a774f1f34c8350195f4d9f0cea", + "mean": -0.0014144667657092214, + "std": 0.2248784899711609, + "rms": 0.22488293051719666, + "max_abs": 5.3125 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c4474e8bce21998b49e85f3b7d29b9ba4aa60f5232dd840774747e6088b749fe", + "mean": -0.006470271851867437, + "std": 8.55126667022705, + "rms": 8.551268577575684, + "max_abs": 1152.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a8f72f41aaff47ab55e3eebb8f98767e125620729039227e17db23cee544d181", + "mean": -0.0014264314668253064, + "std": 0.22242286801338196, + "rms": 0.22242745757102966, + "max_abs": 5.3125 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0377635f46369329ae33dbdef09b821802435f44045346e164be472d5132de8c", + "mean": -0.007526729255914688, + "std": 9.886959075927734, + "rms": 9.886963844299316, + "max_abs": 1152.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0089d3c8bcf7e22b3d3655e827066df5bc87cdc3d01d15174eeab6b855619d07", + "mean": -0.0014862290117889643, + "std": 0.2216222733259201, + "rms": 0.22162725031375885, + "max_abs": 5.4375 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "29deb3a10cb8400baeaba3ea7da412ac02e4fe830ea23272d601987c9231d90c", + "mean": -0.0064111677929759026, + "std": 8.551198959350586, + "rms": 8.551201820373535, + "max_abs": 1152.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e5234b7b08ce1fb6a3dd1699dfa58caa4a7283eefa223776926092faa331ba8b", + "mean": -0.0014490911271423101, + "std": 0.2225116640329361, + "rms": 0.22251637279987335, + "max_abs": 5.25 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d795dc6155b380ae3e807b6f4c69c33aad98f30c00d6471910129bed2a5fa39c", + "mean": -0.007523247506469488, + "std": 9.886938095092773, + "rms": 9.886941909790039, + "max_abs": 1152.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2f8acd9ef06451804b9788d7deb998b631a54a3dd7e2a8ceb5ca1f3e5f5329ef", + "mean": -0.0015790818724781275, + "std": 0.22128960490226746, + "rms": 0.22129525244235992, + "max_abs": 5.40625 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6d14a2f7a405c4a3dad052e86f0392a0ca44fe01624cdad5b8202b8057085d7c", + "mean": -0.006463195197284222, + "std": 8.551177024841309, + "rms": 8.551179885864258, + "max_abs": 1152.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9974326491355896, + "min_cosine_similarity": 0.9903242588043213, + "mean_relative_l2": 0.06787631660699844, + "max_abs_delta": 0.22265625 + }, + "system_bos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9942084550857544, + "min_cosine_similarity": 0.9866775274276733, + "mean_relative_l2": 0.10723341256380081, + "max_abs_delta": 0.2890625 + }, + "system_x": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.99062180519104, + "min_cosine_similarity": 0.9700310826301575, + "mean_relative_l2": 0.1346479058265686, + "max_abs_delta": 0.384765625 + }, + "system_period": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9903750419616699, + "min_cosine_similarity": 0.9696764349937439, + "mean_relative_l2": 0.13578882813453674, + "max_abs_delta": 0.3681640625 + }, + "bos_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9900662899017334, + "min_cosine_similarity": 0.982130765914917, + "mean_relative_l2": 0.1407606154680252, + "max_abs_delta": 0.3125 + }, + "bos_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9880374670028687, + "min_cosine_similarity": 0.9826335906982422, + "mean_relative_l2": 0.15500672161579132, + "max_abs_delta": 0.40625 + }, + "x_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9868910312652588, + "min_cosine_similarity": 0.9676306843757629, + "mean_relative_l2": 0.16033391654491425, + "max_abs_delta": 0.3125 + }, + "x_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9812386631965637, + "min_cosine_similarity": 0.9608349800109863, + "mean_relative_l2": 0.19158706068992615, + "max_abs_delta": 0.515625 + }, + "period_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9879661202430725, + "min_cosine_similarity": 0.972690224647522, + "mean_relative_l2": 0.1536446213722229, + "max_abs_delta": 0.328125 + }, + "period_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9814113974571228, + "min_cosine_similarity": 0.9620420932769775, + "mean_relative_l2": 0.19023694097995758, + "max_abs_delta": 0.4921875 + } + } + }, + "layer_06": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d3c0a003ad961684a8653de7648bccb2274a1b813a97db57bfcc8f3da30f95d3", + "mean": -0.0032305740751326084, + "std": 0.2605465352535248, + "rms": 0.2605665624141693, + "max_abs": 6.28125 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "986a9d8e6e2d2e2f5bfbce3a80fd575d89a852403655b7dcfd1fa18d30a66dcb", + "mean": -0.03340640291571617, + "std": 11.377252578735352, + "rms": 11.377301216125488, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b73eda3d6ed1f1f9754dc423791d180c6997f6b1622342ad5c2bb5cc74f12da5", + "mean": -0.003294228110462427, + "std": 0.26021093130111694, + "rms": 0.26023176312446594, + "max_abs": 6.25 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1e53cfc1e463428d2ba6d7ed8ec15a1c04ca463582d8a2a33fceb266bfab5f39", + "mean": -0.029031025245785713, + "std": 10.149249076843262, + "rms": 10.149290084838867, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8b39788988a9e7a9ee79bc45a29245ce9898253444a89b2eb809c7e420a9f81f", + "mean": -0.003282850841060281, + "std": 0.26175951957702637, + "rms": 0.2617800831794739, + "max_abs": 6.3125 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "767bb51bc388bfdec554ac592e31d8b2af614ef27cc7ec7615a099f54db6e1d0", + "mean": -0.009480985812842846, + "std": 10.045774459838867, + "rms": 10.04577922821045, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6a355dbf01049ff6af141b05de09450c54d523d7b4a047111cdd7b5a8aa9ab6d", + "mean": -0.0032890138681977987, + "std": 0.26342448592185974, + "rms": 0.26344501972198486, + "max_abs": 6.3125 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f56f0c8194496d184021eb522875c15c1a141867489b252b7367563cd04bcbf7", + "mean": -0.008115483447909355, + "std": 8.686964988708496, + "rms": 8.686967849731445, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "18caee03296e50a50fd91871980251630268abe2e5a25059dcfd16a465b9ebef", + "mean": -0.0030812486074864864, + "std": 0.2622106373310089, + "rms": 0.26222872734069824, + "max_abs": 6.375 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1d31a99a7dcc9ae2d8ed23a9308ed69ef7e8ff5ba9b4755b5ff0f0418625da0c", + "mean": -0.009084970690310001, + "std": 10.045735359191895, + "rms": 10.04573917388916, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "900163ec99b94c5bf8f657f94b09de8cfa6fe8a02f9db9202a7b7fba6bd7525a", + "mean": -0.0031369535718113184, + "std": 0.26072975993156433, + "rms": 0.26074862480163574, + "max_abs": 6.40625 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5986dfc4335139214362d00870f8400222aaaceb33257680c5a3c63165f66249", + "mean": -0.007823089137673378, + "std": 8.686882019042969, + "rms": 8.686884880065918, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b3c04b6f919d021ccacc332e19e41d446d6c48f744180a402e73f3f4da88b391", + "mean": -0.0030590330716222525, + "std": 0.26041457056999207, + "rms": 0.26043254137039185, + "max_abs": 6.25 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0ba2488e9ad1db527a95372d9ec08596309bba649c3b05c0aadb00cb0d9fb32c", + "mean": -0.009062292985618114, + "std": 10.045702934265137, + "rms": 10.045706748962402, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3f19e7dc8a83c1979fad12794cc0fafbe98db5b157dcadd8ada51920034e6101", + "mean": -0.003239707089960575, + "std": 0.2597924768924713, + "rms": 0.25981268286705017, + "max_abs": 6.28125 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b82985d5b8b5f4e272e0e52b9e50054fe337d3dcfd801c4ab26ad08d4ac054c6", + "mean": -0.00789311807602644, + "std": 8.686858177185059, + "rms": 8.686861991882324, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9973180294036865, + "min_cosine_similarity": 0.9923868179321289, + "mean_relative_l2": 0.07054858654737473, + "max_abs_delta": 0.375 + }, + "system_bos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9949936270713806, + "min_cosine_similarity": 0.9913793802261353, + "mean_relative_l2": 0.10005926340818405, + "max_abs_delta": 0.328125 + }, + "system_x": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9910083413124084, + "min_cosine_similarity": 0.9791812896728516, + "mean_relative_l2": 0.13276080787181854, + "max_abs_delta": 0.5 + }, + "system_period": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9905382394790649, + "min_cosine_similarity": 0.9766983985900879, + "mean_relative_l2": 0.13624067604541779, + "max_abs_delta": 0.46875 + }, + "bos_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9913527369499207, + "min_cosine_similarity": 0.9868934154510498, + "mean_relative_l2": 0.13150951266288757, + "max_abs_delta": 0.34375 + }, + "bos_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9897266626358032, + "min_cosine_similarity": 0.9825254678726196, + "mean_relative_l2": 0.1445637345314026, + "max_abs_delta": 0.5 + }, + "x_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9877077341079712, + "min_cosine_similarity": 0.9753389358520508, + "mean_relative_l2": 0.15646342933177948, + "max_abs_delta": 0.5 + }, + "x_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9824019074440002, + "min_cosine_similarity": 0.9679689407348633, + "mean_relative_l2": 0.18681611120700836, + "max_abs_delta": 0.59375 + }, + "period_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9885432124137878, + "min_cosine_similarity": 0.9778453707695007, + "mean_relative_l2": 0.15006856620311737, + "max_abs_delta": 0.40625 + }, + "period_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9822036027908325, + "min_cosine_similarity": 0.9686487913131714, + "mean_relative_l2": 0.18716800212860107, + "max_abs_delta": 0.546875 + } + } + }, + "layer_07": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "dc7098e059b4942734ece8ca892583d4935ab100f608ef63739c0efbaa93f1a5", + "mean": -0.0033634344581514597, + "std": 0.2850069999694824, + "rms": 0.2850268483161926, + "max_abs": 6.3125 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "59439d205801d922a4087830497e7d94b529f2c7e4bcab6ae017245d4561c964", + "mean": -0.03323521837592125, + "std": 11.409729957580566, + "rms": 11.40977954864502, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "49e1fc59bcebbef2fc05c6bf73679de64835be34e9bb74b4f41cc7ca2672accb", + "mean": -0.0032432014122605324, + "std": 0.28610464930534363, + "rms": 0.28612303733825684, + "max_abs": 6.5625 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "899f33ca9e0f90b36d1e3f3c1a191e1eb4e602de1f626e39a0027bc681a456f3", + "mean": -0.029628224670886993, + "std": 10.17935848236084, + "rms": 10.179401397705078, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0a4357bd7579a6198e012dc0803682faf87b1c417482bb9a2af561462ae79e30", + "mean": -0.0031798547133803368, + "std": 0.2845705449581146, + "rms": 0.2845883071422577, + "max_abs": 6.34375 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "24b35f6270a751b3fd01cb720f603abc173b067ed234c69060b4c3db368c50d0", + "mean": -0.009185015223920345, + "std": 10.064224243164062, + "rms": 10.064229011535645, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "43e61fa54644eae0e979946b225980094b17500fa58bc4955c77b674094623bc", + "mean": -0.0031814640387892723, + "std": 0.2870151996612549, + "rms": 0.287032812833786, + "max_abs": 6.5625 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7335b07126b0db3db2536c08a9eebb39584a8aed848435a16d096de6f14c1746", + "mean": -0.008632533252239227, + "std": 8.703119277954102, + "rms": 8.703124046325684, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ee6d7531ec89f27ecec78cd48d7dffc80e62d08fd09a0e20b0bb3cc6df2d2e4b", + "mean": -0.0027678217738866806, + "std": 0.28287115693092346, + "rms": 0.28288471698760986, + "max_abs": 6.40625 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cbe5541c2dfbc717b2cd3ab28f42d86cc9419512f12666187d45c1eeea811487", + "mean": -0.008984151296317577, + "std": 10.064139366149902, + "rms": 10.064143180847168, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "afe11b34be5c521bc22f288426322e2fd0e9e20f90b3b6415407ec56b0447025", + "mean": -0.002740144031122327, + "std": 0.2844012677669525, + "rms": 0.28441449999809265, + "max_abs": 6.5625 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2e23ca510209be898dd6880ed3ef51a7616ad3ee3fef17261d9b5caa394144c9", + "mean": -0.008412809111177921, + "std": 8.703023910522461, + "rms": 8.703027725219727, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c3644a75d0a33279780b7aa5659e8fac737fbbdab852bd76595a24540744e566", + "mean": -0.0029320337343961, + "std": 0.2820100784301758, + "rms": 0.2820253372192383, + "max_abs": 6.3125 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "38201ae61bd35ef675e0b7080538f4fa7b8637126bee6e058f6d2977c30c381d", + "mean": -0.008829494006931782, + "std": 10.064126968383789, + "rms": 10.064130783081055, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "030df5568bcd4cbe7d56cea9617a16d3af0162954ca3cfad63cdeda08ebeec7d", + "mean": -0.00287035689689219, + "std": 0.28420373797416687, + "rms": 0.2842182219028473, + "max_abs": 6.5 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c1eb10823adba4a167a72ff85ff62718f146c2f3c840d972e688e9132e8804d6", + "mean": -0.00838154461234808, + "std": 8.703022003173828, + "rms": 8.703025817871094, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9967098832130432, + "min_cosine_similarity": 0.9901145100593567, + "mean_relative_l2": 0.07668391615152359, + "max_abs_delta": 0.34375 + }, + "system_bos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9946895837783813, + "min_cosine_similarity": 0.9889655709266663, + "mean_relative_l2": 0.10254443436861038, + "max_abs_delta": 0.328125 + }, + "system_x": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9908286929130554, + "min_cosine_similarity": 0.9809948205947876, + "mean_relative_l2": 0.1350991576910019, + "max_abs_delta": 0.46875 + }, + "system_period": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9902713894844055, + "min_cosine_similarity": 0.9788917899131775, + "mean_relative_l2": 0.13932308554649353, + "max_abs_delta": 0.4453125 + }, + "bos_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9905866384506226, + "min_cosine_similarity": 0.9830712676048279, + "mean_relative_l2": 0.13576121628284454, + "max_abs_delta": 0.34375 + }, + "bos_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9900815486907959, + "min_cosine_similarity": 0.9812045097351074, + "mean_relative_l2": 0.14050407707691193, + "max_abs_delta": 0.375 + }, + "x_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9866588711738586, + "min_cosine_similarity": 0.9778090715408325, + "mean_relative_l2": 0.16165904700756073, + "max_abs_delta": 0.375 + }, + "x_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9821775555610657, + "min_cosine_similarity": 0.9704375863075256, + "mean_relative_l2": 0.18722878396511078, + "max_abs_delta": 0.609375 + }, + "period_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9872767329216003, + "min_cosine_similarity": 0.977946937084198, + "mean_relative_l2": 0.15711475908756256, + "max_abs_delta": 0.5 + }, + "period_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9819099307060242, + "min_cosine_similarity": 0.9705208539962769, + "mean_relative_l2": 0.18839183449745178, + "max_abs_delta": 0.6171875 + } + } + }, + "layer_08": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2fc17ff7ea89f9ce50114306c9cffff7be7929d571f3ab3dd6c8edf7fcf849e4", + "mean": -0.002636307617649436, + "std": 0.3270837068557739, + "rms": 0.32709431648254395, + "max_abs": 7.5625 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "68d7c906e43103f6dcf21d5ed60a5876172b8747065b288f42b271b22e5ff54c", + "mean": -0.033190496265888214, + "std": 11.448265075683594, + "rms": 11.448312759399414, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "104f3f9d7cd5de957230f2da88891796d60da2f5948cd1d08eff0c520e414d75", + "mean": -0.0024595949798822403, + "std": 0.3282715678215027, + "rms": 0.3282807767391205, + "max_abs": 7.8125 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f2300fa13e366cf8697e1327b775a53f5d7d835c5f5e877bcd9200be9d5ab7a9", + "mean": -0.02919078804552555, + "std": 10.214314460754395, + "rms": 10.214356422424316, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "dd58d1d719fe70521b23b0f84c648911d4603be7568785bf526b51aaf5fa929f", + "mean": -0.002520173555240035, + "std": 0.3267499506473541, + "rms": 0.3267596662044525, + "max_abs": 7.5625 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e2bc75035ab58eeca25ea861d474376bce2d561b6446df4a8255457fa09951e4", + "mean": -0.009313706308603287, + "std": 10.085658073425293, + "rms": 10.085661888122559, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9918817169a8ef44f288c7c90be879252acd6e0a1192924cfcf604a843b074f0", + "mean": -0.002295679645612836, + "std": 0.3286920487880707, + "rms": 0.32870006561279297, + "max_abs": 7.71875 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c7c2372806379bb4317ef82e706d72939620a21d7eeaaf891dfc45d3b7b28795", + "mean": -0.008360311388969421, + "std": 8.72179126739502, + "rms": 8.721795082092285, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2e7816128f5dd16cf246f3c5edc9910196a4edbaa892c3615844c0b67192de45", + "mean": -0.001873431378044188, + "std": 0.3239874243736267, + "rms": 0.32399284839630127, + "max_abs": 7.6875 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4e015b060383c375b6e57cb2675248274da36d923299a22c0d5f7f51a8590b4d", + "mean": -0.008946123532950878, + "std": 10.085585594177246, + "rms": 10.085589408874512, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "30facd5f298bd116ecb3394078b867f5fe2c6cb417274c92916422c05b4710f8", + "mean": -0.0013866255758330226, + "std": 0.32372376322746277, + "rms": 0.32372674345970154, + "max_abs": 7.96875 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "67d4b2a95a63746d1f1461fbf1eb2396169d81af25f9f3ca9da1cdf1bc13da57", + "mean": -0.007938745431602001, + "std": 8.721685409545898, + "rms": 8.721689224243164, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b0594de4c4d629bf1ca3f4c9bd2b302eca64723180cf35d4be8012065d4be01a", + "mean": -0.002238118788227439, + "std": 0.3225373923778534, + "rms": 0.3225451409816742, + "max_abs": 7.53125 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e94d42cef49c40d6827e39d6b56756be407987bf6e920242527d58069dfe43de", + "mean": -0.009127098135650158, + "std": 10.085564613342285, + "rms": 10.08556842803955, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e441c2cbdca844026d97b00ecccabc2cc9a982f09d1540951df66415c5293be8", + "mean": -0.0016274394001811743, + "std": 0.32325178384780884, + "rms": 0.32325589656829834, + "max_abs": 7.875 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "24e928e7d8de12211cea9887365af7bd841ac1a22f404656f2bf5a1f2e8270a3", + "mean": -0.008025663904845715, + "std": 8.721672058105469, + "rms": 8.721674919128418, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9967278838157654, + "min_cosine_similarity": 0.9896607398986816, + "mean_relative_l2": 0.0777311772108078, + "max_abs_delta": 0.34375 + }, + "system_bos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9944532513618469, + "min_cosine_similarity": 0.9895474910736084, + "mean_relative_l2": 0.1048416867852211, + "max_abs_delta": 0.375 + }, + "system_x": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9896517992019653, + "min_cosine_similarity": 0.9812695980072021, + "mean_relative_l2": 0.14313645660877228, + "max_abs_delta": 0.5625 + }, + "system_period": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9885512590408325, + "min_cosine_similarity": 0.9790409803390503, + "mean_relative_l2": 0.15031777322292328, + "max_abs_delta": 0.53125 + }, + "bos_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9904329776763916, + "min_cosine_similarity": 0.9815874099731445, + "mean_relative_l2": 0.13674214482307434, + "max_abs_delta": 0.4375 + }, + "bos_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.990475594997406, + "min_cosine_similarity": 0.9841386079788208, + "mean_relative_l2": 0.13756586611270905, + "max_abs_delta": 0.40625 + }, + "x_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.985198974609375, + "min_cosine_similarity": 0.9748479723930359, + "mean_relative_l2": 0.17067444324493408, + "max_abs_delta": 0.5625 + }, + "x_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.980987548828125, + "min_cosine_similarity": 0.963208794593811, + "mean_relative_l2": 0.19197650253772736, + "max_abs_delta": 0.6875 + }, + "period_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9857406616210938, + "min_cosine_similarity": 0.9743456840515137, + "mean_relative_l2": 0.16621427237987518, + "max_abs_delta": 0.59375 + }, + "period_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9809848070144653, + "min_cosine_similarity": 0.9675701856613159, + "mean_relative_l2": 0.19261974096298218, + "max_abs_delta": 0.6875 + } + } + }, + "layer_09": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5dd01773ac569b228c121e7596f1124d99e0c17cc45a1d6650c0e23ce3bddb15", + "mean": -0.00474544195458293, + "std": 0.3804362416267395, + "rms": 0.3804658353328705, + "max_abs": 11.0 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fc31e36dc0d3ed8d8af5daa52d4b56a4b3480003b9ef3db74ba4fce55a31be5a", + "mean": -0.033453840762376785, + "std": 11.450496673583984, + "rms": 11.450546264648438, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "99bea8f7541bc95645108f50694772babee604da3672ecf7be3f432e9b85b387", + "mean": -0.00464436924085021, + "std": 0.3811839818954468, + "rms": 0.3812122642993927, + "max_abs": 11.0625 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e74492f3009f01275ba442b9566aecaea24c06c0a7a1402f1a062c568dc0a5af", + "mean": -0.030459187924861908, + "std": 10.216428756713867, + "rms": 10.216474533081055, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "57fcc82b0129aac092649727883a901921b0ba010b4a0bd83f665caef25307c5", + "mean": -0.004686910193413496, + "std": 0.37914323806762695, + "rms": 0.3791722059249878, + "max_abs": 10.875 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ad901e31a2ff6ad49e2ab91fc78a436bf2c84c9e90e82032933dd8d4f0ec2a5c", + "mean": -0.009858551435172558, + "std": 10.087993621826172, + "rms": 10.087998390197754, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "09cc7ce9035dbf4ebb3d5a37b2741023eadccacc635691c10a6e5d2e16312818", + "mean": -0.00452360138297081, + "std": 0.38247331976890564, + "rms": 0.3825000524520874, + "max_abs": 10.8125 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "17668eec3099a220f219a283929c03ec8622a2a2d28b7ee9e85867c380db1c09", + "mean": -0.00991231668740511, + "std": 8.724237442016602, + "rms": 8.7242431640625, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d2f7c52e6383bdf59ae5c0719e5e9d4d562975c47f9a77d4dccd49ba46c72ddd", + "mean": -0.004067076835781336, + "std": 0.3743182122707367, + "rms": 0.37434032559394836, + "max_abs": 10.875 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c62e4d9a53d16fc7115198cf9861e2f997c70442f0c3fc62708123547bef790c", + "mean": -0.009325872175395489, + "std": 10.087869644165039, + "rms": 10.087873458862305, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a73a1adc14657fb1b5e5e985da0f1187f5768ca3d8de18cbbd6389e34460357b", + "mean": -0.003776163561269641, + "std": 0.3733448386192322, + "rms": 0.3733639121055603, + "max_abs": 10.875 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c829ac8d0f10518608afec58cd01fb629ee6c3ed0b2f420a4c4432dcea4b9fc7", + "mean": -0.009530847892165184, + "std": 8.724029541015625, + "rms": 8.724034309387207, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c871ba3c87a6aefe487f23a515b52f973c661853238ea2bf374de64d0729e264", + "mean": -0.004437016323208809, + "std": 0.37337568402290344, + "rms": 0.37340202927589417, + "max_abs": 10.8125 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4317b9741240d51d341870128c452e8f595fba60709ce647bae4aa4af50c38e9", + "mean": -0.00933940801769495, + "std": 10.08781909942627, + "rms": 10.087823867797852, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "32e732da5559cb72e6c83d55a7058d01c19c0ac86a72b137eb4337f7528d2257", + "mean": -0.004169033374637365, + "std": 0.3740883469581604, + "rms": 0.3741115629673004, + "max_abs": 10.9375 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1a6fcf3d2e6d65d4a37fd537e7513efa38421b20151884a7d1d5842155379152", + "mean": -0.009515621699392796, + "std": 8.72399616241455, + "rms": 8.724000930786133, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9971423745155334, + "min_cosine_similarity": 0.992641270160675, + "mean_relative_l2": 0.07371427863836288, + "max_abs_delta": 0.3125 + }, + "system_bos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9953581094741821, + "min_cosine_similarity": 0.9913352727890015, + "mean_relative_l2": 0.09692040830850601, + "max_abs_delta": 0.5625 + }, + "system_x": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9908276200294495, + "min_cosine_similarity": 0.9832656383514404, + "mean_relative_l2": 0.13467811048030853, + "max_abs_delta": 0.6875 + }, + "system_period": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.990166962146759, + "min_cosine_similarity": 0.9834131002426147, + "mean_relative_l2": 0.13985516130924225, + "max_abs_delta": 0.625 + }, + "bos_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9922782778739929, + "min_cosine_similarity": 0.985840916633606, + "mean_relative_l2": 0.12320319563150406, + "max_abs_delta": 0.5 + }, + "bos_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9922252297401428, + "min_cosine_similarity": 0.9866524934768677, + "mean_relative_l2": 0.12436497956514359, + "max_abs_delta": 0.5625 + }, + "x_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9879847168922424, + "min_cosine_similarity": 0.980000376701355, + "mean_relative_l2": 0.1536191999912262, + "max_abs_delta": 0.625 + }, + "x_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9831341505050659, + "min_cosine_similarity": 0.9666178226470947, + "mean_relative_l2": 0.18028004467487335, + "max_abs_delta": 1.09375 + }, + "period_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9884010553359985, + "min_cosine_similarity": 0.9797129034996033, + "mean_relative_l2": 0.15051394701004028, + "max_abs_delta": 0.90625 + }, + "period_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9838752746582031, + "min_cosine_similarity": 0.9753262996673584, + "mean_relative_l2": 0.17746767401695251, + "max_abs_delta": 1.0 + } + } + }, + "layer_10": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1507ad3014771bc5145e8f4d7b98af9fb14d3aa87a0e1d47f4b41e02d8538a3a", + "mean": -0.0036098561249673367, + "std": 0.4325639009475708, + "rms": 0.4325789213180542, + "max_abs": 12.1875 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "42f41f45fe3c764dbcbe3deb00d87ad4484b24530274fcc127b0e32fd3d172c0", + "mean": -0.03373352065682411, + "std": 11.461380004882812, + "rms": 11.461429595947266, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cae1ae138c1859e16c75434be8e48c66fdf057d4178cd5892bcb038b026d3cbc", + "mean": -0.0035879744682461023, + "std": 0.43460479378700256, + "rms": 0.43461957573890686, + "max_abs": 12.3125 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d490e4d0acaaa61423520787cf055c0c8ac1a30a58771944b6ec1e6950835afb", + "mean": -0.030963756144046783, + "std": 10.22624397277832, + "rms": 10.226290702819824, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9353ec6eca8f145300f11a0e2a081369646c845f7cefa2b08bcead76a007886c", + "mean": -0.0037600097712129354, + "std": 0.4317587614059448, + "rms": 0.43177512288093567, + "max_abs": 12.25 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bc553890e73e5b35e6dc81a9a0cf583796bfb858fd761ba28ec258bffc00bf6d", + "mean": -0.010403861291706562, + "std": 10.09980583190918, + "rms": 10.099810600280762, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7e0d10c80402153b2732329acc0d8308d05391458036bc310f4d32f66cccc1b9", + "mean": -0.003325723810121417, + "std": 0.43569061160087585, + "rms": 0.435703307390213, + "max_abs": 12.0625 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1406bc814adfedea1c8261ce1d2fc4157056b6b21c6b749621789af75106aa25", + "mean": -0.010398613288998604, + "std": 8.734984397888184, + "rms": 8.734990119934082, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "190b7590f02c00afcb7755406025c658ad12919bf5bf5cea1033f349df7b1f99", + "mean": -0.0032168321777135134, + "std": 0.42807987332344055, + "rms": 0.42809194326400757, + "max_abs": 12.125 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "299a282cd620871f00d19a94bf245e3ea03f97a21bf513b257964c9db362ac39", + "mean": -0.00999637320637703, + "std": 10.099686622619629, + "rms": 10.099692344665527, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "90514099591150e675def4452081d4487734f1619fe85676520d4a2ce4e8a218", + "mean": -0.0026849936693906784, + "std": 0.42693087458610535, + "rms": 0.42693933844566345, + "max_abs": 12.25 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4ae6376b5963e322b4c0c76260afacc5cda6115b60e7ac152a12be5f64db91eb", + "mean": -0.010278252884745598, + "std": 8.734723091125488, + "rms": 8.73472785949707, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "927230b51d90cb3fa340be2f80eb4c65f85b3ee84b6bcf3888c36ae86a45f844", + "mean": -0.003602691926062107, + "std": 0.4275414049625397, + "rms": 0.4275566041469574, + "max_abs": 12.0 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ecdce4612d612f6192104475b2cb0c56b20fe5f236a3dd3e9d7fbb320f25ef2f", + "mean": -0.00982272531837225, + "std": 10.09964656829834, + "rms": 10.099651336669922, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "df370c6e438812eac8843ab17dcc74efac338dc3565d095994d2cc8aa8f9ce09", + "mean": -0.0029399232007563114, + "std": 0.4282051920890808, + "rms": 0.42821526527404785, + "max_abs": 12.1875 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b84fab87b46d618b13d18186c109bbb8096d88fda8a7f7e3cf6871e71249f2c5", + "mean": -0.01015813834965229, + "std": 8.734711647033691, + "rms": 8.73471736907959, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9968057870864868, + "min_cosine_similarity": 0.9912369847297668, + "mean_relative_l2": 0.07754812389612198, + "max_abs_delta": 0.375 + }, + "system_bos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9947355389595032, + "min_cosine_similarity": 0.990345299243927, + "mean_relative_l2": 0.10254047065973282, + "max_abs_delta": 0.5 + }, + "system_x": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9905190467834473, + "min_cosine_similarity": 0.9818210005760193, + "mean_relative_l2": 0.13643330335617065, + "max_abs_delta": 0.75 + }, + "system_period": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.989454448223114, + "min_cosine_similarity": 0.9787460565567017, + "mean_relative_l2": 0.14338426291942596, + "max_abs_delta": 0.671875 + }, + "bos_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9920276999473572, + "min_cosine_similarity": 0.9858022928237915, + "mean_relative_l2": 0.12494926899671555, + "max_abs_delta": 0.5 + }, + "bos_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9920240640640259, + "min_cosine_similarity": 0.9856342077255249, + "mean_relative_l2": 0.12591104209423065, + "max_abs_delta": 0.4375 + }, + "x_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9875596761703491, + "min_cosine_similarity": 0.9802709817886353, + "mean_relative_l2": 0.155986949801445, + "max_abs_delta": 0.8125 + }, + "x_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.982363224029541, + "min_cosine_similarity": 0.96400386095047, + "mean_relative_l2": 0.18390236794948578, + "max_abs_delta": 1.375 + }, + "period_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9878436923027039, + "min_cosine_similarity": 0.9805610775947571, + "mean_relative_l2": 0.15372076630592346, + "max_abs_delta": 0.9375 + }, + "period_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9823076725006104, + "min_cosine_similarity": 0.9691655039787292, + "mean_relative_l2": 0.18473310768604279, + "max_abs_delta": 1.125 + } + } + }, + "layer_11": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "019e81ff8291e5a7a2a8bbbb1692fb8baa74e1f3e88f395e99de251b8d38b779", + "mean": -0.004086168482899666, + "std": 0.5369618535041809, + "rms": 0.5369774103164673, + "max_abs": 17.625 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d2e119ef48c8e6bf57995b37b424668f76bc32ec046718609fdb59eb12bdaac9", + "mean": -0.03338427469134331, + "std": 11.524271965026855, + "rms": 11.524319648742676, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3fc0d8df379880fd90de0f0e244f731a4fc6b8ceb50cc9be94e35e2aadda1d81", + "mean": -0.0034774683881551027, + "std": 0.5378182530403137, + "rms": 0.5378295183181763, + "max_abs": 17.875 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1ebb03c9f96abc8e25445237194a4c9f6f4da76534711f9b5f2af4e5970237fc", + "mean": -0.03057974763214588, + "std": 10.281282424926758, + "rms": 10.281327247619629, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fde0bb7494a66888430e70af90ac1c3d1265e488ec01893cd197f94b070b95d0", + "mean": -0.004150043241679668, + "std": 0.5372318029403687, + "rms": 0.5372478365898132, + "max_abs": 17.375 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ff1432d3b805713349cdfc0a1cf2bf2569b04d70f4f7414bb38150717965d793", + "mean": -0.009893766604363918, + "std": 10.151453018188477, + "rms": 10.151457786560059, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "80701b89783eb3e35aac1b3db9424fb5a27ad658aa41c771f150e61a66c6cfdb", + "mean": -0.0037044144701212645, + "std": 0.5412229299545288, + "rms": 0.5412355661392212, + "max_abs": 17.625 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "56745b02ba903d3c856680e83e98fb74a1c361a152b04aedde9be35f592d7de1", + "mean": -0.010039038024842739, + "std": 8.780296325683594, + "rms": 8.780302047729492, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e136bf6871eb6be81d2de448f5890cd657de8e223e84a9efc0fa63226caf56c7", + "mean": -0.003570238593965769, + "std": 0.5321331024169922, + "rms": 0.532145082950592, + "max_abs": 17.5 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c9ee74231397265eb09ea7f98a804d7eec6b4e0ceadf934080a27a3ccdc45abd", + "mean": -0.009237706661224365, + "std": 10.151385307312012, + "rms": 10.151389122009277, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d17ae97b251f23fcace1a973b54e41c94386b7ad5b8bab47db9852b3de7d3eb8", + "mean": -0.0025581957306712866, + "std": 0.5301214456558228, + "rms": 0.5301276445388794, + "max_abs": 17.75 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "aa5817f0457211fce7a838c25d188a4dcc1f69d56d0a7e0f6a4d460c0172eede", + "mean": -0.00948265753686428, + "std": 8.779930114746094, + "rms": 8.779935836791992, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "add75f51bf2d9e5d8663ee5053370967976caada70cef4f3d8fe6bc0dd72a57e", + "mean": -0.00374686811119318, + "std": 0.530434787273407, + "rms": 0.5304480791091919, + "max_abs": 17.625 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b7b4ff1ec5535afad99677655060e65a6fcfe11358503307f2c4cd77154baa61", + "mean": -0.00910284835845232, + "std": 10.151272773742676, + "rms": 10.151277542114258, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b055116d933fcc9486a9fc9476521c26185a61f77f1f6b5dfb70b095b0ec076a", + "mean": -0.0025725080631673336, + "std": 0.5311137437820435, + "rms": 0.5311199426651001, + "max_abs": 17.875 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "13915bae87449592df27a75f3fd5d1a327cbfea129927aee0453753ec23487ab", + "mean": -0.0093653853982687, + "std": 8.779918670654297, + "rms": 8.779924392700195, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9973659515380859, + "min_cosine_similarity": 0.9937348961830139, + "mean_relative_l2": 0.07031351327896118, + "max_abs_delta": 0.4375 + }, + "system_bos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9956477880477905, + "min_cosine_similarity": 0.9921031594276428, + "mean_relative_l2": 0.09315875172615051, + "max_abs_delta": 0.625 + }, + "system_x": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9923648238182068, + "min_cosine_similarity": 0.9835233688354492, + "mean_relative_l2": 0.12255466729402542, + "max_abs_delta": 1.125 + }, + "system_period": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9913750290870667, + "min_cosine_similarity": 0.9797580242156982, + "mean_relative_l2": 0.1299571543931961, + "max_abs_delta": 0.96875 + }, + "bos_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9939089417457581, + "min_cosine_similarity": 0.9889470338821411, + "mean_relative_l2": 0.10960361361503601, + "max_abs_delta": 0.625 + }, + "bos_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9939041137695312, + "min_cosine_similarity": 0.9891819953918457, + "mean_relative_l2": 0.11087004095315933, + "max_abs_delta": 0.65625 + }, + "x_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9906352758407593, + "min_cosine_similarity": 0.9859942197799683, + "mean_relative_l2": 0.1361410915851593, + "max_abs_delta": 0.8125 + }, + "x_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9864636063575745, + "min_cosine_similarity": 0.9724700450897217, + "mean_relative_l2": 0.16208912432193756, + "max_abs_delta": 1.625 + }, + "period_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9909129738807678, + "min_cosine_similarity": 0.9863036274909973, + "mean_relative_l2": 0.13390162587165833, + "max_abs_delta": 0.875 + }, + "period_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9865188002586365, + "min_cosine_similarity": 0.9758135676383972, + "mean_relative_l2": 0.16233058273792267, + "max_abs_delta": 1.375 + } + } + }, + "layer_12": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6932b6231a1445f6cfd226be4de8fa8cef24a9080921f627433133b479b24f60", + "mean": -0.003513037459924817, + "std": 0.5871198773384094, + "rms": 0.5871303677558899, + "max_abs": 15.875 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c3f8ef227b5b638240a0d95f144157d266ba40d94dd3d1f5d81f6832d4c979ff", + "mean": -0.03404617682099342, + "std": 11.604842185974121, + "rms": 11.604891777038574, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8e0c84dba936c58990250d1e427f956dfbfc01ad13b57a1bf0cddddd881362ef", + "mean": -0.0032877791672945023, + "std": 0.5900298357009888, + "rms": 0.5900390148162842, + "max_abs": 16.125 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "130859e4e82de939dde19eb6db8762718b57cd9023fc004b256eb4c6c65f4a89", + "mean": -0.030782809481024742, + "std": 10.356571197509766, + "rms": 10.35661792755127, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a205b4acd6d8c717cc7cc1c60802e5e09ce0a5ad2a304726835095c6308d8e6e", + "mean": -0.004034474492073059, + "std": 0.5888636112213135, + "rms": 0.5888774394989014, + "max_abs": 15.75 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d6ee19a391598bfa52e9c76e88e07f2d1c02fc5dea03bd34b3872d2873a09e1f", + "mean": -0.01048921700567007, + "std": 10.169707298278809, + "rms": 10.16971206665039, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8223cdcaebb5306d9a4ffea727d8dde2397d31086f855460b6c6314ba42dbb2e", + "mean": -0.0035754109267145395, + "std": 0.5934025049209595, + "rms": 0.593413233757019, + "max_abs": 16.0 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a42237ab54670fa072c12d94930dc1811b459dd5d6eff8979a776d1b91f4b455", + "mean": -0.01030642632395029, + "std": 8.797130584716797, + "rms": 8.797137260437012, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "934cd1b058d7b73abebd05796b69bc17c81987526a764cc84ab86468d3891492", + "mean": -0.0034174639731645584, + "std": 0.5857639312744141, + "rms": 0.5857739448547363, + "max_abs": 15.875 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9db81bcacd50a5291057cfb6901c8abf5481cad9b9cb3be5ea794728eb3ee49a", + "mean": -0.01053602620959282, + "std": 10.169663429260254, + "rms": 10.169669151306152, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "dbd63f0034890a82bb43788767b52cc6a9dd7547f630967ec2772a9ba8c002c3", + "mean": -0.0025634332560002804, + "std": 0.5847028493881226, + "rms": 0.5847084522247314, + "max_abs": 16.25 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "998d4a6ea3ce640d3809838c9a518d25a6293aa29900877414457e0591196166", + "mean": -0.01000532228499651, + "std": 8.796639442443848, + "rms": 8.796645164489746, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "17fde47e77b22780c7696d51a6742624f4e0f5336931c790fa87a3e4b829cc20", + "mean": -0.003475386183708906, + "std": 0.5859867334365845, + "rms": 0.5859969854354858, + "max_abs": 15.875 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "807288fc30bb9d9921c5f891bc6c872f3349619fbbc1aa74de98fb6dd543d173", + "mean": -0.009877157397568226, + "std": 10.169589042663574, + "rms": 10.169593811035156, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6ab6d88d05d358fa867dc5cc9c7402137bcd99066a9d63fc6e23a7fc949d1ff3", + "mean": -0.002710159169510007, + "std": 0.5859327912330627, + "rms": 0.5859390497207642, + "max_abs": 16.25 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "91aeb7f499c2038257765457c652c6465f0df5a5585fb3b979a9df4112a28827", + "mean": -0.009792663156986237, + "std": 8.7966890335083, + "rms": 8.7966947555542, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9972525238990784, + "min_cosine_similarity": 0.9942570924758911, + "mean_relative_l2": 0.07206140458583832, + "max_abs_delta": 0.5 + }, + "system_bos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9952945709228516, + "min_cosine_similarity": 0.9920470118522644, + "mean_relative_l2": 0.09688983857631683, + "max_abs_delta": 0.8125 + }, + "system_x": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9921919107437134, + "min_cosine_similarity": 0.9830844402313232, + "mean_relative_l2": 0.12300381809473038, + "max_abs_delta": 1.0 + }, + "system_period": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9912452697753906, + "min_cosine_similarity": 0.9796172976493835, + "mean_relative_l2": 0.13052786886692047, + "max_abs_delta": 0.953125 + }, + "bos_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9934641122817993, + "min_cosine_similarity": 0.9884212017059326, + "mean_relative_l2": 0.1135232001543045, + "max_abs_delta": 0.5625 + }, + "bos_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9937529563903809, + "min_cosine_similarity": 0.9888092875480652, + "mean_relative_l2": 0.11203630268573761, + "max_abs_delta": 0.84375 + }, + "x_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9904443621635437, + "min_cosine_similarity": 0.9857101440429688, + "mean_relative_l2": 0.13810238242149353, + "max_abs_delta": 0.9375 + }, + "x_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9860197901725769, + "min_cosine_similarity": 0.9689592719078064, + "mean_relative_l2": 0.1643524169921875, + "max_abs_delta": 1.375 + }, + "period_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.990900456905365, + "min_cosine_similarity": 0.9860442876815796, + "mean_relative_l2": 0.13463124632835388, + "max_abs_delta": 0.9375 + }, + "period_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9859897494316101, + "min_cosine_similarity": 0.973120391368866, + "mean_relative_l2": 0.16548097133636475, + "max_abs_delta": 1.25 + } + } + }, + "layer_13": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3732a47ba9f6664c7c879d7896f638717c4f391c635721f0c6a0e246e1ceec46", + "mean": -0.002072803908959031, + "std": 0.6450483202934265, + "rms": 0.6450516581535339, + "max_abs": 18.5 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "972f5a4ce89a960386e12266bb5048e35d1d3bbeb61b3bd99b4da6c1f0492c22", + "mean": -0.033093634992837906, + "std": 11.614691734313965, + "rms": 11.614738464355469, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e38662834582eb69bfe21c9f97129d284a146782a39bb303570d3872dfbdfe1a", + "mean": -0.0020043421536684036, + "std": 0.6473622918128967, + "rms": 0.647365391254425, + "max_abs": 18.625 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "27271ec8db8c6556482e60ab555a71fa92329cf24cb054797a1cd70980718849", + "mean": -0.031172895804047585, + "std": 10.366060256958008, + "rms": 10.366106986999512, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "be1fb34317d629fe8f59ff564fb68becc1823be5c26d97eb2245354de791ecbf", + "mean": -0.002914092503488064, + "std": 0.6475038528442383, + "rms": 0.6475104689598083, + "max_abs": 18.5 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b6432df4b46ed360eabc88b2f4ca17f1d0ff5a20927e1de208533109c4985877", + "mean": -0.009552715346217155, + "std": 10.178577423095703, + "rms": 10.178581237792969, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "851661b9446b58495d025c6df49457d1b6f140ecadfa9ccbaa57230d8937d9fd", + "mean": -0.002505010226741433, + "std": 0.6520639061927795, + "rms": 0.6520687341690063, + "max_abs": 19.125 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0b0ce9cc10313b83bec5b863c2c30f34a5debe6d6750f02dc07fbac8f171eb0c", + "mean": -0.010594721883535385, + "std": 8.805893898010254, + "rms": 8.805900573730469, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "052aedc918ac7d24bfd1d41ebfd1e37333f4e26673a907bdceeb5691f57f905e", + "mean": -0.003102414309978485, + "std": 0.6459372639656067, + "rms": 0.6459447741508484, + "max_abs": 17.5 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e82cfb434e6e7651f02bb7a9e7da3db309b044f9957f9cdddf6f6a3d8f051f80", + "mean": -0.010051238350570202, + "std": 10.17866039276123, + "rms": 10.178665161132812, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e0ade287cb5b36071856e31b9bd8d1f5cad0e8e0df0f0d744f38c30fac22eae2", + "mean": -0.002344936365261674, + "std": 0.642641007900238, + "rms": 0.6426452398300171, + "max_abs": 17.0 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "794c46af9951d7b4a136ced956f7e00de420a41bd0dff896ce0f5b26c937c89f", + "mean": -0.010739943012595177, + "std": 8.805438041687012, + "rms": 8.805444717407227, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "068252c8611e0849d74fa2f22cad8edd3bfe79f7feb037aae9dbaf4ade63f52e", + "mean": -0.003129950724542141, + "std": 0.6460850238800049, + "rms": 0.6460925936698914, + "max_abs": 17.875 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "35152014e706c65948c5487f263340813fb46765e836b924aa07acb2c1f52b20", + "mean": -0.009385482408106327, + "std": 10.178536415100098, + "rms": 10.17854118347168, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a6a2722881166c741083618162989f263e3160cbc2d2f9d129352b4deaf2f569", + "mean": -0.0022220443934202194, + "std": 0.6427692770957947, + "rms": 0.6427730917930603, + "max_abs": 17.125 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "651a3d97ed546fc350708737e3bc6af07258f09fb1141ea0d77168a19dc4c1c6", + "mean": -0.01045244000852108, + "std": 8.805447578430176, + "rms": 8.80545425415039, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9972643852233887, + "min_cosine_similarity": 0.9946876168251038, + "mean_relative_l2": 0.07227516919374466, + "max_abs_delta": 0.53125 + }, + "system_bos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9954673051834106, + "min_cosine_similarity": 0.9924737215042114, + "mean_relative_l2": 0.09503840655088425, + "max_abs_delta": 0.875 + }, + "system_x": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9923337697982788, + "min_cosine_similarity": 0.9834017753601074, + "mean_relative_l2": 0.12192937731742859, + "max_abs_delta": 1.09375 + }, + "system_period": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9912639856338501, + "min_cosine_similarity": 0.9798787832260132, + "mean_relative_l2": 0.12973904609680176, + "max_abs_delta": 1.125 + }, + "bos_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9935033917427063, + "min_cosine_similarity": 0.9864981174468994, + "mean_relative_l2": 0.11299002915620804, + "max_abs_delta": 0.6875 + }, + "bos_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9940361380577087, + "min_cosine_similarity": 0.9892942905426025, + "mean_relative_l2": 0.10952241718769073, + "max_abs_delta": 1.0625 + }, + "x_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9908163547515869, + "min_cosine_similarity": 0.9837884902954102, + "mean_relative_l2": 0.13598158955574036, + "max_abs_delta": 1.0625 + }, + "x_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9862149953842163, + "min_cosine_similarity": 0.960465669631958, + "mean_relative_l2": 0.16271436214447021, + "max_abs_delta": 1.625 + }, + "period_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9914094805717468, + "min_cosine_similarity": 0.9854028224945068, + "mean_relative_l2": 0.13166795670986176, + "max_abs_delta": 0.9375 + }, + "period_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9862664341926575, + "min_cosine_similarity": 0.9649931788444519, + "mean_relative_l2": 0.16288918256759644, + "max_abs_delta": 1.625 + } + } + }, + "layer_14": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6bc69d96a7f65ebf4193cfd93e640beebf9c40695f2e78c3fce0094ae445bc1b", + "mean": 0.000956082483753562, + "std": 0.7305133938789368, + "rms": 0.7305140495300293, + "max_abs": 21.5 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bc5095e01079148ecca1ea2161cac5b3816ede206f5453ec210af7ac7369beb8", + "mean": -0.030181067064404488, + "std": 11.6382417678833, + "rms": 11.638279914855957, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4e4de29ca76226a1948ed06a1ddd505867ac079304663224fbd331e1e8fb6fae", + "mean": 0.0009194249869324267, + "std": 0.7332203388214111, + "rms": 0.7332208752632141, + "max_abs": 21.625 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ddd05c9deed093e54380cc6947dcc83fcbeb36184ce8667d979a6010eb2b03ee", + "mean": -0.029418954625725746, + "std": 10.386560440063477, + "rms": 10.386602401733398, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8dc6e53e3dc740c780e7ae8d1fbf91168aba4f9a3a8de65a0ad594f820b3c85a", + "mean": 0.00015791019541211426, + "std": 0.7336735129356384, + "rms": 0.7336735129356384, + "max_abs": 21.5 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "10189a04a8bc209200c7d906147ba7e63bd5f8ce397a45cb868d4cd7b59671ab", + "mean": -0.006565389689058065, + "std": 10.20409107208252, + "rms": 10.204093933105469, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8619986908cf83a461ab9b66940bcd73c1a258580e5d4c96ef7773d900c8fe36", + "mean": 0.0002617233549244702, + "std": 0.7398046851158142, + "rms": 0.7398046851158142, + "max_abs": 22.25 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5e1f7f846fd6c9622459e5ebf7d7179274e7351435d01d14e7f196369b795f06", + "mean": -0.008709710091352463, + "std": 8.82879638671875, + "rms": 8.828800201416016, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1049c482edb9506bb23af9aa4f9e4ab349e08371c79af408cfbbda315c54c99e", + "mean": 0.00010890902194660157, + "std": 0.7304804921150208, + "rms": 0.7304804921150208, + "max_abs": 20.375 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b8c700f38094d529ddce221c1a39eade80ff22d52941a22f37137943ff140d05", + "mean": -0.0069350250996649265, + "std": 10.204144477844238, + "rms": 10.204146385192871, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e5e0a3b0ec7098a6cdfe6e58d8ee741a387cd7f86e60c04b37f48239f5171f1f", + "mean": 0.0006418571574613452, + "std": 0.7276594042778015, + "rms": 0.7276597023010254, + "max_abs": 20.25 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "782b1d10464153356f2e7efb7fd44ca262d4f99e1409ac29773ab65defc5dd92", + "mean": -0.008786452934145927, + "std": 8.828286170959473, + "rms": 8.828290939331055, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1bd308855c944513340db562a8e8501c9e574303fd51f020cd20bb923be7b9a9", + "mean": -0.0002638062578625977, + "std": 0.7303206324577332, + "rms": 0.7303206920623779, + "max_abs": 20.75 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e89c142590ed05584e1282c5ea386a388b46c3430001dab0db4830980d181abe", + "mean": -0.006453390698879957, + "std": 10.204000473022461, + "rms": 10.204002380371094, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "231b442a151c779e8ba181c969450b8d84ceb05caa936a699b1a2a9902f061cf", + "mean": 0.0008029348100535572, + "std": 0.7281448841094971, + "rms": 0.7281453013420105, + "max_abs": 20.25 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d1b5c30fe04f8be30b7748f9d21b1a26db9c0fc58269b0548cf62c8fb6aba0db", + "mean": -0.00872020423412323, + "std": 8.82825756072998, + "rms": 8.828262329101562, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9970119595527649, + "min_cosine_similarity": 0.9944784641265869, + "mean_relative_l2": 0.07561543583869934, + "max_abs_delta": 0.625 + }, + "system_bos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9954212307929993, + "min_cosine_similarity": 0.992842435836792, + "mean_relative_l2": 0.09547024965286255, + "max_abs_delta": 1.25 + }, + "system_x": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9920452237129211, + "min_cosine_similarity": 0.9830856919288635, + "mean_relative_l2": 0.12412317842245102, + "max_abs_delta": 1.15625 + }, + "system_period": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9904903173446655, + "min_cosine_similarity": 0.9747830629348755, + "mean_relative_l2": 0.13465213775634766, + "max_abs_delta": 1.125 + }, + "bos_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9931917786598206, + "min_cosine_similarity": 0.9856026768684387, + "mean_relative_l2": 0.11515766382217407, + "max_abs_delta": 0.8125 + }, + "bos_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.993858277797699, + "min_cosine_similarity": 0.9883358478546143, + "mean_relative_l2": 0.1107807382941246, + "max_abs_delta": 1.09375 + }, + "x_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9906811714172363, + "min_cosine_similarity": 0.9840036034584045, + "mean_relative_l2": 0.1361469030380249, + "max_abs_delta": 1.125 + }, + "x_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9862408638000488, + "min_cosine_similarity": 0.9598315954208374, + "mean_relative_l2": 0.16165776550769806, + "max_abs_delta": 1.875 + }, + "period_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.991594672203064, + "min_cosine_similarity": 0.9849733710289001, + "mean_relative_l2": 0.12962302565574646, + "max_abs_delta": 0.875 + }, + "period_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9857692718505859, + "min_cosine_similarity": 0.9619577527046204, + "mean_relative_l2": 0.1642286330461502, + "max_abs_delta": 1.75 + } + } + }, + "layer_15": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1a38a99810f8232785ca485757ce41dd5c49f0568918161bd8bb3943cba4be57", + "mean": -0.0005294129950925708, + "std": 0.8373008370399475, + "rms": 0.8373009562492371, + "max_abs": 23.5 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a33809d5aad65a4b69be0ade689b6ac4b8969576799b00d70482b033d5fc5b6a", + "mean": -0.029774578288197517, + "std": 11.648444175720215, + "rms": 11.648482322692871, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2eb75c59ee4e6814fbb0393ffb13b67ef5d9694871fad615573df54a27454d12", + "mean": -0.0005449976888485253, + "std": 0.8392142653465271, + "rms": 0.8392144441604614, + "max_abs": 23.625 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4b4ee2a58938b00ec76e98f709fdd8b5959c6f84a9a11108e48b2d38985acbaf", + "mean": -0.029759913682937622, + "std": 10.39700698852539, + "rms": 10.397049903869629, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7fe0775d8a1ad0aca18b1ef94b58aaa20c137b66e703472b69ebb68f53a29304", + "mean": -0.0014058086089789867, + "std": 0.8397130370140076, + "rms": 0.8397141695022583, + "max_abs": 23.625 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a29297bcd4d4517e25432f7d6bcb37b312ba54443b3235716b5028bbf2018493", + "mean": -0.006427752319723368, + "std": 10.214754104614258, + "rms": 10.21475601196289, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "874b40b2df286749c64ef0b034bf8eb3b4eaa03f66e296c961403203c416ed72", + "mean": -0.0010274661472067237, + "std": 0.8478186726570129, + "rms": 0.8478192090988159, + "max_abs": 24.25 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9629caaa96490216ebc252f712bd1fa10d8bdc7ee02c78e69ed0e2dfc9fb99fc", + "mean": -0.00919004064053297, + "std": 8.839972496032715, + "rms": 8.839977264404297, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6c83b6d6a1fe5dbefa03ff19510f01caaa5009e03e66ff99b1781e9a21d00b66", + "mean": -0.0011906176805496216, + "std": 0.8361828923225403, + "rms": 0.8361837267875671, + "max_abs": 22.625 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ae9d4c4f4541e6fa5ba39f09ddd740368ccbee8ba752c17bce390fa3d6c8dd8e", + "mean": -0.006605792790651321, + "std": 10.214720726013184, + "rms": 10.214722633361816, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d0ee84f116fb1eaa12e56be8cf16229397dc029b7c682583b4d15e3ece55a34e", + "mean": -0.0008626515627838671, + "std": 0.8286526799201965, + "rms": 0.8286531567573547, + "max_abs": 22.25 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d02461370997d40895e4f4ac9526a906df40b4425c7db184a194a590e5791994", + "mean": -0.009294014424085617, + "std": 8.839077949523926, + "rms": 8.839082717895508, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "291834c8edd5d2cc49bf2e9056f132460839287986b7b368da94cd4864b10037", + "mean": -0.0019088705303147435, + "std": 0.8361860513687134, + "rms": 0.8361882567405701, + "max_abs": 22.75 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4a6d5bf21204ea63dbc27aed2104efff76afe6093f493f879a5b07f6967b7aea", + "mean": -0.006392244249582291, + "std": 10.214598655700684, + "rms": 10.214600563049316, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "454818741003a6f2b377bac98824aeae413a801c2775d4b98eb74d78ccda2897", + "mean": -0.0012698954669758677, + "std": 0.8312164545059204, + "rms": 0.831217348575592, + "max_abs": 22.75 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7276fd6d36105ba12bcc8dc9e4e5ee1efc19a9d7eb559daa815edd505ce57309", + "mean": -0.009264405816793442, + "std": 8.83918285369873, + "rms": 8.839187622070312, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9971758723258972, + "min_cosine_similarity": 0.9952602386474609, + "mean_relative_l2": 0.07436887174844742, + "max_abs_delta": 0.53125 + }, + "system_bos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9954620599746704, + "min_cosine_similarity": 0.9930528998374939, + "mean_relative_l2": 0.09549228101968765, + "max_abs_delta": 1.375 + }, + "system_x": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9920149445533752, + "min_cosine_similarity": 0.9847460389137268, + "mean_relative_l2": 0.12464737147092819, + "max_abs_delta": 2.25 + }, + "system_period": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9904208779335022, + "min_cosine_similarity": 0.976425290107727, + "mean_relative_l2": 0.13529108464717865, + "max_abs_delta": 1.75 + }, + "bos_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9936163425445557, + "min_cosine_similarity": 0.987388014793396, + "mean_relative_l2": 0.11148214340209961, + "max_abs_delta": 1.0 + }, + "bos_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9941646456718445, + "min_cosine_similarity": 0.9892970323562622, + "mean_relative_l2": 0.10812930762767792, + "max_abs_delta": 1.1875 + }, + "x_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9913339018821716, + "min_cosine_similarity": 0.9856604337692261, + "mean_relative_l2": 0.13133689761161804, + "max_abs_delta": 1.25 + }, + "x_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9869381189346313, + "min_cosine_similarity": 0.9654276371002197, + "mean_relative_l2": 0.15743893384933472, + "max_abs_delta": 2.625 + }, + "period_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9922646880149841, + "min_cosine_similarity": 0.9872301816940308, + "mean_relative_l2": 0.12439149618148804, + "max_abs_delta": 0.9375 + }, + "period_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9861755967140198, + "min_cosine_similarity": 0.9629268646240234, + "mean_relative_l2": 0.1615140587091446, + "max_abs_delta": 2.0 + } + } + }, + "layer_16": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "92576d0500f34bfd6177c3a98693234c976ab3bff7983957f7f4e283833d6963", + "mean": 0.0027508605271577835, + "std": 0.9345710277557373, + "rms": 0.9345750212669373, + "max_abs": 26.125 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "59dd13e4d91e3c720e66f69e01d0bea8e803ee58ba566e4d8a0b4e2b7d3d9ec2", + "mean": -0.02761700190603733, + "std": 11.659506797790527, + "rms": 11.659539222717285, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8017a09bb20573f9b31b77e170313c213c0e7c6f331960ecdd69a6e1624a2ff3", + "mean": 0.003000263823196292, + "std": 0.9373154640197754, + "rms": 0.9373202323913574, + "max_abs": 26.5 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5ee2c548178ac005046260c4247bcbfeddfc339f80ef5f2b0b9f2ab1e5eaac00", + "mean": -0.027507584542036057, + "std": 10.40795612335205, + "rms": 10.407992362976074, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a8e1d3be7db436141f9dec9e9f032fcf3da02adc76c14cb8e1d4dc08bd54b807", + "mean": 0.0017622255254536867, + "std": 0.9334911108016968, + "rms": 0.9334927201271057, + "max_abs": 26.25 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0489d438b127651a76ec5813478fba051e076e2c1368001a3b7bb64d2475c3a4", + "mean": -0.004274705890566111, + "std": 10.225743293762207, + "rms": 10.225743293762207, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "40a04beb3e7d4dd03a19cfbc3ac463a6ef2a0c221b4c145379b02314da520252", + "mean": 0.0025233859196305275, + "std": 0.9413723945617676, + "rms": 0.9413758516311646, + "max_abs": 27.125 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5d5e754c8530080fc122baed6c9e16017377b6143ba71c7000f69b91f5d10bd0", + "mean": -0.006673820316791534, + "std": 8.851576805114746, + "rms": 8.851578712463379, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "da4eee696ca023b2c6b165f2a7353619ee4ca9b217e87b4368be0fb8c8832a3a", + "mean": 0.0017749167745932937, + "std": 0.9295502305030823, + "rms": 0.929551899433136, + "max_abs": 26.75 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "10697424ca81d3ae26806c33ab9b66bef5d6706538a436e9f34302b9c95e6073", + "mean": -0.004628580529242754, + "std": 10.225934028625488, + "rms": 10.225934028625488, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "36992f2424056acf42ccf685bf608d9d963084fd82cc1036ae6ce48fa1144b68", + "mean": 0.0025803588796406984, + "std": 0.9229490160942078, + "rms": 0.9229525923728943, + "max_abs": 26.75 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5aebcbb32121ee343aa1cada2711fbe08e002299a296187d348140b7ed42659a", + "mean": -0.007042464800179005, + "std": 8.850890159606934, + "rms": 8.850892066955566, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "773dd56294f30d9a6f5d3e62143dee803048a20010a273596d8709b9454c4be2", + "mean": 0.0011575176613405347, + "std": 0.9294427037239075, + "rms": 0.9294434189796448, + "max_abs": 26.0 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a1c53446bf7ee2aba7c3a2fc908e11875b937c951226bdbc17ba105ee2320024", + "mean": -0.004275364335626364, + "std": 10.225569725036621, + "rms": 10.225570678710938, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d612146d9aff537c4e566094b07f759aca0f2c71cac8e1c1f334e216e79fbe32", + "mean": 0.0023184255696833134, + "std": 0.9236592650413513, + "rms": 0.9236621856689453, + "max_abs": 27.25 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5188a4ff8ac0e59aecd2209ab2b6073961edadd6565c7ac9ae065e4846a1af9d", + "mean": -0.006762088742107153, + "std": 8.850735664367676, + "rms": 8.850738525390625, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.99708092212677, + "min_cosine_similarity": 0.9952775239944458, + "mean_relative_l2": 0.07552774995565414, + "max_abs_delta": 0.75 + }, + "system_bos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9952930212020874, + "min_cosine_similarity": 0.9928934574127197, + "mean_relative_l2": 0.09699170291423798, + "max_abs_delta": 1.25 + }, + "system_x": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9920368194580078, + "min_cosine_similarity": 0.9852737784385681, + "mean_relative_l2": 0.12430144101381302, + "max_abs_delta": 2.0 + }, + "system_period": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.99027019739151, + "min_cosine_similarity": 0.9760832786560059, + "mean_relative_l2": 0.13614363968372345, + "max_abs_delta": 1.875 + }, + "bos_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.993428111076355, + "min_cosine_similarity": 0.9876065254211426, + "mean_relative_l2": 0.11225209385156631, + "max_abs_delta": 1.25 + }, + "bos_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9940730929374695, + "min_cosine_similarity": 0.988878607749939, + "mean_relative_l2": 0.1079568862915039, + "max_abs_delta": 1.25 + }, + "x_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9910797476768494, + "min_cosine_similarity": 0.9831398129463196, + "mean_relative_l2": 0.1322764903306961, + "max_abs_delta": 1.25 + }, + "x_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9867905974388123, + "min_cosine_similarity": 0.9636334180831909, + "mean_relative_l2": 0.15728527307510376, + "max_abs_delta": 2.125 + }, + "period_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9921016693115234, + "min_cosine_similarity": 0.9876646399497986, + "mean_relative_l2": 0.12549635767936707, + "max_abs_delta": 0.9375 + }, + "period_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.985630214214325, + "min_cosine_similarity": 0.958098292350769, + "mean_relative_l2": 0.16321755945682526, + "max_abs_delta": 2.125 + } + } + }, + "layer_17": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b237a548888c0133bc9f1ba23d598cf7ee8de0a5ebc7b5bb11bac06125de3f86", + "mean": 0.005132889840751886, + "std": 1.0943912267684937, + "rms": 1.0944032669067383, + "max_abs": 30.125 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d6018f39e8ea4e593a0e7d6a8566abc8d2e608cc3bec5241cd7b31790d5ed4ff", + "mean": -0.0270405113697052, + "std": 11.674234390258789, + "rms": 11.67426586151123, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1e05ff6d91595815fb8907c3e58c37265cfea4357d663649ca2bbed10c9ac71d", + "mean": 0.005175424739718437, + "std": 1.097143530845642, + "rms": 1.0971556901931763, + "max_abs": 29.875 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "57ddb32d6dd5784271cc6281c470735f9c6f3fc45b55a0ef1f82c4e5bd4d3b91", + "mean": -0.028456123545765877, + "std": 10.42324447631836, + "rms": 10.423283576965332, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a16b33303b67c08b54c57f60f347b12ef5b6ce908a18236947fd606cfeab6c5d", + "mean": 0.004111424554139376, + "std": 1.0921016931533813, + "rms": 1.0921093225479126, + "max_abs": 29.5 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5cfac4ecb5fd4013cb35f7a7bc32c21e68d4773490016c5480120c114e39b59e", + "mean": -0.003733572317287326, + "std": 10.241523742675781, + "rms": 10.241524696350098, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "67a17eb381570069b52e0d311b6f6f5349e158ed793726bc87169e8b47962b60", + "mean": 0.004504621494561434, + "std": 1.1001471281051636, + "rms": 1.100156307220459, + "max_abs": 30.125 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fbc200a9148ec0767d4fa009e58494bddaed99bdb1ad42c6981121648b2fd54b", + "mean": -0.007942114025354385, + "std": 8.868691444396973, + "rms": 8.868695259094238, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0d511cfb402f6951b565d56344feb710c4d7296aaa27aa95368d418b154bac24", + "mean": 0.004234123043715954, + "std": 1.0880186557769775, + "rms": 1.0880268812179565, + "max_abs": 30.125 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8bb837082bee6f85e8648db3797b51abda6743a15955caba19ad36364a66b6a1", + "mean": -0.004080993589013815, + "std": 10.241851806640625, + "rms": 10.241853713989258, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "abf8e27ced7b580c46e59f2046697da09ef595794599dadf2e051816d1d9de1f", + "mean": 0.005117424298077822, + "std": 1.07932448387146, + "rms": 1.0793365240097046, + "max_abs": 30.25 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f5eef2713ba5c594de3b686083d8e25a5aad8121c191557f2ffd411f9c926df3", + "mean": -0.008171622641384602, + "std": 8.867975234985352, + "rms": 8.867979049682617, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "289a786c10b07bb9be663dcc425a8437d76ad1b26bcdb23f3f959d465af1ce2a", + "mean": 0.003924429416656494, + "std": 1.08594810962677, + "rms": 1.085955262184143, + "max_abs": 29.25 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b258c79f2298f045bc9185fd92377500dcd7dcaafec6fb589965b8eefa79c6d1", + "mean": -0.0036687094252556562, + "std": 10.241267204284668, + "rms": 10.241268157958984, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5d466f3efd017c004d418ef75956007bd7f77ebe5884ec274183295deb250ae5", + "mean": 0.005247086752206087, + "std": 1.0783101320266724, + "rms": 1.0783228874206543, + "max_abs": 31.0 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d2e0efd723fbee58c11cbf502aec2242ad78fccac57d8f5179e1a27327fe60a1", + "mean": -0.0076267654076218605, + "std": 8.86778736114502, + "rms": 8.867790222167969, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9972569942474365, + "min_cosine_similarity": 0.9955495595932007, + "mean_relative_l2": 0.0734148621559143, + "max_abs_delta": 0.875 + }, + "system_bos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9953455924987793, + "min_cosine_similarity": 0.9919561147689819, + "mean_relative_l2": 0.09653117507696152, + "max_abs_delta": 1.25 + }, + "system_x": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9922281503677368, + "min_cosine_similarity": 0.9840126037597656, + "mean_relative_l2": 0.12250199168920517, + "max_abs_delta": 2.0 + }, + "system_period": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9906682372093201, + "min_cosine_similarity": 0.979304313659668, + "mean_relative_l2": 0.13345883786678314, + "max_abs_delta": 1.875 + }, + "bos_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9936469793319702, + "min_cosine_similarity": 0.988055944442749, + "mean_relative_l2": 0.11042062938213348, + "max_abs_delta": 1.375 + }, + "bos_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9941808581352234, + "min_cosine_similarity": 0.9884032011032104, + "mean_relative_l2": 0.10627324879169464, + "max_abs_delta": 1.25 + }, + "x_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9912724494934082, + "min_cosine_similarity": 0.9832178950309753, + "mean_relative_l2": 0.13101817667484283, + "max_abs_delta": 1.3125 + }, + "x_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9873794317245483, + "min_cosine_similarity": 0.9655646085739136, + "mean_relative_l2": 0.15462042391300201, + "max_abs_delta": 2.125 + }, + "period_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9923036694526672, + "min_cosine_similarity": 0.9881914258003235, + "mean_relative_l2": 0.12361697852611542, + "max_abs_delta": 1.125 + }, + "period_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9862895011901855, + "min_cosine_similarity": 0.9586235284805298, + "mean_relative_l2": 0.15975162386894226, + "max_abs_delta": 2.125 + } + } + }, + "layer_18": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9dafb8f983da673607d7f92ba832230ffc1493bdad3aadc57bd034c01d492449", + "mean": 0.013475892134010792, + "std": 1.2175278663635254, + "rms": 1.2176024913787842, + "max_abs": 32.25 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "dcf4cc4face09acbf686ccd3f6602b550e4b09c335582d39d55d4a10c0b43505", + "mean": -0.022687328979372978, + "std": 11.693565368652344, + "rms": 11.693587303161621, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "93622855aaa8342fbf0297babfe79875dab2ffbd628317e5cef52da2b3829575", + "mean": 0.013283001258969307, + "std": 1.219252347946167, + "rms": 1.2193245887756348, + "max_abs": 32.75 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "af81d45f4ad6e14f06cc3cce08465d4b59d31bdaeee3bff502f85ec9c40b84e8", + "mean": -0.024973392486572266, + "std": 10.442923545837402, + "rms": 10.442953109741211, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9cec582a958d4bcebd9ceae0d5df6c7da57d2f875496c261464bfaf4b0610af2", + "mean": 0.012182884849607944, + "std": 1.2139946222305298, + "rms": 1.2140557765960693, + "max_abs": 32.0 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "538bbeec25f7ee3c06bb1794b03a16f719c9f84ae5e88b59a18075ad27c74d8a", + "mean": 0.0007032484863884747, + "std": 10.259431838989258, + "rms": 10.259431838989258, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fc08d9c58cc2a3c54f029bfc83d3fe790e016b6f68ba118996c38eb0b7a7725c", + "mean": 0.012494818307459354, + "std": 1.2224459648132324, + "rms": 1.222509741783142, + "max_abs": 33.0 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "481b542d294351cd8fb5ec58835c01ca1ae6b521c224b466b1deb9d0cd23c427", + "mean": -0.004455916583538055, + "std": 8.888185501098633, + "rms": 8.88818645477295, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "509cbbc647902535a539726afa425417cf69a55a0dfd79f9ebb9567f0337756f", + "mean": 0.012846231460571289, + "std": 1.2093538045883179, + "rms": 1.209421992301941, + "max_abs": 33.0 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0eaf8114f0b9b2f6a70f1be76083fcc339a73c27bb760b729b377be8cd89c688", + "mean": 0.0006352427299134433, + "std": 10.259859085083008, + "rms": 10.259859085083008, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fb9c0fdc53d9ec084c322d399d0da9eced23070a2f11a1fa5e51c16e53c49634", + "mean": 0.013414905406534672, + "std": 1.1981147527694702, + "rms": 1.1981897354125977, + "max_abs": 33.0 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "522df96d14ece1b7abd8fea33703beae4c479f432f6b08d78a36411db28b2cbe", + "mean": -0.004290482960641384, + "std": 8.88739013671875, + "rms": 8.887391090393066, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b24d3ff108837f46d8e1a95a814d964b212c5302edc515607f6b0fa1691a03bb", + "mean": 0.01235863845795393, + "std": 1.208029866218567, + "rms": 1.2080930471420288, + "max_abs": 32.0 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e176f81afc1f65bd7b5dc39e7373e46a723d824b9500bad3b55df1fc219818be", + "mean": 0.0010081293294206262, + "std": 10.25934886932373, + "rms": 10.25934886932373, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "783bc9c6103b678343df7979f06b498a89fb49992b68a1d98fa4a852353f393d", + "mean": 0.012709910050034523, + "std": 1.1967711448669434, + "rms": 1.196838617324829, + "max_abs": 34.0 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a4fc5952d92362377fcc3c22fd256be4d709839d709569f33a170074cb380f09", + "mean": -0.004122252110391855, + "std": 8.887029647827148, + "rms": 8.887030601501465, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9972128868103027, + "min_cosine_similarity": 0.9952888488769531, + "mean_relative_l2": 0.07376120239496231, + "max_abs_delta": 1.375 + }, + "system_bos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9954047799110413, + "min_cosine_similarity": 0.9912011027336121, + "mean_relative_l2": 0.09539132565259933, + "max_abs_delta": 1.5 + }, + "system_x": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9917563796043396, + "min_cosine_similarity": 0.9824529886245728, + "mean_relative_l2": 0.12595908343791962, + "max_abs_delta": 2.75 + }, + "system_period": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9903544783592224, + "min_cosine_similarity": 0.9791994690895081, + "mean_relative_l2": 0.13545967638492584, + "max_abs_delta": 2.125 + }, + "bos_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9937201142311096, + "min_cosine_similarity": 0.9879026412963867, + "mean_relative_l2": 0.10941635072231293, + "max_abs_delta": 1.875 + }, + "bos_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9940211176872253, + "min_cosine_similarity": 0.9869481325149536, + "mean_relative_l2": 0.1072889193892479, + "max_abs_delta": 1.625 + }, + "x_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9913279414176941, + "min_cosine_similarity": 0.9841296672821045, + "mean_relative_l2": 0.12991204857826233, + "max_abs_delta": 1.5 + }, + "x_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9872117042541504, + "min_cosine_similarity": 0.9681030511856079, + "mean_relative_l2": 0.15590806305408478, + "max_abs_delta": 2.75 + }, + "period_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9922733306884766, + "min_cosine_similarity": 0.9872184991836548, + "mean_relative_l2": 0.12339604645967484, + "max_abs_delta": 1.6875 + }, + "period_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9862217903137207, + "min_cosine_similarity": 0.9598293304443359, + "mean_relative_l2": 0.16018347442150116, + "max_abs_delta": 3.0 + } + } + }, + "layer_19": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5ef8936e96d5bb998d15c5259832bb253cb04fe51867a4a842cec67bc1f21bdf", + "mean": 0.02029445953667164, + "std": 1.3187408447265625, + "rms": 1.318897008895874, + "max_abs": 36.5 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3525bab26153a9fd3e042c2b656f07bcf9aec1ff9f431f2aa1250412da251a74", + "mean": -0.018273258581757545, + "std": 11.69951057434082, + "rms": 11.699524879455566, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7efaca73a21a76b4b9c9af3771c099e1d3905e5c0095b81ae02017e81d6f7b96", + "mean": 0.02060413546860218, + "std": 1.3224726915359497, + "rms": 1.322633147239685, + "max_abs": 37.25 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "77d9633a44475dadc032d9bb47733d3f5713f9b5ab16ae32035760369db7a7a9", + "mean": -0.020387616008520126, + "std": 10.451553344726562, + "rms": 10.451573371887207, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e5c205f1df8c92a4e626205c58a3e1117bc77633e7ab7532e780897dc4d27e1b", + "mean": 0.018516089767217636, + "std": 1.3146814107894897, + "rms": 1.3148117065429688, + "max_abs": 36.0 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a99f0d5f14362563c6095f23ff9ff619f180901bd5f9a8ab65356946a42fb5f2", + "mean": 0.00426550442352891, + "std": 10.266521453857422, + "rms": 10.266522407531738, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "701f37d0176ec75d7386fb31b82e152fd153b1da6a7e0d606949b91c3c751beb", + "mean": 0.01918073371052742, + "std": 1.3255325555801392, + "rms": 1.3256713151931763, + "max_abs": 37.5 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e2ae7bdfd3b9b6f20f1446beb8b15a0c7a91e2be3bc05f77cc927b01a78931d6", + "mean": -0.00028714071959257126, + "std": 8.898086547851562, + "rms": 8.898086547851562, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "01060e4b36ec75de860e7d22fa8c33d7b3f153c15aa595fb1192c85c98e91077", + "mean": 0.018552446737885475, + "std": 1.3087238073349, + "rms": 1.3088552951812744, + "max_abs": 37.0 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3e5b30074fb6f44691f14d2d428449aba745dbe6f4f08f636b8e5ace5e63b987", + "mean": 0.00408932426944375, + "std": 10.26717758178711, + "rms": 10.267178535461426, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9cfc6eedf5a5372e5f1c913af4921a8b3355d758c722f87afe658db5649f987a", + "mean": 0.019416775554418564, + "std": 1.2998054027557373, + "rms": 1.299950361251831, + "max_abs": 36.5 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0d25bd5cee42782ffcf2393462058f368ca827a8b001ee72da605a96db214a8a", + "mean": -0.0003089611418545246, + "std": 8.897209167480469, + "rms": 8.897209167480469, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3cdac0ff53c3e055436823db485730152906b022624359f7e1f0986ac9ac79a1", + "mean": 0.018518127501010895, + "std": 1.3078579902648926, + "rms": 1.3079890012741089, + "max_abs": 36.25 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "20ef85301dfc195f7deaa31731c3ca883117d1f94f0164e5f09eaa7048503129", + "mean": 0.004239160567522049, + "std": 10.266562461853027, + "rms": 10.266563415527344, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "443d5041465e820c1204a22a75cbe0c680f3a8b1b5ff2597c481ecacee35438c", + "mean": 0.01921973191201687, + "std": 1.2968330383300781, + "rms": 1.2969754934310913, + "max_abs": 37.5 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "67a3b0903f3ecf1ffcb9b102b8dea59983b129497c3d6167aae18e17ff290730", + "mean": -0.00043992651626467705, + "std": 8.896836280822754, + "rms": 8.896836280822754, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9970554113388062, + "min_cosine_similarity": 0.9948514103889465, + "mean_relative_l2": 0.0757073238492012, + "max_abs_delta": 1.75 + }, + "system_bos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9951705932617188, + "min_cosine_similarity": 0.9912880659103394, + "mean_relative_l2": 0.09792380779981613, + "max_abs_delta": 1.5 + }, + "system_x": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9915242195129395, + "min_cosine_similarity": 0.9823552370071411, + "mean_relative_l2": 0.1273229569196701, + "max_abs_delta": 2.125 + }, + "system_period": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9900749325752258, + "min_cosine_similarity": 0.9781761169433594, + "mean_relative_l2": 0.13720983266830444, + "max_abs_delta": 2.03125 + }, + "bos_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9934161901473999, + "min_cosine_similarity": 0.986140787601471, + "mean_relative_l2": 0.11204121261835098, + "max_abs_delta": 2.25 + }, + "bos_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.993898868560791, + "min_cosine_similarity": 0.9867200255393982, + "mean_relative_l2": 0.10839425772428513, + "max_abs_delta": 1.625 + }, + "x_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9910144209861755, + "min_cosine_similarity": 0.9830390810966492, + "mean_relative_l2": 0.1322641521692276, + "max_abs_delta": 1.875 + }, + "x_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9868345856666565, + "min_cosine_similarity": 0.967246949672699, + "mean_relative_l2": 0.15832333266735077, + "max_abs_delta": 3.25 + }, + "period_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9919155240058899, + "min_cosine_similarity": 0.9865056276321411, + "mean_relative_l2": 0.1261049509048462, + "max_abs_delta": 2.125 + }, + "period_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.985653817653656, + "min_cosine_similarity": 0.9566230773925781, + "mean_relative_l2": 0.16329070925712585, + "max_abs_delta": 3.125 + } + } + }, + "layer_20": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3960520842aecc14681a75a8640db42096e8176e94e359be4dd9ab0330d3dc92", + "mean": 0.03497776389122009, + "std": 1.5344257354736328, + "rms": 1.5348243713378906, + "max_abs": 39.0 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "df6bc5eaffcb0ce1061bc1e5d4132cd48de98833159814b49dfc18399635cd62", + "mean": -0.010984069667756557, + "std": 12.068557739257812, + "rms": 12.068562507629395, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "054b819f8e1672dde0b78a0e7c7d209af97114111bfc4a0b0a985403d0595748", + "mean": 0.03542174771428108, + "std": 1.537656545639038, + "rms": 1.5380644798278809, + "max_abs": 38.75 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2d8f1295bcc1456ebec34da5282487ae908f3cfa50aab65bf76f1fcf2a772d15", + "mean": -0.014774879440665245, + "std": 10.800405502319336, + "rms": 10.8004150390625, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "83804317a29727533dec689e63bc4f06cd7a3b3122692f0ea4bee5d53268a7f6", + "mean": 0.03278278931975365, + "std": 1.5288029909133911, + "rms": 1.5291544198989868, + "max_abs": 38.5 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e8ead7029b54080cc0811cc0a5d10f08e26c422d731ec92b067af4016568a5e0", + "mean": 0.010239300318062305, + "std": 10.290327072143555, + "rms": 10.290331840515137, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "34166a1dcbc24996978d5ca2f708e3ed0ea5d8e5755fac0e75af4ced709e9814", + "mean": 0.0339408703148365, + "std": 1.5374534130096436, + "rms": 1.537827968597412, + "max_abs": 39.0 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d31f5f6aa07e1f48d7682158d4ec819fe9aaeb88b330f282ca25c32ccc2602a0", + "mean": 0.004547512158751488, + "std": 8.92458438873291, + "rms": 8.924585342407227, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f3c98a8592b266f4bb6c74752503c50d130762d475b34103c887dbc370285b35", + "mean": 0.03300671651959419, + "std": 1.519824743270874, + "rms": 1.5201830863952637, + "max_abs": 38.5 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4167ee04614b7f396ed391656aedc9d6c1eeb3aba1d45659a5169855f6bdaaac", + "mean": 0.009632919915020466, + "std": 10.29086971282959, + "rms": 10.290873527526855, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "49500db93c022788d46dd2fecab4a063c65ea1bdf956d1838e7208bb3a460b01", + "mean": 0.03439706191420555, + "std": 1.506331443786621, + "rms": 1.5067241191864014, + "max_abs": 38.0 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "45288ce791037f30d63981ea3be980bdb703d721d32a7819fc24a7693975bb29", + "mean": 0.004367741756141186, + "std": 8.923282623291016, + "rms": 8.923283576965332, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1df2761bf1d9b6a23d6a70384467b2b29ec5dc5c4e574d4692bb9e76af8d0278", + "mean": 0.032418690621852875, + "std": 1.5207157135009766, + "rms": 1.5210613012313843, + "max_abs": 38.25 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6983c9f91371ca09662b08b059c45b3a864577d66dcd4cac95a35d4fe5f6325b", + "mean": 0.009637715294957161, + "std": 10.29034423828125, + "rms": 10.290348052978516, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2e2411288ae2fbcdfdc8319377a6dd2b1a1df0214b41e700e625070725f4775a", + "mean": 0.03386702388525009, + "std": 1.5031120777130127, + "rms": 1.5034935474395752, + "max_abs": 38.25 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d95912267a46be2a26e8941a8c1303edf72ce371d51b696f35eaf8973650c196", + "mean": 0.004249285440891981, + "std": 8.922725677490234, + "rms": 8.92272663116455, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9966676235198975, + "min_cosine_similarity": 0.9924359321594238, + "mean_relative_l2": 0.08051998168230057, + "max_abs_delta": 1.75 + }, + "system_bos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9949090480804443, + "min_cosine_similarity": 0.991478681564331, + "mean_relative_l2": 0.09983386099338531, + "max_abs_delta": 1.875 + }, + "system_x": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9905573129653931, + "min_cosine_similarity": 0.9782745838165283, + "mean_relative_l2": 0.1344129890203476, + "max_abs_delta": 2.25 + }, + "system_period": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9882766008377075, + "min_cosine_similarity": 0.9762969017028809, + "mean_relative_l2": 0.14880923926830292, + "max_abs_delta": 2.25 + }, + "bos_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9931156039237976, + "min_cosine_similarity": 0.9834882616996765, + "mean_relative_l2": 0.11390673369169235, + "max_abs_delta": 2.375 + }, + "bos_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9935715794563293, + "min_cosine_similarity": 0.9863126277923584, + "mean_relative_l2": 0.11068865656852722, + "max_abs_delta": 2.125 + }, + "x_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9906302690505981, + "min_cosine_similarity": 0.9826437830924988, + "mean_relative_l2": 0.13452813029289246, + "max_abs_delta": 2.328125 + }, + "x_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9854744672775269, + "min_cosine_similarity": 0.9637470245361328, + "mean_relative_l2": 0.1655615270137787, + "max_abs_delta": 4.0 + }, + "period_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.991773247718811, + "min_cosine_similarity": 0.9853573441505432, + "mean_relative_l2": 0.12678009271621704, + "max_abs_delta": 2.75 + }, + "period_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.983874499797821, + "min_cosine_similarity": 0.9549247026443481, + "mean_relative_l2": 0.17204296588897705, + "max_abs_delta": 4.0 + } + } + }, + "layer_21": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cf7002afba7c1436a235e4500b57478f20289ea0a6977d28908beb5db36cd21f", + "mean": 0.04022333025932312, + "std": 1.7295044660568237, + "rms": 1.729972004890442, + "max_abs": 50.75 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "208488eb66084af210a93d210361461adbb6d2709938ea79c925ef9142b28935", + "mean": -0.006321776658296585, + "std": 12.197281837463379, + "rms": 12.197282791137695, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "59117cc8eb55e27228f6ec743ede4171dad824aba3848547892443c386ba9bbd", + "mean": 0.04012816771864891, + "std": 1.7328166961669922, + "rms": 1.7332813739776611, + "max_abs": 50.25 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9488f783c490b567f642c399ae502d3f18ec9b027f573efcbc7955c14fc5e3ad", + "mean": -0.010631132870912552, + "std": 10.913912773132324, + "rms": 10.913917541503906, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f163f13c67e925d91ed4b297c511d230ec622e55b269f656317a7e7ba2b1421d", + "mean": 0.03549693897366524, + "std": 1.7191840410232544, + "rms": 1.719550371170044, + "max_abs": 49.75 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5ebfea3d280cd0ecf1cb6c6d8850e7204a68ab400d2b4c2bda8e5fca385aac9c", + "mean": 0.013822130858898163, + "std": 10.28675651550293, + "rms": 10.286765098571777, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ffe328cfec6f6a80eecf803aa36682f324a0ea0d496379fb947c5376adc42b31", + "mean": 0.037849996238946915, + "std": 1.7308952808380127, + "rms": 1.731308937072754, + "max_abs": 50.5 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "718ff31c9f5007e486353b216decc2635aa50a707e43d9db2aed920cb1eecc63", + "mean": 0.008592200465500355, + "std": 8.930658340454102, + "rms": 8.930662155151367, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c322f23250a31feb7d6ac52ee92a53a1e590b4f2a646cec33af2f3d31e89da8a", + "mean": 0.037141263484954834, + "std": 1.714984655380249, + "rms": 1.7153867483139038, + "max_abs": 50.5 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "492890ed4af83992fc97c2262ad92581ae5a415f2db1b55ec93afb0b6ca8ea75", + "mean": 0.014047332108020782, + "std": 10.288339614868164, + "rms": 10.288349151611328, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c0950586704ac765b0d07f9beb84248997f6dde6ea803102bd84b58ec3984a71", + "mean": 0.03876320272684097, + "std": 1.6993359327316284, + "rms": 1.6997779607772827, + "max_abs": 50.0 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "65462ce351245640834a986008c0181ed99251641cfb8eea94c90780fd2be4e2", + "mean": 0.00807725265622139, + "std": 8.930118560791016, + "rms": 8.930122375488281, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "16b9726fbff75a5bcb738062bfd3634de8edb6e70014de8f968a4add5e264fb5", + "mean": 0.03714390844106674, + "std": 1.7142375707626343, + "rms": 1.7146400213241577, + "max_abs": 50.0 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d1043ca54f3ba0d8fd78ce9418dc07a67f8f95875d030a75945b3da36a7582da", + "mean": 0.01424272358417511, + "std": 10.286946296691895, + "rms": 10.286955833435059, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0a5f207cdb16436ca8ae258f7dc1dd1ef9423837fd2f37610f16d9c8e8d9a4d1", + "mean": 0.03805037587881088, + "std": 1.6975834369659424, + "rms": 1.698009729385376, + "max_abs": 49.5 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1cd25c310dba507bcc4a9bd51191c8058041cce809bc7ecf524109bff6b83428", + "mean": 0.008124735206365585, + "std": 8.928869247436523, + "rms": 8.928873062133789, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9960225820541382, + "min_cosine_similarity": 0.9928758144378662, + "mean_relative_l2": 0.08852583169937134, + "max_abs_delta": 1.625 + }, + "system_bos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9944297671318054, + "min_cosine_similarity": 0.989153265953064, + "mean_relative_l2": 0.10463423281908035, + "max_abs_delta": 2.375 + }, + "system_x": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9891670346260071, + "min_cosine_similarity": 0.9720828533172607, + "mean_relative_l2": 0.14325757324695587, + "max_abs_delta": 2.5 + }, + "system_period": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9862198233604431, + "min_cosine_similarity": 0.9739589691162109, + "mean_relative_l2": 0.16138149797916412, + "max_abs_delta": 2.75 + }, + "bos_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9923204183578491, + "min_cosine_similarity": 0.9817982912063599, + "mean_relative_l2": 0.11969520896673203, + "max_abs_delta": 3.25 + }, + "bos_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9929676055908203, + "min_cosine_similarity": 0.9839237928390503, + "mean_relative_l2": 0.11519695073366165, + "max_abs_delta": 3.5 + }, + "x_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9901303052902222, + "min_cosine_similarity": 0.9817081689834595, + "mean_relative_l2": 0.13775254786014557, + "max_abs_delta": 3.125 + }, + "x_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9842424988746643, + "min_cosine_similarity": 0.9625999927520752, + "mean_relative_l2": 0.17242707312107086, + "max_abs_delta": 5.0 + }, + "period_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9913327693939209, + "min_cosine_similarity": 0.9832791686058044, + "mean_relative_l2": 0.12964944541454315, + "max_abs_delta": 3.75 + }, + "period_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9828724265098572, + "min_cosine_similarity": 0.9550250768661499, + "mean_relative_l2": 0.17732033133506775, + "max_abs_delta": 5.25 + } + } + }, + "layer_22": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6448931b24c2f6893e261179a7fffcf06dff17eb94479d53967acc2cc3a5dac9", + "mean": 0.0466059073805809, + "std": 1.996484637260437, + "rms": 1.9970285892486572, + "max_abs": 65.5 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "555599afd2a6b8415acb819610205676786447a804cb4ab5ad19c1f6b2587c9b", + "mean": -0.0036484573502093554, + "std": 12.225255966186523, + "rms": 12.225255966186523, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7a103f9803cd0e1803996c0f54588e0690b86f4f4e3ca92a77c3090b280bf094", + "mean": 0.04648762196302414, + "std": 2.0010688304901123, + "rms": 2.0016086101531982, + "max_abs": 65.0 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e7494220ad26938ee4afe8e46f7d3f2d390e7afe18252cc0955424f2c130b142", + "mean": -0.009272506460547447, + "std": 10.949708938598633, + "rms": 10.949712753295898, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1d4abf14292cdf6f21dbaf8e64483bdbcccdc3bcf847e95bf00ec22e0b91fb94", + "mean": 0.03909711539745331, + "std": 1.9738337993621826, + "rms": 1.974220871925354, + "max_abs": 64.0 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5763bad9e4900a68c7da071aaff85465d71db3d9d4e30d64a8df609f2ef41493", + "mean": 0.015105657279491425, + "std": 10.319217681884766, + "rms": 10.319228172302246, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6a9e601f9a106a39c33553d92995c01f22c1d7a25638d76008cf581680d2a231", + "mean": 0.04287046566605568, + "std": 1.9909162521362305, + "rms": 1.991377830505371, + "max_abs": 65.5 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ef05708e79e79a15d9055676dca28c1684314af2c378ac22f49c1a3f227983c8", + "mean": 0.009328101761639118, + "std": 8.9744291305542, + "rms": 8.974433898925781, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "29d0544bd28372712baa5a6b7b10b7b02d6b84c3e3e78b8815337b74bc1d361f", + "mean": 0.04243148863315582, + "std": 1.9768342971801758, + "rms": 1.9772896766662598, + "max_abs": 65.0 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "09b50c48eb4bd2b8eecac8c31d073ca872e6a50f5b1cd89249ec09e8b39fd02d", + "mean": 0.016256146132946014, + "std": 10.321992874145508, + "rms": 10.322005271911621, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "43702c31ce5505c99eb4d2eeaac93aab18a9e0779de73f66225dce7b1b193764", + "mean": 0.045711226761341095, + "std": 1.963536024093628, + "rms": 1.964068055152893, + "max_abs": 65.5 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ac891753f41e18763dab109de917e301951adf0cb041364beaef4bec38054f6d", + "mean": 0.010058729909360409, + "std": 8.97478199005127, + "rms": 8.974787712097168, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3be4f47a0e9012c4e2bc08a53e795f57f83e63d4f9de342af646efc535fcec95", + "mean": 0.04196497052907944, + "std": 1.9723412990570068, + "rms": 1.9727877378463745, + "max_abs": 64.0 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4a2ba69a2893e6565a2fe8a82709572d1d211af11403cf8eb5fadea8de903642", + "mean": 0.016055328771471977, + "std": 10.319988250732422, + "rms": 10.319999694824219, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c399ef963c11469dd12cac51de5993f2d1fbaf25cada1b7f51369085877ba483", + "mean": 0.04484831914305687, + "std": 1.9636071920394897, + "rms": 1.9641191959381104, + "max_abs": 65.0 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8996b7a97d3619c186566f8375854fd1584144d066cf36400de914054a2d8c3b", + "mean": 0.010214650072157383, + "std": 8.973319053649902, + "rms": 8.973325729370117, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9958347678184509, + "min_cosine_similarity": 0.9911156296730042, + "mean_relative_l2": 0.09021693468093872, + "max_abs_delta": 2.25 + }, + "system_bos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9942465424537659, + "min_cosine_similarity": 0.9891085624694824, + "mean_relative_l2": 0.106330506503582, + "max_abs_delta": 3.5 + }, + "system_x": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9881023168563843, + "min_cosine_similarity": 0.968288779258728, + "mean_relative_l2": 0.14947929978370667, + "max_abs_delta": 4.0 + }, + "system_period": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9843736886978149, + "min_cosine_similarity": 0.9671317934989929, + "mean_relative_l2": 0.17077526450157166, + "max_abs_delta": 5.0 + }, + "bos_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9918155670166016, + "min_cosine_similarity": 0.9797759056091309, + "mean_relative_l2": 0.12289971113204956, + "max_abs_delta": 5.25 + }, + "bos_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9924837946891785, + "min_cosine_similarity": 0.9832395315170288, + "mean_relative_l2": 0.11856209486722946, + "max_abs_delta": 5.75 + }, + "x_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9896703958511353, + "min_cosine_similarity": 0.9815346598625183, + "mean_relative_l2": 0.1401268094778061, + "max_abs_delta": 4.25 + }, + "x_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9834967255592346, + "min_cosine_similarity": 0.9623997211456299, + "mean_relative_l2": 0.17567183077335358, + "max_abs_delta": 6.5 + }, + "period_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9909903407096863, + "min_cosine_similarity": 0.9815959930419922, + "mean_relative_l2": 0.13168717920780182, + "max_abs_delta": 4.75 + }, + "period_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9817665219306946, + "min_cosine_similarity": 0.9540702700614929, + "mean_relative_l2": 0.18206650018692017, + "max_abs_delta": 7.25 + } + } + }, + "layer_23": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a27a99b5cd95bc32c2aa02b2d314a584f95d87a44193a915822ab6cbbefb6adb", + "mean": 0.06326579302549362, + "std": 2.319610357284546, + "rms": 2.3204729557037354, + "max_abs": 83.5 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "80f0d16fd73a5a2128d33d86ad13c32b57bbf9e298ffd6e85f0d572606a75808", + "mean": 0.004355207085609436, + "std": 12.223340034484863, + "rms": 12.22334098815918, + "max_abs": 1160.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5e5d9bf40b05cbc79bfc6cd5ed603a1d022f1d03b1c2c6f470b6501c91612c5a", + "mean": 0.06269017606973648, + "std": 2.3189444541931152, + "rms": 2.319791793823242, + "max_abs": 83.0 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d23aec20d9395782f90a61adeee0403471041eb7adc95b8c3de0e17a968a8c69", + "mean": -0.001510845497250557, + "std": 10.963882446289062, + "rms": 10.963882446289062, + "max_abs": 1160.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a3d9c05f083e208c17e9604951a1e798d895caa382f62e01bd8d71b02f5ce4a5", + "mean": 0.05486554279923439, + "std": 2.285590171813965, + "rms": 2.2862486839294434, + "max_abs": 81.5 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9dd49e49af7edd1cb173f283f7280e3a7734475281402f722788f4b8ef9096c1", + "mean": 0.022638676688075066, + "std": 10.3305082321167, + "rms": 10.330533027648926, + "max_abs": 1160.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "74fc91c254a0e32251446fa0887d94e01a832d46377afb0a9740ce1a9864d2b0", + "mean": 0.05844486132264137, + "std": 2.3084022998809814, + "rms": 2.3091421127319336, + "max_abs": 83.0 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "89c506593045ccbc429d03739d028640747a2139ee6bf09dce6f14e6684c3efa", + "mean": 0.01708604395389557, + "std": 9.009896278381348, + "rms": 9.009912490844727, + "max_abs": 1160.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "96ab7b8afb2d675fa1a9c1a34f8297f6de64220a0fa123eac1bfb4b1c7507057", + "mean": 0.058399226516485214, + "std": 2.295806407928467, + "rms": 2.296549081802368, + "max_abs": 82.0 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "28c61a76765f10f09a4fdbf3457f419d79331893de0a374df86012219b7b1a7f", + "mean": 0.02443394623696804, + "std": 10.336858749389648, + "rms": 10.336888313293457, + "max_abs": 1160.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "12a9d0f11a0ee8932c273e8fe38765490ffbcbd1be47a79a699ac6362af09d45", + "mean": 0.06012005731463432, + "std": 2.2796120643615723, + "rms": 2.280404567718506, + "max_abs": 82.0 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ebfd2412df7b322827523361bc648854558c5a0c678c9a868684511ca85b8ff0", + "mean": 0.017487715929746628, + "std": 9.012358665466309, + "rms": 9.012375831604004, + "max_abs": 1160.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a63450afd773b137240189995eceae10f2866ec9ea4ab040717c36b4941bf66f", + "mean": 0.05762730911374092, + "std": 2.288212537765503, + "rms": 2.288938045501709, + "max_abs": 81.5 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5272bd4462c0c08ad033d2c26af3f3ad2ddf3093b9d3dfe4cc34a9402913dd02", + "mean": 0.023888463154435158, + "std": 10.332433700561523, + "rms": 10.3324613571167, + "max_abs": 1160.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b7206460b7ada8570a4ac237d6529dff6515f8c56b7a8e8e918ab3a925291315", + "mean": 0.05953739956021309, + "std": 2.281301736831665, + "rms": 2.282078504562378, + "max_abs": 81.0 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b15db8247c71d7b928c132f046507fa9ea2814c6428a1b806ffe6a64d8588bc2", + "mean": 0.017617536708712578, + "std": 9.009660720825195, + "rms": 9.00967788696289, + "max_abs": 1160.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9961616396903992, + "min_cosine_similarity": 0.9913564920425415, + "mean_relative_l2": 0.08613313734531403, + "max_abs_delta": 2.0 + }, + "system_bos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9944663047790527, + "min_cosine_similarity": 0.989844024181366, + "mean_relative_l2": 0.10432647913694382, + "max_abs_delta": 4.5 + }, + "system_x": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9893996119499207, + "min_cosine_similarity": 0.9744319319725037, + "mean_relative_l2": 0.14226214587688446, + "max_abs_delta": 4.5 + }, + "system_period": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9857856631278992, + "min_cosine_similarity": 0.9692121744155884, + "mean_relative_l2": 0.16372902691364288, + "max_abs_delta": 6.0 + }, + "bos_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9920908808708191, + "min_cosine_similarity": 0.9799109697341919, + "mean_relative_l2": 0.12064012140035629, + "max_abs_delta": 7.75 + }, + "bos_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9928779602050781, + "min_cosine_similarity": 0.9831530451774597, + "mean_relative_l2": 0.11553094536066055, + "max_abs_delta": 6.5 + }, + "x_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.99015873670578, + "min_cosine_similarity": 0.9802325367927551, + "mean_relative_l2": 0.13594113290309906, + "max_abs_delta": 5.5 + }, + "x_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9848719239234924, + "min_cosine_similarity": 0.9601048231124878, + "mean_relative_l2": 0.1679547280073166, + "max_abs_delta": 6.5 + }, + "period_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9914419054985046, + "min_cosine_similarity": 0.9821977019309998, + "mean_relative_l2": 0.1278647482395172, + "max_abs_delta": 6.75 + }, + "period_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9831512570381165, + "min_cosine_similarity": 0.9516585469245911, + "mean_relative_l2": 0.17439265549182892, + "max_abs_delta": 7.0 + } + } + }, + "layer_24": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "af381fced0a004c79c08a212b4bd2f29c3c0b1cc05f4f4545434a891b77529d9", + "mean": 0.07868446409702301, + "std": 2.813070774078369, + "rms": 2.814171075820923, + "max_abs": 108.5 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "288a09fd8ecdf5f4cbefb53588587a74dc145690a78551053b5722e341d28487", + "mean": 0.008507556281983852, + "std": 11.504470825195312, + "rms": 11.504473686218262, + "max_abs": 1008.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b1062b8a623d8be94abd712dd7a78a90c9f95d9c352d941d3b22030cf887f7f0", + "mean": 0.07820092886686325, + "std": 2.8078815937042236, + "rms": 2.8089704513549805, + "max_abs": 108.0 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8119cda90bbf7a20cb3efed9e91054508c0e756b9ca71d3019d328a675af8a2e", + "mean": 0.0027266573160886765, + "std": 10.679299354553223, + "rms": 10.679299354553223, + "max_abs": 1120.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "36bfcb79b75c45bf170bd7c4913057739951c6ab324f73802ef245aff05ffd04", + "mean": 0.06966539472341537, + "std": 2.7749321460723877, + "rms": 2.775806427001953, + "max_abs": 106.0 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7f3f54f6c168d9f6765af9c6940c122d6ad615d7dc699dc12ae15bd4dfc63e10", + "mean": 0.030255595222115517, + "std": 7.291965007781982, + "rms": 7.292027950286865, + "max_abs": 840.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "82de41010d9680ed4288b91ac0b6af170c33687199dd642ae41f58d073b2e604", + "mean": 0.07351301610469818, + "std": 2.79765248298645, + "rms": 2.7986180782318115, + "max_abs": 107.5 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ccdc791f76681cb9987b37f630efac56640316ee1cd1d083a3ea2ba226de60ef", + "mean": 0.02404690533876419, + "std": 6.477175235748291, + "rms": 6.477219581604004, + "max_abs": 840.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "608e0901a063f4570df69761aaa7b184bb54f618c82664a005bcd74002b0a1af", + "mean": 0.07442112267017365, + "std": 2.785381317138672, + "rms": 2.7863755226135254, + "max_abs": 106.0 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6ec1cca55a73e1a3b59d6fecc8ea3ef953829ee16739fb40f0cc88f2517af937", + "mean": 0.032190561294555664, + "std": 7.304041385650635, + "rms": 7.304112911224365, + "max_abs": 840.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "396fb53cf5bc548fa3fe461ff8277b9f0a990eb0bce4b99917c86ea8fa4b1428", + "mean": 0.07659076899290085, + "std": 2.7553820610046387, + "rms": 2.756446361541748, + "max_abs": 105.0 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4c9b3febb40554874822a81d023d0276b985e8e05a89d27f2b6d421ba6399098", + "mean": 0.024324722588062286, + "std": 6.481118679046631, + "rms": 6.48116397857666, + "max_abs": 840.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "23aaf438aa013453f57d1444c4d5287a6859642ee9054c6432f9dc643847dde3", + "mean": 0.07381882518529892, + "std": 2.7746827602386475, + "rms": 2.7756645679473877, + "max_abs": 106.0 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f72c1dc8517c84bc21e57edcb1b44370641007ec0cef7162265b1b9e37dc864d", + "mean": 0.032283440232276917, + "std": 7.295571804046631, + "rms": 7.295643329620361, + "max_abs": 840.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ea1415a51e83ca429412fff6881be20cb02d651df23b85bdd206032b1267937d", + "mean": 0.07662135362625122, + "std": 2.752227306365967, + "rms": 2.753293752670288, + "max_abs": 104.0 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "90b50f76ea802b332395c3b50c3b9b523faffb1a3a555ea74252ed7a31d41c7a", + "mean": 0.025043055415153503, + "std": 6.475063323974609, + "rms": 6.475111484527588, + "max_abs": 840.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9966691732406616, + "min_cosine_similarity": 0.9909791946411133, + "mean_relative_l2": 0.07992488145828247, + "max_abs_delta": 2.5 + }, + "system_bos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9950052499771118, + "min_cosine_similarity": 0.9880845546722412, + "mean_relative_l2": 0.09812145680189133, + "max_abs_delta": 4.5 + }, + "system_x": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9907481074333191, + "min_cosine_similarity": 0.9811115264892578, + "mean_relative_l2": 0.13323602080345154, + "max_abs_delta": 5.0 + }, + "system_period": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9873334765434265, + "min_cosine_similarity": 0.9738748073577881, + "mean_relative_l2": 0.15406088531017303, + "max_abs_delta": 6.0 + }, + "bos_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9934126734733582, + "min_cosine_similarity": 0.9832726120948792, + "mean_relative_l2": 0.11032581329345703, + "max_abs_delta": 8.0 + }, + "bos_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9937871694564819, + "min_cosine_similarity": 0.9824232459068298, + "mean_relative_l2": 0.10734324157238007, + "max_abs_delta": 6.0 + }, + "x_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9914207458496094, + "min_cosine_similarity": 0.9786072373390198, + "mean_relative_l2": 0.12619169056415558, + "max_abs_delta": 6.0 + }, + "x_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9864417314529419, + "min_cosine_similarity": 0.9573867321014404, + "mean_relative_l2": 0.15859711170196533, + "max_abs_delta": 9.0 + }, + "period_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9926263689994812, + "min_cosine_similarity": 0.9830111861228943, + "mean_relative_l2": 0.11837059259414673, + "max_abs_delta": 7.0 + }, + "period_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9846369624137878, + "min_cosine_similarity": 0.9472237825393677, + "mean_relative_l2": 0.16538691520690918, + "max_abs_delta": 9.5 + } + } + }, + "layer_25": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f71481339617d0d31be8a24341e0e0a1f7fe66b986b3b63e5512b9db148028fb", + "mean": 0.10842899978160858, + "std": 3.5937459468841553, + "rms": 3.595381498336792, + "max_abs": 147.0 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f8711c7dbeee315dc6f751a2575ab6021da9505c311182ce84b4d638180e275b", + "mean": 0.017862441018223763, + "std": 8.839518547058105, + "rms": 8.839536666870117, + "max_abs": 872.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "790fa1313cdcd6058601d0f7adca4132acf90b17af2af11ecd901e9ab8558f8a", + "mean": 0.10807036608457565, + "std": 3.5810954570770264, + "rms": 3.582725763320923, + "max_abs": 147.0 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8ceb034a075de1befa176883c32276ebdb4430869a573d77fcbc08d0ed2d2f8d", + "mean": 0.006177172064781189, + "std": 8.540708541870117, + "rms": 8.54071044921875, + "max_abs": 984.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "193f7cabf8b10585b45b6b033c18383df4db6491671112ec085861a5b2b9a339", + "mean": 0.09510491043329239, + "std": 3.5223567485809326, + "rms": 3.5236403942108154, + "max_abs": 145.0 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f901d5f4a02c401347001a9086fa04376d17e5deccc6fa5a658d05ad14a1e07e", + "mean": 0.03859474137425423, + "std": 3.8910000324249268, + "rms": 3.891191244125366, + "max_abs": 248.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3177ab8e1f3bf982ceab03269d6289bd109049f7f3774546136cadbc629b06ce", + "mean": 0.09937082976102829, + "std": 3.550933361053467, + "rms": 3.552323579788208, + "max_abs": 148.0 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6ff6084a9a62168cacd7b68d13ac6c3e1440c201aec949dc38c7fb63a302c346", + "mean": 0.027694763615727425, + "std": 3.8663413524627686, + "rms": 3.866440534591675, + "max_abs": 248.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "16419ef7547f04db1255bac3606dd44b79e79b809582a93db60ef32f74076b1a", + "mean": 0.10147623717784882, + "std": 3.547741651535034, + "rms": 3.549192428588867, + "max_abs": 145.0 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "df7ab5b0f34b2ce10ee8b43ee0871cd154268afaa053c1f0f60030b12ba9067a", + "mean": 0.04054330661892891, + "std": 3.9429643154144287, + "rms": 3.9431726932525635, + "max_abs": 248.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d63f9fa4806507c72e5951b8a9399f99275ee7d95ea56fc677b9876123c55df5", + "mean": 0.10289688408374786, + "std": 3.518503427505493, + "rms": 3.520007848739624, + "max_abs": 150.0 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0765317524e3887df5a2f27cfdd041605c2e4366e54f66b782001aec7c5e66cd", + "mean": 0.02872658707201481, + "std": 3.891432285308838, + "rms": 3.891538381576538, + "max_abs": 248.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "08a49444a0555cdadb2b122d66dca1a134c9500aadb626bea5d193fb79fccc60", + "mean": 0.10199131071567535, + "std": 3.5304176807403564, + "rms": 3.531890630722046, + "max_abs": 146.0 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cc2fba4616e2a0e3d8de09882da808b1d2288c2d1cee44c309b5ab95918d44ac", + "mean": 0.04212144389748573, + "std": 3.9121925830841064, + "rms": 3.912419080734253, + "max_abs": 248.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b6531c9ef1ec3d0d75edc0793aa5c894487baac0fa768a10f39bc9ddb4b6cfd7", + "mean": 0.101040318608284, + "std": 3.5102181434631348, + "rms": 3.511672019958496, + "max_abs": 152.0 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "40bd3b739b06f36f771a0b6635c92b73971ab0d64e15ffebe03b269d1cd3b158", + "mean": 0.028965115547180176, + "std": 3.8718063831329346, + "rms": 3.8719146251678467, + "max_abs": 248.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9973155856132507, + "min_cosine_similarity": 0.9914612770080566, + "mean_relative_l2": 0.07194426655769348, + "max_abs_delta": 4.0 + }, + "system_bos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9959854483604431, + "min_cosine_similarity": 0.9892661571502686, + "mean_relative_l2": 0.08781331777572632, + "max_abs_delta": 7.0 + }, + "system_x": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9926044344902039, + "min_cosine_similarity": 0.9863939881324768, + "mean_relative_l2": 0.12039817124605179, + "max_abs_delta": 8.0 + }, + "system_period": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9899334907531738, + "min_cosine_similarity": 0.9787654876708984, + "mean_relative_l2": 0.1385127305984497, + "max_abs_delta": 8.0 + }, + "bos_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9945421814918518, + "min_cosine_similarity": 0.9852721691131592, + "mean_relative_l2": 0.10050223022699356, + "max_abs_delta": 12.0 + }, + "bos_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9949783086776733, + "min_cosine_similarity": 0.9848533868789673, + "mean_relative_l2": 0.09610892087221146, + "max_abs_delta": 9.0 + }, + "x_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9929496645927429, + "min_cosine_similarity": 0.9811704158782959, + "mean_relative_l2": 0.11404920369386673, + "max_abs_delta": 10.5 + }, + "x_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9890050292015076, + "min_cosine_similarity": 0.9630868434906006, + "mean_relative_l2": 0.1433756947517395, + "max_abs_delta": 10.0 + }, + "period_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.993983805179596, + "min_cosine_similarity": 0.9847689867019653, + "mean_relative_l2": 0.10720048099756241, + "max_abs_delta": 11.0 + }, + "period_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9874224662780762, + "min_cosine_similarity": 0.9533721208572388, + "mean_relative_l2": 0.1500839740037918, + "max_abs_delta": 11.0 + } + } + }, + "layer_26": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "948e4fc0e5ac95dfa2e6195b170e8a20659be55ce538e9e88d5e25b20b432dfd", + "mean": 0.1488114446401596, + "std": 5.164894104003906, + "rms": 5.167037487030029, + "max_abs": 274.0 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "eab2d01316200ed322259d268b9e70ec9daa668ef866cd17dacd6fa32aba0b5c", + "mean": 0.022248661145567894, + "std": 9.310159683227539, + "rms": 9.310186386108398, + "max_abs": 840.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8397ea4155a66bcfb3caff2414f266ff34e0bff2af9a748b2acf09a83b8800a8", + "mean": 0.14487363398075104, + "std": 5.040539264678955, + "rms": 5.04262113571167, + "max_abs": 272.0 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d8b50635c55fa3ae80f6dacf9f138f09b6fc057662a1e9af9be4806893597f6f", + "mean": 0.015734542161226273, + "std": 8.977317810058594, + "rms": 8.977331161499023, + "max_abs": 868.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f47dbd9a72396d6a43af7ecc20f6feabaf2cf94778527894905d01b3abd46c0c", + "mean": 0.13323874771595, + "std": 4.979413986206055, + "rms": 4.98119592666626, + "max_abs": 278.0 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ca5a26020399e64d3bcdac37ef0d452cc860a179f65ea7c58aa1aaf9a5e89dee", + "mean": 0.04593272879719734, + "std": 5.67481803894043, + "rms": 5.675004005432129, + "max_abs": 776.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d6ffee8d3daec04c90d2963e29a2c2f7860a4a914fcbd49edd2abcc2b66ad5c5", + "mean": 0.13501936197280884, + "std": 4.946074485778809, + "rms": 4.947917461395264, + "max_abs": 272.0 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a568b90b3b1fdfedde2be178e2b7e4efafaa65e4ac81fdb1eed7203a1d62356c", + "mean": 0.03992321342229843, + "std": 5.6348876953125, + "rms": 5.635029315948486, + "max_abs": 776.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5690ca6de9b28dcc0c8061dc6d9ef02750c0542d7c416d90154b794855cf54e0", + "mean": 0.13980717957019806, + "std": 5.089174747467041, + "rms": 5.091094493865967, + "max_abs": 262.0 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f7ccb48ebf8554b6e2cce0c3fe4ed17c00a3a71e4db11490e5a3d0294e1c3096", + "mean": 0.04722347855567932, + "std": 5.773507118225098, + "rms": 5.77370023727417, + "max_abs": 776.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "98175a3c85284ea930460fffef54aa1d5ecd38a42f6a1746a98eeee8badd802a", + "mean": 0.13248029351234436, + "std": 4.799844741821289, + "rms": 4.80167293548584, + "max_abs": 278.0 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6b3cd13e744dc22d0075f85f5d4bf5921b62f0c57aad43dc2eae594bf1f51181", + "mean": 0.03895750641822815, + "std": 5.612283706665039, + "rms": 5.612419128417969, + "max_abs": 776.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e2ce2f9384399b179d6bef5a34958f8653cb6734c7c543685fe00b6112f51e05", + "mean": 0.1405285745859146, + "std": 5.061767578125, + "rms": 5.063717365264893, + "max_abs": 268.0 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c2bac4dbecf928ac0560a894186d6f416cc72e5fdea1a850c8744664ac2a92c0", + "mean": 0.04895820841193199, + "std": 5.721367359161377, + "rms": 5.721576690673828, + "max_abs": 776.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7b1cb0b2fe00dced485bebab189c5c378801b76215f7300b22ef8e7096fec073", + "mean": 0.13017337024211884, + "std": 4.758577823638916, + "rms": 4.760357856750488, + "max_abs": 282.0 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0935f22506638da8f4b6fcdaa4471c76b98108cf3cdae78c6a833f8f97d68903", + "mean": 0.03895305097103119, + "std": 5.554635524749756, + "rms": 5.55477237701416, + "max_abs": 776.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.998113214969635, + "min_cosine_similarity": 0.9928798675537109, + "mean_relative_l2": 0.06594599038362503, + "max_abs_delta": 13.0 + }, + "system_bos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9970670938491821, + "min_cosine_similarity": 0.9918198585510254, + "mean_relative_l2": 0.07481376826763153, + "max_abs_delta": 12.0 + }, + "system_x": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.994189977645874, + "min_cosine_similarity": 0.9860725998878479, + "mean_relative_l2": 0.12623250484466553, + "max_abs_delta": 38.0 + }, + "system_period": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9924314618110657, + "min_cosine_similarity": 0.9843604564666748, + "mean_relative_l2": 0.14055167138576508, + "max_abs_delta": 46.0 + }, + "bos_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9949672818183899, + "min_cosine_similarity": 0.9767559766769409, + "mean_relative_l2": 0.09819457679986954, + "max_abs_delta": 41.5 + }, + "bos_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9959821105003357, + "min_cosine_similarity": 0.9873395562171936, + "mean_relative_l2": 0.08722768723964691, + "max_abs_delta": 22.5 + }, + "x_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9950974583625793, + "min_cosine_similarity": 0.9808326363563538, + "mean_relative_l2": 0.09792603552341461, + "max_abs_delta": 24.0 + }, + "x_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9909417629241943, + "min_cosine_similarity": 0.9635029435157776, + "mean_relative_l2": 0.14290103316307068, + "max_abs_delta": 44.0 + }, + "period_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9956784248352051, + "min_cosine_similarity": 0.9870830774307251, + "mean_relative_l2": 0.09408389031887054, + "max_abs_delta": 25.0 + }, + "period_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9894741773605347, + "min_cosine_similarity": 0.9542130827903748, + "mean_relative_l2": 0.1531226933002472, + "max_abs_delta": 52.0 + } + } + }, + "final_norm": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7bc9f6ff68a219f3067a4d3ea3655232b08be9cb005c06a5cb8f762b1a2d021e", + "mean": 0.014563215896487236, + "std": 0.48364949226379395, + "rms": 0.48386871814727783, + "max_abs": 15.375 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "532f57e134a98b98ddd4517663e27a8cdce0fb88303765807c3033d8f19ff796", + "mean": 0.004977220203727484, + "std": 0.5475049614906311, + "rms": 0.5475276112556458, + "max_abs": 21.625 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4f1085833a2ca38203ce5b12052992a1738c1f93ee14c6299b7b32d3f9908bf1", + "mean": 0.014476033858954906, + "std": 0.48828616738319397, + "rms": 0.488500714302063, + "max_abs": 15.3125 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "41ed0599392265dd83c471b899b222ee57fb3782468148f63390b2af0ee68886", + "mean": 0.00491546792909503, + "std": 0.5333795547485352, + "rms": 0.5334022045135498, + "max_abs": 21.625 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "32af2c46e1969b932fadb20e607b4804f563378254120bed8bd1923623487c40", + "mean": 0.013492629863321781, + "std": 0.495296835899353, + "rms": 0.49548059701919556, + "max_abs": 15.3125 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ad1059337deb53fa83b5e4f0eedec5334fd62bf88c029875d4e0eec8d4645dd0", + "mean": 0.004822771530598402, + "std": 0.5535456538200378, + "rms": 0.5535666942596436, + "max_abs": 21.125 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "eb0cb0ae42fc6d9dd34d0fbea4c9abd3760a0bb9c1c8c6848e1e50e23d5845f6", + "mean": 0.013677476905286312, + "std": 0.49474987387657166, + "rms": 0.4949389100074768, + "max_abs": 15.3125 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bd30750b12c161a677f21c70166d923cc2e6ca12b5661313ca1dcb83b9850f76", + "mean": 0.004922050982713699, + "std": 0.5356888771057129, + "rms": 0.5357115268707275, + "max_abs": 21.125 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1e0ecc6a7bfa36ed750bdb5d739a8dc895136885fc5029f28b3734eb93221dc9", + "mean": 0.013644007034599781, + "std": 0.48611021041870117, + "rms": 0.48630163073539734, + "max_abs": 15.5 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f375772a5ce81002f91325d95e111e1cb2816fc29acc8880e17ea414c6a283c0", + "mean": 0.005022706929594278, + "std": 0.5426032543182373, + "rms": 0.5426265001296997, + "max_abs": 19.125 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "00cd7f0e11aad02f57b2da6c4e177a98b88e5c40cf87d37a11dc91c20e61ad2f", + "mean": 0.013634609058499336, + "std": 0.49502548575401306, + "rms": 0.49521321058273315, + "max_abs": 15.375 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fab3449681cabbca1e3014faf4d4879808d1783a27d315ed47eed842865b7c46", + "mean": 0.005089199636131525, + "std": 0.5279036164283752, + "rms": 0.5279281139373779, + "max_abs": 18.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "09f7c368605ae7b96cc2d655babfc3a52f114ed43b5154e4131b8870f24719c1", + "mean": 0.013892137445509434, + "std": 0.48905545473098755, + "rms": 0.4892527163028717, + "max_abs": 15.375 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2010118383570d6f1585c1a3457ab8765b3cef06615949f04bfaeb2029857eaa", + "mean": 0.00530238589271903, + "std": 0.5491392016410828, + "rms": 0.5491647720336914, + "max_abs": 20.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "972f6d6edf57a9f8b9559055808b0c5060c88ade5755a4b4a8c665b4f3bb30f0", + "mean": 0.013521187007427216, + "std": 0.4981464743614197, + "rms": 0.49832993745803833, + "max_abs": 15.375 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3f7dc81d8c1c080bdfc954b1b5e5f4c4f52653f12bd1ac5b5cf5682aef9b1982", + "mean": 0.005256518255919218, + "std": 0.534885823726654, + "rms": 0.5349116921424866, + "max_abs": 17.75 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9957336783409119, + "min_cosine_similarity": 0.9852227568626404, + "mean_relative_l2": 0.08986309170722961, + "max_abs_delta": 1.1982421875 + }, + "system_bos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9940709471702576, + "min_cosine_similarity": 0.9834251999855042, + "mean_relative_l2": 0.1046670451760292, + "max_abs_delta": 1.1171875 + }, + "system_x": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9879520535469055, + "min_cosine_similarity": 0.9734809994697571, + "mean_relative_l2": 0.153976708650589, + "max_abs_delta": 1.564453125 + }, + "system_period": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.984012246131897, + "min_cosine_similarity": 0.9695640802383423, + "mean_relative_l2": 0.1768570840358734, + "max_abs_delta": 1.6015625 + }, + "bos_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9912934303283691, + "min_cosine_similarity": 0.9722977876663208, + "mean_relative_l2": 0.12670104205608368, + "max_abs_delta": 1.9375 + }, + "bos_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9923290610313416, + "min_cosine_similarity": 0.9774512648582458, + "mean_relative_l2": 0.11917562037706375, + "max_abs_delta": 1.302734375 + }, + "x_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9898666739463806, + "min_cosine_similarity": 0.9686286449432373, + "mean_relative_l2": 0.13654938340187073, + "max_abs_delta": 1.3076171875 + }, + "x_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9818091988563538, + "min_cosine_similarity": 0.9369802474975586, + "mean_relative_l2": 0.18632008135318756, + "max_abs_delta": 1.84765625 + }, + "period_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9910736680030823, + "min_cosine_similarity": 0.9757596254348755, + "mean_relative_l2": 0.1300564557313919, + "max_abs_delta": 1.3779296875 + }, + "period_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9793423414230347, + "min_cosine_similarity": 0.919306218624115, + "mean_relative_l2": 0.19624844193458557, + "max_abs_delta": 2.30078125 + } + } + } + }, + "router_layers": { + "layer_01": { + "layer": 1, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "eea10beaa14a5c99aa22fde8657e6e1e9bcb0d33a22a3454f395040565e4cd82", + "route_weight_sha256": "1fcb860070ef9a61b91ecb3a7e225707dd81c452a7f18d6e81aaf5683965cfaf", + "loads": [ + 3, + 3, + 2, + 1, + 3, + 4, + 4, + 0, + 10, + 2, + 4, + 0, + 2, + 2, + 2, + 2, + 2, + 1, + 2, + 2, + 4, + 1, + 1, + 1, + 2, + 2, + 2, + 1, + 2, + 2, + 3, + 3, + 0, + 5, + 2, + 2, + 2, + 3, + 3, + 0, + 5, + 3, + 1, + 2, + 1, + 1, + 3, + 4, + 1, + 1, + 1, + 2, + 3, + 1, + 1, + 2, + 1, + 1, + 2, + 1, + 2, + 2, + 3, + 2 + ], + "weighted_loads": [ + 0.2979959771037102, + 0.15557493828237057, + 0.13492226600646973, + 0.024200495332479477, + 0.22554074600338936, + 0.23004959896206856, + 0.1483771689236164, + 0.0, + 0.5079406462609768, + 0.10609042271971703, + 0.3135751970112324, + 0.0, + 0.04533928260207176, + 0.20357614010572433, + 0.08417574316263199, + 0.1417282670736313, + 0.11933112516999245, + 0.03309403732419014, + 0.1728161722421646, + 0.15698686987161636, + 0.15559103339910507, + 0.11828285455703735, + 0.05798571556806564, + 0.03195548057556152, + 0.07406619749963284, + 0.11343370005488396, + 0.07759777829051018, + 0.04321213811635971, + 0.11238794401288033, + 0.08290695585310459, + 0.2445613630115986, + 0.23168598115444183, + 0.0, + 0.22102092951536179, + 0.24728954583406448, + 0.1336858794093132, + 0.12759312987327576, + 0.31806687265634537, + 0.1923508606851101, + 0.0, + 0.314100056886673, + 0.22690750658512115, + 0.10069340467453003, + 0.043405456468462944, + 0.03339026868343353, + 0.09422323852777481, + 0.16223379969596863, + 0.3234846293926239, + 0.05869852751493454, + 0.15233400464057922, + 0.03192126005887985, + 0.21912775933742523, + 0.19857297092676163, + 0.10273477435112, + 0.021514926105737686, + 0.12564443796873093, + 0.03014560602605343, + 0.04148473963141441, + 0.15301793068647385, + 0.03676077723503113, + 0.1046636663377285, + 0.1347665749490261, + 0.206058319658041, + 0.2238178327679634 + ], + "unique_experts": 60, + "load_cv": 0.6967081357519951, + "normalized_load_entropy": 0.9471425732051233, + "max_load_share": 0.07246376811594203 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "ca0eeae0d839aa121111d06d52e022afae9ffdae77e625f67b92859b428fd981", + "route_weight_sha256": "aac23926ab2b565484de361328a70f9e15b796167f61d65dfd2a2f80bddaf193", + "loads": [ + 4, + 3, + 4, + 1, + 5, + 4, + 5, + 2, + 31, + 2, + 6, + 0, + 2, + 2, + 2, + 11, + 2, + 2, + 3, + 2, + 8, + 1, + 2, + 1, + 2, + 6, + 17, + 2, + 2, + 2, + 3, + 8, + 2, + 7, + 2, + 2, + 2, + 3, + 3, + 2, + 6, + 13, + 1, + 7, + 2, + 12, + 3, + 4, + 1, + 1, + 4, + 3, + 7, + 1, + 4, + 6, + 5, + 10, + 2, + 12, + 3, + 6, + 3, + 2 + ], + "weighted_loads": [ + 0.3738093674182892, + 0.15557493828237057, + 0.2378508597612381, + 0.024200495332479477, + 0.27723558619618416, + 0.23004959896206856, + 0.21047450229525566, + 0.26814376562833786, + 1.8356180600821972, + 0.10609042271971703, + 0.5129492841660976, + 0.0, + 0.04533928260207176, + 0.20357614010572433, + 0.08417574316263199, + 0.7585919722914696, + 0.11933112516999245, + 0.10427046939730644, + 0.1928738746792078, + 0.15698686987161636, + 0.5744633469730616, + 0.11828285455703735, + 0.08824355341494083, + 0.03195548057556152, + 0.07406619749963284, + 0.2654388379305601, + 1.037681931629777, + 0.11550687253475189, + 0.11238794401288033, + 0.08290695585310459, + 0.2445613630115986, + 0.6367827993817627, + 0.10603492334485054, + 0.4469711184501648, + 0.24728954583406448, + 0.1336858794093132, + 0.12759312987327576, + 0.31806687265634537, + 0.1923508606851101, + 0.17727938294410706, + 0.35870568454265594, + 0.6391010172665119, + 0.10069340467453003, + 0.15275026290328242, + 1.0177776664495468, + 0.9136728434823453, + 0.16223379969596863, + 0.3234846293926239, + 0.05869852751493454, + 0.15233400464057922, + 0.18939966149628162, + 0.21973244339460507, + 0.47724754735827446, + 0.10273477435112, + 0.06702870386652648, + 0.6189608797430992, + 0.34559219144284725, + 0.564814979210496, + 0.15301793068647385, + 0.7538646906614304, + 0.19557441398501396, + 0.3248923234641552, + 0.206058319658041, + 0.2238178327679634 + ], + "unique_experts": 63, + "load_cv": 1.050426133399391, + "normalized_load_entropy": 0.9099116690147485, + "max_load_share": 0.1076388888888889 + } + }, + "s1_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "a67e9612f03b69a26b6c29a4fad0e00ceefda357ff0a34e174166e08862f2239", + "route_weight_sha256": "3c83e3cfa9b65a399f4640d2c805e6d5e89f23e45c2c99ba9db03110bc3955fb", + "loads": [ + 3, + 4, + 2, + 2, + 3, + 4, + 4, + 1, + 10, + 2, + 4, + 0, + 1, + 2, + 3, + 2, + 2, + 0, + 2, + 2, + 4, + 1, + 1, + 1, + 1, + 2, + 2, + 1, + 3, + 2, + 3, + 3, + 0, + 5, + 2, + 2, + 1, + 3, + 3, + 0, + 5, + 2, + 1, + 2, + 1, + 1, + 3, + 4, + 1, + 2, + 1, + 2, + 3, + 1, + 1, + 2, + 1, + 1, + 2, + 0, + 2, + 2, + 3, + 2 + ], + "weighted_loads": [ + 0.29596756398677826, + 0.20110279135406017, + 0.13473472371697426, + 0.04784930311143398, + 0.23047039285302162, + 0.2276538610458374, + 0.13864172995090485, + 0.03650257736444473, + 0.4675389174371958, + 0.1066528744995594, + 0.31587373465299606, + 0.0, + 0.02267496846616268, + 0.20340149104595184, + 0.11130918934941292, + 0.15055552870035172, + 0.12364616617560387, + 0.0, + 0.1701192408800125, + 0.1582905352115631, + 0.15847613848745823, + 0.1189151182770729, + 0.0604509674012661, + 0.03218900039792061, + 0.047239914536476135, + 0.11370884627103806, + 0.07069385796785355, + 0.043327342718839645, + 0.13950115628540516, + 0.08429347909986973, + 0.24661671556532383, + 0.23071131855249405, + 0.0, + 0.20434311777353287, + 0.25234319269657135, + 0.13488735631108284, + 0.10106725245714188, + 0.31944507732987404, + 0.18975909054279327, + 0.0, + 0.326923131942749, + 0.18537787348031998, + 0.09948568791151047, + 0.04282308369874954, + 0.03500868007540703, + 0.09479659050703049, + 0.16278822720050812, + 0.3279935512691736, + 0.059316493570804596, + 0.18267730250954628, + 0.03329557925462723, + 0.21685051172971725, + 0.20480450987815857, + 0.09993934631347656, + 0.021394869312644005, + 0.11807239055633545, + 0.031827494502067566, + 0.04054945334792137, + 0.15432647615671158, + 0.0, + 0.1061617024242878, + 0.13471631705760956, + 0.2033192552626133, + 0.2301497608423233 + ], + "unique_experts": 59, + "load_cv": 0.7157425057893185, + "normalized_load_entropy": 0.942311655330727, + "max_load_share": 0.07246376811594203 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "1b1f11675d15fc900d4e044b550355c9ca70a747bfc238c247ea623b381a2a5d", + "route_weight_sha256": "bbb0c552ac97290df5cde628ff0967af51e01aa0545b24ed4011f5a8f7ce6dd7", + "loads": [ + 6, + 4, + 5, + 2, + 8, + 6, + 5, + 4, + 37, + 2, + 9, + 1, + 1, + 3, + 3, + 14, + 2, + 5, + 4, + 3, + 8, + 3, + 6, + 2, + 3, + 7, + 23, + 3, + 3, + 4, + 4, + 10, + 2, + 7, + 2, + 2, + 2, + 4, + 3, + 4, + 6, + 14, + 4, + 8, + 3, + 12, + 3, + 7, + 3, + 2, + 9, + 6, + 8, + 1, + 6, + 6, + 11, + 14, + 4, + 11, + 4, + 7, + 3, + 6 + ], + "weighted_loads": [ + 0.4896056093275547, + 0.20110279135406017, + 0.30007729679346085, + 0.04784930311143398, + 0.5207518246024847, + 0.36458035558462143, + 0.18403888121247292, + 0.27383674308657646, + 2.16045581176877, + 0.1066528744995594, + 0.7077740244567394, + 0.14657524228096008, + 0.02267496846616268, + 0.24318649992346764, + 0.11130918934941292, + 0.855876985937357, + 0.12364616617560387, + 0.20131995156407356, + 0.22977179661393166, + 0.22423139214515686, + 0.5345734283328056, + 0.32456671446561813, + 0.3318192391307093, + 0.06669260933995247, + 0.11873984336853027, + 0.2927731368690729, + 1.4868590384721756, + 0.1382264792919159, + 0.13950115628540516, + 0.24606569297611713, + 0.3324528429657221, + 0.8552183963474818, + 0.09280725196003914, + 0.38421814888715744, + 0.25234319269657135, + 0.13488735631108284, + 0.35967422276735306, + 0.35350746288895607, + 0.18975909054279327, + 0.2956593446433544, + 0.3715621717274189, + 0.7603033632040024, + 0.3072022832930088, + 0.24085724540054798, + 1.177197989076376, + 0.8659853034769185, + 0.16278822720050812, + 0.41039559233468026, + 0.20998482033610344, + 0.18267730250954628, + 0.4713469631969929, + 0.5809658542275429, + 0.5473008565604687, + 0.09993934631347656, + 0.11527101718820632, + 0.5927439033985138, + 0.5025231391191483, + 0.7981783356517553, + 0.22932710498571396, + 0.6704141497612, + 0.22207043133676052, + 0.41699739545583725, + 0.2033192552626133, + 0.7212076708674431 + ], + "unique_experts": 64, + "load_cv": 0.9204467514322717, + "normalized_load_entropy": 0.9296650642959688, + "max_load_share": 0.09635416666666667 + } + }, + "s0_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "235732267fe7c8aa6dfb1dcdff85f363f7682d96427c24e537db1beb08533b51", + "route_weight_sha256": "3017c2d8f8af2f9625cbeb0fe39944d505f4a4f6afb50e2ea5100f75ffb9d869", + "loads": [ + 3, + 3, + 2, + 1, + 3, + 3, + 4, + 1, + 6, + 2, + 3, + 0, + 0, + 2, + 4, + 2, + 2, + 5, + 3, + 2, + 4, + 1, + 1, + 1, + 1, + 2, + 1, + 1, + 3, + 1, + 2, + 3, + 1, + 6, + 2, + 2, + 1, + 3, + 3, + 0, + 4, + 2, + 1, + 2, + 2, + 1, + 3, + 4, + 1, + 1, + 1, + 2, + 4, + 1, + 1, + 2, + 1, + 1, + 2, + 1, + 2, + 4, + 3, + 2 + ], + "weighted_loads": [ + 0.2909499257802963, + 0.13968266919255257, + 0.1405412070453167, + 0.025667764246463776, + 0.23242026939988136, + 0.167372802272439, + 0.16623474285006523, + 0.03825721889734268, + 0.22093709371984005, + 0.1123686246573925, + 0.24942240491509438, + 0.0, + 0.0, + 0.2016826570034027, + 0.14397738128900528, + 0.13208220899105072, + 0.11823053285479546, + 0.2188732922077179, + 0.19272120110690594, + 0.159227192401886, + 0.1509846281260252, + 0.11305012553930283, + 0.06405610591173172, + 0.03263775631785393, + 0.049653612077236176, + 0.12477845326066017, + 0.02954927273094654, + 0.043458227068185806, + 0.14552255906164646, + 0.0640006735920906, + 0.2204459086060524, + 0.23016900569200516, + 0.036368586122989655, + 0.28936726599931717, + 0.2580748349428177, + 0.13078756630420685, + 0.09815485030412674, + 0.2862715758383274, + 0.20154527947306633, + 0.0, + 0.19735794514417648, + 0.1595701277256012, + 0.1035592257976532, + 0.05301911570131779, + 0.06069481745362282, + 0.08938433229923248, + 0.16347018629312515, + 0.3280987236648798, + 0.05964633822441101, + 0.15132632851600647, + 0.02930273488163948, + 0.23411395400762558, + 0.2113241534680128, + 0.099579818546772, + 0.023292450234293938, + 0.13360797986388206, + 0.0345173142850399, + 0.035707272589206696, + 0.13358527421951294, + 0.03751834109425545, + 0.1004721187055111, + 0.18686786480247974, + 0.20008837059140205, + 0.20409580320119858 + ], + "unique_experts": 61, + "load_cv": 0.6147046394332897, + "normalized_load_entropy": 0.953247022374801, + "max_load_share": 0.043478260869565216 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "b963b8c528547b657676f17d952092f89362199f1c6dd86a51b266539ae6733b", + "route_weight_sha256": "fc71a72558f7932ee610e95d3a2e9a55877668370c02490aaa8cbd6cf6d0d740", + "loads": [ + 5, + 3, + 4, + 1, + 5, + 3, + 5, + 3, + 24, + 2, + 5, + 2, + 0, + 2, + 5, + 11, + 2, + 7, + 5, + 2, + 7, + 1, + 2, + 1, + 1, + 6, + 14, + 2, + 3, + 1, + 2, + 7, + 3, + 8, + 2, + 2, + 1, + 3, + 3, + 3, + 4, + 12, + 2, + 7, + 2, + 11, + 4, + 4, + 1, + 1, + 5, + 2, + 8, + 1, + 4, + 6, + 5, + 11, + 2, + 11, + 4, + 8, + 3, + 2 + ], + "weighted_loads": [ + 0.40676611103117466, + 0.13968266919255257, + 0.22572460025548935, + 0.025667764246463776, + 0.28411510959267616, + 0.167372802272439, + 0.22833207622170448, + 0.29833386093378067, + 1.2448691856116056, + 0.1123686246573925, + 0.4516426511108875, + 0.05196681246161461, + 0.0, + 0.2016826570034027, + 0.16191044077277184, + 0.748945914208889, + 0.11823053285479546, + 0.3247632347047329, + 0.23915387503802776, + 0.159227192401886, + 0.4849314372986555, + 0.11305012553930283, + 0.09431394375860691, + 0.03263775631785393, + 0.049653612077236176, + 0.2865985482931137, + 0.884658332914114, + 0.10596978291869164, + 0.14552255906164646, + 0.0640006735920906, + 0.2204459086060524, + 0.6722579896450043, + 0.14955708384513855, + 0.5302015990018845, + 0.2580748349428177, + 0.13078756630420685, + 0.09815485030412674, + 0.2862715758383274, + 0.20154527947306633, + 0.22645403817296028, + 0.19735794514417648, + 0.571763638406992, + 0.14634183794260025, + 0.18750395439565182, + 0.06069481745362282, + 0.9083297103643417, + 0.18960732966661453, + 0.3280987236648798, + 0.05964633822441101, + 0.15132632851600647, + 0.2074774894863367, + 0.23411395400762558, + 0.475530656054616, + 0.099579818546772, + 0.09187762811779976, + 0.6444404684007168, + 0.3756205290555954, + 0.6312955226749182, + 0.13358527421951294, + 0.7212293483316898, + 0.2962605096399784, + 0.38443768583238125, + 0.20008837059140205, + 0.20409580320119858 + ], + "unique_experts": 63, + "load_cv": 0.8827915878928169, + "normalized_load_entropy": 0.9253849485644354, + "max_load_share": 0.08333333333333333 + } + }, + "s1_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "1754082161e187beccb14b5b394882816560597e30e755a8fb39059434bad1a3", + "route_weight_sha256": "d878d506865b7cee3844c562293f708f83e6304081e4dbe1e718193be604d93f", + "loads": [ + 3, + 3, + 2, + 2, + 3, + 3, + 3, + 1, + 3, + 3, + 3, + 0, + 0, + 2, + 2, + 2, + 2, + 4, + 3, + 2, + 4, + 1, + 1, + 1, + 1, + 2, + 1, + 1, + 4, + 2, + 3, + 3, + 1, + 6, + 2, + 2, + 1, + 3, + 3, + 0, + 4, + 2, + 1, + 2, + 2, + 1, + 3, + 4, + 1, + 1, + 2, + 2, + 4, + 1, + 1, + 3, + 1, + 1, + 2, + 1, + 2, + 4, + 3, + 2 + ], + "weighted_loads": [ + 0.2762818858027458, + 0.14536866545677185, + 0.13266007602214813, + 0.05040893144905567, + 0.23288648203015327, + 0.1938416324555874, + 0.11473918706178665, + 0.03751828894019127, + 0.09171053022146225, + 0.13665500283241272, + 0.239922933280468, + 0.0, + 0.0, + 0.19990123063325882, + 0.0851978100836277, + 0.1455548070371151, + 0.1297014355659485, + 0.17808479443192482, + 0.1875387281179428, + 0.1583579182624817, + 0.15289075300097466, + 0.12365052849054337, + 0.0684402734041214, + 0.03213067725300789, + 0.04757498577237129, + 0.12496501952409744, + 0.029665427282452583, + 0.044512469321489334, + 0.17502718046307564, + 0.092789426445961, + 0.25829774513840675, + 0.23502948880195618, + 0.03418755903840065, + 0.26697174087166786, + 0.25869913399219513, + 0.1289547234773636, + 0.09920930862426758, + 0.2713688910007477, + 0.1990354023873806, + 0.0, + 0.2098754495382309, + 0.18109332025051117, + 0.09855247288942337, + 0.05187628045678139, + 0.06458296626806259, + 0.09059322625398636, + 0.16696888953447342, + 0.33714268915355206, + 0.06059696525335312, + 0.15111249685287476, + 0.0599357970058918, + 0.23516593873500824, + 0.2040615063160658, + 0.10015205293893814, + 0.02364550530910492, + 0.1581773590296507, + 0.036124087870121, + 0.033600546419620514, + 0.12814506515860558, + 0.03742879256606102, + 0.10540971904993057, + 0.18193918652832508, + 0.2039210945367813, + 0.20559096336364746 + ], + "unique_experts": 61, + "load_cv": 0.5451664601102616, + "normalized_load_entropy": 0.9606140096575424, + "max_load_share": 0.043478260869565216 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "46b295fc56e19fdb552cb07bccb6c4f7d66c0f152e2dd9001dd24db0ab81e7a6", + "route_weight_sha256": "9369f3daa6f244eb0fd37f693c179de610848ee71b3af38f99d7567adf86b260", + "loads": [ + 7, + 3, + 5, + 3, + 8, + 5, + 4, + 4, + 27, + 3, + 8, + 1, + 0, + 4, + 2, + 14, + 2, + 9, + 6, + 3, + 7, + 3, + 5, + 2, + 3, + 7, + 20, + 3, + 4, + 4, + 4, + 9, + 3, + 8, + 3, + 2, + 2, + 4, + 3, + 5, + 4, + 14, + 5, + 8, + 3, + 11, + 4, + 6, + 3, + 1, + 11, + 6, + 9, + 1, + 7, + 7, + 11, + 16, + 4, + 11, + 5, + 9, + 3, + 6 + ], + "weighted_loads": [ + 0.5081619769334793, + 0.14536866545677185, + 0.284330315887928, + 0.08213713206350803, + 0.5231679137796164, + 0.3307681269943714, + 0.16013633832335472, + 0.26589421182870865, + 1.4724878277629614, + 0.13665500283241272, + 0.6332924105226994, + 0.14657524228096008, + 0.0, + 0.26395322754979134, + 0.0851978100836277, + 0.8508762642741203, + 0.1297014355659485, + 0.3794047459959984, + 0.274411728605628, + 0.22429877519607544, + 0.4491337947547436, + 0.3293021246790886, + 0.3394964002072811, + 0.06663428619503975, + 0.11907491460442543, + 0.31683734245598316, + 1.344299292191863, + 0.13616374135017395, + 0.17502718046307564, + 0.2545616403222084, + 0.344133872538805, + 0.8932983353734016, + 0.1339513286948204, + 0.4623810462653637, + 0.2816854827105999, + 0.1289547234773636, + 0.35781627893447876, + 0.3054312765598297, + 0.1990354023873806, + 0.34874268248677254, + 0.2098754495382309, + 0.7560188099741936, + 0.3427104316651821, + 0.24991044215857983, + 0.21779430657625198, + 0.8613131642341614, + 0.19713637605309486, + 0.4192281384021044, + 0.21126529201865196, + 0.15111249685287476, + 0.5252270307391882, + 0.5992812812328339, + 0.5189679060131311, + 0.10015205293893814, + 0.16355512849986553, + 0.6499559413641691, + 0.5215867534279823, + 0.880584329366684, + 0.20314569398760796, + 0.673196267336607, + 0.3235130477696657, + 0.4710203502327204, + 0.2039210945367813, + 0.6966488733887672 + ], + "unique_experts": 63, + "load_cv": 0.7728015412913086, + "normalized_load_entropy": 0.9405811389180191, + "max_load_share": 0.0703125 + } + }, + "s0_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "8c19b448db52344c4fc052bd3a869578eb7988173dd69f84e81c3eea540c9b6c", + "route_weight_sha256": "261e62521b0c228bf1c67a12de9f93ef07c520ee6988b76e900edc62332ba787", + "loads": [ + 3, + 3, + 2, + 1, + 3, + 3, + 4, + 1, + 7, + 2, + 3, + 0, + 0, + 2, + 4, + 2, + 2, + 4, + 3, + 2, + 4, + 1, + 1, + 1, + 1, + 2, + 2, + 1, + 3, + 1, + 2, + 3, + 1, + 6, + 2, + 2, + 1, + 3, + 3, + 0, + 4, + 2, + 1, + 1, + 2, + 1, + 3, + 4, + 1, + 1, + 1, + 2, + 4, + 1, + 2, + 3, + 1, + 1, + 2, + 1, + 2, + 2, + 3, + 2 + ], + "weighted_loads": [ + 0.29496732354164124, + 0.1577284373342991, + 0.1368522085249424, + 0.024538297206163406, + 0.23824862018227577, + 0.19471224397420883, + 0.16979305818676949, + 0.03771839663386345, + 0.23427146300673485, + 0.10832637175917625, + 0.25847428664565086, + 0.0, + 0.0, + 0.21648511290550232, + 0.1477458570152521, + 0.12184003368020058, + 0.12633111327886581, + 0.16036495752632618, + 0.1967590767890215, + 0.16057449206709862, + 0.15517105907201767, + 0.1199076771736145, + 0.06282387673854828, + 0.03308122605085373, + 0.05090118572115898, + 0.12284210324287415, + 0.06228877976536751, + 0.0415719598531723, + 0.14572336338460445, + 0.06100715696811676, + 0.2269073650240898, + 0.23618687689304352, + 0.03555801138281822, + 0.26586698554456234, + 0.25172991305589676, + 0.1319851130247116, + 0.09197663515806198, + 0.30885885655879974, + 0.1921292170882225, + 0.0, + 0.24469738826155663, + 0.1797255389392376, + 0.10747666656970978, + 0.027349427342414856, + 0.06032844819128513, + 0.090790756046772, + 0.16503414884209633, + 0.32218904979526997, + 0.059224341064691544, + 0.15041084587574005, + 0.029316822066903114, + 0.23983356356620789, + 0.21210740506649017, + 0.09540010988712311, + 0.055124612525105476, + 0.15981926769018173, + 0.032612863928079605, + 0.03763965517282486, + 0.14103688299655914, + 0.03775133937597275, + 0.10468168184161186, + 0.130523469299078, + 0.20659540966153145, + 0.21076301485300064 + ], + "unique_experts": 61, + "load_cv": 0.6147046394332897, + "normalized_load_entropy": 0.9541081860489521, + "max_load_share": 0.050724637681159424 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "be50bce08b7fc3ea61830151c76769e8f3b61c4b47a3a16a46d529f052cdda8c", + "route_weight_sha256": "abaf953658d2fd01c05b1c841c111d2e041cabf71e6a1bcf9ab45665926d2147", + "loads": [ + 4, + 3, + 4, + 1, + 5, + 3, + 5, + 4, + 26, + 3, + 5, + 1, + 0, + 2, + 6, + 12, + 2, + 5, + 5, + 2, + 7, + 1, + 3, + 1, + 1, + 6, + 16, + 2, + 3, + 1, + 2, + 7, + 3, + 8, + 2, + 2, + 1, + 3, + 3, + 3, + 4, + 13, + 1, + 6, + 2, + 12, + 3, + 4, + 1, + 1, + 4, + 2, + 8, + 1, + 4, + 7, + 4, + 10, + 2, + 12, + 3, + 6, + 3, + 2 + ], + "weighted_loads": [ + 0.38803835213184357, + 0.1577284373342991, + 0.23149535059928894, + 0.024538297206163406, + 0.28994346037507057, + 0.19471224397420883, + 0.23189039155840874, + 0.33740149438381195, + 1.2947541419416666, + 0.13477206602692604, + 0.45941807702183723, + 0.023533372208476067, + 0.0, + 0.21648511290550232, + 0.18963394314050674, + 0.8556027300655842, + 0.12633111327886581, + 0.23154138959944248, + 0.2408298086374998, + 0.16057449206709862, + 0.48482371121644974, + 0.1199076771736145, + 0.12389161996543407, + 0.03308122605085373, + 0.05090118572115898, + 0.2876347675919533, + 0.9688778351992369, + 0.10814877599477768, + 0.14572336338460445, + 0.06100715696811676, + 0.2269073650240898, + 0.6860631629824638, + 0.14881496503949165, + 0.5086426343768835, + 0.25172991305589676, + 0.1319851130247116, + 0.09197663515806198, + 0.30885885655879974, + 0.1921292170882225, + 0.2485549859702587, + 0.24469738826155663, + 0.647754143923521, + 0.10747666656970978, + 0.16587634198367596, + 0.06032844819128513, + 0.9432785026729107, + 0.16503414884209633, + 0.32218904979526997, + 0.059224341064691544, + 0.15041084587574005, + 0.20473673567175865, + 0.23983356356620789, + 0.4534875638782978, + 0.09540010988712311, + 0.10018892586231232, + 0.6840097829699516, + 0.22539975866675377, + 0.5535306613892317, + 0.14103688299655914, + 0.8200352936983109, + 0.19559242948889732, + 0.3222075551748276, + 0.20659540966153145, + 0.21076301485300064 + ], + "unique_experts": 63, + "load_cv": 0.950957931590205, + "normalized_load_entropy": 0.9179646496842506, + "max_load_share": 0.09027777777777778 + } + }, + "s1_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "4f16a6e153ee3bc0b2edbcbbc7553cd5129896c6f94d512d55bc7f6f66c3bf23", + "route_weight_sha256": "4135b2dd40f715fe0278abb2d9b3e8d9092841d281817a2b7817db5cc518b675", + "loads": [ + 3, + 4, + 2, + 1, + 3, + 3, + 3, + 1, + 2, + 3, + 3, + 0, + 0, + 2, + 2, + 2, + 2, + 4, + 3, + 2, + 4, + 1, + 1, + 1, + 1, + 2, + 1, + 1, + 4, + 2, + 3, + 3, + 1, + 6, + 2, + 2, + 1, + 3, + 3, + 0, + 4, + 2, + 1, + 4, + 3, + 1, + 3, + 4, + 1, + 1, + 1, + 2, + 3, + 1, + 1, + 3, + 1, + 1, + 2, + 1, + 2, + 4, + 3, + 2 + ], + "weighted_loads": [ + 0.2707468718290329, + 0.1790644098073244, + 0.1276337094604969, + 0.024612106382846832, + 0.23475956171751022, + 0.20361283794045448, + 0.11907599121332169, + 0.03711450472474098, + 0.05879359319806099, + 0.13226506859064102, + 0.2421276457607746, + 0.0, + 0.0, + 0.2106381058692932, + 0.083531579002738, + 0.13924338296055794, + 0.13563760370016098, + 0.16953440010547638, + 0.1851941365748644, + 0.15645908936858177, + 0.15513955801725388, + 0.12780505418777466, + 0.06614881008863449, + 0.03167028725147247, + 0.048504509031772614, + 0.12341616302728653, + 0.03090166300535202, + 0.04421226307749748, + 0.17723657935857773, + 0.09087064862251282, + 0.2692312076687813, + 0.23987314850091934, + 0.03425220027565956, + 0.2574703861027956, + 0.2569075748324394, + 0.1316034533083439, + 0.09470465034246445, + 0.27365674264729023, + 0.19433654472231865, + 0.0, + 0.23821240290999413, + 0.19173001870512962, + 0.10037513822317123, + 0.10026934556663036, + 0.0915058683604002, + 0.09073904156684875, + 0.16908570006489754, + 0.3304510358721018, + 0.060453593730926514, + 0.15246914327144623, + 0.03195076435804367, + 0.2366374060511589, + 0.173830084502697, + 0.10064752399921417, + 0.024267910048365593, + 0.159646300598979, + 0.03598461672663689, + 0.03364939987659454, + 0.12607651203870773, + 0.03736869990825653, + 0.11073946952819824, + 0.1816591713577509, + 0.206984531134367, + 0.20215094089508057 + ], + "unique_experts": 61, + "load_cv": 0.5633562819007771, + "normalized_load_entropy": 0.9581985507203443, + "max_load_share": 0.043478260869565216 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "7b01b01b531e6b566b07449298c341acf4e8d703bc9b2c5f8120223232cbd75a", + "route_weight_sha256": "452d0600464e680727d9e51e75cc9b5628d957db2da75dbe7f8538333ce34e38", + "loads": [ + 6, + 4, + 5, + 1, + 8, + 5, + 4, + 5, + 25, + 4, + 8, + 1, + 0, + 4, + 3, + 15, + 2, + 9, + 6, + 3, + 7, + 3, + 5, + 2, + 3, + 7, + 21, + 3, + 4, + 4, + 4, + 9, + 3, + 8, + 2, + 2, + 2, + 4, + 3, + 5, + 4, + 15, + 4, + 10, + 4, + 12, + 4, + 6, + 4, + 1, + 10, + 6, + 8, + 1, + 7, + 7, + 10, + 14, + 4, + 12, + 4, + 9, + 3, + 6 + ], + "weighted_loads": [ + 0.4772872067987919, + 0.1790644098073244, + 0.28662770241498947, + 0.024612106382846832, + 0.5250409934669733, + 0.3405393324792385, + 0.16447314247488976, + 0.3031876627355814, + 1.405940605327487, + 0.15707884542644024, + 0.632002979516983, + 0.14657524228096008, + 0.0, + 0.2763469070196152, + 0.10557074099779129, + 0.9551622569561005, + 0.13563760370016098, + 0.37085435166954994, + 0.26922503486275673, + 0.22239994630217552, + 0.44964395463466644, + 0.3334566503763199, + 0.3372049368917942, + 0.06617389619350433, + 0.12000443786382675, + 0.3195854928344488, + 1.387514628469944, + 0.1376972794532776, + 0.17723657935857773, + 0.2526428624987602, + 0.35506733506917953, + 0.9058261588215828, + 0.1347687691450119, + 0.4535686541348696, + 0.2569075748324394, + 0.1316034533083439, + 0.35331162065267563, + 0.30771912820637226, + 0.19433654472231865, + 0.36663370952010155, + 0.23821240290999413, + 0.8329025842249393, + 0.30809173360466957, + 0.2983035072684288, + 0.2447172086685896, + 0.8959871344268322, + 0.20287181809544563, + 0.4125364851206541, + 0.23271141573786736, + 0.15246914327144623, + 0.5153604783117771, + 0.6007527485489845, + 0.46830103918910027, + 0.10064752399921417, + 0.16313312016427517, + 0.6634186711162329, + 0.3926902338862419, + 0.7742835022509098, + 0.2010771408677101, + 0.7675866931676865, + 0.22664819844067097, + 0.46770387701690197, + 0.206984531134367, + 0.6932088509202003 + ], + "unique_experts": 63, + "load_cv": 0.7603453162872774, + "normalized_load_entropy": 0.9410823827020528, + "max_load_share": 0.06510416666666667 + } + }, + "s0_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "2d8cd9908fc464dc20cd5f3e8c7b1db3070e43c5b0647c5983b812d1b562f242", + "route_weight_sha256": "5c81bb4018153c25a00c68db144af7d4816e2a02fe1a4315025341fad74075d5", + "loads": [ + 3, + 3, + 2, + 1, + 3, + 3, + 4, + 1, + 5, + 3, + 3, + 0, + 0, + 2, + 4, + 2, + 2, + 4, + 3, + 2, + 4, + 1, + 1, + 1, + 1, + 2, + 2, + 1, + 2, + 1, + 2, + 3, + 1, + 6, + 2, + 2, + 1, + 3, + 3, + 0, + 4, + 2, + 1, + 3, + 2, + 1, + 3, + 4, + 1, + 1, + 1, + 2, + 3, + 1, + 2, + 3, + 1, + 1, + 2, + 1, + 2, + 3, + 3, + 2 + ], + "weighted_loads": [ + 0.29529543966054916, + 0.15745901316404343, + 0.1364898830652237, + 0.024389032274484634, + 0.23585115373134613, + 0.1960897035896778, + 0.17028780281543732, + 0.03765729442238808, + 0.1743161603808403, + 0.1350201591849327, + 0.258579783141613, + 0.0, + 0.0, + 0.2158903330564499, + 0.14675084128975868, + 0.1216420978307724, + 0.12741302698850632, + 0.15337443724274635, + 0.19856811873614788, + 0.1595245786011219, + 0.1558385230600834, + 0.1207239106297493, + 0.06432051956653595, + 0.033042315393686295, + 0.05104147270321846, + 0.12276661396026611, + 0.06206359900534153, + 0.041675664484500885, + 0.11227216944098473, + 0.060969844460487366, + 0.22570428252220154, + 0.23641595989465714, + 0.03522690013051033, + 0.26086425222456455, + 0.2459016963839531, + 0.1337258741259575, + 0.09266212582588196, + 0.3083489388227463, + 0.1949099712073803, + 0.0, + 0.252041220664978, + 0.17929135635495186, + 0.10788815468549728, + 0.07890700548887253, + 0.05990685522556305, + 0.09070315212011337, + 0.16530032083392143, + 0.3085902500897646, + 0.059382494539022446, + 0.15129299461841583, + 0.028917096555233, + 0.2398679256439209, + 0.18659396842122078, + 0.09476588666439056, + 0.056029295548796654, + 0.16330616176128387, + 0.03386770933866501, + 0.03725912794470787, + 0.14220259338617325, + 0.03778563812375069, + 0.10535016655921936, + 0.1596736554056406, + 0.20666122809052467, + 0.2135528326034546 + ], + "unique_experts": 61, + "load_cv": 0.5633562819007771, + "normalized_load_entropy": 0.9586699994227154, + "max_load_share": 0.043478260869565216 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "76d94937e16a91b28ef07acb60d6f60dae5dab869fac68fedb7b3b9d22e0944c", + "route_weight_sha256": "4b78a7f93444c13c36c807af3edd3add17a20380e6dec47733cc62aa793ae4f4", + "loads": [ + 4, + 3, + 4, + 1, + 6, + 3, + 5, + 3, + 24, + 3, + 5, + 2, + 0, + 3, + 6, + 11, + 2, + 5, + 5, + 2, + 7, + 1, + 2, + 1, + 1, + 6, + 15, + 2, + 2, + 1, + 2, + 7, + 3, + 8, + 2, + 3, + 1, + 3, + 3, + 3, + 4, + 12, + 1, + 9, + 2, + 11, + 3, + 4, + 2, + 1, + 4, + 3, + 7, + 1, + 4, + 7, + 4, + 10, + 2, + 12, + 3, + 7, + 3, + 2 + ], + "weighted_loads": [ + 0.38893086463212967, + 0.15745901316404343, + 0.2221425659954548, + 0.024389032274484634, + 0.40927986800670624, + 0.1960897035896778, + 0.23238513618707657, + 0.28984271362423897, + 1.2104553319513798, + 0.1350201591849327, + 0.4597017392516136, + 0.15987105295062065, + 0.0, + 0.23974904604256153, + 0.18828460201621056, + 0.7385058030486107, + 0.12741302698850632, + 0.22455086931586266, + 0.24310746602714062, + 0.1595245786011219, + 0.4874671511352062, + 0.1207239106297493, + 0.09457835741341114, + 0.033042315393686295, + 0.05104147270321846, + 0.2871107943356037, + 0.9375146590173244, + 0.1071515828371048, + 0.11227216944098473, + 0.060969844460487366, + 0.22570428252220154, + 0.6887423247098923, + 0.14750099554657936, + 0.5025139544159174, + 0.2459016963839531, + 0.15512707456946373, + 0.09266212582588196, + 0.3083489388227463, + 0.1949099712073803, + 0.22797281295061111, + 0.252041220664978, + 0.5914848670363426, + 0.10788815468549728, + 0.24194119311869144, + 0.05990685522556305, + 0.9096485301852226, + 0.16530032083392143, + 0.3085902500897646, + 0.08054368011653423, + 0.15129299461841583, + 0.20340492017567158, + 0.292782548815012, + 0.44272658601403236, + 0.09476588666439056, + 0.1010936088860035, + 0.6911284923553467, + 0.22676857188344002, + 0.5490629710257053, + 0.14220259338617325, + 0.7514955326914787, + 0.19626091420650482, + 0.34857633151113987, + 0.20666122809052467, + 0.2135528326034546 + ], + "unique_experts": 63, + "load_cv": 0.8906233078822999, + "normalized_load_entropy": 0.9251197949431337, + "max_load_share": 0.08333333333333333 + } + }, + "s1_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "72866217798b454b8b49c265370c0216ecc9662a5e5a2cd03ea5170b15350612", + "route_weight_sha256": "c79a1a11ce904ce4ff3db64e9ae00f3edd11a91ad6659f87055ae1bcf0e79ab2", + "loads": [ + 3, + 4, + 2, + 1, + 3, + 3, + 3, + 1, + 2, + 3, + 3, + 0, + 0, + 2, + 2, + 2, + 2, + 4, + 3, + 2, + 4, + 1, + 1, + 1, + 1, + 2, + 1, + 1, + 4, + 2, + 3, + 3, + 1, + 6, + 2, + 2, + 1, + 3, + 3, + 0, + 4, + 2, + 1, + 4, + 3, + 1, + 3, + 4, + 1, + 1, + 2, + 2, + 3, + 1, + 1, + 3, + 1, + 1, + 2, + 1, + 2, + 3, + 3, + 2 + ], + "weighted_loads": [ + 0.2709576487541199, + 0.17936706729233265, + 0.12713735550642014, + 0.024570981040596962, + 0.23135558515787125, + 0.20355940237641335, + 0.11819412186741829, + 0.037241075187921524, + 0.057637769728899, + 0.13229089602828026, + 0.244628444314003, + 0.0, + 0.0, + 0.2097003385424614, + 0.08382155559957027, + 0.139210756868124, + 0.1366175040602684, + 0.16346454992890358, + 0.1880816537886858, + 0.15621502697467804, + 0.15514781884849072, + 0.12910468876361847, + 0.06781678646802902, + 0.03169141337275505, + 0.04831459000706673, + 0.12319920212030411, + 0.03075767122209072, + 0.044104836881160736, + 0.17241943441331387, + 0.09084099344909191, + 0.2693139873445034, + 0.23933853209018707, + 0.03379764407873154, + 0.25197677314281464, + 0.25306493788957596, + 0.13248971477150917, + 0.09456152468919754, + 0.27499477565288544, + 0.19540372118353844, + 0.0, + 0.24320749938488007, + 0.19158661365509033, + 0.10042787343263626, + 0.10041696950793266, + 0.09075837023556232, + 0.09135763347148895, + 0.16927629336714745, + 0.31735832430422306, + 0.060510993003845215, + 0.1516810655593872, + 0.05957537330687046, + 0.23528924584388733, + 0.1743030771613121, + 0.09998064488172531, + 0.02546687051653862, + 0.16345863975584507, + 0.036179132759571075, + 0.033620692789554596, + 0.12582170218229294, + 0.03742564469575882, + 0.1111098937690258, + 0.15395701117813587, + 0.20685994625091553, + 0.20320414006710052 + ], + "unique_experts": 61, + "load_cv": 0.5512964232350792, + "normalized_load_entropy": 0.9597023097757023, + "max_load_share": 0.043478260869565216 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "db6bf1c7ed4144c0f5ffdbc599502998d6ed579ee6fd77a044f1b9f53d0ddb33", + "route_weight_sha256": "d37c44bba885dcc83e789f9dca6789180c637be9b878afcc78e0fd8be869eb4b", + "loads": [ + 6, + 4, + 5, + 1, + 9, + 5, + 4, + 4, + 24, + 3, + 8, + 4, + 0, + 4, + 3, + 14, + 2, + 9, + 6, + 3, + 7, + 3, + 5, + 2, + 3, + 7, + 21, + 3, + 4, + 4, + 5, + 9, + 3, + 8, + 2, + 2, + 3, + 4, + 3, + 5, + 4, + 15, + 4, + 10, + 4, + 11, + 3, + 6, + 3, + 1, + 11, + 7, + 9, + 1, + 7, + 7, + 10, + 14, + 4, + 11, + 4, + 8, + 3, + 6 + ], + "weighted_loads": [ + 0.4777338244020939, + 0.17936706729233265, + 0.2756897546350956, + 0.024570981040596962, + 0.6418850664049387, + 0.3404858969151974, + 0.16359127312898636, + 0.2529785931110382, + 1.3647964373230934, + 0.13229089602828026, + 0.6348716728389263, + 0.3384453263133764, + 0.0, + 0.2768809627741575, + 0.10569275543093681, + 0.8445322141051292, + 0.1366175040602684, + 0.36478450149297714, + 0.27338046208024025, + 0.2221558839082718, + 0.44722346775233746, + 0.3347562849521637, + 0.33887291327118874, + 0.06619502231478691, + 0.11981451883912086, + 0.3187310229986906, + 1.3768454995006323, + 0.13655844703316689, + 0.17241943441331387, + 0.2526132073253393, + 0.3759744893759489, + 0.9059685319662094, + 0.13313018903136253, + 0.44654274731874466, + 0.25306493788957596, + 0.13248971477150917, + 0.3750163521617651, + 0.30905716121196747, + 0.19540372118353844, + 0.3474445007741451, + 0.24320749938488007, + 0.801870658993721, + 0.3081444688141346, + 0.2984511312097311, + 0.24396971054375172, + 0.862077571451664, + 0.16927629336714745, + 0.3994437735527754, + 0.21117931976914406, + 0.1516810655593872, + 0.5431540869176388, + 0.6423239819705486, + 0.5028615482151508, + 0.09998064488172531, + 0.16582360118627548, + 0.6681301165372133, + 0.3974849805235863, + 0.772163949906826, + 0.20082233101129532, + 0.6731931194663048, + 0.22701862268149853, + 0.4353096019476652, + 0.20685994625091553, + 0.6942620500922203 + ], + "unique_experts": 63, + "load_cv": 0.738922827123675, + "normalized_load_entropy": 0.9440182541568363, + "max_load_share": 0.0625 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.9254658385093167, + "mean_token_weighted_tv": 0.012480085918112942, + "aggregate_load_tv": 0.043478260869565216 + }, + "system_bos": { + "tokens": 23, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.9037267080745341, + "mean_token_weighted_tv": 0.01808329853836609, + "aggregate_load_tv": 0.05072463768115942 + }, + "system_x": { + "tokens": 23, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8695652173913043, + "mean_token_weighted_tv": 0.022374204076502636, + "aggregate_load_tv": 0.07971014492753623 + }, + "system_period": { + "tokens": 23, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.8944099378881988, + "mean_token_weighted_tv": 0.020149786470700867, + "aggregate_load_tv": 0.05797101449275363 + }, + "bos_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 3, + "set_exact_tokens": 9, + "mean_set_jaccard": 0.8074534161490684, + "mean_token_weighted_tv": 0.03909885300242383, + "aggregate_load_tv": 0.10869565217391304 + }, + "bos_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 6, + "set_exact_tokens": 9, + "mean_set_jaccard": 0.7981366459627331, + "mean_token_weighted_tv": 0.040376890612685165, + "aggregate_load_tv": 0.11594202898550725 + }, + "x_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 3, + "set_exact_tokens": 8, + "mean_set_jaccard": 0.8043478260869565, + "mean_token_weighted_tv": 0.03523019709340904, + "aggregate_load_tv": 0.10144927536231885 + }, + "x_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 6, + "set_exact_tokens": 8, + "mean_set_jaccard": 0.7857142857142858, + "mean_token_weighted_tv": 0.04143369493439146, + "aggregate_load_tv": 0.12318840579710144 + }, + "period_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 3, + "set_exact_tokens": 8, + "mean_set_jaccard": 0.7950310559006212, + "mean_token_weighted_tv": 0.036508466683976025, + "aggregate_load_tv": 0.10869565217391303 + }, + "period_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 5, + "set_exact_tokens": 8, + "mean_set_jaccard": 0.7857142857142858, + "mean_token_weighted_tv": 0.04103877593803665, + "aggregate_load_tv": 0.12318840579710144 + } + } + }, + "layer_02": { + "layer": 2, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "3acb21da55ba1b9b1ce6a4210e61cdb3535a1e01dc6363db2c2e9eaade9e615e", + "route_weight_sha256": "56f86ae10d8e883af6bba4d3b0eab5cc0008e773762d60ac3d5f8a4a4152b3fa", + "loads": [ + 3, + 2, + 1, + 4, + 3, + 2, + 4, + 2, + 3, + 3, + 1, + 2, + 2, + 1, + 5, + 5, + 2, + 2, + 0, + 3, + 0, + 1, + 5, + 2, + 0, + 3, + 2, + 2, + 0, + 1, + 0, + 4, + 1, + 2, + 2, + 2, + 1, + 0, + 1, + 4, + 0, + 2, + 3, + 0, + 4, + 4, + 3, + 4, + 3, + 2, + 3, + 0, + 5, + 2, + 2, + 1, + 1, + 1, + 2, + 2, + 3, + 3, + 1, + 4 + ], + "weighted_loads": [ + 0.23039095103740692, + 0.1080981008708477, + 0.023259053006768227, + 0.34124474972486496, + 0.1798817403614521, + 0.10709791630506516, + 0.13053492456674576, + 0.10904501751065254, + 0.28403136134147644, + 0.32030026614665985, + 0.07020584493875504, + 0.24558264017105103, + 0.11367389932274818, + 0.08956774324178696, + 0.3239308279007673, + 0.3618002999573946, + 0.2100118175148964, + 0.2135351374745369, + 0.0, + 0.32838109135627747, + 0.0, + 0.04086267203092575, + 0.554459773004055, + 0.20309706777334213, + 0.0, + 0.2165076918900013, + 0.24892556108534336, + 0.08387935534119606, + 0.0, + 0.07751472294330597, + 0.0, + 0.3036428391933441, + 0.03481978178024292, + 0.0822022333741188, + 0.09326907992362976, + 0.10839952155947685, + 0.032896410673856735, + 0.0, + 0.1203753799200058, + 0.19147781282663345, + 0.0, + 0.15213895589113235, + 0.2507806457579136, + 0.0, + 0.30678874626755714, + 0.2837270274758339, + 0.23689421266317368, + 0.2084449604153633, + 0.4550236202776432, + 0.19465989619493484, + 0.32341688871383667, + 0.0, + 0.5608753934502602, + 0.22538718953728676, + 0.07074335217475891, + 0.058363255113363266, + 0.16504187881946564, + 0.03579473868012428, + 0.4391655772924423, + 0.11879802122712135, + 0.1810528077185154, + 0.2398076057434082, + 0.03395539149641991, + 0.2581307291984558 + ], + "unique_experts": 55, + "load_cv": 0.6518517722912759, + "normalized_load_entropy": 0.9365690375744912, + "max_load_share": 0.036231884057971016 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "e47c62753ff7087314b66cf5c9b01e1c045f50c44751722285de9155e27b306d", + "route_weight_sha256": "2faad384c57998258e93b4563a8a3e2a5146719ceeaad209ac43de54530246de", + "loads": [ + 3, + 12, + 1, + 6, + 3, + 2, + 4, + 3, + 6, + 3, + 4, + 2, + 2, + 2, + 13, + 5, + 2, + 3, + 1, + 7, + 2, + 10, + 5, + 2, + 3, + 3, + 3, + 4, + 3, + 1, + 0, + 5, + 1, + 2, + 7, + 17, + 1, + 0, + 4, + 4, + 0, + 2, + 9, + 0, + 4, + 4, + 6, + 8, + 4, + 2, + 3, + 6, + 5, + 3, + 2, + 1, + 1, + 9, + 10, + 7, + 14, + 5, + 7, + 15 + ], + "weighted_loads": [ + 0.23039095103740692, + 1.057629220187664, + 0.023259053006768227, + 2.0386328622698784, + 0.1798817403614521, + 0.10709791630506516, + 0.13053492456674576, + 0.15589142963290215, + 0.49676502123475075, + 0.32030026614665985, + 0.1952732615172863, + 0.24558264017105103, + 0.11367389932274818, + 0.1174136009067297, + 0.6236945949494839, + 0.3618002999573946, + 0.2100118175148964, + 0.21423358074389398, + 0.0015876434044912457, + 1.1556615233421326, + 0.31117744743824005, + 0.7344586923718452, + 0.554459773004055, + 0.20309706777334213, + 0.13810970075428486, + 0.2165076918900013, + 0.2497705351561308, + 0.40512576326727867, + 0.24645938724279404, + 0.07751472294330597, + 0.0, + 0.30433753214310855, + 0.03481978178024292, + 0.0822022333741188, + 0.31695546209812164, + 2.3351604184135795, + 0.032896410673856735, + 0.0, + 0.22442988865077496, + 0.19147781282663345, + 0.0, + 0.15213895589113235, + 0.8381164744496346, + 0.0, + 0.30678874626755714, + 0.2837270274758339, + 0.33063119649887085, + 0.48287855088710785, + 0.4806631226092577, + 0.19465989619493484, + 0.32341688871383667, + 0.6684192903339863, + 0.5608753934502602, + 0.22669805388431996, + 0.07074335217475891, + 0.058363255113363266, + 0.16504187881946564, + 0.454543674364686, + 0.80410485714674, + 0.35175713896751404, + 1.0955026587471366, + 0.3255640119314194, + 0.5335137825459242, + 0.8400118667632341 + ], + "unique_experts": 60, + "load_cv": 0.8314794192830981, + "normalized_load_entropy": 0.9235681268935743, + "max_load_share": 0.059027777777777776 + } + }, + "s1_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "bfa78cc5b90d4b4da515b484f6e44c9210f71faa35d0f44891bb9174a6be7b02", + "route_weight_sha256": "e840a474312df55a1d9d308c76b179cff9fd1276800274816b19f89ec0928ee5", + "loads": [ + 3, + 2, + 1, + 4, + 3, + 2, + 3, + 2, + 3, + 3, + 1, + 2, + 2, + 1, + 5, + 4, + 2, + 2, + 0, + 3, + 0, + 1, + 5, + 2, + 0, + 3, + 2, + 2, + 0, + 1, + 0, + 4, + 1, + 2, + 2, + 2, + 1, + 0, + 1, + 4, + 0, + 2, + 3, + 1, + 4, + 3, + 3, + 4, + 3, + 2, + 3, + 0, + 5, + 2, + 2, + 1, + 1, + 1, + 2, + 2, + 3, + 3, + 2, + 5 + ], + "weighted_loads": [ + 0.23368898779153824, + 0.11187796294689178, + 0.02318173088133335, + 0.3541659153997898, + 0.1813526675105095, + 0.10515746474266052, + 0.09174344129860401, + 0.11126112937927246, + 0.28746699541807175, + 0.31654443964362144, + 0.07193207740783691, + 0.2469712719321251, + 0.11496945843100548, + 0.09243807941675186, + 0.3352080471813679, + 0.34837959706783295, + 0.2204641029238701, + 0.20965714007616043, + 0.0, + 0.3263060487806797, + 0.0, + 0.04077173396945, + 0.5669316872954369, + 0.2064119055867195, + 0.0, + 0.2112865187227726, + 0.24908454157412052, + 0.08589062839746475, + 0.0, + 0.08115161210298538, + 0.0, + 0.29869766905903816, + 0.03576144948601723, + 0.08132809400558472, + 0.09268027544021606, + 0.10284963995218277, + 0.033089350908994675, + 0.0, + 0.12396833300590515, + 0.18681901320815086, + 0.0, + 0.15483983233571053, + 0.2483748346567154, + 0.026278799399733543, + 0.30253544449806213, + 0.24988821521401405, + 0.23960697650909424, + 0.20364701561629772, + 0.46084268763661385, + 0.1859411597251892, + 0.3271682932972908, + 0.0, + 0.552108395844698, + 0.22006963938474655, + 0.07348433136940002, + 0.05971652269363403, + 0.1616189032793045, + 0.030748188495635986, + 0.4336538016796112, + 0.12102290987968445, + 0.17805330082774162, + 0.25136538967490196, + 0.05651272460818291, + 0.2943975031375885 + ], + "unique_experts": 56, + "load_cv": 0.6255432421712243, + "normalized_load_entropy": 0.9419920146224052, + "max_load_share": 0.036231884057971016 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "e6d1240f4d7cdff6dc3002b556059c3d8b9ba5b48d143f7be569c59d7fa7213c", + "route_weight_sha256": "1ad70822e7d93a583d3f7275ace6d385c760b07126b15115030fc0a83c7cc5d9", + "loads": [ + 7, + 13, + 2, + 7, + 4, + 3, + 3, + 5, + 12, + 4, + 8, + 2, + 2, + 4, + 17, + 5, + 4, + 3, + 1, + 9, + 2, + 12, + 6, + 2, + 6, + 4, + 3, + 5, + 5, + 1, + 1, + 6, + 1, + 2, + 11, + 19, + 1, + 1, + 7, + 7, + 0, + 2, + 12, + 2, + 7, + 3, + 11, + 11, + 5, + 3, + 4, + 9, + 6, + 6, + 2, + 1, + 5, + 8, + 4, + 13, + 14, + 8, + 12, + 19 + ], + "weighted_loads": [ + 0.7542999163269997, + 1.1174427270889282, + 0.048653895035386086, + 2.0861158035695553, + 0.21165605634450912, + 0.2460729032754898, + 0.09174344129860401, + 0.22184811532497406, + 1.03467739187181, + 0.43363795056939125, + 0.3764166198670864, + 0.2469712719321251, + 0.11496945843100548, + 0.1445384647231549, + 0.8858240656554699, + 0.38064419105648994, + 0.28441666811704636, + 0.210244822781533, + 0.0013836058788001537, + 1.1864518206566572, + 0.28810155391693115, + 0.831894813105464, + 0.6054800748825073, + 0.2064119055867195, + 0.2627546526491642, + 0.2614734098315239, + 0.2499124332680367, + 0.7929407730698586, + 0.2536238133907318, + 0.08115161210298538, + 0.033937420696020126, + 0.34163745306432247, + 0.03576144948601723, + 0.08132809400558472, + 0.4612287972122431, + 2.1004363065585494, + 0.033089350908994675, + 0.041833169758319855, + 0.32501765713095665, + 0.5414345525205135, + 0.0, + 0.15483983233571053, + 1.2862540818750858, + 0.2079236414283514, + 0.9529592096805573, + 0.24988821521401405, + 0.875736789777875, + 0.6016452442854643, + 0.5295298360288143, + 0.2289164811372757, + 0.3536345064640045, + 0.9801644273102283, + 0.7276846207678318, + 0.4043884768616408, + 0.07348433136940002, + 0.05971652269363403, + 0.4148321636021137, + 0.3579823561012745, + 0.5445284955203533, + 0.6508554797619581, + 0.9364235056564212, + 0.6144448332488537, + 0.9678012505173683, + 1.284014230594039 + ], + "unique_experts": 63, + "load_cv": 0.7563389525279728, + "normalized_load_entropy": 0.9344234054928285, + "max_load_share": 0.049479166666666664 + } + }, + "s0_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "8568bbe1a391951a4f4ae05a7783f62504fd577700ee7a87e8300aedacf1c6e2", + "route_weight_sha256": "ae1eaf568f27808e6670b20f3d50fc04c621d1f457aad14bf219006633b9425d", + "loads": [ + 3, + 2, + 1, + 4, + 3, + 2, + 3, + 2, + 3, + 3, + 1, + 2, + 2, + 1, + 5, + 4, + 2, + 2, + 1, + 3, + 0, + 1, + 5, + 2, + 0, + 3, + 3, + 2, + 0, + 1, + 0, + 4, + 0, + 2, + 2, + 2, + 0, + 0, + 1, + 3, + 0, + 2, + 3, + 0, + 4, + 4, + 3, + 4, + 3, + 2, + 3, + 0, + 5, + 2, + 2, + 2, + 2, + 1, + 2, + 2, + 3, + 3, + 2, + 4 + ], + "weighted_loads": [ + 0.2456585094332695, + 0.1205410361289978, + 0.022192036733031273, + 0.3274257779121399, + 0.18158164247870445, + 0.10073352232575417, + 0.11371679976582527, + 0.10961718484759331, + 0.2893380969762802, + 0.3014889024198055, + 0.06799691915512085, + 0.24515626579523087, + 0.12583468109369278, + 0.08606019616127014, + 0.2920725792646408, + 0.3432181626558304, + 0.23630409687757492, + 0.2349807806313038, + 0.035161737352609634, + 0.31673654168844223, + 0.0, + 0.037068407982587814, + 0.5654929652810097, + 0.18289761245250702, + 0.0, + 0.22387908026576042, + 0.3094727098941803, + 0.07851890474557877, + 0.0, + 0.06462083011865616, + 0.0, + 0.31660082563757896, + 0.0, + 0.06884657964110374, + 0.0903325006365776, + 0.10078100115060806, + 0.0, + 0.0, + 0.09793411940336227, + 0.1481429822742939, + 0.0, + 0.15330574475228786, + 0.2979024536907673, + 0.0, + 0.32305648550391197, + 0.3065863214433193, + 0.24379991739988327, + 0.19831403903663158, + 0.4859614707529545, + 0.17918584123253822, + 0.31415632739663124, + 0.0, + 0.5720578469336033, + 0.2112060859799385, + 0.08292365819215775, + 0.08665179274976254, + 0.19523907825350761, + 0.04311944916844368, + 0.4379580169916153, + 0.10820174962282181, + 0.16560861468315125, + 0.2499389946460724, + 0.054215021431446075, + 0.24651901796460152 + ], + "unique_experts": 54, + "load_cv": 0.6255432421712243, + "normalized_load_entropy": 0.9381934071009964, + "max_load_share": 0.036231884057971016 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "c0d629e330cb1481105ef4432ca6358080e809fe3b3c9ce2175a3c3b1ed80cfa", + "route_weight_sha256": "6b02e63a83f89167e02c2ba74a153af32321d899656c5d13cbe80b3ad68db148", + "loads": [ + 3, + 12, + 1, + 5, + 3, + 2, + 3, + 3, + 7, + 3, + 4, + 2, + 3, + 2, + 10, + 4, + 3, + 2, + 1, + 7, + 2, + 10, + 5, + 2, + 2, + 3, + 3, + 4, + 3, + 1, + 0, + 4, + 0, + 2, + 7, + 18, + 0, + 0, + 5, + 3, + 0, + 2, + 10, + 0, + 4, + 4, + 6, + 8, + 4, + 2, + 3, + 7, + 5, + 2, + 2, + 2, + 2, + 10, + 10, + 7, + 14, + 5, + 9, + 16 + ], + "weighted_loads": [ + 0.2456585094332695, + 1.0700721554458141, + 0.022192036733031273, + 1.0520060062408447, + 0.18158164247870445, + 0.10073352232575417, + 0.11371679976582527, + 0.1564635969698429, + 0.5068930871784687, + 0.3014889024198055, + 0.19306433573365211, + 0.24515626579523087, + 0.15749168023467064, + 0.11167677864432335, + 0.4937700815498829, + 0.3432181626558304, + 0.26659420505166054, + 0.2349807806313038, + 0.035161737352609634, + 1.0594301894307137, + 0.2908031791448593, + 0.7417076490819454, + 0.5654929652810097, + 0.18289761245250702, + 0.09958060458302498, + 0.22387908026576042, + 0.3094727098941803, + 0.3667154610157013, + 0.28648983873426914, + 0.06462083011865616, + 0.0, + 0.31660082563757896, + 0.0, + 0.06884657964110374, + 0.3140188828110695, + 2.298735464923084, + 0.0, + 0.0, + 0.29362296499311924, + 0.1481429822742939, + 0.0, + 0.15330574475228786, + 0.9603494815528393, + 0.0, + 0.32305648550391197, + 0.3065863214433193, + 0.333485284820199, + 0.465667312964797, + 0.511600973084569, + 0.17918584123253822, + 0.31415632739663124, + 0.6350779552012682, + 0.5720578469336033, + 0.2112060859799385, + 0.08292365819215775, + 0.08665179274976254, + 0.19523907825350761, + 0.4804000146687031, + 0.8028972968459129, + 0.2886773254722357, + 1.0629571257159114, + 0.33569540083408356, + 0.7257006075233221, + 1.087531989440322 + ], + "unique_experts": 58, + "load_cv": 0.8579691784155834, + "normalized_load_entropy": 0.9178573217824805, + "max_load_share": 0.0625 + } + }, + "s1_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "66c7a1dea6572db6f2f6d590e343005aac0c28945c61bc002dc7f40c9b94e6cd", + "route_weight_sha256": "4721ff57b8fb1a334ccd40fb4737490b5a0deedec372ec708401ce6916365508", + "loads": [ + 3, + 3, + 1, + 4, + 3, + 1, + 2, + 2, + 3, + 3, + 1, + 3, + 2, + 1, + 4, + 4, + 2, + 2, + 1, + 3, + 0, + 1, + 6, + 2, + 0, + 3, + 2, + 1, + 0, + 1, + 0, + 5, + 0, + 2, + 2, + 2, + 1, + 0, + 1, + 4, + 0, + 2, + 3, + 0, + 4, + 4, + 3, + 4, + 4, + 2, + 3, + 0, + 5, + 2, + 2, + 2, + 1, + 1, + 2, + 3, + 2, + 3, + 1, + 4 + ], + "weighted_loads": [ + 0.25095051527023315, + 0.15868308581411839, + 0.02497478388249874, + 0.3519997000694275, + 0.18049101904034615, + 0.05934305489063263, + 0.08692053705453873, + 0.10512755438685417, + 0.3083002045750618, + 0.2937576584517956, + 0.06913775205612183, + 0.2861688956618309, + 0.12960899248719215, + 0.08764458447694778, + 0.28071465715765953, + 0.35393425077199936, + 0.23372594267129898, + 0.23734135925769806, + 0.03465043380856514, + 0.3162102475762367, + 0.0, + 0.03606870770454407, + 0.6362305320799351, + 0.18480484187602997, + 0.0, + 0.206970002502203, + 0.2686937563121319, + 0.04300509765744209, + 0.0, + 0.07285670191049576, + 0.0, + 0.3541945107281208, + 0.0, + 0.07449226453900337, + 0.0885583758354187, + 0.09758305549621582, + 0.03129217401146889, + 0.0, + 0.10482976585626602, + 0.17662127315998077, + 0.0, + 0.15187540277838707, + 0.30114683136343956, + 0.0, + 0.31433213129639626, + 0.30238003842532635, + 0.251067154109478, + 0.18088899366557598, + 0.5222113337367773, + 0.17099471390247345, + 0.32685500755906105, + 0.0, + 0.5530827790498734, + 0.2063295766711235, + 0.09327005594968796, + 0.09118638001382351, + 0.16142551600933075, + 0.030964013189077377, + 0.42030754685401917, + 0.14406344667077065, + 0.11713375896215439, + 0.2758074440062046, + 0.022391945123672485, + 0.22499161213636398 + ], + "unique_experts": 55, + "load_cv": 0.6620825380000244, + "normalized_load_entropy": 0.9353064994614274, + "max_load_share": 0.043478260869565216 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "cb491dff08f0047cb639e916a4d03a705628ee3e163949d41236610b025be5b4", + "route_weight_sha256": "9a23b1e5f17b6c699f93ecaa4b6ee2410a552537f9f47aa96acf2f135cd3bc30", + "loads": [ + 7, + 14, + 2, + 7, + 5, + 2, + 2, + 5, + 13, + 4, + 8, + 3, + 3, + 3, + 15, + 5, + 5, + 2, + 1, + 9, + 2, + 12, + 7, + 2, + 5, + 4, + 2, + 4, + 5, + 1, + 1, + 7, + 0, + 2, + 11, + 20, + 1, + 1, + 7, + 7, + 0, + 2, + 13, + 1, + 7, + 4, + 10, + 11, + 6, + 3, + 4, + 9, + 6, + 5, + 2, + 2, + 5, + 8, + 4, + 14, + 13, + 8, + 13, + 18 + ], + "weighted_loads": [ + 0.7715614438056946, + 1.1642478499561548, + 0.050446948036551476, + 1.1412044279277325, + 0.23393601924180984, + 0.20025849342346191, + 0.08692053705453873, + 0.21571454033255577, + 1.0877549070864916, + 0.4108511693775654, + 0.3736222945153713, + 0.2861688956618309, + 0.15737471915781498, + 0.1374155841767788, + 0.7833700627088547, + 0.38619884476065636, + 0.32636028341948986, + 0.23734135925769806, + 0.03465043380856514, + 1.0752232391387224, + 0.2749953120946884, + 0.8498581480234861, + 0.6747789196670055, + 0.18480484187602997, + 0.22909095510840416, + 0.2571568936109543, + 0.2686937563121319, + 0.7319497056305408, + 0.3109481707215309, + 0.07285670191049576, + 0.033937420696020126, + 0.3971342947334051, + 0.0, + 0.07449226453900337, + 0.4571068976074457, + 2.0878672963008285, + 0.03129217401146889, + 0.041833169758319855, + 0.38575807586312294, + 0.5312368124723434, + 0.0, + 0.15187540277838707, + 1.4047538172453642, + 0.18164484202861786, + 0.9647558964788914, + 0.30238003842532635, + 0.862319391220808, + 0.5744147431105375, + 0.5908984821289778, + 0.21397003531455994, + 0.35332122072577477, + 0.9908505417406559, + 0.7286590039730072, + 0.38955513574182987, + 0.09327005594968796, + 0.09118638001382351, + 0.41463877633213997, + 0.33104470558464527, + 0.5311822406947613, + 0.624247532337904, + 0.8582699587568641, + 0.6388868875801563, + 1.0593940168619156, + 1.3784533012658358 + ], + "unique_experts": 62, + "load_cv": 0.7654655446197433, + "normalized_load_entropy": 0.931256351853734, + "max_load_share": 0.052083333333333336 + } + }, + "s0_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "5b0a464864c6b3d141ba4f31629edb0e888eddc59e038cfcd3c83e0a142bf721", + "route_weight_sha256": "6bbdc8df8550fb26725de4b96bf74cd2901b6038763a43cc95a7cbaba4993b13", + "loads": [ + 3, + 2, + 1, + 4, + 3, + 2, + 2, + 2, + 3, + 3, + 1, + 3, + 2, + 1, + 4, + 4, + 2, + 2, + 1, + 3, + 0, + 1, + 5, + 2, + 0, + 3, + 2, + 1, + 0, + 1, + 0, + 5, + 0, + 2, + 2, + 2, + 2, + 0, + 1, + 3, + 0, + 2, + 3, + 0, + 4, + 4, + 3, + 4, + 3, + 2, + 3, + 0, + 5, + 2, + 2, + 2, + 2, + 1, + 2, + 3, + 3, + 3, + 3, + 2 + ], + "weighted_loads": [ + 0.25769776850938797, + 0.11260224506258965, + 0.022192373871803284, + 0.3487345576286316, + 0.17835179716348648, + 0.10576317086815834, + 0.07895717024803162, + 0.10898987948894501, + 0.30181264132261276, + 0.3072839416563511, + 0.06612887233495712, + 0.26893286034464836, + 0.11849966645240784, + 0.08278069645166397, + 0.2801649458706379, + 0.31829238682985306, + 0.22969194501638412, + 0.23558979481458664, + 0.03292720764875412, + 0.31028856709599495, + 0.0, + 0.0381256528198719, + 0.5476197600364685, + 0.18029437959194183, + 0.0, + 0.2236105427145958, + 0.26219049096107483, + 0.039346784353256226, + 0.0, + 0.0659407526254654, + 0.0, + 0.35644304752349854, + 0.0, + 0.07125558704137802, + 0.09031601995229721, + 0.1048634722828865, + 0.06390278972685337, + 0.0, + 0.09167666733264923, + 0.14883874356746674, + 0.0, + 0.15050246380269527, + 0.30784523859620094, + 0.0, + 0.32146846503019333, + 0.3076138496398926, + 0.2563484460115433, + 0.1781066097319126, + 0.4849713332951069, + 0.17328282818198204, + 0.3122871294617653, + 0.0, + 0.5580042451620102, + 0.21759017556905746, + 0.07655615359544754, + 0.08087750151753426, + 0.19428157061338425, + 0.04477902874350548, + 0.43804048001766205, + 0.15389010310173035, + 0.17157245054841042, + 0.2585790082812309, + 0.07733999006450176, + 0.1409146562218666 + ], + "unique_experts": 55, + "load_cv": 0.6092130306372088, + "normalized_load_entropy": 0.9421126250935525, + "max_load_share": 0.036231884057971016 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "f66d5858023f1465228604c2d0b3315eed7dd42be4079b34cd957a4289df36d4", + "route_weight_sha256": "e36847b2d05875ecb0395049fb008bc2972cccca28b1a0ee753658c7a6d08d4f", + "loads": [ + 3, + 12, + 1, + 5, + 3, + 2, + 3, + 3, + 7, + 3, + 6, + 4, + 3, + 2, + 8, + 4, + 3, + 2, + 1, + 7, + 2, + 11, + 5, + 2, + 2, + 3, + 2, + 3, + 3, + 1, + 0, + 5, + 0, + 2, + 7, + 17, + 2, + 0, + 4, + 3, + 0, + 2, + 9, + 0, + 4, + 4, + 6, + 9, + 4, + 2, + 4, + 6, + 5, + 2, + 2, + 2, + 2, + 8, + 11, + 8, + 15, + 5, + 9, + 13 + ], + "weighted_loads": [ + 0.25769776850938797, + 1.062133364379406, + 0.022192373871803284, + 1.0733147859573364, + 0.17835179716348648, + 0.10576317086815834, + 0.11384133249521255, + 0.1558362916111946, + 0.5359394811093807, + 0.3072839416563511, + 0.30074556916952133, + 0.3042697310447693, + 0.14806129969656467, + 0.10962701588869095, + 0.4570023659616709, + 0.31829238682985306, + 0.2606544550508261, + 0.23558979481458664, + 0.03292720764875412, + 1.0741734690964222, + 0.30084089934825897, + 1.0402950160205364, + 0.5476197600364685, + 0.18029437959194183, + 0.09673673287034035, + 0.2236105427145958, + 0.26219049096107483, + 0.32380806654691696, + 0.28710925951600075, + 0.0659407526254654, + 0.0, + 0.35644304752349854, + 0.0, + 0.07125558704137802, + 0.3140024021267891, + 2.3113644188269973, + 0.06390278972685337, + 0.0, + 0.19617503695189953, + 0.14883874356746674, + 0.0, + 0.15050246380269527, + 0.8822041451931, + 0.0, + 0.32146846503019333, + 0.3076138496398926, + 0.34648886136710644, + 0.47680193558335304, + 0.5106108356267214, + 0.17328282818198204, + 0.32953920774161816, + 0.5440194122493267, + 0.5580042451620102, + 0.21759017556905746, + 0.07655615359544754, + 0.08087750151753426, + 0.19428157061338425, + 0.4027758873999119, + 0.9325296953320503, + 0.3339912500232458, + 1.1283989464864135, + 0.3443354144692421, + 0.7154122665524483, + 0.6485965810716152 + ], + "unique_experts": 59, + "load_cv": 0.8155510142168443, + "normalized_load_entropy": 0.9248794519180431, + "max_load_share": 0.059027777777777776 + } + }, + "s1_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "06e52312e12974fde5f4b728e678e0630b097fc175f13ef9cce6919a8f7d7b68", + "route_weight_sha256": "bcbc48e9bd900dfc06fccf561a0d50a6365caa7c4fd00d9424522b51d4386de9", + "loads": [ + 3, + 3, + 1, + 4, + 3, + 2, + 2, + 2, + 3, + 3, + 1, + 3, + 2, + 1, + 4, + 4, + 2, + 2, + 1, + 3, + 0, + 1, + 5, + 2, + 0, + 3, + 2, + 1, + 0, + 1, + 0, + 5, + 0, + 2, + 2, + 2, + 1, + 0, + 1, + 3, + 0, + 2, + 3, + 1, + 4, + 3, + 3, + 4, + 4, + 2, + 3, + 0, + 5, + 2, + 2, + 2, + 2, + 0, + 2, + 3, + 3, + 3, + 2, + 3 + ], + "weighted_loads": [ + 0.2705954313278198, + 0.15099230408668518, + 0.02489030547440052, + 0.36924172192811966, + 0.18000105023384094, + 0.09910424798727036, + 0.08464790135622025, + 0.10311788320541382, + 0.31751780211925507, + 0.2935525178909302, + 0.06879054754972458, + 0.28298652172088623, + 0.12807868793606758, + 0.08550844341516495, + 0.286032821983099, + 0.34775039553642273, + 0.23186776041984558, + 0.23758936673402786, + 0.033961232751607895, + 0.31077832356095314, + 0.0, + 0.0348118357360363, + 0.5843888632953167, + 0.18311597406864166, + 0.0, + 0.20041493326425552, + 0.25827835500240326, + 0.04011475667357445, + 0.0, + 0.06918508559465408, + 0.0, + 0.354545421898365, + 0.0, + 0.07623857259750366, + 0.0921417586505413, + 0.10208959877490997, + 0.03261170908808708, + 0.0, + 0.09802588075399399, + 0.1454724818468094, + 0.0, + 0.15024623647332191, + 0.3034563586115837, + 0.026336174458265305, + 0.3193646930158138, + 0.26253461092710495, + 0.2594200521707535, + 0.1616107039153576, + 0.5274961944669485, + 0.16123388335108757, + 0.32872410118579865, + 0.0, + 0.5413404069840908, + 0.21114397794008255, + 0.0890982635319233, + 0.08778820931911469, + 0.19076398760080338, + 0.0, + 0.41816186904907227, + 0.15042348206043243, + 0.15834014117717743, + 0.2656230814754963, + 0.048048293218016624, + 0.16260644793510437 + ], + "unique_experts": 55, + "load_cv": 0.6147046394332897, + "normalized_load_entropy": 0.9412009252117126, + "max_load_share": 0.036231884057971016 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "17227cfa9cb87157aa77a4457a1a53b464d8a3a4f5077686a50dd59af2e8555e", + "route_weight_sha256": "a01c5852b3777773ab28bc917628ac29b86f748a5a63aa25731b56e6fbcee0ac", + "loads": [ + 7, + 14, + 2, + 6, + 5, + 3, + 2, + 5, + 13, + 4, + 10, + 4, + 3, + 3, + 12, + 5, + 5, + 2, + 1, + 9, + 2, + 13, + 6, + 2, + 5, + 4, + 2, + 4, + 5, + 1, + 1, + 7, + 1, + 2, + 11, + 20, + 1, + 1, + 6, + 6, + 0, + 2, + 12, + 2, + 7, + 3, + 10, + 12, + 6, + 3, + 5, + 8, + 6, + 5, + 2, + 2, + 6, + 7, + 5, + 14, + 15, + 8, + 13, + 16 + ], + "weighted_loads": [ + 0.7912063598632812, + 1.1565570682287216, + 0.050362469628453255, + 1.1258246004581451, + 0.23324916698038578, + 0.24001968652009964, + 0.08464790135622025, + 0.21370486915111542, + 1.1123624127358198, + 0.4106460288167, + 0.4871299937367439, + 0.3180810697376728, + 0.1544861663132906, + 0.13729756884276867, + 0.7135489154607058, + 0.3800149895250797, + 0.33029182255268097, + 0.23758936673402786, + 0.033961232751607895, + 1.0823758374899626, + 0.27535566687583923, + 1.1308715511113405, + 0.6229372508823872, + 0.18311597406864166, + 0.22868118435144424, + 0.2506018243730068, + 0.25827835500240326, + 0.7235320620238781, + 0.3164256252348423, + 0.06918508559465408, + 0.033937420696020126, + 0.39748520590364933, + 0.029791558161377907, + 0.07623857259750366, + 0.4606902804225683, + 2.0726733012124896, + 0.03261170908808708, + 0.041833169758319855, + 0.2609245404601097, + 0.5000880211591721, + 0.0, + 0.15024623647332191, + 1.348777774721384, + 0.20798101648688316, + 0.969788458198309, + 0.26253461092710495, + 0.8706722892820835, + 0.5833736639469862, + 0.596183342859149, + 0.20420920476317406, + 0.3729817122220993, + 0.8966268561780453, + 0.7169166319072247, + 0.3943695370107889, + 0.0890982635319233, + 0.08778820931911469, + 0.4439772479236126, + 0.2983883246779442, + 0.6349096782505512, + 0.634178876876831, + 0.9454494332894683, + 0.628702525049448, + 1.0330791864544153, + 1.0435882825404406 + ], + "unique_experts": 63, + "load_cv": 0.7424387367168942, + "normalized_load_entropy": 0.9362607392576316, + "max_load_share": 0.052083333333333336 + } + }, + "s0_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "e8d8f5f96d56d7be7d48d4ef1a04ac791bca48560fcbe7b3ef845c2ce9f84e85", + "route_weight_sha256": "2ba87580e8cf628818343ae6e77a8f21e4663eb1a4fc7864707a3482966850c7", + "loads": [ + 3, + 2, + 1, + 4, + 3, + 2, + 2, + 2, + 3, + 3, + 1, + 3, + 2, + 1, + 4, + 4, + 2, + 2, + 1, + 3, + 0, + 1, + 5, + 2, + 0, + 3, + 2, + 2, + 0, + 1, + 0, + 5, + 0, + 2, + 2, + 2, + 2, + 0, + 1, + 3, + 0, + 2, + 3, + 0, + 4, + 4, + 3, + 4, + 3, + 2, + 3, + 0, + 5, + 2, + 2, + 2, + 2, + 1, + 2, + 2, + 3, + 3, + 3, + 2 + ], + "weighted_loads": [ + 0.2604915723204613, + 0.112172931432724, + 0.02230938710272312, + 0.34543173387646675, + 0.1773848757147789, + 0.10577540472149849, + 0.08117788285017014, + 0.10817452892661095, + 0.29914896935224533, + 0.3019981384277344, + 0.06699474900960922, + 0.2674674950540066, + 0.11907985433936119, + 0.08388537913560867, + 0.2730711102485657, + 0.3213573321700096, + 0.22569267451763153, + 0.23545818030834198, + 0.03518213331699371, + 0.30976320058107376, + 0.0, + 0.03813562169671059, + 0.546175342053175, + 0.18310316652059555, + 0.0, + 0.2158976048231125, + 0.26561712846159935, + 0.07828015834093094, + 0.0, + 0.06591667979955673, + 0.0, + 0.3527654893696308, + 0.0, + 0.07121548056602478, + 0.09244045987725258, + 0.1020607240498066, + 0.06291513703763485, + 0.0, + 0.09030507504940033, + 0.1502343900501728, + 0.0, + 0.1537166703492403, + 0.3106575012207031, + 0.0, + 0.32879840582609177, + 0.3095115050673485, + 0.25312769412994385, + 0.1715774815529585, + 0.49063771218061447, + 0.17756403237581253, + 0.3155680187046528, + 0.0, + 0.5533752515912056, + 0.2161589302122593, + 0.07669276371598244, + 0.08039810881018639, + 0.19474675506353378, + 0.04034746438264847, + 0.43658988177776337, + 0.11553231999278069, + 0.16861766949295998, + 0.26425620540976524, + 0.07746928930282593, + 0.13817299157381058 + ], + "unique_experts": 55, + "load_cv": 0.603671466656769, + "normalized_load_entropy": 0.9430243249753925, + "max_load_share": 0.036231884057971016 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "9b8ee15f6417635b95d9ec06875ed8649832969219153c10d09ada44a6ea77bd", + "route_weight_sha256": "c6750c82edca7a8e7d1874bd667ed8fec8f01415b71f0c5b6d50a6b8c5678151", + "loads": [ + 4, + 12, + 1, + 6, + 3, + 2, + 2, + 3, + 8, + 3, + 4, + 3, + 2, + 2, + 8, + 5, + 2, + 2, + 1, + 7, + 2, + 10, + 5, + 2, + 3, + 3, + 2, + 4, + 3, + 1, + 0, + 5, + 0, + 3, + 7, + 16, + 2, + 0, + 5, + 3, + 0, + 2, + 9, + 0, + 4, + 4, + 7, + 9, + 5, + 2, + 4, + 6, + 5, + 2, + 2, + 2, + 2, + 8, + 10, + 7, + 16, + 5, + 9, + 12 + ], + "weighted_loads": [ + 0.5555873736739159, + 1.0617040507495403, + 0.02230938710272312, + 1.1027925051748753, + 0.1773848757147789, + 0.10577540472149849, + 0.08117788285017014, + 0.15502094104886055, + 0.5844758488237858, + 0.3019981384277344, + 0.1920621655881405, + 0.2674674950540066, + 0.11907985433936119, + 0.10965337976813316, + 0.44982496835291386, + 0.36799221113324165, + 0.22569267451763153, + 0.23545818030834198, + 0.03518213331699371, + 1.101596973836422, + 0.24312760680913925, + 0.9110273979604244, + 0.546175342053175, + 0.18310316652059555, + 0.1255759745836258, + 0.2158976048231125, + 0.26561712846159935, + 0.3658084124326706, + 0.2576146125793457, + 0.06591667979955673, + 0.0, + 0.3527654893696308, + 0.0, + 0.1195804812014103, + 0.31612684205174446, + 2.244860759936273, + 0.06291513703763485, + 0.0, + 0.2544459905475378, + 0.1502343900501728, + 0.0, + 0.1537166703492403, + 0.8915380574762821, + 0.0, + 0.32879840582609177, + 0.3095115050673485, + 0.36907880939543247, + 0.46918814815580845, + 0.5424901433289051, + 0.17756403237581253, + 0.33311888575553894, + 0.5276691429316998, + 0.5533752515912056, + 0.2161589302122593, + 0.07669276371598244, + 0.08039810881018639, + 0.19474675506353378, + 0.3965182490646839, + 0.801529161632061, + 0.2972422707825899, + 1.130379625596106, + 0.3500126115977764, + 0.7101660165935755, + 0.598026379942894 + ], + "unique_experts": 59, + "load_cv": 0.7983393257333286, + "normalized_load_entropy": 0.9266121555524266, + "max_load_share": 0.05555555555555555 + } + }, + "s1_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "11134b7ed767a9e3fb25ac2b33a4c033042bba786620fc6b335b71cabebba560", + "route_weight_sha256": "0fc99372e3efb357869187bf222ebfc9e65526fef66709a325424c10f73c7d46", + "loads": [ + 3, + 3, + 1, + 4, + 3, + 2, + 2, + 2, + 3, + 3, + 1, + 3, + 2, + 1, + 4, + 4, + 2, + 2, + 1, + 3, + 0, + 1, + 6, + 2, + 0, + 3, + 2, + 1, + 0, + 1, + 0, + 5, + 0, + 2, + 2, + 2, + 1, + 0, + 1, + 4, + 0, + 2, + 3, + 1, + 4, + 3, + 3, + 4, + 3, + 2, + 3, + 0, + 5, + 2, + 3, + 2, + 1, + 0, + 2, + 3, + 2, + 3, + 2, + 3 + ], + "weighted_loads": [ + 0.2684966176748276, + 0.15158767998218536, + 0.025498196482658386, + 0.36739446967840195, + 0.17972147837281227, + 0.09994253516197205, + 0.08642219379544258, + 0.10330541804432869, + 0.31663987785577774, + 0.2909991033375263, + 0.06944619864225388, + 0.28384293615818024, + 0.12757675349712372, + 0.08801738172769547, + 0.2770630791783333, + 0.34288761019706726, + 0.23311986774206161, + 0.23889057338237762, + 0.034298352897167206, + 0.31208645924925804, + 0.0, + 0.034940969198942184, + 0.6195862777531147, + 0.18423466384410858, + 0.0, + 0.2011527568101883, + 0.25681615248322487, + 0.03991835191845894, + 0.0, + 0.06998766958713531, + 0.0, + 0.35167666524648666, + 0.0, + 0.07628795504570007, + 0.0914759524166584, + 0.09928324073553085, + 0.032565295696258545, + 0.0, + 0.09781448543071747, + 0.17887594923377037, + 0.0, + 0.15259645506739616, + 0.3041841350495815, + 0.0262610986828804, + 0.32417987287044525, + 0.26238757371902466, + 0.2556503042578697, + 0.1597989983856678, + 0.5083587653934956, + 0.16389186680316925, + 0.3308879993855953, + 0.0, + 0.5391260981559753, + 0.21038946136832237, + 0.11109056323766708, + 0.08919835463166237, + 0.1581258922815323, + 0.0, + 0.4168556332588196, + 0.15212231129407883, + 0.11714053153991699, + 0.2675721235573292, + 0.04877716861665249, + 0.1583552360534668 + ], + "unique_experts": 55, + "load_cv": 0.636197219352115, + "normalized_load_entropy": 0.9389060767456617, + "max_load_share": 0.043478260869565216 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "794c9322635ad42ab55bbb771e8be47b83d343ff8316d9f91ed0110848cb7aa3", + "route_weight_sha256": "8ff34a10fa1097e1d9e9ee402935253d37a7d39285d76a8bc38b3359b957abc0", + "loads": [ + 8, + 14, + 2, + 7, + 5, + 3, + 2, + 5, + 14, + 4, + 8, + 3, + 2, + 3, + 12, + 6, + 5, + 2, + 1, + 9, + 2, + 12, + 7, + 2, + 5, + 4, + 2, + 4, + 5, + 1, + 1, + 7, + 0, + 3, + 11, + 18, + 1, + 1, + 8, + 7, + 0, + 2, + 12, + 2, + 7, + 3, + 11, + 12, + 6, + 3, + 5, + 8, + 6, + 5, + 3, + 2, + 5, + 7, + 4, + 14, + 15, + 8, + 13, + 15 + ], + "weighted_loads": [ + 1.0583205670118332, + 1.1571524441242218, + 0.05097036063671112, + 1.1590506434440613, + 0.23280546069145203, + 0.24085797369480133, + 0.08642219379544258, + 0.2138924039900303, + 1.15774348936975, + 0.4080926142632961, + 0.37393074110150337, + 0.28384293615818024, + 0.12757675349712372, + 0.13910049758851528, + 0.7043026592582464, + 0.41024598851799965, + 0.330108642578125, + 0.23889057338237762, + 0.034298352897167206, + 1.1116270329803228, + 0.23303192108869553, + 0.9582917261868715, + 0.6581346653401852, + 0.18423466384410858, + 0.22872857749462128, + 0.2513396479189396, + 0.25681615248322487, + 0.7243892587721348, + 0.2792350947856903, + 0.06998766958713531, + 0.033937420696020126, + 0.394616449251771, + 0.0, + 0.11561158671975136, + 0.4600244741886854, + 1.9696470191702247, + 0.032565295696258545, + 0.041833169758319855, + 0.35336892679333687, + 0.533491488546133, + 0.0, + 0.15259645506739616, + 1.3548590056598186, + 0.20790594071149826, + 0.9746036380529404, + 0.26238757371902466, + 0.8933353032916784, + 0.5851354598999023, + 0.6015215627849102, + 0.20686718821525574, + 0.3754458501935005, + 0.85847332701087, + 0.7147023230791092, + 0.39361502043902874, + 0.11109056323766708, + 0.08919835463166237, + 0.4113391526043415, + 0.2953181453049183, + 0.5277303270995617, + 0.6610180549323559, + 0.9192686388269067, + 0.6306515671312809, + 1.0396134313195944, + 0.9823023360222578 + ], + "unique_experts": 62, + "load_cv": 0.7276770498572075, + "normalized_load_entropy": 0.9362113804743045, + "max_load_share": 0.046875 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "ordered_topk_exact_tokens": 19, + "set_exact_tokens": 20, + "mean_set_jaccard": 0.9627329192546583, + "mean_token_weighted_tv": 0.009779704532221607, + "aggregate_load_tv": 0.02173913043478261 + }, + "system_bos": { + "tokens": 23, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 13, + "mean_set_jaccard": 0.875776397515528, + "mean_token_weighted_tv": 0.02518971207673135, + "aggregate_load_tv": 0.05797101449275362 + }, + "system_x": { + "tokens": 23, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.9503105590062112, + "mean_token_weighted_tv": 0.01828793695439463, + "aggregate_load_tv": 0.02898550724637681 + }, + "system_period": { + "tokens": 23, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.9161490683229815, + "mean_token_weighted_tv": 0.022270528397158436, + "aggregate_load_tv": 0.050724637681159424 + }, + "bos_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.9130434782608695, + "mean_token_weighted_tv": 0.026835248765090237, + "aggregate_load_tv": 0.036231884057971016 + }, + "bos_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8788819875776398, + "mean_token_weighted_tv": 0.03303666165827409, + "aggregate_load_tv": 0.06521739130434782 + }, + "x_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8881987577639753, + "mean_token_weighted_tv": 0.029447243305975975, + "aggregate_load_tv": 0.06521739130434784 + }, + "x_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.8913043478260869, + "mean_token_weighted_tv": 0.03379916067680587, + "aggregate_load_tv": 0.05797101449275363 + }, + "period_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.9006211180124224, + "mean_token_weighted_tv": 0.02853485423585643, + "aggregate_load_tv": 0.057971014492753624 + }, + "period_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.8944099378881987, + "mean_token_weighted_tv": 0.03408830693882445, + "aggregate_load_tv": 0.05797101449275362 + } + } + }, + "layer_03": { + "layer": 3, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "5ed5f5338ad1bf262bcd2792bd24a82104ca9d614e36406dea64af3fb71014f8", + "route_weight_sha256": "d1b2e57d039d74cc0b4e8fd1b31240bc3a62fb2a4ae85941fd9d5b5737982126", + "loads": [ + 1, + 4, + 2, + 3, + 1, + 0, + 2, + 0, + 2, + 3, + 2, + 2, + 5, + 1, + 4, + 4, + 2, + 4, + 0, + 1, + 2, + 2, + 3, + 0, + 2, + 3, + 1, + 3, + 1, + 0, + 2, + 0, + 1, + 6, + 1, + 1, + 1, + 2, + 3, + 2, + 0, + 2, + 5, + 3, + 1, + 2, + 0, + 0, + 1, + 2, + 9, + 3, + 0, + 3, + 2, + 3, + 0, + 3, + 4, + 1, + 6, + 4, + 4, + 1 + ], + "weighted_loads": [ + 0.0429801419377327, + 0.2184106819331646, + 0.12048136815428734, + 0.18088864907622337, + 0.17515484988689423, + 0.0, + 0.25161097943782806, + 0.0, + 0.2334124594926834, + 0.2641893997788429, + 0.18749515525996685, + 0.10363629460334778, + 0.3893388994038105, + 0.060613151639699936, + 0.5210277400910854, + 0.13206272013485432, + 0.12247015908360481, + 0.6975597813725471, + 0.0, + 0.033137161284685135, + 0.11367158591747284, + 0.2127067670226097, + 0.19805283099412918, + 0.0, + 0.12290110252797604, + 0.28631511330604553, + 0.07854710519313812, + 0.26569193974137306, + 0.16691841185092926, + 0.0, + 0.11689378321170807, + 0.0, + 0.10794408619403839, + 0.5729026757180691, + 0.08293183892965317, + 0.16476811468601227, + 0.040365416556596756, + 0.1721622794866562, + 0.20072123408317566, + 0.1393415480852127, + 0.0, + 0.39777157083153725, + 0.15126712806522846, + 0.3151017725467682, + 0.09932086616754532, + 0.24679197371006012, + 0.0, + 0.0, + 0.06175079941749573, + 0.17253369092941284, + 0.8913676477968693, + 0.8832870870828629, + 0.0, + 0.18977287039160728, + 0.07515184581279755, + 0.27674055099487305, + 0.0, + 0.09937079809606075, + 0.191336365416646, + 0.05387301743030548, + 0.34556006640195847, + 0.26119815185666084, + 0.43805187568068504, + 0.0499546118080616 + ], + "unique_experts": 53, + "load_cv": 0.8083527401382227, + "normalized_load_entropy": 0.9153435465471992, + "max_load_share": 0.06521739130434782 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "b7dc515274052bd1cbdbd8c1dac094883e36d2f7f40117fab7dd2552e7269718", + "route_weight_sha256": "2cd60ac6de577db66b9388b599e4570f0d02d444a567e2b114e93db24e1ca4a1", + "loads": [ + 10, + 4, + 2, + 14, + 3, + 3, + 2, + 8, + 2, + 9, + 3, + 3, + 7, + 6, + 10, + 4, + 2, + 4, + 0, + 1, + 4, + 5, + 8, + 1, + 2, + 5, + 1, + 10, + 1, + 3, + 3, + 0, + 1, + 6, + 10, + 1, + 1, + 2, + 3, + 2, + 0, + 3, + 14, + 3, + 1, + 2, + 17, + 0, + 9, + 12, + 9, + 3, + 1, + 3, + 6, + 3, + 0, + 4, + 4, + 1, + 13, + 4, + 8, + 2 + ], + "weighted_loads": [ + 1.2911956831812859, + 0.2184106819331646, + 0.12048136815428734, + 0.8181101568043232, + 0.2038179711671546, + 0.13117358461022377, + 0.25161097943782806, + 1.287053395062685, + 0.2334124594926834, + 0.5521806554170325, + 0.2229848261922598, + 0.10451576643390581, + 0.4013555512065068, + 0.4341549016535282, + 0.9190147817134857, + 0.13206272013485432, + 0.12247015908360481, + 0.6975597813725471, + 0.0, + 0.033137161284685135, + 0.18689117953181267, + 0.5028949603438377, + 0.6042224280536175, + 0.027490869164466858, + 0.12290110252797604, + 0.29995283723110333, + 0.07854710519313812, + 0.5283980742096901, + 0.16691841185092926, + 0.1579284369945526, + 0.16322101652622223, + 0.0, + 0.10794408619403839, + 0.5729026757180691, + 1.1155645996332169, + 0.16476811468601227, + 0.040365416556596756, + 0.1721622794866562, + 0.20072123408317566, + 0.1393415480852127, + 0.0, + 0.4091206770390272, + 0.6950659994035959, + 0.3151017725467682, + 0.09932086616754532, + 0.24679197371006012, + 2.136458847671747, + 0.0, + 0.993369322270155, + 0.7902400232851505, + 0.8913676477968693, + 0.8832870870828629, + 0.014660544693470001, + 0.18977287039160728, + 1.9086988866329193, + 0.27674055099487305, + 0.0, + 0.1121341185644269, + 0.191336365416646, + 0.05387301743030548, + 0.8727998025715351, + 0.26119815185666084, + 0.8800302930176258, + 0.08817411586642265 + ], + "unique_experts": 59, + "load_cv": 0.8810417515085391, + "normalized_load_entropy": 0.9113405605760261, + "max_load_share": 0.059027777777777776 + } + }, + "s1_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "c5b52adb69d989cbcabc2893f8114b6a31e2cff06272ba632ef22573f12b8bb7", + "route_weight_sha256": "9889ef9915f33ad02705ef385c2c9cf2e1a4675d8f7e351182c1cacd7f5139db", + "loads": [ + 2, + 4, + 2, + 3, + 1, + 0, + 2, + 0, + 2, + 3, + 2, + 1, + 5, + 1, + 3, + 4, + 2, + 4, + 0, + 1, + 2, + 2, + 3, + 0, + 2, + 3, + 2, + 3, + 1, + 0, + 2, + 0, + 1, + 6, + 1, + 1, + 1, + 2, + 3, + 2, + 0, + 2, + 5, + 3, + 1, + 2, + 0, + 0, + 1, + 2, + 9, + 3, + 0, + 3, + 2, + 3, + 0, + 3, + 4, + 1, + 6, + 4, + 4, + 1 + ], + "weighted_loads": [ + 0.07886578142642975, + 0.21619725041091442, + 0.11664914712309837, + 0.1724209189414978, + 0.17234063148498535, + 0.0, + 0.2530919834971428, + 0.0, + 0.23537295684218407, + 0.2581056281924248, + 0.19323183596134186, + 0.06668918579816818, + 0.4019290376454592, + 0.05983447656035423, + 0.4691408947110176, + 0.13185937702655792, + 0.12216070666909218, + 0.6984855942428112, + 0.0, + 0.03333389759063721, + 0.11347018927335739, + 0.19911178201436996, + 0.2003060281276703, + 0.0, + 0.12510284967720509, + 0.28575489670038223, + 0.11700648814439774, + 0.2631530500948429, + 0.170160710811615, + 0.0, + 0.11443669348955154, + 0.0, + 0.10878255218267441, + 0.5793986767530441, + 0.0858190506696701, + 0.16503924131393433, + 0.03957487642765045, + 0.17622102051973343, + 0.20672247558832169, + 0.14238321781158447, + 0.0, + 0.3963048383593559, + 0.1506640613079071, + 0.31861061602830887, + 0.10005873441696167, + 0.2505365237593651, + 0.0, + 0.0, + 0.06355809420347214, + 0.17551273852586746, + 0.8709901683032513, + 0.8946201205253601, + 0.0, + 0.19354763068258762, + 0.07808973640203476, + 0.27460744976997375, + 0.0, + 0.09850768186151981, + 0.19323763065040112, + 0.05108674615621567, + 0.3340751454234123, + 0.2625400759279728, + 0.4461860954761505, + 0.049890484660863876 + ], + "unique_experts": 53, + "load_cv": 0.7999947489850773, + "normalized_load_entropy": 0.9168473056025573, + "max_load_share": 0.06521739130434782 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "9ab7e820e071af4c364762e7c4e8583974218b9512ef8a45d09b84b6831e6508", + "route_weight_sha256": "6f98b5f19a07837bc6286de92abbfb11a600d2ac4691551ef9d77949b197621e", + "loads": [ + 15, + 6, + 2, + 15, + 2, + 6, + 2, + 11, + 2, + 12, + 5, + 2, + 9, + 7, + 11, + 5, + 4, + 4, + 1, + 1, + 4, + 8, + 13, + 0, + 4, + 6, + 2, + 6, + 1, + 3, + 3, + 0, + 1, + 8, + 9, + 1, + 1, + 7, + 3, + 3, + 1, + 3, + 19, + 5, + 1, + 5, + 21, + 0, + 11, + 12, + 9, + 9, + 4, + 8, + 6, + 7, + 0, + 4, + 11, + 2, + 19, + 5, + 10, + 7 + ], + "weighted_loads": [ + 1.7039705589413643, + 0.2911515887826681, + 0.11664914712309837, + 0.8759419322013855, + 0.1728810240747407, + 0.27322080731391907, + 0.2530919834971428, + 1.3636435475200415, + 0.23537295684218407, + 0.7254888304742053, + 0.27804810367524624, + 0.06756865762872621, + 0.49088077212218195, + 0.49359212443232536, + 1.0439066588878632, + 0.1806229129433632, + 0.3369911275804043, + 0.6984855942428112, + 0.055603545159101486, + 0.03333389759063721, + 0.18003998696804047, + 0.5718583017587662, + 1.1168928556144238, + 0.0, + 0.2289062086492777, + 0.34262633934849873, + 0.11700648814439774, + 0.3596584666520357, + 0.170160710811615, + 0.14709337055683136, + 0.15603045746684074, + 0.0, + 0.10878255218267441, + 0.6520991437137127, + 0.9990269057452679, + 0.16503924131393433, + 0.03957487642765045, + 0.5923189874738455, + 0.20672247558832169, + 0.19249608367681503, + 0.07550901174545288, + 0.4051028834655881, + 0.8177351653575897, + 0.3929542787373066, + 0.10005873441696167, + 0.49185630306601524, + 2.7013246156275272, + 0.0, + 1.299548901617527, + 0.6446978338062763, + 0.8709901683032513, + 1.674403753131628, + 0.2108014151453972, + 0.9111193139106035, + 1.9798849634826183, + 0.5070367902517319, + 0.0, + 0.10753546096384525, + 0.6809561606496572, + 0.08157637901604176, + 1.1499040964990854, + 0.31258969008922577, + 0.91550088301301, + 0.4592835120856762 + ], + "unique_experts": 60, + "load_cv": 0.8186201126828542, + "normalized_load_entropy": 0.9201758375534849, + "max_load_share": 0.0546875 + } + }, + "s0_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "8df6ba7374bfc2899cde9c066b381ec730ce372510e9bbe569daa90d6af236f7", + "route_weight_sha256": "314e9570bf5c7086a146ac068a16a70d2773ac361ce3d5a13537b3a5315fe236", + "loads": [ + 1, + 4, + 2, + 3, + 1, + 0, + 2, + 0, + 2, + 3, + 2, + 1, + 5, + 1, + 4, + 2, + 2, + 4, + 0, + 1, + 2, + 2, + 3, + 0, + 2, + 3, + 2, + 3, + 1, + 0, + 2, + 0, + 1, + 7, + 1, + 1, + 0, + 2, + 3, + 2, + 1, + 2, + 5, + 3, + 1, + 2, + 0, + 0, + 1, + 2, + 9, + 3, + 0, + 4, + 1, + 3, + 0, + 3, + 4, + 2, + 6, + 4, + 4, + 1 + ], + "weighted_loads": [ + 0.048829223960638046, + 0.21758643724024296, + 0.11113202199339867, + 0.17193898186087608, + 0.18620899319648743, + 0.0, + 0.2498985007405281, + 0.0, + 0.25165750458836555, + 0.24855481833219528, + 0.15820522978901863, + 0.06636666506528854, + 0.4135899245738983, + 0.05774175375699997, + 0.4928666539490223, + 0.06198582798242569, + 0.12386685609817505, + 0.6815209686756134, + 0.0, + 0.029313839972019196, + 0.12309586629271507, + 0.22238093614578247, + 0.1990341581404209, + 0.0, + 0.12220711633563042, + 0.28373827785253525, + 0.11345600709319115, + 0.2354077510535717, + 0.12974435091018677, + 0.0, + 0.10301915928721428, + 0.0, + 0.1081804558634758, + 0.6335062123835087, + 0.07533655315637589, + 0.15350422263145447, + 0.0, + 0.19714386761188507, + 0.2028234861791134, + 0.14015549793839455, + 0.02952900528907776, + 0.3782578743994236, + 0.13567722961306572, + 0.28921278938651085, + 0.09326852113008499, + 0.2481832504272461, + 0.0, + 0.0, + 0.05767316743731499, + 0.19695180654525757, + 0.99367256462574, + 0.8800281435251236, + 0.0, + 0.2344456948339939, + 0.039394788444042206, + 0.2588508054614067, + 0.0, + 0.1007913127541542, + 0.1995769925415516, + 0.09736663475632668, + 0.350827157497406, + 0.2684900090098381, + 0.3861851580440998, + 0.06809380650520325 + ], + "unique_experts": 53, + "load_cv": 0.8248146826163592, + "normalized_load_entropy": 0.9136686408130051, + "max_load_share": 0.06521739130434782 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "5d03b57f9cdede56c931af00afb6a37a6fda29b805a7d5fceadf6596f4360030", + "route_weight_sha256": "c66dd8810e366c517cc1cb6f3d3dc637a9e743221178d8d94453af4507223ff8", + "loads": [ + 11, + 4, + 2, + 14, + 3, + 4, + 2, + 8, + 2, + 8, + 4, + 2, + 6, + 5, + 10, + 2, + 2, + 4, + 1, + 1, + 4, + 5, + 9, + 1, + 2, + 4, + 2, + 10, + 1, + 4, + 3, + 0, + 1, + 7, + 9, + 1, + 0, + 2, + 3, + 2, + 1, + 2, + 15, + 3, + 1, + 2, + 16, + 0, + 11, + 12, + 9, + 3, + 0, + 4, + 4, + 3, + 0, + 3, + 4, + 2, + 13, + 4, + 8, + 3 + ], + "weighted_loads": [ + 1.4387139230966568, + 0.21758643724024296, + 0.11113202199339867, + 0.8024248592555523, + 0.2148721144767478, + 0.17409922927618027, + 0.2498985007405281, + 1.1246728524565697, + 0.25165750458836555, + 0.5143398904474452, + 0.226031094789505, + 0.06724613689584658, + 0.4140686836326495, + 0.4174170643091202, + 0.9068471342325211, + 0.06198582798242569, + 0.12386685609817505, + 0.6815209686756134, + 0.03706119582056999, + 0.029313839972019196, + 0.19486499950289726, + 0.51488196849823, + 0.622145488858223, + 0.027490869164466858, + 0.12220711633563042, + 0.2842701855697669, + 0.11345600709319115, + 0.49811388552188873, + 0.12974435091018677, + 0.2088557966053486, + 0.14934639260172844, + 0.0, + 0.1081804558634758, + 0.6335062123835087, + 1.0717872753739357, + 0.15350422263145447, + 0.0, + 0.19714386761188507, + 0.2028234861791134, + 0.14015549793839455, + 0.02952900528907776, + 0.3782578743994236, + 0.7999696396291256, + 0.28921278938651085, + 0.09326852113008499, + 0.2481832504272461, + 2.2859128415584564, + 0.0, + 1.099479891359806, + 0.8146581389009953, + 0.99367256462574, + 0.8800281435251236, + 0.0, + 0.2344456948339939, + 1.1710948944091797, + 0.2588508054614067, + 0.0, + 0.1007913127541542, + 0.1995769925415516, + 0.09736663475632668, + 0.867504745721817, + 0.2684900090098381, + 0.8288560546934605, + 0.1378963328897953 + ], + "unique_experts": 59, + "load_cv": 0.8845379626717033, + "normalized_load_entropy": 0.9116626928566794, + "max_load_share": 0.05555555555555555 + } + }, + "s1_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "457691bfa021e2163f06659bcef909a09cd44cf17fc74ee3337ca4ea395a6c75", + "route_weight_sha256": "7dfad82db9ad8f5386b142d6185f4ca8a7164af6bd745d6cd88f5fa6b5fe183b", + "loads": [ + 1, + 4, + 2, + 3, + 1, + 0, + 2, + 0, + 2, + 3, + 2, + 2, + 5, + 1, + 4, + 2, + 2, + 4, + 0, + 1, + 2, + 2, + 3, + 0, + 2, + 3, + 1, + 3, + 1, + 0, + 2, + 0, + 1, + 7, + 1, + 1, + 0, + 2, + 3, + 2, + 1, + 2, + 4, + 3, + 1, + 2, + 0, + 0, + 1, + 2, + 9, + 3, + 0, + 4, + 1, + 3, + 0, + 4, + 4, + 2, + 6, + 4, + 4, + 1 + ], + "weighted_loads": [ + 0.047110848128795624, + 0.21196075715124607, + 0.11930378898978233, + 0.16325366869568825, + 0.16878929734230042, + 0.0, + 0.24944716691970825, + 0.0, + 0.2623964473605156, + 0.2234180010855198, + 0.1751239076256752, + 0.10753558576107025, + 0.4211930185556412, + 0.061314620077610016, + 0.5067408457398415, + 0.06808461248874664, + 0.1146896630525589, + 0.6886995770037174, + 0.0, + 0.029345709830522537, + 0.11345157027244568, + 0.2173137068748474, + 0.19137006998062134, + 0.0, + 0.12891490943729877, + 0.29302146285772324, + 0.07439496368169785, + 0.23968089744448662, + 0.14343374967575073, + 0.0, + 0.10576973482966423, + 0.0, + 0.11551520973443985, + 0.6618442721664906, + 0.0879816859960556, + 0.15713883936405182, + 0.0, + 0.19363020360469818, + 0.19955911114811897, + 0.1349293850362301, + 0.030559878796339035, + 0.37058475241065025, + 0.11163918487727642, + 0.2842973470687866, + 0.09220820665359497, + 0.2574509382247925, + 0.0, + 0.0, + 0.05732368305325508, + 0.18914110213518143, + 0.9201973676681519, + 0.872320368885994, + 0.0, + 0.25179383531212807, + 0.03829282894730568, + 0.25262341648340225, + 0.0, + 0.12354623153805733, + 0.21202106401324272, + 0.08797036111354828, + 0.37140030413866043, + 0.25751320645213127, + 0.41158416494727135, + 0.07183279097080231 + ], + "unique_experts": 53, + "load_cv": 0.8207301527401605, + "normalized_load_entropy": 0.9141088919924739, + "max_load_share": 0.06521739130434782 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "5658999f5b9b6650e7138b240dc8bec47a7f71a045816a4538c325e952913381", + "route_weight_sha256": "22306f66841400d38500df0da0cec16c63bbf171b3eb1be0186cdc2d16f77a58", + "loads": [ + 15, + 6, + 2, + 15, + 2, + 5, + 2, + 11, + 2, + 12, + 5, + 3, + 8, + 7, + 12, + 3, + 4, + 4, + 2, + 1, + 4, + 8, + 14, + 0, + 4, + 5, + 1, + 6, + 1, + 3, + 3, + 0, + 1, + 9, + 9, + 1, + 0, + 7, + 3, + 3, + 2, + 2, + 19, + 5, + 1, + 6, + 21, + 0, + 12, + 12, + 9, + 9, + 3, + 9, + 4, + 7, + 0, + 4, + 11, + 3, + 19, + 5, + 10, + 8 + ], + "weighted_loads": [ + 1.7777982763946056, + 0.28691509552299976, + 0.11930378898978233, + 0.8629853576421738, + 0.16932968993205577, + 0.23798801004886627, + 0.24944716691970825, + 1.2667946945875883, + 0.2623964473605156, + 0.6979630180867389, + 0.2599401753395796, + 0.10841505759162828, + 0.5022405643248931, + 0.5291409157216549, + 1.0970614030957222, + 0.11684814840555191, + 0.329520083963871, + 0.6886995770037174, + 0.09217758104205132, + 0.029345709830522537, + 0.18422342091798782, + 0.5893449038267136, + 1.1077940333634615, + 0.0, + 0.23271826840937138, + 0.34107375849271193, + 0.07439496368169785, + 0.3361863140016794, + 0.14343374967575073, + 0.15548640862107277, + 0.14736349880695343, + 0.0, + 0.11551520973443985, + 0.7345447391271591, + 1.0092880800366402, + 0.15713883936405182, + 0.0, + 0.6097281705588102, + 0.19955911114811897, + 0.18504225090146065, + 0.10606889054179192, + 0.37058475241065025, + 0.924599913880229, + 0.35864100977778435, + 0.09220820665359497, + 0.5437922142446041, + 2.659901689738035, + 0.0, + 1.3230928741395473, + 0.6583261974155903, + 0.9201973676681519, + 1.6521040014922619, + 0.20043475553393364, + 0.969365518540144, + 1.150683969259262, + 0.48505275696516037, + 0.0, + 0.12354623153805733, + 0.6997395940124989, + 0.11845999397337437, + 1.1829572189599276, + 0.30756282061338425, + 0.9133927039802074, + 0.5131870619952679 + ], + "unique_experts": 59, + "load_cv": 0.8338540040078959, + "normalized_load_entropy": 0.917028350558401, + "max_load_share": 0.0546875 + } + }, + "s0_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "e92ac3485904c2e43650973b27d7b71f25408161a26dacaa252e2819b7872799", + "route_weight_sha256": "e6f5d04829820203a52b3ccb47ec6f586e7bf8a634883c4d29cf2edcb2c1c6db", + "loads": [ + 1, + 4, + 2, + 3, + 1, + 0, + 2, + 0, + 2, + 3, + 2, + 1, + 5, + 1, + 4, + 2, + 2, + 4, + 0, + 1, + 2, + 2, + 3, + 0, + 2, + 3, + 2, + 3, + 1, + 0, + 2, + 0, + 1, + 6, + 1, + 1, + 0, + 2, + 3, + 2, + 1, + 2, + 5, + 3, + 1, + 2, + 1, + 0, + 1, + 2, + 9, + 3, + 0, + 3, + 2, + 3, + 0, + 3, + 4, + 2, + 6, + 4, + 4, + 1 + ], + "weighted_loads": [ + 0.04608495533466339, + 0.20453167334198952, + 0.11011180281639099, + 0.16628000885248184, + 0.1811864823102951, + 0.0, + 0.2490464374423027, + 0.0, + 0.2483898475766182, + 0.2267780378460884, + 0.17225553467869759, + 0.0669260025024414, + 0.40712533704936504, + 0.05807338282465935, + 0.4950129874050617, + 0.06367158703505993, + 0.11984904855489731, + 0.6637399196624756, + 0.0, + 0.03172110766172409, + 0.11658810079097748, + 0.21834298968315125, + 0.2015283890068531, + 0.0, + 0.11962704546749592, + 0.2871824689209461, + 0.11255114153027534, + 0.24893846735358238, + 0.1492621898651123, + 0.0, + 0.10398586466908455, + 0.0, + 0.10937925428152084, + 0.5862921848893166, + 0.07469965517520905, + 0.1612623780965805, + 0.0, + 0.18866539001464844, + 0.20286645740270615, + 0.13818123936653137, + 0.028319882228970528, + 0.37237702682614326, + 0.13728160224854946, + 0.2965839169919491, + 0.09659111499786377, + 0.25107528269290924, + 0.033167872577905655, + 0.0, + 0.05661551281809807, + 0.1845979541540146, + 0.894358430057764, + 0.8657691031694412, + 0.0, + 0.21262655034661293, + 0.07117551937699318, + 0.2665022537112236, + 0.0, + 0.09254148229956627, + 0.20912517607212067, + 0.09100992232561111, + 0.35314954817295074, + 0.27161138877272606, + 0.397556871175766, + 0.06541825085878372 + ], + "unique_experts": 54, + "load_cv": 0.7915485104012391, + "normalized_load_entropy": 0.9201744644215955, + "max_load_share": 0.06521739130434782 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "ad129e2c0054f659f34cc1592141815b1dfffde049c31ea7a1cc76e3d7d6299d", + "route_weight_sha256": "32879ace525ce39a933564abcd156f74b46fd79678e7685f59602c030cbe17b4", + "loads": [ + 9, + 4, + 2, + 15, + 4, + 2, + 2, + 9, + 2, + 8, + 3, + 2, + 6, + 5, + 10, + 2, + 2, + 4, + 0, + 1, + 3, + 5, + 8, + 1, + 2, + 4, + 3, + 11, + 1, + 4, + 3, + 0, + 1, + 6, + 10, + 1, + 1, + 2, + 3, + 2, + 1, + 2, + 15, + 3, + 1, + 3, + 18, + 0, + 9, + 13, + 9, + 3, + 0, + 3, + 5, + 3, + 0, + 3, + 4, + 2, + 14, + 4, + 8, + 2 + ], + "weighted_loads": [ + 1.13217256590724, + 0.20453167334198952, + 0.11011180281639099, + 0.9358366169035435, + 0.24103519704658538, + 0.09182603657245636, + 0.2490464374423027, + 1.1539049819111824, + 0.2483898475766182, + 0.5149308667751029, + 0.20774520561099052, + 0.06780547433299944, + 0.4076040961081162, + 0.4112183302640915, + 0.8724489994347095, + 0.06367158703505993, + 0.11984904855489731, + 0.6637399196624756, + 0.0, + 0.03172110766172409, + 0.14340675994753838, + 0.5185577049851418, + 0.5920887775719166, + 0.027490869164466858, + 0.11962704546749592, + 0.2877143766381778, + 0.15494617447257042, + 0.5588178187608719, + 0.1492621898651123, + 0.21350229158997536, + 0.1503130979835987, + 0.0, + 0.10937925428152084, + 0.5862921848893166, + 1.1733934953808784, + 0.1612623780965805, + 0.047898076474666595, + 0.18866539001464844, + 0.20286645740270615, + 0.13818123936653137, + 0.028319882228970528, + 0.37237702682614326, + 0.7599840294569731, + 0.2965839169919491, + 0.09659111499786377, + 0.2954893410205841, + 2.3792038932442665, + 0.0, + 0.9369817562401295, + 0.8655144162476063, + 0.894358430057764, + 0.8657691031694412, + 0.0, + 0.21262655034661293, + 1.1811777465045452, + 0.2665022537112236, + 0.0, + 0.09254148229956627, + 0.20912517607212067, + 0.09100992232561111, + 0.9342782981693745, + 0.27161138877272606, + 0.8409131765365601, + 0.10363775491714478 + ], + "unique_experts": 59, + "load_cv": 0.9204467514322717, + "normalized_load_entropy": 0.9076982080822251, + "max_load_share": 0.0625 + } + }, + "s1_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "cb8d1f379dfecbf42cee8cf65cf1e4200fcf9a811b5246f427bbf5b456f697a7", + "route_weight_sha256": "c498d765e57d934f98585c1ef2fd520f3e51fec56a34e57232bb45d9bed5878c", + "loads": [ + 1, + 4, + 2, + 3, + 1, + 0, + 2, + 0, + 2, + 3, + 2, + 1, + 4, + 1, + 4, + 2, + 2, + 4, + 0, + 1, + 2, + 2, + 3, + 0, + 2, + 3, + 2, + 4, + 1, + 0, + 2, + 0, + 1, + 6, + 1, + 1, + 1, + 2, + 3, + 2, + 1, + 2, + 4, + 3, + 1, + 2, + 0, + 0, + 1, + 2, + 9, + 3, + 0, + 4, + 2, + 3, + 0, + 2, + 4, + 2, + 7, + 4, + 4, + 1 + ], + "weighted_loads": [ + 0.043625157326459885, + 0.19547190889716148, + 0.11291304975748062, + 0.1570872962474823, + 0.15537188947200775, + 0.0, + 0.25440288335084915, + 0.0, + 0.2602160982787609, + 0.2056705541908741, + 0.17395276576280594, + 0.06835165619850159, + 0.4008864611387253, + 0.0611407533288002, + 0.4948843829333782, + 0.06931553408503532, + 0.11125896871089935, + 0.6763302385807037, + 0.0, + 0.030645830556750298, + 0.10672396421432495, + 0.21197470277547836, + 0.19636821746826172, + 0.0, + 0.13117276318371296, + 0.2950846590101719, + 0.11037355661392212, + 0.2625286988914013, + 0.15624092519283295, + 0.0, + 0.10704001039266586, + 0.0, + 0.11224767565727234, + 0.6108961254358292, + 0.08032448589801788, + 0.1599474847316742, + 0.01778540574014187, + 0.1917048990726471, + 0.19621801748871803, + 0.1334955245256424, + 0.029978640377521515, + 0.3746444843709469, + 0.11834678053855896, + 0.2922057844698429, + 0.09238789230585098, + 0.25641873478889465, + 0.0, + 0.0, + 0.0523306243121624, + 0.179876446723938, + 0.8736370094120502, + 0.8532138168811798, + 0.0, + 0.25169120356440544, + 0.0698920339345932, + 0.2552868276834488, + 0.0, + 0.08376786671578884, + 0.21648088470101357, + 0.0862499363720417, + 0.4055228289216757, + 0.2571147158741951, + 0.40768619254231453, + 0.06931284070014954 + ], + "unique_experts": 54, + "load_cv": 0.7999947489850773, + "normalized_load_entropy": 0.919380061046339, + "max_load_share": 0.06521739130434782 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "6d706f627878670df51b4b5c38a0c238a471bcac54991695b3a7c8c2d633a6b6", + "route_weight_sha256": "27efa12b5da497031f3edebb083abb0cc7e7c0d1488ecf28587df4debdbc82fa", + "loads": [ + 13, + 6, + 2, + 16, + 3, + 4, + 2, + 11, + 2, + 12, + 5, + 2, + 7, + 7, + 12, + 3, + 4, + 4, + 1, + 1, + 3, + 8, + 13, + 1, + 4, + 5, + 3, + 8, + 1, + 4, + 3, + 0, + 1, + 8, + 9, + 1, + 2, + 7, + 3, + 3, + 2, + 2, + 19, + 5, + 1, + 6, + 20, + 0, + 11, + 13, + 9, + 9, + 3, + 9, + 5, + 7, + 0, + 2, + 11, + 3, + 20, + 5, + 10, + 8 + ], + "weighted_loads": [ + 1.4835738688707352, + 0.2704262472689152, + 0.11291304975748062, + 1.005096696317196, + 0.18662465561646968, + 0.1885167695581913, + 0.25440288335084915, + 1.2612234484404325, + 0.2602160982787609, + 0.698643829789944, + 0.2587690334767103, + 0.06923112802905962, + 0.48193400690797716, + 0.5186911411583424, + 1.0614608973264694, + 0.11807907000184059, + 0.32608938962221146, + 0.6763302385807037, + 0.055603545159101486, + 0.030645830556750298, + 0.13906044140458107, + 0.5898501947522163, + 1.088090181350708, + 0.020437562838196754, + 0.23497612215578556, + 0.3431369546451606, + 0.14966728165745735, + 0.4035350587219, + 0.15624092519283295, + 0.19582020118832588, + 0.14863377436995506, + 0.0, + 0.11224767565727234, + 0.6835965923964977, + 1.0456255674362183, + 0.1599474847316742, + 0.058597663417458534, + 0.6078028660267591, + 0.19621801748871803, + 0.18360839039087296, + 0.1054876521229744, + 0.3746444843709469, + 0.8459118902683258, + 0.36654944717884064, + 0.09238789230585098, + 0.5588425323367119, + 2.6372518949210644, + 0.0, + 1.1820175014436245, + 0.7077394612133503, + 0.8736370094120502, + 1.6329974494874477, + 0.20043475553393364, + 0.9692628867924213, + 1.1616356559097767, + 0.4877161681652069, + 0.0, + 0.08376786671578884, + 0.7041994147002697, + 0.11673956923186779, + 1.2655834555625916, + 0.3071643300354481, + 0.8943408243358135, + 0.5104940719902515 + ], + "unique_experts": 61, + "load_cv": 0.8186201126828542, + "normalized_load_entropy": 0.9221858084060076, + "max_load_share": 0.052083333333333336 + } + }, + "s0_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "ec09dc981710b5dbf853db5628c85c8ba58170bf0f618902ae752fd3d8785bf2", + "route_weight_sha256": "72edef60680f104af419eadd757d9b4483478a2c5cd2ee3fc6332892ae3f9bf3", + "loads": [ + 1, + 4, + 2, + 3, + 1, + 0, + 2, + 0, + 2, + 3, + 2, + 1, + 5, + 1, + 4, + 3, + 2, + 4, + 0, + 1, + 2, + 2, + 3, + 0, + 2, + 3, + 2, + 3, + 1, + 0, + 2, + 0, + 1, + 6, + 1, + 1, + 0, + 2, + 3, + 2, + 0, + 2, + 5, + 3, + 1, + 2, + 1, + 0, + 1, + 2, + 9, + 3, + 0, + 3, + 2, + 3, + 0, + 3, + 4, + 2, + 6, + 4, + 4, + 1 + ], + "weighted_loads": [ + 0.04459873214364052, + 0.2090183012187481, + 0.11193850636482239, + 0.16330201923847198, + 0.17917205393314362, + 0.0, + 0.2511792629957199, + 0.0, + 0.24402792751789093, + 0.21547355130314827, + 0.1742583066225052, + 0.06721183657646179, + 0.41582166589796543, + 0.056927964091300964, + 0.4927295185625553, + 0.09509365819394588, + 0.12106535583734512, + 0.6631361804902554, + 0.0, + 0.03161703795194626, + 0.11387493833899498, + 0.22183386981487274, + 0.1969062238931656, + 0.0, + 0.12367703206837177, + 0.2846776619553566, + 0.1118026077747345, + 0.25138603895902634, + 0.1519053429365158, + 0.0, + 0.10490046069025993, + 0.0, + 0.10953692346811295, + 0.5902697220444679, + 0.07459558546543121, + 0.15964427590370178, + 0.0, + 0.1816849410533905, + 0.20332352258265018, + 0.13707086816430092, + 0.0, + 0.38171301782131195, + 0.14037396758794785, + 0.29748012870550156, + 0.09752186387777328, + 0.25512127578258514, + 0.035356517881155014, + 0.0, + 0.053517308086156845, + 0.18519899249076843, + 0.8860281705856323, + 0.8506623804569244, + 0.0, + 0.208345428109169, + 0.07109475880861282, + 0.26779045164585114, + 0.0, + 0.09269161708652973, + 0.20348112657666206, + 0.09011260420084, + 0.35091834887862206, + 0.2741483077406883, + 0.4028245247900486, + 0.06349720805883408 + ], + "unique_experts": 53, + "load_cv": 0.7999947489850773, + "normalized_load_entropy": 0.9168473056025573, + "max_load_share": 0.06521739130434782 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "28117e939653bbf7b8fa59a0375229b3127ffdcf788f739801fd8d27093782fb", + "route_weight_sha256": "cb2dbcaf4130f2464dad6a565805455b574cd27bf5478126e332b1df7335e35c", + "loads": [ + 8, + 5, + 2, + 15, + 4, + 2, + 2, + 9, + 2, + 9, + 3, + 2, + 6, + 5, + 10, + 3, + 2, + 4, + 0, + 1, + 3, + 5, + 9, + 1, + 2, + 4, + 2, + 10, + 1, + 4, + 3, + 0, + 1, + 6, + 9, + 1, + 0, + 2, + 3, + 2, + 0, + 2, + 15, + 3, + 1, + 5, + 18, + 0, + 9, + 12, + 9, + 3, + 0, + 3, + 5, + 3, + 0, + 3, + 5, + 2, + 14, + 4, + 8, + 2 + ], + "weighted_loads": [ + 1.0255194827914238, + 0.3554934822022915, + 0.11193850636482239, + 0.867021519690752, + 0.24659894045908004, + 0.09487484022974968, + 0.2511792629957199, + 1.2132552936673164, + 0.24402792751789093, + 0.6587328278692439, + 0.20974797755479813, + 0.06809130840701982, + 0.4163004249567166, + 0.40649817138910294, + 0.9947898909449577, + 0.09509365819394588, + 0.12106535583734512, + 0.6631361804902554, + 0.0, + 0.03161703795194626, + 0.14069359749555588, + 0.5168099850416183, + 0.6433944553136826, + 0.027490869164466858, + 0.12367703206837177, + 0.28520956967258826, + 0.1118026077747345, + 0.5140921734273434, + 0.1519053429365158, + 0.20415866747498512, + 0.1512276940047741, + 0.0, + 0.10953692346811295, + 0.5902697220444679, + 1.071046307682991, + 0.15964427590370178, + 0.0, + 0.1816849410533905, + 0.20332352258265018, + 0.13707086816430092, + 0.0, + 0.38171301782131195, + 0.7665973603725433, + 0.29748012870550156, + 0.09752186387777328, + 0.38579633086919785, + 2.345935668796301, + 0.0, + 0.91468570753932, + 0.8029053248465061, + 0.8860281705856323, + 0.8506623804569244, + 0.0, + 0.208345428109169, + 1.179287038743496, + 0.26779045164585114, + 0.0, + 0.09269161708652973, + 0.2427828423678875, + 0.09011260420084, + 0.8900406621396542, + 0.2741483077406883, + 0.8631425835192204, + 0.10171671211719513 + ], + "unique_experts": 57, + "load_cv": 0.9137157890776959, + "normalized_load_entropy": 0.9053875774022957, + "max_load_share": 0.0625 + } + }, + "s1_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "35edfbb901ee7967ef76af82b82a2e481e5c612d1a3885bac6647a87a1a5eba5", + "route_weight_sha256": "ae12d6187ac449efdf4ceee7c1423c1e0257e4ece4946d16113910137028c733", + "loads": [ + 1, + 4, + 2, + 3, + 1, + 0, + 2, + 0, + 2, + 3, + 2, + 2, + 4, + 1, + 4, + 2, + 2, + 4, + 0, + 1, + 2, + 2, + 3, + 0, + 2, + 3, + 1, + 4, + 1, + 0, + 2, + 0, + 1, + 6, + 1, + 1, + 1, + 2, + 3, + 2, + 1, + 2, + 3, + 3, + 1, + 2, + 0, + 0, + 1, + 2, + 9, + 3, + 0, + 4, + 2, + 3, + 0, + 3, + 4, + 2, + 7, + 4, + 4, + 1 + ], + "weighted_loads": [ + 0.04335303232073784, + 0.19675366394221783, + 0.118648000061512, + 0.15359333902597427, + 0.1531352698802948, + 0.0, + 0.25541558861732483, + 0.0, + 0.257409181445837, + 0.20263619720935822, + 0.17698846384882927, + 0.10738567635416985, + 0.4057258442044258, + 0.06003102287650108, + 0.505977176129818, + 0.06836777552962303, + 0.11142253875732422, + 0.6737852394580841, + 0.0, + 0.030643008649349213, + 0.1054646447300911, + 0.21807056665420532, + 0.18886468186974525, + 0.0, + 0.13291521929204464, + 0.2942767105996609, + 0.07327007502317429, + 0.2662176117300987, + 0.15816746652126312, + 0.0, + 0.10630164667963982, + 0.0, + 0.11353924125432968, + 0.612960334867239, + 0.08011927455663681, + 0.1592189222574234, + 0.017871327698230743, + 0.18252790719270706, + 0.19805162400007248, + 0.13349780812859535, + 0.030992573127150536, + 0.3757742680609226, + 0.09712009690701962, + 0.29323364421725273, + 0.09318674355745316, + 0.2582954466342926, + 0.0, + 0.0, + 0.05110358074307442, + 0.18183310329914093, + 0.8714505564421415, + 0.8556997030973434, + 0.0, + 0.2548014856874943, + 0.06786134839057922, + 0.2589135095477104, + 0.0, + 0.10540984570980072, + 0.21372169256210327, + 0.08611638471484184, + 0.4037952944636345, + 0.25884008407592773, + 0.4131249040365219, + 0.07162970304489136 + ], + "unique_experts": 54, + "load_cv": 0.7957828355531795, + "normalized_load_entropy": 0.9199721202198572, + "max_load_share": 0.06521739130434782 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "12c6d49ab1f7a1cd1119b44144f4fd0db52977f356df2177eaf231bd8144a06d", + "route_weight_sha256": "8359e85f319a78196cbbc4725e2433e8179e68edff82e7430a842f5dcfdbfa64", + "loads": [ + 11, + 7, + 2, + 16, + 3, + 5, + 2, + 12, + 2, + 13, + 5, + 3, + 7, + 7, + 12, + 3, + 4, + 4, + 1, + 1, + 3, + 8, + 14, + 0, + 4, + 5, + 1, + 7, + 1, + 4, + 3, + 0, + 1, + 8, + 8, + 1, + 1, + 7, + 3, + 3, + 2, + 2, + 19, + 5, + 1, + 8, + 20, + 0, + 10, + 12, + 9, + 9, + 3, + 9, + 5, + 7, + 0, + 3, + 12, + 3, + 20, + 5, + 10, + 8 + ], + "weighted_loads": [ + 1.3444232158362865, + 0.38024370186030865, + 0.118648000061512, + 0.9119724482297897, + 0.190569615107961, + 0.2099942397326231, + 0.25541558861732483, + 1.3424590211361647, + 0.257409181445837, + 0.8198805899592116, + 0.26180473156273365, + 0.10826514818472788, + 0.4867733899736777, + 0.5094282850623131, + 1.151821419596672, + 0.1171313114464283, + 0.3262529596686363, + 0.6737852394580841, + 0.055603545159101486, + 0.030643008649349213, + 0.1378011219203472, + 0.5841305553913116, + 1.1493416875600815, + 0.0, + 0.23671857826411724, + 0.34232900623464957, + 0.07327007502317429, + 0.3627230282872915, + 0.15816746652126312, + 0.1881173774600029, + 0.14789541065692902, + 0.0, + 0.11353924125432968, + 0.6856608018279076, + 0.9541096910834312, + 0.1592189222574234, + 0.017871327698230743, + 0.5986258741468191, + 0.19805162400007248, + 0.1836106739938259, + 0.10650158487260342, + 0.3757742680609226, + 0.9155287835747004, + 0.36757730692625046, + 0.09318674355745316, + 0.6597929447889328, + 2.64070837572217, + 0.0, + 1.1333229131996632, + 0.6510181985795498, + 0.8714505564421415, + 1.6354833357036114, + 0.20043475553393364, + 0.9723731689155102, + 1.151754468679428, + 0.49134285002946854, + 0.0, + 0.10540984570980072, + 0.7495614886283875, + 0.11660601757466793, + 1.2236413788050413, + 0.3088896982371807, + 0.910985179245472, + 0.5132009349763393 + ], + "unique_experts": 60, + "load_cv": 0.8239049972202163, + "normalized_load_entropy": 0.9194249388499871, + "max_load_share": 0.052083333333333336 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "ordered_topk_exact_tokens": 19, + "set_exact_tokens": 21, + "mean_set_jaccard": 0.9751552795031057, + "mean_token_weighted_tv": 0.00892229224352733, + "aggregate_load_tv": 0.014492753623188408 + }, + "system_bos": { + "tokens": 23, + "ordered_topk_exact_tokens": 17, + "set_exact_tokens": 21, + "mean_set_jaccard": 0.9751552795031057, + "mean_token_weighted_tv": 0.015939375466626625, + "aggregate_load_tv": 0.014492753623188408 + }, + "system_x": { + "tokens": 23, + "ordered_topk_exact_tokens": 17, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.9503105590062112, + "mean_token_weighted_tv": 0.01656754622640817, + "aggregate_load_tv": 0.028985507246376815 + }, + "system_period": { + "tokens": 23, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.9161490683229815, + "mean_token_weighted_tv": 0.019884281994208046, + "aggregate_load_tv": 0.04347826086956522 + }, + "bos_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 18, + "mean_set_jaccard": 0.9378881987577641, + "mean_token_weighted_tv": 0.027019149137903816, + "aggregate_load_tv": 0.036231884057971016 + }, + "bos_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.9161490683229815, + "mean_token_weighted_tv": 0.029545194550376873, + "aggregate_load_tv": 0.05072463768115943 + }, + "x_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.9503105590062112, + "mean_token_weighted_tv": 0.021600540281961792, + "aggregate_load_tv": 0.028985507246376812 + }, + "x_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.9161490683229815, + "mean_token_weighted_tv": 0.028512848662617413, + "aggregate_load_tv": 0.04347826086956522 + }, + "period_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 20, + "mean_set_jaccard": 0.9627329192546583, + "mean_token_weighted_tv": 0.020922374992590885, + "aggregate_load_tv": 0.021739130434782608 + }, + "period_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.8944099378881988, + "mean_token_weighted_tv": 0.031008266762870808, + "aggregate_load_tv": 0.050724637681159424 + } + } + }, + "layer_04": { + "layer": 4, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "a44d2aebd9e5ab732af96af32101aaa1f25c2cba88ef8b6aea0410d80398c67c", + "route_weight_sha256": "73494be7de40404aab919f3efad4cd2391ff642fbc7cbb4513b4e105d307c4b2", + "loads": [ + 1, + 7, + 1, + 2, + 2, + 0, + 0, + 0, + 2, + 3, + 2, + 2, + 4, + 0, + 3, + 0, + 3, + 1, + 0, + 0, + 5, + 2, + 3, + 1, + 2, + 0, + 0, + 3, + 4, + 10, + 2, + 2, + 5, + 4, + 2, + 0, + 2, + 3, + 1, + 3, + 1, + 1, + 2, + 7, + 1, + 2, + 2, + 3, + 0, + 7, + 4, + 1, + 3, + 1, + 3, + 2, + 3, + 2, + 1, + 1, + 0, + 3, + 1, + 0 + ], + "weighted_loads": [ + 0.04719240218400955, + 0.3519810140132904, + 0.06765640527009964, + 0.09237397834658623, + 0.1356218047440052, + 0.0, + 0.0, + 0.0, + 0.11631355807185173, + 0.1946941390633583, + 0.6969427764415741, + 0.12533428892493248, + 0.24236472323536873, + 0.0, + 0.16817419230937958, + 0.0, + 0.23253116011619568, + 0.07171980291604996, + 0.0, + 0.0, + 0.3752657175064087, + 0.20153455436229706, + 0.19204549118876457, + 0.09554300457239151, + 0.17535775154829025, + 0.0, + 0.0, + 0.2607201784849167, + 0.4023209884762764, + 1.024672668427229, + 0.12752831354737282, + 0.26676879823207855, + 0.28079619631171227, + 0.3759835585951805, + 0.14938969165086746, + 0.0, + 0.11133471876382828, + 0.28886665403842926, + 0.052255529910326004, + 0.33801665902137756, + 0.03968482092022896, + 0.030639996752142906, + 0.16591722704470158, + 0.6172391697764397, + 0.04609401896595955, + 0.07001053169369698, + 0.07818441279232502, + 0.3249947503209114, + 0.0, + 0.6243631392717361, + 0.27959679812192917, + 0.04894391819834709, + 0.31995241343975067, + 0.06012348458170891, + 0.2190585769712925, + 0.1329914554953575, + 0.19008509069681168, + 0.10401902347803116, + 0.03805793076753616, + 0.0366666279733181, + 0.0, + 0.2070525698363781, + 0.04926333203911781, + 0.0 + ], + "unique_experts": 51, + "load_cv": 0.9137333487622095, + "normalized_load_entropy": 0.8991844320633682, + "max_load_share": 0.07246376811594203 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "f5179ac028de35d0eeda40aa9e07844c9ee8ed418e68e6cd6d4bb53395529377", + "route_weight_sha256": "c342988b44df24585eee28804662200fe93d725dea6857fafd7b30407af55bee", + "loads": [ + 1, + 10, + 3, + 6, + 2, + 0, + 1, + 0, + 2, + 3, + 12, + 4, + 4, + 14, + 5, + 3, + 3, + 1, + 4, + 0, + 5, + 4, + 4, + 1, + 2, + 6, + 6, + 4, + 5, + 29, + 2, + 4, + 5, + 6, + 14, + 0, + 2, + 4, + 2, + 3, + 4, + 4, + 10, + 7, + 1, + 4, + 13, + 3, + 1, + 9, + 5, + 1, + 3, + 1, + 3, + 2, + 3, + 2, + 1, + 14, + 4, + 3, + 4, + 0 + ], + "weighted_loads": [ + 0.04719240218400955, + 0.5288001783192158, + 0.1898295059800148, + 0.38287867527105846, + 0.1356218047440052, + 0.0, + 0.05826026201248169, + 0.0, + 0.11631355807185173, + 0.1946941390633583, + 1.354424437507987, + 0.15189533215016127, + 0.24236472323536873, + 0.9584155976772308, + 0.21406679786741734, + 0.19463163241744041, + 0.23253116011619568, + 0.07171980291604996, + 0.20822938848868944, + 0.0, + 0.3752657175064087, + 1.2673842459917068, + 0.21805233508348465, + 0.09554300457239151, + 0.17535775154829025, + 0.45764829590916634, + 0.5287207551300526, + 0.2687394265085459, + 0.4502224735915661, + 2.6948965485498775, + 0.12752831354737282, + 0.2976859621703625, + 0.28079619631171227, + 0.4162615640088916, + 1.5102639496617485, + 0.0, + 0.11133471876382828, + 0.32939063385128975, + 1.0490502901375294, + 0.33801665902137756, + 0.1803830936551094, + 0.1969366166740656, + 0.5275979321449995, + 0.6172391697764397, + 0.04609401896595955, + 0.2668343745172024, + 1.2258668560534716, + 0.3249947503209114, + 0.036817941814661026, + 0.6747640799731016, + 0.3262830041348934, + 0.04894391819834709, + 0.31995241343975067, + 0.06012348458170891, + 0.2190585769712925, + 0.1329914554953575, + 0.19008509069681168, + 0.10401902347803116, + 0.03805793076753616, + 0.7921490464359522, + 0.5021769450977445, + 0.2070525698363781, + 0.26310284435749054, + 0.0 + ], + "unique_experts": 59, + "load_cv": 1.0333930687632376, + "normalized_load_entropy": 0.9020643690448619, + "max_load_share": 0.10069444444444445 + } + }, + "s1_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "4fcd1dc7e30bfc7bb4e8d7a4ddb4338dbfaee0531093b3148f31f8a819a2f5cf", + "route_weight_sha256": "a4a320e1f3b9d85f7b05d4fabd97052e524d419c5ff44f09004ae142fbe7eb7a", + "loads": [ + 1, + 8, + 1, + 2, + 2, + 0, + 0, + 0, + 2, + 3, + 2, + 2, + 3, + 0, + 4, + 0, + 3, + 1, + 0, + 0, + 5, + 2, + 3, + 1, + 2, + 0, + 0, + 3, + 4, + 10, + 2, + 2, + 5, + 4, + 2, + 0, + 2, + 3, + 1, + 3, + 1, + 1, + 2, + 7, + 1, + 2, + 1, + 3, + 0, + 7, + 4, + 1, + 3, + 1, + 3, + 2, + 3, + 2, + 1, + 1, + 0, + 3, + 1, + 0 + ], + "weighted_loads": [ + 0.04759281873703003, + 0.40278902277350426, + 0.06618401408195496, + 0.09296925738453865, + 0.13470306247472763, + 0.0, + 0.0, + 0.0, + 0.11594299599528313, + 0.19258737936615944, + 0.6961458623409271, + 0.12457014620304108, + 0.19080257788300514, + 0.0, + 0.19963647425174713, + 0.0, + 0.23898038268089294, + 0.0707489624619484, + 0.0, + 0.0, + 0.36723172292113304, + 0.19687769562005997, + 0.19601276889443398, + 0.09405788779258728, + 0.16676832735538483, + 0.0, + 0.0, + 0.27113600820302963, + 0.40028687566518784, + 1.0299028977751732, + 0.12691688165068626, + 0.2596088945865631, + 0.27314337342977524, + 0.36808159202337265, + 0.1510334350168705, + 0.0, + 0.11671335622668266, + 0.28362544625997543, + 0.05203968659043312, + 0.33141743391752243, + 0.039890460669994354, + 0.030193505808711052, + 0.17089905589818954, + 0.6129005774855614, + 0.0457589365541935, + 0.07245176658034325, + 0.0500720851123333, + 0.33253612369298935, + 0.0, + 0.6147388592362404, + 0.2771894447505474, + 0.050203654915094376, + 0.3227219358086586, + 0.05672488361597061, + 0.21115664020180702, + 0.131441630423069, + 0.18878259882330894, + 0.10237043723464012, + 0.03782976046204567, + 0.03664528951048851, + 0.0, + 0.20352431759238243, + 0.05022060126066208, + 0.0 + ], + "unique_experts": 51, + "load_cv": 0.9355406431021744, + "normalized_load_entropy": 0.8963480606314881, + "max_load_share": 0.07246376811594203 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "38f4f91a690f397012e06e4e1e87aed3f18d785a9376e08a48af62b93abe1937", + "route_weight_sha256": "0b32f6ba5f467e9012c9356c681ef4abd2b8302787e188c1f5bf19fd331514d5", + "loads": [ + 1, + 10, + 4, + 11, + 2, + 0, + 3, + 0, + 2, + 12, + 11, + 4, + 4, + 15, + 7, + 4, + 5, + 3, + 7, + 2, + 6, + 5, + 8, + 2, + 2, + 10, + 9, + 4, + 5, + 33, + 2, + 4, + 5, + 6, + 18, + 0, + 2, + 5, + 4, + 6, + 4, + 7, + 11, + 7, + 2, + 5, + 11, + 7, + 1, + 10, + 6, + 1, + 7, + 5, + 9, + 2, + 8, + 4, + 1, + 15, + 7, + 5, + 5, + 1 + ], + "weighted_loads": [ + 0.04759281873703003, + 0.5539663024246693, + 0.23597798496484756, + 0.8520091998507269, + 0.13470306247472763, + 0.0, + 0.21306375786662102, + 0.0, + 0.11594299599528313, + 1.273623488843441, + 1.2871883809566498, + 0.151046983897686, + 0.2980274669826031, + 1.0191113632172346, + 0.2746143415570259, + 0.2762858457863331, + 0.6032938063144684, + 0.14084193855524063, + 0.5539608031976968, + 0.09061743319034576, + 0.41599032655358315, + 1.2949788495898247, + 0.5450110901147127, + 0.18703141808509827, + 0.16676832735538483, + 0.7314742170274258, + 0.8089523650705814, + 0.27943590842187405, + 0.4477423019707203, + 2.6385384667664766, + 0.12691688165068626, + 0.29017412196844816, + 0.27314337342977524, + 0.40874437987804413, + 1.8759008269989863, + 0.0, + 0.11671335622668266, + 0.36628472059965134, + 1.2409149408340454, + 0.5437068603932858, + 0.19882094860076904, + 0.2805783809890272, + 0.6010938324034214, + 0.6129005774855614, + 0.08357926830649376, + 0.2358817158965394, + 1.2483084350824356, + 0.6700933128595352, + 0.02982325665652752, + 0.7012140229344368, + 0.369433481246233, + 0.050203654915094376, + 0.7616820484399796, + 0.24000690504908562, + 0.7605409137904644, + 0.131441630423069, + 0.6132513470947742, + 0.17639480903744698, + 0.03782976046204567, + 0.8613257855176926, + 0.9801153689622879, + 0.40057482942938805, + 0.3398769982159138, + 0.044050849974155426 + ], + "unique_experts": 61, + "load_cv": 0.8569568250501306, + "normalized_load_entropy": 0.9263663897006127, + "max_load_share": 0.0859375 + } + }, + "s0_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "e370334974a9de7c981be2584588bbdfe1a412966dbaebfb53b07e4bfd1eacb2", + "route_weight_sha256": "394320a84967be3481933ddfb0f64a28814848d09380e5831960cc7a84fa03a7", + "loads": [ + 2, + 8, + 1, + 2, + 2, + 0, + 0, + 0, + 2, + 3, + 2, + 2, + 4, + 0, + 2, + 0, + 3, + 1, + 0, + 0, + 5, + 2, + 3, + 1, + 2, + 0, + 0, + 3, + 4, + 9, + 2, + 2, + 5, + 4, + 2, + 0, + 2, + 3, + 1, + 3, + 1, + 1, + 2, + 7, + 1, + 1, + 2, + 3, + 0, + 7, + 4, + 1, + 3, + 1, + 3, + 2, + 3, + 2, + 1, + 1, + 0, + 3, + 2, + 0 + ], + "weighted_loads": [ + 0.0974215716123581, + 0.41042064875364304, + 0.06413083523511887, + 0.0976121574640274, + 0.13108867779374123, + 0.0, + 0.0, + 0.0, + 0.11659424006938934, + 0.19482681527733803, + 0.7145386040210724, + 0.12350583076477051, + 0.23883889243006706, + 0.0, + 0.12903683632612228, + 0.0, + 0.23373860865831375, + 0.0721893310546875, + 0.0, + 0.0, + 0.38540303334593773, + 0.20958495885133743, + 0.19643324986100197, + 0.08409692347049713, + 0.1643521599471569, + 0.0, + 0.0, + 0.26677660644054413, + 0.39842866361141205, + 0.8917382918298244, + 0.13328571617603302, + 0.2615256756544113, + 0.29281139746308327, + 0.35736410319805145, + 0.13481821864843369, + 0.0, + 0.12175821885466576, + 0.28405874222517014, + 0.05188312754034996, + 0.3323642238974571, + 0.03858323022723198, + 0.031105557456612587, + 0.16952988877892494, + 0.6103828176856041, + 0.053870320320129395, + 0.04227370023727417, + 0.07120626419782639, + 0.3122587502002716, + 0.0, + 0.6114772595465183, + 0.29144133254885674, + 0.054108284413814545, + 0.31444520503282547, + 0.0682254359126091, + 0.2111348658800125, + 0.13288822770118713, + 0.19257331266999245, + 0.09614741057157516, + 0.03665082901716232, + 0.031939223408699036, + 0.0, + 0.2079714834690094, + 0.08695841580629349, + 0.0 + ], + "unique_experts": 51, + "load_cv": 0.9026321518272475, + "normalized_load_entropy": 0.9005084995663387, + "max_load_share": 0.06521739130434782 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "0e05f3aaa504526895d50da78f149a65f58359ea31ebba55e0708a8c8ce109fd", + "route_weight_sha256": "155e4d219919f73947d7994d040ef84b695f29d143bc32545ecf92b4cf4e1253", + "loads": [ + 2, + 11, + 3, + 7, + 2, + 0, + 1, + 0, + 2, + 3, + 12, + 3, + 4, + 14, + 4, + 3, + 3, + 1, + 5, + 0, + 5, + 3, + 4, + 1, + 2, + 6, + 6, + 3, + 5, + 30, + 2, + 3, + 5, + 5, + 14, + 0, + 2, + 5, + 2, + 3, + 4, + 4, + 10, + 7, + 1, + 3, + 13, + 3, + 1, + 8, + 5, + 1, + 3, + 1, + 3, + 2, + 3, + 2, + 1, + 14, + 5, + 3, + 5, + 0 + ], + "weighted_loads": [ + 0.0974215716123581, + 0.5919728465378284, + 0.18630393594503403, + 0.4530323810467962, + 0.13108867779374123, + 0.0, + 0.052698805928230286, + 0.0, + 0.11659424006938934, + 0.19482681527733803, + 1.3720202650874853, + 0.1406135018914938, + 0.23883889243006706, + 0.9647900089621544, + 0.17492944188416004, + 0.18430282548069954, + 0.23373860865831375, + 0.0721893310546875, + 0.3650540517701302, + 0.0, + 0.38540303334593773, + 0.5008101239800453, + 0.2256594691425562, + 0.08409692347049713, + 0.1643521599471569, + 0.46747761219739914, + 0.54206782579422, + 0.26677660644054413, + 0.4441547393798828, + 2.6715344409749378, + 0.13328571617603302, + 0.2798911761492491, + 0.29281139746308327, + 0.382715480402112, + 1.4656857215159107, + 0.0, + 0.12175821885466576, + 0.36615853384137154, + 1.0486778877675533, + 0.3323642238974571, + 0.17928150296211243, + 0.19202804006636143, + 0.5312105938792229, + 0.6103828176856041, + 0.053870320320129395, + 0.31748195737600327, + 1.218888707458973, + 0.3122587502002716, + 0.036817941814661026, + 0.6395120080560446, + 0.338127538561821, + 0.054108284413814545, + 0.31444520503282547, + 0.0682254359126091, + 0.2111348658800125, + 0.13288822770118713, + 0.19257331266999245, + 0.09614741057157516, + 0.03665082901716232, + 0.7888958621770144, + 0.6880604596808553, + 0.2079714834690094, + 0.30841588601469994, + 0.0 + ], + "unique_experts": 59, + "load_cv": 1.0555555555555556, + "normalized_load_entropy": 0.900053174191259, + "max_load_share": 0.10416666666666667 + } + }, + "s1_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "37aea419212ad484553ac3d6e3ac6e9565b41fd65a16efea070bdb3c24c46dc7", + "route_weight_sha256": "d2902c673da5b7e0ebd8a334aaf9f6338f1d9d82bf8356a77bc4ff8d8382d803", + "loads": [ + 3, + 6, + 1, + 2, + 1, + 0, + 0, + 0, + 2, + 3, + 2, + 2, + 4, + 0, + 4, + 0, + 3, + 1, + 0, + 0, + 5, + 2, + 3, + 1, + 2, + 0, + 0, + 3, + 4, + 8, + 2, + 3, + 6, + 4, + 2, + 0, + 2, + 3, + 1, + 3, + 1, + 1, + 2, + 7, + 1, + 1, + 1, + 3, + 0, + 7, + 4, + 1, + 3, + 1, + 3, + 2, + 4, + 2, + 0, + 1, + 0, + 3, + 2, + 0 + ], + "weighted_loads": [ + 0.15237882733345032, + 0.29155396297574043, + 0.06921254843473434, + 0.10078998655080795, + 0.10383691638708115, + 0.0, + 0.0, + 0.0, + 0.12149733677506447, + 0.20412596687674522, + 0.7109067440032959, + 0.12250108271837234, + 0.24377410858869553, + 0.0, + 0.19668728858232498, + 0.0, + 0.23815608769655228, + 0.06909096986055374, + 0.0, + 0.0, + 0.40462280437350273, + 0.22071963548660278, + 0.20008831098675728, + 0.08368530869483948, + 0.16075846180319786, + 0.0, + 0.0, + 0.29224591702222824, + 0.40281992405653, + 0.7283767275512218, + 0.13825634121894836, + 0.3037959672510624, + 0.3329878933727741, + 0.3493862561881542, + 0.12417414039373398, + 0.0, + 0.12605061382055283, + 0.2806846499443054, + 0.05190892517566681, + 0.3454730436205864, + 0.03957776352763176, + 0.03243638575077057, + 0.1767391748726368, + 0.6071968227624893, + 0.05463339015841484, + 0.03978206217288971, + 0.04710700735449791, + 0.32643918693065643, + 0.0, + 0.5946703441441059, + 0.2882967069745064, + 0.05454187095165253, + 0.32306133210659027, + 0.06871718913316727, + 0.21592126041650772, + 0.13966599106788635, + 0.23863929510116577, + 0.09417355433106422, + 0.0, + 0.03058832325041294, + 0.0, + 0.2216186858713627, + 0.09050547704100609, + 0.0 + ], + "unique_experts": 50, + "load_cv": 0.8800097381600154, + "normalized_load_entropy": 0.8985332918086095, + "max_load_share": 0.057971014492753624 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "e6bc73888a0e831f7211592ef246360b469ff2151bc777f85ca42f2acd12d96a", + "route_weight_sha256": "b67c7eed9845ddc324a3fb884c63d4864ea15bfe017d839f50bb608595517672", + "loads": [ + 3, + 8, + 4, + 12, + 1, + 0, + 3, + 0, + 2, + 12, + 11, + 3, + 5, + 15, + 7, + 4, + 5, + 3, + 8, + 2, + 6, + 4, + 8, + 2, + 2, + 10, + 9, + 3, + 5, + 32, + 2, + 4, + 6, + 5, + 18, + 0, + 2, + 6, + 4, + 6, + 4, + 7, + 11, + 7, + 2, + 4, + 12, + 7, + 1, + 9, + 6, + 1, + 7, + 5, + 9, + 2, + 9, + 4, + 0, + 15, + 8, + 5, + 6, + 1 + ], + "weighted_loads": [ + 0.15237882733345032, + 0.4509270079433918, + 0.23900651931762695, + 0.9290671127964742, + 0.10383691638708115, + 0.0, + 0.19479619711637497, + 0.0, + 0.12149733677506447, + 1.2851620763540268, + 1.3019492626190186, + 0.13960875384509563, + 0.35099899768829346, + 1.023770209401846, + 0.27166515588760376, + 0.27783308550715446, + 0.6024695113301277, + 0.13918394595384598, + 0.6982870206702501, + 0.09061743319034576, + 0.45338140800595284, + 0.5527338534593582, + 0.5542302895337343, + 0.17665883898735046, + 0.16075846180319786, + 0.7069974206387997, + 0.8348015807569027, + 0.29224591702222824, + 0.4493975527584553, + 2.2968901600688696, + 0.13825634121894836, + 0.32216146774590015, + 0.3329878933727741, + 0.3747376333922148, + 1.709853231557645, + 0.0, + 0.12605061382055283, + 0.40492432564496994, + 1.240784179419279, + 0.5577624700963497, + 0.19850825145840645, + 0.31804598549206275, + 0.6069339513778687, + 0.6071968227624893, + 0.0924537219107151, + 0.20967601600568742, + 1.2934719622135162, + 0.6639963760972023, + 0.02982325665652752, + 0.6582556571811438, + 0.38054074347019196, + 0.05454187095165253, + 0.7620214447379112, + 0.2519992105662823, + 0.7653055340051651, + 0.13966599106788635, + 0.6631080433726311, + 0.16819792613387108, + 0.0, + 0.8562266994267702, + 1.158733919262886, + 0.4186691977083683, + 0.4009474068880081, + 0.044050849974155426 + ], + "unique_experts": 60, + "load_cv": 0.8508574106942558, + "normalized_load_entropy": 0.9249605699177569, + "max_load_share": 0.08333333333333333 + } + }, + "s0_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "dfb30ccb33ab0bb8e973a7fd549d968b6a254e7f6cb625d39bc44de64d7b443d", + "route_weight_sha256": "a4b7eff797b2515a395d918f1b3e9f561f6acd94d145ef14f71b4cf094ff1e36", + "loads": [ + 1, + 7, + 1, + 2, + 1, + 0, + 0, + 0, + 2, + 3, + 2, + 2, + 4, + 0, + 4, + 0, + 3, + 1, + 0, + 0, + 5, + 2, + 3, + 1, + 2, + 0, + 0, + 3, + 4, + 8, + 2, + 3, + 5, + 4, + 2, + 0, + 2, + 3, + 1, + 3, + 1, + 1, + 2, + 7, + 1, + 2, + 1, + 3, + 1, + 7, + 4, + 1, + 3, + 1, + 3, + 2, + 4, + 2, + 0, + 1, + 0, + 3, + 2, + 0 + ], + "weighted_loads": [ + 0.05551004409790039, + 0.35234009101986885, + 0.07157290726900101, + 0.10639054700732231, + 0.09832371771335602, + 0.0, + 0.0, + 0.0, + 0.11096636205911636, + 0.20194599032402039, + 0.7038522362709045, + 0.12247556447982788, + 0.23068850487470627, + 0.0, + 0.194450993090868, + 0.0, + 0.23866578191518784, + 0.06967779994010925, + 0.0, + 0.0, + 0.38558774068951607, + 0.2003457471728325, + 0.2107752002775669, + 0.08026368916034698, + 0.15823106467723846, + 0.0, + 0.0, + 0.2589212507009506, + 0.3840104006230831, + 0.7430770136415958, + 0.13775310665369034, + 0.3193676769733429, + 0.29009315371513367, + 0.37763451412320137, + 0.13668668270111084, + 0.0, + 0.1204734593629837, + 0.2846301645040512, + 0.052566200494766235, + 0.32638413459062576, + 0.037806883454322815, + 0.03398086875677109, + 0.17607847228646278, + 0.6123117096722126, + 0.056493207812309265, + 0.07839104533195496, + 0.046008408069610596, + 0.3114975392818451, + 0.037441156804561615, + 0.5935354977846146, + 0.28393468260765076, + 0.052740678191185, + 0.3308097943663597, + 0.059030480682849884, + 0.2085258662700653, + 0.13167691603302956, + 0.22781124711036682, + 0.09859290719032288, + 0.0, + 0.03872532770037651, + 0.0, + 0.21182888373732567, + 0.08922073245048523, + 0.0 + ], + "unique_experts": 51, + "load_cv": 0.8761825507357589, + "normalized_load_entropy": 0.9015686934776641, + "max_load_share": 0.057971014492753624 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "43bf02028bd49fda8e5a9d5219c32f86c00f53ba8f732a85dbf60cc6c8bfd1f6", + "route_weight_sha256": "9bbde17650d131c7c3d2dfddc827617fb9722ceccc414aa74422e3a1b44431a0", + "loads": [ + 1, + 11, + 4, + 6, + 1, + 0, + 0, + 0, + 2, + 3, + 13, + 3, + 4, + 12, + 6, + 3, + 3, + 1, + 4, + 0, + 5, + 3, + 5, + 1, + 2, + 6, + 6, + 3, + 5, + 27, + 2, + 4, + 5, + 5, + 12, + 0, + 2, + 5, + 2, + 3, + 5, + 4, + 11, + 7, + 1, + 4, + 14, + 3, + 3, + 8, + 5, + 1, + 3, + 1, + 3, + 2, + 4, + 2, + 0, + 15, + 4, + 3, + 5, + 0 + ], + "weighted_loads": [ + 0.05551004409790039, + 0.5733206756412983, + 0.22485487908124924, + 0.43879754762747325, + 0.09832371771335602, + 0.0, + 0.0, + 0.0, + 0.11096636205911636, + 0.20194599032402039, + 1.5780360903590918, + 0.13958323560655117, + 0.23068850487470627, + 0.9037983603775501, + 0.24034359864890575, + 0.19858058542013168, + 0.23866578191518784, + 0.06967779994010925, + 0.23215031196014024, + 0.0, + 0.38558774068951607, + 0.4915709123015404, + 0.2850443869829178, + 0.08026368916034698, + 0.15823106467723846, + 0.3989921994507313, + 0.5829502455890179, + 0.2589212507009506, + 0.4335225261747837, + 2.1795678730413783, + 0.13775310665369034, + 0.33773317746818066, + 0.29009315371513367, + 0.4029858913272619, + 1.22577061879565, + 0.0, + 0.1204734593629837, + 0.3644688352942467, + 1.0493609607219696, + 0.32638413459062576, + 0.23519394546747208, + 0.19952942058444023, + 0.5734486132860184, + 0.6123117096722126, + 0.056493207812309265, + 0.3296588584780693, + 1.4395142123103142, + 0.3114975392818451, + 0.11753573268651962, + 0.6215702462941408, + 0.330620888620615, + 0.052740678191185, + 0.3308097943663597, + 0.059030480682849884, + 0.2085258662700653, + 0.13167691603302956, + 0.22781124711036682, + 0.09859290719032288, + 0.0, + 0.8880197536200285, + 0.47673497069627047, + 0.21182888373732567, + 0.3020658306777477, + 0.0 + ], + "unique_experts": 57, + "load_cv": 1.0038506110884806, + "normalized_load_entropy": 0.9011353005111526, + "max_load_share": 0.09375 + } + }, + "s1_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "0825a8de8f5af8f51789d6bfa872f90b39daf9374d3a6527e5161aec37037ce1", + "route_weight_sha256": "3bb35324e45696b56939917bda0b0f890248ce11d6e52d80d897ec2f64b3fbed", + "loads": [ + 1, + 5, + 1, + 2, + 1, + 0, + 0, + 0, + 2, + 4, + 2, + 2, + 4, + 0, + 4, + 0, + 3, + 1, + 0, + 0, + 5, + 2, + 3, + 1, + 2, + 0, + 0, + 3, + 4, + 6, + 2, + 3, + 7, + 4, + 2, + 0, + 2, + 3, + 1, + 3, + 1, + 1, + 2, + 7, + 1, + 2, + 1, + 3, + 0, + 7, + 4, + 1, + 3, + 1, + 3, + 2, + 4, + 2, + 2, + 1, + 0, + 3, + 2, + 0 + ], + "weighted_loads": [ + 0.05778686702251434, + 0.25099508464336395, + 0.07435084879398346, + 0.11166810989379883, + 0.10156268626451492, + 0.0, + 0.0, + 0.0, + 0.1204235628247261, + 0.24982408434152603, + 0.6836375296115875, + 0.11798486858606339, + 0.24954036250710487, + 0.0, + 0.1976459138095379, + 0.0, + 0.2305486537516117, + 0.06944844871759415, + 0.0, + 0.0, + 0.398459542542696, + 0.21857833117246628, + 0.21212876588106155, + 0.08680719882249832, + 0.15913458913564682, + 0.0, + 0.0, + 0.295761302113533, + 0.39104916527867317, + 0.5582773312926292, + 0.14615296199917793, + 0.30755727365612984, + 0.38542234897613525, + 0.36234889551997185, + 0.12305154651403427, + 0.0, + 0.12527942657470703, + 0.2840333357453346, + 0.05251862108707428, + 0.3361991420388222, + 0.039029810577631, + 0.035661887377500534, + 0.1752561815083027, + 0.5979659594595432, + 0.060859229415655136, + 0.06894997134804726, + 0.04668392986059189, + 0.318128801882267, + 0.0, + 0.5523891113698483, + 0.2918938957154751, + 0.0534292533993721, + 0.34755975008010864, + 0.06650018692016602, + 0.2271844707429409, + 0.13981400430202484, + 0.24512970075011253, + 0.0938090905547142, + 0.0733984000980854, + 0.03634393960237503, + 0.0, + 0.22115030884742737, + 0.08854954317212105, + 0.0 + ], + "unique_experts": 51, + "load_cv": 0.8409544392118266, + "normalized_load_entropy": 0.9054879114702203, + "max_load_share": 0.050724637681159424 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "2430143b15d672095982ab6a74b56683fd8d51e5b6d42f6839a5c2871c2ce1ae", + "route_weight_sha256": "499e7f9e4ea6fb2f4e5ec95a0d4e82e5c11a33919913d051fe9e48ea00a17170", + "loads": [ + 1, + 8, + 5, + 11, + 1, + 0, + 2, + 0, + 2, + 13, + 12, + 3, + 5, + 14, + 7, + 4, + 5, + 3, + 7, + 2, + 6, + 4, + 8, + 2, + 2, + 10, + 9, + 3, + 5, + 28, + 2, + 4, + 7, + 5, + 17, + 0, + 2, + 6, + 5, + 6, + 5, + 7, + 12, + 7, + 2, + 5, + 13, + 7, + 1, + 9, + 6, + 1, + 7, + 5, + 9, + 2, + 9, + 4, + 2, + 16, + 7, + 5, + 6, + 1 + ], + "weighted_loads": [ + 0.05778686702251434, + 0.4536394886672497, + 0.27860698103904724, + 0.9220603670109995, + 0.10156268626451492, + 0.0, + 0.14489996060729027, + 0.0, + 0.1204235628247261, + 1.3308601938188076, + 1.462903380393982, + 0.13509253971278667, + 0.3567652516067028, + 0.9946330189704895, + 0.27262378111481667, + 0.28039465099573135, + 0.5948620773851871, + 0.13954142481088638, + 0.5640239000786096, + 0.09061743319034576, + 0.4472181461751461, + 0.5505925491452217, + 0.5771382711827755, + 0.1797807291150093, + 0.15913458913564682, + 0.6532495468854904, + 0.8696936741471291, + 0.295761302113533, + 0.43864527344703674, + 1.8000713493674994, + 0.14615296199917793, + 0.3259227741509676, + 0.38542234897613525, + 0.3877002727240324, + 1.4757589210057631, + 0.0, + 0.12527942657470703, + 0.4089312180876732, + 1.293038520962, + 0.5484885685145855, + 0.2515283152461052, + 0.3556144615431549, + 0.6458462364971638, + 0.5979659594595432, + 0.0986795611679554, + 0.19791217136662453, + 1.5006085075438023, + 0.6556859910488129, + 0.02982325665652752, + 0.6159744244068861, + 0.38413793221116066, + 0.0534292533993721, + 0.7865198627114296, + 0.24978220835328102, + 0.7765687443315983, + 0.13981400430202484, + 0.6695984490215778, + 0.16783346235752106, + 0.0733984000980854, + 0.9566501043736935, + 0.9250461608171463, + 0.418200820684433, + 0.386210348457098, + 0.044050849974155426 + ], + "unique_experts": 61, + "load_cv": 0.800932616114212, + "normalized_load_entropy": 0.9298902542737616, + "max_load_share": 0.07291666666666667 + } + }, + "s0_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "49a157badf0948a8144f299ad531c33cbda15d2641dcb3d3623ceaa7b637c614", + "route_weight_sha256": "fa572f6a5f546cf4234fc23457e355457247866d32a2beb56b35f426688a09ba", + "loads": [ + 1, + 7, + 1, + 2, + 1, + 0, + 0, + 0, + 2, + 3, + 2, + 2, + 4, + 0, + 4, + 0, + 3, + 1, + 0, + 0, + 5, + 2, + 3, + 1, + 2, + 0, + 0, + 3, + 4, + 9, + 2, + 3, + 6, + 4, + 2, + 0, + 2, + 3, + 1, + 3, + 1, + 1, + 2, + 7, + 1, + 2, + 1, + 3, + 0, + 7, + 3, + 1, + 3, + 1, + 3, + 2, + 4, + 2, + 1, + 1, + 0, + 3, + 1, + 0 + ], + "weighted_loads": [ + 0.05497113987803459, + 0.35248370096087456, + 0.07264629751443863, + 0.10993574187159538, + 0.10229946672916412, + 0.0, + 0.0, + 0.0, + 0.11419222876429558, + 0.20309798419475555, + 0.6937833428382874, + 0.12027255445718765, + 0.23807939514517784, + 0.0, + 0.19426214881241322, + 0.0, + 0.23939615115523338, + 0.07074454426765442, + 0.0, + 0.0, + 0.3884243480861187, + 0.19827315211296082, + 0.21309875324368477, + 0.08250892162322998, + 0.16004468500614166, + 0.0, + 0.0, + 0.26494646072387695, + 0.3933822996914387, + 0.7724182941019535, + 0.13994699344038963, + 0.3139948919415474, + 0.3317559100687504, + 0.38078464940190315, + 0.1406465508043766, + 0.0, + 0.1169981062412262, + 0.2889232113957405, + 0.05448358878493309, + 0.3392852917313576, + 0.03787798807024956, + 0.03423551842570305, + 0.17772478610277176, + 0.6062421686947346, + 0.05620429664850235, + 0.07902119308710098, + 0.04629484564065933, + 0.3136427700519562, + 0.0, + 0.604566503316164, + 0.23633484914898872, + 0.051785342395305634, + 0.34270693361759186, + 0.05927403271198273, + 0.21927352622151375, + 0.1333758383989334, + 0.23113683611154556, + 0.09797407314181328, + 0.037217628210783005, + 0.03878433257341385, + 0.0, + 0.21757714077830315, + 0.04726120084524155, + 0.0 + ], + "unique_experts": 51, + "load_cv": 0.9100479963153392, + "normalized_load_entropy": 0.8977228637131299, + "max_load_share": 0.06521739130434782 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "ad52fa8a6034a10d6d6bef4a71e7b246cea50360292bd4a8d80b145051d894cb", + "route_weight_sha256": "a346d812fb738af5da2ce4f6dfd4fc26bc3fdc0aba2f79f44577822c43210d0f", + "loads": [ + 1, + 11, + 3, + 6, + 1, + 0, + 0, + 0, + 2, + 3, + 12, + 3, + 4, + 12, + 6, + 3, + 3, + 1, + 4, + 0, + 5, + 3, + 6, + 1, + 2, + 6, + 7, + 3, + 5, + 29, + 2, + 4, + 6, + 5, + 12, + 0, + 2, + 5, + 2, + 3, + 4, + 4, + 10, + 7, + 1, + 4, + 13, + 3, + 2, + 8, + 4, + 2, + 4, + 1, + 3, + 2, + 4, + 2, + 1, + 15, + 4, + 3, + 4, + 0 + ], + "weighted_loads": [ + 0.05497113987803459, + 0.5828443728387356, + 0.1948193982243538, + 0.43413897525169887, + 0.10229946672916412, + 0.0, + 0.0, + 0.0, + 0.11419222876429558, + 0.20309798419475555, + 1.3512650039047003, + 0.13738022558391094, + 0.23807939514517784, + 0.8827977441251278, + 0.24015475437045097, + 0.18360726535320282, + 0.23939615115523338, + 0.07074454426765442, + 0.2472464175953064, + 0.0, + 0.3884243480861187, + 0.4894983172416687, + 0.32732443884015083, + 0.08250892162322998, + 0.16004468500614166, + 0.3776233419775963, + 0.8546655885875225, + 0.26494646072387695, + 0.4441819339990616, + 2.238850891153561, + 0.13994699344038963, + 0.33236039243638515, + 0.3317559100687504, + 0.4061360266059637, + 1.2236797437362839, + 0.0, + 0.1169981062412262, + 0.3694513514637947, + 1.0512783490121365, + 0.3392852917313576, + 0.17857626080513, + 0.1929926835000515, + 0.5394054912030697, + 0.6062421686947346, + 0.05620429664850235, + 0.354883074760437, + 1.3554891720414162, + 0.3136427700519562, + 0.0910494439303875, + 0.6326012518256903, + 0.283021055161953, + 0.17880109697580338, + 0.40739232301712036, + 0.05927403271198273, + 0.21927352622151375, + 0.1333758383989334, + 0.23113683611154556, + 0.09797407314181328, + 0.037217628210783005, + 0.8871158231049776, + 0.47228084970265627, + 0.21757714077830315, + 0.26053738221526146, + 0.0 + ], + "unique_experts": 58, + "load_cv": 1.0213764617139018, + "normalized_load_entropy": 0.9024433039090812, + "max_load_share": 0.10069444444444445 + } + }, + "s1_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "f7fb0bc1730c8f344968ae516b8d9860256b356d6bdc8e5fc4d0fd875d6e3122", + "route_weight_sha256": "9e9cfb9c1d82051f87796a49f2ba2510a165a24b449b911fa954811d8fd49a59", + "loads": [ + 2, + 6, + 1, + 2, + 1, + 0, + 0, + 0, + 2, + 4, + 2, + 2, + 4, + 0, + 4, + 0, + 3, + 1, + 0, + 0, + 5, + 2, + 3, + 1, + 2, + 0, + 0, + 3, + 4, + 6, + 2, + 3, + 6, + 4, + 2, + 0, + 2, + 3, + 1, + 3, + 1, + 1, + 2, + 7, + 1, + 2, + 1, + 3, + 0, + 7, + 4, + 1, + 3, + 1, + 3, + 2, + 4, + 2, + 1, + 1, + 0, + 3, + 2, + 0 + ], + "weighted_loads": [ + 0.0962873138487339, + 0.2887214906513691, + 0.07507786899805069, + 0.11583561822772026, + 0.1039617583155632, + 0.0, + 0.0, + 0.0, + 0.12155220285058022, + 0.25491174310445786, + 0.6841490864753723, + 0.11609632894396782, + 0.25134149193763733, + 0.0, + 0.19986790232360363, + 0.0, + 0.2335936576128006, + 0.07015682756900787, + 0.0, + 0.0, + 0.40568437427282333, + 0.21445376425981522, + 0.21129406243562698, + 0.0863388255238533, + 0.15966153889894485, + 0.0, + 0.0, + 0.29888471215963364, + 0.39928119629621506, + 0.5289429351687431, + 0.14657827466726303, + 0.3041820824146271, + 0.33888643980026245, + 0.36606116965413094, + 0.1213173046708107, + 0.0, + 0.11974010989069939, + 0.288032203912735, + 0.0526183657348156, + 0.34748053550720215, + 0.038290202617645264, + 0.03557306528091431, + 0.17620103619992733, + 0.6040775924921036, + 0.06031394749879837, + 0.07136433944106102, + 0.047461435198783875, + 0.3214026838541031, + 0.0, + 0.5801833309233189, + 0.28453942760825157, + 0.05337711423635483, + 0.348814457654953, + 0.06641644239425659, + 0.22429954633116722, + 0.13962814211845398, + 0.25279704853892326, + 0.0923209935426712, + 0.03361507132649422, + 0.036362066864967346, + 0.0, + 0.22673165053129196, + 0.08752134814858437, + 0.0 + ], + "unique_experts": 51, + "load_cv": 0.8369486793032412, + "normalized_load_entropy": 0.9057796686202038, + "max_load_share": 0.050724637681159424 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "f792f2b53677e524199db7e9c9287180ae57fc5c4c18ea687ab9d65721279e76", + "route_weight_sha256": "86eef54d38d966f0eeb4a747ee68532b9cb1b47971ca7188e42e017f17f366cd", + "loads": [ + 2, + 9, + 4, + 11, + 1, + 0, + 2, + 0, + 2, + 13, + 11, + 3, + 5, + 14, + 7, + 4, + 5, + 3, + 7, + 2, + 6, + 4, + 9, + 2, + 2, + 10, + 10, + 3, + 5, + 28, + 2, + 4, + 6, + 5, + 16, + 0, + 2, + 7, + 5, + 6, + 4, + 7, + 11, + 7, + 2, + 5, + 12, + 7, + 1, + 9, + 6, + 2, + 8, + 5, + 9, + 2, + 9, + 4, + 1, + 16, + 7, + 5, + 6, + 2 + ], + "weighted_loads": [ + 0.0962873138487339, + 0.4784841984510422, + 0.2448718398809433, + 0.92037984757917, + 0.1039617583155632, + 0.0, + 0.14489996060729027, + 0.0, + 0.12155220285058022, + 1.3359478525817394, + 1.275191605091095, + 0.1332040000706911, + 0.35856638103723526, + 0.9667147323489189, + 0.2748457696288824, + 0.28933655470609665, + 0.597907081246376, + 0.1402498036623001, + 0.567215669201687, + 0.09061743319034576, + 0.45444297790527344, + 0.5464679822325706, + 0.6162177883088589, + 0.1793123558163643, + 0.15966153889894485, + 0.6192620694637299, + 1.170645646750927, + 0.29888471215963364, + 0.4485211446881294, + 1.7534138914197683, + 0.14657827466726303, + 0.32254758290946484, + 0.33888643980026245, + 0.3914125468581915, + 1.4110573265934363, + 0.0, + 0.11974010989069939, + 0.45672664791345596, + 1.3012806549668312, + 0.5597699619829655, + 0.19722069054841995, + 0.36525647396047134, + 0.6063958127051592, + 0.6040775924921036, + 0.09813427925109863, + 0.19872078287880868, + 1.3544199727475643, + 0.658959873020649, + 0.02982325665652752, + 0.6437686439603567, + 0.37678346410393715, + 0.15010587871074677, + 0.8407818712294102, + 0.2496984638273716, + 0.7736838199198246, + 0.13962814211845398, + 0.6772657968103886, + 0.16634536534547806, + 0.03361507132649422, + 1.013736568391323, + 0.9142714068293571, + 0.4237821623682976, + 0.3970012702047825, + 0.07453523203730583 + ], + "unique_experts": 61, + "load_cv": 0.7878196000495432, + "normalized_load_entropy": 0.9323324411128006, + "max_load_share": 0.07291666666666667 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "ordered_topk_exact_tokens": 19, + "set_exact_tokens": 21, + "mean_set_jaccard": 0.9751552795031057, + "mean_token_weighted_tv": 0.00901200662812461, + "aggregate_load_tv": 0.014492753623188406 + }, + "system_bos": { + "tokens": 23, + "ordered_topk_exact_tokens": 16, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.9254658385093167, + "mean_token_weighted_tv": 0.021523696410915127, + "aggregate_load_tv": 0.043478260869565216 + }, + "system_x": { + "tokens": 23, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 18, + "mean_set_jaccard": 0.9378881987577641, + "mean_token_weighted_tv": 0.02228431622295276, + "aggregate_load_tv": 0.036231884057971016 + }, + "system_period": { + "tokens": 23, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 18, + "mean_set_jaccard": 0.9378881987577641, + "mean_token_weighted_tv": 0.02117974792971559, + "aggregate_load_tv": 0.028985507246376815 + }, + "bos_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.9254658385093169, + "mean_token_weighted_tv": 0.02370419450428175, + "aggregate_load_tv": 0.021739130434782608 + }, + "bos_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.9037267080745343, + "mean_token_weighted_tv": 0.03331131245131078, + "aggregate_load_tv": 0.050724637681159424 + }, + "x_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.9254658385093167, + "mean_token_weighted_tv": 0.025497723816205627, + "aggregate_load_tv": 0.03623188405797102 + }, + "x_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.9006211180124224, + "mean_token_weighted_tv": 0.03750405027328626, + "aggregate_load_tv": 0.05797101449275363 + }, + "period_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.9503105590062112, + "mean_token_weighted_tv": 0.02198740281164646, + "aggregate_load_tv": 0.028985507246376812 + }, + "period_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.9006211180124224, + "mean_token_weighted_tv": 0.03901252948233615, + "aggregate_load_tv": 0.050724637681159424 + } + } + }, + "layer_05": { + "layer": 5, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "9f751eecaf07c9d3fd4388022acab01be8683acdd404cef9cf18ce2e851a2e78", + "route_weight_sha256": "140cc9f1148e7fd38e2c601205cc9a61af42d2dc4d7664c75d0ea704c716fcee", + "loads": [ + 0, + 2, + 0, + 0, + 3, + 0, + 1, + 1, + 6, + 6, + 1, + 2, + 3, + 1, + 0, + 0, + 1, + 4, + 2, + 0, + 4, + 2, + 2, + 0, + 1, + 0, + 2, + 3, + 6, + 1, + 4, + 2, + 7, + 6, + 1, + 5, + 2, + 3, + 2, + 0, + 1, + 0, + 2, + 3, + 5, + 0, + 1, + 3, + 0, + 0, + 0, + 1, + 2, + 2, + 3, + 3, + 3, + 1, + 4, + 0, + 1, + 7, + 5, + 5 + ], + "weighted_loads": [ + 0.0, + 0.27809253334999084, + 0.0, + 0.0, + 0.22664662823081017, + 0.0, + 0.07473825663328171, + 0.05849453806877136, + 0.6388550736010075, + 0.3675047680735588, + 0.05249806493520737, + 0.08040746487677097, + 0.2643924951553345, + 0.04485142230987549, + 0.0, + 0.0, + 0.04059584066271782, + 0.34864524006843567, + 0.13885584101080894, + 0.0, + 0.4208461716771126, + 0.18968725949525833, + 0.10068970918655396, + 0.0, + 0.09713365882635117, + 0.0, + 0.09470491111278534, + 0.1684659644961357, + 0.5184344165027142, + 0.04772124066948891, + 0.16206949949264526, + 0.11242533102631569, + 0.6231211200356483, + 0.40274881199002266, + 0.050608180463314056, + 0.31514739990234375, + 0.08950745314359665, + 0.2437661737203598, + 0.08848398551344872, + 0.0, + 0.2956089973449707, + 0.0, + 0.28868139535188675, + 0.3017772510647774, + 0.2998148538172245, + 0.0, + 0.04777824506163597, + 0.16350603476166725, + 0.0, + 0.0, + 0.0, + 0.03815126791596413, + 0.22425121068954468, + 0.14654218405485153, + 0.2891091853380203, + 0.2604546658694744, + 0.2314695045351982, + 0.04771524667739868, + 0.33292384445667267, + 0.0, + 0.039364662021398544, + 0.5769626796245575, + 0.31472640112042427, + 0.40206000953912735 + ], + "unique_experts": 48, + "load_cv": 0.91740389670136, + "normalized_load_entropy": 0.8869586433478922, + "max_load_share": 0.050724637681159424 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "1948d2ac755c2f7fb0588d7d0d9450d431d5f94ca56718ecb62f8ec48d362a97", + "route_weight_sha256": "0870e0eaf6865542e40404f55ca8619e42c5b898ddb8caf7d35b5530566df3d6", + "loads": [ + 0, + 3, + 0, + 0, + 4, + 2, + 2, + 2, + 8, + 8, + 12, + 2, + 5, + 1, + 0, + 13, + 3, + 10, + 11, + 1, + 6, + 2, + 2, + 0, + 1, + 8, + 2, + 3, + 6, + 2, + 4, + 2, + 7, + 6, + 1, + 9, + 2, + 3, + 14, + 8, + 5, + 8, + 9, + 4, + 6, + 0, + 1, + 5, + 0, + 4, + 8, + 1, + 4, + 10, + 6, + 13, + 3, + 1, + 4, + 1, + 1, + 7, + 5, + 7 + ], + "weighted_loads": [ + 0.0, + 0.2816131964791566, + 0.0, + 0.0, + 0.22841492015868425, + 0.06773566827178001, + 0.10648554936051369, + 0.06155947200022638, + 0.6784621272236109, + 0.41868044110015035, + 0.7104411832988262, + 0.08040746487677097, + 0.39297257363796234, + 0.04485142230987549, + 0.0, + 2.1809718175791204, + 0.1802012138068676, + 0.6458325535058975, + 1.0253256931900978, + 0.013061463832855225, + 0.4363020828459412, + 0.18968725949525833, + 0.10068970918655396, + 0.0, + 0.09713365882635117, + 0.9019144475460052, + 0.09470491111278534, + 0.1684659644961357, + 0.5184344165027142, + 0.1358056180179119, + 0.16206949949264526, + 0.11242533102631569, + 0.6231211200356483, + 0.40274881199002266, + 0.050608180463314056, + 0.6281196549534798, + 0.08950745314359665, + 0.2437661737203598, + 1.2286716401576996, + 0.587898526340723, + 0.47048405930399895, + 0.8850078023970127, + 1.0301674529910088, + 0.34173019602894783, + 0.38170747086405754, + 0.0, + 0.04777824506163597, + 0.1814785455353558, + 0.0, + 0.24719146639108658, + 0.8103769309818745, + 0.03815126791596413, + 1.8535980582237244, + 0.6859532073140144, + 0.30599625315517187, + 0.9979056492447853, + 0.2314695045351982, + 0.04771524667739868, + 0.33292384445667267, + 0.04566708207130432, + 0.039364662021398544, + 0.5769626796245575, + 0.31472640112042427, + 1.3375116847455502 + ], + "unique_experts": 57, + "load_cv": 0.8174410538645644, + "normalized_load_entropy": 0.9144312276065562, + "max_load_share": 0.04861111111111111 + } + }, + "s1_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "fc996deb8fe5c4c7546da4d9074a73afd746b7c1a6e0969570969115da016152", + "route_weight_sha256": "c50288a1022dd0dc4ba493e10f7c8708f3f7df67136984ae711dcbec0a565f14", + "loads": [ + 0, + 2, + 0, + 0, + 3, + 0, + 1, + 1, + 5, + 6, + 1, + 2, + 3, + 2, + 0, + 0, + 1, + 4, + 2, + 0, + 4, + 2, + 2, + 0, + 1, + 0, + 2, + 3, + 7, + 1, + 4, + 2, + 7, + 6, + 1, + 4, + 2, + 3, + 2, + 0, + 1, + 0, + 3, + 3, + 5, + 0, + 1, + 2, + 0, + 0, + 0, + 1, + 2, + 2, + 3, + 3, + 3, + 1, + 4, + 0, + 1, + 7, + 5, + 5 + ], + "weighted_loads": [ + 0.0, + 0.26153896749019623, + 0.0, + 0.0, + 0.23481160029768944, + 0.0, + 0.08875597268342972, + 0.057895269244909286, + 0.5886396951973438, + 0.3721529617905617, + 0.05525919422507286, + 0.08295171335339546, + 0.26394135504961014, + 0.09158091619610786, + 0.0, + 0.0, + 0.03740592673420906, + 0.344600073993206, + 0.13564668595790863, + 0.0, + 0.4311761260032654, + 0.18644214421510696, + 0.10047387704253197, + 0.0, + 0.09638430923223495, + 0.0, + 0.09595126658678055, + 0.17157277837395668, + 0.5545037016272545, + 0.05004017427563667, + 0.1634780466556549, + 0.10756510123610497, + 0.6092777326703072, + 0.393088199198246, + 0.05092262849211693, + 0.26436201855540276, + 0.08441829681396484, + 0.24496424198150635, + 0.0882236547768116, + 0.0, + 0.30062136054039, + 0.0, + 0.3474268764257431, + 0.30009830743074417, + 0.2966633252799511, + 0.0, + 0.046521011739969254, + 0.12789826467633247, + 0.0, + 0.0, + 0.0, + 0.03741937875747681, + 0.2166452333331108, + 0.15038910508155823, + 0.2963969334959984, + 0.2668960876762867, + 0.23214927688241005, + 0.04613521322607994, + 0.33404095470905304, + 0.0, + 0.03895730897784233, + 0.5634302571415901, + 0.3084379620850086, + 0.3999379649758339 + ], + "unique_experts": 48, + "load_cv": 0.9100479963153392, + "normalized_load_entropy": 0.8886108964327359, + "max_load_share": 0.050724637681159424 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "1c6c9f93e1cd5f643f69db8d05454c87d59ff0ad708319a56ca50522afefc5e2", + "route_weight_sha256": "1f10d4db936a629da0e3522e56396bb7cdcd6f9737cef6f83612236f88220001", + "loads": [ + 1, + 4, + 0, + 6, + 4, + 2, + 9, + 3, + 7, + 8, + 15, + 5, + 7, + 2, + 1, + 15, + 4, + 15, + 14, + 10, + 6, + 2, + 3, + 0, + 2, + 8, + 2, + 5, + 7, + 4, + 4, + 2, + 8, + 7, + 2, + 8, + 3, + 6, + 15, + 12, + 5, + 13, + 14, + 7, + 6, + 0, + 1, + 5, + 0, + 14, + 10, + 2, + 4, + 12, + 7, + 13, + 3, + 1, + 5, + 1, + 2, + 7, + 5, + 9 + ], + "weighted_loads": [ + 0.03667677193880081, + 0.28564164019189775, + 0.0, + 0.41302134841680527, + 0.23658668843563646, + 0.07258510962128639, + 1.0619712099432945, + 0.11247337958775461, + 0.6276649271603674, + 0.42539839539676905, + 0.9015325997024775, + 0.45234448835253716, + 0.6212681867182255, + 0.09158091619610786, + 0.033525049686431885, + 2.6408810992725194, + 0.2614080645143986, + 1.0246081426739693, + 1.3554068319499493, + 0.8553846627473831, + 0.44651495036669075, + 0.18644214421510696, + 0.13785230740904808, + 0.0, + 0.1739431917667389, + 0.7196703087538481, + 0.09595126658678055, + 0.3449261896312237, + 0.5545037016272545, + 0.22152568027377129, + 0.1634780466556549, + 0.10756510123610497, + 0.7290524765849113, + 0.43600963056087494, + 0.08581969141960144, + 0.6982233338057995, + 0.12971343100070953, + 0.39707498997449875, + 1.3725694045424461, + 1.0502404756844044, + 0.462700929492712, + 1.3197764419019222, + 1.385872207581997, + 0.5386950857937336, + 0.3587105721235275, + 0.0, + 0.046521011739969254, + 0.1788540177512914, + 0.0, + 0.8869969695806503, + 1.2741812616586685, + 0.0857338234782219, + 1.8458774015307426, + 0.9643123485147953, + 0.35101824440062046, + 0.8838104419410229, + 0.23214927688241005, + 0.04613521322607994, + 0.4037574976682663, + 0.04692578688263893, + 0.08432525023818016, + 0.5634302571415901, + 0.3084379620850086, + 1.5769508220255375 + ], + "unique_experts": 60, + "load_cv": 0.7330255035732992, + "normalized_load_entropy": 0.9315445439009999, + "max_load_share": 0.0390625 + } + }, + "s0_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "2205cc8caa6e2c6b7f26ae1d788ae51d8aefa2df96cee0501b535c9ea593aa31", + "route_weight_sha256": "2db20e6a89048599b0bc8475294da8f82b569c6825fa015593bba1ea2f2bf264", + "loads": [ + 0, + 2, + 0, + 0, + 3, + 0, + 2, + 1, + 5, + 5, + 1, + 2, + 3, + 2, + 0, + 0, + 1, + 4, + 2, + 0, + 4, + 2, + 2, + 0, + 1, + 0, + 2, + 3, + 6, + 1, + 4, + 2, + 7, + 6, + 1, + 4, + 2, + 3, + 1, + 0, + 1, + 0, + 3, + 3, + 5, + 0, + 1, + 3, + 0, + 0, + 0, + 1, + 2, + 2, + 3, + 3, + 3, + 1, + 4, + 0, + 1, + 8, + 5, + 5 + ], + "weighted_loads": [ + 0.0, + 0.2620956599712372, + 0.0, + 0.0, + 0.23191269114613533, + 0.0, + 0.12617527320981026, + 0.05521736666560173, + 0.5288922749459743, + 0.33820008113980293, + 0.050279513001441956, + 0.08322018757462502, + 0.2521546706557274, + 0.10176388919353485, + 0.0, + 0.0, + 0.038626160472631454, + 0.34890950843691826, + 0.12645269185304642, + 0.0, + 0.45838140323758125, + 0.18880770727992058, + 0.09255852922797203, + 0.0, + 0.09945076704025269, + 0.0, + 0.09507856145501137, + 0.17105207964777946, + 0.5112267062067986, + 0.05235930532217026, + 0.18478558585047722, + 0.1229563057422638, + 0.6568814814090729, + 0.4176623523235321, + 0.051020391285419464, + 0.2855675630271435, + 0.08110557496547699, + 0.24075375497341156, + 0.04721993952989578, + 0.0, + 0.2862665355205536, + 0.0, + 0.3425218500196934, + 0.31667840480804443, + 0.2985556460916996, + 0.0, + 0.04884772375226021, + 0.1726568043231964, + 0.0, + 0.0, + 0.0, + 0.036636561155319214, + 0.21925733983516693, + 0.15576688945293427, + 0.28706301748752594, + 0.26763900369405746, + 0.24220313876867294, + 0.04678778350353241, + 0.339460089802742, + 0.0, + 0.04066850617527962, + 0.644945815205574, + 0.2918711192905903, + 0.40322667360305786 + ], + "unique_experts": 48, + "load_cv": 0.9026321518272475, + "normalized_load_entropy": 0.8897442792011009, + "max_load_share": 0.057971014492753624 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "b2018c85b7b5987a8df9aa26bcdbd9bd7ae8fa6f999987d8c92d2a76b5ff8d75", + "route_weight_sha256": "801962e4583d868723372bc80045c886c7077819667b734cc4582af2a65315ca", + "loads": [ + 0, + 3, + 0, + 0, + 3, + 2, + 4, + 2, + 6, + 7, + 12, + 2, + 6, + 2, + 0, + 14, + 3, + 10, + 12, + 1, + 5, + 2, + 2, + 0, + 1, + 8, + 2, + 3, + 6, + 2, + 4, + 2, + 7, + 6, + 1, + 8, + 2, + 3, + 13, + 9, + 5, + 8, + 11, + 4, + 6, + 0, + 1, + 4, + 0, + 4, + 7, + 1, + 3, + 10, + 5, + 14, + 3, + 1, + 4, + 1, + 1, + 8, + 5, + 7 + ], + "weighted_loads": [ + 0.0, + 0.26561632310040295, + 0.0, + 0.0, + 0.23191269114613533, + 0.06773566827178001, + 0.19469978660345078, + 0.058282300597056746, + 0.5322592314332724, + 0.419625461101532, + 0.7345562279224396, + 0.08322018757462502, + 0.4167827107012272, + 0.10176388919353485, + 0.0, + 2.18728863960132, + 0.176623847335577, + 0.6460968218743801, + 1.1280614882707596, + 0.013061463832855225, + 0.47093354538083076, + 0.18880770727992058, + 0.09255852922797203, + 0.0, + 0.09945076704025269, + 0.9019144475460052, + 0.09507856145501137, + 0.17105207964777946, + 0.5112267062067986, + 0.09785778447985649, + 0.18478558585047722, + 0.1229563057422638, + 0.6568814814090729, + 0.4176623523235321, + 0.051020391285419464, + 0.5985398180782795, + 0.08110557496547699, + 0.24075375497341156, + 1.2802354916930199, + 0.6304973848164082, + 0.46114159747958183, + 0.8833509869873524, + 1.1039844863116741, + 0.3583269752562046, + 0.38044826313853264, + 0.0, + 0.04884772375226021, + 0.1882185861468315, + 0.0, + 0.271678626537323, + 0.7383344061672688, + 0.036636561155319214, + 0.8841461390256882, + 0.6951779127120972, + 0.3020404458511621, + 1.0064679235219955, + 0.24220313876867294, + 0.04678778350353241, + 0.339460089802742, + 0.04566708207130432, + 0.04066850617527962, + 0.644945815205574, + 0.2918711192905903, + 1.3386783488094807 + ], + "unique_experts": 57, + "load_cv": 0.8305509104292252, + "normalized_load_entropy": 0.9139400603453436, + "max_load_share": 0.04861111111111111 + } + }, + "s1_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "818934f293d872d50d6f768fc0ff1ce7e493ec4904cbb4c06d6620b58f2b242c", + "route_weight_sha256": "a653a8a2d6f8c9f9c1fd80fb84469e3269a57a046cde258cb48cc69f162adba6", + "loads": [ + 0, + 2, + 0, + 0, + 3, + 0, + 2, + 1, + 5, + 5, + 1, + 2, + 3, + 2, + 0, + 0, + 1, + 4, + 2, + 0, + 4, + 2, + 2, + 0, + 1, + 0, + 2, + 3, + 6, + 1, + 4, + 2, + 7, + 6, + 1, + 4, + 2, + 3, + 1, + 0, + 3, + 0, + 3, + 3, + 4, + 0, + 1, + 3, + 0, + 0, + 0, + 1, + 2, + 2, + 3, + 2, + 3, + 1, + 4, + 0, + 1, + 8, + 5, + 5 + ], + "weighted_loads": [ + 0.0, + 0.2779563069343567, + 0.0, + 0.0, + 0.23873839899897575, + 0.0, + 0.13398733362555504, + 0.06267379969358444, + 0.551081757992506, + 0.34164202958345413, + 0.05033806338906288, + 0.08821652457118034, + 0.25250614434480667, + 0.09818898513913155, + 0.0, + 0.0, + 0.039691176265478134, + 0.3526337146759033, + 0.11382606253027916, + 0.0, + 0.43810784444212914, + 0.18645189329981804, + 0.10103589296340942, + 0.0, + 0.09933526813983917, + 0.0, + 0.09529054164886475, + 0.1882440596818924, + 0.5372915081679821, + 0.059804461896419525, + 0.17876356467604637, + 0.1304868645966053, + 0.6691430918872356, + 0.41427773609757423, + 0.04999485984444618, + 0.275896567851305, + 0.07600840553641319, + 0.23644935339689255, + 0.037817928940057755, + 0.0, + 0.36056819558143616, + 0.0, + 0.34724149107933044, + 0.31782418489456177, + 0.2571581341326237, + 0.0, + 0.04601943492889404, + 0.166367806494236, + 0.0, + 0.0, + 0.0, + 0.036498844623565674, + 0.21457038447260857, + 0.15869684517383575, + 0.2880135178565979, + 0.21949118748307228, + 0.249192513525486, + 0.04495437443256378, + 0.34344836324453354, + 0.0, + 0.0382770374417305, + 0.643225010484457, + 0.30431005731225014, + 0.40078847110271454 + ], + "unique_experts": 48, + "load_cv": 0.891392713894596, + "normalized_load_entropy": 0.891688289435928, + "max_load_share": 0.057971014492753624 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "1282a8a8555907886a0c5c30a297d7f8a3a251a5415c0d438ec5dcfbbfe91b91", + "route_weight_sha256": "4b5f3e8cdb26a648471f4bec2bd16c01fff91a55e43c4725efc207ba74184a7c", + "loads": [ + 1, + 4, + 0, + 6, + 3, + 2, + 11, + 3, + 6, + 6, + 15, + 5, + 8, + 2, + 1, + 16, + 5, + 15, + 16, + 10, + 5, + 2, + 3, + 0, + 2, + 8, + 2, + 5, + 6, + 4, + 4, + 2, + 8, + 7, + 2, + 8, + 3, + 6, + 14, + 12, + 6, + 13, + 15, + 7, + 5, + 0, + 1, + 5, + 0, + 13, + 11, + 2, + 3, + 12, + 6, + 13, + 3, + 1, + 5, + 1, + 2, + 8, + 5, + 9 + ], + "weighted_loads": [ + 0.03667677193880081, + 0.3020589796360582, + 0.0, + 0.41302134841680527, + 0.23873839899897575, + 0.07258510962128639, + 1.1443578526377678, + 0.11725191003642976, + 0.5544506867881864, + 0.38782038912177086, + 0.9113668370991945, + 0.45760929957032204, + 0.6563708856701851, + 0.09818898513913155, + 0.033525049686431885, + 2.710429147351533, + 0.29865294322371483, + 1.0326417833566666, + 1.4960290007293224, + 0.8553846627473831, + 0.45065998658537865, + 0.18645189329981804, + 0.13841432332992554, + 0.0, + 0.1768941506743431, + 0.7196703087538481, + 0.09529054164886475, + 0.3615974709391594, + 0.5372915081679821, + 0.17953309044241905, + 0.17876356467604637, + 0.1304868645966053, + 0.7889178358018398, + 0.45719916746020317, + 0.0848919227719307, + 0.7097578831017017, + 0.12130353972315788, + 0.38856010138988495, + 1.4045194424688816, + 1.0519037619233131, + 0.48883315175771713, + 1.3172876201570034, + 1.4050651155412197, + 0.5627443753182888, + 0.3192053809762001, + 0.0, + 0.04601943492889404, + 0.21487894654273987, + 0.0, + 0.8596781380474567, + 1.222435224801302, + 0.08481328934431076, + 0.8794591836631298, + 0.9726200886070728, + 0.3406380536034703, + 0.8580380342900753, + 0.249192513525486, + 0.04495437443256378, + 0.4131649062037468, + 0.04692578688263893, + 0.08364497870206833, + 0.643225010484457, + 0.30431005731225014, + 1.5778013281524181 + ], + "unique_experts": 60, + "load_cv": 0.7540400446189107, + "normalized_load_entropy": 0.9288291498357112, + "max_load_share": 0.041666666666666664 + } + }, + "s0_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "6a12e139e4c7a479141c2a6cc97bd9fdbc3d372858e0e9f51462294137321d43", + "route_weight_sha256": "cc63bf1aa57c6fb01fc0d7718d587720b7570d69accef9b1ff9ca84429b8a1c9", + "loads": [ + 0, + 2, + 0, + 0, + 3, + 0, + 2, + 1, + 5, + 4, + 1, + 2, + 3, + 2, + 0, + 0, + 1, + 4, + 2, + 0, + 4, + 2, + 2, + 0, + 1, + 0, + 2, + 3, + 6, + 1, + 4, + 2, + 7, + 6, + 1, + 4, + 2, + 3, + 1, + 0, + 2, + 0, + 3, + 3, + 4, + 0, + 1, + 2, + 0, + 0, + 0, + 1, + 2, + 2, + 3, + 4, + 3, + 1, + 4, + 0, + 1, + 9, + 5, + 5 + ], + "weighted_loads": [ + 0.0, + 0.26272185146808624, + 0.0, + 0.0, + 0.24277108535170555, + 0.0, + 0.10834676027297974, + 0.05784865841269493, + 0.5376123413443565, + 0.27634526044130325, + 0.04703384265303612, + 0.07883452624082565, + 0.25690697133541107, + 0.09218809008598328, + 0.0, + 0.0, + 0.04223974421620369, + 0.353473212569952, + 0.12302663549780846, + 0.0, + 0.44083932787179947, + 0.18405210599303246, + 0.09867927804589272, + 0.0, + 0.09930036216974258, + 0.0, + 0.09285531938076019, + 0.18059801682829857, + 0.5143270120024681, + 0.05042172968387604, + 0.18252559751272202, + 0.11959512904286385, + 0.6445465348660946, + 0.3923262879252434, + 0.050095029175281525, + 0.2875107489526272, + 0.08662034757435322, + 0.22589033842086792, + 0.042924851179122925, + 0.0, + 0.29804229736328125, + 0.0, + 0.32942546159029007, + 0.3061439320445061, + 0.25190800428390503, + 0.0, + 0.04842734709382057, + 0.129866573959589, + 0.0, + 0.0, + 0.0, + 0.03503144532442093, + 0.21499517187476158, + 0.14751334488391876, + 0.2895907685160637, + 0.31939391419291496, + 0.23674628511071205, + 0.046403899788856506, + 0.3423502892255783, + 0.0, + 0.04007689654827118, + 0.6581674963235855, + 0.28791480138897896, + 0.39710533618927 + ], + "unique_experts": 48, + "load_cv": 0.9100479963153392, + "normalized_load_entropy": 0.8899855001433954, + "max_load_share": 0.06521739130434782 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "352f0ee2950ff50b66145368e123e395ce6a79d07183085fffd65116b7359be1", + "route_weight_sha256": "f09880e5c813e5556a35044e1f45a8a6586a08415c34934230d12f29e32caa8f", + "loads": [ + 0, + 4, + 0, + 0, + 3, + 2, + 3, + 2, + 6, + 5, + 13, + 2, + 6, + 2, + 0, + 14, + 3, + 10, + 11, + 2, + 5, + 2, + 2, + 0, + 1, + 9, + 2, + 3, + 6, + 1, + 4, + 2, + 7, + 6, + 1, + 8, + 2, + 3, + 11, + 8, + 8, + 9, + 10, + 4, + 5, + 0, + 1, + 3, + 0, + 3, + 7, + 1, + 3, + 12, + 5, + 15, + 3, + 1, + 4, + 1, + 1, + 9, + 5, + 7 + ], + "weighted_loads": [ + 0.0, + 0.30361964856274426, + 0.0, + 0.0, + 0.24277108535170555, + 0.06773566827178001, + 0.14009405300021172, + 0.06091359234414995, + 0.5409792978316545, + 0.3169205076992512, + 0.8503194227814674, + 0.07883452624082565, + 0.4346625432372093, + 0.09218809008598328, + 0.0, + 2.3641609414480627, + 0.1795811466872692, + 0.6506605260074139, + 0.9976580962538719, + 0.05066561698913574, + 0.453391470015049, + 0.18405210599303246, + 0.09867927804589272, + 0.0, + 0.09930036216974258, + 0.9876842498779297, + 0.09285531938076019, + 0.18059801682829857, + 0.5143270120024681, + 0.05042172968387604, + 0.18252559751272202, + 0.11959512904286385, + 0.6445465348660946, + 0.3923262879252434, + 0.050095029175281525, + 0.6004830040037632, + 0.08662034757435322, + 0.22589033842086792, + 0.9550141468644142, + 0.629792895168066, + 0.58878193795681, + 0.8619238436222076, + 0.9343543015420437, + 0.3420836441218853, + 0.33380062133073807, + 0.0, + 0.04842734709382057, + 0.1454283557832241, + 0.0, + 0.22507518902420998, + 0.6882628500461578, + 0.03503144532442093, + 0.8798839710652828, + 0.7994777522981167, + 0.3045681968796998, + 1.1339341588318348, + 0.23674628511071205, + 0.046403899788856506, + 0.3423502892255783, + 0.04566708207130432, + 0.04007689654827118, + 0.6581674963235855, + 0.28791480138897896, + 1.3325570113956928 + ], + "unique_experts": 57, + "load_cv": 0.8443713418650369, + "normalized_load_entropy": 0.9120005963015514, + "max_load_share": 0.052083333333333336 + } + }, + "s1_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "79b4942c56b3906cacdd32917aae092582a8bbf1e384e8489363a8009b14e8aa", + "route_weight_sha256": "c86fd821e776fa788519338ff1e46723e920b16ee8871fa8f3961d37afb249ce", + "loads": [ + 0, + 2, + 0, + 0, + 3, + 0, + 2, + 2, + 5, + 5, + 1, + 2, + 3, + 2, + 0, + 0, + 1, + 4, + 2, + 0, + 4, + 2, + 3, + 0, + 1, + 0, + 2, + 3, + 5, + 1, + 4, + 2, + 7, + 6, + 1, + 4, + 2, + 3, + 0, + 0, + 1, + 0, + 3, + 3, + 4, + 0, + 1, + 2, + 0, + 0, + 0, + 1, + 2, + 2, + 3, + 3, + 3, + 1, + 4, + 0, + 1, + 10, + 5, + 5 + ], + "weighted_loads": [ + 0.0, + 0.2750888019800186, + 0.0, + 0.0, + 0.23991502821445465, + 0.0, + 0.13249406591057777, + 0.08566971682012081, + 0.5469544045627117, + 0.33476319909095764, + 0.051787760108709335, + 0.08653755486011505, + 0.2506009712815285, + 0.09065256640315056, + 0.0, + 0.0, + 0.042908042669296265, + 0.3585858941078186, + 0.10171980783343315, + 0.0, + 0.44762449711561203, + 0.1857016198337078, + 0.1311882622539997, + 0.0, + 0.10008160024881363, + 0.0, + 0.0925699956715107, + 0.20024028420448303, + 0.4761289767920971, + 0.06000837683677673, + 0.17611438781023026, + 0.1353001669049263, + 0.6509190015494823, + 0.40750057995319366, + 0.050153736025094986, + 0.2724921964108944, + 0.07464995235204697, + 0.2337767481803894, + 0.0, + 0.0, + 0.2700099050998688, + 0.0, + 0.32927776873111725, + 0.3129812702536583, + 0.2548134811222553, + 0.0, + 0.047221727669239044, + 0.12786798924207687, + 0.0, + 0.0, + 0.0, + 0.0357651486992836, + 0.21111450344324112, + 0.1614280790090561, + 0.29135651886463165, + 0.26206571981310844, + 0.23260904848575592, + 0.04427897557616234, + 0.35647836327552795, + 0.0, + 0.0404454730451107, + 0.711850680410862, + 0.2892890051007271, + 0.4169793985784054 + ], + "unique_experts": 47, + "load_cv": 0.9355406431021744, + "normalized_load_entropy": 0.8852641995579286, + "max_load_share": 0.07246376811594203 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "5a5ef275d76445e0c489b746d5d64e832334d0302a4b9f4e90805f485871b663", + "route_weight_sha256": "eaa62ca883d21c25196c7d5679088ccf038f2ca673ad7c9ac3ce30991f6aab08", + "loads": [ + 1, + 4, + 0, + 6, + 3, + 3, + 10, + 4, + 6, + 6, + 16, + 5, + 8, + 2, + 1, + 16, + 5, + 15, + 16, + 10, + 5, + 2, + 4, + 0, + 2, + 9, + 2, + 5, + 5, + 3, + 4, + 2, + 8, + 8, + 2, + 9, + 3, + 6, + 10, + 12, + 5, + 12, + 14, + 7, + 5, + 0, + 1, + 4, + 0, + 13, + 9, + 2, + 3, + 14, + 6, + 14, + 3, + 1, + 5, + 1, + 2, + 11, + 5, + 9 + ], + "weighted_loads": [ + 0.03667677193880081, + 0.29919147468172014, + 0.0, + 0.41302134841680527, + 0.23991502821445465, + 0.10473809763789177, + 1.1057093031704426, + 0.14024782716296613, + 0.5503233333583921, + 0.37812191247940063, + 1.0183482225984335, + 0.45593032985925674, + 0.6766885630786419, + 0.09065256640315056, + 0.033525049686431885, + 2.8960434873588383, + 0.3115226738154888, + 1.0385939627885818, + 1.3399291597306728, + 0.8553846627473831, + 0.46017663925886154, + 0.1857016198337078, + 0.16856669262051582, + 0.0, + 0.17764048278331757, + 0.797258211299777, + 0.0925699956715107, + 0.37359369546175003, + 0.4761289767920971, + 0.14663763344287872, + 0.17611438781023026, + 0.1353001669049263, + 0.7706937454640865, + 0.4941246025264263, + 0.0850507989525795, + 0.7517983876168728, + 0.11994508653879166, + 0.3858874961733818, + 0.9995790086686611, + 1.0931618250906467, + 0.47222014516592026, + 1.2153862677514553, + 1.2561028376221657, + 0.5544147789478302, + 0.31686072796583176, + 0.0, + 0.047221727669239044, + 0.17637912929058075, + 0.0, + 0.8453336767852306, + 1.050467487424612, + 0.08407959342002869, + 0.8760033026337624, + 1.0875795409083366, + 0.3439810546115041, + 0.9732195138931274, + 0.23260904848575592, + 0.04427897557616234, + 0.4261949062347412, + 0.04692578688263893, + 0.08581341430544853, + 0.7486194334924221, + 0.2892890051007271, + 1.593992255628109 + ], + "unique_experts": 60, + "load_cv": 0.75, + "normalized_load_entropy": 0.9296541574655949, + "max_load_share": 0.041666666666666664 + } + }, + "s0_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "d2de6ca493ea30d1886214cdef8dd242dc3c222ee6acf7749677ebe7d8bc947c", + "route_weight_sha256": "540b48d2291c06494e1ce76de3f6199b866848c6f538ac8146486dad8cc79a16", + "loads": [ + 0, + 2, + 0, + 0, + 3, + 0, + 2, + 1, + 5, + 5, + 1, + 2, + 3, + 2, + 0, + 0, + 1, + 4, + 2, + 0, + 4, + 2, + 2, + 0, + 1, + 0, + 2, + 3, + 6, + 1, + 4, + 2, + 7, + 6, + 1, + 4, + 2, + 3, + 1, + 0, + 2, + 0, + 3, + 3, + 4, + 0, + 1, + 2, + 0, + 0, + 0, + 1, + 2, + 2, + 3, + 3, + 3, + 1, + 4, + 0, + 1, + 9, + 5, + 5 + ], + "weighted_loads": [ + 0.0, + 0.26318254321813583, + 0.0, + 0.0, + 0.23999523743987083, + 0.0, + 0.10782875493168831, + 0.05855294317007065, + 0.5595942959189415, + 0.3246856816112995, + 0.04656948149204254, + 0.07931105047464371, + 0.2549750506877899, + 0.09251434355974197, + 0.0, + 0.0, + 0.04341791570186615, + 0.3473908416926861, + 0.1314777284860611, + 0.0, + 0.44604409858584404, + 0.18622153624892235, + 0.0978824608027935, + 0.0, + 0.10080048441886902, + 0.0, + 0.08560871332883835, + 0.17861029878258705, + 0.5084709376096725, + 0.053099002689123154, + 0.1720082312822342, + 0.1247098334133625, + 0.6445561908185482, + 0.3991212472319603, + 0.05218145251274109, + 0.2810968607664108, + 0.08936011604964733, + 0.22697655856609344, + 0.04518105834722519, + 0.0, + 0.2955326847732067, + 0.0, + 0.3286774717271328, + 0.30643121898174286, + 0.25020552426576614, + 0.0, + 0.04731960967183113, + 0.13026981800794601, + 0.0, + 0.0, + 0.0, + 0.03564374893903732, + 0.22894831746816635, + 0.14698376506567, + 0.29789984971284866, + 0.2665040045976639, + 0.2421344630420208, + 0.045061126351356506, + 0.3427077382802963, + 0.0, + 0.040017928928136826, + 0.6568928509950638, + 0.29480696097016335, + 0.3988841623067856 + ], + "unique_experts": 48, + "load_cv": 0.9137333487622095, + "normalized_load_entropy": 0.8895452489639263, + "max_load_share": 0.06521739130434782 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "e65655da20b8602f1ef3586adc54fdb58bb8ffafc4e90b9d08d8fa95f98e7a6b", + "route_weight_sha256": "93c5415ae948b9354919063d4beff4ff6049bfb997ac9dabe96a491f45d38fc7", + "loads": [ + 0, + 4, + 0, + 0, + 3, + 2, + 3, + 2, + 6, + 6, + 13, + 2, + 6, + 2, + 0, + 14, + 4, + 11, + 11, + 1, + 5, + 2, + 2, + 0, + 1, + 8, + 2, + 3, + 6, + 1, + 4, + 2, + 7, + 6, + 1, + 9, + 2, + 3, + 11, + 8, + 7, + 9, + 10, + 4, + 6, + 0, + 1, + 3, + 0, + 3, + 7, + 1, + 3, + 10, + 5, + 14, + 3, + 1, + 4, + 1, + 1, + 10, + 5, + 7 + ], + "weighted_loads": [ + 0.0, + 0.304003442870453, + 0.0, + 0.0, + 0.23999523743987083, + 0.06773566827178001, + 0.1395760476589203, + 0.061617877101525664, + 0.5629612524062395, + 0.36698290705680847, + 0.8380581215023994, + 0.07931105047464371, + 0.4336624853312969, + 0.09251434355974197, + 0.0, + 2.193473362829536, + 0.21971232816576958, + 0.7010624743998051, + 0.9407175816595554, + 0.013061463832855225, + 0.45859624072909355, + 0.18622153624892235, + 0.0978824608027935, + 0.0, + 0.10080048441886902, + 0.9019144475460052, + 0.08560871332883835, + 0.17861029878258705, + 0.5084709376096725, + 0.053099002689123154, + 0.1720082312822342, + 0.1247098334133625, + 0.6445561908185482, + 0.3991212472319603, + 0.05218145251274109, + 0.6459486968815327, + 0.08936011604964733, + 0.22697655856609344, + 0.9296284727752209, + 0.6409102715551853, + 0.5279778651893139, + 0.9071067683398724, + 0.9460537731647491, + 0.34142301231622696, + 0.38723598048090935, + 0.0, + 0.04731960967183113, + 0.14583159983158112, + 0.0, + 0.21105489507317543, + 0.7207907661795616, + 0.03564374893903732, + 0.8938371166586876, + 0.6863947883248329, + 0.3128772780764848, + 1.2092721946537495, + 0.2421344630420208, + 0.045061126351356506, + 0.3427077382802963, + 0.04566708207130432, + 0.040017928928136826, + 0.6933395490050316, + 0.29480696097016335, + 1.3343358375132084 + ], + "unique_experts": 57, + "load_cv": 0.8342587454267337, + "normalized_load_entropy": 0.9125094911401231, + "max_load_share": 0.04861111111111111 + } + }, + "s1_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "ac1729a99bc0179a9d4e5bf2af789cd2df6de65babda1bb2b53d59739567e4e1", + "route_weight_sha256": "2d9c0ce09d6684d2b28e1fe14e733841f05cfc364848891f24fda78e12ccdefc", + "loads": [ + 1, + 2, + 0, + 0, + 3, + 0, + 2, + 1, + 5, + 5, + 1, + 2, + 3, + 2, + 0, + 0, + 1, + 4, + 2, + 0, + 4, + 2, + 3, + 0, + 1, + 0, + 1, + 3, + 5, + 1, + 3, + 4, + 7, + 6, + 1, + 4, + 2, + 3, + 0, + 0, + 2, + 0, + 3, + 3, + 4, + 0, + 1, + 2, + 0, + 0, + 0, + 1, + 2, + 2, + 3, + 2, + 3, + 1, + 4, + 0, + 1, + 10, + 5, + 5 + ], + "weighted_loads": [ + 0.03443598002195358, + 0.27216891199350357, + 0.0, + 0.0, + 0.24354152753949165, + 0.0, + 0.1330619491636753, + 0.06077570095658302, + 0.5552406646311283, + 0.3353848457336426, + 0.05030471831560135, + 0.08571493998169899, + 0.25518883764743805, + 0.09130680561065674, + 0.0, + 0.0, + 0.043852634727954865, + 0.34672997891902924, + 0.1031215600669384, + 0.0, + 0.4406503848731518, + 0.18805472180247307, + 0.13197444006800652, + 0.0, + 0.10081423074007034, + 0.0, + 0.05484837666153908, + 0.19945872947573662, + 0.4803430438041687, + 0.06065455451607704, + 0.13660608604550362, + 0.20450171642005444, + 0.6497884802520275, + 0.40773480385541916, + 0.050867266952991486, + 0.2697186544537544, + 0.07804000191390514, + 0.2340896800160408, + 0.0, + 0.0, + 0.31449637562036514, + 0.0, + 0.32888051494956017, + 0.314083069562912, + 0.2563560903072357, + 0.0, + 0.04667949676513672, + 0.12672105431556702, + 0.0, + 0.0, + 0.0, + 0.03653508424758911, + 0.21070469543337822, + 0.16049250215291977, + 0.28697363287210464, + 0.220970768481493, + 0.23798073083162308, + 0.04390762001276016, + 0.34669651091098785, + 0.0, + 0.039787519723176956, + 0.7185964547097683, + 0.3006801977753639, + 0.41206811368465424 + ], + "unique_experts": 48, + "load_cv": 0.9319415313491465, + "normalized_load_entropy": 0.8876796584951266, + "max_load_share": 0.07246376811594203 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "a128c70db58e73b3974ba64ffccb3798a5f0436941bf3a961f8e50edbdd8f07b", + "route_weight_sha256": "299537dc96ba12cb6a3872bc7b7e55f1695d853c0a376482832f6d4fded0e5ae", + "loads": [ + 2, + 4, + 0, + 6, + 3, + 3, + 10, + 3, + 7, + 6, + 16, + 5, + 8, + 2, + 1, + 17, + 5, + 16, + 15, + 10, + 5, + 2, + 4, + 0, + 2, + 8, + 1, + 5, + 5, + 3, + 3, + 4, + 8, + 7, + 2, + 9, + 3, + 6, + 10, + 12, + 6, + 14, + 14, + 7, + 6, + 0, + 1, + 4, + 0, + 13, + 9, + 2, + 3, + 12, + 6, + 13, + 3, + 1, + 5, + 1, + 2, + 10, + 5, + 9 + ], + "weighted_loads": [ + 0.0711127519607544, + 0.2962715846952051, + 0.0, + 0.41302134841680527, + 0.24354152753949165, + 0.11724108085036278, + 1.1062771864235401, + 0.11535381129942834, + 0.5977700164075941, + 0.37993379309773445, + 1.0248689036816359, + 0.4551077149808407, + 0.6876318529248238, + 0.09130680561065674, + 0.033525049686431885, + 2.778509241063148, + 0.3351021558046341, + 1.0687156841158867, + 1.2532536201179028, + 0.8553846627473831, + 0.4532025270164013, + 0.18805472180247307, + 0.16935287043452263, + 0.0, + 0.17837311327457428, + 0.7196703087538481, + 0.05484837666153908, + 0.3728121407330036, + 0.4803430438041687, + 0.14728381112217903, + 0.13660608604550362, + 0.20450171642005444, + 0.7695632241666317, + 0.4506562352180481, + 0.085764329880476, + 0.784897156059742, + 0.12333513610064983, + 0.3862004280090332, + 0.9666109532117844, + 1.1061957366764545, + 0.49305295944213867, + 1.3606998845934868, + 1.2579910270869732, + 0.55500727891922, + 0.36393946409225464, + 0.0, + 0.04667949676513672, + 0.1752321943640709, + 0.0, + 0.8272542990744114, + 1.0600724704563618, + 0.0848495289683342, + 0.8755934946238995, + 0.9744157455861568, + 0.33959816861897707, + 1.0216441042721272, + 0.23798073083162308, + 0.04390762001276016, + 0.4164130538702011, + 0.04692578688263893, + 0.08515546098351479, + 0.7185964547097683, + 0.3006801977753639, + 1.5890809707343578 + ], + "unique_experts": 60, + "load_cv": 0.7459380745820066, + "normalized_load_entropy": 0.9305095993806327, + "max_load_share": 0.044270833333333336 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "ordered_topk_exact_tokens": 16, + "set_exact_tokens": 20, + "mean_set_jaccard": 0.9627329192546585, + "mean_token_weighted_tv": 0.01180525686915802, + "aggregate_load_tv": 0.02173913043478261 + }, + "system_bos": { + "tokens": 23, + "ordered_topk_exact_tokens": 17, + "set_exact_tokens": 21, + "mean_set_jaccard": 0.9751552795031057, + "mean_token_weighted_tv": 0.013234190318895422, + "aggregate_load_tv": 0.014492753623188404 + }, + "system_x": { + "tokens": 23, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.9503105590062112, + "mean_token_weighted_tv": 0.01862547773381938, + "aggregate_load_tv": 0.028985507246376812 + }, + "system_period": { + "tokens": 23, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.9254658385093167, + "mean_token_weighted_tv": 0.021539647739542568, + "aggregate_load_tv": 0.036231884057971016 + }, + "bos_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.9503105590062112, + "mean_token_weighted_tv": 0.021500347870523514, + "aggregate_load_tv": 0.02898550724637681 + }, + "bos_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 18, + "mean_set_jaccard": 0.9378881987577641, + "mean_token_weighted_tv": 0.02328404557445775, + "aggregate_load_tv": 0.036231884057971016 + }, + "x_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.9130434782608695, + "mean_token_weighted_tv": 0.02580205156751301, + "aggregate_load_tv": 0.05072463768115942 + }, + "x_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.9254658385093167, + "mean_token_weighted_tv": 0.026457133055057213, + "aggregate_load_tv": 0.043478260869565216 + }, + "period_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.9254658385093167, + "mean_token_weighted_tv": 0.02226043298192646, + "aggregate_load_tv": 0.04347826086956521 + }, + "period_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 7, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8881987577639753, + "mean_token_weighted_tv": 0.030362139415481815, + "aggregate_load_tv": 0.06521739130434782 + } + } + }, + "layer_06": { + "layer": 6, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "34c314d46a8cc364a34330321eaa81ec963022c37d8e098946041bc746f620c0", + "route_weight_sha256": "a1d4d2eebcdabc489f8309b0f13b3437970e047072d8620e88cb0ce1fff50d28", + "loads": [ + 0, + 3, + 2, + 2, + 0, + 2, + 3, + 2, + 3, + 1, + 0, + 1, + 3, + 4, + 1, + 0, + 3, + 0, + 3, + 3, + 0, + 1, + 4, + 0, + 0, + 0, + 6, + 1, + 0, + 1, + 3, + 6, + 4, + 7, + 2, + 0, + 3, + 0, + 6, + 2, + 1, + 2, + 1, + 2, + 5, + 9, + 0, + 5, + 1, + 1, + 1, + 1, + 1, + 1, + 3, + 1, + 5, + 3, + 2, + 0, + 2, + 5, + 4, + 0 + ], + "weighted_loads": [ + 0.0, + 0.34465399011969566, + 0.1971171572804451, + 0.1202603317797184, + 0.0, + 0.11227431148290634, + 0.16210024803876877, + 0.10516774281859398, + 0.2283046543598175, + 0.047133784741163254, + 0.0, + 0.05494144931435585, + 0.27208616584539413, + 0.3980328142642975, + 0.04407334327697754, + 0.0, + 0.2961253374814987, + 0.0, + 0.24521024525165558, + 0.16170179098844528, + 0.0, + 0.05350648984313011, + 0.6790689826011658, + 0.0, + 0.0, + 0.0, + 0.4211858808994293, + 0.096566341817379, + 0.0, + 0.034165460616350174, + 0.1640402488410473, + 0.29004194773733616, + 0.2981859929859638, + 0.7031804323196411, + 0.15271122008562088, + 0.0, + 0.1928485408425331, + 0.0, + 0.4680429585278034, + 0.13080310821533203, + 0.04693405702710152, + 0.15463722124695778, + 0.16708920896053314, + 0.09440890327095985, + 0.3124968186020851, + 0.7018486969172955, + 0.0, + 0.4268895164132118, + 0.06664174050092697, + 0.038991693407297134, + 0.03591766953468323, + 0.08668994158506393, + 0.06569541245698929, + 0.04233217239379883, + 0.19968153163790703, + 0.09951405972242355, + 0.4086868651211262, + 0.10941354930400848, + 0.09076566621661186, + 0.0, + 0.11189312487840652, + 0.2728351131081581, + 0.1912415437400341, + 0.0 + ], + "unique_experts": 49, + "load_cv": 0.9319415313491465, + "normalized_load_entropy": 0.8883139083737648, + "max_load_share": 0.06521739130434782 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "c599c5232f840e9f2c109ac82bb08a59e2c5217ed4597bb89463287c3b7d2887", + "route_weight_sha256": "5b4fda7237407331cb4db90522ed9f5ad6acd410abad13277bf0aa12b5cd3032", + "loads": [ + 0, + 6, + 2, + 2, + 1, + 2, + 11, + 2, + 3, + 1, + 0, + 7, + 3, + 7, + 2, + 0, + 8, + 1, + 3, + 11, + 1, + 4, + 7, + 1, + 0, + 1, + 6, + 1, + 0, + 4, + 3, + 6, + 7, + 7, + 3, + 6, + 3, + 8, + 6, + 11, + 1, + 7, + 3, + 2, + 5, + 14, + 13, + 7, + 5, + 1, + 9, + 8, + 1, + 1, + 3, + 11, + 15, + 3, + 2, + 9, + 2, + 5, + 4, + 0 + ], + "weighted_loads": [ + 0.0, + 0.41512768156826496, + 0.1971171572804451, + 0.1202603317797184, + 0.0286709051579237, + 0.11227431148290634, + 1.0293195843696594, + 0.10516774281859398, + 0.2283046543598175, + 0.047133784741163254, + 0.0, + 0.4072383139282465, + 0.27208616584539413, + 0.4695076746866107, + 0.12187425792217255, + 0.0, + 0.6113954335451126, + 0.004064245615154505, + 0.24521024525165558, + 0.6547447927296162, + 0.04336344450712204, + 0.24347314797341824, + 2.2000198531895876, + 0.035709455609321594, + 0.0, + 0.02751920372247696, + 0.4211858808994293, + 0.096566341817379, + 0.0, + 0.21167699247598648, + 0.1640402488410473, + 0.29004194773733616, + 0.430661179125309, + 0.7031804323196411, + 0.1870146505534649, + 0.549049373716116, + 0.1928485408425331, + 0.6953616626560688, + 0.4680429585278034, + 0.4940901156514883, + 0.04693405702710152, + 0.5510418936610222, + 0.22517569363117218, + 0.09440890327095985, + 0.3124968186020851, + 0.836834208574146, + 1.6792857982218266, + 0.44928741501644254, + 0.2740591410547495, + 0.038991693407297134, + 0.5342686511576176, + 0.39154618605971336, + 0.06569541245698929, + 0.04233217239379883, + 0.19968153163790703, + 0.855914730578661, + 1.8398120440542698, + 0.10941354930400848, + 0.09076566621661186, + 0.9613983072340488, + 0.11189312487840652, + 0.2728351131081581, + 0.1912415437400341, + 0.0 + ], + "unique_experts": 58, + "load_cv": 0.8342587454267337, + "normalized_load_entropy": 0.9137271642623703, + "max_load_share": 0.052083333333333336 + } + }, + "s1_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "b26a883419d6d66a89abb41fd58ea07bbd6d2d18971b35fa19c79320b076fe5b", + "route_weight_sha256": "38ae4aafa5afaab2067ad01cae64b0b791a606db62622c7a0dcd9d1c6febcee7", + "loads": [ + 0, + 3, + 2, + 2, + 0, + 2, + 3, + 2, + 3, + 1, + 0, + 1, + 3, + 4, + 2, + 0, + 3, + 0, + 3, + 3, + 0, + 1, + 4, + 0, + 0, + 0, + 6, + 1, + 0, + 1, + 3, + 5, + 4, + 7, + 2, + 0, + 3, + 0, + 6, + 2, + 2, + 2, + 1, + 2, + 5, + 9, + 0, + 6, + 1, + 0, + 1, + 1, + 1, + 1, + 3, + 1, + 5, + 3, + 2, + 0, + 2, + 5, + 3, + 0 + ], + "weighted_loads": [ + 0.0, + 0.35197722911834717, + 0.19468311220407486, + 0.12531853094696999, + 0.0, + 0.1143033616244793, + 0.15407902374863625, + 0.1069868914783001, + 0.22705557197332382, + 0.047510478645563126, + 0.0, + 0.05516933277249336, + 0.27372849732637405, + 0.3975470960140228, + 0.08828547224402428, + 0.0, + 0.2966509535908699, + 0.0, + 0.24302484095096588, + 0.16066092252731323, + 0.0, + 0.049486346542835236, + 0.7051966264843941, + 0.0, + 0.0, + 0.0, + 0.4123806431889534, + 0.10045155137777328, + 0.0, + 0.034700680524110794, + 0.16496579349040985, + 0.2496098279953003, + 0.29800890386104584, + 0.6678641252219677, + 0.15204108878970146, + 0.0, + 0.19537897780537605, + 0.0, + 0.4599955715239048, + 0.13760683685541153, + 0.0885353609919548, + 0.15947669371962547, + 0.15709073841571808, + 0.09671741351485252, + 0.3129258416593075, + 0.679420817643404, + 0.0, + 0.46293408796191216, + 0.06473542749881744, + 0.0, + 0.03647421672940254, + 0.08712274581193924, + 0.06608652323484421, + 0.047181982547044754, + 0.20036455616354942, + 0.09822362661361694, + 0.3958162032067776, + 0.11461656913161278, + 0.08919135853648186, + 0.0, + 0.10355721414089203, + 0.26974644511938095, + 0.1529761590063572, + 0.0 + ], + "unique_experts": 48, + "load_cv": 0.9283284660133794, + "normalized_load_entropy": 0.8874022084919249, + "max_load_share": 0.06521739130434782 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "f2d216a1544e4b58230a10b55cd9dd100188636b0e735a332be98d466c21703d", + "route_weight_sha256": "dd59b7886f3b2f95ea38a8918cabbcd47e7104f69599f87435b670ac3503b701", + "loads": [ + 0, + 5, + 5, + 3, + 2, + 2, + 17, + 3, + 8, + 7, + 0, + 11, + 7, + 7, + 10, + 1, + 13, + 1, + 5, + 13, + 2, + 5, + 6, + 1, + 1, + 1, + 6, + 2, + 1, + 4, + 3, + 8, + 11, + 8, + 6, + 8, + 4, + 16, + 6, + 11, + 2, + 7, + 3, + 2, + 6, + 13, + 17, + 8, + 4, + 0, + 10, + 7, + 2, + 4, + 3, + 12, + 22, + 3, + 2, + 11, + 8, + 5, + 3, + 0 + ], + "weighted_loads": [ + 0.0, + 0.3916772869415581, + 0.33554037287831306, + 0.16270536556839943, + 0.1503087915480137, + 0.1143033616244793, + 1.385596053674817, + 0.1684100702404976, + 0.5692052319645882, + 0.7559803165495396, + 0.0, + 0.6812149807810783, + 0.6030670255422592, + 0.4696894399821758, + 0.7017719745635986, + 0.11254264414310455, + 1.0378388166427612, + 0.004065376240760088, + 0.3923712410032749, + 0.8629863858222961, + 0.09186676144599915, + 0.3182895127683878, + 2.196551389992237, + 0.03530333563685417, + 0.03236652910709381, + 0.0353744812309742, + 0.4123806431889534, + 0.12684177048504353, + 0.035971272736787796, + 0.23767834156751633, + 0.16496579349040985, + 0.4480810798704624, + 0.5564527716487646, + 0.701575256884098, + 0.41262630373239517, + 0.7678648270666599, + 0.22934892028570175, + 1.266828753054142, + 0.4599955715239048, + 0.6152032986283302, + 0.0885353609919548, + 0.5705525651574135, + 0.2150583490729332, + 0.09671741351485252, + 0.39712345227599144, + 0.7789856905583292, + 2.025128722190857, + 0.4853587120305747, + 0.2358890026807785, + 0.0, + 0.6369648762047291, + 0.3247777633368969, + 0.10322587937116623, + 0.21571318805217743, + 0.20036455616354942, + 1.1058689951896667, + 2.445683255791664, + 0.11461656913161278, + 0.08919135853648186, + 1.0591862387955189, + 0.40883444994688034, + 0.26974644511938095, + 0.1529761590063572, + 0.0 + ], + "unique_experts": 60, + "load_cv": 0.7927623996016853, + "normalized_load_entropy": 0.9246594634329288, + "max_load_share": 0.057291666666666664 + } + }, + "s0_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "348b9e030a04cb427a6d9d45df1d025f8641543fe17d086b12485f78dd2b9b3e", + "route_weight_sha256": "3258eb28944e54fe1ead30b4c7016da7779a1b4244d8b7173a1e07568b6560c6", + "loads": [ + 0, + 3, + 2, + 2, + 0, + 2, + 3, + 2, + 3, + 1, + 0, + 1, + 3, + 4, + 0, + 0, + 3, + 0, + 3, + 3, + 0, + 1, + 4, + 0, + 0, + 0, + 6, + 1, + 0, + 1, + 3, + 6, + 4, + 8, + 2, + 0, + 3, + 0, + 7, + 1, + 1, + 2, + 1, + 2, + 5, + 8, + 0, + 5, + 1, + 1, + 1, + 1, + 1, + 1, + 4, + 1, + 4, + 3, + 4, + 0, + 2, + 5, + 3, + 0 + ], + "weighted_loads": [ + 0.0, + 0.3851314075291157, + 0.1860184744000435, + 0.12020233273506165, + 0.0, + 0.1108255684375763, + 0.16291068494319916, + 0.10266120359301567, + 0.23932712525129318, + 0.04262431338429451, + 0.0, + 0.05533742904663086, + 0.2670971676707268, + 0.4034816473722458, + 0.0, + 0.0, + 0.30335237085819244, + 0.0, + 0.2384566366672516, + 0.16703608632087708, + 0.0, + 0.049949005246162415, + 0.7178974747657776, + 0.0, + 0.0, + 0.0, + 0.44819730892777443, + 0.08718511462211609, + 0.0, + 0.034850988537073135, + 0.14752713963389397, + 0.3031907118856907, + 0.3100714087486267, + 0.7523262910544872, + 0.15994496271014214, + 0.0, + 0.19933290407061577, + 0.0, + 0.5373468399047852, + 0.06496468186378479, + 0.04272958263754845, + 0.16247062385082245, + 0.15757130086421967, + 0.09667018055915833, + 0.2955511622130871, + 0.6452351585030556, + 0.0, + 0.43558333441615105, + 0.06739712506532669, + 0.04463031515479088, + 0.03633030131459236, + 0.07225240767002106, + 0.06589722633361816, + 0.042677298188209534, + 0.2528694197535515, + 0.0999046266078949, + 0.36495135724544525, + 0.12301567941904068, + 0.17224802821874619, + 0.0, + 0.1280505135655403, + 0.27503594383597374, + 0.14319851621985435, + 0.0 + ], + "unique_experts": 48, + "load_cv": 0.9498007175542577, + "normalized_load_entropy": 0.8830587640401228, + "max_load_share": 0.057971014492753624 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "36ed01836019f9e257f90e781124ecd72d223d70d5b4010d54aa4089c26d3702", + "route_weight_sha256": "2f13663d4a69b8be9cef783d6048ba837a489d29f231a93bdcfa0ea3e8284da6", + "loads": [ + 0, + 6, + 2, + 2, + 1, + 2, + 11, + 2, + 3, + 1, + 0, + 7, + 3, + 5, + 3, + 1, + 9, + 0, + 3, + 11, + 1, + 4, + 6, + 1, + 0, + 1, + 6, + 1, + 0, + 5, + 3, + 6, + 7, + 8, + 3, + 6, + 3, + 9, + 7, + 10, + 1, + 7, + 4, + 2, + 5, + 12, + 13, + 6, + 5, + 1, + 8, + 8, + 1, + 1, + 4, + 11, + 14, + 3, + 4, + 9, + 2, + 5, + 3, + 0 + ], + "weighted_loads": [ + 0.0, + 0.4953512270003557, + 0.1860184744000435, + 0.12020233273506165, + 0.0286709051579237, + 0.1108255684375763, + 1.1286383531987667, + 0.10266120359301567, + 0.23932712525129318, + 0.04262431338429451, + 0.0, + 0.4219738934189081, + 0.2670971676707268, + 0.42659963853657246, + 0.1812305524945259, + 0.04745270311832428, + 0.656314805150032, + 0.0, + 0.2384566366672516, + 0.6565190963447094, + 0.04336344450712204, + 0.22719831205904484, + 1.2912693191319704, + 0.035709455609321594, + 0.0, + 0.02751920372247696, + 0.44819730892777443, + 0.08718511462211609, + 0.0, + 0.2568518668413162, + 0.14752713963389397, + 0.3031907118856907, + 0.44628095999360085, + 0.7523262910544872, + 0.19424839317798615, + 0.5530477054417133, + 0.19933290407061577, + 0.7125398479402065, + 0.5373468399047852, + 0.4241069983690977, + 0.04272958263754845, + 0.5588752962648869, + 0.26318852975964546, + 0.09667018055915833, + 0.2955511622130871, + 0.776184443384409, + 1.741332646459341, + 0.4547218047082424, + 0.2720526847988367, + 0.04463031515479088, + 0.5333421714603901, + 0.3771086521446705, + 0.06589722633361816, + 0.042677298188209534, + 0.2528694197535515, + 0.8563052974641323, + 1.7992035821080208, + 0.12301567941904068, + 0.17224802821874619, + 0.9613983072340488, + 0.1280505135655403, + 0.27503594383597374, + 0.14319851621985435, + 0.0 + ], + "unique_experts": 58, + "load_cv": 0.7993052538854533, + "normalized_load_entropy": 0.9184229676064901, + "max_load_share": 0.04861111111111111 + } + }, + "s1_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "c389b3a424835aefb7e8f179259109563d387eda0ab5e1bd3fa28ec0c0682139", + "route_weight_sha256": "bae9ae7eb04233367023209d33163bdaa0a1b34b44e03672536e262f54fe8065", + "loads": [ + 0, + 3, + 2, + 2, + 0, + 2, + 3, + 2, + 3, + 1, + 0, + 1, + 3, + 4, + 0, + 0, + 3, + 0, + 3, + 3, + 0, + 1, + 4, + 0, + 0, + 0, + 6, + 1, + 0, + 1, + 3, + 5, + 4, + 9, + 2, + 0, + 3, + 0, + 6, + 1, + 1, + 2, + 1, + 2, + 5, + 9, + 0, + 4, + 1, + 1, + 1, + 1, + 2, + 1, + 4, + 1, + 3, + 4, + 4, + 0, + 2, + 5, + 3, + 0 + ], + "weighted_loads": [ + 0.0, + 0.39468343555927277, + 0.1894037202000618, + 0.12921007350087166, + 0.0, + 0.11216732114553452, + 0.16168342158198357, + 0.1099783144891262, + 0.24521047621965408, + 0.044577810913324356, + 0.0, + 0.0507446750998497, + 0.2803904488682747, + 0.41314760595560074, + 0.0, + 0.0, + 0.302379347383976, + 0.0, + 0.24889840185642242, + 0.165214654058218, + 0.0, + 0.05300462245941162, + 0.6990822330117226, + 0.0, + 0.0, + 0.0, + 0.42892247810959816, + 0.07846265286207199, + 0.0, + 0.03503548353910446, + 0.155197162181139, + 0.26974355801939964, + 0.3039044328033924, + 0.7902918122708797, + 0.16073869168758392, + 0.0, + 0.19968446716666222, + 0.0, + 0.48268746212124825, + 0.06420988589525223, + 0.04527120664715767, + 0.15478654950857162, + 0.18196770548820496, + 0.09687982127070427, + 0.3003219813108444, + 0.678695771843195, + 0.0, + 0.4043796509504318, + 0.06413350999355316, + 0.04289376363158226, + 0.0341082327067852, + 0.07340238243341446, + 0.098079614341259, + 0.04658907651901245, + 0.261044155806303, + 0.10201626271009445, + 0.31194963306188583, + 0.15294479951262474, + 0.1770080141723156, + 0.0, + 0.11605923995375633, + 0.2782664969563484, + 0.14168108999729156, + 0.0 + ], + "unique_experts": 48, + "load_cv": 0.9568510632025544, + "normalized_load_entropy": 0.8837747476493517, + "max_load_share": 0.06521739130434782 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "591f354cd5cfecff5977e36b864cb8a74125d5b690585f5e93fa709d059199fb", + "route_weight_sha256": "ef81eb6ecc1c053da8e333af600f1b05d27481b8219819e900a1cf2f49c021a6", + "loads": [ + 0, + 4, + 5, + 3, + 2, + 2, + 18, + 3, + 8, + 7, + 0, + 11, + 7, + 6, + 9, + 2, + 14, + 0, + 5, + 13, + 2, + 5, + 5, + 1, + 1, + 1, + 6, + 2, + 1, + 4, + 3, + 8, + 11, + 10, + 6, + 8, + 4, + 17, + 6, + 10, + 1, + 7, + 3, + 2, + 6, + 12, + 17, + 6, + 4, + 1, + 10, + 7, + 3, + 4, + 4, + 12, + 20, + 4, + 4, + 11, + 8, + 5, + 3, + 0 + ], + "weighted_loads": [ + 0.0, + 0.42962123081088066, + 0.3302609808743, + 0.1665969081223011, + 0.1503087915480137, + 0.11216732114553452, + 1.4664318393915892, + 0.1714014932513237, + 0.5873601362109184, + 0.7530476488173008, + 0.0, + 0.6935338787734509, + 0.6097289770841599, + 0.47879612632095814, + 0.6715803071856499, + 0.16559594124555588, + 1.0820272751152515, + 0.0, + 0.39824480190873146, + 0.8639483079314232, + 0.09186676144599915, + 0.30775335617363453, + 1.2445817962288857, + 0.03530333563685417, + 0.03236652910709381, + 0.0353744812309742, + 0.42892247810959816, + 0.10485287196934223, + 0.035971272736787796, + 0.23633136972784996, + 0.155197162181139, + 0.46821480989456177, + 0.5740395803004503, + 0.8240029439330101, + 0.42132390663027763, + 0.7914606593549252, + 0.23365440964698792, + 1.3312715515494347, + 0.48268746212124825, + 0.5418063476681709, + 0.04527120664715767, + 0.5658624209463596, + 0.23993531614542007, + 0.09687982127070427, + 0.3845195919275284, + 0.774487279355526, + 2.0998375080525875, + 0.4790899232029915, + 0.24293236061930656, + 0.04289376363158226, + 0.6701084263622761, + 0.3110573999583721, + 0.13521897047758102, + 0.21512028202414513, + 0.261044155806303, + 1.1096616312861443, + 2.3860866725444794, + 0.15294479951262474, + 0.1770080141723156, + 1.0591862387955189, + 0.42133647575974464, + 0.2782664969563484, + 0.14168108999729156, + 0.0 + ], + "unique_experts": 60, + "load_cv": 0.7795119555779045, + "normalized_load_entropy": 0.927133828118656, + "max_load_share": 0.052083333333333336 + } + }, + "s0_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "03149d0c2b79c103d2bde784f811dbe70576b278fc1d1a205d0e5bf0f4be159d", + "route_weight_sha256": "85b1efe0e8a63eff6671d699edffd381eeab85f595104a501db409fa35b718e8", + "loads": [ + 0, + 3, + 2, + 2, + 0, + 2, + 3, + 2, + 3, + 1, + 0, + 1, + 3, + 4, + 2, + 0, + 3, + 0, + 3, + 3, + 0, + 1, + 4, + 0, + 0, + 0, + 6, + 1, + 0, + 1, + 3, + 5, + 4, + 8, + 2, + 0, + 3, + 0, + 7, + 1, + 2, + 2, + 1, + 2, + 5, + 8, + 0, + 5, + 1, + 1, + 1, + 1, + 1, + 0, + 3, + 1, + 4, + 3, + 4, + 0, + 2, + 5, + 3, + 0 + ], + "weighted_loads": [ + 0.0, + 0.38511785864830017, + 0.1772110015153885, + 0.11599268391728401, + 0.0, + 0.09595023095607758, + 0.20490214601159096, + 0.10329751670360565, + 0.24680814519524574, + 0.043442364782094955, + 0.0, + 0.059996046125888824, + 0.2562650740146637, + 0.4097379185259342, + 0.08053542673587799, + 0.0, + 0.3123870864510536, + 0.0, + 0.22938595712184906, + 0.16662205010652542, + 0.0, + 0.051778435707092285, + 0.6794403120875359, + 0.0, + 0.0, + 0.0, + 0.4462040439248085, + 0.08282694220542908, + 0.0, + 0.03319093585014343, + 0.14244255051016808, + 0.2416976448148489, + 0.3046000637114048, + 0.7507089357823133, + 0.1592964045703411, + 0.0, + 0.19580825418233871, + 0.0, + 0.5273447483778, + 0.06254977732896805, + 0.0876854658126831, + 0.16173344105482101, + 0.1417323797941208, + 0.09921430796384811, + 0.2927403822541237, + 0.6699474155902863, + 0.0, + 0.4102974496781826, + 0.06540278345346451, + 0.042480893433094025, + 0.03933335468173027, + 0.0737394243478775, + 0.06555061042308807, + 0.0, + 0.2151242271065712, + 0.10349447280168533, + 0.3579514604061842, + 0.12113092467188835, + 0.17302173376083374, + 0.0, + 0.12079140916466713, + 0.26888200640678406, + 0.13896392658352852, + 0.0 + ], + "unique_experts": 48, + "load_cv": 0.9283284660133794, + "normalized_load_entropy": 0.8868573715615318, + "max_load_share": 0.057971014492753624 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "31c44fbe9dbd0bf48ded731bf3e06e77bf63ec8565fbc1fd357f00040bad883e", + "route_weight_sha256": "d762a2702a803511f6fb696fdbca58ab2b4d35fe88c7a7700447f6ae9fc1174a", + "loads": [ + 0, + 5, + 2, + 2, + 1, + 2, + 13, + 2, + 3, + 1, + 0, + 6, + 3, + 6, + 5, + 1, + 8, + 0, + 3, + 12, + 1, + 4, + 6, + 1, + 0, + 1, + 6, + 1, + 0, + 4, + 3, + 5, + 7, + 8, + 3, + 6, + 3, + 9, + 7, + 9, + 2, + 9, + 4, + 2, + 5, + 12, + 12, + 6, + 5, + 1, + 6, + 9, + 1, + 0, + 3, + 12, + 13, + 3, + 4, + 10, + 2, + 5, + 3, + 0 + ], + "weighted_loads": [ + 0.0, + 0.4508297014981508, + 0.1772110015153885, + 0.11599268391728401, + 0.0286709051579237, + 0.09595023095607758, + 1.4687228426337242, + 0.10329751670360565, + 0.24680814519524574, + 0.043442364782094955, + 0.0, + 0.3743013199418783, + 0.2562650740146637, + 0.4724793080240488, + 0.26128173619508743, + 0.04413587972521782, + 0.6233431287109852, + 0.0, + 0.22938595712184906, + 0.7223939076066017, + 0.04336344450712204, + 0.2188547272235155, + 1.2528121564537287, + 0.035709455609321594, + 0.0, + 0.02751920372247696, + 0.4462040439248085, + 0.08282694220542908, + 0.0, + 0.21404818072915077, + 0.14244255051016808, + 0.2416976448148489, + 0.43352799117565155, + 0.7507089357823133, + 0.19359983503818512, + 0.5954462178051472, + 0.19580825418233871, + 0.6630673110485077, + 0.5273447483778, + 0.37955708615481853, + 0.0876854658126831, + 0.6976513564586639, + 0.23326843604445457, + 0.09921430796384811, + 0.2927403822541237, + 0.8008967004716396, + 1.4274534918367863, + 0.42943591997027397, + 0.27836072258651257, + 0.042480893433094025, + 0.4078179635107517, + 0.413381427526474, + 0.06555061042308807, + 0.0, + 0.2151242271065712, + 0.9160622470080853, + 1.5484435949474573, + 0.12113092467188835, + 0.17302173376083374, + 1.035417314618826, + 0.12079140916466713, + 0.26888200640678406, + 0.13896392658352852, + 0.0 + ], + "unique_experts": 57, + "load_cv": 0.8108066399625791, + "normalized_load_entropy": 0.9160815754647675, + "max_load_share": 0.04513888888888889 + } + }, + "s1_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "476f6441d7af76409a9a6ba4ab10acbb9b7a7fc82e8980dba7b3fb359ac6dc9b", + "route_weight_sha256": "1256cddb40689fd14891996fbaccc7f27028e31d5b26e1cc1b1376385a666795", + "loads": [ + 0, + 3, + 2, + 2, + 0, + 2, + 3, + 2, + 3, + 1, + 0, + 1, + 3, + 4, + 1, + 0, + 3, + 0, + 3, + 3, + 0, + 1, + 4, + 0, + 0, + 0, + 6, + 1, + 0, + 1, + 3, + 5, + 4, + 8, + 2, + 0, + 3, + 0, + 7, + 1, + 3, + 2, + 1, + 2, + 5, + 8, + 0, + 5, + 1, + 1, + 1, + 1, + 2, + 0, + 4, + 1, + 3, + 2, + 4, + 0, + 2, + 5, + 3, + 0 + ], + "weighted_loads": [ + 0.0, + 0.3929139971733093, + 0.17926818132400513, + 0.12114623188972473, + 0.0, + 0.11265907064080238, + 0.20687101036310196, + 0.11173645034432411, + 0.25539015606045723, + 0.04702378809452057, + 0.0, + 0.05462375655770302, + 0.2752297595143318, + 0.40960343182086945, + 0.03908525034785271, + 0.0, + 0.31152644753456116, + 0.0, + 0.24246608465909958, + 0.1625862754881382, + 0.0, + 0.05304369702935219, + 0.6872161254286766, + 0.0, + 0.0, + 0.0, + 0.43611134588718414, + 0.07787877321243286, + 0.0, + 0.03180410712957382, + 0.14914162456989288, + 0.24528948217630386, + 0.2828802205622196, + 0.7394158095121384, + 0.15964049100875854, + 0.0, + 0.19812802597880363, + 0.0, + 0.5145078413188457, + 0.06639513373374939, + 0.12250452116131783, + 0.1515585519373417, + 0.14895331859588623, + 0.09434843063354492, + 0.2929106131196022, + 0.6744993440806866, + 0.0, + 0.4392240084707737, + 0.06175706908106804, + 0.043825965374708176, + 0.03474796190857887, + 0.07365275174379349, + 0.09861737303435802, + 0.0, + 0.26219717040657997, + 0.10823754221200943, + 0.29095135629177094, + 0.0814354345202446, + 0.1804579719901085, + 0.0, + 0.11905933916568756, + 0.2736992798745632, + 0.1440548337996006, + 0.0 + ], + "unique_experts": 48, + "load_cv": 0.9283284660133794, + "normalized_load_entropy": 0.8868573715615318, + "max_load_share": 0.057971014492753624 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "0ea18b2905b408555835fafcd229089ea52262fc63d3050007a0e48a645a7519", + "route_weight_sha256": "5d0bf67367be9eccd52db72a6006b0e639fba8cf37d6149ce58a7e4c42840f30", + "loads": [ + 0, + 4, + 5, + 3, + 2, + 2, + 21, + 3, + 8, + 7, + 0, + 10, + 7, + 6, + 10, + 2, + 12, + 0, + 5, + 15, + 2, + 5, + 5, + 1, + 2, + 1, + 6, + 2, + 1, + 4, + 3, + 8, + 10, + 9, + 6, + 8, + 4, + 15, + 7, + 10, + 3, + 9, + 3, + 2, + 6, + 11, + 15, + 6, + 4, + 1, + 9, + 8, + 3, + 3, + 4, + 13, + 19, + 2, + 4, + 12, + 8, + 5, + 3, + 0 + ], + "weighted_loads": [ + 0.0, + 0.4278517924249172, + 0.32012544199824333, + 0.15853306651115417, + 0.1503087915480137, + 0.11265907064080238, + 1.8993026819080114, + 0.1731596291065216, + 0.5975398160517216, + 0.755493625998497, + 0.0, + 0.652263455092907, + 0.604568287730217, + 0.4765039924532175, + 0.7118722498416901, + 0.18016210943460464, + 1.0125816613435745, + 0.0, + 0.3918124847114086, + 0.9654282294213772, + 0.09186676144599915, + 0.3004447501152754, + 1.2327156886458397, + 0.03530333563685417, + 0.06629723310470581, + 0.0353744812309742, + 0.43611134588718414, + 0.1042689923197031, + 0.035971272736787796, + 0.23225676640868187, + 0.14914162456989288, + 0.443760734051466, + 0.5102677624672651, + 0.7731269411742687, + 0.42022570595145226, + 0.795796412974596, + 0.23209796845912933, + 1.143485713750124, + 0.5145078413188457, + 0.5439915955066681, + 0.12250452116131783, + 0.6940650343894958, + 0.20692092925310135, + 0.09434843063354492, + 0.37710822373628616, + 0.7702908515930176, + 1.7060119546949863, + 0.45836247876286507, + 0.23950519040226936, + 0.043825965374708176, + 0.5779725797474384, + 0.34058806486427784, + 0.13575672917068005, + 0.16853120550513268, + 0.26219717040657997, + 1.186813086271286, + 2.065212167799473, + 0.0814354345202446, + 0.1804579719901085, + 1.1310047842562199, + 0.4243365749716759, + 0.2736992798745632, + 0.1440548337996006, + 0.0 + ], + "unique_experts": 60, + "load_cv": 0.7711148134717395, + "normalized_load_entropy": 0.9290850438688512, + "max_load_share": 0.0546875 + } + }, + "s0_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "649c30497bb51cebf44d70d055101992b33a85986a959354eea3e0b2ccb54bc8", + "route_weight_sha256": "6e7d043ff87968d6b0ed1bf8dadb1f75ec00220cd2e3295232833046920f3b2b", + "loads": [ + 0, + 3, + 2, + 2, + 0, + 2, + 3, + 2, + 3, + 1, + 0, + 1, + 3, + 4, + 0, + 0, + 3, + 0, + 3, + 3, + 0, + 1, + 4, + 0, + 0, + 0, + 6, + 1, + 0, + 1, + 3, + 5, + 4, + 8, + 2, + 0, + 3, + 0, + 7, + 1, + 2, + 2, + 1, + 2, + 5, + 8, + 1, + 5, + 1, + 1, + 1, + 1, + 2, + 0, + 4, + 1, + 3, + 3, + 4, + 0, + 2, + 5, + 3, + 0 + ], + "weighted_loads": [ + 0.0, + 0.3675072118639946, + 0.18322528153657913, + 0.11828074604272842, + 0.0, + 0.09597864001989365, + 0.19798266142606735, + 0.10535385459661484, + 0.24952317401766777, + 0.04554784670472145, + 0.0, + 0.05818048492074013, + 0.2558779790997505, + 0.4087872765958309, + 0.0, + 0.0, + 0.31504493206739426, + 0.0, + 0.2321036010980606, + 0.17264487594366074, + 0.0, + 0.05461440235376358, + 0.6981823220849037, + 0.0, + 0.0, + 0.0, + 0.4432707726955414, + 0.07996252924203873, + 0.0, + 0.033079128712415695, + 0.15339702740311623, + 0.249198816716671, + 0.3096354566514492, + 0.7327933255583048, + 0.16148360073566437, + 0.0, + 0.19732778146862984, + 0.0, + 0.5126503668725491, + 0.06182381138205528, + 0.08918073400855064, + 0.16211733222007751, + 0.14732712507247925, + 0.09567667916417122, + 0.29197316616773605, + 0.6507293917238712, + 0.03707275539636612, + 0.4246574901044369, + 0.0657244548201561, + 0.04215862229466438, + 0.039410416036844254, + 0.07532718777656555, + 0.09297347441315651, + 0.0, + 0.25997747853398323, + 0.10515274107456207, + 0.3397917151451111, + 0.11623802781105042, + 0.17683107033371925, + 0.0, + 0.11640447750687599, + 0.26589079201221466, + 0.13898928463459015, + 0.0 + ], + "unique_experts": 48, + "load_cv": 0.9283284660133794, + "normalized_load_entropy": 0.8868573715615318, + "max_load_share": 0.057971014492753624 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "c64d3e4c82f4683c9e44ffd1d46a0e9f2e84e6646a32ada0aa874e057eb9ea79", + "route_weight_sha256": "d54fbdff1197bb63a4601ba950dec4138c1681ee8b0ebc3b064ec664a0532037", + "loads": [ + 0, + 5, + 2, + 2, + 1, + 2, + 13, + 2, + 3, + 1, + 0, + 6, + 4, + 6, + 2, + 1, + 8, + 0, + 3, + 13, + 1, + 4, + 6, + 1, + 0, + 1, + 6, + 1, + 1, + 4, + 3, + 5, + 7, + 8, + 3, + 6, + 3, + 9, + 7, + 9, + 2, + 8, + 4, + 2, + 5, + 12, + 13, + 6, + 5, + 1, + 6, + 9, + 2, + 0, + 4, + 12, + 12, + 3, + 4, + 9, + 2, + 5, + 3, + 0 + ], + "weighted_loads": [ + 0.0, + 0.43321905471384525, + 0.18322528153657913, + 0.11828074604272842, + 0.0286709051579237, + 0.09597864001989365, + 1.3295276761054993, + 0.10535385459661484, + 0.24952317401766777, + 0.04554784670472145, + 0.0, + 0.3679922316223383, + 0.3087266683578491, + 0.4744009245187044, + 0.13276297226548195, + 0.03735201805830002, + 0.6130271926522255, + 0.0, + 0.2321036010980606, + 0.8168557398021221, + 0.04336344450712204, + 0.22670346684753895, + 1.2715541664510965, + 0.035709455609321594, + 0.0, + 0.02751920372247696, + 0.4432707726955414, + 0.07996252924203873, + 0.10543877631425858, + 0.21182171255350113, + 0.15339702740311623, + 0.249198816716671, + 0.44498495012521744, + 0.7327933255583048, + 0.19578703120350838, + 0.5902134887874126, + 0.19732778146862984, + 0.7596795484423637, + 0.5126503668725491, + 0.37883112020790577, + 0.08918073400855064, + 0.6147074289619923, + 0.24189915508031845, + 0.09567667916417122, + 0.29197316616773605, + 0.7816786766052246, + 1.5028982497751713, + 0.44379596039652824, + 0.2716501150280237, + 0.04215862229466438, + 0.4077109880745411, + 0.41407132148742676, + 0.09297347441315651, + 0.0, + 0.25997747853398323, + 1.0099889002740383, + 1.5203497111797333, + 0.11623802781105042, + 0.17683107033371925, + 0.9613983072340488, + 0.11640447750687599, + 0.26589079201221466, + 0.13898928463459015, + 0.0 + ], + "unique_experts": 58, + "load_cv": 0.8041174903405627, + "normalized_load_entropy": 0.9191212340877171, + "max_load_share": 0.04513888888888889 + } + }, + "s1_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "e2416e4263acf47a0657ddfe07217cac0b02f235295e6d6fbd7b018b253cd6c2", + "route_weight_sha256": "8d5b1a09648c207398757508ec157e19a212ce3544d9499cdcee84a968498ded", + "loads": [ + 0, + 3, + 2, + 2, + 0, + 2, + 3, + 2, + 3, + 1, + 0, + 1, + 3, + 4, + 0, + 0, + 3, + 0, + 3, + 3, + 0, + 1, + 4, + 0, + 0, + 0, + 6, + 1, + 0, + 1, + 3, + 6, + 4, + 8, + 2, + 0, + 3, + 0, + 7, + 1, + 2, + 2, + 1, + 2, + 5, + 8, + 0, + 5, + 1, + 1, + 1, + 1, + 2, + 1, + 4, + 1, + 3, + 2, + 4, + 0, + 2, + 5, + 3, + 0 + ], + "weighted_loads": [ + 0.0, + 0.38734228163957596, + 0.18053924292325974, + 0.12290683388710022, + 0.0, + 0.11369385197758675, + 0.20865900069475174, + 0.11133838817477226, + 0.2539636604487896, + 0.04738367721438408, + 0.0, + 0.05265717953443527, + 0.27086449414491653, + 0.412963192909956, + 0.0, + 0.0, + 0.31139951199293137, + 0.0, + 0.24452614784240723, + 0.16400078684091568, + 0.0, + 0.05579201504588127, + 0.6862605437636375, + 0.0, + 0.0, + 0.0, + 0.4296210929751396, + 0.07110923528671265, + 0.0, + 0.031369972974061966, + 0.15276658907532692, + 0.2897332198917866, + 0.2942262440919876, + 0.7360075283795595, + 0.1604657992720604, + 0.0, + 0.19673331081867218, + 0.0, + 0.512021005153656, + 0.06564179062843323, + 0.08738524094223976, + 0.15419696271419525, + 0.1565210372209549, + 0.09206266328692436, + 0.28694866225123405, + 0.6513673737645149, + 0.0, + 0.4389732927083969, + 0.06323198974132538, + 0.04212170094251633, + 0.03524765372276306, + 0.07278046011924744, + 0.10039006173610687, + 0.03933059051632881, + 0.26395364850759506, + 0.10791859030723572, + 0.3037784770131111, + 0.08103026822209358, + 0.18257244303822517, + 0.0, + 0.11704575270414352, + 0.26730215549468994, + 0.14500229060649872, + 0.0 + ], + "unique_experts": 48, + "load_cv": 0.9391259616998502, + "normalized_load_entropy": 0.8854742229773209, + "max_load_share": 0.057971014492753624 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "21e80bd5cf00301876672533f3289692d533851ce9b9e9348e2805d0b0c39831", + "route_weight_sha256": "b386f36802245ef1a76cbf780172db674579b24e70ad3d59cafa2aa2916c5959", + "loads": [ + 0, + 4, + 5, + 3, + 2, + 2, + 21, + 3, + 8, + 7, + 0, + 10, + 8, + 5, + 9, + 2, + 12, + 0, + 5, + 15, + 2, + 5, + 5, + 1, + 2, + 1, + 6, + 2, + 2, + 4, + 3, + 9, + 10, + 9, + 6, + 8, + 4, + 16, + 7, + 10, + 2, + 8, + 3, + 2, + 6, + 11, + 16, + 7, + 3, + 1, + 8, + 8, + 3, + 4, + 4, + 13, + 19, + 2, + 4, + 11, + 8, + 5, + 3, + 0 + ], + "weighted_loads": [ + 0.0, + 0.42228007689118385, + 0.32139650359749794, + 0.16029366850852966, + 0.1503087915480137, + 0.11369385197758675, + 1.7646347004920244, + 0.17276156693696976, + 0.5961133204400539, + 0.7558535151183605, + 0.0, + 0.6527602858841419, + 0.6659247130155563, + 0.43608118407428265, + 0.6732426322996616, + 0.16597576811909676, + 1.0087315179407597, + 0.0, + 0.39387254789471626, + 1.0631316751241684, + 0.09186676144599915, + 0.30011085979640484, + 1.2317601069808006, + 0.03530333563685417, + 0.06725407764315605, + 0.0353744812309742, + 0.4296210929751396, + 0.09749945439398289, + 0.15845051780343056, + 0.23383259773254395, + 0.15276658907532692, + 0.4882044717669487, + 0.5178256202489138, + 0.7697186600416899, + 0.4210510142147541, + 0.8089298941195011, + 0.23070325329899788, + 1.2910106889903545, + 0.512021005153656, + 0.5432382524013519, + 0.08738524094223976, + 0.6086161769926548, + 0.21448864787817, + 0.09206266328692436, + 0.371146272867918, + 0.7471588812768459, + 1.7484488300979137, + 0.500469509512186, + 0.1668020896613598, + 0.04212170094251633, + 0.5274419710040092, + 0.3436359278857708, + 0.1375294178724289, + 0.2078617960214615, + 0.26395364850759506, + 1.2457113415002823, + 2.081115387380123, + 0.08103026822209358, + 0.18257244303822517, + 1.0591862387955189, + 0.42232298851013184, + 0.26730215549468994, + 0.14500229060649872, + 0.0 + ], + "unique_experts": 60, + "load_cv": 0.7761640004248815, + "normalized_load_entropy": 0.9288925951089352, + "max_load_share": 0.0546875 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "ordered_topk_exact_tokens": 20, + "set_exact_tokens": 20, + "mean_set_jaccard": 0.9627329192546585, + "mean_token_weighted_tv": 0.011552945953672346, + "aggregate_load_tv": 0.021739130434782608 + }, + "system_bos": { + "tokens": 23, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.9503105590062112, + "mean_token_weighted_tv": 0.01512784494653992, + "aggregate_load_tv": 0.02898550724637681 + }, + "system_x": { + "tokens": 23, + "ordered_topk_exact_tokens": 16, + "set_exact_tokens": 20, + "mean_set_jaccard": 0.9627329192546583, + "mean_token_weighted_tv": 0.01592035146187181, + "aggregate_load_tv": 0.021739130434782608 + }, + "system_period": { + "tokens": 23, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.9503105590062112, + "mean_token_weighted_tv": 0.01737281987848489, + "aggregate_load_tv": 0.014492753623188404 + }, + "bos_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 18, + "mean_set_jaccard": 0.9378881987577641, + "mean_token_weighted_tv": 0.022657591080212074, + "aggregate_load_tv": 0.036231884057971016 + }, + "bos_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8881987577639753, + "mean_token_weighted_tv": 0.028853793102114098, + "aggregate_load_tv": 0.057971014492753624 + }, + "x_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 16, + "set_exact_tokens": 18, + "mean_set_jaccard": 0.9285714285714286, + "mean_token_weighted_tv": 0.025365962768378464, + "aggregate_load_tv": 0.043478260869565216 + }, + "x_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8881987577639753, + "mean_token_weighted_tv": 0.030595220908846543, + "aggregate_load_tv": 0.057971014492753624 + }, + "period_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.9006211180124224, + "mean_token_weighted_tv": 0.026553387551204018, + "aggregate_load_tv": 0.057971014492753624 + }, + "period_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8881987577639753, + "mean_token_weighted_tv": 0.030869897819407608, + "aggregate_load_tv": 0.057971014492753624 + } + } + }, + "layer_07": { + "layer": 7, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "462e7d9ddb6361517588fdcfb56781f02b09e74629fef7875fb6934e84d11491", + "route_weight_sha256": "24b1d80cd1046c29e14024aefe9309c0101f5ad6d44ac15d5f42a366881df708", + "loads": [ + 6, + 2, + 3, + 2, + 0, + 0, + 1, + 0, + 3, + 3, + 4, + 3, + 0, + 3, + 3, + 4, + 0, + 1, + 0, + 3, + 0, + 2, + 1, + 2, + 3, + 2, + 3, + 6, + 2, + 5, + 2, + 2, + 2, + 5, + 4, + 2, + 1, + 2, + 1, + 0, + 1, + 1, + 3, + 4, + 0, + 0, + 6, + 0, + 0, + 3, + 0, + 1, + 5, + 0, + 0, + 1, + 0, + 2, + 5, + 4, + 0, + 2, + 10, + 2 + ], + "weighted_loads": [ + 0.4693000018596649, + 0.11002535745501518, + 0.1414078138768673, + 0.10451240837574005, + 0.0, + 0.0, + 0.07169126719236374, + 0.0, + 0.20373734831809998, + 0.20857518911361694, + 0.20683863945305347, + 0.15051862597465515, + 0.0, + 0.2884196937084198, + 0.2816387377679348, + 0.2561231888830662, + 0.0, + 0.062069352716207504, + 0.0, + 0.3919209837913513, + 0.0, + 0.13346905633807182, + 0.039638619869947433, + 0.11872601881623268, + 0.43832333385944366, + 0.1300983652472496, + 0.21078113093972206, + 0.531256940215826, + 0.10333333909511566, + 0.4240554980933666, + 0.11727611348032951, + 0.08257875218987465, + 0.11773892119526863, + 0.27454082295298576, + 0.2742413468658924, + 0.17334453761577606, + 0.048867400735616684, + 0.09324293956160545, + 0.046938952058553696, + 0.0, + 0.04962916672229767, + 0.057644497603178024, + 0.3269655928015709, + 0.1545212473720312, + 0.0, + 0.0, + 0.44994786381721497, + 0.0, + 0.0, + 0.17947502061724663, + 0.0, + 0.046495530754327774, + 0.2944924086332321, + 0.0, + 0.0, + 0.07425489276647568, + 0.0, + 0.15138328075408936, + 0.8181728571653366, + 0.3027886897325516, + 0.0, + 0.08999092876911163, + 0.6618592888116837, + 0.10263651981949806 + ], + "unique_experts": 47, + "load_cv": 0.9247012835332911, + "normalized_load_entropy": 0.88705971576327, + "max_load_share": 0.07246376811594203 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "321454c72a1b6381b2a85125e6fb5fd74369bca56068f9459dd3474eb6e1ba4e", + "route_weight_sha256": "4e5098f8c23f63bdffd51a0000ecfd0855d172d7b224af978b45ad9ce9bad3ac", + "loads": [ + 6, + 2, + 3, + 5, + 0, + 1, + 8, + 0, + 10, + 3, + 5, + 6, + 0, + 8, + 3, + 4, + 15, + 3, + 2, + 4, + 0, + 2, + 4, + 4, + 7, + 2, + 8, + 6, + 5, + 5, + 2, + 2, + 5, + 6, + 4, + 2, + 1, + 2, + 11, + 3, + 1, + 12, + 7, + 6, + 4, + 0, + 9, + 2, + 0, + 3, + 15, + 1, + 5, + 1, + 0, + 8, + 0, + 2, + 9, + 4, + 0, + 8, + 13, + 9 + ], + "weighted_loads": [ + 0.4693000018596649, + 0.11002535745501518, + 0.1414078138768673, + 0.2145128697156906, + 0.0, + 0.041239287704229355, + 0.8013174757361412, + 0.0, + 0.7151051871478558, + 0.20857518911361694, + 0.24007144756615162, + 0.626630112528801, + 0.0, + 0.5740000158548355, + 0.2816387377679348, + 0.2561231888830662, + 2.011244297027588, + 0.1816606968641281, + 0.04148694407194853, + 0.47960299253463745, + 0.0, + 0.13346905633807182, + 0.21319815516471863, + 0.3358045555651188, + 0.5699369870126247, + 0.1300983652472496, + 0.5900066122412682, + 0.531256940215826, + 0.16666378267109394, + 0.4240554980933666, + 0.11727611348032951, + 0.08257875218987465, + 0.2313171736896038, + 0.3243975527584553, + 0.2742413468658924, + 0.17334453761577606, + 0.048867400735616684, + 0.09324293956160545, + 0.9437451809644699, + 0.14815430715680122, + 0.04962916672229767, + 1.1654142253100872, + 0.6894337981939316, + 0.18654380831867456, + 1.5441904850304127, + 0.0, + 0.582935843616724, + 0.1365242563188076, + 0.0, + 0.17947502061724663, + 1.1937478184700012, + 0.046495530754327774, + 0.2944924086332321, + 0.03133116289973259, + 0.0, + 0.7328004390001297, + 0.0, + 0.15138328075408936, + 0.9036301421001554, + 0.3027886897325516, + 0.0, + 0.38876773416996, + 0.7105602179653943, + 0.3733724616467953 + ], + "unique_experts": 55, + "load_cv": 0.828690771676461, + "normalized_load_entropy": 0.9124458336919985, + "max_load_share": 0.052083333333333336 + } + }, + "s1_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "a38999fb7a1d9bf902a50fa7bcefa37670a4b9b5f069aa31127d84cb604c34fa", + "route_weight_sha256": "ffd03ccd6c8b7bafd569fc0a449aff0b617e5ffaaa74d765f206c7fbbb085089", + "loads": [ + 6, + 2, + 2, + 3, + 0, + 0, + 1, + 1, + 3, + 3, + 3, + 2, + 0, + 3, + 2, + 4, + 0, + 1, + 0, + 3, + 0, + 2, + 1, + 2, + 3, + 2, + 3, + 7, + 2, + 4, + 2, + 2, + 2, + 5, + 4, + 2, + 1, + 2, + 1, + 0, + 1, + 1, + 3, + 4, + 0, + 0, + 6, + 1, + 0, + 3, + 1, + 2, + 5, + 0, + 0, + 1, + 0, + 2, + 5, + 4, + 0, + 2, + 10, + 1 + ], + "weighted_loads": [ + 0.4659108519554138, + 0.1136716790497303, + 0.10359165072441101, + 0.1445658691227436, + 0.0, + 0.0, + 0.07073867321014404, + 0.04529479891061783, + 0.19565436989068985, + 0.2032814770936966, + 0.18139398843050003, + 0.1162295863032341, + 0.0, + 0.2860339283943176, + 0.24250086396932602, + 0.2583766169846058, + 0.0, + 0.05990729108452797, + 0.0, + 0.39454490691423416, + 0.0, + 0.1350499987602234, + 0.03840634226799011, + 0.1183885708451271, + 0.44378622621297836, + 0.12788443267345428, + 0.2016017623245716, + 0.5642197653651237, + 0.08501213788986206, + 0.3903506323695183, + 0.11878801137208939, + 0.08165476098656654, + 0.11710004135966301, + 0.2607945054769516, + 0.2774532809853554, + 0.16710275784134865, + 0.049213290214538574, + 0.09327354282140732, + 0.04275550693273544, + 0.0, + 0.05405360087752342, + 0.05553776025772095, + 0.3182060196995735, + 0.1541835404932499, + 0.0, + 0.0, + 0.44261037930846214, + 0.027336793020367622, + 0.0, + 0.17608381062746048, + 0.03789293020963669, + 0.08861668035387993, + 0.29539939016103745, + 0.0, + 0.0, + 0.07411735504865646, + 0.0, + 0.15297012776136398, + 0.8357699662446976, + 0.31304869428277016, + 0.0, + 0.09292186796665192, + 0.6614127457141876, + 0.07672398537397385 + ], + "unique_experts": 50, + "load_cv": 0.9063476587683809, + "normalized_load_entropy": 0.896990656012695, + "max_load_share": 0.07246376811594203 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "5e226492705423b1c4e950b7428ae6fa35180509edf07d3e63f8a2ef8862b456", + "route_weight_sha256": "7c3a93bed052a5d116690f0fe5f1d28e7ea1befbd6a9f35f435cd470cbc6ce1b", + "loads": [ + 6, + 2, + 2, + 5, + 1, + 1, + 10, + 1, + 18, + 5, + 9, + 7, + 0, + 8, + 4, + 6, + 16, + 4, + 2, + 4, + 0, + 2, + 3, + 5, + 8, + 2, + 12, + 7, + 5, + 10, + 2, + 2, + 8, + 13, + 4, + 2, + 1, + 6, + 18, + 3, + 3, + 17, + 12, + 7, + 11, + 0, + 9, + 7, + 0, + 3, + 23, + 2, + 5, + 0, + 4, + 10, + 0, + 8, + 8, + 4, + 0, + 8, + 14, + 5 + ], + "weighted_loads": [ + 0.4659108519554138, + 0.1136716790497303, + 0.10359165072441101, + 0.2082444690167904, + 0.046353425830602646, + 0.044498711824417114, + 0.7960643377155066, + 0.04529479891061783, + 1.4441451840102673, + 0.30551284924149513, + 0.7011999748647213, + 0.7095207087695599, + 0.0, + 0.5931682754307985, + 0.30969027802348137, + 0.3556103743612766, + 2.418127443641424, + 0.2230432815849781, + 0.04108001943677664, + 0.48977312445640564, + 0.0, + 0.1350499987602234, + 0.16019600629806519, + 0.36704162135720253, + 0.5990715636871755, + 0.12788443267345428, + 0.9536551237106323, + 0.5642197653651237, + 0.14867276512086391, + 1.1744573935866356, + 0.11878801137208939, + 0.08165476098656654, + 0.5030583925545216, + 0.8009526319801807, + 0.2774532809853554, + 0.16710275784134865, + 0.049213290214538574, + 0.32144899666309357, + 1.8117559850215912, + 0.16095451638102531, + 0.277091596275568, + 1.6301336959004402, + 1.1155319772660732, + 0.22676957026124, + 2.1142269894480705, + 0.0, + 0.592322338372469, + 0.3605033550411463, + 0.0, + 0.17608381062746048, + 1.6767875887453556, + 0.08861668035387993, + 0.29539939016103745, + 0.0, + 0.20657256990671158, + 0.847833039239049, + 0.0, + 0.6944771893322468, + 0.8928904319182038, + 0.31304869428277016, + 0.0, + 0.38545900769531727, + 0.7455086624249816, + 0.19337229244410992 + ], + "unique_experts": 57, + "load_cv": 0.8498365855987974, + "normalized_load_entropy": 0.912738205429264, + "max_load_share": 0.059895833333333336 + } + }, + "s0_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "83febbe67de1a652eac4537ee920c70780ea213340dbd8d1546f3ebcef0f1aae", + "route_weight_sha256": "811009483e5dbec70383dba059f526aa861e888c1841edca83e0a6ab353a7771", + "loads": [ + 5, + 2, + 2, + 3, + 0, + 0, + 1, + 0, + 3, + 3, + 4, + 3, + 0, + 3, + 3, + 3, + 0, + 2, + 2, + 3, + 0, + 2, + 1, + 1, + 3, + 1, + 3, + 6, + 2, + 4, + 2, + 2, + 2, + 5, + 4, + 2, + 1, + 3, + 0, + 0, + 1, + 1, + 3, + 4, + 1, + 0, + 5, + 0, + 1, + 4, + 1, + 3, + 5, + 0, + 0, + 1, + 0, + 2, + 5, + 5, + 0, + 2, + 7, + 1 + ], + "weighted_loads": [ + 0.43330197781324387, + 0.11633970215916634, + 0.10293838754296303, + 0.15480370819568634, + 0.0, + 0.0, + 0.07470738887786865, + 0.0, + 0.20323272421956062, + 0.19526991620659828, + 0.2064512874931097, + 0.1486685499548912, + 0.0, + 0.27035047113895416, + 0.27748117968440056, + 0.22986765950918198, + 0.0, + 0.12039103731513023, + 0.06764914654195309, + 0.40496543794870377, + 0.0, + 0.13064123690128326, + 0.04063098877668381, + 0.07856839150190353, + 0.45256374031305313, + 0.09856532514095306, + 0.2224554419517517, + 0.5369255915284157, + 0.09716898947954178, + 0.41422171890735626, + 0.1250656433403492, + 0.0796150453388691, + 0.11827023327350616, + 0.2846824899315834, + 0.25899387896060944, + 0.15835845470428467, + 0.0444139689207077, + 0.1374417319893837, + 0.0, + 0.0, + 0.04916534945368767, + 0.058069393038749695, + 0.33527108281850815, + 0.15383578836917877, + 0.038058578968048096, + 0.0, + 0.4143408052623272, + 0.0, + 0.03773320093750954, + 0.24235057458281517, + 0.0468483529984951, + 0.11889837682247162, + 0.3046048544347286, + 0.0, + 0.0, + 0.07871956378221512, + 0.0, + 0.14788643270730972, + 0.8730223923921585, + 0.33760857954621315, + 0.0, + 0.0891350507736206, + 0.5198679640889168, + 0.08150245249271393 + ], + "unique_experts": 50, + "load_cv": 0.8083527401382227, + "normalized_load_entropy": 0.9062122405820184, + "max_load_share": 0.050724637681159424 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "327fd745a732a6d92806db3129002686558853574a6cb976b6e02893d2c46483", + "route_weight_sha256": "acbe6871d11d4336377ff23a2e97c0f4532d44b8c5c051e071ede74c6d3becc1", + "loads": [ + 5, + 2, + 2, + 6, + 0, + 1, + 10, + 0, + 10, + 3, + 5, + 7, + 0, + 8, + 3, + 3, + 15, + 4, + 5, + 4, + 0, + 2, + 4, + 3, + 6, + 1, + 8, + 6, + 4, + 4, + 2, + 2, + 5, + 7, + 4, + 2, + 1, + 3, + 9, + 3, + 1, + 12, + 7, + 5, + 5, + 0, + 8, + 2, + 1, + 4, + 16, + 3, + 5, + 2, + 0, + 8, + 0, + 2, + 8, + 5, + 0, + 8, + 9, + 8 + ], + "weighted_loads": [ + 0.43330197781324387, + 0.11633970215916634, + 0.10293838754296303, + 0.2648041695356369, + 0.0, + 0.041239287704229355, + 0.9323323406279087, + 0.0, + 0.7098380848765373, + 0.19526991620659828, + 0.23968409560620785, + 0.6722831726074219, + 0.0, + 0.5559307932853699, + 0.27748117968440056, + 0.22986765950918198, + 2.086080238223076, + 0.23373660817742348, + 0.1504058362916112, + 0.4894462749361992, + 0.0, + 0.13064123690128326, + 0.214190524071455, + 0.2852419391274452, + 0.5770951192826033, + 0.09856532514095306, + 0.6074915267527103, + 0.5369255915284157, + 0.14737518317997456, + 0.41422171890735626, + 0.1250656433403492, + 0.0796150453388691, + 0.23184848576784134, + 0.372767087072134, + 0.25899387896060944, + 0.15835845470428467, + 0.0444139689207077, + 0.1374417319893837, + 0.8343290500342846, + 0.15293258056044579, + 0.04916534945368767, + 1.0951323918998241, + 0.6880529150366783, + 0.17146690748631954, + 0.7619774267077446, + 0.0, + 0.5532781332731247, + 0.13805517554283142, + 0.03773320093750954, + 0.24235057458281517, + 1.3441207110881805, + 0.11889837682247162, + 0.3046048544347286, + 0.07715168967843056, + 0.0, + 0.7372651100158691, + 0.0, + 0.14788643270730972, + 0.9434735421091318, + 0.33760857954621315, + 0.0, + 0.387911856174469, + 0.5629526879638433, + 0.35223839432001114 + ], + "unique_experts": 56, + "load_cv": 0.7905694150420949, + "normalized_load_entropy": 0.920239100035918, + "max_load_share": 0.05555555555555555 + } + }, + "s1_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "86fb6dbcab5acd909acbf7c557a4d4375bbb14f962e71cbba49212c6552d1865", + "route_weight_sha256": "9b0d13702a6c578e0500db649f22b6e4eda7618424a68511a1a7a2464f350a48", + "loads": [ + 6, + 2, + 2, + 3, + 0, + 0, + 1, + 1, + 3, + 3, + 3, + 3, + 0, + 3, + 3, + 3, + 0, + 2, + 2, + 3, + 0, + 2, + 1, + 1, + 4, + 2, + 3, + 7, + 2, + 4, + 2, + 2, + 2, + 5, + 3, + 2, + 1, + 2, + 0, + 0, + 1, + 1, + 3, + 4, + 0, + 0, + 5, + 0, + 1, + 3, + 1, + 2, + 5, + 0, + 0, + 1, + 0, + 2, + 5, + 5, + 0, + 2, + 8, + 1 + ], + "weighted_loads": [ + 0.4814094640314579, + 0.12365652993321419, + 0.10258593037724495, + 0.15181496739387512, + 0.0, + 0.0, + 0.06736065447330475, + 0.041040509939193726, + 0.18929897248744965, + 0.1974962279200554, + 0.1862526722252369, + 0.15264135599136353, + 0.0, + 0.27724963054060936, + 0.2784673050045967, + 0.2368970736861229, + 0.0, + 0.11623460799455643, + 0.06385849602520466, + 0.4088711142539978, + 0.0, + 0.1382461003959179, + 0.04119236022233963, + 0.08176746964454651, + 0.4732657242566347, + 0.13186047226190567, + 0.2067163921892643, + 0.577104777097702, + 0.10094893351197243, + 0.40921103209257126, + 0.12481538951396942, + 0.07575804740190506, + 0.11840054765343666, + 0.28424234315752983, + 0.21979378163814545, + 0.15884672477841377, + 0.04674438387155533, + 0.09696539491415024, + 0.0, + 0.0, + 0.05058613419532776, + 0.05259547010064125, + 0.3305738791823387, + 0.15730083733797073, + 0.0, + 0.0, + 0.4131907522678375, + 0.0, + 0.039339642971754074, + 0.18538134172558784, + 0.041410867124795914, + 0.08745243772864342, + 0.29916471615433693, + 0.0, + 0.0, + 0.07790504395961761, + 0.0, + 0.15778008103370667, + 0.873168908059597, + 0.3471965678036213, + 0.0, + 0.09605846181511879, + 0.5746478661894798, + 0.07797093689441681 + ], + "unique_experts": 50, + "load_cv": 0.8449412085303426, + "normalized_load_entropy": 0.9033253329424494, + "max_load_share": 0.057971014492753624 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "d35af9cd5829d1958db248b67eca543064d8325603dbf1c2bc7f8f69b4efe8c2", + "route_weight_sha256": "df18a2aec4e8abada80104646c4517dc89d0927518688a23b2362c1374f65aee", + "loads": [ + 6, + 2, + 2, + 5, + 1, + 1, + 12, + 1, + 18, + 5, + 9, + 8, + 0, + 8, + 5, + 5, + 16, + 5, + 5, + 4, + 0, + 2, + 3, + 5, + 8, + 2, + 12, + 7, + 4, + 10, + 2, + 2, + 8, + 13, + 3, + 2, + 1, + 6, + 17, + 3, + 3, + 17, + 12, + 7, + 11, + 0, + 8, + 6, + 1, + 3, + 23, + 2, + 5, + 0, + 4, + 10, + 0, + 8, + 7, + 5, + 0, + 8, + 11, + 5 + ], + "weighted_loads": [ + 0.4814094640314579, + 0.12365652993321419, + 0.10258593037724495, + 0.2154935672879219, + 0.046353425830602646, + 0.044498711824417114, + 0.9647172633558512, + 0.041040509939193726, + 1.4426077865064144, + 0.2997276000678539, + 0.7060586586594582, + 0.7582576498389244, + 0.0, + 0.5843839775770903, + 0.34565671905875206, + 0.33413083106279373, + 2.447267547249794, + 0.27466054260730743, + 0.14175597671419382, + 0.49128788709640503, + 0.0, + 0.1382461003959179, + 0.1629820242524147, + 0.3646170645952225, + 0.6213995665311813, + 0.13186047226190567, + 0.9695258848369122, + 0.577104777097702, + 0.15089786797761917, + 1.1933177933096886, + 0.12481538951396942, + 0.07575804740190506, + 0.5043588988482952, + 0.824400469660759, + 0.21979378163814545, + 0.15884672477841377, + 0.04674438387155533, + 0.3251408487558365, + 1.7069743908941746, + 0.16354291886091232, + 0.27362412959337234, + 1.5682973749935627, + 1.1093273349106312, + 0.2568176854401827, + 1.2882225438952446, + 0.0, + 0.5661057159304619, + 0.33531923219561577, + 0.039339642971754074, + 0.18538134172558784, + 1.8202549293637276, + 0.08745243772864342, + 0.29916471615433693, + 0.0, + 0.20657256990671158, + 0.8516207281500101, + 0.0, + 0.6992871426045895, + 0.9149194750934839, + 0.3471965678036213, + 0.0, + 0.38859560154378414, + 0.6532181836664677, + 0.19461924396455288 + ], + "unique_experts": 58, + "load_cv": 0.8307250848907035, + "normalized_load_entropy": 0.9170819961567791, + "max_load_share": 0.059895833333333336 + } + }, + "s0_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "a8ef19147ae27bbd312ecb367fe2843de440620af15224a1de7472b8000e769e", + "route_weight_sha256": "3e6ceb180d40e6a61aa5103354f646317d585e291326f16a08162317647afe09", + "loads": [ + 5, + 2, + 2, + 3, + 0, + 0, + 1, + 1, + 3, + 3, + 4, + 2, + 0, + 3, + 3, + 3, + 0, + 1, + 2, + 3, + 0, + 1, + 1, + 1, + 3, + 2, + 3, + 7, + 2, + 4, + 2, + 2, + 2, + 5, + 4, + 2, + 1, + 3, + 2, + 0, + 1, + 1, + 3, + 4, + 0, + 0, + 6, + 0, + 0, + 4, + 1, + 2, + 5, + 0, + 0, + 1, + 0, + 2, + 5, + 4, + 0, + 2, + 8, + 1 + ], + "weighted_loads": [ + 0.41116273403167725, + 0.11079514026641846, + 0.10716254264116287, + 0.1470290794968605, + 0.0, + 0.0, + 0.06935415416955948, + 0.03972291201353073, + 0.21018211171030998, + 0.1894804760813713, + 0.21270926110446453, + 0.1048835776746273, + 0.0, + 0.282166562974453, + 0.2789985314011574, + 0.23236925154924393, + 0.0, + 0.07246498763561249, + 0.06760910153388977, + 0.43268983066082, + 0.0, + 0.0708271712064743, + 0.040822938084602356, + 0.08403541147708893, + 0.4244259148836136, + 0.13294338434934616, + 0.23650992661714554, + 0.5401006750762463, + 0.0898151732981205, + 0.41863834857940674, + 0.12583495676517487, + 0.08029722049832344, + 0.12138200923800468, + 0.3095835708081722, + 0.2513083256781101, + 0.14684544876217842, + 0.04682813957333565, + 0.1283484324812889, + 0.11707927659153938, + 0.0, + 0.05057644844055176, + 0.060015421360731125, + 0.33553269505500793, + 0.15596794337034225, + 0.0, + 0.0, + 0.4801773875951767, + 0.0, + 0.0, + 0.2286197431385517, + 0.043843526393175125, + 0.08647966012358665, + 0.30158423259854317, + 0.0, + 0.0, + 0.07469643652439117, + 0.0, + 0.1351807788014412, + 0.8956188559532166, + 0.2959773801267147, + 0.0, + 0.09231659770011902, + 0.5440792180597782, + 0.07408338040113449 + ], + "unique_experts": 50, + "load_cv": 0.8489092548178243, + "normalized_load_entropy": 0.9022618250665603, + "max_load_share": 0.057971014492753624 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "ed27044cbaec65836b7c7a213150e98203b74e5bddfa5a9b33701ed3356a0cc5", + "route_weight_sha256": "42f7c7ccd34c813505b2f83a1a69cc9f05ec4a6b1e5610a3ec896f8e076e7d38", + "loads": [ + 5, + 2, + 2, + 6, + 0, + 2, + 5, + 1, + 10, + 3, + 5, + 6, + 1, + 9, + 3, + 3, + 16, + 4, + 4, + 4, + 0, + 1, + 4, + 3, + 6, + 2, + 7, + 7, + 4, + 4, + 2, + 2, + 5, + 7, + 4, + 2, + 1, + 3, + 11, + 3, + 1, + 12, + 8, + 5, + 3, + 0, + 10, + 3, + 0, + 4, + 15, + 2, + 5, + 1, + 0, + 8, + 0, + 2, + 8, + 4, + 0, + 9, + 10, + 9 + ], + "weighted_loads": [ + 0.41116273403167725, + 0.11079514026641846, + 0.10716254264116287, + 0.25702954083681107, + 0.0, + 0.09581402689218521, + 0.5185684412717819, + 0.03972291201353073, + 0.7238837741315365, + 0.1894804760813713, + 0.24594206921756268, + 0.6477385722100735, + 0.03786856681108475, + 0.602018341422081, + 0.2789985314011574, + 0.23236925154924393, + 2.358370754867792, + 0.27323249727487564, + 0.1090960456058383, + 0.49724022299051285, + 0.0, + 0.0708271712064743, + 0.21438247337937355, + 0.28480999171733856, + 0.5489572938531637, + 0.13294338434934616, + 0.5741192251443863, + 0.5401006750762463, + 0.14002136699855328, + 0.41863834857940674, + 0.12583495676517487, + 0.08029722049832344, + 0.23496026173233986, + 0.3989201672375202, + 0.2513083256781101, + 0.14684544876217842, + 0.04682813957333565, + 0.1283484324812889, + 0.8708955198526382, + 0.14746755361557007, + 0.05057644844055176, + 1.0112126544117928, + 0.7174404449760914, + 0.17359906248748302, + 0.6780114881694317, + 0.0, + 0.6476559787988663, + 0.18774332478642464, + 0.0, + 0.2286197431385517, + 1.1375480964779854, + 0.08647966012358665, + 0.30158423259854317, + 0.03133116289973259, + 0.0, + 0.7332419827580452, + 0.0, + 0.1351807788014412, + 0.9660700056701899, + 0.2959773801267147, + 0.0, + 0.44364409893751144, + 0.5871639419347048, + 0.4263109564781189 + ], + "unique_experts": 57, + "load_cv": 0.8089010988089465, + "normalized_load_entropy": 0.9194648174432358, + "max_load_share": 0.05555555555555555 + } + }, + "s1_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "619a5e6e8800ce56ac9b9a08e224b81445c144f44330a9e28b7c500cd9d86c01", + "route_weight_sha256": "947c6379a07d7d1f985365ad685ce1ec044db0cd40ddd8e719f8b6be92f6e311", + "loads": [ + 6, + 2, + 3, + 3, + 0, + 0, + 1, + 1, + 3, + 3, + 3, + 2, + 0, + 3, + 3, + 3, + 0, + 1, + 2, + 3, + 0, + 1, + 1, + 1, + 4, + 2, + 3, + 7, + 1, + 5, + 2, + 2, + 2, + 6, + 4, + 2, + 1, + 2, + 2, + 0, + 1, + 1, + 3, + 4, + 0, + 0, + 6, + 0, + 1, + 3, + 0, + 2, + 4, + 0, + 0, + 1, + 0, + 2, + 5, + 4, + 0, + 2, + 8, + 1 + ], + "weighted_loads": [ + 0.4701690450310707, + 0.11673390492796898, + 0.16610782966017723, + 0.14807426556944847, + 0.0, + 0.0, + 0.06041247770190239, + 0.04226009175181389, + 0.197012260556221, + 0.20255017653107643, + 0.1892658732831478, + 0.1196490079164505, + 0.0, + 0.2855139449238777, + 0.2889363318681717, + 0.21859708800911903, + 0.0, + 0.07266784459352493, + 0.06658788397908211, + 0.43753379583358765, + 0.0, + 0.07349605858325958, + 0.041236940771341324, + 0.08944807201623917, + 0.4481485150754452, + 0.1388246826827526, + 0.21839500218629837, + 0.5626040063798428, + 0.05513937771320343, + 0.4464884400367737, + 0.12556983157992363, + 0.08160417899489403, + 0.11525764688849449, + 0.34375960379838943, + 0.24264703318476677, + 0.1496327705681324, + 0.049083463847637177, + 0.08815484493970871, + 0.10970444604754448, + 0.0, + 0.05445775389671326, + 0.05352534353733063, + 0.3332396671175957, + 0.15815170109272003, + 0.0, + 0.0, + 0.47376690804958344, + 0.0, + 0.038184937089681625, + 0.18418609723448753, + 0.0, + 0.08726413175463676, + 0.2549668215215206, + 0.0, + 0.0, + 0.07501012086868286, + 0.0, + 0.14060456305742264, + 0.8783878311514854, + 0.30679135397076607, + 0.0, + 0.10016253963112831, + 0.56297891959548, + 0.08141504228115082 + ], + "unique_experts": 50, + "load_cv": 0.8723385725572282, + "normalized_load_entropy": 0.8991758871898167, + "max_load_share": 0.057971014492753624 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "c04234399664eac3da223ee6c3cffc013dacb975a6eec8cb33f0bb31840dce19", + "route_weight_sha256": "2ed020b16812bc7c4a7fa555b1720be612fd2732ccf41c6851cfddfe1f1afb27", + "loads": [ + 6, + 2, + 3, + 5, + 1, + 2, + 7, + 1, + 18, + 5, + 9, + 7, + 0, + 9, + 5, + 5, + 17, + 6, + 4, + 4, + 0, + 1, + 3, + 5, + 9, + 2, + 12, + 7, + 3, + 11, + 2, + 2, + 8, + 14, + 4, + 2, + 1, + 6, + 17, + 3, + 3, + 16, + 13, + 7, + 10, + 0, + 10, + 7, + 1, + 3, + 21, + 2, + 4, + 0, + 4, + 10, + 0, + 8, + 7, + 4, + 0, + 9, + 11, + 6 + ], + "weighted_loads": [ + 0.4701690450310707, + 0.11673390492796898, + 0.16610782966017723, + 0.21175286546349525, + 0.046353425830602646, + 0.09798849001526833, + 0.5184614155441523, + 0.04226009175181389, + 1.4789369814097881, + 0.30478154867887497, + 0.7090718597173691, + 0.7602216638624668, + 0.0, + 0.6227750517427921, + 0.35612574592232704, + 0.31583084538578987, + 2.710949383676052, + 0.3503993824124336, + 0.10766790341585875, + 0.5069827437400818, + 0.0, + 0.07349605858325958, + 0.1630266048014164, + 0.3421977013349533, + 0.6287131439894438, + 0.1388246826827526, + 0.9871985130012035, + 0.5626040063798428, + 0.10508831217885017, + 1.230595201253891, + 0.12556983157992363, + 0.08160417899489403, + 0.501215998083353, + 0.8839177303016186, + 0.24264703318476677, + 0.1496327705681324, + 0.049083463847637177, + 0.31633029878139496, + 1.6852220483124256, + 0.15983255952596664, + 0.27749574929475784, + 1.4001036509871483, + 1.1368161514401436, + 0.2610140610486269, + 1.2506593391299248, + 0.0, + 0.6601702086627483, + 0.4032452963292599, + 0.038184937089681625, + 0.18418609723448753, + 1.5330826453864574, + 0.08726413175463676, + 0.2549668215215206, + 0.0, + 0.20657256990671158, + 0.8487258050590754, + 0.0, + 0.6821116246283054, + 0.9201383981853724, + 0.30679135397076607, + 0.0, + 0.44675819762051105, + 0.6415492370724678, + 0.26727296970784664 + ], + "unique_experts": 58, + "load_cv": 0.8186201126828542, + "normalized_load_entropy": 0.9181936371004106, + "max_load_share": 0.0546875 + } + }, + "s0_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "6051f2f5022e1eae233229ba29508e173e5b984f114f1c148260dbba72994c07", + "route_weight_sha256": "3b9ba4673f852a01603aeb4f3fa6918fb5a263184ff79ca8a90daf1a0d48e22d", + "loads": [ + 5, + 2, + 2, + 3, + 0, + 0, + 1, + 0, + 3, + 3, + 4, + 2, + 0, + 3, + 3, + 3, + 0, + 1, + 2, + 3, + 0, + 1, + 1, + 1, + 3, + 2, + 3, + 6, + 2, + 4, + 2, + 2, + 2, + 5, + 4, + 2, + 1, + 3, + 2, + 0, + 1, + 1, + 3, + 4, + 1, + 0, + 6, + 0, + 1, + 4, + 1, + 2, + 5, + 0, + 0, + 1, + 0, + 2, + 5, + 5, + 0, + 2, + 7, + 1 + ], + "weighted_loads": [ + 0.41819848120212555, + 0.11077829450368881, + 0.1053595319390297, + 0.1483772099018097, + 0.0, + 0.0, + 0.07070465385913849, + 0.0, + 0.21278414502739906, + 0.19811448082327843, + 0.21800178661942482, + 0.10601050406694412, + 0.0, + 0.2848282605409622, + 0.2856106758117676, + 0.23333290964365005, + 0.0, + 0.07270047068595886, + 0.06648223660886288, + 0.41835685074329376, + 0.0, + 0.07282806187868118, + 0.038425762206315994, + 0.08478005230426788, + 0.41998016089200974, + 0.12758618965744972, + 0.2500876560807228, + 0.515400618314743, + 0.0995325893163681, + 0.4139874652028084, + 0.12312017008662224, + 0.08424759656190872, + 0.1206643357872963, + 0.31959299370646477, + 0.2597925215959549, + 0.15159215778112411, + 0.046290382742881775, + 0.1272583268582821, + 0.11808434128761292, + 0.0, + 0.049931056797504425, + 0.05993776395916939, + 0.3409097120165825, + 0.1549459584057331, + 0.03724177926778793, + 0.0, + 0.46659159660339355, + 0.0, + 0.036652520298957825, + 0.22628363966941833, + 0.04606956988573074, + 0.08560093864798546, + 0.2981962189078331, + 0.0, + 0.0, + 0.07583662867546082, + 0.0, + 0.14389999955892563, + 0.8687951043248177, + 0.3368440456688404, + 0.0, + 0.09454723820090294, + 0.5051373578608036, + 0.07930198311805725 + ], + "unique_experts": 51, + "load_cv": 0.8124994950962191, + "normalized_load_entropy": 0.9081562508168456, + "max_load_share": 0.050724637681159424 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "6e550ee19d58f066264ca3f9f34e0293f8ccd8b3357ae0ddabe2910651dff94b", + "route_weight_sha256": "b42054ef99fdf43cd2deddbb5abed9240da74f3cb32f3027fab2b8c0220fbf4b", + "loads": [ + 5, + 2, + 2, + 6, + 0, + 1, + 6, + 0, + 11, + 3, + 5, + 6, + 1, + 8, + 3, + 3, + 16, + 4, + 4, + 4, + 0, + 1, + 5, + 3, + 6, + 2, + 7, + 6, + 4, + 4, + 2, + 2, + 5, + 7, + 4, + 2, + 1, + 3, + 12, + 3, + 1, + 13, + 8, + 5, + 4, + 0, + 8, + 2, + 1, + 4, + 17, + 2, + 5, + 1, + 0, + 8, + 0, + 2, + 8, + 5, + 0, + 8, + 9, + 8 + ], + "weighted_loads": [ + 0.41819848120212555, + 0.11077829450368881, + 0.1053595319390297, + 0.25837767124176025, + 0.0, + 0.041239287704229355, + 0.5600321553647518, + 0.0, + 0.8035122007131577, + 0.19811448082327843, + 0.25123459473252296, + 0.6517282500863075, + 0.03673533722758293, + 0.5704085826873779, + 0.2856106758117676, + 0.23333290964365005, + 2.3320959843695164, + 0.2686231806874275, + 0.1079691806808114, + 0.4783949553966522, + 0.0, + 0.07282806187868118, + 0.25638803467154503, + 0.28340598940849304, + 0.5445115398615599, + 0.12758618965744972, + 0.5902658924460411, + 0.515400618314743, + 0.14973878301680088, + 0.4139874652028084, + 0.12312017008662224, + 0.08424759656190872, + 0.23424258828163147, + 0.4053001180291176, + 0.2597925215959549, + 0.15159215778112411, + 0.046290382742881775, + 0.1272583268582821, + 0.9823156148195267, + 0.15169013291597366, + 0.049931056797504425, + 1.074535071849823, + 0.7170989476144314, + 0.17257707752287388, + 0.705811645835638, + 0.0, + 0.5579214207828045, + 0.13900698348879814, + 0.036652520298957825, + 0.22628363966941833, + 1.4734734110534191, + 0.08560093864798546, + 0.2981962189078331, + 0.03133116289973259, + 0.0, + 0.7343821749091148, + 0.0, + 0.14389999955892563, + 0.939246254041791, + 0.3368440456688404, + 0.0, + 0.3933240436017513, + 0.5482220817357302, + 0.35003792494535446 + ], + "unique_experts": 57, + "load_cv": 0.828690771676461, + "normalized_load_entropy": 0.9173000814161872, + "max_load_share": 0.059027777777777776 + } + }, + "s1_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "47ff4b88acb30df4360d414a3985aa2d740f043f0343e139a1fe20e17f7d765d", + "route_weight_sha256": "54bed674d49944560ca64b99a533860b14e1a434c43108f22c199a8fa8a041bb", + "loads": [ + 6, + 3, + 3, + 3, + 0, + 0, + 1, + 0, + 3, + 3, + 3, + 2, + 0, + 3, + 3, + 3, + 0, + 1, + 2, + 3, + 0, + 1, + 1, + 1, + 3, + 2, + 3, + 7, + 1, + 5, + 2, + 2, + 2, + 6, + 4, + 2, + 1, + 2, + 2, + 0, + 1, + 1, + 3, + 4, + 0, + 0, + 6, + 1, + 1, + 3, + 0, + 2, + 4, + 0, + 0, + 1, + 0, + 2, + 5, + 4, + 0, + 2, + 8, + 1 + ], + "weighted_loads": [ + 0.46658018603920937, + 0.1609782688319683, + 0.16562237590551376, + 0.14823691174387932, + 0.0, + 0.0, + 0.06123820319771767, + 0.0, + 0.19304411858320236, + 0.20548614114522934, + 0.18360335379838943, + 0.11865521967411041, + 0.0, + 0.29063770920038223, + 0.2837957851588726, + 0.22042794525623322, + 0.0, + 0.07112165540456772, + 0.06570977717638016, + 0.4302317947149277, + 0.0, + 0.07542654126882553, + 0.04130302742123604, + 0.08684296160936356, + 0.4013621583580971, + 0.13418076187372208, + 0.22386939823627472, + 0.5595555640757084, + 0.06346970796585083, + 0.4413973204791546, + 0.12413337454199791, + 0.0807375330477953, + 0.11357532814145088, + 0.34557878226041794, + 0.24917792901396751, + 0.15077810734510422, + 0.046390801668167114, + 0.0888901948928833, + 0.1139884926378727, + 0.0, + 0.053105343133211136, + 0.05352731794118881, + 0.335364393889904, + 0.1553630828857422, + 0.0, + 0.0, + 0.46299178153276443, + 0.028342878445982933, + 0.03761809319257736, + 0.18219701573252678, + 0.0, + 0.09035304188728333, + 0.24504004791378975, + 0.0, + 0.0, + 0.07473911345005035, + 0.0, + 0.14536750316619873, + 0.8820741921663284, + 0.3134680725634098, + 0.0, + 0.09837270900607109, + 0.5496811605989933, + 0.07828133553266525 + ], + "unique_experts": 50, + "load_cv": 0.8684775806712252, + "normalized_load_entropy": 0.8997679463633347, + "max_load_share": 0.057971014492753624 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "62002ecb4c6592eb3f4b61609fcbd72fcf9af16334275021d5e47fd3da6a2fee", + "route_weight_sha256": "131d84c867ab76fa01d7e70ceedcfc40a3054671b74556e46289921f490e4237", + "loads": [ + 6, + 3, + 3, + 5, + 1, + 1, + 8, + 0, + 19, + 5, + 9, + 7, + 0, + 8, + 5, + 5, + 17, + 6, + 4, + 4, + 0, + 1, + 4, + 4, + 7, + 2, + 12, + 7, + 3, + 11, + 2, + 2, + 9, + 14, + 4, + 2, + 1, + 6, + 18, + 3, + 3, + 18, + 13, + 7, + 10, + 0, + 8, + 7, + 1, + 3, + 23, + 2, + 4, + 0, + 4, + 10, + 0, + 8, + 7, + 4, + 0, + 8, + 11, + 5 + ], + "weighted_loads": [ + 0.46658018603920937, + 0.1609782688319683, + 0.16562237590551376, + 0.2119155116379261, + 0.046353425830602646, + 0.044498711824417114, + 0.5561360474675894, + 0.0, + 1.5354697704315186, + 0.3077175132930279, + 0.7034093402326107, + 0.7087421268224716, + 0.0, + 0.5977720562368631, + 0.35098519921302795, + 0.31766170263290405, + 2.6570224165916443, + 0.33595065772533417, + 0.1067897966131568, + 0.4957643449306488, + 0.0, + 0.07542654126882553, + 0.19553539901971817, + 0.29871145263314247, + 0.5494960006326437, + 0.13418076187372208, + 0.9999018013477325, + 0.5595555640757084, + 0.11341864243149757, + 1.225504081696272, + 0.12413337454199791, + 0.0807375330477953, + 0.5328820273280144, + 0.8857369087636471, + 0.24917792901396751, + 0.15077810734510422, + 0.046390801668167114, + 0.31706564873456955, + 1.775870706886053, + 0.16308145597577095, + 0.2761433385312557, + 1.4995545856654644, + 1.1441630721092224, + 0.2556264642626047, + 1.2485431358218193, + 0.0, + 0.568407692015171, + 0.369999160990119, + 0.03761809319257736, + 0.18219701573252678, + 1.9666099809110165, + 0.09035304188728333, + 0.24504004791378975, + 0.0, + 0.20657256990671158, + 0.8484547976404428, + 0.0, + 0.6868745647370815, + 0.9238247592002153, + 0.3134680725634098, + 0.0, + 0.39090984873473644, + 0.6282514780759811, + 0.19492964260280132 + ], + "unique_experts": 57, + "load_cv": 0.8564501996289361, + "normalized_load_entropy": 0.9128559818868995, + "max_load_share": 0.059895833333333336 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.9006211180124224, + "mean_token_weighted_tv": 0.019718492930026157, + "aggregate_load_tv": 0.043478260869565216 + }, + "system_bos": { + "tokens": 23, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.9130434782608695, + "mean_token_weighted_tv": 0.02065379277843496, + "aggregate_load_tv": 0.043478260869565216 + }, + "system_x": { + "tokens": 23, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.9006211180124224, + "mean_token_weighted_tv": 0.02596816173552171, + "aggregate_load_tv": 0.043478260869565216 + }, + "system_period": { + "tokens": 23, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8881987577639753, + "mean_token_weighted_tv": 0.027760280012760475, + "aggregate_load_tv": 0.05797101449275362 + }, + "bos_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 11, + "mean_set_jaccard": 0.8509316770186336, + "mean_token_weighted_tv": 0.033776714507004486, + "aggregate_load_tv": 0.08695652173913043 + }, + "bos_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.8913043478260869, + "mean_token_weighted_tv": 0.026518264501962974, + "aggregate_load_tv": 0.05797101449275362 + }, + "x_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 12, + "mean_set_jaccard": 0.8633540372670808, + "mean_token_weighted_tv": 0.03626347758361827, + "aggregate_load_tv": 0.07246376811594203 + }, + "x_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8881987577639753, + "mean_token_weighted_tv": 0.03311073452072299, + "aggregate_load_tv": 0.06521739130434784 + }, + "period_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 12, + "mean_set_jaccard": 0.8633540372670808, + "mean_token_weighted_tv": 0.034306959168094654, + "aggregate_load_tv": 0.07971014492753624 + }, + "period_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8881987577639753, + "mean_token_weighted_tv": 0.032593290402513485, + "aggregate_load_tv": 0.06521739130434784 + } + } + }, + "layer_08": { + "layer": 8, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "59d6760f6631ce37c82b730bc8958b3a8e78bc421024defb3d58377d7c576087", + "route_weight_sha256": "f9bd7a862712253cd30459c53d060e07be6a1772a818ee9cd0860e7ed77bf3dd", + "loads": [ + 1, + 0, + 1, + 3, + 1, + 0, + 3, + 0, + 1, + 1, + 3, + 1, + 1, + 1, + 4, + 2, + 0, + 7, + 1, + 0, + 3, + 0, + 4, + 2, + 13, + 0, + 0, + 0, + 2, + 5, + 6, + 1, + 2, + 7, + 0, + 0, + 0, + 0, + 5, + 5, + 5, + 1, + 1, + 3, + 6, + 3, + 1, + 4, + 0, + 0, + 1, + 6, + 1, + 2, + 5, + 0, + 0, + 4, + 2, + 1, + 3, + 0, + 0, + 3 + ], + "weighted_loads": [ + 0.0518861748278141, + 0.0, + 0.039632752537727356, + 0.2891170233488083, + 0.09464923292398453, + 0.0, + 0.1996542252600193, + 0.0, + 0.0545252226293087, + 0.06290454417467117, + 0.2428799569606781, + 0.03794267028570175, + 0.0680435374379158, + 0.0550752729177475, + 0.18816673755645752, + 0.11475429311394691, + 0.0, + 0.71832724660635, + 0.03355490043759346, + 0.0, + 0.20776959136128426, + 0.0, + 0.30211341381073, + 0.08023195713758469, + 1.2237202413380146, + 0.0, + 0.0, + 0.0, + 0.0997675359249115, + 0.3958772346377373, + 0.5446714274585247, + 0.04271119460463524, + 0.14839737117290497, + 0.3841164670884609, + 0.0, + 0.0, + 0.0, + 0.0, + 0.5211213231086731, + 0.37205637246370316, + 0.387874074280262, + 0.030245451256632805, + 0.08751837909221649, + 0.11946265771985054, + 0.4107442535459995, + 0.2510324642062187, + 0.04928255453705788, + 0.36929257586598396, + 0.0, + 0.0, + 0.052957840263843536, + 0.42712533846497536, + 0.06303532421588898, + 0.10063642635941505, + 0.3905734121799469, + 0.0, + 0.0, + 0.1913345716893673, + 0.0960761047899723, + 0.04019495099782944, + 0.16556265577673912, + 0.0, + 0.0, + 0.15869880840182304 + ], + "unique_experts": 45, + "load_cv": 1.1277373986933654, + "normalized_load_entropy": 0.8538056309037126, + "max_load_share": 0.09420289855072464 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "f27c43f5d16e51f1615d2ddc4ca4f7ce3ee134302218f9b207d2dbf3eb767195", + "route_weight_sha256": "efa7328c5ed55a6540c26dc442b0152fd22e9adf2e43fd188a0d36e5e5dcb10d", + "loads": [ + 1, + 6, + 2, + 5, + 4, + 0, + 8, + 1, + 10, + 1, + 3, + 4, + 7, + 8, + 4, + 2, + 0, + 10, + 1, + 0, + 3, + 0, + 6, + 2, + 13, + 11, + 0, + 0, + 2, + 5, + 9, + 1, + 6, + 20, + 0, + 0, + 0, + 0, + 5, + 12, + 13, + 1, + 1, + 3, + 6, + 10, + 9, + 8, + 1, + 2, + 4, + 6, + 12, + 2, + 9, + 7, + 0, + 4, + 7, + 1, + 3, + 0, + 1, + 6 + ], + "weighted_loads": [ + 0.0518861748278141, + 0.3688052464276552, + 0.05182809196412563, + 0.39158793166279793, + 0.2593375709839165, + 0.0, + 0.6325048990547657, + 0.045780301094055176, + 0.6605421453714371, + 0.06290454417467117, + 0.2428799569606781, + 0.12964154966175556, + 0.40748417004942894, + 0.5846880972385406, + 0.18816673755645752, + 0.11475429311394691, + 0.0, + 0.8840212188661098, + 0.03355490043759346, + 0.0, + 0.20776959136128426, + 0.0, + 0.37516189739108086, + 0.08023195713758469, + 1.2237202413380146, + 0.7666409462690353, + 0.0, + 0.0, + 0.0997675359249115, + 0.3958772346377373, + 0.6283765290863812, + 0.04271119460463524, + 0.3200092986226082, + 1.579623568803072, + 0.0, + 0.0, + 0.0, + 0.0, + 0.5211213231086731, + 0.6018371637910604, + 0.836476594209671, + 0.030245451256632805, + 0.08751837909221649, + 0.11946265771985054, + 0.4107442535459995, + 0.9133057445287704, + 0.9318092353641987, + 0.49200422316789627, + 0.038599833846092224, + 0.09011975675821304, + 0.22238866612315178, + 0.42712533846497536, + 0.72461680136621, + 0.10063642635941505, + 1.9703076612204313, + 0.3629655931144953, + 0.0, + 0.1913345716893673, + 0.25437434390187263, + 0.04019495099782944, + 0.16556265577673912, + 0.0, + 0.046803586184978485, + 0.364407978951931 + ], + "unique_experts": 52, + "load_cv": 0.9517689832784342, + "normalized_load_entropy": 0.8860463919658296, + "max_load_share": 0.06944444444444445 + } + }, + "s1_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "0c82de464642fab4b008285a1906acef03fa2822085a4e78f10d8a61c7300b27", + "route_weight_sha256": "3d53ba82718cc14ffad1c014b91dd32cbb1cc374b17b91754df8e1c89eb7b32f", + "loads": [ + 1, + 0, + 1, + 3, + 1, + 0, + 3, + 0, + 1, + 1, + 3, + 1, + 1, + 1, + 4, + 2, + 0, + 7, + 1, + 0, + 3, + 0, + 4, + 2, + 13, + 0, + 0, + 0, + 2, + 5, + 6, + 1, + 2, + 7, + 0, + 0, + 0, + 0, + 5, + 5, + 5, + 1, + 1, + 3, + 6, + 3, + 1, + 4, + 0, + 0, + 1, + 6, + 1, + 2, + 5, + 0, + 0, + 4, + 2, + 1, + 3, + 0, + 0, + 3 + ], + "weighted_loads": [ + 0.04944627359509468, + 0.0, + 0.037891630083322525, + 0.2851029187440872, + 0.09096752107143402, + 0.0, + 0.19672533124685287, + 0.0, + 0.05175730213522911, + 0.0646793469786644, + 0.24208231270313263, + 0.03534868732094765, + 0.07097533345222473, + 0.05379408597946167, + 0.18162261694669724, + 0.11208180710673332, + 0.0, + 0.700824286788702, + 0.03298924118280411, + 0.0, + 0.21031669527292252, + 0.0, + 0.3015870489180088, + 0.0784432403743267, + 1.2380909733474255, + 0.0, + 0.0, + 0.0, + 0.10196711868047714, + 0.38724809885025024, + 0.5519619360566139, + 0.048108335584402084, + 0.14448555558919907, + 0.38646233081817627, + 0.0, + 0.0, + 0.0, + 0.0, + 0.5216900855302811, + 0.3720169849693775, + 0.3704841770231724, + 0.03083815984427929, + 0.08792674541473389, + 0.11967289447784424, + 0.4252581484615803, + 0.24684056639671326, + 0.04851547256112099, + 0.36995403841137886, + 0.0, + 0.0, + 0.046341851353645325, + 0.42465461045503616, + 0.06450675427913666, + 0.09729599207639694, + 0.3912152238190174, + 0.0, + 0.0, + 0.1878308802843094, + 0.09799673408269882, + 0.040448788553476334, + 0.16792802512645721, + 0.0, + 0.0, + 0.15926045924425125 + ], + "unique_experts": 45, + "load_cv": 1.1277373986933654, + "normalized_load_entropy": 0.8538056309037126, + "max_load_share": 0.09420289855072464 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "9908d6512558b5fa780ed98e32b84cf4310c76a4a237de86303b1b412fd7a475", + "route_weight_sha256": "58cca400d50b492e76acaeec80360f12a39a241d1bc531185fa45e6ef689f128", + "loads": [ + 2, + 5, + 11, + 5, + 3, + 1, + 14, + 0, + 15, + 1, + 5, + 5, + 10, + 8, + 4, + 2, + 0, + 21, + 2, + 0, + 3, + 0, + 5, + 6, + 13, + 11, + 0, + 2, + 3, + 5, + 9, + 1, + 6, + 26, + 0, + 0, + 0, + 0, + 11, + 10, + 19, + 1, + 3, + 3, + 6, + 16, + 17, + 8, + 4, + 4, + 5, + 6, + 10, + 8, + 9, + 10, + 0, + 4, + 6, + 3, + 3, + 4, + 2, + 8 + ], + "weighted_loads": [ + 0.08833999559283257, + 0.2825122084468603, + 0.6579294819384813, + 0.39748283103108406, + 0.2394983060657978, + 0.04455362260341644, + 1.1394184902310371, + 0.0, + 0.9619992524385452, + 0.0646793469786644, + 0.32998667657375336, + 0.1544023840688169, + 0.6059225611388683, + 0.5477727465331554, + 0.18162261694669724, + 0.11208180710673332, + 0.0, + 1.699960045516491, + 0.07967931777238846, + 0.0, + 0.21031669527292252, + 0.0, + 0.34154175221920013, + 0.26857112161815166, + 1.2380909733474255, + 1.1065079048275948, + 0.0, + 0.12170308083295822, + 0.14314082637429237, + 0.38724809885025024, + 0.6360171022824943, + 0.048108335584402084, + 0.2891053706407547, + 1.9092750176787376, + 0.0, + 0.0, + 0.0, + 0.0, + 0.9176943674683571, + 0.5178616400808096, + 1.03530665487051, + 0.03083815984427929, + 0.25609372183680534, + 0.11967289447784424, + 0.4252581484615803, + 1.4777115434408188, + 1.2988365553319454, + 0.48462401144206524, + 0.35092422366142273, + 0.2603931725025177, + 0.2641076259315014, + 0.42465461045503616, + 0.5868102815002203, + 0.7736235111951828, + 1.975391685962677, + 0.6018112506717443, + 0.0, + 0.1878308802843094, + 0.24550470639951527, + 0.1120174340903759, + 0.16792802512645721, + 0.18952183797955513, + 0.09865516796708107, + 0.4468616843223572 + ], + "unique_experts": 54, + "load_cv": 0.9344858955002419, + "normalized_load_entropy": 0.896600858679308, + "max_load_share": 0.06770833333333333 + } + }, + "s0_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "1d2ccbe767fe1fe68f60450424cebf4708ca9fd86a1d51752f3bbacffea5c535", + "route_weight_sha256": "24a9fca18da9fa209c32584755f96dcda6059474381f30e6df49f9fefc568ba9", + "loads": [ + 1, + 1, + 0, + 3, + 1, + 0, + 3, + 0, + 1, + 1, + 3, + 2, + 1, + 1, + 4, + 3, + 0, + 7, + 1, + 0, + 2, + 0, + 3, + 1, + 13, + 0, + 0, + 0, + 1, + 5, + 6, + 1, + 2, + 9, + 0, + 0, + 0, + 0, + 5, + 5, + 4, + 2, + 1, + 3, + 6, + 3, + 1, + 3, + 0, + 0, + 1, + 6, + 1, + 2, + 5, + 0, + 0, + 4, + 3, + 1, + 3, + 0, + 0, + 3 + ], + "weighted_loads": [ + 0.050374362617731094, + 0.0364212729036808, + 0.0, + 0.28098100423812866, + 0.10026323795318604, + 0.0, + 0.20199354737997055, + 0.0, + 0.05788545310497284, + 0.06009960547089577, + 0.23889512568712234, + 0.07551931962370872, + 0.06597133725881577, + 0.050602879375219345, + 0.18915990367531776, + 0.15119919553399086, + 0.0, + 0.7286926321685314, + 0.0340285561978817, + 0.0, + 0.15266576409339905, + 0.0, + 0.26660411059856415, + 0.04991330951452255, + 1.269943729043007, + 0.0, + 0.0, + 0.0, + 0.06271898001432419, + 0.3787078484892845, + 0.5512460246682167, + 0.04647386446595192, + 0.13877440243959427, + 0.49517086520791054, + 0.0, + 0.0, + 0.0, + 0.0, + 0.4914037585258484, + 0.365308053791523, + 0.39044180884957314, + 0.06625154428184032, + 0.08898354321718216, + 0.11855069920420647, + 0.42565325647592545, + 0.26366985589265823, + 0.05223207175731659, + 0.3124549947679043, + 0.0, + 0.0, + 0.05737289413809776, + 0.4157351925969124, + 0.05338684841990471, + 0.11117535084486008, + 0.4171680733561516, + 0.0, + 0.0, + 0.18896885216236115, + 0.12931860610842705, + 0.0382075272500515, + 0.16688231378793716, + 0.0, + 0.0, + 0.1670488864183426 + ], + "unique_experts": 45, + "load_cv": 1.1484078455453641, + "normalized_load_entropy": 0.8519543475816944, + "max_load_share": 0.09420289855072464 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "9572d2f2b3b384b419f6118f3f7a02465ec4c2d96c179d569120cc63fd589d6a", + "route_weight_sha256": "48da1a774a35c67123261a12721ef54a76904a5538157c7d924a914b4b787cff", + "loads": [ + 1, + 7, + 1, + 5, + 3, + 0, + 8, + 1, + 10, + 1, + 3, + 5, + 7, + 8, + 4, + 4, + 0, + 10, + 1, + 0, + 2, + 0, + 5, + 1, + 14, + 12, + 0, + 0, + 1, + 5, + 9, + 1, + 7, + 23, + 0, + 0, + 0, + 0, + 5, + 11, + 11, + 2, + 1, + 3, + 6, + 10, + 9, + 6, + 1, + 2, + 4, + 6, + 12, + 2, + 10, + 7, + 0, + 4, + 6, + 1, + 3, + 0, + 1, + 6 + ], + "weighted_loads": [ + 0.050374362617731094, + 0.405226519331336, + 0.012195339426398277, + 0.38397085666656494, + 0.25590067729353905, + 0.0, + 0.6398649364709854, + 0.045780301094055176, + 0.6807864531874657, + 0.06009960547089577, + 0.23889512568712234, + 0.16721819899976254, + 0.4054119698703289, + 0.5751363225281239, + 0.18915990367531776, + 0.19782885164022446, + 0.0, + 0.8796098455786705, + 0.0340285561978817, + 0.0, + 0.15266576409339905, + 0.0, + 0.339652594178915, + 0.04991330951452255, + 1.316568087786436, + 0.8243723176419735, + 0.0, + 0.0, + 0.06271898001432419, + 0.3787078484892845, + 0.6791721824556589, + 0.04647386446595192, + 0.36827170103788376, + 1.745741117745638, + 0.0, + 0.0, + 0.0, + 0.0, + 0.4914037585258484, + 0.6079473700374365, + 0.814133532345295, + 0.06625154428184032, + 0.08898354321718216, + 0.11855069920420647, + 0.42565325647592545, + 0.9033468589186668, + 0.8545019254088402, + 0.4257623516023159, + 0.038599833846092224, + 0.09011975675821304, + 0.226803719997406, + 0.4157351925969124, + 0.7149683255702257, + 0.11117535084486008, + 1.1711281146854162, + 0.3820824045687914, + 0.0, + 0.18896885216236115, + 0.24315976351499557, + 0.0382075272500515, + 0.16688231378793716, + 0.0, + 0.046803586184978485, + 0.37275805696845055 + ], + "unique_experts": 52, + "load_cv": 0.9930312739844154, + "normalized_load_entropy": 0.8809540346344898, + "max_load_share": 0.0798611111111111 + } + }, + "s1_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "1a33834fdabf3f62a9b280f547c9c6f887e634b2386b0e96424caa05af2c3a1f", + "route_weight_sha256": "d1946ae6a0aa0e4aa865424e272c5dfe713849b4739f955996f593efe2d3885c", + "loads": [ + 1, + 0, + 1, + 3, + 2, + 0, + 3, + 0, + 1, + 1, + 3, + 1, + 1, + 1, + 4, + 3, + 0, + 7, + 1, + 0, + 3, + 0, + 3, + 1, + 13, + 0, + 0, + 0, + 1, + 5, + 6, + 1, + 2, + 8, + 0, + 0, + 0, + 0, + 5, + 5, + 4, + 2, + 1, + 3, + 6, + 3, + 1, + 3, + 0, + 0, + 1, + 6, + 1, + 2, + 5, + 0, + 0, + 4, + 3, + 1, + 3, + 0, + 0, + 3 + ], + "weighted_loads": [ + 0.04826585203409195, + 0.0, + 0.03446078673005104, + 0.28184330463409424, + 0.1353083737194538, + 0.0, + 0.19895454868674278, + 0.0, + 0.053096991032361984, + 0.061969093978405, + 0.2441626414656639, + 0.03621416166424751, + 0.06884435564279556, + 0.05113041773438454, + 0.17707736045122147, + 0.15103595703840256, + 0.0, + 0.7219896502792835, + 0.03556056320667267, + 0.0, + 0.20602447167038918, + 0.0, + 0.26629748940467834, + 0.05251314491033554, + 1.2651598155498505, + 0.0, + 0.0, + 0.0, + 0.06532730907201767, + 0.37919890880584717, + 0.5598526261746883, + 0.047569792717695236, + 0.12854526937007904, + 0.4548353813588619, + 0.0, + 0.0, + 0.0, + 0.0, + 0.489037349820137, + 0.3794986642897129, + 0.37387219071388245, + 0.0673196092247963, + 0.09183578938245773, + 0.12229839712381363, + 0.43560420721769333, + 0.25879017263650894, + 0.0517580471932888, + 0.3287217952311039, + 0.0, + 0.0, + 0.055630531162023544, + 0.4306756965816021, + 0.059259407222270966, + 0.10849537327885628, + 0.4120865724980831, + 0.0, + 0.0, + 0.18876631930470467, + 0.13449495285749435, + 0.04059875011444092, + 0.17428544536232948, + 0.0, + 0.0, + 0.16555801033973694 + ], + "unique_experts": 45, + "load_cv": 1.1307134550602624, + "normalized_load_entropy": 0.8540973880536961, + "max_load_share": 0.09420289855072464 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "efb3d08c7431d0849b084230ed16f1f2b2c209f5545c7d43bf6ae2dd86b39f68", + "route_weight_sha256": "acbeaa20beb61136f42042a3d745e0e3dece57980ca35262d7f6efd08d729907", + "loads": [ + 2, + 5, + 11, + 5, + 5, + 1, + 14, + 0, + 14, + 1, + 5, + 4, + 10, + 8, + 4, + 3, + 0, + 22, + 2, + 0, + 3, + 0, + 4, + 5, + 13, + 11, + 0, + 2, + 2, + 5, + 9, + 1, + 6, + 29, + 0, + 0, + 0, + 0, + 11, + 9, + 18, + 2, + 3, + 3, + 6, + 17, + 17, + 6, + 4, + 5, + 5, + 6, + 10, + 8, + 9, + 10, + 0, + 4, + 5, + 2, + 3, + 4, + 2, + 9 + ], + "weighted_loads": [ + 0.08715957403182983, + 0.2825122084468603, + 0.6544986385852098, + 0.39807991310954094, + 0.33195196837186813, + 0.04455362260341644, + 1.1402076743543148, + 0.0, + 0.9412411116063595, + 0.061969093978405, + 0.33206700533628464, + 0.15209303423762321, + 0.6037915833294392, + 0.535355381667614, + 0.17707736045122147, + 0.15103595703840256, + 0.0, + 1.7581577375531197, + 0.08225063979625702, + 0.0, + 0.20602447167038918, + 0.0, + 0.3062521927058697, + 0.2426410261541605, + 1.2651598155498505, + 1.1065079048275948, + 0.0, + 0.12170308083295822, + 0.1065010167658329, + 0.37919890880584717, + 0.6810964439064264, + 0.047569792717695236, + 0.2731650844216347, + 2.122817639261484, + 0.0, + 0.0, + 0.0, + 0.0, + 0.885041631758213, + 0.5303531866520643, + 1.0732560940086842, + 0.0673196092247963, + 0.2600027658045292, + 0.12229839712381363, + 0.43560420721769333, + 1.5423704646527767, + 1.241002969443798, + 0.4343729093670845, + 0.35092422366142273, + 0.30220675095915794, + 0.2733963057398796, + 0.4306756965816021, + 0.5815629344433546, + 0.7848228923976421, + 1.1323012635111809, + 0.6170000582933426, + 0.0, + 0.18876631930470467, + 0.2336006909608841, + 0.07363586872816086, + 0.17428544536232948, + 0.18952183797955513, + 0.09865516796708107, + 0.5054061226546764 + ], + "unique_experts": 54, + "load_cv": 0.9637527921850314, + "normalized_load_entropy": 0.8943819127233734, + "max_load_share": 0.07552083333333333 + } + }, + "s0_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "590030722b6822821b684f7f451bf0d55dd9540677a36f6bb11ccd369706b6d1", + "route_weight_sha256": "5fe6081178d72ec9bc24eeda47c39b183c097becbba4d2377be0aa519d97fe4a", + "loads": [ + 1, + 1, + 0, + 3, + 1, + 0, + 3, + 0, + 1, + 1, + 3, + 2, + 1, + 1, + 5, + 3, + 0, + 7, + 1, + 0, + 2, + 0, + 3, + 1, + 13, + 0, + 0, + 0, + 1, + 5, + 6, + 0, + 2, + 10, + 0, + 0, + 1, + 0, + 5, + 5, + 4, + 2, + 1, + 3, + 5, + 3, + 1, + 3, + 0, + 0, + 1, + 6, + 1, + 2, + 4, + 0, + 0, + 4, + 3, + 1, + 3, + 0, + 0, + 3 + ], + "weighted_loads": [ + 0.0579766109585762, + 0.04070095717906952, + 0.0, + 0.30001839995384216, + 0.10201187431812286, + 0.0, + 0.20095768570899963, + 0.0, + 0.057897455990314484, + 0.053741537034511566, + 0.24359197542071342, + 0.07594609633088112, + 0.06197041645646095, + 0.05089111253619194, + 0.23420098796486855, + 0.157540924847126, + 0.0, + 0.6827395297586918, + 0.03647138923406601, + 0.0, + 0.1545560583472252, + 0.0, + 0.26540639996528625, + 0.04795434698462486, + 1.2711779028177261, + 0.0, + 0.0, + 0.0, + 0.061149828135967255, + 0.3561086244881153, + 0.5552875883877277, + 0.0, + 0.1462557688355446, + 0.534392986446619, + 0.0, + 0.0, + 0.036835893988609314, + 0.0, + 0.5113278105854988, + 0.3541453592479229, + 0.38743241131305695, + 0.06852674670517445, + 0.08754602819681168, + 0.12159135937690735, + 0.36859555169939995, + 0.26359714567661285, + 0.0499248243868351, + 0.3304514102637768, + 0.0, + 0.0, + 0.05921802297234535, + 0.42117488384246826, + 0.051944248378276825, + 0.1152295246720314, + 0.3702292926609516, + 0.0, + 0.0, + 0.17332031205296516, + 0.13264362886548042, + 0.038938216865062714, + 0.16334383562207222, + 0.0, + 0.0, + 0.15722743421792984 + ], + "unique_experts": 45, + "load_cv": 1.1600541745456103, + "normalized_load_entropy": 0.8510004569947345, + "max_load_share": 0.09420289855072464 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "192915d60dc5541c20ceb1f2d48816b3ea517ac76d3db0caee0615b4671190d8", + "route_weight_sha256": "3df2c05a0df2b9afb9d2ad272159eb291e92ef4c16f9cc70c841c1e82b9b42fe", + "loads": [ + 1, + 8, + 2, + 5, + 3, + 0, + 9, + 1, + 11, + 1, + 3, + 5, + 7, + 9, + 5, + 3, + 0, + 10, + 1, + 0, + 2, + 0, + 5, + 1, + 13, + 13, + 0, + 0, + 1, + 5, + 8, + 0, + 8, + 23, + 0, + 0, + 1, + 0, + 5, + 10, + 9, + 2, + 1, + 3, + 5, + 9, + 9, + 6, + 1, + 3, + 5, + 6, + 12, + 2, + 7, + 8, + 0, + 4, + 6, + 1, + 3, + 0, + 1, + 6 + ], + "weighted_loads": [ + 0.0579766109585762, + 0.4621721673756838, + 0.05347456969320774, + 0.4014231376349926, + 0.246340099722147, + 0.0, + 0.6962547339498997, + 0.045780301094055176, + 0.7699525393545628, + 0.053741537034511566, + 0.24359197542071342, + 0.16764497570693493, + 0.4014110490679741, + 0.6652918942272663, + 0.23420098796486855, + 0.157540924847126, + 0.0, + 0.8239355683326721, + 0.03647138923406601, + 0.0, + 0.1545560583472252, + 0.0, + 0.33845488354563713, + 0.04795434698462486, + 1.2711779028177261, + 0.9168521091341972, + 0.0, + 0.0, + 0.061149828135967255, + 0.3561086244881153, + 0.6259207334369421, + 0.0, + 0.42444124445319176, + 1.5402631647884846, + 0.0, + 0.0, + 0.036835893988609314, + 0.0, + 0.5113278105854988, + 0.5422727148979902, + 0.6874519772827625, + 0.06852674670517445, + 0.08754602819681168, + 0.12159135937690735, + 0.36859555169939995, + 0.8491754978895187, + 0.8236472494900227, + 0.4437587670981884, + 0.038599833846092224, + 0.1407836154103279, + 0.281829159706831, + 0.42117488384246826, + 0.7135257255285978, + 0.1152295246720314, + 1.0403454210609198, + 0.4382516276091337, + 0.0, + 0.17332031205296516, + 0.24648478627204895, + 0.038938216865062714, + 0.16334383562207222, + 0.0, + 0.046803586184978485, + 0.3629366047680378 + ], + "unique_experts": 52, + "load_cv": 0.976577546180386, + "normalized_load_entropy": 0.8841308103261004, + "max_load_share": 0.0798611111111111 + } + }, + "s1_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "ddcd7ced8be44d7d8fa812c76773553a57cc0b0c9796c5affa8ea2eb7d76be95", + "route_weight_sha256": "752edde246bcbd96c2cbd2b969d50800b984038e0d4daeb7cf7eebd5d214388c", + "loads": [ + 1, + 1, + 0, + 3, + 1, + 0, + 3, + 0, + 1, + 1, + 3, + 3, + 1, + 1, + 5, + 2, + 0, + 7, + 1, + 0, + 3, + 0, + 3, + 1, + 13, + 0, + 0, + 0, + 1, + 5, + 6, + 0, + 2, + 8, + 0, + 0, + 1, + 0, + 5, + 5, + 4, + 2, + 1, + 3, + 6, + 3, + 1, + 3, + 0, + 0, + 1, + 6, + 1, + 2, + 4, + 0, + 0, + 4, + 3, + 1, + 3, + 0, + 0, + 3 + ], + "weighted_loads": [ + 0.04804347828030586, + 0.03456293046474457, + 0.0, + 0.29987821727991104, + 0.09797413647174835, + 0.0, + 0.2019381746649742, + 0.0, + 0.05196792632341385, + 0.05571897700428963, + 0.2526758015155792, + 0.10468989610671997, + 0.06459727138280869, + 0.05168738588690758, + 0.22423383966088295, + 0.11322946473956108, + 0.0, + 0.69699577242136, + 0.03983365744352341, + 0.0, + 0.20949025079607964, + 0.0, + 0.266400545835495, + 0.0453299805521965, + 1.2376255840063095, + 0.0, + 0.0, + 0.0, + 0.06363708525896072, + 0.3651170879602432, + 0.5521652512252331, + 0.0, + 0.1374604031443596, + 0.43806205689907074, + 0.0, + 0.0, + 0.03448987752199173, + 0.0, + 0.5194386765360832, + 0.36598703637719154, + 0.3739628717303276, + 0.07167539745569229, + 0.08854812383651733, + 0.13009824976325035, + 0.41183723509311676, + 0.2515581250190735, + 0.05440567061305046, + 0.3475860208272934, + 0.0, + 0.0, + 0.057232603430747986, + 0.4245828427374363, + 0.05680494382977486, + 0.12178028747439384, + 0.3538072481751442, + 0.0, + 0.0, + 0.18366235494613647, + 0.14010194689035416, + 0.04077450931072235, + 0.1734449453651905, + 0.0, + 0.0, + 0.15898767486214638 + ], + "unique_experts": 45, + "load_cv": 1.1307134550602624, + "normalized_load_entropy": 0.8540973880536958, + "max_load_share": 0.09420289855072464 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "c6a028c05708257de7911b8b5d223b27c0b61e60bd75a7e07f23061015e7cbfb", + "route_weight_sha256": "4eb110282730b379695b304968f36d53191a17f6fc51f5efedd942b076b6ac40", + "loads": [ + 2, + 7, + 11, + 6, + 3, + 1, + 16, + 0, + 15, + 1, + 5, + 7, + 10, + 10, + 5, + 2, + 0, + 21, + 2, + 0, + 3, + 0, + 4, + 5, + 13, + 14, + 0, + 2, + 2, + 5, + 8, + 0, + 7, + 26, + 0, + 0, + 1, + 0, + 11, + 8, + 15, + 2, + 3, + 3, + 6, + 16, + 16, + 6, + 4, + 5, + 6, + 6, + 10, + 8, + 7, + 10, + 0, + 4, + 5, + 2, + 3, + 4, + 2, + 8 + ], + "weighted_loads": [ + 0.08693720027804375, + 0.3614006992429495, + 0.656417852267623, + 0.4669078700244427, + 0.243507232517004, + 0.04455362260341644, + 1.2358577996492386, + 0.0, + 1.0039648190140724, + 0.05571897700428963, + 0.34058016538619995, + 0.2591518647968769, + 0.5995444990694523, + 0.6730222478508949, + 0.22423383966088295, + 0.11322946473956108, + 0.0, + 1.6906651072204113, + 0.08652373403310776, + 0.0, + 0.20949025079607964, + 0.0, + 0.3063552491366863, + 0.23545786179602146, + 1.2376255840063095, + 1.3121744878590107, + 0.0, + 0.12170308083295822, + 0.10481079295277596, + 0.3651170879602432, + 0.6228817943483591, + 0.0, + 0.3240041583776474, + 1.6694304645061493, + 0.0, + 0.0, + 0.03448987752199173, + 0.0, + 0.9154429584741592, + 0.47306800074875355, + 0.8805300816893578, + 0.07167539745569229, + 0.2567151002585888, + 0.13009824976325035, + 0.41183723509311676, + 1.366042584180832, + 1.124701626598835, + 0.453237134963274, + 0.35092422366142273, + 0.3119250200688839, + 0.3471840061247349, + 0.4245828427374363, + 0.5791084710508585, + 0.7981078065931797, + 1.0279290042817593, + 0.5905410125851631, + 0.0, + 0.18366235494613647, + 0.2392076849937439, + 0.07381162792444229, + 0.1734449453651905, + 0.18952183797955513, + 0.09865516796708107, + 0.4465888999402523 + ], + "unique_experts": 54, + "load_cv": 0.9232716585900141, + "normalized_load_entropy": 0.8979984314287346, + "max_load_share": 0.06770833333333333 + } + }, + "s0_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "feb096d1c5b55ce096bf50ae1d952b331342279b8e61502b5ad436688b0512f1", + "route_weight_sha256": "d7eeec4d8b82e12d813b721d10a921069113c2e067781edd86c193c4c4e04b53", + "loads": [ + 1, + 1, + 0, + 3, + 1, + 0, + 3, + 0, + 1, + 1, + 3, + 2, + 1, + 1, + 5, + 2, + 0, + 7, + 1, + 0, + 2, + 0, + 4, + 1, + 13, + 0, + 0, + 0, + 1, + 5, + 6, + 0, + 2, + 9, + 0, + 0, + 1, + 0, + 5, + 5, + 4, + 2, + 1, + 3, + 6, + 3, + 0, + 3, + 0, + 0, + 1, + 7, + 1, + 2, + 4, + 0, + 0, + 4, + 4, + 1, + 3, + 0, + 0, + 2 + ], + "weighted_loads": [ + 0.061393409967422485, + 0.04070766642689705, + 0.0, + 0.3005855306982994, + 0.09884753078222275, + 0.0, + 0.2044849544763565, + 0.0, + 0.05768027529120445, + 0.05228177458047867, + 0.2439464032649994, + 0.07599589973688126, + 0.06461311876773834, + 0.05267707258462906, + 0.23482047021389008, + 0.11904691159725189, + 0.0, + 0.6708995029330254, + 0.03415989503264427, + 0.0, + 0.15674515068531036, + 0.0, + 0.30494221672415733, + 0.04490262642502785, + 1.261382583528757, + 0.0, + 0.0, + 0.0, + 0.05988220497965813, + 0.3515985757112503, + 0.5513467080891132, + 0.0, + 0.14571809768676758, + 0.5233568549156189, + 0.0, + 0.0, + 0.03489344194531441, + 0.0, + 0.5070023089647293, + 0.35998133197426796, + 0.38438113033771515, + 0.06668663769960403, + 0.08599748462438583, + 0.12492816895246506, + 0.4141564145684242, + 0.26425234973430634, + 0.0, + 0.33173181489109993, + 0.0, + 0.0, + 0.05990935117006302, + 0.47263945639133453, + 0.05151454731822014, + 0.10981763526797295, + 0.36300941556692123, + 0.0, + 0.0, + 0.17349446937441826, + 0.1593445986509323, + 0.03969038650393486, + 0.17204414680600166, + 0.0, + 0.0, + 0.10874713212251663 + ], + "unique_experts": 44, + "load_cv": 1.171584737034095, + "normalized_load_entropy": 0.8457681646814259, + "max_load_share": 0.09420289855072464 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "e2b26ef73388d1e94470666a401623e8a9a9ae835deaab402989d3fff9df14ab", + "route_weight_sha256": "ac8e2cd2b041e608fbfac86af3434d5da78bb03a00842b41ef49c71cbaebfcb6", + "loads": [ + 1, + 7, + 1, + 5, + 3, + 0, + 11, + 1, + 11, + 1, + 3, + 5, + 7, + 9, + 5, + 2, + 0, + 10, + 1, + 0, + 2, + 0, + 6, + 1, + 13, + 13, + 0, + 0, + 1, + 5, + 8, + 0, + 7, + 22, + 0, + 0, + 1, + 0, + 5, + 10, + 8, + 2, + 1, + 3, + 6, + 9, + 9, + 6, + 1, + 4, + 4, + 7, + 12, + 2, + 7, + 8, + 0, + 4, + 7, + 1, + 3, + 0, + 1, + 6 + ], + "weighted_loads": [ + 0.061393409967422485, + 0.40951291285455227, + 0.012195339426398277, + 0.3993605822324753, + 0.24487623944878578, + 0.0, + 0.8540060631930828, + 0.045780301094055176, + 0.8259281106293201, + 0.05228177458047867, + 0.2439464032649994, + 0.16769477911293507, + 0.4040537513792515, + 0.6273329965770245, + 0.23482047021389008, + 0.11904691159725189, + 0.0, + 0.8015641942620277, + 0.03415989503264427, + 0.0, + 0.15674515068531036, + 0.0, + 0.3779907003045082, + 0.04490262642502785, + 1.261382583528757, + 0.9161869511008263, + 0.0, + 0.0, + 0.05988220497965813, + 0.3515985757112503, + 0.6245869044214487, + 0.0, + 0.3922465667128563, + 1.5473687462508678, + 0.0, + 0.0, + 0.03489344194531441, + 0.0, + 0.5070023089647293, + 0.5524314027279615, + 0.6356757320463657, + 0.06668663769960403, + 0.08599748462438583, + 0.12492816895246506, + 0.4141564145684242, + 0.8390368148684502, + 0.8441619537770748, + 0.44503917172551155, + 0.038599833846092224, + 0.1722102276980877, + 0.22934017702937126, + 0.47263945639133453, + 0.7130960244685411, + 0.10981763526797295, + 1.034704128280282, + 0.4326539374887943, + 0.0, + 0.17349446937441826, + 0.27318575605750084, + 0.03969038650393486, + 0.17204414680600166, + 0.0, + 0.046803586184978485, + 0.43844036385416985 + ], + "unique_experts": 52, + "load_cv": 0.9710310162749186, + "normalized_load_entropy": 0.8833623440125973, + "max_load_share": 0.0763888888888889 + } + }, + "s1_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "4c09c29519529a8e6fd6b97c0c153fe602e3795709c7d30746356d8a86200c63", + "route_weight_sha256": "8eb39fd8920b38f65e65636370af5e1bbb157b7e7e15ed7578a92f2fb218240e", + "loads": [ + 1, + 1, + 0, + 3, + 1, + 0, + 3, + 0, + 1, + 1, + 3, + 3, + 1, + 1, + 4, + 2, + 0, + 8, + 1, + 0, + 3, + 0, + 4, + 1, + 13, + 0, + 0, + 0, + 1, + 5, + 6, + 1, + 2, + 7, + 0, + 0, + 1, + 0, + 5, + 5, + 5, + 2, + 1, + 3, + 6, + 3, + 1, + 3, + 0, + 0, + 1, + 6, + 1, + 2, + 3, + 0, + 0, + 4, + 2, + 1, + 3, + 0, + 0, + 3 + ], + "weighted_loads": [ + 0.05172301083803177, + 0.03525795042514801, + 0.0, + 0.30154532939195633, + 0.09632184356451035, + 0.0, + 0.19737236201763153, + 0.0, + 0.052124250680208206, + 0.055935949087142944, + 0.25537846982479095, + 0.10442510433495045, + 0.06575936824083328, + 0.05261088162660599, + 0.17424601688981056, + 0.10535504296422005, + 0.0, + 0.7215910963714123, + 0.0368405282497406, + 0.0, + 0.21496804058551788, + 0.0, + 0.3073900640010834, + 0.04133382439613342, + 1.2197400741279125, + 0.0, + 0.0, + 0.0, + 0.06441660225391388, + 0.3647898957133293, + 0.5536521710455418, + 0.050774939358234406, + 0.13369344919919968, + 0.38644368201494217, + 0.0, + 0.0, + 0.032629285007715225, + 0.0, + 0.5311092883348465, + 0.3766593299806118, + 0.3942889980971813, + 0.06888335943222046, + 0.08710416406393051, + 0.1286483220756054, + 0.41327644884586334, + 0.25351155549287796, + 0.048063091933727264, + 0.34761617332696915, + 0.0, + 0.0, + 0.05664375051856041, + 0.42939841374754906, + 0.055303193628787994, + 0.12471634149551392, + 0.310725636780262, + 0.0, + 0.0, + 0.1841467171907425, + 0.10196046531200409, + 0.039902135729789734, + 0.17448854818940163, + 0.0, + 0.0, + 0.16067323833703995 + ], + "unique_experts": 46, + "load_cv": 1.124753467818188, + "normalized_load_entropy": 0.857424546872734, + "max_load_share": 0.09420289855072464 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "28955233413554770515ec74cc382f3ac08e28ae892e429d30f8cdf4783f8f30", + "route_weight_sha256": "30a37978d9efa10fe838c046a4b387c9fd45e194ba9e16b16f6791713d20bb34", + "loads": [ + 2, + 6, + 10, + 6, + 3, + 1, + 17, + 0, + 15, + 1, + 5, + 6, + 10, + 8, + 4, + 2, + 0, + 23, + 2, + 0, + 3, + 0, + 5, + 5, + 13, + 14, + 0, + 2, + 2, + 5, + 8, + 1, + 6, + 25, + 0, + 0, + 1, + 0, + 11, + 8, + 16, + 2, + 3, + 3, + 6, + 15, + 18, + 6, + 4, + 7, + 5, + 6, + 10, + 8, + 6, + 11, + 0, + 4, + 4, + 2, + 3, + 4, + 2, + 9 + ], + "weighted_loads": [ + 0.09061673283576965, + 0.3177701588720083, + 0.6200378518551588, + 0.4663437679409981, + 0.23984668031334877, + 0.04455362260341644, + 1.3525034710764885, + 0.0, + 1.0312829315662384, + 0.055935949087142944, + 0.3432828336954117, + 0.22030397690832615, + 0.6007065959274769, + 0.5404546223580837, + 0.17424601688981056, + 0.10535504296422005, + 0.0, + 1.7613736391067505, + 0.08353060483932495, + 0.0, + 0.21496804058551788, + 0.0, + 0.3473447673022747, + 0.23146170563995838, + 1.2197400741279125, + 1.283573042601347, + 0.0, + 0.12170308083295822, + 0.10559030994772911, + 0.3647898957133293, + 0.6197381746023893, + 0.050774939358234406, + 0.2783132642507553, + 1.6182392723858356, + 0.0, + 0.0, + 0.032629285007715225, + 0.0, + 0.9271135702729225, + 0.48117426969110966, + 0.9047169387340546, + 0.06888335943222046, + 0.25527114048600197, + 0.1286483220756054, + 0.41327644884586334, + 1.3260766342282295, + 1.2709414400160313, + 0.45326728746294975, + 0.35092422366142273, + 0.4124293699860573, + 0.2744095250964165, + 0.42939841374754906, + 0.5776067208498716, + 0.8010438606142998, + 0.9792663939297199, + 0.6322701945900917, + 0.0, + 0.1841467171907425, + 0.20106620341539383, + 0.07293925434350967, + 0.17448854818940163, + 0.18952183797955513, + 0.09865516796708107, + 0.524510033428669 + ], + "unique_experts": 55, + "load_cv": 0.9400428477232065, + "normalized_load_entropy": 0.8973434727697436, + "max_load_share": 0.06510416666666667 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "ordered_topk_exact_tokens": 18, + "set_exact_tokens": 23, + "mean_set_jaccard": 1.0, + "mean_token_weighted_tv": 0.006997563349811927, + "aggregate_load_tv": 0.0 + }, + "system_bos": { + "tokens": 23, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 20, + "mean_set_jaccard": 0.9627329192546585, + "mean_token_weighted_tv": 0.014537619872261648, + "aggregate_load_tv": 0.021739130434782605 + }, + "system_x": { + "tokens": 23, + "ordered_topk_exact_tokens": 16, + "set_exact_tokens": 20, + "mean_set_jaccard": 0.9627329192546585, + "mean_token_weighted_tv": 0.017473606109295204, + "aggregate_load_tv": 0.021739130434782608 + }, + "system_period": { + "tokens": 23, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.9130434782608695, + "mean_token_weighted_tv": 0.024964722237833168, + "aggregate_load_tv": 0.05072463768115942 + }, + "bos_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.9130434782608695, + "mean_token_weighted_tv": 0.02341229662947033, + "aggregate_load_tv": 0.05072463768115942 + }, + "bos_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 16, + "set_exact_tokens": 18, + "mean_set_jaccard": 0.9378881987577641, + "mean_token_weighted_tv": 0.019386045108346836, + "aggregate_load_tv": 0.036231884057971016 + }, + "x_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.8819875776397516, + "mean_token_weighted_tv": 0.031708181714234146, + "aggregate_load_tv": 0.07246376811594203 + }, + "x_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.9037267080745341, + "mean_token_weighted_tv": 0.02794892458326143, + "aggregate_load_tv": 0.05797101449275363 + }, + "period_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8788819875776398, + "mean_token_weighted_tv": 0.032050050349663135, + "aggregate_load_tv": 0.07246376811594203 + }, + "period_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.9161490683229815, + "mean_token_weighted_tv": 0.026485147440563076, + "aggregate_load_tv": 0.04347826086956522 + } + } + }, + "layer_09": { + "layer": 9, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "72bd7a68a65bd98269e10b2444b666adf2ba7d8c5a6b707b02d428e703654477", + "route_weight_sha256": "90dffc924cd876bce4237734e7c9918f089fd42a1a3ad04259797313a0889e82", + "loads": [ + 7, + 2, + 0, + 0, + 1, + 2, + 0, + 3, + 1, + 2, + 2, + 0, + 0, + 7, + 2, + 2, + 3, + 4, + 0, + 0, + 2, + 1, + 8, + 1, + 4, + 4, + 0, + 5, + 1, + 0, + 0, + 2, + 4, + 2, + 1, + 3, + 6, + 4, + 0, + 0, + 0, + 3, + 1, + 9, + 1, + 2, + 5, + 1, + 3, + 4, + 2, + 0, + 0, + 1, + 0, + 2, + 0, + 1, + 3, + 1, + 4, + 1, + 4, + 4 + ], + "weighted_loads": [ + 0.39373327419161797, + 0.09742392227053642, + 0.0, + 0.0, + 0.08307328820228577, + 0.07899301499128342, + 0.0, + 0.2347363941371441, + 0.10389664024114609, + 0.10646060481667519, + 0.1773630753159523, + 0.0, + 0.0, + 0.4790884479880333, + 0.14823003858327866, + 0.14371836185455322, + 0.19880983978509903, + 0.21364636346697807, + 0.0, + 0.0, + 0.09767444059252739, + 0.029366744682192802, + 0.5427750162780285, + 0.03817254677414894, + 0.21229782328009605, + 0.2101408690214157, + 0.0, + 0.38353871554136276, + 0.06400313228368759, + 0.0, + 0.0, + 0.09985669702291489, + 0.45433543622493744, + 0.23678766191005707, + 0.0698854997754097, + 0.22495625540614128, + 0.460092157125473, + 0.27435972169041634, + 0.0, + 0.0, + 0.0, + 0.19281385838985443, + 0.04867986589670181, + 0.7359848842024803, + 0.04527246206998825, + 0.10940328612923622, + 0.25536223500967026, + 0.04729057848453522, + 0.22553206235170364, + 0.40754250809550285, + 0.10855981148779392, + 0.0, + 0.0, + 0.09574846178293228, + 0.0, + 0.1055360697209835, + 0.0, + 0.036988016217947006, + 0.25411685556173325, + 0.052455835044384, + 0.2458295002579689, + 0.05011427029967308, + 0.39545898139476776, + 0.19766290672123432 + ], + "unique_experts": 47, + "load_cv": 0.9879551865016964, + "normalized_load_entropy": 0.8766735509026797, + "max_load_share": 0.06521739130434782 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "1b57b555bbd91af505e50b1375aadbccdd08d6c14968690b08186090f07eb1dc", + "route_weight_sha256": "0d1b8162d1555ce73856b6f76c80993cfe37d213f82c8928fdb1563e9ac82f27", + "loads": [ + 13, + 2, + 0, + 0, + 3, + 2, + 0, + 3, + 3, + 2, + 13, + 0, + 3, + 12, + 2, + 2, + 4, + 7, + 0, + 12, + 2, + 1, + 13, + 3, + 7, + 5, + 0, + 6, + 1, + 0, + 1, + 8, + 6, + 2, + 10, + 10, + 6, + 4, + 2, + 0, + 0, + 13, + 1, + 9, + 6, + 11, + 17, + 1, + 5, + 4, + 7, + 1, + 0, + 4, + 0, + 7, + 5, + 1, + 5, + 5, + 4, + 1, + 6, + 5 + ], + "weighted_loads": [ + 0.8326996341347694, + 0.09742392227053642, + 0.0, + 0.0, + 0.3731730580329895, + 0.07899301499128342, + 0.0, + 0.2347363941371441, + 0.20061451569199562, + 0.10646060481667519, + 1.3572789058089256, + 0.0, + 0.05235138488933444, + 0.6351985225919634, + 0.14823003858327866, + 0.14371836185455322, + 0.23972787708044052, + 0.3232118170708418, + 0.0, + 1.2026403732597828, + 0.09767444059252739, + 0.029366744682192802, + 2.146270353347063, + 0.21110494807362556, + 0.3417271040380001, + 0.28671372681856155, + 0.0, + 0.3964583268389106, + 0.06400313228368759, + 0.0, + 0.03952590748667717, + 0.28957177279517055, + 0.4916959311813116, + 0.23678766191005707, + 0.565718712285161, + 0.6867104880511761, + 0.460092157125473, + 0.27435972169041634, + 0.08508895337581635, + 0.0, + 0.0, + 1.240547750145197, + 0.04867986589670181, + 0.7359848842024803, + 0.3475702181458473, + 0.9350400567054749, + 1.2434000559151173, + 0.04729057848453522, + 0.348177045583725, + 0.40754250809550285, + 0.44309346936643124, + 0.033672723919153214, + 0.0, + 0.2188115082681179, + 0.0, + 0.43158910796046257, + 0.24088618531823158, + 0.036988016217947006, + 0.3753591924905777, + 0.22748005017638206, + 0.2458295002579689, + 0.05011427029967308, + 0.45115681923925877, + 0.23388374410569668 + ], + "unique_experts": 53, + "load_cv": 0.927128848237702, + "normalized_load_entropy": 0.8925815039589475, + "max_load_share": 0.059027777777777776 + } + }, + "s1_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "bac12d1ebdc61ef8b00426b8ab49b32f08998df4de8030748138f8d7da8cb0e9", + "route_weight_sha256": "ab8d97c43fdc48edecd16616391f5f23ed707a4438d64a9676e93e65cb3360eb", + "loads": [ + 6, + 2, + 0, + 0, + 1, + 4, + 0, + 3, + 1, + 2, + 2, + 0, + 0, + 7, + 2, + 2, + 3, + 4, + 0, + 0, + 2, + 2, + 8, + 1, + 4, + 3, + 0, + 5, + 1, + 1, + 0, + 1, + 4, + 2, + 1, + 3, + 6, + 4, + 0, + 0, + 0, + 3, + 1, + 9, + 1, + 2, + 5, + 1, + 3, + 4, + 1, + 0, + 0, + 1, + 0, + 2, + 0, + 1, + 3, + 1, + 4, + 1, + 3, + 5 + ], + "weighted_loads": [ + 0.32904191315174103, + 0.09773366898298264, + 0.0, + 0.0, + 0.0839213952422142, + 0.13403310999274254, + 0.0, + 0.2324807345867157, + 0.10423697531223297, + 0.10767059400677681, + 0.17666569352149963, + 0.0, + 0.0, + 0.48310495540499687, + 0.14651881158351898, + 0.14197765290737152, + 0.20371776819229126, + 0.2133926972746849, + 0.0, + 0.0, + 0.0969272330403328, + 0.0758505929261446, + 0.5340397451072931, + 0.03622711822390556, + 0.20220544934272766, + 0.18209409713745117, + 0.0, + 0.3773878291249275, + 0.0650104284286499, + 0.03582954779267311, + 0.0, + 0.054846666753292084, + 0.4615178070962429, + 0.2282300665974617, + 0.0703241303563118, + 0.22206507250666618, + 0.4602305591106415, + 0.2798801399767399, + 0.0, + 0.0, + 0.0, + 0.1899072676897049, + 0.04784967005252838, + 0.7200751826167107, + 0.045946188271045685, + 0.10819467157125473, + 0.24307840317487717, + 0.055899448692798615, + 0.22308573126792908, + 0.4002130813896656, + 0.08504509925842285, + 0.0, + 0.0, + 0.09454203397035599, + 0.0, + 0.10976475104689598, + 0.0, + 0.03306024521589279, + 0.2489505484700203, + 0.054250333458185196, + 0.23974360898137093, + 0.04793968051671982, + 0.3553623557090759, + 0.2448513377457857 + ], + "unique_experts": 48, + "load_cv": 0.9742537361309165, + "normalized_load_entropy": 0.880323664394603, + "max_load_share": 0.06521739130434782 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "2ddafd3633e5a538842211660b790934f590a477d95df668341cdc0ad58a0c65", + "route_weight_sha256": "29ca498face45fefb7c60c0bfec5da7604a5616bc8ed1f1dd5e0fa20976723c4", + "loads": [ + 16, + 4, + 0, + 0, + 3, + 4, + 0, + 3, + 8, + 4, + 13, + 2, + 3, + 11, + 3, + 2, + 4, + 6, + 0, + 12, + 2, + 5, + 13, + 11, + 9, + 11, + 4, + 6, + 7, + 1, + 2, + 6, + 6, + 5, + 8, + 16, + 6, + 7, + 4, + 1, + 6, + 18, + 3, + 9, + 7, + 16, + 26, + 1, + 9, + 9, + 4, + 1, + 0, + 4, + 1, + 6, + 5, + 1, + 8, + 5, + 4, + 2, + 5, + 6 + ], + "weighted_loads": [ + 0.9985952600836754, + 0.18644320964813232, + 0.0, + 0.0, + 0.3878376856446266, + 0.13403310999274254, + 0.0, + 0.2324807345867157, + 0.5236812420189381, + 0.19904226064682007, + 1.2606380097568035, + 0.09691542014479637, + 0.053888285998255014, + 0.5809551149141043, + 0.18576129525899887, + 0.14197765290737152, + 0.24952328950166702, + 0.3062947914004326, + 0.0, + 1.2467065565288067, + 0.0969272330403328, + 0.20218459703028202, + 2.1389961559325457, + 0.7992659471929073, + 0.39310353621840477, + 0.6158573441207409, + 0.25511933118104935, + 0.39030744042247534, + 0.4896833784878254, + 0.03582954779267311, + 0.1399914063513279, + 0.2037585584912449, + 0.5029577231034636, + 0.4514589495956898, + 0.40960948914289474, + 1.0524659752845764, + 0.4602305591106415, + 0.4229026772081852, + 0.19689489528536797, + 0.06727427244186401, + 0.40114112198352814, + 1.7486959174275398, + 0.13973387703299522, + 0.7200751826167107, + 0.2714281203225255, + 1.3748054578900337, + 2.063833236694336, + 0.055899448692798615, + 0.5849760957062244, + 0.729204174131155, + 0.33739151433110237, + 0.03255666419863701, + 0.0, + 0.24441302940249443, + 0.040865931659936905, + 0.37045983597636223, + 0.23300982639193535, + 0.03306024521589279, + 0.533172857016325, + 0.23442448675632477, + 0.23974360898137093, + 0.08650047332048416, + 0.518641235306859, + 0.2809446770697832 + ], + "unique_experts": 59, + "load_cv": 0.8333333333333334, + "normalized_load_entropy": 0.9205688794058989, + "max_load_share": 0.06770833333333333 + } + }, + "s0_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "5735218577145c450b3faec886947d137083a546ef4938a5a2456652a29c936d", + "route_weight_sha256": "1cc2c354acff7b2c719977d6c61ff9f2fab3ff02c515d85e7a023397ad10501d", + "loads": [ + 7, + 1, + 0, + 1, + 1, + 2, + 0, + 3, + 1, + 2, + 2, + 0, + 0, + 8, + 2, + 3, + 3, + 4, + 0, + 0, + 1, + 1, + 8, + 1, + 4, + 4, + 0, + 5, + 1, + 0, + 0, + 1, + 4, + 2, + 1, + 3, + 6, + 4, + 0, + 0, + 0, + 3, + 1, + 9, + 2, + 2, + 4, + 1, + 3, + 4, + 1, + 0, + 0, + 1, + 0, + 2, + 0, + 1, + 3, + 1, + 5, + 1, + 4, + 4 + ], + "weighted_loads": [ + 0.39090315997600555, + 0.04605710878968239, + 0.0, + 0.05211051180958748, + 0.08099682629108429, + 0.07925517857074738, + 0.0, + 0.22653811797499657, + 0.10116641223430634, + 0.10946153104305267, + 0.18067146837711334, + 0.0, + 0.0, + 0.5268574953079224, + 0.14681605994701385, + 0.1801808848977089, + 0.2018088810145855, + 0.20861345529556274, + 0.0, + 0.0, + 0.05231912434101105, + 0.0273220743983984, + 0.5676810592412949, + 0.04423040896654129, + 0.2010042816400528, + 0.20535817369818687, + 0.0, + 0.37202633917331696, + 0.0589895136654377, + 0.0, + 0.0, + 0.05162692070007324, + 0.4309121146798134, + 0.25234728306531906, + 0.06256470084190369, + 0.22458411008119583, + 0.47161513566970825, + 0.2721421979367733, + 0.0, + 0.0, + 0.0, + 0.19555149599909782, + 0.05052680894732475, + 0.6971493400633335, + 0.08220339566469193, + 0.11395945772528648, + 0.2232157252728939, + 0.04653777927160263, + 0.2264682948589325, + 0.4142984077334404, + 0.07939150184392929, + 0.0, + 0.0, + 0.0940002053976059, + 0.0, + 0.10823587328195572, + 0.0, + 0.0316469632089138, + 0.25617117434740067, + 0.05027132108807564, + 0.27861034497618675, + 0.051145944744348526, + 0.38552287220954895, + 0.21443505957722664 + ], + "unique_experts": 48, + "load_cv": 1.0081582776486193, + "normalized_load_entropy": 0.8753409385261577, + "max_load_share": 0.06521739130434782 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "53bf038286720c318c5e3089401861926e9fdd9b5ec350c640f17ef3fed6c5ea", + "route_weight_sha256": "fc2ad190d57c588a3158e2c4b8767905cc6315f2ce2f435661f3d387993b391d", + "loads": [ + 14, + 1, + 0, + 1, + 4, + 2, + 0, + 3, + 3, + 2, + 13, + 0, + 2, + 12, + 2, + 3, + 4, + 10, + 0, + 12, + 1, + 1, + 12, + 3, + 7, + 5, + 0, + 6, + 1, + 0, + 1, + 6, + 4, + 2, + 10, + 10, + 6, + 4, + 1, + 1, + 0, + 13, + 1, + 9, + 6, + 11, + 16, + 1, + 5, + 4, + 8, + 1, + 0, + 4, + 0, + 7, + 5, + 1, + 5, + 5, + 5, + 1, + 6, + 5 + ], + "weighted_loads": [ + 0.8804494291543961, + 0.04605710878968239, + 0.0, + 0.05211051180958748, + 0.4488968104124069, + 0.07925517857074738, + 0.0, + 0.22653811797499657, + 0.19788428768515587, + 0.10946153104305267, + 1.3605872988700867, + 0.0, + 0.04498877748847008, + 0.6955242194235325, + 0.14681605994701385, + 0.1801808848977089, + 0.242726918309927, + 0.4346932601183653, + 0.0, + 1.1775819547474384, + 0.05231912434101105, + 0.0273220743983984, + 1.2418780401349068, + 0.26972855627536774, + 0.33043356239795685, + 0.2819310314953327, + 0.0, + 0.3849459504708648, + 0.0589895136654377, + 0.0, + 0.03952590748667717, + 0.2386224465444684, + 0.4309121146798134, + 0.25234728306531906, + 0.558397913351655, + 0.6548253409564495, + 0.47161513566970825, + 0.2721421979367733, + 0.04382992163300514, + 0.04468784108757973, + 0.0, + 1.2324002981185913, + 0.05052680894732475, + 0.6971493400633335, + 0.372684882953763, + 1.0174538902938366, + 1.2174449265003204, + 0.04653777927160263, + 0.3425169512629509, + 0.4142984077334404, + 0.4834769368171692, + 0.033672723919153214, + 0.0, + 0.22393523529171944, + 0.0, + 0.4570218101143837, + 0.24088618531823158, + 0.0316469632089138, + 0.3728470951318741, + 0.2252955362200737, + 0.27861034497618675, + 0.051145944744348526, + 0.44122071005403996, + 0.250655896961689 + ], + "unique_experts": 55, + "load_cv": 0.9254628471643157, + "normalized_load_entropy": 0.8940888633589034, + "max_load_share": 0.05555555555555555 + } + }, + "s1_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "c1d34df9390edf60619145afd284f708495a1856828f15e74c09707ba4cbbf25", + "route_weight_sha256": "7cd88688e68b075998c09dbef320ee1566d4873cd25fe632bd986df7946300ba", + "loads": [ + 6, + 2, + 0, + 0, + 1, + 2, + 0, + 3, + 1, + 2, + 2, + 0, + 0, + 8, + 2, + 3, + 3, + 4, + 0, + 0, + 1, + 1, + 8, + 1, + 4, + 5, + 0, + 5, + 1, + 0, + 0, + 1, + 4, + 2, + 1, + 3, + 6, + 4, + 0, + 0, + 0, + 3, + 1, + 9, + 1, + 2, + 4, + 1, + 3, + 4, + 2, + 0, + 0, + 1, + 0, + 2, + 0, + 1, + 3, + 1, + 4, + 1, + 4, + 5 + ], + "weighted_loads": [ + 0.34329671412706375, + 0.0969257652759552, + 0.0, + 0.0, + 0.08017974346876144, + 0.07536963745951653, + 0.0, + 0.22884422913193703, + 0.10540850460529327, + 0.11117582395672798, + 0.1833861619234085, + 0.0, + 0.0, + 0.5256299786269665, + 0.1459478661417961, + 0.1763937585055828, + 0.20813318714499474, + 0.21180928871035576, + 0.0, + 0.0, + 0.05261262133717537, + 0.025418445467948914, + 0.56233942322433, + 0.0418105311691761, + 0.20272191241383553, + 0.23375363275408745, + 0.0, + 0.3785286247730255, + 0.06129913032054901, + 0.0, + 0.0, + 0.05461057648062706, + 0.4485061578452587, + 0.25321805477142334, + 0.06745490431785583, + 0.22478240728378296, + 0.4742887057363987, + 0.27484192699193954, + 0.0, + 0.0, + 0.0, + 0.19878101721405983, + 0.05010049417614937, + 0.7009589076042175, + 0.049481991678476334, + 0.1111985631287098, + 0.21653839945793152, + 0.052040260285139084, + 0.22430060058832169, + 0.41126422211527824, + 0.11658434011042118, + 0.0, + 0.0, + 0.09298495203256607, + 0.0, + 0.11112659424543381, + 0.0, + 0.031016547232866287, + 0.25018077343702316, + 0.05032739043235779, + 0.24082715809345245, + 0.05194510519504547, + 0.37799712270498276, + 0.24650892242789268 + ], + "unique_experts": 47, + "load_cv": 1.0048193050239391, + "normalized_load_entropy": 0.8735680749701666, + "max_load_share": 0.06521739130434782 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "367c94dd21e98069203f9b4f6e625ed11781fa57e380ab31e5832f8ec530e9ad", + "route_weight_sha256": "11d98c6de78d9644cf44f9d9be836e8853d8c7aafade06469b7e3ecf85f57c1c", + "loads": [ + 17, + 4, + 0, + 0, + 4, + 2, + 0, + 3, + 8, + 4, + 13, + 2, + 2, + 12, + 3, + 3, + 4, + 9, + 0, + 12, + 1, + 4, + 12, + 11, + 9, + 13, + 4, + 6, + 7, + 0, + 2, + 5, + 4, + 5, + 8, + 15, + 6, + 7, + 3, + 2, + 6, + 18, + 3, + 9, + 5, + 16, + 25, + 1, + 9, + 9, + 7, + 1, + 0, + 5, + 1, + 6, + 5, + 1, + 8, + 5, + 4, + 2, + 6, + 6 + ], + "weighted_loads": [ + 1.0974000841379166, + 0.1856353059411049, + 0.0, + 0.0, + 0.46073732525110245, + 0.07536963745951653, + 0.0, + 0.22884422913193703, + 0.5248527713119984, + 0.20254749059677124, + 1.2673584781587124, + 0.09691542014479637, + 0.046957677230238914, + 0.6719821915030479, + 0.185190349817276, + 0.1763937585055828, + 0.2539387084543705, + 0.4361158534884453, + 0.0, + 1.2645444981753826, + 0.05261262133717537, + 0.15175244957208633, + 1.2464071493595839, + 0.8186745680868626, + 0.39361999928951263, + 0.6675168797373772, + 0.25511933118104935, + 0.39144823607057333, + 0.4859720803797245, + 0.0, + 0.1399914063513279, + 0.20069895405322313, + 0.4485061578452587, + 0.4764469377696514, + 0.4067402631044388, + 0.9831981882452965, + 0.4742887057363987, + 0.41786446422338486, + 0.15052666887640953, + 0.11460905149579048, + 0.40114112198352814, + 1.7632584609091282, + 0.1419847011566162, + 0.7009589076042175, + 0.22356353886425495, + 1.4624962247908115, + 2.0530080795288086, + 0.052040260285139084, + 0.5824079029262066, + 0.7402553148567677, + 0.4366725217550993, + 0.03255666419863701, + 0.0, + 0.2821028381586075, + 0.040865931659936905, + 0.4019986614584923, + 0.23300982639193535, + 0.031016547232866287, + 0.5350926034152508, + 0.23050154373049736, + 0.24082715809345245, + 0.09050589799880981, + 0.5412760023027658, + 0.2826022617518902 + ], + "unique_experts": 58, + "load_cv": 0.8380077233799486, + "normalized_load_entropy": 0.9175193051028893, + "max_load_share": 0.06510416666666667 + } + }, + "s0_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "95c64262c00a719e780eb6070efec1dd218cbbb638e2d18a918716ce16d0b730", + "route_weight_sha256": "a0934ce534964f97a5d6957bd24354f43c137cdf9af04712919daf2db14ef175", + "loads": [ + 6, + 2, + 0, + 0, + 1, + 2, + 0, + 3, + 1, + 2, + 2, + 0, + 1, + 7, + 2, + 2, + 3, + 4, + 0, + 0, + 2, + 1, + 8, + 1, + 4, + 6, + 0, + 5, + 1, + 0, + 0, + 2, + 3, + 2, + 1, + 3, + 6, + 4, + 0, + 0, + 0, + 3, + 1, + 9, + 1, + 2, + 5, + 1, + 3, + 5, + 2, + 0, + 0, + 1, + 0, + 2, + 0, + 1, + 3, + 1, + 4, + 1, + 3, + 3 + ], + "weighted_loads": [ + 0.4118337631225586, + 0.10265340283513069, + 0.0, + 0.0, + 0.0799596905708313, + 0.07931786775588989, + 0.0, + 0.22300243750214577, + 0.09550675004720688, + 0.10458118841052055, + 0.1771964654326439, + 0.0, + 0.05425368621945381, + 0.480021208524704, + 0.13277630135416985, + 0.12618351727724075, + 0.18959008157253265, + 0.21114589646458626, + 0.0, + 0.0, + 0.09742653369903564, + 0.027889186516404152, + 0.5553251057863235, + 0.04189595952630043, + 0.20450012758374214, + 0.3212471567094326, + 0.0, + 0.40097520500421524, + 0.06756523251533508, + 0.0, + 0.0, + 0.09066420421004295, + 0.38138579577207565, + 0.2557756379246712, + 0.06320790201425552, + 0.22272389382123947, + 0.4589800499379635, + 0.26680368930101395, + 0.0, + 0.0, + 0.0, + 0.20173455029726028, + 0.04728936031460762, + 0.665094293653965, + 0.05298417806625366, + 0.10467503219842911, + 0.27093522995710373, + 0.04819019138813019, + 0.23690122365951538, + 0.4287460148334503, + 0.10608547367155552, + 0.0, + 0.0, + 0.09999878704547882, + 0.0, + 0.10478873178362846, + 0.0, + 0.03291168808937073, + 0.25537721812725067, + 0.05254106968641281, + 0.2523685470223427, + 0.05420847237110138, + 0.3464439660310745, + 0.1411616150289774 + ], + "unique_experts": 48, + "load_cv": 0.9811283791891484, + "normalized_load_entropy": 0.8800040236862813, + "max_load_share": 0.06521739130434782 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "f2a2a9934226775d7dbbef148f344b85e76a3bee5a849d4b9f11dd60d1c74d61", + "route_weight_sha256": "a3a551d0c17ac6df4a389fdc03832614a3e4351916072e9d656ec40cf63e5cb7", + "loads": [ + 14, + 2, + 0, + 0, + 3, + 2, + 0, + 3, + 3, + 2, + 14, + 0, + 3, + 11, + 2, + 2, + 5, + 7, + 0, + 11, + 2, + 1, + 12, + 3, + 7, + 9, + 0, + 6, + 1, + 0, + 1, + 7, + 3, + 2, + 11, + 9, + 6, + 4, + 4, + 0, + 0, + 13, + 1, + 9, + 5, + 10, + 17, + 1, + 6, + 5, + 7, + 1, + 0, + 2, + 0, + 7, + 5, + 1, + 5, + 7, + 4, + 1, + 5, + 4 + ], + "weighted_loads": [ + 1.019119817763567, + 0.10265340283513069, + 0.0, + 0.0, + 0.38294634222984314, + 0.07931786775588989, + 0.0, + 0.22300243750214577, + 0.1922246254980564, + 0.10458118841052055, + 1.5074476972222328, + 0.0, + 0.09924246370792389, + 0.6230196356773376, + 0.13277630135416985, + 0.12618351727724075, + 0.267346628010273, + 0.3269756194204092, + 0.0, + 1.114042278379202, + 0.09742653369903564, + 0.027889186516404152, + 1.2341661676764488, + 0.22340749576687813, + 0.3339294083416462, + 0.469818614423275, + 0.0, + 0.41389481630176306, + 0.06756523251533508, + 0.0, + 0.03952590748667717, + 0.2776597300544381, + 0.38138579577207565, + 0.2557756379246712, + 0.6540844161063433, + 0.6344719305634499, + 0.4589800499379635, + 0.26680368930101395, + 0.1692741960287094, + 0.0, + 0.0, + 1.2165843732655048, + 0.04728936031460762, + 0.665094293653965, + 0.34449527226388454, + 0.725754626095295, + 1.2267720699310303, + 0.04819019138813019, + 0.4025339037179947, + 0.4287460148334503, + 0.41717064566910267, + 0.033672723919153214, + 0.0, + 0.14494429901242256, + 0.0, + 0.4557166211307049, + 0.24088618531823158, + 0.03291168808937073, + 0.35797880962491035, + 0.30474256351590157, + 0.2523685470223427, + 0.05420847237110138, + 0.40214180387556553, + 0.17738245241343975 + ], + "unique_experts": 53, + "load_cv": 0.927128848237702, + "normalized_load_entropy": 0.892434276012836, + "max_load_share": 0.059027777777777776 + } + }, + "s1_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "cffa5e6e00066fa2618041602314610d69ee308760e4f4424071b8720c96800c", + "route_weight_sha256": "098e87564ed7606379865887b85a906d078bccc73b0c9b9139a49ddb4d4069eb", + "loads": [ + 7, + 2, + 0, + 0, + 1, + 2, + 0, + 3, + 1, + 2, + 2, + 0, + 0, + 7, + 2, + 2, + 3, + 4, + 0, + 0, + 2, + 1, + 8, + 1, + 4, + 7, + 0, + 5, + 1, + 0, + 0, + 2, + 3, + 2, + 1, + 3, + 6, + 4, + 0, + 0, + 0, + 3, + 1, + 8, + 1, + 2, + 5, + 1, + 3, + 4, + 2, + 0, + 0, + 1, + 0, + 2, + 0, + 1, + 3, + 1, + 4, + 1, + 3, + 4 + ], + "weighted_loads": [ + 0.4535592459142208, + 0.10225098207592964, + 0.0, + 0.0, + 0.07445172220468521, + 0.08034608885645866, + 0.0, + 0.22819781675934792, + 0.09837738424539566, + 0.1089463010430336, + 0.17595697939395905, + 0.0, + 0.0, + 0.48329704254865646, + 0.1383361965417862, + 0.12608110904693604, + 0.1988002136349678, + 0.20555980876088142, + 0.0, + 0.0, + 0.09291616454720497, + 0.02678588405251503, + 0.5482198428362608, + 0.04070236533880234, + 0.20633793622255325, + 0.37857960164546967, + 0.0, + 0.4086109958589077, + 0.06693845242261887, + 0.0, + 0.0, + 0.09890606254339218, + 0.3782544210553169, + 0.25249744206666946, + 0.06923173367977142, + 0.22086399793624878, + 0.4655659794807434, + 0.25730664283037186, + 0.0, + 0.0, + 0.0, + 0.1937081590294838, + 0.05079861357808113, + 0.6210036277770996, + 0.05172065645456314, + 0.10101881623268127, + 0.280314389616251, + 0.05939684808254242, + 0.22828415781259537, + 0.3540879338979721, + 0.11411650851368904, + 0.0, + 0.0, + 0.09075219929218292, + 0.0, + 0.11161432042717934, + 0.0, + 0.03261905536055565, + 0.25218284130096436, + 0.049650438129901886, + 0.24113008752465248, + 0.055368728935718536, + 0.3557550981640816, + 0.18968544900417328 + ], + "unique_experts": 47, + "load_cv": 0.9913509608500108, + "normalized_load_entropy": 0.8759103450503254, + "max_load_share": 0.057971014492753624 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "ff827d594437f22f5bcc00fc014163e4c2ff92254df0594d6bb51b313274bd53", + "route_weight_sha256": "fe2205ea2ec734fc806176e78ed98750c5df27c3ec99daec8f6281d0f2936663", + "loads": [ + 20, + 4, + 0, + 0, + 3, + 2, + 0, + 3, + 9, + 4, + 14, + 2, + 2, + 10, + 3, + 2, + 5, + 7, + 0, + 12, + 2, + 4, + 12, + 11, + 9, + 17, + 5, + 6, + 7, + 0, + 2, + 6, + 3, + 5, + 9, + 15, + 6, + 7, + 5, + 2, + 6, + 18, + 3, + 8, + 5, + 13, + 25, + 1, + 9, + 9, + 5, + 1, + 0, + 3, + 1, + 6, + 5, + 1, + 8, + 6, + 4, + 2, + 5, + 5 + ], + "weighted_loads": [ + 1.3469352796673775, + 0.19096052274107933, + 0.0, + 0.0, + 0.3893279507756233, + 0.08034608885645866, + 0.0, + 0.22819781675934792, + 0.5603852160274982, + 0.20031796768307686, + 1.4206775836646557, + 0.09691542014479637, + 0.046957677230238914, + 0.5742043256759644, + 0.17757868021726608, + 0.12608110904693604, + 0.2850496545433998, + 0.3567451946437359, + 0.0, + 1.1648121774196625, + 0.09291616454720497, + 0.15311988815665245, + 1.2357455398887396, + 0.8263492658734322, + 0.39723602309823036, + 0.8917770981788635, + 0.3022793233394623, + 0.4215306071564555, + 0.49161140248179436, + 0.0, + 0.1399914063513279, + 0.24499444011598825, + 0.3782544210553169, + 0.47572632506489754, + 0.468564972281456, + 0.9761074036359787, + 0.4655659794807434, + 0.40032918006181717, + 0.2569485455751419, + 0.11053511500358582, + 0.40114112198352814, + 1.60767412930727, + 0.14268282055854797, + 0.6210036277770996, + 0.22065856494009495, + 1.0070275142788887, + 2.0219829827547073, + 0.05939684808254242, + 0.5845489390194416, + 0.6830790266394615, + 0.33156897500157356, + 0.03255666419863701, + 0.0, + 0.19164592772722244, + 0.040865931659936905, + 0.3962387330830097, + 0.23300982639193535, + 0.03261905536055565, + 0.5217511355876923, + 0.2817694768309593, + 0.24113008752465248, + 0.09392952173948288, + 0.5190339777618647, + 0.22577878832817078 + ], + "unique_experts": 58, + "load_cv": 0.8609990966571593, + "normalized_load_entropy": 0.9151671547832656, + "max_load_share": 0.06510416666666667 + } + }, + "s0_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "b3870ed92e65a2933c34a36d63ad189841752e7f38ddb03e9cf62f6dda707255", + "route_weight_sha256": "165b935594599a5c47560085b4cfb5381be38e7b873583f599481b5ed36578ca", + "loads": [ + 6, + 2, + 0, + 0, + 1, + 2, + 0, + 3, + 1, + 2, + 2, + 0, + 1, + 7, + 2, + 2, + 3, + 4, + 0, + 0, + 2, + 1, + 8, + 1, + 4, + 5, + 0, + 5, + 1, + 0, + 0, + 2, + 4, + 2, + 1, + 3, + 6, + 4, + 0, + 0, + 0, + 3, + 1, + 9, + 1, + 2, + 5, + 1, + 3, + 5, + 2, + 0, + 0, + 1, + 0, + 2, + 0, + 1, + 3, + 1, + 4, + 1, + 3, + 3 + ], + "weighted_loads": [ + 0.43322279304265976, + 0.10372577235102654, + 0.0, + 0.0, + 0.08068415522575378, + 0.07832710444927216, + 0.0, + 0.22291027382016182, + 0.10070107877254486, + 0.10886012390255928, + 0.17613974958658218, + 0.0, + 0.05402369424700737, + 0.4735802337527275, + 0.1336917020380497, + 0.12833156436681747, + 0.1909189149737358, + 0.20245376601815224, + 0.0, + 0.0, + 0.09657739475369453, + 0.02727198787033558, + 0.5523210652172565, + 0.040200747549533844, + 0.2066780924797058, + 0.2771104723215103, + 0.0, + 0.3905896805226803, + 0.06450790166854858, + 0.0, + 0.0, + 0.09513828530907631, + 0.4198145866394043, + 0.2557739391922951, + 0.06814175099134445, + 0.22364487498998642, + 0.455110389739275, + 0.26672743633389473, + 0.0, + 0.0, + 0.0, + 0.20625365898013115, + 0.05009173974394798, + 0.6596818752586842, + 0.05183090269565582, + 0.10466808825731277, + 0.27000392228364944, + 0.04614461585879326, + 0.23652227967977524, + 0.43601546064019203, + 0.10479756444692612, + 0.0, + 0.0, + 0.09859748184680939, + 0.0, + 0.10951759666204453, + 0.0, + 0.03217971697449684, + 0.2512081190943718, + 0.05382093787193298, + 0.25358106195926666, + 0.054948825389146805, + 0.3407653868198395, + 0.13780548050999641 + ], + "unique_experts": 48, + "load_cv": 0.9742537361309165, + "normalized_load_entropy": 0.880795113096974, + "max_load_share": 0.06521739130434782 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "ce46622a1a2c806446a3d676b1dc0b6b5010e3f1f644b7f1d67ee6a96acd27ba", + "route_weight_sha256": "d36bf7f10c35b8d0b0570419207bad4ede4fbf4d8d0e29a317980a740e6b47e8", + "loads": [ + 15, + 2, + 0, + 0, + 3, + 2, + 0, + 3, + 3, + 2, + 14, + 0, + 3, + 10, + 2, + 2, + 4, + 8, + 0, + 11, + 2, + 1, + 12, + 3, + 7, + 6, + 0, + 6, + 1, + 0, + 1, + 7, + 4, + 2, + 11, + 10, + 6, + 4, + 3, + 0, + 0, + 14, + 1, + 9, + 5, + 10, + 18, + 1, + 5, + 5, + 7, + 1, + 0, + 3, + 0, + 7, + 6, + 1, + 5, + 6, + 4, + 1, + 5, + 4 + ], + "weighted_loads": [ + 1.047753855586052, + 0.10372577235102654, + 0.0, + 0.0, + 0.3808322697877884, + 0.07832710444927216, + 0.0, + 0.22291027382016182, + 0.1974189542233944, + 0.10886012390255928, + 1.4509771019220352, + 0.0, + 0.09901247173547745, + 0.5798990465700626, + 0.1336917020380497, + 0.12833156436681747, + 0.2318369522690773, + 0.3697416242212057, + 0.0, + 1.1313683800399303, + 0.09657739475369453, + 0.02727198787033558, + 1.2349911965429783, + 0.22356496006250381, + 0.33610737323760986, + 0.35368333011865616, + 0.0, + 0.4035092918202281, + 0.06450790166854858, + 0.0, + 0.03952590748667717, + 0.28213381115347147, + 0.4198145866394043, + 0.2557739391922951, + 0.6207702700048685, + 0.663810521364212, + 0.455110389739275, + 0.26672743633389473, + 0.13352736085653305, + 0.0, + 0.0, + 1.2718398571014404, + 0.05009173974394798, + 0.6596818752586842, + 0.342428395524621, + 0.758907325565815, + 1.3430989868938923, + 0.04614461585879326, + 0.35308998078107834, + 0.43601546064019203, + 0.412092424929142, + 0.033672723919153214, + 0.0, + 0.17777694016695023, + 0.0, + 0.47618158906698227, + 0.27872712910175323, + 0.03217971697449684, + 0.35255999490618706, + 0.2694109007716179, + 0.25358106195926666, + 0.054948825389146805, + 0.3964632246643305, + 0.17402631789445877 + ], + "unique_experts": 53, + "load_cv": 0.9444444444444444, + "normalized_load_entropy": 0.8911279007134443, + "max_load_share": 0.0625 + } + }, + "s1_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "bfb39cf5bdecbbaf16cad605b4ed64c48c1e06356e12d225957b0231498d0cdf", + "route_weight_sha256": "cd8a55e72b535120f6dd27c23f1358fe65127143d9908bbb9ce3ffec583ecdf4", + "loads": [ + 7, + 2, + 0, + 0, + 1, + 2, + 0, + 3, + 1, + 2, + 2, + 0, + 0, + 7, + 2, + 2, + 3, + 4, + 0, + 0, + 2, + 1, + 7, + 1, + 4, + 6, + 0, + 5, + 1, + 0, + 0, + 1, + 4, + 2, + 1, + 3, + 6, + 4, + 0, + 0, + 0, + 3, + 1, + 8, + 1, + 2, + 5, + 1, + 3, + 4, + 2, + 1, + 0, + 1, + 0, + 2, + 0, + 1, + 3, + 1, + 4, + 1, + 3, + 5 + ], + "weighted_loads": [ + 0.46611231565475464, + 0.10268279910087585, + 0.0, + 0.0, + 0.07449997961521149, + 0.07908151298761368, + 0.0, + 0.2267521657049656, + 0.10038773715496063, + 0.11449473723769188, + 0.17168520390987396, + 0.0, + 0.0, + 0.48020007088780403, + 0.138427272439003, + 0.1274450235068798, + 0.19035355746746063, + 0.19683274254202843, + 0.0, + 0.0, + 0.09541698172688484, + 0.027046898379921913, + 0.507824370637536, + 0.03908079117536545, + 0.20660848170518875, + 0.323249276727438, + 0.0, + 0.40115490928292274, + 0.06668080389499664, + 0.0, + 0.0, + 0.05040793493390083, + 0.4157245233654976, + 0.25265495479106903, + 0.06686699390411377, + 0.22851907461881638, + 0.4562442936003208, + 0.27253078296780586, + 0.0, + 0.0, + 0.0, + 0.19576221704483032, + 0.049259722232818604, + 0.6085560098290443, + 0.05196459963917732, + 0.09890903159976006, + 0.2634412422776222, + 0.056210730224847794, + 0.22987599670886993, + 0.3732144683599472, + 0.10735606960952282, + 0.04198653623461723, + 0.0, + 0.09129796177148819, + 0.0, + 0.11363208293914795, + 0.0, + 0.03060113452374935, + 0.2487398162484169, + 0.05271008238196373, + 0.24572599679231644, + 0.05538121610879898, + 0.35817965865135193, + 0.23998541943728924 + ], + "unique_experts": 48, + "load_cv": 0.9673302374472603, + "normalized_load_entropy": 0.8803010117452527, + "max_load_share": 0.057971014492753624 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "bc89368d294f381e03f6983c98af7e79a5d7585de98feeb564580b79aa378dd7", + "route_weight_sha256": "22eb20f28356eba48ca281e23dacc36b275e1e0ea0bed6b23f5227b9bcb6d0ab", + "loads": [ + 19, + 4, + 0, + 0, + 3, + 2, + 0, + 3, + 8, + 4, + 14, + 2, + 2, + 11, + 3, + 2, + 4, + 8, + 0, + 11, + 2, + 4, + 11, + 11, + 9, + 16, + 4, + 6, + 7, + 0, + 2, + 5, + 4, + 5, + 8, + 16, + 6, + 7, + 5, + 1, + 6, + 19, + 3, + 8, + 5, + 13, + 27, + 1, + 9, + 9, + 5, + 2, + 0, + 4, + 1, + 6, + 6, + 1, + 8, + 5, + 4, + 2, + 5, + 6 + ], + "weighted_loads": [ + 1.2548858411610126, + 0.19139233976602554, + 0.0, + 0.0, + 0.3841264545917511, + 0.07908151298761368, + 0.0, + 0.2267521657049656, + 0.5198320038616657, + 0.20586640387773514, + 1.3250606842339039, + 0.09691542014479637, + 0.046957677230238914, + 0.6022635698318481, + 0.17766975611448288, + 0.1274450235068798, + 0.2361590787768364, + 0.3927859365940094, + 0.0, + 1.1574556455016136, + 0.09541698172688484, + 0.15338090248405933, + 1.196654574945569, + 0.807894840836525, + 0.39750656858086586, + 0.8347261734306812, + 0.25511933118104935, + 0.41407452058047056, + 0.49135375395417213, + 0.0, + 0.1399914063513279, + 0.1964963125064969, + 0.4157245233654976, + 0.4758838377892971, + 0.4061523526906967, + 1.0247367359697819, + 0.4562442936003208, + 0.4155533201992512, + 0.2688138373196125, + 0.06727427244186401, + 0.40114112198352814, + 1.7169844396412373, + 0.14114392921328545, + 0.6085560098290443, + 0.21634707786142826, + 0.9915148839354515, + 2.24046428874135, + 0.056210730224847794, + 0.5862547643482685, + 0.7022055611014366, + 0.3158742170780897, + 0.07454320043325424, + 0.0, + 0.24161388725042343, + 0.040865931659936905, + 0.4001345634460449, + 0.2743874378502369, + 0.03060113452374935, + 0.5207861363887787, + 0.2328842356801033, + 0.24572599679231644, + 0.09394200891256332, + 0.521458538249135, + 0.27607875876128674 + ], + "unique_experts": 58, + "load_cv": 0.8740073734751262, + "normalized_load_entropy": 0.9144800731074438, + "max_load_share": 0.0703125 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 18, + "mean_set_jaccard": 0.9378881987577639, + "mean_token_weighted_tv": 0.013571295968216398, + "aggregate_load_tv": 0.03623188405797102 + }, + "system_bos": { + "tokens": 23, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.9254658385093167, + "mean_token_weighted_tv": 0.016047229868886265, + "aggregate_load_tv": 0.028985507246376815 + }, + "system_x": { + "tokens": 23, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 20, + "mean_set_jaccard": 0.9627329192546585, + "mean_token_weighted_tv": 0.015079722861232965, + "aggregate_load_tv": 0.021739130434782615 + }, + "system_period": { + "tokens": 23, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 18, + "mean_set_jaccard": 0.9378881987577639, + "mean_token_weighted_tv": 0.01938959405474041, + "aggregate_load_tv": 0.036231884057971016 + }, + "bos_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.9254658385093167, + "mean_token_weighted_tv": 0.02025680972830109, + "aggregate_load_tv": 0.036231884057971016 + }, + "bos_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.9130434782608695, + "mean_token_weighted_tv": 0.02015946858117114, + "aggregate_load_tv": 0.04347826086956522 + }, + "x_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.9503105590062113, + "mean_token_weighted_tv": 0.022156683485145153, + "aggregate_load_tv": 0.028985507246376815 + }, + "x_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.9130434782608695, + "mean_token_weighted_tv": 0.027280211934576862, + "aggregate_load_tv": 0.050724637681159424 + }, + "period_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 20, + "mean_set_jaccard": 0.9627329192546585, + "mean_token_weighted_tv": 0.02097641992504182, + "aggregate_load_tv": 0.021739130434782615 + }, + "period_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.9254658385093167, + "mean_token_weighted_tv": 0.025525160538761513, + "aggregate_load_tv": 0.043478260869565216 + } + } + }, + "layer_10": { + "layer": 10, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "e6b037510e87a1916828d62258ddde637f5b13f3671a60b071ca277173354bb8", + "route_weight_sha256": "c1310f453d1f97acf9fe873cb5736009c0e3e3cf3ecd2d29e8c61233448777c3", + "loads": [ + 1, + 0, + 2, + 2, + 4, + 5, + 0, + 11, + 3, + 2, + 1, + 0, + 1, + 2, + 0, + 2, + 3, + 0, + 1, + 6, + 1, + 0, + 8, + 0, + 4, + 3, + 1, + 1, + 0, + 3, + 1, + 4, + 4, + 23, + 2, + 1, + 0, + 0, + 3, + 1, + 0, + 3, + 3, + 0, + 0, + 0, + 0, + 0, + 0, + 2, + 0, + 1, + 1, + 3, + 1, + 3, + 4, + 2, + 3, + 2, + 3, + 0, + 1, + 0 + ], + "weighted_loads": [ + 0.052958790212869644, + 0.0, + 0.13800081983208656, + 0.12449145689606667, + 0.2749965786933899, + 0.2949291840195656, + 0.0, + 0.8639280032366514, + 0.16958880424499512, + 0.09250196814537048, + 0.05531354993581772, + 0.0, + 0.13521219789981842, + 0.16814759373664856, + 0.0, + 0.08482503518462181, + 0.22127941250801086, + 0.0, + 0.15505169332027435, + 0.30516768246889114, + 0.04510237276554108, + 0.0, + 0.9496222026646137, + 0.0, + 0.2066817209124565, + 0.20758850872516632, + 0.03824339807033539, + 0.03792060539126396, + 0.0, + 0.18231366574764252, + 0.058640021830797195, + 0.3033868372440338, + 0.20910341292619705, + 3.1795159429311752, + 0.11890286765992641, + 0.04973806068301201, + 0.0, + 0.0, + 0.18951822817325592, + 0.06190376728773117, + 0.0, + 0.1669658161699772, + 0.33906906098127365, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.10148272663354874, + 0.0, + 0.03544890508055687, + 0.06714745610952377, + 0.16661684215068817, + 0.10484539717435837, + 0.3141184002161026, + 0.2149089276790619, + 0.15455644205212593, + 0.135260459035635, + 0.07424227893352509, + 0.20502010732889175, + 0.0, + 0.041266292333602905, + 0.0 + ], + "unique_experts": 44, + "load_cv": 1.5408053333904081, + "normalized_load_entropy": 0.8181854157469854, + "max_load_share": 0.16666666666666666 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "226684a4c17ef24449d82c272e9ff019e075e32056aba0c29468abb12c5b7cbd", + "route_weight_sha256": "20b0918de17e819eef25b5c33b65890a9563d6daf6fadaf22af43f9135d586ee", + "loads": [ + 1, + 0, + 4, + 2, + 4, + 5, + 0, + 15, + 3, + 4, + 3, + 1, + 2, + 5, + 2, + 2, + 3, + 2, + 8, + 7, + 5, + 2, + 9, + 0, + 4, + 5, + 1, + 10, + 1, + 4, + 3, + 5, + 4, + 32, + 3, + 2, + 0, + 0, + 3, + 1, + 0, + 13, + 8, + 2, + 4, + 2, + 6, + 3, + 0, + 4, + 2, + 8, + 1, + 4, + 1, + 12, + 4, + 9, + 3, + 14, + 8, + 12, + 1, + 0 + ], + "weighted_loads": [ + 0.052958790212869644, + 0.0, + 0.15696877473965287, + 0.12449145689606667, + 0.2749965786933899, + 0.2949291840195656, + 0.0, + 1.0386195722967386, + 0.16958880424499512, + 0.11699235811829567, + 0.15269796550273895, + 0.04508715495467186, + 0.16794485598802567, + 1.5844182781875134, + 0.14959192648530006, + 0.08482503518462181, + 0.22127941250801086, + 0.11908509582281113, + 0.5370084545575082, + 0.37031369656324387, + 0.21273257955908775, + 0.0848299153149128, + 0.9533524983562529, + 0.0, + 0.2066817209124565, + 0.27135802432894707, + 0.03824339807033539, + 1.0006795711815357, + 0.04606078192591667, + 0.2241005264222622, + 0.2562568821012974, + 0.3171287765726447, + 0.20910341292619705, + 3.594963636249304, + 0.1487781275063753, + 0.08677415549755096, + 0.0, + 0.0, + 0.18951822817325592, + 0.06190376728773117, + 0.0, + 1.5289221853017807, + 0.4912093747407198, + 0.0964493677020073, + 0.2009788639843464, + 0.10616698488593102, + 0.2691478170454502, + 0.11158508621156216, + 0.0, + 0.19286125525832176, + 0.09166012704372406, + 0.3832945041358471, + 0.06714745610952377, + 0.24460549652576447, + 0.10484539717435837, + 1.1544631123542786, + 0.2149089276790619, + 0.5446541532874107, + 0.135260459035635, + 0.8481943048536777, + 0.5366833619773388, + 1.0406240709125996, + 0.041266292333602905, + 0.0 + ], + "unique_experts": 56, + "load_cv": 1.115961634811148, + "normalized_load_entropy": 0.8850467380765351, + "max_load_share": 0.1111111111111111 + } + }, + "s1_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "fda95c8f9f67de76f814a28a28ca628d04fada047bc8edb2460274120ab71e31", + "route_weight_sha256": "2ede06c74916b534609a3a5c42d16aa67086ab49e0680b197e7bb00a9151574b", + "loads": [ + 1, + 0, + 3, + 2, + 4, + 5, + 0, + 12, + 3, + 2, + 1, + 0, + 1, + 2, + 0, + 2, + 3, + 0, + 1, + 5, + 0, + 0, + 8, + 0, + 4, + 4, + 0, + 1, + 0, + 3, + 1, + 4, + 3, + 23, + 2, + 1, + 0, + 0, + 3, + 1, + 0, + 4, + 3, + 0, + 0, + 0, + 0, + 0, + 0, + 2, + 0, + 1, + 1, + 3, + 1, + 3, + 3, + 2, + 3, + 3, + 3, + 0, + 1, + 0 + ], + "weighted_loads": [ + 0.05066155269742012, + 0.0, + 0.18283066898584366, + 0.1260751374065876, + 0.2612300142645836, + 0.2887064591050148, + 0.0, + 0.9259306192398071, + 0.17135580629110336, + 0.09244528785347939, + 0.05276254937052727, + 0.0, + 0.13410940766334534, + 0.16657141596078873, + 0.0, + 0.08521376177668571, + 0.22638219967484474, + 0.0, + 0.16014569997787476, + 0.26506301015615463, + 0.0, + 0.0, + 0.9355962872505188, + 0.0, + 0.20695167779922485, + 0.24178225919604301, + 0.0, + 0.039553262293338776, + 0.0, + 0.18429971113801003, + 0.05997326225042343, + 0.304153211414814, + 0.16853520646691322, + 3.2088787481188774, + 0.11336957290768623, + 0.04929690062999725, + 0.0, + 0.0, + 0.19089245051145554, + 0.058710772544145584, + 0.0, + 0.21180376783013344, + 0.3312121629714966, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.09961414337158203, + 0.0, + 0.037804558873176575, + 0.06476704776287079, + 0.16705508157610893, + 0.10686444491147995, + 0.31410086899995804, + 0.16833053529262543, + 0.14859825000166893, + 0.13516121357679367, + 0.10968951135873795, + 0.20468103885650635, + 0.0, + 0.04486560821533203, + 0.0 + ], + "unique_experts": 42, + "load_cv": 1.5624640302518031, + "normalized_load_entropy": 0.8102440598555839, + "max_load_share": 0.16666666666666666 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "5dfd5e259dc80077f381bfc940a921b5e569aa86dd1f7bc129735cc2a7e6f69a", + "route_weight_sha256": "ec371f9049394fda4b816459fd50a5568cebfb74c9070fb06bbb353349bf4035", + "loads": [ + 1, + 0, + 5, + 2, + 8, + 5, + 0, + 13, + 3, + 4, + 3, + 3, + 5, + 4, + 3, + 2, + 3, + 5, + 7, + 5, + 1, + 2, + 9, + 0, + 5, + 7, + 2, + 24, + 0, + 6, + 9, + 5, + 8, + 41, + 4, + 3, + 2, + 2, + 4, + 1, + 1, + 20, + 8, + 2, + 3, + 5, + 6, + 3, + 8, + 5, + 3, + 14, + 2, + 5, + 1, + 17, + 4, + 9, + 3, + 22, + 15, + 10, + 1, + 1 + ], + "weighted_loads": [ + 0.05066155269742012, + 0.0, + 0.20193666173145175, + 0.1260751374065876, + 0.4615533649921417, + 0.2887064591050148, + 0.0, + 0.9628075659275055, + 0.17135580629110336, + 0.11765222437679768, + 0.1301679015159607, + 0.17257045954465866, + 0.3340020477771759, + 1.5412913337349892, + 0.22126486152410507, + 0.08521376177668571, + 0.22638219967484474, + 0.2722689285874367, + 0.5256909723393619, + 0.26506301015615463, + 0.04083188995718956, + 0.0882425345480442, + 0.9395260009914637, + 0.0, + 0.24827566742897034, + 0.5645513981580734, + 0.0703179333359003, + 1.6085233837366104, + 0.0, + 0.3173418417572975, + 0.706976093351841, + 0.3178951507434249, + 0.6621454395353794, + 4.090917780995369, + 0.2558381836861372, + 0.21375124901533127, + 0.08494311943650246, + 0.0863197073340416, + 0.2285429649055004, + 0.058710772544145584, + 0.04269063100218773, + 1.939167071133852, + 0.4677695771679282, + 0.06852002255618572, + 0.17574870586395264, + 0.2592535577714443, + 0.3274328075349331, + 0.10657772608101368, + 0.6497659832239151, + 0.2678017430007458, + 0.17931021004915237, + 0.8080612979829311, + 0.13434000313282013, + 0.2900433875620365, + 0.10686444491147995, + 1.4721633270382881, + 0.2413446083664894, + 0.543148897588253, + 0.13516121357679367, + 1.3279342986643314, + 1.0113793462514877, + 0.903436329215765, + 0.04486560821533203, + 0.03539826720952988 + ], + "unique_experts": 60, + "load_cv": 1.130388330520878, + "normalized_load_entropy": 0.8889352618972237, + "max_load_share": 0.10677083333333333 + } + }, + "s0_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "da30b4c48ff9fbf3352462a99b2ea60cd9aa76d0faab520b75623001d7f53de7", + "route_weight_sha256": "3e843765e5ba2fc6c01b464580200d5afd08a050754f7ea6a5f6ef77250865fb", + "loads": [ + 1, + 0, + 2, + 2, + 4, + 5, + 0, + 11, + 3, + 2, + 1, + 0, + 1, + 2, + 0, + 2, + 3, + 0, + 1, + 6, + 0, + 0, + 8, + 0, + 5, + 5, + 1, + 0, + 0, + 3, + 1, + 5, + 3, + 23, + 2, + 1, + 0, + 0, + 3, + 1, + 0, + 4, + 3, + 0, + 0, + 0, + 0, + 0, + 0, + 2, + 0, + 0, + 1, + 3, + 1, + 3, + 3, + 2, + 3, + 3, + 3, + 0, + 0, + 0 + ], + "weighted_loads": [ + 0.05152781680226326, + 0.0, + 0.13936033472418785, + 0.12423065677285194, + 0.25708044320344925, + 0.2946000471711159, + 0.0, + 0.861382270231843, + 0.16620495915412903, + 0.09958845004439354, + 0.05126728117465973, + 0.0, + 0.14046666026115417, + 0.15195553377270699, + 0.0, + 0.09523820132017136, + 0.21830370277166367, + 0.0, + 0.15382102131843567, + 0.3295306898653507, + 0.0, + 0.0, + 0.9010716900229454, + 0.0, + 0.25565730780363083, + 0.26284484565258026, + 0.04156868904829025, + 0.0, + 0.0, + 0.17895185947418213, + 0.05922704190015793, + 0.33541231229901314, + 0.18373919650912285, + 3.198585756123066, + 0.13123210333287716, + 0.04848300665616989, + 0.0, + 0.0, + 0.1972370520234108, + 0.05565951392054558, + 0.0, + 0.21719888225197792, + 0.3389967828989029, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.09903062880039215, + 0.0, + 0.0, + 0.06715166568756104, + 0.16548476368188858, + 0.10916436463594437, + 0.3268139958381653, + 0.1768147125840187, + 0.15305163711309433, + 0.13647031411528587, + 0.11893640458583832, + 0.20617388933897018, + 0.0, + 0.0, + 0.0 + ], + "unique_experts": 40, + "load_cv": 1.571043905815894, + "normalized_load_entropy": 0.8017798494118721, + "max_load_share": 0.16666666666666666 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "a3908168d81b23d31998bc9313937e833224120534f66bf8d32b166fbedd1f03", + "route_weight_sha256": "d9f6c4c4338eb4dea8cde93329c33a43db8ef6305c7151488fa8aea5dd122c55", + "loads": [ + 1, + 1, + 3, + 2, + 4, + 5, + 0, + 15, + 3, + 3, + 3, + 1, + 2, + 5, + 3, + 2, + 3, + 3, + 7, + 8, + 5, + 2, + 8, + 0, + 5, + 7, + 1, + 10, + 1, + 4, + 3, + 6, + 3, + 31, + 3, + 2, + 0, + 0, + 3, + 1, + 0, + 14, + 8, + 2, + 3, + 2, + 6, + 3, + 0, + 5, + 2, + 6, + 1, + 4, + 1, + 12, + 3, + 9, + 3, + 15, + 8, + 12, + 0, + 0 + ], + "weighted_loads": [ + 0.05152781680226326, + 0.037122197449207306, + 0.15345182735472918, + 0.12423065677285194, + 0.25708044320344925, + 0.2946000471711159, + 0.0, + 1.0360738392919302, + 0.16620495915412903, + 0.11586073040962219, + 0.14865169674158096, + 0.04508715495467186, + 0.17319931834936142, + 0.6988621428608894, + 0.2058514915406704, + 0.09523820132017136, + 0.21830370277166367, + 0.1610398218035698, + 0.5532888695597649, + 0.4359457455575466, + 0.23940956965088844, + 0.0848299153149128, + 0.9010716900229454, + 0.0, + 0.25565730780363083, + 0.326614361256361, + 0.04156868904829025, + 1.040371149778366, + 0.04606078192591667, + 0.2207387201488018, + 0.27269279956817627, + 0.34915425162762403, + 0.18373919650912285, + 3.5872018970549107, + 0.16110736317932606, + 0.08551910147070885, + 0.0, + 0.0, + 0.1972370520234108, + 0.05565951392054558, + 0.0, + 1.6371912248432636, + 0.5384289715439081, + 0.0964493677020073, + 0.18812472745776176, + 0.10616698488593102, + 0.2691478170454502, + 0.11307596229016781, + 0.0, + 0.2632668726146221, + 0.09166012704372406, + 0.2839881032705307, + 0.06715166568756104, + 0.238392673432827, + 0.10916436463594437, + 1.15283477678895, + 0.1768147125840187, + 0.5431493483483791, + 0.13647031411528587, + 0.9052373990416527, + 0.5286071188747883, + 1.0406240709125996, + 0.0, + 0.0 + ], + "unique_experts": 56, + "load_cv": 1.107633446520938, + "normalized_load_entropy": 0.8853339775525148, + "max_load_share": 0.1076388888888889 + } + }, + "s1_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "fab8f1760d09b08598ba5b428cde36255f6847afe4733dcd427df85c6146f65a", + "route_weight_sha256": "16f3dec31a50780a2e6b9f9585b5222ed2cb1153d564a0a35a495f760b62802a", + "loads": [ + 1, + 0, + 2, + 2, + 3, + 5, + 0, + 12, + 3, + 2, + 1, + 0, + 1, + 2, + 0, + 2, + 3, + 0, + 1, + 4, + 0, + 0, + 8, + 0, + 5, + 4, + 1, + 0, + 0, + 3, + 1, + 5, + 3, + 23, + 1, + 1, + 0, + 0, + 4, + 1, + 0, + 5, + 3, + 0, + 0, + 0, + 0, + 0, + 1, + 2, + 0, + 0, + 1, + 3, + 1, + 3, + 3, + 2, + 3, + 3, + 3, + 0, + 1, + 0 + ], + "weighted_loads": [ + 0.05235384404659271, + 0.0, + 0.14167959243059158, + 0.12311732023954391, + 0.22007044777274132, + 0.2940417751669884, + 0.0, + 0.9170290343463421, + 0.1689988188445568, + 0.09853554889559746, + 0.05161727964878082, + 0.0, + 0.1470360904932022, + 0.16035595536231995, + 0.0, + 0.08517046272754669, + 0.22103576734662056, + 0.0, + 0.1565840095281601, + 0.22487235069274902, + 0.0, + 0.0, + 0.9277484342455864, + 0.0, + 0.2627835012972355, + 0.22391122579574585, + 0.0397685170173645, + 0.0, + 0.0, + 0.18148131296038628, + 0.060643766075372696, + 0.33814113587141037, + 0.1801179014146328, + 3.246658980846405, + 0.1020139828324318, + 0.04737783223390579, + 0.0, + 0.0, + 0.23321367055177689, + 0.05450515076518059, + 0.0, + 0.2566760405898094, + 0.3459157571196556, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.02993021160364151, + 0.09984474256634712, + 0.0, + 0.0, + 0.0660560354590416, + 0.1680762954056263, + 0.11247957497835159, + 0.3258395195007324, + 0.1700204610824585, + 0.144326351583004, + 0.13495031371712685, + 0.11530230939388275, + 0.20481745153665543, + 0.0, + 0.03892935812473297, + 0.0 + ], + "unique_experts": 42, + "load_cv": 1.5731815632799344, + "normalized_load_entropy": 0.8072677392677697, + "max_load_share": 0.16666666666666666 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "a339f8ab00a6fb2863a930ccc378e15ab55ad14c10f80dc77acb1c1b53c8f3e0", + "route_weight_sha256": "265457a215292a20b3b31b41485660944f0a6258f317b9448db1b7d7b70df13a", + "loads": [ + 1, + 0, + 3, + 2, + 7, + 6, + 0, + 13, + 3, + 3, + 3, + 3, + 5, + 4, + 4, + 2, + 3, + 4, + 6, + 5, + 2, + 2, + 8, + 0, + 6, + 7, + 3, + 24, + 0, + 6, + 9, + 6, + 8, + 41, + 3, + 3, + 2, + 2, + 5, + 1, + 1, + 22, + 6, + 2, + 3, + 5, + 6, + 3, + 9, + 5, + 3, + 13, + 2, + 6, + 1, + 17, + 4, + 9, + 3, + 22, + 15, + 10, + 1, + 1 + ], + "weighted_loads": [ + 0.05235384404659271, + 0.0, + 0.1557710850611329, + 0.12311732023954391, + 0.42039379850029945, + 0.3293841630220413, + 0.0, + 0.9539059810340405, + 0.1689988188445568, + 0.11480782926082611, + 0.12902263179421425, + 0.17257045954465866, + 0.3469287306070328, + 0.6693052798509598, + 0.28567301109433174, + 0.08517046272754669, + 0.22103576734662056, + 0.21080181375145912, + 0.5569112077355385, + 0.2708120606839657, + 0.09381027519702911, + 0.0882425345480442, + 0.9277484342455864, + 0.0, + 0.304107490926981, + 0.5466803647577763, + 0.11008645035326481, + 1.6018546558916569, + 0.0, + 0.31452344357967377, + 0.7216447852551937, + 0.35188307520002127, + 0.673728134483099, + 4.126193407922983, + 0.24448259361088276, + 0.2118321806192398, + 0.08494311943650246, + 0.0863197073340416, + 0.27086418494582176, + 0.05450515076518059, + 0.04269063100218773, + 2.202923782169819, + 0.4393046423792839, + 0.06852002255618572, + 0.21444298699498177, + 0.2592535577714443, + 0.3274328075349331, + 0.10981710813939571, + 0.6796961948275566, + 0.30066298320889473, + 0.17931021004915237, + 0.7415795437991619, + 0.13562899082899094, + 0.32804884389042854, + 0.11247957497835159, + 1.4617568403482437, + 0.24303453415632248, + 0.5388769991695881, + 0.13495031371712685, + 1.367465402930975, + 0.9955256544053555, + 0.903436329215765, + 0.03892935812473297, + 0.03539826720952988 + ], + "unique_experts": 60, + "load_cv": 1.1361331837029984, + "normalized_load_entropy": 0.8890451615067858, + "max_load_share": 0.10677083333333333 + } + }, + "s0_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "b528689a79bbc15d179d205512952f58686f24b50ed4e264bc69af8f0e39d736", + "route_weight_sha256": "df0bcb8fc7e6b34884faf685b6698895379c370665b4de06a910f5dacc9845f1", + "loads": [ + 1, + 0, + 2, + 2, + 5, + 4, + 0, + 11, + 3, + 2, + 1, + 0, + 1, + 2, + 0, + 2, + 2, + 0, + 1, + 6, + 0, + 0, + 8, + 0, + 5, + 4, + 1, + 0, + 0, + 3, + 1, + 4, + 3, + 23, + 1, + 1, + 0, + 0, + 3, + 1, + 0, + 4, + 3, + 0, + 1, + 0, + 0, + 0, + 1, + 2, + 0, + 0, + 1, + 3, + 1, + 3, + 4, + 2, + 3, + 3, + 3, + 0, + 1, + 0 + ], + "weighted_loads": [ + 0.0626584067940712, + 0.0, + 0.144693985581398, + 0.1213010847568512, + 0.3052029237151146, + 0.260948047041893, + 0.0, + 0.8737560864537954, + 0.16062277555465698, + 0.09605352953076363, + 0.052508123219013214, + 0.0, + 0.14626939594745636, + 0.16566641628742218, + 0.0, + 0.08985824882984161, + 0.1718868464231491, + 0.0, + 0.15093116462230682, + 0.30123962834477425, + 0.0, + 0.0, + 0.9345674961805344, + 0.0, + 0.261077705770731, + 0.21791637130081654, + 0.03984896093606949, + 0.0, + 0.0, + 0.17656514421105385, + 0.06233329325914383, + 0.290106400847435, + 0.17779477313160896, + 3.054028943181038, + 0.09767955541610718, + 0.04579237848520279, + 0.0, + 0.0, + 0.19605504721403122, + 0.06482609361410141, + 0.0, + 0.21576308459043503, + 0.32267390936613083, + 0.0, + 0.04166129603981972, + 0.0, + 0.0, + 0.0, + 0.029701776802539825, + 0.09837685897946358, + 0.0, + 0.0, + 0.06335894018411636, + 0.17090855911374092, + 0.11531047523021698, + 0.3260152265429497, + 0.21992233023047447, + 0.16025234013795853, + 0.1388801448047161, + 0.1299099549651146, + 0.21357956528663635, + 0.0, + 0.03890319541096687, + 0.0 + ], + "unique_experts": 43, + "load_cv": 1.553836779607226, + "normalized_load_entropy": 0.8123221875196022, + "max_load_share": 0.16666666666666666 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "2ff5417f7fbf2338c1256f5a14be3d5788b522ffe2f1ad5158e10a6937344d4f", + "route_weight_sha256": "58958b5816a1fca6d5ccfa1fcee98ec3a647fc93029b76e133074c5b02f18c30", + "loads": [ + 1, + 1, + 3, + 2, + 5, + 4, + 0, + 16, + 3, + 3, + 3, + 1, + 2, + 4, + 2, + 2, + 2, + 4, + 6, + 7, + 4, + 2, + 8, + 0, + 5, + 6, + 1, + 7, + 1, + 4, + 3, + 5, + 3, + 32, + 2, + 2, + 0, + 0, + 3, + 1, + 0, + 13, + 7, + 2, + 5, + 3, + 7, + 3, + 1, + 5, + 3, + 8, + 1, + 4, + 1, + 11, + 4, + 10, + 3, + 15, + 8, + 13, + 1, + 0 + ], + "weighted_loads": [ + 0.0626584067940712, + 0.04674512892961502, + 0.15878547821193933, + 0.1213010847568512, + 0.3052029237151146, + 0.260948047041893, + 0.0, + 1.0870816316455603, + 0.16062277555465698, + 0.11232580989599228, + 0.14989253878593445, + 0.04508715495467186, + 0.1790020540356636, + 0.6699968837201595, + 0.14246830344200134, + 0.08985824882984161, + 0.1718868464231491, + 0.21245017275214195, + 0.48630569875240326, + 0.36638564243912697, + 0.16763020679354668, + 0.0848299153149128, + 0.9345674961805344, + 0.0, + 0.261077705770731, + 0.2816858869045973, + 0.03984896093606949, + 0.8153410889208317, + 0.04606078192591667, + 0.21835200488567352, + 0.27185405790805817, + 0.3038483401760459, + 0.17779477313160896, + 3.474858693778515, + 0.12755481526255608, + 0.08282847329974174, + 0.0, + 0.0, + 0.19605504721403122, + 0.06482609361410141, + 0.0, + 1.3682119399309158, + 0.46658394299447536, + 0.0964493677020073, + 0.24155491217970848, + 0.17820358648896217, + 0.31894415244460106, + 0.11443097330629826, + 0.029701776802539825, + 0.2231350690126419, + 0.12625712528824806, + 0.3953225687146187, + 0.06335894018411636, + 0.2416822351515293, + 0.11531047523021698, + 1.0611800216138363, + 0.21992233023047447, + 0.6123851723968983, + 0.1388801448047161, + 0.9304535277187824, + 0.5441021136939526, + 1.1277737729251385, + 0.03890319541096687, + 0.0 + ], + "unique_experts": 58, + "load_cv": 1.1145779248743821, + "normalized_load_entropy": 0.8893941709105654, + "max_load_share": 0.1111111111111111 + } + }, + "s1_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "e43360b04f48e815bf83df49db36bf9203443cfdec3fff9c4f21a483f7fd8c67", + "route_weight_sha256": "d53f271d5be7c3d2101225c2665583e7aea2721165a2797eea6bf2e98c342d28", + "loads": [ + 1, + 0, + 3, + 2, + 5, + 5, + 0, + 10, + 3, + 2, + 1, + 0, + 1, + 2, + 0, + 1, + 3, + 0, + 1, + 5, + 1, + 0, + 8, + 0, + 5, + 4, + 1, + 0, + 0, + 3, + 1, + 2, + 3, + 23, + 1, + 1, + 0, + 0, + 4, + 1, + 0, + 5, + 3, + 0, + 0, + 0, + 0, + 0, + 1, + 2, + 0, + 1, + 1, + 3, + 1, + 3, + 3, + 2, + 3, + 3, + 3, + 0, + 1, + 0 + ], + "weighted_loads": [ + 0.06136004999279976, + 0.0, + 0.192648034542799, + 0.1254163794219494, + 0.30864136293530464, + 0.28805040940642357, + 0.0, + 0.8086397778242826, + 0.1645849496126175, + 0.09546567872166634, + 0.05342662334442139, + 0.0, + 0.15386807918548584, + 0.16565977036952972, + 0.0, + 0.04712015017867088, + 0.21321607753634453, + 0.0, + 0.148527130484581, + 0.25294462218880653, + 0.04406273737549782, + 0.0, + 0.9290582351386547, + 0.0, + 0.27576756477355957, + 0.2344953827559948, + 0.04102634638547897, + 0.0, + 0.0, + 0.18900241330266, + 0.06335202604532242, + 0.19363552331924438, + 0.1756235659122467, + 2.9590882062911987, + 0.09265431761741638, + 0.046009551733732224, + 0.0, + 0.0, + 0.25628188624978065, + 0.06475378572940826, + 0.0, + 0.25230715423822403, + 0.3216883912682533, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.03073747828602791, + 0.09569792076945305, + 0.0, + 0.0357012040913105, + 0.06420251727104187, + 0.17266583442687988, + 0.10755555331707001, + 0.3050495386123657, + 0.15923969447612762, + 0.1483045481145382, + 0.14098982140421867, + 0.12891916930675507, + 0.21339626610279083, + 0.0, + 0.039333194494247437, + 0.0 + ], + "unique_experts": 44, + "load_cv": 1.5342481038855524, + "normalized_load_entropy": 0.8171598027766387, + "max_load_share": 0.16666666666666666 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "999e40bd914fab31b83d7e46346c76ec79734b3c6909aba1f6935d863cf3f015", + "route_weight_sha256": "fbfd5bb3b218da058e05d93a111bbd78fad239ca42774f95ec73e0193abbb66c", + "loads": [ + 2, + 1, + 4, + 2, + 9, + 6, + 0, + 12, + 3, + 3, + 4, + 3, + 5, + 3, + 4, + 1, + 3, + 5, + 5, + 5, + 2, + 2, + 8, + 0, + 6, + 7, + 3, + 20, + 0, + 6, + 10, + 3, + 8, + 41, + 3, + 3, + 2, + 2, + 5, + 1, + 1, + 21, + 6, + 2, + 2, + 6, + 7, + 4, + 9, + 5, + 5, + 15, + 2, + 5, + 1, + 15, + 4, + 10, + 3, + 22, + 14, + 11, + 1, + 1 + ], + "weighted_loads": [ + 0.11586152389645576, + 0.04984336718916893, + 0.20673952717334032, + 0.1254163794219494, + 0.5089647136628628, + 0.31691044569015503, + 0.0, + 0.8945052903145552, + 0.1645849496126175, + 0.11173795908689499, + 0.17956315353512764, + 0.17257045954465866, + 0.3537607192993164, + 0.6350642889738083, + 0.2793458327651024, + 0.04712015017867088, + 0.21321607753634453, + 0.2631976045668125, + 0.47391972690820694, + 0.25294462218880653, + 0.08489462733268738, + 0.0882425345480442, + 0.9290582351386547, + 0.0, + 0.31709155440330505, + 0.5572645217180252, + 0.11134427972137928, + 1.3369119726121426, + 0.0, + 0.3220445439219475, + 0.8070345558226109, + 0.20737746264785528, + 0.6692337989807129, + 3.8563577383756638, + 0.23512292839586735, + 0.21046390011906624, + 0.08494311943650246, + 0.0863197073340416, + 0.29393240064382553, + 0.06475378572940826, + 0.04269063100218773, + 1.7349961549043655, + 0.4062786400318146, + 0.06852002255618572, + 0.14175746217370033, + 0.32356711104512215, + 0.39406101778149605, + 0.15229842998087406, + 0.680503461509943, + 0.27253175526857376, + 0.25956089422106743, + 0.8836235553026199, + 0.1337754726409912, + 0.2770894952118397, + 0.10755555331707001, + 1.253721009939909, + 0.2322537675499916, + 0.5945009849965572, + 0.14098982140421867, + 1.3353805020451546, + 0.9674086607992649, + 0.9885977618396282, + 0.039333194494247437, + 0.03539826720952988 + ], + "unique_experts": 61, + "load_cv": 1.1012146072002091, + "normalized_load_entropy": 0.8948885440275415, + "max_load_share": 0.10677083333333333 + } + }, + "s0_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "c3a76c4a574a63bb8d050da12321ad5fd9af85e4ee0c0df80cd2fa307dbae98d", + "route_weight_sha256": "43cf37df4e690fb2b43569ba6b3f0d1f57cdbec9960d06786b02af4453210752", + "loads": [ + 1, + 0, + 2, + 2, + 3, + 5, + 0, + 11, + 3, + 2, + 1, + 0, + 1, + 2, + 0, + 2, + 2, + 0, + 1, + 6, + 0, + 0, + 8, + 0, + 5, + 4, + 1, + 0, + 0, + 3, + 1, + 4, + 3, + 23, + 1, + 1, + 0, + 0, + 3, + 1, + 0, + 5, + 3, + 0, + 1, + 0, + 0, + 0, + 1, + 2, + 0, + 1, + 1, + 3, + 1, + 3, + 4, + 2, + 3, + 3, + 3, + 0, + 0, + 0 + ], + "weighted_loads": [ + 0.06160121038556099, + 0.0, + 0.14017226919531822, + 0.12454531341791153, + 0.22118575870990753, + 0.2797101177275181, + 0.0, + 0.8682487644255161, + 0.16110419481992722, + 0.09886500984430313, + 0.05228719860315323, + 0.0, + 0.14629673957824707, + 0.1670498624444008, + 0.0, + 0.09190597757697105, + 0.17161397635936737, + 0.0, + 0.15196095407009125, + 0.3064094390720129, + 0.0, + 0.0, + 0.9453830346465111, + 0.0, + 0.26098548993468285, + 0.2336171790957451, + 0.040315017104148865, + 0.0, + 0.0, + 0.17536715045571327, + 0.059639763087034225, + 0.2908238023519516, + 0.17637236788868904, + 3.0740173533558846, + 0.09807714074850082, + 0.04571424424648285, + 0.0, + 0.0, + 0.19724833220243454, + 0.061698444187641144, + 0.0, + 0.2645949684083462, + 0.32130956649780273, + 0.0, + 0.04100172221660614, + 0.0, + 0.0, + 0.0, + 0.0287560373544693, + 0.10001496225595474, + 0.0, + 0.03487986698746681, + 0.06428465992212296, + 0.17278137058019638, + 0.112825408577919, + 0.32377205044031143, + 0.2097705639898777, + 0.16074257344007492, + 0.14057298004627228, + 0.12951860949397087, + 0.21429493278265, + 0.0, + 0.0, + 0.0 + ], + "unique_experts": 43, + "load_cv": 1.5559980767027937, + "normalized_load_entropy": 0.8118819363401332, + "max_load_share": 0.16666666666666666 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "34da85d43fd44250e4b9bd639e677e1f1ccbb0122d3dc7452232db1b5dca2914", + "route_weight_sha256": "47924a57f91b479619999d014f9a8dd3af8c8ced94a4c477ea3203b7a70509fe", + "loads": [ + 2, + 1, + 3, + 2, + 3, + 5, + 0, + 15, + 3, + 3, + 3, + 1, + 3, + 4, + 2, + 2, + 2, + 3, + 6, + 7, + 4, + 2, + 8, + 0, + 5, + 6, + 1, + 8, + 1, + 4, + 4, + 5, + 3, + 31, + 2, + 2, + 0, + 0, + 3, + 1, + 0, + 15, + 7, + 2, + 4, + 3, + 6, + 3, + 1, + 5, + 3, + 8, + 1, + 4, + 1, + 11, + 4, + 10, + 3, + 16, + 9, + 12, + 0, + 0 + ], + "weighted_loads": [ + 0.09353473037481308, + 0.03738785907626152, + 0.15426376182585955, + 0.12454531341791153, + 0.22118575870990753, + 0.2797101177275181, + 0.0, + 1.0429403334856033, + 0.16110419481992722, + 0.11513729020953178, + 0.14967161417007446, + 0.04508715495467186, + 0.21547375991940498, + 0.6713803298771381, + 0.14479674026370049, + 0.09190597757697105, + 0.17161397635936737, + 0.18562602996826172, + 0.4873354882001877, + 0.3715554531663656, + 0.16763020679354668, + 0.0848299153149128, + 0.9453830346465111, + 0.0, + 0.26098548993468285, + 0.29738669469952583, + 0.040315017104148865, + 0.8470957055687904, + 0.04606078192591667, + 0.21715401113033295, + 0.34650251641869545, + 0.3045657416805625, + 0.17637236788868904, + 3.4501647166907787, + 0.12795240059494972, + 0.0827503390610218, + 0.0, + 0.0, + 0.19724833220243454, + 0.061698444187641144, + 0.0, + 1.5052645616233349, + 0.4649862553924322, + 0.0964493677020073, + 0.19954510405659676, + 0.14970597252249718, + 0.2691478170454502, + 0.11327551864087582, + 0.0287560373544693, + 0.24224677123129368, + 0.12175473943352699, + 0.43299372866749763, + 0.06428465992212296, + 0.24392642080783844, + 0.112825408577919, + 1.0944508388638496, + 0.2097705639898777, + 0.624873910099268, + 0.14057298004627228, + 0.980770405381918, + 0.5949835367500782, + 1.0406240709125996, + 0.0, + 0.0 + ], + "unique_experts": 57, + "load_cv": 1.1069366025095153, + "normalized_load_entropy": 0.8884521410890968, + "max_load_share": 0.1076388888888889 + } + }, + "s1_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "80966b54fd6c615fa8aa285b356e3f63c8013952a34b1e3404494180159aeb19", + "route_weight_sha256": "4601bd0e33d31d6ba134c9828d61aaf79f105d0c44b2450ace6232f0a4160990", + "loads": [ + 1, + 0, + 3, + 2, + 4, + 4, + 0, + 11, + 3, + 2, + 1, + 0, + 1, + 2, + 0, + 1, + 3, + 0, + 1, + 8, + 0, + 0, + 7, + 0, + 5, + 4, + 1, + 0, + 0, + 3, + 1, + 3, + 3, + 23, + 1, + 1, + 0, + 0, + 4, + 1, + 0, + 4, + 3, + 0, + 0, + 0, + 0, + 1, + 1, + 2, + 0, + 1, + 1, + 3, + 1, + 3, + 2, + 2, + 3, + 3, + 3, + 0, + 1, + 0 + ], + "weighted_loads": [ + 0.06003188714385033, + 0.0, + 0.1913934163749218, + 0.12594963610172272, + 0.2516229674220085, + 0.239948071539402, + 0.0, + 0.8474830090999603, + 0.16174474358558655, + 0.097238440066576, + 0.054364390671253204, + 0.0, + 0.1550266146659851, + 0.16961700469255447, + 0.0, + 0.04691196233034134, + 0.21635304763913155, + 0.0, + 0.14882364869117737, + 0.4092045780271292, + 0.0, + 0.0, + 0.8876024857163429, + 0.0, + 0.27242232859134674, + 0.22987446561455727, + 0.040430814027786255, + 0.0, + 0.0, + 0.182963065803051, + 0.060560520738363266, + 0.23773925006389618, + 0.166383296251297, + 2.9600278213620186, + 0.09640582650899887, + 0.046174630522727966, + 0.0, + 0.0, + 0.24514509364962578, + 0.06217190995812416, + 0.0, + 0.2091957964003086, + 0.31608062610030174, + 0.0, + 0.0, + 0.0, + 0.0, + 0.03360491245985031, + 0.03158725053071976, + 0.09696875512599945, + 0.0, + 0.04007955268025398, + 0.061151888221502304, + 0.17515884339809418, + 0.10457730293273926, + 0.2995166480541229, + 0.1126885935664177, + 0.1491660736501217, + 0.14238090813159943, + 0.1208265833556652, + 0.2139464095234871, + 0.0, + 0.03956175222992897, + 0.0 + ], + "unique_experts": 44, + "load_cv": 1.553836779607226, + "normalized_load_entropy": 0.8146871102491112, + "max_load_share": 0.16666666666666666 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "823458728d6052e1d2a4de35428fe5affa53f229a269f9eb43dc9069f1d183d5", + "route_weight_sha256": "bfa3bdf814099cdbf316ce2be002231da62cda6ca3d49a3ba622150594ef9bd9", + "loads": [ + 2, + 0, + 4, + 3, + 8, + 4, + 0, + 12, + 3, + 3, + 3, + 3, + 5, + 3, + 4, + 1, + 3, + 5, + 5, + 8, + 1, + 2, + 7, + 0, + 6, + 7, + 3, + 20, + 0, + 6, + 11, + 4, + 8, + 40, + 3, + 3, + 2, + 2, + 5, + 1, + 1, + 21, + 6, + 2, + 2, + 6, + 6, + 4, + 9, + 6, + 3, + 16, + 2, + 6, + 1, + 16, + 3, + 10, + 3, + 23, + 15, + 11, + 1, + 1 + ], + "weighted_loads": [ + 0.11207177489995956, + 0.0, + 0.20548490900546312, + 0.18331169337034225, + 0.45194631814956665, + 0.239948071539402, + 0.0, + 0.8843599557876587, + 0.16174474358558655, + 0.11351072043180466, + 0.13176974281668663, + 0.17257045954465866, + 0.3549192547798157, + 0.639021523296833, + 0.25822870433330536, + 0.04691196233034134, + 0.21635304763913155, + 0.3155890293419361, + 0.4742162451148033, + 0.4092045780271292, + 0.04083188995718956, + 0.0882425345480442, + 0.8876024857163429, + 0.0, + 0.3137463182210922, + 0.5526436045765877, + 0.11074874736368656, + 1.352153453975916, + 0.0, + 0.3160051964223385, + 0.9115662984549999, + 0.2514811893925071, + 0.6599935293197632, + 3.8025075048208237, + 0.23887443728744984, + 0.21062897890806198, + 0.08494311943650246, + 0.0863197073340416, + 0.28279560804367065, + 0.06217190995812416, + 0.04269063100218773, + 1.7406660616397858, + 0.39657463878393173, + 0.06852002255618572, + 0.14175746217370033, + 0.29567600786685944, + 0.3274328075349331, + 0.1416120994836092, + 0.6813532337546349, + 0.30154706351459026, + 0.17931021004915237, + 0.9627578221261501, + 0.13072484359145164, + 0.31959301978349686, + 0.10457730293273926, + 1.2973716482520103, + 0.18570266664028168, + 0.6766609326004982, + 0.14238090813159943, + 1.3604609072208405, + 1.0057069025933743, + 0.9526755213737488, + 0.03956175222992897, + 0.03539826720952988 + ], + "unique_experts": 60, + "load_cv": 1.1110243021644486, + "normalized_load_entropy": 0.8903762238873234, + "max_load_share": 0.10416666666666667 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "ordered_topk_exact_tokens": 17, + "set_exact_tokens": 18, + "mean_set_jaccard": 0.9378881987577641, + "mean_token_weighted_tv": 0.015155013407702032, + "aggregate_load_tv": 0.036231884057971016 + }, + "system_bos": { + "tokens": 23, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.9254658385093167, + "mean_token_weighted_tv": 0.019752263455935146, + "aggregate_load_tv": 0.036231884057971016 + }, + "system_x": { + "tokens": 23, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 13, + "mean_set_jaccard": 0.8664596273291925, + "mean_token_weighted_tv": 0.030579765003336513, + "aggregate_load_tv": 0.05072463768115941 + }, + "system_period": { + "tokens": 23, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.8913043478260869, + "mean_token_weighted_tv": 0.02923134892531063, + "aggregate_load_tv": 0.05797101449275363 + }, + "bos_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.9006211180124224, + "mean_token_weighted_tv": 0.024523377418518066, + "aggregate_load_tv": 0.043478260869565216 + }, + "bos_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8881987577639753, + "mean_token_weighted_tv": 0.026386784227645916, + "aggregate_load_tv": 0.04347826086956522 + }, + "x_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 13, + "mean_set_jaccard": 0.8664596273291925, + "mean_token_weighted_tv": 0.03372505266705285, + "aggregate_load_tv": 0.050724637681159424 + }, + "x_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8881987577639753, + "mean_token_weighted_tv": 0.03511071387354447, + "aggregate_load_tv": 0.050724637681159424 + }, + "period_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8788819875776398, + "mean_token_weighted_tv": 0.03288560955906692, + "aggregate_load_tv": 0.05072463768115942 + }, + "period_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 13, + "mean_set_jaccard": 0.875776397515528, + "mean_token_weighted_tv": 0.036642537533265095, + "aggregate_load_tv": 0.05797101449275363 + } + } + }, + "layer_11": { + "layer": 11, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "8aeaa5ebb55ff4169f5ee4e71cdc13390cdb68ac683069616ec4915b73f8b151", + "route_weight_sha256": "6bfbccd89810e1c10a350ce77dfefbf208199be62f829948bd6660bd6d8b6630", + "loads": [ + 2, + 2, + 0, + 5, + 0, + 0, + 0, + 1, + 3, + 0, + 2, + 2, + 0, + 2, + 0, + 1, + 8, + 3, + 1, + 0, + 1, + 2, + 2, + 2, + 0, + 1, + 9, + 0, + 0, + 3, + 0, + 1, + 5, + 6, + 0, + 1, + 0, + 0, + 2, + 0, + 8, + 10, + 4, + 0, + 1, + 0, + 1, + 1, + 0, + 4, + 0, + 1, + 3, + 0, + 6, + 4, + 5, + 6, + 0, + 9, + 1, + 3, + 3, + 1 + ], + "weighted_loads": [ + 0.1133204996585846, + 0.08240669220685959, + 0.0, + 0.3444647379219532, + 0.0, + 0.0, + 0.0, + 0.04788200184702873, + 0.17501261085271835, + 0.0, + 0.07996924221515656, + 0.14615349099040031, + 0.0, + 0.12564469873905182, + 0.0, + 0.08855508267879486, + 0.3951490670442581, + 0.34874046966433525, + 0.08353803306818008, + 0.0, + 0.04954950138926506, + 0.1450720950961113, + 0.17039308324456215, + 0.15874015167355537, + 0.0, + 0.050665631890296936, + 0.5897918827831745, + 0.0, + 0.0, + 0.13990234211087227, + 0.0, + 0.08125409483909607, + 0.23985471576452255, + 0.37354690954089165, + 0.0, + 0.03911524638533592, + 0.0, + 0.0, + 0.08110152930021286, + 0.0, + 0.5472066625952721, + 0.6500491052865982, + 0.22295402735471725, + 0.0, + 0.08898699283599854, + 0.0, + 0.10390414297580719, + 0.033107906579971313, + 0.0, + 0.16305002942681313, + 0.0, + 0.032726116478443146, + 0.16042612865567207, + 0.0, + 0.29230349510908127, + 0.1816498152911663, + 0.27051104977726936, + 0.5677418075501919, + 0.0, + 0.8043105751276016, + 0.03756985813379288, + 0.2833179607987404, + 0.11629360541701317, + 0.0454709418118 + ], + "unique_experts": 42, + "load_cv": 1.197122503938086, + "normalized_load_entropy": 0.8343126480812563, + "max_load_share": 0.07246376811594203 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "0ccf59c740598a904c1fa8fe81d0e9438df83557f51f9725749f48745a5b032b", + "route_weight_sha256": "6c0b5d49565b9156888dc71d9f89a097f6c506e6766f076467776622c2782e54", + "loads": [ + 2, + 4, + 1, + 5, + 6, + 0, + 0, + 1, + 8, + 1, + 5, + 5, + 0, + 2, + 0, + 7, + 14, + 5, + 13, + 0, + 1, + 2, + 3, + 8, + 0, + 1, + 10, + 1, + 7, + 3, + 6, + 8, + 6, + 6, + 4, + 3, + 0, + 0, + 2, + 0, + 17, + 10, + 4, + 23, + 4, + 0, + 1, + 9, + 0, + 5, + 0, + 1, + 3, + 0, + 11, + 6, + 5, + 6, + 3, + 9, + 1, + 7, + 12, + 1 + ], + "weighted_loads": [ + 0.1133204996585846, + 0.16765370592474937, + 0.059370964765548706, + 0.3444647379219532, + 0.2644323818385601, + 0.0, + 0.0, + 0.04788200184702873, + 0.4198787175118923, + 0.030617941170930862, + 0.15209769690409303, + 0.20008875709027052, + 0.0, + 0.12564469873905182, + 0.0, + 0.3213922716677189, + 0.9905038513243198, + 0.3785909013822675, + 2.160585641860962, + 0.0, + 0.04954950138926506, + 0.1450720950961113, + 0.17433110205456614, + 0.43822373263537884, + 0.0, + 0.050665631890296936, + 0.5931502333842218, + 0.012540847063064575, + 0.4883144535124302, + 0.13990234211087227, + 0.29461032152175903, + 0.40136972442269325, + 0.2745206244289875, + 0.37354690954089165, + 0.1760234497487545, + 0.17887183651328087, + 0.0, + 0.0, + 0.08110152930021286, + 0.0, + 1.090304397046566, + 0.6500491052865982, + 0.22295402735471725, + 2.4071820862591267, + 0.24774492904543877, + 0.0, + 0.10390414297580719, + 0.6192291602492332, + 0.0, + 0.21941400319337845, + 0.0, + 0.032726116478443146, + 0.16042612865567207, + 0.0, + 0.5842111324891448, + 0.28059937059879303, + 0.27051104977726936, + 0.5677418075501919, + 0.13448286429047585, + 0.8043105751276016, + 0.03756985813379288, + 0.46063748747110367, + 0.6364186108112335, + 0.0454709418118 + ], + "unique_experts": 51, + "load_cv": 1.022131638498561, + "normalized_load_entropy": 0.8773061506922429, + "max_load_share": 0.0798611111111111 + } + }, + "s1_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "0d9afd230f73bde4dd3f391f1db5b46feb5c5a62453f97c1770fa8e3210ba100", + "route_weight_sha256": "343b19bee6bdcf6d2431306131e60b96bdaf0ef901fe8564207f268ec4787251", + "loads": [ + 2, + 1, + 0, + 4, + 0, + 0, + 0, + 1, + 3, + 0, + 2, + 2, + 0, + 2, + 0, + 1, + 8, + 3, + 1, + 0, + 1, + 2, + 2, + 2, + 0, + 1, + 9, + 0, + 0, + 3, + 0, + 1, + 6, + 6, + 0, + 1, + 0, + 0, + 2, + 0, + 8, + 10, + 4, + 0, + 1, + 0, + 1, + 1, + 0, + 4, + 0, + 2, + 3, + 0, + 6, + 3, + 6, + 7, + 0, + 9, + 1, + 3, + 3, + 0 + ], + "weighted_loads": [ + 0.11364682763814926, + 0.04403352364897728, + 0.0, + 0.29859379678964615, + 0.0, + 0.0, + 0.0, + 0.04687908664345741, + 0.17577167227864265, + 0.0, + 0.08324398472905159, + 0.14101780578494072, + 0.0, + 0.12489696219563484, + 0.0, + 0.08392488956451416, + 0.3917854577302933, + 0.3441987782716751, + 0.08511099964380264, + 0.0, + 0.04886521399021149, + 0.1386343017220497, + 0.16899314522743225, + 0.1620064526796341, + 0.0, + 0.04930760711431503, + 0.5811812505126, + 0.0, + 0.0, + 0.14028549566864967, + 0.0, + 0.0783250480890274, + 0.28757015243172646, + 0.37312933802604675, + 0.0, + 0.03824587166309357, + 0.0, + 0.0, + 0.08153800666332245, + 0.0, + 0.5442817062139511, + 0.6162511557340622, + 0.22698470205068588, + 0.0, + 0.08825302869081497, + 0.0, + 0.10387758910655975, + 0.033809155225753784, + 0.0, + 0.1667441390454769, + 0.0, + 0.07456148788332939, + 0.16515888273715973, + 0.0, + 0.28709588944911957, + 0.13697705417871475, + 0.32823551446199417, + 0.582449845969677, + 0.0, + 0.7887823805212975, + 0.03703680634498596, + 0.2779654674232006, + 0.11064542643725872, + 0.0 + ], + "unique_experts": 41, + "load_cv": 1.222126745807789, + "normalized_load_entropy": 0.8281686558861074, + "max_load_share": 0.07246376811594203 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "f84a6956095b7af1c7cb0b9c8734f7983d7822437c351ae59b92f4e31563b024", + "route_weight_sha256": "2f892067b36d4b19ae313b864391f10657ae83551bbd42c592fc4e5823bacf1e", + "loads": [ + 4, + 3, + 1, + 4, + 10, + 4, + 0, + 3, + 12, + 0, + 6, + 5, + 0, + 2, + 0, + 2, + 27, + 5, + 12, + 1, + 2, + 3, + 5, + 7, + 0, + 1, + 12, + 2, + 11, + 3, + 9, + 7, + 7, + 6, + 4, + 5, + 0, + 0, + 2, + 1, + 17, + 10, + 4, + 27, + 3, + 0, + 2, + 15, + 0, + 7, + 0, + 2, + 3, + 5, + 27, + 11, + 12, + 8, + 2, + 13, + 2, + 11, + 14, + 1 + ], + "weighted_loads": [ + 0.26093707978725433, + 0.13096317648887634, + 0.045626554638147354, + 0.29859379678964615, + 0.5498219504952431, + 0.14104371890425682, + 0.0, + 0.17643963918089867, + 0.6881282702088356, + 0.0, + 0.19800131721422076, + 0.19427100103348494, + 0.0, + 0.12489696219563484, + 0.0, + 0.12410541996359825, + 2.0861514024436474, + 0.3731775190681219, + 2.1646678596735, + 0.03820555657148361, + 0.12189573049545288, + 0.2090560719370842, + 0.28490587836131454, + 0.3821639083325863, + 0.0, + 0.04930760711431503, + 0.6616900940425694, + 0.05121370404958725, + 0.8109111227095127, + 0.14028549566864967, + 0.4580333363264799, + 0.3499465025961399, + 0.3207097016274929, + 0.37312933802604675, + 0.20460116118192673, + 0.3849864490330219, + 0.0, + 0.0, + 0.08153800666332245, + 0.046665798872709274, + 1.058331735432148, + 0.6162511557340622, + 0.22698470205068588, + 2.6948860362172127, + 0.2217346392571926, + 0.0, + 0.14952582493424416, + 1.0826940387487411, + 0.0, + 0.38533859327435493, + 0.0, + 0.07456148788332939, + 0.16515888273715973, + 0.3037366718053818, + 1.5766520043835044, + 0.5166635289788246, + 0.8001401163637638, + 0.6262057051062584, + 0.10422240197658539, + 0.943253131583333, + 0.07425867021083832, + 0.6320837624371052, + 0.6676727030426264, + 0.03274724632501602 + ], + "unique_experts": 54, + "load_cv": 1.0651519192636847, + "normalized_load_entropy": 0.8778517597872626, + "max_load_share": 0.0703125 + } + }, + "s0_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "db0af593cabe56440cd47803259bd6e9ab170f4810da80c0d8dece71d83ceaeb", + "route_weight_sha256": "e1dc261111f281e36838ca57289f5b8f842e4206157d786c9133fbc604badff3", + "loads": [ + 3, + 1, + 0, + 5, + 0, + 0, + 0, + 1, + 3, + 0, + 1, + 2, + 0, + 2, + 0, + 1, + 7, + 3, + 1, + 0, + 1, + 2, + 2, + 2, + 0, + 1, + 9, + 0, + 0, + 4, + 0, + 1, + 4, + 8, + 0, + 0, + 0, + 0, + 2, + 0, + 8, + 10, + 4, + 0, + 1, + 0, + 1, + 1, + 0, + 3, + 0, + 1, + 3, + 0, + 6, + 3, + 5, + 7, + 0, + 9, + 1, + 4, + 4, + 1 + ], + "weighted_loads": [ + 0.14929420873522758, + 0.047075897455215454, + 0.0, + 0.33485567197203636, + 0.0, + 0.0, + 0.0, + 0.044165655970573425, + 0.17084284871816635, + 0.0, + 0.049092844128608704, + 0.141388401389122, + 0.0, + 0.12566256895661354, + 0.0, + 0.08655329793691635, + 0.3644287660717964, + 0.3601794168353081, + 0.09081839770078659, + 0.0, + 0.04968344047665596, + 0.1434401050209999, + 0.1613631211221218, + 0.1572084128856659, + 0.0, + 0.05025014653801918, + 0.600650068372488, + 0.0, + 0.0, + 0.18326107412576675, + 0.0, + 0.07922235131263733, + 0.1856229603290558, + 0.45180582627654076, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0810835100710392, + 0.0, + 0.5657808631658554, + 0.6630128175020218, + 0.22986170276999474, + 0.0, + 0.0869048610329628, + 0.0, + 0.10009045153856277, + 0.036769408732652664, + 0.0, + 0.13053391873836517, + 0.0, + 0.031982190907001495, + 0.15359308570623398, + 0.0, + 0.2960233502089977, + 0.14018593728542328, + 0.27359510213136673, + 0.5918262824416161, + 0.0, + 0.8425347693264484, + 0.036315351724624634, + 0.319054514169693, + 0.14971295185387135, + 0.0456693060696125 + ], + "unique_experts": 41, + "load_cv": 1.2276140830505375, + "normalized_load_entropy": 0.8262525292096188, + "max_load_share": 0.07246376811594203 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "c9462c09ef57f0fe0c22a9957ad1692a3ee43a68ac6e8ef95f91703e59394c33", + "route_weight_sha256": "fda7dbc539eda7445a9989fe3a35b0ec9384f6dd793c5e9c889ac9c943ff5c1b", + "loads": [ + 3, + 4, + 1, + 5, + 5, + 0, + 0, + 1, + 7, + 1, + 3, + 4, + 0, + 2, + 0, + 9, + 14, + 4, + 12, + 0, + 1, + 2, + 2, + 8, + 0, + 1, + 9, + 2, + 4, + 4, + 6, + 9, + 5, + 8, + 4, + 2, + 0, + 0, + 2, + 0, + 18, + 10, + 4, + 24, + 4, + 0, + 1, + 9, + 0, + 4, + 0, + 1, + 3, + 0, + 10, + 6, + 5, + 7, + 3, + 9, + 1, + 11, + 13, + 1 + ], + "weighted_loads": [ + 0.14929420873522758, + 0.16207490488886833, + 0.059370964765548706, + 0.33485567197203636, + 0.22382423654198647, + 0.0, + 0.0, + 0.044165655970573425, + 0.367309994995594, + 0.030617941170930862, + 0.11610490456223488, + 0.18325105402618647, + 0.0, + 0.12566256895661354, + 0.0, + 0.39342012628912926, + 1.0517596937716007, + 0.37499671056866646, + 1.271864965558052, + 0.0, + 0.04968344047665596, + 0.1434401050209999, + 0.1613631211221218, + 0.43669199384748936, + 0.0, + 0.05025014653801918, + 0.600650068372488, + 0.05937791243195534, + 0.347451850771904, + 0.18326107412576675, + 0.29461032152175903, + 0.5007209666073322, + 0.22028886899352074, + 0.45180582627654076, + 0.16983188688755035, + 0.1411493830382824, + 0.0, + 0.0, + 0.0810835100710392, + 0.0, + 1.2031907364726067, + 0.6630128175020218, + 0.22986170276999474, + 2.4810464717447758, + 0.24566279724240303, + 0.0, + 0.10009045153856277, + 0.5860601626336575, + 0.0, + 0.1868978925049305, + 0.0, + 0.031982190907001495, + 0.15359308570623398, + 0.0, + 0.5552669940516353, + 0.2716543823480606, + 0.27359510213136673, + 0.5918262824416161, + 0.13448286429047585, + 0.8425347693264484, + 0.036315351724624634, + 0.6252146009355783, + 0.6911545675247908, + 0.0456693060696125 + ], + "unique_experts": 51, + "load_cv": 1.0577462647033207, + "normalized_load_entropy": 0.8729703990320019, + "max_load_share": 0.08333333333333333 + } + }, + "s1_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "922f4e38f17c45e630d82d90826e2d5320fa07136c8cca8e363731fb266eb276", + "route_weight_sha256": "744a92225b3e67ddfad37c1cecc0a543a4c5724d6ec2f756b8a93ab8b199b6cc", + "loads": [ + 2, + 1, + 0, + 5, + 0, + 0, + 1, + 1, + 3, + 0, + 1, + 2, + 0, + 2, + 0, + 1, + 7, + 3, + 1, + 0, + 1, + 2, + 3, + 2, + 0, + 1, + 9, + 0, + 0, + 4, + 0, + 1, + 4, + 7, + 0, + 1, + 0, + 0, + 2, + 0, + 8, + 10, + 5, + 0, + 1, + 0, + 1, + 1, + 0, + 4, + 0, + 1, + 3, + 0, + 6, + 3, + 6, + 7, + 0, + 9, + 1, + 3, + 2, + 0 + ], + "weighted_loads": [ + 0.11704253405332565, + 0.044187452644109726, + 0.0, + 0.3258810117840767, + 0.0, + 0.0, + 0.034898869693279266, + 0.045086272060871124, + 0.17290282621979713, + 0.0, + 0.05268016457557678, + 0.14132120460271835, + 0.0, + 0.12354829907417297, + 0.0, + 0.08246327191591263, + 0.346300695091486, + 0.3666473478078842, + 0.09345609694719315, + 0.0, + 0.04940725490450859, + 0.1438094973564148, + 0.19007042422890663, + 0.162737175822258, + 0.0, + 0.05000779405236244, + 0.5728551410138607, + 0.0, + 0.0, + 0.18468733131885529, + 0.0, + 0.0736706480383873, + 0.19405018165707588, + 0.4185039550065994, + 0.0, + 0.03960036113858223, + 0.0, + 0.0, + 0.08124637976288795, + 0.0, + 0.5604518316686153, + 0.6414916887879372, + 0.26122307404875755, + 0.0, + 0.0779755711555481, + 0.0, + 0.10505501925945282, + 0.03549151495099068, + 0.0, + 0.1620664745569229, + 0.0, + 0.040010273456573486, + 0.16751056537032127, + 0.0, + 0.28861255571246147, + 0.13381768390536308, + 0.3480389639735222, + 0.5858863368630409, + 0.0, + 0.806806206703186, + 0.03618955984711647, + 0.28771957755088806, + 0.08469458296895027, + 0.0 + ], + "unique_experts": 42, + "load_cv": 1.2193738170782975, + "normalized_load_entropy": 0.829680959815017, + "max_load_share": 0.07246376811594203 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "7de9bac01caa96660c48adb449d710a0d37f3a5488c829d058d7b7c1fe153ed4", + "route_weight_sha256": "377423c53f58a39046b8404c5f16719780fc998b3565f7ff796b30301505b7cb", + "loads": [ + 4, + 3, + 1, + 5, + 10, + 4, + 1, + 3, + 11, + 1, + 4, + 4, + 0, + 2, + 0, + 2, + 27, + 4, + 11, + 1, + 2, + 3, + 5, + 7, + 0, + 1, + 11, + 2, + 10, + 4, + 9, + 7, + 5, + 7, + 4, + 5, + 0, + 0, + 2, + 1, + 18, + 10, + 5, + 28, + 3, + 0, + 2, + 16, + 0, + 7, + 0, + 1, + 3, + 5, + 26, + 12, + 12, + 8, + 2, + 13, + 2, + 13, + 14, + 1 + ], + "weighted_loads": [ + 0.2643327862024307, + 0.1285337693989277, + 0.045626554638147354, + 0.3258810117840767, + 0.5498219504952431, + 0.14104371890425682, + 0.034898869693279266, + 0.17464682459831238, + 0.6351486966013908, + 0.033418335020542145, + 0.16230566427111626, + 0.18319135252386332, + 0.0, + 0.12354829907417297, + 0.0, + 0.12264380231499672, + 2.158849846571684, + 0.3814646415412426, + 1.2747055143117905, + 0.03820555657148361, + 0.12243777140974998, + 0.21423126757144928, + 0.3022151552140713, + 0.3828946314752102, + 0.0, + 0.05000779405236244, + 0.6501968950033188, + 0.05121370404958725, + 0.7132245972752571, + 0.18468733131885529, + 0.4580333363264799, + 0.3452921025454998, + 0.22718973085284233, + 0.4185039550065994, + 0.19479265436530113, + 0.3902306817471981, + 0.0, + 0.0, + 0.08124637976288795, + 0.046665798872709274, + 1.150704838335514, + 0.6414916887879372, + 0.26122307404875755, + 2.9498427771031857, + 0.21145718172192574, + 0.0, + 0.15070325508713722, + 1.0805036239326, + 0.0, + 0.38066092878580093, + 0.0, + 0.040010273456573486, + 0.16751056537032127, + 0.3037366718053818, + 1.5568101918324828, + 0.553039439022541, + 0.8199435658752918, + 0.6296421959996223, + 0.10422240197658539, + 0.9612769577652216, + 0.07341142371296883, + 0.7325983382761478, + 0.6745471060276031, + 0.03274724632501602 + ], + "unique_experts": 56, + "load_cv": 1.0700305031996882, + "normalized_load_entropy": 0.8795258186440109, + "max_load_share": 0.07291666666666667 + } + }, + "s0_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "1a2d4fef2f3af9cbadbb493f9d697ff8cab62ebf85ed348819f5a7fd9a847c15", + "route_weight_sha256": "a3ac94913065c7e7ae231a2f7fbc1939b5dcab38665128e7ea9f7e53c75c9f56", + "loads": [ + 2, + 1, + 0, + 4, + 0, + 0, + 0, + 1, + 3, + 0, + 1, + 2, + 0, + 2, + 0, + 1, + 8, + 3, + 1, + 0, + 1, + 2, + 2, + 2, + 0, + 1, + 10, + 0, + 0, + 4, + 1, + 1, + 4, + 7, + 0, + 1, + 0, + 0, + 1, + 0, + 8, + 10, + 4, + 0, + 1, + 0, + 1, + 1, + 0, + 3, + 0, + 1, + 3, + 0, + 6, + 4, + 6, + 7, + 0, + 9, + 1, + 3, + 3, + 1 + ], + "weighted_loads": [ + 0.11477608233690262, + 0.04745951294898987, + 0.0, + 0.29257770255208015, + 0.0, + 0.0, + 0.0, + 0.0461847260594368, + 0.17353753745555878, + 0.0, + 0.0487355999648571, + 0.14185144752264023, + 0.0, + 0.12511758506298065, + 0.0, + 0.08859526365995407, + 0.3981948345899582, + 0.3566329926252365, + 0.08949609845876694, + 0.0, + 0.05305028706789017, + 0.1442142240703106, + 0.16756946593523026, + 0.16158618032932281, + 0.0, + 0.05268734320998192, + 0.6281899698078632, + 0.0, + 0.0, + 0.18548839539289474, + 0.03942335769534111, + 0.07793866842985153, + 0.1758698746562004, + 0.40597059205174446, + 0.0, + 0.04377642273902893, + 0.0, + 0.0, + 0.03476651385426521, + 0.0, + 0.5592117644846439, + 0.6605905257165432, + 0.23443595319986343, + 0.0, + 0.09085258096456528, + 0.0, + 0.09736733883619308, + 0.037628624588251114, + 0.0, + 0.12479433789849281, + 0.0, + 0.03556683287024498, + 0.1458144672214985, + 0.0, + 0.3047330528497696, + 0.17286176979541779, + 0.3229103200137615, + 0.5814930200576782, + 0.0, + 0.8041415326297283, + 0.0408029705286026, + 0.26405109465122223, + 0.11853491514921188, + 0.04822733998298645 + ], + "unique_experts": 43, + "load_cv": 1.2385158235059268, + "normalized_load_entropy": 0.8298993287369786, + "max_load_share": 0.07246376811594203 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "f649aced39b7946421d1f0f906f8dec24ffdd2334d21258e9c88762ffbc3060f", + "route_weight_sha256": "f8b5fdc6af999aa682ebd4a89f837e75ba84a6364cb23d714b7a7b50f349c6f4", + "loads": [ + 2, + 2, + 2, + 4, + 6, + 0, + 0, + 1, + 8, + 1, + 3, + 4, + 0, + 2, + 0, + 7, + 12, + 4, + 13, + 0, + 1, + 2, + 2, + 8, + 0, + 1, + 10, + 1, + 7, + 4, + 7, + 10, + 5, + 7, + 5, + 3, + 0, + 0, + 1, + 0, + 16, + 10, + 4, + 23, + 4, + 0, + 1, + 9, + 0, + 6, + 0, + 1, + 3, + 1, + 10, + 6, + 6, + 7, + 4, + 10, + 1, + 8, + 12, + 1 + ], + "weighted_loads": [ + 0.11477608233690262, + 0.08134808391332626, + 0.0940215140581131, + 0.29257770255208015, + 0.2621515244245529, + 0.0, + 0.0, + 0.0461847260594368, + 0.42425035685300827, + 0.030617941170930862, + 0.11574766039848328, + 0.18371410015970469, + 0.0, + 0.12511758506298065, + 0.0, + 0.3214324526488781, + 0.8942588157951832, + 0.3714502863585949, + 1.3626371994614601, + 0.0, + 0.05305028706789017, + 0.1442142240703106, + 0.16756946593523026, + 0.4410697612911463, + 0.0, + 0.05268734320998192, + 0.6281899698078632, + 0.012540847063064575, + 0.4988953024148941, + 0.18548839539289474, + 0.33403367921710014, + 0.5554580576717854, + 0.21053578332066536, + 0.40597059205174446, + 0.2846266143023968, + 0.18523231893777847, + 0.0, + 0.0, + 0.03476651385426521, + 0.0, + 1.0373529195785522, + 0.6605905257165432, + 0.23443595319986343, + 2.17672186717391, + 0.2496105171740055, + 0.0, + 0.09736733883619308, + 0.6067400276660919, + 0.0, + 0.27245059236884117, + 0.0, + 0.03556683287024498, + 0.1458144672214985, + 0.05507826432585716, + 0.5583147769793868, + 0.255567517131567, + 0.3229103200137615, + 0.5814930200576782, + 0.1942969299852848, + 0.848974421620369, + 0.0408029705286026, + 0.4961983785033226, + 0.618031308054924, + 0.04822733998298645 + ], + "unique_experts": 52, + "load_cv": 1.0137937550497034, + "normalized_load_entropy": 0.8786721432701944, + "max_load_share": 0.0798611111111111 + } + }, + "s1_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "cf1855a3e90add14f81066c8f6d1656fd5f812cf8b3ebc5cf3ebd74575516d5a", + "route_weight_sha256": "d003ee8569e67e90ca0bfa25da13808a4b151067c0e7af797bd4a9bd3b505c4f", + "loads": [ + 2, + 1, + 0, + 5, + 0, + 0, + 1, + 1, + 3, + 0, + 1, + 2, + 0, + 2, + 0, + 1, + 7, + 3, + 1, + 0, + 1, + 2, + 2, + 2, + 0, + 1, + 10, + 0, + 0, + 4, + 0, + 1, + 5, + 7, + 0, + 1, + 0, + 0, + 2, + 0, + 7, + 10, + 4, + 0, + 1, + 0, + 1, + 1, + 0, + 3, + 0, + 1, + 3, + 0, + 7, + 3, + 6, + 7, + 0, + 10, + 0, + 3, + 3, + 0 + ], + "weighted_loads": [ + 0.12128646671772003, + 0.04251302406191826, + 0.0, + 0.32962236925959587, + 0.0, + 0.0, + 0.036547593772411346, + 0.04767831414937973, + 0.17566272616386414, + 0.0, + 0.05479460954666138, + 0.14123530313372612, + 0.0, + 0.12112906202673912, + 0.0, + 0.08184783905744553, + 0.317973542958498, + 0.3556785061955452, + 0.10208093374967575, + 0.0, + 0.05332636460661888, + 0.139155101031065, + 0.16005398333072662, + 0.15804129093885422, + 0.0, + 0.04846259579062462, + 0.6445956490933895, + 0.0, + 0.0, + 0.18524803966283798, + 0.0, + 0.0745546817779541, + 0.2308914214372635, + 0.40764550119638443, + 0.0, + 0.05122702196240425, + 0.0, + 0.0, + 0.07692701742053032, + 0.0, + 0.5190461724996567, + 0.6245058141648769, + 0.22382492572069168, + 0.0, + 0.08316060900688171, + 0.0, + 0.10714298486709595, + 0.035136956721544266, + 0.0, + 0.1240004263818264, + 0.0, + 0.04171612113714218, + 0.15403108671307564, + 0.0, + 0.3355324976146221, + 0.12700378894805908, + 0.337373960763216, + 0.5782872028648853, + 0.0, + 0.824709702283144, + 0.0, + 0.26292264461517334, + 0.1183264721184969, + 0.0 + ], + "unique_experts": 41, + "load_cv": 1.2573664479271869, + "normalized_load_entropy": 0.8225215476430019, + "max_load_share": 0.07246376811594203 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "53032cb98ec2cbf055265dbfd361610bb4631ebf84cf1e2b3f3ce22c6cdda026", + "route_weight_sha256": "1ffffe26fc1dbab2ddad9f978c8a6e096618e374f7e81a73195d0f23dc978374", + "loads": [ + 4, + 3, + 1, + 5, + 10, + 4, + 1, + 3, + 12, + 0, + 4, + 4, + 0, + 2, + 0, + 2, + 26, + 4, + 12, + 1, + 2, + 3, + 4, + 7, + 0, + 1, + 12, + 3, + 11, + 4, + 9, + 8, + 6, + 7, + 5, + 5, + 0, + 0, + 2, + 1, + 14, + 10, + 4, + 27, + 3, + 0, + 2, + 15, + 0, + 7, + 0, + 1, + 3, + 6, + 28, + 12, + 12, + 8, + 3, + 14, + 1, + 11, + 14, + 1 + ], + "weighted_loads": [ + 0.2685767188668251, + 0.11774840578436852, + 0.045626554638147354, + 0.32962236925959587, + 0.5498219504952431, + 0.14104371890425682, + 0.036547593772411346, + 0.17723886668682098, + 0.6916909478604794, + 0.0, + 0.16442010924220085, + 0.18310545105487108, + 0.0, + 0.12112906202673912, + 0.0, + 0.12202836945652962, + 2.0266719609498978, + 0.3704957999289036, + 1.3616969287395477, + 0.03820555657148361, + 0.12635688111186028, + 0.20957687124609947, + 0.27219871431589127, + 0.3781987465918064, + 0.0, + 0.04846259579062462, + 0.7219374030828476, + 0.09393206611275673, + 0.8132111057639122, + 0.18524803966283798, + 0.4580333363264799, + 0.3944494090974331, + 0.26403097063302994, + 0.40764550119638443, + 0.26186662912368774, + 0.40029994398355484, + 0.0, + 0.0, + 0.07692701742053032, + 0.046665798872709274, + 0.9117686524987221, + 0.6245058141648769, + 0.22382492572069168, + 2.4120686762034893, + 0.21664221957325935, + 0.0, + 0.15279122069478035, + 1.02786223590374, + 0.0, + 0.39166898652911186, + 0.0, + 0.04171612113714218, + 0.15403108671307564, + 0.35467347502708435, + 1.640032378025353, + 0.5516758672893047, + 0.8092785626649857, + 0.6220430620014668, + 0.1517365351319313, + 0.9791804533451796, + 0.037221863865852356, + 0.6212341263890266, + 0.6934250947088003, + 0.03274724632501602 + ], + "unique_experts": 55, + "load_cv": 1.0586121679927085, + "normalized_load_entropy": 0.8796240154923375, + "max_load_share": 0.07291666666666667 + } + }, + "s0_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "9fc7e407de93f7a25b2fc6970df8ad1232ebda75b97838f6484c73f044012835", + "route_weight_sha256": "0698eda8adacb56cc78f2fee2e56adac336575f7cc66ac751dc8a4245c33c6e0", + "loads": [ + 2, + 1, + 0, + 4, + 1, + 0, + 0, + 1, + 3, + 0, + 1, + 2, + 0, + 2, + 0, + 1, + 7, + 3, + 1, + 0, + 1, + 2, + 2, + 2, + 0, + 1, + 9, + 0, + 0, + 4, + 0, + 1, + 4, + 7, + 0, + 1, + 0, + 0, + 2, + 0, + 8, + 10, + 4, + 1, + 1, + 0, + 1, + 1, + 0, + 4, + 0, + 2, + 3, + 0, + 6, + 3, + 6, + 7, + 0, + 9, + 1, + 2, + 3, + 1 + ], + "weighted_loads": [ + 0.11416009068489075, + 0.04234164580702782, + 0.0, + 0.2862880676984787, + 0.03275888040661812, + 0.0, + 0.0, + 0.04934978857636452, + 0.17653656378388405, + 0.0, + 0.05037308111786842, + 0.14314807206392288, + 0.0, + 0.12562303617596626, + 0.0, + 0.08630096167325974, + 0.35853202641010284, + 0.3523576781153679, + 0.08986155688762665, + 0.0, + 0.053410593420267105, + 0.14603829756379128, + 0.16239356249570847, + 0.158839613199234, + 0.0, + 0.05373752489686012, + 0.6122492253780365, + 0.0, + 0.0, + 0.18706220015883446, + 0.0, + 0.08137773722410202, + 0.17371006682515144, + 0.3989679552614689, + 0.0, + 0.045827217400074005, + 0.0, + 0.0, + 0.07638812065124512, + 0.0, + 0.5554672069847584, + 0.6440880112349987, + 0.23249703273177147, + 0.03751423954963684, + 0.09538556635379791, + 0.0, + 0.10733653604984283, + 0.03708093240857124, + 0.0, + 0.16195641458034515, + 0.0, + 0.07509053498506546, + 0.1454557664692402, + 0.0, + 0.3027012534439564, + 0.1286051608622074, + 0.33314400538802147, + 0.5759454518556595, + 0.0, + 0.8319085165858269, + 0.03938426449894905, + 0.23259910941123962, + 0.1138175930827856, + 0.04748079553246498 + ], + "unique_experts": 44, + "load_cv": 1.194311940990441, + "normalized_load_entropy": 0.8393115980409073, + "max_load_share": 0.07246376811594203 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "6cacded747a916b4be6f4e80f9fedd1d11f36dce3f50cb2563245fa2791c1d70", + "route_weight_sha256": "477619cfc61841e0bcdf35a527c8ae218dc7ce773ff284dd53ce80972d741b2c", + "loads": [ + 2, + 2, + 1, + 4, + 8, + 0, + 0, + 1, + 8, + 1, + 3, + 4, + 0, + 2, + 0, + 8, + 13, + 4, + 13, + 0, + 1, + 2, + 2, + 8, + 0, + 1, + 9, + 1, + 8, + 4, + 6, + 10, + 5, + 7, + 4, + 4, + 0, + 0, + 2, + 0, + 16, + 10, + 4, + 25, + 4, + 0, + 1, + 9, + 0, + 6, + 0, + 2, + 3, + 0, + 10, + 5, + 6, + 7, + 3, + 10, + 1, + 7, + 10, + 1 + ], + "weighted_loads": [ + 0.11416009068489075, + 0.07623021677136421, + 0.059370964765548706, + 0.2862880676984787, + 0.3724013417959213, + 0.0, + 0.0, + 0.04934978857636452, + 0.4199049547314644, + 0.030617941170930862, + 0.1173851415514946, + 0.18501072470098734, + 0.0, + 0.12562303617596626, + 0.0, + 0.3565509505569935, + 0.950062058866024, + 0.3671749718487263, + 1.3125964887440205, + 0.0, + 0.053410593420267105, + 0.14603829756379128, + 0.16239356249570847, + 0.43832319416105747, + 0.0, + 0.05373752489686012, + 0.6122492253780365, + 0.012540847063064575, + 0.5379859544336796, + 0.18706220015883446, + 0.29461032152175903, + 0.5652995072305202, + 0.2083759754896164, + 0.3989679552614689, + 0.19640736654400826, + 0.3370841220021248, + 0.0, + 0.0, + 0.07638812065124512, + 0.0, + 1.0337108373641968, + 0.6440880112349987, + 0.23249703273177147, + 2.3282716535031796, + 0.25414350256323814, + 0.0, + 0.10733653604984283, + 0.6027857400476933, + 0.0, + 0.2686449848115444, + 0.0, + 0.07509053498506546, + 0.1454557664692402, + 0.0, + 0.5598711846396327, + 0.21040137484669685, + 0.33314400538802147, + 0.5759454518556595, + 0.13448286429047585, + 0.8735526166856289, + 0.03938426449894905, + 0.46510275453329086, + 0.5453197378665209, + 0.04748079553246498 + ], + "unique_experts": 51, + "load_cv": 1.0400914014916143, + "normalized_load_entropy": 0.8752938578689035, + "max_load_share": 0.08680555555555555 + } + }, + "s1_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "b5dd7177343a98c37e8fb7c3390baab4cd6c2dba5c78e79f8b4fccb9b768e718", + "route_weight_sha256": "2b4db89297abdd9455ab42a2439ef1a792ebac17deee72e135128eefada13203", + "loads": [ + 2, + 1, + 0, + 5, + 0, + 0, + 1, + 1, + 3, + 0, + 1, + 2, + 0, + 2, + 0, + 1, + 7, + 3, + 1, + 0, + 1, + 2, + 2, + 2, + 0, + 1, + 10, + 0, + 0, + 5, + 1, + 1, + 5, + 7, + 0, + 1, + 0, + 0, + 1, + 0, + 8, + 9, + 4, + 0, + 1, + 0, + 1, + 1, + 0, + 4, + 0, + 1, + 3, + 0, + 7, + 3, + 6, + 7, + 0, + 9, + 0, + 2, + 3, + 0 + ], + "weighted_loads": [ + 0.11830998212099075, + 0.03730515018105507, + 0.0, + 0.3270247094333172, + 0.0, + 0.0, + 0.0349593348801136, + 0.04817628487944603, + 0.17679817974567413, + 0.0, + 0.055185284465551376, + 0.14619750156998634, + 0.0, + 0.12283080071210861, + 0.0, + 0.08143343031406403, + 0.3236306235194206, + 0.3691990301012993, + 0.10101952403783798, + 0.0, + 0.05333878844976425, + 0.14065445959568024, + 0.1586253046989441, + 0.15692410618066788, + 0.0, + 0.04820441082119942, + 0.6498862151056528, + 0.0, + 0.0, + 0.22268003411591053, + 0.035589806735515594, + 0.07407788932323456, + 0.2287478931248188, + 0.39983489736914635, + 0.0, + 0.0521218404173851, + 0.0, + 0.0, + 0.03615105524659157, + 0.0, + 0.54625653475523, + 0.5718607567250729, + 0.22152666375041008, + 0.0, + 0.08351851254701614, + 0.0, + 0.11000651121139526, + 0.03642348200082779, + 0.0, + 0.15944861620664597, + 0.0, + 0.040669605135917664, + 0.15255093947052956, + 0.0, + 0.3453284129500389, + 0.12213332578539848, + 0.33486882597208023, + 0.5564097687602043, + 0.0, + 0.7974493093788624, + 0.0, + 0.22529742866754532, + 0.11138019897043705, + 0.0 + ], + "unique_experts": 42, + "load_cv": 1.2385158235059268, + "normalized_load_entropy": 0.8260620438459958, + "max_load_share": 0.07246376811594203 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "e47e7ff5280c95474692bb8094c2e755543cab575b1c5ed33e360810b0cdbb97", + "route_weight_sha256": "202f8acd4bad1d1da19d0832cca142eca20da7c03207dadae3c1408786193bd4", + "loads": [ + 4, + 2, + 1, + 5, + 11, + 6, + 1, + 3, + 12, + 0, + 4, + 4, + 0, + 2, + 1, + 3, + 26, + 4, + 11, + 1, + 2, + 3, + 4, + 7, + 0, + 1, + 12, + 2, + 11, + 5, + 10, + 8, + 6, + 7, + 5, + 6, + 0, + 0, + 1, + 1, + 14, + 9, + 4, + 27, + 3, + 0, + 2, + 15, + 0, + 8, + 0, + 1, + 3, + 5, + 27, + 12, + 12, + 8, + 2, + 14, + 1, + 10, + 14, + 1 + ], + "weighted_loads": [ + 0.2656002342700958, + 0.06999258697032928, + 0.045626554638147354, + 0.3270247094333172, + 0.6165101826190948, + 0.2130062971264124, + 0.0349593348801136, + 0.17773683741688728, + 0.6928358897566795, + 0.0, + 0.16481078416109085, + 0.1880676494911313, + 0.0, + 0.12283080071210861, + 0.04007318243384361, + 0.15465721860527992, + 2.055519837886095, + 0.38401632383465767, + 1.2822689414024353, + 0.03820555657148361, + 0.12636930495500565, + 0.21107622981071472, + 0.27077003568410873, + 0.37708156183362007, + 0.0, + 0.04820441082119942, + 0.7272279690951109, + 0.05121370404958725, + 0.8510139659047127, + 0.22268003411591053, + 0.4936231430619955, + 0.3844693601131439, + 0.26188744232058525, + 0.39983489736914635, + 0.24937573820352554, + 0.4943346455693245, + 0.0, + 0.0, + 0.03615105524659157, + 0.046665798872709274, + 0.8720832988619804, + 0.5718607567250729, + 0.22152666375041008, + 2.4531617760658264, + 0.21700012311339378, + 0.0, + 0.15565474703907967, + 1.040179681032896, + 0.0, + 0.41813505068421364, + 0.0, + 0.040669605135917664, + 0.15255093947052956, + 0.3037366718053818, + 1.6163616431877017, + 0.5431842543184757, + 0.8067734278738499, + 0.6001656278967857, + 0.10422240197658539, + 0.9927531573921442, + 0.037221863865852356, + 0.5791398212313652, + 0.6786282826215029, + 0.03274724632501602 + ], + "unique_experts": 56, + "load_cv": 1.0491398593345143, + "normalized_load_entropy": 0.8810266289657791, + "max_load_share": 0.0703125 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "ordered_topk_exact_tokens": 17, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.9503105590062112, + "mean_token_weighted_tv": 0.013260980379646238, + "aggregate_load_tv": 0.028985507246376815 + }, + "system_bos": { + "tokens": 23, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.9130434782608697, + "mean_token_weighted_tv": 0.018968813323780247, + "aggregate_load_tv": 0.04347826086956521 + }, + "system_x": { + "tokens": 23, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8881987577639753, + "mean_token_weighted_tv": 0.025005540810525417, + "aggregate_load_tv": 0.04347826086956522 + }, + "system_period": { + "tokens": 23, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.9006211180124223, + "mean_token_weighted_tv": 0.023285605418293373, + "aggregate_load_tv": 0.05072463768115943 + }, + "bos_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.9006211180124224, + "mean_token_weighted_tv": 0.02151411071257747, + "aggregate_load_tv": 0.05072463768115944 + }, + "bos_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.9254658385093167, + "mean_token_weighted_tv": 0.018626067665931972, + "aggregate_load_tv": 0.043478260869565216 + }, + "x_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8881987577639753, + "mean_token_weighted_tv": 0.025775870389264564, + "aggregate_load_tv": 0.04347826086956522 + }, + "x_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.9037267080745341, + "mean_token_weighted_tv": 0.026321063789984455, + "aggregate_load_tv": 0.05072463768115944 + }, + "period_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8881987577639753, + "mean_token_weighted_tv": 0.026009422160037186, + "aggregate_load_tv": 0.05072463768115943 + }, + "period_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.9037267080745341, + "mean_token_weighted_tv": 0.02624821338964545, + "aggregate_load_tv": 0.05797101449275363 + } + } + }, + "layer_12": { + "layer": 12, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "1243bee5b9b07d0186c4f2350b32d5758266f9d437b28e59526f03247af1d37d", + "route_weight_sha256": "06738cab33f132638f66a769edc3aacefa249826a7bf4be84a6ee5dd320dc5e8", + "loads": [ + 3, + 2, + 1, + 5, + 1, + 6, + 0, + 3, + 1, + 0, + 0, + 0, + 4, + 7, + 2, + 0, + 6, + 1, + 2, + 0, + 1, + 2, + 2, + 3, + 1, + 0, + 4, + 0, + 1, + 0, + 2, + 6, + 1, + 3, + 3, + 1, + 1, + 3, + 2, + 0, + 5, + 1, + 0, + 3, + 4, + 0, + 0, + 2, + 4, + 3, + 0, + 4, + 4, + 3, + 0, + 1, + 4, + 9, + 0, + 4, + 0, + 4, + 1, + 2 + ], + "weighted_loads": [ + 0.17737053334712982, + 0.09554314613342285, + 0.0473317988216877, + 0.9416995085775852, + 0.1416700780391693, + 0.6956821978092194, + 0.0, + 0.1288865990936756, + 0.040971655398607254, + 0.0, + 0.0, + 0.0, + 0.3508804701268673, + 0.4998726435005665, + 0.08723783493041992, + 0.0, + 0.3025369606912136, + 0.06688101589679718, + 0.1054779477417469, + 0.0, + 0.02769756317138672, + 0.06512481160461903, + 0.24376961588859558, + 0.7108741104602814, + 0.049310702830553055, + 0.0, + 0.33236757293343544, + 0.0, + 0.06269783526659012, + 0.0, + 0.08577831462025642, + 0.47125297598540783, + 0.051003966480493546, + 0.17686643078923225, + 0.10480552539229393, + 0.027909692376852036, + 0.05336225405335426, + 0.2729193978011608, + 0.09010563790798187, + 0.0, + 0.3476547449827194, + 0.04830480366945267, + 0.0, + 0.11269981414079666, + 0.15337774902582169, + 0.0, + 0.0, + 0.09946847334504128, + 0.3078956641256809, + 0.1459004357457161, + 0.0, + 0.2489650994539261, + 0.20802604407072067, + 0.23293384909629822, + 0.0, + 0.051234617829322815, + 0.2828909866511822, + 0.6318761892616749, + 0.0, + 0.40163254737854004, + 0.0, + 0.19346507266163826, + 0.027236567810177803, + 0.10561760514974594 + ], + "unique_experts": 47, + "load_cv": 0.9426976445188068, + "normalized_load_entropy": 0.8819480339211084, + "max_load_share": 0.06521739130434782 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "e98f88f0d14655a8d2aef9e749b3172e06ed85ffd7f2292f0ce612639c55087b", + "route_weight_sha256": "a1ec2d3d20febe1b5850e83d486df93b526e87f1128385d788b3fe744343b90a", + "loads": [ + 3, + 2, + 1, + 10, + 5, + 7, + 0, + 5, + 7, + 0, + 0, + 0, + 9, + 7, + 2, + 0, + 10, + 1, + 2, + 0, + 2, + 2, + 3, + 10, + 1, + 0, + 5, + 7, + 16, + 11, + 4, + 11, + 2, + 5, + 3, + 8, + 1, + 7, + 18, + 0, + 5, + 6, + 5, + 5, + 5, + 1, + 1, + 8, + 7, + 3, + 1, + 4, + 4, + 3, + 0, + 1, + 7, + 10, + 0, + 7, + 0, + 8, + 5, + 5 + ], + "weighted_loads": [ + 0.17737053334712982, + 0.09554314613342285, + 0.0473317988216877, + 1.0689859807025641, + 1.7623634245246649, + 0.6997547815553844, + 0.0, + 0.23637774214148521, + 0.4338218681514263, + 0.0, + 0.0, + 0.0, + 0.61687021702528, + 0.4998726435005665, + 0.08723783493041992, + 0.0, + 0.5520252920687199, + 0.06688101589679718, + 0.1054779477417469, + 0.0, + 0.030010699527338147, + 0.06512481160461903, + 0.2914804667234421, + 1.2360126003623009, + 0.049310702830553055, + 0.0, + 0.3651331663131714, + 0.3976475317031145, + 1.9550955183804035, + 1.6377289220690727, + 0.1481976294890046, + 0.8261744994670153, + 0.09729554131627083, + 0.257785402238369, + 0.10480552539229393, + 0.5222843587398529, + 0.05336225405335426, + 0.3862147852778435, + 1.609827145934105, + 0.0, + 0.3476547449827194, + 0.6122756525874138, + 0.3186364024877548, + 0.269264280796051, + 0.2025371603667736, + 0.03696048632264137, + 0.049444813281297684, + 0.45211490616202354, + 0.5095834471285343, + 0.1459004357457161, + 0.012954654172062874, + 0.2489650994539261, + 0.20802604407072067, + 0.23293384909629822, + 0.0, + 0.051234617829322815, + 0.3899120632559061, + 0.6615113653242588, + 0.0, + 0.4951032642275095, + 0.0, + 0.352822856977582, + 0.19328688643872738, + 0.20514936745166779 + ], + "unique_experts": 53, + "load_cv": 0.8792884328524674, + "normalized_load_entropy": 0.9003317784005731, + "max_load_share": 0.0625 + } + }, + "s1_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "aef47840bc8fc6ddf6c23c2b195cb7bb6dcc233f243653c9edf0a51adf462d15", + "route_weight_sha256": "64138cc352eff3deab6fec8ba2c0f2d7dbbc904bb3d4f89d78d9f7253142f163", + "loads": [ + 3, + 1, + 1, + 5, + 1, + 6, + 0, + 3, + 1, + 0, + 0, + 0, + 4, + 7, + 2, + 0, + 7, + 1, + 2, + 0, + 1, + 2, + 2, + 3, + 1, + 0, + 4, + 0, + 1, + 0, + 1, + 5, + 1, + 3, + 3, + 1, + 1, + 3, + 2, + 0, + 6, + 1, + 0, + 2, + 4, + 0, + 0, + 2, + 5, + 3, + 0, + 4, + 4, + 3, + 0, + 1, + 4, + 9, + 0, + 4, + 0, + 5, + 1, + 2 + ], + "weighted_loads": [ + 0.1744694486260414, + 0.05602316930890083, + 0.045398812741041183, + 0.9308069013059139, + 0.14509929716587067, + 0.7109033614397049, + 0.0, + 0.12882717326283455, + 0.04075798764824867, + 0.0, + 0.0, + 0.0, + 0.35297316312789917, + 0.5156722962856293, + 0.09408623352646828, + 0.0, + 0.3210841305553913, + 0.06780242919921875, + 0.1041112132370472, + 0.0, + 0.027736874297261238, + 0.06820252351462841, + 0.25469131022691727, + 0.7203919924795628, + 0.04672076553106308, + 0.0, + 0.32478588819503784, + 0.0, + 0.06315864622592926, + 0.0, + 0.04464999958872795, + 0.4426215961575508, + 0.0495133139193058, + 0.18061046674847603, + 0.10813557915389538, + 0.029280001297593117, + 0.05004160851240158, + 0.2716374434530735, + 0.08600553125143051, + 0.0, + 0.392823301255703, + 0.05048235505819321, + 0.0, + 0.07538184523582458, + 0.14897193759679794, + 0.0, + 0.0, + 0.09930495917797089, + 0.3422236181795597, + 0.14960523694753647, + 0.0, + 0.2485523857176304, + 0.2070455215871334, + 0.23441675677895546, + 0.0, + 0.04766887426376343, + 0.2780851759016514, + 0.6273641660809517, + 0.0, + 0.39374393224716187, + 0.0, + 0.23294219374656677, + 0.027113493531942368, + 0.10483988747000694 + ], + "unique_experts": 47, + "load_cv": 0.9776971000303147, + "normalized_load_entropy": 0.87638510771726, + "max_load_share": 0.06521739130434782 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "56537ffef3d7e45315699888bba77fc6479cc26829965996630630990ad5de90", + "route_weight_sha256": "b516ccb72fc2387fd6a77a0c0425524bd5fc94301c38c9e51c9ae1e7516cc0e7", + "loads": [ + 7, + 1, + 1, + 8, + 5, + 7, + 0, + 8, + 7, + 3, + 1, + 0, + 8, + 7, + 2, + 0, + 12, + 3, + 3, + 0, + 2, + 4, + 5, + 9, + 1, + 0, + 7, + 7, + 18, + 17, + 12, + 9, + 5, + 7, + 8, + 8, + 1, + 7, + 22, + 0, + 7, + 14, + 7, + 7, + 16, + 4, + 4, + 9, + 11, + 3, + 2, + 4, + 4, + 6, + 0, + 2, + 7, + 14, + 0, + 8, + 2, + 13, + 6, + 2 + ], + "weighted_loads": [ + 0.36684065498411655, + 0.05602316930890083, + 0.045398812741041183, + 0.9882954224012792, + 1.7687640525400639, + 0.714845780748874, + 0.0, + 0.3880209010094404, + 0.5344721972942352, + 0.31960856169462204, + 0.04405001550912857, + 0.0, + 0.5488793291151524, + 0.5156722962856293, + 0.09408623352646828, + 0.0, + 0.6549796126782894, + 0.18174193054437637, + 0.13971228525042534, + 0.0, + 0.03007887816056609, + 0.15891935117542744, + 0.37725408002734184, + 1.173639938235283, + 0.04672076553106308, + 0.0, + 0.4459478333592415, + 0.3722468428313732, + 2.281629841774702, + 2.584037370979786, + 0.905379687435925, + 0.744610421359539, + 0.22655821964144707, + 0.4226125404238701, + 0.3626720290631056, + 0.6040906347334385, + 0.05004160851240158, + 0.44430409371852875, + 1.8409819155931473, + 0.0, + 0.4223810713738203, + 1.1787855494767427, + 0.4127436429262161, + 0.3557388223707676, + 1.3050962127745152, + 0.3105485215783119, + 0.17910757660865784, + 0.4977041855454445, + 0.7040934562683105, + 0.14960523694753647, + 0.06547838635742664, + 0.2485523857176304, + 0.2070455215871334, + 0.3933923691511154, + 0.0, + 0.07898750528693199, + 0.35703781712800264, + 0.8489910140633583, + 0.0, + 0.5132057126611471, + 0.07014894858002663, + 0.6326663047075272, + 0.24735287576913834, + 0.10483988747000694 + ], + "unique_experts": 56, + "load_cv": 0.8138343743593587, + "normalized_load_entropy": 0.9153186954997925, + "max_load_share": 0.057291666666666664 + } + }, + "s0_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "4581b93c42fd3f2189d2f0aa6c398758486bbc8fabd95d833db84d2881713761", + "route_weight_sha256": "1f5e14eb50e85abdd4c34be77cab748af33498030faf12beabae95a9510f89cc", + "loads": [ + 3, + 2, + 1, + 6, + 2, + 6, + 0, + 2, + 1, + 0, + 0, + 0, + 4, + 7, + 1, + 1, + 9, + 1, + 2, + 0, + 1, + 2, + 2, + 3, + 0, + 0, + 4, + 0, + 1, + 0, + 1, + 5, + 1, + 3, + 3, + 1, + 1, + 3, + 2, + 0, + 5, + 1, + 0, + 3, + 3, + 0, + 0, + 2, + 5, + 3, + 0, + 3, + 4, + 4, + 0, + 1, + 4, + 9, + 0, + 4, + 0, + 4, + 0, + 2 + ], + "weighted_loads": [ + 0.1580628976225853, + 0.09618403017520905, + 0.04024336859583855, + 1.014778945595026, + 0.1658629309386015, + 0.6958109736442566, + 0.0, + 0.08794543519616127, + 0.04335636645555496, + 0.0, + 0.0, + 0.0, + 0.3882627785205841, + 0.4908016212284565, + 0.05003279075026512, + 0.040987029671669006, + 0.43378059938549995, + 0.059502147138118744, + 0.10848614200949669, + 0.0, + 0.028487440198659897, + 0.05756206810474396, + 0.24992014467716217, + 0.6752328835427761, + 0.0, + 0.0, + 0.3315877802670002, + 0.0, + 0.060928452759981155, + 0.0, + 0.040179722011089325, + 0.4620033800601959, + 0.04979507252573967, + 0.18255461007356644, + 0.10104109905660152, + 0.026973461732268333, + 0.0511891134083271, + 0.26080285385251045, + 0.09120598435401917, + 0.0, + 0.34437209367752075, + 0.04914524778723717, + 0.0, + 0.1168062835931778, + 0.11272673308849335, + 0.0, + 0.0, + 0.09745429828763008, + 0.3276950567960739, + 0.14507398381829262, + 0.0, + 0.19700903818011284, + 0.20696117728948593, + 0.28278468176722527, + 0.0, + 0.0527997650206089, + 0.2977805621922016, + 0.6553599163889885, + 0.0, + 0.4074892923235893, + 0.0, + 0.19392697140574455, + 0.0, + 0.10143113136291504 + ], + "unique_experts": 46, + "load_cv": 1.0081582776486193, + "normalized_load_entropy": 0.8715263062845253, + "max_load_share": 0.06521739130434782 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "4040c53c916c1b9cbbb0d986f0c38f226c7798f97934f170f27ca403c49e0531", + "route_weight_sha256": "49d5588bb65e499cde3a80df3508bc62b6b8c080053b086ea4a6e988b29bfe9f", + "loads": [ + 4, + 2, + 1, + 10, + 5, + 6, + 0, + 3, + 7, + 0, + 0, + 0, + 10, + 7, + 1, + 1, + 14, + 1, + 2, + 0, + 1, + 2, + 3, + 11, + 0, + 0, + 6, + 7, + 17, + 12, + 3, + 11, + 2, + 4, + 3, + 8, + 1, + 7, + 18, + 0, + 5, + 6, + 4, + 6, + 4, + 1, + 0, + 7, + 9, + 3, + 1, + 3, + 4, + 4, + 0, + 1, + 6, + 11, + 0, + 7, + 0, + 8, + 3, + 5 + ], + "weighted_loads": [ + 0.2142561860382557, + 0.09618403017520905, + 0.04024336859583855, + 1.1389610012993217, + 0.8361970521509647, + 0.6958109736442566, + 0.0, + 0.16333256289362907, + 0.47660138830542564, + 0.0, + 0.0, + 0.0, + 0.735393337905407, + 0.4908016212284565, + 0.05003279075026512, + 0.040987029671669006, + 0.7268702164292336, + 0.059502147138118744, + 0.10848614200949669, + 0.0, + 0.028487440198659897, + 0.05756206810474396, + 0.29763099551200867, + 1.2426572553813457, + 0.0, + 0.0, + 0.40705613419413567, + 0.3976475317031145, + 1.9529047943651676, + 1.6185556389391422, + 0.10259903687983751, + 0.8727016896009445, + 0.09608664736151695, + 0.2242925502359867, + 0.10104109905660152, + 0.5213481280952692, + 0.0511891134083271, + 0.3740982413291931, + 1.618681538850069, + 0.0, + 0.34437209367752075, + 0.5506250262260437, + 0.2748106122016907, + 0.3259297348558903, + 0.16188614442944527, + 0.03696048632264137, + 0.0, + 0.3688732422888279, + 0.568016767501831, + 0.14507398381829262, + 0.012954654172062874, + 0.19700903818011284, + 0.20696117728948593, + 0.28278468176722527, + 0.0, + 0.0527997650206089, + 0.4002184998244047, + 0.7283916436135769, + 0.0, + 0.5511986147612333, + 0.0, + 0.35328475572168827, + 0.11813478171825409, + 0.20096289366483688 + ], + "unique_experts": 52, + "load_cv": 0.9468922527255172, + "normalized_load_entropy": 0.8885244890963198, + "max_load_share": 0.0625 + } + }, + "s1_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "ba7b22983a32aa9969cba20c2c7df0174e5189122eed370890c7283a4927675f", + "route_weight_sha256": "ccd59d2d5c931028aae221ec7b4f9a8698a1ed6f939085b700b6aada5cc51379", + "loads": [ + 3, + 2, + 1, + 5, + 2, + 6, + 0, + 3, + 1, + 0, + 0, + 0, + 4, + 7, + 2, + 0, + 7, + 1, + 2, + 0, + 1, + 1, + 2, + 3, + 1, + 0, + 4, + 0, + 1, + 0, + 1, + 5, + 1, + 3, + 3, + 2, + 1, + 3, + 2, + 0, + 6, + 1, + 0, + 2, + 4, + 0, + 0, + 2, + 4, + 3, + 0, + 2, + 4, + 4, + 0, + 1, + 4, + 10, + 0, + 4, + 0, + 5, + 0, + 2 + ], + "weighted_loads": [ + 0.16892537474632263, + 0.09452328085899353, + 0.03857190161943436, + 0.9628201834857464, + 0.18103131838142872, + 0.7236554473638535, + 0.0, + 0.12975292280316353, + 0.04287495091557503, + 0.0, + 0.0, + 0.0, + 0.4031512476503849, + 0.49736202508211136, + 0.09054955467581749, + 0.0, + 0.34078571014106274, + 0.06073135510087013, + 0.10534373298287392, + 0.0, + 0.03146635740995407, + 0.02410413697361946, + 0.25576765835285187, + 0.6958537921309471, + 0.04591301083564758, + 0.0, + 0.32543071918189526, + 0.0, + 0.058857932686805725, + 0.0, + 0.041955944150686264, + 0.45572033524513245, + 0.052266642451286316, + 0.17510635033249855, + 0.10705521702766418, + 0.0627765953540802, + 0.04785402864217758, + 0.25352237932384014, + 0.09153052791953087, + 0.0, + 0.3911733590066433, + 0.050403039902448654, + 0.0, + 0.08025781810283661, + 0.14521266892552376, + 0.0, + 0.0, + 0.09943670406937599, + 0.30320296064019203, + 0.1367521546781063, + 0.0, + 0.1472751572728157, + 0.2069668211042881, + 0.28637780249118805, + 0.0, + 0.0565236359834671, + 0.28153612464666367, + 0.7088104411959648, + 0.0, + 0.40481235831975937, + 0.0, + 0.22841790691018105, + 0.0, + 0.09927735850214958 + ], + "unique_experts": 46, + "load_cv": 0.9947351429505635, + "normalized_load_entropy": 0.8735766198437183, + "max_load_share": 0.07246376811594203 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "8f4080d2609be53a1d310af9515891f38e0a684bfa81bf571fec8c1b08815f0b", + "route_weight_sha256": "4e6502a6051c7780dc8f00096dbbe98b44cf9d68db19b0ba176f61760d0a675f", + "loads": [ + 7, + 2, + 1, + 7, + 5, + 6, + 0, + 8, + 7, + 3, + 1, + 0, + 9, + 7, + 2, + 0, + 13, + 3, + 3, + 0, + 1, + 3, + 5, + 9, + 1, + 0, + 7, + 7, + 18, + 19, + 12, + 10, + 5, + 7, + 8, + 9, + 1, + 7, + 22, + 0, + 7, + 12, + 6, + 8, + 16, + 4, + 2, + 10, + 11, + 3, + 2, + 2, + 4, + 7, + 0, + 2, + 6, + 17, + 0, + 8, + 2, + 13, + 5, + 2 + ], + "weighted_loads": [ + 0.3612965811043978, + 0.09452328085899353, + 0.03857190161943436, + 1.0173620535060763, + 0.8544474150985479, + 0.7236554473638535, + 0.0, + 0.3889466505497694, + 0.6017337329685688, + 0.31960856169462204, + 0.04405001550912857, + 0.0, + 0.7378242760896683, + 0.49736202508211136, + 0.09054955467581749, + 0.0, + 0.7237128335982561, + 0.17467085644602776, + 0.14094480499625206, + 0.0, + 0.03146635740995407, + 0.11482096463441849, + 0.37833042815327644, + 1.1491017378866673, + 0.04591301083564758, + 0.0, + 0.4465926643460989, + 0.3722468428313732, + 2.3892055936157703, + 2.583335217088461, + 0.9026856319978833, + 0.7878946214914322, + 0.22931154817342758, + 0.4171084240078926, + 0.3615916669368744, + 0.6375872287899256, + 0.04785402864217758, + 0.4261890295892954, + 1.9345327951014042, + 0.0, + 0.4207311291247606, + 1.0825608931481838, + 0.3703899160027504, + 0.3970123566687107, + 1.301336944103241, + 0.3105485215783119, + 0.08733611181378365, + 0.5435016229748726, + 0.7156179361045361, + 0.1367521546781063, + 0.06547838635742664, + 0.1472751572728157, + 0.2069668211042881, + 0.445353414863348, + 0.0, + 0.08784226700663567, + 0.34067058376967907, + 1.004393219947815, + 0.0, + 0.5561286266893148, + 0.07014894858002663, + 0.6281420178711414, + 0.22023938223719597, + 0.09927735850214958 + ], + "unique_experts": 56, + "load_cv": 0.8508574106942558, + "normalized_load_entropy": 0.9095807192656269, + "max_load_share": 0.057291666666666664 + } + }, + "s0_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "a4c82b50d47adfc15264f36b5dc1f001edc5ac4add5e9a2f073b10aa1846423a", + "route_weight_sha256": "a7b0c5d4ec8c1a08c3914cf9840d9674460cc0b8d534f6fafac7f40040f48986", + "loads": [ + 3, + 2, + 1, + 5, + 2, + 6, + 0, + 3, + 1, + 0, + 0, + 0, + 4, + 7, + 2, + 1, + 6, + 1, + 2, + 0, + 1, + 1, + 2, + 3, + 1, + 0, + 4, + 0, + 1, + 0, + 1, + 6, + 1, + 3, + 3, + 1, + 1, + 4, + 2, + 0, + 5, + 2, + 0, + 2, + 4, + 0, + 0, + 2, + 4, + 3, + 0, + 4, + 4, + 3, + 0, + 1, + 4, + 8, + 1, + 4, + 0, + 4, + 0, + 2 + ], + "weighted_loads": [ + 0.16651185229420662, + 0.09991942346096039, + 0.04085996001958847, + 1.0001590326428413, + 0.17074132524430752, + 0.7359180226922035, + 0.0, + 0.1282106302678585, + 0.043639376759529114, + 0.0, + 0.0, + 0.0, + 0.37755321711301804, + 0.46435270085930824, + 0.0858873650431633, + 0.04608282446861267, + 0.32764707878232, + 0.062488675117492676, + 0.10856182500720024, + 0.0, + 0.030349839478731155, + 0.032791558653116226, + 0.2399366870522499, + 0.7152082026004791, + 0.047161392867565155, + 0.0, + 0.3193751312792301, + 0.0, + 0.058416564017534256, + 0.0, + 0.04350057244300842, + 0.4757751189172268, + 0.04777500405907631, + 0.17047134786844254, + 0.10078063793480396, + 0.02721196599304676, + 0.05187654867768288, + 0.2887756787240505, + 0.10043371841311455, + 0.0, + 0.3400341644883156, + 0.08808155730366707, + 0.0, + 0.08214592561125755, + 0.14524870365858078, + 0.0, + 0.0, + 0.09671063348650932, + 0.2911793813109398, + 0.16087355464696884, + 0.0, + 0.2489398680627346, + 0.2034154012799263, + 0.2455860823392868, + 0.0, + 0.041629988700151443, + 0.28889599815011024, + 0.636087566614151, + 0.04306582733988762, + 0.3967939093708992, + 0.0, + 0.2118869051337242, + 0.0, + 0.10303523391485214 + ], + "unique_experts": 48, + "load_cv": 0.91740389670136, + "normalized_load_entropy": 0.8868261740386298, + "max_load_share": 0.057971014492753624 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "7fcea4c99213aea8b3ee1ad0d2d23d6aeb05751c65b23c178c22c9c90f159247", + "route_weight_sha256": "5a15b41f919bd710d36e21d2c1a7843e3b1b627b99dd4916ef8fe74b049183eb", + "loads": [ + 3, + 2, + 1, + 9, + 5, + 6, + 0, + 6, + 7, + 0, + 0, + 0, + 9, + 7, + 2, + 1, + 9, + 1, + 2, + 0, + 1, + 1, + 3, + 12, + 1, + 0, + 5, + 8, + 19, + 10, + 4, + 11, + 2, + 5, + 3, + 9, + 1, + 8, + 17, + 0, + 5, + 7, + 5, + 3, + 5, + 2, + 1, + 7, + 8, + 3, + 1, + 4, + 4, + 3, + 0, + 1, + 6, + 9, + 1, + 6, + 0, + 9, + 3, + 5 + ], + "weighted_loads": [ + 0.16651185229420662, + 0.09991942346096039, + 0.04085996001958847, + 1.124341088347137, + 0.8410754464566708, + 0.7359180226922035, + 0.0, + 0.2979862205684185, + 0.42262276634573936, + 0.0, + 0.0, + 0.0, + 0.651161577552557, + 0.46435270085930824, + 0.0858873650431633, + 0.04608282446861267, + 0.5310556814074516, + 0.062488675117492676, + 0.10856182500720024, + 0.0, + 0.030349839478731155, + 0.032791558653116226, + 0.2876475378870964, + 1.4317534305155277, + 0.047161392867565155, + 0.0, + 0.35214072465896606, + 0.4539652857929468, + 2.2234811186790466, + 1.199397262185812, + 0.1515819625928998, + 0.8790344297885895, + 0.09406657889485359, + 0.2513653412461281, + 0.10078063793480396, + 0.5965929832309484, + 0.05187654867768288, + 0.4020710662007332, + 1.444169469177723, + 0.0, + 0.3400341644883156, + 0.6035627909004688, + 0.33762386441230774, + 0.17578047141432762, + 0.1944081149995327, + 0.08926327154040337, + 0.05348530039191246, + 0.36643723025918007, + 0.5532434172928333, + 0.16087355464696884, + 0.012954654172062874, + 0.2489398680627346, + 0.2034154012799263, + 0.2455860823392868, + 0.0, + 0.041629988700151443, + 0.39133393578231335, + 0.6762770935893059, + 0.04306582733988762, + 0.48181398026645184, + 0.0, + 0.44403435103595257, + 0.11813478171825409, + 0.202566996216774 + ], + "unique_experts": 55, + "load_cv": 0.9018157267082181, + "normalized_load_entropy": 0.9005067400735862, + "max_load_share": 0.06597222222222222 + } + }, + "s1_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "324d27f64f1236b41ec42d9b8c3b2cf78b4e3ae93b4c4617d268559940720247", + "route_weight_sha256": "d751014174e02676b05f53d0c1712c41c35fe5a02aa5922f8973f7889a89e93c", + "loads": [ + 3, + 2, + 1, + 6, + 2, + 6, + 0, + 3, + 1, + 0, + 0, + 0, + 4, + 7, + 1, + 1, + 6, + 1, + 2, + 0, + 1, + 2, + 2, + 3, + 1, + 0, + 4, + 0, + 1, + 0, + 1, + 6, + 1, + 3, + 3, + 1, + 1, + 3, + 2, + 0, + 5, + 2, + 0, + 2, + 4, + 0, + 0, + 2, + 4, + 3, + 0, + 3, + 4, + 4, + 0, + 1, + 4, + 8, + 0, + 4, + 0, + 5, + 0, + 2 + ], + "weighted_loads": [ + 0.17626777291297913, + 0.09222116321325302, + 0.03598049655556679, + 1.0135700851678848, + 0.17065183445811272, + 0.7574212998151779, + 0.0, + 0.13259079679846764, + 0.04147082194685936, + 0.0, + 0.0, + 0.0, + 0.3379126526415348, + 0.5357520580291748, + 0.049426570534706116, + 0.04450688138604164, + 0.29784964956343174, + 0.06579883396625519, + 0.10234731808304787, + 0.0, + 0.03092345781624317, + 0.0635255966335535, + 0.2522863671183586, + 0.688484214246273, + 0.04776608571410179, + 0.0, + 0.3279542066156864, + 0.0, + 0.05728099122643471, + 0.0, + 0.046900659799575806, + 0.47356131114065647, + 0.048494186252355576, + 0.1522684097290039, + 0.10517013818025589, + 0.02562941052019596, + 0.04820826277136803, + 0.25512468814849854, + 0.10124151036143303, + 0.0, + 0.3681629076600075, + 0.09863417223095894, + 0.0, + 0.08538982644677162, + 0.14203310944139957, + 0.0, + 0.0, + 0.09829118847846985, + 0.27540988102555275, + 0.15535561367869377, + 0.0, + 0.1806853637099266, + 0.2063462845981121, + 0.2966332696378231, + 0.0, + 0.041544023901224136, + 0.2876746840775013, + 0.603622805327177, + 0.0, + 0.3791235089302063, + 0.0, + 0.25911693274974823, + 0.0, + 0.10024329274892807 + ], + "unique_experts": 47, + "load_cv": 0.9391259616998502, + "normalized_load_entropy": 0.8816756154559119, + "max_load_share": 0.057971014492753624 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "c125bbb5b72b6df20b930cdc84a3cebfab7db648141c50e5c2c0c6df9a0ebb02", + "route_weight_sha256": "41b3f05a74456a7de9022c130fb1945cccc6d337f2e2f6c01bff52620b7f0405", + "loads": [ + 7, + 2, + 1, + 8, + 5, + 6, + 0, + 9, + 7, + 3, + 1, + 0, + 8, + 7, + 1, + 1, + 10, + 3, + 3, + 0, + 1, + 5, + 5, + 10, + 1, + 0, + 8, + 8, + 20, + 15, + 13, + 10, + 5, + 7, + 8, + 9, + 1, + 7, + 21, + 0, + 6, + 13, + 7, + 6, + 16, + 5, + 3, + 9, + 11, + 3, + 2, + 3, + 4, + 7, + 0, + 2, + 5, + 16, + 0, + 7, + 2, + 14, + 5, + 2 + ], + "weighted_loads": [ + 0.36863897927105427, + 0.09222116321325302, + 0.03598049655556679, + 1.0681119551882148, + 0.8440679311752319, + 0.7574212998151779, + 0.0, + 0.4482007008045912, + 0.5089745745062828, + 0.31960856169462204, + 0.04405001550912857, + 0.0, + 0.5141204446554184, + 0.5357520580291748, + 0.049426570534706116, + 0.04450688138604164, + 0.5837512705475092, + 0.1797383353114128, + 0.137948390096426, + 0.0, + 0.03092345781624317, + 0.18518813140690327, + 0.3748491369187832, + 1.2730942852795124, + 0.04776608571410179, + 0.0, + 0.48185108229517937, + 0.4482506550848484, + 2.567705176770687, + 1.8993999175727367, + 0.9550083288922906, + 0.8115452770143747, + 0.22553909197449684, + 0.39427048340439796, + 0.3597065880894661, + 0.6994872055947781, + 0.04820826277136803, + 0.4277913384139538, + 1.607896190136671, + 0.0, + 0.3977206777781248, + 1.1943927146494389, + 0.4658784419298172, + 0.2861827202141285, + 1.2981573846191168, + 0.35174690559506416, + 0.14496587589383125, + 0.435318261384964, + 0.6894536167383194, + 0.15535561367869377, + 0.06547838635742664, + 0.1806853637099266, + 0.2063462845981121, + 0.45560888200998306, + 0.0, + 0.0728626549243927, + 0.3152916934341192, + 0.9625403024256229, + 0.0, + 0.4907281640917063, + 0.07014894858002663, + 0.7120066173374653, + 0.22023938223719597, + 0.10024329274892807 + ], + "unique_experts": 57, + "load_cv": 0.8239049972202163, + "normalized_load_entropy": 0.9144935057783861, + "max_load_share": 0.0546875 + } + }, + "s0_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "552e3b759087dc9abed9beb3c8149b3cd3d9c15ef3dca1ff52000793ab1475b5", + "route_weight_sha256": "7c8379a519a0f1d65bf6b9c1a44122138ead4f4301146fcc021a78b41cad2167", + "loads": [ + 3, + 2, + 1, + 6, + 2, + 6, + 0, + 3, + 1, + 0, + 0, + 0, + 4, + 7, + 1, + 1, + 6, + 1, + 2, + 0, + 1, + 2, + 2, + 3, + 1, + 0, + 4, + 0, + 1, + 0, + 1, + 6, + 1, + 3, + 3, + 1, + 1, + 3, + 2, + 0, + 5, + 2, + 0, + 2, + 4, + 0, + 0, + 2, + 4, + 3, + 0, + 4, + 4, + 3, + 0, + 1, + 4, + 8, + 1, + 4, + 0, + 4, + 0, + 2 + ], + "weighted_loads": [ + 0.16167156398296356, + 0.09724314883351326, + 0.0397670716047287, + 1.0342780835926533, + 0.1579706072807312, + 0.7313317134976387, + 0.0, + 0.12938721477985382, + 0.041045911610126495, + 0.0, + 0.0, + 0.0, + 0.38795626908540726, + 0.48464488238096237, + 0.04923969879746437, + 0.04526056721806526, + 0.3235705681145191, + 0.06169545650482178, + 0.11043308675289154, + 0.0, + 0.031682271510362625, + 0.05766081064939499, + 0.23901744186878204, + 0.7089431546628475, + 0.04701320454478264, + 0.0, + 0.32188090309500694, + 0.0, + 0.06284240633249283, + 0.0, + 0.042105525732040405, + 0.46654487773776054, + 0.04887114465236664, + 0.16234607249498367, + 0.10283416509628296, + 0.026638470590114594, + 0.052050285041332245, + 0.25861399061977863, + 0.11015753075480461, + 0.0, + 0.33507006242871284, + 0.09608400613069534, + 0.0, + 0.08766709640622139, + 0.14265869557857513, + 0.0, + 0.0, + 0.09565924853086472, + 0.29483989626169205, + 0.14873743802309036, + 0.0, + 0.24449555948376656, + 0.20601676404476166, + 0.2343565598130226, + 0.0, + 0.04188069701194763, + 0.29222287610173225, + 0.621707133948803, + 0.043020304292440414, + 0.39088810980319977, + 0.0, + 0.21542267873883247, + 0.0, + 0.10132618993520737 + ], + "unique_experts": 48, + "load_cv": 0.9247012835332911, + "normalized_load_entropy": 0.8860350846279371, + "max_load_share": 0.057971014492753624 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "5e0d88279a6061a56fdbc2219ac5e279cfeb0ea82ad2b9b88c5116d1c3ef84dd", + "route_weight_sha256": "261df27dcafcb3f8a85ccfc5fbb038835ed90341ab5e0ba51ff7816872bcd4e7", + "loads": [ + 3, + 2, + 1, + 10, + 5, + 6, + 0, + 6, + 7, + 0, + 0, + 0, + 9, + 7, + 1, + 1, + 10, + 1, + 2, + 0, + 1, + 2, + 3, + 12, + 1, + 0, + 5, + 8, + 18, + 10, + 3, + 11, + 2, + 5, + 3, + 9, + 1, + 7, + 17, + 0, + 5, + 8, + 5, + 3, + 5, + 1, + 2, + 7, + 7, + 3, + 1, + 4, + 4, + 3, + 0, + 1, + 7, + 8, + 1, + 6, + 0, + 9, + 4, + 5 + ], + "weighted_loads": [ + 0.16167156398296356, + 0.09724314883351326, + 0.0397670716047287, + 1.158460139296949, + 0.8283047284930944, + 0.7313317134976387, + 0.0, + 0.28753067553043365, + 0.4198247417807579, + 0.0, + 0.0, + 0.0, + 0.6662969812750816, + 0.48464488238096237, + 0.04923969879746437, + 0.04526056721806526, + 0.5728825144469738, + 0.06169545650482178, + 0.11043308675289154, + 0.0, + 0.031682271510362625, + 0.05766081064939499, + 0.28672829270362854, + 1.3383164443075657, + 0.04701320454478264, + 0.0, + 0.3546464964747429, + 0.4359850976616144, + 2.246441040188074, + 1.319131638854742, + 0.1045248406007886, + 0.8656030595302582, + 0.09516271948814392, + 0.24085461348295212, + 0.10283416509628296, + 0.5686942338943481, + 0.052050285041332245, + 0.3719093780964613, + 1.5024398155510426, + 0.0, + 0.33507006242871284, + 0.7144971638917923, + 0.320875845849514, + 0.18380461260676384, + 0.19181810691952705, + 0.03696048632264137, + 0.10105713084340096, + 0.3622462749481201, + 0.5044039189815521, + 0.14873743802309036, + 0.012954654172062874, + 0.24449555948376656, + 0.20601676404476166, + 0.2343565598130226, + 0.0, + 0.04188069701194763, + 0.42382737435400486, + 0.621707133948803, + 0.043020304292440414, + 0.4759081806987524, + 0.0, + 0.431312819942832, + 0.1676100641489029, + 0.2008579522371292 + ], + "unique_experts": 55, + "load_cv": 0.8940820521906157, + "normalized_load_entropy": 0.90109018449846, + "max_load_share": 0.0625 + } + }, + "s1_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "7e8b09edea4abfe6095bb5d72766754961e1eb211156ab74631f3d07e55e21c9", + "route_weight_sha256": "3def75fb110fa50ebc9ee8ebcd5b84ec10081a7759e7ac96fbfcd8364af28596", + "loads": [ + 3, + 2, + 1, + 6, + 2, + 6, + 0, + 3, + 2, + 0, + 0, + 0, + 4, + 8, + 1, + 1, + 7, + 1, + 2, + 0, + 1, + 2, + 2, + 3, + 1, + 0, + 4, + 0, + 1, + 0, + 1, + 6, + 1, + 3, + 3, + 1, + 1, + 2, + 2, + 0, + 5, + 2, + 0, + 2, + 2, + 0, + 0, + 2, + 4, + 3, + 0, + 3, + 4, + 4, + 0, + 1, + 4, + 8, + 0, + 4, + 0, + 5, + 0, + 2 + ], + "weighted_loads": [ + 0.1772470958530903, + 0.09517400711774826, + 0.03691418841481209, + 1.0316211730241776, + 0.17410061322152615, + 0.7547478079795837, + 0.0, + 0.13280954584479332, + 0.0804717019200325, + 0.0, + 0.0, + 0.0, + 0.34951914846897125, + 0.5953292325139046, + 0.048984188586473465, + 0.043879300355911255, + 0.32610406540334225, + 0.06264002621173859, + 0.10200108960270882, + 0.0, + 0.03130722790956497, + 0.06682379730045795, + 0.24928368628025055, + 0.6820230707526207, + 0.04590274766087532, + 0.0, + 0.31843882612884045, + 0.0, + 0.060957033187150955, + 0.0, + 0.04729299247264862, + 0.45543170161545277, + 0.049703437834978104, + 0.1615174114704132, + 0.1034916341304779, + 0.028242863714694977, + 0.047383733093738556, + 0.23519092798233032, + 0.10916953161358833, + 0.0, + 0.35285813361406326, + 0.10090694949030876, + 0.0, + 0.09122441709041595, + 0.06537232920527458, + 0.0, + 0.0, + 0.09729436039924622, + 0.26640039309859276, + 0.13771484047174454, + 0.0, + 0.180930957198143, + 0.20843670144677162, + 0.2877649776637554, + 0.0, + 0.04274355247616768, + 0.28635120019316673, + 0.5989822298288345, + 0.0, + 0.3713229224085808, + 0.0, + 0.2636561542749405, + 0.0, + 0.10030974820256233 + ], + "unique_experts": 47, + "load_cv": 0.9638498385314669, + "normalized_load_entropy": 0.8795797972270356, + "max_load_share": 0.057971014492753624 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "b5e2ad62b2c113819735225f43e630782efc8be88c087d6a1cd801757541672e", + "route_weight_sha256": "2fa8423fccee1b9d8e0ac61a65aab0504dcca808cfe4dfda6d10fce3964d30ff", + "loads": [ + 7, + 2, + 1, + 8, + 5, + 6, + 0, + 11, + 8, + 3, + 1, + 0, + 7, + 8, + 1, + 1, + 11, + 3, + 3, + 0, + 1, + 4, + 5, + 10, + 1, + 0, + 8, + 7, + 20, + 15, + 12, + 10, + 5, + 7, + 8, + 9, + 1, + 6, + 22, + 0, + 6, + 14, + 8, + 6, + 14, + 4, + 4, + 9, + 11, + 3, + 2, + 3, + 4, + 7, + 0, + 2, + 5, + 14, + 0, + 7, + 2, + 14, + 6, + 2 + ], + "weighted_loads": [ + 0.36961830221116543, + 0.09517400711774826, + 0.03691418841481209, + 1.0861630430445075, + 0.8475167099386454, + 0.7547478079795837, + 0.0, + 0.5240063760429621, + 0.5482997223734856, + 0.31960856169462204, + 0.04405001550912857, + 0.0, + 0.47350579500198364, + 0.5953292325139046, + 0.048984188586473465, + 0.043879300355911255, + 0.6323258075863123, + 0.1765795275568962, + 0.13760216161608696, + 0.0, + 0.03130722790956497, + 0.15754062496125698, + 0.3718464560806751, + 1.1857442893087864, + 0.04590274766087532, + 0.0, + 0.4723312798887491, + 0.3722468428313732, + 2.6279702112078667, + 1.9281716123223305, + 0.9080226803198457, + 0.800588907673955, + 0.22674834355711937, + 0.40351948514580727, + 0.3580280840396881, + 0.6577834505587816, + 0.047383733093738556, + 0.40785757824778557, + 1.6570405326783657, + 0.0, + 0.3824159037321806, + 1.2806791178882122, + 0.5158507376909256, + 0.28862638771533966, + 1.2214966043829918, + 0.3105485215783119, + 0.2047317773103714, + 0.4313310869038105, + 0.676508154720068, + 0.13771484047174454, + 0.06547838635742664, + 0.180930957198143, + 0.20843670144677162, + 0.4467405900359154, + 0.0, + 0.07406218349933624, + 0.31396820954978466, + 0.862439040094614, + 0.0, + 0.48292757757008076, + 0.07014894858002663, + 0.7171653211116791, + 0.25688452273607254, + 0.10030974820256233 + ], + "unique_experts": 57, + "load_cv": 0.8207381501496753, + "normalized_load_entropy": 0.914893889624909, + "max_load_share": 0.057291666666666664 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "ordered_topk_exact_tokens": 19, + "set_exact_tokens": 20, + "mean_set_jaccard": 0.9534161490683231, + "mean_token_weighted_tv": 0.01285028971893632, + "aggregate_load_tv": 0.028985507246376812 + }, + "system_bos": { + "tokens": 23, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.9037267080745341, + "mean_token_weighted_tv": 0.0231421093011032, + "aggregate_load_tv": 0.05797101449275363 + }, + "system_x": { + "tokens": 23, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.9503105590062113, + "mean_token_weighted_tv": 0.01973556585447944, + "aggregate_load_tv": 0.028985507246376815 + }, + "system_period": { + "tokens": 23, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 18, + "mean_set_jaccard": 0.9378881987577639, + "mean_token_weighted_tv": 0.02211921289563179, + "aggregate_load_tv": 0.036231884057971016 + }, + "bos_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.9006211180124223, + "mean_token_weighted_tv": 0.024488086771705875, + "aggregate_load_tv": 0.057971014492753624 + }, + "bos_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 18, + "mean_set_jaccard": 0.9378881987577639, + "mean_token_weighted_tv": 0.020092403516173363, + "aggregate_load_tv": 0.03623188405797102 + }, + "x_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.9409937888198759, + "mean_token_weighted_tv": 0.022084388153060623, + "aggregate_load_tv": 0.036231884057971016 + }, + "x_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.9130434782608695, + "mean_token_weighted_tv": 0.027408705214443413, + "aggregate_load_tv": 0.050724637681159424 + }, + "period_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.9409937888198759, + "mean_token_weighted_tv": 0.022820983082056046, + "aggregate_load_tv": 0.036231884057971016 + }, + "period_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.888198757763975, + "mean_token_weighted_tv": 0.031206967349609604, + "aggregate_load_tv": 0.06521739130434782 + } + } + }, + "layer_13": { + "layer": 13, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "347a54b7f7d612cf25249e4c683369df030332c2462c9c5a200d9d45148f2df5", + "route_weight_sha256": "48ecd5773e5950b34ebfa3f291258189c565a86541acd46c104e4a9ba0dd68fb", + "loads": [ + 3, + 1, + 0, + 0, + 0, + 4, + 14, + 0, + 0, + 1, + 3, + 0, + 0, + 2, + 8, + 3, + 1, + 1, + 1, + 1, + 0, + 3, + 5, + 0, + 0, + 0, + 9, + 2, + 3, + 0, + 0, + 1, + 1, + 2, + 1, + 4, + 0, + 1, + 1, + 0, + 0, + 3, + 4, + 0, + 0, + 2, + 2, + 7, + 0, + 0, + 8, + 0, + 2, + 2, + 2, + 0, + 0, + 3, + 9, + 1, + 1, + 4, + 3, + 9 + ], + "weighted_loads": [ + 0.10762865282595158, + 0.03764505311846733, + 0.0, + 0.0, + 0.0, + 0.2181466482579708, + 1.079337041825056, + 0.0, + 0.0, + 0.02943781204521656, + 0.10739862732589245, + 0.0, + 0.0, + 0.24118024110794067, + 0.8939077444374561, + 0.11086684837937355, + 0.044653233140707016, + 0.031041420996189117, + 0.02638055384159088, + 0.029853608459234238, + 0.0, + 0.13161875680088997, + 0.3316824361681938, + 0.0, + 0.0, + 0.0, + 0.5015861950814724, + 0.14229194819927216, + 0.09808221645653248, + 0.0, + 0.0, + 0.04433194547891617, + 0.02431575581431389, + 0.08117084950208664, + 0.19805699586868286, + 0.3198679983615875, + 0.0, + 0.031857773661613464, + 0.03649063780903816, + 0.0, + 0.0, + 0.20517623052001, + 0.3082461580634117, + 0.0, + 0.0, + 0.1724480465054512, + 0.08503275737166405, + 0.24350639432668686, + 0.0, + 0.0, + 0.4815439432859421, + 0.0, + 0.10065338388085365, + 0.07938964292407036, + 0.07876026257872581, + 0.0, + 0.0, + 0.1341780610382557, + 1.2729994878172874, + 0.029219187796115875, + 0.05277027189731598, + 0.21371963247656822, + 0.18317805230617523, + 0.5409268401563168 + ], + "unique_experts": 41, + "load_cv": 1.327571039351288, + "normalized_load_entropy": 0.8173734373689502, + "max_load_share": 0.10144927536231885 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "ee3c699e7364abf4312037d0883a98894d7ef451ea6f540e27436a5d85985bd8", + "route_weight_sha256": "c5a27e30d5417c5d9e87bc0262b6c620e4510eca115194d259864f04a9359885", + "loads": [ + 3, + 7, + 0, + 0, + 0, + 5, + 33, + 0, + 0, + 4, + 14, + 6, + 0, + 2, + 9, + 9, + 1, + 3, + 2, + 2, + 0, + 4, + 5, + 0, + 4, + 0, + 12, + 2, + 3, + 14, + 0, + 1, + 1, + 9, + 2, + 4, + 4, + 2, + 1, + 1, + 0, + 5, + 6, + 2, + 10, + 12, + 4, + 9, + 1, + 0, + 9, + 0, + 6, + 5, + 4, + 0, + 3, + 3, + 15, + 6, + 1, + 5, + 3, + 10 + ], + "weighted_loads": [ + 0.10762865282595158, + 0.33423376455903053, + 0.0, + 0.0, + 0.0, + 0.24920915625989437, + 2.839528188109398, + 0.0, + 0.0, + 0.1422628853470087, + 0.8617876097559929, + 0.2705205441452563, + 0.0, + 0.24118024110794067, + 0.9393086954951286, + 0.42302563786506653, + 0.044653233140707016, + 0.0792785631492734, + 0.067670539021492, + 0.07165060564875603, + 0.0, + 0.16406575217843056, + 0.3316824361681938, + 0.0, + 0.1351856729015708, + 0.0, + 0.6286388896405697, + 0.14229194819927216, + 0.09808221645653248, + 0.9879368096590042, + 0.0, + 0.04433194547891617, + 0.02431575581431389, + 0.6882221288979053, + 0.22092837281525135, + 0.3198679983615875, + 0.19767536781728268, + 0.0655343234539032, + 0.03649063780903816, + 0.03561369329690933, + 0.0, + 0.29967112094163895, + 0.4107743799686432, + 0.09470513835549355, + 0.9070617072284222, + 1.1392522417008877, + 0.15215302258729935, + 1.4353336915373802, + 0.03200826048851013, + 0.0, + 0.518225759267807, + 0.0, + 0.2417331300675869, + 0.22111764550209045, + 0.1669634934514761, + 0.0, + 0.168011624366045, + 0.1341780610382557, + 1.5511530973017216, + 0.2720947563648224, + 0.05277027189731598, + 0.24339192733168602, + 0.18317805230617523, + 0.5786673091351986 + ], + "unique_experts": 50, + "load_cv": 1.1856914428007248, + "normalized_load_entropy": 0.8610368627823967, + "max_load_share": 0.11458333333333333 + } + }, + "s1_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "b0c57fbb3190b2bfd7bccaa22c4cb38aa82f7c9a9e66f84e54fca54417389be2", + "route_weight_sha256": "9703ed71bd7ee62d442e32c716d7fad32c72d106e9051e1e1cfc11ac755990fa", + "loads": [ + 3, + 2, + 0, + 0, + 0, + 4, + 14, + 0, + 0, + 1, + 3, + 0, + 0, + 2, + 8, + 3, + 1, + 0, + 1, + 0, + 0, + 3, + 6, + 0, + 0, + 0, + 9, + 2, + 1, + 0, + 0, + 1, + 0, + 2, + 1, + 6, + 1, + 1, + 1, + 0, + 0, + 3, + 4, + 0, + 0, + 2, + 2, + 7, + 0, + 0, + 8, + 0, + 2, + 2, + 2, + 0, + 0, + 3, + 9, + 1, + 1, + 3, + 4, + 9 + ], + "weighted_loads": [ + 0.10639042779803276, + 0.06715260073542595, + 0.0, + 0.0, + 0.0, + 0.21849378943443298, + 1.046197883784771, + 0.0, + 0.0, + 0.029737595468759537, + 0.10882280208170414, + 0.0, + 0.0, + 0.23725884407758713, + 0.891242727637291, + 0.10891512036323547, + 0.0424816757440567, + 0.0, + 0.027806008234620094, + 0.0, + 0.0, + 0.13209808245301247, + 0.3628485705703497, + 0.0, + 0.0, + 0.0, + 0.4889045227319002, + 0.14213211461901665, + 0.03672946244478226, + 0.0, + 0.0, + 0.0434560626745224, + 0.0, + 0.08038507029414177, + 0.20403552055358887, + 0.38356004282832146, + 0.02526222914457321, + 0.03145534172654152, + 0.03364944085478783, + 0.0, + 0.0, + 0.20462001487612724, + 0.3215077668428421, + 0.0, + 0.0, + 0.17900285869836807, + 0.08240818604826927, + 0.24892190843820572, + 0.0, + 0.0, + 0.4683682285249233, + 0.0, + 0.10261645913124084, + 0.07914796657860279, + 0.07768275961279869, + 0.0, + 0.0, + 0.12505783885717392, + 1.2764235585927963, + 0.03145831078290939, + 0.05062674731016159, + 0.1767597608268261, + 0.22164836898446083, + 0.5285563245415688 + ], + "unique_experts": 39, + "load_cv": 1.3576082605213908, + "normalized_load_entropy": 0.8069205122094651, + "max_load_share": 0.10144927536231885 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "de5330567c4f92aec7f747d8b666e0d95e8ad4e044a41cc631603bfdbabec09a", + "route_weight_sha256": "6113c9203ae357c87547b2b8b44ba9d6d4a7a4f07648ab6205870e698a86029e", + "loads": [ + 8, + 8, + 0, + 0, + 0, + 5, + 44, + 0, + 0, + 4, + 14, + 12, + 0, + 2, + 9, + 10, + 1, + 2, + 3, + 3, + 0, + 7, + 6, + 3, + 4, + 0, + 13, + 2, + 1, + 19, + 7, + 2, + 0, + 14, + 4, + 7, + 6, + 2, + 2, + 1, + 2, + 8, + 12, + 2, + 16, + 13, + 3, + 10, + 2, + 5, + 9, + 0, + 5, + 4, + 4, + 2, + 3, + 14, + 17, + 5, + 2, + 5, + 4, + 12 + ], + "weighted_loads": [ + 0.3082686923444271, + 0.3874041363596916, + 0.0, + 0.0, + 0.0, + 0.25468312948942184, + 3.6555321719497442, + 0.0, + 0.0, + 0.1724429875612259, + 0.8313901592046022, + 0.7780139478854835, + 0.0, + 0.23725884407758713, + 0.9348619468510151, + 0.47667016088962555, + 0.0424816757440567, + 0.05292109679430723, + 0.0963260568678379, + 0.12280135601758957, + 0.0, + 0.32476277090609074, + 0.3628485705703497, + 0.12172871828079224, + 0.156082050409168, + 0.0, + 0.6464884895831347, + 0.14213211461901665, + 0.03672946244478226, + 1.6611144058406353, + 0.39069513976573944, + 0.08325839415192604, + 0.0, + 1.208255559206009, + 0.4292806703597307, + 0.4345775246620178, + 0.3174432534724474, + 0.0648152232170105, + 0.07561490684747696, + 0.04302026703953743, + 0.08159289509057999, + 0.42644723132252693, + 0.9865793474018574, + 0.11164906993508339, + 1.3913220688700676, + 1.1409285739064217, + 0.12443449720740318, + 1.4777874536812305, + 0.25383568555116653, + 0.24627847969532013, + 0.5031712874770164, + 0.0, + 0.20714770630002022, + 0.16182280518114567, + 0.1479109488427639, + 0.07155315577983856, + 0.155318982899189, + 0.8328640349209309, + 1.6301598362624645, + 0.22676437720656395, + 0.07927880994975567, + 0.2638652678579092, + 0.22164836898446083, + 0.645381473004818 + ], + "unique_experts": 54, + "load_cv": 1.1376602451230038, + "normalized_load_entropy": 0.8766233825510312, + "max_load_share": 0.11458333333333333 + } + }, + "s0_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "c08fdd2b365f7f647969ab990404a0882c0bfa0e4f06fd6e65d5c6814840da3a", + "route_weight_sha256": "3fbbf751ef679a89b914dedcbd4f0d186fbefaa01f529d411d20c7760191f1fe", + "loads": [ + 3, + 1, + 0, + 0, + 0, + 4, + 14, + 0, + 0, + 0, + 3, + 1, + 0, + 2, + 8, + 3, + 1, + 1, + 1, + 1, + 0, + 3, + 6, + 0, + 0, + 0, + 9, + 2, + 1, + 0, + 0, + 1, + 0, + 2, + 1, + 5, + 0, + 1, + 1, + 0, + 0, + 4, + 4, + 0, + 0, + 2, + 2, + 6, + 0, + 0, + 8, + 0, + 2, + 2, + 3, + 0, + 0, + 3, + 9, + 1, + 1, + 3, + 4, + 9 + ], + "weighted_loads": [ + 0.10475825890898705, + 0.03991730511188507, + 0.0, + 0.0, + 0.0, + 0.21474717184901237, + 1.0130997505038977, + 0.0, + 0.0, + 0.0, + 0.10591588169336319, + 0.0235760360956192, + 0.0, + 0.235576793551445, + 0.8582163266837597, + 0.10917918756604195, + 0.04502927139401436, + 0.0307710412889719, + 0.024885354563593864, + 0.02997143380343914, + 0.0, + 0.13053162768483162, + 0.36109356582164764, + 0.0, + 0.0, + 0.0, + 0.5169082209467888, + 0.14455927908420563, + 0.037829309701919556, + 0.0, + 0.0, + 0.04311726242303848, + 0.0, + 0.08074945583939552, + 0.19728076457977295, + 0.3518297038972378, + 0.0, + 0.031296256929636, + 0.03269743174314499, + 0.0, + 0.0, + 0.23939995095133781, + 0.32416723296046257, + 0.0, + 0.0, + 0.18302127718925476, + 0.08657865598797798, + 0.2173697054386139, + 0.0, + 0.0, + 0.4516556151211262, + 0.0, + 0.10422837734222412, + 0.0807034857571125, + 0.0975797176361084, + 0.0, + 0.0, + 0.12580625712871552, + 1.3224833495914936, + 0.03001592308282852, + 0.04690397530794144, + 0.17870868369936943, + 0.22196362912654877, + 0.5851098448038101 + ], + "unique_experts": 40, + "load_cv": 1.3401683661904016, + "normalized_load_entropy": 0.8118019662915502, + "max_load_share": 0.10144927536231885 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "9b51f44a70af4d701608c40fb839d73b5ce75d84637d0945292eb3124270f258", + "route_weight_sha256": "7c7df16e373f80f5c1a25856b9752b5adebae60a32e82a12cbf1e01ec3922da8", + "loads": [ + 3, + 6, + 1, + 0, + 1, + 6, + 33, + 0, + 0, + 5, + 13, + 5, + 0, + 2, + 8, + 9, + 1, + 2, + 2, + 2, + 0, + 5, + 6, + 0, + 3, + 0, + 12, + 2, + 1, + 14, + 0, + 1, + 0, + 7, + 2, + 5, + 3, + 2, + 1, + 1, + 0, + 6, + 6, + 3, + 10, + 13, + 4, + 7, + 1, + 0, + 9, + 0, + 6, + 6, + 6, + 0, + 4, + 3, + 15, + 6, + 1, + 4, + 4, + 10 + ], + "weighted_loads": [ + 0.10475825890898705, + 0.305685892701149, + 0.06857357919216156, + 0.0, + 0.047575633972883224, + 0.2958314996212721, + 2.7599066067487, + 0.0, + 0.0, + 0.23377524316310883, + 0.7354861814528704, + 0.25811322405934334, + 0.0, + 0.235576793551445, + 0.8582163266837597, + 0.4213379770517349, + 0.04502927139401436, + 0.065974535420537, + 0.06617533974349499, + 0.07176843099296093, + 0.0, + 0.21216583997011185, + 0.36109356582164764, + 0.0, + 0.13939638063311577, + 0.0, + 0.6439609155058861, + 0.14455927908420563, + 0.037829309701919556, + 0.8981127701699734, + 0.0, + 0.04311726242303848, + 0.0, + 0.5865962319076061, + 0.22015214152634144, + 0.3518297038972378, + 0.15274706669151783, + 0.06497280672192574, + 0.03269743174314499, + 0.03561369329690933, + 0.0, + 0.33890780806541443, + 0.45060084760189056, + 0.17822496220469475, + 0.8482858054339886, + 1.1873957812786102, + 0.15369892120361328, + 0.5781069695949554, + 0.03200826048851013, + 0.0, + 0.4883374311029911, + 0.0, + 0.24530812352895737, + 0.2875402048230171, + 0.22310134954750538, + 0.0, + 0.284402821213007, + 0.12580625712871552, + 1.5985737834125757, + 0.27289149165153503, + 0.04690397530794144, + 0.20838097855448723, + 0.22196362912654877, + 0.622850313782692 + ], + "unique_experts": 51, + "load_cv": 1.1752331000725655, + "normalized_load_entropy": 0.86385123187111, + "max_load_share": 0.11458333333333333 + } + }, + "s1_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "a5d576db3bef3949fa1b9f0e99fd4653f366bb61739e8e1e3f76366ae58a31f4", + "route_weight_sha256": "3be5ba92645590083924a033434692b7b39051efc1a0a9fdcfa63c5906483911", + "loads": [ + 3, + 2, + 0, + 0, + 0, + 4, + 14, + 0, + 0, + 0, + 3, + 1, + 0, + 2, + 9, + 3, + 1, + 1, + 1, + 0, + 0, + 3, + 6, + 0, + 0, + 0, + 7, + 2, + 1, + 0, + 0, + 1, + 1, + 1, + 1, + 6, + 0, + 1, + 1, + 0, + 1, + 4, + 4, + 0, + 0, + 3, + 1, + 6, + 0, + 0, + 8, + 0, + 2, + 2, + 2, + 0, + 0, + 3, + 9, + 1, + 1, + 3, + 4, + 9 + ], + "weighted_loads": [ + 0.10513738915324211, + 0.07457319274544716, + 0.0, + 0.0, + 0.0, + 0.22451551631093025, + 0.9563186168670654, + 0.0, + 0.0, + 0.0, + 0.10754873603582382, + 0.02366844192147255, + 0.0, + 0.24475394189357758, + 0.9091021306812763, + 0.10562663152813911, + 0.044515207409858704, + 0.031210437417030334, + 0.030205821618437767, + 0.0, + 0.0, + 0.13413629308342934, + 0.36814339086413383, + 0.0, + 0.0, + 0.0, + 0.43131942860782146, + 0.14448769390583038, + 0.03669644892215729, + 0.0, + 0.0, + 0.045023027807474136, + 0.024901043623685837, + 0.045000143349170685, + 0.1886974424123764, + 0.3922571837902069, + 0.0, + 0.033120047301054, + 0.03119935281574726, + 0.0, + 0.03326923027634621, + 0.2365914061665535, + 0.3448999673128128, + 0.0, + 0.0, + 0.22541508823633194, + 0.046887341886758804, + 0.22463046573102474, + 0.0, + 0.0, + 0.4520421512424946, + 0.0, + 0.0975685827434063, + 0.07944191992282867, + 0.07457239925861359, + 0.0, + 0.0, + 0.1274009607732296, + 1.3313499055802822, + 0.030924830585718155, + 0.04601503536105156, + 0.17651624977588654, + 0.2237619273364544, + 0.5494064763188362 + ], + "unique_experts": 41, + "load_cv": 1.3326242601009242, + "normalized_load_entropy": 0.8147589481945776, + "max_load_share": 0.10144927536231885 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "42427655e7bb1384db8f33bb0ca9683829a1f0f9854964a5bc91e75b2b4cd7fc", + "route_weight_sha256": "24e8d43e70c5891d6ffe8f84ac65347a50f75ae104d344fd4e1ee7c921420001", + "loads": [ + 8, + 9, + 1, + 0, + 0, + 5, + 44, + 0, + 0, + 4, + 16, + 11, + 0, + 2, + 9, + 10, + 1, + 2, + 3, + 3, + 0, + 6, + 6, + 3, + 4, + 0, + 11, + 2, + 1, + 19, + 7, + 2, + 1, + 12, + 4, + 7, + 6, + 2, + 2, + 1, + 3, + 8, + 12, + 2, + 16, + 15, + 2, + 8, + 2, + 5, + 9, + 0, + 5, + 4, + 4, + 2, + 4, + 14, + 17, + 5, + 2, + 5, + 4, + 12 + ], + "weighted_loads": [ + 0.30701565369963646, + 0.44549626111984253, + 0.048413053154945374, + 0.0, + 0.0, + 0.2607048563659191, + 3.621496492996812, + 0.0, + 0.0, + 0.19922002404928207, + 0.9109264127910137, + 0.7702641300857067, + 0.0, + 0.24475394189357758, + 0.9091021306812763, + 0.4733816720545292, + 0.044515207409858704, + 0.07045422866940498, + 0.09872587025165558, + 0.12280135601758957, + 0.0, + 0.2982895113527775, + 0.36814339086413383, + 0.12172871828079224, + 0.21293218433856964, + 0.0, + 0.5889033954590559, + 0.14448769390583038, + 0.03669644892215729, + 1.5927298478782177, + 0.39069513976573944, + 0.08482535928487778, + 0.024901043623685837, + 1.0952606536448002, + 0.41394259221851826, + 0.4432746656239033, + 0.34137928299605846, + 0.06647992879152298, + 0.0731648188084364, + 0.04302026703953743, + 0.1148621253669262, + 0.4233275130391121, + 1.0288642905652523, + 0.11239949241280556, + 1.3051084280014038, + 1.2331521734595299, + 0.08891365304589272, + 0.6238107997924089, + 0.25383568555116653, + 0.24627847969532013, + 0.4868452101945877, + 0.0, + 0.20209982991218567, + 0.16211675852537155, + 0.1448005884885788, + 0.07155315577983856, + 0.1940416470170021, + 0.8352071568369865, + 1.6646347548812628, + 0.2262308970093727, + 0.07466709800064564, + 0.26362175680696964, + 0.2237619273364544, + 0.6662316247820854 + ], + "unique_experts": 56, + "load_cv": 1.131923142267177, + "normalized_load_entropy": 0.8808304436765805, + "max_load_share": 0.11458333333333333 + } + }, + "s0_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "a7fb01590a190dbd6d2bd06b5cc077702c1a58d54b48a6dacb5ec945bf5eefcb", + "route_weight_sha256": "0b2df712ca2de6a96209d7742307c56296bf19e0bd01bf7e16d344127dee9e41", + "loads": [ + 3, + 2, + 0, + 0, + 0, + 4, + 15, + 0, + 0, + 0, + 3, + 1, + 0, + 2, + 8, + 3, + 1, + 1, + 0, + 1, + 0, + 3, + 5, + 0, + 0, + 0, + 9, + 2, + 1, + 0, + 0, + 1, + 1, + 2, + 1, + 5, + 0, + 1, + 1, + 0, + 0, + 4, + 4, + 0, + 0, + 2, + 3, + 6, + 0, + 0, + 8, + 0, + 2, + 2, + 2, + 0, + 0, + 3, + 9, + 1, + 1, + 3, + 4, + 8 + ], + "weighted_loads": [ + 0.10922008380293846, + 0.07337813824415207, + 0.0, + 0.0, + 0.0, + 0.21070873737335205, + 1.1926155351102352, + 0.0, + 0.0, + 0.0, + 0.10838187299668789, + 0.025220997631549835, + 0.0, + 0.24428004771471024, + 0.8917889893054962, + 0.10972271114587784, + 0.04711915925145149, + 0.03232109919190407, + 0.0, + 0.03240149840712547, + 0.0, + 0.13234597817063332, + 0.3198775462806225, + 0.0, + 0.0, + 0.0, + 0.5136286281049252, + 0.15136565268039703, + 0.03766537457704544, + 0.0, + 0.0, + 0.04203144088387489, + 0.027622094377875328, + 0.08172538876533508, + 0.20693036913871765, + 0.3374963216483593, + 0.0, + 0.03162510320544243, + 0.0339820459485054, + 0.0, + 0.0, + 0.24245865270495415, + 0.2881644181907177, + 0.0, + 0.0, + 0.1887395679950714, + 0.11602229997515678, + 0.22201619111001492, + 0.0, + 0.0, + 0.43168481066823006, + 0.0, + 0.09503277018666267, + 0.07796010002493858, + 0.06631985120475292, + 0.0, + 0.0, + 0.13320139795541763, + 1.300601091235876, + 0.030440909788012505, + 0.050834253430366516, + 0.16689686849713326, + 0.22386032715439796, + 0.5288165807723999 + ], + "unique_experts": 40, + "load_cv": 1.3451742652246683, + "normalized_load_entropy": 0.8131655768199918, + "max_load_share": 0.10869565217391304 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "d60936b2eff04fbcdbc028578fe2f44c45dc4e19c5257ad2282b82cfe22e28b3", + "route_weight_sha256": "3e926d1d93eaef84cd544bbdd46238b6d9906e25ad4f2dd7d6276022b828f5c2", + "loads": [ + 3, + 7, + 0, + 0, + 0, + 6, + 33, + 0, + 0, + 2, + 13, + 6, + 0, + 2, + 8, + 10, + 1, + 2, + 2, + 2, + 0, + 5, + 5, + 0, + 5, + 0, + 12, + 2, + 1, + 15, + 0, + 1, + 1, + 9, + 2, + 5, + 3, + 2, + 1, + 1, + 0, + 6, + 5, + 1, + 12, + 14, + 6, + 7, + 1, + 0, + 9, + 0, + 6, + 5, + 4, + 0, + 4, + 3, + 14, + 6, + 1, + 4, + 4, + 9 + ], + "weighted_loads": [ + 0.10922008380293846, + 0.3265717886388302, + 0.0, + 0.0, + 0.0, + 0.29729357548058033, + 2.7958599403500557, + 0.0, + 0.0, + 0.07670933380723, + 0.6773307174444199, + 0.3112154006958008, + 0.0, + 0.24428004771471024, + 0.8917889893054962, + 0.6412321664392948, + 0.04711915925145149, + 0.06752459332346916, + 0.08669323846697807, + 0.07419849559664726, + 0.0, + 0.21580908074975014, + 0.3198775462806225, + 0.0, + 0.22941865026950836, + 0.0, + 0.6406813226640224, + 0.15136565268039703, + 0.03766537457704544, + 0.9724357612431049, + 0.0, + 0.04203144088387489, + 0.027622094377875328, + 0.728842917829752, + 0.22980174608528614, + 0.3374963216483593, + 0.15828399918973446, + 0.06530165299773216, + 0.0339820459485054, + 0.03561369329690933, + 0.0, + 0.34561488404870033, + 0.3404918387532234, + 0.04552072659134865, + 0.9859677106142044, + 1.3925708755850792, + 0.21150623261928558, + 0.5827534552663565, + 0.03200826048851013, + 0.0, + 0.468366626650095, + 0.0, + 0.23611251637339592, + 0.21968810260295868, + 0.1545230820775032, + 0.0, + 0.199457548558712, + 0.13320139795541763, + 1.534253604710102, + 0.273316478356719, + 0.050834253430366516, + 0.19656916335225105, + 0.22386032715439796, + 0.5665570497512817 + ], + "unique_experts": 50, + "load_cv": 1.2012082394688697, + "normalized_load_entropy": 0.8564976279490619, + "max_load_share": 0.11458333333333333 + } + }, + "s1_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "c88ef6ebd5b15db8d32946b9d42a8fe285db60814e7e3172f7de58c127617838", + "route_weight_sha256": "a45f9998f07bdb9d4d1e5ad6ca26177bf69aad84baee39763d021facfd6302d4", + "loads": [ + 3, + 2, + 0, + 0, + 0, + 4, + 15, + 0, + 0, + 0, + 3, + 1, + 0, + 2, + 9, + 1, + 1, + 1, + 0, + 0, + 0, + 3, + 5, + 0, + 0, + 0, + 7, + 2, + 3, + 0, + 0, + 1, + 1, + 2, + 1, + 5, + 0, + 1, + 1, + 0, + 0, + 5, + 4, + 0, + 0, + 2, + 3, + 6, + 0, + 0, + 8, + 0, + 2, + 1, + 1, + 0, + 0, + 3, + 9, + 1, + 2, + 3, + 5, + 9 + ], + "weighted_loads": [ + 0.10744188912212849, + 0.07018701732158661, + 0.0, + 0.0, + 0.0, + 0.21207239851355553, + 1.1011833995580673, + 0.0, + 0.0, + 0.0, + 0.10792372934520245, + 0.023015063256025314, + 0.0, + 0.24688025563955307, + 0.9038846641778946, + 0.034815456718206406, + 0.04734712094068527, + 0.029371630400419235, + 0.0, + 0.0, + 0.0, + 0.13717766478657722, + 0.3082821685820818, + 0.0, + 0.0, + 0.0, + 0.4098238069564104, + 0.14859211444854736, + 0.10375641658902168, + 0.0, + 0.0, + 0.038657501339912415, + 0.025287281721830368, + 0.0832035280764103, + 0.18795421719551086, + 0.34909315034747124, + 0.0, + 0.03193366155028343, + 0.030417587608098984, + 0.0, + 0.0, + 0.264211006462574, + 0.25330163538455963, + 0.0, + 0.0, + 0.16968367993831635, + 0.11711033247411251, + 0.22972160391509533, + 0.0, + 0.0, + 0.4405509252101183, + 0.0, + 0.10195691511034966, + 0.04382464662194252, + 0.0402151495218277, + 0.0, + 0.0, + 0.13339877873659134, + 1.2636970281600952, + 0.02935750037431717, + 0.0815390832722187, + 0.17513857409358025, + 0.2542464341968298, + 0.5978992022573948 + ], + "unique_experts": 39, + "load_cv": 1.3650142930254727, + "normalized_load_entropy": 0.806643728491178, + "max_load_share": 0.10869565217391304 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "ba3b7461e52b8f80fe2ab46e595eb673648f8a967dab4ea2efa6aebe50978184", + "route_weight_sha256": "072d08fcc07270d6d32fa2c2312ab58e86b9923558099f03d92886339f528c45", + "loads": [ + 8, + 8, + 0, + 0, + 0, + 6, + 44, + 0, + 0, + 1, + 12, + 11, + 0, + 2, + 9, + 9, + 1, + 2, + 3, + 3, + 0, + 8, + 5, + 3, + 5, + 0, + 12, + 2, + 3, + 19, + 7, + 2, + 1, + 15, + 4, + 6, + 6, + 2, + 2, + 1, + 2, + 10, + 12, + 0, + 18, + 14, + 5, + 8, + 2, + 5, + 9, + 0, + 5, + 3, + 3, + 3, + 3, + 15, + 14, + 5, + 3, + 6, + 5, + 12 + ], + "weighted_loads": [ + 0.30932015366852283, + 0.3370003141462803, + 0.0, + 0.0, + 0.0, + 0.29831164330244064, + 3.4947172421962023, + 0.0, + 0.0, + 0.030571382492780685, + 0.6852895338088274, + 0.7804206274449825, + 0.0, + 0.24688025563955307, + 0.9038846641778946, + 0.5450571142137051, + 0.04734712094068527, + 0.06861542165279388, + 0.10768722929060459, + 0.12280135601758957, + 0.0, + 0.3861619047820568, + 0.3082821685820818, + 0.12172871828079224, + 0.23863076977431774, + 0.0, + 0.6000097561627626, + 0.14859211444854736, + 0.10375641658902168, + 1.501402910798788, + 0.39069513976573944, + 0.07845983281731606, + 0.025287281721830368, + 1.2921166382730007, + 0.4131993670016527, + 0.4001106321811676, + 0.32633555121719837, + 0.06529354304075241, + 0.07238305360078812, + 0.04302026703953743, + 0.08159289509057999, + 0.49542946368455887, + 0.9146612174808979, + 0.0, + 1.4683881141245365, + 1.2787397503852844, + 0.20242160744965076, + 0.6289019379764795, + 0.25383568555116653, + 0.24627847969532013, + 0.4753539841622114, + 0.0, + 0.20648816227912903, + 0.1264994852244854, + 0.11044333875179291, + 0.11388832703232765, + 0.155318982899189, + 0.8738009333610535, + 1.439209097996354, + 0.22466356679797173, + 0.11019114591181278, + 0.2970429491251707, + 0.2542464341968298, + 0.714724350720644 + ], + "unique_experts": 54, + "load_cv": 1.1326897682556822, + "normalized_load_entropy": 0.8776638113932045, + "max_load_share": 0.11458333333333333 + } + }, + "s0_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "b2ddd411531628b797e4c69af699196cadc0d3d509b550dc8094233ae51b5c28", + "route_weight_sha256": "edf2966be001c7f2efc62c2737234eff66d1f9e4700b47ba9d34df98bc11b4a2", + "loads": [ + 3, + 2, + 0, + 0, + 0, + 4, + 15, + 0, + 0, + 0, + 3, + 1, + 0, + 2, + 8, + 3, + 1, + 1, + 0, + 1, + 0, + 3, + 5, + 0, + 0, + 0, + 8, + 2, + 1, + 0, + 0, + 1, + 1, + 2, + 1, + 5, + 0, + 1, + 1, + 0, + 0, + 5, + 4, + 0, + 0, + 2, + 3, + 6, + 0, + 0, + 8, + 0, + 2, + 2, + 3, + 0, + 0, + 3, + 9, + 1, + 1, + 3, + 3, + 8 + ], + "weighted_loads": [ + 0.11073939502239227, + 0.07138402760028839, + 0.0, + 0.0, + 0.0, + 0.20658284425735474, + 1.1813872940838337, + 0.0, + 0.0, + 0.0, + 0.1099873036146164, + 0.024279462173581123, + 0.0, + 0.2369653806090355, + 0.8911163955926895, + 0.11075284332036972, + 0.046009134501218796, + 0.03453703597187996, + 0.0, + 0.03160861134529114, + 0.0, + 0.13372160866856575, + 0.313862569630146, + 0.0, + 0.0, + 0.0, + 0.46850073523819447, + 0.1506551429629326, + 0.03904467821121216, + 0.0, + 0.0, + 0.03985267132520676, + 0.02591570094227791, + 0.08610860630869865, + 0.212870791554451, + 0.34767841175198555, + 0.0, + 0.031224515289068222, + 0.03197406604886055, + 0.0, + 0.0, + 0.27733371406793594, + 0.29805978015065193, + 0.0, + 0.0, + 0.1795147955417633, + 0.11150142922997475, + 0.22960536554455757, + 0.0, + 0.0, + 0.4243461526930332, + 0.0, + 0.10015415027737617, + 0.07856259495019913, + 0.09860292077064514, + 0.0, + 0.0, + 0.12593435123562813, + 1.2931163124740124, + 0.03140248358249664, + 0.05274131894111633, + 0.16844362020492554, + 0.18987278267741203, + 0.5254261493682861 + ], + "unique_experts": 40, + "load_cv": 1.3326242601009242, + "normalized_load_entropy": 0.8148683661125244, + "max_load_share": 0.10869565217391304 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "5d2929926c63dff28068743a5ef078b5f55704d9ec527f898d2fd332a3f358c2", + "route_weight_sha256": "b0a5880a6c6c5386234db3eb4a6421156675a882e4d52b43fe883788c01103bd", + "loads": [ + 3, + 8, + 0, + 0, + 0, + 6, + 32, + 0, + 0, + 3, + 14, + 6, + 0, + 2, + 9, + 9, + 1, + 2, + 2, + 2, + 0, + 3, + 5, + 0, + 4, + 0, + 11, + 2, + 1, + 15, + 0, + 1, + 1, + 9, + 2, + 5, + 4, + 2, + 1, + 1, + 0, + 9, + 6, + 2, + 11, + 13, + 5, + 7, + 1, + 0, + 9, + 0, + 6, + 5, + 5, + 0, + 3, + 3, + 14, + 6, + 1, + 4, + 3, + 9 + ], + "weighted_loads": [ + 0.11073939502239227, + 0.5015875324606895, + 0.0, + 0.0, + 0.0, + 0.2900117505341768, + 2.826485298573971, + 0.0, + 0.0, + 0.12325336411595345, + 0.7733265291899443, + 0.33663455583155155, + 0.0, + 0.2369653806090355, + 0.9241092093288898, + 0.4229116328060627, + 0.046009134501218796, + 0.06974053010344505, + 0.08734507113695145, + 0.07340560853481293, + 0.0, + 0.13372160866856575, + 0.313862569630146, + 0.0, + 0.26502302661538124, + 0.0, + 0.5955534297972918, + 0.1506551429629326, + 0.03904467821121216, + 1.042745005339384, + 0.0, + 0.03985267132520676, + 0.02591570094227791, + 0.717084638774395, + 0.23574216850101948, + 0.34767841175198555, + 0.21880974806845188, + 0.06490106508135796, + 0.03197406604886055, + 0.03561369329690933, + 0.0, + 0.44852485693991184, + 0.3891889527440071, + 0.10741507634520531, + 0.9545349553227425, + 1.1860730238258839, + 0.17862169444561005, + 0.5903426297008991, + 0.03200826048851013, + 0.0, + 0.46102796867489815, + 0.0, + 0.24123389646410942, + 0.22029059752821922, + 0.18680615164339542, + 0.0, + 0.168011624366045, + 0.12593435123562813, + 1.513163996860385, + 0.27427805215120316, + 0.05274131894111633, + 0.19811591506004333, + 0.18987278267741203, + 0.563166618347168 + ], + "unique_experts": 50, + "load_cv": 1.179165848710618, + "normalized_load_entropy": 0.859121559478416, + "max_load_share": 0.1111111111111111 + } + }, + "s1_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "98ab7eef236221b71f180bece28fd82ec630137fdc76eb85d8b6b5f7bed1fee8", + "route_weight_sha256": "cfc689b3bcb8c6b760cae8c1cd6866e1c8d02c8c65962d20e1d351ac49bed60a", + "loads": [ + 3, + 2, + 0, + 0, + 0, + 4, + 15, + 0, + 0, + 0, + 3, + 1, + 0, + 2, + 8, + 1, + 1, + 2, + 0, + 0, + 0, + 3, + 5, + 0, + 0, + 0, + 9, + 2, + 1, + 0, + 0, + 1, + 1, + 2, + 1, + 6, + 1, + 1, + 1, + 0, + 0, + 4, + 4, + 0, + 0, + 2, + 2, + 7, + 0, + 0, + 7, + 0, + 2, + 1, + 1, + 0, + 0, + 3, + 9, + 1, + 2, + 3, + 4, + 10 + ], + "weighted_loads": [ + 0.10731530748307705, + 0.07200843840837479, + 0.0, + 0.0, + 0.0, + 0.21184556186199188, + 1.1297775991261005, + 0.0, + 0.0, + 0.0, + 0.10818403773009777, + 0.023654283955693245, + 0.0, + 0.24005934596061707, + 0.871531143784523, + 0.03152765706181526, + 0.04738081246614456, + 0.06345275416970253, + 0.0, + 0.0, + 0.0, + 0.13904783502221107, + 0.3068888708949089, + 0.0, + 0.0, + 0.0, + 0.46733617410063744, + 0.14186804369091988, + 0.037137266248464584, + 0.0, + 0.0, + 0.03711811453104019, + 0.02366677112877369, + 0.0830184854567051, + 0.19292952120304108, + 0.37494609504938126, + 0.023432767018675804, + 0.03178994730114937, + 0.030793853104114532, + 0.0, + 0.0, + 0.23401997983455658, + 0.2688099071383476, + 0.0, + 0.0, + 0.1606166958808899, + 0.08252504840493202, + 0.27068158239126205, + 0.0, + 0.0, + 0.39121487736701965, + 0.0, + 0.10249447450041771, + 0.04202475771307945, + 0.03823423013091087, + 0.0, + 0.0, + 0.12238464131951332, + 1.2441073395311832, + 0.030446087941527367, + 0.0804581455886364, + 0.1735907718539238, + 0.22288433089852333, + 0.6151554696261883 + ], + "unique_experts": 40, + "load_cv": 1.3845700547480204, + "normalized_load_entropy": 0.8066404145266145, + "max_load_share": 0.10869565217391304 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "26ff5169f1bace7b5a002cce6af7772c3def72c0dee9d95140877c901c19de33", + "route_weight_sha256": "4deb9fcad2b1f7d444c8494bef8800d11297a37d01b6f7e4ab1e64552f0c7b72", + "loads": [ + 8, + 8, + 0, + 0, + 0, + 5, + 44, + 0, + 0, + 1, + 12, + 12, + 0, + 2, + 8, + 8, + 1, + 3, + 3, + 3, + 0, + 9, + 5, + 3, + 4, + 0, + 13, + 2, + 1, + 21, + 8, + 3, + 1, + 16, + 4, + 7, + 7, + 2, + 2, + 1, + 2, + 9, + 12, + 1, + 18, + 13, + 3, + 9, + 2, + 5, + 8, + 0, + 5, + 3, + 3, + 2, + 3, + 14, + 15, + 5, + 3, + 5, + 4, + 13 + ], + "weighted_loads": [ + 0.3091935720294714, + 0.4762402717024088, + 0.0, + 0.0, + 0.0, + 0.24803490191698074, + 3.4728231746703386, + 0.0, + 0.0, + 0.030571382492780685, + 0.7191802393645048, + 0.8308733385056257, + 0.0, + 0.24005934596061707, + 0.871531143784523, + 0.39928269758820534, + 0.04738081246614456, + 0.10269654542207718, + 0.10155953653156757, + 0.12280135601758957, + 0.0, + 0.4174080602824688, + 0.3068888708949089, + 0.12172871828079224, + 0.32759881019592285, + 0.0, + 0.6249201409518719, + 0.14186804369091988, + 0.037137266248464584, + 1.6127966865897179, + 0.43361368775367737, + 0.11161824688315392, + 0.02366677112877369, + 1.3315445557236671, + 0.41817467100918293, + 0.4259635768830776, + 0.38965706527233124, + 0.06514982879161835, + 0.07275931909680367, + 0.04302026703953743, + 0.08159289509057999, + 0.46888528764247894, + 0.920229148119688, + 0.034819185733795166, + 1.4120734110474586, + 1.1225424110889435, + 0.12455135956406593, + 0.6698619164526463, + 0.25383568555116653, + 0.24627847969532013, + 0.4260179363191128, + 0.0, + 0.20702572166919708, + 0.12469959631562233, + 0.10846241936087608, + 0.07155315577983856, + 0.155318982899189, + 0.8301908373832703, + 1.4664281029254198, + 0.22575215436518192, + 0.10911020822823048, + 0.2606962788850069, + 0.22288433089852333, + 0.7319806180894375 + ], + "unique_experts": 55, + "load_cv": 1.1524430571616109, + "normalized_load_entropy": 0.8748843335330575, + "max_load_share": 0.11458333333333333 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "ordered_topk_exact_tokens": 16, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.9254658385093169, + "mean_token_weighted_tv": 0.014201002074000628, + "aggregate_load_tv": 0.043478260869565216 + }, + "system_bos": { + "tokens": 23, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.9254658385093167, + "mean_token_weighted_tv": 0.0173192387851684, + "aggregate_load_tv": 0.04347826086956521 + }, + "system_x": { + "tokens": 23, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.9130434782608695, + "mean_token_weighted_tv": 0.021362859634277614, + "aggregate_load_tv": 0.05072463768115941 + }, + "system_period": { + "tokens": 23, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.8913043478260869, + "mean_token_weighted_tv": 0.024675959478253903, + "aggregate_load_tv": 0.06521739130434782 + }, + "bos_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.9254658385093169, + "mean_token_weighted_tv": 0.018553174141308536, + "aggregate_load_tv": 0.043478260869565216 + }, + "bos_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.9006211180124224, + "mean_token_weighted_tv": 0.02154274880076232, + "aggregate_load_tv": 0.050724637681159424 + }, + "x_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8881987577639753, + "mean_token_weighted_tv": 0.024986072362441082, + "aggregate_load_tv": 0.05072463768115942 + }, + "x_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 4, + "set_exact_tokens": 9, + "mean_set_jaccard": 0.8167701863354039, + "mean_token_weighted_tv": 0.03588204008891531, + "aggregate_load_tv": 0.08695652173913043 + }, + "period_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.9006211180124224, + "mean_token_weighted_tv": 0.02384558927429759, + "aggregate_load_tv": 0.057971014492753624 + }, + "period_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 6, + "set_exact_tokens": 13, + "mean_set_jaccard": 0.8664596273291927, + "mean_token_weighted_tv": 0.030100252843745377, + "aggregate_load_tv": 0.057971014492753624 + } + } + }, + "layer_14": { + "layer": 14, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "459ffc9a5dd15171c98db9e40c5328a5fa23adb6d4cba7de6772e3280fd72c14", + "route_weight_sha256": "f10d76b8390eceb06fb5a3fc7ede14c94d3943c84e157f8de481ec77bc37bc8d", + "loads": [ + 0, + 0, + 0, + 0, + 2, + 7, + 2, + 3, + 4, + 3, + 9, + 1, + 0, + 0, + 1, + 0, + 0, + 0, + 2, + 0, + 5, + 1, + 0, + 7, + 5, + 2, + 2, + 6, + 5, + 1, + 2, + 3, + 1, + 0, + 0, + 5, + 0, + 0, + 0, + 0, + 0, + 0, + 1, + 1, + 1, + 0, + 7, + 1, + 4, + 3, + 0, + 10, + 1, + 0, + 3, + 2, + 1, + 1, + 6, + 11, + 0, + 2, + 0, + 4 + ], + "weighted_loads": [ + 0.0, + 0.0, + 0.0, + 0.0, + 0.12675676494836807, + 0.36167837493121624, + 0.14053720608353615, + 0.5187927410006523, + 0.17637599259614944, + 0.12708961963653564, + 0.6158529818058014, + 0.03311498835682869, + 0.0, + 0.0, + 0.07722166180610657, + 0.0, + 0.0, + 0.0, + 0.09380874037742615, + 0.0, + 0.3747989200055599, + 0.050903674215078354, + 0.0, + 0.7418362982571125, + 0.5037103481590748, + 0.07926717959344387, + 0.31287806853652, + 1.1585076786577702, + 0.32006482034921646, + 0.03910680487751961, + 0.08736100420355797, + 0.16598380915820599, + 0.036837827414274216, + 0.0, + 0.0, + 0.3021726757287979, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.089141845703125, + 0.03616539388895035, + 0.06818182021379471, + 0.0, + 0.33548406697809696, + 0.05097633972764015, + 0.16775187104940414, + 0.12558847665786743, + 0.0, + 0.8753795400261879, + 0.044398099184036255, + 0.0, + 0.20505328103899956, + 0.12045881897211075, + 0.06273272633552551, + 0.0662546381354332, + 0.4769812859594822, + 1.0002874433994293, + 0.0, + 0.45735715329647064, + 0.0, + 0.16692227870225906 + ], + "unique_experts": 40, + "load_cv": 1.2439308659084878, + "normalized_load_entropy": 0.8224480899614668, + "max_load_share": 0.07971014492753623 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "838b681584130ced73039ec0773e2a20e059af621c39c1c8697400e6bd4cd299", + "route_weight_sha256": "b50193f6f6ce94339aab7ef250436c2fa4c74afb09b649ea1a776675432650a3", + "loads": [ + 8, + 0, + 0, + 2, + 2, + 17, + 2, + 6, + 4, + 11, + 11, + 4, + 0, + 0, + 1, + 5, + 0, + 0, + 6, + 1, + 5, + 1, + 0, + 17, + 6, + 2, + 8, + 12, + 13, + 1, + 4, + 8, + 1, + 7, + 0, + 5, + 2, + 1, + 2, + 0, + 0, + 0, + 2, + 1, + 3, + 0, + 13, + 4, + 5, + 3, + 2, + 16, + 7, + 7, + 3, + 6, + 2, + 2, + 6, + 24, + 0, + 3, + 0, + 4 + ], + "weighted_loads": [ + 0.7505126856267452, + 0.0, + 0.0, + 0.07914513349533081, + 0.12675676494836807, + 1.2747186813503504, + 0.14053720608353615, + 0.6402638256549835, + 0.17637599259614944, + 0.7489447891712189, + 0.6800620295107365, + 0.2237306535243988, + 0.0, + 0.0, + 0.07722166180610657, + 0.2291027195751667, + 0.0, + 0.0, + 0.3333191890269518, + 0.03977340832352638, + 0.3747989200055599, + 0.050903674215078354, + 0.0, + 1.1821312308311462, + 0.5263044238090515, + 0.07926717959344387, + 0.6490354537963867, + 1.5429057506844401, + 1.7725033983588219, + 0.03910680487751961, + 0.2382766641676426, + 0.35081176552921534, + 0.036837827414274216, + 0.7082952484488487, + 0.0, + 0.3021726757287979, + 0.09685255214571953, + 0.043454498052597046, + 0.1341659277677536, + 0.0, + 0.0, + 0.0, + 0.14007246121764183, + 0.03616539388895035, + 0.12912880070507526, + 0.0, + 0.6803378257900476, + 0.18080292828381062, + 0.19398172199726105, + 0.12558847665786743, + 0.07613230869174004, + 2.217919047921896, + 0.8048978447914124, + 0.4789120443165302, + 0.20505328103899956, + 0.4583008475601673, + 0.10248075425624847, + 0.10197697207331657, + 0.4769812859594822, + 1.596640769392252, + 0.0, + 0.4623729563318193, + 0.0, + 0.16692227870225906 + ], + "unique_experts": 50, + "load_cv": 1.118033988749895, + "normalized_load_entropy": 0.8626305817210523, + "max_load_share": 0.08333333333333333 + } + }, + "s1_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "fd5ca059e7531d375f29a1b25e36c38d9998a9a863cf96132b9e0934fa6497eb", + "route_weight_sha256": "1651db3eab7fd27e8882f87a4ec08644b44a30963f6cf10c255fe576a9850830", + "loads": [ + 0, + 0, + 0, + 0, + 2, + 6, + 2, + 4, + 3, + 3, + 10, + 0, + 0, + 0, + 2, + 0, + 0, + 0, + 2, + 0, + 5, + 1, + 0, + 6, + 5, + 1, + 2, + 6, + 5, + 1, + 2, + 2, + 1, + 0, + 0, + 5, + 0, + 0, + 0, + 0, + 0, + 0, + 1, + 1, + 1, + 0, + 7, + 2, + 4, + 3, + 0, + 10, + 1, + 0, + 4, + 2, + 1, + 1, + 6, + 13, + 0, + 2, + 0, + 3 + ], + "weighted_loads": [ + 0.0, + 0.0, + 0.0, + 0.0, + 0.12564248219132423, + 0.31949786841869354, + 0.13882266730070114, + 0.5255316086113453, + 0.13798648491501808, + 0.1274024285376072, + 0.6297849342226982, + 0.0, + 0.0, + 0.0, + 0.10875266045331955, + 0.0, + 0.0, + 0.0, + 0.09409556910395622, + 0.0, + 0.36434196680784225, + 0.049452412873506546, + 0.0, + 0.739370696246624, + 0.5059262625873089, + 0.0504351481795311, + 0.3017197847366333, + 1.1651922054588795, + 0.31368331238627434, + 0.037953998893499374, + 0.0884881429374218, + 0.14934246242046356, + 0.03792889788746834, + 0.0, + 0.0, + 0.30444496870040894, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.08505523949861526, + 0.03419128805398941, + 0.06920614093542099, + 0.0, + 0.3344035614281893, + 0.07808501645922661, + 0.1711751502007246, + 0.12296753749251366, + 0.0, + 0.8573657274246216, + 0.04796427860856056, + 0.0, + 0.24376698955893517, + 0.11127019301056862, + 0.06453106552362442, + 0.06960296630859375, + 0.4650107007473707, + 1.0817805994302034, + 0.0, + 0.4524935185909271, + 0.0, + 0.13762780651450157 + ], + "unique_experts": 39, + "load_cv": 1.294244282571866, + "normalized_load_entropy": 0.8155596623474564, + "max_load_share": 0.09420289855072464 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "1c0952f9c2e1834f934faa920cdad02fc3d3cf82f6a394f66d06b091102fb50f", + "route_weight_sha256": "cab4de36231b8ff0e8bf6e5097621342574e2f4646944149dcf77b2b58b74400", + "loads": [ + 11, + 1, + 0, + 3, + 6, + 22, + 2, + 9, + 5, + 15, + 10, + 3, + 6, + 0, + 2, + 6, + 0, + 0, + 8, + 3, + 7, + 5, + 0, + 15, + 10, + 2, + 7, + 13, + 18, + 2, + 6, + 5, + 3, + 11, + 1, + 6, + 1, + 3, + 3, + 1, + 0, + 0, + 3, + 2, + 3, + 0, + 13, + 4, + 7, + 5, + 13, + 14, + 9, + 9, + 6, + 5, + 2, + 3, + 7, + 33, + 3, + 4, + 2, + 6 + ], + "weighted_loads": [ + 0.8827830627560616, + 0.05172812193632126, + 0.0, + 0.1159074567258358, + 0.3613610863685608, + 1.462227489799261, + 0.13882266730070114, + 0.7424656189978123, + 0.3040682338178158, + 1.0847406946122646, + 0.6297849342226982, + 0.21446195244789124, + 0.39333631098270416, + 0.0, + 0.10875266045331955, + 0.30087344348430634, + 0.0, + 0.0, + 0.47642136365175247, + 0.17517539486289024, + 0.5920886471867561, + 0.1994878426194191, + 0.0, + 1.1192850302904844, + 0.7488214820623398, + 0.09816470742225647, + 0.6683927662670612, + 1.4279422983527184, + 2.220625054091215, + 0.08641432225704193, + 0.31171688064932823, + 0.23750915843993425, + 0.11951103806495667, + 1.1916394010186195, + 0.04847671464085579, + 0.38476748764514923, + 0.04455575719475746, + 0.3564930334687233, + 0.21146699041128159, + 0.058142803609371185, + 0.0, + 0.0, + 0.1839020699262619, + 0.08076877892017365, + 0.13008112832903862, + 0.0, + 0.703004740178585, + 0.1467185728251934, + 0.3214509878307581, + 0.17954045347869396, + 0.8494720086455345, + 2.1353647485375404, + 0.8528833612799644, + 0.69690116122365, + 0.32683370634913445, + 0.37938520684838295, + 0.11635243147611618, + 0.15059183165431023, + 0.5739848371595144, + 2.182014899328351, + 0.2523827850818634, + 0.49852528190240264, + 0.10266362503170967, + 0.24421703070402145 + ], + "unique_experts": 56, + "load_cv": 0.982043645782723, + "normalized_load_entropy": 0.8972491927643742, + "max_load_share": 0.0859375 + } + }, + "s0_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "4ea96db61b0efcedfc75120d5439368c44c6be52d3b35f86ce5dfe62b2ebed38", + "route_weight_sha256": "10da9d0e7a31052c51f129e7d3d03f092b50edffc29619dbb6a36c73496826d2", + "loads": [ + 0, + 0, + 0, + 0, + 2, + 7, + 2, + 3, + 3, + 2, + 12, + 0, + 0, + 0, + 1, + 0, + 0, + 0, + 3, + 0, + 5, + 1, + 0, + 6, + 5, + 1, + 2, + 7, + 5, + 1, + 1, + 4, + 1, + 0, + 0, + 5, + 1, + 0, + 0, + 0, + 0, + 0, + 1, + 1, + 1, + 0, + 6, + 1, + 4, + 3, + 0, + 10, + 0, + 0, + 4, + 2, + 1, + 1, + 5, + 11, + 0, + 2, + 0, + 5 + ], + "weighted_loads": [ + 0.0, + 0.0, + 0.0, + 0.0, + 0.12158146873116493, + 0.34470390155911446, + 0.15066201239824295, + 0.5241743624210358, + 0.14200443029403687, + 0.09236671030521393, + 0.7062089368700981, + 0.0, + 0.0, + 0.0, + 0.07806581258773804, + 0.0, + 0.0, + 0.0, + 0.14319640770554543, + 0.0, + 0.37300219386816025, + 0.04889442026615143, + 0.0, + 0.7717630937695503, + 0.46844005584716797, + 0.04715763404965401, + 0.2873019240796566, + 1.2021741550415754, + 0.32147832587361336, + 0.0422806516289711, + 0.05181204527616501, + 0.201121985912323, + 0.03629308566451073, + 0.0, + 0.0, + 0.3325367234647274, + 0.033974409103393555, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.09368564933538437, + 0.03583040460944176, + 0.06612323224544525, + 0.0, + 0.28142387606203556, + 0.04900183901190758, + 0.17002038843929768, + 0.11709301173686981, + 0.0, + 0.8510645255446434, + 0.0, + 0.0, + 0.23205726966261864, + 0.11821510642766953, + 0.06160878390073776, + 0.05900634080171585, + 0.45184357836842537, + 1.019717462360859, + 0.0, + 0.4468940645456314, + 0.0, + 0.20549006201326847 + ], + "unique_experts": 39, + "load_cv": 1.3071628238988267, + "normalized_load_entropy": 0.8112124208938583, + "max_load_share": 0.08695652173913043 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "93dbb2053aebcf8d4719e997570afedea7978521cd48c0d579962c9c07980343", + "route_weight_sha256": "f76dc27fba4a97f536c13a17bf47f7d3a338a8819fd7ffcf7054d9e63b71de97", + "loads": [ + 6, + 0, + 0, + 3, + 2, + 17, + 2, + 5, + 3, + 10, + 14, + 3, + 0, + 0, + 1, + 5, + 0, + 0, + 9, + 1, + 5, + 1, + 0, + 15, + 7, + 2, + 8, + 12, + 14, + 1, + 3, + 9, + 1, + 6, + 0, + 5, + 3, + 1, + 2, + 0, + 0, + 0, + 1, + 1, + 4, + 0, + 12, + 3, + 5, + 3, + 2, + 17, + 6, + 7, + 4, + 6, + 2, + 2, + 6, + 24, + 0, + 2, + 0, + 5 + ], + "weighted_loads": [ + 0.6656411439180374, + 0.0, + 0.0, + 0.13592608273029327, + 0.12158146873116493, + 1.2577442079782486, + 0.15066201239824295, + 0.6029493808746338, + 0.14200443029403687, + 0.6826281324028969, + 0.7704179845750332, + 0.19061566516757011, + 0.0, + 0.0, + 0.07806581258773804, + 0.22146733105182648, + 0.0, + 0.0, + 0.5354465674608946, + 0.03977340832352638, + 0.37300219386816025, + 0.04889442026615143, + 0.0, + 1.1845082081854343, + 0.5361344665288925, + 0.08745332434773445, + 0.6234593093395233, + 1.5964660216122866, + 1.8052146844565868, + 0.0422806516289711, + 0.20890311151742935, + 0.43174030631780624, + 0.03629308566451073, + 0.662861529737711, + 0.0, + 0.3325367234647274, + 0.12774449214339256, + 0.043454498052597046, + 0.12952974438667297, + 0.0, + 0.0, + 0.0, + 0.09368564933538437, + 0.03583040460944176, + 0.20446972735226154, + 0.0, + 0.6120605450123549, + 0.13435866869986057, + 0.2015115711838007, + 0.11709301173686981, + 0.07513734698295593, + 1.4167006630450487, + 0.7604997456073761, + 0.4789120443165302, + 0.23205726966261864, + 0.4880952574312687, + 0.10135681182146072, + 0.10368507355451584, + 0.49655235186219215, + 1.6206863224506378, + 0.0, + 0.4468940645456314, + 0.0, + 0.20549006201326847 + ], + "unique_experts": 50, + "load_cv": 1.1290223018278653, + "normalized_load_entropy": 0.860304014328401, + "max_load_share": 0.08333333333333333 + } + }, + "s1_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "acf71d31e86c3246cb5fa9652ad5b579f8aec9bda712a5c0da0ff8b1905d6667", + "route_weight_sha256": "0ce815e9a52a3c2bf279769fc055fb780fa685382352363847b5d8b9f8e0f178", + "loads": [ + 0, + 0, + 0, + 0, + 2, + 8, + 2, + 4, + 3, + 4, + 10, + 0, + 0, + 0, + 1, + 0, + 0, + 0, + 3, + 0, + 5, + 1, + 0, + 6, + 5, + 1, + 2, + 6, + 5, + 1, + 2, + 4, + 1, + 0, + 0, + 4, + 1, + 0, + 0, + 0, + 0, + 0, + 1, + 1, + 1, + 0, + 6, + 1, + 4, + 3, + 0, + 10, + 1, + 0, + 4, + 2, + 1, + 1, + 5, + 11, + 0, + 2, + 0, + 3 + ], + "weighted_loads": [ + 0.0, + 0.0, + 0.0, + 0.0, + 0.12532661110162735, + 0.35438182577490807, + 0.1465141884982586, + 0.5535154026001692, + 0.13966745138168335, + 0.16074874065816402, + 0.6344853863120079, + 0.0, + 0.0, + 0.0, + 0.07078918069601059, + 0.0, + 0.0, + 0.0, + 0.1329079121351242, + 0.0, + 0.35982055962085724, + 0.05028965696692467, + 0.0, + 0.7969667017459869, + 0.46513550728559494, + 0.04966949298977852, + 0.27151451259851456, + 1.1743611842393875, + 0.308746337890625, + 0.04087826982140541, + 0.08969033509492874, + 0.19937117025256157, + 0.039434999227523804, + 0.0, + 0.0, + 0.2765479162335396, + 0.03249182179570198, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0902741476893425, + 0.03544756397604942, + 0.06679769605398178, + 0.0, + 0.2926701381802559, + 0.04739531874656677, + 0.16515897773206234, + 0.10724835842847824, + 0.0, + 0.8452147096395493, + 0.04049144685268402, + 0.0, + 0.240219134837389, + 0.11099287495017052, + 0.059628892689943314, + 0.060062166303396225, + 0.4455288015305996, + 1.0462259240448475, + 0.0, + 0.4635094255208969, + 0.0, + 0.14309865981340408 + ], + "unique_experts": 40, + "load_cv": 1.2493224376617578, + "normalized_load_entropy": 0.8218558314169662, + "max_load_share": 0.07971014492753623 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "5e061796578dabd859559cb692306d392b61ada07433a7c24f8bde9a2037ae94", + "route_weight_sha256": "c972f94d88e67ddf39b627eeaf8473f6155b0ce3eb7a42ddd508a60d37f5a366", + "loads": [ + 10, + 1, + 0, + 3, + 6, + 24, + 2, + 8, + 5, + 16, + 11, + 3, + 6, + 0, + 1, + 7, + 0, + 0, + 10, + 3, + 7, + 4, + 0, + 14, + 10, + 2, + 7, + 13, + 19, + 2, + 6, + 7, + 3, + 12, + 1, + 5, + 2, + 3, + 3, + 1, + 0, + 0, + 2, + 2, + 3, + 1, + 12, + 4, + 7, + 5, + 12, + 14, + 9, + 9, + 6, + 5, + 2, + 4, + 6, + 30, + 3, + 3, + 2, + 6 + ], + "weighted_loads": [ + 0.8533674329519272, + 0.05172812193632126, + 0.0, + 0.13376782462000847, + 0.3610452152788639, + 1.4971114471554756, + 0.1465141884982586, + 0.7305890899151564, + 0.30574920028448105, + 1.086401043459773, + 0.6662926413118839, + 0.21446195244789124, + 0.39333631098270416, + 0.0, + 0.07078918069601059, + 0.30072828382253647, + 0.0, + 0.0, + 0.5367666371166706, + 0.17517539486289024, + 0.5875672399997711, + 0.15173501521348953, + 0.0, + 1.1493108104914427, + 0.7080307267606258, + 0.09739905223250389, + 0.6381874941289425, + 1.5084656476974487, + 2.295279897749424, + 0.08933859318494797, + 0.30349861085414886, + 0.3352954536676407, + 0.12101713940501213, + 1.203510094434023, + 0.04847671464085579, + 0.3568704351782799, + 0.07278862223029137, + 0.3564930334687233, + 0.20420589298009872, + 0.058142803609371185, + 0.0, + 0.0, + 0.14378849416971207, + 0.08202505484223366, + 0.1276726834475994, + 0.04187091812491417, + 0.6580245476216078, + 0.1558164730668068, + 0.3270720485597849, + 0.16382127441465855, + 0.8103308491408825, + 1.2959789633750916, + 0.8454105295240879, + 0.69690116122365, + 0.32328585162758827, + 0.43197884038090706, + 0.11145025864243507, + 0.1908579356968403, + 0.5545029379427433, + 2.103275526314974, + 0.2523827850818634, + 0.5047685317695141, + 0.10266362503170967, + 0.24968788400292397 + ], + "unique_experts": 57, + "load_cv": 0.9673488971869917, + "normalized_load_entropy": 0.8991232608783573, + "max_load_share": 0.078125 + } + }, + "s0_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "8f170071d66ee86f918adbcd48d6ea0609d2978d3dc3cc70ff4b04b7acefe288", + "route_weight_sha256": "22637d6bb9a699a5cccfeae5568fec5282f7d15f0a6a572fe488fac4b0e57dc7", + "loads": [ + 0, + 0, + 0, + 0, + 2, + 6, + 2, + 3, + 4, + 3, + 9, + 0, + 0, + 0, + 2, + 0, + 0, + 0, + 2, + 0, + 5, + 1, + 0, + 6, + 5, + 1, + 2, + 7, + 5, + 1, + 1, + 5, + 1, + 0, + 0, + 5, + 0, + 0, + 0, + 0, + 0, + 0, + 1, + 1, + 1, + 0, + 7, + 2, + 4, + 3, + 0, + 10, + 0, + 0, + 4, + 2, + 1, + 1, + 6, + 11, + 0, + 2, + 0, + 4 + ], + "weighted_loads": [ + 0.0, + 0.0, + 0.0, + 0.0, + 0.1261712796986103, + 0.4060342572629452, + 0.14593243226408958, + 0.5000997930765152, + 0.18295839056372643, + 0.13394498825073242, + 0.5961321517825127, + 0.0, + 0.0, + 0.0, + 0.12250695005059242, + 0.0, + 0.0, + 0.0, + 0.10736065730452538, + 0.0, + 0.3731836676597595, + 0.05009397491812706, + 0.0, + 0.7853982858359814, + 0.4708361402153969, + 0.05141448974609375, + 0.31263134256005287, + 1.2001974247395992, + 0.33685852214694023, + 0.03964531049132347, + 0.05029651150107384, + 0.22598453983664513, + 0.03226101025938988, + 0.0, + 0.0, + 0.3218745067715645, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.09750249981880188, + 0.03687657415866852, + 0.06971430778503418, + 0.0, + 0.3222180847078562, + 0.07762020640075207, + 0.1830468513071537, + 0.11947274208068848, + 0.0, + 0.858154084533453, + 0.0, + 0.0, + 0.24393587559461594, + 0.11176907271146774, + 0.060880426317453384, + 0.05816299840807915, + 0.45278553664684296, + 0.9789096005260944, + 0.0, + 0.4660712331533432, + 0.0, + 0.1695275455713272 + ], + "unique_experts": 38, + "load_cv": 1.2546908413351843, + "normalized_load_entropy": 0.8152522493575616, + "max_load_share": 0.07971014492753623 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "e47a0d87d8f2ceea1ddb00b35b0b86e2c7f8187aed90799ffdee1e4e989cebb5", + "route_weight_sha256": "dafdded476c5ea7e9acc8f03b93a575ca6d6ffaeb5eb2b029baa88b0580b7316", + "loads": [ + 7, + 0, + 0, + 1, + 2, + 18, + 2, + 4, + 4, + 11, + 11, + 3, + 0, + 1, + 2, + 4, + 0, + 0, + 6, + 2, + 5, + 1, + 0, + 15, + 7, + 2, + 9, + 11, + 13, + 1, + 4, + 10, + 1, + 7, + 0, + 5, + 3, + 3, + 2, + 0, + 0, + 0, + 2, + 1, + 3, + 0, + 13, + 4, + 4, + 3, + 2, + 14, + 6, + 8, + 4, + 6, + 2, + 2, + 6, + 25, + 0, + 2, + 0, + 4 + ], + "weighted_loads": [ + 0.7782409824430943, + 0.0, + 0.0, + 0.04007919505238533, + 0.1261712796986103, + 1.4491084702312946, + 0.14593243226408958, + 0.5336735509335995, + 0.18295839056372643, + 0.681916069239378, + 0.6603411994874477, + 0.19061566516757011, + 0.0, + 0.0590742751955986, + 0.12250695005059242, + 0.1751353107392788, + 0.0, + 0.0, + 0.29155895859003067, + 0.11521466448903084, + 0.3731836676597595, + 0.05009397491812706, + 0.0, + 1.1981434002518654, + 0.5340607240796089, + 0.08239759504795074, + 0.7605679556727409, + 1.52827088534832, + 1.456941645592451, + 0.03964531049132347, + 0.23489007912576199, + 0.45652352273464203, + 0.03226101025938988, + 0.7261537909507751, + 0.0, + 0.3218745067715645, + 0.1297842040657997, + 0.16214009374380112, + 0.11636633798480034, + 0.0, + 0.0, + 0.0, + 0.145358607172966, + 0.03687657415866852, + 0.13066128827631474, + 0.0, + 0.6782406400889158, + 0.16297703608870506, + 0.1830468513071537, + 0.11947274208068848, + 0.08311712741851807, + 1.3137148786336184, + 0.7604997456073761, + 0.5653107725083828, + 0.24393587559461594, + 0.43557559326291084, + 0.10062845423817635, + 0.1002771258354187, + 0.45278553664684296, + 1.6661898605525494, + 0.0, + 0.4660712331533432, + 0.0, + 0.1695275455713272 + ], + "unique_experts": 51, + "load_cv": 1.1055415967851332, + "normalized_load_entropy": 0.867921564764676, + "max_load_share": 0.08680555555555555 + } + }, + "s1_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "ec0b146bc38b08f53312eeeeed97f35929c0050ba9fe727d12ff7b62cdb1bb22", + "route_weight_sha256": "c0d58ff5c312089f32765bd0600e060cd49dab937e1b9db7364f23bdb116056c", + "loads": [ + 0, + 0, + 0, + 0, + 2, + 7, + 2, + 4, + 3, + 3, + 8, + 0, + 0, + 0, + 1, + 0, + 0, + 0, + 3, + 0, + 5, + 1, + 0, + 6, + 5, + 1, + 2, + 6, + 5, + 1, + 1, + 3, + 1, + 0, + 0, + 6, + 0, + 0, + 0, + 0, + 0, + 0, + 1, + 1, + 1, + 0, + 8, + 2, + 5, + 3, + 0, + 10, + 1, + 0, + 3, + 2, + 1, + 1, + 5, + 12, + 0, + 2, + 0, + 4 + ], + "weighted_loads": [ + 0.0, + 0.0, + 0.0, + 0.0, + 0.1264314092695713, + 0.46853469870984554, + 0.1419723555445671, + 0.5157946012914181, + 0.1435861885547638, + 0.13078740797936916, + 0.5304584205150604, + 0.0, + 0.0, + 0.0, + 0.07211312651634216, + 0.0, + 0.0, + 0.0, + 0.14101031050086021, + 0.0, + 0.3640788905322552, + 0.0484122708439827, + 0.0, + 0.789443351328373, + 0.45245125889778137, + 0.056327447295188904, + 0.2654232457280159, + 1.1790734753012657, + 0.2854655906558037, + 0.040191762149333954, + 0.051883164793252945, + 0.16703357733786106, + 0.03628455102443695, + 0.0, + 0.0, + 0.3464717008173466, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.09837208688259125, + 0.03517242893576622, + 0.06261318922042847, + 0.0, + 0.3512567728757858, + 0.07449334487318993, + 0.22152810916304588, + 0.10904881730675697, + 0.0, + 0.8322652727365494, + 0.0413445308804512, + 0.0, + 0.21655021235346794, + 0.11579569056630135, + 0.054990123957395554, + 0.063625767827034, + 0.34983759745955467, + 1.0553488582372665, + 0.0, + 0.4607904553413391, + 0.0, + 0.17906636744737625 + ], + "unique_experts": 39, + "load_cv": 1.2680124181346109, + "normalized_load_entropy": 0.8164000087262209, + "max_load_share": 0.08695652173913043 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "7c109b9109ded96708fdad13f65c89672e4fcd4dc7373c98189aa5056be8b43e", + "route_weight_sha256": "ecf2aef88ce277f6238e338e12de519ac1ba36607c7b0670b478a1c5c35ed9d2", + "loads": [ + 10, + 1, + 0, + 2, + 6, + 26, + 2, + 8, + 5, + 13, + 8, + 4, + 6, + 0, + 1, + 4, + 0, + 0, + 9, + 3, + 7, + 4, + 0, + 15, + 10, + 2, + 8, + 13, + 17, + 2, + 7, + 5, + 3, + 11, + 1, + 7, + 2, + 4, + 3, + 1, + 0, + 0, + 3, + 2, + 3, + 0, + 14, + 4, + 7, + 5, + 13, + 13, + 9, + 10, + 5, + 5, + 2, + 3, + 6, + 34, + 3, + 3, + 2, + 8 + ], + "weighted_loads": [ + 0.8894870821386576, + 0.05172812193632126, + 0.0, + 0.07504644989967346, + 0.36215001344680786, + 1.848458981141448, + 0.1419723555445671, + 0.6926677189767361, + 0.3096679374575615, + 0.84958023019135, + 0.5304584205150604, + 0.26172273233532906, + 0.39333631098270416, + 0.0, + 0.07211312651634216, + 0.15684528462588787, + 0.0, + 0.0, + 0.5115908831357956, + 0.17517539486289024, + 0.591825570911169, + 0.14985762909054756, + 0.0, + 1.195982525125146, + 0.6953464783728123, + 0.10405700653791428, + 0.7388003878295422, + 1.4710057824850082, + 1.6869579926133156, + 0.08865208551287651, + 0.3394712544977665, + 0.2443817462772131, + 0.11786669120192528, + 1.1325905062258244, + 0.04847671464085579, + 0.42679421976208687, + 0.09199558570981026, + 0.45401928573846817, + 0.18655582889914513, + 0.058142803609371185, + 0.0, + 0.0, + 0.208406750112772, + 0.08174991980195045, + 0.1234881766140461, + 0.0, + 0.7332788798958063, + 0.14312690123915672, + 0.34935933351516724, + 0.16562173329293728, + 0.8458282202482224, + 1.2517541237175465, + 0.8462636135518551, + 0.8161424584686756, + 0.2996169291436672, + 0.35824228450655937, + 0.10681148990988731, + 0.15391269326210022, + 0.4588117338716984, + 2.2412452325224876, + 0.2523827850818634, + 0.5020495615899563, + 0.10266362503170967, + 0.34061844646930695 + ], + "unique_experts": 56, + "load_cv": 1.0142217870531738, + "normalized_load_entropy": 0.8939373105978903, + "max_load_share": 0.08854166666666667 + } + }, + "s0_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "e52a84f784e94fccc389e61385cd7d6e31cabb3104ebafa1802c15fa2157a8fe", + "route_weight_sha256": "49a7bb0cbcbffa3a90f39bb08ae7c608b0551ae05236ad1bdee8e5546ff75b5b", + "loads": [ + 0, + 0, + 0, + 0, + 2, + 7, + 2, + 3, + 4, + 4, + 8, + 0, + 0, + 0, + 1, + 0, + 0, + 0, + 2, + 0, + 5, + 1, + 0, + 7, + 5, + 2, + 2, + 7, + 5, + 1, + 2, + 5, + 1, + 0, + 0, + 5, + 0, + 0, + 0, + 0, + 0, + 0, + 1, + 1, + 1, + 0, + 6, + 2, + 4, + 3, + 0, + 10, + 0, + 0, + 3, + 2, + 1, + 1, + 6, + 11, + 0, + 2, + 0, + 3 + ], + "weighted_loads": [ + 0.0, + 0.0, + 0.0, + 0.0, + 0.1280820146203041, + 0.41644207388162613, + 0.14150675386190414, + 0.4986192062497139, + 0.1848481334745884, + 0.16125947050750256, + 0.5486112870275974, + 0.0, + 0.0, + 0.0, + 0.08534425497055054, + 0.0, + 0.0, + 0.0, + 0.10165521875023842, + 0.0, + 0.3694593347609043, + 0.050872474908828735, + 0.0, + 0.8076188042759895, + 0.47651276364922523, + 0.08606050536036491, + 0.2948574982583523, + 1.2084857821464539, + 0.33485808968544006, + 0.041223395615816116, + 0.08598454296588898, + 0.22881131805479527, + 0.034215714782476425, + 0.0, + 0.0, + 0.319790069013834, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.09498634189367294, + 0.03679101541638374, + 0.07155652344226837, + 0.0, + 0.2871077749878168, + 0.07377946935594082, + 0.17891150526702404, + 0.11884425207972527, + 0.0, + 0.8578467331826687, + 0.0, + 0.0, + 0.21940799616277218, + 0.1139020323753357, + 0.06282655894756317, + 0.06143404170870781, + 0.4626821279525757, + 0.972453236579895, + 0.0, + 0.453778013586998, + 0.0, + 0.13035020604729652 + ], + "unique_experts": 38, + "load_cv": 1.2439308659084878, + "normalized_load_entropy": 0.817224143150727, + "max_load_share": 0.07971014492753623 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "23a82af8bc6f6f1ede06c35fe285444f311c53b9d36d3dd7e0401dc2efe150e4", + "route_weight_sha256": "1ebbd6a9c371a319f8714cf91c89fb806af88ecf0ae2045f263b3a12617f2ea8", + "loads": [ + 6, + 0, + 0, + 1, + 2, + 18, + 2, + 4, + 4, + 12, + 10, + 3, + 0, + 1, + 1, + 5, + 0, + 0, + 6, + 1, + 5, + 1, + 0, + 16, + 7, + 3, + 9, + 12, + 13, + 1, + 4, + 10, + 1, + 7, + 0, + 5, + 4, + 3, + 2, + 0, + 0, + 0, + 1, + 1, + 3, + 0, + 11, + 5, + 4, + 4, + 2, + 14, + 6, + 8, + 3, + 6, + 2, + 2, + 6, + 25, + 0, + 3, + 0, + 3 + ], + "weighted_loads": [ + 0.6858795024454594, + 0.0, + 0.0, + 0.04007919505238533, + 0.1280820146203041, + 1.3987517766654491, + 0.14150675386190414, + 0.5321929641067982, + 0.1848481334745884, + 0.7098061982542276, + 0.6128203347325325, + 0.19061566516757011, + 0.0, + 0.05189058557152748, + 0.08534425497055054, + 0.2152123562991619, + 0.0, + 0.0, + 0.3005709405988455, + 0.03977340832352638, + 0.3694593347609043, + 0.050872474908828735, + 0.0, + 1.2203639186918736, + 0.5479750446975231, + 0.12059914320707321, + 0.6863267756998539, + 1.5827423445880413, + 1.6619985103607178, + 0.041223395615816116, + 0.2415427416563034, + 0.44976099021732807, + 0.034215714782476425, + 0.7461618557572365, + 0.0, + 0.319790069013834, + 0.16332772560417652, + 0.14396366477012634, + 0.11623524501919746, + 0.0, + 0.0, + 0.0, + 0.09498634189367294, + 0.03679101541638374, + 0.13250350393354893, + 0.0, + 0.5878029186278582, + 0.22896172478795052, + 0.17891150526702404, + 0.1657603159546852, + 0.09593572467565536, + 1.305899953469634, + 0.7604997456073761, + 0.563599769026041, + 0.21940799616277218, + 0.5135846100747585, + 0.10257458686828613, + 0.10193677619099617, + 0.4626821279525757, + 1.6294015198946, + 0.0, + 0.48762981593608856, + 0.0, + 0.13035020604729652 + ], + "unique_experts": 51, + "load_cv": 1.110416449517038, + "normalized_load_entropy": 0.8661685806273363, + "max_load_share": 0.08680555555555555 + } + }, + "s1_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "30da39614ff850b3f89846325fbdb38e55777811adaa222c387014eb9bbf82e2", + "route_weight_sha256": "788360e92498005223b8b022836cbd8bb02019c22dcf99709fca56c202308dcf", + "loads": [ + 0, + 0, + 0, + 0, + 3, + 6, + 2, + 4, + 3, + 3, + 8, + 0, + 0, + 0, + 1, + 0, + 0, + 0, + 2, + 0, + 5, + 1, + 0, + 7, + 5, + 2, + 2, + 7, + 5, + 1, + 2, + 2, + 1, + 0, + 0, + 6, + 1, + 0, + 0, + 0, + 0, + 0, + 1, + 1, + 1, + 0, + 7, + 0, + 5, + 3, + 0, + 10, + 1, + 0, + 4, + 2, + 1, + 1, + 5, + 12, + 0, + 2, + 0, + 3 + ], + "weighted_loads": [ + 0.0, + 0.0, + 0.0, + 0.0, + 0.1673233024775982, + 0.44673947617411613, + 0.137596033513546, + 0.5321646817028522, + 0.14724794775247574, + 0.1373080238699913, + 0.5157805606722832, + 0.0, + 0.0, + 0.0, + 0.0723051205277443, + 0.0, + 0.0, + 0.0, + 0.10826987400650978, + 0.0, + 0.3648323342204094, + 0.048075877130031586, + 0.0, + 0.8234721831977367, + 0.46884966269135475, + 0.0932747833430767, + 0.2550412490963936, + 1.1655199024826288, + 0.2847335897386074, + 0.03926454111933708, + 0.08881807327270508, + 0.13693154603242874, + 0.03529977425932884, + 0.0, + 0.0, + 0.34739328920841217, + 0.03286515176296234, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.10201393067836761, + 0.03597625717520714, + 0.0597691647708416, + 0.0, + 0.29750631749629974, + 0.0, + 0.2084547746926546, + 0.11311592161655426, + 0.0, + 0.8290929384529591, + 0.042633309960365295, + 0.0, + 0.23606025613844395, + 0.1134534627199173, + 0.057156406342983246, + 0.07405204325914383, + 0.33599095046520233, + 1.013014417141676, + 0.0, + 0.46354976296424866, + 0.0, + 0.1502055525779724 + ], + "unique_experts": 39, + "load_cv": 1.2627006527512001, + "normalized_load_entropy": 0.8175614744239069, + "max_load_share": 0.08695652173913043 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "6c185af791937423003a6faf4b206afc8845d96fa74feb7507a128b788d9f393", + "route_weight_sha256": "4bed481fee8afa408594990e8edf05452bbd358ef4244f89af1815193f18b6bd", + "loads": [ + 10, + 1, + 0, + 2, + 7, + 23, + 2, + 8, + 5, + 15, + 8, + 3, + 6, + 0, + 1, + 4, + 0, + 0, + 8, + 3, + 7, + 4, + 0, + 15, + 12, + 3, + 8, + 13, + 18, + 2, + 9, + 5, + 3, + 10, + 1, + 7, + 3, + 4, + 2, + 1, + 0, + 0, + 2, + 2, + 3, + 0, + 12, + 3, + 7, + 6, + 13, + 13, + 9, + 11, + 6, + 5, + 2, + 3, + 6, + 33, + 3, + 3, + 2, + 7 + ], + "weighted_loads": [ + 0.8664036225527525, + 0.05172812193632126, + 0.0, + 0.07645266130566597, + 0.40304190665483475, + 1.651550643146038, + 0.137596033513546, + 0.7041442021727562, + 0.31332969665527344, + 0.977016843855381, + 0.5157805606722832, + 0.21446195244789124, + 0.39333631098270416, + 0.0, + 0.0723051205277443, + 0.15882380679249763, + 0.0, + 0.0, + 0.4740496948361397, + 0.17517539486289024, + 0.5925790145993233, + 0.14952123537659645, + 0.0, + 1.1758162919431925, + 0.8149238340556622, + 0.14100434258580208, + 0.6632004380226135, + 1.415833892300725, + 1.6905528418719769, + 0.08772486448287964, + 0.41610414907336235, + 0.24845901876688004, + 0.11688191443681717, + 1.08174854144454, + 0.04847671464085579, + 0.42771580815315247, + 0.11898114904761314, + 0.4500342532992363, + 0.14007753133773804, + 0.058142803609371185, + 0.0, + 0.0, + 0.15552827715873718, + 0.08255374804139137, + 0.12064415216445923, + 0.0, + 0.6566004138439894, + 0.10923608765006065, + 0.33628599904477596, + 0.2121505755931139, + 0.8559042662382126, + 1.2473243810236454, + 0.8475523926317692, + 0.808987233787775, + 0.3191269729286432, + 0.4721907824277878, + 0.108977772295475, + 0.15982813015580177, + 0.44496508687734604, + 2.165761161595583, + 0.2523827850818634, + 0.5048088692128658, + 0.10266362503170967, + 0.3049241416156292 + ], + "unique_experts": 56, + "load_cv": 0.9904053603337261, + "normalized_load_entropy": 0.8955172630064098, + "max_load_share": 0.0859375 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 13, + "mean_set_jaccard": 0.875776397515528, + "mean_token_weighted_tv": 0.02298081658132698, + "aggregate_load_tv": 0.05072463768115944 + }, + "system_bos": { + "tokens": 23, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.9130434782608697, + "mean_token_weighted_tv": 0.020525092623479988, + "aggregate_load_tv": 0.043478260869565216 + }, + "system_x": { + "tokens": 23, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.9006211180124224, + "mean_token_weighted_tv": 0.02731570143900488, + "aggregate_load_tv": 0.05797101449275363 + }, + "system_period": { + "tokens": 23, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8788819875776398, + "mean_token_weighted_tv": 0.034211219045455044, + "aggregate_load_tv": 0.06521739130434784 + }, + "bos_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 8, + "set_exact_tokens": 12, + "mean_set_jaccard": 0.8540372670807455, + "mean_token_weighted_tv": 0.031179275282699127, + "aggregate_load_tv": 0.06521739130434784 + }, + "bos_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 13, + "mean_set_jaccard": 0.875776397515528, + "mean_token_weighted_tv": 0.02659608533039041, + "aggregate_load_tv": 0.05072463768115943 + }, + "x_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 7, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8695652173913043, + "mean_token_weighted_tv": 0.03273134929654391, + "aggregate_load_tv": 0.04347826086956523 + }, + "x_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8788819875776398, + "mean_token_weighted_tv": 0.03600261429243762, + "aggregate_load_tv": 0.050724637681159424 + }, + "period_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.9006211180124224, + "mean_token_weighted_tv": 0.026079443971747936, + "aggregate_load_tv": 0.03623188405797102 + }, + "period_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 12, + "mean_set_jaccard": 0.8633540372670809, + "mean_token_weighted_tv": 0.03927230928093195, + "aggregate_load_tv": 0.050724637681159424 + } + } + }, + "layer_15": { + "layer": 15, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "a1edc901f25ae5b776878e228619bdb5e0b7fb5e8c459d33da96ef8e65f29581", + "route_weight_sha256": "ec905b6c81075fc538a50afda0e06fe53d72c150b7610f6093bdcb3c36cbd25f", + "loads": [ + 0, + 4, + 0, + 3, + 3, + 6, + 0, + 0, + 5, + 1, + 2, + 2, + 1, + 0, + 5, + 1, + 0, + 2, + 0, + 1, + 6, + 0, + 1, + 0, + 8, + 5, + 3, + 4, + 7, + 0, + 1, + 2, + 1, + 5, + 1, + 0, + 1, + 4, + 0, + 3, + 8, + 4, + 0, + 1, + 3, + 0, + 1, + 2, + 3, + 2, + 0, + 1, + 4, + 1, + 4, + 5, + 6, + 0, + 2, + 0, + 1, + 1, + 0, + 1 + ], + "weighted_loads": [ + 0.0, + 0.1543765813112259, + 0.0, + 0.09894685633480549, + 0.16160064190626144, + 0.4606301747262478, + 0.0, + 0.0, + 0.19988926500082016, + 0.030704379081726074, + 0.4461369067430496, + 0.06272907508537173, + 0.05942538380622864, + 0.0, + 0.6330121047794819, + 0.03304824233055115, + 0.0, + 0.3526555374264717, + 0.0, + 0.03169557824730873, + 0.28136491775512695, + 0.0, + 0.02786959894001484, + 0.0, + 0.6293771862983704, + 0.2018626630306244, + 0.4983362630009651, + 0.221134714782238, + 0.5162832774221897, + 0.0, + 0.03253293037414551, + 0.37202636152505875, + 0.02019812911748886, + 0.21332812309265137, + 0.08291885256767273, + 0.0, + 0.052746668457984924, + 0.25189922004938126, + 0.0, + 0.1287860944867134, + 0.7731854617595673, + 0.5612729415297508, + 0.0, + 0.04510941728949547, + 0.17750731855630875, + 0.0, + 0.1207985058426857, + 0.06365263741463423, + 0.10260018147528172, + 0.08722136542201042, + 0.0, + 0.06723548471927643, + 0.09773697704076767, + 0.04982355237007141, + 0.19156990200281143, + 1.4226724319159985, + 0.5513971745967865, + 0.0, + 0.16277757659554482, + 0.0, + 0.032535962760448456, + 0.0283519197255373, + 0.0, + 0.04776528477668762 + ], + "unique_experts": 46, + "load_cv": 1.0148032651094037, + "normalized_load_entropy": 0.8674130895928001, + "max_load_share": 0.057971014492753624 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "499c7c8221df8047198bd07085b92ef2378a7979a5ca9b3c5361889d709abb0e", + "route_weight_sha256": "9bd08b2767549e88d370ac7de5e57728749977c12135213a301819adfab05645", + "loads": [ + 5, + 4, + 0, + 3, + 9, + 9, + 9, + 2, + 10, + 2, + 6, + 3, + 5, + 0, + 15, + 2, + 7, + 4, + 0, + 2, + 6, + 0, + 1, + 5, + 13, + 7, + 12, + 4, + 11, + 0, + 5, + 2, + 7, + 7, + 1, + 0, + 6, + 4, + 3, + 3, + 14, + 5, + 0, + 3, + 3, + 0, + 1, + 3, + 4, + 12, + 5, + 3, + 9, + 1, + 4, + 9, + 6, + 0, + 3, + 0, + 1, + 3, + 0, + 5 + ], + "weighted_loads": [ + 0.2668056320399046, + 0.1543765813112259, + 0.0, + 0.09894685633480549, + 0.5134789161384106, + 0.5330828232690692, + 0.6902018524706364, + 0.06800157949328423, + 0.5784921981394291, + 0.06211717426776886, + 0.5954420547932386, + 0.09287751419469714, + 0.3740432821214199, + 0.0, + 1.0119832949712873, + 0.07271076366305351, + 0.6038910262286663, + 0.4254666529595852, + 0.0, + 0.11057483032345772, + 0.28136491775512695, + 0.0, + 0.02786959894001484, + 0.2793641611933708, + 0.7663820988964289, + 0.25926378555595875, + 1.1095310375094414, + 0.221134714782238, + 0.6617793068289757, + 0.0, + 0.20232836343348026, + 0.37202636152505875, + 0.47471256367862225, + 0.3019496910274029, + 0.08291885256767273, + 0.0, + 0.7608398320153356, + 0.25189922004938126, + 0.08142245374619961, + 0.1287860944867134, + 1.336635746061802, + 0.5655624023638666, + 0.0, + 0.13171550258994102, + 0.17750731855630875, + 0.0, + 0.1207985058426857, + 0.09804708417505026, + 0.11611081194132566, + 1.816831685602665, + 0.30777060613036156, + 0.1488942801952362, + 0.25200332421809435, + 0.04982355237007141, + 0.19156990200281143, + 3.0884132869541645, + 0.5513971745967865, + 0.0, + 0.20805853605270386, + 0.0, + 0.032535962760448456, + 0.11581634916365147, + 0.0, + 0.22314877808094025 + ], + "unique_experts": 53, + "load_cv": 0.8489281549964515, + "normalized_load_entropy": 0.9059642397123315, + "max_load_share": 0.052083333333333336 + } + }, + "s1_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "fab5e471fa62bd6c82cf5f47e442ff6c4f8fccbfbd9dc884da7860e2e38c20df", + "route_weight_sha256": "1cd609479b7b6255802c87a7047439d85948efea85d5d1e4d570dfa5f23868a1", + "loads": [ + 0, + 4, + 0, + 2, + 3, + 6, + 0, + 0, + 5, + 1, + 2, + 2, + 1, + 0, + 5, + 1, + 0, + 2, + 0, + 1, + 6, + 0, + 1, + 0, + 8, + 5, + 3, + 4, + 7, + 0, + 1, + 2, + 1, + 4, + 1, + 0, + 1, + 4, + 0, + 3, + 9, + 4, + 0, + 1, + 3, + 0, + 2, + 2, + 3, + 2, + 0, + 1, + 3, + 2, + 4, + 5, + 6, + 0, + 2, + 0, + 1, + 1, + 0, + 1 + ], + "weighted_loads": [ + 0.0, + 0.15056252852082253, + 0.0, + 0.0700000561773777, + 0.14841308444738388, + 0.47105878219008446, + 0.0, + 0.0, + 0.19897845946252346, + 0.030315257608890533, + 0.447423979640007, + 0.058537247590720654, + 0.05916938930749893, + 0.0, + 0.6319994404911995, + 0.03681878745555878, + 0.0, + 0.3440629690885544, + 0.0, + 0.03389611095190048, + 0.2738714851438999, + 0.0, + 0.02656456083059311, + 0.0, + 0.6313758324831724, + 0.19992252439260483, + 0.48998551443219185, + 0.22352291643619537, + 0.5142823215574026, + 0.0, + 0.031477190554142, + 0.34373175352811813, + 0.018428606912493706, + 0.18558228760957718, + 0.08106767386198044, + 0.0, + 0.05222466215491295, + 0.24808959662914276, + 0.0, + 0.1343085616827011, + 0.8122166376560926, + 0.5512868855148554, + 0.0, + 0.04474726319313049, + 0.17792833596467972, + 0.0, + 0.14809185452759266, + 0.06267497222870588, + 0.1011971440166235, + 0.08755720779299736, + 0.0, + 0.06660553067922592, + 0.07568032667040825, + 0.07739811204373837, + 0.18230202049016953, + 1.403303999453783, + 0.538018312305212, + 0.0, + 0.17063511908054352, + 0.0, + 0.03509478271007538, + 0.03034270741045475, + 0.0, + 0.047923650592565536 + ], + "unique_experts": 46, + "load_cv": 1.018109495054115, + "normalized_load_entropy": 0.8687178184109837, + "max_load_share": 0.06521739130434782 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "57fed0a90555c952e02fda250ed29a1ba4a627e5b2c05e1747d5c37e86ced630", + "route_weight_sha256": "0e31113e95f888afa50d082a3f4d050cf25e783643832623744cbe72fd2e2136", + "loads": [ + 20, + 5, + 0, + 2, + 13, + 12, + 14, + 1, + 15, + 2, + 7, + 6, + 6, + 1, + 11, + 11, + 12, + 5, + 1, + 5, + 7, + 1, + 1, + 5, + 12, + 6, + 13, + 6, + 13, + 1, + 7, + 6, + 7, + 6, + 3, + 0, + 7, + 4, + 2, + 4, + 15, + 6, + 0, + 3, + 3, + 1, + 2, + 4, + 6, + 16, + 8, + 3, + 4, + 3, + 4, + 9, + 6, + 6, + 4, + 4, + 1, + 8, + 2, + 6 + ], + "weighted_loads": [ + 1.3282770477235317, + 0.1766553558409214, + 0.0, + 0.0700000561773777, + 0.6561215743422508, + 0.7064119055867195, + 1.1696565318852663, + 0.033466704189777374, + 0.7896605953574181, + 0.061450645327568054, + 0.6808344796299934, + 0.39177371840924025, + 0.4842614158987999, + 0.08141332864761353, + 0.8341049989685416, + 0.7041070442646742, + 1.0994097590446472, + 0.4585530199110508, + 0.05279861018061638, + 0.3032469004392624, + 0.3027512412518263, + 0.08194843679666519, + 0.02656456083059311, + 0.255330890417099, + 0.7213360816240311, + 0.2282501794397831, + 1.1802129112184048, + 0.34776705875992775, + 0.943721579387784, + 0.03784303739666939, + 0.2542140930891037, + 0.7878355570137501, + 0.4374123550951481, + 0.30255991965532303, + 0.23051442578434944, + 0.0, + 0.7172843078151345, + 0.24808959662914276, + 0.05801291577517986, + 0.17035944759845734, + 1.293678133515641, + 0.6428517363965511, + 0.0, + 0.31850429624319077, + 0.17792833596467972, + 0.03965635970234871, + 0.14809185452759266, + 0.12599042896181345, + 0.24434014316648245, + 2.6342364475131035, + 0.39344505220651627, + 0.1371046081185341, + 0.08957717288285494, + 0.21150191687047482, + 0.18230202049016953, + 3.0511003397405148, + 0.538018312305212, + 0.6625599414110184, + 0.25144951045513153, + 0.17298150435090065, + 0.03509478271007538, + 0.4086249116808176, + 0.11951877921819687, + 0.2565489783883095 + ], + "unique_experts": 61, + "load_cv": 0.7551903733496608, + "normalized_load_entropy": 0.9308102366395279, + "max_load_share": 0.052083333333333336 + } + }, + "s0_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "def22a8ca6198d3310202dbc56867dc4c69315304a19b6df8dea79a6cce6a37f", + "route_weight_sha256": "3b33b5b4df29b8ed4d479abd14866d8fcf7ef55e8373aad2b9557343514e6081", + "loads": [ + 1, + 4, + 0, + 3, + 3, + 5, + 0, + 0, + 4, + 1, + 3, + 2, + 1, + 0, + 5, + 1, + 0, + 2, + 0, + 1, + 6, + 0, + 1, + 0, + 7, + 4, + 3, + 4, + 8, + 0, + 1, + 2, + 1, + 5, + 1, + 0, + 2, + 4, + 1, + 3, + 8, + 4, + 0, + 1, + 3, + 0, + 2, + 2, + 3, + 2, + 1, + 1, + 2, + 1, + 4, + 4, + 6, + 0, + 2, + 0, + 1, + 1, + 0, + 1 + ], + "weighted_loads": [ + 0.040639884769916534, + 0.14143321104347706, + 0.0, + 0.10669281333684921, + 0.1608307920396328, + 0.4324801992624998, + 0.0, + 0.0, + 0.1634772177785635, + 0.03108268976211548, + 0.4778802990913391, + 0.062429682817310095, + 0.060832273215055466, + 0.0, + 0.6190252602100372, + 0.033259376883506775, + 0.0, + 0.3435092568397522, + 0.0, + 0.033653248101472855, + 0.2754876147955656, + 0.0, + 0.028835177421569824, + 0.0, + 0.6316270083189011, + 0.16741226613521576, + 0.5045841000974178, + 0.2150660865008831, + 0.5502589549869299, + 0.0, + 0.03264051675796509, + 0.3552071042358875, + 0.019798606634140015, + 0.22331055998802185, + 0.07384871691465378, + 0.0, + 0.08104240708053112, + 0.27084682509303093, + 0.03545030951499939, + 0.15328441187739372, + 0.7659526709467173, + 0.560405608266592, + 0.0, + 0.04949791356921196, + 0.20117086172103882, + 0.0, + 0.14468838833272457, + 0.06361169368028641, + 0.09257572889328003, + 0.08976641297340393, + 0.033067088574171066, + 0.06514978408813477, + 0.03996418183669448, + 0.05040622130036354, + 0.19066854752600193, + 1.3916414938867092, + 0.5595001466572285, + 0.0, + 0.16143998131155968, + 0.0, + 0.03796132281422615, + 0.028998635709285736, + 0.0, + 0.04829658195376396 + ], + "unique_experts": 49, + "load_cv": 0.9533324079822425, + "normalized_load_entropy": 0.8842901046302846, + "max_load_share": 0.057971014492753624 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "af373dd60a5f39aa76b1f54871668e15c8aca6e50c7e9c763148eacc41def603", + "route_weight_sha256": "4394e1187889952dd6170088523da7cc7ccb0a240c74ad8e419d78cddbd60f07", + "loads": [ + 6, + 4, + 0, + 3, + 10, + 8, + 8, + 2, + 8, + 2, + 7, + 3, + 5, + 0, + 14, + 2, + 7, + 4, + 0, + 2, + 6, + 0, + 1, + 5, + 11, + 5, + 12, + 4, + 13, + 0, + 6, + 2, + 7, + 7, + 1, + 1, + 8, + 4, + 2, + 3, + 15, + 4, + 0, + 3, + 3, + 0, + 2, + 3, + 4, + 11, + 7, + 4, + 7, + 2, + 6, + 6, + 6, + 0, + 3, + 0, + 1, + 3, + 0, + 5 + ], + "weighted_loads": [ + 0.31195355020463467, + 0.14143321104347706, + 0.0, + 0.10669281333684921, + 0.49691831320524216, + 0.5401759389787912, + 0.5288807265460491, + 0.06800157949328423, + 0.5089440774172544, + 0.062495484948158264, + 0.6271854471415281, + 0.0925781219266355, + 0.3797892928123474, + 0.0, + 0.9878823310136795, + 0.07292189821600914, + 0.5943608582019806, + 0.4163203723728657, + 0.0, + 0.11253250017762184, + 0.2754876147955656, + 0.0, + 0.028835177421569824, + 0.2793641611933708, + 0.7809278499335051, + 0.19579549692571163, + 1.115778874605894, + 0.2150660865008831, + 0.7654653880745173, + 0.0, + 0.25970990397036076, + 0.3552071042358875, + 0.48103819228708744, + 0.31193212792277336, + 0.07384871691465378, + 0.10323166102170944, + 0.8225550977513194, + 0.27084682509303093, + 0.06630004197359085, + 0.15328441187739372, + 1.370865186676383, + 0.560405608266592, + 0.0, + 0.13610399886965752, + 0.20117086172103882, + 0.0, + 0.14468838833272457, + 0.09800614044070244, + 0.10608635935932398, + 1.6270526424050331, + 0.41490568220615387, + 0.19516068324446678, + 0.19423052901402116, + 0.11627192422747612, + 0.2921715248376131, + 2.0361452288925648, + 0.5595001466572285, + 0.0, + 0.20672094076871872, + 0.0, + 0.03796132281422615, + 0.1164630651473999, + 0.0, + 0.24078474938869476 + ], + "unique_experts": 54, + "load_cv": 0.8174410538645644, + "normalized_load_entropy": 0.912693756366686, + "max_load_share": 0.052083333333333336 + } + }, + "s1_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "2b6c1fc4df49536e380bd459b0244b06dea4b9a95e5beef4d10a82a583cdca63", + "route_weight_sha256": "9c645270e9e04b6872be2104f55a31a432a3d6bd42061595a0dc1cfcbe150cb2", + "loads": [ + 0, + 4, + 0, + 3, + 3, + 5, + 0, + 0, + 5, + 1, + 2, + 2, + 1, + 1, + 5, + 1, + 0, + 2, + 0, + 1, + 6, + 1, + 0, + 0, + 8, + 5, + 3, + 4, + 6, + 0, + 0, + 2, + 1, + 4, + 1, + 0, + 2, + 4, + 1, + 3, + 8, + 4, + 0, + 1, + 3, + 0, + 2, + 3, + 3, + 2, + 1, + 1, + 2, + 2, + 4, + 4, + 6, + 0, + 2, + 0, + 1, + 1, + 0, + 1 + ], + "weighted_loads": [ + 0.0, + 0.1529211848974228, + 0.0, + 0.09822404012084007, + 0.15777023509144783, + 0.45040296763181686, + 0.0, + 0.0, + 0.2076582033187151, + 0.031877271831035614, + 0.39665861427783966, + 0.05576480785384774, + 0.05933046340942383, + 0.03093653917312622, + 0.5830871053040028, + 0.03758372738957405, + 0.0, + 0.345103420317173, + 0.0, + 0.03320705145597458, + 0.2758778650313616, + 0.027848215773701668, + 0.0, + 0.0, + 0.6364873815327883, + 0.19579780846834183, + 0.5179352425038815, + 0.21930275857448578, + 0.5059951096773148, + 0.0, + 0.0, + 0.3488469794392586, + 0.017730459570884705, + 0.19107893481850624, + 0.07260703295469284, + 0.0, + 0.08014337904751301, + 0.25249622389674187, + 0.03557760268449783, + 0.14498330652713776, + 0.7662841137498617, + 0.5398747641593218, + 0.0, + 0.048968348652124405, + 0.1950141154229641, + 0.0, + 0.1442843470722437, + 0.08979417756199837, + 0.09370598196983337, + 0.09095945954322815, + 0.03824625536799431, + 0.061929959803819656, + 0.03996426658704877, + 0.07777864299714565, + 0.18681739643216133, + 1.4099890477955341, + 0.5511312708258629, + 0.0, + 0.16460717469453812, + 0.0, + 0.034159302711486816, + 0.028540901839733124, + 0.0, + 0.04857618734240532 + ], + "unique_experts": 48, + "load_cv": 0.9498007175542577, + "normalized_load_entropy": 0.8825172410742936, + "max_load_share": 0.057971014492753624 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "84b81efec78080fb436f26704da1fd25c53ccb86fafed2b4f2b0a25798dfee8c", + "route_weight_sha256": "ea1c00ee33beb78b08114e2caf0c25e259766f27d453c8753c18c9ff19b7d26b", + "loads": [ + 21, + 5, + 0, + 3, + 14, + 11, + 14, + 1, + 14, + 2, + 7, + 6, + 6, + 2, + 10, + 11, + 12, + 5, + 1, + 5, + 7, + 2, + 0, + 5, + 13, + 6, + 13, + 6, + 12, + 1, + 7, + 6, + 7, + 6, + 3, + 0, + 9, + 4, + 2, + 4, + 14, + 5, + 0, + 3, + 3, + 1, + 2, + 5, + 6, + 16, + 10, + 3, + 3, + 3, + 4, + 7, + 6, + 6, + 4, + 4, + 1, + 8, + 2, + 5 + ], + "weighted_loads": [ + 1.4213694967329502, + 0.17901401221752167, + 0.0, + 0.09822404012084007, + 0.6428347211331129, + 0.7399786002933979, + 1.0592275578528643, + 0.033466704189777374, + 0.7451315000653267, + 0.06301265954971313, + 0.6300691142678261, + 0.38900127867236733, + 0.47670362517237663, + 0.11234986782073975, + 0.773653082549572, + 0.7048719841986895, + 1.0773167200386524, + 0.4595934711396694, + 0.05279861018061638, + 0.3025578409433365, + 0.30475762113928795, + 0.10979665257036686, + 0.0, + 0.255330890417099, + 0.8254662472754717, + 0.2241254635155201, + 1.2081626392900944, + 0.34354690089821815, + 0.9354343675076962, + 0.03784303739666939, + 0.2727034166455269, + 0.7929507829248905, + 0.4367142077535391, + 0.3080565668642521, + 0.22205378487706184, + 0.0, + 0.7745565427467227, + 0.25249622389674187, + 0.06777667999267578, + 0.18103419244289398, + 1.3240780755877495, + 0.6272436399012804, + 0.0, + 0.3227253817021847, + 0.1950141154229641, + 0.03965635970234871, + 0.1442843470722437, + 0.16213738918304443, + 0.23684898111969233, + 2.5169838815927505, + 0.46392589807510376, + 0.13242903724312782, + 0.05386111279949546, + 0.2118824478238821, + 0.18681739643216133, + 2.119394462555647, + 0.5511312708258629, + 0.6625599414110184, + 0.24542156606912613, + 0.17298150435090065, + 0.034159302711486816, + 0.406823106110096, + 0.11951877921819687, + 0.2302187867462635 + ], + "unique_experts": 60, + "load_cv": 0.7528879583163605, + "normalized_load_entropy": 0.9311857857666922, + "max_load_share": 0.0546875 + } + }, + "s0_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "4b797aed200c8aacf80204f023076a95b275292d4832b2583afe16a32455f850", + "route_weight_sha256": "030ecf08a274fe79b5901fc6b7fed4d3af03a21c4d795c96a146a40e22ecf8d1", + "loads": [ + 0, + 4, + 0, + 2, + 3, + 6, + 0, + 0, + 5, + 1, + 2, + 2, + 1, + 0, + 5, + 1, + 0, + 2, + 0, + 1, + 6, + 0, + 1, + 0, + 7, + 4, + 3, + 4, + 7, + 0, + 1, + 2, + 1, + 4, + 1, + 0, + 2, + 4, + 1, + 3, + 8, + 4, + 0, + 1, + 3, + 0, + 2, + 2, + 3, + 2, + 1, + 1, + 3, + 2, + 4, + 4, + 6, + 0, + 2, + 0, + 1, + 1, + 1, + 1 + ], + "weighted_loads": [ + 0.0, + 0.14445634558796883, + 0.0, + 0.06275689601898193, + 0.17168856412172318, + 0.4443649295717478, + 0.0, + 0.0, + 0.22606924921274185, + 0.03302205353975296, + 0.47266314923763275, + 0.06552426097914577, + 0.06504552066326141, + 0.0, + 0.5600828751921654, + 0.03474980965256691, + 0.0, + 0.36980318278074265, + 0.0, + 0.03293423727154732, + 0.3031922895461321, + 0.0, + 0.029307303950190544, + 0.0, + 0.6290347035974264, + 0.1523977555334568, + 0.508565042167902, + 0.2199089266359806, + 0.523754209280014, + 0.0, + 0.034314464777708054, + 0.3509332910180092, + 0.018314924091100693, + 0.18184850364923477, + 0.06801368296146393, + 0.0, + 0.08251052163541317, + 0.27014346793293953, + 0.03615255281329155, + 0.14375194162130356, + 0.7609903421252966, + 0.5720480717718601, + 0.0, + 0.04940054938197136, + 0.1975337713956833, + 0.0, + 0.14706320315599442, + 0.06111070606857538, + 0.09690629318356514, + 0.08788154274225235, + 0.03809436038136482, + 0.06879125535488129, + 0.06555100297555327, + 0.08098754659295082, + 0.20462510362267494, + 1.3920910842716694, + 0.5416180677711964, + 0.0, + 0.1666327752172947, + 0.0, + 0.03377397358417511, + 0.03377746790647507, + 0.03907687962055206, + 0.04452956095337868 + ], + "unique_experts": 49, + "load_cv": 0.9426976445188068, + "normalized_load_entropy": 0.8857433274779538, + "max_load_share": 0.057971014492753624 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "85002faf3e06740a8138af0adff31e2776f9000b0eda907eb7d153f5bc3537a0", + "route_weight_sha256": "292d87049b00e8c175074bb985a654ab36e5fb6c81aad87a94c8905f127e6901", + "loads": [ + 4, + 4, + 0, + 2, + 10, + 8, + 9, + 2, + 10, + 2, + 7, + 3, + 5, + 0, + 14, + 2, + 7, + 4, + 0, + 3, + 6, + 0, + 1, + 6, + 11, + 6, + 13, + 4, + 11, + 0, + 6, + 2, + 6, + 6, + 1, + 0, + 7, + 4, + 3, + 3, + 14, + 4, + 0, + 4, + 3, + 0, + 2, + 4, + 4, + 10, + 6, + 3, + 9, + 3, + 4, + 7, + 6, + 0, + 3, + 0, + 1, + 4, + 1, + 4 + ], + "weighted_loads": [ + 0.2660387400537729, + 0.14445634558796883, + 0.0, + 0.06275689601898193, + 0.5369030684232712, + 0.49994909577071667, + 0.6817395463585854, + 0.06800157949328423, + 0.6280135661363602, + 0.06443484872579575, + 0.688266983255744, + 0.09567270008847117, + 0.3832944370806217, + 0.0, + 0.9289399459958076, + 0.07441233098506927, + 0.6052850298583508, + 0.4426142983138561, + 0.0, + 0.16037093102931976, + 0.3031922895461321, + 0.0, + 0.029307303950190544, + 0.37817542254924774, + 0.7523435652256012, + 0.219373332336545, + 1.2323295436799526, + 0.2199089266359806, + 0.6692502386868, + 0.0, + 0.2490359041839838, + 0.3509332910180092, + 0.4440337736159563, + 0.2704700715839863, + 0.06801368296146393, + 0.0, + 0.7492274222895503, + 0.27014346793293953, + 0.11737444996833801, + 0.14375194162130356, + 1.274336813017726, + 0.5720480717718601, + 0.0, + 0.21376367285847664, + 0.1975337713956833, + 0.0, + 0.14706320315599442, + 0.14699640963226557, + 0.11041692364960909, + 1.3729507699608803, + 0.34337645024061203, + 0.15045005083084106, + 0.2572887004353106, + 0.116022489964962, + 0.20462510362267494, + 2.0882790237665176, + 0.5416180677711964, + 0.0, + 0.21191373467445374, + 0.0, + 0.03377397358417511, + 0.18928994983434677, + 0.03907687962055206, + 0.17781761288642883 + ], + "unique_experts": 54, + "load_cv": 0.8021960598996473, + "normalized_load_entropy": 0.9149709950436128, + "max_load_share": 0.04861111111111111 + } + }, + "s1_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "194e97ddcefd5b37bb265e96e625ea6321d422452d368fd602157f144ad2cc71", + "route_weight_sha256": "4df84490679d1b8cb8666c1f87d72b9797c3ac53ee7ae9d1064c15227c867b60", + "loads": [ + 0, + 3, + 0, + 1, + 3, + 4, + 0, + 0, + 5, + 1, + 3, + 2, + 2, + 0, + 7, + 1, + 0, + 2, + 0, + 0, + 6, + 1, + 1, + 0, + 8, + 5, + 3, + 4, + 7, + 0, + 1, + 2, + 0, + 4, + 1, + 0, + 1, + 4, + 1, + 3, + 8, + 4, + 0, + 1, + 3, + 0, + 3, + 2, + 2, + 2, + 1, + 3, + 2, + 2, + 4, + 4, + 6, + 0, + 2, + 0, + 1, + 1, + 0, + 1 + ], + "weighted_loads": [ + 0.0, + 0.11052372120320797, + 0.0, + 0.04081936180591583, + 0.1556187942624092, + 0.3703279681503773, + 0.0, + 0.0, + 0.25051576271653175, + 0.03236899897456169, + 0.43285633996129036, + 0.053843215107917786, + 0.09289603866636753, + 0.0, + 0.6128663830459118, + 0.03850029408931732, + 0.0, + 0.3480725362896919, + 0.0, + 0.0, + 0.3314920775592327, + 0.02716020867228508, + 0.026973916217684746, + 0.0, + 0.664463222026825, + 0.19247587211430073, + 0.46993622928857803, + 0.22693556919693947, + 0.48644905537366867, + 0.0, + 0.03324798494577408, + 0.35448452085256577, + 0.0, + 0.17202896252274513, + 0.06903574615716934, + 0.0, + 0.05564279109239578, + 0.25711629912257195, + 0.03976580873131752, + 0.13921723142266273, + 0.7442843168973923, + 0.5567856207489967, + 0.0, + 0.04855776205658913, + 0.18861082941293716, + 0.0, + 0.1798863299190998, + 0.05645408108830452, + 0.07144122198224068, + 0.0744537003338337, + 0.03736886754631996, + 0.11617005243897438, + 0.040623839013278484, + 0.07921300642192364, + 0.18571743741631508, + 1.3379720114171505, + 0.5335994549095631, + 0.0, + 0.1633422151207924, + 0.0, + 0.03472033143043518, + 0.028798630461096764, + 0.0, + 0.04335803911089897 + ], + "unique_experts": 47, + "load_cv": 0.9845476999581908, + "normalized_load_entropy": 0.8760814917291616, + "max_load_share": 0.057971014492753624 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "aee0a3ad4259dd9542e5833dc7617331b8283151d054d0bc4e6cc63a54e39585", + "route_weight_sha256": "f1cf5026caa4afe50b2bd421d44fdffa059a6b3a5f840ea94837edb144b8615a", + "loads": [ + 21, + 4, + 0, + 1, + 13, + 8, + 14, + 1, + 16, + 2, + 9, + 6, + 7, + 1, + 12, + 12, + 12, + 5, + 1, + 5, + 7, + 2, + 1, + 6, + 11, + 6, + 14, + 6, + 13, + 2, + 7, + 6, + 7, + 6, + 3, + 0, + 7, + 4, + 3, + 4, + 12, + 5, + 0, + 4, + 3, + 1, + 3, + 4, + 5, + 16, + 7, + 6, + 3, + 3, + 4, + 7, + 6, + 6, + 4, + 4, + 1, + 9, + 2, + 4 + ], + "weighted_loads": [ + 1.4282884411513805, + 0.13661654852330685, + 0.0, + 0.04081936180591583, + 0.6130759157240391, + 0.5804312378168106, + 1.1834575776010752, + 0.033466704189777374, + 0.9346303548663855, + 0.06350438669323921, + 0.7189303338527679, + 0.3870796859264374, + 0.5363766495138407, + 0.08141332864761353, + 0.803432360291481, + 0.7407297026365995, + 1.0563126802444458, + 0.46256258711218834, + 0.05279861018061638, + 0.32167817279696465, + 0.3603718336671591, + 0.10910864546895027, + 0.026973916217684746, + 0.32786131650209427, + 0.7507515735924244, + 0.220803527161479, + 1.2860785722732544, + 0.35117971152067184, + 0.9158883132040501, + 0.0659666433930397, + 0.2559848874807358, + 0.7985883243381977, + 0.4729198757559061, + 0.289006594568491, + 0.21848249807953835, + 0.0, + 0.6244229832664132, + 0.25711629912257195, + 0.11809030920267105, + 0.17526811733841896, + 1.111562306061387, + 0.6441544964909554, + 0.0, + 0.45153262838721275, + 0.18861082941293716, + 0.03965635970234871, + 0.1798863299190998, + 0.15443960949778557, + 0.21458422113209963, + 2.0698931477963924, + 0.27145102992653847, + 0.22165299206972122, + 0.054520685225725174, + 0.2133168112486601, + 0.18571743741631508, + 2.013965029269457, + 0.5335994549095631, + 0.6625599414110184, + 0.2441566064953804, + 0.17298150435090065, + 0.03472033143043518, + 0.45818877778947353, + 0.11951877921819687, + 0.1681700311601162 + ], + "unique_experts": 61, + "load_cv": 0.7482618748361655, + "normalized_load_entropy": 0.9332737469241354, + "max_load_share": 0.0546875 + } + }, + "s0_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "0edc6fbdacd50ce0ad155d65b0ecb98f8235da80f33b8d8a11d5dc8c4f430097", + "route_weight_sha256": "bb6adff60af0e411f581aff4161b718c1267f55cceb4c1072a84fb267ef24eca", + "loads": [ + 0, + 4, + 0, + 3, + 3, + 6, + 0, + 0, + 5, + 1, + 2, + 2, + 1, + 0, + 5, + 1, + 0, + 2, + 0, + 1, + 5, + 0, + 1, + 0, + 7, + 5, + 3, + 4, + 7, + 0, + 1, + 2, + 1, + 5, + 1, + 0, + 2, + 4, + 1, + 3, + 8, + 4, + 0, + 1, + 3, + 0, + 2, + 3, + 3, + 2, + 1, + 1, + 2, + 1, + 4, + 4, + 6, + 0, + 2, + 0, + 1, + 1, + 0, + 1 + ], + "weighted_loads": [ + 0.0, + 0.14186445623636246, + 0.0, + 0.09679223597049713, + 0.18295657634735107, + 0.4380423538386822, + 0.0, + 0.0, + 0.21879499219357967, + 0.033215101808309555, + 0.4421393573284149, + 0.0638732765801251, + 0.06089409813284874, + 0.0, + 0.5581882484257221, + 0.03609379008412361, + 0.0, + 0.3518333286046982, + 0.0, + 0.03619563579559326, + 0.26696428656578064, + 0.0, + 0.029560798779129982, + 0.0, + 0.6314903907477856, + 0.19011233001947403, + 0.4926690421998501, + 0.21611302345991135, + 0.5232909210026264, + 0.0, + 0.03407371789216995, + 0.35066407173871994, + 0.01922040991485119, + 0.20817014016211033, + 0.07044447958469391, + 0.0, + 0.08143270574510098, + 0.2686487250030041, + 0.037732139229774475, + 0.1392141878604889, + 0.7637831531465054, + 0.5603392384946346, + 0.0, + 0.04918853938579559, + 0.19417300820350647, + 0.0, + 0.14738759025931358, + 0.08700442686676979, + 0.09645913541316986, + 0.09458834305405617, + 0.04176240414381027, + 0.06554659456014633, + 0.03954634862020612, + 0.051013119518756866, + 0.205436609685421, + 1.3978664837777615, + 0.5653257928788662, + 0.0, + 0.17173627391457558, + 0.0, + 0.033060457557439804, + 0.03387214243412018, + 0.0, + 0.04510215297341347 + ], + "unique_experts": 48, + "load_cv": 0.9568510632025544, + "normalized_load_entropy": 0.8808229966553125, + "max_load_share": 0.057971014492753624 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "9e2e1a9c67759d02a63c75c086ea98cada5e006a4c83586005ef075d0197a733", + "route_weight_sha256": "ede126bee1227ecd199c797ece420d328c358f38e675e20172dd0434c48cf1b2", + "loads": [ + 4, + 4, + 0, + 3, + 9, + 8, + 10, + 2, + 10, + 2, + 6, + 4, + 5, + 0, + 14, + 2, + 7, + 4, + 0, + 2, + 5, + 0, + 1, + 6, + 11, + 7, + 13, + 4, + 11, + 0, + 6, + 2, + 7, + 7, + 1, + 0, + 8, + 4, + 3, + 3, + 14, + 4, + 0, + 3, + 3, + 0, + 2, + 5, + 4, + 10, + 6, + 3, + 7, + 2, + 4, + 7, + 6, + 0, + 4, + 0, + 1, + 4, + 0, + 4 + ], + "weighted_loads": [ + 0.2611934933811426, + 0.14186445623636246, + 0.0, + 0.09679223597049713, + 0.5587965771555901, + 0.48439136520028114, + 0.6507478505373001, + 0.06800157949328423, + 0.6100626867264509, + 0.06462789699435234, + 0.5914445053786039, + 0.12809706898406148, + 0.3559470474720001, + 0.0, + 0.9270453192293644, + 0.07575631141662598, + 0.6269105561077595, + 0.42464444413781166, + 0.0, + 0.11507488787174225, + 0.26696428656578064, + 0.0, + 0.029560798779129982, + 0.36367955058813095, + 0.7660455424338579, + 0.25489882938563824, + 1.1471420340240002, + 0.21611302345991135, + 0.6687869504094124, + 0.0, + 0.25045121647417545, + 0.35066407173871994, + 0.48172519356012344, + 0.29679170809686184, + 0.07044447958469391, + 0.0, + 0.8033585054799914, + 0.2686487250030041, + 0.12767865508794785, + 0.1392141878604889, + 1.4174888469278812, + 0.5603392384946346, + 0.0, + 0.13579462468624115, + 0.19417300820350647, + 0.0, + 0.14738759025931358, + 0.16843902692198753, + 0.10996976587921381, + 1.4286975599825382, + 0.35760609433054924, + 0.1472053900361061, + 0.1938126957975328, + 0.09243734553456306, + 0.205436609685421, + 2.1049975119531155, + 0.5653257928788662, + 0.0, + 0.27028924599289894, + 0.0, + 0.033060457557439804, + 0.26143892854452133, + 0.0, + 0.17839020490646362 + ], + "unique_experts": 53, + "load_cv": 0.8060343404748282, + "normalized_load_entropy": 0.9126829019722057, + "max_load_share": 0.04861111111111111 + } + }, + "s1_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "3ad41b2b0c4d1614d270bb58327d04881b90524b5c37e9093b3b364024ffb059", + "route_weight_sha256": "93b74b79ebd7600f658ad27e25b554b46a0009759e9947a1d75b7ae7b06b3697", + "loads": [ + 0, + 4, + 0, + 1, + 3, + 6, + 0, + 0, + 5, + 1, + 2, + 2, + 2, + 0, + 7, + 1, + 0, + 2, + 0, + 0, + 6, + 0, + 0, + 0, + 7, + 4, + 3, + 4, + 7, + 0, + 1, + 2, + 2, + 5, + 1, + 0, + 1, + 4, + 1, + 3, + 7, + 4, + 0, + 1, + 3, + 0, + 2, + 3, + 3, + 2, + 1, + 1, + 3, + 2, + 4, + 4, + 5, + 0, + 2, + 0, + 1, + 1, + 1, + 1 + ], + "weighted_loads": [ + 0.0, + 0.1428360566496849, + 0.0, + 0.04780910909175873, + 0.14568836614489555, + 0.4179459400475025, + 0.0, + 0.0, + 0.2230224832892418, + 0.032317154109478, + 0.4063909649848938, + 0.05146948527544737, + 0.09312132187187672, + 0.0, + 0.5616969652473927, + 0.039134424179792404, + 0.0, + 0.3475709855556488, + 0.0, + 0.0, + 0.3319020550698042, + 0.0, + 0.0, + 0.0, + 0.6137692872434855, + 0.16115960851311684, + 0.45017213746905327, + 0.2302130162715912, + 0.48273965157568455, + 0.0, + 0.03329750522971153, + 0.3622312769293785, + 0.04385931417346001, + 0.20468952506780624, + 0.07653825730085373, + 0.0, + 0.05231565609574318, + 0.25887786224484444, + 0.04178018122911453, + 0.13715600967407227, + 0.7292343750596046, + 0.5630680210888386, + 0.0, + 0.04948331043124199, + 0.1889500804245472, + 0.0, + 0.15566976368427277, + 0.08412256557494402, + 0.09908519312739372, + 0.08389871567487717, + 0.04241026192903519, + 0.06225147098302841, + 0.06156390439718962, + 0.07746533676981926, + 0.1878522913902998, + 1.3499114364385605, + 0.486691378057003, + 0.0, + 0.17086870968341827, + 0.0, + 0.03462979942560196, + 0.029400182887911797, + 0.038107894361019135, + 0.05034293606877327 + ], + "unique_experts": 47, + "load_cv": 0.9603568264944531, + "normalized_load_entropy": 0.8783064653027365, + "max_load_share": 0.050724637681159424 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "3e6149a4cbaa51e6ca4c5aff80731c4f6d93268298fa05547d53848780b71551", + "route_weight_sha256": "df6b14a38773a4e6e4315d1cf6604d19a48a4c7b50379e26eaba54b596b6fe96", + "loads": [ + 21, + 5, + 0, + 1, + 13, + 10, + 14, + 1, + 16, + 2, + 8, + 6, + 7, + 1, + 12, + 13, + 12, + 5, + 1, + 4, + 7, + 1, + 0, + 5, + 10, + 5, + 14, + 6, + 13, + 1, + 7, + 6, + 8, + 8, + 3, + 0, + 7, + 4, + 3, + 4, + 12, + 5, + 0, + 4, + 3, + 1, + 2, + 5, + 6, + 15, + 8, + 3, + 4, + 3, + 4, + 7, + 5, + 6, + 5, + 4, + 1, + 10, + 3, + 4 + ], + "weighted_loads": [ + 1.383414376527071, + 0.16892888396978378, + 0.0, + 0.04780910909175873, + 0.6547056138515472, + 0.6144292764365673, + 1.2128172684460878, + 0.033466704189777374, + 0.8869396056979895, + 0.06345254182815552, + 0.6698973439633846, + 0.38470595609396696, + 0.510372007265687, + 0.08141332864761353, + 0.7522629424929619, + 0.7782935630530119, + 1.0395577400922775, + 0.4620610363781452, + 0.05279861018061638, + 0.2693507894873619, + 0.36078181117773056, + 0.08194843679666519, + 0.0, + 0.255330890417099, + 0.7000576388090849, + 0.1894872635602951, + 1.1890662834048271, + 0.35445715859532356, + 0.9121789094060659, + 0.03784303739666939, + 0.25603440776467323, + 0.8063350804150105, + 0.4628430623561144, + 0.352631576359272, + 0.22598500922322273, + 0.0, + 0.769309357739985, + 0.25887786224484444, + 0.1238897293806076, + 0.1732068955898285, + 1.2855662871152163, + 0.6504368968307972, + 0.0, + 0.372665211558342, + 0.1889500804245472, + 0.03965635970234871, + 0.15566976368427277, + 0.16823282558470964, + 0.24222819227725267, + 2.0139798037707806, + 0.32003530487418175, + 0.13275054842233658, + 0.0754607506096363, + 0.2115691415965557, + 0.1878522913902998, + 2.039191998541355, + 0.486691378057003, + 0.6625599414110184, + 0.31601137667894363, + 0.17298150435090065, + 0.03462979942560196, + 0.586212020367384, + 0.157626673579216, + 0.1751549281179905 + ], + "unique_experts": 60, + "load_cv": 0.759202798262025, + "normalized_load_entropy": 0.929223632666935, + "max_load_share": 0.0546875 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "ordered_topk_exact_tokens": 19, + "set_exact_tokens": 21, + "mean_set_jaccard": 0.9658385093167702, + "mean_token_weighted_tv": 0.011203310482770852, + "aggregate_load_tv": 0.021739130434782608 + }, + "system_bos": { + "tokens": 23, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.9037267080745343, + "mean_token_weighted_tv": 0.022143803536891937, + "aggregate_load_tv": 0.050724637681159424 + }, + "system_x": { + "tokens": 23, + "ordered_topk_exact_tokens": 7, + "set_exact_tokens": 11, + "mean_set_jaccard": 0.8509316770186336, + "mean_token_weighted_tv": 0.030932787542595812, + "aggregate_load_tv": 0.07246376811594202 + }, + "system_period": { + "tokens": 23, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8881987577639753, + "mean_token_weighted_tv": 0.02861423800577936, + "aggregate_load_tv": 0.057971014492753624 + }, + "bos_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.9161490683229815, + "mean_token_weighted_tv": 0.02086899942799431, + "aggregate_load_tv": 0.050724637681159424 + }, + "bos_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.9006211180124224, + "mean_token_weighted_tv": 0.022560839521010286, + "aggregate_load_tv": 0.050724637681159424 + }, + "x_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.9006211180124224, + "mean_token_weighted_tv": 0.025473020657006164, + "aggregate_load_tv": 0.043478260869565216 + }, + "x_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 12, + "mean_set_jaccard": 0.8633540372670808, + "mean_token_weighted_tv": 0.0326461935132418, + "aggregate_load_tv": 0.07246376811594202 + }, + "period_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.9130434782608695, + "mean_token_weighted_tv": 0.02349192040729458, + "aggregate_load_tv": 0.03623188405797101 + }, + "period_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 11, + "mean_set_jaccard": 0.8509316770186336, + "mean_token_weighted_tv": 0.0351031167311189, + "aggregate_load_tv": 0.06521739130434781 + } + } + }, + "layer_16": { + "layer": 16, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "4458301826bb13a6cd1e3febe7109046e7c6fb48d17771a0c34d95d55f688e42", + "route_weight_sha256": "fed683aaaed6b0a78678d1a34a3153576ffd3d8fa6f000246daea8d8a4ca4214", + "loads": [ + 0, + 3, + 3, + 4, + 3, + 0, + 3, + 1, + 4, + 2, + 0, + 0, + 3, + 6, + 1, + 2, + 2, + 3, + 0, + 5, + 0, + 1, + 0, + 2, + 2, + 3, + 0, + 0, + 0, + 8, + 5, + 2, + 1, + 9, + 0, + 0, + 4, + 1, + 2, + 0, + 7, + 1, + 1, + 0, + 0, + 1, + 0, + 1, + 0, + 3, + 0, + 5, + 0, + 0, + 2, + 0, + 4, + 0, + 0, + 0, + 6, + 15, + 0, + 7 + ], + "weighted_loads": [ + 0.0, + 0.1629912219941616, + 0.16353411227464676, + 0.2954328693449497, + 0.10744282230734825, + 0.0, + 0.09203970246016979, + 0.0492459200322628, + 0.29116951301693916, + 0.3159036412835121, + 0.0, + 0.0, + 0.15795692428946495, + 0.24014604836702347, + 0.06707434356212616, + 0.1434193179011345, + 0.12056884169578552, + 0.24504781514406204, + 0.0, + 0.2065516710281372, + 0.0, + 0.041090093553066254, + 0.0, + 0.10012908279895782, + 0.07277380302548409, + 0.22629784792661667, + 0.0, + 0.0, + 0.0, + 0.33085743710398674, + 0.20146437548100948, + 0.11902280896902084, + 0.02956181950867176, + 1.3419049549847841, + 0.0, + 0.0, + 0.24214209988713264, + 0.03947100788354874, + 0.10053590312600136, + 0.0, + 0.5004616994410753, + 0.03517023101449013, + 0.03552977368235588, + 0.0, + 0.0, + 0.031866274774074554, + 0.0, + 0.04841386154294014, + 0.0, + 0.5054375268518925, + 0.0, + 0.3615327514708042, + 0.0, + 0.0, + 0.12881683930754662, + 0.0, + 0.1874317228794098, + 0.0, + 0.0, + 0.0, + 0.22362811025232077, + 2.3021429404616356, + 0.0, + 0.8675266448408365 + ], + "unique_experts": 39, + "load_cv": 1.2890406156846603, + "normalized_load_entropy": 0.8196294090944448, + "max_load_share": 0.10869565217391304 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "b7a92c03f9bc007b2130080dedc8830a7704fb6eb49a97e37946c33d7871994c", + "route_weight_sha256": "92bec606efc15b12b761bd586dcf7e591c7e95822bb71462399f924d20a03a50", + "loads": [ + 0, + 3, + 3, + 4, + 3, + 9, + 8, + 1, + 4, + 6, + 5, + 1, + 3, + 7, + 1, + 10, + 11, + 7, + 5, + 6, + 10, + 3, + 2, + 2, + 9, + 3, + 5, + 0, + 0, + 8, + 7, + 2, + 2, + 16, + 0, + 0, + 4, + 10, + 2, + 0, + 10, + 9, + 1, + 0, + 3, + 2, + 0, + 1, + 0, + 4, + 1, + 7, + 0, + 11, + 2, + 10, + 4, + 0, + 0, + 0, + 9, + 18, + 0, + 14 + ], + "weighted_loads": [ + 0.0, + 0.1629912219941616, + 0.16353411227464676, + 0.2954328693449497, + 0.10744282230734825, + 0.8029461838304996, + 0.2968390639871359, + 0.0492459200322628, + 0.29116951301693916, + 1.7457502894103527, + 0.2311544455587864, + 0.025099975988268852, + 0.15795692428946495, + 0.2593513894826174, + 0.06707434356212616, + 1.0121147446334362, + 0.6598306410014629, + 0.48113002628088, + 0.5427812058478594, + 0.20902114221826196, + 0.913681885227561, + 0.12202819809317589, + 0.13612262904644012, + 0.10012908279895782, + 0.6624488271772861, + 0.22629784792661667, + 0.28406642749905586, + 0.0, + 0.0, + 0.33085743710398674, + 0.33276081643998623, + 0.11902280896902084, + 0.0700263362377882, + 1.6509663248434663, + 0.0, + 0.0, + 0.24214209988713264, + 0.5304889604449272, + 0.10053590312600136, + 0.0, + 0.6398330386728048, + 1.476773377507925, + 0.03552977368235588, + 0.0, + 0.11795005202293396, + 0.09896257519721985, + 0.0, + 0.04841386154294014, + 0.0, + 0.5227844007313251, + 0.028868479654192924, + 0.46557094156742096, + 0.0, + 0.7813945338129997, + 0.12881683930754662, + 0.7886503152549267, + 0.1874317228794098, + 0.0, + 0.0, + 0.0, + 0.42468592431396246, + 2.4962829696014524, + 0.0, + 1.2856816202402115 + ], + "unique_experts": 50, + "load_cv": 0.9598418079539441, + "normalized_load_entropy": 0.8822436107115652, + "max_load_share": 0.0625 + } + }, + "s1_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "6273c47fb61c2387b38d2e2ef6f3240fdf85436484e45445cd8ffe2cf6ddf6cb", + "route_weight_sha256": "fef04972cb265e4c74dd52eededa77dc8fe691eae1b1d2a33655d4395126a899", + "loads": [ + 0, + 3, + 3, + 4, + 2, + 0, + 3, + 1, + 4, + 2, + 0, + 0, + 3, + 5, + 1, + 2, + 2, + 3, + 0, + 6, + 0, + 1, + 0, + 2, + 2, + 3, + 0, + 1, + 0, + 8, + 5, + 2, + 1, + 7, + 1, + 0, + 4, + 1, + 2, + 0, + 8, + 1, + 1, + 0, + 0, + 1, + 0, + 1, + 1, + 3, + 0, + 5, + 0, + 0, + 2, + 0, + 4, + 0, + 0, + 0, + 6, + 15, + 0, + 6 + ], + "weighted_loads": [ + 0.0, + 0.16300281137228012, + 0.16578559577465057, + 0.2906370311975479, + 0.08090933039784431, + 0.0, + 0.0948146190494299, + 0.04945444315671921, + 0.284189410507679, + 0.31868939846754074, + 0.0, + 0.0, + 0.1596236750483513, + 0.20279423147439957, + 0.0702497735619545, + 0.13414661213755608, + 0.11907912604510784, + 0.24633556604385376, + 0.0, + 0.2396902870386839, + 0.0, + 0.04138991981744766, + 0.0, + 0.0982687883079052, + 0.07222329452633858, + 0.2265075519680977, + 0.0, + 0.031273216009140015, + 0.0, + 0.3368411771953106, + 0.202804297208786, + 0.11747438833117485, + 0.029397068545222282, + 1.2688989602029324, + 0.03676670789718628, + 0.0, + 0.23497562110424042, + 0.0373099148273468, + 0.1045692227780819, + 0.0, + 0.5187246911227703, + 0.033488865941762924, + 0.03260016813874245, + 0.0, + 0.0, + 0.03096260130405426, + 0.0, + 0.04590339586138725, + 0.03254101425409317, + 0.49725209549069405, + 0.0, + 0.34965553507208824, + 0.0, + 0.0, + 0.12868301942944527, + 0.0, + 0.1897227019071579, + 0.0, + 0.0, + 0.0, + 0.22430343739688396, + 2.3069348838180304, + 0.0, + 0.8372775390744209 + ], + "unique_experts": 42, + "load_cv": 1.2466295665523415, + "normalized_load_entropy": 0.8334288317577547, + "max_load_share": 0.10869565217391304 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "174515e2a4083f9b53cb24b64e7ef6dba738d4401948e93908e83c4571d43ac4", + "route_weight_sha256": "733e0e2329e6b572cb108c790d771f0dc8f596ef83938c550e3609593a38335c", + "loads": [ + 0, + 6, + 3, + 6, + 2, + 9, + 7, + 2, + 4, + 7, + 6, + 1, + 3, + 8, + 2, + 14, + 14, + 15, + 8, + 8, + 11, + 3, + 2, + 3, + 17, + 3, + 10, + 1, + 0, + 8, + 9, + 2, + 6, + 13, + 2, + 2, + 4, + 10, + 4, + 3, + 12, + 16, + 2, + 2, + 3, + 5, + 1, + 7, + 4, + 7, + 6, + 6, + 0, + 12, + 2, + 11, + 6, + 0, + 0, + 2, + 9, + 17, + 3, + 13 + ], + "weighted_loads": [ + 0.0, + 0.2848658226430416, + 0.16578559577465057, + 0.3816419690847397, + 0.08090933039784431, + 0.829493522644043, + 0.2979948315769434, + 0.07463862374424934, + 0.284189410507679, + 1.7595637626945972, + 0.20916790142655373, + 0.03198684751987457, + 0.1596236750483513, + 0.29176160879433155, + 0.11588173732161522, + 1.5259570889174938, + 0.653001822065562, + 1.0055944882333279, + 0.7938837539404631, + 0.2774636500980705, + 0.9177114646881819, + 0.1378806307911873, + 0.08523889258503914, + 0.17458800598978996, + 1.2480459231883287, + 0.2265075519680977, + 1.1583326943218708, + 0.031273216009140015, + 0.0, + 0.3368411771953106, + 0.3971911817789078, + 0.11747438833117485, + 0.24702089093625546, + 1.501133230049163, + 0.0719415508210659, + 0.12775136530399323, + 0.23497562110424042, + 0.5135124120861292, + 0.2310393899679184, + 0.17863808572292328, + 0.6776775922626257, + 2.5072729885578156, + 0.06917691603302956, + 0.09281762316823006, + 0.09496956132352352, + 0.22429485246539116, + 0.03151534125208855, + 0.3409749008715153, + 0.1556719858199358, + 0.6761699058115482, + 0.2622460052371025, + 0.39182956144213676, + 0.0, + 1.0931896530091763, + 0.12868301942944527, + 0.9809082075953484, + 0.2971760295331478, + 0.0, + 0.0, + 0.21580725349485874, + 0.37538094259798527, + 2.4389190258225426, + 0.32862983271479607, + 1.2498903358355165 + ], + "unique_experts": 59, + "load_cv": 0.7711148134717395, + "normalized_load_entropy": 0.925015146852144, + "max_load_share": 0.044270833333333336 + } + }, + "s0_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "6a134d5fc9c9f9f0c99ed2704bea5abf74d9686fdd51666b99da35cd6c474177", + "route_weight_sha256": "31c0019a73b2f67c93a1eed58a24026aab2359b66859a9af9ae65105fe2a55ac", + "loads": [ + 0, + 3, + 3, + 4, + 2, + 0, + 3, + 1, + 4, + 2, + 0, + 0, + 3, + 4, + 2, + 2, + 2, + 3, + 0, + 5, + 0, + 1, + 0, + 2, + 1, + 4, + 0, + 0, + 0, + 7, + 5, + 2, + 1, + 10, + 0, + 0, + 4, + 1, + 2, + 0, + 7, + 2, + 1, + 0, + 0, + 1, + 0, + 1, + 1, + 3, + 0, + 5, + 0, + 0, + 2, + 0, + 4, + 0, + 1, + 0, + 6, + 15, + 0, + 6 + ], + "weighted_loads": [ + 0.0, + 0.1620546318590641, + 0.16506997495889664, + 0.2823422886431217, + 0.08522026613354683, + 0.0, + 0.10048223100602627, + 0.0484142042696476, + 0.28989651799201965, + 0.32169387489557266, + 0.0, + 0.0, + 0.15504108369350433, + 0.17483998835086823, + 0.1058167889714241, + 0.13823026418685913, + 0.12063125241547823, + 0.260323241353035, + 0.0, + 0.21666947193443775, + 0.0, + 0.043659698218107224, + 0.0, + 0.09115498140454292, + 0.03723766654729843, + 0.2621310390532017, + 0.0, + 0.0, + 0.0, + 0.29799505323171616, + 0.19642571359872818, + 0.12023656815290451, + 0.027957862243056297, + 1.401262380182743, + 0.0, + 0.0, + 0.2619800679385662, + 0.040882330387830734, + 0.09946919605135918, + 0.0, + 0.5003070719540119, + 0.06701371259987354, + 0.039014458656311035, + 0.0, + 0.0, + 0.028476357460021973, + 0.0, + 0.044884175062179565, + 0.029225684702396393, + 0.5189176052808762, + 0.0, + 0.3786441199481487, + 0.0, + 0.0, + 0.13873367756605148, + 0.0, + 0.18508096411824226, + 0.0, + 0.032512035220861435, + 0.0, + 0.2134279329329729, + 2.289126293733716, + 0.0, + 0.8152651600539684 + ], + "unique_experts": 41, + "load_cv": 1.2600363730526467, + "normalized_load_entropy": 0.8302813644911045, + "max_load_share": 0.10869565217391304 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "acbf6f6509fd6b18cc265e4f168c2db3357fac2784f9a2613bb54634d2193384", + "route_weight_sha256": "7934409aa5514bd91836eedab0393be83d2f077486abf7b76f14b7926d5683d3", + "loads": [ + 0, + 3, + 4, + 4, + 2, + 10, + 8, + 1, + 4, + 6, + 4, + 1, + 4, + 5, + 2, + 10, + 10, + 7, + 6, + 6, + 10, + 3, + 2, + 2, + 7, + 4, + 3, + 0, + 0, + 7, + 6, + 2, + 2, + 17, + 1, + 0, + 4, + 10, + 2, + 0, + 10, + 11, + 1, + 0, + 4, + 2, + 0, + 1, + 1, + 5, + 2, + 7, + 0, + 11, + 2, + 10, + 4, + 0, + 1, + 0, + 8, + 18, + 0, + 11 + ], + "weighted_loads": [ + 0.0, + 0.1620546318590641, + 0.2083093263208866, + 0.2823422886431217, + 0.08522026613354683, + 0.8456817492842674, + 0.30528159253299236, + 0.0484142042696476, + 0.28989651799201965, + 0.8142342530190945, + 0.20444065146148205, + 0.04107673093676567, + 0.23325013369321823, + 0.19404532946646214, + 0.1058167889714241, + 0.9023000970482826, + 1.0578952925279737, + 0.4896626006811857, + 0.5055591370910406, + 0.24995497800409794, + 0.913681885227561, + 0.12459780275821686, + 0.13612262904644012, + 0.09115498140454292, + 0.580037321895361, + 0.2621310390532017, + 0.1692885011434555, + 0.0, + 0.0, + 0.29799505323171616, + 0.2723211422562599, + 0.12023656815290451, + 0.06842237897217274, + 1.769229294732213, + 0.10821296274662018, + 0.0, + 0.2619800679385662, + 0.5319002829492092, + 0.09946919605135918, + 0.0, + 0.6426447220146656, + 1.5592817831784487, + 0.039014458656311035, + 0.0, + 0.14823210425674915, + 0.09557265788316727, + 0.0, + 0.044884175062179565, + 0.029225684702396393, + 0.5816120803356171, + 0.07279394380748272, + 0.4826823100447655, + 0.0, + 0.7813945338129997, + 0.13873367756605148, + 0.7886503152549267, + 0.18508096411824226, + 0.0, + 0.032512035220861435, + 0.0, + 0.34516346640884876, + 2.4920775834470987, + 0.0, + 1.2044127900153399 + ], + "unique_experts": 53, + "load_cv": 0.9279607271383371, + "normalized_load_entropy": 0.8932683395490381, + "max_load_share": 0.0625 + } + }, + "s1_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "cfa1eb1aae20f3412561306709b19d85805250600c22c3de376887fff6d71c71", + "route_weight_sha256": "cdfc6e756918008b6e2f2a4c90eb60153e1434b424c791499be9da6d624c9449", + "loads": [ + 0, + 3, + 3, + 4, + 3, + 0, + 2, + 1, + 4, + 2, + 0, + 0, + 3, + 5, + 2, + 2, + 2, + 3, + 0, + 5, + 0, + 1, + 0, + 2, + 2, + 3, + 0, + 1, + 0, + 7, + 5, + 2, + 1, + 9, + 0, + 0, + 4, + 2, + 2, + 0, + 6, + 2, + 1, + 0, + 0, + 1, + 0, + 1, + 0, + 3, + 0, + 5, + 0, + 0, + 2, + 0, + 4, + 0, + 1, + 0, + 6, + 15, + 0, + 6 + ], + "weighted_loads": [ + 0.0, + 0.16369547322392464, + 0.1634741723537445, + 0.29172634705901146, + 0.11281454004347324, + 0.0, + 0.0781962238252163, + 0.0495268739759922, + 0.2866000272333622, + 0.3323289304971695, + 0.0, + 0.0, + 0.15298600867390633, + 0.19797298684716225, + 0.10707981511950493, + 0.12594618275761604, + 0.11315469816327095, + 0.24896756187081337, + 0.0, + 0.21786584332585335, + 0.0, + 0.038717735558748245, + 0.0, + 0.09557810798287392, + 0.07889002561569214, + 0.2297934629023075, + 0.0, + 0.03304065763950348, + 0.0, + 0.3127631973475218, + 0.20332852192223072, + 0.11360901966691017, + 0.02989945001900196, + 1.3871709555387497, + 0.0, + 0.0, + 0.24474917724728584, + 0.0561237558722496, + 0.10377167537808418, + 0.0, + 0.4996381998062134, + 0.06647232174873352, + 0.03603733703494072, + 0.0, + 0.0, + 0.027392642572522163, + 0.0, + 0.043340906500816345, + 0.0, + 0.5086920745670795, + 0.0, + 0.3570296876132488, + 0.0, + 0.0, + 0.12885026633739471, + 0.0, + 0.19125087186694145, + 0.0, + 0.03377867117524147, + 0.0, + 0.2197741251438856, + 2.221392970532179, + 0.0, + 0.810545789077878 + ], + "unique_experts": 41, + "load_cv": 1.2276140830505375, + "normalized_load_entropy": 0.8356764579806802, + "max_load_share": 0.10869565217391304 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "73fa514d247e3ae2b0f090e86b85d9c5df1bd915df4dd0756c8af98324d73167", + "route_weight_sha256": "b8297dc3962f497e3748c068c02fe3fbd86854a316194d08eaf588bb0378a26e", + "loads": [ + 0, + 6, + 3, + 6, + 3, + 9, + 6, + 2, + 4, + 7, + 5, + 1, + 3, + 9, + 3, + 14, + 14, + 14, + 9, + 5, + 11, + 3, + 2, + 3, + 15, + 3, + 10, + 1, + 0, + 7, + 8, + 2, + 6, + 17, + 2, + 2, + 4, + 12, + 4, + 3, + 10, + 18, + 2, + 2, + 5, + 5, + 1, + 7, + 3, + 7, + 6, + 6, + 0, + 12, + 2, + 11, + 6, + 0, + 1, + 1, + 10, + 16, + 3, + 12 + ], + "weighted_loads": [ + 0.0, + 0.2855584844946861, + 0.1634741723537445, + 0.38273128494620323, + 0.11281454004347324, + 0.8439271040260792, + 0.2813764363527298, + 0.07471105456352234, + 0.2866000272333622, + 0.8660140335559845, + 0.1822780929505825, + 0.03198684751987457, + 0.15298600867390633, + 0.32399880327284336, + 0.15271177887916565, + 1.4269627146422863, + 1.0820788405835629, + 0.9495598487555981, + 0.8033876568078995, + 0.21786584332585335, + 0.9177114646881819, + 0.13520844653248787, + 0.08523889258503914, + 0.17189732566475868, + 1.141926795244217, + 0.2297934629023075, + 1.1499561667442322, + 0.03304065763950348, + 0.0, + 0.3127631973475218, + 0.34312460757791996, + 0.11360901966691017, + 0.24752327241003513, + 1.7423986066132784, + 0.07641565799713135, + 0.12775136530399323, + 0.24474917724728584, + 0.5721055697649717, + 0.23024184256792068, + 0.17863808572292328, + 0.6570663917809725, + 2.6242463141679764, + 0.07261408492922783, + 0.09281762316823006, + 0.17594038508832455, + 0.22072489373385906, + 0.03151534125208855, + 0.33841241151094437, + 0.12313097156584263, + 0.6876098848879337, + 0.2703014127910137, + 0.39920371398329735, + 0.0, + 1.0931896530091763, + 0.12885026633739471, + 0.9809082075953484, + 0.29870419949293137, + 0.0, + 0.03377867117524147, + 0.19234897196292877, + 0.43000875413417816, + 2.319614853709936, + 0.32862983271479607, + 1.2169276773929596 + ], + "unique_experts": 60, + "load_cv": 0.7744845956433793, + "normalized_load_entropy": 0.9262126966147269, + "max_load_share": 0.046875 + } + }, + "s0_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "32ccffd25e2b1fb33f5772137e3c4d883aae25e288278553aecd92b5afc3ee49", + "route_weight_sha256": "b495ac61a1e9fde420284e139ca20cd9b2ad6bed85d61e6430a0f168393a3d79", + "loads": [ + 0, + 4, + 3, + 4, + 2, + 0, + 3, + 1, + 4, + 2, + 0, + 0, + 3, + 3, + 1, + 2, + 2, + 3, + 0, + 6, + 1, + 1, + 0, + 2, + 1, + 4, + 0, + 0, + 0, + 5, + 6, + 2, + 1, + 9, + 0, + 0, + 5, + 1, + 2, + 0, + 6, + 2, + 1, + 0, + 0, + 0, + 0, + 1, + 1, + 3, + 0, + 5, + 0, + 0, + 2, + 0, + 4, + 0, + 0, + 0, + 6, + 16, + 1, + 7 + ], + "weighted_loads": [ + 0.0, + 0.21017050743103027, + 0.16518275067210197, + 0.3105161525309086, + 0.08571828901767731, + 0.0, + 0.09339712373912334, + 0.05063445121049881, + 0.28392431512475014, + 0.31233733892440796, + 0.0, + 0.0, + 0.13617223873734474, + 0.13433100283145905, + 0.07094678282737732, + 0.14664164558053017, + 0.11996603105217218, + 0.2454952858388424, + 0.0, + 0.22217394784092903, + 0.03853261098265648, + 0.04322204738855362, + 0.0, + 0.1029750406742096, + 0.046169742941856384, + 0.25082895159721375, + 0.0, + 0.0, + 0.0, + 0.2361265793442726, + 0.23828655295073986, + 0.1171402782201767, + 0.029754942283034325, + 1.3035966362804174, + 0.0, + 0.0, + 0.29335703887045383, + 0.03752689063549042, + 0.10050416365265846, + 0.0, + 0.4882910493761301, + 0.07214220985770226, + 0.03948856145143509, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0435461588203907, + 0.030077239498496056, + 0.5156863145530224, + 0.0, + 0.35961679369211197, + 0.0, + 0.0, + 0.13336285576224327, + 0.0, + 0.1982337236404419, + 0.0, + 0.0, + 0.0, + 0.2228935081511736, + 2.246705736964941, + 0.03158409520983696, + 0.8936007097363472 + ], + "unique_experts": 41, + "load_cv": 1.281195487721048, + "normalized_load_entropy": 0.8277756269497637, + "max_load_share": 0.11594202898550725 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "32cf1f49ac7081bd9785b8b7efcd9d78056eb0b70fd117d9640049bcf7bc5b7d", + "route_weight_sha256": "1877c4a23eeaa18e0aed6269cd878d3df2bdc748f691c970116abab9fd4c6d96", + "loads": [ + 0, + 4, + 3, + 4, + 2, + 11, + 8, + 1, + 4, + 4, + 4, + 0, + 3, + 4, + 1, + 10, + 9, + 8, + 6, + 6, + 12, + 4, + 2, + 2, + 9, + 4, + 4, + 0, + 0, + 5, + 8, + 2, + 4, + 14, + 0, + 0, + 5, + 11, + 2, + 0, + 9, + 10, + 2, + 0, + 2, + 1, + 0, + 1, + 1, + 4, + 1, + 7, + 0, + 12, + 2, + 11, + 4, + 0, + 0, + 0, + 9, + 18, + 1, + 13 + ], + "weighted_loads": [ + 0.0, + 0.21017050743103027, + 0.16518275067210197, + 0.3105161525309086, + 0.08571828901767731, + 0.8809235133230686, + 0.29819648526608944, + 0.05063445121049881, + 0.28392431512475014, + 0.7213377319276333, + 0.20444065146148205, + 0.0, + 0.13617223873734474, + 0.15353634394705296, + 0.07094678282737732, + 1.050641868263483, + 0.48594089690595865, + 0.5211168304085732, + 0.5915531981736422, + 0.22217394784092903, + 1.1950955111533403, + 0.1579221487045288, + 0.13612262904644012, + 0.1029750406742096, + 0.7589638885110617, + 0.25082895159721375, + 0.22025316953659058, + 0.0, + 0.0, + 0.2361265793442726, + 0.3588018622249365, + 0.1171402782201767, + 0.1673438847064972, + 1.565153755247593, + 0.0, + 0.0, + 0.29335703887045383, + 0.5631146617233753, + 0.10050416365265846, + 0.0, + 0.6601713467389345, + 1.4507614336907864, + 0.0674670934677124, + 0.0, + 0.08267949894070625, + 0.0670963004231453, + 0.0, + 0.0435461588203907, + 0.030077239498496056, + 0.5330331884324551, + 0.0344940721988678, + 0.4636549837887287, + 0.0, + 0.9141235128045082, + 0.13336285576224327, + 0.9006932191550732, + 0.1982337236404419, + 0.0, + 0.0, + 0.0, + 0.426720941439271, + 2.407256815582514, + 0.03158409520983696, + 1.3457045014947653 + ], + "unique_experts": 51, + "load_cv": 0.9541980020732037, + "normalized_load_entropy": 0.8844414174459011, + "max_load_share": 0.0625 + } + }, + "s1_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "86a669d69ea06b791a023e3bb11024c73e16d99df640c125b28c7b19f0fecdee", + "route_weight_sha256": "2cf6280639fe3a7260ec3f95196f1cb6649a3122d4aef4a9795d5ac81865f231", + "loads": [ + 0, + 3, + 3, + 4, + 3, + 0, + 2, + 1, + 4, + 2, + 0, + 0, + 3, + 3, + 1, + 2, + 2, + 3, + 0, + 5, + 2, + 2, + 0, + 2, + 3, + 3, + 0, + 0, + 0, + 6, + 5, + 2, + 1, + 9, + 0, + 0, + 4, + 1, + 2, + 0, + 7, + 1, + 1, + 0, + 0, + 1, + 0, + 2, + 1, + 3, + 0, + 6, + 0, + 0, + 2, + 0, + 4, + 0, + 0, + 0, + 4, + 15, + 1, + 7 + ], + "weighted_loads": [ + 0.0, + 0.1842038668692112, + 0.15900856256484985, + 0.3041085749864578, + 0.11522361263632774, + 0.0, + 0.07488203421235085, + 0.05161320045590401, + 0.2887240946292877, + 0.30377764254808426, + 0.0, + 0.0, + 0.1407916322350502, + 0.12856352515518665, + 0.07734686136245728, + 0.12398571148514748, + 0.11836690548807383, + 0.2319183088839054, + 0.0, + 0.21740351431071758, + 0.09293770790100098, + 0.059136081486940384, + 0.0, + 0.09870246052742004, + 0.11399812810122967, + 0.23227964341640472, + 0.0, + 0.0, + 0.0, + 0.2927769795060158, + 0.19668421894311905, + 0.11078790575265884, + 0.030332127586007118, + 1.2681091856211424, + 0.0, + 0.0, + 0.24906916171312332, + 0.031472098082304, + 0.10553472116589546, + 0.0, + 0.483633229508996, + 0.04247986525297165, + 0.035077355802059174, + 0.0, + 0.0, + 0.03263084217905998, + 0.0, + 0.06754493527114391, + 0.03365674614906311, + 0.5147272944450378, + 0.0, + 0.3681499268859625, + 0.0, + 0.0, + 0.12056002020835876, + 0.0, + 0.2022889070212841, + 0.0, + 0.0, + 0.0, + 0.1771637387573719, + 2.179606258869171, + 0.03620542585849762, + 0.8709503691643476 + ], + "unique_experts": 42, + "load_cv": 1.2193738170782975, + "normalized_load_entropy": 0.8399853909450166, + "max_load_share": 0.10869565217391304 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "f30c7b9c2218a74412d62312d2006f10abe458d46c0cd03b19b48657b763e932", + "route_weight_sha256": "45e7edbb7439d16ca46429be495a099d73e0dc4855ee810820f7e85b5d8db6a7", + "loads": [ + 0, + 6, + 3, + 6, + 3, + 10, + 7, + 2, + 4, + 4, + 5, + 1, + 3, + 6, + 2, + 14, + 10, + 15, + 9, + 5, + 16, + 5, + 3, + 3, + 18, + 3, + 10, + 0, + 0, + 8, + 8, + 2, + 7, + 14, + 1, + 2, + 4, + 10, + 5, + 3, + 11, + 16, + 2, + 2, + 2, + 5, + 1, + 8, + 5, + 7, + 6, + 7, + 0, + 13, + 2, + 12, + 6, + 1, + 0, + 2, + 7, + 16, + 4, + 12 + ], + "weighted_loads": [ + 0.0, + 0.3060668781399727, + 0.15900856256484985, + 0.3951135128736496, + 0.11522361263632774, + 0.8868453241884708, + 0.3050774745643139, + 0.07679738104343414, + 0.2887240946292877, + 0.7185837179422379, + 0.1822780929505825, + 0.03198684751987457, + 0.1407916322350502, + 0.21753090247511864, + 0.122978825122118, + 1.4539835304021835, + 0.41688471753150225, + 0.9941053483635187, + 0.8006271291524172, + 0.21740351431071758, + 1.3888016305863857, + 0.19172491878271103, + 0.11777594685554504, + 0.1750216782093048, + 1.4623354095965624, + 0.23227964341640472, + 1.1267745718359947, + 0.0, + 0.0, + 0.34306545928120613, + 0.3364803045988083, + 0.11078790575265884, + 0.3142473194748163, + 1.4828158225864172, + 0.03517484292387962, + 0.12775136530399323, + 0.24906916171312332, + 0.5076745953410864, + 0.25919790379703045, + 0.17863808572292328, + 0.6711577698588371, + 2.3153476268053055, + 0.07165410369634628, + 0.09281762316823006, + 0.06883650831878185, + 0.22596309334039688, + 0.03151534125208855, + 0.36261644028127193, + 0.18843122385442257, + 0.693645104765892, + 0.25742224231362343, + 0.410323953256011, + 0.0, + 1.1924019791185856, + 0.12056002020835876, + 1.1149587109684944, + 0.309742234647274, + 0.05689127370715141, + 0.0, + 0.211210198700428, + 0.31068235635757446, + 2.2737861424684525, + 0.3648352585732937, + 1.2284076027572155 + ], + "unique_experts": 59, + "load_cv": 0.7789549623266633, + "normalized_load_entropy": 0.9244810277244698, + "max_load_share": 0.046875 + } + }, + "s0_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "6a625094397f106b194da3811d77d2417a794157c2a9129238ffa96fb512edf8", + "route_weight_sha256": "e0119a5d1ce0fdc1fd405ad32bcb53d3b1071a46f8e7de80654a82afdd978609", + "loads": [ + 0, + 3, + 3, + 4, + 2, + 0, + 3, + 1, + 4, + 2, + 0, + 0, + 3, + 3, + 1, + 2, + 2, + 3, + 0, + 5, + 0, + 1, + 0, + 2, + 1, + 3, + 0, + 1, + 0, + 6, + 5, + 2, + 1, + 10, + 0, + 0, + 4, + 1, + 2, + 0, + 7, + 2, + 1, + 0, + 0, + 1, + 0, + 1, + 1, + 3, + 0, + 5, + 0, + 0, + 2, + 0, + 4, + 0, + 1, + 0, + 6, + 16, + 1, + 7 + ], + "weighted_loads": [ + 0.0, + 0.17021848261356354, + 0.15741798654198647, + 0.32264135405421257, + 0.08756836131215096, + 0.0, + 0.09513914212584496, + 0.05304943770170212, + 0.2857252396643162, + 0.30799152702093124, + 0.0, + 0.0, + 0.14924557134509087, + 0.13508035987615585, + 0.07125641405582428, + 0.1578099988400936, + 0.12829065322875977, + 0.2538043223321438, + 0.0, + 0.1972027588635683, + 0.0, + 0.04012422636151314, + 0.0, + 0.10034274682402611, + 0.04486380144953728, + 0.22844590619206429, + 0.0, + 0.03870471566915512, + 0.0, + 0.2775709368288517, + 0.20180130191147327, + 0.11968978121876717, + 0.030480803921818733, + 1.3251992128789425, + 0.0, + 0.0, + 0.25842275097966194, + 0.036681439727544785, + 0.09969670325517654, + 0.0, + 0.49587044306099415, + 0.07394063845276833, + 0.038905542343854904, + 0.0, + 0.0, + 0.02881273627281189, + 0.0, + 0.04020044952630997, + 0.03035181760787964, + 0.513301957398653, + 0.0, + 0.36559390276670456, + 0.0, + 0.0, + 0.1334252431988716, + 0.0, + 0.20077017322182655, + 0.0, + 0.03050927072763443, + 0.0, + 0.2161303237080574, + 2.2215697495266795, + 0.03059767372906208, + 0.9131064303219318 + ], + "unique_experts": 43, + "load_cv": 1.281195487721048, + "normalized_load_entropy": 0.8340175769667094, + "max_load_share": 0.11594202898550725 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "b70c6a6cf7277d2784aafd1acff13b8241bad1823244bb6964bcb86e9c5f2aad", + "route_weight_sha256": "2b4cbb77ada01e4d2ef506bedfb262e788137147ef37743ff2b29487cf2162c7", + "loads": [ + 0, + 3, + 3, + 4, + 2, + 13, + 8, + 1, + 4, + 4, + 5, + 1, + 3, + 4, + 1, + 10, + 10, + 8, + 5, + 5, + 11, + 3, + 3, + 2, + 9, + 3, + 4, + 1, + 0, + 6, + 7, + 2, + 2, + 15, + 0, + 0, + 4, + 10, + 2, + 0, + 10, + 10, + 1, + 0, + 2, + 2, + 0, + 2, + 1, + 4, + 1, + 7, + 0, + 11, + 3, + 11, + 4, + 0, + 1, + 0, + 9, + 18, + 1, + 12 + ], + "weighted_loads": [ + 0.0, + 0.17021848261356354, + 0.15741798654198647, + 0.32264135405421257, + 0.08756836131215096, + 0.9620593953877687, + 0.29993850365281105, + 0.05304943770170212, + 0.2857252396643162, + 0.7153718490153551, + 0.25292797572910786, + 0.02772892452776432, + 0.14924557134509087, + 0.15428570099174976, + 0.07125641405582428, + 1.0469520911574364, + 0.5959985293447971, + 0.6584097146987915, + 0.5170771796256304, + 0.1972027588635683, + 0.9838002156466246, + 0.12106233090162277, + 0.17925916984677315, + 0.10034274682402611, + 0.7767779994755983, + 0.22844590619206429, + 0.2568592503666878, + 0.03870471566915512, + 0.0, + 0.2775709368288517, + 0.331899156793952, + 0.11968978121876717, + 0.07094532065093517, + 1.5790339577943087, + 0.0, + 0.0, + 0.25842275097966194, + 0.5276993922889233, + 0.09969670325517654, + 0.0, + 0.6738808024674654, + 1.4983351565897465, + 0.038905542343854904, + 0.0, + 0.07746167667210102, + 0.09590903669595718, + 0.0, + 0.0794685073196888, + 0.03035181760787964, + 0.5306488312780857, + 0.04223737120628357, + 0.4696320928633213, + 0.0, + 0.7813945338129997, + 0.17231884226202965, + 0.8506590314209461, + 0.20077017322182655, + 0.0, + 0.03050927072763443, + 0.0, + 0.4119836166501045, + 2.3727766377851367, + 0.03059767372906208, + 1.3317054901272058 + ], + "unique_experts": 54, + "load_cv": 0.9460770203292446, + "normalized_load_entropy": 0.8911510121955208, + "max_load_share": 0.0625 + } + }, + "s1_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "ce06638c193c15bdf615850ac6228e1657f08cc4b898de622058f59ceb778472", + "route_weight_sha256": "9ca5e4a30b2e8014307d23089521437b5f007e55ddf207719097cad2ab567cf4", + "loads": [ + 0, + 4, + 3, + 4, + 3, + 0, + 2, + 1, + 4, + 2, + 0, + 0, + 2, + 4, + 1, + 2, + 2, + 3, + 0, + 5, + 2, + 2, + 0, + 3, + 2, + 3, + 0, + 0, + 0, + 6, + 5, + 1, + 1, + 8, + 0, + 0, + 4, + 0, + 3, + 0, + 7, + 2, + 1, + 0, + 0, + 1, + 0, + 1, + 1, + 3, + 0, + 6, + 0, + 0, + 2, + 0, + 4, + 0, + 1, + 0, + 4, + 15, + 1, + 7 + ], + "weighted_loads": [ + 0.0, + 0.21048318967223167, + 0.1595449522137642, + 0.2959790267050266, + 0.11030754446983337, + 0.0, + 0.0744154304265976, + 0.05378192663192749, + 0.2792012542486191, + 0.3176986500620842, + 0.0, + 0.0, + 0.08663012832403183, + 0.169298704713583, + 0.08158372342586517, + 0.12642841413617134, + 0.1288943998515606, + 0.23859713971614838, + 0.0, + 0.2139761671423912, + 0.10173177346587181, + 0.061946798115968704, + 0.0, + 0.134522195905447, + 0.08182547241449356, + 0.21902978420257568, + 0.0, + 0.0, + 0.0, + 0.2957303076982498, + 0.2013890314847231, + 0.07312387973070145, + 0.02864549309015274, + 1.1733426991850138, + 0.0, + 0.0, + 0.2463531643152237, + 0.0, + 0.1336919106543064, + 0.0, + 0.46102067455649376, + 0.0753251165151596, + 0.034914590418338776, + 0.0, + 0.0, + 0.03517482429742813, + 0.0, + 0.03767130523920059, + 0.03458187356591225, + 0.5164535567164421, + 0.0, + 0.37455059960484505, + 0.0, + 0.0, + 0.12818533182144165, + 0.0, + 0.20576165616512299, + 0.0, + 0.03130912780761719, + 0.0, + 0.17342766374349594, + 2.0975380577147007, + 0.03497985377907753, + 0.8734447676688433 + ], + "unique_experts": 42, + "load_cv": 1.2110774849893724, + "normalized_load_entropy": 0.8400326131881418, + "max_load_share": 0.10869565217391304 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "6893344d64d21528da9eee2cb752cd75803a0b4b592ddacb6bee72bc30843c3d", + "route_weight_sha256": "ed7dfa2ecac0bc472a4c6e0ce6f0ed5d86879c5586fc06ab1a9a826092a468c8", + "loads": [ + 0, + 7, + 3, + 6, + 3, + 11, + 6, + 2, + 4, + 4, + 6, + 1, + 2, + 7, + 2, + 14, + 9, + 15, + 8, + 5, + 14, + 4, + 2, + 4, + 18, + 3, + 10, + 0, + 0, + 7, + 10, + 1, + 8, + 13, + 1, + 2, + 4, + 9, + 7, + 3, + 11, + 18, + 2, + 2, + 2, + 5, + 1, + 7, + 5, + 7, + 6, + 7, + 0, + 13, + 3, + 12, + 6, + 0, + 1, + 2, + 7, + 16, + 4, + 12 + ], + "weighted_loads": [ + 0.0, + 0.33234620094299316, + 0.1595449522137642, + 0.3869839645922184, + 0.11030754446983337, + 0.9463363457471132, + 0.2775956429541111, + 0.07896610721945763, + 0.2792012542486191, + 0.7325047254562378, + 0.21715711802244186, + 0.03198684751987457, + 0.08663012832403183, + 0.258266082033515, + 0.1272156871855259, + 1.374092549085617, + 0.38669403642416, + 1.0746915377676487, + 0.8130255993455648, + 0.2139761671423912, + 1.069508509710431, + 0.15843750908970833, + 0.08523889258503914, + 0.21084141358733177, + 1.485723003745079, + 0.21902978420257568, + 1.1531072556972504, + 0.0, + 0.0, + 0.321960112079978, + 0.4338930416852236, + 0.07312387973070145, + 0.30565703473985195, + 1.3842339906841516, + 0.03517484292387962, + 0.12775136530399323, + 0.2463531643152237, + 0.4762024972587824, + 0.3324100896716118, + 0.17863808572292328, + 0.6381323803216219, + 2.2828085720539093, + 0.07149133831262589, + 0.09281762316823006, + 0.06883650831878185, + 0.22850707545876503, + 0.03151534125208855, + 0.3327428102493286, + 0.19620601646602154, + 0.6953713670372963, + 0.2508263476192951, + 0.41672462597489357, + 0.0, + 1.1549794897437096, + 0.16807370632886887, + 1.0275020860135555, + 0.3132149837911129, + 0.0, + 0.03130912780761719, + 0.2226344645023346, + 0.3390236012637615, + 2.2126226015388966, + 0.3636096864938736, + 1.239900216460228 + ], + "unique_experts": 59, + "load_cv": 0.7806247497997997, + "normalized_load_entropy": 0.9236456830119645, + "max_load_share": 0.046875 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 18, + "mean_set_jaccard": 0.9378881987577641, + "mean_token_weighted_tv": 0.01457449083175996, + "aggregate_load_tv": 0.03623188405797101 + }, + "system_bos": { + "tokens": 23, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.9130434782608695, + "mean_token_weighted_tv": 0.021815021907019873, + "aggregate_load_tv": 0.03623188405797102 + }, + "system_x": { + "tokens": 23, + "ordered_topk_exact_tokens": 8, + "set_exact_tokens": 11, + "mean_set_jaccard": 0.8509316770186336, + "mean_token_weighted_tv": 0.029081924818456173, + "aggregate_load_tv": 0.07246376811594202 + }, + "system_period": { + "tokens": 23, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8695652173913045, + "mean_token_weighted_tv": 0.03140948739145761, + "aggregate_load_tv": 0.07246376811594203 + }, + "bos_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.9130434782608695, + "mean_token_weighted_tv": 0.022056805698767952, + "aggregate_load_tv": 0.043478260869565216 + }, + "bos_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.9006211180124224, + "mean_token_weighted_tv": 0.020907570769929367, + "aggregate_load_tv": 0.050724637681159424 + }, + "x_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 12, + "mean_set_jaccard": 0.8540372670807453, + "mean_token_weighted_tv": 0.030867578056843384, + "aggregate_load_tv": 0.07246376811594205 + }, + "x_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 11, + "mean_set_jaccard": 0.8509316770186335, + "mean_token_weighted_tv": 0.03221888979896903, + "aggregate_load_tv": 0.07971014492753623 + }, + "period_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.9006211180124224, + "mean_token_weighted_tv": 0.02621203025236078, + "aggregate_load_tv": 0.050724637681159424 + }, + "period_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 12, + "mean_set_jaccard": 0.8354037267080746, + "mean_token_weighted_tv": 0.03907417258976594, + "aggregate_load_tv": 0.09420289855072463 + } + } + }, + "layer_17": { + "layer": 17, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "e5a02c6dde29d4e075310a3ec08a3919102c7ea0930d38fdcce4c65f1cac093b", + "route_weight_sha256": "925a92461a4c621fa9e84e2d3147bd101e372739d10ab516325f79bc6106f4da", + "loads": [ + 10, + 1, + 0, + 3, + 0, + 1, + 0, + 4, + 0, + 2, + 1, + 6, + 9, + 3, + 3, + 1, + 2, + 0, + 0, + 0, + 1, + 4, + 1, + 3, + 0, + 0, + 3, + 4, + 1, + 9, + 1, + 0, + 10, + 0, + 0, + 0, + 0, + 3, + 2, + 3, + 1, + 7, + 3, + 4, + 0, + 6, + 5, + 0, + 2, + 0, + 0, + 0, + 1, + 1, + 4, + 3, + 0, + 0, + 3, + 1, + 2, + 2, + 1, + 1 + ], + "weighted_loads": [ + 1.0818128734827042, + 0.03348425775766373, + 0.0, + 1.313636278733611, + 0.0, + 0.02779538929462433, + 0.0, + 0.27719978243112564, + 0.0, + 0.10307001695036888, + 0.04482456296682358, + 0.47500544786453247, + 0.5942054260522127, + 0.08050930872559547, + 0.08463805727660656, + 0.03523034229874611, + 0.2751859650015831, + 0.0, + 0.0, + 0.0, + 0.07684832811355591, + 0.33717789500951767, + 0.07378028333187103, + 0.07933864183723927, + 0.0, + 0.0, + 0.7877788320183754, + 0.21786629036068916, + 0.0489838607609272, + 0.9797977842390537, + 0.03736063465476036, + 0.0, + 1.0668194014579058, + 0.0, + 0.0, + 0.0, + 0.0, + 0.22882797569036484, + 0.09785497188568115, + 0.15604088827967644, + 0.03637852892279625, + 0.5170734524726868, + 0.2274622619152069, + 0.2303429041057825, + 0.0, + 0.26346322894096375, + 0.3996910806745291, + 0.0, + 0.08863365277647972, + 0.0, + 0.0, + 0.0, + 0.038251835852861404, + 0.04256633296608925, + 0.45039086043834686, + 0.19534381106495857, + 0.0, + 0.0, + 0.14802231267094612, + 0.03629736229777336, + 0.061668891459703445, + 0.13881806284189224, + 0.04190618544816971, + 0.02750454843044281 + ], + "unique_experts": 43, + "load_cv": 1.1858402848885006, + "normalized_load_entropy": 0.8401565376238527, + "max_load_share": 0.07246376811594203 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "65fcf8f4645519ae6e6f07fdd2d7431505eb55ee27228524939485f192447f49", + "route_weight_sha256": "7a07c3711a524e2e8df67a19e0cf4f856e39a2f4c1bc6b41844c8cc2735b8a50", + "loads": [ + 18, + 3, + 3, + 10, + 0, + 1, + 2, + 4, + 0, + 5, + 8, + 7, + 12, + 11, + 3, + 3, + 2, + 7, + 3, + 0, + 4, + 4, + 1, + 9, + 6, + 6, + 12, + 8, + 5, + 11, + 1, + 0, + 19, + 0, + 0, + 0, + 0, + 3, + 8, + 3, + 9, + 10, + 6, + 7, + 0, + 11, + 5, + 0, + 2, + 1, + 1, + 0, + 3, + 1, + 4, + 5, + 0, + 3, + 4, + 1, + 2, + 3, + 7, + 1 + ], + "weighted_loads": [ + 1.3867176119238138, + 0.11221088469028473, + 0.14443210512399673, + 1.9029402565211058, + 0.0, + 0.02779538929462433, + 0.09620825946331024, + 0.27719978243112564, + 0.0, + 0.19129693694412708, + 0.48133762925863266, + 0.49356014281511307, + 0.6929518952965736, + 0.6842351704835892, + 0.08463805727660656, + 0.1214277520775795, + 0.2751859650015831, + 0.6848468966782093, + 0.12157266214489937, + 0.0, + 0.3611758351325989, + 0.33717789500951767, + 0.07378028333187103, + 0.34966943599283695, + 0.507694449275732, + 0.34320880845189095, + 2.4790116511285305, + 0.39578862115740776, + 0.20417135208845139, + 1.0151043692603707, + 0.03736063465476036, + 0.0, + 1.435331404209137, + 0.0, + 0.0, + 0.0, + 0.0, + 0.22882797569036484, + 0.3610118068754673, + 0.15604088827967644, + 1.1231997944414616, + 0.6043043518438935, + 0.46267513930797577, + 0.2870872695930302, + 0.0, + 1.138039417564869, + 0.3996910806745291, + 0.0, + 0.08863365277647972, + 0.04053742066025734, + 0.06711398810148239, + 0.0, + 0.16706882417201996, + 0.04256633296608925, + 0.45039086043834686, + 0.3030488584190607, + 0.0, + 0.16334261000156403, + 0.17788519524037838, + 0.03629736229777336, + 0.061668891459703445, + 0.1887849047780037, + 0.6471393778920174, + 0.02750454843044281 + ], + "unique_experts": 52, + "load_cv": 0.9590375834240038, + "normalized_load_entropy": 0.8879333753055402, + "max_load_share": 0.06597222222222222 + } + }, + "s1_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "94d03686db874003b30910e404eead510d02b3d328c3783b8f722de159f50831", + "route_weight_sha256": "8c54fc0c72bf1bd843d5ec26f768471a0762fee2f2fac8ac95b9245a64f99b7d", + "loads": [ + 11, + 1, + 0, + 3, + 0, + 1, + 0, + 4, + 0, + 2, + 1, + 6, + 9, + 3, + 3, + 1, + 2, + 0, + 0, + 0, + 1, + 4, + 1, + 3, + 0, + 0, + 3, + 4, + 1, + 9, + 1, + 0, + 10, + 0, + 0, + 0, + 0, + 3, + 2, + 3, + 1, + 7, + 3, + 3, + 0, + 6, + 5, + 0, + 2, + 0, + 0, + 0, + 1, + 1, + 4, + 3, + 0, + 0, + 3, + 1, + 2, + 2, + 1, + 1 + ], + "weighted_loads": [ + 1.092153389006853, + 0.03380884975194931, + 0.0, + 1.302453612908721, + 0.0, + 0.03179128095507622, + 0.0, + 0.28617045655846596, + 0.0, + 0.09923175349831581, + 0.04725274071097374, + 0.4857376329600811, + 0.5901496354490519, + 0.08914889767765999, + 0.08852352574467659, + 0.03734993562102318, + 0.274344727396965, + 0.0, + 0.0, + 0.0, + 0.0763961598277092, + 0.32980447076261044, + 0.0667116641998291, + 0.07776517048478127, + 0.0, + 0.0, + 0.7999935857951641, + 0.2225538957864046, + 0.04845717176795006, + 0.9765030760318041, + 0.03786562755703926, + 0.0, + 1.096661927178502, + 0.0, + 0.0, + 0.0, + 0.0, + 0.22194932028651237, + 0.0939430333673954, + 0.1582372896373272, + 0.03660241514444351, + 0.5251766089349985, + 0.22109125554561615, + 0.19926518574357033, + 0.0, + 0.26542800292372704, + 0.37711415626108646, + 0.0, + 0.08409928157925606, + 0.0, + 0.0, + 0.0, + 0.037864502519369125, + 0.04547133669257164, + 0.447396706789732, + 0.18898658454418182, + 0.0, + 0.0, + 0.14981354773044586, + 0.03636475279927254, + 0.05706217885017395, + 0.12904884666204453, + 0.039404504001140594, + 0.028660660609602928 + ], + "unique_experts": 43, + "load_cv": 1.2055148777857978, + "normalized_load_entropy": 0.8382370275292873, + "max_load_share": 0.07971014492753623 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "5a5f95d63d75253626ff7d4ceec358532049d3f6a52d2ccdc18ccca1ebfcc302", + "route_weight_sha256": "78ce37d3280295279c7a1299276e9ff7cf7de94eaf419b99caec99c831ccee75", + "loads": [ + 19, + 2, + 2, + 10, + 6, + 1, + 3, + 5, + 0, + 7, + 9, + 8, + 9, + 11, + 3, + 9, + 3, + 6, + 3, + 0, + 2, + 5, + 1, + 11, + 10, + 22, + 16, + 7, + 2, + 11, + 3, + 1, + 16, + 0, + 0, + 0, + 5, + 5, + 8, + 4, + 14, + 13, + 8, + 4, + 2, + 11, + 7, + 2, + 2, + 1, + 1, + 6, + 5, + 1, + 5, + 10, + 7, + 11, + 4, + 3, + 3, + 7, + 11, + 1 + ], + "weighted_loads": [ + 1.442606007680297, + 0.07676642015576363, + 0.08536479622125626, + 1.975603660568595, + 0.39815616980195045, + 0.03179128095507622, + 0.12019393593072891, + 0.3410907872021198, + 0.0, + 0.2567343935370445, + 0.5803861226886511, + 0.5534744784235954, + 0.5901496354490519, + 0.6936255544424057, + 0.08852352574467659, + 0.3939743675291538, + 0.4124118983745575, + 0.5819249823689461, + 0.10982703790068626, + 0.0, + 0.14386022090911865, + 0.4066155534237623, + 0.0667116641998291, + 0.7020452953875065, + 0.6071843607351184, + 1.4120013248175383, + 2.634752405807376, + 0.3569584023207426, + 0.0997137762606144, + 1.0601937444880605, + 0.13324694707989693, + 0.03886930271983147, + 1.29920070245862, + 0.0, + 0.0, + 0.0, + 0.2609727755188942, + 0.29581217654049397, + 0.5349320992827415, + 0.19196325540542603, + 1.807505376636982, + 0.8635388584807515, + 0.4738844968378544, + 0.2181243598461151, + 0.24103425815701485, + 1.5538808219134808, + 0.5957680214196444, + 0.13138698786497116, + 0.08409928157925606, + 0.04238586127758026, + 0.13346314430236816, + 0.29486059956252575, + 0.2644365280866623, + 0.04547133669257164, + 0.5333877541124821, + 0.588165795430541, + 0.6186338327825069, + 0.5883237309753895, + 0.1742655672132969, + 0.12865979224443436, + 0.08927277475595474, + 0.4057130552828312, + 0.938421068713069, + 0.028660660609602928 + ], + "unique_experts": 59, + "load_cv": 0.814367511903836, + "normalized_load_entropy": 0.9188809415383887, + "max_load_share": 0.057291666666666664 + } + }, + "s0_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "ef05d825a81d3a55b90a569ca54d960c666cbb0cf774499e40998e7903a1eead", + "route_weight_sha256": "6b1e5ad00af2ae503fe0b0fe42c1bc5d49ba1960ab17aa8aa26eb9d4791b40c9", + "loads": [ + 11, + 2, + 0, + 2, + 1, + 1, + 0, + 4, + 0, + 2, + 1, + 6, + 10, + 3, + 3, + 1, + 2, + 0, + 0, + 0, + 1, + 4, + 1, + 3, + 0, + 1, + 3, + 4, + 2, + 9, + 0, + 0, + 10, + 0, + 0, + 0, + 0, + 3, + 1, + 3, + 1, + 6, + 3, + 4, + 0, + 6, + 5, + 0, + 2, + 0, + 0, + 0, + 1, + 1, + 4, + 3, + 0, + 0, + 3, + 1, + 0, + 3, + 1, + 0 + ], + "weighted_loads": [ + 1.1020091269165277, + 0.06381616555154324, + 0.0, + 1.2990344166755676, + 0.03567802906036377, + 0.024720212444663048, + 0.0, + 0.28619077429175377, + 0.0, + 0.0960194580256939, + 0.04126228392124176, + 0.49314094707369804, + 0.6221816670149565, + 0.08287441171705723, + 0.09486604295670986, + 0.03955557942390442, + 0.2777926027774811, + 0.0, + 0.0, + 0.0, + 0.07162696868181229, + 0.3414443898946047, + 0.07462551444768906, + 0.0770405400544405, + 0.0, + 0.03196758031845093, + 0.7701426781713963, + 0.236100222915411, + 0.09055639803409576, + 1.0001703687012196, + 0.0, + 0.0, + 1.0958660375326872, + 0.0, + 0.0, + 0.0, + 0.0, + 0.22717346623539925, + 0.046288859099149704, + 0.1487267129123211, + 0.03832362964749336, + 0.4979073293507099, + 0.2293071448802948, + 0.22989244386553764, + 0.0, + 0.25915140844881535, + 0.37869058921933174, + 0.0, + 0.0958956778049469, + 0.0, + 0.0, + 0.0, + 0.039022576063871384, + 0.043591391295194626, + 0.45500029996037483, + 0.19678881764411926, + 0.0, + 0.0, + 0.14528032764792442, + 0.041699521243572235, + 0.0, + 0.1620008945465088, + 0.04039059951901436, + 0.0 + ], + "unique_experts": 42, + "load_cv": 1.222126745807789, + "normalized_load_entropy": 0.8336556760997546, + "max_load_share": 0.07971014492753623 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "3b61dbc75957a0a15d954aea3c3bb2d5abd9f24e488021a591cb21957f4a9a59", + "route_weight_sha256": "46d71bc2f3e3b31b43c516e9b07c6024102eec31439b0992a813d1e9c4039bdc", + "loads": [ + 18, + 4, + 1, + 9, + 2, + 1, + 2, + 4, + 0, + 5, + 8, + 7, + 14, + 11, + 3, + 2, + 2, + 7, + 3, + 1, + 4, + 5, + 1, + 9, + 6, + 7, + 11, + 7, + 6, + 10, + 0, + 0, + 18, + 0, + 0, + 0, + 0, + 3, + 7, + 3, + 9, + 8, + 5, + 6, + 0, + 11, + 5, + 0, + 2, + 3, + 1, + 0, + 3, + 2, + 5, + 6, + 0, + 3, + 4, + 2, + 0, + 4, + 8, + 0 + ], + "weighted_loads": [ + 1.4627004340291023, + 0.14816159196197987, + 0.05171235278248787, + 1.8883383944630623, + 0.07483713701367378, + 0.024720212444663048, + 0.09620825946331024, + 0.28619077429175377, + 0.0, + 0.1842463780194521, + 0.4764944203197956, + 0.5116956420242786, + 0.872073657810688, + 0.6866002734750509, + 0.09486604295670986, + 0.08681290969252586, + 0.2777926027774811, + 0.6848468966782093, + 0.2578115351498127, + 0.059632547199726105, + 0.37767911702394485, + 0.41843064315617085, + 0.07462551444768906, + 0.3473713342100382, + 0.506588201969862, + 0.36249490827322006, + 1.490131925791502, + 0.361129242926836, + 0.23594775795936584, + 1.0301410015672445, + 0.0, + 0.0, + 1.4559962581843138, + 0.0, + 0.0, + 0.0, + 0.0, + 0.22717346623539925, + 0.3249718062579632, + 0.1487267129123211, + 1.0531987473368645, + 0.5686926022171974, + 0.420580118894577, + 0.2834167815744877, + 0.0, + 1.0580961871892214, + 0.37869058921933174, + 0.0, + 0.0958956778049469, + 0.252546489238739, + 0.06711398810148239, + 0.0, + 0.1703643910586834, + 0.09476319700479507, + 0.5293060652911663, + 0.342611713334918, + 0.0, + 0.16052477434277534, + 0.17514321021735668, + 0.08925525099039078, + 0.0, + 0.2057182379066944, + 0.5731150805950165, + 0.0 + ], + "unique_experts": 51, + "load_cv": 0.9362388636862621, + "normalized_load_entropy": 0.8905791058305309, + "max_load_share": 0.0625 + } + }, + "s1_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "6dec73fd27fe668bdb5e3935470d76b8cb67e5ff75b3b906926ccb24805ec097", + "route_weight_sha256": "61a6546a0917911179119328ff562a88e932fa59cabccec5f82ac6e7f0396461", + "loads": [ + 11, + 1, + 0, + 3, + 0, + 1, + 0, + 4, + 0, + 2, + 1, + 6, + 9, + 3, + 3, + 2, + 2, + 0, + 0, + 0, + 1, + 4, + 1, + 3, + 0, + 0, + 3, + 4, + 2, + 8, + 0, + 0, + 10, + 0, + 2, + 0, + 0, + 3, + 1, + 3, + 1, + 7, + 4, + 3, + 0, + 6, + 5, + 0, + 2, + 0, + 0, + 0, + 1, + 1, + 4, + 3, + 0, + 0, + 3, + 1, + 1, + 2, + 1, + 0 + ], + "weighted_loads": [ + 1.0944323129951954, + 0.03412943333387375, + 0.0, + 1.3174553997814655, + 0.0, + 0.027185959741473198, + 0.0, + 0.2908843755722046, + 0.0, + 0.09528102725744247, + 0.04533830285072327, + 0.4547920264303684, + 0.592463007196784, + 0.08381938189268112, + 0.094276063144207, + 0.07379942014813423, + 0.27781642600893974, + 0.0, + 0.0, + 0.0, + 0.0740504339337349, + 0.3233535662293434, + 0.06793051958084106, + 0.07742691971361637, + 0.0, + 0.0, + 0.7987900078296661, + 0.2347126267850399, + 0.09238187223672867, + 0.9621760658919811, + 0.0, + 0.0, + 1.0650327447801828, + 0.0, + 0.06624085828661919, + 0.0, + 0.0, + 0.2317052036523819, + 0.04203607887029648, + 0.15600896626710892, + 0.0364781953394413, + 0.5153126809746027, + 0.26249004155397415, + 0.1948573850095272, + 0.0, + 0.25911738350987434, + 0.3764467928558588, + 0.0, + 0.08967828750610352, + 0.0, + 0.0, + 0.0, + 0.04065592586994171, + 0.05016500875353813, + 0.450497280806303, + 0.19157267734408379, + 0.0, + 0.0, + 0.14655404910445213, + 0.037757061421871185, + 0.028489110991358757, + 0.13879219815135002, + 0.03986264392733574, + 0.0 + ], + "unique_experts": 42, + "load_cv": 1.194311940990441, + "normalized_load_entropy": 0.8373725498905726, + "max_load_share": 0.07971014492753623 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "d321b35092410dd4616c52249493a5cfe584b979555b00dddb2a12275e19d807", + "route_weight_sha256": "8039b8bf863c9306099153d58f2a67f06af09537e8fce9ce13fa9776d874b7f8", + "loads": [ + 18, + 5, + 1, + 10, + 7, + 1, + 3, + 5, + 0, + 8, + 8, + 8, + 11, + 11, + 3, + 8, + 3, + 6, + 3, + 0, + 2, + 5, + 1, + 11, + 9, + 20, + 15, + 7, + 4, + 9, + 2, + 1, + 15, + 0, + 2, + 0, + 5, + 5, + 7, + 4, + 15, + 12, + 10, + 4, + 2, + 12, + 7, + 2, + 2, + 2, + 2, + 6, + 5, + 1, + 5, + 10, + 7, + 10, + 4, + 3, + 2, + 6, + 12, + 0 + ], + "weighted_loads": [ + 1.4509337805211544, + 0.23319167643785477, + 0.04564720019698143, + 1.9906054474413395, + 0.4255127739161253, + 0.027185959741473198, + 0.12019393593072891, + 0.34580470621585846, + 0.0, + 0.31236862391233444, + 0.5314914640039206, + 0.5225288718938828, + 0.689203655347228, + 0.6882960386574268, + 0.094276063144207, + 0.35235488787293434, + 0.4158835969865322, + 0.5819249823689461, + 0.11575990915298462, + 0.0, + 0.16828707605600357, + 0.4001646488904953, + 0.06793051958084106, + 0.7017070446163416, + 0.6095632314682007, + 1.306769410148263, + 1.7404002789407969, + 0.36152469739317894, + 0.18120570853352547, + 1.0406670905649662, + 0.09538131952285767, + 0.03886930271983147, + 1.2592236697673798, + 0.0, + 0.06624085828661919, + 0.0, + 0.2609727755188942, + 0.3055680599063635, + 0.5128055028617382, + 0.18973493203520775, + 1.8071910813450813, + 0.8620514813810587, + 0.5510891601443291, + 0.213716559112072, + 0.24103425815701485, + 1.6416258439421654, + 0.5951006580144167, + 0.13138698786497116, + 0.08967828750610352, + 0.07870583608746529, + 0.18999474123120308, + 0.29486059956252575, + 0.2642597034573555, + 0.05016500875353813, + 0.5364883281290531, + 0.594096826389432, + 0.6186338327825069, + 0.5425558052957058, + 0.17100606858730316, + 0.130052100867033, + 0.06069970689713955, + 0.3649364970624447, + 0.944681653752923, + 0.0 + ], + "unique_experts": 59, + "load_cv": 0.7756046028744286, + "normalized_load_entropy": 0.9246241216022185, + "max_load_share": 0.052083333333333336 + } + }, + "s0_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "4439445668c01c9c42f8678542b0c45f89c0e93be3cbb97d5fdbdf0d5719e00c", + "route_weight_sha256": "2f6446b8d50d1281625e86fac0b14f0d25e535944d91261f60945571a23d4185", + "loads": [ + 11, + 1, + 0, + 2, + 0, + 1, + 0, + 4, + 0, + 2, + 1, + 6, + 8, + 3, + 3, + 2, + 2, + 0, + 0, + 0, + 1, + 4, + 1, + 3, + 0, + 0, + 3, + 5, + 2, + 8, + 0, + 0, + 10, + 0, + 1, + 0, + 0, + 3, + 1, + 3, + 1, + 7, + 3, + 3, + 0, + 6, + 5, + 0, + 2, + 0, + 0, + 0, + 1, + 1, + 4, + 3, + 0, + 0, + 3, + 1, + 2, + 4, + 1, + 0 + ], + "weighted_loads": [ + 1.1401886437088251, + 0.03526750206947327, + 0.0, + 1.3443447947502136, + 0.0, + 0.02571599744260311, + 0.0, + 0.3020014762878418, + 0.0, + 0.09780221804976463, + 0.04606878012418747, + 0.4740404635667801, + 0.5437337923794985, + 0.08122539892792702, + 0.10252591222524643, + 0.06840590015053749, + 0.24552342295646667, + 0.0, + 0.0, + 0.0, + 0.07777547836303711, + 0.3559303507208824, + 0.07023806124925613, + 0.07622923143208027, + 0.0, + 0.0, + 0.738875899463892, + 0.24854756146669388, + 0.09553991630673409, + 0.9846293330192566, + 0.0, + 0.0, + 1.1309579703956842, + 0.0, + 0.04085876792669296, + 0.0, + 0.0, + 0.21826796978712082, + 0.04276946559548378, + 0.1570049338042736, + 0.0366353765130043, + 0.5049297958612442, + 0.23778722621500492, + 0.20807112008333206, + 0.0, + 0.2557865660637617, + 0.36976663768291473, + 0.0, + 0.0880952700972557, + 0.0, + 0.0, + 0.0, + 0.041408173739910126, + 0.03519974276423454, + 0.4565320983529091, + 0.19454042240977287, + 0.0, + 0.0, + 0.1455287951976061, + 0.037784021347761154, + 0.06497258879244328, + 0.1882652249187231, + 0.03776294365525246, + 0.0 + ], + "unique_experts": 42, + "load_cv": 1.1830029180952184, + "normalized_load_entropy": 0.838483280009587, + "max_load_share": 0.07971014492753623 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "44dbfad64034757b8787240e3ed1b78e0c586fd88d633af97a1c970fe01d9fc3", + "route_weight_sha256": "6942cb10ddf7845826ab99fba96acd31da3df0cf184a76363d595159e141c121", + "loads": [ + 17, + 2, + 3, + 10, + 0, + 1, + 2, + 4, + 0, + 6, + 8, + 7, + 10, + 12, + 3, + 4, + 2, + 8, + 3, + 0, + 3, + 5, + 1, + 10, + 6, + 8, + 9, + 8, + 6, + 9, + 0, + 0, + 18, + 0, + 1, + 0, + 0, + 3, + 7, + 3, + 9, + 9, + 7, + 5, + 0, + 11, + 5, + 0, + 3, + 0, + 2, + 0, + 3, + 1, + 5, + 7, + 0, + 3, + 4, + 1, + 2, + 5, + 7, + 0 + ], + "weighted_loads": [ + 1.426820531487465, + 0.07114971429109573, + 0.13082556053996086, + 2.0830078050494194, + 0.0, + 0.02571599744260311, + 0.09620825946331024, + 0.3020014762878418, + 0.0, + 0.2321398053318262, + 0.5903487280011177, + 0.4925951585173607, + 0.6063891053199768, + 0.7226568087935448, + 0.10252591222524643, + 0.16145560517907143, + 0.24552342295646667, + 0.7280150912702084, + 0.31561728194355965, + 0.0, + 0.28094058483839035, + 0.396162286400795, + 0.07023806124925613, + 0.4054234270006418, + 0.4895518459379673, + 0.4258807096630335, + 1.3133172281086445, + 0.3735765814781189, + 0.25405656918883324, + 1.0145999658852816, + 0.0, + 0.0, + 1.5073113460093737, + 0.0, + 0.04085876792669296, + 0.0, + 0.0, + 0.21826796978712082, + 0.3199918195605278, + 0.1570049338042736, + 1.0458210706710815, + 0.5823986455798149, + 0.5178787801414728, + 0.2615954577922821, + 0.0, + 1.1321553979068995, + 0.36976663768291473, + 0.0, + 0.12794771417975426, + 0.0, + 0.1323164403438568, + 0.0, + 0.1858781948685646, + 0.03519974276423454, + 0.4978858530521393, + 0.3847644720226526, + 0.0, + 0.16612348705530167, + 0.17539167776703835, + 0.037784021347761154, + 0.06497258879244328, + 0.22271147556602955, + 0.47939490526914597, + 0.0 + ], + "unique_experts": 50, + "load_cv": 0.9187686338078459, + "normalized_load_entropy": 0.8899973982634884, + "max_load_share": 0.0625 + } + }, + "s1_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "6056fbeb252d75e7ee600366efa5132d8955e02140a0373094b6c41569a199c7", + "route_weight_sha256": "cf6a7fe1ffbfb3db5335a6cf74212d2e57fd1740c7104463bfd880ad49312e64", + "loads": [ + 9, + 1, + 0, + 3, + 0, + 1, + 0, + 4, + 0, + 2, + 1, + 6, + 10, + 3, + 3, + 3, + 2, + 0, + 0, + 0, + 1, + 4, + 1, + 2, + 0, + 0, + 3, + 5, + 2, + 8, + 0, + 0, + 10, + 0, + 1, + 0, + 0, + 3, + 0, + 3, + 2, + 8, + 4, + 3, + 0, + 6, + 5, + 0, + 2, + 0, + 0, + 1, + 1, + 0, + 4, + 3, + 0, + 0, + 3, + 1, + 1, + 2, + 1, + 0 + ], + "weighted_loads": [ + 1.0335760600864887, + 0.03643127903342247, + 0.0, + 1.2679282687604427, + 0.0, + 0.02848547138273716, + 0.0, + 0.3160289227962494, + 0.0, + 0.091236911714077, + 0.044896189123392105, + 0.4607941284775734, + 0.6210565399378538, + 0.08109229616820812, + 0.09975093230605125, + 0.09955966472625732, + 0.2394747994840145, + 0.0, + 0.0, + 0.0, + 0.08194062113761902, + 0.32489150017499924, + 0.05680406466126442, + 0.0577289704233408, + 0.0, + 0.0, + 0.7397903241217136, + 0.27775654569268227, + 0.09566866979002953, + 0.9802255742251873, + 0.0, + 0.0, + 1.1421768981963396, + 0.0, + 0.04372053220868111, + 0.0, + 0.0, + 0.20761992409825325, + 0.0, + 0.1639474742114544, + 0.08029776066541672, + 0.5452352818101645, + 0.2664216049015522, + 0.20081860572099686, + 0.0, + 0.25251780822873116, + 0.37253986299037933, + 0.0, + 0.0798637866973877, + 0.0, + 0.0, + 0.03060467541217804, + 0.04064507037401199, + 0.0, + 0.46961353346705437, + 0.18806597217917442, + 0.0, + 0.0, + 0.14855597913265228, + 0.03958069533109665, + 0.03168365731835365, + 0.13980856910347939, + 0.03056216612458229, + 0.0 + ], + "unique_experts": 41, + "load_cv": 1.197122503938086, + "normalized_load_entropy": 0.8335999784365908, + "max_load_share": 0.07246376811594203 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "a4f232cc58641bd335f0e90778b3b346877a991e1bcd241663be4dae9eec2d08", + "route_weight_sha256": "4a73517aa7b2e775f60f6490aec38727132ce6c037b80605e1f158725df102df", + "loads": [ + 15, + 2, + 2, + 11, + 6, + 1, + 3, + 5, + 0, + 8, + 10, + 8, + 10, + 12, + 3, + 9, + 3, + 8, + 4, + 0, + 1, + 5, + 1, + 11, + 9, + 23, + 12, + 7, + 2, + 9, + 2, + 1, + 15, + 0, + 1, + 0, + 5, + 5, + 5, + 4, + 15, + 13, + 10, + 4, + 2, + 11, + 7, + 2, + 3, + 1, + 2, + 7, + 5, + 1, + 5, + 11, + 7, + 14, + 5, + 3, + 2, + 7, + 9, + 0 + ], + "weighted_loads": [ + 1.3347352221608162, + 0.07938884943723679, + 0.09882887080311775, + 2.1062743328511715, + 0.39815616980195045, + 0.02848547138273716, + 0.12019393593072891, + 0.37094925343990326, + 0.0, + 0.2878320850431919, + 0.7141142655164003, + 0.5285309739410877, + 0.6210565399378538, + 0.7464830446988344, + 0.09975093230605125, + 0.39183181151747704, + 0.377541970461607, + 0.6599230412393808, + 0.15270822867751122, + 0.0, + 0.08194062113761902, + 0.4017025828361511, + 0.05680406466126442, + 0.7115077078342438, + 0.6245886012911797, + 1.4726368319243193, + 1.4667387325316668, + 0.35636699572205544, + 0.09566866979002953, + 1.0587165988981724, + 0.09538131952285767, + 0.03886930271983147, + 1.355622798204422, + 0.0, + 0.04372053220868111, + 0.0, + 0.2609727755188942, + 0.28148278035223484, + 0.3795614540576935, + 0.19767343997955322, + 1.7577265724539757, + 0.847716199234128, + 0.5570414625108242, + 0.21967777982354164, + 0.24103425815701485, + 1.4870807118713856, + 0.5911937281489372, + 0.13138698786497116, + 0.11747792363166809, + 0.039456807076931, + 0.21961960941553116, + 0.3254652749747038, + 0.292531281709671, + 0.033046867698431015, + 0.5556045807898045, + 0.6341689471155405, + 0.6186338327825069, + 0.754429541528225, + 0.22337747737765312, + 0.13187573477625847, + 0.06389425322413445, + 0.4109755642712116, + 0.6356045883148909, + 0.0 + ], + "unique_experts": 59, + "load_cv": 0.7976745716281936, + "normalized_load_entropy": 0.920536857865469, + "max_load_share": 0.059895833333333336 + } + }, + "s0_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "ba997caaf32a9138af51a53b3f449be4f4b50d1a831fe434281c6019532f0c53", + "route_weight_sha256": "e6b821c7d7ee9532e7b8d96ca1e3323454f273ab3359fa1e8257ee15c2e66c72", + "loads": [ + 11, + 1, + 0, + 2, + 0, + 1, + 0, + 4, + 0, + 2, + 1, + 6, + 9, + 3, + 3, + 1, + 2, + 0, + 0, + 0, + 1, + 4, + 1, + 3, + 0, + 1, + 3, + 4, + 2, + 8, + 0, + 0, + 10, + 0, + 1, + 0, + 0, + 3, + 1, + 3, + 1, + 6, + 4, + 3, + 0, + 6, + 5, + 0, + 2, + 0, + 0, + 0, + 1, + 1, + 4, + 3, + 0, + 0, + 3, + 1, + 2, + 3, + 1, + 1 + ], + "weighted_loads": [ + 1.1231883484870195, + 0.03557366505265236, + 0.0, + 1.3032772541046143, + 0.0, + 0.026535095646977425, + 0.0, + 0.30167724192142487, + 0.0, + 0.09525524079799652, + 0.04363170266151428, + 0.47466012090444565, + 0.5682368278503418, + 0.08131064102053642, + 0.0990230068564415, + 0.03725489601492882, + 0.25396472588181496, + 0.0, + 0.0, + 0.0, + 0.08105520159006119, + 0.3609948307275772, + 0.06715790182352066, + 0.0757615976035595, + 0.0, + 0.031018467620015144, + 0.7484034113585949, + 0.23140317387878895, + 0.09026827290654182, + 0.9637984558939934, + 0.0, + 0.0, + 1.08663378842175, + 0.0, + 0.04140149801969528, + 0.0, + 0.0, + 0.22385163232684135, + 0.04210612177848816, + 0.1595543846487999, + 0.03879643976688385, + 0.48625246435403824, + 0.27683732099831104, + 0.2087714746594429, + 0.0, + 0.25643893890082836, + 0.38215411454439163, + 0.0, + 0.08520019054412842, + 0.0, + 0.0, + 0.0, + 0.03907753899693489, + 0.03959843888878822, + 0.448794461786747, + 0.19613754749298096, + 0.0, + 0.0, + 0.1463867463171482, + 0.040439050644636154, + 0.06177202798426151, + 0.1516806185245514, + 0.04197784140706062, + 0.02670014090836048 + ], + "unique_experts": 44, + "load_cv": 1.1744496894690244, + "normalized_load_entropy": 0.844790073381003, + "max_load_share": 0.07971014492753623 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "81fc0157ac5722815afcb2a9a44dda6890eb0afc345ab231feb9ee1b73da7d13", + "route_weight_sha256": "677ed175db1ea0214cb3563b20b812f58bb2e22abf9a586fce544b9570acb130", + "loads": [ + 17, + 2, + 2, + 10, + 0, + 1, + 2, + 4, + 0, + 5, + 7, + 7, + 11, + 11, + 3, + 3, + 2, + 7, + 3, + 0, + 4, + 5, + 1, + 9, + 6, + 10, + 10, + 8, + 7, + 10, + 0, + 0, + 18, + 0, + 1, + 0, + 0, + 3, + 6, + 3, + 9, + 8, + 8, + 5, + 0, + 11, + 5, + 0, + 2, + 1, + 2, + 0, + 3, + 2, + 5, + 8, + 0, + 2, + 4, + 1, + 2, + 4, + 7, + 1 + ], + "weighted_loads": [ + 1.4151945933699608, + 0.07145587727427483, + 0.1094893179833889, + 1.9403184168040752, + 0.0, + 0.026535095646977425, + 0.09620825946331024, + 0.30167724192142487, + 0.0, + 0.18348216079175472, + 0.4312729835510254, + 0.49321481585502625, + 0.6308921407908201, + 0.6850365027785301, + 0.0990230068564415, + 0.12365052849054337, + 0.25396472588181496, + 0.6848468966782093, + 0.345120657235384, + 0.0, + 0.3385390341281891, + 0.40775131806731224, + 0.06715790182352066, + 0.3460923917591572, + 0.49063269421458244, + 0.48512074165046215, + 1.3606765568256378, + 0.39275998435914516, + 0.2902289628982544, + 1.0314361285418272, + 0.0, + 0.0, + 1.4556286353617907, + 0.0, + 0.04140149801969528, + 0.0, + 0.0, + 0.22385163232684135, + 0.2691991738975048, + 0.1595543846487999, + 1.08498977124691, + 0.583794541656971, + 0.5707987230271101, + 0.26229581236839294, + 0.0, + 1.1804050523787737, + 0.38215411454439163, + 0.0, + 0.08520019054412842, + 0.03430863469839096, + 0.1311824470758438, + 0.0, + 0.17879503592848778, + 0.07579019293189049, + 0.4917602986097336, + 0.5486443135887384, + 0.0, + 0.12181093171238899, + 0.17624962888658047, + 0.040439050644636154, + 0.06177202798426151, + 0.1913202702999115, + 0.5140872225165367, + 0.02670014090836048 + ], + "unique_experts": 52, + "load_cv": 0.9212846639876111, + "normalized_load_entropy": 0.8926165307788467, + "max_load_share": 0.0625 + } + }, + "s1_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "49d168c623f03c69ab53139a1bd52308e8d8fe922a9e85de06b44c4a1811895d", + "route_weight_sha256": "24fc9ed817d381c03bfe695d5b5a1bbf9f2d061886a1113c9488badc58eff5e6", + "loads": [ + 10, + 1, + 0, + 3, + 0, + 1, + 0, + 4, + 0, + 2, + 1, + 6, + 9, + 3, + 3, + 2, + 2, + 0, + 0, + 0, + 1, + 4, + 1, + 2, + 0, + 1, + 3, + 5, + 1, + 8, + 0, + 0, + 10, + 0, + 2, + 0, + 0, + 3, + 1, + 3, + 2, + 7, + 4, + 3, + 0, + 6, + 5, + 0, + 2, + 0, + 0, + 0, + 1, + 0, + 4, + 3, + 0, + 0, + 4, + 1, + 1, + 2, + 1, + 0 + ], + "weighted_loads": [ + 1.049277450889349, + 0.03669294714927673, + 0.0, + 1.247984992340207, + 0.0, + 0.02940080128610134, + 0.0, + 0.32363395765423775, + 0.0, + 0.08701840415596962, + 0.04433039575815201, + 0.45264946296811104, + 0.594394763931632, + 0.08277537859976292, + 0.09760048054158688, + 0.07001729309558868, + 0.2306046448647976, + 0.0, + 0.0, + 0.0, + 0.07655523717403412, + 0.33444682136178017, + 0.053650494664907455, + 0.05801912397146225, + 0.0, + 0.030690742656588554, + 0.732951071113348, + 0.2794281765818596, + 0.05157722532749176, + 0.9672669507563114, + 0.0, + 0.0, + 1.10808240249753, + 0.0, + 0.07502389512956142, + 0.0, + 0.0, + 0.20726353302598, + 0.046568773686885834, + 0.15644364058971405, + 0.0788826234638691, + 0.5308591052889824, + 0.27718695253133774, + 0.200671274214983, + 0.0, + 0.261320972815156, + 0.3516948018223047, + 0.0, + 0.08068414032459259, + 0.0, + 0.0, + 0.0, + 0.038691453635692596, + 0.0, + 0.45418740436434746, + 0.19398656859993935, + 0.0, + 0.0, + 0.1732944566756487, + 0.03857610374689102, + 0.03032137267291546, + 0.13219129666686058, + 0.034074511379003525, + 0.0 + ], + "unique_experts": 42, + "load_cv": 1.180158729654263, + "normalized_load_entropy": 0.8382597496321507, + "max_load_share": 0.07246376811594203 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "2bfc4e7f6ccd170f846a5a0c1ed1fae4ac60e8924704326898a9991989b30009", + "route_weight_sha256": "7f291249a5b2dfb4fd4323bae8c036037e3aa44d489931d567e134d915d63d02", + "loads": [ + 16, + 3, + 2, + 11, + 6, + 1, + 3, + 5, + 0, + 7, + 9, + 8, + 9, + 11, + 3, + 9, + 3, + 6, + 3, + 0, + 1, + 5, + 1, + 10, + 10, + 24, + 13, + 7, + 3, + 9, + 2, + 1, + 15, + 0, + 2, + 0, + 5, + 5, + 5, + 4, + 15, + 12, + 11, + 4, + 2, + 12, + 7, + 2, + 2, + 0, + 2, + 6, + 5, + 1, + 5, + 13, + 7, + 15, + 5, + 3, + 2, + 7, + 9, + 0 + ], + "weighted_loads": [ + 1.3378725722432137, + 0.11300161853432655, + 0.09285250306129456, + 1.974369777366519, + 0.39815616980195045, + 0.02940080128610134, + 0.12019393593072891, + 0.3785542882978916, + 0.0, + 0.24452104419469833, + 0.5769793931394815, + 0.5203863084316254, + 0.594394763931632, + 0.6872520353645086, + 0.09760048054158688, + 0.4207288511097431, + 0.36867181584239006, + 0.5819249823689461, + 0.14026598632335663, + 0.0, + 0.07655523717403412, + 0.41125790402293205, + 0.053650494664907455, + 0.6822992488741875, + 0.6145703364163637, + 1.57066535577178, + 1.4892138820141554, + 0.35803862661123276, + 0.1201140508055687, + 1.0457579754292965, + 0.09538131952285767, + 0.03886930271983147, + 1.3154961671680212, + 0.0, + 0.07502389512956142, + 0.0, + 0.2609727755188942, + 0.2811263892799616, + 0.4019763693213463, + 0.19016960635781288, + 1.6633762530982494, + 0.8474535830318928, + 0.6003595180809498, + 0.21953044831752777, + 0.24103425815701485, + 1.7162458505481482, + 0.5703486669808626, + 0.13138698786497116, + 0.08068414032459259, + 0.0, + 0.19936644285917282, + 0.29486059956252575, + 0.2935318201780319, + 0.03332336246967316, + 0.5401784516870975, + 0.8575275335460901, + 0.6186338327825069, + 0.8287499360740185, + 0.19774647615849972, + 0.13087114319205284, + 0.06253196857869625, + 0.43555978313088417, + 0.6383277308195829, + 0.0 + ], + "unique_experts": 58, + "load_cv": 0.8191501354723959, + "normalized_load_entropy": 0.9176785489561368, + "max_load_share": 0.0625 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "ordered_topk_exact_tokens": 19, + "set_exact_tokens": 22, + "mean_set_jaccard": 0.9875776397515529, + "mean_token_weighted_tv": 0.009278475995297018, + "aggregate_load_tv": 0.007246376811594199 + }, + "system_bos": { + "tokens": 23, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.9006211180124224, + "mean_token_weighted_tv": 0.02047793563131405, + "aggregate_load_tv": 0.050724637681159424 + }, + "system_x": { + "tokens": 23, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.9037267080745343, + "mean_token_weighted_tv": 0.02497722143712251, + "aggregate_load_tv": 0.05797101449275362 + }, + "system_period": { + "tokens": 23, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8881987577639753, + "mean_token_weighted_tv": 0.027631083098442658, + "aggregate_load_tv": 0.050724637681159424 + }, + "bos_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.9130434782608695, + "mean_token_weighted_tv": 0.019951738862563736, + "aggregate_load_tv": 0.05072463768115942 + }, + "bos_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.9254658385093167, + "mean_token_weighted_tv": 0.019446137482705322, + "aggregate_load_tv": 0.036231884057971016 + }, + "x_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 12, + "mean_set_jaccard": 0.8540372670807455, + "mean_token_weighted_tv": 0.0313355122976329, + "aggregate_load_tv": 0.05072463768115941 + }, + "x_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.8726708074534162, + "mean_token_weighted_tv": 0.03149298517762319, + "aggregate_load_tv": 0.07246376811594203 + }, + "period_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.888198757763975, + "mean_token_weighted_tv": 0.0257122161919656, + "aggregate_load_tv": 0.043478260869565216 + }, + "period_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.8975155279503105, + "mean_token_weighted_tv": 0.030009570086131924, + "aggregate_load_tv": 0.057971014492753624 + } + } + }, + "layer_18": { + "layer": 18, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "0f5f436dfc6fe12a98069c49099f26d30d31d17135bea8936deebe0968c01c76", + "route_weight_sha256": "6263401811b34b129ef432aab4079c1341361fa0418d34c8fc199de96ef59ba6", + "loads": [ + 0, + 4, + 5, + 3, + 17, + 7, + 1, + 3, + 1, + 0, + 1, + 1, + 5, + 2, + 2, + 4, + 0, + 1, + 3, + 0, + 1, + 0, + 2, + 0, + 2, + 1, + 0, + 2, + 0, + 1, + 1, + 0, + 1, + 5, + 1, + 5, + 4, + 0, + 1, + 0, + 1, + 0, + 8, + 0, + 2, + 0, + 0, + 12, + 0, + 3, + 1, + 3, + 2, + 0, + 3, + 0, + 6, + 2, + 0, + 2, + 0, + 0, + 3, + 3 + ], + "weighted_loads": [ + 0.0, + 0.5644678175449371, + 0.3753540776669979, + 0.20474477484822273, + 1.1010428369045258, + 0.4973016381263733, + 0.03916788101196289, + 0.18495695292949677, + 0.034846533089876175, + 0.0, + 0.0329100601375103, + 0.08132912963628769, + 0.1765800081193447, + 0.7753971852362156, + 0.10043814033269882, + 0.32720497623085976, + 0.0, + 0.10343299806118011, + 0.1496418509632349, + 0.0, + 0.04908871278166771, + 0.0, + 0.10275046154856682, + 0.0, + 0.07975109294056892, + 0.03764525428414345, + 0.0, + 0.10314927250146866, + 0.0, + 0.05165797099471092, + 0.06670749932527542, + 0.0, + 0.07186209410429001, + 0.3935096114873886, + 0.03698955848813057, + 0.23120078444480896, + 0.16414948552846909, + 0.0, + 0.0402483195066452, + 0.0, + 0.07155769318342209, + 0.0, + 0.41555388644337654, + 0.0, + 0.10234734043478966, + 0.0, + 0.0, + 1.0231778137385845, + 0.0, + 0.3791125789284706, + 0.028287509456276894, + 0.18651330471038818, + 0.21611637622117996, + 0.0, + 0.1445007622241974, + 0.0, + 0.6506415903568268, + 0.10184590891003609, + 0.0, + 0.2978537157177925, + 0.0, + 0.0, + 0.25835250690579414, + 0.23543977178633213 + ], + "unique_experts": 43, + "load_cv": 1.3650142930254727, + "normalized_load_entropy": 0.8246751634682278, + "max_load_share": 0.12318840579710146 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "f02d3f0410c0646598f4754b17eb4bd372da123a833dea29de75338743c4c60b", + "route_weight_sha256": "a65dc20de811583edb10fc3dc0c1c7882e5ad3a5d8f208aee34614288a9c834d", + "loads": [ + 6, + 5, + 17, + 3, + 17, + 9, + 1, + 3, + 10, + 0, + 2, + 5, + 6, + 2, + 7, + 8, + 0, + 1, + 23, + 0, + 1, + 2, + 2, + 0, + 2, + 1, + 0, + 2, + 0, + 1, + 10, + 0, + 1, + 5, + 1, + 10, + 5, + 4, + 1, + 2, + 6, + 0, + 11, + 0, + 2, + 0, + 8, + 12, + 3, + 15, + 3, + 5, + 11, + 6, + 3, + 0, + 8, + 3, + 1, + 5, + 0, + 3, + 3, + 5 + ], + "weighted_loads": [ + 0.39034682884812355, + 0.6362060159444809, + 1.4275193437933922, + 0.20474477484822273, + 1.1010428369045258, + 0.5439025349915028, + 0.03916788101196289, + 0.18495695292949677, + 0.6462096273899078, + 0.0, + 0.043865573592484, + 0.4656950980424881, + 0.2131936140358448, + 0.7753971852362156, + 1.0400673169642687, + 0.46900610625743866, + 0.0, + 0.10343299806118011, + 1.878762235864997, + 0.0, + 0.04908871278166771, + 0.05993678234517574, + 0.10275046154856682, + 0.0, + 0.07975109294056892, + 0.03764525428414345, + 0.0, + 0.10314927250146866, + 0.0, + 0.05165797099471092, + 0.7241037795320153, + 0.0, + 0.07186209410429001, + 0.3935096114873886, + 0.03698955848813057, + 0.4777798131108284, + 0.18776500411331654, + 0.14872009307146072, + 0.0402483195066452, + 0.0476519949734211, + 0.3093567118048668, + 0.0, + 0.5061718914657831, + 0.0, + 0.10234734043478966, + 0.0, + 1.5199420675635338, + 1.0231778137385845, + 0.14926400408148766, + 0.9065937455743551, + 0.08947608061134815, + 0.34360797703266144, + 0.8168590571731329, + 0.4018949158489704, + 0.1445007622241974, + 0.0, + 1.6480983793735504, + 0.12564070150256157, + 0.029346847906708717, + 0.4487322364002466, + 0.0, + 0.08813760802149773, + 0.25835250690579414, + 0.33000791259109974 + ], + "unique_experts": 52, + "load_cv": 1.072955995323776, + "normalized_load_entropy": 0.8721111103015526, + "max_load_share": 0.0798611111111111 + } + }, + "s1_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "c7a2f4014daf5e098a681e7b8e8a786294992349363ca50d8042c246e39b00ab", + "route_weight_sha256": "55dcc8090ac5b47053773a1abf13171a32be6895d8f4406aab4bee29ed3cd7d5", + "loads": [ + 0, + 4, + 5, + 3, + 16, + 7, + 0, + 3, + 1, + 0, + 1, + 1, + 4, + 2, + 2, + 4, + 0, + 2, + 3, + 0, + 1, + 1, + 2, + 0, + 2, + 1, + 0, + 2, + 0, + 1, + 1, + 0, + 1, + 5, + 1, + 5, + 4, + 0, + 1, + 0, + 1, + 0, + 8, + 0, + 2, + 0, + 0, + 12, + 0, + 3, + 2, + 3, + 2, + 0, + 3, + 0, + 5, + 2, + 0, + 2, + 0, + 0, + 3, + 4 + ], + "weighted_loads": [ + 0.0, + 0.539628379046917, + 0.3824406675994396, + 0.19345415756106377, + 1.0662419684231281, + 0.4951578564941883, + 0.0, + 0.18039166554808617, + 0.03365179896354675, + 0.0, + 0.03163642808794975, + 0.08000759035348892, + 0.1539717148989439, + 0.8036693558096886, + 0.10585450008511543, + 0.3171251192688942, + 0.0, + 0.13394291326403618, + 0.14896069280803204, + 0.0, + 0.0527750663459301, + 0.03945161774754524, + 0.09668220579624176, + 0.0, + 0.07779796421527863, + 0.03562653809785843, + 0.0, + 0.10136960074305534, + 0.0, + 0.051534175872802734, + 0.0622430182993412, + 0.0, + 0.0689876601099968, + 0.3874773941934109, + 0.03964170441031456, + 0.22413350455462933, + 0.16001734137535095, + 0.0, + 0.03922291845083237, + 0.0, + 0.06265801191329956, + 0.0, + 0.4380228463560343, + 0.0, + 0.10910511389374733, + 0.0, + 0.0, + 1.0211546793580055, + 0.0, + 0.37631309032440186, + 0.06387794949114323, + 0.18215421587228775, + 0.20761995017528534, + 0.0, + 0.14269006252288818, + 0.0, + 0.6126145757734776, + 0.10804254934191704, + 0.0, + 0.3049519881606102, + 0.0, + 0.0, + 0.25716162100434303, + 0.26447767578065395 + ], + "unique_experts": 43, + "load_cv": 1.3148530257451094, + "normalized_load_entropy": 0.831621456714298, + "max_load_share": 0.11594202898550725 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "322019597d5a28be5ef4cc44054eace6301c943c0bd616824775ad77c2f2874b", + "route_weight_sha256": "549113535e5ed2e2ddf71a03bd2f13aab7f42af1c009c984e22de15c6c5d1fde", + "loads": [ + 8, + 7, + 18, + 3, + 17, + 9, + 1, + 5, + 12, + 2, + 2, + 5, + 4, + 3, + 11, + 5, + 0, + 12, + 28, + 1, + 1, + 3, + 3, + 0, + 2, + 1, + 0, + 2, + 0, + 2, + 13, + 2, + 2, + 6, + 5, + 22, + 5, + 7, + 2, + 2, + 6, + 0, + 10, + 5, + 2, + 0, + 18, + 16, + 2, + 17, + 3, + 5, + 10, + 11, + 5, + 1, + 8, + 8, + 3, + 6, + 0, + 3, + 3, + 9 + ], + "weighted_loads": [ + 0.41062733717262745, + 0.6817743182182312, + 1.4386618193238974, + 0.19345415756106377, + 1.1054614074528217, + 0.5522115658968687, + 0.029560163617134094, + 0.2487628534436226, + 0.9768779799342155, + 0.0614237766712904, + 0.04337526299059391, + 0.43939023464918137, + 0.1539717148989439, + 0.8401775695383549, + 1.1930485423654318, + 0.35025128722190857, + 0.0, + 0.7320151478052139, + 2.5557839293032885, + 0.13707377016544342, + 0.0527750663459301, + 0.09900548122823238, + 0.1319340094923973, + 0.0, + 0.07779796421527863, + 0.03562653809785843, + 0.0, + 0.10136960074305534, + 0.0, + 0.08829944208264351, + 0.9411851251497865, + 0.24286023154854774, + 0.12460392713546753, + 0.46410126611590385, + 0.4589099809527397, + 1.6341813560575247, + 0.18342122808098793, + 0.30035340040922165, + 0.0796489305794239, + 0.04781225137412548, + 0.2698948532342911, + 0.0, + 0.4962714612483978, + 0.4543166011571884, + 0.10910511389374733, + 0.0, + 2.733769878745079, + 1.1992745362222195, + 0.07264812849462032, + 0.9807555247098207, + 0.09013582952320576, + 0.3620453029870987, + 0.7726434096693993, + 0.6230351123958826, + 0.2638698033988476, + 0.03481612727046013, + 1.623607162386179, + 0.37717523612082005, + 0.3692931495606899, + 0.5783270224928856, + 0.0, + 0.10322022438049316, + 0.25716162100434303, + 0.45053770020604134 + ], + "unique_experts": 57, + "load_cv": 0.9864533834793096, + "normalized_load_entropy": 0.8933693960822028, + "max_load_share": 0.07291666666666667 + } + }, + "s0_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "e2e93c4a4f2bd255af99d6f467f9854d3abe8e62e77db3ca5f3c8d2a7b9b8648", + "route_weight_sha256": "2f5b5d704bb225f0246059536069031ba8dceffce278a07cdaa40c066d6312ec", + "loads": [ + 0, + 4, + 5, + 3, + 17, + 8, + 1, + 3, + 1, + 0, + 1, + 1, + 5, + 2, + 2, + 4, + 0, + 2, + 3, + 0, + 1, + 0, + 2, + 0, + 2, + 1, + 0, + 2, + 0, + 1, + 1, + 0, + 1, + 5, + 1, + 6, + 4, + 0, + 1, + 0, + 1, + 0, + 7, + 0, + 1, + 0, + 0, + 11, + 0, + 3, + 0, + 3, + 2, + 0, + 2, + 0, + 6, + 2, + 0, + 2, + 0, + 0, + 5, + 3 + ], + "weighted_loads": [ + 0.0, + 0.6080430708825588, + 0.39155329018831253, + 0.20890652388334274, + 1.0718847000971437, + 0.5963609889149666, + 0.03750012442469597, + 0.17775139212608337, + 0.03657444566488266, + 0.0, + 0.03294263780117035, + 0.0852511003613472, + 0.18615875951945782, + 0.8092326112091541, + 0.10260755568742752, + 0.3299563340842724, + 0.0, + 0.13124223798513412, + 0.14880107901990414, + 0.0, + 0.04776420816779137, + 0.0, + 0.09483382850885391, + 0.0, + 0.08543946593999863, + 0.03576003387570381, + 0.0, + 0.10642486065626144, + 0.0, + 0.053415391594171524, + 0.05459349974989891, + 0.0, + 0.07526673376560211, + 0.3986959233880043, + 0.03739757463335991, + 0.24744204059243202, + 0.1606761161237955, + 0.0, + 0.038898758590221405, + 0.0, + 0.08140978217124939, + 0.0, + 0.40131538547575474, + 0.0, + 0.06425350904464722, + 0.0, + 0.0, + 0.9647357445210218, + 0.0, + 0.36083999276161194, + 0.0, + 0.19013745337724686, + 0.21020351722836494, + 0.0, + 0.11635833978652954, + 0.0, + 0.6587237883359194, + 0.10226583480834961, + 0.0, + 0.27805523946881294, + 0.0, + 0.0, + 0.3311532251536846, + 0.22815041989088058 + ], + "unique_experts": 42, + "load_cv": 1.362550088298112, + "normalized_load_entropy": 0.8210106733760099, + "max_load_share": 0.12318840579710146 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "750521fc9b9d2aa5528757db7e253db162f6a5033d4d44db82c54423fab01301", + "route_weight_sha256": "2aa1f8b60fca9b4e8b5951b604de85fc1669dcdd1c6d39e731284c444503e99e", + "loads": [ + 6, + 5, + 16, + 3, + 17, + 10, + 1, + 3, + 10, + 0, + 1, + 4, + 7, + 2, + 7, + 7, + 0, + 2, + 23, + 0, + 1, + 2, + 2, + 1, + 2, + 1, + 1, + 2, + 0, + 1, + 8, + 0, + 1, + 6, + 1, + 12, + 4, + 4, + 1, + 4, + 7, + 1, + 11, + 0, + 1, + 0, + 9, + 11, + 3, + 14, + 1, + 5, + 11, + 5, + 2, + 0, + 7, + 3, + 1, + 4, + 0, + 4, + 5, + 5 + ], + "weighted_loads": [ + 0.39034682884812355, + 0.6797812692821026, + 1.417198108509183, + 0.20890652388334274, + 1.0718847000971437, + 0.642961885780096, + 0.03750012442469597, + 0.17775139212608337, + 0.6539254076778889, + 0.0, + 0.03294263780117035, + 0.34381815791130066, + 0.44372417591512203, + 0.8092326112091541, + 0.8449644725769758, + 0.43284180015325546, + 0.0, + 0.13124223798513412, + 1.8169088792055845, + 0.0, + 0.04776420816779137, + 0.056177543476223946, + 0.09483382850885391, + 0.04817856848239899, + 0.08543946593999863, + 0.03576003387570381, + 0.04721388965845108, + 0.10642486065626144, + 0.0, + 0.053415391594171524, + 0.6598162688314915, + 0.0, + 0.07526673376560211, + 0.46232912689447403, + 0.03739757463335991, + 0.5475597269833088, + 0.1606761161237955, + 0.1527482382953167, + 0.038898758590221405, + 0.2137206867337227, + 0.41865912452340126, + 0.06369853764772415, + 0.5623438730835915, + 0.0, + 0.06425350904464722, + 0.0, + 1.4750849641859531, + 0.9647357445210218, + 0.14926400408148766, + 0.8489318657666445, + 0.02634524554014206, + 0.3412047475576401, + 0.8109461981803179, + 0.3446546159684658, + 0.11635833978652954, + 0.0, + 0.8815362621098757, + 0.12244861759245396, + 0.029346847906708717, + 0.38359303027391434, + 0.0, + 0.13336365297436714, + 0.3311532251536846, + 0.3227185606956482 + ], + "unique_experts": 55, + "load_cv": 1.0548243081137514, + "normalized_load_entropy": 0.8782483988542198, + "max_load_share": 0.0798611111111111 + } + }, + "s1_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "41968898a4d54c0cef19dd7461cce69426c260976669749c5ced1f8672c1bbcc", + "route_weight_sha256": "319f299b381ca074a38c58ac3f005acd9251f4abedcdab36f00102654e5c1690", + "loads": [ + 0, + 4, + 5, + 3, + 17, + 5, + 0, + 3, + 1, + 0, + 1, + 1, + 5, + 2, + 2, + 4, + 0, + 2, + 3, + 0, + 1, + 1, + 2, + 1, + 2, + 1, + 0, + 2, + 0, + 1, + 1, + 0, + 1, + 5, + 1, + 6, + 4, + 0, + 1, + 0, + 1, + 0, + 7, + 0, + 2, + 0, + 0, + 12, + 0, + 3, + 0, + 3, + 2, + 0, + 2, + 0, + 6, + 2, + 0, + 2, + 0, + 0, + 4, + 4 + ], + "weighted_loads": [ + 0.0, + 0.5894693993031979, + 0.3718784786760807, + 0.20052680745720863, + 1.1339820297434926, + 0.43058517947793007, + 0.0, + 0.1759839579463005, + 0.03407464921474457, + 0.0, + 0.030168114230036736, + 0.07926379889249802, + 0.1915620844811201, + 0.8337357118725777, + 0.10515810549259186, + 0.32351308688521385, + 0.0, + 0.13141575828194618, + 0.1575204897671938, + 0.0, + 0.05079912766814232, + 0.039615072309970856, + 0.08512646704912186, + 0.0402831956744194, + 0.0822564996778965, + 0.034647390246391296, + 0.0, + 0.10482458770275116, + 0.0, + 0.05227279290556908, + 0.06093231588602066, + 0.0, + 0.06948041170835495, + 0.39465582370758057, + 0.0357009619474411, + 0.24853382632136345, + 0.15926447603851557, + 0.0, + 0.040260396897792816, + 0.0, + 0.06986524164676666, + 0.0, + 0.39614049531519413, + 0.0, + 0.0982288345694542, + 0.0, + 0.0, + 0.9874934069812298, + 0.0, + 0.3734674006700516, + 0.0, + 0.1928713209927082, + 0.1801639124751091, + 0.0, + 0.11282527819275856, + 0.0, + 0.6699117980897427, + 0.11188270151615143, + 0.0, + 0.30748213827610016, + 0.0, + 0.0, + 0.2758955582976341, + 0.2792074829339981 + ], + "unique_experts": 43, + "load_cv": 1.3451742652246683, + "normalized_load_entropy": 0.8280023222872659, + "max_load_share": 0.12318840579710146 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "1834086b3f264b2aa1986e6e31a6a9c370dbeb8009db9904946cb9cd0a60e2ba", + "route_weight_sha256": "d194dafb243dfcb3d9d474b30754d3992f7e664c52b9383287a8cc3ee5a69c1a", + "loads": [ + 8, + 7, + 16, + 3, + 18, + 7, + 1, + 5, + 12, + 2, + 1, + 5, + 5, + 3, + 11, + 6, + 0, + 12, + 28, + 1, + 1, + 2, + 3, + 1, + 2, + 1, + 0, + 2, + 0, + 2, + 12, + 2, + 3, + 6, + 5, + 23, + 4, + 7, + 2, + 2, + 7, + 1, + 10, + 5, + 2, + 0, + 19, + 16, + 2, + 17, + 1, + 5, + 10, + 11, + 4, + 1, + 8, + 8, + 3, + 6, + 0, + 4, + 4, + 9 + ], + "weighted_loads": [ + 0.41062733717262745, + 0.7316153384745121, + 1.3676306549459696, + 0.20052680745720863, + 1.1732014687731862, + 0.48763888888061047, + 0.029560163617134094, + 0.24435514584183693, + 1.0075629279017448, + 0.0614237766712904, + 0.030168114230036736, + 0.4072772338986397, + 0.1915620844811201, + 0.870243925601244, + 1.2205939833074808, + 0.39117691293358803, + 0.0, + 0.7294879928231239, + 2.577954275533557, + 0.13707377016544342, + 0.05079912766814232, + 0.06458666361868382, + 0.1203782707452774, + 0.0402831956744194, + 0.0822564996778965, + 0.034647390246391296, + 0.0, + 0.10482458770275116, + 0.0, + 0.08903805911540985, + 0.867176340892911, + 0.24286023154854774, + 0.16821271181106567, + 0.47127969563007355, + 0.45496923848986626, + 1.6793966200202703, + 0.15926447603851557, + 0.3168160319328308, + 0.08068640902638435, + 0.04781225137412548, + 0.3301723375916481, + 0.045542359352111816, + 0.5076556652784348, + 0.4543166011571884, + 0.0982288345694542, + 0.0, + 2.694032348692417, + 1.1656132638454437, + 0.07264812849462032, + 0.9944157097488642, + 0.02625788003206253, + 0.35844455286860466, + 0.745187371969223, + 0.6085110548883677, + 0.23400501906871796, + 0.03481612727046013, + 0.9287977777421474, + 0.3769104368984699, + 0.3692931495606899, + 0.6543466448783875, + 0.0, + 0.14655666798353195, + 0.2758955582976341, + 0.4652675073593855 + ], + "unique_experts": 59, + "load_cv": 0.9890897892057683, + "normalized_load_entropy": 0.8949739672971408, + "max_load_share": 0.07291666666666667 + } + }, + "s0_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "afd042aab78c7d81ba5120423d4df5a8c401de8e5541edec95f35226d16747d0", + "route_weight_sha256": "4faa9d66d46377ac3be9e75f9c26e73d12e621e5c7e022a85ce2220592c2c305", + "loads": [ + 0, + 4, + 5, + 3, + 17, + 7, + 1, + 3, + 1, + 0, + 1, + 1, + 4, + 1, + 2, + 5, + 0, + 2, + 4, + 0, + 2, + 1, + 2, + 0, + 2, + 1, + 0, + 2, + 0, + 1, + 1, + 0, + 1, + 5, + 1, + 4, + 4, + 0, + 2, + 0, + 1, + 0, + 9, + 0, + 1, + 0, + 0, + 11, + 0, + 3, + 0, + 3, + 2, + 0, + 2, + 0, + 6, + 2, + 0, + 2, + 0, + 0, + 4, + 2 + ], + "weighted_loads": [ + 0.0, + 0.56769248098135, + 0.42567000165581703, + 0.19940711557865143, + 1.072007299400866, + 0.5550079308450222, + 0.03609094023704529, + 0.18101217225193977, + 0.04182087257504463, + 0.0, + 0.03635187819600105, + 0.08673423528671265, + 0.15604564361274242, + 0.7748926281929016, + 0.10222412273287773, + 0.34920452535152435, + 0.0, + 0.13176583126187325, + 0.17450327426195145, + 0.0, + 0.08259951323270798, + 0.037208300083875656, + 0.10043323040008545, + 0.0, + 0.07981941103935242, + 0.03954785689711571, + 0.0, + 0.11220825091004372, + 0.0, + 0.044713687151670456, + 0.052199508994817734, + 0.0, + 0.06764785945415497, + 0.39947639033198357, + 0.03327827528119087, + 0.1954917348921299, + 0.15552547201514244, + 0.0, + 0.08570022135972977, + 0.0, + 0.0813320055603981, + 0.0, + 0.46276212111115456, + 0.0, + 0.061804842203855515, + 0.0, + 0.0, + 1.0692003089934587, + 0.0, + 0.36735469847917557, + 0.0, + 0.19084692373871803, + 0.2074059098958969, + 0.0, + 0.10774386115372181, + 0.0, + 0.668040931224823, + 0.103302501142025, + 0.0, + 0.2544211596250534, + 0.0, + 0.0, + 0.29909326136112213, + 0.19001564010977745 + ], + "unique_experts": 43, + "load_cv": 1.355130588538713, + "normalized_load_entropy": 0.8259622017215532, + "max_load_share": 0.12318840579710146 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "d861ce717884b5ab4790b1a580b5df1352bff9b7e1984f683a2bf3d82bf7c09c", + "route_weight_sha256": "236423a792165c37de03dbe720efe06194f373d76ea5b8a7b4320e16be3d267f", + "loads": [ + 7, + 5, + 17, + 3, + 17, + 9, + 1, + 3, + 10, + 0, + 1, + 5, + 5, + 2, + 7, + 8, + 0, + 2, + 23, + 0, + 2, + 2, + 2, + 0, + 2, + 1, + 0, + 2, + 0, + 1, + 9, + 0, + 1, + 6, + 1, + 10, + 4, + 4, + 2, + 2, + 6, + 0, + 11, + 0, + 1, + 0, + 8, + 11, + 4, + 15, + 1, + 6, + 12, + 7, + 2, + 0, + 7, + 3, + 3, + 3, + 0, + 3, + 4, + 5 + ], + "weighted_loads": [ + 0.4326080121099949, + 0.6394306793808937, + 1.6227675508707762, + 0.19940711557865143, + 1.072007299400866, + 0.6016088277101517, + 0.03609094023704529, + 0.18101217225193977, + 0.6337671875953674, + 0.0, + 0.03635187819600105, + 0.4724736213684082, + 0.20209241099655628, + 0.8083258382976055, + 1.0591989662498236, + 0.45208999142050743, + 0.0, + 0.13176583126187325, + 1.9755732379853725, + 0.0, + 0.08259951323270798, + 0.062382979318499565, + 0.10043323040008545, + 0.0, + 0.07981941103935242, + 0.03954785689711571, + 0.0, + 0.11220825091004372, + 0.0, + 0.044713687151670456, + 0.555281849578023, + 0.0, + 0.06764785945415497, + 0.4438427910208702, + 0.03327827528119087, + 0.4625752903521061, + 0.15552547201514244, + 0.13365188986063004, + 0.08570022135972977, + 0.0476519949734211, + 0.3275865465402603, + 0.0, + 0.5219302978366613, + 0.0, + 0.061804842203855515, + 0.0, + 1.4518321752548218, + 1.0692003089934587, + 0.1888740248978138, + 0.8930949289351702, + 0.02634524554014206, + 0.39186717942357063, + 0.9037477876991034, + 0.3943627905100584, + 0.10774386115372181, + 0.0, + 0.8908534049987793, + 0.13602343201637268, + 0.13166497088968754, + 0.29143214598298073, + 0.0, + 0.0938386581838131, + 0.29909326136112213, + 0.36681336537003517 + ], + "unique_experts": 52, + "load_cv": 1.0693542530511198, + "normalized_load_entropy": 0.8730277619246125, + "max_load_share": 0.0798611111111111 + } + }, + "s1_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "3af9d1481ce110d0e4a7365f6cf65ede41c4891f1f14cd5fb8132938009be24f", + "route_weight_sha256": "ab4ffcf72ec4efb0d87541b642a23972c56af7980efefb4f12de9e045b0fcc45", + "loads": [ + 0, + 4, + 4, + 3, + 17, + 7, + 0, + 2, + 1, + 0, + 1, + 1, + 4, + 2, + 2, + 4, + 0, + 1, + 3, + 0, + 2, + 1, + 2, + 1, + 2, + 1, + 0, + 2, + 0, + 1, + 1, + 0, + 1, + 5, + 1, + 6, + 5, + 0, + 2, + 0, + 1, + 0, + 7, + 0, + 1, + 0, + 0, + 11, + 0, + 3, + 0, + 3, + 2, + 0, + 3, + 0, + 5, + 2, + 0, + 2, + 0, + 0, + 5, + 4 + ], + "weighted_loads": [ + 0.0, + 0.5313077569007874, + 0.4213368594646454, + 0.1900898441672325, + 1.1046679029241204, + 0.5024450980126858, + 0.0, + 0.14613346755504608, + 0.034303780645132065, + 0.0, + 0.03079131618142128, + 0.08007693290710449, + 0.16194617375731468, + 0.8102420195937157, + 0.11063684150576591, + 0.30538225173950195, + 0.0, + 0.08654209971427917, + 0.1311730593442917, + 0.0, + 0.08796652778983116, + 0.036055754870176315, + 0.08684186264872551, + 0.03450321778655052, + 0.08160026744008064, + 0.037228234112262726, + 0.0, + 0.13425510004162788, + 0.0, + 0.04244699329137802, + 0.04313889145851135, + 0.0, + 0.06728121638298035, + 0.4075729101896286, + 0.03641616180539131, + 0.2530195973813534, + 0.20039647072553635, + 0.0, + 0.10783157497644424, + 0.0, + 0.0693846195936203, + 0.0, + 0.38832470029592514, + 0.0, + 0.07064376771450043, + 0.0, + 0.0, + 1.0602970384061337, + 0.0, + 0.3882935345172882, + 0.0, + 0.1877189315855503, + 0.17063601687550545, + 0.0, + 0.1429424174129963, + 0.0, + 0.628419591113925, + 0.12515839189291, + 0.0, + 0.23920134082436562, + 0.0, + 0.0, + 0.345319963991642, + 0.2556947432458401 + ], + "unique_experts": 43, + "load_cv": 1.3326242601009242, + "normalized_load_entropy": 0.8289976033906078, + "max_load_share": 0.12318840579710146 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "446f0768a1ed4730427aa41148e12f585b84d59d32dd0fa96cc119892e14e55b", + "route_weight_sha256": "7da6005b4151d70cb3f300828b8a708fc2b3b55e26ca63b08fa90a4b16042cd3", + "loads": [ + 10, + 7, + 16, + 3, + 18, + 9, + 1, + 4, + 13, + 2, + 1, + 5, + 5, + 4, + 11, + 5, + 0, + 11, + 29, + 1, + 2, + 2, + 3, + 1, + 2, + 1, + 0, + 2, + 0, + 2, + 10, + 2, + 2, + 6, + 5, + 22, + 5, + 7, + 3, + 2, + 7, + 0, + 8, + 6, + 1, + 0, + 18, + 15, + 3, + 17, + 1, + 7, + 11, + 11, + 5, + 1, + 7, + 8, + 3, + 4, + 0, + 2, + 5, + 10 + ], + "weighted_loads": [ + 0.573024133220315, + 0.6734536960721016, + 1.5390574615448713, + 0.1900898441672325, + 1.143887341953814, + 0.5594988074153662, + 0.029560163617134094, + 0.2145046554505825, + 1.051850639283657, + 0.0614237766712904, + 0.03079131618142128, + 0.3791613057255745, + 0.19878730922937393, + 0.8793167918920517, + 1.1569318603724241, + 0.3385084196925163, + 0.0, + 0.6846143342554569, + 2.4684659466147423, + 0.13707377016544342, + 0.08796652778983116, + 0.061027346178889275, + 0.12209366634488106, + 0.03450321778655052, + 0.08160026744008064, + 0.037228234112262726, + 0.0, + 0.13425510004162788, + 0.0, + 0.0792122595012188, + 0.6241431441158056, + 0.24286023154854774, + 0.12289748340845108, + 0.4841967821121216, + 0.45568443834781647, + 1.6053578052669764, + 0.20039647072553635, + 0.28599775582551956, + 0.14825758710503578, + 0.04781225137412548, + 0.27825926057994366, + 0.0, + 0.4115323144942522, + 0.5072022527456284, + 0.07064376771450043, + 0.0, + 2.5307511389255524, + 1.2384168952703476, + 0.1109184306114912, + 0.977762820199132, + 0.02625788003206253, + 0.4838881157338619, + 0.8122712932527065, + 0.6041186358779669, + 0.2641221582889557, + 0.03481612727046013, + 0.8873055707663298, + 0.40038554929196835, + 0.3692931495606899, + 0.42099718376994133, + 0.0, + 0.06459084525704384, + 0.345319963991642, + 0.5068896878510714 + ], + "unique_experts": 58, + "load_cv": 0.9846918581747062, + "normalized_load_entropy": 0.894358663191352, + "max_load_share": 0.07552083333333333 + } + }, + "s0_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "d1f016f85ffd41c2e07318deeb7cdd5bcb1501b046e20e28f38f440ad9cf0bbb", + "route_weight_sha256": "42a26253aa9ac6f043f5fa007be1c1630e3e920c5d03156c815b91f37ac85fba", + "loads": [ + 0, + 4, + 4, + 3, + 18, + 7, + 1, + 3, + 1, + 0, + 1, + 1, + 4, + 1, + 2, + 4, + 0, + 2, + 4, + 0, + 2, + 1, + 2, + 3, + 2, + 1, + 0, + 2, + 0, + 1, + 1, + 0, + 1, + 5, + 1, + 4, + 4, + 0, + 1, + 0, + 1, + 0, + 7, + 0, + 1, + 0, + 0, + 11, + 0, + 3, + 0, + 3, + 2, + 0, + 2, + 0, + 5, + 2, + 0, + 2, + 0, + 0, + 5, + 3 + ], + "weighted_loads": [ + 0.0, + 0.5869408287107944, + 0.37979577854275703, + 0.20980309322476387, + 1.1159557420760393, + 0.5389006845653057, + 0.03639503940939903, + 0.17972372099757195, + 0.03841584175825119, + 0.0, + 0.0364622063934803, + 0.08246465772390366, + 0.15567390993237495, + 0.7650066018104553, + 0.10447013005614281, + 0.3212881088256836, + 0.0, + 0.13334713131189346, + 0.19051174074411392, + 0.0, + 0.08260852843523026, + 0.03903976082801819, + 0.09465019777417183, + 0.10235932655632496, + 0.07548705860972404, + 0.04031059518456459, + 0.0, + 0.11389719322323799, + 0.0, + 0.046053871512413025, + 0.05044551566243172, + 0.0, + 0.0671614408493042, + 0.3938281163573265, + 0.03557484596967697, + 0.1949108950793743, + 0.16174713522195816, + 0.0, + 0.044604573398828506, + 0.0, + 0.08036800473928452, + 0.0, + 0.4014696963131428, + 0.0, + 0.06639432907104492, + 0.0, + 0.0, + 1.07713558152318, + 0.0, + 0.3782644271850586, + 0.0, + 0.1936129443347454, + 0.20177574083209038, + 0.0, + 0.11240728199481964, + 0.0, + 0.6412061769515276, + 0.10113987326622009, + 0.0, + 0.2577834650874138, + 0.0, + 0.0, + 0.3212472200393677, + 0.23464392125606537 + ], + "unique_experts": 44, + "load_cv": 1.3476702418861093, + "normalized_load_entropy": 0.8323704853373404, + "max_load_share": 0.13043478260869565 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "9666e0132ea515ec4808bd64a796f7e8736a771501082ce35a057116099c1ca1", + "route_weight_sha256": "8cf51b011d1ea8f742b8d02c8bbccc1b7fcf465cc9533bf234c952bb6925611b", + "loads": [ + 7, + 5, + 15, + 3, + 18, + 9, + 1, + 3, + 10, + 0, + 1, + 5, + 4, + 2, + 7, + 8, + 0, + 2, + 24, + 0, + 2, + 3, + 2, + 3, + 2, + 1, + 0, + 2, + 0, + 1, + 8, + 1, + 1, + 6, + 1, + 9, + 4, + 4, + 1, + 2, + 6, + 0, + 9, + 0, + 1, + 0, + 9, + 11, + 3, + 15, + 2, + 5, + 12, + 8, + 2, + 0, + 6, + 4, + 2, + 3, + 0, + 3, + 5, + 5 + ], + "weighted_loads": [ + 0.4380132518708706, + 0.6586790271103382, + 1.4054405968636274, + 0.20980309322476387, + 1.1159557420760393, + 0.5855015814304352, + 0.03639503940939903, + 0.17972372099757195, + 0.6581132300198078, + 0.0, + 0.0364622063934803, + 0.4540915936231613, + 0.15567390993237495, + 0.7961615659296513, + 1.1820668336004019, + 0.46541759744286537, + 0.0, + 0.13334713131189346, + 2.098527178168297, + 0.0, + 0.08260852843523026, + 0.09692851640284061, + 0.09465019777417183, + 0.10235932655632496, + 0.07548705860972404, + 0.04031059518456459, + 0.0, + 0.11389719322323799, + 0.0, + 0.046053871512413025, + 0.49666164815425873, + 0.030092932283878326, + 0.0671614408493042, + 0.43294408544898033, + 0.03557484596967697, + 0.41805681958794594, + 0.16174713522195816, + 0.13654544204473495, + 0.044604573398828506, + 0.0476519949734211, + 0.33342402428388596, + 0.0, + 0.46063787303864956, + 0.0, + 0.06639432907104492, + 0.0, + 1.6602565050125122, + 1.07713558152318, + 0.14926400408148766, + 0.8946981132030487, + 0.06317169219255447, + 0.35186607763171196, + 0.8630978148430586, + 0.4719792138785124, + 0.11240728199481964, + 0.0, + 0.8640186507254839, + 0.1877741515636444, + 0.07124682329595089, + 0.2947944514453411, + 0.0, + 0.08852982893586159, + 0.3212472200393677, + 0.329212062060833 + ], + "unique_experts": 54, + "load_cv": 1.0548243081137514, + "normalized_load_entropy": 0.8802426764353499, + "max_load_share": 0.08333333333333333 + } + }, + "s1_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "328cfb703fefd821937161c8c4551f98da96c00ba228792d9a0ad1206b47c6fa", + "route_weight_sha256": "3d526b30b0ccc47189267a7511442c19229b59d7657edcedca87548bf0b4e6ea", + "loads": [ + 0, + 4, + 5, + 3, + 17, + 6, + 0, + 3, + 1, + 0, + 1, + 1, + 4, + 2, + 2, + 4, + 0, + 1, + 3, + 0, + 1, + 1, + 2, + 1, + 2, + 1, + 0, + 2, + 0, + 1, + 1, + 0, + 1, + 5, + 1, + 6, + 5, + 0, + 2, + 0, + 1, + 0, + 7, + 0, + 2, + 0, + 0, + 12, + 0, + 3, + 0, + 3, + 2, + 0, + 3, + 0, + 5, + 2, + 0, + 2, + 0, + 0, + 4, + 3 + ], + "weighted_loads": [ + 0.0, + 0.5323934070765972, + 0.4653342738747597, + 0.1892932988703251, + 1.112093973904848, + 0.47367413341999054, + 0.0, + 0.18085504323244095, + 0.03376662731170654, + 0.0, + 0.029523193836212158, + 0.08134842664003372, + 0.15694374963641167, + 0.8016438521444798, + 0.10769586637616158, + 0.3080163523554802, + 0.0, + 0.08893121033906937, + 0.1334344893693924, + 0.0, + 0.05246666818857193, + 0.03878090903162956, + 0.08867395296692848, + 0.03632510453462601, + 0.08010149747133255, + 0.037193961441516876, + 0.0, + 0.1397237926721573, + 0.0, + 0.04289921000599861, + 0.044128116220235825, + 0.0, + 0.06585157662630081, + 0.4027271419763565, + 0.03477403521537781, + 0.24940373562276363, + 0.19325199536979198, + 0.0, + 0.12035393714904785, + 0.0, + 0.07191988080739975, + 0.0, + 0.3772294968366623, + 0.0, + 0.1032535620033741, + 0.0, + 0.0, + 1.1057402938604355, + 0.0, + 0.38044219464063644, + 0.0, + 0.1871890425682068, + 0.18352879583835602, + 0.0, + 0.13964708149433136, + 0.0, + 0.6320262402296066, + 0.12063634395599365, + 0.0, + 0.23058651015162468, + 0.0, + 0.0, + 0.3107609637081623, + 0.2175781149417162 + ], + "unique_experts": 43, + "load_cv": 1.3426736486503665, + "normalized_load_entropy": 0.828594381460784, + "max_load_share": 0.12318840579710146 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "c8e3af468275ccd5433947007de595ec89e9f9fd992be768f4a535bc65c757cb", + "route_weight_sha256": "d3b184497c5ec89a7d6e7c89056fc47eb31e743f5425f7f6088d165d3eb6d49f", + "loads": [ + 8, + 8, + 16, + 3, + 19, + 8, + 1, + 5, + 12, + 3, + 1, + 5, + 4, + 3, + 11, + 5, + 0, + 11, + 28, + 1, + 1, + 2, + 3, + 1, + 2, + 1, + 0, + 2, + 0, + 2, + 9, + 2, + 2, + 6, + 5, + 23, + 5, + 7, + 3, + 2, + 7, + 0, + 8, + 6, + 2, + 0, + 19, + 16, + 2, + 17, + 1, + 8, + 11, + 12, + 5, + 1, + 7, + 8, + 3, + 6, + 0, + 2, + 4, + 9 + ], + "weighted_loads": [ + 0.41062733717262745, + 0.708805751055479, + 1.4610864501446486, + 0.1892932988703251, + 1.18999944627285, + 0.5307278428226709, + 0.029560163617134094, + 0.24922623112797737, + 1.006592571735382, + 0.11329465545713902, + 0.029523193836212158, + 0.42433683574199677, + 0.15694374963641167, + 0.8381520658731461, + 1.3021100293844938, + 0.34114252030849457, + 0.0, + 0.6870034448802471, + 2.423042956739664, + 0.13707377016544342, + 0.05246666818857193, + 0.06375250034034252, + 0.12392575666308403, + 0.03632510453462601, + 0.08010149747133255, + 0.037193961441516876, + 0.0, + 0.1397237926721573, + 0.0, + 0.07966447621583939, + 0.5764986388385296, + 0.24286023154854774, + 0.12146784365177155, + 0.4793510138988495, + 0.45404231175780296, + 1.6579956207424402, + 0.19325199536979198, + 0.28862566873431206, + 0.1607799492776394, + 0.04781225137412548, + 0.2886162232607603, + 0.0, + 0.40043711103498936, + 0.48301118798553944, + 0.1032535620033741, + 0.0, + 2.5733099058270454, + 1.2838601507246494, + 0.07264812849462032, + 0.9829461816698313, + 0.02625788003206253, + 0.5462034605443478, + 0.8095918484032154, + 0.6760740671306849, + 0.26082682237029076, + 0.03481612727046013, + 0.8909122198820114, + 0.42779007740318775, + 0.3692931495606899, + 0.47806885093450546, + 0.0, + 0.06459084525704384, + 0.3107609637081623, + 0.4401940181851387 + ], + "unique_experts": 58, + "load_cv": 0.9921567416492215, + "normalized_load_entropy": 0.893289793387064, + "max_load_share": 0.07291666666666667 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.9409937888198759, + "mean_token_weighted_tv": 0.016494377354240936, + "aggregate_load_tv": 0.028985507246376815 + }, + "system_bos": { + "tokens": 23, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 18, + "mean_set_jaccard": 0.9378881987577641, + "mean_token_weighted_tv": 0.020286342432803434, + "aggregate_load_tv": 0.03623188405797102 + }, + "system_x": { + "tokens": 23, + "ordered_topk_exact_tokens": 8, + "set_exact_tokens": 12, + "mean_set_jaccard": 0.8633540372670808, + "mean_token_weighted_tv": 0.03304102903474932, + "aggregate_load_tv": 0.06521739130434782 + }, + "system_period": { + "tokens": 23, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 13, + "mean_set_jaccard": 0.8664596273291927, + "mean_token_weighted_tv": 0.03343850244646487, + "aggregate_load_tv": 0.06521739130434782 + }, + "bos_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.9254658385093167, + "mean_token_weighted_tv": 0.021603979433522276, + "aggregate_load_tv": 0.03623188405797101 + }, + "bos_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.9130434782608695, + "mean_token_weighted_tv": 0.02242204340417748, + "aggregate_load_tv": 0.043478260869565216 + }, + "x_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8788819875776398, + "mean_token_weighted_tv": 0.0331139028193834, + "aggregate_load_tv": 0.057971014492753624 + }, + "x_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.8913043478260869, + "mean_token_weighted_tv": 0.033126290624394365, + "aggregate_load_tv": 0.057971014492753624 + }, + "period_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 12, + "mean_set_jaccard": 0.8540372670807453, + "mean_token_weighted_tv": 0.0346791780675235, + "aggregate_load_tv": 0.07246376811594203 + }, + "period_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 17, + "set_exact_tokens": 18, + "mean_set_jaccard": 0.9192546583850933, + "mean_token_weighted_tv": 0.03136019841970309, + "aggregate_load_tv": 0.04347826086956522 + } + } + }, + "layer_19": { + "layer": 19, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "84094aad2365e498cbef332b12c3e8a1850923b97ae7cbf47e62e07e0af0298b", + "route_weight_sha256": "2822430db14bf74e752aa5029bcf489466ad3e6634ec58058979174afa0b1434", + "loads": [ + 3, + 1, + 6, + 2, + 2, + 5, + 0, + 0, + 0, + 9, + 1, + 4, + 3, + 3, + 0, + 0, + 4, + 0, + 3, + 2, + 0, + 1, + 2, + 8, + 3, + 1, + 1, + 1, + 0, + 1, + 3, + 3, + 0, + 0, + 2, + 0, + 4, + 9, + 4, + 0, + 4, + 0, + 4, + 7, + 0, + 0, + 0, + 2, + 10, + 2, + 0, + 1, + 0, + 5, + 1, + 0, + 2, + 2, + 4, + 0, + 0, + 1, + 2, + 0 + ], + "weighted_loads": [ + 0.6175926961004734, + 0.03338310867547989, + 0.8555183932185173, + 0.12020143121480942, + 0.07321794331073761, + 0.2933505289256573, + 0.0, + 0.0, + 0.0, + 0.45194762758910656, + 0.045200735330581665, + 0.39712413772940636, + 0.10372544080018997, + 0.10418709367513657, + 0.0, + 0.0, + 0.36330922320485115, + 0.0, + 0.314800750464201, + 0.07730801776051521, + 0.0, + 0.06391553580760956, + 0.23987267911434174, + 0.7276089526712894, + 0.24541679956018925, + 0.0364924855530262, + 0.030919546261429787, + 0.037822578102350235, + 0.0, + 0.06040054187178612, + 0.1199828889220953, + 0.5118397995829582, + 0.0, + 0.0, + 0.11074827238917351, + 0.0, + 0.21642085537314415, + 0.5338504482060671, + 0.14903966151177883, + 0.0, + 0.49683117866516113, + 0.0, + 0.29704576544463634, + 0.3266473561525345, + 0.0, + 0.0, + 0.0, + 0.08646589517593384, + 0.5393690001219511, + 0.08660413697361946, + 0.0, + 0.020604168996214867, + 0.0, + 0.3359125889837742, + 0.0185481496155262, + 0.0, + 0.0542348176240921, + 0.0786137543618679, + 0.14394952356815338, + 0.0, + 0.0, + 0.03597915545105934, + 0.2631174176931381, + 0.0 + ], + "unique_experts": 42, + "load_cv": 1.14254016368129, + "normalized_load_entropy": 0.8442435883306812, + "max_load_share": 0.07246376811594203 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "14ab6241fc7f433c34d4d6388dc0c304ffd25f646c8b529b41a498b6c4abbaa5", + "route_weight_sha256": "6989b8846a0ebb507fd54a9432428e3a208907d37cd7e2b6da8eab1f28b6e955", + "loads": [ + 5, + 4, + 7, + 2, + 7, + 7, + 10, + 0, + 0, + 13, + 1, + 4, + 12, + 5, + 5, + 0, + 7, + 1, + 3, + 9, + 0, + 1, + 8, + 17, + 13, + 1, + 1, + 2, + 0, + 5, + 9, + 3, + 0, + 0, + 2, + 2, + 6, + 16, + 6, + 0, + 7, + 4, + 12, + 9, + 1, + 0, + 0, + 5, + 11, + 2, + 0, + 1, + 0, + 9, + 6, + 0, + 2, + 2, + 9, + 0, + 1, + 4, + 9, + 0 + ], + "weighted_loads": [ + 0.6616780790500343, + 0.21656397357583046, + 0.8800305780023336, + 0.12020143121480942, + 0.9194670785218477, + 0.33594026509672403, + 0.4143004696816206, + 0.0, + 0.0, + 0.6816885862499475, + 0.045200735330581665, + 0.39712413772940636, + 0.6963131278753281, + 0.19204401224851608, + 0.47631116211414337, + 0.0, + 0.480654701590538, + 0.060089994221925735, + 0.314800750464201, + 0.459980521351099, + 0.0, + 0.06391553580760956, + 0.47291838377714157, + 1.0375522738322616, + 1.3466903697699308, + 0.0364924855530262, + 0.030919546261429787, + 0.07506390288472176, + 0.0, + 0.2230932153761387, + 0.3531316425651312, + 0.5118397995829582, + 0.0, + 0.0, + 0.11074827238917351, + 0.11699176207184792, + 0.2598981070332229, + 0.8851539809256792, + 0.2229191418737173, + 0.0, + 0.5595764997415245, + 0.23491492494940758, + 0.8852672930806875, + 0.41342901811003685, + 0.010698859579861164, + 0.0, + 0.0, + 0.32568035274744034, + 0.5787818003445864, + 0.08660413697361946, + 0.0, + 0.020604168996214867, + 0.0, + 0.623563788831234, + 1.718445971608162, + 0.0, + 0.0542348176240921, + 0.0786137543618679, + 0.3784656301140785, + 0.0, + 0.04416662082076073, + 0.2175145149230957, + 0.8124218191951513, + 0.0 + ], + "unique_experts": 49, + "load_cv": 0.9789450103725608, + "normalized_load_entropy": 0.8752357036642809, + "max_load_share": 0.059027777777777776 + } + }, + "s1_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "b8f4cadc4b17a0036b8a4ac6d321f6e23f3c13d52c42d0176c244895ba5cf63c", + "route_weight_sha256": "03a6a81dd4f0f0fc77cd98fd5172b3a051d73016e95c1f0884a2eed90240a094", + "loads": [ + 4, + 1, + 6, + 2, + 2, + 4, + 0, + 0, + 0, + 8, + 1, + 3, + 3, + 3, + 0, + 0, + 4, + 0, + 3, + 2, + 0, + 1, + 2, + 8, + 3, + 1, + 1, + 1, + 0, + 1, + 2, + 3, + 0, + 0, + 2, + 1, + 4, + 8, + 4, + 0, + 4, + 0, + 4, + 7, + 0, + 0, + 0, + 2, + 11, + 2, + 0, + 1, + 0, + 6, + 1, + 0, + 2, + 2, + 3, + 0, + 0, + 2, + 2, + 1 + ], + "weighted_loads": [ + 0.6587041057646275, + 0.03402615338563919, + 0.8795119933784008, + 0.12084685638546944, + 0.07062732428312302, + 0.25610051676630974, + 0.0, + 0.0, + 0.0, + 0.4087498262524605, + 0.04404301568865776, + 0.3655739203095436, + 0.10940605401992798, + 0.10607654601335526, + 0.0, + 0.0, + 0.3518891856074333, + 0.0, + 0.3065220043063164, + 0.077216025441885, + 0.0, + 0.063129723072052, + 0.24712420627474785, + 0.7026169970631599, + 0.2336104642599821, + 0.03628971055150032, + 0.03210681676864624, + 0.039302270859479904, + 0.0, + 0.058769341558218, + 0.07907300442457199, + 0.526682011783123, + 0.0, + 0.0, + 0.10744349658489227, + 0.031126834452152252, + 0.212745800614357, + 0.5248695388436317, + 0.15719124674797058, + 0.0, + 0.4851516783237457, + 0.0, + 0.29505435936152935, + 0.323236171156168, + 0.0, + 0.0, + 0.0, + 0.08396457880735397, + 0.602970203384757, + 0.08655250072479248, + 0.0, + 0.022121433168649673, + 0.0, + 0.3826858885586262, + 0.018908098340034485, + 0.0, + 0.05743681453168392, + 0.08288122341036797, + 0.11875307559967041, + 0.0, + 0.0, + 0.06721284985542297, + 0.2507050782442093, + 0.029150601476430893 + ], + "unique_experts": 44, + "load_cv": 1.1157537955306833, + "normalized_load_entropy": 0.8538253384688114, + "max_load_share": 0.07971014492753623 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "19150c446fd2e8f9d943eb7e32b26660728fca6b7b084ad4730ab3000b8c92d2", + "route_weight_sha256": "74e67e68116752c649f055be3a1fcd743ef090aea2ce2fd2feaac18af2208629", + "loads": [ + 6, + 7, + 8, + 2, + 14, + 6, + 13, + 0, + 0, + 13, + 2, + 10, + 16, + 3, + 11, + 2, + 7, + 5, + 4, + 12, + 3, + 2, + 9, + 14, + 18, + 1, + 1, + 2, + 1, + 2, + 6, + 4, + 2, + 0, + 2, + 2, + 7, + 12, + 5, + 2, + 8, + 9, + 13, + 9, + 1, + 0, + 0, + 12, + 12, + 3, + 5, + 1, + 3, + 17, + 6, + 0, + 4, + 4, + 13, + 2, + 2, + 10, + 11, + 3 + ], + "weighted_loads": [ + 0.6844277707859874, + 0.3800745513290167, + 0.9393401611596346, + 0.12084685638546944, + 1.5989125035703182, + 0.34646136593073606, + 0.6180587355047464, + 0.0, + 0.0, + 0.6810807660222054, + 0.11129295453429222, + 1.0904664918780327, + 0.829903582111001, + 0.10607654601335526, + 0.8242838401347399, + 0.10909751802682877, + 0.7407601475715637, + 0.22963744588196278, + 0.4056851789355278, + 0.6195323131978512, + 0.30281495302915573, + 0.1181044951081276, + 0.5197015888988972, + 0.8968285489827394, + 1.6311981305480003, + 0.03628971055150032, + 0.03210681676864624, + 0.09211746603250504, + 0.037839457392692566, + 0.09262870997190475, + 0.22543152421712875, + 0.572459202259779, + 0.08712287619709969, + 0.0, + 0.10744349658489227, + 0.09501035511493683, + 0.2975338543765247, + 0.7110203225165606, + 0.2018304504454136, + 0.10391071438789368, + 0.5857243379577994, + 0.5060016959905624, + 0.9884489141404629, + 0.39299966767430305, + 0.010698859579861164, + 0.0, + 0.0, + 0.7501357458531857, + 0.6368332114070654, + 0.1281174123287201, + 0.33654822781682014, + 0.022121433168649673, + 0.14570153132081032, + 1.2770630531013012, + 1.726111862808466, + 0.0, + 0.13810979016125202, + 0.1707298755645752, + 0.611197791993618, + 0.06596613861620426, + 0.0975300744175911, + 0.43051553145051, + 0.9764638170599937, + 0.19443507120013237 + ], + "unique_experts": 58, + "load_cv": 0.8202091535428969, + "normalized_load_entropy": 0.9137335650576329, + "max_load_share": 0.046875 + } + }, + "s0_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "bc7a1ab686a5a4dd3db40e0f06d24812559d860d2a8fe2848eb23b3c609fea92", + "route_weight_sha256": "5260fb0474ca08c89b7860594ee4515474e2a138fb43fd029536f1469f067fe1", + "loads": [ + 3, + 2, + 6, + 2, + 2, + 5, + 0, + 0, + 0, + 9, + 1, + 4, + 1, + 2, + 0, + 0, + 4, + 0, + 3, + 4, + 0, + 1, + 2, + 8, + 3, + 1, + 1, + 2, + 0, + 1, + 2, + 3, + 0, + 0, + 2, + 0, + 5, + 8, + 3, + 0, + 4, + 0, + 4, + 7, + 0, + 0, + 0, + 2, + 11, + 2, + 0, + 1, + 0, + 5, + 1, + 0, + 1, + 2, + 4, + 0, + 0, + 2, + 2, + 0 + ], + "weighted_loads": [ + 0.6051038354635239, + 0.061883678659796715, + 0.8987884595990181, + 0.1226525790989399, + 0.07531701400876045, + 0.3057856373488903, + 0.0, + 0.0, + 0.0, + 0.4467372000217438, + 0.04043756052851677, + 0.41332845389842987, + 0.038882240653038025, + 0.07829601690173149, + 0.0, + 0.0, + 0.36281854286789894, + 0.0, + 0.3292570449411869, + 0.14448197931051254, + 0.0, + 0.05990444868803024, + 0.2537076659500599, + 0.7030132934451103, + 0.2269587330520153, + 0.03757975250482559, + 0.03145705536007881, + 0.08103147149085999, + 0.0, + 0.05191725119948387, + 0.09600698575377464, + 0.5341947674751282, + 0.0, + 0.0, + 0.09873934835195541, + 0.0, + 0.23788496479392052, + 0.5153224393725395, + 0.12288413569331169, + 0.0, + 0.5036722794175148, + 0.0, + 0.3081339821219444, + 0.3340011052787304, + 0.0, + 0.0, + 0.0, + 0.08902617171406746, + 0.6033029668033123, + 0.08407589793205261, + 0.0, + 0.024722103029489517, + 0.0, + 0.3461950719356537, + 0.0181931983679533, + 0.0, + 0.024289604276418686, + 0.08112015575170517, + 0.14133375883102417, + 0.0, + 0.0, + 0.0645104181021452, + 0.2471235692501068, + 0.0 + ], + "unique_experts": 42, + "load_cv": 1.151330472432995, + "normalized_load_entropy": 0.8437544490634522, + "max_load_share": 0.07971014492753623 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "6c0646630e43193bebb7823a79537f31ff34aba3f5e3aaa7026333360df78ba8", + "route_weight_sha256": "5660774bac1b78919081f3fb1558b8bd54db247370b99bd2c47e366fbc552875", + "loads": [ + 4, + 4, + 7, + 2, + 6, + 7, + 9, + 0, + 0, + 12, + 1, + 4, + 10, + 6, + 5, + 0, + 7, + 1, + 3, + 11, + 0, + 1, + 8, + 15, + 13, + 1, + 2, + 4, + 0, + 5, + 8, + 3, + 0, + 0, + 2, + 4, + 6, + 15, + 5, + 0, + 6, + 4, + 12, + 8, + 1, + 1, + 0, + 5, + 14, + 2, + 0, + 2, + 0, + 9, + 5, + 0, + 2, + 2, + 9, + 0, + 1, + 5, + 9, + 0 + ], + "weighted_loads": [ + 0.6447587087750435, + 0.21233120001852512, + 0.9233006443828344, + 0.1226525790989399, + 0.6490850057452917, + 0.34837537351995707, + 0.3739784490317106, + 0.0, + 0.0, + 0.6398271061480045, + 0.04043756052851677, + 0.41332845389842987, + 0.6269713640213013, + 0.2505421116948128, + 0.4464610479772091, + 0.0, + 0.4801640212535858, + 0.7346652150154114, + 0.3292570449411869, + 0.7123915813863277, + 0.0, + 0.05990444868803024, + 0.476729366928339, + 0.9678505826741457, + 1.3226262349635363, + 0.03757975250482559, + 0.06919891759753227, + 0.16893108189105988, + 0.0, + 0.21460992470383644, + 0.32184695079922676, + 0.5341947674751282, + 0.0, + 0.0, + 0.09873934835195541, + 0.2078607678413391, + 0.27346711605787277, + 0.8409666381776333, + 0.19676361605525017, + 0.0, + 0.5618610791862011, + 0.20119856670498848, + 0.8963555097579956, + 0.3907991833984852, + 0.010698859579861164, + 0.027725186198949814, + 0.0, + 0.32511482015252113, + 0.7238005883991718, + 0.08407589793205261, + 0.0, + 0.038917627185583115, + 0.0, + 0.6346309147775173, + 0.7742900345474482, + 0.0, + 0.04821726493537426, + 0.08112015575170517, + 0.3758498653769493, + 0.0, + 0.06529590487480164, + 0.24604577757418156, + 0.79642797075212, + 0.0 + ], + "unique_experts": 50, + "load_cv": 0.9354143466934853, + "normalized_load_entropy": 0.8846831002592069, + "max_load_share": 0.052083333333333336 + } + }, + "s1_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "4dbf16a0a4ddf06d6b36945e44ff8bde478ecac9fdb5f10e142d45843a879d1d", + "route_weight_sha256": "585415e67a0e320ce574d3b7f9e8aad87ed34d19ee77a4b8b518046d3e4176e8", + "loads": [ + 3, + 2, + 6, + 2, + 2, + 4, + 0, + 0, + 0, + 9, + 1, + 4, + 2, + 1, + 0, + 0, + 4, + 0, + 3, + 3, + 0, + 1, + 2, + 8, + 3, + 1, + 1, + 1, + 0, + 1, + 2, + 3, + 0, + 0, + 2, + 1, + 4, + 9, + 3, + 0, + 4, + 1, + 4, + 7, + 0, + 0, + 0, + 2, + 9, + 2, + 0, + 1, + 0, + 6, + 1, + 0, + 4, + 2, + 3, + 0, + 0, + 2, + 2, + 0 + ], + "weighted_loads": [ + 0.6144108548760414, + 0.062105750665068626, + 0.8910941183567047, + 0.13332891464233398, + 0.0737970806658268, + 0.2617810033261776, + 0.0, + 0.0, + 0.0, + 0.4313758332282305, + 0.03964348882436752, + 0.4079281613230705, + 0.07391911000013351, + 0.0414501391351223, + 0.0, + 0.0, + 0.35717592015862465, + 0.0, + 0.3277605511248112, + 0.11006233096122742, + 0.0, + 0.062278252094984055, + 0.24481341615319252, + 0.701940905302763, + 0.247888321056962, + 0.036815885454416275, + 0.03433815389871597, + 0.039676398038864136, + 0.0, + 0.0493665374815464, + 0.08376059681177139, + 0.5186027102172375, + 0.0, + 0.0, + 0.09083367139101028, + 0.03251950070261955, + 0.21111249923706055, + 0.5548931639641523, + 0.11922405660152435, + 0.0, + 0.5125422142446041, + 0.0330730676651001, + 0.27662408724427223, + 0.32913822308182716, + 0.0, + 0.0, + 0.0, + 0.08954323828220367, + 0.5416253581643105, + 0.08261658065021038, + 0.0, + 0.02175481803715229, + 0.0, + 0.39233944937586784, + 0.02195240557193756, + 0.0, + 0.1191549189388752, + 0.08200370520353317, + 0.11053233593702316, + 0.0, + 0.0, + 0.06919736787676811, + 0.25553031265735626, + 0.0 + ], + "unique_experts": 44, + "load_cv": 1.106680939165942, + "normalized_load_entropy": 0.8543878659640624, + "max_load_share": 0.06521739130434782 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "cf7bb16cfccb8a0714e28a8f736135b0befd9b95981be1a8d6a261a30aeed8ed", + "route_weight_sha256": "6b5b906168a5df5c131074d168f98a05a77974c49b9f5b18a2f3acc788557dc2", + "loads": [ + 4, + 7, + 9, + 2, + 14, + 6, + 11, + 0, + 0, + 16, + 2, + 11, + 15, + 3, + 11, + 2, + 7, + 5, + 4, + 14, + 3, + 2, + 8, + 12, + 17, + 1, + 1, + 2, + 1, + 2, + 7, + 4, + 2, + 0, + 2, + 3, + 7, + 13, + 4, + 3, + 7, + 10, + 13, + 10, + 1, + 0, + 0, + 11, + 10, + 3, + 5, + 1, + 3, + 17, + 5, + 0, + 6, + 4, + 13, + 2, + 3, + 10, + 11, + 2 + ], + "weighted_loads": [ + 0.635764030739665, + 0.3749669808894396, + 0.987288786098361, + 0.13332891464233398, + 1.5640708729624748, + 0.3521418524906039, + 0.555755378678441, + 0.0, + 0.0, + 0.7583762463182211, + 0.10689342767000198, + 1.1328207328915596, + 0.8047948610037565, + 0.1211177334189415, + 0.8244481738656759, + 0.10909751802682877, + 0.746046882122755, + 0.22963744588196278, + 0.4269237257540226, + 0.9076575934886932, + 0.30281495302915573, + 0.11725302413105965, + 0.4793288856744766, + 0.8469912465661764, + 1.617544511333108, + 0.036815885454416275, + 0.03433815389871597, + 0.09249159321188927, + 0.037839457392692566, + 0.08322590589523315, + 0.2766817808151245, + 0.5643799006938934, + 0.08712287619709969, + 0.0, + 0.09083367139101028, + 0.18910961225628853, + 0.3278980180621147, + 0.7496931441128254, + 0.16386326029896736, + 0.14122385904192924, + 0.6031871102750301, + 0.5197908878326416, + 0.9700186420232058, + 0.43131518363952637, + 0.010698859579861164, + 0.0, + 0.0, + 0.6983315795660019, + 0.5754883661866188, + 0.12418149225413799, + 0.33654822781682014, + 0.02175481803715229, + 0.14570153132081032, + 1.218342136591673, + 0.7876596190035343, + 0.0, + 0.1998278945684433, + 0.1698523573577404, + 0.6062993854284286, + 0.06596613861620426, + 0.13836617022752762, + 0.43250004947185516, + 0.9812890514731407, + 0.16528446972370148 + ], + "unique_experts": 58, + "load_cv": 0.814367511903836, + "normalized_load_entropy": 0.914948165735184, + "max_load_share": 0.044270833333333336 + } + }, + "s0_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "72915e6078a7ca932ad253a8d274d6713ed407ce0f74b8dcad29853f02379386", + "route_weight_sha256": "b474f7d7f6013e946c2e2e3888f1619295cc600cff7fcc3a3d1b46b80b6066ea", + "loads": [ + 3, + 1, + 6, + 2, + 2, + 4, + 0, + 1, + 0, + 9, + 1, + 4, + 1, + 1, + 0, + 0, + 4, + 0, + 3, + 3, + 0, + 1, + 2, + 8, + 3, + 1, + 1, + 3, + 0, + 1, + 2, + 3, + 0, + 0, + 2, + 0, + 4, + 9, + 2, + 0, + 4, + 1, + 4, + 7, + 1, + 0, + 0, + 2, + 11, + 1, + 0, + 1, + 0, + 5, + 1, + 0, + 4, + 2, + 4, + 0, + 0, + 1, + 2, + 0 + ], + "weighted_loads": [ + 0.6133749969303608, + 0.031107766553759575, + 0.8834726326167583, + 0.1352321095764637, + 0.07293512299656868, + 0.25154589489102364, + 0.0, + 0.047769419848918915, + 0.0, + 0.4549630433320999, + 0.04431411251425743, + 0.3852194119244814, + 0.03770051896572113, + 0.04244692996144295, + 0.0, + 0.0, + 0.3649686463177204, + 0.0, + 0.33396684005856514, + 0.11131475120782852, + 0.0, + 0.07039155811071396, + 0.26369910687208176, + 0.7003198899328709, + 0.21696674451231956, + 0.03435967117547989, + 0.031674087047576904, + 0.10536610707640648, + 0.0, + 0.05307186767458916, + 0.0917912907898426, + 0.5710277669131756, + 0.0, + 0.0, + 0.10271556675434113, + 0.0, + 0.20467808097600937, + 0.5174182672053576, + 0.0802199337631464, + 0.0, + 0.4590310715138912, + 0.03267207741737366, + 0.2961467355489731, + 0.3298250772058964, + 0.030666302889585495, + 0.0, + 0.0, + 0.09170486405491829, + 0.6098438426852226, + 0.05381297692656517, + 0.0, + 0.022283362224698067, + 0.0, + 0.34787189215421677, + 0.019344769418239594, + 0.0, + 0.11925291642546654, + 0.08393282443284988, + 0.14488647133111954, + 0.0, + 0.0, + 0.036906708031892776, + 0.26401618123054504, + 0.0 + ], + "unique_experts": 45, + "load_cv": 1.1484078455453641, + "normalized_load_entropy": 0.8509224061090189, + "max_load_share": 0.07971014492753623 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "053f78410e1d54a277635dfece83ed990d6631b09584aa93da601faf9cb26123", + "route_weight_sha256": "dd7d587a802521ffc8dc9d9e689b90e9bd767c0a8a4aa3f88311faa381947c54", + "loads": [ + 5, + 2, + 7, + 2, + 7, + 7, + 10, + 1, + 0, + 12, + 1, + 4, + 12, + 3, + 6, + 0, + 7, + 0, + 3, + 9, + 0, + 1, + 8, + 15, + 12, + 1, + 1, + 4, + 0, + 5, + 7, + 3, + 0, + 0, + 3, + 2, + 4, + 15, + 4, + 0, + 7, + 5, + 13, + 9, + 2, + 0, + 0, + 6, + 12, + 1, + 0, + 1, + 0, + 10, + 5, + 0, + 4, + 2, + 11, + 0, + 2, + 5, + 10, + 0 + ], + "weighted_loads": [ + 0.6983919739723206, + 0.1204617377370596, + 0.9079848174005747, + 0.1352321095764637, + 0.8112519886344671, + 0.3899381095543504, + 0.43083389662206173, + 0.047769419848918915, + 0.0, + 0.6358977295458317, + 0.04431411251425743, + 0.3852194119244814, + 0.8115314617753029, + 0.12655017897486687, + 0.5124606117606163, + 0.0, + 0.4823141247034073, + 0.0, + 0.33396684005856514, + 0.4736666865646839, + 0.0, + 0.07039155811071396, + 0.49350185319781303, + 0.9595171827822924, + 1.0681251790374517, + 0.03435967117547989, + 0.031674087047576904, + 0.142607431858778, + 0.0, + 0.21576454117894173, + 0.2779315672814846, + 0.5710277669131756, + 0.0, + 0.0, + 0.14843594282865524, + 0.15030799433588982, + 0.20467808097600937, + 0.7636211793869734, + 0.15409941412508488, + 0.0, + 0.5659589804708958, + 0.26581884548068047, + 1.0367702022194862, + 0.43164490535855293, + 0.04136516246944666, + 0.0, + 0.0, + 0.4131983853876591, + 0.6492566429078579, + 0.05381297692656517, + 0.0, + 0.022283362224698067, + 0.0, + 0.6308614909648895, + 0.7754416055977345, + 0.0, + 0.11925291642546654, + 0.08393282443284988, + 0.47670161724090576, + 0.0, + 0.11078616604208946, + 0.24709532782435417, + 0.8610307369381189, + 0.0 + ], + "unique_experts": 49, + "load_cv": 0.9558139185602919, + "normalized_load_entropy": 0.878924372906931, + "max_load_share": 0.052083333333333336 + } + }, + "s1_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "eb99dfad916ca63d87eb192225b880b0ce5e2d288185e547e67124cd0eb81cb7", + "route_weight_sha256": "ec355a95f585bc82e607dd4813d89c7da759096a0d44ccc0c3072c9275cfd932", + "loads": [ + 3, + 1, + 6, + 2, + 2, + 3, + 0, + 1, + 0, + 9, + 1, + 3, + 2, + 1, + 0, + 0, + 4, + 0, + 3, + 4, + 0, + 1, + 2, + 8, + 3, + 1, + 1, + 2, + 0, + 1, + 2, + 3, + 0, + 0, + 2, + 1, + 4, + 8, + 2, + 0, + 5, + 1, + 4, + 7, + 0, + 0, + 0, + 2, + 10, + 2, + 0, + 1, + 0, + 5, + 1, + 0, + 4, + 3, + 4, + 0, + 0, + 1, + 2, + 0 + ], + "weighted_loads": [ + 0.6326430663466454, + 0.03134315088391304, + 0.8919882066547871, + 0.12666676193475723, + 0.06551829725503922, + 0.2198614403605461, + 0.0, + 0.05289694666862488, + 0.0, + 0.4347359500825405, + 0.03684726357460022, + 0.3507115915417671, + 0.0776890367269516, + 0.0395258329808712, + 0.0, + 0.0, + 0.3393794633448124, + 0.0, + 0.3175617456436157, + 0.15067562460899353, + 0.0, + 0.07136181741952896, + 0.2555161193013191, + 0.7379993312060833, + 0.19990910217165947, + 0.035215020179748535, + 0.03093658573925495, + 0.06627878732979298, + 0.0, + 0.055079422891139984, + 0.07644962146878242, + 0.5300653241574764, + 0.0, + 0.0, + 0.09881719201803207, + 0.03661973029375076, + 0.20107705518603325, + 0.5054773632436991, + 0.08701702579855919, + 0.0, + 0.48567733727395535, + 0.0355818048119545, + 0.28055921010673046, + 0.3328012749552727, + 0.0, + 0.0, + 0.0, + 0.08882647007703781, + 0.5845638643950224, + 0.08345122635364532, + 0.0, + 0.0211509820073843, + 0.0, + 0.37142159417271614, + 0.020105969160795212, + 0.0, + 0.13082259520888329, + 0.12002714537084103, + 0.15497082099318504, + 0.0, + 0.0, + 0.03525669500231743, + 0.24646250158548355, + 0.0 + ], + "unique_experts": 45, + "load_cv": 1.103640079043242, + "normalized_load_entropy": 0.8569601644333151, + "max_load_share": 0.07246376811594203 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "e63cd4729620666f9a1ffebadde91f1eb3bd1b8433586db5e9e42816ac51139b", + "route_weight_sha256": "3875b5965ba124bfdc3559514aaa087d27768536cf32d2dfb26396345a41ed92", + "loads": [ + 4, + 7, + 8, + 2, + 14, + 6, + 11, + 1, + 0, + 14, + 2, + 10, + 17, + 1, + 12, + 2, + 7, + 6, + 4, + 11, + 3, + 2, + 9, + 12, + 15, + 1, + 1, + 3, + 1, + 2, + 7, + 4, + 3, + 0, + 2, + 2, + 6, + 11, + 3, + 2, + 7, + 11, + 14, + 9, + 1, + 0, + 0, + 13, + 11, + 3, + 5, + 1, + 3, + 15, + 5, + 0, + 7, + 5, + 16, + 2, + 3, + 11, + 12, + 2 + ], + "weighted_loads": [ + 0.653996242210269, + 0.3651170991361141, + 0.9518163744360209, + 0.12666676193475723, + 1.514225285500288, + 0.3515909155830741, + 0.5216857511550188, + 0.05289694666862488, + 0.0, + 0.6869630850851536, + 0.10409720242023468, + 1.0756041631102562, + 0.9382433351129293, + 0.0395258329808712, + 0.8819666411727667, + 0.10909751802682877, + 0.7282504253089428, + 0.2650835905224085, + 0.41672492027282715, + 0.5208819359540939, + 0.30281495302915573, + 0.12633658945560455, + 0.5256709195673466, + 0.8830496724694967, + 1.122458167374134, + 0.035215020179748535, + 0.03093658573925495, + 0.11909398250281811, + 0.037839457392692566, + 0.08893879130482674, + 0.24874141067266464, + 0.5758425146341324, + 0.12405594438314438, + 0.0, + 0.09881719201803207, + 0.1313646286725998, + 0.2819298319518566, + 0.6228577755391598, + 0.1316562294960022, + 0.10391071438789368, + 0.5389082487672567, + 0.6208491101861, + 1.1622583232820034, + 0.41172271594405174, + 0.010698859579861164, + 0.0, + 0.0, + 0.8282277546823025, + 0.6184268724173307, + 0.12501613795757294, + 0.33654822781682014, + 0.0211509820073843, + 0.14570153132081032, + 1.185015108436346, + 0.785813182592392, + 0.0, + 0.26000766828656197, + 0.20787579752504826, + 0.7375849708914757, + 0.06596613861620426, + 0.14551981166005135, + 0.5051090568304062, + 1.0599238872528076, + 0.16528446972370148 + ], + "unique_experts": 59, + "load_cv": 0.8116983224490899, + "normalized_load_entropy": 0.9155201571140837, + "max_load_share": 0.044270833333333336 + } + }, + "s0_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "a238dbdfdbc325497c11cf2ea9c8566f72bc72e2be748973a422efbee06c200a", + "route_weight_sha256": "8f50c44291c271054d096ff9a7531afd6f0b52bc8086282b9804c3fb87d39f66", + "loads": [ + 3, + 1, + 6, + 2, + 2, + 4, + 0, + 1, + 0, + 9, + 1, + 3, + 1, + 2, + 0, + 0, + 4, + 0, + 3, + 3, + 0, + 1, + 2, + 9, + 3, + 1, + 1, + 3, + 0, + 1, + 2, + 3, + 0, + 0, + 2, + 0, + 4, + 9, + 2, + 0, + 4, + 1, + 4, + 7, + 0, + 0, + 0, + 2, + 11, + 1, + 0, + 1, + 0, + 5, + 1, + 0, + 3, + 3, + 4, + 0, + 0, + 1, + 2, + 0 + ], + "weighted_loads": [ + 0.6182322278618813, + 0.03157169744372368, + 0.8799734376370907, + 0.12748434394598007, + 0.07579077780246735, + 0.24579168111085892, + 0.0, + 0.045993149280548096, + 0.0, + 0.4513077363371849, + 0.04508436843752861, + 0.34997719526290894, + 0.03735068067908287, + 0.07264857366681099, + 0.0, + 0.0, + 0.3707733117043972, + 0.0, + 0.32181979715824127, + 0.11061498895287514, + 0.0, + 0.0725758820772171, + 0.26502589508891106, + 0.7435443587601185, + 0.21355674788355827, + 0.034830257296562195, + 0.03125777840614319, + 0.10781454481184483, + 0.0, + 0.054690077900886536, + 0.09326599165797234, + 0.550864627584815, + 0.0, + 0.0, + 0.09996026009321213, + 0.0, + 0.21090930327773094, + 0.5379456114023924, + 0.08052652142941952, + 0.0, + 0.4616791531443596, + 0.033093322068452835, + 0.3104517385363579, + 0.31698233634233475, + 0.0, + 0.0, + 0.0, + 0.09259431809186935, + 0.6213510781526566, + 0.05394071713089943, + 0.0, + 0.021527977660298347, + 0.0, + 0.3486927002668381, + 0.016279833391308784, + 0.0, + 0.08859358169138432, + 0.11222041584551334, + 0.1422015205025673, + 0.0, + 0.0, + 0.03536351025104523, + 0.26025518774986267, + 0.0 + ], + "unique_experts": 44, + "load_cv": 1.1629475331773722, + "normalized_load_entropy": 0.8475480250468557, + "max_load_share": 0.07971014492753623 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "a31a027abfffa576e3e08d0b007e9845eb00335cdf9bd958b0f9dae08a29dd6b", + "route_weight_sha256": "7529ec9691fdf1585ca1917d0d3fc6b377e0cf7b400f643c5e198cb88554e13f", + "loads": [ + 5, + 3, + 7, + 2, + 7, + 7, + 9, + 1, + 0, + 12, + 1, + 3, + 11, + 4, + 6, + 0, + 7, + 0, + 4, + 9, + 0, + 1, + 8, + 17, + 13, + 1, + 1, + 4, + 0, + 5, + 8, + 3, + 0, + 0, + 3, + 2, + 5, + 16, + 4, + 0, + 7, + 5, + 12, + 8, + 1, + 0, + 0, + 7, + 12, + 1, + 0, + 1, + 0, + 8, + 5, + 0, + 3, + 3, + 9, + 0, + 2, + 6, + 9, + 0 + ], + "weighted_loads": [ + 0.7096449360251427, + 0.16308299452066422, + 0.904485622420907, + 0.12748434394598007, + 0.9718666542321444, + 0.3625274794176221, + 0.3739784490317106, + 0.045993149280548096, + 0.0, + 0.632177647203207, + 0.04508436843752861, + 0.34997719526290894, + 0.6980543993413448, + 0.1570047326385975, + 0.5420284904539585, + 0.0, + 0.4881187900900841, + 0.0, + 0.3630540557205677, + 0.49653350561857224, + 0.0, + 0.0725758820772171, + 0.48364848271012306, + 1.0297822132706642, + 1.1071187946945429, + 0.034830257296562195, + 0.03125777840614319, + 0.14505586959421635, + 0.0, + 0.2173827514052391, + 0.3274209462106228, + 0.550864627584815, + 0.0, + 0.0, + 0.15571549162268639, + 0.13296235725283623, + 0.26006679981946945, + 0.837385157123208, + 0.154406001791358, + 0.0, + 0.5670675709843636, + 0.25501393154263496, + 0.8986732661724091, + 0.37378041446208954, + 0.010698859579861164, + 0.0, + 0.0, + 0.4872001186013222, + 0.6607638783752918, + 0.05394071713089943, + 0.0, + 0.021527977660298347, + 0.0, + 0.5964952483773232, + 0.7723766695708036, + 0.0, + 0.08859358169138432, + 0.11222041584551334, + 0.37671762704849243, + 0.0, + 0.10372477024793625, + 0.3275263961404562, + 0.8095595892518759, + 0.0 + ], + "unique_experts": 49, + "load_cv": 0.9541980020732037, + "normalized_load_entropy": 0.8799827163050711, + "max_load_share": 0.059027777777777776 + } + }, + "s1_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "bfa01c1dc92ad4b42d44d81d94e321035d83d873228a3af1179f24feb4060eec", + "route_weight_sha256": "41aea2ee0f39beecc1e1b39c8b6cac4816f29903eaf1feffd34f02c5d59e546b", + "loads": [ + 3, + 1, + 6, + 2, + 2, + 3, + 0, + 2, + 0, + 8, + 1, + 3, + 5, + 1, + 0, + 0, + 3, + 0, + 3, + 5, + 0, + 1, + 2, + 8, + 3, + 1, + 1, + 2, + 0, + 1, + 1, + 2, + 0, + 0, + 2, + 1, + 4, + 8, + 3, + 0, + 4, + 1, + 4, + 7, + 0, + 0, + 0, + 2, + 10, + 1, + 0, + 1, + 0, + 5, + 1, + 0, + 3, + 3, + 4, + 0, + 1, + 1, + 2, + 0 + ], + "weighted_loads": [ + 0.6371214985847473, + 0.03208102285861969, + 0.8593041114509106, + 0.12446238100528717, + 0.0661827102303505, + 0.22080225124955177, + 0.0, + 0.09551145136356354, + 0.0, + 0.3954213708639145, + 0.03747217357158661, + 0.33363645523786545, + 0.18428926169872284, + 0.03659279644489288, + 0.0, + 0.0, + 0.2906476780772209, + 0.0, + 0.3209196999669075, + 0.19171461835503578, + 0.0, + 0.07250427454710007, + 0.2557253874838352, + 0.7361804489046335, + 0.19451066851615906, + 0.03304395079612732, + 0.031124083325266838, + 0.07012498751282692, + 0.0, + 0.0536126047372818, + 0.03864268213510513, + 0.49788743257522583, + 0.0, + 0.0, + 0.09889642521739006, + 0.03530140593647957, + 0.20578504726290703, + 0.5103027913719416, + 0.1144106574356556, + 0.0, + 0.4504630118608475, + 0.036462511867284775, + 0.28406017646193504, + 0.3262147158384323, + 0.0, + 0.0, + 0.0, + 0.08937940374016762, + 0.5783348809927702, + 0.0567166805267334, + 0.0, + 0.020405784249305725, + 0.0, + 0.36705026775598526, + 0.01844264194369316, + 0.0, + 0.10093751363456249, + 0.12362335249781609, + 0.1542002446949482, + 0.0, + 0.030670544132590294, + 0.035372376441955566, + 0.24884210526943207, + 0.0 + ], + "unique_experts": 46, + "load_cv": 1.0852159977694509, + "normalized_load_entropy": 0.8610784126630459, + "max_load_share": 0.07246376811594203 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "717962f5412a161a1c4ff06c8465ec1dc6e4e622dba3dcf257e074b728b7d1c8", + "route_weight_sha256": "0e67e4bdd62e9352fce893fe8b379bba72270d39004493ffc584fd77adfafda3", + "loads": [ + 4, + 5, + 8, + 2, + 14, + 6, + 10, + 2, + 0, + 13, + 2, + 10, + 19, + 1, + 13, + 2, + 6, + 5, + 4, + 14, + 3, + 2, + 8, + 12, + 15, + 1, + 1, + 3, + 1, + 2, + 5, + 3, + 2, + 0, + 3, + 2, + 6, + 10, + 4, + 3, + 7, + 11, + 14, + 10, + 1, + 0, + 0, + 14, + 11, + 2, + 5, + 1, + 3, + 16, + 5, + 0, + 6, + 5, + 14, + 2, + 5, + 12, + 12, + 2 + ], + "weighted_loads": [ + 0.6584746744483709, + 0.27714939042925835, + 0.9191322792321444, + 0.12446238100528717, + 1.5908092968165874, + 0.3572180299088359, + 0.48777581192553043, + 0.09551145136356354, + 0.0, + 0.6688849925994873, + 0.10472211241722107, + 1.0585290268063545, + 0.9451977144926786, + 0.03659279644489288, + 0.8555651511996984, + 0.10909751802682877, + 0.6795186400413513, + 0.22963744588196278, + 0.4200828745961189, + 0.6418798752129078, + 0.30281495302915573, + 0.12747904658317566, + 0.4902408570051193, + 0.881230790168047, + 1.1514040157198906, + 0.03304395079612732, + 0.031124083325266838, + 0.12294018268585205, + 0.037839457392692566, + 0.08747197315096855, + 0.18013301491737366, + 0.5436646230518818, + 0.08712287619709969, + 0.0, + 0.15650631859898567, + 0.12156214937567711, + 0.2866378240287304, + 0.5852296203374863, + 0.1590498611330986, + 0.14932414516806602, + 0.5504860877990723, + 0.6219414919614792, + 1.0147965867072344, + 0.44369130581617355, + 0.010698859579861164, + 0.0, + 0.0, + 0.9342226311564445, + 0.6121978890150785, + 0.09828159213066101, + 0.33654822781682014, + 0.020405784249305725, + 0.14570153132081032, + 1.2487399280071259, + 0.7841498553752899, + 0.0, + 0.23011370934545994, + 0.21147200465202332, + 0.6551486290991306, + 0.06596613861620426, + 0.21465525962412357, + 0.5396800115704536, + 1.017473865300417, + 0.16528446972370148 + ], + "unique_experts": 59, + "load_cv": 0.8275843360850502, + "normalized_load_entropy": 0.9145202600409903, + "max_load_share": 0.049479166666666664 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.9254658385093167, + "mean_token_weighted_tv": 0.01672587960796512, + "aggregate_load_tv": 0.04347826086956521 + }, + "system_bos": { + "tokens": 23, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.9037267080745341, + "mean_token_weighted_tv": 0.020861808089134487, + "aggregate_load_tv": 0.057971014492753624 + }, + "system_x": { + "tokens": 23, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.9037267080745341, + "mean_token_weighted_tv": 0.02356729862968559, + "aggregate_load_tv": 0.043478260869565216 + }, + "system_period": { + "tokens": 23, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8788819875776398, + "mean_token_weighted_tv": 0.028745769887514736, + "aggregate_load_tv": 0.07246376811594202 + }, + "bos_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.9161490683229815, + "mean_token_weighted_tv": 0.02329295355340709, + "aggregate_load_tv": 0.05072463768115941 + }, + "bos_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.9037267080745341, + "mean_token_weighted_tv": 0.021335482030459072, + "aggregate_load_tv": 0.057971014492753624 + }, + "x_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.8913043478260869, + "mean_token_weighted_tv": 0.02939772889341997, + "aggregate_load_tv": 0.06521739130434782 + }, + "x_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 7, + "set_exact_tokens": 9, + "mean_set_jaccard": 0.8167701863354037, + "mean_token_weighted_tv": 0.037863729926555054, + "aggregate_load_tv": 0.07971014492753623 + }, + "period_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8881987577639753, + "mean_token_weighted_tv": 0.027123155274792858, + "aggregate_load_tv": 0.06521739130434781 + }, + "period_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 10, + "mean_set_jaccard": 0.8012422360248448, + "mean_token_weighted_tv": 0.04215998971915763, + "aggregate_load_tv": 0.09420289855072464 + } + } + }, + "layer_20": { + "layer": 20, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "e1890ef93331975dea0054a600434d76bbbb10a33d32306a2f5e6508c93cd7ed", + "route_weight_sha256": "ea3f0bc9d8162277aa63189b1ee8a6e249dc1a5f973b128464bd125235e8f255", + "loads": [ + 0, + 5, + 3, + 1, + 2, + 14, + 2, + 0, + 1, + 0, + 1, + 0, + 1, + 0, + 4, + 6, + 0, + 0, + 4, + 0, + 6, + 0, + 2, + 4, + 0, + 0, + 1, + 0, + 0, + 0, + 17, + 0, + 0, + 0, + 0, + 0, + 0, + 5, + 2, + 0, + 1, + 2, + 0, + 3, + 5, + 1, + 0, + 7, + 4, + 0, + 0, + 4, + 3, + 0, + 3, + 0, + 6, + 5, + 3, + 0, + 1, + 3, + 0, + 6 + ], + "weighted_loads": [ + 0.0, + 0.20858711004257202, + 0.14038385078310966, + 0.028584882616996765, + 0.06805029883980751, + 1.4599665813148022, + 0.32756859064102173, + 0.0, + 0.04660215601325035, + 0.0, + 0.039592597633600235, + 0.0, + 0.06144486740231514, + 0.0, + 0.3746849223971367, + 0.3360743448138237, + 0.0, + 0.0, + 0.32086509838700294, + 0.0, + 0.9045646674931049, + 0.0, + 0.07738704979419708, + 0.1737684179097414, + 0.0, + 0.0, + 0.03275316581130028, + 0.0, + 0.0, + 0.0, + 2.175302118062973, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.2625024989247322, + 0.7500719949603081, + 0.0, + 0.035766664892435074, + 0.10204468294978142, + 0.0, + 0.2880872040987015, + 0.2957311552017927, + 0.03849370777606964, + 0.0, + 0.6454856470227242, + 0.29855071753263474, + 0.0, + 0.0, + 0.25269750133156776, + 0.2711656019091606, + 0.0, + 0.13597098737955093, + 0.0, + 0.537693552672863, + 0.20750741474330425, + 0.13122425507754087, + 0.0, + 0.05446961522102356, + 0.21828200295567513, + 0.0, + 0.23057729378342628 + ], + "unique_experts": 35, + "load_cv": 1.4693536708498427, + "normalized_load_entropy": 0.7868696454624229, + "max_load_share": 0.12318840579710146 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "e0e2d50f48cf6c38efe16ee21fd2582b76fb267818ecf71a47de8ddc4ab3dd5d", + "route_weight_sha256": "d26379a5cacf3549ed9e923daf2180647dfcaa96526c3f538fc5090d8c65e133", + "loads": [ + 0, + 7, + 3, + 9, + 10, + 19, + 5, + 4, + 1, + 0, + 1, + 1, + 5, + 0, + 4, + 13, + 2, + 0, + 15, + 0, + 10, + 0, + 9, + 4, + 0, + 8, + 2, + 0, + 0, + 3, + 17, + 0, + 0, + 1, + 1, + 0, + 2, + 6, + 4, + 0, + 3, + 5, + 2, + 8, + 14, + 1, + 0, + 7, + 5, + 1, + 8, + 4, + 4, + 6, + 3, + 3, + 7, + 11, + 4, + 0, + 13, + 7, + 0, + 6 + ], + "weighted_loads": [ + 0.0, + 0.25339520908892155, + 0.14038385078310966, + 0.6307384930551052, + 0.4584187865257263, + 1.690124211832881, + 0.4122746717184782, + 0.2700131740421057, + 0.04660215601325035, + 0.0, + 0.039592597633600235, + 0.04104446992278099, + 0.1887125801295042, + 0.0, + 0.3746849223971367, + 0.7862918265163898, + 0.0633844118565321, + 0.0, + 1.2427891492843628, + 0.0, + 1.011521807871759, + 0.0, + 0.6691279038786888, + 0.1737684179097414, + 0.0, + 0.5976992771029472, + 0.05019340291619301, + 0.0, + 0.0, + 0.09337917156517506, + 2.175302118062973, + 0.0, + 0.0, + 0.023133913055062294, + 0.04430808871984482, + 0.0, + 0.04675983265042305, + 0.2963939532637596, + 2.068491391837597, + 0.0, + 0.11819710396230221, + 0.22430724650621414, + 0.16114728152751923, + 0.46109520306345075, + 0.6859824433922768, + 0.03849370777606964, + 0.0, + 0.6454856470227242, + 0.30019023921340704, + 0.04783610627055168, + 1.1783824004232883, + 0.25269750133156776, + 0.2991575803607702, + 0.29945426620543003, + 0.13597098737955093, + 0.47351210936903954, + 0.5982501544058323, + 0.39254978112876415, + 0.16970061790198088, + 0.0, + 1.356449052109383, + 0.4556705430150032, + 0.0, + 0.23057729378342628 + ], + "unique_experts": 48, + "load_cv": 1.0289032876362298, + "normalized_load_entropy": 0.8690531984237396, + "max_load_share": 0.06597222222222222 + } + }, + "s1_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "e11362a3b8df17c05d7848a69319eec437340f828fdf886df67eb3a908cf7016", + "route_weight_sha256": "3bc9d5fa43c72a24b21eea302c2a60dd6c96beabd904e4b6ba42b7eb43d253d9", + "loads": [ + 0, + 4, + 3, + 0, + 2, + 14, + 2, + 0, + 1, + 0, + 1, + 0, + 2, + 0, + 5, + 6, + 0, + 0, + 4, + 0, + 6, + 0, + 2, + 3, + 0, + 0, + 1, + 0, + 0, + 2, + 17, + 0, + 0, + 0, + 1, + 1, + 1, + 5, + 2, + 0, + 1, + 2, + 0, + 3, + 4, + 0, + 0, + 6, + 3, + 0, + 0, + 4, + 3, + 0, + 3, + 0, + 6, + 5, + 3, + 0, + 1, + 3, + 0, + 6 + ], + "weighted_loads": [ + 0.0, + 0.18249304220080376, + 0.13751644268631935, + 0.0, + 0.07205755263566971, + 1.4133851937949657, + 0.31844741106033325, + 0.0, + 0.037433281540870667, + 0.0, + 0.04000650718808174, + 0.0, + 0.08769451268017292, + 0.0, + 0.38956727646291256, + 0.36200692132115364, + 0.0, + 0.0, + 0.3131832629442215, + 0.0, + 0.8719008378684521, + 0.0, + 0.07325059920549393, + 0.14158659055829048, + 0.0, + 0.0, + 0.03314695134758949, + 0.0, + 0.0, + 0.06580585055053234, + 2.1540024019777775, + 0.0, + 0.0, + 0.0, + 0.028346674516797066, + 0.04628683626651764, + 0.039856307208538055, + 0.2589807063341141, + 0.746713750064373, + 0.0, + 0.037742454558610916, + 0.10589349269866943, + 0.0, + 0.2910141050815582, + 0.28449397534132004, + 0.0, + 0.0, + 0.6095287278294563, + 0.25811684131622314, + 0.0, + 0.0, + 0.260416429489851, + 0.2677256762981415, + 0.0, + 0.1362108178436756, + 0.0, + 0.5494678542017937, + 0.2041906639933586, + 0.13337111845612526, + 0.0, + 0.05924372747540474, + 0.2110660970211029, + 0.0, + 0.2271754089742899 + ], + "unique_experts": 37, + "load_cv": 1.4369768026808833, + "normalized_load_entropy": 0.7992386972983965, + "max_load_share": 0.12318840579710146 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "99896af2288054b97e07818f0f5884c7be1b83c57d9ac8b0d3a2bafbbc4e060c", + "route_weight_sha256": "40079edddcc8803bac6441a33f90ae7ef46ea77566f0ba103acf5374ceccf9b9", + "loads": [ + 5, + 6, + 3, + 11, + 10, + 21, + 4, + 9, + 1, + 2, + 3, + 0, + 3, + 1, + 6, + 19, + 5, + 0, + 14, + 1, + 12, + 1, + 12, + 5, + 1, + 14, + 2, + 2, + 0, + 8, + 17, + 0, + 1, + 1, + 5, + 3, + 4, + 9, + 5, + 4, + 6, + 4, + 2, + 11, + 18, + 1, + 0, + 6, + 5, + 5, + 13, + 4, + 3, + 9, + 4, + 10, + 8, + 12, + 5, + 2, + 14, + 5, + 1, + 6 + ], + "weighted_loads": [ + 0.2298794686794281, + 0.2267652042210102, + 0.13751644268631935, + 0.7635049037635326, + 0.49360860139131546, + 1.7150270491838455, + 0.39134123735129833, + 0.5908589251339436, + 0.037433281540870667, + 0.23566818982362747, + 0.1338542364537716, + 0.0, + 0.12776503153145313, + 0.2830076515674591, + 0.44832772947847843, + 1.2601510062813759, + 0.3002009764313698, + 0.0, + 1.2990237958729267, + 0.03974062204360962, + 1.0648618168197572, + 0.03480032458901405, + 0.8487626053392887, + 0.3124847002327442, + 0.01978174038231373, + 0.9256335683166981, + 0.050587188452482224, + 0.06125393509864807, + 0.0, + 0.2506658900529146, + 2.1540024019777775, + 0.0, + 0.04738996550440788, + 0.043310489505529404, + 0.21446917578577995, + 0.2240176908671856, + 0.14188593439757824, + 0.41792039945721626, + 2.1045240946114063, + 0.19981792569160461, + 0.24325821176171303, + 0.20033157244324684, + 0.14747050032019615, + 0.5999918424058706, + 1.1572078615427017, + 0.07283078879117966, + 0.0, + 0.6095287278294563, + 0.2933774795383215, + 0.3030273802578449, + 1.725354589521885, + 0.260416429489851, + 0.2677256762981415, + 0.3906014710664749, + 0.16233728639781475, + 1.048930585384369, + 0.6356063634157181, + 0.7434733659029007, + 0.20908261463046074, + 0.052520327270030975, + 1.479031590395607, + 0.3537936955690384, + 0.060637082904577255, + 0.2271754089742899 + ], + "unique_experts": 59, + "load_cv": 0.8559432743405891, + "normalized_load_entropy": 0.9123756123605103, + "max_load_share": 0.0546875 + } + }, + "s0_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "3c9a8800a95cb2ea4d1784c6f03916fc0c5b220883287308f783c444c1ccb5d4", + "route_weight_sha256": "cd1359026d5106a3f85d8ec32aa94149bd66b1ae2c09aa983cac62d56e401cd4", + "loads": [ + 0, + 5, + 3, + 0, + 2, + 14, + 2, + 1, + 2, + 0, + 1, + 0, + 1, + 0, + 5, + 6, + 0, + 1, + 3, + 0, + 6, + 0, + 2, + 4, + 0, + 0, + 1, + 0, + 0, + 0, + 17, + 0, + 0, + 0, + 1, + 0, + 1, + 5, + 2, + 0, + 1, + 2, + 0, + 3, + 5, + 0, + 0, + 6, + 4, + 0, + 0, + 3, + 3, + 0, + 4, + 0, + 6, + 3, + 3, + 0, + 1, + 4, + 0, + 5 + ], + "weighted_loads": [ + 0.0, + 0.23073218762874603, + 0.13468516618013382, + 0.0, + 0.07085716538131237, + 1.513420943170786, + 0.3160025179386139, + 0.025890599936246872, + 0.08727091550827026, + 0.0, + 0.03590361773967743, + 0.0, + 0.07405436038970947, + 0.0, + 0.3957118093967438, + 0.3420919291675091, + 0.0, + 0.04087061062455177, + 0.27383696287870407, + 0.0, + 0.9326566122472286, + 0.0, + 0.08315156400203705, + 0.1852096188813448, + 0.0, + 0.0, + 0.03176812082529068, + 0.0, + 0.0, + 0.0, + 2.1788967810571194, + 0.0, + 0.0, + 0.0, + 0.029101477935910225, + 0.0, + 0.029187703505158424, + 0.28254522010684013, + 0.7604492232203484, + 0.0, + 0.03988944739103317, + 0.10173705220222473, + 0.0, + 0.27166426181793213, + 0.2989754807204008, + 0.0, + 0.0, + 0.6228780467063189, + 0.3037472777068615, + 0.0, + 0.0, + 0.23548190295696259, + 0.27169063687324524, + 0.0, + 0.19211741909384727, + 0.0, + 0.5393859092146158, + 0.14424286782741547, + 0.13380030076950788, + 0.0, + 0.06053275614976883, + 0.25511427223682404, + 0.0, + 0.17693866789340973 + ], + "unique_experts": 37, + "load_cv": 1.4393135893493163, + "normalized_load_entropy": 0.7980857764742624, + "max_load_share": 0.12318840579710146 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "98b3ece84d53b49cc113262e488efa0947341aaf24b1cecfe9781dea16d2962a", + "route_weight_sha256": "87caf2d608b493ac90e3720c417e1b9ccb47648cf8c84ce4f233a68d2b0ab00f", + "loads": [ + 0, + 6, + 3, + 8, + 10, + 19, + 5, + 5, + 2, + 0, + 1, + 1, + 5, + 0, + 6, + 13, + 2, + 1, + 14, + 0, + 9, + 0, + 11, + 4, + 0, + 8, + 4, + 0, + 0, + 3, + 19, + 1, + 0, + 1, + 2, + 0, + 3, + 6, + 3, + 0, + 3, + 5, + 2, + 7, + 15, + 0, + 1, + 7, + 4, + 0, + 8, + 3, + 4, + 5, + 4, + 3, + 6, + 8, + 4, + 0, + 12, + 7, + 0, + 5 + ], + "weighted_loads": [ + 0.0, + 0.25487801991403103, + 0.13468516618013382, + 0.6021536104381084, + 0.4612256530672312, + 1.7293786834925413, + 0.40070859901607037, + 0.2831131611019373, + 0.08727091550827026, + 0.0, + 0.03590361773967743, + 0.6835088729858398, + 0.20737509243190289, + 0.0, + 0.44434433430433273, + 0.765731256455183, + 0.0633844118565321, + 0.04087061062455177, + 1.190318502485752, + 0.0, + 1.0364671181887388, + 0.0, + 0.7370033264160156, + 0.1852096188813448, + 0.0, + 0.5526524819433689, + 0.13037036545574665, + 0.0, + 0.0, + 0.09337917156517506, + 2.278524585068226, + 0.01211369875818491, + 0.0, + 0.023133913055062294, + 0.07131733931601048, + 0.0, + 0.07594753615558147, + 0.31643667444586754, + 1.1247448846697807, + 0.0, + 0.11212551034986973, + 0.22750248853117228, + 0.16345136612653732, + 0.4640767350792885, + 0.7024999260902405, + 0.0, + 0.14474675059318542, + 0.6337255584076047, + 0.3037472777068615, + 0.0, + 1.284110650420189, + 0.23548190295696259, + 0.29968261532485485, + 0.27268010936677456, + 0.19211741909384727, + 0.4012622945010662, + 0.5393859092146158, + 0.29356755688786507, + 0.1722766635939479, + 0.0, + 1.3611298389732838, + 0.4533330798149109, + 0.0, + 0.17693866789340973 + ], + "unique_experts": 49, + "load_cv": 1.0168336232068402, + "normalized_load_entropy": 0.8754326378518289, + "max_load_share": 0.06597222222222222 + } + }, + "s1_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "feb8eea6d1dfdef2680d91f01d8002ad2a7d383355902901b59c9fd0857cddfd", + "route_weight_sha256": "4f797b69fa29063450432637358a8ca59bd49da5038728659da902269cace695", + "loads": [ + 0, + 6, + 3, + 0, + 2, + 14, + 2, + 0, + 2, + 0, + 1, + 0, + 2, + 0, + 4, + 6, + 0, + 0, + 3, + 0, + 6, + 0, + 2, + 4, + 0, + 0, + 1, + 0, + 0, + 1, + 17, + 0, + 0, + 0, + 1, + 1, + 0, + 5, + 2, + 0, + 1, + 1, + 0, + 3, + 4, + 0, + 0, + 6, + 4, + 0, + 0, + 3, + 3, + 0, + 5, + 0, + 6, + 4, + 3, + 0, + 1, + 4, + 0, + 5 + ], + "weighted_loads": [ + 0.0, + 0.2531659547239542, + 0.12541348859667778, + 0.0, + 0.0659146886318922, + 1.4452650770545006, + 0.30468250811100006, + 0.0, + 0.08778999373316765, + 0.0, + 0.035768233239650726, + 0.0, + 0.0937822237610817, + 0.0, + 0.36600473150610924, + 0.3684917315840721, + 0.0, + 0.0, + 0.27264201641082764, + 0.0, + 0.9336665794253349, + 0.0, + 0.07730400189757347, + 0.17328335903584957, + 0.0, + 0.0, + 0.030428284779191017, + 0.0, + 0.0, + 0.03658253327012062, + 2.178526185452938, + 0.0, + 0.0, + 0.0, + 0.030702311545610428, + 0.043481502681970596, + 0.0, + 0.2451530359685421, + 0.7609709426760674, + 0.0, + 0.04095596447587013, + 0.06547291576862335, + 0.0, + 0.30144138634204865, + 0.27626292780041695, + 0.0, + 0.0, + 0.6188666559755802, + 0.29492656886577606, + 0.0, + 0.0, + 0.23536404222249985, + 0.2650832161307335, + 0.0, + 0.21545322611927986, + 0.0, + 0.5495571047067642, + 0.1747900675982237, + 0.1174305658787489, + 0.0, + 0.07845195382833481, + 0.25273461267352104, + 0.0, + 0.18811677955091 + ], + "unique_experts": 36, + "load_cv": 1.4486230416005967, + "normalized_load_entropy": 0.7938157202504821, + "max_load_share": 0.12318840579710146 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "fff6cfdf73eca5c554512bd1be9cb8f0bde5db33bfa74e6f197a47d646082ad7", + "route_weight_sha256": "bf68caa929c49c5e1ffe6d31949647af1297ba0eaa1455137db7fb862de790e0", + "loads": [ + 5, + 7, + 3, + 11, + 10, + 22, + 4, + 9, + 2, + 2, + 3, + 0, + 3, + 1, + 5, + 20, + 5, + 0, + 13, + 1, + 12, + 1, + 13, + 6, + 1, + 14, + 3, + 2, + 0, + 6, + 17, + 0, + 1, + 0, + 4, + 3, + 3, + 10, + 4, + 5, + 6, + 4, + 2, + 11, + 19, + 1, + 0, + 6, + 4, + 5, + 13, + 3, + 3, + 10, + 6, + 10, + 8, + 11, + 4, + 2, + 13, + 6, + 1, + 5 + ], + "weighted_loads": [ + 0.23126060143113136, + 0.2773117870092392, + 0.12541348859667778, + 0.7635049037635326, + 0.48746573738753796, + 1.8151815049350262, + 0.37757633440196514, + 0.5734930448234081, + 0.08778999373316765, + 0.23566818982362747, + 0.12961596250534058, + 0.0, + 0.1338527426123619, + 0.2830076515674591, + 0.4247651845216751, + 1.2944612614810467, + 0.3002009764313698, + 0.0, + 1.2584825493395329, + 0.03974062204360962, + 1.1536956634372473, + 0.03480032458901405, + 0.8878346979618073, + 0.3441814687103033, + 0.01978174038231373, + 0.9347563944756985, + 0.0955685805529356, + 0.06125393509864807, + 0.0, + 0.1717689409852028, + 2.178526185452938, + 0.0, + 0.04738996550440788, + 0.0, + 0.15081295557320118, + 0.22121235728263855, + 0.10202962718904018, + 0.4486616738140583, + 1.168089348822832, + 0.25834227353334427, + 0.2442325484007597, + 0.21370290964841843, + 0.15661747008562088, + 0.7029338367283344, + 1.2109637781977654, + 0.07283078879117966, + 0.0, + 0.6188666559755802, + 0.29492656886577606, + 0.3393111489713192, + 1.7505220547318459, + 0.23536404222249985, + 0.2650832161307335, + 0.43391950614750385, + 0.241579694673419, + 1.0090551376342773, + 0.6351005993783474, + 0.7140727695077658, + 0.15466981567442417, + 0.052520327270030975, + 1.4963566828519106, + 0.3971823565661907, + 0.060637082904577255, + 0.18811677955091 + ], + "unique_experts": 58, + "load_cv": 0.875, + "normalized_load_entropy": 0.90935846262321, + "max_load_share": 0.057291666666666664 + } + }, + "s0_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "c6db5a4a955ecb4a206bada3031046fe6d3c91460effbdb50dd7c3a72d8365e2", + "route_weight_sha256": "9989b85e09688f31f260f81185410fcbe8df0775cab5d66288bdc58293431dae", + "loads": [ + 0, + 5, + 3, + 0, + 2, + 14, + 2, + 0, + 2, + 0, + 1, + 1, + 1, + 0, + 4, + 6, + 0, + 0, + 3, + 0, + 6, + 0, + 2, + 3, + 0, + 0, + 1, + 0, + 0, + 1, + 17, + 0, + 0, + 0, + 1, + 0, + 0, + 5, + 2, + 0, + 1, + 1, + 0, + 3, + 5, + 1, + 0, + 7, + 4, + 0, + 0, + 3, + 3, + 0, + 4, + 0, + 6, + 5, + 3, + 0, + 1, + 4, + 0, + 5 + ], + "weighted_loads": [ + 0.0, + 0.2275551287457347, + 0.1253323033452034, + 0.0, + 0.07384242862462997, + 1.441357098519802, + 0.3429247885942459, + 0.0, + 0.0905575379729271, + 0.0, + 0.030786575749516487, + 0.019672153517603874, + 0.06671323627233505, + 0.0, + 0.3764010891318321, + 0.32495012134313583, + 0.0, + 0.0, + 0.28014707565307617, + 0.0, + 0.9132511951029301, + 0.0, + 0.0812436081469059, + 0.1592169888317585, + 0.0, + 0.0, + 0.032207123935222626, + 0.0, + 0.0, + 0.025424588471651077, + 2.280112896114588, + 0.0, + 0.0, + 0.0, + 0.02907336689531803, + 0.0, + 0.0, + 0.2987632527947426, + 0.7314227148890495, + 0.0, + 0.040573883801698685, + 0.05853171646595001, + 0.0, + 0.2660706229507923, + 0.30502938851714134, + 0.038654062896966934, + 0.0, + 0.6531299352645874, + 0.2985641621053219, + 0.0, + 0.0, + 0.23433875292539597, + 0.27968017011880875, + 0.0, + 0.1780770756304264, + 0.0, + 0.5168434605002403, + 0.2420606128871441, + 0.1261859480291605, + 0.0, + 0.058940622955560684, + 0.23927012085914612, + 0.0, + 0.17478730529546738 + ], + "unique_experts": 37, + "load_cv": 1.4509410717526756, + "normalized_load_entropy": 0.7954991708582281, + "max_load_share": 0.12318840579710146 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "d362566f3b2a759d8114776d4245a3498d50bb495a85972de4eccda11bf17318", + "route_weight_sha256": "aea4a9c13e35ccb8cc83dc24e1ba9130aa4bc7f14cc783718001cbeaf44d67b6", + "loads": [ + 0, + 7, + 3, + 8, + 11, + 17, + 6, + 4, + 5, + 0, + 1, + 1, + 5, + 1, + 4, + 11, + 2, + 0, + 14, + 0, + 9, + 0, + 9, + 3, + 0, + 9, + 2, + 0, + 0, + 6, + 18, + 0, + 0, + 1, + 2, + 0, + 4, + 6, + 3, + 0, + 2, + 3, + 2, + 5, + 16, + 1, + 0, + 7, + 4, + 1, + 8, + 3, + 4, + 5, + 4, + 4, + 7, + 11, + 4, + 0, + 13, + 7, + 0, + 5 + ], + "weighted_loads": [ + 0.0, + 0.2913723336532712, + 0.1253323033452034, + 0.6021536104381084, + 0.5854808948934078, + 1.550522243604064, + 0.4628672692924738, + 0.24928675405681133, + 0.1960300002247095, + 0.0, + 0.030786575749516487, + 0.019672153517603874, + 0.24315065704286098, + 0.028185952454805374, + 0.3764010891318321, + 0.6870095133781433, + 0.0633844118565321, + 0.0, + 1.2604246139526367, + 0.0, + 1.0170617010444403, + 0.0, + 0.6165863536298275, + 0.1592169888317585, + 0.0, + 0.6385261230170727, + 0.049647361040115356, + 0.0, + 0.0, + 0.19000703655183315, + 2.3332304917275906, + 0.0, + 0.0, + 0.023133913055062294, + 0.06556330062448978, + 0.0, + 0.11546114087104797, + 0.33265470713377, + 1.095718376338482, + 0.0, + 0.07429002597928047, + 0.1737206131219864, + 0.16317176818847656, + 0.34774767234921455, + 0.7422224227339029, + 0.038654062896966934, + 0.0, + 0.6531299352645874, + 0.2985641621053219, + 0.03687930852174759, + 1.1369995586574078, + 0.23433875292539597, + 0.30767214857041836, + 0.2733140420168638, + 0.1780770756304264, + 0.4335261136293411, + 0.5596902705729008, + 0.44360219687223434, + 0.1646623108536005, + 0.0, + 1.551193431019783, + 0.430254265666008, + 0.0, + 0.17478730529546738 + ], + "unique_experts": 49, + "load_cv": 1.0015420209622192, + "normalized_load_entropy": 0.8763177521272916, + "max_load_share": 0.0625 + } + }, + "s1_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "52df5532cfebd78a03a5e7d0184a6ec0fb46ae3eb48ae3cf80695b55d9053dfa", + "route_weight_sha256": "c2bddacc7193c7b50632244b0a32163eb0ca2f754fb97cef702395f67524e87c", + "loads": [ + 0, + 5, + 3, + 0, + 4, + 14, + 2, + 0, + 1, + 0, + 1, + 0, + 1, + 0, + 5, + 6, + 0, + 1, + 3, + 0, + 6, + 0, + 2, + 3, + 0, + 0, + 1, + 0, + 0, + 1, + 17, + 0, + 0, + 0, + 1, + 0, + 0, + 5, + 2, + 0, + 1, + 1, + 0, + 3, + 5, + 1, + 0, + 7, + 4, + 0, + 0, + 3, + 3, + 0, + 4, + 0, + 7, + 4, + 3, + 0, + 1, + 4, + 0, + 3 + ], + "weighted_loads": [ + 0.0, + 0.23374169878661633, + 0.10163422673940659, + 0.0, + 0.14989127404987812, + 1.4181743375957012, + 0.3146236091852188, + 0.0, + 0.05194397270679474, + 0.0, + 0.03256816044449806, + 0.0, + 0.059969447553157806, + 0.0, + 0.3927879184484482, + 0.31500662863254547, + 0.0, + 0.02613450214266777, + 0.27168531715869904, + 0.0, + 0.8793676607310772, + 0.0, + 0.07025333121418953, + 0.1400511935353279, + 0.0, + 0.0, + 0.030523400753736496, + 0.0, + 0.0, + 0.02505895495414734, + 2.1318268831819296, + 0.0, + 0.0, + 0.0, + 0.031163565814495087, + 0.0, + 0.0, + 0.32344456389546394, + 0.7105900272727013, + 0.0, + 0.047637566924095154, + 0.06205790489912033, + 0.0, + 0.2614705376327038, + 0.3130186665803194, + 0.036344386637210846, + 0.0, + 0.660200759768486, + 0.3226957581937313, + 0.0, + 0.0, + 0.23864319175481796, + 0.25433383136987686, + 0.0, + 0.17192822694778442, + 0.0, + 0.5640401132404804, + 0.20661155506968498, + 0.11908018589019775, + 0.0, + 0.0624084435403347, + 0.23218651115894318, + 0.0, + 0.11937446147203445 + ], + "unique_experts": 37, + "load_cv": 1.4578730482544484, + "normalized_load_entropy": 0.7939448755951809, + "max_load_share": 0.12318840579710146 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "a4da1b5cb16882dafb9eb4d94167a66eddde36badd99443d58a9a9f2fbf6f7ce", + "route_weight_sha256": "336724ddeaf31b70a1fc31578ed7697b5baf0de94bb171a4b64482b3a036b4a7", + "loads": [ + 4, + 6, + 3, + 12, + 14, + 22, + 5, + 9, + 1, + 2, + 3, + 0, + 3, + 1, + 6, + 19, + 7, + 1, + 14, + 1, + 9, + 2, + 12, + 5, + 1, + 15, + 2, + 3, + 0, + 8, + 17, + 0, + 1, + 0, + 3, + 2, + 3, + 10, + 4, + 4, + 4, + 3, + 2, + 8, + 22, + 2, + 0, + 7, + 4, + 4, + 13, + 3, + 3, + 9, + 5, + 10, + 9, + 12, + 4, + 2, + 14, + 6, + 1, + 3 + ], + "weighted_loads": [ + 0.19503278657794, + 0.2578875310719013, + 0.10163422673940659, + 0.7949813157320023, + 0.7191116157919168, + 1.7730381451547146, + 0.4257556479424238, + 0.5436163432896137, + 0.05194397270679474, + 0.23566818982362747, + 0.1264158897101879, + 0.0, + 0.14507047832012177, + 0.2830076515674591, + 0.45154837146401405, + 1.2380495443940163, + 0.4630993641912937, + 0.02613450214266777, + 1.373207237571478, + 0.03974062204360962, + 0.989095376804471, + 0.067483339458704, + 0.7233904302120209, + 0.31094930320978165, + 0.01978174038231373, + 0.9556611701846123, + 0.04796363785862923, + 0.0937192365527153, + 0.0, + 0.2299508024007082, + 2.1318268831819296, + 0.0, + 0.04738996550440788, + 0.0, + 0.10073376633226871, + 0.17773085460066795, + 0.10202962718904018, + 0.5247918292880058, + 1.117708433419466, + 0.19981792569160461, + 0.18610588274896145, + 0.16221883893013, + 0.14368900284171104, + 0.5235755406320095, + 1.28658296354115, + 0.1091751754283905, + 0.0, + 0.660200759768486, + 0.3226957581937313, + 0.23592375591397285, + 1.446957666426897, + 0.23864319175481796, + 0.25433383136987686, + 0.3661509659141302, + 0.19805469550192356, + 1.0338851511478424, + 0.6501073613762856, + 0.7916017174720764, + 0.15631943568587303, + 0.052520327270030975, + 1.5747641306370497, + 0.37348975241184235, + 0.060637082904577255, + 0.11937446147203445 + ], + "unique_experts": 59, + "load_cv": 0.9076258712829985, + "normalized_load_entropy": 0.9061504052350058, + "max_load_share": 0.057291666666666664 + } + }, + "s0_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "b103aa00eacb7ca3138aabef13e70199fdf7696669a2ce45389fac7f770c5f34", + "route_weight_sha256": "16885ce0700722cac8fd2fd3f28b81fe3b78d3343efaadcc5bb33c5e3c06c52f", + "loads": [ + 0, + 5, + 3, + 0, + 2, + 14, + 2, + 0, + 2, + 0, + 0, + 1, + 1, + 0, + 4, + 6, + 0, + 0, + 3, + 0, + 6, + 0, + 2, + 3, + 0, + 0, + 1, + 0, + 0, + 1, + 17, + 0, + 0, + 0, + 1, + 1, + 0, + 5, + 2, + 0, + 1, + 2, + 0, + 3, + 5, + 0, + 0, + 7, + 4, + 0, + 0, + 3, + 3, + 0, + 4, + 0, + 6, + 5, + 3, + 0, + 1, + 4, + 0, + 5 + ], + "weighted_loads": [ + 0.0, + 0.2375467885285616, + 0.12345133349299431, + 0.0, + 0.06922799721360207, + 1.4605494812130928, + 0.32793566584587097, + 0.0, + 0.09095559269189835, + 0.0, + 0.0, + 0.020017048344016075, + 0.06780935078859329, + 0.0, + 0.37432512640953064, + 0.3283979967236519, + 0.0, + 0.0, + 0.2682834193110466, + 0.0, + 0.9160195589065552, + 0.0, + 0.08814886584877968, + 0.1653367541730404, + 0.0, + 0.0, + 0.031066063791513443, + 0.0, + 0.0, + 0.025299662724137306, + 2.245929107069969, + 0.0, + 0.0, + 0.0, + 0.03053060919046402, + 0.03055388852953911, + 0.0, + 0.2665779311209917, + 0.7378817498683929, + 0.0, + 0.04187236726284027, + 0.09767424687743187, + 0.0, + 0.25779639184474945, + 0.3054759167134762, + 0.0, + 0.0, + 0.6648523155599833, + 0.31035924702882767, + 0.0, + 0.0, + 0.23877978697419167, + 0.27179689705371857, + 0.0, + 0.18278168141841888, + 0.0, + 0.5397973544895649, + 0.22038313187658787, + 0.1182334665209055, + 0.0, + 0.05360255762934685, + 0.2485353648662567, + 0.0, + 0.18052447959780693 + ], + "unique_experts": 36, + "load_cv": 1.4532554045113477, + "normalized_load_entropy": 0.79308371192103, + "max_load_share": 0.12318840579710146 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "cb164508967335fa5a48f729a25e373f5c5d8af17030b6bc5d5c2922ad746abd", + "route_weight_sha256": "383681231a9f7c551af011b4d711f2214b5b8331669f82fa795d5651437374f7", + "loads": [ + 0, + 7, + 3, + 8, + 11, + 17, + 6, + 5, + 4, + 0, + 0, + 1, + 5, + 0, + 4, + 11, + 2, + 0, + 13, + 0, + 10, + 0, + 9, + 3, + 0, + 9, + 2, + 0, + 0, + 6, + 18, + 0, + 0, + 1, + 2, + 1, + 2, + 6, + 3, + 1, + 3, + 4, + 2, + 5, + 18, + 0, + 0, + 7, + 4, + 1, + 9, + 3, + 4, + 5, + 4, + 3, + 7, + 10, + 4, + 0, + 12, + 8, + 0, + 5 + ], + "weighted_loads": [ + 0.0, + 0.3031240180134773, + 0.12345133349299431, + 0.6021536104381084, + 0.497951403260231, + 1.5697146262973547, + 0.46009777300059795, + 0.407705320045352, + 0.1715448461472988, + 0.0, + 0.0, + 0.020017048344016075, + 0.24469479732215405, + 0.0, + 0.37432512640953064, + 0.6574711874127388, + 0.0633844118565321, + 0.0, + 1.1492387726902962, + 0.0, + 1.0647218208760023, + 0.0, + 0.6353626362979412, + 0.1653367541730404, + 0.0, + 0.6973086670041084, + 0.048506300896406174, + 0.0, + 0.0, + 0.19300051033496857, + 2.3015110790729523, + 0.0, + 0.0, + 0.023133913055062294, + 0.0707492046058178, + 0.03055388852953911, + 0.04675983265042305, + 0.3004693854600191, + 1.1021774113178253, + 0.04562459886074066, + 0.12141017057001591, + 0.20044312626123428, + 0.16100656241178513, + 0.3436429761350155, + 0.8598798010498285, + 0.0, + 0.0, + 0.6648523155599833, + 0.31035924702882767, + 0.06682904809713364, + 1.2209827974438667, + 0.23877978697419167, + 0.2997888755053282, + 0.2589643504470587, + 0.18278168141841888, + 0.4257442466914654, + 0.5910723954439163, + 0.36970782093703747, + 0.1567098293453455, + 0.0, + 1.3541996404528618, + 0.4740304499864578, + 0.0, + 0.18052447959780693 + ], + "unique_experts": 48, + "load_cv": 1.0160745087873269, + "normalized_load_entropy": 0.8726930714176236, + "max_load_share": 0.0625 + } + }, + "s1_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "3bc67ebbd95dbe3ec135cfa657dcd8fab242d28ffc100ee1a56e8efff508369b", + "route_weight_sha256": "0dca2a440abcd933e317c8351ab7e0c906f9d433689e7c451075782f14b41bc4", + "loads": [ + 0, + 5, + 2, + 0, + 4, + 14, + 2, + 0, + 1, + 0, + 1, + 0, + 1, + 0, + 5, + 6, + 0, + 0, + 5, + 0, + 6, + 0, + 2, + 3, + 0, + 0, + 1, + 0, + 0, + 1, + 17, + 0, + 0, + 0, + 1, + 0, + 0, + 5, + 2, + 0, + 1, + 1, + 0, + 3, + 5, + 1, + 0, + 7, + 4, + 0, + 0, + 3, + 3, + 0, + 3, + 0, + 7, + 5, + 3, + 0, + 1, + 4, + 0, + 3 + ], + "weighted_loads": [ + 0.0, + 0.2453862801194191, + 0.07198883220553398, + 0.0, + 0.15708115510642529, + 1.3901902176439762, + 0.316725492477417, + 0.0, + 0.0511581189930439, + 0.0, + 0.03248205780982971, + 0.0, + 0.06430725008249283, + 0.0, + 0.3857081364840269, + 0.30280299484729767, + 0.0, + 0.0, + 0.33932069689035416, + 0.0, + 0.8851718604564667, + 0.0, + 0.07297810167074203, + 0.13680201396346092, + 0.0, + 0.0, + 0.028200000524520874, + 0.0, + 0.0, + 0.0257270447909832, + 2.0791720375418663, + 0.0, + 0.0, + 0.0, + 0.03200370445847511, + 0.0, + 0.0, + 0.3342254124581814, + 0.698766864836216, + 0.0, + 0.04713549092411995, + 0.05844332277774811, + 0.0, + 0.281954750418663, + 0.3251546658575535, + 0.03785087913274765, + 0.0, + 0.6654451340436935, + 0.32576098293066025, + 0.0, + 0.0, + 0.23086732253432274, + 0.24162904173135757, + 0.0, + 0.11998742073774338, + 0.0, + 0.5452127233147621, + 0.24097670800983906, + 0.1188467126339674, + 0.0, + 0.06676701456308365, + 0.22380291670560837, + 0.0, + 0.11652334220707417 + ], + "unique_experts": 36, + "load_cv": 1.4716390478247532, + "normalized_load_entropy": 0.7885530960701687, + "max_load_share": 0.12318840579710146 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "5a7ce3aa83be94564a6436fb2634bb8c1842c99c96684548c28a452219c40130", + "route_weight_sha256": "c862dee9af581886da4bab8528dc931268e6206c300dbfdcb725bf6044af40aa", + "loads": [ + 4, + 6, + 2, + 11, + 12, + 21, + 5, + 10, + 1, + 2, + 3, + 0, + 5, + 1, + 6, + 19, + 6, + 0, + 15, + 1, + 10, + 1, + 12, + 5, + 1, + 15, + 2, + 2, + 0, + 6, + 18, + 0, + 1, + 0, + 3, + 2, + 3, + 13, + 4, + 5, + 5, + 3, + 2, + 8, + 21, + 2, + 0, + 7, + 4, + 5, + 13, + 3, + 3, + 9, + 4, + 11, + 8, + 12, + 4, + 2, + 14, + 7, + 1, + 3 + ], + "weighted_loads": [ + 0.19503278657794, + 0.2695321124047041, + 0.07198883220553398, + 0.7635049037635326, + 0.578632203862071, + 1.680460549890995, + 0.4348080325871706, + 0.6178187131881714, + 0.0511581189930439, + 0.23566818982362747, + 0.12632978707551956, + 0.0, + 0.24199623614549637, + 0.2830076515674591, + 0.4444685894995928, + 1.2589903511106968, + 0.32773798145353794, + 0.0, + 1.3251612298190594, + 0.03974062204360962, + 1.0432003494352102, + 0.03480032458901405, + 0.717936996370554, + 0.30770012363791466, + 0.01978174038231373, + 0.9721525348722935, + 0.045640237629413605, + 0.06125393509864807, + 0.0, + 0.16091345250606537, + 2.1247506327927113, + 0.0, + 0.04738996550440788, + 0.0, + 0.10157390497624874, + 0.17773085460066795, + 0.10202962718904018, + 0.6539518162608147, + 1.1058852709829807, + 0.24640849232673645, + 0.22062388993799686, + 0.15525617077946663, + 0.14180441200733185, + 0.540150873363018, + 1.2705338336527348, + 0.11068166792392731, + 0.0, + 0.6654451340436935, + 0.32576098293066025, + 0.321865763515234, + 1.4764625951647758, + 0.23086732253432274, + 0.24162904173135757, + 0.3546988796442747, + 0.14611388929188251, + 1.0900491699576378, + 0.5922255590558052, + 0.7802594099193811, + 0.15608596242964268, + 0.052520327270030975, + 1.527282813563943, + 0.4064638838171959, + 0.060637082904577255, + 0.11652334220707417 + ], + "unique_experts": 58, + "load_cv": 0.9090593428863095, + "normalized_load_entropy": 0.9033158504581192, + "max_load_share": 0.0546875 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "ordered_topk_exact_tokens": 17, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.9161490683229813, + "mean_token_weighted_tv": 0.01871303349490399, + "aggregate_load_tv": 0.05072463768115943 + }, + "system_bos": { + "tokens": 23, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.9254658385093167, + "mean_token_weighted_tv": 0.02124058307431962, + "aggregate_load_tv": 0.04347826086956522 + }, + "system_x": { + "tokens": 23, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 18, + "mean_set_jaccard": 0.9378881987577641, + "mean_token_weighted_tv": 0.023998285380556532, + "aggregate_load_tv": 0.036231884057971016 + }, + "system_period": { + "tokens": 23, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.9006211180124224, + "mean_token_weighted_tv": 0.0315611223163812, + "aggregate_load_tv": 0.057971014492753624 + }, + "bos_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8881987577639753, + "mean_token_weighted_tv": 0.02626926071293976, + "aggregate_load_tv": 0.05797101449275364 + }, + "bos_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.9006211180124224, + "mean_token_weighted_tv": 0.024332178999548374, + "aggregate_load_tv": 0.057971014492753624 + }, + "x_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.9130434782608695, + "mean_token_weighted_tv": 0.02724759361666182, + "aggregate_load_tv": 0.043478260869565216 + }, + "x_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8695652173913043, + "mean_token_weighted_tv": 0.03629782030601864, + "aggregate_load_tv": 0.07971014492753624 + }, + "period_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.9006211180124224, + "mean_token_weighted_tv": 0.026718328200766573, + "aggregate_load_tv": 0.050724637681159424 + }, + "period_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.8819875776397516, + "mean_token_weighted_tv": 0.036820952902021614, + "aggregate_load_tv": 0.07246376811594203 + } + } + }, + "layer_21": { + "layer": 21, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "059c3703c86e3a3766697a14046e1efd1cfbc4645977a0c7df6ecb4e6de9bbdf", + "route_weight_sha256": "e1f00c1c46d3ebec11ee100489cc4310d463aa7183265d869e9bbd97e1953e3e", + "loads": [ + 4, + 1, + 1, + 1, + 0, + 3, + 5, + 1, + 6, + 0, + 1, + 1, + 0, + 1, + 0, + 4, + 17, + 1, + 1, + 5, + 0, + 0, + 0, + 2, + 0, + 4, + 8, + 1, + 6, + 1, + 0, + 0, + 0, + 1, + 5, + 2, + 0, + 1, + 1, + 3, + 2, + 0, + 2, + 2, + 0, + 1, + 2, + 0, + 0, + 1, + 3, + 6, + 3, + 2, + 3, + 0, + 1, + 3, + 6, + 1, + 5, + 5, + 2, + 0 + ], + "weighted_loads": [ + 0.11632712744176388, + 0.045556388795375824, + 0.02153577096760273, + 0.05465409532189369, + 0.0, + 0.31497955322265625, + 0.4351334385573864, + 0.1620151549577713, + 0.316276241093874, + 0.0, + 0.07661160081624985, + 0.07731843739748001, + 0.0, + 0.03327427804470062, + 0.0, + 0.6716310828924179, + 2.1779279932379723, + 0.035194747149944305, + 0.032901037484407425, + 0.24962647445499897, + 0.0, + 0.0, + 0.0, + 0.07267576456069946, + 0.0, + 0.15673308447003365, + 0.5158662628382444, + 0.03788549825549126, + 0.7194672860205173, + 0.04101918265223503, + 0.0, + 0.0, + 0.0, + 0.04928075149655342, + 0.2847591135650873, + 0.07821907289326191, + 0.0, + 0.05495218560099602, + 0.031934019178152084, + 0.07864630036056042, + 0.11363157629966736, + 0.0, + 0.0641296487301588, + 0.25482213497161865, + 0.0, + 0.08994614332914352, + 0.08710072748363018, + 0.0, + 0.0, + 0.03819521144032478, + 0.10010872781276703, + 0.5381687358021736, + 0.2583457715809345, + 0.06163272447884083, + 0.1210951916873455, + 0.0, + 0.04046778380870819, + 0.20088811591267586, + 0.28966210409998894, + 0.03427085652947426, + 0.44673001021146774, + 0.16263528168201447, + 0.12421146035194397, + 0.0 + ], + "unique_experts": 46, + "load_cv": 1.265359322683065, + "normalized_load_entropy": 0.8440493711735013, + "max_load_share": 0.12318840579710146 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "1250ba1f84c52e77efa3ba2cb1511bdf73d560ca875711a7c4031677c81cbf11", + "route_weight_sha256": "f2e5dc4640d977606c6a735bb267915dea15b6333582c0ae33ec2910a65b68bd", + "loads": [ + 4, + 1, + 4, + 1, + 7, + 3, + 8, + 1, + 8, + 0, + 9, + 1, + 2, + 7, + 2, + 9, + 19, + 5, + 1, + 9, + 0, + 8, + 0, + 2, + 0, + 5, + 18, + 6, + 9, + 1, + 3, + 0, + 1, + 1, + 6, + 12, + 0, + 1, + 1, + 4, + 3, + 0, + 7, + 2, + 0, + 1, + 2, + 0, + 11, + 2, + 3, + 12, + 13, + 3, + 9, + 4, + 3, + 3, + 10, + 3, + 5, + 7, + 6, + 0 + ], + "weighted_loads": [ + 0.11632712744176388, + 0.045556388795375824, + 0.09436709946021438, + 0.05465409532189369, + 0.2590996325016022, + 0.31497955322265625, + 0.6802460476756096, + 0.1620151549577713, + 0.44347066804766655, + 0.0, + 0.5834851339459419, + 0.07731843739748001, + 0.12528500705957413, + 0.5404738560318947, + 0.0867365188896656, + 0.8295150762423873, + 2.218157242052257, + 0.15724179847165942, + 0.032901037484407425, + 1.8116585779935122, + 0.0, + 0.4801187366247177, + 0.0, + 0.07267576456069946, + 0.0, + 0.19188295304775238, + 0.9596980232745409, + 0.75586261972785, + 0.7830382850952446, + 0.04101918265223503, + 0.10944612324237823, + 0.0, + 0.022871434688568115, + 0.04928075149655342, + 0.33283392898738384, + 0.6521510276943445, + 0.0, + 0.05495218560099602, + 0.031934019178152084, + 0.1187866423279047, + 0.17354319989681244, + 0.0, + 0.3475663010030985, + 0.25482213497161865, + 0.0, + 0.08994614332914352, + 0.08710072748363018, + 0.0, + 0.6176433004438877, + 0.15934431180357933, + 0.10010872781276703, + 0.8298384994268417, + 0.8723251298069954, + 0.074645621702075, + 0.36377525981515646, + 0.3187056165188551, + 0.1110303346067667, + 0.20088811591267586, + 0.4570349399000406, + 0.1379696950316429, + 0.44673001021146774, + 0.24887797608971596, + 0.3303978852927685, + 0.0 + ], + "unique_experts": 54, + "load_cv": 0.9678472994546858, + "normalized_load_entropy": 0.8883688502261889, + "max_load_share": 0.06597222222222222 + } + }, + "s1_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "2a0456072acd068fbe4c6d24a3a3cac445d745071121944e9aab91c70beae53b", + "route_weight_sha256": "ceb570a5865e667fc8fa512fee5e165949e6cd7b514a8e1a2cc33a6895ab81c4", + "loads": [ + 5, + 3, + 1, + 1, + 0, + 3, + 5, + 1, + 6, + 0, + 1, + 1, + 0, + 2, + 0, + 4, + 17, + 2, + 0, + 4, + 0, + 1, + 0, + 2, + 0, + 4, + 8, + 1, + 6, + 0, + 0, + 0, + 0, + 1, + 5, + 1, + 0, + 1, + 1, + 4, + 3, + 0, + 1, + 2, + 0, + 1, + 1, + 0, + 0, + 1, + 2, + 6, + 3, + 2, + 3, + 0, + 2, + 3, + 6, + 1, + 4, + 4, + 2, + 0 + ], + "weighted_loads": [ + 0.1480236928910017, + 0.12020476162433624, + 0.022526223212480545, + 0.0602903738617897, + 0.0, + 0.310810849070549, + 0.43219172209501266, + 0.1455211639404297, + 0.33044290356338024, + 0.0, + 0.08042865991592407, + 0.07438144087791443, + 0.0, + 0.05364673025906086, + 0.0, + 0.6725563704967499, + 2.152914971113205, + 0.04995034635066986, + 0.0, + 0.23087723925709724, + 0.0, + 0.06436070054769516, + 0.0, + 0.07586975023150444, + 0.0, + 0.14520061761140823, + 0.5298938620835543, + 0.03229992836713791, + 0.7084526382386684, + 0.0, + 0.0, + 0.0, + 0.0, + 0.057439327239990234, + 0.2730733174830675, + 0.05239993706345558, + 0.0, + 0.06448591500520706, + 0.029579302296042442, + 0.10125694796442986, + 0.14990262687206268, + 0.0, + 0.03870350494980812, + 0.26418736949563026, + 0.0, + 0.08650092780590057, + 0.06474904716014862, + 0.0, + 0.0, + 0.038104623556137085, + 0.06853558495640755, + 0.5569538082927465, + 0.2622007057070732, + 0.059238675981760025, + 0.12551473826169968, + 0.0, + 0.0826822817325592, + 0.19934815168380737, + 0.280152577906847, + 0.04207119345664978, + 0.36322101578116417, + 0.1383258644491434, + 0.12297447398304939, + 0.0 + ], + "unique_experts": 45, + "load_cv": 1.2600363730526467, + "normalized_load_entropy": 0.8431064737687594, + "max_load_share": 0.12318840579710146 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "6c064c8733166d071b6f2d61fbfb0ef82299bb1c9d6fa9043e40e071d3144222", + "route_weight_sha256": "9f11054ee42a286395af9bd69ce04f24d11db62e1f1423876d7e542b639285ec", + "loads": [ + 13, + 5, + 4, + 1, + 1, + 4, + 11, + 2, + 10, + 3, + 12, + 1, + 4, + 12, + 6, + 7, + 19, + 11, + 2, + 8, + 1, + 9, + 1, + 7, + 1, + 7, + 16, + 11, + 9, + 1, + 6, + 0, + 1, + 5, + 5, + 18, + 1, + 2, + 2, + 5, + 3, + 2, + 10, + 3, + 1, + 2, + 1, + 0, + 11, + 5, + 3, + 16, + 13, + 3, + 16, + 9, + 6, + 3, + 9, + 6, + 4, + 7, + 6, + 1 + ], + "weighted_loads": [ + 0.6585770398378372, + 0.2040729895234108, + 0.716818327549845, + 0.0602903738617897, + 0.02982361800968647, + 0.3260897845029831, + 0.6851827539503574, + 0.22521885484457016, + 0.49137433245778084, + 0.1762995906174183, + 0.6462576538324356, + 0.07438144087791443, + 0.21587104722857475, + 0.7664057221263647, + 0.2386880125850439, + 0.7600054303184152, + 2.211462247185409, + 0.3644752139225602, + 0.054021913558244705, + 1.7641804330050945, + 0.04726748540997505, + 0.5426165917888284, + 0.030741719529032707, + 0.5760142151266336, + 0.03550385683774948, + 0.24150430969893932, + 0.8231101967394352, + 1.161403615027666, + 0.7437460962682962, + 0.04878450557589531, + 0.25382988527417183, + 0.0, + 0.022810837253928185, + 0.6503004431724548, + 0.2730733174830675, + 0.9719462618231773, + 0.07117611169815063, + 0.10482069849967957, + 0.08403524197638035, + 0.13908902928233147, + 0.14990262687206268, + 0.12920241430401802, + 0.5216433554887772, + 0.3126922585070133, + 0.06788554042577744, + 0.14503181353211403, + 0.06474904716014862, + 0.0, + 0.823096077889204, + 0.9637154117226601, + 0.11999788880348206, + 1.288020571693778, + 0.8384085521101952, + 0.0722515732049942, + 0.9006073968484998, + 0.587842158973217, + 0.2364690639078617, + 0.19934815168380737, + 0.4182320311665535, + 0.2968674786388874, + 0.36322101578116417, + 0.29491117037832737, + 0.30295053496956825, + 0.09215760976076126 + ], + "unique_experts": 62, + "load_cv": 0.8074092656281708, + "normalized_load_entropy": 0.9214855040852579, + "max_load_share": 0.049479166666666664 + } + }, + "s0_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "a4692ddc168e10668160d1ed90729fdaa8d089cb1f280b6b36d663a6a89c418a", + "route_weight_sha256": "7d4da9b5f50af99b312e56ba7cfa02289d0590e0a0d796a296e8af2ee7594e6f", + "loads": [ + 3, + 1, + 1, + 1, + 0, + 3, + 5, + 1, + 7, + 0, + 1, + 1, + 0, + 2, + 0, + 4, + 17, + 3, + 1, + 5, + 0, + 1, + 0, + 1, + 0, + 3, + 8, + 2, + 6, + 2, + 0, + 0, + 0, + 1, + 5, + 2, + 0, + 1, + 1, + 2, + 3, + 0, + 1, + 2, + 0, + 1, + 2, + 0, + 0, + 1, + 2, + 6, + 3, + 2, + 2, + 0, + 1, + 3, + 6, + 0, + 4, + 6, + 2, + 0 + ], + "weighted_loads": [ + 0.08438731357455254, + 0.050288330763578415, + 0.02310638502240181, + 0.06447888165712357, + 0.0, + 0.30455735325813293, + 0.4477539584040642, + 0.12790562212467194, + 0.3340523224323988, + 0.0, + 0.07589808106422424, + 0.07592900842428207, + 0.0, + 0.06283547356724739, + 0.0, + 0.6938785277307034, + 2.293060339987278, + 0.08611709624528885, + 0.03648059442639351, + 0.2426085714250803, + 0.0, + 0.06836617738008499, + 0.0, + 0.03976650908589363, + 0.0, + 0.11522539332509041, + 0.5153410602360964, + 0.07295214757323265, + 0.7485730536282063, + 0.0766238197684288, + 0.0, + 0.0, + 0.0, + 0.06177163124084473, + 0.2830566167831421, + 0.07700086198747158, + 0.0, + 0.04894528165459633, + 0.03055376000702381, + 0.05196535401046276, + 0.15670166537165642, + 0.0, + 0.034909822046756744, + 0.2746221013367176, + 0.0, + 0.08826605975627899, + 0.08478028699755669, + 0.0, + 0.0, + 0.0374547615647316, + 0.0785570740699768, + 0.5409599747508764, + 0.2871916629374027, + 0.06026894226670265, + 0.10428444668650627, + 0.0, + 0.04008527845144272, + 0.19935910403728485, + 0.300151102244854, + 0.0, + 0.3854069299995899, + 0.1964087374508381, + 0.1277211382985115, + 0.0 + ], + "unique_experts": 46, + "load_cv": 1.2680124181346109, + "normalized_load_entropy": 0.8450311453187994, + "max_load_share": 0.12318840579710146 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "daa6c9911bcee37a10ff9ad91060cb7b76154ea9e4a84a544054d2bba578c2c0", + "route_weight_sha256": "03c4466d06cf5b746e62b6a25150c0c76614e9332f2a900ba6a26e2756a5c606", + "loads": [ + 3, + 3, + 3, + 2, + 6, + 3, + 7, + 1, + 10, + 0, + 7, + 1, + 2, + 8, + 2, + 9, + 18, + 5, + 2, + 7, + 0, + 8, + 0, + 1, + 0, + 4, + 18, + 7, + 8, + 2, + 2, + 3, + 1, + 1, + 6, + 12, + 0, + 1, + 1, + 5, + 6, + 0, + 6, + 2, + 0, + 3, + 2, + 0, + 12, + 3, + 2, + 12, + 13, + 3, + 7, + 3, + 3, + 3, + 9, + 2, + 4, + 8, + 6, + 0 + ], + "weighted_loads": [ + 0.08438731357455254, + 0.13338495790958405, + 0.09343884326517582, + 0.2564831003546715, + 0.22705943509936333, + 0.30455735325813293, + 0.6318453401327133, + 0.12790562212467194, + 0.4833191428333521, + 0.0, + 0.4823242761194706, + 0.07592900842428207, + 0.12528500705957413, + 0.4998466297984123, + 0.06888753920793533, + 0.8786556124687195, + 2.3063597856089473, + 0.16640742868185043, + 0.08921584114432335, + 0.8218527194112539, + 0.0, + 0.5447535421699286, + 0.0, + 0.03976650908589363, + 0.0, + 0.15037526190280914, + 0.9591728206723928, + 0.739585604518652, + 0.8077379409223795, + 0.0766238197684288, + 0.08546502515673637, + 0.2433544583618641, + 0.022871434688568115, + 0.06177163124084473, + 0.3311314322054386, + 0.6509328167885542, + 0.0, + 0.04894528165459633, + 0.03055376000702381, + 0.17564173229038715, + 0.3426815904676914, + 0.0, + 0.32117144763469696, + 0.2746221013367176, + 0.0, + 0.2493470050394535, + 0.08478028699755669, + 0.0, + 0.6697758994996548, + 0.20070885121822357, + 0.0785570740699768, + 0.8326297383755445, + 0.9011710211634636, + 0.07328183948993683, + 0.26319611351937056, + 0.29087795689702034, + 0.12035107985138893, + 0.19935910403728485, + 0.3984269741922617, + 0.08235926181077957, + 0.3854069299995899, + 0.31010929122567177, + 0.33055512979626656, + 0.0 + ], + "unique_experts": 55, + "load_cv": 0.931280811902234, + "normalized_load_entropy": 0.8981767721414983, + "max_load_share": 0.0625 + } + }, + "s1_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "0b4cb950549d147f39fc3bd6c6bfaeda8b020969b855371fdf869fc3e433a774", + "route_weight_sha256": "897db59fa1edf3a5539c56f7153219ddf41dcd2f1a415d04cf0b77aaf9b644ac", + "loads": [ + 5, + 1, + 1, + 1, + 0, + 3, + 5, + 1, + 5, + 0, + 1, + 1, + 0, + 2, + 0, + 4, + 17, + 2, + 0, + 4, + 0, + 1, + 0, + 1, + 0, + 4, + 7, + 2, + 5, + 2, + 0, + 0, + 0, + 1, + 5, + 1, + 0, + 1, + 1, + 4, + 3, + 0, + 1, + 2, + 0, + 1, + 2, + 0, + 0, + 1, + 3, + 6, + 3, + 3, + 2, + 0, + 1, + 3, + 8, + 0, + 4, + 5, + 2, + 0 + ], + "weighted_loads": [ + 0.14547552168369293, + 0.05075044929981232, + 0.021734047681093216, + 0.07512837648391724, + 0.0, + 0.2800416573882103, + 0.44657282903790474, + 0.11620918661355972, + 0.28629007935523987, + 0.0, + 0.06788626313209534, + 0.07387751340866089, + 0.0, + 0.06778774596750736, + 0.0, + 0.7015147358179092, + 2.1930001750588417, + 0.057683611288666725, + 0.0, + 0.22558197379112244, + 0.0, + 0.06445755064487457, + 0.0, + 0.03867124393582344, + 0.0, + 0.14516820199787617, + 0.4596465080976486, + 0.07219618000090122, + 0.7104114964604378, + 0.07969891279935837, + 0.0, + 0.0, + 0.0, + 0.06548091769218445, + 0.27664644084870815, + 0.05022505298256874, + 0.0, + 0.05953020229935646, + 0.028862906619906425, + 0.10282430797815323, + 0.1359695941209793, + 0.0, + 0.03702382370829582, + 0.3258805423974991, + 0.0, + 0.09201604872941971, + 0.08458684012293816, + 0.0, + 0.0, + 0.0393708199262619, + 0.09650375880300999, + 0.5337182767689228, + 0.29390374943614006, + 0.09863195195794106, + 0.10732278227806091, + 0.0, + 0.03559047356247902, + 0.19770875200629234, + 0.3360584583133459, + 0.0, + 0.37382639572024345, + 0.17828777432441711, + 0.12155704200267792, + 0.0 + ], + "unique_experts": 45, + "load_cv": 1.2600363730526467, + "normalized_load_entropy": 0.8431655548499997, + "max_load_share": 0.12318840579710146 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "b5ac3a8aa4ba64ff7860159e2dd8065ff4762cbd3bc23d0385e81a281ddc470e", + "route_weight_sha256": "71e7d11bec25f0a248d59eb7c35edd6c5077e27b3e7f515340a32dbfe5ffaaa6", + "loads": [ + 13, + 4, + 3, + 1, + 5, + 4, + 11, + 3, + 9, + 3, + 10, + 2, + 4, + 12, + 5, + 8, + 18, + 8, + 3, + 7, + 1, + 8, + 1, + 6, + 1, + 7, + 15, + 13, + 7, + 3, + 6, + 1, + 1, + 6, + 5, + 18, + 1, + 2, + 2, + 5, + 4, + 2, + 10, + 3, + 1, + 2, + 2, + 0, + 11, + 5, + 4, + 16, + 13, + 4, + 14, + 9, + 5, + 3, + 10, + 4, + 4, + 8, + 7, + 1 + ], + "weighted_loads": [ + 0.6560288686305285, + 0.1866876222193241, + 0.7133566122502089, + 0.07512837648391724, + 0.20112236589193344, + 0.2953205928206444, + 0.744613990187645, + 0.2323922961950302, + 0.4550038259476423, + 0.1762995906174183, + 0.5663679465651512, + 0.12144973501563072, + 0.21587104722857475, + 0.7515861410647631, + 0.19605118967592716, + 0.8669469244778156, + 2.206299620680511, + 0.309052424505353, + 0.11603429168462753, + 0.8188745006918907, + 0.04726748540997505, + 0.5365915279835463, + 0.030741719529032707, + 0.5388157088309526, + 0.03550385683774948, + 0.24147189408540726, + 0.7528628427535295, + 1.2240538243204355, + 0.7413576953113079, + 0.12848341837525368, + 0.25606438145041466, + 0.09350644052028656, + 0.022810837253928185, + 0.6959480494260788, + 0.27664644084870815, + 0.9697713777422905, + 0.07117611169815063, + 0.09986498579382896, + 0.08331884630024433, + 0.1356954425573349, + 0.18222613260149956, + 0.12920241430401802, + 0.5057156346738338, + 0.37438543140888214, + 0.06788554042577744, + 0.15054693445563316, + 0.08458684012293816, + 0.0, + 0.8492716141045094, + 1.0173912048339844, + 0.1479660626500845, + 1.2647850401699543, + 0.870111595839262, + 0.11164484918117523, + 0.8578703822568059, + 0.588558953255415, + 0.18937725573778152, + 0.19770875200629234, + 0.39396865852177143, + 0.20396332815289497, + 0.37382639572024345, + 0.34832504019141197, + 0.36522191390395164, + 0.09215760976076126 + ], + "unique_experts": 63, + "load_cv": 0.7540400446189107, + "normalized_load_entropy": 0.9333176938762796, + "max_load_share": 0.046875 + } + }, + "s0_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "02a79e0ec45367d31525f15a8bc66ea302222e677f36224417a6f9175957c7e3", + "route_weight_sha256": "c4ba3fb3ab3cd6f825acd0788dc735403f8b6cabfd6259b8376dd65c8adcff9e", + "loads": [ + 4, + 1, + 1, + 1, + 0, + 3, + 5, + 1, + 5, + 0, + 1, + 1, + 0, + 2, + 0, + 4, + 17, + 3, + 1, + 5, + 0, + 1, + 0, + 1, + 0, + 4, + 8, + 2, + 5, + 2, + 0, + 1, + 0, + 1, + 5, + 2, + 0, + 1, + 1, + 2, + 2, + 0, + 1, + 2, + 0, + 1, + 1, + 0, + 0, + 1, + 2, + 6, + 3, + 3, + 4, + 0, + 1, + 3, + 6, + 0, + 5, + 4, + 2, + 0 + ], + "weighted_loads": [ + 0.11327066645026207, + 0.046116430312395096, + 0.024429358541965485, + 0.05759507045149803, + 0.0, + 0.2921473830938339, + 0.44284458830952644, + 0.13011740148067474, + 0.2635412570089102, + 0.0, + 0.07108726352453232, + 0.07940331101417542, + 0.0, + 0.06372005864977837, + 0.0, + 0.6516740508377552, + 2.244186021387577, + 0.08089901693165302, + 0.036782629787921906, + 0.2773714028298855, + 0.0, + 0.06318242102861404, + 0.0, + 0.039570603519678116, + 0.0, + 0.1663848552852869, + 0.46978992968797684, + 0.06767783686518669, + 0.6527312137186527, + 0.07834521308541298, + 0.0, + 0.027301790192723274, + 0.0, + 0.062284570187330246, + 0.27048905193805695, + 0.08175498060882092, + 0.0, + 0.04734772443771362, + 0.028656085953116417, + 0.0539209321141243, + 0.10504330322146416, + 0.0, + 0.03687141090631485, + 0.29673227295279503, + 0.0, + 0.09370338916778564, + 0.06100798770785332, + 0.0, + 0.0, + 0.03552107885479927, + 0.0761717613786459, + 0.5820615962147713, + 0.2894166260957718, + 0.08127722702920437, + 0.15747565031051636, + 0.0, + 0.03575228899717331, + 0.20100734010338783, + 0.2824128419160843, + 0.0, + 0.4288541227579117, + 0.14393836073577404, + 0.1305714137852192, + 0.0 + ], + "unique_experts": 47, + "load_cv": 1.2385158235059268, + "normalized_load_entropy": 0.85149477822227, + "max_load_share": 0.12318840579710146 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "2b658412f3dd7e8100ddb2635c44dbb1211289723f6f28bdb73e9c62cab26e14", + "route_weight_sha256": "81eff931dd27b0f04cb0c2de9ae06bc233ac10cc5bd63bbb8c0c35521c72d298", + "loads": [ + 4, + 2, + 4, + 1, + 7, + 3, + 7, + 1, + 7, + 0, + 10, + 1, + 3, + 7, + 2, + 8, + 21, + 7, + 1, + 7, + 0, + 7, + 0, + 1, + 0, + 6, + 18, + 7, + 8, + 2, + 1, + 2, + 1, + 1, + 6, + 13, + 0, + 1, + 1, + 2, + 3, + 0, + 8, + 2, + 0, + 1, + 1, + 0, + 14, + 3, + 2, + 12, + 14, + 4, + 9, + 3, + 4, + 3, + 7, + 1, + 5, + 6, + 6, + 0 + ], + "weighted_loads": [ + 0.11327066645026207, + 0.0853506550192833, + 0.1447624508291483, + 0.05759507045149803, + 0.27863094583153725, + 0.2921473830938339, + 0.6402678042650223, + 0.13011740148067474, + 0.38441150821745396, + 0.0, + 0.632160134613514, + 0.07940331101417542, + 0.15753313526511192, + 0.4218064770102501, + 0.07297582179307938, + 0.7837382815778255, + 2.384718588553369, + 0.22818065993487835, + 0.036782629787921906, + 0.8566155508160591, + 0.0, + 0.5008932519704103, + 0.0, + 0.039570603519678116, + 0.0, + 0.2422186527401209, + 0.9136216901242733, + 0.761714693158865, + 0.7545088734477758, + 0.07834521308541298, + 0.03229473531246185, + 0.09152022935450077, + 0.022871434688568115, + 0.062284570187330246, + 0.31856386736035347, + 0.7501702662557364, + 0.0, + 0.04734772443771362, + 0.028656085953116417, + 0.0539209321141243, + 0.14796316623687744, + 0.0, + 0.40800612419843674, + 0.29673227295279503, + 0.0, + 0.09370338916778564, + 0.06100798770785332, + 0.0, + 0.7810185439884663, + 0.21587250754237175, + 0.0761717613786459, + 0.8737313598394394, + 1.0946505852043629, + 0.09429012425243855, + 0.3221325119957328, + 0.31356069818139076, + 0.18334055319428444, + 0.20100734010338783, + 0.306955398991704, + 0.04285867139697075, + 0.4288541227579117, + 0.23199204541742802, + 0.30510663613677025, + 0.0 + ], + "unique_experts": 55, + "load_cv": 1.0076865081787252, + "normalized_load_entropy": 0.8849073199032179, + "max_load_share": 0.07291666666666667 + } + }, + "s1_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "af3ecb45a9c31c088f5d6c4d5ef6afebd91109c64237932a368a1653741224ff", + "route_weight_sha256": "ccb65ce274c66ea037b6a0f6b758551106b1043c1d6de1f8d8cde01b67778460", + "loads": [ + 6, + 1, + 1, + 1, + 0, + 3, + 5, + 1, + 5, + 0, + 1, + 1, + 0, + 2, + 0, + 4, + 17, + 0, + 1, + 8, + 0, + 0, + 0, + 1, + 0, + 3, + 7, + 1, + 6, + 2, + 0, + 0, + 0, + 1, + 6, + 2, + 0, + 1, + 0, + 2, + 3, + 0, + 1, + 2, + 0, + 1, + 1, + 0, + 1, + 1, + 2, + 6, + 5, + 1, + 2, + 0, + 1, + 3, + 6, + 1, + 5, + 5, + 2, + 0 + ], + "weighted_loads": [ + 0.1982622817158699, + 0.04851962625980377, + 0.024199049919843674, + 0.0676860511302948, + 0.0, + 0.2822934165596962, + 0.420632092282176, + 0.09441032260656357, + 0.27839956246316433, + 0.0, + 0.06761473417282104, + 0.0754685029387474, + 0.0, + 0.06625902466475964, + 0.0, + 0.6528007499873638, + 2.1468550488352776, + 0.0, + 0.03941056504845619, + 0.3736604917794466, + 0.0, + 0.0, + 0.0, + 0.04127230867743492, + 0.0, + 0.12841008976101875, + 0.4136245884001255, + 0.022846607491374016, + 0.7263122946023941, + 0.07823838293552399, + 0.0, + 0.0, + 0.0, + 0.0647326186299324, + 0.2814635504037142, + 0.07343537174165249, + 0.0, + 0.05118666589260101, + 0.0, + 0.05595304071903229, + 0.16341836750507355, + 0.0, + 0.03841663897037506, + 0.2938191890716553, + 0.0, + 0.09498719871044159, + 0.06154464930295944, + 0.0, + 0.029867637902498245, + 0.03583827242255211, + 0.07280582748353481, + 0.6125977374613285, + 0.35012310184538364, + 0.025492684915661812, + 0.0917883887887001, + 0.0, + 0.02991083264350891, + 0.19465965777635574, + 0.29155214317142963, + 0.034222088754177094, + 0.42188478261232376, + 0.17500845715403557, + 0.11543207988142967, + 0.0 + ], + "unique_experts": 45, + "load_cv": 1.3122946324162235, + "normalized_load_entropy": 0.8323929889821928, + "max_load_share": 0.12318840579710146 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "a48de5ebc20e68bd1422909882e30583ee2833364748979fba53196fb940e7eb", + "route_weight_sha256": "3dad7196a663c7df5ff32c63b0fd07c2f8958e3a385908207aaad86d68bcd953", + "loads": [ + 15, + 3, + 4, + 1, + 2, + 4, + 8, + 2, + 8, + 3, + 11, + 1, + 7, + 12, + 6, + 7, + 19, + 5, + 4, + 11, + 1, + 6, + 1, + 8, + 1, + 8, + 15, + 11, + 8, + 3, + 6, + 0, + 1, + 5, + 6, + 20, + 1, + 2, + 1, + 2, + 3, + 3, + 13, + 3, + 1, + 2, + 1, + 0, + 15, + 5, + 3, + 16, + 16, + 2, + 15, + 9, + 5, + 3, + 8, + 4, + 5, + 8, + 4, + 1 + ], + "weighted_loads": [ + 0.7434702683240175, + 0.14783188328146935, + 0.7451196927577257, + 0.0676860511302948, + 0.1106446124613285, + 0.2975723519921303, + 0.5279606748372316, + 0.17410801351070404, + 0.4036303348839283, + 0.1762995906174183, + 0.6063103526830673, + 0.0754685029387474, + 0.3315825127065182, + 0.733018210157752, + 0.23151110112667084, + 0.7722646705806255, + 2.2087226836010814, + 0.20985083281993866, + 0.14485466480255127, + 0.9669530186802149, + 0.04726748540997505, + 0.43462502025067806, + 0.030741719529032707, + 0.6508627440780401, + 0.03550385683774948, + 0.321514243260026, + 0.7068409230560064, + 1.1024242397397757, + 0.7572584934532642, + 0.1270228885114193, + 0.23488782718777657, + 0.0, + 0.022810837253928185, + 0.657593734562397, + 0.2814635504037142, + 1.0634759683161974, + 0.07117611169815063, + 0.09152144938707352, + 0.054455939680337906, + 0.05595304071903229, + 0.16341836750507355, + 0.21004555746912956, + 0.6498036310076714, + 0.34232407808303833, + 0.06788554042577744, + 0.15351808443665504, + 0.06154464930295944, + 0.0, + 1.1073251850903034, + 0.9687860272824764, + 0.12426813133060932, + 1.34366450086236, + 1.1243651453405619, + 0.03850558213889599, + 0.860015076585114, + 0.6137208268046379, + 0.18369761481881142, + 0.19465965777635574, + 0.35325303114950657, + 0.20158230140805244, + 0.42188478261232376, + 0.32818615064024925, + 0.1815888099372387, + 0.09215760976076126 + ], + "unique_experts": 62, + "load_cv": 0.840593375076334, + "normalized_load_entropy": 0.9183236865447622, + "max_load_share": 0.052083333333333336 + } + }, + "s0_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "02967516f46ef1b873cd334c8335431c0a92c089b84f7cb7bebfabd54c130603", + "route_weight_sha256": "9164cf202bdc3c241c98ff6ca91945ffed35bc98f37cd070514e3e3a629c731c", + "loads": [ + 3, + 1, + 1, + 1, + 0, + 3, + 5, + 1, + 5, + 0, + 1, + 1, + 0, + 2, + 0, + 4, + 17, + 1, + 1, + 7, + 0, + 1, + 0, + 1, + 0, + 4, + 8, + 1, + 5, + 2, + 0, + 1, + 0, + 1, + 5, + 2, + 0, + 1, + 1, + 3, + 2, + 0, + 2, + 2, + 0, + 1, + 1, + 0, + 0, + 1, + 3, + 6, + 3, + 2, + 4, + 0, + 1, + 3, + 6, + 1, + 5, + 3, + 2, + 0 + ], + "weighted_loads": [ + 0.08345069736242294, + 0.046966928988695145, + 0.022919941693544388, + 0.05687535181641579, + 0.0, + 0.28936246782541275, + 0.45303336158394814, + 0.12031231820583344, + 0.27583965100347996, + 0.0, + 0.07132253795862198, + 0.07924391329288483, + 0.0, + 0.062180208042263985, + 0.0, + 0.6794897057116032, + 2.244586031883955, + 0.031947530806064606, + 0.03493902459740639, + 0.3592518549412489, + 0.0, + 0.06303867697715759, + 0.0, + 0.04165519028902054, + 0.0, + 0.15084097534418106, + 0.4882761389017105, + 0.03338871896266937, + 0.6521900855004787, + 0.0793076865375042, + 0.0, + 0.025331322103738785, + 0.0, + 0.05427578091621399, + 0.2727976217865944, + 0.08025355823338032, + 0.0, + 0.05091269314289093, + 0.02970360964536667, + 0.08232237957417965, + 0.10984599962830544, + 0.0, + 0.06494101695716381, + 0.2472245693206787, + 0.0, + 0.09438086301088333, + 0.06259511411190033, + 0.0, + 0.0, + 0.034808866679668427, + 0.10643953830003738, + 0.5836134105920792, + 0.30120810493826866, + 0.05164122022688389, + 0.16096732579171658, + 0.0, + 0.035906609147787094, + 0.20012926310300827, + 0.2894445136189461, + 0.035229962319135666, + 0.4322974272072315, + 0.11828915402293205, + 0.13737376779317856, + 0.0 + ], + "unique_experts": 48, + "load_cv": 1.2493224376617578, + "normalized_load_entropy": 0.8520363011880994, + "max_load_share": 0.12318840579710146 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "38924450be168feecd79d0671d355c277b22006f9566446cdb023af5b8bf6735", + "route_weight_sha256": "2cf7545b6cc0f03dd8ce4b21ca8bac7b89b1a1181f4bcb482ccfd81773112d78", + "loads": [ + 3, + 2, + 4, + 1, + 6, + 3, + 9, + 1, + 7, + 0, + 8, + 1, + 3, + 9, + 2, + 8, + 18, + 5, + 1, + 9, + 0, + 9, + 0, + 1, + 0, + 6, + 18, + 6, + 8, + 2, + 1, + 2, + 1, + 1, + 6, + 13, + 0, + 1, + 1, + 3, + 4, + 0, + 7, + 2, + 0, + 2, + 1, + 0, + 13, + 3, + 3, + 13, + 13, + 3, + 9, + 4, + 3, + 3, + 7, + 3, + 5, + 5, + 6, + 0 + ], + "weighted_loads": [ + 0.08345069736242294, + 0.08367269858717918, + 0.14272108115255833, + 0.05687535181641579, + 0.2282540425658226, + 0.28936246782541275, + 0.7679734118282795, + 0.12031231820583344, + 0.40071408636868, + 0.0, + 0.5415028147399426, + 0.07924391329288483, + 0.16326060891151428, + 0.47146456129848957, + 0.07749957963824272, + 0.8282836899161339, + 2.2578854775056243, + 0.1993064098060131, + 0.03493902459740639, + 0.9384960029274225, + 0.0, + 0.5837801415473223, + 0.0, + 0.04165519028902054, + 0.0, + 0.22810877114534378, + 0.932107899338007, + 0.7220251858234406, + 0.7487973440438509, + 0.0793076865375042, + 0.029087642207741737, + 0.09711195155978203, + 0.022871434688568115, + 0.05427578091621399, + 0.3208724372088909, + 0.7041043359786272, + 0.0, + 0.05091269314289093, + 0.02970360964536667, + 0.08232237957417965, + 0.19253400340676308, + 0.0, + 0.3562262784689665, + 0.2472245693206787, + 0.0, + 0.13684750348329544, + 0.06259511411190033, + 0.0, + 0.7441411949694157, + 0.26635707169771194, + 0.10643953830003738, + 0.9463994204998016, + 0.9151874631643295, + 0.06465411745011806, + 0.32722014654427767, + 0.38269440457224846, + 0.12459307163953781, + 0.20012926310300827, + 0.3139870706945658, + 0.158347487449646, + 0.4322974272072315, + 0.20633875206112862, + 0.3134695999324322, + 0.0 + ], + "unique_experts": 55, + "load_cv": 0.9622504486493764, + "normalized_load_entropy": 0.8917074566698105, + "max_load_share": 0.0625 + } + }, + "s1_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "18209c5e375ead89b523ec247f753184d5b65a886a20e5dad38c12ad8222697f", + "route_weight_sha256": "6bffc1c0f96ffc640f86a1a2e71b2f6c9f898aa7e06daadf7ecaf63241557fc5", + "loads": [ + 6, + 1, + 1, + 1, + 0, + 3, + 5, + 1, + 6, + 0, + 1, + 1, + 0, + 2, + 0, + 4, + 17, + 0, + 1, + 8, + 0, + 1, + 0, + 1, + 0, + 3, + 7, + 1, + 6, + 2, + 0, + 0, + 1, + 1, + 4, + 3, + 0, + 1, + 1, + 1, + 3, + 0, + 1, + 2, + 0, + 1, + 2, + 0, + 0, + 0, + 2, + 6, + 4, + 1, + 2, + 0, + 1, + 3, + 6, + 1, + 4, + 5, + 3, + 0 + ], + "weighted_loads": [ + 0.2023160643875599, + 0.048783015459775925, + 0.022547177970409393, + 0.06785009056329727, + 0.0, + 0.29175327718257904, + 0.43564241379499435, + 0.09547916799783707, + 0.31321756541728973, + 0.0, + 0.06890875846147537, + 0.07505645602941513, + 0.0, + 0.06382249109447002, + 0.0, + 0.664520762860775, + 2.115424569696188, + 0.0, + 0.040983155369758606, + 0.4054099041968584, + 0.0, + 0.06100950017571449, + 0.0, + 0.042356327176094055, + 0.0, + 0.12443732470273972, + 0.4346869997680187, + 0.025918660685420036, + 0.698887050151825, + 0.0793721117079258, + 0.0, + 0.0, + 0.024443410336971283, + 0.05717255920171738, + 0.20732047595083714, + 0.11430137418210506, + 0.0, + 0.054731085896492004, + 0.02740444801747799, + 0.03160874918103218, + 0.17626068368554115, + 0.0, + 0.039090171456336975, + 0.29437730833888054, + 0.0, + 0.08668461441993713, + 0.09518121927976608, + 0.0, + 0.0, + 0.0, + 0.07037682086229324, + 0.6190032325685024, + 0.28316996060311794, + 0.025195369496941566, + 0.09719756618142128, + 0.0, + 0.031185336410999298, + 0.188098955899477, + 0.2900713961571455, + 0.036092426627874374, + 0.35921356827020645, + 0.1887172870337963, + 0.15156850591301918, + 0.0 + ], + "unique_experts": 46, + "load_cv": 1.2916450696407764, + "normalized_load_entropy": 0.8388170788601923, + "max_load_share": 0.12318840579710146 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "89ba768d963018e59e68e43ab135e7db3aa582a21d172d1a9b307dc3132ed527", + "route_weight_sha256": "3bc4eb099fd447e430d7520f747a8336e2a75190369e06193202a35a1917f5ba", + "loads": [ + 14, + 3, + 4, + 1, + 3, + 4, + 9, + 2, + 9, + 3, + 9, + 1, + 6, + 14, + 6, + 7, + 20, + 5, + 5, + 12, + 1, + 7, + 1, + 8, + 1, + 6, + 15, + 11, + 8, + 3, + 5, + 0, + 2, + 6, + 4, + 22, + 1, + 2, + 2, + 1, + 3, + 2, + 13, + 3, + 1, + 2, + 2, + 0, + 13, + 4, + 3, + 17, + 14, + 2, + 15, + 10, + 5, + 3, + 7, + 5, + 4, + 8, + 4, + 1 + ], + "weighted_loads": [ + 0.7128694113343954, + 0.14968827366828918, + 0.7512005586177111, + 0.06785009056329727, + 0.12238015979528427, + 0.3070322126150131, + 0.6120990328490734, + 0.17517685890197754, + 0.4384483378380537, + 0.1762995906174183, + 0.5454713255167007, + 0.07505645602941513, + 0.30827686563134193, + 0.7967671044170856, + 0.2464999295771122, + 0.7838683724403381, + 2.2243815762922168, + 0.20985083281993866, + 0.18648239597678185, + 1.0278657488524914, + 0.04726748540997505, + 0.49563452042639256, + 0.030741719529032707, + 0.6505449991673231, + 0.03550385683774948, + 0.2207410167902708, + 0.7279033344238997, + 1.0763663705438375, + 0.7298332490026951, + 0.1281566172838211, + 0.2100885771214962, + 0.0, + 0.04725424759089947, + 0.6773801557719707, + 0.20732047595083714, + 1.120508810505271, + 0.07117611169815063, + 0.09506586939096451, + 0.0818603876978159, + 0.03160874918103218, + 0.17626068368554115, + 0.12920241430401802, + 0.6992085836827755, + 0.3428821973502636, + 0.06788554042577744, + 0.1452155001461506, + 0.09518121927976608, + 0.0, + 0.9453201182186604, + 1.035982072353363, + 0.12183912470936775, + 1.4153332971036434, + 0.8593778070062399, + 0.03820826672017574, + 0.8955380143597722, + 0.6498093232512474, + 0.1849721185863018, + 0.188098955899477, + 0.31493830867111683, + 0.27240994572639465, + 0.35921356827020645, + 0.33296414464712143, + 0.18816499412059784, + 0.09215760976076126 + ], + "unique_experts": 62, + "load_cv": 0.8513673642376062, + "normalized_load_entropy": 0.9185348123394391, + "max_load_share": 0.057291666666666664 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 12, + "mean_set_jaccard": 0.8540372670807455, + "mean_token_weighted_tv": 0.025736050356341446, + "aggregate_load_tv": 0.06521739130434784 + }, + "system_bos": { + "tokens": 23, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8881987577639753, + "mean_token_weighted_tv": 0.024069292592289654, + "aggregate_load_tv": 0.06521739130434782 + }, + "system_x": { + "tokens": 23, + "ordered_topk_exact_tokens": 8, + "set_exact_tokens": 11, + "mean_set_jaccard": 0.8322981366459629, + "mean_token_weighted_tv": 0.0336620767965265, + "aggregate_load_tv": 0.09420289855072464 + }, + "system_period": { + "tokens": 23, + "ordered_topk_exact_tokens": 8, + "set_exact_tokens": 12, + "mean_set_jaccard": 0.8354037267080746, + "mean_token_weighted_tv": 0.03733010594125675, + "aggregate_load_tv": 0.10144927536231883 + }, + "bos_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 11, + "mean_set_jaccard": 0.8509316770186335, + "mean_token_weighted_tv": 0.029709107728432053, + "aggregate_load_tv": 0.06521739130434782 + }, + "bos_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 12, + "mean_set_jaccard": 0.8633540372670808, + "mean_token_weighted_tv": 0.03163905125921187, + "aggregate_load_tv": 0.06521739130434781 + }, + "x_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 12, + "mean_set_jaccard": 0.8633540372670809, + "mean_token_weighted_tv": 0.03122036300761544, + "aggregate_load_tv": 0.06521739130434781 + }, + "x_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 3, + "set_exact_tokens": 9, + "mean_set_jaccard": 0.7981366459627329, + "mean_token_weighted_tv": 0.04575045759101277, + "aggregate_load_tv": 0.10869565217391304 + }, + "period_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8881987577639753, + "mean_token_weighted_tv": 0.027270972971682964, + "aggregate_load_tv": 0.05072463768115942 + }, + "period_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 4, + "set_exact_tokens": 10, + "mean_set_jaccard": 0.8198757763975155, + "mean_token_weighted_tv": 0.04158066030915664, + "aggregate_load_tv": 0.10869565217391303 + } + } + }, + "layer_22": { + "layer": 22, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "851b40d4fbc77da293646a00cff4a4f8fb8fe03d9db13ff68459af2876602a44", + "route_weight_sha256": "4dcd8d6d7d1f35bd25a6d3c86043b729a27a3128aa4aa9945b1ce11e84174dfa", + "loads": [ + 1, + 0, + 2, + 1, + 1, + 2, + 0, + 0, + 22, + 0, + 4, + 2, + 0, + 0, + 11, + 4, + 1, + 0, + 2, + 1, + 4, + 0, + 1, + 0, + 1, + 0, + 0, + 0, + 1, + 4, + 0, + 4, + 4, + 2, + 1, + 8, + 0, + 3, + 0, + 5, + 1, + 0, + 0, + 5, + 1, + 2, + 0, + 1, + 1, + 2, + 0, + 0, + 0, + 1, + 4, + 0, + 3, + 2, + 4, + 1, + 2, + 9, + 0, + 7 + ], + "weighted_loads": [ + 0.02771659754216671, + 0.0, + 0.3378155082464218, + 0.02135366201400757, + 0.036629583686590195, + 0.072383351624012, + 0.0, + 0.0, + 3.4553859159350395, + 0.0, + 0.16912253573536873, + 0.08473793044686317, + 0.0, + 0.0, + 0.9305396843701601, + 0.23632558807730675, + 0.021829815581440926, + 0.0, + 0.1273995265364647, + 0.04633726552128792, + 0.2438524179160595, + 0.0, + 0.0705978274345398, + 0.0, + 0.035384662449359894, + 0.0, + 0.0, + 0.0, + 0.03485722839832306, + 0.2616062220185995, + 0.0, + 0.3167508579790592, + 0.23445207253098488, + 0.051557447761297226, + 0.033082813024520874, + 0.4790922701358795, + 0.0, + 0.14734119176864624, + 0.0, + 0.3471774682402611, + 0.032593026757240295, + 0.0, + 0.0, + 0.18664653785526752, + 0.06404957920312881, + 0.23715515434741974, + 0.0, + 0.03044843301177025, + 0.051797669380903244, + 0.10385183058679104, + 0.0, + 0.0, + 0.0, + 0.03227957710623741, + 0.6358037814497948, + 0.0, + 0.08362370170652866, + 0.06859338283538818, + 0.5462688654661179, + 0.0468011312186718, + 0.09411431103944778, + 0.44855863973498344, + 0.0, + 0.47863863222301006 + ], + "unique_experts": 41, + "load_cv": 1.5859470020463253, + "normalized_load_entropy": 0.7945715775359565, + "max_load_share": 0.15942028985507245 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "a19d641f2b66fbb8f67b306a4a897f0a2930ed501afba02ffe3dc6211847453f", + "route_weight_sha256": "a5b3c86359206bb63100fde35444ee08ea1cd2c8cbba6ce243a94f7fb43f1deb", + "loads": [ + 5, + 1, + 5, + 10, + 1, + 4, + 4, + 1, + 37, + 5, + 4, + 6, + 0, + 0, + 16, + 4, + 1, + 2, + 2, + 1, + 4, + 7, + 2, + 1, + 1, + 1, + 0, + 4, + 1, + 4, + 0, + 4, + 7, + 7, + 3, + 11, + 0, + 5, + 0, + 5, + 4, + 1, + 5, + 5, + 1, + 3, + 0, + 1, + 3, + 5, + 4, + 0, + 0, + 2, + 4, + 15, + 7, + 4, + 4, + 1, + 11, + 16, + 0, + 16 + ], + "weighted_loads": [ + 0.20174530614167452, + 0.04782187566161156, + 0.4420550875365734, + 1.897215485572815, + 0.036629583686590195, + 0.14612472709268332, + 0.23070279974490404, + 0.07952167838811874, + 4.863271849229932, + 0.18824944831430912, + 0.16912253573536873, + 0.2405331889167428, + 0.0, + 0.0, + 1.351780727505684, + 0.23632558807730675, + 0.021829815581440926, + 0.06537546217441559, + 0.1273995265364647, + 0.04633726552128792, + 0.2438524179160595, + 0.6502199321985245, + 0.09900654666125774, + 0.03360389918088913, + 0.035384662449359894, + 0.026248497888445854, + 0.0, + 0.17731526866555214, + 0.03485722839832306, + 0.2616062220185995, + 0.0, + 0.3167508579790592, + 0.30968298576772213, + 0.22570418566465378, + 0.12735652923583984, + 0.6392569094896317, + 0.0, + 0.22201144322752953, + 0.0, + 0.3471774682402611, + 0.1677837986499071, + 0.04125182703137398, + 0.3099103681743145, + 0.18664653785526752, + 0.06404957920312881, + 0.26975222304463387, + 0.0, + 0.03044843301177025, + 0.14763979613780975, + 0.3376896549016237, + 0.19258377514779568, + 0.0, + 0.0, + 0.07200274616479874, + 0.6358037814497948, + 1.196579939685762, + 0.24621871672570705, + 0.1327157635241747, + 0.5462688654661179, + 0.0468011312186718, + 1.4634885042905807, + 0.6989934388548136, + 0.0, + 0.918777834624052 + ], + "unique_experts": 54, + "load_cv": 1.2741494379088572, + "normalized_load_entropy": 0.8605329810591251, + "max_load_share": 0.1284722222222222 + } + }, + "s1_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "101132b94eaaacdabb0ba88c363fbf4381a289cce9da26eb4e170d53aa13e0a7", + "route_weight_sha256": "ca2ccfce85c8a091e2761c5fb0f077c6b98cc1fb20e531b85f952ca84893ad38", + "loads": [ + 1, + 0, + 2, + 1, + 1, + 2, + 0, + 0, + 22, + 0, + 4, + 2, + 0, + 0, + 11, + 4, + 0, + 0, + 2, + 1, + 4, + 0, + 1, + 0, + 1, + 0, + 0, + 1, + 1, + 4, + 0, + 4, + 4, + 2, + 1, + 8, + 0, + 3, + 0, + 5, + 1, + 0, + 0, + 5, + 2, + 2, + 0, + 0, + 1, + 1, + 0, + 0, + 0, + 1, + 4, + 1, + 3, + 2, + 4, + 1, + 2, + 9, + 0, + 7 + ], + "weighted_loads": [ + 0.029353218153119087, + 0.0, + 0.3316684514284134, + 0.022237097844481468, + 0.038232602179050446, + 0.07508970610797405, + 0.0, + 0.0, + 3.470626825466752, + 0.0, + 0.17075065523386002, + 0.08162172883749008, + 0.0, + 0.0, + 0.9217360280454159, + 0.22557376697659492, + 0.0, + 0.0, + 0.12268264964222908, + 0.045267678797245026, + 0.23710625618696213, + 0.0, + 0.07481076568365097, + 0.0, + 0.03649419918656349, + 0.0, + 0.0, + 0.029141634702682495, + 0.03313665837049484, + 0.25313002057373524, + 0.0, + 0.3033904992043972, + 0.2394518032670021, + 0.05000223033130169, + 0.032454002648591995, + 0.47083164751529694, + 0.0, + 0.13621803745627403, + 0.0, + 0.3399930689483881, + 0.029957396909594536, + 0.0, + 0.0, + 0.19076036289334297, + 0.09512185491621494, + 0.2259945049881935, + 0.0, + 0.0, + 0.0499187633395195, + 0.07669463753700256, + 0.0, + 0.0, + 0.0, + 0.030596952885389328, + 0.6551348343491554, + 0.023137694224715233, + 0.0981801301240921, + 0.07213806174695492, + 0.5263720992952585, + 0.04936981573700905, + 0.09332342818379402, + 0.46059953421354294, + 0.0, + 0.4884590692818165 + ], + "unique_experts": 41, + "load_cv": 1.5859470020463253, + "normalized_load_entropy": 0.7945715775359565, + "max_load_share": 0.15942028985507245 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "0446e5e001334c1697650094e9e033872bb416392c6688fc6015f09c767d5539", + "route_weight_sha256": "ffa679da854ad9047df6c80a0044bab66bab681149ea18d8005a2279fbb9a879", + "loads": [ + 3, + 4, + 2, + 12, + 1, + 4, + 5, + 1, + 44, + 9, + 4, + 9, + 3, + 0, + 16, + 8, + 3, + 3, + 3, + 1, + 5, + 14, + 2, + 2, + 1, + 1, + 0, + 4, + 2, + 4, + 1, + 4, + 6, + 12, + 9, + 14, + 2, + 5, + 0, + 6, + 11, + 1, + 4, + 7, + 2, + 3, + 1, + 2, + 4, + 5, + 10, + 3, + 5, + 3, + 4, + 22, + 7, + 4, + 7, + 1, + 17, + 19, + 1, + 12 + ], + "weighted_loads": [ + 0.15760695468634367, + 0.4306946210563183, + 0.3316684514284134, + 2.167156247422099, + 0.038232602179050446, + 0.135892772115767, + 0.2852696431800723, + 0.04178010672330856, + 5.377966571599245, + 0.4687822423875332, + 0.17075065523386002, + 0.4986554952338338, + 0.14009735733270645, + 0.0, + 1.3766657337546349, + 0.45995841175317764, + 0.1471867747604847, + 0.09639943391084671, + 0.1608121134340763, + 0.045267678797245026, + 0.28587428107857704, + 1.1652618050575256, + 0.11857869103550911, + 0.09060174413025379, + 0.03649419918656349, + 0.025535497814416885, + 0.0, + 0.16874894499778748, + 0.11705753952264786, + 0.25313002057373524, + 0.053172964602708817, + 0.3033904992043972, + 0.29477688018232584, + 0.39794163405895233, + 0.38408825173974037, + 0.7357404865324497, + 0.08945801109075546, + 0.20751742646098137, + 0.0, + 0.38894459791481495, + 0.6562998257577419, + 0.025383980944752693, + 0.31600136682391167, + 0.3294572941958904, + 0.09512185491621494, + 0.26259011402726173, + 0.033966828137636185, + 0.06637953221797943, + 0.1779811941087246, + 0.6163292117416859, + 0.493806017562747, + 0.20989754423499107, + 0.5453501455485821, + 0.11985380947589874, + 0.6551348343491554, + 1.7569050826132298, + 0.3088567554950714, + 0.14324664138257504, + 0.5998578378930688, + 0.04936981573700905, + 2.2654460705816746, + 0.8895717151463032, + 0.030640659853816032, + 0.8254706263542175 + ], + "unique_experts": 61, + "load_cv": 1.1388041973930374, + "normalized_load_entropy": 0.88868000216685, + "max_load_share": 0.11458333333333333 + } + }, + "s0_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "38b8f4d8b969c148aa8e9fbeeaaec3a74d2dc0bec6f6f59da13c03ca8e18fec0", + "route_weight_sha256": "83c748a45bd316cbe8a44f8044fa2b7c6d435eba0a16e6c006b061ccc7a9d6af", + "loads": [ + 1, + 0, + 2, + 0, + 1, + 2, + 1, + 0, + 22, + 0, + 3, + 2, + 0, + 0, + 8, + 4, + 1, + 0, + 2, + 1, + 4, + 0, + 1, + 0, + 2, + 0, + 0, + 1, + 1, + 4, + 1, + 3, + 4, + 2, + 1, + 7, + 0, + 3, + 0, + 5, + 1, + 0, + 0, + 5, + 2, + 2, + 0, + 1, + 1, + 2, + 0, + 0, + 0, + 1, + 4, + 1, + 4, + 3, + 5, + 1, + 2, + 9, + 0, + 5 + ], + "weighted_loads": [ + 0.026871584355831146, + 0.0, + 0.3593590557575226, + 0.0, + 0.03742227330803871, + 0.06803257018327713, + 0.03336385637521744, + 0.0, + 3.371022617444396, + 0.0, + 0.14219960197806358, + 0.08013249933719635, + 0.0, + 0.0, + 0.8140971139073372, + 0.2440503127872944, + 0.02734909951686859, + 0.0, + 0.13168548420071602, + 0.04674574360251427, + 0.2643807530403137, + 0.0, + 0.07526671141386032, + 0.0, + 0.07005173340439796, + 0.0, + 0.0, + 0.029102180153131485, + 0.035906706005334854, + 0.274599339812994, + 0.025681745260953903, + 0.27330270037055016, + 0.2557900436222553, + 0.051671648398041725, + 0.029797738417983055, + 0.4676668122410774, + 0.0, + 0.15204324573278427, + 0.0, + 0.39154503494501114, + 0.03193139657378197, + 0.0, + 0.0, + 0.19685715436935425, + 0.08551616780459881, + 0.22600439935922623, + 0.0, + 0.02882506512105465, + 0.05196508765220642, + 0.09573661163449287, + 0.0, + 0.0, + 0.0, + 0.030552860349416733, + 0.6672345288097858, + 0.02525198459625244, + 0.1215619184076786, + 0.10067740455269814, + 0.5978136323392391, + 0.05181683227419853, + 0.10952429100871086, + 0.4426501579582691, + 0.0, + 0.43561094254255295 + ], + "unique_experts": 44, + "load_cv": 1.4987917839360487, + "normalized_load_entropy": 0.8179105773569827, + "max_load_share": 0.15942028985507245 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "69fd6e586a7f0ca833ea4a9ac8d632a922305b33b829bee6468aa1b479d3b242", + "route_weight_sha256": "bfc629d21e4c4c523c289d6b5628609e74401e3ed20de9f008f8fc3de1397050", + "loads": [ + 6, + 1, + 5, + 8, + 1, + 3, + 4, + 1, + 35, + 5, + 4, + 6, + 0, + 0, + 11, + 5, + 1, + 1, + 2, + 1, + 4, + 7, + 2, + 0, + 4, + 1, + 0, + 5, + 1, + 5, + 1, + 3, + 6, + 8, + 3, + 11, + 0, + 5, + 0, + 5, + 5, + 1, + 5, + 5, + 2, + 3, + 0, + 1, + 4, + 5, + 3, + 0, + 0, + 2, + 4, + 15, + 8, + 6, + 5, + 1, + 12, + 16, + 0, + 14 + ], + "weighted_loads": [ + 0.23416307475417852, + 0.04555397480726242, + 0.4635986350476742, + 0.9850540161132812, + 0.03742227330803871, + 0.08063848596066236, + 0.25294043868780136, + 0.9181379675865173, + 4.631742957979441, + 0.18824944831430912, + 0.15832146257162094, + 0.25613059382885695, + 0.0, + 0.0, + 1.1614776216447353, + 0.2863953933119774, + 0.02734909951686859, + 0.025755219161510468, + 0.13168548420071602, + 0.04674574360251427, + 0.2643807530403137, + 0.6390606313943863, + 0.10367543064057827, + 0.0, + 0.09962353063747287, + 0.026248497888445854, + 0.0, + 0.21373188123106956, + 0.035906706005334854, + 0.3185627795755863, + 0.025681745260953903, + 0.27330270037055016, + 0.32447531446814537, + 0.2655233684927225, + 0.12151391245424747, + 0.6648804806172848, + 0.0, + 0.2635618522763252, + 0.0, + 0.39154503494501114, + 0.20434975624084473, + 0.07362374663352966, + 0.21194221265614033, + 0.19685715436935425, + 0.08551616780459881, + 0.25860146805644035, + 0.0, + 0.02882506512105465, + 0.24798034131526947, + 0.28521567350253463, + 0.14723502844572067, + 0.0, + 0.0, + 0.07027602940797806, + 0.6672345288097858, + 1.1974042234942317, + 0.284156933426857, + 0.17909768410027027, + 0.5978136323392391, + 0.05181683227419853, + 1.53466210141778, + 0.6930849570780993, + 0.0, + 0.8056175913661718 + ], + "unique_experts": 54, + "load_cv": 1.1934750588300465, + "normalized_load_entropy": 0.8712959569935957, + "max_load_share": 0.12152777777777778 + } + }, + "s1_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "996caebc895946dd77b1abdabb74c063095bcdfbcbcb7d598328fe0c204b1011", + "route_weight_sha256": "833854c2f2a9c83a679e0fca3f829a518be4ba5bbcf513b97a116d1b78fd9ae5", + "loads": [ + 1, + 0, + 2, + 0, + 1, + 2, + 1, + 0, + 22, + 0, + 4, + 1, + 0, + 0, + 9, + 4, + 1, + 0, + 2, + 1, + 4, + 0, + 1, + 0, + 2, + 0, + 0, + 1, + 1, + 4, + 0, + 3, + 4, + 2, + 1, + 7, + 0, + 3, + 0, + 4, + 1, + 0, + 0, + 5, + 2, + 2, + 0, + 0, + 1, + 2, + 0, + 0, + 0, + 1, + 4, + 1, + 4, + 2, + 5, + 1, + 2, + 9, + 0, + 8 + ], + "weighted_loads": [ + 0.026433240622282028, + 0.0, + 0.35534997284412384, + 0.0, + 0.041649892926216125, + 0.06753415055572987, + 0.03497365117073059, + 0.0, + 3.340958772227168, + 0.0, + 0.1720952857285738, + 0.05672992765903473, + 0.0, + 0.0, + 0.8048953860998154, + 0.2330089993774891, + 0.023841792717576027, + 0.0, + 0.12653402611613274, + 0.04547804221510887, + 0.23681355267763138, + 0.0, + 0.08172731846570969, + 0.0, + 0.06934083253145218, + 0.0, + 0.0, + 0.030404219403862953, + 0.033520374447107315, + 0.2730733323842287, + 0.0, + 0.27039456367492676, + 0.25480829924345016, + 0.050735775381326675, + 0.03088831529021263, + 0.48917000740766525, + 0.0, + 0.14556441828608513, + 0.0, + 0.3484264276921749, + 0.029157867655158043, + 0.0, + 0.0, + 0.19230343028903008, + 0.07978397235274315, + 0.22216949611902237, + 0.0, + 0.0, + 0.05959007516503334, + 0.09537198767066002, + 0.0, + 0.0, + 0.0, + 0.031789444386959076, + 0.6600774079561234, + 0.023040946573019028, + 0.12642256915569305, + 0.06902683340013027, + 0.6320780124515295, + 0.05376459285616875, + 0.10409166291356087, + 0.44219426810741425, + 0.0, + 0.532257804647088 + ], + "unique_experts": 42, + "load_cv": 1.5473347751964477, + "normalized_load_entropy": 0.8036590446760886, + "max_load_share": 0.15942028985507245 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "0f857eae477f14da0c1e68e1c7fca764849b703a8701bd3814247f8d0f961c85", + "route_weight_sha256": "7448b4d3e2b7249bb525e39b19e191a00fbbf5a43bb004b3ed850fbdf1d5058e", + "loads": [ + 5, + 4, + 2, + 10, + 1, + 3, + 5, + 1, + 44, + 9, + 4, + 9, + 3, + 0, + 13, + 9, + 4, + 3, + 3, + 1, + 5, + 12, + 2, + 0, + 2, + 1, + 0, + 5, + 2, + 4, + 0, + 3, + 5, + 11, + 9, + 14, + 2, + 5, + 0, + 5, + 12, + 1, + 4, + 7, + 2, + 2, + 1, + 2, + 7, + 5, + 10, + 3, + 5, + 4, + 4, + 21, + 8, + 4, + 8, + 1, + 18, + 19, + 1, + 15 + ], + "weighted_loads": [ + 0.2189578553661704, + 0.4306946210563183, + 0.35534997284412384, + 1.2498438879847527, + 0.041649892926216125, + 0.0801400663331151, + 0.31036556512117386, + 0.04178010672330856, + 5.185996986925602, + 0.4687822423875332, + 0.1720952857285738, + 0.5386709766462445, + 0.14009735733270645, + 0.0, + 1.3226285614073277, + 0.5084980018436909, + 0.17102856747806072, + 0.08705583587288857, + 0.16466348990797997, + 0.04547804221510887, + 0.2855815775692463, + 1.0499352850019932, + 0.12549524381756783, + 0.0, + 0.06934083253145218, + 0.025535497814416885, + 0.0, + 0.22138247825205326, + 0.11744125559926033, + 0.2730733323842287, + 0.0, + 0.27039456367492676, + 0.30409956723451614, + 0.37034716829657555, + 0.38435176759958267, + 0.8090939968824387, + 0.08945801109075546, + 0.23160604387521744, + 0.0, + 0.39737795665860176, + 0.6909690015017986, + 0.025383980944752693, + 0.30029255524277687, + 0.33100036159157753, + 0.07978397235274315, + 0.22216949611902237, + 0.033966828137636185, + 0.06637953221797943, + 0.3839505761861801, + 0.6255129687488079, + 0.4800651166588068, + 0.20989754423499107, + 0.5453501455485821, + 0.1724126674234867, + 0.6600774079561234, + 1.728473343886435, + 0.33709919452667236, + 0.1422573011368513, + 0.7387632373720407, + 0.05376459285616875, + 2.4062148965895176, + 0.8711664490401745, + 0.030640659853816032, + 0.9571177083998919 + ], + "unique_experts": 59, + "load_cv": 1.1323065201417661, + "normalized_load_entropy": 0.8869022822285867, + "max_load_share": 0.11458333333333333 + } + }, + "s0_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "1d4eb2766f60f386e2b9cbc56f2cd02f33a605e29a4574af3eb5f1c81eacb80c", + "route_weight_sha256": "f65fd53ed21f3a594ca40db778d00847e9506c73238c02a137aa9a88527d2adf", + "loads": [ + 0, + 0, + 2, + 0, + 1, + 0, + 1, + 0, + 22, + 0, + 5, + 1, + 0, + 0, + 8, + 4, + 1, + 0, + 2, + 1, + 4, + 0, + 1, + 0, + 1, + 0, + 0, + 1, + 1, + 4, + 0, + 3, + 4, + 2, + 1, + 9, + 0, + 3, + 0, + 6, + 1, + 0, + 0, + 4, + 1, + 2, + 0, + 1, + 1, + 1, + 1, + 0, + 0, + 1, + 4, + 1, + 4, + 2, + 4, + 1, + 2, + 11, + 0, + 8 + ], + "weighted_loads": [ + 0.0, + 0.0, + 0.37357833981513977, + 0.0, + 0.035778868943452835, + 0.0, + 0.03821595013141632, + 0.0, + 3.469931736588478, + 0.0, + 0.1929089669138193, + 0.051345448940992355, + 0.0, + 0.0, + 0.793788293376565, + 0.23325122892856598, + 0.023419609293341637, + 0.0, + 0.1341027393937111, + 0.047850653529167175, + 0.2421741709113121, + 0.0, + 0.06832432001829147, + 0.0, + 0.031070170924067497, + 0.0, + 0.0, + 0.02787673845887184, + 0.03853481262922287, + 0.24792836979031563, + 0.0, + 0.28492144495248795, + 0.22775998711585999, + 0.05228300206363201, + 0.03436595946550369, + 0.5040552876889706, + 0.0, + 0.1546926014125347, + 0.0, + 0.41038371436297894, + 0.032720763236284256, + 0.0, + 0.0, + 0.17393514141440392, + 0.06053955852985382, + 0.22176045924425125, + 0.0, + 0.026658009737730026, + 0.038318779319524765, + 0.06357929855585098, + 0.03212006762623787, + 0.0, + 0.0, + 0.02181864343583584, + 0.6483965404331684, + 0.028189176693558693, + 0.12206292152404785, + 0.06880582496523857, + 0.5228586625307798, + 0.049013901501894, + 0.10454690828919411, + 0.5576796140521765, + 0.0, + 0.4534659627825022 + ], + "unique_experts": 42, + "load_cv": 1.6049047905353981, + "normalized_load_entropy": 0.7918558165752235, + "max_load_share": 0.15942028985507245 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "cb3daa54775dc07d744fc1b3a3da7f77614eb9b7ee793fe9d8081ab9eae854e2", + "route_weight_sha256": "0cd9bf5c7a738769e835159916bec5e613fd00d991f78d017cd50b26e7f24475", + "loads": [ + 4, + 1, + 5, + 9, + 1, + 2, + 5, + 0, + 36, + 6, + 5, + 4, + 0, + 0, + 11, + 4, + 1, + 2, + 2, + 1, + 4, + 8, + 2, + 0, + 1, + 1, + 0, + 4, + 1, + 4, + 1, + 3, + 6, + 9, + 2, + 11, + 0, + 5, + 0, + 6, + 5, + 1, + 5, + 4, + 1, + 3, + 0, + 2, + 3, + 4, + 4, + 0, + 0, + 2, + 4, + 18, + 8, + 3, + 4, + 1, + 11, + 19, + 0, + 19 + ], + "weighted_loads": [ + 0.1740287085995078, + 0.040210798382759094, + 0.47781791910529137, + 1.0724176615476608, + 0.035778868943452835, + 0.06248565297573805, + 0.3280557319521904, + 0.0, + 4.8026794623583555, + 0.2187318466603756, + 0.1929089669138193, + 0.1781878238543868, + 0.0, + 0.0, + 1.1479499507695436, + 0.23325122892856598, + 0.023419609293341637, + 0.06462948396801949, + 0.1341027393937111, + 0.047850653529167175, + 0.2421741709113121, + 0.7128796651959419, + 0.09673303924500942, + 0.0, + 0.031070170924067497, + 0.026248497888445854, + 0.0, + 0.17874310538172722, + 0.03853481262922287, + 0.24792836979031563, + 0.043721847236156464, + 0.28492144495248795, + 0.29644525796175003, + 0.3128816280514002, + 0.09106037765741348, + 0.5984810441732407, + 0.0, + 0.22558336332440376, + 0.0, + 0.41038371436297894, + 0.2173420749604702, + 0.07610935717821121, + 0.3253736011683941, + 0.17393514141440392, + 0.06053955852985382, + 0.2543575279414654, + 0.0, + 0.05383187346160412, + 0.11531272903084755, + 0.39208365976810455, + 0.20491262525320053, + 0.0, + 0.0, + 0.06154181249439716, + 0.6483965404331684, + 1.4308975646272302, + 0.28465793654322624, + 0.09447630308568478, + 0.5228586625307798, + 0.049013901501894, + 1.4988612718880177, + 0.8619935363531113, + 0.0, + 0.8749617338180542 + ], + "unique_experts": 53, + "load_cv": 1.3052600138300812, + "normalized_load_entropy": 0.8529598342114566, + "max_load_share": 0.125 + } + }, + "s1_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "c2a67055e0d0426c5c7899f0917a8c921bbb54bc4de405d3b324ae1813fb15e6", + "route_weight_sha256": "655dda02e7dceebb8c092aa6ec0f927ba1fa584cb43e740edc4b1335cd739e06", + "loads": [ + 1, + 1, + 2, + 1, + 1, + 0, + 0, + 0, + 22, + 0, + 4, + 1, + 0, + 0, + 6, + 4, + 1, + 0, + 2, + 1, + 4, + 0, + 1, + 0, + 1, + 0, + 0, + 1, + 1, + 4, + 0, + 4, + 4, + 2, + 0, + 8, + 0, + 3, + 0, + 5, + 1, + 0, + 0, + 4, + 1, + 2, + 0, + 1, + 1, + 1, + 0, + 1, + 0, + 1, + 4, + 1, + 4, + 3, + 3, + 1, + 2, + 14, + 0, + 8 + ], + "weighted_loads": [ + 0.03741636872291565, + 0.02470337599515915, + 0.35850411653518677, + 0.022303394973278046, + 0.038144733756780624, + 0.0, + 0.0, + 0.0, + 3.284994602203369, + 0.0, + 0.16212761402130127, + 0.047018975019454956, + 0.0, + 0.0, + 0.7960830740630627, + 0.21568184345960617, + 0.02153218537569046, + 0.0, + 0.13585073128342628, + 0.046462852507829666, + 0.23235905170440674, + 0.0, + 0.07750876992940903, + 0.0, + 0.03595062717795372, + 0.0, + 0.0, + 0.027314655482769012, + 0.03833063319325447, + 0.22620856575667858, + 0.0, + 0.3117196261882782, + 0.23426049202680588, + 0.04770033620297909, + 0.0, + 0.4877378884702921, + 0.0, + 0.13530947640538216, + 0.0, + 0.37971336767077446, + 0.031698912382125854, + 0.0, + 0.0, + 0.1726268883794546, + 0.05886690691113472, + 0.2236165851354599, + 0.0, + 0.032323334366083145, + 0.02792111039161682, + 0.057766128331422806, + 0.0, + 0.024733353406190872, + 0.0, + 0.02095094695687294, + 0.6487734280526638, + 0.031088562682271004, + 0.11388618126511574, + 0.09228689968585968, + 0.4725678451359272, + 0.050991240888834, + 0.0960160568356514, + 0.7542547937482595, + 0.0, + 0.4630136154592037 + ], + "unique_experts": 43, + "load_cv": 1.6215701042583928, + "normalized_load_entropy": 0.7949055948445728, + "max_load_share": 0.15942028985507245 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "15586f24fa94acf1cfe79716be4352569c3b7ead3bde2929f0fae6e8dd7b9a05", + "route_weight_sha256": "fa3b461ea0281c193d858fcc30b0b0c6927c57a7a4fab89083e2551b8c8361cb", + "loads": [ + 3, + 5, + 2, + 12, + 1, + 1, + 6, + 1, + 44, + 10, + 4, + 6, + 3, + 0, + 10, + 8, + 4, + 2, + 3, + 1, + 5, + 14, + 2, + 0, + 1, + 1, + 0, + 3, + 2, + 4, + 0, + 4, + 5, + 11, + 8, + 14, + 2, + 6, + 0, + 6, + 13, + 1, + 4, + 6, + 1, + 2, + 1, + 3, + 4, + 5, + 11, + 4, + 5, + 5, + 4, + 26, + 8, + 5, + 5, + 1, + 17, + 26, + 1, + 12 + ], + "weighted_loads": [ + 0.16567010525614023, + 0.45539799705147743, + 0.35850411653518677, + 1.3225255087018013, + 0.038144733756780624, + 0.012605915777385235, + 0.36154792457818985, + 0.04178010672330856, + 5.12652082927525, + 0.5134791918098927, + 0.16212761402130127, + 0.390922368504107, + 0.14009735733270645, + 0.0, + 1.1787203177809715, + 0.4500664882361889, + 0.16871896013617516, + 0.050170935690402985, + 0.1739801950752735, + 0.046462852507829666, + 0.28112707659602165, + 1.1859455816447735, + 0.12127669528126717, + 0.0, + 0.03595062717795372, + 0.025535497814416885, + 0.0, + 0.1485552415251732, + 0.12225151434540749, + 0.22620856575667858, + 0.0, + 0.3117196261882782, + 0.28355176001787186, + 0.36731172911822796, + 0.3498340342193842, + 0.7609181646257639, + 0.08945801109075546, + 0.26462163403630257, + 0.0, + 0.4286648966372013, + 0.741388464346528, + 0.025383980944752693, + 0.3562872000038624, + 0.31132381968200207, + 0.05886690691113472, + 0.2236165851354599, + 0.033966828137636185, + 0.09870286658406258, + 0.15598354116082191, + 0.6244447231292725, + 0.5253144595772028, + 0.23463089764118195, + 0.5453501455485821, + 0.1909557729959488, + 0.6487734280526638, + 2.1120031913742423, + 0.32456280663609505, + 0.15242040157318115, + 0.5410229898989201, + 0.050991240888834, + 2.2235387042164803, + 1.3472179342061281, + 0.030640659853816032, + 0.7027462385594845 + ], + "unique_experts": 59, + "load_cv": 1.2047360245667467, + "normalized_load_entropy": 0.8754356021726655, + "max_load_share": 0.11458333333333333 + } + }, + "s0_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "88a81a1d016fbc70354d914846950c2a2b6e19f71657b5bbf196cf915cd845ca", + "route_weight_sha256": "5dd64bbbfc7c96e5c1b659bff72efb62c1bf6908b3f3bdf6944e1afc035e09e4", + "loads": [ + 1, + 0, + 2, + 0, + 1, + 0, + 0, + 0, + 22, + 0, + 5, + 1, + 0, + 0, + 8, + 4, + 1, + 0, + 2, + 1, + 4, + 0, + 1, + 0, + 1, + 0, + 0, + 1, + 1, + 4, + 0, + 4, + 4, + 2, + 1, + 8, + 0, + 3, + 0, + 6, + 1, + 0, + 0, + 5, + 2, + 2, + 0, + 1, + 1, + 2, + 0, + 0, + 0, + 1, + 4, + 1, + 5, + 2, + 4, + 1, + 2, + 9, + 0, + 7 + ], + "weighted_loads": [ + 0.02861967124044895, + 0.0, + 0.3519470989704132, + 0.0, + 0.03322290629148483, + 0.0, + 0.0, + 0.0, + 3.4625982977449894, + 0.0, + 0.18574851378798485, + 0.047388266772031784, + 0.0, + 0.0, + 0.8369135055691004, + 0.22950222715735435, + 0.022911790758371353, + 0.0, + 0.13676057755947113, + 0.04727734625339508, + 0.24599259346723557, + 0.0, + 0.067975252866745, + 0.0, + 0.029999900609254837, + 0.0, + 0.0, + 0.02990945428609848, + 0.040739934891462326, + 0.2605221029371023, + 0.0, + 0.31055402383208275, + 0.24158329144120216, + 0.0494530126452446, + 0.03223853558301926, + 0.5071262679994106, + 0.0, + 0.15604184195399284, + 0.0, + 0.41484042443335056, + 0.02948894537985325, + 0.0, + 0.0, + 0.19627478532493114, + 0.08439120464026928, + 0.21833888441324234, + 0.0, + 0.02822134830057621, + 0.037927113473415375, + 0.08932176232337952, + 0.0, + 0.0, + 0.0, + 0.03014550171792507, + 0.6543969139456749, + 0.023157792165875435, + 0.16057586297392845, + 0.06786961480975151, + 0.5220904368907213, + 0.050329167395830154, + 0.12299678847193718, + 0.45178290642797947, + 0.0, + 0.4549952708184719 + ], + "unique_experts": 41, + "load_cv": 1.5603116896274505, + "normalized_load_entropy": 0.7966116981016691, + "max_load_share": 0.15942028985507245 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "b8b0c1c208294c6705e39b73a01b647341210add653119c67710246fb0edc261", + "route_weight_sha256": "26e5cd0de0ebe29f370ec89b12effb3e4b5fe6ed1a6bb40f40feb2738b9df906", + "loads": [ + 5, + 1, + 6, + 8, + 1, + 2, + 3, + 0, + 36, + 5, + 5, + 4, + 0, + 0, + 12, + 4, + 1, + 3, + 2, + 1, + 4, + 8, + 2, + 0, + 1, + 1, + 0, + 5, + 1, + 4, + 0, + 4, + 6, + 7, + 2, + 10, + 0, + 5, + 0, + 6, + 7, + 1, + 5, + 5, + 2, + 3, + 0, + 1, + 4, + 5, + 4, + 0, + 0, + 3, + 4, + 16, + 9, + 4, + 4, + 1, + 12, + 16, + 0, + 17 + ], + "weighted_loads": [ + 0.20264837983995676, + 0.09348878264427185, + 0.48453071899712086, + 0.9850540161132812, + 0.03322290629148483, + 0.06946740206331015, + 0.21957658231258392, + 0.0, + 4.775934034958482, + 0.18824944831430912, + 0.18574851378798485, + 0.17091458197683096, + 0.0, + 0.0, + 1.226939482614398, + 0.22950222715735435, + 0.022911790758371353, + 0.13732649758458138, + 0.13676057755947113, + 0.04727734625339508, + 0.24599259346723557, + 0.7389607131481171, + 0.09638397209346294, + 0.0, + 0.029999900609254837, + 0.026248497888445854, + 0.0, + 0.18820134177803993, + 0.040739934891462326, + 0.2605221029371023, + 0.0, + 0.31055402383208275, + 0.3102685622870922, + 0.22359975054860115, + 0.08893295377492905, + 0.6117933616042137, + 0.0, + 0.2544570714235306, + 0.0, + 0.41484042443335056, + 0.28533922508358955, + 0.09308652579784393, + 0.2856586314737797, + 0.19627478532493114, + 0.08439120464026928, + 0.25093595311045647, + 0.0, + 0.02822134830057621, + 0.15918414667248726, + 0.3518988825380802, + 0.24613568931818008, + 0.0, + 0.0, + 0.12635616771876812, + 0.6543969139456749, + 1.3150365659967065, + 0.32317087799310684, + 0.1195103470236063, + 0.5220904368907213, + 0.050329167395830154, + 1.6176533363759518, + 0.7022177055478096, + 0.0, + 0.8323205877095461 + ], + "unique_experts": 52, + "load_cv": 1.2515422584520899, + "normalized_load_entropy": 0.859848124049253, + "max_load_share": 0.125 + } + }, + "s1_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "cacdead97ed0d03d142da952d3818e54a225d2df45637fff7f4344efd0e4abf0", + "route_weight_sha256": "bfd2e9e6901afa131742842050f451bea8f6dbb855090be3bf47aa564c561b22", + "loads": [ + 1, + 0, + 2, + 1, + 1, + 1, + 1, + 0, + 22, + 0, + 5, + 1, + 0, + 0, + 6, + 4, + 2, + 0, + 2, + 1, + 4, + 0, + 1, + 0, + 1, + 0, + 0, + 0, + 1, + 4, + 0, + 4, + 4, + 1, + 0, + 8, + 0, + 3, + 0, + 5, + 1, + 0, + 0, + 4, + 2, + 2, + 0, + 1, + 1, + 1, + 0, + 1, + 0, + 0, + 4, + 1, + 4, + 2, + 5, + 1, + 2, + 12, + 0, + 8 + ], + "weighted_loads": [ + 0.03941696509718895, + 0.0, + 0.36049996316432953, + 0.022431643679738045, + 0.037931445986032486, + 0.02390974760055542, + 0.03291727602481842, + 0.0, + 3.3040659055113792, + 0.0, + 0.19191009923815727, + 0.050315674394369125, + 0.0, + 0.0, + 0.8059787321835756, + 0.20833732187747955, + 0.0438736155629158, + 0.0, + 0.13463404402136803, + 0.045705150812864304, + 0.2336631938815117, + 0.0, + 0.07675231248140335, + 0.0, + 0.03699859604239464, + 0.0, + 0.0, + 0.0, + 0.03665909916162491, + 0.2230045199394226, + 0.0, + 0.3034328334033489, + 0.23811547830700874, + 0.024926654994487762, + 0.0, + 0.47717494517564774, + 0.0, + 0.1346878446638584, + 0.0, + 0.3771573193371296, + 0.02773110568523407, + 0.0, + 0.0, + 0.1777607835829258, + 0.08202514424920082, + 0.2085348144173622, + 0.0, + 0.026069292798638344, + 0.026716062799096107, + 0.05247757211327553, + 0.0, + 0.025577623397111893, + 0.0, + 0.0, + 0.6562799140810966, + 0.029350843280553818, + 0.12498894147574902, + 0.06787739135324955, + 0.5386604480445385, + 0.051459379494190216, + 0.09477660432457924, + 0.6672463454306126, + 0.0, + 0.451614685356617 + ], + "unique_experts": 42, + "load_cv": 1.5901793758519833, + "normalized_load_entropy": 0.7955987264334687, + "max_load_share": 0.15942028985507245 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "bcae09c4a70866b53b7ef315749a433531d93600f6c59efc19c66d773727c581", + "route_weight_sha256": "758e12ef4fdc3a41610baf157829fd4a8faa405db079094c75d20204398d39a2", + "loads": [ + 3, + 5, + 2, + 11, + 1, + 2, + 6, + 1, + 43, + 9, + 5, + 6, + 3, + 0, + 10, + 8, + 5, + 2, + 3, + 1, + 5, + 15, + 2, + 0, + 1, + 1, + 0, + 2, + 2, + 4, + 1, + 4, + 5, + 11, + 7, + 15, + 2, + 4, + 0, + 8, + 13, + 1, + 4, + 6, + 2, + 2, + 1, + 4, + 4, + 4, + 12, + 4, + 5, + 3, + 4, + 25, + 8, + 4, + 7, + 1, + 18, + 23, + 1, + 13 + ], + "weighted_loads": [ + 0.16767070163041353, + 0.48264239355921745, + 0.36049996316432953, + 1.2722755316644907, + 0.037931445986032486, + 0.036515663377940655, + 0.3493286147713661, + 0.04178010672330856, + 5.103434601798654, + 0.4687822423875332, + 0.19191009923815727, + 0.40390506107360125, + 0.14009735733270645, + 0.0, + 1.197454022243619, + 0.44272196665406227, + 0.1910603903234005, + 0.050170935690402985, + 0.17276350781321526, + 0.045705150812864304, + 0.2824312187731266, + 1.2394299283623695, + 0.12052023783326149, + 0.0, + 0.03699859604239464, + 0.025535497814416885, + 0.0, + 0.1038770005106926, + 0.12057998031377792, + 0.2230045199394226, + 0.040907494723796844, + 0.3034328334033489, + 0.2874067462980747, + 0.3822576068341732, + 0.3214608058333397, + 0.7792196460068226, + 0.08945801109075546, + 0.17941666021943092, + 0.0, + 0.5300849750638008, + 0.7495320420712233, + 0.025383980944752693, + 0.33553242310881615, + 0.31645771488547325, + 0.08202514424920082, + 0.2085348144173622, + 0.033966828137636185, + 0.12396484054625034, + 0.1547784935683012, + 0.5410075336694717, + 0.6152255516499281, + 0.23547516763210297, + 0.5453501455485821, + 0.1484210193157196, + 0.6562799140810966, + 2.039867968298495, + 0.3356655668467283, + 0.1264101956039667, + 0.6071155928075314, + 0.051459379494190216, + 2.3260970637202263, + 1.135966345667839, + 0.030640659853816032, + 0.7043476868420839 + ], + "unique_experts": 60, + "load_cv": 1.1726039399558574, + "normalized_load_entropy": 0.8807707235970392, + "max_load_share": 0.11197916666666667 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "ordered_topk_exact_tokens": 17, + "set_exact_tokens": 20, + "mean_set_jaccard": 0.9627329192546585, + "mean_token_weighted_tv": 0.012590399983784428, + "aggregate_load_tv": 0.021739130434782608 + }, + "system_bos": { + "tokens": 23, + "ordered_topk_exact_tokens": 17, + "set_exact_tokens": 18, + "mean_set_jaccard": 0.9378881987577641, + "mean_token_weighted_tv": 0.01864226927737827, + "aggregate_load_tv": 0.03623188405797101 + }, + "system_x": { + "tokens": 23, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 10, + "mean_set_jaccard": 0.829192546583851, + "mean_token_weighted_tv": 0.03526697352366603, + "aggregate_load_tv": 0.06521739130434782 + }, + "system_period": { + "tokens": 23, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 12, + "mean_set_jaccard": 0.8633540372670808, + "mean_token_weighted_tv": 0.034609949621169464, + "aggregate_load_tv": 0.07246376811594203 + }, + "bos_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8881987577639753, + "mean_token_weighted_tv": 0.025221619795521965, + "aggregate_load_tv": 0.06521739130434782 + }, + "bos_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.9006211180124224, + "mean_token_weighted_tv": 0.025512071164405865, + "aggregate_load_tv": 0.050724637681159424 + }, + "x_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 10, + "mean_set_jaccard": 0.8012422360248448, + "mean_token_weighted_tv": 0.03765059485221687, + "aggregate_load_tv": 0.07971014492753623 + }, + "x_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 7, + "set_exact_tokens": 9, + "mean_set_jaccard": 0.8002070393374742, + "mean_token_weighted_tv": 0.04494651698547861, + "aggregate_load_tv": 0.08695652173913043 + }, + "period_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 12, + "mean_set_jaccard": 0.8540372670807455, + "mean_token_weighted_tv": 0.029632446396610012, + "aggregate_load_tv": 0.050724637681159424 + }, + "period_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 10, + "mean_set_jaccard": 0.8105590062111803, + "mean_token_weighted_tv": 0.04367862900962, + "aggregate_load_tv": 0.08695652173913043 + } + } + }, + "layer_23": { + "layer": 23, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "780b5c281dfb6ae9267dd5cda0c2c658e4706ac5f4ad56655354d13c04b4a23e", + "route_weight_sha256": "8fa5f497e14cdde4dde1a4aa00a04d4ba4783b47232742ab995080627d5c3838", + "loads": [ + 1, + 3, + 1, + 2, + 2, + 2, + 0, + 2, + 2, + 2, + 2, + 4, + 0, + 3, + 1, + 3, + 1, + 0, + 1, + 0, + 4, + 0, + 2, + 1, + 3, + 0, + 1, + 2, + 2, + 2, + 0, + 2, + 12, + 1, + 0, + 2, + 10, + 1, + 3, + 4, + 2, + 3, + 3, + 0, + 0, + 2, + 7, + 2, + 1, + 4, + 0, + 0, + 4, + 0, + 2, + 0, + 0, + 4, + 13, + 1, + 0, + 2, + 1, + 3 + ], + "weighted_loads": [ + 0.12649211287498474, + 0.12492961436510086, + 0.03938833251595497, + 0.09267961233854294, + 0.06976230815052986, + 0.10376280173659325, + 0.0, + 0.12888691946864128, + 0.13455278798937798, + 0.19852079451084137, + 0.07945281639695168, + 0.23787033930420876, + 0.0, + 0.2594403140246868, + 0.02819816768169403, + 0.12540837936103344, + 0.026554744690656662, + 0.0, + 0.038535844534635544, + 0.0, + 0.5953220911324024, + 0.0, + 0.22330868989229202, + 0.049393847584724426, + 0.16271625459194183, + 0.0, + 0.0347161628305912, + 0.09796310216188431, + 0.09333217516541481, + 0.08375589549541473, + 0.0, + 0.06838750839233398, + 0.5583144798874855, + 0.04497251287102699, + 0.0, + 0.22945193201303482, + 0.6873043738305569, + 0.05510321632027626, + 0.17585337907075882, + 0.16126720048487186, + 0.07302919402718544, + 0.34584030508995056, + 0.2343139722943306, + 0.0, + 0.0, + 0.10260634496808052, + 0.35346559435129166, + 0.07547570765018463, + 0.04506285861134529, + 0.1957307644188404, + 0.0, + 0.0, + 0.23928011395037174, + 0.0, + 0.2653120756149292, + 0.0, + 0.0, + 0.1592793669551611, + 1.5866084769368172, + 0.04424336925148964, + 0.0, + 0.11164161190390587, + 0.03339022025465965, + 0.1398206576704979 + ], + "unique_experts": 48, + "load_cv": 1.1830029180952184, + "normalized_load_entropy": 0.8634556078143898, + "max_load_share": 0.09420289855072464 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "a4333707071d61ec10798cecbb7cff383850e080bee9071eeef48e8f41c09e8a", + "route_weight_sha256": "0c68ffd4ae450c2118d0007e37dee69ac36dbe3db07fea9206af5c7dce4a5fa5", + "loads": [ + 6, + 7, + 1, + 11, + 7, + 4, + 4, + 8, + 3, + 10, + 2, + 6, + 2, + 7, + 3, + 3, + 6, + 0, + 1, + 0, + 4, + 0, + 5, + 12, + 6, + 0, + 1, + 2, + 2, + 2, + 0, + 2, + 15, + 5, + 0, + 2, + 11, + 1, + 7, + 4, + 8, + 3, + 5, + 0, + 0, + 7, + 19, + 5, + 2, + 4, + 1, + 2, + 4, + 0, + 12, + 2, + 0, + 13, + 15, + 1, + 1, + 2, + 6, + 4 + ], + "weighted_loads": [ + 0.3201765378471464, + 0.33837464824318886, + 0.03938833251595497, + 0.3643208236899227, + 0.26632287725806236, + 0.1574482531286776, + 0.19658459350466728, + 0.43723149970173836, + 0.13529814081266522, + 0.4817438367754221, + 0.07945281639695168, + 0.3213980235159397, + 0.08782933838665485, + 0.4333060346543789, + 0.13759197294712067, + 0.12540837936103344, + 0.18430141545832157, + 0.0, + 0.038535844534635544, + 0.0, + 0.5953220911324024, + 0.0, + 0.3638552315533161, + 1.503232404589653, + 0.26576762832701206, + 0.0, + 0.0347161628305912, + 0.09796310216188431, + 0.09333217516541481, + 0.08375589549541473, + 0.0, + 0.06838750839233398, + 0.7205469012260437, + 0.5512054354185238, + 0.0, + 0.22945193201303482, + 0.7268018051981926, + 0.05510321632027626, + 0.3531247694045305, + 0.16126720048487186, + 0.40328535437583923, + 0.34584030508995056, + 0.28578193113207817, + 0.0, + 0.0, + 2.0730574168264866, + 1.3850932829082012, + 0.13835643860511482, + 0.08356419578194618, + 0.1957307644188404, + 0.05848977714776993, + 0.11352765560150146, + 0.23928011395037174, + 0.0, + 1.187048800289631, + 0.09918307512998581, + 0.0, + 0.9617174454033375, + 1.6884451322257519, + 0.04424336925148964, + 0.04624869301915169, + 0.11164161190390587, + 0.2588643878698349, + 0.17038948461413383 + ], + "unique_experts": 54, + "load_cv": 0.9485206154979929, + "normalized_load_entropy": 0.8936834824534804, + "max_load_share": 0.06597222222222222 + } + }, + "s1_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "2f5405eb8eb4458bf85543475ba4541fbcdd3b062863c068d4e7329f5201ca87", + "route_weight_sha256": "b36664889b2972bdf6114660d467c4ee91857f28b364e74b1096f957922a5adf", + "loads": [ + 1, + 4, + 1, + 2, + 2, + 2, + 0, + 2, + 2, + 2, + 2, + 4, + 0, + 3, + 1, + 3, + 1, + 0, + 1, + 0, + 4, + 0, + 2, + 2, + 4, + 0, + 1, + 2, + 1, + 2, + 0, + 2, + 12, + 1, + 0, + 2, + 7, + 1, + 3, + 4, + 2, + 4, + 3, + 0, + 0, + 2, + 8, + 1, + 1, + 4, + 0, + 0, + 4, + 0, + 2, + 0, + 0, + 4, + 13, + 1, + 0, + 2, + 1, + 3 + ], + "weighted_loads": [ + 0.12209519743919373, + 0.15687020868062973, + 0.03779720142483711, + 0.09729502722620964, + 0.07283684238791466, + 0.10227971524000168, + 0.0, + 0.12207962200045586, + 0.12592850252985954, + 0.19609985128045082, + 0.07611942663788795, + 0.23700185120105743, + 0.0, + 0.24622894451022148, + 0.0274739321321249, + 0.12498598359525204, + 0.025248656049370766, + 0.0, + 0.03718256205320358, + 0.0, + 0.5735327936708927, + 0.0, + 0.23033222556114197, + 0.08499442040920258, + 0.20359964296221733, + 0.0, + 0.03616869077086449, + 0.09755672514438629, + 0.0587431974709034, + 0.08368535712361336, + 0.0, + 0.0738257896155119, + 0.5459619890898466, + 0.041801899671554565, + 0.0, + 0.2301386520266533, + 0.5239962581545115, + 0.05222971737384796, + 0.17558715119957924, + 0.16699611023068428, + 0.07254910469055176, + 0.36188493482768536, + 0.2308618277311325, + 0.0, + 0.0, + 0.10128165781497955, + 0.4055943824350834, + 0.04358726739883423, + 0.048196177929639816, + 0.19329125061631203, + 0.0, + 0.0, + 0.23765827529132366, + 0.0, + 0.2576321214437485, + 0.0, + 0.0, + 0.15118182823061943, + 1.5706235580146313, + 0.044248491525650024, + 0.0, + 0.10242041200399399, + 0.03440304100513458, + 0.14671073481440544 + ], + "unique_experts": 48, + "load_cv": 1.1571535813529936, + "normalized_load_entropy": 0.8652478100551676, + "max_load_share": 0.09420289855072464 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "27921f3c2449977d0f1523550cae009ff1475cbb310c1f8460112c52737e8be9", + "route_weight_sha256": "eca8b4864881711e3369373c064b8b6dd6fbadff3eb7f94103be897aa6f9d603", + "loads": [ + 6, + 10, + 7, + 11, + 5, + 4, + 12, + 10, + 4, + 6, + 4, + 6, + 2, + 8, + 3, + 6, + 7, + 1, + 3, + 0, + 5, + 0, + 4, + 17, + 6, + 0, + 1, + 2, + 1, + 3, + 0, + 2, + 14, + 13, + 0, + 2, + 13, + 2, + 10, + 5, + 12, + 4, + 5, + 0, + 2, + 10, + 25, + 5, + 7, + 7, + 1, + 10, + 10, + 1, + 12, + 0, + 0, + 19, + 17, + 1, + 3, + 3, + 9, + 6 + ], + "weighted_loads": [ + 0.4252513339743018, + 0.5090208910405636, + 0.3501310236752033, + 0.5944001644384116, + 0.17183976620435715, + 0.14609897369518876, + 0.6095879431813955, + 0.43875931575894356, + 0.1628728958312422, + 0.3498420733958483, + 0.17063717916607857, + 0.30295214243233204, + 0.12297309283167124, + 0.45868225023150444, + 0.1612399984151125, + 0.24744782224297523, + 0.21540735568851233, + 0.05849078670144081, + 0.1285519041121006, + 0.0, + 0.6204934269189835, + 0.0, + 0.3299689944833517, + 2.060509003698826, + 0.2837494295090437, + 0.0, + 0.03616869077086449, + 0.09755672514438629, + 0.0587431974709034, + 0.12959757447242737, + 0.0, + 0.0738257896155119, + 0.6613450627774, + 0.9977823165245354, + 0.0, + 0.2301386520266533, + 0.9605285283178091, + 0.10002843663096428, + 0.5900520794093609, + 0.19129712879657745, + 0.5441802944988012, + 0.36188493482768536, + 0.28519255109131336, + 0.0, + 0.10345114395022392, + 2.1952329482883215, + 2.0747320912778378, + 0.2714003419969231, + 0.3087827395647764, + 0.34259815886616707, + 0.027663428336381912, + 0.6158577743917704, + 0.8824724573642015, + 0.03126540780067444, + 1.2263610437512398, + 0.0, + 0.0, + 1.493420835584402, + 1.7898933105170727, + 0.044248491525650024, + 0.11211563274264336, + 0.22818415611982346, + 0.3762736953794956, + 0.2552849017083645 + ], + "unique_experts": 56, + "load_cv": 0.8799463367476198, + "normalized_load_entropy": 0.9057664055253346, + "max_load_share": 0.06510416666666667 + } + }, + "s0_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "af7ca4bbcf71ca61e8c04c3eae28354d82c273da1f64c2c68e23ea77c79e74b6", + "route_weight_sha256": "c82b126f272203d5974076eb453980e808f5691ded28fd937f5b14120f5a192e", + "loads": [ + 1, + 2, + 1, + 1, + 2, + 3, + 1, + 3, + 2, + 2, + 2, + 4, + 0, + 3, + 2, + 3, + 1, + 0, + 2, + 0, + 4, + 0, + 2, + 1, + 4, + 0, + 1, + 2, + 2, + 2, + 0, + 2, + 11, + 1, + 0, + 2, + 7, + 1, + 3, + 4, + 2, + 3, + 4, + 0, + 0, + 2, + 7, + 2, + 1, + 3, + 0, + 0, + 4, + 0, + 2, + 0, + 0, + 4, + 14, + 1, + 0, + 2, + 1, + 2 + ], + "weighted_loads": [ + 0.09785176813602448, + 0.09777161106467247, + 0.043435126543045044, + 0.06214054673910141, + 0.06986693479120731, + 0.1403318364173174, + 0.03027149848639965, + 0.17961853370070457, + 0.1365063302218914, + 0.18394196033477783, + 0.07564250007271767, + 0.2542463317513466, + 0.0, + 0.27893083542585373, + 0.06253715604543686, + 0.12055004388093948, + 0.021160513162612915, + 0.0, + 0.08527880534529686, + 0.0, + 0.5876970067620277, + 0.0, + 0.2290525734424591, + 0.049219630658626556, + 0.2100999765098095, + 0.0, + 0.03460555896162987, + 0.10808223858475685, + 0.0913443323224783, + 0.07879015803337097, + 0.0, + 0.06565895117819309, + 0.5174605511128902, + 0.046987731009721756, + 0.0, + 0.24560534209012985, + 0.6336280182003975, + 0.055855102837085724, + 0.17969824001193047, + 0.16751944087445736, + 0.08052771911025047, + 0.3356231488287449, + 0.26806147769093513, + 0.0, + 0.0, + 0.10561518743634224, + 0.35254843905568123, + 0.07739447429776192, + 0.05035797134041786, + 0.1603599451482296, + 0.0, + 0.0, + 0.24731283262372017, + 0.0, + 0.25774943828582764, + 0.0, + 0.0, + 0.16939351707696915, + 1.6465740837156773, + 0.04376776143908501, + 0.0, + 0.1053185872733593, + 0.03279411792755127, + 0.10324898734688759 + ], + "unique_experts": 49, + "load_cv": 1.1307134550602624, + "normalized_load_entropy": 0.8732276291034057, + "max_load_share": 0.10144927536231885 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "d4bc89cf7db04c38ed1bf21cbfe8ccad90740b71eef6939c004eaa9295b6b9f7", + "route_weight_sha256": "cba93912c6207bce0df16303985db90a805ab08b249196aa154de791d7728f7f", + "loads": [ + 4, + 6, + 1, + 9, + 8, + 5, + 4, + 9, + 2, + 10, + 2, + 5, + 3, + 7, + 4, + 3, + 7, + 0, + 2, + 1, + 4, + 0, + 5, + 13, + 7, + 0, + 2, + 2, + 2, + 2, + 0, + 2, + 14, + 4, + 0, + 2, + 7, + 1, + 6, + 4, + 9, + 3, + 6, + 1, + 0, + 7, + 19, + 4, + 2, + 3, + 1, + 2, + 4, + 0, + 12, + 3, + 0, + 14, + 17, + 2, + 0, + 2, + 5, + 3 + ], + "weighted_loads": [ + 0.22466158866882324, + 0.31121664494276047, + 0.043435126543045044, + 0.33022267930209637, + 0.3301533777266741, + 0.19401728780940175, + 0.19326972402632236, + 0.44408775493502617, + 0.1365063302218914, + 0.45626326464116573, + 0.07564250007271767, + 0.29081325605511665, + 0.08058820478618145, + 0.4527965560555458, + 0.17087826132774353, + 0.12055004388093948, + 0.22388938628137112, + 0.0, + 0.08527880534529686, + 0.14278998970985413, + 0.5876970067620277, + 0.0, + 0.38874900713562965, + 1.6459086053073406, + 0.3131513502448797, + 0.0, + 0.16050123795866966, + 0.10808223858475685, + 0.0913443323224783, + 0.07879015803337097, + 0.0, + 0.06565895117819309, + 0.6581563763320446, + 0.4910351298749447, + 0.0, + 0.24560534209012985, + 0.6336280182003975, + 0.055855102837085724, + 0.3152958657592535, + 0.16751944087445736, + 0.4291255548596382, + 0.3356231488287449, + 0.3195294365286827, + 0.0603937953710556, + 0.0, + 1.1347291469573975, + 1.366028320044279, + 0.13645731192082167, + 0.08885930851101875, + 0.1603599451482296, + 0.05048755928874016, + 0.11352765560150146, + 0.24731283262372017, + 0.0, + 1.1794861629605293, + 0.14319460466504097, + 0.0, + 1.0150815472006798, + 1.8137255050241947, + 0.29486168548464775, + 0.0, + 0.1053185872733593, + 0.1905074156820774, + 0.1444280818104744 + ], + "unique_experts": 55, + "load_cv": 0.9452610848429752, + "normalized_load_entropy": 0.89840730035478, + "max_load_share": 0.06597222222222222 + } + }, + "s1_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "7c4b91400e7f5634135f25a58bd0db9be55e977b9d9d4feb998768b26bfe009e", + "route_weight_sha256": "ea148a2b9e96a9774f35bce28f9bb3423969e8baee8d41a1d1dde85c7b50ae79", + "loads": [ + 1, + 2, + 0, + 1, + 2, + 2, + 0, + 3, + 2, + 2, + 2, + 4, + 0, + 3, + 1, + 3, + 1, + 0, + 1, + 0, + 5, + 0, + 2, + 2, + 4, + 0, + 1, + 2, + 3, + 2, + 0, + 2, + 11, + 2, + 0, + 2, + 9, + 1, + 3, + 3, + 4, + 3, + 3, + 0, + 0, + 2, + 7, + 2, + 1, + 3, + 0, + 0, + 3, + 0, + 2, + 0, + 0, + 4, + 14, + 1, + 0, + 2, + 0, + 3 + ], + "weighted_loads": [ + 0.10085204243659973, + 0.09696011245250702, + 0.0, + 0.060922324657440186, + 0.0715548787266016, + 0.10693573206663132, + 0.0, + 0.17502319812774658, + 0.1412360519170761, + 0.18541482463479042, + 0.07640284858644009, + 0.2655455693602562, + 0.0, + 0.25991981476545334, + 0.029588907957077026, + 0.12361262366175652, + 0.02207593061029911, + 0.0, + 0.04096708819270134, + 0.0, + 0.5808405186980963, + 0.0, + 0.26191745698451996, + 0.08484116569161415, + 0.20632889494299889, + 0.0, + 0.03512173146009445, + 0.10201364755630493, + 0.12606064975261688, + 0.0805954560637474, + 0.0, + 0.06849467568099499, + 0.5088199190795422, + 0.08338835090398788, + 0.0, + 0.23310070484876633, + 0.6405164208263159, + 0.05244840681552887, + 0.17558055743575096, + 0.1416923776268959, + 0.1383359469473362, + 0.35278142243623734, + 0.23644717037677765, + 0.0, + 0.0, + 0.10317854955792427, + 0.3744017779827118, + 0.07205308973789215, + 0.04954914748668671, + 0.15815836563706398, + 0.0, + 0.0, + 0.2207152582705021, + 0.0, + 0.25038859248161316, + 0.0, + 0.0, + 0.16607722267508507, + 1.6095734685659409, + 0.04348374530673027, + 0.0, + 0.10094566270709038, + 0.0, + 0.13719496876001358 + ], + "unique_experts": 46, + "load_cv": 1.180158729654263, + "normalized_load_entropy": 0.8593302486182992, + "max_load_share": 0.10144927536231885 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "403ff544d3a20807f1b7ba52e2d4497d979905f310ea26d10c604fc0d89f4899", + "route_weight_sha256": "a98b3c7101b8181438a0636ca20408108983806a5d42ce3137b4365dca679632", + "loads": [ + 5, + 8, + 6, + 9, + 6, + 4, + 9, + 11, + 3, + 6, + 4, + 7, + 3, + 9, + 2, + 6, + 9, + 1, + 3, + 0, + 6, + 0, + 5, + 18, + 6, + 0, + 1, + 2, + 3, + 3, + 1, + 2, + 14, + 13, + 0, + 2, + 15, + 2, + 9, + 4, + 15, + 3, + 5, + 0, + 2, + 8, + 23, + 5, + 7, + 6, + 1, + 10, + 9, + 3, + 12, + 2, + 0, + 20, + 18, + 1, + 2, + 3, + 7, + 5 + ], + "weighted_loads": [ + 0.4114573523402214, + 0.44911079481244087, + 0.3123338222503662, + 0.5544955674558878, + 0.21483292989432812, + 0.1507549905218184, + 0.5004424694925547, + 0.512812752276659, + 0.17746391519904137, + 0.3450486343353987, + 0.1709206011146307, + 0.37675792537629604, + 0.07983934972435236, + 0.5037594549357891, + 0.12836364656686783, + 0.2460744623094797, + 0.29716773610562086, + 0.05849078670144081, + 0.13233643025159836, + 0.0, + 0.627801151946187, + 0.0, + 0.43093774653971195, + 2.2819124311208725, + 0.28647868148982525, + 0.0, + 0.03512173146009445, + 0.10201364755630493, + 0.12606064975261688, + 0.12650767341256142, + 0.05030902475118637, + 0.06849467568099499, + 0.6467606723308563, + 1.0215579085052013, + 0.0, + 0.23310070484876633, + 1.0770486909896135, + 0.10024712607264519, + 0.5336427018046379, + 0.16599339619278908, + 0.6589312423020601, + 0.35278142243623734, + 0.2907778937369585, + 0.0, + 0.10345114395022392, + 1.1906348150223494, + 1.9909842684864998, + 0.2961618220433593, + 0.3101357091218233, + 0.307465273886919, + 0.027663428336381912, + 0.6158577743917704, + 0.86552944034338, + 0.15283237770199776, + 1.2191175147891045, + 0.11279186606407166, + 0.0, + 1.5231850519776344, + 1.8642881996929646, + 0.04348374530673027, + 0.07552387565374374, + 0.22670940682291985, + 0.26843850314617157, + 0.2250874973833561 + ], + "unique_experts": 58, + "load_cv": 0.871022706681953, + "normalized_load_entropy": 0.9116031686639035, + "max_load_share": 0.059895833333333336 + } + }, + "s0_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "150e6c16e1f80cce1d0ea01b91db976e875b6101c09b5b7fac5b04099d3ee716", + "route_weight_sha256": "dba06404c8c5a0f02e7d49298eb502ffb235e1b75c3ccf40886054447d7c0063", + "loads": [ + 1, + 2, + 1, + 1, + 2, + 2, + 1, + 3, + 2, + 2, + 4, + 4, + 0, + 3, + 1, + 2, + 1, + 0, + 1, + 0, + 4, + 0, + 2, + 2, + 4, + 0, + 1, + 1, + 2, + 2, + 0, + 1, + 12, + 1, + 0, + 2, + 10, + 2, + 3, + 4, + 3, + 3, + 4, + 0, + 0, + 2, + 7, + 1, + 1, + 3, + 0, + 0, + 2, + 0, + 2, + 0, + 0, + 4, + 13, + 1, + 0, + 2, + 1, + 3 + ], + "weighted_loads": [ + 0.10185486078262329, + 0.10028045624494553, + 0.04823886975646019, + 0.0615093968808651, + 0.06915380619466305, + 0.10933388769626617, + 0.0293054711073637, + 0.17470044642686844, + 0.13889079168438911, + 0.20531389489769936, + 0.15625395812094212, + 0.22910871356725693, + 0.0, + 0.2804388180375099, + 0.028442349284887314, + 0.09755076467990875, + 0.021920274943113327, + 0.0, + 0.03738878294825554, + 0.0, + 0.5738275907933712, + 0.0, + 0.2263166308403015, + 0.08247418329119682, + 0.19844865426421165, + 0.0, + 0.032674383372068405, + 0.0700385719537735, + 0.09157590195536613, + 0.0777047649025917, + 0.0, + 0.035987794399261475, + 0.5634643733501434, + 0.04939314350485802, + 0.0, + 0.26452096551656723, + 0.7288922779262066, + 0.09471909329295158, + 0.17818228900432587, + 0.1681554801762104, + 0.10916683822870255, + 0.2600858174264431, + 0.2763521634042263, + 0.0, + 0.0, + 0.11874816194176674, + 0.35679876804351807, + 0.03833029046654701, + 0.05112599581480026, + 0.15602217614650726, + 0.0, + 0.0, + 0.16906458139419556, + 0.0, + 0.2652662396430969, + 0.0, + 0.0, + 0.1702746730297804, + 1.5442453660070896, + 0.04190647974610329, + 0.0, + 0.11211418733000755, + 0.03843687102198601, + 0.14564917609095573 + ], + "unique_experts": 49, + "load_cv": 1.1858402848885006, + "normalized_load_entropy": 0.8643673076962297, + "max_load_share": 0.09420289855072464 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "a0879aa7a42d885f9bb3be0fe9b347d7e54c9a446def284136842ef15efddfd5", + "route_weight_sha256": "47472b549c371dd9f3322ced7af420b7b5edc3e664c2ae7dc700429214eecc82", + "loads": [ + 6, + 6, + 1, + 11, + 6, + 4, + 6, + 9, + 2, + 9, + 4, + 6, + 3, + 7, + 3, + 2, + 7, + 0, + 1, + 0, + 4, + 0, + 4, + 14, + 7, + 0, + 1, + 1, + 2, + 2, + 0, + 1, + 14, + 5, + 0, + 2, + 11, + 2, + 7, + 4, + 10, + 3, + 6, + 0, + 0, + 7, + 21, + 4, + 2, + 3, + 0, + 2, + 2, + 0, + 13, + 2, + 0, + 13, + 15, + 1, + 0, + 2, + 5, + 3 + ], + "weighted_loads": [ + 0.33691204711794853, + 0.3137254901230335, + 0.04823886975646019, + 0.4732867833226919, + 0.2294477168470621, + 0.16301933908835053, + 0.2835203055292368, + 0.47869861498475075, + 0.13889079168438911, + 0.42837467417120934, + 0.15625395812094212, + 0.3136809691786766, + 0.08537771925330162, + 0.454304538667202, + 0.14822804927825928, + 0.09755076467990875, + 0.2043172661215067, + 0.0, + 0.03738878294825554, + 0.0, + 0.5738275907933712, + 0.0, + 0.3174973241984844, + 1.62832972407341, + 0.3015000279992819, + 0.0, + 0.032674383372068405, + 0.0700385719537735, + 0.09157590195536613, + 0.0777047649025917, + 0.0, + 0.035987794399261475, + 0.663418848067522, + 0.520027868449688, + 0.0, + 0.26452096551656723, + 0.7662256918847561, + 0.09471909329295158, + 0.38061621598899364, + 0.1681554801762104, + 0.4181937612593174, + 0.2600858174264431, + 0.3278201222419739, + 0.0, + 0.0, + 1.1528856121003628, + 1.5305198952555656, + 0.12216885108500719, + 0.08962733298540115, + 0.15602217614650726, + 0.0, + 0.11352765560150146, + 0.16906458139419556, + 0.0, + 1.32176061719656, + 0.08483978360891342, + 0.0, + 1.0411383379250765, + 1.660372793674469, + 0.04190647974610329, + 0.0, + 0.11211418733000755, + 0.1789666935801506, + 0.14564917609095573 + ], + "unique_experts": 52, + "load_cv": 1.0038506110884806, + "normalized_load_entropy": 0.8822822845897561, + "max_load_share": 0.07291666666666667 + } + }, + "s1_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "564fba91f545ce5cc78af38003fba474223a51cdd2a3f1dee8bf2a583f18600e", + "route_weight_sha256": "c66445371a64eafd73b5dbdcaabe31743a22a61fd09879ceb15821cd70765706", + "loads": [ + 1, + 2, + 1, + 1, + 3, + 2, + 0, + 3, + 2, + 2, + 4, + 4, + 0, + 3, + 1, + 2, + 1, + 0, + 1, + 0, + 5, + 0, + 3, + 2, + 3, + 0, + 0, + 2, + 1, + 1, + 0, + 1, + 11, + 2, + 0, + 2, + 10, + 2, + 3, + 3, + 3, + 3, + 4, + 0, + 0, + 2, + 7, + 1, + 1, + 3, + 0, + 0, + 2, + 0, + 2, + 0, + 0, + 4, + 15, + 1, + 0, + 2, + 1, + 3 + ], + "weighted_loads": [ + 0.10112383216619492, + 0.08955565467476845, + 0.03755931183695793, + 0.0674799457192421, + 0.09615418128669262, + 0.09702730178833008, + 0.0, + 0.16099246591329575, + 0.1380155198276043, + 0.20160295069217682, + 0.16640444099903107, + 0.21729888580739498, + 0.0, + 0.267088171094656, + 0.026535626500844955, + 0.09340417012572289, + 0.022505605593323708, + 0.0, + 0.03415784612298012, + 0.0, + 0.5968645401299, + 0.0, + 0.2466951124370098, + 0.08369746431708336, + 0.1629970222711563, + 0.0, + 0.0, + 0.10129199177026749, + 0.05921267345547676, + 0.042493630200624466, + 0.0, + 0.04202800616621971, + 0.500659579411149, + 0.0826963558793068, + 0.0, + 0.261835440993309, + 0.686086991801858, + 0.08570069447159767, + 0.16260843351483345, + 0.13938894122838974, + 0.11719751730561256, + 0.24076978862285614, + 0.264402873814106, + 0.0, + 0.0, + 0.12245066463947296, + 0.3715355917811394, + 0.04141305014491081, + 0.04780668020248413, + 0.14459733478724957, + 0.0, + 0.0, + 0.17730432748794556, + 0.0, + 0.2501194104552269, + 0.0, + 0.0, + 0.1631765253841877, + 1.56413359567523, + 0.04099883511662483, + 0.0, + 0.09572187811136246, + 0.035236865282058716, + 0.13463068380951881 + ], + "unique_experts": 47, + "load_cv": 1.2357994044471483, + "normalized_load_entropy": 0.8545109902110357, + "max_load_share": 0.10869565217391304 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "678a31e6a758a7342c8e226b2fb3fa99d57d1723a3373f2538013cc0d6b49efa", + "route_weight_sha256": "78db8f6a69e912f31a3bea408f0b72a4bc48df49a712f6492d5643097f3b73c0", + "loads": [ + 5, + 8, + 7, + 10, + 6, + 5, + 11, + 10, + 3, + 5, + 6, + 7, + 2, + 8, + 3, + 5, + 10, + 1, + 3, + 1, + 6, + 0, + 5, + 19, + 5, + 0, + 1, + 2, + 1, + 2, + 0, + 1, + 13, + 12, + 0, + 2, + 16, + 3, + 11, + 4, + 12, + 3, + 6, + 0, + 2, + 8, + 25, + 4, + 8, + 6, + 1, + 11, + 8, + 1, + 15, + 0, + 0, + 19, + 18, + 1, + 2, + 3, + 8, + 4 + ], + "weighted_loads": [ + 0.39807653799653053, + 0.4417063370347023, + 0.34989313408732414, + 0.6224797833710909, + 0.1951571051031351, + 0.16640700632706285, + 0.6002264823764563, + 0.46836594119668007, + 0.17424338310956955, + 0.31752158887684345, + 0.2609221935272217, + 0.3199232779443264, + 0.05098095629364252, + 0.47954147681593895, + 0.16781625896692276, + 0.21586600877344608, + 0.30138314235955477, + 0.05849078670144081, + 0.12552718818187714, + 0.033156976103782654, + 0.6438251733779907, + 0.0, + 0.3455484751611948, + 2.14827873185277, + 0.24314680881798267, + 0.0, + 0.06055690348148346, + 0.10129199177026749, + 0.05921267345547676, + 0.08840584754943848, + 0.0, + 0.04202800616621971, + 0.6113192606717348, + 0.9985223561525345, + 0.0, + 0.261835440993309, + 1.1226192619651556, + 0.133499413728714, + 0.6290489844977856, + 0.1636899597942829, + 0.4563909452408552, + 0.24076978862285614, + 0.31873359717428684, + 0.0, + 0.10345114395022392, + 1.2038609739392996, + 2.2344023510813713, + 0.26552178245037794, + 0.35602075792849064, + 0.2939042430371046, + 0.027663428336381912, + 0.6954089719802141, + 0.8221185095608234, + 0.03126540780067444, + 1.4549180641770363, + 0.0, + 0.0, + 1.5070786625146866, + 1.7454874478280544, + 0.04099883511662483, + 0.07552387565374374, + 0.22148562222719193, + 0.2946392819285393, + 0.17469745874404907 + ], + "unique_experts": 57, + "load_cv": 0.9114434522594732, + "normalized_load_entropy": 0.9021020080975581, + "max_load_share": 0.06510416666666667 + } + }, + "s0_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "51fdbbcad245341d96c26d4a7b4fd1850fe2960dc1ff5ef2e9078b5741391b6b", + "route_weight_sha256": "230874060b98ac639020509a44ef7fb6118eddb369f46e3dd6c531a96223770c", + "loads": [ + 1, + 2, + 1, + 1, + 3, + 2, + 1, + 3, + 2, + 2, + 4, + 4, + 0, + 3, + 1, + 3, + 1, + 0, + 1, + 0, + 4, + 0, + 3, + 2, + 4, + 0, + 1, + 1, + 2, + 0, + 0, + 1, + 11, + 1, + 0, + 2, + 8, + 2, + 3, + 4, + 3, + 4, + 4, + 0, + 0, + 2, + 8, + 1, + 1, + 3, + 0, + 0, + 2, + 0, + 2, + 0, + 0, + 4, + 13, + 1, + 0, + 2, + 1, + 3 + ], + "weighted_loads": [ + 0.10322216898202896, + 0.10062423720955849, + 0.04083023592829704, + 0.06344261020421982, + 0.09542549401521683, + 0.10868252441287041, + 0.03094823658466339, + 0.18017854541540146, + 0.1361985057592392, + 0.20533537864685059, + 0.1679413579404354, + 0.23842508904635906, + 0.0, + 0.2838129810988903, + 0.02835185080766678, + 0.1241945531219244, + 0.021537432447075844, + 0.0, + 0.03986041992902756, + 0.0, + 0.5860807746648788, + 0.0, + 0.24848518893122673, + 0.09189724549651146, + 0.20816010236740112, + 0.0, + 0.031935468316078186, + 0.07318010926246643, + 0.09370959922671318, + 0.0, + 0.0, + 0.04074447974562645, + 0.5216302908957005, + 0.047610823065042496, + 0.0, + 0.25332027673721313, + 0.6517044957727194, + 0.09428929165005684, + 0.1824846714735031, + 0.16334536112844944, + 0.11017445847392082, + 0.308231171220541, + 0.26999324932694435, + 0.0, + 0.0, + 0.11842874437570572, + 0.40957136265933514, + 0.03964180499315262, + 0.052077941596508026, + 0.16365009173750877, + 0.0, + 0.0, + 0.18114639073610306, + 0.0, + 0.2572205811738968, + 0.0, + 0.0, + 0.17438976280391216, + 1.5856039226055145, + 0.044098787009716034, + 0.0, + 0.10862017795443535, + 0.03213035315275192, + 0.1395268440246582 + ], + "unique_experts": 48, + "load_cv": 1.1484078455453641, + "normalized_load_entropy": 0.864761984752502, + "max_load_share": 0.09420289855072464 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "7ee664624fe4f4980253dc079ac75b84aa6372bcfbc733785f1621abd3d57a36", + "route_weight_sha256": "4182a68115fa72133b9bb212f1e71020fff10b35e5f3b1b916828b2833539fdf", + "loads": [ + 6, + 6, + 2, + 9, + 8, + 4, + 7, + 9, + 2, + 10, + 4, + 5, + 2, + 7, + 2, + 3, + 6, + 0, + 1, + 0, + 4, + 0, + 5, + 13, + 7, + 0, + 1, + 1, + 2, + 0, + 0, + 1, + 14, + 6, + 0, + 2, + 8, + 2, + 8, + 4, + 10, + 4, + 7, + 0, + 0, + 7, + 21, + 3, + 2, + 3, + 0, + 2, + 2, + 1, + 13, + 2, + 0, + 14, + 15, + 1, + 0, + 2, + 5, + 3 + ], + "weighted_loads": [ + 0.34280091151595116, + 0.3140692710876465, + 0.08423365280032158, + 0.3315247427672148, + 0.3108375743031502, + 0.16236797580495477, + 0.35684606805443764, + 0.4807243198156357, + 0.1361985057592392, + 0.48830204643309116, + 0.1679413579404354, + 0.27700122632086277, + 0.059147270396351814, + 0.4576787017285824, + 0.10013644397258759, + 0.1241945531219244, + 0.17505985870957375, + 0.0, + 0.03986041992902756, + 0.0, + 0.5860807746648788, + 0.0, + 0.34008002281188965, + 1.6221180371940136, + 0.31121147610247135, + 0.0, + 0.031935468316078186, + 0.07318010926246643, + 0.09370959922671318, + 0.0, + 0.0, + 0.04074447974562645, + 0.6421631425619125, + 0.5044263917952776, + 0.0, + 0.25332027673721313, + 0.6517044957727194, + 0.09428929165005684, + 0.5076931733638048, + 0.16334536112844944, + 0.45068106055259705, + 0.308231171220541, + 0.36785901710391045, + 0.0, + 0.0, + 1.1595290638506413, + 1.4924908448010683, + 0.09870464261621237, + 0.09057927876710892, + 0.16365009173750877, + 0.0, + 0.11352765560150146, + 0.18114639073610306, + 0.043898988515138626, + 1.2185341157019138, + 0.08899644017219543, + 0.0, + 1.0916818287223577, + 1.6908221133053303, + 0.044098787009716034, + 0.0, + 0.10862017795443535, + 0.17543233558535576, + 0.1395268440246582 + ], + "unique_experts": 52, + "load_cv": 0.996908802495909, + "normalized_load_entropy": 0.8828916663591586, + "max_load_share": 0.07291666666666667 + } + }, + "s1_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "3ba55ca5b4f46be7741a0875f5e43cc6f28e58ea3cae70c41a58fcd5e7703062", + "route_weight_sha256": "dfd2d66e9e1ba86f69deb9bf8d8eeede28802742d7b6ca1a027baa714e0c5f3a", + "loads": [ + 1, + 2, + 1, + 1, + 3, + 2, + 0, + 3, + 2, + 2, + 5, + 3, + 0, + 3, + 0, + 2, + 1, + 0, + 1, + 0, + 4, + 0, + 3, + 2, + 4, + 0, + 0, + 2, + 2, + 0, + 0, + 1, + 11, + 2, + 0, + 2, + 10, + 1, + 3, + 4, + 3, + 4, + 4, + 0, + 0, + 2, + 7, + 1, + 1, + 4, + 0, + 0, + 2, + 0, + 2, + 0, + 0, + 4, + 14, + 1, + 0, + 2, + 1, + 3 + ], + "weighted_loads": [ + 0.09852717071771622, + 0.09092758223414421, + 0.03811956197023392, + 0.0660322830080986, + 0.09121331013739109, + 0.09415236487984657, + 0.0, + 0.16232003271579742, + 0.13657567650079727, + 0.2028176262974739, + 0.20734083652496338, + 0.18679291009902954, + 0.0, + 0.26760659366846085, + 0.0, + 0.09324213117361069, + 0.02407434768974781, + 0.0, + 0.0367153063416481, + 0.0, + 0.5621241144835949, + 0.0, + 0.25477663055062294, + 0.08013639971613884, + 0.1889837384223938, + 0.0, + 0.0, + 0.1027998998761177, + 0.09123453125357628, + 0.0, + 0.0, + 0.039479851722717285, + 0.49727149680256844, + 0.07650100439786911, + 0.0, + 0.24997729808092117, + 0.6304191518574953, + 0.047278113663196564, + 0.16752326115965843, + 0.15572880022227764, + 0.11237979307770729, + 0.26147669553756714, + 0.26448631659150124, + 0.0, + 0.0, + 0.12839467823505402, + 0.40681028366088867, + 0.04283618554472923, + 0.045817576348781586, + 0.18012062460184097, + 0.0, + 0.0, + 0.18527358770370483, + 0.0, + 0.2556680366396904, + 0.0, + 0.0, + 0.1736140102148056, + 1.5430961810052395, + 0.039743151515722275, + 0.0, + 0.0954790823161602, + 0.03407728672027588, + 0.13051381334662437 + ], + "unique_experts": 45, + "load_cv": 1.222126745807789, + "normalized_load_entropy": 0.8491547734620161, + "max_load_share": 0.10144927536231885 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "dc7663882537291f12352457ea87be10e0e6bdde9ea9ffcd6087f6ca2e58b1d4", + "route_weight_sha256": "529c3efdd4ac8b76fe9411533116a610e91fffda31f91fd3a2558d8d4c47b4e1", + "loads": [ + 5, + 8, + 8, + 10, + 6, + 5, + 13, + 11, + 3, + 6, + 7, + 5, + 2, + 9, + 3, + 5, + 8, + 1, + 3, + 0, + 5, + 0, + 5, + 17, + 6, + 0, + 1, + 2, + 2, + 1, + 0, + 1, + 13, + 13, + 0, + 2, + 16, + 2, + 12, + 5, + 12, + 4, + 6, + 0, + 2, + 8, + 25, + 4, + 7, + 7, + 1, + 10, + 8, + 2, + 14, + 0, + 0, + 19, + 16, + 1, + 2, + 3, + 8, + 4 + ], + "weighted_loads": [ + 0.3794807903468609, + 0.44307826459407806, + 0.386886652559042, + 0.5956011470407248, + 0.19021623395383358, + 0.16457367734983563, + 0.7005045227706432, + 0.49299878627061844, + 0.17280353978276253, + 0.3529525715857744, + 0.301858589053154, + 0.24150997027754784, + 0.07294472400099039, + 0.5066043306142092, + 0.16268019191920757, + 0.21570396982133389, + 0.20757055561989546, + 0.05849078670144081, + 0.12808464840054512, + 0.0, + 0.6090847477316856, + 0.0, + 0.3543261755257845, + 2.0676917769014835, + 0.26913352496922016, + 0.0, + 0.06219291687011719, + 0.1027998998761177, + 0.09123453125357628, + 0.04591221734881401, + 0.0, + 0.039479851722717285, + 0.6114625744521618, + 1.079225480556488, + 0.0, + 0.24997729808092117, + 1.066951422020793, + 0.09507683292031288, + 0.7989346422255039, + 0.18002981878817081, + 0.45291011966764927, + 0.26147669553756714, + 0.3188170399516821, + 0.0, + 0.10345114395022392, + 1.2088553737848997, + 2.106477029621601, + 0.26694491785019636, + 0.3064041379839182, + 0.329427532851696, + 0.027663428336381912, + 0.6158577743917704, + 0.8300877697765827, + 0.07441505417227745, + 1.338398713618517, + 0.0, + 0.0, + 1.5725744739174843, + 1.688340600579977, + 0.039743151515722275, + 0.07552387565374374, + 0.22124282643198967, + 0.3026740774512291, + 0.17058058828115463 + ], + "unique_experts": 56, + "load_cv": 0.8955910525085282, + "normalized_load_entropy": 0.9029384831233889, + "max_load_share": 0.06510416666666667 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "ordered_topk_exact_tokens": 17, + "set_exact_tokens": 18, + "mean_set_jaccard": 0.9378881987577641, + "mean_token_weighted_tv": 0.016828174500361733, + "aggregate_load_tv": 0.036231884057971016 + }, + "system_bos": { + "tokens": 23, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8788819875776398, + "mean_token_weighted_tv": 0.024391286561022633, + "aggregate_load_tv": 0.06521739130434782 + }, + "system_x": { + "tokens": 23, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8788819875776398, + "mean_token_weighted_tv": 0.027599767255394356, + "aggregate_load_tv": 0.050724637681159424 + }, + "system_period": { + "tokens": 23, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8881987577639753, + "mean_token_weighted_tv": 0.030148345126729946, + "aggregate_load_tv": 0.05072463768115943 + }, + "bos_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 16, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.9037267080745343, + "mean_token_weighted_tv": 0.023926271530597107, + "aggregate_load_tv": 0.057971014492753624 + }, + "bos_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8716356107660456, + "mean_token_weighted_tv": 0.027283972210210304, + "aggregate_load_tv": 0.07971014492753624 + }, + "x_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 13, + "mean_set_jaccard": 0.8534161490683231, + "mean_token_weighted_tv": 0.03396313677987327, + "aggregate_load_tv": 0.06521739130434784 + }, + "x_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 7, + "set_exact_tokens": 10, + "mean_set_jaccard": 0.8126293995859213, + "mean_token_weighted_tv": 0.0401500402747289, + "aggregate_load_tv": 0.10869565217391303 + }, + "period_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 12, + "mean_set_jaccard": 0.8467908902691513, + "mean_token_weighted_tv": 0.033275169644342815, + "aggregate_load_tv": 0.09420289855072464 + }, + "period_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 11, + "mean_set_jaccard": 0.8064182194616977, + "mean_token_weighted_tv": 0.04318894867015922, + "aggregate_load_tv": 0.10144927536231885 + } + } + }, + "layer_24": { + "layer": 24, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "9d00ddf179d18c8320a828883c6fc84c9cb324ea57cc7f67a489496672680ad9", + "route_weight_sha256": "d25f213a496b91bcbb61b525af63662261cc5ce8d921707f8f8305996e624a2f", + "loads": [ + 1, + 2, + 4, + 0, + 2, + 0, + 0, + 6, + 1, + 0, + 0, + 0, + 0, + 1, + 0, + 11, + 0, + 4, + 3, + 0, + 15, + 1, + 2, + 2, + 23, + 4, + 1, + 1, + 4, + 9, + 1, + 0, + 0, + 2, + 1, + 2, + 1, + 3, + 0, + 0, + 2, + 1, + 7, + 1, + 0, + 0, + 0, + 6, + 0, + 0, + 3, + 0, + 0, + 2, + 1, + 0, + 1, + 0, + 0, + 2, + 0, + 0, + 2, + 3 + ], + "weighted_loads": [ + 0.04049321264028549, + 0.0826195478439331, + 0.18986952304840088, + 0.0, + 0.05601312220096588, + 0.0, + 0.0, + 0.46426019817590714, + 0.05002646893262863, + 0.0, + 0.0, + 0.0, + 0.0, + 0.05470989644527435, + 0.0, + 0.9478633105754852, + 0.0, + 0.18085461296141148, + 0.1390601545572281, + 0.0, + 0.8765874709933996, + 0.06569641083478928, + 0.09461500495672226, + 0.30604055896401405, + 2.0829942002892494, + 0.23307849653065205, + 0.026240281760692596, + 0.032230839133262634, + 0.1384588275104761, + 0.4584132581949234, + 0.042653072625398636, + 0.0, + 0.0, + 0.34281767904758453, + 0.019904468208551407, + 0.06346726603806019, + 0.030711939558386803, + 0.1478409729897976, + 0.0, + 0.0, + 0.09777053818106651, + 0.03491789475083351, + 0.40963566675782204, + 0.04339350759983063, + 0.0, + 0.0, + 0.0, + 0.6666800081729889, + 0.0, + 0.0, + 0.1294453013688326, + 0.0, + 0.0, + 0.06629867292940617, + 0.03553943336009979, + 0.0, + 0.03475681319832802, + 0.0, + 0.0, + 0.11533968150615692, + 0.0, + 0.0, + 0.3558628782629967, + 0.4074913561344147 + ], + "unique_experts": 38, + "load_cv": 1.7701935999269776, + "normalized_load_entropy": 0.7609389297370125, + "max_load_share": 0.16666666666666666 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "8010cabfa92b8a01964fd1f4a990c15cbd57f03c402343daa574ca0b428a60df", + "route_weight_sha256": "425b67fefc7c16372bd7c6d002f398cb290d79ba1414e02df2add9fbe0c7714c", + "loads": [ + 1, + 3, + 6, + 0, + 2, + 3, + 1, + 7, + 9, + 0, + 10, + 0, + 1, + 1, + 2, + 11, + 1, + 4, + 3, + 1, + 16, + 1, + 6, + 2, + 32, + 4, + 3, + 2, + 11, + 16, + 2, + 2, + 2, + 5, + 8, + 3, + 3, + 5, + 1, + 0, + 2, + 2, + 11, + 1, + 0, + 2, + 0, + 11, + 0, + 0, + 11, + 5, + 3, + 6, + 1, + 0, + 1, + 0, + 9, + 2, + 2, + 17, + 6, + 6 + ], + "weighted_loads": [ + 0.04049321264028549, + 0.13280727341771126, + 0.25504245236516, + 0.0, + 0.05601312220096588, + 0.08817653928417712, + 0.05554276332259178, + 0.5188222005963326, + 0.41308617778122425, + 0.0, + 0.3760391485411674, + 0.0, + 0.0027125454507768154, + 0.05470989644527435, + 0.05499502830207348, + 0.9478633105754852, + 0.03711399808526039, + 0.18085461296141148, + 0.1390601545572281, + 0.036627549678087234, + 0.9117265325039625, + 0.06569641083478928, + 0.3406161218881607, + 0.30604055896401405, + 2.4317175429314375, + 0.23307849653065205, + 0.16290826350450516, + 0.09352366253733635, + 0.42442438565194607, + 0.7237437590956688, + 0.08636637404561043, + 0.06610789895057678, + 0.06418723426759243, + 0.4947873391211033, + 0.23933300375938416, + 0.10488913021981716, + 0.3509464170783758, + 1.0464142747223377, + 0.042161889374256134, + 0.0, + 0.09777053818106651, + 0.09263384714722633, + 0.5976010402664542, + 0.04339350759983063, + 0.0, + 0.08611200749874115, + 0.0, + 1.030241153552197, + 0.0, + 0.0, + 0.49599536694586277, + 0.3767065815627575, + 0.08607985824346542, + 0.24663900397717953, + 0.03553943336009979, + 0.0, + 0.03475681319832802, + 0.0, + 0.3085766551666893, + 0.11533968150615692, + 0.0862632617354393, + 1.381402898579836, + 0.43374798563309014, + 2.389152944087982 + ], + "unique_experts": 54, + "load_cv": 1.2165271355810106, + "normalized_load_entropy": 0.8597172272568004, + "max_load_share": 0.1111111111111111 + } + }, + "s1_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "9d54583ad426a179391cbf3adc2ee1fc0326db1968ff8c7b70d02bafe40abdaf", + "route_weight_sha256": "8499976f2d74ca268e3649ca34ff4de887c5b899584eff2ba7746d24b16b862f", + "loads": [ + 1, + 2, + 4, + 0, + 1, + 0, + 0, + 7, + 2, + 0, + 0, + 0, + 0, + 1, + 0, + 11, + 0, + 5, + 3, + 0, + 13, + 1, + 2, + 2, + 23, + 4, + 1, + 1, + 4, + 9, + 1, + 0, + 0, + 2, + 1, + 2, + 1, + 3, + 0, + 0, + 2, + 1, + 7, + 1, + 0, + 0, + 0, + 6, + 0, + 0, + 2, + 0, + 0, + 2, + 1, + 0, + 1, + 0, + 0, + 2, + 0, + 1, + 2, + 3 + ], + "weighted_loads": [ + 0.04325961694121361, + 0.0831657312810421, + 0.19309940189123154, + 0.0, + 0.02611524425446987, + 0.0, + 0.0, + 0.48867677710950375, + 0.06987199373543262, + 0.0, + 0.0, + 0.0, + 0.0, + 0.04318717494606972, + 0.0, + 0.9325893186032772, + 0.0, + 0.24365502782166004, + 0.14335979893803596, + 0.0, + 0.7909110318869352, + 0.060234639793634415, + 0.09180271625518799, + 0.30900974944233894, + 2.0977501310408115, + 0.23090293630957603, + 0.025935010984539986, + 0.031093424186110497, + 0.144090935587883, + 0.46290462277829647, + 0.04826207458972931, + 0.0, + 0.0, + 0.346014603972435, + 0.019088637083768845, + 0.06053462065756321, + 0.03488936275243759, + 0.1441153660416603, + 0.0, + 0.0, + 0.09474483504891396, + 0.036071956157684326, + 0.4267877973616123, + 0.04348374158143997, + 0.0, + 0.0, + 0.0, + 0.6652055084705353, + 0.0, + 0.0, + 0.10196532309055328, + 0.0, + 0.0, + 0.06465825065970421, + 0.03285291790962219, + 0.0, + 0.037277862429618835, + 0.0, + 0.0, + 0.1100531779229641, + 0.0, + 0.029210004955530167, + 0.34421495348215103, + 0.40759529173374176 + ], + "unique_experts": 39, + "load_cv": 1.7337477086970607, + "normalized_load_entropy": 0.7675828671475727, + "max_load_share": 0.16666666666666666 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "4001b9e7ae4ca24407641af40b2e7c0c5f35981e002cde57d7989ed0220bf982", + "route_weight_sha256": "ae34f6bad05090139ae7e5a563eaeb10778f4fd480dda84415dad9d014ad5617", + "loads": [ + 1, + 2, + 4, + 1, + 3, + 8, + 1, + 8, + 11, + 3, + 8, + 2, + 3, + 1, + 2, + 11, + 0, + 5, + 4, + 1, + 18, + 1, + 11, + 3, + 34, + 4, + 4, + 2, + 23, + 14, + 2, + 3, + 0, + 8, + 7, + 4, + 9, + 5, + 1, + 0, + 3, + 8, + 12, + 3, + 2, + 1, + 0, + 14, + 0, + 0, + 10, + 14, + 6, + 7, + 4, + 2, + 1, + 1, + 15, + 2, + 7, + 22, + 10, + 8 + ], + "weighted_loads": [ + 0.04325961694121361, + 0.0831657312810421, + 0.19309940189123154, + 0.1133539080619812, + 0.08702133037149906, + 0.25162072118837386, + 0.06776673346757889, + 0.526000240817666, + 0.6642002407461405, + 0.1313423104584217, + 0.32878198311664164, + 0.06508811563253403, + 0.06101670581847429, + 0.04318717494606972, + 0.0607377365231514, + 0.9325893186032772, + 0.0, + 0.24365502782166004, + 0.17608771100640297, + 0.030036892741918564, + 1.0161503609269857, + 0.060234639793634415, + 0.5938435066491365, + 0.3333300109952688, + 2.5035210009664297, + 0.23090293630957603, + 0.1756152343004942, + 0.0788076426833868, + 1.10032095387578, + 0.6851211208850145, + 0.08907603099942207, + 0.1394544616341591, + 0.0, + 0.6565685458481312, + 0.23442219803109765, + 0.1581335086375475, + 0.7236217372119427, + 1.051173485815525, + 0.052647143602371216, + 0.0, + 0.20834004506468773, + 0.44915817491710186, + 0.6283239023759961, + 0.25473130494356155, + 0.09289269521832466, + 0.0583321712911129, + 0.0, + 1.2580090973060578, + 0.0, + 0.0, + 0.47413807548582554, + 0.9520017486065626, + 0.16997162625193596, + 0.39492496475577354, + 0.23835085704922676, + 0.09597144275903702, + 0.037277862429618835, + 0.042600151151418686, + 0.6271416990784928, + 0.1100531779229641, + 0.23161710985004902, + 2.097373377997428, + 0.7397587185259908, + 2.4759166911244392 + ], + "unique_experts": 58, + "load_cv": 1.0639287779003086, + "normalized_load_entropy": 0.8840343425445333, + "max_load_share": 0.08854166666666667 + } + }, + "s0_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "799ee752ab640564ca7eff244661089f55c978161aca5215077bb0e4c78e7405", + "route_weight_sha256": "604df8f041b7d440f8e8c6deca27ce176c65888f42f00fe8ac387b63c4004103", + "loads": [ + 1, + 2, + 4, + 0, + 1, + 0, + 0, + 6, + 1, + 0, + 0, + 0, + 0, + 1, + 0, + 11, + 0, + 4, + 3, + 0, + 15, + 1, + 2, + 2, + 23, + 4, + 1, + 1, + 4, + 9, + 1, + 0, + 0, + 2, + 1, + 2, + 2, + 3, + 0, + 0, + 2, + 1, + 7, + 1, + 0, + 0, + 0, + 6, + 0, + 0, + 3, + 0, + 0, + 3, + 1, + 0, + 0, + 0, + 0, + 2, + 0, + 0, + 2, + 3 + ], + "weighted_loads": [ + 0.04282716289162636, + 0.08086241036653519, + 0.1931508667767048, + 0.0, + 0.02642235718667507, + 0.0, + 0.0, + 0.46608058363199234, + 0.049257002770900726, + 0.0, + 0.0, + 0.0, + 0.0, + 0.03930576145648956, + 0.0, + 0.9591630361974239, + 0.0, + 0.19065934233367443, + 0.14355099573731422, + 0.0, + 0.8975136484950781, + 0.08272484689950943, + 0.09825226664543152, + 0.29601961746811867, + 2.073457457125187, + 0.22680657356977463, + 0.024612803012132645, + 0.0313534252345562, + 0.15192515216767788, + 0.4602528288960457, + 0.04346739128232002, + 0.0, + 0.0, + 0.3508433923125267, + 0.018686123192310333, + 0.060481674037873745, + 0.06438342481851578, + 0.16145793348550797, + 0.0, + 0.0, + 0.10324804857373238, + 0.03767123445868492, + 0.4424295350909233, + 0.040735527873039246, + 0.0, + 0.0, + 0.0, + 0.6827260851860046, + 0.0, + 0.0, + 0.12482423149049282, + 0.0, + 0.0, + 0.09782788902521133, + 0.034063905477523804, + 0.0, + 0.0, + 0.0, + 0.0, + 0.1161603070795536, + 0.0, + 0.0, + 0.3753838986158371, + 0.4366653934121132 + ], + "unique_experts": 37, + "load_cv": 1.7739864529662308, + "normalized_load_entropy": 0.7576117709179744, + "max_load_share": 0.16666666666666666 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "5ca182aab45bcfbdfbd18ee5f089ab40eb5d54f5d6930762c5aed218a3e4f22c", + "route_weight_sha256": "e3d4f0b470909dc5bbfe6c57f691947eaa1cb2d62e4a82090d3706de2fe33391", + "loads": [ + 1, + 3, + 7, + 0, + 1, + 5, + 1, + 8, + 8, + 0, + 8, + 0, + 1, + 1, + 2, + 11, + 0, + 4, + 3, + 1, + 16, + 1, + 8, + 2, + 33, + 4, + 5, + 2, + 11, + 16, + 2, + 3, + 2, + 5, + 7, + 2, + 4, + 4, + 0, + 0, + 2, + 2, + 12, + 1, + 0, + 2, + 1, + 10, + 0, + 0, + 11, + 6, + 3, + 7, + 1, + 0, + 0, + 0, + 8, + 2, + 2, + 17, + 4, + 5 + ], + "weighted_loads": [ + 0.04282716289162636, + 0.13249247521162033, + 0.2945164293050766, + 0.0, + 0.02642235718667507, + 0.1659356077434495, + 0.09454122185707092, + 0.5637443624436855, + 0.407824769616127, + 0.0, + 0.32365267374552786, + 0.0, + 0.0027125454507768154, + 0.03930576145648956, + 0.05499502830207348, + 0.9591630361974239, + 0.0, + 0.19065934233367443, + 0.14355099573731422, + 0.03335191309452057, + 0.932652710005641, + 0.08272484689950943, + 0.5300104431807995, + 0.29601961746811867, + 2.4393700566142797, + 0.22680657356977463, + 0.5319847129285336, + 0.06720266118645668, + 0.43789071030914783, + 0.7344325445592403, + 0.08594558760523796, + 0.09236230701208115, + 0.09063904918730259, + 0.5028130523860455, + 0.19858043640851974, + 0.060481674037873745, + 0.26770303398370743, + 1.0263626351952553, + 0.0, + 0.0, + 0.10324804857373238, + 0.09538718685507774, + 0.7053197426721454, + 0.040735527873039246, + 0.0, + 0.11271686106920242, + 0.06045151501893997, + 1.0977929222863168, + 0.0, + 0.0, + 0.5125312339514494, + 0.3830752819776535, + 0.08607985824346542, + 0.28491364419460297, + 0.034063905477523804, + 0.0, + 0.0, + 0.0, + 0.31147108040750027, + 0.1161603070795536, + 0.08875034749507904, + 1.384310893714428, + 0.4205900769447908, + 1.448934145271778 + ], + "unique_experts": 52, + "load_cv": 1.2341588828623924, + "normalized_load_entropy": 0.8545509904680587, + "max_load_share": 0.11458333333333333 + } + }, + "s1_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "414994e94fa80209adad55b336139fe2d1f9bfc5811766ceb8fd4d02cd11cae0", + "route_weight_sha256": "cebe635151a428b78655102c01341ab0205739ca640aa859d492185a399871c0", + "loads": [ + 1, + 2, + 4, + 0, + 1, + 0, + 0, + 6, + 1, + 0, + 0, + 0, + 0, + 1, + 0, + 10, + 0, + 5, + 3, + 0, + 12, + 1, + 2, + 2, + 23, + 4, + 1, + 1, + 5, + 9, + 1, + 0, + 0, + 2, + 1, + 2, + 1, + 3, + 0, + 0, + 2, + 1, + 7, + 1, + 0, + 0, + 0, + 7, + 0, + 0, + 3, + 0, + 1, + 2, + 1, + 0, + 0, + 0, + 0, + 3, + 0, + 1, + 2, + 3 + ], + "weighted_loads": [ + 0.041588179767131805, + 0.09176531806588173, + 0.1924077905714512, + 0.0, + 0.030800217762589455, + 0.0, + 0.0, + 0.45030803233385086, + 0.045445993542671204, + 0.0, + 0.0, + 0.0, + 0.0, + 0.03999781236052513, + 0.0, + 0.8973589800298214, + 0.0, + 0.23663034290075302, + 0.1430835761129856, + 0.0, + 0.8024947047233582, + 0.06823824346065521, + 0.09423409402370453, + 0.29542945325374603, + 2.0675120130181313, + 0.2192063331604004, + 0.026811927556991577, + 0.030782373622059822, + 0.1859091967344284, + 0.4732936881482601, + 0.04344873130321503, + 0.0, + 0.0, + 0.3347638249397278, + 0.0172909926623106, + 0.0607520155608654, + 0.03436574712395668, + 0.15541263669729233, + 0.0, + 0.0, + 0.09784668311476707, + 0.039306640625, + 0.45937858894467354, + 0.043518707156181335, + 0.0, + 0.0, + 0.0, + 0.7013101261109114, + 0.0, + 0.0, + 0.1302859280258417, + 0.0, + 0.02343234047293663, + 0.0638766661286354, + 0.03467905893921852, + 0.0, + 0.0, + 0.0, + 0.0, + 0.15834903344511986, + 0.0, + 0.02899368852376938, + 0.38757649809122086, + 0.4195559024810791 + ], + "unique_experts": 39, + "load_cv": 1.7044242317488731, + "normalized_load_entropy": 0.7709659803173229, + "max_load_share": 0.16666666666666666 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "314d4ae657541f3afa394704a778079f3cdf1c8f4f4828d7f040ec4874cd2f4a", + "route_weight_sha256": "c12c9f548ae27bd209c9c0a71c692658e63966fd244090db8878b451abac3998", + "loads": [ + 1, + 3, + 6, + 1, + 3, + 8, + 1, + 8, + 9, + 3, + 7, + 2, + 3, + 1, + 2, + 10, + 0, + 5, + 4, + 2, + 17, + 1, + 13, + 3, + 33, + 4, + 4, + 1, + 24, + 15, + 1, + 4, + 0, + 8, + 7, + 4, + 9, + 6, + 1, + 0, + 3, + 8, + 13, + 4, + 1, + 2, + 0, + 14, + 0, + 0, + 12, + 14, + 7, + 7, + 4, + 2, + 0, + 0, + 14, + 3, + 5, + 22, + 9, + 6 + ], + "weighted_loads": [ + 0.041588179767131805, + 0.14327098801732063, + 0.25502297282218933, + 0.1133539080619812, + 0.09170630387961864, + 0.24561926175374538, + 0.04021750018000603, + 0.5328315235674381, + 0.6353946663439274, + 0.1313423104584217, + 0.3232247943524271, + 0.06508811563253403, + 0.06101670581847429, + 0.03999781236052513, + 0.0607377365231514, + 0.8973589800298214, + 0.0, + 0.23663034290075302, + 0.17581148818135262, + 0.06029936857521534, + 1.0277340337634087, + 0.06823824346065521, + 0.7865376397967339, + 0.3197497148066759, + 2.434956042096019, + 0.2192063331604004, + 0.1454721838235855, + 0.030782373622059822, + 1.1421392150223255, + 0.7347063012421131, + 0.04344873130321503, + 0.17530625313520432, + 0.0, + 0.645317766815424, + 0.24734187172725797, + 0.15835090354084969, + 0.6305720806121826, + 1.0992945842444897, + 0.044178713113069534, + 0.0, + 0.21144189313054085, + 0.45239285938441753, + 0.8201188975945115, + 0.3279249295592308, + 0.0391542986035347, + 0.10027847066521645, + 0.0, + 1.3529007758479565, + 0.0, + 0.0, + 0.6452627945691347, + 0.9081724788993597, + 0.1934039667248726, + 0.3857103977352381, + 0.2401769980788231, + 0.09597144275903702, + 0.0, + 0.0, + 0.628411864861846, + 0.15834903344511986, + 0.1698321159929037, + 2.048673760611564, + 0.7930959820514545, + 1.4709193259477615 + ], + "unique_experts": 56, + "load_cv": 1.0594318445909268, + "normalized_load_entropy": 0.8820910893169331, + "max_load_share": 0.0859375 + } + }, + "s0_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "e90771244a6ac81e4290f583cb4463412920706704c5ed4a034396d6c0a48886", + "route_weight_sha256": "7f6d8fb6c727d407803dd1f64421a4ff73a01f63c3441b47959c01276b7186af", + "loads": [ + 1, + 2, + 4, + 0, + 1, + 0, + 0, + 7, + 1, + 0, + 0, + 0, + 0, + 1, + 0, + 11, + 0, + 5, + 3, + 0, + 13, + 1, + 2, + 2, + 23, + 4, + 1, + 1, + 4, + 9, + 1, + 0, + 0, + 2, + 1, + 2, + 2, + 3, + 0, + 0, + 2, + 1, + 6, + 1, + 0, + 1, + 0, + 6, + 0, + 0, + 2, + 0, + 1, + 3, + 1, + 0, + 0, + 0, + 0, + 2, + 0, + 0, + 2, + 3 + ], + "weighted_loads": [ + 0.04315977916121483, + 0.08345689997076988, + 0.22949575632810593, + 0.0, + 0.02795647643506527, + 0.0, + 0.0, + 0.5253224726766348, + 0.044028811156749725, + 0.0, + 0.0, + 0.0, + 0.0, + 0.045202575623989105, + 0.0, + 0.9285597801208496, + 0.0, + 0.22859123535454273, + 0.134369395673275, + 0.0, + 0.79890719614923, + 0.07674422115087509, + 0.09691738709807396, + 0.29906508326530457, + 2.0692454800009727, + 0.21633593551814556, + 0.024690216407179832, + 0.031876396387815475, + 0.15090913884341717, + 0.4570316355675459, + 0.04506296291947365, + 0.0, + 0.0, + 0.3681081607937813, + 0.02401942014694214, + 0.062086446210742, + 0.06932831928133965, + 0.15735134109854698, + 0.0, + 0.0, + 0.10232570022344589, + 0.03879883140325546, + 0.3821808993816376, + 0.04529028758406639, + 0.0, + 0.03146255016326904, + 0.0, + 0.6701047196984291, + 0.0, + 0.0, + 0.10401510074734688, + 0.0, + 0.024416906759142876, + 0.09441611357033253, + 0.032292913645505905, + 0.0, + 0.0, + 0.0, + 0.0, + 0.11219517514109612, + 0.0, + 0.0, + 0.3074216917157173, + 0.41513026505708694 + ], + "unique_experts": 39, + "load_cv": 1.7259768275506353, + "normalized_load_entropy": 0.7692577728817669, + "max_load_share": 0.16666666666666666 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "dfdb4d10a31175138ec29ee9cbcd1b79ce138118fd6f05e538ae6207cf02d410", + "route_weight_sha256": "0a0f61241230be71e3b8290d098022b44815baf7d31bb55039c0a35c91de4f33", + "loads": [ + 1, + 3, + 6, + 0, + 1, + 4, + 1, + 9, + 9, + 0, + 9, + 0, + 2, + 1, + 2, + 11, + 0, + 5, + 3, + 0, + 14, + 1, + 6, + 2, + 31, + 4, + 2, + 1, + 12, + 16, + 1, + 2, + 2, + 5, + 9, + 3, + 5, + 6, + 1, + 0, + 3, + 2, + 10, + 1, + 0, + 4, + 0, + 11, + 0, + 0, + 9, + 6, + 4, + 8, + 1, + 0, + 0, + 0, + 9, + 2, + 2, + 17, + 4, + 5 + ], + "weighted_loads": [ + 0.04315977916121483, + 0.13161378353834152, + 0.29466868564486504, + 0.0, + 0.02795647643506527, + 0.11889178876299411, + 0.03217513859272003, + 0.6158298011869192, + 0.48582229763269424, + 0.0, + 0.37919079908169806, + 0.0, + 0.03529150178655982, + 0.045202575623989105, + 0.05499502830207348, + 0.9285597801208496, + 0.0, + 0.22859123535454273, + 0.134369395673275, + 0.0, + 0.8340462576597929, + 0.07674422115087509, + 0.35155095532536507, + 0.29906508326530457, + 2.373532010242343, + 0.21633593551814556, + 0.06614169664680958, + 0.031876396387815475, + 0.4722123648971319, + 0.7376039680093527, + 0.04506296291947365, + 0.05787960812449455, + 0.06760147400200367, + 0.5200778208673, + 0.2790182791650295, + 0.09755116142332554, + 0.351454958319664, + 1.0975020192563534, + 0.03756461665034294, + 0.0, + 0.1377159245312214, + 0.09651478379964828, + 0.5308747394010425, + 0.04529028758406639, + 0.0, + 0.14931748062372208, + 0.0, + 1.091948765097186, + 0.0, + 0.0, + 0.4013478122651577, + 0.4095587842166424, + 0.1104967650026083, + 0.32835577242076397, + 0.032292913645505905, + 0.0, + 0.0, + 0.0, + 0.3395045828074217, + 0.11219517514109612, + 0.08464371785521507, + 1.3461551330983639, + 0.34997826104518026, + 1.4273990169167519 + ], + "unique_experts": 51, + "load_cv": 1.1941214033447043, + "normalized_load_entropy": 0.8562204797535816, + "max_load_share": 0.1076388888888889 + } + }, + "s1_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "8fbabffbc57a5d33205fac10cc964265b65a4531fe2f93045c787c2c6e42d574", + "route_weight_sha256": "ff12bc28c0bb10ed7550aa3165aa4d9371a1c90e071493d4b5c6d831c1b68e3e", + "loads": [ + 1, + 2, + 4, + 0, + 1, + 0, + 0, + 7, + 2, + 0, + 0, + 0, + 0, + 1, + 0, + 9, + 0, + 6, + 3, + 0, + 15, + 1, + 2, + 2, + 23, + 3, + 0, + 1, + 6, + 7, + 1, + 0, + 0, + 2, + 1, + 1, + 1, + 3, + 0, + 0, + 2, + 1, + 7, + 1, + 0, + 2, + 0, + 6, + 0, + 0, + 2, + 0, + 1, + 2, + 2, + 0, + 0, + 0, + 0, + 2, + 0, + 0, + 2, + 3 + ], + "weighted_loads": [ + 0.038173697888851166, + 0.09804732725024223, + 0.23710792139172554, + 0.0, + 0.029102426022291183, + 0.0, + 0.0, + 0.49281503818929195, + 0.064718684181571, + 0.0, + 0.0, + 0.0, + 0.0, + 0.036855507642030716, + 0.0, + 0.8013245314359665, + 0.0, + 0.29889369010925293, + 0.13283754512667656, + 0.0, + 0.8917459100484848, + 0.0679636299610138, + 0.09103558957576752, + 0.27357644587755203, + 2.0063295625150204, + 0.17382602021098137, + 0.0, + 0.03357023373246193, + 0.2560326121747494, + 0.3896644152700901, + 0.051812127232551575, + 0.0, + 0.0, + 0.3581566661596298, + 0.02264290116727352, + 0.04457077756524086, + 0.035030197352170944, + 0.14792543649673462, + 0.0, + 0.0, + 0.09836624935269356, + 0.03411512076854706, + 0.40530042722821236, + 0.0448441244661808, + 0.0, + 0.06442595086991787, + 0.0, + 0.6894677951931953, + 0.0, + 0.0, + 0.10412171110510826, + 0.0, + 0.022998975589871407, + 0.057680683210492134, + 0.06316192075610161, + 0.0, + 0.0, + 0.0, + 0.0, + 0.09489116072654724, + 0.0, + 0.0, + 0.2833159863948822, + 0.4001448079943657 + ], + "unique_experts": 38, + "load_cv": 1.7434126025199828, + "normalized_load_entropy": 0.7648531856450762, + "max_load_share": 0.16666666666666666 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "ffaeb3104f99c0f66a2e27f4fff13e56dde07b2f2166e37fcef49b9a1a5b40c5", + "route_weight_sha256": "999a206439b959735014e0d7dffa1df72a1436138288f7ea0725ff14876fa1d4", + "loads": [ + 1, + 3, + 4, + 1, + 3, + 8, + 1, + 9, + 12, + 3, + 6, + 2, + 4, + 1, + 2, + 9, + 0, + 6, + 4, + 2, + 21, + 1, + 11, + 3, + 32, + 5, + 0, + 1, + 26, + 12, + 2, + 3, + 0, + 9, + 7, + 4, + 11, + 7, + 0, + 0, + 3, + 8, + 12, + 3, + 1, + 3, + 0, + 13, + 0, + 0, + 9, + 14, + 7, + 9, + 5, + 2, + 0, + 0, + 16, + 2, + 5, + 21, + 9, + 6 + ], + "weighted_loads": [ + 0.038173697888851166, + 0.1325448788702488, + 0.23710792139172554, + 0.1133539080619812, + 0.09000851213932037, + 0.24526818853337318, + 0.038749247789382935, + 0.6139351520687342, + 0.7421247195452452, + 0.1313423104584217, + 0.27959036850370467, + 0.06508811563253403, + 0.09119873214513063, + 0.036855507642030716, + 0.0607377365231514, + 0.8013245314359665, + 0.0, + 0.29889369010925293, + 0.16556545719504356, + 0.07728377357125282, + 1.1493485532701015, + 0.0679636299610138, + 0.586427703499794, + 0.2978967074304819, + 2.3351815175265074, + 0.2491067722439766, + 0.0, + 0.03357023373246193, + 1.2530944496393204, + 0.6118809133768082, + 0.09628044068813324, + 0.1394544616341591, + 0.0, + 0.7064950577914715, + 0.23133091675117612, + 0.18843065947294235, + 0.7402914762496948, + 1.1242004670202732, + 0.0, + 0.0, + 0.21196145936846733, + 0.4472013395279646, + 0.5549339214339852, + 0.2560916878283024, + 0.0391542986035347, + 0.12275812216103077, + 0.0, + 1.2521994307171553, + 0.0, + 0.0, + 0.43127451837062836, + 0.941268676891923, + 0.19297060184180737, + 0.4735971800982952, + 0.2686598598957062, + 0.09597144275903702, + 0.0, + 0.0, + 0.6983745861798525, + 0.09489116072654724, + 0.16493095271289349, + 2.0078607951290905, + 0.6750840902095661, + 1.4515082314610481 + ], + "unique_experts": 54, + "load_cv": 1.0793194872490515, + "normalized_load_entropy": 0.8757961176533123, + "max_load_share": 0.08333333333333333 + } + }, + "s0_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "a86a4e9c60cfa2b5c54c3abd36787c5d31f637b43ba57ce2b633ac2c8f61869f", + "route_weight_sha256": "9bedfba900ba808557afe9126790a8dca02279f9e1d69bd8c4706d391ef3c791", + "loads": [ + 1, + 2, + 4, + 0, + 1, + 0, + 0, + 6, + 1, + 0, + 0, + 0, + 0, + 1, + 0, + 10, + 0, + 5, + 3, + 0, + 13, + 1, + 2, + 2, + 23, + 4, + 0, + 1, + 4, + 9, + 1, + 0, + 0, + 2, + 1, + 2, + 2, + 3, + 0, + 0, + 2, + 1, + 6, + 1, + 0, + 2, + 0, + 7, + 0, + 0, + 3, + 0, + 1, + 3, + 1, + 0, + 0, + 0, + 0, + 2, + 0, + 0, + 2, + 3 + ], + "weighted_loads": [ + 0.039512623101472855, + 0.0835166871547699, + 0.21103094145655632, + 0.0, + 0.025336571037769318, + 0.0, + 0.0, + 0.4748467952013016, + 0.04232907295227051, + 0.0, + 0.0, + 0.0, + 0.0, + 0.045260291546583176, + 0.0, + 0.885402012616396, + 0.0, + 0.22951052151620388, + 0.13597312942147255, + 0.0, + 0.8125291150063276, + 0.0727018490433693, + 0.09966301918029785, + 0.2956686429679394, + 2.0923528522253036, + 0.2259929832071066, + 0.0, + 0.032746292650699615, + 0.15390315279364586, + 0.45582412742078304, + 0.045171353965997696, + 0.0, + 0.0, + 0.36647405475378036, + 0.023672273382544518, + 0.06042379327118397, + 0.06162921525537968, + 0.16262542456388474, + 0.0, + 0.0, + 0.10361484438180923, + 0.03782434016466141, + 0.40352388471364975, + 0.04604767635464668, + 0.0, + 0.06566268764436245, + 0.0, + 0.7246260195970535, + 0.0, + 0.0, + 0.13375786319375038, + 0.0, + 0.02341546304523945, + 0.09229527972638607, + 0.033932458609342575, + 0.0, + 0.0, + 0.0, + 0.0, + 0.11149576678872108, + 0.0, + 0.0, + 0.31722576916217804, + 0.40957218408584595 + ], + "unique_experts": 38, + "load_cv": 1.7122929276100187, + "normalized_load_entropy": 0.7693538832126524, + "max_load_share": 0.16666666666666666 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "2c561e914f183b6527a85d8c3a7c0bd28a34a2620d7e1706413a51ef44bac16d", + "route_weight_sha256": "222936f7a62ea213d29f87b12f06dbd65cacee7b967cc0e43d2f94c9b50a37f2", + "loads": [ + 2, + 3, + 7, + 0, + 1, + 4, + 0, + 8, + 9, + 0, + 8, + 0, + 1, + 1, + 3, + 10, + 0, + 6, + 3, + 1, + 14, + 1, + 7, + 2, + 32, + 4, + 1, + 2, + 11, + 16, + 2, + 1, + 2, + 5, + 8, + 2, + 4, + 6, + 0, + 0, + 3, + 3, + 11, + 2, + 0, + 3, + 0, + 12, + 0, + 0, + 11, + 6, + 5, + 6, + 1, + 0, + 0, + 0, + 8, + 2, + 2, + 17, + 4, + 5 + ], + "weighted_loads": [ + 0.07627790793776512, + 0.141981303691864, + 0.3152051270008087, + 0.0, + 0.025336571037769318, + 0.12127555732149631, + 0.0, + 0.5663520134985447, + 0.4326103441417217, + 0.0, + 0.32365267374552786, + 0.0, + 0.0027125454507768154, + 0.045260291546583176, + 0.08784442581236362, + 0.885402012616396, + 0.0, + 0.2634927649050951, + 0.13597312942147255, + 0.041023898869752884, + 0.8476681765168905, + 0.0727018490433693, + 0.4019507169723511, + 0.2956686429679394, + 2.4384145941585302, + 0.2259929832071066, + 0.041212841868400574, + 0.06306552141904831, + 0.4398687109351158, + 0.737157778814435, + 0.07663033902645111, + 0.03214442357420921, + 0.08115765266120434, + 0.5184437148272991, + 0.2493692021816969, + 0.06042379327118397, + 0.29401283897459507, + 1.1055174712091684, + 0.0, + 0.0, + 0.15096861124038696, + 0.16020069271326065, + 0.6213003871962428, + 0.08235564082860947, + 0.0, + 0.11322741024196148, + 0.0, + 1.0990122619550675, + 0.0, + 0.0, + 0.5258197672665119, + 0.46110157668590546, + 0.13895627111196518, + 0.23474262841045856, + 0.033932458609342575, + 0.0, + 0.0, + 0.0, + 0.3051651809364557, + 0.11149576678872108, + 0.0892815813422203, + 1.362333882600069, + 0.3602582219755277, + 1.4218409359455109 + ], + "unique_experts": 50, + "load_cv": 1.208253509496197, + "normalized_load_entropy": 0.8544669261906129, + "max_load_share": 0.1111111111111111 + } + }, + "s1_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "414bcf283bd585e46087960310f12e1c69fa6ccda9fcfbe8c409e4fbd19760a9", + "route_weight_sha256": "6e8cafb200b1403fc25d6ffbfb285a0debb22908abed5ab93ec1f491946f0197", + "loads": [ + 1, + 2, + 5, + 0, + 1, + 0, + 0, + 7, + 2, + 0, + 0, + 0, + 0, + 1, + 0, + 10, + 0, + 6, + 3, + 0, + 14, + 1, + 2, + 2, + 23, + 3, + 0, + 1, + 6, + 6, + 1, + 0, + 0, + 2, + 1, + 2, + 1, + 3, + 0, + 0, + 2, + 1, + 6, + 1, + 0, + 1, + 0, + 7, + 0, + 0, + 2, + 0, + 1, + 2, + 1, + 0, + 0, + 0, + 0, + 2, + 1, + 0, + 2, + 3 + ], + "weighted_loads": [ + 0.03888993337750435, + 0.09279734268784523, + 0.28288019448518753, + 0.0, + 0.027422131970524788, + 0.0, + 0.0, + 0.49494024366140366, + 0.06203432008624077, + 0.0, + 0.0, + 0.0, + 0.0, + 0.03535114601254463, + 0.0, + 0.8396667316555977, + 0.0, + 0.30684424191713333, + 0.1298825852572918, + 0.0, + 0.8274276927113533, + 0.06615588814020157, + 0.08913467451930046, + 0.27539418637752533, + 1.9832810387015343, + 0.17746858671307564, + 0.0, + 0.034226495772600174, + 0.27556566148996353, + 0.3350987434387207, + 0.05030826851725578, + 0.0, + 0.0, + 0.35784394294023514, + 0.02329370565712452, + 0.06196705251932144, + 0.03235221654176712, + 0.14961741492152214, + 0.0, + 0.0, + 0.0970003679394722, + 0.035713355988264084, + 0.3627043403685093, + 0.045003168284893036, + 0.0, + 0.03195298835635185, + 0.0, + 0.7421575747430325, + 0.0, + 0.0, + 0.10863875597715378, + 0.0, + 0.022969836369156837, + 0.05653844587504864, + 0.03425747901201248, + 0.0, + 0.0, + 0.0, + 0.0, + 0.08908366784453392, + 0.030999360606074333, + 0.0, + 0.27761422097682953, + 0.41567154973745346 + ], + "unique_experts": 39, + "load_cv": 1.7279228241690638, + "normalized_load_entropy": 0.7686484792019217, + "max_load_share": 0.16666666666666666 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "049c63ea13d94c8e97045f60de8af2e157749c92a2c1ceb742d8f7bbd2ce7566", + "route_weight_sha256": "6b7e79df44f68e6b1fa886ff1945526b2776e2b0be00b843e0c5ca06886b8a39", + "loads": [ + 1, + 2, + 6, + 1, + 3, + 8, + 1, + 9, + 11, + 3, + 6, + 2, + 3, + 1, + 2, + 10, + 0, + 6, + 4, + 3, + 19, + 1, + 9, + 3, + 33, + 4, + 0, + 1, + 26, + 11, + 2, + 3, + 0, + 8, + 7, + 5, + 9, + 8, + 1, + 0, + 3, + 9, + 10, + 4, + 1, + 2, + 0, + 14, + 0, + 0, + 11, + 15, + 8, + 9, + 4, + 2, + 0, + 0, + 17, + 2, + 6, + 21, + 8, + 6 + ], + "weighted_loads": [ + 0.03888993337750435, + 0.09279734268784523, + 0.3177065886557102, + 0.1133539080619812, + 0.08832821808755398, + 0.24546461750287563, + 0.0407370962202549, + 0.5860367976129055, + 0.6927611418068409, + 0.1313423104584217, + 0.27959036850370467, + 0.06508811563253403, + 0.06101670581847429, + 0.03535114601254463, + 0.0607377365231514, + 0.8396667316555977, + 0.0, + 0.30684424191713333, + 0.1626104973256588, + 0.10856911540031433, + 1.0526670217514038, + 0.06615588814020157, + 0.5178312510251999, + 0.2997144479304552, + 2.354374947026372, + 0.2322881817817688, + 0.0, + 0.034226495772600174, + 1.2875476703047752, + 0.5573152415454388, + 0.09932779148221016, + 0.1394544616341591, + 0.0, + 0.6683978848159313, + 0.22651675762608647, + 0.19948765262961388, + 0.629209216684103, + 1.170723658055067, + 0.039922893047332764, + 0.0, + 0.21059557795524597, + 0.4973066318780184, + 0.4748110482469201, + 0.29900702461600304, + 0.0391542986035347, + 0.09028515964746475, + 0.0, + 1.3028269379865378, + 0.0, + 0.0, + 0.5503436475992203, + 0.9914293680340052, + 0.2187552060931921, + 0.48366263322532177, + 0.23975541815161705, + 0.09597144275903702, + 0.0, + 0.0, + 0.7342081144452095, + 0.08908366784453392, + 0.19316953420639038, + 1.9811842744238675, + 0.6263008959358558, + 1.467034973204136 + ], + "unique_experts": 55, + "load_cv": 1.078112419411301, + "normalized_load_entropy": 0.877719632832098, + "max_load_share": 0.0859375 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.9503105590062113, + "mean_token_weighted_tv": 0.01349202871484601, + "aggregate_load_tv": 0.028985507246376812 + }, + "system_bos": { + "tokens": 23, + "ordered_topk_exact_tokens": 16, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.9254658385093167, + "mean_token_weighted_tv": 0.019595922598534304, + "aggregate_load_tv": 0.043478260869565216 + }, + "system_x": { + "tokens": 23, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 13, + "mean_set_jaccard": 0.8757763975155279, + "mean_token_weighted_tv": 0.029289788080622322, + "aggregate_load_tv": 0.06521739130434782 + }, + "system_period": { + "tokens": 23, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 13, + "mean_set_jaccard": 0.8757763975155279, + "mean_token_weighted_tv": 0.03273690601243921, + "aggregate_load_tv": 0.057971014492753624 + }, + "bos_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 17, + "set_exact_tokens": 21, + "mean_set_jaccard": 0.9751552795031057, + "mean_token_weighted_tv": 0.01507683420229865, + "aggregate_load_tv": 0.014492753623188404 + }, + "bos_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 18, + "mean_set_jaccard": 0.9378881987577639, + "mean_token_weighted_tv": 0.020102497028267902, + "aggregate_load_tv": 0.036231884057971016 + }, + "x_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.9130434782608695, + "mean_token_weighted_tv": 0.023208557385141434, + "aggregate_load_tv": 0.043478260869565216 + }, + "x_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 8, + "set_exact_tokens": 11, + "mean_set_jaccard": 0.8322981366459629, + "mean_token_weighted_tv": 0.038862313710800976, + "aggregate_load_tv": 0.06521739130434781 + }, + "period_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.9130434782608695, + "mean_token_weighted_tv": 0.021904711166153782, + "aggregate_load_tv": 0.05072463768115942 + }, + "period_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 12, + "mean_set_jaccard": 0.8354037267080746, + "mean_token_weighted_tv": 0.04039532699338768, + "aggregate_load_tv": 0.06521739130434784 + } + } + }, + "layer_25": { + "layer": 25, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "389538997b1ffb9b8b55bc5f528ac3651d2740b93eaa5b509f8fda8d5c651aa8", + "route_weight_sha256": "2b09514b99b55122e06e33aff6f3cfef5b83492f6abd6d53c935ff8133c6d0c6", + "loads": [ + 1, + 0, + 4, + 0, + 0, + 0, + 4, + 4, + 1, + 7, + 1, + 4, + 2, + 1, + 0, + 0, + 0, + 6, + 1, + 2, + 1, + 0, + 5, + 0, + 0, + 4, + 2, + 1, + 3, + 3, + 2, + 1, + 4, + 4, + 1, + 3, + 4, + 6, + 1, + 1, + 2, + 3, + 2, + 0, + 0, + 0, + 9, + 0, + 4, + 6, + 1, + 0, + 1, + 0, + 4, + 3, + 9, + 3, + 0, + 2, + 1, + 0, + 2, + 2 + ], + "weighted_loads": [ + 0.05526982620358467, + 0.0, + 0.16418527625501156, + 0.0, + 0.0, + 0.0, + 0.2896426357328892, + 0.16736623272299767, + 0.03770855814218521, + 0.39687016792595387, + 0.040715064853429794, + 0.33357420563697815, + 0.15049544721841812, + 0.028572769835591316, + 0.0, + 0.0, + 0.0, + 0.5669883154332638, + 0.035195376724004745, + 0.3177458196878433, + 0.02678120881319046, + 0.0, + 0.41804379038512707, + 0.0, + 0.0, + 0.3857413977384567, + 0.1297977827489376, + 0.05258127674460411, + 0.19759481400251389, + 0.10881050117313862, + 0.0868292786180973, + 0.04766009375452995, + 0.3907049670815468, + 0.3207909166812897, + 0.031064284965395927, + 0.11124922335147858, + 0.29336271807551384, + 0.47965760715305805, + 0.02212202362716198, + 0.03289776295423508, + 0.12946447730064392, + 0.12633197754621506, + 0.10654238983988762, + 0.0, + 0.0, + 0.0, + 0.5845275577157736, + 0.0, + 0.17952099069952965, + 0.42691968753933907, + 0.05048589035868645, + 0.0, + 0.039626285433769226, + 0.0, + 0.32162170857191086, + 0.14489341527223587, + 0.8037785738706589, + 0.2580668330192566, + 0.0, + 0.0827530026435852, + 0.07919678092002869, + 0.0, + 0.4588264971971512, + 0.07127473130822182 + ], + "unique_experts": 46, + "load_cv": 1.0214050229766756, + "normalized_load_entropy": 0.8690796498244252, + "max_load_share": 0.06521739130434782 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "e70106f265c53c2cc555656dae0d89caf198cd15538b7595f5b0cf4bd184e3cd", + "route_weight_sha256": "9bd3e36f89109de4bc480d5a3ffd7b26d0956e8ce6ffcb653abe1da8fafcec18", + "loads": [ + 3, + 17, + 11, + 1, + 0, + 0, + 10, + 4, + 1, + 7, + 12, + 8, + 6, + 1, + 0, + 0, + 0, + 10, + 2, + 2, + 1, + 0, + 5, + 3, + 0, + 4, + 2, + 2, + 4, + 6, + 3, + 2, + 5, + 5, + 3, + 3, + 4, + 7, + 12, + 4, + 8, + 3, + 2, + 1, + 4, + 9, + 13, + 0, + 4, + 8, + 11, + 0, + 8, + 0, + 13, + 3, + 10, + 7, + 0, + 2, + 3, + 0, + 6, + 3 + ], + "weighted_loads": [ + 0.17533447220921516, + 1.2415189212188125, + 0.6564384307712317, + 0.04914705082774162, + 0.0, + 0.0, + 0.6998179480433464, + 0.16736623272299767, + 0.03770855814218521, + 0.39687016792595387, + 1.0601735673844814, + 0.9787540826946497, + 0.47058189287781715, + 0.028572769835591316, + 0.0, + 0.0, + 0.0, + 0.6977655775845051, + 0.08064251765608788, + 0.3177458196878433, + 0.02678120881319046, + 0.0, + 0.41804379038512707, + 0.12052246369421482, + 0.0, + 0.3857413977384567, + 0.1297977827489376, + 0.10868826881051064, + 0.23962002992630005, + 0.23714247532188892, + 0.13540533557534218, + 0.13372879102826118, + 0.44316215440630913, + 0.383837528526783, + 0.12629068829119205, + 0.11124922335147858, + 0.29336271807551384, + 0.5182454008609056, + 1.4866160843521357, + 0.3773740753531456, + 0.38372132182121277, + 0.12633197754621506, + 0.10654238983988762, + 0.032854460179805756, + 0.32366038486361504, + 0.8112677186727524, + 0.7166718047810718, + 0.0, + 0.17952099069952965, + 0.5160847753286362, + 0.6610435992479324, + 0.0, + 0.3876461172476411, + 0.0, + 0.814715416636318, + 0.14489341527223587, + 0.8500395826995373, + 0.4354054629802704, + 0.0, + 0.0827530026435852, + 0.17824248224496841, + 0.0, + 0.8317728191614151, + 0.13509142771363258 + ], + "unique_experts": 52, + "load_cv": 0.9018157267082181, + "normalized_load_entropy": 0.8957173892572684, + "max_load_share": 0.059027777777777776 + } + }, + "s1_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "4107370143f00ee90390ad1ede5b49beb6478b512896ee1e5b3bae344c10ca22", + "route_weight_sha256": "aa450cb7ad58f89c1f3093fa4c3090181f50f01a0d6ae076b72b10f30b62b815", + "loads": [ + 1, + 0, + 2, + 0, + 0, + 0, + 4, + 4, + 1, + 8, + 1, + 4, + 2, + 1, + 0, + 0, + 0, + 6, + 1, + 3, + 0, + 0, + 4, + 0, + 0, + 4, + 2, + 1, + 4, + 5, + 1, + 1, + 4, + 4, + 1, + 3, + 4, + 5, + 1, + 1, + 2, + 3, + 2, + 0, + 0, + 0, + 9, + 0, + 4, + 7, + 1, + 0, + 1, + 0, + 4, + 3, + 9, + 3, + 0, + 2, + 1, + 0, + 2, + 2 + ], + "weighted_loads": [ + 0.05328376218676567, + 0.0, + 0.09917818754911423, + 0.0, + 0.0, + 0.0, + 0.2952189967036247, + 0.19002756848931313, + 0.03808817267417908, + 0.42853406071662903, + 0.04274217039346695, + 0.32575473934412, + 0.148624949157238, + 0.02906704880297184, + 0.0, + 0.0, + 0.0, + 0.5734962485730648, + 0.03308004140853882, + 0.3600066155195236, + 0.0, + 0.0, + 0.40488579496741295, + 0.0, + 0.0, + 0.3743624687194824, + 0.13627973943948746, + 0.05069484934210777, + 0.23489618115127087, + 0.170690244063735, + 0.05119941756129265, + 0.04388057067990303, + 0.39095211774110794, + 0.3210603669285774, + 0.030074816197156906, + 0.10867615230381489, + 0.28221000358462334, + 0.42319824174046516, + 0.023545272648334503, + 0.037277981638908386, + 0.11742154136300087, + 0.1250193826854229, + 0.10443438962101936, + 0.0, + 0.0, + 0.0, + 0.5820172857493162, + 0.0, + 0.1708096656948328, + 0.47836539149284363, + 0.05292379483580589, + 0.0, + 0.0392431877553463, + 0.0, + 0.3094068095088005, + 0.13047252967953682, + 0.8028495907783508, + 0.24542170763015747, + 0.0, + 0.08334055915474892, + 0.07590252161026001, + 0.0, + 0.4665798395872116, + 0.0732803326100111 + ], + "unique_experts": 45, + "load_cv": 1.0537936189730719, + "normalized_load_entropy": 0.8620323032500058, + "max_load_share": 0.06521739130434782 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "8ff2c6bf81a131f98cb4d447ac16371428ccd451e69838ab579128aa6f28183f", + "route_weight_sha256": "ccc19bda79de297785dd6924823bac266dfdc8c3d0eb5da5f3379a2761c99855", + "loads": [ + 4, + 23, + 13, + 1, + 0, + 1, + 10, + 4, + 3, + 9, + 24, + 7, + 10, + 1, + 0, + 0, + 0, + 14, + 3, + 4, + 3, + 7, + 4, + 5, + 0, + 4, + 3, + 2, + 6, + 9, + 3, + 4, + 9, + 5, + 4, + 3, + 4, + 11, + 11, + 6, + 9, + 3, + 3, + 1, + 9, + 14, + 12, + 0, + 4, + 8, + 13, + 0, + 8, + 6, + 16, + 4, + 11, + 9, + 0, + 3, + 5, + 1, + 7, + 4 + ], + "weighted_loads": [ + 0.3231430910527706, + 1.8092125905677676, + 0.7391897272318602, + 0.0717872902750969, + 0.0, + 0.038430385291576385, + 0.8436572812497616, + 0.19002756848931313, + 0.15136175230145454, + 0.4570283181965351, + 2.0260490477085114, + 0.9804381402209401, + 0.6507437005639076, + 0.02906704880297184, + 0.0, + 0.0, + 0.0, + 1.2213704958558083, + 0.12574470788240433, + 0.38437263667583466, + 0.25809165090322495, + 0.6457192189991474, + 0.40488579496741295, + 0.19667045027017593, + 0.0, + 0.3743624687194824, + 0.1693570762872696, + 0.10550932213664055, + 0.31220151111483574, + 0.32030236534774303, + 0.13738444820046425, + 0.5150994695723057, + 0.6222255527973175, + 0.36802545189857483, + 0.18617931008338928, + 0.10867615230381489, + 0.28221000358462334, + 0.6841871831566095, + 1.7135601788759232, + 0.48794378340244293, + 0.46356163173913956, + 0.1250193826854229, + 0.19046831503510475, + 0.030014201998710632, + 0.6582885831594467, + 1.2885913494974375, + 0.6688288734294474, + 0.0, + 0.1708096656948328, + 0.5222360156476498, + 0.7585482150316238, + 0.0, + 0.4787345970980823, + 0.4774506092071533, + 1.1563017605803907, + 0.1567306313663721, + 0.8843942452222109, + 0.5058395937085152, + 0.0, + 0.17263570055365562, + 0.32033319771289825, + 0.043069347739219666, + 0.9026417601853609, + 0.13560917414724827 + ], + "unique_experts": 56, + "load_cv": 0.8599903100229289, + "normalized_load_entropy": 0.9113824705133399, + "max_load_share": 0.0625 + } + }, + "s0_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "d64b3d01317201b357a92df4ab1322b0eb600e70c2229e591155cacf3e254101", + "route_weight_sha256": "0d00b30326c0639f56734486e99eb2c945562594f064013b21c65c89ebbe88c4", + "loads": [ + 1, + 0, + 3, + 0, + 0, + 0, + 4, + 3, + 1, + 7, + 1, + 4, + 2, + 0, + 0, + 0, + 0, + 7, + 1, + 3, + 1, + 1, + 3, + 0, + 0, + 4, + 2, + 1, + 3, + 4, + 1, + 1, + 4, + 4, + 1, + 3, + 4, + 6, + 1, + 0, + 2, + 2, + 2, + 0, + 1, + 0, + 9, + 0, + 3, + 7, + 1, + 0, + 1, + 0, + 4, + 3, + 9, + 4, + 0, + 2, + 1, + 0, + 3, + 3 + ], + "weighted_loads": [ + 0.05625203996896744, + 0.0, + 0.12463287264108658, + 0.0, + 0.0, + 0.0, + 0.28567225113511086, + 0.13915527611970901, + 0.03918570652604103, + 0.3471217639744282, + 0.0372081957757473, + 0.3365658074617386, + 0.16886860132217407, + 0.0, + 0.0, + 0.0, + 0.0, + 0.6272532865405083, + 0.034665558487176895, + 0.37719040364027023, + 0.026607206091284752, + 0.028644507750868797, + 0.36339543387293816, + 0.0, + 0.0, + 0.38584550470113754, + 0.1232757493853569, + 0.03941477835178375, + 0.18273993209004402, + 0.1330601405352354, + 0.04726216942071915, + 0.0442473329603672, + 0.4179196283221245, + 0.35325663164258003, + 0.02928520366549492, + 0.10663503408432007, + 0.3300372026860714, + 0.5012414082884789, + 0.02254546247422695, + 0.0, + 0.13711660355329514, + 0.09002389013767242, + 0.10845374688506126, + 0.0, + 0.028577188029885292, + 0.0, + 0.5985380709171295, + 0.0, + 0.16778282448649406, + 0.4850691370666027, + 0.05411284416913986, + 0.0, + 0.03761112317442894, + 0.0, + 0.3084561116993427, + 0.16902055218815804, + 0.8159806691110134, + 0.29591648653149605, + 0.0, + 0.08730820193886757, + 0.08091681450605392, + 0.0, + 0.4934186413884163, + 0.10103727132081985 + ], + "unique_experts": 46, + "load_cv": 1.0377256892720608, + "normalized_load_entropy": 0.8670345671742203, + "max_load_share": 0.06521739130434782 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "46ac00885d871ce94c7ee3c705b2a7cbf2020a67a5bbbc9c8cb31e11b89501e2", + "route_weight_sha256": "9ad29e8720376e11302299be7efce30fba7cbfacf3ee63cf45f2a2ed32090375", + "loads": [ + 2, + 17, + 10, + 1, + 0, + 0, + 11, + 4, + 1, + 7, + 12, + 7, + 6, + 0, + 0, + 0, + 0, + 11, + 2, + 3, + 1, + 1, + 3, + 3, + 0, + 4, + 2, + 1, + 4, + 7, + 3, + 2, + 5, + 5, + 3, + 4, + 5, + 6, + 11, + 2, + 8, + 3, + 2, + 2, + 6, + 8, + 11, + 0, + 3, + 10, + 11, + 0, + 7, + 0, + 14, + 3, + 9, + 8, + 0, + 2, + 3, + 0, + 7, + 5 + ], + "weighted_loads": [ + 0.116150613874197, + 1.209831672720611, + 0.6149801500141621, + 0.14756383001804352, + 0.0, + 0.0, + 0.7330294698476791, + 0.18759768083691597, + 0.03918570652604103, + 0.3471217639744282, + 1.1858125142753124, + 0.9701986014842987, + 0.5215436592698097, + 0.0, + 0.0, + 0.0, + 0.0, + 0.7580305486917496, + 0.07652484998106956, + 0.37719040364027023, + 0.026607206091284752, + 0.028644507750868797, + 0.36339543387293816, + 0.12052246369421482, + 0.0, + 0.38584550470113754, + 0.1232757493853569, + 0.03941477835178375, + 0.22476514801383018, + 0.24895036406815052, + 0.3217363879084587, + 0.13031603023409843, + 0.4703768156468868, + 0.41630324348807335, + 0.14237255230545998, + 0.14753296226263046, + 0.3905395083129406, + 0.5012414082884789, + 0.5775829721242189, + 0.4208241403102875, + 0.391373448073864, + 0.13931692019104958, + 0.10845374688506126, + 0.06411116197705269, + 0.3717357534915209, + 0.7523280791938305, + 0.6859303638339043, + 0.0, + 0.16778282448649406, + 0.5999153703451157, + 0.6646705530583858, + 0.0, + 0.38143809139728546, + 0.0, + 0.8298430345021188, + 0.16902055218815804, + 0.8159806691110134, + 0.4611631706357002, + 0.0, + 0.08730820193886757, + 0.17235179990530014, + 0.0, + 0.8663649633526802, + 0.18800944834947586 + ], + "unique_experts": 52, + "load_cv": 0.898386757155346, + "normalized_load_entropy": 0.8957598903696037, + "max_load_share": 0.059027777777777776 + } + }, + "s1_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "3724f02221d05bdaf378860606dd8fdf1834f59463bf113b32b864303625eaea", + "route_weight_sha256": "5a3634ec6c5d2964bb451f4af2fe122d3b93986e6acd026602d01b26477ba7b4", + "loads": [ + 1, + 0, + 2, + 0, + 0, + 0, + 4, + 4, + 1, + 8, + 2, + 4, + 2, + 1, + 0, + 0, + 0, + 7, + 1, + 3, + 1, + 0, + 4, + 0, + 0, + 4, + 2, + 1, + 3, + 4, + 1, + 1, + 4, + 4, + 1, + 3, + 4, + 5, + 1, + 1, + 2, + 2, + 1, + 0, + 0, + 0, + 10, + 0, + 3, + 7, + 1, + 0, + 1, + 0, + 4, + 3, + 9, + 4, + 0, + 2, + 1, + 0, + 2, + 2 + ], + "weighted_loads": [ + 0.052661966532468796, + 0.0, + 0.1008710116147995, + 0.0, + 0.0, + 0.0, + 0.2896995507180691, + 0.16950079426169395, + 0.040155813097953796, + 0.3691001832485199, + 0.07043582014739513, + 0.333211250603199, + 0.16561484336853027, + 0.028522668406367302, + 0.0, + 0.0, + 0.0, + 0.609655138105154, + 0.03267999738454819, + 0.38063014298677444, + 0.02740159071981907, + 0.0, + 0.4009396266192198, + 0.0, + 0.0, + 0.37477994337677956, + 0.1367882527410984, + 0.044484347105026245, + 0.19357706978917122, + 0.13432379439473152, + 0.048423781991004944, + 0.043569184839725494, + 0.3984140567481518, + 0.3311220034956932, + 0.028561823070049286, + 0.11287650838494301, + 0.3087274394929409, + 0.4674026556313038, + 0.026943389326334, + 0.03650080785155296, + 0.1321895606815815, + 0.09058557078242302, + 0.07402041554450989, + 0.0, + 0.0, + 0.0, + 0.601835461333394, + 0.0, + 0.16096176207065582, + 0.4913316071033478, + 0.0521855354309082, + 0.0, + 0.03573323413729668, + 0.0, + 0.29834606498479843, + 0.16187867894768715, + 0.7830416820943356, + 0.2867661416530609, + 0.0, + 0.08732127398252487, + 0.07427630573511124, + 0.0, + 0.44728878140449524, + 0.07354292459785938 + ], + "unique_experts": 46, + "load_cv": 1.072757499924467, + "normalized_load_entropy": 0.862971886690184, + "max_load_share": 0.07246376811594203 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "1295e527c4a82c80e53dc426372aff9df8b3d82e1e997d5b37fef8a9c53e918f", + "route_weight_sha256": "4915102d813909108cf8e6b19dc04b51c1957aef560b5935755a79f33bc91792", + "loads": [ + 4, + 23, + 13, + 0, + 0, + 1, + 10, + 4, + 4, + 9, + 25, + 6, + 10, + 2, + 0, + 0, + 0, + 15, + 3, + 4, + 4, + 7, + 4, + 5, + 0, + 4, + 3, + 1, + 5, + 7, + 2, + 4, + 10, + 5, + 4, + 4, + 4, + 11, + 10, + 5, + 9, + 2, + 2, + 2, + 9, + 13, + 12, + 0, + 4, + 10, + 13, + 0, + 7, + 6, + 15, + 4, + 11, + 10, + 0, + 3, + 5, + 1, + 7, + 7 + ], + "weighted_loads": [ + 0.2963489070534706, + 1.753691821359098, + 0.8118921685963869, + 0.0, + 0.0, + 0.038430385291576385, + 0.8381378352642059, + 0.16950079426169395, + 0.20408053323626518, + 0.397594440728426, + 2.212660489603877, + 0.9791700467467308, + 0.7224278710782528, + 0.07931370474398136, + 0.0, + 0.0, + 0.0, + 1.2575293853878975, + 0.12462170794606209, + 0.4049961641430855, + 0.285493241623044, + 0.6457192189991474, + 0.4009396266192198, + 0.19667045027017593, + 0.0, + 0.37477994337677956, + 0.16986558958888054, + 0.044484347105026245, + 0.2708823997527361, + 0.23635638132691383, + 0.09864263981580734, + 0.5147880837321281, + 0.6811198368668556, + 0.3780870884656906, + 0.20720358192920685, + 0.15325669199228287, + 0.3087274394929409, + 0.7332060877233744, + 0.8156304471194744, + 0.4739351384341717, + 0.4783296510577202, + 0.09058557078242302, + 0.16005434095859528, + 0.06727778539061546, + 0.6480987146496773, + 1.1856605149805546, + 0.6905242521315813, + 0.0, + 0.21389617398381233, + 0.6247912310063839, + 0.7578099556267262, + 0.0, + 0.47103070840239525, + 0.4774506092071533, + 1.0551865040324628, + 0.18813678063452244, + 0.8820103574544191, + 0.5649576634168625, + 0.0, + 0.17661641538143158, + 0.2976495623588562, + 0.043069347739219666, + 0.8833507020026445, + 0.3023259434849024 + ], + "unique_experts": 55, + "load_cv": 0.8680277773333192, + "normalized_load_entropy": 0.9094370052765987, + "max_load_share": 0.06510416666666667 + } + }, + "s0_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "514981f765410dae68ce3d10ba945eebdd898308ed23d6588001bc4ebd1fec56", + "route_weight_sha256": "2abf729a7e685735956ee8ec944de01c06ebcd45ce957ca75f30fa0632f7a1be", + "loads": [ + 1, + 0, + 3, + 0, + 0, + 0, + 4, + 3, + 1, + 7, + 2, + 6, + 2, + 1, + 0, + 0, + 0, + 6, + 1, + 3, + 0, + 0, + 3, + 0, + 0, + 4, + 2, + 1, + 3, + 4, + 2, + 1, + 4, + 4, + 2, + 2, + 4, + 6, + 1, + 1, + 2, + 2, + 2, + 0, + 0, + 0, + 9, + 0, + 3, + 8, + 1, + 0, + 1, + 0, + 4, + 3, + 9, + 4, + 0, + 2, + 1, + 0, + 2, + 1 + ], + "weighted_loads": [ + 0.05398688465356827, + 0.0, + 0.10925178043544292, + 0.0, + 0.0, + 0.0, + 0.27073390409350395, + 0.10901244357228279, + 0.0404803566634655, + 0.38424403592944145, + 0.07548712939023972, + 0.41134065575897694, + 0.1528361365199089, + 0.031135182827711105, + 0.0, + 0.0, + 0.0, + 0.588874951004982, + 0.030513400211930275, + 0.33524636551737785, + 0.0, + 0.0, + 0.3652956597507, + 0.0, + 0.0, + 0.41359980776906013, + 0.10952529311180115, + 0.04235339164733887, + 0.17310235649347305, + 0.11662185750901699, + 0.08022109791636467, + 0.04819204658269882, + 0.3806967083364725, + 0.3623497933149338, + 0.07248901948332787, + 0.0738477073609829, + 0.2981259822845459, + 0.45226304419338703, + 0.02329012006521225, + 0.028782624751329422, + 0.13752738758921623, + 0.08736009523272514, + 0.10656602680683136, + 0.0, + 0.0, + 0.0, + 0.5953268595039845, + 0.0, + 0.18129196017980576, + 0.5158237405121326, + 0.05126010999083519, + 0.0, + 0.04392295330762863, + 0.0, + 0.2955334633588791, + 0.15504775941371918, + 0.7960148900747299, + 0.29789651185274124, + 0.0, + 0.08488181233406067, + 0.08647777140140533, + 0.0, + 0.4726669490337372, + 0.037847988307476044 + ], + "unique_experts": 45, + "load_cv": 1.0569778940124537, + "normalized_load_entropy": 0.8628655833658183, + "max_load_share": 0.06521739130434782 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "3bfc52c86c38cb6b67b2d218059d03c3dadb49d1d154ca1ca0efcc644ab3a469", + "route_weight_sha256": "35ede2da2a03d14f3ee7046ff8ddfd97bbb881fda3c7df4ce3f45158199131f4", + "loads": [ + 3, + 19, + 9, + 1, + 0, + 0, + 13, + 3, + 1, + 7, + 13, + 8, + 5, + 1, + 0, + 0, + 0, + 10, + 2, + 3, + 0, + 0, + 3, + 3, + 0, + 4, + 2, + 1, + 4, + 7, + 3, + 3, + 5, + 5, + 3, + 3, + 5, + 6, + 12, + 3, + 9, + 2, + 2, + 1, + 4, + 8, + 12, + 0, + 4, + 9, + 11, + 0, + 8, + 0, + 14, + 3, + 9, + 8, + 0, + 2, + 2, + 0, + 7, + 3 + ], + "weighted_loads": [ + 0.1535765901207924, + 1.37457041349262, + 0.47105148434638977, + 0.03524397686123848, + 0.0, + 0.0, + 0.8799676708877087, + 0.10901244357228279, + 0.0404803566634655, + 0.38424403592944145, + 1.2064069099724293, + 1.0074787568300962, + 0.4538711793720722, + 0.031135182827711105, + 0.0, + 0.0, + 0.0, + 0.7196522131562233, + 0.06819348968565464, + 0.33524636551737785, + 0.0, + 0.0, + 0.3652956597507, + 0.12052246369421482, + 0.0, + 0.41359980776906013, + 0.10952529311180115, + 0.04235339164733887, + 0.21512757241725922, + 0.2251327559351921, + 0.12757740169763565, + 0.2309318333864212, + 0.43315389566123486, + 0.4253964051604271, + 0.11524668335914612, + 0.11003617569804192, + 0.36208799481391907, + 0.45226304419338703, + 0.6930284164845943, + 0.4295271672308445, + 0.44012385979294777, + 0.08736009523272514, + 0.10656602680683136, + 0.032854460179805756, + 0.32922807708382607, + 0.7300357148051262, + 0.7364796437323093, + 0.0, + 0.22162212431430817, + 0.5832615830004215, + 0.6618178188800812, + 0.0, + 0.5014321841299534, + 0.0, + 0.8461189209483564, + 0.15504775941371918, + 0.7960148900747299, + 0.46344064734876156, + 0.0, + 0.08488181233406067, + 0.14056621491909027, + 0.0, + 0.8832635469734669, + 0.1250111572444439 + ], + "unique_experts": 51, + "load_cv": 0.950957931590205, + "normalized_load_entropy": 0.8873394137529644, + "max_load_share": 0.06597222222222222 + } + }, + "s1_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "18b28d6e88aea0cc92be9606f35748c35bcfea3a53fed5a877f53ce1eb59fb60", + "route_weight_sha256": "4aaedd9f0c27e02957ee3881896123636e23203e889f2558cc44c34849e7185f", + "loads": [ + 1, + 0, + 1, + 0, + 0, + 0, + 4, + 4, + 1, + 6, + 2, + 6, + 2, + 1, + 0, + 0, + 0, + 7, + 1, + 3, + 0, + 0, + 4, + 0, + 0, + 4, + 2, + 1, + 4, + 6, + 2, + 1, + 4, + 4, + 1, + 2, + 4, + 5, + 1, + 1, + 2, + 2, + 1, + 0, + 0, + 0, + 9, + 0, + 2, + 7, + 1, + 0, + 1, + 0, + 4, + 3, + 9, + 4, + 0, + 2, + 1, + 0, + 2, + 3 + ], + "weighted_loads": [ + 0.05824154242873192, + 0.0, + 0.03269684687256813, + 0.0, + 0.0, + 0.0, + 0.2648964710533619, + 0.18001341074705124, + 0.03800389543175697, + 0.29959364980459213, + 0.08479522913694382, + 0.39341543428599834, + 0.1467452570796013, + 0.032724201679229736, + 0.0, + 0.0, + 0.0, + 0.5912769977003336, + 0.028986752033233643, + 0.31684210151433945, + 0.0, + 0.0, + 0.41148882173001766, + 0.0, + 0.0, + 0.40079111233353615, + 0.1142868660390377, + 0.039767201989889145, + 0.22649545595049858, + 0.18497410602867603, + 0.08049319311976433, + 0.045443058013916016, + 0.37119434401392937, + 0.3782051131129265, + 0.027865402400493622, + 0.07018085941672325, + 0.2723755743354559, + 0.43066174536943436, + 0.023164911195635796, + 0.031737931072711945, + 0.13860537484288216, + 0.08718925714492798, + 0.07239416986703873, + 0.0, + 0.0, + 0.0, + 0.59157176874578, + 0.0, + 0.1175546795129776, + 0.4802911765873432, + 0.04971366003155708, + 0.0, + 0.047149743884801865, + 0.0, + 0.2577783465385437, + 0.12748003378510475, + 0.7954548709094524, + 0.2821726016700268, + 0.0, + 0.08575859665870667, + 0.0731048732995987, + 0.0, + 0.48386040329933167, + 0.11431467533111572 + ], + "unique_experts": 45, + "load_cv": 1.06331783701595, + "normalized_load_entropy": 0.8601583672786368, + "max_load_share": 0.06521739130434782 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "b52039fa1c437bb22f9d87f240c083fabc20f1629584d7831ad3970eae913dc5", + "route_weight_sha256": "3d957c7335be3eead748fc7713722b9e62908271aba51810c4d21494968534b3", + "loads": [ + 3, + 24, + 11, + 0, + 0, + 1, + 12, + 4, + 3, + 7, + 25, + 9, + 8, + 2, + 0, + 0, + 0, + 16, + 3, + 4, + 3, + 8, + 4, + 6, + 0, + 4, + 3, + 1, + 6, + 8, + 3, + 5, + 9, + 5, + 3, + 2, + 4, + 10, + 11, + 5, + 9, + 2, + 2, + 1, + 11, + 13, + 11, + 0, + 2, + 9, + 15, + 0, + 9, + 6, + 16, + 4, + 10, + 11, + 0, + 3, + 4, + 1, + 7, + 6 + ], + "weighted_loads": [ + 0.2557053528726101, + 1.8752986742183566, + 0.5684978067874908, + 0.0, + 0.0, + 0.038430385291576385, + 1.0037082806229591, + 0.18001341074705124, + 0.15127747505903244, + 0.3280879072844982, + 2.075981479138136, + 1.088294392451644, + 0.5307642184197903, + 0.10107679665088654, + 0.0, + 0.0, + 0.0, + 1.288302531465888, + 0.12124928832054138, + 0.3412081226706505, + 0.25809165090322495, + 0.6915133036673069, + 0.41148882173001766, + 0.23537766188383102, + 0.0, + 0.40079111233353615, + 0.14736420288681984, + 0.039767201989889145, + 0.30380078591406345, + 0.25414049439132214, + 0.11752608045935631, + 0.6196136325597763, + 0.6024677790701389, + 0.4251701980829239, + 0.13496983796358109, + 0.07018085941672325, + 0.2723755743354559, + 0.6426874045282602, + 0.8735455144196749, + 0.4663212075829506, + 0.48474546521902084, + 0.08718925714492798, + 0.15842809528112411, + 0.030014201998710632, + 0.7051611691713333, + 1.1835184544324875, + 0.748512776568532, + 0.0, + 0.1175546795129776, + 0.5710160955786705, + 0.8955297023057938, + 0.0, + 0.6355058439075947, + 0.4774506092071533, + 1.1088849022053182, + 0.15373813547194004, + 0.8245261032134295, + 0.5964850895106792, + 0.0, + 0.17505373805761337, + 0.25321708619594574, + 0.043069347739219666, + 0.919922323897481, + 0.30567264556884766 + ], + "unique_experts": 55, + "load_cv": 0.9018692009130568, + "normalized_load_entropy": 0.9032975060252593, + "max_load_share": 0.06510416666666667 + } + }, + "s0_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "63185c9f3fec222012697a548ab3de8c5a63e1f42a4684142c2aef67da95b61d", + "route_weight_sha256": "28a08a387c724d07914d721112a3fcf63d46700f41d4a89295fbe312d2e1e356", + "loads": [ + 1, + 0, + 3, + 0, + 0, + 0, + 4, + 4, + 1, + 7, + 2, + 4, + 2, + 1, + 0, + 0, + 0, + 6, + 1, + 3, + 0, + 0, + 4, + 0, + 0, + 4, + 2, + 1, + 3, + 4, + 1, + 1, + 4, + 4, + 2, + 3, + 4, + 5, + 1, + 1, + 2, + 2, + 2, + 0, + 0, + 0, + 9, + 0, + 3, + 8, + 1, + 0, + 1, + 0, + 4, + 3, + 9, + 4, + 0, + 2, + 1, + 0, + 3, + 1 + ], + "weighted_loads": [ + 0.05656467378139496, + 0.0, + 0.1074677798897028, + 0.0, + 0.0, + 0.0, + 0.3013906963169575, + 0.1642130147665739, + 0.040988318622112274, + 0.4104323647916317, + 0.08170201256871223, + 0.33350151032209396, + 0.1660107895731926, + 0.030108902603387833, + 0.0, + 0.0, + 0.0, + 0.5948354452848434, + 0.029139390215277672, + 0.3533788248896599, + 0.0, + 0.0, + 0.3922167643904686, + 0.0, + 0.0, + 0.40382347255945206, + 0.12044916674494743, + 0.04254794865846634, + 0.18696869909763336, + 0.13079257495701313, + 0.048386070877313614, + 0.04683208465576172, + 0.3900316134095192, + 0.3442709445953369, + 0.05505181849002838, + 0.10162106901407242, + 0.31889819353818893, + 0.42214278131723404, + 0.022337360307574272, + 0.031246928498148918, + 0.14128581061959267, + 0.08898043259978294, + 0.111226387321949, + 0.0, + 0.0, + 0.0, + 0.5994088761508465, + 0.0, + 0.1560768149793148, + 0.5154985822737217, + 0.05272005498409271, + 0.0, + 0.044995687901973724, + 0.0, + 0.27967776358127594, + 0.16991187632083893, + 0.8104229457676411, + 0.29871807992458344, + 0.0, + 0.08713259547948837, + 0.07769593596458435, + 0.0, + 0.49946976639330387, + 0.04193469136953354 + ], + "unique_experts": 45, + "load_cv": 1.0409591169771326, + "normalized_load_entropy": 0.8645683726583508, + "max_load_share": 0.06521739130434782 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "790ebddfd6a721170f2bb2a9c07f96df69dce90861f6461ea7b95e117a9f8ed9", + "route_weight_sha256": "f1488a2a36f5e30a82965ddbb94d05490a9d3e8e294544c71ee8588b1617caa6", + "loads": [ + 3, + 19, + 9, + 0, + 0, + 0, + 11, + 4, + 1, + 7, + 13, + 6, + 6, + 2, + 0, + 1, + 0, + 10, + 3, + 3, + 0, + 0, + 4, + 3, + 0, + 4, + 2, + 1, + 4, + 7, + 2, + 2, + 5, + 5, + 4, + 4, + 5, + 5, + 11, + 3, + 8, + 2, + 2, + 1, + 4, + 9, + 11, + 0, + 4, + 9, + 11, + 0, + 8, + 0, + 14, + 3, + 9, + 8, + 0, + 2, + 3, + 0, + 7, + 4 + ], + "weighted_loads": [ + 0.16173118352890015, + 1.4091013027355075, + 0.48838386312127113, + 0.0, + 0.0, + 0.0, + 0.7755460813641548, + 0.1642130147665739, + 0.040988318622112274, + 0.4104323647916317, + 1.1974424496293068, + 0.9296396113932133, + 0.5106161348521709, + 0.06871064752340317, + 0.0, + 0.04690041393041611, + 0.0, + 0.7256127074360847, + 0.11449581943452358, + 0.3533788248896599, + 0.0, + 0.0, + 0.3922167643904686, + 0.12052246369421482, + 0.0, + 0.40382347255945206, + 0.12044916674494743, + 0.04254794865846634, + 0.22899391502141953, + 0.2362500187009573, + 0.09422723948955536, + 0.13290078192949295, + 0.44248880073428154, + 0.40731755644083023, + 0.13820743188261986, + 0.1412082202732563, + 0.3941042721271515, + 0.42214278131723404, + 0.5773748699575663, + 0.48821854405105114, + 0.3955426551401615, + 0.08898043259978294, + 0.111226387321949, + 0.032854460179805756, + 0.3102150224149227, + 0.8499097675085068, + 0.6868011690676212, + 0.0, + 0.1980670765042305, + 0.5819857008755207, + 0.6632777638733387, + 0.0, + 0.425283458083868, + 0.0, + 0.8054679832421243, + 0.16991187632083893, + 0.8104229457676411, + 0.4554487578570843, + 0.0, + 0.08713259547948837, + 0.17313407734036446, + 0.0, + 0.8724160883575678, + 0.3024166151881218 + ], + "unique_experts": 51, + "load_cv": 0.9162456945817024, + "normalized_load_entropy": 0.893270105561183, + "max_load_share": 0.06597222222222222 + } + }, + "s1_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "51d3bcb7db8493e79b3f33aef8263ad3028903289fcf7c2c33f6275d6c7d9b0c", + "route_weight_sha256": "1761c087401431a5012aeb4cdd6c12913bbba55610e90e0611bb2f318f8406a9", + "loads": [ + 1, + 0, + 1, + 0, + 0, + 0, + 5, + 4, + 1, + 6, + 2, + 6, + 2, + 1, + 0, + 0, + 0, + 8, + 1, + 3, + 0, + 0, + 4, + 0, + 0, + 4, + 1, + 1, + 4, + 4, + 2, + 1, + 4, + 4, + 1, + 2, + 4, + 5, + 1, + 1, + 2, + 2, + 1, + 0, + 0, + 0, + 9, + 0, + 2, + 7, + 1, + 0, + 1, + 0, + 4, + 3, + 9, + 4, + 0, + 2, + 1, + 0, + 2, + 4 + ], + "weighted_loads": [ + 0.06201609596610069, + 0.0, + 0.03441273793578148, + 0.0, + 0.0, + 0.0, + 0.3099955879151821, + 0.18572016805410385, + 0.03601045534014702, + 0.32180697098374367, + 0.0856616422533989, + 0.4193146154284477, + 0.1553957387804985, + 0.032669153064489365, + 0.0, + 0.0, + 0.0, + 0.6362284012138844, + 0.02907821163535118, + 0.32832159847021103, + 0.0, + 0.0, + 0.409083716571331, + 0.0, + 0.0, + 0.39259563758969307, + 0.07169996201992035, + 0.04112205281853676, + 0.2307165488600731, + 0.12004052475094795, + 0.07395089417695999, + 0.04383496940135956, + 0.356915008276701, + 0.3904038853943348, + 0.02775680646300316, + 0.06835367530584335, + 0.2638307586312294, + 0.4335990287363529, + 0.022728795185685158, + 0.03455145284533501, + 0.13981890678405762, + 0.09162496030330658, + 0.07014486938714981, + 0.0, + 0.0, + 0.0, + 0.5567492470145226, + 0.0, + 0.12208947911858559, + 0.4730307534337044, + 0.048418715596199036, + 0.0, + 0.04665926471352577, + 0.0, + 0.23791907727718353, + 0.12037266418337822, + 0.7811764590442181, + 0.2733384259045124, + 0.0, + 0.08574783056974411, + 0.07382771372795105, + 0.0, + 0.47056376934051514, + 0.14093680307269096 + ], + "unique_experts": 45, + "load_cv": 1.0758856494473892, + "normalized_load_entropy": 0.8581130852574494, + "max_load_share": 0.06521739130434782 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "6142658492e3c7c6c38b16e9a2a4d7660b8ec0a51510a1db079f2a4912947619", + "route_weight_sha256": "82f03f81932029164d2698da8f5255fc74287a9de7aa8f87e9a3f31fd2206f0f", + "loads": [ + 4, + 25, + 10, + 1, + 0, + 1, + 11, + 4, + 3, + 7, + 25, + 8, + 9, + 2, + 0, + 1, + 0, + 16, + 4, + 4, + 3, + 7, + 4, + 5, + 0, + 4, + 2, + 1, + 6, + 7, + 3, + 4, + 9, + 5, + 4, + 2, + 4, + 11, + 10, + 5, + 9, + 2, + 2, + 1, + 10, + 15, + 11, + 0, + 2, + 9, + 13, + 0, + 8, + 6, + 16, + 4, + 11, + 10, + 0, + 3, + 5, + 1, + 7, + 8 + ], + "weighted_loads": [ + 0.3198881484568119, + 1.9691041698679328, + 0.5488964971154928, + 0.04824350029230118, + 0.0, + 0.038430385291576385, + 0.858433872461319, + 0.18572016805410385, + 0.14928403496742249, + 0.35030122846364975, + 2.0986615233123302, + 1.0652734115719795, + 0.5752986408770084, + 0.09919760003685951, + 0.0, + 0.044144559651613235, + 0.0, + 1.2841026484966278, + 0.15369967371225357, + 0.35268761962652206, + 0.25809165090322495, + 0.6457192189991474, + 0.409083716571331, + 0.19667045027017593, + 0.0, + 0.39259563758969307, + 0.10477729886770248, + 0.04112205281853676, + 0.30802187882363796, + 0.24554037675261497, + 0.10800744965672493, + 0.5150538682937622, + 0.5881884433329105, + 0.4373689703643322, + 0.1787578985095024, + 0.06835367530584335, + 0.2638307586312294, + 0.669879324734211, + 0.8114158529788256, + 0.49139827862381935, + 0.4859589971601963, + 0.09162496030330658, + 0.1561787948012352, + 0.030014201998710632, + 0.6884297877550125, + 1.27142976783216, + 0.6904537789523602, + 0.0, + 0.12208947911858559, + 0.5508744269609451, + 0.754043135792017, + 0.0, + 0.5396866202354431, + 0.4774506092071533, + 1.0412064171396196, + 0.1466307658702135, + 0.8711003344506025, + 0.5563374795019627, + 0.0, + 0.17504297196865082, + 0.3001542240381241, + 0.043069347739219666, + 0.9066256899386644, + 0.5105903074145317 + ], + "unique_experts": 57, + "load_cv": 0.8951062941225348, + "normalized_load_entropy": 0.9077390194088971, + "max_load_share": 0.06510416666666667 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "ordered_topk_exact_tokens": 17, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.9254658385093169, + "mean_token_weighted_tv": 0.016976153639995533, + "aggregate_load_tv": 0.04347826086956522 + }, + "system_bos": { + "tokens": 23, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.9161490683229815, + "mean_token_weighted_tv": 0.019070680415176827, + "aggregate_load_tv": 0.05072463768115942 + }, + "system_x": { + "tokens": 23, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.8913043478260871, + "mean_token_weighted_tv": 0.027886730375821175, + "aggregate_load_tv": 0.057971014492753624 + }, + "system_period": { + "tokens": 23, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 11, + "mean_set_jaccard": 0.8322981366459627, + "mean_token_weighted_tv": 0.03847994477204655, + "aggregate_load_tv": 0.07246376811594203 + }, + "bos_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8788819875776398, + "mean_token_weighted_tv": 0.026618663383566814, + "aggregate_load_tv": 0.06521739130434782 + }, + "bos_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.9409937888198757, + "mean_token_weighted_tv": 0.020172720248608486, + "aggregate_load_tv": 0.03623188405797102 + }, + "x_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 12, + "mean_set_jaccard": 0.8633540372670809, + "mean_token_weighted_tv": 0.03308262696246738, + "aggregate_load_tv": 0.06521739130434782 + }, + "x_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.89648033126294, + "mean_token_weighted_tv": 0.031248707810173863, + "aggregate_load_tv": 0.05797101449275363 + }, + "period_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8788819875776398, + "mean_token_weighted_tv": 0.027793724575768345, + "aggregate_load_tv": 0.057971014492753624 + }, + "period_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.8840579710144929, + "mean_token_weighted_tv": 0.03648788522443046, + "aggregate_load_tv": 0.07246376811594203 + } + } + }, + "layer_26": { + "layer": 26, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "036fb1811de9dfb4dcf968fcb1ff7728e6ab0a0b8a685a619df5437170810f6b", + "route_weight_sha256": "f52a6fe2a02428867d158795ed1f6555deb1064fd781df607524e79a15d18f31", + "loads": [ + 0, + 0, + 2, + 6, + 3, + 0, + 0, + 4, + 4, + 7, + 3, + 0, + 0, + 6, + 5, + 1, + 2, + 2, + 0, + 1, + 1, + 1, + 0, + 0, + 2, + 3, + 0, + 1, + 1, + 1, + 3, + 2, + 1, + 0, + 2, + 5, + 5, + 1, + 3, + 0, + 4, + 0, + 0, + 0, + 11, + 8, + 2, + 2, + 1, + 1, + 2, + 0, + 0, + 0, + 2, + 0, + 9, + 0, + 4, + 3, + 0, + 4, + 7, + 0 + ], + "weighted_loads": [ + 0.0, + 0.0, + 0.11781198531389236, + 0.41958360001444817, + 0.15505913272500038, + 0.0, + 0.0, + 0.22163014858961105, + 0.3325033336877823, + 0.6091941371560097, + 0.18641360104084015, + 0.0, + 0.0, + 0.9065579771995544, + 0.36830486729741096, + 0.0878475084900856, + 0.13615598902106285, + 0.25784406810998917, + 0.0, + 0.036568429321050644, + 0.061254747211933136, + 0.06033254414796829, + 0.0, + 0.0, + 0.09270977601408958, + 0.20404816046357155, + 0.0, + 0.07054387778043747, + 0.036175262182950974, + 0.03489299491047859, + 0.14137794077396393, + 0.14766821265220642, + 0.040706370025873184, + 0.0, + 0.10942195355892181, + 0.32802674174308777, + 0.3157366141676903, + 0.03334738314151764, + 0.23008719831705093, + 0.0, + 0.24748720601201057, + 0.0, + 0.0, + 0.0, + 1.003138568252325, + 0.7169914580881596, + 0.13574715331196785, + 0.1284448765218258, + 0.04741247743368149, + 0.2008155733346939, + 0.07958009093999863, + 0.0, + 0.0, + 0.0, + 0.10144893452525139, + 0.0, + 0.7284379675984383, + 0.0, + 0.2327717561274767, + 0.1856836900115013, + 0.0, + 0.4277048073709011, + 0.5378427878022194, + 0.0 + ], + "unique_experts": 42, + "load_cv": 1.1571535813529936, + "normalized_load_entropy": 0.8414402619126145, + "max_load_share": 0.07971014492753623 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "4ec06582877b6e6057170763a2ccac0ac1bec66127aa0733a223de0a736ec621", + "route_weight_sha256": "6c96e98eb2991b7fe7bb59b180524d42ad5f33d9cdcc6e9cf7514e781ba20b4d", + "loads": [ + 0, + 1, + 2, + 8, + 3, + 0, + 1, + 5, + 4, + 10, + 7, + 5, + 1, + 7, + 20, + 3, + 2, + 14, + 0, + 2, + 1, + 2, + 0, + 0, + 6, + 3, + 6, + 8, + 1, + 1, + 10, + 2, + 4, + 1, + 6, + 5, + 11, + 1, + 3, + 0, + 4, + 1, + 1, + 4, + 13, + 8, + 6, + 2, + 2, + 2, + 11, + 1, + 3, + 0, + 3, + 0, + 24, + 8, + 10, + 4, + 1, + 4, + 8, + 2 + ], + "weighted_loads": [ + 0.0, + 0.04918302595615387, + 0.11781198531389236, + 0.5135890319943428, + 0.15505913272500038, + 0.0, + 0.035588156431913376, + 0.25589071959257126, + 0.3325033336877823, + 0.7945416159927845, + 0.6297670416533947, + 0.3139609273057431, + 0.20421215891838074, + 0.9639458619058132, + 1.0744426330784336, + 0.1849154718220234, + 0.13615598902106285, + 0.9327899012714624, + 0.0, + 0.08319544047117233, + 0.061254747211933136, + 0.09141439571976662, + 0.0, + 0.0, + 0.3066141828894615, + 0.20404816046357155, + 0.8077644668519497, + 0.3499761428683996, + 0.036175262182950974, + 0.03489299491047859, + 0.9398474618792534, + 0.14766821265220642, + 0.16748493537306786, + 0.03056168369948864, + 0.4830688461661339, + 0.32802674174308777, + 0.6059201899915934, + 0.03334738314151764, + 0.23008719831705093, + 0.0, + 0.24748720601201057, + 0.04722775146365166, + 0.03530311957001686, + 0.1964203268289566, + 1.0836963206529617, + 0.7169914580881596, + 0.354466263204813, + 0.1284448765218258, + 0.08921640738844872, + 1.1869949847459793, + 0.4858209006488323, + 0.08002369105815887, + 0.35836804658174515, + 0.0, + 0.14809680357575417, + 0.0, + 1.83746144361794, + 0.40468821534886956, + 0.4750314000993967, + 0.23367581143975258, + 0.0008212571265175939, + 0.4277048073709011, + 0.5784031115472317, + 0.416331198066473 + ], + "unique_experts": 56, + "load_cv": 1.0474837574980447, + "normalized_load_entropy": 0.8845986107850948, + "max_load_share": 0.08333333333333333 + } + }, + "s1_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "199ba42f4157b439c6b281fbf21f5710f8a61bb364de921a0d125ece1e4ce67e", + "route_weight_sha256": "40d31838313374f4bb8e751515e488577735caae1e5b504e8c460271a8ead4bf", + "loads": [ + 0, + 0, + 2, + 6, + 3, + 0, + 0, + 4, + 4, + 7, + 3, + 0, + 0, + 6, + 5, + 1, + 2, + 2, + 0, + 1, + 1, + 1, + 0, + 0, + 2, + 3, + 0, + 1, + 1, + 1, + 3, + 2, + 1, + 0, + 2, + 6, + 5, + 1, + 3, + 0, + 4, + 0, + 0, + 0, + 11, + 8, + 2, + 1, + 1, + 1, + 2, + 0, + 0, + 0, + 2, + 0, + 8, + 0, + 4, + 4, + 0, + 4, + 7, + 0 + ], + "weighted_loads": [ + 0.0, + 0.0, + 0.11778424307703972, + 0.41345902904868126, + 0.1497744843363762, + 0.0, + 0.0, + 0.23698321357369423, + 0.3450487554073334, + 0.6217797473073006, + 0.17337962612509727, + 0.0, + 0.0, + 0.9093940779566765, + 0.3791903518140316, + 0.08638931065797806, + 0.13755062967538834, + 0.2371152862906456, + 0.0, + 0.03610213100910187, + 0.06294728070497513, + 0.058814626187086105, + 0.0, + 0.0, + 0.0891561284661293, + 0.17408952489495277, + 0.0, + 0.07450852543115616, + 0.033726125955581665, + 0.036222632974386215, + 0.1433739773929119, + 0.142011396586895, + 0.04461650177836418, + 0.0, + 0.10236486420035362, + 0.3948129042983055, + 0.3009058013558388, + 0.0315336138010025, + 0.23315341025590897, + 0.0, + 0.23746463283896446, + 0.0, + 0.0, + 0.0, + 1.0120477341115475, + 0.7226803675293922, + 0.13210001960396767, + 0.09442157298326492, + 0.048120561987161636, + 0.21041887998580933, + 0.0653570182621479, + 0.0, + 0.0, + 0.0, + 0.10428134724497795, + 0.0, + 0.7293831408023834, + 0.0, + 0.23062347434461117, + 0.21113986894488335, + 0.0, + 0.4193061962723732, + 0.5289916787296534, + 0.0 + ], + "unique_experts": 42, + "load_cv": 1.1542456990586627, + "normalized_load_entropy": 0.840696394745047, + "max_load_share": 0.07971014492753623 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "5e65e2cc6216eb3669ec7b60e75dc379d876af62df7e36d139a290278540d53e", + "route_weight_sha256": "c42afd0f38cccbd31135a2f03c70628ee6f57db4edd1023edead5ee803f7d5b9", + "loads": [ + 1, + 1, + 2, + 8, + 6, + 0, + 0, + 5, + 4, + 13, + 10, + 7, + 1, + 7, + 20, + 6, + 2, + 10, + 1, + 2, + 1, + 7, + 7, + 0, + 9, + 5, + 12, + 12, + 1, + 3, + 12, + 3, + 6, + 1, + 9, + 6, + 16, + 6, + 6, + 1, + 5, + 1, + 2, + 5, + 12, + 8, + 6, + 2, + 2, + 4, + 10, + 1, + 8, + 2, + 5, + 2, + 27, + 9, + 14, + 10, + 3, + 4, + 10, + 3 + ], + "weighted_loads": [ + 0.046306394040584564, + 0.05426559969782829, + 0.11778424307703972, + 0.49169987812638283, + 0.3309561498463154, + 0.0, + 0.0, + 0.3251815475523472, + 0.3450487554073334, + 0.974522203207016, + 1.0265803895890713, + 0.6139423199929297, + 0.17123718559741974, + 0.9624568596482277, + 1.1961912958649918, + 0.3967996761202812, + 0.13755062967538834, + 0.7722896406194195, + 0.05195746198296547, + 0.08033741265535355, + 0.06294728070497513, + 0.4106223043054342, + 0.5000483468174934, + 0.0, + 0.4135159682482481, + 0.28000928834080696, + 1.3519244827330112, + 0.5004232805222273, + 0.033726125955581665, + 0.10595864057540894, + 1.2167939729988575, + 0.22212250530719757, + 0.270845502614975, + 0.03565734252333641, + 0.5988590568304062, + 0.3948129042983055, + 0.9228229559957981, + 0.33008577302098274, + 0.52374417334795, + 0.03533352166414261, + 0.26762259379029274, + 0.05942336842417717, + 0.08661839365959167, + 0.23401478677988052, + 1.0623371675610542, + 0.7226803675293922, + 0.40083251148462296, + 0.13625865429639816, + 0.08206115663051605, + 1.3502711690962315, + 0.3952708728611469, + 0.08496378362178802, + 0.7112002931535244, + 0.18885773047804832, + 0.3156922422349453, + 0.1171250194311142, + 2.4571996293962, + 0.7482852302491665, + 0.7983816508203745, + 0.4582683015614748, + 0.24044470122316852, + 0.4193061962723732, + 0.656372033059597, + 0.2913524843752384 + ], + "unique_experts": 61, + "load_cv": 0.8477912478906585, + "normalized_load_entropy": 0.9185727845179935, + "max_load_share": 0.0703125 + } + }, + "s0_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "acb8ec3a0853b4a953e0f06ffa3720de7a1abe42bb2dab445c5d26fb2e64fb03", + "route_weight_sha256": "f754fce9b8fd0a3eefb35dfc86dd9f322e2cb6d0adac44bdc165fab775ea3bcd", + "loads": [ + 0, + 0, + 2, + 6, + 2, + 0, + 0, + 3, + 4, + 7, + 4, + 0, + 0, + 6, + 5, + 1, + 2, + 2, + 0, + 0, + 2, + 1, + 0, + 0, + 2, + 3, + 0, + 1, + 1, + 1, + 3, + 2, + 1, + 0, + 2, + 6, + 4, + 1, + 4, + 0, + 4, + 0, + 0, + 0, + 11, + 9, + 2, + 2, + 1, + 1, + 1, + 0, + 0, + 1, + 2, + 0, + 7, + 0, + 4, + 4, + 0, + 4, + 7, + 0 + ], + "weighted_loads": [ + 0.0, + 0.0, + 0.11443821340799332, + 0.42646197602152824, + 0.09186633676290512, + 0.0, + 0.0, + 0.169125746935606, + 0.3652961924672127, + 0.6124444045126438, + 0.23974332213401794, + 0.0, + 0.0, + 0.9426510855555534, + 0.3766220323741436, + 0.08917319774627686, + 0.13108719140291214, + 0.2614881172776222, + 0.0, + 0.0, + 0.1147979386150837, + 0.05721185728907585, + 0.0, + 0.0, + 0.09394581243395805, + 0.19806179776787758, + 0.0, + 0.0639648288488388, + 0.029726700857281685, + 0.03719145804643631, + 0.16124668717384338, + 0.15660261362791061, + 0.044223833829164505, + 0.0, + 0.10465603321790695, + 0.3841344714164734, + 0.2723335772752762, + 0.03401388227939606, + 0.3210498169064522, + 0.0, + 0.2432295884937048, + 0.0, + 0.0, + 0.0, + 1.044130615890026, + 0.7734715640544891, + 0.14425582066178322, + 0.12153893895447254, + 0.04750285670161247, + 0.22144164144992828, + 0.03475198149681091, + 0.0, + 0.0, + 0.05406215786933899, + 0.10075583308935165, + 0.0, + 0.6182568371295929, + 0.0, + 0.25614868104457855, + 0.23352274671196938, + 0.0, + 0.4441216215491295, + 0.5273601599037647, + 0.0 + ], + "unique_experts": 42, + "load_cv": 1.151330472432995, + "normalized_load_entropy": 0.8418299768843945, + "max_load_share": 0.07971014492753623 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "4703ec378e0004d25e90e34d16bc5a7e25f23f053e024c5d64b71ef5f1c756fb", + "route_weight_sha256": "6f519c74dba07e159b8ac1f17980eac97fd2d209307d04299a9e0dd9498d190b", + "loads": [ + 1, + 1, + 2, + 8, + 2, + 1, + 0, + 4, + 4, + 12, + 7, + 5, + 1, + 8, + 18, + 3, + 2, + 12, + 0, + 0, + 2, + 2, + 1, + 0, + 6, + 3, + 6, + 10, + 1, + 1, + 11, + 2, + 3, + 0, + 7, + 6, + 9, + 1, + 4, + 0, + 4, + 2, + 2, + 4, + 14, + 9, + 5, + 2, + 2, + 1, + 10, + 1, + 3, + 1, + 3, + 0, + 22, + 7, + 10, + 5, + 0, + 4, + 8, + 3 + ], + "weighted_loads": [ + 0.02728513441979885, + 0.04710664972662926, + 0.11443821340799332, + 0.4999387376010418, + 0.09186633676290512, + 0.049510397017002106, + 0.0, + 0.2033863179385662, + 0.3652961924672127, + 0.8654355425387621, + 0.6029327735304832, + 0.3332354612648487, + 0.19870902597904205, + 1.02480573579669, + 0.9916224852204323, + 0.2040940336883068, + 0.13108719140291214, + 0.9001297671347857, + 0.0, + 0.0, + 0.1147979386150837, + 0.08829370886087418, + 0.032889872789382935, + 0.0, + 0.30396004393696785, + 0.19806179776787758, + 0.9474168866872787, + 0.4621724095195532, + 0.029726700857281685, + 0.03719145804643631, + 1.0741527415812016, + 0.15660261362791061, + 0.13293979689478874, + 0.0, + 0.5520225837826729, + 0.3841344714164734, + 0.5271984152495861, + 0.03401388227939606, + 0.3210498169064522, + 0.0, + 0.2432295884937048, + 0.368113761767745, + 0.09392638504505157, + 0.19669370725750923, + 1.1951940543949604, + 0.7734715640544891, + 0.3243934214115143, + 0.12153893895447254, + 0.11367372795939445, + 0.22144164144992828, + 0.4396378919482231, + 0.07915212213993073, + 0.34919798374176025, + 0.05406215786933899, + 0.14740370213985443, + 0.0, + 1.9173899088054895, + 0.3997773826122284, + 0.49840832501649857, + 0.28151486814022064, + 0.0, + 0.4441216215491295, + 0.567920483648777, + 0.38388625904917717 + ], + "unique_experts": 56, + "load_cv": 1.0023121418149286, + "normalized_load_entropy": 0.8893622224324162, + "max_load_share": 0.0763888888888889 + } + }, + "s1_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "3549d86b86bf6fdee8d61bcc76ac41699ec82d514c65b81258cbfdce35fb1ee8", + "route_weight_sha256": "ca38650bfeebd49bc0bd323b16d33e71d315fa4fb487249219ecc48557a338e9", + "loads": [ + 0, + 0, + 2, + 6, + 3, + 0, + 0, + 4, + 4, + 7, + 4, + 0, + 0, + 6, + 5, + 1, + 2, + 2, + 0, + 1, + 1, + 1, + 0, + 0, + 2, + 3, + 0, + 1, + 1, + 1, + 3, + 2, + 1, + 0, + 2, + 6, + 4, + 1, + 4, + 0, + 4, + 0, + 0, + 0, + 12, + 7, + 2, + 2, + 1, + 1, + 1, + 0, + 0, + 0, + 2, + 0, + 7, + 0, + 4, + 4, + 0, + 4, + 7, + 0 + ], + "weighted_loads": [ + 0.0, + 0.0, + 0.10874062031507492, + 0.4267948120832443, + 0.1401773802936077, + 0.0, + 0.0, + 0.2180657610297203, + 0.33866680413484573, + 0.6210028156638145, + 0.2204006053507328, + 0.0, + 0.0, + 0.9441413506865501, + 0.3622668422758579, + 0.08883393555879593, + 0.13986898958683014, + 0.2392486184835434, + 0.0, + 0.031154446303844452, + 0.05978097766637802, + 0.05179775506258011, + 0.0, + 0.0, + 0.09340361505746841, + 0.20838917791843414, + 0.0, + 0.06160274147987366, + 0.035943761467933655, + 0.03803136944770813, + 0.1520947404205799, + 0.15084151923656464, + 0.04606650024652481, + 0.0, + 0.10219455137848854, + 0.3890599422156811, + 0.2632906176149845, + 0.03196060284972191, + 0.30845584720373154, + 0.0, + 0.24750915355980396, + 0.0, + 0.0, + 0.0, + 1.0894906781613827, + 0.6950999647378922, + 0.13197244331240654, + 0.11954152770340443, + 0.0476050041615963, + 0.2448936253786087, + 0.03500565141439438, + 0.0, + 0.0, + 0.0, + 0.10287743806838989, + 0.0, + 0.6400768347084522, + 0.0, + 0.24227661080658436, + 0.2275169249624014, + 0.0, + 0.43148117512464523, + 0.5004801694303751, + 0.0 + ], + "unique_experts": 42, + "load_cv": 1.151330472432995, + "normalized_load_entropy": 0.8417237430135418, + "max_load_share": 0.08695652173913043 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "52457c99d6ad185c9c7775b5a6205e9b0436924501a11b075af6be51b7603034", + "route_weight_sha256": "062d1c4c09687c777030d3ce265086f975ece0bc4c48b396f4a331783a7b960a", + "loads": [ + 0, + 1, + 2, + 7, + 6, + 0, + 0, + 5, + 4, + 15, + 12, + 7, + 1, + 7, + 18, + 7, + 2, + 9, + 0, + 1, + 1, + 7, + 7, + 0, + 9, + 5, + 13, + 11, + 1, + 3, + 14, + 3, + 5, + 2, + 10, + 6, + 15, + 6, + 8, + 1, + 5, + 1, + 3, + 4, + 15, + 7, + 6, + 3, + 2, + 3, + 9, + 1, + 8, + 2, + 5, + 2, + 26, + 8, + 14, + 10, + 2, + 4, + 10, + 3 + ], + "weighted_loads": [ + 0.0, + 0.05213572829961777, + 0.10874062031507492, + 0.46418536454439163, + 0.3213590458035469, + 0.0, + 0.0, + 0.30626409500837326, + 0.33866680413484573, + 1.0520717073231936, + 1.1453803814947605, + 0.6342108175158501, + 0.19227458536624908, + 0.9972041323781013, + 1.0970007739961147, + 0.44132306426763535, + 0.13986898958683014, + 0.7450144458562136, + 0.0, + 0.031154446303844452, + 0.05978097766637802, + 0.40360543318092823, + 0.4818040132522583, + 0.0, + 0.4175953362137079, + 0.31430894136428833, + 1.5730315744876862, + 0.4494877438992262, + 0.035943761467933655, + 0.10776737704873085, + 1.4366539306938648, + 0.23095262795686722, + 0.23214557766914368, + 0.08149251341819763, + 0.7203423231840134, + 0.3890599422156811, + 0.8802414052188396, + 0.33051276206970215, + 0.6378547996282578, + 0.03533352166414261, + 0.27766711451113224, + 0.029812222346663475, + 0.1454843208193779, + 0.1951761543750763, + 1.219627633690834, + 0.6950999647378922, + 0.39854642376303673, + 0.16137860901653767, + 0.08154559880495071, + 0.3999726362526417, + 0.3688168004155159, + 0.08243384957313538, + 0.6935357786715031, + 0.18885773047804832, + 0.31428833305835724, + 0.1171250194311142, + 2.5881019346415997, + 0.742957703769207, + 0.8100347872823477, + 0.47464535757899284, + 0.23951289802789688, + 0.43148117512464523, + 0.6278605237603188, + 0.24013475701212883 + ], + "unique_experts": 59, + "load_cv": 0.8544206939337449, + "normalized_load_entropy": 0.9142090504952001, + "max_load_share": 0.06770833333333333 + } + }, + "s0_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "bf1491470f412069a3b91beee98ea2c5496169d9b7eedf46b4e0e20eae10ed18", + "route_weight_sha256": "fb07f9cbe5d8f872073f7ccfeefb52264985ee07bbfb5b81d7851efb8f7e181b", + "loads": [ + 0, + 0, + 2, + 6, + 3, + 0, + 0, + 3, + 4, + 7, + 4, + 0, + 1, + 6, + 5, + 1, + 2, + 2, + 0, + 1, + 1, + 1, + 1, + 0, + 2, + 3, + 0, + 1, + 1, + 1, + 3, + 2, + 0, + 0, + 3, + 5, + 4, + 0, + 3, + 0, + 4, + 0, + 0, + 0, + 11, + 7, + 2, + 2, + 1, + 1, + 2, + 0, + 0, + 1, + 1, + 0, + 9, + 0, + 4, + 3, + 0, + 4, + 8, + 0 + ], + "weighted_loads": [ + 0.0, + 0.0, + 0.11463504657149315, + 0.424707118421793, + 0.16483492031693459, + 0.0, + 0.0, + 0.17772776633501053, + 0.34476038068532944, + 0.5925535894930363, + 0.21809720247983932, + 0.0, + 0.031392693519592285, + 0.8892844468355179, + 0.3950943276286125, + 0.09001786261796951, + 0.13232388719916344, + 0.25162220746278763, + 0.0, + 0.03191792964935303, + 0.061755429953336716, + 0.05881596729159355, + 0.037060197442770004, + 0.0, + 0.08969619870185852, + 0.2107764258980751, + 0.0, + 0.06003744900226593, + 0.03248712420463562, + 0.040267955511808395, + 0.15478110313415527, + 0.15211617201566696, + 0.0, + 0.0, + 0.1439608633518219, + 0.3577457293868065, + 0.28847645223140717, + 0.0, + 0.25064973533153534, + 0.0, + 0.23819346353411674, + 0.0, + 0.0, + 0.0, + 1.056717500090599, + 0.672952227294445, + 0.12621545791625977, + 0.1277771256864071, + 0.04912719503045082, + 0.2174432873725891, + 0.08340558782219887, + 0.0, + 0.0, + 0.04674680903553963, + 0.06777908653020859, + 0.0, + 0.7021953351795673, + 0.0, + 0.24220896884799004, + 0.17153296247124672, + 0.0, + 0.41301166266202927, + 0.5949882604181767, + 0.0 + ], + "unique_experts": 43, + "load_cv": 1.1484078455453641, + "normalized_load_entropy": 0.8448880312027996, + "max_load_share": 0.07971014492753623 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "207be138a76b4115438153748d85e4cee43381f4e7d2b222e148954eacfe9075", + "route_weight_sha256": "39ed60c75552908a74071d204c9b1207bc9f11782ef9e6e1ee045dbda1d63ad2", + "loads": [ + 0, + 1, + 2, + 7, + 3, + 0, + 0, + 4, + 4, + 10, + 8, + 6, + 2, + 7, + 19, + 3, + 2, + 14, + 0, + 1, + 1, + 2, + 1, + 0, + 6, + 3, + 6, + 11, + 2, + 2, + 9, + 2, + 2, + 0, + 8, + 5, + 9, + 0, + 3, + 0, + 4, + 0, + 1, + 6, + 13, + 7, + 5, + 2, + 1, + 1, + 11, + 1, + 3, + 1, + 2, + 0, + 28, + 8, + 10, + 4, + 0, + 4, + 9, + 2 + ], + "weighted_loads": [ + 0.0, + 0.04607955366373062, + 0.11463504657149315, + 0.49158739671111107, + 0.16483492031693459, + 0.0, + 0.0, + 0.21198833733797073, + 0.34476038068532944, + 0.7779010683298111, + 0.6117100082337856, + 0.4628806672990322, + 0.20639482140541077, + 0.9466723315417767, + 1.119082186371088, + 0.18481113389134407, + 0.13232388719916344, + 1.0668915417045355, + 0.0, + 0.03191792964935303, + 0.061755429953336716, + 0.08989781886339188, + 0.037060197442770004, + 0.0, + 0.3025304600596428, + 0.2107764258980751, + 0.8407963626086712, + 0.4361464809626341, + 0.0462564155459404, + 0.08939512073993683, + 0.9374192282557487, + 0.15211617201566696, + 0.08962366729974747, + 0.0, + 0.5349492970854044, + 0.3577457293868065, + 0.5377719886600971, + 0.0, + 0.25064973533153534, + 0.0, + 0.23819346353411674, + 0.0, + 0.028873391449451447, + 0.33292582631111145, + 1.1268210336565971, + 0.672952227294445, + 0.29282189905643463, + 0.1277771256864071, + 0.04912719503045082, + 0.2174432873725891, + 0.4862109608948231, + 0.0744984820485115, + 0.3378583639860153, + 0.04674680903553963, + 0.11442695558071136, + 0.0, + 2.2918664049357176, + 0.5111272260546684, + 0.48446861281991005, + 0.21952508389949799, + 0.0, + 0.41301166266202927, + 0.6355485841631889, + 0.1305592618882656 + ], + "unique_experts": 53, + "load_cv": 1.1145779248743821, + "normalized_load_entropy": 0.8715809318349454, + "max_load_share": 0.09722222222222222 + } + }, + "s1_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "07433414faae612fa34e0abf1fa06d5be8b115c8357c7f8d2ae7b18cfb7aef63", + "route_weight_sha256": "678615cc81944219107343b27cca69e667e5b5b0b614bafbb251bc4f7ca3ccaa", + "loads": [ + 0, + 0, + 2, + 6, + 3, + 0, + 0, + 4, + 5, + 7, + 4, + 0, + 1, + 6, + 5, + 1, + 2, + 2, + 0, + 1, + 1, + 1, + 0, + 0, + 2, + 3, + 0, + 1, + 1, + 1, + 3, + 2, + 0, + 0, + 2, + 5, + 5, + 0, + 3, + 0, + 3, + 0, + 1, + 0, + 11, + 8, + 2, + 1, + 1, + 1, + 2, + 0, + 0, + 0, + 1, + 0, + 9, + 0, + 4, + 4, + 0, + 4, + 7, + 0 + ], + "weighted_loads": [ + 0.0, + 0.0, + 0.11324074119329453, + 0.42867401614785194, + 0.17224467545747757, + 0.0, + 0.0, + 0.22430389747023582, + 0.37666260823607445, + 0.6074295043945312, + 0.17270490154623985, + 0.0, + 0.02929285541176796, + 0.9003398418426514, + 0.43931739032268524, + 0.08862326294183731, + 0.14305441826581955, + 0.23897580802440643, + 0.0, + 0.029816560447216034, + 0.062300704419612885, + 0.05760186165571213, + 0.0, + 0.0, + 0.07527865096926689, + 0.19437416270375252, + 0.0, + 0.06311934441328049, + 0.03183348476886749, + 0.04584171995520592, + 0.14646058529615402, + 0.14762769639492035, + 0.0, + 0.0, + 0.09995216131210327, + 0.3760016895830631, + 0.3321717865765095, + 0.0, + 0.23732534050941467, + 0.0, + 0.21192316338419914, + 0.0, + 0.02907632663846016, + 0.0, + 0.9294583946466446, + 0.7077870704233646, + 0.1269783154129982, + 0.08526626229286194, + 0.04623256251215935, + 0.2058422714471817, + 0.07669728621840477, + 0.0, + 0.0, + 0.0, + 0.06509609520435333, + 0.0, + 0.7171319834887981, + 0.0, + 0.23370064049959183, + 0.1973152607679367, + 0.0, + 0.3828479014337063, + 0.5497576631605625, + 0.0 + ], + "unique_experts": 42, + "load_cv": 1.171584737034095, + "normalized_load_entropy": 0.8379924926224293, + "max_load_share": 0.07971014492753623 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "f55a4b9d8121685d9957002ba7789e9e85c5b72c9378cd49250d96fd21d7e508", + "route_weight_sha256": "bb69b935fb2e6d0b1ef5bc8621ea8aacdf32129f79e9c7bb717b7043e2bc5de5", + "loads": [ + 0, + 1, + 2, + 8, + 6, + 1, + 0, + 5, + 5, + 13, + 12, + 8, + 2, + 7, + 20, + 6, + 2, + 9, + 0, + 1, + 1, + 7, + 6, + 0, + 9, + 5, + 12, + 12, + 2, + 4, + 12, + 3, + 4, + 1, + 9, + 5, + 17, + 5, + 6, + 1, + 4, + 0, + 2, + 4, + 13, + 8, + 5, + 2, + 2, + 3, + 10, + 2, + 8, + 2, + 4, + 2, + 30, + 10, + 15, + 11, + 2, + 4, + 10, + 2 + ], + "weighted_loads": [ + 0.0, + 0.04682905972003937, + 0.11324074119329453, + 0.5523464754223824, + 0.35342634096741676, + 0.06099775433540344, + 0.0, + 0.3125022314488888, + 0.37666260823607445, + 0.9601719602942467, + 0.9551581591367722, + 0.7621561475098133, + 0.13813797757029533, + 0.9534026235342026, + 1.3252010010182858, + 0.40028099343180656, + 0.14305441826581955, + 0.735974932089448, + 0.0, + 0.029816560447216034, + 0.062300704419612885, + 0.40940953977406025, + 0.44725213944911957, + 0.0, + 0.3934298660606146, + 0.3002939261496067, + 1.3652251102030277, + 0.4989272262901068, + 0.07345301285386086, + 0.19478721916675568, + 1.1770473644137383, + 0.22773880511522293, + 0.17816833779215813, + 0.06666607409715652, + 0.6206502579152584, + 0.3760016895830631, + 1.000920295715332, + 0.29855215921998024, + 0.5279161036014557, + 0.03533352166414261, + 0.24208112433552742, + 0.0, + 0.07321993261575699, + 0.1951761543750763, + 1.00499496050179, + 0.7077870704233646, + 0.3491210900247097, + 0.12710334360599518, + 0.08017315715551376, + 0.3609212823212147, + 0.4031611233949661, + 0.10556010156869888, + 0.6771924905478954, + 0.18885773047804832, + 0.2765069901943207, + 0.1171250194311142, + 2.5632111839950085, + 0.8929585590958595, + 0.8669719956815243, + 0.4900727216154337, + 0.23951289802789688, + 0.3828479014337063, + 0.6771380174905062, + 0.11963049694895744 + ], + "unique_experts": 59, + "load_cv": 0.9090593428863095, + "normalized_load_entropy": 0.9091975729607717, + "max_load_share": 0.078125 + } + }, + "s0_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "5da7047fac1fd0da2201a13358de968261827e536f43f69c05add31c396bfa15", + "route_weight_sha256": "042d22ed3d81c2fa7c151d80eb5814f1f272654dd53ee8fd554ae4bb3b46ac1d", + "loads": [ + 0, + 0, + 2, + 6, + 3, + 0, + 0, + 3, + 4, + 7, + 3, + 0, + 1, + 6, + 5, + 1, + 2, + 2, + 0, + 1, + 1, + 1, + 0, + 0, + 2, + 3, + 0, + 1, + 1, + 1, + 3, + 2, + 1, + 0, + 3, + 5, + 5, + 1, + 3, + 0, + 3, + 0, + 0, + 0, + 11, + 9, + 2, + 1, + 1, + 1, + 3, + 0, + 0, + 1, + 1, + 0, + 8, + 0, + 4, + 3, + 0, + 4, + 7, + 0 + ], + "weighted_loads": [ + 0.0, + 0.0, + 0.1162015050649643, + 0.4263996034860611, + 0.1693989671766758, + 0.0, + 0.0, + 0.1686820201575756, + 0.3612635023891926, + 0.6018548756837845, + 0.18195458501577377, + 0.0, + 0.038744810968637466, + 0.8873014897108078, + 0.3950520344078541, + 0.0908023864030838, + 0.12958861887454987, + 0.25839653611183167, + 0.0, + 0.033476267009973526, + 0.06326202303171158, + 0.057991959154605865, + 0.0, + 0.0, + 0.09313499182462692, + 0.21534373611211777, + 0.0, + 0.05928114801645279, + 0.033248111605644226, + 0.03902655839920044, + 0.16908233612775803, + 0.15674381703138351, + 0.04015292972326279, + 0.0, + 0.14940368756651878, + 0.3569410853087902, + 0.3178894817829132, + 0.03227528929710388, + 0.2568807750940323, + 0.0, + 0.20162048190832138, + 0.0, + 0.0, + 0.0, + 1.0090523771941662, + 0.7668905146420002, + 0.13591089099645615, + 0.0976363867521286, + 0.047239478677511215, + 0.1980617493391037, + 0.10882525891065598, + 0.0, + 0.0, + 0.052258364856243134, + 0.073092021048069, + 0.0, + 0.6616032924503088, + 0.0, + 0.2607078589498997, + 0.1842864565551281, + 0.0, + 0.42471419274806976, + 0.497375026345253, + 0.0 + ], + "unique_experts": 44, + "load_cv": 1.1454777617516225, + "normalized_load_entropy": 0.847455298134047, + "max_load_share": 0.07971014492753623 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "6744ed733610b7b90c2ce30c84b17101c4df7ee3a83f0e1b8ed09d13662f6fbc", + "route_weight_sha256": "e52775a301103852069da3d9c825782031966adef410a41663f6e94edee347cb", + "loads": [ + 0, + 1, + 2, + 8, + 3, + 1, + 0, + 4, + 4, + 11, + 7, + 5, + 2, + 7, + 19, + 2, + 2, + 13, + 0, + 1, + 1, + 2, + 0, + 0, + 7, + 3, + 5, + 10, + 1, + 1, + 11, + 2, + 4, + 0, + 8, + 5, + 11, + 1, + 3, + 0, + 3, + 0, + 1, + 4, + 13, + 9, + 6, + 1, + 2, + 1, + 12, + 1, + 4, + 1, + 2, + 0, + 25, + 7, + 10, + 4, + 0, + 4, + 8, + 3 + ], + "weighted_loads": [ + 0.0, + 0.05021526291966438, + 0.1162015050649643, + 0.5273215472698212, + 0.1693989671766758, + 0.0471627414226532, + 0.0, + 0.2029425911605358, + 0.3612635023891926, + 0.8189543262124062, + 0.6013404205441475, + 0.3297003470361233, + 0.22248566523194313, + 0.9446893744170666, + 1.0485392063856125, + 0.14795229956507683, + 0.12958861887454987, + 1.0152026880532503, + 0.0, + 0.033476267009973526, + 0.06326202303171158, + 0.08907381072640419, + 0.0, + 0.0, + 0.39873843267560005, + 0.21534373611211777, + 0.7727180644869804, + 0.39625836722552776, + 0.033248111605644226, + 0.03902655839920044, + 1.049629494547844, + 0.15674381703138351, + 0.16420454159379005, + 0.0, + 0.5949501376599073, + 0.3569410853087902, + 0.6192617826163769, + 0.03227528929710388, + 0.2568807750940323, + 0.0, + 0.20162048190832138, + 0.0, + 0.02813170850276947, + 0.2473835125565529, + 1.0900354199111462, + 0.7668905146420002, + 0.3471074067056179, + 0.0976363867521286, + 0.08942325785756111, + 0.1980617493391037, + 0.5134117156267166, + 0.07559452950954437, + 0.4224780425429344, + 0.052258364856243134, + 0.11973989009857178, + 0.0, + 2.2185931093990803, + 0.3997773826122284, + 0.5029675029218197, + 0.23227857798337936, + 0.0, + 0.42471419274806976, + 0.5379353500902653, + 0.22271167114377022 + ], + "unique_experts": 54, + "load_cv": 1.081551240773988, + "normalized_load_entropy": 0.8744514977739821, + "max_load_share": 0.08680555555555555 + } + }, + "s1_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "da32035453f1ebef6636f78d92a1b9ebc5ef89db173d74a5c9d41725c77666f2", + "route_weight_sha256": "14375219146be7aa59574cca2cd75e5cc1a85d7cee0606c618290901bb02134b", + "loads": [ + 0, + 0, + 2, + 6, + 3, + 0, + 0, + 4, + 5, + 7, + 3, + 0, + 1, + 6, + 5, + 1, + 2, + 2, + 0, + 1, + 1, + 1, + 1, + 0, + 2, + 4, + 0, + 1, + 1, + 1, + 3, + 2, + 0, + 0, + 2, + 5, + 4, + 0, + 3, + 0, + 3, + 0, + 1, + 0, + 10, + 8, + 1, + 1, + 1, + 1, + 3, + 0, + 0, + 0, + 1, + 0, + 8, + 0, + 4, + 5, + 0, + 4, + 8, + 0 + ], + "weighted_loads": [ + 0.0, + 0.0, + 0.11301335319876671, + 0.41521023213863373, + 0.17694124951958656, + 0.0, + 0.0, + 0.22508233785629272, + 0.3702910989522934, + 0.6158067286014557, + 0.14833879098296165, + 0.0, + 0.029121829196810722, + 0.9000282734632492, + 0.44394059479236603, + 0.08521608263254166, + 0.1441529542207718, + 0.24268323183059692, + 0.0, + 0.03038007579743862, + 0.06725158542394638, + 0.06115446984767914, + 0.03394768014550209, + 0.0, + 0.0723361074924469, + 0.2159794382750988, + 0.0, + 0.053677547723054886, + 0.03260580450296402, + 0.04669748991727829, + 0.15736500918865204, + 0.14612913131713867, + 0.0, + 0.0, + 0.10377420857548714, + 0.3664719685912132, + 0.2793470062315464, + 0.0, + 0.2354912906885147, + 0.0, + 0.24313649162650108, + 0.0, + 0.030864102765917778, + 0.0, + 0.8606131970882416, + 0.7281223945319653, + 0.06975439935922623, + 0.09118051826953888, + 0.04778466746211052, + 0.20451371371746063, + 0.10590782389044762, + 0.0, + 0.0, + 0.0, + 0.06477347016334534, + 0.0, + 0.6932041570544243, + 0.0, + 0.25065308436751366, + 0.25220903381705284, + 0.0, + 0.3783930614590645, + 0.561955027282238, + 0.0 + ], + "unique_experts": 43, + "load_cv": 1.14254016368129, + "normalized_load_entropy": 0.8431378897496722, + "max_load_share": 0.07246376811594203 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "6ead0e330b708ea1743cb0523ab4ef7c0a5de43a29cf6a51bb8c837f81d7aec8", + "route_weight_sha256": "8eb723dddf2f444b95d694c8a08f248355c4f3faf91b6474bcaa4f14d4758fb5", + "loads": [ + 0, + 1, + 2, + 8, + 6, + 0, + 0, + 5, + 5, + 13, + 11, + 6, + 2, + 7, + 19, + 6, + 2, + 9, + 0, + 1, + 1, + 7, + 7, + 0, + 10, + 6, + 12, + 12, + 2, + 3, + 12, + 3, + 4, + 1, + 9, + 5, + 16, + 6, + 6, + 1, + 4, + 0, + 4, + 4, + 11, + 8, + 5, + 2, + 3, + 3, + 11, + 2, + 9, + 2, + 5, + 2, + 30, + 8, + 14, + 11, + 2, + 4, + 11, + 3 + ], + "weighted_loads": [ + 0.0, + 0.045970022678375244, + 0.11301335319876671, + 0.517559252679348, + 0.35812291502952576, + 0.0, + 0.0, + 0.3132806718349457, + 0.3702910989522934, + 0.9685491845011711, + 0.9663870297372341, + 0.6116689927875996, + 0.12867414765059948, + 0.9530910551548004, + 1.2821995988488197, + 0.3870989456772804, + 0.1441529542207718, + 0.8262565676122904, + 0.0, + 0.03038007579743862, + 0.06725158542394638, + 0.41296214796602726, + 0.48119981959462166, + 0.0, + 0.46011502854526043, + 0.321899201720953, + 1.335892591625452, + 0.48141537606716156, + 0.08281021192669868, + 0.11643349751830101, + 1.1842374354600906, + 0.22624024003744125, + 0.17618044093251228, + 0.07010232657194138, + 0.6506092697381973, + 0.3664719685912132, + 0.9637433812022209, + 0.3278367258608341, + 0.5260820537805557, + 0.03533352166414261, + 0.27329445257782936, + 0.0, + 0.15648510120809078, + 0.1951761543750763, + 0.9019729234278202, + 0.7281223945319653, + 0.3295445293188095, + 0.13301759958267212, + 0.11542654410004616, + 0.3595927245914936, + 0.42766669765114784, + 0.10393188893795013, + 0.7320907674729824, + 0.18885773047804832, + 0.31414780765771866, + 0.1171250194311142, + 2.6311221066862345, + 0.742957703769207, + 0.818411260843277, + 0.4993374664336443, + 0.23951289802789688, + 0.3783930614590645, + 0.6893353816121817, + 0.202519703656435 + ], + "unique_experts": 58, + "load_cv": 0.8848650242331376, + "normalized_load_entropy": 0.9120352370215269, + "max_load_share": 0.078125 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "ordered_topk_exact_tokens": 17, + "set_exact_tokens": 20, + "mean_set_jaccard": 0.9627329192546585, + "mean_token_weighted_tv": 0.01600770680638759, + "aggregate_load_tv": 0.014492753623188404 + }, + "system_bos": { + "tokens": 23, + "ordered_topk_exact_tokens": 19, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.9503105590062112, + "mean_token_weighted_tv": 0.021271534992948822, + "aggregate_load_tv": 0.028985507246376812 + }, + "system_x": { + "tokens": 23, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.9006211180124224, + "mean_token_weighted_tv": 0.030446028579836307, + "aggregate_load_tv": 0.043478260869565216 + }, + "system_period": { + "tokens": 23, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 11, + "mean_set_jaccard": 0.8509316770186336, + "mean_token_weighted_tv": 0.039515298993691154, + "aggregate_load_tv": 0.05797101449275362 + }, + "bos_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 16, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.9161490683229813, + "mean_token_weighted_tv": 0.028629923401319462, + "aggregate_load_tv": 0.05072463768115942 + }, + "bos_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 16, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.9409937888198759, + "mean_token_weighted_tv": 0.023697768580978332, + "aggregate_load_tv": 0.028985507246376812 + }, + "x_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.9130434782608695, + "mean_token_weighted_tv": 0.026639129521082276, + "aggregate_load_tv": 0.043478260869565216 + }, + "x_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.9037267080745343, + "mean_token_weighted_tv": 0.03206789242508619, + "aggregate_load_tv": 0.03623188405797101 + }, + "period_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 18, + "mean_set_jaccard": 0.9378881987577641, + "mean_token_weighted_tv": 0.022301962518173714, + "aggregate_load_tv": 0.03623188405797101 + }, + "period_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8788819875776398, + "mean_token_weighted_tv": 0.03702340279098438, + "aggregate_load_tv": 0.057971014492753624 + } + } + } + } + }, + { + "id": "HumanEval/31", + "domain": "code", + "label": "Python code", + "within_domain_index": 0, + "selection_rank": "004f4cfa62936a4a096e53df7d0ef3926c3ee97d32cf67a3c9bd64569f580e5c", + "source_text_sha256": "b7e32acf5a6b551a782eacfb4ecab09e59f0577a2da9642e292d2479af5bf50e", + "source_characters": 308, + "source_tokens": 120, + "content_token_ids_sha256": "d22768ea5348c0fe94bfddb93cbb9077aa4bc72a17b096b152e684ac5a485596", + "prompt_tokens_by_condition": { + "s0_eos": 145, + "s1_eos": 161, + "s0_bos": 145, + "s1_bos": 161, + "s0_x": 145, + "s1_x": 161, + "s0_period": 145, + "s1_period": 161 + }, + "batch_prompt_tokens": 161, + "content_tokens": 120, + "boundary_crossing_tokens_by_condition": { + "s0_eos": 0, + "s1_eos": 0, + "s0_bos": 0, + "s1_bos": 0, + "s0_x": 0, + "s1_x": 0, + "s0_period": 0, + "s1_period": 0 + }, + "forward_seconds": 0.871169860009104, + "peak_cuda_memory_allocated_bytes": 27719041024, + "hidden_stages": { + "embedding": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3845a664d4654d8622af3183546fa1220955445321024cf065b452af5cd30210", + "mean": -0.0012909455690532923, + "std": 0.08326598256826401, + "rms": 0.08327598869800568, + "max_abs": 2.046875 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "94dd9dfaa8a8682825703d5a696149d0d78e440456bdf3a7416136bfb44977a1", + "mean": -0.0012299797963351011, + "std": 0.08360898494720459, + "rms": 0.08361802250146866, + "max_abs": 2.046875 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3845a664d4654d8622af3183546fa1220955445321024cf065b452af5cd30210", + "mean": -0.0012909455690532923, + "std": 0.08326598256826401, + "rms": 0.08327598869800568, + "max_abs": 2.046875 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a43d3f416a11e0146f0be31ab25e0fdef7b54db6e339ba3215389bc3cc494b90", + "mean": -0.0013260887935757637, + "std": 0.08594415336847305, + "rms": 0.08595438301563263, + "max_abs": 2.046875 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3845a664d4654d8622af3183546fa1220955445321024cf065b452af5cd30210", + "mean": -0.0012909455690532923, + "std": 0.08326598256826401, + "rms": 0.08327598869800568, + "max_abs": 2.046875 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8e6f24c31cc9135aae9b006750172da7945cc8cf3537949a526ea30ea315dd7b", + "mean": -0.0012194061418995261, + "std": 0.08345475047826767, + "rms": 0.08346366137266159, + "max_abs": 2.046875 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3845a664d4654d8622af3183546fa1220955445321024cf065b452af5cd30210", + "mean": -0.0012909455690532923, + "std": 0.08326598256826401, + "rms": 0.08327598869800568, + "max_abs": 2.046875 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0c96b3a86a152f344b2c8a6ffcf94f82faa674036fa3935b9d8e14338d16681e", + "mean": -0.0013165659038349986, + "std": 0.08580905199050903, + "rms": 0.08581914752721786, + "max_abs": 2.046875 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3845a664d4654d8622af3183546fa1220955445321024cf065b452af5cd30210", + "mean": -0.0012909455690532923, + "std": 0.08326598256826401, + "rms": 0.08327598869800568, + "max_abs": 2.046875 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "10ef4e5cb8ed2bfcd67e88a6d501af164e7512541776772f6f4cefdb00f55313", + "mean": -0.0012453540693968534, + "std": 0.08355861902236938, + "rms": 0.08356789499521255, + "max_abs": 2.046875 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3845a664d4654d8622af3183546fa1220955445321024cf065b452af5cd30210", + "mean": -0.0012909455690532923, + "std": 0.08326598256826401, + "rms": 0.08327598869800568, + "max_abs": 2.046875 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e412af17e035d1bd782c5f6ccba010220ea06031abd2febf975518a3af7632ac", + "mean": -0.0013399352319538593, + "std": 0.08590001612901688, + "rms": 0.08591046184301376, + "max_abs": 2.046875 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3845a664d4654d8622af3183546fa1220955445321024cf065b452af5cd30210", + "mean": -0.0012909455690532923, + "std": 0.08326598256826401, + "rms": 0.08327598869800568, + "max_abs": 2.046875 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b7fc50743ec7c7566ae628d57dd052ea7353d17e9654d687068724544f2d98a2", + "mean": -0.0012459136778488755, + "std": 0.08344011753797531, + "rms": 0.08344941586256027, + "max_abs": 2.046875 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3845a664d4654d8622af3183546fa1220955445321024cf065b452af5cd30210", + "mean": -0.0012909455690532923, + "std": 0.08326598256826401, + "rms": 0.08327598869800568, + "max_abs": 2.046875 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "98d6a219adb949b85ac84b7483dab65e50f821a4bfcd489b36969be692a19e5c", + "mean": -0.0013404391938820481, + "std": 0.08579620718955994, + "rms": 0.08580667525529861, + "max_abs": 2.046875 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 120, + "exact_hidden_rows": 120, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 1.0, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "system_bos": { + "tokens": 120, + "exact_hidden_rows": 120, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 1.0, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "system_x": { + "tokens": 120, + "exact_hidden_rows": 120, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 1.0, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "system_period": { + "tokens": 120, + "exact_hidden_rows": 120, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 1.0, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "bos_at_s0": { + "tokens": 120, + "exact_hidden_rows": 120, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 1.0, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "bos_at_s1": { + "tokens": 120, + "exact_hidden_rows": 120, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 1.0, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "x_at_s0": { + "tokens": 120, + "exact_hidden_rows": 120, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 1.0, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "x_at_s1": { + "tokens": 120, + "exact_hidden_rows": 120, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 1.0, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "period_at_s0": { + "tokens": 120, + "exact_hidden_rows": 120, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 1.0, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "period_at_s1": { + "tokens": 120, + "exact_hidden_rows": 120, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 1.0, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + } + } + }, + "layer_00": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "15c21d9b009f619bd26b96022ad93c10c86d50160db378449aa49c113d515d84", + "mean": -0.0016820330638438463, + "std": 0.0797344446182251, + "rms": 0.07975218445062637, + "max_abs": 2.375 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cf0b47defd84f75281ff4e18b648e301494a3743a8e612571bcc119a521c57b9", + "mean": -0.0016602742252871394, + "std": 0.08149036020040512, + "rms": 0.08150726556777954, + "max_abs": 2.4375 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4cf7251e1e338f74d91dca009f5566dcacd1126e98a35423682dd663119c9a9e", + "mean": -0.0016525754472240806, + "std": 0.07969988137483597, + "rms": 0.0797170102596283, + "max_abs": 2.40625 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2e4a49025bc02c10f748e73844a08f6f957a59c3b28486d0bcf5efbde9d457b5", + "mean": -0.0017032906180247664, + "std": 0.0832597091794014, + "rms": 0.083277128636837, + "max_abs": 2.4375 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f74c776392e3807c77227cb4f6656971621f3a30852538b6728672fede45b64c", + "mean": -0.0016710192430764437, + "std": 0.07977340370416641, + "rms": 0.07979089766740799, + "max_abs": 2.34375 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "641a14e75ed0af4d881aa382d6a0706f0ad871b3daba535930a0f78d51b14a65", + "mean": -0.0016373785911127925, + "std": 0.08129408955574036, + "rms": 0.08131057769060135, + "max_abs": 2.4375 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5726d9ff082e27b817c1b477167df3eb75cfb9dfd639ba057ebea39d90bb16f5", + "mean": -0.0016509669367223978, + "std": 0.07946538925170898, + "rms": 0.0794825330376625, + "max_abs": 2.328125 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "559bff6eac24d183ccc17e2896bc485bbee5b03ab6fe295fd41d7ec6a5de4070", + "mean": -0.0016898286994546652, + "std": 0.08288838714361191, + "rms": 0.082905612885952, + "max_abs": 2.4375 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fc8f0471f82b53d7a098ec0a77ab3413bd8f708ade2a67317d2ae6adfd7240e6", + "mean": -0.0016903626965358853, + "std": 0.0792163833975792, + "rms": 0.07923441380262375, + "max_abs": 2.328125 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "78b1192f051f6720502c976c00aa0ec5b5baa720d6c0c5a6a20c46037b55f43a", + "mean": -0.0016695386730134487, + "std": 0.08095725625753403, + "rms": 0.08097446709871292, + "max_abs": 2.4375 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "03f65b4a28f32ce1dbcfe3cab123e2ba9b27771d7742f8a7afa9e8f3674e1017", + "mean": -0.0016690022312104702, + "std": 0.07902012765407562, + "rms": 0.07903774827718735, + "max_abs": 2.3125 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "82f29b6188aa8d32122e4046099b8944af0ad1fe64841e6a7a919c9e4ab1a06f", + "mean": -0.0017205380136147141, + "std": 0.08268982172012329, + "rms": 0.0827077180147171, + "max_abs": 2.4375 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1ca6da8e4e81cb066b14dcdf58d4fc0f46fbe1dd64f987ab3f0574b6d2be6827", + "mean": -0.0016874190187081695, + "std": 0.07916779816150665, + "rms": 0.07918577641248703, + "max_abs": 2.3125 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4074ba049fc45a5a46aa730e90f6e22c4cc854131ba8a27dc04c83442fa5f3a4", + "mean": -0.0016667996533215046, + "std": 0.08073487132787704, + "rms": 0.08075207471847534, + "max_abs": 2.4375 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a99b31d54966577b0f4af511362c821eea95471dc9ac1050f0b51fdf663787b9", + "mean": -0.0016679217806085944, + "std": 0.07899153977632523, + "rms": 0.07900915294885635, + "max_abs": 2.3125 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "138d7cb4f554f77ef9c28f8164ced61572f32b9aed255b9b488dbb66b579cfcc", + "mean": -0.0017176688415929675, + "std": 0.08249164372682571, + "rms": 0.08250952512025833, + "max_abs": 2.4375 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9992483258247375, + "min_cosine_similarity": 0.9929951429367065, + "mean_relative_l2": 0.035730574280023575, + "max_abs_delta": 0.09375 + }, + "system_bos": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9989762902259827, + "min_cosine_similarity": 0.9856452345848083, + "mean_relative_l2": 0.040046218782663345, + "max_abs_delta": 0.109375 + }, + "system_x": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9990232586860657, + "min_cosine_similarity": 0.9861058592796326, + "mean_relative_l2": 0.03913084790110588, + "max_abs_delta": 0.0859375 + }, + "system_period": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9990537762641907, + "min_cosine_similarity": 0.9867596626281738, + "mean_relative_l2": 0.038613203912973404, + "max_abs_delta": 0.09375 + }, + "bos_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9914141297340393, + "min_cosine_similarity": 0.9366371035575867, + "mean_relative_l2": 0.12362813204526901, + "max_abs_delta": 0.17236328125 + }, + "bos_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9921147227287292, + "min_cosine_similarity": 0.9471429586410522, + "mean_relative_l2": 0.11935839802026749, + "max_abs_delta": 0.174560546875 + }, + "x_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9921921491622925, + "min_cosine_similarity": 0.9400553703308105, + "mean_relative_l2": 0.1168542131781578, + "max_abs_delta": 0.169921875 + }, + "x_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9926214218139648, + "min_cosine_similarity": 0.9498739242553711, + "mean_relative_l2": 0.11483903229236603, + "max_abs_delta": 0.1884765625 + }, + "period_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9923182129859924, + "min_cosine_similarity": 0.9416201114654541, + "mean_relative_l2": 0.11612545698881149, + "max_abs_delta": 0.1728515625 + }, + "period_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9926905035972595, + "min_cosine_similarity": 0.9503762722015381, + "mean_relative_l2": 0.11442249268293381, + "max_abs_delta": 0.1923828125 + } + } + }, + "layer_01": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "167ba8c71903d071832fb96287ff206969941e67523c8f01294ba90a6b3c30b1", + "mean": -0.0021684952080249786, + "std": 0.09699582308530807, + "rms": 0.09702005237340927, + "max_abs": 2.71875 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "26088c17342f798fc6bd4ee762315c0ee16673e562cbba84ab964eb73b537021", + "mean": -0.004024218302220106, + "std": 0.6682177186012268, + "rms": 0.6682298183441162, + "max_abs": 126.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9f6c7f4fcf75abf601b379fdb92022cecb348f46b632d31ba7287e0ccb3c6cd1", + "mean": -0.00212763505987823, + "std": 0.09707726538181305, + "rms": 0.09710057824850082, + "max_abs": 2.703125 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a549c6c74b87c33be75a6f4394bab39ab17504ddec44784b48d020957bb5036e", + "mean": -0.004017171449959278, + "std": 0.6560381650924683, + "rms": 0.6560505032539368, + "max_abs": 134.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "59cd576d9c372dcd3e42b71b737cd5a83d5645795e9f1e7b0f090d9b07bf90ab", + "mean": -0.0023029446601867676, + "std": 0.09653103351593018, + "rms": 0.09655849635601044, + "max_abs": 2.703125 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c07f83e07098361bc7ade6828b8d741ae3e6415efac5ac4ad67dbc1448e58c16", + "mean": -0.0021613857243210077, + "std": 0.10005394369363785, + "rms": 0.10007727891206741, + "max_abs": 4.71875 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bf6d23a9a878a9960266654904ea5167a016b71dd958544bc9e995e95740a3a1", + "mean": -0.0023097991943359375, + "std": 0.09536660462617874, + "rms": 0.0953945741057396, + "max_abs": 2.6875 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d3c39f09148a173d08e3802596f0cc18cc323d67b1d3da0f3014efa0b99e1a57", + "mean": -0.0022831251844763756, + "std": 0.10060692578554153, + "rms": 0.10063283145427704, + "max_abs": 4.71875 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a308532b3a9d286d2a5d05a70e3386616fc5696ac90210febcc128ca2fab1ab4", + "mean": -0.0022976661566644907, + "std": 0.09631709009408951, + "rms": 0.0963444858789444, + "max_abs": 2.71875 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1687f377695c027b178de7ed4a5fdb315b7cc7d023779dfade70789d9a638a79", + "mean": -0.0021630714181810617, + "std": 0.09992902725934982, + "rms": 0.09995243698358536, + "max_abs": 4.71875 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "42b27bcf363cf60a7647359f6d9d11151508a81a13bbc915ddf6820df92c4633", + "mean": -0.0022935091983526945, + "std": 0.09493054449558258, + "rms": 0.09495824575424194, + "max_abs": 2.6875 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f58ea9ba71c480180d965df162a7411e4cff98ef654e3f575b5b8bcaaa324577", + "mean": -0.0022787905763834715, + "std": 0.10034747421741486, + "rms": 0.10037334263324738, + "max_abs": 4.71875 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e19b8a57e65fdcce86ad9b70efea77be83d3f709f9d77fb52c5176c86d099596", + "mean": -0.0022950475104153156, + "std": 0.0962827205657959, + "rms": 0.0963100716471672, + "max_abs": 2.71875 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b1f50c0c4247637a2663fef3fe7433e76e5192ce1e6557eefc3c3263fa378a0c", + "mean": -0.002173067070543766, + "std": 0.09964649379253387, + "rms": 0.09967019408941269, + "max_abs": 4.71875 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3ab80f78b00b163d04da826f714472c8590b7e440e25b63ac35401f363f56c15", + "mean": -0.002295458922162652, + "std": 0.09492278099060059, + "rms": 0.09495052695274353, + "max_abs": 2.6875 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c235fb005b1f0306f7a4e9e0d7656ac58d8223fa581b0c577eabe21e5bc0c0c4", + "mean": -0.00228905794210732, + "std": 0.10012279450893402, + "rms": 0.10014896839857101, + "max_abs": 4.71875 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9986873865127563, + "min_cosine_similarity": 0.9894051551818848, + "mean_relative_l2": 0.04747851938009262, + "max_abs_delta": 0.0859375 + }, + "system_bos": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9972884058952332, + "min_cosine_similarity": 0.9788113236427307, + "mean_relative_l2": 0.06783948838710785, + "max_abs_delta": 0.14453125 + }, + "system_x": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9964033365249634, + "min_cosine_similarity": 0.9702984094619751, + "mean_relative_l2": 0.07596849650144577, + "max_abs_delta": 0.15625 + }, + "system_period": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.996476411819458, + "min_cosine_similarity": 0.9710217714309692, + "mean_relative_l2": 0.07541251927614212, + "max_abs_delta": 0.140625 + }, + "bos_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9905058741569519, + "min_cosine_similarity": 0.909178614616394, + "mean_relative_l2": 0.1300259381532669, + "max_abs_delta": 0.25390625 + }, + "bos_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9900594353675842, + "min_cosine_similarity": 0.9189020991325378, + "mean_relative_l2": 0.13394632935523987, + "max_abs_delta": 0.279296875 + }, + "x_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9909786581993103, + "min_cosine_similarity": 0.9034520387649536, + "mean_relative_l2": 0.12541528046131134, + "max_abs_delta": 0.33203125 + }, + "x_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9895553588867188, + "min_cosine_similarity": 0.9092744588851929, + "mean_relative_l2": 0.13586236536502838, + "max_abs_delta": 0.359375 + }, + "period_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9911417365074158, + "min_cosine_similarity": 0.9059762954711914, + "mean_relative_l2": 0.12451892346143723, + "max_abs_delta": 0.330078125 + }, + "period_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9896435141563416, + "min_cosine_similarity": 0.9081955552101135, + "mean_relative_l2": 0.1354791522026062, + "max_abs_delta": 0.34765625 + } + } + }, + "layer_02": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4ef71fe712fe6779e0533c466969940fa620df2190da671ac6b63040e356fc39", + "mean": -0.0015112865949049592, + "std": 0.11932197958230972, + "rms": 0.11933154612779617, + "max_abs": 3.6875 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8d8ff5b2880efaad616dd2ddfc0e3de52bad8c6a25ef3d6561f492d61bfad6c6", + "mean": -0.008008434437215328, + "std": 1.9945392608642578, + "rms": 1.9945552349090576, + "max_abs": 392.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1de9de822499a32f051b59143a3d39d7c10cca631fa5b6c048e21f2a5b7c82e4", + "mean": -0.0014224350452423096, + "std": 0.11890735477209091, + "rms": 0.118915855884552, + "max_abs": 3.59375 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "232079464d920bdaf4c9c0c9b9b18f24fa87258c701e86751462aecd354e8b37", + "mean": -0.008439896628260612, + "std": 2.1007487773895264, + "rms": 2.1007657051086426, + "max_abs": 436.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "003d2f2153f038e3d80a9a33e8f10228c2b847d44608f170793359b65aa959e8", + "mean": -0.0014955014921724796, + "std": 0.11837651580572128, + "rms": 0.11838596314191818, + "max_abs": 3.59375 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "75bddc76ec2d4eb332c9fe01bc187baf693c130346b6f1b70a02b37db0ec3792", + "mean": -0.0017043573316186666, + "std": 0.1815520077943802, + "rms": 0.18156000971794128, + "max_abs": 23.875 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4e87ec8ad06f61097cf89b58002c6727e40c4094ffd3766f306286f8a5564fa6", + "mean": -0.001330459606833756, + "std": 0.11720770597457886, + "rms": 0.11721525341272354, + "max_abs": 3.5 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5e41851a52952bc97b55aa427b2ce00756dd47eaf8ea55ab86b6d65efc2e093b", + "mean": -0.0016447032103314996, + "std": 0.17673099040985107, + "rms": 0.1767386496067047, + "max_abs": 23.875 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1fbc236aa6ce2918f068ab05ace9f15e3f4b877967c2cae05e01819035d1d311", + "mean": -0.0015288032591342926, + "std": 0.11767539381980896, + "rms": 0.11768531799316406, + "max_abs": 3.59375 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f91ea15e9a630b9def0d60eb67a8f07b28894a2ee4593bbaea19a12cbc7b3621", + "mean": -0.0017384202219545841, + "std": 0.18124587833881378, + "rms": 0.18125420808792114, + "max_abs": 23.875 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "493331d0aac3f474d4f85ed85b98fad6adaf18f57ceba100e29dbe0c39954d6f", + "mean": -0.0012920259032398462, + "std": 0.11640763282775879, + "rms": 0.11641480773687363, + "max_abs": 3.5 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3eca8e2ca8e145c72f7e21429f39b68ece6d31f79b703e5b62b7d37697dc7eb1", + "mean": -0.001620989409275353, + "std": 0.17639562487602234, + "rms": 0.17640307545661926, + "max_abs": 23.875 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ff6078d5fcb4bd851a7f4e893f96b41065ebaf288d563954b02c22c3dab14e74", + "mean": -0.0015012604417279363, + "std": 0.11757352948188782, + "rms": 0.11758311837911606, + "max_abs": 3.59375 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e3ac301b0ece0056f715a5bfe7a7ea4bf8a54e7c6f9c8566106a11848b004904", + "mean": -0.0017571097705513239, + "std": 0.1808808296918869, + "rms": 0.18088935315608978, + "max_abs": 23.875 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2a919c175e2dc56c838f3e111f66d77f829589845f18e82225eb8475cbf2b639", + "mean": -0.0012780845863744617, + "std": 0.1163748949766159, + "rms": 0.11638191342353821, + "max_abs": 3.5 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7e8189bbec53c749296e96dd28e231a5f567bd6225f2159792110de60d4c58fe", + "mean": -0.0016382408794015646, + "std": 0.1761268824338913, + "rms": 0.17613449692726135, + "max_abs": 23.875 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9983824491500854, + "min_cosine_similarity": 0.9869985580444336, + "mean_relative_l2": 0.05242134630680084, + "max_abs_delta": 0.1796875 + }, + "system_bos": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9966427087783813, + "min_cosine_similarity": 0.9732140898704529, + "mean_relative_l2": 0.0753265842795372, + "max_abs_delta": 0.234375 + }, + "system_x": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9953991174697876, + "min_cosine_similarity": 0.9647147059440613, + "mean_relative_l2": 0.08579857647418976, + "max_abs_delta": 0.34375 + }, + "system_period": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9954801201820374, + "min_cosine_similarity": 0.9630662798881531, + "mean_relative_l2": 0.08483520150184631, + "max_abs_delta": 0.3125 + }, + "bos_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9900804162025452, + "min_cosine_similarity": 0.8782408833503723, + "mean_relative_l2": 0.13223302364349365, + "max_abs_delta": 0.4296875 + }, + "bos_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9889125227928162, + "min_cosine_similarity": 0.8736003041267395, + "mean_relative_l2": 0.13947652280330658, + "max_abs_delta": 0.46484375 + }, + "x_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9895575046539307, + "min_cosine_similarity": 0.8481448888778687, + "mean_relative_l2": 0.1330052614212036, + "max_abs_delta": 0.5390625 + }, + "x_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9873100519180298, + "min_cosine_similarity": 0.833305835723877, + "mean_relative_l2": 0.1460101306438446, + "max_abs_delta": 0.5859375 + }, + "period_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9896276593208313, + "min_cosine_similarity": 0.8513838648796082, + "mean_relative_l2": 0.1332479566335678, + "max_abs_delta": 0.51953125 + }, + "period_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9873992204666138, + "min_cosine_similarity": 0.8320517539978027, + "mean_relative_l2": 0.1459140181541443, + "max_abs_delta": 0.5703125 + } + } + }, + "layer_03": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "99870ab3dae5d7abaf1a5fd92b831c33f566cdecfa83eece566be9f4a22a7770", + "mean": -0.0029331555124372244, + "std": 0.1463044434785843, + "rms": 0.14633384346961975, + "max_abs": 4.375 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c0fb7be51e90f85c5c2d7e4d672dc08ba6648b04a066d8bf300d467560ca4436", + "mean": -0.01144284289330244, + "std": 5.982513904571533, + "rms": 5.982524394989014, + "max_abs": 1136.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3bd64f3e27baa562d2b4a48d56443df3aa5f3110d5628fa6294a856dd3a52468", + "mean": -0.0028811548836529255, + "std": 0.146468386054039, + "rms": 0.1464967280626297, + "max_abs": 4.3125 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b7d5ff0897b0d95952c5c1e5ffab5d48683d330a740ed07690378f6c44989117", + "mean": -0.011804340407252312, + "std": 5.867950439453125, + "rms": 5.86796236038208, + "max_abs": 1136.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "143cb99f3bec82a26f783d34ccb28ad4f7fb156c7c04919409e9bf69d7396762", + "mean": -0.0029335517901927233, + "std": 0.1470070630311966, + "rms": 0.1470363289117813, + "max_abs": 4.4375 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "616708947bff129c2b69ad39da05f7f715cabc82d63c441b6f18dca3624c4aa1", + "mean": -0.004449775908142328, + "std": 5.336119174957275, + "rms": 5.336121082305908, + "max_abs": 1136.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "90580348c18643db971e88090972f6955ba3194c82f098d73fdd5a512cecca23", + "mean": -0.00294232415035367, + "std": 0.1462358683347702, + "rms": 0.14626547694206238, + "max_abs": 4.4375 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8e4ac915a5de453e2b8d075e27db1d93892b3182ab7904a6798a27525a50752b", + "mean": -0.004388304427266121, + "std": 5.0642409324646, + "rms": 5.064242839813232, + "max_abs": 1136.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2e4dbb932c9394e81b0f5097bc4f3b3970b78cec27e8aa42f2a6c5733542f09a", + "mean": -0.002977705094963312, + "std": 0.14568249881267548, + "rms": 0.1457129269838333, + "max_abs": 4.4375 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5374bd4840ee112888274ef63f4145160c5f69f1998f7da0171dd4f3a424a517", + "mean": -0.004526025149971247, + "std": 5.3360795974731445, + "rms": 5.336081504821777, + "max_abs": 1136.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1e0199da51c750232d9f6b90fe55741142d969e495eb2a0f49f35ca01612464c", + "mean": -0.002967537846416235, + "std": 0.14517690241336823, + "rms": 0.1452072411775589, + "max_abs": 4.4375 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3ccc5d7651ba3a8e80fb62a4ca3a2148df747fced177a0caf6311cfe19c2b492", + "mean": -0.00444272393360734, + "std": 5.064211368560791, + "rms": 5.064213752746582, + "max_abs": 1136.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "767cb75e5ba73cdf44900f0860df2dce914e1c8cae5584a3c7daaaa669f1c2a6", + "mean": -0.0029298460576683283, + "std": 0.14549694955348969, + "rms": 0.1455264538526535, + "max_abs": 4.4375 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ccd980dd49e5c6106e669927a5879c992ae499d1404306b1d8e50236fb86b25e", + "mean": -0.004491766449064016, + "std": 5.336068153381348, + "rms": 5.3360700607299805, + "max_abs": 1136.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "32cf3621f5499ef3389fed7726fbda45b453c3b15975e4ab937af4a91ff2dcb9", + "mean": -0.0029534564819186926, + "std": 0.14504902064800262, + "rms": 0.14507907629013062, + "max_abs": 4.4375 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "37b545a5457daec1bc653482fd642ac2770a3d4e15c9e7c67ad818a9c52c30fd", + "mean": -0.004436850547790527, + "std": 5.064201831817627, + "rms": 5.064204216003418, + "max_abs": 1136.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9983382821083069, + "min_cosine_similarity": 0.9837749004364014, + "mean_relative_l2": 0.05254834517836571, + "max_abs_delta": 0.1875 + }, + "system_bos": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9962104558944702, + "min_cosine_similarity": 0.9717061519622803, + "mean_relative_l2": 0.08078669011592865, + "max_abs_delta": 0.34375 + }, + "system_x": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.994558572769165, + "min_cosine_similarity": 0.9593248963356018, + "mean_relative_l2": 0.09386425465345383, + "max_abs_delta": 0.328125 + }, + "system_period": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.994634211063385, + "min_cosine_similarity": 0.9546582698822021, + "mean_relative_l2": 0.09287472814321518, + "max_abs_delta": 0.328125 + }, + "bos_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9909064769744873, + "min_cosine_similarity": 0.8843817710876465, + "mean_relative_l2": 0.12681564688682556, + "max_abs_delta": 0.4296875 + }, + "bos_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9893776774406433, + "min_cosine_similarity": 0.8797323107719421, + "mean_relative_l2": 0.135874405503273, + "max_abs_delta": 0.421875 + }, + "x_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9898075461387634, + "min_cosine_similarity": 0.8440771102905273, + "mean_relative_l2": 0.13030362129211426, + "max_abs_delta": 0.5625 + }, + "x_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9871000051498413, + "min_cosine_similarity": 0.8241028189659119, + "mean_relative_l2": 0.14482077956199646, + "max_abs_delta": 0.5546875 + }, + "period_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9899259209632874, + "min_cosine_similarity": 0.841137170791626, + "mean_relative_l2": 0.12939852476119995, + "max_abs_delta": 0.5546875 + }, + "period_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9868047833442688, + "min_cosine_similarity": 0.7981420755386353, + "mean_relative_l2": 0.1456574648618698, + "max_abs_delta": 0.515625 + } + } + }, + "layer_04": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0816d13e3ab8e2b6ad2f4bb90b828634a75319f83794a54de83e55a992aadf68", + "mean": -0.0033295631874352694, + "std": 0.1845930814743042, + "rms": 0.1846231073141098, + "max_abs": 5.4375 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e99b80d197ab14919003638c352cc3c13447ed7d1a1b350f042cc60fd701b338", + "mean": -0.01165094692260027, + "std": 6.24328088760376, + "rms": 6.243291854858398, + "max_abs": 1152.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7ef0fb078b987fbab3b5f6e3d36f5b6d868f296780867679a52061c1407926ed", + "mean": -0.0032741292379796505, + "std": 0.18494731187820435, + "rms": 0.18497627973556519, + "max_abs": 5.4375 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8445e6c402bf724aa3f2828e0203ff6ac898757a696dc69c1127d153c63f5b9b", + "mean": -0.012004503980278969, + "std": 6.107608795166016, + "rms": 6.1076202392578125, + "max_abs": 1152.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "82540aba4e1686c1236399b610bc5558083b8dc617df93200392b2402bff3c26", + "mean": -0.003215335076674819, + "std": 0.18667247891426086, + "rms": 0.18670016527175903, + "max_abs": 5.71875 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "30ad9cbdc38903e1e8f9d4a3e4a5437510eb7cf25be0df8a0c8734107ea7a2eb", + "mean": -0.004570687189698219, + "std": 5.5976738929748535, + "rms": 5.597675323486328, + "max_abs": 1152.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5a1d9f72182fe099c0d785a5f7e725d44b4702663717e4f0ae3149e794bd0eca", + "mean": -0.0032344588544219732, + "std": 0.18601073324680328, + "rms": 0.18603885173797607, + "max_abs": 5.6875 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3e2ff228ba4a7370784d5b8a7a44ea757b9e703738175e85a06158907b444069", + "mean": -0.004514893051236868, + "std": 5.3069891929626465, + "rms": 5.306991100311279, + "max_abs": 1152.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fcd2770a25e5a0a7f219636fdf9b3911b24e5f70f6208818ed7082e4cc388d2c", + "mean": -0.003151817014440894, + "std": 0.1854095160961151, + "rms": 0.18543630838394165, + "max_abs": 5.625 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5742e822233c16d4fdfd69dc5e4da7729b135c03c807343c95af0fde951bad25", + "mean": -0.004500248469412327, + "std": 5.5976176261901855, + "rms": 5.597619533538818, + "max_abs": 1152.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "30cf4f4557658d646d069641c1937978e60821f7a9f16dff0d1f6adec6de035c", + "mean": -0.0031878273002803326, + "std": 0.1845896989107132, + "rms": 0.18461723625659943, + "max_abs": 5.5 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7e975604300a10c85f59c0b6e6e997de01573a414c46aaed162042deef413fbd", + "mean": -0.004471927881240845, + "std": 5.3069305419921875, + "rms": 5.30693244934082, + "max_abs": 1152.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d529d1d967872df68723cf5f95ee3ca031423a0ff40d1dfb9f05c02ab9347444", + "mean": -0.003083505667746067, + "std": 0.1847812682390213, + "rms": 0.18480698764324188, + "max_abs": 5.625 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6fbb829723d2251ce55b5dbf2df96d4e616e46d90caba8a06681c15974fec8f3", + "mean": -0.004448816180229187, + "std": 5.597592353820801, + "rms": 5.597593784332275, + "max_abs": 1152.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "15df0af4ffe61fea496bcec14790a67280a0bf3d55ff6a92b5b6911c9e7ec24d", + "mean": -0.0031507345847785473, + "std": 0.18431010842323303, + "rms": 0.18433703482151031, + "max_abs": 5.46875 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "82496f24348552b0ca5ed7935e8c1424094a49d69892cbd66ec36e1506fdf308", + "mean": -0.004443534649908543, + "std": 5.306915283203125, + "rms": 5.306917190551758, + "max_abs": 1152.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9984533190727234, + "min_cosine_similarity": 0.984213650226593, + "mean_relative_l2": 0.05091942101716995, + "max_abs_delta": 0.1875 + }, + "system_bos": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9967383742332458, + "min_cosine_similarity": 0.9785153865814209, + "mean_relative_l2": 0.07553013414144516, + "max_abs_delta": 0.34375 + }, + "system_x": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9951408505439758, + "min_cosine_similarity": 0.9677678346633911, + "mean_relative_l2": 0.08929914981126785, + "max_abs_delta": 0.5 + }, + "system_period": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9950330257415771, + "min_cosine_similarity": 0.9638199210166931, + "mean_relative_l2": 0.0902729332447052, + "max_abs_delta": 0.46875 + }, + "bos_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9926145672798157, + "min_cosine_similarity": 0.8759467005729675, + "mean_relative_l2": 0.11384370177984238, + "max_abs_delta": 0.515625 + }, + "bos_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9913760423660278, + "min_cosine_similarity": 0.8738834261894226, + "mean_relative_l2": 0.1225535124540329, + "max_abs_delta": 0.625 + }, + "x_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9911342263221741, + "min_cosine_similarity": 0.8396112322807312, + "mean_relative_l2": 0.11984379589557648, + "max_abs_delta": 0.67578125 + }, + "x_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9886510372161865, + "min_cosine_similarity": 0.8222019672393799, + "mean_relative_l2": 0.135391965508461, + "max_abs_delta": 0.728515625 + }, + "period_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9910775423049927, + "min_cosine_similarity": 0.8321256637573242, + "mean_relative_l2": 0.119382344186306, + "max_abs_delta": 0.6728515625 + }, + "period_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9884218573570251, + "min_cosine_similarity": 0.811373770236969, + "mean_relative_l2": 0.13613420724868774, + "max_abs_delta": 0.7734375 + } + } + }, + "layer_05": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "83da5bf29a0f3a187aae4d498b6555f1fc77fede12758c00cc529c15165f5bae", + "mean": -0.0033702708315104246, + "std": 0.2114109843969345, + "rms": 0.2114378660917282, + "max_abs": 5.75 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ce5dc6e1ca0fef504b92f62e850925016fccb83b5a4e84b5ec2b73204ef67e1f", + "mean": -0.012672778218984604, + "std": 6.4335222244262695, + "rms": 6.433535099029541, + "max_abs": 1152.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cf818f0bc56351b5c514094d59d3b31248c3edb3747cff71052d6fb5c5f06ca3", + "mean": -0.003442069748416543, + "std": 0.21178632974624634, + "rms": 0.2118142992258072, + "max_abs": 5.75 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "891e6b0b6e18581ce2f095b6a4212047d7e098d8f0541b618d1603922f82a6a5", + "mean": -0.012940763495862484, + "std": 6.296599388122559, + "rms": 6.296612739562988, + "max_abs": 1152.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "edd06449b4c80ed4c929c81366d13e2b8de5fcfa325ba1985d92681690933732", + "mean": -0.003251973306760192, + "std": 0.21399691700935364, + "rms": 0.21402162313461304, + "max_abs": 5.8125 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8831a3dda3139c12fbcbb085b498742fa5392275452d57f3d6b5f4e2756c9416", + "mean": -0.004875590559095144, + "std": 5.69593620300293, + "rms": 5.695937633514404, + "max_abs": 1152.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1b6e1ecca875b112dc11b31e703bbbbea8b060b8ad2be263588bb6c34036bb0c", + "mean": -0.003374494146555662, + "std": 0.21309195458889008, + "rms": 0.21311867237091064, + "max_abs": 5.875 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "dfd9c97d7f34a5921565ea9b24d71e476efc942b6f4d99508d0664fa6aa855c2", + "mean": -0.004779654089361429, + "std": 5.399733066558838, + "rms": 5.399735450744629, + "max_abs": 1152.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cb16e8bf12fdb74aecc3962b28e80c1f308c1525088941d5a80d1092436e5fd5", + "mean": -0.003246534848585725, + "std": 0.21264909207820892, + "rms": 0.2126738578081131, + "max_abs": 5.875 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "69ade89f4642f151f9e2d7d00a4374a2619ac2520414f8ea746e6d2b34e003c9", + "mean": -0.0048303199000656605, + "std": 5.69587516784668, + "rms": 5.695876598358154, + "max_abs": 1152.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ca251aca24ee9e2333d2d1acbd89a1b919871d0502064e79880d33b131aa9eea", + "mean": -0.0034454097039997578, + "std": 0.21114054322242737, + "rms": 0.21116864681243896, + "max_abs": 5.9375 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7bda296adca246e2bf403b7056fc6b55ab6f7bb744ca150b731255f34c2a9143", + "mean": -0.004809088539332151, + "std": 5.399654388427734, + "rms": 5.399656295776367, + "max_abs": 1152.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1ad4deeb3a6a2101ae5da0f93ceb354e83fc0e0c0dc72a81f634e967d48f45de", + "mean": -0.0032046628184616566, + "std": 0.2123245894908905, + "rms": 0.21234877407550812, + "max_abs": 5.875 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "23b71c68e1ff6657120f2bb1f09f6c42c847d7bc8515a1a831f8196bdd518d20", + "mean": -0.004798743408173323, + "std": 5.695852279663086, + "rms": 5.695855140686035, + "max_abs": 1152.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5a959f26729b5e106254ec8ad43318f81619a8b1ec740a9603ddfe48b3998615", + "mean": -0.0034323828294873238, + "std": 0.2110147327184677, + "rms": 0.2110426425933838, + "max_abs": 5.875 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9fa1005d3b18d4b476a8c9d42ae09ed674ba58f7a93262afe6c5884acda8a1b4", + "mean": -0.004818226210772991, + "std": 5.3996405601501465, + "rms": 5.399642467498779, + "max_abs": 1152.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9978424310684204, + "min_cosine_similarity": 0.9735069274902344, + "mean_relative_l2": 0.05855262279510498, + "max_abs_delta": 0.171875 + }, + "system_bos": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9960113763809204, + "min_cosine_similarity": 0.974254846572876, + "mean_relative_l2": 0.08350419998168945, + "max_abs_delta": 0.2578125 + }, + "system_x": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9937772154808044, + "min_cosine_similarity": 0.9529705047607422, + "mean_relative_l2": 0.10182496160268784, + "max_abs_delta": 0.375 + }, + "system_period": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9935774207115173, + "min_cosine_similarity": 0.9511950612068176, + "mean_relative_l2": 0.10300026834011078, + "max_abs_delta": 0.390625 + }, + "bos_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9913778305053711, + "min_cosine_similarity": 0.8462784886360168, + "mean_relative_l2": 0.1211610808968544, + "max_abs_delta": 0.59375 + }, + "bos_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9901214241981506, + "min_cosine_similarity": 0.8403997421264648, + "mean_relative_l2": 0.1293526291847229, + "max_abs_delta": 0.6748046875 + }, + "x_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9897411465644836, + "min_cosine_similarity": 0.7938816547393799, + "mean_relative_l2": 0.1265544444322586, + "max_abs_delta": 0.78515625 + }, + "x_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9867379665374756, + "min_cosine_similarity": 0.7783113718032837, + "mean_relative_l2": 0.1446571797132492, + "max_abs_delta": 0.8857421875 + }, + "period_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9896782636642456, + "min_cosine_similarity": 0.7934666872024536, + "mean_relative_l2": 0.12641015648841858, + "max_abs_delta": 0.7734375 + }, + "period_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9863797426223755, + "min_cosine_similarity": 0.7635275721549988, + "mean_relative_l2": 0.14570672810077667, + "max_abs_delta": 0.9765625 + } + } + }, + "layer_06": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ba714ad817d74bc8cda8ca778d50f2c9fdd60ddcd5f0a0d13ab2822886bae282", + "mean": -0.0054723164066672325, + "std": 0.24953444302082062, + "rms": 0.24959442019462585, + "max_abs": 8.25 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "84ac0fce4ac0df9441b355a35fb7c85fa986da4521a49d3020dd45aca2a57144", + "mean": -0.014895536005496979, + "std": 6.551529407501221, + "rms": 6.5515456199646, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8bc30689b1459536555c7f04c57fb633468fab36b8f71ba1b2d55029680ca0b0", + "mean": -0.005571234505623579, + "std": 0.24949853122234344, + "rms": 0.24956072866916656, + "max_abs": 8.375 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "834e173c287332ba1c5b571d7b45624dfa63d106e360857ed20b2c5634875141", + "mean": -0.01509073842316866, + "std": 6.41166877746582, + "rms": 6.411685943603516, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ab6d9847cb0f0a3140d3521bcd77a85aeb0d5ab543eb4f323e38f00e958d9861", + "mean": -0.005127900745719671, + "std": 0.2511013150215149, + "rms": 0.2511536777019501, + "max_abs": 8.25 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "711d516a23dd523ea946ec25a75bf28f171572c7559a467d808561a265e8f8df", + "mean": -0.006733199581503868, + "std": 5.7882513999938965, + "rms": 5.78825569152832, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "426499fe516621b766703b8ef0bbd8df52e771bb1980140850d23b54a9eae6ab", + "mean": -0.005171023774892092, + "std": 0.24954044818878174, + "rms": 0.24959401786327362, + "max_abs": 8.5 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f65d044ce1de5246f6db686ecc70cb2500dcd30c8e0e31e350d19c02c4a178a5", + "mean": -0.0064871590584516525, + "std": 5.487412452697754, + "rms": 5.4874162673950195, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2fa13682adb84268d03fcf08ee14798b884047f11a036528500f33f774a6d222", + "mean": -0.005162886809557676, + "std": 0.2506379187107086, + "rms": 0.25069108605384827, + "max_abs": 8.375 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e455d8c4acdc70cc4965637eae713a7dc65a95c236ba5eb1891a38ecfa316b56", + "mean": -0.006676794029772282, + "std": 5.78821325302124, + "rms": 5.788217067718506, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e68e81ce1f2eb8248655768a43f19378d36a21daac0fe098dcf11db2c516a6e4", + "mean": -0.005214550998061895, + "std": 0.24742262065410614, + "rms": 0.24747756123542786, + "max_abs": 8.5 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a9d7c5579207d18490597c75835c6c143a921945e19abd04a14b9abde7e62637", + "mean": -0.006441834382712841, + "std": 5.487313270568848, + "rms": 5.487317085266113, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d20ecc4788df8db39ca5167804ce6ac1825f59cd3f505e14c03647528e8194df", + "mean": -0.005129902623593807, + "std": 0.2503950893878937, + "rms": 0.2504476308822632, + "max_abs": 8.375 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "450cbe9a857854f87133cf3ca0f0616ee0d1227f08409cbf1d68ee6f867f06eb", + "mean": -0.006631798110902309, + "std": 5.7881975173950195, + "rms": 5.788201332092285, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2f83382c2f5f941f346d204972e714736daa317bd0442eb7be8565732fc7b0eb", + "mean": -0.00523013761267066, + "std": 0.24731065332889557, + "rms": 0.24736595153808594, + "max_abs": 8.5 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f46685cdf76c352845dbf459376120be53d164e233c154f2add042bfe4497910", + "mean": -0.006468042265623808, + "std": 5.487300872802734, + "rms": 5.487304210662842, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9973993897438049, + "min_cosine_similarity": 0.9695373177528381, + "mean_relative_l2": 0.06388501077890396, + "max_abs_delta": 0.53125 + }, + "system_bos": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9956871271133423, + "min_cosine_similarity": 0.965466320514679, + "mean_relative_l2": 0.08623609691858292, + "max_abs_delta": 0.31640625 + }, + "system_x": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9931804537773132, + "min_cosine_similarity": 0.9415220618247986, + "mean_relative_l2": 0.10615639388561249, + "max_abs_delta": 0.625 + }, + "system_period": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9928277134895325, + "min_cosine_similarity": 0.9331812858581543, + "mean_relative_l2": 0.10833070427179337, + "max_abs_delta": 0.65625 + }, + "bos_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9917548298835754, + "min_cosine_similarity": 0.8513367176055908, + "mean_relative_l2": 0.11621774733066559, + "max_abs_delta": 0.671875 + }, + "bos_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9907488226890564, + "min_cosine_similarity": 0.8468590974807739, + "mean_relative_l2": 0.1229487881064415, + "max_abs_delta": 0.6015625 + }, + "x_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9901201128959656, + "min_cosine_similarity": 0.791101336479187, + "mean_relative_l2": 0.1225411593914032, + "max_abs_delta": 1.0283203125 + }, + "x_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9865378141403198, + "min_cosine_similarity": 0.7635641098022461, + "mean_relative_l2": 0.1436094343662262, + "max_abs_delta": 1.2236328125 + }, + "period_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9897991418838501, + "min_cosine_similarity": 0.7873644828796387, + "mean_relative_l2": 0.12371707707643509, + "max_abs_delta": 1.05859375 + }, + "period_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.985846221446991, + "min_cosine_similarity": 0.7453248500823975, + "mean_relative_l2": 0.1462986320257187, + "max_abs_delta": 1.3095703125 + } + } + }, + "layer_07": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "af18568c92b7445317dc4aa3d322c07cdf8094546d16aed0ddd1d02c4325c69b", + "mean": -0.005410752724856138, + "std": 0.26810064911842346, + "rms": 0.2681552469730377, + "max_abs": 8.0 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cbdcbb43719c8ab2c536adfa5b430dcd0645c3fb260c41608ab50924bfd32e42", + "mean": -0.014837984926998615, + "std": 6.571034908294678, + "rms": 6.571052074432373, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ea1f417b26eb867d87d9b6c60aafec11433c265d1dba0bc1745edc25b0536962", + "mean": -0.005444852635264397, + "std": 0.2681500315666199, + "rms": 0.26820528507232666, + "max_abs": 8.125 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "82c889d0ef5aba9ba76ee4623a6bcb396cdb38a4d565b2af602e5a2c6686b52a", + "mean": -0.015319956466555595, + "std": 6.431061267852783, + "rms": 6.431079864501953, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f4aa6b9c2d41ce0ac7e904480e4c7b3da9025f5a3a4a8d2a98c640f84ffd0765", + "mean": -0.00509340176358819, + "std": 0.26840803027153015, + "rms": 0.268456369638443, + "max_abs": 8.1875 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "20fba4af531b673bace0ade994a8bfb726f87e736362c524e715d30852b9aa95", + "mean": -0.006677522324025631, + "std": 5.7993292808532715, + "rms": 5.799333095550537, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f4417108eb6900a0e9299667a0bc3f93238a51acd52ef7e215900c79ed7aa9ba", + "mean": -0.005143130663782358, + "std": 0.26788055896759033, + "rms": 0.26792994141578674, + "max_abs": 8.5 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f41882ef64e6b55e433f3e005c326ada4e1caa34086883df4533be010d0a6fbb", + "mean": -0.006760559976100922, + "std": 5.498088359832764, + "rms": 5.4980926513671875, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7b1ab580f3d1fbd427463c537f9bf0eca212c0c55bb99e232069cc637913a9c1", + "mean": -0.0052030207589268684, + "std": 0.2677094638347626, + "rms": 0.2677600085735321, + "max_abs": 8.375 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "50ddd6626cc43ec6c27300eef513217e2c85c5ce6ab030d8391046f4401ee08d", + "mean": -0.006788918748497963, + "std": 5.799273490905762, + "rms": 5.799277305603027, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b46413cbc5af02d72b69fac76256eafe35d8a0a3f680d464a32bfdafe67bd8d7", + "mean": -0.005275106523185968, + "std": 0.2666165232658386, + "rms": 0.2666687071323395, + "max_abs": 8.4375 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0412b600a49c8fd1730c3bbe30b5d99c963f21822efa4f4cde00d9bcbc92caab", + "mean": -0.006853817962110043, + "std": 5.49800968170166, + "rms": 5.498014450073242, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9e565f7e007dd05bff44a42c4b69479279784ad1ee61cd3332d187312dc4ac3c", + "mean": -0.005186206661164761, + "std": 0.26802903413772583, + "rms": 0.2680791914463043, + "max_abs": 8.25 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "19d16bd49cd902c7d6073b5bae8a460e025ebdf845563d38657d277ebe3cddc6", + "mean": -0.006679329555481672, + "std": 5.799286365509033, + "rms": 5.799289703369141, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8b8af5a063f93120cb55a321b97e14b45b61cb13bb32454c850f2511f3a5b11d", + "mean": -0.005288091488182545, + "std": 0.26661089062690735, + "rms": 0.2666633427143097, + "max_abs": 8.5 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "97a515ffcb12de73b8ad617b9598e881c5d28fbfefed5b66e739044c6996ed97", + "mean": -0.006807987578213215, + "std": 5.498008728027344, + "rms": 5.498013019561768, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9968546032905579, + "min_cosine_similarity": 0.9607396721839905, + "mean_relative_l2": 0.07050050050020218, + "max_abs_delta": 0.421875 + }, + "system_bos": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9949911236763, + "min_cosine_similarity": 0.9547834396362305, + "mean_relative_l2": 0.09366963058710098, + "max_abs_delta": 0.453125 + }, + "system_x": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9920626878738403, + "min_cosine_similarity": 0.9217228889465332, + "mean_relative_l2": 0.1149388998746872, + "max_abs_delta": 0.625 + }, + "system_period": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9918118119239807, + "min_cosine_similarity": 0.9147390127182007, + "mean_relative_l2": 0.11610782891511917, + "max_abs_delta": 0.515625 + }, + "bos_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9911977052688599, + "min_cosine_similarity": 0.8554590940475464, + "mean_relative_l2": 0.12059303373098373, + "max_abs_delta": 0.724609375 + }, + "bos_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9901471734046936, + "min_cosine_similarity": 0.8522088527679443, + "mean_relative_l2": 0.12755833566188812, + "max_abs_delta": 0.8125 + }, + "x_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9893810749053955, + "min_cosine_similarity": 0.7994749546051025, + "mean_relative_l2": 0.12751545011997223, + "max_abs_delta": 1.171875 + }, + "x_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9856504201889038, + "min_cosine_similarity": 0.7593611478805542, + "mean_relative_l2": 0.15043093264102936, + "max_abs_delta": 1.3994140625 + }, + "period_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9889948964118958, + "min_cosine_similarity": 0.7880645394325256, + "mean_relative_l2": 0.12917488813400269, + "max_abs_delta": 1.125 + }, + "period_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9848023056983948, + "min_cosine_similarity": 0.7435626983642578, + "mean_relative_l2": 0.15364313125610352, + "max_abs_delta": 1.3994140625 + } + } + }, + "layer_08": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3d9213d82919defb9ae5252472523976ce9a08bd819b272447821e3f686b68e2", + "mean": -0.008099418133497238, + "std": 0.3092922866344452, + "rms": 0.3093983232975006, + "max_abs": 8.875 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c97958cdcbbb3a3e44cc5b410003404593cbced3f4cb6ce8cb1344025c49afbd", + "mean": -0.01713102124631405, + "std": 6.594311714172363, + "rms": 6.594334602355957, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "65c1536912e908bd4ce039ac85c9d30b93ed743fd06a586d4a4010d60e7ec47b", + "mean": -0.00805326085537672, + "std": 0.30933961272239685, + "rms": 0.309444397687912, + "max_abs": 8.9375 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b184feafea7a5b4838a560b3c2f64e90593194cf4f53f9701976b2e3338f18d5", + "mean": -0.017161119729280472, + "std": 6.4542083740234375, + "rms": 6.454231262207031, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7d0bb08246d0886efdc0871df019370feb92d4b3e517552ad000644a239fd716", + "mean": -0.00772115821018815, + "std": 0.3101637363433838, + "rms": 0.3102598190307617, + "max_abs": 8.6875 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d067d7fd346a5aa539b90c2322f5512db3caa883f3405cba62a9170353a133ac", + "mean": -0.008947106078267097, + "std": 5.812981605529785, + "rms": 5.812988758087158, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d66b84d129fd8ad70342a3f52b8157a1e2990970592bee0f98cce3c77e66093e", + "mean": -0.007850204594433308, + "std": 0.3095468580722809, + "rms": 0.3096463978290558, + "max_abs": 8.75 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "55c598fb7e85cb68f73aaba0db931756d02196f5b687d38b1f80cf7d6912ce89", + "mean": -0.008726689033210278, + "std": 5.511142730712891, + "rms": 5.511148929595947, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9b71a6fe01ee4bd9e4ddcfaf9def273e93950a3a8d692b6196c39437732639c1", + "mean": -0.007745738141238689, + "std": 0.3089451193809509, + "rms": 0.30904218554496765, + "max_abs": 8.75 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4f8d332b7f5144c196e667094f7de919f0094a0fad98972bde5eebcdb67cf627", + "mean": -0.008992215618491173, + "std": 5.812911033630371, + "rms": 5.812918186187744, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "02cb445581ea44bbd5df7a64952c0b744cd923b35b8be34fd34e9364da080a6a", + "mean": -0.007820380851626396, + "std": 0.3082142174243927, + "rms": 0.30831342935562134, + "max_abs": 8.75 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3c6cbeb0ef0afa400d8136d34fcbb1a781c3a6779b3f279b525faa56aa926520", + "mean": -0.008675776422023773, + "std": 5.511064052581787, + "rms": 5.511070251464844, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fbcbfc90a09227e1121ffde51a514048ee623c3b2bbebea9c5a197d47b924b86", + "mean": -0.007756037637591362, + "std": 0.309405654668808, + "rms": 0.30950286984443665, + "max_abs": 8.625 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e2108989aafea45f72be866fedf74727a1fb9f0b054f078fbfb18861f24484df", + "mean": -0.008979587815701962, + "std": 5.812935829162598, + "rms": 5.812942981719971, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1f8187e0713a1f9712ffafbfe33ea70efbe96540f87cb59522a4dd30bd48745e", + "mean": -0.007816416211426258, + "std": 0.3082292079925537, + "rms": 0.3083283007144928, + "max_abs": 8.75 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fe4c99a29281b6d9e7f63f8349684c7ae24fc27f717637276c76c52dd00bb172", + "mean": -0.008630302734673023, + "std": 5.511059284210205, + "rms": 5.511065483093262, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9962990283966064, + "min_cosine_similarity": 0.9561008214950562, + "mean_relative_l2": 0.07672285288572311, + "max_abs_delta": 0.78125 + }, + "system_bos": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9945675134658813, + "min_cosine_similarity": 0.9563450217247009, + "mean_relative_l2": 0.09788665175437927, + "max_abs_delta": 0.453125 + }, + "system_x": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9903958439826965, + "min_cosine_similarity": 0.9050072431564331, + "mean_relative_l2": 0.1261741816997528, + "max_abs_delta": 0.90625 + }, + "system_period": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9905568957328796, + "min_cosine_similarity": 0.9128532409667969, + "mean_relative_l2": 0.12577494978904724, + "max_abs_delta": 0.6875 + }, + "bos_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9905797243118286, + "min_cosine_similarity": 0.8215662240982056, + "mean_relative_l2": 0.12358910590410233, + "max_abs_delta": 0.84375 + }, + "bos_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9894116520881653, + "min_cosine_similarity": 0.833303689956665, + "mean_relative_l2": 0.13207286596298218, + "max_abs_delta": 0.828125 + }, + "x_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9886618852615356, + "min_cosine_similarity": 0.7691185474395752, + "mean_relative_l2": 0.13179834187030792, + "max_abs_delta": 1.3125 + }, + "x_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9841659665107727, + "min_cosine_similarity": 0.7058960795402527, + "mean_relative_l2": 0.15716606378555298, + "max_abs_delta": 1.466796875 + }, + "period_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9882243871688843, + "min_cosine_similarity": 0.7550930976867676, + "mean_relative_l2": 0.13371799886226654, + "max_abs_delta": 1.3125 + }, + "period_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9837052822113037, + "min_cosine_similarity": 0.7188242077827454, + "mean_relative_l2": 0.16021862626075745, + "max_abs_delta": 1.25 + } + } + }, + "layer_09": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4015ab44a354ea9b43ad8b2cb8294cd1d71c747e874abc7716674778c252d549", + "mean": -0.010052869096398354, + "std": 0.3536762297153473, + "rms": 0.3538190424442291, + "max_abs": 12.75 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3bc9a3aaf805ccdcc9616d536d5e3276bbf80981458df62c587078bf20a19aa4", + "mean": -0.01860995404422283, + "std": 6.596963405609131, + "rms": 6.596989154815674, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4d818bb4fb24739940599a51b20ef337f72649e68ac6a3b0b75fea6e810cbe8f", + "mean": -0.01005158107727766, + "std": 0.35322898626327515, + "rms": 0.3533719778060913, + "max_abs": 12.75 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d2d62291957b1e527b46c53ac13c601203979d9b032df874d751aecaa9343bdc", + "mean": -0.018904970958828926, + "std": 6.456790447235107, + "rms": 6.456817626953125, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4c19c7bc08a0241aa2713f1fe0d0064a4b54d9aa5539fe7809b733ce13e9a942", + "mean": -0.010105650871992111, + "std": 0.3545144200325012, + "rms": 0.35465842485427856, + "max_abs": 12.375 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fbf80a92bda67875ddb68be90f3bffcf80e74d30b376605190b78b695665fa68", + "mean": -0.010875839740037918, + "std": 5.815880298614502, + "rms": 5.815890789031982, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "26c40a48d215cd12452f6ea04668dd1c2bd9685ffd6b108ae647db2b34c8deee", + "mean": -0.010133879259228706, + "std": 0.3543327748775482, + "rms": 0.3544776439666748, + "max_abs": 12.4375 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b3efda45e41bdd79d4010de3faa850af53a8c1b603d62bd6bcd6d51335a4bed6", + "mean": -0.010805279947817326, + "std": 5.51416540145874, + "rms": 5.514175891876221, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c9de350680770d82bf803ab092906b652d9e8abb416b5e56ba33d0847504ab4a", + "mean": -0.01003274880349636, + "std": 0.353275865316391, + "rms": 0.3534182906150818, + "max_abs": 12.3125 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9360a10022086be27297879d77863827b2ec276fa5f7c9607e1e38668c31aa9f", + "mean": -0.01080628577619791, + "std": 5.815808296203613, + "rms": 5.815818786621094, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "beadc21a27e64e23a2445cb389cd2bb6a2da5ea6599304be9b5f324ffe67f98b", + "mean": -0.009756912477314472, + "std": 0.34943604469299316, + "rms": 0.34957224130630493, + "max_abs": 12.375 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ab8cab2f7268698a986b8e1efe32f7818cccfc720ab20db2e40f66d318b02f62", + "mean": -0.010487152263522148, + "std": 5.513895034790039, + "rms": 5.513905048370361, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6a8c4ab5305baebc8934acee96cc63aea03e78fb562dd8f4e1f5d8e1c8ed3bd1", + "mean": -0.010083918459713459, + "std": 0.35358119010925293, + "rms": 0.35372495651245117, + "max_abs": 12.3125 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "60f19a6c067d5a7254f5aa376adabae73143a4903f636cab510d9b66a50065b5", + "mean": -0.010770874097943306, + "std": 5.815806865692139, + "rms": 5.815817356109619, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cc0ec0cc09ae8b507450a63b3962edb63de23d6cfa6cd151f588f14c5af0ae01", + "mean": -0.010033532045781612, + "std": 0.35055258870124817, + "rms": 0.3506961464881897, + "max_abs": 12.375 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ea1f531fbdaa52cfe7028f38c331806dcaa97fed2f44089a6d24c7842d5f4fe0", + "mean": -0.010599631816148758, + "std": 5.513930320739746, + "rms": 5.513940334320068, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9959023594856262, + "min_cosine_similarity": 0.9523184895515442, + "mean_relative_l2": 0.08019878715276718, + "max_abs_delta": 1.1875 + }, + "system_bos": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9944630861282349, + "min_cosine_similarity": 0.9578201174736023, + "mean_relative_l2": 0.098923459649086, + "max_abs_delta": 0.671875 + }, + "system_x": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9890560507774353, + "min_cosine_similarity": 0.8811208605766296, + "mean_relative_l2": 0.13369061052799225, + "max_abs_delta": 1.84375 + }, + "system_period": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9897884130477905, + "min_cosine_similarity": 0.9060065150260925, + "mean_relative_l2": 0.13106176257133484, + "max_abs_delta": 1.5 + }, + "bos_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9906976819038391, + "min_cosine_similarity": 0.822358250617981, + "mean_relative_l2": 0.12243922054767609, + "max_abs_delta": 1.15625 + }, + "bos_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9896901845932007, + "min_cosine_similarity": 0.8394516706466675, + "mean_relative_l2": 0.12953799962997437, + "max_abs_delta": 1.0625 + }, + "x_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9887304306030273, + "min_cosine_similarity": 0.7790300846099854, + "mean_relative_l2": 0.13273048400878906, + "max_abs_delta": 1.640625 + }, + "x_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9835073351860046, + "min_cosine_similarity": 0.7049015164375305, + "mean_relative_l2": 0.1602490097284317, + "max_abs_delta": 2.25 + }, + "period_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9885224103927612, + "min_cosine_similarity": 0.7695350646972656, + "mean_relative_l2": 0.13360406458377838, + "max_abs_delta": 1.53125 + }, + "period_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9837006330490112, + "min_cosine_similarity": 0.7397642731666565, + "mean_relative_l2": 0.16122274100780487, + "max_abs_delta": 1.75 + } + } + }, + "layer_10": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c7799c8c6b0e94582f57f1b2b7ddcf7d444230955d4bc967aceeded17ae61c26", + "mean": -0.00905602890998125, + "std": 0.3913276493549347, + "rms": 0.39143243432044983, + "max_abs": 12.875 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1ce2d5e0ae613698b9ef404bbf384124224d3a9712f0a7e3640291bb9b37a269", + "mean": -0.018090441823005676, + "std": 6.604469299316406, + "rms": 6.604494571685791, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "247da41d4d347f49550de65ddc69fddf81c954513ae758b3a4f23efd64e3f471", + "mean": -0.009247297421097755, + "std": 0.39117708802223206, + "rms": 0.39128637313842773, + "max_abs": 12.875 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "182bd22e06fac9e34d4b981b8ef183e3fd21cdbd7513a6ad6d8416d13a3dc6af", + "mean": -0.018708616495132446, + "std": 6.464105606079102, + "rms": 6.464132308959961, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6f86032435319ab2855a2fcbb5f00a8509f0758b8f0a9bce5aaf23f4bd89cb20", + "mean": -0.009138401597738266, + "std": 0.39256101846694946, + "rms": 0.39266735315322876, + "max_abs": 12.5625 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8d6d78c04ef405167e08f1f8099edcf8bbb0a35be1ca2ecc234f765868ba0724", + "mean": -0.010420083068311214, + "std": 5.824099063873291, + "rms": 5.824108600616455, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ac7f8c94a6f9bbaee4fa66e4479c2e789dbbe4a6c8c03a1911224975bb223024", + "mean": -0.009181693196296692, + "std": 0.39240318536758423, + "rms": 0.3925105929374695, + "max_abs": 12.625 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a33cdc0da5ad335a1f15716ba0e85e9e14fc95824bb0ac5796afb7f8443e3fa5", + "mean": -0.010494597256183624, + "std": 5.522280216217041, + "rms": 5.522290229797363, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c0390f531cc4a8d7eb163234084dc8e38f4701dce78e516b7335e52ad13ec793", + "mean": -0.008967423811554909, + "std": 0.3929353952407837, + "rms": 0.39303767681121826, + "max_abs": 12.375 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cc1396a5c0b45f7f425cfe6187e815d3abcc35313837c81c4deeda28c72c6ace", + "mean": -0.010264492593705654, + "std": 5.824100494384766, + "rms": 5.8241095542907715, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "202faa60e63bb69f6d05e3577d2b4f10901a959ae5ecad46b4e88d87462505a0", + "mean": -0.008828120306134224, + "std": 0.3906964659690857, + "rms": 0.39079615473747253, + "max_abs": 12.625 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "58e1940b81da100bff4c5977376b4232d13626a166f1d2d12475e66a530172bf", + "mean": -0.010277580469846725, + "std": 5.522136688232422, + "rms": 5.522146224975586, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3689bb58a0a1af76e9a7be8e2014965454112054c77713d0475a51ab10844fce", + "mean": -0.009048908948898315, + "std": 0.3931964039802551, + "rms": 0.39330047369003296, + "max_abs": 12.375 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b4241308b960fc9fe5258150ea4b6a35919e93778cc5de798e69588303851508", + "mean": -0.010177936404943466, + "std": 5.824098110198975, + "rms": 5.8241071701049805, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a635a762a97908f9967d0c61d16e4befe4ddd8230986374df77b2f667bdb0234", + "mean": -0.009064764715731144, + "std": 0.3910786509513855, + "rms": 0.3911837041378021, + "max_abs": 12.625 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "57d3b8e3dc5098c3f5f14d5c197a1756697fa81ea7bf1ce8b69d9b758a121269", + "mean": -0.010344424284994602, + "std": 5.522141456604004, + "rms": 5.522150993347168, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9952959418296814, + "min_cosine_similarity": 0.9479648470878601, + "mean_relative_l2": 0.08702408522367477, + "max_abs_delta": 1.65625 + }, + "system_bos": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9938904047012329, + "min_cosine_similarity": 0.9553557634353638, + "mean_relative_l2": 0.10406490415334702, + "max_abs_delta": 0.75 + }, + "system_x": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9878267645835876, + "min_cosine_similarity": 0.8562027812004089, + "mean_relative_l2": 0.13981637358665466, + "max_abs_delta": 1.9375 + }, + "system_period": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9889928698539734, + "min_cosine_similarity": 0.8938796520233154, + "mean_relative_l2": 0.13602250814437866, + "max_abs_delta": 1.625 + }, + "bos_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9899073243141174, + "min_cosine_similarity": 0.819269061088562, + "mean_relative_l2": 0.1277962028980255, + "max_abs_delta": 1.4375 + }, + "bos_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9887844920158386, + "min_cosine_similarity": 0.8267806172370911, + "mean_relative_l2": 0.13544239103794098, + "max_abs_delta": 1.140625 + }, + "x_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9877427220344543, + "min_cosine_similarity": 0.7559151649475098, + "mean_relative_l2": 0.13914534449577332, + "max_abs_delta": 1.9375 + }, + "x_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.982143223285675, + "min_cosine_similarity": 0.6647459268569946, + "mean_relative_l2": 0.16774185001850128, + "max_abs_delta": 3.171875 + }, + "period_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9877141714096069, + "min_cosine_similarity": 0.7628154754638672, + "mean_relative_l2": 0.1400861144065857, + "max_abs_delta": 2.1875 + }, + "period_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9826672673225403, + "min_cosine_similarity": 0.7115603089332581, + "mean_relative_l2": 0.1678294986486435, + "max_abs_delta": 3.15625 + } + } + }, + "layer_11": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f35deef799aab3ada63dea446602681064bf01b59be3381813756fa520f9029a", + "mean": -0.008943726308643818, + "std": 0.4740235209465027, + "rms": 0.47410792112350464, + "max_abs": 17.5 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a90eb3762c4170946a534f53c8dc2e74ca2ef5faba28cedaa2cdce0c6ea42995", + "mean": -0.01771136373281479, + "std": 6.643701553344727, + "rms": 6.643725395202637, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "dbb54465ef53b790a1cbddd6377e9c71f2948061de9530e83637d2d6d2da93c4", + "mean": -0.008863595314323902, + "std": 0.4731079936027527, + "rms": 0.4731909930706024, + "max_abs": 17.5 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "50b2255aecb27e49de1e980c55726551a3947218ebe02dbf53317716838eada6", + "mean": -0.018233099952340126, + "std": 6.501692295074463, + "rms": 6.501718044281006, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3d8229f4571e2aa1684c799bfaf2f5783ecc30b08e064ec53ef4097d01ae8ab2", + "mean": -0.009108904749155045, + "std": 0.47425442934036255, + "rms": 0.47434189915657043, + "max_abs": 17.0 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d07e7da636dc0c31ba2f4d78e17ce061f148db5770e980e2d4ba06e3946c4c34", + "mean": -0.010070227086544037, + "std": 5.857249736785889, + "rms": 5.857258319854736, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f1e8f17b21d21b643c399138bf5270e889c408e865a63679d6869b8ae6234d8f", + "mean": -0.009017523378133774, + "std": 0.47424355149269104, + "rms": 0.47432926297187805, + "max_abs": 17.25 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "dd17b9c1b0a2063ecc2e9fc32fc2aee5825df29de3d24898c0f76bbdf99faba0", + "mean": -0.010165020823478699, + "std": 5.554215431213379, + "rms": 5.554224967956543, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fe0fc9b129543115d064bca1f0e80c2f1ca0491fc245467b5e07d6a55a35eb3f", + "mean": -0.00875498540699482, + "std": 0.4738638401031494, + "rms": 0.4739447236061096, + "max_abs": 16.75 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "95f5afae85d9772cf7ae8d65cca66310f96cfd8916457046d27044dc19de922e", + "mean": -0.00966077484190464, + "std": 5.857241153717041, + "rms": 5.857248306274414, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3a527f1662d6ff673dc775996b196f0c8e2d5ebfeede8cf07e2e14dc75960b3a", + "mean": -0.008314392529428005, + "std": 0.4701763391494751, + "rms": 0.47024986147880554, + "max_abs": 17.125 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f48ae95c909cd1c3199696fe4cd50915388c986e51ffc17577a6101fe85fb152", + "mean": -0.009582472033798695, + "std": 5.553869724273682, + "rms": 5.553878307342529, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "24717d93a218b69bfd155af2f33bfdd377d7fc571affd05064c3517f7199dd4c", + "mean": -0.008830484002828598, + "std": 0.47423943877220154, + "rms": 0.4743216037750244, + "max_abs": 16.875 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "64c3b9eb2a779e79ca7be17c47bf105ebd1f2cb7e4a3ed673567a28aebaeb03f", + "mean": -0.009619439952075481, + "std": 5.857229232788086, + "rms": 5.857236862182617, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6bc241b554b774b65f273524b2d6fb46831ac43378b34785cf425929e7d7eb6a", + "mean": -0.008478092029690742, + "std": 0.4711793065071106, + "rms": 0.4712555706501007, + "max_abs": 17.25 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d3479e36d958b91aaabad27561762f70a6b4141301609ed89739134a1b6faf32", + "mean": -0.009578198194503784, + "std": 5.553911209106445, + "rms": 5.553919315338135, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9950674772262573, + "min_cosine_similarity": 0.9581286907196045, + "mean_relative_l2": 0.08995695412158966, + "max_abs_delta": 1.8125 + }, + "system_bos": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9941762685775757, + "min_cosine_similarity": 0.9624383449554443, + "mean_relative_l2": 0.10154445469379425, + "max_abs_delta": 1.0625 + }, + "system_x": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.987549364566803, + "min_cosine_similarity": 0.8452041149139404, + "mean_relative_l2": 0.14196757972240448, + "max_abs_delta": 2.75 + }, + "system_period": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9888131618499756, + "min_cosine_similarity": 0.8801183104515076, + "mean_relative_l2": 0.13731782138347626, + "max_abs_delta": 3.09375 + }, + "bos_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9904552102088928, + "min_cosine_similarity": 0.8414124846458435, + "mean_relative_l2": 0.12392052263021469, + "max_abs_delta": 1.875 + }, + "bos_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9890885949134827, + "min_cosine_similarity": 0.8436937928199768, + "mean_relative_l2": 0.13286182284355164, + "max_abs_delta": 1.625 + }, + "x_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9882368445396423, + "min_cosine_similarity": 0.8020102381706238, + "mean_relative_l2": 0.1375115066766739, + "max_abs_delta": 2.3125 + }, + "x_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9831064939498901, + "min_cosine_similarity": 0.7076572775840759, + "mean_relative_l2": 0.1641848385334015, + "max_abs_delta": 3.75 + }, + "period_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.988261342048645, + "min_cosine_similarity": 0.8042546510696411, + "mean_relative_l2": 0.13794685900211334, + "max_abs_delta": 2.53125 + }, + "period_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9835032224655151, + "min_cosine_similarity": 0.7476828098297119, + "mean_relative_l2": 0.16470861434936523, + "max_abs_delta": 5.25 + } + } + }, + "layer_12": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2d08b994e2a26fa95dc33268b6bfd13d4d604b5abfb80b1db3fc982b4e988703", + "mean": -0.007370489649474621, + "std": 0.5172674059867859, + "rms": 0.517319917678833, + "max_abs": 16.125 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "986bdae125a7e8afad6db20d54748cddfd4a93b9cd1ff574a60ae45c7bae8692", + "mean": -0.016689790412783623, + "std": 6.691777229309082, + "rms": 6.691798210144043, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "88c12cdd800af2a2076aa78fc16dede45d3df0e03ed19ab605db04d326c71788", + "mean": -0.007435983046889305, + "std": 0.5176402926445007, + "rms": 0.5176936984062195, + "max_abs": 16.375 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0bb1eb633fc2e72073193b54b4897cd3ddc3fba401f26f8eba5b66cf3d7c69a0", + "mean": -0.01717302016913891, + "std": 6.5508856773376465, + "rms": 6.55090856552124, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5cd809ceac58c5283db13e31f4336d410b7c2aeef90ae4d233b8faa978f85bfc", + "mean": -0.0074784159660339355, + "std": 0.5191241502761841, + "rms": 0.5191779732704163, + "max_abs": 16.25 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "01fc84ab9726661d98fb36d43daf1ba4749d3deb2848dd7f2eeff6c8dea4157f", + "mean": -0.008859950117766857, + "std": 5.869991302490234, + "rms": 5.869997978210449, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fa6984115645cde59ed4fb64e32f5477855490ee57f3cd9597b4f25bd58e70d1", + "mean": -0.007634272798895836, + "std": 0.5193263292312622, + "rms": 0.5193824768066406, + "max_abs": 16.5 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "88a34a879de25eacbe69a5d35f2a8187e54c8479e84596e2edeeef13fe9631e8", + "mean": -0.00909951888024807, + "std": 5.566961765289307, + "rms": 5.566969871520996, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f3c31f97554ae343e12c3ca3a88664090052dfed54c18e77205293bc21691a7d", + "mean": -0.007106894161552191, + "std": 0.5191614627838135, + "rms": 0.5192101001739502, + "max_abs": 16.125 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e9949e6e4e80784569e1d36d743c16b8ba80d2a2a0a264160edc299f71297ec4", + "mean": -0.008630575612187386, + "std": 5.870023727416992, + "rms": 5.870030403137207, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3b50cfbb5f59b656b7c1b3561be27f66e3b214253e35b655077d466c33fe555f", + "mean": -0.006830776110291481, + "std": 0.5158758163452148, + "rms": 0.5159209966659546, + "max_abs": 15.75 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "910f37eba017f3ebae87afda1ab43d76d87e04021acb2c55bae6ed9121f34b6f", + "mean": -0.008499190211296082, + "std": 5.566551685333252, + "rms": 5.566558361053467, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f3c0cecac374bd97539bc50ab99022198246ce472e5ea369fbc0f51862b99640", + "mean": -0.007261274848133326, + "std": 0.5192340612411499, + "rms": 0.5192847847938538, + "max_abs": 16.125 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "50b4637b4675ab56ee61ee5f17d590ec981bcc590f502e2f114950167e2fc0ce", + "mean": -0.008549443446099758, + "std": 5.869989395141602, + "rms": 5.869996070861816, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f8a41dcfcc9900b25bae619b5c426fad79d0c1fad0c671fdb9ac381e2da9e6d4", + "mean": -0.006915900390595198, + "std": 0.5167550444602966, + "rms": 0.5168012976646423, + "max_abs": 16.125 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2cd8ab0316c07066486cf3cd87df11236a5fcf455dd5eb4b58b618cdc647158d", + "mean": -0.008349303156137466, + "std": 5.566613674163818, + "rms": 5.566619873046875, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9934678673744202, + "min_cosine_similarity": 0.9438053965568542, + "mean_relative_l2": 0.10353720188140869, + "max_abs_delta": 1.71875 + }, + "system_bos": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9928344488143921, + "min_cosine_similarity": 0.9462536573410034, + "mean_relative_l2": 0.11171888560056686, + "max_abs_delta": 1.5078125 + }, + "system_x": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9853382110595703, + "min_cosine_similarity": 0.8616455793380737, + "mean_relative_l2": 0.15554706752300262, + "max_abs_delta": 3.0 + }, + "system_period": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.986800491809845, + "min_cosine_similarity": 0.8735311031341553, + "mean_relative_l2": 0.14953891932964325, + "max_abs_delta": 2.3125 + }, + "bos_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.98886638879776, + "min_cosine_similarity": 0.8290928602218628, + "mean_relative_l2": 0.1342911273241043, + "max_abs_delta": 3.0625 + }, + "bos_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9873479008674622, + "min_cosine_similarity": 0.8306078910827637, + "mean_relative_l2": 0.14383506774902344, + "max_abs_delta": 2.5 + }, + "x_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9864038228988647, + "min_cosine_similarity": 0.8030509948730469, + "mean_relative_l2": 0.15012048184871674, + "max_abs_delta": 3.53125 + }, + "x_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9811983704566956, + "min_cosine_similarity": 0.728276789188385, + "mean_relative_l2": 0.17626675963401794, + "max_abs_delta": 2.875 + }, + "period_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9863563179969788, + "min_cosine_similarity": 0.8033896684646606, + "mean_relative_l2": 0.15005138516426086, + "max_abs_delta": 4.15625 + }, + "period_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9813544154167175, + "min_cosine_similarity": 0.7581796646118164, + "mean_relative_l2": 0.17815227806568146, + "max_abs_delta": 5.15625 + } + } + }, + "layer_13": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "85c82fcb1f56bfaae37626fc5292bd2210bbb76cfa3771c6a6dc672648039dfe", + "mean": -0.006891641300171614, + "std": 0.5377596020698547, + "rms": 0.5378037691116333, + "max_abs": 15.5625 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "aa667ef3cb3b780fcf1410b1480715b996a77bf1dbfa6f019ab05a7aef8bcd4d", + "mean": -0.016181770712137222, + "std": 6.697904586791992, + "rms": 6.6979241371154785, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "26107f206d94c7bcc7b727af08cc46ffe69529e43a136d1047d29fa4d8ba6318", + "mean": -0.006936195772141218, + "std": 0.5388057827949524, + "rms": 0.5388504266738892, + "max_abs": 15.625 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "00763c54049053f41764a8468c4a91ae922eb1dfbcfa31d78d1b5c57e36f051e", + "mean": -0.017193837091326714, + "std": 6.5573530197143555, + "rms": 6.557375907897949, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6fb2089348f57ee0fd930ccd0fb0ccf142e29d0503d1ab607965d4902e691acb", + "mean": -0.006881916429847479, + "std": 0.5407158732414246, + "rms": 0.5407596826553345, + "max_abs": 16.0 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "12492eb7b68757d7622776d9d4511046e2057f5f5c07d87ccc5b180bf40e9cd9", + "mean": -0.0082505838945508, + "std": 5.875687122344971, + "rms": 5.875693321228027, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "44a889318b1ad66d174f611bdc0b9cc5e53672fc649b52d2871a9a1ce84df881", + "mean": -0.007169527933001518, + "std": 0.540671706199646, + "rms": 0.5407192707061768, + "max_abs": 15.875 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0ddf312b7a764428395935701d9b90d521788f5a700344f904171dc4dee50b66", + "mean": -0.009114784188568592, + "std": 5.573025703430176, + "rms": 5.573033332824707, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2a01543e2a407d6ca96a6c8c4df7105bcd68956a4065d9ed8fe4a113dd440a53", + "mean": -0.006481939926743507, + "std": 0.5410265326499939, + "rms": 0.5410653948783875, + "max_abs": 14.9375 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "89df99696e822ffdbd550042a1728b15833fe6f18640fa693f6c0e65cf4a4bd8", + "mean": -0.008038334548473358, + "std": 5.875805854797363, + "rms": 5.87581205368042, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8a94aaf29f44dab92961f76e3d4b93a78d23fae39521e9d5118f14b6189f78b3", + "mean": -0.006087757647037506, + "std": 0.5371071100234985, + "rms": 0.5371416211128235, + "max_abs": 15.0 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "29d0f919b3b1880382f1fa18f9855f94e13e0c7d268350fdb84fec4d2562b845", + "mean": -0.008349314332008362, + "std": 5.572661399841309, + "rms": 5.572668075561523, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "33971c4603e6b8e11a0f58379a7cbf52e8c8c33b52990c390c1b1add0c66ffa8", + "mean": -0.006586673203855753, + "std": 0.5404843091964722, + "rms": 0.540524423122406, + "max_abs": 14.9375 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f3cb31a18e30e36a823e1ecb200c2157931a725dfd033c31a6cdffdc61bb354f", + "mean": -0.007897230796515942, + "std": 5.875696659088135, + "rms": 5.875702381134033, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e2295ac7d67e865dcd9162ae2805913ce42f35981aec89ef4fc0af2215588371", + "mean": -0.006171968299895525, + "std": 0.5377970337867737, + "rms": 0.5378324389457703, + "max_abs": 15.125 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7eba1d87f1c87cb74d3904573bad483a518337c369b09afd38bcb2de7674f7b0", + "mean": -0.008194846101105213, + "std": 5.572704315185547, + "rms": 5.5727105140686035, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9929083585739136, + "min_cosine_similarity": 0.9435856342315674, + "mean_relative_l2": 0.10849576443433762, + "max_abs_delta": 2.21875 + }, + "system_bos": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9922482371330261, + "min_cosine_similarity": 0.9369454979896545, + "mean_relative_l2": 0.11665882915258408, + "max_abs_delta": 1.796875 + }, + "system_x": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9841515421867371, + "min_cosine_similarity": 0.857749342918396, + "mean_relative_l2": 0.16273069381713867, + "max_abs_delta": 2.9375 + }, + "system_period": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.985641598701477, + "min_cosine_similarity": 0.8670910596847534, + "mean_relative_l2": 0.15686126053333282, + "max_abs_delta": 2.375 + }, + "bos_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9879648089408875, + "min_cosine_similarity": 0.8289228081703186, + "mean_relative_l2": 0.14082761108875275, + "max_abs_delta": 3.1875 + }, + "bos_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9865816235542297, + "min_cosine_similarity": 0.8222411274909973, + "mean_relative_l2": 0.14866408705711365, + "max_abs_delta": 3.8125 + }, + "x_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9852179884910583, + "min_cosine_similarity": 0.8006265759468079, + "mean_relative_l2": 0.15805014967918396, + "max_abs_delta": 4.3125 + }, + "x_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9802976250648499, + "min_cosine_similarity": 0.7358188629150391, + "mean_relative_l2": 0.1815502941608429, + "max_abs_delta": 3.0625 + }, + "period_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9851976037025452, + "min_cosine_similarity": 0.8027384281158447, + "mean_relative_l2": 0.1574414074420929, + "max_abs_delta": 5.15625 + }, + "period_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9803338646888733, + "min_cosine_similarity": 0.7641099691390991, + "mean_relative_l2": 0.18394580483436584, + "max_abs_delta": 5.65625 + } + } + }, + "layer_14": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "db464f9dade4995ff96fb2f421d0ae8b8bf6cbc87ffacaf0b8ac2227c688a75e", + "mean": -0.0064774928614497185, + "std": 0.5969075560569763, + "rms": 0.5969427227973938, + "max_abs": 18.875 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "012551db8ec21f820104636f4dd44934cc54bb743eceb1bfb388b8a9891ea725", + "mean": -0.01539967954158783, + "std": 6.714203834533691, + "rms": 6.714221477508545, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0c07e9fb24ebd9dcc9805310e1771c66812e01707733e979dc121500dfa1d5a0", + "mean": -0.006692484021186829, + "std": 0.5978907346725464, + "rms": 0.5979282259941101, + "max_abs": 19.0 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fca02665f225e98992efb2375fb2e6ef43b153510773a809eca2dc162fb8fa99", + "mean": -0.016782600432634354, + "std": 6.572651386260986, + "rms": 6.5726728439331055, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5adf67e1653ec166e21a7d7364dde3baf271d8e6788a63f6cb87bfc4f39110ba", + "mean": -0.0065245856530964375, + "std": 0.600875735282898, + "rms": 0.6009111404418945, + "max_abs": 19.25 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "712b41b26f32340295a72ac0cccc137fb3225357468d8f7cb668f9394005178b", + "mean": -0.007546135690063238, + "std": 5.893564224243164, + "rms": 5.893568992614746, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6f4e3e5207257d3eac801ddd2101f02aa226eb2b0e444a3aa0230a9ef720e2a4", + "mean": -0.006910219788551331, + "std": 0.6008901596069336, + "rms": 0.600929856300354, + "max_abs": 19.25 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "71dc74ed5832fb2519f681fb65f7cd7088cc99f0b253aa8400ba2d4cbacfbbcc", + "mean": -0.008657483384013176, + "std": 5.590353488922119, + "rms": 5.590360164642334, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d9ac991a5d373ca3a9fa5d7f782a677dae5b308a3216143ccbcef07e8247e116", + "mean": -0.006480485200881958, + "std": 0.6005047559738159, + "rms": 0.6005397439002991, + "max_abs": 18.875 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4afc7527a4cdb01b5fc47473a3a8e236d22fe083e28278f6daae2ae64bf31ede", + "mean": -0.0076141357421875, + "std": 5.893672943115234, + "rms": 5.893677711486816, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "882090ebe918ed8d98bd21bb3801bf9eacce600fe13bae771d328a2430b8bc60", + "mean": -0.006154352333396673, + "std": 0.5961741805076599, + "rms": 0.5962059497833252, + "max_abs": 17.375 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "42017c67dc2613dcea3cb413a90f7d534e51604c9f2445fc50a0b94e0cded2cf", + "mean": -0.008180370554327965, + "std": 5.5899200439453125, + "rms": 5.589926242828369, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9c673ed2301e618f07207ea2aac98110075b11c3c75f1b2fbce50e9b78ffec46", + "mean": -0.0064232321456074715, + "std": 0.6004361510276794, + "rms": 0.6004704833030701, + "max_abs": 18.75 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ddf559619779e5fe0c8209d6c19cb265ea8d72a99d7fcec222103b3e7c2c9199", + "mean": -0.007365036755800247, + "std": 5.893580436706543, + "rms": 5.893585205078125, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d5fee7469c00d1d04f9b8a22f62b50cefaa0e9d747fdfa5ef08e765f73456061", + "mean": -0.006131851579993963, + "std": 0.5973197817802429, + "rms": 0.5973512530326843, + "max_abs": 17.875 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "346dc81d0648d28693cd6c33285b0b0a9a2800696a6f32379a39c1d912793b77", + "mean": -0.00801373552531004, + "std": 5.589962005615234, + "rms": 5.589968681335449, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9921448826789856, + "min_cosine_similarity": 0.9377957582473755, + "mean_relative_l2": 0.11433806270360947, + "max_abs_delta": 2.0625 + }, + "system_bos": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9914420247077942, + "min_cosine_similarity": 0.9394263029098511, + "mean_relative_l2": 0.12306423485279083, + "max_abs_delta": 1.625 + }, + "system_x": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9824656248092651, + "min_cosine_similarity": 0.8509494662284851, + "mean_relative_l2": 0.17334458231925964, + "max_abs_delta": 4.8125 + }, + "system_period": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9838328957557678, + "min_cosine_similarity": 0.8464322686195374, + "mean_relative_l2": 0.16717354953289032, + "max_abs_delta": 3.875 + }, + "bos_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9873146414756775, + "min_cosine_similarity": 0.8215208649635315, + "mean_relative_l2": 0.14523044228553772, + "max_abs_delta": 3.0625 + }, + "bos_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9859821796417236, + "min_cosine_similarity": 0.8185500502586365, + "mean_relative_l2": 0.15279553830623627, + "max_abs_delta": 2.79638671875 + }, + "x_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.984286904335022, + "min_cosine_similarity": 0.7980663776397705, + "mean_relative_l2": 0.16404856741428375, + "max_abs_delta": 3.9375 + }, + "x_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9792242646217346, + "min_cosine_similarity": 0.7385540008544922, + "mean_relative_l2": 0.1881568878889084, + "max_abs_delta": 4.4375 + }, + "period_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9842832684516907, + "min_cosine_similarity": 0.7931340932846069, + "mean_relative_l2": 0.1632058024406433, + "max_abs_delta": 5.125 + }, + "period_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9791272878646851, + "min_cosine_similarity": 0.7553045749664307, + "mean_relative_l2": 0.19076697528362274, + "max_abs_delta": 5.71875 + } + } + }, + "layer_15": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ec485511aeb00c6d35704180090b48524e8952d3acbaeff494b55a4ac5501eab", + "mean": -0.006724955514073372, + "std": 0.648033082485199, + "rms": 0.6480679512023926, + "max_abs": 21.75 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5a3ec5cdc106c1c874406f68d88e49e874946e7392511a7a2cab4c4638d7e8c7", + "mean": -0.015203813090920448, + "std": 6.721960067749023, + "rms": 6.721977710723877, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c415fadefa113df3f9f03de69d674953fb49caf81345b1e6ed11d9c8a917045a", + "mean": -0.006944297347217798, + "std": 0.6472564935684204, + "rms": 0.6472936868667603, + "max_abs": 21.75 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b27d1e64fad4f6c31803d55bc8464aa2c9557aba51e1e201b8e1dc7cfc232f4f", + "mean": -0.01687755063176155, + "std": 6.580928802490234, + "rms": 6.580950736999512, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8021d62546ae1a18858ddfe735fb3d7020fdab4a0471e3f61eb55c0f56d8ddbf", + "mean": -0.0064333234913647175, + "std": 0.6503723859786987, + "rms": 0.6504042148590088, + "max_abs": 22.75 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "736502faceb7ac690115874b317a701160e2c615ad34a0f2639d9b1a4e907dbf", + "mean": -0.007131175138056278, + "std": 5.901774883270264, + "rms": 5.901779651641846, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3c8b38133825ebb2fff8e8cd7300fd3f919c8f53c35798b73fbe0ecbca1319cf", + "mean": -0.00710960803553462, + "std": 0.6499459147453308, + "rms": 0.6499847769737244, + "max_abs": 22.25 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ec5fd3d1ecfc9fa04b5cb027ef33de444c0b6953e9fa1996cd2e2a3a131032c8", + "mean": -0.008754786103963852, + "std": 5.599334716796875, + "rms": 5.599341869354248, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "06bf6243e3827d552a97bf36b6f11d9c8501e6fd260e0c2179b081a8cf6f3871", + "mean": -0.006528524216264486, + "std": 0.6518097519874573, + "rms": 0.651842474937439, + "max_abs": 21.125 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "77ab51582509c72d1ef60a38ba481d38a24a33799fa03aaa478dad1b11311a35", + "mean": -0.00726332189515233, + "std": 5.902050018310547, + "rms": 5.902054309844971, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d606c39b3d38f97230a164c36fe9bae6026b5649c829224047c42e115d80a7da", + "mean": -0.007106282282620668, + "std": 0.6476224064826965, + "rms": 0.6476614475250244, + "max_abs": 20.125 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3b0e3b403d5a114f7ea365d28d38ab9f746f68ce8411097b908f24d37d9614f8", + "mean": -0.008864578790962696, + "std": 5.599054336547852, + "rms": 5.599061489105225, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5cd485c0bc151112c6fa798a5d5074b1c7346ae8c7beea585917c6366cf6b8d2", + "mean": -0.006648648995906115, + "std": 0.6527009010314941, + "rms": 0.6527347564697266, + "max_abs": 21.375 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b414f03ae5b8865bc64c6298b1ff298e65810c3a3812eb3e69d10231ca4f00cb", + "mean": -0.007178900297731161, + "std": 5.902045249938965, + "rms": 5.902049541473389, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4e49a6cf9c97c6fe4b45cdc5bf99fa0d347492bc675e48149b47e94505e85aed", + "mean": -0.006821912247687578, + "std": 0.6496359705924988, + "rms": 0.6496717929840088, + "max_abs": 20.625 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "88adc21016267e51c233db1da5bdf434da69260274786c7405353b7619c89f69", + "mean": -0.008464382030069828, + "std": 5.5992112159729, + "rms": 5.599217414855957, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.991338849067688, + "min_cosine_similarity": 0.9377532005310059, + "mean_relative_l2": 0.12016589939594269, + "max_abs_delta": 2.375 + }, + "system_bos": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9906491637229919, + "min_cosine_similarity": 0.949435830116272, + "mean_relative_l2": 0.12903042137622833, + "max_abs_delta": 2.75 + }, + "system_x": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9798253178596497, + "min_cosine_similarity": 0.8306182622909546, + "mean_relative_l2": 0.1870489865541458, + "max_abs_delta": 6.5 + }, + "system_period": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9820050597190857, + "min_cosine_similarity": 0.8277722001075745, + "mean_relative_l2": 0.1773025393486023, + "max_abs_delta": 5.625 + }, + "bos_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.985901951789856, + "min_cosine_similarity": 0.8107340335845947, + "mean_relative_l2": 0.1524811089038849, + "max_abs_delta": 3.25 + }, + "bos_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9852179884910583, + "min_cosine_similarity": 0.8162121176719666, + "mean_relative_l2": 0.15757057070732117, + "max_abs_delta": 3.3828125 + }, + "x_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9832174777984619, + "min_cosine_similarity": 0.801020622253418, + "mean_relative_l2": 0.17020662128925323, + "max_abs_delta": 3.9375 + }, + "x_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9775341749191284, + "min_cosine_similarity": 0.7306162118911743, + "mean_relative_l2": 0.1972021758556366, + "max_abs_delta": 5.875 + }, + "period_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9830306768417358, + "min_cosine_similarity": 0.7917680740356445, + "mean_relative_l2": 0.1707243025302887, + "max_abs_delta": 4.4375 + }, + "period_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9769947528839111, + "min_cosine_similarity": 0.7366588711738586, + "mean_relative_l2": 0.20098890364170074, + "max_abs_delta": 6.46875 + } + } + }, + "layer_16": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4bc64d92fae87998c5e7cad5d0f012592f943369d70fa17e76e05b869d82d213", + "mean": -0.006356509868055582, + "std": 0.7209303379058838, + "rms": 0.7209583520889282, + "max_abs": 24.375 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f2716826ff4e87575dba52a8e49d0b8c26de7b99d02f3d5bd77f8135d45f4fd1", + "mean": -0.014777770265936852, + "std": 6.732377052307129, + "rms": 6.732393741607666, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d537c7d0b7a93b8ce232d234bfcc123beff7e21bc0f9fd5ce5046dc4fa834fcb", + "mean": -0.006633473560214043, + "std": 0.719999372959137, + "rms": 0.7200299501419067, + "max_abs": 24.25 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d987405f8d3a813249acf3a7fff33227b5d94e9c3cf05ded946a464dbd18bcd1", + "mean": -0.01632131077349186, + "std": 6.591464996337891, + "rms": 6.591485500335693, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "70f2d55151431145e0903269a0efef236f209431040be67751d5a54a75a46fa0", + "mean": -0.006081284023821354, + "std": 0.721713125705719, + "rms": 0.7217387557029724, + "max_abs": 25.5 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3ed540c09899ae8fe015af73dd3b90f43478ac9c1752139d03235c2f2f7804c4", + "mean": -0.0067258840426802635, + "std": 5.912608623504639, + "rms": 5.912611961364746, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e01b6467bba27d066ec75ee2634e32f06376214666111b86b28f8ca9a0e88963", + "mean": -0.007046000100672245, + "std": 0.7231893539428711, + "rms": 0.7232236862182617, + "max_abs": 24.75 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f36a88494e511b11495f5109f01c93f6163853f32d69c50d8b7d31c3bf10d4c2", + "mean": -0.0082992073148489, + "std": 5.611069202423096, + "rms": 5.611075401306152, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8f34d536e863f21e58914be27d9519eab67345bfdbef4e2b270fd2b7260d488d", + "mean": -0.005883449222892523, + "std": 0.7243444919586182, + "rms": 0.7243683338165283, + "max_abs": 24.625 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b376dfffcd23e24c98e76a06d083562bd95a9cd19f1815e86d9ce46cc48720d5", + "mean": -0.006633169017732143, + "std": 5.913179397583008, + "rms": 5.913182735443115, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c02b0700b18d560cb1d16b2a3f7dc5a8636bfe68c8da66d983d6496f6427e18c", + "mean": -0.00670438539236784, + "std": 0.720439612865448, + "rms": 0.7204707860946655, + "max_abs": 23.375 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9cbdaaa1cfc22082e4a99f1715d67fa8f83e0cd905bcc648d7267d2168ca7a08", + "mean": -0.008222810924053192, + "std": 5.610887050628662, + "rms": 5.610893249511719, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "33986ddf696cffdb552c997a8d7fd73a0a48c0ae04114dca8b56dce0f6d4cb48", + "mean": -0.00618144404143095, + "std": 0.7253277897834778, + "rms": 0.7253541350364685, + "max_abs": 24.75 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "51d47b4813a75f0a2534642da57d9486472df395acae4e989a1add76b1cdfc5c", + "mean": -0.006657739169895649, + "std": 5.913067817687988, + "rms": 5.913071155548096, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f1386c4d765fc1e6a16c647e90f917ee7f79b15366217914ff2bb521e77582ef", + "mean": -0.006532028783112764, + "std": 0.7229915261268616, + "rms": 0.7230210304260254, + "max_abs": 24.125 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7de186e854bd7f131526755773a5bfb9b05c58cbd23dd45aa8abeb3d75729c88", + "mean": -0.007825116626918316, + "std": 5.611011028289795, + "rms": 5.611016750335693, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.99094557762146, + "min_cosine_similarity": 0.9372300505638123, + "mean_relative_l2": 0.12416990101337433, + "max_abs_delta": 2.46875 + }, + "system_bos": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9899278283119202, + "min_cosine_similarity": 0.9555598497390747, + "mean_relative_l2": 0.13453572988510132, + "max_abs_delta": 3.6875 + }, + "system_x": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9780378341674805, + "min_cosine_similarity": 0.8218382596969604, + "mean_relative_l2": 0.19573016464710236, + "max_abs_delta": 7.375 + }, + "system_period": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9811236262321472, + "min_cosine_similarity": 0.8239721059799194, + "mean_relative_l2": 0.1824931651353836, + "max_abs_delta": 5.53125 + }, + "bos_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9854757189750671, + "min_cosine_similarity": 0.8086918592453003, + "mean_relative_l2": 0.1554218977689743, + "max_abs_delta": 3.25 + }, + "bos_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9845729470252991, + "min_cosine_similarity": 0.8114530444145203, + "mean_relative_l2": 0.1615600287914276, + "max_abs_delta": 3.798828125 + }, + "x_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9824448227882385, + "min_cosine_similarity": 0.8005750179290771, + "mean_relative_l2": 0.1751565784215927, + "max_abs_delta": 3.65625 + }, + "x_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9771867394447327, + "min_cosine_similarity": 0.727762758731842, + "mean_relative_l2": 0.19915279746055603, + "max_abs_delta": 6.25 + }, + "period_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9825619459152222, + "min_cosine_similarity": 0.7889223098754883, + "mean_relative_l2": 0.17383155226707458, + "max_abs_delta": 4.0625 + }, + "period_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9767546057701111, + "min_cosine_similarity": 0.7393003702163696, + "mean_relative_l2": 0.20269380509853363, + "max_abs_delta": 6.4375 + } + } + }, + "layer_17": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "87384b09edd4377128c2a8de3a34b23364bf8c57bccf03eb3491ca30f85de82c", + "mean": -0.004252369049936533, + "std": 0.8184552192687988, + "rms": 0.8184662461280823, + "max_abs": 27.625 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "617a21030209522eef07ed24bfb28c0f703c0afb2feb748b180bc3fdb25ecdcb", + "mean": -0.013345767743885517, + "std": 6.746331691741943, + "rms": 6.746345043182373, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "da912512e927e279420fd873514b785960de1223d179dc9d14481ccdcd42f232", + "mean": -0.004528460092842579, + "std": 0.817801296710968, + "rms": 0.8178138732910156, + "max_abs": 28.0 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ef37f97c8f26b0d308ad5d4efc91f47a8193178323e5f5dcfbb90adff8dd1bc8", + "mean": -0.015532582066953182, + "std": 6.606093883514404, + "rms": 6.606112003326416, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cac62eaf224dfb01ea7abae58613bf96ca1dcbc9b5374868e8984a42dc63926f", + "mean": -0.003911613952368498, + "std": 0.8188574910163879, + "rms": 0.8188668489456177, + "max_abs": 29.625 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6a3aa2bee03f01420538c01302980fa68d747e4aa416b8fca340f8d243b0aefe", + "mean": -0.005232864525169134, + "std": 5.9278740882873535, + "rms": 5.9278764724731445, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cdf61469179a301022016c640d48eaf3ef49603eb71e78240bb999527bd0f8d0", + "mean": -0.004853137768805027, + "std": 0.8199006915092468, + "rms": 0.8199149966239929, + "max_abs": 27.625 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "95bac4cb636a0b3ddbd1a47ace800d3643b2e547611e3bb57ce8865cf4893200", + "mean": -0.007468895986676216, + "std": 5.6276535987854, + "rms": 5.627658367156982, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "17eee28dd810b2c8ff47b37e18147e4e56f8aef6f2877a0c216d51fd0bf60b49", + "mean": -0.0035423128865659237, + "std": 0.8212191462516785, + "rms": 0.8212267756462097, + "max_abs": 28.875 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "caeb38900e63b2994715f768e7fae08151759961068f23b07300a1e840dd7fa7", + "mean": -0.005033585708588362, + "std": 5.9285430908203125, + "rms": 5.928544998168945, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4d7bf4f4af7afbdf80bcb23696f6bc6ee9a99376ed0ff9374cea32624e5cb2d7", + "mean": -0.004836700391024351, + "std": 0.8169070482254028, + "rms": 0.8169213533401489, + "max_abs": 27.125 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8f40b22da71fe7cf845ba4f63f71418fd52003c736ddf58e9ad96ab502e56c3f", + "mean": -0.007662551011890173, + "std": 5.6274919509887695, + "rms": 5.62749719619751, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d85f8d31716deba78d2170ecd6e26ee55d545bc428dc3e7cee0d3084eff06035", + "mean": -0.0038813191931694746, + "std": 0.8229590654373169, + "rms": 0.8229681849479675, + "max_abs": 29.0 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "514a1b9b8158680c8e1a0e23df9bb454a65b323d50f87125eecf10ffdd315cc7", + "mean": -0.0050419531762599945, + "std": 5.928488731384277, + "rms": 5.928490161895752, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d5d179597185bf7d5ef7ccfbfd95f3a5be41fc2d294609cfb174f77936ec33c3", + "mean": -0.004523523151874542, + "std": 0.819002091884613, + "rms": 0.8190146088600159, + "max_abs": 27.25 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ab569513794d0805a895644565273b22e7e87f61c6ab0ebe4e92520a96b3053f", + "mean": -0.007147695869207382, + "std": 5.627638339996338, + "rms": 5.62764310836792, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9916603565216064, + "min_cosine_similarity": 0.9412868022918701, + "mean_relative_l2": 0.11997140198945999, + "max_abs_delta": 2.5625 + }, + "system_bos": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.990578293800354, + "min_cosine_similarity": 0.9560781121253967, + "mean_relative_l2": 0.13057735562324524, + "max_abs_delta": 3.875 + }, + "system_x": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9791480302810669, + "min_cosine_similarity": 0.825799822807312, + "mean_relative_l2": 0.19145536422729492, + "max_abs_delta": 7.78125 + }, + "system_period": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9822043180465698, + "min_cosine_similarity": 0.833646297454834, + "mean_relative_l2": 0.17713861167430878, + "max_abs_delta": 5.875 + }, + "bos_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9866993427276611, + "min_cosine_similarity": 0.8093810081481934, + "mean_relative_l2": 0.1486467570066452, + "max_abs_delta": 3.875 + }, + "bos_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9859710335731506, + "min_cosine_similarity": 0.8151213526725769, + "mean_relative_l2": 0.15372566878795624, + "max_abs_delta": 4.1953125 + }, + "x_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9838444590568542, + "min_cosine_similarity": 0.8185834884643555, + "mean_relative_l2": 0.16857954859733582, + "max_abs_delta": 4.09375 + }, + "x_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9794542789459229, + "min_cosine_similarity": 0.7572557926177979, + "mean_relative_l2": 0.18997256457805634, + "max_abs_delta": 6.375 + }, + "period_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9839652180671692, + "min_cosine_similarity": 0.8035808801651001, + "mean_relative_l2": 0.16727662086486816, + "max_abs_delta": 3.4375 + }, + "period_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9790270328521729, + "min_cosine_similarity": 0.7745312452316284, + "mean_relative_l2": 0.1930469572544098, + "max_abs_delta": 4.25 + } + } + }, + "layer_18": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3117d8e432b3309cc3bc0b2576950ead0ceee3cca890ddbc00053cd9280e3863", + "mean": -0.0029638935811817646, + "std": 0.9155916571617126, + "rms": 0.9155964255332947, + "max_abs": 33.25 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "66e5fe70afaa8cb6c82251937b546f16daabd54f4682513f06cf14f4d886df45", + "mean": -0.01226869411766529, + "std": 6.764088153839111, + "rms": 6.76409912109375, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4c55aa4f54fcae5ec8327eb4e5cfc6aa72cb91bff48013cd39cfc5281f2c065e", + "mean": -0.003290749154984951, + "std": 0.9118579030036926, + "rms": 0.9118638038635254, + "max_abs": 33.25 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "332c76217dd60b049ca3fac12f23749b582b1d5fd7416259c429bd13bdafb4c7", + "mean": -0.01445729099214077, + "std": 6.62438440322876, + "rms": 6.624400615692139, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2e852d243022ac2689e40fcafa9424de3622c4c43664e6f365cf48848ec0bfa8", + "mean": -0.002497546374797821, + "std": 0.9147453308105469, + "rms": 0.9147487282752991, + "max_abs": 34.0 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "03cf95fcaabc803c4ffb7b6b9016b27ac4f2b9075d4f5b831d65ceef30564277", + "mean": -0.003943729214370251, + "std": 5.945600986480713, + "rms": 5.9456024169921875, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "68a8cf05adc811cdabce43ca8a3c98583e29889e185e96d7b32dbe9638a99e24", + "mean": -0.003428312484174967, + "std": 0.9145280718803406, + "rms": 0.9145344495773315, + "max_abs": 32.75 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9719bab33bd33119d93bf98d2a0be368c8b0a401da559c63ba5dacbf041be4e7", + "mean": -0.0061599863693118095, + "std": 5.646913528442383, + "rms": 5.646917343139648, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a1cce618bd1fc36b82583259ac0bf2a11ddf42a1cf35e206b20a718db347ed52", + "mean": -0.0019557583145797253, + "std": 0.9203752279281616, + "rms": 0.9203773140907288, + "max_abs": 32.5 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "523d2444daf6c6d52b51c5dc1ce0fa381f551cb10f202e76cdb5417082e6215a", + "mean": -0.0036895053926855326, + "std": 5.946865558624268, + "rms": 5.946866512298584, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6b40cb9ad93c9fa1fe1c0f536a87bca4254c2471ade21d8057efc3eafee33da5", + "mean": -0.0036321543157100677, + "std": 0.9125800728797913, + "rms": 0.9125872850418091, + "max_abs": 30.0 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "96aa66b46723d1889aa70902520a9f77c16b05e076985fcb1c8ab4fd4df61ee9", + "mean": -0.006530937273055315, + "std": 5.647012710571289, + "rms": 5.647017002105713, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f81ecbd4355f42d1d01ba1b1968b655401099fa39b841d30e4ca5078a58d6968", + "mean": -0.002434315625578165, + "std": 0.9218770265579224, + "rms": 0.9218801856040955, + "max_abs": 32.25 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1fe1d46dce91bb3c7b1f10fb5a5e0b207fbe4c4ed838942f7ffef1965e207039", + "mean": -0.0037977544125169516, + "std": 5.946796894073486, + "rms": 5.946798801422119, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b55c1199cfc5ad45840f8fdc239c0c14eafc5b2ee5d8782eb18fdf0220d2f646", + "mean": -0.0032431185245513916, + "std": 0.9153977036476135, + "rms": 0.915403425693512, + "max_abs": 30.25 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f5fa1c9c53c96d7ed884baf8051c822ebfd8d43fbfe18d2265eeb81c47903d2b", + "mean": -0.005976058542728424, + "std": 5.64717435836792, + "rms": 5.647177696228027, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9914354085922241, + "min_cosine_similarity": 0.9370853900909424, + "mean_relative_l2": 0.12194544821977615, + "max_abs_delta": 2.8125 + }, + "system_bos": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9905374050140381, + "min_cosine_similarity": 0.9551035165786743, + "mean_relative_l2": 0.1312474012374878, + "max_abs_delta": 4.625 + }, + "system_x": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9782482981681824, + "min_cosine_similarity": 0.8113369941711426, + "mean_relative_l2": 0.19616122543811798, + "max_abs_delta": 9.5 + }, + "system_period": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9812195897102356, + "min_cosine_similarity": 0.8171917200088501, + "mean_relative_l2": 0.18256187438964844, + "max_abs_delta": 7.5 + }, + "bos_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9862962365150452, + "min_cosine_similarity": 0.7979129552841187, + "mean_relative_l2": 0.1508438140153885, + "max_abs_delta": 4.34765625 + }, + "bos_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9855324029922485, + "min_cosine_similarity": 0.8053848743438721, + "mean_relative_l2": 0.15591831505298615, + "max_abs_delta": 5.66796875 + }, + "x_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9832770228385925, + "min_cosine_similarity": 0.808295726776123, + "mean_relative_l2": 0.171897754073143, + "max_abs_delta": 5.125 + }, + "x_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9788990020751953, + "min_cosine_similarity": 0.7485921382904053, + "mean_relative_l2": 0.19301411509513855, + "max_abs_delta": 8.25 + }, + "period_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9833097457885742, + "min_cosine_similarity": 0.786497950553894, + "mean_relative_l2": 0.17070554196834564, + "max_abs_delta": 4.3125 + }, + "period_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9782759547233582, + "min_cosine_similarity": 0.7623828053474426, + "mean_relative_l2": 0.19701920449733734, + "max_abs_delta": 6.0 + } + } + }, + "layer_19": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6cfaf7e8739b53ae55a18dfbd0eafa2d0b61e5fc1f82ac95e0330bc7ed97c0af", + "mean": -0.00040833279490470886, + "std": 1.0072084665298462, + "rms": 1.0072085857391357, + "max_abs": 31.625 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4895c68c8571f3fca6804843d3e0cd3aa9719512e76f5484dfb6bb0e30fcce1b", + "mean": -0.009812873788177967, + "std": 6.775091648101807, + "rms": 6.77509880065918, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "86e7a610f1fb2b3cfb09fe1f4767006259b098d8d4631fc605a73e5941cb2860", + "mean": -0.0006747120642103255, + "std": 1.0035367012023926, + "rms": 1.0035370588302612, + "max_abs": 31.375 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c4c313d63428dd453864bc7db3471522fe2782896ac0613b58064bddb4a342ab", + "mean": -0.011859847232699394, + "std": 6.636696815490723, + "rms": 6.636707305908203, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "69482fc13abd1c21ed7a2a5e87f9b13b83b1cb56b7730335e24839d6ae2dc46c", + "mean": 6.836366810603067e-05, + "std": 1.0081301927566528, + "rms": 1.0081301927566528, + "max_abs": 32.25 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c7c8e359a44af5524345394113b1488d2209dbd4c5e9aad9b4fc15098ae30b9f", + "mean": -0.0016446347581222653, + "std": 5.958713054656982, + "rms": 5.958714008331299, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e653b2972ea4c2718c12bbf4c8095d8010f4ba9cd223300d0647db453c37e58a", + "mean": -0.0009930796222761273, + "std": 1.0078554153442383, + "rms": 1.0078558921813965, + "max_abs": 30.875 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c96b9853157bd8c1478c3001cb38132fd1fe02a512184ca23136a98e7a68a0f2", + "mean": -0.003736198414117098, + "std": 5.661512851715088, + "rms": 5.6615142822265625, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "085ef46a2709ce79008e530f59b9d7d18c7fa8d686880a38a0583b7a36076c06", + "mean": 0.0009397336980327964, + "std": 1.0133718252182007, + "rms": 1.0133721828460693, + "max_abs": 30.75 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e3c8c3283e687ad9958dec9e8ef8038e4900ef57c065d1fef3c431717ac1ef59", + "mean": -0.0010466744424775243, + "std": 5.960222244262695, + "rms": 5.9602227210998535, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "502c6e585e2bcbe04549a93222fea0a20f4fc7e8f80868a623e4373726b9f9a5", + "mean": -0.0003825354215223342, + "std": 1.0064711570739746, + "rms": 1.0064711570739746, + "max_abs": 27.5 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c90b1a29b370c0b8eb7658a67c24fcc7d805ba1f01736a0ba910d6f5b1a0b7f7", + "mean": -0.0034006796777248383, + "std": 5.661690711975098, + "rms": 5.661692142486572, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3ec28a9a7de7450ce28ee9c0190a2ca895f4aad858516c6da29e19a43500c850", + "mean": 0.0003896969137713313, + "std": 1.014638066291809, + "rms": 1.0146381855010986, + "max_abs": 31.125 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "aef58acad127e765eb2732440483af66daaa7f0d6e8ce5e4fa5702ea1be34045", + "mean": -0.001324985409155488, + "std": 5.960019588470459, + "rms": 5.960020065307617, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1cc7f4ea7aa4b5710ce7079c94a65a7387c818cea86ca8f7d2703352f2c1d7a7", + "mean": -0.00015663541853427887, + "std": 1.0087145566940308, + "rms": 1.0087146759033203, + "max_abs": 27.625 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e31b166467f0a658104255afbbbb818e3fc128446d3c76bf818404c70ea5dd5e", + "mean": -0.0031146446708589792, + "std": 5.661899089813232, + "rms": 5.661899566650391, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9912023544311523, + "min_cosine_similarity": 0.9196348190307617, + "mean_relative_l2": 0.12268953025341034, + "max_abs_delta": 4.3125 + }, + "system_bos": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9908192157745361, + "min_cosine_similarity": 0.9554988145828247, + "mean_relative_l2": 0.12923207879066467, + "max_abs_delta": 4.09375 + }, + "system_x": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9779976010322571, + "min_cosine_similarity": 0.8026391267776489, + "mean_relative_l2": 0.19539542496204376, + "max_abs_delta": 9.0 + }, + "system_period": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9815052151679993, + "min_cosine_similarity": 0.8245733976364136, + "mean_relative_l2": 0.18055559694766998, + "max_abs_delta": 7.25 + }, + "bos_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9863967895507812, + "min_cosine_similarity": 0.8095982670783997, + "mean_relative_l2": 0.1506597399711609, + "max_abs_delta": 4.46875 + }, + "bos_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9855479001998901, + "min_cosine_similarity": 0.7604942321777344, + "mean_relative_l2": 0.15473221242427826, + "max_abs_delta": 8.0625 + }, + "x_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9835540652275085, + "min_cosine_similarity": 0.8231121897697449, + "mean_relative_l2": 0.17092253267765045, + "max_abs_delta": 4.25 + }, + "x_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.978813111782074, + "min_cosine_similarity": 0.7284961938858032, + "mean_relative_l2": 0.19287227094173431, + "max_abs_delta": 7.5 + }, + "period_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9835631251335144, + "min_cosine_similarity": 0.80123370885849, + "mean_relative_l2": 0.16984273493289948, + "max_abs_delta": 3.59375 + }, + "period_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9786208271980286, + "min_cosine_similarity": 0.773596465587616, + "mean_relative_l2": 0.19564390182495117, + "max_abs_delta": 5.375 + } + } + }, + "layer_20": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "64e65c15fe4db0dd0e8b32e7ffa050ec803d5fc0e71226b4ce8d6aec185a1390", + "mean": -6.619704072363675e-05, + "std": 1.1391370296478271, + "rms": 1.1391371488571167, + "max_abs": 33.0 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "aaeef5471858fbcefcc023db79fc3f22237200f68e21de1eaa9e7913f2bd17f3", + "mean": -0.009396261535584927, + "std": 6.996428966522217, + "rms": 6.996435165405273, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d6e83ae4682916d62edf72017d71f256c1b128f97a85e1206e1626a4c30aa661", + "mean": -0.0007526776171289384, + "std": 1.135659098625183, + "rms": 1.1356593370437622, + "max_abs": 33.0 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9cd15982f85d33a7cdeb50f045b1ed7da59435e5f6c26d7921f8e980286ed2f3", + "mean": -0.01184047944843769, + "std": 6.864344596862793, + "rms": 6.864354610443115, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6081ddc62928b0a7c07151da36fc6fa2bf7c6beca10b69b45789038b37f199f1", + "mean": 0.0008125434396788478, + "std": 1.1356253623962402, + "rms": 1.1356257200241089, + "max_abs": 33.0 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5ccd869b0b85f02417d8f33da737b9181831f4ceea593c156e075b9c303b97af", + "mean": -0.0013996714260429144, + "std": 5.982997894287109, + "rms": 5.982997894287109, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "049571c254fe4f1ebfee069504829a9b3b4c37881442284f7cb74c6795e41a4b", + "mean": -0.00033271548454649746, + "std": 1.1374146938323975, + "rms": 1.137414813041687, + "max_abs": 33.0 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "626e229b34d57b096d62602f9fbd3cb79ba3d56cb7dc64f103d8859b6b4659f6", + "mean": -0.0035432791337370872, + "std": 5.68858003616333, + "rms": 5.6885809898376465, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2e90c644f589c31341f05fac6546ea4e16652f10f5be3054304baa3734a43360", + "mean": 0.0015939985169097781, + "std": 1.1416343450546265, + "rms": 1.1416354179382324, + "max_abs": 32.25 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c2f6e213a50f0ed11a1ffc89f62d016d18b3cff87c26fdcff40540e35728e957", + "mean": -0.0008978650439530611, + "std": 5.984948635101318, + "rms": 5.984948635101318, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2dd4b70e59705cba874104f9c1e87193ed5a2188dd2f7be3d51787d28b738e11", + "mean": -0.0003788155736401677, + "std": 1.1413050889968872, + "rms": 1.1413050889968872, + "max_abs": 32.5 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c3c20f5b19ce8e96f05bf8a3cf2f39bc7ccaf327f3cb088a42777a6a2b343977", + "mean": -0.003717760555446148, + "std": 5.68973970413208, + "rms": 5.6897406578063965, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f7f79c016f1d21c3ae97cfdeb39cd7097c88ff606d904d1587a06da8071f194d", + "mean": 0.001008368912152946, + "std": 1.142338514328003, + "rms": 1.1423388719558716, + "max_abs": 32.5 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "066c405c341f45bf3fb6f88a2c2743bd62c07d6b7caea77ff2862141d09557d4", + "mean": -0.0011676972499117255, + "std": 5.984602451324463, + "rms": 5.984602451324463, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "57c6eb4b72d4dfd299fe2f87be33e8224690b59c948c145758a464776f75f8f9", + "mean": -0.00016898922331165522, + "std": 1.1437278985977173, + "rms": 1.1437278985977173, + "max_abs": 32.75 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a4fd70a6780a028d8e7a5b0edc95957c52f918eba619949d9b4c46de8532af19", + "mean": -0.003415843239054084, + "std": 5.689898490905762, + "rms": 5.689899921417236, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9913182854652405, + "min_cosine_similarity": 0.9228419065475464, + "mean_relative_l2": 0.12236925959587097, + "max_abs_delta": 3.75 + }, + "system_bos": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9910784363746643, + "min_cosine_similarity": 0.9563890099525452, + "mean_relative_l2": 0.1279716193675995, + "max_abs_delta": 3.65625 + }, + "system_x": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9781219363212585, + "min_cosine_similarity": 0.8021810054779053, + "mean_relative_l2": 0.19671876728534698, + "max_abs_delta": 8.5 + }, + "system_period": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9811972975730896, + "min_cosine_similarity": 0.8311020135879517, + "mean_relative_l2": 0.18325847387313843, + "max_abs_delta": 6.25 + }, + "bos_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9864248633384705, + "min_cosine_similarity": 0.8037635684013367, + "mean_relative_l2": 0.14967714250087738, + "max_abs_delta": 5.0625 + }, + "bos_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.985797107219696, + "min_cosine_similarity": 0.7711343169212341, + "mean_relative_l2": 0.15336890518665314, + "max_abs_delta": 6.625 + }, + "x_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9835584163665771, + "min_cosine_similarity": 0.819851279258728, + "mean_relative_l2": 0.17033018171787262, + "max_abs_delta": 5.875 + }, + "x_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9792053699493408, + "min_cosine_similarity": 0.7428033351898193, + "mean_relative_l2": 0.1924152821302414, + "max_abs_delta": 7.625 + }, + "period_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9834975600242615, + "min_cosine_similarity": 0.797880232334137, + "mean_relative_l2": 0.1695673018693924, + "max_abs_delta": 4.375 + }, + "period_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9788100123405457, + "min_cosine_similarity": 0.7848266959190369, + "mean_relative_l2": 0.19565683603286743, + "max_abs_delta": 5.125 + } + } + }, + "layer_21": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "597766baa6c6eaf7dbaa21f04a82244b15571522e18ba3692ab335d693d38830", + "mean": 0.0007591114845126867, + "std": 1.2280128002166748, + "rms": 1.228013038635254, + "max_abs": 43.25 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "405cd407db6d5d2e97c798e779a953e6fbc291ea07caf9d9ef594438cfe25484", + "mean": -0.008173257112503052, + "std": 7.07647705078125, + "rms": 7.076481342315674, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5c1f57ab6e41a91150f013c9d572a322a2aaac25ed911a0e2edf23b95558782c", + "mean": 0.00017496943473815918, + "std": 1.223218560218811, + "rms": 1.223218560218811, + "max_abs": 43.5 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b7524d339d5d0e43ee9f95b7e5a3ac24b44ba64dced5d0649a091d4c026b70a2", + "mean": -0.010267862118780613, + "std": 6.939786911010742, + "rms": 6.939794063568115, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e6f4713954674505478b94eb502b3c2034bd8a25950c26e704ed4bfe3502c2aa", + "mean": 0.001429885858669877, + "std": 1.2239335775375366, + "rms": 1.2239344120025635, + "max_abs": 43.5 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ce6f261808e9d39b592eb38761f64cd56ce648ff216bef7480683a16fa0c0193", + "mean": -0.000250521203270182, + "std": 5.986999034881592, + "rms": 5.98699951171875, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3eb59820119ed3cf6687051085c054f279279fc9fe22f3046d5b0be1ca904d70", + "mean": 0.0005847466527484357, + "std": 1.2226386070251465, + "rms": 1.222638726234436, + "max_abs": 42.5 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9b24a3a1b99d6af06a117ad14641771663b15ea47e4810f66413865c7f4ed545", + "mean": -0.0019176830537617207, + "std": 5.697463512420654, + "rms": 5.697463035583496, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "524498be1dda1d2bf4c41889e714b5bfdfb1e56c20e86a2da9b85dbc84afc27b", + "mean": 0.0018716971389949322, + "std": 1.2331973314285278, + "rms": 1.2331987619400024, + "max_abs": 43.5 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e2fc7b6118b8c86590ba26c2b698ed79e1170b659e1bfaf089ee61775e47f2d3", + "mean": -1.1921134500880726e-05, + "std": 5.990022659301758, + "rms": 5.990023136138916, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "20e90d440dae0e4e49c02cd9ef29aa92b6aa9b0c5f0fdcff8d9623155ddd6cd3", + "mean": -0.00020414900791365653, + "std": 1.2323098182678223, + "rms": 1.2323098182678223, + "max_abs": 44.25 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e77b6a9c2c8caa2f1197a4e2283b68a2ba8cd0332cd5d761d15fcff3e0a27ff0", + "mean": -0.002831811551004648, + "std": 5.700273036956787, + "rms": 5.700273513793945, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "df800639f1b03b25922faf30b19eb3c75bd1e274ed4977b3907654d6a54c3efe", + "mean": 0.001629166305065155, + "std": 1.232114553451538, + "rms": 1.232115626335144, + "max_abs": 43.5 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "65147f7acafb7c6837badcfaffa00597a78a1057fe71394436a373f9e540ef16", + "mean": -5.894262358197011e-05, + "std": 5.989010810852051, + "rms": 5.989011287689209, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bdf0e757daa3d3fe707238e9f882c26b5632024ba8a91766bd971a548551582a", + "mean": 0.00040294305654242635, + "std": 1.2325692176818848, + "rms": 1.2325693368911743, + "max_abs": 44.5 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bfcd81ecb4291414ebd8230c80f8b37f80736a9ca984ac03fa049f7d3a078d9b", + "mean": -0.0021836257074028254, + "std": 5.699563980102539, + "rms": 5.699564456939697, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9900075197219849, + "min_cosine_similarity": 0.921733021736145, + "mean_relative_l2": 0.1312360018491745, + "max_abs_delta": 4.8125 + }, + "system_bos": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9903119802474976, + "min_cosine_similarity": 0.9538143873214722, + "mean_relative_l2": 0.13416796922683716, + "max_abs_delta": 4.25 + }, + "system_x": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9748883843421936, + "min_cosine_similarity": 0.7974861860275269, + "mean_relative_l2": 0.21446923911571503, + "max_abs_delta": 8.375 + }, + "system_period": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9782419204711914, + "min_cosine_similarity": 0.8197733163833618, + "mean_relative_l2": 0.1987188756465912, + "max_abs_delta": 6.75 + }, + "bos_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9844158887863159, + "min_cosine_similarity": 0.8044752478599548, + "mean_relative_l2": 0.16079042851924896, + "max_abs_delta": 5.1640625 + }, + "bos_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9839255213737488, + "min_cosine_similarity": 0.7810292840003967, + "mean_relative_l2": 0.1639951765537262, + "max_abs_delta": 6.76171875 + }, + "x_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9815896153450012, + "min_cosine_similarity": 0.8194431066513062, + "mean_relative_l2": 0.18046972155570984, + "max_abs_delta": 7.0 + }, + "x_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9762860536575317, + "min_cosine_similarity": 0.7175919413566589, + "mean_relative_l2": 0.20632492005825043, + "max_abs_delta": 7.5625 + }, + "period_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9812567234039307, + "min_cosine_similarity": 0.79587322473526, + "mean_relative_l2": 0.18026603758335114, + "max_abs_delta": 5.0 + }, + "period_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9761062264442444, + "min_cosine_similarity": 0.7560526132583618, + "mean_relative_l2": 0.20827995240688324, + "max_abs_delta": 5.25 + } + } + }, + "layer_22": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "86c887928135eaa53747d42fd9e4941691cbb50ab789c6ac440b90933f163728", + "mean": 0.002660458441823721, + "std": 1.4022672176361084, + "rms": 1.402269721031189, + "max_abs": 57.75 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d71b6c02c7f8065aa6e1f6453fe6c9a1f09d049f7ad5a88bfb5a172fc270da76", + "mean": -0.006938389968127012, + "std": 7.108325004577637, + "rms": 7.108328342437744, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3989a9be816435a63465f876afdfb530bf28cd89427c37a3f3c6f450351be951", + "mean": 0.0020775676239281893, + "std": 1.3957394361495972, + "rms": 1.3957409858703613, + "max_abs": 58.0 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c0880329f7b5c70f630cbdc1b0188065ac7acf96b41d7c026050fccd4a527ea1", + "mean": -0.009352369233965874, + "std": 6.976192474365234, + "rms": 6.976198673248291, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "835216c0522a8177c27deade2d001a842269c4ea750305a361554ed7be73aac7", + "mean": 0.0027911560609936714, + "std": 1.3976187705993652, + "rms": 1.3976216316223145, + "max_abs": 57.0 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5c2d563d214a18329bb1d120e7ab56346f5a99c4fa7b2687627b20978c0eaeec", + "mean": 0.0005380245856940746, + "std": 6.024613857269287, + "rms": 6.024613857269287, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6f477d3d2783da69791e891c918d16e28df898ea236a8174289340a7747c39d0", + "mean": 0.002539257286116481, + "std": 1.3951526880264282, + "rms": 1.3951549530029297, + "max_abs": 57.0 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "568a007c327b59211ccb08ea03679800e10d081edbe9313bb5e77ad061a54a2b", + "mean": -0.000873350421898067, + "std": 5.742181301116943, + "rms": 5.742181301116943, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "de792c8b26a2ff0ca66e312465efd411d7c59366477ee218c304184667607da1", + "mean": 0.0035407799296081066, + "std": 1.407765507698059, + "rms": 1.407770037651062, + "max_abs": 58.25 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "88d2a38c1298d71a7a2a622036e8855cd1bfd0384e1071b546367518dae65116", + "mean": 0.0009808223694562912, + "std": 6.0284624099731445, + "rms": 6.0284624099731445, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1191542311aeda06cffd7decd7f671265b78c06e76acbfc2b7cb7ab963f57d0c", + "mean": 0.0027136621065437794, + "std": 1.4059938192367554, + "rms": 1.4059964418411255, + "max_abs": 58.0 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "dc59a4ebd08004054a51aa156f6e34b9ac4b0a2c1099de9002dd0e7ea5f92b44", + "mean": -0.0010207445593550801, + "std": 5.745940685272217, + "rms": 5.745941162109375, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "614ebc9edc1a0841401f55632607d5f5d0ce0a22d98c2e8141102956fdb7e66d", + "mean": 0.0032145814038813114, + "std": 1.4065526723861694, + "rms": 1.4065563678741455, + "max_abs": 58.5 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "521748294faf9fbbfed7387e9f839e7fe979e9a5d27b2a3c9506d69ed1510144", + "mean": 0.0008523131255060434, + "std": 6.02712869644165, + "rms": 6.02712869644165, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "efe2f7228a07b7a3f61d6b381ff3744c5553ea730b56241c6afc25eaa9f9719b", + "mean": 0.002831115387380123, + "std": 1.4043837785720825, + "rms": 1.4043866395950317, + "max_abs": 58.5 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8484261aa9f8ce6683bf1a6c1d766ad883d3aa7194bc9f273ad96f0916b883ff", + "mean": -0.0006942008621990681, + "std": 5.74462890625, + "rms": 5.74462890625, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9891149997711182, + "min_cosine_similarity": 0.9021190404891968, + "mean_relative_l2": 0.13615857064723969, + "max_abs_delta": 4.875 + }, + "system_bos": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9895832538604736, + "min_cosine_similarity": 0.9382409453392029, + "mean_relative_l2": 0.13861416280269623, + "max_abs_delta": 4.5 + }, + "system_x": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9734739661216736, + "min_cosine_similarity": 0.8010336756706238, + "mean_relative_l2": 0.21948152780532837, + "max_abs_delta": 9.25 + }, + "system_period": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.976317822933197, + "min_cosine_similarity": 0.8234201669692993, + "mean_relative_l2": 0.2057681679725647, + "max_abs_delta": 8.25 + }, + "bos_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9826012253761292, + "min_cosine_similarity": 0.7773544788360596, + "mean_relative_l2": 0.1676214635372162, + "max_abs_delta": 5.0 + }, + "bos_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9823434948921204, + "min_cosine_similarity": 0.7492807507514954, + "mean_relative_l2": 0.1706908643245697, + "max_abs_delta": 7.078125 + }, + "x_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9801297783851624, + "min_cosine_similarity": 0.8079295754432678, + "mean_relative_l2": 0.1862393170595169, + "max_abs_delta": 6.625 + }, + "x_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9750854969024658, + "min_cosine_similarity": 0.7017155289649963, + "mean_relative_l2": 0.21009759604930878, + "max_abs_delta": 7.5 + }, + "period_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9796330332756042, + "min_cosine_similarity": 0.790785014629364, + "mean_relative_l2": 0.18675732612609863, + "max_abs_delta": 5.125 + }, + "period_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9746748805046082, + "min_cosine_similarity": 0.7290488481521606, + "mean_relative_l2": 0.2122000753879547, + "max_abs_delta": 6.5 + } + } + }, + "layer_23": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "03ffef7cf9664c6eec1af397185f81b0708b3bd22de373f0e6bb98e99d8863bd", + "mean": -0.0013656506780534983, + "std": 1.7906979322433472, + "rms": 1.790698528289795, + "max_abs": 86.0 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c5cfa9cab8ee9a056df019932d18e32ab73d63c6025a27523826d3c84fc5c97b", + "mean": -0.010227539576590061, + "std": 7.1636481285095215, + "rms": 7.163655757904053, + "max_abs": 1160.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4513550e6daa11579e66d28b2c330d0fd6b289eeb764e37630db539567806858", + "mean": -0.0020028005819767714, + "std": 1.7794592380523682, + "rms": 1.7794603109359741, + "max_abs": 87.0 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a0f804bd38927f49738b4a68f09fcd941acaa98f76f51ffa5700ce705624a4bb", + "mean": -0.011590857990086079, + "std": 7.035829067230225, + "rms": 7.035838603973389, + "max_abs": 1160.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d429e1293788d5ef06532b4baf6965da706c64d75e67ad067449df4014f0e6b8", + "mean": -0.0008587942575104535, + "std": 1.7754795551300049, + "rms": 1.7754796743392944, + "max_abs": 85.5 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "55e0dd01836510e040030b468a9196cde5763cc3bb54f0348d1b7fd950224868", + "mean": -0.0025213167537003756, + "std": 6.095463275909424, + "rms": 6.09546422958374, + "max_abs": 1160.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1539ab55ab7673c9ed7589e6d159e2372c5b9bfdeb625f5e5509aa1fc3becb63", + "mean": -0.0017647978384047747, + "std": 1.7735382318496704, + "rms": 1.7735390663146973, + "max_abs": 85.0 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7463fe5a3f42cf41a4a8ab0a3646cc8d8ee33e6e34bc3c6e6f99f012843aa078", + "mean": -0.003265561070293188, + "std": 5.8244218826293945, + "rms": 5.824422836303711, + "max_abs": 1160.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "044e29e3f4fcd1ceb140b263e421e9564be4b62151f80e12bcb6904799a9daf3", + "mean": -1.546032763144467e-05, + "std": 1.791094422340393, + "rms": 1.7910943031311035, + "max_abs": 87.0 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8cf4ef4123a7269408f39a54bbc4f80deff89c96379cd1e596ed82ccd6e9d3e1", + "mean": -0.0018953015096485615, + "std": 6.102547645568848, + "rms": 6.102548122406006, + "max_abs": 1160.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9a3ba40b1c35dd7be4422c2e551ecdb4858785cca6b838c1b2fffc9b61ebef3f", + "mean": -0.001414250466041267, + "std": 1.792517900466919, + "rms": 1.7925184965133667, + "max_abs": 87.5 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "79a6973603c6c356188317b2f5bf3675aaccfd9af7d0ebd39b5698b8c36d811b", + "mean": -0.0034796844702214003, + "std": 5.832141876220703, + "rms": 5.832143306732178, + "max_abs": 1160.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "53c9652b51dddc888614514bdd087a830b3fba7c7f896b248338ec53934230e7", + "mean": -0.0010560093214735389, + "std": 1.786974549293518, + "rms": 1.7869749069213867, + "max_abs": 87.0 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d63c700b34c002872e9a9f0f9cf45eae7bf07d7ef9e42d80debe3a3e90a6ca3f", + "mean": -0.002863614819943905, + "std": 6.099540710449219, + "rms": 6.099541664123535, + "max_abs": 1160.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a803f96e8c5ca9630e325d3d3a31239f8fb17f03a1fd145551fa865ff9a52102", + "mean": -0.0010014551226049662, + "std": 1.7880672216415405, + "rms": 1.7880675792694092, + "max_abs": 87.5 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5bc54b1af495d31076b05ef8ca882850d4f4621663c88a41b8b60259934f1640", + "mean": -0.002969614928588271, + "std": 5.8294901847839355, + "rms": 5.829490661621094, + "max_abs": 1160.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9909952878952026, + "min_cosine_similarity": 0.9048349857330322, + "mean_relative_l2": 0.12419398874044418, + "max_abs_delta": 6.0 + }, + "system_bos": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9910327792167664, + "min_cosine_similarity": 0.9365152716636658, + "mean_relative_l2": 0.12885843217372894, + "max_abs_delta": 5.75 + }, + "system_x": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9779022932052612, + "min_cosine_similarity": 0.8401228785514832, + "mean_relative_l2": 0.2011079341173172, + "max_abs_delta": 11.375 + }, + "system_period": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9799156785011292, + "min_cosine_similarity": 0.8395296335220337, + "mean_relative_l2": 0.18986444175243378, + "max_abs_delta": 9.0 + }, + "bos_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.985281229019165, + "min_cosine_similarity": 0.8018611073493958, + "mean_relative_l2": 0.15328119695186615, + "max_abs_delta": 6.5 + }, + "bos_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.985038161277771, + "min_cosine_similarity": 0.7754008173942566, + "mean_relative_l2": 0.15704192221164703, + "max_abs_delta": 8.533203125 + }, + "x_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.983404815196991, + "min_cosine_similarity": 0.8433047533035278, + "mean_relative_l2": 0.17039446532726288, + "max_abs_delta": 12.0 + }, + "x_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9794017672538757, + "min_cosine_similarity": 0.7581173181533813, + "mean_relative_l2": 0.19208043813705444, + "max_abs_delta": 13.25 + }, + "period_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9828283786773682, + "min_cosine_similarity": 0.8207544684410095, + "mean_relative_l2": 0.17107883095741272, + "max_abs_delta": 7.25 + }, + "period_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9790235161781311, + "min_cosine_similarity": 0.7678470015525818, + "mean_relative_l2": 0.19370733201503754, + "max_abs_delta": 9.5 + } + } + }, + "layer_24": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0df01af315f3747a28e37ee7fa201899574ff7965044600626fa660ce17baa42", + "mean": -0.00772209744900465, + "std": 2.189871311187744, + "rms": 2.189884901046753, + "max_abs": 112.0 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cd19b39098d91dfe6786fb06fb642a521f70bf46e028e44eb103fb0e4335588b", + "mean": -0.016480326652526855, + "std": 6.823879718780518, + "rms": 6.82390022277832, + "max_abs": 1008.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "64ce863f558bd7e3420140db54e09a28a4cfdb5b4fa1aaf6fc23194aec3b4e79", + "mean": -0.007695630192756653, + "std": 2.1745245456695557, + "rms": 2.1745381355285645, + "max_abs": 114.0 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "27a99b1c9c8004a46330f66a5c5d1001ddaa6a7452ea5c2a1c381036697f056e", + "mean": -0.01635955460369587, + "std": 6.916172504425049, + "rms": 6.916192054748535, + "max_abs": 1120.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4f882893274803c2224438ac09116bdb7224da853a756a89412d26010a45faff", + "mean": -0.006530895829200745, + "std": 2.1704483032226562, + "rms": 2.1704583168029785, + "max_abs": 108.0 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cc9bdc14826156fc46501712d353e96a34006087f6d5a182eb76c887b4cde3b7", + "mean": -0.0072297449223697186, + "std": 4.508160591125488, + "rms": 4.508166790008545, + "max_abs": 840.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "24c4ad2d2f31f6c2fc596f25f3fe0da24fe9368f23fe69a485729db5d6a85eef", + "mean": -0.00797082670032978, + "std": 2.167836904525757, + "rms": 2.167851686477661, + "max_abs": 110.0 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9b77d16ea2f437b4d2970c746c639541f72737308439b4f4d17b1ffcb2b79818", + "mean": -0.007446059491485357, + "std": 4.370502471923828, + "rms": 4.370508670806885, + "max_abs": 840.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "26d4f4b950bc20271dfffd2ef1d9068b18bb12af9acb04e00bd5c8f4808c95ea", + "mean": -0.005263102240860462, + "std": 2.185624599456787, + "rms": 2.185631036758423, + "max_abs": 109.0 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8b650eed7f32d70a1eec10e74edaf5e2cc941a3bf9695c0e402da5a4b839694c", + "mean": -0.006349512841552496, + "std": 4.5202131271362305, + "rms": 4.5202178955078125, + "max_abs": 840.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3b4f039e532886ddca4264cfde11e30e1d9d7e5f8a4664b46bdd13fa9ccbeee0", + "mean": -0.006033560261130333, + "std": 2.188389778137207, + "rms": 2.1883981227874756, + "max_abs": 114.0 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b5ded469cfd5581728ea8e968999f3417c1ec539b9f3ee16fd72b43fc79fa630", + "mean": -0.006780874449759722, + "std": 4.384566307067871, + "rms": 4.384571552276611, + "max_abs": 840.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a230e6b852cfe90f974751150f27991e2dcc18eeba968e424fb0f7621bacd72b", + "mean": -0.0061782714910805225, + "std": 2.1822781562805176, + "rms": 2.1822867393493652, + "max_abs": 110.5 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "610091595f50ec2974d903812d38bf1b4ad7ddb1ab73e26c54aaa22401f8479d", + "mean": -0.007094665430486202, + "std": 4.515612602233887, + "rms": 4.515618324279785, + "max_abs": 840.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8665414f7a078ab56905d664251b926b9444cca7bc281683ece759388a78b4c2", + "mean": -0.006416297983378172, + "std": 2.1827139854431152, + "rms": 2.1827235221862793, + "max_abs": 114.0 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "68e3047f3ca3bf28a712d64b3aa4b647c3a131f8a40da02b2f47e31bbee94256", + "mean": -0.0067147258669137955, + "std": 4.379541397094727, + "rms": 4.379546165466309, + "max_abs": 840.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9921531677246094, + "min_cosine_similarity": 0.8978490233421326, + "mean_relative_l2": 0.11491286754608154, + "max_abs_delta": 10.5 + }, + "system_bos": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.992165744304657, + "min_cosine_similarity": 0.9381662607192993, + "mean_relative_l2": 0.11916067451238632, + "max_abs_delta": 6.5 + }, + "system_x": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9804480075836182, + "min_cosine_similarity": 0.8485447764396667, + "mean_relative_l2": 0.18777699768543243, + "max_abs_delta": 13.75 + }, + "system_period": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.982304573059082, + "min_cosine_similarity": 0.8435481190681458, + "mean_relative_l2": 0.17689841985702515, + "max_abs_delta": 11.0 + }, + "bos_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9874212145805359, + "min_cosine_similarity": 0.829734206199646, + "mean_relative_l2": 0.14109010994434357, + "max_abs_delta": 8.5 + }, + "bos_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9871169924736023, + "min_cosine_similarity": 0.8018876314163208, + "mean_relative_l2": 0.14521531760692596, + "max_abs_delta": 8.96875 + }, + "x_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9859378337860107, + "min_cosine_similarity": 0.8624839186668396, + "mean_relative_l2": 0.15623198449611664, + "max_abs_delta": 15.5 + }, + "x_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9818724393844604, + "min_cosine_similarity": 0.7701916694641113, + "mean_relative_l2": 0.1778736114501953, + "max_abs_delta": 15.0 + }, + "period_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9849936366081238, + "min_cosine_similarity": 0.8393317461013794, + "mean_relative_l2": 0.1588621884584427, + "max_abs_delta": 8.5 + }, + "period_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9821041822433472, + "min_cosine_similarity": 0.7772176861763, + "mean_relative_l2": 0.1778712123632431, + "max_abs_delta": 10.5 + } + } + }, + "layer_25": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "96e3851736cd1ac28972e57a6186efa68b87a2eaf3744fabc5646a5de160f0c9", + "mean": -0.028534075245261192, + "std": 3.0566868782043457, + "rms": 3.0568199157714844, + "max_abs": 154.0 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "aabf1b6527e30358101f406520a8cdf8d3dca44c8b0dd044a891824eb82b1a1c", + "mean": -0.035918742418289185, + "std": 5.621984004974365, + "rms": 5.622098445892334, + "max_abs": 872.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "58e52b18f2e4e3de9da4d380b7a300f6df8cb54101aa1d6022a8a3826a2392a2", + "mean": -0.026332447305321693, + "std": 3.0304386615753174, + "rms": 3.030553102493286, + "max_abs": 157.0 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "211a94e0497f5109146c9f59d99a5cc9de010ae50f4d785e065068815adbe7d5", + "mean": -0.03344067931175232, + "std": 5.839773654937744, + "rms": 5.839869022369385, + "max_abs": 984.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "298827b3d1f5177b353cf7cbc446c159a8257d841a0fc8d6bbcf591b9f5b5f16", + "mean": -0.02732292376458645, + "std": 3.0274863243103027, + "rms": 3.027609348297119, + "max_abs": 154.0 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7a5113d479240ab3d50fee01b06d4a09a6dbd6b877c2dfbd6edd02a98a20a576", + "mean": -0.02603749744594097, + "std": 3.2671377658843994, + "rms": 3.2672414779663086, + "max_abs": 248.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e010669b66bee04b17b80e896018ae31d72ff57aa16d31b628bccc647dac064f", + "mean": -0.027676647529006004, + "std": 3.0193893909454346, + "rms": 3.0195162296295166, + "max_abs": 152.0 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "405913fd7557a438a00386bb4a3828b7c22b48e279996fc0e856e38f29d693b6", + "mean": -0.024737650528550148, + "std": 3.312950372695923, + "rms": 3.3130428791046143, + "max_abs": 248.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7cc6bcd22754d4a1a9af9a9687171e3af227c2bef2418e20a192727eb9d5e354", + "mean": -0.026484748348593712, + "std": 3.045522928237915, + "rms": 3.045637845993042, + "max_abs": 153.0 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "446fe5571511580bd20a84c876d997f54e3a3f5c3563c936b430d24d40d33240", + "mean": -0.02597970888018608, + "std": 3.29736328125, + "rms": 3.2974655628204346, + "max_abs": 248.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0c2ad3dd7025b3a72eba9fc4013f4d08dca309ed7543dad8deb2245d732f07e2", + "mean": -0.023708289489150047, + "std": 3.046837091445923, + "rms": 3.046929359436035, + "max_abs": 158.0 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f55af45de4d46f4094abe3e6ef899c5db2f2bbefec6809bf73686ba1c214d463", + "mean": -0.022416124120354652, + "std": 3.3461215496063232, + "rms": 3.3461966514587402, + "max_abs": 248.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "32deba0f5a21881aa97acc428366af0865efef90c67b744f892c4afe4040c842", + "mean": -0.027347346767783165, + "std": 3.0408129692077637, + "rms": 3.040936231613159, + "max_abs": 153.0 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e05a5118a552bdb6d0c8a24083d2cc82dc5498444dc063661f3f2c3951ad8350", + "mean": -0.026454418897628784, + "std": 3.2853147983551025, + "rms": 3.285421371459961, + "max_abs": 248.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2f2a0ac7b7cdb52896673daccb1edf77aa0691eaa0456d584385b7a938269b39", + "mean": -0.02507527731359005, + "std": 3.0316083431243896, + "rms": 3.031712055206299, + "max_abs": 157.0 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9e0f08f8bcd2b3417ce2b859a0db1c3c9bc36b178983f3f9fc0ae0556b8ce71f", + "mean": -0.022972656413912773, + "std": 3.3284523487091064, + "rms": 3.328531503677368, + "max_abs": 248.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9944197535514832, + "min_cosine_similarity": 0.9148858189582825, + "mean_relative_l2": 0.09672293066978455, + "max_abs_delta": 25.0 + }, + "system_bos": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9944719076156616, + "min_cosine_similarity": 0.9463382959365845, + "mean_relative_l2": 0.10010607540607452, + "max_abs_delta": 16.5 + }, + "system_x": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9863780736923218, + "min_cosine_similarity": 0.8902704119682312, + "mean_relative_l2": 0.15696145594120026, + "max_abs_delta": 32.0 + }, + "system_period": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9875491857528687, + "min_cosine_similarity": 0.8883650302886963, + "mean_relative_l2": 0.14816734194755554, + "max_abs_delta": 22.0 + }, + "bos_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9917013645172119, + "min_cosine_similarity": 0.8762803673744202, + "mean_relative_l2": 0.11534354835748672, + "max_abs_delta": 19.5 + }, + "bos_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9914990067481995, + "min_cosine_similarity": 0.8516720533370972, + "mean_relative_l2": 0.11871366202831268, + "max_abs_delta": 18.0 + }, + "x_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9910302758216858, + "min_cosine_similarity": 0.9053568243980408, + "mean_relative_l2": 0.1258537918329239, + "max_abs_delta": 20.0 + }, + "x_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9881185293197632, + "min_cosine_similarity": 0.8335824012756348, + "mean_relative_l2": 0.1448013186454773, + "max_abs_delta": 26.5 + }, + "period_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9903810024261475, + "min_cosine_similarity": 0.889977753162384, + "mean_relative_l2": 0.12784257531166077, + "max_abs_delta": 15.5 + }, + "period_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9881221055984497, + "min_cosine_similarity": 0.8328220248222351, + "mean_relative_l2": 0.14509816467761993, + "max_abs_delta": 19.5 + } + } + }, + "layer_26": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fd632d48e9fca4859287649ab29f50a3efca1b4491fa311b2c10ea669bbf8bd5", + "mean": -0.0529097318649292, + "std": 3.60378360748291, + "rms": 3.6041722297668457, + "max_abs": 205.0 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "331d3ae05b954bd3d4a86e1900f27536ddcbc8727b15fe7b48a266550da7ed74", + "mean": -0.06080222874879837, + "std": 5.939528942108154, + "rms": 5.939839839935303, + "max_abs": 840.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "29c00c61f48e63ad4c2e7e5571bc91e867a4aff85bfdc42361577c509a8ee300", + "mean": -0.04467613995075226, + "std": 3.474006175994873, + "rms": 3.4742934703826904, + "max_abs": 196.0 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1292c96ac8e10a7e0233685573e51c93a7dbf465bd10ae9b5f4115bec9236a99", + "mean": -0.048482395708560944, + "std": 6.122309684753418, + "rms": 6.122501373291016, + "max_abs": 872.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0055472e935751963fa60ff6407ed006e26d8164d0eb80d35bde82e1131fbc3e", + "mean": -0.05127674713730812, + "std": 3.5262253284454346, + "rms": 3.5265982151031494, + "max_abs": 210.0 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d6e18e85aefb2acb56e876a82b2cccd4f9b8010f636cf10ee3763013975badb8", + "mean": -0.04936152324080467, + "std": 4.131270408630371, + "rms": 4.131565570831299, + "max_abs": 768.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0ff618d02fd0d79bb2d4f17ffd04a7965725d0d8d3fefa16957d20829d10ad70", + "mean": -0.04732527583837509, + "std": 3.509345054626465, + "rms": 3.5096640586853027, + "max_abs": 201.0 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9de5c88a7453f6cc807ac539e28b13472b7b5ee18821820f66fff37dc3b7c825", + "mean": -0.0394144132733345, + "std": 4.281216144561768, + "rms": 4.281397342681885, + "max_abs": 768.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6bc4142dba8a1fc48c9f0e6d3403f090a8bda748fb7ac58f4d384946a8bdc060", + "mean": -0.05012809485197067, + "std": 3.520751953125, + "rms": 3.521109104156494, + "max_abs": 204.0 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bedc301eb87bafb4f5137c6d2ac71290b98ca5a426e3f37c617b4cf46a9ec880", + "mean": -0.049224283546209335, + "std": 4.153073310852051, + "rms": 4.153365612030029, + "max_abs": 768.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0a8d167d5cdeb719f7667004e043f46d2bc5c7f9be3e43e585bd1d910e837d78", + "mean": -0.03650817647576332, + "std": 3.3716511726379395, + "rms": 3.3718488216400146, + "max_abs": 173.0 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cdd3a423e41c932238e32f638205713a000bfc280bcf18b248d7a00d7e63ad68", + "mean": -0.03199980780482292, + "std": 4.201714515686035, + "rms": 4.201836585998535, + "max_abs": 768.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c4b2fa880489f201e4c16205daf9dc108cc92bcc7e6b5331d2c5ceca4d0cfdfc", + "mean": -0.05065830424427986, + "std": 3.485380172729492, + "rms": 3.485748291015625, + "max_abs": 197.0 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "073be9cc609466f2341ea4f92b07aff919b62515054b6563f6bd7c0667a28461", + "mean": -0.049358248710632324, + "std": 4.110057830810547, + "rms": 4.110353946685791, + "max_abs": 768.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9befdaccf37843a0f9fdeed0d0f3d145d2aa1da962e0611abe21f59e0abe2b17", + "mean": -0.038316402584314346, + "std": 3.33180832862854, + "rms": 3.33202862739563, + "max_abs": 166.0 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "759356bd3b21b5ca3f36811fd8094eda4c82bf5d740926ec19d34f09ba0a5cf3", + "mean": -0.03296097368001938, + "std": 4.156240940093994, + "rms": 4.1563720703125, + "max_abs": 768.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9931437969207764, + "min_cosine_similarity": 0.8606462478637695, + "mean_relative_l2": 0.11132151633501053, + "max_abs_delta": 48.5 + }, + "system_bos": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.993356466293335, + "min_cosine_similarity": 0.9122872352600098, + "mean_relative_l2": 0.11617232114076614, + "max_abs_delta": 60.0 + }, + "system_x": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9824737310409546, + "min_cosine_similarity": 0.8540787100791931, + "mean_relative_l2": 0.1831197738647461, + "max_abs_delta": 49.75 + }, + "system_period": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9840459823608398, + "min_cosine_similarity": 0.8405369520187378, + "mean_relative_l2": 0.17087671160697937, + "max_abs_delta": 38.0 + }, + "bos_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9916240572929382, + "min_cosine_similarity": 0.8417094349861145, + "mean_relative_l2": 0.12060610204935074, + "max_abs_delta": 47.5 + }, + "bos_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9912880063056946, + "min_cosine_similarity": 0.7840648889541626, + "mean_relative_l2": 0.12562040984630585, + "max_abs_delta": 66.0 + }, + "x_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9912832975387573, + "min_cosine_similarity": 0.8810680508613586, + "mean_relative_l2": 0.13003578782081604, + "max_abs_delta": 41.5 + }, + "x_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9871243238449097, + "min_cosine_similarity": 0.7612038850784302, + "mean_relative_l2": 0.15846385061740875, + "max_abs_delta": 51.5 + }, + "period_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9904707670211792, + "min_cosine_similarity": 0.855854868888855, + "mean_relative_l2": 0.1330999881029129, + "max_abs_delta": 42.5 + }, + "period_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9871322512626648, + "min_cosine_similarity": 0.7613017559051514, + "mean_relative_l2": 0.1566789448261261, + "max_abs_delta": 31.0 + } + } + }, + "final_norm": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2258f9f22528ba9fe3754ad068d9d5860e2d0dc1086b655b67e45b0681f85ce6", + "mean": -0.0062897116877138615, + "std": 0.6498640179634094, + "rms": 0.6498944759368896, + "max_abs": 28.875 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "434617d6901dfb36686c9169c5a30fd1676ce9fe4213d7b1730e4c52e1221a52", + "mean": -0.005941891577094793, + "std": 0.6403380036354065, + "rms": 0.6403656005859375, + "max_abs": 28.875 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "eea21099a2449e96a87abc176f2ddfe070570c9c0afbbe157d50585d8171b572", + "mean": -0.0049651325680315495, + "std": 0.6413089632987976, + "rms": 0.6413281559944153, + "max_abs": 29.0 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b3bb27abbff105068f70c73eb0ddfb7414fd69ede37f0122057e47a826b015e6", + "mean": -0.0038818824104964733, + "std": 0.6200742125511169, + "rms": 0.6200863718986511, + "max_abs": 29.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "02e7b54645f3ed9e27db225cdce9d655d181089c1f900098b868ad2322b3d262", + "mean": -0.0063734157010912895, + "std": 0.6580918431282043, + "rms": 0.658122718334198, + "max_abs": 30.125 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4803381312eb19780d843708ad4a2a93891db2e3bf357857740cd4bbf0988fd5", + "mean": -0.005943065509200096, + "std": 0.6482219696044922, + "rms": 0.6482492089271545, + "max_abs": 30.125 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cc1b1a7d86e35a227da7078abce8123b879f67e5570e9c8641154af652de1daa", + "mean": -0.0055204578675329685, + "std": 0.6472740173339844, + "rms": 0.6472975611686707, + "max_abs": 29.375 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f43f0da7653b9bd1971e3ebce0945e65faae063eaf82d50dc4d3041e9604b4d9", + "mean": -0.004186516627669334, + "std": 0.6246031522750854, + "rms": 0.6246171593666077, + "max_abs": 29.375 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0cb0a53153b3e2951efacdc35400251daecfb11be6fcfc493047a1c5fe1a8501", + "mean": -0.006020864937454462, + "std": 0.6584575176239014, + "rms": 0.6584849953651428, + "max_abs": 29.0 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f142558c2537cf469f075833115a82088f0611f74f99a3a027678418a87afd66", + "mean": -0.0056747267954051495, + "std": 0.6468239426612854, + "rms": 0.6468487977981567, + "max_abs": 29.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d11d67de272f12f49d8cc92ce79b5ddacd79b8e93bb78a2e4120a7356d9ec253", + "mean": -0.003395716892555356, + "std": 0.6484001278877258, + "rms": 0.6484090685844421, + "max_abs": 29.125 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "318d0bc6cd44f45ba6f5c20fb80c613e8bcf71ef3c7790c50a6483506391c18d", + "mean": -0.002620035782456398, + "std": 0.6246103048324585, + "rms": 0.6246157884597778, + "max_abs": 29.125 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "121626c09d96d2dbff968f3738f2ac3158c0020a659a9b8ba37fd3fe0d33a92f", + "mean": -0.006262286100536585, + "std": 0.6609669327735901, + "rms": 0.6609965562820435, + "max_abs": 29.375 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d249e307d07336c134ecdc945c3f2c96cee3be6ab21c6d772c3363169d464ed6", + "mean": -0.005903271026909351, + "std": 0.6500747799873352, + "rms": 0.6501016020774841, + "max_abs": 29.375 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "95af152dbdd0dc480f0823d486d0362741db2a875efa44fcb34d02822fb1e593", + "mean": -0.003921298775821924, + "std": 0.6484860777854919, + "rms": 0.6484979391098022, + "max_abs": 29.375 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d2fcf6b66f74f470ae678e1302920d3513add0b84babd4bb7421e15891033a2f", + "mean": -0.002951346803456545, + "std": 0.626270592212677, + "rms": 0.626277506351471, + "max_abs": 29.375 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9908339381217957, + "min_cosine_similarity": 0.82728111743927, + "mean_relative_l2": 0.1211676299571991, + "max_abs_delta": 4.5625 + }, + "system_bos": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9916240572929382, + "min_cosine_similarity": 0.9215848445892334, + "mean_relative_l2": 0.12194666266441345, + "max_abs_delta": 3.90625 + }, + "system_x": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9766969680786133, + "min_cosine_similarity": 0.8458014130592346, + "mean_relative_l2": 0.19880062341690063, + "max_abs_delta": 4.75 + }, + "system_period": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9779573082923889, + "min_cosine_similarity": 0.8032277822494507, + "mean_relative_l2": 0.18966953456401825, + "max_abs_delta": 6.375 + }, + "bos_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9889870882034302, + "min_cosine_similarity": 0.8268148303031921, + "mean_relative_l2": 0.13356421887874603, + "max_abs_delta": 3.6875 + }, + "bos_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9875956177711487, + "min_cosine_similarity": 0.709216296672821, + "mean_relative_l2": 0.13841286301612854, + "max_abs_delta": 8.625 + }, + "x_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9886182546615601, + "min_cosine_similarity": 0.8768360614776611, + "mean_relative_l2": 0.14273907244205475, + "max_abs_delta": 4.375 + }, + "x_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9812825918197632, + "min_cosine_similarity": 0.6982291340827942, + "mean_relative_l2": 0.177516371011734, + "max_abs_delta": 4.328125 + }, + "period_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9876015782356262, + "min_cosine_similarity": 0.844238817691803, + "mean_relative_l2": 0.14709360897541046, + "max_abs_delta": 4.375 + }, + "period_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.981643557548523, + "min_cosine_similarity": 0.7093757390975952, + "mean_relative_l2": 0.17656183242797852, + "max_abs_delta": 4.5 + } + } + } + }, + "router_layers": { + "layer_01": { + "layer": 1, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "2cc7a06b9993c21210ed679e2f4baed981b433684ebbc2d5a5d301ea944da8ce", + "route_weight_sha256": "5c8965f75a558f0ddb43c5704fe2cc1876cf8cf7ccff17a9c3926f02612d5af0", + "loads": [ + 14, + 11, + 4, + 14, + 2, + 11, + 13, + 22, + 9, + 25, + 9, + 4, + 7, + 17, + 8, + 9, + 20, + 16, + 3, + 12, + 6, + 15, + 13, + 20, + 23, + 17, + 4, + 16, + 3, + 26, + 2, + 18, + 10, + 12, + 2, + 7, + 2, + 8, + 20, + 1, + 15, + 17, + 12, + 12, + 2, + 2, + 26, + 5, + 13, + 17, + 6, + 3, + 11, + 12, + 0, + 10, + 5, + 18, + 5, + 27, + 25, + 0, + 17, + 5 + ], + "weighted_loads": [ + 0.5679469518363476, + 0.40237841941416264, + 0.11145325005054474, + 0.44129003398120403, + 0.18250754475593567, + 1.3494640477001667, + 1.1453611087054014, + 0.5338057968765497, + 0.35869601741433144, + 1.4012542311102152, + 0.21536505781114101, + 0.11237002722918987, + 0.18396544083952904, + 1.1659924127161503, + 0.3140401616692543, + 0.29856228828430176, + 1.8350555133074522, + 0.6834687814116478, + 0.07870187796652317, + 0.33232406713068485, + 0.32075330056250095, + 0.5849972348660231, + 1.222094900906086, + 0.527368588373065, + 1.9134617447853088, + 1.137239571660757, + 0.17987398616969585, + 0.9647250529378653, + 0.08068988658487797, + 1.279383199289441, + 0.049817467108368874, + 1.690456137061119, + 0.4915318936109543, + 0.8856904413551092, + 0.050013964995741844, + 0.19922073557972908, + 0.10536514222621918, + 0.6301073133945465, + 1.3447177931666374, + 0.07802438735961914, + 1.1867067702114582, + 0.5869310572743416, + 0.46969401463866234, + 0.45393345691263676, + 0.05070186220109463, + 0.11098349839448929, + 0.8521265760064125, + 0.23570998944342136, + 0.4249950237572193, + 0.5074611399322748, + 0.16872961446642876, + 0.3283277153968811, + 0.42981624789536, + 0.5169896949082613, + 0.0, + 1.152165986597538, + 0.22529133409261703, + 0.637687012553215, + 0.12261231988668442, + 0.6576191615313292, + 1.26264588534832, + 0.0, + 1.7849888168275356, + 0.13268346153199673 + ], + "unique_experts": 62, + "load_cv": 0.6499762578759852, + "normalized_load_entropy": 0.943907121691214, + "max_load_share": 0.0375 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "7dd0454e6348e59d9b9fe09022a4fa88902f025f7b5e05924bec5c41e6880bed", + "route_weight_sha256": "5c8643712b89137be4bc77c6cff4f63d26e4acf2f6504ec5e30c7ddba945d82d", + "loads": [ + 15, + 11, + 6, + 16, + 4, + 11, + 15, + 24, + 26, + 26, + 11, + 4, + 7, + 17, + 9, + 18, + 20, + 18, + 3, + 13, + 9, + 15, + 14, + 21, + 23, + 21, + 17, + 17, + 3, + 26, + 2, + 23, + 12, + 14, + 2, + 7, + 2, + 8, + 21, + 4, + 15, + 27, + 12, + 18, + 3, + 13, + 26, + 6, + 13, + 17, + 7, + 4, + 15, + 13, + 3, + 14, + 9, + 25, + 6, + 38, + 26, + 3, + 17, + 5 + ], + "weighted_loads": [ + 0.6441837809979916, + 0.40237841941416264, + 0.21392204239964485, + 0.5042578168213367, + 0.23421544395387173, + 1.3494640477001667, + 1.2955046948045492, + 0.8019408974796534, + 1.2504451423883438, + 1.4229520075023174, + 0.37112400494515896, + 0.11237002722918987, + 0.18396544083952904, + 1.1659924127161503, + 0.34136123210191727, + 0.9158785082399845, + 1.8350555133074522, + 0.8465174287557602, + 0.07870187796652317, + 0.3559079710394144, + 0.7190611753612757, + 0.5849972348660231, + 1.2521628085523844, + 0.5526512395590544, + 1.9134617447853088, + 1.2840302884578705, + 0.9901130888611078, + 1.037128632888198, + 0.08068988658487797, + 1.279383199289441, + 0.049817467108368874, + 2.087146346049849, + 0.6254182793200016, + 1.2861557360738516, + 0.050013964995741844, + 0.19922073557972908, + 0.10536514222621918, + 0.6301073133945465, + 1.3708124570548534, + 0.2916167713701725, + 1.1867067702114582, + 0.9991538561880589, + 0.46969401463866234, + 0.585466081101913, + 1.0350197609513998, + 0.929694137244951, + 0.8521265760064125, + 0.2610649149864912, + 0.4249950237572193, + 0.5074611399322748, + 0.19514650478959084, + 0.3289334524888545, + 0.6690219547599554, + 0.542577750980854, + 0.045365917787421495, + 1.722456194460392, + 0.5419677868485451, + 1.0450896006077528, + 0.1461883019655943, + 1.3745005782693624, + 1.353470578789711, + 0.14136506617069244, + 1.7849888168275356, + 0.13268346153199673 + ], + "unique_experts": 64, + "load_cv": 0.5909029838916401, + "normalized_load_entropy": 0.9556683841154014, + "max_load_share": 0.04367816091954023 + } + }, + "s1_eos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "3945c807179b31457fd8521426d3e89422c067adb2cd6aa7bc50a385bb72a2b4", + "route_weight_sha256": "21beb38ebae426e01e893df7647980543fd389948ae471bfd98397e801bc7e61", + "loads": [ + 14, + 10, + 1, + 15, + 2, + 11, + 13, + 23, + 8, + 26, + 8, + 5, + 13, + 18, + 8, + 9, + 18, + 16, + 2, + 12, + 7, + 15, + 13, + 20, + 24, + 17, + 3, + 16, + 2, + 30, + 2, + 18, + 10, + 12, + 2, + 6, + 2, + 8, + 22, + 1, + 15, + 16, + 10, + 11, + 2, + 1, + 29, + 2, + 9, + 17, + 17, + 4, + 11, + 12, + 0, + 10, + 6, + 18, + 7, + 14, + 25, + 0, + 17, + 5 + ], + "weighted_loads": [ + 0.5602700896561146, + 0.36335914209485054, + 0.03930041939020157, + 0.45607468858361244, + 0.18334877118468285, + 1.3455431759357452, + 1.2129929028451443, + 0.5586464814841747, + 0.3327258713543415, + 1.3985159154981375, + 0.18760287202894688, + 0.13809985294938087, + 0.3360352348536253, + 1.1863836273550987, + 0.311576995998621, + 0.29712653532624245, + 1.7747021242976189, + 0.6879127006977797, + 0.05416589789092541, + 0.32871708273887634, + 0.346728703007102, + 0.5794721283018589, + 1.2283882778137922, + 0.5322329085320234, + 1.9489701706916094, + 1.1412649638950825, + 0.16787800937891006, + 0.9819095209240913, + 0.055350931361317635, + 1.4099044110625982, + 0.04966491274535656, + 1.6941117718815804, + 0.499390859156847, + 0.9491151161491871, + 0.05047762580215931, + 0.17281530424952507, + 0.10957290604710579, + 0.6114167869091034, + 1.386778585612774, + 0.07873490452766418, + 1.1265536844730377, + 0.5535780675709248, + 0.4185892269015312, + 0.4231111090630293, + 0.05948852002620697, + 0.0722905620932579, + 0.9535391051322222, + 0.17338226735591888, + 0.30369930155575275, + 0.5195599272847176, + 0.513827595859766, + 0.3364055473357439, + 0.4142016936093569, + 0.5223685409873724, + 0.0, + 1.1755864545702934, + 0.22723715007305145, + 0.6146338805556297, + 0.17965264059603214, + 0.33221655525267124, + 1.2755873650312424, + 0.0, + 1.7633574791252613, + 0.13276120088994503 + ], + "unique_experts": 62, + "load_cv": 0.6683312551921141, + "normalized_load_entropy": 0.9399869331325632, + "max_load_share": 0.041666666666666664 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "411ba9ae026dd3bf0849c83a3f3cd53e4e0397f543a3a0027f0b0d8b8b8a9fbd", + "route_weight_sha256": "f9ee52acc91c9fb26707b974646befcc330928df922d09750d7a23fc5d313445", + "loads": [ + 17, + 10, + 4, + 17, + 7, + 13, + 15, + 26, + 31, + 27, + 13, + 6, + 14, + 19, + 9, + 21, + 18, + 22, + 3, + 14, + 10, + 17, + 18, + 22, + 26, + 22, + 22, + 18, + 2, + 32, + 3, + 25, + 12, + 14, + 2, + 6, + 3, + 9, + 23, + 6, + 15, + 28, + 13, + 18, + 4, + 12, + 29, + 6, + 11, + 17, + 23, + 8, + 16, + 13, + 5, + 14, + 16, + 29, + 9, + 25, + 27, + 4, + 17, + 9 + ], + "weighted_loads": [ + 0.7529658935964108, + 0.36335914209485054, + 0.20514292269945145, + 0.5199362020939589, + 0.47369938902556896, + 1.482578631490469, + 1.3439201265573502, + 0.7960062455385923, + 1.6293821558356285, + 1.4200538396835327, + 0.5343395862728357, + 0.28467734530568123, + 0.36001991853117943, + 1.22638538479805, + 0.33740919828414917, + 1.0003693960607052, + 1.7747021242976189, + 0.9809248559176922, + 0.09312320686876774, + 0.418649036437273, + 0.7051873784512281, + 0.7838487289845943, + 1.4993659785250202, + 0.5923134963959455, + 2.020749669522047, + 1.3141884710639715, + 1.4436563532799482, + 1.0763333663344383, + 0.055350931361317635, + 1.5718601141124964, + 0.1357941087335348, + 2.3164884792349767, + 0.6200983598828316, + 1.3091545961797237, + 0.05047762580215931, + 0.17281530424952507, + 0.3704362101852894, + 0.6449513621628284, + 1.4117109961807728, + 0.41219867765903473, + 1.1265536844730377, + 1.1271875109523535, + 0.6259736027568579, + 0.6429530400782824, + 1.200370267033577, + 0.8400159756129142, + 0.9535391051322222, + 0.28176606554188766, + 0.45500470139086246, + 0.5195599272847176, + 0.8120528943836689, + 0.7012698259204626, + 0.7192390542477369, + 0.5464558806270361, + 0.09381738264346495, + 1.728387676179409, + 0.6984849609434605, + 1.25358235090971, + 0.254832373932004, + 1.0040660966187716, + 1.391320550814271, + 0.23237480223178864, + 1.7633574791252613, + 0.6253105234354734 + ], + "unique_experts": 64, + "load_cv": 0.5359040381680429, + "normalized_load_entropy": 0.9625990062310894, + "max_load_share": 0.033126293995859216 + } + }, + "s0_bos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "da33ce6a5d8e47f72468035c7737b5cc4aa05ef61280e509ecd5c36912888df0", + "route_weight_sha256": "0f48cffdb27dfb78d8cead212761567f75d970dbf7b9560e3095c80402290eba", + "loads": [ + 14, + 11, + 4, + 10, + 2, + 11, + 18, + 25, + 7, + 30, + 16, + 6, + 3, + 17, + 9, + 9, + 17, + 11, + 9, + 17, + 5, + 5, + 13, + 26, + 24, + 17, + 5, + 16, + 5, + 36, + 4, + 18, + 10, + 11, + 3, + 6, + 3, + 8, + 18, + 1, + 15, + 16, + 9, + 11, + 1, + 1, + 17, + 8, + 15, + 6, + 13, + 3, + 11, + 11, + 2, + 10, + 3, + 18, + 9, + 17, + 25, + 0, + 17, + 2 + ], + "weighted_loads": [ + 0.5845480710268021, + 0.3935520723462105, + 0.10952274687588215, + 0.32497902028262615, + 0.16030381619930267, + 1.2261311709880829, + 1.3788825292140245, + 0.6272710710763931, + 0.20746010914444923, + 1.6308671943843365, + 0.3919310048222542, + 0.15916570276021957, + 0.08002990111708641, + 1.236525872722268, + 0.3745379075407982, + 0.3209021706134081, + 1.770446166396141, + 0.4653962180018425, + 0.23399213142693043, + 0.45908794924616814, + 0.24517503567039967, + 0.29880837351083755, + 1.2526389006525278, + 0.6936705689877272, + 1.9059890136122704, + 1.1791225261986256, + 0.2036615703254938, + 0.9888875633478165, + 0.1316049937158823, + 1.6590223088860512, + 0.09979536943137646, + 1.7398498877882957, + 0.49203604832291603, + 0.8141404874622822, + 0.07369737699627876, + 0.16032102517783642, + 0.12334448844194412, + 0.6660283096134663, + 1.367194052785635, + 0.07483717799186707, + 1.2190156057476997, + 0.5578508377075195, + 0.39767491817474365, + 0.4227424468845129, + 0.02341206558048725, + 0.07510806620121002, + 0.5734189450740814, + 0.3108077645301819, + 0.48567785508930683, + 0.21329569816589355, + 0.3636471536010504, + 0.3289347067475319, + 0.4624677263200283, + 0.4737576190382242, + 0.0528855137526989, + 1.1519940048456192, + 0.1779274307191372, + 0.6436752788722515, + 0.23274415731430054, + 0.41841134428977966, + 1.2515175770968199, + 0.0, + 1.8215882554650307, + 0.07036860287189484 + ], + "unique_experts": 63, + "load_cv": 0.6756798131338121, + "normalized_load_entropy": 0.9435019815221208, + "max_load_share": 0.05 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "099d79948f3b2ebf459337bb11d46d0319ef23611a66a9fbea8121b99e142d41", + "route_weight_sha256": "7f4a036f1645ae1f2362c451243e0449afbdecd896cdb9535da884793b436cd4", + "loads": [ + 16, + 11, + 6, + 12, + 4, + 11, + 20, + 27, + 22, + 31, + 19, + 8, + 3, + 17, + 10, + 18, + 17, + 14, + 9, + 18, + 8, + 5, + 14, + 27, + 24, + 21, + 18, + 17, + 5, + 36, + 4, + 22, + 12, + 13, + 3, + 6, + 3, + 8, + 19, + 4, + 15, + 26, + 11, + 17, + 1, + 11, + 18, + 8, + 15, + 6, + 14, + 3, + 15, + 12, + 4, + 14, + 7, + 26, + 9, + 27, + 27, + 3, + 17, + 2 + ], + "weighted_loads": [ + 0.6999595742672682, + 0.3935520723462105, + 0.19481302984058857, + 0.3843768611550331, + 0.21201171539723873, + 1.2261311709880829, + 1.5309504959732294, + 0.8869980275630951, + 1.0239545553922653, + 1.6535251382738352, + 0.5767841953784227, + 0.21131913922727108, + 0.08002990111708641, + 1.236525872722268, + 0.4036781080067158, + 0.9382183905690908, + 1.770446166396141, + 0.6571473143994808, + 0.23399213142693043, + 0.48324617370963097, + 0.581864358857274, + 0.29880837351083755, + 1.2827068082988262, + 0.7200319543480873, + 1.9059890136122704, + 1.331718822941184, + 1.0115224532783031, + 1.0513669960200787, + 0.1316049937158823, + 1.6590223088860512, + 0.09979536943137646, + 2.138729065656662, + 0.6257886365056038, + 1.1870378740131855, + 0.07369737699627876, + 0.16032102517783642, + 0.12334448844194412, + 0.6660283096134663, + 1.3932997807860374, + 0.29375024139881134, + 1.2190156057476997, + 0.9700736366212368, + 0.4667718317359686, + 0.5790250077843666, + 0.02341206558048725, + 0.8933169320225716, + 0.599550286307931, + 0.3108077645301819, + 0.48567785508930683, + 0.21329569816589355, + 0.39006404392421246, + 0.3289347067475319, + 0.6886700540781021, + 0.4987222384661436, + 0.09779990278184414, + 1.7129367887973785, + 0.5191484577953815, + 1.1266128607094288, + 0.23274415731430054, + 1.1019768044352531, + 1.447328282520175, + 0.14109688997268677, + 1.8215882554650307, + 0.07036860287189484 + ], + "unique_experts": 64, + "load_cv": 0.5948961590769901, + "normalized_load_entropy": 0.9555392543359584, + "max_load_share": 0.041379310344827586 + } + }, + "s1_bos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "21b053801d348a3a71aa37a8dd88751d2184b9bc2657afd935e0cba0f210605a", + "route_weight_sha256": "00b69a1240defe7ca5d9e0b55c7d68c8167a98825edc6a856aa8a078fbdc2816", + "loads": [ + 15, + 12, + 1, + 12, + 2, + 11, + 18, + 26, + 5, + 28, + 13, + 6, + 4, + 21, + 9, + 10, + 16, + 10, + 10, + 11, + 5, + 6, + 13, + 24, + 24, + 17, + 8, + 16, + 3, + 40, + 4, + 18, + 10, + 11, + 3, + 6, + 2, + 8, + 18, + 1, + 15, + 16, + 10, + 10, + 3, + 1, + 17, + 7, + 14, + 10, + 18, + 3, + 13, + 10, + 6, + 10, + 3, + 18, + 2, + 14, + 25, + 0, + 17, + 1 + ], + "weighted_loads": [ + 0.5903918277472258, + 0.4197196736931801, + 0.03587479516863823, + 0.36270381323993206, + 0.16700602695345879, + 1.2664767391979694, + 1.3096275553107262, + 0.646973192691803, + 0.1548355184495449, + 1.5423059985041618, + 0.30963282845914364, + 0.16427534073591232, + 0.11092379502952099, + 1.3622665461152792, + 0.3810258526355028, + 0.3366921879351139, + 1.8065903186798096, + 0.40015120431780815, + 0.2592499628663063, + 0.300652202218771, + 0.25338233821094036, + 0.32897550985217094, + 1.2603277508169413, + 0.642432663589716, + 1.8422630168497562, + 1.2099578753113747, + 0.3170577585697174, + 1.0105567835271358, + 0.07705659233033657, + 1.7401694860309362, + 0.10049356706440449, + 1.713706523180008, + 0.4574391655623913, + 0.7765584960579872, + 0.07277762144804001, + 0.1577575635164976, + 0.11047539114952087, + 0.6446986831724644, + 1.349865697324276, + 0.07357874512672424, + 1.154948454350233, + 0.5711604468524456, + 0.4230085387825966, + 0.3864005245268345, + 0.09044491313397884, + 0.08032868057489395, + 0.5720716156065464, + 0.3044798318296671, + 0.46749706380069256, + 0.3267713636159897, + 0.6476886980235577, + 0.32284338772296906, + 0.4979051426053047, + 0.4487294405698776, + 0.14958704262971878, + 1.132478304207325, + 0.14661073498427868, + 0.6207427382469177, + 0.056496648117899895, + 0.33667800202965736, + 1.2900260239839554, + 0.0, + 1.7965905368328094, + 0.049486979842185974 + ], + "unique_experts": 63, + "load_cv": 0.6919287767529007, + "normalized_load_entropy": 0.9411470612897507, + "max_load_share": 0.05555555555555555 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "f3952f1f48c91c2f335be2a068aef87acd215a872b4a7a711c353334e0104e21", + "route_weight_sha256": "18ee149d9c556e2a81d7a6b59ad8d450658a8c748719d42274611daffb8968c4", + "loads": [ + 19, + 12, + 4, + 15, + 7, + 13, + 20, + 29, + 26, + 29, + 19, + 7, + 4, + 23, + 10, + 22, + 16, + 16, + 11, + 13, + 8, + 8, + 17, + 26, + 26, + 22, + 27, + 18, + 3, + 42, + 5, + 24, + 12, + 13, + 4, + 6, + 3, + 9, + 18, + 6, + 15, + 28, + 15, + 17, + 4, + 11, + 18, + 10, + 16, + 10, + 25, + 7, + 18, + 10, + 10, + 14, + 13, + 31, + 4, + 24, + 28, + 4, + 17, + 5 + ], + "weighted_loads": [ + 0.8228042293339968, + 0.4197196736931801, + 0.18823357671499252, + 0.4538951553404331, + 0.4573566447943449, + 1.4035121947526932, + 1.438252229243517, + 0.8750269878655672, + 1.374949622899294, + 1.564347255975008, + 0.690181065350771, + 0.3108528330922127, + 0.11092379502952099, + 1.4266289956867695, + 0.407568970695138, + 1.0399350486695766, + 1.8065903186798096, + 0.6815561149269342, + 0.29820727184414864, + 0.3913569748401642, + 0.5439854320138693, + 0.5333521105349064, + 1.5309946089982986, + 0.7030782233923674, + 1.914042515680194, + 1.3909095469862223, + 1.5902518425136805, + 1.1026249155402184, + 0.07705659233033657, + 1.9021251890808344, + 0.18662276305258274, + 2.337825581431389, + 0.5749203115701675, + 1.0992859899997711, + 0.09594865143299103, + 0.1577575635164976, + 0.37133869528770447, + 0.6782332584261894, + 1.349865697324276, + 0.41274333372712135, + 1.154948454350233, + 1.1447698902338743, + 0.6924668904393911, + 0.6053196080029011, + 0.24235930107533932, + 0.8475857712328434, + 0.6023162044584751, + 0.413266072049737, + 0.6188024636358023, + 0.3267713636159897, + 0.971497219055891, + 0.6877076663076878, + 0.788010086864233, + 0.4487294405698776, + 0.24298267997801304, + 1.6682136505842209, + 0.6325469855219126, + 1.360531521961093, + 0.13167638145387173, + 0.973943118005991, + 1.5083307940512896, + 0.23232804983854294, + 1.7965905368328094, + 0.5420363023877144 + ], + "unique_experts": 64, + "load_cv": 0.5645723953129863, + "normalized_load_entropy": 0.9611271910769135, + "max_load_share": 0.043478260869565216 + } + }, + "s0_x": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "30c98f9e2b8c2b104ad493755a1aa8c522b035ac2d0af3f278fd5318cb4b3bb8", + "route_weight_sha256": "c90953dee99b6c1c7f639e98802f542fcb2ab3f96ed0be4e22258bf1512b7cb8", + "loads": [ + 16, + 11, + 3, + 11, + 2, + 11, + 18, + 26, + 5, + 29, + 18, + 4, + 8, + 17, + 8, + 9, + 18, + 12, + 9, + 19, + 4, + 7, + 13, + 25, + 24, + 17, + 5, + 16, + 2, + 28, + 4, + 18, + 10, + 11, + 3, + 6, + 2, + 8, + 18, + 1, + 15, + 16, + 14, + 13, + 1, + 1, + 18, + 5, + 12, + 6, + 13, + 3, + 11, + 11, + 4, + 10, + 3, + 18, + 9, + 17, + 25, + 0, + 17, + 2 + ], + "weighted_loads": [ + 0.6347643919289112, + 0.393783962354064, + 0.08652477525174618, + 0.342652278020978, + 0.16708874329924583, + 1.2848307341337204, + 1.3774861060082912, + 0.6358066517859697, + 0.1529602985829115, + 1.5882034432142973, + 0.43991687148809433, + 0.11180732771754265, + 0.21301979385316372, + 1.2198542822152376, + 0.3436933644115925, + 0.31096036545932293, + 1.7443438600748777, + 0.5142470933496952, + 0.22548258304595947, + 0.51121043600142, + 0.21772822923958302, + 0.34685367718338966, + 1.2285550571978092, + 0.6863066628575325, + 1.9615147672593594, + 1.1710718236863613, + 0.20832344889640808, + 0.9882383216172457, + 0.054736435413360596, + 1.4118051286786795, + 0.09912765212357044, + 1.803399108350277, + 0.5010480061173439, + 0.8598717451095581, + 0.07140655629336834, + 0.16379735432565212, + 0.10132601857185364, + 0.6831302791833878, + 1.3162806369364262, + 0.07676252722740173, + 1.2906304895877838, + 0.555150717496872, + 0.5286448411643505, + 0.47055542282760143, + 0.02427959255874157, + 0.07368803769350052, + 0.6135657113045454, + 0.2315075807273388, + 0.41887407936155796, + 0.21232710033655167, + 0.3639860786497593, + 0.33406253159046173, + 0.44817509688436985, + 0.481603404507041, + 0.09865930862724781, + 1.1768535748124123, + 0.1638888269662857, + 0.6499402318149805, + 0.23685449361801147, + 0.4133993983268738, + 1.2528305537998676, + 0.0, + 1.830362681299448, + 0.06998912990093231 + ], + "unique_experts": 63, + "load_cv": 0.6547075494513882, + "normalized_load_entropy": 0.9442138305165836, + "max_load_share": 0.04027777777777778 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "b9c4e9c3ad9f0b17e9ca510051b979135d785d4a06bffe27894e8077c0bd1291", + "route_weight_sha256": "8fd33b84141a76cffa7c048da2ae54eff6fe0af19115866c969ec7686b0eddf7", + "loads": [ + 17, + 11, + 5, + 13, + 4, + 11, + 20, + 29, + 20, + 31, + 20, + 5, + 8, + 17, + 9, + 19, + 18, + 14, + 9, + 20, + 7, + 7, + 15, + 26, + 24, + 21, + 19, + 17, + 2, + 28, + 4, + 22, + 12, + 13, + 3, + 6, + 2, + 8, + 18, + 4, + 15, + 27, + 15, + 19, + 1, + 12, + 18, + 5, + 12, + 6, + 14, + 3, + 15, + 12, + 6, + 14, + 6, + 25, + 11, + 28, + 26, + 3, + 17, + 2 + ], + "weighted_loads": [ + 0.7267935611307621, + 0.393783962354064, + 0.18105394951999187, + 0.40098834224045277, + 0.2187966424971819, + 1.2848307341337204, + 1.5292422957718372, + 0.9347226954996586, + 0.9728973340243101, + 1.6369912195950747, + 0.599167175590992, + 0.13537499122321606, + 0.21301979385316372, + 1.2198542822152376, + 0.37309667095541954, + 1.0456227753311396, + 1.7443438600748777, + 0.6715675108134747, + 0.22548258304595947, + 0.5355278979986906, + 0.5486597437411547, + 0.34685367718338966, + 1.2894953526556492, + 0.7134735025465488, + 1.9615147672593594, + 1.3279622420668602, + 1.0464363619685173, + 1.0546336192637682, + 0.054736435413360596, + 1.4118051286786795, + 0.09912765212357044, + 2.204045906662941, + 0.6355406157672405, + 1.2421355098485947, + 0.07140655629336834, + 0.16379735432565212, + 0.10132601857185364, + 0.6831302791833878, + 1.3162806369364262, + 0.3195333406329155, + 1.2906304895877838, + 1.0232127979397774, + 0.5559441596269608, + 0.6313628237694502, + 0.02427959255874157, + 0.9256308749318123, + 0.6135657113045454, + 0.2315075807273388, + 0.41887407936155796, + 0.21232710033655167, + 0.39040296897292137, + 0.33406253159046173, + 0.6586286369711161, + 0.506192633882165, + 0.14357369765639305, + 1.7615858614444733, + 0.35615233331918716, + 1.0471533872187138, + 0.2877748943865299, + 1.1954618021845818, + 1.3436552472412586, + 0.13927479833364487, + 1.830362681299448, + 0.06998912990093231 + ], + "unique_experts": 64, + "load_cv": 0.5831246441720428, + "normalized_load_entropy": 0.955785693307735, + "max_load_share": 0.035632183908045977 + } + }, + "s1_x": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "0433e22673a3c25ef317a1bf0266387f003902cb1a6826aa34ad00f8827de110", + "route_weight_sha256": "410b1c5643f0916d314152978b6c52480b25eaaa6a87e535ee54f6f32b880476", + "loads": [ + 15, + 13, + 1, + 10, + 2, + 11, + 18, + 26, + 4, + 28, + 13, + 5, + 9, + 20, + 8, + 9, + 16, + 11, + 9, + 16, + 5, + 8, + 14, + 24, + 24, + 17, + 10, + 16, + 3, + 30, + 4, + 18, + 10, + 11, + 3, + 6, + 2, + 8, + 18, + 1, + 15, + 16, + 13, + 10, + 5, + 1, + 18, + 5, + 11, + 10, + 18, + 3, + 12, + 10, + 5, + 10, + 3, + 18, + 3, + 14, + 25, + 0, + 17, + 2 + ], + "weighted_loads": [ + 0.5909375250339508, + 0.44922732934355736, + 0.03564244508743286, + 0.3117449935525656, + 0.17229051142930984, + 1.3103119730949402, + 1.2835597805678844, + 0.6426978018134832, + 0.11652897112071514, + 1.5323838144540787, + 0.30466787703335285, + 0.13602652214467525, + 0.23758920095860958, + 1.3485508281737566, + 0.35565441846847534, + 0.31013195775449276, + 1.7960130870342255, + 0.42522745579481125, + 0.23360268212854862, + 0.4263807628303766, + 0.2486241403967142, + 0.3757421802729368, + 1.281320583075285, + 0.6516051348298788, + 1.8285759631544352, + 1.2129947617650032, + 0.37257929891347885, + 1.0171700716018677, + 0.0850085411220789, + 1.4425463732331991, + 0.1003043670207262, + 1.7523095160722733, + 0.44954997301101685, + 0.7693115994334221, + 0.07063564285635948, + 0.16086135245859623, + 0.10745459794998169, + 0.6556137278676033, + 1.3217782154679298, + 0.07377476990222931, + 1.2290244288742542, + 0.5658861827105284, + 0.49435452558100224, + 0.38758881762623787, + 0.14134281501173973, + 0.08252882957458496, + 0.6055423617362976, + 0.2515434008091688, + 0.3973313234746456, + 0.32442495226860046, + 0.6624279748648405, + 0.3270011618733406, + 0.46915814839303493, + 0.4544638730585575, + 0.1315388884395361, + 1.1436124071478844, + 0.13348872773349285, + 0.6340158674865961, + 0.08187672682106495, + 0.33266502618789673, + 1.30457379296422, + 0.0, + 1.7949716188013554, + 0.07084387540817261 + ], + "unique_experts": 63, + "load_cv": 0.6429100507328637, + "normalized_load_entropy": 0.9466091747857326, + "max_load_share": 0.041666666666666664 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "dfae391ac0182cb137cf11ddb64ea08a8c76b5526fcca132c2b38f85285226ed", + "route_weight_sha256": "1ccf0b859dd4b9a73d4cbb1c518752c03bba35cf7d872c19a03e80953c9c7657", + "loads": [ + 18, + 13, + 4, + 12, + 7, + 13, + 20, + 30, + 25, + 30, + 19, + 6, + 9, + 22, + 9, + 22, + 16, + 17, + 10, + 18, + 8, + 10, + 18, + 26, + 26, + 22, + 30, + 18, + 3, + 32, + 5, + 24, + 12, + 13, + 3, + 6, + 3, + 9, + 18, + 6, + 15, + 29, + 17, + 17, + 6, + 12, + 19, + 8, + 14, + 10, + 25, + 7, + 17, + 10, + 9, + 14, + 12, + 29, + 5, + 25, + 27, + 4, + 17, + 6 + ], + "weighted_loads": [ + 0.7968849390745163, + 0.44922732934355736, + 0.19523391500115395, + 0.37087636068463326, + 0.46264112927019596, + 1.447347428649664, + 1.4120807871222496, + 0.9081571102142334, + 1.337350470945239, + 1.5790937654674053, + 0.6845592185854912, + 0.2826040145009756, + 0.23758920095860958, + 1.4145005773752928, + 0.38269797526299953, + 1.1246868204325438, + 1.7960130870342255, + 0.7051058392971754, + 0.27255999110639095, + 0.5169987268745899, + 0.5391838271170855, + 0.5801187809556723, + 1.5519874412566423, + 0.7130790371447802, + 1.9003554619848728, + 1.3987004589289427, + 1.684067390859127, + 1.1106094159185886, + 0.0850085411220789, + 1.6045020762830973, + 0.18643356300890446, + 2.377511240541935, + 0.5660677440464497, + 1.0933217853307724, + 0.07063564285635948, + 0.16086135245859623, + 0.3683179020881653, + 0.6891483031213284, + 1.3217782154679298, + 0.43109679967164993, + 1.2290244288742542, + 1.2061109021306038, + 0.7279351670295, + 0.6067361272871494, + 0.2932572029531002, + 0.8843975029885769, + 0.6391941197216511, + 0.3603607099503279, + 0.5702899601310492, + 0.32442495226860046, + 0.9865031335502863, + 0.6918654404580593, + 0.7457212414592505, + 0.4544638730585575, + 0.22493452578783035, + 1.6916824132204056, + 0.4916799906641245, + 1.266165129840374, + 0.15705646015703678, + 1.064163126051426, + 1.4203069787472486, + 0.23081183806061745, + 1.7949716188013554, + 0.563393197953701 + ], + "unique_experts": 64, + "load_cv": 0.5361599350597639, + "normalized_load_entropy": 0.9641784926810205, + "max_load_share": 0.033126293995859216 + } + }, + "s0_period": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "3f60494aeeb60a2e4e6005e37ba3538832191bf56efed9fdeb3cfa2e348c0434", + "route_weight_sha256": "2071d8558bd060d967435b65942bee9fae556e9cc4a72ad2a672a88957d9aca8", + "loads": [ + 16, + 11, + 3, + 11, + 2, + 11, + 17, + 26, + 5, + 30, + 18, + 4, + 7, + 17, + 8, + 9, + 17, + 12, + 10, + 20, + 4, + 7, + 13, + 25, + 24, + 17, + 4, + 16, + 2, + 29, + 4, + 18, + 10, + 11, + 3, + 6, + 2, + 8, + 19, + 1, + 15, + 16, + 13, + 13, + 1, + 1, + 18, + 5, + 11, + 6, + 13, + 3, + 11, + 11, + 5, + 10, + 3, + 18, + 8, + 17, + 25, + 0, + 17, + 3 + ], + "weighted_loads": [ + 0.633251553401351, + 0.39483782835304737, + 0.08615628443658352, + 0.34182685799896717, + 0.1641293689608574, + 1.2887208983302116, + 1.3522569611668587, + 0.6415078528225422, + 0.1527540385723114, + 1.617429293692112, + 0.44135607406497, + 0.11072026565670967, + 0.18722344003617764, + 1.2165659349411726, + 0.34330733492970467, + 0.31136588752269745, + 1.7249959129840136, + 0.5139804817736149, + 0.24676339328289032, + 0.5367057900875807, + 0.21643717773258686, + 0.3474192749708891, + 1.2290359884500504, + 0.6855963710695505, + 1.9812207259237766, + 1.170167375355959, + 0.18439294584095478, + 0.9912314135581255, + 0.05489087663590908, + 1.433275444433093, + 0.09962060861289501, + 1.8249413073062897, + 0.49727344512939453, + 0.8590298406779766, + 0.07122991234064102, + 0.16347170807421207, + 0.10024572163820267, + 0.6863165646791458, + 1.3375648092478514, + 0.07669349759817123, + 1.2985720559954643, + 0.5518202148377895, + 0.5031903591006994, + 0.47236319817602634, + 0.024462098255753517, + 0.07459165900945663, + 0.6159308739006519, + 0.2297227941453457, + 0.3934578336775303, + 0.21421983651816845, + 0.3639106787741184, + 0.33178017288446426, + 0.4464336149394512, + 0.48043823428452015, + 0.12035017274320126, + 1.1697838604450226, + 0.16624287143349648, + 0.6478661149740219, + 0.20674220472574234, + 0.4131756071001291, + 1.2545140460133553, + 0.0, + 1.8266091905534267, + 0.09125514887273312 + ], + "unique_experts": 63, + "load_cv": 0.6607141665474892, + "normalized_load_entropy": 0.9439265442721672, + "max_load_share": 0.041666666666666664 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "ee0185b7593b183cebbf2a6e0beceaaff9a06f5e7bb9be25f19136d7c0f38f6d", + "route_weight_sha256": "0214dee48f372d3e5dbefb310fea413c11c428c03dd762ac0c98ee6495a5336f", + "loads": [ + 17, + 11, + 5, + 13, + 5, + 11, + 19, + 28, + 20, + 32, + 20, + 6, + 7, + 17, + 9, + 18, + 17, + 14, + 10, + 21, + 7, + 7, + 14, + 26, + 24, + 21, + 17, + 17, + 2, + 29, + 4, + 22, + 12, + 13, + 3, + 7, + 2, + 8, + 19, + 4, + 15, + 26, + 14, + 20, + 1, + 11, + 18, + 5, + 13, + 6, + 14, + 4, + 15, + 12, + 7, + 14, + 6, + 24, + 10, + 28, + 26, + 3, + 17, + 3 + ], + "weighted_loads": [ + 0.7267612274736166, + 0.39483782835304737, + 0.17163281328976154, + 0.4003230407834053, + 0.3381496127694845, + 1.2887208983302116, + 1.5038205906748772, + 0.8930784724652767, + 0.949678760021925, + 1.6655850186944008, + 0.6009360738098621, + 0.27147284895181656, + 0.18722344003617764, + 1.2165659349411726, + 0.3726579863578081, + 0.9286821074783802, + 1.7249959129840136, + 0.6708874069154263, + 0.24676339328289032, + 0.5611972156912088, + 0.5482394862920046, + 0.3474192749708891, + 1.2591038960963488, + 0.7126311343163252, + 1.9812207259237766, + 1.3267191667109728, + 0.9927727989852428, + 1.0570232961326838, + 0.05489087663590908, + 1.433275444433093, + 0.09962060861289501, + 2.2252502143383026, + 0.6312062107026577, + 1.2407044284045696, + 0.07122991234064102, + 0.1847931258380413, + 0.10024572163820267, + 0.6863165646791458, + 1.3375648092478514, + 0.29905445501208305, + 1.2985720559954643, + 0.9640430137515068, + 0.5305420383810997, + 0.6576199289411306, + 0.024462098255753517, + 0.8928005248308182, + 0.6159308739006519, + 0.2297227941453457, + 0.4383916761726141, + 0.21421983651816845, + 0.3903275690972805, + 0.3846188634634018, + 0.6707155220210552, + 0.5052355341613293, + 0.1652645617723465, + 1.7557821944355965, + 0.3588502071797848, + 1.0174804460257292, + 0.2579536996781826, + 1.1267981324344873, + 1.3453387394547462, + 0.1364193633198738, + 1.8266091905534267, + 0.09125514887273312 + ], + "unique_experts": 64, + "load_cv": 0.5743585115833549, + "normalized_load_entropy": 0.9576982605342746, + "max_load_share": 0.0367816091954023 + } + }, + "s1_period": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "5e2b9d1af5b3b5c8280d860e371476f103560ecba96a8acf19e38edf32d29485", + "route_weight_sha256": "69e6ee19cfe3e9e8015dd272d08cfd7ed878a9f9d9ea66dada83727c738c5be4", + "loads": [ + 15, + 13, + 1, + 10, + 2, + 11, + 18, + 27, + 5, + 28, + 13, + 4, + 6, + 20, + 8, + 9, + 16, + 11, + 11, + 17, + 4, + 8, + 14, + 24, + 24, + 17, + 8, + 16, + 2, + 32, + 4, + 18, + 10, + 11, + 3, + 6, + 2, + 8, + 18, + 1, + 15, + 16, + 12, + 10, + 6, + 1, + 19, + 5, + 11, + 10, + 18, + 3, + 12, + 10, + 5, + 10, + 3, + 18, + 3, + 14, + 25, + 0, + 17, + 2 + ], + "weighted_loads": [ + 0.5894939675927162, + 0.44898403994739056, + 0.035759326070547104, + 0.31288324855268, + 0.16997279226779938, + 1.3092401325702667, + 1.2874330785125494, + 0.6656135320663452, + 0.1410000380128622, + 1.5339084845036268, + 0.3058735057711601, + 0.10951701924204826, + 0.16315476782619953, + 1.3478983230888844, + 0.355450801551342, + 0.311232129111886, + 1.794830460101366, + 0.4232835341244936, + 0.27534501254558563, + 0.4508896954357624, + 0.22514385357499123, + 0.3770409841090441, + 1.2814965192228556, + 0.6523218359798193, + 1.8403810560703278, + 1.2127933651208878, + 0.3306182101368904, + 1.0174442268908024, + 0.05617431551218033, + 1.4947217851877213, + 0.10067501664161682, + 1.7642255276441574, + 0.4489230737090111, + 0.771549291908741, + 0.0709735918790102, + 0.16119994036853313, + 0.10728538408875465, + 0.657087005674839, + 1.3221425712108612, + 0.07399311661720276, + 1.2323597557842731, + 0.5622705947607756, + 0.47134321741759777, + 0.3883436471223831, + 0.1670647356659174, + 0.08223097026348114, + 0.6283826753497124, + 0.2519968319684267, + 0.39685082249343395, + 0.32447895035147667, + 0.6630433052778244, + 0.32470979541540146, + 0.467207670211792, + 0.45354199036955833, + 0.13388058729469776, + 1.1404027044773102, + 0.13482815027236938, + 0.6324043795466423, + 0.08171665482223034, + 0.33301445096731186, + 1.304905466735363, + 0.0, + 1.794711995869875, + 0.07082588970661163 + ], + "unique_experts": 63, + "load_cv": 0.6597792373023788, + "normalized_load_entropy": 0.9443319328621623, + "max_load_share": 0.044444444444444446 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "269434a92a5158c73c9d8f44fac46c4767a5269553d874943d5caeb696b4395d", + "route_weight_sha256": "4f59dce0ac10512f155d2177ef77f00a8893fde9b41f360a1685c602032d1d05", + "loads": [ + 18, + 13, + 4, + 12, + 8, + 13, + 20, + 30, + 25, + 29, + 19, + 7, + 6, + 22, + 9, + 21, + 16, + 17, + 12, + 19, + 7, + 10, + 18, + 26, + 26, + 22, + 28, + 18, + 2, + 34, + 6, + 24, + 12, + 13, + 3, + 6, + 4, + 9, + 18, + 6, + 15, + 29, + 16, + 17, + 7, + 11, + 19, + 8, + 14, + 10, + 25, + 8, + 18, + 10, + 9, + 14, + 12, + 29, + 5, + 24, + 27, + 4, + 17, + 6 + ], + "weighted_loads": [ + 0.795616589486599, + 0.44898403994739056, + 0.18509991094470024, + 0.3721482139080763, + 0.5805664006620646, + 1.4462755881249905, + 1.4156150538474321, + 0.8813068140298128, + 1.3206833768635988, + 1.5558220017701387, + 0.6860280334949493, + 0.42319807782769203, + 0.16315476782619953, + 1.4154376275837421, + 0.38247091323137283, + 1.0144749898463488, + 1.794830460101366, + 0.7037480175495148, + 0.31430232152342796, + 0.541730061173439, + 0.5144731067121029, + 0.5814175847917795, + 1.552163377404213, + 0.7138260547071695, + 1.9121605549007654, + 1.3976237587630749, + 1.6322875916957855, + 1.109859425574541, + 0.05617431551218033, + 1.6566774882376194, + 0.2076631709933281, + 2.3891906291246414, + 0.5654766745865345, + 1.095000684261322, + 0.0709735918790102, + 0.16119994036853313, + 0.390150748193264, + 0.6906215809285641, + 1.3221425712108612, + 0.4118760824203491, + 1.2323597557842731, + 1.171125415712595, + 0.7048613820225, + 0.6076486688107252, + 0.31897912360727787, + 0.8494880609214306, + 0.6283826753497124, + 0.3607750404626131, + 0.5703928899019957, + 0.32447895035147667, + 0.9871531184762716, + 0.7323151715099812, + 0.7775417491793633, + 0.45354199036955833, + 0.22727622464299202, + 1.6890014335513115, + 0.49657701700925827, + 1.2640812881290913, + 0.15689638815820217, + 0.9702795669436455, + 1.4206386525183916, + 0.22568901255726814, + 1.794711995869875, + 0.56337521225214 + ], + "unique_experts": 64, + "load_cv": 0.5319218942931869, + "normalized_load_entropy": 0.9647486013671321, + "max_load_share": 0.035196687370600416 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 120, + "ordered_topk_exact_tokens": 66, + "set_exact_tokens": 81, + "mean_set_jaccard": 0.8986111111111111, + "mean_token_weighted_tv": 0.013747024505088726, + "aggregate_load_tv": 0.05138888888888889 + }, + "system_bos": { + "tokens": 120, + "ordered_topk_exact_tokens": 62, + "set_exact_tokens": 73, + "mean_set_jaccard": 0.8845238095238097, + "mean_token_weighted_tv": 0.016122342149416605, + "aggregate_load_tv": 0.05277777777777777 + }, + "system_x": { + "tokens": 120, + "ordered_topk_exact_tokens": 63, + "set_exact_tokens": 76, + "mean_set_jaccard": 0.8880952380952382, + "mean_token_weighted_tv": 0.01739851621290048, + "aggregate_load_tv": 0.04583333333333334 + }, + "system_period": { + "tokens": 120, + "ordered_topk_exact_tokens": 61, + "set_exact_tokens": 78, + "mean_set_jaccard": 0.8964285714285716, + "mean_token_weighted_tv": 0.016591674384350576, + "aggregate_load_tv": 0.04583333333333334 + }, + "bos_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 38, + "set_exact_tokens": 50, + "mean_set_jaccard": 0.7898809523809526, + "mean_token_weighted_tv": 0.02837504371224592, + "aggregate_load_tv": 0.10555555555555556 + }, + "bos_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 37, + "set_exact_tokens": 48, + "mean_set_jaccard": 0.7904761904761906, + "mean_token_weighted_tv": 0.029401670419611038, + "aggregate_load_tv": 0.10416666666666667 + }, + "x_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 38, + "set_exact_tokens": 52, + "mean_set_jaccard": 0.8009920634920635, + "mean_token_weighted_tv": 0.02660441061016172, + "aggregate_load_tv": 0.09444444444444444 + }, + "x_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 39, + "set_exact_tokens": 52, + "mean_set_jaccard": 0.805357142857143, + "mean_token_weighted_tv": 0.028207638401848575, + "aggregate_load_tv": 0.09166666666666666 + }, + "period_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 40, + "set_exact_tokens": 54, + "mean_set_jaccard": 0.8057539682539684, + "mean_token_weighted_tv": 0.02609723649608592, + "aggregate_load_tv": 0.09444444444444444 + }, + "period_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 39, + "set_exact_tokens": 51, + "mean_set_jaccard": 0.8015873015873017, + "mean_token_weighted_tv": 0.02858272025672098, + "aggregate_load_tv": 0.09583333333333334 + } + } + }, + "layer_02": { + "layer": 2, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "0796d35c13895a639d627a8113e443f1417e4c92e2af638a51b40f10299d16d8", + "route_weight_sha256": "5c1af1a5f5da195f804d714bb9e76043e4c7204633ff6e9b4697f6918e7e636c", + "loads": [ + 2, + 3, + 12, + 12, + 6, + 5, + 16, + 3, + 8, + 13, + 13, + 3, + 21, + 15, + 18, + 10, + 4, + 11, + 20, + 8, + 20, + 7, + 17, + 7, + 17, + 10, + 5, + 25, + 3, + 11, + 7, + 4, + 0, + 7, + 18, + 10, + 3, + 15, + 20, + 11, + 2, + 17, + 21, + 10, + 4, + 1, + 10, + 23, + 16, + 5, + 6, + 7, + 14, + 5, + 25, + 21, + 27, + 25, + 14, + 7, + 9, + 8, + 18, + 5 + ], + "weighted_loads": [ + 0.24015315622091293, + 0.08368586748838425, + 0.3416844792664051, + 1.2220981772989035, + 0.20319033972918987, + 0.3597992677241564, + 0.45778802409768105, + 0.27577510103583336, + 0.39264052733778954, + 0.4050195384770632, + 0.36724967509508133, + 0.09740336798131466, + 1.1518415790051222, + 1.609072344377637, + 0.89149559289217, + 0.63857183419168, + 0.1647384762763977, + 0.6454557217657566, + 2.8846956118941307, + 0.38526030257344246, + 0.5659902561455965, + 0.5432693585753441, + 1.2421829272061586, + 0.19335724972188473, + 1.127868190407753, + 1.0603241100907326, + 0.23080486617982388, + 2.5840890370309353, + 0.08385523781180382, + 0.41783633455634117, + 0.3821190521121025, + 0.10992186889052391, + 0.0, + 0.2500811442732811, + 1.0312706641852856, + 0.5716202594339848, + 0.16727178171277046, + 1.1925664991140366, + 0.9209230151027441, + 0.5442380793392658, + 0.07451944425702095, + 0.5187977477908134, + 1.0593524314463139, + 0.36899126693606377, + 0.3204110786318779, + 0.2001168429851532, + 0.4602468591183424, + 1.3102382738143206, + 0.4640974532812834, + 0.14555958099663258, + 0.16245312802493572, + 0.42408648505806923, + 0.9163682274520397, + 0.13916509225964546, + 0.7089648675173521, + 0.5992522723972797, + 3.3203029222786427, + 2.6665992327034473, + 1.1735859829932451, + 0.3499726764857769, + 0.4017592165619135, + 0.3740241937339306, + 1.3704670015722513, + 0.3559075202792883 + ], + "unique_experts": 63, + "load_cv": 0.6190394789859609, + "normalized_load_entropy": 0.9514239886808524, + "max_load_share": 0.0375 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "f930e45daccdf11842a8d7d662d02d26e53d7fbdefde6bf89fc5aace696c887e", + "route_weight_sha256": "f8529e068057131e867465e25ce541dd64111e8fd66c3d3e31d390dc17b248eb", + "loads": [ + 2, + 13, + 12, + 14, + 6, + 5, + 17, + 5, + 10, + 13, + 16, + 3, + 21, + 17, + 26, + 10, + 4, + 12, + 21, + 12, + 22, + 16, + 17, + 7, + 20, + 10, + 6, + 27, + 6, + 11, + 7, + 7, + 0, + 8, + 23, + 24, + 3, + 15, + 22, + 11, + 2, + 17, + 27, + 10, + 4, + 1, + 13, + 27, + 17, + 5, + 6, + 13, + 14, + 6, + 25, + 21, + 27, + 33, + 22, + 10, + 19, + 11, + 23, + 16 + ], + "weighted_loads": [ + 0.24015315622091293, + 1.0307305678725243, + 0.3416844792664051, + 2.9240406211465597, + 0.20319033972918987, + 0.3597992677241564, + 0.47789593413472176, + 0.3736126758158207, + 0.47091787680983543, + 0.4050195384770632, + 0.4932226203382015, + 0.09740336798131466, + 1.1518415790051222, + 1.657111382111907, + 1.2154731042683125, + 0.63857183419168, + 0.1647384762763977, + 0.6461561881005764, + 2.886288966052234, + 1.134743321686983, + 0.8788912314921618, + 1.2384562343358994, + 1.2421829272061586, + 0.19335724972188473, + 1.290060866624117, + 1.0603241100907326, + 0.23165425390470773, + 2.793716836720705, + 0.3284633532166481, + 0.41783633455634117, + 0.3821190521121025, + 0.1748185160686262, + 0.0, + 0.2815597988665104, + 1.255359947681427, + 2.4699950590729713, + 0.16727178171277046, + 1.1925664991140366, + 0.9650933938100934, + 0.5442380793392658, + 0.07451944425702095, + 0.5187977477908134, + 1.7091131694614887, + 0.36899126693606377, + 0.3204110786318779, + 0.2001168429851532, + 0.5558457635343075, + 1.5522292833775282, + 0.489475941285491, + 0.14555958099663258, + 0.16245312802493572, + 1.2396550737321377, + 0.9163682274520397, + 0.14048329333309084, + 0.7089648675173521, + 0.5992522723972797, + 3.3203029222786427, + 3.158829253166914, + 1.5375626031309366, + 0.540041595697403, + 1.2310191951692104, + 0.5024873651564121, + 1.7416200172156096, + 1.1286110859364271 + ], + "unique_experts": 63, + "load_cv": 0.5797799592626819, + "normalized_load_entropy": 0.9558624798157953, + "max_load_share": 0.03793103448275862 + } + }, + "s1_eos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "ae2dcd71f1c40b94ca6f84bee8431289be23ba86193ed52f2008b66a8f39f0c6", + "route_weight_sha256": "4c904ee6565d91f7e54ca16ee32391f8095bde7823ff2a5b658c1aba55244dd1", + "loads": [ + 2, + 2, + 12, + 12, + 6, + 5, + 16, + 3, + 8, + 10, + 11, + 3, + 21, + 14, + 18, + 11, + 3, + 11, + 20, + 8, + 22, + 8, + 17, + 12, + 17, + 10, + 7, + 25, + 3, + 9, + 6, + 4, + 0, + 6, + 19, + 11, + 3, + 15, + 22, + 12, + 2, + 19, + 20, + 11, + 4, + 1, + 11, + 24, + 16, + 4, + 3, + 7, + 14, + 3, + 24, + 20, + 26, + 25, + 14, + 7, + 10, + 8, + 18, + 5 + ], + "weighted_loads": [ + 0.23678788542747498, + 0.0501058604568243, + 0.34447757713496685, + 1.259112348780036, + 0.1990949548780918, + 0.35877230390906334, + 0.46611382625997066, + 0.284016702324152, + 0.390264056622982, + 0.3072683494538069, + 0.3060030825436115, + 0.09796368330717087, + 1.128509657457471, + 1.5970209166407585, + 0.8986299335956573, + 0.6742545813322067, + 0.13572082109749317, + 0.6431766711175442, + 2.922409873455763, + 0.3842933885753155, + 0.6083454061299562, + 0.5658497735857964, + 1.2366514634341002, + 0.30997435562312603, + 1.1123907156288624, + 1.0401478856801987, + 0.2913203723728657, + 2.745521266013384, + 0.08427397534251213, + 0.37622336484491825, + 0.35656928084790707, + 0.11020200327038765, + 0.0, + 0.21580056473612785, + 1.0973910614848137, + 0.6114042811095715, + 0.16499074548482895, + 1.2304758448153734, + 1.001949867233634, + 0.5665261670947075, + 0.07439223304390907, + 0.560437636449933, + 1.0295227505266666, + 0.4056076053529978, + 0.31576675921678543, + 0.19618958234786987, + 0.4861088767647743, + 1.3448839914053679, + 0.46694936230778694, + 0.11204149574041367, + 0.08635181561112404, + 0.45084264501929283, + 0.8826348930597305, + 0.0887976847589016, + 0.6709761638194323, + 0.5725557338446379, + 3.2927533127367496, + 2.7370435558259487, + 1.166687311604619, + 0.3475979845970869, + 0.42068158462643623, + 0.37604432739317417, + 1.4082720559090376, + 0.39189333841204643 + ], + "unique_experts": 63, + "load_cv": 0.6312832316151907, + "normalized_load_entropy": 0.9486765671250889, + "max_load_share": 0.03611111111111111 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "80cef524ec76e047e7d33e8aebe60624cbd8d33a047d75e267fa5d7a1a869fe0", + "route_weight_sha256": "99db66ad4da3adc467e55fd66758696e1ea334a647bc5de78ee1d3e902ae05ba", + "loads": [ + 6, + 14, + 13, + 15, + 7, + 6, + 16, + 7, + 16, + 11, + 18, + 3, + 21, + 17, + 29, + 12, + 5, + 12, + 21, + 14, + 24, + 18, + 18, + 12, + 24, + 11, + 8, + 28, + 8, + 9, + 7, + 8, + 0, + 7, + 28, + 27, + 3, + 16, + 27, + 15, + 2, + 19, + 29, + 12, + 7, + 1, + 18, + 31, + 18, + 5, + 4, + 16, + 15, + 7, + 24, + 20, + 30, + 33, + 16, + 17, + 20, + 14, + 28, + 19 + ], + "weighted_loads": [ + 0.7558925822377205, + 1.080012246966362, + 0.3697854857891798, + 2.995944758877158, + 0.22935745865106583, + 0.500927459448576, + 0.46611382625997066, + 0.44667988270521164, + 1.0076128598302603, + 0.4238657783716917, + 0.6122314445674419, + 0.09796368330717087, + 1.128509657457471, + 1.6416457038139924, + 1.44779840297997, + 0.7070415653288364, + 0.19937482103705406, + 0.643761194718536, + 2.9237878568237647, + 1.174359330907464, + 0.8970246631652117, + 1.3382549732923508, + 1.2751312833279371, + 0.30997435562312603, + 1.4334522373974323, + 1.0904481634497643, + 0.2921409289119765, + 3.3528399877250195, + 0.33884489722549915, + 0.37622336484491825, + 0.39022372104227543, + 0.21433532610535622, + 0.0, + 0.24975315481424332, + 1.4638625420629978, + 2.284842800348997, + 0.16499074548482895, + 1.2723730709403753, + 1.140277860686183, + 0.9214287661015987, + 0.07439223304390907, + 0.560437636449933, + 2.1295265406370163, + 0.5873231235891581, + 0.964847557246685, + 0.19618958234786987, + 1.0896071083843708, + 1.7101471424102783, + 0.5359416268765926, + 0.15478964149951935, + 0.11264770105481148, + 1.578465960919857, + 1.0592430531978607, + 0.2738800341030583, + 0.6709761638194323, + 0.5725557338446379, + 3.546133805066347, + 3.1579737830907106, + 1.2779516149312258, + 0.8541398551315069, + 1.093026166781783, + 0.7833389062434435, + 2.2084450107067823, + 1.5890782736241817 + ], + "unique_experts": 63, + "load_cv": 0.5524149405518729, + "normalized_load_entropy": 0.9595903749450286, + "max_load_share": 0.034161490683229816 + } + }, + "s0_bos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "31b7aafb96fa34bb481e15493276da2675d3ce5b9f50dd8303bd7dc07d7a1d55", + "route_weight_sha256": "54c5d705359ddbd9e4d01e01f3a7713b71ca0b5b32ed999f704d8ecd73474412", + "loads": [ + 2, + 0, + 9, + 17, + 6, + 5, + 17, + 5, + 8, + 15, + 11, + 3, + 15, + 10, + 17, + 10, + 7, + 11, + 20, + 8, + 20, + 6, + 17, + 3, + 17, + 10, + 16, + 25, + 9, + 9, + 7, + 5, + 2, + 5, + 16, + 12, + 3, + 14, + 24, + 12, + 2, + 13, + 19, + 8, + 4, + 1, + 13, + 25, + 10, + 3, + 10, + 6, + 14, + 14, + 22, + 18, + 26, + 26, + 14, + 7, + 8, + 7, + 18, + 4 + ], + "weighted_loads": [ + 0.23261456191539764, + 0.0, + 0.2457865383476019, + 1.4718826580792665, + 0.19768139347434044, + 0.36618651263415813, + 0.4807483088225126, + 0.333560548722744, + 0.38791670091450214, + 0.44680137373507023, + 0.32032887637615204, + 0.0960632972419262, + 0.9709887094795704, + 1.459906430914998, + 0.7471576053649187, + 0.6321571134030819, + 0.24068265780806541, + 0.6856669187545776, + 2.8680323269218206, + 0.3925069235265255, + 0.5935286562889814, + 0.5326863005757332, + 1.2480902764946222, + 0.08391408063471317, + 1.0952872224152088, + 1.0286803506314754, + 0.5364505350589752, + 2.533911306411028, + 0.23757531493902206, + 0.3468622099608183, + 0.37783454544842243, + 0.13781939074397087, + 0.051087636500597, + 0.16927312687039375, + 0.9649182222783566, + 0.6568844188004732, + 0.16095226630568504, + 1.1801359839737415, + 1.0413183271884918, + 0.6226447001099586, + 0.07378690131008625, + 0.3872943390160799, + 1.0117802806198597, + 0.31813780404627323, + 0.32225379906594753, + 0.17694765329360962, + 0.5976194012910128, + 1.4452718067914248, + 0.29853575490415096, + 0.095358831807971, + 0.28629004396498203, + 0.3891234342008829, + 0.931422021239996, + 0.3808420952409506, + 0.6473406236618757, + 0.5334285404533148, + 3.2002784945070744, + 2.9145935345441103, + 1.252188578248024, + 0.42078614607453346, + 0.26405553333461285, + 0.2965402062982321, + 1.4811474457383156, + 0.23121461644768715 + ], + "unique_experts": 63, + "load_cv": 0.5997942033895902, + "normalized_load_entropy": 0.9539764339041797, + "max_load_share": 0.03611111111111111 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "6ef596478c12c5b1efec280cfeec62ec95432dadf1a96ffe30efc0bfa69b952a", + "route_weight_sha256": "171070bfe977dc57b70293cd2cd05218992ed3e78efb718ef010f3315b925776", + "loads": [ + 2, + 10, + 9, + 18, + 6, + 5, + 17, + 7, + 11, + 15, + 14, + 3, + 16, + 11, + 22, + 10, + 8, + 11, + 20, + 12, + 22, + 15, + 17, + 3, + 19, + 10, + 16, + 27, + 12, + 9, + 7, + 7, + 2, + 6, + 21, + 28, + 3, + 14, + 27, + 12, + 2, + 14, + 26, + 8, + 4, + 1, + 16, + 29, + 11, + 3, + 10, + 12, + 14, + 14, + 22, + 18, + 26, + 35, + 22, + 11, + 18, + 10, + 25, + 15 + ], + "weighted_loads": [ + 0.23261456191539764, + 0.94704470038414, + 0.2457865383476019, + 2.2011216450482607, + 0.19768139347434044, + 0.36618651263415813, + 0.4807483088225126, + 0.42930183559656143, + 0.4917508363723755, + 0.44680137373507023, + 0.44630182161927223, + 0.0960632972419262, + 1.00326394662261, + 1.4821674972772598, + 0.9643210489302874, + 0.6321571134030819, + 0.27071966975927353, + 0.6856669187545776, + 2.8680323269218206, + 1.0877231322228909, + 0.8844630848616362, + 1.2380988001823425, + 1.2480902764946222, + 0.08391408063471317, + 1.2108479551970959, + 1.0286803506314754, + 0.5364505350589752, + 2.747891116887331, + 0.5248488318175077, + 0.3468622099608183, + 0.37783454544842243, + 0.19959052838385105, + 0.051087636500597, + 0.20219573751091957, + 1.189007505774498, + 2.6689655017107725, + 0.16095226630568504, + 1.1801359839737415, + 1.1742198904976249, + 0.6226447001099586, + 0.07378690131008625, + 0.41217952594161034, + 1.7263300903141499, + 0.31813780404627323, + 0.32225379906594753, + 0.17694765329360962, + 0.6935835592448711, + 1.6879708338528872, + 0.3239142429083586, + 0.095358831807971, + 0.28629004396498203, + 1.1180932316929102, + 0.931422021239996, + 0.3808420952409506, + 0.6473406236618757, + 0.5334285404533148, + 3.2002784945070744, + 3.4182772133499384, + 1.6161651983857155, + 0.5845766011625528, + 1.0933155119419098, + 0.4203448388725519, + 2.013839727267623, + 1.201453309506178 + ], + "unique_experts": 64, + "load_cv": 0.5705180258409773, + "normalized_load_entropy": 0.9587634421040433, + "max_load_share": 0.040229885057471264 + } + }, + "s1_bos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "2d638c05b5dcd31db0c9e31a207d0031ae0027e116e92193ed5aec2a062b057d", + "route_weight_sha256": "e71fc991024bbe47627e74825b30d925d6fa764fb5364b688962fa4e116e46f5", + "loads": [ + 2, + 1, + 10, + 13, + 6, + 4, + 16, + 5, + 5, + 11, + 13, + 3, + 15, + 9, + 18, + 11, + 6, + 11, + 20, + 8, + 24, + 7, + 17, + 5, + 17, + 10, + 12, + 25, + 11, + 8, + 9, + 5, + 5, + 4, + 18, + 12, + 2, + 16, + 27, + 12, + 2, + 16, + 18, + 10, + 4, + 1, + 12, + 25, + 12, + 3, + 5, + 5, + 13, + 10, + 24, + 18, + 26, + 26, + 14, + 6, + 7, + 8, + 18, + 4 + ], + "weighted_loads": [ + 0.2391212061047554, + 0.027530204504728317, + 0.27416430227458477, + 1.304630359634757, + 0.19088713079690933, + 0.33711376041173935, + 0.45864194817841053, + 0.3291180394589901, + 0.30153219029307365, + 0.32874676398932934, + 0.3846998643130064, + 0.0946968775242567, + 0.974839324131608, + 1.4200385361909866, + 0.7675856351852417, + 0.6727375779300928, + 0.20980609208345413, + 0.6608801670372486, + 2.8767868857830763, + 0.39163046330213547, + 0.7083674762398005, + 0.5377984531223774, + 1.2312341332435608, + 0.13546213693916798, + 1.089484829455614, + 1.0285185314714909, + 0.42905772663652897, + 2.6768063344061375, + 0.3079846203327179, + 0.32217739149928093, + 0.4394416883587837, + 0.13684010691940784, + 0.13627628237009048, + 0.12612918764352798, + 1.0583277866244316, + 0.7044848278164864, + 0.12135056778788567, + 1.313116742298007, + 1.1348535064607859, + 0.605495385825634, + 0.07666481845080853, + 0.477686557918787, + 0.986077107489109, + 0.39875482954084873, + 0.33517496660351753, + 0.1983044445514679, + 0.5486494824290276, + 1.436266679316759, + 0.35161726735532284, + 0.08608900755643845, + 0.1539730466902256, + 0.36528245732188225, + 0.8704871144145727, + 0.27477937936782837, + 0.7014067005366087, + 0.5415143631398678, + 3.149830173701048, + 2.9294985346496105, + 1.2275700755417347, + 0.36738494224846363, + 0.2460738904774189, + 0.32646121084690094, + 1.443716622889042, + 0.26671465672552586 + ], + "unique_experts": 64, + "load_cv": 0.6198366969325045, + "normalized_load_entropy": 0.9528405784999587, + "max_load_share": 0.0375 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "b563aed1d7859793e6c794062f506c3e0317d83f1452089e7c5a55809a7c4efb", + "route_weight_sha256": "53484f35a9657134415ed7ad27256f1c516cd4cbb53b6b8e12885ec77cec40c2", + "loads": [ + 6, + 12, + 11, + 16, + 7, + 5, + 16, + 9, + 14, + 12, + 20, + 3, + 16, + 11, + 29, + 12, + 9, + 11, + 20, + 14, + 26, + 17, + 18, + 5, + 23, + 11, + 12, + 28, + 16, + 8, + 10, + 9, + 5, + 5, + 27, + 30, + 2, + 17, + 32, + 15, + 2, + 17, + 28, + 11, + 7, + 1, + 19, + 32, + 14, + 4, + 6, + 14, + 14, + 13, + 24, + 18, + 30, + 33, + 16, + 16, + 17, + 14, + 30, + 17 + ], + "weighted_loads": [ + 0.7582259029150009, + 1.0322188921272755, + 0.2994722109287977, + 2.098139839246869, + 0.22114963456988335, + 0.479268915951252, + 0.45864194817841053, + 0.4879407398402691, + 0.9530143421143293, + 0.44534419290721416, + 0.6909282263368368, + 0.0946968775242567, + 1.0024423617869616, + 1.4650327917188406, + 1.2930818013846874, + 0.7055245619267225, + 0.301892327144742, + 0.6608801670372486, + 2.8767868857830763, + 1.108882701024413, + 0.9831015411764383, + 1.332437727600336, + 1.2697139531373978, + 0.13546213693916798, + 1.368163987994194, + 1.0788188092410564, + 0.42905772663652897, + 3.285443101078272, + 0.6172726806253195, + 0.32217739149928093, + 0.4730961285531521, + 0.23846572823822498, + 0.13627628237009048, + 0.16168168932199478, + 1.4247992672026157, + 2.5127182342112064, + 0.12135056778788567, + 1.355013968423009, + 1.3572893794625998, + 0.9603979848325253, + 0.07666481845080853, + 0.5027394723147154, + 2.1394553538411856, + 0.580470347777009, + 0.9842557646334171, + 0.1983044445514679, + 1.1512063331902027, + 1.8001232240349054, + 0.42060953192412853, + 0.12883715331554413, + 0.18026893213391304, + 1.483167354017496, + 1.047095274552703, + 0.4587822575122118, + 0.7014067005366087, + 0.5415143631398678, + 3.4032106660306454, + 3.289542207494378, + 1.3388343788683414, + 0.8236237186938524, + 0.9184184726327658, + 0.7266918383538723, + 2.345006102696061, + 1.5637116748839617 + ], + "unique_experts": 64, + "load_cv": 0.5510475555097913, + "normalized_load_entropy": 0.9619651717536845, + "max_load_share": 0.034161490683229816 + } + }, + "s0_x": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "e6834da8710ee3d7d5ff88636afce7410d3a0deda8ffd1928b92abfa41ff31e5", + "route_weight_sha256": "4835e585d683ad6ca26ea7ef99dcaa584cbc6923fd95de26e8d05839cf801d4f", + "loads": [ + 2, + 1, + 10, + 19, + 6, + 5, + 17, + 3, + 8, + 16, + 11, + 3, + 17, + 11, + 18, + 10, + 8, + 11, + 21, + 8, + 21, + 6, + 17, + 3, + 17, + 10, + 15, + 25, + 4, + 8, + 7, + 5, + 2, + 4, + 17, + 12, + 1, + 14, + 24, + 16, + 2, + 12, + 19, + 8, + 4, + 1, + 13, + 26, + 10, + 2, + 11, + 6, + 14, + 15, + 21, + 16, + 26, + 26, + 14, + 7, + 4, + 7, + 18, + 5 + ], + "weighted_loads": [ + 0.24306192994117737, + 0.03444896265864372, + 0.2726187463849783, + 1.4948817193508148, + 0.1954805962741375, + 0.3632714468985796, + 0.47691685520112514, + 0.26394301280379295, + 0.4084911271929741, + 0.47293226048350334, + 0.3074532672762871, + 0.09655644372105598, + 1.0284093115478754, + 1.4469917342066765, + 0.7766752131283283, + 0.6365975812077522, + 0.2613102812319994, + 0.6904407180845737, + 2.875702414661646, + 0.395003966987133, + 0.6221261229366064, + 0.5308237057179213, + 1.2461340501904488, + 0.07607794553041458, + 1.1089825592935085, + 1.0161247998476028, + 0.509214710444212, + 2.4704722687602043, + 0.10755252465605736, + 0.32139396481215954, + 0.3743884973227978, + 0.13781531155109406, + 0.05073196068406105, + 0.15941817127168179, + 1.0258089378476143, + 0.646476749330759, + 0.08971681445837021, + 1.118319220840931, + 1.0371551606804132, + 0.7578340750187635, + 0.07274710386991501, + 0.360901253297925, + 0.9718076065182686, + 0.3177644573152065, + 0.309963621199131, + 0.17237810790538788, + 0.6080351900309324, + 1.4782003723084927, + 0.29589411057531834, + 0.07222888991236687, + 0.30473863892257214, + 0.38356427662074566, + 0.927248815074563, + 0.4053319953382015, + 0.6119134351611137, + 0.4660059083253145, + 3.193988297134638, + 2.7671021074056625, + 1.2302141673862934, + 0.4344647116959095, + 0.1375083103775978, + 0.30960482358932495, + 1.5154590010643005, + 0.24178391322493553 + ], + "unique_experts": 64, + "load_cv": 0.6259807120445899, + "normalized_load_entropy": 0.9497096350942642, + "max_load_share": 0.03611111111111111 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "cd1bcc336d4f6da223f93c52c2823266cf7be4ec0fcf6e53c0bd93473233e29a", + "route_weight_sha256": "bf73ee2e48cd173ebd21956670bb6198baa769de9e719326a242e1739f4529a7", + "loads": [ + 2, + 11, + 10, + 20, + 6, + 5, + 18, + 5, + 11, + 16, + 16, + 4, + 18, + 12, + 23, + 10, + 9, + 11, + 21, + 12, + 23, + 16, + 17, + 3, + 19, + 10, + 15, + 27, + 7, + 8, + 7, + 7, + 2, + 5, + 22, + 27, + 1, + 14, + 26, + 16, + 2, + 13, + 25, + 8, + 4, + 1, + 16, + 31, + 11, + 2, + 11, + 12, + 14, + 15, + 21, + 16, + 26, + 33, + 23, + 10, + 15, + 10, + 24, + 15 + ], + "weighted_loads": [ + 0.24306192994117737, + 0.9814936630427837, + 0.2726187463849783, + 2.224120706319809, + 0.1954805962741375, + 0.3632714468985796, + 0.5118871424347162, + 0.35946058109402657, + 0.5177073590457439, + 0.47293226048350334, + 0.5425144135951996, + 0.13175024092197418, + 1.0582462325692177, + 1.4680605083703995, + 0.9956888519227505, + 0.6365975812077522, + 0.2920214459300041, + 0.6904407180845737, + 2.875702414661646, + 1.108933337032795, + 0.9225555565208197, + 1.5339370425790548, + 1.2461340501904488, + 0.07607794553041458, + 1.225225791335106, + 1.0161247998476028, + 0.509214710444212, + 2.687149465084076, + 0.39392953738570213, + 0.32139396481215954, + 0.3743884973227978, + 0.19716721214354038, + 0.05073196068406105, + 0.18994312919676304, + 1.2498982213437557, + 2.603829398751259, + 0.08971681445837021, + 1.118319220840931, + 1.0813255393877625, + 0.7578340750187635, + 0.07274710386991501, + 0.38588421046733856, + 1.606250125914812, + 0.3177644573152065, + 0.309963621199131, + 0.17237810790538788, + 0.703805772587657, + 1.7525856830179691, + 0.32127259857952595, + 0.07222888991236687, + 0.30473863892257214, + 1.0565238129347563, + 0.927248815074563, + 0.4053319953382015, + 0.6119134351611137, + 0.4660059083253145, + 3.193988297134638, + 3.196355875581503, + 1.7235179208219051, + 0.5675682611763477, + 1.020406512543559, + 0.4340849742293358, + 2.005289427936077, + 0.9276858828961849 + ], + "unique_experts": 64, + "load_cv": 0.5775882083799027, + "normalized_load_entropy": 0.9566054972845576, + "max_load_share": 0.03793103448275862 + } + }, + "s1_x": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "7814df397e00ffe136fc2ddc3d99d447ace0e9fc5f55660fb6602fe25b7f21df", + "route_weight_sha256": "68ea4d5a591da021cc9e2a8f301b95ab657e63f80ebc7f55d19d0ed6ba64cd54", + "loads": [ + 2, + 1, + 12, + 12, + 6, + 4, + 16, + 4, + 8, + 10, + 13, + 3, + 15, + 9, + 18, + 11, + 6, + 11, + 20, + 8, + 24, + 7, + 17, + 7, + 17, + 10, + 9, + 25, + 12, + 8, + 10, + 5, + 2, + 4, + 18, + 12, + 2, + 14, + 26, + 12, + 2, + 19, + 18, + 11, + 4, + 1, + 12, + 26, + 10, + 3, + 7, + 6, + 13, + 9, + 22, + 17, + 26, + 26, + 14, + 6, + 8, + 8, + 18, + 4 + ], + "weighted_loads": [ + 0.24731077998876572, + 0.0309505183249712, + 0.3326617069542408, + 1.2637875489890575, + 0.18904796801507473, + 0.33372877165675163, + 0.4517535213381052, + 0.28985850512981415, + 0.4047852139919996, + 0.2992265820503235, + 0.36943925358355045, + 0.08523565158247948, + 0.986451979726553, + 1.391172043979168, + 0.7618893776088953, + 0.6670595314353704, + 0.2102812211960554, + 0.6606997027993202, + 2.8423601370304823, + 0.398384403437376, + 0.7074098624289036, + 0.5408845469355583, + 1.2383448351174593, + 0.18331510946154594, + 1.0906529650092125, + 1.0015116073191166, + 0.3386099115014076, + 2.642168127000332, + 0.31718385219573975, + 0.31870088167488575, + 0.46784734539687634, + 0.13829500414431095, + 0.054179683327674866, + 0.1245182678103447, + 1.0810809582471848, + 0.7114058192819357, + 0.11997845768928528, + 1.2124758753925562, + 1.110388120636344, + 0.5988004337996244, + 0.07711369544267654, + 0.5582079123705626, + 0.9716454409062862, + 0.4078632388263941, + 0.32539714872837067, + 0.1930016130208969, + 0.554445143789053, + 1.4772694073617458, + 0.2999173551797867, + 0.08761659450829029, + 0.2047137599438429, + 0.3940084110945463, + 0.8765347246080637, + 0.2509111054241657, + 0.6459284815937281, + 0.5141299366950989, + 3.1586070396006107, + 2.8225246965885162, + 1.2092688158154488, + 0.3753293454647064, + 0.2743168734014034, + 0.3350225128233433, + 1.4748790562152863, + 0.24889707006514072 + ], + "unique_experts": 64, + "load_cv": 0.6132286545131835, + "normalized_load_entropy": 0.953454575938455, + "max_load_share": 0.03611111111111111 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "6727a253c8748112bf8c917b4af877e1d27f61dcd717b3eb886eb10d415bd6fe", + "route_weight_sha256": "9afb89bdcc716a99fc6a5907e004c90dae171423ec248bfaca50dd624c8ba642", + "loads": [ + 6, + 12, + 13, + 14, + 7, + 5, + 16, + 8, + 17, + 11, + 22, + 4, + 16, + 11, + 27, + 12, + 9, + 11, + 20, + 14, + 26, + 18, + 18, + 7, + 23, + 11, + 9, + 28, + 17, + 8, + 11, + 9, + 3, + 5, + 27, + 30, + 2, + 15, + 30, + 15, + 2, + 20, + 27, + 12, + 7, + 1, + 19, + 34, + 12, + 4, + 8, + 14, + 14, + 12, + 22, + 17, + 30, + 33, + 17, + 16, + 19, + 14, + 29, + 16 + ], + "weighted_loads": [ + 0.7664154767990112, + 1.0356392059475183, + 0.35796961560845375, + 2.025031875818968, + 0.21931047178804874, + 0.47588392719626427, + 0.4517535213381052, + 0.44835837557911873, + 1.0596944987773895, + 0.4158240109682083, + 0.7894062157720327, + 0.12032514438033104, + 1.0130625888705254, + 1.4353315345942974, + 1.236398471519351, + 0.6998465154320002, + 0.3078104071319103, + 0.6606997027993202, + 2.8423601370304823, + 1.125798324123025, + 0.9832292981445789, + 1.616922453045845, + 1.2768246550112963, + 0.18331510946154594, + 1.3692254163324833, + 1.0518118850886822, + 0.3386099115014076, + 3.2553488463163376, + 0.6356103178113699, + 0.31870088167488575, + 0.5015017855912447, + 0.23941958881914616, + 0.0836279597133398, + 0.15895169228315353, + 1.4475524388253689, + 2.481532821431756, + 0.11997845768928528, + 1.254373101517558, + 1.2160450387746096, + 0.9537030328065157, + 0.07711369544267654, + 0.5831407085061073, + 2.0681107379496098, + 0.5895787570625544, + 0.9744779467582703, + 0.1930016130208969, + 1.1568357776850462, + 1.8686462473124266, + 0.3689096197485924, + 0.13036474026739597, + 0.23100964538753033, + 1.43367881141603, + 1.0531428847461939, + 0.43491398356854916, + 0.6459284815937281, + 0.5141299366950989, + 3.411987531930208, + 3.1826373916119337, + 1.426683448255062, + 0.8328782618045807, + 0.9927912186831236, + 0.7346752770245075, + 2.318491404876113, + 1.3105438183993101 + ], + "unique_experts": 64, + "load_cv": 0.5456694465572575, + "normalized_load_entropy": 0.9625596408453105, + "max_load_share": 0.035196687370600416 + } + }, + "s0_period": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "629741b084bd31edcd2b946d141e1161d65a5742566ca61c6bca82b8228d6c90", + "route_weight_sha256": "94dd82d2cac0e6c5abf8ce86c89177e063c53fe978654b3bbaef3d03eef0eb53", + "loads": [ + 2, + 0, + 10, + 17, + 6, + 5, + 18, + 3, + 8, + 16, + 11, + 3, + 16, + 11, + 18, + 10, + 8, + 11, + 21, + 8, + 21, + 6, + 18, + 4, + 17, + 10, + 14, + 25, + 4, + 8, + 8, + 5, + 2, + 5, + 18, + 13, + 3, + 14, + 23, + 15, + 2, + 13, + 19, + 7, + 4, + 1, + 13, + 26, + 10, + 1, + 12, + 6, + 14, + 13, + 21, + 17, + 25, + 25, + 14, + 7, + 5, + 7, + 18, + 5 + ], + "weighted_loads": [ + 0.2431756556034088, + 0.0, + 0.27466082759201527, + 1.4516453742980957, + 0.19528979621827602, + 0.36343400180339813, + 0.5098844915628433, + 0.2660922110080719, + 0.407468868419528, + 0.47296481393277645, + 0.30866789259016514, + 0.0962334405630827, + 1.0089431200176477, + 1.4433571305125952, + 0.7688223458826542, + 0.6441766545176506, + 0.26422937400639057, + 0.6899474486708641, + 2.876057820394635, + 0.3953796215355396, + 0.6205786652863026, + 0.5352968238294125, + 1.2720203343778849, + 0.10290133953094482, + 1.1063641160726547, + 1.017590269446373, + 0.48072313144803047, + 2.4498427659273148, + 0.10745933651924133, + 0.3234503008425236, + 0.3998389523476362, + 0.13759082555770874, + 0.050649942830204964, + 0.18297195807099342, + 1.0680240280926228, + 0.6803946699947119, + 0.16001677513122559, + 1.09577458165586, + 1.0008788760751486, + 0.7247008234262466, + 0.07262452319264412, + 0.38720946200191975, + 0.9763378463685513, + 0.28643864020705223, + 0.3114030696451664, + 0.17487141489982605, + 0.6070150621235371, + 1.4806428849697113, + 0.29703026823699474, + 0.040411245077848434, + 0.3302628342062235, + 0.38469613157212734, + 0.9236416537314653, + 0.3540460094809532, + 0.6165121104568243, + 0.4916658364236355, + 3.1546713821589947, + 2.7215354554355145, + 1.235073123127222, + 0.4310641195625067, + 0.1661242228001356, + 0.3153456263244152, + 1.5240104459226131, + 0.242308946326375 + ], + "unique_experts": 63, + "load_cv": 0.6130272988503876, + "normalized_load_entropy": 0.9509996577899266, + "max_load_share": 0.03611111111111111 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "f123aca707810e2d6445cd6e5526dcea58b7ec3abdf3dab16672d393e634b412", + "route_weight_sha256": "786fd4e0045fc016b598434dd79cdac7c833d713dcea675f45799c0f0a33e4fd", + "loads": [ + 3, + 10, + 10, + 19, + 6, + 5, + 18, + 5, + 12, + 16, + 14, + 3, + 16, + 12, + 23, + 11, + 8, + 11, + 21, + 12, + 23, + 15, + 18, + 4, + 20, + 10, + 14, + 27, + 7, + 8, + 8, + 7, + 2, + 7, + 23, + 27, + 3, + 14, + 26, + 15, + 2, + 14, + 25, + 7, + 4, + 1, + 17, + 31, + 12, + 1, + 12, + 12, + 14, + 13, + 21, + 17, + 25, + 32, + 22, + 10, + 17, + 10, + 24, + 14 + ], + "weighted_loads": [ + 0.5365572273731232, + 0.94704470038414, + 0.27466082759201527, + 2.2138860784471035, + 0.19528979621827602, + 0.36343400180339813, + 0.5098844915628433, + 0.3616713434457779, + 0.563336631283164, + 0.47296481393277645, + 0.43464083783328533, + 0.0962334405630827, + 1.0089431200176477, + 1.464350115507841, + 0.9877189788967371, + 0.6894974857568741, + 0.26422937400639057, + 0.6899474486708641, + 2.876057820394635, + 1.1345276273787022, + 0.8639829121530056, + 1.4081739895045757, + 1.2720203343778849, + 0.10290133953094482, + 1.2521033771336079, + 1.017590269446373, + 0.48072313144803047, + 2.6665476113557816, + 0.36304386146366596, + 0.3234503008425236, + 0.3998389523476362, + 0.19699722342193127, + 0.050649942830204964, + 0.26251397654414177, + 1.2921133115887642, + 2.5769323278218508, + 0.16001677513122559, + 1.09577458165586, + 1.1051549958065152, + 0.7247008234262466, + 0.07262452319264412, + 0.4124508034437895, + 1.615998487919569, + 0.28643864020705223, + 0.3114030696451664, + 0.17487141489982605, + 0.7286791577935219, + 1.7575110904872417, + 0.348460903391242, + 0.040411245077848434, + 0.3302628342062235, + 1.0397114176303148, + 0.9236416537314653, + 0.3540460094809532, + 0.6165121104568243, + 0.4916658364236355, + 3.1546713821589947, + 3.150589033961296, + 1.5990497432649136, + 0.5681727472692728, + 1.0554775781929493, + 0.43941501528024673, + 2.008614756166935, + 0.8826133590191603 + ], + "unique_experts": 64, + "load_cv": 0.5670989934141584, + "normalized_load_entropy": 0.958460179068926, + "max_load_share": 0.0367816091954023 + } + }, + "s1_period": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "eb9ceab96d05ab1d4a44afdc44f4aaa975053698ce713c5af617607cbcddaea2", + "route_weight_sha256": "8642446314e2d3726d9cf84e328686b5380d61a0defd77d56d19818afdbe7f8d", + "loads": [ + 2, + 1, + 13, + 11, + 6, + 4, + 16, + 3, + 8, + 10, + 14, + 4, + 15, + 9, + 18, + 11, + 6, + 11, + 20, + 8, + 23, + 7, + 17, + 7, + 17, + 10, + 9, + 25, + 11, + 8, + 10, + 5, + 2, + 4, + 18, + 12, + 2, + 14, + 26, + 12, + 2, + 20, + 18, + 11, + 4, + 1, + 12, + 26, + 11, + 4, + 7, + 6, + 13, + 8, + 23, + 15, + 26, + 26, + 14, + 6, + 9, + 7, + 18, + 4 + ], + "weighted_loads": [ + 0.2473708540201187, + 0.02544434554874897, + 0.3616761788725853, + 1.2367245852947235, + 0.1897849589586258, + 0.33257829025387764, + 0.45086707919836044, + 0.2587330713868141, + 0.40384544618427753, + 0.3000409696251154, + 0.3991992138326168, + 0.10781420953571796, + 0.9828442391008139, + 1.3884215280413628, + 0.7576620113104582, + 0.6719076130539179, + 0.20923318341374397, + 0.6600572168827057, + 2.843444647267461, + 0.3984726034104824, + 0.6824388578534126, + 0.5456734653562307, + 1.235723689198494, + 0.18296254612505436, + 1.0938524026423693, + 1.0016249865293503, + 0.3407798819243908, + 2.6530804000794888, + 0.2882487326860428, + 0.3200247064232826, + 0.4683903306722641, + 0.1380019336938858, + 0.053942834958434105, + 0.12370498850941658, + 1.0797914117574692, + 0.7125538568943739, + 0.12061319872736931, + 1.2023919094353914, + 1.1063628308475018, + 0.6016148719936609, + 0.07625695317983627, + 0.5834351945668459, + 0.9777402877807617, + 0.4110503513365984, + 0.3245181255042553, + 0.19364339113235474, + 0.553345263004303, + 1.4762681685388088, + 0.3359481729567051, + 0.11159430630505085, + 0.20574099756777287, + 0.38942965120077133, + 0.8741151206195354, + 0.22562702745199203, + 0.673274228349328, + 0.45545781031250954, + 3.162116650491953, + 2.792577400803566, + 1.2101499382406473, + 0.3775269165635109, + 0.3070542812347412, + 0.3157740868628025, + 1.4784468784928322, + 0.24975041672587395 + ], + "unique_experts": 64, + "load_cv": 0.6124228346453631, + "normalized_load_entropy": 0.9537174087098144, + "max_load_share": 0.03611111111111111 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "c50ae00cd9e3b781b7caa178f6571a95f6b59b70a9ada1855ed4092354c7561c", + "route_weight_sha256": "ef17515a6b495a380109fe08b7c27826d9fa5065ec7935e7170f1034e3f7a2a4", + "loads": [ + 7, + 12, + 14, + 14, + 7, + 5, + 16, + 7, + 18, + 11, + 21, + 4, + 15, + 11, + 27, + 13, + 9, + 11, + 20, + 14, + 25, + 17, + 18, + 7, + 23, + 11, + 9, + 28, + 16, + 8, + 11, + 9, + 2, + 6, + 27, + 28, + 2, + 15, + 32, + 15, + 2, + 21, + 27, + 12, + 7, + 1, + 20, + 34, + 14, + 5, + 8, + 14, + 14, + 11, + 23, + 15, + 30, + 33, + 16, + 16, + 21, + 13, + 29, + 15 + ], + "weighted_loads": [ + 1.0345168933272362, + 1.0301330331712961, + 0.38698408752679825, + 2.0330106876790524, + 0.2200474627315998, + 0.4747334457933903, + 0.45086707919836044, + 0.4174654074013233, + 1.102046225219965, + 0.4166383985430002, + 0.7054275758564472, + 0.10781420953571796, + 0.9828442391008139, + 1.4326743222773075, + 1.2324012871831656, + 0.7391627300530672, + 0.3056234288960695, + 0.6600572168827057, + 2.843444647267461, + 1.157396236434579, + 0.9159481376409531, + 1.4495434146374464, + 1.274203509092331, + 0.18296254612505436, + 1.3725559320300817, + 1.0519252642989159, + 0.3407798819243908, + 3.265839073807001, + 0.5660584326833487, + 0.3200247064232826, + 0.5020447708666325, + 0.2389985304325819, + 0.053942834958434105, + 0.19802318885922432, + 1.4462628923356533, + 2.384240983054042, + 0.12061319872736931, + 1.2442891355603933, + 1.3060900904238224, + 0.9565174710005522, + 0.07625695317983627, + 0.6084749791771173, + 2.0783094577491283, + 0.5927658695727587, + 0.9735989235341549, + 0.19364339113235474, + 1.1818379927426577, + 1.8723957668989897, + 0.4294525757431984, + 0.15434245206415653, + 0.2320368830114603, + 1.3915845453739166, + 1.0507232807576656, + 0.40962990559637547, + 0.673274228349328, + 0.45545781031250954, + 3.4154971428215504, + 3.1522585060447454, + 1.321414241567254, + 0.8591460362076759, + 1.0426136385649443, + 0.715440172702074, + 2.325325643643737, + 1.2559166476130486 + ], + "unique_experts": 64, + "load_cv": 0.5452922502185328, + "normalized_load_entropy": 0.962645821594754, + "max_load_share": 0.035196687370600416 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 120, + "ordered_topk_exact_tokens": 75, + "set_exact_tokens": 90, + "mean_set_jaccard": 0.9285714285714287, + "mean_token_weighted_tv": 0.011992934361721079, + "aggregate_load_tv": 0.030555555555555558 + }, + "system_bos": { + "tokens": 120, + "ordered_topk_exact_tokens": 59, + "set_exact_tokens": 73, + "mean_set_jaccard": 0.8724206349206349, + "mean_token_weighted_tv": 0.02019794857284675, + "aggregate_load_tv": 0.05138888888888889 + }, + "system_x": { + "tokens": 120, + "ordered_topk_exact_tokens": 50, + "set_exact_tokens": 64, + "mean_set_jaccard": 0.8496031746031747, + "mean_token_weighted_tv": 0.023251056865168113, + "aggregate_load_tv": 0.06527777777777777 + }, + "system_period": { + "tokens": 120, + "ordered_topk_exact_tokens": 54, + "set_exact_tokens": 66, + "mean_set_jaccard": 0.8547619047619048, + "mean_token_weighted_tv": 0.02285026522974173, + "aggregate_load_tv": 0.06944444444444443 + }, + "bos_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 35, + "set_exact_tokens": 50, + "mean_set_jaccard": 0.8037698412698414, + "mean_token_weighted_tv": 0.032514571615805225, + "aggregate_load_tv": 0.08194444444444444 + }, + "bos_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 39, + "set_exact_tokens": 58, + "mean_set_jaccard": 0.8363095238095238, + "mean_token_weighted_tv": 0.02810352366262426, + "aggregate_load_tv": 0.07222222222222222 + }, + "x_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 34, + "set_exact_tokens": 45, + "mean_set_jaccard": 0.7936507936507937, + "mean_token_weighted_tv": 0.03337920473422855, + "aggregate_load_tv": 0.08888888888888889 + }, + "x_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 39, + "set_exact_tokens": 63, + "mean_set_jaccard": 0.8468253968253969, + "mean_token_weighted_tv": 0.02729123526563247, + "aggregate_load_tv": 0.062499999999999986 + }, + "period_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 35, + "set_exact_tokens": 49, + "mean_set_jaccard": 0.8049603174603175, + "mean_token_weighted_tv": 0.03218741376573841, + "aggregate_load_tv": 0.08472222222222223 + }, + "period_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 39, + "set_exact_tokens": 63, + "mean_set_jaccard": 0.85, + "mean_token_weighted_tv": 0.026662039725730818, + "aggregate_load_tv": 0.062499999999999986 + } + } + }, + "layer_03": { + "layer": 3, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "48a1cd72552dfc6c8371363742b8bd67afcda740f6f6e9e13acff347c5310547", + "route_weight_sha256": "9d333087f43b2cd3fde7656486b00756476d890de18df2fec3fb9c4eac55dea6", + "loads": [ + 41, + 9, + 22, + 1, + 12, + 12, + 20, + 23, + 4, + 8, + 3, + 6, + 9, + 5, + 14, + 10, + 9, + 13, + 11, + 11, + 12, + 16, + 7, + 7, + 39, + 1, + 0, + 16, + 1, + 1, + 14, + 8, + 24, + 22, + 12, + 20, + 4, + 1, + 14, + 1, + 14, + 6, + 3, + 8, + 7, + 14, + 17, + 18, + 20, + 23, + 2, + 4, + 5, + 19, + 6, + 6, + 3, + 3, + 18, + 11, + 20, + 1, + 14, + 15 + ], + "weighted_loads": [ + 2.9735303334891796, + 0.5600190982222557, + 1.0158952232450247, + 0.04966268688440323, + 1.2561094909906387, + 0.9270350113511086, + 1.8196713514626026, + 1.8573023565113544, + 0.10867793299257755, + 0.7034178227186203, + 0.08249402977526188, + 0.17769421637058258, + 1.9283740781247616, + 0.18863710947334766, + 0.5628230907022953, + 0.43340738490223885, + 0.7561181988567114, + 0.6747679729014635, + 1.8050453066825867, + 0.6525390259921551, + 0.8406181950122118, + 1.6262878850102425, + 0.4544774480164051, + 0.21911749243736267, + 1.5515289269387722, + 0.035878486931324005, + 0.0, + 1.2113475631922483, + 0.029668983072042465, + 0.023371832445263863, + 0.640020627528429, + 0.21913886442780495, + 0.8208138197660446, + 1.9685477316379547, + 1.1701796278357506, + 1.8487159330397844, + 0.37701890617609024, + 0.02802000194787979, + 1.113825485110283, + 0.04672258719801903, + 0.4415907170623541, + 0.1956873033195734, + 0.10072007775306702, + 0.3375863842666149, + 0.28663409501314163, + 1.1106455456465483, + 1.5087545365095139, + 1.2830446921288967, + 1.3181722573935986, + 2.2106163911521435, + 0.057437583804130554, + 0.2642349563539028, + 0.20458629727363586, + 1.122143056243658, + 0.7277989275753498, + 0.3252504263073206, + 0.12075807526707649, + 0.08672227896749973, + 1.2624202985316515, + 0.3506986014544964, + 1.3806380741298199, + 0.06640779972076416, + 0.6568587776273489, + 0.6418935656547546 + ], + "unique_experts": 63, + "load_cv": 0.7531005867924686, + "normalized_load_entropy": 0.9322062403283615, + "max_load_share": 0.05694444444444444 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "b032f2432931d559cc660bf9d7ad20dae4bc65d0495232e8190ef55d37407f8b", + "route_weight_sha256": "1aae6cb0d25bfb29b1e37e82b12060a4f9b875d3e9fe9c8dea15f2e4cc4c1959", + "loads": [ + 51, + 9, + 22, + 11, + 14, + 16, + 20, + 32, + 4, + 14, + 5, + 7, + 11, + 10, + 20, + 10, + 9, + 13, + 11, + 11, + 14, + 19, + 12, + 8, + 39, + 3, + 0, + 22, + 1, + 4, + 16, + 8, + 24, + 22, + 21, + 20, + 4, + 1, + 14, + 1, + 14, + 7, + 13, + 8, + 7, + 14, + 31, + 18, + 26, + 33, + 2, + 4, + 6, + 19, + 10, + 8, + 3, + 4, + 18, + 11, + 25, + 1, + 18, + 17 + ], + "weighted_loads": [ + 4.471964420750737, + 0.5600190982222557, + 1.0158952232450247, + 0.6395021565258503, + 1.284787284792401, + 1.1104979366064072, + 1.8196713514626026, + 3.2940723411738873, + 0.10867793299257755, + 0.9752489833626896, + 0.155102351680398, + 0.17857304232893512, + 1.9404672095552087, + 0.6065067630261183, + 0.9169929809868336, + 0.43340738490223885, + 0.7561181988567114, + 0.6747679729014635, + 1.8050453066825867, + 0.6525390259921551, + 0.913546996191144, + 1.927041880786419, + 0.7958572916686535, + 0.24641070514917374, + 1.5515289269387722, + 0.049613302398938686, + 0.0, + 1.435378884896636, + 0.029668983072042465, + 0.19588742591440678, + 0.7491900362074375, + 0.21913886442780495, + 0.8208138197660446, + 1.9685477316379547, + 2.2041478641331196, + 1.8487159330397844, + 0.37701890617609024, + 0.02802000194787979, + 1.113825485110283, + 0.04672258719801903, + 0.4415907170623541, + 0.20715340040624142, + 0.6741370726376772, + 0.3375863842666149, + 0.28663409501314163, + 1.1106455456465483, + 3.3643239978700876, + 1.2830446921288967, + 1.9253598265349865, + 2.824691828340292, + 0.057437583804130554, + 0.2642349563539028, + 0.2193637676537037, + 1.122143056243658, + 2.559427287429571, + 0.41358662210404873, + 0.12075807526707649, + 0.09958782885223627, + 1.2624202985316515, + 0.3506986014544964, + 1.775510247796774, + 0.06640779972076416, + 1.101334234699607, + 0.7167316377162933 + ], + "unique_experts": 63, + "load_cv": 0.7199147055363272, + "normalized_load_entropy": 0.9390887551343505, + "max_load_share": 0.05862068965517241 + } + }, + "s1_eos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "c7886ab3d8222bef815cbd5c5e573806a0d4a3afd239cefc8db688ebab280464", + "route_weight_sha256": "f166181ca08717e65634519a743e8bbd0275d45aed45973096bfc175fbc4a926", + "loads": [ + 41, + 9, + 22, + 1, + 12, + 12, + 20, + 26, + 3, + 8, + 3, + 7, + 9, + 7, + 14, + 10, + 10, + 13, + 11, + 11, + 12, + 16, + 7, + 5, + 39, + 1, + 0, + 16, + 1, + 1, + 14, + 8, + 23, + 22, + 12, + 19, + 4, + 0, + 13, + 1, + 14, + 4, + 3, + 8, + 7, + 15, + 16, + 18, + 21, + 23, + 5, + 4, + 6, + 18, + 6, + 6, + 3, + 1, + 18, + 11, + 19, + 1, + 15, + 15 + ], + "weighted_loads": [ + 3.012529192492366, + 0.5499765016138554, + 1.0030912011861801, + 0.050386473536491394, + 1.258397787809372, + 0.9497644230723381, + 1.8009448163211346, + 1.9938315693289042, + 0.07402127422392368, + 0.6960960701107979, + 0.08191632851958275, + 0.20848184823989868, + 1.9528490919619799, + 0.2642189934849739, + 0.5627845171838999, + 0.43463018350303173, + 0.7970289904624224, + 0.6710406560450792, + 1.7973673325031996, + 0.6550252698361874, + 0.8650064095854759, + 1.6032694429159164, + 0.45417768880724907, + 0.15498420223593712, + 1.5361454095691442, + 0.03377045691013336, + 0.0, + 1.200853930786252, + 0.02939387783408165, + 0.024036919698119164, + 0.6258933078497648, + 0.22401538491249084, + 0.772152628749609, + 1.946387343108654, + 1.1705326978117228, + 1.83063255995512, + 0.36903489753603935, + 0.0, + 1.0708566289395094, + 0.04560460150241852, + 0.44679270312190056, + 0.13077795505523682, + 0.09770652651786804, + 0.33118104562163353, + 0.28219297528266907, + 1.148728372529149, + 1.5154354274272919, + 1.2732076868414879, + 1.3706701770424843, + 2.2129680924117565, + 0.15460705757141113, + 0.27044622227549553, + 0.23676338605582714, + 1.0698225758969784, + 0.7441520504653454, + 0.3227310720831156, + 0.12190216779708862, + 0.03175891935825348, + 1.249072477221489, + 0.35822728648781776, + 1.3286314606666565, + 0.06465829163789749, + 0.6818113029003143, + 0.6410064473748207 + ], + "unique_experts": 62, + "load_cv": 0.7573508083534211, + "normalized_load_entropy": 0.9304439926007582, + "max_load_share": 0.05694444444444444 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "8dcb872c24aedb5cf484e26baede96c81ab77bb1d594812e6dcd3dbfc1fd81e9", + "route_weight_sha256": "940228b983120b220b847db98ee49ed2b202b5efaf6422601c5a9941c99fec3b", + "loads": [ + 55, + 11, + 22, + 12, + 13, + 19, + 20, + 38, + 3, + 17, + 6, + 8, + 13, + 13, + 22, + 11, + 12, + 13, + 12, + 11, + 14, + 22, + 17, + 5, + 41, + 4, + 0, + 19, + 1, + 4, + 16, + 8, + 23, + 24, + 20, + 19, + 4, + 5, + 13, + 2, + 15, + 5, + 18, + 10, + 7, + 18, + 34, + 18, + 29, + 33, + 5, + 10, + 10, + 23, + 10, + 12, + 3, + 2, + 25, + 12, + 30, + 2, + 21, + 22 + ], + "weighted_loads": [ + 4.882939534261823, + 0.6238015405833721, + 1.0030912011861801, + 0.7082186825573444, + 1.2589347889879718, + 1.2796818017959595, + 1.8009448163211346, + 3.517942214384675, + 0.07402127422392368, + 1.1460926516447216, + 0.16688093729317188, + 0.20936067419825122, + 2.0418659364804626, + 0.7409087084233761, + 1.09877803735435, + 0.48373650945723057, + 1.0104253310710192, + 0.6710406560450792, + 1.8529709670692682, + 0.6550252698361874, + 0.9313906133174896, + 2.0057713203132153, + 1.303423535078764, + 0.15498420223593712, + 1.639542205259204, + 0.09086891991319135, + 0.0, + 1.297001937404275, + 0.02939387783408165, + 0.18750817887485027, + 0.7301569301635027, + 0.22401538491249084, + 0.772152628749609, + 2.01902811601758, + 2.0863964203745127, + 1.83063255995512, + 0.36903489753603935, + 0.4164501316845417, + 1.0708566289395094, + 0.09583360329270363, + 0.521952148526907, + 0.13959168177098036, + 0.8023434299975634, + 0.4048449583351612, + 0.28219297528266907, + 1.3911269288510084, + 3.9516530483961105, + 1.2732076868414879, + 2.2868089824914932, + 2.676720455288887, + 0.15460705757141113, + 1.0504911243915558, + 0.44895757269114256, + 1.7837501950562, + 2.6464453004300594, + 0.645211024209857, + 0.12190216779708862, + 0.04076500050723553, + 1.7360731475055218, + 0.3886727895587683, + 2.0124885477125645, + 0.11482996493577957, + 1.1515903137624264, + 1.0882937163114548 + ], + "unique_experts": 63, + "load_cv": 0.6939463211836849, + "normalized_load_entropy": 0.9434833684964449, + "max_load_share": 0.056935817805383024 + } + }, + "s0_bos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "48cd30826cbb0efdf2f5be3a4caca88ef3a886fe09448b11989ca22fcc20738c", + "route_weight_sha256": "74fe29792316f43a6d376cc4e9e70448cf649b2c89146232e9f171b922b7fa4b", + "loads": [ + 41, + 9, + 21, + 1, + 12, + 12, + 20, + 20, + 4, + 8, + 3, + 6, + 9, + 3, + 9, + 11, + 14, + 16, + 11, + 11, + 12, + 17, + 7, + 7, + 38, + 1, + 0, + 16, + 2, + 1, + 13, + 11, + 22, + 22, + 11, + 21, + 4, + 4, + 12, + 1, + 13, + 5, + 2, + 8, + 7, + 15, + 17, + 18, + 21, + 24, + 0, + 5, + 2, + 24, + 7, + 6, + 3, + 0, + 17, + 8, + 19, + 1, + 14, + 21 + ], + "weighted_loads": [ + 2.8395586982369423, + 0.5774818100035191, + 0.9962752144783735, + 0.05224820226430893, + 1.2996686920523643, + 0.9322002157568932, + 1.7671617418527603, + 1.613853994756937, + 0.10647578723728657, + 0.7187423706054688, + 0.08234639838337898, + 0.17413243651390076, + 2.032528053969145, + 0.13009032234549522, + 0.35519574396312237, + 0.4694667384028435, + 0.934276644140482, + 0.7670573126524687, + 1.9118248000741005, + 0.6419758275151253, + 0.7946540862321854, + 1.6815309450030327, + 0.4370188005268574, + 0.21877769567072392, + 1.4258469324558973, + 0.03439034894108772, + 0.0, + 1.3003870751708746, + 0.058648282662034035, + 0.022828150540590286, + 0.5691334176808596, + 0.2924155406653881, + 0.7304611299186945, + 1.8911627158522606, + 1.1361446771770716, + 1.8731875959783792, + 0.3696880452334881, + 0.11066543124616146, + 1.0488232523202896, + 0.04519684240221977, + 0.3823695834726095, + 0.1627287920564413, + 0.06485290452837944, + 0.33537303283810616, + 0.29018203914165497, + 1.1402939427644014, + 1.5102144367992878, + 1.2676658667623997, + 1.218788592144847, + 2.388688562437892, + 0.0, + 0.29061450995504856, + 0.10133979097008705, + 1.285869201645255, + 0.7996431328356266, + 0.33138759806752205, + 0.11568456888198853, + 0.0, + 1.16923582367599, + 0.24574616365134716, + 1.3103125654160976, + 0.06443727016448975, + 0.6727613154798746, + 0.8722747508436441 + ], + "unique_experts": 61, + "load_cv": 0.7661028522639199, + "normalized_load_entropy": 0.9273688473622212, + "max_load_share": 0.05694444444444444 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "6fc14e6a20f14870126b68c5aeebfc81d2c92592e0e25d14b390bfbb3fab9a72", + "route_weight_sha256": "19b373e408f02fe2ae55eb4f908d01fcab57935b8d3d76d0ebf78896ac32b773", + "loads": [ + 52, + 9, + 21, + 11, + 14, + 17, + 20, + 30, + 4, + 13, + 5, + 7, + 10, + 7, + 15, + 11, + 14, + 16, + 12, + 11, + 14, + 20, + 12, + 8, + 38, + 2, + 0, + 22, + 2, + 5, + 15, + 11, + 22, + 22, + 19, + 21, + 4, + 4, + 12, + 1, + 13, + 5, + 12, + 8, + 7, + 15, + 31, + 18, + 29, + 34, + 0, + 5, + 2, + 24, + 11, + 8, + 3, + 0, + 17, + 8, + 25, + 1, + 18, + 23 + ], + "weighted_loads": [ + 4.495144058018923, + 0.5774818100035191, + 0.9962752144783735, + 0.642087671905756, + 1.3283464858541265, + 1.172579288482666, + 1.7671617418527603, + 2.887048952281475, + 0.10647578723728657, + 0.9726883976254612, + 0.1549547202885151, + 0.1750112624722533, + 2.0330055374652147, + 0.5228236503899097, + 0.7276767995208502, + 0.4694667384028435, + 0.934276644140482, + 0.7670573126524687, + 1.9479543678462505, + 0.6419758275151253, + 0.8666570596396923, + 1.9867635071277618, + 0.7676300574094057, + 0.24607090838253498, + 1.4258469324558973, + 0.03492034581722692, + 0.0, + 1.5244183968752623, + 0.058648282662034035, + 0.23414642363786697, + 0.6733864601701498, + 0.2924155406653881, + 0.7304611299186945, + 1.8911627158522606, + 2.1330753099173307, + 1.8731875959783792, + 0.3696880452334881, + 0.11066543124616146, + 1.0488232523202896, + 0.04519684240221977, + 0.3823695834726095, + 0.1627287920564413, + 0.7316399961709976, + 0.33537303283810616, + 0.29018203914165497, + 1.1402939427644014, + 3.561153467744589, + 1.2676658667623997, + 1.9728293512016535, + 3.0027639996260405, + 0.0, + 0.29061450995504856, + 0.10133979097008705, + 1.285869201645255, + 1.959957929328084, + 0.41718271374702454, + 0.11568456888198853, + 0.0, + 1.16923582367599, + 0.24574616365134716, + 1.7149379029870033, + 0.06443727016448975, + 1.115144344046712, + 0.946892948821187 + ], + "unique_experts": 61, + "load_cv": 0.7369779357200202, + "normalized_load_entropy": 0.9343146146755784, + "max_load_share": 0.059770114942528735 + } + }, + "s1_bos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "ba5cec0bc9e6f6c9b1f9762c1e4dba4a149eddf7a3a83ad2926915823ccde532", + "route_weight_sha256": "72aa6c2555d5bf2f391162a96ed4df109dbbdae66eedeaf0be2cec02f88863d6", + "loads": [ + 41, + 9, + 20, + 1, + 12, + 12, + 19, + 23, + 2, + 8, + 3, + 8, + 9, + 3, + 10, + 12, + 13, + 13, + 10, + 11, + 12, + 16, + 7, + 6, + 38, + 1, + 0, + 16, + 4, + 1, + 12, + 11, + 24, + 22, + 11, + 20, + 4, + 1, + 13, + 1, + 19, + 6, + 2, + 8, + 7, + 15, + 18, + 18, + 22, + 23, + 0, + 5, + 3, + 21, + 8, + 6, + 3, + 1, + 16, + 9, + 18, + 1, + 12, + 20 + ], + "weighted_loads": [ + 2.7806765101850033, + 0.549952857196331, + 0.9531762413680553, + 0.05707442760467529, + 1.2240605279803276, + 0.9424621164798737, + 1.645594585686922, + 1.7329881377518177, + 0.0512051060795784, + 0.7142798528075218, + 0.08469760231673717, + 0.23824317380785942, + 2.0499393958598375, + 0.1305666770786047, + 0.40599888004362583, + 0.5054545775055885, + 0.8998335264623165, + 0.6761639397591352, + 1.808025673031807, + 0.6278293654322624, + 0.8195102177560329, + 1.5899779722094536, + 0.40348347648978233, + 0.19764544069766998, + 1.4337688572704792, + 0.035855941474437714, + 0.0, + 1.2718919795006514, + 0.10893830098211765, + 0.03219124302268028, + 0.5518426485359669, + 0.31157163716852665, + 0.8058197107166052, + 1.8711814992129803, + 1.1440004874020815, + 1.771754652261734, + 0.3611232526600361, + 0.027753032743930817, + 1.0652834977954626, + 0.04451587796211243, + 0.5661850925534964, + 0.1957527045160532, + 0.06280100718140602, + 0.32034796476364136, + 0.2864118963479996, + 1.1208416111767292, + 1.5660788975656033, + 1.2827670238912106, + 1.2554916702210903, + 2.3535903692245483, + 0.0, + 0.2936349678784609, + 0.1386807058006525, + 1.1465304270386696, + 0.8683540653437376, + 0.32208624854683876, + 0.11683686822652817, + 0.02585066668689251, + 1.0514092035591602, + 0.28730051033198833, + 1.225454619154334, + 0.0719996988773346, + 0.5881057530641556, + 0.8187927640974522 + ], + "unique_experts": 62, + "load_cv": 0.7619014550192785, + "normalized_load_entropy": 0.9284437015117382, + "max_load_share": 0.05694444444444444 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "c4ea21150c803c210d6e213551642785219d7a97c055eb13c7a582f0a8e751f1", + "route_weight_sha256": "14e0c34dcc7c666e30657a61c052403fc22ef9bbf1efe51542072a9555271853", + "loads": [ + 56, + 11, + 20, + 12, + 13, + 19, + 19, + 35, + 2, + 17, + 6, + 9, + 12, + 9, + 18, + 13, + 15, + 13, + 12, + 11, + 14, + 22, + 18, + 6, + 40, + 3, + 0, + 19, + 4, + 4, + 14, + 11, + 24, + 24, + 19, + 20, + 4, + 6, + 13, + 2, + 20, + 6, + 17, + 10, + 7, + 18, + 37, + 18, + 31, + 33, + 0, + 11, + 6, + 26, + 12, + 12, + 3, + 1, + 23, + 10, + 29, + 2, + 18, + 27 + ], + "weighted_loads": [ + 4.731910267844796, + 0.6237778961658478, + 0.9531762413680553, + 0.7149066366255283, + 1.2245975291589275, + 1.282401941716671, + 1.645594585686922, + 3.1098108552396297, + 0.0512051060795784, + 1.1744657254312187, + 0.1696622110903263, + 0.23912199976621196, + 2.1310378313064575, + 0.6372231747955084, + 0.959590969607234, + 0.5545609034597874, + 1.1132298670709133, + 0.6761639397591352, + 1.9000988230109215, + 0.6278293654322624, + 0.8898036107420921, + 2.0058250464498997, + 1.2613987047225237, + 0.19764544069766998, + 1.5371656529605389, + 0.08417025191010907, + 0.0, + 1.3680399861186743, + 0.10893830098211765, + 0.19341963157057762, + 0.6497881598770618, + 0.31157163716852665, + 0.8058197107166052, + 1.9438222721219063, + 2.06802230887115, + 1.771754652261734, + 0.3611232526600361, + 0.4442031644284725, + 1.0652834977954626, + 0.09474487975239754, + 0.6413445379585028, + 0.1957527045160532, + 0.8844338413327932, + 0.39401187747716904, + 0.2864118963479996, + 1.3632401674985886, + 4.022711839526892, + 1.2827670238912106, + 2.2639409452676773, + 2.817342732101679, + 0.0, + 1.0736798699945211, + 0.34048918448388577, + 1.8604580461978912, + 2.011079290881753, + 0.6411752738058567, + 0.11683686822652817, + 0.02585066668689251, + 1.538409873843193, + 0.31774601340293884, + 1.8778366167098284, + 0.12217137217521667, + 1.0904045961797237, + 1.2670372426509857 + ], + "unique_experts": 62, + "load_cv": 0.703662717279297, + "normalized_load_entropy": 0.940830026036923, + "max_load_share": 0.057971014492753624 + } + }, + "s0_x": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "528e9ea8e8c0e4377f29b634ee7dfe1569859378997991e550b508256ece99cd", + "route_weight_sha256": "c267bb8ddb6e99bbd85dedf22d68369ee05294cdacf01e437eb71d5b5f6662d1", + "loads": [ + 41, + 9, + 20, + 1, + 12, + 12, + 20, + 18, + 6, + 9, + 3, + 7, + 9, + 2, + 10, + 13, + 14, + 15, + 11, + 11, + 12, + 18, + 6, + 4, + 39, + 1, + 0, + 16, + 3, + 1, + 12, + 9, + 24, + 22, + 12, + 20, + 4, + 3, + 12, + 1, + 12, + 6, + 2, + 7, + 7, + 15, + 17, + 18, + 22, + 24, + 3, + 4, + 1, + 23, + 6, + 7, + 3, + 1, + 17, + 8, + 20, + 1, + 13, + 21 + ], + "weighted_loads": [ + 2.855106920003891, + 0.5812391005456448, + 0.9718931131064892, + 0.050652164965867996, + 1.2940376922488213, + 0.9327615648508072, + 1.8155572470277548, + 1.5689554773271084, + 0.15973549522459507, + 0.7558838110417128, + 0.08332188613712788, + 0.20206685923039913, + 2.0328078120946884, + 0.09686625003814697, + 0.3669307827949524, + 0.549579257145524, + 0.9383477885276079, + 0.7451345920562744, + 1.8967925757169724, + 0.6492264866828918, + 0.816377580165863, + 1.7881613560020924, + 0.33645258843898773, + 0.13256938569247723, + 1.484475526958704, + 0.034995611757040024, + 0.0, + 1.3144491706043482, + 0.08425329253077507, + 0.023130344226956367, + 0.539871096611023, + 0.24364188499748707, + 0.7967097535729408, + 1.8931609652936459, + 1.1471172217279673, + 1.805311907082796, + 0.35013774409890175, + 0.08546946570277214, + 1.0525836534798145, + 0.047264017164707184, + 0.354863278567791, + 0.19306223839521408, + 0.06431789696216583, + 0.29453833401203156, + 0.29072073474526405, + 1.1594011057168245, + 1.542173370718956, + 1.2471638359129429, + 1.2676549684256315, + 2.3739718049764633, + 0.0916812289506197, + 0.25471072643995285, + 0.078879714012146, + 1.2463099546730518, + 0.7368882931768894, + 0.3721721787005663, + 0.11296764016151428, + 0.026123065501451492, + 1.169319361448288, + 0.24553163163363934, + 1.3759593330323696, + 0.06391696631908417, + 0.6403293907642365, + 0.8689651675522327 + ], + "unique_experts": 63, + "load_cv": 0.767230066739203, + "normalized_load_entropy": 0.9292001557344507, + "max_load_share": 0.05694444444444444 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "9117eac08dfaca5dbc9a337fa4e2b45aa1a2fffb0787336fe7b1dd6087f226e0", + "route_weight_sha256": "e8e59b2c1fc70c73ada5a49c7b6cde6ce0463af224bb238badf9a2a40037a229", + "loads": [ + 50, + 9, + 20, + 12, + 15, + 16, + 20, + 28, + 6, + 14, + 5, + 8, + 10, + 6, + 16, + 13, + 14, + 15, + 11, + 11, + 13, + 21, + 11, + 5, + 39, + 2, + 1, + 23, + 3, + 5, + 14, + 9, + 24, + 22, + 21, + 20, + 5, + 3, + 12, + 1, + 12, + 6, + 12, + 7, + 7, + 15, + 31, + 18, + 28, + 35, + 3, + 4, + 1, + 23, + 10, + 9, + 3, + 1, + 17, + 8, + 26, + 1, + 17, + 23 + ], + "weighted_loads": [ + 4.2230994794517756, + 0.5812391005456448, + 0.9718931131064892, + 0.7743280231952667, + 1.3537475286284462, + 1.1299013495445251, + 1.8155572470277548, + 2.8446358293294907, + 0.15973549522459507, + 1.0319601076189429, + 0.15593020804226398, + 0.20294568518875167, + 2.0332852955907583, + 0.4876042455434799, + 0.7057199254631996, + 0.549579257145524, + 0.9383477885276079, + 0.7451345920562744, + 1.8967925757169724, + 0.6492264866828918, + 0.8433051481842995, + 2.0979268439114094, + 0.661595806479454, + 0.1598625984042883, + 1.484475526958704, + 0.03552560863317922, + 0.04225320741534233, + 1.5859185997396708, + 0.08425329253077507, + 0.24218209646642208, + 0.645064253360033, + 0.24364188499748707, + 0.7967097535729408, + 1.8931609652936459, + 2.2455326970666647, + 1.805311907082796, + 0.398285087198019, + 0.08546946570277214, + 1.0525836534798145, + 0.047264017164707184, + 0.354863278567791, + 0.19306223839521408, + 0.6895361877977848, + 0.29453833401203156, + 0.29072073474526405, + 1.1594011057168245, + 3.6069987136870623, + 1.2471638359129429, + 1.870374297723174, + 3.051307789981365, + 0.0916812289506197, + 0.25471072643995285, + 0.078879714012146, + 1.2463099546730518, + 1.875587608665228, + 0.46243628300726414, + 0.11296764016151428, + 0.026123065501451492, + 1.169319361448288, + 0.24553163163363934, + 1.8290462642908096, + 0.06391696631908417, + 1.081413172185421, + 0.9427895285189152 + ], + "unique_experts": 64, + "load_cv": 0.7266949926662702, + "normalized_load_entropy": 0.9381229715144432, + "max_load_share": 0.05747126436781609 + } + }, + "s1_x": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "77667b725ff7f6f2d3b0ddc4b86fc015de4d26125e1641cc2b167ed465dca514", + "route_weight_sha256": "c16ea49dbe6e495443eb53bf727484cfe1ca122197b5ee961bed887305ce10bf", + "loads": [ + 41, + 9, + 20, + 1, + 11, + 12, + 19, + 22, + 3, + 8, + 3, + 7, + 9, + 3, + 9, + 11, + 13, + 12, + 10, + 11, + 12, + 16, + 6, + 6, + 38, + 1, + 0, + 16, + 4, + 1, + 11, + 10, + 25, + 22, + 12, + 19, + 4, + 2, + 13, + 1, + 14, + 6, + 1, + 8, + 7, + 15, + 19, + 18, + 21, + 23, + 5, + 5, + 5, + 19, + 8, + 5, + 3, + 1, + 17, + 11, + 18, + 1, + 15, + 22 + ], + "weighted_loads": [ + 2.768812745809555, + 0.5575404949486256, + 0.9550581928342581, + 0.05844934284687042, + 1.1552823930978775, + 0.9699713885784149, + 1.6396694779396057, + 1.707932099699974, + 0.07950804382562637, + 0.7276055291295052, + 0.08289984613656998, + 0.2056321930140257, + 2.0347056426107883, + 0.13402300514280796, + 0.3624894358217716, + 0.4833297673612833, + 0.9026431944221258, + 0.6531884912401438, + 1.7975281365215778, + 0.6261020377278328, + 0.8280648365616798, + 1.6058656759560108, + 0.32826143503189087, + 0.20443272590637207, + 1.456594042479992, + 0.0357387512922287, + 0.0, + 1.2795624863356352, + 0.11037950962781906, + 0.03293830156326294, + 0.5266069993376732, + 0.2826633434742689, + 0.8460952583700418, + 1.8559087589383125, + 1.1685102321207523, + 1.7455127127468586, + 0.35216551646590233, + 0.05573873594403267, + 1.075443735346198, + 0.0477009043097496, + 0.41744414530694485, + 0.19406060688197613, + 0.03249785676598549, + 0.3111657239496708, + 0.28723182156682014, + 1.1411032602190971, + 1.6671109981834888, + 1.254841085523367, + 1.2622563857585192, + 2.3648597206920385, + 0.15574422851204872, + 0.2906825616955757, + 0.21052991226315498, + 1.0730437822639942, + 0.8324212208390236, + 0.2978702411055565, + 0.1137188971042633, + 0.02576839178800583, + 1.0987895876169205, + 0.33558468893170357, + 1.2562866676598787, + 0.07119113206863403, + 0.6711530573666096, + 0.8895944394171238 + ], + "unique_experts": 63, + "load_cv": 0.7494854201795579, + "normalized_load_entropy": 0.9326582515437869, + "max_load_share": 0.05694444444444444 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "17cb9631390c90b8d14349b1f83a6bbea50d768327a80980a8cf1696d90e6120", + "route_weight_sha256": "69a27ac9df5a771a791fabca664acf9fa37d52ac6fba3cb6ca7e49ec3eaa3e28", + "loads": [ + 54, + 11, + 20, + 13, + 13, + 19, + 19, + 34, + 3, + 17, + 6, + 8, + 12, + 9, + 17, + 12, + 15, + 12, + 11, + 11, + 13, + 22, + 16, + 6, + 40, + 3, + 1, + 20, + 4, + 5, + 13, + 10, + 25, + 24, + 20, + 19, + 5, + 7, + 13, + 2, + 15, + 6, + 16, + 10, + 7, + 18, + 37, + 18, + 29, + 34, + 5, + 11, + 8, + 24, + 12, + 11, + 3, + 1, + 24, + 12, + 29, + 2, + 21, + 29 + ], + "weighted_loads": [ + 4.451959516853094, + 0.6313655339181423, + 0.9550581928342581, + 0.8634184189140797, + 1.1864650683710352, + 1.283391784876585, + 1.6396694779396057, + 3.073616001754999, + 0.07950804382562637, + 1.2084848827216774, + 0.1678644549101591, + 0.20651101897237822, + 2.1158040780574083, + 0.6302699130028486, + 0.8911343924701214, + 0.5324360933154821, + 1.1160395350307226, + 0.6531884912401438, + 1.8531317710876465, + 0.6261020377278328, + 0.8602373376488686, + 2.0263638496398926, + 1.1652554124593735, + 0.20443272590637207, + 1.5599908381700516, + 0.08405306172790006, + 0.039264384657144547, + 1.4211796093732119, + 0.11037950962781906, + 0.23779546096920967, + 0.6248829886317253, + 0.2826633434742689, + 0.8460952583700418, + 1.9285495318472385, + 2.136410880833864, + 1.7455127127468586, + 0.3917930945754051, + 0.47218886762857437, + 1.075443735346198, + 0.09792990610003471, + 0.49260359071195126, + 0.19406060688197613, + 0.7686374578624964, + 0.38482963666319847, + 0.28723182156682014, + 1.3835018165409565, + 4.101512862369418, + 1.254841085523367, + 2.158953370526433, + 2.8877897653728724, + 0.15574422851204872, + 1.070727463811636, + 0.41233839094638824, + 1.7869714014232159, + 1.9542540293186903, + 0.6210874915122986, + 0.1137188971042633, + 0.02576839178800583, + 1.5857902579009533, + 0.3660301920026541, + 1.9616386499255896, + 0.12136280536651611, + 1.1574640423059464, + 1.3380725271999836 + ], + "unique_experts": 64, + "load_cv": 0.6829882250582683, + "normalized_load_entropy": 0.946456664330047, + "max_load_share": 0.055900621118012424 + } + }, + "s0_period": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "ae59981c06066925ced8610f36df0fb9350892eb548625072c464e6ba73175cc", + "route_weight_sha256": "31745479ac108eb9c363b0bbbf13b88604fbe94cf102f1228e65c52e3f511404", + "loads": [ + 41, + 9, + 19, + 1, + 12, + 12, + 20, + 19, + 5, + 9, + 3, + 7, + 9, + 2, + 9, + 12, + 14, + 15, + 11, + 11, + 12, + 18, + 7, + 6, + 39, + 1, + 0, + 16, + 3, + 1, + 12, + 10, + 24, + 22, + 12, + 20, + 4, + 3, + 12, + 1, + 12, + 6, + 2, + 8, + 7, + 15, + 17, + 18, + 21, + 24, + 2, + 4, + 2, + 23, + 6, + 6, + 3, + 1, + 17, + 8, + 19, + 1, + 14, + 21 + ], + "weighted_loads": [ + 2.8106828331947327, + 0.5797738842666149, + 0.9289662633091211, + 0.0521380677819252, + 1.2776380777359009, + 0.9399900659918785, + 1.8132321685552597, + 1.5865084417164326, + 0.12891944497823715, + 0.7527812141925097, + 0.08405915461480618, + 0.20592095702886581, + 2.03875382989645, + 0.09583523496985435, + 0.3445582892745733, + 0.5353290606290102, + 0.939543953165412, + 0.7448655273765326, + 1.89934585057199, + 0.6466561891138554, + 0.8249721936881542, + 1.7832312285900116, + 0.38970719650387764, + 0.19262145087122917, + 1.4734160602092743, + 0.0352608896791935, + 0.0, + 1.3113629650324583, + 0.08322971127927303, + 0.0235128253698349, + 0.5422479137778282, + 0.2681202869862318, + 0.8040334060788155, + 1.8831938803195953, + 1.1524993889033794, + 1.8184558656066656, + 0.3478135019540787, + 0.08427774533629417, + 1.0569769591093063, + 0.04746346175670624, + 0.3586826305836439, + 0.19429096579551697, + 0.06375402957201004, + 0.33489931002259254, + 0.2890346944332123, + 1.1579392738640308, + 1.5436005517840385, + 1.2501794882118702, + 1.224480526521802, + 2.3704637084156275, + 0.06028011627495289, + 0.25711704045534134, + 0.10772543214261532, + 1.2467713467776775, + 0.7284420803189278, + 0.33559899404644966, + 0.11340408772230148, + 0.025821037590503693, + 1.1537671368569136, + 0.24461226724088192, + 1.3140813373029232, + 0.06590340286493301, + 0.6646626591682434, + 0.8776012193411589 + ], + "unique_experts": 63, + "load_cv": 0.7623874132625974, + "normalized_load_entropy": 0.9302090401148154, + "max_load_share": 0.05694444444444444 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "5a2b5606bccc128d14a83af60e947c52ab06f0efdec90bee624b0c1226de6efa", + "route_weight_sha256": "bce5fc6278d06522b9e9e8fe30765b9215c293566b4976baa894ca8c4091f4ad", + "loads": [ + 50, + 10, + 19, + 12, + 15, + 16, + 20, + 29, + 5, + 15, + 5, + 8, + 10, + 6, + 15, + 12, + 14, + 15, + 11, + 11, + 13, + 21, + 13, + 7, + 39, + 2, + 0, + 22, + 3, + 5, + 14, + 10, + 24, + 22, + 20, + 20, + 4, + 3, + 12, + 1, + 12, + 6, + 12, + 8, + 7, + 16, + 31, + 18, + 27, + 34, + 2, + 4, + 2, + 23, + 10, + 8, + 3, + 1, + 18, + 8, + 25, + 1, + 18, + 23 + ], + "weighted_loads": [ + 4.103313691914082, + 0.727898370474577, + 0.9289662633091211, + 0.7121158428490162, + 1.3457924599060789, + 1.1382505409419537, + 1.8132321685552597, + 2.9212754033505917, + 0.12891944497823715, + 1.1857914889696985, + 0.15666747651994228, + 0.20679978298721835, + 2.03923131339252, + 0.4848583973944187, + 0.8081491980701685, + 0.5353290606290102, + 0.939543953165412, + 0.7448655273765326, + 1.89934585057199, + 0.6466561891138554, + 0.8518997617065907, + 2.0904211029410362, + 0.7705344781279564, + 0.21991466358304024, + 1.4734160602092743, + 0.03579088655533269, + 0.0, + 1.535394286736846, + 0.08322971127927303, + 0.23441231995821, + 0.648560494184494, + 0.2681202869862318, + 0.8040334060788155, + 1.8831938803195953, + 2.1494300216436386, + 1.8184558656066656, + 0.3478135019540787, + 0.08427774533629417, + 1.0569769591093063, + 0.04746346175670624, + 0.3586826305836439, + 0.19429096579551697, + 0.6920970343053341, + 0.33489931002259254, + 0.2890346944332123, + 1.2080059088766575, + 3.5805265195667744, + 1.2501794882118702, + 1.816254721954465, + 2.984539145603776, + 0.06028011627495289, + 0.25711704045534134, + 0.10772543214261532, + 1.2467713467776775, + 1.863451961427927, + 0.42387425154447556, + 0.11340408772230148, + 0.025821037590503693, + 1.1935316156595945, + 0.24461226724088192, + 1.7210049256682396, + 0.06590340286493301, + 1.1289751529693604, + 0.9515544343739748 + ], + "unique_experts": 63, + "load_cv": 0.7217914912199114, + "normalized_load_entropy": 0.9380637941355041, + "max_load_share": 0.05747126436781609 + } + }, + "s1_period": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "96931057030cd54445948fd87ab97beb0d2e3825ecab9572e099ac477310a23f", + "route_weight_sha256": "d5bb8a6b057e0ad1a817260970947bb084244de93f41009408650a89cbc6088d", + "loads": [ + 41, + 9, + 20, + 1, + 11, + 12, + 19, + 22, + 3, + 8, + 3, + 8, + 9, + 3, + 9, + 11, + 13, + 13, + 11, + 11, + 12, + 18, + 5, + 6, + 37, + 1, + 0, + 16, + 4, + 1, + 11, + 11, + 24, + 22, + 12, + 18, + 4, + 2, + 13, + 1, + 14, + 6, + 1, + 8, + 7, + 15, + 18, + 18, + 21, + 23, + 5, + 5, + 5, + 19, + 8, + 5, + 3, + 1, + 17, + 9, + 19, + 1, + 15, + 22 + ], + "weighted_loads": [ + 2.7600915618240833, + 0.5558300465345383, + 0.949227649718523, + 0.05863337218761444, + 1.1417452841997147, + 0.9673996977508068, + 1.645440150052309, + 1.6956724654883146, + 0.0791479405015707, + 0.7276413589715958, + 0.08305666595697403, + 0.23518115654587746, + 2.041905140504241, + 0.13067063875496387, + 0.3624115511775017, + 0.4858742840588093, + 0.8925689440220594, + 0.6818417310714722, + 1.8261088989675045, + 0.6316247321665287, + 0.8370823003351688, + 1.700060024857521, + 0.2679642103612423, + 0.20277891494333744, + 1.4251812752336264, + 0.03610125184059143, + 0.0, + 1.2825149446725845, + 0.11040329746901989, + 0.03217431157827377, + 0.5295316968113184, + 0.3099783807992935, + 0.8299733623862267, + 1.848384078592062, + 1.1754500027745962, + 1.7157242596149445, + 0.3446904197335243, + 0.05590159632265568, + 1.0771248508244753, + 0.047147080302238464, + 0.4189951941370964, + 0.19471843726933002, + 0.031581711024045944, + 0.3124603182077408, + 0.28501182049512863, + 1.1438758671283722, + 1.6140242740511894, + 1.2556434869766235, + 1.2518320940434933, + 2.3615876492112875, + 0.15443174168467522, + 0.28951202519237995, + 0.21175789088010788, + 1.074544394388795, + 0.8250544983893633, + 0.2926828656345606, + 0.11449131742119789, + 0.025649355724453926, + 1.0895421504974365, + 0.28431870602071285, + 1.298351138830185, + 0.07172789424657822, + 0.6724762227386236, + 0.8880773950368166 + ], + "unique_experts": 63, + "load_cv": 0.74436152108641, + "normalized_load_entropy": 0.933038584911847, + "max_load_share": 0.05694444444444444 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "72fbc2c282821ed3f90f04e40113934e1266687af426f1d8820453bffac6b446", + "route_weight_sha256": "7e17f9d6e6c5af7976d593b4dabbd31056d77c897dbcf38d5c906707eca5397f", + "loads": [ + 53, + 12, + 20, + 13, + 13, + 19, + 19, + 35, + 3, + 18, + 6, + 9, + 12, + 9, + 17, + 12, + 15, + 13, + 12, + 11, + 13, + 24, + 16, + 6, + 39, + 3, + 0, + 19, + 4, + 5, + 13, + 11, + 24, + 24, + 19, + 18, + 4, + 7, + 13, + 2, + 15, + 6, + 17, + 10, + 7, + 19, + 36, + 18, + 28, + 33, + 5, + 11, + 8, + 24, + 12, + 11, + 3, + 1, + 25, + 10, + 30, + 2, + 21, + 29 + ], + "weighted_loads": [ + 4.347212329506874, + 0.7381062433123589, + 0.949227649718523, + 0.7743858173489571, + 1.1796101486543193, + 1.2827462200075388, + 1.645440150052309, + 3.1483836974948645, + 0.0791479405015707, + 1.3343022970948368, + 0.16802127473056316, + 0.23605998250423, + 2.123003575950861, + 0.6219596806913614, + 0.9697512648999691, + 0.5349806100130081, + 1.1059652846306562, + 0.6818417310714722, + 1.8817125335335732, + 0.6316247321665287, + 0.8692548014223576, + 2.1155850030481815, + 1.1769449040293694, + 0.20277891494333744, + 1.528578070923686, + 0.08441556227626279, + 0.0, + 1.3786629512906075, + 0.11040329746901989, + 0.23004552349448204, + 0.6281975191086531, + 0.3099783807992935, + 0.8299733623862267, + 1.921024851500988, + 2.0518160443753004, + 1.7157242596149445, + 0.3446904197335243, + 0.4723517280071974, + 1.0771248508244753, + 0.09737608209252357, + 0.4941546395421028, + 0.19471843726933002, + 0.8603068497031927, + 0.38612423092126846, + 0.28501182049512863, + 1.4473029896616936, + 4.052860952913761, + 1.2556434869766235, + 2.103090949356556, + 2.825340012088418, + 0.15443174168467522, + 1.0695569273084402, + 0.41356636956334114, + 1.7884720135480165, + 1.9389545153826475, + 0.6143067162483931, + 0.11449131742119789, + 0.025649355724453926, + 1.625116739422083, + 0.31476420909166336, + 1.9595716409385204, + 0.1218995675444603, + 1.1675966996699572, + 1.3366686459630728 + ], + "unique_experts": 63, + "load_cv": 0.6770376277085569, + "normalized_load_entropy": 0.9461055303148409, + "max_load_share": 0.054865424430641824 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 120, + "ordered_topk_exact_tokens": 91, + "set_exact_tokens": 103, + "mean_set_jaccard": 0.9595238095238096, + "mean_token_weighted_tv": 0.008920497470535338, + "aggregate_load_tv": 0.01944444444444444 + }, + "system_bos": { + "tokens": 120, + "ordered_topk_exact_tokens": 72, + "set_exact_tokens": 88, + "mean_set_jaccard": 0.9220238095238095, + "mean_token_weighted_tv": 0.016106041544117034, + "aggregate_load_tv": 0.03472222222222223 + }, + "system_x": { + "tokens": 120, + "ordered_topk_exact_tokens": 55, + "set_exact_tokens": 78, + "mean_set_jaccard": 0.8982142857142857, + "mean_token_weighted_tv": 0.019931451650336385, + "aggregate_load_tv": 0.04305555555555554 + }, + "system_period": { + "tokens": 120, + "ordered_topk_exact_tokens": 63, + "set_exact_tokens": 84, + "mean_set_jaccard": 0.9142857142857144, + "mean_token_weighted_tv": 0.0180365322312961, + "aggregate_load_tv": 0.03333333333333333 + }, + "bos_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 70, + "set_exact_tokens": 80, + "mean_set_jaccard": 0.9029761904761905, + "mean_token_weighted_tv": 0.022159720965040226, + "aggregate_load_tv": 0.04722222222222222 + }, + "bos_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 57, + "set_exact_tokens": 72, + "mean_set_jaccard": 0.8821428571428572, + "mean_token_weighted_tv": 0.025116084166802465, + "aggregate_load_tv": 0.05138888888888889 + }, + "x_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 61, + "set_exact_tokens": 73, + "mean_set_jaccard": 0.8827380952380952, + "mean_token_weighted_tv": 0.025412059125180044, + "aggregate_load_tv": 0.05138888888888889 + }, + "x_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 59, + "set_exact_tokens": 72, + "mean_set_jaccard": 0.8821428571428572, + "mean_token_weighted_tv": 0.02639200636961808, + "aggregate_load_tv": 0.041666666666666664 + }, + "period_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 66, + "set_exact_tokens": 79, + "mean_set_jaccard": 0.8988095238095238, + "mean_token_weighted_tv": 0.023195832789254685, + "aggregate_load_tv": 0.04583333333333332 + }, + "period_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 60, + "set_exact_tokens": 72, + "mean_set_jaccard": 0.8789682539682541, + "mean_token_weighted_tv": 0.027115007614096007, + "aggregate_load_tv": 0.04444444444444445 + } + } + }, + "layer_04": { + "layer": 4, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "b5d535835ad376168d603951a89d25097ef97f0b205713221af34fbafd54bf76", + "route_weight_sha256": "364fdb9618113379d73fa838bf29774897431e98b4a11d95c3e891d1d81a9e7b", + "loads": [ + 19, + 33, + 19, + 19, + 5, + 2, + 5, + 2, + 12, + 18, + 16, + 8, + 9, + 39, + 7, + 9, + 3, + 2, + 20, + 5, + 0, + 22, + 11, + 3, + 3, + 11, + 4, + 12, + 4, + 9, + 5, + 22, + 2, + 7, + 5, + 11, + 8, + 3, + 2, + 10, + 25, + 16, + 10, + 9, + 15, + 19, + 7, + 4, + 24, + 11, + 0, + 13, + 5, + 8, + 22, + 2, + 23, + 4, + 10, + 12, + 52, + 2, + 0, + 21 + ], + "weighted_loads": [ + 0.5948474984616041, + 1.2120805475860834, + 0.8087329436093569, + 1.4218283332884312, + 0.25964265316724777, + 0.08250723592936993, + 0.24675439298152924, + 0.12345616891980171, + 0.577324204146862, + 0.9769761990755796, + 1.607380248606205, + 0.2800421006977558, + 0.40545323491096497, + 2.081604415550828, + 0.3106103725731373, + 0.283135112375021, + 0.4198652543127537, + 0.2775726094841957, + 0.8077341001480818, + 0.2706320881843567, + 0.0, + 0.7771177515387535, + 0.4957680068910122, + 0.1335948035120964, + 0.1835896521806717, + 0.4394654054194689, + 0.16786713153123856, + 0.7572445832192898, + 0.1232087928801775, + 0.595663346350193, + 0.2748544216156006, + 0.8513734303414822, + 0.049966758117079735, + 0.19772983342409134, + 0.3896147944033146, + 0.4568363018333912, + 0.25748647935688496, + 0.09165546484291553, + 0.147380743175745, + 0.39548750780522823, + 3.4203183129429817, + 1.2233309336006641, + 0.5441615972667933, + 0.24891564063727856, + 0.6501831077039242, + 1.0986883733421564, + 0.583993423730135, + 0.5649601072072983, + 1.5101707559078932, + 0.33611746318638325, + 0.0, + 0.45169105008244514, + 0.4032089039683342, + 0.3232569955289364, + 1.5433067586272955, + 0.13603109680116177, + 1.6159488018602133, + 0.1967928633093834, + 0.29932420514523983, + 0.7487113662064075, + 5.102794200181961, + 0.05280233360826969, + 0.0, + 2.0239849872887135 + ], + "unique_experts": 61, + "load_cv": 0.8655263152955754, + "normalized_load_entropy": 0.9186684445605915, + "max_load_share": 0.07222222222222222 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "a29a30c5456fa0d84da6e7ec1ab5e9b4bf4f5be90de814a34596d479ef5313c3", + "route_weight_sha256": "4c2e0ff2922b3147eac0d81e5fdfd264eb0496f7c3068da79e9d872f94ef55a7", + "loads": [ + 19, + 36, + 22, + 23, + 5, + 2, + 6, + 2, + 12, + 18, + 26, + 10, + 9, + 52, + 9, + 12, + 3, + 2, + 24, + 5, + 0, + 24, + 13, + 3, + 3, + 17, + 10, + 13, + 5, + 25, + 5, + 24, + 2, + 9, + 16, + 11, + 8, + 5, + 3, + 10, + 28, + 19, + 18, + 9, + 15, + 21, + 18, + 4, + 25, + 13, + 2, + 13, + 5, + 8, + 22, + 2, + 23, + 4, + 10, + 25, + 56, + 2, + 3, + 22 + ], + "weighted_loads": [ + 0.5948474984616041, + 1.3492665570229292, + 0.9552191309630871, + 1.692388942145044, + 0.25964265316724777, + 0.08250723592936993, + 0.30485666915774345, + 0.12345616891980171, + 0.577324204146862, + 0.9769761990755796, + 2.2673087436705828, + 0.30658108089119196, + 0.40545323491096497, + 3.0062676537781954, + 0.35704335756599903, + 0.4617164023220539, + 0.4198652543127537, + 0.2775726094841957, + 1.0224917450395878, + 0.2706320881843567, + 0.0, + 1.842398814857006, + 0.6058414429426193, + 0.1335948035120964, + 0.1835896521806717, + 0.8744148071855307, + 0.7055311128497124, + 0.7652043476700783, + 0.14851373806595802, + 1.8931635459885001, + 0.2748544216156006, + 0.8823093408718705, + 0.049966758117079735, + 0.2380133755505085, + 1.4408480503770988, + 0.4568363018333912, + 0.25748647935688496, + 0.17303336970508099, + 1.1441310979425907, + 0.39548750780522823, + 3.5607911236584187, + 1.4536441378295422, + 0.9021379761397839, + 0.24891564063727856, + 0.6501831077039242, + 1.2975424509495497, + 1.734056230634451, + 0.5649601072072983, + 1.5470150504261255, + 0.38648896291852, + 0.08656658977270126, + 0.45169105008244514, + 0.4032089039683342, + 0.3232569955289364, + 1.5433067586272955, + 0.13603109680116177, + 1.6159488018602133, + 0.1967928633093834, + 0.29932420514523983, + 1.4638352263718843, + 5.570596845034743, + 0.05280233360826969, + 0.21393197774887085, + 2.0604974813759327 + ], + "unique_experts": 63, + "load_cv": 0.8232549494846485, + "normalized_load_entropy": 0.9250340498562459, + "max_load_share": 0.06436781609195402 + } + }, + "s1_eos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "7eed15c7f3d2cf4aba4bd8331589a588cff9979613128ec2005bfff5c9694672", + "route_weight_sha256": "67e5910d9d933f5e01707224dc2a18b3742d9e81e672d09a5ec6fed5b1e83a8e", + "loads": [ + 17, + 32, + 19, + 19, + 5, + 2, + 5, + 3, + 12, + 18, + 16, + 7, + 8, + 40, + 7, + 9, + 3, + 2, + 20, + 4, + 0, + 26, + 11, + 4, + 3, + 11, + 4, + 12, + 5, + 8, + 5, + 21, + 1, + 8, + 7, + 10, + 9, + 5, + 2, + 9, + 25, + 16, + 10, + 10, + 11, + 19, + 7, + 4, + 24, + 10, + 2, + 14, + 5, + 7, + 21, + 2, + 24, + 4, + 10, + 12, + 52, + 2, + 0, + 20 + ], + "weighted_loads": [ + 0.5251895636320114, + 1.1952922083437443, + 0.8079914432018995, + 1.4384541101753712, + 0.2653878051787615, + 0.0817301981151104, + 0.24507454223930836, + 0.15650279819965363, + 0.5780511237680912, + 0.9625270403921604, + 1.599295251071453, + 0.24657403491437435, + 0.37983230501413345, + 2.0941905956715345, + 0.32057517394423485, + 0.2831718288362026, + 0.41114335134625435, + 0.28467945009469986, + 0.8178102914243937, + 0.22740333527326584, + 0.0, + 0.9029480200260878, + 0.48338125087320805, + 0.17280003800988197, + 0.18860004097223282, + 0.4399791248142719, + 0.16761675663292408, + 0.7498489916324615, + 0.15096281468868256, + 0.5387280620634556, + 0.2814495526254177, + 0.8033007606863976, + 0.021919189020991325, + 0.22828105464577675, + 0.41928120143711567, + 0.4264920949935913, + 0.29424554482102394, + 0.15537060983479023, + 0.14803286269307137, + 0.37332181818783283, + 3.3934114314615726, + 1.2094973362982273, + 0.5426643993705511, + 0.28006107173860073, + 0.5173091515898705, + 1.1342965569347143, + 0.5849097017198801, + 0.565761111676693, + 1.5110392291098833, + 0.3102154769003391, + 0.06099468097090721, + 0.48030656203627586, + 0.39923201501369476, + 0.2959445044398308, + 1.4664376117289066, + 0.13556212186813354, + 1.627404348924756, + 0.19253111630678177, + 0.2882087863981724, + 0.7621660549193621, + 5.14741787314415, + 0.05175585485994816, + 0.0, + 1.9795307293534279 + ], + "unique_experts": 62, + "load_cv": 0.8623825738636558, + "normalized_load_entropy": 0.9213030534407272, + "max_load_share": 0.07222222222222222 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "9f70b867be8eaffda05cc27c6bc7c9f218ad370122074533172d73a428be7e2e", + "route_weight_sha256": "765bf82571c1ed68f3726b89e93a0777fb4c96a012538510b7b7b57e4f2f5ff1", + "loads": [ + 17, + 34, + 23, + 28, + 5, + 2, + 8, + 3, + 12, + 26, + 25, + 9, + 9, + 54, + 10, + 13, + 5, + 4, + 27, + 6, + 1, + 29, + 16, + 5, + 3, + 21, + 13, + 13, + 6, + 28, + 5, + 23, + 1, + 10, + 22, + 10, + 10, + 9, + 5, + 12, + 28, + 22, + 19, + 10, + 13, + 22, + 17, + 8, + 24, + 13, + 5, + 14, + 9, + 11, + 27, + 2, + 29, + 6, + 10, + 26, + 59, + 4, + 4, + 22 + ], + "weighted_loads": [ + 0.5251895636320114, + 1.3113522827625275, + 1.0042016860097647, + 2.183284837024985, + 0.2653878051787615, + 0.0817301981151104, + 0.4584356863051653, + 0.15650279819965363, + 0.5780511237680912, + 2.007609184831381, + 2.1890717558562756, + 0.27297289203852415, + 0.4856988340616226, + 3.079157968983054, + 0.3954625129699707, + 0.5405933186411858, + 0.7724194265902042, + 0.3553504217416048, + 1.3718401950318366, + 0.31753384694457054, + 0.04928259924054146, + 1.999401355162263, + 0.8964177276939154, + 0.2665274403989315, + 0.18860004097223282, + 1.147435698658228, + 0.9798150304704905, + 0.7581187086179852, + 0.174996392801404, + 1.782159836962819, + 0.2814495526254177, + 0.8338825460523367, + 0.021919189020991325, + 0.2689584856852889, + 1.8258381203049794, + 0.4264920949935913, + 0.32146126963198185, + 0.3071280028671026, + 1.3361236788332462, + 0.585278095677495, + 3.553195543587208, + 1.5296585607284214, + 0.9722436424344778, + 0.28006107173860073, + 0.5869366023689508, + 1.2984661640657578, + 1.7740031015127897, + 0.9033478647470474, + 1.5110392291098833, + 0.396740447729826, + 0.19254491850733757, + 0.48030656203627586, + 0.8380507081747055, + 0.47980085015296936, + 2.016316805034876, + 0.13556212186813354, + 2.0508618894964457, + 0.26611250080168247, + 0.2882087863981724, + 1.5564687568694353, + 6.09008664637804, + 0.24802556075155735, + 0.2880217432975769, + 2.0598986595869064 + ], + "unique_experts": 64, + "load_cv": 0.7627791139294465, + "normalized_load_entropy": 0.9360820716454803, + "max_load_share": 0.061076604554865424 + } + }, + "s0_bos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "a30c1aaf8c55986335f66205db850f26907c88dfbd3b0338644b7297b5b8e06f", + "route_weight_sha256": "fd8ef9cb481087172ec83051b882b828b0557ec20963281751ae189a07ec6358", + "loads": [ + 18, + 40, + 18, + 19, + 5, + 2, + 4, + 2, + 10, + 18, + 16, + 8, + 10, + 41, + 8, + 7, + 3, + 2, + 16, + 2, + 0, + 24, + 11, + 3, + 4, + 11, + 4, + 12, + 5, + 7, + 6, + 23, + 2, + 8, + 5, + 8, + 12, + 6, + 3, + 11, + 25, + 16, + 9, + 7, + 11, + 18, + 8, + 4, + 23, + 11, + 0, + 10, + 6, + 8, + 22, + 2, + 21, + 4, + 11, + 14, + 52, + 2, + 1, + 21 + ], + "weighted_loads": [ + 0.5435185171663761, + 1.4703709967434406, + 0.7744362317025661, + 1.4009466841816902, + 0.26717203482985497, + 0.08602684363722801, + 0.2063458189368248, + 0.12158117443323135, + 0.45164929516613483, + 0.9117341227829456, + 1.5530018508434296, + 0.3003832958638668, + 0.43377319164574146, + 2.04357454739511, + 0.34370478615164757, + 0.2297682985663414, + 0.4035758264362812, + 0.2633157968521118, + 0.6303754635155201, + 0.14186635985970497, + 0.0, + 0.8138928823173046, + 0.49091254360973835, + 0.12879928573966026, + 0.2209800910204649, + 0.42982602678239346, + 0.16959374770522118, + 0.7762509472668171, + 0.14899646677076817, + 0.46343822963535786, + 0.31087008863687515, + 0.8960842005908489, + 0.050010452046990395, + 0.2239240575581789, + 0.29877424612641335, + 0.35395925119519234, + 0.3893934581428766, + 0.1837930902838707, + 0.17194479331374168, + 0.4204641245305538, + 3.5477224364876747, + 1.223383978009224, + 0.5313560515642166, + 0.19835341349244118, + 0.5135131813585758, + 1.0115710869431496, + 0.6054712533950806, + 0.5592815354466438, + 1.5199206732213497, + 0.3496409244835377, + 0.0, + 0.3565214481204748, + 0.42409433238208294, + 0.32929763197898865, + 1.488083578646183, + 0.13536708243191242, + 1.551411870867014, + 0.21916089206933975, + 0.33518560603260994, + 0.7669560723006725, + 5.085599780082703, + 0.05418878793716431, + 0.03000130131840706, + 2.0215073712170124 + ], + "unique_experts": 62, + "load_cv": 0.8872206567856502, + "normalized_load_entropy": 0.9182861382271118, + "max_load_share": 0.07222222222222222 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "8d5d6de1e378bc04266bfaeacee7423a5f19049edf0b12481ad83b20d8c87f7b", + "route_weight_sha256": "55f58e9f455c0b24f7ae7cc4716c0d377f6ea1a93f7d9e12c5a00f6a8b119853", + "loads": [ + 18, + 43, + 21, + 24, + 5, + 2, + 5, + 2, + 10, + 18, + 26, + 9, + 10, + 54, + 10, + 10, + 3, + 2, + 21, + 2, + 0, + 25, + 13, + 3, + 4, + 17, + 10, + 12, + 6, + 26, + 6, + 24, + 2, + 9, + 17, + 8, + 12, + 8, + 4, + 11, + 28, + 19, + 17, + 7, + 11, + 20, + 19, + 4, + 24, + 12, + 2, + 10, + 6, + 8, + 22, + 2, + 21, + 4, + 11, + 26, + 57, + 2, + 4, + 22 + ], + "weighted_loads": [ + 0.5435185171663761, + 1.6095970943570137, + 0.9226798806339502, + 1.7298582099901978, + 0.26717203482985497, + 0.08602684363722801, + 0.25882235914468765, + 0.12158117443323135, + 0.45164929516613483, + 0.9117341227829456, + 2.2129303459078074, + 0.31745059229433537, + 0.43377319164574146, + 2.9650542978197336, + 0.3901377711445093, + 0.40689051896333694, + 0.4035758264362812, + 0.2633157968521118, + 0.9888811459240969, + 0.14186635985970497, + 0.0, + 1.1035051457583904, + 0.6032496485859156, + 0.12879928573966026, + 0.2209800910204649, + 0.8745988141745329, + 0.723261158913374, + 0.7762509472668171, + 0.17427773959934711, + 1.9567552292719483, + 0.31087008863687515, + 0.9144811108708382, + 0.050010452046990395, + 0.24928545951843262, + 1.3784187377605122, + 0.35395925119519234, + 0.3893934581428766, + 0.2665373980998993, + 1.1686951480805874, + 0.4204641245305538, + 3.6881952472031116, + 1.4305262044072151, + 0.8893324304372072, + 0.19835341349244118, + 0.5135131813585758, + 1.290992122143507, + 1.7555340602993965, + 0.5592815354466438, + 1.556764967739582, + 0.3776405453681946, + 0.0888085700571537, + 0.3565214481204748, + 0.42409433238208294, + 0.32929763197898865, + 1.488083578646183, + 0.13536708243191242, + 1.551411870867014, + 0.21916089206933975, + 0.33518560603260994, + 1.458727540448308, + 5.750054837350035, + 0.05418878793716431, + 0.2404332496225834, + 2.0579249300062656 + ], + "unique_experts": 63, + "load_cv": 0.849539600041445, + "normalized_load_entropy": 0.9228808028350709, + "max_load_share": 0.06551724137931035 + } + }, + "s1_bos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "e685bb63f7faccf3b84a2f47208f5de31ed34b85e53231e824b13def84cbeca3", + "route_weight_sha256": "f19970ce1b2b3bc7acc98e5d9307f4095001d4a0e10579066413400a34f12765", + "loads": [ + 18, + 38, + 21, + 19, + 5, + 2, + 3, + 2, + 12, + 17, + 16, + 8, + 11, + 40, + 8, + 8, + 3, + 2, + 15, + 5, + 0, + 24, + 11, + 3, + 3, + 12, + 4, + 11, + 5, + 6, + 6, + 22, + 1, + 11, + 5, + 10, + 10, + 5, + 2, + 9, + 25, + 16, + 9, + 8, + 12, + 19, + 7, + 3, + 23, + 12, + 0, + 10, + 6, + 10, + 22, + 2, + 21, + 4, + 9, + 15, + 52, + 2, + 0, + 20 + ], + "weighted_loads": [ + 0.5407835524529219, + 1.368543529883027, + 0.8647386077791452, + 1.4133071415126324, + 0.2695129029452801, + 0.08673182129859924, + 0.15195604600012302, + 0.12367858737707138, + 0.5404754634946585, + 0.8653453383594751, + 1.5569779723882675, + 0.30047889798879623, + 0.47991594299674034, + 1.9991209991276264, + 0.34641624242067337, + 0.2600742019712925, + 0.39951182529330254, + 0.250972680747509, + 0.6025867220014334, + 0.2587142437696457, + 0.0, + 0.8136494625359774, + 0.48175649158656597, + 0.13377997279167175, + 0.1928657740354538, + 0.453553082421422, + 0.16891097649931908, + 0.7567636854946613, + 0.14563724398612976, + 0.4034723211079836, + 0.3116135150194168, + 0.8562782555818558, + 0.023954587057232857, + 0.31120670959353447, + 0.2813645005226135, + 0.4090009368956089, + 0.31720064021646976, + 0.15395832620561123, + 0.1375601403415203, + 0.38261656276881695, + 3.533011645078659, + 1.23615100979805, + 0.5256942696869373, + 0.22517071291804314, + 0.5509420242160559, + 1.047672402113676, + 0.562021417543292, + 0.5376359224319458, + 1.5218299962580204, + 0.3445918969810009, + 0.0, + 0.37927052937448025, + 0.4083237126469612, + 0.38647573813796043, + 1.4962756745517254, + 0.13394725508987904, + 1.5309225805103779, + 0.2126699946820736, + 0.28392404690384865, + 0.8034396134316921, + 5.164110034704208, + 0.05167717486619949, + 0.0, + 1.988326221704483 + ], + "unique_experts": 61, + "load_cv": 0.8796744627950883, + "normalized_load_entropy": 0.9171688562352747, + "max_load_share": 0.07222222222222222 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "219ae5cd6601058fb9e7e42decb50f1537a020ec6ec295c30e5f57cad31ee1a4", + "route_weight_sha256": "6bbac144fcf9864506374ba7d6ab298ac7d92061e62744b3c4bb0ffea27a121f", + "loads": [ + 18, + 40, + 25, + 29, + 5, + 2, + 6, + 2, + 12, + 25, + 25, + 9, + 12, + 54, + 11, + 12, + 5, + 4, + 23, + 7, + 1, + 26, + 16, + 4, + 3, + 22, + 13, + 11, + 6, + 28, + 6, + 23, + 1, + 12, + 21, + 10, + 11, + 9, + 5, + 12, + 28, + 22, + 18, + 8, + 14, + 22, + 18, + 7, + 23, + 14, + 3, + 10, + 10, + 14, + 28, + 2, + 26, + 6, + 9, + 28, + 60, + 4, + 4, + 22 + ], + "weighted_loads": [ + 0.5407835524529219, + 1.4886882398277521, + 1.0615435522049665, + 2.215618620830355, + 0.2695129029452801, + 0.08673182129859924, + 0.34742691554129124, + 0.12367858737707138, + 0.5404754634946585, + 1.9104274827986956, + 2.14675447717309, + 0.3175461944192648, + 0.5857824720442295, + 2.9773922078311443, + 0.4213035814464092, + 0.5272929556667805, + 0.7607879005372524, + 0.32164365239441395, + 1.288406026782468, + 0.3488447554409504, + 0.04928259924054146, + 1.143492056056857, + 0.8911715876311064, + 0.22750737518072128, + 0.1928657740354538, + 1.1411249805241823, + 1.010917067527771, + 0.7567636854946613, + 0.17021039314568043, + 1.7439474649727345, + 0.3116135150194168, + 0.874675165861845, + 0.023954587057232857, + 0.3365681115537882, + 1.67013688350562, + 0.4090009368956089, + 0.3444163650274277, + 0.30818271450698376, + 1.3256509564816952, + 0.5945728402584791, + 3.692795757204294, + 1.566743989562383, + 0.955273512750864, + 0.22517071291804314, + 0.6205694749951363, + 1.216950782953063, + 1.7993002738803625, + 0.8752226755023003, + 1.5218299962580204, + 0.40824464336037636, + 0.13229504972696304, + 0.37927052937448025, + 0.847142405807972, + 0.570332083851099, + 2.0461548678576946, + 0.13394725508987904, + 1.9543801210820675, + 0.2862513791769743, + 0.28392404690384865, + 1.5733584016561508, + 6.332439132034779, + 0.24794688075780869, + 0.29413288086652756, + 2.0699990876019 + ], + "unique_experts": 64, + "load_cv": 0.7765024083733214, + "normalized_load_entropy": 0.9338331853824722, + "max_load_share": 0.062111801242236024 + } + }, + "s0_x": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "7b90b196ea90ffcb1981c4c6af53dc273e00e972faadc061962a7e9cb00f4d8f", + "route_weight_sha256": "91fe3b245c9defc40b55fde4c005439b970af37dc5ed7f87e509f234ebc4610e", + "loads": [ + 18, + 39, + 19, + 19, + 5, + 2, + 4, + 2, + 10, + 18, + 16, + 8, + 11, + 41, + 8, + 7, + 3, + 2, + 17, + 3, + 0, + 23, + 11, + 3, + 3, + 13, + 4, + 11, + 4, + 7, + 5, + 23, + 1, + 7, + 5, + 9, + 9, + 4, + 2, + 10, + 25, + 16, + 9, + 7, + 12, + 19, + 8, + 3, + 25, + 11, + 0, + 11, + 6, + 9, + 22, + 2, + 21, + 4, + 14, + 14, + 52, + 2, + 1, + 21 + ], + "weighted_loads": [ + 0.5456726755946875, + 1.4235579036176205, + 0.8003389202058315, + 1.4766408577561378, + 0.26391814462840557, + 0.08637651801109314, + 0.19822147488594055, + 0.11715623363852501, + 0.4409191254526377, + 0.9141609445214272, + 1.5945607982575893, + 0.2873331606388092, + 0.46833116188645363, + 2.100943863391876, + 0.3454819284379482, + 0.2212143950164318, + 0.4011128582060337, + 0.2616063728928566, + 0.712024787440896, + 0.18018554896116257, + 0.0, + 0.7906677182763815, + 0.5024556405842304, + 0.12713168375194073, + 0.19092252850532532, + 0.47419508546590805, + 0.17396024987101555, + 0.7931480929255486, + 0.12030413746833801, + 0.3669274002313614, + 0.28251076489686966, + 0.8876315094530582, + 0.023131607100367546, + 0.20795810595154762, + 0.2893447056412697, + 0.40393567830324173, + 0.28398781456053257, + 0.11984572187066078, + 0.13204849883913994, + 0.395887752994895, + 3.5113702192902565, + 1.25000511854887, + 0.5433415323495865, + 0.19584229588508606, + 0.5583379175513983, + 1.0325669534504414, + 0.6213001478463411, + 0.5145752169191837, + 1.6256902366876602, + 0.35009455494582653, + 0.0, + 0.37355976179242134, + 0.4366771876811981, + 0.36551027186214924, + 1.484862893819809, + 0.14077556692063808, + 1.5350706279277802, + 0.22148987278342247, + 0.4257234204560518, + 0.7980953175574541, + 5.100810933858156, + 0.052123915404081345, + 0.029232719913125038, + 2.0365851167589426 + ], + "unique_experts": 62, + "load_cv": 0.895530741315995, + "normalized_load_entropy": 0.9152890381811618, + "max_load_share": 0.07222222222222222 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "451a08e2306d60d01aec5f435e7583a82566b3ad399846bf65d210aef42f7c84", + "route_weight_sha256": "1fec199b4848258c59ccefab7b88ad622307cb4aa9336908aec5111222720393", + "loads": [ + 18, + 43, + 23, + 23, + 5, + 2, + 4, + 2, + 10, + 18, + 27, + 9, + 11, + 53, + 10, + 10, + 3, + 2, + 21, + 3, + 0, + 24, + 13, + 3, + 3, + 19, + 10, + 11, + 5, + 24, + 5, + 24, + 1, + 8, + 15, + 9, + 9, + 6, + 3, + 10, + 29, + 19, + 18, + 7, + 12, + 21, + 21, + 3, + 27, + 12, + 2, + 11, + 6, + 9, + 22, + 2, + 21, + 4, + 14, + 27, + 56, + 2, + 4, + 22 + ], + "weighted_loads": [ + 0.5456726755946875, + 1.6062193401157856, + 0.9784552939236164, + 1.7559891433047596, + 0.26391814462840557, + 0.08637651801109314, + 0.19822147488594055, + 0.11715623363852501, + 0.4409191254526377, + 0.9141609445214272, + 2.4700950291007757, + 0.30440045706927776, + 0.46833116188645363, + 2.97939932346344, + 0.39191491343081, + 0.4086676277220249, + 0.4011128582060337, + 0.2616063728928566, + 0.9162986831215676, + 0.18018554896116257, + 0.0, + 1.0802799817174673, + 0.619950108230114, + 0.12713168375194073, + 0.19092252850532532, + 0.8541541025042534, + 0.7711114473640919, + 0.7931480929255486, + 0.14520223625004292, + 1.622550773434341, + 0.28251076489686966, + 0.9060284197330475, + 0.023131607100367546, + 0.23331950791180134, + 1.1415935845288914, + 0.40393567830324173, + 0.28398781456053257, + 0.2028529867529869, + 1.1287988536059856, + 0.395887752994895, + 3.7082427702844143, + 1.4667236879467964, + 0.9367896001785994, + 0.19584229588508606, + 0.5583379175513983, + 1.2826767191290855, + 2.0166598204523325, + 0.5145752169191837, + 1.705847181379795, + 0.37809417583048344, + 0.09049541503190994, + 0.37355976179242134, + 0.4366771876811981, + 0.36551027186214924, + 1.484862893819809, + 0.14077556692063808, + 1.5350706279277802, + 0.22148987278342247, + 0.4257234204560518, + 1.5720756091177464, + 5.564901684556389, + 0.052123915404081345, + 0.23086839728057384, + 2.0735630858689547 + ], + "unique_experts": 63, + "load_cv": 0.855688263647956, + "normalized_load_entropy": 0.9200893734804029, + "max_load_share": 0.06436781609195402 + } + }, + "s1_x": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "868df8b82ca389680989c88e0d2ab9c1f63cbc6fde85fb92f8e374e05add53a3", + "route_weight_sha256": "a410d08cd5c1fadd9bfc47a30baadc34177feaaa1385c41af699c7c1886717df", + "loads": [ + 18, + 37, + 20, + 19, + 5, + 2, + 3, + 2, + 12, + 17, + 16, + 8, + 10, + 41, + 7, + 6, + 3, + 2, + 16, + 5, + 0, + 24, + 11, + 3, + 3, + 12, + 4, + 11, + 6, + 3, + 6, + 21, + 1, + 8, + 5, + 10, + 11, + 2, + 2, + 12, + 25, + 16, + 9, + 9, + 15, + 19, + 9, + 3, + 24, + 13, + 0, + 10, + 5, + 9, + 22, + 2, + 21, + 4, + 10, + 16, + 52, + 2, + 0, + 21 + ], + "weighted_loads": [ + 0.5395677704364061, + 1.3386131338775158, + 0.8366766255348921, + 1.4805767312645912, + 0.2693957947194576, + 0.08723333477973938, + 0.1340077482163906, + 0.12059982493519783, + 0.5328426193445921, + 0.8805500976741314, + 1.5727487653493881, + 0.2912079617381096, + 0.45362272299826145, + 2.076804842799902, + 0.31934014335274696, + 0.19781452789902687, + 0.3885866068303585, + 0.24720213562250137, + 0.6774447523057461, + 0.26058144494891167, + 0.0, + 0.8197599686682224, + 0.4855774771422148, + 0.13152994588017464, + 0.19433395937085152, + 0.45502085983753204, + 0.17127511277794838, + 0.7817609086632729, + 0.17031168192625046, + 0.22468125820159912, + 0.3096255250275135, + 0.8245864734053612, + 0.02389407530426979, + 0.22863035276532173, + 0.26122596859931946, + 0.4173453710973263, + 0.3434318080544472, + 0.054339366033673286, + 0.13349632918834686, + 0.45351199992001057, + 3.5002922117710114, + 1.2653831727802753, + 0.5465067215263844, + 0.24833586066961288, + 0.6578380782157183, + 1.0637362785637379, + 0.6375241633504629, + 0.528916135430336, + 1.584462396800518, + 0.38544053211808205, + 0.0, + 0.3785107899457216, + 0.3902677968144417, + 0.35803219489753246, + 1.4861731361597776, + 0.13700921274721622, + 1.5239468030631542, + 0.21002816408872604, + 0.31901345029473305, + 0.8693145327270031, + 5.23457645252347, + 0.04901048541069031, + 0.0, + 2.0186503175646067 + ], + "unique_experts": 61, + "load_cv": 0.8895830622776931, + "normalized_load_entropy": 0.9143116769907513, + "max_load_share": 0.07222222222222222 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "0e96218c5cee28c5c426d64980da4500803ee72d0208450dbd3708da935235bb", + "route_weight_sha256": "103e7b7df948fbc64556eede0d9afd1a1dcdf87ee1ee2233162e9247b172205f", + "loads": [ + 18, + 40, + 25, + 28, + 5, + 2, + 5, + 2, + 12, + 25, + 26, + 9, + 11, + 54, + 10, + 10, + 5, + 4, + 23, + 7, + 1, + 26, + 16, + 4, + 3, + 22, + 13, + 11, + 6, + 22, + 6, + 22, + 1, + 9, + 20, + 10, + 13, + 6, + 6, + 15, + 29, + 22, + 19, + 9, + 17, + 22, + 21, + 7, + 24, + 15, + 3, + 10, + 9, + 13, + 28, + 2, + 26, + 6, + 10, + 30, + 60, + 4, + 4, + 23 + ], + "weighted_loads": [ + 0.5395677704364061, + 1.5039946772158146, + 1.0687058921903372, + 2.234689294564305, + 0.2693957947194576, + 0.08723333477973938, + 0.2793874032795429, + 0.12059982493519783, + 0.5328426193445921, + 1.9256322421133518, + 2.352406296879053, + 0.30827525816857815, + 0.5594892520457506, + 3.0135411471128464, + 0.3942274823784828, + 0.46792274340987206, + 0.7498626820743084, + 0.3178731072694063, + 1.209181296871975, + 0.35071195662021637, + 0.04928259924054146, + 1.1496025621891022, + 0.8957965392619371, + 0.22525734826922417, + 0.19433395937085152, + 1.089805979281664, + 1.052643034607172, + 0.7817609086632729, + 0.17031168192625046, + 1.3106309492141008, + 0.3096255250275135, + 0.8429833836853504, + 0.02389407530426979, + 0.25399175472557545, + 1.4527879726374522, + 0.4173453710973263, + 0.39619761891663074, + 0.2087175752967596, + 1.3739362359046936, + 0.6654682774096727, + 3.7137411236763, + 1.62671954286634, + 1.016318403184414, + 0.24833586066961288, + 0.7274655289947987, + 1.1895149363263045, + 2.0820034462958574, + 0.8665028885006905, + 1.584462396800518, + 0.4490932784974575, + 0.13350795209407806, + 0.3785107899457216, + 0.8290864899754524, + 0.541888540610671, + 2.036052329465747, + 0.13700921274721622, + 1.9474043436348438, + 0.28360954858362675, + 0.31901345029473305, + 1.73546976223588, + 6.227435555309057, + 0.2452801913022995, + 0.28165601566433907, + 2.0999455880373716 + ], + "unique_experts": 64, + "load_cv": 0.7796756192815824, + "normalized_load_entropy": 0.9330415615747102, + "max_load_share": 0.062111801242236024 + } + }, + "s0_period": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "7446a6d107fabbe2bc1d95e60cc92f96820b241767c8305346b7c86191a81f78", + "route_weight_sha256": "5e6a742be2599ca0e613ca7bcd96ec4dd0589fb6fe6310ed386b9fc1e7793fc2", + "loads": [ + 19, + 39, + 20, + 19, + 5, + 2, + 4, + 2, + 10, + 18, + 16, + 8, + 10, + 40, + 8, + 7, + 3, + 2, + 17, + 3, + 0, + 25, + 11, + 3, + 3, + 13, + 5, + 11, + 6, + 5, + 5, + 22, + 1, + 7, + 5, + 9, + 10, + 2, + 2, + 11, + 25, + 16, + 9, + 7, + 14, + 19, + 7, + 4, + 24, + 11, + 0, + 10, + 6, + 8, + 22, + 2, + 21, + 4, + 14, + 13, + 52, + 2, + 1, + 21 + ], + "weighted_loads": [ + 0.5803370233625174, + 1.4274602066725492, + 0.8365461193025112, + 1.4815132766962051, + 0.26266295835375786, + 0.08485572040081024, + 0.2000749073922634, + 0.11947935819625854, + 0.4425890017300844, + 0.9175791181623936, + 1.5818109884858131, + 0.29071614518761635, + 0.4400522857904434, + 2.057838486507535, + 0.34713305346667767, + 0.222990483045578, + 0.3995303809642792, + 0.26350655406713486, + 0.720872787758708, + 0.17976457625627518, + 0.0, + 0.850284319370985, + 0.5037262607365847, + 0.12741155549883842, + 0.19246888160705566, + 0.46831561625003815, + 0.19742021523416042, + 0.7871130704879761, + 0.17334256321191788, + 0.30633383989334106, + 0.28331029042601585, + 0.8603329788893461, + 0.02301575057208538, + 0.20915332064032555, + 0.2974950671195984, + 0.4005311578512192, + 0.3129497151821852, + 0.05655648000538349, + 0.1261121965944767, + 0.4246265646070242, + 3.4865626469254494, + 1.2395011074841022, + 0.5392493531107903, + 0.19628014788031578, + 0.6247018463909626, + 1.0343033000826836, + 0.5764137040823698, + 0.5596536435186863, + 1.5954464934766293, + 0.34899329394102097, + 0.0, + 0.3510715067386627, + 0.44078770838677883, + 0.32480537332594395, + 1.4833736810833216, + 0.13716137036681175, + 1.5408869255334139, + 0.22397232055664062, + 0.4264758825302124, + 0.7754840105772018, + 5.0683240480721, + 0.051975300535559654, + 0.02931743860244751, + 2.0221460964530706 + ], + "unique_experts": 62, + "load_cv": 0.8947032061865509, + "normalized_load_entropy": 0.9150467585580976, + "max_load_share": 0.07222222222222222 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "a274857758f8a7efec155a2d4499a4a6448c2ea606ded404e329aaa84c5dcdcd", + "route_weight_sha256": "fc97c1527d5136e689a66466eaacb25aeb2dec61f4aa13213fc23cd0691b9ba2", + "loads": [ + 19, + 43, + 23, + 23, + 5, + 2, + 4, + 2, + 10, + 18, + 26, + 9, + 10, + 52, + 10, + 10, + 3, + 2, + 21, + 3, + 0, + 26, + 14, + 3, + 3, + 19, + 12, + 11, + 6, + 23, + 5, + 23, + 1, + 8, + 15, + 9, + 11, + 4, + 3, + 11, + 28, + 19, + 17, + 7, + 14, + 21, + 19, + 4, + 26, + 12, + 2, + 11, + 7, + 8, + 22, + 2, + 21, + 4, + 14, + 26, + 56, + 2, + 4, + 22 + ], + "weighted_loads": [ + 0.5803370233625174, + 1.6185319554060698, + 0.9840870946645737, + 1.7626937568711583, + 0.26266295835375786, + 0.08485572040081024, + 0.2000749073922634, + 0.11947935819625854, + 0.4425890017300844, + 0.9175791181623936, + 2.241739483550191, + 0.3077834416180849, + 0.4400522857904434, + 2.9151206631213427, + 0.3935660384595394, + 0.39343398809432983, + 0.3995303809642792, + 0.26350655406713486, + 0.9255501249281224, + 0.17976457625627518, + 0.0, + 1.1398965828120708, + 0.6553888227790594, + 0.12741155549883842, + 0.19246888160705566, + 0.8307604566216469, + 1.0660717654973269, + 0.7871130704879761, + 0.17334256321191788, + 1.5859048729762435, + 0.28331029042601585, + 0.8787298891693354, + 0.02301575057208538, + 0.23451472260057926, + 1.1373077088210266, + 0.4005311578512192, + 0.33886877447366714, + 0.13981215842068195, + 1.1228625513613224, + 0.4246265646070242, + 3.6270354576408863, + 1.4471644014120102, + 0.8972257319837809, + 0.19628014788031578, + 0.6247018463909626, + 1.3073098324239254, + 1.886750852689147, + 0.5596536435186863, + 1.6869309023022652, + 0.37699291482567787, + 0.08952909708023071, + 0.476139634847641, + 0.505585765466094, + 0.32480537332594395, + 1.4833736810833216, + 0.13716137036681175, + 1.5408869255334139, + 0.22397232055664062, + 0.4264758825302124, + 1.553919667378068, + 5.52573484662571, + 0.051975300535559654, + 0.23001781851053238, + 2.0585697684437037 + ], + "unique_experts": 63, + "load_cv": 0.8439474655531322, + "normalized_load_entropy": 0.9218442909486408, + "max_load_share": 0.06436781609195402 + } + }, + "s1_period": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "8651c4e748e04d3f74f1165d42c711c6f8bd1349ff32b2c0812b1c38a3a76964", + "route_weight_sha256": "4d3d712c488dee50a28fb8d46b643fb0abd909ee2b3807658818e34b3b88b3f0", + "loads": [ + 18, + 37, + 20, + 19, + 5, + 2, + 3, + 2, + 13, + 17, + 16, + 8, + 11, + 41, + 7, + 6, + 3, + 2, + 17, + 5, + 0, + 22, + 11, + 3, + 3, + 12, + 4, + 11, + 6, + 4, + 6, + 21, + 1, + 7, + 5, + 11, + 11, + 2, + 2, + 12, + 25, + 16, + 9, + 9, + 15, + 19, + 9, + 3, + 24, + 10, + 0, + 9, + 5, + 10, + 22, + 2, + 22, + 4, + 11, + 15, + 52, + 2, + 0, + 21 + ], + "weighted_loads": [ + 0.5443859919905663, + 1.3405264895409346, + 0.8428569678217173, + 1.458411742001772, + 0.2674986757338047, + 0.0866457000374794, + 0.13280978240072727, + 0.12206156551837921, + 0.5706176683306694, + 0.88471470028162, + 1.569978304207325, + 0.29046815261244774, + 0.48205326683819294, + 2.0494433771818876, + 0.3203117251396179, + 0.19805744290351868, + 0.3905485011637211, + 0.24938064813613892, + 0.6935624349862337, + 0.2597472071647644, + 0.0, + 0.7492850515991449, + 0.48183547519147396, + 0.12943016178905964, + 0.1951378770172596, + 0.44621957652270794, + 0.17112579569220543, + 0.7883177176117897, + 0.1713197212666273, + 0.24863086454570293, + 0.31031204015016556, + 0.8333758357912302, + 0.02385145053267479, + 0.20741805247962475, + 0.2509947158396244, + 0.45123264752328396, + 0.34890837222337723, + 0.054353976622223854, + 0.12911343201994896, + 0.45520935766398907, + 3.4914200082421303, + 1.2550018802285194, + 0.5419218428432941, + 0.24974998645484447, + 0.6589989773929119, + 1.0636141076683998, + 0.6262423936277628, + 0.5307174436748028, + 1.5797588862478733, + 0.30153040401637554, + 0.0, + 0.3443421870470047, + 0.3854838125407696, + 0.38647864758968353, + 1.4847511891275644, + 0.13710592687129974, + 1.5429288260638714, + 0.21281953528523445, + 0.3459877874702215, + 0.8534811232239008, + 5.191874608397484, + 0.04831536486744881, + 0.0, + 2.002267984673381 + ], + "unique_experts": 61, + "load_cv": 0.8870814958316477, + "normalized_load_entropy": 0.9148609406433826, + "max_load_share": 0.07222222222222222 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "71f3ddb8d7348a721f89d30a94501c72204559693eb9c63a8eb82777b9d5c9e9", + "route_weight_sha256": "ce2ddf934e6551290775202e309099c23e4ce69f72469947a40e0860cecf9689", + "loads": [ + 18, + 40, + 23, + 28, + 5, + 2, + 5, + 2, + 13, + 25, + 25, + 9, + 12, + 54, + 10, + 10, + 5, + 4, + 24, + 7, + 1, + 24, + 17, + 4, + 3, + 22, + 14, + 11, + 6, + 23, + 6, + 22, + 1, + 8, + 19, + 11, + 14, + 7, + 6, + 15, + 28, + 22, + 18, + 9, + 17, + 22, + 20, + 7, + 24, + 12, + 3, + 10, + 10, + 14, + 28, + 2, + 27, + 6, + 11, + 29, + 60, + 4, + 4, + 24 + ], + "weighted_loads": [ + 0.5443859919905663, + 1.4943082127720118, + 1.0137400720268488, + 2.2133910387929063, + 0.2674986757338047, + 0.0866457000374794, + 0.2781894374638796, + 0.12206156551837921, + 0.5706176683306694, + 1.9297968447208405, + 2.1597548089921474, + 0.3075354490429163, + 0.5879197958856821, + 2.961148427799344, + 0.3951990641653538, + 0.47547831013798714, + 0.751824576407671, + 0.32005161978304386, + 1.2244287666399032, + 0.3498777188360691, + 0.04928259924054146, + 1.0791276451200247, + 0.9238789062947035, + 0.22315756417810917, + 0.1951378770172596, + 1.0521930176764727, + 1.3526185117661953, + 0.7883177176117897, + 0.1713197212666273, + 1.3222727999091148, + 0.31031204015016556, + 0.8517727460712194, + 0.02385145053267479, + 0.23277945443987846, + 1.3845185484969988, + 0.45123264752328396, + 0.42996908351778984, + 0.2507535759359598, + 1.3742941804230213, + 0.6671656351536512, + 3.6512041203677654, + 1.6288847970718052, + 0.9715010859072208, + 0.24974998645484447, + 0.7286264281719923, + 1.1915716877265368, + 1.9220986422151327, + 0.8683041967451572, + 1.5797588862478733, + 0.365183150395751, + 0.1325853355228901, + 0.44017499685287476, + 0.8769418373703957, + 0.5703349933028221, + 2.0346303824335337, + 0.13710592687129974, + 1.966386366635561, + 0.28640091978013515, + 0.3459877874702215, + 1.7759622801095247, + 6.183490257710218, + 0.244585070759058, + 0.29540183395147324, + 2.1138839591294527 + ], + "unique_experts": 64, + "load_cv": 0.773050064587867, + "normalized_load_entropy": 0.9341639334185575, + "max_load_share": 0.062111801242236024 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 120, + "ordered_topk_exact_tokens": 81, + "set_exact_tokens": 93, + "mean_set_jaccard": 0.9357142857142857, + "mean_token_weighted_tv": 0.010587781434878707, + "aggregate_load_tv": 0.026388888888888882 + }, + "system_bos": { + "tokens": 120, + "ordered_topk_exact_tokens": 73, + "set_exact_tokens": 87, + "mean_set_jaccard": 0.9178571428571429, + "mean_token_weighted_tv": 0.014256054729533693, + "aggregate_load_tv": 0.03194444444444444 + }, + "system_x": { + "tokens": 120, + "ordered_topk_exact_tokens": 58, + "set_exact_tokens": 80, + "mean_set_jaccard": 0.8994047619047618, + "mean_token_weighted_tv": 0.01758272882240514, + "aggregate_load_tv": 0.034722222222222224 + }, + "system_period": { + "tokens": 120, + "ordered_topk_exact_tokens": 62, + "set_exact_tokens": 81, + "mean_set_jaccard": 0.9017857142857143, + "mean_token_weighted_tv": 0.01770694488659501, + "aggregate_load_tv": 0.030555555555555555 + }, + "bos_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 48, + "set_exact_tokens": 75, + "mean_set_jaccard": 0.8910714285714286, + "mean_token_weighted_tv": 0.02050752176437527, + "aggregate_load_tv": 0.04583333333333332 + }, + "bos_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 47, + "set_exact_tokens": 71, + "mean_set_jaccard": 0.874404761904762, + "mean_token_weighted_tv": 0.022909036821996173, + "aggregate_load_tv": 0.04583333333333333 + }, + "x_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 53, + "set_exact_tokens": 80, + "mean_set_jaccard": 0.9011904761904762, + "mean_token_weighted_tv": 0.020835859553577998, + "aggregate_load_tv": 0.03888888888888888 + }, + "x_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 47, + "set_exact_tokens": 64, + "mean_set_jaccard": 0.8595238095238096, + "mean_token_weighted_tv": 0.02597381394201269, + "aggregate_load_tv": 0.05138888888888889 + }, + "period_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 50, + "set_exact_tokens": 77, + "mean_set_jaccard": 0.8958333333333334, + "mean_token_weighted_tv": 0.020808499112414818, + "aggregate_load_tv": 0.03888888888888888 + }, + "period_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 49, + "set_exact_tokens": 65, + "mean_set_jaccard": 0.8619047619047621, + "mean_token_weighted_tv": 0.02576748242136091, + "aggregate_load_tv": 0.05277777777777777 + } + } + }, + "layer_05": { + "layer": 5, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "e37694f70bfc2ccf1a747bc761026d357a30d2639763be4491d5d2a25dd3057a", + "route_weight_sha256": "ff99bd2b8602334ba140a05ceed345d06ee1ee0642764d2099c6d096b48297a7", + "loads": [ + 8, + 21, + 12, + 3, + 1, + 17, + 14, + 6, + 8, + 9, + 10, + 22, + 12, + 11, + 11, + 11, + 0, + 12, + 27, + 3, + 4, + 13, + 10, + 2, + 3, + 22, + 11, + 5, + 11, + 4, + 1, + 14, + 17, + 2, + 12, + 13, + 9, + 18, + 17, + 8, + 16, + 11, + 6, + 11, + 6, + 18, + 0, + 14, + 10, + 15, + 11, + 4, + 9, + 24, + 14, + 13, + 17, + 16, + 26, + 14, + 11, + 6, + 22, + 12 + ], + "weighted_loads": [ + 0.33145671896636486, + 1.9300042483955622, + 0.5273568406701088, + 0.18319487944245338, + 0.040905024856328964, + 0.7869300339370966, + 0.619601234793663, + 0.2660796046257019, + 0.36240994557738304, + 0.33525367081165314, + 0.5829746946692467, + 0.8907731305807829, + 0.7007823176681995, + 0.4548991434276104, + 0.5903252549469471, + 1.154179386794567, + 0.0, + 0.9173148758709431, + 1.3816826101392508, + 0.13270053640007973, + 0.13065281324088573, + 0.9222920797765255, + 0.36017660051584244, + 0.18674876168370247, + 0.304855614900589, + 1.7946840412914753, + 0.3784082382917404, + 0.3521083742380142, + 0.40055021084845066, + 0.3404914103448391, + 0.07142407447099686, + 0.4817032925784588, + 0.6078079808503389, + 0.08566275611519814, + 0.8556778728961945, + 0.9389603193849325, + 0.44564011320471764, + 1.9093955010175705, + 1.477932509034872, + 0.47108311392366886, + 2.0805729180574417, + 0.6134090572595596, + 0.2787764295935631, + 0.5625460930168629, + 0.3872599322348833, + 1.1517230048775673, + 0.0, + 0.5480634458363056, + 0.6194320283830166, + 0.5726357661187649, + 1.3376168124377728, + 0.15969195030629635, + 0.25667842850089073, + 1.372412672266364, + 0.4967724736779928, + 0.5662582777440548, + 0.9298074562102556, + 0.7859148476272821, + 1.0514930747449398, + 0.7861759103834629, + 1.2756524682044983, + 0.22880252823233604, + 0.9866696689277887, + 1.2358571626245975 + ], + "unique_experts": 62, + "load_cv": 0.5665577237325317, + "normalized_load_entropy": 0.9561804987237943, + "max_load_share": 0.0375 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "048934d0e3e7c2acc5fd215480841ede03982b206284add96b226373c3a720b0", + "route_weight_sha256": "6570a00cc30d1ca87e6c0d5817e664be28e1338b08ee3872ca3fd9c80c37c960", + "loads": [ + 8, + 22, + 12, + 3, + 2, + 19, + 16, + 8, + 9, + 10, + 21, + 22, + 15, + 11, + 11, + 24, + 2, + 18, + 36, + 4, + 6, + 14, + 10, + 2, + 3, + 30, + 11, + 5, + 11, + 4, + 1, + 14, + 17, + 2, + 12, + 17, + 9, + 18, + 28, + 16, + 21, + 19, + 13, + 12, + 7, + 18, + 0, + 16, + 10, + 18, + 19, + 4, + 11, + 33, + 17, + 22, + 17, + 16, + 26, + 15, + 11, + 6, + 22, + 14 + ], + "weighted_loads": [ + 0.33145671896636486, + 1.9335080492310226, + 0.5273568406701088, + 0.18319487944245338, + 0.042664221255108714, + 0.8551640938967466, + 0.6844742111861706, + 0.3081406482961029, + 0.36576366308145225, + 0.3397761592641473, + 1.242014404386282, + 0.8907731305807829, + 0.8830328062176704, + 0.4548991434276104, + 0.5903252549469471, + 3.330058973748237, + 0.1551738753914833, + 1.2145841009914875, + 2.136735050007701, + 0.14576051104813814, + 0.14611137541942298, + 0.9621457457542419, + 0.36017660051584244, + 0.18674876168370247, + 0.304855614900589, + 2.6985243186354637, + 0.3784082382917404, + 0.3521083742380142, + 0.40055021084845066, + 0.3404914103448391, + 0.07142407447099686, + 0.4817032925784588, + 0.6078079808503389, + 0.08566275611519814, + 0.8556778728961945, + 1.251700596883893, + 0.44564011320471764, + 1.9093955010175705, + 2.5803872980177402, + 1.137598155066371, + 2.287684343755245, + 1.439839668571949, + 0.7096249051392078, + 0.6060234382748604, + 0.4685765001922846, + 1.1517230048775673, + 0.0, + 0.5660214165691286, + 0.6194320283830166, + 0.7003642646595836, + 2.032379664480686, + 0.15969195030629635, + 1.8862001560628414, + 1.9673007037490606, + 0.5136248695198447, + 1.2567454017698765, + 0.9298074562102556, + 0.7859148476272821, + 1.0514930747449398, + 0.831958144903183, + 1.2756524682044983, + 0.22880252823233604, + 0.9866696689277887, + 2.1716306917369366 + ], + "unique_experts": 63, + "load_cv": 0.5855845242470583, + "normalized_load_entropy": 0.9548777994639698, + "max_load_share": 0.041379310344827586 + } + }, + "s1_eos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "c12e290d45745547529bada2d696ac44706d8aa4b02813e7a26f899ac565cb76", + "route_weight_sha256": "3e2c25122e1dbc3d90dd7ebb9cf024d365a6a9e71f0a222792ea72fdcc6dfd32", + "loads": [ + 5, + 21, + 13, + 3, + 1, + 19, + 16, + 6, + 8, + 12, + 12, + 22, + 12, + 12, + 11, + 11, + 0, + 13, + 26, + 1, + 5, + 13, + 9, + 2, + 3, + 22, + 10, + 6, + 7, + 5, + 1, + 14, + 15, + 4, + 12, + 13, + 9, + 18, + 17, + 8, + 16, + 11, + 7, + 10, + 5, + 18, + 0, + 12, + 9, + 14, + 13, + 4, + 9, + 25, + 15, + 13, + 17, + 16, + 25, + 14, + 11, + 6, + 21, + 12 + ], + "weighted_loads": [ + 0.23167496174573898, + 1.9332082439213991, + 0.5703660380095243, + 0.17947116121649742, + 0.042604632675647736, + 0.8655275199562311, + 0.6930379122495651, + 0.2598419673740864, + 0.37163378298282623, + 0.4212842006236315, + 0.6446211021393538, + 0.8688554186373949, + 0.6895081922411919, + 0.4879908263683319, + 0.5834639854729176, + 1.1530086994171143, + 0.0, + 0.9591902457177639, + 1.3658572044223547, + 0.0666765570640564, + 0.16575843282043934, + 0.9235521145164967, + 0.3269979488104582, + 0.18659083358943462, + 0.3035591319203377, + 1.7872548624873161, + 0.34637206979095936, + 0.37339499220252037, + 0.25129770673811436, + 0.37010951712727547, + 0.07143580168485641, + 0.4708334859460592, + 0.5385959297418594, + 0.13502016104757786, + 0.8392114639282227, + 0.9396459013223648, + 0.43925320729613304, + 1.9309323206543922, + 1.47029272839427, + 0.4635184481739998, + 2.0814766958355904, + 0.5962485894560814, + 0.3125940039753914, + 0.5284272991120815, + 0.34806692227721214, + 1.1186094731092453, + 0.0, + 0.49625111371278763, + 0.5899163298308849, + 0.545278899371624, + 1.4397087767720222, + 0.15598464012145996, + 0.26616781763732433, + 1.3917581010609865, + 0.5341893564909697, + 0.5621106661856174, + 0.9177280459553003, + 0.7784231957048178, + 1.0222602058202028, + 0.7774431593716145, + 1.2816277891397476, + 0.21300426125526428, + 0.9334420878440142, + 1.261434305459261 + ], + "unique_experts": 62, + "load_cv": 0.5654671399999766, + "normalized_load_entropy": 0.9559717009598425, + "max_load_share": 0.03611111111111111 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "38ff4589ed062d9968586afb0a1aea36fffdd72a784b8b5c84cc5f174a2c7025", + "route_weight_sha256": "88a101322214b88b15777291e6eecfd5717c865753e73ba6ec0ad00379c76fa0", + "loads": [ + 6, + 23, + 13, + 9, + 2, + 21, + 25, + 9, + 9, + 13, + 26, + 25, + 18, + 12, + 12, + 26, + 3, + 24, + 38, + 11, + 7, + 14, + 10, + 2, + 4, + 30, + 10, + 8, + 7, + 6, + 1, + 14, + 16, + 5, + 13, + 17, + 10, + 21, + 30, + 20, + 20, + 24, + 16, + 14, + 6, + 18, + 0, + 15, + 9, + 28, + 23, + 5, + 12, + 35, + 19, + 23, + 17, + 16, + 26, + 15, + 12, + 6, + 21, + 16 + ], + "weighted_loads": [ + 0.26819032058119774, + 1.9571511193644255, + 0.5703660380095243, + 0.5938602648675442, + 0.0443748285761103, + 0.9378772508352995, + 1.7123689576983452, + 0.35271147615276277, + 0.3749939876142889, + 0.4257125277072191, + 1.4883697424083948, + 1.2368390951305628, + 1.137366984039545, + 0.4879908263683319, + 0.616709228605032, + 3.80720777483657, + 0.23771418631076813, + 1.638440441340208, + 2.4596198070794344, + 0.9108814047649503, + 0.18110132007859647, + 0.9647279232740402, + 0.3648931700736284, + 0.18659083358943462, + 0.3795735314488411, + 2.504000334069133, + 0.34637206979095936, + 0.5470146648585796, + 0.25129770673811436, + 0.4187612347304821, + 0.07143580168485641, + 0.4708334859460592, + 0.6577169075608253, + 0.17815758846700191, + 0.873573899269104, + 1.3735445141792297, + 0.4845295026898384, + 2.0831911116838455, + 2.7476330660283566, + 1.582561917603016, + 2.2459793016314507, + 1.8393153920769691, + 0.9652947001159191, + 0.7696666680276394, + 0.410008329898119, + 1.1186094731092453, + 0.0, + 0.5467007861007005, + 0.5899163298308849, + 1.3556734574958682, + 2.552471876144409, + 0.20402033627033234, + 1.9317647088319063, + 2.1946702543646097, + 0.5882745925337076, + 1.1817839965224266, + 0.9177280459553003, + 0.7784231957048178, + 1.0928422305732965, + 0.824955802410841, + 1.327398370951414, + 0.21300426125526428, + 0.9334420878440142, + 2.4411798492074013 + ], + "unique_experts": 63, + "load_cv": 0.5665127467738419, + "normalized_load_entropy": 0.9581939251609896, + "max_load_share": 0.039337474120082816 + } + }, + "s0_bos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "86c034b8aecf6ca0949caa8dbcef5839d69d7285e7d056694e36f9292610f695", + "route_weight_sha256": "915db6b735f8ad9786be2970a8071231b90193065de8f7f06ffbd6a637a7e050", + "loads": [ + 7, + 21, + 15, + 4, + 5, + 17, + 17, + 7, + 10, + 11, + 12, + 19, + 12, + 10, + 10, + 13, + 0, + 14, + 25, + 3, + 5, + 11, + 8, + 3, + 3, + 23, + 10, + 8, + 10, + 5, + 1, + 16, + 15, + 4, + 12, + 11, + 9, + 18, + 16, + 7, + 17, + 11, + 7, + 11, + 5, + 18, + 0, + 9, + 10, + 13, + 11, + 4, + 8, + 23, + 15, + 11, + 17, + 17, + 23, + 14, + 10, + 5, + 21, + 13 + ], + "weighted_loads": [ + 0.27344679459929466, + 2.096665184944868, + 0.6789648309350014, + 0.2023527305573225, + 0.18948492035269737, + 0.7283984292298555, + 0.7083914838731289, + 0.2919630631804466, + 0.4594172313809395, + 0.4070798587054014, + 0.5939334705471992, + 0.7821052893996239, + 0.65018430352211, + 0.37242621555924416, + 0.5568449888378382, + 1.2644962277263403, + 0.0, + 1.0159394536167383, + 1.2624278794974089, + 0.13491766341030598, + 0.15727764181792736, + 0.9228812046349049, + 0.2913792058825493, + 0.20917297527194023, + 0.3176065534353256, + 1.8137616235762835, + 0.3277465011924505, + 0.460291376337409, + 0.3607812970876694, + 0.40152331069111824, + 0.06324875354766846, + 0.5332654025405645, + 0.5367913208901882, + 0.12880671955645084, + 0.8619313016533852, + 0.8146055247634649, + 0.4349389858543873, + 1.8071102052927017, + 1.4804913364350796, + 0.43204694613814354, + 2.127743747085333, + 0.5848956890404224, + 0.32135505974292755, + 0.5649933367967606, + 0.3504948429763317, + 1.1650821454823017, + 0.0, + 0.3903067298233509, + 0.6039706170558929, + 0.47010072506964207, + 1.1479651220142841, + 0.15215908363461494, + 0.23448406718671322, + 1.3598835058510303, + 0.5404823161661625, + 0.48554153740406036, + 0.9105258826166391, + 0.8086038921028376, + 0.9304327070713043, + 0.7718229275196791, + 1.2263507843017578, + 0.18976319953799248, + 0.9283612463623285, + 1.3088587950915098 + ], + "unique_experts": 62, + "load_cv": 0.5286834334831253, + "normalized_load_entropy": 0.96215092266709, + "max_load_share": 0.034722222222222224 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "0dfc5ecb81cdd3efba4c96791c5272c83d8af099c949e47c839d1c3efef47cd8", + "route_weight_sha256": "d1ffeb76b7c77b5c994447386244e20ad7223c69d1487b8b6bd9f25cbe07fbf6", + "loads": [ + 7, + 22, + 15, + 4, + 5, + 19, + 19, + 9, + 11, + 12, + 23, + 19, + 15, + 10, + 10, + 27, + 2, + 20, + 34, + 4, + 6, + 13, + 8, + 3, + 3, + 31, + 10, + 8, + 10, + 5, + 1, + 16, + 15, + 4, + 12, + 15, + 9, + 18, + 29, + 15, + 21, + 19, + 13, + 12, + 6, + 18, + 0, + 10, + 10, + 18, + 18, + 4, + 9, + 32, + 17, + 21, + 17, + 17, + 23, + 15, + 10, + 5, + 21, + 16 + ], + "weighted_loads": [ + 0.27344679459929466, + 2.1001689857803285, + 0.6789648309350014, + 0.2023527305573225, + 0.18948492035269737, + 0.7966324891895056, + 0.7783860713243484, + 0.33237094967626035, + 0.4627709488850087, + 0.4435246605426073, + 1.2878936864435673, + 0.7821052893996239, + 0.8393619991838932, + 0.37242621555924416, + 0.5568449888378382, + 3.4462236524559557, + 0.15730243176221848, + 1.3132086787372828, + 2.107025818899274, + 0.1479776380583644, + 0.169855784624815, + 1.0034001804888248, + 0.2913792058825493, + 0.20917297527194023, + 0.3176065534353256, + 2.717601900920272, + 0.3277465011924505, + 0.460291376337409, + 0.3607812970876694, + 0.40152331069111824, + 0.06324875354766846, + 0.5332654025405645, + 0.5367913208901882, + 0.12880671955645084, + 0.8619313016533852, + 1.1273458022624254, + 0.4349389858543873, + 1.8071102052927017, + 2.768804170191288, + 1.069190576672554, + 2.3041057623922825, + 1.417250145226717, + 0.7578750587999821, + 0.609663836658001, + 0.431811410933733, + 1.1650821454823017, + 0.0, + 0.40587938483804464, + 0.6039706170558929, + 0.6840856643393636, + 1.7541034780442715, + 0.15215908363461494, + 0.8993062283843756, + 1.9547715373337269, + 0.5554413916543126, + 1.1735921762883663, + 0.9105258826166391, + 0.8086038921028376, + 0.9304327070713043, + 0.8176051620393991, + 1.2263507843017578, + 0.18976319953799248, + 0.9283612463623285, + 2.2906069327145815 + ], + "unique_experts": 63, + "load_cv": 0.5715545413498294, + "normalized_load_entropy": 0.9579809947258322, + "max_load_share": 0.03908045977011494 + } + }, + "s1_bos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "579ff5ab1892b9727f3081fdc66fd9faa7a6e347a86346e9526ced91101edd72", + "route_weight_sha256": "37df0296c0630f112134ca0141e30dcfc296e35a85eef593538071a2bfd44482", + "loads": [ + 5, + 21, + 18, + 3, + 3, + 19, + 16, + 6, + 10, + 16, + 12, + 19, + 12, + 12, + 10, + 12, + 0, + 14, + 22, + 3, + 5, + 11, + 7, + 3, + 3, + 23, + 9, + 7, + 8, + 5, + 1, + 14, + 14, + 5, + 12, + 11, + 9, + 18, + 16, + 7, + 17, + 12, + 7, + 11, + 6, + 18, + 0, + 12, + 9, + 12, + 11, + 4, + 7, + 25, + 16, + 9, + 17, + 18, + 25, + 14, + 11, + 5, + 21, + 12 + ], + "weighted_loads": [ + 0.22432390041649342, + 2.0971068553626537, + 0.7950447350740433, + 0.17897935025393963, + 0.11725039407610893, + 0.8020446058362722, + 0.6971267312765121, + 0.25108735263347626, + 0.4631596729159355, + 0.5657095536589622, + 0.5851446893066168, + 0.7472276072949171, + 0.6462464518845081, + 0.45306023955345154, + 0.5539996735751629, + 1.2415710780769587, + 0.0, + 1.0053708739578724, + 1.1557597238570452, + 0.13917549885809422, + 0.16343829594552517, + 0.9244272708892822, + 0.2618419900536537, + 0.22733380272984505, + 0.31139998510479927, + 1.8501787967979908, + 0.289936363697052, + 0.4247097000479698, + 0.28573887050151825, + 0.3754286617040634, + 0.06348651647567749, + 0.45598311722278595, + 0.4887243080884218, + 0.16704361513257027, + 0.8483149390667677, + 0.8099475353956223, + 0.42738015577197075, + 1.8066245689988136, + 1.4288354106247425, + 0.4345043711364269, + 2.1009139511734247, + 0.6084741894155741, + 0.30040640011429787, + 0.563615083694458, + 0.3714288454502821, + 1.1849929317831993, + 0.0, + 0.4946338087320328, + 0.5833499506115913, + 0.42290996573865414, + 1.1670403964817524, + 0.15117663145065308, + 0.21428272500634193, + 1.4017222579568624, + 0.5895263962447643, + 0.42959800362586975, + 0.9143422357738018, + 0.8402013629674911, + 1.0069060288369656, + 0.7521488349884748, + 1.2648902162909508, + 0.17952463030815125, + 0.9201880563050508, + 1.2308503687381744 + ], + "unique_experts": 62, + "load_cv": 0.5490732933602593, + "normalized_load_entropy": 0.9593456126027482, + "max_load_share": 0.034722222222222224 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "a08d8ef0f6bef54ae7c4feb590b8144335022ed67acebeeacb0e97e018a41a03", + "route_weight_sha256": "c7de54fb8de1f99cf9bfecbcf2cbfb748d667e957cbe9f83eeb571f2c37bb1ee", + "loads": [ + 6, + 23, + 18, + 9, + 3, + 21, + 25, + 9, + 11, + 16, + 26, + 22, + 18, + 12, + 11, + 28, + 4, + 25, + 36, + 13, + 6, + 13, + 8, + 3, + 4, + 31, + 9, + 9, + 8, + 6, + 1, + 14, + 15, + 6, + 13, + 15, + 10, + 21, + 30, + 19, + 20, + 25, + 17, + 15, + 7, + 18, + 0, + 14, + 9, + 25, + 22, + 5, + 8, + 35, + 19, + 20, + 17, + 18, + 26, + 15, + 12, + 5, + 21, + 16 + ], + "weighted_loads": [ + 0.26083925925195217, + 2.12104973080568, + 0.7950447350740433, + 0.5933684539049864, + 0.11725039407610893, + 0.8743943367153406, + 1.7215652875602245, + 0.34289894602261484, + 0.4665198775473982, + 0.5657095536589622, + 1.4433889854699373, + 1.115211283788085, + 1.1025898344814777, + 0.45306023955345154, + 0.5872449167072773, + 3.961794296745211, + 0.2777559421956539, + 1.6846210695803165, + 2.420245023444295, + 0.9833803465589881, + 0.1760164387524128, + 1.0107365064322948, + 0.29973721131682396, + 0.22733380272984505, + 0.3874143846333027, + 2.5669242683798075, + 0.289936363697052, + 0.5983293727040291, + 0.28573887050151825, + 0.42408037930727005, + 0.06348651647567749, + 0.45598311722278595, + 0.6078452859073877, + 0.21018104255199432, + 0.882677374407649, + 1.2438461482524872, + 0.4726564511656761, + 1.958883360028267, + 2.854992836713791, + 1.5598808228969574, + 2.2299262266606092, + 1.8722898084670305, + 1.0184904336929321, + 0.8051622919738293, + 0.4333702530711889, + 1.1849929317831993, + 0.0, + 0.5426489440724254, + 0.5833499506115913, + 1.2061650278046727, + 2.261418502777815, + 0.19921232759952545, + 0.8791048862040043, + 2.2046344112604856, + 0.6416208483278751, + 1.0701902993023396, + 0.9143422357738018, + 0.8402013629674911, + 1.0774880535900593, + 0.7996614780277014, + 1.3106607981026173, + 0.17952463030815125, + 0.9201880563050508, + 2.4105959124863148 + ], + "unique_experts": 63, + "load_cv": 0.5546452083009502, + "normalized_load_entropy": 0.9600841553134787, + "max_load_share": 0.037267080745341616 + } + }, + "s0_x": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "c93c0c100827d0ad7dea4a6e601b9496d342de0d4d32e08fd05096563c6286b6", + "route_weight_sha256": "6aeac1b98b394f65753aedf280b51e43079bb56ccaa5b9cbdc0193b2c50e1371", + "loads": [ + 7, + 21, + 13, + 3, + 5, + 17, + 16, + 7, + 10, + 11, + 12, + 18, + 12, + 8, + 12, + 13, + 0, + 14, + 28, + 3, + 5, + 12, + 4, + 2, + 3, + 24, + 9, + 7, + 11, + 5, + 1, + 12, + 16, + 3, + 12, + 13, + 9, + 18, + 16, + 7, + 17, + 12, + 5, + 11, + 6, + 18, + 0, + 13, + 10, + 14, + 11, + 3, + 6, + 22, + 17, + 12, + 16, + 17, + 24, + 14, + 11, + 6, + 23, + 13 + ], + "weighted_loads": [ + 0.2713648993521929, + 2.0721912384033203, + 0.6021033562719822, + 0.17577793449163437, + 0.19142365455627441, + 0.7352096438407898, + 0.6864513717591763, + 0.29836731031537056, + 0.46896563470363617, + 0.4095072038471699, + 0.6007893066853285, + 0.7409668564796448, + 0.6578794904053211, + 0.3071908690035343, + 0.6295953560620546, + 1.266286313533783, + 0.0, + 0.9983374457806349, + 1.4118001461029053, + 0.13568819500505924, + 0.16059459373354912, + 0.9277268797159195, + 0.1532868631184101, + 0.18050702661275864, + 0.32078124955296516, + 1.8391475547105074, + 0.291966512799263, + 0.43338122218847275, + 0.3932893555611372, + 0.3820192515850067, + 0.06306549161672592, + 0.4112087246030569, + 0.5614600442349911, + 0.10227140970528126, + 0.870658278465271, + 0.9010782726109028, + 0.43893614038825035, + 1.7885850295424461, + 1.4951514601707458, + 0.4689551554620266, + 2.1199845746159554, + 0.6295153610408306, + 0.23781859129667282, + 0.5589675903320312, + 0.36849084310233593, + 1.146730825304985, + 0.0, + 0.5257661454379559, + 0.6167336665093899, + 0.5077599342912436, + 1.0822314843535423, + 0.11698411405086517, + 0.17827185057103634, + 1.3242220655083656, + 0.6080715972930193, + 0.5096376221626997, + 0.884552925825119, + 0.8099335134029388, + 0.9701236803084612, + 0.7864578273147345, + 1.2573067340999842, + 0.22525238245725632, + 0.9815286565572023, + 1.3364413250237703 + ], + "unique_experts": 62, + "load_cv": 0.5586580039989572, + "normalized_load_entropy": 0.9579237222411584, + "max_load_share": 0.03888888888888889 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "a8527ba336d88b96945fd575177fb297b25c156a8c130a2cbb2b1bc3cef1d0b6", + "route_weight_sha256": "606cdcdec2bb368e138ed0978f88b8187527ed1a0aea63d2049f62c2459dd912", + "loads": [ + 7, + 23, + 13, + 3, + 5, + 19, + 18, + 9, + 11, + 11, + 24, + 18, + 15, + 8, + 12, + 27, + 2, + 20, + 37, + 4, + 6, + 14, + 4, + 2, + 3, + 33, + 9, + 7, + 11, + 5, + 1, + 12, + 16, + 3, + 12, + 17, + 9, + 18, + 27, + 15, + 23, + 20, + 10, + 12, + 7, + 18, + 0, + 14, + 10, + 17, + 18, + 3, + 7, + 33, + 19, + 22, + 16, + 17, + 24, + 15, + 11, + 6, + 23, + 15 + ], + "weighted_loads": [ + 0.2713648993521929, + 2.112982669379562, + 0.6021033562719822, + 0.17577793449163437, + 0.19142365455627441, + 0.8034437038004398, + 0.7524248622357845, + 0.33767184405587614, + 0.4723193522077054, + 0.4095072038471699, + 1.405252704396844, + 0.7409668564796448, + 0.843164224177599, + 0.3071908690035343, + 0.6295953560620546, + 3.6208795201964676, + 0.1559682935476303, + 1.2956066709011793, + 2.1545385271310806, + 0.14874816965311766, + 0.17317273654043674, + 1.004104245454073, + 0.1532868631184101, + 0.18050702661275864, + 0.32078124955296516, + 2.8300873544067144, + 0.291966512799263, + 0.43338122218847275, + 0.3932893555611372, + 0.3820192515850067, + 0.06306549161672592, + 0.4112087246030569, + 0.5614600442349911, + 0.10227140970528126, + 0.870658278465271, + 1.2138185501098633, + 0.43893614038825035, + 1.7885850295424461, + 2.483801081776619, + 1.1260607428848743, + 2.410849440842867, + 1.4125340208411217, + 0.5818710960447788, + 0.5995715819299221, + 0.4498074110597372, + 1.146730825304985, + 0.0, + 0.5413388004526496, + 0.6167336665093899, + 0.6434770720079541, + 1.7122120596468449, + 0.11698411405086517, + 0.8430940117686987, + 2.0315475687384605, + 0.6230306727811694, + 1.2747722696512938, + 0.884552925825119, + 0.8099335134029388, + 0.9701236803084612, + 0.8322400618344545, + 1.2573067340999842, + 0.22525238245725632, + 0.9815286565572023, + 2.2722148541361094 + ], + "unique_experts": 63, + "load_cv": 0.6061602987944595, + "normalized_load_entropy": 0.9531267702298942, + "max_load_share": 0.04252873563218391 + } + }, + "s1_x": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "908028ad55ab766798c6d07c08fe9fcaedf2b6379a5b805c1387ef54aa7951a5", + "route_weight_sha256": "b511ff43ae9808c457764475d3e4d6354ad6076fc154ad6f70dc7bb2ac366060", + "loads": [ + 7, + 22, + 17, + 2, + 4, + 23, + 16, + 7, + 12, + 12, + 12, + 21, + 12, + 8, + 10, + 13, + 1, + 15, + 23, + 3, + 5, + 12, + 4, + 3, + 3, + 23, + 8, + 8, + 8, + 5, + 1, + 14, + 11, + 4, + 13, + 12, + 10, + 18, + 16, + 7, + 17, + 11, + 5, + 10, + 6, + 18, + 0, + 12, + 11, + 12, + 12, + 4, + 8, + 25, + 18, + 9, + 16, + 17, + 25, + 14, + 11, + 4, + 18, + 12 + ], + "weighted_loads": [ + 0.28295978158712387, + 2.1154697872698307, + 0.7589519768953323, + 0.14846241101622581, + 0.14767153561115265, + 0.9575637020170689, + 0.6878437735140324, + 0.2930304855108261, + 0.5377631075680256, + 0.44332109950482845, + 0.5897917933762074, + 0.8162528593093157, + 0.6445428803563118, + 0.3149062544107437, + 0.5581626296043396, + 1.2905666790902615, + 0.03372275456786156, + 1.0321937631815672, + 1.230255475267768, + 0.14030865393579006, + 0.16068768501281738, + 0.9406430684030056, + 0.1635083146393299, + 0.22464248910546303, + 0.31250613182783127, + 1.8404673337936401, + 0.25156187266111374, + 0.46086299046874046, + 0.2877489347010851, + 0.36707459948956966, + 0.06432068347930908, + 0.4649350307881832, + 0.3903472926467657, + 0.13881393149495125, + 0.8846565894782543, + 0.8619675654917955, + 0.4463612772524357, + 1.8042361959815025, + 1.4252585172653198, + 0.4415281917899847, + 2.0886288173496723, + 0.5587573237717152, + 0.2346388641744852, + 0.5261893980205059, + 0.36158676259219646, + 1.2114398069679737, + 0.0, + 0.4961794540286064, + 0.6620555408298969, + 0.4321374259889126, + 1.116416398435831, + 0.14809241518378258, + 0.23876262456178665, + 1.396866524592042, + 0.650368882343173, + 0.4495511520653963, + 0.8843705095350742, + 0.819429500028491, + 1.0235035195946693, + 0.753471851348877, + 1.2883576359599829, + 0.14675750955939293, + 0.8195995539426804, + 1.225848525762558 + ], + "unique_experts": 63, + "load_cv": 0.5604231205741552, + "normalized_load_entropy": 0.9586106660920786, + "max_load_share": 0.034722222222222224 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "eb495dcca916d556de2bfe5bdd06738732f00425c2df1e86729b3fdb3cae271c", + "route_weight_sha256": "0cebe69f828538b790687e6c18ac2ab37a67c3411831c2d489c0953065b84d73", + "loads": [ + 8, + 24, + 17, + 8, + 4, + 25, + 25, + 10, + 13, + 12, + 27, + 24, + 18, + 8, + 11, + 29, + 5, + 26, + 37, + 13, + 6, + 14, + 5, + 3, + 4, + 32, + 8, + 10, + 8, + 6, + 1, + 14, + 12, + 6, + 14, + 17, + 11, + 21, + 27, + 19, + 21, + 23, + 14, + 14, + 7, + 18, + 0, + 14, + 11, + 25, + 21, + 5, + 9, + 37, + 21, + 20, + 16, + 17, + 26, + 15, + 12, + 4, + 18, + 16 + ], + "weighted_loads": [ + 0.3194751404225826, + 2.139412662712857, + 0.7589519768953323, + 0.5628515146672726, + 0.14767153561115265, + 1.0299134328961372, + 1.7107841707766056, + 0.3833752123173326, + 0.5411233121994883, + 0.44332109950482845, + 1.5492147207260132, + 1.1842365358024836, + 1.098199587315321, + 0.3149062544107437, + 0.591407872736454, + 4.19787471788004, + 0.3213975355029106, + 1.7114439588040113, + 2.3726051840931177, + 0.9845135016366839, + 0.173265827819705, + 1.0232261568307877, + 0.20140353590250015, + 0.22464248910546303, + 0.3885205313563347, + 2.6353611927479506, + 0.25156187266111374, + 0.6344826631247997, + 0.2877489347010851, + 0.4157263170927763, + 0.06432068347930908, + 0.4649350307881832, + 0.5094682704657316, + 0.22663620859384537, + 0.9190190248191357, + 1.3417779710143805, + 0.49163757264614105, + 1.9564949870109558, + 2.500712715089321, + 1.5849024634808302, + 2.292117938399315, + 1.7350229509174824, + 0.8800391983240843, + 0.7644578069448471, + 0.4235281702131033, + 1.2114398069679737, + 0.0, + 0.544194589368999, + 0.6620555408298969, + 1.2117778798565269, + 2.139628864824772, + 0.19612811133265495, + 0.903584785759449, + 2.3094245810061693, + 0.7024633344262838, + 1.1612385641783476, + 0.8843705095350742, + 0.819429500028491, + 1.094085544347763, + 0.8009844943881035, + 1.3341282177716494, + 0.14675750955939293, + 0.8195995539426804, + 2.4055940695106983 + ], + "unique_experts": 63, + "load_cv": 0.5671177451406636, + "normalized_load_entropy": 0.9590125854678164, + "max_load_share": 0.038302277432712216 + } + }, + "s0_period": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "db985fd533443e4fae4d903d056e7274cc4a6270e2bb5b8e1beeb01fc3dfba0a", + "route_weight_sha256": "ad96a89cf4653667beca21cf1324c893964f2b4fdf37201f2a285f2c99ce1b7e", + "loads": [ + 7, + 21, + 15, + 3, + 6, + 17, + 14, + 7, + 10, + 11, + 12, + 20, + 12, + 7, + 10, + 13, + 0, + 14, + 28, + 3, + 4, + 12, + 6, + 2, + 3, + 24, + 10, + 7, + 12, + 5, + 1, + 11, + 15, + 3, + 12, + 13, + 9, + 18, + 16, + 8, + 18, + 12, + 4, + 11, + 6, + 18, + 0, + 12, + 11, + 13, + 11, + 4, + 6, + 23, + 17, + 11, + 17, + 17, + 24, + 14, + 11, + 6, + 20, + 13 + ], + "weighted_loads": [ + 0.28151199594140053, + 2.0578017868101597, + 0.6781122889369726, + 0.17983843386173248, + 0.2231352962553501, + 0.7320082448422909, + 0.6085194125771523, + 0.298294585198164, + 0.46619767881929874, + 0.4088208805769682, + 0.6041346937417984, + 0.815527530387044, + 0.6701609492301941, + 0.2630786560475826, + 0.5607649814337492, + 1.2551146857440472, + 0.0, + 0.987828379496932, + 1.4264727868139744, + 0.1308610662817955, + 0.12827230617403984, + 0.9330921359360218, + 0.2196849249303341, + 0.1803014539182186, + 0.3187498711049557, + 1.8436771109700203, + 0.3282498512417078, + 0.43200669437646866, + 0.4244107101112604, + 0.37923626601696014, + 0.06289162486791611, + 0.3720637783408165, + 0.5318442527204752, + 0.1016548927873373, + 0.8785437941551208, + 0.9049809463322163, + 0.4366402141749859, + 1.7784826904535294, + 1.4995112530887127, + 0.5101066213101149, + 2.146620126441121, + 0.6174111943691969, + 0.2011924535036087, + 0.5622379556298256, + 0.37488153018057346, + 1.1505169607698917, + 0.0, + 0.48600925877690315, + 0.6417623907327652, + 0.461522476747632, + 1.0500473156571388, + 0.1512055415660143, + 0.18179558217525482, + 1.3509763181209564, + 0.6111944802105427, + 0.49368453212082386, + 0.9047275688499212, + 0.8092278949916363, + 0.9712485074996948, + 0.7849632613360882, + 1.2561899088323116, + 0.22830931842327118, + 0.8903911411762238, + 1.3366701994091272 + ], + "unique_experts": 62, + "load_cv": 0.5548884884081677, + "normalized_load_entropy": 0.9585986591998773, + "max_load_share": 0.03888888888888889 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "a45d4f43e853901b93d987f0b356ab8a285c277688468af23742853abb600526", + "route_weight_sha256": "d318d45bdd71141a7a0d609a3c3e75d06588c8c6556a406ab45c27b276a4a8cb", + "loads": [ + 7, + 23, + 15, + 3, + 6, + 19, + 16, + 9, + 11, + 11, + 24, + 20, + 15, + 7, + 10, + 27, + 3, + 21, + 37, + 4, + 5, + 14, + 6, + 2, + 3, + 32, + 10, + 7, + 12, + 5, + 1, + 11, + 15, + 3, + 12, + 18, + 9, + 18, + 27, + 16, + 23, + 20, + 9, + 12, + 8, + 18, + 0, + 13, + 11, + 16, + 18, + 4, + 7, + 32, + 19, + 21, + 17, + 17, + 24, + 15, + 11, + 6, + 20, + 15 + ], + "weighted_loads": [ + 0.28151199594140053, + 2.099543613847345, + 0.6781122889369726, + 0.17983843386173248, + 0.2231352962553501, + 0.8002423048019409, + 0.6749274544417858, + 0.3377372936811298, + 0.46955139632336795, + 0.4088208805769682, + 1.4008229300379753, + 0.815527530387044, + 0.8559315241873264, + 0.2630786560475826, + 0.5607649814337492, + 3.4423955832608044, + 0.1950327418744564, + 1.3424456361681223, + 2.1204960346221924, + 0.14392104092985392, + 0.14085044898092747, + 1.0092100240290165, + 0.2196849249303341, + 0.1803014539182186, + 0.3187498711049557, + 2.7475173883140087, + 0.3282498512417078, + 0.43200669437646866, + 0.4244107101112604, + 0.37923626601696014, + 0.06289162486791611, + 0.3720637783408165, + 0.5318442527204752, + 0.1016548927873373, + 0.8785437941551208, + 1.2709129825234413, + 0.4366402141749859, + 1.7784826904535294, + 2.452962066978216, + 1.1719339545816183, + 2.3793124202638865, + 1.436058757826686, + 0.5532091930508614, + 0.6014461368322372, + 0.5118051152676344, + 1.1505169607698917, + 0.0, + 0.5015819137915969, + 0.6417623907327652, + 0.5982553670182824, + 1.6862001419067383, + 0.1512055415660143, + 0.8466177433729172, + 1.945864349603653, + 0.6261535556986928, + 1.385245868936181, + 0.9047275688499212, + 0.8092278949916363, + 0.9712485074996948, + 0.8307454958558083, + 1.2561899088323116, + 0.22830931842327118, + 0.8903911411762238, + 2.2724437285214663 + ], + "unique_experts": 63, + "load_cv": 0.5934731094294006, + "normalized_load_entropy": 0.9552081292957462, + "max_load_share": 0.04252873563218391 + } + }, + "s1_period": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "ce02133d2152030160e04548c4b14d06f8c3f5f8b6803e06f0db5e178c934084", + "route_weight_sha256": "d184ccdaca570b15b4515121741be4cad1ef5bec563c9f417661843e7b79427f", + "loads": [ + 6, + 22, + 18, + 2, + 4, + 22, + 16, + 7, + 10, + 12, + 14, + 21, + 12, + 8, + 10, + 13, + 1, + 15, + 25, + 3, + 5, + 12, + 5, + 3, + 3, + 23, + 8, + 8, + 7, + 4, + 1, + 11, + 13, + 4, + 13, + 12, + 9, + 18, + 16, + 7, + 18, + 10, + 4, + 10, + 6, + 18, + 0, + 11, + 10, + 10, + 12, + 4, + 8, + 25, + 18, + 9, + 16, + 19, + 26, + 14, + 11, + 6, + 20, + 12 + ], + "weighted_loads": [ + 0.27108361944556236, + 2.107979528605938, + 0.796884898096323, + 0.14941049367189407, + 0.14885910600423813, + 0.9160089921206236, + 0.6817771084606647, + 0.29266850650310516, + 0.46843935549259186, + 0.43852048739790916, + 0.6556763779371977, + 0.8305068034678698, + 0.6502574309706688, + 0.31323475390672684, + 0.5606738273054361, + 1.2991676330566406, + 0.033307429403066635, + 1.0237032752484083, + 1.286319274455309, + 0.14036565087735653, + 0.16041498817503452, + 0.94175860658288, + 0.1953638792037964, + 0.2236742302775383, + 0.31690795719623566, + 1.8395267128944397, + 0.2541487645357847, + 0.4568219259381294, + 0.2590419352054596, + 0.3336952142417431, + 0.06464488059282303, + 0.3628409132361412, + 0.449637807905674, + 0.13830373249948025, + 0.8890877943485975, + 0.8655753694474697, + 0.41249334067106247, + 1.8127467781305313, + 1.4160917773842812, + 0.4619644321501255, + 2.109628140926361, + 0.5362194683402777, + 0.1986105516552925, + 0.527464997023344, + 0.363240672275424, + 1.1992118433117867, + 0.0, + 0.4593214578926563, + 0.6245494149625301, + 0.3625563345849514, + 1.0930838286876678, + 0.1495368890464306, + 0.24042371846735477, + 1.3895030375570059, + 0.6454011388123035, + 0.46047220192849636, + 0.8790453150868416, + 0.8764709625393152, + 1.0660833567380905, + 0.7565134353935719, + 1.2888255659490824, + 0.2197999656200409, + 0.8741360381245613, + 1.23002939671278 + ], + "unique_experts": 63, + "load_cv": 0.5773502691896257, + "normalized_load_entropy": 0.9568622508216009, + "max_load_share": 0.03611111111111111 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "9d12992d3afa5bf900892ac52b4195bc9dc6a9465e1aab2c2c562417b913eb1b", + "route_weight_sha256": "6aee9666fcb47e891796428bff17a6b4b801b1ff7d165ce49a0aff1566a8f45e", + "loads": [ + 7, + 24, + 18, + 8, + 4, + 25, + 25, + 10, + 11, + 12, + 29, + 24, + 18, + 8, + 11, + 30, + 5, + 27, + 38, + 13, + 6, + 14, + 6, + 3, + 4, + 31, + 8, + 10, + 7, + 5, + 1, + 11, + 14, + 5, + 14, + 17, + 10, + 21, + 27, + 19, + 22, + 24, + 13, + 14, + 7, + 18, + 0, + 13, + 10, + 23, + 21, + 5, + 9, + 35, + 21, + 20, + 16, + 19, + 27, + 15, + 12, + 6, + 20, + 16 + ], + "weighted_loads": [ + 0.3075989782810211, + 2.1319224040489644, + 0.796884898096323, + 0.5637995973229408, + 0.14885910600423813, + 1.0331649538129568, + 1.7044322192668915, + 0.38286698958836496, + 0.47179956012405455, + 0.43852048739790916, + 1.6324859280139208, + 1.1984904799610376, + 1.1037626266479492, + 0.31323475390672684, + 0.5939190704375505, + 4.085271873045713, + 0.34284214302897453, + 1.7448770720511675, + 2.356534630060196, + 0.9845704985782504, + 0.17299313098192215, + 1.0250080116093159, + 0.23325910046696663, + 0.2236742302775383, + 0.3929223567247391, + 2.5562721844762564, + 0.2541487645357847, + 0.6304415985941887, + 0.2590419352054596, + 0.3823469318449497, + 0.06464488059282303, + 0.3628409132361412, + 0.5687587857246399, + 0.1814411599189043, + 0.9234502296894789, + 1.3784886337816715, + 0.45776963606476784, + 1.9650055691599846, + 2.4531310498714447, + 1.6044788993895054, + 2.2919697649776936, + 1.8713500816375017, + 0.8656031079590321, + 0.765221793204546, + 0.42518207989633083, + 1.1992118433117867, + 0.0, + 0.5073365932330489, + 0.6245494149625301, + 1.1428225813433528, + 2.110470537096262, + 0.19757258519530296, + 0.9052458796650171, + 2.192415190860629, + 0.6974955908954144, + 1.2635881695896387, + 0.8790453150868416, + 0.8764709625393152, + 1.1366653814911842, + 0.8040260784327984, + 1.3345961477607489, + 0.2197999656200409, + 0.8741360381245613, + 2.4097749404609203 + ], + "unique_experts": 63, + "load_cv": 0.5751633284923023, + "normalized_load_entropy": 0.957975512383182, + "max_load_share": 0.039337474120082816 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 120, + "ordered_topk_exact_tokens": 75, + "set_exact_tokens": 90, + "mean_set_jaccard": 0.9267857142857143, + "mean_token_weighted_tv": 0.012412985476354757, + "aggregate_load_tv": 0.03055555555555555 + }, + "system_bos": { + "tokens": 120, + "ordered_topk_exact_tokens": 67, + "set_exact_tokens": 78, + "mean_set_jaccard": 0.8964285714285716, + "mean_token_weighted_tv": 0.018144367448985576, + "aggregate_load_tv": 0.034722222222222224 + }, + "system_x": { + "tokens": 120, + "ordered_topk_exact_tokens": 57, + "set_exact_tokens": 70, + "mean_set_jaccard": 0.8706349206349207, + "mean_token_weighted_tv": 0.022693122550845147, + "aggregate_load_tv": 0.05 + }, + "system_period": { + "tokens": 120, + "ordered_topk_exact_tokens": 59, + "set_exact_tokens": 72, + "mean_set_jaccard": 0.8750000000000002, + "mean_token_weighted_tv": 0.022593362318972746, + "aggregate_load_tv": 0.04583333333333334 + }, + "bos_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 48, + "set_exact_tokens": 64, + "mean_set_jaccard": 0.8545634920634922, + "mean_token_weighted_tv": 0.027334638320220015, + "aggregate_load_tv": 0.05277777777777777 + }, + "bos_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 50, + "set_exact_tokens": 67, + "mean_set_jaccard": 0.868452380952381, + "mean_token_weighted_tv": 0.02689065277421226, + "aggregate_load_tv": 0.04027777777777777 + }, + "x_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 48, + "set_exact_tokens": 64, + "mean_set_jaccard": 0.8563492063492064, + "mean_token_weighted_tv": 0.02772324630059302, + "aggregate_load_tv": 0.048611111111111105 + }, + "x_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 47, + "set_exact_tokens": 62, + "mean_set_jaccard": 0.8498015873015875, + "mean_token_weighted_tv": 0.030799221837272246, + "aggregate_load_tv": 0.05694444444444443 + }, + "period_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 47, + "set_exact_tokens": 67, + "mean_set_jaccard": 0.8617063492063491, + "mean_token_weighted_tv": 0.02755402986270686, + "aggregate_load_tv": 0.049999999999999996 + }, + "period_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 47, + "set_exact_tokens": 67, + "mean_set_jaccard": 0.8595238095238096, + "mean_token_weighted_tv": 0.029987963599463305, + "aggregate_load_tv": 0.056944444444444436 + } + } + }, + "layer_06": { + "layer": 6, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "86fede81a49ee02f416ff1a04bdfa66f5535e99d3144d7007b3fd0c988418e34", + "route_weight_sha256": "d408416301a621e502362baf6315b530a4e3085989600f2122276514b0e7279d", + "loads": [ + 3, + 17, + 0, + 11, + 7, + 15, + 30, + 2, + 12, + 29, + 4, + 17, + 19, + 8, + 0, + 9, + 6, + 4, + 10, + 9, + 8, + 7, + 14, + 11, + 23, + 3, + 13, + 11, + 6, + 6, + 19, + 23, + 12, + 17, + 11, + 15, + 2, + 8, + 0, + 16, + 0, + 7, + 25, + 9, + 2, + 4, + 11, + 4, + 4, + 8, + 7, + 18, + 10, + 5, + 24, + 18, + 7, + 13, + 15, + 21, + 15, + 31, + 13, + 12 + ], + "weighted_loads": [ + 0.16927657835185528, + 0.7582750469446182, + 0.0, + 0.5040523242205381, + 0.380318745970726, + 0.5806421991437674, + 1.9914320819079876, + 0.12934782728552818, + 0.8417641967535019, + 3.1103152073919773, + 0.22218294255435467, + 1.3758558295667171, + 0.9806513655930758, + 0.302293099462986, + 0.0, + 0.3149898424744606, + 0.4167127013206482, + 0.22120716981589794, + 0.6436544060707092, + 0.6532730534672737, + 0.4444371722638607, + 0.31617625057697296, + 0.5456037931144238, + 1.677670143544674, + 1.004510935395956, + 0.15421197935938835, + 0.5700309462845325, + 0.9401838947087526, + 0.4664077013731003, + 0.30838625133037567, + 0.8886617869138718, + 2.971583556383848, + 0.5727523230016232, + 0.9445112459361553, + 0.6067840680480003, + 0.8768543228507042, + 0.3630230128765106, + 0.5972241126000881, + 0.0, + 0.7816207483410835, + 0.0, + 0.39931906573474407, + 0.9589376486837864, + 0.41415911354124546, + 0.06973008811473846, + 0.15635917149484158, + 0.8019977919757366, + 0.1970575489103794, + 0.165889423340559, + 0.3223097827285528, + 0.37167923897504807, + 1.743059504777193, + 0.41722923517227173, + 0.24385728314518929, + 1.059223322197795, + 1.275834646075964, + 0.7561737410724163, + 0.5639935061335564, + 0.8827855139970779, + 1.4979580249637365, + 1.0347976088523865, + 1.4019738845527172, + 0.4712132513523102, + 0.8937069997191429 + ], + "unique_experts": 60, + "load_cv": 0.6687006010369367, + "normalized_load_entropy": 0.9422951767404941, + "max_load_share": 0.043055555555555555 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "3f4781b85e768d772d42cf7c4f41a255d52321ddf6fa808eecf51de12ce11ab7", + "route_weight_sha256": "88d156e344752494828e299bfdb5025868b09152386547430c10ca8608f3c037", + "loads": [ + 3, + 20, + 0, + 11, + 8, + 15, + 38, + 2, + 12, + 29, + 4, + 22, + 19, + 10, + 2, + 10, + 11, + 5, + 10, + 17, + 9, + 10, + 16, + 12, + 23, + 4, + 13, + 11, + 6, + 9, + 19, + 23, + 16, + 17, + 12, + 21, + 2, + 17, + 0, + 25, + 0, + 12, + 27, + 9, + 2, + 9, + 24, + 6, + 8, + 8, + 14, + 25, + 10, + 5, + 24, + 28, + 17, + 13, + 15, + 30, + 15, + 31, + 13, + 12 + ], + "weighted_loads": [ + 0.16927657835185528, + 0.8290019487030804, + 0.0, + 0.5040523242205381, + 0.40880159474909306, + 0.5806421991437674, + 2.854076527059078, + 0.12934782728552818, + 0.8417641967535019, + 3.1103152073919773, + 0.22218294255435467, + 1.71401472017169, + 0.9806513655930758, + 0.33034363482147455, + 0.12423540651798248, + 0.34490807354450226, + 0.7520898021757603, + 0.22525387722998857, + 0.6436544060707092, + 1.1432586312294006, + 0.48876647278666496, + 0.455061711370945, + 2.039615910500288, + 1.7133846580982208, + 1.004510935395956, + 0.18154438212513924, + 0.5700309462845325, + 0.9401838947087526, + 0.4664077013731003, + 0.4743642508983612, + 0.8886617869138718, + 2.971583556383848, + 0.6970399040728807, + 0.9445112459361553, + 0.6413519978523254, + 1.4161104001104832, + 0.3630230128765106, + 1.3787988498806953, + 0.0, + 1.144493879750371, + 0.0, + 0.7964923549443483, + 1.016839986667037, + 0.41415911354124546, + 0.06973008811473846, + 0.29113548062741756, + 2.2972194589674473, + 0.2194048746023327, + 0.3807731680572033, + 0.3223097827285528, + 0.8557011596858501, + 2.0481223724782467, + 0.41722923517227173, + 0.24385728314518929, + 1.059223322197795, + 2.036972001194954, + 1.886936865746975, + 0.5639935061335564, + 0.8827855139970779, + 2.461243102326989, + 1.0347976088523865, + 1.4019738845527172, + 0.4712132513523102, + 0.8937069997191429 + ], + "unique_experts": 61, + "load_cv": 0.6279481925189203, + "normalized_load_entropy": 0.9480758568328769, + "max_load_share": 0.04367816091954023 + } + }, + "s1_eos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "6a22da2a4d5a712eecd40529cc0f53abc861b08e6afeee38da5cf44b2be4f6f1", + "route_weight_sha256": "4d8fcac972a1ef3a34a87cdc3cedc7dd60115e00b998a062e74b500f104cc76d", + "loads": [ + 3, + 20, + 0, + 11, + 7, + 16, + 29, + 2, + 12, + 28, + 4, + 18, + 18, + 6, + 0, + 7, + 6, + 3, + 11, + 9, + 9, + 7, + 13, + 12, + 24, + 2, + 11, + 12, + 6, + 6, + 21, + 23, + 13, + 18, + 11, + 15, + 2, + 8, + 0, + 16, + 1, + 7, + 26, + 7, + 2, + 4, + 10, + 5, + 5, + 9, + 5, + 18, + 9, + 6, + 25, + 17, + 7, + 14, + 13, + 21, + 14, + 31, + 14, + 11 + ], + "weighted_loads": [ + 0.16557887382805347, + 0.8529815785586834, + 0.0, + 0.5055857226252556, + 0.3719465844333172, + 0.6110811699181795, + 1.9851855020970106, + 0.12584633380174637, + 0.8339401260018349, + 2.9963611401617527, + 0.2230383213609457, + 1.4160177186131477, + 0.9360735081136227, + 0.24607692286372185, + 0.0, + 0.2443806566298008, + 0.40726449713110924, + 0.19112923927605152, + 0.675446629524231, + 0.6609438173472881, + 0.4773467443883419, + 0.3240519165992737, + 0.5183755196630955, + 1.697918277233839, + 1.0659544542431831, + 0.11158596351742744, + 0.5145989172160625, + 0.9511892274022102, + 0.46421996876597404, + 0.30509961023926735, + 0.9488456957042217, + 2.9823986887931824, + 0.6016619391739368, + 0.9679398499429226, + 0.6146039664745331, + 0.8778912983834743, + 0.369867205619812, + 0.5694379508495331, + 0.0, + 0.7605908252298832, + 0.02571023814380169, + 0.39518305845558643, + 1.0101024974137545, + 0.3439089674502611, + 0.06966151483356953, + 0.1564646176993847, + 0.7133126985281706, + 0.23609715327620506, + 0.2129884585738182, + 0.3619874492287636, + 0.287689495831728, + 1.7465275526046753, + 0.3721911646425724, + 0.30832740291953087, + 1.0966918226331472, + 1.2431155145168304, + 0.6940692141652107, + 0.5985357761383057, + 0.7859259843826294, + 1.5037144981324673, + 1.0008103512227535, + 1.4934089630842209, + 0.5122568793594837, + 0.8570201434195042 + ], + "unique_experts": 61, + "load_cv": 0.678778859968945, + "normalized_load_entropy": 0.9413774698336336, + "max_load_share": 0.043055555555555555 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "db991071e4393e1b36a6e4b918eca7ecd726eb9f1590f8ad7fd4c31b57a3adb9", + "route_weight_sha256": "d7c397e92906aa9d7aa8fec354fe729dfe74b90434126cc27832f4891515576f", + "loads": [ + 3, + 22, + 3, + 12, + 9, + 16, + 43, + 3, + 17, + 34, + 4, + 28, + 22, + 8, + 9, + 8, + 16, + 4, + 13, + 19, + 11, + 11, + 15, + 13, + 25, + 4, + 11, + 13, + 7, + 9, + 21, + 26, + 19, + 19, + 15, + 23, + 3, + 25, + 0, + 25, + 1, + 12, + 28, + 7, + 3, + 7, + 27, + 8, + 8, + 9, + 14, + 24, + 10, + 9, + 25, + 28, + 24, + 14, + 13, + 32, + 19, + 31, + 14, + 11 + ], + "weighted_loads": [ + 0.16557887382805347, + 0.8926096931099892, + 0.14279655739665031, + 0.5430577471852303, + 0.52335424721241, + 0.6110811699181795, + 3.232555480673909, + 0.1871124841272831, + 1.1722080446779728, + 3.6998253278434277, + 0.2230383213609457, + 2.054969049990177, + 1.2658794596791267, + 0.2744138017296791, + 0.6649857573211193, + 0.35579222068190575, + 1.1661518216133118, + 0.195205248426646, + 0.8226681016385555, + 1.3565491400659084, + 0.5692093372344971, + 0.5396365001797676, + 2.0103430785238743, + 1.733280509710312, + 1.098351564258337, + 0.18944400921463966, + 0.5145989172160625, + 0.9778522625565529, + 0.5008252859115601, + 0.4973152279853821, + 0.9488456957042217, + 3.1813714280724525, + 0.7883500084280968, + 1.0013886578381062, + 0.8720013722777367, + 1.6402857266366482, + 0.4045715220272541, + 1.8995558954775333, + 0.0, + 1.2379420511424541, + 0.02571023814380169, + 0.8081801999360323, + 1.0680545829236507, + 0.3439089674502611, + 0.15352759696543217, + 0.22357423463836312, + 2.532264430075884, + 0.28979408042505383, + 0.38439951837062836, + 0.3619874492287636, + 0.8905486166477203, + 1.9855327792465687, + 0.4093090146780014, + 0.47580496966838837, + 1.0966918226331472, + 2.2547468282282352, + 2.451021905988455, + 0.5985357761383057, + 0.7859259843826294, + 2.559540180489421, + 1.2651140838861465, + 1.4934089630842209, + 0.5122568793594837, + 0.8570201434195042 + ], + "unique_experts": 63, + "load_cv": 0.6135878947212337, + "normalized_load_entropy": 0.9525136173412377, + "max_load_share": 0.044513457556935816 + } + }, + "s0_bos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "4bc5c467c9ff65883f06c9b836d8b4c1f7cf8635aa094c5f0665752e738ffa30", + "route_weight_sha256": "1085a9ccf495d97adf02c19fc319471ea616adfe3d2216f279cfcc951993f8d7", + "loads": [ + 2, + 16, + 0, + 9, + 8, + 12, + 29, + 3, + 12, + 29, + 2, + 17, + 21, + 10, + 0, + 10, + 6, + 4, + 10, + 9, + 9, + 7, + 11, + 12, + 22, + 2, + 14, + 12, + 7, + 5, + 16, + 24, + 17, + 17, + 12, + 15, + 2, + 8, + 0, + 17, + 0, + 6, + 22, + 8, + 1, + 4, + 10, + 6, + 8, + 8, + 9, + 20, + 10, + 5, + 26, + 16, + 7, + 14, + 15, + 22, + 14, + 29, + 11, + 11 + ], + "weighted_loads": [ + 0.14060434326529503, + 0.7006412483751774, + 0.0, + 0.4065839871764183, + 0.4087030924856663, + 0.46731584519147873, + 1.8913913760334253, + 0.16514556296169758, + 0.8342298977077007, + 3.159437522292137, + 0.15243030339479446, + 1.378931999206543, + 1.0549060050398111, + 0.367612162604928, + 0.0, + 0.33931989781558514, + 0.4215547703206539, + 0.2182864397764206, + 0.6401842273771763, + 0.6393622644245625, + 0.4944013711065054, + 0.3165033087134361, + 0.42758438363671303, + 1.740096889436245, + 0.9073527455329895, + 0.10920913517475128, + 0.605062548071146, + 1.0202024802565575, + 0.5053890720009804, + 0.28485868126153946, + 0.780306052416563, + 3.0938469227403402, + 0.7419819179922342, + 0.9346718974411488, + 0.6360251810401678, + 0.8740442059934139, + 0.37246739864349365, + 0.5350119508802891, + 0.0, + 0.8530109506100416, + 0.0, + 0.33943140506744385, + 0.8471645954996347, + 0.3816697522997856, + 0.04037225991487503, + 0.15602238476276398, + 0.6715452205389738, + 0.2558231055736542, + 0.3238266110420227, + 0.31387233920395374, + 0.47944141924381256, + 1.8302515745162964, + 0.4007475096732378, + 0.224501583725214, + 1.1484838053584099, + 1.1490385830402374, + 0.778895664960146, + 0.5619045402854681, + 0.9134988561272621, + 1.551873316988349, + 1.0166444350033998, + 1.360652219504118, + 0.39629654213786125, + 0.8809319548308849 + ], + "unique_experts": 60, + "load_cv": 0.6592176432973923, + "normalized_load_entropy": 0.9426495121769933, + "max_load_share": 0.04027777777777778 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "541ff7ef10d9f00399b56c94a6656392f7312bf7358162546e8d38aed49177f6", + "route_weight_sha256": "03b31ab40b6273f4e36f8fdd0fc616ed131cb03f2d296ba0639438d9043c3eb2", + "loads": [ + 2, + 18, + 0, + 9, + 9, + 12, + 37, + 3, + 12, + 29, + 2, + 22, + 21, + 11, + 3, + 12, + 12, + 4, + 10, + 17, + 10, + 10, + 12, + 13, + 22, + 3, + 14, + 12, + 7, + 9, + 16, + 24, + 20, + 17, + 13, + 21, + 2, + 18, + 0, + 26, + 0, + 11, + 25, + 8, + 1, + 8, + 24, + 7, + 12, + 8, + 16, + 27, + 10, + 5, + 26, + 26, + 17, + 14, + 15, + 31, + 14, + 29, + 11, + 11 + ], + "weighted_loads": [ + 0.14060434326529503, + 0.7666404563933611, + 0.0, + 0.4065839871764183, + 0.4371859412640333, + 0.46731584519147873, + 2.855341235175729, + 0.16514556296169758, + 0.8342298977077007, + 3.159437522292137, + 0.15243030339479446, + 1.7193285450339317, + 1.0549060050398111, + 0.39071736112236977, + 0.185635793954134, + 0.41622654907405376, + 0.7844934463500977, + 0.2182864397764206, + 0.6401842273771763, + 1.1262464635074139, + 0.5387306716293097, + 0.4644068367779255, + 0.9737894274294376, + 1.7758114039897919, + 0.9073527455329895, + 0.13654153794050217, + 0.605062548071146, + 1.0202024802565575, + 0.5053890720009804, + 0.509525690227747, + 0.780306052416563, + 3.0938469227403402, + 0.8297290429472923, + 0.9346718974411488, + 0.6705931108444929, + 1.4247268736362457, + 0.37246739864349365, + 1.3533092513680458, + 0.0, + 1.2120529636740685, + 0.0, + 0.7366046942770481, + 0.9513100124895573, + 0.3816697522997856, + 0.04037225991487503, + 0.28677184134721756, + 2.28849988989532, + 0.2749243378639221, + 0.5456689149141312, + 0.31387233920395374, + 1.00159178301692, + 2.13531444221735, + 0.4007475096732378, + 0.224501583725214, + 1.1484838053584099, + 1.9101759381592274, + 1.8886969648301601, + 0.5619045402854681, + 0.9134988561272621, + 2.5151583943516016, + 1.0166444350033998, + 1.360652219504118, + 0.39629654213786125, + 0.8809319548308849 + ], + "unique_experts": 61, + "load_cv": 0.6272745636907351, + "normalized_load_entropy": 0.9472658928262725, + "max_load_share": 0.04252873563218391 + } + }, + "s1_bos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "9c72f7a984ad70baff4a78e3aa934cbc9ecb8831f68a61cbe81b080838a5a312", + "route_weight_sha256": "28b1f0c6e85aad2a343bfd2c3643d80e1edb6236f82707e8411a4bb4049cd0c8", + "loads": [ + 3, + 16, + 0, + 10, + 8, + 14, + 28, + 1, + 12, + 28, + 2, + 18, + 20, + 10, + 0, + 9, + 6, + 4, + 11, + 10, + 9, + 7, + 10, + 12, + 24, + 2, + 13, + 12, + 6, + 4, + 20, + 25, + 14, + 17, + 12, + 15, + 2, + 8, + 0, + 16, + 1, + 7, + 23, + 6, + 1, + 6, + 9, + 10, + 5, + 8, + 6, + 20, + 8, + 5, + 24, + 15, + 7, + 14, + 16, + 22, + 17, + 29, + 12, + 11 + ], + "weighted_loads": [ + 0.1806894727051258, + 0.7172547169029713, + 0.0, + 0.4505492802709341, + 0.3959517404437065, + 0.541455453261733, + 1.9070868697017431, + 0.09274046123027802, + 0.8626516908407211, + 3.1008323654532433, + 0.14583871513605118, + 1.3935556635260582, + 1.0026138946413994, + 0.36975950561463833, + 0.0, + 0.3175858948379755, + 0.4122180938720703, + 0.2198970429599285, + 0.6824134923517704, + 0.6990922354161739, + 0.49220383167266846, + 0.322946447879076, + 0.40097229927778244, + 1.721631322056055, + 1.0201168954372406, + 0.10782162845134735, + 0.5699596703052521, + 0.9598441161215305, + 0.4510630816221237, + 0.23908023536205292, + 0.8908451944589615, + 3.0682063456624746, + 0.6376462616026402, + 0.947114571928978, + 0.6631622556596994, + 0.8624111637473106, + 0.36345426738262177, + 0.5201450251042843, + 0.0, + 0.8072374910116196, + 0.026646813377738, + 0.37600049935281277, + 0.906872496008873, + 0.3207854926586151, + 0.03777880594134331, + 0.21470286697149277, + 0.6295763123780489, + 0.4010546803474426, + 0.21357791498303413, + 0.3071044012904167, + 0.34159597754478455, + 1.8481743708252907, + 0.3372560329735279, + 0.23851634189486504, + 1.0875744707882404, + 1.12829951941967, + 0.6915667578577995, + 0.5680903755128384, + 0.9071634840220213, + 1.5656307190656662, + 1.1400987766683102, + 1.4075740948319435, + 0.43639735877513885, + 0.85556685552001 + ], + "unique_experts": 61, + "load_cv": 0.6638830776128736, + "normalized_load_entropy": 0.9420787833241712, + "max_load_share": 0.04027777777777778 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "b352199449b83d1212eca8e7fd7b14793f32dec421d2104139e9115fb9e89836", + "route_weight_sha256": "9dc4586929a0f59b8dcb2ab11c740932f58e76d7d5f2259657189996f6651c78", + "loads": [ + 3, + 17, + 3, + 11, + 10, + 14, + 43, + 2, + 17, + 34, + 2, + 28, + 24, + 11, + 9, + 11, + 17, + 4, + 13, + 20, + 11, + 11, + 11, + 13, + 25, + 4, + 13, + 13, + 7, + 7, + 20, + 28, + 20, + 18, + 16, + 23, + 3, + 26, + 0, + 25, + 1, + 12, + 25, + 6, + 2, + 8, + 27, + 13, + 8, + 8, + 15, + 26, + 9, + 8, + 24, + 26, + 24, + 14, + 16, + 33, + 22, + 29, + 12, + 11 + ], + "weighted_loads": [ + 0.1806894727051258, + 0.7521290890872478, + 0.14279655739665031, + 0.4880213048309088, + 0.5473594032227993, + 0.541455453261733, + 3.227100344374776, + 0.15400661155581474, + 1.200919609516859, + 3.804296553134918, + 0.14583871513605118, + 2.032994471490383, + 1.3324198462069035, + 0.3928647041320801, + 0.6768676340579987, + 0.4808850232511759, + 1.1923381388187408, + 0.2198970429599285, + 0.829634964466095, + 1.3915592841804028, + 0.5840664245188236, + 0.5446643494069576, + 0.947177343070507, + 1.756993554532528, + 1.0525140054523945, + 0.18567967414855957, + 0.5699596703052521, + 0.9865071512758732, + 0.48766839876770973, + 0.43983784690499306, + 0.8908451944589615, + 3.267179084941745, + 0.8273029252886772, + 0.9805633798241615, + 0.920559661462903, + 1.6464222967624664, + 0.39815858379006386, + 1.9298945739865303, + 0.0, + 1.2845887169241905, + 0.026646813377738, + 0.7889976408332586, + 0.9648245815187693, + 0.3207854926586151, + 0.12164488807320595, + 0.2780288551002741, + 2.6186335422098637, + 0.5081977732479572, + 0.40477780625224113, + 0.3071044012904167, + 0.982777789235115, + 2.087179597467184, + 0.3743738830089569, + 0.40599390864372253, + 1.0875744707882404, + 2.139930833131075, + 2.4868066534399986, + 0.5680903755128384, + 0.9071634840220213, + 2.62145640142262, + 1.4044025093317032, + 1.4075740948319435, + 0.43639735877513885, + 0.85556685552001 + ], + "unique_experts": 63, + "load_cv": 0.6152622516756561, + "normalized_load_entropy": 0.951339258438475, + "max_load_share": 0.044513457556935816 + } + }, + "s0_x": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "298fa07b303951da12b77aca85b027fec8a597e88d8e91d47abc451ed2280baa", + "route_weight_sha256": "425841dfd8754c56c1465c29b697c67d0f24fe73a1decf7f4fddbbc2518dce83", + "loads": [ + 2, + 17, + 0, + 10, + 8, + 10, + 28, + 2, + 12, + 29, + 2, + 19, + 20, + 7, + 0, + 11, + 5, + 4, + 10, + 8, + 9, + 7, + 12, + 12, + 24, + 3, + 14, + 12, + 7, + 5, + 17, + 24, + 13, + 16, + 11, + 16, + 2, + 8, + 0, + 17, + 1, + 7, + 23, + 6, + 2, + 5, + 10, + 7, + 8, + 7, + 11, + 20, + 11, + 4, + 25, + 16, + 7, + 15, + 15, + 22, + 14, + 29, + 11, + 11 + ], + "weighted_loads": [ + 0.13804866746068, + 0.7276135981082916, + 0.0, + 0.43974165990948677, + 0.40385969169437885, + 0.414647463709116, + 1.9148607589304447, + 0.12592308782041073, + 0.8315595723688602, + 3.188414290547371, + 0.145326167345047, + 1.4365145564079285, + 1.0123728774487972, + 0.272089846432209, + 0.0, + 0.37949175387620926, + 0.3903471380472183, + 0.21375856548547745, + 0.6299042329192162, + 0.6089285425841808, + 0.4980841800570488, + 0.318078126758337, + 0.4712010771036148, + 1.7323574088513851, + 0.9883445911109447, + 0.14946982264518738, + 0.5910983588546515, + 1.010831568390131, + 0.47790983133018017, + 0.2787133567035198, + 0.7824776563793421, + 3.0845980420708656, + 0.610903549939394, + 0.885240763425827, + 0.6095869895070791, + 0.9282999485731125, + 0.37733425199985504, + 0.5694844387471676, + 0.0, + 0.8443335071206093, + 0.02848942019045353, + 0.3683635722845793, + 0.8597728777676821, + 0.322729604318738, + 0.06992796249687672, + 0.18203612975776196, + 0.6892387233674526, + 0.29344168677926064, + 0.32005922868847847, + 0.2921316400170326, + 0.563377171754837, + 1.8150583431124687, + 0.42959437519311905, + 0.18178239464759827, + 1.1133978478610516, + 1.1407400034368038, + 0.6490678042173386, + 0.5917512737214565, + 0.9359719976782799, + 1.5519969556480646, + 1.0105659049004316, + 1.3920879811048508, + 0.39965431950986385, + 0.8625272251665592 + ], + "unique_experts": 61, + "load_cv": 0.6590303389483074, + "normalized_load_entropy": 0.9437531329129331, + "max_load_share": 0.04027777777777778 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "527d337c02dfe818c22b331ffbc11ffb25726791bcacf1d491e9deee7c11a75a", + "route_weight_sha256": "ac506feae74deec89743df3ff5e8aba2733e8ee59795f00c25fca0de5eb58a76", + "loads": [ + 2, + 19, + 0, + 10, + 9, + 10, + 38, + 2, + 12, + 29, + 2, + 23, + 20, + 8, + 3, + 13, + 10, + 4, + 10, + 17, + 10, + 10, + 13, + 13, + 24, + 4, + 14, + 12, + 7, + 8, + 17, + 24, + 16, + 16, + 12, + 22, + 2, + 18, + 0, + 25, + 1, + 14, + 26, + 6, + 2, + 9, + 23, + 8, + 12, + 7, + 16, + 28, + 11, + 4, + 25, + 27, + 16, + 15, + 15, + 32, + 14, + 29, + 11, + 11 + ], + "weighted_loads": [ + 0.13804866746068, + 0.7936128061264753, + 0.0, + 0.43974165990948677, + 0.4323425404727459, + 0.414647463709116, + 3.1774619705975056, + 0.12592308782041073, + 0.8315595723688602, + 3.188414290547371, + 0.145326167345047, + 1.725748099386692, + 1.0123728774487972, + 0.29519504494965076, + 0.17780900746583939, + 0.4532201550900936, + 0.7109587825834751, + 0.21375856548547745, + 0.6299042329192162, + 1.1626330129802227, + 0.5424134805798531, + 0.4634172134101391, + 1.0174061208963394, + 1.768071923404932, + 0.9883445911109447, + 0.17680222541093826, + 0.5910983588546515, + 1.010831568390131, + 0.47790983133018017, + 0.448738731443882, + 0.7824776563793421, + 3.0845980420708656, + 0.6986506748944521, + 0.885240763425827, + 0.6441549193114042, + 1.5070702321827412, + 0.37733425199985504, + 1.3349427431821823, + 0.0, + 1.1609383579343557, + 0.02848942019045353, + 0.9043867979198694, + 0.9508978463709354, + 0.322729604318738, + 0.06992796249687672, + 0.31278558634221554, + 2.003276526927948, + 0.3125429190695286, + 0.5484285913407803, + 0.2921316400170326, + 0.9564600586891174, + 2.155453123152256, + 0.42959437519311905, + 0.18178239464759827, + 1.1133978478610516, + 1.9576033055782318, + 1.5953842848539352, + 0.5917512737214565, + 0.9359719976782799, + 2.5918353628367186, + 1.0105659049004316, + 1.3920879811048508, + 0.39965431950986385, + 0.8625272251665592 + ], + "unique_experts": 62, + "load_cv": 0.6366405088703365, + "normalized_load_entropy": 0.9470874898629275, + "max_load_share": 0.04367816091954023 + } + }, + "s1_x": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "1155ab34f1199354d9e0e9e1f24679b766d1eb78ff8a128770cd59e952fccf78", + "route_weight_sha256": "dd751bc788f97caa78bb7e761bee66613eb49a0cd77d24096c237733d43432e5", + "loads": [ + 3, + 16, + 0, + 7, + 7, + 11, + 29, + 1, + 12, + 31, + 2, + 19, + 20, + 8, + 0, + 10, + 5, + 4, + 10, + 10, + 9, + 7, + 11, + 12, + 27, + 2, + 12, + 12, + 6, + 5, + 19, + 23, + 13, + 18, + 12, + 16, + 2, + 9, + 0, + 16, + 1, + 9, + 21, + 5, + 1, + 7, + 9, + 9, + 6, + 7, + 7, + 20, + 9, + 4, + 24, + 17, + 6, + 13, + 17, + 22, + 15, + 30, + 14, + 11 + ], + "weighted_loads": [ + 0.17894592508673668, + 0.7154267951846123, + 0.0, + 0.3129001595079899, + 0.34258137457072735, + 0.45396504551172256, + 1.9832325000315905, + 0.092060387134552, + 0.8488673344254494, + 3.298839934170246, + 0.14379320666193962, + 1.4439787939190865, + 0.997604763135314, + 0.30283742770552635, + 0.0, + 0.3512555379420519, + 0.3686271384358406, + 0.21970101073384285, + 0.632808580994606, + 0.669637493789196, + 0.4880465753376484, + 0.3186609745025635, + 0.4395364858210087, + 1.6859660483896732, + 1.121884386986494, + 0.10885102674365044, + 0.5322524011135101, + 0.9432281199842691, + 0.4358002692461014, + 0.2835877053439617, + 0.8296318463981152, + 3.0133961215615273, + 0.6041124165058136, + 0.9788710065186024, + 0.6630893275141716, + 0.9069977048784494, + 0.35583655536174774, + 0.599109198898077, + 0.0, + 0.8292045332491398, + 0.025147074833512306, + 0.4470012839883566, + 0.830382639542222, + 0.2949784956872463, + 0.03623036667704582, + 0.24780231900513172, + 0.6312293447554111, + 0.36138387210667133, + 0.2545700781047344, + 0.27871449291706085, + 0.39271386340260506, + 1.855568666011095, + 0.37519338354468346, + 0.1895996443927288, + 1.0902637336403131, + 1.1854909639805555, + 0.5426596477627754, + 0.5252078287303448, + 0.9342122338712215, + 1.555479185655713, + 1.0417634677141905, + 1.4780099540948868, + 0.5073841251432896, + 0.8328172974288464 + ], + "unique_experts": 61, + "load_cv": 0.6829493049168581, + "normalized_load_entropy": 0.9400679362171076, + "max_load_share": 0.043055555555555555 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "992e3adf17b2ec3aa8d0734654ba6ae9e49269dcc77f3632a1e3f76fd9433f56", + "route_weight_sha256": "b378053f01883a674efb250c47777450c176295895e47b964297a40931db677c", + "loads": [ + 3, + 17, + 3, + 8, + 9, + 11, + 46, + 2, + 17, + 37, + 2, + 28, + 24, + 9, + 9, + 12, + 15, + 4, + 12, + 22, + 11, + 11, + 12, + 13, + 29, + 4, + 12, + 13, + 7, + 8, + 19, + 26, + 18, + 19, + 16, + 24, + 3, + 25, + 0, + 25, + 1, + 16, + 23, + 5, + 2, + 9, + 25, + 11, + 9, + 7, + 15, + 27, + 10, + 7, + 24, + 29, + 22, + 13, + 17, + 34, + 20, + 30, + 14, + 11 + ], + "weighted_loads": [ + 0.17894592508673668, + 0.7503011673688889, + 0.14279655739665031, + 0.35037218406796455, + 0.49398903734982014, + 0.45396504551172256, + 3.64734392054379, + 0.15332653746008873, + 1.1871352531015873, + 4.002304121851921, + 0.14379320666193962, + 2.0334096662700176, + 1.327410714700818, + 0.3259426262229681, + 0.6738354526460171, + 0.529629485681653, + 1.104296587407589, + 0.21970101073384285, + 0.7800300531089306, + 1.4674575552344322, + 0.5799091681838036, + 0.5389629974961281, + 0.9857415296137333, + 1.721328280866146, + 1.188500463962555, + 0.18670907244086266, + 0.5322524011135101, + 0.9698911551386118, + 0.4724055863916874, + 0.47582030296325684, + 0.8296318463981152, + 3.2123688608407974, + 0.7536118552088737, + 1.012319814413786, + 0.9204867333173752, + 1.6963213924318552, + 0.39054087176918983, + 1.844828113913536, + 0.0, + 1.3065557591617107, + 0.025147074833512306, + 0.9936958942562342, + 0.8883347250521183, + 0.2949784956872463, + 0.12009644880890846, + 0.31112830713391304, + 2.2830973360687494, + 0.4117903169244528, + 0.4481806866824627, + 0.27871449291706085, + 0.9585318304598331, + 2.123978292569518, + 0.41231123358011246, + 0.3570772111415863, + 1.0902637336403131, + 2.266201602295041, + 2.167231548577547, + 0.5252078287303448, + 0.9342122338712215, + 2.6823692806065083, + 1.3060672003775835, + 1.4780099540948868, + 0.5073841251432896, + 0.8328172974288464 + ], + "unique_experts": 63, + "load_cv": 0.6397448524577599, + "normalized_load_entropy": 0.9487322705620675, + "max_load_share": 0.047619047619047616 + } + }, + "s0_period": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "dbea24d8ba1e90393326fae58e8175c5e4ef6365c7477d016a43d4e374a0f227", + "route_weight_sha256": "818290b6ff5eccd42cc3c51cd4aaa6308c7b9fd9f5d99b06369f91f0c4362ca4", + "loads": [ + 2, + 15, + 0, + 12, + 8, + 11, + 28, + 2, + 12, + 28, + 2, + 19, + 19, + 8, + 0, + 10, + 5, + 3, + 10, + 9, + 8, + 7, + 12, + 12, + 24, + 3, + 12, + 12, + 7, + 4, + 16, + 24, + 13, + 16, + 11, + 16, + 2, + 9, + 0, + 17, + 0, + 7, + 25, + 7, + 1, + 5, + 9, + 7, + 8, + 7, + 12, + 20, + 11, + 4, + 25, + 17, + 7, + 16, + 16, + 22, + 14, + 29, + 12, + 11 + ], + "weighted_loads": [ + 0.13894792273640633, + 0.6650373674929142, + 0.0, + 0.5133124198764563, + 0.391980841755867, + 0.44325608015060425, + 1.8882644772529602, + 0.12449362128973007, + 0.8348781540989876, + 3.161350518465042, + 0.1453043483197689, + 1.4429969377815723, + 0.9759722109884024, + 0.29926998913288116, + 0.0, + 0.3445621635764837, + 0.3930673897266388, + 0.1831965409219265, + 0.6265360936522484, + 0.6453870199620724, + 0.47058670595288277, + 0.3125769756734371, + 0.46621351316571236, + 1.748042143881321, + 0.9889563545584679, + 0.15054817125201225, + 0.5218985080718994, + 1.0151908490806818, + 0.49033382162451744, + 0.24129613116383553, + 0.7500082515180111, + 3.095787089318037, + 0.6101055555045605, + 0.8914280459284782, + 0.6195664163678885, + 0.9174256846308708, + 0.3731520175933838, + 0.6439515799283981, + 0.0, + 0.8527864515781403, + 0.0, + 0.37571702525019646, + 0.9409321900457144, + 0.35157271288335323, + 0.03924062103033066, + 0.1803593747317791, + 0.6193002164363861, + 0.2877363823354244, + 0.31623018346726894, + 0.2899715304374695, + 0.6009251903742552, + 1.8215833380818367, + 0.4385494776070118, + 0.18020478263497353, + 1.1182850766927004, + 1.17701599560678, + 0.6501128152012825, + 0.622343298047781, + 0.9515203777700663, + 1.5620870105922222, + 1.0038798116147518, + 1.3836653381586075, + 0.42217445373535156, + 0.8686550483107567 + ], + "unique_experts": 60, + "load_cv": 0.6629526173411688, + "normalized_load_entropy": 0.9416966287454167, + "max_load_share": 0.04027777777777778 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "0f34fdde35b7edbd254b4b637f9e54ad28035e06b8314d638accfc726a65047d", + "route_weight_sha256": "270b3d55ab30fa052d415f9f1f39bfeed5e74f873f1b234a11b95c4582b3f134", + "loads": [ + 2, + 17, + 0, + 12, + 9, + 11, + 38, + 2, + 12, + 28, + 2, + 23, + 20, + 9, + 2, + 12, + 10, + 3, + 10, + 19, + 9, + 10, + 13, + 13, + 24, + 4, + 12, + 12, + 8, + 7, + 16, + 24, + 16, + 16, + 12, + 22, + 2, + 19, + 0, + 25, + 0, + 13, + 28, + 7, + 1, + 9, + 22, + 8, + 12, + 7, + 17, + 28, + 11, + 4, + 25, + 28, + 16, + 16, + 16, + 31, + 14, + 29, + 12, + 11 + ], + "weighted_loads": [ + 0.13894792273640633, + 0.7310365755110979, + 0.0, + 0.5133124198764563, + 0.42046369053423405, + 0.44325608015060425, + 3.015323616564274, + 0.12449362128973007, + 0.8348781540989876, + 3.161350518465042, + 0.1453043483197689, + 1.7277552671730518, + 1.0299938451498747, + 0.3223751876503229, + 0.13450777158141136, + 0.41223510541021824, + 0.7131468765437603, + 0.1831965409219265, + 0.6265360936522484, + 1.2879138514399529, + 0.514916006475687, + 0.4562564417719841, + 1.012418556958437, + 1.7837566584348679, + 0.9889563545584679, + 0.17788057401776314, + 0.5218985080718994, + 1.0151908490806818, + 0.5937790311872959, + 0.41232361644506454, + 0.7500082515180111, + 3.095787089318037, + 0.6978526804596186, + 0.8914280459284782, + 0.6541343461722136, + 1.490091446787119, + 0.3731520175933838, + 1.4929428771138191, + 0.0, + 1.1693913023918867, + 0.0, + 0.8291181325912476, + 1.0354060679674149, + 0.35157271288335323, + 0.03924062103033066, + 0.3111088313162327, + 1.9181944578886032, + 0.30683761462569237, + 0.5402663629502058, + 0.2899715304374695, + 0.9932196605950594, + 2.1606881991028786, + 0.4385494776070118, + 0.18020478263497353, + 1.1182850766927004, + 2.0853368882089853, + 1.5948770269751549, + 0.622343298047781, + 0.9515203777700663, + 2.525372087955475, + 1.0038798116147518, + 1.3836653381586075, + 0.42217445373535156, + 0.8686550483107567 + ], + "unique_experts": 61, + "load_cv": 0.6416676318125658, + "normalized_load_entropy": 0.9448942601092128, + "max_load_share": 0.04367816091954023 + } + }, + "s1_period": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "2f9060466443235c7feb237769d94b4891a0211ae759b93a3566f5f564f95407", + "route_weight_sha256": "0dba29ca304e75ed746a4e39c2191728f1b12ce5cd01ecd3607a39d71fe4dc58", + "loads": [ + 3, + 17, + 0, + 7, + 7, + 13, + 29, + 1, + 12, + 31, + 2, + 19, + 20, + 9, + 0, + 10, + 5, + 4, + 10, + 10, + 9, + 7, + 10, + 12, + 27, + 2, + 12, + 12, + 6, + 6, + 20, + 23, + 14, + 17, + 11, + 16, + 2, + 9, + 0, + 17, + 1, + 9, + 22, + 5, + 1, + 4, + 8, + 8, + 5, + 7, + 8, + 20, + 9, + 4, + 22, + 18, + 6, + 12, + 18, + 22, + 16, + 30, + 13, + 11 + ], + "weighted_loads": [ + 0.17765863612294197, + 0.7359462194144726, + 0.0, + 0.31546119041740894, + 0.34433550387620926, + 0.511008819565177, + 1.9899751152843237, + 0.090873584151268, + 0.8490643352270126, + 3.282368026673794, + 0.1375577487051487, + 1.4358383491635323, + 0.9915952701121569, + 0.3393902014940977, + 0.0, + 0.3528748992830515, + 0.3693489357829094, + 0.22436732798814774, + 0.6308597214519978, + 0.6771218106150627, + 0.4884282536804676, + 0.3167486861348152, + 0.40127139165997505, + 1.6967353783547878, + 1.1426033303141594, + 0.10875844210386276, + 0.519378624856472, + 0.9413511455059052, + 0.43207504972815514, + 0.32265036180615425, + 0.8756892085075378, + 3.014442775398493, + 0.6429244466125965, + 0.9323141537606716, + 0.630683058872819, + 0.921024402603507, + 0.36173732578754425, + 0.6144037581980228, + 0.0, + 0.8519307896494865, + 0.025110123679041862, + 0.44829636812210083, + 0.8783774003386497, + 0.29390330985188484, + 0.03597310185432434, + 0.14942406117916107, + 0.5638222601264715, + 0.3364027589559555, + 0.22014611586928368, + 0.2779680844396353, + 0.4087741747498512, + 1.84627865254879, + 0.3740391004830599, + 0.18998459726572037, + 1.0357640944421291, + 1.2062765937298536, + 0.5259953513741493, + 0.4800580069422722, + 0.9704563841223717, + 1.5626631565392017, + 1.0866399612277746, + 1.48110868409276, + 0.4754516128450632, + 0.8329625725746155 + ], + "unique_experts": 61, + "load_cv": 0.6888888888888889, + "normalized_load_entropy": 0.9389242873555649, + "max_load_share": 0.043055555555555555 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "0973ea9ca079da3333eccf1f0930eed02b690ee8b8e4fa33838196416f6596f3", + "route_weight_sha256": "d3d6fdd9a416ea0c9c25663630369b66a01f9658552e42787f25cc4d5450cfae", + "loads": [ + 3, + 18, + 3, + 8, + 9, + 13, + 45, + 2, + 17, + 37, + 2, + 28, + 25, + 10, + 9, + 12, + 15, + 4, + 12, + 22, + 11, + 12, + 11, + 13, + 29, + 4, + 12, + 13, + 8, + 9, + 20, + 26, + 19, + 18, + 15, + 24, + 3, + 26, + 0, + 26, + 1, + 15, + 24, + 5, + 2, + 6, + 24, + 10, + 8, + 7, + 15, + 27, + 10, + 7, + 22, + 30, + 22, + 12, + 18, + 33, + 21, + 30, + 13, + 11 + ], + "weighted_loads": [ + 0.17765863612294197, + 0.7708205915987492, + 0.14279655739665031, + 0.3529332149773836, + 0.49574316665530205, + 0.511008819565177, + 3.472061051055789, + 0.15213973447680473, + 1.1873322539031506, + 3.9858322143554688, + 0.1375577487051487, + 2.0223961882293224, + 1.384486025199294, + 0.36249540001153946, + 0.6750939339399338, + 0.5260495040565729, + 1.1026567667722702, + 0.22436732798814774, + 0.7780811935663223, + 1.5503367520868778, + 0.5802908465266228, + 0.5815736837685108, + 0.9474764354526997, + 1.7320976108312607, + 1.211077257990837, + 0.18661648780107498, + 0.519378624856472, + 0.9680141806602478, + 0.5935614332556725, + 0.5156645327806473, + 0.8756892085075378, + 3.213415514677763, + 0.7924238853156567, + 0.9657629616558552, + 0.8880804646760225, + 1.7169145327061415, + 0.39644164219498634, + 1.9792522825300694, + 0.0, + 1.3292820155620575, + 0.025110123679041862, + 0.9046107456088066, + 0.936329485848546, + 0.29390330985188484, + 0.11983918398618698, + 0.2127500493079424, + 2.180070783942938, + 0.38680920377373695, + 0.3852260485291481, + 0.2779680844396353, + 0.9134956486523151, + 2.119094967842102, + 0.4111569505184889, + 0.35746216401457787, + 1.0357640944421291, + 2.3498810548335314, + 2.1416160725057125, + 0.4800580069422722, + 0.9704563841223717, + 2.6184888388961554, + 1.3509436938911676, + 1.48110868409276, + 0.4754516128450632, + 0.8329625725746155 + ], + "unique_experts": 63, + "load_cv": 0.6402806578699599, + "normalized_load_entropy": 0.9483884070587275, + "max_load_share": 0.046583850931677016 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 120, + "ordered_topk_exact_tokens": 82, + "set_exact_tokens": 92, + "mean_set_jaccard": 0.931547619047619, + "mean_token_weighted_tv": 0.013633452689585586, + "aggregate_load_tv": 0.03194444444444445 + }, + "system_bos": { + "tokens": 120, + "ordered_topk_exact_tokens": 60, + "set_exact_tokens": 83, + "mean_set_jaccard": 0.9047619047619048, + "mean_token_weighted_tv": 0.019120929902419447, + "aggregate_load_tv": 0.03888888888888889 + }, + "system_x": { + "tokens": 120, + "ordered_topk_exact_tokens": 57, + "set_exact_tokens": 79, + "mean_set_jaccard": 0.8934523809523811, + "mean_token_weighted_tv": 0.021359127884109815, + "aggregate_load_tv": 0.04305555555555554 + }, + "system_period": { + "tokens": 120, + "ordered_topk_exact_tokens": 64, + "set_exact_tokens": 77, + "mean_set_jaccard": 0.8922619047619048, + "mean_token_weighted_tv": 0.02141882641396175, + "aggregate_load_tv": 0.05 + }, + "bos_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 52, + "set_exact_tokens": 69, + "mean_set_jaccard": 0.8678571428571428, + "mean_token_weighted_tv": 0.025860855743909877, + "aggregate_load_tv": 0.047222222222222214 + }, + "bos_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 61, + "set_exact_tokens": 75, + "mean_set_jaccard": 0.8857142857142857, + "mean_token_weighted_tv": 0.02334397144149989, + "aggregate_load_tv": 0.04722222222222222 + }, + "x_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 58, + "set_exact_tokens": 70, + "mean_set_jaccard": 0.8773809523809525, + "mean_token_weighted_tv": 0.02501189927570522, + "aggregate_load_tv": 0.05 + }, + "x_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 53, + "set_exact_tokens": 67, + "mean_set_jaccard": 0.8648809523809524, + "mean_token_weighted_tv": 0.027798288276729484, + "aggregate_load_tv": 0.05555555555555556 + }, + "period_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 54, + "set_exact_tokens": 67, + "mean_set_jaccard": 0.868452380952381, + "mean_token_weighted_tv": 0.026145953320277235, + "aggregate_load_tv": 0.05 + }, + "period_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 54, + "set_exact_tokens": 66, + "mean_set_jaccard": 0.8607142857142859, + "mean_token_weighted_tv": 0.028458954649977386, + "aggregate_load_tv": 0.05694444444444445 + } + } + }, + "layer_07": { + "layer": 7, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "c3197a1c0656b5fb4f18c6d62999173b70e3c6f2447320573bef56893c8f9fa6", + "route_weight_sha256": "8ff05e27439e429b0945d7b7a36621a868e32a73bbf1649c79e9d87b9e0c746d", + "loads": [ + 8, + 20, + 8, + 2, + 15, + 10, + 17, + 6, + 23, + 1, + 1, + 29, + 11, + 19, + 2, + 0, + 14, + 4, + 19, + 10, + 9, + 19, + 10, + 6, + 10, + 3, + 5, + 17, + 9, + 20, + 15, + 17, + 3, + 17, + 7, + 12, + 19, + 14, + 12, + 20, + 12, + 16, + 12, + 9, + 0, + 6, + 2, + 0, + 8, + 1, + 12, + 11, + 7, + 18, + 0, + 22, + 5, + 46, + 6, + 26, + 14, + 15, + 7, + 2 + ], + "weighted_loads": [ + 0.31622091867029667, + 1.5854934230446815, + 0.28274909779429436, + 0.06688567623496056, + 0.988752344623208, + 0.4825875014066696, + 1.121321301907301, + 0.40661565214395523, + 1.5207131039351225, + 0.03819750249385834, + 0.06154637038707733, + 2.3192342035472393, + 0.8814383950084448, + 1.4774867724627256, + 0.2876162827014923, + 0.0, + 1.2514591123908758, + 0.2507232315838337, + 0.7081363387405872, + 0.43243764340877533, + 1.1610890626907349, + 1.0989068895578384, + 0.5703156385570765, + 0.21644372679293156, + 1.034995662048459, + 0.16978885605931282, + 0.34376487135887146, + 1.0717369094491005, + 0.8865124098956585, + 1.2543000020086765, + 0.59311687014997, + 0.8049486204981804, + 0.15664523094892502, + 0.6614716481417418, + 0.2615384217351675, + 0.5630404986441135, + 1.9904358610510826, + 0.5015551447868347, + 0.6263569332659245, + 1.2538907043635845, + 0.5925059299916029, + 0.8999280538409948, + 0.7059653475880623, + 0.3090939912945032, + 0.0, + 0.22586225531995296, + 0.08336765691637993, + 0.0, + 0.42645883560180664, + 0.03729153797030449, + 0.7536548227071762, + 0.46822891756892204, + 0.36238517984747887, + 2.123723343014717, + 0.0, + 1.6529853865504265, + 0.2379273995757103, + 2.7554508186876774, + 0.30176325887441635, + 2.020252965390682, + 0.8369796574115753, + 1.3029130846261978, + 0.23521260358393192, + 0.06945262476801872 + ], + "unique_experts": 60, + "load_cv": 0.7353507603455244, + "normalized_load_entropy": 0.9325305185076058, + "max_load_share": 0.06388888888888888 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "8e2f06883e22d7da097b7da7be3634b0f6e554ea58e05726f15be5b52489f4e7", + "route_weight_sha256": "7be8a7c50e3c81b2be18460f7519aaa14cc10de00c24447f1ae1399968cc1f7a", + "loads": [ + 8, + 20, + 8, + 5, + 15, + 11, + 22, + 6, + 31, + 1, + 3, + 33, + 11, + 24, + 2, + 0, + 29, + 7, + 21, + 11, + 9, + 19, + 13, + 8, + 14, + 3, + 10, + 17, + 12, + 20, + 15, + 17, + 6, + 18, + 7, + 12, + 19, + 14, + 22, + 22, + 12, + 27, + 17, + 11, + 3, + 6, + 4, + 2, + 8, + 1, + 27, + 11, + 7, + 19, + 0, + 29, + 5, + 46, + 10, + 26, + 14, + 21, + 10, + 9 + ], + "weighted_loads": [ + 0.31622091867029667, + 1.5854934230446815, + 0.28274909779429436, + 0.1778382584452629, + 0.988752344623208, + 0.5244020521640778, + 1.5724844932556152, + 0.40661565214395523, + 2.1979858111590147, + 0.03819750249385834, + 0.13301312550902367, + 2.831191085278988, + 0.8814383950084448, + 1.761255118995905, + 0.2876162827014923, + 0.0, + 3.2714412603527308, + 0.41729579865932465, + 0.7495800396427512, + 0.484911497682333, + 1.1610890626907349, + 1.0989068895578384, + 0.7409308534115553, + 0.34514389373362064, + 1.1690530800260603, + 0.16978885605931282, + 0.7862635292112827, + 1.0717369094491005, + 0.9498217208310962, + 1.2543000020086765, + 0.59311687014997, + 0.8049486204981804, + 0.270710501819849, + 0.7113546784967184, + 0.2615384217351675, + 0.5630404986441135, + 1.9904358610510826, + 0.5015551447868347, + 1.561820212751627, + 1.344403125345707, + 0.5925059299916029, + 1.8265038300305605, + 1.0450661815702915, + 0.3411270650103688, + 1.4811897315084934, + 0.22586225531995296, + 0.17492415383458138, + 0.14160805195569992, + 0.42645883560180664, + 0.03729153797030449, + 1.9075298942625523, + 0.46822891756892204, + 0.36238517984747887, + 2.155885621905327, + 0.0, + 2.3073051422834396, + 0.2379273995757103, + 2.7554508186876774, + 0.3863937985152006, + 2.020252965390682, + 0.8369796574115753, + 1.5973530188202858, + 0.2838451210409403, + 0.3364030458033085 + ], + "unique_experts": 62, + "load_cv": 0.679429944544832, + "normalized_load_entropy": 0.9427147464777424, + "max_load_share": 0.052873563218390804 + } + }, + "s1_eos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "15f3049c10c9ea6cda027082a942bea8362e8f5f1eed1dd128caab120a659a12", + "route_weight_sha256": "a5bc6213c7a5cef11bac74dbadefe98857e6410d2359f21c2ef062046c86d6de", + "loads": [ + 6, + 21, + 7, + 2, + 15, + 10, + 16, + 6, + 22, + 1, + 2, + 28, + 10, + 18, + 2, + 0, + 15, + 4, + 20, + 10, + 9, + 19, + 9, + 9, + 11, + 3, + 5, + 18, + 9, + 21, + 15, + 18, + 3, + 14, + 7, + 12, + 19, + 15, + 11, + 20, + 11, + 15, + 11, + 11, + 0, + 5, + 3, + 0, + 8, + 1, + 12, + 10, + 7, + 18, + 0, + 22, + 4, + 45, + 6, + 27, + 15, + 15, + 10, + 2 + ], + "weighted_loads": [ + 0.247743371874094, + 1.726045973598957, + 0.24112964048981667, + 0.07065987586975098, + 0.9539737533777952, + 0.48668212816119194, + 1.082156203687191, + 0.4065673463046551, + 1.4408616721630096, + 0.03592413291335106, + 0.08978740684688091, + 2.2448635622859, + 0.8708523865789175, + 1.456426365301013, + 0.2847111225128174, + 0.0, + 1.2910850867629051, + 0.2683516014367342, + 0.7474431414157152, + 0.43589260429143906, + 1.1550316885113716, + 1.0966456308960915, + 0.5344590842723846, + 0.33667347580194473, + 1.0320899691432714, + 0.16621896252036095, + 0.336156640201807, + 1.1078812256455421, + 0.8909361436963081, + 1.2724642623215914, + 0.5906799994409084, + 0.8133167438209057, + 0.15592387318611145, + 0.5549806300550699, + 0.2632536254823208, + 0.5647556874901056, + 1.9578847736120224, + 0.5473025590181351, + 0.5916078705340624, + 1.2382920682430267, + 0.5601027458906174, + 0.8244651053100824, + 0.6532485783100128, + 0.382269399240613, + 0.0, + 0.18811024352908134, + 0.11501526087522507, + 0.0, + 0.41341044940054417, + 0.038089461624622345, + 0.747901227325201, + 0.42705471999943256, + 0.359345655888319, + 2.1733536273241043, + 0.0, + 1.6141491830348969, + 0.19879281520843506, + 2.745447413995862, + 0.2939005680382252, + 2.109640557318926, + 0.8788408115506172, + 1.2906180135905743, + 0.344399506226182, + 0.07130390033125877 + ], + "unique_experts": 60, + "load_cv": 0.7282653159188418, + "normalized_load_entropy": 0.9337434954031602, + "max_load_share": 0.0625 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "de7373304f49d205600a370ba3f2afe821749b09e1c2167b6e2158fde0e7505a", + "route_weight_sha256": "b0882ad0da68d02fd81205a30aa3cfda389da1bd8e3b4373d6fb0734143b10ed", + "loads": [ + 6, + 21, + 7, + 4, + 16, + 11, + 23, + 6, + 38, + 3, + 9, + 33, + 10, + 23, + 4, + 2, + 31, + 8, + 22, + 11, + 9, + 19, + 11, + 12, + 16, + 3, + 14, + 19, + 12, + 27, + 15, + 18, + 9, + 22, + 7, + 12, + 19, + 19, + 28, + 23, + 13, + 31, + 21, + 14, + 9, + 5, + 5, + 6, + 8, + 1, + 34, + 10, + 7, + 18, + 4, + 31, + 4, + 51, + 9, + 27, + 15, + 21, + 14, + 6 + ], + "weighted_loads": [ + 0.247743371874094, + 1.726045973598957, + 0.24112964048981667, + 0.13406683690845966, + 1.0011511463671923, + 0.5308548398315907, + 1.5411723628640175, + 0.4065673463046551, + 2.8361934423446655, + 0.13665545359253883, + 0.6539829988032579, + 2.826200410723686, + 0.8708523865789175, + 1.7655073758214712, + 0.35312917083501816, + 0.0975542888045311, + 3.7388477213680744, + 0.4876111913472414, + 0.7884940942749381, + 0.48724905773997307, + 1.1550316885113716, + 1.0966456308960915, + 0.6521857492625713, + 0.4983707256615162, + 1.187406221870333, + 0.16621896252036095, + 1.1244499348104, + 1.138577213510871, + 0.954465389251709, + 2.0485922191292048, + 0.5906799994409084, + 0.8133167438209057, + 0.5406072661280632, + 1.097732661291957, + 0.2632536254823208, + 0.5647556874901056, + 1.9578847736120224, + 0.7751512955874205, + 2.3603371288627386, + 1.378564652055502, + 0.7818005308508873, + 2.2076581176370382, + 1.4243651255965233, + 0.4548017354682088, + 2.0232541486620903, + 0.18811024352908134, + 0.219093419611454, + 0.3483641594648361, + 0.41341044940054417, + 0.038089461624622345, + 2.350735740736127, + 0.42705471999943256, + 0.359345655888319, + 2.1733536273241043, + 0.20651591941714287, + 2.3835666701197624, + 0.19879281520843506, + 3.2778456676751375, + 0.3511347584426403, + 2.109640557318926, + 0.8788408115506172, + 1.5798650365322828, + 0.4297655657865107, + 0.18585599772632122 + ], + "unique_experts": 64, + "load_cv": 0.6666248717014721, + "normalized_load_entropy": 0.9487940120941428, + "max_load_share": 0.052795031055900624 + } + }, + "s0_bos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "f1688d6806197bd9fa6129465f5ec6f0d9ab5ba49249ec48eeabeeb27b799528", + "route_weight_sha256": "43b2bc1a38d6bcfc24e10ddca60c651a87dbe0bd2dfdd68b57b5142265730f56", + "loads": [ + 6, + 21, + 7, + 1, + 15, + 10, + 16, + 7, + 24, + 1, + 2, + 30, + 10, + 18, + 3, + 0, + 14, + 2, + 18, + 12, + 9, + 19, + 10, + 4, + 10, + 3, + 7, + 17, + 13, + 20, + 14, + 14, + 3, + 18, + 11, + 10, + 19, + 14, + 9, + 19, + 11, + 14, + 10, + 13, + 0, + 7, + 3, + 0, + 6, + 0, + 12, + 10, + 7, + 18, + 0, + 22, + 7, + 43, + 6, + 28, + 18, + 16, + 7, + 2 + ], + "weighted_loads": [ + 0.2494385465979576, + 1.6249142065644264, + 0.244410939514637, + 0.035877976566553116, + 0.9552409462630749, + 0.4933459758758545, + 1.0232837088406086, + 0.4597401097416878, + 1.5986559204757214, + 0.037274278700351715, + 0.08557009883224964, + 2.3547657653689384, + 0.8367190323770046, + 1.4760871827602386, + 0.3351820595562458, + 0.0, + 1.1717743128538132, + 0.1715630143880844, + 0.7119361292570829, + 0.4986951909959316, + 1.1972737237811089, + 1.0800412744283676, + 0.5758769325911999, + 0.1437654234468937, + 1.0390357300639153, + 0.1701127476990223, + 0.4360322318971157, + 1.087120682001114, + 1.077912975102663, + 1.1903293915092945, + 0.5543717108666897, + 0.7019072361290455, + 0.15573415160179138, + 0.7062929794192314, + 0.3983837142586708, + 0.47630249336361885, + 1.9944844748824835, + 0.5166702326387167, + 0.5115613341331482, + 1.2220993749797344, + 0.5609044674783945, + 0.8135794475674629, + 0.617976289242506, + 0.4480959940701723, + 0.0, + 0.25543408654630184, + 0.11483312025666237, + 0.0, + 0.334796417504549, + 0.0, + 0.7612147592008114, + 0.43320353515446186, + 0.3655168376863003, + 2.1603173315525055, + 0.0, + 1.625196011736989, + 0.3298085629940033, + 2.6094044242054224, + 0.31170380860567093, + 2.1168153658509254, + 0.9887153562158346, + 1.328686662018299, + 0.24336343631148338, + 0.06853795796632767 + ], + "unique_experts": 59, + "load_cv": 0.7277565730583474, + "normalized_load_entropy": 0.9321938112201015, + "max_load_share": 0.059722222222222225 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "e4fdb8c1515414380c701e57eb455afd69ff18692211a017fcfbc6a112135d03", + "route_weight_sha256": "4d12d57fc960808d9ff500247d0bbf749096668ea3ea7dc0cd0afadad12dc969", + "loads": [ + 6, + 21, + 7, + 4, + 15, + 11, + 21, + 7, + 32, + 1, + 4, + 34, + 10, + 23, + 3, + 0, + 29, + 6, + 21, + 13, + 9, + 19, + 13, + 6, + 13, + 3, + 12, + 17, + 15, + 20, + 14, + 14, + 6, + 20, + 11, + 10, + 19, + 14, + 18, + 22, + 11, + 25, + 15, + 14, + 3, + 7, + 6, + 2, + 6, + 0, + 27, + 10, + 7, + 20, + 0, + 29, + 7, + 43, + 9, + 28, + 18, + 22, + 9, + 9 + ], + "weighted_loads": [ + 0.2494385465979576, + 1.6249142065644264, + 0.244410939514637, + 0.14683055877685547, + 0.9552409462630749, + 0.5351605266332626, + 1.5297717787325382, + 0.4597401097416878, + 2.2760647572577, + 0.037274278700351715, + 0.16252086125314236, + 2.911985404789448, + 0.8367190323770046, + 1.759855529293418, + 0.3351820595562458, + 0.0, + 3.276309046894312, + 0.37214968726038933, + 0.7942425282672048, + 0.5560387820005417, + 1.1972737237811089, + 1.0800412744283676, + 0.7464921474456787, + 0.27608897536993027, + 1.1660106386989355, + 0.1701127476990223, + 0.882422648370266, + 1.087120682001114, + 1.1280587781220675, + 1.1903293915092945, + 0.5543717108666897, + 0.7019072361290455, + 0.2697994224727154, + 0.7957967445254326, + 0.3983837142586708, + 0.47630249336361885, + 1.9944844748824835, + 0.5166702326387167, + 1.4369163513183594, + 1.350832972675562, + 0.5609044674783945, + 1.7167774699628353, + 0.9531304612755775, + 0.46570437401533127, + 0.6540647409856319, + 0.25543408654630184, + 0.2523018345236778, + 0.15278463810682297, + 0.334796417504549, + 0.0, + 2.020715221762657, + 0.43320353515446186, + 0.3655168376863003, + 2.2364519722759724, + 0.0, + 2.279515767470002, + 0.3298085629940033, + 2.6094044242054224, + 0.3812794927507639, + 2.1168153658509254, + 0.9887153562158346, + 1.623126596212387, + 0.28633988276124, + 0.33548837900161743 + ], + "unique_experts": 61, + "load_cv": 0.6709139378166661, + "normalized_load_entropy": 0.9431222555698092, + "max_load_share": 0.04942528735632184 + } + }, + "s1_bos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "6051e218155db9f6d4eda60b826e76141a91a5ebd83f958742cc18f6fbc17a13", + "route_weight_sha256": "628612171c845af7a3215257c9c7f025d9f3fc3227e9d52f3deec1538adf989e", + "loads": [ + 5, + 20, + 8, + 1, + 15, + 10, + 16, + 7, + 22, + 0, + 2, + 30, + 9, + 20, + 3, + 0, + 12, + 3, + 19, + 11, + 9, + 19, + 9, + 6, + 9, + 3, + 6, + 16, + 11, + 20, + 14, + 15, + 3, + 20, + 9, + 8, + 20, + 14, + 9, + 20, + 11, + 14, + 11, + 13, + 0, + 6, + 4, + 1, + 6, + 0, + 12, + 11, + 7, + 19, + 0, + 21, + 6, + 45, + 6, + 27, + 20, + 15, + 10, + 2 + ], + "weighted_loads": [ + 0.2088504247367382, + 1.639615897089243, + 0.2827910501509905, + 0.03497961536049843, + 0.9309544265270233, + 0.4901016354560852, + 1.004176564514637, + 0.4640805162489414, + 1.4939701817929745, + 0.0, + 0.0912993922829628, + 2.3674600161612034, + 0.8212270773947239, + 1.5380996391177177, + 0.3275076225399971, + 0.0, + 1.1019371263682842, + 0.20896798744797707, + 0.7676801849156618, + 0.4711197968572378, + 1.2111207246780396, + 1.0855070650577545, + 0.5398554392158985, + 0.2221882976591587, + 1.026182446628809, + 0.16531753540039062, + 0.36682136356830597, + 1.0338203720748425, + 1.0636363588273525, + 1.1652044001966715, + 0.5502042211592197, + 0.7062598951160908, + 0.15748251229524612, + 0.7504653315991163, + 0.33966824039816856, + 0.39972732216119766, + 2.006570518016815, + 0.5065866578370333, + 0.48876242712140083, + 1.2418447211384773, + 0.5681794285774231, + 0.7579451240599155, + 0.6547013521194458, + 0.4537926632910967, + 0.0, + 0.22237465903162956, + 0.14614682272076607, + 0.03842047601938248, + 0.32234968803822994, + 0.0, + 0.7449556812644005, + 0.468138936907053, + 0.3614101707935333, + 2.210811860859394, + 0.0, + 1.5989151857793331, + 0.30321548134088516, + 2.692542038857937, + 0.30694080144166946, + 2.0555845126509666, + 1.0478429775685072, + 1.314082819968462, + 0.35256909392774105, + 0.0689742136746645 + ], + "unique_experts": 59, + "load_cv": 0.7381993440832485, + "normalized_load_entropy": 0.9317422074667788, + "max_load_share": 0.0625 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "e8cdcb7ef1148c57ebd542bf82c4e1554e1fa5e3f95f7495aef55c6dfc4d12bc", + "route_weight_sha256": "4d7fcc9e047f0a09ececd29aa1a3d7a13916b753204ea924ee4a869c4e106c98", + "loads": [ + 5, + 20, + 8, + 3, + 16, + 11, + 25, + 7, + 38, + 2, + 9, + 35, + 9, + 25, + 5, + 2, + 28, + 7, + 22, + 12, + 9, + 19, + 11, + 10, + 13, + 3, + 15, + 17, + 13, + 26, + 14, + 15, + 9, + 28, + 9, + 8, + 20, + 18, + 26, + 23, + 13, + 30, + 21, + 15, + 9, + 6, + 7, + 7, + 6, + 0, + 34, + 11, + 7, + 19, + 4, + 30, + 6, + 51, + 8, + 27, + 20, + 21, + 13, + 6 + ], + "weighted_loads": [ + 0.2088504247367382, + 1.639615897089243, + 0.2827910501509905, + 0.09838657639920712, + 0.9781318195164204, + 0.5342743471264839, + 1.632597390562296, + 0.4640805162489414, + 2.886557348072529, + 0.10073132067918777, + 0.6575696505606174, + 2.98421748355031, + 0.8212270773947239, + 1.847180649638176, + 0.3959256708621979, + 0.0975542888045311, + 3.579932291060686, + 0.42428474873304367, + 0.8458833424374461, + 0.5259879324585199, + 1.2111207246780396, + 1.0855070650577545, + 0.6575821042060852, + 0.4387088939547539, + 1.1742924358695745, + 0.16531753540039062, + 1.1491285488009453, + 1.0645163599401712, + 1.1134478263556957, + 1.9413323570042849, + 0.5502042211592197, + 0.7062598951160908, + 0.5421659052371979, + 1.2932173628360033, + 0.33966824039816856, + 0.39972732216119766, + 2.006570518016815, + 0.7344353944063187, + 2.269259534776211, + 1.3859580382704735, + 0.789877213537693, + 2.1355410777032375, + 1.4313280582427979, + 0.5124612376093864, + 1.1846730522811413, + 0.22237465903162956, + 0.297802671790123, + 0.39417650178074837, + 0.32234968803822994, + 0.0, + 2.5006879325956106, + 0.468138936907053, + 0.3614101707935333, + 2.210811860859394, + 0.20651591941714287, + 2.3683326728641987, + 0.30321548134088516, + 3.2249402925372124, + 0.34864007867872715, + 2.0555845126509666, + 1.0478429775685072, + 1.6033298429101706, + 0.4323910027742386, + 0.18352631106972694 + ], + "unique_experts": 63, + "load_cv": 0.6699090423233625, + "normalized_load_entropy": 0.9476977631834536, + "max_load_share": 0.052795031055900624 + } + }, + "s0_x": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "022a4c924c4556dd078851e43bff7a2c7392e6c2a1ab904ba05238e1af6504fb", + "route_weight_sha256": "3d95c12ca894efe4301ef880f7d20bc9a1634d390a97a30b823d965c876bb851", + "loads": [ + 6, + 20, + 7, + 0, + 15, + 10, + 16, + 7, + 23, + 0, + 2, + 32, + 11, + 19, + 3, + 0, + 14, + 4, + 20, + 11, + 9, + 19, + 9, + 5, + 11, + 3, + 7, + 16, + 13, + 20, + 14, + 13, + 4, + 18, + 9, + 12, + 18, + 15, + 8, + 20, + 11, + 13, + 11, + 12, + 0, + 7, + 4, + 1, + 7, + 0, + 12, + 9, + 7, + 18, + 0, + 22, + 7, + 44, + 6, + 25, + 17, + 16, + 6, + 2 + ], + "weighted_loads": [ + 0.26289620250463486, + 1.5548306927084923, + 0.24479057267308235, + 0.0, + 0.939418513327837, + 0.4948785603046417, + 1.0253203064203262, + 0.4547976851463318, + 1.5778640247881413, + 0.0, + 0.0851221140474081, + 2.477578304708004, + 0.8543998338282108, + 1.5200024340301752, + 0.33028656244277954, + 0.0, + 1.2397829219698906, + 0.21995236724615097, + 0.7717966008931398, + 0.46384985372424126, + 1.2023536264896393, + 1.0748549290001392, + 0.5365784652531147, + 0.1743653230369091, + 1.0629821456968784, + 0.16628172993659973, + 0.4610256813466549, + 1.0448689833283424, + 1.1114233955740929, + 1.1871063746511936, + 0.5583116970956326, + 0.6416488587856293, + 0.19067485257983208, + 0.6998330019414425, + 0.3249715268611908, + 0.5507134310901165, + 1.974042620509863, + 0.5614710245281458, + 0.5009952001273632, + 1.2317783273756504, + 0.5801399238407612, + 0.7716987915337086, + 0.6553417816758156, + 0.40726453624665737, + 0.0, + 0.2505071274936199, + 0.14202279970049858, + 0.03801404684782028, + 0.388448316603899, + 0.0, + 0.7671386525034904, + 0.38624121993780136, + 0.35978658869862556, + 2.0518486201763153, + 0.0, + 1.6590517722070217, + 0.32694259844720364, + 2.619305219501257, + 0.3153757192194462, + 2.031952176243067, + 0.9677425026893616, + 1.3348728343844414, + 0.20417750999331474, + 0.06799276173114777 + ], + "unique_experts": 58, + "load_cv": 0.7263981834969401, + "normalized_load_entropy": 0.9328315265960396, + "max_load_share": 0.06111111111111111 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "5c68b38a50937459181896e69ca98efea8e29aeeb4917cf442644179ccab2c3d", + "route_weight_sha256": "41017ee06c465625f17b70b9d3667703eeec7625dcc350c6cc30b6458b13bc0b", + "loads": [ + 6, + 20, + 7, + 3, + 15, + 12, + 19, + 7, + 31, + 0, + 4, + 36, + 12, + 25, + 3, + 0, + 30, + 7, + 22, + 12, + 9, + 19, + 12, + 7, + 14, + 3, + 11, + 16, + 15, + 20, + 14, + 13, + 7, + 20, + 9, + 12, + 18, + 15, + 17, + 23, + 11, + 24, + 16, + 13, + 2, + 7, + 8, + 4, + 7, + 0, + 26, + 9, + 7, + 19, + 0, + 29, + 7, + 44, + 9, + 25, + 17, + 23, + 8, + 10 + ], + "weighted_loads": [ + 0.26289620250463486, + 1.5548306927084923, + 0.24479057267308235, + 0.11095258221030235, + 0.939418513327837, + 0.5929009355604649, + 1.3117404356598854, + 0.4547976851463318, + 2.254938941448927, + 0.0, + 0.16143535263836384, + 3.034261517226696, + 0.8913466930389404, + 1.8371665105223656, + 0.33028656244277954, + 0.0, + 3.6118958108127117, + 0.39540938660502434, + 0.8132403017953038, + 0.5198363624513149, + 1.2023536264896393, + 1.0748549290001392, + 0.7071936801075935, + 0.3106882609426975, + 1.1899570543318987, + 0.16628172993659973, + 0.8684028424322605, + 1.0448689833283424, + 1.1615691985934973, + 1.1871063746511936, + 0.5583116970956326, + 0.6416488587856293, + 0.3047401234507561, + 0.7896000668406487, + 0.3249715268611908, + 0.5507134310901165, + 1.974042620509863, + 0.5614710245281458, + 1.3521263115108013, + 1.3593249469995499, + 0.5801399238407612, + 1.6221003122627735, + 0.9893235564231873, + 0.42487291619181633, + 0.6039404906332493, + 0.2505071274936199, + 0.3127877153456211, + 0.23106934875249863, + 0.388448316603899, + 0.0, + 1.8191102929413319, + 0.38624121993780136, + 0.35978658869862556, + 2.084010899066925, + 0.0, + 2.313371527940035, + 0.32694259844720364, + 2.619305219501257, + 0.38495140336453915, + 2.031952176243067, + 0.9677425026893616, + 1.682226225733757, + 0.24715395644307137, + 0.414116308093071 + ], + "unique_experts": 60, + "load_cv": 0.6699049374214688, + "normalized_load_entropy": 0.9432023065936654, + "max_load_share": 0.05057471264367816 + } + }, + "s1_x": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "aed2f45d2e55238103496588c38cfbd6fc491a5dc097634c372d7af0dac32893", + "route_weight_sha256": "77863e74ba0bef9a560066a84dc8da67dff7cfdd0233f23169b8368c560055af", + "loads": [ + 6, + 20, + 7, + 0, + 16, + 10, + 16, + 7, + 22, + 0, + 2, + 31, + 10, + 19, + 3, + 0, + 13, + 3, + 19, + 10, + 9, + 19, + 9, + 6, + 10, + 3, + 7, + 15, + 11, + 18, + 14, + 14, + 3, + 20, + 8, + 9, + 19, + 14, + 10, + 18, + 11, + 15, + 11, + 13, + 0, + 6, + 4, + 1, + 7, + 0, + 12, + 12, + 7, + 19, + 0, + 21, + 8, + 46, + 6, + 27, + 18, + 16, + 9, + 1 + ], + "weighted_loads": [ + 0.23356585949659348, + 1.5856694467365742, + 0.24377425014972687, + 0.0, + 0.9451063219457865, + 0.49426207318902016, + 0.9757196232676506, + 0.4630515016615391, + 1.5273815393447876, + 0.0, + 0.0932464450597763, + 2.3737081214785576, + 0.8429884649813175, + 1.5158762000501156, + 0.3126254267990589, + 0.0, + 1.1769683510065079, + 0.1963022295385599, + 0.7671721447259188, + 0.436697393655777, + 1.2126804664731026, + 1.0527584161609411, + 0.54302728921175, + 0.2127104178071022, + 1.0384572073817253, + 0.16241127252578735, + 0.4662291668355465, + 0.9891563728451729, + 1.0658593773841858, + 1.0867930129170418, + 0.5596389696002007, + 0.6775338761508465, + 0.1607837714254856, + 0.7474270444363356, + 0.3044023234397173, + 0.45063894242048264, + 1.9588160030543804, + 0.5267743710428476, + 0.6046874932944775, + 1.141102485358715, + 0.5897512249648571, + 0.7963915783911943, + 0.6399616859853268, + 0.44572965800762177, + 0.0, + 0.22536839172244072, + 0.14043071866035461, + 0.05209977552294731, + 0.3672337643802166, + 0.0, + 0.7354176118969917, + 0.5022293198853731, + 0.3498062565922737, + 2.220335241407156, + 0.0, + 1.6254247948527336, + 0.3746309746056795, + 2.6580379102379084, + 0.30268871411681175, + 2.0857157558202744, + 1.0061539225280285, + 1.3366170339286327, + 0.31256759352982044, + 0.03794785216450691 + ], + "unique_experts": 58, + "load_cv": 0.7371952184621497, + "normalized_load_entropy": 0.9312682417283544, + "max_load_share": 0.06388888888888888 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "2e381ded41af6e3a70b22ed3c96bc67a3302c12567e87d8b1114bd008f1ca5a0", + "route_weight_sha256": "b5f42084c557a08a6ac2e96447146b0ba1696a3293a2ab5301583f965df62d23", + "loads": [ + 6, + 20, + 7, + 2, + 17, + 12, + 22, + 7, + 38, + 2, + 9, + 36, + 10, + 25, + 5, + 2, + 30, + 8, + 21, + 11, + 9, + 19, + 11, + 10, + 15, + 3, + 16, + 16, + 13, + 24, + 14, + 14, + 9, + 28, + 8, + 9, + 19, + 18, + 25, + 21, + 13, + 30, + 21, + 15, + 8, + 6, + 8, + 8, + 7, + 0, + 33, + 12, + 7, + 19, + 4, + 30, + 8, + 52, + 8, + 27, + 18, + 23, + 12, + 6 + ], + "weighted_loads": [ + 0.23356585949659348, + 1.5856694467365742, + 0.24377425014972687, + 0.06340696103870869, + 0.9922837149351835, + 0.5926335006952286, + 1.3299956247210503, + 0.4630515016615391, + 2.9246294870972633, + 0.10073132067918777, + 0.6596626602113247, + 3.012190319597721, + 0.8429884649813175, + 1.855927836149931, + 0.3810434751212597, + 0.0975542888045311, + 3.9181157164275646, + 0.4640749339014292, + 0.8082230975851417, + 0.4858342371881008, + 1.2126804664731026, + 1.0527584161609411, + 0.6607539542019367, + 0.41330716386437416, + 1.2205650005489588, + 0.16241127252578735, + 1.2376323007047176, + 1.0198523607105017, + 1.115670844912529, + 1.8629209697246552, + 0.5596389696002007, + 0.6775338761508465, + 0.5454671643674374, + 1.2901790756732225, + 0.3044023234397173, + 0.45063894242048264, + 1.9588160030543804, + 0.754623107612133, + 2.2235862091183662, + 1.2842951491475105, + 0.811449009925127, + 2.0546262841671705, + 1.4069242216646671, + 0.5043982323259115, + 1.1491810604929924, + 0.22536839172244072, + 0.3258587568998337, + 0.4665881246328354, + 0.3672337643802166, + 0.0, + 2.2521765511482954, + 0.5022293198853731, + 0.3498062565922737, + 2.220335241407156, + 0.20651591941714287, + 2.394842281937599, + 0.3746309746056795, + 3.190436163917184, + 0.34438799135386944, + 2.0857157558202744, + 1.0061539225280285, + 1.6790816616266966, + 0.392389502376318, + 0.22104511223733425 + ], + "unique_experts": 63, + "load_cv": 0.6651829482944365, + "normalized_load_entropy": 0.948790061442648, + "max_load_share": 0.053830227743271224 + } + }, + "s0_period": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "af8363751293347161abdc4588b05e2f12d965e0580e86f19fe4ad0b6411288b", + "route_weight_sha256": "f6bd0dc5763801e78f86dbde5a7e20dd51ae7c8bea476a52f67c377c1c22f7df", + "loads": [ + 5, + 21, + 7, + 0, + 15, + 10, + 14, + 7, + 23, + 0, + 2, + 32, + 11, + 19, + 3, + 0, + 14, + 3, + 20, + 11, + 9, + 19, + 8, + 3, + 10, + 3, + 8, + 16, + 12, + 21, + 14, + 14, + 4, + 21, + 9, + 10, + 18, + 14, + 10, + 20, + 11, + 15, + 10, + 12, + 0, + 7, + 4, + 1, + 6, + 0, + 13, + 10, + 7, + 19, + 0, + 22, + 7, + 43, + 6, + 26, + 18, + 15, + 7, + 1 + ], + "weighted_loads": [ + 0.22919007018208504, + 1.5671126917004585, + 0.24216199107468128, + 0.0, + 0.9391838908195496, + 0.4943770356476307, + 0.9157467633485794, + 0.4635515697300434, + 1.611611109226942, + 0.0, + 0.08422860689461231, + 2.4846570156514645, + 0.8639313280582428, + 1.500973779708147, + 0.3346361219882965, + 0.0, + 1.2136757597327232, + 0.1906151082366705, + 0.7760859616100788, + 0.4644008446484804, + 1.207418568432331, + 1.0842963512986898, + 0.5031220726668835, + 0.11288412287831306, + 1.048431048169732, + 0.16629204899072647, + 0.5289090722799301, + 1.040913861244917, + 1.0873711369931698, + 1.2418973445892334, + 0.5556376203894615, + 0.6837946623563766, + 0.1934965681284666, + 0.7872118074446917, + 0.32594681717455387, + 0.4845533948391676, + 1.941406723111868, + 0.5133498497307301, + 0.5779136158525944, + 1.233593549579382, + 0.5899185910820961, + 0.852798480540514, + 0.6231545805931091, + 0.4049059711396694, + 0.0, + 0.2502630986273289, + 0.1424483023583889, + 0.042368754744529724, + 0.34006864205002785, + 0.0, + 0.803070142865181, + 0.4269795399159193, + 0.36129388213157654, + 2.139023683965206, + 0.0, + 1.656953290104866, + 0.3314632661640644, + 2.581609632819891, + 0.3114894740283489, + 2.0405713580548763, + 1.0132859386503696, + 1.3077382817864418, + 0.23747244104743004, + 0.0369454063475132 + ], + "unique_experts": 58, + "load_cv": 0.7371952184621497, + "normalized_load_entropy": 0.9301015596836705, + "max_load_share": 0.059722222222222225 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "ed2c75a03c365413512e9ed8ea0f75d5834f3aef15d16ba45fda152fddcecb58", + "route_weight_sha256": "0ff2b8d0b8adb444d1fa0dbc31a78491989fe3de2b4dec3a9891dac56aae69a4", + "loads": [ + 5, + 21, + 7, + 3, + 15, + 11, + 17, + 7, + 32, + 0, + 4, + 36, + 12, + 24, + 3, + 0, + 30, + 6, + 22, + 12, + 9, + 19, + 12, + 5, + 13, + 3, + 12, + 16, + 14, + 21, + 14, + 14, + 7, + 23, + 9, + 10, + 18, + 14, + 20, + 23, + 11, + 27, + 15, + 13, + 2, + 7, + 6, + 4, + 6, + 0, + 29, + 10, + 7, + 20, + 0, + 29, + 7, + 43, + 9, + 26, + 18, + 21, + 9, + 8 + ], + "weighted_loads": [ + 0.22919007018208504, + 1.5671126917004585, + 0.24216199107468128, + 0.11095258221030235, + 0.9391838908195496, + 0.5361915864050388, + 1.2021668925881386, + 0.4635515697300434, + 2.373420286923647, + 0.0, + 0.15965541265904903, + 3.048960205167532, + 0.9002098888158798, + 1.7847421262413263, + 0.3346361219882965, + 0.0, + 3.5532924123108387, + 0.3588609751313925, + 0.8175296625122428, + 0.5212670248001814, + 1.207418568432331, + 1.0842963512986898, + 0.7170025706291199, + 0.24627794697880745, + 1.1754059568047523, + 0.16629204899072647, + 0.9326523914933205, + 1.040913861244917, + 1.1375169400125742, + 1.2418973445892334, + 0.5556376203894615, + 0.6837946623563766, + 0.3075618389993906, + 0.8722695875912905, + 0.32594681717455387, + 0.4845533948391676, + 1.941406723111868, + 0.5133498497307301, + 1.5358783565461636, + 1.3595885634422302, + 0.5899185910820961, + 1.7614733166992664, + 0.9551425315439701, + 0.4225143510848284, + 0.6039404906332493, + 0.2502630986273289, + 0.23707616701722145, + 0.22750097140669823, + 0.34006864205002785, + 0.0, + 2.187591928988695, + 0.4269795399159193, + 0.36129388213157654, + 2.171185962855816, + 0.0, + 2.311273045837879, + 0.3314632661640644, + 2.581609632819891, + 0.3810651581734419, + 2.0405713580548763, + 1.0132859386503696, + 1.6021782159805298, + 0.28044888749718666, + 0.30389582738280296 + ], + "unique_experts": 60, + "load_cv": 0.689191414954765, + "normalized_load_entropy": 0.940037638220539, + "max_load_share": 0.04942528735632184 + } + }, + "s1_period": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "c39d8da56f68a963df89b9ae070d0962159ef6908bc7fcaf61c36e1f4faf95be", + "route_weight_sha256": "e9ddbe9fa82401655be432a9345bf3ce8f7ad020660486831851af929207870b", + "loads": [ + 5, + 20, + 9, + 0, + 15, + 10, + 17, + 7, + 22, + 0, + 2, + 30, + 10, + 18, + 3, + 0, + 13, + 3, + 19, + 10, + 9, + 19, + 8, + 4, + 10, + 3, + 7, + 15, + 12, + 18, + 14, + 17, + 3, + 20, + 8, + 10, + 19, + 15, + 11, + 18, + 11, + 14, + 11, + 12, + 0, + 6, + 4, + 1, + 7, + 0, + 14, + 12, + 7, + 19, + 0, + 21, + 8, + 45, + 6, + 26, + 18, + 15, + 9, + 1 + ], + "weighted_loads": [ + 0.2002912238240242, + 1.5847879648208618, + 0.3102971985936165, + 0.0, + 0.9268424995243549, + 0.494735699146986, + 1.0042719542980194, + 0.4661705829203129, + 1.5274483263492584, + 0.0, + 0.09231285192072392, + 2.331754680722952, + 0.8512051980942488, + 1.4847045242786407, + 0.3186216652393341, + 0.0, + 1.1893777027726173, + 0.19047236070036888, + 0.767361830919981, + 0.43574273586273193, + 1.2141118571162224, + 1.050137521699071, + 0.5085423961281776, + 0.14434007555246353, + 1.0397118590772152, + 0.16210442036390305, + 0.4653303921222687, + 0.9892098344862461, + 1.1147107817232609, + 1.0870768651366234, + 0.5555285215377808, + 0.7876534592360258, + 0.16212011128664017, + 0.745610911399126, + 0.3036275636404753, + 0.4882541112601757, + 1.9462621957063675, + 0.5500370617955923, + 0.6379275619983673, + 1.140229545533657, + 0.5973763093352318, + 0.7668376639485359, + 0.6430474817752838, + 0.40546260215342045, + 0.0, + 0.22263756021857262, + 0.13967213965952396, + 0.049930207431316376, + 0.3645870294421911, + 0.0, + 0.8023616969585419, + 0.5018135849386454, + 0.35376686230301857, + 2.2132330127060413, + 0.0, + 1.6262591071426868, + 0.36863324232399464, + 2.6084138434380293, + 0.3049643225967884, + 2.045967012643814, + 1.0031859315931797, + 1.3073281049728394, + 0.3161604106426239, + 0.03755324333906174 + ], + "unique_experts": 58, + "load_cv": 0.728434817914834, + "normalized_load_entropy": 0.9316485106801486, + "max_load_share": 0.0625 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "3abda30d6ecea1d84f3eaaa7ce76001cc36b45cabab8ce31a7725c5653a26ad9", + "route_weight_sha256": "22b93fae4a38c7bb28c3a477bfbfe6d2a3db68851b55394544cb25a499b2281b", + "loads": [ + 5, + 20, + 9, + 2, + 16, + 11, + 23, + 7, + 39, + 2, + 9, + 35, + 10, + 23, + 5, + 2, + 30, + 8, + 21, + 11, + 9, + 19, + 11, + 7, + 14, + 3, + 16, + 16, + 14, + 24, + 14, + 17, + 10, + 28, + 8, + 10, + 19, + 19, + 28, + 21, + 13, + 30, + 21, + 14, + 8, + 6, + 6, + 8, + 7, + 0, + 37, + 12, + 7, + 19, + 4, + 30, + 8, + 51, + 8, + 26, + 18, + 21, + 12, + 5 + ], + "weighted_loads": [ + 0.2002912238240242, + 1.5847879648208618, + 0.3102971985936165, + 0.06340696103870869, + 0.974019892513752, + 0.5389084108173847, + 1.3570295311510563, + 0.4661705829203129, + 2.9759261943399906, + 0.10073132067918777, + 0.6595154237002134, + 2.94774467125535, + 0.8512051980942488, + 1.793785534799099, + 0.3870397135615349, + 0.0975542888045311, + 3.8493841774761677, + 0.45239825919270515, + 0.8084127837792039, + 0.4848617836833, + 1.2141118571162224, + 1.050137521699071, + 0.6587025783956051, + 0.3113086186349392, + 1.1878218483179808, + 0.16210442036390305, + 1.2311397194862366, + 1.019905822351575, + 1.164522249251604, + 1.8632048219442368, + 0.5555285215377808, + 0.7876534592360258, + 0.5798865556716919, + 1.288362942636013, + 0.3036275636404753, + 0.4882541112601757, + 1.9462621957063675, + 0.7778857983648777, + 2.3519605360925198, + 1.2839028276503086, + 0.8190740942955017, + 2.08262887224555, + 1.4113404527306557, + 0.4641311764717102, + 1.1491810604929924, + 0.22263756021857262, + 0.2437502983957529, + 0.44037899002432823, + 0.3645870294421911, + 0.0, + 2.7294767554849386, + 0.5018135849386454, + 0.35376686230301857, + 2.2132330127060413, + 0.20651591941714287, + 2.3956765942275524, + 0.36863324232399464, + 3.140812097117305, + 0.3466635998338461, + 2.045967012643814, + 1.0031859315931797, + 1.596575127914548, + 0.39598231948912144, + 0.15210534073412418 + ], + "unique_experts": 63, + "load_cv": 0.6734827667876272, + "normalized_load_entropy": 0.947398158065813, + "max_load_share": 0.052795031055900624 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 120, + "ordered_topk_exact_tokens": 77, + "set_exact_tokens": 92, + "mean_set_jaccard": 0.931547619047619, + "mean_token_weighted_tv": 0.014219435133660833, + "aggregate_load_tv": 0.027777777777777776 + }, + "system_bos": { + "tokens": 120, + "ordered_topk_exact_tokens": 65, + "set_exact_tokens": 81, + "mean_set_jaccard": 0.905357142857143, + "mean_token_weighted_tv": 0.01889765614954134, + "aggregate_load_tv": 0.033333333333333326 + }, + "system_x": { + "tokens": 120, + "ordered_topk_exact_tokens": 74, + "set_exact_tokens": 85, + "mean_set_jaccard": 0.9148809523809525, + "mean_token_weighted_tv": 0.01966124875470996, + "aggregate_load_tv": 0.033333333333333326 + }, + "system_period": { + "tokens": 120, + "ordered_topk_exact_tokens": 67, + "set_exact_tokens": 83, + "mean_set_jaccard": 0.9101190476190477, + "mean_token_weighted_tv": 0.020365842594765128, + "aggregate_load_tv": 0.030555555555555558 + }, + "bos_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 58, + "set_exact_tokens": 75, + "mean_set_jaccard": 0.880357142857143, + "mean_token_weighted_tv": 0.02511588075819115, + "aggregate_load_tv": 0.04722222222222222 + }, + "bos_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 54, + "set_exact_tokens": 69, + "mean_set_jaccard": 0.867857142857143, + "mean_token_weighted_tv": 0.027684388728812338, + "aggregate_load_tv": 0.04722222222222222 + }, + "x_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 56, + "set_exact_tokens": 69, + "mean_set_jaccard": 0.8696428571428572, + "mean_token_weighted_tv": 0.027693035430274904, + "aggregate_load_tv": 0.04583333333333332 + }, + "x_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 56, + "set_exact_tokens": 71, + "mean_set_jaccard": 0.8662698412698414, + "mean_token_weighted_tv": 0.030795923193606238, + "aggregate_load_tv": 0.048611111111111105 + }, + "period_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 52, + "set_exact_tokens": 69, + "mean_set_jaccard": 0.866468253968254, + "mean_token_weighted_tv": 0.02853703199264904, + "aggregate_load_tv": 0.05277777777777778 + }, + "period_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 53, + "set_exact_tokens": 70, + "mean_set_jaccard": 0.8638888888888889, + "mean_token_weighted_tv": 0.031011116760782897, + "aggregate_load_tv": 0.04861111111111111 + } + } + }, + "layer_08": { + "layer": 8, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "7dc99dfb8a45ca6c1c20182bd4d84d607c1b24f9feeef9aa584ded8b6a03aa37", + "route_weight_sha256": "ace187f382a6a18b9e97ea2a7ba51e985b732dae1e89426bcb9458b4a0f311d9", + "loads": [ + 10, + 19, + 1, + 9, + 17, + 0, + 23, + 11, + 34, + 1, + 13, + 11, + 21, + 7, + 17, + 15, + 12, + 18, + 5, + 4, + 15, + 3, + 3, + 5, + 19, + 5, + 11, + 8, + 6, + 1, + 29, + 1, + 19, + 20, + 2, + 3, + 5, + 0, + 0, + 16, + 23, + 28, + 14, + 8, + 5, + 9, + 9, + 10, + 24, + 8, + 9, + 18, + 6, + 23, + 4, + 20, + 20, + 4, + 15, + 24, + 7, + 6, + 0, + 7 + ], + "weighted_loads": [ + 0.5497009884566069, + 1.2502315752208233, + 0.026765134185552597, + 0.39464690908789635, + 0.714151818305254, + 0.0, + 1.436573252081871, + 0.6197429709136486, + 2.4017695747315884, + 0.04346784949302673, + 0.7079722657799721, + 0.9022647198289633, + 1.6798044741153717, + 0.39505984261631966, + 0.9150182455778122, + 0.7335178330540657, + 0.44759344309568405, + 0.9027543812990189, + 0.22638013772666454, + 0.1613595373928547, + 0.7911400943994522, + 0.1784168928861618, + 0.118282001465559, + 0.16316079534590244, + 1.412010584026575, + 0.26966648548841476, + 0.7704856917262077, + 0.38495891354978085, + 0.30911583453416824, + 0.054831843823194504, + 1.3172835055738688, + 0.057430535554885864, + 1.9797080773860216, + 0.8754284232854843, + 0.12434209138154984, + 0.1503307856619358, + 0.16186446696519852, + 0.0, + 0.0, + 0.8500004559755325, + 0.9103266447782516, + 1.1140923649072647, + 0.7279624156653881, + 0.3164135627448559, + 0.1853325068950653, + 0.5746280215680599, + 0.569041233509779, + 0.8641257882118225, + 1.4946033023297787, + 0.34955983981490135, + 1.3436108157038689, + 1.8086304552853107, + 0.6533062532544136, + 2.2812246903777122, + 0.13886631652712822, + 1.285444799810648, + 0.79210090264678, + 0.13082542456686497, + 0.7568228989839554, + 1.1622580587863922, + 0.3252297304570675, + 0.2240971028804779, + 0.0, + 0.3319115899503231 + ], + "unique_experts": 60, + "load_cv": 0.7329965556653619, + "normalized_load_entropy": 0.9296156976639893, + "max_load_share": 0.04722222222222222 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "c58a1e31dfc2120791b827fcedd2bf8b0e53eefe44b3b95d743fdab31496675b", + "route_weight_sha256": "8369f4219cc4ee6f603aa5720c85ecb97cf531a37e02a0c6221db3ff07fa658a", + "loads": [ + 10, + 25, + 2, + 9, + 19, + 0, + 28, + 12, + 44, + 1, + 14, + 14, + 28, + 13, + 17, + 16, + 12, + 21, + 5, + 4, + 15, + 3, + 5, + 5, + 19, + 18, + 11, + 8, + 6, + 1, + 31, + 1, + 23, + 35, + 2, + 3, + 5, + 0, + 0, + 22, + 30, + 28, + 14, + 8, + 5, + 16, + 16, + 14, + 24, + 11, + 11, + 18, + 17, + 23, + 8, + 28, + 20, + 4, + 19, + 24, + 7, + 6, + 2, + 10 + ], + "weighted_loads": [ + 0.5497009884566069, + 1.6179236192256212, + 0.03896896541118622, + 0.39464690908789635, + 0.7770801794249564, + 0.0, + 1.8084915727376938, + 0.6647202260792255, + 3.160272680222988, + 0.04346784949302673, + 0.752753235399723, + 0.993767824023962, + 2.0598006695508957, + 0.8233697712421417, + 0.9150182455778122, + 0.7741368301212788, + 0.44759344309568405, + 1.0675419233739376, + 0.22638013772666454, + 0.1613595373928547, + 0.7911400943994522, + 0.1784168928861618, + 0.1910877227783203, + 0.16316079534590244, + 1.412010584026575, + 1.134247250854969, + 0.7704856917262077, + 0.38495891354978085, + 0.30911583453416824, + 0.054831843823194504, + 1.3398982021026313, + 0.057430535554885864, + 2.1514990646392107, + 1.9868461545556784, + 0.12434209138154984, + 0.1503307856619358, + 0.16186446696519852, + 0.0, + 0.0, + 1.0127872438170016, + 1.2737516164779663, + 1.1140923649072647, + 0.7279624156653881, + 0.3164135627448559, + 0.1853325068950653, + 1.138821043074131, + 1.260153140872717, + 0.9850797103717923, + 1.4946033023297787, + 0.5173934288322926, + 1.4729627333581448, + 1.8086304552853107, + 1.3135127890855074, + 2.2812246903777122, + 1.7165680136531591, + 1.7979616019874811, + 0.79210090264678, + 0.13082542456686497, + 0.874002514174208, + 1.1622580587863922, + 0.3252297304570675, + 0.2240971028804779, + 0.08388438820838928, + 0.5380865894258022 + ], + "unique_experts": 61, + "load_cv": 0.722962008176237, + "normalized_load_entropy": 0.9319738613437384, + "max_load_share": 0.05057471264367816 + } + }, + "s1_eos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "aecd994236a00988b473bc0df7e042100de382b3e3b74823199ac713cbfbfa95", + "route_weight_sha256": "135509d77382f79ed834529d98166d7a96ba1e40bf6c91153a905ab5b7cfc4aa", + "loads": [ + 9, + 20, + 2, + 11, + 16, + 0, + 23, + 11, + 34, + 2, + 13, + 11, + 21, + 6, + 15, + 19, + 12, + 18, + 6, + 5, + 16, + 3, + 2, + 5, + 19, + 5, + 11, + 8, + 7, + 1, + 27, + 1, + 18, + 17, + 2, + 3, + 11, + 0, + 2, + 16, + 22, + 27, + 13, + 8, + 5, + 7, + 8, + 11, + 24, + 8, + 9, + 18, + 6, + 23, + 2, + 20, + 19, + 4, + 15, + 22, + 8, + 6, + 0, + 7 + ], + "weighted_loads": [ + 0.5011159405112267, + 1.256115972995758, + 0.05721361003816128, + 0.4830479081720114, + 0.6805706676095724, + 0.0, + 1.4095509722828865, + 0.6209449507296085, + 2.4000358656048775, + 0.07361441664397717, + 0.7074630279093981, + 0.8870425932109356, + 1.6485578641295433, + 0.3452949710190296, + 0.830216821283102, + 0.9265692494809628, + 0.45673393085598946, + 0.8705730177462101, + 0.2639961205422878, + 0.19032446295022964, + 0.8235503565520048, + 0.1691269539296627, + 0.08165084198117256, + 0.16553656943142414, + 1.534427359700203, + 0.2549440562725067, + 0.7683531567454338, + 0.3884963449090719, + 0.34080195613205433, + 0.05509902536869049, + 1.245569258928299, + 0.057904817163944244, + 1.9358364827930927, + 0.7508772574365139, + 0.12157338485121727, + 0.1615580953657627, + 0.3663325924426317, + 0.0, + 0.07721935212612152, + 0.8580722101032734, + 0.8750371597707272, + 1.1031643990427256, + 0.6845271922647953, + 0.3303321339190006, + 0.18271121755242348, + 0.46751974523067474, + 0.5116846859455109, + 0.9029021803289652, + 1.486287884414196, + 0.3531286418437958, + 1.328721959143877, + 1.8322026766836643, + 0.6538040656596422, + 2.2382109835743904, + 0.0802443940192461, + 1.296433001756668, + 0.781684510409832, + 0.12994654849171638, + 0.8276161551475525, + 1.1030330378562212, + 0.3505846783518791, + 0.22865695133805275, + 0.0, + 0.3248143121600151 + ], + "unique_experts": 61, + "load_cv": 0.7079792143143996, + "normalized_load_entropy": 0.9345804218554605, + "max_load_share": 0.04722222222222222 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "1306dff41c48b93adc7f232fa0b06a2bc8ce2ff8db641c793e050df698c02460", + "route_weight_sha256": "1ee68ec917a59a2a46365869808f19d7c8054d28cf5fe4469a0c3943ac852350", + "loads": [ + 10, + 26, + 12, + 13, + 16, + 1, + 34, + 12, + 48, + 2, + 17, + 15, + 30, + 12, + 15, + 20, + 12, + 32, + 7, + 5, + 16, + 3, + 3, + 9, + 19, + 18, + 11, + 10, + 7, + 1, + 29, + 1, + 21, + 37, + 2, + 3, + 11, + 0, + 8, + 21, + 35, + 27, + 15, + 8, + 5, + 20, + 22, + 15, + 27, + 13, + 13, + 18, + 15, + 29, + 6, + 31, + 19, + 4, + 18, + 24, + 8, + 10, + 3, + 12 + ], + "weighted_loads": [ + 0.5401260405778885, + 1.5745149068534374, + 0.6789267007261515, + 0.5842072870582342, + 0.6805706676095724, + 0.044180549681186676, + 2.281751587986946, + 0.6560790278017521, + 3.3831610195338726, + 0.07361441664397717, + 0.8873128946870565, + 1.0062737623229623, + 2.184785958379507, + 0.751694705337286, + 0.830216821283102, + 0.9700572714209557, + 0.45673393085598946, + 1.8736486434936523, + 0.3109086602926254, + 0.19032446295022964, + 0.8235503565520048, + 0.1691269539296627, + 0.12156085669994354, + 0.355471720919013, + 1.534427359700203, + 1.4589538872241974, + 0.7683531567454338, + 0.5085698682814837, + 0.34080195613205433, + 0.05509902536869049, + 1.2683765711262822, + 0.057904817163944244, + 2.0444965846836567, + 2.095148738473654, + 0.12157338485121727, + 0.1615580953657627, + 0.3663325924426317, + 0.0, + 0.47033146396279335, + 0.9743884261697531, + 1.4592404216527939, + 1.1031643990427256, + 0.8536198548972607, + 0.3303321339190006, + 0.18271121755242348, + 1.578016310930252, + 1.5255293808877468, + 1.0173612218350172, + 1.8004276677966118, + 0.6870936714112759, + 1.5568979196250439, + 1.8322026766836643, + 1.1782343797385693, + 2.914188340306282, + 1.664102977141738, + 2.041397836059332, + 0.781684510409832, + 0.12994654849171638, + 0.929908067220822, + 1.1755469534546137, + 0.3505846783518791, + 0.4168711490929127, + 0.13857794180512428, + 0.6203858628869057 + ], + "unique_experts": 63, + "load_cv": 0.6841921825036398, + "normalized_load_entropy": 0.9414293921790063, + "max_load_share": 0.049689440993788817 + } + }, + "s0_bos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "4b3ce36e441a7fe6a74d242f4ca96d4dbd97c07398c9dab138a09fffdb413e89", + "route_weight_sha256": "8f91096ecb27bfd911872215c0f48822e54e6f04a112486f1f5ed0fcc9c6cdda", + "loads": [ + 11, + 19, + 1, + 10, + 13, + 1, + 22, + 10, + 36, + 2, + 12, + 12, + 21, + 8, + 13, + 16, + 13, + 16, + 5, + 5, + 15, + 3, + 1, + 6, + 19, + 8, + 11, + 8, + 7, + 1, + 29, + 1, + 20, + 20, + 2, + 4, + 4, + 0, + 1, + 16, + 22, + 27, + 14, + 6, + 5, + 10, + 8, + 10, + 24, + 8, + 9, + 18, + 7, + 24, + 4, + 19, + 18, + 6, + 17, + 21, + 7, + 7, + 0, + 7 + ], + "weighted_loads": [ + 0.5673847142606974, + 1.2653314247727394, + 0.025292107835412025, + 0.42712501995265484, + 0.5464429222047329, + 0.039527151733636856, + 1.413222000002861, + 0.5921287201344967, + 2.4184257965534925, + 0.07453407347202301, + 0.6620497386902571, + 0.9669991303235292, + 1.651458039879799, + 0.4165154527872801, + 0.7589777857065201, + 0.7418746761977673, + 0.4782494939863682, + 0.8502740059047937, + 0.22157703898847103, + 0.18391112610697746, + 0.7697495277971029, + 0.18028616905212402, + 0.03762705251574516, + 0.19458133913576603, + 1.4647744074463844, + 0.45323972404003143, + 0.7820731289684772, + 0.391106391325593, + 0.3458509258925915, + 0.05467045679688454, + 1.3008390944451094, + 0.05678914859890938, + 2.0354682952165604, + 0.9147416204214096, + 0.12477236427366734, + 0.20664964616298676, + 0.12851826287806034, + 0.0, + 0.03528251498937607, + 0.8645073585212231, + 0.852740591391921, + 1.0887292064726353, + 0.750737838447094, + 0.23518916219472885, + 0.17576781660318375, + 0.6067568622529507, + 0.48692959919571877, + 0.9020399022847414, + 1.4783060923218727, + 0.35532450675964355, + 1.3048030883073807, + 1.8219959065318108, + 0.702350340783596, + 2.344692640006542, + 0.14225321263074875, + 1.257645420730114, + 0.7396632116287947, + 0.19928063824772835, + 0.8272246886044741, + 1.0727626886218786, + 0.31753039732575417, + 0.244580814614892, + 0.0, + 0.32864508032798767 + ], + "unique_experts": 62, + "load_cv": 0.71267189825887, + "normalized_load_entropy": 0.9350052678160408, + "max_load_share": 0.05 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "31b4c6f884e36ce678ed1ae0b56956a0aa446e690660a92c8d2fd761d7f454be", + "route_weight_sha256": "56a6df84236ee619d76f08863af7dc6072d4d2aa8567a3a3f8e0c4f37cc95cf0", + "loads": [ + 11, + 25, + 2, + 10, + 14, + 1, + 27, + 11, + 46, + 2, + 14, + 16, + 28, + 14, + 13, + 17, + 13, + 19, + 5, + 5, + 15, + 3, + 3, + 6, + 20, + 21, + 11, + 8, + 7, + 1, + 31, + 1, + 25, + 36, + 2, + 4, + 4, + 0, + 1, + 22, + 28, + 27, + 14, + 6, + 5, + 17, + 14, + 13, + 24, + 11, + 11, + 18, + 18, + 24, + 8, + 27, + 18, + 6, + 20, + 21, + 7, + 7, + 2, + 10 + ], + "weighted_loads": [ + 0.5673847142606974, + 1.6330234687775373, + 0.03749593906104565, + 0.42712501995265484, + 0.606560755521059, + 0.039527151733636856, + 1.774592500180006, + 0.6371059753000736, + 3.182690465822816, + 0.07453407347202301, + 0.7502603512257338, + 1.1002747416496277, + 2.031454235315323, + 0.8448253814131021, + 0.7589777857065201, + 0.7884332090616226, + 0.4782494939863682, + 1.0029816683381796, + 0.22157703898847103, + 0.18391112610697746, + 0.7697495277971029, + 0.18028616905212402, + 0.11043277382850647, + 0.19458133913576603, + 1.5111360400915146, + 1.3434059247374535, + 0.7820731289684772, + 0.391106391325593, + 0.3458509258925915, + 0.05467045679688454, + 1.3743206430226564, + 0.05678914859890938, + 2.265718687325716, + 2.0931176226586103, + 0.12477236427366734, + 0.20664964616298676, + 0.12851826287806034, + 0.0, + 0.03528251498937607, + 1.0833613881841302, + 1.2041597831994295, + 1.0887292064726353, + 0.750737838447094, + 0.23518916219472885, + 0.17576781660318375, + 1.1379313841462135, + 1.0644501261413097, + 1.0136237181723118, + 1.4783060923218727, + 0.5225115418434143, + 1.4341550059616566, + 1.8219959065318108, + 1.3625568766146898, + 2.344692640006542, + 0.8481702711433172, + 1.786994380876422, + 0.7396632116287947, + 0.19928063824772835, + 0.9413643795996904, + 1.0727626886218786, + 0.31753039732575417, + 0.244580814614892, + 0.08805491030216217, + 0.5348200798034668 + ], + "unique_experts": 63, + "load_cv": 0.7170903171305877, + "normalized_load_entropy": 0.935390974452817, + "max_load_share": 0.052873563218390804 + } + }, + "s1_bos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "0112ec8c8e0d9e89c82464c94a376f3272c1d5b991384c3f7b23dac3366a079b", + "route_weight_sha256": "7313c98fce501f2c597185ac07a092cbbbb2256b6871db87fe07918f4d975918", + "loads": [ + 11, + 21, + 2, + 10, + 14, + 0, + 23, + 10, + 37, + 2, + 12, + 12, + 21, + 7, + 12, + 19, + 13, + 21, + 5, + 7, + 14, + 3, + 2, + 7, + 19, + 9, + 11, + 8, + 7, + 1, + 27, + 1, + 20, + 15, + 2, + 3, + 6, + 0, + 0, + 16, + 21, + 26, + 14, + 5, + 4, + 7, + 9, + 10, + 23, + 7, + 9, + 18, + 7, + 23, + 4, + 20, + 18, + 5, + 16, + 22, + 8, + 7, + 0, + 7 + ], + "weighted_loads": [ + 0.5653036944568157, + 1.3142415583133698, + 0.0757058709859848, + 0.4250493664294481, + 0.5770677905529737, + 0.0, + 1.4533165842294693, + 0.6040216721594334, + 2.5671628955751657, + 0.07356510311365128, + 0.6536485459655523, + 0.9638186637312174, + 1.6308717355132103, + 0.40913236886262894, + 0.7202750742435455, + 0.9045167788863182, + 0.47694075107574463, + 0.9586363211274147, + 0.22829938121140003, + 0.23981621861457825, + 0.7444475684314966, + 0.1831762231886387, + 0.07718989625573158, + 0.22230824828147888, + 1.5117442049086094, + 0.4915693588554859, + 0.7826534956693649, + 0.4013231433928013, + 0.3449033237993717, + 0.05267208069562912, + 1.2406275644898415, + 0.05776247754693031, + 2.043300163000822, + 0.706799803301692, + 0.12202453054487705, + 0.16761144250631332, + 0.19400516897439957, + 0.0, + 0.0, + 0.8769860658794641, + 0.8217417150735855, + 1.0813063737004995, + 0.731592383235693, + 0.19745956733822823, + 0.1390742752701044, + 0.48063279688358307, + 0.4711872711777687, + 0.8999056704342365, + 1.4413217268884182, + 0.32290981337428093, + 1.3067132644355297, + 1.764935303479433, + 0.6911137886345387, + 2.2896345891058445, + 0.14173470064997673, + 1.270193088799715, + 0.7767405137419701, + 0.16203001700341702, + 0.8271036557853222, + 1.1342540215700865, + 0.3524829763919115, + 0.2511503994464874, + 0.0, + 0.32973121851682663 + ], + "unique_experts": 60, + "load_cv": 0.7147476460477952, + "normalized_load_entropy": 0.933667981275428, + "max_load_share": 0.05138888888888889 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "fe15fa08e56b4d714515550df9eeb7ca7cb75143b59f00129b613b26768ed229", + "route_weight_sha256": "3f9c9580d8698de8850d646b853450c9a55bb943c56119aab7591a1cccdab506", + "loads": [ + 12, + 27, + 12, + 12, + 15, + 1, + 34, + 11, + 51, + 2, + 16, + 15, + 30, + 13, + 12, + 21, + 13, + 36, + 6, + 7, + 15, + 3, + 3, + 11, + 19, + 21, + 11, + 10, + 7, + 1, + 30, + 1, + 23, + 35, + 2, + 3, + 6, + 0, + 6, + 21, + 32, + 26, + 16, + 5, + 4, + 21, + 23, + 13, + 26, + 13, + 13, + 18, + 16, + 29, + 7, + 31, + 18, + 5, + 18, + 23, + 8, + 11, + 3, + 13 + ], + "weighted_loads": [ + 0.6043137945234776, + 1.6326404921710491, + 0.697418961673975, + 0.5280347783118486, + 0.6232936661690474, + 0.044180549681186676, + 2.318457920104265, + 0.6391557492315769, + 3.5609644521027803, + 0.07356510311365128, + 0.8419529031962156, + 1.079884273931384, + 2.167099829763174, + 0.8155321031808853, + 0.7202750742435455, + 0.9836629219353199, + 0.47694075107574463, + 1.9983114823698997, + 0.27521192096173763, + 0.23981621861457825, + 0.7899464871734381, + 0.1831762231886387, + 0.11709991097450256, + 0.41224339976906776, + 1.5117442049086094, + 1.6627505235373974, + 0.7826534956693649, + 0.521396666765213, + 0.3449033237993717, + 0.05267208069562912, + 1.34411258995533, + 0.05776247754693031, + 2.151960264891386, + 2.1228642594069242, + 0.12202453054487705, + 0.16761144250631332, + 0.19400516897439957, + 0.0, + 0.39311211183667183, + 1.037246429361403, + 1.3669862411916256, + 1.0813063737004995, + 0.9006850458681583, + 0.19745956733822823, + 0.1390742752701044, + 1.6316494829952717, + 1.4485638029873371, + 1.005338003858924, + 1.755461510270834, + 0.6989317759871483, + 1.5348892249166965, + 1.764935303479433, + 1.2155441027134657, + 2.965611945837736, + 0.8106506168842316, + 2.026339467614889, + 0.7767405137419701, + 0.16203001700341702, + 0.9264929294586182, + 1.1674037631601095, + 0.3524829763919115, + 0.43936459720134735, + 0.14643215760588646, + 0.6775039359927177 + ], + "unique_experts": 63, + "load_cv": 0.6996551250438645, + "normalized_load_entropy": 0.9393553449756813, + "max_load_share": 0.052795031055900624 + } + }, + "s0_x": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "f62750fbd206d2e36f9cf069c5d226aaeb4f85f633cbe1e7adfa1b1a423fded8", + "route_weight_sha256": "e39c96b214982cace4401f8d3f9a09dd9379d04f03d8a0dafd4d0fa35cb2379c", + "loads": [ + 10, + 19, + 2, + 10, + 15, + 1, + 22, + 10, + 35, + 2, + 12, + 12, + 21, + 7, + 13, + 15, + 12, + 17, + 5, + 7, + 15, + 3, + 1, + 5, + 19, + 8, + 11, + 8, + 7, + 1, + 27, + 1, + 20, + 18, + 2, + 4, + 7, + 0, + 0, + 16, + 22, + 26, + 14, + 8, + 5, + 10, + 9, + 10, + 24, + 9, + 9, + 17, + 6, + 23, + 4, + 20, + 19, + 6, + 16, + 21, + 8, + 7, + 0, + 7 + ], + "weighted_loads": [ + 0.5536837354302406, + 1.2656077556312084, + 0.05305795185267925, + 0.4188569597899914, + 0.5953228883445263, + 0.040581174194812775, + 1.4228405058383942, + 0.594735587015748, + 2.5484581477940083, + 0.07344432920217514, + 0.6417033355683088, + 0.9586681239306927, + 1.6670535076409578, + 0.388256948441267, + 0.760140735656023, + 0.7040941156446934, + 0.44409552961587906, + 0.8377669900655746, + 0.22610127553343773, + 0.2420796938240528, + 0.7551651932299137, + 0.17900509387254715, + 0.03840840607881546, + 0.1614396870136261, + 1.3943525403738022, + 0.4292895719408989, + 0.7932655550539494, + 0.38458809442818165, + 0.3371039740741253, + 0.052330851554870605, + 1.2100908607244492, + 0.058381855487823486, + 2.056316899135709, + 0.7856856882572174, + 0.1302772369235754, + 0.20724767073988914, + 0.226254403591156, + 0.0, + 0.0, + 0.8620954863727093, + 0.862022852525115, + 1.1058945506811142, + 0.7542847879230976, + 0.31395305693149567, + 0.17019023932516575, + 0.6214958652853966, + 0.5049198269844055, + 0.8915414158254862, + 1.4874719642102718, + 0.3982769213616848, + 1.312525425106287, + 1.6039952635765076, + 0.6621424686163664, + 2.332087118178606, + 0.14101442508399487, + 1.307420652359724, + 0.7759030554443598, + 0.20008298009634018, + 0.8052244931459427, + 1.0650416184216738, + 0.3533948343247175, + 0.2459210306406021, + 0.0, + 0.3321162723004818 + ], + "unique_experts": 61, + "load_cv": 0.6913932971601798, + "normalized_load_entropy": 0.9374243973469297, + "max_load_share": 0.04861111111111111 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "a3ba1307f79c8ca19f0a1416c3d4f9c4326bb61d39bbfa1fa07b25c873780f31", + "route_weight_sha256": "3a1bb30d84d0ec045280ca46cd9b7a2766e52f5a058539ff806380c335ca2c5e", + "loads": [ + 10, + 26, + 4, + 10, + 16, + 1, + 28, + 11, + 46, + 2, + 13, + 15, + 28, + 14, + 13, + 16, + 12, + 20, + 5, + 7, + 15, + 3, + 3, + 5, + 19, + 22, + 11, + 8, + 7, + 1, + 29, + 1, + 26, + 33, + 2, + 4, + 7, + 0, + 0, + 21, + 26, + 26, + 14, + 8, + 5, + 16, + 16, + 13, + 24, + 13, + 12, + 17, + 17, + 23, + 6, + 28, + 19, + 6, + 19, + 21, + 8, + 7, + 2, + 10 + ], + "weighted_loads": [ + 0.5536837354302406, + 1.6858522985130548, + 0.10745498724281788, + 0.4188569597899914, + 0.6554407216608524, + 0.040581174194812775, + 1.8377646543085575, + 0.639712842181325, + 3.4030008167028427, + 0.07344432920217514, + 0.68472502194345, + 1.0501712281256914, + 2.047049703076482, + 0.9020306766033173, + 0.760140735656023, + 0.742150716483593, + 0.44409552961587906, + 0.9777696058154106, + 0.22610127553343773, + 0.2420796938240528, + 0.7551651932299137, + 0.17900509387254715, + 0.11121412739157677, + 0.1614396870136261, + 1.3943525403738022, + 1.4163604639470577, + 0.7932655550539494, + 0.38458809442818165, + 0.3371039740741253, + 0.052330851554870605, + 1.267183143645525, + 0.058381855487823486, + 2.33677732758224, + 1.7976859007030725, + 0.1302772369235754, + 0.20724767073988914, + 0.226254403591156, + 0.0, + 0.0, + 1.0236859442666173, + 1.1044487860053778, + 1.1058945506811142, + 0.7542847879230976, + 0.31395305693149567, + 0.17019023932516575, + 1.0912690572440624, + 1.1150876805186272, + 1.0031252317130566, + 1.4874719642102718, + 0.6206794120371342, + 1.4962171204388142, + 1.6039952635765076, + 1.3223490044474602, + 2.332087118178606, + 0.7648913972079754, + 1.8413844387978315, + 0.7759030554443598, + 0.20008298009634018, + 0.9193641841411591, + 1.0650416184216738, + 0.3533948343247175, + 0.2459210306406021, + 0.08859531953930855, + 0.5382912717759609 + ], + "unique_experts": 62, + "load_cv": 0.6990584990143954, + "normalized_load_entropy": 0.9377644199478518, + "max_load_share": 0.052873563218390804 + } + }, + "s1_x": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "54eb0c543d5317d8f38d733583e1e4a53ccc235cf17908532e83ea78c7e7fa04", + "route_weight_sha256": "37c50ffc685f9a659672b1c473fc1fa41792328443389c67efd95bae12cc510f", + "loads": [ + 11, + 21, + 2, + 10, + 13, + 0, + 23, + 12, + 38, + 2, + 11, + 12, + 21, + 7, + 12, + 18, + 9, + 16, + 6, + 4, + 14, + 3, + 2, + 5, + 19, + 9, + 11, + 9, + 6, + 1, + 25, + 1, + 21, + 13, + 2, + 4, + 8, + 0, + 2, + 17, + 24, + 27, + 14, + 7, + 3, + 8, + 8, + 10, + 23, + 9, + 9, + 18, + 5, + 23, + 5, + 21, + 20, + 5, + 16, + 22, + 9, + 7, + 0, + 7 + ], + "weighted_loads": [ + 0.5740311425179243, + 1.2869307938963175, + 0.07695655524730682, + 0.42017555609345436, + 0.5343309696763754, + 0.0, + 1.4485970959067345, + 0.666967598721385, + 2.7327770944684744, + 0.07323824986815453, + 0.6020282581448555, + 0.9442692305892706, + 1.6575264520943165, + 0.42551374807953835, + 0.7156622782349586, + 0.8455773293972015, + 0.33513022772967815, + 0.7511095479130745, + 0.26831694319844246, + 0.15058939345180988, + 0.7171769253909588, + 0.1876627914607525, + 0.07770891487598419, + 0.15929980762302876, + 1.438373539596796, + 0.4674205780029297, + 0.7873468212783337, + 0.43985507264733315, + 0.31318874284625053, + 0.052847977727651596, + 1.1364698223769665, + 0.059479132294654846, + 2.096104806289077, + 0.5718058999627829, + 0.12244253791868687, + 0.20601384714245796, + 0.2629880551248789, + 0.0, + 0.07426363602280617, + 0.913414865732193, + 0.9370520431548357, + 1.1591409239917994, + 0.7234818786382675, + 0.2723489813506603, + 0.09731223247945309, + 0.528527207672596, + 0.4399648979306221, + 0.8892729226499796, + 1.4433755576610565, + 0.39690883457660675, + 1.3103487566113472, + 1.6964237783104181, + 0.6116419248282909, + 2.2853860296308994, + 0.17051566764712334, + 1.3569341152906418, + 0.8381921220570803, + 0.16314531676471233, + 0.8135093562304974, + 1.1201655250042677, + 0.3969281781464815, + 0.25233427435159683, + 0.0, + 0.3245416320860386 + ], + "unique_experts": 61, + "load_cv": 0.7168173829461916, + "normalized_load_entropy": 0.934960330739456, + "max_load_share": 0.05277777777777778 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "68433fcead45313d7d88bc23732fbc303f98cd7a1fe7c8f6b225b3bb26537bfe", + "route_weight_sha256": "22d67b7a1a69ce8ddd1883d3d0c2827917ce361a9eb5dbdc6506ed9a07204ed3", + "loads": [ + 12, + 28, + 13, + 12, + 13, + 1, + 35, + 13, + 54, + 2, + 15, + 16, + 30, + 16, + 12, + 19, + 9, + 30, + 8, + 4, + 14, + 3, + 3, + 9, + 19, + 24, + 11, + 11, + 6, + 1, + 26, + 1, + 25, + 30, + 2, + 4, + 8, + 0, + 8, + 21, + 35, + 27, + 16, + 7, + 3, + 20, + 21, + 13, + 26, + 16, + 14, + 18, + 14, + 29, + 7, + 31, + 20, + 5, + 18, + 23, + 9, + 11, + 3, + 12 + ], + "weighted_loads": [ + 0.6130412425845861, + 1.6502460036426783, + 0.7359639815986156, + 0.5261078104376793, + 0.5343309696763754, + 0.044180549681186676, + 2.359366152435541, + 0.7021016757935286, + 3.8268251921981573, + 0.07323824986815453, + 0.7936044223606586, + 1.0985218677669764, + 2.1937545463442802, + 1.0043497756123543, + 0.7156622782349586, + 0.8807665705680847, + 0.33513022772967815, + 1.7479492165148258, + 0.35211535543203354, + 0.15058939345180988, + 0.7171769253909588, + 0.1876627914607525, + 0.11761892959475517, + 0.34923495911061764, + 1.438373539596796, + 1.8436135798692703, + 0.7873468212783337, + 0.5599285960197449, + 0.31318874284625053, + 0.052847977727651596, + 1.1526714786887169, + 0.059479132294654846, + 2.246196875348687, + 1.692371467128396, + 0.12244253791868687, + 0.20601384714245796, + 0.2629880551248789, + 0.0, + 0.467375747859478, + 1.0251272423192859, + 1.4348721224814653, + 1.1591409239917994, + 0.8925745412707329, + 0.2723489813506603, + 0.09731223247945309, + 1.5275287739932537, + 1.3206777907907963, + 0.994705256074667, + 1.7575153410434723, + 0.8228527754545212, + 1.610139161348343, + 1.6964237783104181, + 1.136072238907218, + 2.961363386362791, + 0.7940610460937023, + 2.0283991992473602, + 0.8381921220570803, + 0.16314531676471233, + 0.9128986299037933, + 1.1533152665942907, + 0.3969281781464815, + 0.44054847210645676, + 0.14987406134605408, + 0.6201131828129292 + ], + "unique_experts": 63, + "load_cv": 0.6958216051186416, + "normalized_load_entropy": 0.9403309825902164, + "max_load_share": 0.055900621118012424 + } + }, + "s0_period": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "ef37216305ccd2c4627a8e4c7e4067e5ec6eb87a51976da0b49252c069f81ff0", + "route_weight_sha256": "d6b250735199a98d919f6fd74ed29c22b5bd351401f24a49a0a5ac516a5bd17b", + "loads": [ + 10, + 19, + 1, + 9, + 13, + 1, + 23, + 10, + 36, + 1, + 12, + 12, + 21, + 7, + 14, + 16, + 11, + 19, + 5, + 6, + 15, + 3, + 1, + 5, + 19, + 8, + 11, + 8, + 7, + 1, + 27, + 1, + 20, + 18, + 2, + 4, + 9, + 0, + 1, + 16, + 22, + 26, + 14, + 8, + 5, + 10, + 8, + 10, + 24, + 10, + 9, + 17, + 5, + 24, + 4, + 20, + 16, + 7, + 16, + 22, + 7, + 7, + 0, + 7 + ], + "weighted_loads": [ + 0.5601838827133179, + 1.2657927237451077, + 0.026437966153025627, + 0.3777464907616377, + 0.5335948616266251, + 0.03999914601445198, + 1.4839471578598022, + 0.5919726584106684, + 2.505397230386734, + 0.04207644984126091, + 0.6502951271831989, + 0.9635506588965654, + 1.6810016985982656, + 0.39461902529001236, + 0.7985134236514568, + 0.7403686195611954, + 0.40246887132525444, + 0.9029645603150129, + 0.2216709554195404, + 0.2115374580025673, + 0.7581375278532505, + 0.1806378774344921, + 0.04140159860253334, + 0.16186237335205078, + 1.3989242278039455, + 0.43868498504161835, + 0.8002066351473331, + 0.3878981601446867, + 0.3415188789367676, + 0.052789848297834396, + 1.1815381608903408, + 0.05891604721546173, + 2.0530502926558256, + 0.7871186397969723, + 0.12791425175964832, + 0.21630793437361717, + 0.28931618109345436, + 0.0, + 0.038486674427986145, + 0.8418046347796917, + 0.8576560895889997, + 1.0869761500507593, + 0.762473039329052, + 0.3129259720444679, + 0.17376337572932243, + 0.637952771037817, + 0.4919612929224968, + 0.8884518295526505, + 1.4961459189653397, + 0.4148919489234686, + 1.3409585282206535, + 1.6863793395459652, + 0.6213635969907045, + 2.3776270784437656, + 0.13634059391915798, + 1.2985780872404575, + 0.6789147518575191, + 0.23045524582266808, + 0.7959383390843868, + 1.1057251188904047, + 0.31802913174033165, + 0.24197151511907578, + 0.0, + 0.3353332653641701 + ], + "unique_experts": 62, + "load_cv": 0.7034307462819739, + "normalized_load_entropy": 0.9360039634109194, + "max_load_share": 0.05 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "eb1f53dd5d341c6c4fa73d7f54e5eba6844b4f10022ee470dd83a0c8a68d8ae1", + "route_weight_sha256": "f26356f13001b72188816d5a0477ec1aba6ebdd6f10ded31828afd43ae098008", + "loads": [ + 10, + 25, + 2, + 9, + 14, + 1, + 31, + 11, + 47, + 1, + 13, + 15, + 28, + 15, + 14, + 16, + 11, + 22, + 5, + 6, + 15, + 3, + 3, + 5, + 19, + 23, + 11, + 8, + 7, + 1, + 29, + 1, + 25, + 33, + 2, + 4, + 9, + 0, + 1, + 20, + 25, + 26, + 14, + 8, + 5, + 16, + 16, + 13, + 24, + 15, + 11, + 17, + 16, + 24, + 6, + 28, + 16, + 7, + 19, + 22, + 7, + 7, + 2, + 11 + ], + "weighted_loads": [ + 0.5601838827133179, + 1.6334847677499056, + 0.03864179737865925, + 0.3777464907616377, + 0.5937126949429512, + 0.03999914601445198, + 2.051604811102152, + 0.6369499135762453, + 3.4062029123306274, + 0.04207644984126091, + 0.6941545307636261, + 1.0550537630915642, + 2.0609978940337896, + 0.9003564491868019, + 0.7985134236514568, + 0.7403686195611954, + 0.40246887132525444, + 1.0325224939733744, + 0.2216709554195404, + 0.2115374580025673, + 0.7581375278532505, + 0.1806378774344921, + 0.11420731991529465, + 0.16186237335205078, + 1.3989242278039455, + 1.462306622415781, + 0.8002066351473331, + 0.3878981601446867, + 0.3415188789367676, + 0.052789848297834396, + 1.2367039285600185, + 0.05891604721546173, + 2.298267086967826, + 1.8110673110932112, + 0.12791425175964832, + 0.21630793437361717, + 0.28931618109345436, + 0.0, + 0.038486674427986145, + 0.9634207049384713, + 1.0484195668250322, + 1.0869761500507593, + 0.762473039329052, + 0.3129259720444679, + 0.17376337572932243, + 1.1109494641423225, + 1.1583654060959816, + 1.0000356454402208, + 1.4961459189653397, + 0.6691294331103563, + 1.4703104458749294, + 1.6863793395459652, + 1.2815701328217983, + 2.3776270784437656, + 0.7602175660431385, + 1.8182833176106215, + 0.6789147518575191, + 0.23045524582266808, + 0.9100780300796032, + 1.1057251188904047, + 0.31802913174033165, + 0.24197151511907578, + 0.0861828364431858, + 0.6646069586277008 + ], + "unique_experts": 63, + "load_cv": 0.7091460330438253, + "normalized_load_entropy": 0.9365914029903857, + "max_load_share": 0.054022988505747126 + } + }, + "s1_period": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "f45da48db5b8020ce8122c40680607bd2d1b190a1807ddc39c16ce8b0204b038", + "route_weight_sha256": "23b34bb16c74097b60628f4d48af1a4fc7ae95d8a0b0d1a6cfca029d062a6f71", + "loads": [ + 11, + 20, + 2, + 11, + 13, + 0, + 23, + 12, + 37, + 2, + 11, + 11, + 21, + 7, + 12, + 18, + 10, + 18, + 6, + 6, + 14, + 3, + 2, + 5, + 19, + 8, + 11, + 9, + 6, + 1, + 26, + 1, + 21, + 12, + 2, + 4, + 7, + 0, + 1, + 17, + 22, + 29, + 14, + 6, + 5, + 7, + 8, + 9, + 23, + 8, + 9, + 19, + 6, + 23, + 3, + 21, + 20, + 5, + 18, + 22, + 9, + 7, + 0, + 7 + ], + "weighted_loads": [ + 0.5777442324906588, + 1.2563836853951216, + 0.07633663713932037, + 0.45116740092635155, + 0.5323534775525331, + 0.0, + 1.4533565826714039, + 0.6629728730767965, + 2.623196518048644, + 0.07380656152963638, + 0.6093758195638657, + 0.9099423438310623, + 1.6613509617745876, + 0.4242747873067856, + 0.710609957575798, + 0.845497377216816, + 0.36637409776449203, + 0.8143514432013035, + 0.2694032471626997, + 0.2103890161961317, + 0.7308641001582146, + 0.1862798072397709, + 0.077842116355896, + 0.15936910919845104, + 1.4568378739058971, + 0.42802098393440247, + 0.790956400334835, + 0.44107132963836193, + 0.3166590966284275, + 0.0519210547208786, + 1.15495116263628, + 0.05999954044818878, + 2.0998556036502123, + 0.5375724229961634, + 0.12124983221292496, + 0.20911840349435806, + 0.23530622571706772, + 0.0, + 0.03948099911212921, + 0.9086990132927895, + 0.8669129330664873, + 1.2297056633979082, + 0.729758370667696, + 0.23189371451735497, + 0.17263111658394337, + 0.486892893910408, + 0.44285353273153305, + 0.8618432693183422, + 1.4558309391140938, + 0.3508754260838032, + 1.3201692551374435, + 1.741243302822113, + 0.637526098638773, + 2.288613513112068, + 0.10899754986166954, + 1.3211978040635586, + 0.831851901486516, + 0.16368094086647034, + 0.894907183945179, + 1.1232569627463818, + 0.39538073912262917, + 0.24843620136380196, + 0.0, + 0.3246392197906971 + ], + "unique_experts": 61, + "load_cv": 0.7212814385385546, + "normalized_load_entropy": 0.9339706027462161, + "max_load_share": 0.05138888888888889 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "cf7f74bf2505de80180fdc3e076c3d5d45e9be8cccaadce73f6b45656cbe35dc", + "route_weight_sha256": "9184ea4b64816765a42641f3a3cf19efa7269595fece9ce33d98885403938dc9", + "loads": [ + 12, + 26, + 12, + 13, + 13, + 1, + 36, + 13, + 52, + 2, + 15, + 14, + 30, + 14, + 12, + 19, + 10, + 33, + 8, + 6, + 16, + 3, + 3, + 9, + 19, + 23, + 11, + 11, + 6, + 1, + 27, + 1, + 24, + 28, + 2, + 4, + 7, + 0, + 7, + 21, + 33, + 29, + 16, + 6, + 5, + 19, + 23, + 12, + 26, + 16, + 13, + 19, + 15, + 29, + 5, + 32, + 20, + 5, + 20, + 23, + 9, + 11, + 3, + 13 + ], + "weighted_loads": [ + 0.6167543325573206, + 1.574782619252801, + 0.6980497278273106, + 0.5616152659058571, + 0.5323534775525331, + 0.044180549681186676, + 2.4531785026192665, + 0.6981069501489401, + 3.6947957407683134, + 0.07380656152963638, + 0.8043266721069813, + 1.026007954031229, + 2.1975790560245514, + 0.8664065934717655, + 0.710609957575798, + 0.8802029862999916, + 0.36637409776449203, + 1.861587904393673, + 0.354904031381011, + 0.2103890161961317, + 0.8164950869977474, + 0.1862798072397709, + 0.11775213107466698, + 0.3493042606860399, + 1.4568378739058971, + 1.7763772457838058, + 0.790956400334835, + 0.5611448530107737, + 0.3166590966284275, + 0.0519210547208786, + 1.1711528189480305, + 0.05999954044818878, + 2.2085157055407763, + 1.6191087905317545, + 0.12124983221292496, + 0.20911840349435806, + 0.23530622571706772, + 0.0, + 0.43259311094880104, + 1.0208041770383716, + 1.3776369150727987, + 1.2297056633979082, + 0.8988510333001614, + 0.23189371451735497, + 0.17263111658394337, + 1.492928970605135, + 1.4695151560008526, + 0.9672756027430296, + 1.7699707224965096, + 0.8411378152668476, + 1.5483452156186104, + 1.741243302822113, + 1.1619564127177, + 2.96459086984396, + 0.7325429283082485, + 2.007725842297077, + 0.831851901486516, + 0.16368094086647034, + 0.994296457618475, + 1.1564067043364048, + 0.39538073912262917, + 0.4366503991186619, + 0.14939885213971138, + 0.6954811774194241 + ], + "unique_experts": 63, + "load_cv": 0.6914710939030151, + "normalized_load_entropy": 0.940818025544429, + "max_load_share": 0.053830227743271224 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 120, + "ordered_topk_exact_tokens": 75, + "set_exact_tokens": 86, + "mean_set_jaccard": 0.9172619047619048, + "mean_token_weighted_tv": 0.016499956736030677, + "aggregate_load_tv": 0.03194444444444444 + }, + "system_bos": { + "tokens": 120, + "ordered_topk_exact_tokens": 67, + "set_exact_tokens": 84, + "mean_set_jaccard": 0.9125, + "mean_token_weighted_tv": 0.017949151092519364, + "aggregate_load_tv": 0.03472222222222222 + }, + "system_x": { + "tokens": 120, + "ordered_topk_exact_tokens": 58, + "set_exact_tokens": 73, + "mean_set_jaccard": 0.8831349206349207, + "mean_token_weighted_tv": 0.02254296694106112, + "aggregate_load_tv": 0.041666666666666664 + }, + "system_period": { + "tokens": 120, + "ordered_topk_exact_tokens": 62, + "set_exact_tokens": 75, + "mean_set_jaccard": 0.8875, + "mean_token_weighted_tv": 0.02236341123158733, + "aggregate_load_tv": 0.043055555555555555 + }, + "bos_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 66, + "set_exact_tokens": 79, + "mean_set_jaccard": 0.8970238095238096, + "mean_token_weighted_tv": 0.022032512763204674, + "aggregate_load_tv": 0.037500000000000006 + }, + "bos_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 58, + "set_exact_tokens": 73, + "mean_set_jaccard": 0.8773809523809525, + "mean_token_weighted_tv": 0.025866110731537145, + "aggregate_load_tv": 0.04166666666666667 + }, + "x_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 54, + "set_exact_tokens": 72, + "mean_set_jaccard": 0.8839285714285715, + "mean_token_weighted_tv": 0.024435573047958313, + "aggregate_load_tv": 0.03333333333333334 + }, + "x_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 46, + "set_exact_tokens": 64, + "mean_set_jaccard": 0.8613095238095239, + "mean_token_weighted_tv": 0.029424445043938856, + "aggregate_load_tv": 0.04722222222222222 + }, + "period_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 55, + "set_exact_tokens": 73, + "mean_set_jaccard": 0.8845238095238096, + "mean_token_weighted_tv": 0.02444870612428834, + "aggregate_load_tv": 0.03888888888888889 + }, + "period_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 50, + "set_exact_tokens": 67, + "mean_set_jaccard": 0.868452380952381, + "mean_token_weighted_tv": 0.02860531855064134, + "aggregate_load_tv": 0.04166666666666667 + } + } + }, + "layer_09": { + "layer": 9, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "92bd45a232aa7ac76dba7718fe98548a32b8d8da4e8ef3a5fb8f20a05c8ac2fe", + "route_weight_sha256": "c5f876a64ab72911bab180fe1e2444688b24aceb5e623582b9a6a85b912845c3", + "loads": [ + 13, + 18, + 6, + 8, + 16, + 7, + 13, + 17, + 19, + 9, + 14, + 17, + 3, + 20, + 14, + 12, + 6, + 12, + 2, + 26, + 4, + 1, + 1, + 1, + 2, + 10, + 13, + 18, + 18, + 15, + 1, + 13, + 3, + 10, + 15, + 12, + 8, + 3, + 27, + 4, + 3, + 12, + 16, + 32, + 13, + 21, + 9, + 2, + 10, + 19, + 16, + 2, + 15, + 20, + 2, + 9, + 15, + 0, + 13, + 25, + 1, + 10, + 4, + 20 + ], + "weighted_loads": [ + 0.6657900642603636, + 0.926325723528862, + 0.3512663245201111, + 0.3694457896053791, + 0.7946268506348133, + 0.40535986237227917, + 0.5038588419556618, + 0.7921665478497744, + 1.5834077410399914, + 0.4225398562848568, + 1.1819078251719475, + 1.0861361287534237, + 0.11579215154051781, + 0.826549306511879, + 0.650144312530756, + 0.602097399532795, + 0.3549831733107567, + 0.45749546959996223, + 0.08585963770747185, + 1.6088330075144768, + 0.11548996716737747, + 0.07635612785816193, + 0.03376730531454086, + 0.05991088226437569, + 0.07912052795290947, + 0.35190763138234615, + 0.9226830080151558, + 2.01966592669487, + 1.6328223776072264, + 0.5661914385855198, + 0.03279963880777359, + 0.6663977093994617, + 0.11242785677313805, + 0.6976176276803017, + 1.1569012627005577, + 0.6543800868093967, + 0.3331381678581238, + 0.18730155751109123, + 1.601607322692871, + 0.15342524647712708, + 0.10826109163463116, + 0.7386986315250397, + 1.113730339333415, + 1.7254265826195478, + 0.6222993358969688, + 1.355391513556242, + 0.6905876211822033, + 0.17121294885873795, + 0.6832228973507881, + 0.7641574814915657, + 0.5405473336577415, + 0.1970454566180706, + 0.7340607084333897, + 1.5187960863113403, + 0.13324831426143646, + 0.39017398841679096, + 1.1817156448960304, + 0.0, + 0.8650748804211617, + 1.4449156150221825, + 0.06512411683797836, + 0.7389000132679939, + 0.1743374541401863, + 1.408967986702919 + ], + "unique_experts": 63, + "load_cv": 0.6590303389483074, + "normalized_load_entropy": 0.9413036089606887, + "max_load_share": 0.044444444444444446 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "b71cb1206e897790f14010de0b940d3b250c558e0cc6454f52526cca2be5d889", + "route_weight_sha256": "1afa27ab891f7d97ed3fe77921dd8ba29c156c2147f4d2fd3625e79aaa65d6c8", + "loads": [ + 20, + 21, + 6, + 8, + 18, + 7, + 13, + 17, + 21, + 9, + 25, + 17, + 6, + 23, + 14, + 12, + 7, + 13, + 2, + 36, + 4, + 1, + 5, + 4, + 5, + 11, + 13, + 19, + 18, + 15, + 2, + 19, + 5, + 10, + 24, + 19, + 8, + 3, + 30, + 4, + 3, + 23, + 16, + 32, + 18, + 30, + 20, + 2, + 13, + 19, + 20, + 3, + 15, + 24, + 2, + 14, + 20, + 0, + 15, + 29, + 1, + 10, + 6, + 21 + ], + "weighted_loads": [ + 1.1581283751875162, + 1.182391382753849, + 0.3512663245201111, + 0.3694457896053791, + 1.0255965031683445, + 0.40535986237227917, + 0.5038588419556618, + 0.7921665478497744, + 1.6801472827792168, + 0.4225398562848568, + 2.3434418961405754, + 1.0861361287534237, + 0.16995796281844378, + 0.8923694929108024, + 0.650144312530756, + 0.602097399532795, + 0.39626896753907204, + 0.4997183158993721, + 0.08585963770747185, + 2.685870300978422, + 0.11548996716737747, + 0.07635612785816193, + 1.5682888366281986, + 0.31013699248433113, + 0.20805726572871208, + 0.4298958759754896, + 0.9226830080151558, + 2.0326723884791136, + 1.6328223776072264, + 0.5661914385855198, + 0.07219161838293076, + 0.8543204921297729, + 0.1487796395085752, + 0.6976176276803017, + 1.6495501920580864, + 1.1151056177914143, + 0.3331381678581238, + 0.18730155751109123, + 1.7293261997401714, + 0.15342524647712708, + 0.10826109163463116, + 1.7806280441582203, + 1.113730339333415, + 1.7254265826195478, + 0.9309645569883287, + 2.1027886904776096, + 1.5211567543447018, + 0.17121294885873795, + 0.8623712435364723, + 0.7641574814915657, + 0.7415740713477135, + 0.2306773103773594, + 0.7340607084333897, + 1.6731388475745916, + 0.13324831426143646, + 0.6405310165137053, + 1.4235882721841335, + 0.0, + 0.9882507845759392, + 1.6176698133349419, + 0.06512411683797836, + 0.7389000132679939, + 0.23039048165082932, + 1.4450827986001968 + ], + "unique_experts": 63, + "load_cv": 0.6458706502202742, + "normalized_load_entropy": 0.9445400917755146, + "max_load_share": 0.041379310344827586 + } + }, + "s1_eos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "c309cb713deeb1fbd6e53f800056d4146603337ee2c09b64e119b93fc66cbb30", + "route_weight_sha256": "e15a2746ec7d4b10de981f91226c8a34f562c045ca759c67a5d49f1e5193580f", + "loads": [ + 11, + 17, + 5, + 9, + 17, + 7, + 11, + 17, + 19, + 9, + 16, + 17, + 3, + 20, + 13, + 11, + 6, + 14, + 2, + 26, + 3, + 1, + 1, + 1, + 4, + 14, + 13, + 18, + 16, + 16, + 2, + 13, + 4, + 10, + 16, + 13, + 7, + 3, + 28, + 4, + 3, + 12, + 13, + 32, + 14, + 22, + 10, + 2, + 10, + 20, + 12, + 2, + 15, + 20, + 1, + 7, + 14, + 0, + 13, + 25, + 1, + 10, + 4, + 21 + ], + "weighted_loads": [ + 0.6016185507178307, + 0.890912938863039, + 0.3153868578374386, + 0.39995647966861725, + 0.8455821685492992, + 0.4090630505234003, + 0.44519490748643875, + 0.8030597381293774, + 1.5818969793617725, + 0.417493000626564, + 1.247602453455329, + 1.0734102614223957, + 0.11222166568040848, + 0.8306574076414108, + 0.6384571678936481, + 0.5322441570460796, + 0.3489675968885422, + 0.5319134201854467, + 0.08574669435620308, + 1.580694392323494, + 0.09137000143527985, + 0.07469610124826431, + 0.03218501806259155, + 0.06133885681629181, + 0.1517893522977829, + 0.48473722115159035, + 0.9273722507059574, + 1.9952836818993092, + 1.519141085445881, + 0.5934356842190027, + 0.07006971165537834, + 0.6661835499107838, + 0.14183964021503925, + 0.6943338252604008, + 1.1599014792591333, + 0.6862151324748993, + 0.29603248462080956, + 0.19022183120250702, + 1.668501727283001, + 0.15062889829277992, + 0.10570117086172104, + 0.7192185446619987, + 0.9574609436094761, + 1.844817940145731, + 0.700364850461483, + 1.4355555139482021, + 0.7067042738199234, + 0.1702999770641327, + 0.6751959025859833, + 0.8069481067359447, + 0.4178869239985943, + 0.20175861194729805, + 0.7446604445576668, + 1.5171849951148033, + 0.09181759506464005, + 0.31286329589784145, + 1.1548122391104698, + 0.0, + 0.8574981391429901, + 1.4411914385855198, + 0.06494119018316269, + 0.7466077618300915, + 0.1707073599100113, + 1.4621709138154984 + ], + "unique_experts": 63, + "load_cv": 0.66332495807108, + "normalized_load_entropy": 0.941241387098821, + "max_load_share": 0.044444444444444446 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "a29a7f9a417db414d4be1cf836ddce6193fe489ffa081913c3c3b627a42a6aec", + "route_weight_sha256": "3be71823911ef3fb8a417a4234256376c8c91c21a5f8f47e2ad862b21c060f0c", + "loads": [ + 22, + 22, + 5, + 9, + 19, + 7, + 11, + 17, + 26, + 11, + 27, + 19, + 6, + 23, + 14, + 11, + 7, + 15, + 2, + 36, + 3, + 4, + 5, + 12, + 9, + 22, + 17, + 19, + 22, + 16, + 4, + 18, + 6, + 13, + 22, + 26, + 7, + 6, + 33, + 5, + 9, + 28, + 15, + 32, + 19, + 36, + 30, + 2, + 17, + 25, + 14, + 3, + 15, + 23, + 2, + 12, + 19, + 0, + 18, + 29, + 1, + 11, + 6, + 22 + ], + "weighted_loads": [ + 1.3173558451235294, + 1.2177711725234985, + 0.3153868578374386, + 0.39995647966861725, + 1.1019446663558483, + 0.4090630505234003, + 0.44519490748643875, + 0.8030597381293774, + 2.0002835616469383, + 0.5091408155858517, + 2.3343795258551836, + 1.169763457030058, + 0.16640874417498708, + 0.8856509367469698, + 0.6775803342461586, + 0.5322441570460796, + 0.395061980932951, + 0.5881210919469595, + 0.08574669435620308, + 2.7147715389728546, + 0.09137000143527985, + 0.20169567316770554, + 1.5657949931919575, + 0.8910573236644268, + 0.3404557667672634, + 0.9054024387151003, + 1.1825860999524593, + 2.0082901436835527, + 1.9404701255261898, + 0.5934356842190027, + 0.20763446390628815, + 0.814933521207422, + 0.18360683228820562, + 0.9168358519673347, + 1.457435367628932, + 1.5047839730978012, + 0.29603248462080956, + 0.3327501751482487, + 1.9229116663336754, + 0.21912937983870506, + 0.507123026996851, + 2.2514237724244595, + 1.0499145612120628, + 1.844817940145731, + 0.8828119616955519, + 2.5942575000226498, + 2.3538807183504105, + 0.1702999770641327, + 1.094025608152151, + 1.1355939991772175, + 0.5350702926516533, + 0.23490549996495247, + 0.7446604445576668, + 1.6657350063323975, + 0.13315699622035027, + 0.5545235015451908, + 1.3877316266298294, + 0.0, + 1.1363865733146667, + 1.6221013329923153, + 0.06494119018316269, + 0.7846008278429508, + 0.328158900141716, + 1.4981725625693798 + ], + "unique_experts": 63, + "load_cv": 0.6182646675626962, + "normalized_load_entropy": 0.9496012158920188, + "max_load_share": 0.037267080745341616 + } + }, + "s0_bos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "6321c15c6907644f68f1d6ce59129587d8079a3457f6baf47e706407de9d238b", + "route_weight_sha256": "fe44dfb0fc795b6fc55873e53acaa69507af6a979fe5f7d4c9b40caa0761ed8c", + "loads": [ + 11, + 19, + 5, + 9, + 16, + 10, + 14, + 16, + 19, + 9, + 17, + 19, + 2, + 20, + 15, + 10, + 8, + 13, + 2, + 25, + 5, + 1, + 1, + 2, + 3, + 5, + 14, + 18, + 17, + 11, + 2, + 11, + 4, + 10, + 15, + 13, + 6, + 3, + 24, + 2, + 3, + 11, + 18, + 32, + 16, + 21, + 11, + 2, + 10, + 20, + 13, + 2, + 15, + 18, + 2, + 7, + 16, + 0, + 13, + 27, + 3, + 10, + 4, + 20 + ], + "weighted_loads": [ + 0.5293778534978628, + 0.9697171859443188, + 0.3198116458952427, + 0.39211224392056465, + 0.7708967551589012, + 0.5041741393506527, + 0.5501188412308693, + 0.8066366128623486, + 1.5910489559173584, + 0.41994398832321167, + 1.2492910083383322, + 1.1675174050033092, + 0.07609857618808746, + 0.7937092185020447, + 0.7196085974574089, + 0.49377458542585373, + 0.40088164433836937, + 0.47403485141694546, + 0.091635562479496, + 1.5912007950246334, + 0.1531791966408491, + 0.0809064731001854, + 0.03527262434363365, + 0.10548781976103783, + 0.1125323511660099, + 0.1913079135119915, + 0.9486815482378006, + 2.0526588037610054, + 1.5944808833301067, + 0.4019370377063751, + 0.0739968866109848, + 0.5810054317116737, + 0.13948276080191135, + 0.700077474117279, + 1.1818061545491219, + 0.6709622405469418, + 0.26746273040771484, + 0.19662293046712875, + 1.5684966817498207, + 0.08761641383171082, + 0.11192431300878525, + 0.7442911267280579, + 1.2051304541528225, + 1.7688375040888786, + 0.7928092274814844, + 1.3785107657313347, + 0.7977881617844105, + 0.1704847663640976, + 0.6611348949372768, + 0.8015875294804573, + 0.4649526569992304, + 0.20358402281999588, + 0.7578152269124985, + 1.4141715541481972, + 0.13818096742033958, + 0.28263523802161217, + 1.2083500660955906, + 0.0, + 0.8628344237804413, + 1.5477877613157034, + 0.1342126466333866, + 0.7584805302321911, + 0.18251339346170425, + 1.4070353023707867 + ], + "unique_experts": 63, + "load_cv": 0.6562143582325956, + "normalized_load_entropy": 0.9427102895531463, + "max_load_share": 0.044444444444444446 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "221a6e3e2ce63375c4f6d4aa971d9671e8731f2efd6e5e5c1c44c815f22b1670", + "route_weight_sha256": "1ef828cd86294581043468744842fe7f56941af25a1967217ecdd8be5c4f4500", + "loads": [ + 19, + 22, + 5, + 9, + 19, + 10, + 14, + 16, + 21, + 9, + 28, + 19, + 4, + 24, + 15, + 10, + 9, + 17, + 2, + 35, + 5, + 1, + 4, + 5, + 6, + 6, + 14, + 19, + 17, + 11, + 3, + 16, + 4, + 10, + 24, + 20, + 6, + 3, + 26, + 3, + 3, + 21, + 18, + 32, + 19, + 30, + 22, + 2, + 13, + 20, + 19, + 3, + 15, + 22, + 2, + 12, + 21, + 0, + 15, + 31, + 3, + 10, + 6, + 21 + ], + "weighted_loads": [ + 1.0676460545510054, + 1.2162982858717442, + 0.3198116458952427, + 0.39211224392056465, + 1.0711068958044052, + 0.5041741393506527, + 0.5501188412308693, + 0.8066366128623486, + 1.6877884976565838, + 0.41994398832321167, + 2.41082507930696, + 1.1675174050033092, + 0.1228473037481308, + 0.962944864295423, + 0.7196085974574089, + 0.49377458542585373, + 0.4421674385666847, + 0.63268724642694, + 0.091635562479496, + 2.6393310874700546, + 0.1531791966408491, + 0.0809064731001854, + 0.6390511766076088, + 0.3965652398765087, + 0.24146908894181252, + 0.26929615810513496, + 0.9486815482378006, + 2.065665265545249, + 1.5944808833301067, + 0.4019370377063751, + 0.11338886618614197, + 0.766206075437367, + 0.13948276080191135, + 0.700077474117279, + 1.6744550839066505, + 1.1304963938891888, + 0.26746273040771484, + 0.19662293046712875, + 1.652040921151638, + 0.13309121131896973, + 0.11192431300878525, + 1.7457353994250298, + 1.2051304541528225, + 1.7688375040888786, + 1.0476703299209476, + 2.28891284763813, + 1.5879560373723507, + 0.1704847663640976, + 0.8364750854671001, + 0.8015875294804573, + 0.7468490339815617, + 0.23721587657928467, + 0.7578152269124985, + 1.575668090954423, + 0.13818096742033958, + 0.5380104556679726, + 1.4502226933836937, + 0.0, + 0.9773132838308811, + 1.7205419596284628, + 0.1342126466333866, + 0.7584805302321911, + 0.23856642097234726, + 1.4431501142680645 + ], + "unique_experts": 63, + "load_cv": 0.6482228722127269, + "normalized_load_entropy": 0.9445063473133402, + "max_load_share": 0.040229885057471264 + } + }, + "s1_bos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "3790ee6fb6274909bc5ee6d22aa285a5abf6872d9c22f624cf1be7d27c73aa18", + "route_weight_sha256": "d7ec882fbbfb5fe112d89270f34b6dd68608379906b1805590c76522a6eddfe5", + "loads": [ + 13, + 17, + 5, + 9, + 16, + 7, + 12, + 16, + 19, + 9, + 16, + 18, + 2, + 21, + 12, + 12, + 7, + 13, + 1, + 26, + 5, + 1, + 1, + 2, + 3, + 8, + 14, + 18, + 17, + 18, + 4, + 12, + 3, + 10, + 15, + 13, + 7, + 3, + 26, + 2, + 2, + 12, + 15, + 31, + 17, + 21, + 10, + 2, + 10, + 17, + 12, + 2, + 15, + 19, + 2, + 8, + 17, + 0, + 12, + 27, + 2, + 10, + 4, + 20 + ], + "weighted_loads": [ + 0.6333419103175402, + 0.8863617926836014, + 0.3223481625318527, + 0.37873586639761925, + 0.7835033349692822, + 0.41529903560876846, + 0.48613737151026726, + 0.7817941717803478, + 1.5947282165288925, + 0.4108522869646549, + 1.2562137376517057, + 1.150969361886382, + 0.07576383650302887, + 0.8359442260116339, + 0.6073012463748455, + 0.5498151890933514, + 0.3654813580214977, + 0.46107758209109306, + 0.04992539435625076, + 1.6400650963187218, + 0.15348426066339016, + 0.081894651055336, + 0.03315316140651703, + 0.11765070632100105, + 0.1114945113658905, + 0.2876929473131895, + 0.976698387414217, + 1.9328144565224648, + 1.6199477892369032, + 0.6645965538918972, + 0.14174873009324074, + 0.614349689334631, + 0.11268247291445732, + 0.7072304338216782, + 1.1682330332696438, + 0.6620040275156498, + 0.302958857268095, + 0.191510371863842, + 1.669068604707718, + 0.08382632210850716, + 0.08340142294764519, + 0.7611945420503616, + 1.0719663575291634, + 1.758690919727087, + 0.8431258760392666, + 1.3493723664432764, + 0.7457055449485779, + 0.18282298743724823, + 0.6519331559538841, + 0.6675367131829262, + 0.4487764425575733, + 0.20687220618128777, + 0.772663164883852, + 1.4663150757551193, + 0.13962727412581444, + 0.2977920062839985, + 1.251806814223528, + 0.0, + 0.8095166012644768, + 1.5510291755199432, + 0.09764891117811203, + 0.7661875039339066, + 0.1788308247923851, + 1.4477500915527344 + ], + "unique_experts": 63, + "load_cv": 0.6571543592276109, + "normalized_load_entropy": 0.9420973772372332, + "max_load_share": 0.043055555555555555 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "1061e913060b30bbae015b090f1837385534c768e0ac3d1f14607070d33c18b6", + "route_weight_sha256": "4602ac4d7e72cdd6e85dd75332f1095624750c8c2ec5ad0f2f8f0209dfeffd0d", + "loads": [ + 25, + 22, + 5, + 9, + 19, + 7, + 12, + 16, + 26, + 11, + 27, + 20, + 4, + 25, + 13, + 12, + 8, + 17, + 1, + 36, + 5, + 4, + 4, + 13, + 8, + 16, + 18, + 19, + 23, + 18, + 6, + 16, + 3, + 13, + 21, + 25, + 7, + 6, + 30, + 4, + 8, + 27, + 17, + 31, + 20, + 35, + 30, + 2, + 17, + 22, + 16, + 3, + 15, + 23, + 3, + 13, + 22, + 0, + 17, + 31, + 2, + 11, + 6, + 21 + ], + "weighted_loads": [ + 1.4291541669517756, + 1.223837275058031, + 0.3223481625318527, + 0.37873586639761925, + 1.1092418991029263, + 0.41529903560876846, + 0.48613737151026726, + 0.7817941717803478, + 2.0131147988140583, + 0.5025001019239426, + 2.3429908100515604, + 1.2473225574940443, + 0.1230299100279808, + 0.9795808428898454, + 0.646424412727356, + 0.5498151890933514, + 0.4115757420659065, + 0.6398809589445591, + 0.04992539435625076, + 2.7918244525790215, + 0.15348426066339016, + 0.20889422297477722, + 0.6370001770555973, + 0.9636832885444164, + 0.300160925835371, + 0.7083581648766994, + 1.231912236660719, + 1.9458209183067083, + 2.041276829317212, + 0.6645965538918972, + 0.27931348234415054, + 0.7602881761267781, + 0.11268247291445732, + 0.9297324605286121, + 1.4657669216394424, + 1.4405397474765778, + 0.302958857268095, + 0.33403871580958366, + 1.8720044419169426, + 0.20378855615854263, + 0.4848232790827751, + 2.2637053206562996, + 1.16441997513175, + 1.758690919727087, + 0.972599727101624, + 2.68779026158154, + 2.37983388453722, + 0.18282298743724823, + 1.070900846272707, + 0.9961826056241989, + 0.6369658838957548, + 0.24001909419894218, + 0.772663164883852, + 1.6541652046144009, + 0.18096667528152466, + 0.5412259940057993, + 1.4847262017428875, + 0.0, + 1.0877138301730156, + 1.7319390699267387, + 0.09764891117811203, + 0.8041805699467659, + 0.3362823650240898, + 1.4837517403066158 + ], + "unique_experts": 63, + "load_cv": 0.6126930334143971, + "normalized_load_entropy": 0.9499644413189525, + "max_load_share": 0.037267080745341616 + } + }, + "s0_x": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "1750ccf5bda74e5ba3c1a313eb733d452195ab569c71183b192c43653d4508db", + "route_weight_sha256": "ae0af8e532a460c752a736f2ca719ff80b2055c2e386b8e27062c8b37a5a030a", + "loads": [ + 12, + 18, + 6, + 9, + 15, + 8, + 16, + 16, + 19, + 9, + 17, + 19, + 3, + 17, + 15, + 11, + 7, + 13, + 1, + 25, + 5, + 1, + 1, + 1, + 1, + 8, + 13, + 18, + 18, + 17, + 1, + 12, + 4, + 11, + 15, + 14, + 6, + 3, + 27, + 2, + 2, + 12, + 18, + 31, + 17, + 21, + 10, + 2, + 10, + 17, + 11, + 2, + 16, + 18, + 2, + 6, + 16, + 0, + 12, + 29, + 2, + 10, + 3, + 19 + ], + "weighted_loads": [ + 0.5952556356787682, + 0.9226542450487614, + 0.3574395552277565, + 0.3868655413389206, + 0.7220322117209435, + 0.43726792372763157, + 0.636429026722908, + 0.7920999713242054, + 1.6237532123923302, + 0.42012618109583855, + 1.2445018012076616, + 1.201033253222704, + 0.10317914560437202, + 0.6844351068139076, + 0.7059142850339413, + 0.5211168862879276, + 0.37184983119368553, + 0.4569144118577242, + 0.052718404680490494, + 1.575425397604704, + 0.15509813278913498, + 0.07973551005125046, + 0.03557513654232025, + 0.06722506135702133, + 0.03496566787362099, + 0.2972438745200634, + 0.8962553776800632, + 1.857240378856659, + 1.6702821552753448, + 0.6403122395277023, + 0.04065472632646561, + 0.632337860763073, + 0.1403644196689129, + 0.7531333230435848, + 1.1973931081593037, + 0.7510735839605331, + 0.26529448106884956, + 0.18808912485837936, + 1.7342492938041687, + 0.08088230900466442, + 0.08339589461684227, + 0.7971361801028252, + 1.2145826108753681, + 1.7151139490306377, + 0.8185875248163939, + 1.3923638612031937, + 0.7158110775053501, + 0.1747349426150322, + 0.6696249544620514, + 0.6775354221463203, + 0.4062041901051998, + 0.20933562517166138, + 0.806155439466238, + 1.4387789145112038, + 0.14065895229578018, + 0.232040137052536, + 1.235969990491867, + 0.0, + 0.8090492486953735, + 1.6261359322816133, + 0.09867789968848228, + 0.7888957001268864, + 0.14844191074371338, + 1.3702230527997017 + ], + "unique_experts": 63, + "load_cv": 0.6723829009069897, + "normalized_load_entropy": 0.9383705265369834, + "max_load_share": 0.043055555555555555 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "3e0ae9220d827a0a2994e3880d6405384cf6a5e462b0d6119ab456d5e6df0174", + "route_weight_sha256": "2331af5dc9020090a39bf8fa3ebb5e3b9e8456fad7d7c85969a672974f929125", + "loads": [ + 21, + 21, + 6, + 9, + 17, + 8, + 16, + 16, + 21, + 9, + 29, + 19, + 5, + 21, + 15, + 11, + 9, + 14, + 1, + 35, + 5, + 1, + 4, + 4, + 4, + 11, + 13, + 19, + 18, + 17, + 2, + 17, + 4, + 11, + 25, + 20, + 6, + 3, + 31, + 2, + 2, + 22, + 18, + 31, + 20, + 29, + 21, + 2, + 13, + 17, + 15, + 3, + 16, + 21, + 2, + 11, + 21, + 0, + 14, + 35, + 2, + 10, + 5, + 20 + ], + "weighted_loads": [ + 1.259742371737957, + 1.174412090331316, + 0.3574395552277565, + 0.3868655413389206, + 0.9530570209026337, + 0.43726792372763157, + 0.636429026722908, + 0.7920999713242054, + 1.7204927541315556, + 0.42012618109583855, + 2.5561769772320986, + 1.201033253222704, + 0.14992787316441536, + 0.8263723505660892, + 0.7059142850339413, + 0.5211168862879276, + 0.4499090686440468, + 0.49913725815713406, + 0.052718404680490494, + 2.6375206261873245, + 0.15509813278913498, + 0.07973551005125046, + 0.6393536888062954, + 0.3245912045240402, + 0.1639024056494236, + 0.4472471922636032, + 0.8962553776800632, + 1.8702468406409025, + 1.6702821552753448, + 0.6403122395277023, + 0.08004670590162277, + 0.8175385044887662, + 0.1403644196689129, + 0.7531333230435848, + 1.7856591679155827, + 1.1673237681388855, + 0.26529448106884956, + 0.18808912485837936, + 1.8975806832313538, + 0.08088230900466442, + 0.08339589461684227, + 1.7344573847949505, + 1.2145826108753681, + 1.7151139490306377, + 1.073448627255857, + 2.0455652475357056, + 1.4788586497306824, + 0.1747349426150322, + 0.8427290692925453, + 0.6775354221463203, + 0.6092466227710247, + 0.24296747893095016, + 0.806155439466238, + 1.557061156257987, + 0.14065895229578018, + 0.47883013635873795, + 1.4778426177799702, + 0.0, + 0.9286304526031017, + 1.877912050113082, + 0.09867789968848228, + 0.7888957001268864, + 0.20449493825435638, + 1.4063378646969795 + ], + "unique_experts": 63, + "load_cv": 0.6658536461427907, + "normalized_load_entropy": 0.9410698382810863, + "max_load_share": 0.040229885057471264 + } + }, + "s1_x": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "179e152c891bbb868a55ebd51b029e792dbd82f80d629850bd33b5910e0a8353", + "route_weight_sha256": "986a76dc8c3f7e80eb3d8480695a2ab902250c8100664d8c5434334793a32ba5", + "loads": [ + 12, + 17, + 6, + 8, + 15, + 7, + 15, + 17, + 20, + 9, + 15, + 18, + 5, + 16, + 15, + 10, + 6, + 13, + 1, + 25, + 1, + 1, + 3, + 1, + 3, + 11, + 14, + 18, + 19, + 19, + 3, + 11, + 3, + 10, + 15, + 13, + 5, + 3, + 26, + 2, + 2, + 12, + 16, + 32, + 14, + 22, + 10, + 2, + 10, + 17, + 12, + 2, + 16, + 20, + 2, + 7, + 18, + 0, + 13, + 30, + 1, + 10, + 3, + 18 + ], + "weighted_loads": [ + 0.6510833874344826, + 0.8705407232046127, + 0.3560949098318815, + 0.3490413762629032, + 0.724789634346962, + 0.4130619838833809, + 0.5993860810995102, + 0.8062133751809597, + 1.6913263201713562, + 0.4022817015647888, + 1.2381427772343159, + 1.1714711636304855, + 0.17237972281873226, + 0.6382873244583607, + 0.7166776061058044, + 0.4628919027745724, + 0.33300843834877014, + 0.440886776894331, + 0.050177931785583496, + 1.6158906817436218, + 0.027732040733098984, + 0.08337179571390152, + 0.09477553330361843, + 0.05772911757230759, + 0.11129098758101463, + 0.4142912570387125, + 0.959538746625185, + 1.8793648220598698, + 1.7149582970887423, + 0.7090374417603016, + 0.11086531914770603, + 0.5756295882165432, + 0.10792141407728195, + 0.7068304978311062, + 1.1924772001802921, + 0.7223685346543789, + 0.21908028796315193, + 0.18038053810596466, + 1.753288622945547, + 0.08373860828578472, + 0.08245041966438293, + 0.7222557626664639, + 1.1141209285706282, + 1.7587447725236416, + 0.7095290273427963, + 1.445271821692586, + 0.6446692980825901, + 0.18908379971981049, + 0.6723334975540638, + 0.6805666051805019, + 0.4568655826151371, + 0.19941042363643646, + 0.8101644143462181, + 1.5242429003119469, + 0.14258883148431778, + 0.2622070014476776, + 1.2972548082470894, + 0.0, + 0.8192293830215931, + 1.6626866981387138, + 0.06396038830280304, + 0.7739127166569233, + 0.14192982763051987, + 1.3626065514981747 + ], + "unique_experts": 63, + "load_cv": 0.6762277357645751, + "normalized_load_entropy": 0.9388230838844186, + "max_load_share": 0.044444444444444446 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "6caf7f33e71f490dffdfcaa7540e38e9dc7250827ef23c6b23e79dd3dfc9bd8e", + "route_weight_sha256": "face766ace518eb8c097d187d0b7cf9e156849c74e4ee63f1fdc93bddcc138ef", + "loads": [ + 25, + 22, + 6, + 8, + 17, + 7, + 15, + 17, + 27, + 11, + 27, + 20, + 7, + 18, + 16, + 10, + 8, + 16, + 1, + 36, + 1, + 4, + 7, + 12, + 8, + 21, + 19, + 19, + 25, + 19, + 6, + 15, + 3, + 13, + 22, + 25, + 5, + 6, + 31, + 4, + 8, + 27, + 18, + 32, + 17, + 33, + 28, + 2, + 17, + 22, + 14, + 3, + 16, + 22, + 3, + 12, + 23, + 0, + 19, + 35, + 1, + 11, + 5, + 19 + ], + "weighted_loads": [ + 1.539417453110218, + 1.189837820827961, + 0.3560949098318815, + 0.3490413762629032, + 1.0053938180208206, + 0.4130619838833809, + 0.5993860810995102, + 0.8062133751809597, + 2.109712902456522, + 0.49392951652407646, + 2.4838875830173492, + 1.2678243592381477, + 0.2196457963436842, + 0.6903902618214488, + 0.7558007724583149, + 0.4628919027745724, + 0.4196549952030182, + 0.5882039666175842, + 0.050177931785583496, + 2.726963821798563, + 0.027732040733098984, + 0.21037136763334274, + 0.7371448148041964, + 0.909505195915699, + 0.29995740205049515, + 0.9136255905032158, + 1.2617780342698097, + 1.8923712838441133, + 2.136287337169051, + 0.7090374417603016, + 0.29342578910291195, + 0.7215680750086904, + 0.10792141407728195, + 0.9293325245380402, + 1.5500669740140438, + 1.4894341491162777, + 0.21908028796315193, + 0.3229088820517063, + 2.0159958712756634, + 0.19580180384218693, + 0.48387227579951286, + 2.0934252850711346, + 1.206574546173215, + 1.7587447725236416, + 0.8390028784051538, + 2.3907191958278418, + 2.135943677276373, + 0.18908379971981049, + 1.09756600856781, + 1.0092124976217747, + 0.5799507834017277, + 0.23255731165409088, + 0.8101644143462181, + 1.6243103817105293, + 0.183928232640028, + 0.4999512378126383, + 1.530174195766449, + 0.0, + 1.141955677419901, + 1.8958355262875557, + 0.06396038830280304, + 0.8119057826697826, + 0.2993813678622246, + 1.3986082002520561 + ], + "unique_experts": 63, + "load_cv": 0.6205898375419943, + "normalized_load_entropy": 0.9481185505975407, + "max_load_share": 0.037267080745341616 + } + }, + "s0_period": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "0fda43121e2830e4c0d18f8439a574c078a050fd23380c73b361e2966a7235ae", + "route_weight_sha256": "113dbfb33652be56dbfc0dce00b97e84e893ddc0d75e8fe9b6978b216b6a5eff", + "loads": [ + 11, + 18, + 6, + 9, + 16, + 8, + 15, + 16, + 19, + 9, + 17, + 19, + 4, + 18, + 14, + 11, + 6, + 13, + 1, + 25, + 4, + 1, + 1, + 1, + 2, + 9, + 14, + 18, + 18, + 18, + 2, + 11, + 4, + 11, + 15, + 14, + 7, + 3, + 26, + 2, + 2, + 12, + 18, + 31, + 15, + 21, + 10, + 2, + 10, + 14, + 10, + 2, + 15, + 19, + 2, + 6, + 16, + 1, + 13, + 30, + 2, + 10, + 3, + 20 + ], + "weighted_loads": [ + 0.5495786722749472, + 0.9296263121068478, + 0.3547377437353134, + 0.37861650437116623, + 0.7565705813467503, + 0.4400934800505638, + 0.598192973062396, + 0.8002243675291538, + 1.6221531815826893, + 0.42160489782691, + 1.2612894270569086, + 1.223574049770832, + 0.13591271825134754, + 0.7206000965088606, + 0.6549200266599655, + 0.5207656919956207, + 0.3434615060687065, + 0.4527404624968767, + 0.05407118797302246, + 1.5921195801347494, + 0.12598645873367786, + 0.0800539031624794, + 0.03393777832388878, + 0.07290607690811157, + 0.06557321548461914, + 0.33686842396855354, + 0.9309365339577198, + 1.91190917044878, + 1.6929640360176563, + 0.6772331651300192, + 0.07150845602154732, + 0.5916714295744896, + 0.14054846949875355, + 0.7560604698956013, + 1.2085632123053074, + 0.7560886964201927, + 0.3103633150458336, + 0.19162620976567268, + 1.715477753430605, + 0.08317061886191368, + 0.08450185135006905, + 0.781864982098341, + 1.215219646692276, + 1.7096474207937717, + 0.7468426115810871, + 1.3820522800087929, + 0.7031660228967667, + 0.17559998482465744, + 0.670017272233963, + 0.5541731342673302, + 0.37173259630799294, + 0.21311656013131142, + 0.7666849829256535, + 1.4704939797520638, + 0.1413743793964386, + 0.2307375967502594, + 1.23415058106184, + 0.03565119951963425, + 0.8523116819560528, + 1.63294243440032, + 0.09977525472640991, + 0.8062536418437958, + 0.14866169542074203, + 1.4148946925997734 + ], + "unique_experts": 64, + "load_cv": 0.6670369342134949, + "normalized_load_entropy": 0.9410103600401438, + "max_load_share": 0.043055555555555555 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "1c9bc318e89ba2ae315884076b8ae52d95a88554ac1eb705178b48bcdf10fee0", + "route_weight_sha256": "f9a755a26e9878d01a897db234e3361ca9dc71f4546d3172e6d27965e9760c46", + "loads": [ + 21, + 21, + 6, + 9, + 18, + 8, + 15, + 16, + 21, + 9, + 29, + 19, + 6, + 22, + 14, + 11, + 7, + 15, + 1, + 35, + 4, + 1, + 4, + 4, + 5, + 10, + 14, + 19, + 18, + 18, + 3, + 16, + 4, + 11, + 25, + 20, + 7, + 3, + 29, + 2, + 2, + 23, + 18, + 31, + 18, + 29, + 22, + 2, + 13, + 14, + 14, + 3, + 15, + 22, + 2, + 11, + 22, + 1, + 15, + 35, + 2, + 10, + 5, + 21 + ], + "weighted_loads": [ + 1.218989847227931, + 1.1820166073739529, + 0.3547377437353134, + 0.37861650437116623, + 0.9869780503213406, + 0.4400934800505638, + 0.598192973062396, + 0.8002243675291538, + 1.7188927233219147, + 0.42160489782691, + 2.5187397096306086, + 1.223574049770832, + 0.18266144581139088, + 0.8619981678202748, + 0.6549200266599655, + 0.5207656919956207, + 0.38474730029702187, + 0.546839902177453, + 0.05407118797302246, + 2.6600292567163706, + 0.12598645873367786, + 0.0800539031624794, + 0.6377163305878639, + 0.3403965085744858, + 0.19450995326042175, + 0.414856668561697, + 0.9309365339577198, + 1.9249156322330236, + 1.6929640360176563, + 0.6772331651300192, + 0.11090043559670448, + 0.7768720733001828, + 0.14054846949875355, + 0.7560604698956013, + 1.7578995674848557, + 1.164707787334919, + 0.3103633150458336, + 0.19162620976567268, + 1.8420150727033615, + 0.08317061886191368, + 0.08450185135006905, + 1.755551241338253, + 1.215219646692276, + 1.7096474207937717, + 1.0017037140205503, + 2.0509942062199116, + 1.5895737409591675, + 0.17559998482465744, + 0.8448404781520367, + 0.5541731342673302, + 0.5719769038259983, + 0.2467484138906002, + 0.7666849829256535, + 1.581011550500989, + 0.1413743793964386, + 0.4849000722169876, + 1.5141356997191906, + 0.03565119951963425, + 0.9741277880966663, + 1.8459471762180328, + 0.09977525472640991, + 0.8062536418437958, + 0.20471472293138504, + 1.4510095044970512 + ], + "unique_experts": 64, + "load_cv": 0.6625437314343018, + "normalized_load_entropy": 0.9425846861899302, + "max_load_share": 0.040229885057471264 + } + }, + "s1_period": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "17949f1eac79f4ea71800876d662b757733944ce3bf319d98d6c8e2418b99a3e", + "route_weight_sha256": "b35ab012e1eb30cdd9cee835169f1c592f6255866eee2d52fd2083a8d187a6fb", + "loads": [ + 12, + 17, + 5, + 8, + 15, + 7, + 15, + 17, + 20, + 9, + 15, + 18, + 4, + 17, + 13, + 12, + 6, + 15, + 1, + 26, + 3, + 1, + 0, + 1, + 3, + 13, + 15, + 18, + 18, + 16, + 2, + 11, + 3, + 11, + 15, + 13, + 5, + 3, + 28, + 1, + 2, + 11, + 16, + 32, + 13, + 20, + 10, + 2, + 11, + 19, + 12, + 2, + 15, + 20, + 2, + 8, + 17, + 0, + 13, + 29, + 1, + 10, + 3, + 20 + ], + "weighted_loads": [ + 0.6403657793998718, + 0.8694925308227539, + 0.3179149255156517, + 0.3410208970308304, + 0.7229959666728973, + 0.41312504932284355, + 0.6032919753342867, + 0.805811770260334, + 1.68580961227417, + 0.40720657631754875, + 1.2233480289578438, + 1.183712176978588, + 0.1369348969310522, + 0.6668276656419039, + 0.6391120105981827, + 0.5262356698513031, + 0.33819566294550896, + 0.5262046866118908, + 0.04990383982658386, + 1.6502872966229916, + 0.08719441294670105, + 0.08385913819074631, + 0.0, + 0.0648307353258133, + 0.11067552119493484, + 0.46876565739512444, + 0.9910589568316936, + 1.8801710307598114, + 1.6924031153321266, + 0.6082120463252068, + 0.07000658102333546, + 0.5742583945393562, + 0.11077874526381493, + 0.7469312697649002, + 1.18375576287508, + 0.6946184486150742, + 0.21913336217403412, + 0.18408113718032837, + 1.8306723609566689, + 0.05193227156996727, + 0.08293734863400459, + 0.6620957404375076, + 1.1214369554072618, + 1.7659773621708155, + 0.66879827901721, + 1.354191705584526, + 0.6656902246177197, + 0.18976490944623947, + 0.72114622220397, + 0.7515596002340317, + 0.45459034480154514, + 0.19997307658195496, + 0.7789036128669977, + 1.5257739201188087, + 0.14405081793665886, + 0.2785336822271347, + 1.2525956146419048, + 0.0, + 0.8310831598937511, + 1.6228025909513235, + 0.06466890126466751, + 0.7810552790760994, + 0.14555634185671806, + 1.446292757987976 + ], + "unique_experts": 62, + "load_cv": 0.6842135252595846, + "normalized_load_entropy": 0.9360413231682507, + "max_load_share": 0.044444444444444446 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "1f422639981c53f08950de1b098e621523c80d0586fdce5152b5e460dcdf5586", + "route_weight_sha256": "78b704bdba77679e5fb41d786909f956f681f2c6137028c9c3049a01cee651c8", + "loads": [ + 24, + 22, + 5, + 8, + 18, + 7, + 15, + 17, + 27, + 11, + 27, + 20, + 6, + 19, + 14, + 12, + 7, + 18, + 1, + 36, + 3, + 4, + 4, + 12, + 8, + 24, + 19, + 19, + 24, + 16, + 5, + 15, + 3, + 14, + 21, + 25, + 5, + 6, + 33, + 2, + 8, + 27, + 18, + 32, + 16, + 31, + 30, + 2, + 18, + 24, + 14, + 3, + 15, + 23, + 3, + 13, + 23, + 0, + 19, + 33, + 1, + 11, + 5, + 21 + ], + "weighted_loads": [ + 1.4315803796052933, + 1.1868567541241646, + 0.3179149255156517, + 0.3410208970308304, + 1.033286351710558, + 0.41312504932284355, + 0.6032919753342867, + 0.805811770260334, + 2.1041961945593357, + 0.4988543912768364, + 2.380872283130884, + 1.2800653725862503, + 0.18420097045600414, + 0.718930603004992, + 0.6782351769506931, + 0.5262356698513031, + 0.38429004698991776, + 0.6723121218383312, + 0.04990383982658386, + 2.7517416290938854, + 0.08719441294670105, + 0.21085871011018753, + 0.6423777788877487, + 0.9108729436993599, + 0.29934193566441536, + 1.0051492545753717, + 1.2462728060781956, + 1.893177492544055, + 2.1137321554124355, + 0.6082120463252068, + 0.2527133282274008, + 0.7201968813315034, + 0.11077874526381493, + 0.9694332964718342, + 1.4812896512448788, + 1.4656540043652058, + 0.21913336217403412, + 0.32660948112607, + 2.104151863604784, + 0.12043275311589241, + 0.4843592047691345, + 2.1285313852131367, + 1.2138905730098486, + 1.7659773621708155, + 0.7982721300795674, + 2.2861604504287243, + 2.38990193977952, + 0.18976490944623947, + 1.1428925916552544, + 1.0802054926753044, + 0.5732230935245752, + 0.23311996459960938, + 0.7789036128669977, + 1.6767439804971218, + 0.18539021909236908, + 0.5180851016193628, + 1.5279408618807793, + 0.0, + 1.154641605913639, + 1.803712485358119, + 0.06466890126466751, + 0.8190483450889587, + 0.3030078820884228, + 1.4822944067418575 + ], + "unique_experts": 63, + "load_cv": 0.6286056614163902, + "normalized_load_entropy": 0.9465292524259744, + "max_load_share": 0.037267080745341616 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 120, + "ordered_topk_exact_tokens": 69, + "set_exact_tokens": 86, + "mean_set_jaccard": 0.9154761904761906, + "mean_token_weighted_tv": 0.016550664495055874, + "aggregate_load_tv": 0.03194444444444445 + }, + "system_bos": { + "tokens": 120, + "ordered_topk_exact_tokens": 62, + "set_exact_tokens": 77, + "mean_set_jaccard": 0.8976190476190476, + "mean_token_weighted_tv": 0.01998994325598081, + "aggregate_load_tv": 0.03749999999999999 + }, + "system_x": { + "tokens": 120, + "ordered_topk_exact_tokens": 54, + "set_exact_tokens": 78, + "mean_set_jaccard": 0.8928571428571429, + "mean_token_weighted_tv": 0.023069637183410426, + "aggregate_load_tv": 0.0375 + }, + "system_period": { + "tokens": 120, + "ordered_topk_exact_tokens": 56, + "set_exact_tokens": 76, + "mean_set_jaccard": 0.8880952380952382, + "mean_token_weighted_tv": 0.023303305132625005, + "aggregate_load_tv": 0.03888888888888889 + }, + "bos_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 51, + "set_exact_tokens": 72, + "mean_set_jaccard": 0.8714285714285716, + "mean_token_weighted_tv": 0.02572553892775128, + "aggregate_load_tv": 0.048611111111111105 + }, + "bos_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 51, + "set_exact_tokens": 73, + "mean_set_jaccard": 0.8791666666666667, + "mean_token_weighted_tv": 0.02514995405605684, + "aggregate_load_tv": 0.04027777777777777 + }, + "x_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 48, + "set_exact_tokens": 66, + "mean_set_jaccard": 0.8543650793650795, + "mean_token_weighted_tv": 0.02929321301635355, + "aggregate_load_tv": 0.04722222222222222 + }, + "x_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 42, + "set_exact_tokens": 60, + "mean_set_jaccard": 0.842857142857143, + "mean_token_weighted_tv": 0.032124717440456155, + "aggregate_load_tv": 0.05 + }, + "period_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 45, + "set_exact_tokens": 64, + "mean_set_jaccard": 0.8496031746031746, + "mean_token_weighted_tv": 0.029921440710313617, + "aggregate_load_tv": 0.04583333333333333 + }, + "period_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 40, + "set_exact_tokens": 64, + "mean_set_jaccard": 0.8523809523809524, + "mean_token_weighted_tv": 0.03097124109044671, + "aggregate_load_tv": 0.038888888888888896 + } + } + }, + "layer_10": { + "layer": 10, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "065d9b448e3af59483c1a0d084813e76dc08ec5cfb24670e2dce099a840ac5f0", + "route_weight_sha256": "ce9783bbbf0e8558f38aedf111513756e07efad0023b12e94d0d348c5bf1f710", + "loads": [ + 7, + 23, + 1, + 28, + 7, + 32, + 19, + 4, + 11, + 8, + 3, + 18, + 8, + 3, + 7, + 22, + 13, + 25, + 10, + 8, + 9, + 18, + 10, + 20, + 8, + 6, + 5, + 2, + 14, + 9, + 11, + 7, + 21, + 11, + 2, + 2, + 19, + 19, + 2, + 2, + 9, + 9, + 3, + 5, + 34, + 21, + 18, + 5, + 3, + 13, + 24, + 14, + 1, + 11, + 0, + 7, + 10, + 20, + 6, + 17, + 11, + 5, + 13, + 7 + ], + "weighted_loads": [ + 0.2535592205822468, + 0.9722528457641602, + 0.03997979685664177, + 1.5178150460124016, + 0.5503806471824646, + 1.3806208111345768, + 0.9791834428906441, + 0.1528918519616127, + 0.49289496429264545, + 0.3244841266423464, + 0.1081017255783081, + 1.2376256361603737, + 0.7495066300034523, + 0.21409210935235023, + 0.3200632706284523, + 0.9803856071084738, + 0.6679258998483419, + 1.2666774857789278, + 0.47984935343265533, + 0.4123043492436409, + 0.3299430012702942, + 1.2798309586942196, + 0.4768473953008652, + 0.9506368357688189, + 0.39669371396303177, + 0.40870557725429535, + 0.2371083851903677, + 0.1374814696609974, + 0.7893038876354694, + 0.5127038769423962, + 0.6091416403651237, + 0.27848209999501705, + 2.335686970502138, + 0.4833781458437443, + 0.1720568872988224, + 0.07743331417441368, + 1.2937452904880047, + 2.052098084241152, + 0.1749708354473114, + 0.096627376973629, + 0.5275411643087864, + 0.5577169191092253, + 0.1069328598678112, + 0.2207743190228939, + 2.436294350773096, + 1.1702631302177906, + 2.1802348122000694, + 0.1956120766699314, + 0.10423499718308449, + 0.7138329111039639, + 1.4161171726882458, + 0.9159834124147892, + 0.04928548261523247, + 0.5483192503452301, + 0.0, + 0.44440992176532745, + 0.41808267310261726, + 1.8440230041742325, + 0.24806115217506886, + 0.7372543253004551, + 0.713078323751688, + 0.6814296059310436, + 0.5088301580399275, + 0.3493609130382538 + ], + "unique_experts": 63, + "load_cv": 0.7051836290054414, + "normalized_load_entropy": 0.9399923495343567, + "max_load_share": 0.04722222222222222 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "8148b1a6661f30d0eee679621d7ef839570dc7da75a4f17139ac8c720a4a51ce", + "route_weight_sha256": "98a26e73a3fc0dd1b25a7c241fa7004e96c02883b77b9ac547ac49fd4d8e31ae", + "loads": [ + 7, + 23, + 3, + 28, + 7, + 32, + 19, + 9, + 11, + 10, + 5, + 20, + 9, + 6, + 9, + 22, + 13, + 29, + 17, + 10, + 13, + 20, + 11, + 20, + 8, + 8, + 5, + 9, + 15, + 10, + 14, + 8, + 21, + 19, + 3, + 3, + 19, + 19, + 2, + 2, + 9, + 17, + 7, + 7, + 41, + 24, + 23, + 8, + 3, + 14, + 26, + 20, + 1, + 14, + 0, + 16, + 10, + 26, + 6, + 27, + 16, + 17, + 13, + 7 + ], + "weighted_loads": [ + 0.2535592205822468, + 0.9722528457641602, + 0.059035553596913815, + 1.5178150460124016, + 0.5503806471824646, + 1.3806208111345768, + 0.9791834428906441, + 0.3659893460571766, + 0.49289496429264545, + 0.34895429480820894, + 0.20416731759905815, + 1.3334640711545944, + 0.7822304032742977, + 1.6299104802310467, + 0.4871406778693199, + 0.9803856071084738, + 0.6679258998483419, + 1.5035252925008535, + 0.8643911923281848, + 0.5123367235064507, + 0.49761804938316345, + 1.3587736152112484, + 0.480580969247967, + 0.9506368357688189, + 0.39669371396303177, + 0.4723534621298313, + 0.2371083851903677, + 0.8027979247272015, + 0.8359390869736671, + 0.5556457526981831, + 0.9241819903254509, + 0.2922585690394044, + 2.335686970502138, + 0.8499940186738968, + 0.2018810659646988, + 0.11430719122290611, + 1.2937452904880047, + 2.052098084241152, + 0.1749708354473114, + 0.096627376973629, + 0.5275411643087864, + 1.5160058420151472, + 0.22074027452617884, + 0.3174554109573364, + 2.9643914587795734, + 1.3124355301260948, + 2.4162478260695934, + 0.324493708088994, + 0.10423499718308449, + 0.7685703821480274, + 1.5118323266506195, + 1.2143676951527596, + 0.04928548261523247, + 0.7055294625461102, + 0.0, + 1.036309465765953, + 0.41808267310261726, + 2.1945447102189064, + 0.24806115217506886, + 1.3714143745601177, + 1.0217319503426552, + 1.7212154157459736, + 0.5088301580399275, + 0.3493609130382538 + ], + "unique_experts": 63, + "load_cv": 0.6237599668419265, + "normalized_load_entropy": 0.9517209808037461, + "max_load_share": 0.047126436781609195 + } + }, + "s1_eos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "c171964c41bbf7d4ebf8923cd88509c7b78dcd97d8b3e39debef24833d3358b8", + "route_weight_sha256": "305e513772bbd4c2f165846976d83c3091ba12cdd94ae75d7aa8296f0003ac07", + "loads": [ + 5, + 24, + 2, + 26, + 7, + 36, + 20, + 2, + 8, + 9, + 3, + 18, + 8, + 3, + 7, + 24, + 11, + 26, + 10, + 8, + 12, + 18, + 9, + 18, + 7, + 6, + 5, + 1, + 14, + 9, + 11, + 6, + 20, + 12, + 2, + 2, + 18, + 17, + 2, + 2, + 11, + 11, + 5, + 5, + 34, + 22, + 18, + 5, + 2, + 13, + 24, + 13, + 1, + 11, + 0, + 8, + 13, + 20, + 7, + 17, + 12, + 5, + 8, + 7 + ], + "weighted_loads": [ + 0.16696146503090858, + 1.0078513137996197, + 0.08725006878376007, + 1.4706732407212257, + 0.5444621630012989, + 1.523584559559822, + 1.0077878404408693, + 0.07718315348029137, + 0.399230744689703, + 0.35128484666347504, + 0.11060962453484535, + 1.2035868801176548, + 0.7429428435862064, + 0.1963716596364975, + 0.32595209032297134, + 1.0873943343758583, + 0.5898151509463787, + 1.2984691355377436, + 0.48015647381544113, + 0.41368263959884644, + 0.4572739191353321, + 1.2746359407901764, + 0.42018261924386024, + 0.8844334091991186, + 0.31771257892251015, + 0.4093197211623192, + 0.24249811470508575, + 0.10893358290195465, + 0.7919573970139027, + 0.5011837929487228, + 0.5973469205200672, + 0.25386480055749416, + 2.258319456130266, + 0.5331771895289421, + 0.16979211941361427, + 0.07937623932957649, + 1.3395483195781708, + 1.9661953449249268, + 0.1761149913072586, + 0.09522103145718575, + 0.6054071709513664, + 0.6431692540645599, + 0.18819237500429153, + 0.23299586027860641, + 2.437708668410778, + 1.1956692337989807, + 2.180184803903103, + 0.19919079542160034, + 0.06013736315071583, + 0.7140776999294758, + 1.3941712640225887, + 0.87120496109128, + 0.04636076092720032, + 0.5498806610703468, + 0.0, + 0.4737076684832573, + 0.5286872293800116, + 1.8419623468071222, + 0.27093468979001045, + 0.7397367935627699, + 0.7329041846096516, + 0.6940015070140362, + 0.33097259514033794, + 0.3456876054406166 + ], + "unique_experts": 63, + "load_cv": 0.7228202652129152, + "normalized_load_entropy": 0.9376420153206791, + "max_load_share": 0.05 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "39b8c79a1739aba6df8a872d51b2854d8292e446d91e071cbcb2001710d17018", + "route_weight_sha256": "1bfc8e8baf740362b6b29cd0655ea3e8a5a0a0ec1b781fc5a05e0088146a276b", + "loads": [ + 5, + 24, + 5, + 26, + 11, + 36, + 20, + 4, + 8, + 11, + 5, + 22, + 12, + 5, + 11, + 24, + 11, + 31, + 16, + 9, + 13, + 20, + 10, + 18, + 8, + 9, + 7, + 22, + 14, + 12, + 20, + 7, + 25, + 29, + 4, + 4, + 20, + 19, + 3, + 2, + 12, + 25, + 9, + 7, + 40, + 27, + 23, + 8, + 10, + 15, + 28, + 26, + 2, + 15, + 0, + 21, + 14, + 27, + 7, + 33, + 24, + 15, + 8, + 8 + ], + "weighted_loads": [ + 0.16696146503090858, + 1.0078513137996197, + 0.14680627407506108, + 1.4706732407212257, + 0.7457410506904125, + 1.523584559559822, + 1.0077878404408693, + 0.16232037916779518, + 0.399230744689703, + 0.37641247920691967, + 0.18883591145277023, + 1.4244822897017002, + 0.9437987878918648, + 1.5711447149515152, + 0.6067052967846394, + 1.0873943343758583, + 0.5898151509463787, + 1.5814251955598593, + 0.8437075112015009, + 0.44662007316946983, + 0.4980062209069729, + 1.360391404479742, + 0.4240839071571827, + 0.8844334091991186, + 0.3595953993499279, + 0.7354701701551676, + 0.3127704281359911, + 1.389110952615738, + 0.7919573970139027, + 0.6338776797056198, + 1.3490937538444996, + 0.2676412696018815, + 2.750533666461706, + 1.3698145188391209, + 0.31170593202114105, + 0.24181940406560898, + 1.4240738302469254, + 2.0538019984960556, + 0.2126562036573887, + 0.09522103145718575, + 0.647454846650362, + 1.9913369715213776, + 0.28568465542048216, + 0.3007472865283489, + 2.8955096416175365, + 1.4585342332720757, + 2.45974500477314, + 0.3221354205161333, + 0.7076008673757315, + 0.8465597368776798, + 1.632794488221407, + 1.6398929618299007, + 0.11580006033182144, + 0.745848223567009, + 0.0, + 1.3467758297920227, + 0.6019306313246489, + 2.2287865970283747, + 0.27093468979001045, + 1.7755771894007921, + 1.5024688467383385, + 1.6028145849704742, + 0.33097259514033794, + 0.3814663738012314 + ], + "unique_experts": 63, + "load_cv": 0.6160420608786877, + "normalized_load_entropy": 0.9525664732667097, + "max_load_share": 0.041407867494824016 + } + }, + "s0_bos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "1d165c5fce6efc4d85d3c58e3e03242dd430ad47372d9a167b1044b0f26cfc28", + "route_weight_sha256": "07a842cef6cc2aa69a26db890d195249c809c9d0adac4f66c24d8a9db6806c6f", + "loads": [ + 5, + 23, + 3, + 27, + 7, + 31, + 20, + 4, + 11, + 7, + 2, + 18, + 8, + 4, + 7, + 22, + 12, + 27, + 13, + 8, + 13, + 17, + 9, + 18, + 6, + 6, + 5, + 2, + 10, + 11, + 11, + 6, + 21, + 11, + 2, + 2, + 19, + 18, + 2, + 2, + 10, + 9, + 9, + 5, + 33, + 22, + 18, + 5, + 3, + 11, + 24, + 14, + 1, + 10, + 0, + 7, + 11, + 21, + 6, + 14, + 10, + 6, + 11, + 10 + ], + "weighted_loads": [ + 0.1809465978294611, + 0.9298131670802832, + 0.100428007543087, + 1.503192225471139, + 0.5619480833411217, + 1.3397501464933157, + 1.0333780609071255, + 0.16558773443102837, + 0.4897645618766546, + 0.2974516376852989, + 0.0739879459142685, + 1.2559936791658401, + 0.7597723305225372, + 0.2302718684077263, + 0.3018115274608135, + 0.9614923000335693, + 0.6670908536761999, + 1.2729365155100822, + 0.6159971207380295, + 0.38171927630901337, + 0.4901152867823839, + 1.2253490798175335, + 0.40123194828629494, + 0.8576942570507526, + 0.27395087108016014, + 0.3934663124382496, + 0.2454191204160452, + 0.13071460649371147, + 0.6392885521054268, + 0.5665699653327465, + 0.5977894775569439, + 0.25531037524342537, + 2.3336369395256042, + 0.5032217428088188, + 0.18701865151524544, + 0.08213008940219879, + 1.3627558127045631, + 2.2259350270032883, + 0.18274477869272232, + 0.08478748798370361, + 0.5996222458779812, + 0.6032543182373047, + 0.3331849128007889, + 0.2328062392771244, + 2.3624235205352306, + 1.2085875123739243, + 2.2146891728043556, + 0.19410013779997826, + 0.10547562874853611, + 0.6187869608402252, + 1.427755381911993, + 0.9165543727576733, + 0.04914812371134758, + 0.5046543143689632, + 0.0, + 0.4783884473145008, + 0.4702937249094248, + 1.9046353790909052, + 0.24777907133102417, + 0.6348494198173285, + 0.7013460770249367, + 0.6971669904887676, + 0.4178703762590885, + 0.4604642167687416 + ], + "unique_experts": 63, + "load_cv": 0.6896053621859066, + "normalized_load_entropy": 0.9429816034676924, + "max_load_share": 0.04583333333333333 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "1c83da7c7b08f77c0c691bd4d2eac20935048be84234ee5d9327e7d545034f6c", + "route_weight_sha256": "b0b3d1d474d9a90ec69f3d54b43bdcc82ab828039f1506ce6375edbb21363d63", + "loads": [ + 5, + 24, + 4, + 27, + 7, + 31, + 20, + 9, + 11, + 8, + 4, + 19, + 9, + 7, + 10, + 22, + 12, + 31, + 19, + 10, + 18, + 19, + 9, + 18, + 6, + 8, + 5, + 10, + 11, + 12, + 14, + 7, + 21, + 19, + 3, + 3, + 19, + 18, + 2, + 2, + 10, + 18, + 13, + 7, + 39, + 25, + 23, + 8, + 3, + 14, + 26, + 19, + 1, + 13, + 0, + 15, + 11, + 27, + 6, + 25, + 15, + 18, + 11, + 10 + ], + "weighted_loads": [ + 0.1809465978294611, + 0.9662500526756048, + 0.11458953283727169, + 1.503192225471139, + 0.5619480833411217, + 1.3397501464933157, + 1.0333780609071255, + 0.37868522852659225, + 0.4897645618766546, + 0.3136936388909817, + 0.17005353793501854, + 1.3041346929967403, + 0.7924961037933826, + 0.7763305269181728, + 0.5381529033184052, + 0.9614923000335693, + 0.6670908536761999, + 1.507317915558815, + 1.0173657648265362, + 0.48085685446858406, + 0.7293649259954691, + 1.3042917363345623, + 0.40123194828629494, + 0.8576942570507526, + 0.27395087108016014, + 0.45711419731378555, + 0.2454191204160452, + 0.9169310964643955, + 0.6859237514436245, + 0.6095118410885334, + 0.9076265059411526, + 0.2690868442878127, + 2.3336369395256042, + 0.8836901113390923, + 0.21684283018112183, + 0.11900396645069122, + 1.3627558127045631, + 2.2259350270032883, + 0.18274477869272232, + 0.08478748798370361, + 0.5996222458779812, + 1.724258627742529, + 0.48845134675502777, + 0.3294873312115669, + 2.8907494619488716, + 1.3507599122822285, + 2.4507021866738796, + 0.32551675848662853, + 0.10547562874853611, + 0.7848381511867046, + 1.5234705358743668, + 1.1547545082867146, + 0.04914812371134758, + 0.6610877625644207, + 0.0, + 1.029051348567009, + 0.4702937249094248, + 2.255157085135579, + 0.24777907133102417, + 1.313087111338973, + 1.016859844326973, + 1.7369528003036976, + 0.4178703762590885, + 0.4604642167687416 + ], + "unique_experts": 63, + "load_cv": 0.6161219755938091, + "normalized_load_entropy": 0.9523916730208063, + "max_load_share": 0.04482758620689655 + } + }, + "s1_bos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "9933c73858d7e55e99b93df4468e8a017fad21903955da5405cc1f353e283947", + "route_weight_sha256": "e659355a63b369291ef32e7cca8c8e616f1dff385891ce48d21b2383c9642891", + "loads": [ + 6, + 23, + 2, + 26, + 7, + 32, + 20, + 2, + 9, + 9, + 3, + 18, + 8, + 3, + 7, + 24, + 12, + 27, + 13, + 8, + 10, + 18, + 8, + 19, + 6, + 6, + 5, + 2, + 10, + 9, + 11, + 4, + 20, + 11, + 2, + 2, + 19, + 18, + 2, + 2, + 12, + 9, + 12, + 5, + 34, + 22, + 18, + 6, + 2, + 13, + 24, + 13, + 1, + 11, + 0, + 7, + 10, + 21, + 7, + 16, + 10, + 5, + 9, + 10 + ], + "weighted_loads": [ + 0.21872051246464252, + 0.9384906142950058, + 0.08439161628484726, + 1.497438918799162, + 0.581933680921793, + 1.3657173831015825, + 1.0542610175907612, + 0.08443955332040787, + 0.41413281485438347, + 0.35265905782580376, + 0.11428768932819366, + 1.2165056057274342, + 0.7598416656255722, + 0.18882757797837257, + 0.3100360222160816, + 1.0318380426615477, + 0.6356692165136337, + 1.294062901288271, + 0.5948132686316967, + 0.3951771855354309, + 0.39582501351833344, + 1.2504229843616486, + 0.3490409776568413, + 0.8927644062787294, + 0.26781097799539566, + 0.40981970354914665, + 0.25219267420470715, + 0.1122376099228859, + 0.6255532838404179, + 0.4983055591583252, + 0.5882265157997608, + 0.17810090258717537, + 2.314032431691885, + 0.5106280148029327, + 0.18224311992526054, + 0.08057207986712456, + 1.421998631209135, + 2.196517463773489, + 0.18641458451747894, + 0.0881979875266552, + 0.6653271988034248, + 0.5657763313502073, + 0.4471294581890106, + 0.2395481951534748, + 2.438440317288041, + 1.2082982417196035, + 2.2387039102613926, + 0.22967836260795593, + 0.06062944605946541, + 0.6830309592187405, + 1.42742919921875, + 0.882468406111002, + 0.053386181592941284, + 0.53238969668746, + 0.0, + 0.4593808837234974, + 0.4369723070412874, + 1.9021669961512089, + 0.28080414049327374, + 0.7067591827362776, + 0.683145996183157, + 0.6758088283240795, + 0.3155659791082144, + 0.4852784387767315 + ], + "unique_experts": 63, + "load_cv": 0.7067575063906334, + "normalized_load_entropy": 0.9398851933060067, + "max_load_share": 0.04722222222222222 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "288ab42b5d8f2f24d1fb05d1d002b80d929b73709c3551bf97191db1b5b77c65", + "route_weight_sha256": "9aa5d2b4f3fb0024b3b7a51a262b8ae66818b811ea8f5b1338875b8193c70b9f", + "loads": [ + 6, + 23, + 4, + 26, + 11, + 32, + 20, + 4, + 9, + 10, + 5, + 22, + 12, + 5, + 12, + 24, + 12, + 31, + 18, + 10, + 12, + 20, + 8, + 19, + 7, + 9, + 7, + 24, + 10, + 12, + 20, + 5, + 25, + 29, + 4, + 4, + 21, + 20, + 3, + 2, + 13, + 24, + 14, + 7, + 40, + 27, + 23, + 9, + 10, + 17, + 28, + 25, + 2, + 15, + 0, + 19, + 11, + 28, + 7, + 33, + 22, + 15, + 9, + 11 + ], + "weighted_loads": [ + 0.21872051246464252, + 0.9384906142950058, + 0.13896151818335056, + 1.497438918799162, + 0.7832125686109066, + 1.3657173831015825, + 1.0542610175907612, + 0.16957677900791168, + 0.41413281485438347, + 0.3689010590314865, + 0.19251397624611855, + 1.4438399150967598, + 0.9606976099312305, + 0.6971881538629532, + 0.6631039045751095, + 1.0318380426615477, + 0.6356692165136337, + 1.5169906318187714, + 0.9942831881344318, + 0.4755127914249897, + 0.4922102428972721, + 1.3361784480512142, + 0.3490409776568413, + 0.8927644062787294, + 0.3096937984228134, + 0.735970152541995, + 0.3224649876356125, + 1.462990153580904, + 0.6255532838404179, + 0.6309994459152222, + 1.3380926810204983, + 0.1918773716315627, + 2.806246642023325, + 1.3850515075027943, + 0.3241569325327873, + 0.24301524460315704, + 1.5065241418778896, + 2.284124117344618, + 0.22295579686760902, + 0.0881979875266552, + 0.7073748745024204, + 2.1710107941180468, + 0.4929491989314556, + 0.3072996214032173, + 2.9714323971420527, + 1.4711632411926985, + 2.5182641111314297, + 0.35627647303044796, + 0.708092950284481, + 0.9152664877474308, + 1.6571980603039265, + 1.5824473798274994, + 0.12282548099756241, + 0.7364790327847004, + 0.0, + 1.3222836814820766, + 0.5102157089859247, + 2.2889912463724613, + 0.28080414049327374, + 1.8121519405394793, + 1.4521217830479145, + 1.5846219062805176, + 0.3155659791082144, + 0.5210572071373463 + ], + "unique_experts": 63, + "load_cv": 0.6063920297276629, + "normalized_load_entropy": 0.9534150404869333, + "max_load_share": 0.041407867494824016 + } + }, + "s0_x": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "cb1ce89395032abc48fdbeffe5d0addbe3cee32ad30be1973654151d21a3cf47", + "route_weight_sha256": "ae9f2abf4e355ef6f2f59db1cb781d90d0068b92ea598c402e3fba657315732f", + "loads": [ + 6, + 23, + 3, + 26, + 7, + 33, + 20, + 1, + 11, + 7, + 2, + 17, + 8, + 2, + 7, + 22, + 12, + 27, + 12, + 7, + 10, + 18, + 9, + 18, + 6, + 6, + 5, + 2, + 8, + 11, + 11, + 5, + 20, + 10, + 2, + 2, + 19, + 19, + 2, + 2, + 12, + 11, + 10, + 4, + 34, + 22, + 18, + 5, + 3, + 11, + 24, + 15, + 1, + 11, + 0, + 7, + 10, + 23, + 7, + 14, + 11, + 5, + 13, + 11 + ], + "weighted_loads": [ + 0.22056472301483154, + 0.9022554010152817, + 0.09997809492051601, + 1.491751465946436, + 0.571097370237112, + 1.3753307685256004, + 1.0673796869814396, + 0.040890149772167206, + 0.4947369899600744, + 0.2791485246270895, + 0.07342537865042686, + 1.2173211053013802, + 0.7723062187433243, + 0.15946872904896736, + 0.3036934807896614, + 0.9421020355075598, + 0.6617115084081888, + 1.3902142494916916, + 0.5471578612923622, + 0.31780778616666794, + 0.3864726200699806, + 1.2957410775125027, + 0.3968469500541687, + 0.8346251007169485, + 0.28404463827610016, + 0.3932587318122387, + 0.24654166400432587, + 0.08327514305710793, + 0.5402143634855747, + 0.5682849325239658, + 0.6131734699010849, + 0.22129233367741108, + 2.321000013500452, + 0.44711481407284737, + 0.19063861668109894, + 0.07642194256186485, + 1.3478623628616333, + 2.316803615540266, + 0.1816776990890503, + 0.08470043167471886, + 0.6671677120029926, + 0.6201145742088556, + 0.37946995347738266, + 0.1752432957291603, + 2.4788531735539436, + 1.2040651626884937, + 2.207623939961195, + 0.1948011964559555, + 0.10645580850541592, + 0.6241294965147972, + 1.4653612822294235, + 0.9764039888978004, + 0.047759946435689926, + 0.5480578318238258, + 0.0, + 0.4768623784184456, + 0.4411768987774849, + 1.9795350022614002, + 0.285552728921175, + 0.6225956045091152, + 0.7651402577757835, + 0.6711609177291393, + 0.4938339125365019, + 0.49664992094039917 + ], + "unique_experts": 63, + "load_cv": 0.7114582486036498, + "normalized_load_entropy": 0.9387752936550275, + "max_load_share": 0.04722222222222222 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "121085bd68db3640d4f5d7a67548410035ffb30446714f3c9d699420d0407330", + "route_weight_sha256": "aefd01f308f688f175f5044bb98473b8c406e647ff7c0545136e79f5e7860ee0", + "loads": [ + 6, + 24, + 4, + 26, + 7, + 33, + 20, + 7, + 11, + 8, + 5, + 18, + 9, + 4, + 9, + 22, + 12, + 32, + 17, + 8, + 14, + 20, + 9, + 18, + 6, + 8, + 5, + 7, + 9, + 12, + 14, + 6, + 20, + 19, + 3, + 3, + 19, + 19, + 2, + 2, + 12, + 19, + 13, + 6, + 41, + 26, + 24, + 9, + 3, + 13, + 27, + 21, + 1, + 14, + 0, + 14, + 10, + 30, + 7, + 25, + 16, + 18, + 13, + 11 + ], + "weighted_loads": [ + 0.22056472301483154, + 0.9491251893341541, + 0.1141396202147007, + 1.491751465946436, + 0.571097370237112, + 1.3753307685256004, + 1.0673796869814396, + 0.2927985228598118, + 0.4947369899600744, + 0.29539052583277225, + 0.20221396535634995, + 1.2654621191322803, + 0.8050299920141697, + 0.663509901612997, + 0.48016345500946045, + 0.9421020355075598, + 0.6617115084081888, + 1.671269167214632, + 0.8852333910763264, + 0.38145142048597336, + 0.5541476681828499, + 1.3746837340295315, + 0.3968469500541687, + 0.8346251007169485, + 0.28404463827610016, + 0.45690661668777466, + 0.24654166400432587, + 0.6175654083490372, + 0.5868495628237724, + 0.6112268082797527, + 0.930482916533947, + 0.23506880272179842, + 2.321000013500452, + 0.8590892069041729, + 0.22046279534697533, + 0.11329581961035728, + 1.3478623628616333, + 2.316803615540266, + 0.1816776990890503, + 0.08470043167471886, + 0.6671677120029926, + 1.4479757379740477, + 0.4852035716176033, + 0.27192438766360283, + 3.033823747187853, + 1.415488213300705, + 2.492874074727297, + 0.3623949456959963, + 0.10645580850541592, + 0.7125800512731075, + 1.5951576493680477, + 1.288113497197628, + 0.047759946435689926, + 0.711797472089529, + 0.0, + 0.9356555454432964, + 0.4411768987774849, + 2.393064234405756, + 0.285552728921175, + 1.3133460395038128, + 1.0742941051721573, + 1.797452513128519, + 0.4938339125365019, + 0.49664992094039917 + ], + "unique_experts": 63, + "load_cv": 0.6457397199871512, + "normalized_load_entropy": 0.9489023527007656, + "max_load_share": 0.047126436781609195 + } + }, + "s1_x": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "669bfe3f788fecd9d19070d1d73aa8534a7a519fdaf7e7ba50e76c84a6be0538", + "route_weight_sha256": "f506e11d121ca1687e50aa50a955803b9d7220de25b80222441a65419462c985", + "loads": [ + 6, + 22, + 1, + 25, + 7, + 31, + 22, + 1, + 11, + 7, + 2, + 17, + 8, + 3, + 6, + 26, + 12, + 31, + 10, + 7, + 10, + 18, + 8, + 17, + 6, + 6, + 5, + 0, + 10, + 12, + 11, + 4, + 21, + 10, + 2, + 2, + 19, + 18, + 2, + 2, + 14, + 9, + 7, + 4, + 36, + 23, + 18, + 6, + 2, + 12, + 24, + 15, + 1, + 12, + 1, + 6, + 8, + 22, + 7, + 17, + 13, + 5, + 10, + 10 + ], + "weighted_loads": [ + 0.2239956520497799, + 0.892236053943634, + 0.04551341384649277, + 1.5045759864151478, + 0.6012714691460133, + 1.2751369178295135, + 1.1374458894133568, + 0.04164547473192215, + 0.48215419240295887, + 0.265873771160841, + 0.07272296026349068, + 1.172788493335247, + 0.764351099729538, + 0.18656504526734352, + 0.2716086246073246, + 1.1066117230802774, + 0.6333880089223385, + 1.57602065987885, + 0.4594333581626415, + 0.34595050662755966, + 0.3794515132904053, + 1.2748456709086895, + 0.35651472210884094, + 0.8518574088811874, + 0.30305587500333786, + 0.39153678715229034, + 0.25097578577697277, + 0.0, + 0.641178160905838, + 0.6148207206279039, + 0.6006420962512493, + 0.17021659761667252, + 2.3712756112217903, + 0.4612849950790405, + 0.18654753267765045, + 0.08058880642056465, + 1.4067842327058315, + 2.223479814827442, + 0.17780520766973495, + 0.08886612951755524, + 0.7462578117847443, + 0.5030802823603153, + 0.2400897853076458, + 0.19442689791321754, + 2.5635752510279417, + 1.240826554596424, + 2.2468860670924187, + 0.22393693029880524, + 0.06003015860915184, + 0.6096345223486423, + 1.4664675295352936, + 0.9855844751000404, + 0.05183720961213112, + 0.5880885310471058, + 0.027190910652279854, + 0.40389832109212875, + 0.35039055719971657, + 1.9623635821044445, + 0.28865731321275234, + 0.7285623960196972, + 0.8193845599889755, + 0.6448366753757, + 0.39434940554201603, + 0.48935563676059246 + ], + "unique_experts": 63, + "load_cv": 0.7435317788587382, + "normalized_load_entropy": 0.9333857809987647, + "max_load_share": 0.05 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "aa0f0c8a4e4fa7edc57a6622285f09c69c03355ff52c02877ebed0557cdff466", + "route_weight_sha256": "df69be634cedfa1f8e4cb854dc2571780cb35867235371f463fdfa1dcd32c295", + "loads": [ + 7, + 23, + 3, + 25, + 11, + 31, + 22, + 4, + 11, + 8, + 5, + 21, + 12, + 4, + 11, + 26, + 12, + 36, + 14, + 8, + 11, + 20, + 8, + 17, + 7, + 9, + 7, + 18, + 10, + 15, + 21, + 5, + 26, + 28, + 4, + 4, + 21, + 20, + 3, + 2, + 15, + 23, + 9, + 6, + 41, + 29, + 24, + 10, + 10, + 16, + 30, + 28, + 2, + 16, + 1, + 16, + 9, + 30, + 7, + 33, + 24, + 16, + 10, + 11 + ], + "weighted_loads": [ + 0.2773294560611248, + 0.9418290928006172, + 0.10008331574499607, + 1.5045759864151478, + 0.8025503568351269, + 1.2751369178295135, + 1.1374458894133568, + 0.1770583800971508, + 0.48215419240295887, + 0.28211577236652374, + 0.19964022934436798, + 1.396943349391222, + 0.9652070440351963, + 0.6554673053324223, + 0.6195930354297161, + 1.1066117230802774, + 0.6333880089223385, + 1.839045798406005, + 0.7833251990377903, + 0.37977734953165054, + 0.42018381506204605, + 1.3606011345982552, + 0.35651472210884094, + 0.8518574088811874, + 0.3449386954307556, + 0.7176872361451387, + 0.3212480992078781, + 1.1134306490421295, + 0.641178160905838, + 0.7475146073848009, + 1.4047644399106503, + 0.18399306666105986, + 2.8634898215532303, + 1.3524872660636902, + 0.32846134528517723, + 0.24303197115659714, + 1.491309743374586, + 2.311086468398571, + 0.21434642001986504, + 0.08886612951755524, + 0.7883054874837399, + 1.7089324295520782, + 0.2859095260500908, + 0.26217832416296005, + 2.9898982401937246, + 1.5664160549640656, + 2.591903269290924, + 0.39430603943765163, + 0.7074936628341675, + 0.8208232596516609, + 1.8013754300773144, + 1.778917983174324, + 0.12127650901675224, + 0.7964467220008373, + 0.027190910652279854, + 1.0988202169537544, + 0.42363395914435387, + 2.3994813822209835, + 0.28865731321275234, + 1.7371631264686584, + 1.5515905730426311, + 1.6395341902971268, + 0.39434940554201603, + 0.5251344051212072 + ], + "unique_experts": 64, + "load_cv": 0.6325212713081574, + "normalized_load_entropy": 0.9508895526268286, + "max_load_share": 0.042443064182194616 + } + }, + "s0_period": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "f31fcf98e50f697e2ff0f5f073902c03ea14c325bbf43aaa83e477f960e98551", + "route_weight_sha256": "5e9d696f219fe9ce98c0fdabfa890596058377ace085ff5285fa42b794aa8a31", + "loads": [ + 6, + 21, + 3, + 25, + 7, + 32, + 20, + 1, + 11, + 7, + 2, + 17, + 8, + 2, + 6, + 22, + 13, + 28, + 11, + 7, + 9, + 17, + 8, + 17, + 6, + 6, + 5, + 1, + 12, + 10, + 13, + 6, + 21, + 10, + 2, + 2, + 19, + 19, + 2, + 2, + 11, + 12, + 7, + 4, + 35, + 23, + 18, + 6, + 3, + 11, + 24, + 14, + 1, + 11, + 0, + 7, + 11, + 23, + 7, + 15, + 11, + 6, + 13, + 11 + ], + "weighted_loads": [ + 0.21948718838393688, + 0.8249903228133917, + 0.11050811968743801, + 1.4633896127343178, + 0.5825086385011673, + 1.3389876428991556, + 1.0732011757791042, + 0.04319983348250389, + 0.4900978170335293, + 0.2781156040728092, + 0.07335324212908745, + 1.2273720502853394, + 0.7618488818407059, + 0.16068058088421822, + 0.2745601758360863, + 0.9431184586137533, + 0.6889791898429394, + 1.4051398057490587, + 0.5179586559534073, + 0.32495881989598274, + 0.3469890095293522, + 1.2516044527292252, + 0.36839069053530693, + 0.8070958126336336, + 0.2840195633471012, + 0.3917195424437523, + 0.250297624617815, + 0.04001937806606293, + 0.7039306350052357, + 0.5430975668132305, + 0.7099308744072914, + 0.2608078196644783, + 2.3805213049054146, + 0.44573308527469635, + 0.18961131945252419, + 0.0816943421959877, + 1.3301322013139725, + 2.3205064050853252, + 0.18356648087501526, + 0.0874486081302166, + 0.6221606805920601, + 0.7545022871345282, + 0.2535051479935646, + 0.17463016510009766, + 2.471588309854269, + 1.2528657652437687, + 2.2270196191966534, + 0.22378277778625488, + 0.10928365588188171, + 0.6286497116088867, + 1.4709546156227589, + 0.9342419654130936, + 0.04903147742152214, + 0.5499538779258728, + 0.0, + 0.4884267821907997, + 0.48542493022978306, + 1.9618214927613735, + 0.285173986107111, + 0.6327486932277679, + 0.7601468451321125, + 0.7055940106511116, + 0.48851531371474266, + 0.5056084543466568 + ], + "unique_experts": 63, + "load_cv": 0.7111111111111111, + "normalized_load_entropy": 0.9385562379739104, + "max_load_share": 0.04861111111111111 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "535f7d37f4ee8d306163805d44ba695acc81b9c44c1c69c7ca97093368b6aa05", + "route_weight_sha256": "263ea70fc274f8505b524a791b8ced64447ba1c141d65b0f1959d71c516ce6f7", + "loads": [ + 7, + 22, + 4, + 25, + 7, + 32, + 20, + 6, + 11, + 8, + 5, + 18, + 10, + 4, + 8, + 22, + 13, + 32, + 16, + 8, + 13, + 19, + 8, + 17, + 6, + 8, + 5, + 7, + 13, + 11, + 17, + 7, + 21, + 18, + 3, + 3, + 19, + 19, + 2, + 2, + 11, + 21, + 10, + 6, + 41, + 27, + 23, + 9, + 3, + 14, + 27, + 20, + 1, + 14, + 0, + 14, + 11, + 30, + 7, + 26, + 17, + 18, + 13, + 11 + ], + "weighted_loads": [ + 0.25170076824724674, + 0.8625316750258207, + 0.1246696449816227, + 1.4633896127343178, + 0.5825086385011673, + 1.3389876428991556, + 1.0732011757791042, + 0.2562973275780678, + 0.4900978170335293, + 0.294357605278492, + 0.20728975534439087, + 1.2755130641162395, + 0.8318100050091743, + 0.6647217534482479, + 0.4424775317311287, + 0.9431184586137533, + 0.6889791898429394, + 1.6594975274056196, + 0.8560341857373714, + 0.38860245421528816, + 0.5146640576422215, + 1.330547109246254, + 0.36839069053530693, + 0.8070958126336336, + 0.2840195633471012, + 0.45536742731928825, + 0.250297624617815, + 0.6140058189630508, + 0.7505658343434334, + 0.5860394425690174, + 1.104604534804821, + 0.27458428870886564, + 2.3805213049054146, + 0.8121072426438332, + 0.21943549811840057, + 0.11856821924448013, + 1.3301322013139725, + 2.3205064050853252, + 0.18356648087501526, + 0.0874486081302166, + 0.6221606805920601, + 1.669053727760911, + 0.35923876613378525, + 0.2713112570345402, + 2.982220608741045, + 1.438958290964365, + 2.4630326330661774, + 0.3528354112058878, + 0.10928365588188171, + 0.7699031308293343, + 1.5969652812927961, + 1.281907670199871, + 0.04903147742152214, + 0.7161760181188583, + 0.0, + 0.9593900367617607, + 0.48542493022978306, + 2.385813619941473, + 0.285173986107111, + 1.3288585841655731, + 1.1269937343895435, + 1.7453798204660416, + 0.48851531371474266, + 0.5056084543466568 + ], + "unique_experts": 63, + "load_cv": 0.6410084207571454, + "normalized_load_entropy": 0.9494791738686877, + "max_load_share": 0.047126436781609195 + } + }, + "s1_period": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "3bbac2a987d005cef5c2b264bfbf9a63ce75c87252c4d7852a060c7aba489406", + "route_weight_sha256": "01bbcf2ca9e844e88d97dc8f5bf8e816ea8333e9c5520b50fcb16d967cf85958", + "loads": [ + 6, + 22, + 1, + 27, + 7, + 32, + 21, + 0, + 9, + 6, + 3, + 18, + 8, + 2, + 6, + 25, + 12, + 30, + 11, + 6, + 10, + 18, + 8, + 19, + 6, + 6, + 5, + 1, + 11, + 11, + 13, + 4, + 21, + 10, + 2, + 2, + 19, + 19, + 2, + 2, + 13, + 9, + 5, + 4, + 36, + 23, + 18, + 5, + 2, + 12, + 24, + 15, + 1, + 13, + 1, + 6, + 9, + 23, + 7, + 16, + 13, + 5, + 9, + 10 + ], + "weighted_loads": [ + 0.20626159757375717, + 0.8738449644297361, + 0.04412861168384552, + 1.5577904488891363, + 0.6012028381228447, + 1.3560064658522606, + 1.11756332218647, + 0.0, + 0.4205161612480879, + 0.2245861403644085, + 0.12108566612005234, + 1.2221319898962975, + 0.7489623352885246, + 0.15550024434924126, + 0.2739723213016987, + 1.0636318735778332, + 0.6339549850672483, + 1.4833221603184938, + 0.48932164162397385, + 0.31635506451129913, + 0.3799634166061878, + 1.2853557094931602, + 0.35725534707307816, + 0.9146781023591757, + 0.28579458594322205, + 0.3839396946132183, + 0.2543153930455446, + 0.0341198705136776, + 0.6722803823649883, + 0.5790542792528868, + 0.7044081427156925, + 0.1727946661412716, + 2.3793101720511913, + 0.45343651808798313, + 0.18625978380441666, + 0.08086387813091278, + 1.4271606504917145, + 2.2333645541220903, + 0.1823531612753868, + 0.0914476104080677, + 0.6976276338100433, + 0.5180120151489973, + 0.16656923294067383, + 0.19308845698833466, + 2.5490508377552032, + 1.2455727308988571, + 2.253802914172411, + 0.18750399351119995, + 0.059904955327510834, + 0.6107664257287979, + 1.4815878495573997, + 0.9730142951011658, + 0.05214652791619301, + 0.6188543997704983, + 0.027792105451226234, + 0.3892454244196415, + 0.4001245051622391, + 1.986361563205719, + 0.28155997209250927, + 0.6607304457575083, + 0.8085708096623421, + 0.6452415511012077, + 0.350500775501132, + 0.48856809735298157 + ], + "unique_experts": 63, + "load_cv": 0.7542472332656506, + "normalized_load_entropy": 0.9315392811296817, + "max_load_share": 0.05 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "11ffdcd29dada6e7e366ced81b02751fb9be997e380f2e301f86d034fdb8d2af", + "route_weight_sha256": "169fe042d824c2e6440081cb2303981f5810b530ddc77ad9873d03c9a32a17ea", + "loads": [ + 8, + 22, + 3, + 28, + 11, + 32, + 21, + 2, + 9, + 7, + 6, + 22, + 12, + 3, + 11, + 25, + 12, + 35, + 15, + 6, + 11, + 20, + 8, + 19, + 7, + 9, + 7, + 19, + 11, + 14, + 24, + 5, + 26, + 27, + 4, + 4, + 21, + 21, + 3, + 2, + 14, + 23, + 7, + 6, + 41, + 29, + 23, + 9, + 10, + 16, + 28, + 29, + 2, + 18, + 1, + 17, + 10, + 31, + 7, + 33, + 24, + 16, + 9, + 11 + ], + "weighted_loads": [ + 0.29424037784338, + 0.8738449644297361, + 0.09869851358234882, + 1.6156614180654287, + 0.8024817258119583, + 1.3560064658522606, + 1.11756332218647, + 0.08513722568750381, + 0.4205161612480879, + 0.24082814157009125, + 0.23537563905119896, + 1.446007113903761, + 0.949818279594183, + 0.62440250441432, + 0.6259732656180859, + 1.0636318735778332, + 0.6339549850672483, + 1.7909185122698545, + 0.8132134824991226, + 0.31635506451129913, + 0.4206957183778286, + 1.371111173182726, + 0.35725534707307816, + 0.9146781023591757, + 0.3276774063706398, + 0.7100901436060667, + 0.32458770647644997, + 1.154060360044241, + 0.6722803823649883, + 0.7117481660097837, + 1.6175256632268429, + 0.18657113518565893, + 2.8715243823826313, + 1.2900738473981619, + 0.32817359641194344, + 0.24330704286694527, + 1.511686161160469, + 2.320971207693219, + 0.2188943736255169, + 0.0914476104080677, + 0.7396753095090389, + 1.7360219862312078, + 0.21238897368311882, + 0.26083988323807716, + 2.969045527279377, + 1.5464386157691479, + 2.533363115042448, + 0.36202271841466427, + 0.7073684595525265, + 0.8244652524590492, + 1.7341099046170712, + 1.8504987880587578, + 0.12158582732081413, + 0.8608006872236729, + 0.027792105451226234, + 1.1172570884227753, + 0.4733679071068764, + 2.5027073323726654, + 0.28155997209250927, + 1.6900452133268118, + 1.5447438769042492, + 1.6026502847671509, + 0.350500775501132, + 0.5243468657135963 + ], + "unique_experts": 64, + "load_cv": 0.6435926952186075, + "normalized_load_entropy": 0.9485184376589352, + "max_load_share": 0.042443064182194616 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 120, + "ordered_topk_exact_tokens": 71, + "set_exact_tokens": 81, + "mean_set_jaccard": 0.9017857142857143, + "mean_token_weighted_tv": 0.01827366465392212, + "aggregate_load_tv": 0.03888888888888888 + }, + "system_bos": { + "tokens": 120, + "ordered_topk_exact_tokens": 70, + "set_exact_tokens": 80, + "mean_set_jaccard": 0.8994047619047619, + "mean_token_weighted_tv": 0.019831444726636012, + "aggregate_load_tv": 0.030555555555555558 + }, + "system_x": { + "tokens": 120, + "ordered_topk_exact_tokens": 55, + "set_exact_tokens": 72, + "mean_set_jaccard": 0.8714285714285716, + "mean_token_weighted_tv": 0.02623437703587115, + "aggregate_load_tv": 0.04027777777777777 + }, + "system_period": { + "tokens": 120, + "ordered_topk_exact_tokens": 59, + "set_exact_tokens": 78, + "mean_set_jaccard": 0.8914682539682541, + "mean_token_weighted_tv": 0.02377464037078122, + "aggregate_load_tv": 0.0375 + }, + "bos_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 59, + "set_exact_tokens": 75, + "mean_set_jaccard": 0.8785714285714287, + "mean_token_weighted_tv": 0.025183640769682825, + "aggregate_load_tv": 0.040277777777777767 + }, + "bos_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 56, + "set_exact_tokens": 71, + "mean_set_jaccard": 0.8676587301587302, + "mean_token_weighted_tv": 0.02762276299763471, + "aggregate_load_tv": 0.034722222222222224 + }, + "x_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 56, + "set_exact_tokens": 73, + "mean_set_jaccard": 0.8738095238095238, + "mean_token_weighted_tv": 0.027410705845492583, + "aggregate_load_tv": 0.04583333333333332 + }, + "x_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 49, + "set_exact_tokens": 60, + "mean_set_jaccard": 0.8361111111111111, + "mean_token_weighted_tv": 0.035051394758435585, + "aggregate_load_tv": 0.05694444444444445 + }, + "period_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 56, + "set_exact_tokens": 72, + "mean_set_jaccard": 0.8678571428571428, + "mean_token_weighted_tv": 0.02807296342216432, + "aggregate_load_tv": 0.04583333333333333 + }, + "period_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 50, + "set_exact_tokens": 65, + "mean_set_jaccard": 0.8501984126984128, + "mean_token_weighted_tv": 0.03260590611025691, + "aggregate_load_tv": 0.052777777777777785 + } + } + }, + "layer_11": { + "layer": 11, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "a949bd59f9d8a7e07485f53d2e5fad2064f778bca4c8c8db19bf3aa1187cc96a", + "route_weight_sha256": "6e0a893efe38784f4b2af09bd8088e0a3a7759515acf7ae67cb5e943d04103a6", + "loads": [ + 6, + 13, + 7, + 4, + 9, + 24, + 2, + 16, + 12, + 14, + 2, + 3, + 17, + 1, + 8, + 4, + 11, + 1, + 7, + 2, + 3, + 1, + 10, + 20, + 9, + 15, + 3, + 13, + 10, + 22, + 15, + 31, + 8, + 13, + 17, + 7, + 12, + 13, + 1, + 7, + 37, + 12, + 8, + 16, + 15, + 15, + 5, + 22, + 10, + 4, + 1, + 3, + 19, + 0, + 0, + 2, + 13, + 21, + 27, + 14, + 29, + 27, + 7, + 20 + ], + "weighted_loads": [ + 0.3586372770369053, + 0.4996839240193367, + 0.3573813382536173, + 0.17110632732510567, + 0.47154393047094345, + 1.7649681270122528, + 0.10725095868110657, + 0.8843828625977039, + 0.6759634241461754, + 0.5820814464241266, + 0.07713515311479568, + 0.10878137685358524, + 0.8095170799642801, + 0.09544326364994049, + 0.3449493534862995, + 0.15755660459399223, + 0.46850474923849106, + 0.0323282890021801, + 0.32800936326384544, + 0.07611711509525776, + 0.1448785588145256, + 0.07436440140008926, + 0.3925178684294224, + 1.8413557820022106, + 0.37733713164925575, + 0.6259745657444, + 0.12392935901880264, + 0.5053174179047346, + 0.8253986984491348, + 1.2812113091349602, + 1.0283641424030066, + 2.027680139988661, + 0.29372335970401764, + 0.58406837657094, + 0.8284409306943417, + 0.4786788448691368, + 0.6891876794397831, + 1.013059824705124, + 0.03986414894461632, + 0.33041856437921524, + 1.7523110006004572, + 0.45999140851199627, + 0.46568910777568817, + 1.173721767961979, + 1.4316395930945873, + 1.2023333087563515, + 0.28431108966469765, + 1.047602340579033, + 0.3724140804260969, + 0.19745266065001488, + 0.042273182421922684, + 0.09161234460771084, + 0.860368087887764, + 0.0, + 0.0, + 0.07983178645372391, + 0.7823885269463062, + 1.2254597544670105, + 1.425720937550068, + 0.6398170161992311, + 1.2159674391150475, + 0.9902032632380724, + 0.33752384781837463, + 1.496788889169693 + ], + "unique_experts": 62, + "load_cv": 0.7470105028431827, + "normalized_load_entropy": 0.9299378521449432, + "max_load_share": 0.05138888888888889 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "55ee78b8189b3133d1247fcae405a4f63cdd332963424ac8a5a7bc71175a66bc", + "route_weight_sha256": "bf5daf458e93557d403be12f15242bd14009fde53f622ebacc6d45db75cc7a86", + "loads": [ + 6, + 14, + 8, + 4, + 14, + 24, + 2, + 16, + 16, + 16, + 5, + 6, + 17, + 1, + 8, + 10, + 15, + 3, + 19, + 2, + 4, + 1, + 11, + 26, + 9, + 16, + 4, + 14, + 17, + 22, + 21, + 38, + 9, + 13, + 21, + 8, + 12, + 13, + 1, + 7, + 46, + 12, + 8, + 38, + 18, + 15, + 5, + 30, + 10, + 6, + 1, + 4, + 19, + 0, + 6, + 4, + 13, + 21, + 30, + 14, + 29, + 32, + 16, + 20 + ], + "weighted_loads": [ + 0.3586372770369053, + 0.5346592217683792, + 0.4158483538776636, + 0.17110632732510567, + 0.7082350105047226, + 1.7649681270122528, + 0.10725095868110657, + 0.8843828625977039, + 0.9045185819268227, + 0.6397307850420475, + 0.14858444221317768, + 0.1626485465094447, + 0.8095170799642801, + 0.09544326364994049, + 0.3449493534862995, + 0.38825199007987976, + 0.9466012939810753, + 0.06221023295074701, + 2.3935395888984203, + 0.07611711509525776, + 0.17391844652593136, + 0.07436440140008926, + 0.3964449162594974, + 2.1215941458940506, + 0.37733713164925575, + 0.6653482057154179, + 0.1272953818552196, + 0.5179086187854409, + 1.312021341174841, + 1.2812113091349602, + 1.322625007480383, + 2.343834411352873, + 0.32988179102540016, + 0.58406837657094, + 1.0058310516178608, + 0.5575854554772377, + 0.6891876794397831, + 1.013059824705124, + 0.03986414894461632, + 0.33041856437921524, + 2.2099478635936975, + 0.45999140851199627, + 0.46568910777568817, + 3.4756079465150833, + 1.5871556401252747, + 1.2023333087563515, + 0.28431108966469765, + 1.6030784994363785, + 0.3724140804260969, + 0.2930527403950691, + 0.042273182421922684, + 0.1225266307592392, + 0.860368087887764, + 0.0, + 0.3153631202876568, + 0.1705813929438591, + 0.7823885269463062, + 1.2254597544670105, + 1.5592151992022991, + 0.6398170161992311, + 1.2159674391150475, + 1.217673433944583, + 0.8472646065056324, + 1.496788889169693 + ], + "unique_experts": 63, + "load_cv": 0.7308718101375545, + "normalized_load_entropy": 0.9360651883513332, + "max_load_share": 0.052873563218390804 + } + }, + "s1_eos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "ee42c55e4493214b16907ea2b96ed5ffc3cf89b4c6d04127946a970d6f9754d0", + "route_weight_sha256": "d55888dc75a7b4c41ae3f0d1ee4254ea44110558b0e222e60f4a354b029f836a", + "loads": [ + 5, + 15, + 6, + 7, + 8, + 23, + 2, + 16, + 12, + 12, + 2, + 4, + 16, + 1, + 8, + 3, + 11, + 2, + 6, + 2, + 1, + 1, + 11, + 20, + 11, + 14, + 4, + 14, + 10, + 23, + 15, + 31, + 9, + 13, + 18, + 7, + 12, + 15, + 2, + 5, + 40, + 12, + 5, + 15, + 15, + 16, + 4, + 21, + 10, + 4, + 1, + 4, + 18, + 0, + 1, + 1, + 13, + 21, + 28, + 13, + 31, + 26, + 4, + 20 + ], + "weighted_loads": [ + 0.3235558159649372, + 0.5788180287927389, + 0.31489307433366776, + 0.2998417690396309, + 0.4166535399854183, + 1.7382163479924202, + 0.10826390981674194, + 0.8637242503464222, + 0.6719288267195225, + 0.5029851421713829, + 0.0733634065836668, + 0.14554655365645885, + 0.7777125909924507, + 0.0940219834446907, + 0.3508598878979683, + 0.11736675351858139, + 0.48656013049185276, + 0.06376681849360466, + 0.3061161506921053, + 0.07504250295460224, + 0.0730389878153801, + 0.07435031235218048, + 0.41766574047505856, + 1.8287579827010632, + 0.4476815350353718, + 0.5902145840227604, + 0.1690102256834507, + 0.5379306729882956, + 0.8132740240544081, + 1.3451601788401604, + 1.0471595637500286, + 1.9947892911732197, + 0.34386463835835457, + 0.5845476947724819, + 0.870060171931982, + 0.4488009065389633, + 0.7134096622467041, + 1.350391898304224, + 0.07275083288550377, + 0.24174369126558304, + 1.8887683246284723, + 0.47289760410785675, + 0.27873048186302185, + 1.1181240528821945, + 1.419796109199524, + 1.2211595978587866, + 0.2434380203485489, + 0.9868424721062183, + 0.35568381659686565, + 0.1977267526090145, + 0.04236311838030815, + 0.1214886475354433, + 0.8196778930723667, + 0.0, + 0.03185733035206795, + 0.051079005002975464, + 0.7709413729608059, + 1.2214968316257, + 1.4465479739010334, + 0.5986692812293768, + 1.317174669355154, + 0.9453202839940786, + 0.1726897731423378, + 1.4804769791662693 + ], + "unique_experts": 63, + "load_cv": 0.7686769136190212, + "normalized_load_entropy": 0.927932967256202, + "max_load_share": 0.05555555555555555 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "c6172adb1c9219244e059b1bde3b647467238d0669a8cd2bc78e8fcfc5f50c31", + "route_weight_sha256": "bb76dbef52446058ae60f4d780c86edcfd99c6b586baf99daceaa97e3bf961e5", + "loads": [ + 7, + 16, + 7, + 7, + 20, + 27, + 2, + 18, + 22, + 12, + 6, + 7, + 16, + 1, + 8, + 4, + 28, + 4, + 17, + 3, + 2, + 2, + 14, + 25, + 11, + 15, + 7, + 16, + 22, + 23, + 23, + 37, + 10, + 13, + 23, + 10, + 12, + 15, + 2, + 6, + 49, + 12, + 5, + 42, + 17, + 16, + 5, + 34, + 10, + 7, + 1, + 4, + 18, + 5, + 24, + 8, + 19, + 22, + 30, + 17, + 31, + 34, + 15, + 21 + ], + "weighted_loads": [ + 0.47125810012221336, + 0.612270874902606, + 0.36230291798710823, + 0.2998417690396309, + 1.0271864868700504, + 1.8764856047928333, + 0.10826390981674194, + 0.9924764446914196, + 1.2514046616852283, + 0.5029851421713829, + 0.1875442424789071, + 0.1987175540998578, + 0.7777125909924507, + 0.0940219834446907, + 0.3508598878979683, + 0.15701625123620033, + 2.0779098961502314, + 0.09279062319546938, + 2.3615328278392553, + 0.11406147666275501, + 0.14680620282888412, + 0.14477288722991943, + 0.5302969871554524, + 2.046781685203314, + 0.4476815350353718, + 0.6300204284489155, + 0.24727301206439734, + 0.5883786315098405, + 1.656489884480834, + 1.3451601788401604, + 1.459684168919921, + 2.2566067539155483, + 0.3756387531757355, + 0.5845476947724819, + 1.1040614731609821, + 0.7418894395232201, + 0.7134096622467041, + 1.350391898304224, + 0.07275083288550377, + 0.288410983979702, + 2.3153672609478235, + 0.47289760410785675, + 0.27873048186302185, + 3.723897859454155, + 1.5436473824083805, + 1.2211595978587866, + 0.28998681902885437, + 1.944310013204813, + 0.35568381659686565, + 0.41789326444268227, + 0.04236311838030815, + 0.1214886475354433, + 0.8196778930723667, + 0.3039204850792885, + 1.3543490283191204, + 0.384005893021822, + 1.2419142313301563, + 1.2647408321499825, + 1.5483240187168121, + 0.7532054167240858, + 1.317174669355154, + 1.2956907600164413, + 0.7190182209014893, + 1.5233803428709507 + ], + "unique_experts": 64, + "load_cv": 0.7006347002486538, + "normalized_load_entropy": 0.9412730544867804, + "max_load_share": 0.050724637681159424 + } + }, + "s0_bos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "4d3acfcff58123913b0b63ebf820b6a86d43d4b1d9c61d50f21dd861794f0587", + "route_weight_sha256": "b474005dc3de5f81be8a271d28b3adfc4423edde118ea685bdb472418ab6bcd4", + "loads": [ + 6, + 13, + 7, + 2, + 8, + 24, + 3, + 16, + 12, + 12, + 2, + 3, + 15, + 2, + 8, + 5, + 11, + 1, + 7, + 2, + 3, + 1, + 11, + 20, + 11, + 12, + 3, + 14, + 11, + 24, + 16, + 31, + 10, + 14, + 17, + 6, + 12, + 16, + 2, + 5, + 39, + 14, + 7, + 17, + 15, + 15, + 4, + 21, + 9, + 3, + 1, + 5, + 16, + 0, + 1, + 0, + 12, + 19, + 27, + 15, + 28, + 24, + 7, + 23 + ], + "weighted_loads": [ + 0.3632477931678295, + 0.4777992460876703, + 0.3558160401880741, + 0.08790310844779015, + 0.40055980905890465, + 1.7764634564518929, + 0.15063805505633354, + 0.8842652812600136, + 0.6769511513411999, + 0.4769461303949356, + 0.07655815593898296, + 0.10881047323346138, + 0.7472729906439781, + 0.12377336248755455, + 0.3415180370211601, + 0.2048569805920124, + 0.48761814646422863, + 0.033909864723682404, + 0.32201828621327877, + 0.0751225147396326, + 0.14764248579740524, + 0.08224799484014511, + 0.4373130686581135, + 1.838558305054903, + 0.46242502331733704, + 0.5269375070929527, + 0.11855148896574974, + 0.5384620763361454, + 0.8617298733443022, + 1.3622639775276184, + 1.07789252884686, + 2.060599695891142, + 0.37540738843381405, + 0.6191999614238739, + 0.82543402351439, + 0.4611406549811363, + 0.7310568541288376, + 1.2084240689873695, + 0.07735320180654526, + 0.2504602260887623, + 1.850814489647746, + 0.5479212999343872, + 0.3790101893246174, + 1.22039457783103, + 1.439339704811573, + 1.2641074303537607, + 0.2291431427001953, + 0.9933238178491592, + 0.33505175821483135, + 0.16591964289546013, + 0.04495789483189583, + 0.14806845597922802, + 0.7725310139358044, + 0.0, + 0.04167691245675087, + 0.0, + 0.7571349292993546, + 1.1506566479802132, + 1.4221995640546083, + 0.686920253559947, + 1.1666120197623968, + 0.895701115950942, + 0.31974578090012074, + 1.6121084466576576 + ], + "unique_experts": 62, + "load_cv": 0.7498147919467995, + "normalized_load_entropy": 0.9299065953389165, + "max_load_share": 0.05416666666666667 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "8caba457d05e02b98d742abc90af0415f470ddc9f639c60e74dd81f596c31845", + "route_weight_sha256": "c216619c78f8ab2ff017ef426285dacb805fd836cff3af2fe70ccfb49c0cbcf8", + "loads": [ + 6, + 14, + 8, + 2, + 13, + 24, + 3, + 16, + 16, + 14, + 4, + 5, + 15, + 2, + 8, + 13, + 16, + 2, + 18, + 2, + 3, + 1, + 11, + 26, + 11, + 12, + 3, + 16, + 16, + 24, + 22, + 39, + 11, + 14, + 21, + 7, + 12, + 16, + 2, + 5, + 49, + 14, + 7, + 40, + 18, + 15, + 4, + 29, + 9, + 5, + 1, + 7, + 16, + 0, + 6, + 2, + 12, + 19, + 30, + 15, + 29, + 31, + 16, + 23 + ], + "weighted_loads": [ + 0.3632477931678295, + 0.5127745438367128, + 0.41428305581212044, + 0.08790310844779015, + 0.6259066872298717, + 1.7764634564518929, + 0.15063805505633354, + 0.8842652812600136, + 0.903082799166441, + 0.5345954690128565, + 0.142896031960845, + 0.15060594957321882, + 0.7472729906439781, + 0.12377336248755455, + 0.3415180370211601, + 0.5082447342574596, + 1.0384961795061827, + 0.04875359311699867, + 1.4915550407022238, + 0.0751225147396326, + 0.14764248579740524, + 0.08224799484014511, + 0.4373130686581135, + 2.118796668946743, + 0.46242502331733704, + 0.5269375070929527, + 0.11855148896574974, + 0.5968010379001498, + 1.2777644339948893, + 1.3622639775276184, + 1.3721533939242363, + 2.479594562202692, + 0.41156581975519657, + 0.6191999614238739, + 0.9997264612466097, + 0.5400472655892372, + 0.7310568541288376, + 1.2084240689873695, + 0.07735320180654526, + 0.2504602260887623, + 2.3800682928413153, + 0.5479212999343872, + 0.3790101893246174, + 3.6301495730876923, + 1.5948557518422604, + 1.2641074303537607, + 0.2291431427001953, + 1.5600174888968468, + 0.33505175821483135, + 0.2615197226405144, + 0.04495789483189583, + 0.21903911046683788, + 0.7725310139358044, + 0.0, + 0.33021071180701256, + 0.08594973757863045, + 0.7571349292993546, + 1.1506566479802132, + 1.5556938257068396, + 0.686920253559947, + 1.2055215369910002, + 1.2057077754288912, + 0.852736784145236, + 1.6121084466576576 + ], + "unique_experts": 63, + "load_cv": 0.7558954882563703, + "normalized_load_entropy": 0.9324145894988022, + "max_load_share": 0.05632183908045977 + } + }, + "s1_bos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "62d26052a8ac833198492b481660226b9642a5cc68fab21d13f2fc08d69759d3", + "route_weight_sha256": "31b980324cce7a81d36ca198b25fe48aff5c06c642e5db351f1a3adad98a8a1d", + "loads": [ + 5, + 13, + 6, + 3, + 7, + 24, + 4, + 15, + 12, + 11, + 2, + 4, + 16, + 2, + 8, + 5, + 10, + 1, + 6, + 2, + 2, + 1, + 10, + 20, + 10, + 12, + 3, + 14, + 10, + 24, + 15, + 31, + 10, + 14, + 19, + 7, + 12, + 16, + 3, + 5, + 42, + 16, + 6, + 18, + 15, + 16, + 4, + 22, + 7, + 4, + 1, + 5, + 16, + 0, + 2, + 0, + 13, + 19, + 27, + 15, + 30, + 23, + 1, + 24 + ], + "weighted_loads": [ + 0.3282773718237877, + 0.5194548685103655, + 0.31111765652894974, + 0.11879238486289978, + 0.3717804066836834, + 1.8127010948956013, + 0.19480721279978752, + 0.8388253450393677, + 0.6729234866797924, + 0.43513335660099983, + 0.07375214621424675, + 0.14353447407484055, + 0.7664106320589781, + 0.12184221111238003, + 0.3458956107497215, + 0.20330804586410522, + 0.4328889660537243, + 0.03461233153939247, + 0.3000340834259987, + 0.07935757376253605, + 0.11459024995565414, + 0.0828251913189888, + 0.398847421631217, + 1.8417947702109814, + 0.4064897485077381, + 0.5343018583953381, + 0.12344889715313911, + 0.535437935963273, + 0.8360295668244362, + 1.3773728758096695, + 1.052494041621685, + 2.036769237369299, + 0.37588960863649845, + 0.6051634829491377, + 0.9010236021131277, + 0.47063228860497475, + 0.7421167939901352, + 1.4663032814860344, + 0.11122914403676987, + 0.24986744299530983, + 1.9845446553081274, + 0.6305814199149609, + 0.3040861673653126, + 1.2717865463346243, + 1.4413571655750275, + 1.257092049345374, + 0.2455809786915779, + 1.0215762332081795, + 0.259286155924201, + 0.21111402288079262, + 0.0433640219271183, + 0.14989698491990566, + 0.7629966773092747, + 0.0, + 0.06618522852659225, + 0.0, + 0.7784412391483784, + 1.1434111632406712, + 1.4225824195891619, + 0.6467227600514889, + 1.2627786304801702, + 0.8522793482989073, + 0.044679563492536545, + 1.6457432582974434 + ], + "unique_experts": 62, + "load_cv": 0.7807878262560384, + "normalized_load_entropy": 0.9260824865473645, + "max_load_share": 0.058333333333333334 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "f2fd903e67851de18c03c9458d5625dd5f638b38729546e61a62b774485907e0", + "route_weight_sha256": "e5a0d5928f7e568c5ea4bc9dc75b0efa57a4504b4d90f0e92fb51b3a2ac0f96a", + "loads": [ + 7, + 14, + 7, + 3, + 18, + 28, + 4, + 17, + 22, + 12, + 5, + 6, + 16, + 2, + 8, + 7, + 27, + 2, + 16, + 3, + 3, + 2, + 12, + 25, + 10, + 13, + 5, + 16, + 21, + 24, + 23, + 37, + 11, + 14, + 23, + 11, + 12, + 16, + 3, + 6, + 50, + 16, + 6, + 46, + 17, + 16, + 5, + 36, + 7, + 7, + 1, + 6, + 16, + 5, + 25, + 7, + 19, + 20, + 29, + 19, + 31, + 33, + 13, + 25 + ], + "weighted_loads": [ + 0.47597965598106384, + 0.5529077146202326, + 0.3585275001823902, + 0.11879238486289978, + 0.9522750340402126, + 1.9509703516960144, + 0.19480721279978752, + 0.9675775393843651, + 1.2519843615591526, + 0.46869559586048126, + 0.18276939168572426, + 0.1853047562763095, + 0.7664106320589781, + 0.12184221111238003, + 0.3458956107497215, + 0.2745693363249302, + 2.06375689804554, + 0.04945605993270874, + 1.4573985449969769, + 0.11837654747068882, + 0.18835746496915817, + 0.15324776619672775, + 0.5076923836022615, + 2.059818472713232, + 0.4064897485077381, + 0.5752976350486279, + 0.1985471434891224, + 0.585885894484818, + 1.63521533831954, + 1.3773728758096695, + 1.4650186467915773, + 2.2985867001116276, + 0.40766372345387936, + 0.6051634829491377, + 1.098076531663537, + 0.7935929037630558, + 0.7421167939901352, + 1.4663032814860344, + 0.11122914403676987, + 0.2965347357094288, + 2.4266438987106085, + 0.6305814199149609, + 0.3040861673653126, + 4.192774711176753, + 1.565208438783884, + 1.257092049345374, + 0.2921297773718834, + 2.0106141418218613, + 0.259286155924201, + 0.4312805347144604, + 0.0433640219271183, + 0.1815450619906187, + 0.7629966773092747, + 0.3039204850792885, + 1.3965189531445503, + 0.3329268880188465, + 1.2494140975177288, + 1.1866551637649536, + 1.5243584644049406, + 0.8012588955461979, + 1.3042792100459337, + 1.295248880982399, + 0.6419581770896912, + 1.6886466220021248 + ], + "unique_experts": 64, + "load_cv": 0.7184205344589081, + "normalized_load_entropy": 0.9400313784736896, + "max_load_share": 0.051759834368530024 + } + }, + "s0_x": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "b21401ce99a2a3c027c1464ec973f21e1930351e73af5c4683f2b15abb6dee3d", + "route_weight_sha256": "6b66b6cf22a164781b98ef0a775e1a6897edfdc0edb84a81f702f554d2eece82", + "loads": [ + 6, + 10, + 7, + 0, + 8, + 24, + 5, + 15, + 15, + 11, + 3, + 3, + 18, + 2, + 9, + 7, + 10, + 1, + 8, + 2, + 2, + 1, + 11, + 21, + 10, + 15, + 3, + 12, + 11, + 24, + 16, + 31, + 7, + 12, + 17, + 8, + 12, + 15, + 3, + 7, + 34, + 13, + 7, + 16, + 15, + 19, + 4, + 20, + 10, + 4, + 1, + 6, + 15, + 0, + 1, + 2, + 14, + 19, + 27, + 10, + 29, + 20, + 7, + 25 + ], + "weighted_loads": [ + 0.37456169724464417, + 0.3707612957805395, + 0.3546139486134052, + 0.0, + 0.4036668185144663, + 1.81071325391531, + 0.23967844247817993, + 0.9083236344158649, + 0.7896219305694103, + 0.4453765582293272, + 0.11153789050877094, + 0.10917726345360279, + 0.8558082263916731, + 0.12375971302390099, + 0.3753282558172941, + 0.27365637943148613, + 0.45001217536628246, + 0.0363173745572567, + 0.35650962963700294, + 0.07463207840919495, + 0.12087045609951019, + 0.08149860799312592, + 0.43626586347818375, + 1.897761382162571, + 0.42869702726602554, + 0.648319760337472, + 0.11911261454224586, + 0.47612663358449936, + 0.8740498032420874, + 1.2919242084026337, + 1.0729821305721998, + 2.0927920006215572, + 0.25494300574064255, + 0.5416140407323837, + 0.8236779980361462, + 0.5560333728790283, + 0.7234227918088436, + 1.1375819966197014, + 0.11378411576151848, + 0.3326742388308048, + 1.5682805217802525, + 0.510152343660593, + 0.3758144937455654, + 1.153348794206977, + 1.4776695109903812, + 1.4101837929338217, + 0.24819263815879822, + 0.9789852574467659, + 0.36697496101260185, + 0.18966905400156975, + 0.043678656220436096, + 0.17627937905490398, + 0.7315150126814842, + 0.0, + 0.04617062211036682, + 0.06900745630264282, + 0.8335550054907799, + 1.1331900283694267, + 1.4308900870382786, + 0.48422159627079964, + 1.2122811563313007, + 0.7506674136966467, + 0.3231082893908024, + 1.7347103506326675 + ], + "unique_experts": 62, + "load_cv": 0.7212814385385546, + "normalized_load_entropy": 0.934404566703456, + "max_load_share": 0.04722222222222222 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "cdc1ef9621b6e5fd95a22465844fbf990dc10fdacb1386fa2e6780eecbf68a65", + "route_weight_sha256": "e887f6da41bef5592757ede5513260522d79eaac45e153f1eb0324aca36fc2fd", + "loads": [ + 6, + 11, + 8, + 0, + 13, + 24, + 5, + 15, + 19, + 13, + 5, + 5, + 18, + 2, + 9, + 13, + 14, + 3, + 20, + 2, + 2, + 1, + 11, + 27, + 10, + 15, + 3, + 13, + 18, + 24, + 22, + 40, + 8, + 12, + 22, + 10, + 12, + 15, + 3, + 7, + 41, + 13, + 7, + 38, + 18, + 19, + 4, + 28, + 10, + 8, + 1, + 7, + 15, + 1, + 7, + 3, + 14, + 19, + 31, + 10, + 30, + 25, + 16, + 25 + ], + "weighted_loads": [ + 0.37456169724464417, + 0.405736593529582, + 0.41308096423745155, + 0.0, + 0.6377024259418249, + 1.81071325391531, + 0.23967844247817993, + 0.9083236344158649, + 1.0156958475708961, + 0.5030258968472481, + 0.17787576653063297, + 0.15097273979336023, + 0.8558082263916731, + 0.12375971302390099, + 0.3753282558172941, + 0.5043517649173737, + 0.9016846846789122, + 0.08639486134052277, + 1.617929469794035, + 0.07463207840919495, + 0.12087045609951019, + 0.08149860799312592, + 0.43626586347818375, + 2.177999746054411, + 0.42869702726602554, + 0.648319760337472, + 0.11911261454224586, + 0.48871783446520567, + 1.3942340184003115, + 1.2919242084026337, + 1.3672429956495762, + 2.570434130728245, + 0.29110143706202507, + 0.5416140407323837, + 1.1086696162819862, + 0.6677940934896469, + 0.7234227918088436, + 1.1375819966197014, + 0.11378411576151848, + 0.3326742388308048, + 1.9039760529994965, + 0.510152343660593, + 0.3758144937455654, + 3.2716945987194777, + 1.6331855580210686, + 1.4101837929338217, + 0.24819263815879822, + 1.5587039180099964, + 0.36697496101260185, + 0.37542539462447166, + 0.043678656220436096, + 0.2114537227898836, + 0.7315150126814842, + 0.05517248436808586, + 0.3573870249092579, + 0.11254801973700523, + 0.8335550054907799, + 1.1331900283694267, + 1.6251091100275517, + 0.48422159627079964, + 1.2562364377081394, + 0.9905721116811037, + 0.8095434121787548, + 1.7347103506326675 + ], + "unique_experts": 63, + "load_cv": 0.716264439292025, + "normalized_load_entropy": 0.9376260562586437, + "max_load_share": 0.047126436781609195 + } + }, + "s1_x": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "2a81eaeeee7f3d5b5335441e59d1c9b5176c631f5f377263bac8aec0ab59c0a1", + "route_weight_sha256": "1fd6aecc8e7aacc2e6b0770a9c31d7b165ea95d2df50bdd12e4f823af21ef3b6", + "loads": [ + 6, + 13, + 4, + 3, + 9, + 24, + 4, + 15, + 15, + 14, + 4, + 4, + 17, + 2, + 8, + 6, + 11, + 1, + 8, + 2, + 2, + 1, + 10, + 22, + 11, + 14, + 4, + 13, + 11, + 24, + 15, + 31, + 8, + 12, + 16, + 8, + 12, + 15, + 4, + 5, + 35, + 9, + 4, + 16, + 16, + 18, + 4, + 21, + 8, + 4, + 1, + 6, + 17, + 0, + 1, + 0, + 13, + 18, + 27, + 15, + 26, + 23, + 3, + 27 + ], + "weighted_loads": [ + 0.3630104549229145, + 0.506224887445569, + 0.2514908201992512, + 0.11428124830126762, + 0.42226587422192097, + 1.8757333420217037, + 0.1962573006749153, + 0.8799289241433144, + 0.8136335350573063, + 0.5375815220177174, + 0.13460449129343033, + 0.14616872742772102, + 0.8409204035997391, + 0.12018951401114464, + 0.35460544377565384, + 0.24607070535421371, + 0.463420070707798, + 0.03509019315242767, + 0.36607344448566437, + 0.08190161362290382, + 0.11246321722865105, + 0.07835856825113297, + 0.38340376131236553, + 1.9392408914864063, + 0.47091384045779705, + 0.6229319199919701, + 0.16554275527596474, + 0.509089982137084, + 0.8121146019548178, + 1.3617579098790884, + 1.0623727776110172, + 2.0788246989250183, + 0.2987610660493374, + 0.532980065792799, + 0.7976205907762051, + 0.5089700780808926, + 0.7288399413228035, + 1.4162256494164467, + 0.15222061052918434, + 0.25175491720438004, + 1.6367094740271568, + 0.34792137518525124, + 0.20202410966157913, + 1.03504728525877, + 1.4790073558688164, + 1.3230470195412636, + 0.24634376540780067, + 1.057444240897894, + 0.29456084966659546, + 0.2080557979643345, + 0.04428902640938759, + 0.17722032219171524, + 0.7997509986162186, + 0.0, + 0.040598683059215546, + 0.0, + 0.7721777260303497, + 1.1113799065351486, + 1.4181877244263887, + 0.6677068639546633, + 1.1401347145438194, + 0.8270064424723387, + 0.13462721183896065, + 1.7725486066192389 + ], + "unique_experts": 62, + "load_cv": 0.7360220071857421, + "normalized_load_entropy": 0.9320439029612025, + "max_load_share": 0.04861111111111111 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "40ed98e10092932f926426119f586fb29eb67df95f45a0f4c9b5f3e8f404c363", + "route_weight_sha256": "6c9a6e9cccebebfa07d086623a8781a6d4c2d57f5aef6d902d206e23b6766329", + "loads": [ + 8, + 14, + 5, + 3, + 20, + 28, + 4, + 17, + 25, + 14, + 7, + 6, + 17, + 2, + 8, + 7, + 29, + 2, + 19, + 3, + 3, + 2, + 12, + 27, + 11, + 15, + 6, + 16, + 23, + 24, + 23, + 38, + 9, + 12, + 21, + 11, + 12, + 15, + 4, + 6, + 40, + 9, + 4, + 43, + 18, + 18, + 5, + 34, + 8, + 8, + 1, + 6, + 17, + 6, + 25, + 8, + 19, + 19, + 30, + 19, + 27, + 31, + 14, + 29 + ], + "weighted_loads": [ + 0.5107127390801907, + 0.5396777335554361, + 0.29890066385269165, + 0.11428124830126762, + 1.0027605015784502, + 2.014002598822117, + 0.1962573006749153, + 1.0086811184883118, + 1.3916617818176746, + 0.5375815220177174, + 0.24362173676490784, + 0.18793900962918997, + 0.8409204035997391, + 0.12018951401114464, + 0.35460544377565384, + 0.28572020307183266, + 2.056522663682699, + 0.04993392154574394, + 1.60127330198884, + 0.1209205873310566, + 0.18623043224215508, + 0.14878114312887192, + 0.4922487232834101, + 2.157264593988657, + 0.47091384045779705, + 0.6679069511592388, + 0.240641001611948, + 0.603605848737061, + 1.714181175455451, + 1.3617579098790884, + 1.4748973827809095, + 2.3899232745170593, + 0.3305351808667183, + 0.532980065792799, + 1.0654697120189667, + 0.8020586110651493, + 0.7288399413228035, + 1.4162256494164467, + 0.15222061052918434, + 0.298422209918499, + 1.8679153621196747, + 0.34792137518525124, + 0.20202410966157913, + 3.420689694583416, + 1.602858629077673, + 1.3230470195412636, + 0.29289256408810616, + 1.999940611422062, + 0.29456084966659546, + 0.47753096371889114, + 0.04428902640938759, + 0.17722032219171524, + 0.7997509986162186, + 0.3540714420378208, + 1.4062437545508146, + 0.3804982006549835, + 1.2431505843997002, + 1.154623907059431, + 1.5672331992536783, + 0.8222429994493723, + 1.180968914180994, + 1.196612410247326, + 0.7062494195997715, + 1.8513157907873392 + ], + "unique_experts": 64, + "load_cv": 0.6830886358939674, + "normalized_load_entropy": 0.9434314759440342, + "max_load_share": 0.044513457556935816 + } + }, + "s0_period": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "15bfb2528e0ad9d395460ebe05d1bc6f88113f00ed5f50d94bafd098b2a89ae1", + "route_weight_sha256": "ba4d65601b7d8ec6a0df8449cb57e93be9ebd28b04aa64ebce8bcd5462c690e6", + "loads": [ + 6, + 11, + 6, + 0, + 9, + 25, + 5, + 16, + 15, + 12, + 2, + 4, + 16, + 2, + 9, + 6, + 10, + 1, + 7, + 2, + 3, + 1, + 11, + 21, + 9, + 15, + 3, + 13, + 12, + 24, + 17, + 31, + 7, + 12, + 18, + 9, + 12, + 15, + 3, + 6, + 34, + 13, + 8, + 16, + 15, + 17, + 3, + 20, + 10, + 4, + 1, + 5, + 15, + 0, + 0, + 2, + 14, + 19, + 27, + 11, + 29, + 20, + 6, + 25 + ], + "weighted_loads": [ + 0.3760494031012058, + 0.41968410089612007, + 0.3300415277481079, + 0.0, + 0.4470357056707144, + 1.850026998668909, + 0.23836402595043182, + 0.9515318460762501, + 0.7905460819602013, + 0.46524957939982414, + 0.08273513987660408, + 0.14284681528806686, + 0.8077040668576956, + 0.12636267952620983, + 0.38254549726843834, + 0.24139348790049553, + 0.4603811800479889, + 0.03627168759703636, + 0.3310761135071516, + 0.07573200762271881, + 0.14874724298715591, + 0.08191703259944916, + 0.4263991601765156, + 1.905282448977232, + 0.3879614360630512, + 0.6590859889984131, + 0.1188390664756298, + 0.4953998699784279, + 0.9267255254089832, + 1.3384764268994331, + 1.1097678896039724, + 2.0687475875020027, + 0.2695943955332041, + 0.5504101328551769, + 0.8490681182593107, + 0.5894563272595406, + 0.7264974005520344, + 1.1292935349047184, + 0.11378725990653038, + 0.2927265390753746, + 1.548407819122076, + 0.5025849938392639, + 0.41474251076579094, + 1.1696949638426304, + 1.4683186151087284, + 1.3626747746020555, + 0.2080201469361782, + 0.9983934797346592, + 0.36515085957944393, + 0.18938118033111095, + 0.04486566409468651, + 0.15144573152065277, + 0.7308412864804268, + 0.0, + 0.0, + 0.0685972049832344, + 0.8512643203139305, + 1.1454750411212444, + 1.4417407885193825, + 0.5137387625873089, + 1.214898806065321, + 0.742757199332118, + 0.2771154157817364, + 1.7449471652507782 + ], + "unique_experts": 61, + "load_cv": 0.7274172134814626, + "normalized_load_entropy": 0.9323632200494342, + "max_load_share": 0.04722222222222222 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "b609329f8daab41fe2a63a9784ee85b7f3420fc3be8a12b03b940c6f47681765", + "route_weight_sha256": "b73eb6c6cc2a88dd530a17b89c61fefb358544bd46f7e2d64b07d24a2c581a4d", + "loads": [ + 6, + 12, + 7, + 0, + 15, + 25, + 5, + 16, + 19, + 14, + 4, + 6, + 16, + 2, + 9, + 13, + 15, + 2, + 19, + 2, + 3, + 1, + 11, + 27, + 9, + 15, + 3, + 14, + 20, + 24, + 23, + 40, + 8, + 12, + 22, + 12, + 12, + 15, + 3, + 6, + 41, + 13, + 8, + 39, + 18, + 17, + 3, + 28, + 10, + 7, + 1, + 6, + 15, + 0, + 6, + 4, + 14, + 19, + 30, + 11, + 30, + 25, + 13, + 25 + ], + "weighted_loads": [ + 0.3760494031012058, + 0.4546593986451626, + 0.38850854337215424, + 0.0, + 0.7576163113117218, + 1.850026998668909, + 0.23836402595043182, + 0.9515318460762501, + 1.0189109295606613, + 0.522898918017745, + 0.1490730158984661, + 0.1846422916278243, + 0.8077040668576956, + 0.12636267952620983, + 0.38254549726843834, + 0.5123425424098969, + 0.9537999592721462, + 0.05111541599035263, + 1.5429206099361181, + 0.07573200762271881, + 0.14874724298715591, + 0.08191703259944916, + 0.4263991601765156, + 2.185520812869072, + 0.3879614360630512, + 0.6590859889984131, + 0.1188390664756298, + 0.5079910708591342, + 1.4848448112607002, + 1.3384764268994331, + 1.4040287546813488, + 2.551110666245222, + 0.3057528268545866, + 0.5504101328551769, + 1.0459211226552725, + 0.8545107692480087, + 0.7264974005520344, + 1.1292935349047184, + 0.11378725990653038, + 0.2927265390753746, + 1.8873827494680882, + 0.5025849938392639, + 0.41474251076579094, + 3.3816590942442417, + 1.6238346621394157, + 1.3626747746020555, + 0.2080201469361782, + 1.5743501372635365, + 0.36515085957944393, + 0.33471050672233105, + 0.04486566409468651, + 0.18720969185233116, + 0.7308412864804268, + 0.0, + 0.3033130783587694, + 0.15079399570822716, + 0.8512643203139305, + 1.1454750411212444, + 1.5752350501716137, + 0.5137387625873089, + 1.2578973211348057, + 0.987368481233716, + 0.6911590024828911, + 1.7449471652507782 + ], + "unique_experts": 62, + "load_cv": 0.7224940289571368, + "normalized_load_entropy": 0.9357448870744906, + "max_load_share": 0.047126436781609195 + } + }, + "s1_period": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "db9e4eaea4ab93d90f742af15c0cebe4460552ae04d596886348deeeeda011df", + "route_weight_sha256": "8af5b8f30de5c9ab6b8d1f78ca9b662f4f7b4b26160264213ba24e41455b8dff", + "loads": [ + 6, + 14, + 6, + 2, + 8, + 24, + 4, + 15, + 15, + 12, + 3, + 4, + 17, + 2, + 9, + 5, + 9, + 1, + 7, + 2, + 2, + 1, + 10, + 21, + 13, + 15, + 4, + 12, + 12, + 24, + 15, + 31, + 8, + 12, + 16, + 8, + 12, + 15, + 4, + 5, + 38, + 11, + 4, + 17, + 15, + 17, + 4, + 22, + 8, + 4, + 1, + 5, + 17, + 0, + 1, + 1, + 13, + 18, + 27, + 13, + 32, + 17, + 3, + 27 + ], + "weighted_loads": [ + 0.3654249869287014, + 0.5488016027957201, + 0.3049914389848709, + 0.08248529210686684, + 0.38705536909401417, + 1.8907965570688248, + 0.19251513481140137, + 0.8956893160939217, + 0.7915269900113344, + 0.46020601131021976, + 0.10730326361954212, + 0.14793587662279606, + 0.8221000079065561, + 0.12071493268013, + 0.38196428306400776, + 0.20447863265872002, + 0.39680764079093933, + 0.031656987965106964, + 0.32828568667173386, + 0.08063609525561333, + 0.11223671212792397, + 0.07933102548122406, + 0.38155848905444145, + 1.9029913134872913, + 0.5187735296785831, + 0.6542327962815762, + 0.16648906469345093, + 0.4878883473575115, + 0.8873880133032799, + 1.3699971623718739, + 1.0510838739573956, + 2.0443406384438276, + 0.2945585176348686, + 0.5398852601647377, + 0.8076116517186165, + 0.5109512694180012, + 0.7239016145467758, + 1.4386932328343391, + 0.15445950999855995, + 0.25199441984295845, + 1.718769259750843, + 0.4305257350206375, + 0.20194363966584206, + 1.080637365579605, + 1.458429604768753, + 1.3228941094130278, + 0.24360327795147896, + 1.0671643316745758, + 0.2946328464895487, + 0.20574335008859634, + 0.04568503797054291, + 0.15197695046663284, + 0.8035068064928055, + 0.0, + 0.043306440114974976, + 0.05242734029889107, + 0.7874566316604614, + 1.1226214207708836, + 1.4264109637588263, + 0.5878928191959858, + 1.3577085509896278, + 0.5969090666621923, + 0.1324959173798561, + 1.7874161079525948 + ], + "unique_experts": 63, + "load_cv": 0.7575138021804138, + "normalized_load_entropy": 0.9305028214855494, + "max_load_share": 0.05277777777777778 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "b7d3cac54115ce9f35a79571e8afca9789c8968b83516414e070e44ece6703bc", + "route_weight_sha256": "57545ef19ae959fdf5fe35611ce678e3a490c793dd433ec9f11df73b6a519c1a", + "loads": [ + 8, + 15, + 7, + 2, + 20, + 30, + 4, + 17, + 25, + 12, + 6, + 6, + 17, + 2, + 10, + 7, + 26, + 2, + 17, + 3, + 3, + 2, + 12, + 26, + 13, + 16, + 6, + 14, + 25, + 24, + 23, + 37, + 9, + 12, + 21, + 13, + 12, + 15, + 4, + 6, + 42, + 11, + 4, + 44, + 17, + 17, + 5, + 35, + 8, + 8, + 1, + 6, + 17, + 5, + 24, + 8, + 19, + 19, + 29, + 17, + 33, + 25, + 14, + 29 + ], + "weighted_loads": [ + 0.5131272710859776, + 0.5822544489055872, + 0.3524012826383114, + 0.08248529210686684, + 1.0379277113825083, + 2.1018582340329885, + 0.19251513481140137, + 1.024441510438919, + 1.3703597132116556, + 0.46020601131021976, + 0.21632050909101963, + 0.189706158824265, + 0.8221000079065561, + 0.12071493268013, + 0.420678598806262, + 0.27783680334687233, + 1.9769108444452286, + 0.04650071635842323, + 1.485650148242712, + 0.1196550689637661, + 0.186003927141428, + 0.149753600358963, + 0.490403451025486, + 2.121015015989542, + 0.5187735296785831, + 0.6994500197470188, + 0.2415873110294342, + 0.5383363058790565, + 1.8630822971463203, + 1.3699971623718739, + 1.4636084791272879, + 2.3061581011861563, + 0.3263326324522495, + 0.5398852601647377, + 1.058574452996254, + 0.9355521984398365, + 0.7239016145467758, + 1.4386932328343391, + 0.15445950999855995, + 0.2986617125570774, + 1.9105193316936493, + 0.4305257350206375, + 0.20194363966584206, + 3.5147950388491154, + 1.5822808779776096, + 1.3228941094130278, + 0.29015207663178444, + 2.0200242549180984, + 0.2946328464895487, + 0.4613613970577717, + 0.04568503797054291, + 0.1909022331237793, + 0.8035068064928055, + 0.3039204850792885, + 1.3599355891346931, + 0.3853542283177376, + 1.2584294900298119, + 1.165865421295166, + 1.528187008574605, + 0.7424289546906948, + 1.3983291052281857, + 0.9739240221679211, + 0.6743025295436382, + 1.8650055304169655 + ], + "unique_experts": 64, + "load_cv": 0.6858941713020541, + "normalized_load_entropy": 0.9433253204441003, + "max_load_share": 0.045548654244306416 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 120, + "ordered_topk_exact_tokens": 68, + "set_exact_tokens": 80, + "mean_set_jaccard": 0.8958333333333334, + "mean_token_weighted_tv": 0.02005651082533101, + "aggregate_load_tv": 0.037500000000000006 + }, + "system_bos": { + "tokens": 120, + "ordered_topk_exact_tokens": 66, + "set_exact_tokens": 82, + "mean_set_jaccard": 0.9005952380952382, + "mean_token_weighted_tv": 0.0200897277565673, + "aggregate_load_tv": 0.030555555555555565 + }, + "system_x": { + "tokens": 120, + "ordered_topk_exact_tokens": 46, + "set_exact_tokens": 68, + "mean_set_jaccard": 0.860515873015873, + "mean_token_weighted_tv": 0.027514488638068237, + "aggregate_load_tv": 0.04722222222222222 + }, + "system_period": { + "tokens": 120, + "ordered_topk_exact_tokens": 49, + "set_exact_tokens": 69, + "mean_set_jaccard": 0.8642857142857143, + "mean_token_weighted_tv": 0.027114962491517267, + "aggregate_load_tv": 0.044444444444444446 + }, + "bos_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 47, + "set_exact_tokens": 67, + "mean_set_jaccard": 0.8688492063492064, + "mean_token_weighted_tv": 0.02465115146866689, + "aggregate_load_tv": 0.041666666666666664 + }, + "bos_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 44, + "set_exact_tokens": 62, + "mean_set_jaccard": 0.8498015873015875, + "mean_token_weighted_tv": 0.0275830566106985, + "aggregate_load_tv": 0.04444444444444446 + }, + "x_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 49, + "set_exact_tokens": 62, + "mean_set_jaccard": 0.851984126984127, + "mean_token_weighted_tv": 0.028678554079184928, + "aggregate_load_tv": 0.05694444444444444 + }, + "x_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 37, + "set_exact_tokens": 54, + "mean_set_jaccard": 0.8196428571428572, + "mean_token_weighted_tv": 0.033831537173440056, + "aggregate_load_tv": 0.058333333333333334 + }, + "period_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 47, + "set_exact_tokens": 63, + "mean_set_jaccard": 0.8557539682539682, + "mean_token_weighted_tv": 0.028395926176259915, + "aggregate_load_tv": 0.052777777777777785 + }, + "period_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 29, + "set_exact_tokens": 50, + "mean_set_jaccard": 0.8140873015873016, + "mean_token_weighted_tv": 0.034326822170987724, + "aggregate_load_tv": 0.05277777777777777 + } + } + }, + "layer_12": { + "layer": 12, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "0f7d702d68f7f0576b6c8003b2812947b51a0e8938694e63b00b4e5e92b005d5", + "route_weight_sha256": "efd5270252b46193f111f522d486e4b54863489071ff5dde9371ea2513f44623", + "loads": [ + 11, + 4, + 9, + 11, + 21, + 3, + 0, + 16, + 30, + 1, + 15, + 2, + 8, + 2, + 19, + 4, + 28, + 4, + 4, + 23, + 6, + 6, + 15, + 16, + 24, + 5, + 9, + 31, + 29, + 17, + 0, + 9, + 14, + 13, + 4, + 3, + 27, + 4, + 14, + 3, + 18, + 14, + 6, + 11, + 1, + 3, + 24, + 9, + 19, + 29, + 2, + 2, + 12, + 8, + 20, + 2, + 3, + 16, + 33, + 5, + 7, + 7, + 3, + 2 + ], + "weighted_loads": [ + 0.6110663786530495, + 0.1525006890296936, + 0.38875482976436615, + 0.47898178175091743, + 2.1181026846170425, + 0.11061875522136688, + 0.0, + 1.1788119710981846, + 2.307135634124279, + 0.030109988525509834, + 0.885820908471942, + 0.11058516427874565, + 0.341726578772068, + 0.0627374704927206, + 1.0472485590726137, + 0.31184694170951843, + 1.36256655305624, + 0.19813840463757515, + 0.3465038388967514, + 0.9978207815438509, + 0.2319425828754902, + 0.5132087543606758, + 0.721289923414588, + 1.4322194531559944, + 1.3242590613663197, + 0.20572549290955067, + 0.35104047134518623, + 2.9051488302648067, + 2.528356123715639, + 1.410098634660244, + 0.0, + 0.4393524508923292, + 0.9982990957796574, + 0.8316603768616915, + 0.22871886938810349, + 0.13495680317282677, + 1.341361090540886, + 0.25048332288861275, + 0.755743196234107, + 0.20463699474930763, + 1.82313278503716, + 0.6372338701039553, + 0.28484351374208927, + 0.6316476538777351, + 0.05011524260044098, + 0.14133560843765736, + 1.5866233371198177, + 0.42733941599726677, + 0.8213272579014301, + 1.44490921869874, + 0.14862307533621788, + 0.0903051383793354, + 0.5256696976721287, + 0.5427166633307934, + 1.5141380280256271, + 0.09450972080230713, + 0.10888439230620861, + 0.7422972097992897, + 2.3700872361660004, + 0.22783131897449493, + 0.32016629725694656, + 0.4203995615243912, + 0.15088955871760845, + 0.08125331625342369 + ], + "unique_experts": 62, + "load_cv": 0.8064554360721802, + "normalized_load_entropy": 0.9211266599321764, + "max_load_share": 0.04583333333333333 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "e269f5c55cf0c6148607265a7d1965ffa759729c19dbb9995dd113474d5c18c7", + "route_weight_sha256": "a6c72502f3568173e08d014c1d1b748ba971959a7328a7a2e742fe671ab74ca1", + "loads": [ + 11, + 4, + 9, + 16, + 25, + 4, + 0, + 19, + 35, + 1, + 15, + 2, + 14, + 2, + 19, + 4, + 32, + 4, + 4, + 23, + 7, + 6, + 16, + 22, + 24, + 5, + 10, + 38, + 44, + 29, + 3, + 14, + 15, + 15, + 4, + 10, + 27, + 8, + 29, + 3, + 18, + 19, + 11, + 11, + 3, + 4, + 24, + 15, + 22, + 29, + 3, + 2, + 12, + 8, + 20, + 2, + 6, + 16, + 36, + 8, + 7, + 11, + 6, + 5 + ], + "weighted_loads": [ + 0.6110663786530495, + 0.1525006890296936, + 0.38875482976436615, + 0.6045855819247663, + 3.739203054457903, + 0.11465597106143832, + 0.0, + 1.4098317585885525, + 2.668964756652713, + 0.030109988525509834, + 0.885820908471942, + 0.11058516427874565, + 0.6302770338952541, + 0.0627374704927206, + 1.0472485590726137, + 0.31184694170951843, + 1.5816428549587727, + 0.19813840463757515, + 0.3465038388967514, + 0.9978207815438509, + 0.23425349313765764, + 0.5132087543606758, + 0.7707258369773626, + 1.914823740720749, + 1.3242590613663197, + 0.20572549290955067, + 0.3837413191795349, + 3.305186279118061, + 4.368141315877438, + 3.0509800910949707, + 0.10624985676258802, + 0.6951498854905367, + 1.044480212032795, + 0.9344388451427221, + 0.22871886938810349, + 0.6322907954454422, + 1.341361090540886, + 0.36509413179010153, + 1.8647134136408567, + 0.20463699474930763, + 1.82313278503716, + 1.1539433617144823, + 0.6053911726921797, + 0.6316476538777351, + 0.1739216223359108, + 0.18070201016962528, + 1.5866233371198177, + 0.762887891381979, + 0.9628320895135403, + 1.44490921869874, + 0.1615621093660593, + 0.0903051383793354, + 0.5256696976721287, + 0.5427166633307934, + 1.5141380280256271, + 0.09450972080230713, + 0.21543731214478612, + 0.7422972097992897, + 2.5735537856817245, + 0.3212408535182476, + 0.32016629725694656, + 0.5762393362820148, + 0.271604185923934, + 0.1796669065952301 + ], + "unique_experts": 63, + "load_cv": 0.7700806305617544, + "normalized_load_entropy": 0.9294597710112645, + "max_load_share": 0.05057471264367816 + } + }, + "s1_eos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "4f99c9d007f9f1f7f3e9e4f6de4f3a8e9fea3b6175598b399e6c5334eb4c976e", + "route_weight_sha256": "179c55f75aa95a4aa9ee6102227d9f9b1668a24c9ac1fb7cfce26445e3017797", + "loads": [ + 10, + 3, + 11, + 12, + 20, + 2, + 0, + 16, + 29, + 1, + 14, + 2, + 8, + 1, + 18, + 4, + 27, + 4, + 4, + 30, + 4, + 6, + 15, + 16, + 26, + 6, + 13, + 31, + 30, + 17, + 0, + 8, + 13, + 12, + 4, + 3, + 26, + 5, + 12, + 3, + 18, + 14, + 6, + 10, + 1, + 2, + 24, + 8, + 20, + 30, + 2, + 1, + 11, + 7, + 20, + 3, + 2, + 18, + 33, + 5, + 7, + 7, + 3, + 2 + ], + "weighted_loads": [ + 0.5722712799906731, + 0.11147907748818398, + 0.45434946194291115, + 0.5201031006872654, + 2.1247927211225033, + 0.07137591391801834, + 0.0, + 1.1751081608235836, + 2.231386996805668, + 0.029734916985034943, + 0.8418256100267172, + 0.10861639678478241, + 0.34521685913205147, + 0.042183756828308105, + 1.061316303908825, + 0.3164439722895622, + 1.3369210436940193, + 0.19750484824180603, + 0.3489481993019581, + 1.2548286449164152, + 0.15444974973797798, + 0.5105474758893251, + 0.7278676480054855, + 1.419573713093996, + 1.4466535449028015, + 0.23638121783733368, + 0.49304725229740143, + 2.8877366110682487, + 2.503425182774663, + 1.3366807624697685, + 0.0, + 0.40384111925959587, + 0.9706580825150013, + 0.7884998135268688, + 0.21882743388414383, + 0.13606048375368118, + 1.350548580288887, + 0.27439360693097115, + 0.6636824775487185, + 0.20361941680312157, + 2.1123093012720346, + 0.6125423908233643, + 0.28440336138010025, + 0.5782742761075497, + 0.05131389945745468, + 0.09053744003176689, + 1.5915985405445099, + 0.43570784479379654, + 0.9066319428384304, + 1.5375788509845734, + 0.13766923546791077, + 0.06028365343809128, + 0.48859338089823723, + 0.48612911254167557, + 1.4923969693481922, + 0.13103223964571953, + 0.07984429225325584, + 0.8117316272109747, + 2.2968017160892487, + 0.23100407049059868, + 0.3044792711734772, + 0.42605171725153923, + 0.15140946581959724, + 0.08075958117842674 + ], + "unique_experts": 62, + "load_cv": 0.8314794192830981, + "normalized_load_entropy": 0.9160329096177354, + "max_load_share": 0.04583333333333333 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "4f7b86b5cc4564e90afb2184f672839d30459d34ca0957d306683e3430c78208", + "route_weight_sha256": "f633343fa17432d5c8c888cc3a7a603f86d0af5832e47dc0c63f88f14b3effe2", + "loads": [ + 14, + 3, + 11, + 15, + 24, + 3, + 0, + 23, + 36, + 4, + 15, + 2, + 11, + 1, + 18, + 4, + 32, + 6, + 5, + 30, + 5, + 8, + 18, + 22, + 26, + 6, + 16, + 38, + 47, + 34, + 11, + 12, + 17, + 17, + 9, + 11, + 26, + 9, + 31, + 3, + 18, + 25, + 13, + 12, + 14, + 6, + 27, + 15, + 26, + 30, + 4, + 1, + 11, + 10, + 20, + 3, + 5, + 24, + 36, + 9, + 9, + 15, + 8, + 2 + ], + "weighted_loads": [ + 0.7621684707701206, + 0.11147907748818398, + 0.45434946194291115, + 0.5750832802150398, + 3.7469081170856953, + 0.07528732484206557, + 0.0, + 1.576058205217123, + 2.741579409688711, + 0.34836242347955704, + 0.8859516736119986, + 0.10861639678478241, + 0.5058882310986519, + 0.042183756828308105, + 1.061316303908825, + 0.3164439722895622, + 1.6585531905293465, + 0.30951788648962975, + 0.38479216769337654, + 1.2548286449164152, + 0.1567793358117342, + 0.6003932561725378, + 0.8504197970032692, + 1.8779612109065056, + 1.4466535449028015, + 0.23638121783733368, + 0.6158125251531601, + 3.2410451471805573, + 4.648218089714646, + 3.774301927536726, + 0.8603563634678721, + 0.6117482054978609, + 1.1477953363209963, + 1.0882962830364704, + 0.4716068506240845, + 0.7431800365447998, + 1.350548580288887, + 0.44931217189878225, + 2.070804977789521, + 0.20361941680312157, + 2.1123093012720346, + 1.6331840604543686, + 0.698439821600914, + 0.6862645670771599, + 1.2663121297955513, + 0.3956359103322029, + 1.7196275778114796, + 0.8338706009089947, + 1.1928035095334053, + 1.5375788509845734, + 0.20291889272630215, + 0.06028365343809128, + 0.48859338089823723, + 0.643975805491209, + 1.4923969693481922, + 0.13103223964571953, + 0.16022138530388474, + 1.0732462089508772, + 2.4973202496767044, + 0.35462381690740585, + 0.3738456778228283, + 0.8308377303183079, + 0.3700997568666935, + 0.08075958117842674 + ], + "unique_experts": 63, + "load_cv": 0.7191838538830827, + "normalized_load_entropy": 0.9365035989376902, + "max_load_share": 0.048654244306418216 + } + }, + "s0_bos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "ed83944704a3c0d5f8549ad6d48f71b28486bb75ab18ae3eae5f5bdf34a7bb10", + "route_weight_sha256": "6f888d94fba5101f2cf339508e3680f8932e0555981b69485de6f3cda649908d", + "loads": [ + 10, + 4, + 10, + 11, + 18, + 4, + 0, + 16, + 28, + 2, + 16, + 3, + 6, + 2, + 19, + 4, + 25, + 4, + 4, + 27, + 5, + 7, + 15, + 16, + 23, + 5, + 10, + 31, + 28, + 17, + 0, + 10, + 14, + 13, + 4, + 3, + 26, + 4, + 11, + 3, + 19, + 17, + 5, + 11, + 1, + 2, + 24, + 9, + 19, + 30, + 2, + 1, + 11, + 8, + 20, + 2, + 4, + 19, + 32, + 6, + 8, + 7, + 3, + 2 + ], + "weighted_loads": [ + 0.5937302857637405, + 0.1520790159702301, + 0.43085111305117607, + 0.4685675296932459, + 2.059374062344432, + 0.14387921430170536, + 0.0, + 1.176611766219139, + 2.2774183433502913, + 0.05981617607176304, + 0.9449479673057795, + 0.14653140306472778, + 0.3054426144808531, + 0.07692233473062515, + 1.0607683546841145, + 0.3302662596106529, + 1.2510546520352364, + 0.19915186613798141, + 0.3457898236811161, + 1.1766883600503206, + 0.19987850449979305, + 0.57261679507792, + 0.7112868241965771, + 1.5079954899847507, + 1.3271040357649326, + 0.20780149474740028, + 0.37745556235313416, + 3.021287467330694, + 2.454451307654381, + 1.4185941256582737, + 0.0, + 0.4606708139181137, + 1.0615780428051949, + 0.8428976442664862, + 0.24240443110466003, + 0.1349191702902317, + 1.3325754702091217, + 0.2571725659072399, + 0.6195853427052498, + 0.22588635236024857, + 1.979898352175951, + 0.7907578982412815, + 0.2575463093817234, + 0.6496240757405758, + 0.050153881311416626, + 0.10955198109149933, + 1.6306775026023388, + 0.4946625679731369, + 0.8247348926961422, + 1.4562924019992352, + 0.1594335064291954, + 0.07121569663286209, + 0.4820232428610325, + 0.5424707271158695, + 1.583951860666275, + 0.08311403915286064, + 0.13628878816962242, + 0.8908775001764297, + 2.232876144349575, + 0.271913792937994, + 0.3551308549940586, + 0.4343964233994484, + 0.1535253580659628, + 0.07856885343790054 + ], + "unique_experts": 62, + "load_cv": 0.7950463919999252, + "normalized_load_entropy": 0.922742317394949, + "max_load_share": 0.044444444444444446 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "ebc8e03a72e0bd104d68eec529d9dc9708f015fcf1a075ba4a86702c08ab3c85", + "route_weight_sha256": "1c83de683bfde0054acf862aa4716eb328c35acd4194415be97f332fb1fcd041", + "loads": [ + 11, + 4, + 10, + 15, + 21, + 4, + 0, + 19, + 34, + 2, + 16, + 3, + 13, + 2, + 19, + 4, + 30, + 4, + 4, + 27, + 5, + 7, + 16, + 23, + 23, + 5, + 12, + 38, + 44, + 29, + 2, + 16, + 15, + 15, + 4, + 10, + 26, + 8, + 26, + 3, + 19, + 22, + 9, + 11, + 3, + 3, + 24, + 14, + 22, + 30, + 3, + 1, + 11, + 8, + 20, + 2, + 6, + 19, + 35, + 9, + 8, + 11, + 6, + 5 + ], + "weighted_loads": [ + 0.6488248743116856, + 0.1520790159702301, + 0.43085111305117607, + 0.5910843703895807, + 2.729867847636342, + 0.14387921430170536, + 0.0, + 1.4092474430799484, + 2.7264867536723614, + 0.05981617607176304, + 0.9449479673057795, + 0.14653140306472778, + 0.6843745317310095, + 0.07692233473062515, + 1.0607683546841145, + 0.3302662596106529, + 1.4684501513838768, + 0.19915186613798141, + 0.3457898236811161, + 1.1766883600503206, + 0.19987850449979305, + 0.57261679507792, + 0.7607227377593517, + 2.035326484590769, + 1.3271040357649326, + 0.20780149474740028, + 0.4530773349106312, + 3.4213249161839485, + 4.285515774041414, + 3.177993491292, + 0.06287556421011686, + 0.7788060717284679, + 1.1077591590583324, + 0.9369160439819098, + 0.24240443110466003, + 0.6322531625628471, + 1.3325754702091217, + 0.3717833748087287, + 1.7405078262090683, + 0.22588635236024857, + 1.979898352175951, + 1.2424347288906574, + 0.5340174995362759, + 0.6496240757405758, + 0.17140235751867294, + 0.14891838282346725, + 1.6306775026023388, + 0.7637936808168888, + 0.9538002796471119, + 1.4562924019992352, + 0.17237254045903683, + 0.07121569663286209, + 0.4820232428610325, + 0.5424707271158695, + 1.583951860666275, + 0.08311403915286064, + 0.23826274648308754, + 0.8908775001764297, + 2.4397084191441536, + 0.41782341338694096, + 0.3551308549940586, + 0.5902361981570721, + 0.2742399852722883, + 0.17698244377970695 + ], + "unique_experts": 63, + "load_cv": 0.7631318327872572, + "normalized_load_entropy": 0.9299082612847811, + "max_load_share": 0.05057471264367816 + } + }, + "s1_bos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "8c7383b84468ad0231464fe7504574ed665f7347a318f36899e96d9cfad0a24a", + "route_weight_sha256": "046eb449411b15965ea10a2e7373fa429e9be973b743db08a95285198083fd71", + "loads": [ + 11, + 3, + 11, + 9, + 18, + 3, + 0, + 16, + 29, + 1, + 16, + 2, + 9, + 1, + 19, + 4, + 26, + 4, + 4, + 31, + 5, + 7, + 13, + 16, + 24, + 6, + 8, + 30, + 29, + 16, + 0, + 13, + 14, + 13, + 4, + 4, + 26, + 4, + 11, + 3, + 19, + 16, + 7, + 10, + 1, + 2, + 24, + 7, + 18, + 32, + 2, + 1, + 11, + 7, + 21, + 2, + 3, + 18, + 32, + 6, + 6, + 7, + 3, + 2 + ], + "weighted_loads": [ + 0.6043025981634855, + 0.10759362205862999, + 0.464314803481102, + 0.3894801866263151, + 2.078065536916256, + 0.1097513884305954, + 0.0, + 1.1679146736860275, + 2.279999788850546, + 0.028456490486860275, + 0.9367461800575256, + 0.107241902500391, + 0.443630812689662, + 0.03430042415857315, + 1.076895885169506, + 0.3150860518217087, + 1.2864119056612253, + 0.20068268105387688, + 0.3501382879912853, + 1.29940433986485, + 0.1764877736568451, + 0.5795737784355879, + 0.6684290282428265, + 1.4589962735772133, + 1.4077355787158012, + 0.24159863218665123, + 0.3246365040540695, + 2.949005361646414, + 2.4970138631761074, + 1.3585829734802246, + 0.0, + 0.5793720129877329, + 1.0186984203755856, + 0.8123296461999416, + 0.24675867334008217, + 0.16365422867238522, + 1.39272128790617, + 0.24941246956586838, + 0.5682107377797365, + 0.2135162465274334, + 2.1894526295363903, + 0.769743712618947, + 0.3345816396176815, + 0.5871965549886227, + 0.04760908707976341, + 0.09184958972036839, + 1.6057748198509216, + 0.3832436352968216, + 0.8391263373196125, + 1.5876903217285872, + 0.14634082093834877, + 0.0680534765124321, + 0.48327813297510147, + 0.49345749616622925, + 1.5910607911646366, + 0.09107017144560814, + 0.11589770764112473, + 0.8306146562099457, + 2.2397174425423145, + 0.2795180678367615, + 0.27242570742964745, + 0.4292442239820957, + 0.15258801728487015, + 0.07786458358168602 + ], + "unique_experts": 62, + "load_cv": 0.8214711284122009, + "normalized_load_entropy": 0.9180471610933412, + "max_load_share": 0.044444444444444446 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "b1ee2a9b20f9ff5d3a848e5c53ae11b44d825bdd732dc311ccc7089685ea372e", + "route_weight_sha256": "8d18f51567e537ee589c1ce1808df8cbb65174e09058f145d301a1570e795f23", + "loads": [ + 15, + 3, + 11, + 11, + 21, + 3, + 0, + 23, + 36, + 4, + 17, + 2, + 13, + 1, + 19, + 4, + 34, + 6, + 5, + 31, + 5, + 9, + 16, + 22, + 24, + 6, + 11, + 37, + 46, + 34, + 11, + 18, + 18, + 18, + 9, + 12, + 26, + 8, + 30, + 3, + 19, + 27, + 13, + 13, + 14, + 6, + 26, + 15, + 24, + 32, + 4, + 1, + 11, + 10, + 21, + 2, + 4, + 24, + 35, + 10, + 8, + 15, + 8, + 2 + ], + "weighted_loads": [ + 0.7941997889429331, + 0.10759362205862999, + 0.464314803481102, + 0.4415199514478445, + 2.749693974852562, + 0.1097513884305954, + 0.0, + 1.5689379498362541, + 2.842059090733528, + 0.34708399698138237, + 0.980872243642807, + 0.107241902500391, + 0.7368195746093988, + 0.03430042415857315, + 1.076895885169506, + 0.3150860518217087, + 1.723055051639676, + 0.3126957193017006, + 0.3859822563827038, + 1.29940433986485, + 0.1764877736568451, + 0.6694195587188005, + 0.7909811772406101, + 1.9173837713897228, + 1.4077355787158012, + 0.24159863218665123, + 0.4474017769098282, + 3.3023138977587223, + 4.762248277664185, + 3.9751062355935574, + 0.8603563634678721, + 0.833156056702137, + 1.1958356741815805, + 1.1137063950300217, + 0.4995380900800228, + 0.7707737814635038, + 1.39272128790617, + 0.4243310345336795, + 2.0859175827354193, + 0.2135162465274334, + 2.1894526295363903, + 1.7695847023278475, + 0.7009264416992664, + 0.730757437646389, + 1.2566860504448414, + 0.3969480600208044, + 1.6952685490250587, + 0.8088467083871365, + 1.115941558033228, + 1.5876903217285872, + 0.21159047819674015, + 0.0680534765124321, + 0.48327813297510147, + 0.6513041891157627, + 1.5910607911646366, + 0.09107017144560814, + 0.14361100271344185, + 1.0921292379498482, + 2.4519845321774483, + 0.4371479172259569, + 0.34179211407899857, + 0.8340302370488644, + 0.3712783083319664, + 0.07786458358168602 + ], + "unique_experts": 63, + "load_cv": 0.7176564031473022, + "normalized_load_entropy": 0.9361054977163619, + "max_load_share": 0.047619047619047616 + } + }, + "s0_x": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "5218fbf4cbeae22f8219dc6e37bd29130a2b35c72e25464fbfaba81aedce2b9e", + "route_weight_sha256": "9c97a7e6e133b0027e4aed16bbb857d7fc88617c29858947ff94f1df6aa383d1", + "loads": [ + 9, + 3, + 10, + 12, + 21, + 2, + 0, + 17, + 30, + 1, + 15, + 2, + 4, + 1, + 18, + 4, + 24, + 4, + 5, + 28, + 6, + 9, + 14, + 16, + 22, + 5, + 10, + 31, + 30, + 17, + 0, + 8, + 15, + 13, + 5, + 4, + 22, + 4, + 13, + 3, + 17, + 16, + 6, + 10, + 1, + 3, + 24, + 8, + 16, + 29, + 2, + 1, + 11, + 7, + 21, + 3, + 2, + 23, + 35, + 6, + 9, + 7, + 4, + 2 + ], + "weighted_loads": [ + 0.5594722144305706, + 0.11730436608195305, + 0.43982965126633644, + 0.4896186776459217, + 2.168600967153907, + 0.07468758150935173, + 0.0, + 1.2543590851128101, + 2.4186817035079002, + 0.028180118650197983, + 0.9247710015624762, + 0.11224795505404472, + 0.19773617014288902, + 0.03395809233188629, + 1.0246776193380356, + 0.314847094938159, + 1.2091451957821846, + 0.20648819208145142, + 0.3770569898188114, + 1.1915544122457504, + 0.23338123597204685, + 0.6391055714339018, + 0.6775560807436705, + 1.4896303452551365, + 1.2817221283912659, + 0.21276108920574188, + 0.3864468913525343, + 3.0861247163265944, + 2.6177278719842434, + 1.3228085786104202, + 0.0, + 0.3988668266683817, + 1.1319903433322906, + 0.8625181466341019, + 0.27018488571047783, + 0.1663838680833578, + 1.1956784296780825, + 0.25518814846873283, + 0.6929600313305855, + 0.22768369317054749, + 1.7118011824786663, + 0.7545840349048376, + 0.30011963471770287, + 0.6583584882318974, + 0.04808974266052246, + 0.1396825797855854, + 1.6527543403208256, + 0.4604930765926838, + 0.7090425901114941, + 1.3902559094130993, + 0.17038366943597794, + 0.068669393658638, + 0.4861187972128391, + 0.5084373652935028, + 1.6656951792538166, + 0.1265179179608822, + 0.08282851800322533, + 1.0767694097012281, + 2.4675303362309933, + 0.2589627206325531, + 0.39002566412091255, + 0.43668584525585175, + 0.1795163620263338, + 0.07852867245674133 + ], + "unique_experts": 62, + "load_cv": 0.8133151181931156, + "normalized_load_entropy": 0.919461970439204, + "max_load_share": 0.04861111111111111 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "048c4a760d13f95990e35b9b909f53dbfca31554f49958f08774177e8cea22c1", + "route_weight_sha256": "ffc1b3661a4851edeb327d662ab555ac90ad06edcadb0d7cd62ae6f0f63e78ee", + "loads": [ + 9, + 3, + 10, + 16, + 24, + 2, + 0, + 20, + 36, + 1, + 15, + 2, + 10, + 1, + 18, + 4, + 27, + 4, + 5, + 28, + 6, + 9, + 15, + 24, + 22, + 5, + 11, + 39, + 48, + 28, + 3, + 13, + 16, + 15, + 5, + 12, + 22, + 8, + 27, + 3, + 17, + 21, + 11, + 10, + 3, + 5, + 24, + 13, + 19, + 29, + 3, + 1, + 11, + 7, + 21, + 3, + 4, + 23, + 38, + 8, + 9, + 12, + 7, + 5 + ], + "weighted_loads": [ + 0.5594722144305706, + 0.11730436608195305, + 0.43982965126633644, + 0.6121355183422565, + 2.839094752445817, + 0.07468758150935173, + 0.0, + 1.4899824000895023, + 2.808932254090905, + 0.028180118650197983, + 0.9247710015624762, + 0.11224795505404472, + 0.49374912679195404, + 0.03395809233188629, + 1.0246776193380356, + 0.314847094938159, + 1.354709055274725, + 0.20648819208145142, + 0.3770569898188114, + 1.1915544122457504, + 0.23338123597204685, + 0.6391055714339018, + 0.7269919943064451, + 2.1607878506183624, + 1.2817221283912659, + 0.21276108920574188, + 0.419147739186883, + 3.5426288936287165, + 4.762125834822655, + 2.819647867232561, + 0.11655731778591871, + 0.6618673894554377, + 1.1781714595854282, + 0.9545860663056374, + 0.27018488571047783, + 0.7397394347935915, + 1.1956784296780825, + 0.3697989573702216, + 1.6500609517097473, + 0.22768369317054749, + 1.7118011824786663, + 1.231890371069312, + 0.6184407770633698, + 0.6583584882318974, + 0.17897729575634003, + 0.23049018904566765, + 1.6527543403208256, + 0.7131933942437172, + 0.8438716419041157, + 1.3902559094130993, + 0.18332270346581936, + 0.068669393658638, + 0.4861187972128391, + 0.5084373652935028, + 1.6656951792538166, + 0.1265179179608822, + 0.18480247631669044, + 1.0767694097012281, + 2.6675127036869526, + 0.3439286220818758, + 0.39002566412091255, + 0.6639059595763683, + 0.30023098923265934, + 0.17694226279854774 + ], + "unique_experts": 63, + "load_cv": 0.7859480652118176, + "normalized_load_entropy": 0.9270937565340988, + "max_load_share": 0.05517241379310345 + } + }, + "s1_x": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "53a311598ec9a19f4626fcbfcab75d58099ae8582fc516a88d556ff524131036", + "route_weight_sha256": "e61e4a2236917952b44f8a7768aedab554be2818c8ce55c2218c03a4da67bed6", + "loads": [ + 11, + 3, + 10, + 10, + 18, + 3, + 0, + 16, + 31, + 1, + 17, + 2, + 5, + 1, + 18, + 5, + 24, + 4, + 4, + 28, + 4, + 7, + 13, + 16, + 24, + 5, + 9, + 33, + 29, + 16, + 1, + 9, + 14, + 13, + 4, + 5, + 25, + 4, + 12, + 3, + 17, + 15, + 7, + 10, + 1, + 2, + 25, + 8, + 22, + 30, + 2, + 2, + 11, + 7, + 23, + 3, + 2, + 18, + 33, + 5, + 7, + 7, + 3, + 3 + ], + "weighted_loads": [ + 0.6049109417945147, + 0.11060485988855362, + 0.41463977843523026, + 0.40401422418653965, + 2.1013402342796326, + 0.1026761643588543, + 0.0, + 1.2214978449046612, + 2.4283609203994274, + 0.030563637614250183, + 0.9595177061855793, + 0.1061176210641861, + 0.23700958862900734, + 0.03230869024991989, + 1.0287912525236607, + 0.3814840167760849, + 1.1970086321234703, + 0.20381790027022362, + 0.35539187490940094, + 1.1427315510809422, + 0.14895392768085003, + 0.54472173191607, + 0.6768403127789497, + 1.4465769864618778, + 1.4131045565009117, + 0.2134261578321457, + 0.35433570481836796, + 3.109936747699976, + 2.596209343522787, + 1.1558940634131432, + 0.03688614070415497, + 0.4203167147934437, + 0.990203507244587, + 0.7776469830423594, + 0.22150834277272224, + 0.20085223205387592, + 1.3705279342830181, + 0.2522832341492176, + 0.6228155605494976, + 0.20285531878471375, + 2.005760505795479, + 0.7025912087410688, + 0.3469640836119652, + 0.5609215572476387, + 0.048843879252672195, + 0.09228461794555187, + 1.6804290190339088, + 0.4162264000624418, + 0.9896839000284672, + 1.5211048368364573, + 0.14369599148631096, + 0.09705070964992046, + 0.4840549975633621, + 0.5000831186771393, + 1.7308945674449205, + 0.13323626294732094, + 0.08111051470041275, + 0.8669396601617336, + 2.400800071656704, + 0.22545136138796806, + 0.3105430919677019, + 0.43882938474416733, + 0.14273606054484844, + 0.1056537851691246 + ], + "unique_experts": 63, + "load_cv": 0.8237223552378061, + "normalized_load_entropy": 0.9193434402423672, + "max_load_share": 0.04583333333333333 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "a1a648932a63eb83b0c3a70f5143e1742e98453bb8fe54af52c531c9dcdf57ab", + "route_weight_sha256": "6960af1ea84caf4f95d9a106ba97ee6e0fee6673059f5d210d716da920978001", + "loads": [ + 15, + 3, + 10, + 12, + 21, + 3, + 0, + 23, + 38, + 4, + 18, + 2, + 8, + 1, + 18, + 5, + 29, + 6, + 5, + 28, + 4, + 10, + 16, + 23, + 24, + 5, + 12, + 41, + 48, + 31, + 13, + 13, + 18, + 17, + 9, + 14, + 25, + 9, + 30, + 3, + 17, + 26, + 15, + 12, + 14, + 7, + 28, + 14, + 27, + 30, + 4, + 2, + 11, + 10, + 23, + 3, + 3, + 27, + 35, + 8, + 9, + 16, + 8, + 3 + ], + "weighted_loads": [ + 0.7948081325739622, + 0.11060485988855362, + 0.41463977843523026, + 0.45605398900806904, + 2.7729686722159386, + 0.1026761643588543, + 0.0, + 1.6334216184914112, + 2.92582580819726, + 0.3491911441087723, + 1.0036437697708607, + 0.1061176210641861, + 0.3776663765311241, + 0.03230869024991989, + 1.0287912525236607, + 0.3814840167760849, + 1.4855769835412502, + 0.31583093851804733, + 0.3912358433008194, + 1.1427315510809422, + 0.14895392768085003, + 0.6650396101176739, + 0.7993924617767334, + 2.036151595413685, + 1.4131045565009117, + 0.2134261578321457, + 0.4771009776741266, + 3.537848223000765, + 5.06310386583209, + 3.2808787003159523, + 0.9436411028727889, + 0.6424681190401316, + 1.167340761050582, + 1.0216962080448866, + 0.4742877595126629, + 0.9081313777714968, + 1.3705279342830181, + 0.4582664826884866, + 1.8734334893524647, + 0.20285531878471375, + 2.005760505795479, + 1.7394921761006117, + 0.8373082242906094, + 0.6689118482172489, + 1.2499970123171806, + 0.4386180844157934, + 1.8116332776844501, + 0.7141819652169943, + 1.2110040448606014, + 1.5211048368364573, + 0.20894564874470234, + 0.09705070964992046, + 0.4840549975633621, + 0.6579298116266727, + 1.7308945674449205, + 0.13323626294732094, + 0.10882380977272987, + 1.257739495486021, + 2.577696770429611, + 0.3412484172731638, + 0.37990949861705303, + 0.8970591127872467, + 0.3614263515919447, + 0.1056537851691246 + ], + "unique_experts": 63, + "load_cv": 0.7221340957069443, + "normalized_load_entropy": 0.9365318981746524, + "max_load_share": 0.049689440993788817 + } + }, + "s0_period": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "c146b2a80496b0336eb52ebfa5c08f4e8673fa107555936cd58198d4d22f1d27", + "route_weight_sha256": "8f60a33cac047d6e38f723460d9622237f9b2611ee1582dcb96c27c51012a313", + "loads": [ + 10, + 3, + 10, + 10, + 20, + 2, + 0, + 17, + 29, + 1, + 16, + 2, + 5, + 2, + 18, + 3, + 22, + 4, + 5, + 26, + 5, + 9, + 15, + 16, + 21, + 5, + 11, + 32, + 29, + 18, + 1, + 9, + 15, + 13, + 4, + 3, + 25, + 4, + 14, + 3, + 17, + 15, + 7, + 9, + 1, + 3, + 24, + 8, + 17, + 30, + 2, + 1, + 11, + 7, + 22, + 3, + 1, + 22, + 34, + 6, + 10, + 7, + 3, + 3 + ], + "weighted_loads": [ + 0.6025878190994263, + 0.11716916039586067, + 0.43769480660557747, + 0.41459302976727486, + 2.1528949681669474, + 0.07043130323290825, + 0.0, + 1.2579310238361359, + 2.4456080961972475, + 0.029033692553639412, + 0.9690666850656271, + 0.11106298863887787, + 0.24491703510284424, + 0.06662852689623833, + 1.0110072195529938, + 0.28896579146385193, + 1.1191342175006866, + 0.20280999317765236, + 0.38107474334537983, + 1.0742547139525414, + 0.20055226236581802, + 0.6334006674587727, + 0.7030948735773563, + 1.487579483538866, + 1.224204309284687, + 0.21254632994532585, + 0.4319285824894905, + 3.1173434741795063, + 2.5644226167351007, + 1.376636829227209, + 0.023279227316379547, + 0.4263101574033499, + 1.113375511020422, + 0.8529867567121983, + 0.23580073192715645, + 0.14489684998989105, + 1.3034990690648556, + 0.25070933625102043, + 0.7187580857425928, + 0.22092274203896523, + 1.749642014503479, + 0.7368536405265331, + 0.32916337810456753, + 0.6065773107111454, + 0.04628133773803711, + 0.13965535908937454, + 1.6492663584649563, + 0.456671092659235, + 0.7676549889147282, + 1.4115316364914179, + 0.16553957015275955, + 0.06789520382881165, + 0.4950491413474083, + 0.5122909769415855, + 1.6922825686633587, + 0.1339876614511013, + 0.04801323637366295, + 1.030743332579732, + 2.432804364711046, + 0.25718915835022926, + 0.43722227960824966, + 0.4484070800244808, + 0.14543840661644936, + 0.10593622177839279 + ], + "unique_experts": 63, + "load_cv": 0.8067615493631709, + "normalized_load_entropy": 0.9207252484722058, + "max_load_share": 0.04722222222222222 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "6eaad347126b1ccd4a1ecfc96eeeccb90b5d504615dfda0ad2760701b3151288", + "route_weight_sha256": "8c825477eeb18a3ac41579f17c2ad7fb170b99fc4fe2622a697a414d97983a13", + "loads": [ + 10, + 3, + 10, + 14, + 23, + 2, + 0, + 20, + 35, + 1, + 16, + 2, + 11, + 2, + 18, + 3, + 25, + 4, + 5, + 26, + 5, + 9, + 16, + 24, + 21, + 5, + 12, + 40, + 47, + 29, + 3, + 14, + 16, + 15, + 4, + 11, + 25, + 8, + 28, + 3, + 17, + 21, + 12, + 9, + 3, + 4, + 24, + 14, + 19, + 30, + 3, + 1, + 11, + 7, + 22, + 3, + 3, + 22, + 37, + 8, + 10, + 12, + 7, + 6 + ], + "weighted_loads": [ + 0.6025878190994263, + 0.11716916039586067, + 0.43769480660557747, + 0.5371098704636097, + 2.8233887534588575, + 0.07043130323290825, + 0.0, + 1.4978220388293266, + 2.8455930277705193, + 0.029033692553639412, + 0.9690666850656271, + 0.11106298863887787, + 0.5468560084700584, + 0.06662852689623833, + 1.0110072195529938, + 0.28896579146385193, + 1.2670903280377388, + 0.20280999317765236, + 0.38107474334537983, + 1.0742547139525414, + 0.20055226236581802, + 0.6334006674587727, + 0.752530787140131, + 2.0704927891492844, + 1.224204309284687, + 0.21254632994532585, + 0.4646294303238392, + 3.554607428610325, + 4.782564276829362, + 2.8883898556232452, + 0.08615479152649641, + 0.6858308892697096, + 1.1595566272735596, + 0.9423737153410912, + 0.23580073192715645, + 0.6911731474101543, + 1.3034990690648556, + 0.3653201451525092, + 1.6746047381311655, + 0.22092274203896523, + 1.749642014503479, + 1.3047306574881077, + 0.6468340177088976, + 0.6065773107111454, + 0.17342349141836166, + 0.17902176082134247, + 1.6492663584649563, + 0.7397179324179888, + 0.8637836948037148, + 1.4115316364914179, + 0.17847860418260098, + 0.06789520382881165, + 0.4950491413474083, + 0.5122909769415855, + 1.6922825686633587, + 0.1339876614511013, + 0.14998719468712807, + 1.030743332579732, + 2.6259789653122425, + 0.34215505979955196, + 0.43722227960824966, + 0.657015010714531, + 0.314940195530653, + 0.2043498121201992 + ], + "unique_experts": 63, + "load_cv": 0.7824978045401701, + "normalized_load_entropy": 0.9271045764331027, + "max_load_share": 0.054022988505747126 + } + }, + "s1_period": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "f1a96f10b5d4d634f1ea53e3c2b1a2397061547efcc39cdf3787dc11913c1a18", + "route_weight_sha256": "df085efc0e42c9272fa1ff0ba8215f1b4da74702ce3bfa4ec10356a231371e0b", + "loads": [ + 10, + 3, + 11, + 10, + 18, + 2, + 0, + 17, + 31, + 1, + 16, + 2, + 6, + 0, + 18, + 5, + 23, + 4, + 4, + 25, + 5, + 7, + 14, + 17, + 24, + 5, + 10, + 32, + 29, + 16, + 0, + 11, + 14, + 12, + 4, + 5, + 25, + 4, + 14, + 3, + 17, + 16, + 6, + 11, + 1, + 2, + 25, + 7, + 19, + 31, + 2, + 2, + 11, + 7, + 23, + 2, + 2, + 21, + 33, + 6, + 6, + 7, + 3, + 3 + ], + "weighted_loads": [ + 0.5790975503623486, + 0.10833084583282471, + 0.4496662002056837, + 0.40982708148658276, + 2.0961502250283957, + 0.06926693767309189, + 0.0, + 1.2586392275989056, + 2.441268589347601, + 0.02903834730386734, + 0.9235689491033554, + 0.10776429623365402, + 0.29006683081388474, + 0.0, + 1.0112998336553574, + 0.37480466440320015, + 1.1586610898375511, + 0.20315416157245636, + 0.3559959642589092, + 1.0439008548855782, + 0.18900278583168983, + 0.5286353584378958, + 0.7072175107896328, + 1.4822292551398277, + 1.4279585778713226, + 0.2098344899713993, + 0.40221233293414116, + 3.0751951076090336, + 2.6024938262999058, + 1.08610101044178, + 0.0, + 0.49630846083164215, + 0.969839408993721, + 0.731840293854475, + 0.22883283719420433, + 0.1995009295642376, + 1.3914205953478813, + 0.24823657423257828, + 0.6716113090515137, + 0.2037782184779644, + 1.9989802613854408, + 0.7322251200675964, + 0.31837155297398567, + 0.5925104394555092, + 0.04761672392487526, + 0.09380500204861164, + 1.6955571100115776, + 0.35291519947350025, + 0.8281896449625492, + 1.5147396996617317, + 0.14287102594971657, + 0.09343797899782658, + 0.4883161596953869, + 0.5032783038914204, + 1.7245176769793034, + 0.09767095744609833, + 0.07503773272037506, + 0.997718958184123, + 2.4435270689427853, + 0.2567087560892105, + 0.2989324890077114, + 0.4546012133359909, + 0.14536897465586662, + 0.10625367797911167 + ], + "unique_experts": 61, + "load_cv": 0.8207193472275284, + "normalized_load_entropy": 0.9173110659616405, + "max_load_share": 0.04583333333333333 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "c0e67607ae9eb2989700eeca547217a071a4257cfc30c1718f17fbde9ab70893", + "route_weight_sha256": "11f967d3a56ccc5a80adaf29447182389d04ac003a2549a84daba2460e93232e", + "loads": [ + 14, + 3, + 11, + 12, + 21, + 2, + 0, + 24, + 38, + 4, + 17, + 2, + 8, + 0, + 18, + 5, + 27, + 6, + 5, + 25, + 5, + 9, + 17, + 24, + 24, + 5, + 13, + 40, + 48, + 32, + 12, + 15, + 18, + 16, + 9, + 14, + 25, + 8, + 33, + 3, + 17, + 28, + 14, + 13, + 14, + 6, + 28, + 13, + 25, + 31, + 4, + 2, + 11, + 10, + 23, + 2, + 3, + 30, + 36, + 9, + 8, + 16, + 8, + 3 + ], + "weighted_loads": [ + 0.7689947411417961, + 0.10833084583282471, + 0.4496662002056837, + 0.46186684630811214, + 2.7677786629647017, + 0.06926693767309189, + 0.0, + 1.671766210347414, + 2.9533964321017265, + 0.34766585379838943, + 0.9676950126886368, + 0.10776429623365402, + 0.3770649954676628, + 0.0, + 1.0112998336553574, + 0.37480466440320015, + 1.4150214083492756, + 0.3151671998202801, + 0.3918399326503277, + 1.0439008548855782, + 0.18900278583168983, + 0.6184811387211084, + 0.8297696597874165, + 1.9912651553750038, + 1.4279585778713226, + 0.2098344899713993, + 0.5249776057898998, + 3.4572883509099483, + 5.094859000295401, + 3.2399851009249687, + 0.8963988600298762, + 0.719143757596612, + 1.146976662799716, + 0.9758895188570023, + 0.481612253934145, + 0.8627959936857224, + 1.3914205953478813, + 0.4231551392003894, + 1.967499129474163, + 0.2037782184779644, + 1.9989802613854408, + 1.8771653175354004, + 0.8199650347232819, + 0.7005007304251194, + 1.2497736476361752, + 0.39890347234904766, + 1.8279115185141563, + 0.6431419681757689, + 1.0852258242666721, + 1.5147396996617317, + 0.20812068320810795, + 0.09343797899782658, + 0.4883161596953869, + 0.6611249968409538, + 1.7245176769793034, + 0.09767095744609833, + 0.10275102779269218, + 1.3800259660929441, + 2.6448505222797394, + 0.37250581197440624, + 0.36829889565706253, + 0.9164173603057861, + 0.3640592657029629, + 0.10625367797911167 + ], + "unique_experts": 62, + "load_cv": 0.7330683779935113, + "normalized_load_entropy": 0.9338459378406336, + "max_load_share": 0.049689440993788817 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 120, + "ordered_topk_exact_tokens": 68, + "set_exact_tokens": 80, + "mean_set_jaccard": 0.9011904761904763, + "mean_token_weighted_tv": 0.021521846911249063, + "aggregate_load_tv": 0.033333333333333326 + }, + "system_bos": { + "tokens": 120, + "ordered_topk_exact_tokens": 64, + "set_exact_tokens": 86, + "mean_set_jaccard": 0.9119047619047619, + "mean_token_weighted_tv": 0.02151459492743015, + "aggregate_load_tv": 0.03194444444444445 + }, + "system_x": { + "tokens": 120, + "ordered_topk_exact_tokens": 56, + "set_exact_tokens": 69, + "mean_set_jaccard": 0.867857142857143, + "mean_token_weighted_tv": 0.030430223086538415, + "aggregate_load_tv": 0.043055555555555555 + }, + "system_period": { + "tokens": 120, + "ordered_topk_exact_tokens": 61, + "set_exact_tokens": 75, + "mean_set_jaccard": 0.8875000000000001, + "mean_token_weighted_tv": 0.02757242354564369, + "aggregate_load_tv": 0.03472222222222222 + }, + "bos_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 53, + "set_exact_tokens": 83, + "mean_set_jaccard": 0.9029761904761905, + "mean_token_weighted_tv": 0.024787971811989943, + "aggregate_load_tv": 0.03194444444444444 + }, + "bos_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 50, + "set_exact_tokens": 75, + "mean_set_jaccard": 0.8803571428571428, + "mean_token_weighted_tv": 0.028519211965613068, + "aggregate_load_tv": 0.03611111111111111 + }, + "x_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 56, + "set_exact_tokens": 75, + "mean_set_jaccard": 0.8843253968253968, + "mean_token_weighted_tv": 0.029416865079353254, + "aggregate_load_tv": 0.047222222222222214 + }, + "x_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 54, + "set_exact_tokens": 70, + "mean_set_jaccard": 0.8688492063492064, + "mean_token_weighted_tv": 0.0322742586179326, + "aggregate_load_tv": 0.037499999999999985 + }, + "period_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 53, + "set_exact_tokens": 70, + "mean_set_jaccard": 0.8706349206349207, + "mean_token_weighted_tv": 0.03083067797900488, + "aggregate_load_tv": 0.04722222222222222 + }, + "period_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 48, + "set_exact_tokens": 69, + "mean_set_jaccard": 0.8642857142857142, + "mean_token_weighted_tv": 0.03369995024986565, + "aggregate_load_tv": 0.04444444444444444 + } + } + }, + "layer_13": { + "layer": 13, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "5af5a265dcc5e9fbf41c7e6a9835ddba91007f9ace9bcec2875487a2daa5e767", + "route_weight_sha256": "3396b58920cdb4ecde63b8065dd591b94b0833bd29aaf02123d02ffd99c08d06", + "loads": [ + 5, + 12, + 13, + 12, + 12, + 18, + 8, + 16, + 2, + 1, + 22, + 7, + 15, + 8, + 17, + 3, + 7, + 7, + 26, + 5, + 11, + 9, + 7, + 11, + 15, + 23, + 13, + 14, + 41, + 9, + 3, + 3, + 1, + 18, + 8, + 5, + 15, + 15, + 2, + 6, + 5, + 2, + 17, + 41, + 25, + 12, + 0, + 14, + 5, + 12, + 13, + 8, + 17, + 7, + 11, + 8, + 9, + 1, + 5, + 19, + 1, + 17, + 9, + 17 + ], + "weighted_loads": [ + 0.22749486938118935, + 0.6040535531938076, + 0.5934939365833998, + 0.5172182656824589, + 0.6189575046300888, + 0.7555956169962883, + 0.30315944366157055, + 0.6104489248245955, + 0.09257937222719193, + 0.038848381489515305, + 0.9294166043400764, + 0.26136748120188713, + 0.790971826761961, + 0.2836858630180359, + 0.913969848304987, + 0.10313552618026733, + 0.2950558103621006, + 0.5200159307569265, + 1.426549982279539, + 0.20734649524092674, + 0.4767494313418865, + 0.4540189392864704, + 0.30615684390068054, + 1.2468126378953457, + 0.5549521166831255, + 1.8007517717778683, + 2.208237651735544, + 0.7393585592508316, + 1.8097730856388807, + 0.7109942808747292, + 0.1013352982699871, + 0.3663356937468052, + 0.04027189686894417, + 0.9392349775880575, + 0.7113810330629349, + 0.428392194211483, + 0.9692228622734547, + 0.871741272509098, + 0.103467658162117, + 0.43298662453889847, + 0.2336634248495102, + 0.06462992168962955, + 0.8633991647511721, + 2.2784292809665203, + 1.5293938517570496, + 0.7275439854711294, + 0.0, + 0.46647932939231396, + 0.351652966812253, + 0.6392466500401497, + 0.8569842539727688, + 0.3547006491571665, + 0.6937181670218706, + 0.25759108550846577, + 0.4693129137158394, + 0.46150341257452965, + 0.4032076597213745, + 0.03897889330983162, + 0.20055120065808296, + 1.0383953526616096, + 0.08371175080537796, + 1.0213909931480885, + 0.4621741287410259, + 0.8478227164596319 + ], + "unique_experts": 63, + "load_cv": 0.7274172134814626, + "normalized_load_entropy": 0.9397437323954585, + "max_load_share": 0.05694444444444444 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "c928206dedd648c95070d9bec79ddb29f45b10e4151ecc0f3d28fa9113a3ca3c", + "route_weight_sha256": "73d82e632a49ea09eaba309253721c246129e537313765618d856443a94523b5", + "loads": [ + 5, + 16, + 13, + 12, + 12, + 20, + 25, + 16, + 2, + 4, + 32, + 13, + 15, + 8, + 18, + 9, + 7, + 10, + 29, + 6, + 11, + 12, + 7, + 12, + 17, + 23, + 17, + 14, + 41, + 24, + 4, + 3, + 1, + 24, + 9, + 5, + 19, + 16, + 2, + 7, + 5, + 4, + 20, + 43, + 35, + 22, + 2, + 16, + 6, + 12, + 14, + 8, + 19, + 10, + 13, + 8, + 12, + 1, + 11, + 23, + 1, + 18, + 9, + 18 + ], + "weighted_loads": [ + 0.22749486938118935, + 0.78210230730474, + 0.5934939365833998, + 0.5172182656824589, + 0.6189575046300888, + 0.8181961476802826, + 1.7914326712489128, + 0.6104489248245955, + 0.09257937222719193, + 0.15202832780778408, + 1.614433640614152, + 0.5061700195074081, + 0.790971826761961, + 0.2836858630180359, + 0.9593979939818382, + 0.41692861542105675, + 0.2950558103621006, + 0.592217331752181, + 1.6805868931114674, + 0.25240346044301987, + 0.4767494313418865, + 0.5622541587799788, + 0.30615684390068054, + 1.2814305499196053, + 0.5837807604111731, + 1.8007517717778683, + 2.3632719106972218, + 0.7393585592508316, + 1.8097730856388807, + 1.5077877417206764, + 0.14433042705059052, + 0.3663356937468052, + 0.04027189686894417, + 1.375997019931674, + 0.7341989334672689, + 0.428392194211483, + 1.1939844507724047, + 0.9053934849798679, + 0.103467658162117, + 0.4662848077714443, + 0.2336634248495102, + 0.18520966358482838, + 1.018906844779849, + 2.3759185075759888, + 2.352903164923191, + 1.7125399205833673, + 0.06462200544774532, + 1.6584222000092268, + 0.3836976867169142, + 0.6392466500401497, + 0.8956006653606892, + 0.3547006491571665, + 0.7720348034054041, + 0.3959642741829157, + 0.5582843869924545, + 0.46150341257452965, + 0.5687517486512661, + 0.03897889330983162, + 0.47954479791224003, + 1.2446605898439884, + 0.08371175080537796, + 1.050027098506689, + 0.4621741287410259, + 0.8861334528774023 + ], + "unique_experts": 64, + "load_cv": 0.6781842972787259, + "normalized_load_entropy": 0.945956573915231, + "max_load_share": 0.04942528735632184 + } + }, + "s1_eos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "856e2c0e3ac12f0db1e233cf8a6593961af2335f8344f74f2bb9bade7898c088", + "route_weight_sha256": "6b11018faaeb3a068a497ff81e14d7038011058ff44fbc04f6ca045a399d8663", + "loads": [ + 6, + 13, + 12, + 11, + 16, + 16, + 8, + 17, + 2, + 4, + 20, + 4, + 16, + 9, + 16, + 4, + 6, + 7, + 26, + 3, + 7, + 9, + 5, + 11, + 9, + 23, + 14, + 13, + 39, + 12, + 3, + 3, + 0, + 18, + 6, + 5, + 15, + 16, + 2, + 6, + 6, + 2, + 22, + 41, + 27, + 12, + 0, + 15, + 5, + 11, + 15, + 12, + 18, + 10, + 9, + 8, + 9, + 1, + 5, + 19, + 2, + 17, + 9, + 13 + ], + "weighted_loads": [ + 0.2685641925781965, + 0.6052417475730181, + 0.5820313822478056, + 0.4949515052139759, + 0.869695758447051, + 0.6977199055254459, + 0.3174721300601959, + 0.6302457805722952, + 0.09718365222215652, + 0.13658487796783447, + 0.839984767138958, + 0.16144630685448647, + 0.82897062972188, + 0.30560876056551933, + 0.8776920195668936, + 0.1286307293921709, + 0.2606826312839985, + 0.49857572093605995, + 1.4388223215937614, + 0.0995589941740036, + 0.3437028340995312, + 0.4426335543394089, + 0.22125902771949768, + 1.2169413566589355, + 0.3713454622775316, + 1.7640180513262749, + 2.4210164304822683, + 0.6924972552806139, + 1.759258421137929, + 0.814303033053875, + 0.10277897864580154, + 0.3557824566960335, + 0.0, + 0.9349484164267778, + 0.6365483589470387, + 0.41335326060652733, + 1.0314976163208485, + 0.891766170039773, + 0.10096630081534386, + 0.4310961216688156, + 0.24974416196346283, + 0.06051182374358177, + 1.049338947981596, + 2.233521644026041, + 1.6371418088674545, + 0.7177703753113747, + 0.0, + 0.492214260622859, + 0.31813104823231697, + 0.6527815386652946, + 1.0574104152619839, + 0.5515538603067398, + 0.7147085666656494, + 0.3614371493458748, + 0.378388486802578, + 0.4576673712581396, + 0.42691026255488396, + 0.040984731167554855, + 0.1937501784414053, + 1.0663460958749056, + 0.1132214218378067, + 1.0139690842479467, + 0.4509669356048107, + 0.6802573073655367 + ], + "unique_experts": 62, + "load_cv": 0.727586913055329, + "normalized_load_entropy": 0.9392918833253696, + "max_load_share": 0.05694444444444444 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "866da61d765fc0c36d64a5bc4cfc02856b00e2723f4943f3590cedb8fcf3f065", + "route_weight_sha256": "76b429da2457d37042c5e633bce956a85990e16115da561c6dace70ecc2ffbef", + "loads": [ + 11, + 17, + 12, + 11, + 16, + 18, + 36, + 17, + 2, + 7, + 30, + 18, + 16, + 9, + 17, + 11, + 6, + 10, + 30, + 7, + 7, + 14, + 5, + 16, + 12, + 23, + 18, + 13, + 39, + 30, + 11, + 4, + 0, + 28, + 9, + 6, + 20, + 17, + 3, + 8, + 7, + 8, + 31, + 43, + 43, + 23, + 2, + 18, + 7, + 15, + 16, + 12, + 20, + 12, + 11, + 10, + 12, + 12, + 12, + 23, + 3, + 19, + 9, + 14 + ], + "weighted_loads": [ + 0.46961636282503605, + 0.8099686820060015, + 0.5820313822478056, + 0.4949515052139759, + 0.869695758447051, + 0.7670201770961285, + 2.6753826066851616, + 0.6302457805722952, + 0.09718365222215652, + 0.27910985983908176, + 1.5167713053524494, + 0.9863987239077687, + 0.82897062972188, + 0.30560876056551933, + 0.9211261961609125, + 0.5103527028113604, + 0.2606826312839985, + 0.582670196890831, + 1.7241579852998257, + 0.2548851892352104, + 0.3437028340995312, + 0.6695149466395378, + 0.22125902771949768, + 1.4102033749222755, + 0.4462515483610332, + 1.7640180513262749, + 2.580318946391344, + 0.6924972552806139, + 1.759258421137929, + 2.219345051795244, + 0.5515238121151924, + 0.396709430962801, + 0.0, + 1.8132535684853792, + 0.8609763290733099, + 0.46750830486416817, + 1.3425658289343119, + 0.925131494179368, + 0.14327051118016243, + 0.511411976069212, + 0.2954569607973099, + 0.33805640414357185, + 1.7623561657965183, + 2.344396848231554, + 2.9044725447893143, + 1.6872664541006088, + 0.0760125033557415, + 1.7225109953433275, + 0.568746168166399, + 0.8570123352110386, + 1.0928907357156277, + 0.5515538603067398, + 0.7861067578196526, + 0.44140951707959175, + 0.4497038498520851, + 0.5284451488405466, + 0.584135364741087, + 0.7491213567554951, + 0.511073112487793, + 1.2629576046019793, + 0.14201884157955647, + 1.0961698796600103, + 0.4509669356048107, + 0.7329948712140322 + ], + "unique_experts": 63, + "load_cv": 0.639208597916215, + "normalized_load_entropy": 0.9528963812494825, + "max_load_share": 0.044513457556935816 + } + }, + "s0_bos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "97a0eca7699bde5ac83ec346ccc050906af6b02c64993c9e8c3096fe8f060f93", + "route_weight_sha256": "8cb57e7cba7b6cf3b38fb18e82721c41165a31779bd20f2fda777c29c7a18f46", + "loads": [ + 6, + 12, + 14, + 9, + 16, + 17, + 8, + 16, + 2, + 6, + 22, + 4, + 17, + 8, + 16, + 2, + 10, + 5, + 25, + 3, + 7, + 9, + 4, + 13, + 17, + 23, + 12, + 14, + 37, + 11, + 1, + 3, + 1, + 21, + 7, + 6, + 15, + 15, + 2, + 6, + 5, + 1, + 18, + 37, + 26, + 12, + 0, + 12, + 6, + 11, + 15, + 10, + 19, + 11, + 9, + 8, + 7, + 1, + 5, + 20, + 2, + 17, + 9, + 17 + ], + "weighted_loads": [ + 0.2693061586469412, + 0.6377247460186481, + 0.600134527310729, + 0.39773354306817055, + 0.7997229006141424, + 0.777094142511487, + 0.38087688758969307, + 0.6328877490013838, + 0.10206795483827591, + 0.2013687826693058, + 0.9688561093062162, + 0.1653173640370369, + 0.8469038493931293, + 0.2791956290602684, + 0.8877118937671185, + 0.06822893396019936, + 0.41132597625255585, + 0.4342352841049433, + 1.3183178417384624, + 0.11726922541856766, + 0.3263653740286827, + 0.46233562752604485, + 0.19711918756365776, + 1.3164562117308378, + 0.6342140566557646, + 1.849278051406145, + 2.2848131209611893, + 0.7447272408753633, + 1.754190281033516, + 0.6963583715260029, + 0.04772774875164032, + 0.3864006884396076, + 0.04409455135464668, + 1.0895516108721495, + 0.7315591536462307, + 0.4551267810165882, + 1.0054938849061728, + 0.8674175422638655, + 0.11448118835687637, + 0.441215593367815, + 0.24432793632149696, + 0.037510648369789124, + 0.9394872896373272, + 2.2525085266679525, + 1.5280739180743694, + 0.7304130904376507, + 0.0, + 0.4021895658224821, + 0.386696295812726, + 0.6600093245506287, + 1.036106899380684, + 0.4730945751070976, + 0.8243514150381088, + 0.3983542136847973, + 0.4103822037577629, + 0.48080727830529213, + 0.34876324236392975, + 0.038443248718976974, + 0.16450577229261398, + 1.1450369209051132, + 0.11783676594495773, + 1.0336070768535137, + 0.46702586114406586, + 0.8506931141018867 + ], + "unique_experts": 63, + "load_cv": 0.707455883543627, + "normalized_load_entropy": 0.9398466479291798, + "max_load_share": 0.05138888888888889 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "dbd1e08ff32e58e770c949f68287302c5bb8b47b7d3d386fbd10a7e01548cd1a", + "route_weight_sha256": "550a5940dd1fd4e4a471c2cefb4b08e1ff7aeb50adc57c05be28916a2f6066b0", + "loads": [ + 6, + 16, + 15, + 9, + 17, + 20, + 25, + 16, + 2, + 11, + 31, + 8, + 17, + 8, + 16, + 8, + 10, + 6, + 28, + 4, + 7, + 11, + 4, + 15, + 18, + 23, + 16, + 14, + 37, + 25, + 2, + 3, + 1, + 25, + 8, + 6, + 19, + 16, + 2, + 7, + 5, + 3, + 21, + 40, + 36, + 23, + 2, + 13, + 7, + 11, + 16, + 10, + 21, + 15, + 12, + 8, + 11, + 1, + 12, + 24, + 2, + 18, + 9, + 18 + ], + "weighted_loads": [ + 0.2693061586469412, + 0.8335260041058064, + 0.6714525353163481, + 0.39773354306817055, + 0.8507755007594824, + 0.8625787496566772, + 1.9311778601258993, + 0.6328877490013838, + 0.10206795483827591, + 0.43572661094367504, + 1.5309338606894016, + 0.35632708109915257, + 0.8469038493931293, + 0.2791956290602684, + 0.8877118937671185, + 0.38202202320098877, + 0.41132597625255585, + 0.46890379674732685, + 1.5613036789000034, + 0.16232619062066078, + 0.3263653740286827, + 0.5279342513531446, + 0.19711918756365776, + 1.3983595538884401, + 0.6573503408581018, + 1.849278051406145, + 2.439847379922867, + 0.7447272408753633, + 1.754190281033516, + 1.4426506906747818, + 0.09532293677330017, + 0.3864006884396076, + 0.04409455135464668, + 1.436764782294631, + 0.7543770540505648, + 0.4551267810165882, + 1.2354798130691051, + 0.9010697547346354, + 0.11448118835687637, + 0.47451377660036087, + 0.24432793632149696, + 0.1468891017138958, + 1.1098922602832317, + 2.43182528950274, + 2.39222127571702, + 1.7536502853035927, + 0.06462200544774532, + 0.7632962595671415, + 0.4187410157173872, + 0.6600093245506287, + 1.0747233107686043, + 0.4730945751070976, + 0.9026680514216423, + 0.6006998904049397, + 0.5374483726918697, + 0.48080727830529213, + 0.6286281086504459, + 0.038443248718976974, + 0.4835302550345659, + 1.351302158087492, + 0.11783676594495773, + 1.0622431822121143, + 0.46702586114406586, + 0.8890038505196571 + ], + "unique_experts": 64, + "load_cv": 0.6673757624038753, + "normalized_load_entropy": 0.9459284359660447, + "max_load_share": 0.04597701149425287 + } + }, + "s1_bos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "d6095704ebceac37c15e8a245f49909f8a55d513419fc1de82f26931e82c4924", + "route_weight_sha256": "7ec086c9cacd3edcdab6cebe1f581ea78854be3256c3489358440fb9086b954f", + "loads": [ + 6, + 11, + 10, + 10, + 17, + 17, + 12, + 18, + 2, + 5, + 22, + 4, + 14, + 9, + 17, + 1, + 8, + 6, + 22, + 1, + 6, + 9, + 5, + 12, + 14, + 23, + 12, + 13, + 41, + 14, + 3, + 3, + 1, + 20, + 6, + 6, + 15, + 16, + 2, + 7, + 5, + 1, + 21, + 42, + 26, + 11, + 0, + 10, + 7, + 13, + 15, + 10, + 18, + 7, + 9, + 8, + 9, + 1, + 5, + 21, + 2, + 17, + 9, + 13 + ], + "weighted_loads": [ + 0.281067181378603, + 0.5806541852653027, + 0.4797211643308401, + 0.45828530192375183, + 0.9491938967257738, + 0.763926163315773, + 0.46037086099386215, + 0.6917777024209499, + 0.10370872914791107, + 0.17554385773837566, + 0.9297459181398153, + 0.1582367978990078, + 0.7424960248172283, + 0.318920586258173, + 0.9390228874981403, + 0.033924348652362823, + 0.3427827786654234, + 0.4562116917222738, + 1.244853438809514, + 0.032015517354011536, + 0.2977660894393921, + 0.4392644427716732, + 0.23490753769874573, + 1.3137719295918941, + 0.5379560608416796, + 1.7848685942590237, + 2.29436819255352, + 0.7001215722411871, + 1.9043050203472376, + 0.7807402536273003, + 0.09811855480074883, + 0.35011250898241997, + 0.04364561662077904, + 1.0405408386141062, + 0.6844318136572838, + 0.44948361441493034, + 0.995554968714714, + 0.913144189864397, + 0.11657391116023064, + 0.48136141896247864, + 0.23256304673850536, + 0.0341341607272625, + 1.0308283735066652, + 2.485763266682625, + 1.5983705557882786, + 0.6997092962265015, + 0.0, + 0.34064807556569576, + 0.3733016047626734, + 0.7401049807667732, + 1.0709191001951694, + 0.4580036345869303, + 0.7448639385402203, + 0.26388463377952576, + 0.3818244803696871, + 0.47694335132837296, + 0.4441089779138565, + 0.03627758473157883, + 0.17348443903028965, + 1.1696849707514048, + 0.11935580894351006, + 1.017238076776266, + 0.45968688279390335, + 0.698338346555829 + ], + "unique_experts": 63, + "load_cv": 0.744527358566709, + "normalized_load_entropy": 0.9365680361651431, + "max_load_share": 0.058333333333333334 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "9a65e53044993376c8a49fee7652f533cdf397b4ba30f4cdc593f4b4f1952be8", + "route_weight_sha256": "7b9b095c8e781684a3af64673abfd04827da57a557bc0201320e37e169f234e9", + "loads": [ + 11, + 16, + 11, + 10, + 17, + 20, + 40, + 18, + 2, + 9, + 33, + 15, + 14, + 9, + 17, + 8, + 8, + 8, + 26, + 5, + 6, + 14, + 5, + 16, + 17, + 23, + 16, + 13, + 41, + 32, + 11, + 4, + 1, + 30, + 9, + 7, + 21, + 17, + 3, + 9, + 6, + 6, + 30, + 44, + 42, + 23, + 2, + 12, + 9, + 17, + 16, + 10, + 20, + 9, + 11, + 10, + 13, + 12, + 12, + 25, + 3, + 19, + 9, + 14 + ], + "weighted_loads": [ + 0.4821193516254425, + 0.8385561108589172, + 0.5282646920531988, + 0.45828530192375183, + 0.9491938967257738, + 0.8561418857425451, + 2.913045357912779, + 0.6917777024209499, + 0.10370872914791107, + 0.37586311250925064, + 1.643725549802184, + 0.9133400116115808, + 0.7424960248172283, + 0.318920586258173, + 0.9390228874981403, + 0.4156463220715523, + 0.3427827786654234, + 0.526623846963048, + 1.5201006773859262, + 0.18734171241521835, + 0.2977660894393921, + 0.6638590022921562, + 0.23490753769874573, + 1.4723236374557018, + 0.662635887041688, + 1.7848685942590237, + 2.453670708462596, + 0.7001215722411871, + 1.9043050203472376, + 2.2095285281538963, + 0.5490186996757984, + 0.39103948324918747, + 0.04364561662077904, + 1.9156991261988878, + 0.908859783783555, + 0.5036386586725712, + 1.369529152289033, + 0.9465095140039921, + 0.1588781215250492, + 0.561677273362875, + 0.2782758455723524, + 0.2726319804787636, + 1.7646004389971495, + 2.603289667516947, + 2.8933183290064335, + 1.7143335416913033, + 0.0760125033557415, + 0.741108501330018, + 0.6239167246967554, + 0.9443357773125172, + 1.1063994206488132, + 0.4580036345869303, + 0.8162621296942234, + 0.3438570015132427, + 0.4531398434191942, + 0.54772112891078, + 0.6415501683950424, + 0.744414210319519, + 0.4732155613601208, + 1.3662964794784784, + 0.14815322868525982, + 1.0994388721883297, + 0.45968688279390335, + 0.7510759104043245 + ], + "unique_experts": 64, + "load_cv": 0.6647703957192506, + "normalized_load_entropy": 0.9505953321300838, + "max_load_share": 0.045548654244306416 + } + }, + "s0_x": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "ce969427d567439c32d42b721853e9b9e8f8e247ab2d50bfc9e20ac726260c5e", + "route_weight_sha256": "e3602f6ac29b099f8427dd1f2fd5a631dddea90edc7100daf35196d43af82868", + "loads": [ + 6, + 13, + 11, + 10, + 14, + 16, + 7, + 16, + 4, + 5, + 22, + 4, + 15, + 8, + 16, + 3, + 11, + 6, + 26, + 3, + 5, + 10, + 5, + 13, + 17, + 24, + 12, + 13, + 38, + 13, + 3, + 3, + 1, + 20, + 6, + 7, + 15, + 16, + 2, + 6, + 6, + 2, + 19, + 35, + 26, + 11, + 0, + 10, + 6, + 12, + 13, + 10, + 18, + 8, + 9, + 7, + 10, + 1, + 6, + 19, + 2, + 17, + 10, + 18 + ], + "weighted_loads": [ + 0.2830009628087282, + 0.7031051553785801, + 0.49084980227053165, + 0.42942509055137634, + 0.6997170317918062, + 0.713805491104722, + 0.24773222766816616, + 0.6407816912978888, + 0.1794080212712288, + 0.15613054484128952, + 0.946873027831316, + 0.1627579964697361, + 0.8114072382450104, + 0.28003629483282566, + 0.9068717919290066, + 0.10373633727431297, + 0.45389004796743393, + 0.5011768359690905, + 1.4557625576853752, + 0.11453744396567345, + 0.24004748463630676, + 0.5198716297745705, + 0.23210356757044792, + 1.3630326502025127, + 0.6263473890721798, + 1.952613327652216, + 2.1808379739522934, + 0.6977822072803974, + 1.7009163815528154, + 0.7400119639933109, + 0.10665910132229328, + 0.3913428336381912, + 0.04064580053091049, + 1.132252337411046, + 0.7110390644520521, + 0.48454628698527813, + 1.0027612932026386, + 0.8823154084384441, + 0.11329096183180809, + 0.45329244434833527, + 0.2706895787268877, + 0.06942209973931313, + 0.9743168372660875, + 2.0819039326161146, + 1.642267121002078, + 0.6877037901431322, + 0.0, + 0.3430566396564245, + 0.397065045312047, + 0.7059908304363489, + 0.8771524950861931, + 0.4767284356057644, + 0.7417954187840223, + 0.2842095196247101, + 0.4192710258066654, + 0.4606447070837021, + 0.48337286338210106, + 0.03933523967862129, + 0.20475110225379467, + 1.1671476922929287, + 0.1207653172314167, + 1.0602042488753796, + 0.5055115185678005, + 0.893780954182148 + ], + "unique_experts": 63, + "load_cv": 0.6903210918670696, + "normalized_load_entropy": 0.9442622224072863, + "max_load_share": 0.05277777777777778 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "6bd6fc2313823914d7f6b1cf6a042a366ef4782dc2a4ae961449a5f82135ee6b", + "route_weight_sha256": "7316904379c2803b61c3f05a9ebebf79fab622e51dfaa1d0578045b836be3e91", + "loads": [ + 6, + 16, + 11, + 10, + 14, + 18, + 24, + 16, + 4, + 7, + 32, + 9, + 15, + 8, + 16, + 10, + 11, + 8, + 29, + 4, + 5, + 12, + 5, + 15, + 20, + 24, + 16, + 13, + 38, + 27, + 4, + 3, + 1, + 26, + 7, + 7, + 19, + 17, + 2, + 7, + 6, + 4, + 22, + 36, + 38, + 23, + 3, + 11, + 7, + 12, + 14, + 10, + 20, + 11, + 11, + 7, + 14, + 1, + 12, + 23, + 2, + 18, + 10, + 19 + ], + "weighted_loads": [ + 0.2830009628087282, + 0.8279535993933678, + 0.49084980227053165, + 0.42942509055137634, + 0.6997170317918062, + 0.7764060217887163, + 1.7010896764695644, + 0.6407816912978888, + 0.1794080212712288, + 0.23191755078732967, + 1.5230898801237345, + 0.42104764841496944, + 0.8114072382450104, + 0.28003629483282566, + 0.9068717919290066, + 0.6355045363306999, + 0.45389004796743393, + 0.5571680050343275, + 1.713270466774702, + 0.15959440916776657, + 0.24004748463630676, + 0.5879314485937357, + 0.23210356757044792, + 1.4434268772602081, + 0.740147553384304, + 1.952613327652216, + 2.335872232913971, + 0.6977822072803974, + 1.7009163815528154, + 1.4916686452925205, + 0.15657893382012844, + 0.3913428336381912, + 0.04064580053091049, + 1.5974037889391184, + 0.7338569648563862, + 0.48454628698527813, + 1.2307636756449938, + 0.915967620909214, + 0.11329096183180809, + 0.4865906275808811, + 0.2706895787268877, + 0.1873362772166729, + 1.1160584967583418, + 2.126943903043866, + 2.6410637740045786, + 1.9120926801115274, + 0.09344248846173286, + 0.704163333401084, + 0.4291097652167082, + 0.7059908304363489, + 0.9157689064741135, + 0.4767284356057644, + 0.8201120551675558, + 0.42258270829916, + 0.5082424990832806, + 0.4606447070837021, + 0.6798381041735411, + 0.03933523967862129, + 0.47484077140688896, + 1.3734129294753075, + 0.1207653172314167, + 1.0888403542339802, + 0.5055115185678005, + 0.9320916905999184 + ], + "unique_experts": 64, + "load_cv": 0.6608825576859384, + "normalized_load_entropy": 0.9485093628384907, + "max_load_share": 0.04367816091954023 + } + }, + "s1_x": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "e6b9b17a7dd5e83054cf266c73415b99f47554831a6feba773f3bdb8c9c31ee3", + "route_weight_sha256": "9fba195b85d80d102bd1f42e60a33a69bd54a8fbd6a9d6ad865adb73f57c3782", + "loads": [ + 5, + 11, + 10, + 11, + 16, + 15, + 11, + 18, + 4, + 6, + 19, + 4, + 15, + 9, + 16, + 3, + 7, + 7, + 26, + 1, + 5, + 10, + 5, + 12, + 16, + 24, + 12, + 13, + 40, + 14, + 3, + 3, + 1, + 21, + 6, + 6, + 15, + 16, + 2, + 7, + 5, + 1, + 18, + 37, + 30, + 11, + 0, + 10, + 7, + 14, + 13, + 12, + 14, + 8, + 8, + 8, + 10, + 1, + 5, + 21, + 2, + 17, + 9, + 14 + ], + "weighted_loads": [ + 0.23640147224068642, + 0.5731570105999708, + 0.4660562239587307, + 0.501822043210268, + 0.8816595748066902, + 0.6726798806339502, + 0.37282031029462814, + 0.7049146611243486, + 0.18803779408335686, + 0.1937361489981413, + 0.7963280491530895, + 0.1640770435333252, + 0.8070034738630056, + 0.3024568445980549, + 0.8960750065743923, + 0.09648670628666878, + 0.3054687827825546, + 0.5454255901277065, + 1.524654434993863, + 0.031076306477189064, + 0.23090815171599388, + 0.4765484370291233, + 0.23048484325408936, + 1.2821500040590763, + 0.5854072142392397, + 1.8663366921246052, + 2.2172688581049442, + 0.6879656780511141, + 1.762996133416891, + 0.7280868645757437, + 0.10627331770956516, + 0.33092212677001953, + 0.04022400826215744, + 1.0898515116423368, + 0.6461826134473085, + 0.43071578070521355, + 1.0109197497367859, + 0.8996001128107309, + 0.11100993305444717, + 0.4865637347102165, + 0.231418889015913, + 0.03374909982085228, + 0.9367788229137659, + 2.161511890590191, + 1.8887569233775139, + 0.6939150243997574, + 0.0, + 0.3359867073595524, + 0.3599731922149658, + 0.8061877600848675, + 0.9463017731904984, + 0.5616929195821285, + 0.5692004691809416, + 0.2914915569126606, + 0.3537744991481304, + 0.485587190836668, + 0.49634382501244545, + 0.04346210137009621, + 0.1800321228802204, + 1.1978304646909237, + 0.11586684733629227, + 1.0318388566374779, + 0.4468563497066498, + 0.7090159244835377 + ], + "unique_experts": 63, + "load_cv": 0.7193961802772731, + "normalized_load_entropy": 0.9403627383622798, + "max_load_share": 0.05555555555555555 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "e7800d93b2d15878c257d6624646d40019fef89bc2011f00262a99649abe089b", + "route_weight_sha256": "d3fd78aaa63aefb55af3d362f31d28d8183e7f0af383eb068a4f0711e540525c", + "loads": [ + 10, + 14, + 10, + 11, + 16, + 17, + 38, + 18, + 4, + 7, + 28, + 16, + 15, + 9, + 16, + 11, + 7, + 9, + 30, + 5, + 5, + 16, + 5, + 17, + 21, + 24, + 17, + 13, + 40, + 32, + 11, + 4, + 1, + 33, + 9, + 7, + 21, + 17, + 3, + 9, + 6, + 7, + 27, + 37, + 48, + 23, + 3, + 12, + 9, + 18, + 14, + 12, + 16, + 10, + 10, + 11, + 13, + 13, + 9, + 25, + 3, + 20, + 9, + 15 + ], + "weighted_loads": [ + 0.43745364248752594, + 0.7279484551399946, + 0.4660562239587307, + 0.501822043210268, + 0.8816595748066902, + 0.7419801522046328, + 2.5887779109179974, + 0.7049146611243486, + 0.18803779408335686, + 0.224333506077528, + 1.366872925311327, + 0.9412051141262054, + 0.8070034738630056, + 0.3024568445980549, + 0.8960750065743923, + 0.6186970360577106, + 0.3054687827825546, + 0.6158377453684807, + 1.8139931131154299, + 0.18640250153839588, + 0.23090815171599388, + 0.7350876852869987, + 0.23048484325408936, + 1.467231186106801, + 0.7776998486369848, + 1.8663366921246052, + 2.409614445641637, + 0.6879656780511141, + 1.762996133416891, + 2.1202158089727163, + 0.5690568890422583, + 0.37184910103678703, + 0.04022400826215744, + 2.0957423467189074, + 0.8706105835735798, + 0.4848708249628544, + 1.3486127723008394, + 0.932965436950326, + 0.15331414341926575, + 0.5668795891106129, + 0.27713168784976006, + 0.30831169337034225, + 1.645532900467515, + 2.161511890590191, + 3.3420740254223347, + 1.8064310476183891, + 0.12004737183451653, + 0.7364471331238747, + 0.6105883121490479, + 1.0104185566306114, + 0.9817820936441422, + 0.5616929195821285, + 0.6405986603349447, + 0.37146392464637756, + 0.42508986219763756, + 0.5987768806517124, + 0.6535689271986485, + 0.7857041992247105, + 0.31704585812985897, + 1.3944419734179974, + 0.14466426707804203, + 1.1495431140065193, + 0.4468563497066498, + 0.7617534883320332 + ], + "unique_experts": 64, + "load_cv": 0.6527980187718212, + "normalized_load_entropy": 0.9526604250641477, + "max_load_share": 0.049689440993788817 + } + }, + "s0_period": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "bd01ae258a7c74e9962a4d9d5589f5fff8bb096b5c201d4e2d94501ae494f675", + "route_weight_sha256": "4aa9ed1b424607219e0dc13042c29240e01812659808d1947698133a242faae0", + "loads": [ + 6, + 14, + 11, + 10, + 14, + 15, + 10, + 17, + 4, + 6, + 22, + 4, + 16, + 7, + 17, + 3, + 11, + 5, + 26, + 3, + 5, + 10, + 5, + 14, + 17, + 24, + 12, + 12, + 37, + 14, + 2, + 3, + 1, + 20, + 7, + 7, + 14, + 15, + 2, + 6, + 5, + 2, + 18, + 33, + 27, + 12, + 0, + 11, + 5, + 12, + 13, + 9, + 16, + 11, + 9, + 7, + 11, + 1, + 4, + 20, + 2, + 17, + 10, + 17 + ], + "weighted_loads": [ + 0.28151787258684635, + 0.7034935746341944, + 0.48705198988318443, + 0.42273862659931183, + 0.7003327514976263, + 0.6760206203907728, + 0.3596935123205185, + 0.6752369999885559, + 0.17451117932796478, + 0.1977142132818699, + 0.9348318353295326, + 0.15987267717719078, + 0.850744966417551, + 0.23805276677012444, + 0.9308791235089302, + 0.10445095971226692, + 0.46059458516538143, + 0.46700746938586235, + 1.456622725352645, + 0.11360139027237892, + 0.24795542657375336, + 0.5141782537102699, + 0.23620472475886345, + 1.3762919083237648, + 0.6397156193852425, + 1.9211203642189503, + 2.2069981321692467, + 0.648635745048523, + 1.6276828274130821, + 0.8681071437895298, + 0.07761822082102299, + 0.3790193945169449, + 0.04180004075169563, + 1.1209478788077831, + 0.7491745334118605, + 0.49471766129136086, + 0.9816860817372799, + 0.8607307244092226, + 0.11306997016072273, + 0.4515131562948227, + 0.24593142978847027, + 0.06854132562875748, + 0.9392396509647369, + 1.9739267565310001, + 1.688334109261632, + 0.7209986466914415, + 0.0, + 0.37072058767080307, + 0.3470451571047306, + 0.7071528751403093, + 0.8856869041919708, + 0.4157482050359249, + 0.6609206087887287, + 0.39209899492561817, + 0.4156915917992592, + 0.45587160997092724, + 0.5312643125653267, + 0.0377504825592041, + 0.1376013532280922, + 1.2089489940553904, + 0.11832575500011444, + 1.052695918828249, + 0.5017194412648678, + 0.850835045799613 + ], + "unique_experts": 63, + "load_cv": 0.6820448556987914, + "normalized_load_entropy": 0.944271116520048, + "max_load_share": 0.05138888888888889 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "12ea030ed30f9570ca1fa999dce295c6c3c6aebd1aeaf1db2449d652d468e194", + "route_weight_sha256": "e05e5c67bcff809b1828db8c8fa3da53e6733c997787c4215c291efddc18eb6c", + "loads": [ + 6, + 18, + 11, + 10, + 14, + 17, + 26, + 17, + 4, + 9, + 31, + 9, + 16, + 7, + 18, + 9, + 11, + 7, + 30, + 4, + 5, + 12, + 5, + 16, + 20, + 24, + 16, + 12, + 37, + 29, + 3, + 3, + 1, + 26, + 8, + 7, + 19, + 16, + 2, + 7, + 5, + 5, + 20, + 35, + 38, + 23, + 2, + 12, + 6, + 12, + 14, + 9, + 18, + 14, + 11, + 7, + 14, + 1, + 10, + 24, + 2, + 18, + 10, + 18 + ], + "weighted_loads": [ + 0.28151787258684635, + 1.0132294483482838, + 0.48705198988318443, + 0.42273862659931183, + 0.7003327514976263, + 0.7386211510747671, + 1.8250789884477854, + 0.6752369999885559, + 0.17451117932796478, + 0.3300941865891218, + 1.5376715417951345, + 0.4231759961694479, + 0.850744966417551, + 0.23805276677012444, + 0.962674044072628, + 0.41824404895305634, + 0.46059458516538143, + 0.5232179425656796, + 1.7351599521934986, + 0.15865835547447205, + 0.24795542657375336, + 0.5799369346350431, + 0.23620472475886345, + 1.452994741499424, + 0.8328118361532688, + 1.9211203642189503, + 2.3620323911309242, + 0.648635745048523, + 1.6276828274130821, + 1.674232255667448, + 0.12541685439646244, + 0.3790193945169449, + 0.04180004075169563, + 1.575703252106905, + 0.7719924338161945, + 0.49471766129136086, + 1.2684326637536287, + 0.8943829368799925, + 0.11306997016072273, + 0.48481133952736855, + 0.24593142978847027, + 0.23003292828798294, + 1.0297769233584404, + 2.0895640328526497, + 2.6186422798782587, + 1.7456575836986303, + 0.06462200544774532, + 0.7318272814154625, + 0.3790898770093918, + 0.7071528751403093, + 0.9243033155798912, + 0.4157482050359249, + 0.7392372451722622, + 0.5304721836000681, + 0.5046630650758743, + 0.45587160997092724, + 0.6968084014952183, + 0.0377504825592041, + 0.39876540936529636, + 1.4152142312377691, + 0.11832575500011444, + 1.0813320241868496, + 0.5017194412648678, + 0.8891457822173834 + ], + "unique_experts": 64, + "load_cv": 0.6644553098335653, + "normalized_load_entropy": 0.9473610366173532, + "max_load_share": 0.04367816091954023 + } + }, + "s1_period": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "a99717209003183068f136a497983bfad74f93c12d839c42efc7075bd02c4794", + "route_weight_sha256": "8bcca2d984e1ecd8aa763cddafcc028d6e13d731a68c1a0fc12a96637f08ca6b", + "loads": [ + 5, + 13, + 11, + 11, + 15, + 13, + 9, + 18, + 4, + 4, + 20, + 3, + 15, + 9, + 16, + 3, + 8, + 8, + 28, + 1, + 5, + 9, + 5, + 13, + 17, + 23, + 12, + 13, + 36, + 15, + 3, + 3, + 1, + 21, + 7, + 6, + 15, + 16, + 2, + 7, + 5, + 1, + 18, + 36, + 29, + 11, + 0, + 12, + 7, + 14, + 13, + 11, + 14, + 9, + 9, + 8, + 12, + 2, + 5, + 20, + 2, + 17, + 9, + 13 + ], + "weighted_loads": [ + 0.23746316507458687, + 0.6202776879072189, + 0.494093319401145, + 0.5024133399128914, + 0.8552416153252125, + 0.5865398216992617, + 0.3293579053133726, + 0.7002915367484093, + 0.1834482178092003, + 0.13471565395593643, + 0.7969367280602455, + 0.1284487396478653, + 0.794394962489605, + 0.30240994691848755, + 0.913035100325942, + 0.0947529524564743, + 0.3326662667095661, + 0.5814154520630836, + 1.5874888245016336, + 0.0299090463668108, + 0.2304931841790676, + 0.42415226995944977, + 0.22770104557275772, + 1.2686921060085297, + 0.6194740384817123, + 1.8571247197687626, + 2.230270303785801, + 0.6656965892761946, + 1.605543041601777, + 0.7839368171989918, + 0.10924961976706982, + 0.34152908995747566, + 0.04024570807814598, + 1.0927573274821043, + 0.6852193232625723, + 0.44129665195941925, + 1.0337247401475906, + 0.9009344261139631, + 0.1125626377761364, + 0.4904883988201618, + 0.2294889185577631, + 0.031082607805728912, + 0.9689577110111713, + 2.1021507270634174, + 1.8590226285159588, + 0.7005321308970451, + 0.0, + 0.39270535483956337, + 0.35172597505152225, + 0.7954165209084749, + 0.9185712710022926, + 0.5201699584722519, + 0.5645717456936836, + 0.3268940057605505, + 0.37824069149792194, + 0.47915564849972725, + 0.577917318791151, + 0.06853702664375305, + 0.1764924582093954, + 1.1807895973324776, + 0.11267346516251564, + 1.04386804997921, + 0.44971799850463867, + 0.68887759745121 + ], + "unique_experts": 63, + "load_cv": 0.6953105709849784, + "normalized_load_entropy": 0.9427148721338475, + "max_load_share": 0.05 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "37fa75644349cad9a47f9d6629f2648626037a25bd1b9e73c167516620cd33bd", + "route_weight_sha256": "30dbfc7a455e05f11a1db0f0e5dc557026109e23953106592a10d4520775fe99", + "loads": [ + 10, + 18, + 11, + 11, + 15, + 15, + 37, + 18, + 4, + 5, + 29, + 14, + 15, + 9, + 16, + 10, + 8, + 10, + 32, + 5, + 5, + 14, + 5, + 18, + 21, + 23, + 16, + 13, + 36, + 35, + 11, + 4, + 1, + 34, + 10, + 7, + 21, + 17, + 3, + 9, + 6, + 7, + 26, + 37, + 47, + 23, + 2, + 14, + 9, + 18, + 14, + 11, + 16, + 11, + 11, + 10, + 15, + 13, + 11, + 24, + 3, + 20, + 9, + 14 + ], + "weighted_loads": [ + 0.4385153353214264, + 0.9885248187929392, + 0.494093319401145, + 0.5024133399128914, + 0.8552416153252125, + 0.6558400932699442, + 2.5186288077384233, + 0.7002915367484093, + 0.1834482178092003, + 0.16531301103532314, + 1.410060029476881, + 0.887877045199275, + 0.794394962489605, + 0.30240994691848755, + 0.913035100325942, + 0.47647492587566376, + 0.3326662667095661, + 0.6518276073038578, + 1.8659391272813082, + 0.18523524142801762, + 0.2304931841790676, + 0.642080033197999, + 0.22770104557275772, + 1.4579002931714058, + 0.8699638843536377, + 1.8571247197687626, + 2.3895728196948767, + 0.6656965892761946, + 1.605543041601777, + 2.270150661468506, + 0.5654169600456953, + 0.38245606422424316, + 0.04024570807814598, + 2.1472447123378515, + 0.9096472933888435, + 0.4954516962170601, + 1.407229458913207, + 0.9342997502535582, + 0.15486684814095497, + 0.5708042532205582, + 0.27520171739161015, + 0.3048809766769409, + 1.6236392743885517, + 2.138541106134653, + 3.2847675420343876, + 1.7046638615429401, + 0.0760125033557415, + 0.7931657806038857, + 0.6023410949856043, + 0.9996473174542189, + 0.9540515914559364, + 0.5201699584722519, + 0.6359699368476868, + 0.40686637349426746, + 0.4495560545474291, + 0.5499334260821342, + 0.735142420977354, + 0.7766736522316933, + 0.40096745640039444, + 1.3774011060595512, + 0.1414708849042654, + 1.1569546237587929, + 0.44971799850463867, + 0.7416151612997055 + ], + "unique_experts": 64, + "load_cv": 0.6465696304941965, + "normalized_load_entropy": 0.9529355393094926, + "max_load_share": 0.048654244306418216 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 120, + "ordered_topk_exact_tokens": 55, + "set_exact_tokens": 71, + "mean_set_jaccard": 0.8730158730158731, + "mean_token_weighted_tv": 0.024744105253679056, + "aggregate_load_tv": 0.052777777777777785 + }, + "system_bos": { + "tokens": 120, + "ordered_topk_exact_tokens": 50, + "set_exact_tokens": 71, + "mean_set_jaccard": 0.869047619047619, + "mean_token_weighted_tv": 0.02568850830818216, + "aggregate_load_tv": 0.051388888888888894 + }, + "system_x": { + "tokens": 120, + "ordered_topk_exact_tokens": 37, + "set_exact_tokens": 59, + "mean_set_jaccard": 0.8308333333333333, + "mean_token_weighted_tv": 0.0346114988050734, + "aggregate_load_tv": 0.043055555555555555 + }, + "system_period": { + "tokens": 120, + "ordered_topk_exact_tokens": 36, + "set_exact_tokens": 55, + "mean_set_jaccard": 0.8259920634920636, + "mean_token_weighted_tv": 0.03548179341014475, + "aggregate_load_tv": 0.045833333333333344 + }, + "bos_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 38, + "set_exact_tokens": 65, + "mean_set_jaccard": 0.8462301587301587, + "mean_token_weighted_tv": 0.0321787379682064, + "aggregate_load_tv": 0.056944444444444436 + }, + "bos_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 48, + "set_exact_tokens": 74, + "mean_set_jaccard": 0.8690476190476191, + "mean_token_weighted_tv": 0.029110856377519666, + "aggregate_load_tv": 0.048611111111111105 + }, + "x_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 38, + "set_exact_tokens": 58, + "mean_set_jaccard": 0.830952380952381, + "mean_token_weighted_tv": 0.03601285573871185, + "aggregate_load_tv": 0.05972222222222222 + }, + "x_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 32, + "set_exact_tokens": 58, + "mean_set_jaccard": 0.833531746031746, + "mean_token_weighted_tv": 0.03594855268020183, + "aggregate_load_tv": 0.05555555555555555 + }, + "period_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 36, + "set_exact_tokens": 57, + "mean_set_jaccard": 0.8257936507936507, + "mean_token_weighted_tv": 0.035580220127788685, + "aggregate_load_tv": 0.06805555555555555 + }, + "period_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 32, + "set_exact_tokens": 56, + "mean_set_jaccard": 0.8230158730158731, + "mean_token_weighted_tv": 0.037849442839312054, + "aggregate_load_tv": 0.05694444444444445 + } + } + }, + "layer_14": { + "layer": 14, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "593b4af5f4c2c7589207645c9cf0bc31c7906667622f3db897da686c7856f9b4", + "route_weight_sha256": "ef23cf852569c31a3450dd1f5934da912d122f9adb72e66937d14b5fe2aa3536", + "loads": [ + 5, + 12, + 3, + 3, + 4, + 7, + 3, + 1, + 9, + 19, + 22, + 29, + 2, + 18, + 16, + 14, + 0, + 7, + 6, + 6, + 1, + 8, + 11, + 8, + 8, + 23, + 18, + 1, + 15, + 1, + 3, + 4, + 5, + 19, + 14, + 4, + 11, + 3, + 1, + 18, + 5, + 9, + 12, + 28, + 10, + 9, + 7, + 26, + 10, + 13, + 11, + 8, + 23, + 25, + 2, + 8, + 28, + 16, + 26, + 17, + 4, + 18, + 24, + 19 + ], + "weighted_loads": [ + 0.2958801444619894, + 0.34513710951432586, + 0.13655657321214676, + 0.08047125302255154, + 0.2692195847630501, + 0.31030688993632793, + 0.12185517698526382, + 0.0238494873046875, + 0.5353438444435596, + 1.1974450312554836, + 0.7907483666203916, + 2.0796793829649687, + 0.0647391602396965, + 1.2793085668236017, + 1.003191460389644, + 0.5669958386570215, + 0.0, + 0.245221309363842, + 0.2325402870774269, + 0.30955748073756695, + 0.12877047061920166, + 0.336858831346035, + 8.30287989974022, + 0.25355177745223045, + 0.29842781089246273, + 1.0957184098660946, + 3.360826374962926, + 0.029722066596150398, + 0.8716094866394997, + 0.02342246286571026, + 0.22276151925325394, + 0.1343940868973732, + 0.6876702215522528, + 1.5262725036591291, + 0.3918931824155152, + 0.12990008108317852, + 0.37328880559653044, + 0.22780084982514381, + 0.03419837728142738, + 0.7530435547232628, + 0.20564711093902588, + 0.3295048512518406, + 0.5329325143247843, + 2.105845347046852, + 0.34767283080145717, + 0.31635729782283306, + 0.23499739356338978, + 1.0729017052799463, + 0.7905635200440884, + 0.7945195510983467, + 0.7286451980471611, + 0.2629740722477436, + 2.0112545154988766, + 2.247076965868473, + 0.06381497718393803, + 0.10151831991970539, + 2.493139509111643, + 0.686361039057374, + 0.8763452316634357, + 0.720795651897788, + 0.2736438848078251, + 0.6665522214025259, + 1.518357357941568, + 0.6262900764122605 + ], + "unique_experts": 63, + "load_cv": 0.7200822998230956, + "normalized_load_entropy": 0.9345644899851399, + "max_load_share": 0.04027777777777778 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "910e2be148c234f503171f4d01f3aa45919839baee500941262934d6e5cf9201", + "route_weight_sha256": "033e1117c4ab137c85ea3fb13b9a34ba616ecda881dd261c5155a31aba899dc5", + "loads": [ + 11, + 12, + 3, + 5, + 4, + 17, + 3, + 3, + 9, + 28, + 25, + 32, + 2, + 18, + 16, + 18, + 0, + 7, + 11, + 7, + 1, + 8, + 11, + 19, + 9, + 26, + 24, + 6, + 23, + 1, + 6, + 11, + 5, + 26, + 14, + 4, + 12, + 4, + 3, + 18, + 5, + 9, + 14, + 29, + 11, + 9, + 12, + 29, + 10, + 15, + 15, + 12, + 29, + 31, + 2, + 12, + 28, + 17, + 26, + 27, + 4, + 19, + 24, + 19 + ], + "weighted_loads": [ + 0.9717843756079674, + 0.34513710951432586, + 0.13655657321214676, + 0.1591260451823473, + 0.2692195847630501, + 1.2232149969786406, + 0.12185517698526382, + 0.09668266773223877, + 0.5353438444435596, + 1.7210682556033134, + 0.8821582901291549, + 2.271256698295474, + 0.0647391602396965, + 1.2793085668236017, + 1.003191460389644, + 0.7258247416466475, + 0.0, + 0.245221309363842, + 0.5763235613703728, + 0.3494469281286001, + 0.12877047061920166, + 0.336858831346035, + 8.30287989974022, + 0.7237605787813663, + 0.3210414871573448, + 1.223482683300972, + 3.696913355961442, + 0.37828345596790314, + 2.0197044536471367, + 0.02342246286571026, + 0.42642273008823395, + 0.38945027347654104, + 0.6876702215522528, + 2.1899755019694567, + 0.3918931824155152, + 0.12990008108317852, + 0.4259084751829505, + 0.270910058170557, + 0.18095043674111366, + 0.7530435547232628, + 0.20564711093902588, + 0.3295048512518406, + 0.6461035069078207, + 2.1540847569704056, + 0.38040227768942714, + 0.31635729782283306, + 0.4974620882421732, + 1.2131951358169317, + 0.7905635200440884, + 0.8617727253586054, + 0.8837587237358093, + 1.5120569709688425, + 2.768738489598036, + 2.675373699516058, + 0.06381497718393803, + 0.4165965896099806, + 2.493139509111643, + 0.7227519433945417, + 0.8763452316634357, + 1.1695252675563097, + 0.2736438848078251, + 0.67155841877684, + 1.518357357941568, + 0.6262900764122605 + ], + "unique_experts": 63, + "load_cv": 0.6638187286689358, + "normalized_load_entropy": 0.943256880213463, + "max_load_share": 0.0367816091954023 + } + }, + "s1_eos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "24c6c4dc7eff4f955d1676f1728d2a631e2cabc1484d243e2aa07baac1afe8ce", + "route_weight_sha256": "afaf6b5d21d4f89d25da9a5fc9a5dd5413f13871ea1bc6ca7bad5238a7b56fab", + "loads": [ + 6, + 10, + 4, + 2, + 4, + 8, + 3, + 0, + 10, + 20, + 23, + 29, + 3, + 18, + 18, + 14, + 0, + 8, + 7, + 5, + 1, + 10, + 12, + 7, + 8, + 27, + 17, + 0, + 13, + 0, + 4, + 4, + 4, + 19, + 14, + 3, + 8, + 3, + 1, + 16, + 10, + 8, + 12, + 27, + 11, + 11, + 6, + 22, + 10, + 13, + 11, + 10, + 23, + 25, + 2, + 7, + 28, + 19, + 28, + 17, + 5, + 16, + 18, + 18 + ], + "weighted_loads": [ + 0.30200970359146595, + 0.2881334382109344, + 0.16517773270606995, + 0.05291359685361385, + 0.26233918219804764, + 0.352198151871562, + 0.11544176377356052, + 0.0, + 0.5688437260687351, + 1.3280255869030952, + 0.8195908139459789, + 2.0928285717964172, + 0.09814595058560371, + 1.203259153291583, + 0.9787205890752375, + 0.5550332758575678, + 0.0, + 0.2561721671372652, + 0.2632338423281908, + 0.2729335315525532, + 0.12774407863616943, + 0.384127140045166, + 8.823298275470734, + 0.2288326919078827, + 0.29773212410509586, + 1.162895143032074, + 3.3408697713166475, + 0.0, + 0.7914042882621288, + 0.0, + 0.2581340279430151, + 0.13393455743789673, + 0.6632869485765696, + 1.5807549729943275, + 0.37821950670331717, + 0.09710897132754326, + 0.3043164312839508, + 0.23587938398122787, + 0.03300771489739418, + 0.6686759926378727, + 0.38704466354101896, + 0.3103754594922066, + 0.5355786792933941, + 2.0667582526803017, + 0.3782704877667129, + 0.3776910025626421, + 0.20044423639774323, + 0.9468745235353708, + 0.79367152787745, + 0.7770139090716839, + 0.6901590451598167, + 0.33245743066072464, + 1.9752288646996021, + 2.221660127863288, + 0.06514155305922031, + 0.07877600705251098, + 2.4565530344843864, + 0.8249564692378044, + 0.8684687851928174, + 0.7173134852200747, + 0.3055771142244339, + 0.6019104421138763, + 1.3873773273080587, + 0.5642860624939203 + ], + "unique_experts": 60, + "load_cv": 0.7147476460477952, + "normalized_load_entropy": 0.933188622998701, + "max_load_share": 0.04027777777777778 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "3fcbca21d597bf3ef4399efb2f4bd0137b46475800b8f30b9de05932ac2eaf22", + "route_weight_sha256": "848340ebe7d5e04223f5b69d6e5aad6b2c38459c7931c5cbb75de45cc79f75c7", + "loads": [ + 14, + 11, + 4, + 5, + 8, + 24, + 3, + 4, + 12, + 32, + 23, + 32, + 9, + 18, + 18, + 19, + 0, + 8, + 14, + 9, + 3, + 14, + 12, + 17, + 13, + 31, + 22, + 8, + 26, + 1, + 9, + 8, + 6, + 30, + 15, + 4, + 8, + 6, + 4, + 17, + 10, + 8, + 14, + 28, + 13, + 11, + 12, + 25, + 12, + 14, + 26, + 13, + 31, + 34, + 4, + 11, + 29, + 21, + 29, + 33, + 8, + 18, + 20, + 21 + ], + "weighted_loads": [ + 1.0819956883788109, + 0.3398653599433601, + 0.16517773270606995, + 0.1685128454118967, + 0.4962496664375067, + 1.477637093514204, + 0.11544176377356052, + 0.16336096823215485, + 0.7354155071079731, + 2.15542758628726, + 0.8195908139459789, + 2.304135363548994, + 0.48523709550499916, + 1.203259153291583, + 0.9787205890752375, + 0.7685314994305372, + 0.0, + 0.2561721671372652, + 0.782630892470479, + 0.47465785034000874, + 0.3551996275782585, + 0.5355966333299875, + 8.823298275470734, + 0.650743106380105, + 0.540094893425703, + 1.3289473950862885, + 3.6926496531814337, + 0.3078938676044345, + 2.4229996353387833, + 0.049014948308467865, + 0.5099299382418394, + 0.251110078766942, + 0.7446742486208677, + 2.692492164671421, + 0.4271027585491538, + 0.17669055238366127, + 0.3043164312839508, + 0.5974640287458897, + 0.2508368007838726, + 0.7265288420021534, + 0.38704466354101896, + 0.3103754594922066, + 0.6318924315273762, + 2.111493080854416, + 0.4408576521091163, + 0.3776910025626421, + 0.5121320523321629, + 1.067758908495307, + 0.9236065056174994, + 0.8117742389440536, + 1.6334986966103315, + 1.548696929588914, + 2.7706919871270657, + 2.939498556777835, + 0.14739754237234592, + 0.3659959635697305, + 2.5088565461337566, + 0.906280655413866, + 0.9783984660170972, + 1.6601767968386412, + 0.5589705817401409, + 0.6483142608776689, + 1.489873444661498, + 0.6759651061147451 + ], + "unique_experts": 63, + "load_cv": 0.6084244688237892, + "normalized_load_entropy": 0.9533229816358862, + "max_load_share": 0.035196687370600416 + } + }, + "s0_bos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "4c1b90f2524b640122b6ff8cff62ebdbc84aafc4cb400632a676e84096db1347", + "route_weight_sha256": "3924f13cc8a8eae7f88d30a68231416fb20070706e11e2ab690cc71fad4d4c75", + "loads": [ + 5, + 12, + 3, + 3, + 4, + 8, + 3, + 0, + 10, + 20, + 24, + 30, + 3, + 17, + 19, + 13, + 0, + 11, + 7, + 4, + 2, + 8, + 12, + 8, + 5, + 23, + 18, + 0, + 17, + 1, + 3, + 4, + 4, + 19, + 11, + 3, + 9, + 3, + 1, + 19, + 8, + 8, + 10, + 28, + 8, + 11, + 8, + 23, + 10, + 14, + 12, + 12, + 21, + 25, + 2, + 6, + 28, + 15, + 29, + 20, + 4, + 15, + 20, + 17 + ], + "weighted_loads": [ + 0.29493018984794617, + 0.3420582110993564, + 0.14133332669734955, + 0.07795425318181515, + 0.2745995447039604, + 0.33411418460309505, + 0.12366428598761559, + 0.0, + 0.6098482441157103, + 1.2961731534451246, + 0.9166207627858967, + 2.1473666336387396, + 0.09617388248443604, + 1.292195025831461, + 1.07157694385387, + 0.5578066147863865, + 0.0, + 0.3336125276982784, + 0.24562732130289078, + 0.2446680460125208, + 0.16177216172218323, + 0.3219580724835396, + 8.795386046171188, + 0.26249457709491253, + 0.17068637162446976, + 1.0878351014107466, + 3.46236683242023, + 0.0, + 1.1340032927691936, + 0.022661957889795303, + 0.23097513616085052, + 0.13498197123408318, + 0.7178840488195419, + 1.5190865844488144, + 0.2749254594091326, + 0.10168037749826908, + 0.3195754922926426, + 0.23284702375531197, + 0.03212936222553253, + 0.7841003462672234, + 0.3292301641777158, + 0.3085930645465851, + 0.4789388123899698, + 2.1362376175820827, + 0.2603454766795039, + 0.35732936300337315, + 0.26453288830816746, + 0.9819009751081467, + 0.7926101982593536, + 0.8346305843442678, + 0.7864883355796337, + 0.37800317630171776, + 2.021535985171795, + 2.3288521114736795, + 0.079609714448452, + 0.05606314982287586, + 2.581832353025675, + 0.6606345977634192, + 0.9299959719646722, + 0.8647494222968817, + 0.2645872998982668, + 0.5675595942884684, + 1.4479619022458792, + 0.576431873254478 + ], + "unique_experts": 61, + "load_cv": 0.7246966159609035, + "normalized_load_entropy": 0.9325700440144411, + "max_load_share": 0.041666666666666664 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "58d9c0eeee71e33a251c6f68c0c9e8cd46863ab343e9478b6d452c68c58f1466", + "route_weight_sha256": "030946904012b18e2fb72d0c7febb3e360a721480f893bec7fc8ab4bb0518f14", + "loads": [ + 10, + 12, + 3, + 6, + 4, + 18, + 3, + 1, + 10, + 28, + 27, + 33, + 3, + 17, + 19, + 16, + 0, + 11, + 14, + 5, + 2, + 8, + 12, + 18, + 7, + 27, + 24, + 6, + 26, + 1, + 6, + 10, + 4, + 25, + 11, + 3, + 10, + 4, + 3, + 19, + 8, + 8, + 11, + 29, + 10, + 11, + 13, + 25, + 10, + 16, + 16, + 17, + 27, + 31, + 2, + 10, + 28, + 16, + 30, + 30, + 4, + 15, + 20, + 17 + ], + "weighted_loads": [ + 0.9254418630152941, + 0.3420582110993564, + 0.14133332669734955, + 0.2132484782487154, + 0.2745995447039604, + 1.2470222916454077, + 0.12366428598761559, + 0.033571481704711914, + 0.6098482441157103, + 1.7590263057500124, + 1.00803068629466, + 2.338943948969245, + 0.09617388248443604, + 1.292195025831461, + 1.07157694385387, + 0.6889851428568363, + 0.0, + 0.3336125276982784, + 0.7461631149053574, + 0.28455749340355396, + 0.16177216172218323, + 0.3219580724835396, + 8.795386046171188, + 0.7049830220639706, + 0.23488529585301876, + 1.2499653045088053, + 3.798453813418746, + 0.45041324198246, + 2.336050283163786, + 0.022661957889795303, + 0.43645720928907394, + 0.39012302458286285, + 0.7178840488195419, + 2.1384328827261925, + 0.2749254594091326, + 0.10168037749826908, + 0.37219516187906265, + 0.2759562321007252, + 0.1723906397819519, + 0.7841003462672234, + 0.3292301641777158, + 0.3085930645465851, + 0.5261393953114748, + 2.184477027505636, + 0.3705185456201434, + 0.35732936300337315, + 0.5106891635805368, + 1.067128524184227, + 0.7926101982593536, + 0.9018837586045265, + 0.9409709572792053, + 0.8636304289102554, + 2.779019959270954, + 2.7571488451212645, + 0.079609714448452, + 0.41363302688114345, + 2.581832353025675, + 0.7063681948930025, + 0.973769459174946, + 1.3134790379554033, + 0.2645872998982668, + 0.5675595942884684, + 1.4479619022458792, + 0.576431873254478 + ], + "unique_experts": 63, + "load_cv": 0.6717955700098008, + "normalized_load_entropy": 0.9422401341802724, + "max_load_share": 0.03793103448275862 + } + }, + "s1_bos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "14781c570734e59afd5a63d379054bc1efc5ddad4eed1e1d5f952cb0b4d41915", + "route_weight_sha256": "e1e1df92cb56111d19ff5e86ad0905d68807bbb7367c9c46b9bd0a17ff1778cd", + "loads": [ + 5, + 11, + 3, + 3, + 4, + 7, + 3, + 0, + 10, + 21, + 25, + 29, + 1, + 17, + 17, + 15, + 0, + 10, + 7, + 4, + 2, + 9, + 12, + 9, + 5, + 22, + 18, + 0, + 17, + 1, + 4, + 6, + 4, + 18, + 11, + 3, + 10, + 3, + 1, + 20, + 10, + 6, + 11, + 29, + 13, + 10, + 6, + 21, + 10, + 14, + 10, + 11, + 22, + 25, + 1, + 5, + 29, + 17, + 26, + 18, + 4, + 15, + 22, + 18 + ], + "weighted_loads": [ + 0.2944292835891247, + 0.3192442459985614, + 0.12960344552993774, + 0.07018681056797504, + 0.262795552611351, + 0.3101054597645998, + 0.11830195970833302, + 0.0, + 0.6047956086695194, + 1.3098979406058788, + 0.9452590374276042, + 2.1285985186696053, + 0.03159850835800171, + 1.210628867149353, + 1.0102297151461244, + 0.6021642498672009, + 0.0, + 0.2769890446215868, + 0.256454773247242, + 0.24318628758192062, + 0.16258887015283108, + 0.3466160483658314, + 8.814329966902733, + 0.28942176327109337, + 0.18724623136222363, + 1.0160078760236502, + 3.4362345319241285, + 0.0, + 1.048382369801402, + 0.02243892289698124, + 0.26704926788806915, + 0.21238379180431366, + 0.7109165228903294, + 1.5600628592073917, + 0.302363135619089, + 0.10268860124051571, + 0.3428619485348463, + 0.23702839389443398, + 0.03259226679801941, + 0.8254999499768019, + 0.3869686061516404, + 0.23072676733136177, + 0.507606353610754, + 2.1653359588235617, + 0.5023907041177154, + 0.34702642261981964, + 0.20347092673182487, + 0.9198864307254553, + 0.7980600968003273, + 0.8438740596175194, + 0.681079525500536, + 0.3553554806858301, + 2.015009667724371, + 2.2755677476525307, + 0.04045238345861435, + 0.04970482271164656, + 2.5452243518084288, + 0.7172693572938442, + 0.7882212318945676, + 0.7530561946332455, + 0.2658453732728958, + 0.5900253374129534, + 1.5025622360408306, + 0.6018441021442413 + ], + "unique_experts": 61, + "load_cv": 0.7246966159609035, + "normalized_load_entropy": 0.9314319381856234, + "max_load_share": 0.04027777777777778 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "37c453666e809cd73d5bfe142043ac1717c9e8753badd738cb2570e84956355e", + "route_weight_sha256": "ce736a6732b7daff6f87e12e066d0c754bc3c66161dedf47333e2f5201e71700", + "loads": [ + 13, + 12, + 3, + 6, + 8, + 23, + 3, + 4, + 12, + 33, + 25, + 32, + 7, + 17, + 17, + 20, + 0, + 10, + 14, + 8, + 4, + 12, + 12, + 18, + 10, + 26, + 23, + 8, + 31, + 2, + 9, + 10, + 6, + 29, + 12, + 4, + 10, + 6, + 4, + 21, + 10, + 6, + 12, + 30, + 16, + 11, + 11, + 24, + 12, + 15, + 25, + 15, + 30, + 34, + 3, + 9, + 30, + 20, + 27, + 34, + 7, + 16, + 24, + 21 + ], + "weighted_loads": [ + 1.0837447810918093, + 0.37097616773098707, + 0.12960344552993774, + 0.20606869645416737, + 0.49670603685081005, + 1.4355444014072418, + 0.11830195970833302, + 0.17537116631865501, + 0.7713673897087574, + 2.1201959662139416, + 0.9452590374276042, + 2.339905310422182, + 0.41868965327739716, + 1.210628867149353, + 1.0102297151461244, + 0.808316882699728, + 0.0, + 0.2769890446215868, + 0.7506926096975803, + 0.4449106063693762, + 0.39004441909492016, + 0.4489795174449682, + 8.814329966902733, + 0.6838536374270916, + 0.4296090006828308, + 1.173184022307396, + 3.7880144137889147, + 0.38390748389065266, + 2.8460761550813913, + 0.0714538712054491, + 0.52124098315835, + 0.3759193681180477, + 0.7923038229346275, + 2.688200768083334, + 0.35124638746492565, + 0.18227018229663372, + 0.3428619485348463, + 0.5986130386590958, + 0.2299356497824192, + 0.8833527993410826, + 0.3869686061516404, + 0.23072676733136177, + 0.5590410567820072, + 2.210070786997676, + 0.60584422852844, + 0.38862568885087967, + 0.46014345064759254, + 1.0363119561225176, + 0.9279950745403767, + 0.8786343894898891, + 1.6157179772853851, + 0.7852454744279385, + 2.8104727901518345, + 2.9934061765670776, + 0.12270837277173996, + 0.39906058739870787, + 2.597527863457799, + 0.8485056050121784, + 0.8981509127188474, + 1.695919506251812, + 0.5192388407886028, + 0.6316696014255285, + 1.60505835339427, + 0.7135231457650661 + ], + "unique_experts": 63, + "load_cv": 0.6177097656344956, + "normalized_load_entropy": 0.9522582265056738, + "max_load_share": 0.035196687370600416 + } + }, + "s0_x": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "5aeee7c341e15bcc71b681b2a61ba5caf1b6125a5c0df19b017cb3aa9f0a06ae", + "route_weight_sha256": "9cb525b7088fd5564677cdba795e58552c0c02462b44e34878947e5c7a9dc192", + "loads": [ + 4, + 13, + 4, + 5, + 4, + 7, + 3, + 1, + 10, + 21, + 21, + 30, + 3, + 17, + 16, + 15, + 0, + 8, + 8, + 5, + 2, + 8, + 12, + 9, + 5, + 24, + 18, + 0, + 15, + 1, + 4, + 4, + 4, + 19, + 13, + 6, + 9, + 3, + 1, + 17, + 6, + 9, + 11, + 29, + 10, + 6, + 6, + 23, + 11, + 15, + 10, + 11, + 24, + 26, + 1, + 6, + 28, + 18, + 27, + 20, + 2, + 18, + 20, + 14 + ], + "weighted_loads": [ + 0.26374299451708794, + 0.3601865107193589, + 0.16722266376018524, + 0.14586213789880276, + 0.2758505716919899, + 0.30542582273483276, + 0.12246041186153889, + 0.03191151097416878, + 0.6131617687642574, + 1.4253352265805006, + 0.7870048696640879, + 2.201589174568653, + 0.10048344917595387, + 1.3513262886554003, + 1.0357049559243023, + 0.6343941558152437, + 0.0, + 0.25841808039695024, + 0.2994523160159588, + 0.27195167168974876, + 0.1597637627273798, + 0.3148161880671978, + 8.524423122406006, + 0.2796698175370693, + 0.17792374826967716, + 1.139508694410324, + 3.479911919683218, + 0.0, + 0.9127573017030954, + 0.0237995907664299, + 0.2739035449922085, + 0.13672196120023727, + 0.7004892528057098, + 1.6318980902433395, + 0.3394214028958231, + 0.1908214259892702, + 0.27856160094961524, + 0.2433043196797371, + 0.032441142946481705, + 0.7042545229196548, + 0.21429582219570875, + 0.3555667884647846, + 0.521971307694912, + 2.2223907709121704, + 0.3541238403413445, + 0.2067029755562544, + 0.1972454972565174, + 0.968014856800437, + 0.8205892778933048, + 0.8769633248448372, + 0.7280010525137186, + 0.3645985648036003, + 2.192967988550663, + 2.4235620368272066, + 0.041735269129276276, + 0.05591695639304817, + 2.5854882672429085, + 0.7808304317295551, + 0.8385017118416727, + 0.834170987829566, + 0.21561693027615547, + 0.7153918389230967, + 1.4295961363241076, + 0.5086243599653244 + ], + "unique_experts": 62, + "load_cv": 0.7243558228002942, + "normalized_load_entropy": 0.9334413903872263, + "max_load_share": 0.041666666666666664 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "26a69eadaa842f8d2bfb0dddde8de1cf55fa06ea8b3b59d960c0361e7e059621", + "route_weight_sha256": "2cc519562b191b3ef6705a05a7b50e9d520e5a8c55f689deee9ab1107d675b54", + "loads": [ + 10, + 13, + 4, + 6, + 4, + 19, + 3, + 2, + 10, + 29, + 24, + 33, + 3, + 18, + 16, + 18, + 0, + 8, + 13, + 7, + 2, + 8, + 12, + 19, + 7, + 28, + 25, + 5, + 23, + 1, + 7, + 10, + 4, + 26, + 13, + 6, + 10, + 5, + 3, + 17, + 6, + 9, + 12, + 30, + 11, + 6, + 11, + 26, + 11, + 17, + 14, + 13, + 30, + 33, + 1, + 10, + 28, + 19, + 27, + 31, + 2, + 18, + 20, + 14 + ], + "weighted_loads": [ + 1.0012232195585966, + 0.3601865107193589, + 0.16722266376018524, + 0.18526491709053516, + 0.2758505716919899, + 1.356221441179514, + 0.12246041186153889, + 0.06548299267888069, + 0.6131617687642574, + 1.8201342765241861, + 0.8784147931728512, + 2.3931664898991585, + 0.10048344917595387, + 1.4089286047965288, + 1.0357049559243023, + 0.7410536129027605, + 0.0, + 0.25841808039695024, + 0.6206059791147709, + 0.38480379059910774, + 0.1597637627273798, + 0.3148161880671978, + 8.524423122406006, + 0.7221582625061274, + 0.24170862510800362, + 1.30084577947855, + 3.9240679033100605, + 0.3795173428952694, + 1.8911894131451845, + 0.0237995907664299, + 0.492714773863554, + 0.3867664970457554, + 0.7004892528057098, + 2.320755511522293, + 0.3394214028958231, + 0.1908214259892702, + 0.3311812705360353, + 0.36025475710630417, + 0.16796861216425896, + 0.7042545229196548, + 0.21429582219570875, + 0.3555667884647846, + 0.5691550970077515, + 2.270630180835724, + 0.38685328722931445, + 0.2067029755562544, + 0.46886516362428665, + 1.0967640783637762, + 0.8205892778933048, + 0.9442164991050959, + 0.8864858690649271, + 0.7287667579948902, + 2.9504519626498222, + 2.938146537169814, + 0.041735269129276276, + 0.3674555520992726, + 2.5854882672429085, + 0.8213742151856422, + 0.8385017118416727, + 1.3436575923115015, + 0.21561693027615547, + 0.7153918389230967, + 1.4295961363241076, + 0.5086243599653244 + ], + "unique_experts": 63, + "load_cv": 0.6806733122526163, + "normalized_load_entropy": 0.9414533866909247, + "max_load_share": 0.03793103448275862 + } + }, + "s1_x": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "e81c014747b5c6c43a12624cab17ae56acca0d862e3393bc0e17d084ce50942e", + "route_weight_sha256": "00e67d3dfa62796c187c854be1c75cdfd22046c64219aa416fdcc7f3a4a0e270", + "loads": [ + 4, + 11, + 4, + 4, + 4, + 10, + 3, + 2, + 9, + 19, + 24, + 31, + 3, + 17, + 18, + 13, + 0, + 9, + 9, + 4, + 2, + 8, + 12, + 10, + 6, + 27, + 18, + 0, + 16, + 1, + 4, + 4, + 4, + 21, + 13, + 4, + 7, + 3, + 0, + 15, + 9, + 7, + 9, + 30, + 11, + 6, + 7, + 20, + 10, + 15, + 11, + 9, + 21, + 28, + 1, + 5, + 30, + 18, + 24, + 17, + 4, + 17, + 20, + 18 + ], + "weighted_loads": [ + 0.26661104522645473, + 0.3117921072989702, + 0.15244739316403866, + 0.10013355687260628, + 0.2598404586315155, + 0.44119229912757874, + 0.11447632126510143, + 0.0582337211817503, + 0.538943275809288, + 1.3578115552663803, + 0.8908934290520847, + 2.243715323507786, + 0.10477796196937561, + 1.1719407066702843, + 0.9467284795828164, + 0.5514688994735479, + 0.0, + 0.26960993465036154, + 0.3213835842907429, + 0.2421443872153759, + 0.15913380682468414, + 0.29745172522962093, + 8.683214291930199, + 0.3104503024369478, + 0.21992651745676994, + 1.160279056057334, + 3.413727993145585, + 0.0, + 0.7698901183903217, + 0.022630443796515465, + 0.2753327190876007, + 0.14864647388458252, + 0.6772778984159231, + 1.7036014907062054, + 0.3912437101826072, + 0.1276355478912592, + 0.2549847327172756, + 0.230979785323143, + 0.0, + 0.6513535194098949, + 0.3033688464201987, + 0.2734188921749592, + 0.42547457106411457, + 2.2713691666722298, + 0.39835970662534237, + 0.21177074685692787, + 0.22896241955459118, + 0.8089430201798677, + 0.7504782509058714, + 0.8863693885505199, + 0.6971740443259478, + 0.27360931411385536, + 1.9659582320600748, + 2.448190128430724, + 0.03892018646001816, + 0.05030053574591875, + 2.6216332763433456, + 0.783522441983223, + 0.7304394135717303, + 0.7615055944770575, + 0.2651561051607132, + 0.7024607416242361, + 1.4071684461086988, + 0.6080008307471871 + ], + "unique_experts": 61, + "load_cv": 0.7348469228349533, + "normalized_load_entropy": 0.9321836298685349, + "max_load_share": 0.043055555555555555 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "403368eab62ccab3dc991f6a96add9df4c2d7a712f604d1fad929861970a7502", + "route_weight_sha256": "9689cfc86a8f16ac7e59b147ca0fa60340aea1e2d91c206ad9514c1a22115e06", + "loads": [ + 12, + 12, + 4, + 5, + 8, + 29, + 3, + 5, + 11, + 29, + 24, + 35, + 9, + 17, + 18, + 16, + 0, + 9, + 15, + 8, + 4, + 11, + 12, + 20, + 11, + 30, + 24, + 8, + 28, + 2, + 10, + 7, + 6, + 32, + 14, + 5, + 8, + 7, + 3, + 16, + 9, + 7, + 11, + 31, + 13, + 6, + 13, + 23, + 12, + 16, + 26, + 11, + 29, + 38, + 3, + 9, + 31, + 20, + 25, + 37, + 7, + 18, + 22, + 22 + ], + "weighted_loads": [ + 1.083064403384924, + 0.3635240290313959, + 0.15244739316403866, + 0.1396687589585781, + 0.49375094287097454, + 1.8011912647634745, + 0.11447632126510143, + 0.18430176563560963, + 0.705515056848526, + 1.9854242391884327, + 0.8908934290520847, + 2.5033979788422585, + 0.49186910688877106, + 1.1719407066702843, + 0.9467284795828164, + 0.6753893923014402, + 0.0, + 0.26960993465036154, + 0.7797871120274067, + 0.44386870600283146, + 0.3865893557667732, + 0.3998151943087578, + 8.683214291930199, + 0.7578300032764673, + 0.46228928677737713, + 1.2944729011505842, + 3.8691528644412756, + 0.3455065432935953, + 2.1274104192852974, + 0.07164539210498333, + 0.5454228036105633, + 0.2590988799929619, + 0.7586651984602213, + 2.848079077899456, + 0.4401269620284438, + 0.2072171289473772, + 0.29140555113554, + 0.6886127926409245, + 0.19062698259949684, + 0.7092063687741756, + 0.3033688464201987, + 0.2734188921749592, + 0.5329693090170622, + 2.316103994846344, + 0.4609468709677458, + 0.21177074685692787, + 0.5398879069834948, + 0.9193419236689806, + 0.8804132286459208, + 0.9211297184228897, + 1.639134282246232, + 0.6354355420917273, + 2.7614213544875383, + 3.2905613090842962, + 0.12117617577314377, + 0.30219797510653734, + 2.673936787992716, + 0.873847246170044, + 0.84036909439601, + 1.8636081162840128, + 0.5185495726764202, + 0.7441050056368113, + 1.5096645634621382, + 0.7508283397182822 + ], + "unique_experts": 63, + "load_cv": 0.6463574469586676, + "normalized_load_entropy": 0.9492377126772586, + "max_load_share": 0.039337474120082816 + } + }, + "s0_period": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "64e77ad891b08fe3fc0dab581eaf1ae4f92f54f007989ff036f15b5996695531", + "route_weight_sha256": "5b24f42ae74038bc45b87549614165b5647d4c288324b407701080cbe05a8770", + "loads": [ + 4, + 13, + 4, + 2, + 4, + 8, + 3, + 0, + 10, + 22, + 21, + 31, + 3, + 17, + 16, + 15, + 0, + 7, + 8, + 5, + 2, + 7, + 12, + 10, + 6, + 24, + 18, + 1, + 16, + 1, + 3, + 3, + 4, + 19, + 14, + 5, + 9, + 3, + 0, + 17, + 6, + 8, + 11, + 28, + 8, + 6, + 5, + 22, + 11, + 14, + 11, + 8, + 24, + 25, + 2, + 7, + 28, + 18, + 30, + 23, + 2, + 19, + 22, + 15 + ], + "weighted_loads": [ + 0.2752278037369251, + 0.36952299205586314, + 0.16999436728656292, + 0.052312154322862625, + 0.27720461413264275, + 0.3339289128780365, + 0.120772959664464, + 0.0, + 0.6077768504619598, + 1.4688179902732372, + 0.7465852242894471, + 2.2794954627752304, + 0.09572981856763363, + 1.3168537262827158, + 1.0246649263426661, + 0.6454848051071167, + 0.0, + 0.24408353120088577, + 0.29942123033106327, + 0.26342371106147766, + 0.1605952363461256, + 0.28655632212758064, + 8.671065114438534, + 0.30941617861390114, + 0.2331108059734106, + 1.1162381153553724, + 3.481242176145315, + 0.025685248896479607, + 0.9529169276356697, + 0.02457253262400627, + 0.23752634972333908, + 0.10601285845041275, + 0.6976746823638678, + 1.6614980567246675, + 0.3807285667862743, + 0.16136245243251324, + 0.32279360853135586, + 0.23404830694198608, + 0.0, + 0.7020026911050081, + 0.2111906949430704, + 0.323698241263628, + 0.5199873633682728, + 2.2295791301876307, + 0.2872246946208179, + 0.2011545803397894, + 0.16562796384096146, + 0.9215298760682344, + 0.8181238584220409, + 0.8526353444904089, + 0.7724838927388191, + 0.2635321654379368, + 2.2388036753982306, + 2.393664913251996, + 0.07810059562325478, + 0.06452999194152653, + 2.5941386371850967, + 0.7551445905119181, + 0.9615793586708605, + 0.931529002264142, + 0.21393360570073128, + 0.7391326036304235, + 1.4202312608249485, + 0.5147982109338045 + ], + "unique_experts": 61, + "load_cv": 0.7506375890690904, + "normalized_load_entropy": 0.9284007860933927, + "max_load_share": 0.043055555555555555 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "ab265271eb68ecb510c90dd9fe515659c79a6ec4a3806b30563f7b7d02ef91e9", + "route_weight_sha256": "ef7a5197686d43861c469eba3c1896f63e9a90e0044031adaab9f2945e587c15", + "loads": [ + 10, + 13, + 4, + 3, + 4, + 19, + 3, + 2, + 10, + 29, + 24, + 34, + 3, + 18, + 16, + 18, + 0, + 7, + 13, + 6, + 2, + 7, + 12, + 20, + 8, + 28, + 25, + 7, + 24, + 1, + 6, + 9, + 4, + 26, + 14, + 5, + 11, + 5, + 2, + 17, + 6, + 8, + 11, + 29, + 9, + 6, + 9, + 25, + 11, + 17, + 16, + 10, + 30, + 32, + 2, + 11, + 28, + 19, + 30, + 33, + 2, + 20, + 22, + 15 + ], + "weighted_loads": [ + 0.9540935326367617, + 0.36952299205586314, + 0.16999436728656292, + 0.09171493351459503, + 0.27720461413264275, + 1.3182339519262314, + 0.120772959664464, + 0.0729089081287384, + 0.6077768504619598, + 1.8224499225616455, + 0.8379951477982104, + 2.471072778105736, + 0.09572981856763363, + 1.370397562161088, + 1.0246649263426661, + 0.7553398571908474, + 0.0, + 0.24408353120088577, + 0.6621655318886042, + 0.30331315845251083, + 0.1605952363461256, + 0.28655632212758064, + 8.671065114438534, + 0.7519046235829592, + 0.3068815656006336, + 1.2684384267777205, + 3.8696656674146652, + 0.4579088445752859, + 2.047122046351433, + 0.02457253262400627, + 0.4497545138001442, + 0.3521578945219517, + 0.6976746823638678, + 2.3427991960197687, + 0.3807285667862743, + 0.16136245243251324, + 0.4191460330039263, + 0.33697863668203354, + 0.130578450858593, + 0.7020026911050081, + 0.2111906949430704, + 0.323698241263628, + 0.5199873633682728, + 2.277818540111184, + 0.31995414150878787, + 0.2011545803397894, + 0.37911590188741684, + 1.0727000180631876, + 0.8181238584220409, + 0.9661296233534813, + 0.9840006567537785, + 0.6277003586292267, + 2.99628764949739, + 2.9035846646875143, + 0.07810059562325478, + 0.4456149444449693, + 2.5941386371850967, + 0.7956863176077604, + 0.9615793586708605, + 1.3802586179226637, + 0.21393360570073128, + 0.7746902275830507, + 1.4202312608249485, + 0.5147982109338045 + ], + "unique_experts": 63, + "load_cv": 0.7008704928497066, + "normalized_load_entropy": 0.9382291900535162, + "max_load_share": 0.03908045977011494 + } + }, + "s1_period": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "17c28160929dfcce2899cc430d0462b0e56340b554755c3789cfa779ab10295e", + "route_weight_sha256": "aa051a17d2bb28e9e0f0033eff592ab27448cdb41b3a5ea3f90aeebd1fe24471", + "loads": [ + 4, + 11, + 4, + 5, + 3, + 9, + 3, + 2, + 10, + 21, + 24, + 30, + 2, + 18, + 19, + 14, + 0, + 8, + 11, + 4, + 2, + 8, + 12, + 9, + 5, + 24, + 18, + 1, + 16, + 1, + 4, + 5, + 3, + 22, + 13, + 4, + 8, + 3, + 0, + 17, + 9, + 6, + 9, + 30, + 11, + 6, + 3, + 18, + 10, + 14, + 12, + 10, + 22, + 27, + 1, + 5, + 29, + 20, + 25, + 17, + 4, + 17, + 19, + 19 + ], + "weighted_loads": [ + 0.2754078693687916, + 0.31008457858115435, + 0.1564444936811924, + 0.12328360229730606, + 0.2234847955405712, + 0.39606253430247307, + 0.11521310359239578, + 0.05872339569032192, + 0.5773289427161217, + 1.4017493538558483, + 0.8902730359695852, + 2.224209165200591, + 0.06540614180266857, + 1.2324784323573112, + 0.9756512651219964, + 0.5864184759557247, + 0.0, + 0.26184613443911076, + 0.39138627611100674, + 0.23784959316253662, + 0.16253669559955597, + 0.29943349957466125, + 8.663620099425316, + 0.28239094465970993, + 0.18608276173472404, + 1.043814778327942, + 3.4620549138635397, + 0.03422805666923523, + 0.8184454161673784, + 0.024022402241826057, + 0.2680191732943058, + 0.18257654085755348, + 0.6324802096933126, + 1.807497676461935, + 0.39174585067667067, + 0.13060743175446987, + 0.29576028883457184, + 0.22677448391914368, + 0.0, + 0.7133112046867609, + 0.2985525184776634, + 0.24307242780923843, + 0.42632419615983963, + 2.3119134418666363, + 0.4081396125257015, + 0.20871544256806374, + 0.11082593724131584, + 0.7263750229030848, + 0.7585541550070047, + 0.8430808801203966, + 0.7575661335140467, + 0.3114409036934376, + 2.0570537205785513, + 2.4450946263968945, + 0.04062143713235855, + 0.051738712936639786, + 2.59558292850852, + 0.8260080050677061, + 0.7753181420266628, + 0.7486063838005066, + 0.26121094822883606, + 0.7023634929209948, + 1.4033203069120646, + 0.6571856690570712 + ], + "unique_experts": 62, + "load_cv": 0.7361897232656642, + "normalized_load_entropy": 0.931412603073873, + "max_load_share": 0.041666666666666664 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "335c09526cd16ee4f4de6ebad893534259cace1b9e588ebde205e1d159a4cd23", + "route_weight_sha256": "078f1ed8c89bbfe01d48f15b0e806f4819887a36cbf5f0b3bcf3050fe4d1da7f", + "loads": [ + 12, + 12, + 4, + 7, + 8, + 26, + 3, + 6, + 12, + 32, + 24, + 33, + 8, + 18, + 19, + 17, + 0, + 8, + 17, + 8, + 4, + 11, + 12, + 18, + 12, + 27, + 24, + 8, + 29, + 2, + 10, + 9, + 5, + 32, + 14, + 5, + 8, + 7, + 3, + 18, + 9, + 6, + 10, + 32, + 13, + 6, + 8, + 21, + 12, + 16, + 27, + 12, + 30, + 38, + 3, + 9, + 30, + 23, + 26, + 34, + 7, + 18, + 21, + 23 + ], + "weighted_loads": [ + 1.0677047688513994, + 0.36181650031358004, + 0.1564444936811924, + 0.196450624614954, + 0.4980933237820864, + 1.574476519599557, + 0.11521310359239578, + 0.22690648399293423, + 0.7439007237553596, + 2.0975682325661182, + 0.8902730359695852, + 2.435515956953168, + 0.452497286722064, + 1.2324784323573112, + 0.9756512651219964, + 0.7119986973702908, + 0.0, + 0.26184613443911076, + 0.8579633440822363, + 0.4395739119499922, + 0.38999224454164505, + 0.4017969686537981, + 8.663620099425316, + 0.6768228188157082, + 0.5313894059509039, + 1.1650912165641785, + 3.861816206946969, + 0.3342126961797476, + 2.175819193944335, + 0.07303735055029392, + 0.536566898226738, + 0.3290258161723614, + 0.7138675097376108, + 2.8899937979876995, + 0.4406291025225073, + 0.21018901281058788, + 0.29576028883457184, + 0.6876260824501514, + 0.18850811943411827, + 0.7711640540510416, + 0.2985525184776634, + 0.24307242780923843, + 0.47775889933109283, + 2.3931744806468487, + 0.47072677686810493, + 0.20871544256806374, + 0.3880416266620159, + 0.8363657314330339, + 0.8884891327470541, + 0.9201582241803408, + 1.7088184896856546, + 0.6732671316713095, + 2.852516843006015, + 3.285697516053915, + 0.12287742644548416, + 0.37020590156316757, + 2.6478864401578903, + 0.9414743389934301, + 0.8852478228509426, + 1.7408157624304295, + 0.5146044157445431, + 0.7440077569335699, + 1.5058164242655039, + 0.8006183868274093 + ], + "unique_experts": 63, + "load_cv": 0.6397448524577599, + "normalized_load_entropy": 0.9498353922942686, + "max_load_share": 0.039337474120082816 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 120, + "ordered_topk_exact_tokens": 53, + "set_exact_tokens": 66, + "mean_set_jaccard": 0.8625, + "mean_token_weighted_tv": 0.02449358702288009, + "aggregate_load_tv": 0.04861111111111111 + }, + "system_bos": { + "tokens": 120, + "ordered_topk_exact_tokens": 52, + "set_exact_tokens": 70, + "mean_set_jaccard": 0.8648809523809524, + "mean_token_weighted_tv": 0.026743698406304854, + "aggregate_load_tv": 0.037500000000000006 + }, + "system_x": { + "tokens": 120, + "ordered_topk_exact_tokens": 36, + "set_exact_tokens": 51, + "mean_set_jaccard": 0.8232142857142857, + "mean_token_weighted_tv": 0.035080897027122165, + "aggregate_load_tv": 0.05138888888888889 + }, + "system_period": { + "tokens": 120, + "ordered_topk_exact_tokens": 39, + "set_exact_tokens": 50, + "mean_set_jaccard": 0.8065476190476192, + "mean_token_weighted_tv": 0.0355406503212483, + "aggregate_load_tv": 0.06388888888888888 + }, + "bos_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 44, + "set_exact_tokens": 59, + "mean_set_jaccard": 0.8337301587301588, + "mean_token_weighted_tv": 0.03183742598921526, + "aggregate_load_tv": 0.052777777777777785 + }, + "bos_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 43, + "set_exact_tokens": 58, + "mean_set_jaccard": 0.8335317460317462, + "mean_token_weighted_tv": 0.03164125016580025, + "aggregate_load_tv": 0.0513888888888889 + }, + "x_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 45, + "set_exact_tokens": 57, + "mean_set_jaccard": 0.8271825396825397, + "mean_token_weighted_tv": 0.03528795787521328, + "aggregate_load_tv": 0.05 + }, + "x_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 36, + "set_exact_tokens": 46, + "mean_set_jaccard": 0.8009920634920635, + "mean_token_weighted_tv": 0.03912509865573763, + "aggregate_load_tv": 0.05416666666666666 + }, + "period_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 47, + "set_exact_tokens": 60, + "mean_set_jaccard": 0.8365079365079366, + "mean_token_weighted_tv": 0.03377404538332485, + "aggregate_load_tv": 0.051388888888888894 + }, + "period_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 41, + "set_exact_tokens": 49, + "mean_set_jaccard": 0.7982142857142859, + "mean_token_weighted_tv": 0.04024170487731074, + "aggregate_load_tv": 0.05833333333333333 + } + } + }, + "layer_15": { + "layer": 15, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "2ff41f256805059c341a88049db58da6b117aa57633d9a460b3fae4f247a29d8", + "route_weight_sha256": "0e19bb8b4736b35dd5c778e6ff9b00703131d1ea40ffb31d53ef8a1e97b3c7e1", + "loads": [ + 10, + 5, + 0, + 18, + 11, + 4, + 16, + 11, + 10, + 14, + 15, + 4, + 12, + 4, + 10, + 14, + 39, + 10, + 9, + 27, + 8, + 1, + 19, + 8, + 3, + 3, + 17, + 5, + 11, + 14, + 11, + 2, + 15, + 14, + 6, + 7, + 20, + 7, + 19, + 10, + 4, + 15, + 3, + 3, + 28, + 2, + 2, + 7, + 16, + 12, + 25, + 23, + 8, + 6, + 27, + 7, + 10, + 13, + 19, + 16, + 9, + 6, + 4, + 12 + ], + "weighted_loads": [ + 0.4929641466587782, + 0.18078596331179142, + 0.0, + 0.6710964608937502, + 0.6264829859137535, + 0.15844660624861717, + 1.2782737910747528, + 0.45498608238995075, + 0.3346074353903532, + 0.804836418479681, + 1.8209916651248932, + 0.23081889003515244, + 0.46769114024937153, + 0.2950425297021866, + 0.4192698560655117, + 0.973545303568244, + 2.9645003397017717, + 0.3930188324302435, + 0.567196000367403, + 2.857667999342084, + 0.30975402891635895, + 0.07320359349250793, + 1.08748085424304, + 0.2521962318569422, + 0.09159285947680473, + 0.25032611563801765, + 1.2222561463713646, + 0.6256251931190491, + 0.3552248254418373, + 0.5652582235634327, + 0.3819407355040312, + 0.08466553688049316, + 0.8954994603991508, + 0.6230301596224308, + 0.2110348679125309, + 0.6224343329668045, + 0.8470903038978577, + 0.25823676958680153, + 1.0527378413826227, + 0.38829185627400875, + 0.1489871982485056, + 0.630333824083209, + 0.19244521111249924, + 0.21310445293784142, + 1.3073980379849672, + 0.06700682640075684, + 0.2691294774413109, + 0.236858943477273, + 0.9534718580543995, + 0.5730562563985586, + 1.7948187049478292, + 1.799134436994791, + 0.3103821221739054, + 0.3576320856809616, + 1.2448375187814236, + 0.22828912734985352, + 0.4576558992266655, + 1.2238544877618551, + 2.522946447134018, + 1.1195822767913342, + 0.4448377341032028, + 0.31367830745875835, + 0.26294804364442825, + 0.46955726481974125 + ], + "unique_experts": 63, + "load_cv": 0.6723829009069897, + "normalized_load_entropy": 0.9470439032721295, + "max_load_share": 0.05416666666666667 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "b4025a1bf65c1a5855ccc8d3d05c9d6a380b6043389a69e5919699e0cf68df94", + "route_weight_sha256": "bea5212309c6fe842c59f60d950be62db587ced52408f2ce7419a85c721c51dd", + "loads": [ + 13, + 5, + 0, + 18, + 17, + 7, + 22, + 12, + 17, + 15, + 20, + 5, + 17, + 4, + 19, + 15, + 46, + 13, + 9, + 30, + 8, + 1, + 19, + 13, + 8, + 4, + 27, + 5, + 13, + 14, + 15, + 2, + 20, + 16, + 6, + 7, + 25, + 7, + 19, + 11, + 10, + 16, + 3, + 6, + 28, + 2, + 2, + 8, + 17, + 21, + 31, + 25, + 14, + 6, + 29, + 11, + 10, + 13, + 20, + 17, + 9, + 8, + 4, + 16 + ], + "weighted_loads": [ + 0.6441642809659243, + 0.18078596331179142, + 0.0, + 0.6710964608937502, + 1.0018560141324997, + 0.23030989151448011, + 1.7153305634856224, + 0.49230548925697803, + 0.808184863999486, + 0.8363243229687214, + 2.0092464853078127, + 0.2610106039792299, + 0.8637993391603231, + 0.2950425297021866, + 0.7648032233119011, + 1.0037554446607828, + 3.703903490677476, + 0.4968885872513056, + 0.567196000367403, + 2.994241075590253, + 0.30975402891635895, + 0.07320359349250793, + 1.08748085424304, + 0.5221221204847097, + 0.22787520638667047, + 0.2788420785218477, + 1.8988447114825249, + 0.6256251931190491, + 0.4364565722644329, + 0.5652582235634327, + 0.5559629946947098, + 0.08466553688049316, + 1.2988228499889374, + 0.7113225348293781, + 0.2110348679125309, + 0.6224343329668045, + 1.5597207956016064, + 0.25823676958680153, + 1.0527378413826227, + 0.4334528613835573, + 0.4180897264741361, + 0.6345783779397607, + 0.19244521111249924, + 0.3380449563264847, + 1.3073980379849672, + 0.06700682640075684, + 0.2691294774413109, + 0.2713692430406809, + 0.9669651482254267, + 1.5270756762474775, + 2.116277936846018, + 1.879230048507452, + 0.49056374933570623, + 0.3576320856809616, + 1.320798922330141, + 1.8940123245120049, + 0.4576558992266655, + 1.2238544877618551, + 2.57096403837204, + 1.1482193619012833, + 0.4448377341032028, + 0.3902115374803543, + 0.26294804364442825, + 0.6426097042858601 + ], + "unique_experts": 63, + "load_cv": 0.6380998016378868, + "normalized_load_entropy": 0.9504946980123965, + "max_load_share": 0.052873563218390804 + } + }, + "s1_eos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "ad4ff0be1a2049ae02e7fae471b6448c2c5b6480c20c989c643a909d6df22b45", + "route_weight_sha256": "d0d8afd9889892c05cf335d37f38a0297af255588c9659b7a88693b643195ea6", + "loads": [ + 10, + 5, + 0, + 17, + 10, + 5, + 16, + 14, + 8, + 14, + 15, + 4, + 8, + 4, + 9, + 17, + 35, + 10, + 9, + 27, + 6, + 1, + 21, + 10, + 4, + 3, + 18, + 4, + 7, + 15, + 7, + 1, + 15, + 19, + 4, + 10, + 19, + 7, + 22, + 13, + 4, + 17, + 3, + 3, + 27, + 2, + 2, + 7, + 17, + 11, + 25, + 22, + 8, + 6, + 26, + 7, + 9, + 16, + 20, + 15, + 10, + 6, + 4, + 10 + ], + "weighted_loads": [ + 0.4905766732990742, + 0.1703975424170494, + 0.0, + 0.6343071460723877, + 0.5955424308776855, + 0.17669779062271118, + 1.2463445141911507, + 0.5917342305183411, + 0.27062081173062325, + 0.7912600357085466, + 1.7824131473898888, + 0.23581647127866745, + 0.3167957942932844, + 0.2663542181253433, + 0.3849750515073538, + 0.9561111479997635, + 2.794770609587431, + 0.4043727219104767, + 0.5629583410918713, + 2.8562742322683334, + 0.2384932078421116, + 0.07536355406045914, + 1.1276686005294323, + 0.30848605558276176, + 0.13529595360159874, + 0.25611273385584354, + 1.2807382810860872, + 0.586500272154808, + 0.23757361434400082, + 0.6067100204527378, + 0.2678503021597862, + 0.0508548729121685, + 0.8885526191443205, + 0.7783454265445471, + 0.1476706564426422, + 0.7982467301189899, + 0.8085527382791042, + 0.25263153575360775, + 1.4355880692601204, + 0.47503952495753765, + 0.153669947758317, + 0.7111924588680267, + 0.1871022805571556, + 0.21695438399910927, + 1.251910500228405, + 0.06696749292314053, + 0.2486514151096344, + 0.22813817858695984, + 0.9706752169877291, + 0.5670742709189653, + 1.7185847088694572, + 1.8445009030401707, + 0.3137496653944254, + 0.32323259860277176, + 1.219103204086423, + 0.23866579867899418, + 0.4420323148369789, + 1.3318846113979816, + 2.5417988412082195, + 1.0727044381201267, + 0.45328825525939465, + 0.328083872795105, + 0.26452528312802315, + 0.39455607533454895 + ], + "unique_experts": 63, + "load_cv": 0.6736669507210719, + "normalized_load_entropy": 0.94505682948543, + "max_load_share": 0.04861111111111111 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "696ef3f87418437e58fdcc5280a6835064cf66423c0253ef853743867ec70c5a", + "route_weight_sha256": "0c03900dc2cfd8ad34af941d095b978b4a30e55f98356d0f78979aba8c0d11e4", + "loads": [ + 30, + 6, + 0, + 17, + 19, + 10, + 28, + 14, + 19, + 15, + 20, + 8, + 14, + 5, + 15, + 26, + 47, + 14, + 10, + 31, + 7, + 2, + 21, + 15, + 8, + 4, + 28, + 6, + 12, + 16, + 14, + 5, + 20, + 22, + 6, + 10, + 25, + 7, + 23, + 15, + 10, + 19, + 3, + 5, + 27, + 3, + 2, + 9, + 20, + 24, + 33, + 24, + 11, + 7, + 28, + 11, + 9, + 22, + 22, + 19, + 10, + 13, + 6, + 15 + ], + "weighted_loads": [ + 1.7430384010076523, + 0.1962673645466566, + 0.0, + 0.6343071460723877, + 1.1239618547260761, + 0.38119054958224297, + 2.1817019023001194, + 0.5917342305183411, + 0.9083335101604462, + 0.8222853597253561, + 2.012143053114414, + 0.5697775855660439, + 0.8222696892917156, + 0.3463596925139427, + 0.5869683250784874, + 1.621869895607233, + 3.9720187336206436, + 0.5643362440168858, + 0.6141541339457035, + 3.1281647942960262, + 0.2681478913873434, + 0.15950175374746323, + 1.1276686005294323, + 0.5523371621966362, + 0.22829162143170834, + 0.2845659200102091, + 1.9840115029364824, + 0.7107974588871002, + 0.6211924497038126, + 0.6462109573185444, + 0.532532587647438, + 0.4967940077185631, + 1.2773390728980303, + 0.9117845930159092, + 0.2977934442460537, + 0.7982467301189899, + 1.4922417849302292, + 0.25263153575360775, + 1.4678689874708652, + 0.5582119803875685, + 0.39190292288549244, + 0.8043737770058215, + 0.1871022805571556, + 0.4962243586778641, + 1.251910500228405, + 0.10511546395719051, + 0.2486514151096344, + 0.29645100980997086, + 1.1113745905458927, + 2.3385232966393232, + 2.0920150242745876, + 1.913157396018505, + 0.39300438668578863, + 0.45587363094091415, + 1.2978141997009516, + 1.8861107844859362, + 0.4420323148369789, + 1.9917768500745296, + 2.6256759837269783, + 1.2410272397100925, + 0.45328825525939465, + 0.7059084437787533, + 0.3798456974327564, + 0.59355672262609 + ], + "unique_experts": 63, + "load_cv": 0.60774774433813, + "normalized_load_entropy": 0.95438911688798, + "max_load_share": 0.048654244306418216 + } + }, + "s0_bos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "d58c1aa285b042a9ab086f862ff9894f270585fa191f1a44ac7df9d087d627e8", + "route_weight_sha256": "046a099f273c22cdcae8c6e21bbb9f61d0289fc2bb70e203f4953b30fbb48df5", + "loads": [ + 11, + 5, + 2, + 20, + 10, + 3, + 17, + 13, + 10, + 14, + 15, + 5, + 10, + 4, + 10, + 14, + 31, + 8, + 8, + 27, + 7, + 1, + 18, + 9, + 4, + 3, + 18, + 4, + 9, + 13, + 10, + 1, + 15, + 18, + 3, + 8, + 20, + 7, + 13, + 10, + 3, + 12, + 3, + 3, + 29, + 2, + 2, + 8, + 20, + 15, + 24, + 23, + 10, + 6, + 30, + 9, + 10, + 14, + 20, + 15, + 12, + 5, + 4, + 13 + ], + "weighted_loads": [ + 0.5563603080809116, + 0.18083423003554344, + 0.07731408625841141, + 0.7335300464183092, + 0.5902715809643269, + 0.10699666291475296, + 1.357608050107956, + 0.5110460538417101, + 0.35639432445168495, + 0.8026453927159309, + 1.8628333695232868, + 0.25144627690315247, + 0.4104304015636444, + 0.30152153223752975, + 0.4226472731679678, + 0.9717773925513029, + 2.606512699276209, + 0.34141789749264717, + 0.5259337462484837, + 2.9314365461468697, + 0.31140606105327606, + 0.07361359149217606, + 1.0782376490533352, + 0.28232812136411667, + 0.1275527961552143, + 0.24815154634416103, + 1.2877799104899168, + 0.6087249144911766, + 0.29696905985474586, + 0.5421292595565319, + 0.37200650572776794, + 0.04860955476760864, + 0.8691216483712196, + 0.7983912751078606, + 0.13353588245809078, + 0.622110340744257, + 0.851998308673501, + 0.2646529208868742, + 0.9713487178087234, + 0.37999309971928596, + 0.11946916952729225, + 0.484240522608161, + 0.2057645618915558, + 0.21679913997650146, + 1.3438605219125748, + 0.06437702104449272, + 0.27718864381313324, + 0.27545977383852005, + 1.110679417848587, + 0.7414890211075544, + 1.933858124539256, + 1.8339907005429268, + 0.38897895254194736, + 0.3612750880420208, + 1.3164765927940607, + 0.29802992194890976, + 0.48967364244163036, + 1.3114526197314262, + 2.6040962915867567, + 1.067261341959238, + 0.5450967438519001, + 0.26635160855948925, + 0.2744035869836807, + 0.5051969289779663 + ], + "unique_experts": 64, + "load_cv": 0.6582805886043833, + "normalized_load_entropy": 0.9479709849225264, + "max_load_share": 0.043055555555555555 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "8967808d04cc85df3f55f32845067953f4d341c67742da78f712b47ae1fbfd96", + "route_weight_sha256": "fb1d756a522f923e410ae951ec29552ca7c9f43cf2c881101f9cf9a152099f0a", + "loads": [ + 14, + 5, + 2, + 20, + 15, + 5, + 22, + 14, + 16, + 15, + 20, + 6, + 15, + 4, + 18, + 15, + 38, + 11, + 8, + 30, + 7, + 1, + 18, + 14, + 9, + 4, + 28, + 4, + 12, + 13, + 16, + 1, + 20, + 20, + 3, + 9, + 26, + 7, + 13, + 11, + 9, + 12, + 3, + 6, + 29, + 2, + 2, + 9, + 21, + 23, + 31, + 26, + 16, + 7, + 34, + 11, + 10, + 14, + 21, + 16, + 12, + 7, + 4, + 16 + ], + "weighted_loads": [ + 0.7087051421403885, + 0.18083423003554344, + 0.07731408625841141, + 0.7335300464183092, + 0.9195530228316784, + 0.1781828422099352, + 1.6659929640591145, + 0.5483654607087374, + 0.7808082848787308, + 0.8341332972049713, + 2.0510881897062063, + 0.28163799084722996, + 0.7986455075442791, + 0.30152153223752975, + 0.7581274267286062, + 1.0019875336438417, + 3.357361126691103, + 0.44528765231370926, + 0.5259337462484837, + 3.0680096223950386, + 0.31140606105327606, + 0.07361359149217606, + 1.0782376490533352, + 0.5522540099918842, + 0.3212387394160032, + 0.2766675092279911, + 1.964368475601077, + 0.6087249144911766, + 0.4483063295483589, + 0.5421292595565319, + 0.6396368760615587, + 0.04860955476760864, + 1.2724450379610062, + 0.8866836503148079, + 0.13353588245809078, + 0.725041750818491, + 1.640495965257287, + 0.2646529208868742, + 0.9713487178087234, + 0.4208877421915531, + 0.44971562176942825, + 0.484240522608161, + 0.2057645618915558, + 0.33482031896710396, + 1.3438605219125748, + 0.06437702104449272, + 0.27718864381313324, + 0.30997007340192795, + 1.1241727080196142, + 1.6366150099784136, + 2.3125172704458237, + 1.9636228010058403, + 0.5691605797037482, + 0.42062027007341385, + 1.4899344649165869, + 0.9438571706414223, + 0.48967364244163036, + 1.3114526197314262, + 2.6521138828247786, + 1.0958984270691872, + 0.5450967438519001, + 0.3428848385810852, + 0.2744035869836807, + 0.6663651578128338 + ], + "unique_experts": 64, + "load_cv": 0.6339786436443839, + "normalized_load_entropy": 0.9504023341098695, + "max_load_share": 0.04367816091954023 + } + }, + "s1_bos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "62109a583a3c971ffe1b3780d1cf6fc6081195eadfbf3e737aac191aca8d3da8", + "route_weight_sha256": "4f6043339e139abcf7a0cd456d384c6dee5d3a897e7c8a2740b0c2af00d3925d", + "loads": [ + 12, + 7, + 1, + 19, + 9, + 4, + 16, + 11, + 6, + 14, + 15, + 4, + 11, + 4, + 9, + 15, + 33, + 10, + 6, + 28, + 6, + 1, + 19, + 10, + 4, + 4, + 18, + 4, + 9, + 14, + 12, + 1, + 15, + 16, + 3, + 9, + 20, + 8, + 19, + 11, + 3, + 15, + 4, + 3, + 27, + 2, + 2, + 7, + 20, + 14, + 22, + 19, + 12, + 6, + 27, + 6, + 9, + 15, + 20, + 16, + 10, + 5, + 4, + 15 + ], + "weighted_loads": [ + 0.6009590644389391, + 0.24754365347325802, + 0.03964785113930702, + 0.6911600586026907, + 0.5433266516774893, + 0.14714912325143814, + 1.3085145447403193, + 0.4527887646108866, + 0.20365138724446297, + 0.817457927390933, + 1.7927424386143684, + 0.23930395767092705, + 0.4496006667613983, + 0.2752739191055298, + 0.3847421854734421, + 0.9919949285686016, + 2.7472961395978928, + 0.40857802517712116, + 0.4380688928067684, + 2.8477367628365755, + 0.2658131942152977, + 0.07057841867208481, + 1.1036112420260906, + 0.3150254748761654, + 0.15426557324826717, + 0.281554089859128, + 1.3203131426125765, + 0.6164035424590111, + 0.2974533513188362, + 0.5599067714065313, + 0.42800163850188255, + 0.05166028067469597, + 0.8968275915831327, + 0.7299404218792915, + 0.1274180617183447, + 0.7845210433006287, + 0.8651900254189968, + 0.28060964681208134, + 1.3028249442577362, + 0.409070385619998, + 0.11383002065122128, + 0.6336608678102493, + 0.23763170279562473, + 0.220554880797863, + 1.259100079536438, + 0.06324926763772964, + 0.273763507604599, + 0.2404324971139431, + 1.0567911360412836, + 0.7219326887279749, + 1.803705520927906, + 1.775641418993473, + 0.44331688433885574, + 0.3192367423325777, + 1.2567929811775684, + 0.1984200906008482, + 0.4616456627845764, + 1.3409025222063065, + 2.5931105837225914, + 1.083956889808178, + 0.45700711011886597, + 0.28326566331088543, + 0.2699146382510662, + 0.5623009521514177 + ], + "unique_experts": 64, + "load_cv": 0.6499762578759852, + "normalized_load_entropy": 0.948424877207891, + "max_load_share": 0.04583333333333333 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "85fdb4c835603aae382a49137dcaea9adf5adb9acb71c58dff75df83ce649549", + "route_weight_sha256": "43cd3c8485f97acdc4926a8ad7171dcafbc967d688260bb6e3374b8a2dee21c3", + "loads": [ + 33, + 8, + 1, + 19, + 18, + 9, + 28, + 11, + 16, + 15, + 20, + 8, + 17, + 5, + 14, + 24, + 45, + 14, + 7, + 32, + 7, + 2, + 19, + 15, + 9, + 5, + 28, + 6, + 14, + 15, + 20, + 5, + 20, + 19, + 5, + 9, + 27, + 8, + 20, + 13, + 9, + 16, + 4, + 5, + 27, + 3, + 2, + 9, + 23, + 27, + 31, + 21, + 15, + 7, + 29, + 9, + 9, + 21, + 22, + 20, + 10, + 12, + 6, + 19 + ], + "weighted_loads": [ + 1.9075719248503447, + 0.2734134756028652, + 0.03964785113930702, + 0.6911600586026907, + 1.0068157967180014, + 0.39217126928269863, + 2.162628570571542, + 0.4527887646108866, + 0.7972509115934372, + 0.8484832514077425, + 2.022472344338894, + 0.5732650719583035, + 0.9425018522888422, + 0.3552793934941292, + 0.5752292983233929, + 1.6577536761760712, + 3.948185730725527, + 0.5685415472835302, + 0.48926468566060066, + 3.1196273248642683, + 0.2954678777605295, + 0.1547166183590889, + 1.1036112420260906, + 0.5588765814900398, + 0.3434170950204134, + 0.31000727601349354, + 2.0235863644629717, + 0.7407007291913033, + 0.681072186678648, + 0.5994077082723379, + 0.7399274632334709, + 0.49759941548109055, + 1.2856140453368425, + 0.8633795883506536, + 0.27754084952175617, + 0.7845210433006287, + 1.6028890050947666, + 0.28060964681208134, + 1.335105862468481, + 0.48905309848487377, + 0.5109588652849197, + 0.7226577550172806, + 0.23763170279562473, + 0.4998248554766178, + 1.259100079536438, + 0.10139723867177963, + 0.273763507604599, + 0.31262463703751564, + 1.1974905095994473, + 2.543690400198102, + 2.2176574803888798, + 1.8442979119718075, + 0.522571605630219, + 0.4518777746707201, + 1.3252471685409546, + 0.9126677941530943, + 0.4616456627845764, + 2.0007947608828545, + 2.67698772624135, + 1.2522796913981438, + 0.45700711011886597, + 0.6610902342945337, + 0.3852350525557995, + 0.7367656901478767 + ], + "unique_experts": 64, + "load_cv": 0.603671466656769, + "normalized_load_entropy": 0.955637009969141, + "max_load_share": 0.046583850931677016 + } + }, + "s0_x": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "508fd8473c9e96a2ea8873d860eb3514a6dac479145c69d9592351e2a8010539", + "route_weight_sha256": "780006240b714ac65543a30dd2359d11bd3f5d6fe661aa6a09476a35f0cc9525", + "loads": [ + 11, + 5, + 1, + 18, + 10, + 4, + 16, + 12, + 10, + 14, + 15, + 5, + 9, + 4, + 10, + 14, + 34, + 10, + 8, + 27, + 8, + 1, + 19, + 9, + 4, + 3, + 18, + 4, + 8, + 14, + 9, + 2, + 15, + 19, + 3, + 8, + 19, + 6, + 17, + 12, + 2, + 12, + 4, + 3, + 23, + 2, + 2, + 5, + 23, + 15, + 25, + 20, + 11, + 7, + 28, + 7, + 10, + 13, + 21, + 16, + 12, + 6, + 4, + 14 + ], + "weighted_loads": [ + 0.5331439264118671, + 0.18523332476615906, + 0.045533742755651474, + 0.687906788662076, + 0.6055620685219765, + 0.14167450927197933, + 1.4006202835589647, + 0.46619545109570026, + 0.359688276425004, + 0.8266615606844425, + 1.9294139593839645, + 0.25614979676902294, + 0.3307404275983572, + 0.2997419908642769, + 0.40796798281371593, + 1.1072861663997173, + 2.814723463729024, + 0.4205658920109272, + 0.5109954662621021, + 2.985346831381321, + 0.317212363705039, + 0.07512779533863068, + 1.145498814061284, + 0.2930781710892916, + 0.15194769762456417, + 0.2607839982956648, + 1.2839116882532835, + 0.6263907998800278, + 0.27852086909115314, + 0.5621189847588539, + 0.32471245527267456, + 0.08172423765063286, + 0.9022833779454231, + 0.8394734282046556, + 0.13562707602977753, + 0.64933642745018, + 0.7883975449949503, + 0.22638637945055962, + 1.0652874987572432, + 0.4296400472521782, + 0.09022252261638641, + 0.4966385215520859, + 0.24596774205565453, + 0.22665638104081154, + 1.1493958104401827, + 0.06861446425318718, + 0.30071599036455154, + 0.18502133712172508, + 1.2460301760584116, + 0.6272691506892443, + 2.0268894396722317, + 1.6130260229110718, + 0.41713323444128036, + 0.39697424694895744, + 1.2388971876353025, + 0.2457444667816162, + 0.484683021903038, + 1.293033305555582, + 2.711743127554655, + 1.1125546302646399, + 0.5494357049465179, + 0.31734289042651653, + 0.29035916179418564, + 0.5687879901379347 + ], + "unique_experts": 64, + "load_cv": 0.6531972647421809, + "normalized_load_entropy": 0.9484178764378755, + "max_load_share": 0.04722222222222222 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "6c910074cd91613c831f6f497cff6648e140b754312677196dce231d3824f43e", + "route_weight_sha256": "9636f00a59af2a0eecf8b75221668642e92775022f2e572c43665755f60a9951", + "loads": [ + 14, + 5, + 1, + 18, + 16, + 5, + 22, + 13, + 17, + 15, + 21, + 6, + 14, + 4, + 18, + 16, + 41, + 14, + 8, + 31, + 8, + 1, + 19, + 15, + 8, + 4, + 29, + 4, + 10, + 14, + 14, + 2, + 20, + 21, + 3, + 8, + 24, + 6, + 17, + 13, + 7, + 12, + 4, + 6, + 23, + 2, + 2, + 6, + 24, + 23, + 31, + 22, + 18, + 8, + 30, + 10, + 10, + 13, + 22, + 17, + 12, + 9, + 4, + 16 + ], + "weighted_loads": [ + 0.6419268883764744, + 0.18523332476615906, + 0.045533742755651474, + 0.687906788662076, + 0.9900054968893528, + 0.16041349619627, + 1.8591807056218386, + 0.5035148579627275, + 0.857106814160943, + 0.8581494651734829, + 2.1859497372061014, + 0.28634151071310043, + 0.7216364908963442, + 0.2997419908642769, + 0.7434481363743544, + 1.1720715388655663, + 3.577919216826558, + 0.5580862313508987, + 0.5109954662621021, + 3.1728168204426765, + 0.317212363705039, + 0.07512779533863068, + 1.145498814061284, + 0.6587335225194693, + 0.27565906569361687, + 0.28929996117949486, + 2.0766091030091047, + 0.6263907998800278, + 0.35975261591374874, + 0.5621189847588539, + 0.5417790915817022, + 0.08172423765063286, + 1.3056067675352097, + 0.927765803411603, + 0.13562707602977753, + 0.64933642745018, + 1.5150766726583242, + 0.22638637945055962, + 1.0652874987572432, + 0.4690353199839592, + 0.3576776757836342, + 0.4966385215520859, + 0.24596774205565453, + 0.3924931697547436, + 1.1493958104401827, + 0.06861446425318718, + 0.30071599036455154, + 0.21953163668513298, + 1.2595234662294388, + 1.4760601613670588, + 2.326767673715949, + 1.6931216344237328, + 0.6350670950487256, + 0.4318264313042164, + 1.3129942584782839, + 0.9401228614151478, + 0.484683021903038, + 1.293033305555582, + 2.759760718792677, + 1.141191715374589, + 0.5494357049465179, + 0.46134114265441895, + 0.29035916179418564, + 0.6703932080417871 + ], + "unique_experts": 64, + "load_cv": 0.6305014183793816, + "normalized_load_entropy": 0.9507381174953704, + "max_load_share": 0.047126436781609195 + } + }, + "s1_x": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "2307d71a2f4da78bf3ddb36fc375e526c14dc291ea2986f023310f59d96e43e3", + "route_weight_sha256": "de98f5dd7bf85824f48a36706459427673827119a14c7da97cfc4b0a87fcdc05", + "loads": [ + 12, + 4, + 0, + 17, + 9, + 6, + 16, + 12, + 9, + 13, + 15, + 4, + 10, + 4, + 10, + 15, + 38, + 9, + 8, + 29, + 4, + 1, + 21, + 9, + 4, + 3, + 18, + 5, + 10, + 14, + 14, + 2, + 15, + 15, + 4, + 10, + 18, + 5, + 22, + 8, + 3, + 18, + 3, + 3, + 25, + 2, + 2, + 4, + 23, + 16, + 24, + 19, + 8, + 6, + 27, + 7, + 8, + 12, + 20, + 15, + 9, + 6, + 5, + 13 + ], + "weighted_loads": [ + 0.6007391288876534, + 0.14128860086202621, + 0.0, + 0.6297330353409052, + 0.5436263792216778, + 0.22945430129766464, + 1.2950988300144672, + 0.4706358127295971, + 0.309331726282835, + 0.798702247440815, + 1.8297762461006641, + 0.23950998485088348, + 0.39876955561339855, + 0.235312569886446, + 0.4114422835409641, + 0.9789855368435383, + 3.1713216342031956, + 0.36527327448129654, + 0.47723234444856644, + 2.966890014708042, + 0.1763787791132927, + 0.07489537447690964, + 1.1508897859603167, + 0.2896317336708307, + 0.12856795638799667, + 0.2515092007815838, + 1.2937091961503029, + 0.6089017726480961, + 0.3380025699734688, + 0.5541591681540012, + 0.5002902448177338, + 0.0815255418419838, + 0.9670185912400484, + 0.6614348478615284, + 0.15439975075423717, + 0.8184745851904154, + 0.745564853772521, + 0.17860568687319756, + 1.3432946875691414, + 0.2805446907877922, + 0.1258060410618782, + 0.7559804283082485, + 0.20496290922164917, + 0.22818593680858612, + 1.1611858420073986, + 0.062163643538951874, + 0.26914411783218384, + 0.1400875523686409, + 1.1847963854670525, + 0.6342035736888647, + 1.8109794817864895, + 1.6853758692741394, + 0.318905234336853, + 0.319070965051651, + 1.2248625811189413, + 0.25615623965859413, + 0.4218807425349951, + 1.2297390848398209, + 2.6408536415547132, + 1.086192287504673, + 0.43009426072239876, + 0.3150822538882494, + 0.30520787462592125, + 0.47889771312475204 + ], + "unique_experts": 63, + "load_cv": 0.6888888888888889, + "normalized_load_entropy": 0.9436731789842802, + "max_load_share": 0.05277777777777778 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "bc190f283567345dbe9a19bfaeb9a4f03c6f1be21ac5b93d112dd5aa9b91b5ec", + "route_weight_sha256": "f35305224045bb504845641597eb5ff7854d252b8cffe7e158bacbfbcd82908c", + "loads": [ + 33, + 5, + 0, + 17, + 17, + 9, + 28, + 12, + 20, + 14, + 21, + 8, + 16, + 5, + 15, + 26, + 50, + 13, + 9, + 34, + 5, + 2, + 21, + 15, + 8, + 4, + 29, + 7, + 15, + 16, + 20, + 6, + 21, + 18, + 6, + 10, + 24, + 5, + 23, + 10, + 8, + 21, + 3, + 6, + 25, + 3, + 2, + 6, + 26, + 28, + 30, + 22, + 11, + 7, + 28, + 10, + 8, + 18, + 22, + 19, + 9, + 14, + 7, + 16 + ], + "weighted_loads": [ + 1.8626568466424942, + 0.16715842299163342, + 0.0, + 0.6297330353409052, + 0.9387221597135067, + 0.38073200173676014, + 2.243457417935133, + 0.4706358127295971, + 1.0162762179970741, + 0.8297275714576244, + 2.1122039444744587, + 0.5734710991382599, + 0.9093281328678131, + 0.3153180442750454, + 0.6019293963909149, + 1.711631402373314, + 4.3681586645543575, + 0.5252367965877056, + 0.5284281373023987, + 3.2914329394698143, + 0.2060334626585245, + 0.15903357416391373, + 1.1508897859603167, + 0.6083347406238317, + 0.2545410320162773, + 0.2799623869359493, + 2.1215032637119293, + 0.7331989593803883, + 0.7216214053332806, + 0.6198845151811838, + 0.7320777699351311, + 0.5274646766483784, + 1.406729957088828, + 0.7948740143328905, + 0.30452253855764866, + 0.8184745851904154, + 1.3734640795737505, + 0.17860568687319756, + 1.3755756057798862, + 0.3587599918246269, + 0.3766191992908716, + 0.91341432929039, + 0.20496290922164917, + 0.6343360505998135, + 1.1611858420073986, + 0.10031161457300186, + 0.26914411783218384, + 0.21820025891065598, + 1.325495759025216, + 2.295299319550395, + 2.0386539474129677, + 1.7888988070189953, + 0.39815995562821627, + 0.4517119973897934, + 1.2541351690888405, + 0.9325330406427383, + 0.4218807425349951, + 1.8896313235163689, + 2.724730784073472, + 1.2545150890946388, + 0.43009426072239876, + 0.7441990915685892, + 0.4205282889306545, + 0.5938137825578451 + ], + "unique_experts": 63, + "load_cv": 0.6393158848091067, + "normalized_load_entropy": 0.9504779982358004, + "max_load_share": 0.051759834368530024 + } + }, + "s0_period": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "32f9c881dad4560d60cbfbcc6feef066745d440aa4d4ce6b15847512d119a7fc", + "route_weight_sha256": "bd82f65d5e31100abd7968ca3157f1c57714f8a377a5ee26825178049b303c31", + "loads": [ + 11, + 5, + 1, + 19, + 10, + 4, + 17, + 11, + 8, + 14, + 15, + 5, + 8, + 4, + 10, + 15, + 37, + 9, + 8, + 27, + 5, + 1, + 19, + 8, + 4, + 3, + 18, + 4, + 9, + 14, + 8, + 2, + 15, + 16, + 3, + 8, + 19, + 8, + 17, + 10, + 3, + 12, + 3, + 3, + 28, + 2, + 2, + 6, + 23, + 15, + 24, + 20, + 10, + 7, + 29, + 7, + 10, + 13, + 21, + 16, + 12, + 6, + 4, + 15 + ], + "weighted_loads": [ + 0.5493924617767334, + 0.19289546832442284, + 0.0449560284614563, + 0.7012059558182955, + 0.6025832183659077, + 0.1445092298090458, + 1.4619858767837286, + 0.42654290795326233, + 0.2915849816054106, + 0.828985620290041, + 1.9184926897287369, + 0.2520534358918667, + 0.3057106863707304, + 0.3032544068992138, + 0.40510197170078754, + 1.0880828611552715, + 2.9707698691636324, + 0.3915273956954479, + 0.5046675875782967, + 2.9334687553346157, + 0.20511041581630707, + 0.07507627457380295, + 1.1605722978711128, + 0.2653287760913372, + 0.14966877177357674, + 0.25514739751815796, + 1.2882727310061455, + 0.6165861487388611, + 0.3179845530539751, + 0.558845516294241, + 0.2954665385186672, + 0.08258220925927162, + 0.9310703817754984, + 0.7215388659387827, + 0.1355010960251093, + 0.6705373600125313, + 0.8067677672952414, + 0.28546020202338696, + 1.038404744118452, + 0.36584183387458324, + 0.12017874792218208, + 0.5155109968036413, + 0.21168648451566696, + 0.22204333916306496, + 1.3016837872564793, + 0.06623842939734459, + 0.3041335344314575, + 0.20045720040798187, + 1.2494842913001776, + 0.6768173724412918, + 1.9705635514110327, + 1.6081190779805183, + 0.3770151901990175, + 0.39686364494264126, + 1.2781090289354324, + 0.25124585069715977, + 0.4758336562663317, + 1.3097736909985542, + 2.694622928276658, + 1.113332698121667, + 0.5602484811097383, + 0.32262133061885834, + 0.28248896077275276, + 0.5976831167936325 + ], + "unique_experts": 64, + "load_cv": 0.682768510921654, + "normalized_load_entropy": 0.9455177363063794, + "max_load_share": 0.05138888888888889 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "c21d8cdff92536e698bc4b6b852d5386cd8185004491754a07c5e567a845e6fc", + "route_weight_sha256": "0501e47c16c16f0fd7096b2ccb02e67085c3dbb3a5902edd13ee9ba36bd722a6", + "loads": [ + 13, + 5, + 1, + 19, + 16, + 5, + 24, + 12, + 15, + 15, + 20, + 7, + 13, + 4, + 18, + 16, + 44, + 13, + 8, + 30, + 5, + 1, + 19, + 14, + 7, + 4, + 29, + 4, + 11, + 14, + 13, + 2, + 20, + 18, + 3, + 8, + 25, + 8, + 17, + 11, + 9, + 13, + 3, + 5, + 28, + 2, + 2, + 7, + 24, + 23, + 31, + 22, + 16, + 7, + 31, + 10, + 10, + 13, + 23, + 17, + 12, + 9, + 4, + 18 + ], + "weighted_loads": [ + 0.6322768069803715, + 0.19289546832442284, + 0.0449560284614563, + 0.7012059558182955, + 1.017906814813614, + 0.16324821673333645, + 1.9074431117624044, + 0.4638623148202896, + 0.7880232539027929, + 0.8604735247790813, + 2.1067475099116564, + 0.3134760931134224, + 0.6742213983088732, + 0.3032544068992138, + 0.740582125261426, + 1.1182930022478104, + 3.740153545513749, + 0.5332614406943321, + 0.5046675875782967, + 3.0700418315827847, + 0.20511041581630707, + 0.07507627457380295, + 1.1605722978711128, + 0.6298139169812202, + 0.25593986362218857, + 0.28366336040198803, + 2.0064601749181747, + 0.6165861487388611, + 0.3992162998765707, + 0.558845516294241, + 0.5145735684782267, + 0.08258220925927162, + 1.334393771365285, + 0.80983124114573, + 0.1355010960251093, + 0.6705373600125313, + 1.6018239837139845, + 0.28546020202338696, + 1.038404744118452, + 0.40383577160537243, + 0.506186805665493, + 0.5578354764729738, + 0.21168648451566696, + 0.3070886619389057, + 1.3016837872564793, + 0.06623842939734459, + 0.3041335344314575, + 0.23496749997138977, + 1.2629775814712048, + 1.5372699908912182, + 2.2908560149371624, + 1.6882146894931793, + 0.5571968173608184, + 0.39686364494264126, + 1.3515077717602253, + 0.9543526489287615, + 0.4758336562663317, + 1.3097736909985542, + 2.792733894661069, + 1.141969783231616, + 0.5602484811097383, + 0.5411355067044497, + 0.28248896077275276, + 0.7246381863951683 + ], + "unique_experts": 64, + "load_cv": 0.6532902992451812, + "normalized_load_entropy": 0.948258615824872, + "max_load_share": 0.05057471264367816 + } + }, + "s1_period": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "d35318135cb95534319c61b05d2cf4dd71724c3f17aa3de325062f786536e002", + "route_weight_sha256": "674f9a28f00e43a4ca887d498bb2920068ff1ed2a51422aec6cde6393969c45e", + "loads": [ + 13, + 5, + 0, + 17, + 11, + 4, + 18, + 14, + 8, + 14, + 15, + 5, + 9, + 4, + 10, + 16, + 39, + 9, + 8, + 29, + 5, + 1, + 19, + 10, + 4, + 3, + 18, + 5, + 7, + 15, + 13, + 2, + 15, + 15, + 4, + 9, + 17, + 6, + 21, + 7, + 3, + 17, + 3, + 3, + 26, + 1, + 2, + 4, + 24, + 15, + 24, + 18, + 10, + 7, + 27, + 7, + 8, + 13, + 19, + 15, + 8, + 6, + 5, + 11 + ], + "weighted_loads": [ + 0.6267067678272724, + 0.17723890393972397, + 0.0, + 0.6451893206685781, + 0.617490541189909, + 0.16484935954213142, + 1.4419001005589962, + 0.5360838621854782, + 0.2853944916278124, + 0.8386828936636448, + 1.8523355312645435, + 0.26180974394083023, + 0.3521874789148569, + 0.24340976402163506, + 0.39950866997241974, + 1.0789213590323925, + 3.2572790402919054, + 0.3712627086788416, + 0.4856395535171032, + 2.9541401136666536, + 0.21021315827965736, + 0.0722660943865776, + 1.103349355980754, + 0.32467065565288067, + 0.13449596241116524, + 0.2488950751721859, + 1.3086853511631489, + 0.6069151684641838, + 0.24668936431407928, + 0.5751468539237976, + 0.4707185197621584, + 0.08310682885348797, + 1.0017896685749292, + 0.6466143801808357, + 0.15166234597563744, + 0.8172733895480633, + 0.7114687897264957, + 0.20846698246896267, + 1.2895279172807932, + 0.24788657762110233, + 0.12487277016043663, + 0.7451191432774067, + 0.20079396665096283, + 0.2260405495762825, + 1.1837740428745747, + 0.027833905071020126, + 0.267949141561985, + 0.14696689136326313, + 1.2025535013526678, + 0.6147842518985271, + 1.8672687858343124, + 1.6136190760880709, + 0.38159495778381824, + 0.3548365458846092, + 1.2156339548528194, + 0.26105951331555843, + 0.41656265780329704, + 1.2620129399001598, + 2.6286240480840206, + 1.0827299356460571, + 0.4058068562299013, + 0.3269125949591398, + 0.30346305668354034, + 0.40559457801282406 + ], + "unique_experts": 63, + "load_cv": 0.6926421055781644, + "normalized_load_entropy": 0.9431861662488213, + "max_load_share": 0.05416666666666667 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "bd508710f678048afc4d4a749b55811e145a23687004662f427a8f8fa4b3c355", + "route_weight_sha256": "762f3c4f72094a84dceb1343604bb25d7bc3d0a663f86b3412a77cf9edaaf2d9", + "loads": [ + 34, + 6, + 0, + 17, + 20, + 7, + 30, + 14, + 20, + 15, + 20, + 9, + 15, + 5, + 15, + 28, + 51, + 14, + 9, + 33, + 6, + 2, + 19, + 15, + 7, + 4, + 29, + 7, + 12, + 16, + 19, + 6, + 20, + 20, + 6, + 9, + 23, + 6, + 22, + 9, + 8, + 20, + 3, + 6, + 26, + 2, + 2, + 5, + 27, + 26, + 31, + 20, + 13, + 8, + 29, + 10, + 8, + 19, + 22, + 19, + 8, + 14, + 7, + 14 + ], + "weighted_loads": [ + 1.8698577284812927, + 0.20310872606933117, + 0.0, + 0.6451893206685781, + 1.0654554031789303, + 0.3161270599812269, + 2.434724058955908, + 0.5360838621854782, + 0.9952666442841291, + 0.8697082176804543, + 2.082065436989069, + 0.5957708582282066, + 0.8477436378598213, + 0.32341523841023445, + 0.5899957828223705, + 1.8532558493316174, + 4.450685920193791, + 0.5714137200266123, + 0.5368353463709354, + 3.2260306756943464, + 0.23986784182488918, + 0.1564042940735817, + 1.103349355980754, + 0.5685217622667551, + 0.22571774199604988, + 0.27734826132655144, + 2.0626014322042465, + 0.731212355196476, + 0.6303081996738911, + 0.6146477907896042, + 0.7025060448795557, + 0.5290459636598825, + 1.390576122328639, + 0.8370755091309547, + 0.3017851337790489, + 0.8172733895480633, + 1.4308931827545166, + 0.20846698246896267, + 1.321808835491538, + 0.3264761585742235, + 0.4561774153262377, + 0.9096072465181351, + 0.20079396665096283, + 0.5708246491849422, + 1.1837740428745747, + 0.06598187610507011, + 0.267949141561985, + 0.18104332871735096, + 1.3432528749108315, + 2.1900645457208157, + 2.144397597759962, + 1.6822755690664053, + 0.4608496790751815, + 0.4874775782227516, + 1.27824872918427, + 0.9418840985745192, + 0.41656265780329704, + 1.9219051785767078, + 2.7716933079063892, + 1.251052737236023, + 0.4058068562299013, + 0.8793534878641367, + 0.4187834709882736, + 0.5205106474459171 + ], + "unique_experts": 63, + "load_cv": 0.648687648612298, + "normalized_load_entropy": 0.9493900024531183, + "max_load_share": 0.052795031055900624 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 120, + "ordered_topk_exact_tokens": 50, + "set_exact_tokens": 66, + "mean_set_jaccard": 0.8625000000000002, + "mean_token_weighted_tv": 0.026252701661239067, + "aggregate_load_tv": 0.05 + }, + "system_bos": { + "tokens": 120, + "ordered_topk_exact_tokens": 47, + "set_exact_tokens": 63, + "mean_set_jaccard": 0.8450396825396825, + "mean_token_weighted_tv": 0.030847352075700957, + "aggregate_load_tv": 0.049999999999999996 + }, + "system_x": { + "tokens": 120, + "ordered_topk_exact_tokens": 45, + "set_exact_tokens": 55, + "mean_set_jaccard": 0.8160714285714284, + "mean_token_weighted_tv": 0.03901998446478198, + "aggregate_load_tv": 0.05555555555555556 + }, + "system_period": { + "tokens": 120, + "ordered_topk_exact_tokens": 34, + "set_exact_tokens": 50, + "mean_set_jaccard": 0.7930555555555556, + "mean_token_weighted_tv": 0.041069258276062705, + "aggregate_load_tv": 0.048611111111111126 + }, + "bos_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 47, + "set_exact_tokens": 63, + "mean_set_jaccard": 0.8361111111111114, + "mean_token_weighted_tv": 0.03304753254633397, + "aggregate_load_tv": 0.05416666666666667 + }, + "bos_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 39, + "set_exact_tokens": 65, + "mean_set_jaccard": 0.8476190476190476, + "mean_token_weighted_tv": 0.03179065483467033, + "aggregate_load_tv": 0.05416666666666667 + }, + "x_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 37, + "set_exact_tokens": 51, + "mean_set_jaccard": 0.7958333333333335, + "mean_token_weighted_tv": 0.0400648199642698, + "aggregate_load_tv": 0.05277777777777777 + }, + "x_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 32, + "set_exact_tokens": 50, + "mean_set_jaccard": 0.7952380952380953, + "mean_token_weighted_tv": 0.040544696625632544, + "aggregate_load_tv": 0.056944444444444436 + }, + "period_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 40, + "set_exact_tokens": 47, + "mean_set_jaccard": 0.7902777777777779, + "mean_token_weighted_tv": 0.04042991631819556, + "aggregate_load_tv": 0.048611111111111105 + }, + "period_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 30, + "set_exact_tokens": 47, + "mean_set_jaccard": 0.789484126984127, + "mean_token_weighted_tv": 0.04267135245415072, + "aggregate_load_tv": 0.05555555555555555 + } + } + }, + "layer_16": { + "layer": 16, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "5b9fba025e29333c3dda8f8e0fe7d2de0fa9169031364f5e168c61ea2a5dfaaa", + "route_weight_sha256": "d337b58bb42bb3ec22ffbb9619e435002afe2a4b97f9fa9750b13a028c6090d0", + "loads": [ + 23, + 1, + 10, + 21, + 13, + 19, + 8, + 2, + 14, + 6, + 33, + 9, + 13, + 14, + 30, + 19, + 20, + 9, + 27, + 5, + 20, + 13, + 0, + 1, + 15, + 3, + 10, + 18, + 2, + 8, + 9, + 11, + 8, + 10, + 29, + 4, + 17, + 2, + 4, + 7, + 9, + 12, + 10, + 20, + 11, + 8, + 9, + 6, + 5, + 4, + 7, + 6, + 11, + 4, + 15, + 25, + 4, + 8, + 5, + 12, + 11, + 8, + 23, + 0 + ], + "weighted_loads": [ + 1.5676376316696405, + 0.053238894790410995, + 0.5902511440217495, + 0.9720024541020393, + 0.7307365611195564, + 1.003183327615261, + 0.3074587807059288, + 0.07260502502322197, + 0.75080531463027, + 0.24231423065066338, + 2.2562085390090942, + 0.3577967118471861, + 0.5276598818600178, + 0.5394329261034727, + 3.189300201833248, + 3.8005725368857384, + 0.8584021609276533, + 0.5679484754800797, + 1.1431739535182714, + 0.28623564541339874, + 2.0173700656741858, + 0.9619432650506496, + 0.0, + 0.027126330882310867, + 0.739608776755631, + 0.19249634817242622, + 0.548772782087326, + 0.929935660213232, + 0.08000030741095543, + 0.35523952543735504, + 0.38262050598859787, + 0.6134483497589827, + 0.4211268164217472, + 0.3744899984449148, + 1.2408165708184242, + 0.15404083020985126, + 0.9475805386900902, + 0.14191586896777153, + 0.27688949555158615, + 0.3020678535103798, + 0.45361851155757904, + 0.8619177788496017, + 0.47022514417767525, + 1.1839692238718271, + 0.5209123883396387, + 0.6263540331274271, + 0.580273874104023, + 0.3801657147705555, + 0.4831846095621586, + 0.1699100397527218, + 0.5031372336670756, + 0.23946708999574184, + 0.48256664350628853, + 0.33913454413414, + 2.3726864233613014, + 1.4236347619444132, + 0.31505613774061203, + 0.3539612703025341, + 0.20606905221939087, + 0.8825822565704584, + 0.42354028671979904, + 0.29342178627848625, + 1.7132034208625555, + 0.0 + ], + "unique_experts": 62, + "load_cv": 0.6860155129081391, + "normalized_load_entropy": 0.9426328648986408, + "max_load_share": 0.04583333333333333 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "935279d4c67b80598100de4e7c453e5a5a7e38e36abbbbe1198bacbc5fa2f246", + "route_weight_sha256": "f076554dea8cd49263aaed6ac218acba0ad4854ba16bec895c3a186badcd240d", + "loads": [ + 23, + 1, + 10, + 21, + 13, + 27, + 12, + 2, + 14, + 9, + 37, + 9, + 13, + 15, + 30, + 25, + 30, + 12, + 33, + 7, + 31, + 15, + 2, + 1, + 20, + 3, + 16, + 18, + 2, + 8, + 11, + 11, + 9, + 18, + 29, + 4, + 17, + 11, + 4, + 7, + 11, + 21, + 13, + 22, + 14, + 9, + 9, + 7, + 5, + 4, + 7, + 8, + 12, + 15, + 15, + 35, + 4, + 8, + 5, + 12, + 15, + 10, + 23, + 6 + ], + "weighted_loads": [ + 1.5676376316696405, + 0.053238894790410995, + 0.5902511440217495, + 0.9720024541020393, + 0.7307365611195564, + 1.7866776771843433, + 0.49283889308571815, + 0.07260502502322197, + 0.75080531463027, + 1.6366969607770443, + 2.5245083309710026, + 0.3577967118471861, + 0.5276598818600178, + 0.5585065688937902, + 3.189300201833248, + 4.341886822134256, + 1.421599451918155, + 0.7964448500424623, + 1.7495179995894432, + 0.3281503820326179, + 2.976436721161008, + 1.0417430065572262, + 0.12129072472453117, + 0.027126330882310867, + 1.2058792943134904, + 0.19249634817242622, + 0.9278250262141228, + 0.929935660213232, + 0.08000030741095543, + 0.35523952543735504, + 0.4763243831694126, + 0.6134483497589827, + 0.4621869809925556, + 0.7544434741139412, + 1.2408165708184242, + 0.15404083020985126, + 0.9475805386900902, + 0.605149382725358, + 0.27688949555158615, + 0.3020678535103798, + 0.5463591068983078, + 1.7332518063485622, + 0.6007291227579117, + 1.3143170606344938, + 0.7035472635179758, + 0.6990286577492952, + 0.580273874104023, + 0.43181542307138443, + 0.4831846095621586, + 0.1699100397527218, + 0.5031372336670756, + 0.34097818098962307, + 0.5104866567999125, + 1.123495800420642, + 2.3726864233613014, + 2.2178259883075953, + 0.31505613774061203, + 0.3539612703025341, + 0.20606905221939087, + 0.8825822565704584, + 0.6562681458890438, + 0.342911031562835, + 1.7132034208625555, + 0.26112575083971024 + ], + "unique_experts": 64, + "load_cv": 0.6553579088085112, + "normalized_load_entropy": 0.9488938145168434, + "max_load_share": 0.04252873563218391 + } + }, + "s1_eos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "6cec01546c26a72fa8875cacbbabaed0ba1c7a465dcce376b77f2dfd417e9ae1", + "route_weight_sha256": "5e84012a0f176199de8a262e0b50835563170f8983ad2d33f57282cb3e2fda22", + "loads": [ + 23, + 1, + 10, + 19, + 12, + 15, + 9, + 2, + 14, + 5, + 33, + 8, + 15, + 15, + 30, + 19, + 17, + 9, + 26, + 6, + 21, + 13, + 0, + 2, + 15, + 3, + 12, + 21, + 1, + 9, + 7, + 11, + 7, + 11, + 29, + 5, + 16, + 3, + 4, + 5, + 13, + 12, + 11, + 18, + 10, + 8, + 8, + 6, + 5, + 8, + 7, + 3, + 14, + 4, + 16, + 26, + 4, + 8, + 3, + 12, + 11, + 8, + 22, + 0 + ], + "weighted_loads": [ + 1.5260547008365393, + 0.04897012934088707, + 0.6031461916863918, + 0.8945092298090458, + 0.7636936288326979, + 0.8931061122566462, + 0.3544183596968651, + 0.07459433376789093, + 0.743581760674715, + 0.20793204009532928, + 2.194024806842208, + 0.3108502943068743, + 0.6480030808597803, + 0.5948335155844688, + 3.169535495340824, + 3.656346295028925, + 0.6874792147427797, + 0.5545321367681026, + 1.0899770762771368, + 0.31701724603772163, + 2.0431077163666487, + 0.9365781284868717, + 0.0, + 0.07180938683450222, + 0.7255168296396732, + 0.19380685314536095, + 0.5837181117385626, + 1.135839581489563, + 0.0354195274412632, + 0.4052046462893486, + 0.303394565358758, + 0.6072965040802956, + 0.39846381545066833, + 0.40767221711575985, + 1.2858339454978704, + 0.16642592288553715, + 0.9108143728226423, + 0.18045414611697197, + 0.2752194292843342, + 0.2325783520936966, + 0.6340785995125771, + 0.9348408915102482, + 0.485878873616457, + 1.0930660162121058, + 0.45624048821628094, + 0.5931311082094908, + 0.5722030438482761, + 0.37851381301879883, + 0.46493031084537506, + 0.3039198648184538, + 0.48991939797997475, + 0.13807662948966026, + 0.6852986682206392, + 0.3482363186776638, + 2.498828452080488, + 1.408636910840869, + 0.3080291897058487, + 0.3417175877839327, + 0.12540224939584732, + 0.8680331241339445, + 0.4309699758887291, + 0.2987521328032017, + 1.5962288044393063, + 0.0 + ], + "unique_experts": 62, + "load_cv": 0.680776608090684, + "normalized_load_entropy": 0.9429588021895204, + "max_load_share": 0.04583333333333333 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "118415034c8566cdb5c5bc84ce8674e01da2316696b851b57c9be6c75ebb7875", + "route_weight_sha256": "de376cea7f2b5b16808b4922d6443358b5d30e6eca1e6c94c80d66cee718cc30", + "loads": [ + 23, + 4, + 10, + 21, + 12, + 24, + 14, + 3, + 14, + 9, + 40, + 9, + 15, + 18, + 31, + 29, + 28, + 18, + 36, + 8, + 32, + 15, + 3, + 3, + 28, + 3, + 24, + 21, + 1, + 9, + 11, + 11, + 12, + 18, + 30, + 7, + 16, + 12, + 6, + 8, + 16, + 27, + 15, + 22, + 13, + 12, + 9, + 12, + 7, + 12, + 13, + 5, + 14, + 16, + 16, + 36, + 6, + 8, + 3, + 14, + 15, + 9, + 25, + 5 + ], + "weighted_loads": [ + 1.5260547008365393, + 0.17220383137464523, + 0.6031461916863918, + 0.9855060242116451, + 0.7636936288326979, + 1.7663481403142214, + 0.607541311532259, + 0.0998199563473463, + 0.743581760674715, + 1.6083043031394482, + 2.4939862210303545, + 0.3413457050919533, + 0.6480030808597803, + 0.6872721891850233, + 3.221307598054409, + 4.722800869494677, + 1.186036376748234, + 1.2151820808649063, + 1.960067953914404, + 0.35439157229848206, + 2.99459071084857, + 1.025189783424139, + 0.11605549976229668, + 0.14933017455041409, + 1.7732916623353958, + 0.19380685314536095, + 1.897140821442008, + 1.135839581489563, + 0.0354195274412632, + 0.4052046462893486, + 0.45838987454771996, + 0.6072965040802956, + 0.616244126111269, + 0.6878636600449681, + 1.3212011959403753, + 0.2923585344105959, + 0.9108143728226423, + 0.6618150323629379, + 0.39865123480558395, + 0.4069894440472126, + 0.7383771073073149, + 2.801926851272583, + 0.6499217189848423, + 1.3110872339457273, + 0.5957680530846119, + 0.7909068446606398, + 0.602718897163868, + 0.6734971180558205, + 0.5613573119044304, + 0.4988346863538027, + 0.7480147406458855, + 0.2097802348434925, + 0.6852986682206392, + 1.4209113866090775, + 2.498828452080488, + 2.334611801430583, + 0.415760800242424, + 0.3417175877839327, + 0.12540224939584732, + 1.0988053977489471, + 0.6197722516953945, + 0.30061245360411704, + 1.9166569449007511, + 0.2396800620481372 + ], + "unique_experts": 64, + "load_cv": 0.609100441453571, + "normalized_load_entropy": 0.9556840364396553, + "max_load_share": 0.041407867494824016 + } + }, + "s0_bos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "726f42f7047f1a8a2912d3da14613073ca136bfdfbfc445ea27e9df1504e2f3a", + "route_weight_sha256": "ebde1efaf4dc434a1d25b2fc2a1d4910ab038eba06706e160d53ed72de2a7d4d", + "loads": [ + 22, + 1, + 12, + 16, + 17, + 15, + 6, + 2, + 14, + 5, + 32, + 10, + 10, + 13, + 31, + 19, + 21, + 8, + 25, + 6, + 19, + 13, + 0, + 2, + 18, + 3, + 14, + 14, + 1, + 10, + 10, + 10, + 8, + 8, + 24, + 4, + 18, + 4, + 4, + 9, + 13, + 12, + 11, + 20, + 8, + 9, + 8, + 7, + 6, + 8, + 8, + 5, + 11, + 4, + 17, + 24, + 4, + 6, + 4, + 12, + 12, + 6, + 27, + 0 + ], + "weighted_loads": [ + 1.5378126744180918, + 0.058009788393974304, + 0.6870082058012486, + 0.7761169821023941, + 0.9325336627662182, + 0.8866504710167646, + 0.23282499238848686, + 0.06607465445995331, + 0.7474490515887737, + 0.26796935871243477, + 2.2078580111265182, + 0.3992362264543772, + 0.3984608594328165, + 0.5174453053623438, + 3.224431235343218, + 4.073773447424173, + 0.8835441414266825, + 0.5626001469790936, + 1.0403478536754847, + 0.29562750831246376, + 2.024686958640814, + 0.9386589527130127, + 0.0, + 0.07873804867267609, + 0.808072442188859, + 0.1990862488746643, + 0.7221481073647738, + 0.8397645354270935, + 0.031214332208037376, + 0.4136902950704098, + 0.4222558066248894, + 0.6362972874194384, + 0.4731026440858841, + 0.3036553207784891, + 1.203950833529234, + 0.15525320544838905, + 1.0038854219019413, + 0.2077102717012167, + 0.29163535311818123, + 0.39566029235720634, + 0.6059104669839144, + 0.8909030389040709, + 0.5274957753717899, + 1.152929374948144, + 0.37881384417414665, + 0.7504856158047915, + 0.559762654826045, + 0.44298550859093666, + 0.5165926739573479, + 0.33278345316648483, + 0.5682859886437654, + 0.17877747118473053, + 0.49333168007433414, + 0.3460308760404587, + 2.4946864768862724, + 1.4058238696306944, + 0.3164675347507, + 0.26414722949266434, + 0.16878637298941612, + 0.8306305203586817, + 0.4491918068379164, + 0.2158325258642435, + 1.8586845360696316, + 0.0 + ], + "unique_experts": 62, + "load_cv": 0.6631388138389678, + "normalized_load_entropy": 0.9456842309806649, + "max_load_share": 0.044444444444444446 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "8cce9e0e721ac43d47cc5e11b3efa38243246c456c9cb05c96a5165046924641", + "route_weight_sha256": "3763f26b35274afacfdace65fbad8b902f0cd03ad70d3d992e8b958aa9459260", + "loads": [ + 22, + 1, + 12, + 16, + 17, + 24, + 10, + 2, + 14, + 8, + 37, + 11, + 11, + 15, + 31, + 25, + 29, + 11, + 31, + 8, + 30, + 15, + 2, + 2, + 22, + 3, + 20, + 14, + 1, + 10, + 12, + 10, + 9, + 15, + 25, + 4, + 18, + 12, + 4, + 9, + 15, + 22, + 14, + 22, + 11, + 10, + 8, + 8, + 6, + 9, + 9, + 7, + 11, + 15, + 17, + 34, + 4, + 6, + 4, + 12, + 14, + 8, + 27, + 5 + ], + "weighted_loads": [ + 1.5378126744180918, + 0.058009788393974304, + 0.6870082058012486, + 0.7761169821023941, + 0.9325336627662182, + 1.7105200979858637, + 0.41290655359625816, + 0.06607465445995331, + 0.7474490515887737, + 0.72889818623662, + 2.5285582058131695, + 0.4417997021228075, + 0.4742920119315386, + 0.5791579876095057, + 3.224431235343218, + 4.544519819319248, + 1.8161247912794352, + 0.8006935697048903, + 1.6193855218589306, + 0.36714867129921913, + 2.983753614127636, + 1.0184586942195892, + 0.12129072472453117, + 0.07873804867267609, + 1.2400143798440695, + 0.1990862488746643, + 1.1069125346839428, + 0.8397645354270935, + 0.031214332208037376, + 0.4136902950704098, + 0.5159596838057041, + 0.6362972874194384, + 0.5141628086566925, + 0.6713376063853502, + 1.3244600780308247, + 0.15525320544838905, + 1.0038854219019413, + 0.645694250240922, + 0.29163535311818123, + 0.39566029235720634, + 0.6986510623246431, + 1.7489537168294191, + 0.6677184961736202, + 1.2894843835383654, + 0.529690895229578, + 0.8231602404266596, + 0.559762654826045, + 0.48386789858341217, + 0.5165926739573479, + 0.3767188563942909, + 0.6149121392518282, + 0.28028856217861176, + 0.49333168007433414, + 1.1303921323269606, + 2.4946864768862724, + 2.2000150959938765, + 0.3164675347507, + 0.26414722949266434, + 0.16878637298941612, + 0.8306305203586817, + 0.5737619865685701, + 0.31081645004451275, + 1.8586845360696316, + 0.24679681472480297 + ], + "unique_experts": 64, + "load_cv": 0.6355771005626915, + "normalized_load_entropy": 0.9514072866197908, + "max_load_share": 0.04252873563218391 + } + }, + "s1_bos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "465935d16a5879e3d3ee9b8cf951b60ee24feb92ea81c6c8b75bdad1fefe14e9", + "route_weight_sha256": "bb90226b81a8e1af5b8ed5240c88fba1ad104124e79385556c5817a049bae4fc", + "loads": [ + 24, + 1, + 11, + 13, + 14, + 17, + 7, + 2, + 14, + 6, + 34, + 10, + 14, + 14, + 31, + 19, + 19, + 8, + 22, + 6, + 19, + 13, + 0, + 2, + 16, + 3, + 14, + 15, + 1, + 11, + 8, + 11, + 7, + 10, + 28, + 2, + 16, + 4, + 3, + 3, + 12, + 14, + 8, + 18, + 11, + 7, + 8, + 6, + 7, + 8, + 8, + 6, + 13, + 4, + 17, + 27, + 4, + 8, + 4, + 12, + 13, + 7, + 26, + 0 + ], + "weighted_loads": [ + 1.6536920052021742, + 0.05728195607662201, + 0.6608780547976494, + 0.6323707401752472, + 0.8716901149600744, + 0.9400244802236557, + 0.27143533900380135, + 0.07105225324630737, + 0.7363267708569765, + 0.3115180879831314, + 2.2581704556941986, + 0.38788577541708946, + 0.6214354708790779, + 0.5401599910110235, + 3.2227542251348495, + 3.898951880633831, + 0.8140800688415766, + 0.5047276206314564, + 0.9635105207562447, + 0.29753493517637253, + 1.9853446148335934, + 0.9480578191578388, + 0.0, + 0.08142244070768356, + 0.7745855990797281, + 0.20244987308979034, + 0.7030108086764812, + 0.9331799782812595, + 0.02939268946647644, + 0.4554784335196018, + 0.3394999224692583, + 0.6327208243310452, + 0.35945698246359825, + 0.3542256895452738, + 1.284525891765952, + 0.07826629281044006, + 0.8915260583162308, + 0.221120560541749, + 0.2416407261043787, + 0.13881685212254524, + 0.5554802808910608, + 0.9359921421855688, + 0.3946717120707035, + 1.0896359775215387, + 0.5131454356014729, + 0.6790024023503065, + 0.5721950232982635, + 0.3869229517877102, + 0.5623089633882046, + 0.3200453780591488, + 0.5571106448769569, + 0.2328171730041504, + 0.613959014415741, + 0.36354440823197365, + 2.5578412003815174, + 1.495788924396038, + 0.31412558257579803, + 0.3557605743408203, + 0.1597517654299736, + 0.8659929502755404, + 0.4856782555580139, + 0.263150354847312, + 1.832149464637041, + 0.0 + ], + "unique_experts": 62, + "load_cv": 0.680776608090684, + "normalized_load_entropy": 0.9430491546069137, + "max_load_share": 0.04722222222222222 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "f152d1c6428742afdd5242c0e6928a9756ab8782034d8d986426de761df47135", + "route_weight_sha256": "3a5c06ff92bc10bf9a8e98ee2a75e2dfc12f9db11d491015e70f0e68768da718", + "loads": [ + 24, + 4, + 11, + 15, + 14, + 25, + 12, + 3, + 14, + 10, + 42, + 11, + 14, + 17, + 32, + 29, + 29, + 17, + 32, + 6, + 30, + 15, + 3, + 3, + 27, + 3, + 26, + 15, + 1, + 11, + 12, + 11, + 12, + 19, + 30, + 4, + 16, + 14, + 5, + 6, + 15, + 30, + 11, + 21, + 17, + 11, + 9, + 12, + 9, + 12, + 14, + 8, + 13, + 16, + 17, + 37, + 6, + 8, + 4, + 13, + 18, + 7, + 29, + 5 + ], + "weighted_loads": [ + 1.6536920052021742, + 0.18051565811038017, + 0.6608780547976494, + 0.7233675345778465, + 0.8716901149600744, + 1.7675739899277687, + 0.5188416764140129, + 0.09627787582576275, + 0.7363267708569765, + 0.8089323192834854, + 2.6096102632582188, + 0.41838118620216846, + 0.6214354708790779, + 0.632598664611578, + 3.2745263278484344, + 4.9340935833752155, + 1.7311826329678297, + 1.1701009273529053, + 1.8523358758538961, + 0.29753493517637253, + 2.9368276093155146, + 1.0366694740951061, + 0.11605549976229668, + 0.15894322842359543, + 1.7473187167197466, + 0.20244987308979034, + 2.022018138319254, + 0.9331799782812595, + 0.02939268946647644, + 0.4554784335196018, + 0.4944952316582203, + 0.6327208243310452, + 0.5772372931241989, + 0.756763843819499, + 1.3647626545280218, + 0.2041989043354988, + 0.8915260583162308, + 0.7422272320836782, + 0.36507253162562847, + 0.31322794407606125, + 0.6597787886857986, + 2.795307656750083, + 0.5319517441093922, + 1.2788943406194448, + 0.7458282206207514, + 0.8767781388014555, + 0.6027108766138554, + 0.6819062568247318, + 0.6587359644472599, + 0.5149601995944977, + 0.8218975588679314, + 0.30452077835798264, + 0.613959014415741, + 1.4362194761633873, + 2.5578412003815174, + 2.421763814985752, + 0.42185719311237335, + 0.3557605743408203, + 0.1597517654299736, + 1.0735206622630358, + 0.7273719105869532, + 0.263150354847312, + 2.152577605098486, + 0.279148580506444 + ], + "unique_experts": 64, + "load_cv": 0.6180427665768252, + "normalized_load_entropy": 0.9546766805396305, + "max_load_share": 0.043478260869565216 + } + }, + "s0_x": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "2feb5de75eff8cb41f56428bbe27ede5d1897a03f1afdf5152446204cc30ab97", + "route_weight_sha256": "c98b76eddb136ab0b2a4002689e3c76251976e0bd88defb7d6ddbf0bb5ed3b42", + "loads": [ + 24, + 1, + 11, + 15, + 14, + 15, + 6, + 2, + 14, + 7, + 33, + 9, + 13, + 13, + 31, + 19, + 19, + 8, + 24, + 6, + 19, + 13, + 0, + 2, + 16, + 3, + 12, + 16, + 2, + 10, + 8, + 10, + 9, + 11, + 25, + 4, + 18, + 5, + 4, + 5, + 15, + 12, + 12, + 18, + 8, + 9, + 7, + 6, + 6, + 6, + 10, + 6, + 12, + 4, + 18, + 24, + 4, + 6, + 4, + 12, + 12, + 5, + 28, + 0 + ], + "weighted_loads": [ + 1.6358979679644108, + 0.05374499782919884, + 0.6044155620038509, + 0.7424756959080696, + 0.8662445098161697, + 0.8692344725131989, + 0.24676546454429626, + 0.07565166801214218, + 0.7484711837023497, + 0.3305685631930828, + 2.2960211783647537, + 0.362616702914238, + 0.5334395002573729, + 0.4998829234391451, + 3.268050916492939, + 4.203246023505926, + 0.784134354442358, + 0.5677403062582016, + 1.017945360392332, + 0.31127119064331055, + 2.1522155851125717, + 0.9387401379644871, + 0.0, + 0.07826096192002296, + 0.8040465014055371, + 0.18066084757447243, + 0.6645394321531057, + 0.9340590666979551, + 0.07190640456974506, + 0.41703339479863644, + 0.34465714544057846, + 0.5945358667522669, + 0.4917754717171192, + 0.4067356064915657, + 1.1696964986622334, + 0.15958450362086296, + 0.984858326613903, + 0.25282291881740093, + 0.2978425547480583, + 0.20961418375372887, + 0.6423665322363377, + 0.8746322840452194, + 0.5493221189826727, + 1.1301025487482548, + 0.3674907796084881, + 0.8152151275426149, + 0.5467242877930403, + 0.4001423716545105, + 0.5390487499535084, + 0.2605186142027378, + 0.6545145586133003, + 0.22737104259431362, + 0.5268511176109314, + 0.34714144095778465, + 2.5599557235836983, + 1.4599574599415064, + 0.31823720037937164, + 0.2622650135308504, + 0.17871101200580597, + 0.8741152454167604, + 0.4419149048626423, + 0.18127643689513206, + 1.9463223721832037, + 0.0 + ], + "unique_experts": 62, + "load_cv": 0.6662961933584423, + "normalized_load_entropy": 0.9459034020367814, + "max_load_share": 0.04583333333333333 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "cca4289acbf4295156a2cfa419c0ff47aa9c8f46dd001b6470511b9aed2c2864", + "route_weight_sha256": "57256317da56c84152c2fd12cf124295bbff3fb1239e7fee35a21a1b79dc040f", + "loads": [ + 24, + 1, + 11, + 15, + 14, + 24, + 10, + 2, + 14, + 8, + 38, + 9, + 13, + 14, + 31, + 25, + 26, + 13, + 30, + 7, + 32, + 16, + 2, + 2, + 22, + 3, + 17, + 16, + 2, + 10, + 11, + 10, + 11, + 15, + 25, + 4, + 18, + 14, + 4, + 5, + 17, + 21, + 15, + 20, + 11, + 10, + 7, + 7, + 6, + 6, + 11, + 8, + 13, + 16, + 18, + 35, + 4, + 6, + 4, + 12, + 15, + 6, + 28, + 6 + ], + "weighted_loads": [ + 1.6358979679644108, + 0.05374499782919884, + 0.6044155620038509, + 0.7424756959080696, + 0.8662445098161697, + 1.6789566855877638, + 0.43134651333093643, + 0.07565166801214218, + 0.7484711837023497, + 0.7087047509849072, + 2.604571860283613, + 0.362616702914238, + 0.5334395002573729, + 0.5189565662294626, + 3.268050916492939, + 4.771502796560526, + 1.1209655813872814, + 0.8685452323406935, + 1.6895993631333113, + 0.35073327645659447, + 3.4010146260261536, + 1.0522816590964794, + 0.12129072472453117, + 0.07826096192002296, + 1.3727038400247693, + 0.18066084757447243, + 1.0106607545167208, + 0.9340590666979551, + 0.07190640456974506, + 0.41703339479863644, + 0.4845593757927418, + 0.5945358667522669, + 0.6067187525331974, + 0.6403841935098171, + 1.1696964986622334, + 0.15958450362086296, + 0.984858326613903, + 0.7242717538028955, + 0.2978425547480583, + 0.20961418375372887, + 0.7351071275770664, + 1.6826984733343124, + 0.6827711295336485, + 1.2922561503946781, + 0.5296988412737846, + 0.8878897521644831, + 0.5467242877930403, + 0.44747720658779144, + 0.5390487499535084, + 0.2605186142027378, + 0.6903547421097755, + 0.32888213358819485, + 0.5557519420981407, + 1.2623563054949045, + 2.5599557235836983, + 2.366561906412244, + 0.31823720037937164, + 0.2622650135308504, + 0.17871101200580597, + 0.8741152454167604, + 0.6359474137425423, + 0.22893080115318298, + 1.9463223721832037, + 0.30489701591432095 + ], + "unique_experts": 64, + "load_cv": 0.6436412140463644, + "normalized_load_entropy": 0.9504283782969667, + "max_load_share": 0.04367816091954023 + } + }, + "s1_x": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "a0e5e3c8409644d8681a72d4ff3641b5f16b777d78e537ebf84452778029aeb6", + "route_weight_sha256": "3a19847482683e5cd32df339bd8fb07ef1ef8a9467843bef7a08cdaaa97276a3", + "loads": [ + 25, + 1, + 11, + 17, + 15, + 15, + 7, + 2, + 13, + 6, + 34, + 8, + 12, + 9, + 31, + 19, + 21, + 9, + 22, + 7, + 20, + 14, + 1, + 2, + 19, + 3, + 13, + 18, + 1, + 7, + 7, + 10, + 8, + 11, + 30, + 3, + 16, + 4, + 2, + 5, + 12, + 14, + 8, + 15, + 12, + 8, + 9, + 4, + 8, + 7, + 7, + 6, + 13, + 4, + 17, + 25, + 4, + 4, + 5, + 12, + 13, + 7, + 28, + 0 + ], + "weighted_loads": [ + 1.6369457356631756, + 0.05361403524875641, + 0.6026391945779324, + 0.8269100766628981, + 0.8915338609367609, + 0.8702008854597807, + 0.27630411460995674, + 0.0729810893535614, + 0.6963177509605885, + 0.2585717812180519, + 2.2902893777936697, + 0.35191576182842255, + 0.5176382586359978, + 0.4006496872752905, + 3.355448141694069, + 3.7390988431870937, + 0.8124873284250498, + 0.5267107803374529, + 0.9569250606000423, + 0.33693598955869675, + 2.0945936366915703, + 0.9673016807064414, + 0.03514968231320381, + 0.07915413752198219, + 0.9314722679555416, + 0.1865948922932148, + 0.6775258835405111, + 1.0666920021176338, + 0.02944229543209076, + 0.3325826935470104, + 0.28149775229394436, + 0.5879782401025295, + 0.36816033348441124, + 0.4261411502957344, + 1.3599684312939644, + 0.09161563031375408, + 0.8709108978509903, + 0.2045357394963503, + 0.1978170908987522, + 0.2164115272462368, + 0.5579563323408365, + 0.8583066519349813, + 0.36374909803271294, + 0.9499024786055088, + 0.520187733694911, + 0.695638082921505, + 0.5866571012884378, + 0.32020560279488564, + 0.6121225543320179, + 0.28868404030799866, + 0.5249964650720358, + 0.24064456671476364, + 0.6059780139476061, + 0.37329625710844994, + 2.562382198870182, + 1.4793489128351212, + 0.30247562751173973, + 0.1784286592155695, + 0.22587282210588455, + 0.9227336309850216, + 0.48247277922928333, + 0.2512834966182709, + 1.8699654377996922, + 0.0 + ], + "unique_experts": 63, + "load_cv": 0.6990293093344814, + "normalized_load_entropy": 0.9417119809477648, + "max_load_share": 0.04722222222222222 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "a40aab7202cee37bda5bf2418b44a09dfba176ba9e105e2e7fecb5a4b3adb48e", + "route_weight_sha256": "d9b95fe98e3c927b881af2d73fdddf4aa58096cfc1778dbd09e565af712e7ab9", + "loads": [ + 25, + 4, + 11, + 19, + 15, + 25, + 12, + 3, + 13, + 8, + 43, + 9, + 12, + 13, + 32, + 29, + 28, + 18, + 32, + 7, + 33, + 17, + 6, + 3, + 33, + 3, + 25, + 18, + 1, + 7, + 11, + 10, + 14, + 16, + 31, + 5, + 16, + 13, + 4, + 8, + 15, + 29, + 11, + 18, + 15, + 12, + 10, + 10, + 11, + 11, + 13, + 8, + 13, + 17, + 17, + 36, + 6, + 5, + 5, + 14, + 16, + 7, + 31, + 4 + ], + "weighted_loads": [ + 1.6369457356631756, + 0.17684773728251457, + 0.6026391945779324, + 0.9179068710654974, + 0.8915338609367609, + 1.7744971886277199, + 0.5373980551958084, + 0.09820671193301678, + 0.6963177509605885, + 0.6733633540570736, + 2.6718169525265694, + 0.38241117261350155, + 0.5176382586359978, + 0.5268550962209702, + 3.407220244407654, + 4.813001271337271, + 1.0736789982765913, + 1.1901571322232485, + 1.8287799190729856, + 0.33693598955869675, + 3.386057471856475, + 1.0924560828134418, + 0.2072731088846922, + 0.15667492523789406, + 2.1342902183532715, + 0.1865948922932148, + 1.9663270097225904, + 1.0666920021176338, + 0.02944229543209076, + 0.3325826935470104, + 0.43649306148290634, + 0.5879782401025295, + 0.6498100161552429, + 0.6445113513618708, + 1.3953356817364693, + 0.21754824183881283, + 0.8709108978509903, + 0.6858966257423162, + 0.321248896420002, + 0.3908226191997528, + 0.6622548401355743, + 2.5926516260951757, + 0.4947196952998638, + 1.1635751128196716, + 0.6497566364705563, + 0.893413819372654, + 0.6171729546040297, + 0.6151889078319073, + 0.739147499203682, + 0.48359886184334755, + 0.7752061206847429, + 0.3123481720685959, + 0.6059780139476061, + 1.5414138063788414, + 2.562382198870182, + 2.540835440158844, + 0.41020723804831505, + 0.24082610197365284, + 0.22587282210588455, + 1.1500554457306862, + 0.6109173353761435, + 0.2512834966182709, + 2.190393578261137, + 0.2359773200005293 + ], + "unique_experts": 64, + "load_cv": 0.6368437135018201, + "normalized_load_entropy": 0.9528417260719386, + "max_load_share": 0.044513457556935816 + } + }, + "s0_period": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "7e87e97d6292d68e2142b61031407ac1fee0cc3151d61dae23b18b6eedc73afc", + "route_weight_sha256": "21107da8175882a364ae6b422b05a0792a6a41e29a4ed82bbbc9bf0cd9a0281a", + "loads": [ + 25, + 1, + 13, + 15, + 15, + 14, + 6, + 2, + 14, + 7, + 32, + 10, + 9, + 12, + 31, + 19, + 20, + 9, + 26, + 6, + 19, + 13, + 0, + 1, + 18, + 3, + 10, + 13, + 2, + 9, + 8, + 10, + 9, + 10, + 24, + 4, + 17, + 5, + 4, + 6, + 11, + 12, + 10, + 20, + 9, + 9, + 7, + 6, + 7, + 7, + 10, + 4, + 12, + 4, + 19, + 26, + 4, + 8, + 5, + 11, + 11, + 9, + 28, + 0 + ], + "weighted_loads": [ + 1.6515150647610426, + 0.05312872305512428, + 0.6849721558392048, + 0.7397598177194595, + 0.8936638794839382, + 0.8302559219300747, + 0.2407625988125801, + 0.07153657451272011, + 0.7559647224843502, + 0.31109941005706787, + 2.260125854983926, + 0.41979755461215973, + 0.3768894299864769, + 0.48514724150300026, + 3.285544391721487, + 4.111841842532158, + 0.8139877747744322, + 0.5682023577392101, + 1.0884483363479376, + 0.3140176013112068, + 2.1296681091189384, + 0.9466653540730476, + 0.0, + 0.02883159928023815, + 0.8728202972561121, + 0.18606125563383102, + 0.6017305478453636, + 0.8069495819509029, + 0.07312973029911518, + 0.39172480814158916, + 0.3325858134776354, + 0.6155335567891598, + 0.4961773604154587, + 0.37491208873689175, + 1.0961941257119179, + 0.15286782942712307, + 0.9507185220718384, + 0.2462722845375538, + 0.2860915008932352, + 0.25301409140229225, + 0.5044785123318434, + 0.8649534936994314, + 0.48354915902018547, + 1.2104808241128922, + 0.42120775021612644, + 0.7784155029803514, + 0.5547545608133078, + 0.40252023190259933, + 0.5809409767389297, + 0.30275869742035866, + 0.6560148233547807, + 0.15399547666311264, + 0.49812357127666473, + 0.3463726304471493, + 2.641314236447215, + 1.5031489711254835, + 0.31349221989512444, + 0.33467704989016056, + 0.22936125099658966, + 0.8124046735465527, + 0.4061609823256731, + 0.303657665848732, + 1.9133240897208452, + 0.0 + ], + "unique_experts": 62, + "load_cv": 0.6709124061978012, + "normalized_load_entropy": 0.9455660787544728, + "max_load_share": 0.044444444444444446 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "0d4f68487be93b5f7a206a5cd0c4c02ec282d1aaa775e80bb532a08ab666eb06", + "route_weight_sha256": "0cb4ea869f801e91945f3d17789f2d64861ad6db17c1f67728a3ab1b7f0d7337", + "loads": [ + 25, + 1, + 13, + 15, + 15, + 24, + 10, + 2, + 14, + 8, + 38, + 11, + 9, + 14, + 31, + 25, + 27, + 14, + 32, + 7, + 32, + 15, + 3, + 1, + 24, + 3, + 15, + 13, + 2, + 9, + 11, + 10, + 10, + 15, + 24, + 4, + 17, + 13, + 4, + 6, + 13, + 21, + 12, + 22, + 13, + 10, + 7, + 7, + 7, + 7, + 10, + 6, + 13, + 15, + 19, + 37, + 4, + 8, + 5, + 11, + 14, + 10, + 28, + 5 + ], + "weighted_loads": [ + 1.6515150647610426, + 0.05312872305512428, + 0.6849721558392048, + 0.7397598177194595, + 0.8936638794839382, + 1.694322545081377, + 0.42774832621216774, + 0.07153657451272011, + 0.7559647224843502, + 0.6892355978488922, + 2.622632449492812, + 0.4466879069805145, + 0.3768894299864769, + 0.5481524355709553, + 3.285544391721487, + 4.66847737133503, + 1.2065968457609415, + 0.975684056058526, + 1.712816309183836, + 0.35347968712449074, + 3.2087989933788776, + 1.0264650955796242, + 0.1627531610429287, + 0.02883159928023815, + 1.4738602470606565, + 0.18606125563383102, + 0.9538055248558521, + 0.8069495819509029, + 0.07312973029911518, + 0.39172480814158916, + 0.49093384854495525, + 0.6155335567891598, + 0.5372375249862671, + 0.6478325147181749, + 1.0961941257119179, + 0.15286782942712307, + 0.9507185220718384, + 0.6842562630772591, + 0.2860915008932352, + 0.25301409140229225, + 0.5972191076725721, + 1.7110994402319193, + 0.5840872973203659, + 1.373806044459343, + 0.621276481077075, + 0.8510901276022196, + 0.5547545608133078, + 0.44111737981438637, + 0.5809409767389297, + 0.30275869742035866, + 0.6560148233547807, + 0.25550656765699387, + 0.5297869816422462, + 1.1307338867336512, + 2.641314236447215, + 2.3614006619900465, + 0.31349221989512444, + 0.33467704989016056, + 0.22936125099658966, + 0.8124046735465527, + 0.5923345182090998, + 0.3513120301067829, + 1.9133240897208452, + 0.25967890955507755 + ], + "unique_experts": 64, + "load_cv": 0.6534197165182069, + "normalized_load_entropy": 0.9499651400739038, + "max_load_share": 0.04367816091954023 + } + }, + "s1_period": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "9f7b4afccd72b8e659d7ea6ce784fb8c4d22891ac01353a3b39481bfd06f71bc", + "route_weight_sha256": "370415ff96c8555199ac66b6ff4025335966b5b247d3b27c1a0413cbd113664d", + "loads": [ + 26, + 1, + 11, + 15, + 15, + 16, + 7, + 2, + 13, + 8, + 33, + 7, + 13, + 11, + 31, + 19, + 18, + 10, + 25, + 8, + 20, + 13, + 0, + 2, + 18, + 3, + 11, + 18, + 1, + 7, + 6, + 10, + 7, + 10, + 26, + 3, + 16, + 4, + 3, + 5, + 13, + 14, + 8, + 15, + 12, + 8, + 9, + 5, + 7, + 8, + 9, + 6, + 12, + 4, + 19, + 27, + 4, + 5, + 4, + 12, + 12, + 5, + 29, + 1 + ], + "weighted_loads": [ + 1.6997356209903955, + 0.05333715304732323, + 0.6192389167845249, + 0.7222695760428905, + 0.9136905409395695, + 0.9184444639831781, + 0.2837887778878212, + 0.07306147739291191, + 0.7038799431174994, + 0.34078747406601906, + 2.2982484363019466, + 0.30739591270685196, + 0.5541294831782579, + 0.4597912784665823, + 3.3421392627060413, + 3.9143569320440292, + 0.7085277996957302, + 0.5386472772806883, + 1.0621013790369034, + 0.3718092516064644, + 2.0953032188117504, + 0.9544682651758194, + 0.0, + 0.07850524224340916, + 0.8847638461738825, + 0.1926048956811428, + 0.6138813830912113, + 1.061593959107995, + 0.029490962624549866, + 0.3317481391131878, + 0.25689690187573433, + 0.5926173720508814, + 0.3464280441403389, + 0.38372486643493176, + 1.1858276072889566, + 0.09196849167346954, + 0.8597967810928822, + 0.20642448775470257, + 0.2351660318672657, + 0.2205413170158863, + 0.5746248867362738, + 0.9058465287089348, + 0.35639055259525776, + 0.9804259706288576, + 0.5373773220926523, + 0.682138504460454, + 0.554824510589242, + 0.3400093615055084, + 0.5753388069570065, + 0.3253539800643921, + 0.5722391828894615, + 0.23399741761386395, + 0.5392594411969185, + 0.3645658381283283, + 2.642601627856493, + 1.5204963367432356, + 0.3052889034152031, + 0.22238079831004143, + 0.1887666955590248, + 0.921420831233263, + 0.44542386196553707, + 0.20005802065134048, + 1.9528148733079433, + 0.027732234448194504 + ], + "unique_experts": 63, + "load_cv": 0.6929984946450078, + "normalized_load_entropy": 0.9427774663758275, + "max_load_share": 0.04583333333333333 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "b7e91109ef2fba398d2b4b551f8fd16ef37cd48e449ffd6b47472602aac8d089", + "route_weight_sha256": "f03a7c01fae7dda2a5f5fe4103856bb0181b3271f912caf9c6931cd306164efa", + "loads": [ + 26, + 4, + 11, + 17, + 15, + 26, + 12, + 3, + 13, + 10, + 42, + 8, + 13, + 15, + 32, + 29, + 24, + 20, + 35, + 8, + 33, + 15, + 4, + 3, + 33, + 3, + 22, + 18, + 1, + 7, + 11, + 10, + 13, + 15, + 27, + 5, + 16, + 13, + 6, + 8, + 16, + 28, + 11, + 19, + 15, + 12, + 10, + 11, + 10, + 12, + 15, + 8, + 12, + 17, + 20, + 38, + 6, + 5, + 4, + 14, + 15, + 5, + 32, + 5 + ], + "weighted_loads": [ + 1.6997356209903955, + 0.1765708550810814, + 0.6192389167845249, + 0.8132663704454899, + 0.9136905409395695, + 1.8327449094504118, + 0.5384084358811378, + 0.09828709997236729, + 0.7038799431174994, + 0.7555790469050407, + 2.6848237738013268, + 0.33789132349193096, + 0.5541294831782579, + 0.5867811404168606, + 3.3939113654196262, + 4.921098560094833, + 0.9271881058812141, + 1.2768764402717352, + 1.9741939697414637, + 0.3718092516064644, + 3.1551264096051455, + 1.0430799201130867, + 0.1396521646529436, + 0.15602602995932102, + 2.14322223700583, + 0.1926048956811428, + 1.871717058122158, + 1.061593959107995, + 0.029490962624549866, + 0.3317481391131878, + 0.4739959482103586, + 0.5926173720508814, + 0.597303070127964, + 0.6035465896129608, + 1.2211948577314615, + 0.2179011031985283, + 0.8597967810928822, + 0.6877853740006685, + 0.4111253023147583, + 0.3949524089694023, + 0.6789233945310116, + 2.5662206411361694, + 0.48868718184530735, + 1.240267114713788, + 0.669083409011364, + 0.879914240911603, + 0.5853403639048338, + 0.6349926665425301, + 0.7135238870978355, + 0.520268801599741, + 0.8164159115403891, + 0.3057010229676962, + 0.5392594411969185, + 1.4930083900690079, + 2.6797971166670322, + 2.492384472861886, + 0.4130205139517784, + 0.22238079831004143, + 0.1887666955590248, + 1.1589267775416374, + 0.6148141901940107, + 0.20005802065134048, + 2.273243013769388, + 0.25965274684131145 + ], + "unique_experts": 64, + "load_cv": 0.6350102706254053, + "normalized_load_entropy": 0.9530422914292255, + "max_load_share": 0.043478260869565216 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 120, + "ordered_topk_exact_tokens": 53, + "set_exact_tokens": 68, + "mean_set_jaccard": 0.8601190476190477, + "mean_token_weighted_tv": 0.028740608133375645, + "aggregate_load_tv": 0.041666666666666664 + }, + "system_bos": { + "tokens": 120, + "ordered_topk_exact_tokens": 49, + "set_exact_tokens": 64, + "mean_set_jaccard": 0.8438492063492065, + "mean_token_weighted_tv": 0.032931089983321726, + "aggregate_load_tv": 0.05277777777777778 + }, + "system_x": { + "tokens": 120, + "ordered_topk_exact_tokens": 39, + "set_exact_tokens": 52, + "mean_set_jaccard": 0.7972222222222222, + "mean_token_weighted_tv": 0.04488731177989393, + "aggregate_load_tv": 0.05694444444444445 + }, + "system_period": { + "tokens": 120, + "ordered_topk_exact_tokens": 42, + "set_exact_tokens": 61, + "mean_set_jaccard": 0.8256746031746032, + "mean_token_weighted_tv": 0.0401256064302288, + "aggregate_load_tv": 0.055555555555555546 + }, + "bos_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 47, + "set_exact_tokens": 57, + "mean_set_jaccard": 0.828968253968254, + "mean_token_weighted_tv": 0.03666562970417241, + "aggregate_load_tv": 0.0638888888888889 + }, + "bos_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 42, + "set_exact_tokens": 58, + "mean_set_jaccard": 0.818452380952381, + "mean_token_weighted_tv": 0.038642561660769084, + "aggregate_load_tv": 0.052777777777777785 + }, + "x_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 40, + "set_exact_tokens": 57, + "mean_set_jaccard": 0.8267857142857143, + "mean_token_weighted_tv": 0.03909405026352033, + "aggregate_load_tv": 0.05972222222222223 + }, + "x_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 34, + "set_exact_tokens": 48, + "mean_set_jaccard": 0.7880952380952382, + "mean_token_weighted_tv": 0.04468746035126969, + "aggregate_load_tv": 0.0638888888888889 + }, + "period_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 40, + "set_exact_tokens": 57, + "mean_set_jaccard": 0.8307539682539683, + "mean_token_weighted_tv": 0.03762691638354833, + "aggregate_load_tv": 0.058333333333333334 + }, + "period_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 32, + "set_exact_tokens": 50, + "mean_set_jaccard": 0.7898809523809525, + "mean_token_weighted_tv": 0.04547759819154938, + "aggregate_load_tv": 0.0638888888888889 + } + } + }, + "layer_17": { + "layer": 17, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "a27d7d8d0c0c212f3f651673a103eb212999f37436eb245b662183c3e4393845", + "route_weight_sha256": "88289e05f44b38b6480169f42fb2c3b385f7fa84e2a3cbb96db68c09852ce8f3", + "loads": [ + 11, + 4, + 14, + 16, + 9, + 15, + 18, + 12, + 3, + 4, + 13, + 18, + 33, + 17, + 14, + 15, + 13, + 27, + 18, + 15, + 28, + 13, + 4, + 4, + 5, + 17, + 13, + 7, + 7, + 4, + 3, + 6, + 5, + 7, + 1, + 9, + 8, + 2, + 18, + 3, + 18, + 29, + 9, + 17, + 11, + 20, + 20, + 3, + 4, + 18, + 4, + 7, + 7, + 27, + 4, + 4, + 3, + 16, + 2, + 18, + 4, + 2, + 11, + 9 + ], + "weighted_loads": [ + 0.4173242226243019, + 0.14415550231933594, + 0.8199288789182901, + 2.0281429179012775, + 0.39456288143992424, + 1.3305089846253395, + 1.1788844652473927, + 0.924062579870224, + 0.12551714479923248, + 0.14530528336763382, + 0.7774615287780762, + 0.6797902341932058, + 1.460100907832384, + 1.2585498131811619, + 0.5668813772499561, + 0.6767470259219408, + 0.8103291168808937, + 4.949244340881705, + 2.1100601898506284, + 0.6489227619022131, + 1.6850224696099758, + 0.5015495456755161, + 0.13995016738772392, + 0.28472115099430084, + 0.21467962116003036, + 1.1129825599491596, + 0.7717365566641092, + 0.3706595189869404, + 0.3953067120164633, + 0.11861405707895756, + 0.12450564652681351, + 0.44339147582650185, + 0.17217476107180119, + 0.42569600977003574, + 0.04442623257637024, + 0.4795667193830013, + 0.5414371863007545, + 0.14610494300723076, + 1.816783171147108, + 0.18010634183883667, + 1.1895724385976791, + 1.469933770596981, + 0.5086755119264126, + 0.7473779562860727, + 0.4403731934726238, + 0.9090965930372477, + 1.0162664335221052, + 0.13200153224170208, + 0.14531791768968105, + 0.7087335344403982, + 0.2404860183596611, + 1.2906664200127125, + 0.42981570959091187, + 1.0594828929752111, + 0.1753578521311283, + 0.4074253514409065, + 0.1554207168519497, + 1.2871330194175243, + 0.14634720236063004, + 0.899540888145566, + 0.16733532398939133, + 0.06177998147904873, + 0.6467573530972004, + 0.6433036867529154 + ], + "unique_experts": 64, + "load_cv": 0.6764102780099743, + "normalized_load_entropy": 0.9453175332336642, + "max_load_share": 0.04583333333333333 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "3884710b0dfd163e9db95cfb2e24bdf8bcb906e40d2014c56488ce7467347505", + "route_weight_sha256": "7a3a76940e2817e29515b245c31ab8b099cde6eb66b4af2c8554b339b87933bb", + "loads": [ + 19, + 6, + 16, + 23, + 9, + 15, + 20, + 12, + 3, + 7, + 19, + 19, + 36, + 25, + 14, + 17, + 13, + 34, + 21, + 15, + 31, + 13, + 4, + 11, + 12, + 22, + 23, + 11, + 11, + 5, + 3, + 6, + 14, + 7, + 1, + 9, + 8, + 2, + 23, + 3, + 26, + 34, + 12, + 20, + 11, + 24, + 20, + 3, + 4, + 19, + 5, + 7, + 9, + 29, + 4, + 7, + 4, + 18, + 2, + 18, + 4, + 3, + 16, + 9 + ], + "weighted_loads": [ + 0.6748240701854229, + 0.22411436587572098, + 0.9188621062785387, + 2.6102234050631523, + 0.39456288143992424, + 1.3305089846253395, + 1.2782330103218555, + 0.924062579870224, + 0.12551714479923248, + 0.23420874774456024, + 1.1662407480180264, + 0.698262419551611, + 1.5594182219356298, + 1.8521555066108704, + 0.5668813772499561, + 0.765187980607152, + 0.8103291168808937, + 5.603804035112262, + 2.232100852765143, + 0.6489227619022131, + 1.9693229012191296, + 0.5015495456755161, + 0.13995016738772392, + 0.6028277315199375, + 0.7139082234352827, + 1.3636012524366379, + 2.5161948166787624, + 0.5452650431543589, + 0.5490193888545036, + 0.12386945122852921, + 0.12450564652681351, + 0.44339147582650185, + 0.5208611711859703, + 0.42569600977003574, + 0.04442623257637024, + 0.4795667193830013, + 0.5414371863007545, + 0.14610494300723076, + 2.0041359029710293, + 0.18010634183883667, + 2.105600018054247, + 1.6126876268535852, + 0.6862171292304993, + 0.8051897629629821, + 0.4403731934726238, + 1.7433887664228678, + 1.0162664335221052, + 0.13200153224170208, + 0.14531791768968105, + 0.7491706032305956, + 0.30613863468170166, + 1.2906664200127125, + 0.5924458354711533, + 1.1409507282078266, + 0.1753578521311283, + 0.5967053323984146, + 0.18636557459831238, + 1.3992080725729465, + 0.14634720236063004, + 0.899540888145566, + 0.16733532398939133, + 0.13158063404262066, + 1.0349798984825611, + 0.6433036867529154 + ], + "unique_experts": 64, + "load_cv": 0.6503065935462472, + "normalized_load_entropy": 0.9479495251539374, + "max_load_share": 0.041379310344827586 + } + }, + "s1_eos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "c1797934df1922fd8ea34c62f157bcf63f7e547e1f58ae02378c7e040ec25a58", + "route_weight_sha256": "145d100505a3c6c168cc2bfa55a756f6845e8d1a2f5a0f2d5753b890e041ef73", + "loads": [ + 10, + 4, + 13, + 17, + 9, + 16, + 17, + 12, + 3, + 5, + 13, + 13, + 40, + 18, + 17, + 17, + 12, + 27, + 18, + 14, + 30, + 12, + 4, + 3, + 7, + 15, + 14, + 8, + 9, + 6, + 2, + 5, + 4, + 6, + 1, + 9, + 8, + 1, + 17, + 3, + 18, + 26, + 10, + 19, + 11, + 18, + 19, + 3, + 3, + 18, + 4, + 8, + 7, + 26, + 3, + 6, + 4, + 16, + 2, + 15, + 3, + 0, + 12, + 10 + ], + "weighted_loads": [ + 0.36677078902721405, + 0.16871774196624756, + 0.7727953623980284, + 2.0443706288933754, + 0.38061296194791794, + 1.3322874829173088, + 1.123301163315773, + 0.9133152645081282, + 0.1294868364930153, + 0.18173096515238285, + 0.8113480787724257, + 0.5102932173758745, + 1.7909430228173733, + 1.2403957154601812, + 0.7132556941360235, + 0.7886192183941603, + 0.7942206971347332, + 5.029503086581826, + 2.0555878886952996, + 0.6469452790915966, + 1.7939883936196566, + 0.4681020714342594, + 0.14660555124282837, + 0.25628167390823364, + 0.27581605315208435, + 0.9976617898792028, + 0.7888664398342371, + 0.40299486741423607, + 0.45973808877170086, + 0.2061305269598961, + 0.10101965442299843, + 0.4091910645365715, + 0.143669705837965, + 0.38780444115400314, + 0.04212057590484619, + 0.46659107133746147, + 0.5371595472097397, + 0.09546719491481781, + 1.6905629504472017, + 0.17658157274127007, + 1.1735084876418114, + 1.3490980435162783, + 0.5151535645127296, + 0.8090504314750433, + 0.4236070644110441, + 0.8355082347989082, + 0.9590536411851645, + 0.13135552033782005, + 0.10576736554503441, + 0.7799931392073631, + 0.1965213194489479, + 1.2375419847667217, + 0.4229226913303137, + 1.0337295588105917, + 0.11863981932401657, + 0.41380568221211433, + 0.19736702740192413, + 1.297493152320385, + 0.14804696291685104, + 0.798214890062809, + 0.12164714187383652, + 0.0, + 0.6176292542368174, + 0.753868505358696 + ], + "unique_experts": 63, + "load_cv": 0.700088177867705, + "normalized_load_entropy": 0.9414938344538326, + "max_load_share": 0.05555555555555555 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "2dabb9154fbc2171bc1d5c893c405f9654ffeca0f84a843f58ac24986c5b9232", + "route_weight_sha256": "4e4eb4cc769404129c9b0e9cfe5f437ec81fc2be46a498edc5bc525b1ec5e451", + "loads": [ + 18, + 6, + 16, + 23, + 15, + 16, + 20, + 13, + 3, + 11, + 20, + 15, + 40, + 26, + 17, + 24, + 13, + 33, + 21, + 14, + 31, + 13, + 4, + 14, + 17, + 35, + 28, + 11, + 11, + 8, + 4, + 6, + 10, + 6, + 1, + 9, + 12, + 3, + 20, + 4, + 31, + 33, + 15, + 20, + 13, + 23, + 21, + 5, + 3, + 19, + 5, + 13, + 11, + 28, + 4, + 12, + 12, + 26, + 3, + 17, + 4, + 5, + 22, + 10 + ], + "weighted_loads": [ + 0.6744841206818819, + 0.24184667505323887, + 0.8770347312092781, + 2.6694709695875645, + 0.7757138013839722, + 1.3322874829173088, + 1.242293406277895, + 0.9704047460108995, + 0.1294868364930153, + 0.3703933022916317, + 1.3109735157340765, + 0.5771579034626484, + 1.7909430228173733, + 1.848846485838294, + 0.7132556941360235, + 1.1240932885557413, + 0.9299723915755749, + 5.596325980499387, + 2.166241784580052, + 0.6469452790915966, + 1.8615464139729738, + 0.5447760112583637, + 0.14660555124282837, + 1.0101646929979324, + 0.8801320777274668, + 2.2718411292880774, + 2.668609891086817, + 0.5331613346934319, + 0.546322463080287, + 0.29236388485878706, + 0.1956225223839283, + 0.44853489100933075, + 0.3256410202011466, + 0.38780444115400314, + 0.04212057590484619, + 0.46659107133746147, + 0.7649351134896278, + 0.16949701681733131, + 1.9858723860234022, + 0.21014640852808952, + 2.773740481585264, + 1.72732455143705, + 0.715602932497859, + 0.8278610166162252, + 0.6566719878464937, + 2.0461249202489853, + 1.180475203320384, + 0.26348163560032845, + 0.10576736554503441, + 0.821581955999136, + 0.3303626999258995, + 1.504694091156125, + 0.6749137807637453, + 1.1119640786200762, + 0.2079356610774994, + 0.8073945250362158, + 0.852343313395977, + 1.8497448489069939, + 0.17158378846943378, + 0.88753642141819, + 0.15723972022533417, + 0.2924683727324009, + 1.323783004656434, + 0.753868505358696 + ], + "unique_experts": 64, + "load_cv": 0.6086498764494946, + "normalized_load_entropy": 0.954167823141293, + "max_load_share": 0.041407867494824016 + } + }, + "s0_bos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "1b4d1e2dc82ad4a16fe09e2a36e3c6e5d38b23365bc0536e172f6f0a2c7f6e85", + "route_weight_sha256": "faa23c5cb7987055fcb99b4b654a4d64b1499c285a58b19d37ab19671c843f0a", + "loads": [ + 9, + 2, + 12, + 16, + 10, + 15, + 17, + 12, + 3, + 5, + 15, + 15, + 31, + 18, + 13, + 14, + 13, + 27, + 15, + 16, + 29, + 13, + 7, + 2, + 7, + 16, + 15, + 10, + 7, + 5, + 2, + 5, + 5, + 6, + 1, + 8, + 8, + 1, + 17, + 3, + 20, + 26, + 8, + 18, + 9, + 19, + 20, + 3, + 3, + 19, + 5, + 7, + 7, + 29, + 4, + 5, + 3, + 17, + 2, + 19, + 7, + 1, + 15, + 9 + ], + "weighted_loads": [ + 0.3347266651690006, + 0.06771205179393291, + 0.781441405415535, + 1.9518173802644014, + 0.4426484126597643, + 1.3687848635017872, + 1.1786022037267685, + 0.9256099592894316, + 0.12221234291791916, + 0.1869128905236721, + 0.8716010376811028, + 0.5989573150873184, + 1.364940108731389, + 1.2530707381665707, + 0.553320974111557, + 0.7012961693108082, + 0.7882270719856024, + 5.102278644219041, + 2.137560134753585, + 0.690341517329216, + 1.6818241365253925, + 0.5091203693300486, + 0.2642225604504347, + 0.23619269952178001, + 0.3057533986866474, + 1.096547044813633, + 0.9063526652753353, + 0.43636127933859825, + 0.37740871123969555, + 0.1792055033147335, + 0.10362885892391205, + 0.45986514165997505, + 0.16918286494910717, + 0.38473542034626007, + 0.048153940588235855, + 0.4517905246466398, + 0.5668787620961666, + 0.09410983324050903, + 1.825327167287469, + 0.192291721701622, + 1.2688733637332916, + 1.342474427074194, + 0.4837370328605175, + 0.7776322178542614, + 0.36703681387007236, + 0.8816985003650188, + 1.0254962015897036, + 0.12839144095778465, + 0.10126660391688347, + 0.7666223049163818, + 0.26533693075180054, + 1.364246129989624, + 0.41276731714606285, + 1.1113716941326857, + 0.15688185393810272, + 0.4591001085937023, + 0.15141547843813896, + 1.3204829599708319, + 0.14653895795345306, + 0.9336589463055134, + 0.27488692477345467, + 0.03218081220984459, + 0.8713380172848701, + 0.7248869352042675 + ], + "unique_experts": 64, + "load_cv": 0.6712803318663652, + "normalized_load_entropy": 0.9445495562979547, + "max_load_share": 0.043055555555555555 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "cfb97bfc94c30ae45f0d5893cdacf539966689457da2a5a702459833dd41aad6", + "route_weight_sha256": "248e2e46f12558d615f54bf808e0533af42ca135d1bd169425ee99f92d30885a", + "loads": [ + 16, + 4, + 13, + 23, + 10, + 15, + 19, + 12, + 3, + 8, + 21, + 16, + 35, + 26, + 13, + 16, + 13, + 34, + 18, + 17, + 32, + 14, + 7, + 9, + 14, + 21, + 23, + 13, + 11, + 5, + 2, + 5, + 14, + 6, + 1, + 8, + 8, + 1, + 22, + 3, + 28, + 30, + 11, + 20, + 9, + 23, + 20, + 3, + 3, + 21, + 6, + 7, + 9, + 31, + 5, + 8, + 4, + 19, + 2, + 20, + 7, + 2, + 22, + 9 + ], + "weighted_loads": [ + 0.608819030225277, + 0.15309369750320911, + 0.8387192338705063, + 2.533897867426276, + 0.4426484126597643, + 1.3687848635017872, + 1.2779507488012314, + 0.9256099592894316, + 0.12221234291791916, + 0.2758163549005985, + 1.260380256921053, + 0.6174295004457235, + 1.6322148814797401, + 1.8466764315962791, + 0.553320974111557, + 0.7858995646238327, + 0.7882270719856024, + 5.756838338449597, + 2.3947122413665056, + 0.7468156665563583, + 1.9809100069105625, + 0.5907766986638308, + 0.2642225604504347, + 0.5620305612683296, + 0.8254404459148645, + 1.3582960665225983, + 1.6268247701227665, + 0.5637395847588778, + 0.5299722701311111, + 0.1792055033147335, + 0.10362885892391205, + 0.45986514165997505, + 0.545179171487689, + 0.38473542034626007, + 0.048153940588235855, + 0.4517905246466398, + 0.5668787620961666, + 0.09410983324050903, + 2.0093079525977373, + 0.192291721701622, + 2.2077429741621017, + 1.4737578202039003, + 0.6551245506852865, + 0.8322703018784523, + 0.36703681387007236, + 1.5764810629189014, + 1.0254962015897036, + 0.12839144095778465, + 0.10126660391688347, + 0.9896412789821625, + 0.3309895470738411, + 1.364246129989624, + 0.5625328831374645, + 1.2113898526877165, + 0.23370687663555145, + 0.6526800282299519, + 0.18421617522835732, + 1.432558013126254, + 0.14653895795345306, + 0.9804143160581589, + 0.27488692477345467, + 0.13379929587244987, + 1.2732003591954708, + 0.7248869352042675 + ], + "unique_experts": 64, + "load_cv": 0.6509563885884375, + "normalized_load_entropy": 0.9470833375447795, + "max_load_share": 0.040229885057471264 + } + }, + "s1_bos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "a4868c05e3a0409627464bbed7138c30296b775f492acecaec2e79fe4644d03e", + "route_weight_sha256": "ab17b5d4451b6333855786b780089874771b5d19cc6dfbd9468ae7a09d46a905", + "loads": [ + 10, + 3, + 13, + 16, + 9, + 16, + 15, + 12, + 3, + 6, + 13, + 12, + 33, + 18, + 14, + 19, + 15, + 27, + 18, + 13, + 28, + 9, + 4, + 2, + 7, + 17, + 14, + 8, + 10, + 4, + 2, + 6, + 5, + 6, + 1, + 9, + 8, + 2, + 19, + 3, + 18, + 25, + 9, + 16, + 12, + 19, + 19, + 3, + 2, + 21, + 5, + 7, + 7, + 27, + 2, + 6, + 4, + 16, + 2, + 18, + 6, + 1, + 14, + 12 + ], + "weighted_loads": [ + 0.37828234396874905, + 0.10773984715342522, + 0.688613448292017, + 1.9622674137353897, + 0.4045643527060747, + 1.4018165059387684, + 1.1010114699602127, + 0.9244641065597534, + 0.1263326145708561, + 0.2251135241240263, + 0.7855369560420513, + 0.4655602443963289, + 1.444047348573804, + 1.2526791281998158, + 0.6169478762894869, + 0.8737773429602385, + 0.89641441591084, + 5.074110170826316, + 2.0518577052280307, + 0.6510847974568605, + 1.6380600184202194, + 0.37619861401617527, + 0.15934536419808865, + 0.22660068050026894, + 0.2915740869939327, + 1.052608821541071, + 0.8775827046483755, + 0.36504134722054005, + 0.4820392243564129, + 0.12428970821201801, + 0.10725631937384605, + 0.492234006524086, + 0.16600879840552807, + 0.3942675441503525, + 0.046517934650182724, + 0.46863595955073833, + 0.5691210441291332, + 0.12758177518844604, + 1.734806440770626, + 0.21028506010770798, + 1.2485403455793858, + 1.3338593542575836, + 0.5147953070700169, + 0.6984449103474617, + 0.46261759102344513, + 0.8825304973870516, + 0.9929667841643095, + 0.12613767199218273, + 0.07077806442975998, + 0.8764566164463758, + 0.22751747071743011, + 1.320661999285221, + 0.4179665148258209, + 1.0412764512002468, + 0.07107323594391346, + 0.4217304512858391, + 0.19437549263238907, + 1.286878228187561, + 0.14883573353290558, + 0.9133685547858477, + 0.23283319547772408, + 0.030435901135206223, + 0.7972737643867731, + 0.9179881662130356 + ], + "unique_experts": 64, + "load_cv": 0.6675919504799912, + "normalized_load_entropy": 0.9450442906263251, + "max_load_share": 0.04583333333333333 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "e262c9ec65967f25e470325d6bb35d1ab1078a2d87323a41c59318de85997d38", + "route_weight_sha256": "c145406dbaa0663366b19d954beebd2d4ba415f4c177b7ef93a7e6eeb824abe5", + "loads": [ + 17, + 8, + 16, + 22, + 15, + 16, + 18, + 13, + 3, + 12, + 20, + 14, + 35, + 26, + 14, + 25, + 16, + 33, + 21, + 13, + 29, + 10, + 4, + 13, + 16, + 37, + 26, + 11, + 10, + 5, + 4, + 7, + 11, + 6, + 1, + 9, + 12, + 4, + 22, + 4, + 32, + 31, + 14, + 17, + 14, + 24, + 21, + 5, + 2, + 23, + 7, + 12, + 11, + 28, + 3, + 13, + 12, + 26, + 3, + 20, + 7, + 6, + 25, + 12 + ], + "weighted_loads": [ + 0.6849753595888615, + 0.3357335012406111, + 0.7928528171032667, + 2.587367754429579, + 0.7996651921421289, + 1.4018165059387684, + 1.2200037129223347, + 0.9815535880625248, + 0.1263326145708561, + 0.4377027116715908, + 1.2851623930037022, + 0.5324249304831028, + 1.5533606763929129, + 1.8611298985779285, + 0.6169478762894869, + 1.1613227371126413, + 1.0321661103516817, + 5.6409330647438765, + 2.168500709347427, + 0.6510847974568605, + 1.7349740117788315, + 0.4528725538402796, + 0.15934536419808865, + 0.9951092712581158, + 0.8834367766976357, + 2.32380660623312, + 1.8325330708175898, + 0.4870378579944372, + 0.4820392243564129, + 0.205287242308259, + 0.20185918733477592, + 0.5315778329968452, + 0.3766794614493847, + 0.3942675441503525, + 0.046517934650182724, + 0.46863595955073833, + 0.7968966104090214, + 0.20161159709095955, + 2.0301158763468266, + 0.24384989589452744, + 2.9110450446605682, + 1.719272067770362, + 0.7192917969077826, + 0.7172554954886436, + 0.6956825144588947, + 2.187689470127225, + 1.214388346299529, + 0.2582637872546911, + 0.07077806442975998, + 0.956667935475707, + 0.41437358036637306, + 1.5878141056746244, + 0.6644065715372562, + 1.087182778865099, + 0.16036907769739628, + 0.8572097215801477, + 0.8528413064777851, + 1.83912992477417, + 0.17237255908548832, + 1.0026900861412287, + 0.2684257738292217, + 0.33032025396823883, + 1.5575367640703917, + 0.9179881662130356 + ], + "unique_experts": 64, + "load_cv": 0.5942822463089896, + "normalized_load_entropy": 0.9559177758069107, + "max_load_share": 0.038302277432712216 + } + }, + "s0_x": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "3099b7a2d597dec7910296fe3a529cdc563626f141e75dd677f5342b74d78069", + "route_weight_sha256": "f740a87ea56cb380a17e20aefd20d66a229d7c4521051784cae6256f3a7b51cb", + "loads": [ + 12, + 1, + 13, + 16, + 11, + 16, + 16, + 12, + 3, + 6, + 15, + 15, + 31, + 18, + 14, + 15, + 15, + 27, + 17, + 17, + 28, + 13, + 5, + 3, + 5, + 20, + 11, + 7, + 6, + 3, + 5, + 6, + 4, + 6, + 1, + 9, + 8, + 1, + 18, + 3, + 19, + 26, + 9, + 16, + 12, + 19, + 20, + 3, + 6, + 15, + 5, + 8, + 7, + 30, + 6, + 5, + 4, + 18, + 2, + 16, + 3, + 1, + 11, + 7 + ], + "weighted_loads": [ + 0.44515353068709373, + 0.03458606079220772, + 0.7182243969291449, + 1.9261474553495646, + 0.5218880921602249, + 1.4212339371442795, + 1.1615985874086618, + 0.9311699513345957, + 0.12786787003278732, + 0.2172339539974928, + 0.8335233367979527, + 0.6018294300884008, + 1.4101184736937284, + 1.265057273209095, + 0.5810521896928549, + 0.7208699211478233, + 0.8598666377365589, + 5.225971527397633, + 2.077045703306794, + 0.7483270280063152, + 1.6048017125576735, + 0.489197064191103, + 0.19341043382883072, + 0.2508594784885645, + 0.2535293810069561, + 1.3022868055850267, + 0.7013241276144981, + 0.3360886238515377, + 0.3576935064047575, + 0.09751657210290432, + 0.2219289466738701, + 0.5033681578934193, + 0.13732201606035233, + 0.3852923512458801, + 0.044594231992959976, + 0.47439378686249256, + 0.6294635124504566, + 0.08905069530010223, + 1.8938717059791088, + 0.19135648384690285, + 1.3739519827067852, + 1.4220576453953981, + 0.5133389718830585, + 0.7002352923154831, + 0.46427507139742374, + 0.8650795705616474, + 1.0307994820177555, + 0.1240853313356638, + 0.20854723826050758, + 0.6197149697691202, + 0.2631000988185406, + 1.4254861176013947, + 0.41427501291036606, + 1.1792340371757746, + 0.2489602342247963, + 0.4848977290093899, + 0.17642561718821526, + 1.4773935116827488, + 0.1500835344195366, + 0.783292431384325, + 0.11355116404592991, + 0.037047773599624634, + 0.7388059534132481, + 0.6139875687658787 + ], + "unique_experts": 64, + "load_cv": 0.6692542376166932, + "normalized_load_entropy": 0.9449767746158035, + "max_load_share": 0.043055555555555555 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "dfd6ac8bd1443b2cc68b6070b8cd13e7107728cc6c3d9f03241357826c5bba37", + "route_weight_sha256": "3c4f1895f730dfe09ba4eef4cc5d7ce4b8df9d030431e3be9e5621416147fa32", + "loads": [ + 18, + 2, + 15, + 24, + 11, + 16, + 18, + 12, + 3, + 10, + 22, + 16, + 33, + 27, + 14, + 17, + 15, + 35, + 20, + 17, + 30, + 14, + 5, + 11, + 12, + 27, + 18, + 10, + 10, + 3, + 5, + 6, + 12, + 6, + 1, + 9, + 8, + 1, + 23, + 3, + 27, + 30, + 12, + 18, + 12, + 23, + 20, + 3, + 7, + 16, + 7, + 8, + 10, + 31, + 7, + 9, + 5, + 20, + 2, + 16, + 3, + 2, + 16, + 7 + ], + "weighted_loads": [ + 0.6564007587730885, + 0.07056503742933273, + 0.8230905402451754, + 2.6590664219111204, + 0.5218880921602249, + 1.4212339371442795, + 1.2609471324831247, + 0.9311699513345957, + 0.12786787003278732, + 0.34971524961292744, + 1.3678975850343704, + 0.620301615446806, + 1.4744342379271984, + 1.89680315554142, + 0.5810521896928549, + 0.80803057923913, + 0.8598666377365589, + 5.925359815359116, + 2.3901504036039114, + 0.7483270280063152, + 1.8053005170077085, + 0.5294995084404945, + 0.19341043382883072, + 0.6238826178014278, + 0.776302071288228, + 1.6562222186475992, + 1.3117848485708237, + 0.4634669292718172, + 0.5128283016383648, + 0.09751657210290432, + 0.2219289466738701, + 0.5033681578934193, + 0.48190951347351074, + 0.3852923512458801, + 0.044594231992959976, + 0.47439378686249256, + 0.6294635124504566, + 0.08905069530010223, + 2.0805428121238947, + 0.19135648384690285, + 2.3099603224545717, + 1.5759621281176805, + 0.6902103088796139, + 0.754873376339674, + 0.46427507139742374, + 1.6654636822640896, + 1.0307994820177555, + 0.1240853313356638, + 0.24942653253674507, + 0.6521000023931265, + 0.395001869648695, + 1.4254861176013947, + 0.6015042383223772, + 1.224617538973689, + 0.29170970618724823, + 0.7158800177276134, + 0.20950434729456902, + 1.589468564838171, + 0.1500835344195366, + 0.783292431384325, + 0.11355116404592991, + 0.12817005813121796, + 1.0178428813815117, + 0.6139875687658787 + ], + "unique_experts": 64, + "load_cv": 0.6373042379970951, + "normalized_load_entropy": 0.9491134048751324, + "max_load_share": 0.040229885057471264 + } + }, + "s1_x": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "7d2a609278c7b8f5278dbc987ade657d51c4de9267f51d42c45cab96f3233109", + "route_weight_sha256": "dd3a981af2058d1fab427e96f0d90695608676b2eb2e5b4b0c52a10ad77c4270", + "loads": [ + 13, + 2, + 12, + 16, + 11, + 17, + 16, + 12, + 3, + 4, + 12, + 12, + 41, + 18, + 15, + 15, + 16, + 27, + 21, + 12, + 26, + 10, + 6, + 5, + 5, + 17, + 16, + 6, + 8, + 3, + 5, + 7, + 4, + 7, + 1, + 9, + 9, + 2, + 20, + 3, + 18, + 22, + 10, + 16, + 6, + 16, + 20, + 2, + 3, + 13, + 3, + 7, + 8, + 30, + 4, + 4, + 5, + 17, + 2, + 20, + 6, + 2, + 10, + 12 + ], + "weighted_loads": [ + 0.4518242496997118, + 0.08053143136203289, + 0.6717240046709776, + 1.9559807684272528, + 0.5145841427147388, + 1.4301120545715094, + 1.116403667256236, + 0.8942758943885565, + 0.12540526315569878, + 0.14702389389276505, + 0.7497295551002026, + 0.4680440314114094, + 1.7586668618023396, + 1.2832222282886505, + 0.6290688216686249, + 0.7325963824987411, + 1.1404103338718414, + 5.059059780091047, + 2.0815813168883324, + 0.5843938197940588, + 1.4409197140485048, + 0.39919982105493546, + 0.22391164302825928, + 0.32488297671079636, + 0.2147096022963524, + 1.0733167417347431, + 0.8456711452454329, + 0.30592814087867737, + 0.42948903515934944, + 0.08673147112131119, + 0.2088334895670414, + 0.5125184077769518, + 0.1409152541309595, + 0.4127642195671797, + 0.043466195464134216, + 0.4686113689094782, + 0.6383486166596413, + 0.1372193843126297, + 1.733166003599763, + 0.19443419948220253, + 1.3011326044797897, + 1.2297358810901642, + 0.5164017174392939, + 0.6710806004703045, + 0.22291559353470802, + 0.7585158236324787, + 0.9891972448676825, + 0.09493612870573997, + 0.09963083826005459, + 0.5513050220906734, + 0.1473981812596321, + 1.2535607554018497, + 0.45693623647093773, + 1.1259001344442368, + 0.14040136337280273, + 0.3130494859069586, + 0.23062528669834137, + 1.4257752299308777, + 0.1540103554725647, + 0.9690188653767109, + 0.2330608069896698, + 0.07585372403264046, + 0.5585028007626534, + 0.857979279011488 + ], + "unique_experts": 64, + "load_cv": 0.6979688344239737, + "normalized_load_entropy": 0.9437320573782079, + "max_load_share": 0.05694444444444444 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "734810a7ccfcc5e2a351cb30d7faef24d4e51cdde1998d12adec9e55b26657d7", + "route_weight_sha256": "83f15488a7c0bd306b639ea147a980165ae98f224e3353d42189cbc3e652da1e", + "loads": [ + 18, + 4, + 16, + 23, + 17, + 17, + 19, + 13, + 3, + 11, + 20, + 14, + 42, + 27, + 15, + 21, + 17, + 34, + 24, + 12, + 26, + 11, + 6, + 17, + 14, + 39, + 25, + 8, + 8, + 4, + 7, + 8, + 9, + 7, + 1, + 9, + 13, + 4, + 23, + 4, + 31, + 29, + 16, + 17, + 8, + 21, + 22, + 4, + 4, + 14, + 5, + 12, + 13, + 31, + 5, + 11, + 13, + 29, + 4, + 22, + 7, + 8, + 18, + 12 + ], + "weighted_loads": [ + 0.6621102653443813, + 0.1536603644490242, + 0.8223474621772766, + 2.7422610092908144, + 0.9096849821507931, + 1.4301120545715094, + 1.235395910218358, + 0.9513653758913279, + 0.12540526315569878, + 0.378828601911664, + 1.3892441280186176, + 0.5349087174981833, + 1.7944486178457737, + 1.9529357701539993, + 0.6290688216686249, + 1.0347320102155209, + 1.276162028312683, + 5.675079297274351, + 2.2098594158887863, + 0.5843938197940588, + 1.4409197140485048, + 0.47587376087903976, + 0.22391164302825928, + 1.1125644352287054, + 0.7918307594954967, + 2.4666929319500923, + 1.5778975058346987, + 0.38170522078871727, + 0.42948903515934944, + 0.16772900521755219, + 0.30343635752797127, + 0.551862234249711, + 0.3184469938278198, + 0.4127642195671797, + 0.043466195464134216, + 0.4686113689094782, + 0.8661241829395294, + 0.2112492062151432, + 2.0284754391759634, + 0.227999035269022, + 2.9190843254327774, + 1.6161258276551962, + 0.7611094862222672, + 0.6898911856114864, + 0.4559805169701576, + 1.9503752402961254, + 1.210618807002902, + 0.22706224396824837, + 0.13863406516611576, + 0.5914405547082424, + 0.36474768817424774, + 1.520712861791253, + 0.7319326475262642, + 1.1654713191092014, + 0.22969720512628555, + 0.7478640899062157, + 0.8887834250926971, + 2.112129397690296, + 0.22753027640283108, + 1.058340396732092, + 0.26865338534116745, + 0.40316069684922695, + 1.1060600578784943, + 0.857979279011488 + ], + "unique_experts": 64, + "load_cv": 0.6122451122855825, + "normalized_load_entropy": 0.9552064675036588, + "max_load_share": 0.043478260869565216 + } + }, + "s0_period": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "c20c83f721263a2b098ac7480185b721c387c834430a7eb13790906b31951abd", + "route_weight_sha256": "7c6e94e68259c02646c15b033950a466f62a14751e4bfd2c99b614a65bc48669", + "loads": [ + 13, + 3, + 12, + 16, + 12, + 16, + 17, + 12, + 3, + 4, + 14, + 16, + 35, + 19, + 12, + 17, + 14, + 27, + 14, + 19, + 25, + 13, + 6, + 3, + 5, + 20, + 13, + 7, + 4, + 3, + 4, + 6, + 4, + 6, + 1, + 9, + 8, + 1, + 18, + 3, + 19, + 27, + 10, + 16, + 12, + 22, + 19, + 2, + 3, + 15, + 5, + 8, + 7, + 27, + 5, + 5, + 4, + 18, + 2, + 17, + 3, + 0, + 13, + 7 + ], + "weighted_loads": [ + 0.4669851139187813, + 0.10761534050107002, + 0.6944387592375278, + 1.9161401577293873, + 0.5513086449354887, + 1.4190683513879776, + 1.184613535180688, + 0.9191422034054995, + 0.12597477436065674, + 0.14685810543596745, + 0.8190153930336237, + 0.6232190765440464, + 1.5253818817436695, + 1.2967726215720177, + 0.5050044097006321, + 0.7864106073975563, + 0.8486696481704712, + 5.306977096945047, + 1.9873580746352673, + 0.8065422810614109, + 1.5325049236416817, + 0.49626774340867996, + 0.20558510906994343, + 0.24834687262773514, + 0.23676177859306335, + 1.2728215120732784, + 0.749467670917511, + 0.3410581275820732, + 0.29859363473951817, + 0.09661290980875492, + 0.1817927397787571, + 0.4964003339409828, + 0.13821213692426682, + 0.37308092415332794, + 0.044188521802425385, + 0.479124341160059, + 0.6152527779340744, + 0.09580092877149582, + 1.854275207966566, + 0.18553759902715683, + 1.3794026896357536, + 1.4406688399612904, + 0.5538202933967113, + 0.6762964483350515, + 0.45845335349440575, + 0.9778887741267681, + 1.0148823037743568, + 0.09776465594768524, + 0.0973709337413311, + 0.6025276500731707, + 0.25726160779595375, + 1.4117198251187801, + 0.42686523124575615, + 1.0558195989578962, + 0.21043615229427814, + 0.4760436713695526, + 0.18105332180857658, + 1.453680308535695, + 0.14590981602668762, + 0.8279216177761555, + 0.11823368445038795, + 0.0, + 0.7733103856444359, + 0.5846751965582371 + ], + "unique_experts": 63, + "load_cv": 0.6876332643007023, + "normalized_load_entropy": 0.9412991986253294, + "max_load_share": 0.04861111111111111 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "c4e0d90930ceb63750955952449947ca67788df891d00dab226755dc11d4329f", + "route_weight_sha256": "0848798b78b1140a5f7937dd0515b9666bbe75fa75ad433044128afac1175774", + "loads": [ + 19, + 4, + 14, + 24, + 12, + 16, + 19, + 12, + 3, + 7, + 20, + 17, + 37, + 27, + 12, + 19, + 14, + 34, + 17, + 19, + 28, + 14, + 6, + 10, + 12, + 28, + 20, + 11, + 8, + 4, + 4, + 6, + 13, + 6, + 1, + 9, + 8, + 1, + 22, + 3, + 26, + 31, + 14, + 18, + 12, + 26, + 19, + 2, + 3, + 16, + 7, + 8, + 10, + 28, + 6, + 10, + 5, + 21, + 2, + 17, + 3, + 1, + 18, + 7 + ], + "weighted_loads": [ + 0.6787387989461422, + 0.14359431713819504, + 0.8178237266838551, + 2.5431173220276833, + 0.5513086449354887, + 1.4190683513879776, + 1.2839620802551508, + 0.9191422034054995, + 0.12597477436065674, + 0.23576156981289387, + 1.2077946122735739, + 0.6416912619024515, + 1.5896976459771395, + 1.8903783150017262, + 0.5050044097006321, + 0.8783894777297974, + 0.8486696481704712, + 5.961536791175604, + 2.328183613717556, + 0.8065422810614109, + 1.7833585664629936, + 0.5417206063866615, + 0.20558510906994343, + 0.5682813171297312, + 0.766918046399951, + 1.6726434603333473, + 1.3569658659398556, + 0.5053503196686506, + 0.45035799592733383, + 0.1325880866497755, + 0.1817927397787571, + 0.4964003339409828, + 0.5165318697690964, + 0.37308092415332794, + 0.044188521802425385, + 0.479124341160059, + 0.6152527779340744, + 0.09580092877149582, + 2.0100697837769985, + 0.18553759902715683, + 2.2717096358537674, + 1.6012354865670204, + 0.7821305692195892, + 0.7309345323592424, + 0.45845335349440575, + 1.8468626625835896, + 1.0148823037743568, + 0.09776465594768524, + 0.0973709337413311, + 0.6350443530827761, + 0.39188722893595695, + 1.4117198251187801, + 0.6150414422154427, + 1.1000852342694998, + 0.254972068592906, + 0.880649633705616, + 0.21273328736424446, + 1.6068830247968435, + 0.14590981602668762, + 0.8279216177761555, + 0.11823368445038795, + 0.0890924409031868, + 1.058511070907116, + 0.5846751965582371 + ], + "unique_experts": 64, + "load_cv": 0.6504366044870163, + "normalized_load_entropy": 0.9467125747617773, + "max_load_share": 0.04252873563218391 + } + }, + "s1_period": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "0c686c67e368eb4c5fb526633c4af303b42654001b24662d72d735f963b25932", + "route_weight_sha256": "635986f8b4738d98fd4a874be04a6d6ace917acdcee00e9d3bbfe84a9ce5ee12", + "loads": [ + 12, + 3, + 12, + 16, + 10, + 16, + 15, + 12, + 3, + 4, + 14, + 14, + 35, + 18, + 13, + 18, + 15, + 27, + 17, + 12, + 26, + 10, + 7, + 4, + 7, + 20, + 15, + 10, + 7, + 3, + 7, + 7, + 3, + 7, + 1, + 9, + 9, + 1, + 19, + 3, + 18, + 26, + 9, + 17, + 7, + 15, + 19, + 2, + 3, + 14, + 4, + 8, + 8, + 28, + 4, + 5, + 5, + 18, + 2, + 19, + 5, + 2, + 9, + 12 + ], + "weighted_loads": [ + 0.4211057871580124, + 0.12045466899871826, + 0.6799012757837772, + 1.9295947551727295, + 0.48461619578301907, + 1.3982757925987244, + 1.059000676497817, + 0.906029723584652, + 0.1255125179886818, + 0.14635007828474045, + 0.7984962165355682, + 0.5316104274243116, + 1.580164521932602, + 1.272497784346342, + 0.5528241638094187, + 0.8507462274283171, + 1.077008219435811, + 5.198712036013603, + 1.9862551297992468, + 0.5956764090806246, + 1.4801735524088144, + 0.40614741668105125, + 0.2434255536645651, + 0.2814506608992815, + 0.2747839502990246, + 1.2072020377963781, + 0.8617367036640644, + 0.44352220371365547, + 0.40116012282669544, + 0.08737139031291008, + 0.258663073182106, + 0.5006358548998833, + 0.10386020876467228, + 0.41785498335957527, + 0.043238647282123566, + 0.47224288806319237, + 0.6214158926159143, + 0.1016467809677124, + 1.717196648940444, + 0.19590016081929207, + 1.277804620563984, + 1.379675853997469, + 0.4723424483090639, + 0.7079743910580873, + 0.2577005885541439, + 0.7375871296972036, + 0.9662686754018068, + 0.09634047001600266, + 0.10159214958548546, + 0.5781912878155708, + 0.18224169313907623, + 1.2788029797375202, + 0.47270240634679794, + 1.0597553253173828, + 0.13544091768562794, + 0.3450796213001013, + 0.22759627178311348, + 1.464136315509677, + 0.15295445173978806, + 0.9252383001148701, + 0.19178229570388794, + 0.06476591899991035, + 0.535703282803297, + 0.8806192800402641 + ], + "unique_experts": 64, + "load_cv": 0.6609009936872468, + "normalized_load_entropy": 0.9475000467168628, + "max_load_share": 0.04861111111111111 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "47166a7134e2f5b6bb1d8be81b944139f0d62220f853506191166c72467da8d6", + "route_weight_sha256": "f6bdce611422e50a3d484f752b95ac67bf6307e63ff8db52c99037c2ee144a97", + "loads": [ + 18, + 5, + 16, + 23, + 16, + 16, + 18, + 13, + 3, + 10, + 21, + 16, + 36, + 26, + 13, + 25, + 16, + 33, + 20, + 12, + 26, + 11, + 7, + 14, + 16, + 43, + 25, + 12, + 8, + 4, + 9, + 8, + 8, + 7, + 1, + 9, + 13, + 3, + 22, + 4, + 32, + 33, + 16, + 18, + 9, + 20, + 21, + 4, + 3, + 14, + 6, + 13, + 13, + 29, + 5, + 15, + 13, + 31, + 3, + 21, + 6, + 7, + 16, + 12 + ], + "weighted_loads": [ + 0.6688483636826277, + 0.19358360208570957, + 0.8303073365241289, + 2.604829292744398, + 0.8797170352190733, + 1.3982757925987244, + 1.177992919459939, + 0.9631192050874233, + 0.1255125179886818, + 0.3329152949154377, + 1.298121653497219, + 0.5984751135110855, + 1.623351413756609, + 1.8809485547244549, + 0.5528241638094187, + 1.198304207995534, + 1.2127599138766527, + 5.765534929931164, + 2.1329788845032454, + 0.5956764090806246, + 1.4801735524088144, + 0.48282135650515556, + 0.2434255536645651, + 1.009734297171235, + 0.8613922894001007, + 2.700074413791299, + 1.6183263044804335, + 0.5192992836236954, + 0.43721470050513744, + 0.16836892440915108, + 0.3532659411430359, + 0.5399796813726425, + 0.2813919484615326, + 0.41785498335957527, + 0.043238647282123566, + 0.47224288806319237, + 0.8491914588958025, + 0.1756766028702259, + 2.0125060845166445, + 0.22946499660611153, + 2.899918779730797, + 1.7807411085814238, + 0.7628153674304485, + 0.7267849761992693, + 0.4907655119895935, + 2.1069964300841093, + 1.1876902375370264, + 0.22846658527851105, + 0.10159214958548546, + 0.5781912878155708, + 0.38967129588127136, + 1.5459550861269236, + 0.7416714206337929, + 1.1002391315996647, + 0.22473675943911076, + 1.0302765984088182, + 0.8802903555333614, + 2.203418767079711, + 0.1764912772923708, + 1.014559831470251, + 0.2273748740553856, + 0.3478188030421734, + 1.0118741244077682, + 0.8806192800402641 + ], + "unique_experts": 64, + "load_cv": 0.6085371830732675, + "normalized_load_entropy": 0.9555540026290755, + "max_load_share": 0.044513457556935816 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 120, + "ordered_topk_exact_tokens": 53, + "set_exact_tokens": 66, + "mean_set_jaccard": 0.8557539682539683, + "mean_token_weighted_tv": 0.029184376316455502, + "aggregate_load_tv": 0.04861111111111112 + }, + "system_bos": { + "tokens": 120, + "ordered_topk_exact_tokens": 47, + "set_exact_tokens": 63, + "mean_set_jaccard": 0.8375, + "mean_token_weighted_tv": 0.03362862051387007, + "aggregate_load_tv": 0.05277777777777777 + }, + "system_x": { + "tokens": 120, + "ordered_topk_exact_tokens": 38, + "set_exact_tokens": 53, + "mean_set_jaccard": 0.7998015873015873, + "mean_token_weighted_tv": 0.04529497013427317, + "aggregate_load_tv": 0.07083333333333333 + }, + "system_period": { + "tokens": 120, + "ordered_topk_exact_tokens": 38, + "set_exact_tokens": 53, + "mean_set_jaccard": 0.8099206349206349, + "mean_token_weighted_tv": 0.04140718416310847, + "aggregate_load_tv": 0.056944444444444436 + }, + "bos_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 37, + "set_exact_tokens": 61, + "mean_set_jaccard": 0.8402777777777779, + "mean_token_weighted_tv": 0.03367650043607379, + "aggregate_load_tv": 0.04861111111111112 + }, + "bos_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 48, + "set_exact_tokens": 71, + "mean_set_jaccard": 0.8566269841269841, + "mean_token_weighted_tv": 0.03346113801623384, + "aggregate_load_tv": 0.04444444444444444 + }, + "x_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 41, + "set_exact_tokens": 63, + "mean_set_jaccard": 0.8326190476190477, + "mean_token_weighted_tv": 0.038966516603250054, + "aggregate_load_tv": 0.04722222222222223 + }, + "x_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 37, + "set_exact_tokens": 55, + "mean_set_jaccard": 0.8018650793650794, + "mean_token_weighted_tv": 0.04391016163475191, + "aggregate_load_tv": 0.075 + }, + "period_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 40, + "set_exact_tokens": 63, + "mean_set_jaccard": 0.8314285714285715, + "mean_token_weighted_tv": 0.03775889975562071, + "aggregate_load_tv": 0.052777777777777785 + }, + "period_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 34, + "set_exact_tokens": 52, + "mean_set_jaccard": 0.7875793650793651, + "mean_token_weighted_tv": 0.04565474382058407, + "aggregate_load_tv": 0.06805555555555556 + } + } + }, + "layer_18": { + "layer": 18, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "6f1eb17f6655067883d703fdaae066e89a0e0f62516adfe0810ee977c108d0b6", + "route_weight_sha256": "70cbdc0ef276a1b861b95ce99154fcd4d3f0bcaf5db2544291b3c0a0572749bc", + "loads": [ + 23, + 6, + 2, + 25, + 13, + 3, + 37, + 2, + 12, + 7, + 6, + 13, + 19, + 15, + 4, + 22, + 3, + 1, + 24, + 11, + 6, + 17, + 15, + 29, + 30, + 10, + 12, + 9, + 1, + 2, + 8, + 8, + 14, + 7, + 14, + 20, + 14, + 23, + 8, + 24, + 8, + 6, + 10, + 4, + 6, + 1, + 20, + 2, + 2, + 14, + 19, + 4, + 15, + 20, + 11, + 2, + 3, + 12, + 4, + 7, + 6, + 13, + 10, + 2 + ], + "weighted_loads": [ + 3.2196283899247646, + 0.22432716563344002, + 0.11008379980921745, + 1.2683251425623894, + 1.7936094477772713, + 0.16970353573560715, + 4.554465543478727, + 0.07970201037824154, + 0.5211750641465187, + 0.37431324645876884, + 0.2749193888157606, + 0.5080602653324604, + 0.8288924396038055, + 3.7005968540906906, + 0.20927222073078156, + 0.8756016157567501, + 0.13543210923671722, + 0.03412821516394615, + 1.6606812085956335, + 0.6453425008803606, + 0.3863219190388918, + 1.23925500549376, + 2.1752352230250835, + 1.2602342534810305, + 1.2354688383638859, + 0.3831273131072521, + 0.5098349712789059, + 0.5285067334771156, + 0.03172531723976135, + 0.06139967404305935, + 0.4095450732856989, + 0.2649106550961733, + 0.5681976694613695, + 0.2638756297528744, + 1.1597401164472103, + 1.141593523323536, + 0.49961306154727936, + 1.0130710769444704, + 0.5702118128538132, + 0.9237371981143951, + 0.2801589425653219, + 0.2331608049571514, + 0.333551237359643, + 0.1365867182612419, + 0.18151444755494595, + 0.06601463258266449, + 1.4870469029992819, + 0.18819276243448257, + 0.07229974865913391, + 0.520992579869926, + 0.7077477276325226, + 0.18059152364730835, + 2.0593406669795513, + 1.0922079235315323, + 0.48905343655496836, + 0.07282860204577446, + 0.1183403842151165, + 0.9782919399440289, + 0.2934805043041706, + 0.5425113551318645, + 0.2597731947898865, + 0.482938589528203, + 0.5522437505424023, + 0.10234587267041206 + ], + "unique_experts": 64, + "load_cv": 0.7287737036358481, + "normalized_load_entropy": 0.9365130456927782, + "max_load_share": 0.05138888888888889 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "69073f5f3bb7165695511076581db1b6e07781faff5b0f3fa7c33df0433c55c7", + "route_weight_sha256": "b1e097e327dc9de0b4ef528a63077bc8ead0e6823ee164913b6149f0eaa8654d", + "loads": [ + 29, + 7, + 14, + 25, + 13, + 6, + 37, + 2, + 20, + 7, + 7, + 17, + 19, + 15, + 9, + 26, + 3, + 1, + 43, + 11, + 6, + 19, + 15, + 29, + 30, + 10, + 12, + 9, + 1, + 2, + 16, + 8, + 15, + 7, + 14, + 23, + 15, + 27, + 8, + 26, + 14, + 6, + 13, + 4, + 6, + 1, + 28, + 2, + 5, + 25, + 22, + 6, + 24, + 28, + 11, + 2, + 5, + 12, + 5, + 10, + 6, + 18, + 10, + 4 + ], + "weighted_loads": [ + 3.5931484140455723, + 0.2968345023691654, + 1.1542686820030212, + 1.2683251425623894, + 1.7936094477772713, + 0.24384455755352974, + 4.554465543478727, + 0.07970201037824154, + 0.9892649799585342, + 0.37431324645876884, + 0.28583881724625826, + 0.8952840752899647, + 0.8288924396038055, + 3.7005968540906906, + 1.0641648638993502, + 1.0084579102694988, + 0.13543210923671722, + 0.03412821516394615, + 2.7443451937288046, + 0.6453425008803606, + 0.3863219190388918, + 1.2923684120178223, + 2.1752352230250835, + 1.2602342534810305, + 1.2354688383638859, + 0.3831273131072521, + 0.5098349712789059, + 0.5285067334771156, + 0.03172531723976135, + 0.06139967404305935, + 0.7079455284401774, + 0.2649106550961733, + 0.609304154291749, + 0.2638756297528744, + 1.1597401164472103, + 1.2843441739678383, + 0.5231831893324852, + 1.1313712149858475, + 0.5702118128538132, + 0.9713433161377907, + 0.5496206004172564, + 0.2331608049571514, + 0.4160447586327791, + 0.1365867182612419, + 0.18151444755494595, + 0.06601463258266449, + 3.005920445546508, + 0.18819276243448257, + 0.21570257656276226, + 1.017582948319614, + 0.8091742172837257, + 0.34653623402118683, + 2.6661939471960068, + 1.6532895602285862, + 0.48905343655496836, + 0.07282860204577446, + 1.116326104849577, + 0.9782919399440289, + 0.32230351865291595, + 0.6892999168485403, + 0.2597731947898865, + 0.6394698955118656, + 0.5522437505424023, + 0.19467350840568542 + ], + "unique_experts": 64, + "load_cv": 0.7090267874593447, + "normalized_load_entropy": 0.9396438485809486, + "max_load_share": 0.04942528735632184 + } + }, + "s1_eos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "c0a182ec24bf7b2cd660792679518bfa33b4fe3fba096de8b79533ded6d16615", + "route_weight_sha256": "b510b603a8553e6be1a7fe97cead34336c79584c06c757b14d2fbb413fc1a3a9", + "loads": [ + 23, + 6, + 4, + 24, + 13, + 3, + 38, + 2, + 9, + 7, + 6, + 10, + 23, + 16, + 5, + 21, + 3, + 1, + 24, + 11, + 5, + 16, + 15, + 31, + 33, + 5, + 12, + 9, + 1, + 1, + 8, + 7, + 12, + 6, + 14, + 20, + 12, + 22, + 10, + 30, + 13, + 5, + 9, + 5, + 7, + 1, + 20, + 3, + 3, + 13, + 17, + 3, + 15, + 18, + 11, + 3, + 4, + 12, + 3, + 6, + 8, + 11, + 10, + 2 + ], + "weighted_loads": [ + 3.10011563077569, + 0.22993029095232487, + 0.1812981404364109, + 1.183645110577345, + 2.1628561168909073, + 0.1662624403834343, + 4.420553009957075, + 0.08109843358397484, + 0.39732950925827026, + 0.3797884024679661, + 0.27114019356667995, + 0.41035743057727814, + 0.9955703504383564, + 3.741813932545483, + 0.24264015443623066, + 0.8324093706905842, + 0.13519597984850407, + 0.038192469626665115, + 1.695205558091402, + 0.660233398899436, + 0.34700072929263115, + 1.115862362086773, + 2.152828572317958, + 1.336752900853753, + 1.3004528610035777, + 0.22119086980819702, + 0.5062802881002426, + 0.5294542796909809, + 0.02923371084034443, + 0.031067444011569023, + 0.36504311859607697, + 0.24129091762006283, + 0.501002473756671, + 0.2162976861000061, + 1.1792945731431246, + 1.1252093240618706, + 0.43129755184054375, + 1.01410211622715, + 0.6735622324049473, + 1.115716291591525, + 0.4470300152897835, + 0.18458066135644913, + 0.31094754859805107, + 0.18816423416137695, + 0.18784421496093273, + 0.06313508749008179, + 1.4596893992275, + 0.22001905925571918, + 0.11508050188422203, + 0.5279386350885034, + 0.6228930596262217, + 0.1575675830245018, + 2.040410328656435, + 1.0190548449754715, + 0.4989234823733568, + 0.11370181292295456, + 0.15648524090647697, + 0.8537986911833286, + 0.26920073106884956, + 0.4895828366279602, + 0.3301635943353176, + 0.42428212985396385, + 0.575949601829052, + 0.10435000248253345 + ], + "unique_experts": 64, + "load_cv": 0.7568616162633957, + "normalized_load_entropy": 0.9344657998623814, + "max_load_share": 0.05277777777777778 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "53e57201f45bae1fcca6b2436f3959cddb6e36f8232d71a3c25592cf90cdcd60", + "route_weight_sha256": "34f30bf5155fec2588ac5e55543f2713950e641634f3f57a3944a1231399f1a7", + "loads": [ + 30, + 9, + 17, + 24, + 14, + 7, + 39, + 4, + 19, + 8, + 7, + 14, + 23, + 17, + 14, + 23, + 3, + 10, + 47, + 12, + 5, + 19, + 16, + 31, + 33, + 5, + 12, + 9, + 1, + 2, + 18, + 9, + 14, + 7, + 18, + 34, + 13, + 30, + 11, + 32, + 18, + 5, + 12, + 10, + 7, + 1, + 38, + 6, + 6, + 26, + 19, + 6, + 24, + 30, + 13, + 4, + 7, + 17, + 5, + 10, + 8, + 16, + 10, + 8 + ], + "weighted_loads": [ + 3.504006426781416, + 0.3668764103204012, + 1.2373094279319048, + 1.183645110577345, + 2.2014978528022766, + 0.2875418346375227, + 4.45028131455183, + 0.1495074201375246, + 1.2361144497990608, + 0.41702791303396225, + 0.28289503511041403, + 0.7803925052285194, + 0.9955703504383564, + 3.7833213144913316, + 1.234092989936471, + 0.889990720897913, + 0.13519597984850407, + 0.609882703050971, + 3.509564721956849, + 0.7952444311231375, + 0.34700072929263115, + 1.206159157678485, + 2.1861119847744703, + 1.336752900853753, + 1.3004528610035777, + 0.22119086980819702, + 0.5062802881002426, + 0.5294542796909809, + 0.02923371084034443, + 0.06779333762824535, + 0.8953281519934535, + 0.4850758668035269, + 0.5910197179764509, + 0.2951313629746437, + 1.604954170063138, + 2.3627051021903753, + 0.4548416379839182, + 1.316880812868476, + 0.7098869904875755, + 1.1634743958711624, + 0.6479131896048784, + 0.18458066135644913, + 0.4034291170537472, + 0.6517210751771927, + 0.18784421496093273, + 0.06313508749008179, + 4.199488462880254, + 0.37254888750612736, + 0.21283747255802155, + 1.0907192351296544, + 0.6877068039029837, + 0.3530851863324642, + 2.630466839298606, + 1.758758120238781, + 0.6190957855433226, + 0.14887341111898422, + 1.169027827680111, + 1.0844077169895172, + 0.6034949719905853, + 0.7594584561884403, + 0.3301635943353176, + 0.590107386931777, + 0.575949601829052, + 0.3292074427008629 + ], + "unique_experts": 64, + "load_cv": 0.6855941273584678, + "normalized_load_entropy": 0.9458868154799639, + "max_load_share": 0.048654244306418216 + } + }, + "s0_bos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "202a819d097b85161fe1e5dbb3e8eae8c4224bcd85f0e65777a8f149691cddca", + "route_weight_sha256": "ad333ee2e2031578169933b49581a613db4043975ea5877a45f1a8320af2121d", + "loads": [ + 23, + 3, + 5, + 25, + 15, + 4, + 38, + 2, + 8, + 9, + 6, + 16, + 19, + 17, + 4, + 23, + 2, + 1, + 22, + 11, + 6, + 16, + 16, + 31, + 32, + 6, + 8, + 8, + 1, + 3, + 10, + 7, + 13, + 8, + 15, + 20, + 14, + 24, + 9, + 26, + 11, + 3, + 8, + 2, + 7, + 1, + 21, + 4, + 2, + 12, + 18, + 3, + 15, + 21, + 13, + 3, + 3, + 12, + 3, + 7, + 4, + 9, + 11, + 1 + ], + "weighted_loads": [ + 3.3454925902187824, + 0.11684859544038773, + 0.22334034740924835, + 1.3308234326541424, + 2.0998858362436295, + 0.2115599364042282, + 4.824892856180668, + 0.08592306822538376, + 0.3656393848359585, + 0.4107197429984808, + 0.2905659954994917, + 0.6351834181696177, + 0.8301728367805481, + 3.884608317166567, + 0.21321187168359756, + 0.9188068807125092, + 0.11082948744297028, + 0.03080967254936695, + 1.689113350585103, + 0.6662600375711918, + 0.38998107239603996, + 1.1096806395798922, + 2.183806836605072, + 1.3434905968606472, + 1.3178067337721586, + 0.26019036769866943, + 0.3435482829809189, + 0.5019194893538952, + 0.03005523607134819, + 0.09240692667663097, + 0.4253168050199747, + 0.24468664452433586, + 0.5502620860934258, + 0.27268941700458527, + 1.2170715127140284, + 1.2255576737225056, + 0.47877494618296623, + 1.106582660228014, + 0.6471691764891148, + 1.0073762815445662, + 0.3982209134846926, + 0.11774758249521255, + 0.2782858591526747, + 0.06800922006368637, + 0.18873822689056396, + 0.07225221395492554, + 1.5438973754644394, + 0.2720513083040714, + 0.06369318813085556, + 0.49847166053950787, + 0.6855019796639681, + 0.1578178908675909, + 2.0259875543415546, + 1.1786230728030205, + 0.5655816541984677, + 0.11531728319823742, + 0.11394423618912697, + 1.0089102126657963, + 0.24871687591075897, + 0.6166943907737732, + 0.17245080322027206, + 0.3566584177315235, + 0.6093905195593834, + 0.07766737043857574 + ], + "unique_experts": 64, + "load_cv": 0.7635201130048658, + "normalized_load_entropy": 0.9314150165038528, + "max_load_share": 0.05277777777777778 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "7a3b68d133b0a46e6000e4171f8f9dff44a1e083befa814068550613009861ae", + "route_weight_sha256": "ae6349229a32b27812582cfd20dfac07034e57c10693319f69f1dbd61c66a965", + "loads": [ + 29, + 4, + 16, + 25, + 15, + 6, + 38, + 2, + 16, + 9, + 6, + 19, + 21, + 17, + 9, + 28, + 2, + 1, + 41, + 11, + 6, + 18, + 16, + 32, + 32, + 6, + 9, + 8, + 1, + 3, + 16, + 7, + 13, + 9, + 15, + 24, + 14, + 28, + 9, + 30, + 18, + 4, + 12, + 2, + 7, + 1, + 30, + 4, + 5, + 23, + 20, + 5, + 24, + 28, + 13, + 3, + 4, + 12, + 4, + 9, + 4, + 13, + 11, + 3 + ], + "weighted_loads": [ + 3.71901261433959, + 0.18935593217611313, + 1.2409447021782398, + 1.3308234326541424, + 2.0998858362436295, + 0.25838824175298214, + 4.824892856180668, + 0.08592306822538376, + 0.833729300647974, + 0.4107197429984808, + 0.2905659954994917, + 0.8790676537901163, + 1.097682572901249, + 3.884608317166567, + 0.9439773764461279, + 1.075339226052165, + 0.11082948744297028, + 0.03080967254936695, + 2.786007361486554, + 0.6662600375711918, + 0.38998107239603996, + 1.1620991211384535, + 2.183806836605072, + 1.3919860646128654, + 1.3178067337721586, + 0.26019036769866943, + 0.3936239778995514, + 0.5019194893538952, + 0.03005523607134819, + 0.09240692667663097, + 0.6759632583707571, + 0.24468664452433586, + 0.5502620860934258, + 0.3382297456264496, + 1.2170715127140284, + 1.4296685978770256, + 0.47877494618296623, + 1.231974359601736, + 0.6471691764891148, + 1.2246933225542307, + 0.7526694405823946, + 0.18167250603437424, + 0.4356417804956436, + 0.06800922006368637, + 0.18873822689056396, + 0.07225221395492554, + 3.0157633274793625, + 0.2720513083040714, + 0.2070960160344839, + 0.973507896065712, + 0.7505457755178213, + 0.31244695000350475, + 2.63284083455801, + 1.6830751225352287, + 0.5655816541984677, + 0.11531728319823742, + 0.33708691969513893, + 1.0089102126657963, + 0.2775398902595043, + 0.7206238135695457, + 0.17245080322027206, + 0.48482757434248924, + 0.6093905195593834, + 0.1699950061738491 + ], + "unique_experts": 64, + "load_cv": 0.7397263940560403, + "normalized_load_entropy": 0.9343028286720101, + "max_load_share": 0.047126436781609195 + } + }, + "s1_bos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "c42786453df6ddc97f2c99e472a54cf0a5466e3f0268b80c4858a7c30372d6e7", + "route_weight_sha256": "96c6a8ab5980e1012a7412b178276283c2ea4ab8accdb1ec1f5781bdd6afecd0", + "loads": [ + 23, + 2, + 3, + 23, + 14, + 4, + 37, + 2, + 9, + 9, + 7, + 14, + 21, + 17, + 5, + 20, + 2, + 1, + 22, + 10, + 6, + 15, + 15, + 34, + 29, + 7, + 11, + 8, + 2, + 4, + 9, + 6, + 16, + 4, + 14, + 21, + 11, + 22, + 11, + 28, + 12, + 3, + 12, + 2, + 7, + 1, + 20, + 4, + 3, + 13, + 17, + 3, + 15, + 22, + 12, + 3, + 3, + 12, + 3, + 8, + 5, + 9, + 11, + 2 + ], + "weighted_loads": [ + 3.3365308698266745, + 0.07420780882239342, + 0.14522378891706467, + 1.1964843198657036, + 2.263347629457712, + 0.19802111014723778, + 4.544631848111749, + 0.08595663495361805, + 0.40293218195438385, + 0.4259483180940151, + 0.27318483497947454, + 0.5719986297190189, + 0.9321062304079533, + 3.864056565798819, + 0.23751648515462875, + 0.8137879520654678, + 0.10723762214183807, + 0.031658295542001724, + 1.756099872291088, + 0.6387803219258785, + 0.3903775215148926, + 1.1338588893413544, + 2.176889492198825, + 1.499402318149805, + 1.1857749186456203, + 0.2730199247598648, + 0.49477339908480644, + 0.5091739781200886, + 0.06857673078775406, + 0.11885030381381512, + 0.4076595399528742, + 0.19317015632987022, + 0.6608301997184753, + 0.1428222768008709, + 1.1947802416980267, + 1.1973512805998325, + 0.38494445476680994, + 1.0136832557618618, + 0.7639882452785969, + 1.0474434345960617, + 0.412649791687727, + 0.10900544747710228, + 0.398760624229908, + 0.07328920811414719, + 0.19435611180961132, + 0.066648468375206, + 1.5292630773037672, + 0.2779541593044996, + 0.10865103080868721, + 0.5555870793759823, + 0.6585803050547838, + 0.15549134649336338, + 2.0088476426899433, + 1.147112499922514, + 0.525812404230237, + 0.12273220904171467, + 0.10726232826709747, + 0.873086653649807, + 0.2637833505868912, + 0.6099054291844368, + 0.2087633330374956, + 0.3516468796879053, + 0.6185015216469765, + 0.11171112954616547 + ], + "unique_experts": 64, + "load_cv": 0.7488262420219665, + "normalized_load_entropy": 0.9343187114886344, + "max_load_share": 0.05138888888888889 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "2fd3d79939b0623ee3ede5415971d75ffed586b3398efe0b9e999b6a21c6877c", + "route_weight_sha256": "617a9a05100065e826c9957abed3ac412e8b891beb3d3b4e2917197f0b191b18", + "loads": [ + 30, + 5, + 14, + 23, + 15, + 7, + 38, + 4, + 19, + 10, + 7, + 18, + 21, + 18, + 14, + 24, + 2, + 10, + 45, + 11, + 6, + 17, + 16, + 34, + 29, + 7, + 11, + 8, + 2, + 5, + 19, + 8, + 17, + 5, + 18, + 34, + 11, + 30, + 12, + 31, + 18, + 4, + 16, + 7, + 7, + 1, + 39, + 7, + 6, + 27, + 20, + 6, + 24, + 34, + 14, + 4, + 5, + 17, + 5, + 12, + 6, + 13, + 11, + 8 + ], + "weighted_loads": [ + 3.7404216658324003, + 0.21115392819046974, + 1.140202671289444, + 1.1964843198657036, + 2.3019893653690815, + 0.2848647143691778, + 4.574360152706504, + 0.15436562150716782, + 1.2417171224951744, + 0.4631878286600113, + 0.27318483497947454, + 0.9194291792809963, + 0.9321062304079533, + 3.9055639477446675, + 1.3182948008179665, + 0.9362716265022755, + 0.10723762214183807, + 0.6033485289663076, + 3.607433995231986, + 0.77379135414958, + 0.3903775215148926, + 1.185214577242732, + 2.2101729046553373, + 1.499402318149805, + 1.1857749186456203, + 0.2730199247598648, + 0.49477339908480644, + 0.5091739781200886, + 0.06857673078775406, + 0.15557619743049145, + 0.9599939975887537, + 0.4369551055133343, + 0.7178446725010872, + 0.2216559536755085, + 1.62043983861804, + 2.4058392085134983, + 0.38494445476680994, + 1.3189171627163887, + 0.8003130033612251, + 1.1236764695495367, + 0.6549666207283735, + 0.15814179554581642, + 0.5482083447277546, + 0.5368460491299629, + 0.19435611180961132, + 0.066648468375206, + 4.236686499789357, + 0.4304839875549078, + 0.20640800148248672, + 1.161249190568924, + 0.7609359566122293, + 0.3449405264109373, + 2.598904153332114, + 1.8690752647817135, + 0.6459847074002028, + 0.15790380723774433, + 0.3682006560266018, + 1.1036956794559956, + 0.5980775915086269, + 0.9550367593765259, + 0.23696105554699898, + 0.4999516364187002, + 0.6185015216469765, + 0.3365685697644949 + ], + "unique_experts": 64, + "load_cv": 0.6875919471991867, + "normalized_load_entropy": 0.945420180887681, + "max_load_share": 0.046583850931677016 + } + }, + "s0_x": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "802f8cec7465c21610e22a762573fc8bb2bd237cfbf3e7d6ee6a2f61e7a59b64", + "route_weight_sha256": "e5aab473db49d73a76d361106859351ef8583116c37f6c885a40ac0ba8479eb5", + "loads": [ + 23, + 3, + 4, + 25, + 15, + 3, + 39, + 2, + 8, + 8, + 7, + 15, + 19, + 16, + 5, + 22, + 3, + 1, + 23, + 10, + 6, + 19, + 16, + 29, + 28, + 7, + 9, + 9, + 1, + 3, + 9, + 8, + 11, + 6, + 16, + 22, + 13, + 21, + 9, + 25, + 9, + 4, + 9, + 3, + 5, + 1, + 22, + 4, + 5, + 13, + 17, + 4, + 15, + 23, + 12, + 2, + 3, + 12, + 3, + 7, + 6, + 10, + 11, + 2 + ], + "weighted_loads": [ + 3.4231051877141, + 0.1042543463408947, + 0.1755297463387251, + 1.3144437223672867, + 1.9056673012673855, + 0.1764870397746563, + 5.13878457993269, + 0.07986507378518581, + 0.41242411360144615, + 0.37433057837188244, + 0.2948582097887993, + 0.6011491045355797, + 0.8154464978724718, + 3.9010360101237893, + 0.2443332877010107, + 0.8803258314728737, + 0.14167146757245064, + 0.035346563905477524, + 1.7310263961553574, + 0.6426164470613003, + 0.4064291939139366, + 1.379193127155304, + 2.2222803365439177, + 1.2820552214980125, + 1.1389419194310904, + 0.28797220438718796, + 0.38411133736371994, + 0.5290811061859131, + 0.031884048134088516, + 0.09439874812960625, + 0.35632009617984295, + 0.2654725592583418, + 0.4910975247621536, + 0.21534699760377407, + 1.2631065268069506, + 1.304144898429513, + 0.4482927583158016, + 0.9499097280204296, + 0.6405659392476082, + 0.9522444289177656, + 0.31465044245123863, + 0.15528689697384834, + 0.301227705553174, + 0.10367236658930779, + 0.15018786117434502, + 0.07936648279428482, + 1.7100462727248669, + 0.2873466294258833, + 0.16463573276996613, + 0.5153097128495574, + 0.6588170733302832, + 0.19220810756087303, + 2.0608243718743324, + 1.3255719188600779, + 0.5486533232033253, + 0.08042400889098644, + 0.11699897050857544, + 1.0272536389529705, + 0.24971510842442513, + 0.5781849399209023, + 0.253189779818058, + 0.4019307419657707, + 0.5845574513077736, + 0.09981954656541348 + ], + "unique_experts": 64, + "load_cv": 0.7410369778014696, + "normalized_load_entropy": 0.9359603647630952, + "max_load_share": 0.05416666666666667 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "2074d126fb0ff7b635f64c1751ceb676a845330596651eb2fe7ccac903570edb", + "route_weight_sha256": "76e5eef3e43e832e96307917f236b03253512acd2000bb721b5d641bbbebe926", + "loads": [ + 30, + 4, + 16, + 25, + 15, + 5, + 39, + 2, + 16, + 8, + 7, + 19, + 20, + 16, + 10, + 26, + 3, + 1, + 42, + 10, + 6, + 21, + 16, + 29, + 28, + 7, + 9, + 9, + 1, + 3, + 16, + 8, + 12, + 7, + 16, + 26, + 13, + 25, + 9, + 27, + 15, + 4, + 11, + 3, + 5, + 1, + 30, + 4, + 9, + 24, + 19, + 7, + 25, + 31, + 12, + 2, + 4, + 12, + 6, + 8, + 7, + 13, + 11, + 5 + ], + "weighted_loads": [ + 3.839188851416111, + 0.1767616830766201, + 1.3614404518157244, + 1.3144437223672867, + 1.9056673012673855, + 0.22331534512341022, + 5.13878457993269, + 0.07986507378518581, + 0.8805140294134617, + 0.37433057837188244, + 0.2948582097887993, + 0.9682936519384384, + 0.8614113572984934, + 3.9010360101237893, + 1.133995272219181, + 1.0058402735739946, + 0.14167146757245064, + 0.035346563905477524, + 2.920301169157028, + 0.6426164470613003, + 0.4064291939139366, + 1.4411987382918596, + 2.2222803365439177, + 1.2820552214980125, + 1.1389419194310904, + 0.28797220438718796, + 0.38411133736371994, + 0.5290811061859131, + 0.031884048134088516, + 0.09439874812960625, + 0.6175869982689619, + 0.2654725592583418, + 0.5203027781099081, + 0.2614676933735609, + 1.2631065268069506, + 1.4934693332761526, + 0.4482927583158016, + 1.070926770567894, + 0.6405659392476082, + 0.9998505469411612, + 0.5789200365543365, + 0.15528689697384834, + 0.35744718089699745, + 0.10367236658930779, + 0.15018786117434502, + 0.07936648279428482, + 3.230614271014929, + 0.2873466294258833, + 0.3484696876257658, + 1.0025440184399486, + 0.723214527592063, + 0.38377581909298897, + 2.7652009911835194, + 1.8880009483546019, + 0.5486533232033253, + 0.08042400889098644, + 0.3401416540145874, + 1.0272536389529705, + 0.37847037240862846, + 0.6153568848967552, + 0.2820683363825083, + 0.49303556606173515, + 0.5845574513077736, + 0.27271738834679127 + ], + "unique_experts": 64, + "load_cv": 0.7209709986326325, + "normalized_load_entropy": 0.9384304651030803, + "max_load_share": 0.04827586206896552 + } + }, + "s1_x": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "c86a349c710e7434c9bd941893c732fdbcecac5307ef73d2c7fb9762576b8b41", + "route_weight_sha256": "bec72c1c9a67357550214e8e355317204a3e72b40ce9db88c29a4b4d6ace022b", + "loads": [ + 22, + 2, + 4, + 25, + 15, + 4, + 38, + 2, + 11, + 8, + 7, + 11, + 25, + 17, + 4, + 16, + 2, + 1, + 22, + 10, + 6, + 19, + 15, + 32, + 30, + 4, + 12, + 9, + 1, + 1, + 9, + 8, + 9, + 6, + 14, + 23, + 12, + 19, + 10, + 24, + 11, + 3, + 11, + 5, + 7, + 1, + 21, + 4, + 8, + 11, + 18, + 5, + 15, + 22, + 11, + 3, + 4, + 12, + 3, + 7, + 7, + 10, + 11, + 1 + ], + "weighted_loads": [ + 3.226093541830778, + 0.0692785307765007, + 0.17168090865015984, + 1.1642731055617332, + 2.1720661967992783, + 0.17728622257709503, + 4.5909996051341295, + 0.08460518345236778, + 0.5318617690354586, + 0.379409346729517, + 0.27814603224396706, + 0.458791583776474, + 1.0592501424252987, + 3.799917459487915, + 0.2004137486219406, + 0.6384025383740664, + 0.10826743021607399, + 0.04201849550008774, + 1.7666978184133768, + 0.6208491679280996, + 0.3771604336798191, + 1.3684272076934576, + 2.183246873319149, + 1.3932103849947453, + 1.1881072903051972, + 0.16426423750817776, + 0.5070081762969494, + 0.5488408096134663, + 0.03445190191268921, + 0.03371644392609596, + 0.36328280717134476, + 0.2628473713994026, + 0.38543829694390297, + 0.20779568329453468, + 1.1839776039123535, + 1.2575474008917809, + 0.42057276982814074, + 0.8578807972371578, + 0.6989036612212658, + 0.9054025802761316, + 0.36749680899083614, + 0.11349419131875038, + 0.3961281590163708, + 0.18075627461075783, + 0.1915706992149353, + 0.06446783989667892, + 1.6074367873370647, + 0.27966331131756306, + 0.32920191437005997, + 0.45985051058232784, + 0.6690355334430933, + 0.2241827677935362, + 2.009600307792425, + 1.124047277495265, + 0.5165381263941526, + 0.12487772107124329, + 0.1487381048500538, + 0.800058513879776, + 0.2969329096376896, + 0.5098265893757343, + 0.31560782343149185, + 0.3718771543353796, + 0.6031646430492401, + 0.07376518845558167 + ], + "unique_experts": 64, + "load_cv": 0.7412035591181296, + "normalized_load_entropy": 0.935602160971526, + "max_load_share": 0.05277777777777778 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "306e6c198ac20ebe7d810131cf424ab95c105f2602089b5f95c97e6a58afe405", + "route_weight_sha256": "d54b869e8d1903b054c41fa0377b34208456288539e8ee23bf7333f40df93c30", + "loads": [ + 31, + 5, + 17, + 25, + 16, + 8, + 39, + 4, + 22, + 9, + 7, + 15, + 26, + 18, + 13, + 19, + 2, + 10, + 46, + 11, + 6, + 23, + 16, + 32, + 30, + 4, + 12, + 9, + 1, + 2, + 18, + 10, + 11, + 7, + 18, + 35, + 12, + 26, + 11, + 26, + 15, + 3, + 13, + 11, + 7, + 1, + 39, + 7, + 12, + 23, + 20, + 11, + 25, + 34, + 13, + 4, + 6, + 17, + 5, + 9, + 7, + 13, + 11, + 8 + ], + "weighted_loads": [ + 3.7906639613211155, + 0.20622465014457703, + 1.319849956780672, + 1.1642731055617332, + 2.2107079327106476, + 0.29993158020079136, + 4.620727909728885, + 0.15301417000591755, + 1.4106269720941782, + 0.41664885729551315, + 0.27814603224396706, + 0.7756147906184196, + 1.0973872914910316, + 3.8414248414337635, + 1.1545436531305313, + 0.7259394396096468, + 0.10826743021607399, + 0.6137087289243937, + 3.732519667595625, + 0.7558602001518011, + 0.3771604336798191, + 1.4899077378213406, + 2.2165302857756615, + 1.3932103849947453, + 1.1881072903051972, + 0.16426423750817776, + 0.5070081762969494, + 0.5488408096134663, + 0.03445190191268921, + 0.0704423375427723, + 0.840611606836319, + 0.5066323205828667, + 0.47839900478720665, + 0.2866293601691723, + 1.609637200832367, + 2.4381170384585857, + 0.42057276982814074, + 1.1397471874952316, + 0.735228419303894, + 0.953160684555769, + 0.5065604615956545, + 0.11349419131875038, + 0.4508366957306862, + 0.6926129423081875, + 0.1915706992149353, + 0.06446783989667892, + 4.220310837030411, + 0.43219313956797123, + 0.46624308824539185, + 0.9707211162894964, + 0.726733023300767, + 0.5844272468239069, + 2.675508363172412, + 1.8129485491663218, + 0.6367104295641184, + 0.16004931926727295, + 0.4096764326095581, + 1.0306675396859646, + 0.6312271505594254, + 0.6896544583141804, + 0.31560782343149185, + 0.4756027963012457, + 0.6031646430492401, + 0.36343262158334255 + ], + "unique_experts": 64, + "load_cv": 0.6816815382700019, + "normalized_load_entropy": 0.9459115060485984, + "max_load_share": 0.047619047619047616 + } + }, + "s0_period": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "9d92a68857a06eec11365bc10d5f9a6e512651e2ba5aed194efdccf53748d86b", + "route_weight_sha256": "368aec7350aca6b40191861ee72bd8896769e28b0b9c97e111fc790ac0a502dd", + "loads": [ + 22, + 2, + 3, + 24, + 15, + 3, + 39, + 2, + 10, + 8, + 7, + 14, + 17, + 16, + 4, + 22, + 4, + 1, + 24, + 10, + 6, + 18, + 16, + 31, + 31, + 8, + 8, + 9, + 2, + 3, + 9, + 7, + 11, + 5, + 15, + 21, + 12, + 22, + 9, + 24, + 13, + 3, + 12, + 2, + 6, + 1, + 23, + 4, + 4, + 11, + 16, + 4, + 15, + 25, + 14, + 2, + 3, + 12, + 3, + 6, + 5, + 9, + 11, + 2 + ], + "weighted_loads": [ + 3.408408284187317, + 0.0720067247748375, + 0.1430540569126606, + 1.2530952282249928, + 1.8816035017371178, + 0.16743409261107445, + 5.156449435278773, + 0.07984266988933086, + 0.47351385839283466, + 0.3758298493921757, + 0.31506337970495224, + 0.5762606933712959, + 0.7295345328748226, + 3.867340420372784, + 0.21739445626735687, + 0.8754160758107901, + 0.17503469809889793, + 0.03301272168755531, + 1.7834088373929262, + 0.6404070369899273, + 0.39106547459959984, + 1.3788034431636333, + 2.200000301003456, + 1.344250151887536, + 1.292647611349821, + 0.3203952480107546, + 0.33345625922083855, + 0.5314421616494656, + 0.06610418483614922, + 0.09055688232183456, + 0.35327207297086716, + 0.23869759030640125, + 0.4777126666158438, + 0.177801251411438, + 1.2362982742488384, + 1.232332605868578, + 0.4290401628240943, + 0.9995874017477036, + 0.6153031885623932, + 0.8978512994945049, + 0.4450455792248249, + 0.11565666273236275, + 0.3740631891414523, + 0.07190001383423805, + 0.17065266519784927, + 0.07627291232347488, + 1.7411081809550524, + 0.29280101507902145, + 0.15073467791080475, + 0.4548463439568877, + 0.6345446370542049, + 0.1883189007639885, + 2.0617205761373043, + 1.3748392462730408, + 0.5957281105220318, + 0.07428744807839394, + 0.11351985111832619, + 0.9967423342168331, + 0.23777562007308006, + 0.5216396041214466, + 0.22145196050405502, + 0.36460108309984207, + 0.5876105725765228, + 0.10168305970728397 + ], + "unique_experts": 64, + "load_cv": 0.7586537784494028, + "normalized_load_entropy": 0.9332413621588845, + "max_load_share": 0.05416666666666667 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "e1db50fb77077cc63b9a593cd5e73e88b4e6a00ee06bc1cfc48128c1ef7f5fae", + "route_weight_sha256": "960479bd5df29f2101fc810e243dce73ddd9f8b99752d946316e141c9726ce28", + "loads": [ + 29, + 3, + 14, + 24, + 15, + 5, + 39, + 2, + 18, + 8, + 7, + 18, + 17, + 16, + 9, + 28, + 4, + 1, + 44, + 10, + 6, + 21, + 16, + 31, + 31, + 8, + 8, + 9, + 2, + 3, + 15, + 8, + 12, + 6, + 15, + 24, + 12, + 26, + 9, + 26, + 19, + 3, + 14, + 2, + 6, + 1, + 32, + 4, + 7, + 22, + 19, + 6, + 25, + 34, + 14, + 2, + 4, + 13, + 5, + 7, + 5, + 12, + 11, + 4 + ], + "weighted_loads": [ + 3.8307204991579056, + 0.1445140615105629, + 1.160658411681652, + 1.2530952282249928, + 1.8816035017371178, + 0.21426239795982838, + 5.156449435278773, + 0.07984266988933086, + 0.9416037742048502, + 0.3758298493921757, + 0.31506337970495224, + 0.9382669255137444, + 0.7295345328748226, + 3.867340420372784, + 1.2062069792300463, + 1.074640516191721, + 0.17503469809889793, + 0.03301272168755531, + 3.034017449244857, + 0.6404070369899273, + 0.39106547459959984, + 1.4688774701207876, + 2.200000301003456, + 1.344250151887536, + 1.292647611349821, + 0.3203952480107546, + 0.33345625922083855, + 0.5314421616494656, + 0.06610418483614922, + 0.09055688232183456, + 0.5787179917097092, + 0.26591678708791733, + 0.5046317055821419, + 0.21767886728048325, + 1.2362982742488384, + 1.3854475356638432, + 0.4290401628240943, + 1.1201672945171595, + 0.6153031885623932, + 0.9454574175179005, + 0.7206110320985317, + 0.11565666273236275, + 0.43028266448527575, + 0.07190001383423805, + 0.17065266519784927, + 0.07627291232347488, + 3.435012901201844, + 0.29280101507902145, + 0.2941375058144331, + 0.9347231825813651, + 0.7348559126257896, + 0.3449617996811867, + 2.74253648519516, + 2.009109642356634, + 0.5957281105220318, + 0.07428744807839394, + 0.33666253462433815, + 1.0492454282939434, + 0.30282046645879745, + 0.5588115490972996, + 0.22145196050405502, + 0.45567597448825836, + 0.5876105725765228, + 0.19401069544255733 + ], + "unique_experts": 64, + "load_cv": 0.7493794499768207, + "normalized_load_entropy": 0.9344196887343768, + "max_load_share": 0.05057471264367816 + } + }, + "s1_period": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "d0de901bbd0efa222861dcf38372d3f1f70eb5e7d7a3ed158c9734dc62fd8fe3", + "route_weight_sha256": "a90a626aa34c8c90e52a3a70ed3a82ac5b0bbf216436636b26e1728398d2f1ea", + "loads": [ + 22, + 4, + 3, + 26, + 15, + 4, + 38, + 2, + 9, + 8, + 8, + 14, + 21, + 17, + 4, + 18, + 3, + 1, + 23, + 10, + 6, + 21, + 15, + 34, + 29, + 4, + 9, + 9, + 1, + 1, + 8, + 8, + 8, + 7, + 14, + 26, + 9, + 21, + 9, + 18, + 9, + 4, + 12, + 4, + 7, + 1, + 21, + 4, + 9, + 10, + 18, + 4, + 15, + 24, + 10, + 3, + 4, + 12, + 3, + 6, + 7, + 14, + 11, + 1 + ], + "weighted_loads": [ + 3.271227292716503, + 0.13236336968839169, + 0.13898360170423985, + 1.1847921796143055, + 2.0406065098941326, + 0.18632999435067177, + 4.634432235732675, + 0.08672134764492512, + 0.47304124012589455, + 0.3948099613189697, + 0.28425732534378767, + 0.5624597948044538, + 0.9353270567953587, + 3.820731271058321, + 0.19259090721607208, + 0.7229706533253193, + 0.14556081220507622, + 0.040488749742507935, + 1.8549850918352604, + 0.6285762079060078, + 0.36578348837792873, + 1.4965306483209133, + 2.1888915598392487, + 1.4342633988708258, + 1.1490294896066189, + 0.18301991000771523, + 0.3817037120461464, + 0.5527924820780754, + 0.03441223129630089, + 0.035031210631132126, + 0.320981340482831, + 0.2672063820064068, + 0.36849305406212807, + 0.23545770347118378, + 1.1771198399364948, + 1.312807634472847, + 0.3337822565808892, + 0.9355945251882076, + 0.6524605788290501, + 0.6901231333613396, + 0.31327773444354534, + 0.14869556948542595, + 0.43420420587062836, + 0.14968324825167656, + 0.1934883464127779, + 0.0654492974281311, + 1.610080774873495, + 0.2757857218384743, + 0.3636170458048582, + 0.441726453602314, + 0.6586240977048874, + 0.19833417609333992, + 2.068302385509014, + 1.2199690230190754, + 0.4815087132155895, + 0.12040848471224308, + 0.15282630547881126, + 0.8206972740590572, + 0.2815649062395096, + 0.48212237283587456, + 0.3201552592217922, + 0.5274773482233286, + 0.6020992808043957, + 0.0723637267947197 + ], + "unique_experts": 64, + "load_cv": 0.7514594852849297, + "normalized_load_entropy": 0.9348288027462133, + "max_load_share": 0.05277777777777778 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "8fc1c86632291d1b7b040b7150c46027bb5674c7baae1c52d036476adb8abe11", + "route_weight_sha256": "75f57de5cc1d590bd3b7a013b871dee7bae957559a94b447e86d72d00f57b814", + "loads": [ + 29, + 7, + 14, + 26, + 16, + 7, + 39, + 4, + 19, + 10, + 8, + 18, + 22, + 18, + 13, + 22, + 3, + 10, + 46, + 11, + 6, + 24, + 16, + 34, + 29, + 4, + 9, + 9, + 1, + 2, + 17, + 10, + 9, + 8, + 18, + 39, + 9, + 28, + 10, + 21, + 13, + 4, + 14, + 10, + 7, + 1, + 40, + 7, + 12, + 24, + 20, + 11, + 25, + 37, + 12, + 4, + 6, + 18, + 5, + 8, + 7, + 17, + 11, + 8 + ], + "weighted_loads": [ + 3.675118088722229, + 0.269309489056468, + 1.1339624840766191, + 1.1847921796143055, + 2.079248245805502, + 0.2731735985726118, + 4.66416054032743, + 0.15513033419847488, + 1.311826180666685, + 0.47932132333517075, + 0.28425732534378767, + 0.9030087348073721, + 0.9689669162034988, + 3.8622386530041695, + 1.2988385111093521, + 0.8423653412610292, + 0.14556081220507622, + 0.6121789831668139, + 3.7332120928913355, + 0.7635872401297092, + 0.36578348837792873, + 1.5978637915104628, + 2.222174972295761, + 1.4342633988708258, + 1.1490294896066189, + 0.18301991000771523, + 0.3817037120461464, + 0.5527924820780754, + 0.03441223129630089, + 0.07175710424780846, + 0.7877154964953661, + 0.5109913311898708, + 0.4255075268447399, + 0.3142913803458214, + 1.6027794368565083, + 2.5220652744174004, + 0.3337822565808892, + 1.213440366089344, + 0.6887853369116783, + 0.7645436301827431, + 0.46086148358881474, + 0.14869556948542595, + 0.48891274258494377, + 0.6402098871767521, + 0.1934883464127779, + 0.0654492974281311, + 4.322199992835522, + 0.42831555008888245, + 0.4613740164786577, + 1.0255896896123886, + 0.7217926345765591, + 0.6054124757647514, + 2.712906716391444, + 1.9550034254789352, + 0.6016810163855553, + 0.15558008290827274, + 0.4137646332383156, + 1.1136198937892914, + 0.6158591471612453, + 0.6619502417743206, + 0.3201552592217922, + 0.6359789576381445, + 0.6020992808043957, + 0.3294471222907305 + ], + "unique_experts": 64, + "load_cv": 0.6958216051186416, + "normalized_load_entropy": 0.9450232318082175, + "max_load_share": 0.047619047619047616 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 120, + "ordered_topk_exact_tokens": 51, + "set_exact_tokens": 60, + "mean_set_jaccard": 0.8410714285714286, + "mean_token_weighted_tv": 0.031264806798814486, + "aggregate_load_tv": 0.048611111111111105 + }, + "system_bos": { + "tokens": 120, + "ordered_topk_exact_tokens": 51, + "set_exact_tokens": 70, + "mean_set_jaccard": 0.8630952380952382, + "mean_token_weighted_tv": 0.030502361105754973, + "aggregate_load_tv": 0.045833333333333344 + }, + "system_x": { + "tokens": 120, + "ordered_topk_exact_tokens": 40, + "set_exact_tokens": 62, + "mean_set_jaccard": 0.8298412698412698, + "mean_token_weighted_tv": 0.04220429133468618, + "aggregate_load_tv": 0.05138888888888888 + }, + "system_period": { + "tokens": 120, + "ordered_topk_exact_tokens": 38, + "set_exact_tokens": 54, + "mean_set_jaccard": 0.8097222222222222, + "mean_token_weighted_tv": 0.04234418883764495, + "aggregate_load_tv": 0.06388888888888888 + }, + "bos_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 40, + "set_exact_tokens": 54, + "mean_set_jaccard": 0.8222222222222223, + "mean_token_weighted_tv": 0.03640634337983405, + "aggregate_load_tv": 0.05694444444444445 + }, + "bos_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 36, + "set_exact_tokens": 48, + "mean_set_jaccard": 0.8043650793650794, + "mean_token_weighted_tv": 0.03744130844715983, + "aggregate_load_tv": 0.05416666666666667 + }, + "x_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 33, + "set_exact_tokens": 52, + "mean_set_jaccard": 0.8148809523809525, + "mean_token_weighted_tv": 0.039962233315842845, + "aggregate_load_tv": 0.05 + }, + "x_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 31, + "set_exact_tokens": 48, + "mean_set_jaccard": 0.7936507936507937, + "mean_token_weighted_tv": 0.04457060838661467, + "aggregate_load_tv": 0.05555555555555555 + }, + "period_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 37, + "set_exact_tokens": 48, + "mean_set_jaccard": 0.8007936507936508, + "mean_token_weighted_tv": 0.04243848260181646, + "aggregate_load_tv": 0.061111111111111116 + }, + "period_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 30, + "set_exact_tokens": 45, + "mean_set_jaccard": 0.7794444444444444, + "mean_token_weighted_tv": 0.04847136823227629, + "aggregate_load_tv": 0.0736111111111111 + } + } + }, + "layer_19": { + "layer": 19, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "0a89838a6e8d0a73445aab942147c6b4ce3c47058b447185fce87338c4599dc9", + "route_weight_sha256": "02a9fb3be0c634e5fb26aec280522edb2843eca2f891cda3748bd82b305ee176", + "loads": [ + 9, + 18, + 21, + 16, + 11, + 9, + 10, + 8, + 1, + 27, + 21, + 15, + 13, + 15, + 8, + 23, + 4, + 13, + 14, + 16, + 4, + 2, + 8, + 5, + 5, + 6, + 12, + 5, + 20, + 11, + 5, + 15, + 19, + 0, + 21, + 21, + 16, + 15, + 5, + 8, + 14, + 9, + 4, + 4, + 16, + 16, + 5, + 6, + 10, + 2, + 14, + 9, + 4, + 30, + 21, + 8, + 2, + 5, + 6, + 2, + 25, + 6, + 13, + 14 + ], + "weighted_loads": [ + 0.3219405338168144, + 0.9421676564961672, + 0.7394840344786644, + 3.3504149578511715, + 0.7984423991292715, + 1.4974811673164368, + 0.46958984434604645, + 0.9223534241318703, + 0.04711252078413963, + 1.2958571463823318, + 0.7602732442319393, + 0.8030887842178345, + 0.7495476193726063, + 0.6279137283563614, + 0.27450719475746155, + 0.9133241679519415, + 0.16182973608374596, + 2.2211004681885242, + 0.4853784032166004, + 1.4363540057092905, + 0.29922767356038094, + 0.14404083788394928, + 0.2621261142194271, + 0.20577162876725197, + 0.2929293215274811, + 0.1520475409924984, + 1.3338590562343597, + 0.18264099396765232, + 0.9009461626410484, + 0.5826302859932184, + 0.18205245956778526, + 2.2711366340517998, + 1.251305403187871, + 0.0, + 1.8467048238962889, + 0.7939573880285025, + 0.8838213067501783, + 0.5253273136913776, + 0.4300251938402653, + 0.2496358435600996, + 0.5478749815374613, + 0.49612509086728096, + 0.1579349935054779, + 0.16271710768342018, + 1.344525357708335, + 0.6491985004395247, + 0.1716259066015482, + 0.3772985190153122, + 0.3761143945157528, + 0.20332038030028343, + 0.5161838103085756, + 0.2953225038945675, + 0.16000333800911903, + 2.458581741899252, + 1.1588260643184185, + 0.3257213607430458, + 0.04264160431921482, + 0.2768993526697159, + 0.33781730756163597, + 0.08061532117426395, + 1.0139461010694504, + 0.2332387249916792, + 0.7981773614883423, + 0.7234768476337194 + ], + "unique_experts": 63, + "load_cv": 0.6176418715416576, + "normalized_load_entropy": 0.9518690055185557, + "max_load_share": 0.041666666666666664 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "5a65de2da90c667aafda2d946dffb10d3f29ea98bd162a4f0e73705f7fd0b723", + "route_weight_sha256": "fc225319809ecc11ed80cb8174873d350461f238c048a5d6a17c2f68e87e9621", + "loads": [ + 11, + 19, + 24, + 16, + 16, + 10, + 20, + 8, + 1, + 31, + 21, + 16, + 20, + 18, + 12, + 23, + 7, + 13, + 14, + 23, + 4, + 2, + 13, + 14, + 13, + 6, + 12, + 7, + 20, + 16, + 13, + 15, + 20, + 0, + 21, + 22, + 18, + 22, + 6, + 9, + 18, + 13, + 12, + 5, + 17, + 16, + 5, + 9, + 11, + 2, + 14, + 9, + 4, + 32, + 27, + 8, + 2, + 5, + 12, + 2, + 27, + 10, + 20, + 14 + ], + "weighted_loads": [ + 0.36451805010437965, + 1.0282230768352747, + 0.8362005855888128, + 3.3504149578511715, + 1.5576231833547354, + 1.510655683465302, + 0.8801952116191387, + 0.9223534241318703, + 0.04711252078413963, + 1.5107044763863087, + 0.7602732442319393, + 0.8339045252650976, + 1.2288242653012276, + 0.7585539259016514, + 0.5181613769382238, + 0.9133241679519415, + 0.27297303080558777, + 2.2211004681885242, + 0.4853784032166004, + 1.7836801577359438, + 0.29922767356038094, + 0.14404083788394928, + 0.4441746175289154, + 0.5176620567217469, + 0.7611445742659271, + 0.1520475409924984, + 1.3338590562343597, + 0.2764300461858511, + 0.9009461626410484, + 0.7984317485243082, + 0.4711014926433563, + 2.2711366340517998, + 1.29041494615376, + 0.0, + 1.8467048238962889, + 0.85190718062222, + 0.9269273199606687, + 0.8662818260490894, + 0.473151009529829, + 0.2830283772200346, + 0.6565708830021322, + 0.8463409803807735, + 0.7663277238607407, + 0.21887043491005898, + 1.3552353084087372, + 0.6491985004395247, + 0.1716259066015482, + 0.6133431009948254, + 0.41409940645098686, + 0.20332038030028343, + 0.5161838103085756, + 0.2953225038945675, + 0.16000333800911903, + 2.6706197820603848, + 2.900185588747263, + 0.3257213607430458, + 0.04264160431921482, + 0.2768993526697159, + 0.590030625462532, + 0.08061532117426395, + 1.0906648971140385, + 0.4525549467653036, + 1.3307540342211723, + 0.7234768476337194 + ], + "unique_experts": 63, + "load_cv": 0.5470636494447397, + "normalized_load_entropy": 0.9595795518074662, + "max_load_share": 0.0367816091954023 + } + }, + "s1_eos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "bd359857974970dbe6d694de4de2d42420d901c34416bcb6f3f902faee1b4e0e", + "route_weight_sha256": "95a1f975c668b29dbe55b0efd5a32fbd2a620e0738fe36212a9fadc60bdb7043", + "loads": [ + 9, + 17, + 18, + 15, + 11, + 9, + 11, + 8, + 1, + 24, + 25, + 19, + 15, + 14, + 6, + 18, + 5, + 13, + 14, + 13, + 4, + 2, + 11, + 6, + 4, + 6, + 14, + 4, + 22, + 10, + 5, + 15, + 18, + 1, + 21, + 16, + 14, + 15, + 4, + 9, + 13, + 10, + 5, + 4, + 14, + 16, + 5, + 5, + 9, + 2, + 15, + 11, + 2, + 33, + 22, + 10, + 3, + 6, + 6, + 2, + 27, + 6, + 13, + 15 + ], + "weighted_loads": [ + 0.3154977597296238, + 0.8760762996971607, + 0.6601401586085558, + 3.2761328145861626, + 0.7820766679942608, + 1.5623520761728287, + 0.496663436293602, + 0.8824515417218208, + 0.04400377720594406, + 1.176257111132145, + 0.8956989198923111, + 0.94864621758461, + 0.807494992390275, + 0.5604174379259348, + 0.21622061170637608, + 0.7394816819578409, + 0.2004130743443966, + 2.7893457040190697, + 0.46792760491371155, + 1.3333305567502975, + 0.2941441647708416, + 0.1432286985218525, + 0.34475090354681015, + 0.2197132706642151, + 0.22510669752955437, + 0.1406238442286849, + 1.5906020067632198, + 0.15280377492308617, + 0.9672607071697712, + 0.5597987826913595, + 0.18011468648910522, + 2.2599263712763786, + 1.238511849194765, + 0.03185206279158592, + 1.8638878799974918, + 0.6494195591658354, + 0.8084057047963142, + 0.5160276740789413, + 0.40955720096826553, + 0.2415743349120021, + 0.521309008821845, + 0.5750128906220198, + 0.19806703180074692, + 0.14081192202866077, + 1.1607436966151, + 0.6421965938061476, + 0.17052247375249863, + 0.3473762534558773, + 0.3354285452514887, + 0.20038270205259323, + 0.548203619197011, + 0.36386884562671185, + 0.10252949222922325, + 2.26492459513247, + 1.2091791369020939, + 0.3912102784961462, + 0.07674027048051357, + 0.31877264380455017, + 0.3421233706176281, + 0.08478692546486855, + 1.1059462446719408, + 0.22138439863920212, + 0.7946858145296574, + 0.7558905277401209 + ], + "unique_experts": 64, + "load_cv": 0.617441955086658, + "normalized_load_entropy": 0.9529895648968643, + "max_load_share": 0.04583333333333333 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "ae4aae70b84646811fbb0fd61db1fa896de779b6e3007bf594939a98fd1664cb", + "route_weight_sha256": "3452a3c650ab9be386c55b03573add94d6df8ad07f5a025a4e27cbb12520adce", + "loads": [ + 12, + 21, + 20, + 15, + 23, + 11, + 25, + 8, + 1, + 29, + 26, + 26, + 26, + 16, + 16, + 20, + 7, + 18, + 15, + 23, + 7, + 3, + 18, + 13, + 16, + 6, + 14, + 6, + 23, + 12, + 10, + 15, + 21, + 1, + 21, + 16, + 18, + 19, + 5, + 12, + 18, + 19, + 14, + 4, + 15, + 16, + 5, + 15, + 10, + 3, + 20, + 11, + 5, + 44, + 27, + 10, + 5, + 8, + 15, + 4, + 30, + 15, + 22, + 17 + ], + "weighted_loads": [ + 0.3747180551290512, + 1.1471212208271027, + 0.7191254626959562, + 3.2761328145861626, + 2.1841845270246267, + 1.6514003546908498, + 1.1457422599196434, + 0.8824515417218208, + 0.04400377720594406, + 1.414842002093792, + 0.9617756232619286, + 1.671113908290863, + 1.4419527295976877, + 0.6291763000190258, + 0.8568718396127224, + 0.8474503289908171, + 0.5553135797381401, + 3.009529085829854, + 0.5657501742243767, + 1.859931230545044, + 0.5979742668569088, + 0.19709427282214165, + 0.621521444991231, + 0.4470957377925515, + 0.9842409649863839, + 0.1406238442286849, + 1.5906020067632198, + 0.2651320733129978, + 1.0064394734799862, + 0.6403577532619238, + 0.35560560412704945, + 2.2599263712763786, + 1.357386775314808, + 0.03185206279158592, + 1.8638878799974918, + 0.6494195591658354, + 0.9372025728225708, + 0.7047981936484575, + 0.45688172429800034, + 0.37634245958179235, + 0.6617414047941566, + 1.1467288825660944, + 0.9032593704760075, + 0.14081192202866077, + 1.1714536473155022, + 0.6421965938061476, + 0.17052247375249863, + 0.9933370985090733, + 0.3702352475374937, + 0.2458888329565525, + 0.8812576439231634, + 0.36386884562671185, + 0.24617082811892033, + 3.150418298318982, + 2.920571055263281, + 0.3912102784961462, + 0.1570552233606577, + 0.40810366719961166, + 0.7950597703456879, + 0.1490795537829399, + 1.2217924427241087, + 0.6096391566097736, + 1.5130769684910774, + 0.9203345533460379 + ], + "unique_experts": 64, + "load_cv": 0.5379478049333554, + "normalized_load_entropy": 0.9630583122625739, + "max_load_share": 0.045548654244306416 + } + }, + "s0_bos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "82c5939fa81e39c235e0ba96c0b7a29b7920b9bd3f826588cba891cd5106229a", + "route_weight_sha256": "cf1fd5b7097213085eb3110b7f26f4317b91b2028a95476add6eee15ecd20cce", + "loads": [ + 7, + 20, + 15, + 16, + 12, + 9, + 10, + 8, + 1, + 27, + 20, + 17, + 14, + 15, + 7, + 20, + 5, + 12, + 13, + 16, + 6, + 2, + 10, + 7, + 5, + 5, + 13, + 4, + 18, + 11, + 6, + 15, + 19, + 1, + 22, + 24, + 17, + 16, + 4, + 9, + 11, + 7, + 5, + 6, + 12, + 18, + 5, + 6, + 8, + 3, + 12, + 9, + 3, + 29, + 19, + 12, + 3, + 6, + 7, + 3, + 25, + 5, + 13, + 15 + ], + "weighted_loads": [ + 0.22297011129558086, + 1.0520674921572208, + 0.6109194625169039, + 3.4638867117464542, + 0.8139769341796637, + 1.500560749322176, + 0.448676822707057, + 0.9475132972002029, + 0.04270649701356888, + 1.326610542833805, + 0.7633811812847853, + 0.849054666236043, + 0.7858944348990917, + 0.6567998472601175, + 0.23300492577254772, + 0.7954909894615412, + 0.19288860820233822, + 2.4649326652288437, + 0.4459151066839695, + 1.4408562034368515, + 0.37758599780499935, + 0.15425004810094833, + 0.32233448699116707, + 0.24101450573652983, + 0.30746329203248024, + 0.1488491240888834, + 1.5395538471639156, + 0.137550450861454, + 0.8293935470283031, + 0.587162321433425, + 0.21999209374189377, + 2.3159599527716637, + 1.2535662185400724, + 0.03371751308441162, + 1.9825491961091757, + 0.9050645474344492, + 0.9064041506499052, + 0.6063026860356331, + 0.4508192427456379, + 0.26077207922935486, + 0.4448643010109663, + 0.458448376506567, + 0.1995873637497425, + 0.2788705490529537, + 1.4347335435450077, + 0.7496519573032856, + 0.1756721492856741, + 0.3624801244586706, + 0.306526405736804, + 0.24355116486549377, + 0.45197533443570137, + 0.2787594087421894, + 0.13517480716109276, + 2.5843310207128525, + 1.0406435746699572, + 0.4762195535004139, + 0.07951348274946213, + 0.3231331668794155, + 0.3894830197095871, + 0.10892365500330925, + 1.0027207173407078, + 0.20846922881901264, + 0.7472255434840918, + 0.7499102726578712 + ], + "unique_experts": 64, + "load_cv": 0.5937950762616617, + "normalized_load_entropy": 0.9567247276199765, + "max_load_share": 0.04027777777777778 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "efe7265e4937ab6dd2817ae3b345030f17e6a51097091102eae34acc4af8f550", + "route_weight_sha256": "549f4c846f2b70f872f05b576fe9b6b9a10aafc2c50424c6efc4702dad600d87", + "loads": [ + 9, + 21, + 16, + 16, + 16, + 10, + 18, + 8, + 1, + 30, + 21, + 18, + 22, + 20, + 11, + 20, + 8, + 13, + 13, + 23, + 6, + 2, + 15, + 13, + 13, + 5, + 14, + 7, + 18, + 16, + 14, + 15, + 20, + 1, + 22, + 26, + 17, + 24, + 5, + 9, + 14, + 11, + 14, + 7, + 13, + 19, + 5, + 9, + 11, + 3, + 12, + 10, + 3, + 31, + 24, + 12, + 4, + 6, + 13, + 3, + 27, + 8, + 20, + 15 + ], + "weighted_loads": [ + 0.2943203393369913, + 1.1381229124963284, + 0.6354924365878105, + 3.4638867117464542, + 1.4577834140509367, + 1.5137352654710412, + 0.7902145627886057, + 0.9475132972002029, + 0.04270649701356888, + 1.4940412491559982, + 0.8041961211711168, + 0.8798704072833061, + 1.29046999104321, + 0.8715614918619394, + 0.48855028860270977, + 0.7954909894615412, + 0.30403190292418003, + 3.219834491610527, + 0.4459151066839695, + 1.9597505442798138, + 0.37758599780499935, + 0.15425004810094833, + 0.5043829903006554, + 0.466391178779304, + 0.824129730463028, + 0.1488491240888834, + 1.57288421317935, + 0.30523235723376274, + 0.8293935470283031, + 0.7924191188067198, + 0.5147896818816662, + 2.3159599527716637, + 1.287029193714261, + 0.03371751308441162, + 1.9825491961091757, + 0.9818311147391796, + 0.9064041506499052, + 0.962610125541687, + 0.49394505843520164, + 0.26077207922935486, + 0.5452623292803764, + 0.7502022907137871, + 0.8391812574118376, + 0.3350238762795925, + 1.44544349424541, + 0.7746247127652168, + 0.1756721492856741, + 0.5945957023650408, + 0.4253871273249388, + 0.24355116486549377, + 0.45197533443570137, + 0.29419427644461393, + 0.13517480716109276, + 2.7722051218152046, + 1.8383915964514017, + 0.4762195535004139, + 0.11043834127485752, + 0.3231331668794155, + 0.6416963376104832, + 0.10892365500330925, + 1.079115729779005, + 0.39118816144764423, + 1.2798022162169218, + 0.7499102726578712 + ], + "unique_experts": 64, + "load_cv": 0.5257838645447541, + "normalized_load_entropy": 0.9637583744875349, + "max_load_share": 0.035632183908045977 + } + }, + "s1_bos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "e76b38be14159c2ceedc309a62b15c358bab2f1cf04e92f9c416c83ae6a8d7eb", + "route_weight_sha256": "2662dadbeaab085a4deb99152319208e8fb5d8a4c3241b837a14f05d857e722b", + "loads": [ + 6, + 19, + 18, + 16, + 10, + 9, + 11, + 8, + 1, + 26, + 19, + 17, + 14, + 16, + 8, + 19, + 5, + 12, + 10, + 16, + 4, + 2, + 9, + 7, + 4, + 7, + 12, + 3, + 18, + 7, + 5, + 15, + 18, + 0, + 23, + 26, + 16, + 18, + 6, + 9, + 10, + 10, + 4, + 6, + 14, + 18, + 6, + 5, + 8, + 3, + 12, + 8, + 3, + 32, + 22, + 14, + 4, + 6, + 8, + 2, + 24, + 4, + 13, + 15 + ], + "weighted_loads": [ + 0.21585243195295334, + 0.9719377961009741, + 0.6658118087798357, + 3.3662182111293077, + 0.7795867715030909, + 1.5557151958346367, + 0.46650955080986023, + 0.9295425992459059, + 0.04245677590370178, + 1.2709866017103195, + 0.7043321076780558, + 0.8757320046424866, + 0.7744626328349113, + 0.6567402873188257, + 0.27370964735746384, + 0.77603704854846, + 0.19838242419064045, + 2.7625164054334164, + 0.3376715648919344, + 1.4365314785391092, + 0.30877212807536125, + 0.15579911321401596, + 0.28137989714741707, + 0.25409541465342045, + 0.258746437728405, + 0.18946936167776585, + 1.7458385452628136, + 0.10359197109937668, + 0.818976417183876, + 0.45648398622870445, + 0.18433190509676933, + 2.2730710357427597, + 1.2378826513886452, + 0.0, + 1.9078424256294966, + 1.0054769348353148, + 0.8725071605294943, + 0.6923086494207382, + 0.5096345599740744, + 0.2495469469577074, + 0.41893566958606243, + 0.5497337970882654, + 0.1623336225748062, + 0.26125925965607166, + 1.4024877157062292, + 0.7297755889594555, + 0.2003590650856495, + 0.3364771455526352, + 0.3041079733520746, + 0.24166443943977356, + 0.4476487897336483, + 0.2588795395568013, + 0.1329108625650406, + 2.364265440031886, + 1.2019153889268637, + 0.5249269567430019, + 0.1053368840366602, + 0.32244834676384926, + 0.3966846242547035, + 0.08270759880542755, + 0.9842924531549215, + 0.15742737613618374, + 0.7731231022626162, + 0.7450353186577559 + ], + "unique_experts": 63, + "load_cv": 0.6208317797643996, + "normalized_load_entropy": 0.95236460805312, + "max_load_share": 0.044444444444444446 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "50b1295c0b6d7c310de5613026510de54e4b8af41dfdbead4142fe8a43c3070b", + "route_weight_sha256": "17b6211c629182104e3c396526fec8d19ba89e44378a93adb34fb96e5cc66a04", + "loads": [ + 7, + 23, + 22, + 16, + 22, + 11, + 22, + 8, + 1, + 33, + 20, + 24, + 25, + 20, + 18, + 21, + 7, + 17, + 11, + 27, + 7, + 3, + 16, + 12, + 15, + 7, + 12, + 5, + 19, + 10, + 12, + 15, + 21, + 0, + 23, + 28, + 19, + 21, + 7, + 12, + 14, + 19, + 13, + 6, + 15, + 18, + 6, + 15, + 9, + 4, + 17, + 8, + 6, + 43, + 26, + 14, + 6, + 8, + 18, + 4, + 26, + 13, + 22, + 17 + ], + "weighted_loads": [ + 0.23724133148789406, + 1.242982717230916, + 0.7904283460229635, + 3.3662182111293077, + 2.2430282719433308, + 1.6447634743526578, + 1.0218241065740585, + 0.9295425992459059, + 0.04245677590370178, + 1.6094700954854488, + 0.7704088110476732, + 1.5981996953487396, + 1.408920370042324, + 0.8039097189903259, + 0.9262860771268606, + 0.8840056955814362, + 0.553282929584384, + 2.9826997872442007, + 0.4354941342025995, + 2.192284731194377, + 0.6126022301614285, + 0.20966468751430511, + 0.5581504385918379, + 0.43121036514639854, + 1.0934080090373755, + 0.18946936167776585, + 1.7458385452628136, + 0.2314661666750908, + 0.858155183494091, + 0.5678686685860157, + 0.44378617219626904, + 2.2730710357427597, + 1.3597072139382362, + 0.0, + 1.9078424256294966, + 1.1050284299999475, + 0.9973880629986525, + 0.8550263047218323, + 0.5569590833038092, + 0.3942603524774313, + 0.5448875464498997, + 1.090696094557643, + 0.8675259612500668, + 0.26125925965607166, + 1.4131976664066315, + 0.7297755889594555, + 0.2003590650856495, + 0.9628707617521286, + 0.33891467563807964, + 0.28717057034373283, + 0.7807028144598007, + 0.2588795395568013, + 0.27655219845473766, + 3.1751782167702913, + 1.9717257004231215, + 0.5249269567430019, + 0.1856518369168043, + 0.41177937015891075, + 0.8919960781931877, + 0.14700022712349892, + 1.0656381901353598, + 0.5440958775579929, + 1.4915142562240362, + 0.9094793442636728 + ], + "unique_experts": 63, + "load_cv": 0.5399838363695857, + "normalized_load_entropy": 0.9626806908019142, + "max_load_share": 0.044513457556935816 + } + }, + "s0_x": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "c61ada1fca5a982a04a96a8c61bb7c3eed136d5b5548d467abff4b12b77bf630", + "route_weight_sha256": "bb797b35b87b1077a1df2177dd9c1745b26c0e3d25d78645e044638bdbcc1034", + "loads": [ + 6, + 20, + 14, + 16, + 11, + 9, + 10, + 8, + 1, + 26, + 19, + 17, + 14, + 14, + 9, + 21, + 4, + 12, + 11, + 15, + 6, + 2, + 11, + 7, + 4, + 7, + 13, + 3, + 20, + 12, + 3, + 15, + 19, + 0, + 22, + 26, + 17, + 16, + 6, + 7, + 14, + 6, + 5, + 4, + 14, + 17, + 6, + 9, + 8, + 3, + 10, + 10, + 5, + 30, + 19, + 11, + 1, + 4, + 10, + 2, + 25, + 7, + 14, + 13 + ], + "weighted_loads": [ + 0.2031293399631977, + 1.1012303791940212, + 0.5685070119798183, + 3.4198712073266506, + 0.8673081435263157, + 1.468906618654728, + 0.45109304040670395, + 0.952856320887804, + 0.04222476854920387, + 1.3000062014907598, + 0.6994323339313269, + 0.8606427609920502, + 0.8283768985420465, + 0.62408715672791, + 0.31031749583780766, + 0.8384310752153397, + 0.15677943639457226, + 1.9419357925653458, + 0.3902358990162611, + 1.4910916574299335, + 0.35667135566473007, + 0.1480441950261593, + 0.3531130328774452, + 0.2576940804719925, + 0.19106308929622173, + 0.21338574960827827, + 1.3266166672110558, + 0.09765112400054932, + 0.8739696778357029, + 0.6265562064945698, + 0.11949669197201729, + 2.331689417362213, + 1.2669121846556664, + 0.0, + 2.029608704149723, + 0.9991436041891575, + 0.930322676897049, + 0.5674948859959841, + 0.5108425971120596, + 0.2366793304681778, + 0.5404369309544563, + 0.3842354156076908, + 0.18949324265122414, + 0.17287038639187813, + 1.490907408297062, + 0.7426672168076038, + 0.21297212317585945, + 0.48652103170752525, + 0.307742714881897, + 0.24972057901322842, + 0.3959651105105877, + 0.3467116244137287, + 0.1810206137597561, + 2.6198895424604416, + 1.1060515381395817, + 0.45854389667510986, + 0.029507270082831383, + 0.2542671449482441, + 0.5060105249285698, + 0.07462138682603836, + 1.06479661911726, + 0.2916997130960226, + 0.8064977303147316, + 0.6609299294650555 + ], + "unique_experts": 63, + "load_cv": 0.608377725422392, + "normalized_load_entropy": 0.9530089288398897, + "max_load_share": 0.041666666666666664 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "cbaa13b9e8d9cd32be068c520aa4f3b609b22589ca620ccb8b603c3399a767ca", + "route_weight_sha256": "7854ff8fbbeee5b7b2ef015ad568d34bd7be14aeba32bf123d6feeead698d0a9", + "loads": [ + 9, + 21, + 15, + 16, + 16, + 11, + 19, + 8, + 1, + 29, + 19, + 18, + 23, + 17, + 14, + 21, + 7, + 12, + 11, + 21, + 6, + 2, + 17, + 14, + 10, + 7, + 13, + 5, + 20, + 17, + 9, + 15, + 20, + 0, + 23, + 27, + 17, + 23, + 7, + 9, + 18, + 9, + 14, + 6, + 15, + 17, + 6, + 14, + 9, + 3, + 10, + 10, + 5, + 33, + 24, + 11, + 2, + 4, + 17, + 2, + 26, + 11, + 22, + 13 + ], + "weighted_loads": [ + 0.3168141022324562, + 1.1872857995331287, + 0.593079986050725, + 3.4198712073266506, + 1.6933535747230053, + 1.5653833420947194, + 0.8472403325140476, + 0.952856320887804, + 0.04222476854920387, + 1.4662725422531366, + 0.6994323339313269, + 0.8914585020393133, + 1.47961556725204, + 0.747798902913928, + 0.6116579342633486, + 0.8384310752153397, + 0.26792273111641407, + 1.9419357925653458, + 0.3902358990162611, + 1.7790604084730148, + 0.35667135566473007, + 0.1480441950261593, + 0.5863359048962593, + 0.5173553302884102, + 0.5222437027841806, + 0.21338574960827827, + 1.3266166672110558, + 0.19958869740366936, + 0.8739696778357029, + 0.8360493257641792, + 0.32991473004221916, + 2.331689417362213, + 1.3081867881119251, + 0.0, + 2.073216989636421, + 1.057093396782875, + 0.930322676897049, + 0.837196359410882, + 0.5539684128016233, + 0.30314377322793007, + 0.6941964421421289, + 0.6553814895451069, + 0.9383646734058857, + 0.2690776474773884, + 1.5016173589974642, + 0.7426672168076038, + 0.21297212317585945, + 0.8355943113565445, + 0.34572772681713104, + 0.24972057901322842, + 0.3959651105105877, + 0.3467116244137287, + 0.1810206137597561, + 2.839012410491705, + 1.9037995599210262, + 0.45854389667510986, + 0.06654280237853527, + 0.2542671449482441, + 0.8053014539182186, + 0.07462138682603836, + 1.0999184176325798, + 0.5033406484872103, + 1.3869463168084621, + 0.6609299294650555 + ], + "unique_experts": 63, + "load_cv": 0.5386526253649236, + "normalized_load_entropy": 0.9611001619616726, + "max_load_share": 0.03793103448275862 + } + }, + "s1_x": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "a49bae868c6d7a6d233f3396e936466464c5cc76f06917f5b1987c0691ba7909", + "route_weight_sha256": "44c4a2284bbdd18767bc1e144f4d95addba87054259d092129a66bd5e6e6c812", + "loads": [ + 10, + 18, + 18, + 15, + 10, + 9, + 9, + 7, + 1, + 26, + 19, + 12, + 16, + 15, + 8, + 17, + 4, + 12, + 9, + 17, + 4, + 2, + 11, + 7, + 3, + 8, + 13, + 3, + 22, + 8, + 5, + 15, + 19, + 0, + 22, + 23, + 17, + 18, + 6, + 10, + 8, + 12, + 5, + 4, + 13, + 17, + 6, + 8, + 11, + 3, + 14, + 11, + 3, + 28, + 22, + 11, + 2, + 5, + 9, + 2, + 27, + 8, + 13, + 10 + ], + "weighted_loads": [ + 0.3617715109139681, + 0.869675051420927, + 0.6838808804750443, + 3.1463260650634766, + 0.8331184946000576, + 1.5797859467566013, + 0.417454419657588, + 0.8765666149556637, + 0.04019922390580177, + 1.2030571550130844, + 0.6878529321402311, + 0.6691694296896458, + 0.8020533565431833, + 0.5913332402706146, + 0.29737390764057636, + 0.7153485547751188, + 0.148012051358819, + 2.1040432043373585, + 0.29765327647328377, + 1.4991776645183563, + 0.3027109131217003, + 0.1509639024734497, + 0.34072355926036835, + 0.2574726864695549, + 0.1444865744560957, + 0.24279999732971191, + 1.5099721513688564, + 0.10418940708041191, + 0.9453207906335592, + 0.500114943832159, + 0.18053099885582924, + 2.223955951631069, + 1.2815332897007465, + 0.0, + 1.9353856015950441, + 0.8615938071161509, + 0.9093111623078585, + 0.6420016046613455, + 0.47729119658470154, + 0.3419609274715185, + 0.35437879525125027, + 0.6252639815211296, + 0.18041281402111053, + 0.14836492389440536, + 1.2286127544939518, + 0.7389037907123566, + 0.2101474180817604, + 0.469375092536211, + 0.4156584572046995, + 0.23628240264952183, + 0.5221865996718407, + 0.3875362668186426, + 0.1227814182639122, + 1.9320399276912212, + 1.2364982850849628, + 0.43773203156888485, + 0.05716082267463207, + 0.28615688532590866, + 0.42734505608677864, + 0.08229260891675949, + 1.1246812641620636, + 0.26325172558426857, + 0.7754930555820465, + 0.61397310718894 + ], + "unique_experts": 63, + "load_cv": 0.6004113816047243, + "normalized_load_entropy": 0.9542029086886565, + "max_load_share": 0.03888888888888889 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "7b83cc0c0169d725866347ec85149fad71a7659aab70aa41a56484d6ef2b32f9", + "route_weight_sha256": "562277c13b376786b98ac6933cece9da0c17f20f00cba5a3daaf08dbecd6b529", + "loads": [ + 12, + 23, + 21, + 15, + 22, + 12, + 20, + 7, + 1, + 31, + 20, + 19, + 29, + 17, + 19, + 19, + 6, + 18, + 10, + 25, + 7, + 3, + 20, + 12, + 12, + 8, + 13, + 5, + 23, + 10, + 10, + 15, + 23, + 0, + 22, + 23, + 20, + 20, + 7, + 12, + 11, + 21, + 16, + 5, + 14, + 17, + 6, + 20, + 12, + 4, + 19, + 11, + 6, + 39, + 26, + 11, + 4, + 7, + 19, + 4, + 29, + 19, + 23, + 12 + ], + "weighted_loads": [ + 0.4206301439553499, + 1.1865352354943752, + 0.7782212868332863, + 3.1463260650634766, + 2.188541939482093, + 1.712579251267016, + 0.9372680690139532, + 0.8765666149556637, + 0.04019922390580177, + 1.4595847874879837, + 0.7539296355098486, + 1.3916371203958988, + 1.5753991808742285, + 0.6549924556165934, + 1.0020780116319656, + 0.823317201808095, + 0.5029125567525625, + 2.3604460190981627, + 0.3954758457839489, + 1.899524874985218, + 0.6065410152077675, + 0.20482947677373886, + 0.6863475199788809, + 0.434587636962533, + 0.7558786049485207, + 0.24279999732971191, + 1.5099721513688564, + 0.24278144165873528, + 0.9844995569437742, + 0.582429364323616, + 0.3558564353734255, + 2.223955951631069, + 1.4449074566364288, + 0.0, + 1.9353856015950441, + 0.8615938071161509, + 1.0341920647770166, + 0.7381589654833078, + 0.5246157199144363, + 0.44327941350638866, + 0.44445547834038734, + 1.1090296283364296, + 1.1034940648823977, + 0.1849183775484562, + 1.239322705194354, + 0.7389037907123566, + 0.2101474180817604, + 1.2407693974673748, + 0.45046515949070454, + 0.2817885335534811, + 0.8552406243979931, + 0.3875362668186426, + 0.2664227541536093, + 2.762636099010706, + 2.0063085965812206, + 0.43773203156888485, + 0.1374757755547762, + 0.37548790872097015, + 0.9126971177756786, + 0.14658523723483086, + 1.2024877145886421, + 0.7632379122078419, + 1.5839566998183727, + 0.778417132794857 + ], + "unique_experts": 63, + "load_cv": 0.5280396140928509, + "normalized_load_entropy": 0.9631552380049541, + "max_load_share": 0.040372670807453416 + } + }, + "s0_period": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "9dd2a141b51b3560c441e543041ff4a08ca61dcb7e11be9a2a7bdc484c81830a", + "route_weight_sha256": "560e27ea81918187832ca05e4efc097542d21376f7cbb03601016c18923920ee", + "loads": [ + 6, + 19, + 14, + 16, + 10, + 9, + 7, + 8, + 1, + 25, + 22, + 18, + 13, + 14, + 10, + 23, + 4, + 12, + 11, + 15, + 6, + 2, + 8, + 7, + 3, + 7, + 12, + 3, + 19, + 11, + 3, + 15, + 20, + 0, + 22, + 26, + 17, + 16, + 6, + 6, + 11, + 9, + 4, + 5, + 15, + 19, + 5, + 8, + 9, + 3, + 13, + 11, + 4, + 28, + 19, + 13, + 0, + 5, + 9, + 2, + 26, + 9, + 13, + 14 + ], + "weighted_loads": [ + 0.20435143820941448, + 1.060489570721984, + 0.5639428086578846, + 3.4304630272090435, + 0.8190005235373974, + 1.489775512367487, + 0.35106347873806953, + 0.9575042091310024, + 0.04168751463294029, + 1.2710396591573954, + 0.8303029257804155, + 0.905578950420022, + 0.783906351774931, + 0.6177330762147903, + 0.3439915422350168, + 0.9216080848127604, + 0.14915171451866627, + 1.883980493992567, + 0.3799810912460089, + 1.5318071134388447, + 0.3659783024340868, + 0.15041068568825722, + 0.2638842221349478, + 0.24714233726263046, + 0.15343398973345757, + 0.2204504795372486, + 1.3544938825070858, + 0.10103301331400871, + 0.8270681872963905, + 0.5965463183820248, + 0.12306150794029236, + 2.3223481625318527, + 1.2899328339844942, + 0.0, + 2.026902474462986, + 1.014067942276597, + 0.9304983727633953, + 0.5655355658382177, + 0.5072156954556704, + 0.2024996131658554, + 0.4264016877859831, + 0.5156962461769581, + 0.16644656285643578, + 0.19004273787140846, + 1.5127266887575388, + 0.7954156026244164, + 0.18474585562944412, + 0.441028218716383, + 0.341189619153738, + 0.24708909727633, + 0.48205474577844143, + 0.38391862250864506, + 0.16263580322265625, + 2.4449392091482878, + 1.109669929370284, + 0.509301895275712, + 0.0, + 0.2903602607548237, + 0.45183708891272545, + 0.08115001395344734, + 1.054735160432756, + 0.3465223703533411, + 0.7738670706748962, + 0.6994963195174932 + ], + "unique_experts": 62, + "load_cv": 0.6180415104521503, + "normalized_load_entropy": 0.9506024032665272, + "max_load_share": 0.03888888888888889 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "1e48a2f77d4f8625abf2cfb6c5083f5b18ae4c1c20a160d6c1a4ea58dd0ee6b5", + "route_weight_sha256": "87585268de3c2131555d881470ed6069617eb90f6eb106571f016cf2c2add378", + "loads": [ + 9, + 20, + 16, + 16, + 15, + 11, + 15, + 8, + 1, + 28, + 22, + 19, + 21, + 16, + 15, + 23, + 8, + 12, + 12, + 21, + 6, + 2, + 13, + 14, + 10, + 7, + 12, + 5, + 19, + 17, + 10, + 15, + 21, + 0, + 23, + 27, + 18, + 23, + 7, + 6, + 15, + 12, + 12, + 6, + 16, + 19, + 5, + 13, + 10, + 3, + 13, + 11, + 4, + 31, + 24, + 13, + 1, + 5, + 15, + 2, + 28, + 14, + 21, + 14 + ], + "weighted_loads": [ + 0.32307211868464947, + 1.1465449910610914, + 0.6195754669606686, + 3.4304630272090435, + 1.6722782589495182, + 1.5758628034964204, + 0.6926012188196182, + 0.9575042091310024, + 0.04168751463294029, + 1.4504944924265146, + 0.8303029257804155, + 0.9363946914672852, + 1.328608714044094, + 0.6965816207230091, + 0.6533731836825609, + 0.9216080848127604, + 0.2890818063169718, + 1.883980493992567, + 0.42181761004030704, + 1.8320252597332, + 0.3659783024340868, + 0.15041068568825722, + 0.4459327254444361, + 0.5034265406429768, + 0.5299354046583176, + 0.2204504795372486, + 1.3544938825070858, + 0.21016477048397064, + 0.8270681872963905, + 0.836792353540659, + 0.3861590661108494, + 2.3223481625318527, + 1.3315328154712915, + 0.0, + 2.092536933720112, + 1.0720177348703146, + 0.9805458299815655, + 0.853797497227788, + 0.5503415111452341, + 0.2024996131658554, + 0.572936151176691, + 0.7693770080804825, + 0.7748392932116985, + 0.24619606509804726, + 1.523436639457941, + 0.7954156026244164, + 0.18474585562944412, + 0.8348325192928314, + 0.3791746310889721, + 0.24708909727633, + 0.48205474577844143, + 0.38391862250864506, + 0.16263580322265625, + 2.6851290706545115, + 1.9074179511517286, + 0.509301895275712, + 0.0352831669151783, + 0.2903602607548237, + 0.7040504068136215, + 0.08115001395344734, + 1.1228324798867106, + 0.6521209813654423, + 1.3446708247065544, + 0.6994963195174932 + ], + "unique_experts": 63, + "load_cv": 0.5332887416951165, + "normalized_load_entropy": 0.9611419416647823, + "max_load_share": 0.035632183908045977 + } + }, + "s1_period": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "1f575561998f090bdfb9b5e5f5bd568d86e207f2ddb484573e20940e9b5a5117", + "route_weight_sha256": "6f49ca2c80d604ffa1b640fab717f26c3fdb2ddc2abdecbcf09af8de30197cf0", + "loads": [ + 9, + 18, + 21, + 16, + 10, + 9, + 9, + 8, + 1, + 29, + 21, + 14, + 15, + 13, + 8, + 18, + 4, + 12, + 5, + 19, + 4, + 2, + 10, + 7, + 3, + 7, + 13, + 4, + 17, + 10, + 5, + 15, + 20, + 1, + 22, + 25, + 17, + 21, + 5, + 10, + 10, + 10, + 5, + 5, + 11, + 17, + 6, + 8, + 10, + 2, + 15, + 9, + 3, + 27, + 21, + 13, + 3, + 4, + 8, + 2, + 24, + 6, + 13, + 11 + ], + "weighted_loads": [ + 0.31814187578856945, + 0.9146368727087975, + 0.7486314699053764, + 3.245294703170657, + 0.7788278665393591, + 1.5871253311634064, + 0.41734449937939644, + 0.9026447366923094, + 0.041241466999053955, + 1.3227979838848114, + 0.7897394951432943, + 0.7368852011859417, + 0.787276366725564, + 0.5264109689742327, + 0.29917432367801666, + 0.7659406065940857, + 0.15245990827679634, + 1.9604979418218136, + 0.17240474559366703, + 1.6426441054791212, + 0.30410774424672127, + 0.15115240961313248, + 0.3188589233905077, + 0.25965921580791473, + 0.16308108158409595, + 0.21567440778017044, + 1.5603473335504532, + 0.14068861864507198, + 0.8103272020816803, + 0.5631771702319384, + 0.17150881327688694, + 2.268065731972456, + 1.3305017743259668, + 0.03375696390867233, + 1.9552211668342352, + 0.9350710976868868, + 0.8984887320548296, + 0.7436702530831099, + 0.4450025614351034, + 0.34506737999618053, + 0.44417874328792095, + 0.557997465133667, + 0.18200339935719967, + 0.1898456234484911, + 1.1498214732855558, + 0.7314968444406986, + 0.21718296594917774, + 0.4772850535809994, + 0.38532098568975925, + 0.20887599140405655, + 0.5497645828872919, + 0.3257761597633362, + 0.12738302536308765, + 1.9844449870288372, + 1.1749885641038418, + 0.49233067221939564, + 0.08907081745564938, + 0.2521844431757927, + 0.3715961165726185, + 0.08550013601779938, + 1.0197098720818758, + 0.20708634704351425, + 0.7608505040407181, + 0.6218439191579819 + ], + "unique_experts": 64, + "load_cv": 0.6150378890265799, + "normalized_load_entropy": 0.9532396891858566, + "max_load_share": 0.04027777777777778 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "c821accb3df3b65eea0921619d3eb5859b89cdc9f576521fc4559e16b8bb90a0", + "route_weight_sha256": "254e0f91988f4fe7deb82ac72fb4df65e88b78b408fbd7a9be3e2fe97a0a128c", + "loads": [ + 11, + 22, + 24, + 16, + 22, + 12, + 19, + 8, + 1, + 34, + 22, + 21, + 27, + 15, + 20, + 20, + 6, + 17, + 6, + 28, + 7, + 3, + 17, + 12, + 11, + 7, + 13, + 6, + 18, + 12, + 10, + 15, + 23, + 1, + 24, + 26, + 20, + 23, + 6, + 13, + 13, + 19, + 15, + 6, + 12, + 17, + 6, + 21, + 11, + 3, + 20, + 9, + 6, + 39, + 25, + 13, + 5, + 6, + 17, + 4, + 27, + 18, + 23, + 13 + ], + "weighted_loads": [ + 0.3744745422154665, + 1.1856817938387394, + 0.8442567475140095, + 3.245294703170657, + 2.243271067738533, + 1.7189525002613664, + 0.9044141881167889, + 0.9026447366923094, + 0.041241466999053955, + 1.5813413560390472, + 0.8558161985129118, + 1.4593528918921947, + 1.472271366044879, + 0.5912609659135342, + 1.0328848119825125, + 0.8739092536270618, + 0.5073604136705399, + 2.180681323632598, + 0.27022731490433216, + 2.0940739158540964, + 0.6079378463327885, + 0.20501798391342163, + 0.5956294648349285, + 0.43677416630089283, + 0.7102176025509834, + 0.21567440778017044, + 1.5603473335504532, + 0.27643527649343014, + 0.8495059683918953, + 0.645354924723506, + 0.3443153463304043, + 2.268065731972456, + 1.462721886113286, + 0.03375696390867233, + 2.057779824361205, + 0.9736854862421751, + 1.0233696345239878, + 0.8299992475658655, + 0.4923270847648382, + 0.4861272517591715, + 0.5357483513653278, + 1.039192721247673, + 0.9209570903331041, + 0.22182207368314266, + 1.160531423985958, + 0.7314968444406986, + 0.21718296594917774, + 1.3612437509000301, + 0.4201276879757643, + 0.2543821223080158, + 0.8828186076134443, + 0.3257761597633362, + 0.27102436125278473, + 2.890459395945072, + 1.9447988756000996, + 0.49233067221939564, + 0.1693857703357935, + 0.3415154665708542, + 0.8245325163006783, + 0.14979276433587074, + 1.143888233229518, + 0.7369937039911747, + 1.522579774260521, + 0.7862879447638988 + ], + "unique_experts": 64, + "load_cv": 0.5396026656556683, + "normalized_load_entropy": 0.9625407184615924, + "max_load_share": 0.040372670807453416 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 120, + "ordered_topk_exact_tokens": 44, + "set_exact_tokens": 61, + "mean_set_jaccard": 0.8438492063492063, + "mean_token_weighted_tv": 0.03187139752165725, + "aggregate_load_tv": 0.05277777777777777 + }, + "system_bos": { + "tokens": 120, + "ordered_topk_exact_tokens": 41, + "set_exact_tokens": 58, + "mean_set_jaccard": 0.8331349206349207, + "mean_token_weighted_tv": 0.03457147028918068, + "aggregate_load_tv": 0.04305555555555555 + }, + "system_x": { + "tokens": 120, + "ordered_topk_exact_tokens": 28, + "set_exact_tokens": 41, + "mean_set_jaccard": 0.7755952380952382, + "mean_token_weighted_tv": 0.04781695002845178, + "aggregate_load_tv": 0.0625 + }, + "system_period": { + "tokens": 120, + "ordered_topk_exact_tokens": 25, + "set_exact_tokens": 43, + "mean_set_jaccard": 0.7753968253968255, + "mean_token_weighted_tv": 0.04606304873789971, + "aggregate_load_tv": 0.06805555555555555 + }, + "bos_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 39, + "set_exact_tokens": 56, + "mean_set_jaccard": 0.814484126984127, + "mean_token_weighted_tv": 0.03914875479337449, + "aggregate_load_tv": 0.05277777777777778 + }, + "bos_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 39, + "set_exact_tokens": 55, + "mean_set_jaccard": 0.8025793650793652, + "mean_token_weighted_tv": 0.03906126206663127, + "aggregate_load_tv": 0.06666666666666665 + }, + "x_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 35, + "set_exact_tokens": 48, + "mean_set_jaccard": 0.7878571428571429, + "mean_token_weighted_tv": 0.04421513562556356, + "aggregate_load_tv": 0.05972222222222222 + }, + "x_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 29, + "set_exact_tokens": 46, + "mean_set_jaccard": 0.7661507936507939, + "mean_token_weighted_tv": 0.04741109615812699, + "aggregate_load_tv": 0.06944444444444445 + }, + "period_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 36, + "set_exact_tokens": 54, + "mean_set_jaccard": 0.7969047619047619, + "mean_token_weighted_tv": 0.04314451829607909, + "aggregate_load_tv": 0.05972222222222221 + }, + "period_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 27, + "set_exact_tokens": 41, + "mean_set_jaccard": 0.7461111111111111, + "mean_token_weighted_tv": 0.05004551339273652, + "aggregate_load_tv": 0.07777777777777778 + } + } + }, + "layer_20": { + "layer": 20, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "e402bed3f602482db4cc31cd98ece75085071e271e5a9c95e151d7938f30cb30", + "route_weight_sha256": "4534ecd4b89ab22ffec836c4d2cffbbe0fd624692d4e119035721ec45a476d76", + "loads": [ + 12, + 5, + 17, + 4, + 19, + 18, + 15, + 11, + 11, + 4, + 24, + 16, + 22, + 5, + 18, + 4, + 6, + 3, + 8, + 15, + 3, + 10, + 12, + 8, + 4, + 27, + 5, + 2, + 1, + 12, + 5, + 14, + 8, + 9, + 21, + 10, + 8, + 8, + 3, + 1, + 25, + 32, + 8, + 8, + 7, + 15, + 13, + 8, + 9, + 10, + 30, + 6, + 9, + 28, + 11, + 13, + 8, + 29, + 3, + 1, + 13, + 5, + 9, + 12 + ], + "weighted_loads": [ + 0.4725622162222862, + 0.17216630838811398, + 1.1500850692391396, + 0.1462128348648548, + 0.8458541911095381, + 0.9266767557710409, + 2.274138316512108, + 0.4770274702459574, + 0.8861145451664925, + 0.3612458575516939, + 1.3297212664037943, + 2.2109147142618895, + 1.9889121111482382, + 0.35965390130877495, + 0.7289100270718336, + 0.16524210944771767, + 0.30413063429296017, + 0.3641381114721298, + 0.44938623160123825, + 1.2518736571073532, + 0.1017273236066103, + 0.5223299786448479, + 0.614781741052866, + 0.3451124504208565, + 0.22325201705098152, + 1.474340546876192, + 0.16995512507855892, + 0.15564027801156044, + 0.03162746876478195, + 0.4859314113855362, + 0.2249436341226101, + 0.4728258829563856, + 0.4468521624803543, + 0.4192518778145313, + 1.0089172404259443, + 0.44190999306738377, + 0.28488072752952576, + 0.32109845243394375, + 0.08537077903747559, + 0.03663903474807739, + 0.9661792367696762, + 1.4077021032571793, + 0.6780068650841713, + 0.38428945094347, + 0.40931393951177597, + 0.6408389564603567, + 0.6930407173931599, + 0.29057490453124046, + 0.32104920595884323, + 0.3301402349025011, + 3.154301807284355, + 0.23344380781054497, + 0.32330645993351936, + 1.163423227146268, + 0.4884920883923769, + 1.3842664323747158, + 0.44392628222703934, + 1.4130098819732666, + 0.10914250463247299, + 0.039896368980407715, + 0.8862022869288921, + 0.17263506539165974, + 0.3375289160758257, + 0.440971277654171 + ], + "unique_experts": 64, + "load_cv": 0.6784150009988332, + "normalized_load_entropy": 0.9470088280057752, + "max_load_share": 0.044444444444444446 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "637892e1b3bd5de244ac0064d0c739b0d6102f172981a466827f8d4c93076a3b", + "route_weight_sha256": "63ee3a3c26c5bcf363999820acf7f94fb782f90a3dbedcbdfb1cbfb80bdad817", + "loads": [ + 12, + 7, + 17, + 12, + 27, + 22, + 20, + 16, + 11, + 4, + 24, + 17, + 26, + 5, + 18, + 11, + 6, + 3, + 18, + 15, + 8, + 10, + 19, + 8, + 4, + 35, + 6, + 2, + 1, + 14, + 6, + 14, + 8, + 10, + 22, + 10, + 10, + 10, + 6, + 1, + 28, + 35, + 10, + 11, + 14, + 15, + 13, + 9, + 10, + 11, + 38, + 6, + 10, + 35, + 11, + 16, + 9, + 34, + 4, + 1, + 25, + 9, + 9, + 12 + ], + "weighted_loads": [ + 0.4725622162222862, + 0.21684868447482586, + 1.1500850692391396, + 0.7504349909722805, + 1.2374954763799906, + 1.1191756837069988, + 2.4252949748188257, + 0.7980954572558403, + 0.8861145451664925, + 0.3612458575516939, + 1.3297212664037943, + 2.2537981886416674, + 2.1154288854449987, + 0.35965390130877495, + 0.7289100270718336, + 0.5245181955397129, + 0.30413063429296017, + 0.3641381114721298, + 1.340877115726471, + 1.2518736571073532, + 0.25203805416822433, + 0.5223299786448479, + 1.0003379806876183, + 0.3451124504208565, + 0.22325201705098152, + 2.0048728734254837, + 0.18739653937518597, + 0.15564027801156044, + 0.03162746876478195, + 0.5502358991652727, + 0.2513487245887518, + 0.4728258829563856, + 0.4468521624803543, + 0.44230711832642555, + 1.0549175385385752, + 0.44190999306738377, + 0.3319764882326126, + 0.3803672734647989, + 1.4339900743216276, + 0.03663903474807739, + 1.1262307539582253, + 1.5177636221051216, + 0.8614431545138359, + 0.48112189990933985, + 0.6437320802360773, + 0.6408389564603567, + 0.6930407173931599, + 0.33599333465099335, + 0.32269194070249796, + 0.36391269601881504, + 4.167603243142366, + 0.23344380781054497, + 0.3583922013640404, + 1.5138127505779266, + 0.4884920883923769, + 1.770709440112114, + 0.5066501349210739, + 1.5708925612270832, + 0.1479690931737423, + 0.039896368980407715, + 2.1439845808781683, + 0.4029520396143198, + 0.3375289160758257, + 0.440971277654171 + ], + "unique_experts": 64, + "load_cv": 0.6620330450025788, + "normalized_load_entropy": 0.9495581167880681, + "max_load_share": 0.04367816091954023 + } + }, + "s1_eos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "571cbdab119045a5943b7f123eee956759557885c306eda214fdcbfe4052c4b4", + "route_weight_sha256": "47c6639d18e388ba70dd58bab748b780f6de9a6323f716a063dce76571f9df42", + "loads": [ + 12, + 5, + 17, + 3, + 18, + 15, + 15, + 9, + 12, + 5, + 24, + 17, + 22, + 5, + 15, + 5, + 6, + 3, + 8, + 15, + 5, + 10, + 12, + 8, + 4, + 26, + 5, + 2, + 0, + 13, + 5, + 14, + 7, + 9, + 24, + 9, + 8, + 8, + 4, + 2, + 21, + 31, + 8, + 7, + 7, + 12, + 13, + 7, + 8, + 15, + 26, + 12, + 9, + 33, + 9, + 13, + 9, + 25, + 6, + 1, + 12, + 3, + 12, + 15 + ], + "weighted_loads": [ + 0.4676992688328028, + 0.17151307128369808, + 1.165938377380371, + 0.11481037363409996, + 0.8136862590909004, + 0.7973042223602533, + 2.2637196704745293, + 0.42253489047288895, + 0.8716456759721041, + 0.3967907689511776, + 1.3969950545579195, + 2.435537489131093, + 2.029702875763178, + 0.369926605373621, + 0.6159246284514666, + 0.2637996282428503, + 0.3063753843307495, + 0.36410462856292725, + 0.46442445181310177, + 1.1980984564870596, + 0.16215349175035954, + 0.5265050195157528, + 0.5857303515076637, + 0.34085896238684654, + 0.22657831013202667, + 1.4368542041629553, + 0.17135123908519745, + 0.14647328481078148, + 0.0, + 0.4972662925720215, + 0.23934095352888107, + 0.4872049205005169, + 0.40420023910701275, + 0.38586784340441227, + 1.1417737230658531, + 0.4239874705672264, + 0.2908779066056013, + 0.3178812861442566, + 0.12091481499373913, + 0.06369655579328537, + 0.8878673911094666, + 1.3821066245436668, + 0.6670811772346497, + 0.37587832659482956, + 0.3834101613610983, + 0.5546465031802654, + 0.6868076622486115, + 0.2574418429285288, + 0.2866597790271044, + 0.49846495129168034, + 2.8510692808777094, + 0.4102600887417793, + 0.307526633143425, + 1.2958779744803905, + 0.40737312473356724, + 1.2534227035939693, + 0.4813033137470484, + 1.2386056073009968, + 0.21162566915154457, + 0.04075126349925995, + 0.8597358092665672, + 0.11968113668262959, + 0.46819634176790714, + 0.5412092804908752 + ], + "unique_experts": 63, + "load_cv": 0.6524408113734754, + "normalized_load_entropy": 0.9502738734479513, + "max_load_share": 0.04583333333333333 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "e133f05679879c04246a129b36739ef8b5faddf8d29c69a12a4239356be8ffc2", + "route_weight_sha256": "ca40f5ea621480b49c41590623d12c1edea9e0598e0c688061cc7c48f0516bda", + "loads": [ + 17, + 7, + 17, + 14, + 26, + 24, + 17, + 19, + 12, + 7, + 26, + 17, + 24, + 6, + 16, + 20, + 11, + 3, + 18, + 16, + 10, + 11, + 23, + 10, + 5, + 40, + 6, + 4, + 0, + 17, + 5, + 15, + 8, + 10, + 27, + 11, + 11, + 14, + 7, + 7, + 26, + 32, + 10, + 13, + 19, + 13, + 13, + 7, + 10, + 20, + 39, + 12, + 10, + 41, + 10, + 23, + 10, + 32, + 8, + 2, + 25, + 5, + 13, + 15 + ], + "weighted_loads": [ + 0.6995084844529629, + 0.21579719334840775, + 1.165938377380371, + 0.8675916604697704, + 1.2268038019537926, + 1.1707936823368073, + 2.33157442137599, + 1.0527604166418314, + 0.8716456759721041, + 0.6287065483629704, + 1.4875114243477583, + 2.435537489131093, + 2.0945049077272415, + 0.6530289985239506, + 0.6758203785866499, + 1.1536275669932365, + 0.6170885935425758, + 0.36410462856292725, + 1.4425700809806585, + 1.2312048468738794, + 0.32088007405400276, + 0.5615700632333755, + 1.2323191985487938, + 0.5139174126088619, + 0.24662244878709316, + 2.3309715278446674, + 0.1887926533818245, + 0.20573738031089306, + 0.0, + 0.6214943956583738, + 0.23934095352888107, + 0.5179698318243027, + 0.45328095369040966, + 0.42890932224690914, + 1.2862395104020834, + 0.6035012602806091, + 0.3953844755887985, + 0.5365251023322344, + 1.4816456642001867, + 0.29439548030495644, + 1.1418765746057034, + 1.4315220527350903, + 0.8295841440558434, + 0.6062604081816971, + 1.1367584113031626, + 0.6272365711629391, + 0.6868076622486115, + 0.2574418429285288, + 0.32180636771954596, + 0.8105922695249319, + 4.471233295276761, + 0.4102600887417793, + 0.34241387248039246, + 1.6556168179959059, + 0.4345773346722126, + 2.2349818497896194, + 0.525750195607543, + 1.7711701337248087, + 0.28761183097958565, + 0.0687322448939085, + 2.276733997510746, + 0.2371202278882265, + 0.5254582744091749, + 0.5412092804908752 + ], + "unique_experts": 63, + "load_cv": 0.6031031379949428, + "normalized_load_entropy": 0.9573673775365064, + "max_load_share": 0.042443064182194616 + } + }, + "s0_bos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "cae6e9a4e86c7cb5b1203c489dc412ba6bdb0d5eabea70e64c585164458a88a7", + "route_weight_sha256": "937e090c3d22e2cbd5b9bb092f58d7e6e615459ed4ed64422dd07692b5bc2cc8", + "loads": [ + 10, + 5, + 20, + 3, + 16, + 18, + 15, + 9, + 11, + 4, + 24, + 15, + 22, + 6, + 15, + 6, + 6, + 3, + 8, + 15, + 5, + 10, + 11, + 8, + 3, + 27, + 5, + 2, + 0, + 10, + 3, + 15, + 8, + 10, + 26, + 11, + 6, + 7, + 4, + 1, + 22, + 37, + 8, + 6, + 9, + 14, + 14, + 6, + 9, + 15, + 27, + 7, + 9, + 26, + 10, + 14, + 9, + 26, + 5, + 1, + 12, + 4, + 11, + 16 + ], + "weighted_loads": [ + 0.41493006609380245, + 0.1781329233199358, + 1.2582187689840794, + 0.10506599396467209, + 0.7278301641345024, + 0.9310733713209629, + 2.3496974632143974, + 0.4386077858507633, + 0.9155207481235266, + 0.36177318543195724, + 1.3496067691594362, + 2.6636679247021675, + 2.0590447653084993, + 0.36237344332039356, + 0.6024829838424921, + 0.23774269223213196, + 0.34415311738848686, + 0.4044712632894516, + 0.4454013165086508, + 1.2570653483271599, + 0.16390507109463215, + 0.5187487229704857, + 0.5957485809922218, + 0.35730569809675217, + 0.2020998504012823, + 1.6493604462593794, + 0.18043450638651848, + 0.1662408858537674, + 0.0, + 0.37597544118762016, + 0.13895494863390923, + 0.4994103014469147, + 0.46445532515645027, + 0.514193020761013, + 1.223766952753067, + 0.4983414225280285, + 0.23070322163403034, + 0.28824565559625626, + 0.11542438715696335, + 0.037942104041576385, + 0.9263608548790216, + 1.6340044178068638, + 0.6543875634670258, + 0.3359790276736021, + 0.4964821878820658, + 0.6108600776642561, + 0.7245284263044596, + 0.233419144526124, + 0.2978431098163128, + 0.4913683608174324, + 2.8751335609704256, + 0.25385819002985954, + 0.3466881215572357, + 1.1336937304586172, + 0.47472409904003143, + 1.4793219584971666, + 0.4692678861320019, + 1.3368175886571407, + 0.18279759213328362, + 0.04082681983709335, + 0.8615530580282211, + 0.14407333731651306, + 0.36130508966743946, + 0.5420008208602667 + ], + "unique_experts": 63, + "load_cv": 0.6818638218918337, + "normalized_load_entropy": 0.9460436496124728, + "max_load_share": 0.05138888888888889 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "1be13380d66f226c246301c4abfd48b6ae006f76eaae16ee4b4e37506682082b", + "route_weight_sha256": "d9ed937bd0763b5ba667a4241ff0d4770f0cd07635be24cd51ba2d5238d7e17d", + "loads": [ + 10, + 6, + 20, + 11, + 24, + 22, + 20, + 14, + 11, + 4, + 24, + 16, + 26, + 6, + 16, + 14, + 6, + 3, + 18, + 15, + 9, + 10, + 20, + 8, + 3, + 35, + 8, + 2, + 0, + 12, + 6, + 16, + 8, + 11, + 27, + 11, + 8, + 9, + 5, + 1, + 25, + 40, + 10, + 8, + 17, + 14, + 15, + 8, + 9, + 15, + 35, + 7, + 10, + 32, + 10, + 17, + 9, + 30, + 6, + 1, + 23, + 7, + 11, + 16 + ], + "weighted_loads": [ + 0.41493006609380245, + 0.20224016346037388, + 1.2582187689840794, + 0.7092881500720978, + 1.119471449404955, + 1.1138902511447668, + 2.5008541215211153, + 0.7459454443305731, + 0.9155207481235266, + 0.36177318543195724, + 1.3496067691594362, + 3.3943585827946663, + 2.190246259793639, + 0.36237344332039356, + 0.6499714124947786, + 0.6757823638617992, + 0.34415311738848686, + 0.4044712632894516, + 1.3368922006338835, + 1.2570653483271599, + 0.31059117056429386, + 0.5187487229704857, + 1.0818578451871872, + 0.35730569809675217, + 0.2020998504012823, + 2.1748322639614344, + 0.27509608678519726, + 0.1662408858537674, + 0.0, + 0.4402799289673567, + 0.2642682623118162, + 0.5096907755360007, + 0.46445532515645027, + 0.5372482612729073, + 1.265687469393015, + 0.4983414225280285, + 0.2777989823371172, + 0.34751447662711143, + 0.4801841601729393, + 0.037942104041576385, + 1.084584429860115, + 1.720430531539023, + 0.8386463075876236, + 0.4528563413769007, + 0.766244787722826, + 0.6108600776642561, + 0.8587111923843622, + 0.2864995691925287, + 0.2978431098163128, + 0.4913683608174324, + 3.933469796553254, + 0.25385819002985954, + 0.3826495260000229, + 1.4130736514925957, + 0.47472409904003143, + 1.8715386521071196, + 0.4692678861320019, + 1.4579396098852158, + 0.22162418067455292, + 0.04082681983709335, + 2.1179567519575357, + 0.3523890748620033, + 0.36130508966743946, + 0.5420008208602667 + ], + "unique_experts": 63, + "load_cv": 0.6522540366397552, + "normalized_load_entropy": 0.9495875290023725, + "max_load_share": 0.04597701149425287 + } + }, + "s1_bos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "c8f9a9143a58f32fc2bc3c9265dd5fbbd6e1df80091ad9ced904c78d99e29bd0", + "route_weight_sha256": "3c62738320dc2ac8dfd66846762a6e5c125a6dd0c02d8fc856a0981b8a00611c", + "loads": [ + 13, + 5, + 18, + 3, + 16, + 11, + 15, + 9, + 11, + 3, + 27, + 17, + 22, + 7, + 12, + 3, + 6, + 3, + 6, + 14, + 3, + 11, + 11, + 9, + 5, + 29, + 6, + 2, + 0, + 11, + 5, + 15, + 8, + 12, + 25, + 11, + 6, + 7, + 7, + 3, + 22, + 33, + 8, + 9, + 8, + 12, + 16, + 7, + 7, + 13, + 27, + 10, + 9, + 28, + 10, + 13, + 9, + 28, + 2, + 1, + 13, + 2, + 14, + 12 + ], + "weighted_loads": [ + 0.5040916278958321, + 0.1846315022557974, + 1.1747764144092798, + 0.10370169393718243, + 0.7439189776778221, + 0.6510224286466837, + 2.3090600222349167, + 0.38256020843982697, + 0.865160271525383, + 0.33725705184042454, + 1.4856612719595432, + 2.918345808982849, + 1.9918214231729507, + 0.4173074457794428, + 0.4824991039931774, + 0.12384066730737686, + 0.3245600424706936, + 0.41511674225330353, + 0.40881169959902763, + 1.1851344220340252, + 0.09589962661266327, + 0.548362048342824, + 0.571476899087429, + 0.3666001781821251, + 0.26088525354862213, + 1.6366792526096106, + 0.2088268045336008, + 0.16039109602570534, + 0.0, + 0.41995276510715485, + 0.22473419830203056, + 0.5022739227861166, + 0.45703476667404175, + 0.5491917617619038, + 1.2151088155806065, + 0.4808639604598284, + 0.2119091972708702, + 0.28939603455364704, + 0.20952299796044827, + 0.09998692199587822, + 0.9298577699810266, + 1.5469426400959492, + 0.6587648317217827, + 0.4214260447770357, + 0.4340690840035677, + 0.5331932045519352, + 0.8391885720193386, + 0.2512423451989889, + 0.23984594270586967, + 0.4381622038781643, + 2.9348392989486456, + 0.3490654546767473, + 0.3362177312374115, + 1.1678466200828552, + 0.46372062154114246, + 1.3197710625827312, + 0.4877821411937475, + 1.287807585671544, + 0.07406581193208694, + 0.04107526317238808, + 0.9353303834795952, + 0.09236117824912071, + 0.5110939219594002, + 0.43636309914290905 + ], + "unique_experts": 63, + "load_cv": 0.6778688463408731, + "normalized_load_entropy": 0.9464302999847242, + "max_load_share": 0.04583333333333333 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "771cd748b2f7cd3c4513e2e12ec750692f569f8c7c544178168b5ad8bfd70c68", + "route_weight_sha256": "def9e75709d7a5f6ee15cbc57b62b4c998f564951b71470ac8f691758ba0223b", + "loads": [ + 17, + 6, + 18, + 14, + 24, + 21, + 17, + 19, + 11, + 5, + 29, + 18, + 24, + 8, + 13, + 18, + 11, + 3, + 16, + 15, + 8, + 12, + 23, + 11, + 6, + 43, + 9, + 4, + 0, + 15, + 5, + 16, + 9, + 12, + 27, + 13, + 9, + 13, + 9, + 8, + 27, + 36, + 10, + 15, + 20, + 13, + 16, + 7, + 7, + 18, + 40, + 10, + 10, + 37, + 11, + 23, + 11, + 35, + 3, + 2, + 25, + 4, + 15, + 12 + ], + "weighted_loads": [ + 0.700076250359416, + 0.20873874239623547, + 1.1747764144092798, + 0.8564829807728529, + 1.1570365205407143, + 1.0922869145870209, + 2.3769147731363773, + 0.9962148163467646, + 0.865160271525383, + 0.5691728312522173, + 1.576177641749382, + 2.9594767540693283, + 2.0566234551370144, + 0.7004098389297724, + 0.5423948541283607, + 1.0609233491122723, + 0.6352732516825199, + 0.41511674225330353, + 1.3869573287665844, + 1.218240812420845, + 0.2834402322769165, + 0.5834270920604467, + 1.2663576751947403, + 0.5396586284041405, + 0.2809293922036886, + 2.520627373829484, + 0.31315811537206173, + 0.21965519152581692, + 0.0, + 0.5177160054445267, + 0.22473419830203056, + 0.5330388341099024, + 0.5061154812574387, + 0.5491917617619038, + 1.2905244547873735, + 0.6603777501732111, + 0.3164157662540674, + 0.5212124437093735, + 0.6196557264775038, + 0.3568265028297901, + 1.1872012354433537, + 1.6820459961891174, + 0.8309688344597816, + 0.7429894749075174, + 1.187417333945632, + 0.6057832725346088, + 0.8391885720193386, + 0.2512423451989889, + 0.23984594270586967, + 0.7641056999564171, + 4.615253111347556, + 0.3490654546767473, + 0.3681325241923332, + 1.5696889963001013, + 0.4909248314797878, + 2.294963002204895, + 0.5696301031857729, + 1.820372112095356, + 0.11226532608270645, + 0.06905624456703663, + 2.350444847717881, + 0.23877232894301414, + 0.568355854600668, + 0.43636309914290905 + ], + "unique_experts": 63, + "load_cv": 0.6216940048390157, + "normalized_load_entropy": 0.9550289162792464, + "max_load_share": 0.044513457556935816 + } + }, + "s0_x": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "8e1e1ed602cc976588490e8dd6f1a9dde3333eef1c9a19dfde378a00d188a796", + "route_weight_sha256": "c006bb78509bb593a5ecaa28011a07f07b9f50226723e5d0146386963109c12f", + "loads": [ + 13, + 5, + 18, + 2, + 16, + 17, + 15, + 10, + 10, + 4, + 25, + 15, + 22, + 5, + 14, + 6, + 7, + 3, + 9, + 18, + 4, + 9, + 11, + 9, + 2, + 27, + 7, + 4, + 0, + 12, + 3, + 15, + 8, + 8, + 24, + 13, + 6, + 6, + 5, + 2, + 23, + 37, + 8, + 7, + 9, + 17, + 13, + 7, + 7, + 12, + 28, + 7, + 8, + 28, + 9, + 13, + 8, + 26, + 3, + 1, + 12, + 2, + 9, + 17 + ], + "weighted_loads": [ + 0.5228501446545124, + 0.177730031311512, + 1.202728908509016, + 0.07064508274197578, + 0.7343056350946426, + 0.8967696707695723, + 2.3535959273576736, + 0.4420957062393427, + 0.9598127938807011, + 0.3713616393506527, + 1.366851296275854, + 2.5363208167254925, + 2.0691595394164324, + 0.3357737883925438, + 0.5709949769079685, + 0.2330395020544529, + 0.41972020268440247, + 0.39726585894823074, + 0.47652761451900005, + 1.3629751075059175, + 0.12636173143982887, + 0.4955071955919266, + 0.553415959700942, + 0.3699935358017683, + 0.1858418956398964, + 1.5902567524462938, + 0.24964448809623718, + 0.23485404253005981, + 0.0, + 0.4830729756504297, + 0.12609325721859932, + 0.4955382961779833, + 0.47432356141507626, + 0.43144452199339867, + 1.1517593543976545, + 0.5699782446026802, + 0.23348559997975826, + 0.2774560432881117, + 0.1567699797451496, + 0.06850224547088146, + 0.9585661590099335, + 1.6501759327948093, + 0.6760934852063656, + 0.38019704073667526, + 0.5144089478999376, + 0.7170689571648836, + 0.7131972014904022, + 0.2603673581033945, + 0.2415558621287346, + 0.39280399680137634, + 3.129214545711875, + 0.2606004308909178, + 0.29929641634225845, + 1.1818765997886658, + 0.4465644285082817, + 1.4632295109331608, + 0.4063337314873934, + 1.3056854344904423, + 0.1113680973649025, + 0.04163770005106926, + 0.853756207972765, + 0.09211254492402077, + 0.31029765866696835, + 0.597036449238658 + ], + "unique_experts": 63, + "load_cv": 0.6940665638551741, + "normalized_load_entropy": 0.9441948419251752, + "max_load_share": 0.05138888888888889 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "bf421cde5207fa0a2e65f8a86b4a42d2a821010b3e4fa436a6b8c4e0c48f7961", + "route_weight_sha256": "67748534497dc04ce87be6dc1a54abb1bd2e9a339438bfb55c623a1d73beb134", + "loads": [ + 13, + 7, + 18, + 10, + 25, + 20, + 21, + 15, + 10, + 4, + 25, + 15, + 26, + 6, + 15, + 12, + 7, + 3, + 20, + 18, + 8, + 9, + 18, + 9, + 2, + 36, + 8, + 4, + 0, + 17, + 5, + 15, + 8, + 9, + 25, + 13, + 9, + 8, + 6, + 3, + 26, + 39, + 10, + 8, + 17, + 17, + 13, + 7, + 7, + 13, + 36, + 7, + 8, + 34, + 9, + 17, + 9, + 31, + 4, + 1, + 24, + 5, + 9, + 17 + ], + "weighted_loads": [ + 0.5228501446545124, + 0.2398996241390705, + 1.202728908509016, + 0.6748672388494015, + 1.2483852319419384, + 1.0002947002649307, + 2.542443310841918, + 0.7400208041071892, + 0.9598127938807011, + 0.3713616393506527, + 1.366851296275854, + 2.5363208167254925, + 2.2383644338697195, + 0.363006891682744, + 0.6086738519370556, + 0.5606452524662018, + 0.41972020268440247, + 0.39726585894823074, + 1.4674496706575155, + 1.3629751075059175, + 0.2809971757233143, + 0.4955071955919266, + 0.9498285185545683, + 0.3699935358017683, + 0.1858418956398964, + 2.130481457337737, + 0.2670859023928642, + 0.23485404253005981, + 0.0, + 0.6402848958969116, + 0.204441724345088, + 0.4955382961779833, + 0.47432356141507626, + 0.4544997625052929, + 1.1891279313713312, + 0.5699782446026802, + 0.3141834530979395, + 0.33672486431896687, + 0.5215297527611256, + 0.10687859170138836, + 1.0943483337759972, + 1.7252508886158466, + 0.860552329570055, + 0.41704021766781807, + 0.7988041415810585, + 0.7170689571648836, + 0.7131972014904022, + 0.2603673581033945, + 0.2415558621287346, + 0.43094929680228233, + 4.180462429299951, + 0.2606004308909178, + 0.29929641634225845, + 1.4752623792737722, + 0.4465644285082817, + 1.8938497267663479, + 0.4467639308422804, + 1.4810536280274391, + 0.1501946859061718, + 0.04163770005106926, + 2.294257028028369, + 0.30072973296046257, + 0.31029765866696835, + 0.597036449238658 + ], + "unique_experts": 63, + "load_cv": 0.6677557493461064, + "normalized_load_entropy": 0.9480492178093486, + "max_load_share": 0.04482758620689655 + } + }, + "s1_x": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "d7d0cedc99af3e588e143bf1144be885407dcea9b0157ee7f3f007667d7af27e", + "route_weight_sha256": "7b59c9bb6d7bf5158e7a6a9003770c591327c7529bd04fd1e56e4bb74a696b97", + "loads": [ + 11, + 2, + 17, + 3, + 20, + 16, + 15, + 7, + 10, + 3, + 27, + 18, + 22, + 6, + 11, + 5, + 6, + 3, + 8, + 16, + 2, + 10, + 12, + 7, + 2, + 29, + 6, + 3, + 0, + 9, + 6, + 15, + 8, + 6, + 22, + 10, + 3, + 7, + 7, + 3, + 24, + 32, + 8, + 6, + 11, + 12, + 18, + 6, + 7, + 15, + 33, + 13, + 7, + 27, + 9, + 14, + 9, + 26, + 3, + 1, + 13, + 3, + 14, + 16 + ], + "weighted_loads": [ + 0.4069037511944771, + 0.08755986392498016, + 1.0713652651757002, + 0.1007528118789196, + 0.9505688790231943, + 0.8482468742877245, + 2.3197511062026024, + 0.2919486090540886, + 0.8366556614637375, + 0.3180769048631191, + 1.461203282698989, + 2.8756957314908504, + 1.9677161909639835, + 0.4653718899935484, + 0.4537504781037569, + 0.26039091497659683, + 0.3070011232048273, + 0.4243900030851364, + 0.46758807823061943, + 1.1729802209883928, + 0.07904079183936119, + 0.5209642164409161, + 0.6252177637070417, + 0.30418921262025833, + 0.16748913004994392, + 1.4892762079834938, + 0.19369461946189404, + 0.19067686796188354, + 0.0, + 0.35932725481688976, + 0.2688848413527012, + 0.5019136033952236, + 0.4542166441679001, + 0.31741636991500854, + 1.0524711888283491, + 0.43286669068038464, + 0.12409369833767414, + 0.27973315864801407, + 0.20614667236804962, + 0.09902060404419899, + 1.0229221563786268, + 1.465420937165618, + 0.6387497801333666, + 0.33053182251751423, + 0.5057802610099316, + 0.5202728919684887, + 0.9128408581018448, + 0.20900113321840763, + 0.23842975869774818, + 0.48128332011401653, + 3.1301458943635225, + 0.448008781298995, + 0.24923967011272907, + 1.1168099883943796, + 0.4142875261604786, + 1.3044072799384594, + 0.4841781109571457, + 1.208628211170435, + 0.09816979803144932, + 0.04319583997130394, + 0.9159249309450388, + 0.12317807972431183, + 0.4973444379866123, + 0.5876388847827911 + ], + "unique_experts": 63, + "load_cv": 0.7100686803853536, + "normalized_load_entropy": 0.9410453505613535, + "max_load_share": 0.04583333333333333 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "1f017ac03bf3595282d7d2b7251801606b157ad219ca8e5c265ed50577cf1c7a", + "route_weight_sha256": "e914176ba43c973fbfb2f5c060b98c6c45c55beedc6b5ce417fb2675078dfee5", + "loads": [ + 15, + 3, + 17, + 15, + 30, + 27, + 18, + 17, + 10, + 5, + 29, + 18, + 25, + 7, + 12, + 19, + 12, + 3, + 20, + 17, + 6, + 11, + 23, + 9, + 3, + 43, + 7, + 6, + 0, + 13, + 6, + 17, + 9, + 6, + 24, + 12, + 6, + 13, + 9, + 7, + 28, + 34, + 10, + 10, + 24, + 13, + 18, + 6, + 7, + 19, + 46, + 13, + 7, + 35, + 10, + 24, + 11, + 34, + 4, + 2, + 26, + 5, + 15, + 16 + ], + "weighted_loads": [ + 0.602888373658061, + 0.11166710406541824, + 1.0713652651757002, + 0.8856314308941364, + 1.5150145757943392, + 1.2980575077235699, + 2.4252586886286736, + 0.873408729210496, + 0.8366556614637375, + 0.5499926842749119, + 1.5517196524888277, + 2.8756957314908504, + 2.0824548304080963, + 0.748474283143878, + 0.5136462282389402, + 1.1306893602013588, + 0.7527626026421785, + 0.4243900030851364, + 1.5876492224633694, + 1.2060866113752127, + 0.2355194240808487, + 0.5560292601585388, + 1.2678546290844679, + 0.4772476628422737, + 0.18753326870501041, + 2.350057192146778, + 0.21113603375852108, + 0.2835442926734686, + 0.0, + 0.4644694998860359, + 0.2688848413527012, + 0.5640850514173508, + 0.503297358751297, + 0.31741636991500854, + 1.1139945425093174, + 0.6123804803937674, + 0.22860026732087135, + 0.5069960821419954, + 0.6162794008851051, + 0.29681527614593506, + 1.2340588737279177, + 1.553291605785489, + 0.7948642615228891, + 0.5181173551827669, + 1.3051145747303963, + 0.5928629599511623, + 0.9128408581018448, + 0.20900113321840763, + 0.23842975869774818, + 0.7193304989486933, + 4.750694939866662, + 0.448008781298995, + 0.24923967011272907, + 1.4740842655301094, + 0.44149173609912395, + 2.2707031667232513, + 0.5678261481225491, + 1.7901874128729105, + 0.13636931218206882, + 0.07117682136595249, + 2.4233386926352978, + 0.24368487298488617, + 0.5546063706278801, + 0.5876388847827911 + ], + "unique_experts": 63, + "load_cv": 0.6659043002837131, + "normalized_load_entropy": 0.9483546073335407, + "max_load_share": 0.047619047619047616 + } + }, + "s0_period": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "274a6b7f035802f09fa9d574c766ed9679861dcc4ef4faf88632cc84d6544371", + "route_weight_sha256": "4cedecdcfc06b81968e06245cfa3d34b8bb12de05a274cff46e81a3f5985beab", + "loads": [ + 12, + 6, + 17, + 2, + 15, + 16, + 15, + 8, + 10, + 5, + 26, + 14, + 22, + 6, + 15, + 6, + 6, + 3, + 8, + 15, + 4, + 9, + 11, + 9, + 2, + 28, + 6, + 3, + 0, + 12, + 4, + 14, + 8, + 9, + 24, + 13, + 6, + 8, + 5, + 1, + 22, + 38, + 8, + 6, + 10, + 17, + 13, + 6, + 7, + 13, + 29, + 10, + 7, + 28, + 10, + 14, + 8, + 25, + 3, + 1, + 12, + 4, + 9, + 17 + ], + "weighted_loads": [ + 0.492515342310071, + 0.20020592212677002, + 1.1778205186128616, + 0.07493297383189201, + 0.7065838221460581, + 0.8407952077686787, + 2.346036970615387, + 0.38049541041255, + 0.893382016569376, + 0.389906520023942, + 1.395437404513359, + 2.4650598652660847, + 2.0464009810239077, + 0.34591154381632805, + 0.5898066125810146, + 0.23304262571036816, + 0.37990089505910873, + 0.38889114558696747, + 0.4493424966931343, + 1.2906250432133675, + 0.12788622453808784, + 0.5011667050421238, + 0.5515107456594706, + 0.368650758638978, + 0.1748848371207714, + 1.6548387669026852, + 0.2244657203555107, + 0.19872085377573967, + 0.0, + 0.48086218535900116, + 0.16279915161430836, + 0.4608247596770525, + 0.4987649545073509, + 0.44766826182603836, + 1.1679630652070045, + 0.5685200039297342, + 0.22618266567587852, + 0.3369482569396496, + 0.1508557815104723, + 0.03836359456181526, + 0.9471106249839067, + 1.7084327675402164, + 0.6666147299110889, + 0.3427661173045635, + 0.5548085290938616, + 0.7113899681717157, + 0.682618660852313, + 0.23841597512364388, + 0.23954109475016594, + 0.41923709213733673, + 3.223313305526972, + 0.35198776982724667, + 0.2572167180478573, + 1.1918054390698671, + 0.47792496904730797, + 1.4920647721737623, + 0.4180404879152775, + 1.2230832297354937, + 0.11501257680356503, + 0.04167582839727402, + 0.8614548277109861, + 0.14936927892267704, + 0.3077149298042059, + 0.5928737912327051 + ], + "unique_experts": 63, + "load_cv": 0.6937107235016874, + "normalized_load_entropy": 0.9449040972795887, + "max_load_share": 0.05277777777777778 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "cffaad3b6a1a136c2150f03860095dd5009f2b7933746ff44d1843cfd2ef9c28", + "route_weight_sha256": "0a0bc82d457b7626f98fc9fdcbe1c3258be1fc665746b79ab627ad6f90478604", + "loads": [ + 12, + 8, + 17, + 10, + 24, + 18, + 21, + 14, + 11, + 5, + 26, + 14, + 27, + 6, + 15, + 12, + 6, + 3, + 18, + 15, + 9, + 9, + 18, + 9, + 2, + 38, + 7, + 3, + 0, + 16, + 6, + 14, + 8, + 10, + 25, + 13, + 8, + 10, + 6, + 2, + 25, + 40, + 10, + 7, + 18, + 17, + 13, + 6, + 7, + 14, + 38, + 10, + 8, + 34, + 10, + 17, + 9, + 29, + 5, + 1, + 23, + 8, + 9, + 17 + ], + "weighted_loads": [ + 0.492515342310071, + 0.2663240097463131, + 1.1778205186128616, + 0.6791551299393177, + 1.1485530976206064, + 0.9151944052428007, + 2.551365112885833, + 0.8381850067526102, + 0.9367481209337711, + 0.389906520023942, + 1.395437404513359, + 2.4650598652660847, + 2.2761874180287123, + 0.34591154381632805, + 0.5898066125810146, + 0.5422426592558622, + 0.37990089505910873, + 0.38889114558696747, + 1.340833380818367, + 1.2906250432133675, + 0.3268227316439152, + 0.5011667050421238, + 0.9332242999225855, + 0.368650758638978, + 0.1748848371207714, + 2.249391321092844, + 0.24190713465213776, + 0.19872085377573967, + 0.0, + 0.6072397958487272, + 0.23969504982233047, + 0.4608247596770525, + 0.4987649545073509, + 0.4707235023379326, + 1.2065406441688538, + 0.5685200039297342, + 0.2732784263789654, + 0.39621707797050476, + 0.5156155545264482, + 0.07677203416824341, + 1.1031684894114733, + 1.7835077233612537, + 0.8461618982255459, + 0.37960929423570633, + 0.8331716954708099, + 0.7113899681717157, + 0.682618660852313, + 0.23841597512364388, + 0.23954109475016594, + 0.4789704382419586, + 4.323434706777334, + 0.35198776982724667, + 0.28664930909872055, + 1.4919615723192692, + 0.47792496904730797, + 1.8871806655079126, + 0.4658919684588909, + 1.3442052509635687, + 0.19110083021223545, + 0.04167582839727402, + 2.1178585216403008, + 0.39254134707152843, + 0.3077149298042059, + 0.5928737912327051 + ], + "unique_experts": 63, + "load_cv": 0.668008953890987, + "normalized_load_entropy": 0.9487850470604715, + "max_load_share": 0.04597701149425287 + } + }, + "s1_period": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "d264f8d4ba011c1c3f8525b253b82e8de298c9af0c76c0825bc27533a4f750e9", + "route_weight_sha256": "b97d3fad3efffeb09c2c8c5a61c06ed697c0a03252650dfc426ba989d7832379", + "loads": [ + 15, + 3, + 17, + 3, + 20, + 12, + 15, + 7, + 11, + 3, + 28, + 17, + 22, + 5, + 11, + 4, + 6, + 3, + 8, + 15, + 1, + 12, + 12, + 7, + 2, + 27, + 6, + 3, + 0, + 8, + 6, + 15, + 9, + 7, + 19, + 11, + 4, + 8, + 4, + 2, + 26, + 33, + 8, + 7, + 13, + 12, + 17, + 7, + 9, + 10, + 36, + 11, + 7, + 28, + 8, + 13, + 10, + 27, + 4, + 1, + 13, + 2, + 14, + 16 + ], + "weighted_loads": [ + 0.548895226791501, + 0.1257336214184761, + 1.1084691733121872, + 0.09479955211281776, + 0.972054636105895, + 0.7109367325901985, + 2.3175376132130623, + 0.2783379387110472, + 0.8865187298506498, + 0.32279644906520844, + 1.4927100911736488, + 2.860351223498583, + 1.9811268616467714, + 0.42812931537628174, + 0.4483827445656061, + 0.23094793781638145, + 0.33994121849536896, + 0.41766197234392166, + 0.45457810163497925, + 1.163409274071455, + 0.04087582603096962, + 0.5593778099864721, + 0.6029803454875946, + 0.3033989779651165, + 0.16742896661162376, + 1.54156144708395, + 0.1995591688901186, + 0.18350210040807724, + 0.0, + 0.31037038564682007, + 0.2553011439740658, + 0.5070368107408285, + 0.5093533899635077, + 0.3927065543830395, + 0.93513398244977, + 0.4664647337049246, + 0.1409210879355669, + 0.3199936356395483, + 0.12656120769679546, + 0.06542064435780048, + 1.0800395365804434, + 1.4710539691150188, + 0.6576777119189501, + 0.369018642231822, + 0.561724441125989, + 0.5275217033922672, + 0.9208398777991533, + 0.24605625309050083, + 0.3084326721727848, + 0.3326650708913803, + 3.3702934496104717, + 0.38699844293296337, + 0.2545985169708729, + 1.1497360039502382, + 0.3864551018923521, + 1.247809987515211, + 0.4928684886544943, + 1.224422212690115, + 0.13173691555857658, + 0.042712725698947906, + 0.9282371662557125, + 0.0896556843072176, + 0.4920907448977232, + 0.5764295216649771 + ], + "unique_experts": 63, + "load_cv": 0.7243558228002942, + "normalized_load_entropy": 0.9393521153287242, + "max_load_share": 0.05 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "358c04129f32defee0e7883788d05bb77debda60ab49280c1a8d761dbdaa06fb", + "route_weight_sha256": "dcd0614a2726f591eead4aa94a27102ca337837e4204a56e0ed9795e4eeead51", + "loads": [ + 19, + 4, + 17, + 14, + 29, + 22, + 18, + 19, + 11, + 5, + 30, + 17, + 27, + 6, + 12, + 17, + 11, + 3, + 18, + 16, + 6, + 13, + 23, + 9, + 3, + 42, + 7, + 5, + 0, + 11, + 6, + 16, + 10, + 7, + 20, + 13, + 7, + 15, + 6, + 7, + 31, + 35, + 10, + 11, + 27, + 13, + 17, + 7, + 9, + 15, + 49, + 11, + 7, + 37, + 9, + 24, + 11, + 34, + 5, + 2, + 26, + 4, + 15, + 16 + ], + "weighted_loads": [ + 0.744879849255085, + 0.14984086155891418, + 1.1084691733121872, + 0.8475808389484882, + 1.4248704705387354, + 1.1017453502863646, + 2.426011174917221, + 0.9511415492743254, + 0.8865187298506498, + 0.5547122284770012, + 1.5832264609634876, + 2.860351223498583, + 2.1931943017989397, + 0.7112317085266113, + 0.5082784947007895, + 1.0653852112591267, + 0.6506544277071953, + 0.41766197234392166, + 1.432723730802536, + 1.1965156644582748, + 0.2252512164413929, + 0.5944428537040949, + 1.2374674640595913, + 0.4764574281871319, + 0.18747310526669025, + 2.466302312910557, + 0.21700058318674564, + 0.24276619590818882, + 0.0, + 0.38414362259209156, + 0.2553011439740658, + 0.5378017220646143, + 0.5584341045469046, + 0.3927065543830395, + 0.9634574297815561, + 0.6459785234183073, + 0.24542765691876411, + 0.5960966385900974, + 0.536693936213851, + 0.2937102112919092, + 1.3248218093067408, + 1.5611970610916615, + 0.81109937466681, + 0.5566041748970747, + 1.3979537431150675, + 0.6001117713749409, + 0.9208398777991533, + 0.24605625309050083, + 0.3084326721727848, + 0.6384378187358379, + 5.014854114502668, + 0.38699844293296337, + 0.2545985169708729, + 1.5456243455410004, + 0.41365931183099747, + 2.255955919623375, + 0.5373153705149889, + 1.7569867391139269, + 0.1699364297091961, + 0.07069370709359646, + 2.381387570872903, + 0.20544707961380482, + 0.549352677538991, + 0.5764295216649771 + ], + "unique_experts": 63, + "load_cv": 0.6784543567570008, + "normalized_load_entropy": 0.947558793310568, + "max_load_share": 0.050724637681159424 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 120, + "ordered_topk_exact_tokens": 41, + "set_exact_tokens": 65, + "mean_set_jaccard": 0.8466269841269842, + "mean_token_weighted_tv": 0.03002014202841868, + "aggregate_load_tv": 0.05277777777777777 + }, + "system_bos": { + "tokens": 120, + "ordered_topk_exact_tokens": 40, + "set_exact_tokens": 54, + "mean_set_jaccard": 0.8218253968253968, + "mean_token_weighted_tv": 0.03464467157609761, + "aggregate_load_tv": 0.05972222222222223 + }, + "system_x": { + "tokens": 120, + "ordered_topk_exact_tokens": 31, + "set_exact_tokens": 49, + "mean_set_jaccard": 0.7936507936507938, + "mean_token_weighted_tv": 0.04560582474029313, + "aggregate_load_tv": 0.07361111111111111 + }, + "system_period": { + "tokens": 120, + "ordered_topk_exact_tokens": 30, + "set_exact_tokens": 44, + "mean_set_jaccard": 0.7777777777777778, + "mean_token_weighted_tv": 0.04609592334988217, + "aggregate_load_tv": 0.08055555555555555 + }, + "bos_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 36, + "set_exact_tokens": 56, + "mean_set_jaccard": 0.8192460317460318, + "mean_token_weighted_tv": 0.03639711029051493, + "aggregate_load_tv": 0.05694444444444446 + }, + "bos_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 41, + "set_exact_tokens": 59, + "mean_set_jaccard": 0.8301587301587303, + "mean_token_weighted_tv": 0.03550404072739184, + "aggregate_load_tv": 0.059722222222222225 + }, + "x_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 26, + "set_exact_tokens": 48, + "mean_set_jaccard": 0.7940476190476191, + "mean_token_weighted_tv": 0.04081969809873651, + "aggregate_load_tv": 0.059722222222222225 + }, + "x_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 24, + "set_exact_tokens": 44, + "mean_set_jaccard": 0.7742063492063492, + "mean_token_weighted_tv": 0.04520342031028122, + "aggregate_load_tv": 0.06805555555555555 + }, + "period_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 31, + "set_exact_tokens": 51, + "mean_set_jaccard": 0.7989682539682541, + "mean_token_weighted_tv": 0.04045701326491932, + "aggregate_load_tv": 0.06111111111111111 + }, + "period_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 25, + "set_exact_tokens": 46, + "mean_set_jaccard": 0.7694444444444445, + "mean_token_weighted_tv": 0.046623120356040694, + "aggregate_load_tv": 0.07638888888888888 + } + } + }, + "layer_21": { + "layer": 21, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "f7ef223ba5336cb92010d33e4bf9a6cb5e705777190ef47e26a78a342e294446", + "route_weight_sha256": "19ab25251258fa85c3ea0a8ea4d07980fc192436e9374532805198d49a3d75ea", + "loads": [ + 3, + 14, + 0, + 22, + 6, + 9, + 6, + 12, + 16, + 2, + 15, + 3, + 23, + 4, + 1, + 10, + 1, + 7, + 20, + 7, + 2, + 5, + 3, + 4, + 2, + 27, + 13, + 15, + 7, + 8, + 24, + 19, + 1, + 27, + 6, + 7, + 3, + 2, + 18, + 17, + 32, + 15, + 13, + 13, + 15, + 25, + 11, + 24, + 19, + 5, + 1, + 18, + 4, + 36, + 4, + 21, + 17, + 9, + 7, + 13, + 13, + 13, + 0, + 1 + ], + "weighted_loads": [ + 0.10174499824643135, + 0.5476890075951815, + 0.0, + 1.3364300951361656, + 0.18846751935780048, + 0.37659244425594807, + 0.22616206668317318, + 0.6935665346682072, + 0.6752655562013388, + 0.18359652906656265, + 0.766429241746664, + 0.10521675646305084, + 1.1643419098109007, + 0.18065265379846096, + 0.0423872247338295, + 0.3789893537759781, + 0.03029298037290573, + 0.25736639834940434, + 0.8316571284085512, + 0.23682641051709652, + 0.08206377178430557, + 0.25327272340655327, + 0.16641545668244362, + 0.41406240314245224, + 0.06718572229146957, + 2.052550109103322, + 0.7616236060857773, + 1.155970387160778, + 0.3506178557872772, + 0.5503216348588467, + 0.971830204129219, + 0.7223710492253304, + 0.05197259783744812, + 1.3034878764301538, + 0.22793905809521675, + 0.4160815328359604, + 0.12454204261302948, + 0.07604978606104851, + 1.5258368402719498, + 0.6532960403710604, + 1.2165255546569824, + 0.87019326351583, + 0.8685852233320475, + 1.0746501833200455, + 1.3300197944045067, + 0.9992226772010326, + 0.5858000926673412, + 1.1239287983626127, + 0.9464337378740311, + 0.20994333922863007, + 0.02973846159875393, + 1.0876337923109531, + 0.14087260514497757, + 1.936373582109809, + 0.13276096992194653, + 1.2719596959650517, + 1.009375547990203, + 0.47962211817502975, + 0.26639679819345474, + 0.6000805795192719, + 0.6320020295679569, + 0.5455432385206223, + 0.0, + 0.053121618926525116 + ], + "unique_experts": 62, + "load_cv": 0.7648125728601343, + "normalized_load_entropy": 0.9261601757355467, + "max_load_share": 0.05 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "235d896c9194661f8c71f11401be86b82193f908a118a8c83998625ef0156d24", + "route_weight_sha256": "049a62e427b40cf1c8030e06de692c88be684bd62d229b7c13b0158ff22890dc", + "loads": [ + 3, + 14, + 3, + 22, + 13, + 9, + 9, + 12, + 18, + 2, + 22, + 4, + 26, + 9, + 5, + 16, + 2, + 11, + 20, + 13, + 2, + 13, + 3, + 5, + 2, + 28, + 21, + 20, + 10, + 8, + 25, + 19, + 2, + 28, + 7, + 17, + 3, + 2, + 18, + 18, + 34, + 16, + 16, + 13, + 15, + 25, + 11, + 24, + 30, + 7, + 1, + 25, + 13, + 38, + 10, + 22, + 18, + 9, + 11, + 15, + 13, + 13, + 6, + 1 + ], + "weighted_loads": [ + 0.10174499824643135, + 0.5476890075951815, + 0.0729636789765209, + 1.3364300951361656, + 0.44979349710047245, + 0.37659244425594807, + 0.5192377772182226, + 0.6935665346682072, + 0.8102553468197584, + 0.18359652906656265, + 1.1407430060207844, + 0.15320613980293274, + 1.3032498564571142, + 0.4873016644269228, + 0.18895642459392548, + 0.5815605064854026, + 0.043555392883718014, + 0.3811024157330394, + 0.8316571284085512, + 1.8668316658586264, + 0.08206377178430557, + 0.719374546315521, + 0.16641545668244362, + 0.458419818431139, + 0.06718572229146957, + 2.0886182989925146, + 1.1412202529609203, + 1.5986560806632042, + 0.41406654892489314, + 0.5503216348588467, + 1.0065360851585865, + 0.7223710492253304, + 0.07480553351342678, + 1.3405857142060995, + 0.27820924669504166, + 0.9983044266700745, + 0.12454204261302948, + 0.07604978606104851, + 1.5258368402719498, + 0.6885799039155245, + 1.3130663745105267, + 0.9054009672254324, + 1.0573994535952806, + 1.0746501833200455, + 1.3300197944045067, + 0.9992226772010326, + 0.5858000926673412, + 1.1239287983626127, + 1.5271292626857758, + 0.3910697475075722, + 0.02973846159875393, + 1.4041459113359451, + 0.7238209508359432, + 1.9868291774764657, + 0.3764081858098507, + 1.4399703778326511, + 1.0500859748572111, + 0.47962211817502975, + 0.41618933714926243, + 0.6645790785551071, + 0.6320020295679569, + 0.5455432385206223, + 0.2899050638079643, + 0.053121618926525116 + ], + "unique_experts": 64, + "load_cv": 0.6477008944506837, + "normalized_load_entropy": 0.9460108548592167, + "max_load_share": 0.04367816091954023 + } + }, + "s1_eos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "b76fdcc392777efa88952d8041150fa80afeaa7fbf7d7048ffb6d0ca2fbdd30e", + "route_weight_sha256": "37bd654bda6a13478006d8d9aa812cd5e8ffb6cf05ddefefa3ea841c075bda32", + "loads": [ + 3, + 16, + 0, + 26, + 2, + 8, + 6, + 11, + 18, + 2, + 14, + 6, + 21, + 4, + 2, + 10, + 0, + 7, + 17, + 6, + 2, + 4, + 3, + 5, + 2, + 28, + 13, + 15, + 6, + 8, + 31, + 18, + 1, + 27, + 5, + 7, + 5, + 2, + 19, + 13, + 30, + 15, + 14, + 13, + 15, + 24, + 13, + 21, + 18, + 6, + 2, + 16, + 4, + 33, + 5, + 20, + 18, + 9, + 10, + 12, + 13, + 14, + 1, + 1 + ], + "weighted_loads": [ + 0.11109086498618126, + 0.6382325161248446, + 0.0, + 1.6454161573201418, + 0.056371914222836494, + 0.3498455844819546, + 0.22934378869831562, + 0.6843014992773533, + 0.7443054430186749, + 0.1737084649503231, + 0.6916607618331909, + 0.21940771117806435, + 1.1051478385925293, + 0.18604993261396885, + 0.07267644256353378, + 0.3742589261382818, + 0.0, + 0.26671858318150043, + 0.7317698914557695, + 0.19768905267119408, + 0.07665899768471718, + 0.21242660284042358, + 0.1694016121327877, + 0.40918242931365967, + 0.06912657618522644, + 1.97476907633245, + 0.7067090310156345, + 1.1786539014428854, + 0.31345059908926487, + 0.5163614843040705, + 1.1722018960863352, + 0.6572689153254032, + 0.04815308004617691, + 1.2552811913192272, + 0.19028080441057682, + 0.419744037091732, + 0.21619966998696327, + 0.07536076754331589, + 1.5335049405694008, + 0.4973535034805536, + 1.1950150206685066, + 0.8387604150921106, + 0.8936788849532604, + 1.0811639614403248, + 1.289587527513504, + 0.9685333408415318, + 0.6560249347239733, + 0.9632839523255825, + 0.8522913716733456, + 0.2523831017315388, + 0.061191679909825325, + 0.9814084619283676, + 0.13946125097572803, + 1.891877317801118, + 0.176306314766407, + 1.1480909883975983, + 1.0278087984770536, + 0.4625956788659096, + 0.36937449127435684, + 0.643733024597168, + 0.6369665004312992, + 0.5901046078652143, + 0.03270136937499046, + 0.051181480288505554 + ], + "unique_experts": 62, + "load_cv": 0.7545745265044287, + "normalized_load_entropy": 0.9285201553896804, + "max_load_share": 0.04583333333333333 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "fc0218cec9eb34efd7ffe382922b55174008f379c02f91b15809158174b2d596", + "route_weight_sha256": "1f227c2a3926114e47140d4d63764ee7bc239a81aa34ec02e116240e9e2f4bca", + "loads": [ + 11, + 17, + 3, + 26, + 2, + 9, + 12, + 12, + 21, + 4, + 24, + 7, + 26, + 14, + 10, + 14, + 1, + 16, + 19, + 11, + 3, + 13, + 5, + 10, + 3, + 30, + 21, + 25, + 9, + 9, + 37, + 18, + 2, + 31, + 5, + 22, + 6, + 3, + 20, + 15, + 33, + 17, + 22, + 14, + 16, + 25, + 13, + 21, + 29, + 9, + 3, + 26, + 14, + 35, + 17, + 29, + 22, + 9, + 13, + 15, + 14, + 15, + 7, + 2 + ], + "weighted_loads": [ + 0.6230109501630068, + 0.6857491377741098, + 0.6937812629621476, + 1.6454161573201418, + 0.056371914222836494, + 0.3654113467782736, + 0.49603777192533016, + 0.7660838253796101, + 0.8830241225659847, + 0.3220457583665848, + 1.191244650632143, + 0.2599537931382656, + 1.3553858175873756, + 0.7186072915792465, + 0.38444204814732075, + 0.5054624108597636, + 0.013262412510812283, + 0.5784724745899439, + 0.7868657223880291, + 1.764572847634554, + 0.12364298105239868, + 0.7092356095090508, + 0.22743930108845234, + 0.8960074000060558, + 0.10466313362121582, + 2.0460585709661245, + 0.9926245883107185, + 2.0943330470472574, + 0.34902938129380345, + 0.5651727225631475, + 1.4061536826193333, + 0.6572689153254032, + 0.07078684493899345, + 1.8490522913634777, + 0.19028080441057682, + 1.2728167101740837, + 0.2870911620557308, + 0.11605732515454292, + 1.5888602994382381, + 0.5797598417848349, + 1.307890560477972, + 0.9642723370343447, + 1.303730197250843, + 1.1236490495502949, + 1.348968181759119, + 1.028137180954218, + 0.6560249347239733, + 0.9632839523255825, + 1.6874951533973217, + 1.1647454723715782, + 0.1147730853408575, + 1.6898607797920704, + 0.7452138308435678, + 1.9372928338125348, + 0.893412908539176, + 1.7687896359711885, + 1.1871217992156744, + 0.4625956788659096, + 0.5129304938018322, + 0.8040764257311821, + 0.659387955442071, + 0.6526142116636038, + 0.29888003692030907, + 0.14150310307741165 + ], + "unique_experts": 64, + "load_cv": 0.6025342732684669, + "normalized_load_entropy": 0.953277544134185, + "max_load_share": 0.038302277432712216 + } + }, + "s0_bos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "853445e0dddac243487a51ea93c598f9b9b48a843339e2998cfc21dfc60c8d10", + "route_weight_sha256": "79258d12e0c27bbb94e74af04c5385de044511e8058fe9c3c38c10c01e81b99f", + "loads": [ + 2, + 15, + 0, + 25, + 4, + 8, + 7, + 13, + 22, + 2, + 14, + 7, + 21, + 5, + 2, + 8, + 0, + 6, + 19, + 6, + 3, + 7, + 3, + 3, + 2, + 25, + 15, + 15, + 8, + 8, + 28, + 24, + 1, + 27, + 3, + 7, + 2, + 1, + 19, + 18, + 32, + 15, + 13, + 13, + 15, + 22, + 10, + 24, + 16, + 4, + 2, + 17, + 4, + 29, + 4, + 19, + 16, + 9, + 7, + 11, + 13, + 18, + 1, + 1 + ], + "weighted_loads": [ + 0.07064146548509598, + 0.6189215444028378, + 0.0, + 1.5561408065259457, + 0.11772917956113815, + 0.3493598513305187, + 0.2878192849457264, + 0.7923496291041374, + 0.8815416414290667, + 0.196756973862648, + 0.7152026109397411, + 0.24511045962572098, + 1.1702591180801392, + 0.2073741853237152, + 0.07629968598484993, + 0.309963446110487, + 0.0, + 0.20976563729345798, + 0.7998522948473692, + 0.19991964101791382, + 0.11739926971495152, + 0.3169249966740608, + 0.1767653226852417, + 0.39076773822307587, + 0.07172239944338799, + 1.9096021205186844, + 0.8703485429286957, + 1.0989168249070644, + 0.37622053548693657, + 0.5534833669662476, + 1.1343953423202038, + 0.9037198685109615, + 0.05388488620519638, + 1.3187028709799051, + 0.11704137548804283, + 0.4160868525505066, + 0.11343783885240555, + 0.03616590052843094, + 1.5568990856409073, + 0.6825699508190155, + 1.2006828058511019, + 0.8819237425923347, + 0.8528887201100588, + 1.1666635796427727, + 1.4010716564953327, + 0.8798175640404224, + 0.5287048369646072, + 1.129464726895094, + 0.7596568241715431, + 0.1794588789343834, + 0.061356453225016594, + 1.033847365528345, + 0.1557229347527027, + 1.560909440740943, + 0.1480526365339756, + 1.1919281892478466, + 0.94461321644485, + 0.5372777432203293, + 0.2575059328228235, + 0.5482280403375626, + 0.6237962581217289, + 0.8037171214818954, + 0.03273938596248627, + 0.05161215364933014 + ], + "unique_experts": 62, + "load_cv": 0.7573508083534211, + "normalized_load_entropy": 0.9262391276453754, + "max_load_share": 0.044444444444444446 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "c964bbd3a707c0d79c1b5995e8a93e5aa50b1a97d5a9dac793482814d35a7bc2", + "route_weight_sha256": "31c7587b377389f3fd07eb59f10a995c8dabc413bc71745ce2ed9684336e247b", + "loads": [ + 2, + 16, + 2, + 26, + 9, + 8, + 9, + 13, + 25, + 2, + 20, + 8, + 23, + 10, + 6, + 13, + 1, + 9, + 20, + 9, + 3, + 15, + 3, + 4, + 2, + 26, + 23, + 20, + 10, + 8, + 29, + 27, + 2, + 27, + 4, + 17, + 2, + 1, + 19, + 22, + 38, + 16, + 16, + 13, + 15, + 24, + 10, + 24, + 27, + 7, + 2, + 24, + 13, + 30, + 8, + 20, + 17, + 9, + 10, + 13, + 13, + 18, + 7, + 1 + ], + "weighted_loads": [ + 0.07064146548509598, + 0.6562135070562363, + 0.07047116197645664, + 1.7734776549041271, + 0.30669502168893814, + 0.3493598513305187, + 0.5025705844163895, + 0.7923496291041374, + 1.0391363445669413, + 0.196756973862648, + 1.024239368736744, + 0.2889612577855587, + 1.2779645584523678, + 0.49208464100956917, + 0.22906814143061638, + 0.508708817884326, + 0.013262412510812283, + 0.33191332779824734, + 0.8515168633311987, + 0.8131786026060581, + 0.11739926971495152, + 0.8244183259084821, + 0.1767653226852417, + 0.4351251535117626, + 0.07172239944338799, + 1.945670310407877, + 1.2499451898038387, + 1.5312548391520977, + 0.43526702001690865, + 0.5534833669662476, + 1.173775628209114, + 1.1519568488001823, + 0.07671782188117504, + 1.3187028709799051, + 0.16731156408786774, + 0.9983097463846207, + 0.11343783885240555, + 0.03616590052843094, + 1.5568990856409073, + 0.8386751711368561, + 1.4767933674156666, + 0.9171314463019371, + 1.041702950373292, + 1.1666635796427727, + 1.4010716564953327, + 1.0369694605469704, + 0.5287048369646072, + 1.129464726895094, + 1.3366673365235329, + 0.38906656950712204, + 0.061356453225016594, + 1.350359484553337, + 0.7386712804436684, + 1.573922068811953, + 0.283653037622571, + 1.359938871115446, + 0.9853236433118582, + 0.5372777432203293, + 0.3498552404344082, + 0.6127265393733978, + 0.6237962581217289, + 0.8037171214818954, + 0.3372931517660618, + 0.05161215364933014 + ], + "unique_experts": 64, + "load_cv": 0.6607546021077965, + "normalized_load_entropy": 0.9428679171768325, + "max_load_share": 0.04367816091954023 + } + }, + "s1_bos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "ace90bbf989cfa4d2d0a4a08668eb853a4fc5572040bced6a5f76e06f5239f06", + "route_weight_sha256": "5c9d8a339c37efe35d4ba6af623b95b21d8377f04af2119b0177502a59913576", + "loads": [ + 3, + 14, + 0, + 27, + 5, + 8, + 8, + 12, + 15, + 2, + 14, + 10, + 22, + 5, + 1, + 9, + 1, + 6, + 20, + 8, + 3, + 5, + 3, + 5, + 2, + 24, + 15, + 14, + 7, + 7, + 27, + 20, + 1, + 26, + 3, + 7, + 5, + 1, + 19, + 15, + 31, + 15, + 15, + 13, + 15, + 23, + 12, + 22, + 16, + 4, + 2, + 18, + 2, + 27, + 6, + 18, + 17, + 10, + 7, + 12, + 14, + 19, + 2, + 1 + ], + "weighted_loads": [ + 0.10784529522061348, + 0.564949644729495, + 0.0, + 1.6985863093286753, + 0.16045528650283813, + 0.3458459936082363, + 0.32434594444930553, + 0.7386437505483627, + 0.6561782360076904, + 0.19155720993876457, + 0.709625905379653, + 0.36843824572861195, + 1.229576788842678, + 0.2156489472836256, + 0.0459924079477787, + 0.34283226914703846, + 0.02696117013692856, + 0.21049496345221996, + 0.8387090787291527, + 0.26730369962751865, + 0.1178971417248249, + 0.2596017401665449, + 0.18407297506928444, + 0.4330724664032459, + 0.07077678292989731, + 1.8333189971745014, + 0.8327549230307341, + 1.0412295684218407, + 0.32908521965146065, + 0.4860397204756737, + 1.0827941093593836, + 0.7300357464700937, + 0.05202861875295639, + 1.245773209258914, + 0.12868503481149673, + 0.43414582312107086, + 0.24168424680829048, + 0.03786096349358559, + 1.5388160571455956, + 0.5765418652445078, + 1.225421441718936, + 0.870967797935009, + 0.8728700764477253, + 1.1239679083228111, + 1.3464688584208488, + 0.9508669711649418, + 0.6612287778407335, + 0.9807450100779533, + 0.7224576938897371, + 0.1969185248017311, + 0.06527207046747208, + 1.067905679345131, + 0.07727638632059097, + 1.5052386242896318, + 0.2336769998073578, + 1.0706973876804113, + 0.9996259175240993, + 0.5987455770373344, + 0.2710843700915575, + 0.6317249536514282, + 0.6502027437090874, + 0.8361785393208265, + 0.06975258700549603, + 0.054810114204883575 + ], + "unique_experts": 63, + "load_cv": 0.7192245481192115, + "normalized_load_entropy": 0.9331807284219102, + "max_load_share": 0.043055555555555555 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "cc434f3c766574870e2c2c1a04e1e909f92fff479174f4d698593b14e9ef963e", + "route_weight_sha256": "5f5529f62efb31b152b967004c4df008c0a2d72853b66c104295b84a992452cd", + "loads": [ + 11, + 16, + 2, + 27, + 8, + 9, + 14, + 14, + 19, + 4, + 22, + 12, + 27, + 14, + 7, + 12, + 2, + 13, + 24, + 12, + 4, + 13, + 5, + 10, + 3, + 26, + 23, + 25, + 9, + 8, + 33, + 22, + 2, + 30, + 3, + 22, + 6, + 2, + 20, + 17, + 34, + 17, + 23, + 14, + 16, + 24, + 12, + 22, + 27, + 8, + 3, + 28, + 12, + 28, + 19, + 27, + 21, + 10, + 8, + 15, + 15, + 20, + 9, + 2 + ], + "weighted_loads": [ + 0.619765380397439, + 0.6476402040570974, + 0.691111484542489, + 1.6985863093286753, + 0.27520568668842316, + 0.3614117559045553, + 0.6322697382420301, + 0.8597522862255573, + 0.8440902642905712, + 0.33989450335502625, + 1.131511377170682, + 0.472769046202302, + 1.4812877923250198, + 0.6878379732370377, + 0.29377066902816296, + 0.4605187550187111, + 0.04022358264774084, + 0.4920224454253912, + 1.0101922359317541, + 0.8946576062589884, + 0.1648811250925064, + 0.7528452714905143, + 0.24211066402494907, + 0.9198974370956421, + 0.10631334036588669, + 1.904608491808176, + 1.118670480325818, + 1.9581517241895199, + 0.3603097256273031, + 0.5348509587347507, + 1.3212864138185978, + 0.865275913849473, + 0.07466238364577293, + 1.8395443093031645, + 0.12868503481149673, + 1.2872184962034225, + 0.31257573887705803, + 0.07855752110481262, + 1.594171416014433, + 0.6465795766562223, + 1.3509633708745241, + 0.996479719877243, + 1.282921388745308, + 1.1664529964327812, + 1.4058495126664639, + 1.010470811277628, + 0.6612287778407335, + 0.9807450100779533, + 1.5573887098580599, + 1.1918769143521786, + 0.11885347589850426, + 1.7763579972088337, + 0.6830289661884308, + 1.518251252360642, + 0.9983769152313471, + 1.681499157100916, + 1.15893891826272, + 0.5987455770373344, + 0.2960336711257696, + 0.7920683547854424, + 0.6726241987198591, + 0.898688143119216, + 0.4047131557017565, + 0.14513173699378967 + ], + "unique_experts": 64, + "load_cv": 0.5767114099724676, + "normalized_load_entropy": 0.9561939317840806, + "max_load_share": 0.035196687370600416 + } + }, + "s0_x": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "f2feff2f806612f9c349ed50289832fb57c7be21bf64c2155649a42b73fb11a7", + "route_weight_sha256": "39094e09a95510ea4b31cdb456230efe1835e5c407aad783162f82ab81305407", + "loads": [ + 3, + 13, + 0, + 22, + 5, + 9, + 7, + 13, + 15, + 2, + 15, + 9, + 23, + 5, + 1, + 8, + 2, + 7, + 18, + 8, + 2, + 4, + 3, + 5, + 2, + 24, + 17, + 14, + 7, + 8, + 29, + 23, + 3, + 25, + 6, + 7, + 5, + 1, + 19, + 19, + 27, + 14, + 12, + 13, + 15, + 19, + 12, + 23, + 16, + 5, + 1, + 18, + 2, + 31, + 5, + 22, + 17, + 10, + 8, + 12, + 12, + 17, + 0, + 1 + ], + "weighted_loads": [ + 0.11293882317841053, + 0.5166490878909826, + 0.0, + 1.3523921314626932, + 0.16118904761970043, + 0.38811079040169716, + 0.2842988669872284, + 0.7376685068011284, + 0.6341095305979252, + 0.18919406831264496, + 0.7347868140786886, + 0.31179723516106606, + 1.1755415499210358, + 0.21361217461526394, + 0.04785482957959175, + 0.3221100028604269, + 0.06055259890854359, + 0.25265468657016754, + 0.7702231537550688, + 0.2668850254267454, + 0.07414393313229084, + 0.2252563238143921, + 0.17161394655704498, + 0.4929595850408077, + 0.0716706644743681, + 1.9467177838087082, + 0.9138098265975714, + 1.1169375963509083, + 0.3448798842728138, + 0.5390456914901733, + 1.1590649727731943, + 0.8521764893084764, + 0.11198780499398708, + 1.197699397802353, + 0.23141976818442345, + 0.4062824733555317, + 0.23351481929421425, + 0.037863850593566895, + 1.6303292475640774, + 0.7349977008998394, + 1.0451832730323076, + 0.8187201507389545, + 0.8649552222341299, + 1.2195346243679523, + 1.362764660269022, + 0.812350045889616, + 0.6525390073657036, + 1.0873772948980331, + 0.7824771963059902, + 0.21209659427404404, + 0.03367946669459343, + 1.0350646004080772, + 0.08709384873509407, + 1.6103578433394432, + 0.1737046279013157, + 1.3176110479980707, + 0.9977277666330338, + 0.5528927929699421, + 0.2848028801381588, + 0.5472612418234348, + 0.5815348476171494, + 0.7513195462524891, + 0.0, + 0.05230442062020302 + ], + "unique_experts": 62, + "load_cv": 0.7164728420068226, + "normalized_load_entropy": 0.9330965683644984, + "max_load_share": 0.043055555555555555 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "26a1965f5cb5e31676d3f5dbc38d7bc9dfb44467f43ed2cb539f4f2ad5d9160f", + "route_weight_sha256": "644c79cbd86fbb7eae762625b9a16838e90b1925cf307223b6719ac7b98015f2", + "loads": [ + 3, + 13, + 2, + 22, + 11, + 9, + 10, + 13, + 17, + 2, + 23, + 10, + 26, + 9, + 5, + 12, + 4, + 12, + 19, + 12, + 2, + 10, + 3, + 6, + 2, + 25, + 25, + 19, + 10, + 8, + 30, + 24, + 4, + 25, + 7, + 18, + 5, + 1, + 19, + 20, + 30, + 15, + 18, + 13, + 15, + 19, + 12, + 23, + 29, + 8, + 1, + 25, + 12, + 32, + 10, + 25, + 19, + 10, + 9, + 14, + 12, + 17, + 4, + 1 + ], + "weighted_loads": [ + 0.11293882317841053, + 0.5166490878909826, + 0.07047116197645664, + 1.3523921314626932, + 0.39111769013106823, + 0.38811079040169716, + 0.5391629450023174, + 0.7376685068011284, + 0.7572160549461842, + 0.18919406831264496, + 1.1412120554596186, + 0.36019571498036385, + 1.316407322883606, + 0.4682535845786333, + 0.20299701765179634, + 0.4768807999789715, + 0.11776070762425661, + 0.43742308020591736, + 0.8079475443810225, + 0.9149126894772053, + 0.07414393313229084, + 0.6481442982330918, + 0.17161394655704498, + 0.5373170003294945, + 0.0716706644743681, + 1.9827859736979008, + 1.2934064734727144, + 1.5408941768109798, + 0.4492405317723751, + 0.5390456914901733, + 1.19483901001513, + 0.9164631012827158, + 0.13482074066996574, + 1.197699397802353, + 0.28168995678424835, + 1.0820292867720127, + 0.23351481929421425, + 0.037863850593566895, + 1.6303292475640774, + 0.7677494809031487, + 1.1569736208766699, + 0.8539278544485569, + 1.185050604864955, + 1.2195346243679523, + 1.362764660269022, + 0.812350045889616, + 0.6525390073657036, + 1.0873772948980331, + 1.4998611602932215, + 0.44568154960870743, + 0.03367946669459343, + 1.3515767194330692, + 0.8555539026856422, + 1.6233704714104533, + 0.3453883733600378, + 1.5520656891167164, + 1.081845298409462, + 0.5528927929699421, + 0.3094544466584921, + 0.6117597408592701, + 0.5815348476171494, + 0.7513195462524891, + 0.18814022094011307, + 0.05230442062020302 + ], + "unique_experts": 64, + "load_cv": 0.6180403228478495, + "normalized_load_entropy": 0.949874506749194, + "max_load_share": 0.0367816091954023 + } + }, + "s1_x": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "9e1cc0fe58fb3b6586c4f4d9109ea017d4df2f4dd78508d3f63db06b95f60b3a", + "route_weight_sha256": "9e914e7ec5afe29adcaef8c4080d47a892d77d2636577e8781486a9ada51a61d", + "loads": [ + 3, + 13, + 0, + 23, + 4, + 9, + 8, + 13, + 17, + 4, + 15, + 7, + 22, + 5, + 2, + 8, + 2, + 5, + 17, + 8, + 3, + 3, + 3, + 4, + 1, + 26, + 11, + 14, + 9, + 6, + 30, + 20, + 1, + 25, + 7, + 6, + 3, + 1, + 19, + 14, + 28, + 14, + 12, + 13, + 15, + 21, + 13, + 26, + 18, + 5, + 1, + 17, + 2, + 36, + 5, + 20, + 14, + 10, + 9, + 12, + 14, + 21, + 2, + 1 + ], + "weighted_loads": [ + 0.12075784429907799, + 0.479753689840436, + 0.0, + 1.350142927840352, + 0.12026635557413101, + 0.3680764175951481, + 0.35127207450568676, + 0.760904636234045, + 0.6727098822593689, + 0.2402210310101509, + 0.7379672415554523, + 0.28642333298921585, + 1.155267346650362, + 0.23408642411231995, + 0.07839363068342209, + 0.31206968799233437, + 0.06456245854496956, + 0.1720469743013382, + 0.7155181095004082, + 0.2639712020754814, + 0.11849617958068848, + 0.19335748627781868, + 0.1754102259874344, + 0.3979273550212383, + 0.03139413148164749, + 1.9016346875578165, + 0.6501043755561113, + 1.0629400126636028, + 0.3802208695560694, + 0.42469828575849533, + 1.1794532481580973, + 0.7150462716817856, + 0.0526479035615921, + 1.1274369172751904, + 0.26429107785224915, + 0.3805769830942154, + 0.15620151534676552, + 0.03997300565242767, + 1.4790456108748913, + 0.5121323242783546, + 1.2015390768647194, + 0.7662640120834112, + 0.7763880230486393, + 1.1401803381741047, + 1.2391319200396538, + 0.8557183034718037, + 0.736681129783392, + 1.1177333742380142, + 0.8596222214400768, + 0.22903957590460777, + 0.032282501459121704, + 1.0341314766556025, + 0.07685190066695213, + 2.0130112878978252, + 0.19153547659516335, + 1.1245899721980095, + 0.8845635615289211, + 0.5279200151562691, + 0.3133303038775921, + 0.6100653875619173, + 0.6697624921798706, + 0.948499534279108, + 0.07429361343383789, + 0.05399646982550621 + ], + "unique_experts": 63, + "load_cv": 0.7484964352488573, + "normalized_load_entropy": 0.930178518473008, + "max_load_share": 0.05 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "dceef46fe85d1acd73375d0ab0f896893b4c6f064379fc9aa16a027f58826d68", + "route_weight_sha256": "49de33d27d4b8d43c4c1164755e1469b99f8d8718f8bf465d479ff8e02f87c15", + "loads": [ + 12, + 14, + 2, + 23, + 5, + 10, + 12, + 14, + 19, + 6, + 25, + 8, + 29, + 15, + 10, + 11, + 3, + 11, + 20, + 12, + 4, + 10, + 5, + 11, + 2, + 30, + 19, + 24, + 11, + 7, + 36, + 20, + 2, + 29, + 7, + 22, + 4, + 2, + 20, + 16, + 30, + 17, + 23, + 14, + 16, + 22, + 13, + 26, + 32, + 8, + 2, + 27, + 13, + 37, + 17, + 30, + 18, + 10, + 10, + 15, + 15, + 22, + 5, + 2 + ], + "weighted_loads": [ + 0.6611719876527786, + 0.5272703114897013, + 0.691111484542489, + 1.350142927840352, + 0.15053179115056992, + 0.3836421798914671, + 0.4955614861100912, + 0.8426869623363018, + 0.7754745930433273, + 0.3885583244264126, + 1.2308527138084173, + 0.32895921543240547, + 1.4885983876883984, + 0.7480961438268423, + 0.3908285144716501, + 0.43461876176297665, + 0.07782487105578184, + 0.4083753116428852, + 0.819115387275815, + 0.8861578851938248, + 0.16548016294836998, + 0.6469454364851117, + 0.23344791494309902, + 0.9768984355032444, + 0.06693068891763687, + 2.063978213816881, + 0.9360199328511953, + 1.9075671695172787, + 0.41144537553191185, + 0.4735095240175724, + 1.4151529781520367, + 0.7150462716817856, + 0.07528166845440865, + 1.7212080173194408, + 0.26429107785224915, + 1.3007310256361961, + 0.22709300741553307, + 0.08066956326365471, + 1.5344009697437286, + 0.5942368805408478, + 1.277074858546257, + 0.9712317418307066, + 1.3558123223483562, + 1.1826654262840748, + 1.2985125742852688, + 0.9153221435844898, + 0.736681129783392, + 1.1177333742380142, + 1.955351386219263, + 1.131077580153942, + 0.08586390689015388, + 1.7425837945193052, + 0.8892565257847309, + 2.0260239159688354, + 0.8863086085766554, + 1.7928277757018805, + 1.0438765622675419, + 0.5279200151562691, + 0.3382796049118042, + 0.7704087886959314, + 0.6921839471906424, + 1.0110091380774975, + 0.19701732695102692, + 0.1443180926144123 + ], + "unique_experts": 64, + "load_cv": 0.6063920297276629, + "normalized_load_entropy": 0.9532242554158963, + "max_load_share": 0.038302277432712216 + } + }, + "s0_period": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "712434a54eb13ceb08cc234a6cad2665c20bf6c44995a3e831328665a995b489", + "route_weight_sha256": "81624bbbe7c9da30887a2bd5554b7a5aabc2a56d71a818cb646535be6d0d46da", + "loads": [ + 3, + 14, + 0, + 24, + 6, + 10, + 7, + 13, + 15, + 2, + 16, + 9, + 25, + 5, + 1, + 10, + 1, + 7, + 15, + 7, + 2, + 7, + 3, + 5, + 2, + 24, + 16, + 14, + 7, + 8, + 30, + 19, + 2, + 27, + 5, + 7, + 3, + 1, + 19, + 16, + 31, + 14, + 12, + 13, + 15, + 20, + 10, + 23, + 16, + 3, + 2, + 17, + 4, + 29, + 4, + 21, + 17, + 10, + 7, + 13, + 15, + 16, + 0, + 1 + ], + "weighted_loads": [ + 0.10541966557502747, + 0.554301830008626, + 0.0, + 1.4732864499092102, + 0.19067175313830376, + 0.41068604961037636, + 0.30377744883298874, + 0.760309137403965, + 0.6092447359114885, + 0.18670296296477318, + 0.7624475713819265, + 0.33659573271870613, + 1.280617056414485, + 0.22222253680229187, + 0.05122920125722885, + 0.39335239492356777, + 0.030601050704717636, + 0.23676453717052937, + 0.6652023773640394, + 0.2372029460966587, + 0.07526879385113716, + 0.3333307020366192, + 0.17410599067807198, + 0.49452192708849907, + 0.07069064676761627, + 1.9279017224907875, + 0.8751652967184782, + 1.0964146107435226, + 0.3235294446349144, + 0.528308616951108, + 1.1872543543577194, + 0.7389916758984327, + 0.08613330870866776, + 1.2770477291196585, + 0.19412092491984367, + 0.40085247717797756, + 0.1447250247001648, + 0.03767242655158043, + 1.598473072052002, + 0.6308234259486198, + 1.1779916230589151, + 0.8404853008687496, + 0.8347365371882915, + 1.2189090549945831, + 1.3611190132796764, + 0.8498539943248034, + 0.5545899514108896, + 1.0887846872210503, + 0.7806297894567251, + 0.15384292602539062, + 0.06544926390051842, + 1.0651497542858124, + 0.1478492822498083, + 1.5662310048937798, + 0.14247311651706696, + 1.3186344914138317, + 0.9730367083102465, + 0.5315573550760746, + 0.2632064074277878, + 0.6051813717931509, + 0.7070269882678986, + 0.695622343569994, + 0.0, + 0.05140496790409088 + ], + "unique_experts": 62, + "load_cv": 0.727586913055329, + "normalized_load_entropy": 0.931669246964714, + "max_load_share": 0.043055555555555555 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "9d7acbe2ad2733ad5743b0d5c3451880e51c6f93791eb1d86b6e78bb7affae8b", + "route_weight_sha256": "d9c479a295742d493f9852008417c857dcdc1c9261e0e3664b071083a31e8007", + "loads": [ + 3, + 14, + 2, + 24, + 13, + 10, + 11, + 13, + 17, + 2, + 22, + 10, + 28, + 11, + 5, + 15, + 2, + 11, + 17, + 11, + 2, + 13, + 3, + 6, + 2, + 25, + 24, + 19, + 10, + 8, + 31, + 20, + 3, + 27, + 6, + 18, + 3, + 1, + 19, + 18, + 33, + 15, + 16, + 13, + 15, + 21, + 10, + 23, + 28, + 5, + 2, + 25, + 13, + 30, + 9, + 25, + 18, + 10, + 8, + 16, + 15, + 16, + 4, + 1 + ], + "weighted_loads": [ + 0.10541966557502747, + 0.554301830008626, + 0.07047116197645664, + 1.4732864499092102, + 0.45067521184682846, + 0.41068604961037636, + 0.6236255653202534, + 0.760309137403965, + 0.7343334574252367, + 0.18670296296477318, + 1.080572148784995, + 0.38398123905062675, + 1.4266778323799372, + 0.5613001324236393, + 0.20285895839333534, + 0.5879709981381893, + 0.04386346321552992, + 0.39204283617436886, + 0.7387875374406576, + 0.8816647939383984, + 0.07526879385113716, + 0.7562186764553189, + 0.17410599067807198, + 0.5388793423771858, + 0.07069064676761627, + 1.96396991237998, + 1.2547619435936213, + 1.5109135061502457, + 0.4207201339304447, + 0.528308616951108, + 1.2238119132816792, + 0.80656941793859, + 0.10896624438464642, + 1.2770477291196585, + 0.24439111351966858, + 1.0446758139878511, + 0.1447250247001648, + 0.03767242655158043, + 1.598473072052002, + 0.7069721594452858, + 1.2563221212476492, + 0.875693004578352, + 1.0803922079503536, + 1.2189090549945831, + 1.3611190132796764, + 0.8915851507335901, + 0.5545899514108896, + 1.0887846872210503, + 1.447668882086873, + 0.39246125519275665, + 0.06544926390051842, + 1.4420171491801739, + 0.730797627940774, + 1.5792436329647899, + 0.31504438258707523, + 1.6276479046791792, + 1.0137471351772547, + 0.5315573550760746, + 0.28785797394812107, + 0.7581536751240492, + 0.7070269882678986, + 0.695622343569994, + 0.19921853207051754, + 0.05140496790409088 + ], + "unique_experts": 64, + "load_cv": 0.6287555944634065, + "normalized_load_entropy": 0.9477937841408461, + "max_load_share": 0.03793103448275862 + } + }, + "s1_period": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "b7c6c78a5f8d02ac87561815c8bf51ab314644efebc8a1f8b6aec4a979297718", + "route_weight_sha256": "3924d597e497a502d15a3b89fbec6051580c5daacf008f1e19421138d55eb145", + "loads": [ + 3, + 12, + 0, + 24, + 3, + 9, + 8, + 13, + 14, + 2, + 16, + 7, + 24, + 7, + 1, + 6, + 0, + 4, + 19, + 6, + 3, + 4, + 3, + 4, + 2, + 27, + 12, + 15, + 10, + 6, + 30, + 18, + 1, + 23, + 7, + 6, + 4, + 1, + 19, + 14, + 29, + 14, + 12, + 13, + 15, + 21, + 12, + 26, + 19, + 6, + 1, + 20, + 2, + 37, + 7, + 20, + 15, + 10, + 6, + 13, + 16, + 16, + 2, + 1 + ], + "weighted_loads": [ + 0.12317358888685703, + 0.4312824737280607, + 0.0, + 1.4223467521369457, + 0.08883446455001831, + 0.3752022311091423, + 0.3514272943139076, + 0.7627287060022354, + 0.571971956640482, + 0.17920030653476715, + 0.7674155738204718, + 0.2768363058567047, + 1.2907127104699612, + 0.3057469595223665, + 0.045243486762046814, + 0.23764048516750336, + 0.0, + 0.14809546992182732, + 0.7867792509496212, + 0.20477816462516785, + 0.1200290098786354, + 0.2209431566298008, + 0.17343009263277054, + 0.39494528621435165, + 0.0701487846672535, + 1.9923855140805244, + 0.6965309735387564, + 1.0293116979300976, + 0.4149256646633148, + 0.41636547073721886, + 1.1893155463039875, + 0.6649530213326216, + 0.05305827036499977, + 1.0415960066020489, + 0.26438574865460396, + 0.37873878702521324, + 0.19396138563752174, + 0.03980784863233566, + 1.4709077700972557, + 0.5103136263787746, + 1.2392582520842552, + 0.7920831181108952, + 0.7735695205628872, + 1.1474198885262012, + 1.2169360630214214, + 0.8353180680423975, + 0.7307590842247009, + 1.116186324506998, + 0.9112510997802019, + 0.25912272557616234, + 0.031730569899082184, + 1.2017052918672562, + 0.07796130329370499, + 2.0404528006911278, + 0.2670385129749775, + 1.1776840668171644, + 0.9566079787909985, + 0.5276490598917007, + 0.23245672695338726, + 0.6500980574637651, + 0.7340581528842449, + 0.7170704640448093, + 0.07596271857619286, + 0.05708479881286621 + ], + "unique_experts": 62, + "load_cv": 0.7646511348482334, + "normalized_load_entropy": 0.9265069681824443, + "max_load_share": 0.05138888888888889 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "da25a84fa3a92e773d85842c16307229381a07ded1f81f5a015cd9a7280ad80e", + "route_weight_sha256": "57c9066ef22f8c4f7ce48d3833afef78ce54d9326b300478d5ff0cdd012b4985", + "loads": [ + 11, + 13, + 2, + 24, + 4, + 10, + 13, + 14, + 17, + 4, + 24, + 8, + 29, + 17, + 9, + 8, + 2, + 9, + 23, + 10, + 4, + 12, + 5, + 11, + 3, + 29, + 20, + 24, + 12, + 7, + 36, + 18, + 2, + 27, + 7, + 23, + 5, + 3, + 20, + 17, + 32, + 16, + 23, + 14, + 16, + 22, + 12, + 26, + 32, + 9, + 2, + 31, + 12, + 38, + 20, + 31, + 19, + 10, + 7, + 17, + 17, + 17, + 5, + 2 + ], + "weighted_loads": [ + 0.6350936740636826, + 0.478799095377326, + 0.691111484542489, + 1.4223467521369457, + 0.12024735659360886, + 0.3907679934054613, + 0.5650795623660088, + 0.8445110321044922, + 0.7149928994476795, + 0.3275375999510288, + 1.1902477573603392, + 0.3170991837978363, + 1.5674642473459244, + 0.8292621858417988, + 0.3704759683459997, + 0.314589099958539, + 0.04964583273977041, + 0.35255278274416924, + 0.9348790999501944, + 0.829685814678669, + 0.1670129932463169, + 0.7064486900344491, + 0.23146778158843517, + 1.0000263154506683, + 0.10568534210324287, + 2.063675008714199, + 0.9824465308338404, + 1.8063553869724274, + 0.4461501706391573, + 0.46517670899629593, + 1.4298112783581018, + 0.6649530213326216, + 0.07569203525781631, + 1.6353671066462994, + 0.26438574865460396, + 1.3139198385179043, + 0.2648528777062893, + 0.10794435441493988, + 1.526263128966093, + 0.635882880538702, + 1.356835462152958, + 0.9175950400531292, + 1.3587678037583828, + 1.1899049766361713, + 1.2763167172670364, + 0.8949219081550837, + 0.7307590842247009, + 1.116186324506998, + 1.849514851346612, + 1.2623343728482723, + 0.08531197533011436, + 1.9728922583162785, + 0.6837138831615448, + 2.053465428762138, + 1.01623753644526, + 1.8909283205866814, + 1.1159209795296192, + 0.5276490598917007, + 0.2574060279875994, + 0.883508550003171, + 0.7564796078950167, + 0.7795800678431988, + 0.19808253645896912, + 0.1474064216017723 + ], + "unique_experts": 64, + "load_cv": 0.6237865381028086, + "normalized_load_entropy": 0.9509637159211075, + "max_load_share": 0.039337474120082816 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 120, + "ordered_topk_exact_tokens": 37, + "set_exact_tokens": 59, + "mean_set_jaccard": 0.8422619047619049, + "mean_token_weighted_tv": 0.02878655563108623, + "aggregate_load_tv": 0.05 + }, + "system_bos": { + "tokens": 120, + "ordered_topk_exact_tokens": 41, + "set_exact_tokens": 67, + "mean_set_jaccard": 0.8509920634920634, + "mean_token_weighted_tv": 0.03035648853207628, + "aggregate_load_tv": 0.04583333333333334 + }, + "system_x": { + "tokens": 120, + "ordered_topk_exact_tokens": 22, + "set_exact_tokens": 37, + "mean_set_jaccard": 0.7553571428571428, + "mean_token_weighted_tv": 0.04850915587351968, + "aggregate_load_tv": 0.05138888888888889 + }, + "system_period": { + "tokens": 120, + "ordered_topk_exact_tokens": 27, + "set_exact_tokens": 45, + "mean_set_jaccard": 0.7748809523809524, + "mean_token_weighted_tv": 0.04575048498809338, + "aggregate_load_tv": 0.06527777777777777 + }, + "bos_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 32, + "set_exact_tokens": 53, + "mean_set_jaccard": 0.8044444444444445, + "mean_token_weighted_tv": 0.03824764585588127, + "aggregate_load_tv": 0.058333333333333334 + }, + "bos_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 34, + "set_exact_tokens": 51, + "mean_set_jaccard": 0.8164682539682542, + "mean_token_weighted_tv": 0.03600699607438097, + "aggregate_load_tv": 0.058333333333333334 + }, + "x_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 23, + "set_exact_tokens": 39, + "mean_set_jaccard": 0.7686507936507937, + "mean_token_weighted_tv": 0.04231276123318821, + "aggregate_load_tv": 0.05694444444444444 + }, + "x_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 21, + "set_exact_tokens": 35, + "mean_set_jaccard": 0.752063492063492, + "mean_token_weighted_tv": 0.047796272377793984, + "aggregate_load_tv": 0.06249999999999999 + }, + "period_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 35, + "set_exact_tokens": 51, + "mean_set_jaccard": 0.7926587301587301, + "mean_token_weighted_tv": 0.04010361485028018, + "aggregate_load_tv": 0.05 + }, + "period_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 21, + "set_exact_tokens": 39, + "mean_set_jaccard": 0.7615873015873016, + "mean_token_weighted_tv": 0.047167102922685444, + "aggregate_load_tv": 0.06805555555555556 + } + } + }, + "layer_22": { + "layer": 22, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "ced67f1c981540bcc3e38c9cb51b26cc663f86792885c378d91dd9c2b0639efa", + "route_weight_sha256": "dce63d450567271fecb84f17cabcfbb14a243d31b32dfe1f397bef905264b480", + "loads": [ + 26, + 26, + 15, + 8, + 5, + 36, + 12, + 12, + 13, + 30, + 13, + 1, + 3, + 3, + 6, + 5, + 2, + 4, + 5, + 14, + 17, + 15, + 12, + 5, + 24, + 7, + 3, + 1, + 4, + 8, + 6, + 11, + 16, + 14, + 2, + 10, + 9, + 4, + 1, + 21, + 5, + 8, + 22, + 1, + 24, + 2, + 12, + 15, + 7, + 5, + 22, + 4, + 15, + 10, + 15, + 23, + 3, + 18, + 4, + 1, + 18, + 22, + 19, + 16 + ], + "weighted_loads": [ + 1.7894747853279114, + 1.0446774177253246, + 1.6771044954657555, + 0.7019319348037243, + 0.2281789593398571, + 1.475461058318615, + 0.34454462956637144, + 5.325028017163277, + 0.66593212261796, + 2.2438692282885313, + 0.6167082134634256, + 0.03603217005729675, + 0.17973461002111435, + 0.08162136934697628, + 0.3472505174577236, + 0.18159672245383263, + 0.11520401388406754, + 0.14430374279618263, + 0.24445149675011635, + 0.6874593179672956, + 0.6838085912168026, + 0.9170390609651804, + 0.5073962323367596, + 0.29426462203264236, + 0.9957581534981728, + 0.2662343271076679, + 0.09656380116939545, + 0.04082382097840309, + 0.29038335755467415, + 0.33269070088863373, + 0.22228511609137058, + 0.45914940163493156, + 0.5886402297765017, + 0.5786469355225563, + 0.038126745261251926, + 0.3568302094936371, + 0.49865059554576874, + 0.14166608452796936, + 0.11431803554296494, + 1.262410692870617, + 0.6090178936719894, + 0.5572057403624058, + 0.8785288538783789, + 0.03244692087173462, + 1.1782656162977219, + 0.074002955108881, + 0.6812673453241587, + 0.6330632120370865, + 0.3192418087273836, + 0.21366729587316513, + 0.8662638161331415, + 0.48488353937864304, + 0.7998729981482029, + 0.40748320519924164, + 0.7409706320613623, + 1.3621410839259624, + 0.1621887944638729, + 0.8658629953861237, + 0.2248545102775097, + 0.05713634938001633, + 1.531245930120349, + 1.1375873610377312, + 1.089877713471651, + 0.7860729992389679 + ], + "unique_experts": 64, + "load_cv": 0.7294510027631045, + "normalized_load_entropy": 0.935059575363401, + "max_load_share": 0.05 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "ea6fc7b85b489b37385f4dbc0522cbf63440b68865bea2712f16e96860167819", + "route_weight_sha256": "4ce009bf0aa898b1badb7104d6b98c8f08c937bb64abff2590d935b5f7c3b07f", + "loads": [ + 31, + 27, + 17, + 17, + 5, + 38, + 16, + 12, + 28, + 35, + 13, + 3, + 3, + 3, + 12, + 5, + 2, + 6, + 5, + 14, + 18, + 22, + 13, + 5, + 24, + 8, + 3, + 6, + 4, + 8, + 7, + 11, + 19, + 22, + 3, + 12, + 9, + 6, + 1, + 21, + 9, + 9, + 27, + 1, + 24, + 3, + 13, + 15, + 11, + 7, + 25, + 4, + 16, + 12, + 15, + 37, + 6, + 19, + 4, + 1, + 27, + 30, + 19, + 22 + ], + "weighted_loads": [ + 1.989384631626308, + 1.0900357477366924, + 1.7558531537652016, + 2.5794258303940296, + 0.2281789593398571, + 1.5463595343753695, + 0.5645446730777621, + 5.325028017163277, + 1.8814708665013313, + 2.4336067289114, + 0.6167082134634256, + 0.06549283675849438, + 0.17973461002111435, + 0.08162136934697628, + 1.3055055541917682, + 0.18159672245383263, + 0.11520401388406754, + 0.20326399244368076, + 0.24445149675011635, + 0.6874593179672956, + 0.7260145880281925, + 1.430146999657154, + 0.5376645755022764, + 0.29426462203264236, + 0.9957581534981728, + 0.29236460104584694, + 0.09656380116939545, + 0.22744047455489635, + 0.29038335755467415, + 0.33269070088863373, + 0.24547507241368294, + 0.45914940163493156, + 0.6638634367845953, + 0.8908722046762705, + 0.0959772216156125, + 0.4892624691128731, + 0.49865059554576874, + 0.2193137276917696, + 0.11431803554296494, + 1.262410692870617, + 0.8327703401446342, + 0.6003778874874115, + 1.1872202400118113, + 0.03244692087173462, + 1.1782656162977219, + 0.10153633542358875, + 0.7227532584220171, + 0.6330632120370865, + 0.4815408606082201, + 0.3996949978172779, + 1.0335081163793802, + 0.48488353937864304, + 0.9169849492609501, + 0.4702029135078192, + 0.7409706320613623, + 2.4889013678766787, + 0.29021403938531876, + 0.8915201015770435, + 0.2248545102775097, + 0.05713634938001633, + 2.7703732047230005, + 1.4187950361520052, + 1.089877713471651, + 1.0956287309527397 + ], + "unique_experts": 64, + "load_cv": 0.712476806565874, + "normalized_load_entropy": 0.9381979415015237, + "max_load_share": 0.04367816091954023 + } + }, + "s1_eos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "6bc1792c39a9ff03937a392c2096f8079a66b2d4321494f588e869bbb17ad744", + "route_weight_sha256": "29be9ea0891d590d67f1d2adb3f76ca8c7dff53e48cf66af2cc168885b6ce9c0", + "loads": [ + 27, + 23, + 15, + 8, + 6, + 32, + 13, + 12, + 14, + 32, + 14, + 1, + 3, + 6, + 7, + 5, + 2, + 5, + 3, + 15, + 17, + 13, + 10, + 5, + 21, + 12, + 1, + 1, + 4, + 9, + 6, + 10, + 18, + 12, + 0, + 12, + 7, + 3, + 1, + 19, + 6, + 8, + 20, + 3, + 29, + 2, + 10, + 16, + 4, + 5, + 22, + 4, + 14, + 11, + 16, + 22, + 2, + 18, + 4, + 1, + 17, + 23, + 22, + 17 + ], + "weighted_loads": [ + 1.8372098710387945, + 0.9297591913491488, + 1.6851417645812035, + 0.6840562205761671, + 0.24485160037875175, + 1.3090575877577066, + 0.38698090333491564, + 5.882295921444893, + 0.7350720204412937, + 2.2359921876341105, + 0.6824163123965263, + 0.035408347845077515, + 0.1802830882370472, + 0.15160507149994373, + 0.353118471801281, + 0.18115192838013172, + 0.11198179051280022, + 0.17582596838474274, + 0.1577741988003254, + 0.6795398760586977, + 0.6890946757048368, + 0.8243949022144079, + 0.42686646059155464, + 0.29183413088321686, + 0.9278678335249424, + 0.46779169887304306, + 0.03411111235618591, + 0.04098197817802429, + 0.2815477289259434, + 0.34637296199798584, + 0.22428098134696484, + 0.3892123494297266, + 0.6612704545259476, + 0.5079795774072409, + 0.0, + 0.4339065682142973, + 0.41700214333832264, + 0.10668801330029964, + 0.11360175162553787, + 1.1749393194913864, + 0.5710139703005552, + 0.5540774706751108, + 0.7813966237008572, + 0.10505392029881477, + 1.398718185722828, + 0.073704794049263, + 0.6105212420225143, + 0.6606932021677494, + 0.22028884664177895, + 0.2089198548346758, + 0.8480160506442189, + 0.45374399423599243, + 0.7431348543614149, + 0.4323265887796879, + 0.8214374333620071, + 1.3668243065476418, + 0.12338977307081223, + 0.8783941939473152, + 0.22610562667250633, + 0.05646299198269844, + 1.4989917986094952, + 1.1773282270878553, + 1.2511513084173203, + 0.8157369215041399 + ], + "unique_experts": 63, + "load_cv": 0.728434817914834, + "normalized_load_entropy": 0.9333454564458941, + "max_load_share": 0.044444444444444446 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "f5ddb6a87847c672d541bfe76e6e8c60d1720877a02c478a35c301360205a0fb", + "route_weight_sha256": "4cf54454fc1ffaa66b4e97e0f49e4177537e6031c8726c130ca701d0b05d739b", + "loads": [ + 29, + 29, + 15, + 19, + 6, + 34, + 18, + 13, + 36, + 41, + 14, + 6, + 6, + 6, + 12, + 9, + 5, + 7, + 4, + 15, + 19, + 27, + 11, + 5, + 21, + 13, + 1, + 5, + 5, + 9, + 8, + 10, + 20, + 23, + 8, + 17, + 9, + 6, + 1, + 20, + 17, + 9, + 25, + 5, + 29, + 3, + 11, + 18, + 8, + 7, + 32, + 7, + 20, + 13, + 16, + 43, + 6, + 19, + 7, + 1, + 32, + 33, + 22, + 21 + ], + "weighted_loads": [ + 1.9618672477081418, + 1.4259987752884626, + 1.6851417645812035, + 2.829592829570174, + 0.24485160037875175, + 1.370351959951222, + 0.6685666991397738, + 5.924262635409832, + 2.504409508779645, + 2.6929152086377144, + 0.6824163123965263, + 0.3375789299607277, + 0.32023414224386215, + 0.15160507149994373, + 1.1868005022406578, + 0.4159069340676069, + 0.25554654002189636, + 0.22600477188825607, + 0.1973729133605957, + 0.6795398760586977, + 0.776776323094964, + 1.8781921733170748, + 0.46942638978362083, + 0.29183413088321686, + 0.9278678335249424, + 0.49327101930975914, + 0.03411111235618591, + 0.18615266494452953, + 0.365129005163908, + 0.34637296199798584, + 0.3003326244652271, + 0.3892123494297266, + 0.7184917288832366, + 0.9234912246465683, + 0.34954579174518585, + 0.6590987239032984, + 0.5061491634696722, + 0.20464495941996574, + 0.11360175162553787, + 1.2152411304414272, + 1.2514771781861782, + 0.579479681327939, + 1.1185760982334614, + 0.23972006887197495, + 1.398718185722828, + 0.1115235835313797, + 0.6441440768539906, + 0.7287544570863247, + 0.389732476323843, + 0.6642582733184099, + 1.345061949454248, + 0.6546543128788471, + 1.4191001821309328, + 0.5265687964856625, + 0.8214374333620071, + 3.091174079105258, + 0.33813320100307465, + 0.9034082647413015, + 0.2962913843803108, + 0.05646299198269844, + 3.5733257681131363, + 1.5995287392288446, + 1.2511513084173203, + 1.0814261343330145 + ], + "unique_experts": 64, + "load_cv": 0.6826869039395228, + "normalized_load_entropy": 0.9448150834626851, + "max_load_share": 0.044513457556935816 + } + }, + "s0_bos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "6f473a63593d26777e881713e2a522c15379dc6cf247ba228c9e2b6ed4b5b1d5", + "route_weight_sha256": "f68058377b93d4127ab22bb9bfa4262302037f9032855bd19556cd797f2a5ca9", + "loads": [ + 26, + 23, + 15, + 9, + 7, + 29, + 13, + 12, + 14, + 29, + 12, + 2, + 3, + 6, + 8, + 6, + 2, + 5, + 3, + 13, + 14, + 15, + 12, + 4, + 29, + 10, + 1, + 2, + 5, + 6, + 5, + 11, + 14, + 12, + 0, + 11, + 7, + 2, + 2, + 21, + 5, + 7, + 24, + 1, + 30, + 2, + 11, + 17, + 8, + 4, + 24, + 6, + 14, + 10, + 15, + 22, + 3, + 19, + 4, + 1, + 19, + 17, + 20, + 17 + ], + "weighted_loads": [ + 1.9278044942766428, + 0.9482442159205675, + 1.7287993878126144, + 0.6821904014796019, + 0.3128908481448889, + 1.2346746008843184, + 0.3214761521667242, + 5.995657607913017, + 0.8001014925539494, + 2.135279305279255, + 0.6242406293749809, + 0.0730847716331482, + 0.18750938773155212, + 0.17136095464229584, + 0.40419597178697586, + 0.20716435834765434, + 0.11518890410661697, + 0.17666591703891754, + 0.17651710473001003, + 0.6030980441719294, + 0.5867528505623341, + 0.9193237293511629, + 0.5078683290630579, + 0.2720152921974659, + 1.1906987354159355, + 0.40771833434700966, + 0.03567640110850334, + 0.0826551578938961, + 0.3430216368287802, + 0.22160633094608784, + 0.1922460813075304, + 0.42265379801392555, + 0.49777971021831036, + 0.5781709086149931, + 0.0, + 0.3953316733241081, + 0.43722784146666527, + 0.07353116571903229, + 0.15814877673983574, + 1.336076132953167, + 0.6143933683633804, + 0.5799682810902596, + 0.9468281902372837, + 0.036943476647138596, + 1.4468738418072462, + 0.07645843550562859, + 0.6217360235750675, + 0.6686097141355276, + 0.36049605160951614, + 0.17439774423837662, + 0.8262304146774113, + 0.5756397470831871, + 0.7040139473974705, + 0.3862446956336498, + 0.7290363572537899, + 1.4690317250788212, + 0.16871848702430725, + 0.9038344770669937, + 0.24487464874982834, + 0.06104372814297676, + 1.5968083888292313, + 0.9270683787763119, + 1.1702992469072342, + 0.8210505954921246 + ], + "unique_experts": 63, + "load_cv": 0.7228202652129152, + "normalized_load_entropy": 0.9349878565190427, + "max_load_share": 0.041666666666666664 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "3377e2ab106ac91d2541eda85ac877e4a4b80ace4254eb82b2fb7c52b6e58274", + "route_weight_sha256": "b0d50d5a2df60624a0d66ed5836443d1ab9c1d3e44a4b21c104e8551615835d4", + "loads": [ + 30, + 24, + 17, + 17, + 7, + 30, + 16, + 13, + 27, + 34, + 13, + 3, + 3, + 6, + 11, + 7, + 2, + 6, + 3, + 13, + 15, + 22, + 13, + 4, + 30, + 11, + 1, + 8, + 5, + 7, + 6, + 11, + 16, + 21, + 1, + 15, + 7, + 5, + 2, + 21, + 9, + 8, + 29, + 1, + 30, + 3, + 12, + 17, + 13, + 6, + 26, + 6, + 15, + 12, + 15, + 35, + 6, + 21, + 4, + 1, + 29, + 25, + 20, + 24 + ], + "weighted_loads": [ + 2.0990659864619374, + 0.9966024029999971, + 1.8075480461120605, + 1.6688240971416235, + 0.3128908481448889, + 1.2472702832892537, + 0.5303127970546484, + 6.90795724093914, + 1.9414548352360725, + 2.3250168059021235, + 0.6456068716943264, + 0.08554018661379814, + 0.18750938773155212, + 0.17136095464229584, + 1.179686315357685, + 0.2503751926124096, + 0.11518890410661697, + 0.20235229097306728, + 0.17651710473001003, + 0.6030980441719294, + 0.6288692615926266, + 1.4350059740245342, + 0.5381366722285748, + 0.2720152921974659, + 1.1954840957187116, + 0.4338486082851887, + 0.03567640110850334, + 0.31262667663395405, + 0.3430216368287802, + 0.2683075424283743, + 0.2180566880851984, + 0.42265379801392555, + 0.5664590615779161, + 0.9230356179177761, + 0.05785047635436058, + 0.59212751314044, + 0.43722784146666527, + 0.21839114278554916, + 0.15814877673983574, + 1.336076132953167, + 0.8424300663173199, + 0.6609338894486427, + 1.1405376219190657, + 0.036943476647138596, + 1.4468738418072462, + 0.10399181582033634, + 0.663221936672926, + 0.6686097141355276, + 0.6381964311003685, + 0.3045929786749184, + 0.9499859106726944, + 0.5756397470831871, + 0.8181739412248135, + 0.4506554901599884, + 0.7290363572537899, + 2.603427010588348, + 0.2967437319457531, + 0.9384074108675122, + 0.24487464874982834, + 0.06104372814297676, + 2.8205299265682697, + 1.208276053890586, + 1.1702992469072342, + 1.11041696742177 + ], + "unique_experts": 64, + "load_cv": 0.6973630569423674, + "normalized_load_entropy": 0.9391348865587404, + "max_load_share": 0.040229885057471264 + } + }, + "s1_bos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "7ba33c83121bae3b89188dd8b782d78f26d028de3d418a4e6c62d70bdcbec7ee", + "route_weight_sha256": "9b7c258e86ca96eb9708199067927b8157a73c50a52e5d35e734cb84d02c1e7b", + "loads": [ + 26, + 23, + 15, + 8, + 5, + 30, + 13, + 12, + 14, + 31, + 15, + 4, + 3, + 4, + 7, + 4, + 2, + 3, + 2, + 14, + 16, + 14, + 13, + 6, + 25, + 13, + 2, + 3, + 4, + 9, + 6, + 10, + 20, + 11, + 1, + 12, + 8, + 3, + 2, + 19, + 5, + 8, + 18, + 0, + 27, + 2, + 11, + 15, + 7, + 5, + 21, + 5, + 13, + 12, + 14, + 22, + 3, + 18, + 5, + 1, + 18, + 20, + 21, + 17 + ], + "weighted_loads": [ + 1.8537765424698591, + 0.9276225566864014, + 1.7327230796217918, + 0.6962601477280259, + 0.2190711721777916, + 1.2207680121064186, + 0.31162832770496607, + 6.7535697519779205, + 0.788703478872776, + 2.1523764673620462, + 0.728349706158042, + 0.138570724055171, + 0.19000089541077614, + 0.09747762233018875, + 0.35042474418878555, + 0.14016959071159363, + 0.11547844111919403, + 0.10511057451367378, + 0.14917373657226562, + 0.6723475474864244, + 0.6896044388413429, + 0.8931874539703131, + 0.5147575996816158, + 0.34853967651724815, + 1.0390016827732325, + 0.5124779120087624, + 0.068910613656044, + 0.10099377483129501, + 0.3047148361802101, + 0.3365368600934744, + 0.23093044757843018, + 0.40357247553765774, + 0.6998630985617638, + 0.5104962885379791, + 0.010380596853792667, + 0.4545804001390934, + 0.4780351910740137, + 0.0985210295766592, + 0.15470995381474495, + 1.2137025706470013, + 0.5573298260569572, + 0.57691690325737, + 0.7534316033124924, + 0.0, + 1.416166752576828, + 0.07221101596951485, + 0.6290913000702858, + 0.5996530503034592, + 0.31148711778223515, + 0.20488781481981277, + 0.7495735948905349, + 0.5527595095336437, + 0.655367910861969, + 0.45856030471622944, + 0.7314775101840496, + 1.4565169624984264, + 0.17073190584778786, + 0.9198017492890358, + 0.2751903161406517, + 0.05942106619477272, + 1.5456695705652237, + 1.010752959176898, + 1.1298567838966846, + 0.7896602265536785 + ], + "unique_experts": 63, + "load_cv": 0.7002645002928325, + "normalized_load_entropy": 0.9382582362100278, + "max_load_share": 0.043055555555555555 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "2bca0feb5c001dfe1e98dce8bff9f78d69789eb627390bea32a27f05a0b6f69a", + "route_weight_sha256": "5c6cf2e7f82f7f71627edda6c38cda69a69a14bd2030d29571a0a9439696fed1", + "loads": [ + 28, + 28, + 15, + 18, + 5, + 31, + 17, + 13, + 35, + 40, + 15, + 10, + 6, + 4, + 11, + 9, + 5, + 5, + 3, + 14, + 18, + 26, + 15, + 6, + 25, + 14, + 2, + 8, + 5, + 9, + 7, + 10, + 21, + 23, + 9, + 19, + 10, + 6, + 2, + 20, + 16, + 9, + 23, + 2, + 27, + 2, + 12, + 17, + 12, + 8, + 30, + 8, + 20, + 16, + 14, + 42, + 7, + 19, + 6, + 1, + 34, + 30, + 21, + 23 + ], + "weighted_loads": [ + 1.9784339191392064, + 1.384838990867138, + 1.7327230796217918, + 1.9466159353032708, + 0.2190711721777916, + 1.233363694511354, + 0.5833851816132665, + 6.79553646594286, + 2.5017176512628794, + 2.60929948836565, + 0.728349706158042, + 0.5047978442162275, + 0.3299519494175911, + 0.09747762233018875, + 1.1008939817547798, + 0.41653991490602493, + 0.2590431906282902, + 0.15528937801718712, + 0.18877245113253593, + 0.6723475474864244, + 0.7826288789510727, + 1.8593846466392279, + 0.5924651995301247, + 0.34853967651724815, + 1.0390016827732325, + 0.5379572324454784, + 0.068910613656044, + 0.2924034520983696, + 0.38829611241817474, + 0.3365368600934744, + 0.2676506079733372, + 0.40357247553765774, + 0.7510026358067989, + 0.9571595247834921, + 0.3599263885989785, + 0.7726500928401947, + 0.5671822112053633, + 0.21533318795263767, + 0.15470995381474495, + 1.254004381597042, + 1.244231691583991, + 0.6023191139101982, + 1.0837581269443035, + 0.13466614857316017, + 1.416166752576828, + 0.07221101596951485, + 0.662714134901762, + 0.6677143052220345, + 0.6172603387385607, + 0.727222628891468, + 1.1987290354445577, + 0.7536698281764984, + 1.3569475281983614, + 0.6356768179684877, + 0.7314775101840496, + 3.1776592610403895, + 0.3854753337800503, + 0.9448158200830221, + 0.3167765885591507, + 0.05942106619477272, + 3.6678196899592876, + 1.4329534713178873, + 1.1298567838966846, + 1.1660660468041897 + ], + "unique_experts": 64, + "load_cv": 0.6569870699503267, + "normalized_load_entropy": 0.9476829647416214, + "max_load_share": 0.043478260869565216 + } + }, + "s0_x": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "f56d45c168a4169b396e225cad0c0d01df5dd1e33d0a9adcee6f99ad88276cba", + "route_weight_sha256": "a26ce13b9f96b2315f891a64277c9f61c856a7d3655fe183c4a7152e58123716", + "loads": [ + 26, + 24, + 15, + 9, + 7, + 32, + 9, + 12, + 10, + 28, + 13, + 2, + 3, + 4, + 8, + 6, + 2, + 4, + 3, + 14, + 14, + 16, + 14, + 5, + 26, + 12, + 1, + 3, + 4, + 6, + 6, + 9, + 17, + 7, + 4, + 11, + 9, + 1, + 1, + 21, + 6, + 8, + 22, + 1, + 30, + 2, + 12, + 17, + 10, + 3, + 21, + 6, + 19, + 10, + 15, + 24, + 3, + 17, + 4, + 1, + 18, + 17, + 23, + 13 + ], + "weighted_loads": [ + 1.8463490307331085, + 0.9883245062083006, + 1.7345082238316536, + 0.6809230139479041, + 0.31231650710105896, + 1.3144357204437256, + 0.22859941236674786, + 5.764329552650452, + 0.6243695579469204, + 2.2081408202648163, + 0.6549320425838232, + 0.06876305863261223, + 0.18318628147244453, + 0.10217436961829662, + 0.4248466342687607, + 0.20817971043288708, + 0.11856991052627563, + 0.13631650060415268, + 0.17262354493141174, + 0.6338842045515776, + 0.564043439924717, + 0.9799983147531748, + 0.5475976672023535, + 0.2958047427237034, + 1.1058836039155722, + 0.4983267765492201, + 0.03516734763979912, + 0.09994253143668175, + 0.3129703402519226, + 0.2257538828998804, + 0.22048314101994038, + 0.36889893375337124, + 0.60567213781178, + 0.3748781457543373, + 0.07943141274154186, + 0.4087841045111418, + 0.5002699699252844, + 0.04232574626803398, + 0.12436770647764206, + 1.3459011390805244, + 0.6648440025746822, + 0.58194175735116, + 0.8922052271664143, + 0.032123174518346786, + 1.4404879361391068, + 0.0742211639881134, + 0.653966449201107, + 0.6727426052093506, + 0.42716205678880215, + 0.14259270578622818, + 0.8907652664929628, + 0.5688393004238605, + 0.9451111927628517, + 0.3683473374694586, + 0.7151201516389847, + 1.6098488215357065, + 0.17100626230239868, + 0.8513439409434795, + 0.2522124946117401, + 0.06158149614930153, + 1.5038658566772938, + 0.9240661971271038, + 1.282204819843173, + 0.6733513250946999 + ], + "unique_experts": 64, + "load_cv": 0.7226494462892933, + "normalized_load_entropy": 0.9358857615832266, + "max_load_share": 0.044444444444444446 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "750b882fe4647d7fe128f12494af90adb681a65187ee19d283dd64d8828ef075", + "route_weight_sha256": "b07a15b5b452d22017be90a0e59f9300ad665e67693b07ffc5e58a8876ed1ba2", + "loads": [ + 31, + 25, + 17, + 18, + 7, + 33, + 13, + 12, + 24, + 33, + 13, + 3, + 3, + 4, + 12, + 6, + 2, + 6, + 3, + 14, + 15, + 24, + 16, + 5, + 26, + 13, + 1, + 7, + 4, + 6, + 7, + 9, + 19, + 17, + 5, + 13, + 9, + 4, + 1, + 21, + 10, + 9, + 27, + 1, + 30, + 3, + 13, + 17, + 12, + 5, + 24, + 6, + 21, + 12, + 15, + 39, + 6, + 18, + 4, + 1, + 27, + 26, + 23, + 20 + ], + "weighted_loads": [ + 2.0482658809050918, + 1.0309630613774061, + 1.8132568821310997, + 1.7501859506592155, + 0.31231650710105896, + 1.327031402848661, + 0.5084498580545187, + 5.764329552650452, + 1.8151534218341112, + 2.397878320887685, + 0.6549320425838232, + 0.08121847361326218, + 0.18318628147244453, + 0.10217436961829662, + 1.3382548466324806, + 0.20817971043288708, + 0.11856991052627563, + 0.19720580987632275, + 0.17262354493141174, + 0.6338842045515776, + 0.6046426594257355, + 1.5623866580426693, + 0.6003386434167624, + 0.2958047427237034, + 1.1058836039155722, + 0.5244570504873991, + 0.03516734763979912, + 0.23255661688745022, + 0.3129703402519226, + 0.2257538828998804, + 0.2623721305280924, + 0.36889893375337124, + 0.6743514891713858, + 0.7560503128916025, + 0.13728188909590244, + 0.49897767044603825, + 0.5002699699252844, + 0.13970196060836315, + 0.12436770647764206, + 1.3459011390805244, + 0.8999246135354042, + 0.6592571325600147, + 1.1858914718031883, + 0.032123174518346786, + 1.4404879361391068, + 0.10175454430282116, + 0.6954523622989655, + 0.6727426052093506, + 0.514690576121211, + 0.3955700173974037, + 1.0706217717379332, + 0.5688393004238605, + 1.0892814937978983, + 0.43116288632154465, + 0.7151201516389847, + 2.957960688509047, + 0.29903150722384453, + 0.8770010471343994, + 0.2522124946117401, + 0.06158149614930153, + 2.7263098433613777, + 1.2596719916909933, + 1.282204819843173, + 0.9365185350179672 + ], + "unique_experts": 64, + "load_cv": 0.6978478892821166, + "normalized_load_entropy": 0.9394000797184006, + "max_load_share": 0.04482758620689655 + } + }, + "s1_x": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "ba20b2867880c8a31d9d654683f603660ca7b8da0906956293b2fbe8add474cd", + "route_weight_sha256": "d4b5a50ac11ef1905159dd845bb46692164ba778ec213771551857c180d933e5", + "loads": [ + 26, + 24, + 15, + 10, + 6, + 27, + 10, + 12, + 14, + 26, + 19, + 2, + 3, + 6, + 5, + 2, + 3, + 3, + 2, + 13, + 17, + 15, + 11, + 6, + 28, + 10, + 1, + 1, + 4, + 8, + 6, + 13, + 20, + 10, + 4, + 8, + 8, + 4, + 1, + 21, + 6, + 7, + 21, + 1, + 25, + 1, + 11, + 19, + 6, + 4, + 19, + 6, + 19, + 10, + 14, + 25, + 2, + 18, + 5, + 1, + 19, + 21, + 23, + 13 + ], + "weighted_loads": [ + 1.633253950625658, + 0.9766918178647757, + 1.703788448125124, + 0.8787069311365485, + 0.23375625722110271, + 1.0798600912094116, + 0.26771787367761135, + 5.609464213252068, + 0.7450059819966555, + 2.0201016031205654, + 1.0102419964969158, + 0.07780095189809799, + 0.18558267503976822, + 0.14795821346342564, + 0.29859787225723267, + 0.07714224979281425, + 0.15047954954206944, + 0.10503869131207466, + 0.13470672070980072, + 0.6732100695371628, + 0.722059290856123, + 0.9274044632911682, + 0.4577925205230713, + 0.34165786392986774, + 1.1532111037522554, + 0.41463487409055233, + 0.030278515070676804, + 0.03977537527680397, + 0.30512121692299843, + 0.299177348613739, + 0.22899974696338177, + 0.4913244564086199, + 0.6859939526766539, + 0.45697420462965965, + 0.09775490686297417, + 0.30353947170078754, + 0.44771661795675755, + 0.1349076647311449, + 0.11869773268699646, + 1.2213766239583492, + 0.5576690882444382, + 0.4980071596801281, + 0.8348285742104053, + 0.034442681819200516, + 1.3363624140620232, + 0.039809487760066986, + 0.6405660733580589, + 0.774220772087574, + 0.2650468721985817, + 0.20231520384550095, + 0.8168023340404034, + 0.5600169524550438, + 0.8824453577399254, + 0.367268580943346, + 0.6933870613574982, + 1.4724149256944656, + 0.12086621299386024, + 0.9223842583596706, + 0.26196344941854477, + 0.05939066410064697, + 1.4689104333519936, + 1.1548546180129051, + 1.2811734471470118, + 0.6359860692173243 + ], + "unique_experts": 64, + "load_cv": 0.7159557197149784, + "normalized_load_entropy": 0.9347544744233821, + "max_load_share": 0.03888888888888889 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "b3e54f3ec1979c48fabb2da98172b53b94e45e8609169409c4cdc08124531b30", + "route_weight_sha256": "a249b6e7c91a7b0dde69766ef7f9cf4c35c916e52e0d5370382b881e90dc68a8", + "loads": [ + 28, + 29, + 15, + 21, + 6, + 29, + 15, + 13, + 36, + 36, + 19, + 6, + 6, + 6, + 9, + 6, + 6, + 5, + 3, + 13, + 19, + 29, + 12, + 6, + 28, + 11, + 1, + 2, + 5, + 8, + 7, + 13, + 21, + 22, + 12, + 13, + 10, + 6, + 1, + 22, + 17, + 8, + 26, + 3, + 25, + 2, + 12, + 21, + 9, + 7, + 30, + 9, + 25, + 14, + 14, + 49, + 6, + 19, + 6, + 1, + 34, + 33, + 23, + 18 + ], + "weighted_loads": [ + 1.7579113272950053, + 1.4339082520455122, + 1.703788448125124, + 2.179830997250974, + 0.23375625722110271, + 1.1212577866390347, + 0.578956538811326, + 5.651430927217007, + 2.490846026688814, + 2.522112900391221, + 1.0102419964969158, + 0.3627920188009739, + 0.3255337290465832, + 0.14795821346342564, + 0.9881802313029766, + 0.31189725548028946, + 0.2940442990511656, + 0.155217494815588, + 0.17430543527007103, + 0.6732100695371628, + 0.8143410906195641, + 2.0242259204387665, + 0.5003524497151375, + 0.34165786392986774, + 1.1532111037522554, + 0.4401141945272684, + 0.030278515070676804, + 0.07497569546103477, + 0.38870249316096306, + 0.299177348613739, + 0.2595936395227909, + 0.4913244564086199, + 0.737133489921689, + 0.8941298257559538, + 0.44730069860816, + 0.5388730447739363, + 0.5368636380881071, + 0.21201266162097454, + 0.11869773268699646, + 1.26167843490839, + 1.2677606549113989, + 0.5234093703329563, + 1.2306195944547653, + 0.1691088303923607, + 1.3363624140620232, + 0.06866776756942272, + 0.6741889081895351, + 0.8422820270061493, + 0.3980107344686985, + 0.7460448145866394, + 1.3439731057733297, + 0.7609272710978985, + 1.545762587338686, + 0.5267211049795151, + 0.6933870613574982, + 3.59194243978709, + 0.33560964092612267, + 0.947398329153657, + 0.30354972183704376, + 0.05939066410064697, + 3.4875095449388027, + 1.7400882579386234, + 1.2811734471470118, + 0.867496682330966 + ], + "unique_experts": 64, + "load_cv": 0.7012217885290972, + "normalized_load_entropy": 0.940914927970558, + "max_load_share": 0.050724637681159424 + } + }, + "s0_period": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "67720dee16ed6b74e77bc03bc129ddb397432425b964dd7c6b0ba503e897b2a7", + "route_weight_sha256": "161d8bc8ce1b36a62eb5e85a0cc8a724e0e3d7c8f2bf30ecd5ff71ad09cb6d0e", + "loads": [ + 26, + 23, + 15, + 7, + 7, + 32, + 8, + 12, + 13, + 29, + 12, + 0, + 3, + 4, + 7, + 6, + 2, + 6, + 4, + 13, + 15, + 15, + 13, + 6, + 27, + 12, + 2, + 2, + 4, + 7, + 6, + 9, + 17, + 7, + 6, + 10, + 8, + 3, + 2, + 19, + 6, + 8, + 19, + 1, + 27, + 1, + 13, + 17, + 8, + 4, + 21, + 6, + 21, + 9, + 17, + 25, + 3, + 18, + 4, + 1, + 19, + 17, + 22, + 14 + ], + "weighted_loads": [ + 1.907699246890843, + 0.9901620931923389, + 1.7492233850061893, + 0.6011363686993718, + 0.304840125143528, + 1.290679568424821, + 0.2270790608599782, + 5.642690345644951, + 0.7476437427103519, + 2.2170391343533993, + 0.5920483022928238, + 0.0, + 0.18217310681939125, + 0.10304254293441772, + 0.3969898670911789, + 0.2086073886603117, + 0.11627895385026932, + 0.21501954644918442, + 0.20491093583405018, + 0.6205753572285175, + 0.6111704632639885, + 0.9754838030785322, + 0.5413974262773991, + 0.3335623685270548, + 1.152251273393631, + 0.5022810287773609, + 0.06811794638633728, + 0.07207301445305347, + 0.3109716475009918, + 0.2589985094964504, + 0.2202459815889597, + 0.3710343539714813, + 0.5857629384845495, + 0.3987897112965584, + 0.1198923708871007, + 0.359412869438529, + 0.47089165076613426, + 0.10550027713179588, + 0.1547929346561432, + 1.2588638290762901, + 0.6379048824310303, + 0.5919395610690117, + 0.8025805354118347, + 0.03382329270243645, + 1.332966785877943, + 0.044825706630945206, + 0.7049157284200191, + 0.6708156112581491, + 0.35555864684283733, + 0.16727210581302643, + 0.862095127813518, + 0.5776780657470226, + 1.0010189805179834, + 0.34028773941099644, + 0.7621264439076185, + 1.580834649503231, + 0.1655469425022602, + 0.8690008446574211, + 0.25420546904206276, + 0.06038971617817879, + 1.584321979433298, + 0.9433891512453556, + 1.3080258443951607, + 0.7110146954655647 + ], + "unique_experts": 63, + "load_cv": 0.7116317538491518, + "normalized_load_entropy": 0.9376049241315684, + "max_load_share": 0.044444444444444446 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "1720e2c5b7c69804926505ec489aeb44800567315381a643b1bcdd2f65816142", + "route_weight_sha256": "58cdbd27a5bfc8b6d0b79851ae7de2965f7815edb6905596edfd2bf40506a740", + "loads": [ + 30, + 24, + 17, + 15, + 7, + 33, + 11, + 12, + 27, + 34, + 12, + 1, + 3, + 4, + 12, + 6, + 2, + 8, + 4, + 13, + 16, + 24, + 14, + 6, + 27, + 13, + 2, + 6, + 4, + 8, + 7, + 9, + 19, + 15, + 7, + 12, + 8, + 6, + 2, + 20, + 11, + 9, + 24, + 1, + 27, + 2, + 14, + 17, + 11, + 5, + 25, + 6, + 23, + 12, + 17, + 39, + 6, + 19, + 4, + 1, + 29, + 25, + 22, + 21 + ], + "weighted_loads": [ + 2.0789607390761375, + 1.0899586118757725, + 1.8279720433056355, + 1.5877700643613935, + 0.304840125143528, + 1.3032752508297563, + 0.4359157057479024, + 5.642690345644951, + 1.9306433461606503, + 2.406776634976268, + 0.5920483022928238, + 0.012455414980649948, + 0.18217310681939125, + 0.10304254293441772, + 1.2228024564683437, + 0.2086073886603117, + 0.11627895385026932, + 0.2880645450204611, + 0.20491093583405018, + 0.6205753572285175, + 0.6561925150454044, + 1.6062770634889603, + 0.5716657694429159, + 0.3335623685270548, + 1.152251273393631, + 0.5284113027155399, + 0.06811794638633728, + 0.21288179233670235, + 0.3109716475009918, + 0.3111995607614517, + 0.24768861941993237, + 0.3710343539714813, + 0.6544422898441553, + 0.6896114181727171, + 0.17774284724146128, + 0.4626281838864088, + 0.47089165076613426, + 0.22473962418735027, + 0.1547929346561432, + 1.2921058349311352, + 0.9293925985693932, + 0.6826853379607201, + 1.0608110129833221, + 0.03382329270243645, + 1.332966785877943, + 0.07235908694565296, + 0.7464016415178776, + 0.6708156112581491, + 0.4858450461179018, + 0.29333917796611786, + 1.1203818013891578, + 0.5776780657470226, + 1.1425481047481298, + 0.4642688874155283, + 0.7621264439076185, + 2.836274075321853, + 0.29357218742370605, + 0.894657950848341, + 0.25420546904206276, + 0.06038971617817879, + 2.8615515306591988, + 1.2245968263596296, + 1.3080258443951607, + 0.9906086660921574 + ], + "unique_experts": 64, + "load_cv": 0.6906621001690016, + "normalized_load_entropy": 0.9411679748894536, + "max_load_share": 0.04482758620689655 + } + }, + "s1_period": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "2970851f83c5dace1d8fda283c90febde16eb53392bd2f7f2daa782138678ba8", + "route_weight_sha256": "614374e91d821233f2d02266c1f0092c18c5a3087035b0b0b2b5f567ea7e989f", + "loads": [ + 27, + 25, + 15, + 9, + 5, + 29, + 11, + 12, + 13, + 27, + 19, + 2, + 3, + 5, + 7, + 6, + 3, + 2, + 2, + 13, + 20, + 15, + 10, + 5, + 21, + 8, + 2, + 1, + 4, + 8, + 7, + 9, + 22, + 12, + 5, + 10, + 8, + 2, + 1, + 21, + 6, + 8, + 18, + 1, + 26, + 2, + 12, + 16, + 7, + 4, + 19, + 6, + 17, + 8, + 14, + 26, + 2, + 20, + 5, + 1, + 20, + 20, + 22, + 14 + ], + "weighted_loads": [ + 1.771950414404273, + 1.0018381085246801, + 1.7177833952009678, + 0.8387283021584153, + 0.2045576386153698, + 1.1557584200054407, + 0.3038461431860924, + 5.574414491653442, + 0.7571427412331104, + 2.0605285447090864, + 0.9784633107483387, + 0.07611711695790291, + 0.18351490795612335, + 0.12901155278086662, + 0.37828391045331955, + 0.20149506069719791, + 0.1493167132139206, + 0.07308686152100563, + 0.13489718735218048, + 0.6764161083847284, + 0.804794292896986, + 0.88597715459764, + 0.42556451819837093, + 0.30491912737488747, + 0.904109351336956, + 0.33917966298758984, + 0.06694747135043144, + 0.04333816468715668, + 0.29365457966923714, + 0.3019944652915001, + 0.2603035606443882, + 0.38266751170158386, + 0.7539272233843803, + 0.5597573108971119, + 0.11784985568374395, + 0.35764562524855137, + 0.43935476429760456, + 0.0717349573969841, + 0.11182703077793121, + 1.2551644407212734, + 0.5646402351558208, + 0.5611907504498959, + 0.746892623603344, + 0.034652553498744965, + 1.3775906506925821, + 0.07606035098433495, + 0.6599593386054039, + 0.6875537671148777, + 0.30199497379362583, + 0.19145645573735237, + 0.8293337412178516, + 0.5557533353567123, + 0.8141961395740509, + 0.3162016347050667, + 0.6668417528271675, + 1.5050502717494965, + 0.12393783777952194, + 1.0003029461950064, + 0.2755659408867359, + 0.05947372317314148, + 1.5454185158014297, + 1.138111725449562, + 1.2328860871493816, + 0.6695971824228764 + ], + "unique_experts": 64, + "load_cv": 0.7109374788020618, + "normalized_load_entropy": 0.9365464807924545, + "max_load_share": 0.04027777777777778 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "2bd141dea19047c43866de82cd85ca48127bd36cde4e7f629b23a06d1a8698c3", + "route_weight_sha256": "32277d65137ff2ecc33a8b0eb2949ae5e3027621be4cfa9215e3ef84e8f48eb0", + "loads": [ + 29, + 30, + 15, + 19, + 5, + 30, + 15, + 13, + 34, + 36, + 19, + 6, + 6, + 5, + 11, + 10, + 6, + 4, + 3, + 13, + 22, + 29, + 11, + 5, + 21, + 9, + 2, + 3, + 5, + 8, + 9, + 9, + 23, + 25, + 13, + 15, + 10, + 3, + 1, + 24, + 19, + 9, + 23, + 3, + 26, + 2, + 13, + 18, + 10, + 7, + 31, + 9, + 23, + 12, + 14, + 50, + 6, + 21, + 6, + 1, + 36, + 31, + 22, + 18 + ], + "weighted_loads": [ + 1.8966077910736203, + 1.4590545427054167, + 1.7177833952009678, + 2.08908408973366, + 0.2045576386153698, + 1.168354102410376, + 0.5756029970943928, + 5.6163812056183815, + 2.482890360057354, + 2.5174515657126904, + 0.9784633107483387, + 0.3611081838607788, + 0.3234659619629383, + 0.12901155278086662, + 1.0785360410809517, + 0.4362500663846731, + 0.29288146272301674, + 0.12326566502451897, + 0.1744959019124508, + 0.6764161083847284, + 0.8969328589737415, + 1.968042304739356, + 0.4681244473904371, + 0.30491912737488747, + 0.904109351336956, + 0.3646589834243059, + 0.06694747135043144, + 0.10646318085491657, + 0.37723585590720177, + 0.3019944652915001, + 0.32397546619176865, + 0.38266751170158386, + 0.8050667606294155, + 1.0354389417916536, + 0.4673956474289298, + 0.5804591868072748, + 0.5285017844289541, + 0.10327690094709396, + 0.11182703077793121, + 1.39942841604352, + 1.3530142400413752, + 0.5865929611027241, + 1.1299682669341564, + 0.16931870207190514, + 1.3775906506925821, + 0.07606035098433495, + 0.6935821734368801, + 0.755615022033453, + 0.43882456235587597, + 0.6889628991484642, + 1.4303172286599874, + 0.756663653999567, + 1.4791649840772152, + 0.48691602796316147, + 0.6668417528271675, + 3.5237763775512576, + 0.33868126571178436, + 1.0253170169889927, + 0.3171522133052349, + 0.05947372317314148, + 3.6226841583848, + 1.6022134944796562, + 1.2328860871493816, + 0.8720097951591015 + ], + "unique_experts": 64, + "load_cv": 0.7031752093843299, + "normalized_load_entropy": 0.9408146531054118, + "max_load_share": 0.051759834368530024 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 120, + "ordered_topk_exact_tokens": 43, + "set_exact_tokens": 54, + "mean_set_jaccard": 0.8196428571428572, + "mean_token_weighted_tv": 0.035746852424927054, + "aggregate_load_tv": 0.054166666666666675 + }, + "system_bos": { + "tokens": 120, + "ordered_topk_exact_tokens": 35, + "set_exact_tokens": 51, + "mean_set_jaccard": 0.8047619047619049, + "mean_token_weighted_tv": 0.03801758057864693, + "aggregate_load_tv": 0.05833333333333333 + }, + "system_x": { + "tokens": 120, + "ordered_topk_exact_tokens": 21, + "set_exact_tokens": 36, + "mean_set_jaccard": 0.7565476190476191, + "mean_token_weighted_tv": 0.05094404101837426, + "aggregate_load_tv": 0.06527777777777778 + }, + "system_period": { + "tokens": 120, + "ordered_topk_exact_tokens": 25, + "set_exact_tokens": 36, + "mean_set_jaccard": 0.7597222222222224, + "mean_token_weighted_tv": 0.049043054944680385, + "aggregate_load_tv": 0.06527777777777778 + }, + "bos_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 32, + "set_exact_tokens": 47, + "mean_set_jaccard": 0.7912698412698413, + "mean_token_weighted_tv": 0.041596885663845264, + "aggregate_load_tv": 0.0611111111111111 + }, + "bos_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 30, + "set_exact_tokens": 47, + "mean_set_jaccard": 0.7880952380952382, + "mean_token_weighted_tv": 0.042450771162596844, + "aggregate_load_tv": 0.043055555555555555 + }, + "x_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 29, + "set_exact_tokens": 38, + "mean_set_jaccard": 0.7570238095238097, + "mean_token_weighted_tv": 0.04781413384480402, + "aggregate_load_tv": 0.06527777777777777 + }, + "x_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 21, + "set_exact_tokens": 37, + "mean_set_jaccard": 0.7549603174603176, + "mean_token_weighted_tv": 0.04971237146528438, + "aggregate_load_tv": 0.0763888888888889 + }, + "period_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 27, + "set_exact_tokens": 41, + "mean_set_jaccard": 0.7742063492063492, + "mean_token_weighted_tv": 0.0445534309411111, + "aggregate_load_tv": 0.06666666666666665 + }, + "period_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 22, + "set_exact_tokens": 37, + "mean_set_jaccard": 0.7486904761904764, + "mean_token_weighted_tv": 0.05143738678501298, + "aggregate_load_tv": 0.06944444444444445 + } + } + }, + "layer_23": { + "layer": 23, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "c023a32aa622513601fb17e39d42decdbdf95265ccffde6f43c03bf1c71ee0d7", + "route_weight_sha256": "997d2bf1d5d3dba41a73b84a3267a725695e577082caa15113324e6c53e8b18d", + "loads": [ + 17, + 4, + 22, + 6, + 19, + 9, + 20, + 12, + 17, + 9, + 7, + 1, + 16, + 6, + 11, + 17, + 17, + 2, + 3, + 6, + 12, + 15, + 3, + 23, + 10, + 25, + 21, + 7, + 2, + 1, + 12, + 2, + 7, + 8, + 16, + 15, + 13, + 3, + 9, + 14, + 10, + 2, + 32, + 7, + 1, + 6, + 14, + 13, + 7, + 16, + 3, + 3, + 6, + 7, + 11, + 15, + 18, + 26, + 5, + 15, + 26, + 4, + 24, + 10 + ], + "weighted_loads": [ + 0.7384043950587511, + 0.2755243293941021, + 0.7642805930227041, + 0.32818448543548584, + 0.7015974968671799, + 0.32948339357972145, + 1.0029281824827194, + 0.44422322139143944, + 0.7682785354554653, + 0.32825144566595554, + 0.5205785557627678, + 0.036239344626665115, + 0.8654272090643644, + 0.26364110596477985, + 0.5502388663589954, + 0.921227253973484, + 1.1012737825512886, + 0.16136287152767181, + 0.15995200723409653, + 0.43903998285532, + 0.6521309539675713, + 0.7757537178695202, + 0.1196201890707016, + 1.4664957839995623, + 0.36325121857225895, + 1.5471114721149206, + 1.552532272413373, + 0.37235964462161064, + 0.10664858669042587, + 0.08059599250555038, + 0.48602514155209064, + 0.06989680975675583, + 0.26266160793602467, + 0.30637555941939354, + 0.8733462374657393, + 1.2866562120616436, + 0.8174042738974094, + 0.09946686960756779, + 0.5110421609133482, + 0.5382878948003054, + 0.5489721912890673, + 0.1322832852602005, + 1.3243395872414112, + 0.43965838104486465, + 0.039839569479227066, + 0.2650163471698761, + 0.7178998664021492, + 1.0812446661293507, + 0.3473163805902004, + 0.6254512518644333, + 0.10710152238607407, + 0.14036141708493233, + 0.3082043547183275, + 0.2678673844784498, + 0.5917889848351479, + 0.8410633392632008, + 1.1142601147294044, + 1.3688580207526684, + 0.16875016130506992, + 0.9721879698336124, + 1.4355716649442911, + 0.25530487671494484, + 1.2684126291424036, + 0.3685532286763191 + ], + "unique_experts": 64, + "load_cv": 0.6522515609528521, + "normalized_load_entropy": 0.9468860730115419, + "max_load_share": 0.044444444444444446 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "3a342a36d4b81f38a6fab17b1e8c5d10d0b09f361829a214cdb3ce742ee593fd", + "route_weight_sha256": "0355ade6db3659f536cc503b32c2fc36c3ed85600a3bea47ac28a1f0daeeb244", + "loads": [ + 24, + 7, + 22, + 14, + 24, + 12, + 26, + 20, + 18, + 17, + 7, + 2, + 17, + 11, + 13, + 17, + 20, + 2, + 3, + 6, + 12, + 15, + 4, + 33, + 14, + 25, + 23, + 7, + 2, + 1, + 12, + 2, + 8, + 13, + 17, + 15, + 14, + 3, + 13, + 14, + 16, + 2, + 35, + 7, + 1, + 13, + 25, + 16, + 8, + 16, + 3, + 4, + 6, + 7, + 21, + 17, + 18, + 37, + 7, + 15, + 26, + 4, + 26, + 11 + ], + "weighted_loads": [ + 1.0027367761358619, + 0.45044103264808655, + 0.7642805930227041, + 0.5619729883037508, + 0.8923914954066277, + 0.4379913965240121, + 1.3725302331149578, + 0.805728867650032, + 0.7690218309289776, + 0.6022565346211195, + 0.5205785557627678, + 0.08391738310456276, + 0.8756288634613156, + 0.46995118632912636, + 0.6618057861924171, + 0.921227253973484, + 1.1529568149708211, + 0.16136287152767181, + 0.15995200723409653, + 0.43903998285532, + 0.6521309539675713, + 0.7757537178695202, + 0.1382133588194847, + 2.7419723253697157, + 0.5202882308512926, + 1.5471114721149206, + 1.6167619656771421, + 0.37235964462161064, + 0.10664858669042587, + 0.08059599250555038, + 0.48602514155209064, + 0.06989680975675583, + 0.3214873056858778, + 0.572055455762893, + 0.923036115244031, + 1.2866562120616436, + 0.8603208735585213, + 0.09946686960756779, + 0.6883519804105163, + 0.5382878948003054, + 0.8770379032939672, + 0.1322832852602005, + 1.4061710927635431, + 0.43965838104486465, + 0.039839569479227066, + 2.3316221572458744, + 1.675454143434763, + 1.1446685721166432, + 0.3879333920776844, + 0.6254512518644333, + 0.10710152238607407, + 0.22899114713072777, + 0.3082043547183275, + 0.2678673844784498, + 1.5047454163432121, + 0.941463690251112, + 1.1142601147294044, + 2.285506993532181, + 0.28602071292698383, + 0.9721879698336124, + 1.4355716649442911, + 0.25530487671494484, + 1.3448568508028984, + 0.40107231959700584 + ], + "unique_experts": 64, + "load_cv": 0.6371715474832368, + "normalized_load_entropy": 0.9481173095501905, + "max_load_share": 0.04252873563218391 + } + }, + "s1_eos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "bba88b0710c86a2c73d22598836f7cea5803b418059bbcfaadcd1fdc6928ae63", + "route_weight_sha256": "c5c13612f01ed7ad6f0b7f1fd356f0d8ff7e7993e684d10871b299477998c060", + "loads": [ + 16, + 2, + 22, + 8, + 15, + 7, + 18, + 13, + 21, + 9, + 8, + 2, + 14, + 6, + 12, + 16, + 17, + 3, + 3, + 5, + 12, + 16, + 3, + 21, + 11, + 25, + 24, + 7, + 2, + 1, + 10, + 1, + 5, + 9, + 17, + 15, + 11, + 3, + 8, + 13, + 11, + 2, + 35, + 7, + 1, + 6, + 14, + 14, + 7, + 13, + 3, + 3, + 6, + 7, + 12, + 15, + 16, + 28, + 6, + 17, + 26, + 3, + 25, + 12 + ], + "weighted_loads": [ + 0.661612406373024, + 0.19257675111293793, + 0.7943404652178288, + 0.43321456760168076, + 0.6266490668058395, + 0.2819466982036829, + 0.8669514320790768, + 0.4668295830488205, + 0.9371469095349312, + 0.3569979500025511, + 0.5508734304457903, + 0.06625356338918209, + 0.7839144635945559, + 0.24716544523835182, + 0.5592659935355186, + 0.8163853008300066, + 1.145180445164442, + 0.18221045657992363, + 0.16217806190252304, + 0.38817932084202766, + 0.6318408884108067, + 0.8377002850174904, + 0.12451490387320518, + 1.4254644885659218, + 0.4024698380380869, + 1.4580472186207771, + 1.687473712489009, + 0.3734753802418709, + 0.10026156529784203, + 0.07716134935617447, + 0.4080226216465235, + 0.029745975509285927, + 0.19495001807808876, + 0.344910629093647, + 0.9236686863005161, + 1.2876485772430897, + 0.7589442543685436, + 0.10447924211621284, + 0.4676462151110172, + 0.5145264808088541, + 0.6015326976776123, + 0.12921157106757164, + 1.4205808211117983, + 0.602719122543931, + 0.04354534298181534, + 0.26470979303121567, + 0.7426222618669271, + 1.0982449762523174, + 0.3243293557316065, + 0.5305959694087505, + 0.09329713135957718, + 0.12367813102900982, + 0.30469105392694473, + 0.2554008327424526, + 0.6321721356362104, + 0.8138282410800457, + 1.0725081712007523, + 1.4496763814240694, + 0.2017634529620409, + 1.0584610626101494, + 1.4185923747718334, + 0.22454482316970825, + 1.3629274982959032, + 0.4204989057034254 + ], + "unique_experts": 64, + "load_cv": 0.6736669507210719, + "normalized_load_entropy": 0.9444681571199957, + "max_load_share": 0.04861111111111111 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "946f8aa62d879a307907a86d44153161c6216265f2b15bfbc714e6a7fa366c23", + "route_weight_sha256": "bd9df455f92abece59418493eef9aed560875426c8dd7cc6c5cc2634bb89e1d7", + "loads": [ + 21, + 7, + 28, + 17, + 20, + 9, + 31, + 22, + 23, + 13, + 10, + 3, + 15, + 11, + 14, + 19, + 20, + 4, + 5, + 5, + 13, + 17, + 4, + 36, + 13, + 25, + 27, + 7, + 2, + 2, + 10, + 1, + 6, + 21, + 17, + 15, + 17, + 4, + 15, + 13, + 19, + 2, + 38, + 7, + 3, + 16, + 30, + 18, + 13, + 16, + 5, + 13, + 12, + 9, + 22, + 16, + 16, + 45, + 9, + 17, + 27, + 4, + 31, + 16 + ], + "weighted_loads": [ + 0.9466178589500487, + 0.5123811215162277, + 1.1101010330021381, + 0.9285688539966941, + 0.8404342792928219, + 0.3378199292346835, + 1.5874385833740234, + 0.8268598262220621, + 0.9731570490403101, + 0.5095068756490946, + 0.6414698977023363, + 0.10367034189403057, + 0.7941056881099939, + 0.45712602883577347, + 0.6940943971276283, + 0.9371944516897202, + 1.190589024219662, + 0.24155034497380257, + 0.253859993070364, + 0.38817932084202766, + 0.6797478124499321, + 0.864290326833725, + 0.14295715652406216, + 3.2970971390604973, + 0.47869825176894665, + 1.4580472186207771, + 1.7730115409940481, + 0.3734753802418709, + 0.10026156529784203, + 0.12170877680182457, + 0.4080226216465235, + 0.029745975509285927, + 0.2389032170176506, + 1.0276970349950716, + 0.9236686863005161, + 1.2876485772430897, + 1.194335613399744, + 0.15368784591555595, + 0.883300045505166, + 0.5145264808088541, + 1.0046814121305943, + 0.12921157106757164, + 1.5032601114362478, + 0.602719122543931, + 0.1457182765007019, + 2.432691091671586, + 2.3594151716679335, + 1.3239233228377998, + 0.5865813083946705, + 0.6825237050652504, + 0.14931166544556618, + 0.734704039990902, + 0.9455376975238323, + 0.3256612438708544, + 1.5975440870970488, + 0.8457502983510494, + 1.0725081712007523, + 2.971686292439699, + 0.3702148888260126, + 1.0584610626101494, + 1.4664329662919044, + 0.3498573899269104, + 1.586720198392868, + 0.5886362697929144 + ], + "unique_experts": 64, + "load_cv": 0.6290419328166346, + "normalized_load_entropy": 0.9515284120411177, + "max_load_share": 0.046583850931677016 + } + }, + "s0_bos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "13c474a16086eee318146472d5811c1a33ddee4bb088a8768ce185fc2a19f8d7", + "route_weight_sha256": "41d51af2a542585f40bb0749aded49d1b457284ef78ff761277263bb12320233", + "loads": [ + 18, + 3, + 19, + 7, + 16, + 7, + 18, + 12, + 15, + 9, + 7, + 2, + 17, + 6, + 12, + 17, + 17, + 3, + 3, + 6, + 13, + 16, + 3, + 23, + 12, + 23, + 23, + 7, + 2, + 1, + 11, + 2, + 5, + 11, + 14, + 15, + 13, + 4, + 8, + 12, + 10, + 2, + 35, + 7, + 0, + 7, + 14, + 14, + 9, + 12, + 2, + 6, + 5, + 9, + 11, + 17, + 17, + 28, + 5, + 15, + 24, + 3, + 29, + 7 + ], + "weighted_loads": [ + 0.8306028228253126, + 0.23616166785359383, + 0.7016364745795727, + 0.334117591381073, + 0.6380676496773958, + 0.28934963792562485, + 0.9144604057073593, + 0.4167201705276966, + 0.6942153088748455, + 0.3336369227617979, + 0.5103509835898876, + 0.06340599991381168, + 0.8280005566775799, + 0.2807601522654295, + 0.6265512965619564, + 0.9420688487589359, + 1.0951045155525208, + 0.19719223119318485, + 0.15900758653879166, + 0.4085419811308384, + 0.6998424492776394, + 0.8079551383852959, + 0.13583922758698463, + 1.4565815441310406, + 0.4375512842088938, + 1.4863121509552002, + 1.7218569368124008, + 0.3877392113208771, + 0.10805801302194595, + 0.08075913786888123, + 0.4214745834469795, + 0.07125252112746239, + 0.19291538931429386, + 0.4129231162369251, + 0.7693169191479683, + 1.3402869291603565, + 0.7796790711581707, + 0.14396314695477486, + 0.4795279800891876, + 0.46007897704839706, + 0.5640841294080019, + 0.1345558799803257, + 1.4277146700769663, + 0.6596846356987953, + 0.0, + 0.28963906690478325, + 0.7286654375493526, + 1.091480027884245, + 0.4174185059964657, + 0.49824579432606697, + 0.06852046214044094, + 0.2915830686688423, + 0.28103166818618774, + 0.35297943092882633, + 0.6002304684370756, + 0.9190201070159674, + 1.052500793710351, + 1.5266165845096111, + 0.16822911240160465, + 0.9622161909937859, + 1.3169124200940132, + 0.22534094378352165, + 1.5586444642394781, + 0.2466187383979559 + ], + "unique_experts": 63, + "load_cv": 0.6646265079439192, + "normalized_load_entropy": 0.9458345039385624, + "max_load_share": 0.04861111111111111 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "9f0a6ad2c41e2632e9a70b2aff1f997c9558e2d955757c2577082829c32f3439", + "route_weight_sha256": "ee6d45dd4e91335b9003854276b51c5229797509c6ea5bf248ea68928838837d", + "loads": [ + 23, + 6, + 19, + 14, + 22, + 10, + 24, + 20, + 15, + 16, + 7, + 2, + 19, + 11, + 13, + 17, + 20, + 3, + 3, + 7, + 13, + 16, + 4, + 34, + 16, + 23, + 25, + 7, + 2, + 1, + 11, + 2, + 6, + 14, + 14, + 15, + 13, + 5, + 11, + 12, + 16, + 2, + 39, + 8, + 0, + 13, + 25, + 16, + 10, + 13, + 3, + 7, + 5, + 9, + 21, + 20, + 17, + 40, + 8, + 16, + 24, + 3, + 31, + 9 + ], + "weighted_loads": [ + 1.022060323972255, + 0.4110783711075783, + 0.7016364745795727, + 0.5643538357689977, + 0.8968889396637678, + 0.4144693473353982, + 1.291139394044876, + 0.7474388964474201, + 0.6942153088748455, + 0.5716178100556135, + 0.5103509835898876, + 0.06340599991381168, + 0.8727703867480159, + 0.487070232629776, + 0.7000061683356762, + 0.9420688487589359, + 1.1467875479720533, + 0.19719223119318485, + 0.15900758653879166, + 0.5598841793835163, + 0.6998424492776394, + 0.8079551383852959, + 0.15443239733576775, + 2.8436797596514225, + 0.5959342289716005, + 1.4863121509552002, + 1.8911142107099295, + 0.3877392113208771, + 0.10805801302194595, + 0.08075913786888123, + 0.4214745834469795, + 0.07125252112746239, + 0.251741087064147, + 0.6526113115251064, + 0.7693169191479683, + 1.3402869291603565, + 0.7796790711581707, + 0.18427904695272446, + 0.6320331068709493, + 0.46007897704839706, + 0.8953715991228819, + 0.1345558799803257, + 1.5385187454521656, + 0.7221248783171177, + 0.0, + 1.3676328882575035, + 1.6862197145819664, + 1.1510894242674112, + 0.45803551748394966, + 0.5463537126779556, + 0.1209405567497015, + 0.38021279871463776, + 0.28103166818618774, + 0.35297943092882633, + 1.5131868999451399, + 1.0629117656499147, + 1.052500793710351, + 2.475531667470932, + 0.3447964619845152, + 1.193751759827137, + 1.3169124200940132, + 0.22534094378352165, + 1.635088685899973, + 0.32371368072927 + ], + "unique_experts": 63, + "load_cv": 0.6566468587502868, + "normalized_load_entropy": 0.9466050636365481, + "max_load_share": 0.04597701149425287 + } + }, + "s1_bos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "3bbd3c9f38619f496cabe52c107e1cee6260807ac04613f1655a53ea09a62c1f", + "route_weight_sha256": "4a5feb13527c3c7d95d0474ab69841c70caba4af3bf023511738f89becfb9255", + "loads": [ + 18, + 4, + 16, + 6, + 17, + 8, + 17, + 13, + 18, + 10, + 5, + 2, + 16, + 5, + 13, + 17, + 17, + 2, + 3, + 6, + 13, + 15, + 4, + 22, + 12, + 25, + 22, + 7, + 2, + 1, + 8, + 2, + 5, + 10, + 17, + 15, + 11, + 3, + 10, + 13, + 9, + 2, + 31, + 8, + 1, + 6, + 17, + 14, + 8, + 12, + 3, + 5, + 5, + 11, + 11, + 15, + 20, + 26, + 5, + 16, + 24, + 4, + 28, + 9 + ], + "weighted_loads": [ + 0.8446186576038599, + 0.2771543636918068, + 0.6206329353153706, + 0.335997574031353, + 0.6601006742566824, + 0.3203671332448721, + 0.8360632248222828, + 0.4591081514954567, + 0.7801102977246046, + 0.3793532978743315, + 0.435747642070055, + 0.06566832773387432, + 0.805124906823039, + 0.2200267519801855, + 0.6654207054525614, + 0.923811998218298, + 1.0593435540795326, + 0.16827255487442017, + 0.16358067840337753, + 0.44290560856461525, + 0.7017085291445255, + 0.8226659558713436, + 0.15115612745285034, + 1.451800711452961, + 0.42731352150440216, + 1.530204314738512, + 1.6796322725713253, + 0.3887288346886635, + 0.10564857348799706, + 0.0797778069972992, + 0.3359788488596678, + 0.053245995193719864, + 0.20647466368973255, + 0.3871210925281048, + 0.8829614818096161, + 1.304520409554243, + 0.6963523477315903, + 0.10134664736688137, + 0.5537883825600147, + 0.5033405125141144, + 0.5162679962813854, + 0.13573650270700455, + 1.310143131762743, + 0.7269675824791193, + 0.03554921597242355, + 0.25728829950094223, + 0.8355093970894814, + 1.1077583953738213, + 0.38027341663837433, + 0.5089378710836172, + 0.09928002581000328, + 0.20480993762612343, + 0.28808508068323135, + 0.4176630303263664, + 0.6208114698529243, + 0.8528812155127525, + 1.2675544526427984, + 1.3819246403872967, + 0.17284101620316505, + 1.1512105204164982, + 1.377974335104227, + 0.25755305401980877, + 1.5262236557900906, + 0.31942187063395977 + ], + "unique_experts": 64, + "load_cv": 0.6440611887195306, + "normalized_load_entropy": 0.9484613757701913, + "max_load_share": 0.043055555555555555 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "e36ee2777006ae2cb412a7d6a3acb9089198a42e9563e5f4c4aa9ed3834a984d", + "route_weight_sha256": "bbc9d9633ce89bddb0a92a8b0ed7c0e7e0b60324ab5389c4d27a70e7015f2527", + "loads": [ + 22, + 9, + 22, + 15, + 24, + 10, + 29, + 22, + 19, + 14, + 7, + 3, + 17, + 10, + 14, + 20, + 20, + 3, + 5, + 6, + 14, + 16, + 6, + 38, + 15, + 25, + 25, + 7, + 2, + 2, + 9, + 2, + 6, + 20, + 17, + 15, + 17, + 5, + 16, + 13, + 18, + 2, + 33, + 8, + 3, + 13, + 33, + 17, + 14, + 16, + 5, + 15, + 11, + 14, + 21, + 18, + 20, + 44, + 7, + 16, + 25, + 5, + 34, + 13 + ], + "weighted_loads": [ + 1.1392181483097374, + 0.5969587340950966, + 0.93639350309968, + 0.8556766612455249, + 0.9966012481600046, + 0.38960336428135633, + 1.5212888158857822, + 0.8187429308891296, + 0.8153978902846575, + 0.5394760947674513, + 0.526344109326601, + 0.11671248264610767, + 0.8153161313384771, + 0.42998733557760715, + 0.7633664105087519, + 1.0446211490780115, + 1.1047521331347525, + 0.2276124432682991, + 0.2552626095712185, + 0.44290560856461525, + 0.749615453183651, + 0.8492559976875782, + 0.2180441301316023, + 3.398906622081995, + 0.5514323152601719, + 1.530204314738512, + 1.7702715918421745, + 0.3887288346886635, + 0.10564857348799706, + 0.1243252344429493, + 0.3855013195425272, + 0.053245995193719864, + 0.2504278626292944, + 1.0137685891240835, + 0.8829614818096161, + 1.304520409554243, + 1.1317437067627907, + 0.19939696602523327, + 0.9109699819236994, + 0.5033405125141144, + 0.9802348017692566, + 0.13573650270700455, + 1.364282302558422, + 0.7269675824791193, + 0.13772214949131012, + 1.3614145945757627, + 2.4523023068904877, + 1.3297441992908716, + 0.6425253693014383, + 0.7044520806521177, + 0.15895340964198112, + 0.8158358465880156, + 0.9289317242801189, + 0.5561718177050352, + 1.5861834213137627, + 0.9950885884463787, + 1.2675544526427984, + 2.9131480548530817, + 0.30176928266882896, + 1.1512105204164982, + 1.425814926624298, + 0.3828656207770109, + 1.7500163558870554, + 0.5042387414723635 + ], + "unique_experts": 64, + "load_cv": 0.6107871000336351, + "normalized_load_entropy": 0.9544367742453772, + "max_load_share": 0.045548654244306416 + } + }, + "s0_x": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "db2a0861850c325611460ced33d2123b6d5e5db1438b8e1d0d2bc4db45e53f58", + "route_weight_sha256": "c40dcd4507ead2e9d28066c92d3e32661629466032cc85bed130f168d9c6cf51", + "loads": [ + 18, + 3, + 21, + 5, + 17, + 6, + 17, + 12, + 17, + 8, + 7, + 4, + 17, + 5, + 12, + 19, + 16, + 3, + 3, + 5, + 12, + 14, + 4, + 23, + 8, + 26, + 21, + 7, + 3, + 1, + 11, + 2, + 5, + 9, + 11, + 15, + 11, + 4, + 10, + 15, + 9, + 2, + 32, + 8, + 0, + 7, + 14, + 13, + 8, + 12, + 3, + 6, + 6, + 9, + 14, + 17, + 17, + 27, + 6, + 17, + 28, + 3, + 28, + 7 + ], + "weighted_loads": [ + 0.8322690464556217, + 0.23440850526094437, + 0.7864576950669289, + 0.3011273741722107, + 0.6504315137863159, + 0.24359990656375885, + 0.9709181003272533, + 0.424272695556283, + 0.7374842707067728, + 0.26408195309340954, + 0.5079827420413494, + 0.14433117397129536, + 0.7988674826920033, + 0.23606722988188267, + 0.6345125325024128, + 1.0407144166529179, + 1.0418958961963654, + 0.1988925337791443, + 0.15753373131155968, + 0.43891750276088715, + 0.6727683842182159, + 0.7364085167646408, + 0.15809861198067665, + 1.3964167833328247, + 0.3206075057387352, + 1.6140880789607763, + 1.6278559267520905, + 0.39625639095902443, + 0.14499292895197868, + 0.07905670255422592, + 0.40974159352481365, + 0.06689909100532532, + 0.20979014039039612, + 0.3232781272381544, + 0.6419907324016094, + 1.382553230971098, + 0.6546720713376999, + 0.13573667407035828, + 0.562298733741045, + 0.5556866098195314, + 0.5229966603219509, + 0.13074540719389915, + 1.3474498204886913, + 0.7061810288578272, + 0.0, + 0.2916499078273773, + 0.7510845027863979, + 1.0464454554021358, + 0.37519388273358345, + 0.49394598603248596, + 0.09727029502391815, + 0.2509099766612053, + 0.31095630303025246, + 0.36078461445868015, + 0.755644503980875, + 0.8791612535715103, + 1.0855372808873653, + 1.5004433952271938, + 0.19833210483193398, + 1.0338880494236946, + 1.5408294517546892, + 0.22927237302064896, + 1.4826271384954453, + 0.2463419772684574 + ], + "unique_experts": 63, + "load_cv": 0.6636970899141368, + "normalized_load_entropy": 0.9467017096625553, + "max_load_share": 0.044444444444444446 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "b12fbbe6236fd8a8cc911df842953aac41a854ec3fac92c0a658d3fc638757c8", + "route_weight_sha256": "9e5ca9409f12545cb9ba8776702d1b88a743f94bc9b3c3ddde4f754ff32beb9e", + "loads": [ + 24, + 6, + 21, + 15, + 22, + 9, + 24, + 20, + 17, + 14, + 7, + 4, + 18, + 10, + 14, + 19, + 20, + 3, + 3, + 5, + 12, + 14, + 5, + 34, + 12, + 26, + 23, + 7, + 3, + 1, + 11, + 2, + 6, + 13, + 11, + 15, + 12, + 4, + 14, + 15, + 15, + 2, + 34, + 8, + 0, + 14, + 27, + 15, + 9, + 12, + 3, + 7, + 6, + 9, + 25, + 19, + 17, + 38, + 8, + 17, + 28, + 3, + 32, + 7 + ], + "weighted_loads": [ + 1.097407462541014, + 0.4093252085149288, + 0.7864576950669289, + 0.6947267567738891, + 0.8499791920185089, + 0.36644498724490404, + 1.4023245386779308, + 0.7463154252618551, + 0.7374842707067728, + 0.4616424385458231, + 0.5079827420413494, + 0.14433117397129536, + 0.8090691370889544, + 0.44237731024622917, + 0.7523248232901096, + 1.0407144166529179, + 1.1256522997282445, + 0.1988925337791443, + 0.15753373131155968, + 0.43891750276088715, + 0.6727683842182159, + 0.7364085167646408, + 0.17669178172945976, + 2.750284381210804, + 0.47434408962726593, + 1.6140880789607763, + 1.6873737201094627, + 0.39625639095902443, + 0.14499292895197868, + 0.07905670255422592, + 0.40974159352481365, + 0.06689909100532532, + 0.26861583814024925, + 0.5900066513568163, + 0.6419907324016094, + 1.382553230971098, + 0.6940315626561642, + 0.13573667407035828, + 0.7722631925716996, + 0.5556866098195314, + 0.8037407547235489, + 0.13074540719389915, + 1.4001332316547632, + 0.7061810288578272, + 0.0, + 1.4148284010589123, + 1.8609580732882023, + 1.1060548517853022, + 0.41581089422106743, + 0.49394598603248596, + 0.09727029502391815, + 0.33953970670700073, + 0.31095630303025246, + 0.36078461445868015, + 1.8026291467249393, + 0.963961698114872, + 1.0855372808873653, + 2.4676400497555733, + 0.31908584758639336, + 1.0338880494236946, + 1.5408294517546892, + 0.22927237302064896, + 1.61643036454916, + 0.2463419772684574 + ], + "unique_experts": 63, + "load_cv": 0.6560027003543827, + "normalized_load_entropy": 0.9466916912281291, + "max_load_share": 0.04367816091954023 + } + }, + "s1_x": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "7cb984289594da12709e21164361ce02bdf71324c70dab9ea09523aa31d6428f", + "route_weight_sha256": "ad57ecb580de4bfbb1a66e14a050aad706ab410c1a448077645a78a880093a40", + "loads": [ + 17, + 2, + 22, + 10, + 18, + 7, + 19, + 11, + 18, + 4, + 7, + 5, + 14, + 4, + 10, + 17, + 17, + 2, + 3, + 6, + 11, + 15, + 4, + 23, + 8, + 27, + 23, + 7, + 2, + 1, + 7, + 3, + 3, + 11, + 14, + 14, + 11, + 3, + 11, + 13, + 9, + 2, + 35, + 9, + 1, + 7, + 16, + 14, + 7, + 13, + 4, + 0, + 5, + 9, + 14, + 17, + 17, + 26, + 5, + 16, + 26, + 3, + 29, + 12 + ], + "weighted_loads": [ + 0.7656193431466818, + 0.1825728639960289, + 0.7748546786606312, + 0.5679366756230593, + 0.6474913991987705, + 0.2840390708297491, + 0.9444869607686996, + 0.4108635224401951, + 0.7682122383266687, + 0.15015906654298306, + 0.49440364353358746, + 0.163388816639781, + 0.6827936992049217, + 0.18108592182397842, + 0.4943614602088928, + 0.8800188824534416, + 1.0607282333076, + 0.1665320135653019, + 0.16506362333893776, + 0.4689552038908005, + 0.5855555348098278, + 0.8127098437398672, + 0.13889389671385288, + 1.6221286337822676, + 0.29647237434983253, + 1.5400386285036802, + 1.681215114891529, + 0.3819158747792244, + 0.09966042265295982, + 0.07220329344272614, + 0.3097871784120798, + 0.08835114724934101, + 0.13322191685438156, + 0.42387158051133156, + 0.7395652234554291, + 1.2465662993490696, + 0.6489483043551445, + 0.09551328234374523, + 0.5838717129081488, + 0.48629553616046906, + 0.4800977762788534, + 0.1263432502746582, + 1.402623726055026, + 0.7792831249535084, + 0.03947565332055092, + 0.2817576713860035, + 0.8536477480083704, + 1.06626458466053, + 0.3107490502297878, + 0.5297227688133717, + 0.15366306900978088, + 0.0, + 0.2841704599559307, + 0.34134383127093315, + 0.7502007260918617, + 0.8358155321329832, + 1.0946234576404095, + 1.3202543295919895, + 0.1792930494993925, + 1.1231767944991589, + 1.3444989137351513, + 0.23311638832092285, + 1.577590560540557, + 0.4342929311096668 + ], + "unique_experts": 63, + "load_cv": 0.6926421055781644, + "normalized_load_entropy": 0.9411580866473314, + "max_load_share": 0.04861111111111111 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "ff4378e76f67cff4a2d84e5876ae07e3f8a9b09f2b729891d1f4e6bc42eb34fa", + "route_weight_sha256": "0be48da9978f839210157302b5e01a2fb3e99b71ee0c475065e502df3291bc3d", + "loads": [ + 21, + 7, + 29, + 20, + 22, + 8, + 32, + 20, + 19, + 7, + 9, + 5, + 15, + 9, + 11, + 20, + 20, + 3, + 5, + 7, + 12, + 17, + 5, + 40, + 10, + 27, + 24, + 7, + 2, + 2, + 7, + 3, + 5, + 21, + 14, + 14, + 18, + 4, + 19, + 13, + 16, + 2, + 37, + 9, + 3, + 15, + 34, + 17, + 14, + 16, + 6, + 11, + 11, + 11, + 27, + 18, + 17, + 43, + 7, + 16, + 28, + 4, + 37, + 14 + ], + "weighted_loads": [ + 1.0548980203457177, + 0.5023772343993187, + 1.1140447054058313, + 1.1603471199050546, + 0.8207857348024845, + 0.28920652996748686, + 1.6920851431787014, + 0.7502046637237072, + 0.8034998308867216, + 0.2647646386176348, + 0.5850001107901335, + 0.163388816639781, + 0.6929849237203598, + 0.39104650542140007, + 0.5923071652650833, + 1.0008280333131552, + 1.10613681236282, + 0.22587190195918083, + 0.2567455545067787, + 0.4991950783878565, + 0.6334624588489532, + 0.8937185164541006, + 0.15733614936470985, + 3.624242575839162, + 0.3727007880806923, + 1.5400386285036802, + 1.7077025584876537, + 0.3819158747792244, + 0.09966042265295982, + 0.11675072088837624, + 0.3097871784120798, + 0.08835114724934101, + 0.20572123304009438, + 1.0396717432886362, + 0.7395652234554291, + 1.2465662993490696, + 1.123404636979103, + 0.14472188614308834, + 1.04053789190948, + 0.48629553616046906, + 0.788592716678977, + 0.1263432502746582, + 1.4567628968507051, + 0.7792831249535084, + 0.14164858683943748, + 1.4266975056380033, + 2.709977241232991, + 1.2882503885775805, + 0.6206138338893652, + 0.6816505044698715, + 0.21100610122084618, + 0.6923276353627443, + 0.9250171035528183, + 0.4116042423993349, + 1.9782849363982677, + 0.8677375894039869, + 1.0946234576404095, + 2.8486329298466444, + 0.2856669183820486, + 1.1231767944991589, + 1.4386729672551155, + 0.358428955078125, + 1.8636589627712965, + 0.5390939302742481 + ], + "unique_experts": 64, + "load_cv": 0.6602153031990992, + "normalized_load_entropy": 0.9487134291965315, + "max_load_share": 0.044513457556935816 + } + }, + "s0_period": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "69c8f7a1a5d9f94a510866031c4865cafe895da49f5f97c539cc9e35a35f7581", + "route_weight_sha256": "9f1920ee03d88b292bf971b3306e95622c17c6fdfdec51773a2b513299806d18", + "loads": [ + 19, + 3, + 19, + 7, + 14, + 8, + 17, + 13, + 18, + 8, + 8, + 3, + 12, + 5, + 10, + 18, + 17, + 3, + 3, + 5, + 13, + 15, + 4, + 23, + 9, + 26, + 23, + 7, + 3, + 1, + 10, + 3, + 4, + 9, + 11, + 15, + 11, + 4, + 8, + 15, + 10, + 2, + 34, + 8, + 0, + 6, + 13, + 13, + 8, + 12, + 2, + 5, + 6, + 11, + 15, + 17, + 17, + 29, + 5, + 16, + 27, + 3, + 29, + 8 + ], + "weighted_loads": [ + 0.8745830617845058, + 0.21797634661197662, + 0.6837991625070572, + 0.3426240645349026, + 0.5439801756292582, + 0.3197183459997177, + 0.9484920836985111, + 0.45065202564001083, + 0.8355338349938393, + 0.2904201317578554, + 0.532623652368784, + 0.10510339587926865, + 0.6304656714200974, + 0.2375364936888218, + 0.5185408405959606, + 1.035333339124918, + 1.1072961930185556, + 0.20249516516923904, + 0.15951434895396233, + 0.4161685034632683, + 0.6918544732034206, + 0.8188688661903143, + 0.1693286933004856, + 1.4800236970186234, + 0.34513114392757416, + 1.5992142651230097, + 1.7037477772682905, + 0.38591529428958893, + 0.14401116222143173, + 0.07940170913934708, + 0.3978680055588484, + 0.08919893018901348, + 0.1726863533258438, + 0.3355834372341633, + 0.6533285826444626, + 1.3684750497341156, + 0.6416722387075424, + 0.1334332711994648, + 0.4923069104552269, + 0.5588170811533928, + 0.539730740711093, + 0.13537362590432167, + 1.3997107315808535, + 0.8706361018121243, + 0.0, + 0.2464013285934925, + 0.7141944244503975, + 1.0521935857832432, + 0.38027945160865784, + 0.49971913918852806, + 0.07221497222781181, + 0.2381930574774742, + 0.30844876542687416, + 0.4291946738958359, + 0.7686764504760504, + 0.8496894873678684, + 1.0690511167049408, + 1.6051553450524807, + 0.16740108281373978, + 0.9826191402971745, + 1.4916041493415833, + 0.22939858213067055, + 1.601829832419753, + 0.27876030653715134 + ], + "unique_experts": 63, + "load_cv": 0.6764102780099743, + "normalized_load_entropy": 0.9454011415363475, + "max_load_share": 0.04722222222222222 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "f68924ed98e6286c9aca5b7d1046fc46f6f8f52ea3c23c2603bd63572d55ceb2", + "route_weight_sha256": "2951332efdaea6c8b9446c68f56df2d3714b44e636b6f98971a4a924bbf4ff81", + "loads": [ + 25, + 6, + 20, + 15, + 19, + 11, + 25, + 20, + 18, + 16, + 8, + 4, + 13, + 10, + 11, + 18, + 20, + 3, + 3, + 5, + 13, + 15, + 5, + 34, + 12, + 26, + 25, + 7, + 3, + 1, + 10, + 3, + 5, + 13, + 11, + 15, + 11, + 4, + 13, + 15, + 16, + 2, + 37, + 8, + 0, + 12, + 24, + 15, + 9, + 12, + 3, + 6, + 6, + 12, + 26, + 19, + 17, + 41, + 7, + 16, + 27, + 3, + 31, + 10 + ], + "weighted_loads": [ + 1.134918682742864, + 0.3928930498659611, + 0.7278688661754131, + 0.5996367065235972, + 0.7476400900632143, + 0.43429938796907663, + 1.4525478817522526, + 0.7397095747292042, + 0.8355338349938393, + 0.582270672544837, + 0.532623652368784, + 0.14761297032237053, + 0.6406673258170485, + 0.4438465740531683, + 0.5919957123696804, + 1.035333339124918, + 1.1589792254380882, + 0.20249516516923904, + 0.15951434895396233, + 0.4161685034632683, + 0.6918544732034206, + 0.8188688661903143, + 0.18792186304926872, + 2.838927239179611, + 0.45289071649312973, + 1.5992142651230097, + 1.7631098926067352, + 0.38591529428958893, + 0.14401116222143173, + 0.07940170913934708, + 0.3978680055588484, + 0.08919893018901348, + 0.23151205107569695, + 0.6208454146981239, + 0.6533285826444626, + 1.3684750497341156, + 0.6416722387075424, + 0.1334332711994648, + 0.840833724476397, + 0.5588170811533928, + 0.8390249032527208, + 0.13537362590432167, + 1.4956544376909733, + 0.8706361018121243, + 0.0, + 1.3240941353142262, + 1.6717487014830112, + 1.1118029821664095, + 0.4208964630961418, + 0.49971913918852806, + 0.10215160064399242, + 0.32682278752326965, + 0.30844876542687416, + 0.4743991307914257, + 1.7326604444533587, + 0.9364100694656372, + 1.0690511167049408, + 2.6240088753402233, + 0.2861855551600456, + 0.9826191402971745, + 1.4916041493415833, + 0.22939858213067055, + 1.6782740540802479, + 0.3600879944860935 + ], + "unique_experts": 63, + "load_cv": 0.6657266460303158, + "normalized_load_entropy": 0.9463391290809443, + "max_load_share": 0.047126436781609195 + } + }, + "s1_period": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "3842d161d37a7f04b3713ed7b4dcabf18ed4562ddd18fbc98883b02bee6b5794", + "route_weight_sha256": "8db6b4ffb4ddefb084e998aa299e9c7ea61fa1f42f5f405a65f02aec8b5af5a8", + "loads": [ + 17, + 3, + 20, + 10, + 16, + 6, + 20, + 10, + 18, + 7, + 6, + 5, + 13, + 4, + 14, + 18, + 16, + 2, + 3, + 5, + 11, + 13, + 4, + 24, + 8, + 25, + 20, + 7, + 2, + 1, + 10, + 2, + 5, + 12, + 15, + 14, + 11, + 5, + 12, + 12, + 7, + 2, + 35, + 8, + 1, + 7, + 16, + 12, + 9, + 11, + 3, + 4, + 5, + 9, + 14, + 17, + 18, + 26, + 6, + 18, + 25, + 3, + 28, + 10 + ], + "weighted_loads": [ + 0.763108141720295, + 0.21520016714930534, + 0.6872893329709768, + 0.5783006716519594, + 0.6254364401102066, + 0.2673125918954611, + 0.9890255033969879, + 0.3595730811357498, + 0.7586908228695393, + 0.24148769117891788, + 0.46151773259043694, + 0.16617218777537346, + 0.6461924128234386, + 0.18593486957252026, + 0.6721183154731989, + 0.9090840350836515, + 1.0348542779684067, + 0.16811298951506615, + 0.16563548892736435, + 0.4207022748887539, + 0.5893735364079475, + 0.7158075161278248, + 0.1431014984846115, + 1.7118902206420898, + 0.305849963799119, + 1.4970804899930954, + 1.591374846175313, + 0.37771038338541985, + 0.10114530473947525, + 0.07572640478610992, + 0.3883251715451479, + 0.04997653514146805, + 0.19188028573989868, + 0.4651061110198498, + 0.7980365213006735, + 1.266517173498869, + 0.6427510790526867, + 0.156591534614563, + 0.6218587178736925, + 0.46140612848103046, + 0.4058101177215576, + 0.12601006776094437, + 1.4068800117820501, + 0.75718604773283, + 0.034281954169273376, + 0.28175804018974304, + 0.879045756533742, + 1.0329230837523937, + 0.37701945193111897, + 0.48529693111777306, + 0.13736876472830772, + 0.18406178057193756, + 0.2919464260339737, + 0.358716132119298, + 0.7513399589806795, + 0.8734336979687214, + 1.1749380454421043, + 1.3627294711768627, + 0.21031896024942398, + 1.1724207364022732, + 1.3167329784482718, + 0.23284054175019264, + 1.5686774626374245, + 0.3675250578671694 + ], + "unique_experts": 64, + "load_cv": 0.66332495807108, + "normalized_load_entropy": 0.9472069654061616, + "max_load_share": 0.04861111111111111 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "a937bee434542f5bbbd911d7d5d023a5aa2ebd0a39ed3e642ce1bf3cbdea7a57", + "route_weight_sha256": "a206a19bae48a8d7a4cc8696f259769367f556c69cb09add274ec668174754f2", + "loads": [ + 21, + 8, + 26, + 19, + 20, + 7, + 35, + 19, + 20, + 12, + 8, + 5, + 14, + 9, + 15, + 21, + 20, + 3, + 5, + 5, + 12, + 15, + 5, + 39, + 10, + 26, + 22, + 7, + 2, + 2, + 10, + 2, + 6, + 23, + 15, + 14, + 17, + 6, + 21, + 12, + 15, + 2, + 37, + 8, + 3, + 14, + 34, + 15, + 15, + 14, + 4, + 14, + 11, + 11, + 26, + 18, + 19, + 43, + 9, + 18, + 27, + 4, + 34, + 13 + ], + "weighted_loads": [ + 1.040475642774254, + 0.5350045375525951, + 1.0030499007552862, + 1.0998955825343728, + 0.79954843968153, + 0.27248005103319883, + 1.8337489608675241, + 0.6955462284386158, + 0.8311056010425091, + 0.42666169069707394, + 0.552114199846983, + 0.16617218777537346, + 0.6563836373388767, + 0.3958954531699419, + 0.7700640205293894, + 1.029893185943365, + 1.114371879491955, + 0.22745287790894508, + 0.2573174200952053, + 0.4207022748887539, + 0.637280460447073, + 0.8058243729174137, + 0.16154375113546848, + 3.635963086038828, + 0.38207837752997875, + 1.526402486488223, + 1.6416540630161762, + 0.37771038338541985, + 0.10114530473947525, + 0.12027383223176003, + 0.3883251715451479, + 0.04997653514146805, + 0.23583348467946053, + 1.184539457783103, + 0.7980365213006735, + 1.266517173498869, + 1.078142438083887, + 0.2058001384139061, + 1.256127204746008, + 0.46140612848103046, + 0.7437086813151836, + 0.12601006776094437, + 1.4610191825777292, + 0.75718604773283, + 0.13645488768815994, + 1.3858843352645636, + 2.5861743297427893, + 1.254908887669444, + 0.639271404594183, + 0.6372246667742729, + 0.16562403738498688, + 0.7950876895338297, + 0.9327930696308613, + 0.42897654324769974, + 1.8303655106574297, + 0.9053557552397251, + 1.2170253843069077, + 2.9632082860916853, + 0.35241235233843327, + 1.1724207364022732, + 1.4276663530617952, + 0.3581531085073948, + 1.7924701627343893, + 0.506347144022584 + ], + "unique_experts": 64, + "load_cv": 0.6452954827414737, + "normalized_load_entropy": 0.9504742799614899, + "max_load_share": 0.044513457556935816 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 120, + "ordered_topk_exact_tokens": 37, + "set_exact_tokens": 68, + "mean_set_jaccard": 0.8636904761904762, + "mean_token_weighted_tv": 0.028893535553167263, + "aggregate_load_tv": 0.04444444444444445 + }, + "system_bos": { + "tokens": 120, + "ordered_topk_exact_tokens": 36, + "set_exact_tokens": 54, + "mean_set_jaccard": 0.828968253968254, + "mean_token_weighted_tv": 0.03301111614176382, + "aggregate_load_tv": 0.04583333333333334 + }, + "system_x": { + "tokens": 120, + "ordered_topk_exact_tokens": 21, + "set_exact_tokens": 36, + "mean_set_jaccard": 0.7619047619047618, + "mean_token_weighted_tv": 0.04752759853533159, + "aggregate_load_tv": 0.05694444444444445 + }, + "system_period": { + "tokens": 120, + "ordered_topk_exact_tokens": 28, + "set_exact_tokens": 45, + "mean_set_jaccard": 0.790357142857143, + "mean_token_weighted_tv": 0.04402754112767677, + "aggregate_load_tv": 0.06111111111111111 + }, + "bos_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 29, + "set_exact_tokens": 57, + "mean_set_jaccard": 0.8311507936507937, + "mean_token_weighted_tv": 0.035967035118180016, + "aggregate_load_tv": 0.051388888888888894 + }, + "bos_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 27, + "set_exact_tokens": 53, + "mean_set_jaccard": 0.814484126984127, + "mean_token_weighted_tv": 0.037968585112442575, + "aggregate_load_tv": 0.05555555555555555 + }, + "x_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 24, + "set_exact_tokens": 44, + "mean_set_jaccard": 0.789484126984127, + "mean_token_weighted_tv": 0.04329888951809456, + "aggregate_load_tv": 0.05416666666666667 + }, + "x_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 17, + "set_exact_tokens": 38, + "mean_set_jaccard": 0.7694444444444445, + "mean_token_weighted_tv": 0.04674107547228535, + "aggregate_load_tv": 0.05694444444444444 + }, + "period_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 23, + "set_exact_tokens": 45, + "mean_set_jaccard": 0.7882936507936509, + "mean_token_weighted_tv": 0.04442584527811656, + "aggregate_load_tv": 0.0638888888888889 + }, + "period_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 16, + "set_exact_tokens": 37, + "mean_set_jaccard": 0.7656746031746031, + "mean_token_weighted_tv": 0.04786283618304878, + "aggregate_load_tv": 0.06527777777777777 + } + } + }, + "layer_24": { + "layer": 24, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "97491f08ab3834edcdc604fe4c896b1bdb2d1d3d51ca86eee826f5ee4735fa4e", + "route_weight_sha256": "404ea780fd4e525fa10f2bf8fbc811def8d64ffa5bf0b71979704ffeabdf5609", + "loads": [ + 8, + 24, + 17, + 14, + 8, + 12, + 22, + 14, + 10, + 5, + 6, + 9, + 3, + 2, + 13, + 8, + 0, + 19, + 11, + 6, + 22, + 2, + 25, + 20, + 8, + 8, + 12, + 12, + 4, + 17, + 16, + 12, + 13, + 17, + 26, + 6, + 14, + 8, + 21, + 3, + 12, + 22, + 6, + 6, + 6, + 15, + 3, + 9, + 10, + 1, + 22, + 15, + 11, + 18, + 8, + 5, + 2, + 7, + 14, + 3, + 9, + 28, + 1, + 10 + ], + "weighted_loads": [ + 0.29631622694432735, + 1.0164259988814592, + 0.5469763465225697, + 0.6092450451105833, + 0.28202610462903976, + 0.3993956856429577, + 1.1570882871747017, + 0.6119586080312729, + 0.7441208818927407, + 0.3167964071035385, + 0.27834340184926987, + 0.44253652542829514, + 0.10166743397712708, + 0.09602173790335655, + 0.5039248932152987, + 0.3275615144520998, + 0.0, + 0.7975462954491377, + 0.38527457788586617, + 0.1743819173425436, + 0.9821294099092484, + 0.07544968649744987, + 1.4521049484610558, + 1.8567888624966145, + 0.30124574713408947, + 0.23893514648079872, + 0.5788254933431745, + 3.7045846581459045, + 0.15005218982696533, + 0.6676584929227829, + 0.6026766784489155, + 0.4554264321923256, + 0.4698779918253422, + 1.5062298327684402, + 0.895596232265234, + 0.23741207271814346, + 0.48523218370974064, + 0.26792838983237743, + 0.6923436094075441, + 0.10733492486178875, + 0.609399015083909, + 0.7144855447113514, + 0.20548148453235626, + 0.2044488862156868, + 0.23538609966635704, + 0.5108354520052671, + 0.05282583460211754, + 0.3238808121532202, + 0.316188694909215, + 0.07846289128065109, + 0.7839291840791702, + 1.0821962021291256, + 0.36712461337447166, + 0.6911000600084662, + 0.7683878168463707, + 0.5742924213409424, + 0.06389185972511768, + 0.24153009615838528, + 0.6051692236214876, + 0.08478204347193241, + 0.34137988835573196, + 1.620703212916851, + 0.04405077546834946, + 0.36181688494980335 + ], + "unique_experts": 63, + "load_cv": 0.6138323251970281, + "normalized_load_entropy": 0.9518088451511976, + "max_load_share": 0.03888888888888889 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "6be1dc7c5fabac739129a251a4d58f8da7ea5fdac94fc59eacdeb43cc467e025", + "route_weight_sha256": "124a20d3f322caff133f1226840e7a44bd02d8ae159fcd4d7c1e43ef7189286d", + "loads": [ + 8, + 26, + 20, + 14, + 8, + 17, + 22, + 15, + 19, + 5, + 16, + 9, + 4, + 2, + 15, + 8, + 0, + 19, + 11, + 6, + 23, + 3, + 32, + 20, + 15, + 8, + 12, + 12, + 11, + 22, + 16, + 15, + 16, + 21, + 33, + 7, + 15, + 10, + 22, + 3, + 12, + 23, + 10, + 8, + 6, + 17, + 3, + 15, + 10, + 1, + 27, + 21, + 14, + 21, + 8, + 5, + 2, + 7, + 25, + 4, + 11, + 44, + 3, + 13 + ], + "weighted_loads": [ + 0.29631622694432735, + 1.0867395009845495, + 0.65345230512321, + 0.6092450451105833, + 0.28202610462903976, + 0.5463404089678079, + 1.1570882871747017, + 0.6699717305600643, + 1.128256204072386, + 0.3167964071035385, + 0.6503980823326856, + 0.44253652542829514, + 0.10441192425787449, + 0.09602173790335655, + 0.5698120053857565, + 0.3275615144520998, + 0.0, + 0.7975462954491377, + 0.38527457788586617, + 0.1743819173425436, + 1.0150375925004482, + 0.1270337477326393, + 1.9162553660571575, + 1.8567888624966145, + 0.5604345246683806, + 0.23893514648079872, + 0.5788254933431745, + 3.7045846581459045, + 0.43187202140688896, + 0.8664880990982056, + 0.6026766784489155, + 0.563393522053957, + 0.5721103698015213, + 1.6912665106356144, + 1.1269010920077562, + 0.2856471613049507, + 0.5754438508301973, + 1.177366217598319, + 0.7326289769262075, + 0.10733492486178875, + 0.609399015083909, + 0.7753058560192585, + 0.392028221860528, + 0.28457050770521164, + 0.23538609966635704, + 0.6057770531624556, + 0.05282583460211754, + 0.7014559260569513, + 0.316188694909215, + 0.07846289128065109, + 1.0084468312561512, + 1.4839256629347801, + 0.45190677233040333, + 0.8256463138386607, + 0.7683878168463707, + 0.5742924213409424, + 0.06389185972511768, + 0.24153009615838528, + 0.9725874204305001, + 0.12138141132891178, + 0.4039503037929535, + 2.7273913943208754, + 0.04695403226651251, + 2.343652529641986 + ], + "unique_experts": 63, + "load_cv": 0.6318410773661096, + "normalized_load_entropy": 0.9508378979924664, + "max_load_share": 0.05057471264367816 + } + }, + "s1_eos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "b98bff1462d9af97484ac836d2b0040f80007951a78cc5ce858221f796f9eb04", + "route_weight_sha256": "87498fda6537562fbe83be72cec2a1aab5706cb20bc774c0e64dbcb626e752a3", + "loads": [ + 9, + 24, + 10, + 10, + 8, + 11, + 23, + 15, + 11, + 5, + 6, + 10, + 3, + 2, + 11, + 9, + 0, + 21, + 10, + 7, + 19, + 2, + 23, + 20, + 9, + 4, + 11, + 13, + 5, + 17, + 15, + 13, + 20, + 16, + 26, + 7, + 16, + 10, + 20, + 4, + 12, + 21, + 5, + 9, + 6, + 20, + 5, + 8, + 10, + 1, + 23, + 11, + 9, + 19, + 9, + 5, + 2, + 6, + 12, + 7, + 10, + 26, + 1, + 8 + ], + "weighted_loads": [ + 0.33731476217508316, + 1.0030772015452385, + 0.3293263055384159, + 0.5058222897350788, + 0.2884956654161215, + 0.3678702600300312, + 1.3594370801001787, + 0.6434335056692362, + 0.7895240392535925, + 0.30659860745072365, + 0.27175584994256496, + 0.5081158727407455, + 0.10186848975718021, + 0.08926935866475105, + 0.42917650379240513, + 0.3674886506050825, + 0.0, + 0.8780700750648975, + 0.34216240979731083, + 0.2029501385986805, + 0.8904817216098309, + 0.07481667026877403, + 1.3623832426965237, + 1.8490015380084515, + 0.327799579128623, + 0.11316886357963085, + 0.5258588641881943, + 3.744302587583661, + 0.1782729271799326, + 0.6555157154798508, + 0.5442378800362349, + 0.47233045287430286, + 0.7013298869132996, + 1.4989175871014595, + 0.8981276340782642, + 0.28432318568229675, + 0.5560242831707001, + 0.32360665127635, + 0.6666258070617914, + 0.13453787565231323, + 0.5843268483877182, + 0.6996671259403229, + 0.16525868140161037, + 0.3071175906807184, + 0.23208318836987019, + 0.6748609188944101, + 0.11772661842405796, + 0.27573126181960106, + 0.3094757441431284, + 0.0781022161245346, + 0.844712333753705, + 0.8507801108062267, + 0.30146120116114616, + 0.7378445826470852, + 0.7827395051717758, + 0.5608680881559849, + 0.06323748454451561, + 0.2051149122416973, + 0.5392174441367388, + 0.20188533701002598, + 0.3706623613834381, + 1.6045409236103296, + 0.04617282375693321, + 0.287540253251791 + ], + "unique_experts": 63, + "load_cv": 0.5997942033895902, + "normalized_load_entropy": 0.9543247734528142, + "max_load_share": 0.03611111111111111 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "c2e5eafc2b362692326212c46b6235508aa0cc34e76bc0b7a0ba4195340e0e05", + "route_weight_sha256": "8247c5fb794486b453cf37fad3ac80afd60f3060202b9848137618c3c9adc208", + "loads": [ + 9, + 26, + 11, + 11, + 10, + 18, + 23, + 16, + 20, + 8, + 15, + 12, + 7, + 2, + 14, + 9, + 0, + 21, + 11, + 8, + 24, + 3, + 35, + 21, + 19, + 4, + 11, + 13, + 23, + 22, + 15, + 16, + 20, + 22, + 33, + 9, + 23, + 13, + 21, + 4, + 13, + 28, + 10, + 12, + 8, + 21, + 5, + 16, + 10, + 1, + 29, + 25, + 17, + 23, + 11, + 7, + 2, + 8, + 29, + 8, + 14, + 45, + 8, + 14 + ], + "weighted_loads": [ + 0.33731476217508316, + 1.0722293313592672, + 0.35389296524226665, + 0.6178894601762295, + 0.34861009567976, + 0.5820042055565864, + 1.3594370801001787, + 0.6824418511241674, + 1.3807623242028058, + 0.43739623948931694, + 0.6351434991229326, + 0.5749683380126953, + 0.1921035167761147, + 0.08926935866475105, + 0.5228650756180286, + 0.3674886506050825, + 0.0, + 0.8780700750648975, + 0.3735911678522825, + 0.23354666493833065, + 1.105764463543892, + 0.13638199865818024, + 2.113337619230151, + 1.8737819083034992, + 0.6900314285885543, + 0.11316886357963085, + 0.5258588641881943, + 3.744302587583661, + 1.1066087428480387, + 0.8790187928825617, + 0.5442378800362349, + 0.6117413733154535, + 0.7013298869132996, + 1.809959415346384, + 1.1540270233526826, + 0.3805633559823036, + 1.0737267844378948, + 1.2768020369112492, + 0.7170707043260336, + 0.13453787565231323, + 0.6960179209709167, + 1.114009354263544, + 0.3670501038432121, + 0.558804826810956, + 0.3260477762669325, + 0.73357286863029, + 0.11772661842405796, + 0.8108586758607998, + 0.3094757441431284, + 0.0781022161245346, + 1.105806851759553, + 1.8054837826639414, + 0.5312707778066397, + 1.0214267671108246, + 0.9570388570427895, + 0.6535716913640499, + 0.06323748454451561, + 0.28316744044423103, + 1.2175775835639797, + 0.2352170515805483, + 0.4928230717778206, + 3.4044685973785818, + 0.39587467804085463, + 2.395112194120884 + ], + "unique_experts": 63, + "load_cv": 0.5873169954324563, + "normalized_load_entropy": 0.9570006658274524, + "max_load_share": 0.046583850931677016 + } + }, + "s0_bos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "bc505bd7f1afc648bc58001597161641dabc0575067004b93500ffeb58fca1d5", + "route_weight_sha256": "8bab0d1b48a11456445cdebb299e1a18ede5cac2147460b2840abce179075d8e", + "loads": [ + 8, + 34, + 14, + 8, + 8, + 12, + 23, + 12, + 10, + 5, + 5, + 12, + 5, + 2, + 10, + 8, + 0, + 21, + 12, + 3, + 17, + 2, + 25, + 20, + 7, + 8, + 11, + 13, + 5, + 18, + 19, + 13, + 17, + 16, + 27, + 6, + 14, + 6, + 23, + 3, + 10, + 25, + 3, + 8, + 8, + 21, + 2, + 10, + 10, + 2, + 23, + 16, + 5, + 15, + 8, + 5, + 2, + 6, + 13, + 4, + 10, + 26, + 1, + 5 + ], + "weighted_loads": [ + 0.32034116238355637, + 1.3549121227115393, + 0.4614513535052538, + 0.3791858088225126, + 0.31137920916080475, + 0.3928155079483986, + 1.2730846609920263, + 0.5512930266559124, + 0.7256020400673151, + 0.3267846778035164, + 0.24341828748583794, + 0.5529071725904942, + 0.15951119735836983, + 0.09518197923898697, + 0.38958216086030006, + 0.32855888083577156, + 0.0, + 0.8698872122913599, + 0.4166537933051586, + 0.08903714455664158, + 0.8170484621077776, + 0.07003986835479736, + 1.4286076724529266, + 1.8749972842633724, + 0.2865716442465782, + 0.25575406663119793, + 0.4798496551811695, + 3.7141356337815523, + 0.1941073164343834, + 0.7199309710413218, + 0.6756253968924284, + 0.47413077764213085, + 0.6089343335479498, + 1.5169423185288906, + 0.9582605306059122, + 0.23218158073723316, + 0.4719736557453871, + 0.21283645741641521, + 0.7840018346905708, + 0.11358540318906307, + 0.5584197547286749, + 0.8146144095808268, + 0.15288925543427467, + 0.2638618517667055, + 0.30099783279001713, + 0.7382462676614523, + 0.055359404534101486, + 0.3632287085056305, + 0.3351994138211012, + 0.1150832399725914, + 0.8420075140893459, + 1.0887436736375093, + 0.1706647016108036, + 0.6076209302991629, + 0.779312003403902, + 0.6095397118479013, + 0.06697947904467583, + 0.21953075379133224, + 0.5833016354590654, + 0.11252901889383793, + 0.37166186422109604, + 1.5853025391697884, + 0.04392179101705551, + 0.19324695691466331 + ], + "unique_experts": 63, + "load_cv": 0.6743995957997119, + "normalized_load_entropy": 0.9448848554265517, + "max_load_share": 0.04722222222222222 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "ee92432d2d1c5c50a7ff97962b37500fef5fd1282ea35ac875fe828eeb486797", + "route_weight_sha256": "7a476a0173b52cce3e7bfa362694dd00b992d1c2b349c4ab9208bf8aec7e54f3", + "loads": [ + 8, + 36, + 17, + 8, + 8, + 17, + 24, + 13, + 18, + 5, + 13, + 12, + 6, + 2, + 12, + 8, + 0, + 21, + 12, + 3, + 18, + 3, + 34, + 20, + 15, + 8, + 12, + 13, + 12, + 23, + 20, + 18, + 20, + 20, + 32, + 6, + 15, + 8, + 23, + 3, + 10, + 26, + 8, + 8, + 9, + 23, + 3, + 14, + 10, + 2, + 30, + 22, + 8, + 18, + 8, + 5, + 2, + 7, + 23, + 5, + 12, + 42, + 2, + 7 + ], + "weighted_loads": [ + 0.32034116238355637, + 1.4216748420149088, + 0.5555603057146072, + 0.3791858088225126, + 0.31137920916080475, + 0.5463463563937694, + 1.3317379113286734, + 0.6093061491847038, + 1.1052165497094393, + 0.3267846778035164, + 0.5658311063889414, + 0.5529071725904942, + 0.16225568763911724, + 0.09518197923898697, + 0.4521765522658825, + 0.32855888083577156, + 0.0, + 0.8698872122913599, + 0.4166537933051586, + 0.08903714455664158, + 0.8499566446989775, + 0.11225331202149391, + 2.101169791072607, + 1.8749972842633724, + 0.5842675145249814, + 0.25575406663119793, + 0.9260292835533619, + 3.7141356337815523, + 0.475927148014307, + 0.9187605772167444, + 0.7109547797590494, + 0.6386370249092579, + 0.7372514698654413, + 1.7019789963960648, + 1.1108212023973465, + 0.23218158073723316, + 0.5621853228658438, + 1.1225754674524069, + 0.7840018346905708, + 0.11358540318906307, + 0.5584197547286749, + 0.8754347208887339, + 0.411892743781209, + 0.2638618517667055, + 0.3386927042156458, + 0.8487187307327986, + 0.11710254848003387, + 0.7125957029638812, + 0.3351994138211012, + 0.1150832399725914, + 1.1459700874984264, + 1.4695011675357819, + 0.25544686056673527, + 0.7421671841293573, + 0.779312003403902, + 0.6095397118479013, + 0.06697947904467583, + 0.2565750852227211, + 0.9407120700925589, + 0.14984898827970028, + 0.43423227965831757, + 2.709667316172272, + 0.04562763497233391, + 1.205719567835331 + ], + "unique_experts": 63, + "load_cv": 0.6704096274436724, + "normalized_load_entropy": 0.9461404609449076, + "max_load_share": 0.04827586206896552 + } + }, + "s1_bos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "267747eb9c2cee01b0debaf1bd95907d214aeb119f52ef4532323dfb9dc9ada9", + "route_weight_sha256": "4205e3a6bd0bb454f90d6bd798b4e077abc83b66ba5f799a4717175e0d79924f", + "loads": [ + 11, + 25, + 10, + 8, + 8, + 11, + 23, + 13, + 10, + 5, + 6, + 11, + 5, + 2, + 12, + 11, + 0, + 25, + 9, + 5, + 15, + 4, + 25, + 20, + 6, + 8, + 14, + 13, + 5, + 15, + 17, + 14, + 16, + 16, + 28, + 8, + 12, + 7, + 19, + 4, + 10, + 21, + 4, + 9, + 6, + 26, + 5, + 12, + 15, + 2, + 20, + 12, + 7, + 17, + 8, + 5, + 2, + 4, + 11, + 7, + 10, + 25, + 1, + 5 + ], + "weighted_loads": [ + 0.42519323341548443, + 1.077759811654687, + 0.32868717238307, + 0.39487460628151894, + 0.2882462665438652, + 0.36297178268432617, + 1.4878117106854916, + 0.5876923203468323, + 0.7559384368360043, + 0.32760781049728394, + 0.26459767296910286, + 0.5132186226546764, + 0.1589559931308031, + 0.09578396379947662, + 0.460408927872777, + 0.40920780785381794, + 0.0, + 0.9899052958935499, + 0.3138006702065468, + 0.14885137788951397, + 0.695033485069871, + 0.14332988858222961, + 1.4615479577332735, + 1.8801049403846264, + 0.24799109622836113, + 0.23718037083745003, + 0.6462601236999035, + 3.7847276516258717, + 0.19329637475311756, + 0.6769817601889372, + 0.647289602085948, + 0.4931086879223585, + 0.5587811674922705, + 1.51414380595088, + 0.984374301508069, + 0.30785554461181164, + 0.4142895918339491, + 0.23579704947769642, + 0.645991999655962, + 0.13902848400175571, + 0.5322079099714756, + 0.7352067492902279, + 0.21614815294742584, + 0.2955678179860115, + 0.23610410280525684, + 0.9211760126054287, + 0.13351907581090927, + 0.42145337350666523, + 0.4790989123284817, + 0.11655448004603386, + 0.7759228553622961, + 0.9280750416219234, + 0.22703572735190392, + 0.7043944112956524, + 0.7861232273280621, + 0.611487714573741, + 0.06554502435028553, + 0.15164410695433617, + 0.5243970733135939, + 0.20286605320870876, + 0.3745677974075079, + 1.4759529251605272, + 0.0402429960668087, + 0.19185991398990154 + ], + "unique_experts": 63, + "load_cv": 0.6142344427149001, + "normalized_load_entropy": 0.9538027185183975, + "max_load_share": 0.03888888888888889 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "a84cd3d8fcede1b15896c803cf9959b4921c5f6984ae42ee964d722dc9807f29", + "route_weight_sha256": "f855c74483ab11863920bba662ca1332579b60a91778711cebb78a287c218abd", + "loads": [ + 11, + 26, + 13, + 9, + 10, + 18, + 23, + 14, + 18, + 8, + 14, + 13, + 9, + 2, + 16, + 11, + 0, + 25, + 10, + 7, + 20, + 5, + 38, + 21, + 16, + 8, + 14, + 13, + 23, + 20, + 17, + 19, + 16, + 22, + 35, + 10, + 19, + 10, + 20, + 4, + 11, + 28, + 10, + 13, + 7, + 28, + 5, + 19, + 15, + 2, + 27, + 27, + 14, + 21, + 10, + 7, + 2, + 5, + 26, + 8, + 13, + 45, + 7, + 9 + ], + "weighted_loads": [ + 0.42519323341548443, + 1.108083626255393, + 0.41840617544949055, + 0.5069417767226696, + 0.3483606968075037, + 0.5806451991666108, + 1.4878117106854916, + 0.6267006658017635, + 1.3428580611944199, + 0.45840544253587723, + 0.6215522105339915, + 0.5800710879266262, + 0.2491910201497376, + 0.09578396379947662, + 0.5785612612962723, + 0.40920780785381794, + 0.0, + 0.9899052958935499, + 0.3452294282615185, + 0.21006340719759464, + 0.910316227003932, + 0.19781843945384026, + 2.3303557857871056, + 1.9048853106796741, + 0.6084909762721509, + 0.23718037083745003, + 0.6462601236999035, + 3.7847276516258717, + 1.1216321904212236, + 0.9004848375916481, + 0.647289602085948, + 0.7023970577865839, + 0.5587811674922705, + 1.8251856341958046, + 1.251218213699758, + 0.4040957149118185, + 0.9319920931011438, + 1.187307370826602, + 0.6890443153679371, + 0.13902848400175571, + 0.6438989825546741, + 1.149548977613449, + 0.5696153808385134, + 0.6342531554400921, + 0.27508159913122654, + 1.0261197052896023, + 0.13351907581090927, + 0.9772103744326159, + 0.4790989123284817, + 0.11655448004603386, + 1.1432701032608747, + 1.8732263278216124, + 0.42903777584433556, + 0.9879765957593918, + 0.9604225791990757, + 0.704191317781806, + 0.06554502435028553, + 0.19030891358852386, + 1.1453826744109392, + 0.24144735373556614, + 0.4634764362126589, + 3.2943425378762186, + 0.38865768536925316, + 1.2860246319323778 + ], + "unique_experts": 63, + "load_cv": 0.5902291725294045, + "normalized_load_entropy": 0.9578331417153407, + "max_load_share": 0.046583850931677016 + } + }, + "s0_x": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "c51a7876ca4d19e20b3d1d6f552099333ab7023750c2c3a64b59c97ff2aa4971", + "route_weight_sha256": "3bb3dddaa46bbb9638f8fba15d49f51b2a1d988e73e8ac4aae55a36aa51f0525", + "loads": [ + 11, + 36, + 11, + 9, + 7, + 18, + 21, + 13, + 11, + 5, + 5, + 10, + 2, + 2, + 13, + 8, + 0, + 19, + 11, + 3, + 16, + 3, + 24, + 20, + 9, + 8, + 14, + 13, + 5, + 17, + 21, + 11, + 16, + 17, + 25, + 7, + 12, + 6, + 16, + 3, + 10, + 23, + 2, + 8, + 8, + 25, + 1, + 9, + 10, + 2, + 22, + 17, + 5, + 17, + 8, + 6, + 2, + 6, + 12, + 5, + 12, + 25, + 1, + 6 + ], + "weighted_loads": [ + 0.4283352177590132, + 1.4006147123873234, + 0.363565256819129, + 0.40127274207770824, + 0.25547170639038086, + 0.6006966847926378, + 1.2380235400050879, + 0.5652534421533346, + 0.7645153310149908, + 0.3246097266674042, + 0.24702781252563, + 0.4857190363109112, + 0.07098192349076271, + 0.09535413980484009, + 0.4813253805041313, + 0.3400140143930912, + 0.0, + 0.8348078522831202, + 0.38931872695684433, + 0.0901228990405798, + 0.820456899702549, + 0.0979706458747387, + 1.312559586018324, + 1.9605964682996273, + 0.3441405314952135, + 0.24406775645911694, + 0.5917747989296913, + 4.022274147719145, + 0.1803454589098692, + 0.6595529336482286, + 0.7581316158175468, + 0.4031009841710329, + 0.5548931024968624, + 1.5713763423264027, + 0.8817301541566849, + 0.2587057389318943, + 0.40938569977879524, + 0.22682345658540726, + 0.5403381139039993, + 0.11113352701067924, + 0.5702447798103094, + 0.7790035121142864, + 0.07305636629462242, + 0.2596543338149786, + 0.3017828185111284, + 0.8544037230312824, + 0.014837571419775486, + 0.31928778626024723, + 0.3453689329326153, + 0.11289656348526478, + 0.8048062268644571, + 1.1486819088459015, + 0.16565280221402645, + 0.6802261453121901, + 0.7434941492974758, + 0.6051888819783926, + 0.06274782866239548, + 0.20479066483676434, + 0.5655967388302088, + 0.12816432304680347, + 0.45629297010600567, + 1.551506631076336, + 0.04341877996921539, + 0.23468809947371483 + ], + "unique_experts": 63, + "load_cv": 0.6638830776128736, + "normalized_load_entropy": 0.9456153463326753, + "max_load_share": 0.05 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "8691cb5dff9ad21ba6b49145b340880f5e9993eeb3d0eec0c439caca40dc460f", + "route_weight_sha256": "fc3db251fff125c4967d84b6f8ab6ca611ac4a541b8965f929a31e478e13f1d7", + "loads": [ + 11, + 37, + 13, + 9, + 7, + 24, + 21, + 15, + 20, + 5, + 14, + 10, + 3, + 2, + 16, + 8, + 0, + 19, + 11, + 3, + 17, + 4, + 31, + 20, + 16, + 9, + 14, + 13, + 12, + 22, + 21, + 13, + 19, + 21, + 32, + 8, + 14, + 9, + 17, + 3, + 11, + 24, + 5, + 9, + 8, + 27, + 1, + 14, + 10, + 2, + 27, + 23, + 9, + 21, + 8, + 6, + 2, + 7, + 23, + 5, + 14, + 41, + 2, + 8 + ], + "weighted_loads": [ + 0.4283352177590132, + 1.4363437928259373, + 0.43199095502495766, + 0.40127274207770824, + 0.25547170639038086, + 0.7783771187532693, + 1.2380235400050879, + 0.6570910979062319, + 1.2234974559396505, + 0.3246097266674042, + 0.6225770546589047, + 0.4857190363109112, + 0.07372641377151012, + 0.09535413980484009, + 0.5729802660644054, + 0.3400140143930912, + 0.0, + 0.8348078522831202, + 0.38931872695684433, + 0.0901228990405798, + 0.8533650822937489, + 0.13923325017094612, + 1.7573198024183512, + 1.9605964682996273, + 0.6033293090295047, + 0.28195846639573574, + 0.5917747989296913, + 4.022274147719145, + 0.4621652904897928, + 0.8583825398236513, + 0.7581316158175468, + 0.4806171488016844, + 0.6615798510611057, + 1.7564130201935768, + 1.112809183076024, + 0.29322459548711777, + 0.5425012707710266, + 1.1722525581717491, + 0.5787285342812538, + 0.11113352701067924, + 0.6051915343850851, + 0.8398238234221935, + 0.18066528625786304, + 0.30167519487440586, + 0.3017828185111284, + 0.938607681542635, + 0.014837571419775486, + 0.7032838164595887, + 0.3453689329326153, + 0.11289656348526478, + 0.984340438619256, + 1.5744084641337395, + 0.2843564301729202, + 0.8619742151349783, + 0.7434941492974758, + 0.6051888819783926, + 0.06274782866239548, + 0.2497044187039137, + 0.961204444989562, + 0.12816432304680347, + 0.5188633855432272, + 2.6694767945446074, + 0.04512462392449379, + 1.2471607103943825 + ], + "unique_experts": 63, + "load_cv": 0.6598582183154988, + "normalized_load_entropy": 0.9464714350045011, + "max_load_share": 0.047126436781609195 + } + }, + "s1_x": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "9fa844695eaca943f214776e8fb9f937c53c78b825307efbe0cc382125964e39", + "route_weight_sha256": "5ba8fe4d74273d3df1fe9e25f9ddf471a18fa889deebde02c4a178e3da064b6d", + "loads": [ + 12, + 29, + 13, + 10, + 6, + 16, + 21, + 16, + 11, + 5, + 6, + 10, + 4, + 2, + 12, + 9, + 0, + 24, + 9, + 5, + 14, + 3, + 25, + 20, + 10, + 5, + 14, + 13, + 4, + 15, + 19, + 12, + 10, + 16, + 28, + 10, + 16, + 8, + 16, + 3, + 10, + 18, + 3, + 9, + 10, + 23, + 1, + 7, + 14, + 1, + 22, + 13, + 7, + 13, + 8, + 5, + 2, + 5, + 13, + 5, + 10, + 32, + 1, + 7 + ], + "weighted_loads": [ + 0.4816133361309767, + 1.1689339242875576, + 0.41606881469488144, + 0.47248265892267227, + 0.19689211249351501, + 0.5336108431220055, + 1.4429980162531137, + 0.6837130654603243, + 0.8421763088554144, + 0.32242976874113083, + 0.27726867981255054, + 0.45802009478211403, + 0.13445588387548923, + 0.09048772975802422, + 0.4507484994828701, + 0.39368921890854836, + 0.0, + 0.9521104227751493, + 0.3034069277346134, + 0.14380355551838875, + 0.6810957714915276, + 0.1120637021958828, + 1.3052170928567648, + 1.8994485773146152, + 0.3677268512547016, + 0.16446991078555584, + 0.734980933368206, + 3.4849795382469893, + 0.1376688051968813, + 0.6074126325547695, + 0.6865799129009247, + 0.42138112895190716, + 0.361834516748786, + 1.4716657660901546, + 0.9794030170887709, + 0.37322578951716423, + 0.5355429910123348, + 0.2651420906186104, + 0.5442354492843151, + 0.11119834333658218, + 0.49730097874999046, + 0.5904424265027046, + 0.11301009356975555, + 0.2840927094221115, + 0.3499929551035166, + 0.803994370624423, + 0.044342294335365295, + 0.2404177151620388, + 0.45851648412644863, + 0.07796937972307205, + 0.8515034075826406, + 0.8840474467724562, + 0.22150429897010326, + 0.6301862746477127, + 0.6695017628371716, + 0.5586675927042961, + 0.06157358177006245, + 0.18784059211611748, + 0.5479857157915831, + 0.14038042910397053, + 0.3896648548543453, + 1.698379686102271, + 0.042729854583740234, + 0.2571040093898773 + ], + "unique_experts": 63, + "load_cv": 0.6469300723559839, + "normalized_load_entropy": 0.9482693148696664, + "max_load_share": 0.044444444444444446 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "462bce0ccd0fe77525f085916a9d554775d90696b09736f0ef88c6fba8035df4", + "route_weight_sha256": "472dd2b124c30916ca8d9d964ddbf6e935857b9954684ca10393027522c4d667", + "loads": [ + 12, + 29, + 14, + 11, + 8, + 23, + 21, + 17, + 21, + 8, + 13, + 12, + 9, + 2, + 15, + 9, + 0, + 24, + 10, + 6, + 21, + 4, + 37, + 21, + 19, + 5, + 14, + 13, + 23, + 20, + 19, + 16, + 10, + 23, + 35, + 13, + 25, + 12, + 16, + 3, + 11, + 25, + 7, + 12, + 11, + 24, + 1, + 14, + 14, + 1, + 28, + 28, + 14, + 17, + 10, + 7, + 2, + 6, + 30, + 5, + 15, + 53, + 7, + 11 + ], + "weighted_loads": [ + 0.4816133361309767, + 1.1689339242875576, + 0.4406354743987322, + 0.5845498293638229, + 0.2570065427571535, + 0.7462975636590272, + 1.4429980162531137, + 0.7227214109152555, + 1.5127680245786905, + 0.4532274007797241, + 0.5917172192130238, + 0.5248725600540638, + 0.2550154593773186, + 0.09048772975802422, + 0.5466224122792482, + 0.39368921890854836, + 0.0, + 0.9521104227751493, + 0.3348356857895851, + 0.1744000818580389, + 0.9611611217260361, + 0.15688535571098328, + 2.0141209810972214, + 1.924228947609663, + 0.6902056362014264, + 0.16446991078555584, + 0.734980933368206, + 3.4849795382469893, + 1.1083778198808432, + 0.8309157099574804, + 0.6865799129009247, + 0.5874299556016922, + 0.361834516748786, + 1.819739155471325, + 1.2265384634956717, + 0.5171836651861668, + 1.175921268761158, + 1.2568421922624111, + 0.5442354492843151, + 0.11119834333658218, + 0.608992051333189, + 1.0047846548259258, + 0.23371450789272785, + 0.5435990951955318, + 0.3889704514294863, + 0.8627063203603029, + 0.044342294335365295, + 0.7625098562566563, + 0.45851648412644863, + 0.07796937972307205, + 1.0988692361861467, + 1.8709730878472328, + 0.4235063474625349, + 0.9137684591114521, + 0.8438011147081852, + 0.6513711959123611, + 0.06157358177006245, + 0.22652686014771461, + 1.2639137860387564, + 0.14038042910397053, + 0.5473828092217445, + 3.5773133388720453, + 0.3911445438861847, + 1.360200971364975 + ], + "unique_experts": 63, + "load_cv": 0.6408160152794062, + "normalized_load_entropy": 0.9507252267070799, + "max_load_share": 0.054865424430641824 + } + }, + "s0_period": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "905bd8ea354df48723d4da768eb1a53c3804a459d8911f2f9cb0e94077cb69d7", + "route_weight_sha256": "8f6bcf14fce09384ccbe33506d096ff9aa8c2a029bc20590c016e922a86fca96", + "loads": [ + 12, + 33, + 12, + 8, + 4, + 17, + 19, + 12, + 11, + 5, + 6, + 12, + 2, + 2, + 12, + 10, + 0, + 20, + 9, + 5, + 16, + 2, + 26, + 20, + 8, + 9, + 11, + 13, + 5, + 18, + 20, + 11, + 15, + 16, + 26, + 6, + 16, + 7, + 19, + 3, + 11, + 24, + 3, + 7, + 9, + 22, + 3, + 8, + 12, + 1, + 21, + 17, + 5, + 15, + 8, + 5, + 2, + 5, + 12, + 6, + 12, + 27, + 1, + 6 + ], + "weighted_loads": [ + 0.45994197577238083, + 1.2970117647200823, + 0.3830791860818863, + 0.36741041764616966, + 0.15052065812051296, + 0.5697248186916113, + 1.1561287436634302, + 0.5399485118687153, + 0.7311932351440191, + 0.3255477584898472, + 0.279079157859087, + 0.5346932224929333, + 0.07485421001911163, + 0.09516515955328941, + 0.4449734725058079, + 0.40837923996150494, + 0.0, + 0.8489259462803602, + 0.33647106401622295, + 0.13752254284918308, + 0.7925079315900803, + 0.07179660350084305, + 1.4304444342851639, + 1.9246223866939545, + 0.3409379832446575, + 0.28300943225622177, + 0.5078437747433782, + 4.17704714089632, + 0.18425412103533745, + 0.7132095284759998, + 0.7632961627095938, + 0.3933720625936985, + 0.5297198854386806, + 1.529067326337099, + 0.9027360025793314, + 0.23530806973576546, + 0.5498974360525608, + 0.2492340411990881, + 0.6477453485131264, + 0.1144310962408781, + 0.5672168489545584, + 0.8192336596548557, + 0.09882485494017601, + 0.23175319097936153, + 0.34826498478651047, + 0.7360763736069202, + 0.05772183649241924, + 0.2899602372199297, + 0.39486912451684475, + 0.08085436373949051, + 0.764040956273675, + 1.1669091004878283, + 0.16355548612773418, + 0.6071720402687788, + 0.7619365006685257, + 0.5844320021569729, + 0.06418492645025253, + 0.18240732327103615, + 0.5712922923266888, + 0.1665138490498066, + 0.44780782982707024, + 1.6504829749464989, + 0.040974635630846024, + 0.21836131438612938 + ], + "unique_experts": 63, + "load_cv": 0.6545189544454729, + "normalized_load_entropy": 0.9467486482449375, + "max_load_share": 0.04583333333333333 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "9d139e5fec37c6e9fa979c30481225ecdd23094c13970cfd4f4a1ac9bcc43467", + "route_weight_sha256": "23afba32389cf2547cb303baa3a61dc8a7e8a11dcb908dcc78fc20fef2eeb43d", + "loads": [ + 12, + 34, + 15, + 8, + 4, + 23, + 19, + 14, + 19, + 5, + 14, + 12, + 3, + 2, + 15, + 10, + 0, + 21, + 9, + 5, + 17, + 2, + 33, + 20, + 15, + 9, + 11, + 13, + 13, + 23, + 20, + 13, + 18, + 21, + 32, + 6, + 17, + 10, + 19, + 3, + 12, + 27, + 7, + 9, + 9, + 23, + 3, + 13, + 12, + 1, + 26, + 24, + 8, + 18, + 8, + 5, + 2, + 6, + 22, + 7, + 14, + 43, + 3, + 9 + ], + "weighted_loads": [ + 0.45994197577238083, + 1.3338097874075174, + 0.4897500332444906, + 0.36741041764616966, + 0.15052065812051296, + 0.751277080969885, + 1.1561287436634302, + 0.6381881013512611, + 1.1108077447861433, + 0.3255477584898472, + 0.6014919767621905, + 0.5346932224929333, + 0.07759870029985905, + 0.09516515955328941, + 0.5355718284845352, + 0.40837923996150494, + 0.0, + 0.8824143912643194, + 0.33647106401622295, + 0.13752254284918308, + 0.8254161141812801, + 0.07179660350084305, + 1.8974878787994385, + 1.9246223866939545, + 0.6001267607789487, + 0.28300943225622177, + 0.5078437747433782, + 4.17704714089632, + 0.4971334505826235, + 0.9120391346514225, + 0.7632961627095938, + 0.462077796459198, + 0.645363062620163, + 1.7492306157946587, + 1.1070388220250607, + 0.23530806973576546, + 0.6401091031730175, + 1.1879894230514765, + 0.6477453485131264, + 0.1144310962408781, + 0.6128489430993795, + 0.9781616926193237, + 0.26281936652958393, + 0.31424187310039997, + 0.34826498478651047, + 0.7844867520034313, + 0.05772183649241924, + 0.6583444437710568, + 0.39486912451684475, + 0.08085436373949051, + 0.9949260782450438, + 1.683298958465457, + 0.24833764508366585, + 0.7417182940989733, + 0.7619365006685257, + 0.5844320021569729, + 0.06418492645025253, + 0.224061731249094, + 0.9300460238009691, + 0.2015627846121788, + 0.5103782452642918, + 2.7907648817636073, + 0.07845200970768929, + 1.2704184129834175 + ], + "unique_experts": 63, + "load_cv": 0.6552288743568843, + "normalized_load_entropy": 0.9474515434147053, + "max_load_share": 0.04942528735632184 + } + }, + "s1_period": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "36ccb8b1c7f71d1a259c3ce2bc600e8a31496ccfee5d3bca2422ff8b41da1628", + "route_weight_sha256": "c3f9384611d6e4fc175904cc8ce5d3330ea14bbf3a7ca12a9657804ecbfd1b19", + "loads": [ + 11, + 26, + 16, + 9, + 7, + 16, + 22, + 15, + 11, + 5, + 5, + 10, + 4, + 2, + 13, + 10, + 0, + 23, + 9, + 8, + 16, + 3, + 25, + 20, + 9, + 4, + 14, + 14, + 5, + 13, + 19, + 13, + 15, + 17, + 27, + 9, + 18, + 6, + 15, + 3, + 10, + 22, + 3, + 6, + 8, + 20, + 1, + 9, + 16, + 1, + 19, + 14, + 5, + 14, + 9, + 5, + 2, + 7, + 9, + 7, + 9, + 29, + 1, + 7 + ], + "weighted_loads": [ + 0.4515420850366354, + 1.0820289514958858, + 0.5179003030061722, + 0.4511253722012043, + 0.22487467341125011, + 0.5397287979722023, + 1.492445271462202, + 0.6435697488486767, + 0.835973596200347, + 0.32609955593943596, + 0.24332342855632305, + 0.4964223951101303, + 0.13204639963805676, + 0.09194381162524223, + 0.48861274868249893, + 0.43243877589702606, + 0.0, + 0.9245893768966198, + 0.3046891503036022, + 0.22892367094755173, + 0.7269779741764069, + 0.10932964459061623, + 1.2675009686499834, + 1.9158948957920074, + 0.3456914070993662, + 0.13699503988027573, + 0.7805105354636908, + 3.6153111178427935, + 0.1679394692182541, + 0.541942922398448, + 0.7203015517443419, + 0.4669678043574095, + 0.5170092713087797, + 1.5311222933232784, + 0.9448936618864536, + 0.3210226409137249, + 0.6017730180174112, + 0.2039725724607706, + 0.5224080216139555, + 0.10759700275957584, + 0.5138154067099094, + 0.7424311898648739, + 0.11343224346637726, + 0.19045849330723286, + 0.29768216237425804, + 0.7189691718667746, + 0.03927547484636307, + 0.3029510769993067, + 0.4985024221241474, + 0.0766674354672432, + 0.6878168303519487, + 0.9321823976933956, + 0.16191744804382324, + 0.6352362353354692, + 0.7198704779148102, + 0.5685929711908102, + 0.06218560039997101, + 0.2588135302066803, + 0.42398395761847496, + 0.1911764908581972, + 0.34294065833091736, + 1.6695542875677347, + 0.043859366327524185, + 0.2487844955176115 + ], + "unique_experts": 63, + "load_cv": 0.6259807120445899, + "normalized_load_entropy": 0.9500427740673043, + "max_load_share": 0.04027777777777778 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "ac79c92a722a3f393ed362e4d94f4c9cd94dd12df1038d12aef6d1701c0822cb", + "route_weight_sha256": "f1a9c1b06b161560e78ad8a0c4ff72d29012ac754a1a0b258015491c1120fac5", + "loads": [ + 11, + 26, + 17, + 10, + 9, + 23, + 22, + 17, + 19, + 8, + 12, + 12, + 8, + 2, + 18, + 10, + 0, + 23, + 10, + 10, + 21, + 4, + 35, + 21, + 19, + 4, + 14, + 14, + 24, + 18, + 19, + 16, + 15, + 23, + 34, + 11, + 25, + 11, + 15, + 3, + 11, + 30, + 7, + 9, + 9, + 22, + 1, + 16, + 16, + 1, + 26, + 31, + 12, + 19, + 11, + 7, + 2, + 8, + 26, + 8, + 13, + 50, + 7, + 11 + ], + "weighted_loads": [ + 0.4515420850366354, + 1.0820289514958858, + 0.5424669627100229, + 0.563192542642355, + 0.2849891036748886, + 0.7577949885744601, + 1.492445271462202, + 0.724188506603241, + 1.4228932205587626, + 0.45689718797802925, + 0.5577719679567963, + 0.5632748603820801, + 0.22228142665699124, + 0.09194381162524223, + 0.6430143248289824, + 0.43243877589702606, + 0.0, + 0.9245893768966198, + 0.3361179083585739, + 0.2950805891305208, + 0.9422607161104679, + 0.14921438694000244, + 1.909953836351633, + 1.9406752660870552, + 0.7067359655629843, + 0.13699503988027573, + 0.7805105354636908, + 3.6153111178427935, + 1.1472272463142872, + 0.7654459998011589, + 0.7203015517443419, + 0.6063787247985601, + 0.5170092713087797, + 1.842164121568203, + 1.1918507842347026, + 0.41726281121373177, + 1.119475519284606, + 1.2335989605635405, + 0.5224080216139555, + 0.10759700275957584, + 0.625506479293108, + 1.2049951665103436, + 0.22880578599870205, + 0.4495262186974287, + 0.33665965870022774, + 0.8169727269560099, + 0.03927547484636307, + 0.8465213755844161, + 0.4985024221241474, + 0.0766674354672432, + 1.012562122195959, + 2.0018077846616507, + 0.3639194965362549, + 0.9653953593224287, + 0.8941698297858238, + 0.6612965743988752, + 0.06218560039997101, + 0.2954678274691105, + 1.1240623407065868, + 0.22200993448495865, + 0.4685470499098301, + 3.5592644824646413, + 0.39227405562996864, + 1.3522840905934572 + ], + "unique_experts": 63, + "load_cv": 0.6159307200103137, + "normalized_load_entropy": 0.9534620165296307, + "max_load_share": 0.051759834368530024 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 120, + "ordered_topk_exact_tokens": 31, + "set_exact_tokens": 46, + "mean_set_jaccard": 0.792857142857143, + "mean_token_weighted_tv": 0.03442675633123145, + "aggregate_load_tv": 0.06111111111111111 + }, + "system_bos": { + "tokens": 120, + "ordered_topk_exact_tokens": 34, + "set_exact_tokens": 51, + "mean_set_jaccard": 0.8033730158730158, + "mean_token_weighted_tv": 0.03450079062798371, + "aggregate_load_tv": 0.07083333333333333 + }, + "system_x": { + "tokens": 120, + "ordered_topk_exact_tokens": 18, + "set_exact_tokens": 36, + "mean_set_jaccard": 0.7465079365079366, + "mean_token_weighted_tv": 0.04886851391832655, + "aggregate_load_tv": 0.07222222222222223 + }, + "system_period": { + "tokens": 120, + "ordered_topk_exact_tokens": 18, + "set_exact_tokens": 33, + "mean_set_jaccard": 0.7280555555555556, + "mean_token_weighted_tv": 0.051192756148520854, + "aggregate_load_tv": 0.06944444444444445 + }, + "bos_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 25, + "set_exact_tokens": 35, + "mean_set_jaccard": 0.7460317460317462, + "mean_token_weighted_tv": 0.042686873864537726, + "aggregate_load_tv": 0.07222222222222222 + }, + "bos_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 20, + "set_exact_tokens": 30, + "mean_set_jaccard": 0.7323412698412698, + "mean_token_weighted_tv": 0.044777853732618195, + "aggregate_load_tv": 0.06527777777777778 + }, + "x_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 23, + "set_exact_tokens": 35, + "mean_set_jaccard": 0.7274603174603176, + "mean_token_weighted_tv": 0.047331122068377834, + "aggregate_load_tv": 0.08611111111111111 + }, + "x_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 30, + "mean_set_jaccard": 0.711984126984127, + "mean_token_weighted_tv": 0.052342422803243, + "aggregate_load_tv": 0.08194444444444443 + }, + "period_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 26, + "set_exact_tokens": 36, + "mean_set_jaccard": 0.7281746031746031, + "mean_token_weighted_tv": 0.047463208832778034, + "aggregate_load_tv": 0.08472222222222223 + }, + "period_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 27, + "mean_set_jaccard": 0.6945238095238097, + "mean_token_weighted_tv": 0.05404848541753988, + "aggregate_load_tv": 0.07777777777777779 + } + } + }, + "layer_25": { + "layer": 25, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "1dcc51a938aadeeef19df65d1181b9ecdefc4a35fb0a92716d483adc2919f53b", + "route_weight_sha256": "9cbd9ba0f8038d7e1e68eec68de0748c026dadd19befc72dda3496769cf8477b", + "loads": [ + 20, + 28, + 10, + 13, + 14, + 9, + 6, + 9, + 18, + 8, + 31, + 2, + 11, + 7, + 0, + 1, + 7, + 9, + 7, + 20, + 6, + 6, + 10, + 6, + 13, + 16, + 23, + 1, + 18, + 4, + 16, + 3, + 18, + 19, + 20, + 4, + 10, + 32, + 12, + 23, + 18, + 8, + 6, + 6, + 18, + 29, + 7, + 2, + 7, + 11, + 19, + 5, + 5, + 5, + 14, + 6, + 0, + 23, + 0, + 9, + 7, + 3, + 17, + 5 + ], + "weighted_loads": [ + 0.9242538176476955, + 1.9571663215756416, + 0.3907656781375408, + 0.41090162470936775, + 0.47374056465923786, + 0.5463616251945496, + 0.2662404254078865, + 0.3115143198519945, + 0.6180561613291502, + 0.5623894110321999, + 2.304789809510112, + 0.09257010370492935, + 0.5791903622448444, + 0.2111568432301283, + 0.0, + 0.02758263610303402, + 0.5596645548939705, + 0.7353829443454742, + 0.5194906108081341, + 2.158819891512394, + 0.42596929147839546, + 0.22187263146042824, + 0.3861287534236908, + 0.44354716688394547, + 0.6682286895811558, + 1.852991808205843, + 0.8930769544094801, + 0.04151112586259842, + 1.4128478653728962, + 0.1262292116880417, + 1.2068306244909763, + 0.26948362588882446, + 0.7109490390866995, + 0.8007779773324728, + 0.6117878016084433, + 0.1928584761917591, + 0.598961777985096, + 1.4958775527775288, + 0.6947119552642107, + 1.7504380196332932, + 1.7991070412099361, + 0.3990899473428726, + 0.26489123702049255, + 0.23449768498539925, + 1.1373657435178757, + 1.6673603896051645, + 0.20911546982824802, + 0.07296162098646164, + 0.30471687763929367, + 0.3881857041269541, + 1.1476348154246807, + 0.2757948897778988, + 0.22411461919546127, + 0.18709420040249825, + 0.9062480013817549, + 0.2499875593930483, + 0.0, + 0.9222624357789755, + 0.0, + 0.7012204378843307, + 0.2635535057634115, + 0.0966005027294159, + 1.5418584160506725, + 0.16543146595358849 + ], + "unique_experts": 61, + "load_cv": 0.7039570693980959, + "normalized_load_entropy": 0.9382589594422877, + "max_load_share": 0.044444444444444446 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "9db27d5eab5c387d56e9b8d680214673f88670cbfcce80a922d317b9ef2d0f15", + "route_weight_sha256": "552ae3604bcd90ca5aae1a46e5f7de64d68e3e172579ab8eaaf1cadb5147bb80", + "loads": [ + 22, + 47, + 17, + 14, + 14, + 9, + 12, + 9, + 18, + 8, + 41, + 6, + 12, + 7, + 0, + 1, + 7, + 13, + 8, + 20, + 6, + 6, + 10, + 8, + 13, + 16, + 23, + 1, + 19, + 6, + 16, + 4, + 20, + 20, + 22, + 4, + 10, + 34, + 23, + 26, + 27, + 8, + 6, + 8, + 23, + 39, + 10, + 2, + 7, + 12, + 29, + 5, + 10, + 5, + 22, + 6, + 1, + 28, + 0, + 9, + 10, + 3, + 23, + 5 + ], + "weighted_loads": [ + 1.0235488414764404, + 3.441777723142877, + 0.924678098410368, + 0.47467179223895073, + 0.47374056465923786, + 0.5463616251945496, + 0.6742630079388618, + 0.3115143198519945, + 0.6180561613291502, + 0.5623894110321999, + 3.1953399162739515, + 0.7523441831581295, + 0.6441834755241871, + 0.2111568432301283, + 0.0, + 0.02758263610303402, + 0.5596645548939705, + 0.8637566026300192, + 0.546121908351779, + 2.158819891512394, + 0.42596929147839546, + 0.22187263146042824, + 0.3861287534236908, + 0.5356200709939003, + 0.6682286895811558, + 1.852991808205843, + 0.8930769544094801, + 0.04151112586259842, + 1.4552195817232132, + 0.19545742124319077, + 1.2068306244909763, + 0.35593704879283905, + 0.8379356395453215, + 0.8618154469877481, + 0.6985912527889013, + 0.1928584761917591, + 0.598961777985096, + 1.5789661183953285, + 2.1628469601273537, + 2.100800607353449, + 2.3210012447088957, + 0.3990899473428726, + 0.26489123702049255, + 0.3053704760968685, + 1.4826507847756147, + 2.4786267075687647, + 0.30082152131944895, + 0.07296162098646164, + 0.30471687763929367, + 0.4255922455340624, + 1.747794222086668, + 0.2757948897778988, + 0.4926629983820021, + 0.18709420040249825, + 1.2838346741627902, + 0.2499875593930483, + 0.04727427288889885, + 1.1604221761226654, + 0.0, + 0.7012204378843307, + 0.41448341496288776, + 0.0966005027294159, + 1.9891062285751104, + 0.16543146595358849 + ], + "unique_experts": 62, + "load_cv": 0.7546640112332818, + "normalized_load_entropy": 0.9335839931994793, + "max_load_share": 0.054022988505747126 + } + }, + "s1_eos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "130c9c4c55c6207b0a8cb1e81f7aac252d8a3aa6b748a107b45cb3851dc518b4", + "route_weight_sha256": "9225645d5372d69e57b8850e7c58054122a28288a7202559d84d33c053232a2f", + "loads": [ + 19, + 26, + 9, + 10, + 17, + 9, + 7, + 10, + 20, + 7, + 29, + 4, + 11, + 6, + 0, + 3, + 6, + 9, + 6, + 20, + 5, + 8, + 10, + 7, + 10, + 16, + 28, + 1, + 18, + 8, + 13, + 3, + 14, + 21, + 19, + 3, + 9, + 36, + 12, + 23, + 19, + 11, + 6, + 5, + 18, + 28, + 5, + 2, + 10, + 9, + 16, + 5, + 6, + 2, + 16, + 5, + 0, + 21, + 0, + 10, + 6, + 3, + 17, + 8 + ], + "weighted_loads": [ + 0.8925359398126602, + 1.844380259513855, + 0.36781787872314453, + 0.31187680549919605, + 0.5800855997949839, + 0.5581015311181545, + 0.34562045708298683, + 0.33832743018865585, + 0.6782860103994608, + 0.5221527479588985, + 2.211798071861267, + 0.15295742452144623, + 0.603804524987936, + 0.191654859110713, + 0.0, + 0.09203281812369823, + 0.4934663735330105, + 0.7298932746052742, + 0.4667951110750437, + 2.1131557784974575, + 0.3917462769895792, + 0.29281764663755894, + 0.3653539605438709, + 0.4870412554591894, + 0.5568569824099541, + 1.8608113639056683, + 1.0492273159325123, + 0.04024617001414299, + 1.3719473630189896, + 0.2409170549362898, + 1.2231689542531967, + 0.2658238001167774, + 0.5520873200148344, + 0.8499556444585323, + 0.6084929779171944, + 0.16184266284108162, + 0.5563055668026209, + 1.6280425172299147, + 0.7112989220768213, + 1.6568769719451666, + 1.7786847334355116, + 0.4913515243679285, + 0.2578398920595646, + 0.18721053004264832, + 1.145395565778017, + 1.5237006321549416, + 0.15211695805191994, + 0.06959997117519379, + 0.427438884973526, + 0.314469113945961, + 1.0011026877909899, + 0.28070175275206566, + 0.2656576447188854, + 0.08428734540939331, + 1.03721759095788, + 0.22890942357480526, + 0.0, + 0.9182989001274109, + 0.0, + 0.7111289482563734, + 0.24084319546818733, + 0.1019856221973896, + 1.609424315392971, + 0.2610887996852398 + ], + "unique_experts": 61, + "load_cv": 0.7085021585302159, + "normalized_load_entropy": 0.9387763864088302, + "max_load_share": 0.05 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "4875beca92f7b3c737988070a5ca369a4d47ac34b6e341de04edbeb780444cb5", + "route_weight_sha256": "dbe4d3e22a5e44c8491d3258f13d626d9d9d5d09ca5d6fb102915498463f3afc", + "loads": [ + 22, + 51, + 20, + 11, + 17, + 10, + 14, + 10, + 22, + 8, + 50, + 8, + 17, + 6, + 0, + 3, + 6, + 17, + 7, + 21, + 8, + 15, + 10, + 12, + 10, + 16, + 29, + 1, + 19, + 11, + 13, + 6, + 20, + 22, + 22, + 3, + 10, + 43, + 22, + 28, + 28, + 11, + 7, + 6, + 27, + 42, + 7, + 2, + 10, + 10, + 27, + 5, + 13, + 9, + 28, + 6, + 3, + 28, + 0, + 11, + 11, + 4, + 22, + 9 + ], + "weighted_loads": [ + 1.153544269502163, + 3.895058254012838, + 1.0043141674250364, + 0.38459126092493534, + 0.5800855997949839, + 0.5967814363539219, + 0.9365063831210136, + 0.33832743018865585, + 0.7921317722648382, + 0.5503794085234404, + 4.069988835602999, + 0.8773638559505343, + 0.9158813506364822, + 0.191654859110713, + 0.0, + 0.09203281812369823, + 0.4934663735330105, + 1.3784647956490517, + 0.5187079515308142, + 2.1368563026189804, + 0.6499799434095621, + 0.9312962852418423, + 0.3653539605438709, + 0.6793551575392485, + 0.5568569824099541, + 1.8608113639056683, + 1.08305025100708, + 0.04024617001414299, + 1.4174211733043194, + 0.3453335426747799, + 1.2231689542531967, + 0.7398728169500828, + 0.8512485716491938, + 0.8958786465227604, + 0.7564776875078678, + 0.16184266284108162, + 0.6008967068046331, + 1.9634409192949533, + 2.4006326626986265, + 2.113388678058982, + 2.314992355182767, + 0.4913515243679285, + 0.34464510157704353, + 0.21745236031711102, + 1.7803943678736687, + 2.7833920884877443, + 0.19461364997550845, + 0.06959997117519379, + 0.427438884973526, + 0.3595176376402378, + 1.6879575420171022, + 0.28070175275206566, + 0.7066169902682304, + 0.590185958892107, + 1.8152181792538613, + 0.2555602826178074, + 0.12963619083166122, + 1.2406094670295715, + 0.0, + 0.8006758447736502, + 0.5552641972899437, + 0.14462560787796974, + 2.0395953617990017, + 0.2867756150662899 + ], + "unique_experts": 62, + "load_cv": 0.7480712611312604, + "normalized_load_entropy": 0.936692175292594, + "max_load_share": 0.052795031055900624 + } + }, + "s0_bos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "9e6f2044a7492e9379123600d5a0554e1083cbb89cfed5709545a95e208c7b73", + "route_weight_sha256": "6b944de8dc8797eb2b3b3486f30fa0063db4c3bd8ffa8dcfa33b01de13dac55d", + "loads": [ + 20, + 30, + 16, + 14, + 20, + 9, + 7, + 10, + 20, + 8, + 29, + 3, + 11, + 6, + 0, + 6, + 6, + 8, + 7, + 19, + 7, + 4, + 12, + 7, + 13, + 16, + 24, + 1, + 18, + 5, + 14, + 3, + 15, + 17, + 16, + 4, + 9, + 32, + 11, + 21, + 18, + 11, + 4, + 2, + 16, + 28, + 7, + 2, + 6, + 11, + 20, + 5, + 6, + 3, + 15, + 5, + 1, + 19, + 0, + 12, + 6, + 3, + 16, + 6 + ], + "weighted_loads": [ + 0.9946123994886875, + 1.8942882101982832, + 0.6620324552059174, + 0.42330966144800186, + 0.6520587988197803, + 0.581153716892004, + 0.32687773182988167, + 0.3358093984425068, + 0.6669159941375256, + 0.5530808046460152, + 2.283939551562071, + 0.12261340394616127, + 0.650228925049305, + 0.18178137578070164, + 0.0, + 0.1653867419809103, + 0.5008750855922699, + 0.7458397075533867, + 0.5264721848070621, + 2.171091165393591, + 0.4587718043476343, + 0.17502666637301445, + 0.44377589225769043, + 0.49874212220311165, + 0.6700728591531515, + 1.8824870325624943, + 0.910020750015974, + 0.04536791518330574, + 1.427645580843091, + 0.16949498280882835, + 1.2699034437537193, + 0.27310583740472794, + 0.6112947091460228, + 0.6941134668886662, + 0.5217229146510363, + 0.19733630865812302, + 0.6293080747127533, + 1.476835709065199, + 0.6794943585991859, + 1.6741566359996796, + 1.8796894401311874, + 0.5012805741280317, + 0.1971127726137638, + 0.07613186165690422, + 1.0457386001944542, + 1.5907174572348595, + 0.2021563369780779, + 0.08262554183602333, + 0.26244427263736725, + 0.3964519500732422, + 1.2204249240458012, + 0.28633932396769524, + 0.23503564670681953, + 0.1166766881942749, + 0.9966260381042957, + 0.24272718280553818, + 0.03702462464570999, + 0.7587658856064081, + 0.0, + 0.7902722805738449, + 0.23820776864886284, + 0.1004772037267685, + 1.55260743573308, + 0.19137108325958252 + ], + "unique_experts": 62, + "load_cv": 0.6888888888888889, + "normalized_load_entropy": 0.9410319408550825, + "max_load_share": 0.044444444444444446 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "97dd5606c57b548831710bdccf4640c94a2bf129c8192bd1b3f56e80d80ed3e7", + "route_weight_sha256": "b88313b831dd7a7dbd80fd3767462fd9a97efe122922d4be4dd2ac96bbc3a70a", + "loads": [ + 21, + 48, + 24, + 15, + 20, + 9, + 13, + 11, + 20, + 8, + 39, + 6, + 14, + 6, + 0, + 6, + 6, + 12, + 8, + 19, + 7, + 4, + 12, + 9, + 13, + 16, + 24, + 1, + 19, + 8, + 15, + 4, + 17, + 18, + 18, + 4, + 10, + 33, + 21, + 23, + 27, + 12, + 4, + 4, + 21, + 36, + 9, + 2, + 6, + 13, + 30, + 5, + 10, + 3, + 24, + 5, + 2, + 25, + 0, + 12, + 8, + 3, + 22, + 6 + ], + "weighted_loads": [ + 1.042384434491396, + 3.300201457226649, + 1.2236360311508179, + 0.5572830066084862, + 0.6520587988197803, + 0.581153716892004, + 0.734900314360857, + 0.3765684552490711, + 0.6669159941375256, + 0.5530808046460152, + 3.235802672803402, + 0.7763213217258453, + 0.8135770075023174, + 0.18178137578070164, + 0.0, + 0.1653867419809103, + 0.5008750855922699, + 0.8742133658379316, + 0.553103482350707, + 2.171091165393591, + 0.4587718043476343, + 0.17502666637301445, + 0.44377589225769043, + 0.5908150263130665, + 0.6700728591531515, + 1.8824870325624943, + 0.910020750015974, + 0.04536791518330574, + 1.470017297193408, + 0.2687460742890835, + 1.550881765782833, + 0.3595592603087425, + 0.728129506111145, + 0.7551509365439415, + 0.6337105389684439, + 0.19733630865812302, + 0.6898286454379559, + 1.5298492424190044, + 1.2375239562243223, + 2.09850150346756, + 2.392136024311185, + 0.5577494669705629, + 0.1971127726137638, + 0.14224373549222946, + 1.3883622493594885, + 2.304240070283413, + 0.2925449628382921, + 0.08262554183602333, + 0.26244427263736725, + 0.47745581343770027, + 1.8205843307077885, + 0.28633932396769524, + 0.4993976652622223, + 0.1166766881942749, + 1.4247319351416081, + 0.24272718280553818, + 0.08641505986452103, + 1.0135502330958843, + 0.0, + 0.7902722805738449, + 0.35064174234867096, + 0.1004772037267685, + 1.9998552482575178, + 0.19137108325958252 + ], + "unique_experts": 62, + "load_cv": 0.7349098465079816, + "normalized_load_entropy": 0.9363318466030794, + "max_load_share": 0.05517241379310345 + } + }, + "s1_bos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "4922e0198e9f70f4e9b9c91b46f359d2b32e1716887c063eadb952493b02400f", + "route_weight_sha256": "0d05f486ceb4d9c702c9906409e72ab0309a09a19de8d2f4da3c98478fd69153", + "loads": [ + 21, + 26, + 13, + 14, + 16, + 10, + 7, + 12, + 18, + 8, + 28, + 2, + 11, + 8, + 0, + 4, + 6, + 8, + 7, + 20, + 6, + 5, + 11, + 7, + 12, + 16, + 25, + 1, + 18, + 5, + 14, + 2, + 13, + 18, + 20, + 4, + 10, + 37, + 12, + 22, + 19, + 11, + 4, + 4, + 15, + 25, + 8, + 2, + 7, + 9, + 19, + 5, + 8, + 3, + 15, + 5, + 0, + 20, + 0, + 9, + 5, + 4, + 16, + 10 + ], + "weighted_loads": [ + 0.9905453715473413, + 1.7808088194578886, + 0.6161128766834736, + 0.45633711479604244, + 0.5509641077369452, + 0.6147033851593733, + 0.32202356308698654, + 0.41228604689240456, + 0.6137393843382597, + 0.5350871365517378, + 2.1531444266438484, + 0.08749634772539139, + 0.6269327141344547, + 0.2672993838787079, + 0.0, + 0.12026121839880943, + 0.5058191865682602, + 0.7229217290878296, + 0.5518224202096462, + 2.197461862117052, + 0.4367822539061308, + 0.2230502888560295, + 0.39997575618326664, + 0.4630160927772522, + 0.6543517336249352, + 1.8673014491796494, + 0.963811133056879, + 0.04174595698714256, + 1.3709486592561007, + 0.17072818800807, + 1.5220938883721828, + 0.23824532330036163, + 0.5188914202153683, + 0.7098531015217304, + 0.6599534898996353, + 0.19150158762931824, + 0.6397062465548515, + 1.6066944673657417, + 0.7518409620970488, + 1.5993332955986261, + 1.7794903442263603, + 0.5063756369054317, + 0.2002347782254219, + 0.15525871142745018, + 0.9724960550665855, + 1.4403468389064074, + 0.2379705999046564, + 0.08041283115744591, + 0.3209526091814041, + 0.3297080919146538, + 1.1468094810843468, + 0.27683257311582565, + 0.3555131424218416, + 0.12148107960820198, + 1.029770027846098, + 0.24050240963697433, + 0.0, + 0.7964333333075047, + 0.0, + 0.7068811357021332, + 0.21259001269936562, + 0.14368966594338417, + 1.5841368064284325, + 0.3148339707404375 + ], + "unique_experts": 61, + "load_cv": 0.6865551869233515, + "normalized_load_entropy": 0.9411403193770821, + "max_load_share": 0.05138888888888889 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "8d951ca1507a60b92599b5a64f23de42a7ca7152e635cf8c058cb04b6479465e", + "route_weight_sha256": "3ca891d5b5f29d0b69c52bbb3773f55ee7c1d66ed685ddfdaf1468946553c72c", + "loads": [ + 23, + 51, + 25, + 15, + 16, + 11, + 14, + 12, + 21, + 9, + 50, + 5, + 18, + 8, + 0, + 4, + 6, + 16, + 8, + 21, + 9, + 12, + 11, + 12, + 12, + 16, + 26, + 1, + 19, + 7, + 14, + 5, + 20, + 19, + 23, + 4, + 11, + 44, + 21, + 26, + 28, + 11, + 5, + 6, + 24, + 39, + 9, + 2, + 7, + 11, + 30, + 5, + 14, + 10, + 27, + 6, + 3, + 27, + 0, + 10, + 9, + 5, + 21, + 12 + ], + "weighted_loads": [ + 1.18904915638268, + 3.7705243232194334, + 1.339128052815795, + 0.5061167385429144, + 0.5509641077369452, + 0.6533832903951406, + 0.9129094891250134, + 0.41228604689240456, + 0.7749952170997858, + 0.5633137971162796, + 4.116604272276163, + 0.7954136729240417, + 0.9934188835322857, + 0.2672993838787079, + 0.0, + 0.12026121839880943, + 0.5058191865682602, + 1.371493250131607, + 0.6037352606654167, + 2.221162386238575, + 0.6950159203261137, + 0.8615289274603128, + 0.39997575618326664, + 0.6553299948573112, + 0.6543517336249352, + 1.8673014491796494, + 0.9976340681314468, + 0.04174595698714256, + 1.4164224695414305, + 0.23790896125137806, + 1.5220938883721828, + 0.712294340133667, + 0.8702464550733566, + 0.7557761035859585, + 0.8169865347445011, + 0.19150158762931824, + 0.6842973865568638, + 1.9465252794325352, + 1.5402516294270754, + 2.0429539922624826, + 2.279986221343279, + 0.5063756369054317, + 0.28703998774290085, + 0.22140162251889706, + 1.6134135723114014, + 2.6602756325155497, + 0.2791340369731188, + 0.08041283115744591, + 0.3209526091814041, + 0.42057906463742256, + 1.8336643353104591, + 0.27683257311582565, + 0.7922969814389944, + 0.6273796930909157, + 1.8077706161420792, + 0.26715326867997646, + 0.15621837228536606, + 1.1303829234093428, + 0.0, + 0.7964280322194099, + 0.45851849764585495, + 0.1863296516239643, + 2.014307852834463, + 0.37429442442953587 + ], + "unique_experts": 62, + "load_cv": 0.7349371573126425, + "normalized_load_entropy": 0.9387069320154282, + "max_load_share": 0.052795031055900624 + } + }, + "s0_x": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "19fde3944d1a681b338fa02b14116a770a5ec56244542d844de60248278b8ef3", + "route_weight_sha256": "6f94d6e418b2356545029a33e1a94156bce7388725613d75c97106ba0ff4621c", + "loads": [ + 20, + 31, + 11, + 12, + 19, + 10, + 6, + 10, + 22, + 7, + 29, + 1, + 11, + 6, + 0, + 1, + 7, + 11, + 6, + 19, + 6, + 7, + 9, + 6, + 13, + 16, + 23, + 1, + 18, + 6, + 16, + 3, + 15, + 16, + 18, + 3, + 8, + 31, + 11, + 23, + 19, + 10, + 5, + 2, + 17, + 27, + 9, + 2, + 8, + 12, + 20, + 5, + 7, + 4, + 17, + 5, + 0, + 20, + 0, + 10, + 8, + 3, + 17, + 5 + ], + "weighted_loads": [ + 0.9736211150884628, + 1.9591039456427097, + 0.43590374663472176, + 0.3541375454515219, + 0.6481959335505962, + 0.5465931221842766, + 0.28849395364522934, + 0.34603751078248024, + 0.7470774799585342, + 0.49441252648830414, + 2.224917287006974, + 0.0500713549554348, + 0.6936248019337654, + 0.18327124416828156, + 0.0, + 0.037791669368743896, + 0.5469783805310726, + 0.8333680629730225, + 0.5341423060745001, + 2.2118423134088516, + 0.4430745095014572, + 0.25264893285930157, + 0.3446716256439686, + 0.44436854496598244, + 0.700890738517046, + 1.9274758510291576, + 0.8935630433261395, + 0.04362690821290016, + 1.4915240462869406, + 0.192397840321064, + 1.324612494558096, + 0.2637558728456497, + 0.5938489213585854, + 0.6640295125544071, + 0.5742923263460398, + 0.15651221200823784, + 0.6159368753433228, + 1.4529064800590277, + 0.6829886808991432, + 1.748663704842329, + 1.9325788095593452, + 0.5330278240144253, + 0.23109015822410583, + 0.07617339864373207, + 1.1325190290808678, + 1.496599953621626, + 0.26093030348420143, + 0.07933349907398224, + 0.3660319708287716, + 0.4274014327675104, + 1.1777067705988884, + 0.28026364371180534, + 0.28915987722575665, + 0.1560077704489231, + 1.0103101711720228, + 0.24595990777015686, + 0.0, + 0.8044657669961452, + 0.0, + 0.7344738133251667, + 0.3104030601680279, + 0.10159028321504593, + 1.5461234264075756, + 0.15617277100682259 + ], + "unique_experts": 61, + "load_cv": 0.7014975163406487, + "normalized_load_entropy": 0.9370896040777378, + "max_load_share": 0.043055555555555555 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "ed8dd9c2009f0fd8b79f0509f0cf4930674acea5c71924ac9913dfcbc2e69245", + "route_weight_sha256": "703f072ec44364ead139409ec3f9b1d9a9c1b611bcbaf013122610b686ec89d3", + "loads": [ + 22, + 51, + 17, + 13, + 19, + 10, + 14, + 10, + 22, + 7, + 39, + 4, + 13, + 6, + 0, + 1, + 7, + 15, + 8, + 19, + 6, + 7, + 9, + 8, + 13, + 16, + 23, + 1, + 19, + 9, + 16, + 5, + 17, + 17, + 19, + 3, + 9, + 32, + 22, + 25, + 29, + 10, + 5, + 3, + 22, + 35, + 11, + 2, + 9, + 12, + 30, + 5, + 12, + 4, + 26, + 5, + 0, + 25, + 0, + 10, + 10, + 3, + 24, + 5 + ], + "weighted_loads": [ + 1.0583518221974373, + 3.5282952098641545, + 0.8332776091992855, + 0.3884302992373705, + 0.6481959335505962, + 0.5465931221842766, + 0.821125689893961, + 0.34603751078248024, + 0.7470774799585342, + 0.49441252648830414, + 3.152645507827401, + 0.7097998633980751, + 0.8081619217991829, + 0.18327124416828156, + 0.0, + 0.037791669368743896, + 0.5469783805310726, + 0.9617417212575674, + 0.5881567522883415, + 2.2118423134088516, + 0.4430745095014572, + 0.25264893285930157, + 0.3446716256439686, + 0.5364414490759373, + 0.700890738517046, + 1.9274758510291576, + 0.8935630433261395, + 0.04362690821290016, + 1.5338957626372576, + 0.30475350841879845, + 1.324612494558096, + 0.4430526793003082, + 0.7142782732844353, + 0.7250669822096825, + 0.6234348099678755, + 0.15651221200823784, + 0.6779308095574379, + 1.5195309799164534, + 1.354707470163703, + 2.1594348661601543, + 2.4943798687309027, + 0.5330278240144253, + 0.23109015822410583, + 0.10870455577969551, + 1.4838155936449766, + 2.2356065176427364, + 0.35131892934441566, + 0.07933349907398224, + 0.40512100234627724, + 0.4274014327675104, + 1.7778661772608757, + 0.28026364371180534, + 0.666656019166112, + 0.1560077704489231, + 1.4579364589881152, + 0.24595990777015686, + 0.0, + 1.0112349763512611, + 0.0, + 0.7344738133251667, + 0.42638710141181946, + 0.10159028321504593, + 2.0328981820493937, + 0.15617277100682259 + ], + "unique_experts": 61, + "load_cv": 0.7567898492589206, + "normalized_load_entropy": 0.9316792316842963, + "max_load_share": 0.05862068965517241 + } + }, + "s1_x": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "323438440a6a6e617c572110ce0cea62d672225cdcada89a5769736c74e0f4dd", + "route_weight_sha256": "db2ec4c1f832f94befef7ffcc0211726ed6bd4aeea8b4df05dcebde41d123b40", + "loads": [ + 20, + 29, + 12, + 11, + 18, + 8, + 5, + 18, + 16, + 7, + 30, + 1, + 11, + 6, + 0, + 3, + 6, + 9, + 7, + 19, + 6, + 7, + 14, + 6, + 11, + 16, + 27, + 1, + 17, + 5, + 14, + 4, + 14, + 21, + 16, + 3, + 9, + 37, + 13, + 23, + 18, + 13, + 3, + 0, + 16, + 26, + 7, + 2, + 10, + 11, + 18, + 5, + 6, + 3, + 15, + 4, + 0, + 20, + 0, + 9, + 6, + 4, + 16, + 8 + ], + "weighted_loads": [ + 0.9289223570376635, + 1.9445183165371418, + 0.441071605309844, + 0.37673266790807247, + 0.6289340201765299, + 0.4676639176905155, + 0.259912583976984, + 0.6248585637658834, + 0.5691405292600393, + 0.5237806774675846, + 2.210751971229911, + 0.03902644291520119, + 0.6419913284480572, + 0.19798084907233715, + 0.0, + 0.08856347389519215, + 0.4911128878593445, + 0.7254570312798023, + 0.5162578150629997, + 2.1309651732444763, + 0.4314040932804346, + 0.276850663125515, + 0.5362604558467865, + 0.38013886101543903, + 0.5977317579090595, + 1.9005409255623817, + 1.0149977505207062, + 0.03941040858626366, + 1.3176433984190226, + 0.17843759804964066, + 1.5619243457913399, + 0.30505042523145676, + 0.5441340170800686, + 0.8424741756170988, + 0.5461710710078478, + 0.15110836178064346, + 0.5507284328341484, + 1.6389935705810785, + 0.7487127743661404, + 1.643258798867464, + 1.7674397006630898, + 0.6329725831747055, + 0.1634116806089878, + 0.0, + 1.0963652282953262, + 1.4101150464266539, + 0.21211343631148338, + 0.07697529718279839, + 0.4652963764965534, + 0.41922253742814064, + 1.0579345412552357, + 0.2678308039903641, + 0.308994410559535, + 0.1230081170797348, + 0.8278571330010891, + 0.21324973925948143, + 0.0, + 0.8340066038072109, + 0.0, + 0.6784692667424679, + 0.2465907782316208, + 0.14137974753975868, + 1.5565154068171978, + 0.2727379184216261 + ], + "unique_experts": 60, + "load_cv": 0.7233324799448798, + "normalized_load_entropy": 0.9339894750518756, + "max_load_share": 0.05138888888888889 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "cc06d5738bae492020a0109c5ad4b1acb7f45e9f9819d7a92e0f00a1037aece6", + "route_weight_sha256": "8d63cd2d97eb84ae04dbeff19aba0c4e887aa75a24f8b9effabe20de3b89aab6", + "loads": [ + 23, + 55, + 22, + 11, + 18, + 9, + 14, + 18, + 18, + 8, + 52, + 4, + 16, + 6, + 0, + 3, + 6, + 18, + 8, + 20, + 9, + 14, + 14, + 11, + 11, + 16, + 28, + 1, + 18, + 8, + 14, + 8, + 20, + 22, + 18, + 3, + 10, + 43, + 23, + 27, + 27, + 13, + 4, + 1, + 26, + 40, + 8, + 2, + 10, + 11, + 31, + 5, + 15, + 10, + 28, + 5, + 1, + 27, + 0, + 10, + 10, + 5, + 21, + 9 + ], + "weighted_loads": [ + 1.1646087672561407, + 4.042388105997816, + 0.9653600361198187, + 0.37673266790807247, + 0.6289340201765299, + 0.5063438229262829, + 1.0443539917469025, + 0.6248585637658834, + 0.6829862911254168, + 0.5520073380321264, + 4.147035358473659, + 0.7622235678136349, + 0.9159899465739727, + 0.19798084907233715, + 0.0, + 0.08856347389519215, + 0.4911128878593445, + 1.422298140823841, + 0.5681706555187702, + 2.154665697365999, + 0.6896377597004175, + 0.9153293017297983, + 0.5362604558467865, + 0.5724527630954981, + 0.5977317579090595, + 1.9005409255623817, + 1.048820685595274, + 0.03941040858626366, + 1.3631172087043524, + 0.2912744674831629, + 1.5619243457913399, + 0.8797642141580582, + 0.8325992077589035, + 0.8883971776813269, + 0.6515349876135588, + 0.15110836178064346, + 0.5953195728361607, + 1.9146459382027388, + 1.5995984822511673, + 2.096456680446863, + 2.3044252768158913, + 0.6329725831747055, + 0.25021689012646675, + 0.0302418302744627, + 1.7791568227112293, + 2.642243580892682, + 0.25327687337994576, + 0.07697529718279839, + 0.4652963764965534, + 0.41922253742814064, + 1.885483916848898, + 0.2678308039903641, + 0.9361990801990032, + 0.6289067305624485, + 1.685189752606675, + 0.23990059830248356, + 0.03093954175710678, + 1.1414723806083202, + 0.0, + 0.7680161632597446, + 0.48609087243676186, + 0.18401973322033882, + 1.9866864532232285, + 0.2984247338026762 + ], + "unique_experts": 62, + "load_cv": 0.7698495445648812, + "normalized_load_entropy": 0.9322016806665354, + "max_load_share": 0.056935817805383024 + } + }, + "s0_period": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "07fd0055ec42811f827f7abc1109479e80741243455ff43f88a8573650e4cf80", + "route_weight_sha256": "ab7682c1669b478d176c5b3b565d08a8cbcc53c792e9294d30cf2f438213c505", + "loads": [ + 21, + 30, + 11, + 15, + 17, + 10, + 7, + 14, + 22, + 8, + 30, + 2, + 11, + 4, + 0, + 2, + 6, + 8, + 7, + 19, + 6, + 7, + 11, + 6, + 14, + 16, + 21, + 1, + 18, + 5, + 15, + 3, + 14, + 16, + 15, + 4, + 8, + 32, + 10, + 23, + 19, + 9, + 5, + 1, + 18, + 31, + 11, + 2, + 6, + 9, + 20, + 5, + 6, + 4, + 17, + 5, + 0, + 20, + 0, + 10, + 8, + 3, + 16, + 6 + ], + "weighted_loads": [ + 0.9684174992144108, + 1.9237442035228014, + 0.4257518108934164, + 0.45083998143672943, + 0.5829865261912346, + 0.576220216229558, + 0.32983028143644333, + 0.4773276671767235, + 0.7558665387332439, + 0.5527289174497128, + 2.250145923346281, + 0.08185101300477982, + 0.7086176723241806, + 0.12429541163146496, + 0.0, + 0.06073358841240406, + 0.5130781754851341, + 0.7357359565794468, + 0.561725165694952, + 2.1869903169572353, + 0.4386786352843046, + 0.24773165956139565, + 0.42059873044490814, + 0.46047307178378105, + 0.7253492251038551, + 1.9214290753006935, + 0.8029223810881376, + 0.04469330981373787, + 1.4725957531481981, + 0.16733455285429955, + 1.3671325892210007, + 0.2628962844610214, + 0.5863794256001711, + 0.6729527078568935, + 0.4770306460559368, + 0.19306525960564613, + 0.5878426507115364, + 1.5323924161493778, + 0.6439665518701077, + 1.7863427698612213, + 2.041317917406559, + 0.47821930795907974, + 0.22771084308624268, + 0.04220746457576752, + 1.1788056455552578, + 1.6751220058649778, + 0.31169991940259933, + 0.07646903768181801, + 0.28547460585832596, + 0.3274513501673937, + 1.1953850574791431, + 0.28542404994368553, + 0.22936258651316166, + 0.15659190714359283, + 1.0760292317718267, + 0.24823345616459846, + 0.0, + 0.792926212772727, + 0.0, + 0.7173240762203932, + 0.31216736882925034, + 0.10360706597566605, + 1.5155077539384365, + 0.19113830663263798 + ], + "unique_experts": 61, + "load_cv": 0.7118052168020873, + "normalized_load_entropy": 0.9364612596688344, + "max_load_share": 0.044444444444444446 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "452f6d263484672a9963115c2d830eb9183478dac3cdb6067ac12db9771bf7da", + "route_weight_sha256": "02c8621967e064eb40a226ed837d19fd83a3e7b9c73474844cd7eaf6caae2965", + "loads": [ + 23, + 50, + 18, + 15, + 17, + 10, + 13, + 14, + 22, + 8, + 41, + 5, + 14, + 5, + 0, + 3, + 6, + 12, + 8, + 19, + 6, + 7, + 11, + 8, + 14, + 16, + 21, + 1, + 19, + 8, + 15, + 4, + 16, + 17, + 17, + 4, + 9, + 33, + 20, + 25, + 28, + 9, + 5, + 2, + 23, + 40, + 13, + 2, + 6, + 9, + 30, + 5, + 11, + 4, + 26, + 5, + 0, + 25, + 0, + 10, + 11, + 3, + 22, + 7 + ], + "weighted_loads": [ + 1.0634072683751583, + 3.530771397287026, + 0.8489505890756845, + 0.45083998143672943, + 0.5829865261912346, + 0.576220216229558, + 0.7378528639674187, + 0.4773276671767235, + 0.7558665387332439, + 0.5527289174497128, + 3.218141373246908, + 0.7480642907321453, + 0.8616881258785725, + 0.16078844852745533, + 0.0, + 0.10395951010286808, + 0.5130781754851341, + 0.8641096148639917, + 0.5883564632385969, + 2.1869903169572353, + 0.4386786352843046, + 0.24773165956139565, + 0.42059873044490814, + 0.5525459758937359, + 0.7253492251038551, + 1.9214290753006935, + 0.8029223810881376, + 0.04469330981373787, + 1.5149674694985151, + 0.27854593098163605, + 1.3671325892210007, + 0.349349707365036, + 0.6977250594645739, + 0.7339901775121689, + 0.5687256120145321, + 0.19306525960564613, + 0.6622132062911987, + 1.590385764837265, + 1.201996149495244, + 2.2421387434005737, + 2.5509773660451174, + 0.47821930795907974, + 0.22771084308624268, + 0.07473862171173096, + 1.532975785434246, + 2.5384752731770277, + 0.40208854526281357, + 0.07646903768181801, + 0.28547460585832596, + 0.3274513501673937, + 1.7955444641411304, + 0.28542404994368553, + 0.5325494352728128, + 0.15659190714359283, + 1.4960970885585994, + 0.24823345616459846, + 0.0, + 0.9860488995909691, + 0.0, + 0.7173240762203932, + 0.4556559547781944, + 0.10360706597566605, + 1.9627555664628744, + 0.32004023529589176 + ], + "unique_experts": 61, + "load_cv": 0.7656760043852574, + "normalized_load_entropy": 0.9314531774600305, + "max_load_share": 0.05747126436781609 + } + }, + "s1_period": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "07c71a6cadbc80e33ce0739ac4f32e92e2c363d293d0c52bccfb09a9552a48d1", + "route_weight_sha256": "e8c63ed3ae63e261f5bd5fe3ba31b17a1effcf252de6cf339c81a728993669b3", + "loads": [ + 20, + 30, + 12, + 12, + 19, + 9, + 5, + 19, + 17, + 8, + 29, + 2, + 12, + 5, + 0, + 2, + 5, + 8, + 6, + 20, + 6, + 8, + 14, + 6, + 10, + 16, + 23, + 1, + 17, + 6, + 13, + 4, + 14, + 23, + 15, + 3, + 8, + 38, + 13, + 22, + 17, + 13, + 3, + 2, + 17, + 26, + 7, + 2, + 9, + 11, + 18, + 5, + 9, + 2, + 15, + 4, + 1, + 19, + 0, + 9, + 5, + 4, + 16, + 6 + ], + "weighted_loads": [ + 0.9384015295654535, + 2.0300440713763237, + 0.4408023301512003, + 0.41462910361588, + 0.6539063900709152, + 0.5117571540176868, + 0.2577594220638275, + 0.647851750254631, + 0.609147822484374, + 0.5638710260391235, + 2.1586006581783295, + 0.0749627910554409, + 0.7167331501841545, + 0.17689947970211506, + 0.0, + 0.07367876544594765, + 0.44650720432400703, + 0.7200201489031315, + 0.518256114795804, + 2.15563553199172, + 0.4293150994926691, + 0.2916958723217249, + 0.5304239112883806, + 0.36994760297238827, + 0.5699735470116138, + 1.9160428829491138, + 0.8598722480237484, + 0.039227064698934555, + 1.3249020464718342, + 0.20648377761244774, + 1.6170510686933994, + 0.29261944256722927, + 0.5235518626868725, + 0.8932102527469397, + 0.4856120254844427, + 0.1501089408993721, + 0.5413929987698793, + 1.7225959822535515, + 0.7646515723317862, + 1.6617389060556889, + 1.7276521101593971, + 0.6400559693574905, + 0.16680640541017056, + 0.07346723228693008, + 1.1076583173125982, + 1.4286647588014603, + 0.2111988589167595, + 0.08104866370558739, + 0.4303537718951702, + 0.4139361809939146, + 1.069123575463891, + 0.26257022842764854, + 0.4340620469301939, + 0.09106600657105446, + 0.877369087189436, + 0.206308264285326, + 0.031214158982038498, + 0.7810167763382196, + 0.0, + 0.6985672228038311, + 0.2081371583044529, + 0.1403125450015068, + 1.5883824490010738, + 0.19315217807888985 + ], + "unique_experts": 62, + "load_cv": 0.7202537275840823, + "normalized_load_entropy": 0.9363124544418497, + "max_load_share": 0.05277777777777778 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "9c282efeec69edb79f281184a38f0d445862bd1ac41b60bab8225f6fe4ecc809", + "route_weight_sha256": "16f814f3109f857e75c3dbae850174ea54067430c93c46d058b445516680fe14", + "loads": [ + 23, + 56, + 21, + 12, + 19, + 10, + 12, + 19, + 19, + 9, + 51, + 5, + 18, + 5, + 0, + 3, + 5, + 16, + 8, + 21, + 9, + 15, + 14, + 11, + 10, + 16, + 24, + 1, + 18, + 9, + 13, + 7, + 20, + 24, + 18, + 3, + 9, + 45, + 22, + 27, + 26, + 13, + 4, + 3, + 27, + 41, + 8, + 2, + 9, + 11, + 29, + 5, + 16, + 9, + 28, + 5, + 3, + 26, + 0, + 10, + 10, + 5, + 21, + 8 + ], + "weighted_loads": [ + 1.2021977994590998, + 4.183459522435442, + 0.9435341320931911, + 0.41462910361588, + 0.6539063900709152, + 0.5504370592534542, + 0.8486453481018543, + 0.647851750254631, + 0.7229935843497515, + 0.5920976866036654, + 4.115191105753183, + 0.7883047722280025, + 1.0210332199931145, + 0.17689947970211506, + 0.0, + 0.110425665974617, + 0.44650720432400703, + 1.368591669946909, + 0.5955380126833916, + 2.179336056113243, + 0.687548765912652, + 0.9301745109260082, + 0.5304239112883806, + 0.5622615050524473, + 0.5699735470116138, + 1.9160428829491138, + 0.8936951830983162, + 0.039227064698934555, + 1.370375856757164, + 0.32146229036152363, + 1.6170510686933994, + 0.7666684594005346, + 0.7989779971539974, + 0.9391332548111677, + 0.6417432259768248, + 0.1501089408993721, + 0.5859841387718916, + 2.0334294140338898, + 1.5530622396618128, + 2.1533763371407986, + 2.2446810640394688, + 0.6400559693574905, + 0.2536116149276495, + 0.10370906256139278, + 1.8124562669545412, + 2.7173799742013216, + 0.25236229598522186, + 0.08104866370558739, + 0.4303537718951702, + 0.4139361809939146, + 1.7559784296900034, + 0.26257022842764854, + 0.9288621973246336, + 0.5969646200537682, + 1.7217844265978783, + 0.23295912332832813, + 0.10324422642588615, + 1.0811062939465046, + 0.0, + 0.7881141193211079, + 0.4832777604460716, + 0.18295253068208694, + 2.0185534954071045, + 0.44798463955521584 + ], + "unique_experts": 62, + "load_cv": 0.7694039749511095, + "normalized_load_entropy": 0.9336491386099065, + "max_load_share": 0.057971014492753624 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 120, + "ordered_topk_exact_tokens": 38, + "set_exact_tokens": 51, + "mean_set_jaccard": 0.8097222222222222, + "mean_token_weighted_tv": 0.03264821097254753, + "aggregate_load_tv": 0.05972222222222222 + }, + "system_bos": { + "tokens": 120, + "ordered_topk_exact_tokens": 41, + "set_exact_tokens": 62, + "mean_set_jaccard": 0.8434523809523811, + "mean_token_weighted_tv": 0.0302094003961732, + "aggregate_load_tv": 0.048611111111111105 + }, + "system_x": { + "tokens": 120, + "ordered_topk_exact_tokens": 27, + "set_exact_tokens": 40, + "mean_set_jaccard": 0.7781746031746032, + "mean_token_weighted_tv": 0.04559005604436, + "aggregate_load_tv": 0.06388888888888888 + }, + "system_period": { + "tokens": 120, + "ordered_topk_exact_tokens": 27, + "set_exact_tokens": 41, + "mean_set_jaccard": 0.7815476190476189, + "mean_token_weighted_tv": 0.04487147260612498, + "aggregate_load_tv": 0.06944444444444445 + }, + "bos_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 28, + "set_exact_tokens": 42, + "mean_set_jaccard": 0.7968253968253969, + "mean_token_weighted_tv": 0.037301088823005556, + "aggregate_load_tv": 0.05833333333333333 + }, + "bos_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 25, + "set_exact_tokens": 45, + "mean_set_jaccard": 0.8, + "mean_token_weighted_tv": 0.03717768428226312, + "aggregate_load_tv": 0.05416666666666667 + }, + "x_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 33, + "set_exact_tokens": 55, + "mean_set_jaccard": 0.818452380952381, + "mean_token_weighted_tv": 0.0364103766468664, + "aggregate_load_tv": 0.048611111111111105 + }, + "x_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 29, + "set_exact_tokens": 44, + "mean_set_jaccard": 0.7841269841269842, + "mean_token_weighted_tv": 0.04447236292374631, + "aggregate_load_tv": 0.05416666666666667 + }, + "period_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 34, + "set_exact_tokens": 51, + "mean_set_jaccard": 0.8053571428571428, + "mean_token_weighted_tv": 0.03860910851508379, + "aggregate_load_tv": 0.056944444444444436 + }, + "period_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 32, + "set_exact_tokens": 46, + "mean_set_jaccard": 0.7892857142857144, + "mean_token_weighted_tv": 0.04393474364187568, + "aggregate_load_tv": 0.06527777777777778 + } + } + }, + "layer_26": { + "layer": 26, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "a787ebf308c8e2e9b50d1eb087b5c4f07d5692f49a09640016e2c913c26f0608", + "route_weight_sha256": "6fb89e03bcb44d185fd51650eff0f1d2c8fc13566925a2994702844220912941", + "loads": [ + 6, + 2, + 20, + 11, + 17, + 7, + 5, + 7, + 2, + 16, + 4, + 9, + 6, + 10, + 37, + 9, + 10, + 22, + 16, + 2, + 15, + 18, + 6, + 0, + 19, + 7, + 14, + 26, + 1, + 19, + 12, + 8, + 26, + 8, + 13, + 9, + 23, + 6, + 5, + 6, + 3, + 8, + 15, + 10, + 22, + 11, + 6, + 0, + 11, + 6, + 13, + 8, + 26, + 7, + 4, + 5, + 25, + 11, + 4, + 4, + 13, + 19, + 22, + 8 + ], + "weighted_loads": [ + 0.22383596748113632, + 0.22213414683938026, + 1.24751802906394, + 0.5139574445784092, + 0.838592067360878, + 0.28042640164494514, + 0.2923030648380518, + 0.2873171903192997, + 0.06650637835264206, + 0.9060160927474499, + 0.327359426766634, + 0.4719855673611164, + 0.4097503498196602, + 0.39792921394109726, + 2.3090104442089796, + 0.39642439037561417, + 0.6524996235966682, + 0.7379139550030231, + 0.5700077209621668, + 0.06163522228598595, + 1.0974582992494106, + 1.766747223213315, + 0.21223843283951283, + 0.0, + 0.7858810294419527, + 0.3480347506701946, + 1.0511925723403692, + 1.778702599927783, + 0.04150642454624176, + 1.4821269698441029, + 0.6899617202579975, + 0.255537373945117, + 1.0560557954013348, + 0.2871853355318308, + 0.6111405938863754, + 0.4354107044637203, + 0.8540098574012518, + 0.2567175030708313, + 0.38118360191583633, + 0.2092190980911255, + 0.10144037194550037, + 1.159147348254919, + 0.5407281685620546, + 0.3759179301559925, + 0.9444838035851717, + 0.43116623908281326, + 0.18090044520795345, + 0.0, + 0.4175899662077427, + 0.2523105777800083, + 0.7340101823210716, + 0.30750116519629955, + 1.509240796789527, + 0.3192664608359337, + 0.236040897667408, + 0.18132930621504784, + 1.5534115079790354, + 0.5958259850740433, + 0.29304576851427555, + 0.17730136960744858, + 1.5739189200103283, + 0.7499291934072971, + 1.045703949406743, + 0.3928131014108658 + ], + "unique_experts": 62, + "load_cv": 0.6816827400079096, + "normalized_load_entropy": 0.9442379687701161, + "max_load_share": 0.05138888888888889 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "419215e3a70d4510be829935f848399b482023a09275e5c04b4e8d3a28d4fe16", + "route_weight_sha256": "12425569371e508edfd5637d7715230ebfd530524fa3012daedb54c9d8657456", + "loads": [ + 6, + 2, + 20, + 14, + 17, + 7, + 5, + 9, + 2, + 19, + 7, + 14, + 6, + 12, + 54, + 11, + 10, + 32, + 16, + 2, + 15, + 22, + 8, + 0, + 26, + 7, + 19, + 33, + 1, + 19, + 18, + 8, + 28, + 9, + 16, + 9, + 30, + 6, + 6, + 6, + 3, + 8, + 16, + 13, + 23, + 11, + 10, + 0, + 12, + 7, + 21, + 8, + 30, + 7, + 5, + 5, + 39, + 20, + 10, + 5, + 14, + 19, + 23, + 10 + ], + "weighted_loads": [ + 0.22383596748113632, + 0.22213414683938026, + 1.24751802906394, + 0.6227019689977169, + 0.838592067360878, + 0.28042640164494514, + 0.2923030648380518, + 0.3945254869759083, + 0.06650637835264206, + 1.0886160992085934, + 0.5370694696903229, + 0.7755287876352668, + 0.4097503498196602, + 0.5212418287992477, + 3.0535541745484807, + 0.4935073181986809, + 0.6524996235966682, + 1.2429207828827202, + 0.5700077209621668, + 0.06163522228598595, + 1.0974582992494106, + 2.043878113850951, + 0.31593612022697926, + 0.0, + 1.2174103427678347, + 0.3480347506701946, + 1.7591585498303175, + 2.0592729300260544, + 0.04150642454624176, + 1.4821269698441029, + 1.4289734810590744, + 0.255537373945117, + 1.129952721297741, + 0.3208568189293146, + 0.9006096795201302, + 0.4354107044637203, + 1.218057295307517, + 0.2567175030708313, + 0.4248766601085663, + 0.2092190980911255, + 0.10144037194550037, + 1.159147348254919, + 0.5920473914593458, + 0.5295698530972004, + 0.9873368944972754, + 0.43116623908281326, + 0.396332086995244, + 0.0, + 0.45306607335805893, + 1.2386770881712437, + 1.083499226719141, + 0.30750116519629955, + 1.9587203543633223, + 0.3192664608359337, + 0.28281141072511673, + 0.18132930621504784, + 2.5432421639561653, + 1.0126344594173133, + 0.5266897808760405, + 0.22144479677081108, + 1.5747274731402285, + 0.7499291934072971, + 1.0860253777354956, + 0.46798305958509445 + ], + "unique_experts": 62, + "load_cv": 0.7441709891491964, + "normalized_load_entropy": 0.9375331977701519, + "max_load_share": 0.06206896551724138 + } + }, + "s1_eos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "1a153fbf2303c218a527fbac0abf0290dada67154e70eafaff756c565fe6b256", + "route_weight_sha256": "3c68ff3c4c769f8a565e0a817e350c28bb4d406d252a0cd329f0051cffc244f8", + "loads": [ + 4, + 2, + 18, + 12, + 16, + 9, + 6, + 11, + 2, + 18, + 5, + 11, + 6, + 11, + 37, + 9, + 10, + 19, + 16, + 2, + 15, + 18, + 6, + 0, + 20, + 8, + 13, + 24, + 1, + 19, + 12, + 4, + 27, + 6, + 14, + 12, + 23, + 7, + 7, + 5, + 3, + 8, + 16, + 8, + 29, + 10, + 6, + 0, + 11, + 5, + 13, + 7, + 23, + 6, + 3, + 4, + 21, + 11, + 4, + 3, + 13, + 21, + 22, + 8 + ], + "weighted_loads": [ + 0.1659867838025093, + 0.21456709876656532, + 1.1303455214947462, + 0.5263170413672924, + 0.8075376525521278, + 0.35182180255651474, + 0.3035815339535475, + 0.4118716213852167, + 0.06873882375657558, + 1.004541378468275, + 0.37932517006993294, + 0.5769490823149681, + 0.4094550609588623, + 0.41207832284271717, + 2.2152935322374105, + 0.38766178488731384, + 0.6288396865129471, + 0.6386040654033422, + 0.581167459487915, + 0.06117400340735912, + 1.0937333889305592, + 1.7229117564857006, + 0.21860809065401554, + 0.0, + 0.783415649086237, + 0.35906299389898777, + 1.0775935277342796, + 1.7040016036480665, + 0.04022752121090889, + 1.4349327981472015, + 0.6635782439261675, + 0.12130650877952576, + 1.0893185958266258, + 0.23244812712073326, + 0.6611670628190041, + 0.5332559086382389, + 0.8632083013653755, + 0.2786631193011999, + 0.4165198467671871, + 0.1655142605304718, + 0.0971380602568388, + 1.147175621241331, + 0.5840309672057629, + 0.31453512981534004, + 1.2235966213047504, + 0.40011202171444893, + 0.17229986563324928, + 0.0, + 0.40516785345971584, + 0.1987767331302166, + 0.723532110452652, + 0.27497257478535175, + 1.3827962055802345, + 0.2685353010892868, + 0.20691151544451714, + 0.148936215788126, + 1.4721113592386246, + 0.6436619572341442, + 0.2908344268798828, + 0.14676481112837791, + 1.5015092827379704, + 0.8351343143731356, + 1.080619340762496, + 0.39922789856791496 + ], + "unique_experts": 62, + "load_cv": 0.687274093075205, + "normalized_load_entropy": 0.9426441535691443, + "max_load_share": 0.05138888888888889 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "bafd56967a7221cb6cb1908ad21fb73405911b20127ce38ac83f17a88edbd5a5", + "route_weight_sha256": "19bb0ec36f803cc51ae9b50508c9e721e34558636b14275b3984233edfc47628", + "loads": [ + 5, + 2, + 18, + 15, + 19, + 9, + 6, + 13, + 2, + 24, + 11, + 18, + 6, + 13, + 54, + 14, + 10, + 26, + 17, + 2, + 15, + 27, + 15, + 0, + 30, + 9, + 24, + 34, + 1, + 20, + 21, + 5, + 31, + 6, + 20, + 12, + 35, + 12, + 11, + 6, + 4, + 8, + 18, + 12, + 30, + 11, + 10, + 1, + 12, + 8, + 20, + 7, + 32, + 8, + 6, + 7, + 39, + 21, + 14, + 9, + 16, + 21, + 25, + 9 + ], + "weighted_loads": [ + 0.21719596907496452, + 0.21456709876656532, + 1.1303455214947462, + 0.6329412572085857, + 0.9871406443417072, + 0.35182180255651474, + 0.3035815339535475, + 0.5741902086883783, + 0.06873882375657558, + 1.3578542843461037, + 1.019587181508541, + 1.1899096353445202, + 0.4094550609588623, + 0.5166324470192194, + 3.1167350485920906, + 0.7020942009985447, + 0.6288396865129471, + 1.0190411263611168, + 0.6344558112323284, + 0.06117400340735912, + 1.0937333889305592, + 2.323998551815748, + 0.8404803331941366, + 0.0, + 1.2955690883100033, + 0.42886059172451496, + 2.3363488018512726, + 2.1022471152246, + 0.04022752121090889, + 1.4694021828472614, + 1.6672769207507372, + 0.2025914266705513, + 1.2649380266666412, + 0.23244812712073326, + 1.0965908467769623, + 0.5332559086382389, + 1.5304315574467182, + 0.5822907108813524, + 0.747280091047287, + 0.1990487091243267, + 0.12744013592600822, + 1.147175621241331, + 0.6810758411884308, + 0.5122386105358601, + 1.277370348572731, + 0.41781312972307205, + 0.43482426926493645, + 0.04207879677414894, + 0.4401967655867338, + 1.3345273435115814, + 1.012804388999939, + 0.27497257478535175, + 2.1829783618450165, + 0.45509224012494087, + 0.42144875228405, + 0.29537105932831764, + 3.1180108599364758, + 1.4167695781216025, + 0.8545805774629116, + 0.40491894632577896, + 1.7391133978380822, + 0.8351343143731356, + 1.2072610668838024, + 0.44397521391510963 + ], + "unique_experts": 63, + "load_cv": 0.6940451466609413, + "normalized_load_entropy": 0.9433550211709073, + "max_load_share": 0.055900621118012424 + } + }, + "s0_bos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "7065a3365317b4efc3258cd1a86f12630501aaed11f2ffc4679d4962fe7a8900", + "route_weight_sha256": "9e2ac549ab52b7df707edcb948358c26b7d0e1d0f7499971a64c0fa92b94c3e8", + "loads": [ + 5, + 2, + 19, + 12, + 20, + 8, + 6, + 10, + 3, + 17, + 5, + 12, + 6, + 12, + 37, + 12, + 8, + 19, + 17, + 4, + 15, + 19, + 4, + 0, + 14, + 7, + 13, + 24, + 1, + 19, + 11, + 4, + 27, + 8, + 12, + 10, + 21, + 5, + 5, + 7, + 2, + 9, + 17, + 16, + 18, + 11, + 6, + 0, + 11, + 5, + 13, + 9, + 26, + 5, + 5, + 8, + 25, + 11, + 3, + 4, + 13, + 14, + 20, + 9 + ], + "weighted_loads": [ + 0.1924922913312912, + 0.2092161402106285, + 1.2540380042046309, + 0.5451593995094299, + 0.9469438660889864, + 0.29982344061136246, + 0.3462362661957741, + 0.3765935320407152, + 0.10975414514541626, + 0.9539377056062222, + 0.38224292173981667, + 0.5888826567679644, + 0.4033334329724312, + 0.44375169463455677, + 2.3274679575115442, + 0.5155559591948986, + 0.5697803236544132, + 0.6478977166116238, + 0.6031903550028801, + 0.1380322016775608, + 1.1372565031051636, + 1.7615074701607227, + 0.15410145558416843, + 0.0, + 0.6011738739907742, + 0.3469509929418564, + 1.1492804139852524, + 1.6925249211490154, + 0.04548614099621773, + 1.4443258941173553, + 0.6368961799889803, + 0.12658006697893143, + 1.1618838086724281, + 0.28909814544022083, + 0.6290777418762445, + 0.46236586943268776, + 0.790095966309309, + 0.20788699761033058, + 0.40901617519557476, + 0.23385464772582054, + 0.07492662593722343, + 1.1871742270886898, + 0.6115637626498938, + 0.5943970214575529, + 0.772026065737009, + 0.427372831851244, + 0.1814166884869337, + 0.0, + 0.4210437424480915, + 0.21463729068636894, + 0.7306425608694553, + 0.35710149072110653, + 1.4871963523328304, + 0.24257368221879005, + 0.26664040610194206, + 0.29419197142124176, + 1.6747786309570074, + 0.6216179691255093, + 0.2584494352340698, + 0.18338720314204693, + 1.598539113998413, + 0.5860789120197296, + 0.9858519025146961, + 0.43834682554006577 + ], + "unique_experts": 62, + "load_cv": 0.6579053930261094, + "normalized_load_entropy": 0.9471534127327851, + "max_load_share": 0.05138888888888889 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "4f1aeeba7c70aa44536a4eee55396385926b3272a877db84b9b290d33a7dcc37", + "route_weight_sha256": "eaf56bf2fecf31c7458aea8dd1b3921a6ff368bc9ff4a088b11549a1ef3bd720", + "loads": [ + 6, + 2, + 19, + 14, + 20, + 9, + 6, + 12, + 3, + 22, + 8, + 16, + 6, + 14, + 51, + 14, + 8, + 27, + 17, + 4, + 15, + 23, + 7, + 0, + 21, + 7, + 18, + 33, + 1, + 19, + 19, + 4, + 28, + 8, + 16, + 10, + 27, + 5, + 5, + 7, + 2, + 10, + 19, + 19, + 21, + 11, + 9, + 0, + 12, + 5, + 21, + 9, + 30, + 5, + 7, + 8, + 39, + 19, + 9, + 5, + 13, + 14, + 21, + 11 + ], + "weighted_loads": [ + 0.22544283419847488, + 0.2092161402106285, + 1.2540380042046309, + 0.6275300309062004, + 0.9469438660889864, + 0.34987034276127815, + 0.3462362661957741, + 0.503673916682601, + 0.10975414514541626, + 1.2121138237416744, + 0.5799548961222172, + 0.8903782907873392, + 0.4033334329724312, + 0.5592021029442549, + 2.9604305755347013, + 0.6325903981924057, + 0.5697803236544132, + 1.0782226100564003, + 0.6031903550028801, + 0.1380322016775608, + 1.1372565031051636, + 2.037612035870552, + 0.2902821693569422, + 0.0, + 1.0215488448739052, + 0.3469509929418564, + 1.9434623643755913, + 2.1231884229928255, + 0.04548614099621773, + 1.4443258941173553, + 1.4609795529395342, + 0.12658006697893143, + 1.2000039704144, + 0.28909814544022083, + 0.9682019520550966, + 0.46236586943268776, + 1.1170232072472572, + 0.20788699761033058, + 0.40901617519557476, + 0.23385464772582054, + 0.07492662593722343, + 1.40055638179183, + 0.7298253867775202, + 0.7480489443987608, + 0.9323238618671894, + 0.427372831851244, + 0.3555725570768118, + 0.0, + 0.4940076656639576, + 0.21463729068636894, + 1.0801316052675247, + 0.35710149072110653, + 1.942517813295126, + 0.24257368221879005, + 0.3447942025959492, + 0.29419197142124176, + 2.672676119953394, + 1.0335806552320719, + 0.49209344759583473, + 0.22753063030540943, + 1.598539113998413, + 0.5860789120197296, + 1.0261733308434486, + 0.5430988632142544 + ], + "unique_experts": 62, + "load_cv": 0.7099801913503798, + "normalized_load_entropy": 0.9413905471581018, + "max_load_share": 0.05862068965517241 + } + }, + "s1_bos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "07a51a0895f11890392d8989afe7104bde56acdb28a33a8ca931ad3d83c6757c", + "route_weight_sha256": "e2ffda03a7f4616824e047c39a25d91d5e150c796e37d41b70963c1915100166", + "loads": [ + 6, + 2, + 18, + 12, + 17, + 8, + 6, + 10, + 3, + 18, + 5, + 11, + 7, + 12, + 36, + 10, + 10, + 21, + 16, + 2, + 15, + 20, + 6, + 0, + 18, + 6, + 12, + 26, + 1, + 19, + 11, + 3, + 27, + 7, + 13, + 9, + 22, + 5, + 5, + 6, + 2, + 11, + 19, + 11, + 21, + 12, + 7, + 0, + 9, + 6, + 14, + 8, + 29, + 5, + 3, + 7, + 20, + 11, + 3, + 3, + 13, + 18, + 17, + 10 + ], + "weighted_loads": [ + 0.23794835805892944, + 0.19945675507187843, + 1.1444651652127504, + 0.5346266329288483, + 0.8272013515233994, + 0.31956394389271736, + 0.35268428921699524, + 0.36495334655046463, + 0.1100473403930664, + 0.956901678815484, + 0.40174800157546997, + 0.5824539661407471, + 0.431087426841259, + 0.4577275961637497, + 2.2757791001349688, + 0.4367194324731827, + 0.6587615944445133, + 0.7130939587950706, + 0.5928764641284943, + 0.0645885244011879, + 1.134772066026926, + 1.7946875132620335, + 0.2138044647872448, + 0.0, + 0.7331469468772411, + 0.3078291155397892, + 1.0165740065276623, + 1.8517037685960531, + 0.045282408595085144, + 1.4040673561394215, + 0.6173325330018997, + 0.0949308518320322, + 1.1392848081886768, + 0.2815664615482092, + 0.6651275008916855, + 0.408591665327549, + 0.7974371667951345, + 0.2124485783278942, + 0.3853013850748539, + 0.20662803016602993, + 0.07058753073215485, + 1.351962435990572, + 0.7098225262016058, + 0.43669154308736324, + 0.9496465921401978, + 0.45459411665797234, + 0.22203397937119007, + 0.0, + 0.3696265034377575, + 0.238812617957592, + 0.771754652261734, + 0.31197858043015003, + 1.5804513916373253, + 0.22519823163747787, + 0.2059819009155035, + 0.2736305966973305, + 1.413028784096241, + 0.6470574252307415, + 0.2586411312222481, + 0.15168887376785278, + 1.5844622664153576, + 0.7251438125967979, + 0.9056643377989531, + 0.4792401008307934 + ], + "unique_experts": 62, + "load_cv": 0.6721992649890745, + "normalized_load_entropy": 0.9444843729604999, + "max_load_share": 0.05 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "ed0f5861cd6c0a442d19776bef3a010b47091fdbd8cb4a9650573c11f27902b7", + "route_weight_sha256": "d337d71a71188ff15c2f75b16958af969c32c4a4457fbc2f06ff72f2ec6762cf", + "loads": [ + 6, + 2, + 18, + 13, + 20, + 8, + 6, + 12, + 3, + 26, + 12, + 17, + 7, + 15, + 50, + 16, + 10, + 27, + 17, + 2, + 15, + 29, + 15, + 0, + 28, + 7, + 24, + 35, + 1, + 20, + 22, + 4, + 30, + 8, + 20, + 9, + 34, + 10, + 8, + 7, + 3, + 11, + 22, + 15, + 24, + 13, + 10, + 1, + 10, + 8, + 21, + 8, + 38, + 7, + 6, + 11, + 38, + 20, + 13, + 9, + 15, + 18, + 20, + 12 + ], + "weighted_loads": [ + 0.23794835805892944, + 0.19945675507187843, + 1.1444651652127504, + 0.5676780007779598, + 1.0068043433129787, + 0.31956394389271736, + 0.35268428921699524, + 0.5457582026720047, + 0.1100473403930664, + 1.3913193959742785, + 1.0942728482186794, + 1.1931260079145432, + 0.431087426841259, + 0.616500161588192, + 3.0684062223881483, + 0.7960088290274143, + 0.6587615944445133, + 1.0985073000192642, + 0.6381025314331055, + 0.0645885244011879, + 1.134772066026926, + 2.3917697556316853, + 0.8214796148240566, + 0.0, + 1.2519068755209446, + 0.3776267133653164, + 2.4306739419698715, + 2.2085507921874523, + 0.045282408595085144, + 1.4385367408394814, + 1.7548214346170425, + 0.17621576972305775, + 1.2746121436357498, + 0.3286433946341276, + 1.182689629495144, + 0.408591665327549, + 1.4706818703562021, + 0.5160761699080467, + 0.6753012388944626, + 0.24016247875988483, + 0.10088960640132427, + 1.351962435990572, + 0.8540176618844271, + 0.6343950238078833, + 1.0853395909070969, + 0.47229522466659546, + 0.4444244932383299, + 0.04207879677414894, + 0.40465541556477547, + 0.38986290618777275, + 1.061026930809021, + 0.31197858043015003, + 2.3674821108579636, + 0.41175517067313194, + 0.42051913775503635, + 0.46695051342248917, + 3.0619377493858337, + 1.4148208983242512, + 0.8223872818052769, + 0.40984300896525383, + 1.8211400024592876, + 0.7251438125967979, + 1.0323060639202595, + 0.604765672236681 + ], + "unique_experts": 63, + "load_cv": 0.6777463624158325, + "normalized_load_entropy": 0.9453108062850226, + "max_load_share": 0.051759834368530024 + } + }, + "s0_x": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "67d382101c0038bf8e6a8e26bbd5a29ad90c38748586f63f389ca666b9b0cada", + "route_weight_sha256": "3473766fb0277bdfad5acea552a5f41dd83ba341755a2467281b4f015d227881", + "loads": [ + 5, + 2, + 22, + 15, + 20, + 8, + 6, + 7, + 2, + 15, + 5, + 11, + 8, + 11, + 37, + 11, + 8, + 19, + 15, + 2, + 15, + 20, + 5, + 0, + 14, + 7, + 13, + 25, + 1, + 19, + 12, + 5, + 27, + 7, + 11, + 10, + 22, + 4, + 7, + 7, + 3, + 9, + 16, + 14, + 22, + 9, + 4, + 0, + 10, + 6, + 13, + 8, + 30, + 5, + 5, + 6, + 24, + 11, + 3, + 5, + 13, + 19, + 19, + 6 + ], + "weighted_loads": [ + 0.17630678601562977, + 0.20672881603240967, + 1.365872697904706, + 0.664928637444973, + 0.9664675984531641, + 0.30954540707170963, + 0.35311695002019405, + 0.26113245636224747, + 0.07130406051874161, + 0.8576601184904575, + 0.41359366849064827, + 0.5649551898241043, + 0.4645754210650921, + 0.4043379873037338, + 2.212018856778741, + 0.47729554772377014, + 0.5857687219977379, + 0.6513774171471596, + 0.5200953725725412, + 0.05883808620274067, + 1.1775475181639194, + 1.834070559591055, + 0.1835576854646206, + 0.0, + 0.6027459967881441, + 0.3685241565108299, + 1.0271761491894722, + 1.7326261438429356, + 0.044504642486572266, + 1.4535351507365704, + 0.6954380329698324, + 0.1561315469443798, + 1.1384020633995533, + 0.26178206130862236, + 0.599413825199008, + 0.4601752310991287, + 0.8246952183544636, + 0.1696033589541912, + 0.44011699967086315, + 0.2569246031343937, + 0.10246627405285835, + 1.3657932467758656, + 0.5865695513784885, + 0.5319216437637806, + 0.9066469371318817, + 0.35507228411734104, + 0.12392856180667877, + 0.0, + 0.38286486826837063, + 0.2655344307422638, + 0.7302291393280029, + 0.3372296579182148, + 1.6285562757402658, + 0.23420501872897148, + 0.27833755873143673, + 0.23167428001761436, + 1.5849558506160975, + 0.6340489573776722, + 0.2674921825528145, + 0.22982408292591572, + 1.5465590097010136, + 0.7534630056470633, + 0.9503542333841324, + 0.31603794544935226 + ], + "unique_experts": 62, + "load_cv": 0.6888888888888889, + "normalized_load_entropy": 0.9431533249675306, + "max_load_share": 0.05138888888888889 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "291f0eea5e70461a7c6f83101bd5ceeb8088fb3005b2042d373f149adc5dcb86", + "route_weight_sha256": "9af49f3c323314fa9525250656e9a5b16796283f1d467f6c5f388c77c5c756c1", + "loads": [ + 5, + 2, + 22, + 16, + 20, + 8, + 6, + 9, + 2, + 19, + 9, + 17, + 8, + 13, + 52, + 13, + 8, + 29, + 15, + 2, + 15, + 24, + 7, + 0, + 21, + 7, + 18, + 33, + 1, + 19, + 18, + 5, + 28, + 7, + 14, + 10, + 28, + 4, + 7, + 7, + 3, + 9, + 17, + 19, + 23, + 9, + 7, + 0, + 10, + 6, + 22, + 8, + 34, + 5, + 6, + 7, + 42, + 20, + 9, + 6, + 13, + 19, + 21, + 7 + ], + "weighted_loads": [ + 0.17630678601562977, + 0.20672881603240967, + 1.365872697904706, + 0.7019354589283466, + 0.9664675984531641, + 0.30954540707170963, + 0.35311695002019405, + 0.3850533701479435, + 0.07130406051874161, + 1.075794454663992, + 0.6741055957973003, + 1.012103397399187, + 0.4645754210650921, + 0.5308252573013306, + 2.945168239995837, + 0.57366893440485, + 0.5857687219977379, + 1.2174928188323975, + 0.5200953725725412, + 0.05883808620274067, + 1.1775475181639194, + 2.1019897870719433, + 0.2720044255256653, + 0.0, + 1.0232860762625933, + 0.3685241565108299, + 1.7073541171848774, + 2.0468626227229834, + 0.044504642486572266, + 1.4535351507365704, + 1.364386910572648, + 0.1561315469443798, + 1.1765222251415253, + 0.26178206130862236, + 0.8632515724748373, + 0.4601752310991287, + 1.1398617327213287, + 0.1696033589541912, + 0.44011699967086315, + 0.2569246031343937, + 0.10246627405285835, + 1.3657932467758656, + 0.6291814595460892, + 0.7815417237579823, + 0.9421870857477188, + 0.35507228411734104, + 0.3028450272977352, + 0.0, + 0.38286486826837063, + 0.2655344307422638, + 1.1142084524035454, + 0.3372296579182148, + 2.0585337225347757, + 0.23420501872897148, + 0.32510807178914547, + 0.2668180838227272, + 2.7735103219747543, + 1.1554215718060732, + 0.5011361949145794, + 0.2739675100892782, + 1.5465590097010136, + 0.7534630056470633, + 1.0358005054295063, + 0.35920417308807373 + ], + "unique_experts": 62, + "load_cv": 0.7492666075574749, + "normalized_load_entropy": 0.9361446768246849, + "max_load_share": 0.059770114942528735 + } + }, + "s1_x": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "9a10ffe7dc225e27d1a663a9e096e2dd3947d43eb8d9d3933141aac89175ce1e", + "route_weight_sha256": "46b9259a95be60d78f798df39aaf513b85a0d57e688c77fab2fcd411ab44adad", + "loads": [ + 7, + 2, + 19, + 14, + 18, + 11, + 6, + 13, + 2, + 18, + 5, + 11, + 7, + 10, + 37, + 12, + 11, + 16, + 19, + 2, + 15, + 18, + 5, + 0, + 16, + 4, + 13, + 26, + 1, + 20, + 11, + 1, + 26, + 10, + 15, + 10, + 25, + 4, + 7, + 6, + 3, + 10, + 18, + 10, + 22, + 11, + 7, + 0, + 8, + 6, + 14, + 9, + 27, + 4, + 4, + 4, + 20, + 10, + 3, + 4, + 12, + 18, + 17, + 6 + ], + "weighted_loads": [ + 0.2626203875988722, + 0.1957753747701645, + 1.1471104510128498, + 0.6218157894909382, + 0.8586668223142624, + 0.43500886484980583, + 0.3250967226922512, + 0.4706618934869766, + 0.07151057943701744, + 0.9806017968803644, + 0.3841881975531578, + 0.5937885120511055, + 0.38800731860101223, + 0.35370689630508423, + 2.154520623385906, + 0.4930734261870384, + 0.7085641622543335, + 0.5465332809835672, + 0.6776076406240463, + 0.05726823769509792, + 1.109868261963129, + 1.7886519208550453, + 0.17579582333564758, + 0.0, + 0.656174236908555, + 0.253670372068882, + 0.9328831695020199, + 1.6692919172346592, + 0.04461042955517769, + 1.4362328555434942, + 0.6196118835359812, + 0.03986797481775284, + 1.1120831072330475, + 0.3819218650460243, + 0.654165817424655, + 0.4388028457760811, + 0.9359743781387806, + 0.17355386167764664, + 0.46118949726223946, + 0.21415033005177975, + 0.10143386013805866, + 1.3621079176664352, + 0.6867828667163849, + 0.3959901090711355, + 0.9349692203104496, + 0.4023991394788027, + 0.21575831435620785, + 0.0, + 0.3292385935783386, + 0.2271208092570305, + 0.7367672994732857, + 0.3290786277502775, + 1.530935475602746, + 0.18689293786883354, + 0.22556516528129578, + 0.16372568905353546, + 1.3445034138858318, + 0.6550936661660671, + 0.27511075884103775, + 0.18712756037712097, + 1.4331932440400124, + 0.7209831364452839, + 0.9054688978940248, + 0.3287912979722023 + ], + "unique_experts": 62, + "load_cv": 0.679324283005901, + "normalized_load_entropy": 0.9425338441993754, + "max_load_share": 0.05138888888888889 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "34c5b944d4ebd66019a2ff34562c2fd076f814ee74c7392cf5f75872966e2342", + "route_weight_sha256": "c15cab11a0bfa9fcc279fd29103c15ffca0de8defa203536b84eecb5224c2ee8", + "loads": [ + 7, + 2, + 19, + 14, + 21, + 11, + 6, + 15, + 2, + 25, + 12, + 19, + 7, + 12, + 53, + 17, + 11, + 22, + 19, + 2, + 15, + 27, + 13, + 0, + 26, + 5, + 25, + 37, + 1, + 22, + 20, + 2, + 29, + 11, + 21, + 10, + 37, + 9, + 10, + 7, + 4, + 10, + 20, + 14, + 22, + 12, + 10, + 1, + 10, + 8, + 21, + 9, + 36, + 6, + 7, + 8, + 40, + 21, + 14, + 11, + 14, + 18, + 20, + 7 + ], + "weighted_loads": [ + 0.2626203875988722, + 0.1957753747701645, + 1.1471104510128498, + 0.6218157894909382, + 1.0382698141038418, + 0.43500886484980583, + 0.3250967226922512, + 0.6360377445816994, + 0.07151057943701744, + 1.3706933353096247, + 1.071924202144146, + 1.3644034042954445, + 0.38800731860101223, + 0.46146073192358017, + 3.117569215595722, + 0.8067273907363415, + 0.7085641622543335, + 0.9464277792721987, + 0.6776076406240463, + 0.05726823769509792, + 1.109868261963129, + 2.3959895819425583, + 0.7083193473517895, + 0.0, + 1.17218360863626, + 0.3234679698944092, + 2.2251007929444313, + 2.101887134835124, + 0.04461042955517769, + 1.5567960608750582, + 1.5674365181475878, + 0.12115289270877838, + 1.2474104426801205, + 0.42326126992702484, + 1.086458494886756, + 0.4388028457760811, + 1.5987019017338753, + 0.47718145325779915, + 0.7511893510818481, + 0.24768477864563465, + 0.1317359358072281, + 1.3621079176664352, + 0.7773336470127106, + 0.5936935897916555, + 0.9349692203104496, + 0.4201002474874258, + 0.4354062993079424, + 0.04207879677414894, + 0.39326361007988453, + 0.3781710974872112, + 1.0260395780205727, + 0.3290786277502775, + 2.2778949830681086, + 0.3734498769044876, + 0.44010240212082863, + 0.348684836179018, + 3.0797274336218834, + 1.5834631584584713, + 0.9023916162550449, + 0.4908906780183315, + 1.6698709800839424, + 0.7209831364452839, + 1.0321106240153313, + 0.373538613319397 + ], + "unique_experts": 63, + "load_cv": 0.690677147696036, + "normalized_load_entropy": 0.9437350290098436, + "max_load_share": 0.054865424430641824 + } + }, + "s0_period": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "796fc7475ea538a7626fe344b4d17e7e050cbaa294fd0d3dd43b0f03d9ddf6a2", + "route_weight_sha256": "bfa6c81fc7a404248092d622f8f05839b260e01673454d0d9a00aa6e3bf86a5e", + "loads": [ + 2, + 2, + 20, + 13, + 20, + 11, + 6, + 8, + 2, + 16, + 5, + 12, + 7, + 12, + 35, + 12, + 8, + 17, + 17, + 3, + 15, + 19, + 7, + 0, + 16, + 6, + 13, + 26, + 1, + 19, + 12, + 4, + 27, + 10, + 13, + 10, + 20, + 5, + 6, + 7, + 3, + 8, + 17, + 15, + 24, + 10, + 3, + 0, + 8, + 6, + 13, + 10, + 27, + 5, + 4, + 7, + 24, + 11, + 3, + 5, + 13, + 16, + 18, + 6 + ], + "weighted_loads": [ + 0.08358530327677727, + 0.21079806238412857, + 1.3392558060586452, + 0.5724384300410748, + 0.9694876112043858, + 0.4120232071727514, + 0.34931956976652145, + 0.3077547512948513, + 0.07058298587799072, + 0.9257636778056622, + 0.41124793142080307, + 0.5851453132927418, + 0.44965655729174614, + 0.4395275916904211, + 2.1283503640443087, + 0.5213095955550671, + 0.587073564529419, + 0.6025509368628263, + 0.6019848976284266, + 0.09843853302299976, + 1.1552773900330067, + 1.843686394393444, + 0.25232228823006153, + 0.0, + 0.6704097483307123, + 0.3356432355940342, + 1.1060758084058762, + 1.8302637450397015, + 0.04581749811768532, + 1.428887713700533, + 0.7059592735022306, + 0.12590383924543858, + 1.1434251237660646, + 0.36293655820190907, + 0.653643948957324, + 0.46369951218366623, + 0.7399091403931379, + 0.19339404627680779, + 0.41481301933526993, + 0.24363186210393906, + 0.10188156552612782, + 1.3282107822597027, + 0.6373895518481731, + 0.5691362805664539, + 0.9540239069610834, + 0.3903831522911787, + 0.08452961035072803, + 0.0, + 0.34304826706647873, + 0.25065498426556587, + 0.7178334891796112, + 0.40159439109265804, + 1.5416006613522768, + 0.23346291854977608, + 0.23899110220372677, + 0.25582263991236687, + 1.6316055059432983, + 0.6217277571558952, + 0.2582401931285858, + 0.22874240949749947, + 1.5459990501403809, + 0.6298380233347416, + 0.9186761565506458, + 0.33610665798187256 + ], + "unique_experts": 62, + "load_cv": 0.6683312551921141, + "normalized_load_entropy": 0.9446501240912379, + "max_load_share": 0.04861111111111111 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "ff1884b7c10d1da94a5af06be49e0e8e19899ac266eb2ff8123d3c027528fae7", + "route_weight_sha256": "829ffdaa41e1bf72a398f29854f1958397a089f2751b262d6c4e886e4c55c265", + "loads": [ + 2, + 2, + 20, + 15, + 20, + 12, + 6, + 10, + 2, + 19, + 9, + 16, + 7, + 14, + 51, + 14, + 8, + 27, + 18, + 3, + 15, + 23, + 8, + 0, + 24, + 6, + 18, + 33, + 1, + 19, + 19, + 4, + 29, + 11, + 16, + 10, + 27, + 5, + 6, + 7, + 3, + 8, + 17, + 18, + 25, + 10, + 7, + 0, + 8, + 6, + 21, + 10, + 32, + 5, + 5, + 9, + 40, + 19, + 9, + 6, + 13, + 16, + 19, + 8 + ], + "weighted_loads": [ + 0.08358530327677727, + 0.21079806238412857, + 1.3392558060586452, + 0.6523872055113316, + 0.9694876112043858, + 0.45694088749587536, + 0.34931956976652145, + 0.4226590469479561, + 0.07058298587799072, + 1.1083636842668056, + 0.6852940991520882, + 0.8866409473121166, + 0.44965655729174614, + 0.5639238301664591, + 2.8372869323939085, + 0.6128852292895317, + 0.587073564529419, + 1.1684324834495783, + 0.6358697321265936, + 0.09843853302299976, + 1.1552773900330067, + 2.1188376992940903, + 0.29106065817177296, + 0.0, + 1.1941085178405046, + 0.3356432355940342, + 1.7812507189810276, + 2.110834075137973, + 0.04581749811768532, + 1.428887713700533, + 1.3975399937480688, + 0.12590383924543858, + 1.2197052035480738, + 0.4015518631786108, + 0.922506419941783, + 0.46369951218366623, + 1.1088876631110907, + 0.19339404627680779, + 0.41481301933526993, + 0.24363186210393906, + 0.10188156552612782, + 1.3282107822597027, + 0.6373895518481731, + 0.7227882035076618, + 0.9900589045137167, + 0.3903831522911787, + 0.294543145224452, + 0.0, + 0.34304826706647873, + 0.25065498426556587, + 1.0673225335776806, + 0.40159439109265804, + 2.061406834051013, + 0.23346291854977608, + 0.2857616152614355, + 0.32251930981874466, + 2.8050467129796743, + 1.0336904432624578, + 0.4918842054903507, + 0.27288583666086197, + 1.5459990501403809, + 0.6298380233347416, + 0.9589975848793983, + 0.46480368822813034 + ], + "unique_experts": 62, + "load_cv": 0.728670362209904, + "normalized_load_entropy": 0.9381894909437931, + "max_load_share": 0.05862068965517241 + } + }, + "s1_period": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "390f133c96348c8be728f7a8b1d2c599c4fc7ac850500790c037c378deda5788", + "route_weight_sha256": "3550f24bf6a4265e98a8581fa3c77cba0db8c7e212b4155da23a0bcc44d4990b", + "loads": [ + 5, + 2, + 21, + 15, + 19, + 11, + 7, + 11, + 2, + 17, + 5, + 11, + 6, + 10, + 37, + 12, + 11, + 19, + 16, + 2, + 15, + 18, + 5, + 0, + 15, + 4, + 12, + 27, + 1, + 20, + 12, + 2, + 25, + 11, + 14, + 10, + 25, + 5, + 6, + 5, + 3, + 9, + 16, + 10, + 20, + 11, + 4, + 0, + 14, + 6, + 14, + 8, + 30, + 4, + 3, + 6, + 20, + 10, + 3, + 4, + 12, + 20, + 17, + 5 + ], + "weighted_loads": [ + 0.1815052218735218, + 0.20073512196540833, + 1.262365210801363, + 0.648703183978796, + 0.8963585197925568, + 0.4064756352454424, + 0.36749469116330147, + 0.4216029793024063, + 0.07575955986976624, + 0.9770541712641716, + 0.39851436764001846, + 0.6033749356865883, + 0.3620556592941284, + 0.3656339105218649, + 2.1954364981502295, + 0.49458154663443565, + 0.6780847683548927, + 0.6499820798635483, + 0.5812829341739416, + 0.05738308094441891, + 1.1490373201668262, + 1.7831691466271877, + 0.18094414472579956, + 0.0, + 0.615427415817976, + 0.2551075667142868, + 0.9125979878008366, + 1.784250471740961, + 0.04396996647119522, + 1.4449695236980915, + 0.6460299510508776, + 0.07155051082372665, + 1.0987515468150377, + 0.4121042527258396, + 0.6470056232064962, + 0.430107980966568, + 0.948686558753252, + 0.20202418603003025, + 0.4335350729525089, + 0.17020734958350658, + 0.10461415350437164, + 1.1774940192699432, + 0.6019868850708008, + 0.39887543581426144, + 0.8788084462285042, + 0.407776415348053, + 0.13176333718001842, + 0.0, + 0.5257012136280537, + 0.22350680828094482, + 0.729795940220356, + 0.2980280928313732, + 1.6222297921776772, + 0.18232911452651024, + 0.19645697623491287, + 0.2305546421557665, + 1.382458958774805, + 0.6695355698466301, + 0.27594373375177383, + 0.20183895900845528, + 1.4231973141431808, + 0.7870606388896704, + 0.9056784976273775, + 0.3097259923815727 + ], + "unique_experts": 62, + "load_cv": 0.6926421055781644, + "normalized_load_entropy": 0.9409762060829259, + "max_load_share": 0.05138888888888889 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "e27cd756c5cb08b61883c9020c7c642cff9e49ace6c2618b43c8378113d4579b", + "route_weight_sha256": "90058c3a42daf154563e4fdc9ed692157e01cdf2eb43f0436ae1d4daf5fc5e9c", + "loads": [ + 5, + 2, + 21, + 16, + 22, + 12, + 7, + 13, + 2, + 24, + 12, + 17, + 6, + 12, + 52, + 17, + 11, + 25, + 16, + 2, + 15, + 27, + 13, + 0, + 26, + 5, + 23, + 37, + 1, + 21, + 21, + 3, + 28, + 11, + 20, + 10, + 37, + 10, + 9, + 6, + 4, + 9, + 19, + 15, + 21, + 12, + 8, + 1, + 16, + 8, + 22, + 8, + 40, + 6, + 7, + 10, + 40, + 19, + 13, + 10, + 14, + 20, + 20, + 7 + ], + "weighted_loads": [ + 0.1815052218735218, + 0.20073512196540833, + 1.262365210801363, + 0.6796027421951294, + 1.0759615115821362, + 0.4529524501413107, + 0.36749469116330147, + 0.5990800708532333, + 0.07575955986976624, + 1.3672842867672443, + 1.1195727549493313, + 1.2140469774603844, + 0.3620556592941284, + 0.46855258010327816, + 3.131455173715949, + 0.7968774028122425, + 0.6780847683548927, + 1.0760443136096, + 0.5812829341739416, + 0.05738308094441891, + 1.1490373201668262, + 2.393517628312111, + 0.7149737142026424, + 0.0, + 1.2150064557790756, + 0.324905164539814, + 2.1746339313685894, + 2.171907091513276, + 0.04396996647119522, + 1.4794389083981514, + 1.5883168149739504, + 0.1528354287147522, + 1.2340788822621107, + 0.4121042527258396, + 1.078114015981555, + 0.430107980966568, + 1.61808892339468, + 0.5056517776101828, + 0.7235349267721176, + 0.2037417981773615, + 0.13491622917354107, + 1.1774940192699432, + 0.7272662669420242, + 0.6273513399064541, + 0.9074873309582472, + 0.4254775233566761, + 0.3828277010470629, + 0.04207879677414894, + 0.595004003494978, + 0.37455709651112556, + 1.0606532655656338, + 0.2980280928313732, + 2.4233756065368652, + 0.3688860535621643, + 0.44840381294488907, + 0.4233641196042299, + 3.189145091921091, + 1.4372990429401398, + 0.8396898843348026, + 0.4599930942058563, + 1.659875050187111, + 0.7870606388896704, + 1.032320223748684, + 0.4352378249168396 + ], + "unique_experts": 63, + "load_cv": 0.6953285996949178, + "normalized_load_entropy": 0.9431331056845853, + "max_load_share": 0.053830227743271224 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 120, + "ordered_topk_exact_tokens": 36, + "set_exact_tokens": 53, + "mean_set_jaccard": 0.8226190476190477, + "mean_token_weighted_tv": 0.03145498926751315, + "aggregate_load_tv": 0.04722222222222222 + }, + "system_bos": { + "tokens": 120, + "ordered_topk_exact_tokens": 48, + "set_exact_tokens": 63, + "mean_set_jaccard": 0.8535714285714288, + "mean_token_weighted_tv": 0.027193675632588565, + "aggregate_load_tv": 0.05138888888888889 + }, + "system_x": { + "tokens": 120, + "ordered_topk_exact_tokens": 31, + "set_exact_tokens": 42, + "mean_set_jaccard": 0.7900793650793652, + "mean_token_weighted_tv": 0.042458145429069796, + "aggregate_load_tv": 0.06388888888888888 + }, + "system_period": { + "tokens": 120, + "ordered_topk_exact_tokens": 29, + "set_exact_tokens": 45, + "mean_set_jaccard": 0.7982142857142857, + "mean_token_weighted_tv": 0.040099396867056686, + "aggregate_load_tv": 0.06111111111111111 + }, + "bos_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 31, + "set_exact_tokens": 47, + "mean_set_jaccard": 0.7970238095238095, + "mean_token_weighted_tv": 0.036967079349172614, + "aggregate_load_tv": 0.05833333333333333 + }, + "bos_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 33, + "set_exact_tokens": 53, + "mean_set_jaccard": 0.8119047619047618, + "mean_token_weighted_tv": 0.03484784625470638, + "aggregate_load_tv": 0.05694444444444444 + }, + "x_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 29, + "set_exact_tokens": 48, + "mean_set_jaccard": 0.803968253968254, + "mean_token_weighted_tv": 0.036659784296837944, + "aggregate_load_tv": 0.05416666666666667 + }, + "x_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 25, + "set_exact_tokens": 42, + "mean_set_jaccard": 0.7847222222222222, + "mean_token_weighted_tv": 0.04248033003726353, + "aggregate_load_tv": 0.06805555555555556 + }, + "period_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 29, + "set_exact_tokens": 48, + "mean_set_jaccard": 0.8017857142857143, + "mean_token_weighted_tv": 0.037811204923006395, + "aggregate_load_tv": 0.06388888888888888 + }, + "period_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 21, + "set_exact_tokens": 38, + "mean_set_jaccard": 0.768452380952381, + "mean_token_weighted_tv": 0.04454296325178196, + "aggregate_load_tv": 0.06666666666666667 + } + } + } + } + }, + { + "id": "gsm8k/test/1069", + "domain": "math", + "label": "Grade-school math", + "within_domain_index": 0, + "selection_rank": "000946b459ce33a645f403b9d781a7aefd81f5568412149f4588381fed55b1d7", + "source_text_sha256": "0cc2ca2bdd6ee8d664eb1197e8020bac71c25ba0ce52d813fc4adbf08df22378", + "source_characters": 522, + "source_tokens": 107, + "content_token_ids_sha256": "4352631307b8b721b2b062c1b5231bc7b86c810c027c92464ac415d75ff73c57", + "prompt_tokens_by_condition": { + "s0_eos": 131, + "s1_eos": 147, + "s0_bos": 131, + "s1_bos": 147, + "s0_x": 131, + "s1_x": 147, + "s0_period": 131, + "s1_period": 147 + }, + "batch_prompt_tokens": 147, + "content_tokens": 106, + "boundary_crossing_tokens_by_condition": { + "s0_eos": 1, + "s1_eos": 1, + "s0_bos": 1, + "s1_bos": 1, + "s0_x": 1, + "s1_x": 1, + "s0_period": 1, + "s1_period": 1 + }, + "forward_seconds": 0.8427411850134376, + "peak_cuda_memory_allocated_bytes": 27702810624, + "hidden_stages": { + "embedding": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6fa762ca3d9437b6eb7d7235d7342f5ac0eee48f09cc9c56b3a2f6342cb439ed", + "mean": -0.0009989648824557662, + "std": 0.0989219918847084, + "rms": 0.09892703592777252, + "max_abs": 1.7109375 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f01939f917925e26373217dbd28730db8dd3e0f46c5dfb5ce611079f4a010dc0", + "mean": -0.0009563579806126654, + "std": 0.09677619487047195, + "rms": 0.0967809185385704, + "max_abs": 2.046875 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6fa762ca3d9437b6eb7d7235d7342f5ac0eee48f09cc9c56b3a2f6342cb439ed", + "mean": -0.0009989648824557662, + "std": 0.0989219918847084, + "rms": 0.09892703592777252, + "max_abs": 1.7109375 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0ef4682bdffe5f861263252c8a89938344b54541ff6e04d5aeff9c082c6019c8", + "mean": -0.001091402256861329, + "std": 0.097677081823349, + "rms": 0.09768317639827728, + "max_abs": 2.046875 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6fa762ca3d9437b6eb7d7235d7342f5ac0eee48f09cc9c56b3a2f6342cb439ed", + "mean": -0.0009989648824557662, + "std": 0.0989219918847084, + "rms": 0.09892703592777252, + "max_abs": 1.7109375 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "12fb1f7893c0817f1195b099fe6a61fd7b2fbfb304e6ab7f799231372ae00893", + "mean": -0.0009446542826481164, + "std": 0.09662870317697525, + "rms": 0.09663331508636475, + "max_abs": 2.046875 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6fa762ca3d9437b6eb7d7235d7342f5ac0eee48f09cc9c56b3a2f6342cb439ed", + "mean": -0.0009989648824557662, + "std": 0.0989219918847084, + "rms": 0.09892703592777252, + "max_abs": 1.7109375 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "73cf54398ca47312937c60c8160ee3c03e3a030a9957b9ba98b935abbfad7477", + "mean": -0.0010809723753482103, + "std": 0.09754687547683716, + "rms": 0.09755286574363708, + "max_abs": 2.046875 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6fa762ca3d9437b6eb7d7235d7342f5ac0eee48f09cc9c56b3a2f6342cb439ed", + "mean": -0.0009989648824557662, + "std": 0.0989219918847084, + "rms": 0.09892703592777252, + "max_abs": 1.7109375 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "81758f70b2069d72ad2314e65dcc7097d180e3dfacbedb62e976f97c74022a15", + "mean": -0.0009733753395266831, + "std": 0.09672808647155762, + "rms": 0.0967329889535904, + "max_abs": 2.046875 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6fa762ca3d9437b6eb7d7235d7342f5ac0eee48f09cc9c56b3a2f6342cb439ed", + "mean": -0.0009989648824557662, + "std": 0.0989219918847084, + "rms": 0.09892703592777252, + "max_abs": 1.7109375 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "65208cd7ff20c13e9ebae6e356543a2794239929bd36e87b46b92b344091fc8e", + "mean": -0.0011065674480050802, + "std": 0.09763458371162415, + "rms": 0.09764084964990616, + "max_abs": 2.046875 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6fa762ca3d9437b6eb7d7235d7342f5ac0eee48f09cc9c56b3a2f6342cb439ed", + "mean": -0.0009989648824557662, + "std": 0.0989219918847084, + "rms": 0.09892703592777252, + "max_abs": 1.7109375 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9c9577121a8bd19c0ffd7d62e7f24f5fb22f0d7ded1ac9de5a781b10a17b07bf", + "mean": -0.0009739947272464633, + "std": 0.0966147929430008, + "rms": 0.09661970287561417, + "max_abs": 2.046875 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6fa762ca3d9437b6eb7d7235d7342f5ac0eee48f09cc9c56b3a2f6342cb439ed", + "mean": -0.0009989648824557662, + "std": 0.0989219918847084, + "rms": 0.09892703592777252, + "max_abs": 1.7109375 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ba75fb77ec227a7e098e77d23471338f5225b0c1aa3d2bae1d29e276381c8399", + "mean": -0.0011071193730458617, + "std": 0.09753456711769104, + "rms": 0.09754085540771484, + "max_abs": 2.046875 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 106, + "exact_hidden_rows": 106, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999999403953552, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "system_bos": { + "tokens": 106, + "exact_hidden_rows": 106, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999999403953552, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "system_x": { + "tokens": 106, + "exact_hidden_rows": 106, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999999403953552, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "system_period": { + "tokens": 106, + "exact_hidden_rows": 106, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999999403953552, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "bos_at_s0": { + "tokens": 106, + "exact_hidden_rows": 106, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999999403953552, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "bos_at_s1": { + "tokens": 106, + "exact_hidden_rows": 106, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999999403953552, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "x_at_s0": { + "tokens": 106, + "exact_hidden_rows": 106, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999999403953552, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "x_at_s1": { + "tokens": 106, + "exact_hidden_rows": 106, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999999403953552, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "period_at_s0": { + "tokens": 106, + "exact_hidden_rows": 106, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999999403953552, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "period_at_s1": { + "tokens": 106, + "exact_hidden_rows": 106, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999999403953552, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + } + } + }, + "layer_00": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4421f34ed0aeb95757a03278ea03fd3205f7d12522a433877ec8cc451d57a32a", + "mean": -0.0013498780317604542, + "std": 0.0904666930437088, + "rms": 0.09047676622867584, + "max_abs": 2.5625 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "dc9d829c85369aabf5e357951f4637fc9f3fe980bd43fa8ab7d42da7c58f2137", + "mean": -0.0013725346652790904, + "std": 0.09055308252573013, + "rms": 0.09056349098682404, + "max_abs": 2.5625 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "43d3b4bf14912aa983ccd099b558635eb0758a1a103e3ff867f0701719ca2b33", + "mean": -0.0013639295939356089, + "std": 0.09066205471754074, + "rms": 0.0906723141670227, + "max_abs": 2.5625 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d57d0f624e27cb9e28a1ea9e2183ac28f95eb94f8f99842aa3921103d8257b02", + "mean": -0.0014860335504636168, + "std": 0.09155896306037903, + "rms": 0.09157101809978485, + "max_abs": 2.5625 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ccf5d6b5fe67614bd570695b286c6797b3c97e5b8c701648ace7bf942dbac9d3", + "mean": -0.0012661692453548312, + "std": 0.09007047116756439, + "rms": 0.09007935971021652, + "max_abs": 2.484375 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0a3e09a4ab83e36a097d9d602a94f3dfb48d90d03655267f0d6f61cfa5693d4f", + "mean": -0.0012916012201458216, + "std": 0.0899227112531662, + "rms": 0.08993198722600937, + "max_abs": 2.484375 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cdee6ad04c6fdd093068d383a05cecf9e1d7f99cc0ac445558a47c8366a9c3a8", + "mean": -0.0013141545932739973, + "std": 0.09020178765058517, + "rms": 0.09021136164665222, + "max_abs": 2.5 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "aeaa04705fb0ab141d9ecd2bde8629473b04ac61c6d1770c6aeabc40e7f009d9", + "mean": -0.0014390598516911268, + "std": 0.09096989780664444, + "rms": 0.09098127484321594, + "max_abs": 2.5 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9f44c9ea515290ab50998b622f5efffc4541c10ef3243b1e5724b55585160f21", + "mean": -0.0012767226435244083, + "std": 0.08972016721963882, + "rms": 0.08972924947738647, + "max_abs": 2.5 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b4651da3e3224cc38272797c5d5d76e049bdf51f4539986e1419c39de10d0b3f", + "mean": -0.0013182602124288678, + "std": 0.0897519513964653, + "rms": 0.0897616371512413, + "max_abs": 2.5 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2eb00b20b8946358505225f06e641f302782449a01a0c912711fde4252581579", + "mean": -0.0013301329454407096, + "std": 0.08993719518184662, + "rms": 0.08994702249765396, + "max_abs": 2.515625 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a3168d1997a57ab0d363f36f1e4fa6ebb3fe5bc0991dc3de021fd591ad2fa893", + "mean": -0.001469469745643437, + "std": 0.09089401364326477, + "rms": 0.09090588986873627, + "max_abs": 2.515625 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c0e48e077c3393e7c88a69c691ba3b6ed0e37fc1c70794362d33766892d5937f", + "mean": -0.0012695570476353168, + "std": 0.08974438160657883, + "rms": 0.08975336700677872, + "max_abs": 2.5 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f53711a4e185b0cbb59fc4d37fde7a929ea365dc88ef26c197cfbb79487a0379", + "mean": -0.0013120424700900912, + "std": 0.08959085494279861, + "rms": 0.08960046619176865, + "max_abs": 2.5 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1f333123368f334862ac7f560bf0d45095961c4ed4ec4222e2d19e0ad28453e3", + "mean": -0.0013250666670501232, + "std": 0.08995572477579117, + "rms": 0.08996548503637314, + "max_abs": 2.515625 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e0a41d54420ff453cedf4f6cfca044562ed19b89e43f26c125da9bafd3324652", + "mean": -0.001463396125473082, + "std": 0.0907340794801712, + "rms": 0.09074588119983673, + "max_abs": 2.515625 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9994285702705383, + "min_cosine_similarity": 0.9949464797973633, + "mean_relative_l2": 0.030349962413311005, + "max_abs_delta": 0.125 + }, + "system_bos": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9992271065711975, + "min_cosine_similarity": 0.9914023876190186, + "mean_relative_l2": 0.035804297775030136, + "max_abs_delta": 0.1171875 + }, + "system_x": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9992680549621582, + "min_cosine_similarity": 0.9932349920272827, + "mean_relative_l2": 0.03529829904437065, + "max_abs_delta": 0.125 + }, + "system_period": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9993001818656921, + "min_cosine_similarity": 0.993533730506897, + "mean_relative_l2": 0.034617822617292404, + "max_abs_delta": 0.1171875 + }, + "bos_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9901829957962036, + "min_cosine_similarity": 0.964756965637207, + "mean_relative_l2": 0.1375914365053177, + "max_abs_delta": 0.1875 + }, + "bos_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9912739396095276, + "min_cosine_similarity": 0.9726550579071045, + "mean_relative_l2": 0.12979845702648163, + "max_abs_delta": 0.19580078125 + }, + "x_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9910417199134827, + "min_cosine_similarity": 0.9702110290527344, + "mean_relative_l2": 0.1309943050146103, + "max_abs_delta": 0.19482421875 + }, + "x_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9919419288635254, + "min_cosine_similarity": 0.9745176434516907, + "mean_relative_l2": 0.12422292679548264, + "max_abs_delta": 0.19970703125 + }, + "period_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.991144061088562, + "min_cosine_similarity": 0.971450924873352, + "mean_relative_l2": 0.1303914338350296, + "max_abs_delta": 0.21875 + }, + "period_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9920117259025574, + "min_cosine_similarity": 0.97525554895401, + "mean_relative_l2": 0.12379564344882965, + "max_abs_delta": 0.20068359375 + } + } + }, + "layer_01": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a954a16ece32480c192677d779371f4c2598dd422898774805fe4fbafc0d63cd", + "mean": -0.0016289366176351905, + "std": 0.10498753190040588, + "rms": 0.10500016063451767, + "max_abs": 2.984375 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "98b1a1b23aa28b12bc27c8a284741d05ed6de6b90be587a3c6fe09290e435558", + "mean": -0.0037306398153305054, + "std": 0.7036307454109192, + "rms": 0.7036406397819519, + "max_abs": 126.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f415f518e67e7f819067f20057c8fcc5652ed2de842c0e643f11e8519a2163e2", + "mean": -0.0016263617435470223, + "std": 0.10536660254001617, + "rms": 0.10537915676832199, + "max_abs": 3.0 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "635fa4d30a26206882201f02556dcddd69bbed442f99f036439b69631f522867", + "mean": -0.0037903999909758568, + "std": 0.6889532208442688, + "rms": 0.6889636516571045, + "max_abs": 135.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5e076f85f221a74c65825deb0d30227f6ceb623015060abb46711fe20b9139eb", + "mean": -0.0017307412344962358, + "std": 0.1047600731253624, + "rms": 0.1047743707895279, + "max_abs": 3.015625 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7391645827ed4517c869558ddef2ecf55705eee9a1ec6c6034ba88c79215e82d", + "mean": -0.0016390568343922496, + "std": 0.106883205473423, + "rms": 0.10689577460289001, + "max_abs": 4.71875 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "dbe47f23a59d622038d9952fcd6478b3eb57177d8bfdd73d41a8815e2a86db8d", + "mean": -0.0018363739363849163, + "std": 0.1047932431101799, + "rms": 0.10480932891368866, + "max_abs": 3.03125 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "83d2dd98737dbfc34c6610c360f6f789af925808496588a49841c2eaa63dec50", + "mean": -0.0019006034126505256, + "std": 0.10770846903324127, + "rms": 0.10772523283958435, + "max_abs": 4.71875 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6883e052b6165ab5591b9be6e983a85668d337adb7afca8715bbb4f303affa59", + "mean": -0.0017090096371248364, + "std": 0.10480806976556778, + "rms": 0.10482200235128403, + "max_abs": 3.046875 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "dc941fa51512cac06675b81ef37143fd3a9211c6e2fca454003ee30500d10bdd", + "mean": -0.0016205058200284839, + "std": 0.10694164782762527, + "rms": 0.106953926384449, + "max_abs": 4.71875 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6740706c3fd9d622bfd3dc16623ac3c47e4672892445194e5ef6a870b9a12056", + "mean": -0.0018414369551464915, + "std": 0.10468100011348724, + "rms": 0.10469719767570496, + "max_abs": 3.03125 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "29a9b6b08e41b932569838c74906217124a0f0b39de0c82c75db5e29f6256346", + "mean": -0.0019085431704297662, + "std": 0.10769239813089371, + "rms": 0.10770930349826813, + "max_abs": 4.71875 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c69723056b0160e23128f91c3336c47df7b8e204209c5bee0abbae74031daecf", + "mean": -0.0017136178212240338, + "std": 0.1047929897904396, + "rms": 0.10480699688196182, + "max_abs": 3.046875 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1ba7ef4fd9679a617658359b3bba05b0e79a2c4d84ebb2632ec3d2be77212583", + "mean": -0.0016370750963687897, + "std": 0.10666810721158981, + "rms": 0.10668066143989563, + "max_abs": 4.71875 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "000d98c8bbae4a8c8327937f5db4dfc49c0099536963057b052aa3ea0bd08485", + "mean": -0.0018418619874864817, + "std": 0.10466909408569336, + "rms": 0.10468529909849167, + "max_abs": 3.03125 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "718c15655df21ef1a62b86e1036ee44f6f85439d311b825fa4c184a325269ed2", + "mean": -0.0019171524327248335, + "std": 0.10745912045240402, + "rms": 0.10747621953487396, + "max_abs": 4.71875 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9989263415336609, + "min_cosine_similarity": 0.9877792596817017, + "mean_relative_l2": 0.042138535529375076, + "max_abs_delta": 0.1171875 + }, + "system_bos": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9960403442382812, + "min_cosine_similarity": 0.9434788227081299, + "mean_relative_l2": 0.08140438795089722, + "max_abs_delta": 0.318359375 + }, + "system_x": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9950397610664368, + "min_cosine_similarity": 0.9494081735610962, + "mean_relative_l2": 0.09036039561033249, + "max_abs_delta": 0.2783203125 + }, + "system_period": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9952490329742432, + "min_cosine_similarity": 0.9539182186126709, + "mean_relative_l2": 0.08863569796085358, + "max_abs_delta": 0.2568359375 + }, + "bos_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9898311495780945, + "min_cosine_similarity": 0.9271641969680786, + "mean_relative_l2": 0.138205423951149, + "max_abs_delta": 0.3544921875 + }, + "bos_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9897908568382263, + "min_cosine_similarity": 0.9623129367828369, + "mean_relative_l2": 0.13873417675495148, + "max_abs_delta": 0.20703125 + }, + "x_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9912149906158447, + "min_cosine_similarity": 0.9376325607299805, + "mean_relative_l2": 0.12789905071258545, + "max_abs_delta": 0.3134765625 + }, + "x_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9889415502548218, + "min_cosine_similarity": 0.959129810333252, + "mean_relative_l2": 0.14318329095840454, + "max_abs_delta": 0.2734375 + }, + "period_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9914209842681885, + "min_cosine_similarity": 0.9462807178497314, + "mean_relative_l2": 0.1268215775489807, + "max_abs_delta": 0.2734375 + }, + "period_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9891214370727539, + "min_cosine_similarity": 0.963118314743042, + "mean_relative_l2": 0.14222195744514465, + "max_abs_delta": 0.2734375 + } + } + }, + "layer_02": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bf5a5df04bd14eda5ba34b8882a035777075e870b1ab15e2ae01c37cd0042508", + "mean": -0.0015930673107504845, + "std": 0.12583273649215698, + "rms": 0.12584282457828522, + "max_abs": 3.5 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "21ce74090648f67b0fce714386dd26587e06385ec616d5abf698f643cab3328e", + "mean": -0.008740259334445, + "std": 2.1011135578155518, + "rms": 2.1011319160461426, + "max_abs": 392.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cedfbc32197c4007e743744e283fcf6e6d0a466b0ed01de019d1138559c74fba", + "mean": -0.0014850785955786705, + "std": 0.1261427104473114, + "rms": 0.1261514574289322, + "max_abs": 3.5 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "89457b45593b7a32d2634dafa38244440bf5405af15c4a746e47401e10ed74ac", + "mean": -0.009106220677495003, + "std": 2.19856333732605, + "rms": 2.198582172393799, + "max_abs": 436.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1a74954505d2606c685db6a9f65e863d85f5ecdaf8bb66504d6c30a5a753614b", + "mean": -0.0016688088653609157, + "std": 0.12573596835136414, + "rms": 0.12574703991413116, + "max_abs": 3.484375 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3f909839c935735f247177ef02733028116d1d4c2837f35f454b89343d12af07", + "mean": -0.0018531144596636295, + "std": 0.1907258927822113, + "rms": 0.19073490798473358, + "max_abs": 23.875 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2b9c274e17adcc20de24856fec8064c7c7aa0e219f36b2026e200aad7dc33591", + "mean": -0.0014898041263222694, + "std": 0.125648632645607, + "rms": 0.12565746903419495, + "max_abs": 3.4375 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9447247e8c9ed502a0dd88bcc119087c8adce583ef72d7ea9bd88f5966a6481f", + "mean": -0.0017768989782780409, + "std": 0.1854175478219986, + "rms": 0.18542605638504028, + "max_abs": 23.875 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cca520421876b30f6e300fd6bc4a3be0436b36ac493d0b6fc7b8209e2f4b4fac", + "mean": -0.0016423885244876146, + "std": 0.1255636364221573, + "rms": 0.12557438015937805, + "max_abs": 3.5 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cb554951a4e6feddc3d3fc83ec49d6a8e9e038857acc8069c20fe95b4e1ad00f", + "mean": -0.0018338699592277408, + "std": 0.19066567718982697, + "rms": 0.19067449867725372, + "max_abs": 23.875 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "550780e12b5a1b2883c20bb96ef9d7dc28d148a7484ace977d62205f92caf78b", + "mean": -0.0014455656055361032, + "std": 0.12520918250083923, + "rms": 0.1252175271511078, + "max_abs": 3.46875 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "72b429d89254da7639bd4f30b05df77f71f2326eda8a6361ad6d971983b01762", + "mean": -0.0017469993326812983, + "std": 0.1852537840604782, + "rms": 0.1852620244026184, + "max_abs": 23.875 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "57f022e6eee123246f5796cb4b507da3b6729dc6ec7f7ab0199043ff2f2593fa", + "mean": -0.0016009206883609295, + "std": 0.12542086839675903, + "rms": 0.12543107569217682, + "max_abs": 3.5 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "785aeab1ef0fea380b521dc6c61e96e00d425bc6774312dba6ee0e442fe46c50", + "mean": -0.0018443360459059477, + "std": 0.19033192098140717, + "rms": 0.19034086167812347, + "max_abs": 23.875 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6fac26454abb2dd23be01bf42d44db5427b56e3c142850037ac4114f7e62bde4", + "mean": -0.001435463665984571, + "std": 0.12514984607696533, + "rms": 0.12515807151794434, + "max_abs": 3.46875 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e7c0b8a4a5ddc56b034fa44b7a8d3ce6915ce33d0219f600b6993f3c8490168e", + "mean": -0.00177065993193537, + "std": 0.18496198952198029, + "rms": 0.18497046828269958, + "max_abs": 23.875 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9988261461257935, + "min_cosine_similarity": 0.9893540143966675, + "mean_relative_l2": 0.04463080316781998, + "max_abs_delta": 0.1171875 + }, + "system_bos": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.995675802230835, + "min_cosine_similarity": 0.9391905069351196, + "mean_relative_l2": 0.08616556227207184, + "max_abs_delta": 0.3486328125 + }, + "system_x": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9945176839828491, + "min_cosine_similarity": 0.9523674249649048, + "mean_relative_l2": 0.09804815798997879, + "max_abs_delta": 0.2685546875 + }, + "system_period": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9948450326919556, + "min_cosine_similarity": 0.9583618640899658, + "mean_relative_l2": 0.09540586918592453, + "max_abs_delta": 0.236328125 + }, + "bos_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9908062815666199, + "min_cosine_similarity": 0.9143287539482117, + "mean_relative_l2": 0.1301039457321167, + "max_abs_delta": 0.375 + }, + "bos_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9896675944328308, + "min_cosine_similarity": 0.962099552154541, + "mean_relative_l2": 0.14017948508262634, + "max_abs_delta": 0.38671875 + }, + "x_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9911686182022095, + "min_cosine_similarity": 0.9295823574066162, + "mean_relative_l2": 0.12746362388134003, + "max_abs_delta": 0.3671875 + }, + "x_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9876708984375, + "min_cosine_similarity": 0.9466551542282104, + "mean_relative_l2": 0.15138176083564758, + "max_abs_delta": 0.48828125 + }, + "period_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9911938309669495, + "min_cosine_similarity": 0.9391674995422363, + "mean_relative_l2": 0.12792447209358215, + "max_abs_delta": 0.375 + }, + "period_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9876900315284729, + "min_cosine_similarity": 0.9504563808441162, + "mean_relative_l2": 0.1516035497188568, + "max_abs_delta": 0.4921875 + } + } + }, + "layer_03": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6ada859f620a5403505d167ea4c698a5ec65b63eb3289ef150e5749ef8a2e984", + "mean": -0.0019618715159595013, + "std": 0.15013465285301208, + "rms": 0.1501474678516388, + "max_abs": 4.34375 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2cf636df981b061cb89bb111ad6c5f1b102449c3c703548bf87248b6eefa20ca", + "mean": -0.011545831337571144, + "std": 6.295918941497803, + "rms": 6.295929431915283, + "max_abs": 1136.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7cd1e255b3ddb65781e4b146ce9b535bacbcb13f418c227dbfcf6183019fb2de", + "mean": -0.001928941928781569, + "std": 0.15059304237365723, + "rms": 0.15060539543628693, + "max_abs": 4.28125 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8188ed37a9aba0c13afa13863597e0d43852a7074d412761cdafb40706550f1f", + "mean": -0.011925225146114826, + "std": 6.1405134201049805, + "rms": 6.140524864196777, + "max_abs": 1136.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "23b8255c730f5ed0f3972c6d4fc4e6a62b14ab0f0916049396e560cd9b561cd5", + "mean": -0.0020011388696730137, + "std": 0.15174247324466705, + "rms": 0.1517556607723236, + "max_abs": 4.4375 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f0be1e7d61d8049826f27bc5cbac356ac5421cd48919bf72dec256cda5bd0112", + "mean": -0.0038068443536758423, + "std": 5.613907337188721, + "rms": 5.613908290863037, + "max_abs": 1136.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9b740769df1b1713c72c47ee695cd4da886093faba65d4a1df3b2437d11b701b", + "mean": -0.0020501231774687767, + "std": 0.15221937000751495, + "rms": 0.15223316848278046, + "max_abs": 4.4375 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c2d1c7f72eeb39205824d7b1a3d6f280ed3735aa995b320343aef2cf293687cc", + "mean": -0.0038611122872680426, + "std": 5.299835681915283, + "rms": 5.2998366355896, + "max_abs": 1136.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0eb0aadfb3e870ceea03741486b789f6e3c8a12e89391a6a2f33ec295141f87c", + "mean": -0.0020482675172388554, + "std": 0.15064293146133423, + "rms": 0.15065686404705048, + "max_abs": 4.46875 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e3c6c9913824de5d0cacabcd1d658445d682f85b7dea11f479c1869aaceac3d5", + "mean": -0.0038907441776245832, + "std": 5.6138715744018555, + "rms": 5.613872528076172, + "max_abs": 1136.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "42a880c102e9c12f564710f88c4e9581d541fcdfd73411095739a40d78e20ecd", + "mean": -0.0021641235798597336, + "std": 0.15128245949745178, + "rms": 0.1512979418039322, + "max_abs": 4.375 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8ad2eb30f8bfe5d2a8e03be56fae318d870c7b69d157b2d06497655896bbe944", + "mean": -0.003982170019298792, + "std": 5.299809455871582, + "rms": 5.299810409545898, + "max_abs": 1136.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7619796f25f930362588a573dab5a01a941c369aa67123bf1c45e4dac1b57ddd", + "mean": -0.002025193301960826, + "std": 0.15059927105903625, + "rms": 0.15061289072036743, + "max_abs": 4.46875 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e1570c3b39d7400781053fd40422dc5f8c785c6723ace171f5e42593fb8b35e7", + "mean": -0.0038801960181444883, + "std": 5.61386251449585, + "rms": 5.613863468170166, + "max_abs": 1136.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c2e4be6c3c56f178de7fcdb861af2c9dd16262630c9ae95ec2f7f8ba04666ceb", + "mean": -0.0021425068844109774, + "std": 0.15120773017406464, + "rms": 0.15122291445732117, + "max_abs": 4.375 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e88446177b5216ce0a88c9cd1600a9e9790ba2a05ebaab285891cf65b1ec5774", + "mean": -0.003969297744333744, + "std": 5.299800872802734, + "rms": 5.299802303314209, + "max_abs": 1136.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9988664388656616, + "min_cosine_similarity": 0.9910316467285156, + "mean_relative_l2": 0.044549617916345596, + "max_abs_delta": 0.09375 + }, + "system_bos": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9959756135940552, + "min_cosine_similarity": 0.9613170027732849, + "mean_relative_l2": 0.08488837629556656, + "max_abs_delta": 0.25 + }, + "system_x": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9946893453598022, + "min_cosine_similarity": 0.9642188549041748, + "mean_relative_l2": 0.09797769784927368, + "max_abs_delta": 0.205078125 + }, + "system_period": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9949053525924683, + "min_cosine_similarity": 0.9680143594741821, + "mean_relative_l2": 0.09615248441696167, + "max_abs_delta": 0.212890625 + }, + "bos_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9920462369918823, + "min_cosine_similarity": 0.9370954036712646, + "mean_relative_l2": 0.12303648144006729, + "max_abs_delta": 0.3203125 + }, + "bos_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9906198978424072, + "min_cosine_similarity": 0.9653571844100952, + "mean_relative_l2": 0.13512855768203735, + "max_abs_delta": 0.38671875 + }, + "x_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9920623898506165, + "min_cosine_similarity": 0.93813157081604, + "mean_relative_l2": 0.12100708484649658, + "max_abs_delta": 0.35546875 + }, + "x_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9881583452224731, + "min_cosine_similarity": 0.9394081234931946, + "mean_relative_l2": 0.14864572882652283, + "max_abs_delta": 0.48828125 + }, + "period_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.992250382900238, + "min_cosine_similarity": 0.9500299692153931, + "mean_relative_l2": 0.12040475755929947, + "max_abs_delta": 0.36328125 + }, + "period_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9882867336273193, + "min_cosine_similarity": 0.9480363130569458, + "mean_relative_l2": 0.14846301078796387, + "max_abs_delta": 0.4921875 + } + } + }, + "layer_04": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1b5e1c1644c85634bd4e2fa96ea8e6ee4d09ff1c53f96335ebeaa3a8131b3b50", + "mean": -0.0024810326285660267, + "std": 0.1834801882505417, + "rms": 0.18349696695804596, + "max_abs": 5.46875 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ef8aeced6c11a023fb5247200edd77cccd5795b2b6ee76d8f1a9dce7758e3412", + "mean": -0.011857330799102783, + "std": 6.569735527038574, + "rms": 6.569746017456055, + "max_abs": 1152.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f944eb8a3cfbc5be4797e67295c6fb121f8e46ff314a888ec41bb6437868a9aa", + "mean": -0.002498095855116844, + "std": 0.1838986873626709, + "rms": 0.1839156597852707, + "max_abs": 5.375 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4c2e2d5662ce303f6f10a8e4cc3b471fd2a42ef1367c11792a92c3e13334ae16", + "mean": -0.012261820025742054, + "std": 6.391158580780029, + "rms": 6.391170024871826, + "max_abs": 1152.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "403b740ccd7f4be1606032ef805e271ccfb4ef1632cf0a3fb1c3cd848aab975a", + "mean": -0.002738719107583165, + "std": 0.18678830564022064, + "rms": 0.18680837750434875, + "max_abs": 5.625 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2d939de23395abca1cbf5cdea2b9705bb6e5654e261f6de226dc39def6bbb451", + "mean": -0.004311583004891872, + "std": 5.888072967529297, + "rms": 5.8880743980407715, + "max_abs": 1152.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ffc8f2c0f66e17330d357cd922f19010ddf2a42963fcf789b38e5de9668f64ca", + "mean": -0.0027627148665487766, + "std": 0.18677455186843872, + "rms": 0.1867949664592743, + "max_abs": 5.5625 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6a3bf85f4a5898f7b6804b6ebc7e1b61fe4fd6e13d28068953fadacd8262fdb0", + "mean": -0.004304341971874237, + "std": 5.553698539733887, + "rms": 5.5537004470825195, + "max_abs": 1152.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "04ba81886cbbb4f08c20b3660e5fbff5a0bb650b5dee0817cbf55eb57ebb4730", + "mean": -0.002724328078329563, + "std": 0.18488293886184692, + "rms": 0.18490299582481384, + "max_abs": 5.59375 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ea0dc1efcae18f247231d370fd31e981eda203ca96868929d57f60a2e687a711", + "mean": -0.004259445704519749, + "std": 5.888000011444092, + "rms": 5.888000965118408, + "max_abs": 1152.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bcbd2acff05d92f7d03a0cb5bb23fd53ef5bb3e1f3b7039cab1bcddc88a73653", + "mean": -0.002765091136097908, + "std": 0.18544405698776245, + "rms": 0.18546466529369354, + "max_abs": 5.53125 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "601aa27b5fa2b24647294245b06519eff2982a25e8e61b591d815544bfe1605c", + "mean": -0.004284476861357689, + "std": 5.553642749786377, + "rms": 5.553644180297852, + "max_abs": 1152.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6ede8d802e1736f546698286026fff5da6791ab88d85b2d05ec031f0b6af71a2", + "mean": -0.0026825706008821726, + "std": 0.18461167812347412, + "rms": 0.18463116884231567, + "max_abs": 5.5625 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "46d93079b8223c6f9f5addc41ea6d13fa436dd5ed76b9d8651442e72ef473c7a", + "mean": -0.004241119604557753, + "std": 5.887985706329346, + "rms": 5.887986660003662, + "max_abs": 1152.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d43350b27f6fbaca34fcfc99abc219e7eff57c658a01645c5e8c0b024362aa3d", + "mean": -0.002752960892394185, + "std": 0.18523231148719788, + "rms": 0.18525275588035583, + "max_abs": 5.53125 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "919b3331d250693658e2e47d6e8a61930669d2de63afa750737d841aabb1fd23", + "mean": -0.004278490319848061, + "std": 5.553630828857422, + "rms": 5.5536322593688965, + "max_abs": 1152.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9990268349647522, + "min_cosine_similarity": 0.994565486907959, + "mean_relative_l2": 0.041906848549842834, + "max_abs_delta": 0.125 + }, + "system_bos": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9964049458503723, + "min_cosine_similarity": 0.9711805582046509, + "mean_relative_l2": 0.08088288456201553, + "max_abs_delta": 0.278076171875 + }, + "system_x": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9950554370880127, + "min_cosine_similarity": 0.9763650298118591, + "mean_relative_l2": 0.09636443853378296, + "max_abs_delta": 0.205078125 + }, + "system_period": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9951531887054443, + "min_cosine_similarity": 0.9785659313201904, + "mean_relative_l2": 0.09568417072296143, + "max_abs_delta": 0.2265625 + }, + "bos_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9938530921936035, + "min_cosine_similarity": 0.964787483215332, + "mean_relative_l2": 0.11061214655637741, + "max_abs_delta": 0.34375 + }, + "bos_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9922863841056824, + "min_cosine_similarity": 0.9676378965377808, + "mean_relative_l2": 0.12410406768321991, + "max_abs_delta": 0.4375 + }, + "x_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9934976696968079, + "min_cosine_similarity": 0.9557960033416748, + "mean_relative_l2": 0.11068062484264374, + "max_abs_delta": 0.3828125 + }, + "x_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9894388914108276, + "min_cosine_similarity": 0.946610689163208, + "mean_relative_l2": 0.14238505065441132, + "max_abs_delta": 0.515625 + }, + "period_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9934975504875183, + "min_cosine_similarity": 0.9620665311813354, + "mean_relative_l2": 0.11099183559417725, + "max_abs_delta": 0.3671875 + }, + "period_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9894500374794006, + "min_cosine_similarity": 0.956946611404419, + "mean_relative_l2": 0.14281530678272247, + "max_abs_delta": 0.53125 + } + } + }, + "layer_05": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d8e2c5f1882406387f079bea90d59dadea11484b678761414c8b78966556ac62", + "mean": -0.0016584694385528564, + "std": 0.20519371330738068, + "rms": 0.2052004188299179, + "max_abs": 5.71875 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fa49134ab9e88a340eeaa560cd69a1437e207d3f1c32e771f101f29983df4b2a", + "mean": -0.01230314839631319, + "std": 6.770280838012695, + "rms": 6.770291805267334, + "max_abs": 1152.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1320d175ad5a3967c37a5c1849b5eecc0be7c17f185908a216978e8747c9d36a", + "mean": -0.001723561785183847, + "std": 0.20552769303321838, + "rms": 0.2055349051952362, + "max_abs": 5.78125 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f342ce53f291a44a38b67a44d85c8c9590ad0a1f6c3187404d9ee6ca455aaf48", + "mean": -0.012621641159057617, + "std": 6.58876895904541, + "rms": 6.588780879974365, + "max_abs": 1152.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f0110478a0f1a46f116616c2d3d0518743c8dc6c63b1e458abca2c40ea763dba", + "mean": -0.0017872325843200088, + "std": 0.20819422602653503, + "rms": 0.20820188522338867, + "max_abs": 5.8125 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6dc04a6e2fe5b2e5d757331fe8abf09548006cfcdeec49d700ac12de3977359b", + "mean": -0.0038959383964538574, + "std": 5.991711139678955, + "rms": 5.99171257019043, + "max_abs": 1152.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "da43ce204372f280479f020fea2b171e6e4d4c2bee6456ba5879b019eacfa731", + "mean": -0.0018607634119689465, + "std": 0.20770633220672607, + "rms": 0.20771464705467224, + "max_abs": 5.84375 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "700e8d882d6c580d40569bd99c92d322cfb0110be63ead8bc6351147ce694a7a", + "mean": -0.003867719555273652, + "std": 5.650531768798828, + "rms": 5.6505327224731445, + "max_abs": 1152.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "be536375ee0c23f5cd48e097d28ee4814676be61895d08e0ef213e45e41a1a50", + "mean": -0.0018869859632104635, + "std": 0.20689459145069122, + "rms": 0.20690318942070007, + "max_abs": 5.9375 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "19598514894ad9c1e43d7aa2a4619a5764e9d6d5b3e451229abb8110096f1a24", + "mean": -0.003909708932042122, + "std": 5.991650581359863, + "rms": 5.99165153503418, + "max_abs": 1152.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c52c2faf2f8fedef6528a0890ef499788449c689ab26ea0f7902d6322528ef6f", + "mean": -0.0020078520756214857, + "std": 0.20626820623874664, + "rms": 0.2062779814004898, + "max_abs": 5.96875 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0c3c6442b9ad47a92eacc90b8312c6d4adde7b9c49c5b175568181853d4bc835", + "mean": -0.003939204383641481, + "std": 5.650471210479736, + "rms": 5.650472164154053, + "max_abs": 1152.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "342de16a5bfa5bcaa9d10c19ac5e203e68ba14677e7db58bbd0a4f0ed34b85e7", + "mean": -0.0019125378457829356, + "std": 0.20695844292640686, + "rms": 0.2069672793149948, + "max_abs": 5.96875 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f4cdb49af7959ad19ff2e9295a25482749e9e03c3f51c77c59e79530e2ca1acc", + "mean": -0.003932572901248932, + "std": 5.991641044616699, + "rms": 5.991641998291016, + "max_abs": 1152.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "15782305d360e432e7893d71da82cb1e4af6ab71f2e8848ccf5ab39182e56ded", + "mean": -0.0019986715633422136, + "std": 0.20582476258277893, + "rms": 0.20583446323871613, + "max_abs": 6.0 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "771dd3e4612f5c395a2c2f33ef5f70eb65e029ffb7454de8554754eac5a04bf2", + "mean": -0.00395150575786829, + "std": 5.650449752807617, + "rms": 5.650451183319092, + "max_abs": 1152.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.998722493648529, + "min_cosine_similarity": 0.9927221536636353, + "mean_relative_l2": 0.04775160551071167, + "max_abs_delta": 0.203125 + }, + "system_bos": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9956796169281006, + "min_cosine_similarity": 0.9713759422302246, + "mean_relative_l2": 0.08933248370885849, + "max_abs_delta": 0.34375 + }, + "system_x": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9937944412231445, + "min_cosine_similarity": 0.973311722278595, + "mean_relative_l2": 0.10835234820842743, + "max_abs_delta": 0.3203125 + }, + "system_period": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9937615990638733, + "min_cosine_similarity": 0.9750608801841736, + "mean_relative_l2": 0.1084635779261589, + "max_abs_delta": 0.3359375 + }, + "bos_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9934810400009155, + "min_cosine_similarity": 0.974429726600647, + "mean_relative_l2": 0.11350765824317932, + "max_abs_delta": 0.390625 + }, + "bos_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.991587221622467, + "min_cosine_similarity": 0.9596744179725647, + "mean_relative_l2": 0.1283016800880432, + "max_abs_delta": 0.46875 + }, + "x_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.992885947227478, + "min_cosine_similarity": 0.9575899839401245, + "mean_relative_l2": 0.11575352400541306, + "max_abs_delta": 0.5625 + }, + "x_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9880517721176147, + "min_cosine_similarity": 0.9331761598587036, + "mean_relative_l2": 0.15046080946922302, + "max_abs_delta": 0.53125 + }, + "period_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9929401278495789, + "min_cosine_similarity": 0.9647048115730286, + "mean_relative_l2": 0.11609672755002975, + "max_abs_delta": 0.59375 + }, + "period_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9881339073181152, + "min_cosine_similarity": 0.9456541538238525, + "mean_relative_l2": 0.15030452609062195, + "max_abs_delta": 0.498046875 + } + } + }, + "layer_06": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2687dc6cb89328973827d7642a52176d18ee28a3398c609e4200e27e363b4d49", + "mean": -0.0030073849484324455, + "std": 0.2457047551870346, + "rms": 0.245723158121109, + "max_abs": 7.53125 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "93844561e92a1f009f6e7a1fee863fbd2e7c6159369854f4deea27cd7123c9b2", + "mean": -0.013990683481097221, + "std": 6.893036842346191, + "rms": 6.893050670623779, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d75627b8cc6b17e4a3586abfe1d8024494831a6c1ee0d0d09217d7067806257a", + "mean": -0.00312596233561635, + "std": 0.24586495757102966, + "rms": 0.24588483572006226, + "max_abs": 7.5625 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "85378e997eefec900433075a81b402aec6c0b64e050787997f17bf0be1a2bbf5", + "mean": -0.01430341973900795, + "std": 6.7091450691223145, + "rms": 6.709159851074219, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "63a2df09ef35a39aae8560e0b01a188c71e1ca684d331404ba32aa53d4b37cac", + "mean": -0.002841254463419318, + "std": 0.2475014179944992, + "rms": 0.24751773476600647, + "max_abs": 7.5 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5ecbe9e9ad98595ef2173e40e99bbc7c90179bd558d8b35b9b440a3f1069ee41", + "mean": -0.005119259003549814, + "std": 6.087390899658203, + "rms": 6.0873942375183105, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9437074e88f95f0a7684a063c93866d32258a608f2b7028dccdd20574660727c", + "mean": -0.003035046625882387, + "std": 0.24749387800693512, + "rms": 0.24751245975494385, + "max_abs": 7.5625 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "02db538e60fbac3646abfed3728ff3062a3fcd2d78540d7b2c60ea028f3a5544", + "mean": -0.005138964857906103, + "std": 5.74227237701416, + "rms": 5.742274761199951, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "38decabc3bbec74af5aa1123eb64040bc80b446426950956e796e5d845c2b3f2", + "mean": -0.002855760045349598, + "std": 0.24717526137828827, + "rms": 0.24719177186489105, + "max_abs": 7.5625 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cc954e2bcfde9a2ca3e4a7a4059d26e147760afe26680954834aca37c3ed4c27", + "mean": -0.005033185239881277, + "std": 6.087344646453857, + "rms": 6.087346076965332, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "69b89bfc1a3fd46de91a2dcce71309cbca3919f5208db40471f2a3b0bfd02f53", + "mean": -0.003077046014368534, + "std": 0.24599744379520416, + "rms": 0.24601668119430542, + "max_abs": 7.6875 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "31318772fb0427f75edc50eb3cd323b7f1b80e43209e31afca9f8646acc28406", + "mean": -0.005081439856439829, + "std": 5.742188930511475, + "rms": 5.742190837860107, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5df932d230c32c2b85960211c680e985ddb2ebb3ae1c4ed0a4eec5de5c0f047c", + "mean": -0.0029296129941940308, + "std": 0.24693897366523743, + "rms": 0.24695636332035065, + "max_abs": 7.59375 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5f1b1fb9a539148fd0e2c455f06aec8e202541cd6ca80e69fcb6fe83d22305ec", + "mean": -0.005071891471743584, + "std": 6.087328910827637, + "rms": 6.087331771850586, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1f178c66df409c214e49655733e5ee7444e5a2797caec581a737e0ca236f2808", + "mean": -0.0031378334388136864, + "std": 0.24590586125850677, + "rms": 0.2459258735179901, + "max_abs": 7.6875 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e503c9b5872fbdaf5acf2f8d2a1d0deb0fd984c6d001a08213400e48c20274bf", + "mean": -0.005136073566973209, + "std": 5.7421793937683105, + "rms": 5.742181301116943, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9986541271209717, + "min_cosine_similarity": 0.992357611656189, + "mean_relative_l2": 0.04890172928571701, + "max_abs_delta": 0.15625 + }, + "system_bos": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9957531690597534, + "min_cosine_similarity": 0.976182222366333, + "mean_relative_l2": 0.08928949385881424, + "max_abs_delta": 0.53125 + }, + "system_x": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9937794804573059, + "min_cosine_similarity": 0.9755287170410156, + "mean_relative_l2": 0.10888580977916718, + "max_abs_delta": 0.46875 + }, + "system_period": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9937719106674194, + "min_cosine_similarity": 0.9768378138542175, + "mean_relative_l2": 0.10878808796405792, + "max_abs_delta": 0.421875 + }, + "bos_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9941877722740173, + "min_cosine_similarity": 0.975341796875, + "mean_relative_l2": 0.10594172030687332, + "max_abs_delta": 0.4375 + }, + "bos_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9926490783691406, + "min_cosine_similarity": 0.9680474996566772, + "mean_relative_l2": 0.11956249177455902, + "max_abs_delta": 0.46875 + }, + "x_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.993486225605011, + "min_cosine_similarity": 0.9572927951812744, + "mean_relative_l2": 0.11017149686813354, + "max_abs_delta": 0.625 + }, + "x_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.988974928855896, + "min_cosine_similarity": 0.9455299973487854, + "mean_relative_l2": 0.14489340782165527, + "max_abs_delta": 0.625 + }, + "period_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9934402108192444, + "min_cosine_similarity": 0.9615525007247925, + "mean_relative_l2": 0.11091279238462448, + "max_abs_delta": 0.46875 + }, + "period_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9889074563980103, + "min_cosine_similarity": 0.9530739784240723, + "mean_relative_l2": 0.14535768330097198, + "max_abs_delta": 0.546875 + } + } + }, + "layer_07": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "424ad98be5c68d5c17a05d23b850f938b4a601c8357e83227d8a5d8ce8e7a21d", + "mean": -0.0029490303713828325, + "std": 0.2626529633998871, + "rms": 0.26266953349113464, + "max_abs": 7.34375 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6dc374e5b0d75a9bfd9c7d19f9cb86981abb204122df207b88abda8c2f3b3bde", + "mean": -0.01395244151353836, + "std": 6.913416862487793, + "rms": 6.913430690765381, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3492721f83ba422446ec498b74709b0bf37bcde38b07b54b530338a71518132c", + "mean": -0.0030173086561262608, + "std": 0.2633501887321472, + "rms": 0.2633674740791321, + "max_abs": 7.40625 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "70d938bb1d0753ab6d528224df349b701c03ecf0318aa3f462cccc9bdfcd47f0", + "mean": -0.014578565023839474, + "std": 6.729323387145996, + "rms": 6.729339599609375, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0a60c6c933619a2074adf85c19f1e59a6c3ce1eeb9a9109d3ddd5b555b18bbb1", + "mean": -0.0029986421577632427, + "std": 0.26359015703201294, + "rms": 0.2636072039604187, + "max_abs": 7.25 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "38bc7a12381bcc55c84197861af8dd97c9646a1d87f7e3bd06ff3f7c7f67097a", + "mean": -0.00520282844081521, + "std": 6.098881244659424, + "rms": 6.098883628845215, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e32bf08b8badb38408caab321d5390541435250972a7f8dc8e2d12872348007a", + "mean": -0.003031225176528096, + "std": 0.2640767991542816, + "rms": 0.26409420371055603, + "max_abs": 7.375 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6a5e5f192071b7378f637f7ef741db2e3bce97e04d647670218a601e866a1c11", + "mean": -0.005434600170701742, + "std": 5.7532854080200195, + "rms": 5.7532877922058105, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e1601a92d1fdcc4077f846918f01bde0886dde88118254b67871121cbb61a6e1", + "mean": -0.0030036503449082375, + "std": 0.2625865042209625, + "rms": 0.26260367035865784, + "max_abs": 7.40625 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0d3f89845e3f8eee232a1946b11cadcae670f69ecee92ac80c1192497ac50ad9", + "mean": -0.005221914034336805, + "std": 6.098804950714111, + "rms": 6.098806858062744, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "df11b4db2afb9ca8354537034eb7a3e455084a5f2c580e161d9e915e8b5212f8", + "mean": -0.0031309835612773895, + "std": 0.26293808221817017, + "rms": 0.2629567086696625, + "max_abs": 7.5 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "eff615d9a5cf10f69f20a0da04b20710fcfb711e2a3087fdbb9110f974ef261d", + "mean": -0.0054975105449557304, + "std": 5.753209590911865, + "rms": 5.7532124519348145, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c921065fad9f84f71bc0afd773a3c19f1cc82e19016cc5688cbce7addf534091", + "mean": -0.0029957902152091265, + "std": 0.2622874677181244, + "rms": 0.2623045742511749, + "max_abs": 7.3125 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ee1d166e0e545b6c6dc8d76f332042ff32f88fd169c58f876461aa0d1b97d415", + "mean": -0.005132903810590506, + "std": 6.098794460296631, + "rms": 6.0987958908081055, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8edab1163443dfb998571de95ef3698ad00d0c386fff97ecec154bd0e647b747", + "mean": -0.0030884237494319677, + "std": 0.26280340552330017, + "rms": 0.2628215253353119, + "max_abs": 7.5 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "803a3731b15e078da1d713fed1d6d6e02c63e13d06d97a6bc7b35c0e143278cf", + "mean": -0.005415491294115782, + "std": 5.753208160400391, + "rms": 5.75321102142334, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9984689354896545, + "min_cosine_similarity": 0.9926226139068604, + "mean_relative_l2": 0.05224448814988136, + "max_abs_delta": 0.25 + }, + "system_bos": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9952537417411804, + "min_cosine_similarity": 0.9768246412277222, + "mean_relative_l2": 0.09444557875394821, + "max_abs_delta": 0.625 + }, + "system_x": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9931686520576477, + "min_cosine_similarity": 0.9758623838424683, + "mean_relative_l2": 0.11457628011703491, + "max_abs_delta": 0.75 + }, + "system_period": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.993222713470459, + "min_cosine_similarity": 0.9753881692886353, + "mean_relative_l2": 0.11373836547136307, + "max_abs_delta": 0.65625 + }, + "bos_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9937793016433716, + "min_cosine_similarity": 0.9752922654151917, + "mean_relative_l2": 0.1084149181842804, + "max_abs_delta": 0.625 + }, + "bos_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9923049211502075, + "min_cosine_similarity": 0.9668449759483337, + "mean_relative_l2": 0.12127062678337097, + "max_abs_delta": 0.625 + }, + "x_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9928780198097229, + "min_cosine_similarity": 0.9484659433364868, + "mean_relative_l2": 0.11403343826532364, + "max_abs_delta": 0.6875 + }, + "x_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9881783127784729, + "min_cosine_similarity": 0.9347034692764282, + "mean_relative_l2": 0.14944222569465637, + "max_abs_delta": 1.125 + }, + "period_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9929512739181519, + "min_cosine_similarity": 0.9537563323974609, + "mean_relative_l2": 0.11351568251848221, + "max_abs_delta": 0.71875 + }, + "period_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.98818439245224, + "min_cosine_similarity": 0.9447482824325562, + "mean_relative_l2": 0.14933228492736816, + "max_abs_delta": 0.9375 + } + } + }, + "layer_08": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e672be0784f9712d66daa17edbd7a7c204cc038c749a615d081e3cf2f5ad241b", + "mean": -0.00572922732681036, + "std": 0.2981151342391968, + "rms": 0.29817017912864685, + "max_abs": 7.8125 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ca8e6ed80fceff41d7ce1110450816dd0a2d605ce2dd6ea74e233bbceb7fc827", + "mean": -0.01636667549610138, + "std": 6.937502861022949, + "rms": 6.9375224113464355, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "98f4504a9322f9308fd1c72aea14107031c96fa3f94145742b7a0cd59a04b27e", + "mean": -0.005725155584514141, + "std": 0.2991069257259369, + "rms": 0.29916173219680786, + "max_abs": 7.96875 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2fa4002db08ea79bddc1f41dad42cdd98434b9318c09d2ebdd9d9fe10f133bbf", + "mean": -0.016497524455189705, + "std": 6.753163814544678, + "rms": 6.753183841705322, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6c1c0cc576f141b78ae80597d45b8fddc132ff6224d4ebd7195a51f7ca64fe9c", + "mean": -0.005965412128716707, + "std": 0.3005039691925049, + "rms": 0.30056315660476685, + "max_abs": 7.8125 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "49e0e00e2e9e7dd4eac1928bbb68089946e1b13169ed0e09ed0c554e517b393a", + "mean": -0.007809286005795002, + "std": 6.112795829772949, + "rms": 6.1128010749816895, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ddba18ba5d99f6c87176b5f4f55854edf4a2f45597eb8c3e81ce63bc6a4bd0c4", + "mean": -0.006105208303779364, + "std": 0.3026665151119232, + "rms": 0.3027280867099762, + "max_abs": 8.0 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7dcaaec08af9be1b451f06b1b29990d80f656e8d03119b9b1647dfd9f42ef842", + "mean": -0.007691661361604929, + "std": 5.7666192054748535, + "rms": 5.766624927520752, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "18d1f58e7d4f033cf2cb470b810c50ad5d26429b7c2556b6b3593bbb57f5da1d", + "mean": -0.006061225663870573, + "std": 0.29978296160697937, + "rms": 0.29984423518180847, + "max_abs": 8.0 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bc2119ca70c2be7c36b14dcedd78f7259a8978bf5597e3c091464fc7c759d00d", + "mean": -0.007895397953689098, + "std": 6.112740993499756, + "rms": 6.112746238708496, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9a4ccbf87bfffed5ab0c7e1c5a1e150ad5ab18d8a9c68547e3d679dcd84284ce", + "mean": -0.006182849407196045, + "std": 0.30215775966644287, + "rms": 0.30222100019454956, + "max_abs": 8.4375 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "554abe1b75d5bd106d8454f57387fcf51ba173490e3035c9f5ad4de0ee4aa981", + "mean": -0.007699795998632908, + "std": 5.766577243804932, + "rms": 5.766582489013672, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cf1d9207220d4596826cb55ee3dda790a027b2fe4ec89909e72fd9a171a663b2", + "mean": -0.006105782464146614, + "std": 0.29932618141174316, + "rms": 0.29938843846321106, + "max_abs": 8.0625 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e61a137d508d63e07b2b1ae4ac754d05521968495f6ed87a83fe48fcf8472b1b", + "mean": -0.007931613363325596, + "std": 6.112726211547852, + "rms": 6.112731456756592, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4ab5b4b6ba56bec16d9bc1299c6187af871237b1b102c557c6f309d03395b648", + "mean": -0.0062163881957530975, + "std": 0.3015194833278656, + "rms": 0.30158355832099915, + "max_abs": 8.4375 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "86e6c778642d0b30d540241edb90899a11649d68ee58c4732d7b31274dcf1369", + "mean": -0.007691249717026949, + "std": 5.766554832458496, + "rms": 5.766560077667236, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9978504776954651, + "min_cosine_similarity": 0.9898397922515869, + "mean_relative_l2": 0.06041976064443588, + "max_abs_delta": 0.3125 + }, + "system_bos": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9945120811462402, + "min_cosine_similarity": 0.9740538001060486, + "mean_relative_l2": 0.10153069347143173, + "max_abs_delta": 0.5625 + }, + "system_x": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9921198487281799, + "min_cosine_similarity": 0.9663866758346558, + "mean_relative_l2": 0.123087577521801, + "max_abs_delta": 0.8125 + }, + "system_period": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9923723936080933, + "min_cosine_similarity": 0.9764952063560486, + "mean_relative_l2": 0.12074737995862961, + "max_abs_delta": 0.78125 + }, + "bos_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9928606748580933, + "min_cosine_similarity": 0.972001314163208, + "mean_relative_l2": 0.1157849133014679, + "max_abs_delta": 0.71875 + }, + "bos_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.991356611251831, + "min_cosine_similarity": 0.9680136442184448, + "mean_relative_l2": 0.1293911188840866, + "max_abs_delta": 0.65625 + }, + "x_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9918051958084106, + "min_cosine_similarity": 0.9513715505599976, + "mean_relative_l2": 0.12250111997127533, + "max_abs_delta": 0.53125 + }, + "x_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9867761135101318, + "min_cosine_similarity": 0.9395537972450256, + "mean_relative_l2": 0.159341961145401, + "max_abs_delta": 1.21875 + }, + "period_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9919523000717163, + "min_cosine_similarity": 0.9563133716583252, + "mean_relative_l2": 0.12121038883924484, + "max_abs_delta": 0.5 + }, + "period_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9870883226394653, + "min_cosine_similarity": 0.9495311975479126, + "mean_relative_l2": 0.1572568118572235, + "max_abs_delta": 1.09375 + } + } + }, + "layer_09": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0ae3a793d449da18920c823e3832419e4004b47b126a684d0fcd522270c7480c", + "mean": -0.005253441631793976, + "std": 0.3481358289718628, + "rms": 0.3481754660606384, + "max_abs": 11.0625 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "179cf068f1b2a4490e50bc6c028e136ba5ab768ba358815b9bb1e548bc497479", + "mean": -0.015736207365989685, + "std": 6.940224647521973, + "rms": 6.940242290496826, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c444b6250adfec2fe3850767f9361e35a95ab572c691e040baa0fa8bc6da52f2", + "mean": -0.005274406634271145, + "std": 0.3492807447910309, + "rms": 0.34932056069374084, + "max_abs": 11.125 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4451bd02c3a0932291da2adf28f574a1234ed90b71df83e804fa56b3a30e71f7", + "mean": -0.016410216689109802, + "std": 6.755890846252441, + "rms": 6.755910396575928, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8cd147afb11854dcf1dc39f22573414d85ca349309bbfa8b58500bb70aa1905a", + "mean": -0.005639984738081694, + "std": 0.35037603974342346, + "rms": 0.3504214584827423, + "max_abs": 10.75 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6082f45b0cabbd2068a598e4c156c5b01907be1fcc5bdfebf3e30c927069cd42", + "mean": -0.0073905629105865955, + "std": 6.115811824798584, + "rms": 6.115816593170166, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0a624b101fabbc7760c7a198e3489ac1b22e81b04c7499e90ad26d9c896abe79", + "mean": -0.005591204855591059, + "std": 0.35266366600990295, + "rms": 0.35270798206329346, + "max_abs": 11.125 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "019039338baa44d386c771e1c5890e9e96e184e401beb3cd56dea2bc9c71dd5d", + "mean": -0.007662636693567038, + "std": 5.769747734069824, + "rms": 5.7697529792785645, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "dad6209f2a72170ba76f88e57d6bbb4455d8e1119b29cdb64b008645f6236b5e", + "mean": -0.005813478492200375, + "std": 0.3500727713108063, + "rms": 0.35012105107307434, + "max_abs": 11.0 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3f4c0d36659b66a19bcd2bcc0a7503f0070fe9cff989afd95cde665d5a3f54ef", + "mean": -0.007528543472290039, + "std": 6.115774154663086, + "rms": 6.11577844619751, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cf9a34339eec525e859ff4d02d2c56f327f4c9d0663b1519088089e7dccaf9ef", + "mean": -0.005822105798870325, + "std": 0.3525109589099884, + "rms": 0.35255903005599976, + "max_abs": 11.375 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6f2a82b91d2db517fea8d44300601cf1e3f75627620547fbb482c3d449ce4acd", + "mean": -0.007830503396689892, + "std": 5.769704818725586, + "rms": 5.769710540771484, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "eebdcf5c6eff8ae11b36dafba77c251f0aadf707ae0999d93285f648512e049c", + "mean": -0.005927037913352251, + "std": 0.34977611899375916, + "rms": 0.34982630610466003, + "max_abs": 11.125 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ff1497ae28e7623baa140501704cf45aaf03d933d42b6ba41fbd9dfe79f66faf", + "mean": -0.0075250654481351376, + "std": 6.115740776062012, + "rms": 6.1157450675964355, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6f1262321817a4fd2f43792e69902c42b02421c1a60148f2228c1d2e4cb07613", + "mean": -0.005942431278526783, + "std": 0.3517676889896393, + "rms": 0.35181787610054016, + "max_abs": 11.3125 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "dff1cc1ef53cb971de8fb591ab5409c41cd99bdf38f07732dc85f879c19f9e2d", + "mean": -0.007832854054868221, + "std": 5.769653797149658, + "rms": 5.769659519195557, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9979239702224731, + "min_cosine_similarity": 0.9918900728225708, + "mean_relative_l2": 0.05931854620575905, + "max_abs_delta": 0.375 + }, + "system_bos": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9951302409172058, + "min_cosine_similarity": 0.9757516384124756, + "mean_relative_l2": 0.09547333419322968, + "max_abs_delta": 0.75 + }, + "system_x": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9931890964508057, + "min_cosine_similarity": 0.9756157398223877, + "mean_relative_l2": 0.11439388245344162, + "max_abs_delta": 1.125 + }, + "system_period": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9932770729064941, + "min_cosine_similarity": 0.9796955585479736, + "mean_relative_l2": 0.11343645304441452, + "max_abs_delta": 1.1875 + }, + "bos_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9936254024505615, + "min_cosine_similarity": 0.9805798530578613, + "mean_relative_l2": 0.1092313826084137, + "max_abs_delta": 0.8125 + }, + "bos_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9924641847610474, + "min_cosine_similarity": 0.9722732901573181, + "mean_relative_l2": 0.12003786861896515, + "max_abs_delta": 1.0 + }, + "x_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9927719235420227, + "min_cosine_similarity": 0.9631131887435913, + "mean_relative_l2": 0.11510618776082993, + "max_abs_delta": 0.6875 + }, + "x_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.988574743270874, + "min_cosine_similarity": 0.952023446559906, + "mean_relative_l2": 0.14755424857139587, + "max_abs_delta": 1.75 + }, + "period_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9928509593009949, + "min_cosine_similarity": 0.9666690826416016, + "mean_relative_l2": 0.1144760325551033, + "max_abs_delta": 0.625 + }, + "period_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9888275265693665, + "min_cosine_similarity": 0.9597182273864746, + "mean_relative_l2": 0.14561040699481964, + "max_abs_delta": 1.6875 + } + } + }, + "layer_10": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ffcdfdc07485d2f3d75714b00419d6c68c7bbb4f461ebab787f18a172bf2633f", + "mean": -0.0046871621161699295, + "std": 0.3899678885936737, + "rms": 0.3899960517883301, + "max_abs": 11.625 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "dfff3726021722eaadb2199a3c1a4ede41b7f1b4511e70d1e7075fba1f7da3d4", + "mean": -0.01560793723911047, + "std": 6.948079586029053, + "rms": 6.948097229003906, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6630d6f5d887dc7a808e9dfadc734d2dc157e6984b9662a39c1d6e414d410e0b", + "mean": -0.004691531416028738, + "std": 0.39082610607147217, + "rms": 0.39085426926612854, + "max_abs": 11.625 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0fae8b2f4383ca8e5e3781db745cd88a2e781e60179ce1092c998679f1bbc03e", + "mean": -0.01642095483839512, + "std": 6.76351261138916, + "rms": 6.763531684875488, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1f85478fd1d4dfce572c92b76653771b855dffde0eaca5dfecfc2bd250773793", + "mean": -0.004951490554958582, + "std": 0.3911657929420471, + "rms": 0.3911971151828766, + "max_abs": 11.625 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9fdac9455e4340ec34b058c6a5c814d6bfb09562010fa9ad7af822cbbc476234", + "mean": -0.0072418018244206905, + "std": 6.124356269836426, + "rms": 6.124361038208008, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "99c4799d542001e5673fc23cb7d5f2f9a02c55275ad635ca57d4b4c5f180065b", + "mean": -0.00484556844457984, + "std": 0.39245936274528503, + "rms": 0.3924892544746399, + "max_abs": 11.625 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "254f3798b91b69d7417d81276beaef662a2ad6a729148ebda499f2f810814f8f", + "mean": -0.007597674150019884, + "std": 5.778127670288086, + "rms": 5.77813196182251, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5d3fce4a5bd366ae78deb72b24ab203c1543c79316214e6243f720370b534f8b", + "mean": -0.005206821020692587, + "std": 0.390974223613739, + "rms": 0.3910088837146759, + "max_abs": 11.8125 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "16da61368905d28ce72ace339e789e71bf57a32d6659a239ecc282255c266e4f", + "mean": -0.007412804756313562, + "std": 6.124306678771973, + "rms": 6.124311447143555, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a29265e92dd682ae1691208cf1d0765923c993a36266e2dbabb63af078b38260", + "mean": -0.005236056167632341, + "std": 0.39240097999572754, + "rms": 0.3924359083175659, + "max_abs": 11.875 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3cfc6f095bd52103113543c1486751cd5326213933f8443471a30bf528775dfa", + "mean": -0.007890893146395683, + "std": 5.778053283691406, + "rms": 5.778058052062988, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f7e47c36925f66ca21875186485ae3d9445539839f90e5ff731eb089076b0e98", + "mean": -0.005317281000316143, + "std": 0.3904646337032318, + "rms": 0.39050087332725525, + "max_abs": 11.8125 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6d5582477d944a2ab92036e2705b9c039226dba475338d9736c92465ffcb5080", + "mean": -0.0073760817758738995, + "std": 6.124258995056152, + "rms": 6.124264240264893, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a49d4435e805e3d93b2e9f387cb81f986e977e4c536d80cb3e1fddd6a5057572", + "mean": -0.0053627085871994495, + "std": 0.3912576138973236, + "rms": 0.39129436016082764, + "max_abs": 11.875 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1fa3aef53336d3d11e1fb603848a9753749e6edd90828eff0ae8d2c7f653f52f", + "mean": -0.007886094972491264, + "std": 5.777980327606201, + "rms": 5.777985572814941, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9976423978805542, + "min_cosine_similarity": 0.9905320405960083, + "mean_relative_l2": 0.06355271488428116, + "max_abs_delta": 0.375 + }, + "system_bos": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9945402145385742, + "min_cosine_similarity": 0.9758986234664917, + "mean_relative_l2": 0.10065620392560959, + "max_abs_delta": 0.65625 + }, + "system_x": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.992746889591217, + "min_cosine_similarity": 0.9767105579376221, + "mean_relative_l2": 0.11757277697324753, + "max_abs_delta": 0.9375 + }, + "system_period": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9926813840866089, + "min_cosine_similarity": 0.9769675135612488, + "mean_relative_l2": 0.11746227741241455, + "max_abs_delta": 0.9375 + }, + "bos_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9928244352340698, + "min_cosine_similarity": 0.9789261817932129, + "mean_relative_l2": 0.11544682830572128, + "max_abs_delta": 0.75 + }, + "bos_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9918463230133057, + "min_cosine_similarity": 0.9688334465026855, + "mean_relative_l2": 0.12396927922964096, + "max_abs_delta": 1.0 + }, + "x_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9920899868011475, + "min_cosine_similarity": 0.9692872166633606, + "mean_relative_l2": 0.12102805078029633, + "max_abs_delta": 0.71875 + }, + "x_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9877268671989441, + "min_cosine_similarity": 0.9512993097305298, + "mean_relative_l2": 0.1522609293460846, + "max_abs_delta": 1.625 + }, + "period_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9922253489494324, + "min_cosine_similarity": 0.9673396348953247, + "mean_relative_l2": 0.11929835379123688, + "max_abs_delta": 0.5625 + }, + "period_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9881616234779358, + "min_cosine_similarity": 0.9616526365280151, + "mean_relative_l2": 0.1490638256072998, + "max_abs_delta": 1.375 + } + } + }, + "layer_11": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b3d4824fcb7efff6c4596ca0a960f9955acda0d09cda2cd70794aab01d617033", + "mean": -0.009379766881465912, + "std": 0.4793906509876251, + "rms": 0.47948241233825684, + "max_abs": 15.3125 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d639a3cb5dff0674de64432b0e904a06cc4ee9c886efbc2374ad82a108cd46e5", + "mean": -0.019004134461283684, + "std": 6.989168643951416, + "rms": 6.989194393157959, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "387eaf55dc88a1202fd9fe6d3195977b09a82f56f319d68dfc37edb76cdce6ad", + "mean": -0.009286878630518913, + "std": 0.47897711396217346, + "rms": 0.4790671467781067, + "max_abs": 15.4375 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8a9ba11c0030d7a695ac92115dba0156be51ff7f1da70fd2553126e7ec652d12", + "mean": -0.01943803019821644, + "std": 6.802736282348633, + "rms": 6.802763938903809, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ef5aaac57bfdf49f3269cb453581a12bbf6c1a18a9e2ad11b8dc8260d26a0203", + "mean": -0.00950761791318655, + "std": 0.48127225041389465, + "rms": 0.4813661575317383, + "max_abs": 15.25 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "151ac62b7b2ed6e40383dd749d987811e936dd86e0de0dc5f8e4ddbed89876d4", + "mean": -0.010504301637411118, + "std": 6.159126281738281, + "rms": 6.159135341644287, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0603b27060977ff031703f51ab029fff0aba2571bd6fd73b326a65a6862e17f2", + "mean": -0.009361736476421356, + "std": 0.4811488389968872, + "rms": 0.481239914894104, + "max_abs": 15.375 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d1b9750dd5096ed33a4bc26de8b4d075764a0fd66e2d3373c7a46466f3f1711c", + "mean": -0.010516677983105183, + "std": 5.811446189880371, + "rms": 5.811455726623535, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a5153407e8cb96db56c8130e291829ad6085b78723296083246c8ad9c3a5d511", + "mean": -0.009793182834982872, + "std": 0.48056188225746155, + "rms": 0.48066166043281555, + "max_abs": 15.8125 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e25a08c82dccba106381d09cc77d9b0894d17dca1988809e959406d65d2a8fa4", + "mean": -0.010636928491294384, + "std": 6.159049034118652, + "rms": 6.159058094024658, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "58e6bc3886f462bbc35bc94748cd493cc4f83114162aafdc0e51e94d3920b220", + "mean": -0.009661679156124592, + "std": 0.47849106788635254, + "rms": 0.4785885810852051, + "max_abs": 15.875 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a2f43aa3ffc5c949c13cc80e3df2655e73833067f49d0242c30204a7df23b5fc", + "mean": -0.010664736852049828, + "std": 5.811169147491455, + "rms": 5.811179161071777, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4433b07a01fc93d254a129cdc38f1a06379bf49b2350aaf2c3a912e20b106726", + "mean": -0.010012253187596798, + "std": 0.4788285493850708, + "rms": 0.478933185338974, + "max_abs": 15.75 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ebae36ece9584f886376230b15713a538bdce023451062b458a1f0feeaaef84b", + "mean": -0.01070733554661274, + "std": 6.158899784088135, + "rms": 6.158908843994141, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c2897d9fbe5fa6a3eea297e844bde4eac0f8dc084fa32ba93daa72cc6d646c04", + "mean": -0.009787406772375107, + "std": 0.47733554244041443, + "rms": 0.4774358570575714, + "max_abs": 15.5625 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b9e81df463f2b1f3c1ff078d0fa4741de08324f719afec029c893f06d9de7d73", + "mean": -0.010624894872307777, + "std": 5.8110785484313965, + "rms": 5.811088562011719, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9976889491081238, + "min_cosine_similarity": 0.9908194541931152, + "mean_relative_l2": 0.0634516179561615, + "max_abs_delta": 0.5 + }, + "system_bos": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9950953722000122, + "min_cosine_similarity": 0.9707736968994141, + "mean_relative_l2": 0.0952104926109314, + "max_abs_delta": 0.75 + }, + "system_x": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9936835169792175, + "min_cosine_similarity": 0.9794391393661499, + "mean_relative_l2": 0.10988527536392212, + "max_abs_delta": 1.125 + }, + "system_period": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9932631254196167, + "min_cosine_similarity": 0.9787676930427551, + "mean_relative_l2": 0.11301791667938232, + "max_abs_delta": 1.125 + }, + "bos_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9936884641647339, + "min_cosine_similarity": 0.9781694412231445, + "mean_relative_l2": 0.10835447907447815, + "max_abs_delta": 0.75 + }, + "bos_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9926816821098328, + "min_cosine_similarity": 0.9677563905715942, + "mean_relative_l2": 0.11749318987131119, + "max_abs_delta": 0.9375 + }, + "x_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.993148684501648, + "min_cosine_similarity": 0.9774806499481201, + "mean_relative_l2": 0.113218292593956, + "max_abs_delta": 0.75 + }, + "x_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9893600940704346, + "min_cosine_similarity": 0.9576194286346436, + "mean_relative_l2": 0.1422211080789566, + "max_abs_delta": 1.25 + }, + "period_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9932387471199036, + "min_cosine_similarity": 0.9785710573196411, + "mean_relative_l2": 0.11184001713991165, + "max_abs_delta": 0.8125 + }, + "period_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9895634651184082, + "min_cosine_similarity": 0.9664546251296997, + "mean_relative_l2": 0.14057321846485138, + "max_abs_delta": 1.1875 + } + } + }, + "layer_12": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "08dd55157cec6397ee26d503f10be9e33755e659ce6a12030c624ca4822448b9", + "mean": -0.010701213032007217, + "std": 0.5040990710258484, + "rms": 0.5042126178741455, + "max_abs": 14.875 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "77d2295cfccc4c4e2959186626af330e873ae854018c4b7a2cf2082fd9520077", + "mean": -0.02055356837809086, + "std": 7.038413047790527, + "rms": 7.038443088531494, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a1803cf211f43055beb3f782f78ec573dbb0634ec4e8ca2d82bfed02cba53b6d", + "mean": -0.010424542240798473, + "std": 0.5037732124328613, + "rms": 0.50388103723526, + "max_abs": 15.125 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6322c9f6c74f65aa04f45c114286b5805ab09acd1a77f873104c1f8d5f22d551", + "mean": -0.020372511819005013, + "std": 6.852925777435303, + "rms": 6.852956295013428, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8b09cd9db58a6e7609f90fb0d397cb53b4d379d3aeecb932f50f07acd0e31494", + "mean": -0.010749246925115585, + "std": 0.506001889705658, + "rms": 0.5061160326004028, + "max_abs": 15.125 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "387c7e20e175801794264279332bffd851bc4ac59103b792105af8e8e7c3b73b", + "mean": -0.011816967278718948, + "std": 6.170841693878174, + "rms": 6.170853137969971, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "52cbe5a861004dcb86d35152decd76992c62462313ca60365d41aa3113817562", + "mean": -0.010601038113236427, + "std": 0.5058470964431763, + "rms": 0.5059581398963928, + "max_abs": 15.125 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5ca3a41ede2e3f9ba0e241edbef33cc54bcd1dc2ed96881c005a069be64cf768", + "mean": -0.011512210592627525, + "std": 5.823177337646484, + "rms": 5.823188781738281, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d994fef2ecadd381bd9dbbc08409dce8b55708d353205de3bb15bb3982e8ad0f", + "mean": -0.01100162137299776, + "std": 0.5056166648864746, + "rms": 0.5057363510131836, + "max_abs": 15.125 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f8effe249665364a7166a2a0b80165ea850679812318b5bc9bc5e7024bc00cf4", + "mean": -0.012162677943706512, + "std": 6.170792102813721, + "rms": 6.170804500579834, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e51cd7a4aa28028ae5a45323a16bfe4c2c8fbce199102263db48d1878a3be9ab", + "mean": -0.010916327126324177, + "std": 0.5036554932594299, + "rms": 0.5037737488746643, + "max_abs": 15.125 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "98cf675fec0c684efb0a293010f4acc39f09456a44c9929be9801a36714a24de", + "mean": -0.011770504526793957, + "std": 5.822841644287109, + "rms": 5.822853088378906, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6a5cf625575e818fc9fcd8577d475ec11aa93a4ce3632269f8914c2ee9684af6", + "mean": -0.011178595945239067, + "std": 0.5048644542694092, + "rms": 0.5049881935119629, + "max_abs": 15.25 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5e3eee56be527e635b64c7d8594c0841dc26b5dce488a459c4e3c9869a058e53", + "mean": -0.012116225436329842, + "std": 6.170677661895752, + "rms": 6.170689582824707, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fd36e8338c990616f139f47ef3872868ab4a705ac9da4e488e06bd52997a2da6", + "mean": -0.010927660390734673, + "std": 0.5033067464828491, + "rms": 0.5034253597259521, + "max_abs": 15.1875 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9d98435b84510c087ce497e652f72c14f1c8727b02a60d11958175d7afccc70d", + "mean": -0.011553846299648285, + "std": 5.822834491729736, + "rms": 5.822846412658691, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9973759055137634, + "min_cosine_similarity": 0.987407922744751, + "mean_relative_l2": 0.06771058589220047, + "max_abs_delta": 0.4375 + }, + "system_bos": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9947676658630371, + "min_cosine_similarity": 0.9701840877532959, + "mean_relative_l2": 0.09892290830612183, + "max_abs_delta": 1.125 + }, + "system_x": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9931865334510803, + "min_cosine_similarity": 0.9774331450462341, + "mean_relative_l2": 0.11406180262565613, + "max_abs_delta": 1.375 + }, + "system_period": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9928735494613647, + "min_cosine_similarity": 0.9764383435249329, + "mean_relative_l2": 0.11628706753253937, + "max_abs_delta": 0.921875 + }, + "bos_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9930899739265442, + "min_cosine_similarity": 0.9772330522537231, + "mean_relative_l2": 0.11353044956922531, + "max_abs_delta": 1.0 + }, + "bos_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9921938180923462, + "min_cosine_similarity": 0.9669166803359985, + "mean_relative_l2": 0.12142741680145264, + "max_abs_delta": 1.3125 + }, + "x_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9926567673683167, + "min_cosine_similarity": 0.9770681858062744, + "mean_relative_l2": 0.1172279343008995, + "max_abs_delta": 1.25 + }, + "x_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.988714337348938, + "min_cosine_similarity": 0.9545091390609741, + "mean_relative_l2": 0.1468079537153244, + "max_abs_delta": 1.8125 + }, + "period_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9926753044128418, + "min_cosine_similarity": 0.9781772494316101, + "mean_relative_l2": 0.1167917400598526, + "max_abs_delta": 1.3125 + }, + "period_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9888242483139038, + "min_cosine_similarity": 0.9660049676895142, + "mean_relative_l2": 0.14584055542945862, + "max_abs_delta": 1.875 + } + } + }, + "layer_13": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8f41b5d6bd138faee9a94639a104a930d70ff4879c88316124bfff044cd554ed", + "mean": -0.011637426912784576, + "std": 0.5295923948287964, + "rms": 0.5297202467918396, + "max_abs": 16.5 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9493194a186aab9b2ba5947d0e5546224aaf88bbb79f3741dfde7da70ad049c2", + "mean": -0.021265460178256035, + "std": 7.045016288757324, + "rms": 7.045048713684082, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5d0ac5b4babf530d341b68642ba416e60bafe8f70c83684cf619e887924c6f50", + "mean": -0.011390960775315762, + "std": 0.5290701389312744, + "rms": 0.5291927456855774, + "max_abs": 16.875 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "73559c9c178939865a18d7a7675763726292cbeced639835600b2750e4975af9", + "mean": -0.021527927368879318, + "std": 6.859773635864258, + "rms": 6.859807014465332, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "82c3f4d77ec5ef67d71f8e27edad66b3a524457a63af60098b0274ca790b5e39", + "mean": -0.01177380234003067, + "std": 0.5315490961074829, + "rms": 0.5316795110702515, + "max_abs": 16.5 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "460ccd50ebd4a5d57dea587c182e76e0a8b896e6210d0c26b7ba0162af7a885b", + "mean": -0.012598621658980846, + "std": 6.176937580108643, + "rms": 6.176950931549072, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9d73b2d3f701c5833afbfe9e979d8d3efe644577b2febcb0f297f89bf7558515", + "mean": -0.011508996598422527, + "std": 0.5307456851005554, + "rms": 0.5308704972267151, + "max_abs": 16.625 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3b933cf5f2621f4322fbb5b19e9ca732dd6519ade79afd5b43c249d1d575fd74", + "mean": -0.012570835649967194, + "std": 5.829607009887695, + "rms": 5.829619884490967, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b3769c372ac8b2a8422ea00558959677a3ba24070d1870fe97e69072cd51620b", + "mean": -0.011891336180269718, + "std": 0.5304832458496094, + "rms": 0.5306165218353271, + "max_abs": 16.375 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2f8f7c1eb982f2f300461da38261e2ec28b31ae0578370c07e50d13d7b212d4b", + "mean": -0.012913004495203495, + "std": 6.1768999099731445, + "rms": 6.176913261413574, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b628570fe9194ac790b155699e39d54610b70f2be2d1f30ee704a3b8595bdfc3", + "mean": -0.011855179443955421, + "std": 0.5293829441070557, + "rms": 0.5295156836509705, + "max_abs": 16.5 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "898b7696a9033d52f063924298a4e9faec8bc174aa95c7621d489726abc5fe8a", + "mean": -0.012876469641923904, + "std": 5.829358100891113, + "rms": 5.829371929168701, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f3d47521e9795016d80759b1843f28a93cd21dc039097e0a08c9caf1e1f100e1", + "mean": -0.012082398869097233, + "std": 0.5300137996673584, + "rms": 0.5301515460014343, + "max_abs": 16.375 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fb1ffbe33daab88a02149c312c4d9251d945d86bac74ec76b9f16065da4f4a3b", + "mean": -0.01285542268306017, + "std": 6.176792144775391, + "rms": 6.1768059730529785, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1b89ce1ee19583c02f1aa8ea716c4aa7d2d83ee802ca69568ff41778a2111f4b", + "mean": -0.011838573031127453, + "std": 0.5284451246261597, + "rms": 0.5285777449607849, + "max_abs": 16.25 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8467be7b8c1bd618ed7aa20c842524392745d8dcbc5932fc99d70ecefb389c67", + "mean": -0.012697331607341766, + "std": 5.829311847686768, + "rms": 5.8293256759643555, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9973422288894653, + "min_cosine_similarity": 0.9885382056236267, + "mean_relative_l2": 0.06896618008613586, + "max_abs_delta": 0.5 + }, + "system_bos": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9948363900184631, + "min_cosine_similarity": 0.9729360342025757, + "mean_relative_l2": 0.09837346524000168, + "max_abs_delta": 1.3125 + }, + "system_x": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9932426810264587, + "min_cosine_similarity": 0.9793205857276917, + "mean_relative_l2": 0.11355433613061905, + "max_abs_delta": 1.125 + }, + "system_period": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.993194580078125, + "min_cosine_similarity": 0.9771559834480286, + "mean_relative_l2": 0.11368115991353989, + "max_abs_delta": 0.9375 + }, + "bos_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.993220865726471, + "min_cosine_similarity": 0.9723426103591919, + "mean_relative_l2": 0.1126696765422821, + "max_abs_delta": 1.4375 + }, + "bos_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9923928380012512, + "min_cosine_similarity": 0.9698810577392578, + "mean_relative_l2": 0.12010140717029572, + "max_abs_delta": 2.125 + }, + "x_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9927011728286743, + "min_cosine_similarity": 0.9739219546318054, + "mean_relative_l2": 0.11694912612438202, + "max_abs_delta": 1.875 + }, + "x_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9890157580375671, + "min_cosine_similarity": 0.9568765163421631, + "mean_relative_l2": 0.14504966139793396, + "max_abs_delta": 2.4375 + }, + "period_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9926944971084595, + "min_cosine_similarity": 0.9755662083625793, + "mean_relative_l2": 0.11682508885860443, + "max_abs_delta": 1.875 + }, + "period_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9891096949577332, + "min_cosine_similarity": 0.9652802348136902, + "mean_relative_l2": 0.1443847268819809, + "max_abs_delta": 2.625 + } + } + }, + "layer_14": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "baf5669f991df2593bd77c1fc4a0c8be5c7032d17b948b53804631b8989dfed4", + "mean": -0.011740018613636494, + "std": 0.6184245944023132, + "rms": 0.6185359954833984, + "max_abs": 18.125 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "82db9a51d613dffb16fa8fa4c4df7fee3ea65241ce8e86cd03d703a4175a91ee", + "mean": -0.02094406448304653, + "std": 7.063847064971924, + "rms": 7.063877582550049, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "94e991447b28f0cfa6631de93efd1241748b80b38714346a5705053a6c3de2a5", + "mean": -0.01156668271869421, + "std": 0.6184132695198059, + "rms": 0.6185214519500732, + "max_abs": 18.375 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "de6d7dd378f9ee30d0067bcbecb07e71ceda1a8e3df6a3eba7446d852d70834b", + "mean": -0.021484004333615303, + "std": 6.87725830078125, + "rms": 6.877292156219482, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "91c0366b4ec985d8c8335a2300a2fe1128fe3aa2fedddb18718d4463d475b395", + "mean": -0.011929967440664768, + "std": 0.6209437251091003, + "rms": 0.6210582852363586, + "max_abs": 18.0 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c782ae13cdd3e07289a2c5f97db38945bc70d73d30de1dae7ea07e909e7c4039", + "mean": -0.012349874712526798, + "std": 6.197612762451172, + "rms": 6.197624683380127, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "33dee5effe5e918743a94164523282b0a480c3b62cc1cb132965237506670636", + "mean": -0.011831722222268581, + "std": 0.6194081902503967, + "rms": 0.6195212006568909, + "max_abs": 18.25 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5f8b9b11cb6d9a57c05bea45724023c491d3af0d0569c50172dfc56711e21538", + "mean": -0.012577692978084087, + "std": 5.849313735961914, + "rms": 5.849327087402344, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d83c2cf3eed66c036fd72c50c80da572d7fa51986157574225faf766e52dd702", + "mean": -0.012110944837331772, + "std": 0.6182519793510437, + "rms": 0.6183705925941467, + "max_abs": 18.375 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3e26550ee7a5da8f9287b2f0147929d6921f704a4db6adf8c2dc744cf63edcb0", + "mean": -0.012703944928944111, + "std": 6.197488784790039, + "rms": 6.197501182556152, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c24e7d5e1c821772b5d3307e2facdf58ebae33ef58507d510f837e152ee02164", + "mean": -0.012292392551898956, + "std": 0.6165212392807007, + "rms": 0.6166437864303589, + "max_abs": 18.625 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "051d48a81a93f94c2cf5acb354f8d792563112b3ea7e290061c9c3d6b37d6fb5", + "mean": -0.01298451703041792, + "std": 5.848990440368652, + "rms": 5.849005222320557, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1f4da6f9864c0425694f75b61d7ac506e0343159bd63aeff1992053a17b906c0", + "mean": -0.012171624228358269, + "std": 0.6187210083007812, + "rms": 0.6188406944274902, + "max_abs": 18.125 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3a332829d4edec4ff1370719da8389a42d3e629314a58a34133bb136528391f1", + "mean": -0.012550980783998966, + "std": 6.197427749633789, + "rms": 6.1974406242370605, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "caccf74f028dbe68811d93bddcc3fabd55f4eabadc26deccc309bc749070d446", + "mean": -0.012212594039738178, + "std": 0.6158651113510132, + "rms": 0.615986168384552, + "max_abs": 18.5 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "362fccffeb78ff7895f76228991f848aa0d809ebbfb727377b2a5cd5b887d0d9", + "mean": -0.0128233153373003, + "std": 5.848907470703125, + "rms": 5.848921775817871, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9974645972251892, + "min_cosine_similarity": 0.9909155964851379, + "mean_relative_l2": 0.06785790622234344, + "max_abs_delta": 0.5625 + }, + "system_bos": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9952451586723328, + "min_cosine_similarity": 0.9764267802238464, + "mean_relative_l2": 0.09446680545806885, + "max_abs_delta": 1.0625 + }, + "system_x": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9936268925666809, + "min_cosine_similarity": 0.9806174039840698, + "mean_relative_l2": 0.11042901873588562, + "max_abs_delta": 1.1875 + }, + "system_period": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9935499429702759, + "min_cosine_similarity": 0.9771431684494019, + "mean_relative_l2": 0.11067378520965576, + "max_abs_delta": 1.109375 + }, + "bos_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9937475919723511, + "min_cosine_similarity": 0.9715599417686462, + "mean_relative_l2": 0.10838599503040314, + "max_abs_delta": 1.625 + }, + "bos_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9930229783058167, + "min_cosine_similarity": 0.9732204675674438, + "mean_relative_l2": 0.11494994908571243, + "max_abs_delta": 2.3125 + }, + "x_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.993337094783783, + "min_cosine_similarity": 0.9720900058746338, + "mean_relative_l2": 0.11140212416648865, + "max_abs_delta": 2.1875 + }, + "x_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9897341728210449, + "min_cosine_similarity": 0.9607683420181274, + "mean_relative_l2": 0.13958321511745453, + "max_abs_delta": 2.6875 + }, + "period_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9933035373687744, + "min_cosine_similarity": 0.9751104116439819, + "mean_relative_l2": 0.1116604208946228, + "max_abs_delta": 2.0 + }, + "period_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9898687601089478, + "min_cosine_similarity": 0.9651419520378113, + "mean_relative_l2": 0.13873307406902313, + "max_abs_delta": 2.875 + } + } + }, + "layer_15": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "51107489cbc7c73dd8d84b97194c8712e01e97f36280d27722c431ea92300b4d", + "mean": -0.015953967347741127, + "std": 0.6907501816749573, + "rms": 0.6909343600273132, + "max_abs": 22.0 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8474c2198cee89c85ac7bd796224a0c6a6d44a8fa350cea11e00c686a9ede955", + "mean": -0.024002805352211, + "std": 7.073402404785156, + "rms": 7.073443412780762, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1fa741d687581fa71324873801fda026d3d051fcc7efb535804b70f6f912ba56", + "mean": -0.015760507434606552, + "std": 0.6896371245384216, + "rms": 0.6898171901702881, + "max_abs": 21.75 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "229341ab392ce2d0f2e6737ed0b39ab0ae453c8eea92213f3b07ef6061188395", + "mean": -0.024506358429789543, + "std": 6.887209892272949, + "rms": 6.887253761291504, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f83bdeb21c1c48d3f862118a70c8a05b14a6e4b4319cc04f41dff0b34104faf4", + "mean": -0.016127578914165497, + "std": 0.6933900117874146, + "rms": 0.6935775279998779, + "max_abs": 22.25 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "00fbb4dab6f81e770961be74cce45c72ede04d42f842635be78230ebdd308800", + "mean": -0.015459075570106506, + "std": 6.207983016967773, + "rms": 6.20800256729126, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "da99d943ab1a09972f2c8de4e46f48e642331b15495006481328cb931f5877ec", + "mean": -0.016129713505506516, + "std": 0.6913207769393921, + "rms": 0.691508948802948, + "max_abs": 22.25 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c03692faec96aac7c739fcc76ef06a5de855a8f2910071d5affd4f958ecfd789", + "mean": -0.015741141512989998, + "std": 5.860284805297852, + "rms": 5.8603057861328125, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b1c7a6c8f841df12b9e6ccb810805599e8ea85fe3e110a637b42ffc875484fab", + "mean": -0.01651676557958126, + "std": 0.690993070602417, + "rms": 0.6911904215812683, + "max_abs": 22.25 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "859ba25d94593d93196ff494538e03a2590237ffd258154b624409a659b03546", + "mean": -0.015947405248880386, + "std": 6.207863807678223, + "rms": 6.207884311676025, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d554f0fa300a93f67d5d8f442d36ae240fd8237911deb825b93dda82f7edf3df", + "mean": -0.016947157680988312, + "std": 0.6880207061767578, + "rms": 0.6882293820381165, + "max_abs": 21.875 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1297f72822f7d3aefd045fa0541cdc056ec0770b5d9ea10b16ff94d225f2be3a", + "mean": -0.016327042132616043, + "std": 5.859884262084961, + "rms": 5.859907627105713, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f2743d9e4584d0c416cea15cf95cc84dbf60dd806ddbbf9a5eeee5c1b459ba88", + "mean": -0.01662125252187252, + "std": 0.6914042234420776, + "rms": 0.69160395860672, + "max_abs": 22.375 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c4f4fa35c458772ffc22d0086cb63b9bef4702493ab96c5bf795e4bae324dd53", + "mean": -0.015806205570697784, + "std": 6.207798480987549, + "rms": 6.20781946182251, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "55f9656c835c206d710ba821869f05ec7bc02989c324d1fe3e5cc52d421cf9b6", + "mean": -0.01693127118051052, + "std": 0.6873903274536133, + "rms": 0.6875988245010376, + "max_abs": 22.0 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4edf8fdccf6a7bd6f934f477dec715b318211ff5750d1be6d9c721814dfeabc9", + "mean": -0.016174839809536934, + "std": 5.859809875488281, + "rms": 5.859832286834717, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.997488796710968, + "min_cosine_similarity": 0.9913253784179688, + "mean_relative_l2": 0.06752272695302963, + "max_abs_delta": 0.625 + }, + "system_bos": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9954224228858948, + "min_cosine_similarity": 0.9768766164779663, + "mean_relative_l2": 0.09264790266752243, + "max_abs_delta": 1.4375 + }, + "system_x": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9939083456993103, + "min_cosine_similarity": 0.9812502861022949, + "mean_relative_l2": 0.1080431118607521, + "max_abs_delta": 1.5625 + }, + "system_period": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.993707001209259, + "min_cosine_similarity": 0.9759143590927124, + "mean_relative_l2": 0.10913312435150146, + "max_abs_delta": 1.5 + }, + "bos_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9941937327384949, + "min_cosine_similarity": 0.9711694717407227, + "mean_relative_l2": 0.1044728010892868, + "max_abs_delta": 1.75 + }, + "bos_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9933918118476868, + "min_cosine_similarity": 0.9737443923950195, + "mean_relative_l2": 0.11172930151224136, + "max_abs_delta": 2.625 + }, + "x_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9937061071395874, + "min_cosine_similarity": 0.9703841209411621, + "mean_relative_l2": 0.10819942504167557, + "max_abs_delta": 2.25 + }, + "x_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9902028441429138, + "min_cosine_similarity": 0.9653347730636597, + "mean_relative_l2": 0.13630430400371552, + "max_abs_delta": 3.125 + }, + "period_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.993668258190155, + "min_cosine_similarity": 0.9742269515991211, + "mean_relative_l2": 0.10862668603658676, + "max_abs_delta": 2.0625 + }, + "period_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9902489185333252, + "min_cosine_similarity": 0.9668760895729065, + "mean_relative_l2": 0.13596172630786896, + "max_abs_delta": 3.375 + } + } + }, + "layer_16": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "768c4e9e6efe7de2fa00e1f1c9e6efa3e9ff77b9486bbb6a1880983e084d7421", + "mean": -0.017474422231316566, + "std": 0.7914940118789673, + "rms": 0.7916868925094604, + "max_abs": 25.125 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c892b1c40264e3147ad5a2ea425989b67f7ebc8af9b6f143a73b841ccd39d624", + "mean": -0.025069585070014, + "std": 7.086719036102295, + "rms": 7.08676290512085, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "303beb1c54a0386c5bcc5156b9a683a302bb44148aa770eee2120f8fc346a123", + "mean": -0.017432324588298798, + "std": 0.791316032409668, + "rms": 0.7915080189704895, + "max_abs": 25.875 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "498d1f417b9ed31b07a5045799c309c915a37947154a9495065e9982d71fca06", + "mean": -0.02537098340690136, + "std": 6.900440692901611, + "rms": 6.900487422943115, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "036bf08373bb92d5cefe4a31509bd85ea6aa54949ccf84c611ff51786cdcfb0b", + "mean": -0.017557619139552116, + "std": 0.7926464676856995, + "rms": 0.7928408980369568, + "max_abs": 24.625 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cca05d8e79ed0c2b273fcae09b9fe902ab7d1fa4fae84c973194a6527459ed93", + "mean": -0.01640835590660572, + "std": 6.222057819366455, + "rms": 6.222079753875732, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "38ea0f38de0c99c04d6f2db5087bc8315bf04b39b95e127e8b58499bcf384993", + "mean": -0.01790175959467888, + "std": 0.7906455993652344, + "rms": 0.7908481955528259, + "max_abs": 24.875 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e1555d1a0ce8c6458300766fdad78b3600fd8c77ac3d3b39fc81dc3523a48cc8", + "mean": -0.01659010909497738, + "std": 5.874813556671143, + "rms": 5.8748369216918945, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "23552642619b42c10c5c067b857f95e164b2faa427211b896f42a08cfa7b320d", + "mean": -0.01837625354528427, + "std": 0.7904047966003418, + "rms": 0.790618360042572, + "max_abs": 24.875 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "99a139ed6c252d1c39f472c93544c4b8b1262019275503b29c785392e6b731aa", + "mean": -0.01723696105182171, + "std": 6.222066402435303, + "rms": 6.222089767456055, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1a91b09aae0d2de8ac6c6a30a40b899fc0840dcbed7ef971afd265e5e5cf86a2", + "mean": -0.019184675067663193, + "std": 0.7883893251419067, + "rms": 0.7886226773262024, + "max_abs": 24.5 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5e8f1269218e33e7cad95821f4ad83af095e3cbf61212fa2ba701e3fa4a5b6db", + "mean": -0.017577189952135086, + "std": 5.874645233154297, + "rms": 5.874671459197998, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ad784c5705061e3964f60dcc8b3c6498ba26b3d805d706ca19962b77e1e7faea", + "mean": -0.018267584964632988, + "std": 0.7909691333770752, + "rms": 0.7911800742149353, + "max_abs": 25.0 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d65266c22c29fe1cd77f522bb745d658cee0a2c0ac13fb42392966241456c55b", + "mean": -0.016885807737708092, + "std": 6.221900463104248, + "rms": 6.221922874450684, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c8bf336ddcb5f35427d618949c44b9cdddd93003c93c57b8616ba88aa3503888", + "mean": -0.019045429304242134, + "std": 0.7880802750587463, + "rms": 0.7883103489875793, + "max_abs": 24.75 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8cb331e3bb1506d31d9cc4290b5794f38ca30467508ab0840a4b1bb7533695ff", + "mean": -0.017222842201590538, + "std": 5.874454975128174, + "rms": 5.874480247497559, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9975440502166748, + "min_cosine_similarity": 0.9901691675186157, + "mean_relative_l2": 0.06681011617183685, + "max_abs_delta": 0.75 + }, + "system_bos": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9955072999000549, + "min_cosine_similarity": 0.9801681041717529, + "mean_relative_l2": 0.09171741455793381, + "max_abs_delta": 1.5 + }, + "system_x": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.99410080909729, + "min_cosine_similarity": 0.980288028717041, + "mean_relative_l2": 0.10612577199935913, + "max_abs_delta": 1.75 + }, + "system_period": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9938421249389648, + "min_cosine_similarity": 0.9762542843818665, + "mean_relative_l2": 0.10774140805006027, + "max_abs_delta": 1.625 + }, + "bos_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.99428790807724, + "min_cosine_similarity": 0.964693546295166, + "mean_relative_l2": 0.10320204496383667, + "max_abs_delta": 2.125 + }, + "bos_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.993550717830658, + "min_cosine_similarity": 0.977868914604187, + "mean_relative_l2": 0.10979899764060974, + "max_abs_delta": 3.125 + }, + "x_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9938176274299622, + "min_cosine_similarity": 0.9650149345397949, + "mean_relative_l2": 0.10705585032701492, + "max_abs_delta": 2.5625 + }, + "x_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.990565299987793, + "min_cosine_similarity": 0.9671100378036499, + "mean_relative_l2": 0.13348595798015594, + "max_abs_delta": 3.4375 + }, + "period_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9938619136810303, + "min_cosine_similarity": 0.9701651334762573, + "mean_relative_l2": 0.10666128993034363, + "max_abs_delta": 2.4375 + }, + "period_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.990638017654419, + "min_cosine_similarity": 0.9671933054924011, + "mean_relative_l2": 0.13280785083770752, + "max_abs_delta": 3.75 + } + } + }, + "layer_17": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e1fb2dcee13dd10f1a067f95f0b5102f7c053d08edbcd19215e980bc93528176", + "mean": -0.021859485656023026, + "std": 0.9147013425827026, + "rms": 0.9149625301361084, + "max_abs": 28.75 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "783fbc323402fc66cd6fcf5d80ee074848d05df90b1fdde60014e11166ae1ff6", + "mean": -0.02893121726810932, + "std": 7.103884220123291, + "rms": 7.103943347930908, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "58ceb58553d97335dd4e5c2ff7f541228ff342e57b25f5e82404ec30f56bc32a", + "mean": -0.0216534323990345, + "std": 0.9144630432128906, + "rms": 0.9147193431854248, + "max_abs": 29.375 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5a4433adddeb984d23c5c972a5acba8137ae4a6d47d71c1693ef94cd170b492c", + "mean": -0.029239961877465248, + "std": 6.91792631149292, + "rms": 6.917988300323486, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b937e8d13ceffd26a7952bbb543aae82d93114c4747f5b84522920f26db226ee", + "mean": -0.021692955866456032, + "std": 0.916378378868103, + "rms": 0.9166350960731506, + "max_abs": 28.375 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "947649acc71d8ae5a09d549874117f99b8882cbf6456fe5fe362fa1f30c66420", + "mean": -0.020018061622977257, + "std": 6.241098403930664, + "rms": 6.241130352020264, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c6e033003c8e200f2ceb706ca403fe881461ae2544d81ae1c60da8372e657267", + "mean": -0.02207564003765583, + "std": 0.9138293266296387, + "rms": 0.9140958786010742, + "max_abs": 28.5 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5bfa1cf7d5e35f92aea35bd76728d748a925dd484ee66d6b7c68bb0fbe24cb97", + "mean": -0.02046036906540394, + "std": 5.894845008850098, + "rms": 5.894880771636963, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f8f11768e833cda7fd9f98b5dc51c4c6b4fef75391abbc43ef146f4848ff2560", + "mean": -0.022592298686504364, + "std": 0.9130615592002869, + "rms": 0.9133409857749939, + "max_abs": 29.0 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c157bc2ebade25eb80a7d25ffb5ff9a4bd89f6b6407bbd7b85d9f66f120da2a2", + "mean": -0.020971301943063736, + "std": 6.241025924682617, + "rms": 6.241060733795166, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2262ac2ec286c6d05e55f9e5bfd2ab688c360777407d1598d1b61b8e35f5a6b2", + "mean": -0.023443305864930153, + "std": 0.9111811518669128, + "rms": 0.9114826321601868, + "max_abs": 29.25 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6202a3d3f6005941949614b0baa298168ea2a90b38f4e7d1710b1c894f1d9d6c", + "mean": -0.02159346453845501, + "std": 5.89460563659668, + "rms": 5.8946452140808105, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "532fd441906eec504c8dee982f38b45207ff09ed3af7f77d5f4e733b7ea90e08", + "mean": -0.022382207214832306, + "std": 0.9142983555793762, + "rms": 0.9145722389221191, + "max_abs": 28.875 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "47adce5963548521ac214004b4605fe833e40068f7344ee5b18059789a63838e", + "mean": -0.020482443273067474, + "std": 6.240891456604004, + "rms": 6.24092435836792, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c0b9631acb40c758db27b3c657b022e1a32a7c543badc7ad72c2f1250c9d862b", + "mean": -0.02303740754723549, + "std": 0.9114705920219421, + "rms": 0.9117616415023804, + "max_abs": 29.125 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "05e30499a61278e8a1580e692ebaf892f1af2034159f8ebc8694964001468bbc", + "mean": -0.020990317687392235, + "std": 5.894522666931152, + "rms": 5.89456033706665, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9976507425308228, + "min_cosine_similarity": 0.9910615682601929, + "mean_relative_l2": 0.06533306837081909, + "max_abs_delta": 1.0 + }, + "system_bos": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9957796931266785, + "min_cosine_similarity": 0.9792454838752747, + "mean_relative_l2": 0.08843706548213959, + "max_abs_delta": 1.625 + }, + "system_x": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9944701790809631, + "min_cosine_similarity": 0.979172945022583, + "mean_relative_l2": 0.10230481624603271, + "max_abs_delta": 2.125 + }, + "system_period": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9941882491111755, + "min_cosine_similarity": 0.978803277015686, + "mean_relative_l2": 0.10398813337087631, + "max_abs_delta": 1.625 + }, + "bos_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9946691989898682, + "min_cosine_similarity": 0.9712610244750977, + "mean_relative_l2": 0.09970330446958542, + "max_abs_delta": 2.25 + }, + "bos_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9940494894981384, + "min_cosine_similarity": 0.9807705283164978, + "mean_relative_l2": 0.10530418902635574, + "max_abs_delta": 3.25 + }, + "x_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9942705631256104, + "min_cosine_similarity": 0.9743239283561707, + "mean_relative_l2": 0.10311249643564224, + "max_abs_delta": 2.625 + }, + "x_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9913681149482727, + "min_cosine_similarity": 0.9699857831001282, + "mean_relative_l2": 0.1274145543575287, + "max_abs_delta": 3.5625 + }, + "period_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9943583607673645, + "min_cosine_similarity": 0.9773398637771606, + "mean_relative_l2": 0.10221947729587555, + "max_abs_delta": 2.4375 + }, + "period_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.991438090801239, + "min_cosine_similarity": 0.9665250778198242, + "mean_relative_l2": 0.1266496777534485, + "max_abs_delta": 4.125 + } + } + }, + "layer_18": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2e02acdfeddb4637ba12ec1a51665d809598797dca51f723cd18fc2becd2e5ca", + "mean": -0.02356138452887535, + "std": 1.066172480583191, + "rms": 1.0664327144622803, + "max_abs": 33.25 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9c0a7d898be664a4e406fd821542a6d4d00b6618bda4394e1cdcac6782909147", + "mean": -0.030376872047781944, + "std": 7.129125118255615, + "rms": 7.129190444946289, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "69a1ec488f4aef49cacda703b1dc53a5169b82fabb133400ca4ccc19a4f7a6a4", + "mean": -0.0233609676361084, + "std": 1.0643792152404785, + "rms": 1.0646356344223022, + "max_abs": 33.25 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e88d1d3116b16aad2261157cf9885dc2a97fb3f1bd0e18041e71ca6f94cd615a", + "mean": -0.030370617285370827, + "std": 6.94316291809082, + "rms": 6.9432291984558105, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6952a828baea4f5498d53ae2ea7954b822417e2f9ee17c306cd4f140c890b60d", + "mean": -0.0234221238642931, + "std": 1.0657885074615479, + "rms": 1.0660457611083984, + "max_abs": 33.5 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "331caea955911216343539b74cee9cfd90ca930a0462331a60b6f2635d23dee5", + "mean": -0.021465115249156952, + "std": 6.267117500305176, + "rms": 6.267154216766357, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "982b638d86eb491abc20c82aa237e93d636ced2af67e8a679754f10fefb9cb40", + "mean": -0.023875011131167412, + "std": 1.0629485845565796, + "rms": 1.0632166862487793, + "max_abs": 33.5 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e67d5957a9a22266d0ead7271375feda765f9559dc3605bdee501ee5d139adbe", + "mean": -0.021629033610224724, + "std": 5.921844005584717, + "rms": 5.921883583068848, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "386530f024546f56309b33ec9c0517b0fcae2aac4b871c5f5aff5e55ab3c81b9", + "mean": -0.024458030238747597, + "std": 1.06283438205719, + "rms": 1.0631158351898193, + "max_abs": 34.25 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d759fa3d5c3322127e795e4644060ec9943c32abb98d0937f37938e00c398e33", + "mean": -0.022577449679374695, + "std": 6.267087459564209, + "rms": 6.267127990722656, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4486b324a5d2ade393bf223ec8c59c2128f95b8f4aabb531a3a69a56d66f4f6d", + "mean": -0.025633765384554863, + "std": 1.0600476264953613, + "rms": 1.0603575706481934, + "max_abs": 34.0 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "334b083a55b15e09e9bfb383b23b7238a7228a9b4625185ac61e78894866e787", + "mean": -0.0229041650891304, + "std": 5.921689033508301, + "rms": 5.9217329025268555, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f2276c3a21b07d2b8e4f1e13d1b90da23b3109cecdf5d95246738ec50e1b24ff", + "mean": -0.02433539368212223, + "std": 1.064113974571228, + "rms": 1.06439208984375, + "max_abs": 34.0 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d2363964c8ae0f6e64c9ee9d316af26a57f439119bb49aa001c51f2cd144afaf", + "mean": -0.022186100482940674, + "std": 6.2669878005981445, + "rms": 6.267026901245117, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9a15389dd932d005537746df297e8c4733adf5d79193149b538732361a1f49c7", + "mean": -0.025350509211421013, + "std": 1.059181571006775, + "rms": 1.059484839439392, + "max_abs": 34.0 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "50217a94ba3c6f65fb4eee6788cca607624f6e879e90b8cc64c43d2f8b85332c", + "mean": -0.022421592846512794, + "std": 5.921361446380615, + "rms": 5.921403884887695, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.997767448425293, + "min_cosine_similarity": 0.9915263652801514, + "mean_relative_l2": 0.06357374787330627, + "max_abs_delta": 1.25 + }, + "system_bos": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9960147738456726, + "min_cosine_similarity": 0.9768258333206177, + "mean_relative_l2": 0.08541087061166763, + "max_abs_delta": 1.875 + }, + "system_x": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9946739673614502, + "min_cosine_similarity": 0.9795641899108887, + "mean_relative_l2": 0.09987909346818924, + "max_abs_delta": 2.375 + }, + "system_period": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9943424463272095, + "min_cosine_similarity": 0.9786133766174316, + "mean_relative_l2": 0.10225322097539902, + "max_abs_delta": 2.125 + }, + "bos_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9950990676879883, + "min_cosine_similarity": 0.9770044088363647, + "mean_relative_l2": 0.09557586163282394, + "max_abs_delta": 2.5 + }, + "bos_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9943913817405701, + "min_cosine_similarity": 0.9783557653427124, + "mean_relative_l2": 0.1017322912812233, + "max_abs_delta": 3.875 + }, + "x_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9948360323905945, + "min_cosine_similarity": 0.9810555577278137, + "mean_relative_l2": 0.09783085435628891, + "max_abs_delta": 2.875 + }, + "x_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9919102787971497, + "min_cosine_similarity": 0.9693634510040283, + "mean_relative_l2": 0.12265582382678986, + "max_abs_delta": 4.5 + }, + "period_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.994874119758606, + "min_cosine_similarity": 0.976268470287323, + "mean_relative_l2": 0.09718247503042221, + "max_abs_delta": 2.625 + }, + "period_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9918433427810669, + "min_cosine_similarity": 0.9617289304733276, + "mean_relative_l2": 0.12284308671951294, + "max_abs_delta": 5.25 + } + } + }, + "layer_19": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "86d5a7ef50279f6becce7e101e78d5c969fab81b7e81af19e917d5355a480f8b", + "mean": -0.025339210405945778, + "std": 1.1849663257598877, + "rms": 1.1852372884750366, + "max_abs": 31.875 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e8f17cd0f0093cfe28cc72251515596855a71764e450cf51ef03ed8040ad185f", + "mean": -0.0315546989440918, + "std": 7.144625663757324, + "rms": 7.144695281982422, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c245e0d319c87dd2e41961aa7a7542e8000b455a0ec6b43c3813df7535530d06", + "mean": -0.02500789985060692, + "std": 1.1837427616119385, + "rms": 1.184006929397583, + "max_abs": 32.75 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "68ab98b2825710dae02857dcbab25301ac9ac0d7d61f40edf8dd496da352f544", + "mean": -0.031001143157482147, + "std": 6.959766387939453, + "rms": 6.959835052490234, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "78b5336f2fcaa5f8f92badf89041ddf19d02f64a051a9551d5c962128586d270", + "mean": -0.025279659777879715, + "std": 1.1855947971343994, + "rms": 1.1858643293380737, + "max_abs": 30.25 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "dbad56a32314f22decaada481fba095c40a1a68c7aab56ea3e68cd9c9e253d6e", + "mean": -0.02286696806550026, + "std": 6.285197734832764, + "rms": 6.285239219665527, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "22351cdc0fff426c235c9f068f6365aaf60d0757479efafb3098c6447cc4e5e9", + "mean": -0.025770191103219986, + "std": 1.1823428869247437, + "rms": 1.1826236248016357, + "max_abs": 30.5 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c9eccbd8b7d0bd3953224f23a300cc8c615368ddba06d81ffa7e740bcbb3aa5d", + "mean": -0.02249821648001671, + "std": 5.941118240356445, + "rms": 5.941160678863525, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "087ef6af9e6403e130b3eb5d24db5b67042131781fc51cac8b31c1721c214725", + "mean": -0.026194659993052483, + "std": 1.1815863847732544, + "rms": 1.1818766593933105, + "max_abs": 29.75 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f97913a617d614e5b241a652f4b7460b32b0197e771e27211f4e65fee3549dd0", + "mean": -0.023746469989418983, + "std": 6.2851667404174805, + "rms": 6.285211086273193, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cf63ce54e765fd454364e7abb5da5032be67e5877cdcc81b15037c31ed436e4f", + "mean": -0.02748335897922516, + "std": 1.1787025928497314, + "rms": 1.179023027420044, + "max_abs": 30.875 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0e86bc5c15bd22d91a402035bc78181486401d65bcfb74f1f529210ce3557607", + "mean": -0.023607676848769188, + "std": 5.940836429595947, + "rms": 5.940883159637451, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "996ce0c00ecfe9f977d1ba101a033a47f932cae92b439329152ac1b40fcecf7b", + "mean": -0.026245711371302605, + "std": 1.183884859085083, + "rms": 1.184175729751587, + "max_abs": 30.375 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "831bd0b437ee8126f401ad966a625d19f88f6f6d0f3182ae5d94507ee356068b", + "mean": -0.02362382784485817, + "std": 6.285150527954102, + "rms": 6.2851948738098145, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "491cd2475ad478120401fbd7224a881be0b7773c14ec9a429ef8906bc1483356", + "mean": -0.027157112956047058, + "std": 1.1792913675308228, + "rms": 1.179603934288025, + "max_abs": 31.0 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "16c1b0c8343628cbe802436f0bd972654b446eee1b9ded60b967e4d73ecef71f", + "mean": -0.02320409007370472, + "std": 5.940777778625488, + "rms": 5.940823554992676, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9977580308914185, + "min_cosine_similarity": 0.9908620119094849, + "mean_relative_l2": 0.06386473029851913, + "max_abs_delta": 1.25 + }, + "system_bos": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9960338473320007, + "min_cosine_similarity": 0.9723469018936157, + "mean_relative_l2": 0.08522384613752365, + "max_abs_delta": 2.125 + }, + "system_x": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9946581125259399, + "min_cosine_similarity": 0.9814339876174927, + "mean_relative_l2": 0.10011856257915497, + "max_abs_delta": 2.375 + }, + "system_period": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9943397641181946, + "min_cosine_similarity": 0.9744046330451965, + "mean_relative_l2": 0.10198985040187836, + "max_abs_delta": 2.875 + }, + "bos_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.995126485824585, + "min_cosine_similarity": 0.9803434014320374, + "mean_relative_l2": 0.09556478261947632, + "max_abs_delta": 2.75 + }, + "bos_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9943177700042725, + "min_cosine_similarity": 0.9743464589118958, + "mean_relative_l2": 0.10255378484725952, + "max_abs_delta": 4.125 + }, + "x_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9947994947433472, + "min_cosine_similarity": 0.9811888337135315, + "mean_relative_l2": 0.09839286655187607, + "max_abs_delta": 3.0 + }, + "x_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9918394088745117, + "min_cosine_similarity": 0.9706288576126099, + "mean_relative_l2": 0.1229497566819191, + "max_abs_delta": 4.5 + }, + "period_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9948434829711914, + "min_cosine_similarity": 0.9704583883285522, + "mean_relative_l2": 0.09754309803247452, + "max_abs_delta": 2.75 + }, + "period_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.991756796836853, + "min_cosine_similarity": 0.9560244679450989, + "mean_relative_l2": 0.12334685027599335, + "max_abs_delta": 5.25 + } + } + }, + "layer_20": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7d72caa627e6365f5a38d491ade07ba39895cd2dd6fa96ce5bf65d46901b21e8", + "mean": -0.02687295340001583, + "std": 1.3818074464797974, + "rms": 1.3820686340332031, + "max_abs": 40.0 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1cc7b67b3c0fd71f123c93ee82508806a3618a96a705a4b118ea879af8b25059", + "mean": -0.03292310982942581, + "std": 7.3868584632873535, + "rms": 7.386931896209717, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "262088d745c0c441417f950ed8dec459ff1a4cf0a3eff533da9d3a2e60fc2e93", + "mean": -0.02642110548913479, + "std": 1.3814629316329956, + "rms": 1.3817155361175537, + "max_abs": 40.0 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e3ceec0d87fecbad6656ad2f92f35b8a22672728b160e77b264ef1d4ef8545d1", + "mean": -0.032141901552677155, + "std": 7.206895351409912, + "rms": 7.206966876983643, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "db8118d42c8a769eefb882c3f4e5ba1e4b46f24db27ddeabcae5e2bc42134807", + "mean": -0.026743654161691666, + "std": 1.3801056146621704, + "rms": 1.3803646564483643, + "max_abs": 39.5 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1fcdc1dde49ff1968d986e081cd2c7e66d2ccb84973865713c212bd261f413aa", + "mean": -0.024641426280140877, + "std": 6.322779178619385, + "rms": 6.322826862335205, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7b9dd74eca92b6d8865934198edac0959a22262a653fc66db7dbb670d25da601", + "mean": -0.027297304943203926, + "std": 1.3788191080093384, + "rms": 1.37908935546875, + "max_abs": 40.25 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9a572d7432c034ffa4d1df73817ff20df1f78e48b9e7aa0fdad626bc0b482c22", + "mean": -0.024052515625953674, + "std": 5.980731964111328, + "rms": 5.980780124664307, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "69b309dedd79f0c5355c1fa91c002444d6b7120ab7f2ff5d270d4ba2b957c7c0", + "mean": -0.028190527111291885, + "std": 1.375437617301941, + "rms": 1.3757264614105225, + "max_abs": 39.25 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "25fadc294f80c3e3e104d9f17fbbac703bbd08c9012dbce348335ace7810f96c", + "mean": -0.02596956677734852, + "std": 6.322803974151611, + "rms": 6.322856903076172, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4c325ce15300674b6405a696606854c9126d301d2d27428b13cd8887cbc3c5c2", + "mean": -0.029382148757576942, + "std": 1.3743029832839966, + "rms": 1.3746169805526733, + "max_abs": 39.75 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d5e876f2f9138b68339c726e9dbb87cca0c07251f41f1991d0ce948c50f97059", + "mean": -0.025448257103562355, + "std": 5.980443000793457, + "rms": 5.980497360229492, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e716a37310a36b6bea48d48e452030ebb0d084143a18c25188dddf18666d932c", + "mean": -0.027745481580495834, + "std": 1.3792273998260498, + "rms": 1.3795064687728882, + "max_abs": 39.5 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9c1b23f5e757f306a96b96e67dbeddfd5e047293fa232d21b0e4388307af4de1", + "mean": -0.025349579751491547, + "std": 6.322981357574463, + "rms": 6.323031902313232, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0cdbd3b0b50e18073098ce5ff818edd11c8c4923d6c16079fb87d226e941fac4", + "mean": -0.029354695230722427, + "std": 1.3757091760635376, + "rms": 1.3760223388671875, + "max_abs": 39.75 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5a8fb4aa9f0754d9a9c37c0dfbb4e214ef38ba18c2ccf323452352ba5c5cbd01", + "mean": -0.02523195743560791, + "std": 5.980459213256836, + "rms": 5.980511665344238, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9978433847427368, + "min_cosine_similarity": 0.9887330532073975, + "mean_relative_l2": 0.0626230537891388, + "max_abs_delta": 1.25 + }, + "system_bos": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9963012337684631, + "min_cosine_similarity": 0.9713046550750732, + "mean_relative_l2": 0.08196526765823364, + "max_abs_delta": 2.25 + }, + "system_x": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.994713306427002, + "min_cosine_similarity": 0.9819066524505615, + "mean_relative_l2": 0.09914759546518326, + "max_abs_delta": 2.25 + }, + "system_period": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9943705201148987, + "min_cosine_similarity": 0.9735732078552246, + "mean_relative_l2": 0.10132433474063873, + "max_abs_delta": 2.375 + }, + "bos_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9955223202705383, + "min_cosine_similarity": 0.9811677932739258, + "mean_relative_l2": 0.09159044176340103, + "max_abs_delta": 3.125 + }, + "bos_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9946624636650085, + "min_cosine_similarity": 0.9745088219642639, + "mean_relative_l2": 0.09918281435966492, + "max_abs_delta": 4.625 + }, + "x_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9952043294906616, + "min_cosine_similarity": 0.9812189340591431, + "mean_relative_l2": 0.09471902996301651, + "max_abs_delta": 3.25 + }, + "x_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9918688535690308, + "min_cosine_similarity": 0.9682328701019287, + "mean_relative_l2": 0.12234635651111603, + "max_abs_delta": 4.875 + }, + "period_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9953359365463257, + "min_cosine_similarity": 0.9708144664764404, + "mean_relative_l2": 0.09269281476736069, + "max_abs_delta": 3.0 + }, + "period_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9919679164886475, + "min_cosine_similarity": 0.9574152827262878, + "mean_relative_l2": 0.12131954729557037, + "max_abs_delta": 5.0 + } + } + }, + "layer_21": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "09e6ee4b4c7b51727ee42c2fb0598c70f6db017ee78d48bfbb51b6bd21702b6e", + "mean": -0.03344935178756714, + "std": 1.5256015062332153, + "rms": 1.5259681940078735, + "max_abs": 51.75 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "649577b1775b6ea203887890bca0867fdc7c62011f67853fe64b3eafc7b445c0", + "mean": -0.03785667568445206, + "std": 7.47972297668457, + "rms": 7.479818820953369, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6aec2e1b08fe3a98dac5627cb62e898f5892fd062b9626a0ef9ba6ce5c12d5c2", + "mean": -0.033067528158426285, + "std": 1.5249528884887695, + "rms": 1.5253113508224487, + "max_abs": 51.75 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "75b9f277035ed6680727d92eec52e51865fb47bca7807056444b7dd93877adc7", + "mean": -0.03610968589782715, + "std": 7.294979572296143, + "rms": 7.295068740844727, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4494294562773c5b56d4079a3f8e1e125462031ba646f3cad65b11badcc82ead", + "mean": -0.03350058197975159, + "std": 1.5253336429595947, + "rms": 1.5257015228271484, + "max_abs": 50.5 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a38e83f89bbb55336645cf42af50445b47c6c01da55e187930a8e15b019970ce", + "mean": -0.02960285171866417, + "std": 6.339300632476807, + "rms": 6.339369297027588, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "38a73aa5e40d5b43a0b653ee01f32b4d8d109aae17911ab678d140c96605bc16", + "mean": -0.033886343240737915, + "std": 1.5206103324890137, + "rms": 1.520987868309021, + "max_abs": 51.5 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3760bb45017b97dc9288a80f3d07a6bd71ee25c78696b8fa4ee00f55a89a6739", + "mean": -0.02793193981051445, + "std": 6.001340866088867, + "rms": 6.001405715942383, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7cd99844475a66f85b716492478fec4e49cea2746988456e86c7173de5b912e3", + "mean": -0.035433150827884674, + "std": 1.5198777914047241, + "rms": 1.520290732383728, + "max_abs": 50.75 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4f6253f40a1965cd536d276ef69d888fa8e936d748b6cd69e24c5a1d2eced5ad", + "mean": -0.03132150322198868, + "std": 6.339505672454834, + "rms": 6.339582443237305, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6677e78ea64a777094a799cca31908c541b2432a33d8e1f2020ce0d7b112b379", + "mean": -0.037206169217824936, + "std": 1.518493413925171, + "rms": 1.5189491510391235, + "max_abs": 51.5 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4abc7336861c6a3748aa9683c55700b85c933c1a332d380b2dcb669bbcb653ea", + "mean": -0.03055484965443611, + "std": 6.0021162033081055, + "rms": 6.002193450927734, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "241431a546615d39743080b212e24c2c6ffb0582586fc8dccdcba438f6e86b2b", + "mean": -0.03487040847539902, + "std": 1.5234835147857666, + "rms": 1.523882508277893, + "max_abs": 51.0 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "20e7bd987c5ef4209f3c227acdfe9c7e4bc28f851f254d82ccd420fdb9f5926a", + "mean": -0.030688347294926643, + "std": 6.339355945587158, + "rms": 6.339430809020996, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6c52c13d8237d8bb19e31a2da766b3f03e85f0b0f07bb630656305bec5f46f82", + "mean": -0.03713497146964073, + "std": 1.5194467306137085, + "rms": 1.5199004411697388, + "max_abs": 51.0 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c5607b3ba2233a074ae404f90607aa6fe139ecb16e684680158287060d13a590", + "mean": -0.03016648255288601, + "std": 6.001461505889893, + "rms": 6.001537322998047, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.997669517993927, + "min_cosine_similarity": 0.9862689971923828, + "mean_relative_l2": 0.06509029120206833, + "max_abs_delta": 1.75 + }, + "system_bos": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9961757063865662, + "min_cosine_similarity": 0.9703007340431213, + "mean_relative_l2": 0.08317994326353073, + "max_abs_delta": 2.25 + }, + "system_x": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9941377639770508, + "min_cosine_similarity": 0.979863166809082, + "mean_relative_l2": 0.10402756184339523, + "max_abs_delta": 2.75 + }, + "system_period": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9938863515853882, + "min_cosine_similarity": 0.9717841148376465, + "mean_relative_l2": 0.10527835786342621, + "max_abs_delta": 2.5 + }, + "bos_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9954992532730103, + "min_cosine_similarity": 0.980961799621582, + "mean_relative_l2": 0.09218034148216248, + "max_abs_delta": 3.25 + }, + "bos_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.994515597820282, + "min_cosine_similarity": 0.9723063111305237, + "mean_relative_l2": 0.10050778836011887, + "max_abs_delta": 4.625 + }, + "x_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9951647520065308, + "min_cosine_similarity": 0.9801027178764343, + "mean_relative_l2": 0.09551329165697098, + "max_abs_delta": 3.0 + }, + "x_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9913156628608704, + "min_cosine_similarity": 0.9660736918449402, + "mean_relative_l2": 0.12646910548210144, + "max_abs_delta": 4.75 + }, + "period_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9953747987747192, + "min_cosine_similarity": 0.9703736305236816, + "mean_relative_l2": 0.09256309270858765, + "max_abs_delta": 2.625 + }, + "period_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9916186928749084, + "min_cosine_similarity": 0.9548677206039429, + "mean_relative_l2": 0.12354820966720581, + "max_abs_delta": 5.125 + } + } + }, + "layer_22": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4a24859400c49edee9ad8e01e3f9b8d765c66af30f13ca91efcdf67d52c1ff1c", + "mean": -0.043746188282966614, + "std": 1.8034594058990479, + "rms": 1.8039900064468384, + "max_abs": 65.0 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "73b1261fce117b31e2924474fe5c4f8baa6379dcb175cb1b47d5d8eda8852041", + "mean": -0.046458687633275986, + "std": 7.535338401794434, + "rms": 7.5354814529418945, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4c8a4299678010acd6fc4854a260984a93799ddc6500a1bd300f7e9508617f19", + "mean": -0.042826391756534576, + "std": 1.8040043115615845, + "rms": 1.804512619972229, + "max_abs": 65.0 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f50fcd5c8fd858f41a2c8ff22a3c2af7ae789eecf071b45a1b029961a7514abb", + "mean": -0.04360527917742729, + "std": 7.353886127471924, + "rms": 7.354015350341797, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9871edc3a24523bf170e2902877e351543ad26d731f0e6736a8c765980947640", + "mean": -0.043671123683452606, + "std": 1.8019202947616577, + "rms": 1.8024494647979736, + "max_abs": 64.5 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "46cc864ec1d21fedc18d714e7f9de8d5c18986b734261abbbf58912b2568813b", + "mean": -0.03812864050269127, + "std": 6.404855251312256, + "rms": 6.40496826171875, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e459523937c3318d234424f67e0cb2c033a07c1fdab3b490b8509459f3891596", + "mean": -0.043605826795101166, + "std": 1.7976150512695312, + "rms": 1.798143744468689, + "max_abs": 64.5 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e6b43c929b5a3b5937a9bd284a2e4dca74d3e9090ac796bdfa40d061aec9e7e2", + "mean": -0.035332415252923965, + "std": 6.072697639465332, + "rms": 6.072800159454346, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0b6115e45dc69c3378033e2f6ff9783994cef92b7361d0372a9d7de647f18ef1", + "mean": -0.04628836363554001, + "std": 1.8007621765136719, + "rms": 1.8013569116592407, + "max_abs": 65.0 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "852dda01e5d03b8bc664c25b878296e67618affc3379b44f691134e42468fc20", + "mean": -0.040350526571273804, + "std": 6.4061689376831055, + "rms": 6.4062957763671875, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7b43ec1e682b89c0eb9263271880fda35cd430aa45ce2d0d95323b28cfff595e", + "mean": -0.04758232459425926, + "std": 1.7985875606536865, + "rms": 1.7992167472839355, + "max_abs": 65.0 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b1e724fd9e604da383b7a70b1c3ba993869ce46aad9ab14be44d1f0a7d14edb7", + "mean": -0.038333673030138016, + "std": 6.074484825134277, + "rms": 6.074605464935303, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ad723d2bf96fecd7e3b5527cf7840285c723847ab05eeeddd97121ae79ebf946", + "mean": -0.045263223350048065, + "std": 1.8025704622268677, + "rms": 1.8031386137008667, + "max_abs": 65.0 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e75947838574178c3039362d55540e40a04b705322cbef7825a3bd83cbfb5daf", + "mean": -0.03937338665127754, + "std": 6.405615329742432, + "rms": 6.405735969543457, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "172cb056398c366bc5a56e55dc0b41e6023f1237da3ad95f185eb234b03a7845", + "mean": -0.04714566469192505, + "std": 1.7999598979949951, + "rms": 1.800577163696289, + "max_abs": 64.5 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2f85994ace7ebb81ec11bcbcd39505ef4abc96ee25ec8ae82005f70560712814", + "mean": -0.037719059735536575, + "std": 6.073733806610107, + "rms": 6.073851108551025, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9977244138717651, + "min_cosine_similarity": 0.9888207316398621, + "mean_relative_l2": 0.064309261739254, + "max_abs_delta": 2.0 + }, + "system_bos": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9962634444236755, + "min_cosine_similarity": 0.966613233089447, + "mean_relative_l2": 0.08183081448078156, + "max_abs_delta": 2.75 + }, + "system_x": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9943161606788635, + "min_cosine_similarity": 0.9771530628204346, + "mean_relative_l2": 0.10141521692276001, + "max_abs_delta": 2.75 + }, + "system_period": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9940476417541504, + "min_cosine_similarity": 0.9699365496635437, + "mean_relative_l2": 0.10283442586660385, + "max_abs_delta": 2.875 + }, + "bos_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9956839680671692, + "min_cosine_similarity": 0.9806397557258606, + "mean_relative_l2": 0.08980875462293625, + "max_abs_delta": 3.75 + }, + "bos_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9947959184646606, + "min_cosine_similarity": 0.9701153039932251, + "mean_relative_l2": 0.09738870710134506, + "max_abs_delta": 4.625 + }, + "x_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9953495264053345, + "min_cosine_similarity": 0.979823887348175, + "mean_relative_l2": 0.09370769560337067, + "max_abs_delta": 2.875 + }, + "x_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9916401505470276, + "min_cosine_similarity": 0.9674439430236816, + "mean_relative_l2": 0.12341520935297012, + "max_abs_delta": 5.25 + }, + "period_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9956022500991821, + "min_cosine_similarity": 0.9703953266143799, + "mean_relative_l2": 0.0902918130159378, + "max_abs_delta": 2.25 + }, + "period_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9919978976249695, + "min_cosine_similarity": 0.9591995477676392, + "mean_relative_l2": 0.12012293934822083, + "max_abs_delta": 5.5 + } + } + }, + "layer_23": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d552d075e2174f5794d282648de1199e99cee36a3267075131b76f1f346a892c", + "mean": -0.05928533524274826, + "std": 2.2231757640838623, + "rms": 2.223966121673584, + "max_abs": 91.5 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ca4ba3e0bdf397089a3725998a4759273fb81643475c8e00cac384e58ce88a98", + "mean": -0.059070199728012085, + "std": 7.608714580535889, + "rms": 7.608943939208984, + "max_abs": 1160.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f8dc5263f7bab02990521d1fac5bd332f8154406543cafb56813650c59ce3d34", + "mean": -0.05864885076880455, + "std": 2.2247166633605957, + "rms": 2.225489616394043, + "max_abs": 93.0 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "09c776c9eeed2989e1eecf3edc9e72d2d662e1c58214edc378ce7917bef971c7", + "mean": -0.05416536703705788, + "std": 7.4311652183532715, + "rms": 7.431363105773926, + "max_abs": 1160.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "dedace2060a98927bd24851098937216160b56b113dd307743afe1daf0d0f939", + "mean": -0.059288352727890015, + "std": 2.2176618576049805, + "rms": 2.218454122543335, + "max_abs": 95.0 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f9f8cbb95d4903081825bd1a85c03959544529ef8645a558dbf128862ca1edf8", + "mean": -0.05087801814079285, + "std": 6.498650550842285, + "rms": 6.498849391937256, + "max_abs": 1160.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ea3407015369d6e9127bf52eae39903239d2a8a70016f400a7285e7e7944f8a1", + "mean": -0.059836868196725845, + "std": 2.215859889984131, + "rms": 2.216667652130127, + "max_abs": 93.5 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2e7ae08a2b9438ef5e173ed12211d0f44361f4fd51cc9910170384ae49c41e1f", + "mean": -0.04632950946688652, + "std": 6.176595687866211, + "rms": 6.176769733428955, + "max_abs": 1160.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c072e613e6352627b6f8ff914d3181a27c0dc980ad0aaec274a9ffa0b84b5aad", + "mean": -0.061811190098524094, + "std": 2.2208707332611084, + "rms": 2.2217307090759277, + "max_abs": 94.0 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9310fc7536f63b50b373ea3635a87f30d9996c97b54fca4f0de11159ee63081d", + "mean": -0.05283597484230995, + "std": 6.502445697784424, + "rms": 6.502660274505615, + "max_abs": 1160.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fee25da8eba5d2ba95662b9d1f762c037b7591d420e55e415472406657a44ac4", + "mean": -0.06353885680437088, + "std": 2.2173986434936523, + "rms": 2.218308687210083, + "max_abs": 94.0 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "995a439da93c3964858e205c7d01f885e1d23756221a29b7468f851e7856d744", + "mean": -0.04914817214012146, + "std": 6.179977893829346, + "rms": 6.180172443389893, + "max_abs": 1160.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a8ae18a138a15fa08e472a0d3b106b06444515fcb3dce5718d77c7815f7e5e44", + "mean": -0.061072319746017456, + "std": 2.221219062805176, + "rms": 2.2220582962036133, + "max_abs": 94.0 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4b97e13af697f1f5a4932dac12ceee498795787aac620c3a3927875d469eaa30", + "mean": -0.052362583577632904, + "std": 6.500639915466309, + "rms": 6.500850677490234, + "max_abs": 1160.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2672e02b9d6561526ac730df2749308031baf8392217cab49239e20843b512d3", + "mean": -0.06318173557519913, + "std": 2.219033718109131, + "rms": 2.219933032989502, + "max_abs": 95.0 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f28a798d8180f98284f05559448eebe414961227e135e5a91fb098ea77a534a0", + "mean": -0.048581767827272415, + "std": 6.1787214279174805, + "rms": 6.17891263961792, + "max_abs": 1160.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9980285167694092, + "min_cosine_similarity": 0.9919068217277527, + "mean_relative_l2": 0.05999017134308815, + "max_abs_delta": 2.25 + }, + "system_bos": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9968457221984863, + "min_cosine_similarity": 0.9746330976486206, + "mean_relative_l2": 0.07557851076126099, + "max_abs_delta": 3.0 + }, + "system_x": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9950974583625793, + "min_cosine_similarity": 0.9782869219779968, + "mean_relative_l2": 0.09406274557113647, + "max_abs_delta": 3.5 + }, + "system_period": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9948263168334961, + "min_cosine_similarity": 0.9691611528396606, + "mean_relative_l2": 0.09557238966226578, + "max_abs_delta": 4.0 + }, + "bos_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9963443875312805, + "min_cosine_similarity": 0.9833729267120361, + "mean_relative_l2": 0.08282667398452759, + "max_abs_delta": 3.5 + }, + "bos_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9955887198448181, + "min_cosine_similarity": 0.9749062657356262, + "mean_relative_l2": 0.08984969556331635, + "max_abs_delta": 4.5 + }, + "x_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.995986819267273, + "min_cosine_similarity": 0.9836500883102417, + "mean_relative_l2": 0.08716931194067001, + "max_abs_delta": 3.75 + }, + "x_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.992880642414093, + "min_cosine_similarity": 0.9712978005409241, + "mean_relative_l2": 0.11381848901510239, + "max_abs_delta": 6.0 + }, + "period_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9962748885154724, + "min_cosine_similarity": 0.977013111114502, + "mean_relative_l2": 0.08333688974380493, + "max_abs_delta": 3.0 + }, + "period_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9931778907775879, + "min_cosine_similarity": 0.9650478959083557, + "mean_relative_l2": 0.11078757792711258, + "max_abs_delta": 6.0 + } + } + }, + "layer_24": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "246b5375e15eb006eb861117a61710af2d781771e09c5864e0ee6ceffdd4012e", + "mean": -0.07381024211645126, + "std": 2.701780080795288, + "rms": 2.7027878761291504, + "max_abs": 116.0 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "aa0f3e14368ca637c21b004ceb601378c79790a5a190134ab034859e9ca85978", + "mean": -0.07203720510005951, + "std": 7.292396545410156, + "rms": 7.292752742767334, + "max_abs": 1008.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2080af6de8003dd9a146344e0ecb655db9b9041620bc32feb841282e825336c3", + "mean": -0.07339729368686676, + "std": 2.70308780670166, + "rms": 2.7040839195251465, + "max_abs": 118.0 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fb04d3a2d3ba9d76fe221f916c527fc6e2a58601ae59321a5674c43ec316fc34", + "mean": -0.06565237045288086, + "std": 7.3376264572143555, + "rms": 7.337920188903809, + "max_abs": 1120.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7ceefdca7dbf7750acbd0dea3c47c71f255568dd11305e0ced4f6fdcbddc6f9c", + "mean": -0.07376959919929504, + "std": 2.6951193809509277, + "rms": 2.6961288452148438, + "max_abs": 119.0 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "66babf75be097cb7d9e880167584d9a4db4a78c3e6a1f79e3bfd9f42628e1858", + "mean": -0.06271377950906754, + "std": 4.910208225250244, + "rms": 4.910608291625977, + "max_abs": 840.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a3e338ad5566112614fbf822b2c6f49dce464820eaa6c3e25b764af24ab847a5", + "mean": -0.07464949786663055, + "std": 2.6925833225250244, + "rms": 2.693617820739746, + "max_abs": 117.0 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6cd0732f4ebf3ec8727efd08d6a333d9f075447bbc0970a3f2e9835fe4c1851c", + "mean": -0.05676497146487236, + "std": 4.727226257324219, + "rms": 4.727567195892334, + "max_abs": 840.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "420726c34d09294564d414f0081a9969a0cd9a9bd417fda2309aad2a549ff312", + "mean": -0.07617975771427155, + "std": 2.700382709503174, + "rms": 2.7014570236206055, + "max_abs": 117.0 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "913a2fc18d1c22f599f1a5949652cc9a8cdbfdedbe60d69dff1340a4d10a68a1", + "mean": -0.06480672210454941, + "std": 4.917520999908447, + "rms": 4.917947769165039, + "max_abs": 840.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6f63192192ea18d433834bea79067832917a133c1319c9613780c0a8e32030e0", + "mean": -0.07756505161523819, + "std": 2.6968321800231934, + "rms": 2.6979475021362305, + "max_abs": 117.5 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "aef34c987479c6fad0726f05fc37cca60b652baf91ab46bcc8a42fe7e2a2fe4e", + "mean": -0.059335824102163315, + "std": 4.734389781951904, + "rms": 4.734761714935303, + "max_abs": 840.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "be67f280ff52f04e2c84b1fc436b463c011e15022f4865dfc82630a411c868d0", + "mean": -0.07557377964258194, + "std": 2.699242353439331, + "rms": 2.7003002166748047, + "max_abs": 117.0 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0b36af0e242e50fc5ffcfd8a9822cc49e66a1e4370c22b24b569061b5901d882", + "mean": -0.06428099423646927, + "std": 4.9143900871276855, + "rms": 4.9148101806640625, + "max_abs": 840.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "361194f273497e3a1261961f7d4218c80ef2333b751e5b8ab7313594497cdec0", + "mean": -0.07735750824213028, + "std": 2.6983063220977783, + "rms": 2.6994149684906006, + "max_abs": 118.5 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ff6b3f9caff1f84bd4142129f082f9f8523c8e84f2c1f170260ba444c7494580", + "mean": -0.05864370986819267, + "std": 4.732210636138916, + "rms": 4.732573986053467, + "max_abs": 840.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9983025789260864, + "min_cosine_similarity": 0.9938017725944519, + "mean_relative_l2": 0.05580355226993561, + "max_abs_delta": 2.0 + }, + "system_bos": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9973087906837463, + "min_cosine_similarity": 0.9793431758880615, + "mean_relative_l2": 0.06982332468032837, + "max_abs_delta": 3.0 + }, + "system_x": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9958130717277527, + "min_cosine_similarity": 0.9798667430877686, + "mean_relative_l2": 0.08683108538389206, + "max_abs_delta": 3.0 + }, + "system_period": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9956204295158386, + "min_cosine_similarity": 0.9737493395805359, + "mean_relative_l2": 0.08786649256944656, + "max_abs_delta": 4.5 + }, + "bos_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9968873262405396, + "min_cosine_similarity": 0.9867760539054871, + "mean_relative_l2": 0.07647384703159332, + "max_abs_delta": 4.0 + }, + "bos_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9962208867073059, + "min_cosine_similarity": 0.9788992404937744, + "mean_relative_l2": 0.0828598141670227, + "max_abs_delta": 4.5 + }, + "x_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9964933395385742, + "min_cosine_similarity": 0.9858922362327576, + "mean_relative_l2": 0.08138810098171234, + "max_abs_delta": 5.25 + }, + "x_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9938487410545349, + "min_cosine_similarity": 0.9691653847694397, + "mean_relative_l2": 0.10553787648677826, + "max_abs_delta": 7.75 + }, + "period_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9967391490936279, + "min_cosine_similarity": 0.9811182022094727, + "mean_relative_l2": 0.0778583437204361, + "max_abs_delta": 3.5 + }, + "period_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9941608309745789, + "min_cosine_similarity": 0.9647791385650635, + "mean_relative_l2": 0.10225702822208405, + "max_abs_delta": 7.75 + } + } + }, + "layer_25": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "278743765f034424e1cfff75ffa2a5d9e678b0baee57a93b3a1e441988ec5441", + "mean": -0.11768342554569244, + "std": 3.621800184249878, + "rms": 3.623711347579956, + "max_abs": 166.0 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "13e7260cccf90fca688094bf5eb738a0883af8288770e9f6d91e354791726ebc", + "mean": -0.1104610338807106, + "std": 6.091772079467773, + "rms": 6.0927734375, + "max_abs": 872.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d07a3d28a6bfba208c855e4e92af261ca585bbf161c576bb5ad405314f09f407", + "mean": -0.11546164005994797, + "std": 3.6196208000183105, + "rms": 3.621461868286133, + "max_abs": 168.0 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5586ea42d83638f30d0aa4cad1667babbb2bb415c6ac2d2f8ba6ec413074a779", + "mean": -0.10005216300487518, + "std": 6.271531581878662, + "rms": 6.272329330444336, + "max_abs": 984.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "020fa01adad7e394a863127116d49715283d527768f3719bde9cc68b1657395b", + "mean": -0.11874376982450485, + "std": 3.613858938217163, + "rms": 3.615809202194214, + "max_abs": 168.0 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2913a1326b99329f790fde2596b1228c50c81552fa658ac1ad6da1c2e796d1b2", + "mean": -0.10143798589706421, + "std": 3.746861457824707, + "rms": 3.7482340335845947, + "max_abs": 248.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6450cb21414521f0692ad8e2b4ab0134817832101edfea427c198cd595f7be35", + "mean": -0.11888296157121658, + "std": 3.612543821334839, + "rms": 3.61449933052063, + "max_abs": 166.0 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "717fcc6985250fcb534943e8693efc05914b13e83fbbd0b01a6f20fd5fb9385f", + "mean": -0.09213163703680038, + "std": 3.7440457344055176, + "rms": 3.7451791763305664, + "max_abs": 248.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f5805766c189db60ec86c21282dea559e570d4a4ca94fd20eb8ce1acbd62d0c7", + "mean": -0.12108665704727173, + "std": 3.6235344409942627, + "rms": 3.6255569458007812, + "max_abs": 166.0 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0c3278503800a2003c9d223ab1fb7a5b69e14213c1f8a589d79beb325c0aca9a", + "mean": -0.10389328747987747, + "std": 3.7660763263702393, + "rms": 3.7675092220306396, + "max_abs": 248.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "512a96b3a4808237e083a693a8b1326516283601e59a4246ca866f2395becd88", + "mean": -0.12032942473888397, + "std": 3.6169352531433105, + "rms": 3.61893630027771, + "max_abs": 168.0 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "116a5c83959358a881e2d300e9e063eb388f0792849e12881f38307f6b13de03", + "mean": -0.0933915451169014, + "std": 3.757869005203247, + "rms": 3.7590293884277344, + "max_abs": 248.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5043348a26b6fffe4de300ea45e772e07dc1c1c88dd9a97f82913b55cb1d5a1c", + "mean": -0.12017322331666946, + "std": 3.621234655380249, + "rms": 3.623228073120117, + "max_abs": 166.0 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "72cb58d9587b449adaf4b67fff4fdc499c22842519380d7676013d45126b50c9", + "mean": -0.10281259566545486, + "std": 3.758190870285034, + "rms": 3.759596824645996, + "max_abs": 248.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f51e112a9f9b4e216d11be83b297a9575772623e690fbd4bddd220a38d5171e5", + "mean": -0.12054824829101562, + "std": 3.6201632022857666, + "rms": 3.6221694946289062, + "max_abs": 167.0 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "94d8012c34b3883289b2cd7b3611721a0808cbd0685faeda86bea1d9eb711818", + "mean": -0.09299915283918381, + "std": 3.7544593811035156, + "rms": 3.755610704421997, + "max_abs": 248.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9987584352493286, + "min_cosine_similarity": 0.9948996305465698, + "mean_relative_l2": 0.04764914885163307, + "max_abs_delta": 5.0 + }, + "system_bos": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9981086850166321, + "min_cosine_similarity": 0.9871747493743896, + "mean_relative_l2": 0.05850007385015488, + "max_abs_delta": 4.5 + }, + "system_x": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9968609809875488, + "min_cosine_similarity": 0.9803997278213501, + "mean_relative_l2": 0.07468672841787338, + "max_abs_delta": 12.5 + }, + "system_period": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9967651963233948, + "min_cosine_similarity": 0.9762740135192871, + "mean_relative_l2": 0.075280100107193, + "max_abs_delta": 11.75 + }, + "bos_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9978373646736145, + "min_cosine_similarity": 0.9904502630233765, + "mean_relative_l2": 0.06370772421360016, + "max_abs_delta": 6.0 + }, + "bos_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9973310232162476, + "min_cosine_similarity": 0.9812362194061279, + "mean_relative_l2": 0.06935401260852814, + "max_abs_delta": 9.0625 + }, + "x_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9975534081459045, + "min_cosine_similarity": 0.9892224073410034, + "mean_relative_l2": 0.0680345669388771, + "max_abs_delta": 7.0 + }, + "x_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9956544637680054, + "min_cosine_similarity": 0.9739859104156494, + "mean_relative_l2": 0.08876188844442368, + "max_abs_delta": 9.5 + }, + "period_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9977353811264038, + "min_cosine_similarity": 0.9882178902626038, + "mean_relative_l2": 0.06484556943178177, + "max_abs_delta": 6.0 + }, + "period_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9958962202072144, + "min_cosine_similarity": 0.9768168926239014, + "mean_relative_l2": 0.08586220443248749, + "max_abs_delta": 10.0 + } + } + }, + "layer_26": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c24342ac8ec72139779acea405e63533d5a85da23798d648e686623a47535c91", + "mean": -0.17943112552165985, + "std": 4.215304851531982, + "rms": 4.219121932983398, + "max_abs": 296.0 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6be74cfb4242f465081566e764edcb9cac2c71c869fed4a328407641fcca81af", + "mean": -0.16819995641708374, + "std": 6.438908576965332, + "rms": 6.441105365753174, + "max_abs": 844.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "229e1ccac10cf30158d12800a103775f9fbec33626ccdcdd3838e77e53d035ee", + "mean": -0.17379707098007202, + "std": 4.143494606018066, + "rms": 4.1471381187438965, + "max_abs": 290.0 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bc42bc7b4718f0978708d08084f12485d01947e65feb66064345b65bdf5d111a", + "mean": -0.14540012180805206, + "std": 6.596408367156982, + "rms": 6.598010540008545, + "max_abs": 868.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9e4c498d0735147d050f6a5d9cfc986bd12a61a60b11562aaf654848a4744f09", + "mean": -0.17992465198040009, + "std": 4.198667526245117, + "rms": 4.202520847320557, + "max_abs": 300.0 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ee9ba8a9ec515f320b913d032250a384cd58e0b2cc0c848eda583c9b14d7e5b5", + "mean": -0.15682430565357208, + "std": 4.675661563873291, + "rms": 4.678290843963623, + "max_abs": 776.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e76c340f91361893481c333bd553be86ce13f947630a5ec92775e8377be10c14", + "mean": -0.17725448310375214, + "std": 4.139097690582275, + "rms": 4.1428914070129395, + "max_abs": 292.0 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4a76c1d2df03525bce414b4d9ab270d44a717adcf2bd665cac851a8f98311a46", + "mean": -0.1361696720123291, + "std": 4.72183895111084, + "rms": 4.723802089691162, + "max_abs": 776.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "10124c40b5f520d90bae5896fea9c0c4e1e7ee43bebade5c5ab48dedc96286d1", + "mean": -0.1826297491788864, + "std": 4.228824615478516, + "rms": 4.232766628265381, + "max_abs": 304.0 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "794f7d5737c138b6132f722a18ce72e0dfc41fb88d28aae2fc085cf94dad4f68", + "mean": -0.16000716388225555, + "std": 4.713201999664307, + "rms": 4.715917110443115, + "max_abs": 776.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "95f767ae3aff045c7cbc24b646e8993586d28c2d8047d2bcc179cdc0c06a2302", + "mean": -0.17522288858890533, + "std": 4.0938544273376465, + "rms": 4.097602367401123, + "max_abs": 294.0 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ea75a165900f37c359a1a461612b6e921c75551e83398012df293ce1e6d2437b", + "mean": -0.1346554160118103, + "std": 4.701534748077393, + "rms": 4.703463077545166, + "max_abs": 776.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "38d45c3f3d3becb7770e264c73c1fe37c666aaa64194db514d0a33428f93182a", + "mean": -0.18096967041492462, + "std": 4.197787284851074, + "rms": 4.201685905456543, + "max_abs": 300.0 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0c41f7e967ec6515a7863c2188ee35c5c370d16fb9fd5d9191cbb004b85b5d29", + "mean": -0.15796253085136414, + "std": 4.68052864074707, + "rms": 4.683193206787109, + "max_abs": 776.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b84503ed4fbc0a0ea8a1f379f29ebc4f85cec5e9fff6038d1e7d6d4e76525f14", + "mean": -0.1744711548089981, + "std": 4.077659606933594, + "rms": 4.081389904022217, + "max_abs": 296.0 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "04c77476ff5353436eb1044c6aa50bbea7e12f47cbcfb0698eb543eef433a835", + "mean": -0.13342878222465515, + "std": 4.6798624992370605, + "rms": 4.681764602661133, + "max_abs": 776.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.998507022857666, + "min_cosine_similarity": 0.9898717403411865, + "mean_relative_l2": 0.054682228714227676, + "max_abs_delta": 13.0 + }, + "system_bos": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9979593753814697, + "min_cosine_similarity": 0.9843690395355225, + "mean_relative_l2": 0.06325507164001465, + "max_abs_delta": 20.0 + }, + "system_x": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.995922327041626, + "min_cosine_similarity": 0.9622545838356018, + "mean_relative_l2": 0.08827080577611923, + "max_abs_delta": 42.5 + }, + "system_period": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9959200620651245, + "min_cosine_similarity": 0.972229540348053, + "mean_relative_l2": 0.08836130797863007, + "max_abs_delta": 37.0 + }, + "bos_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9977632761001587, + "min_cosine_similarity": 0.9832099080085754, + "mean_relative_l2": 0.06627855449914932, + "max_abs_delta": 16.0 + }, + "bos_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9970747232437134, + "min_cosine_similarity": 0.9774815440177917, + "mean_relative_l2": 0.07453510165214539, + "max_abs_delta": 20.0 + }, + "x_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9975554943084717, + "min_cosine_similarity": 0.986723005771637, + "mean_relative_l2": 0.06997551769018173, + "max_abs_delta": 17.0 + }, + "x_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9952111840248108, + "min_cosine_similarity": 0.9730640649795532, + "mean_relative_l2": 0.09451492875814438, + "max_abs_delta": 30.0 + }, + "period_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9977383017539978, + "min_cosine_similarity": 0.9864797592163086, + "mean_relative_l2": 0.06671909987926483, + "max_abs_delta": 17.0 + }, + "period_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.995600163936615, + "min_cosine_similarity": 0.974795937538147, + "mean_relative_l2": 0.0920105129480362, + "max_abs_delta": 24.0 + } + } + }, + "final_norm": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0aa7666967d30e72c3c2718112af11090f7c988b7844526d7c6a4c993fcae1de", + "mean": -0.030581384897232056, + "std": 0.7347864508628845, + "rms": 0.7354225516319275, + "max_abs": 18.25 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1aef58d7ba593578e28c646e2f0e5d279dd219551f8426bcf2270e4ac57eb56e", + "mean": -0.02623012103140354, + "std": 0.7165364623069763, + "rms": 0.7170163989067078, + "max_abs": 24.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "98595f5674d33a04c964e157a0c7746e34107d98194979fca6f0c956631921cd", + "mean": -0.030145442113280296, + "std": 0.7337035536766052, + "rms": 0.7343226075172424, + "max_abs": 18.875 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9eb5c786aabc3074501e1484793bf59cf0a13a1efcd2f212981dc136c949d0c4", + "mean": -0.022519269958138466, + "std": 0.6942316889762878, + "rms": 0.6945967674255371, + "max_abs": 24.75 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "326fb83dc0cf9257f6a1ee98ef0a751ed17966cdc8cfc352605cad9d7d66d447", + "mean": -0.030816171318292618, + "std": 0.7379338145256042, + "rms": 0.7385769486427307, + "max_abs": 18.875 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "58b7b7feee6bd7a7117c64485b95e1873688fb82de0cbc56a4e43e112e62aaf1", + "mean": -0.026364769786596298, + "std": 0.7197664976119995, + "rms": 0.7202491760253906, + "max_abs": 23.75 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b7c24f167998bf5509aa38b6daf7f4058d7e6cb7a3a465d2cdae85c590b85a5e", + "mean": -0.030907878652215004, + "std": 0.7426014542579651, + "rms": 0.7432444095611572, + "max_abs": 19.125 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4776398ff41e0084b950734929a7a6c3294a42e44d2e761777ae342f37a3a0e6", + "mean": -0.02305656112730503, + "std": 0.701316237449646, + "rms": 0.7016951441764832, + "max_abs": 24.625 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "79a53e8ff50fc498d471fbd3adcadc8b4bbd22dbf9026a4831ef123d572cb2ed", + "mean": -0.0310379471629858, + "std": 0.7316316366195679, + "rms": 0.7322896718978882, + "max_abs": 18.375 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bfb5b5c805e4b84f7c9538d7d5d1eae3441b52a5e9407649494258aca8fc434c", + "mean": -0.026606697589159012, + "std": 0.7123432755470276, + "rms": 0.7128400206565857, + "max_abs": 23.375 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f979bcb10b5c5eef915fb887a25cc073bcc6aa5e7bb24f0e05ff7d673c5b3cc9", + "mean": -0.030695632100105286, + "std": 0.7268539667129517, + "rms": 0.7275018095970154, + "max_abs": 18.875 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "70546224c04fd062989d70cc29cef121f81c8b6a04f489ddc5e92f82eaeb2ccf", + "mean": -0.022842662408947945, + "std": 0.6881340146064758, + "rms": 0.6885130405426025, + "max_abs": 25.25 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8313bc3d3c9af723b604d171d03a24ed6d14a931628291ddad5deee71c556fbb", + "mean": -0.031062444671988487, + "std": 0.7381483912467957, + "rms": 0.7388016581535339, + "max_abs": 19.0 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "65346641b75ca4aef2dc06a1d3f83e8040d4828d14a49e17dc84422ce6c510eb", + "mean": -0.02653207816183567, + "std": 0.7195372581481934, + "rms": 0.7200262546539307, + "max_abs": 23.5 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8185eb364bdb0168a6f1bb59b21d776e681dc51ed611272bb288f14d5c93f6f4", + "mean": -0.030754467472434044, + "std": 0.7339853048324585, + "rms": 0.7346293330192566, + "max_abs": 19.0 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d5380ad808462260d59d0169bffa3d35b5690d1d79536de9e5fca0e0f8d6e4a4", + "mean": -0.022742189466953278, + "std": 0.6949408650398254, + "rms": 0.6953128576278687, + "max_abs": 25.25 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9983918070793152, + "min_cosine_similarity": 0.9894969463348389, + "mean_relative_l2": 0.05259931832551956, + "max_abs_delta": 1.4375 + }, + "system_bos": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9977622628211975, + "min_cosine_similarity": 0.9856116771697998, + "mean_relative_l2": 0.06274014711380005, + "max_abs_delta": 1.54541015625 + }, + "system_x": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9954123497009277, + "min_cosine_similarity": 0.9189777374267578, + "mean_relative_l2": 0.08418913930654526, + "max_abs_delta": 3.1875 + }, + "system_period": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9954441785812378, + "min_cosine_similarity": 0.9382176995277405, + "mean_relative_l2": 0.0840914398431778, + "max_abs_delta": 2.625 + }, + "bos_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9976590871810913, + "min_cosine_similarity": 0.9835751056671143, + "mean_relative_l2": 0.06488508731126785, + "max_abs_delta": 1.2421875 + }, + "bos_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.99686199426651, + "min_cosine_similarity": 0.9644786715507507, + "mean_relative_l2": 0.07428079843521118, + "max_abs_delta": 1.5390625 + }, + "x_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9972602725028992, + "min_cosine_similarity": 0.9813464283943176, + "mean_relative_l2": 0.07020466029644012, + "max_abs_delta": 1.4375 + }, + "x_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9943917989730835, + "min_cosine_similarity": 0.9531116485595703, + "mean_relative_l2": 0.09730320423841476, + "max_abs_delta": 2.6875 + }, + "period_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.99759840965271, + "min_cosine_similarity": 0.9811949729919434, + "mean_relative_l2": 0.06522314250469208, + "max_abs_delta": 1.375 + }, + "period_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9950127005577087, + "min_cosine_similarity": 0.9603859186172485, + "mean_relative_l2": 0.09102045744657516, + "max_abs_delta": 2.15625 + } + } + } + }, + "router_layers": { + "layer_01": { + "layer": 1, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "589f427b6e0bb3519d3887d6c185ace6919c60b5fefaebd0ddcde0f8c39ba3db", + "route_weight_sha256": "a7c680efdc231bb9c9006c7895b67462a0d9264963716045ac2e20d5624a100f", + "loads": [ + 11, + 14, + 4, + 15, + 5, + 10, + 13, + 6, + 16, + 6, + 17, + 7, + 18, + 7, + 5, + 9, + 8, + 4, + 21, + 19, + 2, + 20, + 13, + 16, + 16, + 2, + 14, + 9, + 4, + 7, + 9, + 8, + 2, + 10, + 8, + 18, + 5, + 16, + 6, + 8, + 16, + 20, + 4, + 9, + 9, + 8, + 5, + 12, + 10, + 7, + 4, + 5, + 10, + 15, + 22, + 5, + 9, + 6, + 4, + 14, + 2, + 18, + 7, + 7 + ], + "weighted_loads": [ + 0.7114781439304352, + 1.0018724165856838, + 0.21652577072381973, + 1.1304023321717978, + 0.6027305871248245, + 0.9781888127326965, + 0.6202144883573055, + 0.3490325193852186, + 0.7213996928185225, + 0.43863486126065254, + 0.9381683208048344, + 0.48708040080964565, + 0.5185950640588999, + 0.515726663172245, + 0.24716797471046448, + 0.4581745509058237, + 0.3563226405531168, + 0.10935663990676403, + 1.6291352063417435, + 1.450070597231388, + 0.10909216478466988, + 2.1608668863773346, + 0.5092788301408291, + 1.0281732305884361, + 1.0971226524561644, + 0.0930091105401516, + 0.5318365935236216, + 0.36801241897046566, + 0.1484958902001381, + 0.29764341190457344, + 0.6110510788857937, + 0.6081428080797195, + 0.05180734023451805, + 0.3511987682431936, + 0.6708192359656096, + 1.0642505753785372, + 0.234678627923131, + 0.9187040347605944, + 0.3048494700342417, + 0.5465450622141361, + 0.8485316373407841, + 1.302207237109542, + 0.21413935907185078, + 0.6563743259757757, + 0.5554541312158108, + 0.692082904279232, + 0.5869445689022541, + 0.7525439523160458, + 0.45867073722183704, + 0.5471929255872965, + 0.1991474535316229, + 0.45734043046832085, + 0.8206064291298389, + 0.7405685074627399, + 1.5629965607076883, + 0.25180409476161003, + 0.2767060399055481, + 0.23906048946082592, + 0.12303046509623528, + 1.0761499218642712, + 0.05467807129025459, + 1.6203271597623825, + 0.5664559844881296, + 0.6221146434545517 + ], + "unique_experts": 64, + "load_cv": 0.5415748066808126, + "normalized_load_entropy": 0.9644490447061523, + "max_load_share": 0.03459119496855346 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "1fd413308b0f80843f5e0f6be689657a3d46c5b1d698d7adff8faf835ad272dd", + "route_weight_sha256": "b525873e47aa37089248587e37e1cb17fe1b2f40fe4b88cb55fd4e8fdc18c183", + "loads": [ + 11, + 14, + 6, + 15, + 9, + 10, + 15, + 9, + 33, + 6, + 19, + 7, + 18, + 7, + 5, + 18, + 8, + 6, + 21, + 19, + 6, + 21, + 14, + 16, + 16, + 6, + 27, + 9, + 4, + 7, + 10, + 13, + 3, + 13, + 8, + 18, + 5, + 16, + 6, + 11, + 17, + 30, + 4, + 14, + 10, + 19, + 6, + 12, + 10, + 8, + 8, + 6, + 14, + 15, + 25, + 9, + 12, + 14, + 4, + 25, + 3, + 22, + 7, + 7 + ], + "weighted_loads": [ + 0.7114781439304352, + 1.0018724165856838, + 0.3189222142100334, + 1.1304023321717978, + 0.7650192938745022, + 0.9781888127326965, + 0.7487008944153786, + 0.6354453321546316, + 1.6720220688730478, + 0.43863486126065254, + 1.179211225360632, + 0.48708040080964565, + 0.5185950640588999, + 0.515726663172245, + 0.24716797471046448, + 1.0752208288758993, + 0.3563226405531168, + 0.2125642243772745, + 1.6291352063417435, + 1.450070597231388, + 0.4172936286777258, + 2.1814454589039087, + 0.5394217874854803, + 1.0281732305884361, + 1.0971226524561644, + 0.2616884969174862, + 1.343967318534851, + 0.36801241897046566, + 0.1484958902001381, + 0.29764341190457344, + 0.6849880553781986, + 1.0080372410011478, + 0.11345990747213364, + 0.5784634035080671, + 0.6708192359656096, + 1.0642505753785372, + 0.234678627923131, + 0.9187040347605944, + 0.3048494700342417, + 0.7893244214355946, + 0.8799314126372337, + 1.714035650715232, + 0.21413935907185078, + 0.7658744509099051, + 1.5398246608674526, + 1.5118728563538752, + 0.682605717331171, + 0.7525439523160458, + 0.45867073722183704, + 0.5698450300842524, + 0.34697335213422775, + 0.45794428046792746, + 1.1003385968506336, + 0.7405685074627399, + 1.6083772358542774, + 0.7815837077796459, + 0.5536059699952602, + 0.721646036952734, + 0.12303046509623528, + 1.7931708246469498, + 0.14555662497878075, + 1.8384420275688171, + 0.5664559844881296, + 0.6221146434545517 + ], + "unique_experts": 64, + "load_cv": 0.5523387109868286, + "normalized_load_entropy": 0.9651575367167546, + "max_load_share": 0.04198473282442748 + } + }, + "s1_eos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "543863c9d5ae1ae89c2f6ae521cc4d50b96edd86fd66b3474ee252091cabff9e", + "route_weight_sha256": "29b26da9204877338151b8399f4cf73a3197347b709f1c60742e489e4f393945", + "loads": [ + 12, + 14, + 4, + 16, + 5, + 10, + 13, + 8, + 16, + 6, + 17, + 9, + 14, + 7, + 4, + 10, + 8, + 2, + 21, + 19, + 3, + 21, + 16, + 16, + 16, + 2, + 11, + 8, + 4, + 7, + 10, + 8, + 0, + 6, + 8, + 18, + 6, + 16, + 6, + 8, + 16, + 22, + 3, + 9, + 11, + 8, + 5, + 11, + 10, + 8, + 4, + 5, + 10, + 17, + 22, + 5, + 8, + 6, + 6, + 13, + 1, + 17, + 7, + 7 + ], + "weighted_loads": [ + 0.7331828232854605, + 1.0364174582064152, + 0.21342474222183228, + 1.172524333000183, + 0.6023660153150558, + 0.9609161466360092, + 0.5797424372285604, + 0.39067923463881016, + 0.6616966929286718, + 0.4373421110212803, + 0.960180539637804, + 0.5244065877050161, + 0.4166687335819006, + 0.5424383282661438, + 0.2094617746770382, + 0.4888872690498829, + 0.34512652456760406, + 0.060150280594825745, + 1.631028924137354, + 1.4567217603325844, + 0.12738431990146637, + 2.2203673236072063, + 0.5833244472742081, + 1.0206068120896816, + 1.0524334236979485, + 0.0946536734700203, + 0.4626818597316742, + 0.31418205983936787, + 0.14945408888161182, + 0.3009668719023466, + 0.6414275541901588, + 0.6054574735462666, + 0.0, + 0.20023133605718613, + 0.6709555722773075, + 1.0539261847734451, + 0.26168014481663704, + 0.9415430631488562, + 0.30693013221025467, + 0.5419005528092384, + 0.858414089307189, + 1.415518717840314, + 0.1888924092054367, + 0.6557684782892466, + 0.6173567846417427, + 0.6996145285665989, + 0.5821901746094227, + 0.7377040237188339, + 0.4619214851409197, + 0.5755097400397062, + 0.19675847329199314, + 0.45068054646253586, + 0.8260796181857586, + 0.7884181011468172, + 1.5963700488209724, + 0.24325692653656006, + 0.259118665009737, + 0.2425660416483879, + 0.17579678632318974, + 1.0449835434556007, + 0.03192185238003731, + 1.6004619859158993, + 0.5583796706050634, + 0.6223800927400589 + ], + "unique_experts": 63, + "load_cv": 0.5557058457369999, + "normalized_load_entropy": 0.9610338614963312, + "max_load_share": 0.03459119496855346 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "3e2ee860b11dbba43959fd163326990b552bb5abbbdd956b6c72092e4965f37e", + "route_weight_sha256": "dc2a7e6ddca445bfc7ba3a6f9b47530139f1e559317c61a9804d6220e9ee5d21", + "loads": [ + 14, + 14, + 7, + 16, + 12, + 12, + 15, + 12, + 39, + 6, + 22, + 10, + 14, + 8, + 4, + 22, + 8, + 8, + 22, + 20, + 7, + 24, + 21, + 17, + 18, + 7, + 31, + 9, + 4, + 9, + 12, + 15, + 1, + 8, + 8, + 18, + 7, + 17, + 6, + 13, + 17, + 34, + 6, + 15, + 13, + 19, + 6, + 14, + 12, + 9, + 13, + 9, + 15, + 17, + 27, + 9, + 17, + 18, + 8, + 24, + 3, + 22, + 7, + 11 + ], + "weighted_loads": [ + 0.838549317792058, + 1.0364174582064152, + 0.3791877031326294, + 1.172524333000183, + 0.9992882683873177, + 1.098204329609871, + 0.6877038460224867, + 0.646762166172266, + 2.0338798258453608, + 0.4373421110212803, + 1.3941657468676567, + 0.6712372060865164, + 0.4166687335819006, + 0.582404013723135, + 0.2094617746770382, + 1.193025216460228, + 0.34512652456760406, + 0.29270975664258003, + 1.670078668743372, + 1.5227903574705124, + 0.3735993951559067, + 2.4453012216836214, + 0.8544667383830529, + 1.054947067052126, + 1.1242657862603664, + 0.29007013887166977, + 1.777590123936534, + 0.3565009292215109, + 0.14945408888161182, + 0.46324763260781765, + 0.8005950823426247, + 1.2318723424396012, + 0.049505215138196945, + 0.3429843746125698, + 0.6709555722773075, + 1.0539261847734451, + 0.5205957181751728, + 0.9751638453453779, + 0.30693013221025467, + 0.9024659469723701, + 0.8911459650844336, + 1.9891606755554676, + 0.396454855799675, + 0.8535954505205154, + 1.758445881307125, + 1.4674606907065026, + 0.6753115244209766, + 0.8206557006633375, + 0.6131650619208813, + 0.5985772628337145, + 0.6299546901136637, + 0.8156060390174389, + 1.1693581007421017, + 0.7884181011468172, + 1.6902688810369, + 0.74941336363554, + 0.6910807620733976, + 0.9507757611572742, + 0.25096466206014156, + 1.716790609061718, + 0.14770853705704212, + 1.9104448147118092, + 0.5583796706050634, + 1.114692397415638 + ], + "unique_experts": 64, + "load_cv": 0.5386668924007019, + "normalized_load_entropy": 0.9664519772940311, + "max_load_share": 0.04421768707482993 + } + }, + "s0_bos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "ca1f17a755612297c92a597f68b5d9c8d6c84e427b20d9493abaecb682bd822e", + "route_weight_sha256": "bdd4e9e5bf0974bf3cce948ab5f6ebd2b4dbcae9d6411aa54b001ce038c63e19", + "loads": [ + 12, + 13, + 4, + 15, + 5, + 10, + 16, + 8, + 15, + 6, + 18, + 10, + 16, + 7, + 5, + 14, + 4, + 7, + 19, + 19, + 2, + 19, + 14, + 16, + 17, + 2, + 9, + 9, + 3, + 9, + 9, + 8, + 3, + 9, + 8, + 17, + 5, + 15, + 6, + 8, + 17, + 17, + 4, + 13, + 10, + 8, + 5, + 14, + 6, + 6, + 5, + 5, + 10, + 13, + 21, + 5, + 11, + 6, + 2, + 14, + 1, + 18, + 7, + 7 + ], + "weighted_loads": [ + 0.7546841334551573, + 0.9624247029423714, + 0.22529194876551628, + 1.1489359587430954, + 0.5400380976498127, + 0.8492179960012436, + 0.7508574370294809, + 0.396746501326561, + 0.537418132647872, + 0.4767244979739189, + 1.0240165684372187, + 0.5849198382347822, + 0.4817309360951185, + 0.4589212164282799, + 0.2629626579582691, + 0.6666236966848373, + 0.23490938171744347, + 0.20721746236085892, + 1.4535474590957165, + 1.4581922739744186, + 0.10394937545061111, + 2.0148737393319607, + 0.5393449123948812, + 1.0940592046827078, + 1.119284825399518, + 0.09180358797311783, + 0.39515569992363453, + 0.3550729304552078, + 0.11851632595062256, + 0.3697553649544716, + 0.5949703678488731, + 0.5705456957221031, + 0.08538916520774364, + 0.31486478820443153, + 0.6928666662424803, + 0.9655433408915997, + 0.2506106495857239, + 0.8849245943129063, + 0.3152655754238367, + 0.5618991106748581, + 0.8726208172738552, + 1.0097223166376352, + 0.21600002236664295, + 0.7469017673283815, + 0.6008340921252966, + 0.6383213400840759, + 0.5880758389830589, + 0.8183975480496883, + 0.34763846360147, + 0.5249276235699654, + 0.2437612134963274, + 0.46300413087010384, + 0.8553606458008289, + 0.6708247419446707, + 1.5811349339783192, + 0.2499282006174326, + 0.3624242711812258, + 0.1980949230492115, + 0.07908011227846146, + 1.0263303592801094, + 0.025899279862642288, + 1.6458030808717012, + 0.5515212640166283, + 0.6067164465785027 + ], + "unique_experts": 64, + "load_cv": 0.527964852061631, + "normalized_load_entropy": 0.964803467734659, + "max_load_share": 0.0330188679245283 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "c03a09bc2cf8ea31fd37100d11536690670b633bba7c4db7e03daf4cef1f78c8", + "route_weight_sha256": "d5c8973ed2a0ab5fefba661dabdc44c51f57060bd0c032124699c683449d6a6e", + "loads": [ + 13, + 13, + 6, + 15, + 9, + 10, + 18, + 11, + 31, + 6, + 20, + 11, + 17, + 7, + 5, + 23, + 4, + 10, + 19, + 19, + 6, + 19, + 15, + 16, + 17, + 6, + 22, + 9, + 3, + 9, + 10, + 12, + 4, + 11, + 8, + 17, + 5, + 15, + 6, + 11, + 18, + 28, + 5, + 17, + 10, + 19, + 7, + 14, + 6, + 6, + 9, + 5, + 14, + 13, + 23, + 9, + 15, + 15, + 2, + 24, + 3, + 22, + 7, + 7 + ], + "weighted_loads": [ + 0.7782156802713871, + 0.9624247029423714, + 0.31059621647000313, + 1.1489359587430954, + 0.6966253370046616, + 0.8492179960012436, + 0.883550463244319, + 0.6755038555711508, + 1.3934963177889585, + 0.4767244979739189, + 1.260302783921361, + 0.6094700768589973, + 0.5137459803372622, + 0.4589212164282799, + 0.2629626579582691, + 1.283669974654913, + 0.23490938171744347, + 0.34736286848783493, + 1.4535474590957165, + 1.4581922739744186, + 0.3789036553353071, + 2.0148737393319607, + 0.5694878697395325, + 1.0940592046827078, + 1.119284825399518, + 0.26533403620123863, + 1.204012218862772, + 0.3550729304552078, + 0.11851632595062256, + 0.3697553649544716, + 0.6688577458262444, + 0.9995884671807289, + 0.14704173244535923, + 0.5034292675554752, + 0.6928666662424803, + 0.9655433408915997, + 0.2506106495857239, + 0.8849245943129063, + 0.3152655754238367, + 0.8075179979205132, + 0.9037816636264324, + 1.4403171613812447, + 0.2587823402136564, + 0.8559201657772064, + 0.6008340921252966, + 1.4939791038632393, + 0.7318166885524988, + 0.8183975480496883, + 0.34763846360147, + 0.5249276235699654, + 0.39599376544356346, + 0.46300413087010384, + 1.1262078881263733, + 0.6708247419446707, + 1.6260651145130396, + 0.7826385516673326, + 0.7035312559455633, + 0.7569326609373093, + 0.07908011227846146, + 1.7100075334310532, + 0.22151431813836098, + 1.8680704589933157, + 0.5515212640166283, + 0.6067164465785027 + ], + "unique_experts": 64, + "load_cv": 0.5309171128575806, + "normalized_load_entropy": 0.9661493516981463, + "max_load_share": 0.039440203562340966 + } + }, + "s1_bos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "d09bc80fe1cb534d0ef31fba8d7d12c4904e14cb12d118e146cbb734cb7751a4", + "route_weight_sha256": "e956b03129babbf6bba24049989c5ed26ef95ed13230af853266803564acc323", + "loads": [ + 12, + 14, + 4, + 15, + 5, + 10, + 12, + 10, + 15, + 6, + 17, + 10, + 12, + 7, + 4, + 12, + 5, + 4, + 19, + 19, + 2, + 20, + 15, + 16, + 16, + 2, + 23, + 7, + 4, + 9, + 10, + 8, + 0, + 5, + 8, + 17, + 5, + 15, + 7, + 8, + 15, + 20, + 3, + 10, + 13, + 8, + 5, + 13, + 12, + 6, + 5, + 5, + 10, + 14, + 22, + 5, + 8, + 6, + 2, + 13, + 1, + 17, + 7, + 7 + ], + "weighted_loads": [ + 0.7042935322970152, + 1.0547708831727505, + 0.21066130697727203, + 1.1425827704370022, + 0.5469395853579044, + 0.9070250988006592, + 0.5853596888482571, + 0.44649275206029415, + 0.5320233646780252, + 0.45410894975066185, + 0.9729130119085312, + 0.5725029893219471, + 0.3684030622243881, + 0.4737158101052046, + 0.19455355033278465, + 0.5995308123528957, + 0.25792259350419044, + 0.11421572789549828, + 1.4006634373217821, + 1.4278417080640793, + 0.10198807716369629, + 2.1462858747690916, + 0.5755712017416954, + 1.0490125603973866, + 1.0341132525354624, + 0.09466978907585144, + 0.7944580856710672, + 0.27773912250995636, + 0.14806489273905754, + 0.3680972885340452, + 0.633908299729228, + 0.5791554376482964, + 0.0, + 0.1611360851675272, + 0.6969879008829594, + 0.9532034955918789, + 0.25634062848985195, + 0.8615538068115711, + 0.3378109931945801, + 0.5388953238725662, + 0.7516170032322407, + 1.289248514920473, + 0.18538745492696762, + 0.6668430492281914, + 0.6937577407807112, + 0.6420814767479897, + 0.5896135754883289, + 0.8234854396432638, + 0.4967685993760824, + 0.5200532004237175, + 0.23777201771736145, + 0.4554060995578766, + 0.8577531166374683, + 0.6915864013135433, + 1.6271856352686882, + 0.23913463950157166, + 0.2870222460478544, + 0.2001776620745659, + 0.06966651789844036, + 1.0209041088819504, + 0.02808283269405365, + 1.6086371634155512, + 0.5323869585990906, + 0.5999138504266739 + ], + "unique_experts": 63, + "load_cv": 0.5593949841650413, + "normalized_load_entropy": 0.9598489947388626, + "max_load_share": 0.036163522012578615 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "0d8c8f0cd16da8c268ad88541899400ef50d2613e42594979d4944bb4a20cc3d", + "route_weight_sha256": "f23caadd157489adb8b7487d39dd506656124968dc3c13f8fd4c513aca8ccd0c", + "loads": [ + 15, + 14, + 7, + 16, + 12, + 12, + 14, + 14, + 37, + 6, + 22, + 11, + 12, + 8, + 4, + 24, + 5, + 10, + 20, + 20, + 5, + 22, + 19, + 17, + 18, + 7, + 43, + 8, + 4, + 11, + 12, + 14, + 1, + 7, + 8, + 17, + 6, + 16, + 7, + 13, + 16, + 32, + 7, + 16, + 14, + 19, + 7, + 15, + 14, + 7, + 14, + 9, + 15, + 14, + 27, + 9, + 18, + 20, + 4, + 23, + 4, + 22, + 7, + 11 + ], + "weighted_loads": [ + 0.83193071000278, + 1.0547708831727505, + 0.36276572570204735, + 1.1742998696863651, + 0.9395125173032284, + 1.0443132817745209, + 0.6814788579940796, + 0.693437771871686, + 1.7989749182015657, + 0.45410894975066185, + 1.4009301252663136, + 0.7193336077034473, + 0.3684030622243881, + 0.5136814955621958, + 0.19455355033278465, + 1.3036687597632408, + 0.25792259350419044, + 0.3484102077782154, + 1.4397131819278002, + 1.4939103052020073, + 0.2959448844194412, + 2.3508627098053694, + 0.8464046958833933, + 1.0833528153598309, + 1.1059456150978804, + 0.2969457507133484, + 2.114833977073431, + 0.3200579918920994, + 0.14806489273905754, + 0.5303780492395163, + 0.796668229624629, + 1.2312960848212242, + 0.049505215138196945, + 0.3010237533599138, + 0.6969879008829594, + 0.9532034955918789, + 0.5152562018483877, + 0.8951745890080929, + 0.3378109931945801, + 0.9029073268175125, + 0.7814347203820944, + 1.8628904726356268, + 0.42929232865571976, + 0.8646700214594603, + 0.8458098601549864, + 1.443515133112669, + 0.7391833905130625, + 0.9061232823878527, + 0.648012176156044, + 0.5400333944708109, + 0.6848255544900894, + 0.8203315921127796, + 1.1758075095713139, + 0.6915864013135433, + 1.7402011957019567, + 0.743575744330883, + 0.7733644545078278, + 1.0056033991277218, + 0.1448343936353922, + 1.6580606922507286, + 0.24620863609015942, + 1.9214028809219599, + 0.5323869585990906, + 1.092226155102253 + ], + "unique_experts": 64, + "load_cv": 0.5685372990888663, + "normalized_load_entropy": 0.9635388713381974, + "max_load_share": 0.048752834467120185 + } + }, + "s0_x": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "02dc371a07f33b617d47d6e71220cf7d9b1394a4e653a3ddced4f07b735aa796", + "route_weight_sha256": "6ccc3225765c2a4de6ce3edb5f6af6535f7d9bfe635160f531fa1e45225226d1", + "loads": [ + 12, + 12, + 4, + 15, + 5, + 10, + 15, + 6, + 18, + 6, + 19, + 10, + 18, + 7, + 6, + 12, + 4, + 8, + 19, + 19, + 2, + 20, + 11, + 16, + 17, + 2, + 16, + 8, + 3, + 8, + 9, + 8, + 3, + 9, + 7, + 15, + 5, + 15, + 4, + 8, + 17, + 18, + 3, + 13, + 10, + 8, + 5, + 13, + 9, + 6, + 4, + 5, + 10, + 13, + 23, + 5, + 9, + 6, + 2, + 13, + 1, + 18, + 7, + 7 + ], + "weighted_loads": [ + 0.7370364535599947, + 0.9398941658437252, + 0.21531904116272926, + 1.1030369102954865, + 0.5575645603239536, + 0.9653187058866024, + 0.7348634656518698, + 0.3532760515809059, + 0.6650340147316456, + 0.4610063284635544, + 1.0478470139205456, + 0.562158852815628, + 0.53134442307055, + 0.47148582339286804, + 0.2659936435520649, + 0.5841699820011854, + 0.23260588385164738, + 0.23188264295458794, + 1.5062903985381126, + 1.4157474413514137, + 0.1043412983417511, + 2.1176374182105064, + 0.4608166478574276, + 1.0432574916630983, + 1.164162801578641, + 0.09192242473363876, + 0.5904727373272181, + 0.33052106760442257, + 0.11790814250707626, + 0.3312660753726959, + 0.5906205326318741, + 0.5787106081843376, + 0.08568439818918705, + 0.3182668536901474, + 0.6549130044877529, + 0.9188365247100592, + 0.23999354429543018, + 0.9210362229496241, + 0.24995082803070545, + 0.5535029955208302, + 0.9316729474812746, + 1.1454162616282701, + 0.18974428996443748, + 0.7544130831956863, + 0.5843784417957067, + 0.6609972827136517, + 0.5927270725369453, + 0.7674356568604708, + 0.42960044741630554, + 0.5096577554941177, + 0.20343686267733574, + 0.47202277928590775, + 0.8357914574444294, + 0.6684886384755373, + 1.6929289307445288, + 0.2485658172518015, + 0.3009886797517538, + 0.20927886106073856, + 0.07841718196868896, + 1.0143112987279892, + 0.028426816686987877, + 1.6027291044592857, + 0.5525876842439175, + 0.6092501096427441 + ], + "unique_experts": 64, + "load_cv": 0.551131469004925, + "normalized_load_entropy": 0.9622017995872615, + "max_load_share": 0.036163522012578615 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "90d4102604e794371a2124d28a1d5810e37057ef99064749961018fb0c439d06", + "route_weight_sha256": "a4283fd581cc59ac5a62038212323fe82b04fa5b6b0a5049f40d49a65406ad19", + "loads": [ + 12, + 12, + 6, + 15, + 9, + 10, + 17, + 9, + 34, + 7, + 21, + 10, + 19, + 7, + 6, + 22, + 4, + 10, + 19, + 19, + 5, + 21, + 13, + 16, + 17, + 6, + 30, + 8, + 3, + 8, + 10, + 12, + 4, + 11, + 7, + 15, + 5, + 15, + 4, + 11, + 18, + 30, + 3, + 17, + 10, + 20, + 6, + 13, + 9, + 7, + 8, + 5, + 14, + 13, + 25, + 9, + 12, + 14, + 2, + 24, + 2, + 22, + 7, + 7 + ], + "weighted_loads": [ + 0.7370364535599947, + 0.9398941658437252, + 0.30974672734737396, + 1.1030369102954865, + 0.7162474989891052, + 0.9653187058866024, + 0.8700889516621828, + 0.6521381251513958, + 1.5235714875161648, + 0.48733612336218357, + 1.2876325137913227, + 0.562158852815628, + 0.565522151067853, + 0.47148582339286804, + 0.2659936435520649, + 1.318062113597989, + 0.23260588385164738, + 0.3367628864943981, + 1.5062903985381126, + 1.4157474413514137, + 0.3588300943374634, + 2.1373779755085707, + 0.5218177400529385, + 1.0432574916630983, + 1.164162801578641, + 0.26983996108174324, + 1.4314583409577608, + 0.33052106760442257, + 0.11790814250707626, + 0.3312660753726959, + 0.6673721224069595, + 1.0227291136980057, + 0.14733696542680264, + 0.5099507011473179, + 0.6549130044877529, + 0.9188365247100592, + 0.23999354429543018, + 0.9210362229496241, + 0.24995082803070545, + 0.8224404193460941, + 0.9643615130335093, + 1.6311912760138512, + 0.18974428996443748, + 0.8634314816445112, + 0.5843784417957067, + 1.5504138134419918, + 0.7144491970539093, + 0.7674356568604708, + 0.42960044741630554, + 0.5288806110620499, + 0.35425860807299614, + 0.47202277928590775, + 1.089277297258377, + 0.6684886384755373, + 1.7378591112792492, + 0.8029562477022409, + 0.4929502513259649, + 0.6888207644224167, + 0.07841718196868896, + 1.7965906634926796, + 0.11930537037551403, + 1.820070307701826, + 0.5525876842439175, + 0.6092501096427441 + ], + "unique_experts": 64, + "load_cv": 0.5828194144978662, + "normalized_load_entropy": 0.9606291459635847, + "max_load_share": 0.043256997455470736 + } + }, + "s1_x": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "9c6a3a62830f6e940dfe2963b160ec5760c8ab49c573189c9c1dc8db201ff246", + "route_weight_sha256": "857e0acd1b3fd66735e74da9f2a8eb3f5cdb414d43b0dbe42eb56d8cddb99522", + "loads": [ + 12, + 14, + 4, + 15, + 5, + 10, + 13, + 6, + 14, + 6, + 17, + 10, + 10, + 7, + 4, + 11, + 6, + 2, + 18, + 19, + 3, + 20, + 16, + 15, + 16, + 2, + 28, + 7, + 5, + 8, + 10, + 8, + 1, + 5, + 8, + 17, + 5, + 14, + 5, + 8, + 15, + 24, + 3, + 10, + 12, + 9, + 5, + 13, + 11, + 6, + 5, + 5, + 10, + 16, + 22, + 5, + 8, + 6, + 1, + 13, + 1, + 17, + 8, + 7 + ], + "weighted_loads": [ + 0.6842167396098375, + 1.0477829091250896, + 0.20179082080721855, + 1.1101531460881233, + 0.5566173270344734, + 0.9383680149912834, + 0.6172869391739368, + 0.35145774856209755, + 0.5006166156381369, + 0.43915044143795967, + 0.970922376960516, + 0.5621870346367359, + 0.31893135234713554, + 0.48360247164964676, + 0.17823120020329952, + 0.5559966843575239, + 0.2852078229188919, + 0.0658087320625782, + 1.3682262115180492, + 1.3957143127918243, + 0.12205950729548931, + 2.173196792602539, + 0.6100342124700546, + 0.99234414473176, + 1.052112691104412, + 0.09459133818745613, + 0.969204742461443, + 0.27628539502620697, + 0.17554671131074429, + 0.33469147980213165, + 0.6400393303483725, + 0.5762586295604706, + 0.026766974478960037, + 0.1603471077978611, + 0.6877364125102758, + 0.9609379395842552, + 0.2501257620751858, + 0.8328101355582476, + 0.2787789087742567, + 0.537701889872551, + 0.7913097515702248, + 1.4812785778194666, + 0.1843406744301319, + 0.6663247141987085, + 0.666444206610322, + 0.6734446510672569, + 0.5901354588568211, + 0.8137218654155731, + 0.4766198471188545, + 0.5137098729610443, + 0.2319443766027689, + 0.4578166604042053, + 0.8538311831653118, + 0.7410332132130861, + 1.6203330252319574, + 0.238302331417799, + 0.2876730393618345, + 0.20493794418871403, + 0.04614117741584778, + 1.0207798406481743, + 0.029889877885580063, + 1.5789940729737282, + 0.552195705473423, + 0.5977233499288559 + ], + "unique_experts": 64, + "load_cv": 0.5928986558484998, + "normalized_load_entropy": 0.9572969025167835, + "max_load_share": 0.0440251572327044 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "a17ce5796e017ec12c477aae1a37e5a118c7ff50f366ed9f519371c37f1fc397", + "route_weight_sha256": "0646522b26d3e46c010d9559f26b6a891ba3554d806653186e2d432dc29575cf", + "loads": [ + 14, + 14, + 7, + 15, + 12, + 12, + 15, + 12, + 36, + 7, + 22, + 11, + 10, + 8, + 4, + 24, + 6, + 8, + 19, + 20, + 6, + 22, + 20, + 16, + 18, + 7, + 49, + 8, + 5, + 10, + 12, + 14, + 2, + 7, + 8, + 17, + 6, + 15, + 5, + 13, + 16, + 37, + 6, + 16, + 13, + 21, + 7, + 15, + 13, + 7, + 14, + 9, + 15, + 16, + 26, + 9, + 17, + 18, + 3, + 24, + 3, + 22, + 8, + 11 + ], + "weighted_loads": [ + 0.789583234116435, + 1.0477829091250896, + 0.36131536960601807, + 1.1101531460881233, + 0.9492043145000935, + 1.0756561979651451, + 0.7104350849986076, + 0.6550053432583809, + 1.7597002554684877, + 0.4640343561768532, + 1.3978906124830246, + 0.7090176530182362, + 0.31893135234713554, + 0.523568157106638, + 0.17823120020329952, + 1.3712008092552423, + 0.2852078229188919, + 0.30087266489863396, + 1.4072759561240673, + 1.4617829099297523, + 0.31566206365823746, + 2.377773627638817, + 0.8808677066117525, + 1.0266843996942043, + 1.12394505366683, + 0.3016520217061043, + 2.3348216731101274, + 0.31860426440835, + 0.17554671131074429, + 0.4969722405076027, + 0.805811895057559, + 1.2351627945899963, + 0.07627218961715698, + 0.30285292491316795, + 0.6877364125102758, + 0.9609379395842552, + 0.5090413354337215, + 0.8664309177547693, + 0.2787789087742567, + 0.919755756855011, + 0.8211686015129089, + 2.1214220635592937, + 0.3919031210243702, + 0.8641516864299774, + 0.8184963259845972, + 1.5104322172701359, + 0.745535921305418, + 0.896359708160162, + 0.6278634238988161, + 0.5336559452116489, + 0.6787099931389093, + 0.8227421529591084, + 1.155722714960575, + 0.7410332132130861, + 1.7138104867190123, + 0.75426110252738, + 0.6454546228051186, + 0.906862473115325, + 0.1213090531527996, + 1.7521514594554901, + 0.14567656256258488, + 1.8875319249927998, + 0.552195705473423, + 1.090035654604435 + ], + "unique_experts": 64, + "load_cv": 0.6074347027077821, + "normalized_load_entropy": 0.960624474421995, + "max_load_share": 0.05555555555555555 + } + }, + "s0_period": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "f9a1b1824cf4d59a939acf3547278e98b2d75b79e2ad72ae7e0f9219fb9ccd89", + "route_weight_sha256": "6fceae65e123c761ccc17d424788cd2661c5afa924c8e1262f110a8fffa2ec69", + "loads": [ + 12, + 12, + 4, + 15, + 5, + 10, + 14, + 7, + 18, + 6, + 19, + 9, + 18, + 7, + 6, + 12, + 4, + 8, + 19, + 19, + 2, + 20, + 11, + 16, + 17, + 2, + 15, + 8, + 3, + 8, + 9, + 8, + 3, + 9, + 7, + 15, + 5, + 15, + 4, + 8, + 17, + 18, + 3, + 13, + 11, + 8, + 5, + 13, + 9, + 6, + 4, + 5, + 10, + 13, + 23, + 5, + 10, + 6, + 2, + 13, + 1, + 18, + 7, + 7 + ], + "weighted_loads": [ + 0.7346339263021946, + 0.9492479525506496, + 0.2153097465634346, + 1.1031599678099155, + 0.5545664243400097, + 0.9654400609433651, + 0.7006708085536957, + 0.3726238440722227, + 0.654806537553668, + 0.459777656942606, + 1.049211259931326, + 0.5376362688839436, + 0.5307161342352629, + 0.47762247547507286, + 0.26795448549091816, + 0.5833627451211214, + 0.230966379866004, + 0.23158452846109867, + 1.5025542248040438, + 1.4217468574643135, + 0.10494358837604523, + 2.1189355105161667, + 0.46108129248023033, + 1.0428463444113731, + 1.1674342900514603, + 0.09208666533231735, + 0.5617915149778128, + 0.33179498836398125, + 0.11816494725644588, + 0.33122350834310055, + 0.5934871267527342, + 0.5785197019577026, + 0.08452259376645088, + 0.3168164025992155, + 0.6549951676279306, + 0.921391611918807, + 0.24181456118822098, + 0.9236911628395319, + 0.2512537855654955, + 0.5551440268754959, + 0.9417764656245708, + 1.1470824498683214, + 0.18974540010094643, + 0.7549308184534311, + 0.6200654823333025, + 0.6611506454646587, + 0.5927050299942493, + 0.7731582913547754, + 0.42726106010377407, + 0.5112299546599388, + 0.20284431241452694, + 0.46914440020918846, + 0.8300229907035828, + 0.6728824693709612, + 1.6957165971398354, + 0.24780815839767456, + 0.3337094746530056, + 0.20584658533334732, + 0.07890937104821205, + 1.0135986618697643, + 0.02846958115696907, + 1.6044418271631002, + 0.5467713493853807, + 0.6130482405424118 + ], + "unique_experts": 64, + "load_cv": 0.5473866410543777, + "normalized_load_entropy": 0.962652757340139, + "max_load_share": 0.036163522012578615 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "e218fd5d058e4a500635bc1042d52e4c760a4bfe5fb2dc624927c209d69ae098", + "route_weight_sha256": "cb60d53d6c9e0be512a1642fed132f3ad1ce9097b210bbebaea1f3eccb350b94", + "loads": [ + 12, + 12, + 6, + 15, + 10, + 10, + 16, + 9, + 34, + 7, + 21, + 11, + 19, + 7, + 6, + 21, + 4, + 10, + 19, + 19, + 5, + 21, + 12, + 16, + 17, + 6, + 28, + 8, + 3, + 8, + 10, + 12, + 4, + 11, + 7, + 16, + 5, + 15, + 4, + 11, + 18, + 29, + 3, + 18, + 11, + 19, + 6, + 13, + 10, + 7, + 8, + 6, + 14, + 13, + 25, + 9, + 13, + 13, + 2, + 24, + 2, + 22, + 7, + 7 + ], + "weighted_loads": [ + 0.7346339263021946, + 0.9492479525506496, + 0.3008318766951561, + 1.1031599678099155, + 0.8344881385564804, + 0.9654400609433651, + 0.8356729112565517, + 0.6240116711705923, + 1.4870900437235832, + 0.48531064949929714, + 1.2889690436422825, + 0.6986723653972149, + 0.5631053876131773, + 0.47762247547507286, + 0.26795448549091816, + 1.200409023091197, + 0.230966379866004, + 0.33600073121488094, + 1.5025542248040438, + 1.4217468574643135, + 0.35938119143247604, + 2.1388852801173925, + 0.49122424982488155, + 1.0428463444113731, + 1.1674342900514603, + 0.2698254734277725, + 1.372706577181816, + 0.33179498836398125, + 0.11816494725644588, + 0.33122350834310055, + 0.6743154432624578, + 1.0239415168762207, + 0.14617516100406647, + 0.5076935682445765, + 0.6549951676279306, + 0.9426993913948536, + 0.24181456118822098, + 0.9236911628395319, + 0.2512537855654955, + 0.80501938611269, + 0.9747237302362919, + 1.5769903920590878, + 0.18974540010094643, + 0.8897296749055386, + 0.6200654823333025, + 1.5184348337352276, + 0.7138471640646458, + 0.7731582913547754, + 0.4484195578843355, + 0.530539907515049, + 0.3553576320409775, + 0.5220563374459743, + 1.0967559330165386, + 0.6728824693709612, + 1.7406467776745558, + 0.804819792509079, + 0.5260008126497269, + 0.6564726755023003, + 0.07890937104821205, + 1.7273313291370869, + 0.11934813484549522, + 1.819472910836339, + 0.5467713493853807, + 0.6130482405424118 + ], + "unique_experts": 64, + "load_cv": 0.5684218673236123, + "normalized_load_entropy": 0.962174849081457, + "max_load_share": 0.043256997455470736 + } + }, + "s1_period": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "cf325abc71dd7998efb94b173fd2af5d2e7d7857c6862150e37892b61586429b", + "route_weight_sha256": "10528267fbc280a4af8f7807b3ccf1e0c09c1eec5704e8a5acf396da0f3f7109", + "loads": [ + 12, + 14, + 4, + 15, + 5, + 10, + 13, + 8, + 14, + 6, + 17, + 10, + 10, + 7, + 4, + 10, + 6, + 2, + 19, + 19, + 3, + 20, + 15, + 15, + 16, + 2, + 28, + 7, + 5, + 8, + 10, + 8, + 0, + 5, + 8, + 17, + 5, + 14, + 5, + 8, + 15, + 24, + 3, + 10, + 12, + 9, + 5, + 13, + 11, + 6, + 5, + 5, + 10, + 15, + 22, + 5, + 9, + 6, + 1, + 13, + 1, + 17, + 8, + 7 + ], + "weighted_loads": [ + 0.6824292335659266, + 1.0529062431305647, + 0.20188648998737335, + 1.1121537573635578, + 0.5535155236721039, + 0.9357941709458828, + 0.616270937025547, + 0.3922526389360428, + 0.49468961358070374, + 0.43893810361623764, + 0.9729586001485586, + 0.5584162659943104, + 0.32019614428281784, + 0.48833101987838745, + 0.17922191694378853, + 0.5271316040307283, + 0.2820786852389574, + 0.06530042365193367, + 1.3960498925298452, + 1.3999013118445873, + 0.12266027554869652, + 2.1705576423555613, + 0.5903539061546326, + 0.9923464730381966, + 1.0512705296278, + 0.09453927725553513, + 0.9654605947434902, + 0.27688915468752384, + 0.17546270973980427, + 0.33369945362210274, + 0.6413653697818518, + 0.578355710953474, + 0.0, + 0.15945927053689957, + 0.6870636641979218, + 0.9638837706297636, + 0.24986649118363857, + 0.8373932279646397, + 0.2789634168148041, + 0.5378772616386414, + 0.7982281092554331, + 1.4803566914051771, + 0.18389401957392693, + 0.66622762568295, + 0.6663552299141884, + 0.6738472282886505, + 0.592541329562664, + 0.812850346788764, + 0.4764194078743458, + 0.5164440646767616, + 0.23045464232563972, + 0.4559086002409458, + 0.8493962399661541, + 0.7246661856770515, + 1.6254706904292107, + 0.23794879391789436, + 0.3135691359639168, + 0.20294197462499142, + 0.04663688316941261, + 1.0217533484101295, + 0.0300276055932045, + 1.5813505556434393, + 0.5495964828878641, + 0.5989107824862003 + ], + "unique_experts": 63, + "load_cv": 0.592631734661827, + "normalized_load_entropy": 0.9564992678862176, + "max_load_share": 0.0440251572327044 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "bd9fb0ef6de8806720112560df447787bf5c76869f6bf182ef6baca00cb57cd9", + "route_weight_sha256": "ff77156ec436494cdcf7c314384db9d72279007d8806dfe0a0e8d8a0c36de316", + "loads": [ + 14, + 14, + 7, + 15, + 13, + 12, + 15, + 13, + 35, + 6, + 22, + 13, + 10, + 8, + 4, + 22, + 6, + 8, + 20, + 20, + 6, + 22, + 19, + 16, + 18, + 7, + 49, + 8, + 5, + 10, + 13, + 14, + 1, + 7, + 8, + 17, + 7, + 15, + 5, + 13, + 16, + 37, + 6, + 16, + 13, + 20, + 6, + 15, + 13, + 7, + 14, + 10, + 16, + 15, + 26, + 9, + 18, + 18, + 3, + 23, + 3, + 22, + 8, + 11 + ], + "weighted_loads": [ + 0.7877957280725241, + 1.0529062431305647, + 0.3512282781302929, + 1.1121537573635578, + 1.0659652836620808, + 1.0730823539197445, + 0.7095061764121056, + 0.6460629068315029, + 1.7105729095637798, + 0.43893810361623764, + 1.4001265559345484, + 0.8726629503071308, + 0.32019614428281784, + 0.5282967053353786, + 0.17922191694378853, + 1.2312695514410734, + 0.2820786852389574, + 0.2999453581869602, + 1.4350996371358633, + 1.4659699089825153, + 0.31609088741242886, + 2.375134477391839, + 0.8611874002963305, + 1.0266867280006409, + 1.123102892190218, + 0.30088938772678375, + 2.3207073528319597, + 0.31920802406966686, + 0.17546270973980427, + 0.4959802143275738, + 0.8308495860546827, + 1.238291870802641, + 0.049505215138196945, + 0.30147404223680496, + 0.6870636641979218, + 0.9638837706297636, + 0.5307828355580568, + 0.8710140101611614, + 0.2789634168148041, + 0.9007184058427811, + 0.8281311299651861, + 2.0892745181918144, + 0.3914564661681652, + 0.8640545979142189, + 0.8184073492884636, + 1.477892853319645, + 0.7124732881784439, + 0.8954881895333529, + 0.6276629846543074, + 0.5365142282098532, + 0.6777656637132168, + 0.863679725676775, + 1.185770781710744, + 0.7246661856770515, + 1.7189481519162655, + 0.7548905126750469, + 0.6748622339218855, + 0.9041037373244762, + 0.12180475890636444, + 1.6589099317789078, + 0.1458142902702093, + 1.8854513075202703, + 0.5495964828878641, + 1.0912230871617794 + ], + "unique_experts": 64, + "load_cv": 0.6013090684336673, + "normalized_load_entropy": 0.960792800603373, + "max_load_share": 0.05555555555555555 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 106, + "ordered_topk_exact_tokens": 65, + "set_exact_tokens": 77, + "mean_set_jaccard": 0.9218328840970351, + "mean_token_weighted_tv": 0.011586343280900762, + "aggregate_load_tv": 0.036163522012578615 + }, + "system_bos": { + "tokens": 106, + "ordered_topk_exact_tokens": 52, + "set_exact_tokens": 66, + "mean_set_jaccard": 0.8800539083557951, + "mean_token_weighted_tv": 0.01888271601308348, + "aggregate_load_tv": 0.05817610062893082 + }, + "system_x": { + "tokens": 106, + "ordered_topk_exact_tokens": 48, + "set_exact_tokens": 61, + "mean_set_jaccard": 0.8625336927223721, + "mean_token_weighted_tv": 0.02160303707603576, + "aggregate_load_tv": 0.07075471698113207 + }, + "system_period": { + "tokens": 106, + "ordered_topk_exact_tokens": 50, + "set_exact_tokens": 63, + "mean_set_jaccard": 0.8643306379155435, + "mean_token_weighted_tv": 0.021118465152059524, + "aggregate_load_tv": 0.07075471698113207 + }, + "bos_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 53, + "set_exact_tokens": 67, + "mean_set_jaccard": 0.8847708894878706, + "mean_token_weighted_tv": 0.02282220336942459, + "aggregate_load_tv": 0.05345911949685534 + }, + "bos_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 44, + "set_exact_tokens": 59, + "mean_set_jaccard": 0.8636567834681044, + "mean_token_weighted_tv": 0.02246411133311548, + "aggregate_load_tv": 0.047169811320754707 + }, + "x_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 52, + "set_exact_tokens": 66, + "mean_set_jaccard": 0.8840970350404314, + "mean_token_weighted_tv": 0.020080415022401314, + "aggregate_load_tv": 0.04874213836477987 + }, + "x_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 50, + "set_exact_tokens": 65, + "mean_set_jaccard": 0.8778077268643308, + "mean_token_weighted_tv": 0.021159955326748907, + "aggregate_load_tv": 0.050314465408805034 + }, + "period_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 53, + "set_exact_tokens": 66, + "mean_set_jaccard": 0.8825247079964061, + "mean_token_weighted_tv": 0.02013508636363835, + "aggregate_load_tv": 0.04874213836477987 + }, + "period_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 52, + "set_exact_tokens": 65, + "mean_set_jaccard": 0.8778077268643308, + "mean_token_weighted_tv": 0.020882907446544124, + "aggregate_load_tv": 0.04874213836477988 + } + } + }, + "layer_02": { + "layer": 2, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "cc20b25108140f754d0809d9560e13ca71402e5076a836a2ac19a15b86f0ae88", + "route_weight_sha256": "cf059acf2b352ff52d52827daabb845bf01160a6233a91246ee2fdca666ac3fe", + "loads": [ + 7, + 13, + 19, + 21, + 4, + 13, + 7, + 7, + 5, + 22, + 7, + 6, + 4, + 13, + 12, + 18, + 12, + 15, + 6, + 1, + 15, + 5, + 15, + 7, + 4, + 14, + 21, + 15, + 14, + 10, + 12, + 13, + 11, + 9, + 11, + 8, + 9, + 12, + 4, + 15, + 7, + 9, + 3, + 6, + 2, + 24, + 6, + 8, + 9, + 8, + 11, + 1, + 16, + 9, + 9, + 15, + 13, + 8, + 9, + 5, + 7, + 7, + 4, + 4 + ], + "weighted_loads": [ + 0.7139181420207024, + 1.018763829022646, + 1.0201019290834665, + 1.0522535797208548, + 0.11548941396176815, + 1.0667714588344097, + 0.2917012330144644, + 0.46198346838355064, + 0.36223581805825233, + 2.1924303863197565, + 0.2103768903762102, + 0.4404197633266449, + 0.25679318979382515, + 0.7068267855793238, + 0.46119103766977787, + 1.2412808276712894, + 0.6128811072558165, + 1.4009389393031597, + 0.31808464601635933, + 0.18959921598434448, + 1.3208111375570297, + 0.2689012475311756, + 2.1771317198872566, + 0.2728504966944456, + 0.20093796774744987, + 0.9110868126153946, + 1.3731565475463867, + 1.0419200956821442, + 1.1128719430416822, + 0.5632499270141125, + 0.7649323157966137, + 0.7903866451233625, + 1.078832808881998, + 0.6475670002400875, + 1.149782121181488, + 0.5248701628297567, + 0.6920597422868013, + 1.2350799459964037, + 0.40970284305512905, + 0.945006463676691, + 0.3644084557890892, + 0.5204959362745285, + 0.27682502567768097, + 0.3721795938909054, + 0.40122440457344055, + 1.733051035553217, + 0.39718060567975044, + 0.4200294651091099, + 0.7807779163122177, + 0.2780558727681637, + 1.205033479258418, + 0.04382197931408882, + 1.098573386669159, + 0.8048993200063705, + 0.30618302896618843, + 0.901391725987196, + 0.9315882958471775, + 0.45399213023483753, + 1.1268152669072151, + 0.2774914987385273, + 0.4050120636820793, + 0.6786950491368771, + 0.16930624842643738, + 0.17484395951032639 + ], + "unique_experts": 64, + "load_cv": 0.5237524992886008, + "normalized_load_entropy": 0.9664169030991824, + "max_load_share": 0.03773584905660377 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "0678383ebc30a245061990c5231f377474726d3019db5caadceb73058b46cc40", + "route_weight_sha256": "6c89bed242306fe28f0b9588b68d3f250bf1a12fab1f97248a7887fd00205b5a", + "loads": [ + 7, + 23, + 20, + 23, + 4, + 13, + 7, + 9, + 8, + 22, + 10, + 6, + 4, + 15, + 21, + 18, + 12, + 16, + 7, + 5, + 17, + 14, + 15, + 7, + 7, + 14, + 22, + 17, + 16, + 10, + 12, + 14, + 11, + 9, + 16, + 24, + 9, + 12, + 7, + 15, + 7, + 9, + 10, + 6, + 2, + 24, + 8, + 12, + 10, + 8, + 11, + 6, + 16, + 10, + 9, + 15, + 13, + 16, + 17, + 7, + 18, + 10, + 9, + 15 + ], + "weighted_loads": [ + 0.7139181420207024, + 1.964918576180935, + 1.0465061943978071, + 2.7543272133916616, + 0.11548941396176815, + 1.0667714588344097, + 0.2917012330144644, + 0.5884051993489265, + 0.5386082492768764, + 2.1924303863197565, + 0.33677191473543644, + 0.4404197633266449, + 0.25679318979382515, + 0.754680210724473, + 0.890381870791316, + 1.2412808276712894, + 0.6128811072558165, + 1.4016361007816158, + 0.31967189349234104, + 0.9300090074539185, + 1.6335365325212479, + 0.9641568921506405, + 2.1771317198872566, + 0.2728504966944456, + 0.3474470488727093, + 0.9110868126153946, + 1.3740022249985486, + 1.2904057279229164, + 1.320730036124587, + 0.5632499270141125, + 0.7649323157966137, + 0.7910821380792186, + 1.078832808881998, + 0.6475670002400875, + 1.374313086271286, + 2.6633953163400292, + 0.6920597422868013, + 1.2350799459964037, + 0.5032721413299441, + 0.945006463676691, + 0.3644084557890892, + 0.5204959362745285, + 1.0372595712542534, + 0.3721795938909054, + 0.40122440457344055, + 1.733051035553217, + 0.4639497809112072, + 0.6619398407638073, + 0.8061187248677015, + 0.2780558727681637, + 1.205033479258418, + 0.6557633429765701, + 1.098573386669159, + 0.8062125303549692, + 0.30618302896618843, + 0.901391725987196, + 0.9315882958471775, + 0.8914907034486532, + 1.4907280579209328, + 0.36310699582099915, + 1.2628194568678737, + 0.8261592760682106, + 0.563099529594183, + 0.7937237937003374 + ], + "unique_experts": 64, + "load_cv": 0.4400123133951726, + "normalized_load_entropy": 0.9765168626384779, + "max_load_share": 0.030534351145038167 + } + }, + "s1_eos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "f0c61856ed92b63cc4a12681f3f817cc4ff94e5e2475ef7f74a3bbf05f085668", + "route_weight_sha256": "832a0b2f7b13add79e65691b80429ac5a45c2be697d8d0a9e0b74fcc927646fc", + "loads": [ + 7, + 13, + 21, + 21, + 3, + 13, + 8, + 8, + 5, + 22, + 8, + 5, + 4, + 12, + 11, + 18, + 12, + 15, + 6, + 1, + 15, + 6, + 15, + 8, + 4, + 14, + 20, + 15, + 14, + 10, + 14, + 12, + 11, + 9, + 11, + 8, + 10, + 12, + 4, + 15, + 7, + 11, + 3, + 6, + 2, + 24, + 6, + 7, + 9, + 7, + 11, + 1, + 16, + 10, + 9, + 14, + 13, + 7, + 9, + 5, + 5, + 7, + 4, + 3 + ], + "weighted_loads": [ + 0.7088024467229843, + 1.017704326659441, + 1.0878480859100819, + 1.0641126055270433, + 0.09150998480618, + 1.0967178083956242, + 0.3269333653151989, + 0.5160004682838917, + 0.3629775755107403, + 2.190787533298135, + 0.24210764281451702, + 0.425576226785779, + 0.25826072692871094, + 0.669585881754756, + 0.41863836348056793, + 1.2506726626306772, + 0.6029183641076088, + 1.4250491373240948, + 0.3105910625308752, + 0.18823519349098206, + 1.3287735916674137, + 0.2996102496981621, + 2.1920013427734375, + 0.2974198590964079, + 0.19509639218449593, + 0.9104767125099897, + 1.3591413870453835, + 1.0446217358112335, + 1.1191357653588057, + 0.577217273414135, + 0.8512680940330029, + 0.7395233605057001, + 1.0795218870043755, + 0.6549798846244812, + 1.1481491662561893, + 0.49965750426054, + 0.7356636244803667, + 1.197759846225381, + 0.41347121447324753, + 0.9222799446433783, + 0.36803906597197056, + 0.5893736220896244, + 0.27759893238544464, + 0.37560591474175453, + 0.40389469265937805, + 1.7059247568249702, + 0.3932630382478237, + 0.37599952891469, + 0.7842868082225323, + 0.2534842025488615, + 1.2112133465707302, + 0.04369969666004181, + 1.0842203050851822, + 0.8344923239201307, + 0.3165533859282732, + 0.8893318604677916, + 0.9285186044871807, + 0.3986659497022629, + 1.104517675936222, + 0.27594029158353806, + 0.3271052297204733, + 0.6899002250283957, + 0.17025097832083702, + 0.14633166044950485 + ], + "unique_experts": 64, + "load_cv": 0.5303568896901725, + "normalized_load_entropy": 0.965291742094749, + "max_load_share": 0.03773584905660377 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "56d03c6199415ba7960f07dccb1bab5a069567593aed9c32b071620e37bbfb9f", + "route_weight_sha256": "db3912fc52f9bb3305df42ef9e22b77c692d255c7900164cb03ac5fdd4831e45", + "loads": [ + 11, + 24, + 24, + 24, + 4, + 14, + 8, + 12, + 14, + 23, + 15, + 5, + 4, + 15, + 23, + 19, + 14, + 16, + 7, + 7, + 17, + 16, + 16, + 8, + 11, + 15, + 21, + 18, + 18, + 10, + 15, + 14, + 11, + 9, + 20, + 26, + 10, + 13, + 9, + 18, + 7, + 11, + 13, + 7, + 5, + 24, + 13, + 14, + 11, + 8, + 12, + 9, + 17, + 14, + 9, + 14, + 18, + 14, + 11, + 13, + 16, + 13, + 14, + 17 + ], + "weighted_loads": [ + 1.2288674972951412, + 2.02279294654727, + 1.1601964179426432, + 2.801028626039624, + 0.12168855220079422, + 1.238207209855318, + 0.3269333653151989, + 0.7015574313700199, + 1.0857628118246794, + 2.307131314650178, + 0.5470846686512232, + 0.425576226785779, + 0.25826072692871094, + 0.7219446167000569, + 1.07068432867527, + 1.2833891715854406, + 0.6665951982140541, + 1.4256315685925074, + 0.31196707382332534, + 0.9670776464045048, + 1.6175894029438496, + 1.069699652493, + 2.2305893898010254, + 0.2974198590964079, + 0.5022405907511711, + 0.9607876595109701, + 1.3599623222835362, + 1.690429612994194, + 1.3392318431288004, + 0.577217273414135, + 0.885280191898346, + 0.7824199981987476, + 1.0795218870043755, + 0.6549798846244812, + 1.5148744471371174, + 2.3995297802612185, + 0.7356636244803667, + 1.2396582458168268, + 0.5682089710608125, + 1.276274060830474, + 0.36803906597197056, + 0.5893736220896244, + 1.4934269823133945, + 0.556410688906908, + 1.0520192235708237, + 1.7059247568249702, + 0.9954143259674311, + 0.7396041713654995, + 0.8527863156050444, + 0.2966319490224123, + 1.237504357472062, + 0.9471989497542381, + 1.260645568370819, + 1.018942695343867, + 0.3165533859282732, + 0.8893318604677916, + 1.2099577318876982, + 0.7344385012984276, + 1.2155008912086487, + 0.6311133652925491, + 1.029118156991899, + 1.1147190276533365, + 1.0073134452104568, + 1.175030568614602 + ], + "unique_experts": 64, + "load_cv": 0.38363567463128384, + "normalized_load_entropy": 0.9818786451936132, + "max_load_share": 0.02947845804988662 + } + }, + "s0_bos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "8827654982ef66e27369c49e26a33cfba0330af430bd4754f2ca6f0e06fe4b52", + "route_weight_sha256": "317a1f1231f8e74b416305627311da4c003486e655ed3d6b028d70ffcafe0944", + "loads": [ + 7, + 14, + 20, + 20, + 4, + 13, + 6, + 9, + 5, + 22, + 4, + 8, + 4, + 9, + 6, + 18, + 11, + 15, + 6, + 1, + 16, + 4, + 15, + 7, + 4, + 14, + 20, + 17, + 16, + 10, + 14, + 14, + 11, + 8, + 11, + 6, + 9, + 14, + 4, + 15, + 9, + 10, + 3, + 6, + 2, + 24, + 6, + 8, + 8, + 7, + 12, + 1, + 15, + 10, + 12, + 15, + 13, + 7, + 9, + 6, + 7, + 7, + 4, + 4 + ], + "weighted_loads": [ + 0.7813214436173439, + 1.0774461422115564, + 1.0382968038320541, + 1.0382337905466557, + 0.11573162861168385, + 1.077304482460022, + 0.25186987593770027, + 0.5223885178565979, + 0.3869449310004711, + 2.137728162109852, + 0.12290644831955433, + 0.48736200854182243, + 0.23686984553933144, + 0.5499054901301861, + 0.2851960379630327, + 1.2895991299301386, + 0.602395573630929, + 1.3083137422800064, + 0.305977176874876, + 0.17024874687194824, + 1.353322273120284, + 0.2286401130259037, + 2.215511240065098, + 0.2723542805761099, + 0.18383878096938133, + 0.8997251130640507, + 1.3435836844146252, + 1.101707335561514, + 1.235477151349187, + 0.5794040113687515, + 0.8800984546542168, + 0.9078010339289904, + 1.0645230114459991, + 0.6468969248235226, + 1.1305250078439713, + 0.3973444662988186, + 0.6804147157818079, + 1.3043489940464497, + 0.4150120485574007, + 0.9621757790446281, + 0.4701318237930536, + 0.555106196552515, + 0.2896214872598648, + 0.3861328326165676, + 0.43298108875751495, + 1.7321413103491068, + 0.40749670192599297, + 0.40324183367192745, + 0.7816809117794037, + 0.25888654217123985, + 1.281575160101056, + 0.05007157474756241, + 1.0685724336653948, + 0.8344874866306782, + 0.41265703178942204, + 0.9378944858908653, + 0.918526154011488, + 0.3809795007109642, + 1.0734587833285332, + 0.3042565006762743, + 0.4169070329517126, + 0.6713642030954361, + 0.23847166448831558, + 0.13604172877967358 + ], + "unique_experts": 64, + "load_cv": 0.5386453744762338, + "normalized_load_entropy": 0.9643333377750397, + "max_load_share": 0.03773584905660377 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "bc4ca5e40c2eb6dc93fa706b5f655e4da6c1e10d4ffcddd5e96c421c9b319f5b", + "route_weight_sha256": "b9b1847632d6461dc9a4bb0b9f600b4b061278a20fafd3c0cd3b6919cea0bddf", + "loads": [ + 7, + 24, + 21, + 21, + 4, + 13, + 6, + 11, + 8, + 22, + 7, + 8, + 5, + 10, + 13, + 18, + 12, + 15, + 6, + 5, + 19, + 13, + 15, + 7, + 6, + 14, + 20, + 19, + 18, + 10, + 14, + 14, + 11, + 8, + 16, + 23, + 9, + 14, + 8, + 15, + 9, + 10, + 11, + 6, + 2, + 24, + 9, + 12, + 9, + 7, + 12, + 6, + 15, + 10, + 12, + 15, + 13, + 15, + 17, + 9, + 19, + 9, + 10, + 16 + ], + "weighted_loads": [ + 0.7813214436173439, + 2.0236008893698454, + 1.0631781965494156, + 1.7674810625612736, + 0.11573162861168385, + 1.077304482460022, + 0.25186987593770027, + 0.6316887177526951, + 0.5791304148733616, + 2.137728162109852, + 0.24930147267878056, + 0.48736200854182243, + 0.26920297741889954, + 0.5761403627693653, + 0.5938619002699852, + 1.2895991299301386, + 0.6323110777884722, + 1.3083137422800064, + 0.305977176874876, + 0.8704004436731339, + 1.6630445532500744, + 0.934080321341753, + 2.215511240065098, + 0.2723542805761099, + 0.29028818383812904, + 0.8997251130640507, + 1.3435836844146252, + 1.355740923434496, + 1.4947608578950167, + 0.5794040113687515, + 0.8800984546542168, + 0.9078010339289904, + 1.0645230114459991, + 0.6468969248235226, + 1.3550559729337692, + 2.5926856165751815, + 0.6804147157818079, + 1.3043489940464497, + 0.5993940709158778, + 0.9621757790446281, + 0.4701318237930536, + 0.555106196552515, + 1.0849203541874886, + 0.3861328326165676, + 0.43298108875751495, + 1.7321413103491068, + 0.5085894577205181, + 0.6486582551151514, + 0.8070217203348875, + 0.25888654217123985, + 1.281575160101056, + 0.6777288131415844, + 1.0685724336653948, + 0.8344874866306782, + 0.41265703178942204, + 0.9378944858908653, + 0.918526154011488, + 0.7879742868244648, + 1.4373715743422508, + 0.4189817067235708, + 1.3486701371148229, + 0.7572733536362648, + 0.7145004980266094, + 1.045482810586691 + ], + "unique_experts": 64, + "load_cv": 0.42735215557487166, + "normalized_load_entropy": 0.9777418717608247, + "max_load_share": 0.030534351145038167 + } + }, + "s1_bos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "0176145ec3a2ff04034569af9e0a381b5331b3b047d5c5607d57bf33f81f0762", + "route_weight_sha256": "9db62570ddf697b967199f5ad10a94cbea3a6bddb05ec11789f649942fcc06c8", + "loads": [ + 7, + 13, + 20, + 21, + 3, + 13, + 6, + 9, + 5, + 22, + 6, + 6, + 5, + 9, + 5, + 17, + 10, + 15, + 7, + 1, + 16, + 4, + 15, + 8, + 4, + 14, + 21, + 15, + 16, + 10, + 14, + 13, + 11, + 10, + 11, + 7, + 10, + 13, + 3, + 13, + 9, + 14, + 3, + 6, + 2, + 24, + 6, + 7, + 9, + 8, + 11, + 1, + 15, + 9, + 13, + 17, + 13, + 7, + 9, + 6, + 6, + 7, + 4, + 2 + ], + "weighted_loads": [ + 0.7531993761658669, + 1.0687761809676886, + 1.0649756621569395, + 1.0896923374384642, + 0.09741212800145149, + 1.115555938333273, + 0.2684703581035137, + 0.5332884099334478, + 0.38256844505667686, + 2.174514716491103, + 0.18295059725642204, + 0.4500968437641859, + 0.2705118600279093, + 0.5365988090634346, + 0.23913229629397392, + 1.2986179627478123, + 0.5785626247525215, + 1.3350259810686111, + 0.3196950163692236, + 0.1759830266237259, + 1.3804914485663176, + 0.23031660728156567, + 2.2977909818291664, + 0.2943264991044998, + 0.18562314845621586, + 0.919719522818923, + 1.3910861890763044, + 1.006835237145424, + 1.223585657775402, + 0.5995277501642704, + 0.9133194889873266, + 0.828582938760519, + 1.0512725822627544, + 0.7204587236046791, + 1.142586499452591, + 0.42863287404179573, + 0.719341354444623, + 1.2506576925516129, + 0.40480655431747437, + 0.8566070683300495, + 0.4868853911757469, + 0.6907849833369255, + 0.2774161994457245, + 0.38122427836060524, + 0.4363980144262314, + 1.6966329216957092, + 0.4036793150007725, + 0.3497126270085573, + 0.8091153521090746, + 0.2804894279688597, + 1.232545891776681, + 0.03881770372390747, + 1.0246461927890778, + 0.8232811205089092, + 0.46325648203492165, + 1.044130377471447, + 0.8920364640653133, + 0.360821008682251, + 1.0751371085643768, + 0.3020906876772642, + 0.35034796595573425, + 0.7088081203401089, + 0.2027033045887947, + 0.08265721425414085 + ], + "unique_experts": 64, + "load_cv": 0.5433248846715838, + "normalized_load_entropy": 0.9633411278532145, + "max_load_share": 0.03773584905660377 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "39279a35bd4333bb6d76558ddfc9a9b7b809bb2b7a9e613661ea9d301cfb5b01", + "route_weight_sha256": "0b099e66a329c897228fabed70f353a3ca08417ae22b26d17815a90f0a361e33", + "loads": [ + 11, + 24, + 23, + 24, + 4, + 14, + 6, + 13, + 14, + 23, + 13, + 6, + 6, + 11, + 16, + 18, + 13, + 15, + 7, + 7, + 18, + 14, + 16, + 8, + 10, + 15, + 21, + 18, + 20, + 10, + 15, + 15, + 11, + 10, + 20, + 26, + 10, + 14, + 9, + 16, + 9, + 14, + 14, + 7, + 5, + 24, + 13, + 14, + 11, + 9, + 12, + 9, + 16, + 12, + 13, + 17, + 18, + 13, + 11, + 14, + 18, + 14, + 15, + 16 + ], + "weighted_loads": [ + 1.2732644267380238, + 2.0738648008555174, + 1.140897361561656, + 1.8836122620850801, + 0.1275906953960657, + 1.2570453397929668, + 0.2684703581035137, + 0.7030474562197924, + 1.122596526518464, + 2.2908584978431463, + 0.4879276230931282, + 0.4500968437641859, + 0.29832240380346775, + 0.5870923325419426, + 0.7896385360509157, + 1.3313344717025757, + 0.6710498202592134, + 1.3350259810686111, + 0.3196950163692236, + 0.9017834104597569, + 1.6543177496641874, + 1.0228318367153406, + 2.3363790288567543, + 0.2943264991044998, + 0.46092921681702137, + 0.9700304698199034, + 1.3910861890763044, + 1.6640492528676987, + 1.4924228377640247, + 0.5995277501642704, + 0.9473315868526697, + 0.8714795764535666, + 1.0512725822627544, + 0.7204587236046791, + 1.509311780333519, + 2.420198197476566, + 0.719341354444623, + 1.2925560921430588, + 0.6695600422099233, + 1.2106011845171452, + 0.4868853911757469, + 0.6907849833369255, + 1.5210047345608473, + 0.5620290525257587, + 1.084522545337677, + 1.6966329216957092, + 1.0149288028478622, + 0.7169520128518343, + 0.8776148594915867, + 0.32363717444241047, + 1.2588369026780128, + 0.9841586947441101, + 1.2010714560747147, + 1.006648249924183, + 0.46325648203492165, + 1.044130377471447, + 1.1734755914658308, + 0.6278726607561111, + 1.1861203238368034, + 0.6572637613862753, + 1.1128637930378318, + 1.150075914338231, + 1.1202010437846184, + 1.2731048073619604 + ], + "unique_experts": 64, + "load_cv": 0.364727087400127, + "normalized_load_entropy": 0.9837426206291194, + "max_load_share": 0.02947845804988662 + } + }, + "s0_x": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "e07bd84f3bc1bcaee171481a472ec4f0c990706ac1acab93f291d69ecfde6cdc", + "route_weight_sha256": "c4ccc5fb67047b29997fe134a45270ec55ecf335de540190d8e299b8634a54f5", + "loads": [ + 7, + 12, + 22, + 19, + 4, + 13, + 7, + 9, + 5, + 22, + 3, + 7, + 5, + 10, + 7, + 18, + 11, + 15, + 6, + 1, + 15, + 4, + 15, + 9, + 5, + 14, + 20, + 17, + 15, + 10, + 14, + 12, + 11, + 8, + 11, + 8, + 8, + 14, + 4, + 15, + 9, + 10, + 3, + 6, + 3, + 24, + 6, + 9, + 8, + 9, + 12, + 1, + 16, + 9, + 11, + 14, + 13, + 7, + 9, + 6, + 5, + 8, + 4, + 2 + ], + "weighted_loads": [ + 0.7749966382980347, + 1.0305372178554535, + 1.1029793582856655, + 1.024844627827406, + 0.11543266288936138, + 1.0765878073871136, + 0.2898529674857855, + 0.5267252307385206, + 0.38222842663526535, + 2.172145336866379, + 0.09267738275229931, + 0.46524142287671566, + 0.2819359563291073, + 0.5911920703947544, + 0.30345737747848034, + 1.2814663406461477, + 0.5893978253006935, + 1.3755415454506874, + 0.2990255393087864, + 0.17286857962608337, + 1.3147963676601648, + 0.2323075383901596, + 2.2002994790673256, + 0.32162580266594887, + 0.21561218239367008, + 0.9166990239173174, + 1.3475116975605488, + 1.1069624908268452, + 1.1866936050355434, + 0.5700590945780277, + 0.8670158535242081, + 0.7731993403285742, + 1.0504658296704292, + 0.6134267020970583, + 1.1307125426828861, + 0.4908287860453129, + 0.6520395074039698, + 1.2748374436050653, + 0.39822263084352016, + 0.9624651856720448, + 0.44424702040851116, + 0.5408907663077116, + 0.2789168283343315, + 0.37658514082431793, + 0.4375362880527973, + 1.7200051806867123, + 0.4049448035657406, + 0.4171672984957695, + 0.7708772998303175, + 0.3125351332128048, + 1.2579044308513403, + 0.04171070083975792, + 1.1014343928545713, + 0.7876347862184048, + 0.38266970962285995, + 0.8826144244521856, + 0.9002900570631027, + 0.37456491962075233, + 1.0598600506782532, + 0.3057815805077553, + 0.3437618128955364, + 0.7240065783262253, + 0.22454574704170227, + 0.08271750994026661 + ], + "unique_experts": 64, + "load_cv": 0.5321438616707556, + "normalized_load_entropy": 0.9651384057883976, + "max_load_share": 0.03773584905660377 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "55366659d918262ee71a65928d143e7d1551034019fed9bed6fd47e3d989eada", + "route_weight_sha256": "f1a17bbf1c5be69fd523900e77ed57ce93e0b997d6fbbb26e92aa9a81c7a0d72", + "loads": [ + 7, + 22, + 23, + 20, + 4, + 13, + 8, + 11, + 8, + 22, + 8, + 8, + 6, + 11, + 14, + 18, + 12, + 15, + 6, + 5, + 17, + 14, + 15, + 9, + 7, + 14, + 20, + 19, + 17, + 10, + 14, + 12, + 11, + 8, + 16, + 24, + 8, + 14, + 7, + 15, + 9, + 10, + 10, + 6, + 3, + 24, + 8, + 14, + 9, + 9, + 13, + 6, + 16, + 9, + 11, + 14, + 13, + 14, + 18, + 8, + 18, + 10, + 9, + 13 + ], + "weighted_loads": [ + 0.7749966382980347, + 1.9766919650137424, + 1.1309201046824455, + 1.7540918998420238, + 0.11543266288936138, + 1.0765878073871136, + 0.32476520724594593, + 0.6329644676297903, + 0.5647850222885609, + 2.172145336866379, + 0.327559320256114, + 0.5003078486770391, + 0.31158167868852615, + 0.6177027076482773, + 0.6123670991510153, + 1.2814663406461477, + 0.620056314393878, + 1.3755415454506874, + 0.2990255393087864, + 0.885008841753006, + 1.6148444805294275, + 1.234803095459938, + 2.2002994790673256, + 0.32162580266594887, + 0.31984727643430233, + 0.9166990239173174, + 1.3475116975605488, + 1.3529635630548, + 1.446169774979353, + 0.5700590945780277, + 0.8670158535242081, + 0.7731993403285742, + 1.0504658296704292, + 0.6134267020970583, + 1.355243507772684, + 2.6199067225679755, + 0.6520395074039698, + 1.2748374436050653, + 0.4921100726351142, + 0.9624651856720448, + 0.44424702040851116, + 0.5408907663077116, + 0.9859348945319653, + 0.37658514082431793, + 0.4375362880527973, + 1.7200051806867123, + 0.47171397879719734, + 0.693684171885252, + 0.7962181083858013, + 0.3125351332128048, + 1.2811326440423727, + 0.6232838556170464, + 1.1014343928545713, + 0.7876347862184048, + 0.38266970962285995, + 0.8826144244521856, + 0.9002900570631027, + 0.7399755120277405, + 1.5524780303239822, + 0.3913970775902271, + 1.3278349721804261, + 0.809915728867054, + 0.6462535262107849, + 0.6546409651637077 + ], + "unique_experts": 64, + "load_cv": 0.4133039332941418, + "normalized_load_entropy": 0.979570932022044, + "max_load_share": 0.030534351145038167 + } + }, + "s1_x": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "3ca02828cab26d5623eaeda462602b735de37c072bb5eb8cd81ada692123c54d", + "route_weight_sha256": "d8654b4b6bd9c2652c319d650a1f8e14f99988729271c933fa2f5f9bba222691", + "loads": [ + 7, + 12, + 22, + 20, + 3, + 13, + 6, + 9, + 5, + 22, + 7, + 7, + 5, + 10, + 5, + 17, + 10, + 16, + 7, + 1, + 16, + 4, + 15, + 8, + 3, + 14, + 21, + 14, + 16, + 10, + 14, + 14, + 11, + 10, + 11, + 9, + 9, + 14, + 3, + 13, + 8, + 13, + 3, + 6, + 2, + 24, + 6, + 8, + 8, + 8, + 11, + 1, + 15, + 9, + 13, + 15, + 13, + 7, + 9, + 6, + 5, + 7, + 4, + 2 + ], + "weighted_loads": [ + 0.763949066400528, + 1.016626462340355, + 1.1217796877026558, + 1.0597002916038036, + 0.0974863562732935, + 1.125016912817955, + 0.2705776132643223, + 0.529625715687871, + 0.38628091663122177, + 2.1785879135131836, + 0.2123872172087431, + 0.4774225018918514, + 0.2860104162245989, + 0.5603717267513275, + 0.23863746598362923, + 1.3092497065663338, + 0.5654781255871058, + 1.3937556147575378, + 0.31292653270065784, + 0.17598509788513184, + 1.3849727753549814, + 0.2330777272582054, + 2.3043280988931656, + 0.29629326798021793, + 0.1592130120843649, + 0.9201638884842396, + 1.390529377385974, + 0.9651778489351273, + 1.2061929795891047, + 0.601969238370657, + 0.9043925125151873, + 0.8107853922992945, + 1.0455980971455574, + 0.7120308317244053, + 1.150918759405613, + 0.5162900052964687, + 0.69570242613554, + 1.233569085597992, + 0.390296533703804, + 0.8579851649701595, + 0.446811456233263, + 0.6579021718353033, + 0.2722684219479561, + 0.3729134872555733, + 0.4323715269565582, + 1.6919267401099205, + 0.4064393565058708, + 0.36719577200710773, + 0.7758942432701588, + 0.283516600728035, + 1.2121647242456675, + 0.0357549823820591, + 1.0262809172272682, + 0.7967966496944427, + 0.46252977289259434, + 0.9608589950948954, + 0.885766688734293, + 0.36357181519269943, + 1.0697885006666183, + 0.3000353332608938, + 0.31413804180920124, + 0.7086993735283613, + 0.19466983154416084, + 0.07973539642989635 + ], + "unique_experts": 64, + "load_cv": 0.5439069926565877, + "normalized_load_entropy": 0.963210484351768, + "max_load_share": 0.03773584905660377 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "d1c388755f921fc438bcc81788c0772328388179bd38eaafb41f48b6d8cbafc3", + "route_weight_sha256": "2e408882001428c7d8ad23c31820590c0b8106c431f007f7682582138cada0ab", + "loads": [ + 11, + 23, + 24, + 22, + 4, + 14, + 6, + 13, + 14, + 23, + 16, + 8, + 6, + 11, + 15, + 18, + 13, + 16, + 7, + 7, + 18, + 15, + 16, + 8, + 9, + 15, + 21, + 17, + 20, + 10, + 15, + 16, + 11, + 10, + 20, + 28, + 9, + 15, + 8, + 16, + 8, + 13, + 13, + 7, + 5, + 24, + 13, + 16, + 10, + 9, + 14, + 8, + 16, + 12, + 13, + 15, + 18, + 13, + 12, + 14, + 18, + 14, + 14, + 15 + ], + "weighted_loads": [ + 1.2840141169726849, + 2.0217150822281837, + 1.1777733024209738, + 1.8210577331483364, + 0.12766492366790771, + 1.266506314277649, + 0.2705776132643223, + 0.6954357344657183, + 1.1193918082863092, + 2.2949316948652267, + 0.6321229767054319, + 0.5123686827719212, + 0.3121378645300865, + 0.5844945348799229, + 0.7473972514271736, + 1.3419662155210972, + 0.6631022710353136, + 1.3937556147575378, + 0.31292653270065784, + 0.9115872420370579, + 1.6604699436575174, + 1.3079666160047054, + 2.3429161459207535, + 0.29629326798021793, + 0.4331414606422186, + 0.97047483548522, + 1.390529377385974, + 1.6188849657773972, + 1.47338848374784, + 0.601969238370657, + 0.9384046103805304, + 0.853682029992342, + 1.0455980971455574, + 0.7120308317244053, + 1.517644040286541, + 2.4800143716856837, + 0.69570242613554, + 1.2754674851894379, + 0.5370358908548951, + 1.2119792811572552, + 0.446811456233263, + 0.6579021718353033, + 1.4492880143225193, + 0.5537182614207268, + 1.0804960578680038, + 1.6919267401099205, + 1.015536230057478, + 0.7624508421868086, + 0.8443937506526709, + 0.32666434720158577, + 1.2894485257565975, + 0.9175136126577854, + 1.2027061805129051, + 0.9801637791097164, + 0.46252977289259434, + 0.9608589950948954, + 1.1672058161348104, + 0.6323708146810532, + 1.2867366969585419, + 0.6552084069699049, + 1.1201240150257945, + 1.1437269430607557, + 1.0547056011855602, + 1.0022705346345901 + ], + "unique_experts": 64, + "load_cv": 0.36831847116688826, + "normalized_load_entropy": 0.9834701524480606, + "max_load_share": 0.031746031746031744 + } + }, + "s0_period": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "32af30e028713c74b052db9a5d0f984511ab284ab24c5e278901ed2632a57858", + "route_weight_sha256": "11e157a2c30537f7d491ba3e041aee8f38d3d994f0d8d869a13141eefa2c312e", + "loads": [ + 7, + 12, + 22, + 20, + 3, + 13, + 6, + 9, + 5, + 22, + 3, + 8, + 5, + 10, + 8, + 17, + 11, + 15, + 6, + 1, + 15, + 4, + 15, + 8, + 4, + 14, + 20, + 15, + 19, + 10, + 14, + 12, + 11, + 9, + 11, + 8, + 9, + 13, + 4, + 15, + 9, + 10, + 3, + 6, + 3, + 24, + 6, + 8, + 9, + 10, + 12, + 1, + 16, + 10, + 10, + 14, + 13, + 7, + 9, + 6, + 4, + 7, + 4, + 2 + ], + "weighted_loads": [ + 0.7776240035891533, + 1.0277094058692455, + 1.1063058320432901, + 1.0568351559340954, + 0.09297908842563629, + 1.074068583548069, + 0.2574187908321619, + 0.5217319279909134, + 0.3805094175040722, + 2.180737441405654, + 0.09253405965864658, + 0.49372692592442036, + 0.2804193589836359, + 0.5935327187180519, + 0.3393563535064459, + 1.2523407712578773, + 0.593925254419446, + 1.3835387714207172, + 0.29772964864969254, + 0.17254763841629028, + 1.3156724758446217, + 0.23265656270086765, + 2.2000825852155685, + 0.29259971156716347, + 0.19092379324138165, + 0.921060124412179, + 1.3447501733899117, + 1.0404565148055553, + 1.2900637909770012, + 0.573854248970747, + 0.8686597663909197, + 0.7699382621794939, + 1.0536065697669983, + 0.6503441259264946, + 1.1291146278381348, + 0.484879057854414, + 0.6746400222182274, + 1.2475140485912561, + 0.3946695774793625, + 0.9654893055558205, + 0.4475203603506088, + 0.5439894553273916, + 0.27496153116226196, + 0.37658169865608215, + 0.43607609532773495, + 1.7135733850300312, + 0.40152643993496895, + 0.3865526709705591, + 0.7922342009842396, + 0.34277824498713017, + 1.264101479202509, + 0.04232319816946983, + 1.0973282475024462, + 0.8228171952068806, + 0.358629597350955, + 0.8852278422564268, + 0.8971166685223579, + 0.37048352509737015, + 1.0646711215376854, + 0.3096226919442415, + 0.3222280256450176, + 0.6854627970606089, + 0.22165348380804062, + 0.08034084364771843 + ], + "unique_experts": 64, + "load_cv": 0.5409901892585632, + "normalized_load_entropy": 0.9638281746625448, + "max_load_share": 0.03773584905660377 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "fd9ba3411bbbbd4c76ed9708edeb0821d8060a004f65d7099bee27e67608ac00", + "route_weight_sha256": "02bea9eb07eba2f17800d9fa7610a6d0d03b768133e872ba42a4b70476dd5a87", + "loads": [ + 8, + 22, + 23, + 22, + 3, + 13, + 6, + 11, + 9, + 22, + 6, + 8, + 5, + 11, + 15, + 18, + 11, + 15, + 6, + 5, + 17, + 13, + 15, + 8, + 7, + 14, + 20, + 17, + 21, + 10, + 14, + 12, + 11, + 10, + 16, + 23, + 9, + 13, + 8, + 15, + 9, + 10, + 10, + 6, + 3, + 24, + 9, + 13, + 11, + 10, + 13, + 6, + 16, + 10, + 10, + 14, + 13, + 14, + 17, + 8, + 18, + 9, + 9, + 12 + ], + "weighted_loads": [ + 1.0715897008776665, + 1.9738641530275345, + 1.1337451785802841, + 1.8189552873373032, + 0.09297908842563629, + 1.074068583548069, + 0.2574187908321619, + 0.6328213103115559, + 0.6112201251089573, + 2.180737441405654, + 0.2189290840178728, + 0.49372692592442036, + 0.2804193589836359, + 0.6198514234274626, + 0.6431686319410801, + 1.2974858805537224, + 0.593925254419446, + 1.3835387714207172, + 0.29772964864969254, + 0.9102802574634552, + 1.558425422757864, + 1.1077789384871721, + 2.2000825852155685, + 0.29259971156716347, + 0.32481736317276955, + 0.921060124412179, + 1.3447501733899117, + 1.2881415821611881, + 1.5205465853214264, + 0.573854248970747, + 0.8686597663909197, + 0.7699382621794939, + 1.0536065697669983, + 0.6983236595988274, + 1.3536455929279327, + 2.553817323409021, + 0.6746400222182274, + 1.2475140485912561, + 0.5481265457347035, + 0.9654893055558205, + 0.4475203603506088, + 0.5439894553273916, + 1.003056064248085, + 0.37658169865608215, + 0.43607609532773495, + 1.7135733850300312, + 0.4943249300122261, + 0.6659772414714098, + 0.8434964418411255, + 0.34277824498713017, + 1.2874065767973661, + 0.6036486476659775, + 1.0973282475024462, + 0.8228171952068806, + 0.358629597350955, + 0.8852278422564268, + 0.8971166685223579, + 0.7340274341404438, + 1.428583912551403, + 0.39523818902671337, + 1.3068084912374616, + 0.7713719476014376, + 0.6451274380087852, + 0.604772387072444 + ], + "unique_experts": 64, + "load_cv": 0.4190291974818708, + "normalized_load_entropy": 0.978825838557918, + "max_load_share": 0.030534351145038167 + } + }, + "s1_period": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "f8cd8cbbc6935c47b828dcaf178aac96941d9ac3f4971d0f7d5cd39bc6ba950d", + "route_weight_sha256": "ba9dd0a752604e2c83ac3ede44ee7fee0ff18f2c2dc24f08bfbc3ecf16ebbd76", + "loads": [ + 7, + 12, + 22, + 20, + 3, + 13, + 6, + 9, + 5, + 22, + 6, + 7, + 5, + 10, + 5, + 18, + 10, + 16, + 7, + 1, + 16, + 4, + 15, + 9, + 3, + 14, + 21, + 14, + 16, + 10, + 14, + 14, + 11, + 10, + 11, + 8, + 10, + 14, + 3, + 13, + 8, + 13, + 3, + 6, + 2, + 24, + 6, + 7, + 8, + 8, + 11, + 1, + 15, + 9, + 13, + 16, + 13, + 7, + 9, + 6, + 4, + 7, + 4, + 2 + ], + "weighted_loads": [ + 0.7615537494421005, + 1.0200648996978998, + 1.126186853274703, + 1.063328417018056, + 0.09773083031177521, + 1.1193039156496525, + 0.27173405326902866, + 0.5307207815349102, + 0.382339783012867, + 2.1812825202941895, + 0.1824882086366415, + 0.47735537588596344, + 0.287250192835927, + 0.5587045587599277, + 0.24002771079540253, + 1.3291756883263588, + 0.5668461881577969, + 1.3983742073178291, + 0.31524997763335705, + 0.1751265823841095, + 1.3814164083451033, + 0.23246979340910912, + 2.303097575902939, + 0.3223415743559599, + 0.15846962481737137, + 0.9227949492633343, + 1.3935838714241982, + 0.9635681658983231, + 1.2106676641851664, + 0.6063421182334423, + 0.9046164974570274, + 0.7998914010822773, + 1.047719333320856, + 0.7053376995027065, + 1.1465115956962109, + 0.4961876180022955, + 0.716212434694171, + 1.2313646171241999, + 0.3906952142715454, + 0.8590084575116634, + 0.44783712923526764, + 0.6576794814318419, + 0.27064701169729233, + 0.37726307287812233, + 0.42862771451473236, + 1.6897232588380575, + 0.40270955115556717, + 0.3364249151200056, + 0.7769462950527668, + 0.28263150714337826, + 1.2127590626478195, + 0.03592631220817566, + 1.0221943594515324, + 0.7980007864534855, + 0.4669128470122814, + 0.9928012099117041, + 0.8800042904913425, + 0.3588275946676731, + 1.070829339325428, + 0.30005818605422974, + 0.291401170194149, + 0.7007174678146839, + 0.1966327540576458, + 0.07784553430974483 + ], + "unique_experts": 64, + "load_cv": 0.5508443091735221, + "normalized_load_entropy": 0.9622779599135183, + "max_load_share": 0.03773584905660377 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "1eb73bad063d9c6fa2b5e86d939e78bca98970b6c3ad4e5ad6e7eeaa0a87f045", + "route_weight_sha256": "37512aa9dbe5a8aeb438c73443feee33387cdc8b788efa0bbacbe7e4cf68fa4b", + "loads": [ + 12, + 23, + 24, + 23, + 4, + 14, + 6, + 13, + 15, + 23, + 13, + 7, + 5, + 11, + 15, + 20, + 13, + 16, + 7, + 7, + 18, + 14, + 16, + 9, + 9, + 15, + 21, + 17, + 20, + 10, + 15, + 16, + 11, + 11, + 20, + 25, + 10, + 15, + 9, + 16, + 8, + 13, + 13, + 7, + 5, + 24, + 14, + 15, + 11, + 9, + 14, + 8, + 16, + 12, + 13, + 16, + 18, + 13, + 11, + 14, + 18, + 14, + 14, + 14 + ], + "weighted_loads": [ + 1.549279447644949, + 2.0251535195857286, + 1.181911937892437, + 1.8598962482064962, + 0.12790939770638943, + 1.2607933171093464, + 0.27173405326902866, + 0.7022539004683495, + 1.1606672015041113, + 2.2976263016462326, + 0.48746523447334766, + 0.47735537588596344, + 0.287250192835927, + 0.5828273668885231, + 0.7415453437715769, + 1.3969186916947365, + 0.6635053381323814, + 1.3983742073178291, + 0.31524997763335705, + 0.9403796829283237, + 1.614644756540656, + 1.1341755092144012, + 2.3416856229305267, + 0.3223415743559599, + 0.43217651546001434, + 0.9731058962643147, + 1.3935838714241982, + 1.6195764541625977, + 1.4495582785457373, + 0.6063421182334423, + 0.9386285953223705, + 0.8427880387753248, + 1.047719333320856, + 0.7451374232769012, + 1.513236876577139, + 2.36447883117944, + 0.716212434694171, + 1.2732630167156458, + 0.6062805177643895, + 1.213002573698759, + 0.44783712923526764, + 0.6576794814318419, + 1.4615768864750862, + 0.5580678470432758, + 1.076752245426178, + 1.6897232588380575, + 1.0374806858599186, + 0.7361821178346872, + 0.8700117282569408, + 0.32577925361692905, + 1.2902433667331934, + 0.8886561915278435, + 1.1986196227371693, + 0.9813679158687592, + 0.4669128470122814, + 0.9928012099117041, + 1.16144341789186, + 0.627164900302887, + 1.1818125545978546, + 0.6552312597632408, + 1.1105678034946322, + 1.14013228751719, + 1.0569113492965698, + 0.946599867194891 + ], + "unique_experts": 64, + "load_cv": 0.36178283796902383, + "normalized_load_entropy": 0.9838525642659067, + "max_load_share": 0.02834467120181406 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 106, + "ordered_topk_exact_tokens": 81, + "set_exact_tokens": 88, + "mean_set_jaccard": 0.9514824797843666, + "mean_token_weighted_tv": 0.009863773308132054, + "aggregate_load_tv": 0.020440251572327046 + }, + "system_bos": { + "tokens": 106, + "ordered_topk_exact_tokens": 64, + "set_exact_tokens": 79, + "mean_set_jaccard": 0.925202156334232, + "mean_token_weighted_tv": 0.01703526871278882, + "aggregate_load_tv": 0.031446540880503145 + }, + "system_x": { + "tokens": 106, + "ordered_topk_exact_tokens": 64, + "set_exact_tokens": 77, + "mean_set_jaccard": 0.9198113207547172, + "mean_token_weighted_tv": 0.018224691532833397, + "aggregate_load_tv": 0.03459119496855346 + }, + "system_period": { + "tokens": 106, + "ordered_topk_exact_tokens": 65, + "set_exact_tokens": 79, + "mean_set_jaccard": 0.925202156334232, + "mean_token_weighted_tv": 0.017713503771514264, + "aggregate_load_tv": 0.03459119496855346 + }, + "bos_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 54, + "set_exact_tokens": 68, + "mean_set_jaccard": 0.889487870619946, + "mean_token_weighted_tv": 0.024373016820974508, + "aggregate_load_tv": 0.03930817610062893 + }, + "bos_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 60, + "set_exact_tokens": 73, + "mean_set_jaccard": 0.9070080862533693, + "mean_token_weighted_tv": 0.02200270359808544, + "aggregate_load_tv": 0.04088050314465409 + }, + "x_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 56, + "set_exact_tokens": 69, + "mean_set_jaccard": 0.8962264150943396, + "mean_token_weighted_tv": 0.02140951968448342, + "aggregate_load_tv": 0.04402515723270441 + }, + "x_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 57, + "set_exact_tokens": 72, + "mean_set_jaccard": 0.9043126684636119, + "mean_token_weighted_tv": 0.021908039543426263, + "aggregate_load_tv": 0.04402515723270441 + }, + "period_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 56, + "set_exact_tokens": 69, + "mean_set_jaccard": 0.8962264150943396, + "mean_token_weighted_tv": 0.021468450429515458, + "aggregate_load_tv": 0.04245283018867924 + }, + "period_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 56, + "set_exact_tokens": 69, + "mean_set_jaccard": 0.8962264150943396, + "mean_token_weighted_tv": 0.02251767243241083, + "aggregate_load_tv": 0.04402515723270441 + } + } + }, + "layer_03": { + "layer": 3, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "5c708656f66dbccaf27909a933700a3f4e6c9ef47b9516930df25024551145f2", + "route_weight_sha256": "2f412c8729e0a98ba795e323b06afdc63660bbb34b1eb2b7d1320b992334e0c1", + "loads": [ + 2, + 10, + 20, + 10, + 18, + 5, + 19, + 2, + 12, + 0, + 9, + 8, + 21, + 5, + 9, + 6, + 7, + 1, + 7, + 11, + 8, + 17, + 6, + 4, + 20, + 12, + 36, + 10, + 9, + 7, + 9, + 5, + 11, + 12, + 17, + 5, + 17, + 10, + 10, + 17, + 11, + 9, + 5, + 22, + 3, + 4, + 6, + 18, + 1, + 11, + 2, + 5, + 13, + 2, + 14, + 6, + 15, + 6, + 4, + 21, + 4, + 15, + 13, + 2 + ], + "weighted_loads": [ + 0.075216980651021, + 0.3996259495615959, + 0.9685515146702528, + 0.520164530724287, + 1.3389092553406954, + 0.2114521525800228, + 1.3844496794044971, + 0.06382112763822079, + 1.3161378856748343, + 0.0, + 0.5358419176191092, + 0.4489046800881624, + 1.5114770252257586, + 0.18419169262051582, + 0.8164339493960142, + 0.19671044498682022, + 0.5821663476526737, + 0.024105118587613106, + 0.24450990371406078, + 0.7747996337711811, + 0.4261648003011942, + 2.5407507978379726, + 0.36695078015327454, + 0.1258755810558796, + 1.637579521164298, + 0.8086502458900213, + 3.7110604532063007, + 0.7138015180826187, + 0.6026349645107985, + 0.5579756535589695, + 1.072098407894373, + 0.4178365860134363, + 0.9674594588577747, + 0.9293294511735439, + 0.8376033399254084, + 0.265037352219224, + 1.095077995210886, + 0.6168859396129847, + 0.8733101412653923, + 1.2535908855497837, + 0.6763572916388512, + 0.3819702323526144, + 0.20346294529736042, + 1.6010248698294163, + 0.12597401440143585, + 0.4421975612640381, + 0.2988450061529875, + 1.529038231819868, + 0.03754769265651703, + 0.41277920082211494, + 0.08173449337482452, + 0.45444876328110695, + 0.8844436332583427, + 0.06659658625721931, + 1.6718143709003925, + 0.49966079741716385, + 1.6261582225561142, + 0.2441426645964384, + 0.39598775655031204, + 1.6407230086624622, + 0.11875336803495884, + 1.4048662036657333, + 1.382305547595024, + 0.15328311920166016 + ], + "unique_experts": 63, + "load_cv": 0.6669929188642996, + "normalized_load_entropy": 0.9473231297423207, + "max_load_share": 0.05660377358490566 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "c33d89f6699fa2b5883a5bff26a7d4995403f13323fa39048663f488ae946295", + "route_weight_sha256": "5ae0c6919b27694cac8ffd478c07223edeb3aea862207d449983dc119ce0be59", + "loads": [ + 11, + 10, + 20, + 21, + 21, + 7, + 19, + 10, + 12, + 5, + 10, + 9, + 23, + 9, + 16, + 6, + 7, + 1, + 7, + 11, + 10, + 20, + 12, + 6, + 20, + 14, + 36, + 17, + 9, + 11, + 11, + 5, + 11, + 12, + 26, + 5, + 17, + 10, + 10, + 17, + 11, + 10, + 14, + 22, + 3, + 4, + 19, + 18, + 8, + 21, + 2, + 5, + 14, + 2, + 18, + 7, + 15, + 7, + 5, + 21, + 11, + 15, + 16, + 4 + ], + "weighted_loads": [ + 1.3786082807928324, + 0.3996259495615959, + 0.9685515146702528, + 1.1764625161886215, + 1.5602519758976996, + 0.30647071450948715, + 1.3844496794044971, + 1.2319990899413824, + 1.3161378856748343, + 0.2155721224262379, + 0.5716727431863546, + 0.4497846794547513, + 1.5234791113471147, + 0.5270496644079685, + 1.35649318061769, + 0.19671044498682022, + 0.5821663476526737, + 0.024105118587613106, + 0.24450990371406078, + 0.7747996337711811, + 0.4994556400924921, + 2.823532324284315, + 0.8048937991261482, + 0.18881351687014103, + 1.637579521164298, + 0.822323709668126, + 3.7110604532063007, + 0.9756804686039686, + 0.6026349645107985, + 0.7604935839772224, + 1.1474294029176235, + 0.4178365860134363, + 0.9674594588577747, + 0.9293294511735439, + 1.8690871614962816, + 0.265037352219224, + 1.095077995210886, + 0.6168859396129847, + 0.8733101412653923, + 1.2535908855497837, + 0.6763572916388512, + 0.39336081128567457, + 0.747603403404355, + 1.6010248698294163, + 0.12597401440143585, + 0.4421975612640381, + 1.9286282416433096, + 1.529038231819868, + 0.8180567994713783, + 1.0296606868505478, + 0.08173449337482452, + 0.45444876328110695, + 0.899182241410017, + 0.06659658625721931, + 3.504579607397318, + 0.5467802584171295, + 1.6261582225561142, + 0.2569370772689581, + 0.46562591195106506, + 1.6407230086624622, + 0.6307383645325899, + 1.4048662036657333, + 1.7073907479643822, + 0.2272137515246868 + ], + "unique_experts": 64, + "load_cv": 0.5444043993723834, + "normalized_load_entropy": 0.9640690921728908, + "max_load_share": 0.04580152671755725 + } + }, + "s1_eos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "f401d8f201401151d30b82f7b8ae26f633a72c34c197a86c39e221e4818e3794", + "route_weight_sha256": "3121776a37d1a45ae5257ea5417f41f0fa37d6051a68b4ca97f1f667e60b0caa", + "loads": [ + 2, + 10, + 19, + 10, + 18, + 5, + 21, + 2, + 11, + 0, + 8, + 8, + 21, + 5, + 9, + 5, + 7, + 3, + 7, + 11, + 7, + 17, + 5, + 4, + 20, + 14, + 35, + 10, + 8, + 7, + 9, + 5, + 12, + 12, + 17, + 6, + 17, + 11, + 11, + 17, + 10, + 9, + 5, + 22, + 3, + 4, + 6, + 18, + 0, + 11, + 2, + 5, + 13, + 2, + 14, + 6, + 16, + 6, + 4, + 21, + 3, + 15, + 13, + 2 + ], + "weighted_loads": [ + 0.07476493716239929, + 0.3935480210930109, + 0.92890421487391, + 0.513605622574687, + 1.344812773168087, + 0.21444201096892357, + 1.4477516543120146, + 0.06476582959294319, + 1.308179497718811, + 0.0, + 0.5069770328700542, + 0.4459485951811075, + 1.5134736895561218, + 0.1818009801208973, + 0.8161111418157816, + 0.165750402957201, + 0.5749648213386536, + 0.08944880217313766, + 0.24331489019095898, + 0.7909479979425669, + 0.40227353759109974, + 2.557188533246517, + 0.33413009718060493, + 0.13222388923168182, + 1.6389426421374083, + 0.8690270055085421, + 3.6932732723653316, + 0.7089944183826447, + 0.5866617355495691, + 0.5441145487129688, + 1.0700143687427044, + 0.4155088309198618, + 1.00226516649127, + 0.927292937412858, + 0.8465569242835045, + 0.2870451230555773, + 1.0953433942049742, + 0.6538468562066555, + 0.8906522952020168, + 1.2582163028419018, + 0.6603752337396145, + 0.3852957785129547, + 0.20471221767365932, + 1.5766955409199, + 0.13629791513085365, + 0.44966254383325577, + 0.2856941223144531, + 1.5416470039635897, + 0.0, + 0.41205058991909027, + 0.08303581550717354, + 0.4479328766465187, + 0.8929855041205883, + 0.06724356859922409, + 1.6886064819991589, + 0.5010835751891136, + 1.6561989057809114, + 0.24233748763799667, + 0.38575849682092667, + 1.655925702303648, + 0.08818832226097584, + 1.415803723037243, + 1.368977926671505, + 0.15457003563642502 + ], + "unique_experts": 62, + "load_cv": 0.6686513710939508, + "normalized_load_entropy": 0.9462946414700991, + "max_load_share": 0.055031446540880505 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "e24aaac2c269d47b174828b5b7cee4bd2c11a3b0799ccc3ae9fa6b5f895abfe9", + "route_weight_sha256": "9a068fa791c244f1ad4703b8338d8059c72d25969eec4c56f7307351a285bf46", + "loads": [ + 15, + 12, + 19, + 22, + 20, + 9, + 21, + 13, + 11, + 8, + 11, + 9, + 25, + 10, + 18, + 6, + 9, + 3, + 8, + 11, + 9, + 23, + 16, + 5, + 22, + 17, + 35, + 13, + 8, + 11, + 10, + 5, + 12, + 14, + 25, + 6, + 17, + 16, + 11, + 18, + 11, + 10, + 19, + 24, + 3, + 7, + 23, + 18, + 10, + 21, + 2, + 11, + 17, + 7, + 19, + 11, + 16, + 7, + 12, + 22, + 16, + 16, + 18, + 9 + ], + "weighted_loads": [ + 1.7583824843168259, + 0.4676911476999521, + 0.92890421487391, + 1.240053677931428, + 1.5413140677846968, + 0.4104784205555916, + 1.4477516543120146, + 1.3141659684479237, + 1.308179497718811, + 0.3991569280042313, + 0.5923983808606863, + 0.4468285945476964, + 1.6022625489567872, + 0.5881290845572948, + 1.5352591704577208, + 0.21475913748145103, + 0.7890897765755653, + 0.08944880217313766, + 0.298681179061532, + 0.7909479979425669, + 0.46861777268350124, + 2.930556543171406, + 1.2734557166695595, + 0.16710840165615082, + 1.740515911951661, + 0.9255514190881513, + 3.6932732723653316, + 0.8053435292094946, + 0.5866617355495691, + 0.7378340922296047, + 1.1113983914256096, + 0.4155088309198618, + 1.00226516649127, + 1.0003687385469675, + 1.7604228928685188, + 0.2870451230555773, + 1.0953433942049742, + 1.0708539299666882, + 0.8906522952020168, + 1.3083419427275658, + 0.7349767498672009, + 0.3941103108227253, + 0.8772282674908638, + 1.646409073844552, + 0.13629791513085365, + 0.6915164552628994, + 2.4834247678518295, + 1.5416470039635897, + 1.1211215313524008, + 0.8790399357676506, + 0.08303581550717354, + 1.2255512811243534, + 1.1041434155777097, + 0.7808378636837006, + 3.6309150978922844, + 0.7801028992980719, + 1.6561989057809114, + 0.25134733878076077, + 0.9364179521799088, + 1.6867996118962765, + 0.8845009971410036, + 1.4659044668078423, + 1.782124601304531, + 0.5970531925559044 + ], + "unique_experts": 64, + "load_cv": 0.46788458689259294, + "normalized_load_entropy": 0.9732253616363321, + "max_load_share": 0.03968253968253968 + } + }, + "s0_bos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "7752e40a970fb67d0d5ccf480257fd1248cbcc38e20d8589c18bc1bea00ea17c", + "route_weight_sha256": "8d3148fec4b24bc6fb4b0ed4f3f56af65ef7b970e50015d1e41ca13c881cff68", + "loads": [ + 2, + 10, + 18, + 11, + 17, + 5, + 19, + 2, + 11, + 1, + 11, + 9, + 21, + 5, + 9, + 3, + 7, + 3, + 7, + 11, + 7, + 17, + 6, + 3, + 19, + 16, + 33, + 10, + 8, + 7, + 9, + 7, + 10, + 13, + 15, + 6, + 15, + 11, + 11, + 17, + 10, + 12, + 5, + 23, + 2, + 4, + 9, + 18, + 1, + 10, + 4, + 5, + 13, + 1, + 14, + 6, + 15, + 5, + 4, + 20, + 4, + 15, + 12, + 2 + ], + "weighted_loads": [ + 0.08159433305263519, + 0.37915957532823086, + 0.9037153590470552, + 0.5857111234217882, + 1.3105272483080626, + 0.21779190003871918, + 1.3432407137006521, + 0.06876575574278831, + 1.3118408769369125, + 0.027057219296693802, + 0.5835917796939611, + 0.49011735804378986, + 1.4596839267760515, + 0.17512774094939232, + 0.8253181483596563, + 0.11592850834131241, + 0.5817531868815422, + 0.09927479550242424, + 0.23085878416895866, + 0.761471712961793, + 0.407079815864563, + 2.5759774893522263, + 0.3644459843635559, + 0.10197631642222404, + 1.6752151921391487, + 0.9345190599560738, + 3.55237302929163, + 0.7024471834301949, + 0.5918206740170717, + 0.5392409265041351, + 1.018191546201706, + 0.4934139046818018, + 0.9628131873905659, + 0.9731083605438471, + 0.7802577093243599, + 0.2961700614541769, + 0.9803333412855864, + 0.663053510710597, + 0.8599432241171598, + 1.23599449172616, + 0.6522105932235718, + 0.4635403510183096, + 0.1829382423311472, + 1.668224772438407, + 0.10912295430898666, + 0.4470207095146179, + 0.4066773150116205, + 1.541120694950223, + 0.04188923165202141, + 0.3613085150718689, + 0.14773105084896088, + 0.44279516860842705, + 0.8550774827599525, + 0.03551569953560829, + 1.7042285799980164, + 0.5353896915912628, + 1.6110957395285368, + 0.2262192852795124, + 0.4347483068704605, + 1.7122829854488373, + 0.12830559723079205, + 1.369235523045063, + 1.392199270427227, + 0.14999815076589584 + ], + "unique_experts": 64, + "load_cv": 0.6359047310290565, + "normalized_load_entropy": 0.9513122403736226, + "max_load_share": 0.05188679245283019 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "635b78df4e8b80ee537792287a71598ecd46caddb1ffea69f5b53c7aff1dbebc", + "route_weight_sha256": "8feecadf8cdf6d7f0ae5e18fdba7d5a639988d96b9b57301b58d0d79f4d6b96a", + "loads": [ + 12, + 10, + 18, + 22, + 20, + 7, + 19, + 10, + 11, + 6, + 12, + 10, + 22, + 9, + 16, + 3, + 7, + 3, + 8, + 11, + 9, + 20, + 12, + 5, + 19, + 17, + 33, + 17, + 8, + 12, + 11, + 7, + 10, + 13, + 23, + 6, + 15, + 11, + 11, + 17, + 10, + 12, + 16, + 23, + 2, + 5, + 22, + 18, + 9, + 20, + 4, + 5, + 13, + 1, + 17, + 7, + 15, + 5, + 5, + 20, + 11, + 15, + 15, + 4 + ], + "weighted_loads": [ + 1.519965972751379, + 0.37915957532823086, + 0.9037153590470552, + 1.2616724129766226, + 1.4535248414613307, + 0.3138803690671921, + 1.3432407137006521, + 1.1964077316224575, + 1.3118408769369125, + 0.26306464144727215, + 0.6194226052612066, + 0.49099735741037875, + 1.4601603297924157, + 0.5345690213143826, + 1.4070790242403746, + 0.11592850834131241, + 0.5817531868815422, + 0.09927479550242424, + 0.26680825278162956, + 0.761471712961793, + 0.4789850078523159, + 2.867996759712696, + 0.7959638237953186, + 0.16145830042660236, + 1.6752151921391487, + 0.9350480166613124, + 3.55237302929163, + 0.9643261339515448, + 0.5918206740170717, + 0.7838306836783886, + 1.0934481471776962, + 0.4934139046818018, + 0.9628131873905659, + 0.9731083605438471, + 1.7749182134866714, + 0.2961700614541769, + 0.9803333412855864, + 0.663053510710597, + 0.8599432241171598, + 1.23599449172616, + 0.6522105932235718, + 0.4635403510183096, + 0.8829447943717241, + 1.668224772438407, + 0.10912295430898666, + 0.495784405618906, + 2.035643110051751, + 1.541120694950223, + 0.9164343662559986, + 0.9781900011003017, + 0.14773105084896088, + 0.44279516860842705, + 0.8550774827599525, + 0.03551569953560829, + 2.835354335606098, + 0.5871013179421425, + 1.6110957395285368, + 0.2262192852795124, + 0.48945870995521545, + 1.7122829854488373, + 0.6268800068646669, + 1.369235523045063, + 1.717284470796585, + 0.2256622239947319 + ], + "unique_experts": 64, + "load_cv": 0.5176788346010984, + "normalized_load_entropy": 0.9667146830791691, + "max_load_share": 0.04198473282442748 + } + }, + "s1_bos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "d202dca5e5f56da2c672e86ad8f19db9aece0dfbfb6508e37950fc8e5a7bd283", + "route_weight_sha256": "a4d6271674c632b33a6c63ae773b1c3900e9a817bcdee879b937d3dc33f5d9ea", + "loads": [ + 2, + 10, + 17, + 11, + 17, + 5, + 19, + 1, + 11, + 0, + 10, + 8, + 21, + 5, + 9, + 5, + 8, + 3, + 8, + 10, + 6, + 17, + 5, + 4, + 19, + 14, + 33, + 10, + 9, + 7, + 9, + 7, + 12, + 13, + 16, + 5, + 15, + 12, + 11, + 17, + 10, + 13, + 6, + 23, + 3, + 4, + 7, + 18, + 1, + 7, + 4, + 5, + 13, + 2, + 14, + 6, + 16, + 5, + 4, + 20, + 5, + 15, + 12, + 2 + ], + "weighted_loads": [ + 0.06401857547461987, + 0.37545884773135185, + 0.8526440542191267, + 0.5808912552893162, + 1.3275210987776518, + 0.22506371140480042, + 1.3248685467988253, + 0.037588607519865036, + 1.3456937316805124, + 0.0, + 0.5537579450756311, + 0.46507369354367256, + 1.499635824933648, + 0.17235304974019527, + 0.781569616869092, + 0.1602717712521553, + 0.604234853759408, + 0.0974536407738924, + 0.2717173136770725, + 0.7530853897333145, + 0.37437374889850616, + 2.574404951184988, + 0.32944588363170624, + 0.13540907762944698, + 1.6197794750332832, + 0.8817375600337982, + 3.5311981104314327, + 0.6837024688720703, + 0.6264116559177637, + 0.5283954814076424, + 1.020045779645443, + 0.4728734437376261, + 1.049783881753683, + 0.9437311869114637, + 0.8071224261075258, + 0.2716042045503855, + 0.9988441597670317, + 0.7108337599784136, + 0.8653932455927134, + 1.252425815910101, + 0.6806857399642467, + 0.5093195121735334, + 0.2242173980921507, + 1.6420640125870705, + 0.13872388191521168, + 0.4530530273914337, + 0.35802438482642174, + 1.5698262639343739, + 0.04053765907883644, + 0.26309724524617195, + 0.15041693672537804, + 0.4351953901350498, + 0.8731022998690605, + 0.06206333264708519, + 1.6977893486618996, + 0.5269857421517372, + 1.6441277209669352, + 0.21844379603862762, + 0.4296237900853157, + 1.7229292709380388, + 0.17792123556137085, + 1.4106674194335938, + 1.3311675041913986, + 0.15829791873693466 + ], + "unique_experts": 63, + "load_cv": 0.6329119281551548, + "normalized_load_entropy": 0.9514742642994442, + "max_load_share": 0.05188679245283019 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "691abc5a613e04f184187b1c48bfff6e635a1cb4f2eb3bb490b6ce3942ddb44c", + "route_weight_sha256": "e71cc47045285c34ba5e176ccda61f3a9706f8e8e5473bf79eb4adb614f23f27", + "loads": [ + 16, + 12, + 17, + 23, + 19, + 9, + 19, + 11, + 11, + 8, + 13, + 9, + 24, + 10, + 18, + 6, + 10, + 3, + 10, + 10, + 8, + 23, + 16, + 5, + 21, + 16, + 33, + 13, + 9, + 11, + 10, + 7, + 12, + 15, + 24, + 5, + 15, + 17, + 11, + 18, + 11, + 13, + 22, + 26, + 3, + 8, + 25, + 18, + 11, + 17, + 4, + 11, + 16, + 7, + 18, + 11, + 16, + 5, + 12, + 21, + 18, + 16, + 17, + 9 + ], + "weighted_loads": [ + 1.8147326502949, + 0.4496019743382931, + 0.8526440542191267, + 1.3407443165779114, + 1.4514067848213017, + 0.42283322289586067, + 1.3248685467988253, + 1.211933922022581, + 1.3456937316805124, + 0.4178138449206017, + 0.6391792930662632, + 0.46595369291026145, + 1.5804767979716416, + 0.5952027570456266, + 1.5455166976898909, + 0.20928050577640533, + 0.8183598089963198, + 0.0974536407738924, + 0.36360564455389977, + 0.7530853897333145, + 0.44488558173179626, + 2.938196513801813, + 1.2709475010633469, + 0.17075172625482082, + 1.721352744847536, + 0.9294657324790023, + 3.5311981104314327, + 0.7800515796989202, + 0.6264116559177637, + 0.7189686149358749, + 1.0614298023283482, + 0.4728734437376261, + 1.049783881753683, + 1.0168069880455732, + 1.729318318888545, + 0.2716042045503855, + 0.9988441597670317, + 1.1278408337384462, + 0.8653932455927134, + 1.302551455795765, + 0.7552872560918331, + 0.5093195121735334, + 1.0732501745224, + 1.740872249007225, + 0.13872388191521168, + 0.7534936331212521, + 2.5894149895757437, + 1.5698262639343739, + 1.2086388356983662, + 0.7300865910947323, + 0.15041693672537804, + 1.2128137946128845, + 1.0738761462271214, + 0.7756576277315617, + 2.8517788983881474, + 0.807742053642869, + 1.6441277209669352, + 0.21844379603862762, + 0.973228707909584, + 1.7538031805306673, + 0.9456158466637135, + 1.4607681632041931, + 1.7443141788244247, + 0.6034427657723427 + ], + "unique_experts": 64, + "load_cv": 0.44995770596336576, + "normalized_load_entropy": 0.9753379818069444, + "max_load_share": 0.03741496598639456 + } + }, + "s0_x": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "79dd09644a2b45ecd29318d1e50583149e69426472d3003ecf93148b8a1ccf0b", + "route_weight_sha256": "1c6fc73d8b2b4ab72dc5ba9b0d8e12a13d48fa9bf14b5f1337038b6bd2de2b44", + "loads": [ + 2, + 10, + 17, + 9, + 17, + 5, + 17, + 2, + 11, + 1, + 10, + 8, + 21, + 5, + 9, + 3, + 7, + 3, + 8, + 11, + 6, + 17, + 6, + 4, + 20, + 16, + 33, + 10, + 9, + 7, + 9, + 7, + 11, + 12, + 16, + 6, + 15, + 11, + 11, + 17, + 10, + 12, + 4, + 23, + 3, + 4, + 6, + 17, + 1, + 11, + 4, + 5, + 13, + 4, + 14, + 6, + 15, + 6, + 4, + 20, + 6, + 15, + 12, + 2 + ], + "weighted_loads": [ + 0.0696018896996975, + 0.38533505611121655, + 0.843104301020503, + 0.5051008313894272, + 1.2790671680122614, + 0.20938435196876526, + 1.32337049767375, + 0.06839168071746826, + 1.3328629173338413, + 0.02378900907933712, + 0.5605044644325972, + 0.4598295260220766, + 1.4981390051543713, + 0.1776897944509983, + 0.7814995888620615, + 0.11660653725266457, + 0.5883360207080841, + 0.09292580187320709, + 0.2606654278934002, + 0.7801584508270025, + 0.3755461797118187, + 2.5621888861060143, + 0.37307166680693626, + 0.13391944207251072, + 1.674221757799387, + 0.9401170313358307, + 3.550677752122283, + 0.7019953578710556, + 0.6226719915866852, + 0.5532927252352238, + 1.0281082540750504, + 0.4837248660624027, + 0.9719493258744478, + 0.9567618127912283, + 0.8042417131364346, + 0.3009347375482321, + 0.970205632969737, + 0.666639557108283, + 0.8541879300028086, + 1.222763855010271, + 0.6644825786352158, + 0.4610488321632147, + 0.14853964000940323, + 1.6471110004931688, + 0.14847858250141144, + 0.44970597326755524, + 0.31728973239660263, + 1.5199039094150066, + 0.04212616756558418, + 0.40164898708462715, + 0.14424709044396877, + 0.4320470653474331, + 0.8926502987742424, + 0.12331737764179707, + 1.711036890745163, + 0.5353196337819099, + 1.631525058299303, + 0.2436972726136446, + 0.4293092340230942, + 1.6576706785708666, + 0.19513893499970436, + 1.3698893897235394, + 1.3926702477037907, + 0.1500263661146164 + ], + "unique_experts": 64, + "load_cv": 0.6220694913899826, + "normalized_load_entropy": 0.9544651058903467, + "max_load_share": 0.05188679245283019 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "f36f552eaa4c797378e2124007a71927bd4c323953cca366ac10d2c26c83116c", + "route_weight_sha256": "b83cf08772176eff50277c8444706ed8cc55ee48f5c79eaef2f58f5b4d83b551", + "loads": [ + 9, + 10, + 17, + 21, + 21, + 7, + 17, + 10, + 11, + 6, + 11, + 9, + 22, + 9, + 16, + 3, + 7, + 3, + 8, + 11, + 7, + 20, + 12, + 6, + 20, + 17, + 34, + 18, + 9, + 12, + 10, + 7, + 11, + 12, + 25, + 6, + 16, + 11, + 11, + 17, + 10, + 12, + 15, + 24, + 3, + 5, + 19, + 17, + 7, + 22, + 4, + 5, + 13, + 4, + 17, + 7, + 15, + 6, + 5, + 20, + 13, + 15, + 15, + 4 + ], + "weighted_loads": [ + 1.1481055952608585, + 0.38533505611121655, + 0.843104301020503, + 1.296553622931242, + 1.4710873612202704, + 0.3017851300537586, + 1.32337049767375, + 1.1961285434663296, + 1.3328629173338413, + 0.2799891288741492, + 0.5963352899998426, + 0.4607095253886655, + 1.4986154081707355, + 0.536220122128725, + 1.3223051261156797, + 0.11660653725266457, + 0.5883360207080841, + 0.09292580187320709, + 0.2606654278934002, + 0.7801584508270025, + 0.4023440480232239, + 2.8402523025870323, + 0.8074405044317245, + 0.1964411772787571, + 1.674221757799387, + 0.9406459880410694, + 3.5930707808583975, + 1.0114681217819452, + 0.6226719915866852, + 0.7975725792348385, + 1.0748167745769024, + 0.4837248660624027, + 0.9719493258744478, + 0.9567618127912283, + 1.900023553520441, + 0.3009347375482321, + 1.0183308068662882, + 0.666639557108283, + 0.8541879300028086, + 1.222763855010271, + 0.6644825786352158, + 0.4610488321632147, + 0.8047753535211086, + 1.6768649220466614, + 0.14847858250141144, + 0.5065373592078686, + 1.945072054862976, + 1.5199039094150066, + 0.7644398212432861, + 1.082269586622715, + 0.14424709044396877, + 0.4320470653474331, + 0.8926502987742424, + 0.12331737764179707, + 2.820501182228327, + 0.5909372940659523, + 1.631525058299303, + 0.2436972726136446, + 0.4908430613577366, + 1.6576706785708666, + 0.7223271802067757, + 1.3698893897235394, + 1.7177554480731487, + 0.22703303024172783 + ], + "unique_experts": 64, + "load_cv": 0.5190777328368547, + "normalized_load_entropy": 0.9680198690327312, + "max_load_share": 0.043256997455470736 + } + }, + "s1_x": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "09e7642a29f7a078fbea500c4de1119538037ea050339d06edfa21c6e58cc376", + "route_weight_sha256": "3837de62448cd56c2475131c85a66e219115fd8262d0db74fbe86bdf0222644c", + "loads": [ + 1, + 10, + 19, + 9, + 17, + 5, + 18, + 1, + 11, + 0, + 10, + 9, + 21, + 5, + 9, + 5, + 8, + 3, + 8, + 10, + 6, + 17, + 5, + 4, + 20, + 14, + 33, + 10, + 9, + 7, + 9, + 6, + 12, + 13, + 16, + 5, + 15, + 12, + 11, + 17, + 10, + 12, + 6, + 23, + 3, + 4, + 7, + 18, + 1, + 10, + 3, + 5, + 13, + 2, + 14, + 6, + 16, + 5, + 4, + 20, + 6, + 15, + 11, + 2 + ], + "weighted_loads": [ + 0.034699905663728714, + 0.3780419882386923, + 0.908946193754673, + 0.5151058658957481, + 1.2870287410914898, + 0.21883049793541431, + 1.3000927232205868, + 0.038190584629774094, + 1.3588312771171331, + 0.0, + 0.5586958024650812, + 0.4897385537624359, + 1.5177105627954006, + 0.17223059944808483, + 0.750535286962986, + 0.1584153901785612, + 0.6067710537463427, + 0.09653913229703903, + 0.27272701635956764, + 0.7674852162599564, + 0.37469669431447983, + 2.534976590424776, + 0.3317537233233452, + 0.13587521389126778, + 1.6320789940655231, + 0.8820673525333405, + 3.524403451010585, + 0.691578533500433, + 0.6294857282191515, + 0.535283874720335, + 1.0219118371605873, + 0.4408320337533951, + 1.0453757215291262, + 0.9431880787014961, + 0.8012787494808435, + 0.27906461246311665, + 1.0001343823969364, + 0.7136135175824165, + 0.85253637842834, + 1.2617157399654388, + 0.6938886046409607, + 0.48065201938152313, + 0.22162122279405594, + 1.632512053474784, + 0.14198440499603748, + 0.44947151839733124, + 0.4027995727956295, + 1.586431609466672, + 0.0407869890332222, + 0.3610624372959137, + 0.12026241421699524, + 0.4473761096596718, + 0.8899286948144436, + 0.0638675857335329, + 1.6991493999958038, + 0.5274829715490341, + 1.6443737950176, + 0.21806921437382698, + 0.4197441302239895, + 1.689668733626604, + 0.21374636329710484, + 1.4207514487206936, + 1.284742921590805, + 0.1553008258342743 + ], + "unique_experts": 63, + "load_cv": 0.6381401221935369, + "normalized_load_entropy": 0.9503385820055237, + "max_load_share": 0.05188679245283019 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "86cae9d7b01e366fabf72d6c19c7e84220154216f636952e81d70a95407dde0c", + "route_weight_sha256": "f1da00028927e44ad9e779f5ae452522827b1696a274c92a2aee8fde0f9c2fa7", + "loads": [ + 13, + 12, + 19, + 22, + 20, + 8, + 18, + 12, + 11, + 8, + 13, + 10, + 24, + 10, + 18, + 6, + 10, + 3, + 9, + 10, + 7, + 23, + 16, + 5, + 22, + 16, + 34, + 14, + 9, + 12, + 10, + 6, + 12, + 15, + 24, + 5, + 16, + 17, + 11, + 18, + 11, + 12, + 21, + 26, + 3, + 8, + 23, + 18, + 10, + 21, + 3, + 11, + 16, + 7, + 18, + 11, + 16, + 5, + 12, + 21, + 20, + 16, + 16, + 9 + ], + "weighted_loads": [ + 1.512916337698698, + 0.4521851148456335, + 0.908946193754673, + 1.4187052063643932, + 1.4475170620717108, + 0.3673769850283861, + 1.3000927232205868, + 1.2349246591329575, + 1.3588312771171331, + 0.4366232789470814, + 0.6441171504557133, + 0.4906185531290248, + 1.5985515358333942, + 0.5940090548247099, + 1.4827305302023888, + 0.20742412470281124, + 0.8208960089832544, + 0.09653913229703903, + 0.3280933052301407, + 0.7674852162599564, + 0.4066457152366638, + 2.887470368295908, + 1.275514092296362, + 0.1730671525001526, + 1.733652263879776, + 0.9297955249785446, + 3.563436133787036, + 0.8331346642225981, + 0.6294857282191515, + 0.76835036277771, + 1.0632958598434925, + 0.4408320337533951, + 1.0453757215291262, + 1.0162638798356056, + 1.7681346479803324, + 0.27906461246311665, + 1.040444653481245, + 1.1306205913424492, + 0.85253637842834, + 1.3118413798511028, + 0.7684901207685471, + 0.48065201938152313, + 0.9551525842398405, + 1.732483757659793, + 0.14198440499603748, + 0.7610669918358326, + 2.5690529197454453, + 1.586431609466672, + 1.0910748429596424, + 0.8875942528247833, + 0.12026241421699524, + 1.2249945141375065, + 1.0907025411725044, + 0.7774618808180094, + 2.831139400601387, + 0.8104393351823092, + 1.6443737950176, + 0.21806921437382698, + 0.9640363939106464, + 1.7205426432192326, + 1.0578895658254623, + 1.470852192491293, + 1.6978895962238312, + 0.6010610833764076 + ], + "unique_experts": 64, + "load_cv": 0.4602616053598672, + "normalized_load_entropy": 0.9740321801750196, + "max_load_share": 0.03854875283446712 + } + }, + "s0_period": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "339471ba7cf83ec872751c85b665354576540f79e5cfdfb0e461e86c2a23d922", + "route_weight_sha256": "57bf447aa6603cd8d21092a2cd9c30c3d5347eafa39e0fa9f523285ec59c2344", + "loads": [ + 2, + 10, + 17, + 9, + 17, + 5, + 18, + 2, + 12, + 0, + 11, + 8, + 21, + 5, + 9, + 3, + 7, + 3, + 8, + 11, + 7, + 17, + 6, + 4, + 20, + 16, + 33, + 10, + 9, + 7, + 9, + 7, + 10, + 12, + 16, + 7, + 15, + 11, + 11, + 17, + 10, + 11, + 4, + 23, + 3, + 4, + 6, + 18, + 1, + 10, + 4, + 5, + 13, + 4, + 14, + 6, + 14, + 6, + 4, + 19, + 6, + 15, + 12, + 2 + ], + "weighted_loads": [ + 0.06829877011477947, + 0.38646621257066727, + 0.8456591218709946, + 0.4958440065383911, + 1.2841581273823977, + 0.20969212613999844, + 1.3524194471538067, + 0.06855444237589836, + 1.356292998418212, + 0.0, + 0.5868153087794781, + 0.46170499734580517, + 1.4971517585217953, + 0.17730418592691422, + 0.7649241778999567, + 0.11620933562517166, + 0.5872813202440739, + 0.09365978091955185, + 0.2637451272457838, + 0.775137435644865, + 0.3987794276326895, + 2.5576492063701153, + 0.3631290849298239, + 0.1329067163169384, + 1.6839982699602842, + 0.9429700244218111, + 3.5549886021763086, + 0.7069535255432129, + 0.6307209711521864, + 0.555647473782301, + 1.0270372368395329, + 0.4845145493745804, + 0.9543542489409447, + 0.9606120623648167, + 0.8011133428663015, + 0.3323592934757471, + 0.9636146072298288, + 0.659659830853343, + 0.8631878085434437, + 1.2306635938584805, + 0.6697883065789938, + 0.43514147587120533, + 0.14903019182384014, + 1.6470901854336262, + 0.14835052378475666, + 0.4473807290196419, + 0.310917966067791, + 1.5539032723754644, + 0.041334573179483414, + 0.3673487603664398, + 0.1453344002366066, + 0.4321361407637596, + 0.8972899876534939, + 0.12309076450765133, + 1.7012644670903683, + 0.5294575393199921, + 1.59501807205379, + 0.24087066762149334, + 0.4286511391401291, + 1.6334961913526058, + 0.19291304424405098, + 1.3814397305250168, + 1.3806931413710117, + 0.15049537271261215 + ], + "unique_experts": 63, + "load_cv": 0.6228320653709206, + "normalized_load_entropy": 0.9535310947986834, + "max_load_share": 0.05188679245283019 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "84a484be062f0b3b1bd7541757567f0bef546a15eedfcda3f9c69eeab46ea9cd", + "route_weight_sha256": "541242b43dfbbce269c3ed9f798cf50f03ebb9e962409cd51ec8a0af106b8f66", + "loads": [ + 9, + 11, + 17, + 21, + 21, + 7, + 18, + 10, + 12, + 6, + 12, + 9, + 22, + 9, + 16, + 3, + 7, + 3, + 8, + 11, + 8, + 20, + 13, + 6, + 20, + 17, + 33, + 17, + 9, + 12, + 10, + 7, + 10, + 12, + 24, + 7, + 15, + 11, + 11, + 17, + 10, + 11, + 15, + 24, + 3, + 6, + 19, + 18, + 7, + 20, + 4, + 5, + 13, + 4, + 17, + 7, + 14, + 6, + 6, + 19, + 13, + 15, + 15, + 4 + ], + "weighted_loads": [ + 1.0793037991970778, + 0.534002460539341, + 0.8456591218709946, + 1.2259223945438862, + 1.4834811338223517, + 0.30224846489727497, + 1.3524194471538067, + 1.2383909821510315, + 1.356292998418212, + 0.41334964701673016, + 0.6226461343467236, + 0.46258499671239406, + 1.4976281615381595, + 0.5338729619979858, + 1.4286584574729204, + 0.11620933562517166, + 0.5872813202440739, + 0.09365978091955185, + 0.2637451272457838, + 0.775137435644865, + 0.42557729594409466, + 2.8317036367952824, + 0.8489665854722261, + 0.19551224075257778, + 1.6839982699602842, + 0.9434989811270498, + 3.5549886021763086, + 0.9688324760645628, + 0.6307209711521864, + 0.7956837750971317, + 1.0737457573413849, + 0.4845145493745804, + 0.9543542489409447, + 0.9606120623648167, + 1.795773847028613, + 0.3323592934757471, + 0.9636146072298288, + 0.659659830853343, + 0.8631878085434437, + 1.2306635938584805, + 0.6697883065789938, + 0.43514147587120533, + 0.8076116945594549, + 1.6769087500870228, + 0.14835052378475666, + 0.5554245263338089, + 1.9396389052271843, + 1.5539032723754644, + 0.7618436105549335, + 0.9842302463948727, + 0.1453344002366066, + 0.4321361407637596, + 0.8972899876534939, + 0.12309076450765133, + 2.8061410635709763, + 0.5850027576088905, + 1.59501807205379, + 0.24087066762149334, + 0.5316972993314266, + 1.6334961913526058, + 0.6786594018340111, + 1.3814397305250168, + 1.7057783417403698, + 0.22667890414595604 + ], + "unique_experts": 64, + "load_cv": 0.5022400597952904, + "normalized_load_entropy": 0.9698743421085468, + "max_load_share": 0.04198473282442748 + } + }, + "s1_period": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "e824bb76e0bf50daa8e77d231ea075570c903fb5d002d6c87594c31c91f5a291", + "route_weight_sha256": "4b4c9bb740862ae9fe1852d2c1ffb762dd8a008bc005fcce45edd5f0b8eacf20", + "loads": [ + 1, + 10, + 17, + 8, + 17, + 5, + 18, + 1, + 11, + 0, + 10, + 9, + 21, + 5, + 10, + 4, + 8, + 2, + 8, + 10, + 6, + 17, + 5, + 4, + 19, + 15, + 34, + 10, + 9, + 7, + 9, + 6, + 13, + 13, + 16, + 5, + 15, + 12, + 11, + 17, + 10, + 12, + 6, + 23, + 3, + 4, + 8, + 18, + 1, + 10, + 4, + 5, + 14, + 2, + 14, + 6, + 16, + 5, + 4, + 20, + 5, + 15, + 11, + 2 + ], + "weighted_loads": [ + 0.03485961630940437, + 0.3756083454936743, + 0.8518534991890192, + 0.47238894924521446, + 1.2890232857316732, + 0.22294927015900612, + 1.3023987542837858, + 0.03765373304486275, + 1.3585000187158585, + 0.0, + 0.5600551255047321, + 0.4915448725223541, + 1.522895872592926, + 0.17199417762458324, + 0.7802111357450485, + 0.13676267303526402, + 0.6037360094487667, + 0.06773276440799236, + 0.27545805647969246, + 0.7644674219191074, + 0.3741998188197613, + 2.5249678008258343, + 0.32489054277539253, + 0.13599551282823086, + 1.6013102270662785, + 0.9082024339586496, + 3.5330949258059263, + 0.690836563706398, + 0.6350279320031404, + 0.5361635610461235, + 1.0270541496574879, + 0.44183780439198017, + 1.0877455342561007, + 0.9447431173175573, + 0.8017524685710669, + 0.27920992858707905, + 0.9977569151669741, + 0.7065040357410908, + 0.8574536498636007, + 1.2629394754767418, + 0.700709868222475, + 0.4808902982622385, + 0.22405239939689636, + 1.6360166482627392, + 0.1430193204432726, + 0.44909460097551346, + 0.41989981569349766, + 1.5903925709426403, + 0.04104648157954216, + 0.36282201670110226, + 0.1492397040128708, + 0.443508293479681, + 0.9181016329675913, + 0.06401516124606133, + 1.6922032907605171, + 0.5241585522890091, + 1.6473900340497494, + 0.21649573370814323, + 0.42445845901966095, + 1.6844104379415512, + 0.1868662443011999, + 1.4174185171723366, + 1.2835719101130962, + 0.15685208141803741 + ], + "unique_experts": 63, + "load_cv": 0.642587575953094, + "normalized_load_entropy": 0.949649262704549, + "max_load_share": 0.05345911949685535 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "fec5a3a55ddf4483ecdf21cce840fb9d0884f5d845dab72f78930dbb32d4b17f", + "route_weight_sha256": "64c35accea283ae48602b163ac0fab9034f93217bd65110a46f549f88fff095c", + "loads": [ + 12, + 13, + 17, + 21, + 20, + 8, + 18, + 13, + 11, + 9, + 13, + 10, + 24, + 10, + 19, + 5, + 10, + 2, + 9, + 10, + 7, + 23, + 17, + 5, + 21, + 17, + 34, + 13, + 9, + 12, + 10, + 6, + 13, + 15, + 23, + 5, + 15, + 17, + 11, + 18, + 11, + 12, + 22, + 26, + 3, + 9, + 24, + 18, + 9, + 20, + 4, + 11, + 17, + 7, + 18, + 11, + 16, + 5, + 13, + 21, + 19, + 16, + 16, + 9 + ], + "weighted_loads": [ + 1.4150786697864532, + 0.5581741388887167, + 0.8518534991890192, + 1.2907200418412685, + 1.4483502288348973, + 0.3714957572519779, + 1.3023987542837858, + 1.3205993194133043, + 1.3585000187158585, + 0.5620470679714344, + 0.6454764734953642, + 0.492424871888943, + 1.6037368456309196, + 0.5903480555862188, + 1.593940507620573, + 0.18577140755951405, + 0.8178609646856785, + 0.06773276440799236, + 0.3308243453502655, + 0.7644674219191074, + 0.40614883974194527, + 2.8727446869015694, + 1.3355558589100838, + 0.17340639792382717, + 1.7028834968805313, + 0.9559306064038537, + 3.5330949258059263, + 0.787185674533248, + 0.6350279320031404, + 0.7662795074284077, + 1.068438172340393, + 0.44183780439198017, + 1.0877455342561007, + 1.0178189184516668, + 1.6762148644775152, + 0.27920992858707905, + 0.9977569151669741, + 1.1235111095011234, + 0.8574536498636007, + 1.3130651153624058, + 0.7753113843500614, + 0.4808902982622385, + 1.0489964466542006, + 1.7356093227863312, + 0.1430193204432726, + 0.8224000185728073, + 2.5861531626433134, + 1.5903925709426403, + 1.0480521395802498, + 0.8298113625496626, + 0.1492397040128708, + 1.2211266979575157, + 1.1188754793256521, + 0.7776094563305378, + 2.8166807256639004, + 0.8062783423811197, + 1.6473900340497494, + 0.21649573370814323, + 1.0188485756516457, + 1.7152843475341797, + 0.9875073041766882, + 1.467519260942936, + 1.6967185847461224, + 0.6023186482489109 + ], + "unique_experts": 64, + "load_cv": 0.45703283958506896, + "normalized_load_entropy": 0.9741993494450464, + "max_load_share": 0.03854875283446712 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 106, + "ordered_topk_exact_tokens": 88, + "set_exact_tokens": 94, + "mean_set_jaccard": 0.9676549865229112, + "mean_token_weighted_tv": 0.007108923144427673, + "aggregate_load_tv": 0.017295597484276726 + }, + "system_bos": { + "tokens": 106, + "ordered_topk_exact_tokens": 69, + "set_exact_tokens": 83, + "mean_set_jaccard": 0.9359838274932615, + "mean_token_weighted_tv": 0.014127089808923457, + "aggregate_load_tv": 0.025157232704402517 + }, + "system_x": { + "tokens": 106, + "ordered_topk_exact_tokens": 69, + "set_exact_tokens": 84, + "mean_set_jaccard": 0.940700808625337, + "mean_token_weighted_tv": 0.014625655267528206, + "aggregate_load_tv": 0.023584905660377357 + }, + "system_period": { + "tokens": 106, + "ordered_topk_exact_tokens": 72, + "set_exact_tokens": 83, + "mean_set_jaccard": 0.9339622641509434, + "mean_token_weighted_tv": 0.015065134142718787, + "aggregate_load_tv": 0.029874213836477984 + }, + "bos_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 59, + "set_exact_tokens": 77, + "mean_set_jaccard": 0.9177897574123989, + "mean_token_weighted_tv": 0.019715805643431422, + "aggregate_load_tv": 0.04088050314465408 + }, + "bos_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 59, + "set_exact_tokens": 75, + "mean_set_jaccard": 0.9144204851752021, + "mean_token_weighted_tv": 0.020862098537244887, + "aggregate_load_tv": 0.03459119496855345 + }, + "x_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 59, + "set_exact_tokens": 74, + "mean_set_jaccard": 0.9097035040431266, + "mean_token_weighted_tv": 0.01984079482631301, + "aggregate_load_tv": 0.03773584905660377 + }, + "x_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 59, + "set_exact_tokens": 76, + "mean_set_jaccard": 0.9130727762803237, + "mean_token_weighted_tv": 0.021829275800934377, + "aggregate_load_tv": 0.03144654088050314 + }, + "period_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 63, + "set_exact_tokens": 76, + "mean_set_jaccard": 0.9130727762803234, + "mean_token_weighted_tv": 0.01961964223850167, + "aggregate_load_tv": 0.03773584905660377 + }, + "period_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 58, + "set_exact_tokens": 74, + "mean_set_jaccard": 0.9076819407008087, + "mean_token_weighted_tv": 0.022258095768333045, + "aggregate_load_tv": 0.03930817610062892 + } + } + }, + "layer_04": { + "layer": 4, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "c1262afcc6204f0a06e6d9babadbc94c51a618483a53aae4fed2dbae82bb0ba8", + "route_weight_sha256": "e3a31a316d248d5de92b77d22eeed591f3badd690678ae1d3486d3ed3587e274", + "loads": [ + 18, + 10, + 10, + 4, + 15, + 12, + 7, + 10, + 9, + 8, + 10, + 16, + 0, + 0, + 7, + 12, + 3, + 26, + 4, + 6, + 19, + 7, + 6, + 14, + 4, + 1, + 0, + 15, + 10, + 5, + 8, + 25, + 30, + 10, + 0, + 0, + 17, + 12, + 7, + 6, + 19, + 4, + 4, + 22, + 6, + 10, + 9, + 23, + 5, + 7, + 14, + 6, + 6, + 3, + 12, + 14, + 3, + 24, + 20, + 1, + 0, + 15, + 24, + 2 + ], + "weighted_loads": [ + 1.401329718530178, + 0.44759885407984257, + 0.8602710515260696, + 0.24847974255681038, + 1.3736142739653587, + 0.9449144396930933, + 0.4124106913805008, + 0.916135486215353, + 0.7807577140629292, + 0.5716018974781036, + 0.8877921141684055, + 0.728798408061266, + 0.0, + 0.0, + 0.37785247154533863, + 0.9810585025697947, + 0.2878572903573513, + 2.4292663857340813, + 0.15211861208081245, + 0.6042775399982929, + 1.5669698603451252, + 0.31397756561636925, + 0.5356493294239044, + 1.1994875110685825, + 0.18063772097229958, + 0.0288420170545578, + 0.0, + 0.7825079429894686, + 0.6062504760921001, + 0.2045357432216406, + 0.6422692500054836, + 1.9246505852788687, + 2.4777452368289232, + 0.5829360224306583, + 0.0, + 0.0, + 1.2136002480983734, + 1.355715986341238, + 0.5758771635591984, + 0.602408193051815, + 1.3820200636982918, + 0.21641525998711586, + 0.23436816036701202, + 1.7492560651153326, + 0.37100742012262344, + 0.46069544181227684, + 0.482000270858407, + 1.9298266731202602, + 0.1641941573470831, + 0.3356892764568329, + 1.0446445792913437, + 0.25346346758306026, + 0.5963116809725761, + 0.10199179127812386, + 0.9327448010444641, + 0.9862451925873756, + 0.17966270446777344, + 1.593566905707121, + 1.6522135138511658, + 0.04791048541665077, + 0.0, + 1.2085485234856606, + 1.724567323923111, + 0.12571850046515465 + ], + "unique_experts": 58, + "load_cv": 0.7430705157552911, + "normalized_load_entropy": 0.928368774088562, + "max_load_share": 0.04716981132075472 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "1fd40b29253b30852591f71a95cab85450e62d8be97f2e2ae748bef5c98c8e7c", + "route_weight_sha256": "fe56be6f601a95a1681d1eb1b6224f4473e21eac41cfcdd250cd545307e94ed6", + "loads": [ + 18, + 13, + 13, + 8, + 16, + 12, + 9, + 10, + 9, + 8, + 20, + 18, + 0, + 13, + 10, + 16, + 3, + 26, + 8, + 6, + 19, + 9, + 8, + 14, + 4, + 7, + 5, + 16, + 10, + 24, + 8, + 27, + 30, + 12, + 11, + 0, + 17, + 15, + 8, + 6, + 22, + 6, + 12, + 22, + 6, + 11, + 20, + 23, + 6, + 9, + 15, + 6, + 6, + 3, + 12, + 14, + 3, + 24, + 20, + 12, + 4, + 15, + 27, + 2 + ], + "weighted_loads": [ + 1.401329718530178, + 0.6052196342498064, + 1.0387923270463943, + 0.5944202704995405, + 1.4534658789634705, + 0.9449144396930933, + 0.5358540788292885, + 0.916135486215353, + 0.7807577140629292, + 0.5716018974781036, + 1.5453056450933218, + 0.7552845096215606, + 0.0, + 0.9337232895195484, + 0.45257717557251453, + 1.2799647245556116, + 0.2878572903573513, + 2.4292663857340813, + 0.4231499210873153, + 0.6042775399982929, + 1.5669698603451252, + 1.3787981234490871, + 0.6675850860774517, + 1.1994875110685825, + 0.18063772097229958, + 0.47677358612418175, + 0.48704126477241516, + 0.7904911516234279, + 0.6062504760921001, + 1.5570641609810991, + 0.6422692500054836, + 1.9555805316194892, + 2.4777452368289232, + 0.6231853282079101, + 1.0355615564621985, + 0.0, + 1.2136002480983734, + 1.5561843402683735, + 1.5725000835955143, + 0.602408193051815, + 1.5230508781969547, + 0.346896693110466, + 0.5945549514144659, + 1.7492560651153326, + 0.37100742012262344, + 0.49079236947000027, + 1.631185943260789, + 1.9298266731202602, + 0.20113533921539783, + 0.3860152307897806, + 1.091641578823328, + 0.25346346758306026, + 0.5963116809725761, + 0.10199179127812386, + 0.9327448010444641, + 0.9862451925873756, + 0.17966270446777344, + 1.593566905707121, + 1.6522135138511658, + 0.6689686104655266, + 0.4087276184000075, + 1.2085485234856606, + 1.9478164911270142, + 0.12571850046515465 + ], + "unique_experts": 62, + "load_cv": 0.5783586833299419, + "normalized_load_entropy": 0.9571873561127534, + "max_load_share": 0.03816793893129771 + } + }, + "s1_eos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "e3e710bd1b2bc8bad741e9abc15ada1ec8f8e592d8d7666d295c4c54f1bc5d91", + "route_weight_sha256": "a21b0d4a254435f79ac7edf48f96889dd43037d20741c02844584dacafad4db8", + "loads": [ + 19, + 10, + 12, + 4, + 15, + 10, + 7, + 10, + 9, + 8, + 10, + 15, + 0, + 0, + 8, + 12, + 3, + 26, + 4, + 6, + 20, + 7, + 6, + 13, + 5, + 1, + 0, + 15, + 10, + 7, + 8, + 24, + 29, + 10, + 0, + 0, + 17, + 12, + 7, + 6, + 19, + 4, + 4, + 22, + 6, + 10, + 8, + 23, + 3, + 7, + 14, + 6, + 6, + 3, + 12, + 14, + 2, + 25, + 20, + 1, + 0, + 15, + 25, + 2 + ], + "weighted_loads": [ + 1.4394301027059555, + 0.4448329322040081, + 0.9196952283382416, + 0.2501268535852432, + 1.3736210726201534, + 0.8848854824900627, + 0.42861346900463104, + 0.9296754114329815, + 0.7763925828039646, + 0.5661929659545422, + 0.8829663470387459, + 0.7122833337634802, + 0.0, + 0.0, + 0.41383558325469494, + 0.9766082391142845, + 0.2894962392747402, + 2.430607333779335, + 0.152348343282938, + 0.5967748276889324, + 1.5864005088806152, + 0.3166029155254364, + 0.5343278646469116, + 1.1558523494750261, + 0.21019397303462029, + 0.031925637274980545, + 0.0, + 0.7870142608880997, + 0.6125864870846272, + 0.2749982364475727, + 0.6400303617119789, + 1.9082205593585968, + 2.4443169981241226, + 0.5792926196008921, + 0.0, + 0.0, + 1.2153822090476751, + 1.3667360469698906, + 0.5668794810771942, + 0.6041640117764473, + 1.3752037957310677, + 0.22097155079245567, + 0.22985383123159409, + 1.7433380633592606, + 0.3665557708591223, + 0.4690093453973532, + 0.4487481936812401, + 1.8905238769948483, + 0.08920628018677235, + 0.3349269460886717, + 1.0351067762821913, + 0.2583459112793207, + 0.5897512249648571, + 0.10236220434308052, + 0.9102555178105831, + 0.9854758270084858, + 0.14173420891165733, + 1.6385273095220327, + 1.662046229466796, + 0.04374071955680847, + 0.0, + 1.2041192799806595, + 1.7612656131386757, + 0.12318767607212067 + ], + "unique_experts": 58, + "load_cv": 0.7449844159396087, + "normalized_load_entropy": 0.9277453232334708, + "max_load_share": 0.04559748427672956 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "032ab3edd5b9abf06a63ec092245476b4714513b4be024e35f548194cb211143", + "route_weight_sha256": "ee09abcf237a5693c5f2fc72740a1a35e403578b12739c538616dd5cbd33f846", + "loads": [ + 19, + 12, + 16, + 13, + 16, + 10, + 11, + 10, + 9, + 17, + 19, + 17, + 1, + 14, + 11, + 17, + 5, + 28, + 11, + 8, + 21, + 10, + 11, + 14, + 5, + 11, + 8, + 16, + 10, + 30, + 8, + 26, + 29, + 12, + 15, + 0, + 18, + 17, + 10, + 9, + 22, + 9, + 13, + 22, + 7, + 12, + 18, + 27, + 3, + 10, + 16, + 6, + 10, + 7, + 18, + 14, + 7, + 27, + 20, + 14, + 7, + 17, + 29, + 3 + ], + "weighted_loads": [ + 1.4394301027059555, + 0.5808839984238148, + 1.1419268622994423, + 1.0574509587313514, + 1.4568739049136639, + 0.8848854824900627, + 0.7172986976802349, + 0.9296754114329815, + 0.7763925828039646, + 1.644039299339056, + 1.472653480246663, + 0.738687627017498, + 0.10025633871555328, + 0.999300479888916, + 0.48854565620422363, + 1.355827186256647, + 0.652452614158392, + 2.50121589563787, + 0.7525359368883073, + 0.6866227574646473, + 1.6356145143508911, + 1.413175754249096, + 0.9580234363675117, + 1.2495789173990488, + 0.21019397303462029, + 0.7537496536970139, + 0.7670351676642895, + 0.7952883755788207, + 0.6125864870846272, + 1.5735316034406424, + 0.6400303617119789, + 1.9387975530698895, + 2.4443169981241226, + 0.6199430590495467, + 1.3664655631873757, + 0.0, + 1.242733497172594, + 1.6340490225702524, + 1.7547307685017586, + 0.815223790705204, + 1.5356476120650768, + 0.4492489994299831, + 0.6602234430611134, + 1.7433380633592606, + 0.4047683458775282, + 0.49959705225774087, + 1.6379199661314487, + 2.2289842404425144, + 0.08920628018677235, + 0.4214551169425249, + 1.1279968973249197, + 0.2583459112793207, + 1.0259463675320148, + 0.2842724435031414, + 1.4617025144398212, + 0.9854758270084858, + 0.5627830289304256, + 1.7116711679846048, + 1.662046229466796, + 0.7817900273948908, + 0.8901036269962788, + 1.400238037109375, + 2.0584409572184086, + 0.16759147122502327 + ], + "unique_experts": 63, + "load_cv": 0.5080124254895209, + "normalized_load_entropy": 0.9671677059241448, + "max_load_share": 0.034013605442176874 + } + }, + "s0_bos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "5335deb77efb44ad49f9cbb7148e14e9985d97a456b33493dd44005a8794618c", + "route_weight_sha256": "6ad63d81191e9bc60d09a12448b5e9e4a321fc99154afd6a22ed7c0533ae7314", + "loads": [ + 19, + 11, + 11, + 4, + 15, + 12, + 6, + 12, + 9, + 8, + 10, + 15, + 1, + 0, + 10, + 12, + 3, + 26, + 4, + 6, + 19, + 9, + 6, + 14, + 2, + 1, + 0, + 16, + 10, + 5, + 8, + 21, + 29, + 9, + 0, + 0, + 17, + 11, + 7, + 6, + 19, + 4, + 4, + 22, + 5, + 8, + 9, + 23, + 4, + 8, + 13, + 6, + 6, + 4, + 12, + 14, + 3, + 25, + 20, + 1, + 0, + 15, + 25, + 2 + ], + "weighted_loads": [ + 1.3834361992776394, + 0.48156179301440716, + 0.9000699259340763, + 0.2512349672615528, + 1.3205631468445063, + 1.0182911586016417, + 0.38386229425668716, + 1.0165021028369665, + 0.786236222833395, + 0.6108218990266323, + 0.8571374267339706, + 0.7118799723684788, + 0.03910929337143898, + 0.0, + 0.4759396482259035, + 0.9871267192065716, + 0.28546663746237755, + 2.481137130409479, + 0.1458938717842102, + 0.5949106886982918, + 1.5571782290935516, + 0.38078935258090496, + 0.5253936797380447, + 1.1911837253719568, + 0.09950325638055801, + 0.027600068598985672, + 0.0, + 0.8002205584198236, + 0.6077014580368996, + 0.18532336317002773, + 0.6276843287050724, + 1.8225761447101831, + 2.446063971146941, + 0.5787004865705967, + 0.0, + 0.0, + 1.2728071995079517, + 1.3241948168724775, + 0.5521441623568535, + 0.6258014068007469, + 1.322161853313446, + 0.21586846560239792, + 0.22892596572637558, + 1.7405898198485374, + 0.33384088054299355, + 0.41322642378509045, + 0.46508043445646763, + 1.9510653652250767, + 0.125205984339118, + 0.3900864254683256, + 1.0025704726576805, + 0.24118927121162415, + 0.58624517172575, + 0.13053002208471298, + 0.9347577430307865, + 1.0041064023971558, + 0.18948842957615852, + 1.6066750437021255, + 1.6672001872211695, + 0.057482004165649414, + 0.0, + 1.1998226195573807, + 1.7533564940094948, + 0.1224411204457283 + ], + "unique_experts": 59, + "load_cv": 0.7360103032489881, + "normalized_load_entropy": 0.9295825408441264, + "max_load_share": 0.04559748427672956 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "b96cdc2b1b1f419f87e00289f5cc8f4f5d92236ab7eaf3abe25a91983078d702", + "route_weight_sha256": "604141f256da555dedefb2405cbad885c03cf6c326a5174c77982033ee2354a7", + "loads": [ + 19, + 14, + 14, + 9, + 16, + 12, + 8, + 12, + 9, + 8, + 20, + 16, + 1, + 13, + 13, + 16, + 3, + 26, + 9, + 6, + 19, + 10, + 8, + 14, + 2, + 7, + 5, + 16, + 10, + 24, + 8, + 22, + 29, + 10, + 11, + 0, + 17, + 14, + 9, + 6, + 22, + 6, + 12, + 22, + 5, + 9, + 20, + 23, + 5, + 9, + 15, + 6, + 6, + 4, + 12, + 14, + 3, + 25, + 20, + 12, + 6, + 15, + 28, + 2 + ], + "weighted_loads": [ + 1.3834361992776394, + 0.6351033914834261, + 1.0910141579806805, + 0.6227822913497221, + 1.383963594213128, + 1.0182911586016417, + 0.49797390028834343, + 1.0165021028369665, + 0.786236222833395, + 0.6108218990266323, + 1.514650957658887, + 0.7289507426321507, + 0.03910929337143898, + 0.9251042865216732, + 0.5506643522530794, + 1.2802034690976143, + 0.28546663746237755, + 2.481137130409479, + 0.528548520145705, + 0.5949106886982918, + 1.5571782290935516, + 0.670407934114337, + 0.6471395790576935, + 1.1911837253719568, + 0.09950325638055801, + 0.48598016053438187, + 0.5006065592169762, + 0.8002205584198236, + 0.6077014580368996, + 1.6535071267717285, + 0.6276843287050724, + 1.8409618306905031, + 2.446063971146941, + 0.6040571201592684, + 1.0940493089146912, + 0.0, + 1.2728071995079517, + 1.5063319075852633, + 1.573966447263956, + 0.6258014068007469, + 1.463192667812109, + 0.34745102748274803, + 0.5891127567738295, + 1.7405898198485374, + 0.33384088054299355, + 0.4433233514428139, + 1.6142661068588495, + 1.9510653652250767, + 0.16214716620743275, + 0.41807944141328335, + 1.0823798552155495, + 0.24118927121162415, + 0.58624517172575, + 0.13053002208471298, + 0.9347577430307865, + 1.0041064023971558, + 0.18948842957615852, + 1.6066750437021255, + 1.6672001872211695, + 0.6753397546708584, + 0.6473781601525843, + 1.1998226195573807, + 1.9753847010433674, + 0.1224411204457283 + ], + "unique_experts": 63, + "load_cv": 0.5665964506760219, + "normalized_load_entropy": 0.9590036795114795, + "max_load_share": 0.03689567430025445 + } + }, + "s1_bos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "030634bdaf1b05d9be26ca98d69c58c50db87d96ecf2ace8f07fbc40a8ff6fae", + "route_weight_sha256": "a6185cd4397a1c81eddacd72fb9ea8d713c7ed7fb0e2f521a3bdf4e13bf63479", + "loads": [ + 19, + 10, + 13, + 4, + 14, + 11, + 6, + 12, + 9, + 8, + 10, + 17, + 1, + 0, + 12, + 12, + 3, + 26, + 4, + 6, + 19, + 10, + 6, + 13, + 2, + 0, + 0, + 14, + 10, + 2, + 8, + 23, + 29, + 9, + 0, + 0, + 17, + 12, + 7, + 6, + 20, + 5, + 5, + 23, + 4, + 9, + 8, + 23, + 1, + 8, + 13, + 6, + 6, + 4, + 12, + 15, + 3, + 24, + 20, + 1, + 0, + 14, + 25, + 3 + ], + "weighted_loads": [ + 1.4266221188008785, + 0.42079036124050617, + 0.9805885776877403, + 0.24650061130523682, + 1.309642544016242, + 0.9815872758626938, + 0.380302045494318, + 1.0481807738542557, + 0.7743163146078587, + 0.5983317345380783, + 0.8635095618665218, + 0.7813854552805424, + 0.04069092869758606, + 0.0, + 0.5414904411882162, + 0.9831721782684326, + 0.2883119583129883, + 2.4828148782253265, + 0.14393223263323307, + 0.5820903293788433, + 1.5458823144435883, + 0.4199260529130697, + 0.5141268596053123, + 1.1427376102656126, + 0.09902136400341988, + 0.0, + 0.0, + 0.7537695690989494, + 0.61907172575593, + 0.08448481187224388, + 0.633874699473381, + 1.8865527343004942, + 2.4466394633054733, + 0.5772780887782574, + 0.0, + 0.0, + 1.249421689659357, + 1.3329049833118916, + 0.5360861867666245, + 0.6255562528967857, + 1.3414675071835518, + 0.25392409786581993, + 0.25953538715839386, + 1.7781475726515055, + 0.29223398491740227, + 0.4438903108239174, + 0.45897956378757954, + 1.906089510768652, + 0.03201263025403023, + 0.39280048944056034, + 1.0229684747755527, + 0.2555477246642113, + 0.5750655867159367, + 0.13303102552890778, + 0.918962262570858, + 1.02573006413877, + 0.19234326109290123, + 1.5938797388225794, + 1.6869664713740349, + 0.05876173451542854, + 0.0, + 1.1589129939675331, + 1.7391939088702202, + 0.14620567485690117 + ], + "unique_experts": 58, + "load_cv": 0.7506968401538778, + "normalized_load_entropy": 0.9255050322603552, + "max_load_share": 0.04559748427672956 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "069edf9a22c5328b3d6ecb6907016e860b50650f28e305daeb92128cbf44e065", + "route_weight_sha256": "9f289a8345d75c9cc4e1a2b0766f63d43b2d250e54c576839255c83bd78be9fe", + "loads": [ + 19, + 12, + 17, + 14, + 15, + 11, + 10, + 12, + 9, + 17, + 19, + 18, + 2, + 14, + 15, + 17, + 5, + 28, + 12, + 8, + 20, + 12, + 11, + 14, + 2, + 10, + 8, + 14, + 10, + 24, + 8, + 24, + 29, + 10, + 15, + 0, + 19, + 17, + 10, + 9, + 23, + 10, + 14, + 23, + 5, + 11, + 19, + 27, + 1, + 10, + 16, + 6, + 10, + 8, + 18, + 15, + 8, + 26, + 20, + 14, + 9, + 16, + 29, + 4 + ], + "weighted_loads": [ + 1.4266221188008785, + 0.5511930901557207, + 1.207479327917099, + 1.073744693043409, + 1.3703886289149523, + 0.9815872758626938, + 0.6466245166957378, + 1.0481807738542557, + 0.7743163146078587, + 1.6761780679225922, + 1.453196695074439, + 0.7984562255442142, + 0.14094726741313934, + 0.9818698987364769, + 0.6162005141377449, + 1.374735102057457, + 0.65126833319664, + 2.5534234400838614, + 0.8471681582741439, + 0.6719382591545582, + 1.5950963199138641, + 0.7499214690178633, + 0.9186740145087242, + 1.2364641781896353, + 0.09902136400341988, + 0.6943119056522846, + 0.7773732058703899, + 0.7537695690989494, + 0.61907172575593, + 1.3855321798473597, + 0.633874699473381, + 1.9049384202808142, + 2.4466394633054733, + 0.602634722366929, + 1.3669785654637963, + 0.0, + 1.301683273166418, + 1.5821706596761942, + 1.7239374741911888, + 0.8366160318255424, + 1.501911323517561, + 0.4843732938898029, + 0.6899049989879131, + 1.7781475726515055, + 0.3304465599358082, + 0.4744780176843051, + 1.6966041829437017, + 2.244549874216318, + 0.03201263025403023, + 0.45647301338613033, + 1.1495666429400444, + 0.2555477246642113, + 1.0112607292830944, + 0.31494126468896866, + 1.4704092592000961, + 1.02573006413877, + 0.6133920811116695, + 1.6670235972851515, + 1.6869664713740349, + 0.78863993473351, + 1.1092371568083763, + 1.3550317510962486, + 2.0550098083913326, + 0.19060947000980377 + ], + "unique_experts": 63, + "load_cv": 0.4947209762685603, + "normalized_load_entropy": 0.9676109776468482, + "max_load_share": 0.032879818594104306 + } + }, + "s0_x": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "28836afc82972a1087727c8ba375dabcf183fbce7262962ba036b0fb1f4295f5", + "route_weight_sha256": "c6e9401fcaa608f5fc4fc1c1a4b6f5fb6ca71988274533ff4ad55dff8aef5682", + "loads": [ + 18, + 11, + 12, + 4, + 14, + 12, + 6, + 11, + 9, + 8, + 10, + 14, + 0, + 0, + 9, + 12, + 3, + 26, + 4, + 6, + 19, + 9, + 6, + 16, + 2, + 0, + 0, + 15, + 10, + 4, + 8, + 22, + 29, + 7, + 0, + 0, + 17, + 11, + 8, + 6, + 21, + 5, + 4, + 23, + 6, + 10, + 8, + 23, + 5, + 7, + 13, + 6, + 6, + 4, + 12, + 14, + 3, + 24, + 20, + 1, + 0, + 15, + 25, + 3 + ], + "weighted_loads": [ + 1.373115036636591, + 0.4782284330576658, + 0.9454113077372313, + 0.25912244617938995, + 1.288365414366126, + 0.9899936057627201, + 0.4024266228079796, + 0.9606597069650888, + 0.7705715782940388, + 0.6007292531430721, + 0.8833559080958366, + 0.6724330242723227, + 0.0, + 0.0, + 0.45469101145863533, + 0.9916213732212782, + 0.2825716510415077, + 2.5041353553533554, + 0.15213707461953163, + 0.5987653136253357, + 1.558691419661045, + 0.3865542933344841, + 0.5510990396142006, + 1.2492150608450174, + 0.09778378903865814, + 0.0, + 0.0, + 0.7792908325791359, + 0.6170795485377312, + 0.13436226174235344, + 0.6422089971601963, + 1.8661248069256544, + 2.42554684355855, + 0.4984657932072878, + 0.0, + 0.0, + 1.259599195793271, + 1.259764026850462, + 0.5803417582064867, + 0.6256403475999832, + 1.3806316182017326, + 0.2561817578971386, + 0.22038725018501282, + 1.744605464860797, + 0.35881086625158787, + 0.4775246698409319, + 0.4656182359904051, + 2.0117138661444187, + 0.16342538967728615, + 0.3512745276093483, + 0.9936560802161694, + 0.24426142685115337, + 0.614960066974163, + 0.12902785651385784, + 0.9372374452650547, + 1.0055573731660843, + 0.18816396594047546, + 1.6185547728091478, + 1.6667760387063026, + 0.05421171709895134, + 0.0, + 1.2041538693010807, + 1.7758007273077965, + 0.1498165726661682 + ], + "unique_experts": 57, + "load_cv": 0.740724588777398, + "normalized_load_entropy": 0.927562505021289, + "max_load_share": 0.04559748427672956 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "6a7caad0bc51ae1a82192cc4277eaf3a92edb23d8b29a57e6b982f39e8edd81f", + "route_weight_sha256": "6a72c23f1a43230633584f8df81ccebb42d68f6c01cea217b0b278ce662caf90", + "loads": [ + 18, + 15, + 17, + 8, + 15, + 12, + 7, + 11, + 9, + 8, + 21, + 15, + 0, + 12, + 12, + 16, + 3, + 26, + 8, + 6, + 19, + 10, + 8, + 16, + 2, + 6, + 5, + 15, + 10, + 20, + 8, + 23, + 29, + 8, + 9, + 0, + 17, + 14, + 9, + 6, + 25, + 7, + 13, + 23, + 6, + 11, + 21, + 23, + 7, + 8, + 15, + 6, + 7, + 4, + 12, + 14, + 3, + 24, + 20, + 13, + 5, + 15, + 28, + 3 + ], + "weighted_loads": [ + 1.373115036636591, + 0.6762815397232771, + 1.1935138329863548, + 0.5953049189120065, + 1.35107216052711, + 0.9899936057627201, + 0.46653149276971817, + 0.9606597069650888, + 0.7705715782940388, + 0.6007292531430721, + 1.7569936010986567, + 0.6895037945359945, + 0.0, + 0.8848548233509064, + 0.5294157154858112, + 1.3036122377961874, + 0.2825716510415077, + 2.5041353553533554, + 0.3912976385036018, + 0.5987653136253357, + 1.558691419661045, + 0.6761728748679161, + 0.6865337714552879, + 1.2492150608450174, + 0.09778378903865814, + 0.38970164582133293, + 0.5396211892366409, + 0.7792908325791359, + 0.6170795485377312, + 1.3362370061659021, + 0.6422089971601963, + 1.8845104929059744, + 2.42554684355855, + 0.5238224267959595, + 0.8578817960806191, + 0.0, + 1.259599195793271, + 1.4388521760702133, + 1.5769646782428026, + 0.6256403475999832, + 1.5785572938621044, + 0.391070194542408, + 0.6162494886666536, + 1.744605464860797, + 0.35881086625158787, + 0.5076215974986553, + 1.8590683843940496, + 2.0117138661444187, + 0.24343717470765114, + 0.37926754355430603, + 1.0754902996122837, + 0.24426142685115337, + 0.6383317690342665, + 0.12902785651385784, + 0.9372374452650547, + 1.0055573731660843, + 0.18816396594047546, + 1.6185547728091478, + 1.6667760387063026, + 0.7482909858226776, + 0.44445453444495797, + 1.2041538693010807, + 1.9934544079005718, + 0.1498165726661682 + ], + "unique_experts": 62, + "load_cv": 0.5716929295094144, + "normalized_load_entropy": 0.9579526988531777, + "max_load_share": 0.03689567430025445 + } + }, + "s1_x": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "954f4fd494a7e67d066ee40696d0ce07f564accf5abfece69ad36fc5713be8ed", + "route_weight_sha256": "9b7dc66048b6ea48484ae4329c29ebb984030ef8f2654889b547a6ea4a24fd75", + "loads": [ + 19, + 9, + 13, + 4, + 13, + 11, + 6, + 11, + 9, + 8, + 10, + 16, + 1, + 0, + 11, + 12, + 3, + 26, + 4, + 6, + 19, + 9, + 6, + 16, + 2, + 0, + 0, + 14, + 10, + 2, + 8, + 21, + 28, + 9, + 0, + 0, + 19, + 12, + 7, + 6, + 20, + 5, + 5, + 23, + 4, + 11, + 8, + 23, + 0, + 10, + 13, + 6, + 6, + 4, + 12, + 16, + 3, + 24, + 20, + 2, + 0, + 13, + 25, + 3 + ], + "weighted_loads": [ + 1.4400530830025673, + 0.389031732454896, + 0.9873880203813314, + 0.2548496574163437, + 1.2599803134799004, + 0.9847041256725788, + 0.3846304155886173, + 1.003185674548149, + 0.7706501670181751, + 0.5971365869045258, + 0.8778951726853848, + 0.7371705509722233, + 0.040444955229759216, + 0.0, + 0.5214229822158813, + 0.9810498543083668, + 0.2852596119046211, + 2.5040296651422977, + 0.1482209712266922, + 0.5890918634831905, + 1.5244184881448746, + 0.39107353426516056, + 0.5304332971572876, + 1.2369100265204906, + 0.09432100132107735, + 0.0, + 0.0, + 0.7566765490919352, + 0.6353085450828075, + 0.07992245256900787, + 0.6426385827362537, + 1.7971680257469416, + 2.3940262999385595, + 0.5553140621632338, + 0.0, + 0.0, + 1.338767934590578, + 1.2746349684894085, + 0.5285873711109161, + 0.622591957449913, + 1.2987305354326963, + 0.26003871113061905, + 0.25835098698735237, + 1.7705289963632822, + 0.2905222661793232, + 0.5220073740929365, + 0.49162482656538486, + 1.962685950100422, + 0.0, + 0.4547936376184225, + 1.0170929580926895, + 0.2566204220056534, + 0.5946164652705193, + 0.13712593540549278, + 0.9207926094532013, + 1.0509242992848158, + 0.1952708624303341, + 1.6204631701111794, + 1.690572975203395, + 0.10053230449557304, + 0.0, + 1.1265572309494019, + 1.7408844158053398, + 0.14427083358168602 + ], + "unique_experts": 57, + "load_cv": 0.7456212909573433, + "normalized_load_entropy": 0.925508511545786, + "max_load_share": 0.0440251572327044 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "4b491751ef5b73e8f61fb0bc9f4ad5e29ae9f637869d49a9b212835b5debefdf", + "route_weight_sha256": "5595261ac89de3e8da3474208abf34bfe0df68343d5ebfbfb487fe8eca0f7c1c", + "loads": [ + 19, + 12, + 19, + 13, + 14, + 11, + 9, + 11, + 9, + 17, + 20, + 17, + 2, + 13, + 14, + 17, + 5, + 28, + 11, + 8, + 20, + 11, + 11, + 17, + 2, + 10, + 8, + 14, + 10, + 21, + 8, + 22, + 28, + 10, + 14, + 0, + 21, + 17, + 10, + 9, + 24, + 10, + 15, + 23, + 5, + 13, + 21, + 27, + 0, + 12, + 16, + 6, + 10, + 8, + 18, + 16, + 8, + 26, + 20, + 16, + 8, + 15, + 29, + 4 + ], + "weighted_loads": [ + 1.4400530830025673, + 0.5658898260444403, + 1.2797477710992098, + 1.0478156667377334, + 1.3159155547618866, + 0.9847041256725788, + 0.6050770431756973, + 1.003185674548149, + 0.7706501670181751, + 1.6749829202890396, + 1.6579870041459799, + 0.7542413212358952, + 0.1407012939453125, + 0.9395650438964367, + 0.59613305516541, + 1.3655371367931366, + 0.6482159867882729, + 2.5746382270008326, + 0.697094866540283, + 0.6789397932589054, + 1.5736324936151505, + 0.7210689503699541, + 0.9432195834815502, + 1.3306365944445133, + 0.09432100132107735, + 0.6400742679834366, + 0.802515771239996, + 0.7566765490919352, + 0.6353085450828075, + 1.167326545342803, + 0.6426385827362537, + 1.8155537117272615, + 2.3940262999385595, + 0.5806706957519054, + 1.1813864393625408, + 0.0, + 1.3916126620024443, + 1.5175518970936537, + 1.7164386585354805, + 0.8336517363786697, + 1.5132349152117968, + 0.4906055890751304, + 0.7289276197552681, + 1.7705289963632822, + 0.3287348411977291, + 0.5525950809533242, + 1.9810035023838282, + 2.301146313548088, + 0.0, + 0.5184661615639925, + 1.1441969946026802, + 0.2566204220056534, + 1.030811607837677, + 0.31903617456555367, + 1.4722396060824394, + 1.0509242992848158, + 0.6163196824491024, + 1.6936070285737514, + 1.690572975203395, + 0.8997536618262529, + 0.8924240060150623, + 1.3226759880781174, + 2.0446549244225025, + 0.18867462873458862 + ], + "unique_experts": 62, + "load_cv": 0.4968781246891196, + "normalized_load_entropy": 0.9664683436944366, + "max_load_share": 0.032879818594104306 + } + }, + "s0_period": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "8e4128d95f032215e0198e1dac1cb5dbe87e4d6537bb8451b8c9afd92ea3f0f0", + "route_weight_sha256": "04b0bb4e0fb12f8c6b19931fdcbcdf30edecf1c642031fcd6c23cff62f4aba34", + "loads": [ + 18, + 11, + 12, + 4, + 14, + 12, + 7, + 11, + 9, + 8, + 10, + 14, + 1, + 0, + 9, + 12, + 3, + 26, + 4, + 6, + 19, + 9, + 6, + 14, + 2, + 0, + 0, + 15, + 10, + 4, + 8, + 22, + 29, + 8, + 0, + 0, + 16, + 11, + 7, + 6, + 21, + 5, + 4, + 23, + 6, + 10, + 8, + 23, + 5, + 8, + 13, + 6, + 6, + 4, + 12, + 14, + 3, + 25, + 20, + 1, + 0, + 15, + 25, + 2 + ], + "weighted_loads": [ + 1.383093524724245, + 0.47992124035954475, + 0.9404020216315985, + 0.25932013988494873, + 1.2787076700478792, + 0.9861434958875179, + 0.43130892142653465, + 0.9756620228290558, + 0.7734606117010117, + 0.5992015600204468, + 0.8754502646625042, + 0.673474483191967, + 0.03894531726837158, + 0.0, + 0.4557567834854126, + 0.9868290722370148, + 0.2823733240365982, + 2.4937752448022366, + 0.1549975946545601, + 0.601123683154583, + 1.5556178838014603, + 0.3786433655768633, + 0.5452982261776924, + 1.1847644001245499, + 0.09801416471600533, + 0.0, + 0.0, + 0.7745393998920918, + 0.6211478784680367, + 0.13524418324232101, + 0.6400337740778923, + 1.8512651398777962, + 2.4131905175745487, + 0.541920643299818, + 0.0, + 0.0, + 1.204941626638174, + 1.2884976007044315, + 0.5448890924453735, + 0.6278200596570969, + 1.386929303407669, + 0.2558045797049999, + 0.22321440279483795, + 1.7608647290617228, + 0.3568670339882374, + 0.47012918442487717, + 0.4536384865641594, + 1.998764242976904, + 0.15351511165499687, + 0.4001362584531307, + 0.9948554411530495, + 0.24304964393377304, + 0.6198853030800819, + 0.12975943833589554, + 0.9339115992188454, + 0.9993716664612293, + 0.1883574202656746, + 1.6524037029594183, + 1.6623603608459234, + 0.051944028586149216, + 0.0, + 1.2009014189243317, + 1.7788934037089348, + 0.12155627086758614 + ], + "unique_experts": 58, + "load_cv": 0.7385854619695192, + "normalized_load_entropy": 0.9287132537560583, + "max_load_share": 0.04559748427672956 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "003bbda4f777c82e28b2ce459a162a74d37392fb1076c11cdc3ecf02821f9ed6", + "route_weight_sha256": "271fd3a188199cb9786f88333f9d4bd0411bdcad5d597cda5cf9c8917f6d368f", + "loads": [ + 18, + 15, + 16, + 8, + 15, + 12, + 8, + 11, + 9, + 8, + 20, + 15, + 1, + 12, + 12, + 16, + 3, + 26, + 8, + 6, + 19, + 10, + 9, + 14, + 2, + 6, + 6, + 15, + 10, + 21, + 8, + 23, + 29, + 9, + 9, + 0, + 16, + 14, + 8, + 6, + 24, + 7, + 12, + 23, + 6, + 11, + 20, + 23, + 7, + 9, + 15, + 7, + 8, + 4, + 12, + 14, + 3, + 25, + 20, + 13, + 5, + 15, + 28, + 2 + ], + "weighted_loads": [ + 1.383093524724245, + 0.6886724345386028, + 1.148554164916277, + 0.5996733209758531, + 1.3460298273712397, + 0.9861434958875179, + 0.502544853836298, + 0.9756620228290558, + 0.7734606117010117, + 0.5992015600204468, + 1.5329637955874205, + 0.6905452534556389, + 0.03894531726837158, + 0.8632313832640648, + 0.5304814875125885, + 1.2813857197761536, + 0.2823733240365982, + 2.4937752448022366, + 0.4018089660385158, + 0.601123683154583, + 1.5556178838014603, + 0.6682619471102953, + 0.7171807326376438, + 1.1847644001245499, + 0.09801416471600533, + 0.37096923030912876, + 0.8075688853859901, + 0.7745393998920918, + 0.6211478784680367, + 1.362694934286992, + 0.6400337740778923, + 1.8696508258581161, + 2.4131905175745487, + 0.5672772768884897, + 0.8518289034254849, + 0.0, + 1.204941626638174, + 1.4688700437545776, + 1.5415120124816895, + 0.6278200596570969, + 1.527960117906332, + 0.3884730413556099, + 0.5834011938422918, + 1.7608647290617228, + 0.3568670339882374, + 0.5002261120826006, + 1.7620475962758064, + 1.998764242976904, + 0.24493155628442764, + 0.42812927439808846, + 1.0757415369153023, + 0.3686927929520607, + 0.7084471546113491, + 0.12975943833589554, + 0.9339115992188454, + 0.9993716664612293, + 0.1883574202656746, + 1.6524037029594183, + 1.6623603608459234, + 0.7532928064465523, + 0.44540979946032166, + 1.2009014189243317, + 1.997762992978096, + 0.12155627086758614 + ], + "unique_experts": 63, + "load_cv": 0.5618226111975865, + "normalized_load_entropy": 0.9599701713736472, + "max_load_share": 0.03689567430025445 + } + }, + "s1_period": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "d29f344cb4614a551a6597742379f4ca5bbfce77be25bdc4f54c2b433e24be98", + "route_weight_sha256": "1194b80b778fded131adb82b63fab84da142a8c16ad43c84d1c993627daf3f87", + "loads": [ + 19, + 10, + 14, + 4, + 13, + 11, + 6, + 11, + 9, + 8, + 10, + 16, + 1, + 0, + 11, + 12, + 3, + 26, + 4, + 6, + 19, + 10, + 6, + 15, + 2, + 0, + 0, + 13, + 10, + 2, + 8, + 22, + 27, + 9, + 0, + 0, + 19, + 11, + 7, + 6, + 20, + 5, + 5, + 23, + 4, + 12, + 8, + 23, + 0, + 10, + 13, + 6, + 6, + 4, + 12, + 15, + 3, + 24, + 20, + 1, + 0, + 14, + 25, + 3 + ], + "weighted_loads": [ + 1.4335098434239626, + 0.42241799272596836, + 1.016542725265026, + 0.25353994220495224, + 1.253371600061655, + 0.9819605387747288, + 0.38093800470232964, + 1.014160431921482, + 0.768192071467638, + 0.5970341935753822, + 0.8805694282054901, + 0.7379926070570946, + 0.04044593870639801, + 0.0, + 0.5227374937385321, + 0.9788608737289906, + 0.2853848524391651, + 2.4917488507926464, + 0.14826666563749313, + 0.5861212573945522, + 1.5285871848464012, + 0.4245246108621359, + 0.518296554684639, + 1.1941444259136915, + 0.09388045221567154, + 0.0, + 0.0, + 0.7129826862365007, + 0.635498121380806, + 0.07647473365068436, + 0.6389786265790462, + 1.8099524844437838, + 2.3652852177619934, + 0.5715508684515953, + 0.0, + 0.0, + 1.3307781238108873, + 1.2778896354138851, + 0.5257143378257751, + 0.625584252178669, + 1.309664960950613, + 0.2549790143966675, + 0.2554640546441078, + 1.7802454233169556, + 0.29162305407226086, + 0.543442863970995, + 0.4806116260588169, + 1.9439614415168762, + 0.0, + 0.4612347986549139, + 1.0202568508684635, + 0.2535383999347687, + 0.5898472368717194, + 0.13683593645691872, + 0.9170299135148525, + 1.0212008766829967, + 0.19550712779164314, + 1.6243298910558224, + 1.6994267757982016, + 0.058721430599689484, + 0.0, + 1.1610051579773426, + 1.7484193854033947, + 0.13976320624351501 + ], + "unique_experts": 57, + "load_cv": 0.7443469960017739, + "normalized_load_entropy": 0.9251341046313518, + "max_load_share": 0.04245283018867924 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "555df4a58c7cb25d24efb68c2ce16d3b76c3b4dd11be8732980c9edf4b9ebee4", + "route_weight_sha256": "1b7e011f8e6593ac7deb815311b737a63c2cedbfd9c7a1a8f1d620c7ec1e5e21", + "loads": [ + 19, + 13, + 19, + 13, + 14, + 11, + 9, + 11, + 9, + 17, + 19, + 17, + 2, + 13, + 14, + 17, + 5, + 28, + 11, + 8, + 20, + 12, + 12, + 16, + 2, + 10, + 9, + 13, + 10, + 21, + 8, + 23, + 27, + 10, + 13, + 0, + 21, + 17, + 10, + 9, + 23, + 10, + 14, + 23, + 5, + 14, + 20, + 27, + 0, + 12, + 16, + 7, + 11, + 8, + 18, + 15, + 8, + 26, + 20, + 15, + 8, + 16, + 29, + 5 + ], + "weighted_loads": [ + 1.4335098434239626, + 0.5882428716868162, + 1.269698977470398, + 1.0487091776158195, + 1.3132524937391281, + 0.9819605387747288, + 0.6096223667263985, + 1.014160431921482, + 0.768192071467638, + 1.674880526959896, + 1.4702565614134073, + 0.7550633773207664, + 0.1407022774219513, + 0.9140410237014294, + 0.5974475666880608, + 1.3700060285627842, + 0.6483412273228168, + 2.562357412651181, + 0.6999118565581739, + 0.6759691871702671, + 1.577801190316677, + 0.7545200269669294, + 0.9631991125643253, + 1.2878709938377142, + 0.09388045221567154, + 0.6117020584642887, + 1.10291962698102, + 0.7129826862365007, + 0.635498121380806, + 1.152203792706132, + 0.6389786265790462, + 1.8283381704241037, + 2.3652852177619934, + 0.596907502040267, + 1.1257696545217186, + 0.0, + 1.3845367394387722, + 1.5661009345203638, + 1.7135656252503395, + 0.8366440311074257, + 1.4701087772846222, + 0.48294870935205836, + 0.6858336664736271, + 1.7802454233169556, + 0.32983562909066677, + 0.5740305708313826, + 1.8202248513698578, + 2.2824218049645424, + 0.0, + 0.5249073226004839, + 1.1463626734912395, + 0.3496968522667885, + 1.0785162597894669, + 0.3187461756169796, + 1.4684769101440907, + 1.0212008766829967, + 0.6165559478104115, + 1.6974737495183945, + 1.6994267757982016, + 0.9146947618573904, + 0.8937396183609962, + 1.3571239151060581, + 2.0654873214662075, + 0.2146223559975624 + ], + "unique_experts": 62, + "load_cv": 0.4863350898425885, + "normalized_load_entropy": 0.9678030004344504, + "max_load_share": 0.032879818594104306 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 106, + "ordered_topk_exact_tokens": 88, + "set_exact_tokens": 95, + "mean_set_jaccard": 0.9703504043126685, + "mean_token_weighted_tv": 0.006861931055713937, + "aggregate_load_tv": 0.015723270440251572 + }, + "system_bos": { + "tokens": 106, + "ordered_topk_exact_tokens": 78, + "set_exact_tokens": 88, + "mean_set_jaccard": 0.9474393530997305, + "mean_token_weighted_tv": 0.012502119797369782, + "aggregate_load_tv": 0.026729559748427674 + }, + "system_x": { + "tokens": 106, + "ordered_topk_exact_tokens": 71, + "set_exact_tokens": 80, + "mean_set_jaccard": 0.9278975741239892, + "mean_token_weighted_tv": 0.015501524023008797, + "aggregate_load_tv": 0.031446540880503145 + }, + "system_period": { + "tokens": 106, + "ordered_topk_exact_tokens": 75, + "set_exact_tokens": 83, + "mean_set_jaccard": 0.9344115004492364, + "mean_token_weighted_tv": 0.015066548927142372, + "aggregate_load_tv": 0.031446540880503145 + }, + "bos_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 68, + "set_exact_tokens": 80, + "mean_set_jaccard": 0.9278975741239892, + "mean_token_weighted_tv": 0.018258946165793908, + "aggregate_load_tv": 0.025157232704402517 + }, + "bos_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 66, + "set_exact_tokens": 79, + "mean_set_jaccard": 0.9272237196765499, + "mean_token_weighted_tv": 0.018835988009945966, + "aggregate_load_tv": 0.03616352201257862 + }, + "x_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 75, + "set_exact_tokens": 85, + "mean_set_jaccard": 0.9413746630727762, + "mean_token_weighted_tv": 0.01654420613820823, + "aggregate_load_tv": 0.028301886792452834 + }, + "x_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 62, + "set_exact_tokens": 74, + "mean_set_jaccard": 0.9137466307277629, + "mean_token_weighted_tv": 0.021473058578470407, + "aggregate_load_tv": 0.045597484276729564 + }, + "period_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 71, + "set_exact_tokens": 83, + "mean_set_jaccard": 0.9359838274932614, + "mean_token_weighted_tv": 0.016777586068887757, + "aggregate_load_tv": 0.026729559748427674 + }, + "period_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 62, + "set_exact_tokens": 74, + "mean_set_jaccard": 0.9117250673854448, + "mean_token_weighted_tv": 0.021654883065735393, + "aggregate_load_tv": 0.045597484276729564 + } + } + }, + "layer_05": { + "layer": 5, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "3b57efff154237fe225d9bbb9b4792cbb1c68c83a06bbc231a4e1d28313848ce", + "route_weight_sha256": "70c05905c07a242b066a24a7c52c4581f5cf1cadbe3fd5ffe6dba4561f891f6b", + "loads": [ + 4, + 5, + 19, + 7, + 14, + 6, + 2, + 13, + 8, + 10, + 0, + 4, + 6, + 17, + 41, + 1, + 11, + 1, + 0, + 4, + 12, + 5, + 23, + 10, + 8, + 6, + 14, + 7, + 5, + 16, + 11, + 6, + 24, + 17, + 23, + 0, + 13, + 2, + 0, + 1, + 14, + 0, + 9, + 5, + 12, + 15, + 13, + 10, + 14, + 1, + 0, + 10, + 2, + 6, + 9, + 8, + 11, + 11, + 25, + 34, + 27, + 11, + 7, + 6 + ], + "weighted_loads": [ + 0.2761971838772297, + 0.23429909348487854, + 1.5979280807077885, + 0.5224511586129665, + 0.7530813552439213, + 0.23955112881958485, + 0.15842075273394585, + 0.95862852409482, + 0.4077389985322952, + 0.4566696248948574, + 0.0, + 0.18056795001029968, + 0.516250267624855, + 1.215536743402481, + 3.2314039170742035, + 0.032475538551807404, + 1.0421234145760536, + 0.042541276663541794, + 0.0, + 0.20055846124887466, + 0.5368448197841644, + 0.36007263138890266, + 1.674861129373312, + 0.6140849739313126, + 0.5073203518986702, + 0.30816263891756535, + 0.9596301056444645, + 0.6679347641766071, + 0.24213692359626293, + 1.2785879969596863, + 0.6598573066294193, + 0.26035455241799355, + 1.1932132989168167, + 1.2630372308194637, + 1.896285830065608, + 0.0, + 0.7927178964018822, + 0.1956365667283535, + 0.0, + 0.03400837630033493, + 0.9655244182795286, + 0.0, + 0.9248266443610191, + 0.5098825693130493, + 0.724996916949749, + 1.1382833756506443, + 0.725476797670126, + 0.6976057961583138, + 1.1422322485595942, + 0.0587395504117012, + 0.0, + 0.6883076056838036, + 0.07289976999163628, + 0.4694150350987911, + 0.4994385279715061, + 0.5824432447552681, + 0.5576145872473717, + 0.8034348525106907, + 2.4997966289520264, + 3.9196354150772095, + 2.661437716335058, + 0.7106204126030207, + 0.3501591347157955, + 0.40345763973891735 + ], + "unique_experts": 58, + "load_cv": 0.8333985971833123, + "normalized_load_entropy": 0.9175175189687514, + "max_load_share": 0.06446540880503145 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "a17fbc88fcfe4218eba261cfb68ca109c1b08d284f13351ea33b38039f14be60", + "route_weight_sha256": "542c13b35c9cba0a3b4786b849eaed76bc7c3e945d5a1877e1657cbdeaa818d3", + "loads": [ + 4, + 6, + 19, + 7, + 15, + 7, + 4, + 15, + 9, + 11, + 10, + 4, + 9, + 17, + 41, + 13, + 14, + 7, + 9, + 5, + 14, + 5, + 23, + 10, + 8, + 14, + 14, + 7, + 5, + 17, + 11, + 6, + 24, + 17, + 23, + 5, + 13, + 2, + 11, + 8, + 19, + 8, + 18, + 6, + 14, + 15, + 13, + 12, + 14, + 4, + 7, + 10, + 4, + 15, + 12, + 17, + 11, + 11, + 25, + 35, + 27, + 11, + 7, + 8 + ], + "weighted_loads": [ + 0.2761971838772297, + 0.23780662985518575, + 1.5979280807077885, + 0.5224511586129665, + 0.7548475930234417, + 0.275870518758893, + 0.2325599379837513, + 0.9952205445151776, + 0.4110950971953571, + 0.4612001455388963, + 0.5883434191346169, + 0.18056795001029968, + 0.7125271484255791, + 1.215536743402481, + 3.2314039170742035, + 2.006290715187788, + 1.3009330332279205, + 0.339633546769619, + 0.8087241612374783, + 0.21362189669162035, + 0.5523287521209568, + 0.36007263138890266, + 1.674861129373312, + 0.6140849739313126, + 0.5073203518986702, + 1.2073265928775072, + 0.9596301056444645, + 0.6679347641766071, + 0.24213692359626293, + 1.3098694905638695, + 0.6598573066294193, + 0.26035455241799355, + 1.1932132989168167, + 1.2630372308194637, + 1.896285830065608, + 0.43511495366692543, + 0.7927178964018822, + 0.1956365667283535, + 1.0870030112564564, + 0.6388167031109333, + 1.17184441909194, + 0.7758868783712387, + 1.7709394916892052, + 0.5523672066628933, + 0.8847065195441246, + 1.1382833756506443, + 0.725476797670126, + 0.7155796405859292, + 1.1422322485595942, + 0.2135008331388235, + 0.6613304428756237, + 0.6883076056838036, + 1.7022130005061626, + 1.0633132793009281, + 0.5163133632158861, + 1.2703734785318375, + 0.5576145872473717, + 0.8034348525106907, + 2.4997966289520264, + 3.9653655365109444, + 2.661437716335058, + 0.7106204126030207, + 0.3501591347157955, + 1.3389437329024076 + ], + "unique_experts": 64, + "load_cv": 0.5956535936654047, + "normalized_load_entropy": 0.9620027956711968, + "max_load_share": 0.05216284987277354 + } + }, + "s1_eos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "1520c8cf520477f7af530cc84523c9e6a5f05846e284f9433cd8d2543cf8f585", + "route_weight_sha256": "326f2e15a93b2f8720f048667e56dfdacb73e2c1a55c93c519e9600b62752c07", + "loads": [ + 4, + 6, + 19, + 6, + 13, + 6, + 2, + 13, + 8, + 10, + 0, + 3, + 6, + 17, + 41, + 1, + 11, + 1, + 0, + 5, + 12, + 5, + 23, + 11, + 7, + 7, + 15, + 7, + 5, + 15, + 11, + 5, + 24, + 17, + 22, + 0, + 13, + 2, + 0, + 1, + 14, + 0, + 9, + 5, + 12, + 15, + 17, + 10, + 15, + 1, + 1, + 10, + 2, + 5, + 7, + 8, + 11, + 11, + 25, + 34, + 27, + 10, + 7, + 6 + ], + "weighted_loads": [ + 0.273258525878191, + 0.2588463630527258, + 1.6056763976812363, + 0.4870515912771225, + 0.7181868366897106, + 0.2428632490336895, + 0.15972161665558815, + 0.9477242231369019, + 0.4052456021308899, + 0.46278220415115356, + 0.0, + 0.15137894824147224, + 0.5164763145148754, + 1.2115086503326893, + 3.201437082141638, + 0.032706405967473984, + 1.0371468476951122, + 0.04200546815991402, + 0.0, + 0.23676839098334312, + 0.5489494726061821, + 0.3611077778041363, + 1.6621416248381138, + 0.6569396629929543, + 0.47246785648167133, + 0.3336329162120819, + 1.0094166733324528, + 0.6686172485351562, + 0.24136106669902802, + 1.2459398955106735, + 0.6631479263305664, + 0.2223997302353382, + 1.1976938471198082, + 1.2789466045796871, + 1.8582854121923447, + 0.0, + 0.7851021103560925, + 0.19801176339387894, + 0.0, + 0.03374800831079483, + 0.9540967848151922, + 0.0, + 0.9135397970676422, + 0.5068499930202961, + 0.7272137030959129, + 1.131502240896225, + 0.891317879781127, + 0.6967779211699963, + 1.1695406343787909, + 0.059888217598199844, + 0.02574901655316353, + 0.6694751493632793, + 0.07575823739171028, + 0.44440530613064766, + 0.42806725576519966, + 0.5691402815282345, + 0.5571539048105478, + 0.7991954758763313, + 2.5212221406400204, + 3.954327717423439, + 2.6436433233320713, + 0.6696202345192432, + 0.351798340678215, + 0.4231371097266674 + ], + "unique_experts": 59, + "load_cv": 0.8352949500468861, + "normalized_load_entropy": 0.9178603789424242, + "max_load_share": 0.06446540880503145 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "fe059ef4fd18ce4e2391aab132d3c9b6dba16a79246b2bd6d9f07ce7470690c0", + "route_weight_sha256": "df01e67abbc59ad6627593415335d58822c4c8296ac45b1bd8f97b05203e0339", + "loads": [ + 5, + 7, + 19, + 12, + 14, + 8, + 11, + 15, + 9, + 11, + 12, + 6, + 11, + 17, + 42, + 15, + 15, + 12, + 12, + 15, + 14, + 5, + 24, + 11, + 8, + 15, + 15, + 9, + 5, + 18, + 11, + 5, + 25, + 18, + 23, + 5, + 14, + 5, + 12, + 12, + 18, + 14, + 22, + 9, + 14, + 15, + 17, + 13, + 15, + 15, + 10, + 12, + 4, + 15, + 11, + 18, + 11, + 11, + 26, + 35, + 28, + 10, + 7, + 10 + ], + "weighted_loads": [ + 0.31015167012810707, + 0.26241649757139385, + 1.6056763976812363, + 0.9000983871519566, + 0.7199600775493309, + 0.3159369081258774, + 1.1719492264091969, + 1.0025324574671686, + 0.4086057851091027, + 0.46720202965661883, + 0.749253373593092, + 0.5264166556298733, + 0.9454875290393829, + 1.2115086503326893, + 3.2351355850696564, + 2.5190200493671, + 1.3823277093470097, + 0.7209266126155853, + 1.1467117443680763, + 1.089568835683167, + 0.5642884767148644, + 0.3611077778041363, + 1.7001036629080772, + 0.6569396629929543, + 0.5485547874122858, + 1.052002664655447, + 1.0094166733324528, + 0.8413334935903549, + 0.24136106669902802, + 1.3625003546476364, + 0.6631479263305664, + 0.2223997302353382, + 1.3174441307783127, + 1.3223239928483963, + 1.8928320854902267, + 0.5633079707622528, + 0.8307116627693176, + 0.3489954322576523, + 1.2307952865958214, + 1.0963216051459312, + 1.1183835808187723, + 1.2118655294179916, + 2.045615378767252, + 0.7520828321576118, + 0.8581251800060272, + 1.131502240896225, + 0.891317879781127, + 0.7477731846738607, + 1.1695406343787909, + 0.888741685077548, + 1.0886446684598923, + 0.7376639470458031, + 1.7050272412598133, + 1.247693058103323, + 0.482790156500414, + 1.1867046486586332, + 0.5571539048105478, + 0.7991954758763313, + 2.5917196162045, + 4.001807041466236, + 2.689540561288595, + 0.6696202345192432, + 0.351798340678215, + 1.6015939451754093 + ], + "unique_experts": 64, + "load_cv": 0.5041107542720596, + "normalized_load_entropy": 0.972616601238238, + "max_load_share": 0.047619047619047616 + } + }, + "s0_bos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "09d3a60b8d7c003df8840c1034d1914c09c815572f48ad02c43514d21791607d", + "route_weight_sha256": "ce6d318b39fb0360e3ccf319e0a0403626c0a99b2f31fb96f4b3eb0efc227404", + "loads": [ + 4, + 5, + 18, + 6, + 14, + 4, + 2, + 13, + 9, + 10, + 0, + 4, + 6, + 17, + 44, + 1, + 11, + 1, + 0, + 7, + 10, + 5, + 23, + 11, + 9, + 6, + 13, + 7, + 4, + 16, + 10, + 4, + 24, + 17, + 24, + 0, + 14, + 2, + 0, + 1, + 14, + 0, + 9, + 5, + 13, + 15, + 12, + 12, + 15, + 1, + 0, + 11, + 2, + 5, + 8, + 8, + 11, + 11, + 26, + 32, + 29, + 10, + 6, + 5 + ], + "weighted_loads": [ + 0.28699941188097, + 0.22002526558935642, + 1.6305641531944275, + 0.5041002854704857, + 0.7518262639641762, + 0.17744944989681244, + 0.15616508945822716, + 0.9529927186667919, + 0.4310535080730915, + 0.4422050416469574, + 0.0, + 0.18635361641645432, + 0.5006782822310925, + 1.2218029648065567, + 3.4630591347813606, + 0.0357411727309227, + 1.0452084206044674, + 0.04175717756152153, + 0.0, + 0.31780530512332916, + 0.4641650393605232, + 0.3577819913625717, + 1.708116341382265, + 0.6728749889880419, + 0.531679192557931, + 0.30176530964672565, + 0.9436810072511435, + 0.6536173783242702, + 0.21892181783914566, + 1.2495930660516024, + 0.6235874481499195, + 0.18595163524150848, + 1.1643490884453058, + 1.2639025375247002, + 1.928069081157446, + 0.0, + 0.8243421204388142, + 0.1987389512360096, + 0.0, + 0.030410941690206528, + 0.9941627979278564, + 0.0, + 0.9746658802032471, + 0.5249365195631981, + 0.7604710403829813, + 1.1209786683321, + 0.6991582401096821, + 0.7756349742412567, + 1.1540546659380198, + 0.06794162839651108, + 0.0, + 0.7233836576342583, + 0.0769541822373867, + 0.45145104825496674, + 0.46742277778685093, + 0.5843697339296341, + 0.5615446828305721, + 0.8148158695548773, + 2.5452078320086002, + 3.8811997398734093, + 2.7747649755328894, + 0.689559506252408, + 0.32540978491306305, + 0.39519111812114716 + ], + "unique_experts": 58, + "load_cv": 0.8593828155266332, + "normalized_load_entropy": 0.914029662573577, + "max_load_share": 0.06918238993710692 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "b1987dc0918c14b7cb250aef3caeeda22c5c6c97181f7be2a4026ee9127d45f9", + "route_weight_sha256": "5152145bf582b273f869b3a9d36b9e312730aee9a871e8eb12a2def5114cef4b", + "loads": [ + 4, + 6, + 18, + 6, + 14, + 5, + 4, + 14, + 10, + 10, + 10, + 4, + 9, + 17, + 44, + 14, + 14, + 7, + 10, + 8, + 11, + 5, + 23, + 11, + 9, + 14, + 13, + 7, + 4, + 17, + 10, + 4, + 24, + 17, + 24, + 5, + 14, + 2, + 12, + 9, + 18, + 8, + 19, + 6, + 15, + 15, + 12, + 13, + 15, + 5, + 7, + 11, + 3, + 14, + 10, + 18, + 11, + 11, + 26, + 33, + 29, + 11, + 6, + 7 + ], + "weighted_loads": [ + 0.28699941188097, + 0.22353280195966363, + 1.6305641531944275, + 0.5041002854704857, + 0.7518262639641762, + 0.2137688398361206, + 0.22913124412298203, + 0.9560513298492879, + 0.43440960673615336, + 0.4422050416469574, + 0.5947984904050827, + 0.18635361641645432, + 0.703481025993824, + 1.2218029648065567, + 3.4630591347813606, + 2.061862599104643, + 1.3209374360740185, + 0.3388494476675987, + 0.9389357529580593, + 0.33086874056607485, + 0.4767464203760028, + 0.3577819913625717, + 1.708116341382265, + 0.6728749889880419, + 0.531679192557931, + 1.2009292636066675, + 0.9436810072511435, + 0.6536173783242702, + 0.21892181783914566, + 1.281581187620759, + 0.6235874481499195, + 0.18595163524150848, + 1.1643490884453058, + 1.2639025375247002, + 1.928069081157446, + 0.44420283660292625, + 0.8243421204388142, + 0.1987389512360096, + 1.2645667530596256, + 0.6685140803456306, + 1.16968834400177, + 0.8131344094872475, + 1.8884949460625648, + 0.5698330923914909, + 0.9187457654625177, + 1.1209786683321, + 0.6991582401096821, + 0.7912051910534501, + 1.1540546659380198, + 0.25935244001448154, + 0.6353364773094654, + 0.7233836576342583, + 0.7417305670678616, + 1.0453492924571037, + 0.48239232902415097, + 1.2686380930244923, + 0.5615446828305721, + 0.8148158695548773, + 2.5452078320086002, + 3.926929861307144, + 2.7747649755328894, + 0.7254539337009192, + 0.32540978491306305, + 1.3306772112846375 + ], + "unique_experts": 64, + "load_cv": 0.6168423884394373, + "normalized_load_entropy": 0.9596193377173321, + "max_load_share": 0.05597964376590331 + } + }, + "s1_bos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "92ae5e54b4e00eba3822b8c7fb91e3e8ce7a42ff995a4fe42bca1acbb6e31262", + "route_weight_sha256": "f8fb02ce5ae6b7fd2211234bda95097d0cd00b1b04d9df108b3e43098b5ab697", + "loads": [ + 4, + 4, + 18, + 6, + 13, + 5, + 1, + 13, + 9, + 12, + 0, + 4, + 6, + 18, + 42, + 1, + 13, + 1, + 0, + 8, + 11, + 6, + 24, + 10, + 8, + 6, + 13, + 7, + 4, + 16, + 11, + 5, + 23, + 18, + 23, + 0, + 14, + 2, + 0, + 0, + 14, + 0, + 9, + 5, + 12, + 15, + 13, + 12, + 14, + 1, + 1, + 10, + 2, + 6, + 7, + 8, + 10, + 11, + 25, + 33, + 28, + 9, + 6, + 6 + ], + "weighted_loads": [ + 0.2723713628947735, + 0.17943602427840233, + 1.6327356025576591, + 0.5091480873525143, + 0.7045920714735985, + 0.21587774902582169, + 0.11667592823505402, + 0.9334580339491367, + 0.43524566292762756, + 0.5203309915959835, + 0.0, + 0.18458692729473114, + 0.510307177901268, + 1.2986016049981117, + 3.306475382298231, + 0.038254037499427795, + 1.125069659203291, + 0.04226955026388168, + 0.0, + 0.3521433137357235, + 0.4875191692262888, + 0.40265967324376106, + 1.7045094594359398, + 0.6353721935302019, + 0.49847506918013096, + 0.29758716374635696, + 0.9444682635366917, + 0.6575903818011284, + 0.21566849015653133, + 1.278101846575737, + 0.6861764006316662, + 0.21511086076498032, + 1.12572599388659, + 1.3227451294660568, + 1.8900359347462654, + 0.0, + 0.8323256000876427, + 0.20694146677851677, + 0.0, + 0.0, + 0.9503297246992588, + 0.0, + 0.9757227897644043, + 0.5374079048633575, + 0.744583748281002, + 1.1051589474081993, + 0.7471506856381893, + 0.8072361163794994, + 1.134652715176344, + 0.06030157208442688, + 0.026601171121001244, + 0.6666428446769714, + 0.07692320644855499, + 0.48802625015378, + 0.43603439070284367, + 0.5735924430191517, + 0.5369332022964954, + 0.8099641688168049, + 2.496285943314433, + 3.959498817101121, + 2.720400556921959, + 0.6779414862394333, + 0.3300756737589836, + 0.44039031118154526 + ], + "unique_experts": 58, + "load_cv": 0.8432130614963472, + "normalized_load_entropy": 0.9155773336480183, + "max_load_share": 0.0660377358490566 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "c1af7007cb50fef97e2aed5ece225625c4e1325167ea3ad8f1aa89056f5d5d0c", + "route_weight_sha256": "0a806652c14b80fde89b3e588e053e65e42751b85a72873045be5d9774967cf4", + "loads": [ + 5, + 5, + 18, + 12, + 13, + 7, + 10, + 15, + 10, + 12, + 13, + 7, + 11, + 18, + 43, + 16, + 18, + 12, + 14, + 18, + 12, + 6, + 25, + 10, + 9, + 14, + 13, + 9, + 4, + 18, + 11, + 5, + 24, + 19, + 24, + 5, + 15, + 5, + 13, + 11, + 17, + 13, + 22, + 10, + 14, + 15, + 13, + 14, + 14, + 14, + 11, + 12, + 3, + 16, + 10, + 19, + 10, + 11, + 26, + 34, + 29, + 10, + 6, + 10 + ], + "weighted_loads": [ + 0.30926450714468956, + 0.18300615879707038, + 1.6327356025576591, + 0.9221948832273483, + 0.7045920714735985, + 0.28895140811800957, + 1.125692255795002, + 0.9882662682794034, + 0.4386058459058404, + 0.5203309915959835, + 0.7900383472442627, + 0.5596246346831322, + 0.9554594494402409, + 1.2986016049981117, + 3.3401738852262497, + 2.583036793861538, + 1.5196766033768654, + 0.721190694719553, + 1.3040767721831799, + 1.2049437584355474, + 0.5001005502417684, + 0.40265967324376106, + 1.7424714975059032, + 0.6353721935302019, + 0.5745620001107454, + 1.015956912189722, + 0.9444682635366917, + 0.8303066268563271, + 0.21566849015653133, + 1.3652342110872269, + 0.6861764006316662, + 0.21511086076498032, + 1.2454762775450945, + 1.366122517734766, + 1.9245826080441475, + 0.5740801692008972, + 0.8779351525008678, + 0.3579251356422901, + 1.3889021910727024, + 1.0396398603916168, + 1.07914325222373, + 1.194096889346838, + 2.0936169363558292, + 0.8167814649641514, + 0.8776725828647614, + 1.1051589474081993, + 0.7471506856381893, + 0.8558024140074849, + 1.134652715176344, + 0.8541472163051367, + 1.112227601930499, + 0.7348316423594952, + 0.7416995912790298, + 1.2913140021264553, + 0.488769106566906, + 1.211756220087409, + 0.5369332022964954, + 0.8099641688168049, + 2.566783418878913, + 4.006978141143918, + 2.766297794878483, + 0.7172098383307457, + 0.3300756737589836, + 1.6188471466302872 + ], + "unique_experts": 64, + "load_cv": 0.516524220811125, + "normalized_load_entropy": 0.9710130920480787, + "max_load_share": 0.048752834467120185 + } + }, + "s0_x": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "521ef5ae2845a135818a199bdf950bacb58410aecaa98a758a45af1d4548c799", + "route_weight_sha256": "1d5353123f020e46159dfdbd1900263cd959229ec7d9003765912e405ce7eb27", + "loads": [ + 4, + 5, + 19, + 6, + 12, + 4, + 1, + 14, + 9, + 9, + 0, + 4, + 6, + 17, + 44, + 1, + 12, + 1, + 0, + 7, + 10, + 6, + 23, + 11, + 9, + 6, + 13, + 7, + 4, + 16, + 10, + 5, + 24, + 17, + 25, + 0, + 14, + 2, + 0, + 1, + 14, + 0, + 9, + 5, + 13, + 13, + 14, + 12, + 15, + 1, + 0, + 10, + 2, + 5, + 8, + 8, + 10, + 10, + 26, + 33, + 30, + 9, + 6, + 5 + ], + "weighted_loads": [ + 0.28960999473929405, + 0.21904591470956802, + 1.6572074219584465, + 0.5036738403141499, + 0.6714675202965736, + 0.1761832106858492, + 0.11184820532798767, + 0.9970546327531338, + 0.42270630970597267, + 0.39437147229909897, + 0.0, + 0.18288059532642365, + 0.503829400986433, + 1.2406531870365143, + 3.4302462600171566, + 0.03608600050210953, + 1.0967595130205154, + 0.041888460516929626, + 0.0, + 0.3178752176463604, + 0.4506108779460192, + 0.38909459486603737, + 1.6821111664175987, + 0.6562007311731577, + 0.5480351038277149, + 0.30127573758363724, + 0.9338174350559711, + 0.6506579034030437, + 0.21185784228146076, + 1.2843787055462599, + 0.6242860332131386, + 0.2262522205710411, + 1.1596531085669994, + 1.2693320102989674, + 1.9239522218704224, + 0.0, + 0.8194264099001884, + 0.1970386579632759, + 0.0, + 0.03181346133351326, + 0.9955142308026552, + 0.0, + 0.9360817894339561, + 0.51978699862957, + 0.7662921436131, + 1.0292490646243095, + 0.7624312378466129, + 0.7387987542897463, + 1.1592014469206333, + 0.06197395548224449, + 0.0, + 0.6714247800409794, + 0.07860065996646881, + 0.44798582792282104, + 0.460428424179554, + 0.5827002078294754, + 0.5084603894501925, + 0.7622124962508678, + 2.5461564250290394, + 3.8723686672747135, + 2.7916135042905807, + 0.6517201289534569, + 0.32088828459382057, + 0.3871508240699768 + ], + "unique_experts": 58, + "load_cv": 0.870359359312455, + "normalized_load_entropy": 0.9125119929856927, + "max_load_share": 0.06918238993710692 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "7cb40385e1cf64b2d6c856417430df9d874d884c007250be3075903f695fdeb1", + "route_weight_sha256": "33241d8ffe0eff9f1e74915e135122bda59551e85774cc7d51e5cc53197e6db6", + "loads": [ + 4, + 6, + 19, + 6, + 12, + 5, + 3, + 15, + 10, + 9, + 11, + 4, + 9, + 17, + 44, + 14, + 15, + 7, + 9, + 8, + 11, + 6, + 23, + 11, + 9, + 15, + 13, + 7, + 4, + 16, + 10, + 5, + 24, + 17, + 25, + 5, + 14, + 2, + 10, + 8, + 20, + 8, + 18, + 7, + 15, + 13, + 14, + 13, + 15, + 4, + 7, + 10, + 3, + 16, + 10, + 18, + 10, + 10, + 26, + 34, + 30, + 10, + 6, + 7 + ], + "weighted_loads": [ + 0.28960999473929405, + 0.22255345107987523, + 1.6572074219584465, + 0.5036738403141499, + 0.6714675202965736, + 0.21250260062515736, + 0.1829225718975067, + 1.0001132439356297, + 0.42606240836903453, + 0.39437147229909897, + 0.6823634393513203, + 0.18288059532642365, + 0.7124452106654644, + 1.2406531870365143, + 3.4302462600171566, + 2.2493473552167416, + 1.3520278558135033, + 0.3389807306230068, + 0.8001624047756195, + 0.3309386530891061, + 0.46319225896149874, + 0.38909459486603737, + 1.6821111664175987, + 0.6562007311731577, + 0.5480351038277149, + 1.2855325192213058, + 0.9338174350559711, + 0.6506579034030437, + 0.21185784228146076, + 1.2843787055462599, + 0.6242860332131386, + 0.2262522205710411, + 1.1596531085669994, + 1.2693320102989674, + 1.9239522218704224, + 0.4439144544303417, + 0.8194264099001884, + 0.1970386579632759, + 0.9474252574145794, + 0.6408631578087807, + 1.2860548328608274, + 0.7794261798262596, + 1.688373900949955, + 0.5882744919508696, + 0.9089803509414196, + 1.0292490646243095, + 0.7624312378466129, + 0.7543689711019397, + 1.1592014469206333, + 0.211581664159894, + 0.6363357529044151, + 0.6714247800409794, + 0.7433770447969437, + 1.1554992944002151, + 0.475397975416854, + 1.3446766547858715, + 0.5084603894501925, + 0.7622124962508678, + 2.5461564250290394, + 3.9180987887084484, + 2.7916135042905807, + 0.6882599331438541, + 0.32088828459382057, + 1.322636917233467 + ], + "unique_experts": 64, + "load_cv": 0.6304632892613512, + "normalized_load_entropy": 0.9580356372277505, + "max_load_share": 0.05597964376590331 + } + }, + "s1_x": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "c448a5ab4e9e6f817a975d5b9992e11c331664cd2309aee3c983f358531887ea", + "route_weight_sha256": "af2b1748857ca46f714f5b9006e42434f5569dd668a92d58b9a3e3612117a164", + "loads": [ + 4, + 4, + 19, + 6, + 13, + 6, + 1, + 14, + 9, + 11, + 0, + 5, + 6, + 19, + 41, + 1, + 12, + 1, + 0, + 7, + 11, + 6, + 23, + 11, + 8, + 4, + 12, + 7, + 4, + 15, + 12, + 5, + 23, + 19, + 23, + 1, + 14, + 2, + 0, + 0, + 13, + 0, + 9, + 5, + 14, + 15, + 14, + 12, + 14, + 1, + 1, + 10, + 2, + 6, + 8, + 8, + 10, + 10, + 26, + 32, + 28, + 8, + 6, + 5 + ], + "weighted_loads": [ + 0.2705626040697098, + 0.16444430500268936, + 1.6568969562649727, + 0.5056982412934303, + 0.6975999660789967, + 0.2516584675759077, + 0.11652390658855438, + 0.9586781971156597, + 0.43701258674263954, + 0.4820769391953945, + 0.0, + 0.2139271181076765, + 0.5118849165737629, + 1.3588974364101887, + 3.2182189375162125, + 0.036771804094314575, + 1.1022383011877537, + 0.04229295998811722, + 0.0, + 0.3409423381090164, + 0.4983784519135952, + 0.3985049966722727, + 1.6512815468013287, + 0.6636479310691357, + 0.4977568332105875, + 0.23656393960118294, + 0.9038323797285557, + 0.6455539241433144, + 0.20953549444675446, + 1.2535856328904629, + 0.7081022560596466, + 0.21499639749526978, + 1.1275823153555393, + 1.326598921790719, + 1.85178641974926, + 0.027132607996463776, + 0.8259866386651993, + 0.20501281693577766, + 0.0, + 0.0, + 0.9395398460328579, + 0.0, + 0.9370989762246609, + 0.5325417816638947, + 0.8118966408073902, + 1.091446079313755, + 0.7812010906636715, + 0.7986282873898745, + 1.130721341818571, + 0.05685627833008766, + 0.02627115324139595, + 0.6575233414769173, + 0.07703258469700813, + 0.4903441593050957, + 0.4796519074589014, + 0.5768377259373665, + 0.5199233889579773, + 0.7550073228776455, + 2.5487854443490505, + 3.9258524365723133, + 2.7178446650505066, + 0.6394951641559601, + 0.32808710634708405, + 0.42170400172472 + ], + "unique_experts": 59, + "load_cv": 0.8373759780046351, + "normalized_load_entropy": 0.9168159856942634, + "max_load_share": 0.06446540880503145 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "edcba33bbbb03bb224c504861b43eb830fc968440642368a92232a52f45bb9ef", + "route_weight_sha256": "19a5f7db15009f59f09f39bbc4b5787f554fcecb942aa2a0bd050546934e6e96", + "loads": [ + 5, + 5, + 19, + 12, + 13, + 8, + 10, + 16, + 10, + 11, + 14, + 8, + 11, + 19, + 42, + 16, + 17, + 12, + 13, + 17, + 12, + 6, + 24, + 11, + 9, + 13, + 12, + 9, + 4, + 17, + 12, + 5, + 24, + 21, + 24, + 7, + 15, + 5, + 11, + 11, + 17, + 12, + 21, + 10, + 16, + 15, + 14, + 14, + 14, + 14, + 9, + 12, + 3, + 18, + 11, + 19, + 10, + 10, + 27, + 33, + 29, + 9, + 6, + 9 + ], + "weighted_loads": [ + 0.30745574831962585, + 0.16801443952135742, + 1.6568969562649727, + 0.9187450371682644, + 0.6975999660789967, + 0.3247321266680956, + 1.12599141523242, + 1.0134864314459264, + 0.4403727697208524, + 0.4820769391953945, + 0.8807821795344353, + 0.5889648254960775, + 0.9638131447136402, + 1.3588974364101887, + 3.251917440444231, + 2.7910267733968794, + 1.497281227260828, + 0.7212141044437885, + 1.1330297514796257, + 1.1937427828088403, + 0.5109598329290748, + 0.3985049966722727, + 1.6892435848712921, + 0.6636479310691357, + 0.573843764141202, + 1.0331332609057426, + 0.9038323797285557, + 0.818270169198513, + 0.20953549444675446, + 1.3407179974019527, + 0.7081022560596466, + 0.21499639749526978, + 1.2473325990140438, + 1.4144231285899878, + 1.886333093047142, + 0.6493267752230167, + 0.8715961910784245, + 0.355996485799551, + 1.0556631237268448, + 1.053996205329895, + 1.1424413286149502, + 1.1116073541343212, + 1.9237234890460968, + 0.8081716038286686, + 0.9346510358154774, + 1.091446079313755, + 0.7812010906636715, + 0.8471945850178599, + 1.130721341818571, + 0.8446190897375345, + 1.0004497319459915, + 0.725712139159441, + 0.741808969527483, + 1.4031410366296768, + 0.5323866233229637, + 1.2844394613057375, + 0.5199233889579773, + 0.7550073228776455, + 2.6192829199135303, + 3.9733317606151104, + 2.7637419030070305, + 0.6788381040096283, + 0.32808710634708405, + 1.600160837173462 + ], + "unique_experts": 64, + "load_cv": 0.5097907118576094, + "normalized_load_entropy": 0.9716560845390239, + "max_load_share": 0.047619047619047616 + } + }, + "s0_period": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "eba0b61c7378a0f8960a657d91a13f60dca73ce799a8be42e4c8263713c7d578", + "route_weight_sha256": "afcf163a865dacd8c3c184ab382cfb483ea26a75c5465e0e3fec030bda4cb7ad", + "loads": [ + 4, + 5, + 19, + 6, + 12, + 4, + 2, + 14, + 9, + 9, + 0, + 4, + 6, + 17, + 44, + 1, + 12, + 1, + 0, + 7, + 10, + 5, + 23, + 11, + 9, + 6, + 12, + 7, + 4, + 16, + 10, + 5, + 24, + 18, + 25, + 0, + 12, + 2, + 0, + 1, + 14, + 0, + 9, + 5, + 13, + 14, + 13, + 11, + 15, + 1, + 1, + 10, + 2, + 5, + 8, + 8, + 11, + 11, + 26, + 33, + 29, + 10, + 6, + 5 + ], + "weighted_loads": [ + 0.2911284491419792, + 0.2136759962886572, + 1.6573541648685932, + 0.5049134492874146, + 0.6677041538059711, + 0.17350596748292446, + 0.1501302272081375, + 1.0021866969764233, + 0.4208994582295418, + 0.3939860723912716, + 0.0, + 0.17975200712680817, + 0.5025958605110645, + 1.2434532307088375, + 3.421797003597021, + 0.03515452519059181, + 1.1031105890870094, + 0.04245282709598541, + 0.0, + 0.3145093098282814, + 0.4482201747596264, + 0.36077026277780533, + 1.6835118494927883, + 0.6567829363048077, + 0.5379807204008102, + 0.29658592119812965, + 0.895279549062252, + 0.6421254687011242, + 0.2102744784206152, + 1.270906463265419, + 0.626553550362587, + 0.2255145013332367, + 1.1533816866576672, + 1.307883258908987, + 1.926602877676487, + 0.0, + 0.7403202336281538, + 0.19570130109786987, + 0.0, + 0.03167843818664551, + 0.9771712254732847, + 0.0, + 0.9585147313773632, + 0.5147436149418354, + 0.7658663541078568, + 1.066864874213934, + 0.7321038544178009, + 0.7111231852322817, + 1.149877218529582, + 0.055151116102933884, + 0.02533409371972084, + 0.6773535422980785, + 0.0779927596449852, + 0.4543108120560646, + 0.45628406666219234, + 0.5660599619150162, + 0.5442394148558378, + 0.8019027337431908, + 2.5394110586494207, + 3.8672256022691727, + 2.7491778805851936, + 0.6835048981010914, + 0.3199523836374283, + 0.39294588565826416 + ], + "unique_experts": 59, + "load_cv": 0.8639733231351976, + "normalized_load_entropy": 0.9147735547250929, + "max_load_share": 0.06918238993710692 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "3a6f9b74d1cd3ab27ad6212fd4106618f1b643740dfde2113605195a097808a2", + "route_weight_sha256": "571fab35eeba41b6ca8af55c21b2dabb0de1192ac856ccbb680932c4de3da4ce", + "loads": [ + 4, + 6, + 19, + 6, + 12, + 5, + 4, + 15, + 10, + 9, + 11, + 4, + 9, + 17, + 44, + 14, + 16, + 8, + 9, + 8, + 11, + 5, + 23, + 11, + 9, + 14, + 12, + 7, + 4, + 17, + 10, + 5, + 24, + 18, + 25, + 6, + 12, + 2, + 10, + 8, + 19, + 8, + 18, + 6, + 16, + 14, + 13, + 12, + 15, + 4, + 8, + 10, + 3, + 14, + 10, + 18, + 11, + 11, + 26, + 34, + 29, + 11, + 6, + 7 + ], + "weighted_loads": [ + 0.2911284491419792, + 0.2171835326589644, + 1.6573541648685932, + 0.5049134492874146, + 0.6677041538059711, + 0.20982535742223263, + 0.22231224551796913, + 1.0052453081589192, + 0.42425555689260364, + 0.3939860723912716, + 0.6823554486036301, + 0.17975200712680817, + 0.7108417004346848, + 1.2434532307088375, + 3.421797003597021, + 2.081454373896122, + 1.4047366976737976, + 0.3967764750123024, + 0.7431162446737289, + 0.3275727452710271, + 0.46080155577510595, + 0.36077026277780533, + 1.6835118494927883, + 0.6567829363048077, + 0.5379807204008102, + 1.1957498751580715, + 0.895279549062252, + 0.6421254687011242, + 0.2102744784206152, + 1.2983839511871338, + 0.626553550362587, + 0.2255145013332367, + 1.1533816866576672, + 1.307883258908987, + 1.926602877676487, + 0.49155354872345924, + 0.7403202336281538, + 0.19570130109786987, + 0.9144930392503738, + 0.6344478093087673, + 1.2099221479147673, + 0.811584122478962, + 1.7214358821511269, + 0.5549290664494038, + 0.9675811938941479, + 1.066864874213934, + 0.7321038544178009, + 0.7266934020444751, + 1.149877218529582, + 0.20270770229399204, + 0.673789482563734, + 0.6773535422980785, + 0.74276914447546, + 1.0482090562582016, + 0.4712536178994924, + 1.4598106667399406, + 0.5442394148558378, + 0.8019027337431908, + 2.5394110586494207, + 3.9129557237029076, + 2.7491778805851936, + 0.7203886695206165, + 0.3199523836374283, + 1.3284319788217545 + ], + "unique_experts": 64, + "load_cv": 0.6245199646988511, + "normalized_load_entropy": 0.9589581592713964, + "max_load_share": 0.05597964376590331 + } + }, + "s1_period": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "3a16cfbd9b61f6235941b36ea74e0fe827f2c36ea04addd2279025b16ca5bf87", + "route_weight_sha256": "9940e42df9d24776ad769802014a2b266c3d8065e574e81220ee99026e88c9a7", + "loads": [ + 4, + 4, + 19, + 6, + 13, + 7, + 1, + 14, + 9, + 12, + 0, + 5, + 6, + 18, + 41, + 1, + 12, + 1, + 0, + 7, + 11, + 6, + 23, + 10, + 8, + 5, + 12, + 7, + 4, + 15, + 12, + 5, + 23, + 18, + 23, + 0, + 15, + 2, + 0, + 0, + 13, + 0, + 9, + 5, + 14, + 15, + 14, + 11, + 15, + 1, + 1, + 10, + 2, + 6, + 7, + 8, + 10, + 10, + 26, + 33, + 28, + 8, + 6, + 5 + ], + "weighted_loads": [ + 0.2738468013703823, + 0.16690963134169579, + 1.6513909790664911, + 0.5112374313175678, + 0.6973665878176689, + 0.28019013069570065, + 0.11460141092538834, + 0.9673934206366539, + 0.43200764060020447, + 0.519241951406002, + 0.0, + 0.2133330162614584, + 0.513216532766819, + 1.3121608085930347, + 3.219789005815983, + 0.036083757877349854, + 1.110483881086111, + 0.04226798191666603, + 0.0, + 0.3361010327935219, + 0.49435911513864994, + 0.3987145200371742, + 1.6561531461775303, + 0.6292204111814499, + 0.501107020303607, + 0.2663535140454769, + 0.9007492512464523, + 0.6392649300396442, + 0.20910786651074886, + 1.2471573259681463, + 0.7235634066164494, + 0.21420235373079777, + 1.1114836893975735, + 1.3087545074522495, + 1.856117706745863, + 0.0, + 0.8615227788686752, + 0.2045011818408966, + 0.0, + 0.0, + 0.9084270428866148, + 0.0, + 0.9510293640196323, + 0.5320027023553848, + 0.8146764971315861, + 1.0897832177579403, + 0.7805402297526598, + 0.7663612924516201, + 1.1545982658863068, + 0.05420715734362602, + 0.02595900557935238, + 0.658225204795599, + 0.07552536204457283, + 0.4926677383482456, + 0.43432730063796043, + 0.5659472793340683, + 0.5247951801866293, + 0.75280986353755, + 2.5463509932160378, + 3.9175856560468674, + 2.733426922932267, + 0.6455886028707027, + 0.32885288819670677, + 0.4178813472390175 + ], + "unique_experts": 58, + "load_cv": 0.8405819784986105, + "normalized_load_entropy": 0.915681235156182, + "max_load_share": 0.06446540880503145 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "f0ba2978082ac5def8bd6c08090a4d0e61f79d1f7df88997820e47e61441f796", + "route_weight_sha256": "9713e024da3b2014dd32c7185b2d3fe94dc14975932541a2b083b02e78e0f9b8", + "loads": [ + 5, + 5, + 19, + 12, + 13, + 9, + 10, + 16, + 10, + 12, + 14, + 8, + 11, + 18, + 42, + 17, + 17, + 13, + 13, + 17, + 12, + 6, + 24, + 10, + 9, + 13, + 12, + 9, + 4, + 17, + 12, + 5, + 24, + 19, + 24, + 6, + 16, + 5, + 11, + 11, + 17, + 13, + 21, + 10, + 17, + 15, + 14, + 13, + 15, + 14, + 9, + 12, + 3, + 16, + 10, + 19, + 10, + 10, + 27, + 34, + 29, + 9, + 6, + 9 + ], + "weighted_loads": [ + 0.3107399456202984, + 0.17047976586036384, + 1.6513909790664911, + 0.9242842271924019, + 0.6973665878176689, + 0.3532637897878885, + 1.1236328780651093, + 1.0222016549669206, + 0.4353678235784173, + 0.519241951406002, + 0.8936670906841755, + 0.5883707236498594, + 0.9646544009447098, + 1.3121608085930347, + 3.2534875087440014, + 2.6560107157565653, + 1.528101559728384, + 0.7630832381546497, + 1.0898001044988632, + 1.1889014774933457, + 0.5069404961541295, + 0.3987145200371742, + 1.6941151842474937, + 0.6292204111814499, + 0.5771939512342215, + 0.984723262488842, + 0.9007492512464523, + 0.8119811750948429, + 0.20910786651074886, + 1.3342896904796362, + 0.7235634066164494, + 0.21420235373079777, + 1.231233973056078, + 1.3521318957209587, + 1.890664380043745, + 0.6508699506521225, + 0.9071323312819004, + 0.35548485070466995, + 1.016826804727316, + 1.0445926785469055, + 1.090026030316949, + 1.2221363186836243, + 1.9529891051352024, + 0.8068786859512329, + 0.9871384389698505, + 1.0897832177579403, + 0.7805402297526598, + 0.8149275900796056, + 1.1545982658863068, + 0.8381983134895563, + 0.9975737649947405, + 0.7264140024781227, + 0.7403017468750477, + 1.295955490320921, + 0.48706201650202274, + 1.3676566649228334, + 0.5247951801866293, + 0.75280986353755, + 2.6168484687805176, + 3.9650649800896645, + 2.779324160888791, + 0.6857624836266041, + 0.32885288819670677, + 1.5963381826877594 + ], + "unique_experts": 64, + "load_cv": 0.5110801246927482, + "normalized_load_entropy": 0.9715426309081285, + "max_load_share": 0.047619047619047616 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 106, + "ordered_topk_exact_tokens": 87, + "set_exact_tokens": 94, + "mean_set_jaccard": 0.965633423180593, + "mean_token_weighted_tv": 0.008173429969487325, + "aggregate_load_tv": 0.017295597484276733 + }, + "system_bos": { + "tokens": 106, + "ordered_topk_exact_tokens": 71, + "set_exact_tokens": 82, + "mean_set_jaccard": 0.9353099730458221, + "mean_token_weighted_tv": 0.015211167991301924, + "aggregate_load_tv": 0.028301886792452824 + }, + "system_x": { + "tokens": 106, + "ordered_topk_exact_tokens": 64, + "set_exact_tokens": 77, + "mean_set_jaccard": 0.9218328840970351, + "mean_token_weighted_tv": 0.018547516939985863, + "aggregate_load_tv": 0.029874213836477988 + }, + "system_period": { + "tokens": 106, + "ordered_topk_exact_tokens": 64, + "set_exact_tokens": 77, + "mean_set_jaccard": 0.9218328840970351, + "mean_token_weighted_tv": 0.018187031193794508, + "aggregate_load_tv": 0.03144654088050314 + }, + "bos_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 70, + "set_exact_tokens": 81, + "mean_set_jaccard": 0.9285714285714287, + "mean_token_weighted_tv": 0.018541945153320173, + "aggregate_load_tv": 0.02987421383647798 + }, + "bos_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 57, + "set_exact_tokens": 73, + "mean_set_jaccard": 0.9110512129380055, + "mean_token_weighted_tv": 0.02200140270738388, + "aggregate_load_tv": 0.03459119496855346 + }, + "x_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 68, + "set_exact_tokens": 78, + "mean_set_jaccard": 0.9204851752021564, + "mean_token_weighted_tv": 0.0199337673180227, + "aggregate_load_tv": 0.03773584905660377 + }, + "x_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 54, + "set_exact_tokens": 69, + "mean_set_jaccard": 0.8942048517520215, + "mean_token_weighted_tv": 0.025355663001185882, + "aggregate_load_tv": 0.040880503144654086 + }, + "period_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 69, + "set_exact_tokens": 78, + "mean_set_jaccard": 0.9225067385444746, + "mean_token_weighted_tv": 0.019123776165663072, + "aggregate_load_tv": 0.033018867924528295 + }, + "period_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 58, + "set_exact_tokens": 71, + "mean_set_jaccard": 0.9036388140161725, + "mean_token_weighted_tv": 0.023873280285734613, + "aggregate_load_tv": 0.03773584905660377 + } + } + }, + "layer_06": { + "layer": 6, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "d312f244aef5956c418ef47cb7eb3a086ca22c3513f7f09000c4fd18155ad758", + "route_weight_sha256": "7c3435ba420a996e885650ceac8de5aacb6ba5eeae5de1b7a478b3954a2effae", + "loads": [ + 7, + 2, + 2, + 19, + 10, + 5, + 7, + 16, + 23, + 6, + 14, + 5, + 6, + 9, + 14, + 8, + 5, + 2, + 7, + 4, + 18, + 17, + 5, + 5, + 5, + 20, + 6, + 14, + 40, + 8, + 17, + 9, + 0, + 1, + 1, + 0, + 25, + 1, + 24, + 7, + 21, + 13, + 2, + 2, + 25, + 6, + 0, + 3, + 7, + 22, + 3, + 17, + 5, + 0, + 18, + 1, + 2, + 8, + 5, + 6, + 8, + 39, + 14, + 15 + ], + "weighted_loads": [ + 0.3071697875857353, + 0.06784368678927422, + 0.13162225484848022, + 1.3445884808897972, + 0.4629886541515589, + 0.34635409712791443, + 0.34386630915105343, + 1.1315651386976242, + 2.408040829002857, + 0.41282129660248756, + 1.3459609113633633, + 0.31206217035651207, + 0.7164726704359055, + 0.7972980514168739, + 0.7603673078119755, + 0.39977334626019, + 0.4146498925983906, + 0.08519201911985874, + 0.5982144400477409, + 0.2404152788221836, + 1.0551602877676487, + 1.2507864125072956, + 0.19507474452257156, + 0.19762170314788818, + 0.1897541806101799, + 1.2556553576141596, + 0.23130776174366474, + 1.041527047753334, + 3.247094079852104, + 0.39358463883399963, + 0.8913376368582249, + 0.5750906951725483, + 0.0, + 0.028205515816807747, + 0.0833287164568901, + 0.0, + 2.3945555705577135, + 0.04184648394584656, + 1.891489204019308, + 0.30080750212073326, + 1.4069373030215502, + 0.9265116695314646, + 0.07146695256233215, + 0.13882547244429588, + 1.8154393397271633, + 0.18698743917047977, + 0.0, + 0.1770142875611782, + 0.49519651010632515, + 2.37932813167572, + 0.17114900052547455, + 1.287222232669592, + 0.32870373874902725, + 0.0, + 1.5023333691060543, + 0.03699066862463951, + 0.10414430126547813, + 0.6009477954357862, + 0.19303329847753048, + 0.28118614852428436, + 0.4186785575002432, + 3.2194770127534866, + 0.6039900220930576, + 1.0899751782417297 + ], + "unique_experts": 60, + "load_cv": 0.889064398637493, + "normalized_load_entropy": 0.9101799228678294, + "max_load_share": 0.06289308176100629 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "a881e7f396e90e19fb0b071ae5df8bb77e5afd58d18d0f5efdb493727563ac9b", + "route_weight_sha256": "6cec17a5ef6d3a51844addd5271511870559ed9f37fa1063fb7a485351f8b174", + "loads": [ + 7, + 4, + 2, + 19, + 11, + 5, + 16, + 16, + 23, + 6, + 14, + 11, + 6, + 11, + 16, + 9, + 10, + 3, + 7, + 13, + 19, + 21, + 7, + 6, + 5, + 21, + 6, + 14, + 40, + 11, + 17, + 9, + 5, + 1, + 2, + 5, + 25, + 8, + 24, + 16, + 21, + 19, + 4, + 2, + 25, + 11, + 12, + 5, + 11, + 22, + 9, + 24, + 5, + 0, + 18, + 11, + 12, + 8, + 5, + 15, + 8, + 39, + 14, + 15 + ], + "weighted_loads": [ + 0.3071697875857353, + 0.10750133357942104, + 0.13162225484848022, + 1.3445884808897972, + 0.49176791682839394, + 0.34635409712791443, + 1.3268975410610437, + 1.1315651386976242, + 2.408040829002857, + 0.41282129660248756, + 1.3459609113633633, + 0.7294659800827503, + 0.7164726704359055, + 0.8253445941954851, + 0.8949576877057552, + 0.4356148559600115, + 0.7997126504778862, + 0.08923931233584881, + 0.5982144400477409, + 0.8220425583422184, + 1.0990978218615055, + 1.5020581427961588, + 1.68899817019701, + 0.23330182954669, + 0.1897541806101799, + 1.2833882197737694, + 0.23130776174366474, + 1.041527047753334, + 3.247094079852104, + 0.5572588630020618, + 0.8913376368582249, + 0.5750906951725483, + 0.17470654100179672, + 0.028205515816807747, + 0.1179552711546421, + 0.4531530328094959, + 2.3945555705577135, + 0.6480760127305984, + 1.891489204019308, + 0.6622715890407562, + 1.4069373030215502, + 1.4125333037227392, + 0.12936127930879593, + 0.13882547244429588, + 1.8154393397271633, + 0.32134975772351027, + 1.3017774485051632, + 0.19937790767289698, + 0.7016692738980055, + 2.37932813167572, + 0.6967690140008926, + 1.5948810800909996, + 0.32870373874902725, + 0.0, + 1.5023333691060543, + 0.7996482029557228, + 1.2718817666172981, + 0.6009477954357862, + 0.19303329847753048, + 1.2501131556928158, + 0.4186785575002432, + 3.2194770127534866, + 0.6039900220930576, + 1.0899751782417297 + ], + "unique_experts": 63, + "load_cv": 0.669201520842609, + "normalized_load_entropy": 0.9477882791175685, + "max_load_share": 0.05089058524173028 + } + }, + "s1_eos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "c5a4af76e0743851f3d1fec41c6f256886015719dbc8aaf52f162b31ed0049c1", + "route_weight_sha256": "0331ac87852e3a618366f33c52ee1a1e3f34f654e44f4b610d964e6034a54fb2", + "loads": [ + 7, + 2, + 2, + 19, + 11, + 5, + 7, + 15, + 23, + 6, + 14, + 5, + 6, + 9, + 14, + 8, + 5, + 2, + 7, + 4, + 18, + 17, + 7, + 4, + 5, + 20, + 6, + 15, + 40, + 7, + 17, + 9, + 0, + 1, + 1, + 0, + 24, + 1, + 23, + 6, + 20, + 13, + 2, + 2, + 25, + 5, + 0, + 5, + 7, + 22, + 3, + 16, + 5, + 0, + 17, + 1, + 2, + 8, + 7, + 6, + 8, + 40, + 15, + 15 + ], + "weighted_loads": [ + 0.30063183046877384, + 0.06886604055762291, + 0.12951336055994034, + 1.3636667169630527, + 0.49183399975299835, + 0.3401011247187853, + 0.3510566111654043, + 1.0983436852693558, + 2.384106617420912, + 0.4074960723519325, + 1.3288297839462757, + 0.3134022504091263, + 0.7167456448078156, + 0.7940850742161274, + 0.757407408207655, + 0.3974882196635008, + 0.41995835304260254, + 0.08391257002949715, + 0.5997213087975979, + 0.237983338534832, + 1.069889210164547, + 1.240111991763115, + 0.2776549234986305, + 0.1669748518615961, + 0.19471034593880177, + 1.221265435218811, + 0.23062215000391006, + 1.0618271492421627, + 3.223397273570299, + 0.3446815125644207, + 0.9118099734187126, + 0.5817090086638927, + 0.0, + 0.02851802110671997, + 0.08218980580568314, + 0.0, + 2.3546845987439156, + 0.04211655259132385, + 1.8412668108940125, + 0.2588118128478527, + 1.362906102091074, + 0.9213712587952614, + 0.07120567932724953, + 0.1402808129787445, + 1.8322645910084248, + 0.1576666347682476, + 0.0, + 0.2622273713350296, + 0.4999426454305649, + 2.3663324303925037, + 0.17049193382263184, + 1.2767874673008919, + 0.3185344710946083, + 0.0, + 1.4736099652945995, + 0.037213731557130814, + 0.10712093487381935, + 0.5986851342022419, + 0.2567753531038761, + 0.29182499647140503, + 0.4174389913678169, + 3.251227777451277, + 0.6390848997980356, + 1.085508055984974 + ], + "unique_experts": 60, + "load_cv": 0.8835302860603158, + "normalized_load_entropy": 0.9115399201761747, + "max_load_share": 0.06289308176100629 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "b437ff4fa790e05b206680e164393900f1c3149fdd023a34cf131ca46928ef94", + "route_weight_sha256": "d736ef715e1bdd6c3ba8fa38ec73f3644011599af3a826afc4edf64c5759c9c2", + "loads": [ + 7, + 4, + 5, + 20, + 13, + 5, + 21, + 16, + 28, + 12, + 14, + 15, + 10, + 11, + 23, + 10, + 15, + 3, + 9, + 15, + 20, + 22, + 9, + 5, + 6, + 21, + 6, + 16, + 41, + 10, + 17, + 12, + 7, + 2, + 5, + 7, + 25, + 16, + 23, + 15, + 20, + 19, + 4, + 2, + 26, + 9, + 16, + 7, + 10, + 22, + 11, + 22, + 6, + 3, + 17, + 12, + 19, + 8, + 7, + 18, + 13, + 40, + 15, + 15 + ], + "weighted_loads": [ + 0.30063183046877384, + 0.10849128663539886, + 0.2708248719573021, + 1.401042364537716, + 0.6429674103856087, + 0.3401011247187853, + 1.7012226916849613, + 1.1600135043263435, + 2.726183544844389, + 1.1150626093149185, + 1.3288297839462757, + 0.9924247898161411, + 1.047210682183504, + 0.8224118920043111, + 1.430873952805996, + 0.5448066871613264, + 1.2346994131803513, + 0.08799710124731064, + 0.7478381842374802, + 1.018173921853304, + 1.1626358889043331, + 1.5603526253253222, + 1.769626833498478, + 0.20233765430748463, + 0.227445462718606, + 1.2566518038511276, + 0.23062215000391006, + 1.0886018592864275, + 3.260178990662098, + 0.5312478095293045, + 0.9118099734187126, + 0.7788127511739731, + 0.24381256476044655, + 0.06211774796247482, + 0.341581579297781, + 0.6703130267560482, + 2.389031011611223, + 1.2123986892402172, + 1.8412668108940125, + 0.736721932888031, + 1.362906102091074, + 1.421156384050846, + 0.12915625423192978, + 0.1402808129787445, + 1.917019035667181, + 0.25656531867571175, + 1.6188007201999426, + 0.28461913648061454, + 0.6687656156718731, + 2.3663324303925037, + 0.8139457739889622, + 1.5157772675156593, + 0.3555344007909298, + 0.1675299070775509, + 1.4736099652945995, + 1.049981128424406, + 1.89202169328928, + 0.5986851342022419, + 0.2567753531038761, + 1.391948876902461, + 0.6786106452345848, + 3.251227777451277, + 0.6390848997980356, + 1.085508055984974 + ], + "unique_experts": 64, + "load_cv": 0.5897043277813561, + "normalized_load_entropy": 0.9594564497964009, + "max_load_share": 0.046485260770975055 + } + }, + "s0_bos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "9b14d4a85dbebedce06ad97ca6b834d527607941125413f9044c36106368047b", + "route_weight_sha256": "eef3b823dd74b8b14b5dbd96e21b4a38d6cd8f074d640164a3d0c59722f0629e", + "loads": [ + 7, + 3, + 2, + 18, + 9, + 4, + 6, + 15, + 22, + 6, + 14, + 5, + 6, + 7, + 13, + 8, + 5, + 1, + 7, + 4, + 18, + 19, + 7, + 4, + 5, + 20, + 5, + 16, + 40, + 7, + 18, + 9, + 0, + 0, + 3, + 0, + 24, + 1, + 24, + 6, + 19, + 12, + 2, + 2, + 24, + 6, + 0, + 5, + 8, + 24, + 3, + 17, + 6, + 0, + 17, + 1, + 2, + 8, + 7, + 6, + 8, + 42, + 15, + 14 + ], + "weighted_loads": [ + 0.3043613266199827, + 0.09828509390354156, + 0.13294041901826859, + 1.3399278223514557, + 0.42684391140937805, + 0.31323377415537834, + 0.32653884403407574, + 1.107758890837431, + 2.324183613061905, + 0.4190693125128746, + 1.4085845462977886, + 0.32245679572224617, + 0.7151332348585129, + 0.7470290809869766, + 0.7212327755987644, + 0.3898205328732729, + 0.4107371084392071, + 0.05895473062992096, + 0.6078956872224808, + 0.24082544445991516, + 1.0643982663750648, + 1.3370909746736288, + 0.2640463709831238, + 0.16359319165349007, + 0.18726828880608082, + 1.229577036574483, + 0.1918695978820324, + 1.1542197577655315, + 3.205473303794861, + 0.3578449562191963, + 0.9393647201359272, + 0.5709956884384155, + 0.0, + 0.0, + 0.14396903105080128, + 0.0, + 2.3832289464771748, + 0.0477713942527771, + 1.9191543143242598, + 0.2514582294970751, + 1.3494067713618279, + 0.9176216684281826, + 0.0758351981639862, + 0.13611196354031563, + 1.8528747111558914, + 0.19487666338682175, + 0.0, + 0.2636315952986479, + 0.5359612181782722, + 2.4636821411550045, + 0.1725662536919117, + 1.2645039223134518, + 0.3636898957192898, + 0.0, + 1.4812888018786907, + 0.03431219980120659, + 0.09680192917585373, + 0.605901962146163, + 0.2628474738448858, + 0.2812344431877136, + 0.4188144989311695, + 3.464435512199998, + 0.6447085663676262, + 1.059813391417265 + ], + "unique_experts": 59, + "load_cv": 0.8980947093914455, + "normalized_load_entropy": 0.9094808557517545, + "max_load_share": 0.0660377358490566 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "0c509d84c512e04349074a037daf8f7ce918a05773e756a7033c0306dd73b001", + "route_weight_sha256": "c8e6156446d72e386a765d636c41450fe4a6773703c4e8581ab4195a3ef43946", + "loads": [ + 7, + 4, + 2, + 18, + 10, + 4, + 15, + 15, + 22, + 6, + 14, + 11, + 6, + 8, + 16, + 10, + 11, + 1, + 7, + 13, + 19, + 23, + 8, + 5, + 5, + 21, + 5, + 16, + 40, + 11, + 18, + 9, + 4, + 0, + 4, + 5, + 24, + 9, + 24, + 15, + 19, + 18, + 4, + 2, + 24, + 10, + 13, + 6, + 12, + 24, + 10, + 24, + 6, + 0, + 17, + 11, + 12, + 8, + 7, + 15, + 8, + 42, + 15, + 14 + ], + "weighted_loads": [ + 0.3043613266199827, + 0.13319546729326248, + 0.13294041901826859, + 1.3399278223514557, + 0.4556231740862131, + 0.31323377415537834, + 1.3263382036238909, + 1.107758890837431, + 2.324183613061905, + 0.4190693125128746, + 1.4085845462977886, + 0.7550490349531174, + 0.7151332348585129, + 0.7701297458261251, + 0.9046255946159363, + 0.4773463997989893, + 0.8361816257238388, + 0.05895473062992096, + 0.6078956872224808, + 0.8137293271720409, + 1.1083358004689217, + 1.5894059054553509, + 0.810261607170105, + 0.19927331805229187, + 0.18726828880608082, + 1.2573098987340927, + 0.1918695978820324, + 1.1542197577655315, + 3.205473303794861, + 0.5709140859544277, + 0.9393647201359272, + 0.5709956884384155, + 0.13838420063257217, + 0.0, + 0.17859558574855328, + 0.4566383846104145, + 2.3832289464771748, + 0.7227206379175186, + 1.9191543143242598, + 0.6086010504513979, + 1.3494067713618279, + 1.4005168825387955, + 0.13372952491044998, + 0.13611196354031563, + 1.8528747111558914, + 0.3251990657299757, + 1.5290389098227024, + 0.2827364895492792, + 0.7446406800299883, + 2.4636821411550045, + 0.7660990357398987, + 1.5721627697348595, + 0.3636898957192898, + 0.0, + 1.4812888018786907, + 0.7969697341322899, + 1.3166692554950714, + 0.605901962146163, + 0.2628474738448858, + 1.250161450356245, + 0.4188144989311695, + 3.464435512199998, + 0.6447085663676262, + 1.059813391417265 + ], + "unique_experts": 62, + "load_cv": 0.6801036928015736, + "normalized_load_entropy": 0.9458381580305029, + "max_load_share": 0.05343511450381679 + } + }, + "s1_bos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "60011c360f828760a94e53999b25fc730000b05055d63d722cf6d2ef8f20bf47", + "route_weight_sha256": "65a4ddb2074591521dd6018b92b1272e29b32bb81bfdaf7ab190934d9d6755eb", + "loads": [ + 7, + 3, + 2, + 19, + 11, + 6, + 7, + 16, + 22, + 6, + 14, + 5, + 6, + 7, + 13, + 9, + 5, + 1, + 7, + 4, + 18, + 17, + 6, + 5, + 6, + 20, + 7, + 14, + 38, + 7, + 19, + 9, + 0, + 0, + 2, + 0, + 23, + 1, + 22, + 5, + 20, + 11, + 2, + 2, + 24, + 6, + 0, + 5, + 8, + 21, + 3, + 18, + 5, + 0, + 18, + 1, + 2, + 9, + 6, + 6, + 6, + 43, + 17, + 14 + ], + "weighted_loads": [ + 0.2923469506204128, + 0.09864060394465923, + 0.12566913291811943, + 1.4189933575689793, + 0.5114049017429352, + 0.3664386812597513, + 0.3629935458302498, + 1.1324086114764214, + 2.3060640953481197, + 0.4123132210224867, + 1.3634449429810047, + 0.31653741002082825, + 0.7004546374082565, + 0.738445833325386, + 0.7378025688230991, + 0.43148113787174225, + 0.4212102070450783, + 0.062084805220365524, + 0.6008766628801823, + 0.23501430079340935, + 1.0858620777726173, + 1.2501785680651665, + 0.2402779646217823, + 0.19874035194516182, + 0.23323237337172031, + 1.190163318067789, + 0.2524646706879139, + 1.0224366784095764, + 3.0682774502784014, + 0.3704349473118782, + 1.0118897836655378, + 0.5695366486907005, + 0.0, + 0.0, + 0.11838768422603607, + 0.0, + 2.3133245669305325, + 0.049266647547483444, + 1.856918215751648, + 0.22173995152115822, + 1.3698976021260023, + 0.8945362251251936, + 0.07687260210514069, + 0.13969701156020164, + 1.8325353525578976, + 0.19658225774765015, + 0.0, + 0.2626241371035576, + 0.5333563759922981, + 2.3359834291040897, + 0.17542283609509468, + 1.3169947043061256, + 0.3229624554514885, + 0.0, + 1.547408301383257, + 0.03501420095562935, + 0.09484478458762169, + 0.6301467251032591, + 0.22364869713783264, + 0.28239959850907326, + 0.33488910645246506, + 3.4769766833633184, + 0.7176405340433121, + 1.0366056822240353 + ], + "unique_experts": 59, + "load_cv": 0.8846041066250222, + "normalized_load_entropy": 0.9111335424996113, + "max_load_share": 0.06761006289308176 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "c41aa4c3b89419c24b0e1c27a7fdab36f72c29de9adb33512dd49e88ae10f627", + "route_weight_sha256": "be1e569541384af039548e5fe62d057d3095f03cff2502362d3193a7777cbac7", + "loads": [ + 7, + 4, + 5, + 20, + 13, + 6, + 22, + 17, + 27, + 12, + 14, + 15, + 10, + 8, + 22, + 12, + 16, + 1, + 9, + 15, + 20, + 22, + 7, + 6, + 7, + 21, + 7, + 15, + 39, + 10, + 19, + 12, + 7, + 1, + 6, + 7, + 24, + 16, + 22, + 14, + 20, + 17, + 4, + 2, + 25, + 9, + 17, + 7, + 11, + 21, + 12, + 24, + 6, + 3, + 18, + 12, + 19, + 9, + 6, + 18, + 11, + 43, + 17, + 14 + ], + "weighted_loads": [ + 0.2923469506204128, + 0.13350786454975605, + 0.2669806443154812, + 1.4563690051436424, + 0.6625383123755455, + 0.3664386812597513, + 1.7720167804509401, + 1.1940784305334091, + 2.648141022771597, + 1.1198797579854727, + 1.3634449429810047, + 1.0094906464219093, + 1.030919674783945, + 0.7615464981645346, + 1.4172781743109226, + 0.641682606190443, + 1.2771816477179527, + 0.062084805220365524, + 0.7489935383200645, + 1.014296293258667, + 1.1786087565124035, + 1.5708902273327112, + 0.7864932008087635, + 0.23410315439105034, + 0.26596749015152454, + 1.2255496867001057, + 0.2524646706879139, + 1.0492113884538412, + 3.1050591673702, + 0.5585234612226486, + 1.0118897836655378, + 0.7666403912007809, + 0.24091879278421402, + 0.03359972685575485, + 0.3777794577181339, + 0.6786021329462528, + 2.34767097979784, + 1.2771566212177277, + 1.856918215751648, + 0.6996500715613365, + 1.3698976021260023, + 1.3963752519339323, + 0.13482317700982094, + 0.13969701156020164, + 1.9172897972166538, + 0.29170222766697407, + 1.8000326585024595, + 0.3383314460515976, + 0.709616407752037, + 2.3359834291040897, + 0.8991959802806377, + 1.555984504520893, + 0.35996238514781, + 0.1675299070775509, + 1.547408301383257, + 1.0477815978229046, + 1.9591775201261044, + 0.6301467251032591, + 0.22364869713783264, + 1.3825234789401293, + 0.5960607603192329, + 3.4769766833633184, + 0.7176405340433121, + 1.0366056822240353 + ], + "unique_experts": 64, + "load_cv": 0.5929043983544934, + "normalized_load_entropy": 0.9583885109911207, + "max_load_share": 0.048752834467120185 + } + }, + "s0_x": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "21f3db42898c44cb4d29802dbd70dc059d3cfb3ee213aa28385c267cf1b050f7", + "route_weight_sha256": "d4dbe8d6fd29475e0a69658643305e8fb3d3ac846d0dfa602a0d142c03aaf90b", + "loads": [ + 7, + 2, + 2, + 19, + 8, + 5, + 7, + 17, + 22, + 6, + 14, + 5, + 6, + 7, + 14, + 8, + 5, + 1, + 7, + 4, + 18, + 18, + 7, + 4, + 5, + 20, + 5, + 15, + 39, + 8, + 17, + 9, + 0, + 0, + 2, + 0, + 24, + 1, + 23, + 5, + 19, + 13, + 2, + 2, + 25, + 6, + 0, + 5, + 7, + 24, + 3, + 16, + 7, + 0, + 17, + 1, + 2, + 8, + 7, + 6, + 8, + 43, + 15, + 14 + ], + "weighted_loads": [ + 0.3015555068850517, + 0.06721125915646553, + 0.12732788920402527, + 1.357424758374691, + 0.3934864290058613, + 0.3381571304053068, + 0.3655206002295017, + 1.1529814712703228, + 2.326108366250992, + 0.4134873077273369, + 1.4035720713436604, + 0.314245767891407, + 0.703861877322197, + 0.7330030612647533, + 0.8036770150065422, + 0.4021935500204563, + 0.4168533869087696, + 0.05715130642056465, + 0.5977863892912865, + 0.23919270560145378, + 1.0692734494805336, + 1.2738577723503113, + 0.28550177067518234, + 0.17017896845936775, + 0.18758254684507847, + 1.2327769100666046, + 0.1928212083876133, + 1.0545493923127651, + 3.099494831636548, + 0.39486441388726234, + 0.914456445723772, + 0.5701671950519085, + 0.0, + 0.0, + 0.1151320468634367, + 0.0, + 2.4051999524235725, + 0.045403432101011276, + 1.854442484676838, + 0.2044808380305767, + 1.3535062558948994, + 0.9400210827589035, + 0.07525216788053513, + 0.1376742608845234, + 1.8420629184693098, + 0.19421559385955334, + 0.0, + 0.25384748727083206, + 0.4888065904378891, + 2.468854308128357, + 0.17833329737186432, + 1.2214438803493977, + 0.40309763699769974, + 0.0, + 1.4692290164530277, + 0.03437314182519913, + 0.09762167930603027, + 0.6022088993340731, + 0.26734907180070877, + 0.27924542129039764, + 0.41265360452234745, + 3.4678005650639534, + 0.6501494012773037, + 1.0419858023524284 + ], + "unique_experts": 59, + "load_cv": 0.9000305450384971, + "normalized_load_entropy": 0.9087389251601621, + "max_load_share": 0.06761006289308176 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "94f6e398a8c8d062f5023941a2b03f2c7349cf5d5889cf8a594836221d22845d", + "route_weight_sha256": "d8631f2f9a631ae38d1c317b52804bd226d97e96fff1eef0fcbcff46fa51ada6", + "loads": [ + 7, + 3, + 2, + 19, + 9, + 5, + 18, + 17, + 22, + 6, + 14, + 10, + 6, + 8, + 17, + 10, + 10, + 1, + 7, + 14, + 19, + 22, + 8, + 5, + 5, + 21, + 5, + 15, + 39, + 11, + 17, + 9, + 4, + 0, + 3, + 5, + 24, + 9, + 23, + 13, + 19, + 21, + 4, + 2, + 25, + 10, + 12, + 6, + 11, + 24, + 8, + 24, + 7, + 0, + 17, + 12, + 11, + 8, + 7, + 16, + 8, + 43, + 15, + 14 + ], + "weighted_loads": [ + 0.3015555068850517, + 0.10212163254618645, + 0.12732788920402527, + 1.357424758374691, + 0.42226569168269634, + 0.3381571304053068, + 1.6485511139035225, + 1.1529814712703228, + 2.326108366250992, + 0.4134873077273369, + 1.4035720713436604, + 0.679142314940691, + 0.703861877322197, + 0.7561037261039019, + 0.9851437769830227, + 0.49394748359918594, + 0.8023114055395126, + 0.05715130642056465, + 0.5977863892912865, + 0.8741810172796249, + 1.1132109835743904, + 1.5137018244713545, + 0.8317170068621635, + 0.20585909485816956, + 0.18758254684507847, + 1.2605097722262144, + 0.1928212083876133, + 1.0545493923127651, + 3.099494831636548, + 0.5600855201482773, + 0.914456445723772, + 0.5701671950519085, + 0.13072335720062256, + 0.0, + 0.1497586015611887, + 0.4838039241731167, + 2.4051999524235725, + 0.672576516866684, + 1.854442484676838, + 0.5192086659371853, + 1.3535062558948994, + 1.546210154891014, + 0.1331464946269989, + 0.1376742608845234, + 1.8420629184693098, + 0.3245379962027073, + 1.262658428400755, + 0.2729523815214634, + 0.6985818985849619, + 2.468854308128357, + 0.6433210074901581, + 1.5642555989325047, + 0.40309763699769974, + 0.0, + 1.4692290164530277, + 0.8531853444874287, + 1.2096203155815601, + 0.6022088993340731, + 0.26734907180070877, + 1.3238748796284199, + 0.41265360452234745, + 3.4678005650639534, + 0.6501494012773037, + 1.0419858023524284 + ], + "unique_experts": 62, + "load_cv": 0.6885808365232933, + "normalized_load_entropy": 0.9444285339532309, + "max_load_share": 0.054707379134860054 + } + }, + "s1_x": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "24e33b29371f87561b04653053f1242db4d50456d9bf41de16549d0b2a5e62fe", + "route_weight_sha256": "80b63d036597617ec568107909ac92013ba466d28802b85a7b3842700ca6abff", + "loads": [ + 5, + 3, + 2, + 19, + 12, + 5, + 7, + 15, + 22, + 5, + 14, + 5, + 6, + 8, + 13, + 8, + 6, + 1, + 7, + 5, + 18, + 18, + 8, + 4, + 6, + 20, + 6, + 14, + 37, + 7, + 18, + 9, + 0, + 0, + 2, + 0, + 23, + 1, + 22, + 5, + 21, + 12, + 2, + 2, + 24, + 6, + 0, + 5, + 8, + 22, + 4, + 18, + 5, + 0, + 17, + 1, + 2, + 8, + 8, + 5, + 6, + 44, + 16, + 14 + ], + "weighted_loads": [ + 0.239910539239645, + 0.09875248372554779, + 0.12712648883461952, + 1.4102871380746365, + 0.5478042121976614, + 0.3331333100795746, + 0.37400222942233086, + 1.0854660794138908, + 2.315674651414156, + 0.3747635968029499, + 1.355189710855484, + 0.3140994422137737, + 0.6914905235171318, + 0.7608713656663895, + 0.7588175125420094, + 0.41195862367749214, + 0.4592213910073042, + 0.05848543345928192, + 0.6002428084611893, + 0.25980966351926327, + 1.0964466445147991, + 1.2553435359150171, + 0.3262804076075554, + 0.1689992155879736, + 0.23491634242236614, + 1.183912556618452, + 0.2147678453475237, + 0.9837189577519894, + 2.950501035898924, + 0.3735812194645405, + 0.9842658340930939, + 0.5671512633562088, + 0.0, + 0.0, + 0.12086629122495651, + 0.0, + 2.313042588531971, + 0.04836905002593994, + 1.8509886711835861, + 0.2041739858686924, + 1.394147850573063, + 0.9098378103226423, + 0.07929732650518417, + 0.14156504720449448, + 1.813614521175623, + 0.19677443616092205, + 0.0, + 0.25975168868899345, + 0.5406373329460621, + 2.344934705644846, + 0.23076217994093895, + 1.3172472678124905, + 0.32867755368351936, + 0.0, + 1.4994170926511288, + 0.03595660254359245, + 0.08726364374160767, + 0.6048146691173315, + 0.291162446141243, + 0.2374180555343628, + 0.33378713950514793, + 3.483270427212119, + 0.6827002353966236, + 1.0090324319899082 + ], + "unique_experts": 59, + "load_cv": 0.886926257803086, + "normalized_load_entropy": 0.9109210694054742, + "max_load_share": 0.06918238993710692 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "224a4ab15d84249cd39a98ecc9d67d95c1ab8a3635abbeec4a6890b6db829aa1", + "route_weight_sha256": "4efbac872f764bf12078052450a35be86e3d83a0c57e1d5c012162ff3bc552ed", + "loads": [ + 5, + 4, + 5, + 20, + 14, + 5, + 25, + 16, + 27, + 11, + 14, + 14, + 10, + 9, + 22, + 11, + 15, + 1, + 9, + 18, + 20, + 23, + 9, + 5, + 7, + 21, + 6, + 15, + 38, + 10, + 18, + 12, + 6, + 1, + 6, + 7, + 24, + 15, + 22, + 14, + 21, + 20, + 4, + 2, + 25, + 9, + 15, + 6, + 11, + 22, + 12, + 25, + 6, + 3, + 17, + 13, + 18, + 8, + 8, + 18, + 11, + 44, + 16, + 14 + ], + "weighted_loads": [ + 0.239910539239645, + 0.1336197443306446, + 0.2684380002319813, + 1.4476627856492996, + 0.6989376228302717, + 0.3331333100795746, + 2.153501333668828, + 1.1471358984708786, + 2.657751578837633, + 1.082330133765936, + 1.355189710855484, + 0.9451335668563843, + 1.0219555608928204, + 0.783972030505538, + 1.4424421228468418, + 0.645831510424614, + 1.2331269662827253, + 0.05848543345928192, + 0.7483596839010715, + 1.119794713333249, + 1.1891933232545853, + 1.5574574954807758, + 0.8724956437945366, + 0.20436201803386211, + 0.26765145920217037, + 1.2192989252507687, + 0.2147678453475237, + 1.0104936677962542, + 2.9872827529907227, + 0.5595755912363529, + 0.9842658340930939, + 0.7642550058662891, + 0.19772161915898323, + 0.03359972685575485, + 0.38025806471705437, + 0.6723995693027973, + 2.3473890013992786, + 1.137393843382597, + 1.8509886711835861, + 0.6820841059088707, + 1.394147850573063, + 1.5379876289516687, + 0.13724790140986443, + 0.14156504720449448, + 1.8983689658343792, + 0.29189440608024597, + 1.52777118422091, + 0.2788565829396248, + 0.7168595343828201, + 2.344934705644846, + 0.862171083688736, + 1.5852747540920973, + 0.36567748337984085, + 0.1675299070775509, + 1.4994170926511288, + 1.1188517026603222, + 1.799528330564499, + 0.6048146691173315, + 0.291162446141243, + 1.40888393484056, + 0.5949587933719158, + 3.483270427212119, + 0.6827002353966236, + 1.0090324319899082 + ], + "unique_experts": 64, + "load_cv": 0.6059430440306658, + "normalized_load_entropy": 0.9565255630071497, + "max_load_share": 0.049886621315192746 + } + }, + "s0_period": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "85943ea706d19a38ba78530efe03940b317e6d4872024078733310682cc75ae3", + "route_weight_sha256": "cd97cf8351545163300372731978bd20421cf1c1c6b2aff9246843577e421968", + "loads": [ + 7, + 2, + 2, + 19, + 11, + 6, + 6, + 15, + 22, + 5, + 14, + 5, + 6, + 7, + 14, + 8, + 5, + 1, + 7, + 5, + 18, + 18, + 8, + 4, + 5, + 20, + 5, + 16, + 38, + 7, + 18, + 8, + 0, + 0, + 2, + 0, + 24, + 1, + 24, + 5, + 20, + 12, + 2, + 2, + 25, + 5, + 0, + 5, + 7, + 24, + 4, + 16, + 6, + 0, + 17, + 1, + 2, + 8, + 7, + 6, + 8, + 41, + 16, + 14 + ], + "weighted_loads": [ + 0.30272514559328556, + 0.06669413298368454, + 0.12755151838064194, + 1.3634857311844826, + 0.5035997498780489, + 0.3730974681675434, + 0.3146800026297569, + 1.1003600023686886, + 2.336196668446064, + 0.3798207975924015, + 1.4096051380038261, + 0.3186621181666851, + 0.6961358264088631, + 0.7301564365625381, + 0.8044990971684456, + 0.3963982071727514, + 0.4154408611357212, + 0.058750372380018234, + 0.5967121757566929, + 0.27751249447464943, + 1.0632935613393784, + 1.2858605794608593, + 0.32863036170601845, + 0.16414988413453102, + 0.18767470493912697, + 1.2298730071634054, + 0.19484632089734077, + 1.0665833689272404, + 3.04012780636549, + 0.3450038284063339, + 0.9435570035129786, + 0.5193688869476318, + 0.0, + 0.0, + 0.11494994163513184, + 0.0, + 2.394999247044325, + 0.04671395942568779, + 1.873147727921605, + 0.20631799660623074, + 1.3814546447247267, + 0.9183937236666679, + 0.07668398320674896, + 0.1347511261701584, + 1.8499352168291807, + 0.16406967863440514, + 0.0, + 0.25637715123593807, + 0.4912978932261467, + 2.4604264441877604, + 0.23151317983865738, + 1.2139948420226574, + 0.36444197595119476, + 0.0, + 1.4469758160412312, + 0.0342213474214077, + 0.10495217144489288, + 0.5968738589435816, + 0.2660204041749239, + 0.2782492358237505, + 0.4174165241420269, + 3.375587133690715, + 0.6747235078364611, + 1.038936287164688 + ], + "unique_experts": 59, + "load_cv": 0.888352256827189, + "normalized_load_entropy": 0.9098036706058912, + "max_load_share": 0.06446540880503145 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "5b664214c30af201bd3b814d1a9372f5e5b173793c5e4db2b43cb43119cbfbf4", + "route_weight_sha256": "8f3b6ae56fcd68f87072296a13c3406dab670a0f55141bed045eb1ceb278ce65", + "loads": [ + 7, + 3, + 2, + 19, + 12, + 6, + 17, + 15, + 22, + 5, + 14, + 10, + 7, + 8, + 16, + 10, + 10, + 1, + 7, + 16, + 19, + 22, + 9, + 5, + 5, + 21, + 5, + 16, + 39, + 10, + 18, + 8, + 4, + 0, + 3, + 5, + 24, + 9, + 24, + 13, + 20, + 19, + 4, + 2, + 25, + 9, + 12, + 6, + 11, + 24, + 9, + 24, + 6, + 0, + 17, + 12, + 11, + 8, + 7, + 15, + 8, + 41, + 16, + 14 + ], + "weighted_loads": [ + 0.30272514559328556, + 0.10160450637340546, + 0.12755151838064194, + 1.3634857311844826, + 0.532379012554884, + 0.3730974681675434, + 1.4785578474402428, + 1.1003600023686886, + 2.336196668446064, + 0.3798207975924015, + 1.4096051380038261, + 0.6814443022012711, + 0.7495071664452553, + 0.7532571014016867, + 0.9433604143559933, + 0.4825885687023401, + 0.7887792624533176, + 0.058750372380018234, + 0.5967121757566929, + 1.0050611682236195, + 1.1072310954332352, + 1.5271924007683992, + 0.8748455978929996, + 0.19983001053333282, + 0.18767470493912697, + 1.2576058693230152, + 0.19484632089734077, + 1.0665833689272404, + 3.146093226969242, + 0.5123604908585548, + 0.9435570035129786, + 0.5193688869476318, + 0.13393693044781685, + 0.0, + 0.14957649633288383, + 0.48296083137393, + 2.394999247044325, + 0.7554023750126362, + 1.873147727921605, + 0.5210458245128393, + 1.3814546447247267, + 1.4421099573373795, + 0.13457830995321274, + 0.1347511261701584, + 1.8499352168291807, + 0.2943920809775591, + 1.2738210894167423, + 0.2754820454865694, + 0.6969832237809896, + 2.4604264441877604, + 0.6889587342739105, + 1.5558941438794136, + 0.36444197595119476, + 0.0, + 1.4469758160412312, + 0.9446259215474129, + 1.2139290757477283, + 0.5968738589435816, + 0.2660204041749239, + 1.247176242992282, + 0.4174165241420269, + 3.375587133690715, + 0.6747235078364611, + 1.038936287164688 + ], + "unique_experts": 62, + "load_cv": 0.6788840312571357, + "normalized_load_entropy": 0.9453306246042388, + "max_load_share": 0.05216284987277354 + } + }, + "s1_period": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "aa524bfcc26e037e504013e63544012a825f89450e3cc829de570c4810561c97", + "route_weight_sha256": "c812554e4ddc69ac49883563702a70de690771145579e7ca7d7b0389d1b858e9", + "loads": [ + 5, + 3, + 2, + 19, + 11, + 6, + 7, + 16, + 22, + 5, + 14, + 5, + 6, + 8, + 14, + 8, + 6, + 1, + 7, + 5, + 18, + 18, + 6, + 4, + 6, + 20, + 7, + 14, + 37, + 7, + 17, + 9, + 0, + 0, + 2, + 0, + 23, + 1, + 22, + 6, + 22, + 12, + 2, + 2, + 24, + 6, + 0, + 5, + 8, + 22, + 4, + 18, + 5, + 0, + 17, + 1, + 2, + 8, + 7, + 5, + 6, + 43, + 16, + 14 + ], + "weighted_loads": [ + 0.23820943385362625, + 0.09897627495229244, + 0.12576942890882492, + 1.4055111072957516, + 0.5054514054208994, + 0.3596405293792486, + 0.3747374378144741, + 1.1157933324575424, + 2.3116016015410423, + 0.3819558322429657, + 1.362218752503395, + 0.3196041025221348, + 0.6838085353374481, + 0.7458944618701935, + 0.8145438618957996, + 0.40601409040391445, + 0.4584790822118521, + 0.058571431785821915, + 0.594478577375412, + 0.25693429447710514, + 1.0867888368666172, + 1.2689693477004766, + 0.23587678000330925, + 0.16417676769196987, + 0.2363250069320202, + 1.1875278241932392, + 0.25123184733092785, + 0.9512695372104645, + 2.960835302248597, + 0.3698877952992916, + 0.9422826617956161, + 0.5631829090416431, + 0.0, + 0.0, + 0.12033859640359879, + 0.0, + 2.2925099954009056, + 0.04963851720094681, + 1.839654602110386, + 0.2556150145828724, + 1.4412308242172003, + 0.911027304828167, + 0.07744092866778374, + 0.13830778375267982, + 1.8163679651916027, + 0.19445181638002396, + 0.0, + 0.25965485721826553, + 0.536868579685688, + 2.3404974080622196, + 0.23334261402487755, + 1.305390102788806, + 0.32494350522756577, + 0.0, + 1.4912683740258217, + 0.03659285977482796, + 0.09313440695405006, + 0.6016644388437271, + 0.25383743084967136, + 0.2390713095664978, + 0.33272386714816093, + 3.4465615451335907, + 0.6783625297248363, + 1.0051136836409569 + ], + "unique_experts": 59, + "load_cv": 0.8822758435631801, + "normalized_load_entropy": 0.9114077647296626, + "max_load_share": 0.06761006289308176 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "06514455868e900d480921b412932c7d41d6fc98884f8f7550717e33989ba02d", + "route_weight_sha256": "0242ac8f9bdfb7f199b2f7d3aea59dfcfbdf8add48eb644c3ae16c9a4974ce6b", + "loads": [ + 5, + 4, + 5, + 20, + 13, + 6, + 25, + 17, + 27, + 11, + 14, + 14, + 11, + 9, + 23, + 11, + 15, + 1, + 9, + 17, + 20, + 23, + 7, + 5, + 7, + 21, + 7, + 15, + 39, + 10, + 17, + 12, + 6, + 1, + 6, + 7, + 24, + 17, + 22, + 15, + 22, + 18, + 4, + 2, + 25, + 9, + 16, + 6, + 11, + 22, + 11, + 25, + 6, + 3, + 17, + 13, + 18, + 8, + 7, + 17, + 11, + 43, + 16, + 14 + ], + "weighted_loads": [ + 0.23820943385362625, + 0.13384353555738926, + 0.2670809403061867, + 1.4428867548704147, + 0.6565848160535097, + 0.3596405293792486, + 2.008109299466014, + 1.1774631515145302, + 2.6536785289645195, + 1.0895223692059517, + 1.362218752503395, + 0.9475617483258247, + 1.0787434466183186, + 0.768995126709342, + 1.4984492249786854, + 0.6219664569944143, + 1.224676227197051, + 0.058571431785821915, + 0.7425954528152943, + 1.172743147239089, + 1.1795355156064034, + 1.576554998755455, + 0.7820920161902905, + 0.1995395701378584, + 0.2690601237118244, + 1.2229141928255558, + 0.25123184733092785, + 0.9780442472547293, + 3.1219567339867353, + 0.5565129816532135, + 0.9422826617956161, + 0.7602866515517235, + 0.1984143666923046, + 0.03359972685575485, + 0.37973036989569664, + 0.6840631030499935, + 2.3268564082682133, + 1.3195445910096169, + 1.839654602110386, + 0.7335251346230507, + 1.4412308242172003, + 1.405359573662281, + 0.135391503572464, + 0.13830778375267982, + 1.901122409850359, + 0.2895717862993479, + 1.5771638806909323, + 0.27875975146889687, + 0.6818229295313358, + 2.3404974080622196, + 0.7960816770792007, + 1.5776850413531065, + 0.36194343492388725, + 0.1675299070775509, + 1.4912683740258217, + 1.1816222928464413, + 1.796544460579753, + 0.6016644388437271, + 0.25383743084967136, + 1.3391951899975538, + 0.5938955210149288, + 3.4465615451335907, + 0.6783625297248363, + 1.0051136836409569 + ], + "unique_experts": 64, + "load_cv": 0.606078801068069, + "normalized_load_entropy": 0.9565092846555124, + "max_load_share": 0.048752834467120185 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 106, + "ordered_topk_exact_tokens": 86, + "set_exact_tokens": 95, + "mean_set_jaccard": 0.9703504043126685, + "mean_token_weighted_tv": 0.007546725691700319, + "aggregate_load_tv": 0.015723270440251576 + }, + "system_bos": { + "tokens": 106, + "ordered_topk_exact_tokens": 66, + "set_exact_tokens": 78, + "mean_set_jaccard": 0.9245283018867925, + "mean_token_weighted_tv": 0.016045382518743007, + "aggregate_load_tv": 0.03144654088050314 + }, + "system_x": { + "tokens": 106, + "ordered_topk_exact_tokens": 65, + "set_exact_tokens": 78, + "mean_set_jaccard": 0.9245283018867926, + "mean_token_weighted_tv": 0.01765654616514748, + "aggregate_load_tv": 0.033018867924528295 + }, + "system_period": { + "tokens": 106, + "ordered_topk_exact_tokens": 63, + "set_exact_tokens": 78, + "mean_set_jaccard": 0.9245283018867926, + "mean_token_weighted_tv": 0.01748794012369131, + "aggregate_load_tv": 0.02830188679245283 + }, + "bos_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 61, + "set_exact_tokens": 78, + "mean_set_jaccard": 0.9245283018867925, + "mean_token_weighted_tv": 0.01830910802555253, + "aggregate_load_tv": 0.034591194968553465 + }, + "bos_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 63, + "set_exact_tokens": 76, + "mean_set_jaccard": 0.9171159029649596, + "mean_token_weighted_tv": 0.01995797978081512, + "aggregate_load_tv": 0.033018867924528295 + }, + "x_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 66, + "set_exact_tokens": 83, + "mean_set_jaccard": 0.9359838274932615, + "mean_token_weighted_tv": 0.016686421186434774, + "aggregate_load_tv": 0.029874213836477984 + }, + "x_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 60, + "set_exact_tokens": 76, + "mean_set_jaccard": 0.9191374663072776, + "mean_token_weighted_tv": 0.021323781126653247, + "aggregate_load_tv": 0.0330188679245283 + }, + "period_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 63, + "set_exact_tokens": 77, + "mean_set_jaccard": 0.9198113207547169, + "mean_token_weighted_tv": 0.0186883063354301, + "aggregate_load_tv": 0.036163522012578615 + }, + "period_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 61, + "set_exact_tokens": 75, + "mean_set_jaccard": 0.9164420485175202, + "mean_token_weighted_tv": 0.02154396405830136, + "aggregate_load_tv": 0.03144654088050314 + } + } + }, + "layer_07": { + "layer": 7, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "69705102ba639f29c3fe7eff9ac867572af8ef9eafda90a37cd9fe25b52509fc", + "route_weight_sha256": "1a8645162aebb98308ce026d1e9cf99ec8ddc31901e1c86c6f5177953d1a0acd", + "loads": [ + 23, + 9, + 69, + 2, + 6, + 15, + 4, + 22, + 1, + 12, + 4, + 6, + 4, + 4, + 36, + 8, + 2, + 9, + 9, + 4, + 2, + 7, + 19, + 15, + 14, + 4, + 3, + 8, + 3, + 4, + 8, + 15, + 1, + 10, + 8, + 15, + 15, + 1, + 4, + 11, + 2, + 0, + 6, + 3, + 2, + 11, + 10, + 1, + 20, + 12, + 0, + 18, + 25, + 28, + 2, + 0, + 0, + 9, + 9, + 15, + 22, + 12, + 5, + 8 + ], + "weighted_loads": [ + 1.8535610847175121, + 0.34453812055289745, + 6.036229087039828, + 0.07380510121583939, + 0.546269740909338, + 0.7957295253872871, + 0.19588299468159676, + 1.594452627003193, + 0.06145324930548668, + 0.7146905325353146, + 0.22441130504012108, + 0.3900969922542572, + 0.18871379643678665, + 0.167274110019207, + 3.126688841730356, + 0.40468533523380756, + 0.09455788135528564, + 0.4805769957602024, + 1.0554575324058533, + 0.1899428442120552, + 0.08473372459411621, + 0.5825379155576229, + 1.3805391155183315, + 1.1376485731452703, + 0.7389171086251736, + 0.17915331944823265, + 0.1494566984474659, + 0.44258179888129234, + 0.1663036346435547, + 0.26853470876812935, + 0.5727222822606564, + 0.6724364403635263, + 0.05815122649073601, + 0.5516311768442392, + 0.5572447739541531, + 0.7438970357179642, + 1.2010863274335861, + 0.08553936332464218, + 0.28742048144340515, + 0.6294325664639473, + 0.10076576098799706, + 0.0, + 0.5361979976296425, + 0.13321038708090782, + 0.07078081928193569, + 0.6042075157165527, + 0.9979924038052559, + 0.021614713594317436, + 1.458985272794962, + 0.8286561891436577, + 0.0, + 1.0969735570251942, + 2.540048733353615, + 1.786967147141695, + 0.14864696562290192, + 0.0, + 0.0, + 0.5958241950720549, + 0.7381397038698196, + 0.9492623377591372, + 1.8996583856642246, + 0.6407947223633528, + 0.23879636265337467, + 0.614953875541687 + ], + "unique_experts": 60, + "load_cv": 1.070125370326139, + "normalized_load_entropy": 0.8949138917663118, + "max_load_share": 0.10849056603773585 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "b4605dbc232dafaeebe0ade071ed38b7b2d1da13a02f9eef9e117f6face03671", + "route_weight_sha256": "045fa43498b6c19fe97c3a3ca76db887403037ecab2892a1449878bf5af2d74b", + "loads": [ + 23, + 9, + 69, + 5, + 6, + 16, + 9, + 22, + 8, + 12, + 5, + 10, + 4, + 9, + 36, + 8, + 17, + 11, + 12, + 5, + 2, + 7, + 22, + 18, + 18, + 4, + 7, + 8, + 6, + 4, + 8, + 15, + 4, + 12, + 8, + 15, + 15, + 1, + 13, + 14, + 2, + 10, + 11, + 6, + 6, + 11, + 12, + 2, + 20, + 12, + 15, + 18, + 25, + 29, + 2, + 7, + 0, + 10, + 13, + 15, + 22, + 18, + 8, + 15 + ], + "weighted_loads": [ + 1.8535610847175121, + 0.34453812055289745, + 6.036229087039828, + 0.18368643522262573, + 0.546269740909338, + 0.8375449702143669, + 0.6885252557694912, + 1.594452627003193, + 0.6601374857127666, + 0.7146905325353146, + 0.25710612162947655, + 0.9453179873526096, + 0.18871379643678665, + 0.4531626719981432, + 3.126688841730356, + 0.40468533523380756, + 2.102487776428461, + 0.5958682261407375, + 1.1651893462985754, + 0.2483627162873745, + 0.08473372459411621, + 0.5825379155576229, + 1.5543268322944641, + 1.3361663352698088, + 0.869565146509558, + 0.17915331944823265, + 0.48189787194132805, + 0.44258179888129234, + 0.229388321749866, + 0.26853470876812935, + 0.5727222822606564, + 0.6724364403635263, + 0.17174774780869484, + 0.6875372212380171, + 0.5572447739541531, + 0.7438970357179642, + 1.2010863274335861, + 0.08553936332464218, + 1.1209963411092758, + 0.7590654902160168, + 0.10076576098799706, + 0.9969595968723297, + 0.9065600745379925, + 0.20168525073677301, + 1.5892629865556955, + 0.6042075157165527, + 1.145627398043871, + 0.10963986627757549, + 1.458985272794962, + 0.8286561891436577, + 1.0417979061603546, + 1.0969735570251942, + 2.540048733353615, + 1.81903026252985, + 0.14864696562290192, + 0.6539452150464058, + 0.0, + 0.6296481359750032, + 0.8236444406211376, + 0.9492623377591372, + 1.8996583856642246, + 0.939094765111804, + 0.28750704508274794, + 0.8863599710166454 + ], + "unique_experts": 63, + "load_cv": 0.816341935789904, + "normalized_load_entropy": 0.9375490627963158, + "max_load_share": 0.08778625954198473 + } + }, + "s1_eos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "f1d0e6e2366714050dd248aa85f994fe03cd3d4a4d9885a0b89713a7d0c75ab6", + "route_weight_sha256": "5e7f42cca09a6602ce763213311ed54cf7f2f1f2b293b423015e10fc7997408e", + "loads": [ + 23, + 9, + 69, + 1, + 6, + 15, + 4, + 21, + 1, + 10, + 4, + 6, + 5, + 3, + 36, + 8, + 2, + 8, + 10, + 4, + 2, + 7, + 19, + 15, + 13, + 4, + 3, + 9, + 3, + 4, + 8, + 15, + 1, + 10, + 8, + 16, + 15, + 1, + 4, + 11, + 3, + 0, + 6, + 4, + 3, + 11, + 10, + 1, + 20, + 12, + 0, + 18, + 26, + 28, + 2, + 0, + 0, + 9, + 9, + 15, + 23, + 11, + 5, + 7 + ], + "weighted_loads": [ + 1.8415513448417187, + 0.3452346455305815, + 6.095405897125602, + 0.04414232447743416, + 0.5581786893308163, + 0.7863078378140926, + 0.19986241683363914, + 1.5407087355852127, + 0.06086632236838341, + 0.6358005777001381, + 0.2241358645260334, + 0.3923102244734764, + 0.21618407033383846, + 0.13466686755418777, + 3.0967074185609818, + 0.4084115270525217, + 0.0971701629459858, + 0.44973092526197433, + 1.067088820040226, + 0.20265531539916992, + 0.08086640760302544, + 0.5783841218799353, + 1.3802014999091625, + 1.1549638956785202, + 0.6979616358876228, + 0.17408905550837517, + 0.15314537286758423, + 0.48172420263290405, + 0.15580488368868828, + 0.2662040889263153, + 0.5605514645576477, + 0.6529271230101585, + 0.05659748241305351, + 0.5502814650535583, + 0.5512428693473339, + 0.7772557027637959, + 1.175959300249815, + 0.08561824262142181, + 0.2734049819409847, + 0.6281776092946529, + 0.13581345230340958, + 0.0, + 0.5379394516348839, + 0.18899184465408325, + 0.10512358509004116, + 0.6048111915588379, + 0.9956212267279625, + 0.021626895293593407, + 1.4544330090284348, + 0.8267226703464985, + 0.0, + 1.090758666396141, + 2.558629998937249, + 1.7807000987231731, + 0.1457621529698372, + 0.0, + 0.0, + 0.6078377738595009, + 0.7403612527996302, + 0.958632942289114, + 1.9153308346867561, + 0.6012226641178131, + 0.25278889387845993, + 0.5818304680287838 + ], + "unique_experts": 60, + "load_cv": 1.0708643817538308, + "normalized_load_entropy": 0.8951563444200169, + "max_load_share": 0.10849056603773585 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "adff17b2ea4da47bf6c7417a9fb5f3e81090db1efbc43c4306aff2ae46fa1856", + "route_weight_sha256": "f0fe9224011afe05ba8204dc6433c36044449b713be3f911261142b5485f341e", + "loads": [ + 23, + 9, + 69, + 3, + 7, + 16, + 11, + 21, + 16, + 12, + 10, + 11, + 5, + 9, + 38, + 10, + 18, + 11, + 13, + 5, + 2, + 7, + 21, + 19, + 18, + 4, + 11, + 10, + 6, + 10, + 8, + 15, + 7, + 19, + 8, + 16, + 15, + 5, + 20, + 14, + 5, + 15, + 16, + 8, + 13, + 11, + 13, + 6, + 20, + 12, + 22, + 18, + 26, + 28, + 6, + 9, + 0, + 16, + 12, + 15, + 23, + 17, + 9, + 10 + ], + "weighted_loads": [ + 1.8415513448417187, + 0.3452346455305815, + 6.095405897125602, + 0.10772784613072872, + 0.6048130691051483, + 0.8305982202291489, + 0.6896567698568106, + 1.5407087355852127, + 1.380922868847847, + 0.7372541576623917, + 0.7435794398188591, + 1.0246792696416378, + 0.21618407033383846, + 0.47031109780073166, + 3.166428327560425, + 0.5049166809767485, + 2.533697735518217, + 0.6153412871062756, + 1.180051477625966, + 0.26138922199606895, + 0.08086640760302544, + 0.5783841218799353, + 1.4973689019680023, + 1.395471215248108, + 0.852908234577626, + 0.17408905550837517, + 0.8387588039040565, + 0.5122217908501625, + 0.21933672577142715, + 1.0443060621619225, + 0.5605514645576477, + 0.6529271230101585, + 0.44206877052783966, + 1.1670513786375523, + 0.5512428693473339, + 0.7772557027637959, + 1.175959300249815, + 0.3128590490669012, + 1.9508241042494774, + 0.7750993520021439, + 0.3591918423771858, + 1.4613973647356033, + 1.3489707186818123, + 0.29766363371163607, + 2.176892975345254, + 0.6048111915588379, + 1.189511053264141, + 0.3096187859773636, + 1.4544330090284348, + 0.8267226703464985, + 1.4978695698082447, + 1.090758666396141, + 2.558629998937249, + 1.7807000987231731, + 0.35253021866083145, + 0.7644002232700586, + 0.0, + 1.183084174990654, + 0.7975771240890026, + 0.958632942289114, + 1.9153308346867561, + 0.8927764855325222, + 0.33715100260451436, + 0.6702603977173567 + ], + "unique_experts": 63, + "load_cv": 0.704741329951204, + "normalized_load_entropy": 0.9528419104226822, + "max_load_share": 0.0782312925170068 + } + }, + "s0_bos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "c41180c144be250d03c7ecc81ebcda27ca11b60adaf77222c0a109d281469d10", + "route_weight_sha256": "b96c997f8f9af7eb5eeddc5a5cadb4883e1c48f84312f55f22972706f39be839", + "loads": [ + 23, + 6, + 70, + 2, + 6, + 13, + 4, + 19, + 1, + 10, + 3, + 6, + 4, + 5, + 35, + 8, + 2, + 8, + 9, + 4, + 1, + 6, + 20, + 17, + 16, + 4, + 3, + 10, + 3, + 4, + 8, + 16, + 1, + 11, + 8, + 14, + 14, + 1, + 4, + 11, + 4, + 0, + 6, + 3, + 2, + 12, + 10, + 0, + 21, + 14, + 0, + 20, + 27, + 27, + 2, + 0, + 0, + 9, + 9, + 14, + 23, + 12, + 4, + 7 + ], + "weighted_loads": [ + 1.8619745671749115, + 0.24826333671808243, + 5.96587773039937, + 0.0760069228708744, + 0.5581399388611317, + 0.7272623144090176, + 0.1834522895514965, + 1.4356455411762, + 0.05756793171167374, + 0.64671840518713, + 0.18596478924155235, + 0.40347377955913544, + 0.19397682324051857, + 0.1912964414805174, + 3.0860485881567, + 0.4062536992132664, + 0.10819794610142708, + 0.46217360347509384, + 1.0758689567446709, + 0.20419033244252205, + 0.05043207108974457, + 0.5648586712777615, + 1.421404603868723, + 1.2043714839965105, + 0.8110477421432734, + 0.17494825087487698, + 0.15813228115439415, + 0.5461666621267796, + 0.16324786096811295, + 0.28314267098903656, + 0.5817007794976234, + 0.7643351852893829, + 0.06050090864300728, + 0.5986899267882109, + 0.5787682645022869, + 0.6849260423332453, + 1.1748452074825764, + 0.08767262101173401, + 0.27756309136748314, + 0.6499394439160824, + 0.16326696425676346, + 0.0, + 0.5450789481401443, + 0.13140935450792313, + 0.07905678078532219, + 0.628846313804388, + 0.9985133670270443, + 0.0, + 1.5143131464719772, + 0.9049622379243374, + 0.0, + 1.1601063441485167, + 2.6117489598691463, + 1.78451744094491, + 0.14344386383891106, + 0.0, + 0.0, + 0.5697718728333712, + 0.715205866843462, + 0.8940177317708731, + 1.9260884448885918, + 0.6468261927366257, + 0.2033943422138691, + 0.5870806984603405 + ], + "unique_experts": 59, + "load_cv": 1.085247416775937, + "normalized_load_entropy": 0.8914355952601066, + "max_load_share": 0.11006289308176101 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "0607c0c9ea4f57d880344f84cb32751c18be538ecd8e950345b8fae302c62b63", + "route_weight_sha256": "ef21bdd210c070cfac45e21ad934c1b88a35ea4a29f5ef6864a27cf66086683e", + "loads": [ + 23, + 6, + 70, + 5, + 6, + 14, + 10, + 19, + 8, + 10, + 5, + 10, + 4, + 10, + 35, + 8, + 17, + 10, + 13, + 5, + 1, + 6, + 23, + 20, + 19, + 4, + 8, + 10, + 5, + 4, + 8, + 16, + 4, + 13, + 8, + 14, + 14, + 1, + 13, + 14, + 4, + 10, + 11, + 5, + 6, + 12, + 13, + 1, + 21, + 14, + 15, + 20, + 27, + 29, + 2, + 7, + 0, + 9, + 12, + 14, + 23, + 18, + 6, + 14 + ], + "weighted_loads": [ + 1.8619745671749115, + 0.24826333671808243, + 5.96587773039937, + 0.18588825687766075, + 0.5581399388611317, + 0.7690777592360973, + 0.7658824287354946, + 1.4356455411762, + 0.6617978289723396, + 0.64671840518713, + 0.2518605925142765, + 0.9847525358200073, + 0.19397682324051857, + 0.4771850034594536, + 3.0860485881567, + 0.4062536992132664, + 2.1247946992516518, + 0.5708738416433334, + 1.2294567245990038, + 0.2683994509279728, + 0.05043207108974457, + 0.5648586712777615, + 1.5951923206448555, + 1.4070303980261087, + 0.9346609599888325, + 0.17494825087487698, + 0.5578024461865425, + 0.5461666621267796, + 0.21327878162264824, + 0.28314267098903656, + 0.5817007794976234, + 0.7643351852893829, + 0.1740974299609661, + 0.7406139466911554, + 0.5787682645022869, + 0.6849260423332453, + 1.1748452074825764, + 0.08767262101173401, + 1.159431491047144, + 0.7818540558218956, + 0.16326696425676346, + 0.9998104870319366, + 0.9066954962909222, + 0.1865635309368372, + 0.7716692797839642, + 0.628846313804388, + 1.1916042268276215, + 0.08802515268325806, + 1.5143131464719772, + 0.9049622379243374, + 1.150116205215454, + 1.1601063441485167, + 2.6117489598691463, + 1.8610742278397083, + 0.14344386383891106, + 0.6539452150464058, + 0.0, + 0.5697718728333712, + 0.7857176382094622, + 0.8940177317708731, + 1.9260884448885918, + 0.9451262354850769, + 0.2465080711990595, + 0.8584867939352989 + ], + "unique_experts": 63, + "load_cv": 0.8321777820423744, + "normalized_load_entropy": 0.9347862256434114, + "max_load_share": 0.089058524173028 + } + }, + "s1_bos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "1d6a118568f3748211f823821c0b7d1612dc5e8a62c84636593935c12c792b94", + "route_weight_sha256": "623d61768fa30a5f783087811724b300acc47ed374603700642f29b58fef3e7a", + "loads": [ + 23, + 8, + 68, + 2, + 6, + 15, + 4, + 19, + 1, + 11, + 4, + 5, + 5, + 5, + 34, + 7, + 2, + 8, + 12, + 5, + 1, + 6, + 21, + 16, + 14, + 3, + 3, + 10, + 3, + 4, + 8, + 16, + 1, + 12, + 9, + 12, + 14, + 1, + 4, + 11, + 4, + 0, + 6, + 4, + 2, + 11, + 10, + 0, + 20, + 13, + 0, + 19, + 26, + 28, + 2, + 0, + 0, + 9, + 9, + 14, + 23, + 11, + 5, + 7 + ], + "weighted_loads": [ + 1.7895488888025284, + 0.3255842290818691, + 5.983256973326206, + 0.07552690804004669, + 0.5609011501073837, + 0.7970979958772659, + 0.18024292960762978, + 1.3810252342373133, + 0.05995389074087143, + 0.6661945953965187, + 0.2163400910794735, + 0.36432817950844765, + 0.21403715759515762, + 0.19287201762199402, + 3.0372440479695797, + 0.3741477392613888, + 0.11255451664328575, + 0.46463559195399284, + 1.1659460812807083, + 0.25575292855501175, + 0.05055280402302742, + 0.5504246838390827, + 1.4525966085493565, + 1.1801078151911497, + 0.7190081514418125, + 0.14287094585597515, + 0.16115958988666534, + 0.5389208272099495, + 0.15489942580461502, + 0.2754562012851238, + 0.5685765147209167, + 0.7308155335485935, + 0.05861108750104904, + 0.6146404463797808, + 0.6024666856974363, + 0.6176511980593204, + 1.1423924639821053, + 0.08430013805627823, + 0.24945258721709251, + 0.6499218754470348, + 0.1600197497755289, + 0.0, + 0.5369988493621349, + 0.18697378784418106, + 0.08518093824386597, + 0.5846633687615395, + 0.9932047016918659, + 0.0, + 1.4534605219960213, + 0.8702204637229443, + 0.0, + 1.1152100786566734, + 2.5341711416840553, + 1.859811406582594, + 0.14520611613988876, + 0.0, + 0.0, + 0.5798339396715164, + 0.6835699789226055, + 0.917634379118681, + 1.8895033039152622, + 0.6046075187623501, + 0.24579443037509918, + 0.5946155972778797 + ], + "unique_experts": 59, + "load_cv": 1.0568845089762042, + "normalized_load_entropy": 0.8954426983802198, + "max_load_share": 0.1069182389937107 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "7b87c1d66626ff385ff8a2e4c78bc2c4318fc9c8f30833ad1791178be4a28828", + "route_weight_sha256": "0361872dd08cb0a10d3416793b6c257c1bd547e6c5ad0f9f4dddc1d8a56ef4dc", + "loads": [ + 23, + 8, + 68, + 4, + 7, + 16, + 12, + 19, + 16, + 13, + 11, + 10, + 5, + 11, + 36, + 9, + 18, + 11, + 16, + 6, + 1, + 6, + 23, + 21, + 18, + 3, + 12, + 11, + 5, + 10, + 8, + 16, + 7, + 21, + 9, + 12, + 14, + 5, + 20, + 14, + 6, + 15, + 16, + 7, + 12, + 11, + 14, + 5, + 20, + 13, + 22, + 19, + 26, + 28, + 6, + 9, + 0, + 15, + 11, + 14, + 23, + 17, + 8, + 10 + ], + "weighted_loads": [ + 1.7895488888025284, + 0.3255842290818691, + 5.983256973326206, + 0.13911242969334126, + 0.6075355298817158, + 0.8413883782923222, + 0.7952000256627798, + 1.3810252342373133, + 1.3711705170571804, + 0.7676481753587723, + 0.7715610153973103, + 1.0157099105417728, + 0.21403715759515762, + 0.5285162478685379, + 3.1069649569690228, + 0.47065289318561554, + 2.56328072398901, + 0.6255880109965801, + 1.3110732454806566, + 0.31936629116535187, + 0.05055280402302742, + 0.5504246838390827, + 1.5697640106081963, + 1.469827713444829, + 0.8667612969875336, + 0.14287094585597515, + 0.922326248139143, + 0.569418415427208, + 0.20468818582594395, + 1.053558174520731, + 0.5685765147209167, + 0.7308155335485935, + 0.4440823756158352, + 1.2356338109821081, + 0.6024666856974363, + 0.6176511980593204, + 1.1423924639821053, + 0.3115409445017576, + 1.9719775691628456, + 0.7991687059402466, + 0.38339813984930515, + 1.465204730629921, + 1.3383067958056927, + 0.28033182583749294, + 1.321716956794262, + 0.5846633687615395, + 1.2342898659408092, + 0.2879918906837702, + 1.4534605219960213, + 0.8702204637229443, + 1.6504744701087475, + 1.1152100786566734, + 2.5341711416840553, + 1.859811406582594, + 0.351974181830883, + 0.7644002232700586, + 0.0, + 1.1207942552864552, + 0.7252382002770901, + 0.917634379118681, + 1.8895033039152622, + 0.8961613401770592, + 0.3246026672422886, + 0.6830455269664526 + ], + "unique_experts": 63, + "load_cv": 0.6992331076818002, + "normalized_load_entropy": 0.9523977922024746, + "max_load_share": 0.07709750566893424 + } + }, + "s0_x": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "972b07054bcd28f6744f7c37896f0b5c296bbcb45b00c116e1e510c4fecbd812", + "route_weight_sha256": "fcfb8e3a127c80e9ee01c95be46d2544c15856ddc68c0233ef7060ac9bbd5cc4", + "loads": [ + 22, + 9, + 68, + 2, + 6, + 14, + 4, + 19, + 1, + 11, + 5, + 6, + 4, + 5, + 35, + 8, + 2, + 9, + 10, + 4, + 1, + 6, + 20, + 17, + 14, + 4, + 3, + 10, + 3, + 4, + 8, + 15, + 1, + 12, + 8, + 12, + 14, + 1, + 4, + 11, + 4, + 0, + 6, + 3, + 2, + 11, + 10, + 0, + 21, + 14, + 0, + 19, + 26, + 27, + 2, + 0, + 0, + 9, + 10, + 14, + 23, + 12, + 4, + 7 + ], + "weighted_loads": [ + 1.7768488228321075, + 0.38032957166433334, + 5.834028532728553, + 0.07694720104336739, + 0.5598767399787903, + 0.7788715735077858, + 0.18272179923951626, + 1.4125048350542784, + 0.05888567119836807, + 0.6775475554168224, + 0.25804267078638077, + 0.39612841233611107, + 0.18745066225528717, + 0.2003850731998682, + 3.0598903223872185, + 0.4032962694764137, + 0.09762286767363548, + 0.49895709939301014, + 1.1127084903419018, + 0.2064320668578148, + 0.05162215605378151, + 0.558555718511343, + 1.4376599378883839, + 1.1798922140151262, + 0.7465228736400604, + 0.17698239535093307, + 0.17171142250299454, + 0.5419864989817142, + 0.16628271713852882, + 0.28282975405454636, + 0.5684707425534725, + 0.691660201177001, + 0.05867660045623779, + 0.6147749181836843, + 0.5820373855531216, + 0.6059262193739414, + 1.154054183512926, + 0.08420141041278839, + 0.278326652944088, + 0.6536685228347778, + 0.16345564275979996, + 0.0, + 0.5470438897609711, + 0.1391815021634102, + 0.08112650364637375, + 0.5906155202537775, + 0.9758618846535683, + 0.0, + 1.5152769479900599, + 0.9143236093223095, + 0.0, + 1.1610862240195274, + 2.5697115138173103, + 1.8421494700014591, + 0.142607219517231, + 0.0, + 0.0, + 0.5768117923289537, + 0.7544512804597616, + 0.8837959356606007, + 1.91501796990633, + 0.6451838035136461, + 0.20591751486063004, + 0.5917097888886929 + ], + "unique_experts": 59, + "load_cv": 1.0562855166095884, + "normalized_load_entropy": 0.8954966718198276, + "max_load_share": 0.1069182389937107 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "6594b1c7008636ddecbe44078209062c866d77eb2f7725a7a0e720410cb67a93", + "route_weight_sha256": "6102e3bf3d5fb145818c8d519d039db8f1accef2a019be93ba29951e39544f16", + "loads": [ + 22, + 9, + 68, + 5, + 6, + 16, + 8, + 19, + 8, + 11, + 7, + 10, + 4, + 11, + 35, + 8, + 18, + 11, + 13, + 5, + 1, + 6, + 23, + 20, + 17, + 4, + 7, + 10, + 5, + 4, + 8, + 15, + 4, + 14, + 8, + 12, + 14, + 1, + 13, + 14, + 4, + 10, + 11, + 5, + 5, + 11, + 14, + 2, + 21, + 14, + 14, + 19, + 26, + 28, + 2, + 7, + 0, + 9, + 13, + 14, + 23, + 19, + 6, + 15 + ], + "weighted_loads": [ + 1.7768488228321075, + 0.38032957166433334, + 5.834028532728553, + 0.18682853505015373, + 0.5598767399787903, + 0.8769848421216011, + 0.5492690559476614, + 1.4125048350542784, + 0.6464264504611492, + 0.6775475554168224, + 0.32528920471668243, + 0.9776929654181004, + 0.18745066225528717, + 0.5199653878808022, + 3.0598903223872185, + 0.4032962694764137, + 2.385462399572134, + 0.6195899527519941, + 1.2214287091046572, + 0.26827748492360115, + 0.05162215605378151, + 0.558555718511343, + 1.6114476546645164, + 1.3692938517779112, + 0.8701360914856195, + 0.17698239535093307, + 0.5178738832473755, + 0.5419864989817142, + 0.21631363779306412, + 0.28282975405454636, + 0.5684707425534725, + 0.691660201177001, + 0.17227312177419662, + 0.7533496636897326, + 0.5820373855531216, + 0.6059262193739414, + 1.154054183512926, + 0.08420141041278839, + 1.0829642452299595, + 0.7851873114705086, + 0.16345564275979996, + 0.9327073097229004, + 0.9171018153429031, + 0.19297870807349682, + 0.7210266627371311, + 0.5906155202537775, + 1.1867020726203918, + 0.13538067042827606, + 1.5152769479900599, + 0.9143236093223095, + 0.9752984791994095, + 1.1610862240195274, + 2.5697115138173103, + 1.874212585389614, + 0.142607219517231, + 0.6539452150464058, + 0.0, + 0.5768117923289537, + 0.8249630518257618, + 0.8837959356606007, + 1.91501796990633, + 0.9961181525141001, + 0.24903124384582043, + 0.9425262361764908 + ], + "unique_experts": 63, + "load_cv": 0.8092043133006809, + "normalized_load_entropy": 0.93766621790449, + "max_load_share": 0.08651399491094147 + } + }, + "s1_x": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "81c966e6468398a6632ef9c398e8f2e081004fc694eba6801e818adca2934759", + "route_weight_sha256": "d0e87ca23c93f3f267a26ae2dd4b3bc1c11a53c3e14db87cb1a99e56bf066220", + "loads": [ + 22, + 9, + 68, + 2, + 6, + 12, + 4, + 20, + 1, + 9, + 5, + 6, + 5, + 5, + 34, + 8, + 2, + 7, + 12, + 7, + 1, + 6, + 21, + 17, + 15, + 2, + 3, + 10, + 3, + 4, + 8, + 16, + 1, + 12, + 8, + 12, + 14, + 1, + 3, + 12, + 4, + 0, + 6, + 3, + 2, + 11, + 10, + 0, + 21, + 13, + 0, + 18, + 26, + 28, + 2, + 0, + 1, + 9, + 8, + 14, + 24, + 11, + 4, + 8 + ], + "weighted_loads": [ + 1.708357084542513, + 0.3683096319437027, + 5.857192298397422, + 0.07641399465501308, + 0.5635576173663139, + 0.6853886805474758, + 0.17946746572852135, + 1.3995538465678692, + 0.06161676347255707, + 0.5945418141782284, + 0.25342445634305477, + 0.38603684678673744, + 0.2118634730577469, + 0.19340921752154827, + 2.993538249284029, + 0.411678534001112, + 0.11033818125724792, + 0.4207727052271366, + 1.1838523801416159, + 0.37935442104935646, + 0.051218315958976746, + 0.5335565991699696, + 1.4648597724735737, + 1.2265810817480087, + 0.7791318763047457, + 0.11210086196660995, + 0.17683984711766243, + 0.5367169566452503, + 0.14333274215459824, + 0.27342626079916954, + 0.559321653097868, + 0.7206006553024054, + 0.05773588642477989, + 0.6121371686458588, + 0.5736759677529335, + 0.603333804756403, + 1.1203067265450954, + 0.0816173329949379, + 0.20916328206658363, + 0.6794424522668123, + 0.1595296896994114, + 0.0, + 0.545548640191555, + 0.14387677796185017, + 0.08378195017576218, + 0.5780424419790506, + 1.0019021928310394, + 0.0, + 1.4807180669158697, + 0.8693932555615902, + 0.0, + 1.081220854073763, + 2.5267846547067165, + 1.88712053373456, + 0.14973577111959457, + 0.0, + 0.02593553252518177, + 0.5808229800313711, + 0.6427759975194931, + 0.9058125056326389, + 1.9023002088069916, + 0.6109474301338196, + 0.21023180335760117, + 0.6449862383306026 + ], + "unique_experts": 60, + "load_cv": 1.0586794526474634, + "normalized_load_entropy": 0.8956786256864259, + "max_load_share": 0.1069182389937107 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "5e0eb3beced450f782216bf9cc93ca21ede6636b593681660d8b29ea2b7e48c1", + "route_weight_sha256": "6058b9a31bf57c1f7d404fae795a378d5743e362fedbb7fdcaa439864f14fa7f", + "loads": [ + 22, + 9, + 68, + 4, + 7, + 14, + 10, + 20, + 15, + 11, + 12, + 11, + 5, + 12, + 36, + 10, + 19, + 10, + 15, + 9, + 1, + 6, + 23, + 22, + 20, + 2, + 11, + 11, + 5, + 10, + 8, + 16, + 7, + 21, + 8, + 12, + 14, + 5, + 18, + 15, + 6, + 14, + 16, + 5, + 11, + 11, + 15, + 7, + 21, + 13, + 21, + 18, + 26, + 28, + 6, + 9, + 1, + 15, + 10, + 14, + 24, + 18, + 7, + 12 + ], + "weighted_loads": [ + 1.708357084542513, + 0.3683096319437027, + 5.857192298397422, + 0.13999951630830765, + 0.610191997140646, + 0.7835272140800953, + 0.5640462394803762, + 1.3995538465678692, + 1.295819740742445, + 0.695995394140482, + 0.8122697342187166, + 1.060198176652193, + 0.2118634730577469, + 0.5599411483854055, + 3.063259158283472, + 0.5081836879253387, + 2.8218186534941196, + 0.5884512029588223, + 1.2857432998716831, + 0.5119857229292393, + 0.051218315958976746, + 0.5335565991699696, + 1.5820271745324135, + 1.4851702153682709, + 0.9603140782564878, + 0.11210086196660995, + 0.8845993019640446, + 0.5672145448625088, + 0.19312150217592716, + 1.0515282340347767, + 0.559321653097868, + 0.7206006553024054, + 0.44320717453956604, + 1.2277749367058277, + 0.5736759677529335, + 0.603333804756403, + 1.1203067265450954, + 0.3088581394404173, + 1.8501913622021675, + 0.8277476709336042, + 0.38290807977318764, + 1.3354255706071854, + 1.3602000027894974, + 0.2023118995130062, + 1.2821133881807327, + 0.5780424419790506, + 1.2687103599309921, + 0.39517257548868656, + 1.4807180669158697, + 0.8693932555615902, + 1.4204263724386692, + 1.081220854073763, + 2.5267846547067165, + 1.88712053373456, + 0.35650383681058884, + 0.7644002232700586, + 0.02593553252518177, + 1.1217832956463099, + 0.6844442188739777, + 0.9058125056326389, + 1.9023002088069916, + 0.9557834565639496, + 0.2890400402247906, + 0.8016993459314108 + ], + "unique_experts": 64, + "load_cv": 0.6992331076818002, + "normalized_load_entropy": 0.9530228271970802, + "max_load_share": 0.07709750566893424 + } + }, + "s0_period": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "fd45aabbb862a1b7f335a71b3d303cc70144b25b6cab20aaa0d83302ba1886f1", + "route_weight_sha256": "dc6a95e5edf9899b9f179c63cc813bd0dce4f46fd12a61a341decb9baf49fd9c", + "loads": [ + 22, + 8, + 70, + 1, + 6, + 15, + 4, + 19, + 1, + 11, + 4, + 6, + 4, + 5, + 35, + 8, + 2, + 8, + 10, + 5, + 1, + 6, + 20, + 16, + 15, + 4, + 3, + 10, + 3, + 4, + 8, + 16, + 1, + 12, + 8, + 12, + 14, + 1, + 4, + 11, + 4, + 0, + 6, + 3, + 2, + 10, + 10, + 0, + 21, + 12, + 0, + 19, + 26, + 28, + 2, + 0, + 0, + 9, + 10, + 14, + 24, + 12, + 4, + 7 + ], + "weighted_loads": [ + 1.7905123196542263, + 0.340446624904871, + 5.930720705538988, + 0.045453641563653946, + 0.5563168339431286, + 0.8121967948973179, + 0.18344319984316826, + 1.403639066964388, + 0.05936422944068909, + 0.6721320487558842, + 0.22462816536426544, + 0.3962372951209545, + 0.18532037734985352, + 0.1994406245648861, + 3.05033653229475, + 0.41060421243309975, + 0.10026068240404129, + 0.4470667075365782, + 1.0978534780442715, + 0.256236732006073, + 0.051430538296699524, + 0.5589864104986191, + 1.4257308430969715, + 1.157564327120781, + 0.7847792711108923, + 0.17759175598621368, + 0.17172113060951233, + 0.5465131737291813, + 0.16029992327094078, + 0.281329158693552, + 0.5669604018330574, + 0.7345983758568764, + 0.05965924263000488, + 0.6108325459063053, + 0.5919837728142738, + 0.5989618301391602, + 1.1541315838694572, + 0.08484997600317001, + 0.29997117444872856, + 0.658673383295536, + 0.16600513085722923, + 0.0, + 0.5508138686418533, + 0.1332701314240694, + 0.08420974388718605, + 0.563277468085289, + 0.9688550978899002, + 0.0, + 1.519308103248477, + 0.8372089229524136, + 0.0, + 1.151475315913558, + 2.566066689789295, + 1.8776845484972, + 0.1465068832039833, + 0.0, + 0.0, + 0.5763880535960197, + 0.751925740391016, + 0.876006780192256, + 1.9454063139855862, + 0.6371666174381971, + 0.19331521168351173, + 0.5886358991265297 + ], + "unique_experts": 59, + "load_cv": 1.0802790785459124, + "normalized_load_entropy": 0.8924417700113033, + "max_load_share": 0.11006289308176101 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "af751bd3c95069a39179e2bf55f86d2427f20f22a63045e2091aac5ba296aee5", + "route_weight_sha256": "13118c3debbb2428dceb9ea9eba23e99d81fc4ca7449296fdf57f8f09b691f3a", + "loads": [ + 22, + 8, + 70, + 4, + 6, + 16, + 9, + 19, + 9, + 11, + 6, + 10, + 4, + 10, + 35, + 8, + 18, + 10, + 13, + 6, + 1, + 6, + 24, + 19, + 18, + 4, + 7, + 10, + 5, + 4, + 8, + 16, + 4, + 14, + 8, + 12, + 14, + 1, + 14, + 14, + 4, + 11, + 11, + 5, + 5, + 10, + 12, + 1, + 21, + 12, + 16, + 19, + 26, + 29, + 2, + 7, + 0, + 9, + 13, + 14, + 24, + 18, + 6, + 14 + ], + "weighted_loads": [ + 1.7905123196542263, + 0.340446624904871, + 5.930720705538988, + 0.1553349755704403, + 0.5563168339431286, + 0.8540122397243977, + 0.5914602354168892, + 1.403639066964388, + 0.732557151466608, + 0.6721320487558842, + 0.291724257171154, + 0.9775158725678921, + 0.18532037734985352, + 0.4853291865438223, + 3.05033653229475, + 0.41060421243309975, + 2.3740090280771255, + 0.5611522179096937, + 1.2122392375022173, + 0.3148863650858402, + 0.051430538296699524, + 0.5589864104986191, + 1.6435879059135914, + 1.3439563810825348, + 0.9083924889564514, + 0.17759175598621368, + 0.5127136632800102, + 0.5465131737291813, + 0.21033084392547607, + 0.281329158693552, + 0.5669604018330574, + 0.7345983758568764, + 0.17325576394796371, + 0.75092863291502, + 0.5919837728142738, + 0.5989618301391602, + 1.1541315838694572, + 0.08484997600317001, + 1.2058744616806507, + 0.7923589423298836, + 0.16600513085722923, + 0.9873584434390068, + 0.9254636205732822, + 0.18902995809912682, + 0.7251722067594528, + 0.563277468085289, + 1.09839341416955, + 0.08802515268325806, + 1.519308103248477, + 0.8372089229524136, + 1.3111928924918175, + 1.151475315913558, + 2.566066689789295, + 1.909747663885355, + 0.1465068832039833, + 0.6539452150464058, + 0.0, + 0.5763880535960197, + 0.8224375117570162, + 0.876006780192256, + 1.9454063139855862, + 0.9354666601866484, + 0.23642894066870213, + 0.8600419946014881 + ], + "unique_experts": 63, + "load_cv": 0.8301836247434485, + "normalized_load_entropy": 0.9351223371280649, + "max_load_share": 0.089058524173028 + } + }, + "s1_period": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "6b1678470d6d34ef0e3e04aa9958d6beaa25d946f095bcbf088465a74d0aca42", + "route_weight_sha256": "512b4d5269ae519c3d7453aeb645dffbb1be9d009d77adc29299aabc7293b710", + "loads": [ + 24, + 9, + 68, + 2, + 6, + 13, + 4, + 20, + 1, + 10, + 4, + 5, + 5, + 6, + 34, + 7, + 2, + 7, + 12, + 6, + 1, + 6, + 21, + 17, + 14, + 3, + 3, + 10, + 3, + 4, + 8, + 15, + 1, + 12, + 8, + 12, + 14, + 1, + 4, + 11, + 4, + 0, + 6, + 4, + 3, + 10, + 10, + 0, + 20, + 13, + 0, + 18, + 26, + 28, + 2, + 0, + 1, + 9, + 8, + 14, + 25, + 11, + 4, + 7 + ], + "weighted_loads": [ + 1.7847013212740421, + 0.36532895639538765, + 5.853841416537762, + 0.07517501898109913, + 0.5728714019060135, + 0.7252181433141232, + 0.17953677102923393, + 1.408754514530301, + 0.06329400092363358, + 0.6165996268391609, + 0.22117770463228226, + 0.35530076920986176, + 0.2129391748458147, + 0.2265748493373394, + 2.9846731945872307, + 0.38456201553344727, + 0.11269818991422653, + 0.41491574421525, + 1.1494168043136597, + 0.3196989893913269, + 0.05318916589021683, + 0.5367596969008446, + 1.4556836113333702, + 1.218538785353303, + 0.7318209391087294, + 0.14122558198869228, + 0.17360727116465569, + 0.5320780910551548, + 0.14205772057175636, + 0.27287959679961205, + 0.5596716292202473, + 0.6818368081003428, + 0.058588992804288864, + 0.6144969183951616, + 0.5718877501785755, + 0.606475692242384, + 1.1289863660931587, + 0.0807611346244812, + 0.25984038412570953, + 0.6531003750860691, + 0.1607459858059883, + 0.0, + 0.5443473011255264, + 0.18344678170979023, + 0.10816318728029728, + 0.5448772553354502, + 0.9964498244225979, + 0.0, + 1.4606591165065765, + 0.8583591654896736, + 0.0, + 1.0855104550719261, + 2.542104721069336, + 1.8836251869797707, + 0.15054181963205338, + 0.0, + 0.025874922052025795, + 0.5801256615668535, + 0.6462947688996792, + 0.9031334444880486, + 1.9517211243510246, + 0.6029652468860149, + 0.20636211708188057, + 0.5971646793186665 + ], + "unique_experts": 60, + "load_cv": 1.0595757842315778, + "normalized_load_entropy": 0.8964597456418415, + "max_load_share": 0.1069182389937107 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "7485ccce4b3a267217e736f94542a3b283e60959928919cc8a84f1e8136625d5", + "route_weight_sha256": "a65fdac08c6634ab2614dd14202af5a78ec86d67d8b28cd9609f43f4dea2be29", + "loads": [ + 24, + 9, + 68, + 4, + 7, + 14, + 10, + 20, + 17, + 12, + 11, + 10, + 5, + 12, + 36, + 9, + 19, + 10, + 15, + 7, + 1, + 6, + 24, + 21, + 18, + 3, + 11, + 11, + 5, + 10, + 8, + 15, + 8, + 21, + 8, + 12, + 14, + 5, + 21, + 14, + 6, + 15, + 16, + 6, + 12, + 10, + 13, + 6, + 20, + 13, + 24, + 18, + 26, + 28, + 6, + 9, + 1, + 15, + 10, + 14, + 25, + 17, + 7, + 10 + ], + "weighted_loads": [ + 1.7847013212740421, + 0.36532895639538765, + 5.853841416537762, + 0.1387605406343937, + 0.6195057816803455, + 0.7695085257291794, + 0.529119336977601, + 1.408754514530301, + 1.430156171321869, + 0.7180532068014145, + 0.7807127237319946, + 0.979429267346859, + 0.2129391748458147, + 0.5622190795838833, + 3.0543941035866737, + 0.481067169457674, + 2.7681163549423218, + 0.5760272108018398, + 1.2566495258361101, + 0.3924837112426758, + 0.05318916589021683, + 0.5367596969008446, + 1.6056106090545654, + 1.442762104794383, + 0.8795740846544504, + 0.14122558198869228, + 0.8768895380198956, + 0.5625756792724133, + 0.1918464805930853, + 1.0509815700352192, + 0.5596716292202473, + 0.6818368081003428, + 0.4772999994456768, + 1.2254161071032286, + 0.5718877501785755, + 0.606475692242384, + 1.1289863660931587, + 0.3080019410699606, + 2.0087139159440994, + 0.8026456646621227, + 0.38412437587976456, + 1.4197279661893845, + 1.3547478057444096, + 0.24188190326094627, + 1.307699779048562, + 0.5448772553354502, + 1.1783681474626064, + 0.3285695929080248, + 1.4606591165065765, + 0.8583591654896736, + 1.9068893603980541, + 1.0855104550719261, + 2.542104721069336, + 1.8836251869797707, + 0.35730988532304764, + 0.7644002232700586, + 0.025874922052025795, + 1.1210859771817923, + 0.6879629902541637, + 0.9031334444880486, + 1.9517211243510246, + 0.894519068300724, + 0.28517035394907, + 0.6855946090072393 + ], + "unique_experts": 64, + "load_cv": 0.7066066728107835, + "normalized_load_entropy": 0.9522432044433802, + "max_load_share": 0.07709750566893424 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 106, + "ordered_topk_exact_tokens": 88, + "set_exact_tokens": 96, + "mean_set_jaccard": 0.973045822102426, + "mean_token_weighted_tv": 0.007795143072967822, + "aggregate_load_tv": 0.014150943396226412 + }, + "system_bos": { + "tokens": 106, + "ordered_topk_exact_tokens": 72, + "set_exact_tokens": 82, + "mean_set_jaccard": 0.9353099730458222, + "mean_token_weighted_tv": 0.01607490237802267, + "aggregate_load_tv": 0.026729559748427674 + }, + "system_x": { + "tokens": 106, + "ordered_topk_exact_tokens": 64, + "set_exact_tokens": 83, + "mean_set_jaccard": 0.9380053908355797, + "mean_token_weighted_tv": 0.017885839021852555, + "aggregate_load_tv": 0.023584905660377357 + }, + "system_period": { + "tokens": 106, + "ordered_topk_exact_tokens": 68, + "set_exact_tokens": 82, + "mean_set_jaccard": 0.9353099730458222, + "mean_token_weighted_tv": 0.01754378494015842, + "aggregate_load_tv": 0.026729559748427674 + }, + "bos_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 69, + "set_exact_tokens": 81, + "mean_set_jaccard": 0.9326145552560647, + "mean_token_weighted_tv": 0.016996600208276848, + "aggregate_load_tv": 0.034591194968553465 + }, + "bos_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 70, + "set_exact_tokens": 82, + "mean_set_jaccard": 0.9353099730458221, + "mean_token_weighted_tv": 0.018472753790259925, + "aggregate_load_tv": 0.029874213836477988 + }, + "x_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 65, + "set_exact_tokens": 79, + "mean_set_jaccard": 0.9272237196765499, + "mean_token_weighted_tv": 0.01832830959509285, + "aggregate_load_tv": 0.029874213836477988 + }, + "x_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 62, + "set_exact_tokens": 78, + "mean_set_jaccard": 0.9225067385444743, + "mean_token_weighted_tv": 0.02276462114433635, + "aggregate_load_tv": 0.04088050314465409 + }, + "period_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 70, + "set_exact_tokens": 82, + "mean_set_jaccard": 0.933288409703504, + "mean_token_weighted_tv": 0.017607210880532017, + "aggregate_load_tv": 0.031446540880503145 + }, + "period_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 62, + "set_exact_tokens": 79, + "mean_set_jaccard": 0.92722371967655, + "mean_token_weighted_tv": 0.021609649958335003, + "aggregate_load_tv": 0.034591194968553465 + } + } + }, + "layer_08": { + "layer": 8, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "9c84679980e2e25a36a8d4f555eb6f701dc477e73b1fa33ab1497dbd00dea254", + "route_weight_sha256": "4676afc6afafe157191f35f63015541d189f11a1ebdd2e71fed2745fe928d556", + "loads": [ + 4, + 50, + 2, + 6, + 1, + 15, + 3, + 35, + 0, + 12, + 6, + 4, + 2, + 6, + 2, + 11, + 7, + 9, + 1, + 5, + 5, + 10, + 36, + 0, + 35, + 1, + 0, + 0, + 13, + 27, + 9, + 16, + 8, + 4, + 18, + 0, + 20, + 45, + 3, + 9, + 9, + 16, + 3, + 30, + 20, + 5, + 2, + 18, + 0, + 0, + 0, + 18, + 11, + 3, + 6, + 3, + 6, + 2, + 8, + 12, + 7, + 7, + 8, + 2 + ], + "weighted_loads": [ + 0.16116192936897278, + 2.951208457350731, + 0.08219493180513382, + 0.5300752967596054, + 0.03382440283894539, + 0.7340435516089201, + 0.18918294087052345, + 2.6418707743287086, + 0.0, + 0.5744224116206169, + 0.49735406041145325, + 0.24024677649140358, + 0.09121742844581604, + 0.3526274301111698, + 0.13077382743358612, + 0.6529566571116447, + 0.4018009305000305, + 0.7481247521936893, + 0.05595732852816582, + 0.27125899866223335, + 0.5434230081737041, + 0.55565569922328, + 2.355171889066696, + 0.0, + 2.5889946296811104, + 0.052604034543037415, + 0.0, + 0.0, + 0.9014212787151337, + 2.0371909998357296, + 0.8049781322479248, + 1.499951422214508, + 0.562448300421238, + 0.17837046831846237, + 1.0800558011978865, + 0.0, + 1.404964977875352, + 2.611601810902357, + 0.11114750616252422, + 0.779865775257349, + 0.445380374789238, + 0.8719411082565784, + 0.18908200412988663, + 1.9637525789439678, + 1.3657228164374828, + 0.3481248989701271, + 0.10365879908204079, + 0.8499507755041122, + 0.0, + 0.0, + 0.0, + 1.2162021324038506, + 0.8591854013502598, + 0.24004815518856049, + 0.3888612240552902, + 0.14281689375638962, + 0.3505629412829876, + 0.11945414543151855, + 0.40482764318585396, + 0.9033133946359158, + 0.4490074925124645, + 0.293211679905653, + 0.5582263991236687, + 0.08524098247289658 + ], + "unique_experts": 56, + "load_cv": 1.1198324703627462, + "normalized_load_entropy": 0.8720019800791666, + "max_load_share": 0.07861635220125786 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "c7f576ae505b1ccba2b32506496d7c4c2498708358d882c13120390f7b579643", + "route_weight_sha256": "bd0b548d8139dbd127b6d8a4b0d3ab1515453d83e7bbed82ad73dc6374efc6c4", + "loads": [ + 4, + 56, + 4, + 7, + 4, + 15, + 8, + 36, + 8, + 12, + 7, + 6, + 9, + 13, + 2, + 11, + 7, + 12, + 1, + 5, + 5, + 10, + 38, + 0, + 35, + 12, + 0, + 0, + 13, + 27, + 12, + 16, + 12, + 19, + 18, + 0, + 20, + 45, + 3, + 16, + 16, + 16, + 3, + 30, + 20, + 11, + 8, + 22, + 0, + 3, + 3, + 18, + 23, + 3, + 10, + 11, + 6, + 2, + 12, + 12, + 7, + 7, + 10, + 5 + ], + "weighted_loads": [ + 0.16116192936897278, + 3.3214488830417395, + 0.12131887953728437, + 0.5764947421848774, + 0.1499489697162062, + 0.7340435516089201, + 0.6806586422026157, + 2.6875676587224007, + 0.5623978152871132, + 0.5744224116206169, + 0.5582963936030865, + 0.3051420906558633, + 0.4723633639514446, + 0.8507262021303177, + 0.13077382743358612, + 0.6529566571116447, + 0.4018009305000305, + 0.8882923051714897, + 0.05595732852816582, + 0.27125899866223335, + 0.5434230081737041, + 0.55565569922328, + 2.429469220340252, + 0.0, + 2.5889946296811104, + 0.8238506875932217, + 0.0, + 0.0, + 0.9014212787151337, + 2.0371909998357296, + 0.8734045070596039, + 1.499951422214508, + 0.7315427996218204, + 1.4007792975753546, + 1.0800558011978865, + 0.0, + 1.404964977875352, + 2.611601810902357, + 0.11114750616252422, + 0.9882167628966272, + 0.8495104797184467, + 0.8719411082565784, + 0.18908200412988663, + 1.9637525789439678, + 1.3657228164374828, + 0.9551267214119434, + 0.768534030765295, + 0.9717418635264039, + 0.0, + 0.16474704071879387, + 0.169997688382864, + 1.2162021324038506, + 1.7300790883600712, + 0.24004815518856049, + 1.966016935184598, + 0.6341387592256069, + 0.3505629412829876, + 0.11945414543151855, + 0.5196736725047231, + 0.9033133946359158, + 0.4490074925124645, + 0.293211679905653, + 0.6418886967003345, + 0.29288384318351746 + ], + "unique_experts": 59, + "load_cv": 0.9074484895410615, + "normalized_load_entropy": 0.9115815854250848, + "max_load_share": 0.07124681933842239 + } + }, + "s1_eos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "fb6965aaa14c39e8b0bd764589395999239f71c2f6ad2cac836d225c281decff", + "route_weight_sha256": "56a807f1015cd150db740f209f7bea34f47048a4bec71ef1305724ad8313f4a3", + "loads": [ + 4, + 51, + 2, + 6, + 1, + 14, + 2, + 36, + 0, + 12, + 6, + 4, + 2, + 6, + 2, + 11, + 8, + 9, + 2, + 5, + 5, + 10, + 36, + 0, + 35, + 1, + 0, + 0, + 15, + 26, + 9, + 15, + 8, + 5, + 18, + 1, + 19, + 45, + 2, + 9, + 9, + 17, + 3, + 30, + 20, + 5, + 2, + 16, + 0, + 0, + 0, + 18, + 10, + 3, + 6, + 3, + 6, + 2, + 9, + 11, + 7, + 8, + 7, + 2 + ], + "weighted_loads": [ + 0.16302623599767685, + 2.951507482677698, + 0.08149874582886696, + 0.5330043733119965, + 0.036338429898023605, + 0.69082185998559, + 0.1457185447216034, + 2.7036046124994755, + 0.0, + 0.5681494735181332, + 0.4977595768868923, + 0.24929000064730644, + 0.09021115303039551, + 0.360026016831398, + 0.13109704852104187, + 0.658121544867754, + 0.4405181184411049, + 0.7275431863963604, + 0.08490271307528019, + 0.27223772555589676, + 0.5450703017413616, + 0.5476699993014336, + 2.33272173628211, + 0.0, + 2.6080708913505077, + 0.050223805010318756, + 0.0, + 0.0, + 0.9773262292146683, + 1.9790684096515179, + 0.793513361364603, + 1.4504347145557404, + 0.5575473718345165, + 0.21630102768540382, + 1.06457787938416, + 0.03269033879041672, + 1.345103757455945, + 2.6224481016397476, + 0.07168932259082794, + 0.7689554132521152, + 0.4342466089874506, + 0.9065162502229214, + 0.18976649641990662, + 1.936833743005991, + 1.3507619686424732, + 0.35053105279803276, + 0.10319700092077255, + 0.786332605406642, + 0.0, + 0.0, + 0.0, + 1.200441762804985, + 0.8327322863042355, + 0.23686624318361282, + 0.3954465053975582, + 0.1431654505431652, + 0.34855200722813606, + 0.11834311112761497, + 0.4524037539958954, + 0.8548173680901527, + 0.4418761618435383, + 0.332826629281044, + 0.5194189473986626, + 0.08791439980268478 + ], + "unique_experts": 57, + "load_cv": 1.1220908396994775, + "normalized_load_entropy": 0.8732595599709654, + "max_load_share": 0.08018867924528301 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "c679d7a91f44b7fe9e450a768886ece080c32c5c6678c03fe520cf3b44898abd", + "route_weight_sha256": "5b715fb3dca687ab1865c6cbc97fab0fca25b15a61982d19998cad49a15ee139", + "loads": [ + 5, + 56, + 12, + 8, + 2, + 15, + 13, + 37, + 13, + 12, + 9, + 8, + 11, + 13, + 2, + 11, + 8, + 23, + 3, + 5, + 5, + 10, + 37, + 4, + 35, + 12, + 0, + 2, + 16, + 26, + 12, + 15, + 11, + 27, + 18, + 1, + 19, + 45, + 8, + 15, + 22, + 17, + 5, + 30, + 20, + 17, + 16, + 20, + 3, + 5, + 5, + 18, + 19, + 9, + 10, + 13, + 6, + 2, + 12, + 13, + 7, + 12, + 10, + 7 + ], + "weighted_loads": [ + 0.20254267752170563, + 3.2311204709112644, + 0.7046112669631839, + 0.638735368847847, + 0.09502143412828445, + 0.7353409565985203, + 1.140802577137947, + 2.738542925566435, + 0.8569414466619492, + 0.5681494735181332, + 0.6516677401959896, + 0.368848429992795, + 0.6270033940672874, + 0.8313263542950153, + 0.13109704852104187, + 0.658121544867754, + 0.4405181184411049, + 1.6945586241781712, + 0.13174488209187984, + 0.27223772555589676, + 0.5450703017413616, + 0.5476699993014336, + 2.3719392083585262, + 0.18764951638877392, + 2.6080708913505077, + 1.1630446873605251, + 0.0, + 0.11914309486746788, + 1.018996823579073, + 1.9790684096515179, + 0.8623194140382111, + 1.4504347145557404, + 0.666721798479557, + 1.7513069715350866, + 1.06457787938416, + 0.03269033879041672, + 1.345103757455945, + 2.6224481016397476, + 0.46553878113627434, + 0.9319288227707148, + 1.0619254503399134, + 0.9065162502229214, + 0.3579035922884941, + 1.936833743005991, + 1.3507619686424732, + 1.522357176989317, + 1.1421527825295925, + 0.9007126493379474, + 0.32165708392858505, + 0.33190638944506645, + 0.2548299878835678, + 1.200441762804985, + 1.5158974677324295, + 0.920733168721199, + 1.9791135229170322, + 0.8363406173884869, + 0.34855200722813606, + 0.11834311112761497, + 0.5545457161497325, + 0.9279432222247124, + 0.4418761618435383, + 0.5213823020458221, + 0.6612185277044773, + 0.37812773138284683 + ], + "unique_experts": 63, + "load_cv": 0.7774537711910131, + "normalized_load_entropy": 0.9353789149505723, + "max_load_share": 0.06349206349206349 + } + }, + "s0_bos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "aeda5fe3046742584878753572deb424df0b1702c137b2a3325b9398bcabb7a9", + "route_weight_sha256": "79ce20b8552121e8d6c5b65fb59c13b4589ae745f3c9b5689898eca3b666deda", + "loads": [ + 5, + 55, + 2, + 6, + 1, + 12, + 3, + 35, + 0, + 13, + 6, + 4, + 2, + 6, + 2, + 12, + 5, + 10, + 1, + 5, + 5, + 10, + 34, + 0, + 35, + 1, + 0, + 0, + 13, + 26, + 9, + 16, + 8, + 4, + 20, + 1, + 17, + 45, + 2, + 9, + 8, + 18, + 3, + 31, + 23, + 5, + 2, + 16, + 0, + 0, + 0, + 18, + 10, + 3, + 7, + 3, + 6, + 2, + 8, + 11, + 7, + 6, + 7, + 2 + ], + "weighted_loads": [ + 0.20250430330634117, + 3.1492164488881826, + 0.08365790918469429, + 0.5362477451562881, + 0.03220513463020325, + 0.6205242350697517, + 0.18466096371412277, + 2.6638961620628834, + 0.0, + 0.6206011436879635, + 0.5041605904698372, + 0.23263004049658775, + 0.0941491462290287, + 0.3712225407361984, + 0.12590930610895157, + 0.6793200485408306, + 0.3237052857875824, + 0.7792039811611176, + 0.05694418400526047, + 0.2713753990828991, + 0.5604281015694141, + 0.5542288087308407, + 2.2789941988885403, + 0.0, + 2.65229388512671, + 0.06223701685667038, + 0.0, + 0.0, + 0.9354188814759254, + 1.9633272551000118, + 0.8101800084114075, + 1.5230272226035595, + 0.5577358603477478, + 0.18900243192911148, + 1.1596324630081654, + 0.03289817273616791, + 1.3305867854505777, + 2.5988093074411154, + 0.06946566328406334, + 0.7754526399075985, + 0.3812983687967062, + 0.9582989104092121, + 0.19466665014624596, + 2.0149940960109234, + 1.5070830136537552, + 0.35056061297655106, + 0.10651230067014694, + 0.7903337962925434, + 0.0, + 0.0, + 0.0, + 1.2269317097961903, + 0.8396762348711491, + 0.24006281793117523, + 0.42612920701503754, + 0.14281639829277992, + 0.34793591126799583, + 0.12283870205283165, + 0.40986981242895126, + 0.8906268589198589, + 0.4357798360288143, + 0.2505149655044079, + 0.5238290689885616, + 0.09399686753749847 + ], + "unique_experts": 57, + "load_cv": 1.146225336680222, + "normalized_load_entropy": 0.8698621096769783, + "max_load_share": 0.08647798742138364 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "aa24823d9b01f094fb42a3d6000e09bd6308d39e4d56ed8232394f7d4f894308", + "route_weight_sha256": "5a268be55f5ea974eacc3eadff17eb9dbf32186763aea428ccd3e2bb42af707a", + "loads": [ + 5, + 61, + 4, + 7, + 3, + 12, + 8, + 36, + 8, + 13, + 7, + 6, + 9, + 13, + 2, + 13, + 5, + 14, + 1, + 5, + 5, + 10, + 36, + 0, + 36, + 12, + 0, + 0, + 13, + 26, + 12, + 16, + 12, + 20, + 20, + 1, + 17, + 45, + 2, + 15, + 14, + 18, + 3, + 31, + 23, + 12, + 8, + 19, + 0, + 3, + 3, + 18, + 22, + 3, + 11, + 11, + 6, + 2, + 11, + 11, + 7, + 6, + 9, + 5 + ], + "weighted_loads": [ + 0.20250430330634117, + 3.519456874579191, + 0.12278185691684484, + 0.5853911079466343, + 0.1438319832086563, + 0.6205242350697517, + 0.6669188141822815, + 2.7095930464565754, + 0.5673615634441376, + 0.6206011436879635, + 0.5696657001972198, + 0.29752535466104746, + 0.4752950817346573, + 0.8697233088314533, + 0.12590930610895157, + 0.7251182720065117, + 0.3237052857875824, + 0.9637354947626591, + 0.05694418400526047, + 0.2713753990828991, + 0.5604281015694141, + 0.5542288087308407, + 2.353291530162096, + 0.0, + 2.6979112569242716, + 0.8334836699068546, + 0.0, + 0.0, + 0.9354188814759254, + 1.9633272551000118, + 0.928486755117774, + 1.5230272226035595, + 0.7268303595483303, + 1.4979848731309175, + 1.1596324630081654, + 0.03289817273616791, + 1.3305867854505777, + 2.5988093074411154, + 0.06946566328406334, + 0.9958281144499779, + 0.7738925348967314, + 0.9582989104092121, + 0.19466665014624596, + 2.0149940960109234, + 1.5070830136537552, + 1.014516431838274, + 0.7363410741090775, + 0.9027468226850033, + 0.0, + 0.17316676303744316, + 0.169997688382864, + 1.2269317097961903, + 1.726844448596239, + 0.24006281793117523, + 1.132426330819726, + 0.6479756645858288, + 0.34793591126799583, + 0.12283870205283165, + 0.5216756425797939, + 0.8906268589198589, + 0.4357798360288143, + 0.2505149655044079, + 0.6114345043897629, + 0.30163972824811935 + ], + "unique_experts": 60, + "load_cv": 0.9323364943139253, + "normalized_load_entropy": 0.9094844426004693, + "max_load_share": 0.07760814249363868 + } + }, + "s1_bos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "8071e13440487387609771822859012f0421a6573fe9970d8433c4f48724e557", + "route_weight_sha256": "e661374091157b5a94c107bd922db374fa984d762353cbf1184cf5ccbb2903d3", + "loads": [ + 4, + 57, + 2, + 6, + 0, + 12, + 3, + 35, + 0, + 12, + 6, + 4, + 2, + 6, + 2, + 11, + 7, + 9, + 1, + 5, + 5, + 10, + 35, + 0, + 36, + 1, + 0, + 0, + 12, + 26, + 9, + 15, + 8, + 3, + 17, + 0, + 20, + 47, + 1, + 9, + 6, + 19, + 3, + 33, + 21, + 5, + 2, + 16, + 0, + 0, + 0, + 19, + 10, + 3, + 7, + 3, + 6, + 2, + 8, + 11, + 7, + 8, + 7, + 2 + ], + "weighted_loads": [ + 0.1674175225198269, + 3.228900048881769, + 0.08413660526275635, + 0.5403053686022758, + 0.0, + 0.6192424893379211, + 0.1838604137301445, + 2.7091346699744463, + 0.0, + 0.5831149891018867, + 0.5082065425813198, + 0.24014881253242493, + 0.09302917867898941, + 0.3787367269396782, + 0.1286197267472744, + 0.640646442770958, + 0.417810283601284, + 0.7081496715545654, + 0.0548427514731884, + 0.27444107830524445, + 0.5643280036747456, + 0.5389402359724045, + 2.3082664236426353, + 0.0, + 2.6673880256712437, + 0.05712953582406044, + 0.0, + 0.0, + 0.8731108345091343, + 1.9098514802753925, + 0.7840849757194519, + 1.450014442205429, + 0.5567416772246361, + 0.1510700136423111, + 1.0318696089088917, + 0.0, + 1.4065200630575418, + 2.736565835773945, + 0.03399493545293808, + 0.7627119794487953, + 0.298944603651762, + 0.9901036620140076, + 0.1927851028740406, + 2.007874833419919, + 1.4227626621723175, + 0.33923501893877983, + 0.09835291281342506, + 0.7733186613768339, + 0.0, + 0.0, + 0.0, + 1.2422460950911045, + 0.7978467494249344, + 0.23533230274915695, + 0.43401292338967323, + 0.14124493300914764, + 0.3423396721482277, + 0.12095776200294495, + 0.4295279234647751, + 0.8898361138999462, + 0.430167019367218, + 0.32896657288074493, + 0.5195386968553066, + 0.08785884827375412 + ], + "unique_experts": 55, + "load_cv": 1.1830421057036502, + "normalized_load_entropy": 0.8625445618468696, + "max_load_share": 0.08962264150943396 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "f53e545cf5f350defeaa20c320c2595462ccc4462114f8aebd484c01cc027536", + "route_weight_sha256": "b8bab4634a1c6d8beb412c073b09670728cd9dcf27bf2a251ad2fe83be80888f", + "loads": [ + 5, + 62, + 12, + 8, + 2, + 13, + 14, + 36, + 13, + 12, + 9, + 7, + 11, + 13, + 2, + 12, + 7, + 24, + 2, + 5, + 5, + 10, + 36, + 4, + 36, + 12, + 0, + 2, + 13, + 26, + 12, + 15, + 11, + 27, + 17, + 0, + 20, + 47, + 7, + 14, + 18, + 19, + 5, + 33, + 21, + 18, + 16, + 19, + 3, + 6, + 5, + 19, + 19, + 9, + 10, + 13, + 6, + 2, + 10, + 12, + 7, + 12, + 10, + 7 + ], + "weighted_loads": [ + 0.20693396404385567, + 3.5085130371153355, + 0.7072491263970733, + 0.6485202722251415, + 0.0996086560189724, + 0.6637615859508514, + 1.165040671825409, + 2.7440729830414057, + 0.8766919113695621, + 0.5831149891018867, + 0.6634925566613674, + 0.35654656309634447, + 0.6298214197158813, + 0.8567377217113972, + 0.1286197267472744, + 0.681500755250454, + 0.417810283601284, + 1.7239635065197945, + 0.10168492048978806, + 0.27444107830524445, + 0.5643280036747456, + 0.5389402359724045, + 2.3474838957190514, + 0.18764951638877392, + 2.6673880256712437, + 1.1699504181742668, + 0.0, + 0.11914309486746788, + 0.914781428873539, + 1.9098514802753925, + 0.8954151701182127, + 1.450014442205429, + 0.6659161038696766, + 1.8317458983510733, + 1.0318696089088917, + 0.0, + 1.4065200630575418, + 2.736565835773945, + 0.4278443939983845, + 0.9291770067065954, + 0.9094037041068077, + 0.9901036620140076, + 0.3609221987426281, + 2.007874833419919, + 1.4227626621723175, + 1.5915294326841831, + 1.103323582559824, + 0.8786690626293421, + 0.32165708392858505, + 0.3809460252523422, + 0.2548299878835678, + 1.2422460950911045, + 1.4942505694925785, + 0.9191992282867432, + 1.1024913266301155, + 0.8392141237854958, + 0.3423396721482277, + 0.12095776200294495, + 0.5287644825875759, + 0.9230446331202984, + 0.430167019367218, + 0.5175222456455231, + 0.6622111834585667, + 0.37807217985391617 + ], + "unique_experts": 62, + "load_cv": 0.8192910394311834, + "normalized_load_entropy": 0.9301305249315823, + "max_load_share": 0.07029478458049887 + } + }, + "s0_x": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "d64f0da2ae00c90d1fee5335f1284f00671f7df62ca146cc20ce5accb65b718b", + "route_weight_sha256": "18356a9357689fd5b7de408b43da063cb132307f68aafed52d5e7851a1d8195b", + "loads": [ + 4, + 54, + 2, + 6, + 0, + 12, + 2, + 35, + 0, + 12, + 6, + 5, + 2, + 5, + 2, + 12, + 8, + 9, + 1, + 5, + 5, + 10, + 36, + 0, + 35, + 1, + 0, + 2, + 13, + 26, + 9, + 16, + 8, + 5, + 20, + 0, + 18, + 45, + 3, + 9, + 6, + 17, + 3, + 32, + 21, + 5, + 2, + 15, + 0, + 0, + 0, + 19, + 9, + 3, + 6, + 3, + 6, + 2, + 9, + 11, + 7, + 8, + 7, + 2 + ], + "weighted_loads": [ + 0.16190028563141823, + 3.0792898274958134, + 0.08568740263581276, + 0.5367517918348312, + 0.0, + 0.6089855022728443, + 0.14338227361440659, + 2.6592529602348804, + 0.0, + 0.5962074734270573, + 0.502685409039259, + 0.2695576027035713, + 0.09114363044500351, + 0.3243675269186497, + 0.11246147006750107, + 0.6837003901600838, + 0.4293903075158596, + 0.7299325950443745, + 0.05823974683880806, + 0.27070780470967293, + 0.5605907514691353, + 0.5472834222018719, + 2.3294425942003727, + 0.0, + 2.7031210474669933, + 0.053176380693912506, + 0.0, + 0.06475205905735493, + 0.9115360081195831, + 1.9492588974535465, + 0.8063349239528179, + 1.508633978664875, + 0.5584261007606983, + 0.22196673229336739, + 1.1430517919361591, + 0.0, + 1.3310234062373638, + 2.6044574212282896, + 0.10135249048471451, + 0.7858166433870792, + 0.3209371343255043, + 0.8953093066811562, + 0.19295009598135948, + 2.0146051812916994, + 1.4300692938268185, + 0.35892166942358017, + 0.10978936403989792, + 0.7344936523586512, + 0.0, + 0.0, + 0.0, + 1.2646192200481892, + 0.7491658516228199, + 0.23839940503239632, + 0.37012626975774765, + 0.14460882171988487, + 0.35440394654870033, + 0.12196213006973267, + 0.4532304219901562, + 0.8808084651827812, + 0.43802130222320557, + 0.32817989587783813, + 0.5120207853615284, + 0.08170144632458687 + ], + "unique_experts": 56, + "load_cv": 1.1456730553403973, + "normalized_load_entropy": 0.8696456279979754, + "max_load_share": 0.08490566037735849 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "c132b4e461bd360da8615b54cfd65282c39d9bc4a739f8a1edbf4956b840fd8f", + "route_weight_sha256": "d0dd68516199a6a0c7c3e00a63bfcb0265c79997c3fc7831f8988710aa928cf6", + "loads": [ + 4, + 61, + 5, + 7, + 2, + 12, + 8, + 36, + 9, + 12, + 7, + 7, + 9, + 13, + 2, + 12, + 8, + 12, + 1, + 5, + 5, + 10, + 38, + 0, + 35, + 13, + 0, + 2, + 13, + 26, + 11, + 16, + 13, + 20, + 20, + 0, + 18, + 45, + 3, + 14, + 12, + 17, + 3, + 32, + 21, + 11, + 8, + 18, + 0, + 4, + 4, + 19, + 21, + 3, + 8, + 11, + 6, + 2, + 12, + 11, + 7, + 8, + 9, + 5 + ], + "weighted_loads": [ + 0.16190028563141823, + 3.502186046913266, + 0.16711513232439756, + 0.5847106501460075, + 0.10662544891238213, + 0.6089855022728443, + 0.6609515994787216, + 2.7049498446285725, + 0.6284937560558319, + 0.5962074734270573, + 0.563504733145237, + 0.334452916868031, + 0.4722895659506321, + 0.9049894958734512, + 0.11246147006750107, + 0.6837003901600838, + 0.4293903075158596, + 0.8625324331223965, + 0.05823974683880806, + 0.27070780470967293, + 0.5605907514691353, + 0.5472834222018719, + 2.4037399254739285, + 0.0, + 2.7031210474669933, + 0.9250681214034557, + 0.0, + 0.06475205905735493, + 0.9115360081195831, + 1.9492588974535465, + 0.8662943411618471, + 1.508633978664875, + 0.7708101980388165, + 1.3764681983739138, + 1.1430517919361591, + 0.0, + 1.3310234062373638, + 2.6044574212282896, + 0.10135249048471451, + 0.9524827897548676, + 0.682691428810358, + 0.8953093066811562, + 0.19295009598135948, + 2.0146051812916994, + 1.4300692938268185, + 0.9709783233702183, + 0.7386329062283039, + 0.846906678751111, + 0.0, + 0.23150409758090973, + 0.22369014099240303, + 1.2646192200481892, + 1.590553019195795, + 0.23839940503239632, + 0.9937464725226164, + 0.6482663489878178, + 0.35440394654870033, + 0.12196213006973267, + 0.5650362521409988, + 0.8808084651827812, + 0.43802130222320557, + 0.32817989587783813, + 0.5912055894732475, + 0.28934430703520775 + ], + "unique_experts": 60, + "load_cv": 0.9273229602630871, + "normalized_load_entropy": 0.9118986829140502, + "max_load_share": 0.07760814249363868 + } + }, + "s1_x": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "e046980a7d25fdc31f1a03a14202b92b9bfc7cd5d738888c6be2676bebb559ae", + "route_weight_sha256": "cd590d91c80d0a8ccc1f3aa492d12d5a2a090446fb0550ec69ed2dbbefd98b4d", + "loads": [ + 3, + 55, + 2, + 6, + 0, + 11, + 3, + 36, + 0, + 13, + 6, + 4, + 2, + 5, + 2, + 11, + 9, + 9, + 2, + 5, + 5, + 9, + 36, + 0, + 36, + 1, + 1, + 0, + 12, + 26, + 9, + 16, + 8, + 4, + 17, + 0, + 17, + 46, + 1, + 9, + 7, + 17, + 3, + 32, + 23, + 5, + 2, + 15, + 0, + 0, + 0, + 18, + 10, + 3, + 8, + 4, + 6, + 2, + 9, + 11, + 7, + 8, + 7, + 2 + ], + "weighted_loads": [ + 0.1234465166926384, + 3.075431253761053, + 0.08489060774445534, + 0.5479437708854675, + 0.0, + 0.5868779700249434, + 0.18336642906069756, + 2.7603314705193043, + 0.0, + 0.6218588724732399, + 0.5117980465292931, + 0.24404654651880264, + 0.09290587902069092, + 0.33630798384547234, + 0.12560578808188438, + 0.6349210515618324, + 0.4753500074148178, + 0.6936410181224346, + 0.08836749568581581, + 0.27981600910425186, + 0.561066310852766, + 0.48296114057302475, + 2.3505486734211445, + 0.0, + 2.700254064053297, + 0.059756774455308914, + 0.028123611584305763, + 0.0, + 0.8541862294077873, + 1.9128810297697783, + 0.7795124091207981, + 1.4844938293099403, + 0.5690875202417374, + 0.17160318046808243, + 1.0076462551951408, + 0.0, + 1.2633098252117634, + 2.665533473715186, + 0.035799961537122726, + 0.7734968662261963, + 0.3484932370483875, + 0.9129896350204945, + 0.19681206345558167, + 1.9546444024890661, + 1.4599259085953236, + 0.34763041138648987, + 0.10594551265239716, + 0.732733428478241, + 0.0, + 0.0, + 0.0, + 1.1719735451042652, + 0.7633792422711849, + 0.2295178920030594, + 0.44709023274481297, + 0.18277639895677567, + 0.3448810949921608, + 0.11972073838114738, + 0.4738977290689945, + 0.882502369582653, + 0.414418775588274, + 0.33163826540112495, + 0.5241759046912193, + 0.08463893458247185 + ], + "unique_experts": 56, + "load_cv": 1.1619911738025108, + "normalized_load_entropy": 0.867291253298977, + "max_load_share": 0.08647798742138364 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "5f491237afbac26d7afc0dc65e6ac2cd233900cbcf3e08c65bc7b49911614a07", + "route_weight_sha256": "9ed9b96f738a5a57ef6675cb993e825764d9ef8792198c44e450ec5b36d55e13", + "loads": [ + 4, + 61, + 13, + 8, + 1, + 12, + 15, + 37, + 13, + 13, + 10, + 8, + 11, + 14, + 2, + 11, + 10, + 23, + 4, + 5, + 5, + 9, + 37, + 4, + 36, + 14, + 1, + 2, + 13, + 26, + 11, + 16, + 12, + 25, + 17, + 0, + 17, + 46, + 7, + 13, + 19, + 17, + 5, + 32, + 23, + 17, + 16, + 18, + 3, + 6, + 6, + 18, + 19, + 9, + 10, + 12, + 6, + 2, + 11, + 12, + 7, + 12, + 9, + 7 + ], + "weighted_loads": [ + 0.16296295821666718, + 3.3999098874628544, + 0.7454493036493659, + 0.6544289812445641, + 0.054176315665245056, + 0.6313970666378736, + 1.1833062432706356, + 2.7952697835862637, + 0.8815451040863991, + 0.6218588724732399, + 0.7199978530406952, + 0.39855530206114054, + 0.6296981200575829, + 0.9454187415540218, + 0.12560578808188438, + 0.6349210515618324, + 0.5093805678188801, + 1.6529480442404747, + 0.1694321669638157, + 0.27981600910425186, + 0.561066310852766, + 0.48296114057302475, + 2.3897661454975605, + 0.18764951638877392, + 2.700254064053297, + 1.341163944453001, + 0.028123611584305763, + 0.11914309486746788, + 0.895856823772192, + 1.9128810297697783, + 0.8424265626817942, + 1.4844938293099403, + 0.7200531922280788, + 1.5520151685923338, + 1.0076462551951408, + 0.0, + 1.2633098252117634, + 2.665533473715186, + 0.4296494200825691, + 0.9026289936155081, + 0.9068866521120071, + 0.9129896350204945, + 0.36494915932416916, + 1.9546444024890661, + 1.4599259085953236, + 1.5123157650232315, + 1.075940378010273, + 0.8380838297307491, + 0.32165708392858505, + 0.3846045434474945, + 0.32662878185510635, + 1.1719735451042652, + 1.4231200516223907, + 0.9133848175406456, + 1.0705770682543516, + 0.7458745948970318, + 0.3448810949921608, + 0.11972073838114738, + 0.5731342881917953, + 0.9157108888030052, + 0.414418775588274, + 0.5201939381659031, + 0.6244383417069912, + 0.3748522661626339 + ], + "unique_experts": 63, + "load_cv": 0.8049056199382258, + "normalized_load_entropy": 0.9329800691722219, + "max_load_share": 0.0691609977324263 + } + }, + "s0_period": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "cddc71f6c4bdca849d7e9885f49f42ba4460b9896f6c93efa0b27988383584db", + "route_weight_sha256": "4b9b034abf7bfbd6c00455d59fd98cfc7ed7861e582081f6e00b4127c3631923", + "loads": [ + 4, + 53, + 2, + 6, + 0, + 12, + 3, + 34, + 0, + 12, + 6, + 5, + 2, + 5, + 2, + 12, + 7, + 9, + 2, + 5, + 5, + 10, + 36, + 0, + 35, + 1, + 0, + 1, + 13, + 26, + 9, + 16, + 8, + 5, + 19, + 1, + 18, + 46, + 2, + 9, + 6, + 17, + 3, + 33, + 22, + 5, + 2, + 16, + 0, + 0, + 0, + 18, + 8, + 3, + 7, + 4, + 6, + 2, + 9, + 10, + 7, + 8, + 7, + 2 + ], + "weighted_loads": [ + 0.16412734612822533, + 3.0029879920184612, + 0.08379299938678741, + 0.5379503890872002, + 0.0, + 0.6090687587857246, + 0.1887248456478119, + 2.607543036341667, + 0.0, + 0.5925633423030376, + 0.5030600652098656, + 0.26275456324219704, + 0.09478826448321342, + 0.3225044570863247, + 0.11860876530408859, + 0.6782878637313843, + 0.40412432700395584, + 0.7388332784175873, + 0.08846623823046684, + 0.2722563296556473, + 0.5533172152936459, + 0.5474053546786308, + 2.324786063283682, + 0.0, + 2.6649301182478666, + 0.05290781334042549, + 0.0, + 0.033461056649684906, + 0.9051708467304707, + 1.9689856618642807, + 0.7977445535361767, + 1.5126036778092384, + 0.555241983383894, + 0.22125961631536484, + 1.0969525277614594, + 0.03460604324936867, + 1.3385189566761255, + 2.621234767138958, + 0.06834018230438232, + 0.764638427644968, + 0.31996608152985573, + 0.8977117203176022, + 0.19667503610253334, + 2.070920968428254, + 1.4806892648339272, + 0.3574201874434948, + 0.10072121396660805, + 0.7728704884648323, + 0.0, + 0.0, + 0.0, + 1.2209036312997341, + 0.7041782028973103, + 0.2368050180375576, + 0.4065822809934616, + 0.18124323710799217, + 0.34917686879634857, + 0.11985157057642937, + 0.460451602935791, + 0.8449708856642246, + 0.4361361972987652, + 0.3304590433835983, + 0.5127265155315399, + 0.09057439118623734 + ], + "unique_experts": 57, + "load_cv": 1.1419381699150197, + "normalized_load_entropy": 0.8714170561882196, + "max_load_share": 0.08333333333333333 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "f84155dddf7ad06031e2c4be265da8cf8b16ca4db19ec18b886e5af3d38a675e", + "route_weight_sha256": "a4aa95728de44f55371a7e038c81c5f74b16ccf24adf28d675b6879a18b0a05d", + "loads": [ + 4, + 59, + 4, + 7, + 2, + 12, + 11, + 35, + 8, + 12, + 8, + 7, + 9, + 13, + 2, + 12, + 7, + 12, + 2, + 5, + 5, + 10, + 38, + 0, + 35, + 13, + 0, + 1, + 13, + 26, + 11, + 16, + 12, + 20, + 19, + 1, + 18, + 46, + 2, + 15, + 11, + 17, + 3, + 33, + 22, + 11, + 9, + 19, + 0, + 5, + 3, + 18, + 20, + 3, + 9, + 12, + 6, + 2, + 12, + 10, + 7, + 8, + 8, + 6 + ], + "weighted_loads": [ + 0.16412734612822533, + 3.37322841770947, + 0.12291694711893797, + 0.5897299610078335, + 0.11028328165411949, + 0.6090687587857246, + 0.8498051427304745, + 2.653239920735359, + 0.6540372371673584, + 0.5925633423030376, + 0.6128563210368156, + 0.32764987740665674, + 0.475934199988842, + 0.8528460822999477, + 0.11860876530408859, + 0.6782878637313843, + 0.40412432700395584, + 0.8695802763104439, + 0.08846623823046684, + 0.2722563296556473, + 0.5533172152936459, + 0.5474053546786308, + 2.3990833945572376, + 0.0, + 2.6649301182478666, + 0.9133962467312813, + 0.0, + 0.033461056649684906, + 0.9051708467304707, + 1.9689856618642807, + 0.8580012675374746, + 1.5126036778092384, + 0.7243364825844765, + 1.373115198686719, + 1.0969525277614594, + 0.03460604324936867, + 1.3385189566761255, + 2.621234767138958, + 0.06834018230438232, + 0.9660468064248562, + 0.6378040723502636, + 0.8977117203176022, + 0.19667503610253334, + 2.070920968428254, + 1.4806892648339272, + 0.9529878459870815, + 0.8136328905820847, + 0.8852835148572922, + 0.0, + 0.26435045525431633, + 0.169997688382864, + 1.2209036312997341, + 1.542153362184763, + 0.2368050180375576, + 1.0302024837583303, + 0.6726261414587498, + 0.34917686879634857, + 0.11985157057642937, + 0.5722574330866337, + 0.8449708856642246, + 0.4361361972987652, + 0.3304590433835983, + 0.5587583258748055, + 0.42228613793849945 + ], + "unique_experts": 61, + "load_cv": 0.9187935429139239, + "normalized_load_entropy": 0.91321368286519, + "max_load_share": 0.07506361323155217 + } + }, + "s1_period": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "77107b94fbba5f017c3548bc1460026e3c2f38e9889d0a7b1336ec5005491e39", + "route_weight_sha256": "9c00373a600fa867cd0acf26b35dae22c13d62363795f893ce3cc5e46fd7d2a4", + "loads": [ + 4, + 55, + 2, + 6, + 0, + 12, + 3, + 33, + 0, + 12, + 6, + 5, + 2, + 6, + 2, + 11, + 8, + 9, + 2, + 5, + 5, + 10, + 35, + 0, + 36, + 1, + 2, + 0, + 12, + 25, + 9, + 16, + 8, + 5, + 17, + 1, + 19, + 47, + 1, + 9, + 6, + 17, + 3, + 32, + 22, + 5, + 2, + 14, + 0, + 0, + 0, + 19, + 10, + 3, + 7, + 4, + 6, + 2, + 8, + 11, + 7, + 8, + 7, + 2 + ], + "weighted_loads": [ + 0.16053762659430504, + 3.067081969231367, + 0.08380267396569252, + 0.552061028778553, + 0.0, + 0.6035013031214476, + 0.1853078342974186, + 2.615355681627989, + 0.0, + 0.5834593437612057, + 0.5146403387188911, + 0.2883664406836033, + 0.09457037970423698, + 0.3829435743391514, + 0.12882351875305176, + 0.6408059783279896, + 0.45872874557971954, + 0.694996539503336, + 0.08616331219673157, + 0.27961917594075203, + 0.5636203177273273, + 0.5229188576340675, + 2.313864056020975, + 0.0, + 2.697077129036188, + 0.063788503408432, + 0.058860668912529945, + 0.0, + 0.855864629149437, + 1.8708140812814236, + 0.7650143653154373, + 1.4968017973005772, + 0.5686369650065899, + 0.20011991262435913, + 1.0058358944952488, + 0.036788973957300186, + 1.3487266041338444, + 2.708173468708992, + 0.03617013990879059, + 0.7383790761232376, + 0.3008888140320778, + 0.9172150827944279, + 0.19815553352236748, + 1.968262841925025, + 1.4317564219236374, + 0.3376770503818989, + 0.09571538493037224, + 0.6797978710383177, + 0.0, + 0.0, + 0.0, + 1.2185526378452778, + 0.7579226791858673, + 0.23282244428992271, + 0.4129750691354275, + 0.18497147038578987, + 0.3423054479062557, + 0.11910359561443329, + 0.43532707542181015, + 0.8793462663888931, + 0.42492642626166344, + 0.3336359113454819, + 0.5219946317374706, + 0.08612887188792229 + ], + "unique_experts": 57, + "load_cv": 1.1478805863815926, + "normalized_load_entropy": 0.8715762999191733, + "max_load_share": 0.08647798742138364 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "1d62d932b714b620cbb8c4f297fb1c1da88eae054e113c3fcd07b56dfccc4437", + "route_weight_sha256": "ed445b97581d2d85ab98211209d8c2213be50ff158f2cef43eae4f293cc8a038", + "loads": [ + 5, + 60, + 12, + 8, + 1, + 13, + 16, + 34, + 13, + 12, + 10, + 8, + 11, + 13, + 2, + 11, + 9, + 24, + 4, + 5, + 5, + 10, + 36, + 4, + 36, + 14, + 2, + 2, + 13, + 25, + 11, + 16, + 11, + 26, + 17, + 1, + 19, + 47, + 7, + 13, + 18, + 17, + 5, + 32, + 22, + 16, + 17, + 17, + 3, + 8, + 5, + 19, + 19, + 9, + 9, + 13, + 6, + 2, + 10, + 12, + 7, + 12, + 10, + 8 + ], + "weighted_loads": [ + 0.20005406811833382, + 3.3466949574649334, + 0.7069151951000094, + 0.6655059233307838, + 0.053235698491334915, + 0.6480203997343779, + 1.2785532847046852, + 2.650293994694948, + 0.9117957018315792, + 0.5834593437612057, + 0.7324918508529663, + 0.40476419124752283, + 0.6313626207411289, + 0.8534614071249962, + 0.12882351875305176, + 0.6408059783279896, + 0.494767002761364, + 1.7172827795147896, + 0.1681809015572071, + 0.27961917594075203, + 0.5636203177273273, + 0.5229188576340675, + 2.353081528097391, + 0.18764951638877392, + 2.697077129036188, + 1.300068948417902, + 0.058860668912529945, + 0.11914309486746788, + 0.8975352235138416, + 1.8708140812814236, + 0.8257686365395784, + 1.4968017973005772, + 0.6778113916516304, + 1.5765032190829515, + 1.0058358944952488, + 0.036788973957300186, + 1.3487266041338444, + 2.708173468708992, + 0.430019598454237, + 0.8647612500935793, + 0.8658681511878967, + 0.9172150827944279, + 0.36629262939095497, + 1.968262841925025, + 1.4317564219236374, + 1.4567430019378662, + 1.2001888081431389, + 0.7851482722908258, + 0.32165708392858505, + 0.48581448569893837, + 0.2548299878835678, + 1.2185526378452778, + 1.4144478924572468, + 0.9166893698275089, + 1.0364619046449661, + 0.7949016019701958, + 0.3423054479062557, + 0.11910359561443329, + 0.534563634544611, + 0.9125547856092453, + 0.42492642626166344, + 0.52219158411026, + 0.6557305604219437, + 0.45208312943577766 + ], + "unique_experts": 64, + "load_cv": 0.7909867825626158, + "normalized_load_entropy": 0.9360273374846931, + "max_load_share": 0.06802721088435375 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 106, + "ordered_topk_exact_tokens": 81, + "set_exact_tokens": 89, + "mean_set_jaccard": 0.9521563342318061, + "mean_token_weighted_tv": 0.010383088537052556, + "aggregate_load_tv": 0.017295597484276733 + }, + "system_bos": { + "tokens": 106, + "ordered_topk_exact_tokens": 68, + "set_exact_tokens": 84, + "mean_set_jaccard": 0.9366576819407009, + "mean_token_weighted_tv": 0.015899788509210887, + "aggregate_load_tv": 0.026729559748427667 + }, + "system_x": { + "tokens": 106, + "ordered_topk_exact_tokens": 57, + "set_exact_tokens": 77, + "mean_set_jaccard": 0.9198113207547169, + "mean_token_weighted_tv": 0.018999031358310638, + "aggregate_load_tv": 0.02515723270440251 + }, + "system_period": { + "tokens": 106, + "ordered_topk_exact_tokens": 58, + "set_exact_tokens": 80, + "mean_set_jaccard": 0.9278975741239892, + "mean_token_weighted_tv": 0.018089988875150117, + "aggregate_load_tv": 0.02044025157232704 + }, + "bos_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 66, + "set_exact_tokens": 79, + "mean_set_jaccard": 0.925202156334232, + "mean_token_weighted_tv": 0.017346901599458366, + "aggregate_load_tv": 0.02987421383647798 + }, + "bos_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 62, + "set_exact_tokens": 78, + "mean_set_jaccard": 0.9204851752021564, + "mean_token_weighted_tv": 0.019050630837468045, + "aggregate_load_tv": 0.029874213836477984 + }, + "x_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 59, + "set_exact_tokens": 74, + "mean_set_jaccard": 0.9117250673854447, + "mean_token_weighted_tv": 0.020047437557774894, + "aggregate_load_tv": 0.029874213836477988 + }, + "x_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 51, + "set_exact_tokens": 72, + "mean_set_jaccard": 0.9043126684636119, + "mean_token_weighted_tv": 0.023581674190694995, + "aggregate_load_tv": 0.029874213836477984 + }, + "period_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 61, + "set_exact_tokens": 75, + "mean_set_jaccard": 0.9144204851752024, + "mean_token_weighted_tv": 0.019224314379312518, + "aggregate_load_tv": 0.033018867924528295 + }, + "period_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 57, + "set_exact_tokens": 76, + "mean_set_jaccard": 0.9171159029649596, + "mean_token_weighted_tv": 0.021965619255700765, + "aggregate_load_tv": 0.029874213836477988 + } + } + }, + "layer_09": { + "layer": 9, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "a42a4c864a2d92544d094a78acd6122d869610f379041107839560dbd5f206e5", + "route_weight_sha256": "5fbcfca4e175fc526a36cb02005aecbbd88ae60bcb7add1a6c19d1535e14fe7e", + "loads": [ + 10, + 5, + 6, + 23, + 12, + 11, + 6, + 8, + 0, + 4, + 1, + 19, + 10, + 9, + 1, + 2, + 11, + 12, + 5, + 3, + 2, + 20, + 5, + 3, + 2, + 8, + 3, + 24, + 24, + 1, + 25, + 5, + 8, + 0, + 14, + 4, + 27, + 19, + 0, + 10, + 10, + 1, + 12, + 13, + 11, + 1, + 3, + 22, + 5, + 7, + 10, + 28, + 10, + 0, + 11, + 1, + 48, + 25, + 5, + 5, + 22, + 7, + 11, + 6 + ], + "weighted_loads": [ + 0.5057369992136955, + 0.3860093764960766, + 0.36288806051015854, + 1.2421430926769972, + 0.7367789074778557, + 0.9636108316481113, + 0.27189142629504204, + 0.4081961214542389, + 0.0, + 0.20878968015313148, + 0.04328217729926109, + 1.1340590044856071, + 1.042642230167985, + 1.1053102277219296, + 0.04535449668765068, + 0.10452199727296829, + 0.8663734346628189, + 0.44998660311102867, + 0.28503064066171646, + 0.19801577925682068, + 0.13897626474499702, + 1.4035865515470505, + 0.2559230327606201, + 0.11453557386994362, + 0.07983461394906044, + 0.34126151353120804, + 0.10671282559633255, + 1.3241414576768875, + 2.4831264950335026, + 0.03655720502138138, + 1.465245932340622, + 0.24277235195040703, + 0.43620731867849827, + 0.0, + 1.2617293670773506, + 0.2937455251812935, + 2.408131182193756, + 1.540141535922885, + 0.0, + 0.5743346810340881, + 0.693728219717741, + 0.05457477271556854, + 0.6477046497166157, + 0.6692506410181522, + 0.5330536998808384, + 0.04178019240498543, + 0.20771102979779243, + 1.4563649035990238, + 0.3977513089776039, + 0.29944036342203617, + 0.7664716430008411, + 2.072507742792368, + 0.6912101469933987, + 0.0, + 0.5403048731386662, + 0.05412149056792259, + 3.874270796775818, + 1.5875719375908375, + 0.47774767875671387, + 0.19762949645519257, + 1.5191163048148155, + 0.39841626584529877, + 0.608181219547987, + 0.34148746728897095 + ], + "unique_experts": 60, + "load_cv": 0.9122532567819724, + "normalized_load_entropy": 0.9074526503552216, + "max_load_share": 0.07547169811320754 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "3c0ddb98b96235d489cc9d023e1373c0d9e9a27d5be241075720500e4bd71ed4", + "route_weight_sha256": "14f6fa6ac1dbe11703ad605aa5fc25b695a37edfdddc1e27b49fd0eb8f976965", + "loads": [ + 17, + 8, + 6, + 23, + 14, + 11, + 6, + 8, + 2, + 4, + 12, + 19, + 13, + 13, + 1, + 2, + 12, + 13, + 5, + 12, + 2, + 20, + 10, + 7, + 6, + 10, + 3, + 25, + 24, + 1, + 27, + 11, + 9, + 0, + 23, + 11, + 27, + 19, + 3, + 10, + 10, + 10, + 12, + 13, + 16, + 9, + 14, + 22, + 8, + 7, + 15, + 29, + 10, + 3, + 11, + 6, + 52, + 25, + 7, + 9, + 22, + 7, + 13, + 7 + ], + "weighted_loads": [ + 1.0374720804393291, + 0.6247099973261356, + 0.36288806051015854, + 1.2421430926769972, + 0.9628274068236351, + 0.9636108316481113, + 0.27189142629504204, + 0.4081961214542389, + 0.09500579535961151, + 0.20878968015313148, + 1.2129287086427212, + 1.1340590044856071, + 1.0960279353894293, + 1.2053472101688385, + 0.04535449668765068, + 0.10452199727296829, + 0.9074934348464012, + 0.49259695783257484, + 0.28503064066171646, + 1.062452644109726, + 0.13897626474499702, + 1.4035865515470505, + 1.8325368221849203, + 0.4709226116538048, + 0.24544008821249008, + 0.5184507519006729, + 0.10671282559633255, + 1.3371393689885736, + 2.4831264950335026, + 0.03655720502138138, + 1.565021924674511, + 0.4313891031779349, + 0.4399422805290669, + 0.0, + 1.7526521142572165, + 0.7662447318434715, + 2.408131182193756, + 1.540141535922885, + 0.12471703067421913, + 0.5743346810340881, + 0.693728219717741, + 0.9789061099290848, + 0.6477046497166157, + 0.6692506410181522, + 0.8491130960173905, + 0.7352306768298149, + 1.1159100942313671, + 1.4563649035990238, + 0.6152961514890194, + 0.29944036342203617, + 1.0348208919167519, + 2.106613915413618, + 0.6912101469933987, + 0.11954950354993343, + 0.5403048731386662, + 0.28752170875668526, + 4.080196246504784, + 1.5875719375908375, + 0.6286587230861187, + 0.3727867901325226, + 1.5191163048148155, + 0.39841626584529877, + 0.6640434619039297, + 0.3777092285454273 + ], + "unique_experts": 63, + "load_cv": 0.7122455122744298, + "normalized_load_entropy": 0.9438082661903796, + "max_load_share": 0.06615776081424936 + } + }, + "s1_eos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "9cbc698b2afca68accb9d2bade7296ccb3ef5a987fbfdc6d06a8b2fa1a54a90e", + "route_weight_sha256": "466c0ab51128e41c238aab1df6754dd1f99a29498b251dbe44a36d9cd9c71435", + "loads": [ + 9, + 5, + 8, + 24, + 12, + 11, + 5, + 7, + 0, + 4, + 1, + 19, + 10, + 9, + 1, + 2, + 11, + 12, + 5, + 3, + 2, + 20, + 7, + 3, + 2, + 5, + 3, + 25, + 24, + 1, + 24, + 5, + 7, + 0, + 15, + 4, + 26, + 19, + 0, + 10, + 11, + 2, + 12, + 11, + 11, + 1, + 3, + 22, + 5, + 7, + 10, + 28, + 10, + 0, + 11, + 1, + 49, + 25, + 5, + 5, + 23, + 7, + 11, + 6 + ], + "weighted_loads": [ + 0.46173403039574623, + 0.38072769716382027, + 0.4597684033215046, + 1.2670935615897179, + 0.7459978498518467, + 0.9766949787735939, + 0.23422508127987385, + 0.36330052092671394, + 0.0, + 0.20992263033986092, + 0.04292873665690422, + 1.144822783768177, + 1.0368068013340235, + 1.082472313195467, + 0.047545526176691055, + 0.10256612673401833, + 0.8754943013191223, + 0.46381075493991375, + 0.2860499359667301, + 0.19388244301080704, + 0.13103849813342094, + 1.3886007405817509, + 0.339109905064106, + 0.11097655072808266, + 0.08071146160364151, + 0.22499792650341988, + 0.10371185652911663, + 1.3581450562924147, + 2.498722217977047, + 0.03672603890299797, + 1.4087239690124989, + 0.24367541074752808, + 0.3946903795003891, + 0.0, + 1.285320244729519, + 0.2909183166921139, + 2.3560790978372097, + 1.5360869616270065, + 0.0, + 0.5779263749718666, + 0.7316639460623264, + 0.09310483187437057, + 0.6423497200012207, + 0.5912929102778435, + 0.5457807295024395, + 0.04260780289769173, + 0.23007646575570107, + 1.4556967616081238, + 0.39952346682548523, + 0.29558481462299824, + 0.749963253736496, + 2.0716629959642887, + 0.7028393223881721, + 0.0, + 0.5342457592487335, + 0.06931526213884354, + 3.878963988274336, + 1.5953241437673569, + 0.4770282953977585, + 0.19647375866770744, + 1.5534518957138062, + 0.3832610212266445, + 0.602484755218029, + 0.35024867579340935 + ], + "unique_experts": 60, + "load_cv": 0.9203688575277232, + "normalized_load_entropy": 0.9069963785807705, + "max_load_share": 0.0770440251572327 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "2fe0cfe0e042797439de4c48312460ad9b96a6756a25b2a2c6fe31e9d57a22e5", + "route_weight_sha256": "dcb7c96b28b830e058be12fb0ee58e6ddafba9e0d145136cb2ab4bac17ecc9bf", + "loads": [ + 20, + 10, + 8, + 24, + 14, + 11, + 5, + 7, + 7, + 6, + 12, + 21, + 13, + 13, + 2, + 2, + 12, + 13, + 5, + 12, + 2, + 23, + 12, + 15, + 7, + 14, + 7, + 26, + 30, + 1, + 27, + 10, + 8, + 3, + 21, + 16, + 26, + 22, + 5, + 11, + 17, + 16, + 14, + 11, + 17, + 14, + 23, + 22, + 12, + 12, + 13, + 29, + 10, + 3, + 12, + 5, + 54, + 25, + 10, + 9, + 23, + 8, + 13, + 7 + ], + "weighted_loads": [ + 1.2258616350591183, + 0.7058941572904587, + 0.4597684033215046, + 1.2670935615897179, + 0.9942476339638233, + 0.9766949787735939, + 0.23422508127987385, + 0.36330052092671394, + 0.42149077728390694, + 0.301060251891613, + 1.122627142816782, + 1.241539642214775, + 1.0914431661367416, + 1.1704938760958612, + 0.08730733767151833, + 0.10256612673401833, + 0.9213511906564236, + 0.5196070168167353, + 0.2860499359667301, + 1.1471124701201916, + 0.13103849813342094, + 1.514803871512413, + 1.9155209884047508, + 1.0600487515330315, + 0.2687183581292629, + 0.7523876875638962, + 0.35772685892879963, + 1.3711429676041007, + 2.925231173634529, + 0.03672603890299797, + 1.6191283129155636, + 0.39178167888894677, + 0.3982963804155588, + 0.2217627316713333, + 1.58824167214334, + 1.0907549671828747, + 2.3560790978372097, + 1.6788054816424847, + 0.2396739460527897, + 0.6449103727936745, + 1.1312436312437057, + 1.5275064706802368, + 0.7342940382659435, + 0.5912929102778435, + 0.762383152730763, + 1.1573470830917358, + 1.9688591919839382, + 1.4556967616081238, + 0.8568210154771805, + 0.6246945913881063, + 0.9319092966616154, + 2.105033800005913, + 0.7028393223881721, + 0.1482066996395588, + 0.5748501047492027, + 0.2608998827636242, + 4.112158138304949, + 1.5953241437673569, + 0.7897010818123817, + 0.3823169767856598, + 1.5534518957138062, + 0.4208161234855652, + 0.7601465359330177, + 0.38623474165797234 + ], + "unique_experts": 64, + "load_cv": 0.6427081535989227, + "normalized_load_entropy": 0.95413099397554, + "max_load_share": 0.061224489795918366 + } + }, + "s0_bos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "af46e483e6edc2d65fa64a583e4fd0e967469b4c1b72e66a646c6291ae63d9da", + "route_weight_sha256": "32aa3f256d5d333a59c207a12c127b9b3b83f4950261b8b062886d53bc4ed40d", + "loads": [ + 11, + 5, + 6, + 23, + 12, + 12, + 4, + 8, + 0, + 4, + 1, + 19, + 11, + 9, + 1, + 2, + 11, + 11, + 6, + 3, + 2, + 22, + 4, + 3, + 2, + 4, + 2, + 23, + 24, + 1, + 23, + 4, + 6, + 0, + 15, + 4, + 27, + 20, + 0, + 9, + 10, + 1, + 15, + 10, + 11, + 1, + 3, + 20, + 5, + 6, + 10, + 28, + 10, + 0, + 14, + 0, + 48, + 28, + 5, + 5, + 24, + 7, + 14, + 7 + ], + "weighted_loads": [ + 0.5315876863896847, + 0.3863951787352562, + 0.39981235936284065, + 1.2639016546308994, + 0.7206497602164745, + 1.0302265547215939, + 0.20730305835604668, + 0.41121185570955276, + 0.0, + 0.20897247083485126, + 0.041031889617443085, + 1.1270999871194363, + 1.0606616027653217, + 1.1092142425477505, + 0.04256204143166542, + 0.10673791542649269, + 0.8632359206676483, + 0.4173062052577734, + 0.33418258279561996, + 0.23610183224081993, + 0.13014544174075127, + 1.5040384978055954, + 0.21045709401369095, + 0.108809320256114, + 0.07862293720245361, + 0.19024675339460373, + 0.07709075137972832, + 1.2997841443866491, + 2.5506617315113544, + 0.035893362015485764, + 1.3774566017091274, + 0.20140476524829865, + 0.37044674530625343, + 0.0, + 1.2347500286996365, + 0.2950173616409302, + 2.4474958404898643, + 1.596777055412531, + 0.0, + 0.5715703628957272, + 0.7044580392539501, + 0.05416892468929291, + 0.7735090646892786, + 0.5468333065509796, + 0.5508593954145908, + 0.04061241075396538, + 0.2402094565331936, + 1.4083123914897442, + 0.40241991728544235, + 0.26213936507701874, + 0.8042821828275919, + 2.0651065446436405, + 0.6921124719083309, + 0.0, + 0.6419157311320305, + 0.0, + 3.877029560506344, + 1.7678102273494005, + 0.4839372932910919, + 0.19928980618715286, + 1.5892297178506851, + 0.39442434906959534, + 0.7260486725717783, + 0.39491360634565353 + ], + "unique_experts": 59, + "load_cv": 0.9338510828938161, + "normalized_load_entropy": 0.9018136117109715, + "max_load_share": 0.07547169811320754 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "2cba6cede25aacb5bc607d9b3775737adb917f1a6c1525204f580f80b2d729d9", + "route_weight_sha256": "c41b61e505065228cc5a43c1046479efb4f1222e732736b4f436a11187f21088", + "loads": [ + 19, + 8, + 6, + 23, + 15, + 12, + 4, + 8, + 2, + 4, + 12, + 19, + 13, + 13, + 1, + 2, + 12, + 14, + 6, + 12, + 2, + 22, + 8, + 7, + 6, + 6, + 2, + 24, + 24, + 1, + 25, + 9, + 6, + 0, + 24, + 11, + 27, + 20, + 2, + 10, + 10, + 10, + 15, + 10, + 15, + 9, + 14, + 20, + 8, + 6, + 17, + 29, + 10, + 3, + 14, + 4, + 52, + 28, + 7, + 9, + 24, + 7, + 16, + 8 + ], + "weighted_loads": [ + 1.1006114296615124, + 0.610844612121582, + 0.39981235936284065, + 1.2639016546308994, + 1.005041804164648, + 1.0302265547215939, + 0.20730305835604668, + 0.41121185570955276, + 0.09500579535961151, + 0.20897247083485126, + 1.2106784209609032, + 1.1270999871194363, + 1.106606014072895, + 1.2695579575374722, + 0.04256204143166542, + 0.10673791542649269, + 0.9043559208512306, + 0.5360781420022249, + 0.33418258279561996, + 1.1005386970937252, + 0.13014544174075127, + 1.5040384978055954, + 0.8613257687538862, + 0.5077653098851442, + 0.24422841146588326, + 0.373133085668087, + 0.07709075137972832, + 1.3127820556983352, + 2.5506617315113544, + 0.035893362015485764, + 1.480504583567381, + 0.3872836921364069, + 0.37044674530625343, + 0.0, + 1.7256727758795023, + 0.7576619349420071, + 2.4474958404898643, + 1.596777055412531, + 0.0811324268579483, + 0.6166542619466782, + 0.7044580392539501, + 1.0139388740062714, + 0.7735090646892786, + 0.5468333065509796, + 0.8491599978879094, + 0.8675687648355961, + 1.1362057588994503, + 1.4083123914897442, + 0.618070837110281, + 0.26213936507701874, + 1.1534072272479534, + 2.0992127172648907, + 0.6921124719083309, + 0.12172668613493443, + 0.6419157311320305, + 0.20054291561245918, + 4.08295501023531, + 1.7678102273494005, + 0.6377749033272266, + 0.3744470998644829, + 1.5892297178506851, + 0.39442434906959534, + 0.781910914927721, + 0.4311353676021099 + ], + "unique_experts": 63, + "load_cv": 0.735148808802008, + "normalized_load_entropy": 0.9391553419130453, + "max_load_share": 0.06615776081424936 + } + }, + "s1_bos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "1317ca242670eb9e2639783ef4e638272811075ba2b7babe330f8c3a1a940878", + "route_weight_sha256": "62ed9252e508553a37c04bd6e00111c13a986ee8213372784659b06af7fcd54f", + "loads": [ + 9, + 5, + 7, + 22, + 11, + 12, + 4, + 7, + 0, + 4, + 1, + 19, + 10, + 9, + 1, + 2, + 11, + 12, + 7, + 2, + 2, + 21, + 7, + 1, + 1, + 4, + 2, + 24, + 24, + 1, + 22, + 7, + 6, + 0, + 15, + 4, + 28, + 20, + 0, + 10, + 10, + 1, + 15, + 9, + 12, + 1, + 3, + 19, + 5, + 6, + 10, + 28, + 10, + 0, + 12, + 1, + 49, + 28, + 5, + 5, + 24, + 7, + 14, + 8 + ], + "weighted_loads": [ + 0.4413131270557642, + 0.37633850425481796, + 0.43315858393907547, + 1.199748508632183, + 0.6827272400259972, + 1.0319776311516762, + 0.20721051841974258, + 0.3705190010368824, + 0.0, + 0.2113368734717369, + 0.041068244725465775, + 1.1240378431975842, + 1.0211943238973618, + 1.0973635837435722, + 0.0435665100812912, + 0.10439491271972656, + 0.8682416789233685, + 0.4539233595132828, + 0.3694361299276352, + 0.16648531705141068, + 0.12873568013310432, + 1.4249354042112827, + 0.3341543860733509, + 0.037206389009952545, + 0.0336175411939621, + 0.16178280487656593, + 0.07268388196825981, + 1.3037826362997293, + 2.538699481636286, + 0.03735022246837616, + 1.3100720401853323, + 0.3044300340116024, + 0.36968011781573296, + 0.0, + 1.2412673570215702, + 0.29323237761855125, + 2.453176263719797, + 1.5719126407057047, + 0.0, + 0.5958008207380772, + 0.6979749351739883, + 0.052801311016082764, + 0.7632507290691137, + 0.5093391947448254, + 0.5844341609627008, + 0.041068460792303085, + 0.2454693354666233, + 1.344995990395546, + 0.40090976655483246, + 0.2677394449710846, + 0.7981795221567154, + 2.0935777574777603, + 0.695551760494709, + 0.0, + 0.5629338324069977, + 0.05264982208609581, + 3.908183880150318, + 1.7434580735862255, + 0.4795207977294922, + 0.1929398477077484, + 1.5773803554475307, + 0.386084359139204, + 0.7107036020606756, + 0.42987366393208504 + ], + "unique_experts": 60, + "load_cv": 0.9350363347339264, + "normalized_load_entropy": 0.9022857785239654, + "max_load_share": 0.0770440251572327 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "ffe0561a2be8bb86b6de5876ae387e3c200b61619fff43f78383d3b4b0b6858a", + "route_weight_sha256": "a9e730075a1ddc4553e18f579ec491d833721f08a215b53a216967d1ece5623c", + "loads": [ + 21, + 10, + 7, + 22, + 14, + 12, + 4, + 7, + 7, + 6, + 12, + 21, + 12, + 13, + 2, + 2, + 12, + 15, + 7, + 11, + 2, + 24, + 11, + 13, + 6, + 13, + 6, + 25, + 30, + 1, + 25, + 11, + 6, + 3, + 21, + 16, + 28, + 23, + 4, + 12, + 16, + 15, + 17, + 9, + 16, + 14, + 23, + 19, + 12, + 11, + 15, + 29, + 10, + 3, + 13, + 5, + 54, + 28, + 10, + 9, + 24, + 8, + 16, + 9 + ], + "weighted_loads": [ + 1.2766922730952501, + 0.6880919858813286, + 0.43315858393907547, + 1.199748508632183, + 0.985780481249094, + 1.0319776311516762, + 0.20721051841974258, + 0.3705190010368824, + 0.42149077728390694, + 0.302474495023489, + 1.1207666508853436, + 1.2207547016441822, + 1.0688892733305693, + 1.2357598850503564, + 0.08332832157611847, + 0.10439491271972656, + 0.9140985682606697, + 0.5948064588010311, + 0.3694361299276352, + 1.1197153441607952, + 0.12873568013310432, + 1.5511385351419449, + 0.985854234546423, + 0.9924056716263294, + 0.2216244377195835, + 0.6849364191293716, + 0.3266988843679428, + 1.3167805476114154, + 2.965208437293768, + 0.03735022246837616, + 1.5175154190510511, + 0.4497224260121584, + 0.36968011781573296, + 0.2217627316713333, + 1.5441887844353914, + 1.0845365561544895, + 2.453176263719797, + 1.7146311607211828, + 0.19507833942770958, + 0.7145028598606586, + 1.0975546203553677, + 1.5182135105133057, + 0.8551950473338366, + 0.5093391947448254, + 0.7523493086919188, + 1.3262595608830452, + 1.9841720089316368, + 1.344995990395546, + 0.8614576272666454, + 0.5968492217361927, + 1.0551597904413939, + 2.1269485615193844, + 0.695551760494709, + 0.15241997689008713, + 0.6035381779074669, + 0.24423444271087646, + 4.141378030180931, + 1.7434580735862255, + 0.7922900766134262, + 0.37878306582570076, + 1.5773803554475307, + 0.4236394613981247, + 0.8683653827756643, + 0.465859729796648 + ], + "unique_experts": 64, + "load_cv": 0.6500900856113115, + "normalized_load_entropy": 0.9528395087045427, + "max_load_share": 0.061224489795918366 + } + }, + "s0_x": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "069fd19d32582ff191795c1e32667ec0fd80930ccb56bf88bfd580a8c21caf2f", + "route_weight_sha256": "1f3b2d745af5216b688f8550a4870c7834921363a4e93688f9278be1f92bdce6", + "loads": [ + 10, + 5, + 6, + 24, + 12, + 12, + 5, + 8, + 0, + 4, + 1, + 20, + 10, + 9, + 0, + 2, + 11, + 11, + 5, + 3, + 2, + 22, + 5, + 3, + 3, + 5, + 2, + 25, + 24, + 1, + 22, + 5, + 8, + 0, + 15, + 4, + 27, + 20, + 0, + 9, + 11, + 1, + 15, + 10, + 11, + 1, + 3, + 19, + 5, + 6, + 10, + 28, + 10, + 0, + 13, + 0, + 49, + 26, + 5, + 5, + 23, + 7, + 11, + 7 + ], + "weighted_loads": [ + 0.5106133222579956, + 0.38207951188087463, + 0.3869696855545044, + 1.271904805675149, + 0.7067273296415806, + 1.0019640922546387, + 0.2493809536099434, + 0.4228327125310898, + 0.0, + 0.20908772945404053, + 0.041428592056035995, + 1.163780014961958, + 1.0262910909950733, + 1.100190881639719, + 0.0, + 0.10517996922135353, + 0.8554550036787987, + 0.41593386232852936, + 0.29188647121191025, + 0.20863833650946617, + 0.130681574344635, + 1.4859788827598095, + 0.2277512401342392, + 0.11212870851159096, + 0.11068025976419449, + 0.23395298421382904, + 0.0722646713256836, + 1.351436235010624, + 2.5310029052197933, + 0.0364890992641449, + 1.2908311001956463, + 0.2456342838704586, + 0.4486507326364517, + 0.0, + 1.2314926460385323, + 0.296736691147089, + 2.4162227399647236, + 1.5656987950205803, + 0.0, + 0.5544421281665564, + 0.7263158466666937, + 0.055945150554180145, + 0.7775563672184944, + 0.5575565062463284, + 0.5472933240234852, + 0.0401550829410553, + 0.2357584573328495, + 1.3785500451922417, + 0.4042087495326996, + 0.2649693265557289, + 0.7987129837274551, + 2.0513925440609455, + 0.7048689387738705, + 0.0, + 0.6069116294384003, + 0.0, + 3.873212307691574, + 1.6654824987053871, + 0.4749627411365509, + 0.1930813044309616, + 1.5540751479566097, + 0.3982780873775482, + 0.6163125857710838, + 0.3938230462372303 + ], + "unique_experts": 58, + "load_cv": 0.9316459003823399, + "normalized_load_entropy": 0.9025288300312965, + "max_load_share": 0.0770440251572327 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "391e945ad2260e64d1410e40a9d0e37a0e69b16a6a21fa5f30cbe24fa0bc2c30", + "route_weight_sha256": "8aec9d38ae6becf6629a714f4a9f78d60fd96c1d61fbb59a54e55e51e0b985f3", + "loads": [ + 19, + 8, + 6, + 24, + 14, + 12, + 5, + 8, + 2, + 4, + 13, + 20, + 12, + 13, + 0, + 2, + 13, + 12, + 5, + 12, + 2, + 22, + 9, + 7, + 7, + 8, + 2, + 26, + 24, + 1, + 24, + 10, + 8, + 0, + 25, + 10, + 27, + 20, + 3, + 9, + 11, + 10, + 15, + 10, + 14, + 8, + 15, + 19, + 8, + 6, + 15, + 29, + 10, + 3, + 13, + 5, + 53, + 26, + 7, + 10, + 23, + 7, + 13, + 8 + ], + "weighted_loads": [ + 1.21633305773139, + 0.628783106803894, + 0.3869696855545044, + 1.271904805675149, + 0.9339409805834293, + 1.0019640922546387, + 0.2493809536099434, + 0.4228327125310898, + 0.09500579535961151, + 0.20908772945404053, + 1.362064179033041, + 1.163780014961958, + 1.0722355023026466, + 1.2344000907614827, + 0.0, + 0.10517996922135353, + 0.9328885450959206, + 0.45854421705007553, + 0.29188647121191025, + 1.0730752013623714, + 0.130681574344635, + 1.4859788827598095, + 0.8782240506261587, + 0.4672487638890743, + 0.27628573402762413, + 0.45905542746186256, + 0.0722646713256836, + 1.36443414632231, + 2.5310029052197933, + 0.0364890992641449, + 1.3855131641030312, + 0.43151321075856686, + 0.4486507326364517, + 0.0, + 1.818405730649829, + 0.7385038509964943, + 2.4162227399647236, + 1.5656987950205803, + 0.12816281989216805, + 0.5544421281665564, + 0.7263158466666937, + 0.969321645796299, + 0.7775563672184944, + 0.5575565062463284, + 0.8090015025809407, + 0.5992555543780327, + 1.1545952931046486, + 1.3785500451922417, + 0.6305516697466373, + 0.2649693265557289, + 1.054214932024479, + 2.0854987166821957, + 0.7048689387738705, + 0.11835422180593014, + 0.6069116294384003, + 0.2385825589299202, + 4.07913775742054, + 1.6654824987053871, + 0.624477069824934, + 0.40832655504345894, + 1.5540751479566097, + 0.3982780873775482, + 0.6721748281270266, + 0.4300448074936867 + ], + "unique_experts": 62, + "load_cv": 0.7324665156512737, + "normalized_load_entropy": 0.9399296830171949, + "max_load_share": 0.06743002544529263 + } + }, + "s1_x": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "ce7e4bdd21f6850af35e526dd4867ebc1c09e32e02b13cfc9a5e980fc69b255a", + "route_weight_sha256": "2f3c79d431976c1e56ce63946e02a60f2939d08d623109949a119284b0f15e38", + "loads": [ + 12, + 5, + 7, + 22, + 10, + 12, + 5, + 8, + 0, + 4, + 1, + 18, + 10, + 9, + 1, + 2, + 11, + 10, + 5, + 2, + 3, + 21, + 5, + 1, + 1, + 7, + 2, + 18, + 24, + 1, + 23, + 8, + 7, + 0, + 16, + 4, + 28, + 20, + 0, + 10, + 11, + 1, + 15, + 10, + 14, + 1, + 3, + 19, + 5, + 6, + 10, + 29, + 10, + 0, + 12, + 0, + 49, + 26, + 5, + 5, + 25, + 7, + 12, + 8 + ], + "weighted_loads": [ + 0.5707601364701986, + 0.37110190838575363, + 0.4173832833766937, + 1.1687966734170914, + 0.6283840164542198, + 1.0003322139382362, + 0.24470912665128708, + 0.4171042777597904, + 0.0, + 0.21095608174800873, + 0.04087765887379646, + 1.061150200664997, + 1.0206591337919235, + 1.074391845613718, + 0.04037593677639961, + 0.10269991680979729, + 0.877045039087534, + 0.388701593503356, + 0.28372209519147873, + 0.17809858918190002, + 0.15890906564891338, + 1.4140695482492447, + 0.25642338022589684, + 0.035762969404459, + 0.032857175916433334, + 0.28204955719411373, + 0.06958120688796043, + 1.0487977601587772, + 2.4915182515978813, + 0.038996241986751556, + 1.3300355486571789, + 0.340493131428957, + 0.39372080005705357, + 0.0, + 1.2648960724473, + 0.29295065626502037, + 2.420261148363352, + 1.5277083050459623, + 0.0, + 0.5722001977264881, + 0.7251163311302662, + 0.051507510244846344, + 0.7552066762000322, + 0.5393820218741894, + 0.6753326617181301, + 0.03992544487118721, + 0.2508889473974705, + 1.3337572403252125, + 0.4021746888756752, + 0.2620178945362568, + 0.797183521091938, + 2.113524381071329, + 0.7027111202478409, + 0.0, + 0.5625940784811974, + 0.0, + 3.957140553742647, + 1.6432826276868582, + 0.47985491901636124, + 0.19199199602007866, + 1.6087134219706059, + 0.39162665978074074, + 0.6216004602611065, + 0.42924875020980835 + ], + "unique_experts": 59, + "load_cv": 0.9234580722063009, + "normalized_load_entropy": 0.9036516235893011, + "max_load_share": 0.0770440251572327 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "1288730c889014ff0b09e32fc782d12ebd24a5fd33bcf754187ad6f7dea6daa3", + "route_weight_sha256": "a3218e6ccf4a303df54ad903cf5019cbdda9259c564dd787e312f17efb969576", + "loads": [ + 26, + 10, + 7, + 22, + 12, + 12, + 5, + 8, + 8, + 6, + 13, + 20, + 12, + 12, + 2, + 2, + 13, + 11, + 5, + 12, + 3, + 24, + 9, + 13, + 6, + 17, + 7, + 19, + 30, + 1, + 26, + 12, + 7, + 3, + 23, + 15, + 28, + 23, + 5, + 12, + 17, + 15, + 17, + 10, + 17, + 12, + 22, + 19, + 12, + 11, + 13, + 30, + 10, + 2, + 13, + 5, + 54, + 26, + 10, + 10, + 25, + 8, + 14, + 9 + ], + "weighted_loads": [ + 1.5593814570456743, + 0.6794366836547852, + 0.4173832833766937, + 1.1687966734170914, + 0.8793640732765198, + 1.0003322139382362, + 0.24470912665128708, + 0.4171042777597904, + 0.4631164036691189, + 0.3020937032997608, + 1.2800973914563656, + 1.1578670591115952, + 1.068354083225131, + 1.162282650358975, + 0.08013774827122688, + 0.10269991680979729, + 0.9633544906973839, + 0.4444978553801775, + 0.28372209519147873, + 1.1774854399263859, + 0.15890906564891338, + 1.5402726791799068, + 0.9074082337319851, + 0.9927613288164139, + 0.22086407244205475, + 0.831693259999156, + 0.36982613801956177, + 1.0617956714704633, + 2.9180272072553635, + 0.038996241986751556, + 1.5361990891397, + 0.485785523429513, + 0.39372080005705357, + 0.2217627316713333, + 1.6276069302111864, + 1.049118049442768, + 2.420261148363352, + 1.6704268250614405, + 0.24389242008328438, + 0.6831768788397312, + 1.1246960163116455, + 1.4354179166257381, + 0.8471509944647551, + 0.5393820218741894, + 0.8050634386017919, + 0.9943377561867237, + 1.8628142848610878, + 1.3337572403252125, + 0.8808345831930637, + 0.5911276713013649, + 0.978221133351326, + 2.146895185112953, + 0.7027111202478409, + 0.09955780580639839, + 0.6031984239816666, + 0.23766210675239563, + 4.19033470377326, + 1.6432826276868582, + 0.7807943969964981, + 0.43088123574852943, + 1.6087134219706059, + 0.4291817620396614, + 0.7792622409760952, + 0.46523481607437134 + ], + "unique_experts": 64, + "load_cv": 0.6484428216702406, + "normalized_load_entropy": 0.9535127742504544, + "max_load_share": 0.061224489795918366 + } + }, + "s0_period": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "a695bb4a51ad1df8ab7a0f873a60763a7a13913bf73cc0d6e38c192734e79f47", + "route_weight_sha256": "70863320e2de8683a63d94248a7965fb7b82c333834fc71782d2e011729a479c", + "loads": [ + 11, + 5, + 7, + 24, + 12, + 11, + 7, + 9, + 0, + 4, + 1, + 19, + 10, + 9, + 1, + 2, + 11, + 11, + 6, + 3, + 2, + 22, + 5, + 3, + 3, + 5, + 2, + 22, + 24, + 1, + 22, + 4, + 8, + 0, + 15, + 4, + 28, + 20, + 0, + 9, + 11, + 1, + 14, + 11, + 11, + 1, + 3, + 20, + 5, + 6, + 10, + 28, + 10, + 0, + 13, + 0, + 48, + 25, + 5, + 5, + 23, + 7, + 10, + 7 + ], + "weighted_loads": [ + 0.5480893272906542, + 0.38112127035856247, + 0.42395687103271484, + 1.2596249803900719, + 0.7038081735372543, + 0.9641630202531815, + 0.316324844956398, + 0.4714205265045166, + 0.0, + 0.20977578684687614, + 0.04121742025017738, + 1.123274352401495, + 1.0379169397056103, + 1.1079878360033035, + 0.04351182281970978, + 0.10655363276600838, + 0.852978989481926, + 0.4124521780759096, + 0.3350730501115322, + 0.21007641404867172, + 0.12959839776158333, + 1.4899327047169209, + 0.22900673188269138, + 0.11325579136610031, + 0.11235059797763824, + 0.22667516767978668, + 0.07385382428765297, + 1.2421753946691751, + 2.5247808173298836, + 0.03745255619287491, + 1.2868620995432138, + 0.2017625942826271, + 0.44719529151916504, + 0.0, + 1.2429527007043362, + 0.29507991671562195, + 2.4489673376083374, + 1.5620990321040154, + 0.0, + 0.5622700974345207, + 0.7292109988629818, + 0.055659253150224686, + 0.7368825413286686, + 0.5957050397992134, + 0.5433744862675667, + 0.04063011333346367, + 0.21553417667746544, + 1.4202633649110794, + 0.4025614261627197, + 0.2669408656656742, + 0.8201492577791214, + 2.040912240743637, + 0.6960475817322731, + 0.0, + 0.6018197610974312, + 0.0, + 3.844039961695671, + 1.61167704872787, + 0.4772597774863243, + 0.19442368671298027, + 1.5462866947054863, + 0.39453016221523285, + 0.5711376555263996, + 0.3928634561598301 + ], + "unique_experts": 59, + "load_cv": 0.913812887366643, + "normalized_load_entropy": 0.9060274927681491, + "max_load_share": 0.07547169811320754 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "48677f6a7eb17e86b83179bd693457785d65be6cea099fada96f830ae3efef3d", + "route_weight_sha256": "7e46f9bea7b5d29ca815b3365ca06d16f0c896e74cf18f6d3b44722179549f8e", + "loads": [ + 20, + 8, + 7, + 24, + 14, + 11, + 7, + 9, + 2, + 4, + 13, + 19, + 12, + 12, + 1, + 2, + 12, + 13, + 6, + 12, + 2, + 22, + 9, + 7, + 7, + 7, + 2, + 23, + 24, + 1, + 24, + 9, + 8, + 0, + 25, + 11, + 28, + 20, + 3, + 9, + 11, + 11, + 14, + 11, + 14, + 8, + 16, + 20, + 8, + 6, + 15, + 29, + 10, + 2, + 13, + 5, + 53, + 25, + 7, + 9, + 23, + 7, + 12, + 8 + ], + "weighted_loads": [ + 1.2217383068054914, + 0.6234131678938866, + 0.42395687103271484, + 1.2596249803900719, + 0.9304529428482056, + 0.9641630202531815, + 0.316324844956398, + 0.4714205265045166, + 0.09500579535961151, + 0.20977578684687614, + 1.3062917329370975, + 1.123274352401495, + 1.0838613510131836, + 1.2072499999776483, + 0.04351182281970978, + 0.10655363276600838, + 0.8940989896655083, + 0.5066960323601961, + 0.3350730501115322, + 1.074513278901577, + 0.12959839776158333, + 1.4899327047169209, + 0.8819123469293118, + 0.46945832297205925, + 0.2779560722410679, + 0.40333767235279083, + 0.07385382428765297, + 1.2551733059808612, + 2.5247808173298836, + 0.03745255619287491, + 1.38718824647367, + 0.38764152117073536, + 0.44719529151916504, + 0.0, + 1.7908802684396505, + 0.7735564708709717, + 2.4489673376083374, + 1.5620990321040154, + 0.12814849615097046, + 0.5622700974345207, + 0.7292109988629818, + 1.0184058994054794, + 0.7368825413286686, + 0.5957050397992134, + 0.8050826648250222, + 0.6156498715281487, + 1.2507632076740265, + 1.4202633649110794, + 0.6305159144103527, + 0.2669408656656742, + 1.0771705694496632, + 2.0750184133648872, + 0.6960475817322731, + 0.07586542703211308, + 0.6018197610974312, + 0.24417820572853088, + 4.088650614023209, + 1.61167704872787, + 0.6318313218653202, + 0.3695809803903103, + 1.5462866947054863, + 0.39453016221523285, + 0.6269998978823423, + 0.42908521741628647 + ], + "unique_experts": 63, + "load_cv": 0.7250747641579695, + "normalized_load_entropy": 0.9417832467160528, + "max_load_share": 0.06743002544529263 + } + }, + "s1_period": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "3a82fbe145e5fe9b4955634bf20a5836836fd7cc77735f82032d70b66d0d444c", + "route_weight_sha256": "44f98fc547808a7c9e811417ed702f7aab3aa96a5b468f7bd7c4a1e4b9c6981f", + "loads": [ + 9, + 5, + 7, + 23, + 11, + 12, + 5, + 8, + 0, + 4, + 1, + 18, + 10, + 8, + 1, + 2, + 11, + 11, + 6, + 2, + 3, + 21, + 7, + 1, + 2, + 7, + 2, + 19, + 24, + 1, + 21, + 7, + 6, + 0, + 16, + 4, + 27, + 20, + 0, + 10, + 11, + 1, + 15, + 11, + 11, + 1, + 3, + 19, + 5, + 6, + 10, + 30, + 10, + 0, + 12, + 0, + 50, + 27, + 5, + 5, + 25, + 7, + 12, + 8 + ], + "weighted_loads": [ + 0.46725403890013695, + 0.37274646013975143, + 0.42480452358722687, + 1.2137911226600409, + 0.6570554301142693, + 0.9943695850670338, + 0.2438679151237011, + 0.4239871948957443, + 0.0, + 0.20955456979572773, + 0.040502745658159256, + 1.0712973307818174, + 1.0225944519042969, + 1.0401389114558697, + 0.04223359376192093, + 0.10346551239490509, + 0.8716466352343559, + 0.429774709045887, + 0.3304305151104927, + 0.17734839767217636, + 0.16048909723758698, + 1.4210396483540535, + 0.323279295116663, + 0.03572099655866623, + 0.06244990602135658, + 0.277244932949543, + 0.0710616409778595, + 1.0786410216242075, + 2.497328646481037, + 0.03876982629299164, + 1.2566742934286594, + 0.3071954492479563, + 0.3638368770480156, + 0.0, + 1.2540699914097786, + 0.29590631648898125, + 2.364352535456419, + 1.5356372240930796, + 0.0, + 0.5849365573376417, + 0.7276809699833393, + 0.05361120402812958, + 0.759190509095788, + 0.578103419393301, + 0.5551807545125484, + 0.0403064526617527, + 0.23684043064713478, + 1.3545545730739832, + 0.40173422545194626, + 0.26927465572953224, + 0.7862341683357954, + 2.1490702889859676, + 0.6975716762244701, + 0.0, + 0.5596262812614441, + 0.0, + 3.97608183324337, + 1.6809865031391382, + 0.480484701693058, + 0.19259146228432655, + 1.6107181794941425, + 0.38323158398270607, + 0.6245381869375706, + 0.43442418053746223 + ], + "unique_experts": 59, + "load_cv": 0.9292652361935297, + "normalized_load_entropy": 0.9039625835651564, + "max_load_share": 0.07861635220125786 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "c32209eabb833cd3dac0733a440dd1970a16aa52aa7700074e620d0ddd770b9b", + "route_weight_sha256": "8da08eab3473f254d2d6b2cd642fc77021539600307c2523e84c296f2481d4ac", + "loads": [ + 22, + 10, + 7, + 23, + 13, + 12, + 5, + 8, + 7, + 6, + 13, + 20, + 12, + 12, + 2, + 2, + 12, + 13, + 6, + 11, + 3, + 24, + 11, + 13, + 7, + 17, + 6, + 20, + 30, + 1, + 24, + 11, + 6, + 3, + 22, + 16, + 27, + 23, + 5, + 11, + 17, + 16, + 17, + 11, + 14, + 11, + 25, + 19, + 12, + 11, + 13, + 31, + 10, + 3, + 13, + 5, + 56, + 27, + 10, + 9, + 25, + 8, + 14, + 9 + ], + "weighted_loads": [ + 1.3507398255169392, + 0.6824963018298149, + 0.42480452358722687, + 1.2137911226600409, + 0.9086490273475647, + 0.9943695850670338, + 0.2438679151237011, + 0.4239871948957443, + 0.42149077728390694, + 0.3006921913474798, + 1.1909548304975033, + 1.1680141892284155, + 1.0702894013375044, + 1.1616430478170514, + 0.0819954052567482, + 0.10346551239490509, + 0.9175035245716572, + 0.537656158208847, + 0.3304305151104927, + 1.130578424781561, + 0.16048909723758698, + 1.5472427792847157, + 0.9769745245575905, + 0.9740129187703133, + 0.250456802546978, + 0.8450004458427429, + 0.3250766433775425, + 1.0916389329358935, + 2.9238376021385193, + 0.03876982629299164, + 1.4695563651621342, + 0.45248784124851227, + 0.3638368770480156, + 0.2217627316713333, + 1.5569914188235998, + 1.1039340049028397, + 2.364352535456419, + 1.6783557441085577, + 0.2585763521492481, + 0.6519205551594496, + 1.1272606551647186, + 1.5057466924190521, + 0.8511348273605108, + 0.578103419393301, + 0.6849115313962102, + 0.9305629581212997, + 2.127091407775879, + 1.3545545730739832, + 0.8784240297973156, + 0.5983844324946404, + 0.9641978461295366, + 2.1824410930275917, + 0.6975716762244701, + 0.1495121419429779, + 0.6002306267619133, + 0.23866800591349602, + 4.252326223999262, + 1.6809865031391382, + 0.7916205674409866, + 0.3784346804022789, + 1.6107181794941425, + 0.42078668624162674, + 0.7821999676525593, + 0.4704102464020252 + ], + "unique_experts": 64, + "load_cv": 0.6561364668787465, + "normalized_load_entropy": 0.9533539827416604, + "max_load_share": 0.06349206349206349 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 106, + "ordered_topk_exact_tokens": 84, + "set_exact_tokens": 90, + "mean_set_jaccard": 0.9568733153638815, + "mean_token_weighted_tv": 0.010755419037041237, + "aggregate_load_tv": 0.01729559748427673 + }, + "system_bos": { + "tokens": 106, + "ordered_topk_exact_tokens": 70, + "set_exact_tokens": 79, + "mean_set_jaccard": 0.9272237196765499, + "mean_token_weighted_tv": 0.017238900917670073, + "aggregate_load_tv": 0.02515723270440251 + }, + "system_x": { + "tokens": 106, + "ordered_topk_exact_tokens": 60, + "set_exact_tokens": 75, + "mean_set_jaccard": 0.9144204851752021, + "mean_token_weighted_tv": 0.019788711762301764, + "aggregate_load_tv": 0.03459119496855345 + }, + "system_period": { + "tokens": 106, + "ordered_topk_exact_tokens": 52, + "set_exact_tokens": 67, + "mean_set_jaccard": 0.8928571428571428, + "mean_token_weighted_tv": 0.022434309010727786, + "aggregate_load_tv": 0.03616352201257861 + }, + "bos_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 68, + "set_exact_tokens": 75, + "mean_set_jaccard": 0.910377358490566, + "mean_token_weighted_tv": 0.02031400094230501, + "aggregate_load_tv": 0.03616352201257861 + }, + "bos_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 66, + "set_exact_tokens": 73, + "mean_set_jaccard": 0.9090296495956873, + "mean_token_weighted_tv": 0.020912425864909618, + "aggregate_load_tv": 0.03616352201257861 + }, + "x_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 66, + "set_exact_tokens": 75, + "mean_set_jaccard": 0.910377358490566, + "mean_token_weighted_tv": 0.020711325618596572, + "aggregate_load_tv": 0.029874213836477984 + }, + "x_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 53, + "set_exact_tokens": 62, + "mean_set_jaccard": 0.8753369272237197, + "mean_token_weighted_tv": 0.027207444878822228, + "aggregate_load_tv": 0.047169811320754707 + }, + "period_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 70, + "set_exact_tokens": 79, + "mean_set_jaccard": 0.9211590296495956, + "mean_token_weighted_tv": 0.01961736682415852, + "aggregate_load_tv": 0.02987421383647798 + }, + "period_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 55, + "set_exact_tokens": 64, + "mean_set_jaccard": 0.8827493261455527, + "mean_token_weighted_tv": 0.02624876061805858, + "aggregate_load_tv": 0.040880503144654086 + } + } + }, + "layer_10": { + "layer": 10, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "6d6df128bc7a9c388ef211e88c1425d3d7cd6719d80ceb61de1af27fcc5fa385", + "route_weight_sha256": "f170c1c9d1318243b250985bec1202a649c3c940dcfbda883f1c11268a2598b1", + "loads": [ + 1, + 6, + 11, + 0, + 12, + 16, + 1, + 76, + 13, + 7, + 10, + 6, + 0, + 2, + 14, + 11, + 8, + 0, + 7, + 11, + 6, + 44, + 5, + 12, + 10, + 13, + 26, + 2, + 9, + 6, + 2, + 13, + 1, + 21, + 6, + 15, + 4, + 2, + 24, + 1, + 1, + 1, + 9, + 37, + 0, + 5, + 4, + 12, + 2, + 10, + 1, + 0, + 20, + 5, + 8, + 3, + 19, + 8, + 15, + 1, + 6, + 10, + 9, + 16 + ], + "weighted_loads": [ + 0.04237937927246094, + 0.5411389842629433, + 0.6573456525802612, + 0.0, + 1.2894918397068977, + 0.9701553545892239, + 0.037234362214803696, + 5.851094916462898, + 0.939504973590374, + 0.3934359010308981, + 0.5966593883931637, + 0.6015142537653446, + 0.0, + 0.08020957559347153, + 0.8979637660086155, + 0.6306700557470322, + 0.4009768180549145, + 0.0, + 0.6965558677911758, + 0.8302815668284893, + 0.3424658700823784, + 3.6131395250558853, + 0.17694320529699326, + 0.6256700754165649, + 0.7227849550545216, + 1.2734690271317959, + 2.159035872668028, + 0.07414437457919121, + 0.6230178736150265, + 0.47995834052562714, + 0.12508642300963402, + 0.9300293549895287, + 0.05445748567581177, + 1.0378010496497154, + 0.46358758211135864, + 0.9193320386111736, + 0.24781450256705284, + 0.24338586628437042, + 1.533714983612299, + 0.05185836926102638, + 0.03371048346161842, + 0.04458838701248169, + 0.6963666081428528, + 1.955309521406889, + 0.0, + 0.20262622088193893, + 0.2122106496244669, + 1.1475247517228127, + 0.12453718855977058, + 0.5766106769442558, + 0.02895352616906166, + 0.0, + 1.3481962233781815, + 0.3325672447681427, + 0.5019224714487791, + 0.1705891750752926, + 1.3301734328269958, + 0.6984659619629383, + 0.898040659725666, + 0.03964560478925705, + 0.37426167726516724, + 0.6453512161970139, + 0.524958398193121, + 0.8357304446399212 + ], + "unique_experts": 59, + "load_cv": 1.1911723879299345, + "normalized_load_entropy": 0.8776443038915314, + "max_load_share": 0.11949685534591195 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "9cc13f865d28ed853ac318f9950716697355c5edfdc3c3b44c50046e8bf27b1d", + "route_weight_sha256": "e68aa0326ab5a21e274dfa39b398e8304ecb6726355edf89550ae00577e0abc4", + "loads": [ + 1, + 6, + 13, + 0, + 12, + 16, + 1, + 80, + 13, + 9, + 12, + 7, + 1, + 5, + 16, + 11, + 8, + 3, + 14, + 13, + 9, + 46, + 6, + 12, + 10, + 16, + 26, + 8, + 10, + 7, + 6, + 14, + 1, + 29, + 7, + 16, + 4, + 2, + 24, + 1, + 1, + 11, + 13, + 39, + 4, + 7, + 10, + 16, + 2, + 12, + 3, + 5, + 20, + 6, + 8, + 12, + 19, + 14, + 15, + 15, + 11, + 23, + 9, + 16 + ], + "weighted_loads": [ + 0.04237937927246094, + 0.5411389842629433, + 0.6764615518040955, + 0.0, + 1.2894918397068977, + 0.9701553545892239, + 0.037234362214803696, + 6.028269298374653, + 0.939504973590374, + 0.418023057281971, + 0.6920301765203476, + 0.6498682834208012, + 0.032807640731334686, + 1.4944849722087383, + 1.0325930714607239, + 0.6306700557470322, + 0.4009768180549145, + 0.18482903391122818, + 1.082031627651304, + 0.9247364215552807, + 0.45470738410949707, + 3.697250511497259, + 0.18071568105369806, + 0.6256700754165649, + 0.7227849550545216, + 1.3863629661500454, + 2.159035872668028, + 0.8674252592027187, + 0.6693758107721806, + 0.522886399179697, + 0.4939884655177593, + 0.9437987543642521, + 0.05445748567581177, + 1.4314476028084755, + 0.4934810120612383, + 0.9563792459666729, + 0.24781450256705284, + 0.24338586628437042, + 1.533714983612299, + 0.05185836926102638, + 0.03371048346161842, + 0.9756435826420784, + 0.8092512805014849, + 2.0522204898297787, + 0.21025227382779121, + 0.30714789777994156, + 0.4813896920531988, + 1.4050840716809034, + 0.12453718855977058, + 0.6688361875712872, + 0.12386935576796532, + 0.26402899622917175, + 1.3481962233781815, + 0.40857987850904465, + 0.5019224714487791, + 0.8358480706810951, + 1.3301734328269958, + 1.0435514189302921, + 0.898040659725666, + 0.9376296661794186, + 0.7149884589016438, + 1.7754898555576801, + 0.524958398193121, + 0.8357304446399212 + ], + "unique_experts": 63, + "load_cv": 0.9809581084231527, + "normalized_load_entropy": 0.915254820697597, + "max_load_share": 0.10178117048346055 + } + }, + "s1_eos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "29041a0bce3a633e0cfff6df765fed70831243673a41abc18789c64fab0bbf71", + "route_weight_sha256": "b3a2297bd0277172a755799a38b0bcfad6bb70d5cf5aac4fb82c06afa7a96e10", + "loads": [ + 1, + 6, + 11, + 0, + 12, + 16, + 1, + 78, + 13, + 6, + 10, + 6, + 0, + 1, + 14, + 11, + 8, + 0, + 7, + 12, + 6, + 44, + 4, + 12, + 11, + 12, + 26, + 2, + 9, + 6, + 2, + 13, + 2, + 21, + 6, + 15, + 4, + 2, + 25, + 1, + 1, + 1, + 8, + 37, + 0, + 5, + 3, + 12, + 2, + 11, + 1, + 0, + 20, + 5, + 7, + 3, + 19, + 8, + 15, + 1, + 6, + 10, + 9, + 16 + ], + "weighted_loads": [ + 0.04190649464726448, + 0.5238684415817261, + 0.6682788617908955, + 0.0, + 1.2976085506379604, + 1.0045651532709599, + 0.03691909834742546, + 5.870639530941844, + 0.9374528117477894, + 0.34938038513064384, + 0.6000647619366646, + 0.6017383933067322, + 0.0, + 0.03903038427233696, + 0.9061056636273861, + 0.6269809529185295, + 0.413629699498415, + 0.0, + 0.692159540951252, + 0.8849710375070572, + 0.3444915860891342, + 3.5520248971879482, + 0.14323486760258675, + 0.6239887773990631, + 0.7659980095922947, + 1.2545484378933907, + 2.1434317901730537, + 0.07312945276498795, + 0.6253544986248016, + 0.4810640960931778, + 0.12633583694696426, + 0.9262632131576538, + 0.09737049788236618, + 1.0079724602401257, + 0.4725538641214371, + 0.929960336536169, + 0.24958141148090363, + 0.2449643835425377, + 1.5819915942847729, + 0.05421824008226395, + 0.033020537346601486, + 0.04429614916443825, + 0.6516555659472942, + 1.9754853304475546, + 0.0, + 0.20666027069091797, + 0.1730900164693594, + 1.1180950440466404, + 0.12378698959946632, + 0.6317489258944988, + 0.027636604383587837, + 0.0, + 1.3554360531270504, + 0.3343459442257881, + 0.47796571627259254, + 0.1750631295144558, + 1.324964839965105, + 0.6983473114669323, + 0.8860760405659676, + 0.036290060728788376, + 0.37761399522423744, + 0.6502956673502922, + 0.5228557847440243, + 0.8318619430065155 + ], + "unique_experts": 59, + "load_cv": 1.2132823710017189, + "normalized_load_entropy": 0.8747222773232891, + "max_load_share": 0.12264150943396226 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "99dcf6d3f9d825d20e70592488f103e7766a711352ba49377a966c55efa03045", + "route_weight_sha256": "77bf3114ee8bbe4d6355d59496e883966b28894348dde03dc7e8ffa93c1bc9ea", + "loads": [ + 1, + 6, + 14, + 0, + 16, + 16, + 1, + 80, + 13, + 8, + 12, + 9, + 4, + 3, + 17, + 11, + 8, + 5, + 13, + 14, + 7, + 46, + 5, + 12, + 12, + 15, + 28, + 22, + 9, + 9, + 12, + 14, + 7, + 37, + 8, + 17, + 6, + 5, + 26, + 1, + 2, + 17, + 12, + 39, + 3, + 10, + 9, + 16, + 10, + 14, + 4, + 13, + 21, + 7, + 7, + 15, + 20, + 15, + 15, + 21, + 16, + 21, + 9, + 17 + ], + "weighted_loads": [ + 0.04190649464726448, + 0.5238684415817261, + 0.727444785181433, + 0.0, + 1.4998337998986244, + 1.0045651532709599, + 0.03691909834742546, + 5.954510124400258, + 0.9374528117477894, + 0.37450399063527584, + 0.6781395860016346, + 0.7722992226481438, + 0.20108699798583984, + 1.4135893993079662, + 1.1108634285628796, + 0.6269809529185295, + 0.413629699498415, + 0.2981035076081753, + 1.056555730290711, + 0.9631233029067516, + 0.38491325452923775, + 3.638113606721163, + 0.1471561649814248, + 0.6239887773990631, + 0.8077810741961002, + 1.5845872517675161, + 2.2139522060751915, + 1.4755683485418558, + 0.6253544986248016, + 0.612981054931879, + 0.938111312687397, + 0.9400326125323772, + 0.5901520326733589, + 1.8241906203329563, + 0.6149022858589888, + 1.0934192836284637, + 0.3344799131155014, + 0.37164250016212463, + 1.6201590932905674, + 0.05421824008226395, + 0.07519777491688728, + 1.3473646976053715, + 0.7494641439989209, + 2.043528141453862, + 0.17765875905752182, + 0.4595945253968239, + 0.48982694186270237, + 1.3621466550976038, + 0.7738156132400036, + 0.8037190549075603, + 0.20727789215743542, + 0.7782944366335869, + 1.425062607973814, + 0.45305971056222916, + 0.47796571627259254, + 1.0670674294233322, + 1.3970027677714825, + 1.0961918234825134, + 0.8860760405659676, + 1.3470055423676968, + 1.1163851544260979, + 1.6391083672642708, + 0.5228557847440243, + 0.8681098818778992 + ], + "unique_experts": 63, + "load_cv": 0.8759734335857001, + "normalized_load_entropy": 0.929924252998302, + "max_load_share": 0.09070294784580499 + } + }, + "s0_bos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "27d170469fa0b18407a756148772dd325a556a1e936f9582f608e7272d47be26", + "route_weight_sha256": "e1e678a580a83b4ceb3d23588fe5d09b54b82947ab62500be372a154d6bebfe8", + "loads": [ + 1, + 6, + 11, + 0, + 12, + 15, + 1, + 75, + 13, + 7, + 9, + 6, + 0, + 1, + 14, + 11, + 8, + 0, + 8, + 10, + 7, + 43, + 2, + 14, + 13, + 12, + 26, + 2, + 11, + 6, + 1, + 12, + 2, + 21, + 6, + 15, + 3, + 2, + 26, + 1, + 1, + 1, + 9, + 34, + 0, + 5, + 5, + 12, + 2, + 10, + 1, + 0, + 22, + 5, + 8, + 4, + 20, + 8, + 15, + 1, + 6, + 7, + 8, + 19 + ], + "weighted_loads": [ + 0.03726743161678314, + 0.5452377907931805, + 0.6676652021706104, + 0.0, + 1.351277906447649, + 0.9199492000043392, + 0.03696514666080475, + 5.825392585247755, + 0.9391618594527245, + 0.42259417846798897, + 0.5426606126129627, + 0.5990216508507729, + 0.0, + 0.039193831384181976, + 0.9113842658698559, + 0.6561385989189148, + 0.37611253559589386, + 0.0, + 0.7324629947543144, + 0.7517605386674404, + 0.38299380242824554, + 3.5590568520128727, + 0.07036560773849487, + 0.6894786655902863, + 0.840693186968565, + 1.244887936860323, + 2.19901542365551, + 0.07503880560398102, + 0.7029905095696449, + 0.47665970027446747, + 0.07929620891809464, + 0.8826092090457678, + 0.10383507236838341, + 0.973208948969841, + 0.4528617635369301, + 0.9501051977276802, + 0.2085409164428711, + 0.25898537039756775, + 1.66993011161685, + 0.052473198622465134, + 0.03339865431189537, + 0.045721374452114105, + 0.7059625163674355, + 1.8536355253309011, + 0.0, + 0.20124678313732147, + 0.24857167527079582, + 1.188524629920721, + 0.11987797170877457, + 0.5868816897273064, + 0.029275692999362946, + 0.0, + 1.435118742287159, + 0.33898306638002396, + 0.49367342703044415, + 0.23320843651890755, + 1.3869737442582846, + 0.712375782430172, + 0.8875328674912453, + 0.07674910128116608, + 0.39017753675580025, + 0.508126650005579, + 0.48916234262287617, + 0.9643543735146523 + ], + "unique_experts": 59, + "load_cv": 1.1819716910477818, + "normalized_load_entropy": 0.8766141470803807, + "max_load_share": 0.1179245283018868 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "b6ab8ffb2ea14935dfb3fab9ffad1113f34967a809d7ce774a4b6f254f30fe50", + "route_weight_sha256": "cb72607880b766deefa514f75c77491bbc5b6de5da0569a07eda318280ad294f", + "loads": [ + 1, + 6, + 12, + 0, + 12, + 15, + 1, + 79, + 13, + 8, + 11, + 7, + 1, + 4, + 17, + 11, + 8, + 3, + 14, + 12, + 11, + 45, + 2, + 14, + 13, + 15, + 26, + 9, + 12, + 7, + 5, + 13, + 2, + 29, + 7, + 16, + 3, + 2, + 26, + 1, + 1, + 11, + 13, + 36, + 3, + 7, + 11, + 16, + 2, + 13, + 3, + 5, + 22, + 6, + 8, + 13, + 20, + 14, + 15, + 16, + 11, + 20, + 8, + 19 + ], + "weighted_loads": [ + 0.03726743161678314, + 0.5452377907931805, + 0.6818266483023763, + 0.0, + 1.351277906447649, + 0.9199492000043392, + 0.03696514666080475, + 6.00256696715951, + 0.9391618594527245, + 0.4388323873281479, + 0.6380314007401466, + 0.6473756805062294, + 0.032807640731334686, + 0.5861504673957825, + 1.0964610576629639, + 0.6561385989189148, + 0.37611253559589386, + 0.1947464495897293, + 1.1343564875423908, + 0.8478724099695683, + 0.5659008026123047, + 3.6431678384542465, + 0.07036560773849487, + 0.6894786655902863, + 0.840693186968565, + 1.3551020547747612, + 2.19901542365551, + 0.9659380093216896, + 0.749348446726799, + 0.5195877589285374, + 0.4460972473025322, + 0.8963786084204912, + 0.10383507236838341, + 1.3675944954156876, + 0.48275519348680973, + 0.9871524050831795, + 0.2085409164428711, + 0.25898537039756775, + 1.66993011161685, + 0.052473198622465134, + 0.03339865431189537, + 1.1733816862106323, + 0.8593569900840521, + 1.9505464937537909, + 0.19866793230175972, + 0.3057684600353241, + 0.5177507176995277, + 1.4662283342331648, + 0.11987797170877457, + 0.7579709775745869, + 0.1241915225982666, + 0.23833921924233437, + 1.435118742287159, + 0.41491229832172394, + 0.49367342703044415, + 0.925438180565834, + 1.3869737442582846, + 1.0574612393975258, + 0.8875328674912453, + 1.010627444833517, + 0.7280504032969475, + 1.6412811055779457, + 0.48916234262287617, + 0.9643543735146523 + ], + "unique_experts": 63, + "load_cv": 0.971513801557888, + "normalized_load_entropy": 0.9145817640824895, + "max_load_share": 0.1005089058524173 + } + }, + "s1_bos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "e448584f337c92a4bf9afe4a4fc0b1c050a499d847dc4d5d2ce8578401eab1a4", + "route_weight_sha256": "0ce2f98e3708984e59b09a7e985329590b9a85d4dd90bf80513aca5b88c4c58e", + "loads": [ + 1, + 6, + 11, + 0, + 12, + 15, + 1, + 77, + 12, + 6, + 10, + 6, + 0, + 1, + 14, + 11, + 9, + 0, + 8, + 9, + 8, + 43, + 3, + 11, + 12, + 12, + 26, + 2, + 10, + 6, + 1, + 14, + 2, + 19, + 6, + 14, + 3, + 2, + 25, + 1, + 1, + 1, + 8, + 36, + 0, + 6, + 5, + 12, + 2, + 10, + 1, + 0, + 20, + 4, + 7, + 4, + 22, + 8, + 17, + 2, + 6, + 9, + 9, + 17 + ], + "weighted_loads": [ + 0.03809859976172447, + 0.5303442180156708, + 0.6731289215385914, + 0.0, + 1.30003185197711, + 0.9537453912198544, + 0.03894782438874245, + 5.839565539732575, + 0.8670896664261818, + 0.3704075291752815, + 0.608794778585434, + 0.5883067212998867, + 0.0, + 0.041558463126420975, + 0.9087753929197788, + 0.6355477869510651, + 0.43468401581048965, + 0.0, + 0.732390683144331, + 0.7007213570177555, + 0.4416273981332779, + 3.524767480790615, + 0.10173126310110092, + 0.5876477733254433, + 0.8051579631865025, + 1.245587557554245, + 2.192319594323635, + 0.07227364555001259, + 0.6489626206457615, + 0.4782881885766983, + 0.08173100650310516, + 0.9499637223780155, + 0.09957748278975487, + 0.8890259061008692, + 0.44715138152241707, + 0.8908922113478184, + 0.20426061376929283, + 0.24449122697114944, + 1.6338990926742554, + 0.05252958834171295, + 0.033899713307619095, + 0.04357345402240753, + 0.6768777184188366, + 1.9552232343703508, + 0.0, + 0.23624106124043465, + 0.2522902935743332, + 1.1738853119313717, + 0.12153104692697525, + 0.5908733271062374, + 0.02795405685901642, + 0.0, + 1.3418656662106514, + 0.29953495413064957, + 0.46575549617409706, + 0.23803768679499626, + 1.465594720095396, + 0.7180404029786587, + 0.970484122633934, + 0.10791226476430893, + 0.394620668143034, + 0.5808908753097057, + 0.5275139510631561, + 0.8625018633902073 + ], + "unique_experts": 59, + "load_cv": 1.19713474630341, + "normalized_load_entropy": 0.8767244051783644, + "max_load_share": 0.12106918238993711 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "9097293b00e588a55be5d61cc8ff96f024aad55f8b4d7510f812f70f0887f42b", + "route_weight_sha256": "fa56b7eec02b556c58274dec437c85b08f07301e457f45684a81ab9a1896c0a6", + "loads": [ + 1, + 6, + 13, + 0, + 16, + 15, + 1, + 79, + 12, + 7, + 12, + 10, + 4, + 3, + 18, + 11, + 9, + 4, + 13, + 11, + 10, + 45, + 3, + 11, + 13, + 16, + 28, + 23, + 10, + 9, + 10, + 15, + 7, + 35, + 8, + 16, + 5, + 5, + 26, + 1, + 2, + 18, + 10, + 38, + 3, + 11, + 11, + 16, + 10, + 14, + 4, + 13, + 21, + 6, + 7, + 16, + 23, + 15, + 17, + 23, + 16, + 20, + 9, + 18 + ], + "weighted_loads": [ + 0.03809859976172447, + 0.5303442180156708, + 0.7272918904200196, + 0.0, + 1.502257101237774, + 0.9537453912198544, + 0.03894782438874245, + 5.9234361331909895, + 0.8670896664261818, + 0.38664573803544044, + 0.686869602650404, + 0.8133222013711929, + 0.20108699798583984, + 0.5503471568226814, + 1.1736734360456467, + 0.6355477869510651, + 0.43468401581048965, + 0.2524219863116741, + 1.1327503211796284, + 0.7821642085909843, + 0.5370771363377571, + 3.6108561903238297, + 0.10173126310110092, + 0.5876477733254433, + 0.846941027790308, + 1.623063636943698, + 2.262840010225773, + 1.5491257105022669, + 0.6489626206457615, + 0.6102051474153996, + 0.842114619910717, + 0.963733121752739, + 0.5923590175807476, + 1.708104370161891, + 0.5894998032599688, + 1.054351158440113, + 0.2891591154038906, + 0.3711693435907364, + 1.67206659168005, + 0.05252958834171295, + 0.07607695087790489, + 1.6138287708163261, + 0.7226803153753281, + 2.0232660453766584, + 0.21662672981619835, + 0.48917531594634056, + 0.5690272189676762, + 1.4424863960593939, + 0.7715596705675125, + 0.8271402306854725, + 0.207595344632864, + 0.7504517622292042, + 1.411492221057415, + 0.4150552302598953, + 0.46575549617409706, + 1.1752032823860645, + 1.5376326479017735, + 1.1158849149942398, + 0.970484122633934, + 1.4600792676210403, + 1.1307836100459099, + 1.5735081247985363, + 0.5275139510631561, + 0.898749802261591 + ], + "unique_experts": 63, + "load_cv": 0.8682379488143408, + "normalized_load_entropy": 0.9296071740302764, + "max_load_share": 0.08956916099773243 + } + }, + "s0_x": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "70dc388f9a89de3df9221a61d229d311ca14078c1bc30f7f1540414756554446", + "route_weight_sha256": "c09eaaafbb477cd85727124f11bc57b8b71938695bbc1d6ead39f67946f26993", + "loads": [ + 1, + 6, + 11, + 0, + 12, + 15, + 1, + 76, + 12, + 7, + 11, + 6, + 0, + 1, + 14, + 12, + 9, + 0, + 8, + 7, + 7, + 43, + 2, + 11, + 13, + 12, + 26, + 2, + 10, + 6, + 2, + 12, + 2, + 25, + 6, + 15, + 3, + 2, + 25, + 1, + 1, + 1, + 8, + 35, + 0, + 3, + 5, + 12, + 2, + 11, + 1, + 0, + 21, + 5, + 8, + 3, + 19, + 8, + 16, + 2, + 6, + 9, + 9, + 17 + ], + "weighted_loads": [ + 0.03857901692390442, + 0.5163986533880234, + 0.6465538144111633, + 0.0, + 1.3199774473905563, + 0.9094148464500904, + 0.036278750747442245, + 5.889273136854172, + 0.8804637677967548, + 0.42581072449684143, + 0.6269910410046577, + 0.5898757390677929, + 0.0, + 0.036712028086185455, + 0.8850579410791397, + 0.679033175110817, + 0.433228712528944, + 0.0, + 0.7394254468381405, + 0.5682437904179096, + 0.3878239244222641, + 3.525111772119999, + 0.07037427462637424, + 0.5889617241919041, + 0.8351554572582245, + 1.2528825923800468, + 2.160859262570739, + 0.07399272918701172, + 0.6666939686983824, + 0.4798521548509598, + 0.13008634001016617, + 0.8857994340360165, + 0.0978030152618885, + 1.1496219094842672, + 0.45860742032527924, + 0.9612959176301956, + 0.2041870430111885, + 0.26181621849536896, + 1.6083520874381065, + 0.05183593928813934, + 0.032476164400577545, + 0.0467989444732666, + 0.6720599867403507, + 1.8843653742223978, + 0.0, + 0.13027647510170937, + 0.2487982790917158, + 1.1797686964273453, + 0.11679866164922714, + 0.6210182346403599, + 0.029107755050063133, + 0.0, + 1.3958621583878994, + 0.3431462086737156, + 0.4994810726493597, + 0.18529099225997925, + 1.330946885049343, + 0.7097744084894657, + 0.9218510165810585, + 0.10425715520977974, + 0.3876967504620552, + 0.610969103872776, + 0.517402209341526, + 0.8767804242670536 + ], + "unique_experts": 59, + "load_cv": 1.1935609054349903, + "normalized_load_entropy": 0.8759733116314325, + "max_load_share": 0.11949685534591195 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "324440fb982d46247177874e3c2173080c5dac2b57df0fa0ebeaa1a890f7b7d0", + "route_weight_sha256": "7eef7e94916b88d3ae36a45ebfe3e30d438c69ea3e8d88d5c00230907d7dac86", + "loads": [ + 1, + 6, + 12, + 0, + 12, + 15, + 1, + 81, + 12, + 8, + 13, + 7, + 1, + 3, + 16, + 12, + 9, + 4, + 13, + 9, + 10, + 45, + 2, + 11, + 13, + 15, + 26, + 7, + 11, + 7, + 6, + 13, + 2, + 34, + 7, + 16, + 3, + 2, + 25, + 1, + 1, + 10, + 11, + 37, + 4, + 6, + 12, + 17, + 2, + 13, + 3, + 5, + 21, + 7, + 8, + 12, + 19, + 15, + 16, + 16, + 11, + 23, + 9, + 17 + ], + "weighted_loads": [ + 0.03857901692390442, + 0.5163986533880234, + 0.6607152605429292, + 0.0, + 1.3199774473905563, + 0.9094148464500904, + 0.036278750747442245, + 6.105545911937952, + 0.8804637677967548, + 0.44204893335700035, + 0.7223618291318417, + 0.6382297687232494, + 0.032807640731334686, + 0.540220107883215, + 1.0172363258898258, + 0.679033175110817, + 0.433228712528944, + 0.2464507445693016, + 1.0782297477126122, + 0.6699670813977718, + 0.5000654384493828, + 3.6092227585613728, + 0.07037427462637424, + 0.5889617241919041, + 0.8351554572582245, + 1.3640562258660793, + 2.160859262570739, + 0.8240856826305389, + 0.7130519058555365, + 0.5227802135050297, + 0.4966913163661957, + 0.8995688334107399, + 0.0978030152618885, + 1.575569836422801, + 0.4885008502751589, + 0.9983431249856949, + 0.2041870430111885, + 0.26181621849536896, + 1.6083520874381065, + 0.05183593928813934, + 0.032476164400577545, + 0.9157849885523319, + 0.7768046353012323, + 1.9812763426452875, + 0.21411948651075363, + 0.3049864210188389, + 0.5675716679543257, + 1.4608833771198988, + 0.11679866164922714, + 0.7118802070617676, + 0.12402358464896679, + 0.2775573804974556, + 1.3958621583878994, + 0.47629057615995407, + 0.4994810726493597, + 0.8592761680483818, + 1.330946885049343, + 1.1171484775841236, + 0.9218510165810585, + 0.965323232114315, + 0.7301126606762409, + 1.8218256942927837, + 0.517402209341526, + 0.8767804242670536 + ], + "unique_experts": 63, + "load_cv": 0.9966729807093595, + "normalized_load_entropy": 0.9122211470479683, + "max_load_share": 0.10305343511450382 + } + }, + "s1_x": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "f0b26448790b4d401c1ea3209f3bea5b3c626e8f3f37def42938678b827d4335", + "route_weight_sha256": "ad79ddd2c607b8b58a3057b7f21d4bb9e5e5488096995b23e119140f86499b87", + "loads": [ + 1, + 6, + 11, + 0, + 12, + 16, + 1, + 75, + 12, + 7, + 9, + 6, + 0, + 1, + 13, + 12, + 9, + 1, + 7, + 7, + 8, + 42, + 3, + 12, + 12, + 12, + 26, + 1, + 9, + 6, + 2, + 12, + 2, + 21, + 6, + 15, + 4, + 2, + 26, + 1, + 1, + 1, + 8, + 35, + 0, + 6, + 5, + 12, + 2, + 11, + 1, + 0, + 20, + 4, + 6, + 3, + 21, + 8, + 16, + 4, + 6, + 10, + 11, + 17 + ], + "weighted_loads": [ + 0.039433542639017105, + 0.5057776980102062, + 0.6650728024542332, + 0.0, + 1.290391355752945, + 0.982638843357563, + 0.04042072966694832, + 5.6631305404007435, + 0.8647265210747719, + 0.4286140874028206, + 0.5569260567426682, + 0.5740477815270424, + 0.0, + 0.040738727897405624, + 0.8542052544653416, + 0.6930869668722153, + 0.43038517236709595, + 0.046312328428030014, + 0.6953279078006744, + 0.6077104844152927, + 0.4340061992406845, + 3.486942868679762, + 0.09986513294279575, + 0.6060572899878025, + 0.7731055170297623, + 1.237497717142105, + 2.1877635661512613, + 0.032784540206193924, + 0.5743110701441765, + 0.4770395942032337, + 0.13201512768864632, + 0.8670726232230663, + 0.10035580769181252, + 0.9482949804514647, + 0.4436214119195938, + 0.9376666471362114, + 0.23764167726039886, + 0.2397763356566429, + 1.6530723571777344, + 0.05399266630411148, + 0.03327447921037674, + 0.047269996255636215, + 0.6690125539898872, + 1.880370182916522, + 0.0, + 0.2354570087045431, + 0.25689927488565445, + 1.1347018033266068, + 0.12142860516905785, + 0.6289126798510551, + 0.030183477327227592, + 0.0, + 1.3521784916520119, + 0.3007610887289047, + 0.4334826413542032, + 0.18932797014713287, + 1.4298630952835083, + 0.7226644642651081, + 0.9306953176856041, + 0.19116419181227684, + 0.39931054040789604, + 0.614965159446001, + 0.5838668905198574, + 0.8566024154424667 + ], + "unique_experts": 60, + "load_cv": 1.172428937186668, + "normalized_load_entropy": 0.8806415158570565, + "max_load_share": 0.1179245283018868 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "1109f0fffca424a3ad7c8d8756fac972a2a7068751db0b9d41d976245720c331", + "route_weight_sha256": "70c553557842e29b08ccd166540b7ead4ca560bc725fcad6ef29eafd989145d0", + "loads": [ + 1, + 6, + 13, + 0, + 16, + 16, + 1, + 78, + 12, + 8, + 12, + 9, + 4, + 2, + 18, + 12, + 9, + 6, + 11, + 8, + 9, + 44, + 3, + 12, + 13, + 16, + 28, + 19, + 9, + 9, + 11, + 13, + 7, + 37, + 8, + 17, + 6, + 5, + 27, + 1, + 2, + 17, + 10, + 37, + 2, + 12, + 12, + 17, + 10, + 15, + 5, + 13, + 21, + 7, + 6, + 14, + 22, + 16, + 16, + 25, + 16, + 22, + 11, + 18 + ], + "weighted_loads": [ + 0.039433542639017105, + 0.5057776980102062, + 0.7192357713356614, + 0.0, + 1.492616605013609, + 0.982638843357563, + 0.04042072966694832, + 5.798367213457823, + 0.8647265210747719, + 0.4448522962629795, + 0.6851053610444069, + 0.744608610868454, + 0.20108699798583984, + 0.5096223913133144, + 1.1655006743967533, + 0.6930869668722153, + 0.43038517236709595, + 0.3520347289741039, + 1.0195345133543015, + 0.6527351066470146, + 0.47442786768078804, + 3.5730315782129765, + 0.09986513294279575, + 0.6060572899878025, + 0.8148885816335678, + 1.6074522752314806, + 2.258283982053399, + 1.3731274474412203, + 0.5743110701441765, + 0.608956553041935, + 0.8705515079200268, + 0.8808420225977898, + 0.5931373424828053, + 1.7617597077041864, + 0.5859698336571455, + 1.101125594228506, + 0.32254017889499664, + 0.36645445227622986, + 1.691239856183529, + 0.05399266630411148, + 0.07545171678066254, + 1.352280616760254, + 0.7148151509463787, + 1.9484129939228296, + 0.1437068171799183, + 0.550818195566535, + 0.6393374465405941, + 1.3985545057803392, + 0.7714572288095951, + 0.8341432884335518, + 0.24526985920965672, + 0.7831152528524399, + 1.4218050464987755, + 0.4742223285138607, + 0.4334826413542032, + 1.041858572512865, + 1.5019010230898857, + 1.1708034463226795, + 0.9306953176856041, + 1.5252717807888985, + 1.1504623964428902, + 1.669759128242731, + 0.5838668905198574, + 0.8928503543138504 + ], + "unique_experts": 63, + "load_cv": 0.861197502977345, + "normalized_load_entropy": 0.930127809809327, + "max_load_share": 0.08843537414965986 + } + }, + "s0_period": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "59da3977ae1aba3924b6f4411b0d99911af8b6b0ac2bb092a43ed4bd0dfc4121", + "route_weight_sha256": "718ddb2626980258d261b1034c3023644c8750ebd649900c9bf64d0588917a4f", + "loads": [ + 1, + 6, + 10, + 0, + 12, + 15, + 1, + 75, + 13, + 8, + 10, + 6, + 0, + 1, + 14, + 12, + 8, + 0, + 8, + 10, + 6, + 42, + 2, + 13, + 12, + 12, + 26, + 2, + 9, + 6, + 2, + 13, + 1, + 24, + 6, + 15, + 4, + 2, + 25, + 1, + 1, + 1, + 8, + 34, + 0, + 5, + 5, + 12, + 2, + 11, + 1, + 0, + 21, + 5, + 7, + 3, + 21, + 8, + 16, + 1, + 6, + 7, + 9, + 19 + ], + "weighted_loads": [ + 0.04137144982814789, + 0.5279764160513878, + 0.611906673759222, + 0.0, + 1.3406788185238838, + 0.9066485948860645, + 0.03660454973578453, + 5.819096643477678, + 0.9246712140738964, + 0.4574591815471649, + 0.5938868075609207, + 0.5927928015589714, + 0.0, + 0.03725587576627731, + 0.8846455663442612, + 0.7026071585714817, + 0.3940806910395622, + 0.0, + 0.7352929338812828, + 0.7362446337938309, + 0.33973247930407524, + 3.4583518840372562, + 0.06959236413240433, + 0.6656306516379118, + 0.775619599968195, + 1.2475000098347664, + 2.1612225007265806, + 0.07664096727967262, + 0.6404090747237206, + 0.48009758815169334, + 0.12996087968349457, + 0.9201498962938786, + 0.05444364249706268, + 1.1162897013127804, + 0.45120564103126526, + 0.9523596614599228, + 0.24647806584835052, + 0.2575991228222847, + 1.5973820500075817, + 0.05173715576529503, + 0.03302880376577377, + 0.04588297754526138, + 0.6772151552140713, + 1.8509135842323303, + 0.0, + 0.19827053882181644, + 0.24992041662335396, + 1.168378483504057, + 0.11810903623700142, + 0.624754037708044, + 0.029977982863783836, + 0.0, + 1.3932517655193806, + 0.34525178372859955, + 0.4667772464454174, + 0.18929273262619972, + 1.4166399836540222, + 0.7137752212584019, + 0.9227226190268993, + 0.07130380719900131, + 0.3873376213014126, + 0.5087171569466591, + 0.512446803972125, + 0.9466567113995552 + ], + "unique_experts": 59, + "load_cv": 1.1813021893423352, + "normalized_load_entropy": 0.8763642408551601, + "max_load_share": 0.1179245283018868 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "02fe1962a59ef87232ff317af4d993caea3c9d18d5dde33f1126b07ca44cf91f", + "route_weight_sha256": "908a5a92d9cd795ae0bfdbf6e5b6487aba666bec561540872fe622ae94788586", + "loads": [ + 1, + 6, + 11, + 0, + 12, + 15, + 1, + 79, + 13, + 9, + 12, + 7, + 1, + 3, + 16, + 12, + 8, + 3, + 13, + 12, + 9, + 44, + 2, + 13, + 12, + 15, + 26, + 8, + 10, + 7, + 7, + 14, + 1, + 32, + 7, + 16, + 4, + 2, + 25, + 1, + 1, + 11, + 11, + 36, + 3, + 8, + 11, + 16, + 2, + 14, + 4, + 6, + 21, + 6, + 7, + 12, + 21, + 15, + 16, + 16, + 12, + 20, + 9, + 19 + ], + "weighted_loads": [ + 0.04137144982814789, + 0.5279764160513878, + 0.6260681198909879, + 0.0, + 1.3406788185238838, + 0.9066485948860645, + 0.03660454973578453, + 5.996271025389433, + 0.9246712140738964, + 0.47369739040732384, + 0.6892575956881046, + 0.641146831214428, + 0.032807640731334686, + 0.5407639555633068, + 1.0158519074320793, + 0.7026071585714817, + 0.3940806910395622, + 0.23127888143062592, + 1.0740972347557545, + 0.8375524692237377, + 0.4519739933311939, + 3.54246287047863, + 0.06959236413240433, + 0.6656306516379118, + 0.775619599968195, + 1.3610182106494904, + 2.1612225007265806, + 0.852224837988615, + 0.6867670118808746, + 0.5230256468057632, + 0.5672678537666798, + 0.933919295668602, + 0.05444364249706268, + 1.4944978915154934, + 0.4810990709811449, + 0.9894068688154221, + 0.24647806584835052, + 0.2575991228222847, + 1.5973820500075817, + 0.05173715576529503, + 0.03302880376577377, + 1.001720555126667, + 0.7819598037749529, + 1.94782455265522, + 0.16772127151489258, + 0.34678504429757595, + 0.5190994590520859, + 1.4213594179600477, + 0.11810903623700142, + 0.7698932029306889, + 0.16246804781258106, + 0.34714871272444725, + 1.3932517655193806, + 0.42534948885440826, + 0.4667772464454174, + 0.9055890738964081, + 1.4166399836540222, + 1.1333916746079922, + 0.9227226190268993, + 0.9903314970433712, + 0.7811085544526577, + 1.6394301913678646, + 0.512446803972125, + 0.9466567113995552 + ], + "unique_experts": 63, + "load_cv": 0.970873801179979, + "normalized_load_entropy": 0.9147247688473218, + "max_load_share": 0.1005089058524173 + } + }, + "s1_period": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "061f966a1192589e9c4960a2e07ac2fde24bac5d2e428985f5bdfd902e2727ff", + "route_weight_sha256": "b6309229c195fb8aebff45b6f3a96995552c7b4e2ebc00975b9d6060bb8b9f99", + "loads": [ + 1, + 6, + 11, + 0, + 12, + 15, + 1, + 77, + 13, + 5, + 10, + 6, + 0, + 1, + 14, + 11, + 8, + 1, + 9, + 7, + 8, + 43, + 3, + 11, + 12, + 11, + 26, + 2, + 10, + 6, + 2, + 13, + 1, + 22, + 6, + 14, + 3, + 2, + 25, + 1, + 1, + 1, + 8, + 36, + 0, + 6, + 5, + 12, + 2, + 11, + 1, + 0, + 20, + 4, + 6, + 3, + 20, + 8, + 17, + 3, + 6, + 10, + 10, + 17 + ], + "weighted_loads": [ + 0.03993423283100128, + 0.5144063867628574, + 0.6666573043912649, + 0.0, + 1.2669639103114605, + 0.9522770643234253, + 0.04053862392902374, + 5.758279237896204, + 0.9064008556306362, + 0.3342425562441349, + 0.599631629884243, + 0.578317429870367, + 0.0, + 0.04013998061418533, + 0.8889874219894409, + 0.6381502337753773, + 0.391508586704731, + 0.046505965292453766, + 0.7757573500275612, + 0.6387698724865913, + 0.4315730072557926, + 3.5330029353499413, + 0.10011757351458073, + 0.5768027566373348, + 0.7642715275287628, + 1.1782721243798733, + 2.175016922876239, + 0.07442305982112885, + 0.6247013565152884, + 0.48133767396211624, + 0.1333063431084156, + 0.9004211984574795, + 0.05718938633799553, + 0.9802904240787029, + 0.4410534203052521, + 0.8935603387653828, + 0.2006721831858158, + 0.23737477511167526, + 1.618515145033598, + 0.053645409643650055, + 0.03382506221532822, + 0.048311490565538406, + 0.6633037328720093, + 1.9577055014669895, + 0.0, + 0.2327385451644659, + 0.25776729360222816, + 1.127470649778843, + 0.12196183204650879, + 0.6353729739785194, + 0.029103130102157593, + 0.0, + 1.3482623472809792, + 0.3046374171972275, + 0.4346026461571455, + 0.1891501285135746, + 1.3986207991838455, + 0.7277369126677513, + 0.9686587415635586, + 0.14273751527071, + 0.39464354142546654, + 0.6166502051055431, + 0.5429913587868214, + 0.8542463537305593 + ], + "unique_experts": 60, + "load_cv": 1.1981916149916523, + "normalized_load_entropy": 0.8773911976609144, + "max_load_share": 0.12106918238993711 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "1d1fc5b7b42ad9fccca18fb57108b410b8cbc4c8fb115a4af5896df9873668ca", + "route_weight_sha256": "1b9385196d528c8858dd632d8751083eacb8c15ba6285d69cd77cec9b25ee351", + "loads": [ + 1, + 6, + 13, + 1, + 16, + 15, + 1, + 79, + 13, + 6, + 12, + 10, + 4, + 2, + 19, + 11, + 8, + 6, + 13, + 8, + 9, + 45, + 3, + 11, + 13, + 14, + 28, + 20, + 10, + 9, + 12, + 14, + 6, + 38, + 8, + 16, + 5, + 5, + 26, + 1, + 2, + 17, + 10, + 38, + 2, + 12, + 11, + 17, + 10, + 15, + 4, + 14, + 21, + 6, + 6, + 15, + 21, + 16, + 17, + 24, + 17, + 22, + 10, + 18 + ], + "weighted_loads": [ + 0.03993423283100128, + 0.5144063867628574, + 0.7208202732726932, + 0.05708339810371399, + 1.4691891595721245, + 0.9522770643234253, + 0.04053862392902374, + 5.842149831354618, + 0.9064008556306362, + 0.3504807651042938, + 0.677706453949213, + 0.8008906506001949, + 0.20108699798583984, + 0.5090236440300941, + 1.1818877048790455, + 0.6381502337753773, + 0.391508586704731, + 0.40279316157102585, + 1.0999639555811882, + 0.6830091774463654, + 0.47199467569589615, + 3.619091644883156, + 0.10011757351458073, + 0.5768027566373348, + 0.8060545921325684, + 1.5083109382539988, + 2.2455373387783766, + 1.4073254596441984, + 0.6247013565152884, + 0.6132546328008175, + 0.973350502550602, + 0.9141905978322029, + 0.5499709211289883, + 1.7810260318219662, + 0.5834018420428038, + 1.0570192858576775, + 0.2855706848204136, + 0.3640528917312622, + 1.6566826440393925, + 0.053645409643650055, + 0.07600229978561401, + 1.354488767683506, + 0.7091063298285007, + 2.025748312473297, + 0.1437068171799183, + 0.5227829832583666, + 0.5745042189955711, + 1.4008121136575937, + 0.771990455687046, + 0.8414854630827904, + 0.20874441787600517, + 0.8820151537656784, + 1.4178889021277428, + 0.426336333155632, + 0.4346026461571455, + 1.105642281472683, + 1.470658726990223, + 1.256163652986288, + 0.9686587415635586, + 1.4514202438294888, + 1.1768209338188171, + 1.6476058401167393, + 0.5429913587868214, + 0.890494292601943 + ], + "unique_experts": 64, + "load_cv": 0.8756916322901833, + "normalized_load_entropy": 0.9287466275512577, + "max_load_share": 0.08956916099773243 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 106, + "ordered_topk_exact_tokens": 87, + "set_exact_tokens": 94, + "mean_set_jaccard": 0.9676549865229112, + "mean_token_weighted_tv": 0.009523508200457073, + "aggregate_load_tv": 0.0110062893081761 + }, + "system_bos": { + "tokens": 106, + "ordered_topk_exact_tokens": 65, + "set_exact_tokens": 79, + "mean_set_jaccard": 0.92722371967655, + "mean_token_weighted_tv": 0.01742158526168117, + "aggregate_load_tv": 0.029874213836477988 + }, + "system_x": { + "tokens": 106, + "ordered_topk_exact_tokens": 57, + "set_exact_tokens": 77, + "mean_set_jaccard": 0.9218328840970351, + "mean_token_weighted_tv": 0.019562410550930026, + "aggregate_load_tv": 0.02672955974842767 + }, + "system_period": { + "tokens": 106, + "ordered_topk_exact_tokens": 56, + "set_exact_tokens": 78, + "mean_set_jaccard": 0.9225067385444743, + "mean_token_weighted_tv": 0.019766912496877165, + "aggregate_load_tv": 0.031446540880503145 + }, + "bos_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 66, + "set_exact_tokens": 75, + "mean_set_jaccard": 0.9083557951482479, + "mean_token_weighted_tv": 0.022436651120067767, + "aggregate_load_tv": 0.03144654088050314 + }, + "bos_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 63, + "set_exact_tokens": 79, + "mean_set_jaccard": 0.92722371967655, + "mean_token_weighted_tv": 0.019208187457033486, + "aggregate_load_tv": 0.02830188679245283 + }, + "x_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 58, + "set_exact_tokens": 76, + "mean_set_jaccard": 0.9150943396226415, + "mean_token_weighted_tv": 0.020725584299004864, + "aggregate_load_tv": 0.033018867924528295 + }, + "x_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 54, + "set_exact_tokens": 71, + "mean_set_jaccard": 0.9036388140161725, + "mean_token_weighted_tv": 0.02385722614719339, + "aggregate_load_tv": 0.03144654088050314 + }, + "period_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 60, + "set_exact_tokens": 75, + "mean_set_jaccard": 0.9123989218328841, + "mean_token_weighted_tv": 0.02093105250090923, + "aggregate_load_tv": 0.029874213836477988 + }, + "period_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 58, + "set_exact_tokens": 77, + "mean_set_jaccard": 0.9218328840970351, + "mean_token_weighted_tv": 0.02120664586611795, + "aggregate_load_tv": 0.02830188679245283 + } + } + }, + "layer_11": { + "layer": 11, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "4b1d87440f0ed0684b8957e81ac6569d8e51d1bb7ca368903c1dff5cb69ae135", + "route_weight_sha256": "6308faba8d0a0fa6cf2a4e4935f29d6d925d1fbdff459c2f55260ee312899d10", + "loads": [ + 5, + 8, + 6, + 36, + 3, + 0, + 7, + 3, + 5, + 5, + 1, + 8, + 14, + 21, + 53, + 8, + 4, + 7, + 1, + 22, + 8, + 15, + 5, + 8, + 5, + 6, + 9, + 9, + 0, + 31, + 36, + 7, + 31, + 27, + 3, + 4, + 9, + 2, + 2, + 9, + 14, + 31, + 8, + 0, + 21, + 9, + 4, + 1, + 4, + 14, + 14, + 14, + 13, + 0, + 1, + 2, + 2, + 11, + 3, + 7, + 7, + 9, + 4, + 0 + ], + "weighted_loads": [ + 0.26545171067118645, + 0.40832236781716347, + 0.5035345554351807, + 1.9241983629763126, + 0.10914527252316475, + 0.0, + 0.3801582418382168, + 0.163464467972517, + 0.33765895664691925, + 0.24571601673960686, + 0.047118980437517166, + 0.365037702023983, + 0.7455920893698931, + 1.4659338556230068, + 3.9042216949164867, + 0.35404255986213684, + 0.17297201231122017, + 0.26803385466337204, + 0.036519743502140045, + 1.1879064999520779, + 0.6222416162490845, + 1.0324679352343082, + 0.17605124600231647, + 0.6093945503234863, + 0.20998040586709976, + 0.3475765697658062, + 0.34328808076679707, + 0.5084939673542976, + 0.0, + 2.226338267326355, + 1.8102843463420868, + 0.3857763893902302, + 2.3206097185611725, + 1.5459708496928215, + 0.15579007752239704, + 0.4850723147392273, + 0.49235155060887337, + 0.07378437742590904, + 0.0682106502354145, + 0.45401037856936455, + 0.9266417250037193, + 1.8894262183457613, + 0.4848138242959976, + 0.0, + 1.5253383331000805, + 0.7517745494842529, + 0.169124536216259, + 0.040222860872745514, + 0.23686303570866585, + 1.1477239914238453, + 0.6499520055949688, + 1.1887784451246262, + 0.655208058655262, + 0.0, + 0.03050900250673294, + 0.10841508954763412, + 0.091106366366148, + 0.5724056679755449, + 0.13788341358304024, + 0.48012850061059, + 0.4580758512020111, + 1.2542942352592945, + 0.14418712630867958, + 0.0 + ], + "unique_experts": 59, + "load_cv": 1.0525340911972363, + "normalized_load_entropy": 0.889589566618353, + "max_load_share": 0.08333333333333333 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "87c2d9f4d4d28aa990afff2dec2a9fddb3d4a702ed036665e9273f966bb8c033", + "route_weight_sha256": "ebc871151dd27645b14c674a91fedb07e0883d99d5768d04bccf6e57fba04d3a", + "loads": [ + 5, + 9, + 7, + 36, + 8, + 0, + 7, + 3, + 8, + 6, + 5, + 11, + 14, + 21, + 53, + 14, + 9, + 9, + 13, + 22, + 8, + 15, + 6, + 13, + 5, + 6, + 10, + 11, + 6, + 31, + 42, + 15, + 33, + 27, + 7, + 8, + 9, + 2, + 2, + 9, + 21, + 31, + 8, + 22, + 23, + 9, + 4, + 9, + 4, + 17, + 14, + 14, + 13, + 0, + 5, + 4, + 2, + 11, + 6, + 8, + 8, + 15, + 12, + 1 + ], + "weighted_loads": [ + 0.26545171067118645, + 0.4390721470117569, + 0.5617959760129452, + 1.9241983629763126, + 0.332118958234787, + 0.0, + 0.3801582418382168, + 0.163464467972517, + 0.5138701014220715, + 0.2766457460820675, + 0.16392404260113835, + 0.41911145113408566, + 0.7455920893698931, + 1.4659338556230068, + 3.9042216949164867, + 0.5853516757488251, + 0.7441748827695847, + 0.2979943146929145, + 2.1046069897711277, + 1.1879064999520779, + 0.6222416162490845, + 1.0324679352343082, + 0.18000599276274443, + 0.8586287572979927, + 0.20998040586709976, + 0.3475765697658062, + 0.346659786766395, + 0.5687108235433698, + 0.46550923958420753, + 2.226338267326355, + 2.102411797270179, + 0.7374504208564758, + 2.3861130978912115, + 1.5459708496928215, + 0.3358154948800802, + 0.7977876476943493, + 0.49235155060887337, + 0.07378437742590904, + 0.0682106502354145, + 0.45401037856936455, + 1.2744915448129177, + 1.8894262183457613, + 0.4848138242959976, + 2.137112010270357, + 1.6527464017271996, + 0.7517745494842529, + 0.169124536216259, + 0.6206588037312031, + 0.23686303570866585, + 1.3326697163283825, + 0.6499520055949688, + 1.1887784451246262, + 0.655208058655262, + 0.0, + 0.22778398916125298, + 0.20005758851766586, + 0.091106366366148, + 0.5724056679755449, + 0.2749410979449749, + 0.5393722169101238, + 0.48998285084962845, + 1.5931204240769148, + 0.6187935806810856, + 0.026970436796545982 + ], + "unique_experts": 62, + "load_cv": 0.8336702696657483, + "normalized_load_entropy": 0.9284366209018127, + "max_load_share": 0.06743002544529263 + } + }, + "s1_eos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "7f6c6b267270dcb05e6c855d9eaa21cc39bc5c8d163709c707f7f74eec613d78", + "route_weight_sha256": "3a09211fe92eb56d75f4eef20c51f4af8321c548c6cc73e42a286c1704a1efb8", + "loads": [ + 5, + 7, + 8, + 34, + 3, + 0, + 7, + 3, + 5, + 5, + 2, + 8, + 14, + 20, + 56, + 8, + 4, + 6, + 1, + 22, + 9, + 15, + 5, + 8, + 6, + 6, + 7, + 10, + 0, + 31, + 35, + 7, + 30, + 27, + 4, + 4, + 10, + 2, + 2, + 8, + 14, + 30, + 8, + 0, + 20, + 9, + 4, + 1, + 4, + 14, + 15, + 14, + 14, + 0, + 1, + 2, + 2, + 11, + 3, + 7, + 7, + 9, + 3, + 0 + ], + "weighted_loads": [ + 0.26675277948379517, + 0.38435073569417, + 0.5833518318831921, + 1.8634723275899887, + 0.11239251494407654, + 0.0, + 0.377290029078722, + 0.16569554060697556, + 0.3396593779325485, + 0.24634090438485146, + 0.08588530495762825, + 0.36375923827290535, + 0.7515444979071617, + 1.4291481859982014, + 4.048986773937941, + 0.3503144010901451, + 0.17232432588934898, + 0.22866136208176613, + 0.03622697666287422, + 1.2073829509317875, + 0.6486072055995464, + 1.0260095596313477, + 0.17267580144107342, + 0.6079737618565559, + 0.24474162608385086, + 0.3456328511238098, + 0.2694616951048374, + 0.5437709502875805, + 0.0, + 2.250016700476408, + 1.7704468481242657, + 0.3761579729616642, + 2.276290025562048, + 1.5366192534565926, + 0.1807479728013277, + 0.4792076647281647, + 0.5245080962777138, + 0.07470349222421646, + 0.07193728536367416, + 0.4192405641078949, + 0.9013205133378506, + 1.8565826192498207, + 0.4895901791751385, + 0.0, + 1.4894830323755741, + 0.7460076697170734, + 0.168687105178833, + 0.04022322595119476, + 0.2310909666121006, + 1.1504226587712765, + 0.6899272091686726, + 1.2049822211265564, + 0.6841293722391129, + 0.0, + 0.03074604645371437, + 0.10651925951242447, + 0.0878058485686779, + 0.5815261527895927, + 0.14244280755519867, + 0.4859680272638798, + 0.4584548585116863, + 1.2501881830394268, + 0.11164307594299316, + 0.0 + ], + "unique_experts": 59, + "load_cv": 1.0516317578222718, + "normalized_load_entropy": 0.8910442210712308, + "max_load_share": 0.0880503144654088 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "9eec1d05650d8887209dfd3fc71893e5ce33abd9e8a2dd5a2e39ca51f6f4013f", + "route_weight_sha256": "fe4fddc118d2436e236b7255e5d8a633608da7dd10f99e82462b7fdd941ecc4b", + "loads": [ + 7, + 8, + 9, + 34, + 14, + 4, + 7, + 5, + 14, + 5, + 7, + 11, + 14, + 20, + 56, + 9, + 23, + 8, + 12, + 23, + 10, + 16, + 8, + 13, + 6, + 6, + 10, + 13, + 10, + 31, + 43, + 13, + 31, + 27, + 8, + 11, + 10, + 2, + 2, + 9, + 20, + 30, + 8, + 26, + 22, + 9, + 5, + 14, + 4, + 18, + 15, + 14, + 14, + 5, + 19, + 9, + 8, + 12, + 5, + 12, + 10, + 18, + 14, + 2 + ], + "weighted_loads": [ + 0.4126493036746979, + 0.41728347167372704, + 0.6309469267725945, + 1.8634723275899887, + 0.6867468245327473, + 0.1424565203487873, + 0.377290029078722, + 0.2939024306833744, + 0.8840354308485985, + 0.24634090438485146, + 0.2433102303184569, + 0.41688454523682594, + 0.7515444979071617, + 1.4291481859982014, + 4.048986773937941, + 0.3901400566101074, + 1.8952984400093555, + 0.25764457043260336, + 2.09014905244112, + 1.24568135663867, + 0.7215951345860958, + 1.0982584282755852, + 0.28459309646859765, + 0.8313096836209297, + 0.24474162608385086, + 0.3456328511238098, + 0.3489218207541853, + 0.6498604724183679, + 0.7672496512532234, + 2.250016700476408, + 2.1755855195224285, + 0.6548122614622116, + 2.3088079281151295, + 1.5366192534565926, + 0.3791962545365095, + 1.0558600276708603, + 0.5245080962777138, + 0.07470349222421646, + 0.07193728536367416, + 0.46585893258452415, + 1.1786660626530647, + 1.8565826192498207, + 0.4895901791751385, + 2.4699151031672955, + 1.627722628414631, + 0.7460076697170734, + 0.2149418443441391, + 1.0495682209730148, + 0.2310909666121006, + 1.4475570432841778, + 0.6899272091686726, + 1.2049822211265564, + 0.6841293722391129, + 0.3046979382634163, + 1.1238082684576511, + 0.4380844086408615, + 0.558709193021059, + 0.6238129138946533, + 0.24415628984570503, + 0.7033557556569576, + 0.5724693275988102, + 1.7174909245222807, + 0.6857751272618771, + 0.07072880305349827 + ], + "unique_experts": 64, + "load_cv": 0.7184988942520638, + "normalized_load_entropy": 0.9477897938521193, + "max_load_share": 0.06349206349206349 + } + }, + "s0_bos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "cf68f8da993223827f6ad80657c30eeb298e0e75ec46fdb09562c5e3d519e21b", + "route_weight_sha256": "4a21c2dce915ab14021a0c3b2118cfcc6803c4ef5759d4ff6200ac6c49793d45", + "loads": [ + 5, + 7, + 7, + 32, + 2, + 0, + 7, + 3, + 5, + 5, + 2, + 8, + 14, + 20, + 56, + 6, + 5, + 5, + 1, + 22, + 9, + 15, + 5, + 8, + 6, + 6, + 8, + 9, + 0, + 32, + 37, + 7, + 31, + 26, + 3, + 4, + 8, + 1, + 3, + 10, + 15, + 31, + 6, + 0, + 21, + 11, + 4, + 1, + 4, + 14, + 14, + 14, + 11, + 0, + 0, + 2, + 3, + 11, + 4, + 6, + 8, + 10, + 5, + 1 + ], + "weighted_loads": [ + 0.26589368656277657, + 0.3673239052295685, + 0.555907778441906, + 1.7543144151568413, + 0.07676922902464867, + 0.0, + 0.38468898087739944, + 0.16401070728898048, + 0.34248466044664383, + 0.24861392751336098, + 0.0854158028960228, + 0.3545694090425968, + 0.7452841140329838, + 1.416208479553461, + 3.9706560596823692, + 0.2797209247946739, + 0.20965810865163803, + 0.19478662870824337, + 0.03591391071677208, + 1.193619441241026, + 0.7095241062343121, + 1.0441971942782402, + 0.17542850971221924, + 0.6118074506521225, + 0.24252204410731792, + 0.34641188383102417, + 0.3094336725771427, + 0.5270838923752308, + 0.0, + 2.347087223082781, + 1.9061128087341785, + 0.39674731716513634, + 2.3554009199142456, + 1.528905626386404, + 0.15002650767564774, + 0.48020437359809875, + 0.4412023350596428, + 0.03174422308802605, + 0.10932759195566177, + 0.49435069784522057, + 0.9804943166673183, + 1.8860353399068117, + 0.40596768632531166, + 0.0, + 1.5555937960743904, + 0.8757657743990421, + 0.16815658658742905, + 0.03867589309811592, + 0.23407384008169174, + 1.14793810993433, + 0.6411626078188419, + 1.2011325918138027, + 0.5650705732405186, + 0.0, + 0.0, + 0.10813494026660919, + 0.1364326775074005, + 0.5628479346632957, + 0.1706702969968319, + 0.44224969670176506, + 0.5002611950039864, + 1.3112445585429668, + 0.19736965745687485, + 0.034393925219774246 + ], + "unique_experts": 59, + "load_cv": 1.0600236658046736, + "normalized_load_entropy": 0.8900305783764142, + "max_load_share": 0.0880503144654088 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "29c08ad1b34ec2472db53f833e0a8fc3a5c83e32e5f97bdc80d3bf304726bd0b", + "route_weight_sha256": "5f41b0f610ddb80001c86ebc438cbd1a636595a570718efb17d5ea19631e1e18", + "loads": [ + 5, + 8, + 8, + 32, + 7, + 0, + 7, + 3, + 8, + 7, + 5, + 10, + 14, + 20, + 56, + 13, + 11, + 6, + 12, + 22, + 9, + 15, + 5, + 13, + 6, + 6, + 8, + 12, + 6, + 32, + 43, + 15, + 33, + 26, + 7, + 8, + 8, + 1, + 3, + 10, + 23, + 31, + 6, + 22, + 23, + 11, + 4, + 9, + 4, + 17, + 14, + 14, + 11, + 0, + 4, + 3, + 3, + 11, + 7, + 7, + 10, + 17, + 14, + 1 + ], + "weighted_loads": [ + 0.26589368656277657, + 0.3980736844241619, + 0.6141691990196705, + 1.7543144151568413, + 0.2997429147362709, + 0.0, + 0.38468898087739944, + 0.16401070728898048, + 0.5155389793217182, + 0.3153141662478447, + 0.1979710515588522, + 0.39643357414752245, + 0.7452841140329838, + 1.416208479553461, + 3.9706560596823692, + 0.5433079078793526, + 0.8629644922912121, + 0.20962687488645315, + 1.208762340247631, + 1.193619441241026, + 0.7095241062343121, + 1.0441971942782402, + 0.17542850971221924, + 0.8610416576266289, + 0.24252204410731792, + 0.34641188383102417, + 0.3094336725771427, + 0.6327735977247357, + 0.4578249752521515, + 2.347087223082781, + 2.1982402596622705, + 0.748421348631382, + 2.4209042992442846, + 1.528905626386404, + 0.3276018686592579, + 0.7947137616574764, + 0.4412023350596428, + 0.03174422308802605, + 0.10932759195566177, + 0.49435069784522057, + 1.4189613722264767, + 1.8860353399068117, + 0.40596768632531166, + 2.2841840125620365, + 1.6830018647015095, + 0.8757657743990421, + 0.16815658658742905, + 0.6080773137509823, + 0.23407384008169174, + 1.3253308609127998, + 0.6411626078188419, + 1.2011325918138027, + 0.5650705732405186, + 0.0, + 0.19117647595703602, + 0.1522780880331993, + 0.1364326775074005, + 0.5628479346632957, + 0.30772798135876656, + 0.49841608107089996, + 0.5789225697517395, + 1.7104191612452269, + 0.7421929091215134, + 0.034393925219774246 + ], + "unique_experts": 62, + "load_cv": 0.8475956450970142, + "normalized_load_entropy": 0.9267674336919711, + "max_load_share": 0.07124681933842239 + } + }, + "s1_bos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "063878f4a3311799da1d6ac9c354f96cf7fb0fae4e39c28fc6e459afabfe3ed0", + "route_weight_sha256": "7725d027d95e00fe2a0cc37a90048403f9f5af9009c778c203d548d2afca33a3", + "loads": [ + 4, + 7, + 8, + 31, + 1, + 0, + 7, + 3, + 5, + 7, + 2, + 9, + 14, + 21, + 58, + 8, + 4, + 3, + 1, + 22, + 9, + 15, + 4, + 8, + 6, + 5, + 8, + 8, + 0, + 33, + 34, + 7, + 29, + 25, + 4, + 4, + 9, + 1, + 3, + 10, + 14, + 31, + 7, + 0, + 20, + 12, + 4, + 1, + 4, + 14, + 15, + 15, + 13, + 0, + 0, + 2, + 2, + 12, + 4, + 6, + 8, + 10, + 4, + 1 + ], + "weighted_loads": [ + 0.2274002470076084, + 0.37678568065166473, + 0.5813726335763931, + 1.7261734157800674, + 0.04210631176829338, + 0.0, + 0.38105520606040955, + 0.16009849682450294, + 0.34611400216817856, + 0.3322046622633934, + 0.08248688280582428, + 0.3903672844171524, + 0.7388038486242294, + 1.4724295251071453, + 4.05369645357132, + 0.3489683233201504, + 0.16797276213765144, + 0.12139297649264336, + 0.03492068126797676, + 1.2125283852219582, + 0.6797452382743359, + 1.0483843982219696, + 0.1449864450842142, + 0.6164077706634998, + 0.2419740241020918, + 0.31489090248942375, + 0.3090282753109932, + 0.503669835627079, + 0.0, + 2.368911702185869, + 1.7375390753149986, + 0.3936556950211525, + 2.2502124942839146, + 1.4876281395554543, + 0.16401616856455803, + 0.4824768006801605, + 0.48160238191485405, + 0.03283311054110527, + 0.12092729285359383, + 0.4942653141915798, + 0.9308821298182011, + 1.9510830119252205, + 0.4483342729508877, + 0.0, + 1.5084886997938156, + 0.8777532149106264, + 0.16975292935967445, + 0.03861263394355774, + 0.22582148015499115, + 1.1480556577444077, + 0.6932416558265686, + 1.2634464018046856, + 0.6463257297873497, + 0.0, + 0.0, + 0.10752912610769272, + 0.08655795454978943, + 0.6141620203852654, + 0.17577799782156944, + 0.44229158759117126, + 0.4981972724199295, + 1.3162950351834297, + 0.15342240408062935, + 0.03594175726175308 + ], + "unique_experts": 59, + "load_cv": 1.0601729176151644, + "normalized_load_entropy": 0.8889459954177847, + "max_load_share": 0.09119496855345911 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "db3c1b6b3634163e1118bfe96b741309482c6289ddfbfea6814227d0e86e5538", + "route_weight_sha256": "5ed753acdc5d50aff7ab96a6915cdba14f2e6404d7742ff5e1520859d2ddc829", + "loads": [ + 6, + 8, + 9, + 31, + 12, + 4, + 7, + 5, + 15, + 8, + 5, + 11, + 14, + 21, + 58, + 10, + 23, + 4, + 11, + 23, + 10, + 16, + 6, + 13, + 6, + 5, + 10, + 11, + 9, + 33, + 42, + 13, + 30, + 25, + 8, + 11, + 9, + 1, + 3, + 11, + 22, + 31, + 7, + 26, + 22, + 12, + 5, + 15, + 4, + 18, + 15, + 15, + 13, + 5, + 18, + 9, + 8, + 13, + 6, + 12, + 10, + 21, + 16, + 2 + ], + "weighted_loads": [ + 0.3732967711985111, + 0.40971841663122177, + 0.6289677284657955, + 1.7261734157800674, + 0.6164606213569641, + 0.1424565203487873, + 0.38105520606040955, + 0.2883053869009018, + 0.9338930882513523, + 0.3656670153141022, + 0.19136191345751286, + 0.4321260014548898, + 0.7388038486242294, + 1.4724295251071453, + 4.05369645357132, + 0.4201198183000088, + 1.94713818654418, + 0.13623322267085314, + 1.190480537712574, + 1.2508267909288406, + 0.7527331672608852, + 1.1206332668662071, + 0.25312922708690166, + 0.8397436924278736, + 0.2419740241020918, + 0.31489090248942375, + 0.38532793149352074, + 0.6123246671631932, + 0.7224895767867565, + 2.368911702185869, + 2.1426777467131615, + 0.6723099835216999, + 2.282730396836996, + 1.4876281395554543, + 0.35987500101327896, + 1.0471043959259987, + 0.48160238191485405, + 0.03283311054110527, + 0.12092729285359383, + 0.5408836826682091, + 1.3671442307531834, + 1.9510830119252205, + 0.4483342729508877, + 2.670016884803772, + 1.6467282958328724, + 0.8777532149106264, + 0.21600766852498055, + 1.069721806794405, + 0.22582148015499115, + 1.444377139210701, + 0.6932416558265686, + 1.2634464018046856, + 0.6463257297873497, + 0.3046979382634163, + 1.083843333646655, + 0.43909427523612976, + 0.5574612990021706, + 0.6564487814903259, + 0.2774914801120758, + 0.6799233704805374, + 0.5856522768735886, + 1.8891275133937597, + 0.7738927491009235, + 0.07828819006681442 + ], + "unique_experts": 64, + "load_cv": 0.7296339010403502, + "normalized_load_entropy": 0.9457989903903397, + "max_load_share": 0.06575963718820861 + } + }, + "s0_x": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "c9d2102c4e765ca32e668a3cb4765d2dd08e77646cec3289e66efe9c2cad66dd", + "route_weight_sha256": "7a1c4be6944fc03f96cd76e1414f5aa1929535c5963245cd1b21f52c6f4f8ef2", + "loads": [ + 4, + 7, + 7, + 33, + 1, + 0, + 7, + 3, + 5, + 7, + 2, + 9, + 14, + 20, + 58, + 7, + 5, + 3, + 1, + 22, + 9, + 15, + 5, + 8, + 5, + 6, + 7, + 10, + 0, + 34, + 36, + 7, + 30, + 26, + 3, + 4, + 9, + 1, + 3, + 10, + 13, + 32, + 6, + 0, + 21, + 10, + 4, + 1, + 4, + 14, + 14, + 15, + 13, + 0, + 0, + 2, + 2, + 10, + 4, + 6, + 8, + 9, + 4, + 1 + ], + "weighted_loads": [ + 0.22547554224729538, + 0.374129805713892, + 0.5517630837857723, + 1.795439686626196, + 0.040227506309747696, + 0.0, + 0.38116586208343506, + 0.16148146986961365, + 0.3377590626478195, + 0.3362540043890476, + 0.0831357054412365, + 0.39819036796689034, + 0.7263783402740955, + 1.4146955497562885, + 4.0121275801211596, + 0.3052460700273514, + 0.20726271346211433, + 0.12932007759809494, + 0.03599163889884949, + 1.1929005794227123, + 0.7022384218871593, + 1.0360158756375313, + 0.17662856355309486, + 0.6027786545455456, + 0.20718073099851608, + 0.35499537736177444, + 0.27649600617587566, + 0.5569475870579481, + 0.0, + 2.416768167167902, + 1.8547274097800255, + 0.3750704862177372, + 2.308298707008362, + 1.516906913369894, + 0.14683321677148342, + 0.48785319924354553, + 0.48392927274107933, + 0.03031429462134838, + 0.11567226052284241, + 0.49814749509096146, + 0.8798824213445187, + 1.935255715623498, + 0.4032624363899231, + 0.0, + 1.5362603329122066, + 0.8353190310299397, + 0.1653833296149969, + 0.03989965841174126, + 0.22403917461633682, + 1.1305187977850437, + 0.6486579701304436, + 1.2400602772831917, + 0.6356501244008541, + 0.0, + 0.0, + 0.10649542137980461, + 0.09428133815526962, + 0.5346271023154259, + 0.17078343033790588, + 0.4417048282921314, + 0.4802703894674778, + 1.2412016578018665, + 0.14936474338173866, + 0.034235041588544846 + ], + "unique_experts": 59, + "load_cv": 1.084809949291962, + "normalized_load_entropy": 0.8856400513915555, + "max_load_share": 0.09119496855345911 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "fb1ff209add5689ce31e7b7829c73763c8743b6a55a0963bef03b45315f37dbd", + "route_weight_sha256": "49bd2a515a42e760bec84a4c57b7422b3c60fc56465d2f5c54ffe817269de02f", + "loads": [ + 4, + 9, + 8, + 33, + 6, + 0, + 7, + 3, + 9, + 8, + 4, + 11, + 14, + 20, + 58, + 13, + 10, + 5, + 13, + 22, + 9, + 15, + 5, + 13, + 5, + 6, + 7, + 12, + 6, + 34, + 42, + 16, + 32, + 26, + 8, + 8, + 9, + 1, + 3, + 10, + 19, + 32, + 6, + 21, + 23, + 10, + 4, + 9, + 4, + 19, + 14, + 15, + 13, + 1, + 4, + 3, + 2, + 10, + 8, + 7, + 9, + 15, + 13, + 1 + ], + "weighted_loads": [ + 0.22547554224729538, + 0.4444102980196476, + 0.6100245043635368, + 1.795439686626196, + 0.26320119202136993, + 0.0, + 0.38116586208343506, + 0.16148146986961365, + 0.563910435885191, + 0.36718373373150826, + 0.15025985054671764, + 0.44005453307181597, + 0.7263783402740955, + 1.4146955497562885, + 4.0121275801211596, + 0.5365551859140396, + 0.7676416374742985, + 0.17977134976536036, + 1.3005156703293324, + 1.1929005794227123, + 0.7022384218871593, + 1.0360158756375313, + 0.17662856355309486, + 0.852012861520052, + 0.20718073099851608, + 0.35499537736177444, + 0.27649600617587566, + 0.6219367971643806, + 0.4611654430627823, + 2.416768167167902, + 2.1468548607081175, + 0.7753102071583271, + 2.373802086338401, + 1.516906913369894, + 0.4197112862020731, + 0.814607810229063, + 0.48392927274107933, + 0.03031429462134838, + 0.11567226052284241, + 0.49814749509096146, + 1.2057052813470364, + 1.935255715623498, + 0.4032624363899231, + 2.0065398775041103, + 1.6636684015393257, + 0.8353190310299397, + 0.1653833296149969, + 0.6187601387500763, + 0.22403917461633682, + 1.4049938432872295, + 0.6486579701304436, + 1.2400602772831917, + 0.6356501244008541, + 0.05562260374426842, + 0.19471074268221855, + 0.15063856914639473, + 0.09428133815526962, + 0.5346271023154259, + 0.3680431880056858, + 0.49662144109606743, + 0.5109669174998999, + 1.5673990193754435, + 0.6430556885898113, + 0.034235041588544846 + ], + "unique_experts": 63, + "load_cv": 0.8599718409250325, + "normalized_load_entropy": 0.9257325277577036, + "max_load_share": 0.0737913486005089 + } + }, + "s1_x": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "d380c9ffbceb286c20933907383c0a62fcd0e05223bee4109f8cca9e80c433d9", + "route_weight_sha256": "964d5e7d20f9a8e142d30039e2166af869293cef9ab90a49f72f1050ac843e12", + "loads": [ + 5, + 8, + 8, + 31, + 1, + 0, + 7, + 3, + 5, + 7, + 1, + 9, + 14, + 20, + 60, + 7, + 5, + 3, + 1, + 22, + 9, + 15, + 3, + 8, + 6, + 5, + 10, + 9, + 0, + 34, + 34, + 6, + 29, + 26, + 3, + 4, + 9, + 0, + 3, + 9, + 13, + 31, + 6, + 0, + 20, + 12, + 4, + 1, + 4, + 14, + 15, + 15, + 13, + 0, + 0, + 2, + 2, + 11, + 5, + 6, + 8, + 10, + 4, + 1 + ], + "weighted_loads": [ + 0.26611625775694847, + 0.4170880429446697, + 0.5725844241678715, + 1.7106986157596111, + 0.04797579348087311, + 0.0, + 0.37774263322353363, + 0.15638714656233788, + 0.3445042297244072, + 0.3310643918812275, + 0.03949274495244026, + 0.39407455921173096, + 0.7264003269374371, + 1.427194457501173, + 4.099747447296977, + 0.30173090286552906, + 0.20036419481039047, + 0.11973566934466362, + 0.03497825935482979, + 1.2117819711565971, + 0.6715496331453323, + 1.0365066826343536, + 0.10435261018574238, + 0.609790213406086, + 0.24800994619727135, + 0.32542990893125534, + 0.3788827359676361, + 0.5377489328384399, + 0.0, + 2.347475677728653, + 1.7336610723286867, + 0.35568175464868546, + 2.278047449886799, + 1.5233853906393051, + 0.1295232381671667, + 0.4870050698518753, + 0.47542232275009155, + 0.0, + 0.12757115811109543, + 0.454434409737587, + 0.8738884925842285, + 1.9626726973801851, + 0.4050101041793823, + 0.0, + 1.5066396854817867, + 0.8745799846947193, + 0.16880569607019424, + 0.040196143090724945, + 0.22609280049800873, + 1.107619896531105, + 0.6982704363763332, + 1.2536387871950865, + 0.6387401036918163, + 0.0, + 0.0, + 0.10662855207920074, + 0.08782420679926872, + 0.5753360651433468, + 0.20762187987565994, + 0.4446004219353199, + 0.4840441979467869, + 1.2923455573618412, + 0.15213772282004356, + 0.03690347447991371 + ], + "unique_experts": 58, + "load_cv": 1.0808647742704414, + "normalized_load_entropy": 0.8851658420094204, + "max_load_share": 0.09433962264150944 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "7800145412afa954c053c637bfa226f7803301a83d77f51515bdc67086df640d", + "route_weight_sha256": "7eaa6f17a6d74c194d2166b93d04bfd2ab0bc78c65c88f8624bbdc8fa54e621b", + "loads": [ + 7, + 10, + 9, + 31, + 12, + 4, + 7, + 5, + 15, + 7, + 4, + 11, + 14, + 20, + 60, + 8, + 24, + 4, + 12, + 23, + 10, + 16, + 5, + 13, + 6, + 5, + 12, + 13, + 10, + 34, + 42, + 13, + 30, + 26, + 8, + 11, + 9, + 0, + 3, + 10, + 18, + 31, + 6, + 26, + 22, + 12, + 5, + 13, + 4, + 20, + 15, + 15, + 13, + 6, + 20, + 9, + 8, + 12, + 8, + 11, + 9, + 19, + 15, + 2 + ], + "weighted_loads": [ + 0.4120127819478512, + 0.49103186652064323, + 0.6201795190572739, + 1.7106986157596111, + 0.6223301030695438, + 0.1424565203487873, + 0.37774263322353363, + 0.2845940366387367, + 0.964513748884201, + 0.3310643918812275, + 0.14836777560412884, + 0.4358332762494683, + 0.7264003269374371, + 1.427194457501173, + 4.099747447296977, + 0.34155655838549137, + 1.912932962179184, + 0.1345759155228734, + 1.267788365483284, + 1.2500803768634796, + 0.7445375621318817, + 1.1087555512785912, + 0.21249539218842983, + 0.8331261351704597, + 0.24800994619727135, + 0.32542990893125534, + 0.45518239215016365, + 0.7017653109505773, + 0.7616326808929443, + 2.347475677728653, + 2.1387997437268496, + 0.6835462041199207, + 2.3105653524398804, + 1.5233853906393051, + 0.40946550108492374, + 1.0782602056860924, + 0.47542232275009155, + 0.0, + 0.12757115811109543, + 0.5010527782142162, + 1.1147707402706146, + 1.9626726973801851, + 0.4050101041793823, + 2.3783347196877003, + 1.6448792815208435, + 0.8745799846947193, + 0.21506043523550034, + 1.0053867101669312, + 0.22609280049800873, + 1.4875628724694252, + 0.6982704363763332, + 1.2536387871950865, + 0.6387401036918163, + 0.35487687587738037, + 1.1470942329615355, + 0.4381937012076378, + 0.5587275512516499, + 0.6176228262484074, + 0.3565986827015877, + 0.6583140455186367, + 0.5220341570675373, + 1.7573118936270475, + 0.7694738283753395, + 0.07924990728497505 + ], + "unique_experts": 63, + "load_cv": 0.7427091405506528, + "normalized_load_entropy": 0.9438670757242716, + "max_load_share": 0.06802721088435375 + } + }, + "s0_period": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "77d001447a59e39aee2bfbb4bb385c4e103a5c9760015924cf55392d773bb579", + "route_weight_sha256": "8201d380a42f8a2f158e86ef35b8a809caea916bf0d6a4879210d565da58cb49", + "loads": [ + 5, + 7, + 7, + 31, + 1, + 0, + 7, + 3, + 5, + 6, + 3, + 8, + 14, + 20, + 59, + 7, + 5, + 4, + 1, + 22, + 9, + 15, + 4, + 8, + 6, + 6, + 7, + 9, + 0, + 32, + 34, + 7, + 30, + 26, + 3, + 4, + 9, + 1, + 2, + 8, + 14, + 34, + 7, + 0, + 21, + 11, + 4, + 1, + 4, + 14, + 16, + 14, + 13, + 0, + 0, + 2, + 3, + 10, + 4, + 6, + 7, + 11, + 4, + 1 + ], + "weighted_loads": [ + 0.2649393565952778, + 0.37668392807245255, + 0.5531094186007977, + 1.7165585421025753, + 0.04064379259943962, + 0.0, + 0.3789537623524666, + 0.15915557369589806, + 0.3402586989104748, + 0.296207744628191, + 0.11704427748918533, + 0.3622630052268505, + 0.7402814216911793, + 1.4107555374503136, + 4.075305033475161, + 0.31329451128840446, + 0.20576239004731178, + 0.16208627074956894, + 0.03607397526502609, + 1.1872294023633003, + 0.700656346976757, + 1.0285280458629131, + 0.14715103432536125, + 0.6088940016925335, + 0.24098369106650352, + 0.35580411553382874, + 0.27505243569612503, + 0.5269590578973293, + 0.0, + 2.334094364196062, + 1.7410255428403616, + 0.37699807435274124, + 2.2959041111171246, + 1.5110058411955833, + 0.1504425462335348, + 0.49525136500597, + 0.48043281212449074, + 0.03258560225367546, + 0.06340517476201057, + 0.43141473457217216, + 0.9336184225976467, + 2.0139661952853203, + 0.44841280207037926, + 0.0, + 1.5361587181687355, + 0.8591240532696247, + 0.1704748049378395, + 0.03949456289410591, + 0.23416649922728539, + 1.1324021704494953, + 0.7226634174585342, + 1.201393686234951, + 0.6358902789652348, + 0.0, + 0.0, + 0.1071818396449089, + 0.13558350130915642, + 0.5386918038129807, + 0.1722199134528637, + 0.44061316922307014, + 0.44809452816843987, + 1.3336250372231007, + 0.14918704330921173, + 0.03348781168460846 + ], + "unique_experts": 59, + "load_cv": 1.0777863208941678, + "normalized_load_entropy": 0.8873826093574206, + "max_load_share": 0.09276729559748427 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "ae5d3e55c835cfbe299d7faf9ee94d21dff7c8438844ad60ce1d1a7e42526936", + "route_weight_sha256": "800b9b868ff905fec914aab9e51503fbe6ad2fe5b2ff5396b4b4a93e82373921", + "loads": [ + 5, + 8, + 8, + 31, + 7, + 0, + 7, + 3, + 9, + 7, + 5, + 10, + 14, + 20, + 59, + 14, + 11, + 5, + 13, + 22, + 9, + 15, + 4, + 13, + 6, + 6, + 7, + 11, + 7, + 32, + 40, + 16, + 32, + 26, + 7, + 9, + 9, + 1, + 2, + 8, + 20, + 34, + 7, + 23, + 23, + 11, + 4, + 9, + 4, + 18, + 16, + 14, + 13, + 0, + 4, + 4, + 3, + 10, + 7, + 7, + 8, + 17, + 11, + 1 + ], + "weighted_loads": [ + 0.2649393565952778, + 0.407433707267046, + 0.6113708391785622, + 1.7165585421025753, + 0.3503844290971756, + 0.0, + 0.3789537623524666, + 0.15915557369589806, + 0.5673865936696529, + 0.3271374739706516, + 0.18416842259466648, + 0.40412717033177614, + 0.7402814216911793, + 1.4107555374503136, + 4.075305033475161, + 0.5839537791907787, + 0.8200983852148056, + 0.17692651692777872, + 1.2501915507018566, + 1.1872294023633003, + 0.700656346976757, + 1.0285280458629131, + 0.14715103432536125, + 0.8581282086670399, + 0.24098369106650352, + 0.35580411553382874, + 0.27505243569612503, + 0.5888795936480165, + 0.4994458928704262, + 2.334094364196062, + 2.0331529937684536, + 0.7696454487740993, + 2.3614074904471636, + 1.5110058411955833, + 0.35040990449488163, + 0.9725234135985374, + 0.48043281212449074, + 0.03258560225367546, + 0.06340517476201057, + 0.43141473457217216, + 1.2660701535642147, + 2.0139661952853203, + 0.44841280207037926, + 2.1251609586179256, + 1.6635667867958546, + 0.8591240532696247, + 0.1704748049378395, + 0.6166993826627731, + 0.23416649922728539, + 1.3628806062042713, + 0.7226634174585342, + 1.201393686234951, + 0.6358902789652348, + 0.0, + 0.19469379261136055, + 0.1923961602151394, + 0.13558350130915642, + 0.5386918038129807, + 0.30927759781479836, + 0.4997161589562893, + 0.47805051878094673, + 1.681886812672019, + 0.5739775449037552, + 0.03348781168460846 + ], + "unique_experts": 62, + "load_cv": 0.8571967336137588, + "normalized_load_entropy": 0.9256504450982256, + "max_load_share": 0.07506361323155217 + } + }, + "s1_period": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "c7e8678fad0d4e60fc1d6863df4cba0828fb76dfe05d5cd7ed1e113e70d9be80", + "route_weight_sha256": "5f6d52bfa4a8dd01208cc9e75ead222fff2bb1e6fc489ed47fb5a1193a62953d", + "loads": [ + 4, + 8, + 8, + 32, + 1, + 0, + 7, + 3, + 5, + 7, + 2, + 9, + 14, + 21, + 59, + 8, + 3, + 2, + 1, + 24, + 9, + 15, + 5, + 8, + 6, + 5, + 8, + 9, + 0, + 33, + 36, + 6, + 29, + 26, + 2, + 4, + 9, + 1, + 3, + 9, + 14, + 31, + 6, + 0, + 20, + 11, + 4, + 1, + 4, + 13, + 15, + 14, + 13, + 0, + 0, + 2, + 2, + 12, + 5, + 6, + 8, + 9, + 4, + 1 + ], + "weighted_loads": [ + 0.22854209318757057, + 0.40580397099256516, + 0.5616800263524055, + 1.7534951977431774, + 0.04788433015346527, + 0.0, + 0.3795938603579998, + 0.15802503377199173, + 0.34211885184049606, + 0.33383723348379135, + 0.08255798369646072, + 0.3965435065329075, + 0.735425565391779, + 1.4770615361630917, + 4.078342370688915, + 0.3437553532421589, + 0.11620011180639267, + 0.08237278833985329, + 0.03479750454425812, + 1.29151401668787, + 0.6660042144358158, + 1.034984566271305, + 0.17461837455630302, + 0.606599785387516, + 0.24767608381807804, + 0.3255396969616413, + 0.31240995414555073, + 0.5380390956997871, + 0.0, + 2.33070819824934, + 1.759863093495369, + 0.35527923330664635, + 2.2829545848071575, + 1.5086623542010784, + 0.10802721604704857, + 0.491436243057251, + 0.4803677648305893, + 0.03377896547317505, + 0.12700237706303596, + 0.456100856885314, + 0.918097548186779, + 1.936300877481699, + 0.4063011147081852, + 0.0, + 1.517186313867569, + 0.8459239769726992, + 0.16704333573579788, + 0.041429273784160614, + 0.22977983206510544, + 1.0957680828869343, + 0.7049198113381863, + 1.239095401018858, + 0.6458583474159241, + 0.0, + 0.0, + 0.10580531135201454, + 0.08893309161067009, + 0.6214306205511093, + 0.208902133628726, + 0.4315166026353836, + 0.4780960790812969, + 1.2323407121002674, + 0.15008137375116348, + 0.037111781537532806 + ], + "unique_experts": 59, + "load_cv": 1.085684707986098, + "normalized_load_entropy": 0.8847810325533897, + "max_load_share": 0.09276729559748427 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "67c1edcf81b68ee990835551b3283e241aaafcd508ecc771bf0591b3b288fb54", + "route_weight_sha256": "5f887d43448e42e54bc07a8061f1e4b719e5a6f1b9cd7b5c8d09bb40f65d9ba3", + "loads": [ + 6, + 9, + 9, + 32, + 13, + 6, + 7, + 5, + 15, + 7, + 5, + 11, + 14, + 21, + 60, + 11, + 22, + 3, + 11, + 25, + 10, + 16, + 7, + 13, + 6, + 5, + 10, + 12, + 11, + 33, + 44, + 12, + 30, + 26, + 7, + 12, + 9, + 1, + 3, + 10, + 19, + 31, + 6, + 25, + 22, + 11, + 5, + 14, + 4, + 18, + 15, + 14, + 13, + 5, + 19, + 9, + 8, + 13, + 7, + 11, + 10, + 18, + 14, + 2 + ], + "weighted_loads": [ + 0.3744386173784733, + 0.4387367069721222, + 0.6092751212418079, + 1.7534951977431774, + 0.6899398826062679, + 0.215272706001997, + 0.3795938603579998, + 0.2862319238483906, + 0.9578404575586319, + 0.33383723348379135, + 0.1914330143481493, + 0.43830222357064486, + 0.735425565391779, + 1.4770615361630917, + 4.11788634210825, + 0.4513397812843323, + 1.8350116088986397, + 0.09721303451806307, + 1.1903573609888554, + 1.3298124223947525, + 0.7389921434223652, + 1.1072334349155426, + 0.2827611565589905, + 0.8299357071518898, + 0.24767608381807804, + 0.3255396969616413, + 0.38870961032807827, + 0.6533834496513009, + 0.8186613582074642, + 2.33070819824934, + 2.165001764893532, + 0.6339335218071938, + 2.315472487360239, + 1.5086623542010784, + 0.3715117909014225, + 1.142939930781722, + 0.4803677648305893, + 0.03377896547317505, + 0.12700237706303596, + 0.5027192253619432, + 1.173092357814312, + 1.936300877481699, + 0.4063011147081852, + 2.349483333528042, + 1.6554259099066257, + 0.8459239769726992, + 0.21329807490110397, + 1.0472594983875751, + 0.22977983206510544, + 1.4259384460747242, + 0.7049198113381863, + 1.239095401018858, + 0.6458583474159241, + 0.3046979382634163, + 1.11983329243958, + 0.4373704604804516, + 0.5598364360630512, + 0.6637173816561699, + 0.31061561591923237, + 0.6432742960751057, + 0.5561557821929455, + 1.7039711382240057, + 0.6968223340809345, + 0.07945821434259415 + ], + "unique_experts": 64, + "load_cv": 0.7438160205367139, + "normalized_load_entropy": 0.9449545981402929, + "max_load_share": 0.06802721088435375 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 106, + "ordered_topk_exact_tokens": 85, + "set_exact_tokens": 92, + "mean_set_jaccard": 0.9622641509433962, + "mean_token_weighted_tv": 0.008896002633813417, + "aggregate_load_tv": 0.020440251572327043 + }, + "system_bos": { + "tokens": 106, + "ordered_topk_exact_tokens": 67, + "set_exact_tokens": 79, + "mean_set_jaccard": 0.9231805929919138, + "mean_token_weighted_tv": 0.016882307001582858, + "aggregate_load_tv": 0.029874213836477995 + }, + "system_x": { + "tokens": 106, + "ordered_topk_exact_tokens": 70, + "set_exact_tokens": 87, + "mean_set_jaccard": 0.9467654986522911, + "mean_token_weighted_tv": 0.01451364916942592, + "aggregate_load_tv": 0.023584905660377367 + }, + "system_period": { + "tokens": 106, + "ordered_topk_exact_tokens": 63, + "set_exact_tokens": 75, + "mean_set_jaccard": 0.9164420485175203, + "mean_token_weighted_tv": 0.018576885564779898, + "aggregate_load_tv": 0.031446540880503145 + }, + "bos_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 62, + "set_exact_tokens": 73, + "mean_set_jaccard": 0.9049865229110514, + "mean_token_weighted_tv": 0.020247828417440068, + "aggregate_load_tv": 0.0330188679245283 + }, + "bos_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 58, + "set_exact_tokens": 69, + "mean_set_jaccard": 0.8942048517520216, + "mean_token_weighted_tv": 0.02231206963682231, + "aggregate_load_tv": 0.036163522012578615 + }, + "x_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 52, + "set_exact_tokens": 69, + "mean_set_jaccard": 0.8942048517520216, + "mean_token_weighted_tv": 0.021506185476439742, + "aggregate_load_tv": 0.03773584905660378 + }, + "x_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 50, + "set_exact_tokens": 68, + "mean_set_jaccard": 0.8874663072776281, + "mean_token_weighted_tv": 0.02473888060359179, + "aggregate_load_tv": 0.04402515723270441 + }, + "period_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 50, + "set_exact_tokens": 68, + "mean_set_jaccard": 0.8915094339622641, + "mean_token_weighted_tv": 0.021246212183163977, + "aggregate_load_tv": 0.04088050314465408 + }, + "period_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 52, + "set_exact_tokens": 67, + "mean_set_jaccard": 0.8867924528301887, + "mean_token_weighted_tv": 0.024089205228143704, + "aggregate_load_tv": 0.039308176100628936 + } + } + }, + "layer_12": { + "layer": 12, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "6cbad277acf6519be46f7821ca0be87241d4cbd843bd9328340d0b4c9d0406ad", + "route_weight_sha256": "78edc1275e6e1072879fd25f622a9a49403f5abc10b7e442ccc39c34ca557610", + "loads": [ + 12, + 12, + 17, + 8, + 7, + 23, + 48, + 5, + 2, + 0, + 0, + 15, + 5, + 12, + 17, + 5, + 12, + 2, + 12, + 4, + 17, + 18, + 5, + 6, + 1, + 13, + 1, + 9, + 0, + 0, + 1, + 6, + 4, + 13, + 5, + 10, + 2, + 14, + 1, + 5, + 61, + 0, + 1, + 21, + 1, + 10, + 1, + 3, + 1, + 36, + 17, + 23, + 24, + 4, + 12, + 6, + 8, + 6, + 3, + 4, + 3, + 7, + 14, + 21 + ], + "weighted_loads": [ + 0.6971328500658274, + 0.7905490435659885, + 0.9895778317004442, + 0.6389426440000534, + 0.3310254942625761, + 1.1895442083477974, + 3.4106342308223248, + 0.2964579239487648, + 0.07914519682526588, + 0.0, + 0.0, + 0.7411461696028709, + 0.32240111008286476, + 0.6477220691740513, + 0.884047219529748, + 0.22011923044919968, + 0.581856407225132, + 0.2505287379026413, + 0.7328612506389618, + 0.2121775969862938, + 1.335206501185894, + 0.9796921536326408, + 0.3051856979727745, + 0.29270659387111664, + 0.03502165153622627, + 0.6530428230762482, + 0.03942021355032921, + 0.6414456404745579, + 0.0, + 0.0, + 0.03294021636247635, + 0.3096100501716137, + 0.14975859224796295, + 1.5039398930966854, + 0.42433836311101913, + 0.4435684122145176, + 0.08682530000805855, + 0.9780723862349987, + 0.04304194822907448, + 0.30278779938817024, + 4.342488821595907, + 0.0, + 0.0316978357732296, + 1.967620100826025, + 0.05664372444152832, + 0.6352357342839241, + 0.04257562384009361, + 0.19205279648303986, + 0.03744896128773689, + 2.011653019115329, + 1.6258794851601124, + 1.8244091980159283, + 1.529139768332243, + 0.18804795667529106, + 0.6492206156253815, + 0.2536538504064083, + 0.44153790175914764, + 0.36063080094754696, + 0.10567788779735565, + 0.24461771175265312, + 0.13280197232961655, + 0.5850950740277767, + 1.0454378053545952, + 1.5036349967122078 + ], + "unique_experts": 59, + "load_cv": 1.1057562511648893, + "normalized_load_entropy": 0.8819827532059923, + "max_load_share": 0.0959119496855346 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "abebb2955da1ea0cafa50633f3ea9be5073f1cf11cc0db8bbc0758a37fc9e426", + "route_weight_sha256": "804a2e904924e7399f6d56b88e658502126f17796524c8ab59f32e5b85019146", + "loads": [ + 12, + 12, + 17, + 13, + 9, + 24, + 48, + 7, + 9, + 0, + 0, + 15, + 10, + 12, + 17, + 5, + 15, + 2, + 12, + 4, + 18, + 18, + 6, + 11, + 1, + 13, + 2, + 17, + 15, + 10, + 4, + 12, + 5, + 15, + 5, + 17, + 2, + 18, + 15, + 5, + 61, + 5, + 6, + 22, + 3, + 11, + 2, + 7, + 6, + 37, + 18, + 23, + 24, + 4, + 12, + 6, + 11, + 6, + 4, + 8, + 3, + 12, + 19, + 24 + ], + "weighted_loads": [ + 0.6971328500658274, + 0.7905490435659885, + 0.9895778317004442, + 0.7619459067936987, + 1.8837109934538603, + 1.1936232261359692, + 3.4106342308223248, + 0.41196583956480026, + 0.5703594721853733, + 0.0, + 0.0, + 0.7411461696028709, + 0.574132863432169, + 0.6477220691740513, + 0.884047219529748, + 0.22011923044919968, + 0.751900739967823, + 0.2505287379026413, + 0.7328612506389618, + 0.2121775969862938, + 1.337522826390341, + 0.9796921536326408, + 0.3556837886571884, + 0.7509812340140343, + 0.03502165153622627, + 0.6530428230762482, + 0.0721893422305584, + 1.0648913383483887, + 1.910487700253725, + 1.4811587743461132, + 0.13796357810497284, + 0.5863526053726673, + 0.1963835246860981, + 1.6231118626892567, + 0.42433836311101913, + 0.9409579262137413, + 0.08682530000805855, + 1.0919196605682373, + 1.1368934363126755, + 0.30278779938817024, + 4.342488821595907, + 0.4555625859647989, + 0.37558584846556187, + 2.082743775099516, + 0.14624306187033653, + 0.6748358532786369, + 0.086761973798275, + 0.4196388367563486, + 0.29325632378458977, + 2.057834694162011, + 1.6388161508366466, + 1.8244091980159283, + 1.529139768332243, + 0.18804795667529106, + 0.6492206156253815, + 0.2536538504064083, + 0.5448721596039832, + 0.36063080094754696, + 0.17074143886566162, + 0.4161285227164626, + 0.13280197232961655, + 0.8148258421570063, + 1.3680629171431065, + 1.5974443964660168 + ], + "unique_experts": 62, + "load_cv": 0.8550186277027555, + "normalized_load_entropy": 0.9266020529806855, + "max_load_share": 0.07760814249363868 + } + }, + "s1_eos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "3b2a40cd59d1417b2ef85845b963d2acebb2f45cfcc45e24d92bc354deb3c852", + "route_weight_sha256": "9dc5e2c720554166360cc326e7fb47be61bba6dac01c1ba6deded85a0c6a09ae", + "loads": [ + 11, + 12, + 15, + 9, + 7, + 22, + 48, + 5, + 1, + 0, + 0, + 16, + 5, + 12, + 17, + 5, + 12, + 2, + 11, + 4, + 17, + 18, + 5, + 7, + 1, + 12, + 1, + 8, + 0, + 1, + 1, + 6, + 4, + 13, + 5, + 10, + 2, + 14, + 1, + 6, + 64, + 0, + 1, + 21, + 1, + 10, + 1, + 3, + 1, + 35, + 17, + 24, + 24, + 4, + 13, + 6, + 8, + 5, + 2, + 5, + 3, + 7, + 14, + 21 + ], + "weighted_loads": [ + 0.6555048078298569, + 0.7865678183734417, + 0.9182407259941101, + 0.6739293970167637, + 0.33290589414536953, + 1.1545022185891867, + 3.4247875530272722, + 0.29972341656684875, + 0.03934863954782486, + 0.0, + 0.0, + 0.7741447165608406, + 0.330065805464983, + 0.6505865044891834, + 0.8813594933599234, + 0.21509460732340813, + 0.580751933157444, + 0.24283894151449203, + 0.6942517980933189, + 0.22422561794519424, + 1.3247162476181984, + 0.9834112972021103, + 0.3093375898897648, + 0.314431918784976, + 0.03573000803589821, + 0.6269085444509983, + 0.0388675220310688, + 0.6065557822585106, + 0.0, + 0.030410438776016235, + 0.03382682427763939, + 0.320358470082283, + 0.1479145586490631, + 1.494091834872961, + 0.4285473860800266, + 0.4504924565553665, + 0.09037059918045998, + 0.9533298090100288, + 0.04008999094367027, + 0.32812267541885376, + 4.423538137227297, + 0.0, + 0.036108411848545074, + 1.9414792396128178, + 0.05539384111762047, + 0.6450115963816643, + 0.04258597642183304, + 0.1903177797794342, + 0.03712649643421173, + 1.988708458840847, + 1.6311638616025448, + 1.8233291264623404, + 1.5317815095186234, + 0.1917574480175972, + 0.705532044172287, + 0.25095947086811066, + 0.4368585254997015, + 0.3225975073873997, + 0.06551341712474823, + 0.3074513301253319, + 0.13583743572235107, + 0.5783410370349884, + 1.0395659618079662, + 1.499690379947424 + ], + "unique_experts": 60, + "load_cv": 1.122936557250457, + "normalized_load_entropy": 0.8811249535958439, + "max_load_share": 0.10062893081761007 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "80fe4d6f960def1834a417e4f75aed9fc259cb469733170a6f6754e850fec8fc", + "route_weight_sha256": "96580d1d857f9df6c1411c5b1d5ee0292a79c62a1d3e7278e8afc1393fb0bafa", + "loads": [ + 15, + 12, + 15, + 12, + 12, + 23, + 48, + 10, + 8, + 3, + 1, + 16, + 9, + 12, + 17, + 5, + 16, + 4, + 12, + 4, + 18, + 20, + 7, + 13, + 1, + 12, + 4, + 15, + 17, + 16, + 12, + 11, + 8, + 18, + 10, + 17, + 2, + 18, + 19, + 6, + 64, + 11, + 9, + 24, + 14, + 14, + 4, + 9, + 9, + 36, + 19, + 24, + 24, + 7, + 13, + 6, + 11, + 11, + 3, + 10, + 5, + 16, + 20, + 21 + ], + "weighted_loads": [ + 0.8465703129768372, + 0.7865678183734417, + 0.9182407259941101, + 0.7281197472475469, + 1.994316903874278, + 1.1584246568381786, + 3.4247875530272722, + 0.5571334287524223, + 0.6237003356218338, + 0.3142116814851761, + 0.041834063827991486, + 0.7741447165608406, + 0.5171141102910042, + 0.6505865044891834, + 0.8813594933599234, + 0.21509460732340813, + 0.8661869466304779, + 0.3547147512435913, + 0.7301300726830959, + 0.22422561794519424, + 1.327055960893631, + 1.072738628834486, + 0.3953136317431927, + 0.7759487126022577, + 0.03573000803589821, + 0.6269085444509983, + 0.1617760956287384, + 0.9710963517427444, + 2.206500019878149, + 2.3143096566200256, + 0.8928064331412315, + 0.549959747120738, + 0.32460073567926884, + 1.8183910138905048, + 0.6839220449328423, + 1.0112230759114027, + 0.09037059918045998, + 1.1307894438505173, + 1.4244776628911495, + 0.32812267541885376, + 4.423538137227297, + 0.9414538592100143, + 0.49997467175126076, + 2.165744248777628, + 1.2533623091876507, + 0.9538998417556286, + 0.18067467585206032, + 0.5119804870337248, + 0.43579139560461044, + 2.037308819591999, + 1.6966787157580256, + 1.8233291264623404, + 1.5317815095186234, + 0.3508767709136009, + 0.705532044172287, + 0.25095947086811066, + 0.5161576839163899, + 0.5741574391722679, + 0.12915755808353424, + 0.504378592595458, + 0.20471677370369434, + 1.048981960862875, + 1.4158107750117779, + 1.499690379947424 + ], + "unique_experts": 64, + "load_cv": 0.7358093209317683, + "normalized_load_entropy": 0.9468468654849046, + "max_load_share": 0.07256235827664399 + } + }, + "s0_bos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "f39e86d442c2ca38c9185e52c08cde6fcb4172b63e7eb24d0da1a1561d8415a2", + "route_weight_sha256": "0293a4b86ec7c3cf725885d10cb3ccf752f56312ce9056b6943d76d2927ffc59", + "loads": [ + 11, + 12, + 16, + 10, + 7, + 25, + 48, + 5, + 1, + 0, + 2, + 15, + 5, + 12, + 16, + 6, + 12, + 2, + 10, + 4, + 16, + 17, + 5, + 6, + 1, + 12, + 2, + 8, + 0, + 0, + 0, + 7, + 6, + 12, + 5, + 10, + 2, + 14, + 1, + 6, + 64, + 0, + 1, + 20, + 1, + 9, + 1, + 3, + 1, + 35, + 17, + 23, + 24, + 4, + 13, + 6, + 8, + 5, + 2, + 6, + 3, + 8, + 12, + 21 + ], + "weighted_loads": [ + 0.6805925983935595, + 0.778975322842598, + 0.979119922965765, + 0.7143946178257465, + 0.3265245035290718, + 1.2321515399962664, + 3.449734279885888, + 0.3042266108095646, + 0.03791159763932228, + 0.0, + 0.06779322773218155, + 0.7421177737414837, + 0.3181958608329296, + 0.6272458992898464, + 0.8345671538263559, + 0.2751522734761238, + 0.5917846392840147, + 0.24424227327108383, + 0.6681391559541225, + 0.20421937480568886, + 1.2995921820402145, + 0.9406380616128445, + 0.30007433146238327, + 0.28691495954990387, + 0.03458259999752045, + 0.6308779790997505, + 0.07042649760842323, + 0.6042939908802509, + 0.0, + 0.0, + 0.0, + 0.35016118362545967, + 0.20904240757226944, + 1.4495234750211239, + 0.4167904779314995, + 0.45712703093886375, + 0.08896979689598083, + 0.9430523999035358, + 0.03933161869645119, + 0.3408091776072979, + 4.542424900457263, + 0.0, + 0.03317977115511894, + 1.9613042958080769, + 0.05894197151064873, + 0.6183952949941158, + 0.041644640266895294, + 0.1734653003513813, + 0.043217141181230545, + 1.9674808382987976, + 1.6538671553134918, + 1.9026563689112663, + 1.520186636596918, + 0.19885730370879173, + 0.6944091841578484, + 0.2544047497212887, + 0.4659224562346935, + 0.3741695135831833, + 0.0694199800491333, + 0.34174125269055367, + 0.1328296810388565, + 0.6203080732375383, + 0.9036745242774487, + 1.505216434597969 + ], + "unique_experts": 59, + "load_cv": 1.11700308777787, + "normalized_load_entropy": 0.8829329673996275, + "max_load_share": 0.10062893081761007 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "8072ee7295add64fb3e3a210a1281a602ba4fa4532cfc456367eff2f58477b63", + "route_weight_sha256": "3a9cdb077a8663a9319bde312027354e35e5ba30d440f7e38538ce820c0fc361", + "loads": [ + 11, + 12, + 16, + 14, + 8, + 25, + 48, + 7, + 9, + 0, + 2, + 15, + 11, + 12, + 16, + 6, + 17, + 2, + 10, + 4, + 16, + 17, + 6, + 11, + 1, + 12, + 4, + 16, + 16, + 10, + 2, + 14, + 7, + 14, + 5, + 17, + 2, + 18, + 15, + 6, + 64, + 5, + 5, + 21, + 3, + 10, + 2, + 7, + 6, + 36, + 18, + 23, + 24, + 4, + 13, + 6, + 10, + 5, + 3, + 10, + 3, + 13, + 17, + 24 + ], + "weighted_loads": [ + 0.6805925983935595, + 0.778975322842598, + 0.979119922965765, + 0.8342744819819927, + 0.9290745928883553, + 1.2321515399962664, + 3.449734279885888, + 0.4196794852614403, + 0.6044096276164055, + 0.0, + 0.06779322773218155, + 0.7421177737414837, + 0.6300383321940899, + 0.6272458992898464, + 0.8345671538263559, + 0.2751522734761238, + 0.8354187067598104, + 0.24424227327108383, + 0.6681391559541225, + 0.20421937480568886, + 1.2995921820402145, + 0.9406380616128445, + 0.3505724221467972, + 0.7451895996928215, + 0.03458259999752045, + 0.6308779790997505, + 0.14555450901389122, + 1.0277396887540817, + 1.910970788449049, + 1.567954920232296, + 0.06245002523064613, + 0.6741179265081882, + 0.2556673400104046, + 1.5658033452928066, + 0.4167904779314995, + 0.9545165449380875, + 0.08896979689598083, + 1.0568996742367744, + 1.21843546256423, + 0.3408091776072979, + 4.542424900457263, + 0.4772850461304188, + 0.3456985019147396, + 2.0781098566949368, + 0.15260877832770348, + 0.6579954139888287, + 0.08427504077553749, + 0.39571417681872845, + 0.2938905283808708, + 2.0110211335122585, + 1.666803820990026, + 1.9026563689112663, + 1.520186636596918, + 0.19885730370879173, + 0.6944091841578484, + 0.2544047497212887, + 0.5646552331745625, + 0.3741695135831833, + 0.1328727975487709, + 0.5676612704992294, + 0.1328296810388565, + 0.8418298214673996, + 1.2181828990578651, + 1.599025834351778 + ], + "unique_experts": 63, + "load_cv": 0.8644174501455169, + "normalized_load_entropy": 0.927683694345073, + "max_load_share": 0.08142493638676845 + } + }, + "s1_bos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "6f0a3cabda4ee7afcbb81fdc28ea0eeb925745950bb0ecf67f1d3fc52f0dea77", + "route_weight_sha256": "bcb8d2ebecbfcc763524d4ca7df0bb9372aa86e3c8898990c81f494403d7067f", + "loads": [ + 11, + 12, + 16, + 9, + 8, + 23, + 46, + 5, + 1, + 0, + 2, + 15, + 5, + 12, + 17, + 5, + 11, + 2, + 11, + 4, + 16, + 17, + 5, + 7, + 0, + 12, + 2, + 8, + 1, + 0, + 1, + 5, + 5, + 12, + 5, + 9, + 2, + 13, + 1, + 6, + 64, + 0, + 1, + 20, + 2, + 8, + 1, + 4, + 1, + 37, + 18, + 24, + 24, + 4, + 14, + 6, + 9, + 7, + 1, + 6, + 3, + 6, + 14, + 20 + ], + "weighted_loads": [ + 0.6617584768682718, + 0.7719002924859524, + 0.9715378768742085, + 0.6631711274385452, + 0.35639694705605507, + 1.1796947177499533, + 3.363359933719039, + 0.30476706475019455, + 0.03885319456458092, + 0.0, + 0.0655163861811161, + 0.7461464069783688, + 0.31039537861943245, + 0.6352530755102634, + 0.858994634822011, + 0.21914881467819214, + 0.5576681233942509, + 0.24478840827941895, + 0.7049075774848461, + 0.21099242940545082, + 1.300105955451727, + 0.9263913687318563, + 0.3180011659860611, + 0.3125406876206398, + 0.0, + 0.6343116816133261, + 0.07342322170734406, + 0.5986761562526226, + 0.02873198501765728, + 0.0, + 0.031563807278871536, + 0.29300884529948235, + 0.17599324882030487, + 1.4176144003868103, + 0.41999124363064766, + 0.416216105222702, + 0.09265491366386414, + 0.8880064785480499, + 0.040612779557704926, + 0.3304339610040188, + 4.545307399705052, + 0.0, + 0.036641236394643784, + 1.8950611501932144, + 0.08829724229872227, + 0.5745035819709301, + 0.04467804729938507, + 0.21591593697667122, + 0.03941318765282631, + 2.0514433942735195, + 1.71769367903471, + 1.8849452435970306, + 1.525171872228384, + 0.19643478840589523, + 0.7425677739083767, + 0.26640833355486393, + 0.48900022730231285, + 0.43819762021303177, + 0.03559261932969093, + 0.334776621311903, + 0.13794799521565437, + 0.5184172205626965, + 0.9949854090809822, + 1.4640130139887333 + ], + "unique_experts": 60, + "load_cv": 1.1121766181818684, + "normalized_load_entropy": 0.8843352799477366, + "max_load_share": 0.10062893081761007 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "651d14dcdac6ef04ad304e45b40ebc378927e00f26811fd6510d656ef30da39b", + "route_weight_sha256": "a68b1e85d5f488f4b91c6ed592968317166abe6ec8ac6e5c8b80fa5b0c5e317e", + "loads": [ + 15, + 12, + 16, + 11, + 11, + 23, + 46, + 11, + 9, + 3, + 3, + 15, + 10, + 12, + 17, + 5, + 16, + 4, + 12, + 4, + 16, + 19, + 7, + 13, + 0, + 12, + 5, + 15, + 18, + 18, + 12, + 10, + 9, + 17, + 10, + 16, + 2, + 17, + 19, + 6, + 64, + 11, + 7, + 23, + 15, + 12, + 4, + 10, + 10, + 38, + 20, + 24, + 24, + 7, + 14, + 6, + 11, + 13, + 2, + 11, + 5, + 15, + 20, + 20 + ], + "weighted_loads": [ + 0.8528239820152521, + 0.7719002924859524, + 0.9715378768742085, + 0.7144197262823582, + 1.0288348235189915, + 1.1796947177499533, + 3.363359933719039, + 0.6008292958140373, + 0.7330865189433098, + 0.3142116814851761, + 0.10735045000910759, + 0.7461464069783688, + 0.5714981965720654, + 0.6352530755102634, + 0.858994634822011, + 0.21914881467819214, + 0.8849611394107342, + 0.3566642180085182, + 0.7407858520746231, + 0.21099242940545082, + 1.300105955451727, + 1.015718700364232, + 0.403977207839489, + 0.7740574814379215, + 0.0, + 0.6343116816133261, + 0.19633179530501366, + 0.9632167257368565, + 2.34886490739882, + 2.5343479365110397, + 0.8905434161424637, + 0.5218173246830702, + 0.3526794258505106, + 1.736036203801632, + 0.6753659024834633, + 0.9769467245787382, + 0.09265491366386414, + 1.0654661133885384, + 1.546889539808035, + 0.3304339610040188, + 4.545307399705052, + 0.9600710533559322, + 0.42569465562701225, + 2.100813776254654, + 1.2878421787172556, + 0.8833918273448944, + 0.18175877258181572, + 0.5431576538830996, + 0.4775346368551254, + 2.098359640687704, + 1.7832085331901908, + 1.8849452435970306, + 1.525171872228384, + 0.35555411130189896, + 0.7425677739083767, + 0.26640833355486393, + 0.5481204763054848, + 0.6897575519979, + 0.10090281441807747, + 0.5573806799948215, + 0.20682733319699764, + 0.9855483919382095, + 1.3769110217690468, + 1.4640130139887333 + ], + "unique_experts": 63, + "load_cv": 0.7285054732792168, + "normalized_load_entropy": 0.9475863972819915, + "max_load_share": 0.07256235827664399 + } + }, + "s0_x": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "a489432f8ff46de1ed79bb16bf2b151e380e728ed2faa25e8e6739155947a70a", + "route_weight_sha256": "0b9910df805fa2d6c92f901c71121a7cf51b2e29fa288d46aa55b74f8324cb3d", + "loads": [ + 10, + 12, + 16, + 9, + 7, + 25, + 48, + 5, + 1, + 0, + 1, + 14, + 5, + 12, + 15, + 5, + 11, + 2, + 11, + 4, + 17, + 18, + 5, + 7, + 1, + 13, + 3, + 8, + 0, + 0, + 0, + 5, + 6, + 13, + 5, + 10, + 3, + 14, + 1, + 6, + 63, + 0, + 1, + 21, + 1, + 9, + 1, + 3, + 1, + 34, + 18, + 22, + 24, + 5, + 13, + 7, + 8, + 6, + 2, + 5, + 3, + 7, + 13, + 21 + ], + "weighted_loads": [ + 0.6220101974904537, + 0.785813432186842, + 0.9811211451888084, + 0.6665273923426867, + 0.31897960789501667, + 1.22510108910501, + 3.484336569905281, + 0.2976859398186207, + 0.033640943467617035, + 0.0, + 0.0351988710463047, + 0.6918587200343609, + 0.31453392654657364, + 0.6232833974063396, + 0.7981158867478371, + 0.232985008507967, + 0.5687755197286606, + 0.24637512117624283, + 0.7144378684461117, + 0.19526052847504616, + 1.360332366079092, + 0.9843666162341833, + 0.29303212091326714, + 0.3139064908027649, + 0.034225448966026306, + 0.658540666103363, + 0.09833114966750145, + 0.5872109457850456, + 0.0, + 0.0, + 0.0, + 0.25953194685280323, + 0.2102347146719694, + 1.4493193812668324, + 0.4108068197965622, + 0.4556513652205467, + 0.12351664900779724, + 0.9418922960758209, + 0.04299463331699371, + 0.33383291959762573, + 4.493560086935759, + 0.0, + 0.033207815140485764, + 1.9946229979395866, + 0.060692183673381805, + 0.6225031688809395, + 0.04223524034023285, + 0.15791162848472595, + 0.03950551524758339, + 1.9585925750434399, + 1.691422201693058, + 1.8401892594993114, + 1.5206326991319656, + 0.24081376194953918, + 0.7077709510922432, + 0.28794315829873085, + 0.44911888241767883, + 0.42027491703629494, + 0.07187170162796974, + 0.3000498451292515, + 0.1392827183008194, + 0.5952249430119991, + 0.9599856846034527, + 1.4892005510628223 + ], + "unique_experts": 59, + "load_cv": 1.1076148465567635, + "normalized_load_entropy": 0.8838418713262023, + "max_load_share": 0.09905660377358491 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "3a51cb56f25bcdb8591a362f8d77bd10dc2f89ed961786695de877533863ba43", + "route_weight_sha256": "de6e1d678a3fbe6edf41f05dc8b131f5303231f9f0d5b40d6e0eba70c6d9b778", + "loads": [ + 10, + 12, + 16, + 13, + 8, + 25, + 48, + 8, + 8, + 0, + 1, + 14, + 10, + 12, + 15, + 5, + 13, + 2, + 11, + 4, + 17, + 18, + 6, + 13, + 1, + 13, + 4, + 17, + 17, + 10, + 3, + 11, + 7, + 15, + 5, + 18, + 3, + 18, + 15, + 6, + 63, + 6, + 4, + 22, + 3, + 11, + 2, + 7, + 6, + 35, + 19, + 22, + 24, + 5, + 13, + 7, + 10, + 6, + 3, + 8, + 3, + 13, + 18, + 24 + ], + "weighted_loads": [ + 0.6220101974904537, + 0.785813432186842, + 0.9811211451888084, + 0.7864072564989328, + 0.9215296972543001, + 1.22510108910501, + 3.484336569905281, + 0.4553254321217537, + 0.5165938660502434, + 0.0, + 0.0351988710463047, + 0.6918587200343609, + 0.5791530385613441, + 0.6232833974063396, + 0.7981158867478371, + 0.232985008507967, + 0.7066461183130741, + 0.24637512117624283, + 0.7144378684461117, + 0.19526052847504616, + 1.360332366079092, + 0.9843666162341833, + 0.34353021159768105, + 0.9221084490418434, + 0.034225448966026306, + 0.658540666103363, + 0.13110027834773064, + 1.0677422434091568, + 2.145022638142109, + 1.3354610279202461, + 0.11649371311068535, + 0.5460702124983072, + 0.25685964711010456, + 1.5580124594271183, + 0.4108068197965622, + 1.028655033558607, + 0.12351664900779724, + 1.0557395704090595, + 1.0855621621012688, + 0.33383291959762573, + 4.493560086935759, + 0.518140971660614, + 0.3023580498993397, + 2.098040707409382, + 0.14922301471233368, + 0.7139428071677685, + 0.08679278567433357, + 0.36230248026549816, + 0.29922908917069435, + 2.002254743129015, + 1.7043588673695922, + 1.8401892594993114, + 1.5206326991319656, + 0.24081376194953918, + 0.7077709510922432, + 0.28794315829873085, + 0.5478516593575478, + 0.42027491703629494, + 0.138724934309721, + 0.4587544873356819, + 0.1392827183008194, + 0.9054521787911654, + 1.277702011168003, + 1.5830099508166313 + ], + "unique_experts": 63, + "load_cv": 0.8556242132999753, + "normalized_load_entropy": 0.928785483870232, + "max_load_share": 0.08015267175572519 + } + }, + "s1_x": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "e104f7e05def3cb26f978934e752d9b66cf951098255d3be11a1fe43ca18a91b", + "route_weight_sha256": "edddc4992aec663bb7be8ee89179030ffc24c8b827504398fa7512970c972fd0", + "loads": [ + 9, + 12, + 14, + 9, + 8, + 23, + 47, + 5, + 0, + 0, + 1, + 16, + 5, + 12, + 16, + 6, + 11, + 2, + 13, + 5, + 17, + 17, + 5, + 6, + 1, + 11, + 2, + 9, + 1, + 0, + 0, + 6, + 6, + 13, + 5, + 9, + 3, + 14, + 1, + 6, + 63, + 0, + 1, + 20, + 2, + 8, + 1, + 3, + 1, + 37, + 18, + 23, + 24, + 4, + 14, + 6, + 8, + 7, + 2, + 5, + 4, + 6, + 13, + 20 + ], + "weighted_loads": [ + 0.594809964299202, + 0.754401046782732, + 0.9073624685406685, + 0.6463728696107864, + 0.3464887998998165, + 1.1537264585494995, + 3.42166150175035, + 0.3048822954297066, + 0.0, + 0.0, + 0.03273693472146988, + 0.7770615592598915, + 0.303061880171299, + 0.6602806095033884, + 0.8091996945440769, + 0.2629665229469538, + 0.5623180475085974, + 0.2417220026254654, + 0.7796228900551796, + 0.22679025679826736, + 1.336853438988328, + 0.9280406087636948, + 0.3082987442612648, + 0.2868262119591236, + 0.0340694822371006, + 0.604411318898201, + 0.0742533951997757, + 0.6279209293425083, + 0.030330603942275047, + 0.0, + 0.0, + 0.3361796475946903, + 0.21029330044984818, + 1.400832923129201, + 0.4077445901930332, + 0.4261072389781475, + 0.12439890205860138, + 0.9252380877733231, + 0.03954363986849785, + 0.3203691653907299, + 4.4551824033260345, + 0.0, + 0.039419252425432205, + 1.925517488270998, + 0.08858373016119003, + 0.5807605013251305, + 0.04668794199824333, + 0.1590898409485817, + 0.03843235597014427, + 2.069188456982374, + 1.7159295789897442, + 1.7970012500882149, + 1.54386854916811, + 0.19958946853876114, + 0.7424515336751938, + 0.2668114956468344, + 0.45111847296357155, + 0.4478110335767269, + 0.07139534503221512, + 0.292919147759676, + 0.1852719448506832, + 0.5272921472787857, + 0.9640340395271778, + 1.4509875047951937 + ], + "unique_experts": 59, + "load_cv": 1.1066144523104062, + "normalized_load_entropy": 0.8846172784734078, + "max_load_share": 0.09905660377358491 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "766fd3409da575fd8e6dd88e025a78646fab0997f427aeefebeba19517f6d3bf", + "route_weight_sha256": "09973b17d752d719633a50cf72f71088804283a8a081a433cd91cf500ec9a12e", + "loads": [ + 13, + 12, + 14, + 11, + 11, + 23, + 47, + 11, + 7, + 3, + 2, + 16, + 9, + 12, + 16, + 6, + 14, + 4, + 14, + 5, + 17, + 21, + 7, + 13, + 1, + 11, + 5, + 17, + 21, + 15, + 12, + 11, + 10, + 18, + 10, + 17, + 3, + 18, + 18, + 6, + 63, + 11, + 9, + 23, + 15, + 13, + 4, + 8, + 8, + 38, + 20, + 23, + 24, + 7, + 14, + 6, + 9, + 13, + 3, + 9, + 6, + 16, + 19, + 20 + ], + "weighted_loads": [ + 0.7858754694461823, + 0.754401046782732, + 0.9073624685406685, + 0.6976214684545994, + 1.018926676362753, + 1.1537264585494995, + 3.42166150175035, + 0.6115635223686695, + 0.5362570658326149, + 0.3142116814851761, + 0.07457099854946136, + 0.7770615592598915, + 0.5056388787925243, + 0.6602806095033884, + 0.8091996945440769, + 0.2629665229469538, + 0.7787836585193872, + 0.35359781235456467, + 0.8155011646449566, + 0.22679025679826736, + 1.336853438988328, + 1.0881279110908508, + 0.3942747861146927, + 0.8805322200059891, + 0.0340694822371006, + 0.604411318898201, + 0.1971619687974453, + 1.0675420500338078, + 2.608292454853654, + 2.1241935715079308, + 0.8979160450398922, + 0.5899852756410837, + 0.3869794774800539, + 1.7067670356482267, + 0.6631192490458488, + 1.084764489904046, + 0.12439890205860138, + 1.1026977226138115, + 1.362661525607109, + 0.3203691653907299, + 4.4551824033260345, + 0.9578666314482689, + 0.5070208758115768, + 2.111655291169882, + 1.2885686494410038, + 0.9302169382572174, + 0.1878623627126217, + 0.41074983589351177, + 0.3774829376488924, + 2.125511448830366, + 1.781444433145225, + 1.7970012500882149, + 1.54386854916811, + 0.35870879143476486, + 0.7424515336751938, + 0.2668114956468344, + 0.4788603447377682, + 0.6993709653615952, + 0.13391228765249252, + 0.4611009806394577, + 0.2541512828320265, + 1.0612541921436787, + 1.343175757676363, + 1.4509875047951937 + ], + "unique_experts": 64, + "load_cv": 0.7259034324300534, + "normalized_load_entropy": 0.9489550102605094, + "max_load_share": 0.07142857142857142 + } + }, + "s0_period": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "5e95e4bd3bfdfcf9dc748048c4ffa8fb19d35ad8ba948c01001a7739b28a6d27", + "route_weight_sha256": "03729c08846c038f30e7ebeb26488dbab1878fe1a3e91fd0954f4062d59d20e4", + "loads": [ + 12, + 12, + 15, + 10, + 7, + 24, + 47, + 5, + 1, + 0, + 2, + 15, + 5, + 12, + 16, + 5, + 11, + 2, + 11, + 4, + 16, + 18, + 5, + 7, + 1, + 13, + 3, + 8, + 0, + 0, + 0, + 6, + 6, + 12, + 6, + 10, + 2, + 14, + 1, + 6, + 63, + 0, + 1, + 20, + 2, + 9, + 1, + 3, + 1, + 35, + 17, + 23, + 24, + 4, + 12, + 6, + 8, + 6, + 2, + 6, + 3, + 7, + 12, + 21 + ], + "weighted_loads": [ + 0.6700678002089262, + 0.768440954387188, + 0.9474060758948326, + 0.6986699216067791, + 0.3189764954149723, + 1.1824164930731058, + 3.466107713058591, + 0.300117626786232, + 0.03549792617559433, + 0.0, + 0.06693944334983826, + 0.7311455681920052, + 0.32347872108221054, + 0.6358127277344465, + 0.8602225221693516, + 0.23302895948290825, + 0.5554037280380726, + 0.24991824477910995, + 0.7116386145353317, + 0.1908324621617794, + 1.297658521682024, + 0.9807333797216415, + 0.288413368165493, + 0.31985948979854584, + 0.03478739410638809, + 0.6574924476444721, + 0.09912053309381008, + 0.5967327393591404, + 0.0, + 0.0, + 0.0, + 0.29930414259433746, + 0.2113189585506916, + 1.4181441627442837, + 0.4504895694553852, + 0.47137110866606236, + 0.08723749965429306, + 0.9439849704504013, + 0.042205337435007095, + 0.33200401067733765, + 4.498185813426971, + 0.0, + 0.034471381455659866, + 1.920263722538948, + 0.09021497704088688, + 0.6268840320408344, + 0.04305427893996239, + 0.15798524022102356, + 0.04132518544793129, + 1.965219659730792, + 1.6139510236680508, + 1.8453362621366978, + 1.5189892649650574, + 0.20198888331651688, + 0.6643961258232594, + 0.259522395208478, + 0.4597252123057842, + 0.4213239587843418, + 0.06932121142745018, + 0.3322388529777527, + 0.13509869202971458, + 0.5927571542561054, + 0.9140690006315708, + 1.5055458880960941 + ], + "unique_experts": 59, + "load_cv": 1.0997300911978436, + "normalized_load_entropy": 0.8858640679108709, + "max_load_share": 0.09905660377358491 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "2858a9175ffce4e220c86b16f79a0bb2f6012a802b2f6817cd4bf9d7be03f95f", + "route_weight_sha256": "d7ec0a97775a7665d5e982fdfc6689eb1c3a2f01246ed4b9ddf28fd2bc7f5825", + "loads": [ + 12, + 12, + 15, + 14, + 8, + 24, + 47, + 8, + 9, + 0, + 2, + 15, + 10, + 12, + 16, + 5, + 15, + 2, + 11, + 4, + 16, + 18, + 6, + 13, + 1, + 13, + 4, + 17, + 16, + 9, + 2, + 12, + 7, + 14, + 6, + 18, + 2, + 18, + 15, + 6, + 63, + 5, + 5, + 21, + 4, + 10, + 2, + 7, + 5, + 36, + 18, + 23, + 24, + 4, + 12, + 6, + 11, + 6, + 3, + 9, + 3, + 13, + 18, + 24 + ], + "weighted_loads": [ + 0.6700678002089262, + 0.768440954387188, + 0.9474060758948326, + 0.8185497857630253, + 0.9215265847742558, + 1.1824164930731058, + 3.466107713058591, + 0.46079524978995323, + 0.5634735599160194, + 0.0, + 0.06693944334983826, + 0.7311455681920052, + 0.5997483693063259, + 0.6358127277344465, + 0.8602225221693516, + 0.23302895948290825, + 0.8054147958755493, + 0.24991824477910995, + 0.7116386145353317, + 0.1908324621617794, + 1.297658521682024, + 0.9807333797216415, + 0.3389114588499069, + 0.8300368823111057, + 0.03478739410638809, + 0.6574924476444721, + 0.13188966177403927, + 1.0606300570070744, + 2.170277666300535, + 1.3021170943975449, + 0.06245002523064613, + 0.5870495811104774, + 0.25794389098882675, + 1.5229421816766262, + 0.4504895694553852, + 1.01900471188128, + 0.08723749965429306, + 1.05783224478364, + 1.1040107682347298, + 0.33200401067733765, + 4.498185813426971, + 0.5217812806367874, + 0.34011244401335716, + 2.0154436975717545, + 0.18118244595825672, + 0.6664841510355473, + 0.08930519968271255, + 0.36144535802304745, + 0.27496209368109703, + 2.0144443158060312, + 1.626887689344585, + 1.8453362621366978, + 1.5189892649650574, + 0.20198888331651688, + 0.6643961258232594, + 0.259522395208478, + 0.587619561702013, + 0.4213239587843418, + 0.13482165709137917, + 0.4860011599957943, + 0.13509869202971458, + 0.8747749794274569, + 1.2764973975718021, + 1.599355287849903 + ], + "unique_experts": 63, + "load_cv": 0.8521058258922487, + "normalized_load_entropy": 0.9291248723874521, + "max_load_share": 0.08015267175572519 + } + }, + "s1_period": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "e88d1de4e52600627ca79d81dd67493b03d88deca22530cc4aba823d5be75e13", + "route_weight_sha256": "9c41426d99700608e2151777010cde6398495183cb069e4565af16f8f1cd2b62", + "loads": [ + 10, + 12, + 15, + 9, + 8, + 22, + 49, + 5, + 0, + 0, + 2, + 16, + 5, + 13, + 17, + 5, + 11, + 2, + 11, + 4, + 16, + 18, + 5, + 6, + 0, + 12, + 2, + 9, + 0, + 0, + 0, + 6, + 5, + 13, + 5, + 7, + 3, + 14, + 1, + 6, + 64, + 0, + 2, + 20, + 2, + 8, + 1, + 3, + 1, + 38, + 18, + 23, + 24, + 4, + 14, + 6, + 9, + 7, + 2, + 4, + 3, + 7, + 12, + 20 + ], + "weighted_loads": [ + 0.6205760911107063, + 0.7589535601437092, + 0.942499715834856, + 0.6457382813096046, + 0.3443982284516096, + 1.1182056590914726, + 3.5287146493792534, + 0.3065435476601124, + 0.0, + 0.0, + 0.06361955776810646, + 0.7880000602453947, + 0.30132531002163887, + 0.6965579837560654, + 0.8618470821529627, + 0.21864623948931694, + 0.5782110765576363, + 0.24498733133077621, + 0.7086154818534851, + 0.1842641644179821, + 1.3200316578149796, + 0.9805296696722507, + 0.31169258058071136, + 0.29603737592697144, + 0.0, + 0.643473606556654, + 0.07372542843222618, + 0.6386910751461983, + 0.0, + 0.0, + 0.0, + 0.3212549723684788, + 0.17787920497357845, + 1.3998671248555183, + 0.40771516785025597, + 0.3540238179266453, + 0.12309490889310837, + 0.940917581319809, + 0.04117657244205475, + 0.3119991533458233, + 4.491807393729687, + 0.0, + 0.0716407485306263, + 1.9290225021541119, + 0.0905876625329256, + 0.5730692446231842, + 0.046992409974336624, + 0.1573024019598961, + 0.03829445317387581, + 2.106758937239647, + 1.7173739038407803, + 1.791596345603466, + 1.5357159562408924, + 0.20005906000733376, + 0.7389451116323471, + 0.2763125114142895, + 0.4879893362522125, + 0.44287820532917976, + 0.07036414742469788, + 0.23388200625777245, + 0.14471478760242462, + 0.5861004181206226, + 0.915870014578104, + 1.4654976204037666 + ], + "unique_experts": 57, + "load_cv": 1.1321977571969675, + "normalized_load_entropy": 0.8798405474691299, + "max_load_share": 0.10062893081761007 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "74c8a792251ebc3890257c8bf122edd965481f494898eb54a6940a41f98fa802", + "route_weight_sha256": "19ae6ed04c115a8075306c8944c262eca53cdff64d4e1d3668a1e71059ed4a57", + "loads": [ + 14, + 12, + 15, + 11, + 11, + 22, + 49, + 13, + 8, + 3, + 3, + 16, + 9, + 13, + 17, + 5, + 15, + 4, + 12, + 4, + 16, + 21, + 7, + 13, + 0, + 12, + 5, + 16, + 19, + 14, + 11, + 11, + 9, + 18, + 10, + 15, + 3, + 18, + 19, + 6, + 64, + 11, + 9, + 23, + 15, + 12, + 4, + 9, + 8, + 39, + 20, + 23, + 24, + 7, + 14, + 6, + 10, + 13, + 3, + 8, + 5, + 17, + 19, + 20 + ], + "weighted_loads": [ + 0.8116415962576866, + 0.7589535601437092, + 0.942499715834856, + 0.6969868801534176, + 1.016836104914546, + 1.1182056590914726, + 3.5287146493792534, + 0.690284188836813, + 0.5999813340604305, + 0.3142116814851761, + 0.10545362159609795, + 0.7880000602453947, + 0.48873531073331833, + 0.6965579837560654, + 0.8618470821529627, + 0.21864623948931694, + 0.8841801732778549, + 0.3568631410598755, + 0.7444937564432621, + 0.1842641644179821, + 1.3200316578149796, + 1.1137709505856037, + 0.39766862243413925, + 0.8070466816425323, + 0.0, + 0.643473606556654, + 0.19663400202989578, + 1.0032316446304321, + 2.555587735027075, + 2.0287598073482513, + 0.8589796088635921, + 0.5728766079992056, + 0.3545653820037842, + 1.7086700424551964, + 0.6630898267030716, + 0.970717566087842, + 0.12309490889310837, + 1.1183772161602974, + 1.4252926707267761, + 0.3119991533458233, + 4.491807393729687, + 1.0191855803132057, + 0.4977182261645794, + 2.108006324619055, + 1.2955983597785234, + 0.8819574899971485, + 0.18742256984114647, + 0.44942802377045155, + 0.384701207280159, + 2.168716762214899, + 1.7828887579962611, + 1.791596345603466, + 1.5357159562408924, + 0.3591783829033375, + 0.7389451116323471, + 0.2763125114142895, + 0.5157312080264091, + 0.694438137114048, + 0.13332650810480118, + 0.402693759649992, + 0.2135941255837679, + 1.1108570285141468, + 1.31942967325449, + 1.4654976204037666 + ], + "unique_experts": 63, + "load_cv": 0.7418224474210945, + "normalized_load_entropy": 0.9467891771577689, + "max_load_share": 0.07256235827664399 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 106, + "ordered_topk_exact_tokens": 77, + "set_exact_tokens": 85, + "mean_set_jaccard": 0.9433962264150944, + "mean_token_weighted_tv": 0.012846673250128076, + "aggregate_load_tv": 0.017295597484276726 + }, + "system_bos": { + "tokens": 106, + "ordered_topk_exact_tokens": 63, + "set_exact_tokens": 77, + "mean_set_jaccard": 0.917789757412399, + "mean_token_weighted_tv": 0.018935836034493066, + "aggregate_load_tv": 0.028301886792452824 + }, + "system_x": { + "tokens": 106, + "ordered_topk_exact_tokens": 59, + "set_exact_tokens": 75, + "mean_set_jaccard": 0.9123989218328842, + "mean_token_weighted_tv": 0.01954761229209461, + "aggregate_load_tv": 0.029874213836477988 + }, + "system_period": { + "tokens": 106, + "ordered_topk_exact_tokens": 60, + "set_exact_tokens": 78, + "mean_set_jaccard": 0.9204851752021563, + "mean_token_weighted_tv": 0.018689518601124017, + "aggregate_load_tv": 0.02987421383647798 + }, + "bos_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 55, + "set_exact_tokens": 75, + "mean_set_jaccard": 0.914420485175202, + "mean_token_weighted_tv": 0.020865905353412876, + "aggregate_load_tv": 0.02987421383647798 + }, + "bos_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 56, + "set_exact_tokens": 79, + "mean_set_jaccard": 0.9231805929919138, + "mean_token_weighted_tv": 0.02006513677221143, + "aggregate_load_tv": 0.028301886792452824 + }, + "x_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 66, + "set_exact_tokens": 85, + "mean_set_jaccard": 0.9413746630727762, + "mean_token_weighted_tv": 0.01794000572683114, + "aggregate_load_tv": 0.028301886792452824 + }, + "x_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 52, + "set_exact_tokens": 75, + "mean_set_jaccard": 0.910377358490566, + "mean_token_weighted_tv": 0.02331960856703655, + "aggregate_load_tv": 0.033018867924528295 + }, + "period_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 56, + "set_exact_tokens": 79, + "mean_set_jaccard": 0.925202156334232, + "mean_token_weighted_tv": 0.019904055237278062, + "aggregate_load_tv": 0.026729559748427667 + }, + "period_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 48, + "set_exact_tokens": 73, + "mean_set_jaccard": 0.9049865229110512, + "mean_token_weighted_tv": 0.024361698466511268, + "aggregate_load_tv": 0.02987421383647798 + } + } + }, + "layer_13": { + "layer": 13, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "3d447295c94da2017bf00f2a9737bbfab93a29ff0780e8a67ebb8e4ce0a55975", + "route_weight_sha256": "a1d4ea2a239cdeaaf71fc91b533e30763e649af1a6327099e1468115ded4e302", + "loads": [ + 21, + 3, + 5, + 6, + 36, + 7, + 8, + 17, + 22, + 0, + 12, + 5, + 19, + 17, + 4, + 20, + 13, + 6, + 1, + 2, + 5, + 5, + 21, + 0, + 9, + 0, + 7, + 1, + 5, + 0, + 0, + 6, + 22, + 4, + 3, + 15, + 2, + 0, + 17, + 40, + 8, + 0, + 6, + 1, + 0, + 11, + 9, + 29, + 16, + 1, + 12, + 12, + 51, + 1, + 11, + 2, + 0, + 5, + 19, + 8, + 10, + 9, + 16, + 13 + ], + "weighted_loads": [ + 1.186272593215108, + 0.1120518110692501, + 0.23479197919368744, + 0.27273096702992916, + 1.5449955202639103, + 0.37693826481699944, + 0.34298891574144363, + 1.236370712518692, + 1.0122700110077858, + 0.0, + 0.8442351259291172, + 0.269512128084898, + 1.0547733251005411, + 0.8301410786807537, + 0.14233152754604816, + 1.2293448019772768, + 0.7019311338663101, + 0.21082459203898907, + 0.043238721787929535, + 0.06122390367090702, + 0.2021663412451744, + 0.273240327835083, + 1.1341001465916634, + 0.0, + 0.3756143730133772, + 0.0, + 0.22449656762182713, + 0.024971207603812218, + 0.19801643304526806, + 0.0, + 0.0, + 0.27365681529045105, + 1.398639852181077, + 0.22210876643657684, + 0.2743402346968651, + 1.157321773469448, + 0.07425030693411827, + 0.0, + 1.0671164840459824, + 2.3329588063061237, + 0.5258928164839745, + 0.0, + 0.24360192567110062, + 0.0521089993417263, + 0.0, + 0.6855216473340988, + 0.36255341209471226, + 1.0313785262405872, + 2.0200120098888874, + 0.04031718522310257, + 0.42517517134547234, + 0.4605964124202728, + 2.706569455564022, + 0.050859108567237854, + 0.5418964736163616, + 0.10136893391609192, + 0.0, + 0.29537928476929665, + 0.8593525625765324, + 0.34364989027380943, + 0.5002698376774788, + 0.3993190582841635, + 0.8596455492079258, + 0.7741978652775288 + ], + "unique_experts": 55, + "load_cv": 1.0218722690333535, + "normalized_load_entropy": 0.8845684955761033, + "max_load_share": 0.08018867924528301 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "5c784b7238b07e018784e18223f89f086cf5d5dfd7d3a54af0e6dc9f1316d1ac", + "route_weight_sha256": "89dd19e1713f710c3b4d7367fbb323cf018835d0df7e0b6083050b6e16b9e68c", + "loads": [ + 21, + 7, + 5, + 6, + 36, + 7, + 26, + 17, + 22, + 2, + 22, + 11, + 19, + 17, + 5, + 26, + 13, + 9, + 2, + 3, + 5, + 8, + 21, + 0, + 13, + 0, + 10, + 1, + 5, + 13, + 0, + 6, + 22, + 10, + 4, + 15, + 5, + 1, + 17, + 42, + 9, + 1, + 9, + 3, + 11, + 22, + 11, + 31, + 18, + 1, + 13, + 12, + 55, + 4, + 14, + 2, + 3, + 5, + 25, + 13, + 10, + 10, + 16, + 14 + ], + "weighted_loads": [ + 1.186272593215108, + 0.3346177004277706, + 0.23479197919368744, + 0.27273096702992916, + 1.5449955202639103, + 0.37693826481699944, + 1.7300127763301134, + 1.236370712518692, + 1.0122700110077858, + 0.07683849334716797, + 1.5561608280986547, + 0.6563020176254213, + 1.0547733251005411, + 0.8301410786807537, + 0.18772769160568714, + 1.536924222484231, + 0.7019311338663101, + 0.30141525249928236, + 0.08501464501023293, + 0.10470501147210598, + 0.2021663412451744, + 0.42305272445082664, + 1.1341001465916634, + 0.0, + 0.48027717787772417, + 0.0, + 0.3489877339452505, + 0.024971207603812218, + 0.19801643304526806, + 0.9533435329794884, + 0.0, + 0.27365681529045105, + 1.398639852181077, + 0.8198971189558506, + 0.29716166108846664, + 1.157321773469448, + 0.31322198919951916, + 0.03359677270054817, + 1.0671164840459824, + 2.4482819214463234, + 0.6313182711601257, + 0.049772460013628006, + 0.3846755065023899, + 0.1487981639802456, + 0.7189312092959881, + 1.7155404910445213, + 0.4281363505870104, + 2.2237046249210835, + 2.1016862094402313, + 0.04031718522310257, + 0.4630493111908436, + 0.4605964124202728, + 2.851235054433346, + 0.18897921591997147, + 0.6732517257332802, + 0.10136893391609192, + 0.164889108389616, + 0.29537928476929665, + 1.1747772339731455, + 0.5798852518200874, + 0.5002698376774788, + 0.4286246933043003, + 0.8596455492079258, + 0.8118398524820805 + ], + "unique_experts": 61, + "load_cv": 0.8556242132999753, + "normalized_load_entropy": 0.9178575585605444, + "max_load_share": 0.06997455470737914 + } + }, + "s1_eos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "302b4b08595123079ab16c41c8e6812f2d23c1a1576f81675e3b86917a1f5b76", + "route_weight_sha256": "4257e53a9289a226626d11148b87601da4bfb3e00d8431797ed86909f59a0d04", + "loads": [ + 21, + 1, + 6, + 8, + 37, + 7, + 9, + 17, + 22, + 0, + 11, + 5, + 19, + 16, + 4, + 20, + 14, + 6, + 1, + 2, + 5, + 5, + 20, + 0, + 9, + 0, + 8, + 1, + 8, + 0, + 0, + 6, + 20, + 4, + 3, + 16, + 2, + 0, + 17, + 41, + 8, + 0, + 7, + 1, + 0, + 11, + 8, + 27, + 16, + 1, + 11, + 12, + 51, + 1, + 10, + 3, + 0, + 5, + 19, + 9, + 9, + 9, + 16, + 11 + ], + "weighted_loads": [ + 1.1859569437801838, + 0.046380314975976944, + 0.2591371424496174, + 0.33233814500272274, + 1.586552070453763, + 0.3871600776910782, + 0.3693106509745121, + 1.238809209316969, + 0.9994898065924644, + 0.0, + 0.8283105194568634, + 0.26238398998975754, + 1.0648119542747736, + 0.7832999508827925, + 0.1399559024721384, + 1.213305177167058, + 0.7456208951771259, + 0.20413314923644066, + 0.04351745918393135, + 0.062207115814089775, + 0.2046236153692007, + 0.27379875630140305, + 1.101047407835722, + 0.0, + 0.37190502136945724, + 0.0, + 0.26428149454295635, + 0.02484774775803089, + 0.2935274466872215, + 0.0, + 0.0, + 0.2653981987386942, + 1.32096316665411, + 0.21814827248454094, + 0.28354473412036896, + 1.1644203960895538, + 0.0767035074532032, + 0.0, + 1.05635404586792, + 2.3889632374048233, + 0.5264220871031284, + 0.0, + 0.2696160785853863, + 0.0504227913916111, + 0.0, + 0.6958271935582161, + 0.33359093591570854, + 0.9659464079886675, + 1.998962016776204, + 0.03971508517861366, + 0.3941010348498821, + 0.47317418828606606, + 2.693323325365782, + 0.05006667971611023, + 0.5040391888469458, + 0.13089202716946602, + 0.0, + 0.2941826581954956, + 0.8531238753348589, + 0.3764277081936598, + 0.46005019918084145, + 0.4022870361804962, + 0.8646974712610245, + 0.7159403450787067 + ], + "unique_experts": 55, + "load_cv": 1.0162829231012356, + "normalized_load_entropy": 0.8859191880435413, + "max_load_share": 0.08018867924528301 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "7a8f55e6c2d5dcd68646f3c69c103751262b715743ba3b66b87c61897131ecae", + "route_weight_sha256": "4272f488ef5a96ff52b66472fe7a23fb0ec8909b371bc35a4b214e83178ff9ce", + "loads": [ + 26, + 5, + 6, + 8, + 37, + 9, + 39, + 17, + 22, + 2, + 23, + 17, + 19, + 16, + 5, + 27, + 14, + 10, + 3, + 4, + 5, + 11, + 20, + 3, + 13, + 0, + 12, + 1, + 8, + 18, + 7, + 7, + 20, + 15, + 6, + 17, + 7, + 1, + 18, + 43, + 11, + 3, + 15, + 2, + 16, + 23, + 10, + 30, + 19, + 6, + 12, + 12, + 53, + 3, + 13, + 5, + 3, + 16, + 27, + 12, + 10, + 11, + 16, + 13 + ], + "weighted_loads": [ + 1.3873069062829018, + 0.29008908569812775, + 0.2591371424496174, + 0.33233814500272274, + 1.586552070453763, + 0.45498912781476974, + 2.695791518315673, + 1.238809209316969, + 0.9994898065924644, + 0.08927828818559647, + 1.6254053693264723, + 1.1705725556239486, + 1.0648119542747736, + 0.7832999508827925, + 0.18342391960322857, + 1.5892586838454008, + 0.7456208951771259, + 0.335100076161325, + 0.10958867520093918, + 0.14564023353159428, + 0.2046236153692007, + 0.5952750202268362, + 1.101047407835722, + 0.12196814641356468, + 0.49189343303442, + 0.0, + 0.4257033597677946, + 0.02484774775803089, + 0.2935274466872215, + 1.620271172374487, + 0.4052514396607876, + 0.3049159664660692, + 1.32096316665411, + 1.3168985024094582, + 0.5091251097619534, + 1.2197712771594524, + 0.45602688752114773, + 0.03337422013282776, + 1.0993187241256237, + 2.5208815932273865, + 0.7079563289880753, + 0.13146701455116272, + 0.9349429160356522, + 0.12460591271519661, + 1.1465180963277817, + 1.7108412645757198, + 0.4096921943128109, + 2.1953693833202124, + 2.291789600625634, + 0.2852587178349495, + 0.43133485317230225, + 0.47317418828606606, + 2.766389463096857, + 0.1301712915301323, + 0.6165968887507915, + 0.20289282873272896, + 0.15489286184310913, + 1.001487098634243, + 1.2367993984371424, + 0.530915142968297, + 0.4887353330850601, + 0.4842456020414829, + 0.8646974712610245, + 0.805651567876339 + ], + "unique_experts": 63, + "load_cv": 0.7619553757078977, + "normalized_load_entropy": 0.935007253172296, + "max_load_share": 0.060090702947845805 + } + }, + "s0_bos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "6aec63e9528ff4de7a06eafa5ae19b07c111effb2f9baf3ea7397512be48cdf3", + "route_weight_sha256": "3dc378aa3604afad76dc0915a076ab74fd5a6d90c7e3eda43e2378d0fb593488", + "loads": [ + 21, + 2, + 5, + 6, + 39, + 8, + 9, + 19, + 21, + 0, + 10, + 5, + 19, + 16, + 5, + 20, + 16, + 7, + 0, + 2, + 4, + 5, + 21, + 0, + 8, + 0, + 7, + 1, + 6, + 0, + 0, + 5, + 21, + 4, + 3, + 16, + 2, + 0, + 18, + 41, + 8, + 0, + 6, + 1, + 0, + 10, + 12, + 24, + 16, + 1, + 13, + 11, + 51, + 1, + 10, + 2, + 0, + 4, + 18, + 7, + 11, + 9, + 16, + 13 + ], + "weighted_loads": [ + 1.171831265091896, + 0.08280017226934433, + 0.24334204569458961, + 0.27569830045104027, + 1.695031626150012, + 0.41163718700408936, + 0.38456601835787296, + 1.3704527281224728, + 0.9583569560199976, + 0.0, + 0.7488554548472166, + 0.26380745880305767, + 1.0912927240133286, + 0.7856110166758299, + 0.17597291991114616, + 1.2518960181623697, + 0.7869646325707436, + 0.2425024528056383, + 0.0, + 0.06024792231619358, + 0.17244519293308258, + 0.27560804411768913, + 1.162504505366087, + 0.0, + 0.34539420157670975, + 0.0, + 0.23601225204765797, + 0.02516668476164341, + 0.23343251086771488, + 0.0, + 0.0, + 0.22823134437203407, + 1.384612262248993, + 0.21874773874878883, + 0.2844218760728836, + 1.1823387034237385, + 0.07371977716684341, + 0.0, + 1.111593384295702, + 2.3936133459210396, + 0.5310539193451405, + 0.0, + 0.2341286651790142, + 0.05172058939933777, + 0.0, + 0.6429376266896725, + 0.4730734098702669, + 0.8612161595374346, + 2.015200525522232, + 0.041113536804914474, + 0.473426915705204, + 0.44304036535322666, + 2.7369687035679817, + 0.051245350390672684, + 0.49929420091211796, + 0.10385046526789665, + 0.0, + 0.27139102667570114, + 0.826864005997777, + 0.30276085436344147, + 0.5388980209827423, + 0.41343711502850056, + 0.8633713126182556, + 0.786207964643836 + ], + "unique_experts": 54, + "load_cv": 1.0301994301433328, + "normalized_load_entropy": 0.8822318757837058, + "max_load_share": 0.08018867924528301 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "1ac5a4088612711c7a8de864eac1d192d54fcb7019a98ab4283d3c1a4a79db7e", + "route_weight_sha256": "bfb16f0647ca76bc1c7c5dec871678364f18fcd744fd08bdfe7399f2e16593b0", + "loads": [ + 21, + 7, + 6, + 6, + 40, + 8, + 27, + 19, + 21, + 4, + 20, + 9, + 19, + 16, + 5, + 26, + 16, + 9, + 1, + 3, + 4, + 8, + 21, + 0, + 11, + 0, + 10, + 1, + 6, + 13, + 0, + 5, + 21, + 9, + 4, + 16, + 5, + 1, + 18, + 43, + 9, + 1, + 9, + 3, + 11, + 21, + 14, + 25, + 18, + 1, + 14, + 11, + 55, + 5, + 13, + 2, + 4, + 4, + 24, + 12, + 11, + 10, + 16, + 14 + ], + "weighted_loads": [ + 1.171831265091896, + 0.38361771777272224, + 0.3128858767449856, + 0.27569830045104027, + 1.7446896824985743, + 0.41163718700408936, + 1.8328811712563038, + 1.3704527281224728, + 0.9583569560199976, + 0.1813470907509327, + 1.4021617956459522, + 0.6001809388399124, + 1.0912927240133286, + 0.7856110166758299, + 0.17597291991114616, + 1.559475438669324, + 0.7869646325707436, + 0.3218936678022146, + 0.04177592322230339, + 0.10372903011739254, + 0.17244519293308258, + 0.43178199231624603, + 1.162504505366087, + 0.0, + 0.4498271830379963, + 0.0, + 0.36050341837108135, + 0.02516668476164341, + 0.23343251086771488, + 0.9026180617511272, + 0.0, + 0.22823134437203407, + 1.384612262248993, + 0.7668539322912693, + 0.30724330246448517, + 1.1823387034237385, + 0.3325855527073145, + 0.03359677270054817, + 1.111593384295702, + 2.5013340078294277, + 0.6396706141531467, + 0.049772460013628006, + 0.3928975760936737, + 0.16159847751259804, + 0.7219070307910442, + 1.667300682514906, + 0.538656348362565, + 1.2223351020365953, + 2.0899714417755604, + 0.041113536804914474, + 0.5113010555505753, + 0.44304036535322666, + 2.8816343024373055, + 0.25117137283086777, + 0.6300259474664927, + 0.10385046526789665, + 0.27569739893078804, + 0.27139102667570114, + 1.1425860468298197, + 0.5389962159097195, + 0.5388980209827423, + 0.4427427500486374, + 0.8633713126182556, + 0.8238499518483877 + ], + "unique_experts": 61, + "load_cv": 0.8562293705845997, + "normalized_load_entropy": 0.9184480834352792, + "max_load_share": 0.06997455470737914 + } + }, + "s1_bos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "76acf5a4513d99c824e355e5e56df350dce233363a5c0e216c756bef727655b9", + "route_weight_sha256": "a72d96e7d3e3352bd34a0073f4a58206e06535725253c56c8e4dcfc41ad7b72a", + "loads": [ + 20, + 1, + 5, + 7, + 39, + 8, + 9, + 17, + 22, + 0, + 10, + 5, + 19, + 19, + 4, + 18, + 16, + 8, + 0, + 1, + 6, + 5, + 21, + 0, + 8, + 0, + 10, + 1, + 6, + 0, + 0, + 5, + 20, + 4, + 3, + 16, + 2, + 0, + 18, + 40, + 8, + 0, + 6, + 1, + 0, + 10, + 11, + 26, + 16, + 1, + 12, + 12, + 49, + 1, + 10, + 1, + 0, + 4, + 19, + 8, + 11, + 9, + 16, + 12 + ], + "weighted_loads": [ + 1.134083965793252, + 0.04954517260193825, + 0.22272959910333157, + 0.31249553337693214, + 1.6765466965734959, + 0.41446132957935333, + 0.3926128149032593, + 1.2886896580457687, + 0.9947170577943325, + 0.0, + 0.7316670939326286, + 0.25434795022010803, + 1.0715434961020947, + 0.878663869574666, + 0.1450604721903801, + 1.130218256264925, + 0.7791696041822433, + 0.27362264320254326, + 0.0, + 0.034683603793382645, + 0.23984985798597336, + 0.27776236087083817, + 1.143059702590108, + 0.0, + 0.34601524844765663, + 0.0, + 0.3511142022907734, + 0.02513045445084572, + 0.24068447388708591, + 0.0, + 0.0, + 0.22471830993890762, + 1.329202700406313, + 0.21734175086021423, + 0.26959093660116196, + 1.1779262199997902, + 0.0741039291024208, + 0.0, + 1.10674162581563, + 2.3445613756775856, + 0.5293354988098145, + 0.0, + 0.2399020604789257, + 0.04537436366081238, + 0.0, + 0.642531257122755, + 0.4389057047665119, + 0.9475613329559565, + 1.983749259263277, + 0.04431726038455963, + 0.4341314509510994, + 0.46584993228316307, + 2.597283609211445, + 0.04953690245747566, + 0.4796456042677164, + 0.0696326270699501, + 0.0, + 0.2509389854967594, + 0.8477672226727009, + 0.3402038514614105, + 0.5224763825535774, + 0.4250609986484051, + 0.8530894871801138, + 0.7591535076498985 + ], + "unique_experts": 54, + "load_cv": 1.0162829231012356, + "normalized_load_entropy": 0.8823946629896093, + "max_load_share": 0.0770440251572327 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "a2092ba2778876d182318c78ca5e30564a0fe34ced3ffa8983869b5e42752b0c", + "route_weight_sha256": "7823118d621f2d066334611c2c11321cdc19d54e1f9f2d0ea924d3db2c9368ba", + "loads": [ + 25, + 6, + 6, + 7, + 39, + 10, + 39, + 17, + 22, + 3, + 22, + 15, + 19, + 19, + 4, + 25, + 16, + 11, + 2, + 3, + 7, + 11, + 21, + 3, + 12, + 0, + 14, + 1, + 6, + 18, + 7, + 6, + 20, + 15, + 6, + 17, + 8, + 1, + 19, + 42, + 11, + 3, + 14, + 2, + 16, + 22, + 13, + 28, + 18, + 6, + 13, + 12, + 51, + 3, + 13, + 3, + 4, + 15, + 27, + 11, + 12, + 11, + 16, + 14 + ], + "weighted_loads": [ + 1.33543392829597, + 0.3718451149761677, + 0.2717678342014551, + 0.31249553337693214, + 1.6765466965734959, + 0.4822903797030449, + 2.8059772085398436, + 1.2886896580457687, + 0.9947170577943325, + 0.14035510644316673, + 1.5224461760371923, + 1.0893424917012453, + 1.0715434961020947, + 0.878663869574666, + 0.1450604721903801, + 1.5061717629432678, + 0.7791696041822433, + 0.390349593013525, + 0.06607121601700783, + 0.11811672151088715, + 0.28392086178064346, + 0.5993897970765829, + 1.143059702590108, + 0.12196814641356468, + 0.5232898555696011, + 0.0, + 0.5125360675156116, + 0.02513045445084572, + 0.24068447388708591, + 1.6210905015468597, + 0.4052514396607876, + 0.26423607766628265, + 1.329202700406313, + 1.3105145804584026, + 0.49517131224274635, + 1.2332771010696888, + 0.5463984292000532, + 0.03337422013282776, + 1.1497063040733337, + 2.4627348482608795, + 0.7155328206717968, + 0.13146701455116272, + 0.9195860587060452, + 0.12016347050666809, + 1.151759061962366, + 1.657886628061533, + 0.5150069631636143, + 1.3472146969288588, + 2.2345940805971622, + 0.28986089304089546, + 0.4713652692735195, + 0.46584993228316307, + 2.67034974694252, + 0.12964151427149773, + 0.5916644334793091, + 0.14163342863321304, + 0.1976245604455471, + 0.9582434259355068, + 1.211680043488741, + 0.49469128623604774, + 0.5511615164577961, + 0.5070195645093918, + 0.8530894871801138, + 0.8488647304475307 + ], + "unique_experts": 63, + "load_cv": 0.7487767321973888, + "normalized_load_entropy": 0.9360330642825462, + "max_load_share": 0.05782312925170068 + } + }, + "s0_x": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "202475c18864f7e1848073a919154a7c26f859aa4b61ecaeb80399e24072e0c5", + "route_weight_sha256": "4176474524e33113c81b4caa303e7512819cdbb31d6802153c67e893843ccd0f", + "loads": [ + 21, + 2, + 5, + 7, + 34, + 8, + 8, + 19, + 22, + 0, + 12, + 5, + 19, + 17, + 5, + 18, + 15, + 6, + 0, + 2, + 6, + 5, + 23, + 0, + 8, + 0, + 8, + 1, + 5, + 0, + 0, + 5, + 20, + 4, + 3, + 16, + 3, + 0, + 18, + 40, + 9, + 0, + 6, + 1, + 0, + 10, + 12, + 26, + 16, + 1, + 13, + 11, + 50, + 1, + 9, + 1, + 0, + 4, + 19, + 8, + 12, + 8, + 16, + 13 + ], + "weighted_loads": [ + 1.1754037383943796, + 0.08026737347245216, + 0.24339411780238152, + 0.30940748937428, + 1.478092534467578, + 0.40949616208672523, + 0.33311767131090164, + 1.3800631389021873, + 0.9992404449731112, + 0.0, + 0.7967011779546738, + 0.24714018031954765, + 1.089074980467558, + 0.8140165507793427, + 0.17763333767652512, + 1.1414401941001415, + 0.7644009366631508, + 0.20851614885032177, + 0.0, + 0.06258475594222546, + 0.23582278192043304, + 0.2786019332706928, + 1.2232770770788193, + 0.0, + 0.3449145592749119, + 0.0, + 0.2740478366613388, + 0.025365980342030525, + 0.20274722017347813, + 0.0, + 0.0, + 0.22606789134442806, + 1.3572576493024826, + 0.22133975476026535, + 0.27346883714199066, + 1.1829636208713055, + 0.10796608403325081, + 0.0, + 1.10847282782197, + 2.3260520063340664, + 0.5658123157918453, + 0.0, + 0.247847069054842, + 0.05125400424003601, + 0.0, + 0.6487360559403896, + 0.4726372957229614, + 0.9382006954401731, + 1.9795866198837757, + 0.04507093504071236, + 0.4684674274176359, + 0.41255148500204086, + 2.6967241689562798, + 0.04792993888258934, + 0.45920436829328537, + 0.07179564982652664, + 0.0, + 0.2574577294290066, + 0.8644846547394991, + 0.34972526505589485, + 0.5551664661616087, + 0.37291782163083553, + 0.8609951231628656, + 0.7778197228908539 + ], + "unique_experts": 54, + "load_cv": 1.0051684008669886, + "normalized_load_entropy": 0.8848590734480105, + "max_load_share": 0.07861635220125786 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "03f81b351f6c11227371b101fe31efbe334200463a4f4d9821afa175617a77f4", + "route_weight_sha256": "93990526e02a99b8a01332d1241c2f68e316b017e3a5079bbfdb4263edfd081c", + "loads": [ + 21, + 6, + 5, + 7, + 34, + 8, + 26, + 19, + 22, + 2, + 23, + 10, + 19, + 17, + 5, + 25, + 15, + 8, + 1, + 3, + 7, + 8, + 23, + 0, + 13, + 0, + 11, + 1, + 5, + 12, + 0, + 5, + 20, + 10, + 4, + 16, + 6, + 1, + 18, + 42, + 10, + 1, + 9, + 2, + 13, + 22, + 15, + 27, + 18, + 1, + 14, + 11, + 54, + 4, + 11, + 1, + 3, + 4, + 24, + 13, + 12, + 9, + 16, + 14 + ], + "weighted_loads": [ + 1.1754037383943796, + 0.3064592704176903, + 0.24339411780238152, + 0.30940748937428, + 1.478092534467578, + 0.40949616208672523, + 1.6770331729203463, + 1.3800631389021873, + 0.9992404449731112, + 0.07683849334716797, + 1.4680028278380632, + 0.6534666549414396, + 1.089074980467558, + 0.8140165507793427, + 0.17763333767652512, + 1.6666444726288319, + 0.7644009366631508, + 0.2867001462727785, + 0.04177592322230339, + 0.10606586374342442, + 0.27735406532883644, + 0.45022493228316307, + 1.2232770770788193, + 0.0, + 0.5303616523742676, + 0.0, + 0.3985390029847622, + 0.025365980342030525, + 0.20274722017347813, + 0.8830203227698803, + 0.0, + 0.22606789134442806, + 1.3572576493024826, + 0.8371398746967316, + 0.2962902635335922, + 1.1829636208713055, + 0.3490245100110769, + 0.03359677270054817, + 1.10847282782197, + 2.4326683431863785, + 0.6770827434957027, + 0.049772460013628006, + 0.38059669360518456, + 0.09726661816239357, + 0.874735627323389, + 1.8796173259615898, + 0.5673327632248402, + 1.299319637939334, + 2.0661360807716846, + 0.04507093504071236, + 0.5063415672630072, + 0.41255148500204086, + 2.8413897678256035, + 0.18605004623532295, + 0.5476030185818672, + 0.07179564982652664, + 0.164889108389616, + 0.2574577294290066, + 1.1532887760549784, + 0.5859606266021729, + 0.5551664661616087, + 0.40222345665097237, + 0.8609951231628656, + 0.8154617100954056 + ], + "unique_experts": 61, + "load_cv": 0.8412161402730223, + "normalized_load_entropy": 0.9181060499683701, + "max_load_share": 0.06870229007633588 + } + }, + "s1_x": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "9e1f39f5fc4e8d6d60921296ccd6137edd20bb2a692cebc68e180dcf17852feb", + "route_weight_sha256": "79b831b884bcb9c5ca7ff5c8ddf92c83a5dc8d2f3f4ec5f7ed19173bb7f8a814", + "loads": [ + 20, + 1, + 5, + 7, + 35, + 9, + 10, + 18, + 21, + 0, + 11, + 4, + 20, + 17, + 4, + 16, + 16, + 7, + 0, + 0, + 5, + 5, + 20, + 0, + 9, + 0, + 8, + 1, + 7, + 0, + 0, + 5, + 22, + 4, + 3, + 15, + 2, + 0, + 18, + 40, + 8, + 1, + 8, + 1, + 0, + 9, + 11, + 29, + 16, + 1, + 13, + 14, + 49, + 1, + 10, + 2, + 0, + 4, + 16, + 9, + 12, + 9, + 16, + 12 + ], + "weighted_loads": [ + 1.1065749172121286, + 0.04759102314710617, + 0.223411463201046, + 0.3053768388926983, + 1.5434788167476654, + 0.45204639434814453, + 0.4179418161511421, + 1.3037859667092562, + 0.9580199886113405, + 0.0, + 0.7522416170686483, + 0.21135495603084564, + 1.0845948196947575, + 0.809125255793333, + 0.1419703457504511, + 1.0841568298637867, + 0.7820006608963013, + 0.240286810323596, + 0.0, + 0.0, + 0.21179665252566338, + 0.2783137708902359, + 1.0974248312413692, + 0.0, + 0.38723844289779663, + 0.0, + 0.2982242275029421, + 0.025725403800606728, + 0.26669944263994694, + 0.0, + 0.0, + 0.22665315493941307, + 1.3967771027237177, + 0.21864355728030205, + 0.2763656824827194, + 1.1599948666989803, + 0.07570759207010269, + 0.0, + 1.0927461329847574, + 2.3321808706969023, + 0.5228987373411655, + 0.0315183661878109, + 0.30695873498916626, + 0.04660744592547417, + 0.0, + 0.6013758070766926, + 0.4433209076523781, + 1.0259608626365662, + 1.9420290999114513, + 0.04316699877381325, + 0.47187001816928387, + 0.5177339296787977, + 2.580809937790036, + 0.04224982112646103, + 0.4640517346560955, + 0.09793748147785664, + 0.0, + 0.23912091925740242, + 0.7422119975090027, + 0.369562279433012, + 0.549461105838418, + 0.41204747557640076, + 0.8686532005667686, + 0.7472802549600601 + ], + "unique_experts": 54, + "load_cv": 1.0015414724274025, + "normalized_load_entropy": 0.8846780801586147, + "max_load_share": 0.0770440251572327 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "0d4507210ec5705dd4cf1091cc0f38da1e67c4cf2c351799caff265ee356c6fe", + "route_weight_sha256": "a3cb7311c8e9813e1046048fa95747c77f0892262772df492508927aba099aea", + "loads": [ + 25, + 5, + 5, + 7, + 35, + 11, + 39, + 18, + 21, + 1, + 21, + 14, + 20, + 17, + 4, + 24, + 16, + 10, + 2, + 2, + 6, + 10, + 20, + 3, + 14, + 0, + 13, + 1, + 7, + 18, + 7, + 6, + 22, + 16, + 6, + 16, + 7, + 1, + 19, + 42, + 11, + 5, + 16, + 2, + 18, + 22, + 14, + 31, + 19, + 6, + 14, + 14, + 51, + 3, + 12, + 5, + 3, + 15, + 23, + 12, + 13, + 12, + 16, + 14 + ], + "weighted_loads": [ + 1.3079248797148466, + 0.28693729266524315, + 0.223411463201046, + 0.3053768388926983, + 1.5434788167476654, + 0.5198754444718361, + 2.690402088686824, + 1.3037859667092562, + 0.9580199886113405, + 0.030591819435358047, + 1.409404195845127, + 1.0610906202346087, + 1.0845948196947575, + 0.809125255793333, + 0.1419703457504511, + 1.599669024348259, + 0.7820006608963013, + 0.3520879354327917, + 0.06607121601700783, + 0.0834331177175045, + 0.26536694914102554, + 0.5601177830249071, + 1.0974248312413692, + 0.12196814641356468, + 0.5639343522489071, + 0.0, + 0.49099245481193066, + 0.025725403800606728, + 0.26669944263994694, + 1.6255043745040894, + 0.4052514396607876, + 0.2661709226667881, + 1.3967771027237177, + 1.3986561819911003, + 0.5019460581243038, + 1.215345747768879, + 0.432716378942132, + 0.03337422013282776, + 1.1357108112424612, + 2.4452915471047163, + 0.7089135348796844, + 0.2017212137579918, + 0.9726491868495941, + 0.08864400908350945, + 1.311626199632883, + 1.7638154923915863, + 0.5624229945242405, + 1.4256142266094685, + 2.2369047589600086, + 0.2887106314301491, + 0.509103836491704, + 0.5177339296787977, + 2.6538760755211115, + 0.1223544329404831, + 0.535197963938117, + 0.20975967682898045, + 0.15489286184310913, + 0.9464253596961498, + 1.0144362095743418, + 0.5240497142076492, + 0.5781462397426367, + 0.5293334908783436, + 0.8686532005667686, + 0.8369914777576923 + ], + "unique_experts": 63, + "load_cv": 0.7408236490847178, + "normalized_load_entropy": 0.9360590923259703, + "max_load_share": 0.05782312925170068 + } + }, + "s0_period": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "289a6b387394388ca6c3cc73528d6faf67928edf0a8648a6bae482429b0ef49b", + "route_weight_sha256": "974e8efc90957499305dede3119a7e0e718d50e975a3c992707fd90dae263746", + "loads": [ + 21, + 2, + 6, + 7, + 34, + 8, + 10, + 18, + 21, + 0, + 12, + 6, + 19, + 17, + 6, + 18, + 16, + 8, + 0, + 1, + 4, + 5, + 22, + 0, + 7, + 0, + 7, + 1, + 6, + 0, + 0, + 6, + 21, + 4, + 3, + 16, + 3, + 0, + 18, + 39, + 8, + 0, + 7, + 1, + 0, + 10, + 12, + 22, + 16, + 1, + 13, + 11, + 50, + 1, + 10, + 2, + 0, + 4, + 19, + 9, + 11, + 8, + 16, + 13 + ], + "weighted_loads": [ + 1.163913071155548, + 0.07953277230262756, + 0.27117496356368065, + 0.3085036836564541, + 1.462855400517583, + 0.4095574654638767, + 0.43154244869947433, + 1.325747836381197, + 0.966707918792963, + 0.0, + 0.8015038445591927, + 0.2818956431001425, + 1.078286174684763, + 0.8127681072801352, + 0.210497185587883, + 1.152609508484602, + 0.7890161722898483, + 0.266982140019536, + 0.0, + 0.032406359910964966, + 0.17123422771692276, + 0.2784576043486595, + 1.1969377845525742, + 0.0, + 0.30641938745975494, + 0.0, + 0.23359681107103825, + 0.02438303455710411, + 0.2328713722527027, + 0.0, + 0.0, + 0.26188010163605213, + 1.3723495732992887, + 0.22222523018717766, + 0.2789374366402626, + 1.1843721941113472, + 0.10390912741422653, + 0.0, + 1.0933359563350677, + 2.2855983823537827, + 0.519757455214858, + 0.0, + 0.278446227312088, + 0.052806392312049866, + 0.0, + 0.6431906558573246, + 0.4755989648401737, + 0.8036406636238098, + 1.9728574007749557, + 0.045225489884614944, + 0.46671090833842754, + 0.41820629872381687, + 2.687087034806609, + 0.04837750270962715, + 0.4877711683511734, + 0.10424646735191345, + 0.0, + 0.2534761466085911, + 0.8700401317328215, + 0.3794162943959236, + 0.5246087163686752, + 0.37781449407339096, + 0.8541696239262819, + 0.773828748613596 + ], + "unique_experts": 54, + "load_cv": 0.985617067184247, + "normalized_load_entropy": 0.8880665224612855, + "max_load_share": 0.07861635220125786 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "8a4b693550991f5f750dabae35ab1b7a86c8d2e889c446da71aa41d74a5c479c", + "route_weight_sha256": "b292205e6cd4acb258202230c04d99f2dcaf5f5f448cdf4de46026201705353f", + "loads": [ + 21, + 7, + 6, + 7, + 34, + 8, + 26, + 18, + 21, + 2, + 23, + 11, + 19, + 17, + 6, + 24, + 16, + 10, + 1, + 2, + 5, + 8, + 22, + 0, + 11, + 0, + 10, + 1, + 6, + 13, + 0, + 6, + 21, + 11, + 4, + 16, + 7, + 1, + 18, + 41, + 9, + 3, + 10, + 3, + 12, + 21, + 14, + 23, + 18, + 1, + 14, + 11, + 54, + 4, + 12, + 2, + 3, + 4, + 24, + 14, + 11, + 9, + 16, + 14 + ], + "weighted_loads": [ + 1.163913071155548, + 0.4831204004585743, + 0.27117496356368065, + 0.3085036836564541, + 1.462855400517583, + 0.4095574654638767, + 1.7252725791186094, + 1.325747836381197, + 0.966707918792963, + 0.07683849334716797, + 1.5423597190529108, + 0.7042452096939087, + 1.078286174684763, + 0.8127681072801352, + 0.210497185587883, + 1.4601889289915562, + 0.7890161722898483, + 0.3440727386623621, + 0.04177592322230339, + 0.07588746771216393, + 0.21817396953701973, + 0.42695945315063, + 1.1969377845525742, + 0.0, + 0.5292996987700462, + 0.0, + 0.35808797739446163, + 0.02438303455710411, + 0.2328713722527027, + 0.964756540954113, + 0.0, + 0.26188010163605213, + 1.3723495732992887, + 0.8948986455798149, + 0.30175886303186417, + 1.1843721941113472, + 0.4004474859684706, + 0.03359677270054817, + 1.0933359563350677, + 2.3894843868911266, + 0.6296329852193594, + 0.13313450291752815, + 0.4023900330066681, + 0.1616024412214756, + 0.8155428841710091, + 1.6777095831930637, + 0.5411819033324718, + 1.1647596061229706, + 2.0522086545825005, + 0.045225489884614944, + 0.5045850481837988, + 0.41820629872381687, + 2.831752633675933, + 0.18649761006236076, + 0.5761698186397552, + 0.10424646735191345, + 0.164889108389616, + 0.2534761466085911, + 1.141911095008254, + 0.6156516559422016, + 0.5246087163686752, + 0.4071201290935278, + 0.8541696239262819, + 0.8114707358181477 + ], + "unique_experts": 61, + "load_cv": 0.8184963985231102, + "normalized_load_entropy": 0.9229505614241362, + "max_load_share": 0.06870229007633588 + } + }, + "s1_period": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "6c834287c903418b48e94117279e854bbb1d274232122e1580768fabccc7a24e", + "route_weight_sha256": "848503c6cbc19af8935e2dbffcf336391d72eae4ba6b08114cbe3e2997cb56e4", + "loads": [ + 19, + 1, + 5, + 7, + 38, + 8, + 10, + 19, + 21, + 0, + 11, + 4, + 18, + 16, + 4, + 16, + 16, + 9, + 0, + 0, + 5, + 5, + 21, + 0, + 9, + 0, + 8, + 1, + 7, + 0, + 0, + 4, + 21, + 4, + 3, + 15, + 2, + 0, + 18, + 42, + 9, + 1, + 7, + 1, + 0, + 10, + 12, + 25, + 15, + 1, + 12, + 12, + 52, + 1, + 11, + 2, + 0, + 4, + 18, + 9, + 11, + 8, + 16, + 12 + ], + "weighted_loads": [ + 1.088750071823597, + 0.04791400581598282, + 0.22523579746484756, + 0.30737508460879326, + 1.6155778374522924, + 0.40941399708390236, + 0.40398024022579193, + 1.3577751759439707, + 0.9715514928102493, + 0.0, + 0.7675297874957323, + 0.2137524001300335, + 1.0266347862780094, + 0.7730877138674259, + 0.13889380730688572, + 1.0750305466353893, + 0.7694571763277054, + 0.2997255325317383, + 0.0, + 0.0, + 0.20824408158659935, + 0.2807002291083336, + 1.164183545857668, + 0.0, + 0.3740875720977783, + 0.0, + 0.29393021017313004, + 0.025768032297492027, + 0.27014609798789024, + 0.0, + 0.0, + 0.18769654631614685, + 1.3839216735213995, + 0.21936176717281342, + 0.2718017175793648, + 1.1571321040391922, + 0.07454459741711617, + 0.0, + 1.0931017026305199, + 2.4109652675688267, + 0.5613851100206375, + 0.03097318857908249, + 0.2745106779038906, + 0.04938692972064018, + 0.0, + 0.6464869976043701, + 0.4770875349640846, + 0.9166398011147976, + 1.9104488715529442, + 0.044144876301288605, + 0.4346141070127487, + 0.444597827270627, + 2.707153184339404, + 0.04824332892894745, + 0.4886280093342066, + 0.1005200743675232, + 0.0, + 0.23568369820713997, + 0.8085756972432137, + 0.37578932009637356, + 0.5195626821368933, + 0.38524407520890236, + 0.8588432930409908, + 0.7501001730561256 + ], + "unique_experts": 54, + "load_cv": 1.0286624490477576, + "normalized_load_entropy": 0.8822647362226211, + "max_load_share": 0.08176100628930817 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "44537d5d5d03ea7deec06b06d0a38ec0a5719939b0b219ec03911cb7f4374c67", + "route_weight_sha256": "ba5e0aba5f1008fd9bbc2f13cb4600cf477fe756a6134b4dcb2a94e7b77a93c0", + "loads": [ + 24, + 6, + 5, + 7, + 38, + 10, + 39, + 19, + 21, + 1, + 22, + 15, + 18, + 16, + 4, + 23, + 16, + 12, + 2, + 2, + 6, + 10, + 21, + 3, + 13, + 0, + 12, + 1, + 7, + 19, + 7, + 6, + 21, + 17, + 6, + 16, + 8, + 1, + 19, + 44, + 12, + 5, + 15, + 2, + 18, + 23, + 14, + 27, + 18, + 6, + 13, + 12, + 54, + 3, + 13, + 4, + 3, + 15, + 24, + 12, + 12, + 10, + 16, + 14 + ], + "weighted_loads": [ + 1.290100034326315, + 0.451536200940609, + 0.22523579746484756, + 0.30737508460879326, + 1.6155778374522924, + 0.4772430472075939, + 2.668548097833991, + 1.3577751759439707, + 0.9715514928102493, + 0.030591819435358047, + 1.5027986317873, + 1.0950716864317656, + 1.0266347862780094, + 0.7730877138674259, + 0.13889380730688572, + 1.4509840533137321, + 0.7694571763277054, + 0.41742054745554924, + 0.06607121601700783, + 0.0834331177175045, + 0.2634231969714165, + 0.5551966708153486, + 1.164183545857668, + 0.12196814641356468, + 0.6292502880096436, + 0.0, + 0.4553520753979683, + 0.025768032297492027, + 0.27014609798789024, + 1.7042022235691547, + 0.4052514396607876, + 0.2602010630071163, + 1.3839216735213995, + 1.4459398612380028, + 0.4973820932209492, + 1.2124829851090908, + 0.5012297984212637, + 0.03337422013282776, + 1.1360663808882236, + 2.521278690546751, + 0.7454949803650379, + 0.20181125029921532, + 0.9238808266818523, + 0.0833483524620533, + 1.2833864279091358, + 1.6966321021318436, + 0.553188793361187, + 1.3162931650877, + 2.1994364708662033, + 0.28968850895762444, + 0.47184792533516884, + 0.444597827270627, + 2.7802193220704794, + 0.1283479407429695, + 0.5597742386162281, + 0.17252087593078613, + 0.15489286184310913, + 0.9429881386458874, + 1.0531341545283794, + 0.5302767548710108, + 0.548247816041112, + 0.46720264106988907, + 0.8588432930409908, + 0.8398113958537579 + ], + "unique_experts": 63, + "load_cv": 0.7604422579267583, + "normalized_load_entropy": 0.9344027427380897, + "max_load_share": 0.061224489795918366 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 106, + "ordered_topk_exact_tokens": 68, + "set_exact_tokens": 82, + "mean_set_jaccard": 0.933288409703504, + "mean_token_weighted_tv": 0.011906176190471874, + "aggregate_load_tv": 0.023584905660377353 + }, + "system_bos": { + "tokens": 106, + "ordered_topk_exact_tokens": 49, + "set_exact_tokens": 72, + "mean_set_jaccard": 0.90633423180593, + "mean_token_weighted_tv": 0.017593594188889804, + "aggregate_load_tv": 0.02515723270440251 + }, + "system_x": { + "tokens": 106, + "ordered_topk_exact_tokens": 47, + "set_exact_tokens": 66, + "mean_set_jaccard": 0.8881401617250675, + "mean_token_weighted_tv": 0.02007037947692399, + "aggregate_load_tv": 0.03930817610062892 + }, + "system_period": { + "tokens": 106, + "ordered_topk_exact_tokens": 48, + "set_exact_tokens": 70, + "mean_set_jaccard": 0.8989218328840971, + "mean_token_weighted_tv": 0.01798562266213714, + "aggregate_load_tv": 0.03616352201257861 + }, + "bos_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 47, + "set_exact_tokens": 67, + "mean_set_jaccard": 0.8888140161725068, + "mean_token_weighted_tv": 0.02066430432792261, + "aggregate_load_tv": 0.033018867924528295 + }, + "bos_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 49, + "set_exact_tokens": 64, + "mean_set_jaccard": 0.8766846361185985, + "mean_token_weighted_tv": 0.022415568893951066, + "aggregate_load_tv": 0.03459119496855346 + }, + "x_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 48, + "set_exact_tokens": 64, + "mean_set_jaccard": 0.8827493261455527, + "mean_token_weighted_tv": 0.021096949351354026, + "aggregate_load_tv": 0.033018867924528295 + }, + "x_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 37, + "set_exact_tokens": 62, + "mean_set_jaccard": 0.8656783468104222, + "mean_token_weighted_tv": 0.025613021307607304, + "aggregate_load_tv": 0.04245283018867924 + }, + "period_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 45, + "set_exact_tokens": 58, + "mean_set_jaccard": 0.86455525606469, + "mean_token_weighted_tv": 0.023650030350699177, + "aggregate_load_tv": 0.040880503144654086 + }, + "period_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 39, + "set_exact_tokens": 61, + "mean_set_jaccard": 0.8614106019766399, + "mean_token_weighted_tv": 0.025421504572666478, + "aggregate_load_tv": 0.040880503144654086 + } + } + }, + "layer_14": { + "layer": 14, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "324e227a70483eb2ae19c993a66f3ad93d811f6f98d59d267fd99a6c29a536a7", + "route_weight_sha256": "d1dd82463c78db1c3b4bb90b5270c0c6090b83865ef6698d1d4bf2a28d174265", + "loads": [ + 8, + 3, + 9, + 5, + 6, + 2, + 30, + 5, + 12, + 0, + 46, + 1, + 4, + 22, + 3, + 5, + 17, + 8, + 6, + 19, + 21, + 9, + 0, + 8, + 2, + 7, + 9, + 10, + 10, + 29, + 3, + 6, + 10, + 0, + 1, + 15, + 3, + 14, + 15, + 17, + 12, + 26, + 13, + 0, + 5, + 4, + 17, + 23, + 8, + 19, + 1, + 15, + 12, + 1, + 31, + 17, + 6, + 0, + 2, + 4, + 2, + 10, + 4, + 4 + ], + "weighted_loads": [ + 0.6040242351591587, + 0.11442848667502403, + 0.4152928125113249, + 0.18242976069450378, + 0.38970035314559937, + 0.07457546144723892, + 2.4959817454218864, + 0.15838291123509407, + 0.6597911827266216, + 0.0, + 2.345003282651305, + 0.03931782767176628, + 0.14597502164542675, + 1.467061560600996, + 0.11079831421375275, + 0.24903356283903122, + 0.8388347961008549, + 0.44128669053316116, + 0.261835191398859, + 1.6215955540537834, + 1.7869772985577583, + 0.7738313414156437, + 0.0, + 0.29114046692848206, + 0.1655225194990635, + 0.5043042041361332, + 0.4405545983463526, + 0.4162650443613529, + 0.3699612654745579, + 1.5832856707274914, + 0.1648142859339714, + 0.2519053593277931, + 0.7027243729680777, + 0.0, + 0.04384315758943558, + 0.9454983659088612, + 0.09922508336603642, + 0.9104253239929676, + 0.9385438784956932, + 0.9447525404393673, + 0.44108780659735203, + 2.050581719726324, + 0.7592981401830912, + 0.0, + 0.3145759887993336, + 0.12758143618702888, + 1.7063447628170252, + 1.954442759975791, + 1.40902029722929, + 1.9620887339115143, + 0.057178713381290436, + 0.5910528991371393, + 0.8279745951294899, + 0.06824849545955658, + 2.559664560481906, + 1.061129815876484, + 0.3102151192724705, + 0.0, + 0.07055007293820381, + 0.15977666154503822, + 0.11961697787046432, + 0.41518858447670937, + 0.2607385627925396, + 0.2516997680068016 + ], + "unique_experts": 59, + "load_cv": 0.9162337025119546, + "normalized_load_entropy": 0.9054984308392324, + "max_load_share": 0.07232704402515723 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "c3d4b8ae33f160f825da14bee7c190c2e0c7b176a1861afaf83519a98a02562b", + "route_weight_sha256": "eb4213a6e9c176a907596dfab08a980e2a08a25069365679bc550200442bf72b", + "loads": [ + 14, + 3, + 9, + 6, + 7, + 13, + 30, + 7, + 12, + 7, + 48, + 4, + 4, + 22, + 3, + 9, + 17, + 8, + 11, + 21, + 21, + 9, + 0, + 19, + 3, + 10, + 15, + 16, + 17, + 29, + 5, + 11, + 10, + 7, + 1, + 15, + 4, + 15, + 17, + 17, + 12, + 26, + 14, + 1, + 7, + 4, + 24, + 26, + 8, + 19, + 6, + 20, + 18, + 7, + 31, + 21, + 7, + 0, + 2, + 15, + 2, + 11, + 4, + 5 + ], + "weighted_loads": [ + 1.2579242251813412, + 0.11442848667502403, + 0.4152928125113249, + 0.22233949229121208, + 0.43555187806487083, + 1.0991025790572166, + 2.4959817454218864, + 0.23122138902544975, + 0.6597911827266216, + 0.5074448511004448, + 2.4116725847125053, + 0.23252084106206894, + 0.14597502164542675, + 1.467061560600996, + 0.11079831421375275, + 0.4354028720408678, + 0.8388347961008549, + 0.44128669053316116, + 0.6194785591214895, + 1.7752068638801575, + 1.7869772985577583, + 0.7738313414156437, + 0.0, + 0.7619989104568958, + 0.18814696371555328, + 0.7190549261868, + 0.778325529769063, + 0.8714401656761765, + 1.4846928007900715, + 1.5832856707274914, + 0.32002706080675125, + 0.45565840136259794, + 0.7027243729680777, + 0.5695316791534424, + 0.04384315758943558, + 0.9454983659088612, + 0.15101350657641888, + 0.9534423686563969, + 1.0713873989880085, + 0.9447525404393673, + 0.44108780659735203, + 2.050581719726324, + 0.8180085923522711, + 0.04766218736767769, + 0.37912432476878166, + 0.12758143618702888, + 2.0453713461756706, + 2.089050717651844, + 1.40902029722929, + 1.9620887339115143, + 0.26335075311362743, + 1.902636231854558, + 1.5449663624167442, + 0.4967467077076435, + 2.559664560481906, + 1.3944612927734852, + 0.3507119454443455, + 0.0, + 0.07055007293820381, + 0.6672403030097485, + 0.11961697787046432, + 0.4201966621913016, + 0.2607385627925396, + 0.33166737854480743 + ], + "unique_experts": 62, + "load_cv": 0.7347259398463567, + "normalized_load_entropy": 0.936543110314368, + "max_load_share": 0.061068702290076333 + } + }, + "s1_eos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "1960dfdc83b8a07182f75b5e4a75ffcdd0dac0e0298506d4ab27c068cf3ec09b", + "route_weight_sha256": "4846032c5b7401e732c2a2ee216be2fba6d5b82be8a8d155c224d814ccbe8471", + "loads": [ + 8, + 3, + 9, + 4, + 6, + 2, + 30, + 4, + 12, + 0, + 45, + 1, + 4, + 21, + 4, + 5, + 18, + 9, + 5, + 18, + 21, + 9, + 0, + 8, + 2, + 7, + 9, + 8, + 8, + 31, + 3, + 6, + 10, + 0, + 1, + 15, + 3, + 14, + 15, + 17, + 11, + 26, + 13, + 0, + 6, + 3, + 17, + 23, + 8, + 19, + 2, + 17, + 10, + 1, + 32, + 19, + 8, + 0, + 2, + 4, + 3, + 7, + 5, + 5 + ], + "weighted_loads": [ + 0.6180758439004421, + 0.11257878318428993, + 0.4080621022731066, + 0.14821355044841766, + 0.3924258276820183, + 0.07229283824563026, + 2.5378566831350327, + 0.12544718571007252, + 0.6595272645354271, + 0.0, + 2.308792434632778, + 0.041664622724056244, + 0.14879672415554523, + 1.4539470355957747, + 0.1411832608282566, + 0.25343430414795876, + 0.8590991273522377, + 0.4813279379159212, + 0.22164791822433472, + 1.57772047072649, + 1.763855718076229, + 0.7948933467268944, + 0.0, + 0.288351533934474, + 0.168695580214262, + 0.4989745169878006, + 0.42285006679594517, + 0.3348077032715082, + 0.3065818324685097, + 1.6480975039303303, + 0.17202181741595268, + 0.24961096420884132, + 0.6941792462021112, + 0.0, + 0.041478171944618225, + 0.9418126121163368, + 0.10237285494804382, + 0.8982379995286465, + 0.9379592854529619, + 0.9356648754328489, + 0.39918842539191246, + 2.064770644530654, + 0.7679458893835545, + 0.0, + 0.360024344176054, + 0.09586446359753609, + 1.7058060187846422, + 1.9102596528828144, + 1.4189950563013554, + 1.9435210600495338, + 0.09078595414757729, + 0.6750064976513386, + 0.774027481675148, + 0.07151061296463013, + 2.589069291949272, + 1.1369963008910418, + 0.38795063085854053, + 0.0, + 0.06958949193358421, + 0.15992079488933086, + 0.1484630350023508, + 0.30108997225761414, + 0.2902409750968218, + 0.2693417724221945 + ], + "unique_experts": 59, + "load_cv": 0.9201969304057772, + "normalized_load_entropy": 0.9056744419929111, + "max_load_share": 0.07075471698113207 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "90c87e8396aff3593d5f5491e52c18888f03960d5f6d49487b5f96c346ce3f2e", + "route_weight_sha256": "4128d40b9c3e3f8307330e6159388141a3d4c9994a2beadfeeeabb92ed9d4a84", + "loads": [ + 15, + 4, + 9, + 6, + 10, + 19, + 30, + 8, + 14, + 10, + 45, + 4, + 9, + 21, + 4, + 10, + 18, + 9, + 12, + 23, + 23, + 13, + 0, + 18, + 8, + 12, + 14, + 16, + 20, + 32, + 7, + 9, + 12, + 11, + 2, + 16, + 3, + 17, + 18, + 18, + 11, + 26, + 15, + 1, + 8, + 3, + 24, + 26, + 10, + 20, + 17, + 21, + 18, + 11, + 34, + 22, + 9, + 1, + 3, + 22, + 6, + 9, + 7, + 9 + ], + "weighted_loads": [ + 1.3655064441263676, + 0.16442816331982613, + 0.4080621022731066, + 0.22379210218787193, + 0.6457514613866806, + 1.31019152328372, + 2.5378566831350327, + 0.28925771079957485, + 0.8273547887802124, + 0.7837820798158646, + 2.308792434632778, + 0.2565896362066269, + 0.49742372520267963, + 1.4539470355957747, + 0.1411832608282566, + 0.49522566981613636, + 0.8590991273522377, + 0.4813279379159212, + 0.7403981983661652, + 1.882365783676505, + 1.9931524209678173, + 0.9446960389614105, + 0.0, + 0.7099330518394709, + 0.448733102530241, + 0.7721089720726013, + 0.7930136639624834, + 0.6995214922353625, + 1.9594682790338993, + 1.6957262195646763, + 0.38030778616666794, + 0.33844641502946615, + 0.7749996315687895, + 1.0494425483047962, + 0.09047159552574158, + 1.0218082591891289, + 0.10237285494804382, + 1.2535371743142605, + 1.1617664564400911, + 0.9928172472864389, + 0.39918842539191246, + 2.064770644530654, + 0.8660516552627087, + 0.05069635063409805, + 0.4233754687011242, + 0.09586446359753609, + 2.070959521457553, + 2.0210286173969507, + 1.5479664504528046, + 1.977564625442028, + 1.039996698498726, + 1.948073387145996, + 1.5792193785309792, + 0.8256336413323879, + 2.6715116538107395, + 1.4085302222520113, + 0.4396613594144583, + 0.038023509085178375, + 0.1764349602162838, + 1.1976417135447264, + 0.4001373890787363, + 0.3452907600440085, + 0.39196272008121014, + 0.4508251156657934 + ], + "unique_experts": 63, + "load_cv": 0.6331648869572732, + "normalized_load_entropy": 0.9511211966371629, + "max_load_share": 0.05102040816326531 + } + }, + "s0_bos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "5b64528d4dead65dd359a3a83d3274a9c66716a05f78f3e32ff4daa63c22ae7b", + "route_weight_sha256": "ae9d99ed3498da694496af90e10f388018f492704ffebe238d811b49ea04b14a", + "loads": [ + 8, + 3, + 9, + 6, + 6, + 2, + 31, + 4, + 13, + 0, + 43, + 1, + 4, + 19, + 3, + 5, + 18, + 8, + 5, + 16, + 20, + 9, + 0, + 8, + 2, + 7, + 8, + 8, + 10, + 28, + 4, + 6, + 10, + 0, + 1, + 16, + 2, + 14, + 14, + 17, + 17, + 27, + 13, + 0, + 7, + 2, + 16, + 23, + 10, + 19, + 3, + 15, + 11, + 1, + 32, + 16, + 8, + 0, + 2, + 4, + 2, + 11, + 5, + 4 + ], + "weighted_loads": [ + 0.6300218012183905, + 0.11089278943836689, + 0.4228513166308403, + 0.21775326691567898, + 0.39076628163456917, + 0.07090229913592339, + 2.5433206744492054, + 0.12167464755475521, + 0.7017308697104454, + 0.0, + 2.238440530374646, + 0.04039795324206352, + 0.14966900646686554, + 1.4068522714078426, + 0.1016409732401371, + 0.2428070344030857, + 0.8891025427728891, + 0.4279900807887316, + 0.2296757884323597, + 1.4721378404647112, + 1.7702581323683262, + 0.7277033589780331, + 0.0, + 0.2944227997213602, + 0.160181675106287, + 0.5045502781867981, + 0.4033727813512087, + 0.34043950214982033, + 0.3732472714036703, + 1.5712583437561989, + 0.20015119388699532, + 0.24956370890140533, + 0.7153450101613998, + 0.0, + 0.047764852643013, + 0.9698759410530329, + 0.07231134176254272, + 0.9171116873621941, + 0.9182870052754879, + 0.9904358685016632, + 0.6029877383261919, + 2.134971546009183, + 0.7681375835090876, + 0.0, + 0.413179125636816, + 0.07012226432561874, + 1.7053733058273792, + 1.9845497235655785, + 1.4723188243806362, + 1.9481441490352154, + 0.12160962447524071, + 0.5791721548885107, + 0.7946582660079002, + 0.0710342675447464, + 2.6089290753006935, + 1.0253314301371574, + 0.3978048153221607, + 0.0, + 0.0680706575512886, + 0.1523040384054184, + 0.11806968227028847, + 0.4443227667361498, + 0.2881532050669193, + 0.2500969022512436 + ], + "unique_experts": 59, + "load_cv": 0.8949179458591799, + "normalized_load_entropy": 0.908278688240737, + "max_load_share": 0.06761006289308176 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "479d6f0b924445205a2dec1f1b2640cd076aaf62d968dc21f6a48b8d1a75ca06", + "route_weight_sha256": "d4b7d44f0b073c348d3eeff723fe732a3996ff10a93bc7eea0708aeb4e38ccd2", + "loads": [ + 14, + 3, + 9, + 8, + 7, + 13, + 31, + 5, + 13, + 7, + 45, + 4, + 4, + 19, + 3, + 9, + 18, + 8, + 11, + 18, + 20, + 9, + 0, + 18, + 3, + 10, + 14, + 14, + 18, + 28, + 6, + 10, + 10, + 7, + 1, + 16, + 3, + 15, + 16, + 17, + 17, + 27, + 13, + 1, + 10, + 2, + 23, + 26, + 10, + 19, + 7, + 20, + 17, + 7, + 32, + 20, + 9, + 1, + 3, + 15, + 2, + 11, + 5, + 5 + ], + "weighted_loads": [ + 1.283921791240573, + 0.11089278943836689, + 0.4228513166308403, + 0.3009080681949854, + 0.43780626729130745, + 1.0846797414124012, + 2.5433206744492054, + 0.15523391030728817, + 0.7017308697104454, + 0.5195355005562305, + 2.3051098324358463, + 0.23360096663236618, + 0.14966900646686554, + 1.4068522714078426, + 0.1016409732401371, + 0.458477009087801, + 0.8891025427728891, + 0.4279900807887316, + 0.6730389725416899, + 1.6164037007838488, + 1.7702581323683262, + 0.7277033589780331, + 0.0, + 0.7375752907246351, + 0.1828061193227768, + 0.7349245846271515, + 0.7411437127739191, + 0.8383194282650948, + 1.5514255668967962, + 1.5712583437561989, + 0.358825895935297, + 0.4528633616864681, + 0.7153450101613998, + 0.5669514238834381, + 0.047764852643013, + 0.9698759410530329, + 0.12409976497292519, + 0.9601287320256233, + 1.0635339245200157, + 0.9904358685016632, + 0.6029877383261919, + 2.134971546009183, + 0.7681375835090876, + 0.04766218736767769, + 0.5514081083238125, + 0.07012226432561874, + 2.0385648887604475, + 2.119450619444251, + 1.4723188243806362, + 1.9481441490352154, + 0.31943370401859283, + 1.0955688450485468, + 1.5116500332951546, + 0.49953247979283333, + 2.6089290753006935, + 1.395291555672884, + 0.4383016414940357, + 0.04337989538908005, + 0.11109066382050514, + 0.6513321585953236, + 0.11806968227028847, + 0.4443227667361498, + 0.2881532050669193, + 0.32984886318445206 + ], + "unique_experts": 63, + "load_cv": 0.709184545062688, + "normalized_load_entropy": 0.9403179824747155, + "max_load_share": 0.05725190839694656 + } + }, + "s1_bos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "cc1f95e521e37724d55e748a1d8e0c186f66146de803c7d8fd22c5e713863dab", + "route_weight_sha256": "b971c1a6cf15f83bcc27268b9c0b57478409a88a167c6980a9e0b3a53b9f7b7b", + "loads": [ + 8, + 3, + 10, + 4, + 6, + 2, + 30, + 4, + 13, + 0, + 49, + 1, + 4, + 18, + 4, + 5, + 16, + 8, + 6, + 16, + 20, + 9, + 0, + 8, + 2, + 7, + 7, + 8, + 10, + 29, + 4, + 7, + 10, + 0, + 1, + 16, + 3, + 14, + 14, + 16, + 14, + 26, + 13, + 0, + 7, + 2, + 17, + 22, + 9, + 21, + 2, + 16, + 11, + 1, + 32, + 17, + 8, + 0, + 2, + 3, + 3, + 8, + 5, + 5 + ], + "weighted_loads": [ + 0.6069354079663754, + 0.11286364495754242, + 0.4507516138255596, + 0.15279367938637733, + 0.3962676450610161, + 0.06881047040224075, + 2.5821320191025734, + 0.1291108950972557, + 0.6976350527256727, + 0.0, + 2.468094404786825, + 0.041652049869298935, + 0.14764605835080147, + 1.3584250342100859, + 0.14362205937504768, + 0.2575226463377476, + 0.8145924061536789, + 0.4244084358215332, + 0.2441608514636755, + 1.44746982306242, + 1.7371579594910145, + 0.689389955252409, + 0.0, + 0.28577578626573086, + 0.168413195759058, + 0.4946656711399555, + 0.34699342027306557, + 0.3360334075987339, + 0.36901012249290943, + 1.5951738506555557, + 0.20609529688954353, + 0.28651752322912216, + 0.709202267229557, + 0.0, + 0.04073009267449379, + 0.9749383293092251, + 0.10639575123786926, + 0.9211654029786587, + 0.910456757992506, + 0.9622774198651314, + 0.501237066462636, + 2.0699491817504168, + 0.7512815129011869, + 0.0, + 0.4339386783540249, + 0.0645665843039751, + 1.6732572186738253, + 1.9397835694253445, + 1.4118211679160595, + 2.013320265337825, + 0.08980103209614754, + 0.6094480343163013, + 0.7823568638414145, + 0.06311202794313431, + 2.5416994616389275, + 1.0630170740187168, + 0.37783094123005867, + 0.0, + 0.065813347697258, + 0.11781341396272182, + 0.15336260572075844, + 0.32881903648376465, + 0.2855044510215521, + 0.26772401854395866 + ], + "unique_experts": 59, + "load_cv": 0.9246566462064066, + "normalized_load_entropy": 0.9062870881687828, + "max_load_share": 0.0770440251572327 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "e683d1a4a5f2aa0f195c220cab851859603773711004479e07a0ca25d17f775b", + "route_weight_sha256": "7b4a547da1c4346fc34309f2365472a24f8251f18c559ced7964caee4f9df8d2", + "loads": [ + 15, + 4, + 10, + 6, + 10, + 19, + 30, + 7, + 15, + 10, + 49, + 4, + 9, + 18, + 4, + 10, + 16, + 8, + 13, + 21, + 22, + 12, + 0, + 17, + 8, + 12, + 12, + 16, + 23, + 30, + 8, + 10, + 12, + 11, + 2, + 17, + 3, + 17, + 17, + 17, + 14, + 26, + 14, + 1, + 10, + 3, + 24, + 25, + 11, + 22, + 18, + 21, + 19, + 10, + 34, + 20, + 9, + 2, + 3, + 21, + 6, + 9, + 7, + 9 + ], + "weighted_loads": [ + 1.3543660081923008, + 0.1647130250930786, + 0.4507516138255596, + 0.24192716926336288, + 0.6526455022394657, + 1.284864418208599, + 2.5821320191025734, + 0.25565337017178535, + 0.865462576970458, + 0.7949097491800785, + 2.468094404786825, + 0.2565770633518696, + 0.49627305939793587, + 1.3584250342100859, + 0.14362205937504768, + 0.5072697885334492, + 0.8145924061536789, + 0.4244084358215332, + 0.7245956119149923, + 1.7480654399842024, + 1.9664546623826027, + 0.7913585007190704, + 0.0, + 0.679944459348917, + 0.448450718075037, + 0.7790340930223465, + 0.7171570174396038, + 0.7551137022674084, + 2.205026851966977, + 1.6428025662899017, + 0.4171578884124756, + 0.42712271958589554, + 0.7900226525962353, + 1.0630056746304035, + 0.08972351625561714, + 1.0549339763820171, + 0.10639575123786926, + 1.2764645777642727, + 1.1661299355328083, + 1.0194297917187214, + 0.501237066462636, + 2.0699491817504168, + 0.8038940187543631, + 0.05069635063409805, + 0.5388152152299881, + 0.10629953257739544, + 2.0295939203351736, + 2.0552089493721724, + 1.5407925620675087, + 2.047363830730319, + 1.0856135301291943, + 1.097439132630825, + 1.5875487606972456, + 0.7764280922710896, + 2.624141823500395, + 1.3873772956430912, + 0.4295416697859764, + 0.07994239404797554, + 0.17265881597995758, + 1.1490102652460337, + 0.40503695979714394, + 0.3682672418653965, + 0.38722619600594044, + 0.4586971290409565 + ], + "unique_experts": 63, + "load_cv": 0.6365342307720256, + "normalized_load_entropy": 0.95190195824871, + "max_load_share": 0.05555555555555555 + } + }, + "s0_x": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "86ab03bcececb69ad3526c7d5b4e666c158bec16a60224de414dad7be02cafd2", + "route_weight_sha256": "18a99917e68065d5340abfd1b918b3dc725a7220dbc32a1f68fe40779ad65585", + "loads": [ + 9, + 3, + 9, + 4, + 6, + 2, + 30, + 4, + 13, + 0, + 46, + 0, + 4, + 21, + 2, + 5, + 18, + 8, + 6, + 16, + 20, + 9, + 0, + 8, + 2, + 7, + 8, + 8, + 10, + 30, + 3, + 6, + 10, + 0, + 1, + 15, + 3, + 14, + 13, + 17, + 15, + 26, + 12, + 0, + 8, + 2, + 18, + 23, + 8, + 21, + 2, + 16, + 10, + 1, + 31, + 17, + 8, + 0, + 2, + 5, + 2, + 9, + 5, + 5 + ], + "weighted_loads": [ + 0.6604546271264553, + 0.1146102286875248, + 0.4154236763715744, + 0.1577872671186924, + 0.393857654184103, + 0.06988519430160522, + 2.541016925126314, + 0.12998679839074612, + 0.7105885278433561, + 0.0, + 2.3265794534236193, + 0.0, + 0.15177315846085548, + 1.465032210573554, + 0.07565983757376671, + 0.24345492757856846, + 0.9013492148369551, + 0.4630364514887333, + 0.2619503401219845, + 1.455880431458354, + 1.7652004659175873, + 0.7087256778031588, + 0.0, + 0.29590264707803726, + 0.16147958859801292, + 0.5098300166428089, + 0.40552376583218575, + 0.33841801807284355, + 0.368241174146533, + 1.6397969014942646, + 0.16569488495588303, + 0.25149543583393097, + 0.7222974859178066, + 0.0, + 0.04403965547680855, + 0.9445629380643368, + 0.10560351237654686, + 0.9020728580653667, + 0.8866784311830997, + 0.9931588098406792, + 0.5534566435962915, + 2.0685261506587267, + 0.7393078729510307, + 0.0, + 0.4713858440518379, + 0.06615056842565536, + 1.749532775953412, + 1.9496693518012762, + 1.369897797703743, + 2.0271361526101828, + 0.09172772616147995, + 0.5860515255481005, + 0.7546571083366871, + 0.05760508030653, + 2.5454692263156176, + 1.0697485730051994, + 0.3996482118964195, + 0.0, + 0.06768921762704849, + 0.18533469550311565, + 0.11831727996468544, + 0.3757165912538767, + 0.2898409962654114, + 0.2931896299123764 + ], + "unique_experts": 58, + "load_cv": 0.9195089004536757, + "normalized_load_entropy": 0.9041551504261802, + "max_load_share": 0.07232704402515723 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "a5483fe8232ae326826aac4e6319bc6c541ad8e19c0cbeb74d5ce236ec76ce37", + "route_weight_sha256": "e4f65b857a99067777b19b6df0cb2f1315abd5398489c40f7592acd17f7d074c", + "loads": [ + 16, + 3, + 9, + 5, + 7, + 15, + 30, + 5, + 13, + 6, + 48, + 3, + 4, + 21, + 2, + 9, + 18, + 8, + 10, + 19, + 20, + 9, + 0, + 18, + 3, + 10, + 15, + 13, + 17, + 30, + 5, + 10, + 10, + 7, + 1, + 15, + 4, + 16, + 15, + 17, + 15, + 26, + 14, + 1, + 10, + 2, + 24, + 26, + 8, + 21, + 7, + 19, + 16, + 8, + 31, + 21, + 9, + 1, + 2, + 17, + 2, + 9, + 5, + 6 + ], + "weighted_loads": [ + 1.4210194684565067, + 0.1146102286875248, + 0.4154236763715744, + 0.1976969987154007, + 0.4422745481133461, + 1.2299837283790112, + 2.541016925126314, + 0.16354606114327908, + 0.7105885278433561, + 0.4436611346900463, + 2.3932487554848194, + 0.19320301339030266, + 0.15177315846085548, + 1.465032210573554, + 0.07565983757376671, + 0.45281810872256756, + 0.9013492148369551, + 0.4630364514887333, + 0.5687324833124876, + 1.6928639095276594, + 1.7652004659175873, + 0.7087256778031588, + 0.0, + 0.7390551380813122, + 0.18410403281450272, + 0.7387415245175362, + 0.8539600856602192, + 0.7487865462899208, + 1.3257116805762053, + 1.6397969014942646, + 0.3256790563464165, + 0.45089225471019745, + 0.7222974859178066, + 0.6191830784082413, + 0.04403965547680855, + 0.9445629380643368, + 0.15739193558692932, + 1.0184957273304462, + 1.0163524374365807, + 0.9931588098406792, + 0.5534566435962915, + 2.0685261506587267, + 0.8285519704222679, + 0.04766218736767769, + 0.535934180021286, + 0.06615056842565536, + 2.054284378886223, + 2.085913088172674, + 1.369897797703743, + 2.0271361526101828, + 0.3329622782766819, + 1.0091026406735182, + 1.4716488756239414, + 0.5702790133655071, + 2.5454692263156176, + 1.3830158598721027, + 0.4401450380682945, + 0.041082996875047684, + 0.06768921762704849, + 0.7503036167472601, + 0.11831727996468544, + 0.3757165912538767, + 0.2898409962654114, + 0.3827686235308647 + ], + "unique_experts": 63, + "load_cv": 0.7354305863571425, + "normalized_load_entropy": 0.9364741633133284, + "max_load_share": 0.061068702290076333 + } + }, + "s1_x": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "f70b6be4603826ed921b3c59d6e76cb616b6494d313cd88c82527cf523342a80", + "route_weight_sha256": "a583ac093015e69cbcc81d077819393353305d716a6ab41f34f0c30a88b155cb", + "loads": [ + 8, + 3, + 9, + 4, + 6, + 2, + 30, + 4, + 13, + 0, + 46, + 2, + 3, + 20, + 4, + 6, + 19, + 8, + 5, + 16, + 20, + 9, + 0, + 7, + 2, + 7, + 7, + 8, + 9, + 31, + 3, + 7, + 10, + 0, + 0, + 16, + 3, + 14, + 14, + 17, + 16, + 26, + 13, + 0, + 8, + 3, + 18, + 22, + 9, + 21, + 3, + 14, + 10, + 1, + 32, + 16, + 8, + 0, + 1, + 3, + 3, + 8, + 4, + 5 + ], + "weighted_loads": [ + 0.6122251898050308, + 0.11496531963348389, + 0.42450734972953796, + 0.1531876139342785, + 0.39064714685082436, + 0.0662909671664238, + 2.586704671382904, + 0.1290412787348032, + 0.6988472118973732, + 0.0, + 2.3579287622123957, + 0.07221752777695656, + 0.11099855042994022, + 1.4454186018556356, + 0.1455335970968008, + 0.27301207184791565, + 0.9212744403630495, + 0.4437496233731508, + 0.2110045701265335, + 1.4801808651536703, + 1.717753078788519, + 0.6804620120674372, + 0.0, + 0.25957406871020794, + 0.16403472051024437, + 0.5008833482861519, + 0.35537079721689224, + 0.3287308122962713, + 0.3294946663081646, + 1.6748976856470108, + 0.1746046133339405, + 0.2803615853190422, + 0.7102384269237518, + 0.0, + 0.0, + 0.9687303975224495, + 0.10493239760398865, + 0.8980978690087795, + 0.9154412671923637, + 0.971398651599884, + 0.5749982353299856, + 2.0272866934537888, + 0.7524827513843775, + 0.0, + 0.4692235253751278, + 0.09948445297777653, + 1.7493411377072334, + 1.9014099519699812, + 1.3905600756406784, + 2.001728877425194, + 0.1182248592376709, + 0.5412768628448248, + 0.7441201061010361, + 0.06130553409457207, + 2.5822994466871023, + 1.0216399766504765, + 0.39268070086836815, + 0.0, + 0.027824504300951958, + 0.10225168243050575, + 0.1550937294960022, + 0.311984920874238, + 0.2651716470718384, + 0.286659337580204 + ], + "unique_experts": 58, + "load_cv": 0.9227724738028822, + "normalized_load_entropy": 0.9045786103023035, + "max_load_share": 0.07232704402515723 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "18e89fd7ab1f8cd0e5525e379def3a79a88d92bd7c8f64eb1f9d8c2157b1e3f0", + "route_weight_sha256": "31624f3754ed3fea3b1d68446370c21f15f0aa92e7ba5cb2fd893ecafdc27e5e", + "loads": [ + 16, + 4, + 9, + 5, + 10, + 22, + 30, + 7, + 15, + 9, + 46, + 6, + 8, + 20, + 4, + 10, + 19, + 8, + 11, + 21, + 22, + 12, + 0, + 17, + 8, + 12, + 13, + 16, + 21, + 32, + 7, + 9, + 12, + 11, + 1, + 17, + 3, + 18, + 17, + 18, + 16, + 26, + 15, + 1, + 10, + 3, + 24, + 25, + 11, + 22, + 18, + 17, + 18, + 11, + 34, + 19, + 9, + 1, + 2, + 24, + 6, + 9, + 6, + 9 + ], + "weighted_loads": [ + 1.4388334825634956, + 0.16681469976902008, + 0.42450734972953796, + 0.1924457848072052, + 0.6505059637129307, + 1.5073500722646713, + 2.586704671382904, + 0.25558375380933285, + 0.8666747361421585, + 0.7100930511951447, + 2.3579287622123957, + 0.3365929275751114, + 0.4596255514770746, + 1.4454186018556356, + 0.1455335970968008, + 0.47806407883763313, + 0.9212744403630495, + 0.4437496233731508, + 0.6468820124864578, + 1.8097413517534733, + 1.9470497816801071, + 0.7824305575340986, + 0.0, + 0.7066896483302116, + 0.4440722428262234, + 0.7707270383834839, + 0.8268400728702545, + 0.6810336876660585, + 1.8231488056480885, + 1.7225264012813568, + 0.393099382519722, + 0.35843604803085327, + 0.7910588122904301, + 1.1181593090295792, + 0.04899342358112335, + 1.0487260445952415, + 0.10493239760398865, + 1.34910224750638, + 1.1335214599967003, + 1.028551023453474, + 0.5749982353299856, + 2.0272866934537888, + 0.861819414421916, + 0.05069635063409805, + 0.532574649900198, + 0.09948445297777653, + 2.078193813562393, + 2.020058274269104, + 1.5195314697921276, + 2.035772442817688, + 1.0551712960004807, + 0.9701902773231268, + 1.5493120029568672, + 0.9011908546090126, + 2.6647418085485697, + 1.2561332546174526, + 0.4443914294242859, + 0.038023509085178375, + 0.13466997258365154, + 1.2802383229136467, + 0.4067680835723877, + 0.35143312625586987, + 0.36689339205622673, + 0.4885884150862694 + ], + "unique_experts": 63, + "load_cv": 0.6395000065117882, + "normalized_load_entropy": 0.9497702786852418, + "max_load_share": 0.05215419501133787 + } + }, + "s0_period": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "e01f8ade70423b5ad5d467b475fe49ce542efe65e17c8ccbc68bd6ec3a56a444", + "route_weight_sha256": "2f25d83675d7cd7460eed1c8064b43d6703a0375f642e154eb7dea979ecaf57a", + "loads": [ + 8, + 3, + 9, + 4, + 6, + 2, + 30, + 3, + 13, + 0, + 45, + 1, + 4, + 20, + 2, + 5, + 20, + 8, + 5, + 16, + 20, + 9, + 0, + 7, + 2, + 7, + 8, + 9, + 9, + 30, + 3, + 7, + 10, + 0, + 1, + 14, + 2, + 14, + 14, + 17, + 18, + 26, + 14, + 0, + 7, + 3, + 18, + 22, + 9, + 21, + 2, + 14, + 10, + 1, + 32, + 17, + 8, + 0, + 2, + 2, + 2, + 11, + 5, + 5 + ], + "weighted_loads": [ + 0.6225825622677803, + 0.11538246646523476, + 0.42161495611071587, + 0.15512404590845108, + 0.3904699571430683, + 0.07164167985320091, + 2.5610268376767635, + 0.09762189723551273, + 0.7044156771153212, + 0.0, + 2.308526808395982, + 0.03108292631804943, + 0.15044135600328445, + 1.411680718883872, + 0.07376679591834545, + 0.24404048174619675, + 0.9420072101056576, + 0.4445953853428364, + 0.22886894270777702, + 1.4455421529710293, + 1.7419356815516949, + 0.6919277273118496, + 0.0, + 0.26162903010845184, + 0.16487089358270168, + 0.5009557344019413, + 0.4012579619884491, + 0.3696933872997761, + 0.34347199834883213, + 1.6386957075446844, + 0.1659836508333683, + 0.2870956063270569, + 0.7139544151723385, + 0.0, + 0.040992967784404755, + 0.8974604979157448, + 0.07109593600034714, + 0.9018108621239662, + 0.9072880558669567, + 0.966743029654026, + 0.6641177162528038, + 2.0566464215517044, + 0.782485943287611, + 0.0, + 0.4249958097934723, + 0.09361347556114197, + 1.7763610929250717, + 1.9487136527895927, + 1.4307241179049015, + 2.0270753633230925, + 0.0893607996404171, + 0.5297692716121674, + 0.7567713856697083, + 0.06511157751083374, + 2.5705852545797825, + 1.0618812441825867, + 0.39899502508342266, + 0.0, + 0.06814106553792953, + 0.08504065871238708, + 0.11901082471013069, + 0.42550829239189625, + 0.2883383985608816, + 0.29521386697888374 + ], + "unique_experts": 59, + "load_cv": 0.9224294835113128, + "normalized_load_entropy": 0.9033409584921162, + "max_load_share": 0.07075471698113207 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "247c70f209fe91bd5c1c5c82c25bf7721c81076119a6fdbec0641a67f883b609", + "route_weight_sha256": "2ef80574e779905826b2e7888691416efcce67f824cffaf94fc93aca93f198cf", + "loads": [ + 15, + 3, + 9, + 5, + 7, + 14, + 30, + 5, + 13, + 6, + 47, + 4, + 4, + 20, + 2, + 9, + 20, + 8, + 10, + 18, + 20, + 9, + 0, + 17, + 3, + 10, + 15, + 15, + 16, + 30, + 5, + 11, + 10, + 7, + 1, + 14, + 3, + 16, + 16, + 17, + 18, + 26, + 14, + 1, + 9, + 3, + 23, + 26, + 9, + 22, + 7, + 17, + 16, + 8, + 32, + 21, + 9, + 1, + 2, + 14, + 2, + 11, + 5, + 6 + ], + "weighted_loads": [ + 1.3194525353610516, + 0.11538246646523476, + 0.42161495611071587, + 0.19503377750515938, + 0.4382286109030247, + 1.1508364416658878, + 2.5610268376767635, + 0.1723956484347582, + 0.7044156771153212, + 0.4564596898853779, + 2.375196110457182, + 0.2242859397083521, + 0.15044135600328445, + 1.411680718883872, + 0.07376679591834545, + 0.44559259712696075, + 0.9420072101056576, + 0.4445953853428364, + 0.5873065944761038, + 1.601671438664198, + 1.7419356815516949, + 0.6919277273118496, + 0.0, + 0.7047815211117268, + 0.18749533779919147, + 0.7213744260370731, + 0.7933018654584885, + 0.8277984261512756, + 1.370858894661069, + 1.6386957075446844, + 0.33007126674056053, + 0.47927291691303253, + 0.7139544151723385, + 0.5990615971386433, + 0.040992967784404755, + 0.8974604979157448, + 0.1228843592107296, + 1.0043153017759323, + 1.0343434661626816, + 0.966743029654026, + 0.6641177162528038, + 2.0566464215517044, + 0.782485943287611, + 0.04766218736767769, + 0.4895441457629204, + 0.09361347556114197, + 2.0291005056351423, + 2.1549121905118227, + 1.4307241179049015, + 2.0772415939718485, + 0.347491554915905, + 0.9598291851580143, + 1.4737631529569626, + 0.5801172368228436, + 2.5705852545797825, + 1.4421190954744816, + 0.43949185125529766, + 0.038564395159482956, + 0.06814106553792953, + 0.6337137967348099, + 0.11901082471013069, + 0.42550829239189625, + 0.2883383985608816, + 0.38420963659882545 + ], + "unique_experts": 63, + "load_cv": 0.7276419449276745, + "normalized_load_entropy": 0.937736700159821, + "max_load_share": 0.05979643765903308 + } + }, + "s1_period": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "f321ce00a4556d82c859a05ac1cf961e6d9584e2bc9fcf9467501a8bc7461fc0", + "route_weight_sha256": "661c7c54673f5542e402f5082d4c2c893c41ef8f69b6225b6862f4d25af93322", + "loads": [ + 8, + 3, + 10, + 4, + 6, + 2, + 30, + 5, + 13, + 0, + 49, + 2, + 4, + 19, + 4, + 5, + 16, + 8, + 4, + 16, + 20, + 9, + 1, + 8, + 2, + 7, + 7, + 8, + 10, + 31, + 3, + 7, + 10, + 0, + 1, + 16, + 3, + 14, + 14, + 16, + 14, + 26, + 13, + 0, + 7, + 2, + 19, + 21, + 9, + 22, + 2, + 15, + 10, + 1, + 31, + 16, + 8, + 0, + 2, + 2, + 3, + 8, + 5, + 5 + ], + "weighted_loads": [ + 0.6211526170372963, + 0.1152249351143837, + 0.45356386713683605, + 0.1538023054599762, + 0.40503840893507004, + 0.06602463498711586, + 2.633822750300169, + 0.17376579903066158, + 0.7076041288673878, + 0.0, + 2.4896742217242718, + 0.0719001293182373, + 0.14719987474381924, + 1.4061283990740776, + 0.13961118645966053, + 0.25030842423439026, + 0.8193705976009369, + 0.43016486056149006, + 0.16928093135356903, + 1.4636819772422314, + 1.7280444614589214, + 0.6856511160731316, + 0.020067373290657997, + 0.2957517374306917, + 0.16210037842392921, + 0.5015065595507622, + 0.3489467687904835, + 0.33198908530175686, + 0.3531501442193985, + 1.68535166233778, + 0.1754496656358242, + 0.28112760931253433, + 0.7151506170630455, + 0.0, + 0.04141397401690483, + 0.9712785985320807, + 0.10815638676285744, + 0.9091122709214687, + 0.9034614972770214, + 0.949464950710535, + 0.5025730952620506, + 2.0449062939733267, + 0.7494810130447149, + 0.0, + 0.4254952371120453, + 0.06984174251556396, + 1.7574282195419073, + 1.888469010591507, + 1.3772976770997047, + 2.0512575805187225, + 0.09479879215359688, + 0.5585991386324167, + 0.7507623955607414, + 0.06250330805778503, + 2.5323988292366266, + 1.0231628380715847, + 0.39792193099856377, + 0.0, + 0.06225280463695526, + 0.07922879606485367, + 0.1535937264561653, + 0.3236004374921322, + 0.29194567166268826, + 0.29037151858210564 + ], + "unique_experts": 60, + "load_cv": 0.9299460478503597, + "normalized_load_entropy": 0.9064085926719875, + "max_load_share": 0.0770440251572327 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "85dfe0b1c583f48b0490e084b3d8cde7a9ae83ff19a39198c08b8bc36a175b45", + "route_weight_sha256": "72f412196627bd1c9fe838c85953c6e08eb0ea6e6099be2904e0d57fd6e761f9", + "loads": [ + 16, + 4, + 10, + 5, + 10, + 20, + 30, + 8, + 15, + 10, + 49, + 5, + 9, + 19, + 4, + 9, + 16, + 8, + 10, + 21, + 22, + 12, + 1, + 17, + 9, + 12, + 13, + 15, + 22, + 32, + 8, + 10, + 12, + 10, + 2, + 17, + 3, + 18, + 17, + 17, + 14, + 26, + 14, + 1, + 9, + 2, + 25, + 25, + 11, + 24, + 18, + 18, + 18, + 12, + 33, + 19, + 9, + 2, + 3, + 21, + 6, + 9, + 7, + 9 + ], + "weighted_loads": [ + 1.427394326776266, + 0.1670743152499199, + 0.45356386713683605, + 0.1930604763329029, + 0.6623955443501472, + 1.3425793796777725, + 2.633822750300169, + 0.30030827410519123, + 0.8754316531121731, + 0.7717431336641312, + 2.4896742217242718, + 0.28682514280080795, + 0.49582687579095364, + 1.4061283990740776, + 0.13961118645966053, + 0.45141180604696274, + 0.8193705976009369, + 0.43016486056149006, + 0.6476853638887405, + 1.781012276187539, + 1.9573411643505096, + 0.787619661539793, + 0.020067373290657997, + 0.6899204105138779, + 0.4811932072043419, + 0.7657426483929157, + 0.7610010839998722, + 0.6381202060729265, + 1.7696559354662895, + 1.732980377972126, + 0.4340037852525711, + 0.3969808407127857, + 0.7959710024297237, + 1.0835780389606953, + 0.09040739759802818, + 1.0512742456048727, + 0.10815638676285744, + 1.3572390191257, + 1.11327188834548, + 1.006617322564125, + 0.5025730952620506, + 2.0449062939733267, + 0.802093518897891, + 0.05069635063409805, + 0.4888463616371155, + 0.06984174251556396, + 2.075380565598607, + 2.0427329894155264, + 1.506269071251154, + 2.127844415605068, + 1.1058253720402718, + 0.9850837606936693, + 1.5559542924165726, + 0.9002525694668293, + 2.614841191098094, + 1.3424702398478985, + 0.4496326595544815, + 0.08574442937970161, + 0.16909827291965485, + 1.1513754650950432, + 0.4052680805325508, + 0.36304864287376404, + 0.3936674166470766, + 0.487471591681242 + ], + "unique_experts": 64, + "load_cv": 0.6389852082393954, + "normalized_load_entropy": 0.9522139617694072, + "max_load_share": 0.05555555555555555 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 106, + "ordered_topk_exact_tokens": 70, + "set_exact_tokens": 89, + "mean_set_jaccard": 0.9541778975741242, + "mean_token_weighted_tv": 0.01051289562733387, + "aggregate_load_tv": 0.026729559748427674 + }, + "system_bos": { + "tokens": 106, + "ordered_topk_exact_tokens": 53, + "set_exact_tokens": 76, + "mean_set_jaccard": 0.9110512129380055, + "mean_token_weighted_tv": 0.018506487295523566, + "aggregate_load_tv": 0.02987421383647798 + }, + "system_x": { + "tokens": 106, + "ordered_topk_exact_tokens": 58, + "set_exact_tokens": 78, + "mean_set_jaccard": 0.9245283018867925, + "mean_token_weighted_tv": 0.017226483277484494, + "aggregate_load_tv": 0.02672955974842767 + }, + "system_period": { + "tokens": 106, + "ordered_topk_exact_tokens": 56, + "set_exact_tokens": 80, + "mean_set_jaccard": 0.9278975741239892, + "mean_token_weighted_tv": 0.01676435682500871, + "aggregate_load_tv": 0.0330188679245283 + }, + "bos_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 52, + "set_exact_tokens": 71, + "mean_set_jaccard": 0.9036388140161725, + "mean_token_weighted_tv": 0.01997464565771087, + "aggregate_load_tv": 0.036163522012578615 + }, + "bos_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 53, + "set_exact_tokens": 79, + "mean_set_jaccard": 0.925202156334232, + "mean_token_weighted_tv": 0.018186417364357214, + "aggregate_load_tv": 0.0330188679245283 + }, + "x_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 53, + "set_exact_tokens": 73, + "mean_set_jaccard": 0.9110512129380054, + "mean_token_weighted_tv": 0.019681217886929243, + "aggregate_load_tv": 0.031446540880503145 + }, + "x_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 47, + "set_exact_tokens": 74, + "mean_set_jaccard": 0.9097035040431267, + "mean_token_weighted_tv": 0.02207232878174422, + "aggregate_load_tv": 0.03301886792452831 + }, + "period_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 48, + "set_exact_tokens": 66, + "mean_set_jaccard": 0.8921832884097036, + "mean_token_weighted_tv": 0.02138628168383016, + "aggregate_load_tv": 0.04088050314465409 + }, + "period_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 47, + "set_exact_tokens": 74, + "mean_set_jaccard": 0.9097035040431267, + "mean_token_weighted_tv": 0.02192080054291577, + "aggregate_load_tv": 0.037735849056603765 + } + } + }, + "layer_15": { + "layer": 15, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "424b83222963288c7b51db288e19e31d950be855d7135e911e1aa39b69bcd559", + "route_weight_sha256": "5ab55488e4cb84d34aec2630974058a3fb4c347f6a2794aa2a8331ad5cdd3736", + "loads": [ + 6, + 8, + 24, + 11, + 1, + 1, + 0, + 6, + 1, + 0, + 18, + 14, + 18, + 9, + 5, + 0, + 1, + 9, + 0, + 6, + 3, + 26, + 0, + 5, + 6, + 22, + 3, + 27, + 3, + 5, + 11, + 11, + 0, + 4, + 1, + 3, + 7, + 19, + 0, + 9, + 21, + 7, + 14, + 14, + 4, + 8, + 17, + 24, + 6, + 2, + 4, + 64, + 13, + 16, + 4, + 13, + 21, + 3, + 9, + 17, + 30, + 4, + 13, + 5 + ], + "weighted_loads": [ + 0.20583334751427174, + 0.5175073351711035, + 2.0950902309268713, + 0.4969756118953228, + 0.044354259967803955, + 0.04172603413462639, + 0.0, + 0.25775187835097313, + 0.041745174676179886, + 0.0, + 1.9223980531096458, + 1.6828082781285048, + 0.9534522630274296, + 0.4274421092122793, + 0.1627441793680191, + 0.0, + 0.03988068550825119, + 0.30901380628347397, + 0.0, + 0.3514700196683407, + 0.10549894906580448, + 1.3719036914408207, + 0.0, + 0.22048850916326046, + 0.21087726578116417, + 1.8610960152000189, + 0.07483047619462013, + 2.0573028437793255, + 0.09874187037348747, + 0.2090410739183426, + 0.6583085544407368, + 0.5623814705759287, + 0.0, + 0.22414297610521317, + 0.051840148866176605, + 0.08722850680351257, + 0.3333963956683874, + 1.3448778241872787, + 0.0, + 0.3854710813611746, + 1.3706287033855915, + 0.25312837958335876, + 0.8221541345119476, + 1.1899082623422146, + 0.16487673670053482, + 0.37965687923133373, + 1.5651527680456638, + 2.0206036996096373, + 0.22131763398647308, + 0.22445397824048996, + 0.16871466860175133, + 4.062083929777145, + 1.728655593469739, + 0.9210643619298935, + 0.1475727390497923, + 0.4798679109662771, + 1.0319727268069983, + 0.21072491258382797, + 0.6778816618025303, + 0.7405165396630764, + 1.7895771488547325, + 0.3189484588801861, + 0.8430008720606565, + 0.1969042718410492 + ], + "unique_experts": 57, + "load_cv": 1.0421100871808326, + "normalized_load_entropy": 0.889716802178046, + "max_load_share": 0.10062893081761007 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "670b7c6f40e86afe1d6f50fb46b2e688f4f46b46db98f10c4e2dc945afc04260", + "route_weight_sha256": "23e1c2f0f1546c6223f2c7060beba5ea344534d6709b7f5d63c70df2e8564103", + "loads": [ + 8, + 8, + 24, + 12, + 6, + 4, + 7, + 7, + 7, + 1, + 22, + 15, + 24, + 9, + 15, + 1, + 8, + 11, + 0, + 8, + 3, + 26, + 0, + 10, + 11, + 23, + 13, + 27, + 6, + 5, + 15, + 11, + 5, + 6, + 1, + 3, + 12, + 19, + 0, + 9, + 28, + 9, + 14, + 16, + 4, + 8, + 17, + 25, + 7, + 10, + 7, + 66, + 20, + 16, + 5, + 18, + 21, + 3, + 10, + 18, + 30, + 8, + 13, + 11 + ], + "weighted_loads": [ + 0.3700896967202425, + 0.5175073351711035, + 2.0950902309268713, + 0.5489051081240177, + 0.4138655476272106, + 0.11419024504721165, + 0.6066682673990726, + 0.29089248552918434, + 0.39816592261195183, + 0.0314757265150547, + 2.0708591863512993, + 1.7129141874611378, + 1.382351890206337, + 0.4274421092122793, + 0.5417059576138854, + 0.031402166932821274, + 0.649676937609911, + 0.37491615675389767, + 0.0, + 0.4736870378255844, + 0.10549894906580448, + 1.3719036914408207, + 0.0, + 0.4926790688186884, + 0.3294020656030625, + 1.8894580397754908, + 0.7298884280025959, + 2.0573028437793255, + 0.21170932799577713, + 0.2090410739183426, + 0.8330956399440765, + 0.5623814705759287, + 0.4048077315092087, + 0.3150714486837387, + 0.051840148866176605, + 0.08722850680351257, + 1.1177375679835677, + 1.3448778241872787, + 0.0, + 0.3854710813611746, + 2.046304071554914, + 0.2988581024110317, + 0.8221541345119476, + 1.2725028060376644, + 0.16487673670053482, + 0.37965687923133373, + 1.5651527680456638, + 2.054982179775834, + 0.23481694143265486, + 1.42238125577569, + 0.3524727299809456, + 4.148444887250662, + 2.0005039582028985, + 0.9210643619298935, + 0.16715843603014946, + 2.199159422889352, + 1.0319727268069983, + 0.21072491258382797, + 0.7231812998652458, + 0.8278636373579502, + 1.7895771488547325, + 0.5515390858054161, + 0.8430008720606565, + 0.4611115790903568 + ], + "unique_experts": 61, + "load_cv": 0.8288098583667273, + "normalized_load_entropy": 0.9289003772260528, + "max_load_share": 0.08396946564885496 + } + }, + "s1_eos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "72ec0bb630e6da344e5ded8a007a0fcd4102480ec89f64712ebadcbe8a29ab61", + "route_weight_sha256": "295f82df45540cdd1363b057fdf4fe6cccae328e2fb2eff07b812eda9cf6cdfb", + "loads": [ + 4, + 9, + 24, + 12, + 1, + 2, + 0, + 7, + 1, + 0, + 18, + 14, + 17, + 9, + 4, + 0, + 1, + 7, + 0, + 6, + 2, + 27, + 0, + 4, + 6, + 22, + 4, + 27, + 3, + 5, + 11, + 9, + 0, + 5, + 1, + 2, + 7, + 19, + 1, + 9, + 20, + 8, + 15, + 14, + 4, + 7, + 18, + 23, + 5, + 2, + 4, + 63, + 13, + 17, + 4, + 15, + 21, + 3, + 8, + 17, + 34, + 3, + 13, + 5 + ], + "weighted_loads": [ + 0.1356627456843853, + 0.5568171106278896, + 2.0755981765687466, + 0.5387258902192116, + 0.045574434101581573, + 0.08065778762102127, + 0.0, + 0.2898516561836004, + 0.042641788721084595, + 0.0, + 1.9121454693377018, + 1.66029816493392, + 0.9132169429212809, + 0.4281308688223362, + 0.12821718491613865, + 0.0, + 0.041615914553403854, + 0.2536168247461319, + 0.0, + 0.3677012138068676, + 0.06755845434963703, + 1.410908592864871, + 0.0, + 0.20172050595283508, + 0.2119024097919464, + 1.8609704189002514, + 0.10880886949598789, + 2.05342785269022, + 0.09882099740207195, + 0.20807962492108345, + 0.6417837329208851, + 0.5125057119876146, + 0.0, + 0.26038144156336784, + 0.05280254781246185, + 0.05971905589103699, + 0.33284551464021206, + 1.3333803601562977, + 0.03396497666835785, + 0.3810142744332552, + 1.3477166555821896, + 0.2866818979382515, + 0.8446848317980766, + 1.1942829266190529, + 0.16055520623922348, + 0.35700323805212975, + 1.5941394492983818, + 1.9667567424476147, + 0.19262906722724438, + 0.21954823285341263, + 0.1662953943014145, + 4.095923230051994, + 1.725755736231804, + 0.9282648712396622, + 0.14660529233515263, + 0.5359976068139076, + 1.0400699973106384, + 0.2071419544517994, + 0.6510505080223083, + 0.7349285911768675, + 1.8931402042508125, + 0.26969362050294876, + 0.8370129391551018, + 0.18708983063697815 + ], + "unique_experts": 58, + "load_cv": 1.0519326216149516, + "normalized_load_entropy": 0.8880999968824761, + "max_load_share": 0.09905660377358491 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "9669e00b777ca1e8b433c47756adf36369d3eea88afd25b2265e6a634fdb0fc3", + "route_weight_sha256": "0727b5460c7f48c64cde4ee6cb3930541bc393c1d0b7ff4d357de25dd7f7b70a", + "loads": [ + 23, + 10, + 24, + 13, + 8, + 7, + 13, + 7, + 11, + 2, + 23, + 19, + 24, + 10, + 10, + 10, + 13, + 12, + 1, + 10, + 3, + 28, + 0, + 10, + 9, + 23, + 14, + 29, + 9, + 6, + 17, + 13, + 5, + 7, + 3, + 2, + 13, + 19, + 3, + 10, + 27, + 10, + 15, + 16, + 4, + 8, + 18, + 25, + 8, + 14, + 9, + 65, + 16, + 18, + 5, + 20, + 21, + 9, + 10, + 22, + 34, + 10, + 15, + 10 + ], + "weighted_loads": [ + 1.4176755547523499, + 0.5834819190204144, + 2.0755981765687466, + 0.5920955128967762, + 0.5066227540373802, + 0.2849900647997856, + 1.108738237991929, + 0.2898516561836004, + 0.5473484955728054, + 0.06318290159106255, + 2.1534663029015064, + 2.0354099087417126, + 1.4518794175237417, + 0.5087223164737225, + 0.3300168439745903, + 0.6605832846835256, + 1.1269064582884312, + 0.4448345359414816, + 0.049402523785829544, + 0.6363469157367945, + 0.09649740904569626, + 1.4921812321990728, + 0.0, + 0.4790999982506037, + 0.2789020976051688, + 1.8894332461059093, + 0.8066808637231588, + 2.1787969432771206, + 0.5178000833839178, + 0.24560922384262085, + 0.8677703384310007, + 0.9702724125236273, + 0.3970720171928406, + 0.3757525198161602, + 0.2007896900177002, + 0.05971905589103699, + 1.0996883949264884, + 1.3333803601562977, + 0.09950781986117363, + 0.41678321920335293, + 1.9855419681407511, + 0.3751657479442656, + 0.8446848317980766, + 1.4702377431094646, + 0.16055520623922348, + 0.39481423795223236, + 1.5941394492983818, + 2.0378158763051033, + 0.33530568052083254, + 2.168760523200035, + 0.4093885254114866, + 4.164828345179558, + 1.862024019472301, + 1.0761627703905106, + 0.16893625259399414, + 2.240298818796873, + 1.0400699973106384, + 0.8702718429267406, + 0.735729593783617, + 0.9902561251074076, + 1.8931402042508125, + 0.7213858775794506, + 0.9524062760174274, + 0.3947167955338955 + ], + "unique_experts": 63, + "load_cv": 0.7195286828862792, + "normalized_load_entropy": 0.9460975671975499, + "max_load_share": 0.07369614512471655 + } + }, + "s0_bos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "dc452b7a4639e7eed548473043c094f53c16b21adda1ddf5ea6edbd2d0f30f69", + "route_weight_sha256": "3808886d2e9a60d27fcd53e3f6cd9d87bc1bb6b11debf135699d7702f8d0b06c", + "loads": [ + 6, + 10, + 25, + 11, + 1, + 1, + 0, + 6, + 1, + 0, + 18, + 15, + 17, + 9, + 6, + 0, + 1, + 6, + 0, + 7, + 3, + 26, + 0, + 5, + 6, + 20, + 4, + 26, + 2, + 6, + 11, + 12, + 0, + 4, + 1, + 4, + 8, + 19, + 0, + 7, + 19, + 6, + 14, + 15, + 5, + 7, + 17, + 23, + 7, + 2, + 4, + 64, + 13, + 17, + 7, + 12, + 20, + 3, + 8, + 16, + 33, + 3, + 13, + 4 + ], + "weighted_loads": [ + 0.20668132789433002, + 0.5727169662714005, + 2.1359560191631317, + 0.4771820902824402, + 0.04473692923784256, + 0.042050234973430634, + 0.0, + 0.2541708145290613, + 0.038261692970991135, + 0.0, + 1.9385241884738207, + 1.6793287079781294, + 0.9351939670741558, + 0.4327572900801897, + 0.20190020091831684, + 0.0, + 0.04359683766961098, + 0.23338951915502548, + 0.0, + 0.4025360494852066, + 0.09253297187387943, + 1.38562436029315, + 0.0, + 0.23472514376044273, + 0.2132388073951006, + 1.8208758998662233, + 0.1085217110812664, + 2.047155387699604, + 0.06824014522135258, + 0.2522467039525509, + 0.6462270319461823, + 0.5898805186152458, + 0.0, + 0.24279597960412502, + 0.0554722435772419, + 0.11919091269373894, + 0.374127771705389, + 1.3761136643588543, + 0.0, + 0.3211321420967579, + 1.2729458063840866, + 0.22515979781746864, + 0.8360430933535099, + 1.2475790791213512, + 0.19516582414507866, + 0.3656788803637028, + 1.5906898602843285, + 1.9795992150902748, + 0.24084347300231457, + 0.2225484475493431, + 0.16378651559352875, + 4.1926977299153805, + 1.7533041015267372, + 0.9601559340953827, + 0.25340734235942364, + 0.41836800798773766, + 1.0051250327378511, + 0.2092217355966568, + 0.6386917717754841, + 0.6923187226057053, + 1.8889862578362226, + 0.2759944275021553, + 0.859512023627758, + 0.16885602101683617 + ], + "unique_experts": 57, + "load_cv": 1.0395258052432481, + "normalized_load_entropy": 0.8907818717278153, + "max_load_share": 0.10062893081761007 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "9780f24b1ad0756c46bedce53e66c8a467a14327449869a08876a72cb869ea5c", + "route_weight_sha256": "60a110c49e8816e5d97e3b4d827427eca0406009f16072b36054969680b11e74", + "loads": [ + 9, + 10, + 25, + 12, + 5, + 4, + 7, + 7, + 5, + 1, + 22, + 17, + 23, + 9, + 15, + 1, + 8, + 8, + 0, + 9, + 3, + 26, + 0, + 10, + 10, + 21, + 14, + 26, + 5, + 6, + 15, + 12, + 5, + 6, + 1, + 5, + 13, + 19, + 1, + 7, + 27, + 6, + 14, + 17, + 5, + 7, + 17, + 24, + 8, + 10, + 9, + 67, + 20, + 17, + 9, + 15, + 20, + 3, + 9, + 17, + 33, + 7, + 13, + 10 + ], + "weighted_loads": [ + 0.4458512980490923, + 0.5727169662714005, + 2.1359560191631317, + 0.5324078500270844, + 0.34810128435492516, + 0.15163864381611347, + 0.5478357672691345, + 0.28731142170727253, + 0.3289880268275738, + 0.0314757265150547, + 2.086985321715474, + 1.7505389228463173, + 1.3691722601652145, + 0.4327572900801897, + 0.5707638934254646, + 0.031402166932821274, + 0.65636882558465, + 0.29806855879724026, + 0.0, + 0.5247530676424503, + 0.09253297187387943, + 1.38562436029315, + 0.0, + 0.5069157034158707, + 0.32805320248007774, + 1.8492379244416952, + 0.7635796628892422, + 2.047155387699604, + 0.18120760284364223, + 0.2522467039525509, + 0.821014117449522, + 0.5898805186152458, + 0.4048077315092087, + 0.33372445218265057, + 0.0554722435772419, + 0.2056046463549137, + 1.2081927778199315, + 1.3761136643588543, + 0.022597679868340492, + 0.3211321420967579, + 2.057515200227499, + 0.22515979781746864, + 0.8360430933535099, + 1.330173622816801, + 0.19516582414507866, + 0.3656788803637028, + 1.5906898602843285, + 2.0139776952564716, + 0.25434278044849634, + 1.3947447054088116, + 0.4745985195040703, + 4.3288213685154915, + 2.020808137021959, + 0.9601559340953827, + 0.3537127207964659, + 1.119377963244915, + 1.0051250327378511, + 0.2092217355966568, + 0.6839914098381996, + 0.7816439047455788, + 1.8889862578362226, + 0.5255981124937534, + 0.859512023627758, + 0.45377228409051895 + ], + "unique_experts": 62, + "load_cv": 0.8318042417089893, + "normalized_load_entropy": 0.9302193063210946, + "max_load_share": 0.08524173027989822 + } + }, + "s1_bos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "49c32526ac0a32a419c01ca45912277dd5ae5128130b85d6815d821f27ea31e8", + "route_weight_sha256": "83746def478a6ba02377ea85673be52c4843b7773c3833b6cfdc3245eb974bd9", + "loads": [ + 5, + 10, + 26, + 10, + 1, + 2, + 0, + 7, + 1, + 0, + 20, + 15, + 18, + 9, + 5, + 0, + 1, + 7, + 0, + 7, + 3, + 27, + 0, + 5, + 6, + 21, + 3, + 27, + 3, + 5, + 11, + 10, + 0, + 5, + 1, + 3, + 7, + 19, + 0, + 10, + 20, + 6, + 14, + 14, + 3, + 7, + 18, + 24, + 6, + 2, + 4, + 63, + 13, + 17, + 5, + 11, + 21, + 3, + 8, + 15, + 32, + 3, + 13, + 4 + ], + "weighted_loads": [ + 0.17702149040997028, + 0.5707817859947681, + 2.1459739096462727, + 0.4435130823403597, + 0.04420823976397514, + 0.07345571368932724, + 0.0, + 0.29611783288419247, + 0.04297321289777756, + 0.0, + 1.9849928598850965, + 1.638385958969593, + 0.9498325493186712, + 0.4318397827446461, + 0.16083567403256893, + 0.0, + 0.04598783701658249, + 0.27228933572769165, + 0.0, + 0.3836551196873188, + 0.0930198710411787, + 1.417515143752098, + 0.0, + 0.25295093283057213, + 0.21137304045259953, + 1.847696317359805, + 0.08168204873800278, + 2.0681964084506035, + 0.09770670160651207, + 0.2055191658437252, + 0.6377260386943817, + 0.5483139809221029, + 0.0, + 0.29873284325003624, + 0.05618590489029884, + 0.09205278381705284, + 0.3443320691585541, + 1.3129216935485601, + 0.0, + 0.4066731669008732, + 1.3226014785468578, + 0.21602188050746918, + 0.8525791838765144, + 1.2037367597222328, + 0.12223716452717781, + 0.36173879727721214, + 1.6061764415353537, + 1.9984895549714565, + 0.21336754225194454, + 0.2070767730474472, + 0.1618364118039608, + 4.169225322082639, + 1.6940669901669025, + 0.9492861609905958, + 0.1884397640824318, + 0.3984989635646343, + 1.0373003911226988, + 0.19995930790901184, + 0.6489729434251785, + 0.645613107830286, + 1.862157603725791, + 0.25858353078365326, + 0.8456829972565174, + 0.16762082278728485 + ], + "unique_experts": 57, + "load_cv": 1.0478636717596275, + "normalized_load_entropy": 0.8884890944682778, + "max_load_share": 0.09905660377358491 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "b7c80df72e1fc81f5aaa202f4026d9f2382583b767ee39cb61c188f7a029f2f7", + "route_weight_sha256": "9d3ee254b99a4cc206912ccdfc14f15e4c927e4e290479b8b2b110b7539953dc", + "loads": [ + 25, + 11, + 26, + 11, + 8, + 7, + 13, + 7, + 10, + 2, + 25, + 20, + 25, + 10, + 10, + 10, + 13, + 12, + 1, + 11, + 4, + 28, + 0, + 11, + 9, + 22, + 13, + 29, + 9, + 6, + 17, + 14, + 5, + 7, + 3, + 3, + 14, + 19, + 2, + 11, + 27, + 7, + 14, + 16, + 3, + 8, + 18, + 26, + 9, + 15, + 11, + 65, + 16, + 18, + 5, + 15, + 21, + 9, + 10, + 20, + 32, + 10, + 15, + 9 + ], + "weighted_loads": [ + 1.5104344841092825, + 0.5974465943872929, + 2.1459739096462727, + 0.4978348184376955, + 0.431004099547863, + 0.3163528647273779, + 1.03215860016644, + 0.29611783288419247, + 0.4988310392946005, + 0.06455855071544647, + 2.226313693448901, + 2.017701618373394, + 1.4964272174984217, + 0.5124312303960323, + 0.3510512076318264, + 0.6605832846835256, + 1.1473883911967278, + 0.46167369931936264, + 0.049402523785829544, + 0.6523008216172457, + 0.12195882573723793, + 1.4987877830863, + 0.0, + 0.5303304251283407, + 0.3265975210815668, + 1.876159144565463, + 0.7795540429651737, + 2.193565499037504, + 0.5166857875883579, + 0.2430487647652626, + 0.8637126442044973, + 1.0060806814581156, + 0.3970720171928406, + 0.4141039215028286, + 0.20417304709553719, + 0.09205278381705284, + 1.183739979751408, + 1.3129216935485601, + 0.06554284319281578, + 0.4424421116709709, + 2.093723764643073, + 0.3002987876534462, + 0.8525791838765144, + 1.4796915762126446, + 0.12223716452717781, + 0.39954979717731476, + 1.6061764415353537, + 2.0779820941388607, + 0.3560441555455327, + 2.2060410045087337, + 0.48304956033825874, + 4.238130437210202, + 1.8283413415774703, + 1.0971840601414442, + 0.1884397640824318, + 1.1831678412854671, + 1.0373003911226988, + 0.8630891963839531, + 0.7336520291864872, + 0.9088276475667953, + 1.862157603725791, + 0.7273107208311558, + 0.9610763341188431, + 0.40780577063560486 + ], + "unique_experts": 63, + "load_cv": 0.7208994461334842, + "normalized_load_entropy": 0.9458681754196466, + "max_load_share": 0.07369614512471655 + } + }, + "s0_x": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "7d54e7410f6d379db070f2ad85cb21c24e4e53bccbf30c2ad387bd9fc1b69034", + "route_weight_sha256": "977c8b5414fb2270921734777302c7ae8e6707f5e296e7312bf6d223c2c63481", + "loads": [ + 6, + 9, + 24, + 12, + 1, + 2, + 0, + 7, + 1, + 0, + 18, + 15, + 17, + 9, + 5, + 0, + 1, + 7, + 0, + 7, + 2, + 26, + 0, + 4, + 6, + 21, + 4, + 27, + 2, + 5, + 13, + 11, + 0, + 4, + 1, + 2, + 7, + 19, + 0, + 8, + 21, + 6, + 14, + 15, + 4, + 7, + 17, + 23, + 7, + 2, + 5, + 63, + 13, + 16, + 4, + 12, + 20, + 3, + 8, + 20, + 33, + 3, + 13, + 4 + ], + "weighted_loads": [ + 0.20267621986567974, + 0.5488270483911037, + 2.102989323437214, + 0.5572519078850746, + 0.0429464690387249, + 0.08005166798830032, + 0.0, + 0.25665662437677383, + 0.04269930720329285, + 0.0, + 1.9383813384920359, + 1.662230096757412, + 0.9392974525690079, + 0.4293802920728922, + 0.15947705321013927, + 0.0, + 0.04182729497551918, + 0.262332309037447, + 0.0, + 0.40614197589457035, + 0.07164353877305984, + 1.384369032457471, + 0.0, + 0.2095038890838623, + 0.20957389287650585, + 1.8220030143857002, + 0.1111142635345459, + 2.0811494551599026, + 0.06532532162964344, + 0.2156892940402031, + 0.7052676565945148, + 0.5785281136631966, + 0.0, + 0.24773097783327103, + 0.05115044116973877, + 0.06262815929949284, + 0.3411779385060072, + 1.361852090805769, + 0.0, + 0.3553414735943079, + 1.3318550828844309, + 0.21687530353665352, + 0.843903087079525, + 1.2355413250625134, + 0.15672770887613297, + 0.36688505858182907, + 1.5659033954143524, + 1.9602870531380177, + 0.24406485632061958, + 0.2133624628186226, + 0.1898440197110176, + 4.20397262275219, + 1.716051910072565, + 0.9354500584304333, + 0.14575039222836494, + 0.42719609662890434, + 0.9909367263317108, + 0.2016519121825695, + 0.6391075849533081, + 0.8285437785089016, + 1.887658428400755, + 0.2719647288322449, + 0.8653687927871943, + 0.16107282415032387 + ], + "unique_experts": 57, + "load_cv": 1.0460501691838242, + "normalized_load_entropy": 0.8879540805735953, + "max_load_share": 0.09905660377358491 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "7651d5ec266f332ec31b94b1b187b264aad5aa75b0118b59a687369f59214cdf", + "route_weight_sha256": "3384adca13bf87620a0598f2b59efcb55105983a63240ff32bb9ebf2a98bfddf", + "loads": [ + 8, + 9, + 24, + 13, + 6, + 3, + 7, + 8, + 8, + 1, + 23, + 16, + 23, + 9, + 14, + 1, + 8, + 8, + 0, + 10, + 2, + 26, + 0, + 10, + 10, + 22, + 15, + 27, + 5, + 5, + 17, + 11, + 5, + 6, + 1, + 2, + 12, + 19, + 0, + 8, + 28, + 7, + 14, + 18, + 4, + 7, + 17, + 24, + 8, + 10, + 9, + 65, + 21, + 16, + 4, + 16, + 20, + 3, + 9, + 21, + 33, + 8, + 13, + 9 + ], + "weighted_loads": [ + 0.32688931562006474, + 0.5488270483911037, + 2.102989323437214, + 0.6022280640900135, + 0.40020984038710594, + 0.09878687374293804, + 0.5976619385182858, + 0.28979723155498505, + 0.42913768999278545, + 0.0314757265150547, + 2.155570575967431, + 1.692336006090045, + 1.3674023486673832, + 0.4293802920728922, + 0.5283407457172871, + 0.031402166932821274, + 0.6687015406787395, + 0.2982248477637768, + 0.0, + 0.5772529114037752, + 0.07164353877305984, + 1.384369032457471, + 0.0, + 0.5774245522916317, + 0.324388287961483, + 1.850365038961172, + 0.8816364780068398, + 2.0811494551599026, + 0.1782927792519331, + 0.2156892940402031, + 0.8800547420978546, + 0.5785281136631966, + 0.4048077315092087, + 0.33865945041179657, + 0.05115044116973877, + 0.06262815929949284, + 1.11977185215801, + 1.361852090805769, + 0.0, + 0.3553414735943079, + 2.036870727315545, + 0.2645096741616726, + 0.843903087079525, + 1.3982345722615719, + 0.15672770887613297, + 0.36688505858182907, + 1.5659033954143524, + 1.9946655333042145, + 0.25756416376680136, + 1.395543422549963, + 0.39890911243855953, + 4.290333580225706, + 2.0285567631945014, + 0.9354500584304333, + 0.14575039222836494, + 1.1671191230416298, + 0.9909367263317108, + 0.2016519121825695, + 0.6844072230160236, + 0.9164335243403912, + 1.887658428400755, + 0.571920920163393, + 0.8653687927871943, + 0.4007049538195133 + ], + "unique_experts": 61, + "load_cv": 0.8361518290302036, + "normalized_load_entropy": 0.9263515337962899, + "max_load_share": 0.08269720101781171 + } + }, + "s1_x": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "d038d19f21354147a1a7aeb96869ac1b95c7eed309a528972a0132856eaeb43e", + "route_weight_sha256": "f3b369eb466ba6925e72e84e56796c1b75e2c83f9895b39f35047925c641d755", + "loads": [ + 5, + 10, + 24, + 12, + 2, + 2, + 0, + 6, + 2, + 0, + 19, + 15, + 17, + 9, + 5, + 0, + 1, + 7, + 0, + 7, + 4, + 28, + 0, + 4, + 6, + 21, + 3, + 27, + 3, + 5, + 13, + 9, + 1, + 4, + 1, + 4, + 7, + 18, + 0, + 6, + 19, + 7, + 14, + 15, + 5, + 8, + 16, + 21, + 6, + 2, + 5, + 63, + 12, + 17, + 6, + 9, + 20, + 3, + 9, + 20, + 32, + 3, + 13, + 4 + ], + "weighted_loads": [ + 0.17724968865513802, + 0.5661971662193537, + 2.0350438095629215, + 0.5211943760514259, + 0.07936358451843262, + 0.076059116050601, + 0.0, + 0.23451285436749458, + 0.07663360983133316, + 0.0, + 1.9577376395463943, + 1.6498257350176573, + 0.9206475540995598, + 0.41888084076344967, + 0.17045054957270622, + 0.0, + 0.04494772106409073, + 0.2557161580771208, + 0.0, + 0.3989354334771633, + 0.13361983560025692, + 1.4609954729676247, + 0.0, + 0.21483993902802467, + 0.2068526539951563, + 1.815686147660017, + 0.07150125317275524, + 2.0556286722421646, + 0.0958099253475666, + 0.2072681561112404, + 0.6792301647365093, + 0.5210002493113279, + 0.032671406865119934, + 0.25245560705661774, + 0.05446905270218849, + 0.1204344816505909, + 0.341568049043417, + 1.2821508683264256, + 0.0, + 0.28738902881741524, + 1.274907534942031, + 0.246531181037426, + 0.8378287106752396, + 1.2274769581854343, + 0.17380594089627266, + 0.39149939827620983, + 1.5520758554339409, + 1.8886025995016098, + 0.21890859492123127, + 0.20519708842039108, + 0.18788999505341053, + 4.210471892729402, + 1.738251730799675, + 0.9279059693217278, + 0.21727766655385494, + 0.35420150123536587, + 0.9939493201673031, + 0.19650092348456383, + 0.6903057843446732, + 0.8402974270284176, + 1.8689327854663134, + 0.2694546617567539, + 0.8441927265375853, + 0.15889006666839123 + ], + "unique_experts": 58, + "load_cv": 1.0311205191148503, + "normalized_load_entropy": 0.8939388025703796, + "max_load_share": 0.09905660377358491 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "f73a0b145ef47520d81441f0872048b4dc220ba0997420c3ded18f5cd5dc88dd", + "route_weight_sha256": "3d56d758ffdd56105778e7a30bca1bc6015e2284c98403c129105737af35304a", + "loads": [ + 25, + 11, + 24, + 13, + 8, + 5, + 13, + 6, + 14, + 1, + 25, + 19, + 24, + 10, + 10, + 10, + 13, + 12, + 1, + 12, + 5, + 29, + 0, + 11, + 8, + 22, + 14, + 29, + 9, + 6, + 19, + 13, + 7, + 6, + 3, + 4, + 13, + 18, + 3, + 7, + 24, + 8, + 14, + 18, + 5, + 9, + 16, + 22, + 9, + 14, + 11, + 66, + 15, + 18, + 6, + 13, + 20, + 9, + 11, + 25, + 32, + 11, + 15, + 9 + ], + "weighted_loads": [ + 1.470181044191122, + 0.5928619746118784, + 2.0350438095629215, + 0.5664053596556187, + 0.4213220998644829, + 0.22641241922974586, + 1.1172372493892908, + 0.23451285436749458, + 0.6821094732731581, + 0.0310196690261364, + 2.2507448494434357, + 1.983114479109645, + 1.4599882736802101, + 0.49947228841483593, + 0.3606660831719637, + 0.6605832846835256, + 1.1521364077925682, + 0.45513431169092655, + 0.049402523785829544, + 0.7195383701473475, + 0.16255879029631615, + 1.5422681123018265, + 0.0, + 0.5704965498298407, + 0.27019123546779156, + 1.844148974865675, + 0.8907073382288218, + 2.1809977628290653, + 0.5147890113294125, + 0.2447977550327778, + 0.905216770246625, + 0.9787669498473406, + 0.47165919467806816, + 0.3678266853094101, + 0.20245619490742683, + 0.1204344816505909, + 1.0183529304340482, + 1.2821508683264256, + 0.10596279427409172, + 0.32315797358751297, + 1.939017929136753, + 0.330808088183403, + 0.8378287106752396, + 1.630305863916874, + 0.17380594089627266, + 0.42931039817631245, + 1.5520758554339409, + 1.9226894453167915, + 0.36158520821481943, + 2.048789646476507, + 0.4208276979625225, + 4.3153579365462065, + 1.8692221296951175, + 1.0758038684725761, + 0.21727766655385494, + 1.0899540092796087, + 0.9939493201673031, + 0.8596308119595051, + 0.7749848701059818, + 1.1022641733288765, + 1.8689327854663134, + 0.7681746408343315, + 0.9595860633999109, + 0.3550443761050701 + ], + "unique_experts": 63, + "load_cv": 0.715285626293863, + "normalized_load_entropy": 0.9475343532443304, + "max_load_share": 0.07482993197278912 + } + }, + "s0_period": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "8f7864245c62ba63ffcbdf52cedcd0781f585715f6ad7924c1e0de44d724ff2b", + "route_weight_sha256": "69746f7ec9c5515a793e082950209c9875927eadbef8e9c6987248d6b6c3ae95", + "loads": [ + 6, + 9, + 23, + 12, + 1, + 2, + 0, + 6, + 1, + 0, + 19, + 14, + 16, + 10, + 5, + 0, + 1, + 7, + 0, + 7, + 4, + 27, + 0, + 4, + 5, + 21, + 4, + 27, + 2, + 5, + 12, + 11, + 0, + 4, + 1, + 3, + 7, + 18, + 0, + 8, + 22, + 6, + 15, + 15, + 3, + 7, + 17, + 25, + 8, + 2, + 3, + 64, + 13, + 16, + 6, + 10, + 21, + 4, + 8, + 18, + 31, + 3, + 13, + 4 + ], + "weighted_loads": [ + 0.2016410455107689, + 0.5422401279211044, + 2.0334247052669525, + 0.5606487318873405, + 0.0407368503510952, + 0.08219433203339577, + 0.0, + 0.23856152780354023, + 0.043096669018268585, + 0.0, + 1.9579484481364489, + 1.6412913482636213, + 0.8869331665337086, + 0.45369913056492805, + 0.16519618220627308, + 0.0, + 0.04164738208055496, + 0.26487397588789463, + 0.0, + 0.40670359693467617, + 0.13312488049268723, + 1.4029638022184372, + 0.0, + 0.2200133576989174, + 0.17271697893738747, + 1.8321329969912767, + 0.1067811381071806, + 2.0651029236614704, + 0.06844530440866947, + 0.22340680286288261, + 0.6723337285220623, + 0.5850498601794243, + 0.0, + 0.25018370524048805, + 0.05488060414791107, + 0.08954251185059547, + 0.3368640523403883, + 1.3033412620425224, + 0.0, + 0.34808989986777306, + 1.3489135727286339, + 0.22086501121520996, + 0.8719465360045433, + 1.2269911151379347, + 0.12396817654371262, + 0.35869235172867775, + 1.56127367913723, + 2.0346787106245756, + 0.27370867505669594, + 0.21712646633386612, + 0.11725940555334091, + 4.278543220832944, + 1.76622224599123, + 0.9148697964847088, + 0.220047265291214, + 0.38292445056140423, + 1.0277801807969809, + 0.23538155853748322, + 0.6444892138242722, + 0.7554211858659983, + 1.791456576436758, + 0.26962966471910477, + 0.8512920662760735, + 0.16521622985601425 + ], + "unique_experts": 57, + "load_cv": 1.0489201003147333, + "normalized_load_entropy": 0.8887149468460046, + "max_load_share": 0.10062893081761007 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "0a9b105097a72a41c7c3decc57cc6fd8930e35bb8fa92de51072af6e0acf9ae8", + "route_weight_sha256": "2cbc63fdd46a86dc7e79c6a7ad5554da089e65dd2f3d105ebd7b221df9c3e665", + "loads": [ + 8, + 9, + 23, + 13, + 6, + 3, + 8, + 7, + 7, + 1, + 23, + 16, + 22, + 10, + 14, + 1, + 8, + 9, + 0, + 9, + 4, + 27, + 0, + 10, + 9, + 22, + 15, + 27, + 5, + 5, + 16, + 11, + 5, + 6, + 1, + 3, + 13, + 18, + 0, + 8, + 29, + 7, + 15, + 17, + 3, + 7, + 17, + 26, + 9, + 10, + 7, + 66, + 20, + 16, + 6, + 14, + 21, + 4, + 10, + 19, + 31, + 8, + 13, + 9 + ], + "weighted_loads": [ + 0.33768273144960403, + 0.5422401279211044, + 2.0334247052669525, + 0.6112983971834183, + 0.44537852704524994, + 0.10092953778803349, + 0.6345534659922123, + 0.27170213498175144, + 0.4077690038830042, + 0.0314757265150547, + 2.1064095813781023, + 1.7058103270828724, + 1.2808530814945698, + 0.45369913056492805, + 0.5340598747134209, + 0.031402166932821274, + 0.6680365391075611, + 0.32942711748182774, + 0.0, + 0.5289206150919199, + 0.13312488049268723, + 1.4029638022184372, + 0.0, + 0.5706576965749264, + 0.2875313740223646, + 1.8604950215667486, + 0.8067309428006411, + 2.0651029236614704, + 0.18141276203095913, + 0.22340680286288261, + 0.8471208140254021, + 0.5850498601794243, + 0.4048077315092087, + 0.3411121778190136, + 0.05488060414791107, + 0.08954251185059547, + 1.2055827667936683, + 1.3033412620425224, + 0.0, + 0.34808989986777306, + 2.1244471445679665, + 0.26493046432733536, + 0.8719465360045433, + 1.3095856588333845, + 0.12396817654371262, + 0.35869235172867775, + 1.56127367913723, + 2.0690571907907724, + 0.2872079825028777, + 1.3925333358347416, + 0.32345994003117085, + 4.36490417830646, + 2.038848019205034, + 0.9148697964847088, + 0.220047265291214, + 1.1407133769243956, + 1.0277801807969809, + 0.23538155853748322, + 0.7421241626143456, + 0.8420163039118052, + 1.791456576436758, + 0.6507742591202259, + 0.8512920662760735, + 0.3901620991528034 + ], + "unique_experts": 61, + "load_cv": 0.833297398366671, + "normalized_load_entropy": 0.9282968754629334, + "max_load_share": 0.08396946564885496 + } + }, + "s1_period": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "bb0333a691dfd428c8f8e1c9622dd4feb06eebe49e0bf941cefc89e21a1f2b32", + "route_weight_sha256": "e553b68c7ed5f21e90ea115b6e5a4c966640ef305663c9ab9ac927823fe7ac0f", + "loads": [ + 5, + 9, + 25, + 11, + 2, + 1, + 0, + 5, + 1, + 0, + 19, + 15, + 17, + 11, + 4, + 0, + 1, + 7, + 0, + 7, + 4, + 27, + 0, + 5, + 6, + 21, + 2, + 27, + 2, + 5, + 13, + 11, + 1, + 5, + 1, + 4, + 7, + 19, + 0, + 7, + 19, + 8, + 14, + 14, + 3, + 8, + 16, + 23, + 5, + 2, + 4, + 65, + 12, + 16, + 6, + 10, + 20, + 3, + 8, + 19, + 33, + 3, + 13, + 5 + ], + "weighted_loads": [ + 0.17261593602597713, + 0.5341334380209446, + 2.090183585882187, + 0.48471136949956417, + 0.07552004978060722, + 0.04900924488902092, + 0.0, + 0.21647359430789948, + 0.045840077102184296, + 0.0, + 1.9659187644720078, + 1.6154198590666056, + 0.9300253242254257, + 0.49220890179276466, + 0.12956934235990047, + 0.0, + 0.04511971026659012, + 0.2490241937339306, + 0.0, + 0.40781122259795666, + 0.13728067278862, + 1.4455003440380096, + 0.0, + 0.238779803737998, + 0.20906549878418446, + 1.816509272903204, + 0.04283080995082855, + 2.07438100874424, + 0.06531110778450966, + 0.20845447108149529, + 0.6723998114466667, + 0.5887448452413082, + 0.03434862941503525, + 0.30202875658869743, + 0.0568988136947155, + 0.12009789235889912, + 0.3367678336799145, + 1.3102024234831333, + 0.0, + 0.32157612405717373, + 1.2886240519583225, + 0.2753342054784298, + 0.8545621689409018, + 1.206753309816122, + 0.12172067165374756, + 0.3893214985728264, + 1.5549869909882545, + 1.9761567413806915, + 0.18695589900016785, + 0.21181143820285797, + 0.15728585794568062, + 4.21349361166358, + 1.7225032411515713, + 0.8994769472628832, + 0.2174512967467308, + 0.37661752104759216, + 1.0122592151165009, + 0.19702530652284622, + 0.6531683430075645, + 0.7968548908829689, + 1.9103844836354256, + 0.2610761187970638, + 0.8472834341228008, + 0.20800266414880753 + ], + "unique_experts": 58, + "load_cv": 1.0585299902597287, + "normalized_load_entropy": 0.8887992770866961, + "max_load_share": 0.10220125786163523 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "e0c508e93941a280831f487dad05249cc3ea952bf8fe1477556509b3bf7a5785", + "route_weight_sha256": "fac68ff96855a0f5da24a5b3da848b38a43099e51502a813147be3b75f2f52cb", + "loads": [ + 25, + 10, + 25, + 12, + 9, + 4, + 13, + 5, + 13, + 1, + 24, + 19, + 24, + 12, + 9, + 11, + 13, + 11, + 1, + 11, + 5, + 28, + 0, + 12, + 8, + 22, + 13, + 29, + 8, + 6, + 19, + 15, + 6, + 8, + 3, + 4, + 13, + 19, + 3, + 8, + 25, + 10, + 14, + 17, + 3, + 9, + 16, + 24, + 8, + 13, + 10, + 67, + 15, + 17, + 6, + 14, + 20, + 9, + 11, + 24, + 33, + 11, + 15, + 10 + ], + "weighted_loads": [ + 1.4511698726564646, + 0.5607982464134693, + 2.090183585882187, + 0.5369552504271269, + 0.4990047253668308, + 0.19936254806816578, + 1.1188526134938002, + 0.21647359430789948, + 0.6356084682047367, + 0.0310196690261364, + 2.2072395980358124, + 1.9487086031585932, + 1.4626216739416122, + 0.5728003494441509, + 0.31978487595915794, + 0.6960167894139886, + 1.1287220232188702, + 0.4091641493141651, + 0.049402523785829544, + 0.6764569245278835, + 0.16621962748467922, + 1.5267729833722115, + 0.0, + 0.547224136069417, + 0.2724040802568197, + 1.844972100108862, + 0.7837828807532787, + 2.1997500993311405, + 0.4842901937663555, + 0.24598407000303268, + 0.8983864169567823, + 1.0465115457773209, + 0.4314206466078758, + 0.44838549569249153, + 0.20488595589995384, + 0.12009789235889912, + 1.1683606477454305, + 1.3102024234831333, + 0.11297129839658737, + 0.35734506882727146, + 1.9969377424567938, + 0.4034113548696041, + 0.8545621689409018, + 1.532729122787714, + 0.12172067165374756, + 0.427132498472929, + 1.5549869909882545, + 2.0102435871958733, + 0.329632512293756, + 2.010785363614559, + 0.3910547699779272, + 4.282398726791143, + 1.8572210362181067, + 1.0473748464137316, + 0.2174512967467308, + 1.110218945890665, + 1.0122592151165009, + 0.8601551949977875, + 0.7987801022827625, + 1.0577472485601902, + 1.9103844836354256, + 0.9010648354887962, + 0.9626767709851265, + 0.4176187217235565 + ], + "unique_experts": 63, + "load_cv": 0.7261300670015323, + "normalized_load_entropy": 0.9459910987765013, + "max_load_share": 0.07596371882086168 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 106, + "ordered_topk_exact_tokens": 72, + "set_exact_tokens": 82, + "mean_set_jaccard": 0.933288409703504, + "mean_token_weighted_tv": 0.012823697697933553, + "aggregate_load_tv": 0.02830188679245283 + }, + "system_bos": { + "tokens": 106, + "ordered_topk_exact_tokens": 59, + "set_exact_tokens": 71, + "mean_set_jaccard": 0.9056603773584906, + "mean_token_weighted_tv": 0.017727049594780185, + "aggregate_load_tv": 0.029874213836477984 + }, + "system_x": { + "tokens": 106, + "ordered_topk_exact_tokens": 52, + "set_exact_tokens": 69, + "mean_set_jaccard": 0.8962264150943396, + "mean_token_weighted_tv": 0.019792859969695785, + "aggregate_load_tv": 0.02987421383647798 + }, + "system_period": { + "tokens": 106, + "ordered_topk_exact_tokens": 54, + "set_exact_tokens": 69, + "mean_set_jaccard": 0.8982479784366577, + "mean_token_weighted_tv": 0.0196473658313307, + "aggregate_load_tv": 0.034591194968553465 + }, + "bos_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 60, + "set_exact_tokens": 75, + "mean_set_jaccard": 0.9123989218328842, + "mean_token_weighted_tv": 0.018298716257976473, + "aggregate_load_tv": 0.0330188679245283 + }, + "bos_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 50, + "set_exact_tokens": 71, + "mean_set_jaccard": 0.9016172506738546, + "mean_token_weighted_tv": 0.02019957885286718, + "aggregate_load_tv": 0.028301886792452827 + }, + "x_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 60, + "set_exact_tokens": 72, + "mean_set_jaccard": 0.9047619047619049, + "mean_token_weighted_tv": 0.019773252194149875, + "aggregate_load_tv": 0.028301886792452827 + }, + "x_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 44, + "set_exact_tokens": 61, + "mean_set_jaccard": 0.8706199460916443, + "mean_token_weighted_tv": 0.02489165778992311, + "aggregate_load_tv": 0.04245283018867924 + }, + "period_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 56, + "set_exact_tokens": 66, + "mean_set_jaccard": 0.8861185983827493, + "mean_token_weighted_tv": 0.021728353856026002, + "aggregate_load_tv": 0.03301886792452831 + }, + "period_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 49, + "set_exact_tokens": 65, + "mean_set_jaccard": 0.8814016172506738, + "mean_token_weighted_tv": 0.02405416573626253, + "aggregate_load_tv": 0.039308176100628936 + } + } + }, + "layer_16": { + "layer": 16, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "ea190e2e6db2abb7f1e48dd8beef92df9ac2e0ff360139bb7521a1b8446d4055", + "route_weight_sha256": "4fe0240692bd94857f88d6e3ff582ee06a20ee4ff838a3a7a3f413da2a396e8e", + "loads": [ + 5, + 8, + 34, + 6, + 0, + 5, + 26, + 21, + 20, + 9, + 0, + 5, + 1, + 6, + 5, + 3, + 16, + 4, + 7, + 20, + 0, + 19, + 0, + 27, + 1, + 13, + 3, + 21, + 9, + 20, + 3, + 9, + 3, + 3, + 14, + 22, + 21, + 13, + 5, + 0, + 8, + 0, + 11, + 3, + 0, + 14, + 5, + 13, + 4, + 3, + 4, + 25, + 20, + 11, + 2, + 1, + 24, + 13, + 20, + 3, + 17, + 15, + 3, + 10 + ], + "weighted_loads": [ + 0.25855917669832706, + 0.33856269903481007, + 1.5992615781724453, + 0.27303487807512283, + 0.0, + 0.18885894119739532, + 1.5740552712231874, + 1.5240834169089794, + 1.7679294664412737, + 2.1928589902818203, + 0.0, + 0.24477969855070114, + 0.061714813113212585, + 0.21199834533035755, + 0.31369494274258614, + 0.42618998885154724, + 0.595839885994792, + 0.4491395875811577, + 0.5295413918793201, + 1.4161858353763819, + 0.0, + 1.8508144188672304, + 0.0, + 2.0067345444113016, + 0.034605473279953, + 0.7555696945637465, + 0.10633612237870693, + 1.4590121619403362, + 0.5105434991419315, + 1.0796834416687489, + 0.10048065334558487, + 0.36519988253712654, + 0.12517352029681206, + 0.1095372699201107, + 0.6285113580524921, + 2.245800357311964, + 1.2600815072655678, + 1.3497114852070808, + 0.4059898629784584, + 0.0, + 0.45283292979002, + 0.0, + 0.9128382988274097, + 0.13322638534009457, + 0.0, + 0.8393807932734489, + 0.21883935667574406, + 0.787200078368187, + 0.3762325942516327, + 0.1293895822018385, + 0.1673638578504324, + 1.4029259029775858, + 1.07781046256423, + 1.6149726137518883, + 0.05918426997959614, + 0.025580693036317825, + 1.4063900783658028, + 0.6460863314568996, + 1.118117269128561, + 0.0986538715660572, + 1.3740510195493698, + 0.5592763964086771, + 0.2094033695757389, + 0.3742703218013048 + ], + "unique_experts": 57, + "load_cv": 0.8501274402634565, + "normalized_load_entropy": 0.9073394524774672, + "max_load_share": 0.05345911949685535 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "a028a7c5a699ff99e3e6714a987479bf8687c87f5a0c435b15e45ec0f5c84d49", + "route_weight_sha256": "8fc571da27dc4e84b36ec07b0b8424c46b5eb286161d6691138e02325a30de67", + "loads": [ + 5, + 8, + 34, + 6, + 0, + 13, + 31, + 21, + 20, + 11, + 3, + 5, + 1, + 7, + 5, + 10, + 25, + 9, + 13, + 21, + 11, + 21, + 2, + 27, + 9, + 13, + 7, + 21, + 9, + 20, + 5, + 9, + 4, + 10, + 14, + 22, + 21, + 23, + 6, + 0, + 10, + 7, + 13, + 3, + 4, + 15, + 5, + 14, + 4, + 3, + 4, + 27, + 20, + 23, + 2, + 11, + 24, + 13, + 20, + 3, + 21, + 18, + 3, + 17 + ], + "weighted_loads": [ + 0.25855917669832706, + 0.33856269903481007, + 1.5992615781724453, + 0.27303487807512283, + 0.0, + 0.9589200355112553, + 1.8012174349278212, + 1.5240834169089794, + 1.7679294664412737, + 3.521092738956213, + 0.17360147461295128, + 0.24477969855070114, + 0.061714813113212585, + 0.23107340931892395, + 0.31369494274258614, + 0.9182074554264545, + 1.0386430299840868, + 0.8159756455570459, + 1.1455233432352543, + 1.4186538725625724, + 0.9646391570568085, + 1.9315383862704039, + 0.12183016538619995, + 2.0067345444113016, + 0.7373954728245735, + 0.7555696945637465, + 0.3455494623631239, + 1.4590121619403362, + 0.5105434991419315, + 1.0796834416687489, + 0.19385924376547337, + 0.36519988253712654, + 0.1657172217965126, + 0.5311623783782125, + 0.6285113580524921, + 2.245800357311964, + 1.2600815072655678, + 1.8768072985112667, + 0.6245623901486397, + 0.0, + 0.5339676253497601, + 1.3199611939489841, + 0.9912886992096901, + 0.13322638534009457, + 0.14413229376077652, + 0.9069098979234695, + 0.21883935667574406, + 0.8512481898069382, + 0.3762325942516327, + 0.1293895822018385, + 0.1673638578504324, + 1.5017794836312532, + 1.07781046256423, + 2.4328295402228832, + 0.05918426997959614, + 0.830581434071064, + 1.4063900783658028, + 0.6460863314568996, + 1.118117269128561, + 0.0986538715660572, + 1.7431281581521034, + 0.6710717438254505, + 0.2094033695757389, + 0.7701430274173617 + ], + "unique_experts": 62, + "load_cv": 0.6826882386773858, + "normalized_load_entropy": 0.9404588078659737, + "max_load_share": 0.043256997455470736 + } + }, + "s1_eos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "87c3414feecb2fe70ebc794b74277899fcfe011fdbb182cea438025264828baa", + "route_weight_sha256": "750011bd491e0d3c455351cdab67174f998e10b85125db9bf229004e5f655600", + "loads": [ + 5, + 8, + 33, + 8, + 0, + 6, + 25, + 21, + 21, + 10, + 0, + 5, + 1, + 6, + 5, + 3, + 15, + 4, + 7, + 20, + 0, + 20, + 0, + 26, + 1, + 14, + 1, + 21, + 10, + 21, + 3, + 9, + 3, + 3, + 16, + 23, + 21, + 11, + 5, + 0, + 8, + 0, + 11, + 3, + 0, + 14, + 3, + 12, + 4, + 3, + 4, + 26, + 21, + 11, + 2, + 1, + 24, + 12, + 19, + 3, + 16, + 15, + 3, + 10 + ], + "weighted_loads": [ + 0.25714029371738434, + 0.33764518797397614, + 1.5736716520041227, + 0.3248290363699198, + 0.0, + 0.2161435205489397, + 1.5548749957233667, + 1.5269231628626585, + 1.7758186683058739, + 2.2078226543962955, + 0.0, + 0.24994094297289848, + 0.05951455608010292, + 0.20944059826433659, + 0.3229709230363369, + 0.4116260167211294, + 0.548064362257719, + 0.4684981629252434, + 0.5209476388990879, + 1.439435750246048, + 0.0, + 1.9158242642879486, + 0.0, + 1.9652002230286598, + 0.03338005766272545, + 0.7777075041085482, + 0.04248316213488579, + 1.4497168082743883, + 0.5387048311531544, + 1.0824717320501804, + 0.09855447709560394, + 0.3664255775511265, + 0.12116023525595665, + 0.1076829731464386, + 0.6869847662746906, + 2.2782801762223244, + 1.260423792526126, + 1.273671057075262, + 0.4258529171347618, + 0.0, + 0.46055653132498264, + 0.0, + 0.9064952619373798, + 0.13023507595062256, + 0.0, + 0.8336247056722641, + 0.15108351595699787, + 0.7362774312496185, + 0.3698585592210293, + 0.12674880027770996, + 0.1662083975970745, + 1.4187363181263208, + 1.1369940862059593, + 1.6260279566049576, + 0.06150139309465885, + 0.025167841464281082, + 1.4190823175013065, + 0.6036691591143608, + 1.0723894909024239, + 0.10437875054776669, + 1.2881925478577614, + 0.5652039367705584, + 0.20890644937753677, + 0.42469776049256325 + ], + "unique_experts": 57, + "load_cv": 0.8525435038821357, + "normalized_load_entropy": 0.9058712698764587, + "max_load_share": 0.05188679245283019 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "7ceeefd54e6dbd189c42b589fcf2ac0e7c98d8e8e098ec0accef1852c250a64e", + "route_weight_sha256": "d0b46e1186d83d888870c0fc6d93dd309d8f2ed4780a5405940902ebf4d221ed", + "loads": [ + 5, + 11, + 33, + 10, + 0, + 14, + 30, + 22, + 21, + 13, + 5, + 7, + 1, + 9, + 6, + 14, + 26, + 15, + 15, + 22, + 11, + 22, + 2, + 27, + 16, + 14, + 10, + 21, + 10, + 21, + 7, + 9, + 8, + 9, + 17, + 25, + 21, + 21, + 8, + 3, + 11, + 14, + 14, + 5, + 4, + 18, + 4, + 19, + 7, + 7, + 10, + 27, + 21, + 24, + 2, + 12, + 26, + 12, + 19, + 4, + 22, + 17, + 6, + 16 + ], + "weighted_loads": [ + 0.25714029371738434, + 0.46015355736017227, + 1.5736716520041227, + 0.41715586744248867, + 0.0, + 1.0806479435414076, + 1.8105029072612524, + 1.5524459183216095, + 1.7758186683058739, + 3.5696547739207745, + 0.18504849821329117, + 0.31252108328044415, + 0.05951455608010292, + 0.30043235793709755, + 0.3764563128352165, + 1.3980061057955027, + 0.9934575241059065, + 1.2735503651201725, + 1.365072138607502, + 1.4777373054530472, + 0.934458190575242, + 2.0056279376149178, + 0.08163376897573471, + 2.04160937666893, + 1.2836748138070107, + 0.7777075041085482, + 1.1726796701550484, + 1.4497168082743883, + 0.5387048311531544, + 1.0824717320501804, + 0.25434678606688976, + 0.3664255775511265, + 0.33700570091605186, + 0.41246550250798464, + 0.7222619988024235, + 2.396726593375206, + 1.260423792526126, + 1.8004237245768309, + 0.7548445425927639, + 0.17725524678826332, + 0.5686932671815157, + 2.296932503581047, + 1.0139428526163101, + 0.2223087176680565, + 0.12815969437360764, + 1.0333322323858738, + 0.18252027593553066, + 1.0901827737689018, + 0.495566263794899, + 0.3194245733320713, + 0.42638491094112396, + 1.4610597472637892, + 1.1369940862059593, + 2.728157015517354, + 0.06150139309465885, + 0.9677906110882759, + 1.5272342301905155, + 0.6036691591143608, + 1.0723894909024239, + 0.30627608858048916, + 1.6860366947948933, + 0.6239107915898785, + 0.5384230315685272, + 0.7827724982053041 + ], + "unique_experts": 63, + "load_cv": 0.5731491571082793, + "normalized_load_entropy": 0.9569229567529546, + "max_load_share": 0.03741496598639456 + } + }, + "s0_bos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "1307e897ec314d8702f9ee98f737e9b8303f8318cca574baf17c36d3e55b320b", + "route_weight_sha256": "98d06f1cadb24b73706cb4398eea821dce7b054ba3d4b7f906ce45a48731000e", + "loads": [ + 4, + 8, + 32, + 7, + 0, + 4, + 28, + 20, + 20, + 12, + 0, + 5, + 1, + 7, + 5, + 4, + 15, + 4, + 7, + 20, + 0, + 22, + 0, + 26, + 1, + 13, + 3, + 22, + 9, + 21, + 3, + 10, + 3, + 1, + 13, + 25, + 19, + 13, + 5, + 0, + 8, + 0, + 13, + 4, + 1, + 14, + 3, + 14, + 5, + 2, + 3, + 23, + 23, + 11, + 1, + 1, + 25, + 9, + 19, + 2, + 17, + 13, + 3, + 10 + ], + "weighted_loads": [ + 0.22681022062897682, + 0.3480416461825371, + 1.5625127330422401, + 0.29809038527309895, + 0.0, + 0.14245365746319294, + 1.632623815909028, + 1.511587530374527, + 1.77675561606884, + 2.29736165702343, + 0.0, + 0.2526442613452673, + 0.05973314866423607, + 0.24309459142386913, + 0.340553343296051, + 0.4707665368914604, + 0.5713882707059383, + 0.4505333676934242, + 0.5254776328802109, + 1.4301682356745005, + 0.0, + 1.9812514893710613, + 0.0, + 1.9995936173945665, + 0.03404397889971733, + 0.7491114046424627, + 0.10499110072851181, + 1.48113907687366, + 0.5450544990599155, + 1.118427550420165, + 0.10925581492483616, + 0.39947251230478287, + 0.10725255683064461, + 0.03543539345264435, + 0.5931952763348818, + 2.398927439004183, + 1.2055547535419464, + 1.2977159805595875, + 0.4156568869948387, + 0.0, + 0.444879999384284, + 0.0, + 0.9888429902493954, + 0.17067050375044346, + 0.025522397831082344, + 0.8528871349990368, + 0.14924720861017704, + 0.8577229827642441, + 0.4032598212361336, + 0.11279389448463917, + 0.1419125832617283, + 1.335856745019555, + 1.1853470634669065, + 1.571830376982689, + 0.03383161872625351, + 0.02425982989370823, + 1.4410554356873035, + 0.46483826637268066, + 1.0986904688179493, + 0.07851457595825195, + 1.4036097135394812, + 0.4941163472831249, + 0.21127915754914284, + 0.3794178180396557 + ], + "unique_experts": 58, + "load_cv": 0.862690443228957, + "normalized_load_entropy": 0.9043478366242764, + "max_load_share": 0.050314465408805034 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "0051ad60646c8e7964a0ee07c2fa83dde470672e1951085e40d6dca03ad8b4b7", + "route_weight_sha256": "5c7b76220fd5e98bd30145e9313febc5dad6025d960914ea1f7d0aca3206fd67", + "loads": [ + 4, + 8, + 32, + 7, + 0, + 13, + 32, + 20, + 20, + 14, + 3, + 6, + 2, + 9, + 5, + 11, + 23, + 9, + 13, + 21, + 11, + 24, + 2, + 26, + 8, + 13, + 7, + 22, + 9, + 21, + 5, + 10, + 4, + 7, + 14, + 25, + 19, + 23, + 6, + 0, + 10, + 8, + 16, + 4, + 4, + 15, + 3, + 15, + 5, + 3, + 4, + 25, + 23, + 23, + 1, + 11, + 25, + 9, + 19, + 2, + 20, + 15, + 3, + 15 + ], + "weighted_loads": [ + 0.22681022062897682, + 0.3480416461825371, + 1.5625127330422401, + 0.29809038527309895, + 0.0, + 0.9534477982670069, + 1.8062318470329046, + 1.511587530374527, + 1.77675561606884, + 2.717396382242441, + 0.17360147461295128, + 0.29153733514249325, + 0.1330738253891468, + 0.30283869057893753, + 0.340553343296051, + 0.9665676914155483, + 1.472935676574707, + 0.8161431793123484, + 1.1233797445893288, + 1.4600829984992743, + 0.9646391570568085, + 2.0619754567742348, + 0.12183016538619995, + 1.9995936173945665, + 0.6698107942938805, + 0.7491114046424627, + 0.33193444460630417, + 1.48113907687366, + 0.5450544990599155, + 1.118427550420165, + 0.20263440534472466, + 0.39947251230478287, + 0.14779625833034515, + 0.45062151923775673, + 0.7076216209679842, + 2.398927439004183, + 1.2055547535419464, + 1.8216295577585697, + 0.6112082377076149, + 0.0, + 0.5260146949440241, + 1.3607686758041382, + 1.09257285669446, + 0.17067050375044346, + 0.13064616732299328, + 0.9204162396490574, + 0.14924720861017704, + 0.9172926023602486, + 0.4032598212361336, + 0.15826706774532795, + 0.1850498467683792, + 1.4347103256732225, + 1.1853470634669065, + 2.3853251673281193, + 0.03383161872625351, + 0.8292605709284544, + 1.4410554356873035, + 0.46483826637268066, + 1.0986904688179493, + 0.07851457595825195, + 1.7135643232613802, + 0.5923305153846741, + 0.21127915754914284, + 0.7104655150324106 + ], + "unique_experts": 62, + "load_cv": 0.6814732028202093, + "normalized_load_entropy": 0.9402344564450715, + "max_load_share": 0.04071246819338423 + } + }, + "s1_bos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "2a9ec524bb627f7fb27a9c601c8b914367d3447b70a2c285e88e1a7eb2b21d55", + "route_weight_sha256": "acc80ed4a875382cb6fc1e9528e71e2789adc9e3de2a2392abfef793f34ea32d", + "loads": [ + 5, + 7, + 32, + 5, + 0, + 3, + 27, + 20, + 21, + 11, + 0, + 5, + 1, + 5, + 5, + 3, + 13, + 4, + 7, + 20, + 0, + 20, + 0, + 25, + 1, + 13, + 2, + 22, + 9, + 21, + 3, + 11, + 3, + 3, + 14, + 25, + 20, + 13, + 5, + 0, + 8, + 0, + 11, + 3, + 1, + 13, + 5, + 13, + 4, + 3, + 5, + 24, + 22, + 11, + 1, + 1, + 25, + 12, + 19, + 3, + 20, + 13, + 3, + 12 + ], + "weighted_loads": [ + 0.2571532167494297, + 0.3014342039823532, + 1.5420797187834978, + 0.23720111697912216, + 0.0, + 0.10655185766518116, + 1.602141797542572, + 1.495548602193594, + 1.788165058940649, + 2.211519945412874, + 0.0, + 0.24472011998295784, + 0.05831615626811981, + 0.18052174896001816, + 0.3406389690935612, + 0.4231865368783474, + 0.5089952945709229, + 0.45929141342639923, + 0.5368267521262169, + 1.421899078413844, + 0.0, + 1.921408724039793, + 0.0, + 1.9504995662719011, + 0.03764329105615616, + 0.7356346193701029, + 0.0684987585991621, + 1.4222375079989433, + 0.5351806581020355, + 1.1131444033235312, + 0.10596386343240738, + 0.43462279438972473, + 0.10390201024711132, + 0.1071900837123394, + 0.6320429984480143, + 2.3658152893185616, + 1.2136247418820858, + 1.2464204486459494, + 0.40205758810043335, + 0.0, + 0.4625195786356926, + 0.0, + 0.8930533714592457, + 0.13685882836580276, + 0.026800842955708504, + 0.8431725278496742, + 0.22412952966988087, + 0.798527866601944, + 0.3558109700679779, + 0.1398970577865839, + 0.20659715682268143, + 1.370817320421338, + 1.1530759502202272, + 1.5579311400651932, + 0.031826164573431015, + 0.024492483586072922, + 1.4540233835577965, + 0.5816295742988586, + 1.099636249244213, + 0.10675293765962124, + 1.40644770860672, + 0.5056329444050789, + 0.20579267293214798, + 0.4301776587963104 + ], + "unique_experts": 58, + "load_cv": 0.8569860339000577, + "normalized_load_entropy": 0.9059205356743181, + "max_load_share": 0.050314465408805034 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "0684ffd9e6bb0d390881fe833d2198a8e9a6acc8f6be886cef49d7912123a212", + "route_weight_sha256": "a507d8f5c857807b73fcae977d6532516e0512bee9e68eb1f6a7a29900333f54", + "loads": [ + 5, + 10, + 32, + 7, + 0, + 11, + 32, + 21, + 21, + 14, + 5, + 7, + 1, + 8, + 6, + 14, + 24, + 14, + 15, + 20, + 11, + 22, + 2, + 26, + 15, + 13, + 11, + 22, + 9, + 21, + 7, + 11, + 8, + 10, + 16, + 27, + 20, + 23, + 8, + 3, + 11, + 15, + 14, + 5, + 7, + 17, + 6, + 20, + 7, + 7, + 11, + 25, + 22, + 24, + 1, + 12, + 27, + 12, + 19, + 4, + 27, + 14, + 6, + 17 + ], + "weighted_loads": [ + 0.2571532167494297, + 0.42394257336854935, + 1.5420797187834978, + 0.32952794805169106, + 0.0, + 0.971056280657649, + 1.8572898916900158, + 1.521071357652545, + 1.788165058940649, + 2.6609895788133144, + 0.18504849821329117, + 0.3073002602905035, + 0.05831615626811981, + 0.2715135086327791, + 0.3941243588924408, + 1.4148691669106483, + 1.413054745644331, + 1.2408106252551079, + 1.3848201110959053, + 1.421899078413844, + 0.934458190575242, + 2.011212397366762, + 0.08163376897573471, + 2.0269087199121714, + 1.2150219082832336, + 0.7356346193701029, + 1.1884904634207487, + 1.4222375079989433, + 0.5351806581020355, + 1.1131444033235312, + 0.2617561724036932, + 0.43462279438972473, + 0.31974747590720654, + 0.5015389695763588, + 0.7120528910309076, + 2.484261706471443, + 1.2136247418820858, + 1.7736342325806618, + 0.7112514264881611, + 0.17725524678826332, + 0.5706563144922256, + 2.359988547861576, + 1.0015874076634645, + 0.2289324700832367, + 0.22615603543817997, + 1.042880054563284, + 0.25556628964841366, + 1.1519280783832073, + 0.4815186746418476, + 0.33257283084094524, + 0.47327686473727226, + 1.4131407495588064, + 1.1530759502202272, + 2.6567569244652987, + 0.031826164573431015, + 0.9671152532100677, + 1.5621752962470055, + 0.5816295742988586, + 1.099636249244213, + 0.3086502756923437, + 1.8639911487698555, + 0.5565229058265686, + 0.5353092551231384, + 0.7927433531731367 + ], + "unique_experts": 63, + "load_cv": 0.5772968306233145, + "normalized_load_entropy": 0.9566616405980731, + "max_load_share": 0.036281179138321996 + } + }, + "s0_x": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "63440e7af76104fe3d583288d2e23a34bc43071bdf730c10e57dfbb2ef5e7c3b", + "route_weight_sha256": "2bddda51a96b48ccdc5b6ee9e1ad868f99c1b180e0f81754162eb80a6629af03", + "loads": [ + 5, + 5, + 32, + 5, + 0, + 3, + 25, + 20, + 21, + 10, + 0, + 7, + 1, + 6, + 5, + 3, + 14, + 4, + 7, + 20, + 1, + 21, + 0, + 27, + 1, + 13, + 3, + 23, + 10, + 21, + 3, + 11, + 3, + 3, + 14, + 24, + 21, + 12, + 6, + 0, + 8, + 0, + 12, + 4, + 0, + 14, + 4, + 14, + 4, + 1, + 4, + 24, + 21, + 11, + 1, + 1, + 25, + 10, + 21, + 3, + 17, + 13, + 3, + 11 + ], + "weighted_loads": [ + 0.26610938645899296, + 0.241815023124218, + 1.5703845638781786, + 0.2292555868625641, + 0.0, + 0.11514360457658768, + 1.54939753562212, + 1.513736605644226, + 1.8122760020196438, + 2.217994499951601, + 0.0, + 0.3065373878926039, + 0.05707354471087456, + 0.2136343400925398, + 0.345174640417099, + 0.42550942301750183, + 0.5449660420417786, + 0.4420112296938896, + 0.5333989523351192, + 1.4320097379386425, + 0.031971581280231476, + 1.9574696812778711, + 0.0, + 1.9982127621769905, + 0.03724818304181099, + 0.7531120143830776, + 0.10849041678011417, + 1.4932633191347122, + 0.561575124040246, + 1.1233476717025042, + 0.10293320938944817, + 0.43277634494006634, + 0.10440992936491966, + 0.09999756142497063, + 0.6208962444216013, + 2.3765904530882835, + 1.2807574588805437, + 1.2975923866033554, + 0.4333943724632263, + 0.0, + 0.4305200334638357, + 0.0, + 0.9292991645634174, + 0.16771374084055424, + 0.0, + 0.8601567186415195, + 0.18801964446902275, + 0.8517490029335022, + 0.3604790046811104, + 0.08048008382320404, + 0.16352454200387, + 1.359011271968484, + 1.0994861777871847, + 1.5599074177443981, + 0.032945189625024796, + 0.0231825802475214, + 1.433947928249836, + 0.49365944787859917, + 1.2092791385948658, + 0.1046985611319542, + 1.3241766765713692, + 0.4894809126853943, + 0.2061438336968422, + 0.3966853618621826 + ], + "unique_experts": 58, + "load_cv": 0.8590145151655703, + "normalized_load_entropy": 0.9052465932139756, + "max_load_share": 0.050314465408805034 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "31a6ff4fad3a7ac3b79b63cb3d89adb7437256335d60e448d6570bcd1c57774c", + "route_weight_sha256": "6604fe8eba4790e8f4f0424dd893ebbd4e5e87a5644f8e580057e68a21e247e3", + "loads": [ + 5, + 5, + 32, + 5, + 0, + 11, + 30, + 20, + 21, + 11, + 3, + 7, + 1, + 7, + 5, + 10, + 21, + 10, + 13, + 20, + 13, + 24, + 2, + 27, + 9, + 13, + 7, + 23, + 10, + 21, + 6, + 11, + 5, + 8, + 14, + 24, + 21, + 23, + 7, + 0, + 10, + 7, + 14, + 4, + 3, + 15, + 4, + 15, + 4, + 1, + 5, + 26, + 21, + 24, + 1, + 12, + 25, + 10, + 21, + 3, + 21, + 15, + 3, + 17 + ], + "weighted_loads": [ + 0.26610938645899296, + 0.241815023124218, + 1.5703845638781786, + 0.2292555868625641, + 0.0, + 0.8852046988904476, + 1.7817806862294674, + 1.513736605644226, + 1.8122760020196438, + 2.5960611887276173, + 0.17360147461295128, + 0.3065373878926039, + 0.05707354471087456, + 0.23270940408110619, + 0.345174640417099, + 0.949007160961628, + 0.8751865290105343, + 0.8797636460512877, + 1.1911410689353943, + 1.4320097379386425, + 1.2409390732645988, + 2.072652941569686, + 0.12183016538619995, + 1.9982127621769905, + 0.7752031907439232, + 0.7531120143830776, + 0.33463933132588863, + 1.4932633191347122, + 0.561575124040246, + 1.1233476717025042, + 0.24290483631193638, + 0.43277634494006634, + 0.2183665782213211, + 0.4405549392104149, + 0.6208962444216013, + 2.3765904530882835, + 1.2807574588805437, + 1.862959560006857, + 0.6636761277914047, + 0.0, + 0.5116547290235758, + 1.2603927738964558, + 1.014037910848856, + 0.16771374084055424, + 0.10471914894878864, + 0.9276858232915401, + 0.18801964446902275, + 0.9147433489561081, + 0.3604790046811104, + 0.08048008382320404, + 0.1977182887494564, + 1.4578648526221514, + 1.0994861777871847, + 2.5097896941006184, + 0.032945189625024796, + 0.9411797281354666, + 1.433947928249836, + 0.49365944787859917, + 1.2092791385948658, + 0.1046985611319542, + 1.6978793106973171, + 0.6086319908499718, + 0.2061438336968422, + 0.7548977080732584 + ], + "unique_experts": 62, + "load_cv": 0.6835980983211037, + "normalized_load_entropy": 0.9391294331460209, + "max_load_share": 0.04071246819338423 + } + }, + "s1_x": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "e4f157cb9a79356c6b1e4937d614dd2cea198013ec9d48a97f0cb6cd347f5a65", + "route_weight_sha256": "0709d2d68bb235791ba261f1b0bd2396c398c831abf52e028ef76f13aa7a555c", + "loads": [ + 5, + 6, + 32, + 6, + 1, + 2, + 26, + 20, + 21, + 11, + 0, + 5, + 1, + 6, + 6, + 3, + 12, + 4, + 7, + 19, + 1, + 21, + 1, + 23, + 1, + 15, + 3, + 22, + 9, + 22, + 3, + 9, + 3, + 1, + 14, + 25, + 20, + 11, + 5, + 0, + 8, + 0, + 11, + 3, + 1, + 14, + 6, + 13, + 4, + 4, + 5, + 24, + 20, + 11, + 1, + 1, + 26, + 13, + 20, + 3, + 18, + 13, + 3, + 12 + ], + "weighted_loads": [ + 0.2674561571329832, + 0.2695682439953089, + 1.5476561896502972, + 0.26104388386011124, + 0.027147550135850906, + 0.0735245831310749, + 1.5701885558664799, + 1.5111511871218681, + 1.8014234583824873, + 2.231556311249733, + 0.0, + 0.2449699342250824, + 0.05737118050456047, + 0.21727132983505726, + 0.3715666402131319, + 0.4273730404675007, + 0.48666176572442055, + 0.45667798072099686, + 0.5250995494425297, + 1.3681931979954243, + 0.03358389437198639, + 1.9898169748485088, + 0.03072972036898136, + 1.852763820439577, + 0.034107550978660583, + 0.8070316761732101, + 0.10684137605130672, + 1.441856388002634, + 0.5185279063880444, + 1.1747423727065325, + 0.10474210418760777, + 0.36871789768338203, + 0.10370073653757572, + 0.03261569142341614, + 0.6418582070618868, + 2.3629568684846163, + 1.1928119603544474, + 1.1938360519707203, + 0.4092063307762146, + 0.0, + 0.46345231868326664, + 0.0, + 0.8998864218592644, + 0.13350138254463673, + 0.027674758806824684, + 0.8506291285157204, + 0.2534809112548828, + 0.7772456407546997, + 0.3425398953258991, + 0.15997289307415485, + 0.19980249553918839, + 1.3587798085063696, + 1.0564635694026947, + 1.5691433437168598, + 0.03149500861763954, + 0.023782256990671158, + 1.4707483407109976, + 0.5940835848450661, + 1.192614957690239, + 0.09869419783353806, + 1.3748010862618685, + 0.4995110500603914, + 0.20566514506936073, + 0.4720922913402319 + ], + "unique_experts": 61, + "load_cv": 0.8434006819162021, + "normalized_load_entropy": 0.9104861373705229, + "max_load_share": 0.050314465408805034 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "80f5a2e76338ab1f401082c558e1c9e4bf84d679a41bec763f5a2cf90e78e3d4", + "route_weight_sha256": "4b3218767e8890c83f869fbcf59d4aee8b45d31a073ef6a1b5facd59ebfa1fd6", + "loads": [ + 5, + 9, + 32, + 8, + 1, + 10, + 31, + 21, + 21, + 13, + 6, + 7, + 1, + 9, + 7, + 14, + 22, + 15, + 14, + 19, + 16, + 24, + 4, + 24, + 16, + 15, + 12, + 22, + 9, + 22, + 8, + 9, + 9, + 5, + 15, + 27, + 20, + 21, + 8, + 3, + 11, + 14, + 14, + 5, + 5, + 18, + 7, + 20, + 7, + 8, + 10, + 25, + 20, + 25, + 1, + 13, + 28, + 14, + 20, + 4, + 23, + 14, + 6, + 16 + ], + "weighted_loads": [ + 0.2674561571329832, + 0.392076613381505, + 1.5476561896502972, + 0.35337071493268013, + 0.027147550135850906, + 0.9380290061235428, + 1.83802006021142, + 1.5366739425808191, + 1.8014234583824873, + 2.6449085995554924, + 0.21206353977322578, + 0.30755007453262806, + 0.05737118050456047, + 0.3082630895078182, + 0.42505203001201153, + 1.4592647440731525, + 0.8503662217408419, + 1.323198925703764, + 1.3038518130779266, + 1.3681931979954243, + 1.3785761687904596, + 2.115961167961359, + 0.14515413530170918, + 1.9291729740798473, + 1.354891050606966, + 0.8070316761732101, + 1.2100536320358515, + 1.441856388002634, + 0.5185279063880444, + 1.1747423727065325, + 0.2887418568134308, + 0.36871789768338203, + 0.38319809921085835, + 0.23558054491877556, + 0.6771354395896196, + 2.481403285637498, + 1.1928119603544474, + 1.7185669373720884, + 0.772750336676836, + 0.17725524678826332, + 0.5715890545397997, + 2.2534124068915844, + 1.0110632665455341, + 0.22557502426207066, + 0.15306594781577587, + 1.05033665522933, + 0.2849176712334156, + 1.1172288171947002, + 0.46824759989976883, + 0.3526486661285162, + 0.4199620746076107, + 1.401103237643838, + 1.0564635694026947, + 2.7644328083842993, + 0.03149500861763954, + 1.1018989607691765, + 1.5789002534002066, + 0.6639865040779114, + 1.192614957690239, + 0.30059153586626053, + 1.7263634148985147, + 0.575539031997323, + 0.5351817272603512, + 0.740203533321619 + ], + "unique_experts": 64, + "load_cv": 0.5612554104036274, + "normalized_load_entropy": 0.9595215917430395, + "max_load_share": 0.036281179138321996 + } + }, + "s0_period": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "1f0962a59d10b71766aa84891822ca3ce5aa0d8eb4d658058344680ef8bd0c1a", + "route_weight_sha256": "442972a15681ac40cdd6e1f785b3df02841f0bc9ff6f4f6994164ed95f7e8d34", + "loads": [ + 4, + 6, + 31, + 6, + 0, + 3, + 26, + 20, + 20, + 10, + 0, + 8, + 1, + 5, + 6, + 2, + 16, + 4, + 7, + 19, + 1, + 20, + 0, + 27, + 1, + 12, + 3, + 23, + 9, + 20, + 3, + 11, + 3, + 4, + 13, + 25, + 19, + 13, + 6, + 0, + 9, + 0, + 13, + 4, + 0, + 14, + 5, + 13, + 4, + 2, + 4, + 26, + 21, + 11, + 1, + 1, + 23, + 9, + 21, + 3, + 18, + 13, + 3, + 11 + ], + "weighted_loads": [ + 0.2184022106230259, + 0.26786855794489384, + 1.5603371988981962, + 0.27028101682662964, + 0.0, + 0.10567649453878403, + 1.5565467718988657, + 1.520747259259224, + 1.7747874483466148, + 2.2158301137387753, + 0.0, + 0.3446132726967335, + 0.05792466551065445, + 0.17380979284644127, + 0.3740364648401737, + 0.38739013671875, + 0.6026989128440619, + 0.44729799777269363, + 0.5090574249625206, + 1.3876202423125505, + 0.03263654187321663, + 1.9347213841974735, + 0.0, + 2.013038231059909, + 0.037679288536310196, + 0.7176918350160122, + 0.10699482262134552, + 1.515194034203887, + 0.5320224612951279, + 1.084203215315938, + 0.09999458864331245, + 0.42821964994072914, + 0.10607731714844704, + 0.12753663025796413, + 0.5877562053501606, + 2.3802182655781507, + 1.2002906575798988, + 1.3211259581148624, + 0.431268110871315, + 0.0, + 0.4722094517201185, + 0.0, + 0.9667858369648457, + 0.16609283722937107, + 0.0, + 0.8580943010747433, + 0.2200772687792778, + 0.7954159826040268, + 0.3752349801361561, + 0.10572783090174198, + 0.16702576354146004, + 1.4540382586419582, + 1.0975255984812975, + 1.5789823308587074, + 0.03183383494615555, + 0.02324914000928402, + 1.3664478957653046, + 0.47073008120059967, + 1.1845938116312027, + 0.09884663484990597, + 1.428364945575595, + 0.48940117470920086, + 0.2086867094039917, + 0.3948791231960058 + ], + "unique_experts": 58, + "load_cv": 0.8484507505334952, + "normalized_load_entropy": 0.9073527583848422, + "max_load_share": 0.04874213836477988 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "81427ddaee2cbf9a541eaf8f1bf0abdef1329b9be0516045d6461588a7ec780e", + "route_weight_sha256": "30c4279cf66f2d140bd8431802445e9fd34eb34270de660f8905a0982dbbc196", + "loads": [ + 4, + 6, + 31, + 6, + 0, + 12, + 31, + 20, + 20, + 11, + 4, + 8, + 1, + 6, + 6, + 9, + 23, + 10, + 13, + 19, + 13, + 22, + 3, + 27, + 10, + 12, + 7, + 23, + 9, + 20, + 6, + 11, + 4, + 8, + 13, + 25, + 19, + 23, + 7, + 0, + 11, + 7, + 16, + 4, + 3, + 15, + 5, + 15, + 4, + 2, + 4, + 28, + 21, + 24, + 1, + 12, + 23, + 9, + 21, + 3, + 22, + 15, + 3, + 16 + ], + "weighted_loads": [ + 0.2184022106230259, + 0.26786855794489384, + 1.5603371988981962, + 0.27028101682662964, + 0.0, + 0.9213752038776875, + 1.7921550441533327, + 1.520747259259224, + 1.7747874483466148, + 2.5938968025147915, + 0.22472826018929482, + 0.3446132726967335, + 0.05792466551065445, + 0.19288485683500767, + 0.3740364648401737, + 0.888762179762125, + 0.9728818144649267, + 0.981750575825572, + 1.1075936742126942, + 1.3876202423125505, + 1.078805673867464, + 2.015445351600647, + 0.16674073040485382, + 2.013038231059909, + 0.8472634293138981, + 0.7176918350160122, + 0.3663460984826088, + 1.515194034203887, + 0.5320224612951279, + 1.084203215315938, + 0.25257587991654873, + 0.42821964994072914, + 0.14662101864814758, + 0.43877297826111317, + 0.5877562053501606, + 2.3802182655781507, + 1.2002906575798988, + 1.8499019853770733, + 0.6560751497745514, + 0.0, + 0.5533441472798586, + 1.317379992455244, + 1.0674449186772108, + 0.16609283722937107, + 0.11996565014123917, + 0.9256234057247639, + 0.2200772687792778, + 0.8821263313293457, + 0.3752349801361561, + 0.10572783090174198, + 0.16702576354146004, + 1.5528918392956257, + 1.0975255984812975, + 2.4322342686355114, + 0.03183383494615555, + 0.8897708412259817, + 1.3664478957653046, + 0.47073008120059967, + 1.1845938116312027, + 0.09884663484990597, + 1.8048276472836733, + 0.6153916325420141, + 0.2086867094039917, + 0.7124378643929958 + ], + "unique_experts": 62, + "load_cv": 0.6767443343166935, + "normalized_load_entropy": 0.9409805553859161, + "max_load_share": 0.039440203562340966 + } + }, + "s1_period": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "41ef79ad525f87bc0096f4458a47dbc97519218854c3e94bc6376c2decd2985d", + "route_weight_sha256": "9fd79d950476bf64e2453733c2927478ab18218be9bb87f5b2082c5332b017e0", + "loads": [ + 5, + 7, + 32, + 7, + 0, + 2, + 26, + 20, + 20, + 10, + 0, + 5, + 1, + 5, + 8, + 3, + 13, + 4, + 7, + 20, + 1, + 21, + 1, + 23, + 1, + 13, + 3, + 21, + 10, + 21, + 3, + 9, + 4, + 0, + 14, + 25, + 19, + 11, + 5, + 0, + 9, + 0, + 11, + 3, + 1, + 13, + 6, + 13, + 4, + 4, + 6, + 25, + 20, + 11, + 1, + 1, + 25, + 13, + 21, + 3, + 18, + 13, + 3, + 12 + ], + "weighted_loads": [ + 0.26786706782877445, + 0.3020603097975254, + 1.5345600806176662, + 0.3027477189898491, + 0.0, + 0.07167940586805344, + 1.5493191182613373, + 1.5100255571305752, + 1.7733294069766998, + 2.1613735631108284, + 0.0, + 0.24645665660500526, + 0.056628964841365814, + 0.18060491047799587, + 0.4412100575864315, + 0.4295995533466339, + 0.5111493598669767, + 0.470151849091053, + 0.5046174600720406, + 1.4081631246954203, + 0.033257126808166504, + 1.9879366271197796, + 0.030767720192670822, + 1.870161646977067, + 0.041164569556713104, + 0.7407997287809849, + 0.10828046500682831, + 1.3994355089962482, + 0.5611439608037472, + 1.1331929340958595, + 0.1049824021756649, + 0.3627379387617111, + 0.13480084389448166, + 0.0, + 0.6374105736613274, + 2.375264097005129, + 1.162701390683651, + 1.2522126082330942, + 0.431498434394598, + 0.0, + 0.49738914519548416, + 0.0, + 0.8914685919880867, + 0.13444536179304123, + 0.027253203094005585, + 0.8205973543226719, + 0.2536183148622513, + 0.7673435769975185, + 0.33950379118323326, + 0.16064736060798168, + 0.23762260749936104, + 1.4177336040884256, + 1.0503042936325073, + 1.5784715302288532, + 0.030667873099446297, + 0.023321228101849556, + 1.4550238363444805, + 0.5905046872794628, + 1.225749708712101, + 0.09950725361704826, + 1.329797774553299, + 0.5035708621144295, + 0.20764034986495972, + 0.4616087060421705 + ], + "unique_experts": 59, + "load_cv": 0.8366198394877641, + "normalized_load_entropy": 0.9099621701329075, + "max_load_share": 0.050314465408805034 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "bbd68965b0c8ab434cee2485767924603600ecd8cee9356f7f21b32b60e0d049", + "route_weight_sha256": "cdcba87f40a4d1d1a38d6cf5e5f916192d9d480ff2ae4fc326a8bbf4bd59fd25", + "loads": [ + 5, + 10, + 32, + 9, + 0, + 11, + 31, + 21, + 20, + 12, + 6, + 7, + 1, + 8, + 9, + 14, + 22, + 16, + 15, + 20, + 14, + 23, + 3, + 24, + 17, + 13, + 12, + 21, + 10, + 21, + 8, + 9, + 10, + 4, + 15, + 27, + 19, + 21, + 9, + 3, + 12, + 14, + 14, + 5, + 5, + 17, + 7, + 20, + 7, + 8, + 11, + 26, + 20, + 24, + 2, + 13, + 27, + 13, + 21, + 4, + 24, + 14, + 6, + 16 + ], + "weighted_loads": [ + 0.26786706782877445, + 0.42456867918372154, + 1.5345600806176662, + 0.395074550062418, + 0.0, + 0.9715680964291096, + 1.8237546756863594, + 1.5355483125895262, + 1.7733294069766998, + 2.574725851416588, + 0.2203826606273651, + 0.3090367969125509, + 0.056628964841365814, + 0.27159667015075684, + 0.4946954473853111, + 1.4306909255683422, + 0.8525588903576136, + 1.4151187166571617, + 1.3616836033761501, + 1.4081631246954203, + 1.0655831824988127, + 2.0777403004467487, + 0.11240148916840553, + 1.9465708006173372, + 1.4394268579781055, + 0.7407997287809849, + 1.2368908785283566, + 1.3994355089962482, + 0.5611439608037472, + 1.1331929340958595, + 0.32677573151886463, + 0.3627379387617111, + 0.3874313049018383, + 0.20699899271130562, + 0.6726878061890602, + 2.4937105141580105, + 1.162701390683651, + 1.7757938243448734, + 0.8148969262838364, + 0.17725524678826332, + 0.6055258810520172, + 2.1551491282880306, + 0.9992345254868269, + 0.22651900351047516, + 0.15193633176386356, + 1.0203048810362816, + 0.2850550748407841, + 1.098346758633852, + 0.46521149575710297, + 0.353323133662343, + 0.45778218656778336, + 1.460057033225894, + 1.0503042936325073, + 2.702598040923476, + 0.06956096552312374, + 1.0163939241319895, + 1.5631757490336895, + 0.5905046872794628, + 1.225749708712101, + 0.30140459164977074, + 1.7507625445723534, + 0.5999899730086327, + 0.5371569320559502, + 0.7147972397506237 + ], + "unique_experts": 63, + "load_cv": 0.5544716159906284, + "normalized_load_entropy": 0.9598074704507698, + "max_load_share": 0.036281179138321996 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 106, + "ordered_topk_exact_tokens": 79, + "set_exact_tokens": 86, + "mean_set_jaccard": 0.9460916442048519, + "mean_token_weighted_tv": 0.012340420602276077, + "aggregate_load_tv": 0.022012578616352196 + }, + "system_bos": { + "tokens": 106, + "ordered_topk_exact_tokens": 62, + "set_exact_tokens": 78, + "mean_set_jaccard": 0.9164420485175202, + "mean_token_weighted_tv": 0.018222215365759045, + "aggregate_load_tv": 0.03459119496855345 + }, + "system_x": { + "tokens": 106, + "ordered_topk_exact_tokens": 57, + "set_exact_tokens": 73, + "mean_set_jaccard": 0.9110512129380055, + "mean_token_weighted_tv": 0.020068459669655224, + "aggregate_load_tv": 0.037735849056603765 + }, + "system_period": { + "tokens": 106, + "ordered_topk_exact_tokens": 54, + "set_exact_tokens": 70, + "mean_set_jaccard": 0.8989218328840971, + "mean_token_weighted_tv": 0.021140800999864092, + "aggregate_load_tv": 0.0440251572327044 + }, + "bos_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 52, + "set_exact_tokens": 65, + "mean_set_jaccard": 0.88544474393531, + "mean_token_weighted_tv": 0.02193722480310584, + "aggregate_load_tv": 0.042452830188679236 + }, + "bos_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 60, + "set_exact_tokens": 71, + "mean_set_jaccard": 0.9036388140161725, + "mean_token_weighted_tv": 0.02074353098166439, + "aggregate_load_tv": 0.03773584905660377 + }, + "x_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 56, + "set_exact_tokens": 68, + "mean_set_jaccard": 0.8915094339622642, + "mean_token_weighted_tv": 0.02185155142906983, + "aggregate_load_tv": 0.03616352201257861 + }, + "x_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 53, + "set_exact_tokens": 64, + "mean_set_jaccard": 0.8807277628032345, + "mean_token_weighted_tv": 0.0244207802000192, + "aggregate_load_tv": 0.04559748427672956 + }, + "period_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 54, + "set_exact_tokens": 68, + "mean_set_jaccard": 0.8935309973045823, + "mean_token_weighted_tv": 0.02082009263828678, + "aggregate_load_tv": 0.03930817610062893 + }, + "period_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 50, + "set_exact_tokens": 62, + "mean_set_jaccard": 0.8733153638814016, + "mean_token_weighted_tv": 0.025780614702698757, + "aggregate_load_tv": 0.045597484276729564 + } + } + }, + "layer_17": { + "layer": 17, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "15173018c2218e1beef95c545b601a38fd86df0c6c4471aa1fff1c9279d0a4c4", + "route_weight_sha256": "8379cc7a51271cc914f8472bbafaf1efe333d7da52ba52d54b192525723be1d5", + "loads": [ + 11, + 3, + 4, + 10, + 8, + 12, + 0, + 15, + 16, + 14, + 3, + 7, + 5, + 15, + 34, + 5, + 12, + 9, + 4, + 3, + 15, + 11, + 17, + 13, + 3, + 21, + 12, + 11, + 5, + 8, + 7, + 0, + 2, + 10, + 19, + 17, + 9, + 8, + 12, + 20, + 4, + 5, + 2, + 12, + 6, + 5, + 17, + 23, + 20, + 5, + 14, + 4, + 8, + 19, + 13, + 4, + 4, + 0, + 18, + 8, + 22, + 4, + 7, + 2 + ], + "weighted_loads": [ + 0.4592456556856632, + 0.11734012886881828, + 0.14675667136907578, + 1.0805201195180416, + 0.7738931700587273, + 0.5783834178000689, + 0.0, + 0.8316010385751724, + 0.9659401439130306, + 2.023073460906744, + 0.12183648906648159, + 0.47390396893024445, + 0.20277532376348972, + 1.3128482848405838, + 2.4719753861427307, + 0.35363421589136124, + 0.638238649815321, + 0.41294006258249283, + 0.7850050218403339, + 0.14218446239829063, + 0.7344445437192917, + 0.5218462143093348, + 1.322110217064619, + 2.4313500728458166, + 0.12503115832805634, + 1.3151463251560926, + 0.502138052135706, + 0.5024989768862724, + 0.9276046939194202, + 0.31643681041896343, + 0.4434561785310507, + 0.0, + 0.07745986431837082, + 0.7319806776940823, + 1.3569919392466545, + 1.5358563028275967, + 0.42805821262300014, + 0.5330376550555229, + 0.8262107819318771, + 1.5938333123922348, + 0.17957673966884613, + 0.22559035755693913, + 0.09954215213656425, + 0.5616691056638956, + 0.34911560639739037, + 0.231998598203063, + 1.102604504674673, + 1.4992879163473845, + 2.2702354192733765, + 0.1770895291119814, + 0.9987151362001896, + 0.17450378090143204, + 0.5811853408813477, + 1.4269135631620884, + 0.5320737212896347, + 0.31739629805088043, + 0.17944470793008804, + 0.0, + 1.2905459329485893, + 0.33170087449252605, + 1.3642008695751429, + 0.1442687250673771, + 0.6026030220091343, + 0.07135353423655033 + ], + "unique_experts": 61, + "load_cv": 0.6799146480566978, + "normalized_load_entropy": 0.9426857542840901, + "max_load_share": 0.05345911949685535 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "d874e880ed965058c68cb65c3caa4ac1082f9b7e7dac460c9861ee26c1031610", + "route_weight_sha256": "3793274e999d3a8aee4de03bf4889aef65c6ffc610f271af0280b1f4d31b2149", + "loads": [ + 19, + 4, + 7, + 17, + 8, + 12, + 2, + 15, + 16, + 18, + 11, + 8, + 8, + 23, + 34, + 9, + 12, + 16, + 7, + 3, + 18, + 11, + 17, + 20, + 10, + 29, + 19, + 14, + 9, + 9, + 7, + 0, + 11, + 10, + 19, + 17, + 9, + 8, + 17, + 20, + 11, + 9, + 4, + 14, + 6, + 10, + 17, + 23, + 20, + 5, + 16, + 4, + 10, + 20, + 13, + 7, + 4, + 3, + 18, + 8, + 22, + 5, + 12, + 2 + ], + "weighted_loads": [ + 0.7289920588955283, + 0.15363987907767296, + 0.30221978947520256, + 1.6693027429282665, + 0.7738931700587273, + 0.5783834178000689, + 0.09668757021427155, + 0.8316010385751724, + 0.9659401439130306, + 2.411979429423809, + 0.5815515406429768, + 0.4923671465367079, + 0.3000979293137789, + 1.9024758450686932, + 2.4719753861427307, + 0.7704495228827, + 0.638238649815321, + 1.0805266872048378, + 0.8771391119807959, + 0.14218446239829063, + 1.01652991771698, + 0.5218462143093348, + 1.322110217064619, + 2.743302857503295, + 0.6386091448366642, + 1.9044996779412031, + 2.0662636905908585, + 0.6413760781288147, + 1.0808066632598639, + 0.3217472522519529, + 0.4434561785310507, + 0.0, + 0.4189458843320608, + 0.7319806776940823, + 1.3569919392466545, + 1.5358563028275967, + 0.42805821262300014, + 0.5330376550555229, + 1.016499888151884, + 1.5938333123922348, + 1.0632450804114342, + 0.3244032091461122, + 0.24142244085669518, + 0.5836987402290106, + 0.34911560639739037, + 1.1833363715559244, + 1.102604504674673, + 1.4992879163473845, + 2.2702354192733765, + 0.1770895291119814, + 1.1060428358614445, + 0.17450378090143204, + 0.7637864649295807, + 1.4548549894243479, + 0.5320737212896347, + 0.5332590565085411, + 0.17944470793008804, + 0.1479300558567047, + 1.2905459329485893, + 0.33170087449252605, + 1.3642008695751429, + 0.22998930141329765, + 0.9640147127211094, + 0.07135353423655033 + ], + "unique_experts": 63, + "load_cv": 0.5530884234801793, + "normalized_load_entropy": 0.9615247867503937, + "max_load_share": 0.043256997455470736 + } + }, + "s1_eos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "2d7994ab12958fb40f677268cf2e06dad20261d6e2dfd7bcead8407fa5098e91", + "route_weight_sha256": "70035d2566381f238e63ee8956f15b93493654e69ce2d27162291adf7574f2da", + "loads": [ + 10, + 2, + 3, + 11, + 8, + 12, + 0, + 14, + 16, + 14, + 2, + 7, + 5, + 16, + 36, + 4, + 12, + 9, + 4, + 3, + 14, + 11, + 16, + 14, + 5, + 22, + 11, + 11, + 5, + 8, + 7, + 0, + 2, + 10, + 20, + 18, + 8, + 8, + 12, + 20, + 4, + 6, + 3, + 11, + 6, + 5, + 18, + 23, + 20, + 4, + 14, + 3, + 8, + 19, + 12, + 4, + 4, + 0, + 18, + 7, + 24, + 4, + 7, + 2 + ], + "weighted_loads": [ + 0.4238820783793926, + 0.0827171728014946, + 0.11190268397331238, + 1.0942679215222597, + 0.7751458361744881, + 0.5919983722269535, + 0.0, + 0.7868027798831463, + 0.9600420407950878, + 2.0622357819229364, + 0.0979692880064249, + 0.4680746756494045, + 0.2116925437003374, + 1.3691917024552822, + 2.594115199521184, + 0.3215258978307247, + 0.6366167403757572, + 0.41421908512711525, + 0.7575617842376232, + 0.14280834794044495, + 0.6979348491877317, + 0.5117232874035835, + 1.2787560559809208, + 2.4280003365129232, + 0.2048335298895836, + 1.3706864137202501, + 0.4806762672960758, + 0.4857496079057455, + 0.9062008541077375, + 0.3099457938224077, + 0.4462139271199703, + 0.0, + 0.07794873043894768, + 0.730797067284584, + 1.400078896433115, + 1.6047251261770725, + 0.38765687867999077, + 0.5239873640239239, + 0.8469147384166718, + 1.606158223003149, + 0.1800391636788845, + 0.26147444546222687, + 0.13385894522070885, + 0.5189533140510321, + 0.3497694171965122, + 0.24473890848457813, + 1.1190274823457003, + 1.498103205114603, + 2.2558613065630198, + 0.1445007473230362, + 1.013908615335822, + 0.14256532303988934, + 0.5886841304600239, + 1.4227971993386745, + 0.48736350424587727, + 0.31941646337509155, + 0.1772787757217884, + 0.0, + 1.2930719126015902, + 0.2931535914540291, + 1.4405797105282545, + 0.14469533041119576, + 0.5847856644541025, + 0.07398590631783009 + ], + "unique_experts": 61, + "load_cv": 0.7070648251072875, + "normalized_load_entropy": 0.939353304538427, + "max_load_share": 0.05660377358490566 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "c27b24dd32eb11fc6e1f17e5a343a2adbd93d1dfb1bbb644375c140c94c0faa7", + "route_weight_sha256": "d2a9da0882939586abf96cb2df4b631f4d220c84dd0b71e11d4edfb350f374d9", + "loads": [ + 18, + 3, + 7, + 17, + 14, + 12, + 3, + 15, + 16, + 21, + 10, + 9, + 5, + 24, + 36, + 12, + 14, + 16, + 7, + 3, + 15, + 12, + 16, + 24, + 15, + 45, + 23, + 13, + 6, + 10, + 9, + 1, + 8, + 10, + 20, + 18, + 12, + 10, + 16, + 21, + 16, + 12, + 6, + 12, + 8, + 11, + 20, + 25, + 20, + 5, + 16, + 9, + 12, + 20, + 13, + 9, + 11, + 11, + 19, + 9, + 25, + 9, + 16, + 2 + ], + "weighted_loads": [ + 0.745468688197434, + 0.12484922632575035, + 0.2781751714646816, + 1.729561297222972, + 1.1655286718159914, + 0.5919983722269535, + 0.11930635198950768, + 0.8422826677560806, + 0.9600420407950878, + 2.53832028247416, + 0.6115971077233553, + 0.5349057111889124, + 0.2116925437003374, + 1.9901667460799217, + 2.594115199521184, + 0.9174895659089088, + 0.8065987229347229, + 1.0108820796012878, + 0.8613641727715731, + 0.14280834794044495, + 0.7663097586482763, + 0.5884743109345436, + 1.2787560559809208, + 3.1293016467243433, + 0.8242883128114045, + 2.9630731977522373, + 2.258565729483962, + 0.5814634766429663, + 0.9581469167023897, + 0.38862484972923994, + 0.5411052592098713, + 0.03952908515930176, + 0.2593120615929365, + 0.730797067284584, + 1.400078896433115, + 1.6047251261770725, + 0.6144228465855122, + 0.5968528650701046, + 1.1750329360365868, + 1.6392649412155151, + 1.715931199491024, + 0.5973498141393065, + 0.2713233381509781, + 0.5377670582383871, + 0.5847405903041363, + 1.6205067690461874, + 1.3361921701580286, + 1.6297797448933125, + 2.2558613065630198, + 0.1796242967247963, + 1.1932541821151972, + 0.43855172395706177, + 0.8610968552529812, + 1.4525980185717344, + 0.5754405502229929, + 0.7187933661043644, + 0.7944975793361664, + 0.5989238247275352, + 1.3169765826314688, + 0.38755084574222565, + 1.4758379776030779, + 0.45413411408662796, + 1.2718266136944294, + 0.07398590631783009 + ], + "unique_experts": 64, + "load_cv": 0.5525393619506215, + "normalized_load_entropy": 0.9648814932752326, + "max_load_share": 0.05102040816326531 + } + }, + "s0_bos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "3bfe471afc46fa30c37908fabeccef80a78172816e9c8e751f83627ba4756dcc", + "route_weight_sha256": "530b31c99623abcc0ef1d60cdb491aea969d97edf848ab376ae187e046e348f8", + "loads": [ + 10, + 2, + 4, + 11, + 8, + 12, + 0, + 14, + 16, + 15, + 2, + 8, + 5, + 16, + 37, + 5, + 10, + 7, + 4, + 3, + 13, + 13, + 15, + 14, + 6, + 22, + 13, + 9, + 5, + 6, + 6, + 0, + 2, + 12, + 18, + 17, + 6, + 7, + 12, + 22, + 4, + 6, + 1, + 10, + 5, + 5, + 18, + 23, + 19, + 6, + 14, + 4, + 8, + 20, + 15, + 4, + 4, + 0, + 18, + 8, + 24, + 4, + 7, + 2 + ], + "weighted_loads": [ + 0.4262986518442631, + 0.07843301445245743, + 0.14253831654787064, + 1.1012264806777239, + 0.7648247256875038, + 0.606150321662426, + 0.0, + 0.8170522265136242, + 0.9853343069553375, + 2.1262273974716663, + 0.10700490325689316, + 0.5280799195170403, + 0.1953228898346424, + 1.3707629442214966, + 2.6597001999616623, + 0.34013479202985764, + 0.5601409561932087, + 0.3314511515200138, + 0.8513173609972, + 0.14080916717648506, + 0.6605057064443827, + 0.5863502509891987, + 1.2687561623752117, + 2.423575095832348, + 0.2366855964064598, + 1.3754292018711567, + 0.5340338461101055, + 0.4294909257441759, + 0.8611836321651936, + 0.2590914610773325, + 0.4140574000775814, + 0.0, + 0.07467517629265785, + 0.7990592941641808, + 1.3246396444737911, + 1.5557327438145876, + 0.3416717052459717, + 0.480924304574728, + 0.8006571233272552, + 1.6933348961174488, + 0.17371242120862007, + 0.2658705562353134, + 0.06650709360837936, + 0.47617163322865963, + 0.3244145307689905, + 0.22632459923624992, + 1.1840077079832554, + 1.5143939107656479, + 2.265090972185135, + 0.21190660633146763, + 0.9925106149166822, + 0.18296372704207897, + 0.5973559655249119, + 1.4541912898421288, + 0.5750859640538692, + 0.3225448615849018, + 0.18156471848487854, + 0.0, + 1.2775287739932537, + 0.3311068844050169, + 1.4811263158917427, + 0.14852173998951912, + 0.5982675775885582, + 0.07015207596123219 + ], + "unique_experts": 61, + "load_cv": 0.7161807294458152, + "normalized_load_entropy": 0.9381509104515737, + "max_load_share": 0.05817610062893082 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "8babf30a09a803ccb1a54b21719dce24de1fb1b61e1872d662cad912b99ee759", + "route_weight_sha256": "c9033e30e488a4ce5d83dcdb9b12de22da5599ea088f8c0019129e2caaa8b194", + "loads": [ + 17, + 4, + 6, + 18, + 8, + 12, + 2, + 14, + 16, + 19, + 11, + 9, + 9, + 24, + 37, + 9, + 10, + 14, + 7, + 4, + 16, + 13, + 15, + 21, + 13, + 30, + 19, + 11, + 9, + 6, + 6, + 0, + 9, + 12, + 18, + 17, + 6, + 7, + 17, + 22, + 12, + 9, + 3, + 11, + 5, + 10, + 18, + 23, + 19, + 7, + 16, + 4, + 10, + 22, + 15, + 7, + 4, + 3, + 18, + 9, + 24, + 5, + 13, + 2 + ], + "weighted_loads": [ + 0.7057782765477896, + 0.16429385542869568, + 0.24312607571482658, + 1.6900091040879488, + 0.7648247256875038, + 0.606150321662426, + 0.09668757021427155, + 0.8170522265136242, + 0.9853343069553375, + 2.5152308493852615, + 0.6097868010401726, + 0.5465430971235037, + 0.4508071057498455, + 1.960390504449606, + 2.6597001999616623, + 0.722676120698452, + 0.5601409561932087, + 0.9990377761423588, + 0.949998626485467, + 0.19727200269699097, + 0.9580597449094057, + 0.5863502509891987, + 1.2687561623752117, + 2.730108927935362, + 0.7382312156260014, + 1.966921679675579, + 1.163417611271143, + 0.5214182008057833, + 1.0102460663765669, + 0.2590914610773325, + 0.4140574000775814, + 0.0, + 0.37147185392677784, + 0.7990592941641808, + 1.3246396444737911, + 1.5557327438145876, + 0.3416717052459717, + 0.480924304574728, + 0.9913978520780802, + 1.6933348961174488, + 1.0776509381830692, + 0.3580215461552143, + 0.20961543917655945, + 0.49498537741601467, + 0.3244145307689905, + 1.146440040320158, + 1.1840077079832554, + 1.5143939107656479, + 2.265090972185135, + 0.3637316022068262, + 1.0999632868915796, + 0.18296372704207897, + 0.7811027802526951, + 1.5348188746720552, + 0.5750859640538692, + 0.544462438672781, + 0.18156471848487854, + 0.14466749504208565, + 1.2775287739932537, + 0.37624880485236645, + 1.4811263158917427, + 0.24128186330199242, + 1.0300835967063904, + 0.07015207596123219 + ], + "unique_experts": 63, + "load_cv": 0.5824638131669951, + "normalized_load_entropy": 0.9585680125365876, + "max_load_share": 0.047073791348600506 + } + }, + "s1_bos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "b211070a341c2c0c8b046602835316ae8db7881b7e3c5a8d91c787398b624755", + "route_weight_sha256": "aa7d0f2c2141737add94d5d417ff9069c9428f92c8761925e2f78f509e3d6f42", + "loads": [ + 10, + 1, + 4, + 10, + 8, + 12, + 0, + 14, + 16, + 16, + 2, + 7, + 4, + 16, + 38, + 4, + 10, + 8, + 5, + 3, + 11, + 12, + 16, + 14, + 7, + 22, + 14, + 12, + 4, + 7, + 6, + 0, + 1, + 10, + 20, + 19, + 8, + 7, + 11, + 22, + 4, + 5, + 2, + 10, + 5, + 4, + 19, + 23, + 20, + 5, + 14, + 3, + 8, + 20, + 15, + 4, + 4, + 0, + 18, + 6, + 23, + 4, + 7, + 2 + ], + "weighted_loads": [ + 0.4487729072570801, + 0.035659316927194595, + 0.13543065823614597, + 1.1042594574391842, + 0.755806103348732, + 0.5963479746133089, + 0.0, + 0.8108220007270575, + 0.9809349793940783, + 2.090055637061596, + 0.11105590872466564, + 0.4772167094051838, + 0.15910374745726585, + 1.3551393076777458, + 2.6216071229428053, + 0.3092520609498024, + 0.5612341463565826, + 0.36787961423397064, + 0.8020416554063559, + 0.13489806093275547, + 0.5938642416149378, + 0.5594588872045279, + 1.305474892258644, + 2.396876085549593, + 0.2701391912996769, + 1.3641283754259348, + 0.5745185036212206, + 0.5098837669938803, + 0.8193905763328075, + 0.28113772347569466, + 0.41567532159388065, + 0.0, + 0.03763199225068092, + 0.7285959720611572, + 1.3957888316363096, + 1.6298489347100258, + 0.4000668078660965, + 0.4772790800780058, + 0.7758936155587435, + 1.6717724800109863, + 0.17652452737092972, + 0.22597973607480526, + 0.09796678274869919, + 0.4829043261706829, + 0.3163451962172985, + 0.21023599803447723, + 1.1711549684405327, + 1.497683610767126, + 2.2653320115059614, + 0.16760693490505219, + 0.9937394615262747, + 0.1515466906130314, + 0.5955465883016586, + 1.451210368424654, + 0.5823656618595123, + 0.3247392252087593, + 0.1759786456823349, + 0.0, + 1.2760308012366295, + 0.269192086532712, + 1.4346000142395496, + 0.15241465717554092, + 0.6141481753438711, + 0.074362363666296 + ], + "unique_experts": 61, + "load_cv": 0.7390137826793703, + "normalized_load_entropy": 0.9342701251280983, + "max_load_share": 0.059748427672955975 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "065e3d6fbe5d694048489bcdd66870393116212f55e4799ff0b0741ee044c585", + "route_weight_sha256": "b552f7c9b855bc0beddd6a3b748ab3d79faaa24099cb1725e8902f7fa2499796", + "loads": [ + 17, + 4, + 8, + 16, + 14, + 12, + 3, + 15, + 16, + 24, + 11, + 9, + 6, + 24, + 38, + 12, + 12, + 15, + 8, + 3, + 12, + 13, + 16, + 24, + 16, + 44, + 26, + 14, + 4, + 8, + 8, + 1, + 5, + 10, + 20, + 19, + 12, + 9, + 15, + 23, + 17, + 10, + 5, + 11, + 7, + 10, + 21, + 25, + 20, + 6, + 17, + 9, + 12, + 20, + 16, + 9, + 11, + 11, + 19, + 8, + 24, + 9, + 17, + 2 + ], + "weighted_loads": [ + 0.7522592861205339, + 0.180180873721838, + 0.29713582061231136, + 1.7395528331398964, + 1.1461889389902353, + 0.5963479746133089, + 0.11930635198950768, + 0.8663018885999918, + 0.9809349793940783, + 2.630789939314127, + 0.6673292219638824, + 0.5440477449446917, + 0.2716752626001835, + 1.9761143513023853, + 2.6216071229428053, + 0.8748619742691517, + 0.7312161289155483, + 0.9645426087081432, + 0.9169137701392174, + 0.13489806093275547, + 0.6909969169646502, + 0.6362099107354879, + 1.305474892258644, + 3.095069959759712, + 0.8594975732266903, + 2.9488636776804924, + 1.482011053711176, + 0.6000744421035051, + 0.8193905763328075, + 0.3545528016984463, + 0.5105666536837816, + 0.03952908515930176, + 0.17920446395874023, + 0.7285959720611572, + 1.3957888316363096, + 1.6298489347100258, + 0.6268327757716179, + 0.5501445811241865, + 1.0984385963529348, + 1.7048791982233524, + 1.7529184259474277, + 0.5648270025849342, + 0.2346983179450035, + 0.501718070358038, + 0.5513163693249226, + 1.7111738622188568, + 1.388319656252861, + 1.6293601505458355, + 2.2653320115059614, + 0.21001660078763962, + 1.2365217823535204, + 0.4475330915302038, + 0.8697977513074875, + 1.451210368424654, + 0.670442707836628, + 0.7308383546769619, + 0.7931974492967129, + 0.5942889899015427, + 1.299935471266508, + 0.36358934082090855, + 1.469858281314373, + 0.45589641109108925, + 1.3475215546786785, + 0.074362363666296 + ], + "unique_experts": 64, + "load_cv": 0.5731491571082793, + "normalized_load_entropy": 0.9622872040312177, + "max_load_share": 0.049886621315192746 + } + }, + "s0_x": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "395cae08e37d371fbdefd2d797245faeea391e417de439840d07c9dad4abeb8d", + "route_weight_sha256": "8c010728e6e48e80b71f752ffa1963fef0caf93c28a7e2c67af20df1fa2fc3c7", + "loads": [ + 10, + 4, + 4, + 11, + 8, + 11, + 0, + 15, + 16, + 14, + 2, + 8, + 4, + 16, + 39, + 4, + 10, + 8, + 4, + 3, + 11, + 13, + 15, + 14, + 6, + 22, + 11, + 10, + 5, + 7, + 6, + 0, + 2, + 11, + 18, + 17, + 9, + 9, + 11, + 20, + 4, + 5, + 2, + 9, + 5, + 4, + 19, + 23, + 19, + 6, + 14, + 5, + 8, + 20, + 14, + 4, + 4, + 0, + 18, + 9, + 23, + 4, + 7, + 2 + ], + "weighted_loads": [ + 0.42551259882748127, + 0.14392735064029694, + 0.14339393004775047, + 1.0859674736857414, + 0.7818880453705788, + 0.5719960145652294, + 0.0, + 0.854507852345705, + 0.9850730337202549, + 2.0604556780308485, + 0.10674967430531979, + 0.5418478809297085, + 0.15470819920301437, + 1.356411350890994, + 2.677631814032793, + 0.3033635877072811, + 0.5663883723318577, + 0.3729413654655218, + 0.775050550699234, + 0.13599893450737, + 0.5895062051713467, + 0.5927260331809521, + 1.2487727254629135, + 2.4342703223228455, + 0.2456306405365467, + 1.3675894644111395, + 0.4691010154783726, + 0.44499378465116024, + 0.8699278347194195, + 0.288099804893136, + 0.4116854891180992, + 0.0, + 0.07433343678712845, + 0.7657247148454189, + 1.3164622373878956, + 1.568831853568554, + 0.44320569559931755, + 0.5348389390856028, + 0.7599367648363113, + 1.5873019956052303, + 0.17687413096427917, + 0.21693307720124722, + 0.09649546816945076, + 0.453328475356102, + 0.3179734591394663, + 0.20000844448804855, + 1.1931449547410011, + 1.5112649202346802, + 2.275530118495226, + 0.21325200609862804, + 0.9895977154374123, + 0.20907927863299847, + 0.59701744094491, + 1.4492775052785873, + 0.5639832299202681, + 0.32211679965257645, + 0.17707310989499092, + 0.0, + 1.274947851896286, + 0.3722764905542135, + 1.446129497140646, + 0.15437046065926552, + 0.6077822670340538, + 0.07353848405182362 + ], + "unique_experts": 61, + "load_cv": 0.7130810842591014, + "normalized_load_entropy": 0.9400213068363287, + "max_load_share": 0.06132075471698113 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "e62288b0bb72a0eb7a77145e519b8d56cc904ef6a8e197f0061e5cf9ace07bdd", + "route_weight_sha256": "e1331a2247c78339cec3b4f8bf8d1c07dec738262a4559a1bb40428d527687a8", + "loads": [ + 16, + 5, + 7, + 19, + 8, + 11, + 2, + 15, + 16, + 19, + 11, + 9, + 6, + 25, + 39, + 8, + 10, + 16, + 7, + 3, + 13, + 13, + 15, + 22, + 13, + 31, + 18, + 12, + 9, + 7, + 6, + 0, + 9, + 11, + 18, + 17, + 9, + 9, + 16, + 20, + 11, + 9, + 4, + 10, + 5, + 9, + 19, + 23, + 20, + 6, + 16, + 5, + 10, + 20, + 14, + 9, + 4, + 3, + 18, + 9, + 23, + 5, + 12, + 2 + ], + "weighted_loads": [ + 0.6396498531103134, + 0.1802271008491516, + 0.3092504031956196, + 1.8247080072760582, + 0.7818880453705788, + 0.5719960145652294, + 0.09668757021427155, + 0.854507852345705, + 0.9850730337202549, + 2.4710653368383646, + 0.7235900852829218, + 0.5603110585361719, + 0.2178211659193039, + 1.9842914808541536, + 2.677631814032793, + 0.7136781290173531, + 0.5663883723318577, + 1.0858905483037233, + 0.8688997644931078, + 0.13599893450737, + 0.7903978191316128, + 0.5927260331809521, + 1.2487727254629135, + 2.8055509999394417, + 0.7482038289308548, + 2.029236352071166, + 1.079383585602045, + 0.5369210597127676, + 1.0258099269121885, + 0.288099804893136, + 0.4116854891180992, + 0.0, + 0.37113011442124844, + 0.7657247148454189, + 1.3164622373878956, + 1.568831853568554, + 0.44320569559931755, + 0.5348389390856028, + 0.9589476641267538, + 1.5873019956052303, + 1.0502876192331314, + 0.37122362293303013, + 0.23966559767723083, + 0.47214221954345703, + 0.3179734591394663, + 1.1305241584777832, + 1.1931449547410011, + 1.5112649202346802, + 2.3158247731626034, + 0.21325200609862804, + 1.1231390982866287, + 0.20907927863299847, + 0.7830666415393353, + 1.4492775052785873, + 0.5639832299202681, + 0.6058806777000427, + 0.17707310989499092, + 0.14318760484457016, + 1.274947851896286, + 0.3722764905542135, + 1.446129497140646, + 0.24655737355351448, + 0.9454834274947643, + 0.07353848405182362 + ], + "unique_experts": 63, + "load_cv": 0.586010116222433, + "normalized_load_entropy": 0.9590770355560516, + "max_load_share": 0.04961832061068702 + } + }, + "s1_x": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "84a230dd3c0474f31d4e2dd6edaf0de6b1756e9d9934c6a6b8c6801b9f62a3cb", + "route_weight_sha256": "0c607a2a66ab6b8dbdbd051bb007f15365676023f9a8dfab96aaa3dcd378cb7d", + "loads": [ + 10, + 2, + 4, + 11, + 8, + 12, + 0, + 14, + 16, + 12, + 3, + 9, + 4, + 16, + 39, + 5, + 10, + 11, + 4, + 3, + 11, + 12, + 16, + 14, + 7, + 21, + 12, + 10, + 5, + 9, + 6, + 0, + 1, + 10, + 19, + 19, + 6, + 8, + 12, + 21, + 4, + 4, + 2, + 10, + 4, + 5, + 19, + 23, + 19, + 3, + 14, + 5, + 8, + 20, + 12, + 4, + 5, + 0, + 19, + 6, + 25, + 3, + 8, + 2 + ], + "weighted_loads": [ + 0.440869415178895, + 0.07181917503476143, + 0.1342281512916088, + 1.1164102368056774, + 0.7654362395405769, + 0.5995590817183256, + 0.0, + 0.8399095125496387, + 0.9972985871136189, + 2.085144178941846, + 0.1434459239244461, + 0.5495248101651669, + 0.15592274069786072, + 1.3721006736159325, + 2.642088545486331, + 0.3522188775241375, + 0.564083356410265, + 0.4659447744488716, + 0.7353281006217003, + 0.1316852644085884, + 0.5832882542163134, + 0.5725168026983738, + 1.2583857737481594, + 2.3555721305310726, + 0.2852276973426342, + 1.3824519775807858, + 0.5168532952666283, + 0.42896826565265656, + 0.8560448121279478, + 0.3399394452571869, + 0.395007586106658, + 0.0, + 0.03942759335041046, + 0.734702505171299, + 1.3722630180418491, + 1.656218834221363, + 0.3339029364287853, + 0.4923311769962311, + 0.7925191670656204, + 1.6447517946362495, + 0.18557101860642433, + 0.18633894808590412, + 0.09315245598554611, + 0.4792445953935385, + 0.2897297963500023, + 0.2315287757664919, + 1.1572200525552034, + 1.5083965733647346, + 2.227544739842415, + 0.10872190073132515, + 0.9803044311702251, + 0.20574765466153622, + 0.5938358120620251, + 1.4684675298631191, + 0.4777068104594946, + 0.3356781229376793, + 0.21121004968881607, + 0.0, + 1.3111870996654034, + 0.26775598153471947, + 1.4732971489429474, + 0.12194131314754486, + 0.6197612471878529, + 0.07904709503054619 + ], + "unique_experts": 61, + "load_cv": 0.7319144390527519, + "normalized_load_entropy": 0.9364948818260016, + "max_load_share": 0.06132075471698113 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "658323fff5600278514055ab74a1db7fc9ba21e2d77ef906c88206251142d495", + "route_weight_sha256": "c2926c2db331e86dd3374ff1fb2ec33fd6b19359b47ad29fbf0b7caf9a819357", + "loads": [ + 15, + 3, + 9, + 18, + 14, + 12, + 3, + 15, + 16, + 20, + 13, + 11, + 4, + 25, + 39, + 13, + 12, + 19, + 7, + 3, + 11, + 13, + 16, + 25, + 16, + 44, + 22, + 11, + 5, + 10, + 8, + 1, + 5, + 10, + 19, + 19, + 10, + 10, + 15, + 22, + 16, + 10, + 5, + 11, + 6, + 11, + 21, + 25, + 20, + 3, + 17, + 11, + 12, + 20, + 13, + 11, + 12, + 12, + 21, + 8, + 26, + 9, + 17, + 2 + ], + "weighted_loads": [ + 0.6545152179896832, + 0.11395122855901718, + 0.3631649278104305, + 1.909141220152378, + 1.1558190751820803, + 0.5995590817183256, + 0.11930635198950768, + 0.8953894004225731, + 0.9972985871136189, + 2.5842333789914846, + 0.8500915337353945, + 0.6163558457046747, + 0.15592274069786072, + 2.0552210062742233, + 2.642088545486331, + 0.9222678914666176, + 0.7340653389692307, + 1.1142222434282303, + 0.8495425265282393, + 0.1316852644085884, + 0.5832882542163134, + 0.6492678262293339, + 1.2583857737481594, + 3.096851896494627, + 0.8803661055862904, + 3.022723278030753, + 1.28990207798779, + 0.4680599607527256, + 0.8560448121279478, + 0.4133545234799385, + 0.48989891819655895, + 0.03952908515930176, + 0.18100006505846977, + 0.734702505171299, + 1.3722630180418491, + 1.656218834221363, + 0.5606689043343067, + 0.5651966780424118, + 1.0870140306651592, + 1.6778585128486156, + 1.7345524579286575, + 0.5415107477456331, + 0.23263761028647423, + 0.4980583395808935, + 0.5247009694576263, + 1.5308662634342909, + 1.3743847403675318, + 1.640073113143444, + 2.2674477845430374, + 0.10872190073132515, + 1.24716941639781, + 0.5017340555787086, + 0.8762726075947285, + 1.4684675298631191, + 0.5657838564366102, + 0.8172556404024363, + 0.828428853303194, + 0.6339382193982601, + 1.3838621601462364, + 0.36215323582291603, + 1.5085554160177708, + 0.4592635426670313, + 1.2691045459359884, + 0.07904709503054619 + ], + "unique_experts": 64, + "load_cv": 0.576012817733337, + "normalized_load_entropy": 0.9614237838553763, + "max_load_share": 0.049886621315192746 + } + }, + "s0_period": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "546db3822e625a9253c3d8b0ddc9c15f6777d1143af41ef851e6285fdee11443", + "route_weight_sha256": "5ffc6f55a6084fa5f0038c4a39ed24638a2c64f3900773fd2c9d905bfa6eb4b1", + "loads": [ + 8, + 2, + 4, + 11, + 8, + 12, + 0, + 15, + 16, + 13, + 2, + 8, + 5, + 16, + 40, + 4, + 10, + 9, + 4, + 3, + 11, + 13, + 16, + 14, + 6, + 20, + 13, + 10, + 5, + 6, + 7, + 0, + 2, + 10, + 19, + 17, + 7, + 8, + 11, + 21, + 4, + 5, + 3, + 9, + 5, + 5, + 19, + 23, + 19, + 4, + 14, + 5, + 8, + 20, + 15, + 4, + 4, + 0, + 18, + 8, + 25, + 4, + 7, + 2 + ], + "weighted_loads": [ + 0.3673657812178135, + 0.0762600228190422, + 0.14411437883973122, + 1.08705610409379, + 0.7631188333034515, + 0.6088507305830717, + 0.0, + 0.8480915855616331, + 0.989546712487936, + 2.0490028709173203, + 0.10056607238948345, + 0.5279521755874157, + 0.1936203744262457, + 1.3519697412848473, + 2.691842233762145, + 0.2992994450032711, + 0.556256290525198, + 0.4119262732565403, + 0.7716056816279888, + 0.13917412981390953, + 0.5838432237505913, + 0.5983452405780554, + 1.2862444706261158, + 2.433174354955554, + 0.24938764423131943, + 1.2695221826434135, + 0.5360390450805426, + 0.4478063229471445, + 0.8976362962275743, + 0.26272224821150303, + 0.4261124972254038, + 0.0, + 0.07574154064059258, + 0.7393353916704655, + 1.3514804020524025, + 1.5616435371339321, + 0.3804969973862171, + 0.5188370030373335, + 0.7733177468180656, + 1.6185142882168293, + 0.1770189069211483, + 0.2138531655073166, + 0.1333308257162571, + 0.4601166136562824, + 0.32060488872230053, + 0.22853603214025497, + 1.194201335310936, + 1.497522396966815, + 2.2628338411450386, + 0.1502854861319065, + 0.9850085657089949, + 0.20356438867747784, + 0.5892509333789349, + 1.4306046292185783, + 0.5974194053560495, + 0.32064491510391235, + 0.18111543729901314, + 0.0, + 1.2720276527106762, + 0.33195479959249496, + 1.4979081600904465, + 0.15020747482776642, + 0.6143682226538658, + 0.07577589899301529 + ], + "unique_experts": 61, + "load_cv": 0.7303996466614715, + "normalized_load_entropy": 0.9378973316435734, + "max_load_share": 0.06289308176100629 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "9b702251e2280f92442928a8dd0efcab3e7f9a92bf7626e22830dbd5c8e276d3", + "route_weight_sha256": "96d86c1e0263ae85d9a79f4eae7831b0e5a217dd5102d0450aa9b41558f69f4c", + "loads": [ + 14, + 3, + 7, + 19, + 8, + 12, + 2, + 15, + 16, + 17, + 10, + 9, + 7, + 24, + 40, + 8, + 10, + 16, + 7, + 3, + 14, + 13, + 16, + 21, + 13, + 30, + 20, + 13, + 9, + 6, + 7, + 0, + 10, + 10, + 19, + 17, + 7, + 8, + 15, + 21, + 11, + 9, + 6, + 10, + 5, + 10, + 19, + 23, + 19, + 4, + 16, + 5, + 10, + 20, + 15, + 10, + 4, + 4, + 18, + 8, + 25, + 5, + 12, + 2 + ], + "weighted_loads": [ + 0.5820901188999414, + 0.11255977302789688, + 0.308971356600523, + 1.719374556094408, + 0.7631188333034515, + 0.6088507305830717, + 0.09668757021427155, + 0.8480915855616331, + 0.989546712487936, + 2.4277536682784557, + 0.5667548980563879, + 0.5464153531938791, + 0.2567333411425352, + 1.9415973015129566, + 2.691842233762145, + 0.7017649859189987, + 0.556256290525198, + 1.0795128978788853, + 0.8675311300903559, + 0.13917412981390953, + 0.8345072865486145, + 0.5983452405780554, + 1.2862444706261158, + 2.7461958546191454, + 0.753622230142355, + 1.9580595679581165, + 1.146086622029543, + 0.5749101657420397, + 1.0528775602579117, + 0.26272224821150303, + 0.4261124972254038, + 0.0, + 0.4118636604398489, + 0.7393353916704655, + 1.3514804020524025, + 1.5616435371339321, + 0.3804969973862171, + 0.5188370030373335, + 0.9337459001690149, + 1.6185142882168293, + 1.0413334257900715, + 0.380766823887825, + 0.32150693237781525, + 0.47893035784363747, + 0.32060488872230053, + 1.2206290531903505, + 1.194201335310936, + 1.497522396966815, + 2.2628338411450386, + 0.1502854861319065, + 1.1218018364161253, + 0.20356438867747784, + 0.7774601243436337, + 1.4306046292185783, + 0.5974194053560495, + 0.7912142258137465, + 0.18111543729901314, + 0.18775947019457817, + 1.2720276527106762, + 0.33195479959249496, + 1.4979081600904465, + 0.24264170974493027, + 0.9586855508387089, + 0.07577589899301529 + ], + "unique_experts": 63, + "load_cv": 0.5914648666212721, + "normalized_load_entropy": 0.9583919629707557, + "max_load_share": 0.05089058524173028 + } + }, + "s1_period": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "0bf971fbd499fb3e96240b5d6682885f86e57a896c075f068a03604c3d94941d", + "route_weight_sha256": "937e2a553b90faf17c4444b321ff3081ffc842272c14bf39fcdcca08e8d68fe1", + "loads": [ + 10, + 1, + 3, + 11, + 8, + 11, + 0, + 15, + 16, + 12, + 3, + 8, + 4, + 16, + 39, + 6, + 10, + 10, + 4, + 3, + 12, + 14, + 15, + 14, + 6, + 22, + 12, + 8, + 4, + 7, + 7, + 0, + 1, + 10, + 19, + 19, + 8, + 8, + 11, + 21, + 4, + 4, + 3, + 11, + 6, + 4, + 20, + 23, + 20, + 4, + 14, + 4, + 8, + 20, + 11, + 4, + 5, + 0, + 18, + 7, + 25, + 3, + 8, + 2 + ], + "weighted_loads": [ + 0.44780577160418034, + 0.035558249801397324, + 0.10630624368786812, + 1.1080794986337423, + 0.7609725743532181, + 0.5658175200223923, + 0.0, + 0.8685513827949762, + 0.9847955331206322, + 2.050467735156417, + 0.14464434795081615, + 0.5243829302489758, + 0.1618676707148552, + 1.3721698466688395, + 2.6500512938946486, + 0.38477833941578865, + 0.5616861060261726, + 0.43926207534968853, + 0.780430905520916, + 0.13225086778402328, + 0.6052825469523668, + 0.6238969005644321, + 1.235183421522379, + 2.3753645587712526, + 0.2475414089858532, + 1.4103487338870764, + 0.5235910005867481, + 0.3709139693528414, + 0.8308824934065342, + 0.27226679399609566, + 0.43006363324820995, + 0.0, + 0.038044992834329605, + 0.7388191521167755, + 1.3825933560729027, + 1.6763939820230007, + 0.4002339653670788, + 0.4952064696699381, + 0.7734991759061813, + 1.6526506766676903, + 0.1839056797325611, + 0.18451940827071667, + 0.1301414966583252, + 0.5204450227320194, + 0.3490237928926945, + 0.20680980756878853, + 1.187376556918025, + 1.5158018674701452, + 2.2586983740329742, + 0.12928521074354649, + 0.9890113975852728, + 0.17651150189340115, + 0.5994347333908081, + 1.4437889494001865, + 0.42637814208865166, + 0.3350754603743553, + 0.21314000710844994, + 0.0, + 1.2851357348263264, + 0.30733751878142357, + 1.487300081178546, + 0.11898713186383247, + 0.6205509174615145, + 0.08033925667405128 + ], + "unique_experts": 61, + "load_cv": 0.7372990068898084, + "normalized_load_entropy": 0.9356380520887008, + "max_load_share": 0.06132075471698113 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "02493126581604c4d030f9a53e20cdbf75cfcb33cd79b0b97e81d18823257920", + "route_weight_sha256": "80bb7ce0e8b2be6dc7c6ab7fcc8a24dc30fecda451756a3250a2a697a39672af", + "loads": [ + 15, + 2, + 8, + 18, + 14, + 11, + 3, + 16, + 16, + 19, + 12, + 10, + 4, + 24, + 39, + 14, + 12, + 17, + 6, + 3, + 12, + 15, + 15, + 24, + 16, + 46, + 24, + 9, + 5, + 8, + 9, + 1, + 5, + 10, + 19, + 19, + 12, + 10, + 14, + 22, + 17, + 10, + 8, + 12, + 8, + 10, + 22, + 25, + 20, + 4, + 17, + 10, + 13, + 20, + 12, + 11, + 12, + 13, + 19, + 9, + 26, + 8, + 16, + 2 + ], + "weighted_loads": [ + 0.6614515744149685, + 0.07769030332565308, + 0.31000207737088203, + 1.8008546996861696, + 1.1513554099947214, + 0.5658175200223923, + 0.11930635198950768, + 0.9240312706679106, + 0.9847955331206322, + 2.526193207129836, + 0.7024180591106415, + 0.5912139657884836, + 0.1618676707148552, + 1.993144890293479, + 2.6500512938946486, + 0.9785283915698528, + 0.7316680885851383, + 1.0359250698238611, + 0.8459063787013292, + 0.13225086778402328, + 0.6052825469523668, + 0.7006479240953922, + 1.235183421522379, + 3.076866490766406, + 0.8816279694437981, + 3.1153836883604527, + 1.3644560929387808, + 0.4100056644529104, + 0.8612850699573755, + 0.3456818722188473, + 0.5249549653381109, + 0.03952908515930176, + 0.17961746454238892, + 0.7388191521167755, + 1.3825933560729027, + 1.6763939820230007, + 0.6269999332726002, + 0.5680719707161188, + 1.0679940395057201, + 1.6857573948800564, + 1.7723067067563534, + 0.5534438453614712, + 0.34502948448061943, + 0.5392587669193745, + 0.5839949660003185, + 1.7094676904380322, + 1.4045412447303534, + 1.6474784072488546, + 2.2586983740329742, + 0.12928521074354649, + 1.2273296620696783, + 0.4724979028105736, + 0.9099576845765114, + 1.4437889494001865, + 0.5144551880657673, + 0.958265196532011, + 0.8303588107228279, + 0.7028769962489605, + 1.309040404856205, + 0.40173477306962013, + 1.5225583482533693, + 0.4276779368519783, + 1.1820568293333054, + 0.08033925667405128 + ], + "unique_experts": 64, + "load_cv": 0.5805652952353996, + "normalized_load_entropy": 0.9613826805124274, + "max_load_share": 0.05215419501133787 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 106, + "ordered_topk_exact_tokens": 68, + "set_exact_tokens": 83, + "mean_set_jaccard": 0.9380053908355797, + "mean_token_weighted_tv": 0.013010689206772818, + "aggregate_load_tv": 0.023584905660377357 + }, + "system_bos": { + "tokens": 106, + "ordered_topk_exact_tokens": 55, + "set_exact_tokens": 71, + "mean_set_jaccard": 0.8995956873315364, + "mean_token_weighted_tv": 0.02005728376361559, + "aggregate_load_tv": 0.03144654088050314 + }, + "system_x": { + "tokens": 106, + "ordered_topk_exact_tokens": 47, + "set_exact_tokens": 72, + "mean_set_jaccard": 0.9043126684636119, + "mean_token_weighted_tv": 0.020460693121729594, + "aggregate_load_tv": 0.037735849056603765 + }, + "system_period": { + "tokens": 106, + "ordered_topk_exact_tokens": 61, + "set_exact_tokens": 73, + "mean_set_jaccard": 0.898921832884097, + "mean_token_weighted_tv": 0.021149663764210243, + "aggregate_load_tv": 0.033018867924528295 + }, + "bos_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 55, + "set_exact_tokens": 67, + "mean_set_jaccard": 0.8847708894878705, + "mean_token_weighted_tv": 0.022505468838268292, + "aggregate_load_tv": 0.04245283018867925 + }, + "bos_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 54, + "set_exact_tokens": 70, + "mean_set_jaccard": 0.8928571428571428, + "mean_token_weighted_tv": 0.022318104123872407, + "aggregate_load_tv": 0.03459119496855346 + }, + "x_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 55, + "set_exact_tokens": 66, + "mean_set_jaccard": 0.8845462713387241, + "mean_token_weighted_tv": 0.022796341560710715, + "aggregate_load_tv": 0.04088050314465408 + }, + "x_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 56, + "set_exact_tokens": 71, + "mean_set_jaccard": 0.8955525606469003, + "mean_token_weighted_tv": 0.02314842872778481, + "aggregate_load_tv": 0.03930817610062892 + }, + "period_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 50, + "set_exact_tokens": 70, + "mean_set_jaccard": 0.896900269541779, + "mean_token_weighted_tv": 0.020647590479128203, + "aggregate_load_tv": 0.04245283018867924 + }, + "period_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 53, + "set_exact_tokens": 72, + "mean_set_jaccard": 0.8942048517520216, + "mean_token_weighted_tv": 0.02307763405776811, + "aggregate_load_tv": 0.03616352201257861 + } + } + }, + "layer_18": { + "layer": 18, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "719343bd5183cc03b2385ab653c0a6ea9630ae2b3c7cfdbe4e79b05a6bc21228", + "route_weight_sha256": "eaacee0d89b6f0ab83bcdab05954371737403172568fe745389f7eeec86e31ea", + "loads": [ + 2, + 3, + 7, + 2, + 62, + 10, + 2, + 19, + 3, + 0, + 8, + 12, + 17, + 10, + 14, + 2, + 20, + 8, + 1, + 7, + 18, + 0, + 8, + 28, + 12, + 3, + 17, + 7, + 11, + 5, + 3, + 3, + 9, + 5, + 2, + 3, + 12, + 4, + 11, + 0, + 5, + 6, + 30, + 3, + 7, + 23, + 4, + 24, + 9, + 10, + 10, + 3, + 10, + 4, + 13, + 10, + 18, + 5, + 15, + 8, + 5, + 4, + 38, + 2 + ], + "weighted_loads": [ + 0.0855637788772583, + 0.20228518173098564, + 0.541903343051672, + 0.07408379018306732, + 4.145492278039455, + 0.5577927827835083, + 0.06591863743960857, + 1.5271106977015734, + 0.1591414473950863, + 0.0, + 0.667643815279007, + 0.7423409186303616, + 0.841460082679987, + 0.6525557301938534, + 0.8193204365670681, + 0.06128275580704212, + 1.3282616399228573, + 0.3066416699439287, + 0.04808256775140762, + 0.5392465218901634, + 1.211766904219985, + 0.0, + 0.9114716276526451, + 1.579757645726204, + 0.7807842269539833, + 0.14924574829638004, + 0.9130567461252213, + 0.34170834720134735, + 1.004286378622055, + 0.35381216183304787, + 0.1340434905141592, + 0.15295368060469627, + 0.6062404550611973, + 0.20778263360261917, + 0.07727237790822983, + 0.14204297959804535, + 0.47477827966213226, + 0.1434656959027052, + 0.5754496976733208, + 0.0, + 0.28506945446133614, + 0.29611479490995407, + 1.7963515780866146, + 0.2690289169549942, + 0.25739845633506775, + 1.8330047465860844, + 0.2053482048213482, + 1.5500134192407131, + 0.3261201623827219, + 0.4519216399639845, + 0.6633655112236738, + 0.2128559947013855, + 0.7885811850428581, + 0.1669740453362465, + 0.5464091990143061, + 0.8186880871653557, + 0.7561683636158705, + 0.48014264553785324, + 2.9945940263569355, + 0.817337054759264, + 0.19916658475995064, + 0.1227355133742094, + 2.3437573295086622, + 0.11404164135456085 + ], + "unique_experts": 61, + "load_cv": 1.017527653293298, + "normalized_load_entropy": 0.9042250262213114, + "max_load_share": 0.09748427672955975 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "bc1c48ffa6e07c31f721da7df4c21b44aee9198c24cccabfc21b4ec7b4104c26", + "route_weight_sha256": "7dff02dee7a1b0392d9b44e9a408a7525e7c97a433d473d8c6ae709a0f417198", + "loads": [ + 9, + 4, + 20, + 2, + 62, + 12, + 2, + 19, + 11, + 0, + 9, + 17, + 17, + 10, + 19, + 6, + 20, + 8, + 18, + 7, + 18, + 1, + 8, + 30, + 12, + 4, + 17, + 7, + 11, + 5, + 10, + 3, + 10, + 5, + 2, + 6, + 14, + 6, + 11, + 3, + 9, + 6, + 34, + 3, + 7, + 23, + 11, + 24, + 11, + 21, + 13, + 5, + 19, + 12, + 13, + 10, + 20, + 6, + 17, + 12, + 5, + 8, + 38, + 4 + ], + "weighted_loads": [ + 0.5069068111479282, + 0.27801109477877617, + 1.6694326847791672, + 0.07408379018306732, + 4.145492278039455, + 0.6068177986890078, + 0.06591863743960857, + 1.5271106977015734, + 0.6446660347282887, + 0.0, + 0.6786159742623568, + 1.2057046294212341, + 0.841460082679987, + 0.6525557301938534, + 1.7338814865797758, + 0.18937602825462818, + 1.3282616399228573, + 0.3066416699439287, + 1.1365978829562664, + 0.5392465218901634, + 1.211766904219985, + 0.024969439953565598, + 0.9114716276526451, + 1.6628217287361622, + 0.7807842269539833, + 0.18002566695213318, + 0.9130567461252213, + 0.34170834720134735, + 1.004286378622055, + 0.35381216183304787, + 0.42170657124370337, + 0.15295368060469627, + 0.6342797446995974, + 0.20778263360261917, + 0.07727237790822983, + 0.3779478371143341, + 0.5852895453572273, + 0.20370969362556934, + 0.5754496976733208, + 0.07513235323131084, + 0.4860691986978054, + 0.29611479490995407, + 1.9106545876711607, + 0.2690289169549942, + 0.25739845633506775, + 1.8330047465860844, + 1.9293557368218899, + 1.5500134192407131, + 0.4357250723987818, + 0.9381442833691835, + 0.8416365012526512, + 0.40189630538225174, + 1.3906442057341337, + 0.7177206575870514, + 0.5464091990143061, + 0.8186880871653557, + 1.7542841415852308, + 0.5238568261265755, + 3.0868225749582052, + 0.9446948654949665, + 0.19916658475995064, + 0.23333646170794964, + 2.3437573295086622, + 0.2079588659107685 + ], + "unique_experts": 63, + "load_cv": 0.8135453381321874, + "normalized_load_entropy": 0.9342502381646628, + "max_load_share": 0.07888040712468193 + } + }, + "s1_eos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "69245321be4545d12d197a561026a610ab77c02808943d573469e00d5a66bc5a", + "route_weight_sha256": "14f138145d3253dcda433d5099502d75780725aaa11b39119765fcb55d28a4fb", + "loads": [ + 2, + 3, + 9, + 3, + 62, + 10, + 2, + 19, + 3, + 0, + 8, + 12, + 16, + 11, + 15, + 2, + 20, + 8, + 1, + 7, + 18, + 0, + 8, + 27, + 12, + 3, + 17, + 7, + 10, + 5, + 7, + 3, + 7, + 5, + 2, + 3, + 14, + 4, + 10, + 0, + 5, + 6, + 29, + 3, + 6, + 24, + 4, + 24, + 9, + 9, + 9, + 3, + 10, + 3, + 12, + 11, + 19, + 5, + 15, + 8, + 5, + 3, + 36, + 3 + ], + "weighted_loads": [ + 0.0797506757080555, + 0.19455205276608467, + 0.6152935940772295, + 0.10164200887084007, + 4.1914605461061, + 0.5571393650025129, + 0.062974339351058, + 1.5296922028064728, + 0.15683425962924957, + 0.0, + 0.6737153567373753, + 0.7527240812778473, + 0.8105000890791416, + 0.6875172164291143, + 0.857277974486351, + 0.06249934248626232, + 1.333743367344141, + 0.3126393109560013, + 0.047154299914836884, + 0.5395128279924393, + 1.2249676324427128, + 0.0, + 0.91094109416008, + 1.5729957893490791, + 0.7823463417589664, + 0.15030448511242867, + 0.8922303654253483, + 0.34514718875288963, + 0.9768303763121367, + 0.35382817685604095, + 0.2454170137643814, + 0.15371961519122124, + 0.5501959938555956, + 0.204091377556324, + 0.07701568678021431, + 0.13993915170431137, + 0.5443425178527832, + 0.14220515824854374, + 0.5455564521253109, + 0.0, + 0.2763730622828007, + 0.2894793339073658, + 1.7607581727206707, + 0.2601664774119854, + 0.22299351543188095, + 1.8568642679601908, + 0.2001427225768566, + 1.5844244342297316, + 0.31892475858330727, + 0.41269972175359726, + 0.6523682754486799, + 0.216224804520607, + 0.7780262492597103, + 0.1353549137711525, + 0.5045480616390705, + 0.822657011449337, + 0.7692142613232136, + 0.4811401106417179, + 2.969609320163727, + 0.8231286313384771, + 0.1992359608411789, + 0.0917718205600977, + 2.2756654918193817, + 0.1539573147892952 + ], + "unique_experts": 61, + "load_cv": 1.004223508502698, + "normalized_load_entropy": 0.9065307762302621, + "max_load_share": 0.09748427672955975 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "9e38e447db6297fe6aa9effe7e33e9cce82e09c63b5a8c5cc99dc35305ec566d", + "route_weight_sha256": "8a3abb84ff07b86187d0ae26504649c6fc9873316ef43640d5be7bd416576df2", + "loads": [ + 10, + 6, + 23, + 3, + 63, + 13, + 2, + 21, + 13, + 2, + 9, + 17, + 16, + 12, + 24, + 3, + 20, + 17, + 24, + 8, + 18, + 1, + 9, + 28, + 12, + 3, + 17, + 7, + 10, + 6, + 17, + 5, + 8, + 6, + 6, + 18, + 16, + 9, + 11, + 2, + 11, + 6, + 32, + 8, + 6, + 24, + 21, + 28, + 12, + 23, + 11, + 5, + 19, + 15, + 14, + 12, + 22, + 11, + 19, + 12, + 5, + 6, + 36, + 9 + ], + "weighted_loads": [ + 0.514115460216999, + 0.33314212784171104, + 1.769347433000803, + 0.10164200887084007, + 4.22953012958169, + 0.6456272657960653, + 0.062974339351058, + 1.599061019718647, + 1.018032293766737, + 0.0627104826271534, + 0.6855366798117757, + 1.2025042958557606, + 0.8105000890791416, + 0.729355214163661, + 1.9304942451417446, + 0.09618852101266384, + 1.333743367344141, + 0.8773244582116604, + 1.9432193730026484, + 0.6746792644262314, + 1.2249676324427128, + 0.025896336883306503, + 0.9463110826909542, + 1.6121071130037308, + 0.7823463417589664, + 0.15030448511242867, + 0.8922303654253483, + 0.34514718875288963, + 0.9768303763121367, + 0.38996945321559906, + 0.803459002636373, + 0.3976120240986347, + 0.6054191049188375, + 0.27990737557411194, + 0.5018039457499981, + 1.5116178710013628, + 0.6518404949456453, + 0.3665090147405863, + 0.5824099481105804, + 0.047740740701556206, + 0.523665513843298, + 0.2894793339073658, + 1.8556050285696983, + 0.71987733989954, + 0.22299351543188095, + 1.8568642679601908, + 3.0362121872603893, + 1.7639373745769262, + 0.41586667858064175, + 1.0095916241407394, + 0.7917676288634539, + 0.39573971927165985, + 1.3701730463653803, + 0.8342128060758114, + 0.6260292157530785, + 0.8581997565925121, + 1.7773139849305153, + 0.7564168013632298, + 3.3846624828875065, + 1.0797122325748205, + 0.1992359608411789, + 0.18582457304000854, + 2.2756654918193817, + 0.38499978743493557 + ], + "unique_experts": 64, + "load_cv": 0.7248826999998742, + "normalized_load_entropy": 0.945226702137035, + "max_load_share": 0.07142857142857142 + } + }, + "s0_bos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "783d10d51186457c100638ea35f752e58ce00d97a98e808cedf596d113a2d3df", + "route_weight_sha256": "20727efef2fc5839d0cb43813c89aabd8883f60e38536998e543299c00a20481", + "loads": [ + 2, + 4, + 6, + 4, + 61, + 9, + 1, + 19, + 3, + 0, + 8, + 11, + 17, + 11, + 15, + 2, + 21, + 7, + 0, + 7, + 18, + 0, + 8, + 30, + 11, + 3, + 18, + 7, + 10, + 5, + 7, + 3, + 8, + 5, + 2, + 3, + 15, + 3, + 9, + 0, + 5, + 6, + 30, + 3, + 7, + 24, + 4, + 26, + 7, + 9, + 10, + 3, + 9, + 3, + 13, + 10, + 16, + 5, + 15, + 7, + 7, + 3, + 38, + 3 + ], + "weighted_loads": [ + 0.09255807660520077, + 0.2108680121600628, + 0.5231265127658844, + 0.13515943847596645, + 4.108332064002752, + 0.5362662188708782, + 0.023266881704330444, + 1.5609436109662056, + 0.16498884186148643, + 0.0, + 0.6744470223784447, + 0.6986191608011723, + 0.8661200646311045, + 0.6770367454737425, + 0.8503349646925926, + 0.06296518445014954, + 1.3809323348104954, + 0.2737099379301071, + 0.0, + 0.5337982513010502, + 1.1964129116386175, + 0.0, + 0.8889065571129322, + 1.7344836592674255, + 0.72565608471632, + 0.14811266027390957, + 0.9591575171798468, + 0.346519585698843, + 1.0447838138788939, + 0.35991641506552696, + 0.24618981964886189, + 0.1500355564057827, + 0.5685793831944466, + 0.20484098605811596, + 0.08031845465302467, + 0.13838618993759155, + 0.5769334807991982, + 0.11350107192993164, + 0.5052783619612455, + 0.0, + 0.297849353402853, + 0.30366721376776695, + 1.8104069586843252, + 0.25849610567092896, + 0.2579798046499491, + 1.925009785220027, + 0.18823211640119553, + 1.6622120812535286, + 0.2613156232982874, + 0.4329619389027357, + 0.7017090581357479, + 0.2147403210401535, + 0.7261473834514618, + 0.12996701523661613, + 0.55734583735466, + 0.8093733042478561, + 0.6754265073686838, + 0.4819943346083164, + 2.928010229021311, + 0.8138257637619972, + 0.2626882903277874, + 0.09738410264253616, + 2.3493764977902174, + 0.15173009224236012 + ], + "unique_experts": 60, + "load_cv": 1.02419216063171, + "normalized_load_entropy": 0.902124965679024, + "max_load_share": 0.0959119496855346 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "89e15aaa76618b4919b8f66a317703990f9fcdfff737911ec9c90df8920dd774", + "route_weight_sha256": "5c3392076ac419c3224513ff56ec02414e4a551fc2cdbffd620343438432cb52", + "loads": [ + 8, + 5, + 18, + 4, + 61, + 12, + 1, + 19, + 11, + 0, + 8, + 15, + 18, + 11, + 20, + 5, + 21, + 7, + 19, + 7, + 18, + 1, + 8, + 33, + 11, + 4, + 19, + 7, + 10, + 5, + 13, + 3, + 9, + 5, + 2, + 7, + 16, + 5, + 9, + 3, + 11, + 7, + 35, + 3, + 7, + 24, + 12, + 26, + 9, + 19, + 12, + 5, + 18, + 11, + 13, + 10, + 17, + 6, + 17, + 10, + 7, + 6, + 38, + 5 + ], + "weighted_loads": [ + 0.47644328884780407, + 0.2865939252078533, + 1.6242549307644367, + 0.13515943847596645, + 4.108332064002752, + 0.6103144399821758, + 0.023266881704330444, + 1.5609436109662056, + 0.6505134291946888, + 0.0, + 0.6744470223784447, + 1.0372221432626247, + 1.0426982883363962, + 0.6770367454737425, + 1.643398316577077, + 0.15812227874994278, + 1.3809323348104954, + 0.2737099379301071, + 1.1312345396727324, + 0.5337982513010502, + 1.1964129116386175, + 0.024969439953565598, + 0.8889065571129322, + 1.8686829805374146, + 0.72565608471632, + 0.17934979870915413, + 1.0083097238093615, + 0.346519585698843, + 1.0447838138788939, + 0.35991641506552696, + 0.5598151925951242, + 0.1500355564057827, + 0.6045460216701031, + 0.20484098605811596, + 0.08031845465302467, + 0.40535006672143936, + 0.6676194742321968, + 0.1737450696527958, + 0.5052783619612455, + 0.1444559581577778, + 0.5887108631432056, + 0.3699682615697384, + 1.9905789718031883, + 0.25849610567092896, + 0.2579798046499491, + 1.925009785220027, + 1.9326514229178429, + 1.6622120812535286, + 0.37092053331434727, + 0.8703395929187536, + 0.8471653517335653, + 0.40186716616153717, + 1.3282104041427374, + 0.6517097689211369, + 0.55734583735466, + 0.8093733042478561, + 0.8985367063432932, + 0.5242297053337097, + 3.0180899631232023, + 0.9713178128004074, + 0.2626882903277874, + 0.18224560655653477, + 2.3493764977902174, + 0.24564731679856777 + ], + "unique_experts": 63, + "load_cv": 0.8195083034733079, + "normalized_load_entropy": 0.9335000416430502, + "max_load_share": 0.07760814249363868 + } + }, + "s1_bos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "6ca59e01e015099bed57107fac057147f114b374d2ccc3d0322d542f81d1bb84", + "route_weight_sha256": "5a4738aaa7197eb0120c7544b15183df26718dd12aedc22ba8d16f224ed6483a", + "loads": [ + 2, + 4, + 6, + 3, + 63, + 9, + 0, + 19, + 3, + 0, + 8, + 11, + 18, + 10, + 14, + 1, + 20, + 8, + 1, + 7, + 18, + 0, + 8, + 26, + 10, + 3, + 18, + 7, + 10, + 5, + 6, + 3, + 8, + 4, + 2, + 4, + 14, + 3, + 11, + 0, + 5, + 8, + 33, + 3, + 8, + 23, + 4, + 23, + 9, + 10, + 9, + 4, + 9, + 2, + 14, + 11, + 18, + 5, + 15, + 8, + 6, + 2, + 38, + 2 + ], + "weighted_loads": [ + 0.09103438816964626, + 0.1941378116607666, + 0.49019936099648476, + 0.10185081139206886, + 4.162478178739548, + 0.5343818664550781, + 0.0, + 1.5483862534165382, + 0.1609867960214615, + 0.0, + 0.6585879623889923, + 0.7097636386752129, + 0.9071228783577681, + 0.6331240776926279, + 0.8196247406303883, + 0.031861625611782074, + 1.3532640226185322, + 0.30647691152989864, + 0.04319576546549797, + 0.5291838757693768, + 1.225822465494275, + 0.0, + 0.894106961786747, + 1.5270980335772038, + 0.6883571036159992, + 0.1530013494193554, + 0.9588694963604212, + 0.3397570475935936, + 1.0369153060019016, + 0.35237008333206177, + 0.2137121744453907, + 0.14550607651472092, + 0.5776116084307432, + 0.17052283510565758, + 0.0874035619199276, + 0.185535728931427, + 0.5462103374302387, + 0.10426026023924351, + 0.5551834013313055, + 0.0, + 0.2814820185303688, + 0.36238331720232964, + 1.898943429812789, + 0.2615172155201435, + 0.2921703830361366, + 1.887320403009653, + 0.19375735893845558, + 1.5574783328920603, + 0.3214017543941736, + 0.45726615749299526, + 0.6434270776808262, + 0.2511620260775089, + 0.7476398982107639, + 0.09180035069584846, + 0.564633809030056, + 0.8338799756020308, + 0.731130039319396, + 0.4847659096121788, + 2.9397126026451588, + 0.8303468301892281, + 0.21971064247190952, + 0.06850424222648144, + 2.3262785989791155, + 0.09719303622841835 + ], + "unique_experts": 60, + "load_cv": 1.034031887967891, + "normalized_load_entropy": 0.9004195839209338, + "max_load_share": 0.09905660377358491 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "3565636ffd82f6a8a4fb5887b002b79c88a6a12058dcc6c7f6c6c558acb48d63", + "route_weight_sha256": "cb09b96ac72e4cf0e747cb3596370d7b1eb6280944d4bfcf794e84afdee125fe", + "loads": [ + 9, + 7, + 18, + 3, + 64, + 12, + 0, + 21, + 13, + 2, + 8, + 16, + 18, + 11, + 23, + 3, + 20, + 17, + 24, + 8, + 18, + 1, + 9, + 27, + 10, + 3, + 18, + 7, + 10, + 6, + 15, + 5, + 10, + 5, + 6, + 18, + 15, + 8, + 12, + 2, + 11, + 9, + 37, + 8, + 8, + 23, + 22, + 27, + 12, + 24, + 11, + 6, + 18, + 14, + 16, + 12, + 20, + 12, + 19, + 12, + 6, + 6, + 38, + 9 + ], + "weighted_loads": [ + 0.4898811485618353, + 0.332727886736393, + 1.5805921033024788, + 0.10185081139206886, + 4.2005477622151375, + 0.6228697672486305, + 0.0, + 1.6177550703287125, + 1.022184830158949, + 0.0627104826271534, + 0.6585879623889923, + 1.1396057642996311, + 0.9071228783577681, + 0.6749620754271746, + 1.930709220468998, + 0.09826995432376862, + 1.3532640226185322, + 0.8711620587855577, + 1.950479008257389, + 0.6643503122031689, + 1.225822465494275, + 0.025896336883306503, + 0.9294769503176212, + 1.565936353057623, + 0.6883571036159992, + 0.1530013494193554, + 0.9588694963604212, + 0.3397570475935936, + 1.0369153060019016, + 0.3885113596916199, + 0.7988528534770012, + 0.3893984854221344, + 0.6663257647305727, + 0.2463388331234455, + 0.5121918208897114, + 1.5031968019902706, + 0.6355725713074207, + 0.32856411673128605, + 0.592036897316575, + 0.047740740701556206, + 0.5423116572201252, + 0.4104446545243263, + 2.050883600488305, + 0.7212280780076981, + 0.2921703830361366, + 1.887320403009653, + 2.991661559790373, + 1.736991273239255, + 0.4183436743915081, + 1.0701203737407923, + 0.7896226793527603, + 0.4300638996064663, + 1.339786695316434, + 0.7616838701069355, + 0.686114963144064, + 0.8694227207452059, + 0.9884453658014536, + 0.7974729090929031, + 3.3574453741312027, + 1.1590387299656868, + 0.21971064247190952, + 0.20970244519412518, + 2.3262785989791155, + 0.3616856802254915 + ], + "unique_experts": 63, + "load_cv": 0.7370381958993796, + "normalized_load_entropy": 0.9437213501987941, + "max_load_share": 0.07256235827664399 + } + }, + "s0_x": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "108da8589ca07d93030e341c9660bf564529769a17a4cf31cccf070bdff9d8c6", + "route_weight_sha256": "d82e5df4b926aa651f3e7fc47e096314dc14e05d4b4e884c1996127a6f48ed1b", + "loads": [ + 2, + 4, + 6, + 2, + 62, + 9, + 0, + 19, + 3, + 0, + 8, + 10, + 18, + 10, + 14, + 3, + 22, + 8, + 0, + 7, + 18, + 1, + 8, + 27, + 11, + 3, + 18, + 7, + 9, + 5, + 5, + 3, + 9, + 5, + 2, + 3, + 15, + 3, + 10, + 0, + 5, + 8, + 31, + 3, + 7, + 24, + 4, + 26, + 9, + 8, + 10, + 3, + 9, + 3, + 14, + 9, + 16, + 5, + 15, + 7, + 7, + 3, + 39, + 2 + ], + "weighted_loads": [ + 0.09608200564980507, + 0.21078326180577278, + 0.5158571116626263, + 0.07026386260986328, + 4.174640987068415, + 0.5531842522323132, + 0.0, + 1.5502765569835901, + 0.16526345536112785, + 0.0, + 0.6493399702012539, + 0.6760537847876549, + 0.9084010776132345, + 0.6508994176983833, + 0.8269424922764301, + 0.10046259127557278, + 1.3900550808757544, + 0.2995396200567484, + 0.0, + 0.5338193513453007, + 1.2193940412253141, + 0.028737124055624008, + 0.8786642253398895, + 1.5269327946007252, + 0.7332873791456223, + 0.1497662104666233, + 0.9552106242626905, + 0.34896593913435936, + 1.007814034819603, + 0.3535882867872715, + 0.18123794719576836, + 0.14504503086209297, + 0.6077627278864384, + 0.2001140434294939, + 0.07623327523469925, + 0.14224651083350182, + 0.5642617251724005, + 0.11227576062083244, + 0.5563466008752584, + 0.0, + 0.2849019393324852, + 0.37676188722252846, + 1.849589042365551, + 0.25297318398952484, + 0.26724322885274887, + 1.9325547330081463, + 0.19860340654850006, + 1.6678568311035633, + 0.3250012453645468, + 0.3840576373040676, + 0.6511552482843399, + 0.21519802510738373, + 0.7307689972221851, + 0.13073450699448586, + 0.578997815027833, + 0.7820113301277161, + 0.6852408815175295, + 0.5015470497310162, + 2.9154829643666744, + 0.7850990481674671, + 0.2640905138105154, + 0.09667707793414593, + 2.3624361604452133, + 0.11335271969437599 + ], + "unique_experts": 60, + "load_cv": 1.0352552780661466, + "normalized_load_entropy": 0.9004749214974056, + "max_load_share": 0.09748427672955975 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "7ce3199c35a6d59b049d85281d4c54f14dd2a43147be427fbc5f4491c1e8882a", + "route_weight_sha256": "0e5573849eac653dc0f6eab6d8b9266ba26acf76a9caf98eff6a93e290da9baf", + "loads": [ + 10, + 5, + 19, + 2, + 62, + 11, + 0, + 19, + 11, + 0, + 8, + 15, + 18, + 10, + 19, + 6, + 22, + 8, + 18, + 7, + 18, + 2, + 8, + 27, + 11, + 3, + 18, + 7, + 9, + 5, + 12, + 3, + 10, + 5, + 2, + 7, + 16, + 5, + 10, + 3, + 10, + 8, + 34, + 3, + 7, + 24, + 11, + 26, + 12, + 19, + 12, + 6, + 19, + 11, + 14, + 9, + 17, + 7, + 19, + 10, + 7, + 6, + 39, + 5 + ], + "weighted_loads": [ + 0.5690237283706665, + 0.2865091748535633, + 1.7859767898917198, + 0.07026386260986328, + 4.174640987068415, + 0.6022092681378126, + 0.0, + 1.5502765569835901, + 0.6507880426943302, + 0.0, + 0.6493399702012539, + 1.1131761707365513, + 0.9084010776132345, + 0.6508994176983833, + 1.7179751452058554, + 0.19561968557536602, + 1.3900550808757544, + 0.2995396200567484, + 1.1368521749973297, + 0.5338193513453007, + 1.2193940412253141, + 0.053706564009189606, + 0.8786642253398895, + 1.5269327946007252, + 0.7332873791456223, + 0.1497662104666233, + 0.9552106242626905, + 0.34896593913435936, + 1.007814034819603, + 0.3535882867872715, + 0.5237317234277725, + 0.14504503086209297, + 0.6393158324062824, + 0.2001140434294939, + 0.07623327523469925, + 0.41931622847914696, + 0.6540889944881201, + 0.1725197583436966, + 0.5563466008752584, + 0.07608918473124504, + 0.5259344354271889, + 0.37676188722252846, + 1.9377897027879953, + 0.25297318398952484, + 0.26724322885274887, + 1.9325547330081463, + 1.8782478868961334, + 1.6678568311035633, + 0.4769241642206907, + 0.8601769581437111, + 0.7775825504213572, + 0.44069015979766846, + 1.4303431455045938, + 0.6505543477833271, + 0.578997815027833, + 0.7820113301277161, + 0.9083510804921389, + 0.5829368382692337, + 3.1137704718858004, + 0.915959220379591, + 0.2640905138105154, + 0.18035114742815495, + 2.3624361604452133, + 0.2864307388663292 + ], + "unique_experts": 62, + "load_cv": 0.8136726647306733, + "normalized_load_entropy": 0.9338310385633312, + "max_load_share": 0.07888040712468193 + } + }, + "s1_x": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "d4da8671fb85feb3b377a59963093ead8fbce4b979832c212ef914e2bc56222e", + "route_weight_sha256": "06b70b2ce90fccd8931b569cc8a82fe67eeb1f92341d09102c22861a5165e8e8", + "loads": [ + 3, + 3, + 6, + 3, + 63, + 8, + 1, + 19, + 3, + 0, + 8, + 9, + 19, + 11, + 14, + 1, + 20, + 8, + 1, + 7, + 18, + 0, + 8, + 27, + 11, + 3, + 17, + 7, + 10, + 6, + 4, + 3, + 8, + 7, + 2, + 4, + 15, + 2, + 10, + 0, + 5, + 6, + 33, + 4, + 5, + 24, + 4, + 24, + 10, + 10, + 9, + 4, + 9, + 3, + 12, + 10, + 18, + 5, + 14, + 7, + 7, + 2, + 39, + 3 + ], + "weighted_loads": [ + 0.13138443045318127, + 0.15947510674595833, + 0.5311920940876007, + 0.09981400519609451, + 4.191255893558264, + 0.524688359349966, + 0.03782723471522331, + 1.5232612676918507, + 0.1589037850499153, + 0.0, + 0.6719640158116817, + 0.611160933971405, + 0.926977314054966, + 0.6919398065656424, + 0.8099954016506672, + 0.03176524490118027, + 1.331533458083868, + 0.2984461821615696, + 0.043094173073768616, + 0.5090447254478931, + 1.248233299702406, + 0.0, + 0.8896561041474342, + 1.5326165854930878, + 0.7658414393663406, + 0.14414802752435207, + 0.892524192109704, + 0.34462058916687965, + 1.0369299668818712, + 0.3871898651123047, + 0.1541485469788313, + 0.14241327345371246, + 0.5767005309462547, + 0.2598314005881548, + 0.0873439721763134, + 0.19009704515337944, + 0.579504257068038, + 0.07894425466656685, + 0.5746572911739349, + 0.0, + 0.26968878880143166, + 0.2811789568513632, + 1.926787130534649, + 0.28313263319432735, + 0.19755247607827187, + 1.882039487361908, + 0.21042615920305252, + 1.612037232145667, + 0.3553861044347286, + 0.4398834388703108, + 0.6895165741443634, + 0.2515100706368685, + 0.7613937892019749, + 0.13414845243096352, + 0.5022622849792242, + 0.7817330732941628, + 0.7142608426511288, + 0.5038701146841049, + 2.8744605854153633, + 0.7839111536741257, + 0.25617034547030926, + 0.06802467815577984, + 2.347256977111101, + 0.14774389564990997 + ], + "unique_experts": 61, + "load_cv": 1.0418063867373337, + "normalized_load_entropy": 0.901003564641443, + "max_load_share": 0.09905660377358491 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "435ac2aec5ce5d5cc9030d77ebc8059b3fc7fc7c3506ae9e4ba2a5fd26e30de1", + "route_weight_sha256": "6fb64721898925caca768ee93d21a8c9c260a3febcea489b7e1e33793f82d42c", + "loads": [ + 13, + 6, + 19, + 3, + 64, + 11, + 1, + 21, + 14, + 2, + 8, + 14, + 19, + 12, + 23, + 2, + 20, + 17, + 26, + 8, + 18, + 1, + 9, + 27, + 11, + 3, + 17, + 7, + 10, + 7, + 13, + 5, + 10, + 8, + 6, + 17, + 16, + 7, + 11, + 2, + 11, + 6, + 35, + 10, + 5, + 24, + 21, + 28, + 14, + 23, + 11, + 7, + 19, + 15, + 14, + 11, + 20, + 12, + 18, + 10, + 7, + 4, + 39, + 10 + ], + "weighted_loads": [ + 0.7610095497220755, + 0.2980651818215847, + 1.7399326153099537, + 0.09981400519609451, + 4.2293254770338535, + 0.6131762601435184, + 0.03782723471522331, + 1.5926300846040249, + 1.0632629618048668, + 0.0627104826271534, + 0.6719640158116817, + 0.9630325511097908, + 0.926977314054966, + 0.733777804300189, + 1.867544211447239, + 0.06545442342758179, + 1.331533458083868, + 0.8631313294172287, + 2.075258608907461, + 0.6442111618816853, + 1.248233299702406, + 0.025896336883306503, + 0.9250260926783085, + 1.5326165854930878, + 0.7658414393663406, + 0.14414802752435207, + 0.892524192109704, + 0.34462058916687965, + 1.0369299668818712, + 0.4233311414718628, + 0.7030374985188246, + 0.38630568236112595, + 0.662752091884613, + 0.3356473986059427, + 0.5121322311460972, + 1.4803767055273056, + 0.6594080161303282, + 0.3032481111586094, + 0.6115107871592045, + 0.047740740701556206, + 0.5029432587325573, + 0.2811789568513632, + 1.9830629713833332, + 0.8018622975796461, + 0.19755247607827187, + 1.882039487361908, + 2.989600755274296, + 1.7915501724928617, + 0.4900215435773134, + 0.9870223216712475, + 0.8275900445878506, + 0.4660345707088709, + 1.4307093266397715, + 0.7691723741590977, + 0.6237434390932322, + 0.8172758184373379, + 0.9715761691331863, + 0.8188259638845921, + 3.2856448516249657, + 1.0509334206581116, + 0.25617034547030926, + 0.1321211401373148, + 2.347256977111101, + 0.44204833172261715 + ], + "unique_experts": 64, + "load_cv": 0.7385992615376957, + "normalized_load_entropy": 0.9437785417141519, + "max_load_share": 0.07256235827664399 + } + }, + "s0_period": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "5374bbb267326ce01c9c46eaed80ce2fdf95279666466eddfd96335022be6ffc", + "route_weight_sha256": "7d09249787253a5f327db7d5da5c6ef9655bfc4d3cfd779c417cff015f13995b", + "loads": [ + 2, + 4, + 6, + 2, + 62, + 9, + 1, + 18, + 3, + 0, + 8, + 11, + 18, + 11, + 15, + 2, + 22, + 8, + 1, + 6, + 17, + 0, + 8, + 26, + 10, + 3, + 17, + 8, + 10, + 5, + 4, + 3, + 8, + 5, + 1, + 3, + 15, + 3, + 10, + 0, + 5, + 7, + 31, + 3, + 7, + 24, + 4, + 25, + 9, + 9, + 9, + 4, + 9, + 4, + 14, + 11, + 16, + 5, + 15, + 7, + 8, + 3, + 40, + 2 + ], + "weighted_loads": [ + 0.08690940774977207, + 0.22054835595190525, + 0.514220330864191, + 0.06750673055648804, + 4.146815728396177, + 0.5548662319779396, + 0.040978603065013885, + 1.498370461165905, + 0.16064921393990517, + 0.0, + 0.647371631115675, + 0.7114154472947121, + 0.9042949769645929, + 0.6803461331874132, + 0.847849702462554, + 0.061166055500507355, + 1.404052197933197, + 0.3018763866275549, + 0.04501543566584587, + 0.49415089935064316, + 1.1923627890646458, + 0.0, + 0.8792099617421627, + 1.5444200113415718, + 0.6943097189068794, + 0.15024195238947868, + 0.9049277491867542, + 0.36295133642852306, + 1.0276815835386515, + 0.3520350567996502, + 0.14855927601456642, + 0.14611175283789635, + 0.5962381288409233, + 0.20501568913459778, + 0.04327847808599472, + 0.14109796285629272, + 0.5630911868065596, + 0.11691932380199432, + 0.5654949061572552, + 0.0, + 0.2847543768584728, + 0.33980462327599525, + 1.8389820270240307, + 0.262479729950428, + 0.2568654790520668, + 1.9106322098523378, + 0.1988666132092476, + 1.637503633275628, + 0.3309996537864208, + 0.4144025929272175, + 0.6175317205488682, + 0.24795223772525787, + 0.7280614003539085, + 0.16033773496747017, + 0.5748683903366327, + 0.8204553313553333, + 0.6824136711657047, + 0.4844377227127552, + 2.9387708604335785, + 0.7976700104773045, + 0.28971336781978607, + 0.09578290581703186, + 2.404899887740612, + 0.10818587616086006 + ], + "unique_experts": 61, + "load_cv": 1.032040786021419, + "normalized_load_entropy": 0.9016129911894853, + "max_load_share": 0.09748427672955975 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "d5de87699fe3e1b3d3c1ef7a16fae47227678e8ada5e86a7da1756e7c0d0e64e", + "route_weight_sha256": "24b6ec84b48ea44627ce08bbaa863d66a79e4d86c8d864573a5a5ca317018d16", + "loads": [ + 10, + 5, + 18, + 2, + 62, + 11, + 1, + 18, + 11, + 0, + 8, + 16, + 18, + 11, + 20, + 5, + 22, + 8, + 20, + 6, + 17, + 1, + 8, + 27, + 10, + 3, + 17, + 8, + 10, + 5, + 11, + 4, + 9, + 5, + 1, + 6, + 16, + 5, + 10, + 3, + 9, + 7, + 34, + 3, + 7, + 24, + 12, + 25, + 11, + 20, + 12, + 6, + 19, + 13, + 14, + 11, + 17, + 8, + 18, + 10, + 8, + 6, + 40, + 4 + ], + "weighted_loads": [ + 0.5587895344942808, + 0.2962742689996958, + 1.612786017358303, + 0.06750673055648804, + 4.146815728396177, + 0.6038912478834391, + 0.040978603065013885, + 1.498370461165905, + 0.6461738012731075, + 0.0, + 0.647371631115675, + 1.1291570998728275, + 0.9042949769645929, + 0.6803461331874132, + 1.8609043434262276, + 0.1563231498003006, + 1.404052197933197, + 0.3018763866275549, + 1.2345391139388084, + 0.49415089935064316, + 1.1923627890646458, + 0.024969439953565598, + 0.8792099617421627, + 1.5864555947482586, + 0.6943097189068794, + 0.15024195238947868, + 0.9049277491867542, + 0.36295133642852306, + 1.0276815835386515, + 0.3520350567996502, + 0.4791765920817852, + 0.1782686859369278, + 0.6219452507793903, + 0.20501568913459778, + 0.04327847808599472, + 0.38115574419498444, + 0.6508564781397581, + 0.17716332152485847, + 0.5654949061572552, + 0.0814702957868576, + 0.48341160640120506, + 0.33980462327599525, + 1.927182687446475, + 0.262479729950428, + 0.2568654790520668, + 1.9106322098523378, + 2.05233521014452, + 1.637503633275628, + 0.4406045638024807, + 0.8808946497738361, + 0.783539516851306, + 0.4337489977478981, + 1.4050543960183859, + 0.7342515103518963, + 0.5748683903366327, + 0.8204553313553333, + 0.9055238701403141, + 0.613295167684555, + 3.072724709287286, + 0.918516619130969, + 0.28971336781978607, + 0.1836896948516369, + 2.404899887740612, + 0.20210310071706772 + ], + "unique_experts": 63, + "load_cv": 0.8177366480692325, + "normalized_load_entropy": 0.9332301179134331, + "max_load_share": 0.07888040712468193 + } + }, + "s1_period": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "edbb266b8f8c170418332b2814ebbf111876202914a498b5ddb7ed83e85f8b56", + "route_weight_sha256": "8e0b290cad99f6597fe64be388f853e6015d11fd088e1280782e22206dffde79", + "loads": [ + 2, + 4, + 6, + 3, + 63, + 8, + 0, + 19, + 3, + 0, + 8, + 10, + 18, + 10, + 14, + 1, + 21, + 8, + 1, + 6, + 18, + 0, + 8, + 27, + 11, + 3, + 17, + 7, + 11, + 6, + 5, + 2, + 7, + 4, + 2, + 4, + 15, + 1, + 11, + 0, + 5, + 6, + 33, + 4, + 6, + 23, + 4, + 24, + 9, + 8, + 9, + 5, + 9, + 3, + 14, + 12, + 15, + 5, + 15, + 9, + 8, + 3, + 40, + 3 + ], + "weighted_loads": [ + 0.09570305049419403, + 0.19053929299116135, + 0.5300600416958332, + 0.10445144027471542, + 4.2117976024746895, + 0.5225657224655151, + 0.0, + 1.5339089706540108, + 0.1526315174996853, + 0.0, + 0.6603167802095413, + 0.6619989424943924, + 0.9039937909692526, + 0.6522648129612207, + 0.8135356679558754, + 0.032567098736763, + 1.3708031810820103, + 0.29352317191660404, + 0.04299662634730339, + 0.4883347786962986, + 1.2474262081086636, + 0.0, + 0.9102575033903122, + 1.5434850566089153, + 0.775831550359726, + 0.14618683978915215, + 0.8933817483484745, + 0.3432626463472843, + 1.0662514548748732, + 0.39039161056280136, + 0.1840246468782425, + 0.11283228173851967, + 0.5445070471614599, + 0.16063185781240463, + 0.08537321537733078, + 0.19429407641291618, + 0.577382093295455, + 0.04306858032941818, + 0.6009640712291002, + 0.0, + 0.2707677185535431, + 0.27948080003261566, + 1.9278716053813696, + 0.27760795690119267, + 0.22220608033239841, + 1.8722326252609491, + 0.20898983255028725, + 1.6298591643571854, + 0.3288056943565607, + 0.3829577937722206, + 0.6330192815512419, + 0.2930675074458122, + 0.7557336315512657, + 0.13903242349624634, + 0.5728635396808386, + 0.8453276176005602, + 0.6272448059171438, + 0.4989537447690964, + 2.915445748716593, + 0.8549090567976236, + 0.2872519511729479, + 0.09357942081987858, + 2.3847880382090807, + 0.15173648297786713 + ], + "unique_experts": 60, + "load_cv": 1.0463526378840218, + "normalized_load_entropy": 0.8988715799946325, + "max_load_share": 0.09905660377358491 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "7d838ff03fa7d9401589a0cb92e87ce294759aa09961180806b9fed556c3dc7e", + "route_weight_sha256": "67eb458c13bc1775eccc0e55000e413f69fb661c46f5bc2e43b9e21cbcf386cc", + "loads": [ + 10, + 7, + 18, + 3, + 64, + 11, + 0, + 21, + 13, + 3, + 8, + 15, + 18, + 11, + 23, + 2, + 21, + 17, + 23, + 7, + 18, + 1, + 9, + 27, + 11, + 3, + 17, + 7, + 11, + 7, + 14, + 4, + 9, + 5, + 6, + 18, + 16, + 6, + 12, + 3, + 11, + 6, + 35, + 9, + 6, + 23, + 22, + 28, + 12, + 22, + 11, + 9, + 19, + 16, + 16, + 13, + 17, + 13, + 19, + 12, + 8, + 6, + 40, + 10 + ], + "weighted_loads": [ + 0.5427660159766674, + 0.3291293680667877, + 1.617547795176506, + 0.10445144027471542, + 4.249867185950279, + 0.6110536232590675, + 0.0, + 1.603277787566185, + 1.0138295516371727, + 0.11426594480872154, + 0.6603167802095413, + 1.064312383532524, + 0.9039937909692526, + 0.6941028106957674, + 2.0385253094136715, + 0.06625627726316452, + 1.3708031810820103, + 0.8582083191722631, + 1.9573761820793152, + 0.6235012151300907, + 1.2474262081086636, + 0.025896336883306503, + 0.9456274919211864, + 1.5434850566089153, + 0.775831550359726, + 0.14618683978915215, + 0.8933817483484745, + 0.3432626463472843, + 1.0662514548748732, + 0.42653288692235947, + 0.6913088522851467, + 0.35672469064593315, + 0.6292913984507322, + 0.23644785583019257, + 0.5101614743471146, + 1.501291073858738, + 0.6571808885782957, + 0.2673724368214607, + 0.6378175672143698, + 0.07522405497729778, + 0.5071924030780792, + 0.27948080003261566, + 1.984147446230054, + 0.7373188193887472, + 0.22220608033239841, + 1.8722326252609491, + 3.0163989663124084, + 1.80937210470438, + 0.4257476143538952, + 0.972833126783371, + 0.7707749102264643, + 0.5772105231881142, + 1.4109909441322088, + 0.8244854304939508, + 0.6943446937948465, + 0.8808703627437353, + 0.8845601323992014, + 0.8808716386556625, + 3.3254415094852448, + 1.1118574980646372, + 0.2872519511729479, + 0.1850232109427452, + 2.3847880382090807, + 0.42186051420867443 + ], + "unique_experts": 63, + "load_cv": 0.7349143030383903, + "normalized_load_entropy": 0.9442137143944663, + "max_load_share": 0.07256235827664399 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 106, + "ordered_topk_exact_tokens": 77, + "set_exact_tokens": 86, + "mean_set_jaccard": 0.9460916442048519, + "mean_token_weighted_tv": 0.011411630882407134, + "aggregate_load_tv": 0.02358490566037736 + }, + "system_bos": { + "tokens": 106, + "ordered_topk_exact_tokens": 61, + "set_exact_tokens": 73, + "mean_set_jaccard": 0.9090296495956872, + "mean_token_weighted_tv": 0.018426405485578865, + "aggregate_load_tv": 0.03616352201257862 + }, + "system_x": { + "tokens": 106, + "ordered_topk_exact_tokens": 58, + "set_exact_tokens": 73, + "mean_set_jaccard": 0.9110512129380054, + "mean_token_weighted_tv": 0.019260707636416522, + "aggregate_load_tv": 0.03616352201257861 + }, + "system_period": { + "tokens": 106, + "ordered_topk_exact_tokens": 64, + "set_exact_tokens": 74, + "mean_set_jaccard": 0.911725067385445, + "mean_token_weighted_tv": 0.019146814292191335, + "aggregate_load_tv": 0.03144654088050314 + }, + "bos_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 61, + "set_exact_tokens": 72, + "mean_set_jaccard": 0.9083557951482482, + "mean_token_weighted_tv": 0.019820274996026507, + "aggregate_load_tv": 0.034591194968553465 + }, + "bos_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 62, + "set_exact_tokens": 72, + "mean_set_jaccard": 0.9083557951482479, + "mean_token_weighted_tv": 0.02031172278671051, + "aggregate_load_tv": 0.036163522012578615 + }, + "x_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 57, + "set_exact_tokens": 75, + "mean_set_jaccard": 0.9164420485175202, + "mean_token_weighted_tv": 0.018943123730286112, + "aggregate_load_tv": 0.03459119496855346 + }, + "x_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 58, + "set_exact_tokens": 74, + "mean_set_jaccard": 0.9097035040431268, + "mean_token_weighted_tv": 0.021816562184677372, + "aggregate_load_tv": 0.03773584905660378 + }, + "period_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 60, + "set_exact_tokens": 72, + "mean_set_jaccard": 0.9043126684636119, + "mean_token_weighted_tv": 0.020092840332819044, + "aggregate_load_tv": 0.036163522012578615 + }, + "period_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 51, + "set_exact_tokens": 64, + "mean_set_jaccard": 0.8827493261455527, + "mean_token_weighted_tv": 0.02441339204439296, + "aggregate_load_tv": 0.04402515723270441 + } + } + }, + "layer_19": { + "layer": 19, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "bae268da9f5c1f2fe27e95962980f486e9751a3b1fb311c393cad3e80177b8cc", + "route_weight_sha256": "819efe608489181f61adb9c5d347c92200afe9b44a7e5f12bbfc9b098d13c098", + "loads": [ + 1, + 2, + 15, + 15, + 3, + 0, + 11, + 24, + 15, + 10, + 1, + 5, + 6, + 3, + 5, + 0, + 16, + 3, + 13, + 9, + 16, + 23, + 11, + 5, + 7, + 13, + 6, + 15, + 5, + 9, + 9, + 16, + 0, + 26, + 5, + 12, + 4, + 5, + 5, + 6, + 11, + 4, + 3, + 3, + 23, + 10, + 15, + 5, + 7, + 20, + 2, + 62, + 17, + 9, + 3, + 8, + 10, + 20, + 13, + 16, + 7, + 0, + 12, + 1 + ], + "weighted_loads": [ + 0.03695053234696388, + 0.08136849105358124, + 1.5101588144898415, + 1.1777614504098892, + 0.11613812297582626, + 0.0, + 0.964268933981657, + 1.2848247922956944, + 1.0433117933571339, + 0.6737231910228729, + 0.026474198326468468, + 0.18889827094972134, + 0.2243287581950426, + 0.1055797915905714, + 0.3812611885368824, + 0.0, + 1.4518532641232014, + 0.13111365213990211, + 0.5855053160339594, + 0.2971794940531254, + 1.0825345069169998, + 1.5142957717180252, + 0.4325633607804775, + 0.18726453743875027, + 0.30274177342653275, + 1.8712110947817564, + 0.35410504788160324, + 0.9325724225491285, + 0.3465273380279541, + 0.8410707898437977, + 0.5264816600829363, + 1.8485940974205732, + 0.0, + 1.3027348425239325, + 0.4231125768274069, + 0.7898448221385479, + 0.13952034153044224, + 0.16785772144794464, + 0.24018891155719757, + 0.4873911924660206, + 0.5686105918139219, + 0.12783442065119743, + 0.11466658487915993, + 0.1179710254073143, + 1.9166558645665646, + 0.5196969769895077, + 0.7727635987102985, + 0.3221588507294655, + 0.324018482118845, + 1.4178076647222042, + 0.0765354372560978, + 3.2668107580393553, + 1.1846460476517677, + 0.490253284573555, + 0.11049617454409599, + 0.5088073629885912, + 0.3718956708908081, + 1.2737502567470074, + 1.4355277195572853, + 1.0145727917551994, + 0.3119290415197611, + 0.0, + 0.7504538483917713, + 0.0317755825817585 + ], + "unique_experts": 60, + "load_cv": 0.9302862668393245, + "normalized_load_entropy": 0.9153394539724383, + "max_load_share": 0.09748427672955975 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "5a4ebbb41e27fecd32a765fbebdec49f5e27c0cddda2352a8490969d0b4f1b24", + "route_weight_sha256": "fb6c88a7de1134c9342ca834e470011254724d14af701d0e9ccb0de920522a01", + "loads": [ + 3, + 6, + 18, + 15, + 8, + 2, + 22, + 24, + 15, + 15, + 1, + 6, + 14, + 4, + 10, + 0, + 18, + 3, + 13, + 13, + 16, + 23, + 17, + 14, + 16, + 13, + 6, + 17, + 5, + 13, + 14, + 16, + 0, + 26, + 5, + 13, + 6, + 10, + 6, + 6, + 16, + 6, + 12, + 4, + 24, + 10, + 15, + 9, + 8, + 20, + 2, + 62, + 17, + 12, + 10, + 8, + 10, + 20, + 20, + 17, + 9, + 4, + 18, + 1 + ], + "weighted_loads": [ + 0.08009973959997296, + 0.4487611260265112, + 1.7708072494715452, + 1.1777614504098892, + 0.8697395212948322, + 0.05986778251826763, + 1.4332743426784873, + 1.2848247922956944, + 1.0433117933571339, + 1.039355255663395, + 0.026474198326468468, + 0.21867776103317738, + 0.7671856265515089, + 0.14514357782900333, + 0.8445628508925438, + 0.0, + 1.5356602668762207, + 0.13111365213990211, + 0.5855053160339594, + 0.470568735152483, + 1.0825345069169998, + 1.5142957717180252, + 0.6569707300513983, + 0.4994352627545595, + 0.7600910407491028, + 1.8712110947817564, + 0.35410504788160324, + 1.0359979066997766, + 0.3465273380279541, + 1.0003204196691513, + 0.7146702334284782, + 1.8485940974205732, + 0.0, + 1.3027348425239325, + 0.4231125768274069, + 0.847672376781702, + 0.18272018083371222, + 0.405797578394413, + 0.2816780060529709, + 0.4873911924660206, + 0.7272405517287552, + 0.2592369094491005, + 0.7649691179394722, + 0.17559487000107765, + 1.9273697137832642, + 0.5196969769895077, + 0.7727635987102985, + 0.674629770219326, + 0.3623111695051193, + 1.4178076647222042, + 0.0765354372560978, + 3.2668107580393553, + 1.1846460476517677, + 0.748150572180748, + 1.8813826944679022, + 0.5088073629885912, + 0.3718956708908081, + 1.2737502567470074, + 1.7276027295738459, + 1.0549106635153294, + 0.5320062953978777, + 0.21485797688364983, + 1.264773439615965, + 0.0317755825817585 + ], + "unique_experts": 62, + "load_cv": 0.7365566186085138, + "normalized_load_entropy": 0.9420420083410275, + "max_load_share": 0.07888040712468193 + } + }, + "s1_eos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "1fe3ce9d08510d2a0dd824e89d6d96aea4d6428c5d1405fb68a906a3e1a4ac3d", + "route_weight_sha256": "1da21d8a7b731fdef4ab17b1cafe9e08027a056c2ee4a86e553e234094050bc2", + "loads": [ + 1, + 2, + 16, + 15, + 3, + 0, + 11, + 22, + 15, + 10, + 1, + 5, + 5, + 2, + 5, + 0, + 15, + 3, + 13, + 10, + 16, + 23, + 12, + 5, + 8, + 13, + 6, + 15, + 5, + 9, + 8, + 16, + 1, + 28, + 5, + 13, + 3, + 3, + 5, + 6, + 12, + 4, + 4, + 3, + 23, + 10, + 15, + 5, + 7, + 19, + 2, + 61, + 17, + 8, + 3, + 9, + 10, + 20, + 13, + 16, + 7, + 0, + 12, + 2 + ], + "weighted_loads": [ + 0.03708122298121452, + 0.07689891010522842, + 1.5648909378796816, + 1.1989934332668781, + 0.11089129373431206, + 0.0, + 0.9523154608905315, + 1.2219726759940386, + 1.0540050454437733, + 0.6536299735307693, + 0.025047169998288155, + 0.187780587002635, + 0.18872392922639847, + 0.08137623220682144, + 0.3876231424510479, + 0.0, + 1.4361968003213406, + 0.12762702070176601, + 0.5828601326793432, + 0.32992237247526646, + 1.0761898942291737, + 1.523958034813404, + 0.4563177041709423, + 0.18798121809959412, + 0.32569154165685177, + 1.8994121067225933, + 0.35844605416059494, + 0.9382178131490946, + 0.34100191853940487, + 0.873510405421257, + 0.4818070773035288, + 1.8417071998119354, + 0.02753663808107376, + 1.3639305997639894, + 0.4108496177941561, + 0.8264891915023327, + 0.1061989888548851, + 0.10775583051145077, + 0.2388889454305172, + 0.49136659502983093, + 0.6018568444997072, + 0.13368662260472775, + 0.14611579105257988, + 0.11140942759811878, + 1.9478574730455875, + 0.509405892342329, + 0.7595715466886759, + 0.3187784105539322, + 0.3243543989956379, + 1.3967704251408577, + 0.07548054680228233, + 3.2487527672201395, + 1.1843867022544146, + 0.47185680642724037, + 0.11375235207378864, + 0.5303449332714081, + 0.37274693325161934, + 1.2830126881599426, + 1.4357659164816141, + 1.0342669151723385, + 0.31242524832487106, + 0.0, + 0.7502020541578531, + 0.058426614850759506 + ], + "unique_experts": 61, + "load_cv": 0.9229439211495802, + "normalized_load_entropy": 0.9165535760525387, + "max_load_share": 0.0959119496855346 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "71d42fc1d90dbe7bfddc68b3bb04b38b0dcda52a709c68291ed0e7b1ec3ea152", + "route_weight_sha256": "25b5c7e32b049006908df7d9095055e964971dfd20b64fd40a12a37fe4c7854e", + "loads": [ + 4, + 8, + 18, + 15, + 15, + 3, + 24, + 22, + 15, + 16, + 2, + 13, + 17, + 2, + 16, + 2, + 18, + 8, + 14, + 18, + 20, + 24, + 19, + 11, + 21, + 13, + 6, + 17, + 6, + 11, + 12, + 16, + 3, + 28, + 5, + 13, + 6, + 7, + 6, + 8, + 18, + 12, + 14, + 4, + 24, + 10, + 15, + 16, + 8, + 20, + 7, + 61, + 20, + 17, + 8, + 9, + 12, + 22, + 23, + 18, + 10, + 7, + 21, + 4 + ], + "weighted_loads": [ + 0.09798093466088176, + 0.5832991413772106, + 1.7903947811573744, + 1.1989934332668781, + 1.5776271615177393, + 0.1338860411196947, + 1.5697244359180331, + 1.2219726759940386, + 1.0540050454437733, + 1.0378879718482494, + 0.09129929728806019, + 0.9486239310353994, + 0.8772700652480125, + 0.08137623220682144, + 1.246509725227952, + 0.1104513667523861, + 1.830825574696064, + 0.35224019922316074, + 0.6826484482735395, + 0.7153744678944349, + 1.411358980461955, + 1.5783785097301006, + 0.7316476013511419, + 0.3874273542314768, + 1.0864487765356898, + 1.8994121067225933, + 0.35844605416059494, + 1.0750792007893324, + 0.3804007265716791, + 0.9467834047973156, + 0.6281651277095079, + 1.8417071998119354, + 0.11764673888683319, + 1.3639305997639894, + 0.4108496177941561, + 0.8264891915023327, + 0.18940758844837546, + 0.282584635540843, + 0.2821744941174984, + 0.5962988790124655, + 0.7789551797322929, + 0.5144623313099146, + 0.9143110513687134, + 0.14952714927494526, + 1.9585713222622871, + 0.509405892342329, + 0.7595715466886759, + 1.084641445428133, + 0.35865310579538345, + 1.4399962238967419, + 0.40887659043073654, + 3.2487527672201395, + 1.3278617449104786, + 1.2627374939620495, + 1.8246355410665274, + 0.5303449332714081, + 0.45293139666318893, + 1.3712757602334023, + 1.9393530935049057, + 1.11087117344141, + 0.5017232708632946, + 0.3201575931161642, + 1.4698556158691645, + 0.2225419282913208 + ], + "unique_experts": 64, + "load_cv": 0.64117024631765, + "normalized_load_entropy": 0.9564345772685067, + "max_load_share": 0.0691609977324263 + } + }, + "s0_bos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "2a477ba55be89ae525464c04cceb2af3422237d37aefda7a68bca33cef3b7180", + "route_weight_sha256": "f709060b32d58bc8d87c9d45a309ba970fb0d36632b707601643c8914dd87a37", + "loads": [ + 2, + 2, + 13, + 15, + 5, + 0, + 12, + 22, + 15, + 13, + 0, + 5, + 4, + 3, + 5, + 0, + 15, + 3, + 13, + 10, + 15, + 23, + 11, + 4, + 6, + 13, + 6, + 14, + 5, + 8, + 8, + 16, + 1, + 29, + 5, + 12, + 3, + 4, + 5, + 6, + 11, + 4, + 3, + 3, + 22, + 10, + 16, + 5, + 5, + 21, + 2, + 63, + 17, + 9, + 3, + 8, + 10, + 20, + 14, + 17, + 7, + 0, + 13, + 2 + ], + "weighted_loads": [ + 0.06813471764326096, + 0.07804320380091667, + 1.3906136397272348, + 1.1706230454146862, + 0.18993204459547997, + 0.0, + 0.984882427379489, + 1.2509014904499054, + 1.0446756668388844, + 0.8606891967356205, + 0.0, + 0.1856131125241518, + 0.1560155302286148, + 0.10049343295395374, + 0.3984410874545574, + 0.0, + 1.4427836071699858, + 0.1288812719285488, + 0.5886208154261112, + 0.32918104343116283, + 1.0607812032103539, + 1.5404197573661804, + 0.4406425766646862, + 0.15495466068387032, + 0.27073733881115913, + 1.9117008950561285, + 0.3505581244826317, + 0.9017276223748922, + 0.346381526440382, + 0.7673018984496593, + 0.48701225593686104, + 1.82057018391788, + 0.02741846814751625, + 1.4242810178548098, + 0.42586737498641014, + 0.8287988640367985, + 0.10891547240316868, + 0.14298544637858868, + 0.2473595179617405, + 0.5108328685164452, + 0.5630086101591587, + 0.1307207029312849, + 0.10970023646950722, + 0.11514311656355858, + 1.9793038181960583, + 0.5156470276415348, + 0.7907531410455704, + 0.33236122131347656, + 0.24496625736355782, + 1.4424194227904081, + 0.07873879745602608, + 3.345301503315568, + 1.2101948000490665, + 0.47514396347105503, + 0.11368722282350063, + 0.5269628595560789, + 0.38509382866322994, + 1.2905077375471592, + 1.467297986149788, + 1.071083553135395, + 0.30416244082152843, + 0.0, + 0.809652503579855, + 0.0586093794554472 + ], + "unique_experts": 60, + "load_cv": 0.9454694201032113, + "normalized_load_entropy": 0.9140897845748444, + "max_load_share": 0.09905660377358491 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "4464278edfd62c912d0c49c1003bccd61f748efef544b252e19f4188cdf07174", + "route_weight_sha256": "1d95631470021eb21fc420df46b31c1ff43bce4cb87c8c5c501ba05069c13051", + "loads": [ + 3, + 6, + 15, + 15, + 9, + 2, + 22, + 22, + 15, + 17, + 0, + 6, + 12, + 7, + 10, + 0, + 17, + 4, + 13, + 15, + 15, + 23, + 17, + 10, + 15, + 13, + 7, + 16, + 5, + 12, + 15, + 16, + 1, + 29, + 5, + 14, + 3, + 9, + 6, + 6, + 14, + 7, + 12, + 4, + 23, + 11, + 16, + 9, + 7, + 21, + 2, + 64, + 17, + 12, + 9, + 8, + 10, + 20, + 22, + 18, + 9, + 3, + 19, + 2 + ], + "weighted_loads": [ + 0.1068435050547123, + 0.42008821852505207, + 1.6146779581904411, + 1.1706230454146862, + 0.7966205477714539, + 0.04658413864672184, + 1.4083589622750878, + 1.2509014904499054, + 1.0446756668388844, + 1.1590125784277916, + 0.0, + 0.21539260260760784, + 0.6916545443236828, + 0.25511169619858265, + 0.8604121580719948, + 0.0, + 1.526590609923005, + 0.8599870763719082, + 0.5886208154261112, + 0.7412944789975882, + 1.0607812032103539, + 1.5404197573661804, + 0.6743511203676462, + 0.3808692432940006, + 0.8379142172634602, + 1.9117008950561285, + 0.38628536462783813, + 1.036255406215787, + 0.346381526440382, + 0.926551528275013, + 0.7590315211564302, + 1.82057018391788, + 0.02741846814751625, + 1.4242810178548098, + 0.42586737498641014, + 0.9056027550250292, + 0.10891547240316868, + 0.38800803013145924, + 0.2888486124575138, + 0.5108328685164452, + 0.6770772421732545, + 0.29858882911503315, + 0.7675374448299408, + 0.17276696115732193, + 1.9900176674127579, + 0.542370893061161, + 0.7907531410455704, + 0.6943819224834442, + 0.31942567229270935, + 1.4424194227904081, + 0.07873879745602608, + 3.3611804712563753, + 1.2101948000490665, + 0.7097277510911226, + 0.9408719390630722, + 0.5269628595560789, + 0.38509382866322994, + 1.2905077375471592, + 1.792299898341298, + 1.1139375790953636, + 0.4895195718854666, + 0.18156729638576508, + 1.3239720948040485, + 0.0586093794554472 + ], + "unique_experts": 62, + "load_cv": 0.7532451316881961, + "normalized_load_entropy": 0.9412135210508388, + "max_load_share": 0.08142493638676845 + } + }, + "s1_bos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "ef37e8f0f61234abefb4cd28ebcc22b948c878c4ad3cbbe264f8ae1724ee72fd", + "route_weight_sha256": "7bc56c1aec0080e5ba705da593ec6da039b4e8c6f3f4214e9102ee8a39b47e83", + "loads": [ + 2, + 1, + 15, + 15, + 4, + 0, + 11, + 22, + 15, + 10, + 0, + 5, + 5, + 2, + 6, + 1, + 15, + 3, + 12, + 10, + 16, + 23, + 12, + 4, + 6, + 13, + 6, + 14, + 5, + 9, + 7, + 17, + 1, + 27, + 5, + 13, + 2, + 5, + 6, + 6, + 10, + 4, + 3, + 3, + 22, + 10, + 16, + 5, + 7, + 21, + 2, + 62, + 18, + 8, + 3, + 8, + 11, + 20, + 15, + 16, + 6, + 0, + 13, + 2 + ], + "weighted_loads": [ + 0.06602268852293491, + 0.03699541836977005, + 1.3931751288473606, + 1.2077214792370796, + 0.159630186855793, + 0.0, + 0.9441973343491554, + 1.2465481441468, + 1.058255948126316, + 0.6650566682219505, + 0.0, + 0.1771391537040472, + 0.19450263306498528, + 0.08563858643174171, + 0.41971175745129585, + 0.021104633808135986, + 1.4115778431296349, + 0.14266031980514526, + 0.5445552915334702, + 0.32252118550240993, + 1.097573947161436, + 1.537261750549078, + 0.4629968162626028, + 0.15107566863298416, + 0.2651420049369335, + 1.8954105246812105, + 0.35194506123661995, + 0.9078835491091013, + 0.34021260403096676, + 0.8263096883893013, + 0.4607480317354202, + 1.8528244476765394, + 0.027465904131531715, + 1.3600442465394735, + 0.42145536839962006, + 0.8292798902839422, + 0.09216596186161041, + 0.17943603731691837, + 0.2684680353850126, + 0.49297768250107765, + 0.5442957244813442, + 0.13915794901549816, + 0.10511773824691772, + 0.12167487666010857, + 1.8992425352334976, + 0.5145372841507196, + 0.7839352041482925, + 0.32095998153090477, + 0.32233016192913055, + 1.4645002540200949, + 0.07596008852124214, + 3.274225426837802, + 1.218937637284398, + 0.45050350949168205, + 0.11111021228134632, + 0.537221884354949, + 0.3967602550983429, + 1.3059793934226036, + 1.4910655617713928, + 1.016193002462387, + 0.263800535351038, + 0.0, + 0.8029946219176054, + 0.05886811390519142 + ], + "unique_experts": 61, + "load_cv": 0.933681638377494, + "normalized_load_entropy": 0.9152889923042414, + "max_load_share": 0.09748427672955975 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "5861159fdc582cbfd4e0ef8db25f236b07bc1fe50fd1a805b0b7a415a6ec2d88", + "route_weight_sha256": "da8f7265effe8eeb58a6753e8ba84408a23d6d2a91b869b1cf89c048812ef5e5", + "loads": [ + 4, + 7, + 17, + 15, + 16, + 2, + 22, + 22, + 15, + 18, + 1, + 13, + 17, + 4, + 16, + 3, + 19, + 8, + 13, + 18, + 20, + 24, + 20, + 8, + 18, + 13, + 6, + 16, + 6, + 11, + 13, + 17, + 3, + 27, + 5, + 14, + 5, + 9, + 7, + 9, + 14, + 11, + 13, + 5, + 23, + 10, + 16, + 15, + 8, + 22, + 7, + 62, + 21, + 18, + 7, + 8, + 13, + 22, + 26, + 18, + 9, + 7, + 22, + 4 + ], + "weighted_loads": [ + 0.12255729362368584, + 0.5089054591953754, + 1.627277597784996, + 1.2077214792370796, + 1.6402949299663305, + 0.09213621355593204, + 1.4804587280377746, + 1.2465481441468, + 1.058255948126316, + 1.1092233210802078, + 0.06625212728977203, + 0.9379824977368116, + 0.8789246939122677, + 0.1646881438791752, + 1.2214053440839052, + 0.13155600056052208, + 1.8394872061908245, + 0.36727349832654, + 0.6443436071276665, + 0.9034347329288721, + 1.4327430333942175, + 1.5916822254657745, + 0.7986743822693825, + 0.3000881224870682, + 1.1108062695711851, + 1.8954105246812105, + 0.35194506123661995, + 1.056471949443221, + 0.379611412063241, + 0.8995826877653599, + 0.6879291199147701, + 1.8528244476765394, + 0.11757600493729115, + 1.3600442465394735, + 0.42145536839962006, + 0.8912843111902475, + 0.20682024210691452, + 0.34289332665503025, + 0.31175358407199383, + 0.6392393838614225, + 0.6764292540028691, + 0.48761160112917423, + 0.8750095926225185, + 0.19585006311535835, + 1.9099563844501972, + 0.5145372841507196, + 0.7839352041482925, + 1.0456931106746197, + 0.3566288687288761, + 1.507726052775979, + 0.40935613214969635, + 3.274225426837802, + 1.3624126799404621, + 1.2459846436977386, + 0.8804610278457403, + 0.537221884354949, + 0.4769447185099125, + 1.3942424654960632, + 2.0371214728802443, + 1.0937965400516987, + 0.43821313604712486, + 0.3201575931161642, + 1.5226481836289167, + 0.22298342734575272 + ], + "unique_experts": 64, + "load_cv": 0.6488233306999206, + "normalized_load_entropy": 0.9558796039015394, + "max_load_share": 0.07029478458049887 + } + }, + "s0_x": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "eeb78dfef57cb6ccdbc9c4363b25a6d00a94712908fef4ad8c92a0a0730f615b", + "route_weight_sha256": "e09cc3fb863ba7d35f37be105193790ad8b479e1b53569415ec399795e5fc617", + "loads": [ + 2, + 3, + 13, + 14, + 4, + 0, + 12, + 20, + 15, + 12, + 0, + 5, + 5, + 3, + 5, + 0, + 15, + 3, + 13, + 9, + 15, + 23, + 12, + 4, + 7, + 13, + 6, + 14, + 5, + 8, + 9, + 17, + 1, + 28, + 5, + 13, + 3, + 3, + 5, + 6, + 10, + 4, + 3, + 3, + 23, + 9, + 16, + 5, + 7, + 20, + 2, + 64, + 16, + 8, + 3, + 9, + 13, + 20, + 15, + 17, + 5, + 0, + 13, + 1 + ], + "weighted_loads": [ + 0.06679828651249409, + 0.11425012722611427, + 1.3665930293500423, + 1.1462886556982994, + 0.13673215731978416, + 0.0, + 1.000620324164629, + 1.2068988345563412, + 1.0374902915209532, + 0.773224113509059, + 0.0, + 0.1822306476533413, + 0.19483206793665886, + 0.11260526068508625, + 0.3788556419312954, + 0.0, + 1.417072230949998, + 0.13255999982357025, + 0.5726469419896603, + 0.3132699877023697, + 1.0478770695626736, + 1.5246758088469505, + 0.4737342167645693, + 0.15583306178450584, + 0.29383016936481, + 1.9016124214977026, + 0.34271371364593506, + 0.9048771746456623, + 0.34395067766308784, + 0.7900082152336836, + 0.512161735445261, + 1.7909446489065886, + 0.027111278846859932, + 1.3654666561633348, + 0.41882069036364555, + 0.8093029409646988, + 0.1058901697397232, + 0.11076154746115208, + 0.24662607349455357, + 0.4982213042676449, + 0.5360682047903538, + 0.1347607970237732, + 0.11281901970505714, + 0.11108290404081345, + 2.003168039023876, + 0.47991354763507843, + 0.8016371466219425, + 0.3333519399166107, + 0.3044597748667002, + 1.4523261561989784, + 0.0768519677221775, + 3.3118000980466604, + 1.1611392386257648, + 0.44682365097105503, + 0.11316312476992607, + 0.5415228214114904, + 0.4844560269266367, + 1.2827104665338993, + 1.5164367370307446, + 1.083101313561201, + 0.24625000916421413, + 0.0, + 0.7953648380935192, + 0.03350439667701721 + ], + "unique_experts": 60, + "load_cv": 0.9494772565145645, + "normalized_load_entropy": 0.9137124486747147, + "max_load_share": 0.10062893081761007 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "8fe96020ba903f350ec33dd968012cfaf309d4002d64ff91912a3ac703897b35", + "route_weight_sha256": "8576bb12721964f36993bb7dd9ccd1e8310479ec3dff27becafca2a6b259a456", + "loads": [ + 3, + 6, + 15, + 14, + 9, + 3, + 23, + 20, + 15, + 17, + 0, + 6, + 15, + 4, + 11, + 0, + 17, + 3, + 13, + 13, + 15, + 23, + 19, + 10, + 15, + 13, + 6, + 16, + 5, + 12, + 14, + 17, + 1, + 28, + 5, + 14, + 3, + 7, + 6, + 7, + 14, + 6, + 13, + 4, + 24, + 9, + 16, + 10, + 8, + 20, + 2, + 64, + 16, + 13, + 9, + 9, + 13, + 20, + 24, + 18, + 7, + 3, + 20, + 1 + ], + "weighted_loads": [ + 0.10550707392394543, + 0.445352416485548, + 1.5791473928838968, + 1.1462886556982994, + 0.888470932841301, + 0.14385011978447437, + 1.4855905240401626, + 1.2068988345563412, + 1.0374902915209532, + 1.1287832893431187, + 0.0, + 0.21201013773679733, + 0.9155381508171558, + 0.15216904692351818, + 0.8786855861544609, + 0.0, + 1.5008792337030172, + 0.13255999982357025, + 0.5726469419896603, + 0.48489342629909515, + 1.0478770695626736, + 1.5246758088469505, + 0.761258527636528, + 0.38174764439463615, + 0.71568888053298, + 1.9016124214977026, + 0.34271371364593506, + 1.0208949595689774, + 0.34395067766308784, + 0.9492578450590372, + 0.7013429868966341, + 1.7909446489065886, + 0.027111278846859932, + 1.3654666561633348, + 0.41882069036364555, + 0.8671304956078529, + 0.1058901697397232, + 0.2770193535834551, + 0.2881151679903269, + 0.5329358838498592, + 0.705733691342175, + 0.26484090462327003, + 0.9216369017958641, + 0.1687067486345768, + 2.013881888240576, + 0.47991354763507843, + 0.8016371466219425, + 0.8044063001871109, + 0.3427524622529745, + 1.4523261561989784, + 0.0768519677221775, + 3.3118000980466604, + 1.1611392386257648, + 0.7513282690197229, + 0.9403478410094976, + 0.5415228214114904, + 0.4844560269266367, + 1.2827104665338993, + 1.8847584370523691, + 1.1278168968856335, + 0.42556766234338284, + 0.18156729638576508, + 1.3574675098061562, + 0.03350439667701721 + ], + "unique_experts": 62, + "load_cv": 0.7611800970488838, + "normalized_load_entropy": 0.9392090154239882, + "max_load_share": 0.08142493638676845 + } + }, + "s1_x": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "39fb0aa79a13b8f72c062b6b09b7c80167d3b7a399bdf3fb971ec14ab6f4a530", + "route_weight_sha256": "3c5e2e8836026f0ecb0e296bfc4b27bee1caaf2cab925eca86e3909bfe566649", + "loads": [ + 2, + 2, + 15, + 13, + 3, + 0, + 12, + 20, + 15, + 10, + 1, + 4, + 6, + 2, + 6, + 1, + 14, + 3, + 11, + 10, + 16, + 23, + 11, + 6, + 5, + 13, + 6, + 14, + 6, + 10, + 8, + 18, + 1, + 27, + 5, + 13, + 3, + 4, + 5, + 6, + 11, + 4, + 4, + 4, + 22, + 10, + 16, + 4, + 8, + 21, + 2, + 61, + 16, + 7, + 2, + 9, + 12, + 20, + 15, + 17, + 7, + 0, + 12, + 2 + ], + "weighted_loads": [ + 0.06495082750916481, + 0.08217039331793785, + 1.4301438499242067, + 1.1552968993782997, + 0.11331410333514214, + 0.0, + 0.9725099243223667, + 1.1971549708396196, + 1.047583932057023, + 0.714612752199173, + 0.03565646708011627, + 0.14815210364758968, + 0.24446393735706806, + 0.07586383819580078, + 0.40622415766119957, + 0.021886367350816727, + 1.370638344436884, + 0.13337913155555725, + 0.505626305937767, + 0.3316326607018709, + 1.0910115502774715, + 1.5252331234514713, + 0.43312979117035866, + 0.2053022515028715, + 0.23639729246497154, + 1.9146367032080889, + 0.3517749607563019, + 0.9148713424801826, + 0.3670439627021551, + 0.9002167601138353, + 0.46374686621129513, + 1.8454261757433414, + 0.02549959346652031, + 1.3289429228752851, + 0.4085749387741089, + 0.795368729159236, + 0.11684486456215382, + 0.1538948267698288, + 0.2474363036453724, + 0.4794557951390743, + 0.5880863554775715, + 0.15294495970010757, + 0.13877311162650585, + 0.1430729553103447, + 1.8711527101695538, + 0.5035261269658804, + 0.8030493780970573, + 0.28023068606853485, + 0.35138406977057457, + 1.470258528366685, + 0.07874971255660057, + 3.1606909949332476, + 1.1426088735461235, + 0.44234185107052326, + 0.0873669907450676, + 0.5468522906303406, + 0.43459679558873177, + 1.2923269383609295, + 1.4837425202131271, + 1.108325220644474, + 0.2961635459214449, + 0.0, + 0.7702431753277779, + 0.05898638255894184 + ], + "unique_experts": 62, + "load_cv": 0.9141591105900023, + "normalized_load_entropy": 0.9193425529531362, + "max_load_share": 0.0959119496855346 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "d3b65a8acf2a591edfb995b9389ca0fe04fcc15aadaa7ab6c8bfca889542dbdc", + "route_weight_sha256": "eef25ae3faa1ffcf9ac8b243c84e78d30fb27a1a48f56959c717be65c338bc3c", + "loads": [ + 4, + 9, + 17, + 13, + 15, + 3, + 24, + 20, + 15, + 16, + 2, + 12, + 20, + 2, + 18, + 3, + 18, + 8, + 12, + 16, + 20, + 24, + 20, + 10, + 15, + 13, + 6, + 16, + 7, + 12, + 12, + 18, + 4, + 27, + 5, + 13, + 5, + 6, + 6, + 8, + 15, + 13, + 15, + 5, + 23, + 10, + 16, + 15, + 9, + 22, + 7, + 61, + 19, + 17, + 6, + 9, + 14, + 22, + 26, + 19, + 9, + 10, + 22, + 4 + ], + "weighted_loads": [ + 0.12148543260991573, + 0.5891324877738953, + 1.6893120687454939, + 1.1552968993782997, + 1.5751868281513453, + 0.14034893549978733, + 1.5447685150429606, + 1.1971549708396196, + 1.047583932057023, + 1.056356344372034, + 0.1019085943698883, + 0.9089954476803541, + 1.0678573716431856, + 0.07586383819580078, + 1.3011880051344633, + 0.13233773410320282, + 1.7977315112948418, + 0.357992310076952, + 0.6054146215319633, + 0.625541502609849, + 1.426180636510253, + 1.5796535983681679, + 0.7907209973782301, + 0.35431470535695553, + 0.8968332130461931, + 1.9146367032080889, + 0.3517749607563019, + 1.0392743982374668, + 0.40644277073442936, + 0.9734897594898939, + 0.6087853815406561, + 1.8454261757433414, + 0.15266600996255875, + 1.3289429228752851, + 0.4085749387741089, + 0.795368729159236, + 0.19613798893988132, + 0.22164497151970863, + 0.2907218523323536, + 0.5843880791217089, + 0.7127202088013291, + 0.5825959257781506, + 1.088293505832553, + 0.18119067698717117, + 1.8818665593862534, + 0.5035261269658804, + 0.8030493780970573, + 1.0926791280508041, + 0.38568277657032013, + 1.513484327122569, + 0.4121457561850548, + 3.1606909949332476, + 1.2860839162021875, + 1.2052772101014853, + 0.8567178063094616, + 0.5468522906303406, + 0.5147812590003014, + 1.3805900104343891, + 2.0235876757651567, + 1.2062139175832272, + 0.38777258805930614, + 0.43698357604444027, + 1.578535333275795, + 0.22310169599950314 + ], + "unique_experts": 64, + "load_cv": 0.6375673696984512, + "normalized_load_entropy": 0.9574889783031489, + "max_load_share": 0.0691609977324263 + } + }, + "s0_period": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "312287d94ba7ceee24c24689b787e3f05ee05ca2f3a881ab90b8efaaeb9252df", + "route_weight_sha256": "dcfdbb0da7bb2b4434bd02914876f653f44746f81fb75d265d7482a2a8252263", + "loads": [ + 2, + 1, + 13, + 15, + 5, + 0, + 12, + 21, + 15, + 11, + 0, + 5, + 4, + 3, + 5, + 0, + 16, + 3, + 13, + 9, + 16, + 23, + 11, + 6, + 7, + 13, + 6, + 12, + 5, + 9, + 8, + 17, + 1, + 26, + 5, + 13, + 4, + 5, + 5, + 6, + 10, + 4, + 3, + 4, + 22, + 10, + 14, + 5, + 8, + 21, + 3, + 63, + 17, + 7, + 3, + 8, + 10, + 20, + 15, + 18, + 6, + 0, + 13, + 1 + ], + "weighted_loads": [ + 0.06358209624886513, + 0.03663429617881775, + 1.3432428166270256, + 1.1630032565444708, + 0.18375949561595917, + 0.0, + 0.9889124277979136, + 1.2215686459094286, + 1.0445749573409557, + 0.7982793655246496, + 0.0, + 0.18329682014882565, + 0.15870322287082672, + 0.10909896716475487, + 0.38114331290125847, + 0.0, + 1.4679064266383648, + 0.13937867805361748, + 0.5746432598680258, + 0.30881495028734207, + 1.080093115568161, + 1.513673521578312, + 0.4252477325499058, + 0.22287601418793201, + 0.29604440927505493, + 1.8847068939357996, + 0.3522387593984604, + 0.8316290844231844, + 0.3365580029785633, + 0.8149976544082165, + 0.4994977377355099, + 1.808031177148223, + 0.0279703289270401, + 1.327851790934801, + 0.421178026124835, + 0.8075740281492472, + 0.14069225080311298, + 0.17874457873404026, + 0.24936224520206451, + 0.4924851842224598, + 0.528716079890728, + 0.13511401042342186, + 0.10941470973193645, + 0.14962968230247498, + 1.9198567122220993, + 0.5108954161405563, + 0.7210119124501944, + 0.3270186074078083, + 0.33649994246661663, + 1.4654654487967491, + 0.10239645093679428, + 3.3295981511473656, + 1.1893058344721794, + 0.40276019647717476, + 0.10724116303026676, + 0.512523191049695, + 0.377984169870615, + 1.279694240540266, + 1.524888675659895, + 1.132784390822053, + 0.2677672654390335, + 0.0, + 0.8020093217492104, + 0.03286139667034149 + ], + "unique_experts": 60, + "load_cv": 0.932155251680339, + "normalized_load_entropy": 0.9163043618196356, + "max_load_share": 0.09905660377358491 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "5c90c73b68f8c6d48ae9959eba8c669cc9bf1718b49ab5567a2ff213b7172f7a", + "route_weight_sha256": "eb8a38c7aaa596ca9612721a529d5c001aa2943c6c49e52c2c1449c1c5abeb2d", + "loads": [ + 3, + 5, + 15, + 15, + 10, + 3, + 22, + 21, + 15, + 16, + 0, + 6, + 13, + 4, + 11, + 0, + 18, + 3, + 13, + 13, + 16, + 23, + 17, + 12, + 15, + 13, + 6, + 14, + 5, + 13, + 13, + 17, + 1, + 26, + 6, + 14, + 5, + 10, + 6, + 7, + 14, + 6, + 12, + 5, + 23, + 10, + 14, + 11, + 9, + 21, + 3, + 63, + 17, + 11, + 9, + 8, + 10, + 20, + 23, + 19, + 8, + 4, + 20, + 1 + ], + "weighted_loads": [ + 0.10229088366031647, + 0.3876738455146551, + 1.5590298380702734, + 1.1630032565444708, + 0.9989767707884312, + 0.13528886251151562, + 1.4143636235967278, + 1.2215686459094286, + 1.0445749573409557, + 1.1599237620830536, + 0.0, + 0.21307631023228168, + 0.754553310573101, + 0.1486627534031868, + 0.8893502317368984, + 0.0, + 1.5517134293913841, + 0.13937867805361748, + 0.5746432598680258, + 0.48590949177742004, + 1.080093115568161, + 1.513673521578312, + 0.6560585517436266, + 0.4487905967980623, + 0.716850595548749, + 1.8847068939357996, + 0.3522387593984604, + 0.9476882722228765, + 0.3365580029785633, + 0.9742472842335701, + 0.6892205569893122, + 1.808031177148223, + 0.0279703289270401, + 1.327851790934801, + 0.48683938197791576, + 0.8654015827924013, + 0.19448243640363216, + 0.38147267140448093, + 0.29085133969783783, + 0.521311542019248, + 0.6901942463591695, + 0.26671554893255234, + 0.7676226366311312, + 0.20725352689623833, + 1.930570561438799, + 0.5108954161405563, + 0.7210119124501944, + 0.8737041242420673, + 0.37479262985289097, + 1.4654654487967491, + 0.10239645093679428, + 3.3295981511473656, + 1.1893058344721794, + 0.7162090688943863, + 0.9344258792698383, + 0.512523191049695, + 0.377984169870615, + 1.279694240540266, + 1.8470892198383808, + 1.1782238576561213, + 0.43718715012073517, + 0.26744359731674194, + 1.3517743237316608, + 0.03286139667034149 + ], + "unique_experts": 62, + "load_cv": 0.7372595154235082, + "normalized_load_entropy": 0.9432568140553036, + "max_load_share": 0.08015267175572519 + } + }, + "s1_period": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "2b7f8fc97835afe18a75c9b15a3555c668c08ad5331a90babc49c363b6696a3d", + "route_weight_sha256": "af844570fa4ef37a2a302531611b58ac2dd1af2f807a030baa82b91a6d18bde8", + "loads": [ + 2, + 1, + 14, + 14, + 3, + 0, + 11, + 21, + 14, + 9, + 0, + 5, + 6, + 2, + 6, + 1, + 15, + 3, + 11, + 12, + 16, + 23, + 11, + 4, + 6, + 13, + 6, + 13, + 5, + 9, + 8, + 18, + 0, + 29, + 5, + 13, + 3, + 5, + 5, + 6, + 10, + 4, + 4, + 5, + 22, + 10, + 15, + 5, + 8, + 21, + 2, + 60, + 17, + 8, + 3, + 8, + 12, + 20, + 15, + 17, + 8, + 0, + 12, + 2 + ], + "weighted_loads": [ + 0.06588625721633434, + 0.040522072464227676, + 1.4195392709225416, + 1.1880709044635296, + 0.11659019812941551, + 0.0, + 0.9435665421187878, + 1.245522791519761, + 1.0087318383157253, + 0.6307936459779739, + 0.0, + 0.18146952241659164, + 0.23785658553242683, + 0.08120222389698029, + 0.4094381295144558, + 0.021432416513562202, + 1.3969067111611366, + 0.1382354237139225, + 0.4989597350358963, + 0.40300713665783405, + 1.0967124551534653, + 1.5335080809891224, + 0.43338337168097496, + 0.14933031797409058, + 0.25937472842633724, + 1.9055382497608662, + 0.3531833589076996, + 0.8544354028999805, + 0.33404253982007504, + 0.8875616975128651, + 0.4797359649091959, + 1.8572262823581696, + 0.0, + 1.402329595759511, + 0.4235295746475458, + 0.8107046484947205, + 0.1162067074328661, + 0.18363579735159874, + 0.23869038745760918, + 0.48364875465631485, + 0.5478254333138466, + 0.1527796946465969, + 0.14225500263273716, + 0.18041695468127728, + 1.8732384033501148, + 0.5138366520404816, + 0.7765896189957857, + 0.3162124790251255, + 0.3518810626119375, + 1.4464839175343513, + 0.07698192819952965, + 3.1778409648686647, + 1.1848730202764273, + 0.45791058614850044, + 0.1044264379888773, + 0.5126444566994905, + 0.4245098661631346, + 1.3042138740420341, + 1.48241650685668, + 1.1237642019987106, + 0.3055806662887335, + 0.0, + 0.779919546097517, + 0.058672426268458366 + ], + "unique_experts": 60, + "load_cv": 0.913812887366643, + "normalized_load_entropy": 0.9171938752177742, + "max_load_share": 0.09433962264150944 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "ff23261d904664f89c1ff34df855e1d2624d356db6c08ea61ea55616d2445d66", + "route_weight_sha256": "160a05eede3ba6183227a9a16ef162dc4a5f833df8ce9e359c2faae40812c704", + "loads": [ + 5, + 7, + 16, + 14, + 15, + 3, + 22, + 21, + 14, + 16, + 1, + 13, + 19, + 2, + 18, + 3, + 19, + 8, + 12, + 19, + 20, + 24, + 20, + 8, + 14, + 13, + 6, + 15, + 6, + 11, + 13, + 18, + 2, + 29, + 6, + 13, + 5, + 6, + 6, + 9, + 14, + 13, + 15, + 6, + 23, + 10, + 15, + 17, + 9, + 22, + 7, + 60, + 20, + 18, + 7, + 8, + 14, + 22, + 25, + 19, + 11, + 10, + 22, + 4 + ], + "weighted_loads": [ + 0.16256115958094597, + 0.4829951152205467, + 1.6775709930807352, + 1.1880709044635296, + 1.6307646427303553, + 0.14106940291821957, + 1.479676610790193, + 1.245522791519761, + 1.0087318383157253, + 1.005575593560934, + 0.06625212728977203, + 0.9423128664493561, + 0.9666301161050797, + 0.08120222389698029, + 1.2811944279819727, + 0.1318837832659483, + 1.8261455744504929, + 0.36284860223531723, + 0.5987480506300926, + 0.7360026855021715, + 1.4318815413862467, + 1.587928555905819, + 0.7883178070187569, + 0.2983427718281746, + 0.8272808268666267, + 1.9055382497608662, + 0.3531833589076996, + 0.9805682301521301, + 0.3734413478523493, + 0.9608346968889236, + 0.6585789751261473, + 1.8572262823581696, + 0.09011010080575943, + 1.402329595759511, + 0.48061676137149334, + 0.8107046484947205, + 0.1954998318105936, + 0.21305351331830025, + 0.2819759361445904, + 0.6328785847872496, + 0.6943200463429093, + 0.598762072622776, + 0.935695881024003, + 0.21853467635810375, + 1.8839522525668144, + 0.5138366520404816, + 0.7765896189957857, + 1.2243086285889149, + 0.3861797694116831, + 1.4897097162902355, + 0.41037797182798386, + 3.1778409648686647, + 1.3283480629324913, + 1.2463885210454464, + 0.8737772535532713, + 0.5126444566994905, + 0.5046943295747042, + 1.3924769461154938, + 1.9917550962418318, + 1.2167414240539074, + 0.4596413020044565, + 0.43835523165762424, + 1.5440325550734997, + 0.22278773970901966 + ], + "unique_experts": 64, + "load_cv": 0.636921854256399, + "normalized_load_entropy": 0.9565878112582266, + "max_load_share": 0.06802721088435375 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 106, + "ordered_topk_exact_tokens": 77, + "set_exact_tokens": 89, + "mean_set_jaccard": 0.9541778975741241, + "mean_token_weighted_tv": 0.01045321486890316, + "aggregate_load_tv": 0.018867924528301883 + }, + "system_bos": { + "tokens": 106, + "ordered_topk_exact_tokens": 68, + "set_exact_tokens": 84, + "mean_set_jaccard": 0.938679245283019, + "mean_token_weighted_tv": 0.014843375536279296, + "aggregate_load_tv": 0.02672955974842767 + }, + "system_x": { + "tokens": 106, + "ordered_topk_exact_tokens": 60, + "set_exact_tokens": 70, + "mean_set_jaccard": 0.9009433962264151, + "mean_token_weighted_tv": 0.019664557413461636, + "aggregate_load_tv": 0.03773584905660378 + }, + "system_period": { + "tokens": 106, + "ordered_topk_exact_tokens": 56, + "set_exact_tokens": 73, + "mean_set_jaccard": 0.9090296495956873, + "mean_token_weighted_tv": 0.01904809374783961, + "aggregate_load_tv": 0.03459119496855346 + }, + "bos_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 59, + "set_exact_tokens": 78, + "mean_set_jaccard": 0.9245283018867925, + "mean_token_weighted_tv": 0.0170702924249026, + "aggregate_load_tv": 0.02987421383647798 + }, + "bos_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 58, + "set_exact_tokens": 72, + "mean_set_jaccard": 0.9063342318059299, + "mean_token_weighted_tv": 0.019168544323447178, + "aggregate_load_tv": 0.026729559748427674 + }, + "x_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 54, + "set_exact_tokens": 73, + "mean_set_jaccard": 0.9090296495956873, + "mean_token_weighted_tv": 0.018149983058771434, + "aggregate_load_tv": 0.036163522012578615 + }, + "x_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 49, + "set_exact_tokens": 69, + "mean_set_jaccard": 0.8982479784366577, + "mean_token_weighted_tv": 0.021760528081290004, + "aggregate_load_tv": 0.03301886792452831 + }, + "period_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 51, + "set_exact_tokens": 76, + "mean_set_jaccard": 0.9191374663072778, + "mean_token_weighted_tv": 0.017924610340862342, + "aggregate_load_tv": 0.029874213836477988 + }, + "period_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 45, + "set_exact_tokens": 63, + "mean_set_jaccard": 0.8840970350404314, + "mean_token_weighted_tv": 0.0232401428621192, + "aggregate_load_tv": 0.034591194968553465 + } + } + }, + "layer_20": { + "layer": 20, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "6c3f1a4a50467e96816e924647cfe079079df5cd828b95f42e5cc718dec46a26", + "route_weight_sha256": "d658a805b179e837f15b50da38f457bd619e2725156f82f56b73e40fdb5d3137", + "loads": [ + 9, + 13, + 4, + 4, + 15, + 19, + 20, + 8, + 3, + 2, + 10, + 5, + 3, + 13, + 6, + 1, + 1, + 17, + 3, + 20, + 8, + 18, + 4, + 12, + 14, + 3, + 5, + 1, + 18, + 7, + 30, + 0, + 0, + 12, + 2, + 5, + 21, + 3, + 3, + 3, + 2, + 6, + 12, + 20, + 4, + 6, + 56, + 30, + 11, + 5, + 0, + 8, + 14, + 16, + 5, + 3, + 9, + 6, + 18, + 20, + 5, + 8, + 21, + 6 + ], + "weighted_loads": [ + 0.3836801405996084, + 0.5960327330976725, + 0.13837837427854538, + 0.145584337413311, + 0.5487233009189367, + 1.2490468434989452, + 1.9708814416080713, + 0.42039212211966515, + 0.09930658340454102, + 0.1562987957149744, + 0.5534305982291698, + 0.16803507879376411, + 0.509739100933075, + 1.5698324963450432, + 0.18764927797019482, + 0.03576904907822609, + 0.03288915380835533, + 1.1031919121742249, + 0.17169375158846378, + 1.1937086042016745, + 0.2681904975324869, + 0.8927742652595043, + 0.3571596331894398, + 0.7319884411990643, + 1.0634860657155514, + 0.11218030750751495, + 0.17601155675947666, + 0.04646219685673714, + 1.7439204454421997, + 0.21318337880074978, + 1.119807243347168, + 0.0, + 0.0, + 0.4539270494133234, + 0.07266579195857048, + 0.22331367246806622, + 2.030921310186386, + 0.09756922908127308, + 0.08337868005037308, + 0.09970558062195778, + 0.0829203836619854, + 0.2626734543591738, + 0.7656213454902172, + 1.4417044389992952, + 0.23315680399537086, + 0.3200017213821411, + 3.1857185531407595, + 1.6206759922206402, + 0.36892347782850266, + 0.16763169318437576, + 0.0, + 0.38632757589221, + 0.5689267851412296, + 0.8140505310148001, + 0.2745877355337143, + 0.1191011480987072, + 0.31753470562398434, + 0.22900984436273575, + 0.9713284112513065, + 0.9813624378293753, + 0.7191325798630714, + 0.2650705315172672, + 1.2379609141498804, + 0.20932387374341488 + ], + "unique_experts": 61, + "load_cv": 0.9355438401318618, + "normalized_load_entropy": 0.910915845685971, + "max_load_share": 0.0880503144654088 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "0d86e55895476dbcc572ed392e084ce62b36b9164237e0459055674b0b3e6e42", + "route_weight_sha256": "5238357ac9253f6f023a15ab0eb9806d4ae614001bd88e22fa1f72f518096aec", + "loads": [ + 9, + 15, + 4, + 12, + 23, + 23, + 24, + 14, + 3, + 2, + 10, + 6, + 5, + 14, + 6, + 4, + 4, + 17, + 13, + 21, + 13, + 18, + 11, + 12, + 14, + 9, + 6, + 1, + 18, + 9, + 30, + 0, + 0, + 13, + 3, + 5, + 24, + 5, + 5, + 4, + 4, + 8, + 14, + 22, + 16, + 6, + 56, + 30, + 13, + 5, + 8, + 8, + 15, + 24, + 5, + 6, + 9, + 12, + 18, + 20, + 18, + 12, + 22, + 6 + ], + "weighted_loads": [ + 0.3836801405996084, + 0.6407086551189423, + 0.13837837427854538, + 0.7404818013310432, + 0.9466882813721895, + 1.406091695651412, + 2.084487061947584, + 0.8223049305379391, + 0.09930658340454102, + 0.1562987957149744, + 0.5534305982291698, + 0.21060629189014435, + 0.5676251873373985, + 1.6208187118172646, + 0.18764927797019482, + 0.17366956174373627, + 0.1460942067205906, + 1.1031919121742249, + 1.0555304903537035, + 1.2526185605674982, + 0.4212864248547703, + 0.8927742652595043, + 0.7078925892710686, + 0.7319884411990643, + 1.0634860657155514, + 0.7558391653001308, + 0.1934576816856861, + 0.04646219685673714, + 1.7439204454421997, + 0.2789151482284069, + 1.119807243347168, + 0.0, + 0.0, + 0.4770288560539484, + 0.11709551885724068, + 0.22331367246806622, + 2.163119899109006, + 0.15508219227194786, + 1.402389831840992, + 0.1292266920208931, + 0.16816669330000877, + 0.3397859577089548, + 0.9686676450073719, + 1.4800183865008876, + 0.6523912064731121, + 0.3200017213821411, + 3.1857185531407595, + 1.6206759922206402, + 0.40563441428821534, + 0.16763169318437576, + 1.1756745129823685, + 0.38632757589221, + 0.607893094420433, + 1.4394291024655104, + 0.2745877355337143, + 0.5866982266306877, + 0.31753470562398434, + 0.4165533632040024, + 0.9713284112513065, + 0.9813624378293753, + 2.0399483423680067, + 0.4983102083206177, + 1.271981855854392, + 0.20932387374341488 + ], + "unique_experts": 62, + "load_cv": 0.7486928742903053, + "normalized_load_entropy": 0.9387350721814224, + "max_load_share": 0.07124681933842239 + } + }, + "s1_eos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "97b50ccf01f64fc4874f4799100c2970095f260171d899833e9d11e6ad2bf463", + "route_weight_sha256": "091da83c4ea6227df01bef6b71d725994359f4a7b8f07df25848e9f0726c2cff", + "loads": [ + 8, + 13, + 4, + 3, + 14, + 19, + 20, + 9, + 4, + 2, + 10, + 7, + 3, + 13, + 5, + 1, + 1, + 16, + 4, + 21, + 7, + 17, + 4, + 13, + 14, + 3, + 6, + 1, + 19, + 7, + 28, + 0, + 0, + 12, + 3, + 5, + 21, + 3, + 3, + 2, + 2, + 5, + 12, + 21, + 4, + 6, + 58, + 29, + 10, + 5, + 0, + 8, + 12, + 17, + 5, + 3, + 9, + 7, + 18, + 19, + 6, + 9, + 21, + 5 + ], + "weighted_loads": [ + 0.34800461307168007, + 0.5936350170522928, + 0.1399261374026537, + 0.12205862626433372, + 0.5125010497868061, + 1.2748594135046005, + 2.0019055791199207, + 0.44481061212718487, + 0.1356974057853222, + 0.15671133436262608, + 0.5625528134405613, + 0.23295140080153942, + 0.49899613857269287, + 1.5599395390599966, + 0.15014123171567917, + 0.04090045392513275, + 0.03201787546277046, + 1.0571095794439316, + 0.19575881771743298, + 1.2516359277069569, + 0.24393238686025143, + 0.8606856353580952, + 0.347602054476738, + 0.7572535835206509, + 1.0646220855414867, + 0.1087016798555851, + 0.20851163566112518, + 0.04584019258618355, + 1.7662964761257172, + 0.21302062086760998, + 1.0589079298079014, + 0.0, + 0.0, + 0.445318304002285, + 0.10177141427993774, + 0.2219333667308092, + 2.018470421433449, + 0.0962213110178709, + 0.0832015611231327, + 0.0676143690943718, + 0.08072765544056892, + 0.25633892975747585, + 0.7838907726109028, + 1.471002908423543, + 0.23803097754716873, + 0.3211229741573334, + 3.2433493714779615, + 1.5738085769116879, + 0.3491553273051977, + 0.16721632331609726, + 0.0, + 0.3718805592507124, + 0.5144103318452835, + 0.8485818058252335, + 0.27157289907336235, + 0.11830523982644081, + 0.32212502881884575, + 0.2566895801573992, + 0.9664016738533974, + 0.9540792554616928, + 0.7670901045203209, + 0.29410478472709656, + 1.2516665142029524, + 0.17167235724627972 + ], + "unique_experts": 61, + "load_cv": 0.940267348051329, + "normalized_load_entropy": 0.9114518351365545, + "max_load_share": 0.09119496855345911 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "a443cb56ed9680530bb8d7ade4d9685cd45e90603ecd44cdea54a9b1a0665e8c", + "route_weight_sha256": "2e27d0ee1e79660d4444b3a0962f289189a148fe1d7430a74a5fe7ea90514c75", + "loads": [ + 13, + 15, + 4, + 14, + 23, + 25, + 22, + 17, + 4, + 4, + 12, + 7, + 5, + 15, + 6, + 12, + 8, + 16, + 14, + 23, + 12, + 18, + 15, + 15, + 15, + 16, + 7, + 3, + 19, + 12, + 28, + 1, + 1, + 12, + 6, + 7, + 25, + 9, + 6, + 6, + 6, + 6, + 14, + 26, + 19, + 7, + 58, + 29, + 12, + 10, + 13, + 8, + 12, + 27, + 6, + 14, + 11, + 14, + 20, + 20, + 20, + 11, + 22, + 5 + ], + "weighted_loads": [ + 0.5798699762672186, + 0.637951985001564, + 0.1399261374026537, + 0.8794953711330891, + 0.9650704972445965, + 1.5057506300508976, + 2.070968883112073, + 1.007357407361269, + 0.1356974057853222, + 0.39229353703558445, + 0.6543648391962051, + 0.23295140080153942, + 0.5623743273317814, + 1.89359419234097, + 0.2108682543039322, + 0.6769276112318039, + 0.3965901881456375, + 1.0571095794439316, + 1.1885441895574331, + 1.3477864786982536, + 0.4018896669149399, + 0.897039134055376, + 0.9597973003983498, + 0.929216992110014, + 1.0845962837338448, + 1.136239182204008, + 0.22595776058733463, + 0.10657254420220852, + 1.7662964761257172, + 0.3726684544235468, + 1.0589079298079014, + 0.031783509999513626, + 0.04884977638721466, + 0.445318304002285, + 0.24888898059725761, + 0.39922397397458553, + 2.2047569695860147, + 0.31327310763299465, + 1.442513331770897, + 0.264201994985342, + 0.25503136217594147, + 0.309299373999238, + 0.9786683730781078, + 1.6570695834234357, + 1.1059652101248503, + 0.3941517025232315, + 3.2433493714779615, + 1.5738085769116879, + 0.3842994443839416, + 0.4806552678346634, + 1.7543159276247025, + 0.3718805592507124, + 0.5144103318452835, + 1.512092811986804, + 0.3001569751650095, + 1.2256633006036282, + 0.4063292369246483, + 0.7975587528198957, + 1.040771059691906, + 0.9820582363754511, + 2.2408503476763144, + 0.4181135930120945, + 1.3140113186091185, + 0.17167235724627972 + ], + "unique_experts": 64, + "load_cv": 0.6490768794607117, + "normalized_load_entropy": 0.9547516249284759, + "max_load_share": 0.06575963718820861 + } + }, + "s0_bos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "9e1481a43f5990fa891d58b42b89839602d2a317e6881006653a04756489ecec", + "route_weight_sha256": "e2e8a510a773821ba2791cd4a5a81fb68f90076802101990a5a506b8a04bbf51", + "loads": [ + 10, + 14, + 3, + 3, + 13, + 18, + 20, + 7, + 4, + 2, + 10, + 6, + 3, + 13, + 4, + 1, + 1, + 17, + 4, + 21, + 6, + 17, + 4, + 13, + 14, + 5, + 8, + 0, + 20, + 3, + 26, + 0, + 1, + 11, + 5, + 5, + 20, + 2, + 2, + 3, + 3, + 6, + 12, + 20, + 4, + 6, + 59, + 32, + 10, + 5, + 0, + 9, + 14, + 16, + 5, + 5, + 8, + 6, + 17, + 20, + 6, + 8, + 20, + 6 + ], + "weighted_loads": [ + 0.4269222021102905, + 0.6191753540188074, + 0.10445233806967735, + 0.1164909154176712, + 0.4820384494960308, + 1.2168205883353949, + 1.991246361285448, + 0.38638032227754593, + 0.12775330431759357, + 0.15867457166314125, + 0.5667191036045551, + 0.20906530693173409, + 0.48015690594911575, + 1.5824478901922703, + 0.1253842506557703, + 0.03881518915295601, + 0.03406341373920441, + 1.1092703640460968, + 0.19923105090856552, + 1.3128098994493484, + 0.2077900394797325, + 0.8769491761922836, + 0.35552046820521355, + 0.7808804530650377, + 1.0736193619668484, + 0.1654472816735506, + 0.25483197905123234, + 0.0, + 1.8265505395829678, + 0.10468458198010921, + 0.9883724078536034, + 0.0, + 0.027167366817593575, + 0.41760194674134254, + 0.16216593235731125, + 0.22350443713366985, + 2.061628010123968, + 0.07334604486823082, + 0.05354991741478443, + 0.1012125313282013, + 0.11296587809920311, + 0.2591697722673416, + 0.7978464625775814, + 1.4557188898324966, + 0.2288980819284916, + 0.3267051726579666, + 3.3569218534976244, + 1.6606667041778564, + 0.34095749258995056, + 0.16888484358787537, + 0.0, + 0.42317664436995983, + 0.5856460276991129, + 0.8088373132050037, + 0.2664756067097187, + 0.19069992192089558, + 0.2816794030368328, + 0.2344888038933277, + 0.9313726797699928, + 1.0275105275213718, + 0.7138689942657948, + 0.2642555981874466, + 1.2284987401217222, + 0.22934598848223686 + ], + "unique_experts": 61, + "load_cv": 0.9481431934096507, + "normalized_load_entropy": 0.911274448645384, + "max_load_share": 0.09276729559748427 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "4651c40ade68d64ed9c9d7389eab51865c739720575181a54482c6d29b73c365", + "route_weight_sha256": "d1ef29bffd4de0e227edb6c792eb71648261b9034a018e476fa3e8746006529f", + "loads": [ + 10, + 15, + 3, + 11, + 21, + 22, + 24, + 12, + 4, + 2, + 10, + 7, + 5, + 14, + 4, + 5, + 4, + 17, + 14, + 22, + 10, + 17, + 13, + 13, + 14, + 12, + 11, + 0, + 20, + 5, + 27, + 1, + 1, + 12, + 6, + 5, + 23, + 4, + 3, + 4, + 5, + 8, + 14, + 22, + 16, + 6, + 60, + 33, + 11, + 5, + 8, + 9, + 15, + 23, + 5, + 8, + 8, + 11, + 17, + 20, + 18, + 11, + 20, + 6 + ], + "weighted_loads": [ + 0.4269222021102905, + 0.64329001493752, + 0.10445233806967735, + 0.7113883793354034, + 0.8800034299492836, + 1.3883830532431602, + 2.104851981624961, + 0.7246359437704086, + 0.12775330431759357, + 0.15867457166314125, + 0.5667191036045551, + 0.9070173390209675, + 0.5380429923534393, + 1.6363070495426655, + 0.1253842506557703, + 0.26333313807845116, + 0.13267302885651588, + 1.1092703640460968, + 1.0830677896738052, + 1.366136372089386, + 0.3617339916527271, + 0.8769491761922836, + 0.8068186864256859, + 0.7808804530650377, + 1.0736193619668484, + 0.8533379565924406, + 0.3555988762527704, + 0.0, + 1.8265505395829678, + 0.17041635140776634, + 1.0270861461758614, + 0.011960592120885849, + 0.027167366817593575, + 0.44070375338196754, + 0.20497947558760643, + 0.22350443713366985, + 2.204408621415496, + 0.1308590080589056, + 0.41824922151863575, + 0.12981083802878857, + 0.18992702662944794, + 0.3144384101033211, + 0.996038231998682, + 1.5728982016444206, + 0.64052421040833, + 0.3267051726579666, + 3.4940895307809114, + 1.67178229149431, + 0.3760291039943695, + 0.16888484358787537, + 1.191018771380186, + 0.42317664436995983, + 0.6271752882748842, + 1.3448758535087109, + 0.2664756067097187, + 0.6477333586663008, + 0.2816794030368328, + 0.38431721925735474, + 0.9313726797699928, + 1.0275105275213718, + 2.027662670239806, + 0.4643736071884632, + 1.2284987401217222, + 0.22934598848223686 + ], + "unique_experts": 63, + "load_cv": 0.7630830714997835, + "normalized_load_entropy": 0.939391201513075, + "max_load_share": 0.07633587786259542 + } + }, + "s1_bos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "9a1082dd6a5953616dd693616ced520f935d212308c6a834543b29a5f37bf089", + "route_weight_sha256": "15d33c98c6d8cd311f54764595cf107b95a2ec70467bc3396effabd64b47c39b", + "loads": [ + 7, + 14, + 3, + 3, + 12, + 20, + 20, + 8, + 5, + 2, + 9, + 9, + 3, + 13, + 3, + 1, + 2, + 17, + 3, + 20, + 7, + 18, + 4, + 14, + 14, + 4, + 11, + 0, + 20, + 4, + 28, + 1, + 1, + 11, + 5, + 5, + 21, + 3, + 3, + 2, + 3, + 6, + 12, + 18, + 4, + 6, + 56, + 31, + 7, + 4, + 0, + 11, + 14, + 16, + 5, + 3, + 9, + 6, + 17, + 21, + 5, + 8, + 19, + 5 + ], + "weighted_loads": [ + 0.3292253464460373, + 0.6347652189433575, + 0.10140948370099068, + 0.11388716846704483, + 0.447505671530962, + 1.337486632168293, + 2.001825388520956, + 0.39821422658860683, + 0.15820332244038582, + 0.16010856069624424, + 0.5324860438704491, + 0.30923585779964924, + 0.4618055745959282, + 1.570596620440483, + 0.09703133255243301, + 0.053258657455444336, + 0.05887812562286854, + 1.090899258852005, + 0.1662131380289793, + 1.2561215907335281, + 0.23931296356022358, + 0.8933871984481812, + 0.35543326288461685, + 0.801154762506485, + 1.0764933973550797, + 0.13106725178658962, + 0.36533438600599766, + 0.0, + 1.8317977227270603, + 0.12091121822595596, + 1.0299732349812984, + 0.026539500802755356, + 0.02769242413341999, + 0.41187727078795433, + 0.16067108511924744, + 0.21808107569813728, + 1.9549671709537506, + 0.10102839209139347, + 0.07971356995403767, + 0.06760598719120026, + 0.11434083431959152, + 0.2634014431387186, + 0.7899519428610802, + 1.37052808329463, + 0.2310006357729435, + 0.32490185275673866, + 3.2613895758986473, + 1.6453487928956747, + 0.24717592261731625, + 0.13525008410215378, + 0.0, + 0.4726101364940405, + 0.5787993632256985, + 0.8183458521962166, + 0.25595684722065926, + 0.12355964630842209, + 0.3324855137616396, + 0.2392813004553318, + 0.9296337235718966, + 1.0412919707596302, + 0.7074060142040253, + 0.2660922724753618, + 1.1507893037050962, + 0.18398230336606503 + ], + "unique_experts": 62, + "load_cv": 0.9279021143248046, + "normalized_load_entropy": 0.9136585174381119, + "max_load_share": 0.0880503144654088 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "5d396952e62db2eff84d5a7eca509197c7fb464b60a2482c4ea49c53782e4593", + "route_weight_sha256": "cec0269b52f93388e462092dbdf4a2cf4d6819fdb8f75ea4680e1514a361438f", + "loads": [ + 12, + 15, + 3, + 14, + 21, + 27, + 22, + 16, + 5, + 4, + 11, + 9, + 5, + 16, + 4, + 13, + 8, + 17, + 13, + 22, + 12, + 19, + 16, + 16, + 15, + 17, + 14, + 2, + 20, + 8, + 28, + 2, + 2, + 11, + 7, + 7, + 25, + 9, + 5, + 7, + 8, + 8, + 14, + 23, + 19, + 7, + 56, + 31, + 7, + 9, + 13, + 11, + 15, + 27, + 6, + 14, + 10, + 13, + 18, + 22, + 17, + 10, + 20, + 5 + ], + "weighted_loads": [ + 0.5634282361716032, + 0.6588798798620701, + 0.10140948370099068, + 0.8713239133358002, + 0.8967431001365185, + 1.6323695816099644, + 2.0708886925131083, + 0.9408844001591206, + 0.15820332244038582, + 0.3956907633692026, + 0.6242980696260929, + 0.30923585779964924, + 0.5251837633550167, + 1.9372890833765268, + 0.15775835514068604, + 0.7815737277269363, + 0.3859774488955736, + 1.090899258852005, + 1.1589985098689795, + 1.3476826548576355, + 0.42068600095808506, + 0.929740697145462, + 1.0280301310122013, + 0.9731181710958481, + 1.0964675955474377, + 1.1233196873217821, + 0.4717239923775196, + 0.06073235161602497, + 1.8317977227270603, + 0.2308221459388733, + 1.0299732349812984, + 0.05832301080226898, + 0.07654220052063465, + 0.41187727078795433, + 0.23738977685570717, + 0.3953716829419136, + 2.1476576421409845, + 0.3297802824527025, + 0.48863756470382214, + 0.3225480653345585, + 0.3268497548997402, + 0.3617882300168276, + 0.9805195853114128, + 1.6379482354968786, + 1.1079282946884632, + 0.3979305811226368, + 3.2613895758986473, + 1.6453487928956747, + 0.24717592261731625, + 0.461115337908268, + 1.8338892571628094, + 0.4726101364940405, + 0.6226292997598648, + 1.49050616286695, + 0.2845409233123064, + 1.218984842300415, + 0.3774456735700369, + 0.7801504731178284, + 0.9648097176104784, + 1.0692709516733885, + 2.1366448383778334, + 0.3887991849333048, + 1.2131341081112623, + 0.18398230336606503 + ], + "unique_experts": 64, + "load_cv": 0.6340737792562671, + "normalized_load_entropy": 0.9566773730320619, + "max_load_share": 0.06349206349206349 + } + }, + "s0_x": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "51f6d82fe235c90563ef11217a47d43503b3fb4a00b750d2c77f278822d8798b", + "route_weight_sha256": "bcee1e5099bba1c370b77412be8f4168c58a7f382c3c05d3b36357e5c17d44d7", + "loads": [ + 9, + 12, + 5, + 3, + 14, + 20, + 20, + 6, + 4, + 2, + 10, + 6, + 3, + 14, + 4, + 1, + 1, + 17, + 3, + 21, + 8, + 18, + 4, + 13, + 14, + 4, + 8, + 1, + 20, + 6, + 29, + 0, + 0, + 11, + 3, + 5, + 20, + 3, + 1, + 3, + 2, + 5, + 12, + 19, + 4, + 6, + 59, + 32, + 11, + 4, + 0, + 8, + 12, + 15, + 5, + 5, + 8, + 8, + 16, + 20, + 6, + 6, + 21, + 6 + ], + "weighted_loads": [ + 0.39247806556522846, + 0.5535428579896688, + 0.15909529849886894, + 0.11491327360272408, + 0.5277209747582674, + 1.3325220681726933, + 1.9753159638494253, + 0.36152519285678864, + 0.12943439930677414, + 0.15650968626141548, + 0.5453316867351532, + 0.19925690442323685, + 0.4641479328274727, + 1.6042050085961819, + 0.1286823358386755, + 0.04416121169924736, + 0.032640669494867325, + 1.112773172557354, + 0.1809132657945156, + 1.3107602801173925, + 0.25789863988757133, + 0.8952448107302189, + 0.3576459102332592, + 0.7699424624443054, + 1.0764475464820862, + 0.13466333970427513, + 0.236033346503973, + 0.04656105116009712, + 1.8032477479428053, + 0.19123515859246254, + 1.0955379959195852, + 0.0, + 0.0, + 0.4153561368584633, + 0.09901097789406776, + 0.21791600063443184, + 2.0188991464674473, + 0.10418920964002609, + 0.0243923868983984, + 0.0997721292078495, + 0.07932819798588753, + 0.20772991329431534, + 0.7823712565004826, + 1.4070146717131138, + 0.2294515110552311, + 0.32332926988601685, + 3.374279761686921, + 1.6718152929097414, + 0.36863161623477936, + 0.13796772435307503, + 0.0, + 0.3766275495290756, + 0.518541568890214, + 0.777036240324378, + 0.2634534277021885, + 0.1952764317393303, + 0.2784064207226038, + 0.30653417110443115, + 0.8871715683490038, + 0.9918115362524986, + 0.7348712030798197, + 0.20536432787775993, + 1.2391474675387144, + 0.23224378935992718 + ], + "unique_experts": 61, + "load_cv": 0.960742003239216, + "normalized_load_entropy": 0.9089180299926731, + "max_load_share": 0.09276729559748427 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "0977b932d2328c6b0990a35de6a55a6da0dc914015080b312c3d139a649ee995", + "route_weight_sha256": "4b4c6c25bb7b0e22f1783c72a25ffddcddeb7f8989c3251c99b88fc518ac3a2b", + "loads": [ + 9, + 14, + 5, + 11, + 24, + 24, + 25, + 12, + 4, + 2, + 10, + 6, + 5, + 16, + 4, + 3, + 4, + 17, + 14, + 22, + 12, + 18, + 11, + 13, + 14, + 11, + 9, + 1, + 20, + 10, + 29, + 0, + 0, + 12, + 4, + 5, + 24, + 5, + 2, + 4, + 3, + 6, + 14, + 20, + 17, + 6, + 59, + 32, + 12, + 5, + 8, + 8, + 12, + 22, + 5, + 9, + 8, + 14, + 16, + 20, + 19, + 9, + 21, + 6 + ], + "weighted_loads": [ + 0.39247806556522846, + 0.6148929987102747, + 0.15909529849886894, + 0.7098107375204563, + 1.1013305950909853, + 1.4741214830428362, + 2.126564607024193, + 0.7320884838700294, + 0.12943439930677414, + 0.15650968626141548, + 0.5453316867351532, + 0.19925690442323685, + 0.5220340192317963, + 1.6847444362938404, + 0.1286823358386755, + 0.13838958367705345, + 0.13670655339956284, + 1.112773172557354, + 1.1634345836937428, + 1.3649846967309713, + 0.4077559523284435, + 0.8952448107302189, + 0.7139553315937519, + 0.7699424624443054, + 1.0764475464820862, + 0.7664431147277355, + 0.25347947143018246, + 0.04656105116009712, + 1.8032477479428053, + 0.3236872684210539, + 1.0955379959195852, + 0.0, + 0.0, + 0.4384579434990883, + 0.1337692029774189, + 0.21791600063443184, + 2.1786067206412554, + 0.16170217283070087, + 0.3890916910022497, + 0.1406557746231556, + 0.11775101721286774, + 0.24995852261781693, + 0.9792168252170086, + 1.4436218030750751, + 0.6878452766686678, + 0.32332926988601685, + 3.374279761686921, + 1.6718152929097414, + 0.4037032276391983, + 0.17763836681842804, + 1.2356698364019394, + 0.3766275495290756, + 0.518541568890214, + 1.3437851686030626, + 0.2634534277021885, + 0.7310483120381832, + 0.2784064207226038, + 0.5097403973340988, + 0.8871715683490038, + 0.9918115362524986, + 2.2425935715436935, + 0.40932855010032654, + 1.2391474675387144, + 0.23224378935992718 + ], + "unique_experts": 62, + "load_cv": 0.773733569479971, + "normalized_load_entropy": 0.9359044582010803, + "max_load_share": 0.07506361323155217 + } + }, + "s1_x": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "61bc87f46c555fb4d93f16f7101e7d50bd5238d7cc2bdcd991e18f9325374d89", + "route_weight_sha256": "0a18c341ed2e627e659d11b7493c38469d0e97806c442830e93f9478c19df5ce", + "loads": [ + 7, + 12, + 2, + 4, + 17, + 19, + 20, + 6, + 3, + 2, + 10, + 8, + 4, + 13, + 5, + 1, + 2, + 17, + 4, + 20, + 7, + 18, + 4, + 14, + 14, + 3, + 9, + 0, + 19, + 4, + 30, + 0, + 1, + 9, + 5, + 4, + 19, + 3, + 2, + 2, + 3, + 6, + 12, + 19, + 6, + 6, + 58, + 32, + 9, + 4, + 0, + 10, + 14, + 13, + 5, + 5, + 8, + 7, + 17, + 21, + 5, + 8, + 17, + 8 + ], + "weighted_loads": [ + 0.32787808030843735, + 0.5538746975362301, + 0.0644483957439661, + 0.1544644981622696, + 0.6552547961473465, + 1.2983652278780937, + 2.0064961574971676, + 0.3658000025898218, + 0.10412686690688133, + 0.1604948230087757, + 0.5677108317613602, + 0.273574635386467, + 0.46028604730963707, + 1.5865594986826181, + 0.15125984326004982, + 0.0474623367190361, + 0.057938652113080025, + 1.0982689335942268, + 0.1926271989941597, + 1.2759726718068123, + 0.23402822390198708, + 0.8984367400407791, + 0.34540339186787605, + 0.7845841478556395, + 1.0554709285497665, + 0.10668468475341797, + 0.28726131096482277, + 0.0, + 1.7746240962296724, + 0.12828459404408932, + 1.1141778528690338, + 0.0, + 0.027601873502135277, + 0.3616815321147442, + 0.15927217714488506, + 0.19633875228464603, + 1.9141566716134548, + 0.10516370832920074, + 0.05506864935159683, + 0.06531594693660736, + 0.11210358701646328, + 0.26149473525583744, + 0.7734509035944939, + 1.382076809182763, + 0.306617371737957, + 0.3299890048801899, + 3.283798089250922, + 1.6629420462995768, + 0.30334202758967876, + 0.13569911196827888, + 0.0, + 0.4233777988702059, + 0.5934514924883842, + 0.7163426652550697, + 0.25538530573248863, + 0.19388061203062534, + 0.3109525628387928, + 0.2661246992647648, + 0.91077078320086, + 1.0267343800514936, + 0.7513583973050117, + 0.2535060402005911, + 1.0824588909745216, + 0.2794519867748022 + ], + "unique_experts": 61, + "load_cv": 0.9439620944414331, + "normalized_load_entropy": 0.9121625413876335, + "max_load_share": 0.09119496855345911 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "f7405b71c583f899782f6b5e0ef6fbe6fdea7aff7a2203d437d000a1108ac90d", + "route_weight_sha256": "a9335fb7a30aa0227626b6deeca1f6bce28172eb290349fdb1ca93ca37d2f1fc", + "loads": [ + 11, + 13, + 2, + 16, + 28, + 26, + 23, + 14, + 3, + 4, + 12, + 8, + 6, + 15, + 6, + 14, + 9, + 17, + 15, + 22, + 11, + 19, + 15, + 16, + 16, + 17, + 10, + 3, + 19, + 8, + 30, + 2, + 2, + 9, + 7, + 6, + 23, + 9, + 4, + 6, + 6, + 7, + 14, + 24, + 20, + 7, + 58, + 32, + 9, + 8, + 13, + 10, + 14, + 23, + 6, + 16, + 9, + 15, + 18, + 22, + 19, + 10, + 18, + 8 + ], + "weighted_loads": [ + 0.5243224259465933, + 0.5779893584549427, + 0.0644483957439661, + 0.9485848546028137, + 1.2921566627919674, + 1.5745494924485683, + 2.1145949568599463, + 0.8844284303486347, + 0.10412686690688133, + 0.3960770256817341, + 0.659522857517004, + 0.273574635386467, + 0.5236642360687256, + 1.9179393146187067, + 0.21198686584830284, + 0.7663759626448154, + 0.5436722412705421, + 1.0982689335942268, + 1.2953082993626595, + 1.3697486594319344, + 0.4017397053539753, + 0.93479023873806, + 0.9811049439013004, + 0.9565475564450026, + 1.1140113770961761, + 1.0740705616772175, + 0.3047074358910322, + 0.09458570368587971, + 1.7746240962296724, + 0.23819552175700665, + 1.1141778528690338, + 0.06365732848644257, + 0.07645164988934994, + 0.3616815321147442, + 0.2273098435252905, + 0.37362935952842236, + 2.093276670202613, + 0.331100482493639, + 0.4639926441013813, + 0.2619035728275776, + 0.25061683915555477, + 0.3144551794975996, + 0.9521913751959801, + 1.6072204560041428, + 1.1596484426409006, + 0.40301773324608803, + 3.283798089250922, + 1.6629420462995768, + 0.30334202758967876, + 0.3756384290754795, + 1.7780558802187443, + 0.4233777988702059, + 0.5934514924883842, + 1.2502786424010992, + 0.2839693818241358, + 1.3249907959252596, + 0.3559127226471901, + 0.8520866669714451, + 0.9459467772394419, + 1.054713360965252, + 2.3129964862018824, + 0.4160687495023012, + 1.1448036953806877, + 0.2794519867748022 + ], + "unique_experts": 64, + "load_cv": 0.6572639710365613, + "normalized_load_entropy": 0.9541625999085309, + "max_load_share": 0.06575963718820861 + } + }, + "s0_period": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "98bd658dff460d6c1fbd43bf6e82ccc8a5a7b2dbef7ff9fca8197f1042ba37ad", + "route_weight_sha256": "a05682e2e4288e59a498cffb1c84d5eb4d496b801fca7afae45f0949a83cd9a7", + "loads": [ + 9, + 14, + 4, + 3, + 12, + 20, + 21, + 8, + 5, + 2, + 10, + 7, + 3, + 14, + 4, + 2, + 1, + 17, + 4, + 21, + 6, + 18, + 4, + 13, + 14, + 4, + 5, + 1, + 20, + 7, + 26, + 0, + 1, + 12, + 4, + 5, + 20, + 3, + 1, + 2, + 2, + 6, + 12, + 19, + 5, + 6, + 58, + 30, + 10, + 6, + 0, + 9, + 14, + 14, + 5, + 6, + 8, + 7, + 17, + 20, + 5, + 6, + 19, + 5 + ], + "weighted_loads": [ + 0.39869704470038414, + 0.6135482210665941, + 0.13248439319431782, + 0.12049108371138573, + 0.437824759632349, + 1.2882128730416298, + 2.0202397741377354, + 0.4415227472782135, + 0.16059870459139347, + 0.1579401958733797, + 0.5499989148229361, + 0.2314067017287016, + 0.4565560072660446, + 1.6044344957917929, + 0.12820772267878056, + 0.07761238142848015, + 0.03123394213616848, + 1.1014138124883175, + 0.19464453123509884, + 1.30576347745955, + 0.2097571026533842, + 0.896975927054882, + 0.3528597243130207, + 0.7653199378401041, + 1.0542252771556377, + 0.13111023232340813, + 0.16119654662907124, + 0.04301469773054123, + 1.816213894635439, + 0.21203405037522316, + 0.9917739555239677, + 0.0, + 0.026249468326568604, + 0.443846283480525, + 0.1266219113022089, + 0.21973492950201035, + 2.0282708909362555, + 0.105876624584198, + 0.023611867800354958, + 0.06797175854444504, + 0.07863643392920494, + 0.23961961641907692, + 0.7863439358770847, + 1.41844941675663, + 0.2597696837037802, + 0.3200499303638935, + 3.3316246271133423, + 1.6021062284708023, + 0.3457948751747608, + 0.18737909756600857, + 0.0, + 0.40889466367661953, + 0.5862064175307751, + 0.7295279186218977, + 0.2666463069617748, + 0.22116347774863243, + 0.27746975235641, + 0.2618900127708912, + 0.9216407313942909, + 0.9980559553951025, + 0.701076328754425, + 0.2062208503484726, + 1.1752424947917461, + 0.19765220768749714 + ], + "unique_experts": 62, + "load_cv": 0.9309663318211533, + "normalized_load_entropy": 0.9144144726861227, + "max_load_share": 0.09119496855345911 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "adcff45813d545e2f28e1bd53b4994bb635afa9e3bb50befc589c90925f5bb3d", + "route_weight_sha256": "df866e0da140adef65e99a4b6dd7ec45e0eccda33cd66f4e337048ae5af87446", + "loads": [ + 9, + 16, + 4, + 11, + 22, + 23, + 26, + 14, + 5, + 2, + 10, + 7, + 6, + 15, + 4, + 6, + 4, + 17, + 14, + 22, + 11, + 18, + 11, + 13, + 14, + 12, + 6, + 1, + 20, + 10, + 26, + 0, + 1, + 13, + 5, + 5, + 23, + 5, + 2, + 4, + 4, + 7, + 14, + 20, + 18, + 6, + 58, + 30, + 11, + 7, + 9, + 9, + 14, + 20, + 5, + 9, + 8, + 12, + 17, + 20, + 17, + 10, + 19, + 5 + ], + "weighted_loads": [ + 0.39869704470038414, + 0.6803391817957163, + 0.13248439319431782, + 0.715388547629118, + 0.9213986545801163, + 1.39734704233706, + 2.19400498457253, + 0.9491258859634399, + 0.16059870459139347, + 0.1579401958733797, + 0.5499989148229361, + 0.2314067017287016, + 0.5575976558029652, + 1.6542113814502954, + 0.12820772267878056, + 0.24229858443140984, + 0.1348232589662075, + 1.1014138124883175, + 1.0784812700003386, + 1.360729055479169, + 0.4100628551095724, + 0.896975927054882, + 0.7130755223333836, + 0.7653199378401041, + 1.0542252771556377, + 0.8478012792766094, + 0.17864267155528069, + 0.04301469773054123, + 1.816213894635439, + 0.3124511893838644, + 0.9917739555239677, + 0.0, + 0.026249468326568604, + 0.46694809012115, + 0.16079513914883137, + 0.21973492950201035, + 2.1601773351430893, + 0.16338958777487278, + 0.3883111719042063, + 0.15827316790819168, + 0.17653532698750496, + 0.2818482257425785, + 0.9823466651141644, + 1.4550565481185913, + 0.7333605624735355, + 0.3200499303638935, + 3.3316246271133423, + 1.6021062284708023, + 0.38086648657917976, + 0.24678403325378895, + 1.212629720568657, + 0.40889466367661953, + 0.5862064175307751, + 1.224543610587716, + 0.2666463069617748, + 0.7182425633072853, + 0.27746975235641, + 0.4117184281349182, + 0.9216407313942909, + 0.9980559553951025, + 2.016523474827409, + 0.466956552118063, + 1.1752424947917461, + 0.19765220768749714 + ], + "unique_experts": 63, + "load_cv": 0.7378213507453583, + "normalized_load_entropy": 0.9421769806684992, + "max_load_share": 0.0737913486005089 + } + }, + "s1_period": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "78a57f47b0aea81b9152249ae6d169b918b765f800cab1fff60513ff0e053493", + "route_weight_sha256": "6a0eccc39565c56ff43b2409badf2533b41ab4b519e97db8956113d7f43738bc", + "loads": [ + 7, + 14, + 4, + 3, + 16, + 19, + 20, + 5, + 4, + 2, + 10, + 7, + 4, + 14, + 5, + 1, + 1, + 18, + 4, + 21, + 7, + 18, + 4, + 12, + 14, + 4, + 6, + 0, + 20, + 2, + 32, + 0, + 1, + 10, + 5, + 5, + 19, + 4, + 2, + 2, + 3, + 6, + 12, + 19, + 6, + 6, + 58, + 31, + 9, + 6, + 1, + 8, + 14, + 13, + 5, + 5, + 8, + 7, + 15, + 21, + 6, + 7, + 18, + 6 + ], + "weighted_loads": [ + 0.3281952776014805, + 0.6110566854476929, + 0.12769412249326706, + 0.12282247468829155, + 0.6091567352414131, + 1.3110957890748978, + 2.0252757277339697, + 0.3045266531407833, + 0.13966844975948334, + 0.16094272769987583, + 0.5909093171358109, + 0.25330778397619724, + 0.47515153512358665, + 1.6032746583223343, + 0.15140276215970516, + 0.05334428697824478, + 0.02869657799601555, + 1.1326867956668139, + 0.19269540905952454, + 1.316220736131072, + 0.23973426409065723, + 0.9073729068040848, + 0.34721604362130165, + 0.7377045080065727, + 1.0468834564089775, + 0.13254455849528313, + 0.18320012465119362, + 0.0, + 1.8101975284516811, + 0.07133937440812588, + 1.1805566847324371, + 0.0, + 0.02779742144048214, + 0.3872923031449318, + 0.1578693799674511, + 0.21394271962344646, + 1.9099752102047205, + 0.14519067481160164, + 0.055352600291371346, + 0.06591057404875755, + 0.11435532383620739, + 0.25881517492234707, + 0.7780454270541668, + 1.3904109243303537, + 0.2982994858175516, + 0.3220277391374111, + 3.3198219817131758, + 1.6235710214823484, + 0.30035911314189434, + 0.1960452552884817, + 0.03173283860087395, + 0.3733780588954687, + 0.5724143330007792, + 0.7204598374664783, + 0.26065272465348244, + 0.19233347848057747, + 0.286039836704731, + 0.26553409546613693, + 0.8422030806541443, + 1.0346715301275253, + 0.7582657225430012, + 0.22334102354943752, + 1.129388315603137, + 0.20597802102565765 + ], + "unique_experts": 62, + "load_cv": 0.9491439165274571, + "normalized_load_entropy": 0.912491325822487, + "max_load_share": 0.09119496855345911 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "89f2d410be4d81ebb1472048f3732386069c9b649ce50a3e40a25433e6d96109", + "route_weight_sha256": "67491844a58f0608e6ff10f93672d542a42955147c20d0840ef52c4fae48795d", + "loads": [ + 11, + 15, + 4, + 14, + 26, + 25, + 23, + 14, + 4, + 4, + 12, + 7, + 7, + 16, + 6, + 13, + 7, + 18, + 14, + 23, + 12, + 19, + 15, + 14, + 15, + 18, + 7, + 2, + 20, + 6, + 32, + 1, + 2, + 10, + 6, + 7, + 23, + 11, + 4, + 8, + 8, + 7, + 14, + 24, + 20, + 7, + 58, + 31, + 9, + 11, + 14, + 8, + 14, + 23, + 6, + 17, + 9, + 14, + 16, + 22, + 20, + 10, + 19, + 6 + ], + "weighted_loads": [ + 0.5246396232396364, + 0.6351713463664055, + 0.12769412249326706, + 0.8802592195570469, + 1.1443636901676655, + 1.5419870056211948, + 2.136658489704132, + 0.9008137155324221, + 0.13966844975948334, + 0.3965249303728342, + 0.6827213428914547, + 0.25330778397619724, + 0.5835625119507313, + 1.9339516572654247, + 0.21212978474795818, + 0.7788090296089649, + 0.37289333902299404, + 1.1326867956668139, + 1.1854807808995247, + 1.4065615218132734, + 0.4431304205209017, + 0.9437264055013657, + 0.9839139692485332, + 0.9096679165959358, + 1.0668576546013355, + 1.122820157557726, + 0.20064624957740307, + 0.06073235161602497, + 1.8101975284516811, + 0.1812503021210432, + 1.1805566847324371, + 0.031783509999513626, + 0.0766471978276968, + 0.3872923031449318, + 0.18619109317660332, + 0.3912333268672228, + 2.0908209048211575, + 0.4087921530008316, + 0.4642765950411558, + 0.34869111329317093, + 0.3279041778296232, + 0.31177561916410923, + 0.9586564935743809, + 1.6147213727235794, + 1.1455271989107132, + 0.39505646750330925, + 3.3198219817131758, + 1.6235710214823484, + 0.30035911314189434, + 0.523483095690608, + 1.8158200457692146, + 0.3733780588954687, + 0.5724143330007792, + 1.2450698502361774, + 0.2892368007451296, + 1.351821180433035, + 0.3309999965131283, + 0.8064032681286335, + 0.8773790746927261, + 1.0626505110412836, + 2.269678896293044, + 0.4293037373572588, + 1.191733120009303, + 0.20597802102565765 + ], + "unique_experts": 64, + "load_cv": 0.6575142649499451, + "normalized_load_entropy": 0.9540051685406803, + "max_load_share": 0.06575963718820861 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 106, + "ordered_topk_exact_tokens": 57, + "set_exact_tokens": 73, + "mean_set_jaccard": 0.9090296495956873, + "mean_token_weighted_tv": 0.014378456811789633, + "aggregate_load_tv": 0.026729559748427677 + }, + "system_bos": { + "tokens": 106, + "ordered_topk_exact_tokens": 50, + "set_exact_tokens": 69, + "mean_set_jaccard": 0.8982479784366576, + "mean_token_weighted_tv": 0.017751458962008637, + "aggregate_load_tv": 0.03930817610062892 + }, + "system_x": { + "tokens": 106, + "ordered_topk_exact_tokens": 43, + "set_exact_tokens": 61, + "mean_set_jaccard": 0.8746630727762804, + "mean_token_weighted_tv": 0.021308530174758075, + "aggregate_load_tv": 0.04874213836477988 + }, + "system_period": { + "tokens": 106, + "ordered_topk_exact_tokens": 52, + "set_exact_tokens": 67, + "mean_set_jaccard": 0.8888140161725068, + "mean_token_weighted_tv": 0.020183141141216148, + "aggregate_load_tv": 0.040880503144654086 + }, + "bos_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 44, + "set_exact_tokens": 63, + "mean_set_jaccard": 0.8820754716981132, + "mean_token_weighted_tv": 0.019411896355450153, + "aggregate_load_tv": 0.04402515723270441 + }, + "bos_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 44, + "set_exact_tokens": 58, + "mean_set_jaccard": 0.8645552560646901, + "mean_token_weighted_tv": 0.022079110084066413, + "aggregate_load_tv": 0.04874213836477986 + }, + "x_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 46, + "set_exact_tokens": 68, + "mean_set_jaccard": 0.8955525606469003, + "mean_token_weighted_tv": 0.018272398707439314, + "aggregate_load_tv": 0.03773584905660378 + }, + "x_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 41, + "set_exact_tokens": 54, + "mean_set_jaccard": 0.8557951482479785, + "mean_token_weighted_tv": 0.02456081524175012, + "aggregate_load_tv": 0.05660377358490567 + }, + "period_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 49, + "set_exact_tokens": 70, + "mean_set_jaccard": 0.894878706199461, + "mean_token_weighted_tv": 0.01848400820854981, + "aggregate_load_tv": 0.04245283018867925 + }, + "period_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 38, + "set_exact_tokens": 56, + "mean_set_jaccard": 0.8571428571428572, + "mean_token_weighted_tv": 0.024212375942195923, + "aggregate_load_tv": 0.0518867924528302 + } + } + }, + "layer_21": { + "layer": 21, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "b022f2714ac1226255daa40116ef89f28824c1923fe6edd0a1f5d6f1029be4ae", + "route_weight_sha256": "5e97ae0029de306cf46dd7ed184179237a3a5389f6014008708b2d6ba2c60755", + "loads": [ + 0, + 9, + 15, + 2, + 4, + 12, + 7, + 7, + 4, + 9, + 19, + 35, + 1, + 3, + 6, + 12, + 1, + 11, + 1, + 10, + 9, + 12, + 19, + 7, + 15, + 3, + 6, + 1, + 11, + 25, + 8, + 23, + 13, + 8, + 3, + 2, + 0, + 2, + 7, + 3, + 18, + 11, + 2, + 23, + 16, + 9, + 17, + 15, + 0, + 7, + 19, + 5, + 11, + 3, + 2, + 5, + 16, + 36, + 9, + 5, + 16, + 7, + 24, + 15 + ], + "weighted_loads": [ + 0.0, + 1.2086641751229763, + 2.5416420437395573, + 0.055149372667074203, + 0.1361163929104805, + 1.1281939838081598, + 0.47164657339453697, + 0.26279435493052006, + 0.1585540883243084, + 0.9750766083598137, + 1.5961644984781742, + 1.5174979250878096, + 0.027851367369294167, + 0.08515904285013676, + 0.22105107828974724, + 0.4115078803151846, + 0.04094123840332031, + 0.7736549153923988, + 0.03963276371359825, + 0.3318430781364441, + 0.4367123581469059, + 0.6807277798652649, + 1.4314015191048384, + 0.5722916517406702, + 1.175207193940878, + 0.09649429470300674, + 0.23347381129860878, + 0.06970957666635513, + 0.4022159893065691, + 1.8037310093641281, + 0.47224840335547924, + 0.8596083205193281, + 0.7337395213544369, + 0.30719684436917305, + 0.0951492041349411, + 0.06118220463395119, + 0.0, + 0.06887354142963886, + 0.5520359314978123, + 0.07871692627668381, + 0.7459269911050797, + 0.4724824894219637, + 0.102239228785038, + 1.648595167323947, + 1.0872510001063347, + 0.36346277222037315, + 0.8811451140791178, + 1.4326373655349016, + 0.0, + 0.22780958749353886, + 0.9424127656966448, + 0.35490118339657784, + 0.544267550110817, + 0.09524739161133766, + 0.07025398313999176, + 0.2708261050283909, + 1.3515603058040142, + 3.2068537827581167, + 0.5808964986354113, + 0.19240664318203926, + 0.745796600356698, + 0.35389091446995735, + 0.9752665776759386, + 1.1614090241491795 + ], + "unique_experts": 61, + "load_cv": 0.803826732231728, + "normalized_load_entropy": 0.9232872373115111, + "max_load_share": 0.05660377358490566 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "365a12d2db918e2cee5ac6f0cfba33a8fbed9b89b2a6fdfa4926eb7a61bbee65", + "route_weight_sha256": "517ced52052c18c14699fce5b1ff23e845d6652c8517b308a7e2873400d8eafc", + "loads": [ + 0, + 10, + 18, + 2, + 10, + 13, + 10, + 7, + 5, + 9, + 29, + 35, + 5, + 8, + 8, + 18, + 2, + 14, + 1, + 13, + 9, + 21, + 19, + 8, + 15, + 3, + 15, + 6, + 15, + 25, + 11, + 23, + 14, + 8, + 4, + 12, + 0, + 2, + 7, + 4, + 19, + 11, + 7, + 23, + 16, + 9, + 17, + 15, + 11, + 11, + 19, + 12, + 21, + 4, + 6, + 9, + 18, + 36, + 12, + 7, + 16, + 7, + 27, + 15 + ], + "weighted_loads": [ + 0.0, + 1.236307468265295, + 2.617201415123418, + 0.055149372667074203, + 0.36289460211992264, + 1.1686479542404413, + 0.7513496316969395, + 0.26279435493052006, + 0.22099532932043076, + 0.9750766083598137, + 2.1565663516521454, + 1.5174979250878096, + 0.3452358525246382, + 0.4745561610907316, + 0.2919338159263134, + 0.6032482599839568, + 0.0541996406391263, + 0.8575024735182524, + 0.03963276371359825, + 1.8523630313575268, + 0.4367123581469059, + 1.3438770323991776, + 1.4314015191048384, + 0.6137108225375414, + 1.175207193940878, + 0.09649429470300674, + 0.6415633093565702, + 0.5534757860004902, + 0.4960613464936614, + 1.8037310093641281, + 0.6854749042540789, + 0.8596083205193281, + 0.756668334826827, + 0.30719684436917305, + 0.14511487260460854, + 0.6311707850545645, + 0.0, + 0.06887354142963886, + 0.5520359314978123, + 0.12125365063548088, + 0.8050325885415077, + 0.4724824894219637, + 0.36858299747109413, + 1.648595167323947, + 1.0872510001063347, + 0.36346277222037315, + 0.8811451140791178, + 1.4326373655349016, + 0.5844348035752773, + 0.563975078985095, + 0.9424127656966448, + 0.6820295713841915, + 1.1796580776572227, + 0.1082611558958888, + 0.20096923224627972, + 0.6987341679632664, + 1.4430053979158401, + 3.2068537827581167, + 0.7000230401754379, + 0.2733023129403591, + 0.745796600356698, + 0.35389091446995735, + 1.1089329365640879, + 1.1614090241491795 + ], + "unique_experts": 62, + "load_cv": 0.6394367102675008, + "normalized_load_entropy": 0.9494399967243122, + "max_load_share": 0.04580152671755725 + } + }, + "s1_eos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "6df0603ad04508550e6e2e3ea68b168f984736da9be78ee9beac29d1502ba8fa", + "route_weight_sha256": "eab1ad4bc151d09174e2fbca6d68e2bd1509104d747d5ca479c5a8766842e955", + "loads": [ + 0, + 9, + 15, + 2, + 3, + 13, + 8, + 7, + 4, + 10, + 20, + 35, + 2, + 3, + 6, + 12, + 1, + 12, + 1, + 9, + 9, + 12, + 19, + 7, + 15, + 3, + 6, + 1, + 11, + 25, + 8, + 21, + 15, + 6, + 3, + 1, + 0, + 2, + 7, + 2, + 18, + 11, + 2, + 24, + 16, + 10, + 16, + 15, + 0, + 7, + 19, + 5, + 11, + 2, + 2, + 5, + 15, + 37, + 9, + 6, + 16, + 7, + 22, + 16 + ], + "weighted_loads": [ + 0.0, + 1.1856143735349178, + 2.5186525247991085, + 0.05631450563669205, + 0.10258190333843231, + 1.1516451593488455, + 0.49990670941770077, + 0.2692001685500145, + 0.1569796409457922, + 1.0091886185109615, + 1.652151359245181, + 1.5201350767165422, + 0.05598914809525013, + 0.08216354064643383, + 0.22380519658327103, + 0.41459533385932446, + 0.04304946959018707, + 0.7962008882313967, + 0.0412263423204422, + 0.3066769354045391, + 0.4358777776360512, + 0.6809135414659977, + 1.4507520720362663, + 0.5936954077333212, + 1.1742303408682346, + 0.09483145549893379, + 0.22210057079792023, + 0.06723655760288239, + 0.39677990786731243, + 1.776402521878481, + 0.4748040307313204, + 0.8041462264955044, + 0.7695122081786394, + 0.23580327257514, + 0.09760766662657261, + 0.03187555447220802, + 0.0, + 0.06894873455166817, + 0.5521022230386734, + 0.05286587402224541, + 0.7562461830675602, + 0.4739156477153301, + 0.10259905830025673, + 1.7127977833151817, + 1.1047288365662098, + 0.38591622561216354, + 0.8677427489310503, + 1.4189364593476057, + 0.0, + 0.2238150518387556, + 0.9600795693695545, + 0.35213619098067284, + 0.5189411547034979, + 0.0651894249022007, + 0.0703335665166378, + 0.2903640531003475, + 1.3385621272027493, + 3.220122380182147, + 0.5801403503865004, + 0.2314444314688444, + 0.74523507617414, + 0.35270096734166145, + 0.9155304301530123, + 1.1814589854329824 + ], + "unique_experts": 61, + "load_cv": 0.8087326473669351, + "normalized_load_entropy": 0.9218776562135488, + "max_load_share": 0.05817610062893082 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "28f4020eacbd783aff715d0f1f1525a71c93eaacca85f7ab36507ba7b737c7c9", + "route_weight_sha256": "5725bbe9e60b62da3b9577ff02e0ac8075e3a2f157be473910c502c836010b6a", + "loads": [ + 8, + 10, + 18, + 2, + 3, + 16, + 13, + 8, + 7, + 13, + 31, + 35, + 8, + 14, + 11, + 15, + 2, + 21, + 3, + 13, + 10, + 22, + 21, + 12, + 16, + 5, + 14, + 10, + 15, + 26, + 15, + 21, + 16, + 10, + 3, + 16, + 1, + 3, + 8, + 4, + 19, + 13, + 11, + 25, + 17, + 11, + 16, + 15, + 10, + 11, + 20, + 15, + 21, + 3, + 13, + 15, + 20, + 37, + 12, + 12, + 17, + 8, + 25, + 17 + ], + "weighted_loads": [ + 0.5105472411960363, + 1.232034556567669, + 3.210868529509753, + 0.05631450563669205, + 0.10258190333843231, + 1.233820291236043, + 0.7464465387165546, + 0.3515673577785492, + 0.29761713556945324, + 1.1818612795323133, + 2.2782839592546225, + 1.5201350767165422, + 0.4384096059948206, + 0.7185558397322893, + 0.4272816311568022, + 0.5018684025853872, + 0.05630787182599306, + 1.1072004004381597, + 0.09466592036187649, + 1.8436319418251514, + 0.48396145924925804, + 1.353232815861702, + 1.5143680404871702, + 1.0824721362441778, + 1.2093958295881748, + 0.16757072880864143, + 0.5044822171330452, + 0.9071466401219368, + 0.46852173609659076, + 1.825318083167076, + 0.8726777471601963, + 0.8041462264955044, + 0.7921785283833742, + 0.8321745358407497, + 0.09760766662657261, + 0.8933215029537678, + 0.07126513868570328, + 0.1100214384496212, + 0.6058099083602428, + 0.1333284191787243, + 0.7983048222959042, + 0.5992259085178375, + 0.536168996244669, + 1.7539618760347366, + 1.1743333376944065, + 0.4437253996729851, + 0.8677427489310503, + 1.4189364593476057, + 0.7891379594802856, + 1.2646088022738695, + 1.012834344059229, + 1.0637979470193386, + 1.1152637731283903, + 0.07820318918675184, + 0.7308765333145857, + 1.0466497763991356, + 1.5488099716603756, + 3.220122380182147, + 0.7287569679319859, + 0.4993588402867317, + 0.7676651496440172, + 0.41619032993912697, + 1.0385571774095297, + 1.266838712617755 + ], + "unique_experts": 64, + "load_cv": 0.5497030808541924, + "normalized_load_entropy": 0.9622939311682396, + "max_load_share": 0.04195011337868481 + } + }, + "s0_bos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "baeeaa1f1dc0ee73499cf8646fe1623175ece4bf2a34765ec0c546037e2c7f8c", + "route_weight_sha256": "9f92932432aa621d49e6c13cb0b501ef5ea20046ecb19a6f3bf049fb98d7d4de", + "loads": [ + 0, + 9, + 14, + 3, + 5, + 13, + 8, + 9, + 4, + 9, + 20, + 31, + 1, + 5, + 7, + 11, + 0, + 13, + 2, + 8, + 11, + 10, + 18, + 7, + 15, + 3, + 9, + 1, + 10, + 25, + 8, + 23, + 14, + 6, + 2, + 1, + 0, + 2, + 7, + 2, + 16, + 12, + 2, + 24, + 17, + 8, + 17, + 15, + 0, + 6, + 18, + 5, + 12, + 2, + 3, + 5, + 16, + 37, + 9, + 5, + 16, + 7, + 23, + 15 + ], + "weighted_loads": [ + 0.0, + 1.1435950361192226, + 2.5091712176799774, + 0.08419542200863361, + 0.1752677895128727, + 1.1312998365610838, + 0.5126072261482477, + 0.31536235846579075, + 0.15785571560263634, + 1.0054413303732872, + 1.6931440196931362, + 1.3647998366504908, + 0.02764628641307354, + 0.15732529573142529, + 0.2665775753557682, + 0.3728975020349026, + 0.0, + 0.826486125588417, + 0.06744264997541904, + 0.27249305695295334, + 0.5039212312549353, + 0.6509470231831074, + 1.3915417306125164, + 0.5789684262126684, + 1.1951974146068096, + 0.09504814073443413, + 0.3056646678596735, + 0.07013389468193054, + 0.36940498650074005, + 1.816524963825941, + 0.4803593885153532, + 0.9012244418263435, + 0.7721340265125036, + 0.2425999827682972, + 0.06175768002867699, + 0.030955126509070396, + 0.0, + 0.07253722473978996, + 0.568328034132719, + 0.05582495778799057, + 0.6938410494476557, + 0.50859384983778, + 0.09284104406833649, + 1.698098698630929, + 1.1383416596800089, + 0.3086615242063999, + 0.8906189110130072, + 1.4697052482515574, + 0.0, + 0.19631184451282024, + 0.940752575173974, + 0.37107331305742264, + 0.5909308362752199, + 0.06852931901812553, + 0.103562131524086, + 0.2580311931669712, + 1.3992519676685333, + 3.2598693929612637, + 0.5546638909727335, + 0.1956869587302208, + 0.7221096474677324, + 0.3546364828944206, + 0.9688848182559013, + 1.1925864927470684 + ], + "unique_experts": 60, + "load_cv": 0.7877217262320039, + "normalized_load_entropy": 0.9242969506109854, + "max_load_share": 0.05817610062893082 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "fbedca1b24650523963945dee493afda281de04ed49578588ce3792eae28ed5e", + "route_weight_sha256": "c21aa0255f0930a75f67075192b2925caf814ed9291d9204a7bf5fd79ad1f024", + "loads": [ + 0, + 12, + 16, + 4, + 10, + 14, + 10, + 9, + 6, + 9, + 29, + 31, + 5, + 10, + 9, + 15, + 1, + 17, + 3, + 10, + 11, + 18, + 18, + 8, + 15, + 3, + 18, + 6, + 13, + 25, + 11, + 25, + 15, + 6, + 3, + 11, + 0, + 2, + 7, + 5, + 18, + 12, + 7, + 24, + 17, + 9, + 17, + 15, + 11, + 9, + 18, + 12, + 22, + 3, + 7, + 8, + 18, + 37, + 11, + 6, + 16, + 7, + 27, + 15 + ], + "weighted_loads": [ + 0.0, + 1.2471665050834417, + 2.582222467288375, + 0.2861540336161852, + 0.3666016757488251, + 1.1641357634216547, + 0.7291711326688528, + 0.31536235846579075, + 0.26097921654582024, + 1.0054413303732872, + 2.190469518303871, + 1.3647998366504908, + 0.3454192075878382, + 0.4965167511254549, + 0.33836253359913826, + 0.5142780337482691, + 0.013258402235805988, + 0.9656248204410076, + 0.12309141643345356, + 0.8503771163523197, + 0.5039212312549353, + 1.3153661582618952, + 1.3915417306125164, + 0.6203875970095396, + 1.1951974146068096, + 0.09504814073443413, + 0.713754165917635, + 0.5220765881240368, + 0.45961719285696745, + 1.816524963825941, + 0.6888138558715582, + 1.0583816021680832, + 0.7950628399848938, + 0.2425999827682972, + 0.11172334849834442, + 0.6009437069296837, + 0.0, + 0.07253722473978996, + 0.568328034132719, + 0.179921705275774, + 0.8209153283387423, + 0.50859384983778, + 0.35678065568208694, + 1.698098698630929, + 1.1383416596800089, + 0.4144578389823437, + 0.8906189110130072, + 1.4697052482515574, + 0.5844348035752773, + 0.552364656701684, + 0.940752575173974, + 0.6982017010450363, + 1.2263213638216257, + 0.08154308330267668, + 0.23427738063037395, + 0.6270514205098152, + 1.4951020292937756, + 3.2598693929612637, + 0.6176522113382816, + 0.23954520002007484, + 0.7221096474677324, + 0.3546364828944206, + 1.1590640135109425, + 1.1925864927470684 + ], + "unique_experts": 62, + "load_cv": 0.6263419639252591, + "normalized_load_entropy": 0.9514727176448573, + "max_load_share": 0.047073791348600506 + } + }, + "s1_bos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "bb58cf7fa5d6ba201a28b24b181468b1847f30501de58cab899b036f897b1d04", + "route_weight_sha256": "f947546fe02efe37dc4d6f0cb4f77f55881279d164ade969144c7d09dd035916", + "loads": [ + 0, + 9, + 14, + 3, + 3, + 14, + 9, + 7, + 4, + 9, + 20, + 32, + 0, + 4, + 8, + 11, + 1, + 13, + 1, + 8, + 9, + 11, + 18, + 6, + 15, + 3, + 8, + 1, + 11, + 25, + 8, + 24, + 14, + 5, + 3, + 1, + 0, + 2, + 7, + 2, + 18, + 12, + 2, + 25, + 16, + 9, + 17, + 15, + 0, + 5, + 19, + 5, + 12, + 4, + 3, + 6, + 15, + 35, + 7, + 5, + 16, + 7, + 25, + 15 + ], + "weighted_loads": [ + 0.0, + 1.1272586695849895, + 2.5104965306818485, + 0.08605888858437538, + 0.10133979469537735, + 1.1974570117890835, + 0.5369784142822027, + 0.26146459206938744, + 0.15962525084614754, + 0.9746605530381203, + 1.5842866282910109, + 1.4281800743192434, + 0.0, + 0.11245024390518665, + 0.2882928419858217, + 0.38296062499284744, + 0.049221478402614594, + 0.7871356885880232, + 0.039979565888643265, + 0.2718176878988743, + 0.43894935213029385, + 0.6567697171121836, + 1.4043274745345116, + 0.5790381990373135, + 1.188090804964304, + 0.09778937324881554, + 0.2723294012248516, + 0.06387417018413544, + 0.3916489500552416, + 1.7528354581445456, + 0.48157108575105667, + 0.9372044056653976, + 0.7625825572758913, + 0.19950702600181103, + 0.09283333271741867, + 0.030948491767048836, + 0.0, + 0.07926911860704422, + 0.5543178096413612, + 0.056892773136496544, + 0.7529833130538464, + 0.5043935775756836, + 0.0972629152238369, + 1.737255234271288, + 1.0842217989265919, + 0.3391342256218195, + 0.877539549022913, + 1.4518538303673267, + 0.0, + 0.1703209225088358, + 0.9835227318108082, + 0.37075019627809525, + 0.5828858986496925, + 0.11283767409622669, + 0.09941773302853107, + 0.2852103225886822, + 1.3393024373799562, + 3.1394199430942535, + 0.4643602501600981, + 0.19766439869999886, + 0.7340969871729612, + 0.35533702932298183, + 1.02569760940969, + 1.1959558054804802 + ], + "unique_experts": 60, + "load_cv": 0.7990887179545314, + "normalized_load_entropy": 0.9222414759382, + "max_load_share": 0.055031446540880505 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "d1090796de321a30e565873b736a04353f82587734f295aaa3d2d9141f8efd9c", + "route_weight_sha256": "38324300ab1304a5b88caea6e218ffcc8d8897c90b5ed6ec09105cb28e19ab25", + "loads": [ + 8, + 13, + 16, + 3, + 6, + 15, + 14, + 9, + 7, + 12, + 30, + 33, + 6, + 14, + 13, + 14, + 2, + 21, + 4, + 11, + 10, + 20, + 20, + 11, + 16, + 5, + 16, + 11, + 14, + 26, + 15, + 26, + 15, + 9, + 3, + 16, + 1, + 3, + 8, + 4, + 19, + 14, + 11, + 26, + 17, + 10, + 17, + 15, + 10, + 10, + 20, + 15, + 22, + 5, + 14, + 15, + 20, + 35, + 8, + 9, + 17, + 8, + 29, + 16 + ], + "weighted_loads": [ + 0.5105472411960363, + 1.2770574390888214, + 3.2000365536659956, + 0.08605888858437538, + 0.2118990682065487, + 1.2124813981354237, + 0.8251359090209007, + 0.3809131421148777, + 0.30592450872063637, + 1.147333214059472, + 2.156537873670459, + 1.4841375071555376, + 0.37903933599591255, + 0.6813605222851038, + 0.49034731462597847, + 0.5036819260567427, + 0.06247988063842058, + 1.1001068726181984, + 0.15602275915443897, + 0.8688917867839336, + 0.4870330337435007, + 1.3287143390625715, + 1.4679434429854155, + 1.06781492754817, + 1.2232562936842442, + 0.17052864655852318, + 0.5547110475599766, + 0.9235403090715408, + 0.45848100911825895, + 1.8017510194331408, + 0.8491512108594179, + 1.0741149187088013, + 0.7852488774806261, + 0.7958782892674208, + 0.09283333271741867, + 0.8923944402486086, + 0.07126513868570328, + 0.12034182250499725, + 0.6080254949629307, + 0.13143530674278736, + 0.7974325343966484, + 0.629703838378191, + 0.5356192626059055, + 1.7784193269908428, + 1.1538263000547886, + 0.39694339968264103, + 0.877539549022913, + 1.4518538303673267, + 0.7891379594802856, + 1.3215369787067175, + 1.0362775065004826, + 1.082411952316761, + 1.179208517074585, + 0.12585143838077784, + 0.759960699826479, + 1.0408989191055298, + 1.5565317068248987, + 3.1394199430942535, + 0.48931774497032166, + 0.39681720547378063, + 0.7565270606428385, + 0.41882639192044735, + 1.213968900963664, + 1.2813355326652527 + ], + "unique_experts": 64, + "load_cv": 0.54322945043267, + "normalized_load_entropy": 0.9638246226489955, + "max_load_share": 0.03968253968253968 + } + }, + "s0_x": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "1e23bc5b391c2a4853814fdbfb5ac9abc20697eccd13ae0375987b170c3f66f8", + "route_weight_sha256": "4b46aaa8beb47a39c4dc2683c0fe3abcf43878bb80698f520bdd24dc87867243", + "loads": [ + 1, + 9, + 13, + 3, + 5, + 11, + 7, + 6, + 4, + 9, + 20, + 35, + 0, + 3, + 5, + 8, + 1, + 13, + 1, + 6, + 12, + 13, + 19, + 7, + 15, + 3, + 7, + 2, + 12, + 24, + 9, + 22, + 14, + 8, + 2, + 1, + 0, + 2, + 7, + 2, + 17, + 11, + 2, + 24, + 16, + 11, + 20, + 15, + 0, + 6, + 17, + 7, + 12, + 2, + 3, + 5, + 16, + 36, + 8, + 6, + 15, + 7, + 24, + 15 + ], + "weighted_loads": [ + 0.027709810063242912, + 1.1909167431294918, + 2.502615850418806, + 0.0873209610581398, + 0.16818910278379917, + 1.0625487100332975, + 0.4763323999941349, + 0.23555550165474415, + 0.15958434902131557, + 1.0052127428352833, + 1.6451475229114294, + 1.5304440390318632, + 0.0, + 0.08597393333911896, + 0.19257991015911102, + 0.28669968247413635, + 0.0512382872402668, + 0.8142024874687195, + 0.0408887080848217, + 0.222807127982378, + 0.5318132787942886, + 0.7109917681664228, + 1.426125142723322, + 0.5795918740332127, + 1.2043952867388725, + 0.09720822609961033, + 0.2422744259238243, + 0.10095063969492912, + 0.41663316637277603, + 1.7673781346529722, + 0.5194270741194487, + 0.8545556366443634, + 0.7649821266531944, + 0.3026597611606121, + 0.06458503566682339, + 0.04369970038533211, + 0.0, + 0.06911021284759045, + 0.5653855055570602, + 0.05402693338692188, + 0.7078548241406679, + 0.4701865389943123, + 0.09685118868947029, + 1.6415560580790043, + 1.0898056384176016, + 0.4099720884114504, + 0.9830210413783789, + 1.4503718055784702, + 0.0, + 0.19275795854628086, + 0.9092612192034721, + 0.41858429834246635, + 0.5884324070066214, + 0.06528244353830814, + 0.10189955122768879, + 0.25865087285637856, + 1.3821350783109665, + 3.1904062014073133, + 0.5070306528359652, + 0.23017249628901482, + 0.687275405973196, + 0.3532386776059866, + 0.9662392307072878, + 1.21541753038764 + ], + "unique_experts": 61, + "load_cv": 0.8044170218153973, + "normalized_load_entropy": 0.9229368906687706, + "max_load_share": 0.05660377358490566 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "fa01eeae7e9ec98b918170aeb2c4bc7dec710c94538b6f3f18a5e23e5aeea9d7", + "route_weight_sha256": "804f22087100a019a2054f9acd5a9c718fbc80ad77986ed3d0d668f0eaa6b29b", + "loads": [ + 2, + 9, + 16, + 3, + 10, + 11, + 10, + 6, + 5, + 9, + 31, + 35, + 5, + 6, + 7, + 11, + 2, + 19, + 1, + 8, + 12, + 20, + 19, + 8, + 15, + 3, + 16, + 7, + 16, + 24, + 12, + 22, + 15, + 8, + 3, + 12, + 0, + 2, + 7, + 3, + 17, + 11, + 9, + 24, + 16, + 11, + 20, + 15, + 13, + 10, + 17, + 14, + 23, + 3, + 7, + 9, + 19, + 36, + 10, + 8, + 15, + 7, + 27, + 15 + ], + "weighted_loads": [ + 0.05735265463590622, + 1.1909167431294918, + 2.617726931348443, + 0.0873209610581398, + 0.35952298901975155, + 1.0625487100332975, + 0.7504864484071732, + 0.23555550165474415, + 0.22202559001743793, + 1.0052127428352833, + 2.2392832078039646, + 1.5304440390318632, + 0.33613594248890877, + 0.36116474866867065, + 0.26190386340022087, + 0.3865773770958185, + 0.06449668947607279, + 1.0445952713489532, + 0.0408887080848217, + 0.8006911873817444, + 0.5318132787942886, + 1.3154273070394993, + 1.426125142723322, + 0.6210110448300838, + 1.2043952867388725, + 0.09720822609961033, + 0.6503639239817858, + 0.5539935752749443, + 0.5497585041448474, + 1.7673781346529722, + 0.7576247397810221, + 0.8545556366443634, + 0.7879109401255846, + 0.3026597611606121, + 0.11455070413649082, + 0.7079560812562704, + 0.0, + 0.06911021284759045, + 0.5653855055570602, + 0.09376814030110836, + 0.7078548241406679, + 0.4701865389943123, + 0.46639711409807205, + 1.6415560580790043, + 1.0898056384176016, + 0.4099720884114504, + 0.9830210413783789, + 1.4503718055784702, + 0.7120340131223202, + 0.5323355700820684, + 0.9092612192034721, + 0.74571268633008, + 1.4133648108690977, + 0.07829620782285929, + 0.23261480033397675, + 0.70192451775074, + 1.5199231058359146, + 3.1904062014073133, + 0.5750526823103428, + 0.29836793802678585, + 0.687275405973196, + 0.3532386776059866, + 1.0907037984579802, + 1.21541753038764 + ], + "unique_experts": 63, + "load_cv": 0.6452426514393726, + "normalized_load_entropy": 0.9498032582490591, + "max_load_share": 0.04580152671755725 + } + }, + "s1_x": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "89252f5c3da9f3cc9d67d3d1aae46552e3201c4ce0d735cd4e675f73cefdaf17", + "route_weight_sha256": "99db34a4d52585e1795220c2301cbe1201eceef2ba4424f61872b844c6230ffe", + "loads": [ + 2, + 9, + 14, + 3, + 4, + 12, + 8, + 5, + 4, + 10, + 20, + 31, + 0, + 3, + 6, + 6, + 1, + 13, + 1, + 11, + 13, + 12, + 18, + 7, + 16, + 5, + 7, + 1, + 11, + 24, + 9, + 25, + 14, + 5, + 3, + 1, + 0, + 2, + 7, + 3, + 16, + 10, + 2, + 25, + 15, + 9, + 19, + 15, + 0, + 5, + 18, + 8, + 12, + 3, + 3, + 5, + 17, + 35, + 6, + 5, + 16, + 8, + 23, + 15 + ], + "weighted_loads": [ + 0.05883225239813328, + 1.137634675949812, + 2.5068975631147623, + 0.08765139244496822, + 0.14032577350735664, + 1.120036419481039, + 0.5191744770854712, + 0.1909167543053627, + 0.15482679195702076, + 1.0057789161801338, + 1.662637922912836, + 1.3922169599682093, + 0.0, + 0.08559193648397923, + 0.21880540996789932, + 0.21747695095837116, + 0.060065917670726776, + 0.7707937527447939, + 0.042553819715976715, + 0.37388445250689983, + 0.5618943180888891, + 0.6826360132545233, + 1.4045241065323353, + 0.6249366365373135, + 1.1841162387281656, + 0.15213324688374996, + 0.23808778822422028, + 0.06677740067243576, + 0.3827274274080992, + 1.7295727953314781, + 0.5118066277354956, + 0.9584455620497465, + 0.7406774945557117, + 0.1791711114346981, + 0.09421778097748756, + 0.059031736105680466, + 0.0, + 0.07467752695083618, + 0.544878389686346, + 0.09367524646222591, + 0.6922945659607649, + 0.43727258034050465, + 0.10137872397899628, + 1.6564787290990353, + 1.0355211962014437, + 0.3332972079515457, + 0.9728639721870422, + 1.4080639611929655, + 0.0, + 0.15851998515427113, + 0.9210610389709473, + 0.4826054088771343, + 0.5635680891573429, + 0.08616800606250763, + 0.09936203435063362, + 0.22691304236650467, + 1.44410565122962, + 3.0534664038568735, + 0.45876994356513023, + 0.21053404361009598, + 0.7145530823618174, + 0.39327916502952576, + 0.9399566762149334, + 1.1971814632415771 + ], + "unique_experts": 61, + "load_cv": 0.7863144509210206, + "normalized_load_entropy": 0.9254115054360444, + "max_load_share": 0.055031446540880505 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "9ed7ffe07c65ef7b6a66d2d94b3711a37974e61d32bfae99fd04ccc8e7182f6c", + "route_weight_sha256": "8c3b85ee8686b5870a224cf0f809aab258e4e1e757f88222502a420fccec3491", + "loads": [ + 10, + 11, + 16, + 3, + 5, + 13, + 12, + 6, + 7, + 13, + 31, + 31, + 8, + 13, + 11, + 9, + 2, + 19, + 4, + 14, + 14, + 20, + 20, + 13, + 17, + 9, + 15, + 10, + 14, + 25, + 16, + 25, + 15, + 9, + 3, + 17, + 1, + 3, + 8, + 3, + 16, + 13, + 13, + 26, + 17, + 10, + 19, + 15, + 13, + 10, + 19, + 19, + 23, + 4, + 14, + 15, + 22, + 35, + 7, + 10, + 17, + 9, + 25, + 16 + ], + "weighted_loads": [ + 0.5693794935941696, + 1.229499440640211, + 3.1964375860989094, + 0.08765139244496822, + 0.17170106247067451, + 1.1350608058273792, + 0.6927376575767994, + 0.2732839435338974, + 0.31336759217083454, + 1.1784515772014856, + 2.303850593045354, + 1.3922169599682093, + 0.41366269066929817, + 0.6317685823887587, + 0.4242097828537226, + 0.3378738909959793, + 0.07332431990653276, + 1.0270566288381815, + 0.15550913102924824, + 0.9709585513919592, + 0.609977999702096, + 1.284529672935605, + 1.4681400749832392, + 1.1670129038393497, + 1.2192817274481058, + 0.3117995448410511, + 0.5204694345593452, + 0.8944982886314392, + 0.4426544914022088, + 1.7784883566200733, + 0.9211212135851383, + 0.9584455620497465, + 0.7633438147604465, + 0.7755423747003078, + 0.09421778097748756, + 0.9857122115790844, + 0.07126513868570328, + 0.11575023084878922, + 0.5985860750079155, + 0.09367524646222591, + 0.6922945659607649, + 0.6339568253606558, + 0.6429416835308075, + 1.6976428218185902, + 1.1414946112781763, + 0.39110638201236725, + 0.9728639721870422, + 1.4080639611929655, + 1.0414362363517284, + 1.1933112312108278, + 0.9738158136606216, + 1.2225530054420233, + 1.3642282746732235, + 0.09918177034705877, + 0.7599050011485815, + 1.0427908934652805, + 1.6579097546637058, + 3.0534664038568735, + 0.4837274383753538, + 0.4494419824331999, + 0.7369831558316946, + 0.45676852762699127, + 1.0155151188373566, + 1.2825611904263496 + ], + "unique_experts": 64, + "load_cv": 0.530200239292589, + "normalized_load_entropy": 0.9648332749214988, + "max_load_share": 0.03968253968253968 + } + }, + "s0_period": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "08a61374115ff26c41dd4e3eaa1d1d7e6d67472bf5810ab6de417b25c1486d84", + "route_weight_sha256": "747dab1c40c89cb8be40c93fa1085927de2f2b02fb3c3d9beffc14020d8aad9f", + "loads": [ + 1, + 9, + 13, + 3, + 4, + 14, + 7, + 8, + 4, + 9, + 18, + 33, + 1, + 2, + 7, + 9, + 1, + 13, + 1, + 9, + 10, + 12, + 18, + 7, + 15, + 3, + 8, + 1, + 11, + 25, + 8, + 22, + 14, + 7, + 3, + 1, + 0, + 2, + 7, + 2, + 17, + 11, + 2, + 24, + 16, + 9, + 19, + 15, + 0, + 7, + 19, + 6, + 12, + 2, + 2, + 5, + 16, + 37, + 9, + 5, + 14, + 7, + 25, + 15 + ], + "weighted_loads": [ + 0.026585077866911888, + 1.1819273494184017, + 2.517217079177499, + 0.08899793773889542, + 0.14199288561940193, + 1.1863572280853987, + 0.45492012798786163, + 0.29244947992265224, + 0.15923780016601086, + 0.9873570390045643, + 1.595957513898611, + 1.4580748435109854, + 0.02769695594906807, + 0.054492976516485214, + 0.2521096467971802, + 0.30463485419750214, + 0.047494564205408096, + 0.7891548648476601, + 0.03889985755085945, + 0.3047262132167816, + 0.47144375927746296, + 0.6889254208654165, + 1.3822334576398134, + 0.5757188592106104, + 1.1890793778002262, + 0.09843919984996319, + 0.27557835541665554, + 0.06828038394451141, + 0.387374060228467, + 1.802282927557826, + 0.46587342396378517, + 0.83355444483459, + 0.751429945230484, + 0.27054404467344284, + 0.09159431979060173, + 0.04040858894586563, + 0.0, + 0.07533517107367516, + 0.553817629814148, + 0.055816929787397385, + 0.7044482324272394, + 0.4706734288483858, + 0.0969085544347763, + 1.6800501625984907, + 1.083536071702838, + 0.3537703566253185, + 0.9657927919179201, + 1.445245275273919, + 0.0, + 0.22257457487285137, + 0.9503558203577995, + 0.3854396939277649, + 0.5883065853267908, + 0.06574261374771595, + 0.06793213821947575, + 0.2543599810451269, + 1.3828112110495567, + 3.2330194748938084, + 0.541840810328722, + 0.19536568224430084, + 0.6599127911031246, + 0.36491805873811245, + 1.0070705115795135, + 1.1787242107093334 + ], + "unique_experts": 62, + "load_cv": 0.8000781180957115, + "normalized_load_entropy": 0.9238437126883069, + "max_load_share": 0.05817610062893082 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "29593429b5399f805a29e9f0ea724269500803e60eabbbbd6f8dabbd5c84d0bc", + "route_weight_sha256": "bda0944340ec03f3b4436ac226b80710522110b07b131a3c5e9732247968f945", + "loads": [ + 1, + 10, + 16, + 3, + 11, + 14, + 10, + 8, + 5, + 9, + 27, + 33, + 6, + 7, + 9, + 13, + 2, + 18, + 2, + 11, + 10, + 19, + 18, + 8, + 15, + 3, + 17, + 6, + 15, + 25, + 11, + 22, + 15, + 7, + 4, + 12, + 0, + 2, + 7, + 2, + 18, + 11, + 8, + 24, + 16, + 9, + 19, + 15, + 12, + 11, + 19, + 14, + 22, + 3, + 6, + 10, + 18, + 37, + 10, + 7, + 14, + 7, + 28, + 15 + ], + "weighted_loads": [ + 0.026585077866911888, + 1.2078067678958178, + 2.637622620910406, + 0.08899793773889542, + 0.40934132039546967, + 1.1863572280853987, + 0.7665528357028961, + 0.29244947992265224, + 0.22167904116213322, + 0.9873570390045643, + 2.1014526281505823, + 1.4580748435109854, + 0.35600581020116806, + 0.4021265283226967, + 0.32190392166376114, + 0.45170713029801846, + 0.060752966441214085, + 0.9876322485506535, + 0.08270657062530518, + 0.882610272616148, + 0.47144375927746296, + 1.292799349874258, + 1.3822334576398134, + 0.6171380300074816, + 1.1890793778002262, + 0.09843919984996319, + 0.683667853474617, + 0.5260692536830902, + 0.5174612710252404, + 1.802282927557826, + 0.6925732120871544, + 0.83355444483459, + 0.7743587587028742, + 0.27054404467344284, + 0.14155998826026917, + 0.667646886780858, + 0.0, + 0.07533517107367516, + 0.553817629814148, + 0.055816929787397385, + 0.7398807387799025, + 0.4706734288483858, + 0.42918122187256813, + 1.6800501625984907, + 1.083536071702838, + 0.3537703566253185, + 0.9657927919179201, + 1.445245275273919, + 0.6553838588297367, + 0.6029726956039667, + 0.9503558203577995, + 0.7705409675836563, + 1.2236971128731966, + 0.0787563780322671, + 0.1986473873257637, + 0.7743982318788767, + 1.4699960201978683, + 3.2330194748938084, + 0.5663917418569326, + 0.3276648558676243, + 0.6599127911031246, + 0.36491805873811245, + 1.1460034064948559, + 1.1787242107093334 + ], + "unique_experts": 63, + "load_cv": 0.6286532348122817, + "normalized_load_entropy": 0.951645420791889, + "max_load_share": 0.047073791348600506 + } + }, + "s1_period": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "390c85a73b20d5aeae5f5f5078d1bb55e7d43396d9b2d6a864fe0ff7c344472c", + "route_weight_sha256": "cb7b106653cead30f6eedfac1f4cb449404d00c808fca87a7cf316fa3d3f18ca", + "loads": [ + 1, + 9, + 13, + 3, + 2, + 12, + 8, + 6, + 4, + 9, + 16, + 31, + 0, + 4, + 7, + 9, + 1, + 13, + 2, + 14, + 9, + 10, + 18, + 7, + 16, + 3, + 8, + 2, + 12, + 25, + 9, + 22, + 15, + 6, + 3, + 1, + 0, + 2, + 7, + 2, + 16, + 12, + 2, + 26, + 16, + 10, + 19, + 16, + 0, + 4, + 19, + 7, + 12, + 3, + 3, + 5, + 17, + 35, + 5, + 6, + 14, + 8, + 25, + 15 + ], + "weighted_loads": [ + 0.028794432058930397, + 1.2003966383635998, + 2.5003207996487617, + 0.08831900730729103, + 0.06576913967728615, + 1.1025132052600384, + 0.4925188310444355, + 0.23022264055907726, + 0.15249978937208652, + 0.9637649692595005, + 1.4871845412999392, + 1.401959117501974, + 0.0, + 0.11452171951532364, + 0.2566726189106703, + 0.32256218791007996, + 0.05730121210217476, + 0.7766640409827232, + 0.06619944795966148, + 0.4637151136994362, + 0.4338768310844898, + 0.6244793478399515, + 1.4231385309249163, + 0.6290580295026302, + 1.2095335740596056, + 0.10103118233382702, + 0.2759788278490305, + 0.09678114950656891, + 0.40791542641818523, + 1.775625329464674, + 0.5023825913667679, + 0.8744573649019003, + 0.7661545388400555, + 0.21839435957372189, + 0.09309178590774536, + 0.05483299493789673, + 0.0, + 0.07808198779821396, + 0.5495071075856686, + 0.05450780689716339, + 0.6961686313152313, + 0.4967651907354593, + 0.10246921330690384, + 1.7500864695757627, + 1.0745581965893507, + 0.37223806232213974, + 0.9764804039150476, + 1.444490760564804, + 0.0, + 0.11926533840596676, + 0.9625120908021927, + 0.4383871890604496, + 0.5699987020343542, + 0.08555139042437077, + 0.1005542054772377, + 0.2332735639065504, + 1.42288763448596, + 3.0839964281767607, + 0.4067723713815212, + 0.23302163556218147, + 0.6528075970709324, + 0.39215002954006195, + 1.0243500769138336, + 1.199381124228239 + ], + "unique_experts": 61, + "load_cv": 0.7873199042451452, + "normalized_load_entropy": 0.9250769418480599, + "max_load_share": 0.055031446540880505 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "5f68abee92fb9b12533eec5c60c2da6e518dd64752d0a141aeb53dcf058dda70", + "route_weight_sha256": "5353a797306fc4ffdbaf57fb19dc3fa62473ca8ce93c1af3b89817782be75d70", + "loads": [ + 10, + 10, + 16, + 3, + 3, + 13, + 13, + 7, + 7, + 12, + 26, + 31, + 7, + 14, + 12, + 12, + 2, + 19, + 6, + 18, + 10, + 19, + 20, + 13, + 17, + 5, + 16, + 11, + 15, + 26, + 16, + 22, + 16, + 10, + 3, + 18, + 1, + 3, + 8, + 2, + 16, + 14, + 13, + 27, + 17, + 11, + 19, + 16, + 12, + 9, + 20, + 18, + 22, + 4, + 14, + 16, + 22, + 35, + 6, + 12, + 15, + 9, + 27, + 16 + ], + "weighted_loads": [ + 0.5710575841367245, + 1.2468168213963509, + 3.2409823443740606, + 0.08831900730729103, + 0.10281671583652496, + 1.1175375916063786, + 0.741075785830617, + 0.31258982978761196, + 0.3191602509468794, + 1.1364376302808523, + 2.0938339456915855, + 1.401959117501974, + 0.38356830179691315, + 0.66594173386693, + 0.4591195397078991, + 0.44774785451591015, + 0.07055961433798075, + 1.0281761772930622, + 0.22847063653171062, + 1.0893345158547163, + 0.4819605126976967, + 1.2459423635154963, + 1.4867544993758202, + 1.1784730777144432, + 1.2446990627795458, + 0.17377045564353466, + 0.5583604741841555, + 0.8851868696510792, + 0.46810097713023424, + 1.8245408907532692, + 0.9079748000949621, + 0.8744573649019003, + 0.7888208590447903, + 0.8147656228393316, + 0.09309178590774536, + 1.0041377060115337, + 0.07126513868570328, + 0.11915469169616699, + 0.603214792907238, + 0.05450780689716339, + 0.6961686313152313, + 0.6220754515379667, + 0.6641098521649837, + 1.7912505622953176, + 1.1441626977175474, + 0.4300472363829613, + 0.9764804039150476, + 1.444490760564804, + 0.9065314307808876, + 1.2660127710551023, + 1.015266865491867, + 1.2146407030522823, + 1.1663213204592466, + 0.09856515470892191, + 0.7610971722751856, + 1.0601346548646688, + 1.6409408785402775, + 3.0839964281767607, + 0.4317298661917448, + 0.5428387802094221, + 0.6752376705408096, + 0.45563939213752747, + 1.1012041866779327, + 1.2847608514130116 + ], + "unique_experts": 64, + "load_cv": 0.5273998149759515, + "normalized_load_entropy": 0.9642842560972323, + "max_load_share": 0.03968253968253968 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 106, + "ordered_topk_exact_tokens": 62, + "set_exact_tokens": 81, + "mean_set_jaccard": 0.9305929919137468, + "mean_token_weighted_tv": 0.012818952249187344, + "aggregate_load_tv": 0.020440251572327043 + }, + "system_bos": { + "tokens": 106, + "ordered_topk_exact_tokens": 61, + "set_exact_tokens": 76, + "mean_set_jaccard": 0.9171159029649595, + "mean_token_weighted_tv": 0.016664788645323156, + "aggregate_load_tv": 0.02987421383647798 + }, + "system_x": { + "tokens": 106, + "ordered_topk_exact_tokens": 56, + "set_exact_tokens": 68, + "mean_set_jaccard": 0.8975741239892184, + "mean_token_weighted_tv": 0.0195959836227011, + "aggregate_load_tv": 0.042452830188679236 + }, + "system_period": { + "tokens": 106, + "ordered_topk_exact_tokens": 47, + "set_exact_tokens": 68, + "mean_set_jaccard": 0.8915094339622642, + "mean_token_weighted_tv": 0.019997154318569403, + "aggregate_load_tv": 0.03930817610062893 + }, + "bos_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 57, + "set_exact_tokens": 71, + "mean_set_jaccard": 0.9056603773584907, + "mean_token_weighted_tv": 0.018092911163309834, + "aggregate_load_tv": 0.03930817610062892 + }, + "bos_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 53, + "set_exact_tokens": 67, + "mean_set_jaccard": 0.894878706199461, + "mean_token_weighted_tv": 0.01989378325887165, + "aggregate_load_tv": 0.036163522012578615 + }, + "x_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 47, + "set_exact_tokens": 63, + "mean_set_jaccard": 0.8820754716981132, + "mean_token_weighted_tv": 0.020156591164194188, + "aggregate_load_tv": 0.04088050314465408 + }, + "x_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 39, + "set_exact_tokens": 54, + "mean_set_jaccard": 0.8537735849056604, + "mean_token_weighted_tv": 0.02593761027948755, + "aggregate_load_tv": 0.05503144654088049 + }, + "period_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 61, + "set_exact_tokens": 76, + "mean_set_jaccard": 0.9171159029649596, + "mean_token_weighted_tv": 0.016580459037971385, + "aggregate_load_tv": 0.029874213836477988 + }, + "period_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 40, + "set_exact_tokens": 56, + "mean_set_jaccard": 0.8551212938005394, + "mean_token_weighted_tv": 0.02521416260245836, + "aggregate_load_tv": 0.056603773584905655 + } + } + }, + "layer_22": { + "layer": 22, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "80b1fdc4cc644380c9deccdc060f03d409306ed250bcda0c136e0304e6beaf8e", + "route_weight_sha256": "e2efde9cdbdc5e1568fd8cd4febc71faef49ad1d4a7e5d7051cfa30439ca9ea3", + "loads": [ + 2, + 4, + 30, + 12, + 25, + 36, + 6, + 7, + 30, + 0, + 35, + 8, + 25, + 6, + 8, + 8, + 20, + 10, + 16, + 3, + 25, + 4, + 11, + 7, + 11, + 12, + 18, + 2, + 15, + 1, + 10, + 8, + 6, + 5, + 1, + 1, + 13, + 9, + 17, + 9, + 3, + 8, + 8, + 0, + 3, + 0, + 11, + 11, + 6, + 14, + 6, + 4, + 6, + 9, + 1, + 1, + 15, + 9, + 8, + 17, + 4, + 3, + 8, + 5 + ], + "weighted_loads": [ + 0.11411748826503754, + 0.1514640413224697, + 2.9815246611833572, + 1.7859076485037804, + 2.533746834844351, + 2.74457535892725, + 0.3620434030890465, + 0.32954197749495506, + 1.414384052157402, + 0.0, + 2.5864196307957172, + 0.3885536026209593, + 1.4143841713666916, + 0.31662864051759243, + 0.3165293037891388, + 0.32289058715105057, + 1.166441023349762, + 0.6393762324005365, + 0.8910794463008642, + 0.14479001611471176, + 1.06502821482718, + 0.2722410708665848, + 0.5243068747222424, + 0.45172833278775215, + 0.6294760480523109, + 0.5511192306876183, + 0.8949023634195328, + 0.07274950295686722, + 1.0359529852867126, + 0.03245105594396591, + 0.4858007561415434, + 0.6409061010926962, + 0.23829195462167263, + 0.14188484475016594, + 0.056016676127910614, + 0.034844815731048584, + 0.7872749753296375, + 0.3921266794204712, + 1.3223937004804611, + 0.46128804236650467, + 0.17291001975536346, + 0.42526500672101974, + 0.9469721727073193, + 0.0, + 0.08228318206965923, + 0.0, + 0.8110223300755024, + 0.6264636926352978, + 0.507754435762763, + 2.3244003616273403, + 0.21176897548139095, + 0.1948702037334442, + 0.28057489916682243, + 0.30050297267735004, + 0.034293219447135925, + 0.02326238714158535, + 0.9830137677490711, + 0.5042157601565123, + 0.41056403517723083, + 1.3601923249661922, + 0.31796377152204514, + 0.11252668499946594, + 0.4160041119903326, + 0.18417351320385933 + ], + "unique_experts": 61, + "load_cv": 0.8469575731118278, + "normalized_load_entropy": 0.9198511397347502, + "max_load_share": 0.05660377358490566 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "1b1887c7a2b075e278bdc7977fa50758b62b1b62763439fb002eddb9b714aa9d", + "route_weight_sha256": "7f0fabb13fe817db154d97a16c2c2f436101f90b75b65de33b1367cb769e2909", + "loads": [ + 6, + 5, + 32, + 22, + 25, + 39, + 11, + 7, + 44, + 5, + 35, + 10, + 25, + 6, + 13, + 8, + 20, + 12, + 16, + 3, + 25, + 11, + 13, + 7, + 12, + 14, + 19, + 5, + 15, + 1, + 11, + 8, + 10, + 11, + 2, + 3, + 13, + 9, + 17, + 10, + 7, + 8, + 13, + 0, + 3, + 1, + 13, + 11, + 10, + 16, + 11, + 4, + 6, + 11, + 1, + 14, + 18, + 10, + 9, + 17, + 12, + 11, + 9, + 11 + ], + "weighted_loads": [ + 0.2889064298942685, + 0.19666631519794464, + 3.058424036949873, + 3.722091507166624, + 2.533746834844351, + 2.906521967612207, + 0.6910165166482329, + 0.32954197749495506, + 2.633169924840331, + 0.19242935813963413, + 2.5864196307957172, + 0.4180197836831212, + 1.4143841713666916, + 0.31662864051759243, + 0.8951710714027286, + 0.32289058715105057, + 1.166441023349762, + 0.7094024512916803, + 0.8910794463008642, + 0.14479001611471176, + 1.06502821482718, + 0.9320926740765572, + 0.5869238507002592, + 0.45172833278775215, + 0.6571273561567068, + 0.6114488877356052, + 0.9625194296240807, + 0.1972117405384779, + 1.0359529852867126, + 0.03245105594396591, + 0.5201179552823305, + 0.6409061010926962, + 0.36975983483716846, + 0.35495549626648426, + 0.12016153335571289, + 0.1134699285030365, + 0.7872749753296375, + 0.3921266794204712, + 1.3223937004804611, + 0.5257859900593758, + 0.41842399165034294, + 0.42526500672101974, + 1.3884486928582191, + 0.0, + 0.08228318206965923, + 0.03088296204805374, + 0.8797071501612663, + 0.6264636926352978, + 0.716929392889142, + 2.514021050184965, + 0.44623900577425957, + 0.1948702037334442, + 0.28057489916682243, + 0.4196308422833681, + 0.034293219447135925, + 1.1221371074207127, + 1.105173036456108, + 0.5298546683043242, + 0.5316645354032516, + 1.3601923249661922, + 1.4385400377213955, + 0.3935258127748966, + 0.4426577892154455, + 0.4054964780807495 + ], + "unique_experts": 63, + "load_cv": 0.7113722941999265, + "normalized_load_entropy": 0.9442451525679563, + "max_load_share": 0.05597964376590331 + } + }, + "s1_eos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "c026bf0450f19f6d69ec51aeed8a1718bebb557e741e0a2ac72fe0af8e13de41", + "route_weight_sha256": "28ddea8bfebc81a75bf4dc20a09dfd42f576dfe0ad06b79b735e5ab8c82b7363", + "loads": [ + 2, + 2, + 30, + 12, + 27, + 35, + 6, + 7, + 30, + 0, + 34, + 8, + 25, + 5, + 8, + 7, + 20, + 10, + 16, + 3, + 29, + 4, + 10, + 6, + 10, + 13, + 16, + 2, + 15, + 3, + 10, + 8, + 6, + 4, + 1, + 1, + 12, + 8, + 17, + 9, + 3, + 8, + 9, + 0, + 2, + 0, + 12, + 11, + 6, + 13, + 6, + 4, + 6, + 9, + 1, + 1, + 16, + 9, + 9, + 18, + 4, + 3, + 9, + 6 + ], + "weighted_loads": [ + 0.11306741461157799, + 0.07666759192943573, + 3.0112821105867624, + 1.7810152545571327, + 2.611817345023155, + 2.670624941587448, + 0.3652571029961109, + 0.32471964322030544, + 1.3998459428548813, + 0.0, + 2.5990582294762135, + 0.394648727029562, + 1.410657461732626, + 0.28442640230059624, + 0.31758129596710205, + 0.29153215885162354, + 1.1707744151353836, + 0.6426431182771921, + 0.8941738326102495, + 0.145607341080904, + 1.2408911734819412, + 0.27302396297454834, + 0.4814821146428585, + 0.4134704302996397, + 0.5953853614628315, + 0.5919180084019899, + 0.8208223208785057, + 0.07327189855277538, + 1.0264853928238153, + 0.10104422643780708, + 0.4834687318652868, + 0.6365378908813, + 0.22780244424939156, + 0.11222941987216473, + 0.0463065505027771, + 0.034013476222753525, + 0.7563441097736359, + 0.3552489597350359, + 1.3319630213081837, + 0.4666476510465145, + 0.17933456972241402, + 0.4206506237387657, + 0.9714730270206928, + 0.0, + 0.056791165843605995, + 0.0, + 0.8582686502486467, + 0.6369821298867464, + 0.5143134109675884, + 2.291009768843651, + 0.2192249372601509, + 0.19772442057728767, + 0.2776504345238209, + 0.30388339422643185, + 0.03417697921395302, + 0.02181072160601616, + 1.0132466610521078, + 0.4980277046561241, + 0.4514232762157917, + 1.3884912114590406, + 0.3194795325398445, + 0.11088472232222557, + 0.4329690784215927, + 0.21889740228652954 + ], + "unique_experts": 61, + "load_cv": 0.8580930726743932, + "normalized_load_entropy": 0.9180442184250458, + "max_load_share": 0.055031446540880505 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "27973f5769c7c1f28f369c37ed33e39d810d04cda7b9d97161ebff4a21a4bee1", + "route_weight_sha256": "07143d310bb89e625388cf35dc42d9802e73a6d003cbb571ce024b69a06311ba", + "loads": [ + 4, + 7, + 30, + 24, + 27, + 39, + 12, + 9, + 50, + 9, + 34, + 13, + 28, + 5, + 13, + 11, + 23, + 13, + 17, + 3, + 30, + 17, + 11, + 6, + 11, + 14, + 17, + 4, + 16, + 3, + 11, + 8, + 9, + 15, + 9, + 6, + 14, + 9, + 17, + 10, + 14, + 9, + 14, + 2, + 2, + 2, + 14, + 13, + 10, + 15, + 17, + 7, + 11, + 12, + 1, + 21, + 20, + 10, + 13, + 18, + 18, + 13, + 9, + 9 + ], + "weighted_loads": [ + 0.23974474426358938, + 0.5533686764538288, + 3.0112821105867624, + 3.981297466903925, + 2.611817345023155, + 2.852940754033625, + 0.7436464186757803, + 0.4055021349340677, + 3.082802217453718, + 0.4647060912102461, + 2.5990582294762135, + 0.695504036732018, + 1.551201932132244, + 0.28442640230059624, + 0.8933383729308844, + 0.5280294455587864, + 1.316080454736948, + 0.7431894354522228, + 0.934189947322011, + 0.145607341080904, + 1.2892654612660408, + 1.397344909608364, + 0.5244386121630669, + 0.4134704302996397, + 0.6263429056853056, + 0.6174750700592995, + 0.8905874937772751, + 0.1570818740874529, + 1.109097981825471, + 0.10104422643780708, + 0.5370650161057711, + 0.6365378908813, + 0.33934902027249336, + 0.5211856383830309, + 0.39136320911347866, + 0.2354896068572998, + 0.8465036228299141, + 0.38885204307734966, + 1.3319630213081837, + 0.5293751694262028, + 0.9021045677363873, + 0.4460937939584255, + 1.435355830937624, + 0.1360919177532196, + 0.056791165843605995, + 0.07559001818299294, + 0.924719912931323, + 0.7034788709133863, + 0.725906427949667, + 2.7535023167729378, + 0.7328364215791225, + 0.4094333201646805, + 0.8228295519948006, + 0.47298513539135456, + 0.03417697921395302, + 1.7281356640160084, + 1.2271405588835478, + 0.5230121053755283, + 0.6402660044841468, + 1.3884912114590406, + 2.236182238906622, + 0.5273699052631855, + 0.4329690784215927, + 0.36615559831261635 + ], + "unique_experts": 64, + "load_cv": 0.6563871907327573, + "normalized_load_entropy": 0.9529556677787329, + "max_load_share": 0.05668934240362812 + } + }, + "s0_bos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "07af8e567201385b7a27a92653f4456cef1c4ed278c9bf1243f7d50e0a335236", + "route_weight_sha256": "59091cd26b88b6aef9703b129b8dc0b88bf0e1b335a5d5cc58b61d619b7f02d1", + "loads": [ + 2, + 2, + 31, + 12, + 29, + 38, + 6, + 6, + 29, + 0, + 37, + 7, + 25, + 5, + 7, + 8, + 19, + 11, + 15, + 3, + 26, + 3, + 9, + 7, + 12, + 12, + 18, + 1, + 15, + 2, + 10, + 8, + 5, + 6, + 0, + 1, + 14, + 10, + 17, + 8, + 3, + 9, + 9, + 0, + 2, + 0, + 11, + 11, + 6, + 14, + 5, + 4, + 6, + 8, + 1, + 1, + 16, + 8, + 8, + 17, + 4, + 4, + 8, + 5 + ], + "weighted_loads": [ + 0.10776766762137413, + 0.08092525601387024, + 3.1019180938601494, + 1.7575336024165154, + 2.7245481237769127, + 2.92611744068563, + 0.3524560835212469, + 0.3035073336213827, + 1.4126350115984678, + 0.0, + 2.708540018647909, + 0.3547228705137968, + 1.4324050843715668, + 0.27078131027519703, + 0.2720385044813156, + 0.3177526332437992, + 1.129737664014101, + 0.6423478834331036, + 0.8617993984371424, + 0.14391497895121574, + 1.0876248851418495, + 0.2403324842453003, + 0.4436698481440544, + 0.4649885781109333, + 0.6552807241678238, + 0.5442593954503536, + 0.9102836698293686, + 0.02908659167587757, + 1.0362155381590128, + 0.0654989741742611, + 0.48379177041351795, + 0.6380481738597155, + 0.21099861897528172, + 0.1710428949445486, + 0.0, + 0.036332666873931885, + 0.8315920978784561, + 0.4296767860651016, + 1.3464413322508335, + 0.4058723449707031, + 0.17444423213601112, + 0.45385567471385, + 0.9364422857761383, + 0.0, + 0.05768481269478798, + 0.0, + 0.8309416100382805, + 0.6137402765452862, + 0.5026388633996248, + 2.3693211246281862, + 0.17403100430965424, + 0.19647664204239845, + 0.2737270873039961, + 0.25772213377058506, + 0.03380749374628067, + 0.021488144993782043, + 1.0297944620251656, + 0.4690482299774885, + 0.41749903187155724, + 1.3637419566512108, + 0.3140338771045208, + 0.14602954871952534, + 0.424666129052639, + 0.1851781290024519 + ], + "unique_experts": 60, + "load_cv": 0.8899537745400069, + "normalized_load_entropy": 0.9125165279166038, + "max_load_share": 0.059748427672955975 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "c170865c817a3124bd64e8ed52c2910e6394a10a68417873e0645c90466a0417", + "route_weight_sha256": "846aa77794bbecfd6eda06d24f2fafc7fd8ac7a06000139d37bb3ff449cd1135", + "loads": [ + 6, + 2, + 33, + 21, + 29, + 40, + 10, + 7, + 42, + 5, + 38, + 8, + 25, + 5, + 9, + 9, + 19, + 13, + 15, + 3, + 26, + 10, + 10, + 7, + 15, + 14, + 19, + 5, + 15, + 2, + 10, + 8, + 8, + 12, + 1, + 5, + 14, + 12, + 17, + 9, + 7, + 9, + 14, + 0, + 2, + 1, + 13, + 11, + 11, + 16, + 9, + 4, + 6, + 10, + 1, + 13, + 19, + 10, + 9, + 17, + 13, + 12, + 8, + 13 + ], + "weighted_loads": [ + 0.2825566092506051, + 0.08092525601387024, + 3.178817469626665, + 2.7978557497262955, + 2.7245481237769127, + 3.0418813163414598, + 0.6629383508116007, + 1.2316559609025717, + 2.594859419390559, + 0.19242935813963413, + 2.7258167173713446, + 0.36717598233371973, + 1.4324050843715668, + 0.27078131027519703, + 0.6911062300205231, + 0.3595830053091049, + 1.129737664014101, + 0.7222162261605263, + 0.8617993984371424, + 0.14391497895121574, + 1.0876248851418495, + 0.8884323984384537, + 0.47231934405863285, + 0.4649885781109333, + 0.7099972520954907, + 0.6045890524983406, + 0.9747097417712212, + 0.18848394975066185, + 1.0362155381590128, + 0.0654989741742611, + 0.48379177041351795, + 0.6380481738597155, + 0.3422135729342699, + 0.38479332625865936, + 0.06414485722780228, + 0.21246782690286636, + 0.8315920978784561, + 0.5147031843662262, + 1.3464413322508335, + 0.4700332060456276, + 0.4031786620616913, + 0.45385567471385, + 1.2712139759678394, + 0.0, + 0.05768481269478798, + 0.03088296204805374, + 0.8992798272520304, + 0.6137402765452862, + 0.8125943038612604, + 2.499058563960716, + 0.3535423446446657, + 0.19647664204239845, + 0.2737270873039961, + 0.3691916186362505, + 0.03380749374628067, + 1.1137706600129604, + 1.1519537307322025, + 0.5018748133443296, + 0.5438928417861462, + 1.3637419566512108, + 1.548764429986477, + 0.427028676494956, + 0.424666129052639, + 0.5124997440725565 + ], + "unique_experts": 63, + "load_cv": 0.735853050377254, + "normalized_load_entropy": 0.9404588510103127, + "max_load_share": 0.05343511450381679 + } + }, + "s1_bos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "fd70cebf7b4e5e8168ed6aa92722aae35dc685f055dc980a9ae3074497958a8c", + "route_weight_sha256": "b7b9a1e65f638c5b9711bb7df08c6690c59ad607a6b49907a3e6566cc9a33f03", + "loads": [ + 2, + 3, + 30, + 12, + 29, + 34, + 6, + 6, + 33, + 0, + 38, + 7, + 25, + 5, + 9, + 7, + 19, + 11, + 14, + 3, + 25, + 3, + 10, + 6, + 11, + 14, + 17, + 2, + 15, + 2, + 10, + 7, + 6, + 5, + 0, + 1, + 13, + 10, + 17, + 9, + 3, + 8, + 8, + 0, + 2, + 0, + 12, + 11, + 6, + 12, + 5, + 4, + 6, + 9, + 1, + 1, + 15, + 9, + 9, + 19, + 4, + 2, + 8, + 6 + ], + "weighted_loads": [ + 0.11058268696069717, + 0.11713604256510735, + 3.0472803078591824, + 1.723163515329361, + 2.6740711499005556, + 2.6514493860304356, + 0.35760651901364326, + 0.30654532089829445, + 1.5275692883878946, + 0.0, + 2.7587709426879883, + 0.35020296089351177, + 1.4137066677212715, + 0.2772653792053461, + 0.34317958541214466, + 0.28383518010377884, + 1.1202133782207966, + 0.6501526292413473, + 0.8134837057441473, + 0.1498250886797905, + 1.095034521073103, + 0.22971811890602112, + 0.47384197264909744, + 0.41603079810738564, + 0.6354357320815325, + 0.5932470336556435, + 0.870929054915905, + 0.06365559622645378, + 1.043827548623085, + 0.06828656792640686, + 0.4929759278893471, + 0.6045811586081982, + 0.24550978280603886, + 0.14542640559375286, + 0.0, + 0.03722838684916496, + 0.773603767156601, + 0.4394427761435509, + 1.369384977966547, + 0.43584248796105385, + 0.17930524051189423, + 0.4235655553638935, + 0.8882211148738861, + 0.0, + 0.054162539541721344, + 0.0, + 0.8396437633782625, + 0.6261855363845825, + 0.5130915250629187, + 2.271158989518881, + 0.18886765465140343, + 0.20488565415143967, + 0.28170434571802616, + 0.30349482223391533, + 0.032524269074201584, + 0.018014663830399513, + 0.9812452867627144, + 0.5055571608245373, + 0.4592664483934641, + 1.4399217814207077, + 0.3144663833081722, + 0.06780488789081573, + 0.4103104956448078, + 0.21600586734712124 + ], + "unique_experts": 60, + "load_cv": 0.8829928860697622, + "normalized_load_entropy": 0.9136906525104591, + "max_load_share": 0.059748427672955975 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "fc622c703b9b8ff994aa772404c352159c0aad5c7f94d574d4d0c248e95d83ed", + "route_weight_sha256": "bf94b269da6000a304f665f9fe56cb4f603427db4b8ac1e607bf9b7e729c892a", + "loads": [ + 4, + 7, + 30, + 24, + 29, + 36, + 11, + 8, + 53, + 9, + 38, + 12, + 28, + 5, + 13, + 12, + 22, + 14, + 15, + 3, + 26, + 15, + 12, + 6, + 12, + 15, + 18, + 5, + 16, + 2, + 11, + 7, + 8, + 16, + 8, + 7, + 15, + 12, + 17, + 10, + 14, + 9, + 13, + 2, + 2, + 0, + 14, + 13, + 12, + 15, + 15, + 7, + 11, + 13, + 1, + 20, + 19, + 10, + 12, + 19, + 19, + 12, + 8, + 11 + ], + "weighted_loads": [ + 0.23726001661270857, + 0.5548929795622826, + 3.0472803078591824, + 3.0511547178030014, + 2.6740711499005556, + 2.7639393201097846, + 0.7185298502445221, + 0.38732781261205673, + 3.2010650616139174, + 0.4647060912102461, + 2.7587709426879883, + 0.6794208800420165, + 1.5542511381208897, + 0.2772653792053461, + 0.8836279176175594, + 0.5633904747664928, + 1.265519417822361, + 0.7730960100889206, + 0.8534998204559088, + 0.1498250886797905, + 1.1434088088572025, + 1.3018893860280514, + 0.5641447678208351, + 0.41603079810738564, + 0.6673561539500952, + 0.618804095312953, + 0.9393298253417015, + 0.18803123757243156, + 1.1264401376247406, + 0.06828656792640686, + 0.5311979614198208, + 0.6045811586081982, + 0.34402800165116787, + 0.5487113241106272, + 0.34505665861070156, + 0.289611853659153, + 0.8637632802128792, + 0.5259735807776451, + 1.369384977966547, + 0.4972708970308304, + 0.8959146030247211, + 0.4490087255835533, + 1.3437320813536644, + 0.1360919177532196, + 0.054162539541721344, + 0.0, + 0.9062285106629133, + 0.6926822774112225, + 0.8977352511137724, + 2.802740205079317, + 0.6635958105325699, + 0.4165945537388325, + 0.8268834631890059, + 0.5129832401871681, + 0.032524269074201584, + 1.7178825046867132, + 1.1951391845941544, + 0.5305415615439415, + 0.648603143170476, + 1.4399217814207077, + 2.3728782571852207, + 0.48429007083177567, + 0.4103104956448078, + 0.46952675841748714 + ], + "unique_experts": 63, + "load_cv": 0.6696640778170705, + "normalized_load_entropy": 0.9506521376855273, + "max_load_share": 0.060090702947845805 + } + }, + "s0_x": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "abe5a0faa5ee2a2fda87196e1080636e2674fc8da42260f0ba48ff01f18695d8", + "route_weight_sha256": "e687150783fea56392003d36cf247444574129a6a265b02a5b5f79dd86c31525", + "loads": [ + 2, + 4, + 31, + 12, + 28, + 34, + 6, + 10, + 29, + 0, + 36, + 7, + 25, + 5, + 8, + 8, + 20, + 10, + 16, + 3, + 26, + 4, + 11, + 7, + 12, + 13, + 17, + 0, + 15, + 1, + 10, + 8, + 3, + 4, + 0, + 1, + 12, + 10, + 17, + 9, + 3, + 8, + 9, + 0, + 1, + 0, + 10, + 11, + 6, + 13, + 5, + 3, + 6, + 9, + 1, + 2, + 16, + 9, + 8, + 19, + 4, + 4, + 9, + 6 + ], + "weighted_loads": [ + 0.11512251943349838, + 0.15273244306445122, + 3.0549290888011456, + 1.7746375985443592, + 2.685312367975712, + 2.763442225754261, + 0.34960252419114113, + 0.3928188569843769, + 1.3216371200978756, + 0.0, + 2.678245734423399, + 0.35230371356010437, + 1.4052401036024094, + 0.27520569413900375, + 0.32286790013313293, + 0.31379545852541924, + 1.1542847864329815, + 0.617532841861248, + 0.8952195346355438, + 0.1421537883579731, + 1.0969042386859655, + 0.26933033764362335, + 0.517632070928812, + 0.4396904185414314, + 0.662701677531004, + 0.5694593787193298, + 0.8630332052707672, + 0.0, + 1.0288875941187143, + 0.0333065539598465, + 0.4745118636637926, + 0.6417737938463688, + 0.14064407534897327, + 0.12122021242976189, + 0.0, + 0.036656420677900314, + 0.742317222058773, + 0.4384097717702389, + 1.334181897342205, + 0.46104734390974045, + 0.17254726961255074, + 0.424100361764431, + 0.9467267952859402, + 0.0, + 0.030418716371059418, + 0.0, + 0.7615540139377117, + 0.6156000215560198, + 0.48454444855451584, + 2.349357381463051, + 0.18153825402259827, + 0.16128430888056755, + 0.2706722058355808, + 0.29769490472972393, + 0.03397751599550247, + 0.03996247798204422, + 1.023416006937623, + 0.49432894960045815, + 0.42343153432011604, + 1.4203734919428825, + 0.3251812383532524, + 0.15538732707500458, + 0.4344349391758442, + 0.2137176413089037 + ], + "unique_experts": 59, + "load_cv": 0.8670809864866695, + "normalized_load_entropy": 0.9135480673484523, + "max_load_share": 0.05660377358490566 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "93ac184fd34252d77fd34b8fe72372f7d89d8d7c83e9cffcfe94fd30c39fff7e", + "route_weight_sha256": "c4d7f33a0cfcdb8839cdc4ad103e9462d92087c2ebea5e57ca82bd36b77dc41a", + "loads": [ + 6, + 6, + 33, + 22, + 28, + 37, + 11, + 10, + 42, + 6, + 36, + 8, + 25, + 5, + 11, + 8, + 20, + 13, + 16, + 3, + 26, + 12, + 12, + 7, + 12, + 15, + 18, + 2, + 15, + 1, + 11, + 8, + 6, + 12, + 2, + 3, + 12, + 10, + 17, + 10, + 7, + 8, + 14, + 0, + 1, + 1, + 12, + 11, + 8, + 15, + 10, + 3, + 6, + 11, + 1, + 16, + 19, + 10, + 9, + 19, + 12, + 13, + 10, + 13 + ], + "weighted_loads": [ + 0.28991146106272936, + 0.23249758407473564, + 3.1318284645676613, + 2.9176786839962006, + 2.685312367975712, + 2.9001164445653558, + 0.7382571175694466, + 0.3928188569843769, + 2.503169856965542, + 0.22343317978084087, + 2.678245734423399, + 0.3647568253800273, + 1.4052401036024094, + 0.27520569413900375, + 0.7722013145685196, + 0.31379545852541924, + 1.1542847864329815, + 0.7372367642819881, + 0.8952195346355438, + 0.1421537883579731, + 1.0969042386859655, + 0.9928791895508766, + 0.5462815668433905, + 0.4396904185414314, + 0.662701677531004, + 0.6297890357673168, + 0.92298349365592, + 0.07163579948246479, + 1.0288875941187143, + 0.0333065539598465, + 0.5193713288754225, + 0.6417737938463688, + 0.26792500726878643, + 0.4231627378612757, + 0.09277216717600822, + 0.12183854356408119, + 0.742317222058773, + 0.4384097717702389, + 1.334181897342205, + 0.5245701670646667, + 0.42622627317905426, + 0.424100361764431, + 1.3624614030122757, + 0.0, + 0.030418716371059418, + 0.03088296204805374, + 0.828800281509757, + 0.6156000215560198, + 0.6169076561927795, + 2.60121613740921, + 0.4305944927036762, + 0.16128430888056755, + 0.2706722058355808, + 0.41128202341496944, + 0.03397751599550247, + 1.3421848006546497, + 1.14557527564466, + 0.51996785774827, + 0.5287824384868145, + 1.4203734919428825, + 1.4689961560070515, + 0.4915864020586014, + 0.4638304505497217, + 0.46772907860577106 + ], + "unique_experts": 63, + "load_cv": 0.7207758109285751, + "normalized_load_entropy": 0.9409262202074069, + "max_load_share": 0.05343511450381679 + } + }, + "s1_x": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "4a68812304a151e2260841a1eeff6986bc440092948a4dcad616cae512adaf2e", + "route_weight_sha256": "539d72328326fbc1c87ff3c4254feb3b79f239d071355cf4a203fb974bbd750c", + "loads": [ + 2, + 2, + 30, + 12, + 29, + 32, + 6, + 7, + 35, + 0, + 37, + 7, + 25, + 5, + 8, + 8, + 19, + 11, + 14, + 3, + 22, + 4, + 10, + 7, + 11, + 13, + 17, + 1, + 15, + 1, + 12, + 8, + 5, + 4, + 0, + 2, + 13, + 10, + 16, + 9, + 4, + 8, + 8, + 0, + 1, + 0, + 10, + 11, + 7, + 12, + 6, + 3, + 6, + 9, + 1, + 2, + 15, + 9, + 8, + 18, + 4, + 6, + 8, + 8 + ], + "weighted_loads": [ + 0.11056139320135117, + 0.0866200365126133, + 3.017244003713131, + 1.7684139497578144, + 2.67160726711154, + 2.564875489100814, + 0.3596909213811159, + 0.3155469335615635, + 1.5632984340190887, + 0.0, + 2.7269139364361763, + 0.34971646033227444, + 1.3889688290655613, + 0.2627812158316374, + 0.32766843400895596, + 0.31350431963801384, + 1.1035919040441513, + 0.6588960271328688, + 0.8159566465765238, + 0.13722514733672142, + 0.9650181289762259, + 0.26441100239753723, + 0.45705448649823666, + 0.4185632672160864, + 0.6424189433455467, + 0.5681681893765926, + 0.8726966790854931, + 0.03504737466573715, + 1.0064775552600622, + 0.029495488852262497, + 0.5467473659664392, + 0.6319676339626312, + 0.20742632448673248, + 0.12054423987865448, + 0.0, + 0.06905793771147728, + 0.7681145071983337, + 0.4457826018333435, + 1.306276898831129, + 0.4764000438153744, + 0.21244357526302338, + 0.4315287508070469, + 0.8984688818454742, + 0.0, + 0.032098438590765, + 0.0, + 0.7489739209413528, + 0.623630229383707, + 0.5155268386006355, + 2.28186896443367, + 0.22171791456639767, + 0.17103588208556175, + 0.2759567406028509, + 0.30324387177824974, + 0.03232347220182419, + 0.039752187207341194, + 0.9558869823813438, + 0.5083559639751911, + 0.4106555972248316, + 1.40221431478858, + 0.33000944182276726, + 0.22979401424527168, + 0.39892883598804474, + 0.28368050791323185 + ], + "unique_experts": 60, + "load_cv": 0.862690443228957, + "normalized_load_entropy": 0.916826453540909, + "max_load_share": 0.05817610062893082 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "47292f365d983ed788160947a605007f9476229f44bf4dbf363ea1af0bfec431", + "route_weight_sha256": "f1db074e1debfffa8330596de7849c8a6a3c76d9168e4e816d9a0a10e16b6a00", + "loads": [ + 5, + 7, + 30, + 24, + 29, + 35, + 12, + 9, + 57, + 10, + 37, + 11, + 28, + 5, + 12, + 12, + 22, + 14, + 15, + 3, + 23, + 17, + 11, + 7, + 11, + 14, + 18, + 3, + 16, + 1, + 12, + 8, + 7, + 13, + 8, + 6, + 15, + 11, + 16, + 10, + 16, + 9, + 13, + 2, + 2, + 0, + 11, + 13, + 10, + 15, + 17, + 6, + 11, + 14, + 1, + 25, + 19, + 10, + 11, + 18, + 18, + 18, + 8, + 11 + ], + "weighted_loads": [ + 0.2628790223971009, + 0.5594473071396351, + 3.017244003713131, + 3.1308261193335056, + 2.67160726711154, + 2.687598622404039, + 0.7632333058863878, + 0.3963294252753258, + 3.3135335333645344, + 0.513301556929946, + 2.7269139364361763, + 0.633382766507566, + 1.5295132994651794, + 0.2627812158316374, + 0.8469011411070824, + 0.5500016063451767, + 1.2488979436457157, + 0.747700959444046, + 0.8559727612882853, + 0.13722514733672142, + 1.0133924167603254, + 1.3947088532149792, + 0.500010984018445, + 0.4185632672160864, + 0.6424189433455467, + 0.5937252510339022, + 0.9297408014535904, + 0.10567997023463249, + 1.0890901442617178, + 0.029495488852262497, + 0.5467473659664392, + 0.6319676339626312, + 0.31396331265568733, + 0.4526767134666443, + 0.34505665861070156, + 0.22951683029532433, + 0.858274020254612, + 0.4771709255874157, + 1.306276898831129, + 0.5392459817230701, + 0.9668395556509495, + 0.4569719210267067, + 1.4098695144057274, + 0.1360919177532196, + 0.08476515486836433, + 0.0, + 0.7834862396121025, + 0.690126970410347, + 0.676043763756752, + 2.8281229734420776, + 0.741335766389966, + 0.38274478167295456, + 0.8211358580738306, + 0.5237408019602299, + 0.03232347220182419, + 2.1140822675079107, + 1.1697808802127838, + 0.5333403646945953, + 0.5816467273980379, + 1.40221431478858, + 2.2960273921489716, + 0.7998203858733177, + 0.39892883598804474, + 0.43093870393931866 + ], + "unique_experts": 63, + "load_cv": 0.6904715361630979, + "normalized_load_entropy": 0.9480758475676706, + "max_load_share": 0.06462585034013606 + } + }, + "s0_period": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "fd3b68fbf231e2becdf25733fe3ff49778455039a96d45ad88f68d0324a41417", + "route_weight_sha256": "259a3f1ebebcf0f47df7f16f49d595ec0836220c1c41e142489e4814c4fca34f", + "loads": [ + 2, + 4, + 31, + 12, + 29, + 34, + 5, + 7, + 30, + 0, + 37, + 7, + 25, + 5, + 8, + 9, + 20, + 11, + 17, + 3, + 26, + 4, + 10, + 6, + 13, + 14, + 17, + 0, + 14, + 2, + 11, + 8, + 3, + 4, + 1, + 1, + 13, + 10, + 17, + 9, + 3, + 7, + 7, + 0, + 2, + 0, + 12, + 11, + 6, + 13, + 6, + 3, + 6, + 8, + 1, + 2, + 16, + 9, + 7, + 18, + 4, + 0, + 9, + 7 + ], + "weighted_loads": [ + 0.10761161521077156, + 0.15327243134379387, + 3.0795163214206696, + 1.7748927511274815, + 2.693786136806011, + 2.7572167478501797, + 0.32886814698576927, + 0.33340352959930897, + 1.395387165248394, + 0.0, + 2.7523779049515724, + 0.35073618590831757, + 1.4223039150238037, + 0.2770462539047003, + 0.309477336704731, + 0.3513106666505337, + 1.1514118388295174, + 0.6502692345529795, + 0.9044942427426577, + 0.15127526223659515, + 1.0785227548331022, + 0.27609775215387344, + 0.47934744879603386, + 0.42736077308654785, + 0.6973210666328669, + 0.5974698383361101, + 0.8788764774799347, + 0.0, + 0.9992805309593678, + 0.06697749719023705, + 0.4965349826961756, + 0.6226093228906393, + 0.1434401012957096, + 0.11507528088986874, + 0.04932878911495209, + 0.03651821240782738, + 0.7921781688928604, + 0.4323301874101162, + 1.332434982061386, + 0.45711613819003105, + 0.16919487342238426, + 0.37388357147574425, + 0.8623007051646709, + 0.0, + 0.052125174552202225, + 0.0, + 0.8494321350008249, + 0.6199080664664507, + 0.4814235679805279, + 2.3410254791378975, + 0.204646123573184, + 0.16410424932837486, + 0.2730488032102585, + 0.2670823186635971, + 0.03299858421087265, + 0.03967026434838772, + 1.0222785640507936, + 0.49720591120421886, + 0.3773384392261505, + 1.3955198805779219, + 0.3310812935233116, + 0.0, + 0.4454240333288908, + 0.2571575026959181 + ], + "unique_experts": 59, + "load_cv": 0.8829928860697622, + "normalized_load_entropy": 0.911286690757135, + "max_load_share": 0.05817610062893082 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "6143b9a1ef95f4e541150d4d13a10654e4dbe9fb8ec02a65304a8612c7cda8aa", + "route_weight_sha256": "bc34b205325649fc773470fb21180766c6164b693e91fe1c6d0b22cad0044ddd", + "loads": [ + 7, + 6, + 33, + 21, + 29, + 36, + 9, + 7, + 43, + 5, + 37, + 8, + 25, + 5, + 12, + 9, + 20, + 14, + 17, + 3, + 26, + 13, + 11, + 6, + 14, + 16, + 18, + 2, + 14, + 2, + 11, + 8, + 6, + 10, + 2, + 3, + 13, + 10, + 17, + 11, + 8, + 7, + 12, + 0, + 3, + 1, + 14, + 11, + 10, + 15, + 11, + 3, + 6, + 11, + 1, + 15, + 19, + 10, + 8, + 18, + 13, + 8, + 9, + 14 + ], + "weighted_loads": [ + 0.30662022810429335, + 0.28352415189146996, + 3.1564156971871853, + 2.8203779086470604, + 2.693786136806011, + 2.8829750707373023, + 0.6452211067080498, + 0.33340352959930897, + 2.5779565945267677, + 0.19242935813963413, + 2.7523779049515724, + 0.3631892977282405, + 1.4223039150238037, + 0.2770462539047003, + 0.793260034173727, + 0.3513106666505337, + 1.1514118388295174, + 0.7970476690679789, + 0.9044942427426577, + 0.15127526223659515, + 1.0785227548331022, + 1.0434884540736675, + 0.5079969447106123, + 0.42736077308654785, + 0.7253929991275072, + 0.6577994953840971, + 0.9396682269871235, + 0.07163579948246479, + 0.9992805309593678, + 0.06697749719023705, + 0.4965349826961756, + 0.6226093228906393, + 0.2707860879600048, + 0.3330208621919155, + 0.11347364634275436, + 0.12266658246517181, + 0.7921781688928604, + 0.4323301874101162, + 1.332434982061386, + 0.5538659282028675, + 0.4747941829264164, + 0.37388357147574425, + 1.2429197207093239, + 0.0, + 0.07712135091423988, + 0.03088296204805374, + 0.9179112184792757, + 0.6199080664664507, + 0.674482449889183, + 2.5158615447580814, + 0.5017357710748911, + 0.16410424932837486, + 0.2730488032102585, + 0.42351267859339714, + 0.03299858421087265, + 1.241105543449521, + 1.1444378327578306, + 0.5228448193520308, + 0.48875001072883606, + 1.3955198805779219, + 1.534398090094328, + 0.2809991277754307, + 0.4454240333288908, + 0.5214904341846704 + ], + "unique_experts": 63, + "load_cv": 0.7255032584479782, + "normalized_load_entropy": 0.9413960103697434, + "max_load_share": 0.054707379134860054 + } + }, + "s1_period": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "99d1bd04a6f2877d5272dfb26e0a4c84c26e49c5ae87d0702fa3abc894e258b5", + "route_weight_sha256": "6844e9254be4cbf84cc68aca68640a32f539d9e30d73f386bc701d988bf764ad", + "loads": [ + 2, + 2, + 31, + 12, + 29, + 32, + 6, + 9, + 33, + 0, + 36, + 7, + 25, + 5, + 7, + 8, + 19, + 11, + 14, + 3, + 23, + 4, + 10, + 6, + 11, + 13, + 18, + 1, + 15, + 2, + 11, + 8, + 5, + 3, + 0, + 1, + 12, + 10, + 16, + 10, + 4, + 9, + 8, + 0, + 2, + 0, + 11, + 11, + 7, + 12, + 5, + 3, + 6, + 9, + 1, + 2, + 15, + 9, + 10, + 19, + 4, + 4, + 8, + 7 + ], + "weighted_loads": [ + 0.113039281219244, + 0.0820750780403614, + 3.0476361587643623, + 1.7589082978665829, + 2.6917242780327797, + 2.5776505190879107, + 0.3781611490994692, + 0.3788870144635439, + 1.4425683729350567, + 0.0, + 2.764920823276043, + 0.3526308685541153, + 1.4059075862169266, + 0.2601745277643204, + 0.2846276182681322, + 0.31163957342505455, + 1.1152914427220821, + 0.6463668141514063, + 0.8177691027522087, + 0.1468256674706936, + 0.9937289170920849, + 0.26285644993185997, + 0.46446315199136734, + 0.3910027705132961, + 0.657307056710124, + 0.5703596919775009, + 0.900707084685564, + 0.03314991295337677, + 1.023290030658245, + 0.06638075038790703, + 0.5190769545733929, + 0.633750619366765, + 0.20153630338609219, + 0.09049807488918304, + 0.0, + 0.03519684448838234, + 0.7271742932498455, + 0.44902968779206276, + 1.316827978938818, + 0.5108149722218513, + 0.2197856865823269, + 0.47395623475313187, + 0.8930937498807907, + 0.0, + 0.05643351376056671, + 0.0, + 0.7995176706463099, + 0.6358270812779665, + 0.518347816541791, + 2.3288324885070324, + 0.18852422758936882, + 0.1707204394042492, + 0.2770141288638115, + 0.30448813177645206, + 0.03201219066977501, + 0.040068263188004494, + 0.9484815262258053, + 0.5094257108867168, + 0.4839913882315159, + 1.434000439941883, + 0.32674305886030197, + 0.1527130827307701, + 0.40838607028126717, + 0.25343253649771214 + ], + "unique_experts": 60, + "load_cv": 0.8597509581150967, + "normalized_load_entropy": 0.9167100186182355, + "max_load_share": 0.05660377358490566 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "2867ee0e11d60f2d3bfddee0e937e21d44c493ebef7760230ecb004f7b69a097", + "route_weight_sha256": "da69a593b78910c023e4af8fcae5a9587a6535b64ed24456bd9fd7924c7bb5a1", + "loads": [ + 5, + 7, + 31, + 23, + 29, + 35, + 11, + 11, + 54, + 9, + 36, + 11, + 28, + 5, + 11, + 12, + 22, + 14, + 15, + 3, + 24, + 18, + 11, + 6, + 12, + 14, + 19, + 3, + 16, + 2, + 12, + 8, + 8, + 14, + 8, + 6, + 14, + 10, + 16, + 11, + 17, + 10, + 13, + 2, + 2, + 0, + 12, + 13, + 10, + 14, + 17, + 6, + 11, + 13, + 1, + 24, + 19, + 10, + 13, + 19, + 19, + 15, + 8, + 10 + ], + "weighted_loads": [ + 0.26709396857768297, + 0.5754736997187138, + 3.0476361587643623, + 3.0625602528452873, + 2.6917242780327797, + 2.7026675203815103, + 0.7377999629825354, + 0.4596695061773062, + 3.169965922832489, + 0.4647060912102461, + 2.764920823276043, + 0.6362971747294068, + 1.5464520566165447, + 0.2601745277643204, + 0.8672362081706524, + 0.5481368601322174, + 1.2605974823236465, + 0.7284906767308712, + 0.8577852174639702, + 0.1468256674706936, + 1.0421032048761845, + 1.433968462049961, + 0.5074196495115757, + 0.3910027705132961, + 0.6877234093844891, + 0.5959167536348104, + 0.9570656642317772, + 0.10332721471786499, + 1.1059026196599007, + 0.06638075038790703, + 0.5558158531785011, + 0.633750619366765, + 0.33467984199523926, + 0.5071134977042675, + 0.34505665861070156, + 0.23143915832042694, + 0.8173338063061237, + 0.44902968779206276, + 1.316827978938818, + 0.5726410374045372, + 1.0370287261903286, + 0.49939940497279167, + 1.3850797787308693, + 0.1360919177532196, + 0.05643351376056671, + 0.0, + 0.8340299893170595, + 0.7023238223046064, + 0.6739921439439058, + 2.7913250364363194, + 0.7893913425505161, + 0.382429338991642, + 0.8221932463347912, + 0.5135953556746244, + 0.03201219066977501, + 2.0225308258086443, + 1.1623754240572453, + 0.5344101116061211, + 0.6722331754863262, + 1.434000439941883, + 2.337050922214985, + 0.6107513718307018, + 0.40838607028126717, + 0.40069073252379894 + ], + "unique_experts": 63, + "load_cv": 0.6723614117479316, + "normalized_load_entropy": 0.9499881660684476, + "max_load_share": 0.061224489795918366 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 106, + "ordered_topk_exact_tokens": 69, + "set_exact_tokens": 80, + "mean_set_jaccard": 0.9299191374663074, + "mean_token_weighted_tv": 0.013670821779600854, + "aggregate_load_tv": 0.02515723270440251 + }, + "system_bos": { + "tokens": 106, + "ordered_topk_exact_tokens": 61, + "set_exact_tokens": 79, + "mean_set_jaccard": 0.9211590296495957, + "mean_token_weighted_tv": 0.017204164404351758, + "aggregate_load_tv": 0.0330188679245283 + }, + "system_x": { + "tokens": 106, + "ordered_topk_exact_tokens": 62, + "set_exact_tokens": 78, + "mean_set_jaccard": 0.9164420485175202, + "mean_token_weighted_tv": 0.01879090347485441, + "aggregate_load_tv": 0.036163522012578615 + }, + "system_period": { + "tokens": 106, + "ordered_topk_exact_tokens": 60, + "set_exact_tokens": 74, + "mean_set_jaccard": 0.9076819407008087, + "mean_token_weighted_tv": 0.01959009002015557, + "aggregate_load_tv": 0.04088050314465409 + }, + "bos_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 61, + "set_exact_tokens": 75, + "mean_set_jaccard": 0.914420485175202, + "mean_token_weighted_tv": 0.018834789485653054, + "aggregate_load_tv": 0.031446540880503145 + }, + "bos_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 58, + "set_exact_tokens": 76, + "mean_set_jaccard": 0.9191374663072777, + "mean_token_weighted_tv": 0.017274563350134862, + "aggregate_load_tv": 0.03144654088050314 + }, + "x_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 57, + "set_exact_tokens": 70, + "mean_set_jaccard": 0.9029649595687332, + "mean_token_weighted_tv": 0.019299134550581, + "aggregate_load_tv": 0.031446540880503145 + }, + "x_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 47, + "set_exact_tokens": 66, + "mean_set_jaccard": 0.8800539083557952, + "mean_token_weighted_tv": 0.02439275336504545, + "aggregate_load_tv": 0.04559748427672955 + }, + "period_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 58, + "set_exact_tokens": 72, + "mean_set_jaccard": 0.9063342318059299, + "mean_token_weighted_tv": 0.01926304682878391, + "aggregate_load_tv": 0.03930817610062892 + }, + "period_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 55, + "set_exact_tokens": 71, + "mean_set_jaccard": 0.9016172506738546, + "mean_token_weighted_tv": 0.021748219906651187, + "aggregate_load_tv": 0.042452830188679236 + } + } + }, + "layer_23": { + "layer": 23, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "4c64531f2f28d4e6653290ec4958d515f611a18d589880c1c5028661abbee915", + "route_weight_sha256": "9587dea6782370867852ff2f3c9bdc74d4e68baaefdaba711dd2b7d22fe97da8", + "loads": [ + 8, + 12, + 14, + 11, + 5, + 8, + 5, + 3, + 17, + 10, + 15, + 15, + 5, + 1, + 9, + 5, + 0, + 19, + 23, + 17, + 13, + 0, + 13, + 2, + 14, + 5, + 12, + 19, + 19, + 11, + 16, + 3, + 2, + 3, + 1, + 24, + 13, + 10, + 4, + 7, + 4, + 18, + 6, + 14, + 5, + 13, + 4, + 14, + 15, + 12, + 0, + 2, + 5, + 7, + 5, + 6, + 21, + 3, + 3, + 53, + 4, + 10, + 18, + 1 + ], + "weighted_loads": [ + 0.71674794703722, + 0.7351686842739582, + 0.631306029856205, + 1.7843546438962221, + 0.2232946641743183, + 0.389764990657568, + 0.3754541464149952, + 0.12715307250618935, + 1.5454888008534908, + 0.367043761536479, + 0.6126906126737595, + 0.6116535365581512, + 0.1858601812273264, + 0.04811883345246315, + 0.7646212913095951, + 0.2530227266252041, + 0.0, + 1.4067138209939003, + 1.6733650639653206, + 1.1622279360890388, + 0.6943771410733461, + 0.0, + 0.8950882777571678, + 0.3156181126832962, + 0.5390945579856634, + 0.14982532151043415, + 0.5393869690597057, + 1.090976770967245, + 1.2185690850019455, + 0.5987336933612823, + 0.6645701434463263, + 0.15824664756655693, + 0.10734151303768158, + 0.14224649220705032, + 0.025993607938289642, + 1.9914546608924866, + 0.6161829717457294, + 0.4288580846041441, + 0.30445606634020805, + 0.31663331016898155, + 0.17644217982888222, + 1.0451721902936697, + 0.2078592237085104, + 0.6761027928441763, + 0.343741986900568, + 1.6753015629947186, + 0.18253793753683567, + 1.3734398856759071, + 1.233393307775259, + 0.4989876262843609, + 0.0, + 0.17202571034431458, + 0.19586342945694923, + 0.29504843428730965, + 0.3347322940826416, + 0.23345795646309853, + 1.540220383554697, + 0.1338294856250286, + 0.09695356152951717, + 3.661474235355854, + 0.20331332460045815, + 0.7393513545393944, + 1.309024242684245, + 0.04077081382274628 + ], + "unique_experts": 61, + "load_cv": 0.8354843485981661, + "normalized_load_entropy": 0.9250783459546663, + "max_load_share": 0.08333333333333333 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "4e0fc4e643837e7f1fa577d3d06f14fe7fb3fd448834add9aba3a17e85d04b18", + "route_weight_sha256": "24c9bfbcd9605d511b57288293ef34953969949a8ec9cd6e67a82ebaadfb7714", + "loads": [ + 13, + 15, + 14, + 22, + 11, + 11, + 11, + 8, + 18, + 18, + 15, + 15, + 6, + 6, + 11, + 5, + 4, + 19, + 23, + 17, + 13, + 0, + 14, + 12, + 18, + 5, + 12, + 19, + 19, + 11, + 16, + 3, + 4, + 8, + 1, + 24, + 14, + 10, + 8, + 9, + 10, + 18, + 7, + 14, + 5, + 20, + 16, + 18, + 16, + 12, + 0, + 3, + 5, + 8, + 16, + 7, + 21, + 13, + 5, + 53, + 4, + 10, + 22, + 1 + ], + "weighted_loads": [ + 0.9101105113513768, + 0.9054897576570511, + 0.631306029856205, + 2.116902138805017, + 0.4800583552569151, + 0.5158855561167002, + 0.7889639623463154, + 0.32524538040161133, + 1.5462335947086103, + 0.6628683153539896, + 0.6126906126737595, + 0.6116535365581512, + 0.19612314365804195, + 0.2845131531357765, + 0.8765960372984409, + 0.2530227266252041, + 0.07809572434052825, + 1.4067138209939003, + 1.6733650639653206, + 1.1622279360890388, + 0.6943771410733461, + 0.0, + 0.913728779181838, + 1.6143734827637672, + 0.6799750681966543, + 0.14982532151043415, + 0.5393869690597057, + 1.090976770967245, + 1.2185690850019455, + 0.5987336933612823, + 0.6645701434463263, + 0.15824664756655693, + 0.1974920518696308, + 0.4680085558211431, + 0.025993607938289642, + 1.9914546608924866, + 0.6633141227066517, + 0.4288580846041441, + 0.5209267484024167, + 0.36825413070619106, + 0.4539596661925316, + 1.0451721902936697, + 0.23270352184772491, + 0.6761027928441763, + 0.343741986900568, + 3.8022889588028193, + 1.1911413352936506, + 1.5284983834717423, + 1.2729128897190094, + 0.4989876262843609, + 0.0, + 0.2622397467494011, + 0.19586342945694923, + 0.36622702702879906, + 1.3013746552169323, + 0.26777319610118866, + 1.540220383554697, + 1.1697134021669626, + 0.20856651477515697, + 3.661474235355854, + 0.20331332460045815, + 0.7393513545393944, + 1.4862782657146454, + 0.04077081382274628 + ], + "unique_experts": 62, + "load_cv": 0.65083766324791, + "normalized_load_entropy": 0.951198438365905, + "max_load_share": 0.06743002544529263 + } + }, + "s1_eos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "4135d63f89723fd7a3d6c389b1429bcb24077a81ff8bdcc3811c1dc68af92d39", + "route_weight_sha256": "38c22617484d071f9d90d4b5e2817b90ea29c96ae3bc3f1b1029fd2783f7a176", + "loads": [ + 8, + 12, + 13, + 11, + 5, + 8, + 5, + 3, + 17, + 11, + 17, + 18, + 5, + 1, + 10, + 5, + 0, + 19, + 23, + 17, + 13, + 0, + 13, + 2, + 15, + 5, + 10, + 18, + 19, + 11, + 16, + 3, + 2, + 3, + 1, + 26, + 11, + 11, + 4, + 7, + 4, + 18, + 6, + 13, + 6, + 13, + 4, + 14, + 15, + 7, + 0, + 3, + 4, + 5, + 5, + 7, + 21, + 3, + 3, + 53, + 4, + 10, + 19, + 1 + ], + "weighted_loads": [ + 0.7062787376344204, + 0.7350549139082432, + 0.6001788135617971, + 1.8011149056255817, + 0.2130342312157154, + 0.3883955553174019, + 0.3740648403763771, + 0.1301642544567585, + 1.5691288076341152, + 0.40969013795256615, + 0.6818834207952023, + 0.697762206196785, + 0.19484942965209484, + 0.04923831298947334, + 0.796421704813838, + 0.2556112203747034, + 0.0, + 1.3986891508102417, + 1.6941409222781658, + 1.1378108095377684, + 0.713056294247508, + 0.0, + 0.8939924761652946, + 0.31899236887693405, + 0.5725388322025537, + 0.14773476496338844, + 0.5019414257258177, + 1.0654722787439823, + 1.227486152201891, + 0.5972614996135235, + 0.6761515885591507, + 0.15302304551005363, + 0.10943625867366791, + 0.13226522877812386, + 0.028768455609679222, + 2.1154192071408033, + 0.5533741991966963, + 0.46003120951354504, + 0.31147727742791176, + 0.31552383676171303, + 0.1702849641442299, + 1.051845921203494, + 0.20988530479371548, + 0.6439757272601128, + 0.37853556498885155, + 1.6520343832671642, + 0.18817340023815632, + 1.3669087700545788, + 1.2474900670349598, + 0.33906647749245167, + 0.0, + 0.20716499164700508, + 0.16081690602004528, + 0.21559598110616207, + 0.33262335881590843, + 0.26058737374842167, + 1.5433553289622068, + 0.13353245332837105, + 0.09480175003409386, + 3.670407924801111, + 0.196982117369771, + 0.7472932934761047, + 1.3482441194355488, + 0.04118044674396515 + ], + "unique_experts": 61, + "load_cv": 0.8456488800919536, + "normalized_load_entropy": 0.9238464666245466, + "max_load_share": 0.08333333333333333 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "3aa3502f31e6e6cf6accfaf2734095e4680f9f778ae00ba2adc11d61f1116753", + "route_weight_sha256": "f9a5fc3bb2bd80d3637f05ef320c2b528372ce4e6cdaaeeec946822a74961cbb", + "loads": [ + 14, + 17, + 19, + 22, + 10, + 11, + 17, + 10, + 19, + 16, + 19, + 19, + 6, + 6, + 12, + 8, + 5, + 20, + 25, + 17, + 14, + 0, + 14, + 16, + 18, + 5, + 10, + 18, + 19, + 12, + 16, + 3, + 4, + 15, + 1, + 26, + 17, + 12, + 11, + 8, + 13, + 18, + 8, + 13, + 8, + 23, + 21, + 19, + 21, + 10, + 0, + 13, + 10, + 7, + 16, + 7, + 21, + 19, + 5, + 53, + 6, + 11, + 26, + 3 + ], + "weighted_loads": [ + 1.0266726408153772, + 1.0552499368786812, + 0.9194103088229895, + 2.373655165778473, + 0.4314956273883581, + 0.510954724624753, + 1.1018721964210272, + 0.3704315721988678, + 1.6034433722961694, + 0.6177731081843376, + 0.7768650762736797, + 0.7290224097669125, + 0.20505269058048725, + 0.28991299867630005, + 0.9311051163822412, + 0.3784048967063427, + 0.11940955417230725, + 1.4569720551371574, + 1.7846109680831432, + 1.1378108095377684, + 0.759777246043086, + 0.0, + 0.9124239943921566, + 2.1583871319890022, + 0.6982460636645555, + 0.14773476496338844, + 0.5019414257258177, + 1.0654722787439823, + 1.227486152201891, + 0.6430013999342918, + 0.6761515885591507, + 0.15302304551005363, + 0.19515342265367508, + 0.8425659111235291, + 0.028768455609679222, + 2.1154192071408033, + 0.9851379040628672, + 0.5078096855431795, + 0.7638180777430534, + 0.34051366709172726, + 0.5228628944605589, + 1.051845921203494, + 0.2630455922335386, + 0.6439757272601128, + 0.48049865290522575, + 3.889714812859893, + 1.842862168326974, + 1.6750016475562006, + 1.5112325735390186, + 0.49123273976147175, + 0.0, + 0.8247006367892027, + 0.8021872248500586, + 0.3177293110638857, + 1.3334641642868519, + 0.26058737374842167, + 1.5433553289622068, + 1.749859170988202, + 0.23007326945662498, + 3.670407924801111, + 0.2714946363121271, + 0.8726947158575058, + 1.6353966556489468, + 0.11980248242616653 + ], + "unique_experts": 62, + "load_cv": 0.5901227123988164, + "normalized_load_entropy": 0.958093426624395, + "max_load_share": 0.060090702947845805 + } + }, + "s0_bos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "99fdd99a0ba4ca0ac8113e22ed2c0ba761cb09d3f265c159e2c996f250f4e258", + "route_weight_sha256": "7a7758c1fb367c5d053c614243dbbc4d38e834ab04e8902ae32806ade7c885e5", + "loads": [ + 8, + 12, + 12, + 11, + 6, + 10, + 5, + 3, + 17, + 11, + 15, + 14, + 5, + 1, + 10, + 4, + 0, + 20, + 23, + 18, + 13, + 0, + 13, + 2, + 16, + 2, + 15, + 19, + 18, + 12, + 14, + 3, + 2, + 3, + 1, + 24, + 14, + 10, + 4, + 7, + 4, + 17, + 6, + 13, + 5, + 12, + 3, + 14, + 15, + 10, + 0, + 3, + 5, + 6, + 5, + 6, + 22, + 3, + 3, + 53, + 4, + 10, + 19, + 1 + ], + "weighted_loads": [ + 0.7234743386507034, + 0.7387913838028908, + 0.5523531548678875, + 1.8171947188675404, + 0.24577108770608902, + 0.4351719804108143, + 0.38625214248895645, + 0.12737955898046494, + 1.5594026036560535, + 0.3967125080525875, + 0.6018304247409105, + 0.5580107849091291, + 0.20091864094138145, + 0.048113808035850525, + 0.8046025279909372, + 0.22426755726337433, + 0.0, + 1.4619724117219448, + 1.685823231935501, + 1.1972447261214256, + 0.6959020085632801, + 0.0, + 0.9026441108435392, + 0.2957015410065651, + 0.585308900102973, + 0.06876882910728455, + 0.6592601239681244, + 1.1126220747828484, + 1.1984369903802872, + 0.6476170420646667, + 0.622007992118597, + 0.15784206986427307, + 0.09799731895327568, + 0.13718963041901588, + 0.024706175550818443, + 2.0049043856561184, + 0.6696726344525814, + 0.4285511430352926, + 0.31028956919908524, + 0.3161185346543789, + 0.1786416582763195, + 1.022638438269496, + 0.2081078626215458, + 0.6437077429145575, + 0.34549130499362946, + 1.5925614908337593, + 0.14753305725753307, + 1.3502443935722113, + 1.2404295913875103, + 0.46419995464384556, + 0.0, + 0.20811576396226883, + 0.2068399991840124, + 0.2559831477701664, + 0.3210736885666847, + 0.2343116533011198, + 1.6155304573476315, + 0.13288213685154915, + 0.0944428239017725, + 3.773030821233988, + 0.19576003961265087, + 0.7458143569529057, + 1.347331015393138, + 0.04200431704521179 + ], + "unique_experts": 61, + "load_cv": 0.8428376953605595, + "normalized_load_entropy": 0.9233831786153479, + "max_load_share": 0.08333333333333333 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "f2d43644afe203b75167955de9832ab0a31885a2cad58c17ba76e3e15186b797", + "route_weight_sha256": "2eecaa314bb936542948f5262f93e145b3864d5f145a2d19150aca8a9bfa5cd3", + "loads": [ + 11, + 15, + 12, + 21, + 11, + 13, + 11, + 8, + 17, + 19, + 15, + 14, + 7, + 6, + 11, + 4, + 3, + 20, + 23, + 19, + 13, + 0, + 14, + 13, + 20, + 2, + 16, + 19, + 18, + 12, + 14, + 3, + 3, + 6, + 1, + 24, + 14, + 11, + 7, + 9, + 12, + 17, + 8, + 14, + 5, + 18, + 15, + 17, + 16, + 10, + 1, + 4, + 5, + 8, + 15, + 8, + 22, + 14, + 6, + 54, + 4, + 10, + 23, + 1 + ], + "weighted_loads": [ + 0.845941704697907, + 0.9091124571859837, + 0.5523531548678875, + 2.1393862678669393, + 0.4853140953928232, + 0.5589334387332201, + 0.7902328483760357, + 0.32929258421063423, + 1.5594026036560535, + 0.6880910806357861, + 0.6018304247409105, + 0.5580107849091291, + 0.24346929043531418, + 0.2970098406076431, + 0.8777918685227633, + 0.22426755726337433, + 0.05152639327570796, + 1.4619724117219448, + 1.685823231935501, + 1.3677411302924156, + 0.6959020085632801, + 0.0, + 0.9212846122682095, + 1.699538204818964, + 0.7347237076610327, + 0.06876882910728455, + 0.781316265463829, + 1.1126220747828484, + 1.1984369903802872, + 0.6476170420646667, + 0.622007992118597, + 0.15784206986427307, + 0.15280437096953392, + 0.4195171929895878, + 0.024706175550818443, + 2.0049043856561184, + 0.6696726344525814, + 0.4677151832729578, + 0.4872983815148473, + 0.3672149386256933, + 0.5397821012884378, + 1.022638438269496, + 0.2679277639836073, + 0.6920962017029524, + 0.34549130499362946, + 2.7483622189611197, + 1.1522393617779016, + 1.4994853399693966, + 1.2799491733312607, + 0.46419995464384556, + 0.0507768839597702, + 0.29832980036735535, + 0.2068399991840124, + 0.3741013668477535, + 1.2440829426050186, + 0.3153203967958689, + 1.6155304573476315, + 1.2000325489789248, + 0.26022967137396336, + 4.033422950655222, + 0.19576003961265087, + 0.7458143569529057, + 1.5275228321552277, + 0.04200431704521179 + ], + "unique_experts": 63, + "load_cv": 0.6617292838462545, + "normalized_load_entropy": 0.9501847242622814, + "max_load_share": 0.06870229007633588 + } + }, + "s1_bos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "a6d62bab1bbae54b4a803b535197cf8cb31659fe0eda08ba7896c37b42f0a6ad", + "route_weight_sha256": "5b27d4a747b609b31384038bd0db02143d2cac4cc3ae1a6a358affb1cd649406", + "loads": [ + 8, + 12, + 12, + 11, + 6, + 11, + 5, + 2, + 17, + 11, + 13, + 16, + 6, + 1, + 11, + 4, + 0, + 19, + 23, + 17, + 13, + 0, + 13, + 2, + 13, + 4, + 13, + 19, + 20, + 12, + 15, + 3, + 2, + 3, + 1, + 25, + 14, + 10, + 4, + 7, + 4, + 18, + 6, + 13, + 5, + 12, + 4, + 13, + 15, + 10, + 0, + 2, + 5, + 4, + 5, + 7, + 22, + 3, + 3, + 53, + 4, + 10, + 19, + 1 + ], + "weighted_loads": [ + 0.743970425799489, + 0.7271864898502827, + 0.565493006259203, + 1.7756856381893158, + 0.24755665846168995, + 0.4664646051824093, + 0.38783004507422447, + 0.08156921714544296, + 1.5979628264904022, + 0.39906211383640766, + 0.5245247446000576, + 0.6588674653321505, + 0.23256009072065353, + 0.04928518459200859, + 0.8263162281364202, + 0.21771832555532455, + 0.0, + 1.4281875900924206, + 1.6822362206876278, + 1.1578076016157866, + 0.722516493871808, + 0.0, + 0.8931292779743671, + 0.28862109780311584, + 0.4990825317800045, + 0.12237668968737125, + 0.58473608084023, + 1.0914247035980225, + 1.2520355433225632, + 0.6565912179648876, + 0.6518382988870144, + 0.15708927810192108, + 0.09632063284516335, + 0.13158686831593513, + 0.02654997818171978, + 2.020697869360447, + 0.6782644428312778, + 0.4336507599800825, + 0.31067152693867683, + 0.30897464603185654, + 0.17515594139695168, + 1.0587068777531385, + 0.20879204012453556, + 0.6401331033557653, + 0.34051167592406273, + 1.5276931412518024, + 0.18875743448734283, + 1.30235855281353, + 1.2436830699443817, + 0.4620435144752264, + 0.0, + 0.17441581934690475, + 0.20099709928035736, + 0.16867215186357498, + 0.33137109503149986, + 0.2659622635692358, + 1.5837842039763927, + 0.13414406403899193, + 0.09928811155259609, + 3.72248413041234, + 0.18838097341358662, + 0.7324998304247856, + 1.335182273760438, + 0.04382789507508278 + ], + "unique_experts": 61, + "load_cv": 0.8432130614963472, + "normalized_load_entropy": 0.9234994738667266, + "max_load_share": 0.08333333333333333 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "a05be228df2176bb0061567834beb1212b65ed9b7572b7584147f1f8d70ad245", + "route_weight_sha256": "185840f451c306dd156aac9a1a3df8600c41b127adfbaf84ae7ecaa4e1fdeb32", + "loads": [ + 13, + 17, + 19, + 20, + 13, + 14, + 17, + 11, + 18, + 16, + 15, + 17, + 7, + 6, + 12, + 7, + 5, + 20, + 25, + 17, + 14, + 0, + 15, + 17, + 15, + 4, + 13, + 19, + 20, + 13, + 16, + 3, + 3, + 13, + 1, + 25, + 20, + 12, + 10, + 7, + 13, + 18, + 9, + 13, + 7, + 20, + 21, + 17, + 21, + 13, + 0, + 12, + 11, + 8, + 15, + 8, + 22, + 20, + 6, + 53, + 6, + 11, + 26, + 3 + ], + "weighted_loads": [ + 1.063576183281839, + 1.0473815128207207, + 0.928410142660141, + 2.3169277939014137, + 0.5687696039676666, + 0.5789975058287382, + 1.118293983861804, + 0.389651395380497, + 1.6315555982291698, + 0.6058172304183245, + 0.6195064000785351, + 0.690127668902278, + 0.24276335164904594, + 0.30082835257053375, + 0.924543647095561, + 0.34051200188696384, + 0.11940955417230725, + 1.4864704944193363, + 1.7727062664926052, + 1.1578076016157866, + 0.769237445667386, + 0.0, + 0.9592603258788586, + 2.243567768484354, + 0.5787315145134926, + 0.12237668968737125, + 0.58473608084023, + 1.0914247035980225, + 1.2520355433225632, + 0.702331118285656, + 0.7055377885699272, + 0.15708927810192108, + 0.14045046642422676, + 0.7862098012119532, + 0.02654997818171978, + 2.020697869360447, + 1.1100281476974487, + 0.5336332079023123, + 0.6978549137711525, + 0.30897464603185654, + 0.5601686704903841, + 1.0587068777531385, + 0.2977731581777334, + 0.6401331033557653, + 0.44247476384043694, + 2.7588713224977255, + 1.8386301659047604, + 1.6054592858999968, + 1.5074255764484406, + 0.6142097767442465, + 0.0, + 0.7919514644891024, + 0.8423674181103706, + 0.3846816383302212, + 1.289900902658701, + 0.3149917181581259, + 1.5837842039763927, + 1.7711092922836542, + 0.28090463019907475, + 3.72248413041234, + 0.2628934923559427, + 0.8579012528061867, + 1.6351324301213026, + 0.14365337789058685 + ], + "unique_experts": 62, + "load_cv": 0.5795724963859638, + "normalized_load_entropy": 0.9592866182824618, + "max_load_share": 0.060090702947845805 + } + }, + "s0_x": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "fe92d6ac057189c09833f6c3f1ccd2729bb78ab2fc1c39ca0e1b1e4e077b9485", + "route_weight_sha256": "89ab75f9dc86062efd58c2426de099c13748d228ccd77cb6324e43ba2dd50d5f", + "loads": [ + 8, + 12, + 12, + 11, + 6, + 10, + 5, + 2, + 16, + 10, + 14, + 15, + 5, + 1, + 9, + 5, + 0, + 20, + 23, + 17, + 12, + 0, + 13, + 2, + 16, + 3, + 13, + 19, + 20, + 12, + 13, + 3, + 2, + 3, + 1, + 25, + 14, + 11, + 5, + 8, + 4, + 18, + 6, + 13, + 6, + 12, + 4, + 13, + 15, + 11, + 0, + 2, + 5, + 6, + 5, + 7, + 22, + 3, + 3, + 52, + 4, + 10, + 18, + 1 + ], + "weighted_loads": [ + 0.7235150076448917, + 0.7331021577119827, + 0.55796954408288, + 1.8026462607085705, + 0.24438275955617428, + 0.43938381411135197, + 0.3897022567689419, + 0.08402598649263382, + 1.5070684216916561, + 0.3692738302052021, + 0.5721315462142229, + 0.6087684780359268, + 0.19614898227155209, + 0.04809153825044632, + 0.7643574103713036, + 0.2468822505325079, + 0.0, + 1.447206461802125, + 1.6734850890934467, + 1.148479277268052, + 0.6792411506175995, + 0.0, + 0.8963699676096439, + 0.2834194600582123, + 0.5802354030311108, + 0.10080510005354881, + 0.5843399688601494, + 1.1012090668082237, + 1.261594370007515, + 0.6420401483774185, + 0.5790081229060888, + 0.15334231406450272, + 0.10088953748345375, + 0.1411805972456932, + 0.026537733152508736, + 2.052155017852783, + 0.6665756683796644, + 0.44858670234680176, + 0.340029314160347, + 0.34858377277851105, + 0.16845868155360222, + 1.051530996337533, + 0.20844311080873013, + 0.6364576779305935, + 0.3632055427879095, + 1.6116024479269981, + 0.18280458636581898, + 1.3119919802993536, + 1.2394872270524502, + 0.47687296010553837, + 0.0, + 0.1701441928744316, + 0.20002595148980618, + 0.25588740035891533, + 0.33483101800084114, + 0.2697643041610718, + 1.589972160756588, + 0.13298748806118965, + 0.09296726807951927, + 3.673714891076088, + 0.19544008933007717, + 0.7515774928033352, + 1.2913838252425194, + 0.0431726835668087 + ], + "unique_experts": 61, + "load_cv": 0.8311172622699231, + "normalized_load_entropy": 0.9251107679396281, + "max_load_share": 0.08176100628930817 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "c00b2aa6f4539011b848829d11b27ff59d658868bc58c98928eedefb3e667310", + "route_weight_sha256": "98bc142ebbc6b3c36b1d3dde93b39e6c722ce5d68d5bafc5819302d7cf6af744", + "loads": [ + 12, + 15, + 12, + 22, + 10, + 13, + 12, + 6, + 16, + 18, + 14, + 15, + 6, + 6, + 11, + 5, + 4, + 20, + 23, + 17, + 12, + 0, + 14, + 13, + 19, + 3, + 14, + 19, + 20, + 12, + 13, + 3, + 3, + 7, + 1, + 25, + 15, + 11, + 10, + 9, + 10, + 18, + 7, + 13, + 6, + 20, + 18, + 16, + 16, + 11, + 0, + 3, + 5, + 7, + 17, + 8, + 22, + 13, + 5, + 52, + 4, + 10, + 24, + 1 + ], + "weighted_loads": [ + 0.9139970848336816, + 0.9034232310950756, + 0.55796954408288, + 2.249429905321449, + 0.42081356421113014, + 0.5445477403700352, + 0.8542473874986172, + 0.2328430376946926, + 1.5070684216916561, + 0.6488007735460997, + 0.5721315462142229, + 0.6087684780359268, + 0.20641194470226765, + 0.28671708330512047, + 0.8821992874145508, + 0.2468822505325079, + 0.08095138100907207, + 1.447206461802125, + 1.6734850890934467, + 1.148479277268052, + 0.6792411506175995, + 0.0, + 0.9150104690343142, + 1.6457339338958263, + 0.6820557005703449, + 0.10080510005354881, + 0.6215826719999313, + 1.1012090668082237, + 1.261594370007515, + 0.6420401483774185, + 0.5790081229060888, + 0.15334231406450272, + 0.155696589499712, + 0.4769960641860962, + 0.026537733152508736, + 2.052155017852783, + 0.705319045111537, + 0.44858670234680176, + 0.6023288303986192, + 0.3752841055393219, + 0.404464291408658, + 1.051530996337533, + 0.23328740894794464, + 0.6364576779305935, + 0.3632055427879095, + 2.8500564228743315, + 1.3481908421963453, + 1.4574144594371319, + 1.2790068089962006, + 0.47687296010553837, + 0.0, + 0.2603582292795181, + 0.20002595148980618, + 0.3064719997346401, + 1.4543277509510517, + 0.3040795437991619, + 1.589972160756588, + 1.1877379436045885, + 0.19247042387723923, + 3.673714891076088, + 0.19544008933007717, + 0.7515774928033352, + 1.5305708814412355, + 0.0431726835668087 + ], + "unique_experts": 62, + "load_cv": 0.6565427912183546, + "normalized_load_entropy": 0.9496594716474077, + "max_load_share": 0.06615776081424936 + } + }, + "s1_x": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "ece6f1703210b3abe4b2a9a17585b0bc88ab0ff7e04aaf162acd9e45ae06c2dc", + "route_weight_sha256": "f90d94811934a54b69319ca4b79df7e733ce656f05cfe950dcfd0848d7d3eaf5", + "loads": [ + 8, + 12, + 13, + 11, + 6, + 11, + 5, + 2, + 17, + 9, + 16, + 14, + 5, + 1, + 9, + 4, + 0, + 19, + 23, + 17, + 13, + 1, + 13, + 2, + 17, + 3, + 12, + 18, + 19, + 12, + 13, + 4, + 2, + 3, + 1, + 26, + 13, + 12, + 5, + 7, + 4, + 17, + 7, + 13, + 5, + 12, + 5, + 14, + 15, + 9, + 0, + 2, + 5, + 4, + 5, + 8, + 21, + 3, + 3, + 53, + 4, + 10, + 18, + 1 + ], + "weighted_loads": [ + 0.7554773855954409, + 0.7197004109621048, + 0.5994026474654675, + 1.775697287172079, + 0.2437239047139883, + 0.4561232030391693, + 0.3809066377580166, + 0.08257363736629486, + 1.534063681960106, + 0.35106339678168297, + 0.6438948102295399, + 0.5808048080652952, + 0.19807714223861694, + 0.047933291643857956, + 0.7444120887666941, + 0.22140266001224518, + 0.0, + 1.4119715802371502, + 1.6874493770301342, + 1.158319691196084, + 0.7181574124842882, + 0.02636145055294037, + 0.8752210587263107, + 0.2910385727882385, + 0.6090146340429783, + 0.09825115092098713, + 0.5271562207490206, + 1.0267431326210499, + 1.1964580900967121, + 0.6448833085596561, + 0.5835558101534843, + 0.17466696351766586, + 0.09220469743013382, + 0.13414952903985977, + 0.02531713992357254, + 2.073468057438731, + 0.6212684754282236, + 0.4891509898006916, + 0.34350188449025154, + 0.30836324393749237, + 0.16142626851797104, + 1.0139342211186886, + 0.23095007240772247, + 0.6277460530400276, + 0.3368532136082649, + 1.5618959702551365, + 0.22722738981246948, + 1.3698386065661907, + 1.2403814867138863, + 0.38489755243062973, + 0.0, + 0.1612428054213524, + 0.19110685400664806, + 0.1733844205737114, + 0.34966758638620377, + 0.2926174886524677, + 1.5364917032420635, + 0.1255449876189232, + 0.11003351584076881, + 3.64259135350585, + 0.1934752482920885, + 0.7371616177260876, + 1.3177570682018995, + 0.04507138580083847 + ], + "unique_experts": 62, + "load_cv": 0.8368089381711957, + "normalized_load_entropy": 0.925702269263933, + "max_load_share": 0.08333333333333333 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "f56713c6b38292912fdb3855caa194a3112c10bbf4dece717201ab727c1cb2ed", + "route_weight_sha256": "472c832a8c967a4328af2a68f8a7e75f29b4140262dfc455f6a87a8cc038d285", + "loads": [ + 13, + 17, + 19, + 21, + 10, + 14, + 18, + 9, + 18, + 13, + 18, + 15, + 6, + 7, + 10, + 7, + 7, + 20, + 25, + 17, + 14, + 1, + 14, + 18, + 20, + 3, + 12, + 18, + 19, + 13, + 13, + 4, + 3, + 13, + 1, + 26, + 19, + 13, + 12, + 7, + 12, + 17, + 9, + 13, + 7, + 22, + 24, + 18, + 22, + 12, + 0, + 13, + 11, + 6, + 19, + 8, + 21, + 19, + 4, + 53, + 6, + 11, + 26, + 2 + ], + "weighted_loads": [ + 1.0678061312064528, + 1.0398954339325428, + 0.9186341427266598, + 2.3762691388837993, + 0.4036943018436432, + 0.5464481133967638, + 1.1632628310471773, + 0.30130880512297153, + 1.5676564536988735, + 0.510339830070734, + 0.7388764657080173, + 0.6120650116354227, + 0.20828040316700935, + 0.32165900245308876, + 0.8426395077258348, + 0.34419633634388447, + 0.18333327630534768, + 1.470254484564066, + 1.7779194228351116, + 1.158319691196084, + 0.7648783642798662, + 0.02636145055294037, + 0.8936525769531727, + 2.26732325181365, + 0.7418827824294567, + 0.09825115092098713, + 0.5271562207490206, + 1.0267431326210499, + 1.1964580900967121, + 0.6906232088804245, + 0.5835558101534843, + 0.17466696351766586, + 0.13633453100919724, + 0.8010580074042082, + 0.02531713992357254, + 2.073468057438731, + 1.0530321802943945, + 0.5369294658303261, + 0.7996935993432999, + 0.30836324393749237, + 0.44921197183430195, + 1.0139342211186886, + 0.2841103598475456, + 0.6277460530400276, + 0.43881630152463913, + 2.8624472729861736, + 2.1251401342451572, + 1.6685384381562471, + 1.5674869120121002, + 0.5370638146996498, + 0.0, + 0.8775469306856394, + 0.8324771728366613, + 0.2562108784914017, + 1.609444908797741, + 0.2926174886524677, + 1.5364917032420635, + 1.7407577615231276, + 0.19053633883595467, + 3.64259135350585, + 0.2679877672344446, + 0.8625630401074886, + 1.621477959677577, + 0.08734288066625595 + ], + "unique_experts": 63, + "load_cv": 0.5941519082210619, + "normalized_load_entropy": 0.9577923824208353, + "max_load_share": 0.060090702947845805 + } + }, + "s0_period": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "ad5b35962af562e1da57db1f31b8e663ad1511abcc3a9228b6098503df07b559", + "route_weight_sha256": "57f947ea06580bda968df9c43ab2a5245f73ea722047aea642ae73223ce5044b", + "loads": [ + 8, + 12, + 11, + 11, + 7, + 9, + 5, + 3, + 17, + 9, + 14, + 13, + 5, + 1, + 9, + 5, + 0, + 20, + 23, + 17, + 12, + 0, + 13, + 2, + 15, + 4, + 14, + 19, + 19, + 12, + 14, + 3, + 2, + 3, + 1, + 24, + 15, + 10, + 4, + 8, + 4, + 17, + 6, + 13, + 6, + 13, + 4, + 13, + 15, + 11, + 0, + 2, + 5, + 7, + 5, + 7, + 22, + 3, + 3, + 53, + 4, + 10, + 19, + 1 + ], + "weighted_loads": [ + 0.741071991622448, + 0.7365731857717037, + 0.5106206461787224, + 1.8058361522853374, + 0.28122081607580185, + 0.41340938955545425, + 0.38524842262268066, + 0.12967560440301895, + 1.5768442526459694, + 0.3416575863957405, + 0.5689149871468544, + 0.530979260802269, + 0.19911896251142025, + 0.0474499836564064, + 0.7471291813999414, + 0.2447890341281891, + 0.0, + 1.4320903737097979, + 1.672945462167263, + 1.1688884664326906, + 0.675442123785615, + 0.0, + 0.8965210914611816, + 0.2876005545258522, + 0.5363760814070702, + 0.13048819825053215, + 0.6123287566006184, + 1.097967203706503, + 1.2273662686347961, + 0.6402297429740429, + 0.6169741377234459, + 0.15767529234290123, + 0.09999781101942062, + 0.14035482704639435, + 0.026803577318787575, + 2.0230192877352238, + 0.6898215319961309, + 0.42058134637773037, + 0.3012348599731922, + 0.3437913805246353, + 0.16667935997247696, + 1.0167556069791317, + 0.21088329702615738, + 0.6322593614459038, + 0.36818898655474186, + 1.646263014525175, + 0.18307079002261162, + 1.3088633455336094, + 1.2365826331079006, + 0.4974135756492615, + 0.0, + 0.1787986233830452, + 0.20443757623434067, + 0.293565109372139, + 0.32418593019247055, + 0.27003570832312107, + 1.5824156608432531, + 0.13644082471728325, + 0.0912606231868267, + 3.7440262101590633, + 0.19757534191012383, + 0.7522594146430492, + 1.3505985271185637, + 0.04248605668544769 + ], + "unique_experts": 61, + "load_cv": 0.8330188085690319, + "normalized_load_entropy": 0.9258133073752728, + "max_load_share": 0.08333333333333333 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "1cf667e271dd3a673f1f8913e3d3770e5dafd922e71582b9086f119fea0e7da1", + "route_weight_sha256": "a5840ebb1bad4f643caa88d4c7f3966b2271b7009140ff9e927466fa8c3ec1a0", + "loads": [ + 12, + 15, + 12, + 20, + 13, + 12, + 13, + 7, + 17, + 17, + 14, + 13, + 6, + 6, + 10, + 5, + 3, + 20, + 23, + 17, + 12, + 0, + 14, + 13, + 18, + 4, + 15, + 19, + 19, + 12, + 14, + 3, + 3, + 7, + 1, + 24, + 15, + 10, + 9, + 9, + 12, + 17, + 7, + 13, + 6, + 20, + 16, + 16, + 16, + 11, + 0, + 3, + 5, + 9, + 17, + 8, + 22, + 14, + 5, + 53, + 4, + 10, + 25, + 1 + ], + "weighted_loads": [ + 0.9399835439398885, + 0.9068942591547966, + 0.5556684695184231, + 2.105774415191263, + 0.554085286334157, + 0.5193689335137606, + 0.9190603643655777, + 0.2835676781833172, + 1.5768442526459694, + 0.6304135732352734, + 0.5689149871468544, + 0.530979260802269, + 0.2093819249421358, + 0.28847554326057434, + 0.8203185219317675, + 0.2447890341281891, + 0.05152639327570796, + 1.4320903737097979, + 1.672945462167263, + 1.1688884664326906, + 0.675442123785615, + 0.0, + 0.9151615928858519, + 1.6463322378695011, + 0.6381963789463043, + 0.13048819825053215, + 0.6369529869407415, + 1.097967203706503, + 1.2273662686347961, + 0.6402297429740429, + 0.6169741377234459, + 0.15767529234290123, + 0.15480486303567886, + 0.48947423323988914, + 0.026803577318787575, + 2.0230192877352238, + 0.6898215319961309, + 0.42058134637773037, + 0.6754794577136636, + 0.37049171328544617, + 0.49558258429169655, + 1.0167556069791317, + 0.2357275951653719, + 0.6322593614459038, + 0.36818898655474186, + 2.8389125671237707, + 1.1920051127672195, + 1.4511773455888033, + 1.276102215051651, + 0.4974135756492615, + 0.0, + 0.2690126597881317, + 0.20443757623434067, + 0.3790181763470173, + 1.3402749598026276, + 0.3043509479612112, + 1.5824156608432531, + 1.2374878991395235, + 0.1896311528980732, + 3.7440262101590633, + 0.19757534191012383, + 0.7522594146430492, + 1.5715072266757488, + 0.04248605668544769 + ], + "unique_experts": 62, + "load_cv": 0.65369645119229, + "normalized_load_entropy": 0.9505209336129427, + "max_load_share": 0.06743002544529263 + } + }, + "s1_period": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "c7898ed1f168eb2ca2fae1f776c4108486f7e2f8de9a5ea6a1606b71c332efee", + "route_weight_sha256": "a928a5eedbcfb10162b72df83022f55401e5352639e39fcddee0fe743725ec81", + "loads": [ + 9, + 12, + 12, + 12, + 6, + 11, + 5, + 2, + 16, + 9, + 16, + 16, + 5, + 1, + 9, + 4, + 0, + 19, + 23, + 17, + 13, + 0, + 13, + 2, + 15, + 3, + 11, + 19, + 18, + 12, + 17, + 4, + 2, + 3, + 1, + 26, + 12, + 10, + 5, + 7, + 4, + 17, + 7, + 13, + 5, + 12, + 4, + 14, + 15, + 9, + 0, + 2, + 5, + 5, + 5, + 7, + 21, + 3, + 2, + 54, + 4, + 10, + 20, + 1 + ], + "weighted_loads": [ + 0.7928791269659996, + 0.7155238650739193, + 0.5556666776537895, + 1.8274289481341839, + 0.2623698152601719, + 0.45526944287121296, + 0.3769151158630848, + 0.0854618288576603, + 1.4874218069016933, + 0.3524434622377157, + 0.6411610338836908, + 0.63886733725667, + 0.19998045451939106, + 0.0486488863825798, + 0.7253155093640089, + 0.21116985380649567, + 0.0, + 1.4152979403734207, + 1.694660261273384, + 1.1866785362362862, + 0.7295768409967422, + 0.0, + 0.8578723482787609, + 0.2896405905485153, + 0.5471591036766768, + 0.09705987200140953, + 0.5088423602283001, + 1.0625167824327946, + 1.156908331438899, + 0.6432345025241375, + 0.7031406629830599, + 0.176804443821311, + 0.08685141429305077, + 0.13190680369734764, + 0.02792518027126789, + 2.1028847377747297, + 0.5923414304852486, + 0.42186231166124344, + 0.33659999817609787, + 0.3057899586856365, + 0.16445418819785118, + 1.0133865624666214, + 0.23358578234910965, + 0.6223857272416353, + 0.33759966120123863, + 1.5751641429960728, + 0.19210394844412804, + 1.3525875117629766, + 1.2388268820941448, + 0.3868347220122814, + 0.0, + 0.1699928194284439, + 0.19975649937987328, + 0.21307454258203506, + 0.348989088088274, + 0.26225372962653637, + 1.5386696681380272, + 0.12739980220794678, + 0.0630060937255621, + 3.7074430901557207, + 0.19437076337635517, + 0.7367754653096199, + 1.3783174995332956, + 0.043248534202575684 + ], + "unique_experts": 61, + "load_cv": 0.8525435038821357, + "normalized_load_entropy": 0.9226296333792173, + "max_load_share": 0.08490566037735849 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "6acdb317c2cd0c9afe6aac9adc7feca57c18573c084aef4d039d2fa1996c0517", + "route_weight_sha256": "b3ebd66cd5c9124c3cec9f73f1b18b049008e351f03371d50bbe32ecea5865c0", + "loads": [ + 14, + 17, + 19, + 22, + 10, + 14, + 19, + 9, + 17, + 14, + 18, + 17, + 6, + 6, + 10, + 7, + 6, + 20, + 25, + 17, + 14, + 0, + 14, + 17, + 18, + 3, + 11, + 19, + 18, + 13, + 17, + 4, + 3, + 15, + 1, + 26, + 18, + 11, + 13, + 7, + 12, + 17, + 9, + 13, + 7, + 22, + 23, + 18, + 21, + 12, + 0, + 12, + 11, + 8, + 18, + 7, + 21, + 19, + 3, + 54, + 6, + 11, + 27, + 2 + ], + "weighted_loads": [ + 1.0997707033529878, + 1.0357188880443573, + 0.9176807887852192, + 2.395874116104096, + 0.4246756788343191, + 0.5470730550587177, + 1.2257010731846094, + 0.3060011528432369, + 1.521014578640461, + 0.549103757366538, + 0.7361426893621683, + 0.6701275408267975, + 0.21018371544778347, + 0.28883572667837143, + 0.8235429283231497, + 0.33396353013813496, + 0.14400976011529565, + 1.4735808447003365, + 1.7851303070783615, + 1.1866785362362862, + 0.7762977927923203, + 0.0, + 0.8763038665056229, + 2.191209815442562, + 0.678336339071393, + 0.09705987200140953, + 0.5088423602283001, + 1.0625167824327946, + 1.156908331438899, + 0.6889744028449059, + 0.7031406629830599, + 0.176804443821311, + 0.13098124787211418, + 0.9409197960048914, + 0.02792518027126789, + 2.1028847377747297, + 1.0241051353514194, + 0.4696407876908779, + 0.9520744048058987, + 0.3057899586856365, + 0.459774075075984, + 1.0133865624666214, + 0.2867460697889328, + 0.6223857272416353, + 0.43956274911761284, + 2.8841753024607897, + 1.9310590960085392, + 1.642636526376009, + 1.5025693885982037, + 0.5390009842813015, + 0.0, + 0.7875284645706415, + 0.8411268182098866, + 0.3389665000140667, + 1.4944830909371376, + 0.26225372962653637, + 1.5386696681380272, + 1.7413958217948675, + 0.14350891672074795, + 3.7074430901557207, + 0.2688832823187113, + 0.862176887691021, + 1.6431262139230967, + 0.08552002906799316 + ], + "unique_experts": 62, + "load_cv": 0.603221487274767, + "normalized_load_entropy": 0.9559151593997715, + "max_load_share": 0.061224489795918366 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 106, + "ordered_topk_exact_tokens": 72, + "set_exact_tokens": 87, + "mean_set_jaccard": 0.9467654986522911, + "mean_token_weighted_tv": 0.01120813255075295, + "aggregate_load_tv": 0.023584905660377357 + }, + "system_bos": { + "tokens": 106, + "ordered_topk_exact_tokens": 68, + "set_exact_tokens": 87, + "mean_set_jaccard": 0.9487870619946092, + "mean_token_weighted_tv": 0.012556019362132504, + "aggregate_load_tv": 0.022012578616352203 + }, + "system_x": { + "tokens": 106, + "ordered_topk_exact_tokens": 58, + "set_exact_tokens": 78, + "mean_set_jaccard": 0.9245283018867925, + "mean_token_weighted_tv": 0.01671478805079494, + "aggregate_load_tv": 0.025157232704402514 + }, + "system_period": { + "tokens": 106, + "ordered_topk_exact_tokens": 49, + "set_exact_tokens": 73, + "mean_set_jaccard": 0.9070080862533693, + "mean_token_weighted_tv": 0.018782204790216573, + "aggregate_load_tv": 0.034591194968553465 + }, + "bos_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 66, + "set_exact_tokens": 84, + "mean_set_jaccard": 0.940700808625337, + "mean_token_weighted_tv": 0.01325420421144029, + "aggregate_load_tv": 0.026729559748427674 + }, + "bos_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 61, + "set_exact_tokens": 79, + "mean_set_jaccard": 0.9252021563342318, + "mean_token_weighted_tv": 0.01648693876165264, + "aggregate_load_tv": 0.03144654088050314 + }, + "x_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 61, + "set_exact_tokens": 80, + "mean_set_jaccard": 0.9299191374663072, + "mean_token_weighted_tv": 0.01544287208608299, + "aggregate_load_tv": 0.026729559748427674 + }, + "x_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 53, + "set_exact_tokens": 75, + "mean_set_jaccard": 0.9144204851752021, + "mean_token_weighted_tv": 0.018984521247165383, + "aggregate_load_tv": 0.033018867924528295 + }, + "period_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 60, + "set_exact_tokens": 80, + "mean_set_jaccard": 0.9299191374663073, + "mean_token_weighted_tv": 0.014998011273454945, + "aggregate_load_tv": 0.023584905660377364 + }, + "period_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 53, + "set_exact_tokens": 76, + "mean_set_jaccard": 0.9191374663072776, + "mean_token_weighted_tv": 0.0190502993744921, + "aggregate_load_tv": 0.02987421383647798 + } + } + }, + "layer_24": { + "layer": 24, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "e8d492eda2fb26594cc4ce23525b36d4265f4a5a981f51c511901bb3b6e2a06f", + "route_weight_sha256": "d61c1ff58e72464fab8b07eb8fcf73d92d33fba67457a0e3bc9c692966f428a9", + "loads": [ + 2, + 13, + 4, + 9, + 7, + 16, + 28, + 12, + 15, + 21, + 19, + 3, + 12, + 26, + 3, + 6, + 0, + 2, + 4, + 7, + 11, + 18, + 5, + 3, + 6, + 25, + 0, + 8, + 2, + 14, + 51, + 8, + 6, + 8, + 3, + 12, + 1, + 2, + 13, + 19, + 3, + 2, + 6, + 1, + 7, + 5, + 4, + 3, + 20, + 14, + 4, + 4, + 4, + 12, + 10, + 14, + 27, + 15, + 17, + 7, + 7, + 0, + 5, + 21 + ], + "weighted_loads": [ + 0.08677079528570175, + 0.6083250977098942, + 0.11797256581485271, + 0.30368906259536743, + 0.46993905305862427, + 0.8844469543546438, + 1.3005702067166567, + 0.45953586138784885, + 1.6925877034664154, + 1.1521015129983425, + 1.4873883407562971, + 0.2834210768342018, + 0.9895881600677967, + 1.3183380085974932, + 0.12470616772770882, + 0.19180214405059814, + 0.0, + 0.07858606241643429, + 0.137409046292305, + 0.2155920248478651, + 0.5251581948250532, + 0.8910480421036482, + 0.2062114253640175, + 0.11125755682587624, + 0.22345134802162647, + 1.070343479514122, + 0.0, + 0.3435582034289837, + 0.06581628695130348, + 0.7947241459041834, + 4.085255187004805, + 0.2554824985563755, + 0.4114857651293278, + 0.6343395803123713, + 0.09251037426292896, + 0.7878031581640244, + 0.03366352990269661, + 0.07988666743040085, + 0.4139460511505604, + 0.9180939290672541, + 0.30694595351815224, + 0.07443217560648918, + 0.21148338168859482, + 0.036471977829933167, + 0.2952445074915886, + 0.3158455863595009, + 0.15918278694152832, + 0.09238505363464355, + 1.813448205590248, + 1.1872875653207302, + 0.15945341065526009, + 0.3230074271559715, + 0.10432308353483677, + 0.9547654986381531, + 0.5995032209903002, + 0.7974032238125801, + 1.6672163531184196, + 0.5761113837361336, + 0.952887574210763, + 0.22467806190252304, + 0.3195501621812582, + 0.0, + 0.2752387188374996, + 0.8406765852123499 + ], + "unique_experts": 61, + "load_cv": 0.89385651575003, + "normalized_load_entropy": 0.9152670576630696, + "max_load_share": 0.08018867924528301 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "8fbca42c6f281facfd6ad81fe344662c3832ebfa1e759ef76067f906071475a4", + "route_weight_sha256": "ca298e555baf063b8bc61c24984e59149e0b9f435648beab9a3a73ef02c164ba", + "loads": [ + 2, + 14, + 7, + 9, + 7, + 22, + 28, + 13, + 24, + 21, + 30, + 3, + 13, + 26, + 6, + 6, + 0, + 2, + 4, + 8, + 12, + 18, + 11, + 3, + 14, + 25, + 0, + 8, + 9, + 19, + 51, + 11, + 7, + 12, + 10, + 13, + 2, + 4, + 13, + 19, + 3, + 4, + 9, + 3, + 7, + 8, + 4, + 9, + 20, + 14, + 9, + 10, + 7, + 16, + 10, + 14, + 27, + 15, + 27, + 8, + 10, + 15, + 7, + 24 + ], + "weighted_loads": [ + 0.08677079528570175, + 0.6524073407053947, + 0.2224223855882883, + 0.30368906259536743, + 0.46993905305862427, + 1.178934596828185, + 1.3005702067166567, + 0.5144380573183298, + 2.095423921942711, + 1.1521015129983425, + 1.8814570249523968, + 0.2834210768342018, + 0.9923208758700639, + 1.3183380085974932, + 0.22863533906638622, + 0.19180214405059814, + 0.0, + 0.07858606241643429, + 0.137409046292305, + 0.24534697271883488, + 0.5585743170231581, + 0.8910480421036482, + 0.7449950464069843, + 0.11125755682587624, + 0.5257404954172671, + 1.070343479514122, + 0.0, + 0.3435582034289837, + 0.348584558814764, + 0.994155889376998, + 4.085255187004805, + 0.35722018778324127, + 0.4399665482342243, + 0.8189431317150593, + 0.3045402429997921, + 0.8338154554367065, + 0.1299383006989956, + 0.9856198541820049, + 0.4139460511505604, + 0.9180939290672541, + 0.30694595351815224, + 0.19323980808258057, + 0.28630704060196877, + 0.1910312883555889, + 0.2952445074915886, + 0.5730241276323795, + 0.15918278694152832, + 0.5331744073191658, + 1.813448205590248, + 1.1872875653207302, + 0.35838671401143074, + 0.7791104763746262, + 0.18845833837985992, + 1.1333176866173744, + 0.5995032209903002, + 0.7974032238125801, + 1.6672163531184196, + 0.5761113837361336, + 1.270728261442855, + 0.2652231529355049, + 0.4283760003745556, + 1.298405280802399, + 0.2781418499071151, + 2.825716594234109 + ], + "unique_experts": 62, + "load_cv": 0.7303419572712652, + "normalized_load_entropy": 0.9402184616370142, + "max_load_share": 0.0648854961832061 + } + }, + "s1_eos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "0e17d651b496d55b2786abe1b114a294b4e64d1dd4454b7a179778e577657092", + "route_weight_sha256": "6329b229134363eaaf0aa6c34563455d9f34f8aed217be63cf279723f087e2c8", + "loads": [ + 2, + 15, + 4, + 9, + 6, + 15, + 26, + 9, + 15, + 21, + 20, + 3, + 11, + 26, + 3, + 6, + 0, + 2, + 3, + 7, + 12, + 18, + 4, + 3, + 6, + 22, + 0, + 9, + 7, + 14, + 52, + 8, + 6, + 8, + 4, + 12, + 2, + 2, + 12, + 19, + 3, + 2, + 7, + 1, + 7, + 5, + 2, + 3, + 21, + 14, + 5, + 4, + 6, + 11, + 10, + 15, + 26, + 14, + 16, + 8, + 7, + 0, + 5, + 21 + ], + "weighted_loads": [ + 0.08473969623446465, + 0.6745203416794538, + 0.11519406922161579, + 0.30063390731811523, + 0.43734072521328926, + 0.8688441962003708, + 1.2477761059999466, + 0.36276126839220524, + 1.6876520197838545, + 1.1649412401020527, + 1.5347182881087065, + 0.28357674181461334, + 0.9642484821379185, + 1.3243152741342783, + 0.12500810995697975, + 0.20461577363312244, + 0.0, + 0.08460023812949657, + 0.10828414000570774, + 0.21189626306295395, + 0.562417097389698, + 0.8918252848088741, + 0.17237132042646408, + 0.11407477036118507, + 0.22574958950281143, + 0.9873239323496819, + 0.0, + 0.36421853490173817, + 0.21224649623036385, + 0.8066852577030659, + 4.129355864599347, + 0.2588997520506382, + 0.41139553487300873, + 0.6359559986740351, + 0.12107461504638195, + 0.8056988585740328, + 0.06635949201881886, + 0.0779525600373745, + 0.3818138428032398, + 0.9186389166861773, + 0.31130553036928177, + 0.07017392106354237, + 0.23508784361183643, + 0.03756142035126686, + 0.3020300380885601, + 0.29376284778118134, + 0.1062006801366806, + 0.10145686939358711, + 1.8432660307735205, + 1.1786684356629848, + 0.18819567561149597, + 0.3301718197762966, + 0.14494800008833408, + 0.9245107993483543, + 0.5856797304004431, + 0.8554443288594484, + 1.624850545078516, + 0.5400712378323078, + 0.9080372843891382, + 0.2674393020570278, + 0.32303231582045555, + 0.0, + 0.2687608376145363, + 0.8463599905371666 + ], + "unique_experts": 61, + "load_cv": 0.8804806825526634, + "normalized_load_entropy": 0.918617604942772, + "max_load_share": 0.08176100628930817 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "3b3aa8e4c0ffa3b51cd5279348200d35c1ac093c54a58d3786ae6658e1d0e242", + "route_weight_sha256": "3e4786ada78357e3997af15a5dc8379d4feebd1ee9646b109f84b5d7534266a7", + "loads": [ + 2, + 16, + 5, + 10, + 8, + 25, + 26, + 10, + 25, + 24, + 28, + 5, + 14, + 26, + 5, + 6, + 1, + 2, + 4, + 10, + 16, + 18, + 16, + 4, + 16, + 22, + 0, + 9, + 28, + 19, + 52, + 11, + 6, + 14, + 11, + 14, + 9, + 5, + 13, + 19, + 4, + 10, + 11, + 4, + 9, + 7, + 2, + 11, + 21, + 14, + 10, + 18, + 12, + 15, + 12, + 17, + 26, + 15, + 31, + 9, + 13, + 19, + 12, + 26 + ], + "weighted_loads": [ + 0.08473969623446465, + 0.7172944229096174, + 0.14070198871195316, + 0.4154520034790039, + 0.49863313883543015, + 1.2928172558313236, + 1.2477761059999466, + 0.40020094998180866, + 2.3197883018292487, + 1.295516412705183, + 1.8540884766262025, + 0.3506949543952942, + 1.0259084983263165, + 1.3243152741342783, + 0.2048255242407322, + 0.20461577363312244, + 0.028864020481705666, + 0.08460023812949657, + 0.14025161229074, + 0.30511385574936867, + 0.7446378618478775, + 0.8918252848088741, + 1.006307352334261, + 0.13924182206392288, + 0.5797424972988665, + 0.9873239323496819, + 0.0, + 0.36421853490173817, + 1.2299209460616112, + 1.0262188073247671, + 4.129355864599347, + 0.3981430120766163, + 0.41139553487300873, + 0.9511174466460943, + 0.3606313788332045, + 0.9061133358627558, + 0.591851195320487, + 1.0237971879541874, + 0.4337601624429226, + 0.9186389166861773, + 0.4251704439520836, + 0.5468192212283611, + 0.3462323173880577, + 0.34947581961750984, + 0.39713098853826523, + 0.508643165230751, + 0.1062006801366806, + 0.6706514887046069, + 1.8432660307735205, + 1.1786684356629848, + 0.39308357797563076, + 1.3435719013214111, + 0.31823679991066456, + 1.2127393335103989, + 0.7603550869971514, + 0.9534990396350622, + 1.624850545078516, + 0.5836119651794434, + 1.5042675194563344, + 0.3134942390024662, + 0.5252185165882111, + 1.9662269772961736, + 0.6182062053121626, + 2.92349761351943 + ], + "unique_experts": 63, + "load_cv": 0.6572639710365613, + "normalized_load_entropy": 0.9494418556882793, + "max_load_share": 0.05895691609977324 + } + }, + "s0_bos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "0fb42b2221c513b94f3a9c480a96454584ba0c6f91737d9baafa99dfe733905e", + "route_weight_sha256": "10fb5f4fcd763fd1229c569cfcc926265ef69d649ccfcbffd8e9eb57d84b928c", + "loads": [ + 2, + 12, + 3, + 6, + 6, + 16, + 25, + 11, + 14, + 20, + 18, + 3, + 12, + 26, + 3, + 5, + 0, + 2, + 6, + 6, + 12, + 18, + 5, + 3, + 6, + 27, + 0, + 8, + 3, + 14, + 55, + 9, + 5, + 8, + 5, + 13, + 1, + 2, + 11, + 19, + 3, + 2, + 4, + 1, + 6, + 5, + 3, + 5, + 21, + 14, + 6, + 5, + 4, + 12, + 10, + 13, + 28, + 15, + 18, + 7, + 7, + 1, + 5, + 21 + ], + "weighted_loads": [ + 0.08457217365503311, + 0.5712514854967594, + 0.08891842514276505, + 0.20330685935914516, + 0.4265945255756378, + 0.8905351236462593, + 1.2406741939485073, + 0.41178036853671074, + 1.6972450651228428, + 1.121421456336975, + 1.4511782955378294, + 0.28178682178258896, + 0.9941966272890568, + 1.32977438531816, + 0.12703155353665352, + 0.16976159252226353, + 0.0, + 0.07840250246226788, + 0.19923801347613335, + 0.19477093778550625, + 0.5654779598116875, + 0.878675976768136, + 0.20817174389958382, + 0.11304229125380516, + 0.2300003580749035, + 1.141819754615426, + 0.0, + 0.35026468709111214, + 0.08843204937875271, + 0.8031086586415768, + 4.28550838958472, + 0.2834872901439667, + 0.3877546712756157, + 0.6201512329280376, + 0.14758713357150555, + 0.8316865675151348, + 0.032553330063819885, + 0.08248777687549591, + 0.3591231908649206, + 0.9305145796388388, + 0.29865581914782524, + 0.06693397648632526, + 0.14647601544857025, + 0.03666016459465027, + 0.27076044492423534, + 0.2824308853596449, + 0.151319932192564, + 0.1621571984142065, + 1.890972200781107, + 1.1920479834079742, + 0.2182441744953394, + 0.3588039129972458, + 0.1023316103965044, + 0.9551799483597279, + 0.6039957050234079, + 0.7861365601420403, + 1.7135304752737284, + 0.5648169405758381, + 0.9942203853279352, + 0.23467211052775383, + 0.3172704931348562, + 0.03367765247821808, + 0.2795391324907541, + 0.8372607976198196 + ], + "unique_experts": 62, + "load_cv": 0.918475889145435, + "normalized_load_entropy": 0.9151545704530196, + "max_load_share": 0.08647798742138364 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "5d7537ceb2d6dad97a2ec5ce1db5974db2f02b4a120734b9f060b9b5308787e2", + "route_weight_sha256": "64287e1d7b353030e1085f4bc11f21f63d15c876e7fde07850c1e38864d30144", + "loads": [ + 2, + 13, + 6, + 6, + 6, + 22, + 26, + 12, + 22, + 20, + 27, + 3, + 13, + 26, + 6, + 5, + 0, + 2, + 6, + 7, + 13, + 18, + 13, + 3, + 14, + 27, + 1, + 8, + 10, + 19, + 56, + 12, + 6, + 12, + 12, + 13, + 2, + 4, + 11, + 19, + 3, + 4, + 8, + 2, + 6, + 8, + 4, + 9, + 21, + 14, + 13, + 11, + 7, + 16, + 10, + 13, + 28, + 15, + 27, + 8, + 10, + 17, + 6, + 23 + ], + "weighted_loads": [ + 0.08457217365503311, + 0.6168633289635181, + 0.1811664868146181, + 0.20330685935914516, + 0.4265945255756378, + 1.1712925269966945, + 1.308788064867258, + 0.4666825644671917, + 2.096488943323493, + 1.121421456336975, + 1.8068605873268098, + 0.28178682178258896, + 0.996929343091324, + 1.32977438531816, + 0.2299132477492094, + 0.16976159252226353, + 0.0, + 0.07840250246226788, + 0.19923801347613335, + 0.22877720929682255, + 0.5988940820097923, + 0.878675976768136, + 0.9114419482648373, + 0.11304229125380516, + 0.5322895054705441, + 1.141819754615426, + 0.4364488422870636, + 0.35026468709111214, + 0.37120032124221325, + 1.0025404021143913, + 4.3267420856282115, + 0.3743766862899065, + 0.41623545438051224, + 0.8047547843307257, + 0.34590631164610386, + 0.8316865675151348, + 0.12882810086011887, + 0.9886464327573776, + 0.3591231908649206, + 0.9305145796388388, + 0.29865581914782524, + 0.16961637325584888, + 0.3256294019520283, + 0.1563648134469986, + 0.27076044492423534, + 0.5751468893140554, + 0.21302776783704758, + 0.5432787555037066, + 1.890972200781107, + 1.1920479834079742, + 0.5179452896118164, + 0.7797275632619858, + 0.18646686524152756, + 1.1302525140345097, + 0.6039957050234079, + 0.7861365601420403, + 1.7135304752737284, + 0.5648169405758381, + 1.312765458598733, + 0.2735629081726074, + 0.4249580707401037, + 1.4027193174697459, + 0.2812443805160001, + 1.8526889234781265 + ], + "unique_experts": 63, + "load_cv": 0.7543445721143389, + "normalized_load_entropy": 0.9385466250952407, + "max_load_share": 0.07124681933842239 + } + }, + "s1_bos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "d09b32cc99f7e531800b66480b82017a737684ea645f4d81864849ff78897958", + "route_weight_sha256": "0316c35bac9f3f975ef346dc0e2d2b7e48c47a45fd35de1fdb649d91b12b9902", + "loads": [ + 1, + 14, + 5, + 6, + 6, + 16, + 27, + 10, + 16, + 20, + 19, + 3, + 12, + 26, + 3, + 4, + 0, + 5, + 3, + 7, + 11, + 16, + 5, + 3, + 7, + 23, + 0, + 8, + 4, + 14, + 52, + 11, + 5, + 7, + 4, + 13, + 1, + 2, + 11, + 20, + 3, + 1, + 6, + 1, + 8, + 4, + 3, + 5, + 21, + 15, + 5, + 4, + 4, + 13, + 10, + 14, + 27, + 12, + 17, + 9, + 7, + 0, + 5, + 22 + ], + "weighted_loads": [ + 0.048271991312503815, + 0.624217489734292, + 0.1495024599134922, + 0.20241717621684074, + 0.4200189746916294, + 0.8844544123858213, + 1.2778324540704489, + 0.3813956715166569, + 1.7206444777548313, + 1.1139333620667458, + 1.4390147738158703, + 0.2726641707122326, + 0.9941652491688728, + 1.3226212933659554, + 0.12418734654784203, + 0.14083749055862427, + 0.0, + 0.19660761579871178, + 0.10819493979215622, + 0.21762518025934696, + 0.538164084777236, + 0.8203770369291306, + 0.20364731177687645, + 0.11855287849903107, + 0.2588927038013935, + 1.017591131851077, + 0.0, + 0.3395255096256733, + 0.13787602074444294, + 0.8059956058859825, + 4.1645081005990505, + 0.34062305092811584, + 0.3840551860630512, + 0.594101307913661, + 0.126189686357975, + 0.8125142846256495, + 0.03443581983447075, + 0.07951787859201431, + 0.3637447003275156, + 0.9544857330620289, + 0.30059871450066566, + 0.02506491355597973, + 0.22825925052165985, + 0.03706996142864227, + 0.3178288396447897, + 0.24340127781033516, + 0.1536269448697567, + 0.16329979710280895, + 1.8722289483994246, + 1.2181454356759787, + 0.1890560630708933, + 0.343512199819088, + 0.10028114169836044, + 0.9613655302673578, + 0.5861943066120148, + 0.8276993483304977, + 1.6941477339714766, + 0.4723159112036228, + 0.9389034546911716, + 0.29029998928308487, + 0.3210556451231241, + 0.0, + 0.28251695074141026, + 0.8631452023983002 + ], + "unique_experts": 61, + "load_cv": 0.8927938237223382, + "normalized_load_entropy": 0.915961382405461, + "max_load_share": 0.08176100628930817 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "303a2dd5848f0b975ece9824d075db49b80a29c5cb233d360606ae247391ca53", + "route_weight_sha256": "0546c776774e080f9221db57ff91b352bf673c5e78bc7628856068e9416f4dfa", + "loads": [ + 1, + 15, + 7, + 7, + 8, + 26, + 27, + 11, + 25, + 23, + 27, + 5, + 15, + 26, + 6, + 4, + 1, + 5, + 4, + 11, + 15, + 16, + 18, + 4, + 16, + 23, + 0, + 8, + 25, + 19, + 52, + 15, + 5, + 13, + 11, + 15, + 8, + 5, + 12, + 20, + 4, + 9, + 11, + 5, + 9, + 7, + 3, + 12, + 21, + 15, + 11, + 18, + 10, + 17, + 12, + 16, + 27, + 13, + 31, + 10, + 11, + 20, + 11, + 25 + ], + "weighted_loads": [ + 0.048271991312503815, + 0.6789204459637403, + 0.19690433703362942, + 0.3172352723777294, + 0.4813113883137703, + 1.2843066122150049, + 1.2778324540704489, + 0.4188353531062603, + 2.353544160723686, + 1.244508534669876, + 1.7820339992176741, + 0.33978238329291344, + 1.0558252653572708, + 1.3226212933659554, + 0.23064502701163292, + 0.14083749055862427, + 0.028864020481705666, + 0.19660761579871178, + 0.1401624120771885, + 0.3413744755089283, + 0.7203848492354155, + 0.8203770369291306, + 1.2031029649078846, + 0.14371993020176888, + 0.5777940624393523, + 1.017591131851077, + 0.0, + 0.3395255096256733, + 1.159082805737853, + 1.0255291555076838, + 4.1645081005990505, + 0.5171026885509491, + 0.3840551860630512, + 0.9092627558857203, + 0.3650916558690369, + 0.9129287619143724, + 0.5599275231361389, + 1.0298625081777573, + 0.4099069405347109, + 0.9544857330620289, + 0.4144636280834675, + 0.48676392063498497, + 0.47304542921483517, + 0.4205012768507004, + 0.35745290108025074, + 0.518370732665062, + 0.1536269448697567, + 0.7691771833924577, + 1.8722289483994246, + 1.2181454356759787, + 0.5082999039441347, + 1.3051715940237045, + 0.2735699415206909, + 1.2495940644294024, + 0.7608696632087231, + 0.9257540591061115, + 1.6941477339714766, + 0.515274990350008, + 1.5316203627735376, + 0.3288559205830097, + 0.45711851119995117, + 2.0040574269369245, + 0.6306839828612283, + 1.922963336110115 + ], + "unique_experts": 63, + "load_cv": 0.6536239387208495, + "normalized_load_entropy": 0.9502346152117501, + "max_load_share": 0.05895691609977324 + } + }, + "s0_x": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "d991137f3846ecfdbb976f086b16c9dee6945d2571a40f38a17f5a30ac81f4ce", + "route_weight_sha256": "effafa17f13385847076a15b791a497f7b8a5aa776f8da015f6bb3a41ee049f0", + "loads": [ + 2, + 11, + 3, + 9, + 6, + 15, + 24, + 10, + 16, + 20, + 18, + 3, + 11, + 25, + 3, + 3, + 0, + 2, + 4, + 7, + 14, + 19, + 6, + 3, + 6, + 25, + 0, + 9, + 3, + 14, + 52, + 10, + 5, + 8, + 3, + 12, + 1, + 2, + 12, + 19, + 3, + 2, + 6, + 1, + 8, + 4, + 3, + 3, + 21, + 15, + 5, + 6, + 3, + 12, + 10, + 13, + 28, + 16, + 19, + 8, + 7, + 0, + 5, + 23 + ], + "weighted_loads": [ + 0.08433463051915169, + 0.5482613518834114, + 0.08987644501030445, + 0.2873321585357189, + 0.4147813506424427, + 0.8455020636320114, + 1.1728814132511616, + 0.4027456045150757, + 1.727592496201396, + 1.1087155416607857, + 1.467108678072691, + 0.27086005732417107, + 0.9702769480645657, + 1.2963467612862587, + 0.12467135488986969, + 0.10249999351799488, + 0.0, + 0.07838235422968864, + 0.1446346417069435, + 0.2111948076635599, + 0.6298696529120207, + 0.9025582727044821, + 0.23388556763529778, + 0.11402851715683937, + 0.2163655012845993, + 1.0937913935631514, + 0.0, + 0.3669173549860716, + 0.09362094104290009, + 0.782501045614481, + 4.109706562943757, + 0.3157863225787878, + 0.36823078244924545, + 0.6092805098742247, + 0.08643028885126114, + 0.796754464507103, + 0.03197038173675537, + 0.07965748757123947, + 0.3852127566933632, + 0.924709802493453, + 0.27886664494872093, + 0.06981474161148071, + 0.2063184417784214, + 0.03550399839878082, + 0.3211693912744522, + 0.25378087535500526, + 0.13516003265976906, + 0.09955648891627789, + 1.8476677611470222, + 1.1997137777507305, + 0.1811404675245285, + 0.3965424783527851, + 0.07225408963859081, + 0.9400887750089169, + 0.585352411493659, + 0.7775603737682104, + 1.714975267648697, + 0.5915953479707241, + 1.017074540257454, + 0.27085580863058567, + 0.3276732601225376, + 0.0, + 0.27245619893074036, + 0.9022577255964279 + ], + "unique_experts": 61, + "load_cv": 0.9003820679909378, + "normalized_load_entropy": 0.9140559846510432, + "max_load_share": 0.08176100628930817 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "4869d12841f2f1a91642099308e6c55c572d1c23005a5cd448f7f831d2bfdcba", + "route_weight_sha256": "c069d10c155e6fc62c5ee3f3b338cbbb00a0805babc258e0c664a75dd10c00bd", + "loads": [ + 2, + 12, + 5, + 9, + 6, + 22, + 24, + 11, + 25, + 20, + 28, + 3, + 13, + 25, + 7, + 3, + 0, + 2, + 4, + 8, + 15, + 19, + 13, + 3, + 14, + 26, + 0, + 9, + 10, + 19, + 52, + 12, + 6, + 12, + 11, + 13, + 3, + 4, + 13, + 19, + 3, + 3, + 8, + 2, + 8, + 7, + 3, + 8, + 21, + 15, + 11, + 12, + 6, + 17, + 10, + 13, + 28, + 16, + 28, + 8, + 10, + 15, + 7, + 25 + ], + "weighted_loads": [ + 0.08433463051915169, + 0.5844028666615486, + 0.15603202767670155, + 0.2873321585357189, + 0.4147813506424427, + 1.1598213672405109, + 1.1728814132511616, + 0.45764780044555664, + 2.2132551074028015, + 1.1087155416607857, + 1.8798993683885783, + 0.27086005732417107, + 1.0069144547451288, + 1.2963467612862587, + 0.26107232458889484, + 0.10249999351799488, + 0.0, + 0.07838235422968864, + 0.1446346417069435, + 0.23654849268496037, + 0.6632857751101255, + 0.9025582727044821, + 0.8595992811024189, + 0.11402851715683937, + 0.5186546486802399, + 1.12948446162045, + 0.0, + 0.3669173549860716, + 0.3763892129063606, + 0.9819327890872955, + 4.109706562943757, + 0.3904197048395872, + 0.396711565554142, + 0.7938840612769127, + 0.34560725279152393, + 0.8332986794412136, + 0.16986674815416336, + 0.9789732024073601, + 0.4237995147705078, + 0.924709802493453, + 0.27886664494872093, + 0.12884092330932617, + 0.24745380133390427, + 0.13947997987270355, + 0.3211693912744522, + 0.46617620438337326, + 0.13516003265976906, + 0.5073557923315093, + 1.8476677611470222, + 1.1997137777507305, + 0.39094085432589054, + 0.8588347919285297, + 0.15638934448361397, + 1.1727577671408653, + 0.585352411493659, + 0.7775603737682104, + 1.714975267648697, + 0.5915953479707241, + 1.3319211546331644, + 0.27085580863058567, + 0.4448961168527603, + 1.3809833810664713, + 0.32208101463038474, + 1.9176858514547348 + ], + "unique_experts": 62, + "load_cv": 0.7414629033751426, + "normalized_load_entropy": 0.9376361162054677, + "max_load_share": 0.06615776081424936 + } + }, + "s1_x": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "7dfdbfe2659d9bd1a448fe23f24f0035b4dd5a45850af0be08b3d9f1850478ae", + "route_weight_sha256": "3282331068cec51a0262b7ae29fbbc912d0b5f0fe44c6ec18b28472498372b58", + "loads": [ + 1, + 12, + 4, + 10, + 6, + 15, + 26, + 11, + 16, + 21, + 20, + 3, + 12, + 26, + 3, + 2, + 0, + 4, + 3, + 7, + 12, + 18, + 5, + 3, + 7, + 22, + 0, + 9, + 5, + 14, + 51, + 11, + 5, + 7, + 2, + 13, + 2, + 2, + 10, + 19, + 3, + 2, + 6, + 1, + 9, + 2, + 3, + 3, + 21, + 14, + 6, + 5, + 4, + 12, + 10, + 15, + 28, + 12, + 17, + 10, + 7, + 1, + 5, + 21 + ], + "weighted_loads": [ + 0.046396397054195404, + 0.5819217786192894, + 0.11967131681740284, + 0.33766193501651287, + 0.4188774451613426, + 0.8365774173289537, + 1.2127755433321, + 0.4157594982534647, + 1.7127458304166794, + 1.130493588745594, + 1.4789141025394201, + 0.2639099285006523, + 1.0022853631526232, + 1.318807691335678, + 0.12289877980947495, + 0.07165220566093922, + 0.0, + 0.1581126730889082, + 0.10773587971925735, + 0.22021217085421085, + 0.5585559979081154, + 0.8691897578537464, + 0.20622148923575878, + 0.11525138467550278, + 0.2496736142784357, + 0.9980340451002121, + 0.0, + 0.35294933058321476, + 0.16684594191610813, + 0.7577681858092546, + 4.046221222728491, + 0.34558997489511967, + 0.37491942569613457, + 0.5708552934229374, + 0.05415128543972969, + 0.8024787865579128, + 0.0654471218585968, + 0.07242804393172264, + 0.33928151801228523, + 0.9125365130603313, + 0.2711406238377094, + 0.06372908130288124, + 0.21090085059404373, + 0.035260267555713654, + 0.364731865003705, + 0.20135211944580078, + 0.13420840725302696, + 0.10332520119845867, + 1.8367970008403063, + 1.1793884839862585, + 0.1991477981209755, + 0.38045278936624527, + 0.09534562937915325, + 0.9092163555324078, + 0.5702644977718592, + 0.85913011059165, + 1.7092633601278067, + 0.4701688401401043, + 0.927663205191493, + 0.3305402137339115, + 0.3235589303076267, + 0.04040434956550598, + 0.262951023876667, + 0.8670718967914581 + ], + "unique_experts": 62, + "load_cv": 0.8854979623642352, + "normalized_load_entropy": 0.916830659989389, + "max_load_share": 0.08018867924528301 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "2c0739c6429d78c237d3a1396af8679ffbb5af06b4d601a0e61e7a6390d97cd4", + "route_weight_sha256": "15c9eff794d9e1eecc952182670e0277b6066084b97e2bf8db821210406c7563", + "loads": [ + 1, + 13, + 5, + 11, + 8, + 26, + 26, + 12, + 26, + 24, + 27, + 5, + 15, + 26, + 5, + 2, + 2, + 4, + 4, + 11, + 17, + 18, + 16, + 4, + 16, + 22, + 0, + 9, + 27, + 20, + 51, + 15, + 5, + 14, + 9, + 16, + 11, + 5, + 10, + 19, + 4, + 10, + 10, + 4, + 10, + 4, + 3, + 9, + 21, + 14, + 10, + 19, + 10, + 18, + 12, + 17, + 28, + 12, + 32, + 10, + 12, + 21, + 11, + 24 + ], + "weighted_loads": [ + 0.046396397054195404, + 0.6157772205770016, + 0.1451792363077402, + 0.45248003117740154, + 0.4801698587834835, + 1.2754517592256889, + 1.2127755433321, + 0.4531991798430681, + 2.395175538957119, + 1.2610687613487244, + 1.7853345486801118, + 0.33102814108133316, + 1.0639453793410212, + 1.318807691335678, + 0.20078318566083908, + 0.07165220566093922, + 0.061884934082627296, + 0.1581126730889082, + 0.13970335200428963, + 0.35624697990715504, + 0.7729647904634476, + 0.8691897578537464, + 1.027227582409978, + 0.14041843637824059, + 0.5685749729163945, + 0.9980340451002121, + 0.0, + 0.35294933058321476, + 1.2414517868310213, + 1.0107094831764698, + 4.046221222728491, + 0.5114083290100098, + 0.37491942569613457, + 0.9260225184261799, + 0.28999582724645734, + 0.9557778276503086, + 0.7124388553202152, + 1.0166540741920471, + 0.33928151801228523, + 0.9125365130603313, + 0.38500553742051125, + 0.5323597062379122, + 0.3107245545834303, + 0.31623489409685135, + 0.40435592643916607, + 0.3831389546394348, + 0.13420840725302696, + 0.5850958226947114, + 1.8367970008403063, + 1.1793884839862585, + 0.3748735263943672, + 1.3940855786204338, + 0.2686344292014837, + 1.266625577583909, + 0.7449398543685675, + 0.9571848213672638, + 1.7092633601278067, + 0.4701688401401043, + 1.5707126539200544, + 0.3305402137339115, + 0.49458996392786503, + 2.038549912162125, + 0.611118055996485, + 1.926890030503273 + ], + "unique_experts": 63, + "load_cv": 0.664484218270333, + "normalized_load_entropy": 0.9478055898382327, + "max_load_share": 0.05782312925170068 + } + }, + "s0_period": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "c8d90960180f88013aafd8b69867378bcea586b496ee1de43b35d98f68d739a3", + "route_weight_sha256": "d23f5853824199e431b0616a7466003f50368bafd6f4dc158d9e4d34060b3b65", + "loads": [ + 2, + 13, + 5, + 6, + 6, + 16, + 25, + 10, + 15, + 20, + 18, + 3, + 12, + 26, + 3, + 4, + 0, + 1, + 5, + 7, + 12, + 20, + 4, + 3, + 6, + 25, + 0, + 9, + 2, + 14, + 51, + 9, + 5, + 8, + 4, + 13, + 0, + 2, + 13, + 20, + 3, + 2, + 7, + 1, + 8, + 5, + 3, + 3, + 22, + 14, + 5, + 5, + 3, + 12, + 10, + 14, + 27, + 15, + 18, + 8, + 7, + 0, + 5, + 22 + ], + "weighted_loads": [ + 0.08257696032524109, + 0.5999819226562977, + 0.1509311329573393, + 0.2073021661490202, + 0.4163597300648689, + 0.8807458337396383, + 1.2075069844722748, + 0.3903878666460514, + 1.6998638343065977, + 1.1133928522467613, + 1.4650078751146793, + 0.27293800190091133, + 0.9911377802491188, + 1.3157745134085417, + 0.1251545175909996, + 0.13305787928402424, + 0.0, + 0.05061676725745201, + 0.1761628407984972, + 0.21389836445450783, + 0.5641126222908497, + 0.9327712822705507, + 0.17605778574943542, + 0.11615752056241035, + 0.22213587537407875, + 1.0978175438940525, + 0.0, + 0.3720179330557585, + 0.07047189399600029, + 0.799971217289567, + 4.139115002937615, + 0.28040303476154804, + 0.376080434769392, + 0.6085587907582521, + 0.10945137031376362, + 0.8289247266948223, + 0.0, + 0.07856559753417969, + 0.4221804831176996, + 0.9462918341159821, + 0.28307514265179634, + 0.07159498706459999, + 0.24716589599847794, + 0.03634173050522804, + 0.31841290555894375, + 0.2701683025807142, + 0.1343955285847187, + 0.10087842494249344, + 1.870750728994608, + 1.1849854066967964, + 0.18594864010810852, + 0.361760176718235, + 0.07172805443406105, + 0.9495336972177029, + 0.5875517036765814, + 0.8090934306383133, + 1.6823350619524717, + 0.5736515019088984, + 0.9724070765078068, + 0.2605424243956804, + 0.3272121772170067, + 0.0, + 0.2783573493361473, + 0.8821563366800547 + ], + "unique_experts": 60, + "load_cv": 0.8980947093914455, + "normalized_load_entropy": 0.9127991550503247, + "max_load_share": 0.08018867924528301 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "30086c91bbf25cfaf8f0d8863c5b7f23c62c0cec38adb7822fd11a6160798168", + "route_weight_sha256": "8c428429d047b1e29dc888166d670c1d97ff0c864ebd86d4703bcff52b37bf50", + "loads": [ + 2, + 14, + 7, + 6, + 6, + 23, + 25, + 12, + 23, + 20, + 27, + 3, + 13, + 26, + 7, + 4, + 0, + 1, + 5, + 8, + 13, + 20, + 11, + 3, + 14, + 25, + 0, + 9, + 10, + 19, + 51, + 11, + 6, + 13, + 11, + 13, + 1, + 5, + 13, + 20, + 3, + 4, + 10, + 3, + 8, + 7, + 3, + 8, + 22, + 14, + 11, + 12, + 6, + 16, + 10, + 14, + 27, + 15, + 28, + 8, + 9, + 16, + 8, + 24 + ], + "weighted_loads": [ + 0.08257696032524109, + 0.6478064991533756, + 0.21708671562373638, + 0.2073021661490202, + 0.4163597300648689, + 1.1991087164497003, + 1.2075069844722748, + 0.4822891615331173, + 2.0989782363176346, + 1.1133928522467613, + 1.8234498135279864, + 0.27293800190091133, + 0.993870496051386, + 1.3157745134085417, + 0.25787058658897877, + 0.13305787928402424, + 0.0, + 0.05061676725745201, + 0.1761628407984972, + 0.24224630184471607, + 0.5975287444889545, + 0.9327712822705507, + 0.7764918431639671, + 0.11615752056241035, + 0.5244250227697194, + 1.0978175438940525, + 0.0, + 0.3720179330557585, + 0.3834720868617296, + 0.9994029607623816, + 4.139115002937615, + 0.35918780602514744, + 0.40456121787428856, + 0.8276967033743858, + 0.33236057683825493, + 0.8289247266948223, + 0.09627477079629898, + 1.0082705058157444, + 0.4221804831176996, + 0.9462918341159821, + 0.28307514265179634, + 0.19172140583395958, + 0.32370568066835403, + 0.1694968417286873, + 0.31841290555894375, + 0.4616746958345175, + 0.1343955285847187, + 0.5139949916629121, + 1.870750728994608, + 1.1849854066967964, + 0.45445895940065384, + 0.9119088836014271, + 0.1558633092790842, + 1.1229069791734219, + 0.5875517036765814, + 0.8090934306383133, + 1.6823350619524717, + 0.5736515019088984, + 1.3207646049559116, + 0.2605424243956804, + 0.408884946256876, + 1.4480374106206, + 0.35726238426286727, + 1.8975844625383615 + ], + "unique_experts": 62, + "load_cv": 0.7296323964054258, + "normalized_load_entropy": 0.9388093259089458, + "max_load_share": 0.0648854961832061 + } + }, + "s1_period": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "662c7200613e821f3188699471ab0ded100b7142a7c920f257a7513fca7316c5", + "route_weight_sha256": "c24cde10478784a63e4816e3c348cc4070839824bcdbd61ca4a83bc82563ea53", + "loads": [ + 3, + 13, + 4, + 9, + 6, + 15, + 25, + 12, + 15, + 21, + 19, + 3, + 12, + 26, + 3, + 3, + 0, + 4, + 3, + 7, + 13, + 18, + 5, + 3, + 7, + 25, + 0, + 8, + 3, + 14, + 51, + 12, + 5, + 7, + 2, + 12, + 1, + 2, + 11, + 21, + 3, + 1, + 5, + 1, + 8, + 2, + 3, + 4, + 21, + 15, + 6, + 5, + 4, + 12, + 10, + 14, + 27, + 11, + 18, + 9, + 7, + 1, + 5, + 21 + ], + "weighted_loads": [ + 0.11581508815288544, + 0.6181940082460642, + 0.12324302643537521, + 0.3022449053823948, + 0.41201433166861534, + 0.8377070110291243, + 1.1661463864147663, + 0.4398889448493719, + 1.701953910291195, + 1.139643419533968, + 1.4479512311518192, + 0.2628418058156967, + 1.0170642510056496, + 1.3211530055850744, + 0.1219918318092823, + 0.10469798743724823, + 0.0, + 0.1529269814491272, + 0.10874214395880699, + 0.21881199441850185, + 0.5872001927345991, + 0.8670947197824717, + 0.20047068782150745, + 0.11721891537308693, + 0.2446225117892027, + 1.0818618442863226, + 0.0, + 0.33406485617160797, + 0.10792082734405994, + 0.7770142871886492, + 4.0557201355695724, + 0.3709075041115284, + 0.3732827417552471, + 0.581877339631319, + 0.04571632482111454, + 0.7701271586120129, + 0.03272818773984909, + 0.07280337810516357, + 0.36192226223647594, + 0.9689091183245182, + 0.27403921633958817, + 0.025295164436101913, + 0.18309667520225048, + 0.03513478487730026, + 0.3293223846703768, + 0.1877819150686264, + 0.13517561927437782, + 0.1353741679340601, + 1.858200328424573, + 1.202841131016612, + 0.19637452065944672, + 0.3902365230023861, + 0.10139021091163158, + 0.9319121763110161, + 0.5699378419667482, + 0.831144668161869, + 1.7095417845994234, + 0.4454935919493437, + 0.9734462071210146, + 0.30372102186083794, + 0.3198771681636572, + 0.0352448970079422, + 0.26690239645540714, + 0.8675693925470114 + ], + "unique_experts": 62, + "load_cv": 0.8911974097071355, + "normalized_load_entropy": 0.9157633056716474, + "max_load_share": 0.08018867924528301 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "0467aa37cd6d6156104a7dbdade2e134b554b1cb21955d8154b50ca3498f7cf0", + "route_weight_sha256": "01fd5264eeed5eee389f19bb98af20ceb239910fb54c15e1ff343acf7f1f6526", + "loads": [ + 3, + 14, + 5, + 10, + 8, + 26, + 25, + 13, + 24, + 24, + 26, + 5, + 15, + 26, + 6, + 3, + 1, + 4, + 4, + 11, + 17, + 18, + 16, + 4, + 16, + 25, + 0, + 8, + 25, + 19, + 51, + 15, + 5, + 13, + 9, + 14, + 8, + 6, + 12, + 21, + 4, + 10, + 8, + 5, + 9, + 5, + 3, + 11, + 21, + 15, + 12, + 20, + 10, + 18, + 12, + 16, + 27, + 11, + 33, + 9, + 12, + 21, + 11, + 24 + ], + "weighted_loads": [ + 0.11581508815288544, + 0.6527758967131376, + 0.14875094592571259, + 0.41706300154328346, + 0.4733067452907562, + 1.2720714438473806, + 1.1661463864147663, + 0.47732862643897533, + 2.329592779278755, + 1.2702185921370983, + 1.7543716772925109, + 0.32996001839637756, + 1.0787242671940476, + 1.3211530055850744, + 0.22816874273121357, + 0.10469798743724823, + 0.028864020481705666, + 0.1529269814491272, + 0.14070961624383926, + 0.35878964327275753, + 0.7694209571927786, + 0.8670947197824717, + 1.0230322126299143, + 0.14238596707582474, + 0.5635238704271615, + 1.0818618442863226, + 0.0, + 0.33406485617160797, + 1.1973527055233717, + 0.9965478368103504, + 4.0557201355695724, + 0.5101507641375065, + 0.3732827417552471, + 0.8970387876033783, + 0.27580454433336854, + 0.8705416359007359, + 0.5582198910415173, + 1.0547745153307915, + 0.4006484169512987, + 0.9689091183245182, + 0.38790412992239, + 0.5390029605478048, + 0.25710833072662354, + 0.35789068043231964, + 0.3689464461058378, + 0.4208504445850849, + 0.13517561927437782, + 0.668912377092056, + 1.858200328424573, + 1.202841131016612, + 0.47595956176519394, + 1.439264502376318, + 0.27467901073396206, + 1.2976653650403023, + 0.7446131985634565, + 0.9291993789374828, + 1.7095417845994234, + 0.4454935919493437, + 1.6288129072636366, + 0.30372102186083794, + 0.4946935623884201, + 2.011673388071358, + 0.6150694285752252, + 1.9273875262588263 + ], + "unique_experts": 63, + "load_cv": 0.6563871907327573, + "normalized_load_entropy": 0.949716220442797, + "max_load_share": 0.05782312925170068 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 106, + "ordered_topk_exact_tokens": 63, + "set_exact_tokens": 75, + "mean_set_jaccard": 0.9128481581311769, + "mean_token_weighted_tv": 0.013505362475044885, + "aggregate_load_tv": 0.031446540880503145 + }, + "system_bos": { + "tokens": 106, + "ordered_topk_exact_tokens": 51, + "set_exact_tokens": 71, + "mean_set_jaccard": 0.9036388140161725, + "mean_token_weighted_tv": 0.015307431702308779, + "aggregate_load_tv": 0.04402515723270441 + }, + "system_x": { + "tokens": 106, + "ordered_topk_exact_tokens": 53, + "set_exact_tokens": 71, + "mean_set_jaccard": 0.9036388140161725, + "mean_token_weighted_tv": 0.01688763434682393, + "aggregate_load_tv": 0.04245283018867924 + }, + "system_period": { + "tokens": 106, + "ordered_topk_exact_tokens": 54, + "set_exact_tokens": 70, + "mean_set_jaccard": 0.9009433962264153, + "mean_token_weighted_tv": 0.017044738686274527, + "aggregate_load_tv": 0.040880503144654086 + }, + "bos_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 53, + "set_exact_tokens": 71, + "mean_set_jaccard": 0.9036388140161724, + "mean_token_weighted_tv": 0.016086232668351172, + "aggregate_load_tv": 0.03616352201257861 + }, + "bos_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 53, + "set_exact_tokens": 69, + "mean_set_jaccard": 0.9002695417789759, + "mean_token_weighted_tv": 0.016856778949007112, + "aggregate_load_tv": 0.04402515723270441 + }, + "x_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 47, + "set_exact_tokens": 65, + "mean_set_jaccard": 0.885893980233603, + "mean_token_weighted_tv": 0.01853765624153586, + "aggregate_load_tv": 0.037735849056603765 + }, + "x_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 43, + "set_exact_tokens": 63, + "mean_set_jaccard": 0.8760107816711591, + "mean_token_weighted_tv": 0.02146605586738519, + "aggregate_load_tv": 0.03930817610062892 + }, + "period_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 50, + "set_exact_tokens": 64, + "mean_set_jaccard": 0.8831985624438454, + "mean_token_weighted_tv": 0.018534418621610076, + "aggregate_load_tv": 0.02987421383647798 + }, + "period_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 49, + "set_exact_tokens": 63, + "mean_set_jaccard": 0.8780323450134772, + "mean_token_weighted_tv": 0.02065375306696262, + "aggregate_load_tv": 0.04874213836477987 + } + } + }, + "layer_25": { + "layer": 25, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "08502856ac45a921a044c58f6a99c791c6203b34815ede6ec7c28933745bd40f", + "route_weight_sha256": "d5730954efd33f5902299a1e6425705f32a7331c8a00e5f8d01f877cb0c4fd9d", + "loads": [ + 13, + 5, + 7, + 15, + 4, + 19, + 4, + 18, + 5, + 4, + 2, + 3, + 5, + 4, + 25, + 26, + 20, + 14, + 9, + 5, + 19, + 8, + 4, + 1, + 6, + 16, + 5, + 10, + 1, + 2, + 12, + 13, + 3, + 8, + 9, + 18, + 5, + 7, + 13, + 3, + 12, + 11, + 5, + 4, + 3, + 4, + 9, + 20, + 25, + 3, + 13, + 21, + 12, + 4, + 4, + 12, + 15, + 2, + 36, + 10, + 13, + 14, + 9, + 5 + ], + "weighted_loads": [ + 0.6120821759104729, + 0.40994483418762684, + 0.23900250904262066, + 0.7273005992174149, + 0.16001795791089535, + 1.299442745745182, + 0.2572642043232918, + 1.2196248453110456, + 0.175771189853549, + 0.15520013123750687, + 0.09829366952180862, + 0.1224689856171608, + 0.22556714713573456, + 0.13127460703253746, + 2.0299437437206507, + 0.9998490400612354, + 1.166745675727725, + 0.8622094169259071, + 0.4514722842723131, + 0.3192886933684349, + 1.0852257385849953, + 0.25951768830418587, + 0.16642729192972183, + 0.03199540078639984, + 0.29011951573193073, + 1.3313472159206867, + 0.15320043079555035, + 0.49995823577046394, + 0.08434732258319855, + 0.1005833949893713, + 0.6232142299413681, + 1.062998877838254, + 0.08834448270499706, + 0.2764428574591875, + 0.24449674971401691, + 1.5024751424789429, + 0.5581168010830879, + 0.27747150510549545, + 1.5178567692637444, + 0.7303248085081577, + 0.5546784084290266, + 0.47983788326382637, + 0.2255271039903164, + 0.12327747978270054, + 0.1888015829026699, + 0.3248411640524864, + 0.32285880483686924, + 1.4674171973019838, + 1.7926145661622286, + 0.10025337338447571, + 0.7683673202991486, + 1.29748310521245, + 1.3545661978423595, + 0.21671905554831028, + 0.14230073057115078, + 0.5959612522274256, + 0.5056404545903206, + 0.07793906331062317, + 1.903656430542469, + 0.3502559568732977, + 0.6982702668756247, + 1.2360477149486542, + 0.7110411524772644, + 0.16837383806705475 + ], + "unique_experts": 64, + "load_cv": 0.7271430369350493, + "normalized_load_entropy": 0.9405986189041178, + "max_load_share": 0.05660377358490566 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "547a7f2f6c9be8eb86425e348ebe694c7fbe45067cb7e2fdeeab83e18460a7b8", + "route_weight_sha256": "b1fc375d5ea4f0ebef0c5d6e7452e4632221e3da7949013460d6f4105cb229cd", + "loads": [ + 15, + 23, + 12, + 16, + 4, + 19, + 11, + 18, + 5, + 4, + 11, + 7, + 7, + 4, + 25, + 26, + 20, + 17, + 10, + 5, + 19, + 8, + 4, + 7, + 6, + 16, + 5, + 10, + 2, + 7, + 12, + 14, + 5, + 10, + 11, + 18, + 5, + 8, + 25, + 5, + 19, + 12, + 5, + 6, + 8, + 14, + 12, + 20, + 25, + 3, + 23, + 21, + 18, + 4, + 13, + 12, + 16, + 4, + 36, + 10, + 15, + 14, + 15, + 5 + ], + "weighted_loads": [ + 0.7176449224352837, + 1.8588785594329238, + 0.5369763728231192, + 0.7860293090343475, + 0.16001795791089535, + 1.299442745745182, + 0.71849475055933, + 1.2196248453110456, + 0.175771189853549, + 0.15520013123750687, + 1.0458512976765633, + 0.81335294758901, + 0.5181074738502502, + 0.13127460703253746, + 2.0299437437206507, + 0.9998490400612354, + 1.166745675727725, + 0.9609044566750526, + 0.4777167495340109, + 0.3192886933684349, + 1.0852257385849953, + 0.25951768830418587, + 0.16642729192972183, + 0.29169759526848793, + 0.29011951573193073, + 1.3313472159206867, + 0.15320043079555035, + 0.49995823577046394, + 0.12544658407568932, + 0.2793259993195534, + 0.6232142299413681, + 1.1600067559629679, + 0.28981935046613216, + 0.38303241319954395, + 0.3303940277546644, + 1.5024751424789429, + 0.5581168010830879, + 0.3485705107450485, + 3.051146889105439, + 0.930526364594698, + 0.8366395756602287, + 0.5222136862576008, + 0.2255271039903164, + 0.19403704814612865, + 0.6113437637686729, + 1.1880362164229155, + 0.414171043317765, + 1.4674171973019838, + 1.7926145661622286, + 0.10025337338447571, + 1.3749786391854286, + 1.29748310521245, + 1.66431180620566, + 0.21671905554831028, + 0.5992036480456591, + 0.5959612522274256, + 0.575110673904419, + 0.14861373230814934, + 1.903656430542469, + 0.3502559568732977, + 0.7949926387518644, + 1.2360477149486542, + 1.1568758133798838, + 0.16837383806705475 + ], + "unique_experts": 64, + "load_cv": 0.5837074700414017, + "normalized_load_entropy": 0.9597583577774208, + "max_load_share": 0.04580152671755725 + } + }, + "s1_eos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "3d4ed338df973f678a024f9d3843fcb75321a0b64750e6f89aae78102a2f8dbd", + "route_weight_sha256": "c12bc8a81c4affbd5c0403d06d2d7f4ff05bd59833d462f968d8cd7ba4e52dfd", + "loads": [ + 14, + 5, + 7, + 14, + 4, + 18, + 4, + 17, + 6, + 3, + 3, + 2, + 5, + 3, + 25, + 31, + 18, + 15, + 9, + 5, + 20, + 8, + 4, + 3, + 6, + 16, + 5, + 10, + 1, + 1, + 12, + 12, + 4, + 6, + 9, + 18, + 5, + 7, + 12, + 3, + 9, + 11, + 5, + 3, + 3, + 4, + 10, + 22, + 25, + 4, + 13, + 21, + 13, + 4, + 4, + 11, + 12, + 2, + 37, + 11, + 13, + 14, + 9, + 6 + ], + "weighted_loads": [ + 0.639429360628128, + 0.4089179988950491, + 0.2403968684375286, + 0.6959938108921051, + 0.162962069734931, + 1.2715580072253942, + 0.2550036758184433, + 1.1673679184168577, + 0.19719355180859566, + 0.10551320761442184, + 0.13288320414721966, + 0.09403696283698082, + 0.22761430218815804, + 0.09558623656630516, + 2.0483450908213854, + 1.1610429007560015, + 1.1077989153563976, + 0.8560534790158272, + 0.46039247140288353, + 0.32309047505259514, + 1.1132822018116713, + 0.25807869620621204, + 0.16446064412593842, + 0.10756631940603256, + 0.28846945986151695, + 1.3517530523240566, + 0.1553075946867466, + 0.49961914867162704, + 0.0830266922712326, + 0.07230031490325928, + 0.6399180684238672, + 1.066386889666319, + 0.12206132896244526, + 0.20722244307398796, + 0.252429710701108, + 1.486911129206419, + 0.5649891011416912, + 0.2822628915309906, + 1.4744171425700188, + 0.7174752727150917, + 0.4527278132736683, + 0.49621877260506153, + 0.22096048295497894, + 0.09190934896469116, + 0.18807825073599815, + 0.3278323858976364, + 0.34728620760142803, + 1.5672987159341574, + 1.7759782392531633, + 0.13457678444683552, + 0.7749405056238174, + 1.2918617874383926, + 1.389824340119958, + 0.21763204596936703, + 0.14100019074976444, + 0.5769595764577389, + 0.41910175047814846, + 0.07194001041352749, + 1.9274916667491198, + 0.378611559048295, + 0.7014836650341749, + 1.2513622902333736, + 0.7115219980478287, + 0.1972903087735176 + ], + "unique_experts": 64, + "load_cv": 0.7485862101523775, + "normalized_load_entropy": 0.9389713060276051, + "max_load_share": 0.05817610062893082 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "e2e229f809f96a9007f4578586f9994024dd6e4159beebda65ad46acbf3196d7", + "route_weight_sha256": "c2374fb9fd696d33776b02887c6c3d14c1e350d4e51e02f4134fdc6eff6ca9b5", + "loads": [ + 17, + 29, + 15, + 15, + 4, + 19, + 11, + 17, + 8, + 4, + 25, + 6, + 10, + 3, + 25, + 31, + 18, + 23, + 10, + 6, + 23, + 15, + 4, + 12, + 6, + 16, + 6, + 10, + 2, + 7, + 12, + 15, + 10, + 6, + 11, + 18, + 6, + 14, + 23, + 7, + 16, + 12, + 6, + 4, + 12, + 18, + 13, + 22, + 25, + 5, + 25, + 21, + 21, + 10, + 17, + 12, + 15, + 5, + 37, + 12, + 17, + 15, + 14, + 9 + ], + "weighted_loads": [ + 0.8979623317718506, + 2.400036240927875, + 0.6407473888248205, + 0.7700270116329193, + 0.162962069734931, + 1.3093592505902052, + 0.859914168715477, + 1.1673679184168577, + 0.31211667880415916, + 0.1340617910027504, + 2.0880297403782606, + 0.8517985418438911, + 0.6811954379081726, + 0.09558623656630516, + 2.0483450908213854, + 1.1610429007560015, + 1.1077989153563976, + 1.5017050504684448, + 0.5121401697397232, + 0.3467461410909891, + 1.3705246951431036, + 0.9010304473340511, + 0.16446064412593842, + 0.4560701549053192, + 0.28846945986151695, + 1.3517530523240566, + 0.1885077990591526, + 0.49961914867162704, + 0.12862134724855423, + 0.30028451420366764, + 0.6399180684238672, + 1.5328869484364986, + 0.4629280250519514, + 0.20722244307398796, + 0.3495402168482542, + 1.486911129206419, + 0.6091265492141247, + 0.6329012457281351, + 3.2284540086984634, + 1.0987639240920544, + 0.7702968008816242, + 0.5216946229338646, + 0.3077094107866287, + 0.12218562886118889, + 0.9028452672064304, + 1.640027454122901, + 0.4393456826219335, + 1.5672987159341574, + 1.7759782392531633, + 0.18369814567267895, + 1.5046975668519735, + 1.2918617874383926, + 1.864731484092772, + 0.6908398102968931, + 0.9943563211709261, + 0.6032390370965004, + 0.5646494012326002, + 0.183984212577343, + 1.9274916667491198, + 0.46533470042049885, + 0.9394693803042173, + 1.2943799830973148, + 1.1451252456754446, + 0.2970155980437994 + ], + "unique_experts": 64, + "load_cv": 0.5448928163060354, + "normalized_load_entropy": 0.9642627478939267, + "max_load_share": 0.04195011337868481 + } + }, + "s0_bos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "39a7eefa4d3b63f78fb2c75713b99a1fdfe03e80ae133a3d8903446919c2e7cc", + "route_weight_sha256": "b2db5c6f868ab8d2c30419096d93be075634770e4dd75ec0c9d2877d678cb340", + "loads": [ + 14, + 5, + 6, + 15, + 4, + 20, + 4, + 18, + 5, + 4, + 2, + 5, + 5, + 3, + 25, + 24, + 19, + 14, + 9, + 5, + 20, + 8, + 4, + 2, + 6, + 15, + 5, + 10, + 1, + 1, + 12, + 12, + 3, + 6, + 7, + 18, + 6, + 9, + 13, + 4, + 12, + 12, + 5, + 2, + 3, + 4, + 10, + 22, + 25, + 4, + 14, + 22, + 13, + 3, + 4, + 12, + 10, + 2, + 35, + 11, + 15, + 14, + 9, + 5 + ], + "weighted_loads": [ + 0.6534525472670794, + 0.425979670137167, + 0.20686771161854267, + 0.7323553524911404, + 0.1532075572758913, + 1.3589180670678616, + 0.247385049238801, + 1.2406028341501951, + 0.16727379150688648, + 0.13923608511686325, + 0.09203245863318443, + 0.16710404679179192, + 0.2261359579861164, + 0.08902222290635109, + 2.0603879038244486, + 0.9276839140802622, + 1.1379851512610912, + 0.8597220107913017, + 0.46439865976572037, + 0.3225242756307125, + 1.1286158673465252, + 0.2582556791603565, + 0.16076268255710602, + 0.06077997758984566, + 0.30003662779927254, + 1.314371731132269, + 0.15697402134537697, + 0.5065793618559837, + 0.08015383780002594, + 0.0687231495976448, + 0.6445805300027132, + 1.063982181251049, + 0.09082606062293053, + 0.20709598436951637, + 0.202199874445796, + 1.5010056644678116, + 0.5907944831997156, + 0.3335664812475443, + 1.49654133990407, + 0.7273866403847933, + 0.5782719179987907, + 0.5378142185509205, + 0.22914185374975204, + 0.0633209366351366, + 0.19392095878720284, + 0.32807815447449684, + 0.3450818080455065, + 1.5372121315449476, + 1.775368805974722, + 0.1418189462274313, + 0.8154427725821733, + 1.335045948624611, + 1.3950819093734026, + 0.19129648432135582, + 0.14523464441299438, + 0.6135180164128542, + 0.36672905646264553, + 0.06980745308101177, + 1.8754612412303686, + 0.37369409389793873, + 0.7379527352750301, + 1.2675549574196339, + 0.7071134895086288, + 0.1709223110228777 + ], + "unique_experts": 64, + "load_cv": 0.7256182838879023, + "normalized_load_entropy": 0.9402774495597133, + "max_load_share": 0.055031446540880505 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "46c1e27673f06198a3f28e10a1d538d802e91ba7ebaf803de7f2bd54f2a80400", + "route_weight_sha256": "d4656fdab4c138793469bd76f5ba31c4f331e48f3936382642e1fa049b7f5637", + "loads": [ + 15, + 23, + 12, + 16, + 4, + 20, + 11, + 19, + 6, + 4, + 12, + 8, + 8, + 3, + 25, + 24, + 19, + 17, + 10, + 5, + 20, + 8, + 4, + 8, + 6, + 15, + 5, + 10, + 2, + 5, + 13, + 13, + 5, + 7, + 9, + 18, + 6, + 10, + 24, + 5, + 19, + 14, + 5, + 4, + 8, + 13, + 12, + 22, + 25, + 5, + 24, + 22, + 18, + 3, + 14, + 12, + 11, + 5, + 35, + 11, + 16, + 14, + 15, + 5 + ], + "weighted_loads": [ + 0.707193786278367, + 1.8378971153870225, + 0.6194097604602575, + 0.8641936592757702, + 0.1532075572758913, + 1.3589180670678616, + 0.7081150691956282, + 1.2925153877586126, + 0.22371130995452404, + 0.13923608511686325, + 1.1528347544372082, + 0.8769127912819386, + 0.5942571125924587, + 0.08902222290635109, + 2.0603879038244486, + 0.9276839140802622, + 1.1379851512610912, + 0.9584170505404472, + 0.49064312502741814, + 0.3225242756307125, + 1.1286158673465252, + 0.2582556791603565, + 0.16076268255710602, + 0.3102871384471655, + 0.30003662779927254, + 1.314371731132269, + 0.15697402134537697, + 0.5065793618559837, + 0.12125309929251671, + 0.21054429933428764, + 0.8718091417104006, + 1.160990059375763, + 0.2786187417805195, + 0.2660347633063793, + 0.3031932171434164, + 1.5010056644678116, + 0.5907944831997156, + 0.40138659067451954, + 2.112283458933234, + 0.8823801297694445, + 0.8602330852299929, + 0.6252077966928482, + 0.22914185374975204, + 0.13256158493459225, + 0.6192038953304291, + 1.1480424515902996, + 0.43506566993892193, + 1.5372121315449476, + 1.775368805974722, + 0.18513883836567402, + 1.4220540914684534, + 1.335045948624611, + 1.6991722416132689, + 0.19129648432135582, + 0.6603842601180077, + 0.6135180164128542, + 0.4340257626026869, + 0.1851638425141573, + 1.8754612412303686, + 0.37369409389793873, + 0.7913895212113857, + 1.2675549574196339, + 1.1529481504112482, + 0.1709223110228777 + ], + "unique_experts": 64, + "load_cv": 0.5808609131705621, + "normalized_load_entropy": 0.9598612850784619, + "max_load_share": 0.044529262086514 + } + }, + "s1_bos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "e56c0843a6febd8b9ed2b5c7943db076092afec996c3f40427a2938ff071697d", + "route_weight_sha256": "10286430294284d6219477a8692d7e50db04bbc1e95c3ee54cf25e7b04d1dd8a", + "loads": [ + 14, + 5, + 7, + 18, + 5, + 19, + 4, + 18, + 6, + 1, + 3, + 4, + 5, + 3, + 24, + 26, + 18, + 14, + 10, + 4, + 19, + 9, + 5, + 3, + 5, + 16, + 5, + 10, + 1, + 1, + 13, + 12, + 3, + 7, + 7, + 18, + 6, + 8, + 13, + 4, + 12, + 11, + 5, + 2, + 3, + 4, + 8, + 22, + 26, + 2, + 14, + 22, + 12, + 3, + 4, + 12, + 12, + 2, + 35, + 9, + 13, + 15, + 9, + 6 + ], + "weighted_loads": [ + 0.6488940641283989, + 0.4229255560785532, + 0.24662361666560173, + 0.8224338460713625, + 0.20574322901666164, + 1.328097440302372, + 0.22722508385777473, + 1.2017730586230755, + 0.20021973550319672, + 0.03508699685335159, + 0.12691366113722324, + 0.14622855558991432, + 0.22282897867262363, + 0.08793492987751961, + 1.999707281589508, + 1.0075274761766195, + 1.1035546250641346, + 0.8571745790541172, + 0.5046993438154459, + 0.27920839190483093, + 1.1011197194457054, + 0.2914354782551527, + 0.19653845578432083, + 0.11216909065842628, + 0.25518988259136677, + 1.3109839111566544, + 0.15942863747477531, + 0.5074382349848747, + 0.0810927301645279, + 0.07129945605993271, + 0.6777687147259712, + 1.0729801505804062, + 0.08885837346315384, + 0.23832127451896667, + 0.2043730542063713, + 1.5049410741776228, + 0.5975111983716488, + 0.3276763781905174, + 1.4901809990406036, + 0.7194262687116861, + 0.5551776811480522, + 0.49918464571237564, + 0.22578531503677368, + 0.0663509014993906, + 0.18132970482110977, + 0.32008009031414986, + 0.28069197945296764, + 1.5392373725771904, + 1.7642485406249762, + 0.08954031765460968, + 0.8165629878640175, + 1.3078774362802505, + 1.3432904817163944, + 0.1926928460597992, + 0.13428926467895508, + 0.6024582032114267, + 0.42880640737712383, + 0.06992986798286438, + 1.872279666364193, + 0.3201516605913639, + 0.6873400490731001, + 1.2588903345167637, + 0.7099761180579662, + 0.20760851725935936 + ], + "unique_experts": 64, + "load_cv": 0.7336418005561558, + "normalized_load_entropy": 0.9386393646774476, + "max_load_share": 0.055031446540880505 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "587d1d6e883c03c515e42895c3d6ccdced9af2fb88421e5161e8ce43b852c19c", + "route_weight_sha256": "b651aeed9574360006b54aa9a0a8f328875a3e75dc65a88bef6ce7f6b81b637b", + "loads": [ + 16, + 30, + 16, + 19, + 5, + 20, + 11, + 18, + 10, + 2, + 26, + 7, + 12, + 3, + 24, + 26, + 18, + 22, + 11, + 5, + 22, + 16, + 5, + 12, + 5, + 16, + 6, + 10, + 2, + 6, + 13, + 15, + 10, + 7, + 10, + 18, + 7, + 15, + 23, + 7, + 19, + 11, + 6, + 3, + 12, + 18, + 9, + 22, + 26, + 4, + 26, + 22, + 19, + 9, + 17, + 13, + 15, + 5, + 35, + 10, + 16, + 16, + 14, + 9 + ], + "weighted_loads": [ + 0.8465522862970829, + 2.3919032653793693, + 0.7601640578359365, + 0.8724150005728006, + 0.20574322901666164, + 1.365898683667183, + 0.8302656374871731, + 1.2017730586230755, + 0.3985966332256794, + 0.06363558024168015, + 2.240397648885846, + 0.8907910771667957, + 0.7842930741608143, + 0.08793492987751961, + 1.999707281589508, + 1.0075274761766195, + 1.1035546250641346, + 1.5028261505067348, + 0.5564470421522856, + 0.3028640579432249, + 1.3583622127771378, + 0.9343872293829918, + 0.19653845578432083, + 0.45804097689688206, + 0.25518988259136677, + 1.3109839111566544, + 0.19262884184718132, + 0.5074382349848747, + 0.12668738514184952, + 0.26301993429660797, + 0.6777687147259712, + 1.539480209350586, + 0.5005156546831131, + 0.23832127451896667, + 0.35592493787407875, + 1.5049410741776228, + 0.6416486464440823, + 0.6799534726887941, + 2.34248036891222, + 1.0489580910652876, + 0.8727466687560081, + 0.49918464571237564, + 0.31253424286842346, + 0.09662718139588833, + 0.8826137855648994, + 1.5847697407007217, + 0.3223734814673662, + 1.5392373725771904, + 1.7642485406249762, + 0.1824655570089817, + 1.5463200490921736, + 1.3078774362802505, + 1.8164909891784191, + 0.6659006103873253, + 0.9832821786403656, + 0.6287376638501883, + 0.5908805709332228, + 0.20307746529579163, + 1.872279666364193, + 0.40687480196356773, + 0.8630334790796041, + 1.3019080273807049, + 1.1435793656855822, + 0.2987628970295191 + ], + "unique_experts": 64, + "load_cv": 0.5394299986498908, + "normalized_load_entropy": 0.9638597282319784, + "max_load_share": 0.03968253968253968 + } + }, + "s0_x": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "0d60d4165d016809036c1e1a7cc14c407be67394e1748048bbb2fe40d5f89565", + "route_weight_sha256": "ca475ffb7eceacc0f86209a0b78e328059385f0f22ecc6f801c93e6230a5637d", + "loads": [ + 15, + 4, + 6, + 15, + 5, + 18, + 4, + 16, + 6, + 6, + 2, + 5, + 5, + 4, + 25, + 27, + 19, + 14, + 10, + 4, + 19, + 7, + 4, + 3, + 7, + 16, + 4, + 10, + 1, + 1, + 13, + 12, + 3, + 8, + 6, + 18, + 6, + 9, + 14, + 4, + 12, + 11, + 5, + 2, + 3, + 5, + 9, + 21, + 24, + 2, + 13, + 21, + 11, + 3, + 5, + 12, + 11, + 3, + 35, + 11, + 12, + 14, + 9, + 7 + ], + "weighted_loads": [ + 0.665207838639617, + 0.39648938924074173, + 0.19886824116110802, + 0.7277961056679487, + 0.17882956750690937, + 1.2601729314774275, + 0.23676512204110622, + 1.1245022919028997, + 0.19645976833999157, + 0.20406866259872913, + 0.09847728908061981, + 0.17035521008074284, + 0.2181453239172697, + 0.13035505078732967, + 2.003734242171049, + 1.030549669638276, + 1.1312312576919794, + 0.8909928351640701, + 0.5075017213821411, + 0.28691691160202026, + 1.071909599006176, + 0.22723443433642387, + 0.1603233553469181, + 0.1058447640389204, + 0.33141715079545975, + 1.3163039106875658, + 0.13113690540194511, + 0.5027616359293461, + 0.08261328190565109, + 0.07066255807876587, + 0.6591825503855944, + 1.0463153086602688, + 0.08920018747448921, + 0.2771165072917938, + 0.16973265632987022, + 1.4958904795348644, + 0.5886680036783218, + 0.3311465661972761, + 1.542982092127204, + 0.7004042435437441, + 0.5836094580590725, + 0.4826528951525688, + 0.2233818918466568, + 0.0644722431898117, + 0.18922699615359306, + 0.3592391423881054, + 0.3170829005539417, + 1.459697637706995, + 1.7336164563894272, + 0.05688553489744663, + 0.7749661467969418, + 1.2883004546165466, + 1.3176726624369621, + 0.18898789957165718, + 0.1606860626488924, + 0.6043721847236156, + 0.39407142624258995, + 0.11143439449369907, + 1.86540262773633, + 0.3804751802235842, + 0.6558024547994137, + 1.2416978757828474, + 0.7077678889036179, + 0.23572473227977753 + ], + "unique_experts": 64, + "load_cv": 0.7104134814205563, + "normalized_load_entropy": 0.9432266549078164, + "max_load_share": 0.055031446540880505 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "497052780f9297a676fb8b3b4f1539c36e57c62efe473ab48912057a129710bb", + "route_weight_sha256": "ce053da88a6de4e2d5d24e3a895c33b6acbba97976b355cce02340f52372d1d4", + "loads": [ + 17, + 23, + 9, + 16, + 5, + 18, + 13, + 16, + 6, + 6, + 11, + 8, + 8, + 4, + 25, + 27, + 19, + 17, + 12, + 4, + 19, + 7, + 4, + 9, + 7, + 16, + 4, + 10, + 2, + 4, + 13, + 14, + 5, + 9, + 7, + 18, + 6, + 10, + 26, + 5, + 20, + 12, + 5, + 3, + 9, + 14, + 12, + 21, + 25, + 2, + 23, + 21, + 17, + 3, + 15, + 12, + 12, + 5, + 35, + 11, + 13, + 14, + 16, + 7 + ], + "weighted_loads": [ + 0.7563148122280836, + 1.9339575851336122, + 0.42958954721689224, + 0.7640089262276888, + 0.17882956750690937, + 1.2601729314774275, + 0.8228230457752943, + 1.1245022919028997, + 0.19645976833999157, + 0.20406866259872913, + 1.0852965414524078, + 0.8377006966620684, + 0.5108866039663553, + 0.13035505078732967, + 2.003734242171049, + 1.030549669638276, + 1.1312312576919794, + 0.9896878749132156, + 0.5610965359956026, + 0.28691691160202026, + 1.071909599006176, + 0.22723443433642387, + 0.1603233553469181, + 0.3678533397614956, + 0.33141715079545975, + 1.3163039106875658, + 0.13113690540194511, + 0.5027616359293461, + 0.12371254339814186, + 0.1717273537069559, + 0.6591825503855944, + 1.234972182661295, + 0.26186853274703026, + 0.33605528622865677, + 0.2236509881913662, + 1.4958904795348644, + 0.5886680036783218, + 0.4174311887472868, + 2.2960554733872414, + 0.8553977329283953, + 0.9117488171905279, + 0.5236909873783588, + 0.2233818918466568, + 0.09715244174003601, + 0.6753040738403797, + 1.2309114895761013, + 0.45892851427197456, + 1.459697637706995, + 1.775636002421379, + 0.05688553489744663, + 1.3815774656832218, + 1.2883004546165466, + 1.7530740089714527, + 0.18898789957165718, + 0.6973874475806952, + 0.6043721847236156, + 0.4505072236061096, + 0.1747786607593298, + 1.86540262773633, + 0.3804751802235842, + 0.7092392407357693, + 1.2416978757828474, + 1.1918928269296885, + 0.23572473227977753 + ], + "unique_experts": 64, + "load_cv": 0.5844169428715534, + "normalized_load_entropy": 0.9591724422997527, + "max_load_share": 0.044529262086514 + } + }, + "s1_x": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "c2fb74a24c50d17d4373bc60e5c19514e9dd4e3c4ccff3b9b1311fc346a86a18", + "route_weight_sha256": "7b5d1592e38c2c73a74107fd9fcfb3d9e0c2acebf6e71e30610401e9280f678b", + "loads": [ + 12, + 5, + 6, + 16, + 5, + 18, + 4, + 18, + 5, + 8, + 3, + 2, + 5, + 2, + 23, + 30, + 19, + 14, + 10, + 4, + 20, + 10, + 5, + 3, + 5, + 15, + 5, + 10, + 1, + 1, + 13, + 12, + 3, + 8, + 7, + 18, + 5, + 8, + 13, + 4, + 12, + 11, + 4, + 2, + 3, + 5, + 9, + 20, + 21, + 3, + 14, + 21, + 12, + 3, + 4, + 11, + 13, + 4, + 36, + 9, + 12, + 15, + 9, + 8 + ], + "weighted_loads": [ + 0.5468298811465502, + 0.42666687071323395, + 0.20835017040371895, + 0.7529845144599676, + 0.20691503025591373, + 1.2485287878662348, + 0.24848182499408722, + 1.1965445932000875, + 0.17513225972652435, + 0.2592996172606945, + 0.14780277386307716, + 0.08659957721829414, + 0.22951075434684753, + 0.05459749139845371, + 1.9120386727154255, + 1.131468715146184, + 1.1223620064556599, + 0.89659608528018, + 0.47373083606362343, + 0.2724737524986267, + 1.1006025616079569, + 0.32623869366943836, + 0.19398433342576027, + 0.10399402678012848, + 0.23992085084319115, + 1.2550460752099752, + 0.1555379331111908, + 0.49452585726976395, + 0.08492665737867355, + 0.06605667620897293, + 0.6732405927032232, + 1.048170294612646, + 0.09254415147006512, + 0.27162064239382744, + 0.19763647206127644, + 1.4951079487800598, + 0.5411335062235594, + 0.29697092808783054, + 1.5316801443696022, + 0.6844159793108702, + 0.571483600884676, + 0.4778478555381298, + 0.17819883301854134, + 0.06024691089987755, + 0.16972539201378822, + 0.36676333099603653, + 0.30384767800569534, + 1.4326466005295515, + 1.5863294154405594, + 0.11880533210933208, + 0.8104133363813162, + 1.2690843790769577, + 1.3342062383890152, + 0.19000189006328583, + 0.1288770865648985, + 0.5475257281213999, + 0.4580631833523512, + 0.143528388813138, + 1.897234484553337, + 0.31788838095963, + 0.6608241535723209, + 1.2333015110343695, + 0.7085540033876896, + 0.2526266500353813 + ], + "unique_experts": 64, + "load_cv": 0.7181662939999242, + "normalized_load_entropy": 0.9422506214077511, + "max_load_share": 0.05660377358490566 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "0e5fe61addda92e29b054459cb11b859ec2de76fc57dff7c540faa76dbf14990", + "route_weight_sha256": "e87342a7b309c11c536ac765dedefb403cb133f760cf3648efc956b5f47a9cef", + "loads": [ + 14, + 30, + 14, + 17, + 5, + 19, + 13, + 18, + 7, + 9, + 25, + 5, + 12, + 2, + 23, + 30, + 19, + 23, + 11, + 5, + 23, + 17, + 5, + 12, + 5, + 15, + 6, + 10, + 2, + 3, + 14, + 16, + 9, + 8, + 9, + 18, + 6, + 14, + 24, + 7, + 19, + 11, + 5, + 3, + 13, + 19, + 10, + 20, + 21, + 4, + 28, + 21, + 21, + 9, + 18, + 12, + 15, + 7, + 36, + 10, + 15, + 16, + 14, + 11 + ], + "weighted_loads": [ + 0.7444881033152342, + 2.4466044092550874, + 0.599326066672802, + 0.8136292826384306, + 0.20691503025591373, + 1.2863300312310457, + 1.066735252737999, + 1.1965445932000875, + 0.29005538672208786, + 0.28784820064902306, + 2.184473689645529, + 0.8173093013465405, + 0.7327774297446012, + 0.05459749139845371, + 1.9120386727154255, + 1.131468715146184, + 1.1223620064556599, + 1.5903448201715946, + 0.5254785344004631, + 0.2961294185370207, + 1.3578450549393892, + 0.9691904447972775, + 0.19398433342576027, + 0.4544928576797247, + 0.23992085084319115, + 1.2550460752099752, + 0.1887381374835968, + 0.49452585726976395, + 0.13052131235599518, + 0.1357838176190853, + 0.7065608706325293, + 1.6236548908054829, + 0.39809259213507175, + 0.27162064239382744, + 0.30064977891743183, + 1.4951079487800598, + 0.5852709542959929, + 0.6012856811285019, + 2.4677335135638714, + 1.0139478016644716, + 0.8890525884926319, + 0.4778478555381298, + 0.2649477608501911, + 0.09052319079637527, + 0.9020858537405729, + 1.6778667643666267, + 0.3455291800200939, + 1.4326466005295515, + 1.5863294154405594, + 0.16792669333517551, + 1.6828926466405392, + 1.2690843790769577, + 1.9842950999736786, + 0.6632096543908119, + 1.0863502081483603, + 0.5738051887601614, + 0.5381075944751501, + 0.25199178978800774, + 1.897234484553337, + 0.40461152233183384, + 0.836517583578825, + 1.2763192038983107, + 1.1421572510153055, + 0.34824311919510365 + ], + "unique_experts": 64, + "load_cv": 0.546400573033655, + "normalized_load_entropy": 0.9633088117216038, + "max_load_share": 0.04081632653061224 + } + }, + "s0_period": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "73e7e4ed4951de9e7a181b4a274f0114354d6cc8944fa64912690399c55afb53", + "route_weight_sha256": "fad4b4d6668d56ced0caa188b71a9d44470e2e6bcc851a678c8e448834d6ec03", + "loads": [ + 14, + 4, + 7, + 15, + 4, + 19, + 4, + 17, + 7, + 5, + 2, + 4, + 5, + 4, + 26, + 29, + 19, + 14, + 10, + 4, + 20, + 7, + 4, + 3, + 5, + 17, + 5, + 10, + 1, + 1, + 11, + 12, + 2, + 7, + 8, + 19, + 6, + 7, + 13, + 3, + 12, + 11, + 5, + 2, + 3, + 5, + 10, + 20, + 25, + 3, + 13, + 22, + 11, + 4, + 5, + 12, + 12, + 2, + 36, + 10, + 12, + 13, + 8, + 6 + ], + "weighted_loads": [ + 0.6459181476384401, + 0.3960632011294365, + 0.23170511238276958, + 0.7353020384907722, + 0.1562290620058775, + 1.2949856016784906, + 0.23920108564198017, + 1.1752073168754578, + 0.23110807687044144, + 0.16782502457499504, + 0.10166901350021362, + 0.15059287287294865, + 0.22294392064213753, + 0.13051063939929008, + 2.064315762370825, + 1.0858480650931597, + 1.1379068307578564, + 0.8656519018113613, + 0.5001285057514906, + 0.28702230006456375, + 1.1097512654960155, + 0.22377723827958107, + 0.16506025567650795, + 0.10611659847199917, + 0.2551171276718378, + 1.3350646253675222, + 0.15800423361361027, + 0.5005288235843182, + 0.08063565939664841, + 0.06594303250312805, + 0.6039020083844662, + 1.0532891266047955, + 0.06079338304698467, + 0.24220292456448078, + 0.22280522622168064, + 1.5320020280778408, + 0.5885202791541815, + 0.27655185386538506, + 1.5019866861402988, + 0.685568243265152, + 0.5857470966875553, + 0.4882424399256706, + 0.22183184698224068, + 0.06623191758990288, + 0.19265278428792953, + 0.35374952107667923, + 0.3499069605022669, + 1.4664880111813545, + 1.781960166990757, + 0.10202826745808125, + 0.7854209169745445, + 1.3256281707435846, + 1.309733610600233, + 0.21712260879576206, + 0.16575643979012966, + 0.5940329246222973, + 0.42938656359910965, + 0.06871476210653782, + 1.9191363081336021, + 0.3489434029906988, + 0.6617733929306269, + 1.2138246465474367, + 0.6685469746589661, + 0.20458513870835304 + ], + "unique_experts": 64, + "load_cv": 0.7411516732604663, + "normalized_load_entropy": 0.9393003617233912, + "max_load_share": 0.05660377358490566 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "53858b65b1534bf488850c8ea34168fb6473d234820fd68410bda3bf1ef8bb77", + "route_weight_sha256": "5530b46925b996e3e12d1f0a710297f61ac404112c61503b760ffeef5e3c3daf", + "loads": [ + 16, + 23, + 11, + 16, + 4, + 19, + 11, + 17, + 7, + 5, + 12, + 7, + 8, + 4, + 26, + 30, + 19, + 17, + 11, + 4, + 20, + 7, + 4, + 9, + 5, + 17, + 5, + 10, + 2, + 5, + 11, + 13, + 4, + 8, + 10, + 19, + 6, + 8, + 24, + 4, + 19, + 12, + 5, + 3, + 9, + 15, + 13, + 20, + 25, + 3, + 23, + 22, + 17, + 4, + 15, + 12, + 13, + 4, + 36, + 10, + 14, + 13, + 14, + 7 + ], + "weighted_loads": [ + 0.7437361050397158, + 2.000434652902186, + 0.49014229886233807, + 0.7724280059337616, + 0.1562290620058775, + 1.2949856016784906, + 0.6991206537932158, + 1.1752073168754578, + 0.23110807687044144, + 0.16782502457499504, + 1.1806243769824505, + 0.8175656516104937, + 0.5199079029262066, + 0.13051063939929008, + 2.064315762370825, + 1.1289776619523764, + 1.1379068307578564, + 0.9643469415605068, + 0.5263729710131884, + 0.28702230006456375, + 1.1097512654960155, + 0.22377723827958107, + 0.16506025567650795, + 0.3673747777938843, + 0.2551171276718378, + 1.3350646253675222, + 0.15800423361361027, + 0.5005288235843182, + 0.12173492088913918, + 0.20884512178599834, + 0.6039020083844662, + 1.1502970047295094, + 0.20095142535865307, + 0.3011417035013437, + 0.3160408940166235, + 1.5320020280778408, + 0.5885202791541815, + 0.37527693435549736, + 2.127799665555358, + 0.8405617326498032, + 0.8677082639187574, + 0.5209800526499748, + 0.22183184698224068, + 0.09891211614012718, + 0.6552003808319569, + 1.3379994481801987, + 0.49480837397277355, + 1.4664880111813545, + 1.781960166990757, + 0.10202826745808125, + 1.3920322358608246, + 1.3256281707435846, + 1.6550410836935043, + 0.21712260879576206, + 0.6666952688246965, + 0.5940329246222973, + 0.4805291183292866, + 0.13309707306325436, + 1.9191363081336021, + 0.3489434029906988, + 0.7529693674296141, + 1.2138246465474367, + 1.1143816355615854, + 0.324483010917902 + ], + "unique_experts": 64, + "load_cv": 0.5994675492294005, + "normalized_load_entropy": 0.9577231277490728, + "max_load_share": 0.04580152671755725 + } + }, + "s1_period": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "dbcab87817cfd4e193fb144145f0edba729cf68ee16d30018fe4daef97341054", + "route_weight_sha256": "5874f53caee250d926de47a975ac95cf155511c71e0af99a2ac6cc4cab907b16", + "loads": [ + 13, + 4, + 6, + 17, + 5, + 19, + 4, + 18, + 6, + 6, + 3, + 3, + 5, + 3, + 24, + 27, + 18, + 14, + 10, + 4, + 19, + 10, + 5, + 3, + 4, + 16, + 4, + 10, + 1, + 1, + 13, + 12, + 2, + 6, + 7, + 18, + 6, + 9, + 13, + 4, + 12, + 11, + 4, + 2, + 3, + 5, + 9, + 20, + 21, + 3, + 14, + 22, + 12, + 3, + 4, + 12, + 14, + 3, + 35, + 10, + 14, + 15, + 9, + 7 + ], + "weighted_loads": [ + 0.5807405952364206, + 0.40473346412181854, + 0.21188032999634743, + 0.798517657443881, + 0.2019009068608284, + 1.2907374445348978, + 0.2293502502143383, + 1.1897201854735613, + 0.1987787000834942, + 0.20446376129984856, + 0.13697776198387146, + 0.11917748674750328, + 0.2226905282586813, + 0.08649584464728832, + 1.9538227077573538, + 1.0297914147377014, + 1.0954509172588587, + 0.8689365461468697, + 0.4880874790251255, + 0.2691948004066944, + 1.0875117033720016, + 0.3283873572945595, + 0.19776648841798306, + 0.10873541608452797, + 0.2059658970683813, + 1.2938683163374662, + 0.12911084294319153, + 0.49454550072550774, + 0.08222810178995132, + 0.0655551552772522, + 0.6726015228778124, + 1.0556284803897142, + 0.05987030640244484, + 0.20939451828598976, + 0.19909593276679516, + 1.4963150303810835, + 0.5819148067384958, + 0.34378881752491, + 1.520802117884159, + 0.6885877046734095, + 0.5741062797605991, + 0.4817945919930935, + 0.17537199705839157, + 0.06550301797688007, + 0.18092259019613266, + 0.3605104796588421, + 0.30287831276655197, + 1.458970570936799, + 1.5881629101932049, + 0.11942465044558048, + 0.8031772468239069, + 1.300303839147091, + 1.322106245905161, + 0.18993087857961655, + 0.12256025895476341, + 0.5908452235162258, + 0.48255089297890663, + 0.10053101554512978, + 1.8900361955165863, + 0.34427984803915024, + 0.7215638067573309, + 1.2533055245876312, + 0.7190268598496914, + 0.22571112774312496 + ], + "unique_experts": 64, + "load_cv": 0.7135247151188803, + "normalized_load_entropy": 0.9418553113258703, + "max_load_share": 0.055031446540880505 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "c8b308b63b5ff99777ade3fa64f83497057503ce64e9989e54b6f54d810db546", + "route_weight_sha256": "118a4223c482bc20ec686a0deb5948ad577ba266ab597c22a2995e9819fff5ce", + "loads": [ + 16, + 29, + 13, + 18, + 5, + 20, + 11, + 18, + 8, + 7, + 25, + 6, + 13, + 3, + 24, + 28, + 18, + 22, + 12, + 5, + 22, + 17, + 5, + 11, + 4, + 16, + 5, + 10, + 2, + 3, + 14, + 15, + 8, + 6, + 10, + 18, + 7, + 16, + 23, + 7, + 19, + 11, + 5, + 3, + 14, + 20, + 10, + 20, + 21, + 4, + 26, + 22, + 20, + 9, + 18, + 13, + 17, + 6, + 35, + 11, + 18, + 16, + 14, + 10 + ], + "weighted_loads": [ + 0.8500359933823347, + 2.482134790159762, + 0.5726078730076551, + 0.8645898010581732, + 0.2019009068608284, + 1.3285386878997087, + 0.842836894094944, + 1.1897201854735613, + 0.3137018270790577, + 0.2330123446881771, + 2.14645304530859, + 0.8394105695188046, + 0.7420188449323177, + 0.08649584464728832, + 1.9538227077573538, + 1.0784925483167171, + 1.0954509172588587, + 1.5145881175994873, + 0.5659156795591116, + 0.2928504664450884, + 1.344754196703434, + 0.9713391084223986, + 0.19776648841798306, + 0.4251060839742422, + 0.2059658970683813, + 1.2938683163374662, + 0.16231104731559753, + 0.49454550072550774, + 0.12782275676727295, + 0.13528229668736458, + 0.7087170388549566, + 1.522128539159894, + 0.36137042939662933, + 0.20939451828598976, + 0.34595960192382336, + 1.4963150303810835, + 0.6260522548109293, + 0.6696840282529593, + 2.378727860748768, + 1.018119527027011, + 0.8916752673685551, + 0.4817945919930935, + 0.26212092489004135, + 0.0957792978733778, + 0.9927818812429905, + 1.7178672663867474, + 0.34455981478095055, + 1.458970570936799, + 1.5881629101932049, + 0.1685460116714239, + 1.532934308052063, + 1.300303839147091, + 1.85361909866333, + 0.6631386429071426, + 1.0308178775012493, + 0.6171246841549873, + 0.6274223029613495, + 0.21517086401581764, + 1.8900361955165863, + 0.43100298941135406, + 0.9501028526574373, + 1.2963232174515724, + 1.1526301074773073, + 0.5116256400942802 + ], + "unique_experts": 64, + "load_cv": 0.5366777380646326, + "normalized_load_entropy": 0.9639130898179312, + "max_load_share": 0.03968253968253968 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 106, + "ordered_topk_exact_tokens": 64, + "set_exact_tokens": 77, + "mean_set_jaccard": 0.9218328840970351, + "mean_token_weighted_tv": 0.012898092351432116, + "aggregate_load_tv": 0.03301886792452831 + }, + "system_bos": { + "tokens": 106, + "ordered_topk_exact_tokens": 61, + "set_exact_tokens": 80, + "mean_set_jaccard": 0.9278975741239892, + "mean_token_weighted_tv": 0.014123074218349636, + "aggregate_load_tv": 0.033018867924528295 + }, + "system_x": { + "tokens": 106, + "ordered_topk_exact_tokens": 55, + "set_exact_tokens": 69, + "mean_set_jaccard": 0.8962264150943396, + "mean_token_weighted_tv": 0.018441750659203192, + "aggregate_load_tv": 0.04088050314465409 + }, + "system_period": { + "tokens": 106, + "ordered_topk_exact_tokens": 48, + "set_exact_tokens": 69, + "mean_set_jaccard": 0.8982479784366577, + "mean_token_weighted_tv": 0.018302421630272327, + "aggregate_load_tv": 0.04088050314465408 + }, + "bos_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 52, + "set_exact_tokens": 74, + "mean_set_jaccard": 0.9117250673854448, + "mean_token_weighted_tv": 0.015719673772043776, + "aggregate_load_tv": 0.0330188679245283 + }, + "bos_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 52, + "set_exact_tokens": 68, + "mean_set_jaccard": 0.8955525606469005, + "mean_token_weighted_tv": 0.017961821184968047, + "aggregate_load_tv": 0.04088050314465409 + }, + "x_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 46, + "set_exact_tokens": 69, + "mean_set_jaccard": 0.8962264150943396, + "mean_token_weighted_tv": 0.017638674032224237, + "aggregate_load_tv": 0.040880503144654086 + }, + "x_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 53, + "set_exact_tokens": 61, + "mean_set_jaccard": 0.8726415094339622, + "mean_token_weighted_tv": 0.02261350455008588, + "aggregate_load_tv": 0.04874213836477988 + }, + "period_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 55, + "set_exact_tokens": 74, + "mean_set_jaccard": 0.9117250673854448, + "mean_token_weighted_tv": 0.01557405902740528, + "aggregate_load_tv": 0.033018867924528295 + }, + "period_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 48, + "set_exact_tokens": 61, + "mean_set_jaccard": 0.8746630727762804, + "mean_token_weighted_tv": 0.021962457582495123, + "aggregate_load_tv": 0.05188679245283019 + } + } + }, + "layer_26": { + "layer": 26, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "c831d05f1f24b16b20908a2919d01b18c788680c44c236570af0d3dc71f7c1e8", + "route_weight_sha256": "3cf6450d685c339c83dfd1d8ee1531f048c0a9575f97259772f152dfda890c26", + "loads": [ + 11, + 16, + 20, + 8, + 12, + 4, + 20, + 9, + 10, + 4, + 5, + 10, + 16, + 3, + 8, + 6, + 18, + 12, + 1, + 23, + 15, + 15, + 0, + 17, + 5, + 9, + 4, + 3, + 4, + 2, + 1, + 6, + 17, + 7, + 2, + 20, + 4, + 16, + 7, + 7, + 10, + 29, + 4, + 8, + 20, + 18, + 5, + 3, + 0, + 9, + 22, + 9, + 6, + 13, + 4, + 10, + 6, + 12, + 13, + 16, + 19, + 3, + 7, + 13 + ], + "weighted_loads": [ + 0.479740584269166, + 1.5082298964262009, + 1.349743064492941, + 0.2891831211745739, + 0.7427148018032312, + 0.13823440857231617, + 1.5044791959226131, + 0.34451936185359955, + 0.6388064716011286, + 0.17538397945463657, + 0.23176641017198563, + 1.773566447198391, + 1.119084671139717, + 0.11036621779203415, + 0.5147912446409464, + 0.40499134361743927, + 1.1318585984408855, + 1.6555570736527443, + 0.026610033586621284, + 1.4941010102629662, + 1.2848215699195862, + 1.102228844538331, + 0.0, + 0.9866329319775105, + 0.3642242029309273, + 0.3268865831196308, + 0.1327069140970707, + 0.18903206288814545, + 0.17248175665736198, + 0.061020608991384506, + 0.029635678976774216, + 0.19968957640230656, + 1.0189665108919144, + 0.22734258510172367, + 0.2540273293852806, + 1.5272753797471523, + 0.25502828508615494, + 0.7967528365552425, + 0.41731337271630764, + 0.5208729933947325, + 0.4626585692167282, + 2.0498799607157707, + 0.2005219217389822, + 0.3654281236231327, + 0.7470385916531086, + 1.0627332720905542, + 0.16602735593914986, + 0.22204051911830902, + 0.0, + 0.5313917100429535, + 1.077088950201869, + 0.449122654274106, + 0.3839889355003834, + 0.472541281953454, + 0.16076788119971752, + 0.5440845880657434, + 0.7174146436154842, + 1.9526370726525784, + 0.6735916063189507, + 0.7250984497368336, + 1.0600226819515228, + 0.21276609227061272, + 0.33658574521541595, + 0.45517652854323387 + ], + "unique_experts": 62, + "load_cv": 0.6588782025080806, + "normalized_load_entropy": 0.9450426062056956, + "max_load_share": 0.04559748427672956 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "a3e18b6262cf1e7e1566b1148e58f13bd911d58272131196c9a234dd46a0dd90", + "route_weight_sha256": "d1c84c2ae899590597c26016cae618f37e721b4776495bd893ec6940e97d2d61", + "loads": [ + 11, + 16, + 20, + 9, + 12, + 4, + 20, + 11, + 10, + 9, + 9, + 15, + 16, + 4, + 23, + 8, + 18, + 24, + 1, + 23, + 15, + 16, + 1, + 17, + 11, + 9, + 9, + 11, + 4, + 2, + 7, + 6, + 21, + 9, + 6, + 20, + 9, + 16, + 7, + 7, + 10, + 29, + 5, + 11, + 20, + 18, + 9, + 3, + 1, + 10, + 30, + 9, + 12, + 13, + 5, + 10, + 21, + 21, + 19, + 18, + 20, + 3, + 8, + 15 + ], + "weighted_loads": [ + 0.479740584269166, + 1.5082298964262009, + 1.349743064492941, + 0.3167625106871128, + 0.7427148018032312, + 0.13823440857231617, + 1.5044791959226131, + 0.5233670882880688, + 0.6388064716011286, + 0.5015168879181147, + 0.5114191845059395, + 2.0775985929649323, + 1.119084671139717, + 0.17148148640990257, + 1.196084942203015, + 0.500833623111248, + 1.1318585984408855, + 2.3556266392115504, + 0.026610033586621284, + 1.4941010102629662, + 1.2848215699195862, + 1.1337528321892023, + 0.06081964820623398, + 0.9866329319775105, + 0.7425028309226036, + 0.3268865831196308, + 1.2040224596858025, + 0.5847859475761652, + 0.17248175665736198, + 0.061020608991384506, + 0.6729810237884521, + 0.19968957640230656, + 1.1997148096561432, + 0.3186733592301607, + 0.4684327244758606, + 1.5272753797471523, + 0.538628589361906, + 0.7967528365552425, + 0.41731337271630764, + 0.5208729933947325, + 0.4626585692167282, + 2.0498799607157707, + 0.2516107130795717, + 0.5151593126356602, + 0.7470385916531086, + 1.0627332720905542, + 0.39191926270723343, + 0.22204051911830902, + 0.03408527374267578, + 1.5177424252033234, + 1.4239347744733095, + 0.449122654274106, + 0.9328861348330975, + 0.472541281953454, + 0.20821847952902317, + 0.5440845880657434, + 1.8806597832590342, + 2.3784701405093074, + 0.9090094864368439, + 1.0494435541331768, + 1.0608334644930437, + 0.21276609227061272, + 0.3777763843536377, + 0.5364659950137138 + ], + "unique_experts": 64, + "load_cv": 0.55997568261477, + "normalized_load_entropy": 0.9599215223443702, + "max_load_share": 0.03816793893129771 + } + }, + "s1_eos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "a72748ada4b7feb32eeef5ff6a4377e57cbd062c3458f410bffd38d45536140b", + "route_weight_sha256": "8115a673dd775f902c8b3276418ce621be3d520379a7d1b638de9d0d1d026965", + "loads": [ + 11, + 16, + 19, + 4, + 12, + 4, + 20, + 8, + 10, + 4, + 5, + 10, + 16, + 4, + 8, + 6, + 18, + 13, + 1, + 23, + 17, + 15, + 0, + 18, + 5, + 10, + 5, + 4, + 4, + 3, + 1, + 5, + 15, + 7, + 2, + 20, + 4, + 18, + 7, + 6, + 10, + 28, + 3, + 8, + 19, + 17, + 7, + 3, + 0, + 9, + 22, + 8, + 6, + 13, + 6, + 10, + 6, + 12, + 13, + 16, + 19, + 3, + 6, + 14 + ], + "weighted_loads": [ + 0.4819102827459574, + 1.5064752325415611, + 1.319803822785616, + 0.16097857244312763, + 0.7358938883990049, + 0.13658119179308414, + 1.524788361042738, + 0.31523292511701584, + 0.6333760879933834, + 0.1816446054726839, + 0.23091904819011688, + 1.7576608881354332, + 1.1205503791570663, + 0.14593758061528206, + 0.5314925648272038, + 0.4049778878688812, + 1.1314187347888947, + 1.7036028951406479, + 0.0267045795917511, + 1.4771743305027485, + 1.331786209717393, + 1.1034516990184784, + 0.0, + 1.0135169997811317, + 0.3563128747045994, + 0.35994720458984375, + 0.17134349420666695, + 0.22679155692458153, + 0.1755433939397335, + 0.09850628115236759, + 0.029691021889448166, + 0.16799591481685638, + 0.9445500802248716, + 0.23353205434978008, + 0.26168612390756607, + 1.5289093106985092, + 0.25729426369071007, + 0.8524708840996027, + 0.4162141866981983, + 0.4861743338406086, + 0.46611639112234116, + 2.0179187823086977, + 0.17690075561404228, + 0.3640958406031132, + 0.7150228749960661, + 1.044445177540183, + 0.22456811740994453, + 0.22004706412553787, + 0.0, + 0.5340635981410742, + 1.0768350325524807, + 0.4183661974966526, + 0.38827747106552124, + 0.45953699573874474, + 0.22570950351655483, + 0.5447569880634546, + 0.7089903615415096, + 1.929471641778946, + 0.6604530699551105, + 0.7342790309339762, + 1.075533650815487, + 0.21095992624759674, + 0.30522114410996437, + 0.49005694687366486 + ], + "unique_experts": 62, + "load_cv": 0.6528471538373174, + "normalized_load_entropy": 0.9460332530770246, + "max_load_share": 0.0440251572327044 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "297464664ae60c27666c2532129a4896d616edf5ea2bf2f19df705dcefe65db0", + "route_weight_sha256": "a07995287e94ba5e934f9a5e83b63cc6ee16ff08b8855710f74111bb8f9eec30", + "loads": [ + 12, + 16, + 19, + 5, + 15, + 4, + 20, + 10, + 10, + 12, + 12, + 17, + 16, + 5, + 23, + 11, + 18, + 20, + 2, + 23, + 17, + 20, + 8, + 18, + 14, + 11, + 16, + 15, + 4, + 5, + 10, + 6, + 21, + 8, + 9, + 20, + 15, + 23, + 10, + 7, + 11, + 28, + 5, + 12, + 19, + 18, + 11, + 4, + 1, + 12, + 29, + 8, + 18, + 15, + 9, + 12, + 24, + 23, + 23, + 23, + 22, + 3, + 9, + 16 + ], + "weighted_loads": [ + 0.5337455477565527, + 1.5064752325415611, + 1.319803822785616, + 0.1900885161012411, + 0.9183060266077518, + 0.13658119179308414, + 1.524788361042738, + 0.5434515103697777, + 0.6333760879933834, + 0.6953145992010832, + 0.9352258667349815, + 2.3713858579285443, + 1.1205503791570663, + 0.19925513491034508, + 1.3311434862553142, + 0.7139896862208843, + 1.1314187347888947, + 2.2135839745169505, + 0.08047550171613693, + 1.4771743305027485, + 1.331786209717393, + 1.4269746858626604, + 0.5585163459181786, + 1.0135169997811317, + 0.8331279531121254, + 0.42917513847351074, + 1.7514065280556679, + 0.7271570693701506, + 0.1755433939397335, + 0.16750474832952023, + 0.9566166773438454, + 0.24699050188064575, + 1.21607562340796, + 0.3009189050644636, + 0.6234077736735344, + 1.5289093106985092, + 0.8656122982501984, + 1.1573655474931002, + 0.7056636735796928, + 0.5202229805290699, + 0.497212678194046, + 2.0179187823086977, + 0.2679719999432564, + 0.5658530741930008, + 0.7150228749960661, + 1.0622615683823824, + 0.5023189075291157, + 0.2621179334819317, + 0.03590665012598038, + 1.6725250240415335, + 1.3754781186580658, + 0.4183661974966526, + 1.3163383789360523, + 0.658258531242609, + 0.4372565131634474, + 0.6637913379818201, + 2.4726522155106068, + 2.733344360254705, + 1.223627395927906, + 1.2812099009752274, + 1.3146815891377628, + 0.21095992624759674, + 0.42776953615248203, + 0.5694541111588478 + ], + "unique_experts": 64, + "load_cv": 0.48768652182715244, + "normalized_load_entropy": 0.9687587683759085, + "max_load_share": 0.032879818594104306 + } + }, + "s0_bos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "77a0317f4396a5bb4ade56c97b7c37123c94adcf46f88a2e783c471501660ae1", + "route_weight_sha256": "1235d1e251019087f99228ed3645265c153b01d710080ed717de185b62a27f32", + "loads": [ + 12, + 16, + 20, + 8, + 11, + 3, + 19, + 9, + 10, + 4, + 5, + 10, + 16, + 3, + 7, + 6, + 18, + 13, + 2, + 24, + 16, + 14, + 0, + 18, + 7, + 11, + 1, + 3, + 4, + 3, + 1, + 6, + 16, + 6, + 2, + 19, + 4, + 17, + 6, + 7, + 10, + 29, + 4, + 7, + 20, + 17, + 5, + 3, + 0, + 9, + 19, + 9, + 7, + 14, + 6, + 10, + 6, + 12, + 13, + 16, + 18, + 3, + 8, + 14 + ], + "weighted_loads": [ + 0.5279681514948606, + 1.5255469158291817, + 1.36347097158432, + 0.2974664643406868, + 0.7114443778991699, + 0.10903644189238548, + 1.515306020155549, + 0.3397505581378937, + 0.6429640278220177, + 0.17088109627366066, + 0.22606809064745903, + 1.786585383117199, + 1.125030592083931, + 0.10548383742570877, + 0.513948529958725, + 0.3948436565697193, + 1.1452675070613623, + 1.6766546294093132, + 0.054674165323376656, + 1.5286282524466515, + 1.3748418726027012, + 1.073516771197319, + 0.0, + 1.0243093147873878, + 0.4246889799833298, + 0.3997635804116726, + 0.03454325348138809, + 0.1857534684240818, + 0.1735483966767788, + 0.09615306742489338, + 0.02977013774216175, + 0.2095835618674755, + 0.9938791617751122, + 0.1953483633697033, + 0.2600857689976692, + 1.4881493505090475, + 0.2602793201804161, + 0.8342114649713039, + 0.37630484998226166, + 0.5405185371637344, + 0.45699144154787064, + 2.0262613371014595, + 0.19974168948829174, + 0.35412525199353695, + 0.7476055845618248, + 1.0645079798996449, + 0.16136391833424568, + 0.2257395200431347, + 0.0, + 0.5344212651252747, + 0.9679395761340857, + 0.43501774221658707, + 0.4043585751205683, + 0.5000633094459772, + 0.22773824073374271, + 0.551075043156743, + 0.7428049854934216, + 1.9486833941191435, + 0.6820215359330177, + 0.7251054476946592, + 1.0323458164930344, + 0.20303670689463615, + 0.3683950174599886, + 0.4840301647782326 + ], + "unique_experts": 62, + "load_cv": 0.6506622915656327, + "normalized_load_entropy": 0.9457855397858967, + "max_load_share": 0.04559748427672956 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "578ece78e9ee2b4f5bb50c61ad5f62b733c732fc5b09872d3054a1cb939ee103", + "route_weight_sha256": "77c1ecfdd18d123df3047b8a1b401f84b89db9e48a6a7f8397b012a5f70e2ea5", + "loads": [ + 13, + 16, + 20, + 8, + 11, + 3, + 19, + 11, + 10, + 10, + 8, + 14, + 16, + 4, + 20, + 8, + 18, + 23, + 2, + 24, + 16, + 15, + 2, + 18, + 13, + 11, + 7, + 12, + 4, + 3, + 9, + 6, + 19, + 7, + 7, + 19, + 9, + 17, + 6, + 7, + 10, + 30, + 6, + 10, + 23, + 17, + 8, + 3, + 1, + 9, + 27, + 9, + 13, + 14, + 7, + 10, + 20, + 20, + 19, + 18, + 18, + 3, + 9, + 17 + ], + "weighted_loads": [ + 0.5534100867807865, + 1.5255469158291817, + 1.36347097158432, + 0.2974664643406868, + 0.7114443778991699, + 0.10903644189238548, + 1.515306020155549, + 0.509381365031004, + 0.6429640278220177, + 0.5299226753413677, + 0.43910642713308334, + 2.08856588229537, + 1.125030592083931, + 0.1665991060435772, + 1.1155479177832603, + 0.5079204589128494, + 1.1452675070613623, + 2.314515959471464, + 0.054674165323376656, + 1.5286282524466515, + 1.3748418726027012, + 1.1050407588481903, + 0.09426367655396461, + 1.0243093147873878, + 0.7957420237362385, + 0.3997635804116726, + 1.2731468193233013, + 0.66358064673841, + 0.1735483966767788, + 0.09615306742489338, + 0.8509388025850058, + 0.2095835618674755, + 1.1340410895645618, + 0.2594698779284954, + 0.5470558442175388, + 1.4881493505090475, + 0.5474671274423599, + 0.8342114649713039, + 0.37630484998226166, + 0.5405185371637344, + 0.45699144154787064, + 2.3687993064522743, + 0.2989647965878248, + 0.5038564410060644, + 0.8875746317207813, + 1.0645079798996449, + 0.344793189316988, + 0.2257395200431347, + 0.06665542721748352, + 0.5344212651252747, + 1.3147854004055262, + 0.43501774221658707, + 0.9586631711572409, + 0.5000633094459772, + 0.27518883906304836, + 0.551075043156743, + 1.87710384093225, + 2.3681266121566296, + 0.917439416050911, + 1.0571169313043356, + 1.0323458164930344, + 0.20303670689463615, + 0.40958565659821033, + 0.621362529695034 + ], + "unique_experts": 64, + "load_cv": 0.5392421260036299, + "normalized_load_entropy": 0.9630599797384434, + "max_load_share": 0.03816793893129771 + } + }, + "s1_bos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "7c6e6cf4071b84a879ba0709511196f000f5a8095046281d7b335141c86a162a", + "route_weight_sha256": "2880e4eb1b9bd40dc0b16c591b9228521ac38081357ff6011a321ba4af19b5e6", + "loads": [ + 12, + 16, + 20, + 6, + 10, + 4, + 19, + 8, + 10, + 4, + 5, + 10, + 16, + 4, + 7, + 5, + 19, + 12, + 3, + 24, + 15, + 15, + 0, + 17, + 6, + 8, + 4, + 4, + 4, + 3, + 1, + 6, + 15, + 6, + 2, + 22, + 4, + 18, + 6, + 8, + 10, + 28, + 3, + 7, + 18, + 18, + 5, + 4, + 0, + 9, + 19, + 10, + 6, + 13, + 6, + 11, + 6, + 11, + 13, + 16, + 19, + 3, + 6, + 17 + ], + "weighted_loads": [ + 0.5274675227701664, + 1.5310625061392784, + 1.3640309795737267, + 0.23460494726896286, + 0.6729599181562662, + 0.14531949907541275, + 1.5119799990206957, + 0.3178637623786926, + 0.6364523824304342, + 0.1774015873670578, + 0.23154957592487335, + 1.7357748672366142, + 1.1352939046919346, + 0.13427896611392498, + 0.5367304515093565, + 0.37314803153276443, + 1.1632737964391708, + 1.5915684960782528, + 0.08050267770886421, + 1.5370874628424644, + 1.2889688685536385, + 1.111065337434411, + 0.0, + 0.9833178073167801, + 0.3850119896233082, + 0.3042520396411419, + 0.12859364226460457, + 0.2355344258248806, + 0.1734338477253914, + 0.1005296092480421, + 0.02950306236743927, + 0.20416168496012688, + 0.9513030722737312, + 0.19635113142430782, + 0.26386700570583344, + 1.5771376341581345, + 0.262422539293766, + 0.8724123407155275, + 0.37663447856903076, + 0.5547030754387379, + 0.4628184661269188, + 1.9867846835404634, + 0.17744800448417664, + 0.35675961524248123, + 0.6982975602149963, + 1.0620239283889532, + 0.15688891150057316, + 0.25518542900681496, + 0.0, + 0.5280121266841888, + 0.9594441745430231, + 0.47237137146294117, + 0.3896142803132534, + 0.4681352376937866, + 0.22790017165243626, + 0.5723940692842007, + 0.7034844011068344, + 1.8967019505798817, + 0.6686661168932915, + 0.7343258894979954, + 1.0694481544196606, + 0.20944752544164658, + 0.28670672699809074, + 0.5906722284853458 + ], + "unique_experts": 62, + "load_cv": 0.6496888831977606, + "normalized_load_entropy": 0.9473996426304011, + "max_load_share": 0.0440251572327044 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "0ddff945d423b4fcfab7cdac932266506cbfdf3226f3d222f5fb06b85446f163", + "route_weight_sha256": "77b3de0e694cec4f97341954275d769927ee86bc590cfc5cd81cbac9151ced85", + "loads": [ + 12, + 16, + 20, + 7, + 13, + 4, + 19, + 10, + 10, + 13, + 13, + 16, + 16, + 6, + 20, + 10, + 19, + 18, + 3, + 24, + 15, + 20, + 8, + 17, + 15, + 9, + 16, + 14, + 4, + 5, + 12, + 7, + 20, + 8, + 10, + 22, + 15, + 23, + 9, + 9, + 11, + 28, + 6, + 11, + 20, + 19, + 8, + 5, + 1, + 11, + 26, + 10, + 18, + 15, + 9, + 13, + 24, + 21, + 23, + 23, + 21, + 3, + 9, + 20 + ], + "weighted_loads": [ + 0.5274675227701664, + 1.5310625061392784, + 1.3640309795737267, + 0.2635314129292965, + 0.8553720563650131, + 0.14531949907541275, + 1.5119799990206957, + 0.5333080664277077, + 0.6364523824304342, + 0.7145063430070877, + 0.9878265932202339, + 2.3472147770226, + 1.1352939046919346, + 0.23793901316821575, + 1.2744749207049608, + 0.6920233145356178, + 1.1632737964391708, + 2.1052536368370056, + 0.08050267770886421, + 1.5370874628424644, + 1.2889688685536385, + 1.434588324278593, + 0.5469904877245426, + 0.9833178073167801, + 0.8708120323717594, + 0.3734799735248089, + 1.926756925880909, + 0.6957109104841948, + 0.1734338477253914, + 0.16952807642519474, + 1.1098981648683548, + 0.28315627202391624, + 1.178370002657175, + 0.31519688479602337, + 0.6922263819724321, + 1.5771376341581345, + 0.87432561814785, + 1.177307004109025, + 0.6660839654505253, + 0.5887517221271992, + 0.49391475319862366, + 1.9867846835404634, + 0.32352040708065033, + 0.5585168488323689, + 0.7857465669512749, + 1.0798403192311525, + 0.36955261416733265, + 0.29725629836320877, + 0.03590665012598038, + 0.6817999333143234, + 1.2580872606486082, + 0.47237137146294117, + 1.2884421907365322, + 0.6668567731976509, + 0.4394471812993288, + 0.6914284192025661, + 2.480710305273533, + 2.6964533124119043, + 1.231840442866087, + 1.2903236988931894, + 1.3076644353568554, + 0.20944752544164658, + 0.4092551190406084, + 0.7418869584798813 + ], + "unique_experts": 64, + "load_cv": 0.4664757900384385, + "normalized_load_entropy": 0.9716440164051968, + "max_load_share": 0.031746031746031744 + } + }, + "s0_x": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "32171c4ade6969b5fbcb618f7ad65775860a903e8551be2d8ae1dc1d14a73b77", + "route_weight_sha256": "adb80e9cae13d6b3359a04b0bdd7b618c167a9ad39f88b62d4fe3106fd4ade65", + "loads": [ + 12, + 16, + 20, + 7, + 13, + 4, + 19, + 6, + 10, + 4, + 5, + 10, + 16, + 3, + 7, + 5, + 19, + 13, + 1, + 24, + 14, + 15, + 0, + 18, + 7, + 9, + 3, + 4, + 4, + 3, + 1, + 5, + 16, + 7, + 2, + 20, + 4, + 15, + 7, + 7, + 10, + 28, + 4, + 8, + 19, + 18, + 5, + 4, + 0, + 9, + 23, + 7, + 7, + 12, + 5, + 11, + 7, + 11, + 13, + 16, + 19, + 3, + 8, + 14 + ], + "weighted_loads": [ + 0.5106476098299026, + 1.5014123395085335, + 1.3538270443677902, + 0.2700934838503599, + 0.7717699930071831, + 0.14633789286017418, + 1.4721654690802097, + 0.2406360860913992, + 0.6542886029928923, + 0.16275846026837826, + 0.21889743581414223, + 1.792762041091919, + 1.1111837290227413, + 0.10667981579899788, + 0.5086728129535913, + 0.3690335229039192, + 1.1719645969569683, + 1.6634489390999079, + 0.030250679701566696, + 1.5296695623546839, + 1.2549722082912922, + 1.0928695369511843, + 0.0, + 1.0219879299402237, + 0.43277070112526417, + 0.3337838836014271, + 0.09696873277425766, + 0.22940237075090408, + 0.17087441682815552, + 0.09603434056043625, + 0.02924298122525215, + 0.17321517132222652, + 0.9900941792875528, + 0.2238888144493103, + 0.2557661756873131, + 1.5345613583922386, + 0.27922485023736954, + 0.7564701996743679, + 0.4087411146610975, + 0.5240058712661266, + 0.45684032142162323, + 1.9944287184625864, + 0.19974693097174168, + 0.35635809041559696, + 0.7156249023973942, + 1.0773096568882465, + 0.16409138031303883, + 0.25466243363916874, + 0.0, + 0.5272845234721899, + 1.06844094209373, + 0.3597825262695551, + 0.42184486240148544, + 0.43112028762698174, + 0.19994580745697021, + 0.577371746301651, + 0.7606509141623974, + 1.9099437929689884, + 0.6918352097272873, + 0.7374792229384184, + 1.0654474198818207, + 0.19484752789139748, + 0.35583848133683205, + 0.48596190474927425 + ], + "unique_experts": 62, + "load_cv": 0.6547831333371835, + "normalized_load_entropy": 0.9460261795595943, + "max_load_share": 0.0440251572327044 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "499a590c8126521283bce16920ed57d8749b9f6fb4927ebe8bff0f3b17538b0a", + "route_weight_sha256": "444dcf73dd911661f649f4f845abf3a53b54eb905067434cd294cabaa9d115f6", + "loads": [ + 12, + 16, + 20, + 8, + 13, + 4, + 19, + 8, + 10, + 9, + 9, + 16, + 16, + 4, + 21, + 7, + 19, + 26, + 1, + 24, + 14, + 16, + 0, + 18, + 13, + 9, + 8, + 13, + 4, + 4, + 7, + 5, + 19, + 8, + 5, + 20, + 9, + 15, + 7, + 7, + 10, + 28, + 5, + 13, + 19, + 18, + 8, + 4, + 0, + 9, + 31, + 7, + 14, + 12, + 6, + 11, + 24, + 20, + 19, + 18, + 19, + 3, + 9, + 16 + ], + "weighted_loads": [ + 0.5106476098299026, + 1.5014123395085335, + 1.3538270443677902, + 0.29810331016778946, + 0.7717699930071831, + 0.14633789286017418, + 1.4721654690802097, + 0.39338315464556217, + 0.6542886029928923, + 0.4876248259097338, + 0.49238644912838936, + 2.2416577227413654, + 1.1111837290227413, + 0.1677950844168663, + 1.213170314207673, + 0.46322398260235786, + 1.1719645969569683, + 2.487619372084737, + 0.030250679701566696, + 1.5296695623546839, + 1.2549722082912922, + 1.1243935246020555, + 0.0, + 1.0219879299402237, + 0.803364833816886, + 0.3337838836014271, + 1.1723014079034328, + 0.6545847523957491, + 0.17087441682815552, + 0.1419028639793396, + 0.712133064866066, + 0.17321517132222652, + 1.1196280475705862, + 0.27250271290540695, + 0.43233857676386833, + 1.5345613583922386, + 0.5599017813801765, + 0.7564701996743679, + 0.4087411146610975, + 0.5240058712661266, + 0.45684032142162323, + 1.9944287184625864, + 0.25239323638379574, + 0.5998355653136969, + 0.7156249023973942, + 1.0773096568882465, + 0.330631161108613, + 0.25466243363916874, + 0.0, + 0.5272845234721899, + 1.4152867663651705, + 0.3597825262695551, + 0.9533791523426771, + 0.43112028762698174, + 0.24739640578627586, + 0.577371746301651, + 2.0815397892147303, + 2.447744119912386, + 0.9272530898451805, + 1.0688797887414694, + 1.0654474198818207, + 0.19484752789139748, + 0.3970291204750538, + 0.554735578596592 + ], + "unique_experts": 62, + "load_cv": 0.5696961788398796, + "normalized_load_entropy": 0.9575680200068875, + "max_load_share": 0.039440203562340966 + } + }, + "s1_x": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "f1742d11185e9a3be694d72c5d43aff10e66691d183ed2f1f7d84ed9dd666dfe", + "route_weight_sha256": "301448e8ea6ca498fe494469ce471a8d09c9dda474806c603c4feae130d3fe1d", + "loads": [ + 12, + 16, + 20, + 5, + 11, + 5, + 18, + 8, + 10, + 3, + 5, + 10, + 16, + 2, + 7, + 5, + 20, + 13, + 2, + 24, + 15, + 15, + 0, + 17, + 5, + 8, + 4, + 4, + 5, + 3, + 1, + 5, + 15, + 8, + 2, + 20, + 4, + 15, + 7, + 7, + 10, + 29, + 3, + 7, + 19, + 17, + 6, + 4, + 0, + 9, + 19, + 9, + 7, + 14, + 6, + 12, + 6, + 11, + 13, + 18, + 20, + 3, + 6, + 16 + ], + "weighted_loads": [ + 0.5133728366345167, + 1.4910531416535378, + 1.3516792841255665, + 0.2033153660595417, + 0.7048836424946785, + 0.1830504611134529, + 1.4609521478414536, + 0.2979496568441391, + 0.6227956060320139, + 0.12878281995654106, + 0.2180093675851822, + 1.7407819628715515, + 1.1165289171040058, + 0.06516769900918007, + 0.5207566227763891, + 0.36948058009147644, + 1.1820609904825687, + 1.6054254081100225, + 0.07762619853019714, + 1.5313090533018112, + 1.2063677944242954, + 1.0794604923576117, + 0.0, + 0.9850958585739136, + 0.3608067575842142, + 0.29019516706466675, + 0.139061126857996, + 0.2362101525068283, + 0.2050032578408718, + 0.10796578973531723, + 0.029613612219691277, + 0.17216214910149574, + 0.9271240476518869, + 0.2589473221451044, + 0.2582439035177231, + 1.5505438223481178, + 0.2853667214512825, + 0.7443127799779177, + 0.408973328769207, + 0.5032757967710495, + 0.4570839162915945, + 2.0043869856745005, + 0.1738663613796234, + 0.3438912872225046, + 0.7180443480610847, + 1.0290042385458946, + 0.1856369897723198, + 0.2471174020320177, + 0.0, + 0.5270405635237694, + 0.967726893723011, + 0.3998639341443777, + 0.4085369147360325, + 0.48501915484666824, + 0.2206596527248621, + 0.6042406428605318, + 0.6915155500173569, + 1.8626508712768555, + 0.6825937181711197, + 0.8036894965916872, + 1.086427941918373, + 0.19830293953418732, + 0.2769796624779701, + 0.5580156836658716 + ], + "unique_experts": 62, + "load_cv": 0.6545414490497818, + "normalized_load_entropy": 0.946129978902681, + "max_load_share": 0.04559748427672956 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "885715716fd2be7e1c788485d6febca289a7ef19b028c313321bd95b0bd621bc", + "route_weight_sha256": "42131d6dc3f086be395bababc90cd8ccca5ab9f5d61862b82586d5b8103de559", + "loads": [ + 12, + 16, + 20, + 5, + 14, + 8, + 18, + 10, + 10, + 11, + 13, + 18, + 16, + 3, + 22, + 10, + 20, + 20, + 2, + 24, + 15, + 20, + 6, + 17, + 14, + 9, + 15, + 15, + 5, + 6, + 10, + 6, + 21, + 8, + 8, + 20, + 15, + 20, + 10, + 8, + 11, + 29, + 5, + 11, + 19, + 18, + 9, + 5, + 1, + 11, + 26, + 9, + 18, + 16, + 9, + 14, + 26, + 23, + 24, + 26, + 22, + 3, + 9, + 18 + ], + "weighted_loads": [ + 0.5133728366345167, + 1.4910531416535378, + 1.3516792841255665, + 0.2033153660595417, + 0.8872957807034254, + 0.29467534460127354, + 1.4609521478414536, + 0.5070741474628448, + 0.6227956060320139, + 0.627096563577652, + 0.9989847540855408, + 2.5129768885672092, + 1.1165289171040058, + 0.11848525330424309, + 1.4111467991024256, + 0.6812089718878269, + 1.1820609904825687, + 2.1935088355094194, + 0.07762619853019714, + 1.5313090533018112, + 1.2063677944242954, + 1.4029834792017937, + 0.4537028521299362, + 0.9850958585739136, + 0.8243817966431379, + 0.35942310094833374, + 1.6689907386898994, + 0.7232673820108175, + 0.2050032578408718, + 0.24616122618317604, + 0.9677494559437037, + 0.2511567361652851, + 1.161850843578577, + 0.2589473221451044, + 0.5956027507781982, + 1.5505438223481178, + 0.8950702883303165, + 1.0492074433714151, + 0.6984228156507015, + 0.5373244434595108, + 0.48818020336329937, + 2.0043869856745005, + 0.2653568424284458, + 0.5456485208123922, + 0.7180443480610847, + 1.046820629388094, + 0.3856441155076027, + 0.2891882713884115, + 0.03590665012598038, + 0.680828370153904, + 1.2663699798285961, + 0.3998639341443777, + 1.251916728913784, + 0.6837406903505325, + 0.43220666237175465, + 0.7232749927788973, + 2.5975061990320683, + 2.819427166134119, + 1.308796714991331, + 1.4322122745215893, + 1.324644222855568, + 0.19830293953418732, + 0.3995280545204878, + 0.6320490650832653 + ], + "unique_experts": 64, + "load_cv": 0.49004255988769274, + "normalized_load_entropy": 0.9688119804347969, + "max_load_share": 0.032879818594104306 + } + }, + "s0_period": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "fdf1428db7957e2999b2b5bb972d13f6abc2d7422ca5af5f037d7f6de0098683", + "route_weight_sha256": "799c75f702fc8736e87ea044a6a8671d42b656e45dfd24fbae28740ecea869eb", + "loads": [ + 12, + 16, + 20, + 6, + 13, + 4, + 19, + 8, + 10, + 4, + 5, + 10, + 16, + 4, + 8, + 5, + 19, + 13, + 1, + 24, + 15, + 15, + 0, + 17, + 6, + 8, + 4, + 3, + 4, + 3, + 1, + 5, + 16, + 7, + 2, + 20, + 4, + 15, + 6, + 7, + 10, + 27, + 4, + 6, + 21, + 19, + 7, + 4, + 0, + 9, + 21, + 8, + 7, + 12, + 5, + 11, + 6, + 11, + 13, + 15, + 19, + 3, + 7, + 16 + ], + "weighted_loads": [ + 0.5130313690751791, + 1.514085065573454, + 1.3448288887739182, + 0.23202204331755638, + 0.7598170191049576, + 0.14821133390069008, + 1.4695489257574081, + 0.3000440988689661, + 0.6500114779919386, + 0.16786707378923893, + 0.22329680994153023, + 1.785293124616146, + 1.1243238300085068, + 0.13089283555746078, + 0.5451439991593361, + 0.3642760179936886, + 1.1768270321190357, + 1.670063829049468, + 0.02855641581118107, + 1.5234605763107538, + 1.2870285511016846, + 1.1066278889775276, + 0.0, + 0.9816032946109772, + 0.3995716404169798, + 0.290755920112133, + 0.12797950394451618, + 0.1754678525030613, + 0.17116903886198997, + 0.09639121405780315, + 0.029838044196367264, + 0.17708944343030453, + 0.9724760111421347, + 0.22447971068322659, + 0.2560677081346512, + 1.5209996439516544, + 0.2686384655535221, + 0.7749410513788462, + 0.37970733642578125, + 0.5355254095047712, + 0.47105327993631363, + 1.9762270133942366, + 0.199605418369174, + 0.30817529559135437, + 0.7905459273606539, + 1.122211493551731, + 0.22198533080518246, + 0.2555703166872263, + 0.0, + 0.5243311375379562, + 1.03703298792243, + 0.3942954447120428, + 0.41254627890884876, + 0.4314813707023859, + 0.19057950749993324, + 0.5809796452522278, + 0.7313492149114609, + 1.91583751142025, + 0.6724474057555199, + 0.7134639285504818, + 1.0534394718706608, + 0.20030396059155464, + 0.32167930342257023, + 0.5494107585400343 + ], + "unique_experts": 62, + "load_cv": 0.6516342458619923, + "normalized_load_entropy": 0.946361323946836, + "max_load_share": 0.04245283018867924 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "e749f50dce72afa52086e1515552cbfe33f820d76be1e8b4bd62da51fc9b7360", + "route_weight_sha256": "ad8b82ad66a33c5deb6b7be372408553a7bed52f858edd135a4717a03c075fee", + "loads": [ + 12, + 16, + 20, + 6, + 13, + 4, + 19, + 10, + 10, + 9, + 9, + 14, + 16, + 5, + 22, + 6, + 19, + 25, + 1, + 24, + 15, + 16, + 0, + 17, + 13, + 8, + 9, + 11, + 4, + 3, + 9, + 5, + 20, + 8, + 6, + 20, + 10, + 15, + 6, + 7, + 10, + 27, + 5, + 9, + 22, + 19, + 11, + 4, + 1, + 9, + 29, + 8, + 15, + 12, + 6, + 11, + 22, + 19, + 19, + 17, + 19, + 3, + 8, + 19 + ], + "weighted_loads": [ + 0.5130313690751791, + 1.514085065573454, + 1.3448288887739182, + 0.23202204331755638, + 0.7598170191049576, + 0.14821133390069008, + 1.4695489257574081, + 0.4721403028815985, + 0.6500114779919386, + 0.5022705439478159, + 0.5131158791482449, + 2.0872736237943172, + 1.1243238300085068, + 0.1920081041753292, + 1.188514657318592, + 0.4212239980697632, + 1.1768270321190357, + 2.4393654409796, + 0.02855641581118107, + 1.5234605763107538, + 1.2870285511016846, + 1.138151876628399, + 0.0, + 0.9816032946109772, + 0.8695021998137236, + 0.290755920112133, + 1.1767365839332342, + 0.5641597267240286, + 0.17116903886198997, + 0.09639121405780315, + 0.7806251123547554, + 0.17708944343030453, + 1.1507091987878084, + 0.2769687157124281, + 0.45947270654141903, + 1.5209996439516544, + 0.6097592636942863, + 0.7749410513788462, + 0.37970733642578125, + 0.5355254095047712, + 0.47105327993631363, + 1.9762270133942366, + 0.2523301262408495, + 0.45790648460388184, + 0.8293402995914221, + 1.122211493551731, + 0.4245165940374136, + 0.2555703166872263, + 0.03775276243686676, + 0.5243311375379562, + 1.3838788121938705, + 0.3942954447120428, + 1.049412401393056, + 0.4314813707023859, + 0.2380301058292389, + 0.5809796452522278, + 2.0677280593663454, + 2.336178082972765, + 0.9078652858734131, + 1.049470443278551, + 1.0534394718706608, + 0.20030396059155464, + 0.36286994256079197, + 0.6989555228501558 + ], + "unique_experts": 63, + "load_cv": 0.5590499301970974, + "normalized_load_entropy": 0.9592766896926236, + "max_load_share": 0.03689567430025445 + } + }, + "s1_period": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "a42a0151948191f0b302f6e7e3167b79b79bc3f7816c27c686ae6be0c63c0e9c", + "route_weight_sha256": "8aad7143fbe8de23befb4469dbedd3aea9933ab6b2bbe0a0ff174c757a82fab8", + "loads": [ + 12, + 16, + 20, + 5, + 10, + 5, + 19, + 8, + 10, + 4, + 5, + 10, + 16, + 1, + 7, + 6, + 20, + 13, + 2, + 25, + 14, + 15, + 0, + 18, + 6, + 8, + 4, + 4, + 5, + 3, + 1, + 5, + 15, + 7, + 3, + 21, + 4, + 15, + 7, + 7, + 10, + 27, + 3, + 7, + 17, + 17, + 7, + 4, + 0, + 9, + 20, + 11, + 6, + 15, + 4, + 12, + 6, + 11, + 13, + 18, + 19, + 2, + 6, + 16 + ], + "weighted_loads": [ + 0.5170557610690594, + 1.4920555353164673, + 1.3480890579521656, + 0.19640374556183815, + 0.6691770292818546, + 0.18333592638373375, + 1.4883595816791058, + 0.3100172821432352, + 0.6229286268353462, + 0.16640877351164818, + 0.22413216158747673, + 1.7578206211328506, + 1.1115899309515953, + 0.029842577874660492, + 0.5340028367936611, + 0.40140653401613235, + 1.1734420638531446, + 1.5851058848202229, + 0.07318379543721676, + 1.5697488114237785, + 1.1827045790851116, + 1.0987764578312635, + 0.0, + 1.0198205597698689, + 0.3884071558713913, + 0.2910585217177868, + 0.13495256006717682, + 0.2266555316746235, + 0.20646820589900017, + 0.10665654949843884, + 0.03019852377474308, + 0.17569918744266033, + 0.9225399997085333, + 0.22961776331067085, + 0.28325225971639156, + 1.560911476612091, + 0.2930760681629181, + 0.7599197998642921, + 0.41175349801778793, + 0.518336359411478, + 0.4648139700293541, + 1.941346200183034, + 0.17499282956123352, + 0.33823018334805965, + 0.66654422134161, + 1.039718957617879, + 0.2183024976402521, + 0.24786840938031673, + 0.0, + 0.5214446932077408, + 0.9929728377610445, + 0.46145731769502163, + 0.3759296275675297, + 0.5128969587385654, + 0.1674174703657627, + 0.6113984193652868, + 0.6514672301709652, + 1.8896561302244663, + 0.6961633265018463, + 0.8077063467353582, + 1.059421095997095, + 0.1668468341231346, + 0.2790660262107849, + 0.5664482526481152 + ], + "unique_experts": 62, + "load_cv": 0.6530894651210948, + "normalized_load_entropy": 0.9458063496178364, + "max_load_share": 0.04245283018867924 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "4807f3371458c04c7725fbc93855d4ea49f518d5ea5ed577269602ded834ac32", + "route_weight_sha256": "a9575db07fef3046cb133367372a49db7cb3793a008cc32232455aa36b625985", + "loads": [ + 12, + 16, + 20, + 6, + 13, + 7, + 19, + 10, + 10, + 12, + 13, + 16, + 16, + 2, + 21, + 11, + 20, + 20, + 2, + 25, + 14, + 20, + 6, + 18, + 16, + 9, + 15, + 15, + 5, + 5, + 10, + 6, + 21, + 8, + 9, + 21, + 16, + 20, + 10, + 8, + 11, + 27, + 6, + 11, + 17, + 18, + 11, + 5, + 1, + 11, + 27, + 11, + 18, + 17, + 8, + 14, + 26, + 21, + 23, + 25, + 21, + 2, + 9, + 19 + ], + "weighted_loads": [ + 0.5170557610690594, + 1.4920555353164673, + 1.3480890579521656, + 0.22421949915587902, + 0.8515891674906015, + 0.26402347162365913, + 1.4883595816791058, + 0.5206750575453043, + 0.6229286268353462, + 0.6589713227003813, + 1.0236766636371613, + 2.3692605309188366, + 1.1115899309515953, + 0.08316013216972351, + 1.366570807993412, + 0.701592642813921, + 1.1734420638531446, + 2.210127364844084, + 0.07318379543721676, + 1.5697488114237785, + 1.1827045790851116, + 1.4222994446754456, + 0.4537028521299362, + 1.0198205597698689, + 0.9329562447965145, + 0.3602864556014538, + 1.6188406832516193, + 0.703720323741436, + 0.20646820589900017, + 0.17565501667559147, + 0.9555596690624952, + 0.2546937745064497, + 1.158444257453084, + 0.2601539511233568, + 0.61780827306211, + 1.560911476612091, + 0.9606896601617336, + 1.0648144632577896, + 0.7012029848992825, + 0.5523850060999393, + 0.49591025710105896, + 1.941346200183034, + 0.2964498847723007, + 0.5399874169379473, + 0.66654422134161, + 1.0575353484600782, + 0.4637150224298239, + 0.28993927873671055, + 0.03590665012598038, + 0.6752324998378754, + 1.2916159238666296, + 0.46145731769502163, + 1.2685269564390182, + 0.7116184942424297, + 0.4203440509736538, + 0.7304327692836523, + 2.651363827288151, + 2.6889664456248283, + 1.2593376524746418, + 1.3988388888537884, + 1.29763737693429, + 0.1668468341231346, + 0.4016144182533026, + 0.7178268432617188 + ], + "unique_experts": 64, + "load_cv": 0.4820874477086488, + "normalized_load_entropy": 0.9691062907235576, + "max_load_share": 0.030612244897959183 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 106, + "ordered_topk_exact_tokens": 70, + "set_exact_tokens": 84, + "mean_set_jaccard": 0.9386792452830188, + "mean_token_weighted_tv": 0.01147618877508168, + "aggregate_load_tv": 0.02515723270440251 + }, + "system_bos": { + "tokens": 106, + "ordered_topk_exact_tokens": 69, + "set_exact_tokens": 78, + "mean_set_jaccard": 0.9245283018867925, + "mean_token_weighted_tv": 0.014444219844661793, + "aggregate_load_tv": 0.03459119496855346 + }, + "system_x": { + "tokens": 106, + "ordered_topk_exact_tokens": 60, + "set_exact_tokens": 71, + "mean_set_jaccard": 0.9016172506738545, + "mean_token_weighted_tv": 0.01882131519850414, + "aggregate_load_tv": 0.034591194968553465 + }, + "system_period": { + "tokens": 106, + "ordered_topk_exact_tokens": 57, + "set_exact_tokens": 69, + "mean_set_jaccard": 0.8921832884097036, + "mean_token_weighted_tv": 0.01998034960432154, + "aggregate_load_tv": 0.03459119496855346 + }, + "bos_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 69, + "set_exact_tokens": 81, + "mean_set_jaccard": 0.9305929919137466, + "mean_token_weighted_tv": 0.014126793885568404, + "aggregate_load_tv": 0.028301886792452827 + }, + "bos_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 59, + "set_exact_tokens": 74, + "mean_set_jaccard": 0.9097035040431267, + "mean_token_weighted_tv": 0.01670690884216214, + "aggregate_load_tv": 0.03459119496855345 + }, + "x_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 59, + "set_exact_tokens": 73, + "mean_set_jaccard": 0.9090296495956873, + "mean_token_weighted_tv": 0.016971581009269324, + "aggregate_load_tv": 0.02830188679245283 + }, + "x_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 55, + "set_exact_tokens": 71, + "mean_set_jaccard": 0.8975741239892183, + "mean_token_weighted_tv": 0.020308282718343555, + "aggregate_load_tv": 0.03616352201257861 + }, + "period_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 59, + "set_exact_tokens": 72, + "mean_set_jaccard": 0.9063342318059299, + "mean_token_weighted_tv": 0.016515497030374013, + "aggregate_load_tv": 0.029874213836477984 + }, + "period_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 55, + "set_exact_tokens": 65, + "mean_set_jaccard": 0.881401617250674, + "mean_token_weighted_tv": 0.021661920481765608, + "aggregate_load_tv": 0.040880503144654086 + } + } + } + } + } + ], + "summary": { + "sources": 4, + "conditions_per_source": 8, + "decoder_layers_executed": 27, + "moe_gates_executed": 26, + "hidden_stages": 29, + "target_content_tokens_per_condition": 362, + "target_route_decisions": 451776, + "hidden": { + "embedding": { + "system_eos": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 362, + "token_weighted_mean_cosine_similarity": 1.0, + "source_mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "system_bos": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 362, + "token_weighted_mean_cosine_similarity": 1.0, + "source_mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "system_x": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 362, + "token_weighted_mean_cosine_similarity": 1.0, + "source_mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "system_period": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 362, + "token_weighted_mean_cosine_similarity": 1.0, + "source_mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "bos_at_s0": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 362, + "token_weighted_mean_cosine_similarity": 1.0, + "source_mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "bos_at_s1": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 362, + "token_weighted_mean_cosine_similarity": 1.0, + "source_mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "x_at_s0": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 362, + "token_weighted_mean_cosine_similarity": 1.0, + "source_mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "x_at_s1": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 362, + "token_weighted_mean_cosine_similarity": 1.0, + "source_mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "period_at_s0": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 362, + "token_weighted_mean_cosine_similarity": 1.0, + "source_mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "period_at_s1": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 362, + "token_weighted_mean_cosine_similarity": 1.0, + "source_mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + } + }, + "layer_00": { + "system_eos": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9994806089124627, + "source_mean_relative_l2": 0.02687328075990081, + "max_abs_delta": 0.1484375 + }, + "system_bos": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9992658360886969, + "source_mean_relative_l2": 0.03282219683751464, + "max_abs_delta": 0.1328125 + }, + "system_x": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9993020218709556, + "source_mean_relative_l2": 0.03216928988695145, + "max_abs_delta": 0.1328125 + }, + "system_period": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.99933077979483, + "source_mean_relative_l2": 0.03130611637607217, + "max_abs_delta": 0.1328125 + }, + "bos_at_s0": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9904210718955783, + "source_mean_relative_l2": 0.1414784248918295, + "max_abs_delta": 0.25244140625 + }, + "bos_at_s1": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9914189027159254, + "source_mean_relative_l2": 0.13426918350160122, + "max_abs_delta": 0.2421875 + }, + "x_at_s0": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9911955973720024, + "source_mean_relative_l2": 0.1362858135253191, + "max_abs_delta": 0.25048828125 + }, + "x_at_s1": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9919918920453741, + "source_mean_relative_l2": 0.13011132180690765, + "max_abs_delta": 0.2421875 + }, + "period_at_s0": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9913217883083701, + "source_mean_relative_l2": 0.13529949076473713, + "max_abs_delta": 0.265625 + }, + "period_at_s1": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9920752111060843, + "source_mean_relative_l2": 0.12934806384146214, + "max_abs_delta": 0.25 + } + }, + "layer_01": { + "system_eos": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9989723675158801, + "source_mean_relative_l2": 0.04162977263331413, + "max_abs_delta": 0.1171875 + }, + "system_bos": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9967627951782712, + "source_mean_relative_l2": 0.07570159435272217, + "max_abs_delta": 0.318359375 + }, + "system_x": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9956388111272569, + "source_mean_relative_l2": 0.08783170767128468, + "max_abs_delta": 0.2783203125 + }, + "system_period": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9957797140377003, + "source_mean_relative_l2": 0.08610695227980614, + "max_abs_delta": 0.2568359375 + }, + "bos_at_s0": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9900108159247024, + "source_mean_relative_l2": 0.14403938502073288, + "max_abs_delta": 0.3544921875 + }, + "bos_at_s1": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.989774843276535, + "source_mean_relative_l2": 0.14479755237698555, + "max_abs_delta": 0.279296875 + }, + "x_at_s0": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9910605294599059, + "source_mean_relative_l2": 0.13542568124830723, + "max_abs_delta": 0.33203125 + }, + "x_at_s1": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9890726959507768, + "source_mean_relative_l2": 0.14909734949469566, + "max_abs_delta": 0.359375 + }, + "period_at_s0": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9912346718390344, + "source_mean_relative_l2": 0.1344184037297964, + "max_abs_delta": 0.330078125 + }, + "period_at_s1": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9891781887626121, + "source_mean_relative_l2": 0.1482384093105793, + "max_abs_delta": 0.34765625 + } + }, + "layer_02": { + "system_eos": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9987279836973433, + "source_mean_relative_l2": 0.048137346282601357, + "max_abs_delta": 0.1796875 + }, + "system_bos": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9960600992263351, + "source_mean_relative_l2": 0.08645489439368248, + "max_abs_delta": 0.3486328125 + }, + "system_x": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9946251124637562, + "source_mean_relative_l2": 0.09965121373534203, + "max_abs_delta": 0.34375 + }, + "system_period": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9948075691968696, + "source_mean_relative_l2": 0.09787163138389587, + "max_abs_delta": 0.3125 + }, + "bos_at_s0": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9904358502251008, + "source_mean_relative_l2": 0.1400531753897667, + "max_abs_delta": 0.4296875 + }, + "bos_at_s1": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9890389409513105, + "source_mean_relative_l2": 0.15065935626626015, + "max_abs_delta": 0.46484375 + }, + "x_at_s0": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9904516059390748, + "source_mean_relative_l2": 0.13958209566771984, + "max_abs_delta": 0.5390625 + }, + "x_at_s1": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.987142839978413, + "source_mean_relative_l2": 0.1626097969710827, + "max_abs_delta": 0.5859375 + }, + "period_at_s0": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9904992591939579, + "source_mean_relative_l2": 0.1396325845271349, + "max_abs_delta": 0.51953125 + }, + "period_at_s1": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9871456125823174, + "source_mean_relative_l2": 0.16244494915008545, + "max_abs_delta": 0.5703125 + } + }, + "layer_03": { + "system_eos": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9986999311499832, + "source_mean_relative_l2": 0.0486255893483758, + "max_abs_delta": 0.203125 + }, + "system_bos": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9959828252621119, + "source_mean_relative_l2": 0.0879083164036274, + "max_abs_delta": 0.34375 + }, + "system_x": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9942379188801044, + "source_mean_relative_l2": 0.10316403023898602, + "max_abs_delta": 0.328125 + }, + "system_period": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9943444066943384, + "source_mean_relative_l2": 0.1025701779872179, + "max_abs_delta": 0.328125 + }, + "bos_at_s0": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9914354321377054, + "source_mean_relative_l2": 0.13342145644128323, + "max_abs_delta": 0.4296875 + }, + "bos_at_s1": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9897690843482044, + "source_mean_relative_l2": 0.14578822255134583, + "max_abs_delta": 0.46875 + }, + "x_at_s0": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.991140966092684, + "source_mean_relative_l2": 0.1337098516523838, + "max_abs_delta": 0.5625 + }, + "x_at_s1": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9874137891919573, + "source_mean_relative_l2": 0.15942208841443062, + "max_abs_delta": 0.5546875 + }, + "period_at_s0": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9912660661981909, + "source_mean_relative_l2": 0.13272184319794178, + "max_abs_delta": 0.5546875 + }, + "period_at_s1": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9872720914980324, + "source_mean_relative_l2": 0.15975040569901466, + "max_abs_delta": 0.515625 + } + }, + "layer_04": { + "system_eos": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9987448873770172, + "source_mean_relative_l2": 0.047712523490190506, + "max_abs_delta": 0.21875 + }, + "system_bos": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.996374060106541, + "source_mean_relative_l2": 0.08527215011417866, + "max_abs_delta": 0.34375 + }, + "system_x": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9945330598407028, + "source_mean_relative_l2": 0.10310089774429798, + "max_abs_delta": 0.5 + }, + "system_period": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9945144274616768, + "source_mean_relative_l2": 0.10306865349411964, + "max_abs_delta": 0.46875 + }, + "bos_at_s0": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9931938485216699, + "source_mean_relative_l2": 0.11874567531049252, + "max_abs_delta": 0.515625 + }, + "bos_at_s1": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9915644216932644, + "source_mean_relative_l2": 0.132058247923851, + "max_abs_delta": 0.625 + }, + "x_at_s0": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9924339326047107, + "source_mean_relative_l2": 0.12322361581027508, + "max_abs_delta": 0.67578125 + }, + "x_at_s1": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9886825937592523, + "source_mean_relative_l2": 0.15176014974713326, + "max_abs_delta": 0.728515625 + }, + "period_at_s0": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9924242819211759, + "source_mean_relative_l2": 0.12232333235442638, + "max_abs_delta": 0.6728515625 + }, + "period_at_s1": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9884890928782152, + "source_mean_relative_l2": 0.15222014486789703, + "max_abs_delta": 0.7734375 + } + }, + "layer_05": { + "system_eos": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9982875396204258, + "source_mean_relative_l2": 0.05610264465212822, + "max_abs_delta": 0.22265625 + }, + "system_bos": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9956944463002747, + "source_mean_relative_l2": 0.09218199923634529, + "max_abs_delta": 0.34375 + }, + "system_x": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9931571172416539, + "source_mean_relative_l2": 0.11521548591554165, + "max_abs_delta": 0.433837890625 + }, + "system_period": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9930050111277986, + "source_mean_relative_l2": 0.11622392572462559, + "max_abs_delta": 0.421875 + }, + "bos_at_s0": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.992414818448915, + "source_mean_relative_l2": 0.12313361279666424, + "max_abs_delta": 0.59375 + }, + "bos_at_s1": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9907003502819419, + "source_mean_relative_l2": 0.13611841946840286, + "max_abs_delta": 0.6748046875 + }, + "x_at_s0": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9914776129617217, + "source_mean_relative_l2": 0.12951453775167465, + "max_abs_delta": 0.78515625 + }, + "x_at_s1": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9871745043696619, + "source_mean_relative_l2": 0.159038707613945, + "max_abs_delta": 0.8857421875 + }, + "period_at_s0": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9915121563231748, + "source_mean_relative_l2": 0.12832914106547832, + "max_abs_delta": 0.7734375 + }, + "period_at_s1": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9869446324709371, + "source_mean_relative_l2": 0.15984711423516273, + "max_abs_delta": 0.9765625 + } + }, + "layer_06": { + "system_eos": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9980280099652749, + "source_mean_relative_l2": 0.059489818289875984, + "max_abs_delta": 0.53125 + }, + "system_bos": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.995592407923377, + "source_mean_relative_l2": 0.0917061660438776, + "max_abs_delta": 0.53125 + }, + "system_x": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9926443821158857, + "source_mean_relative_l2": 0.11822178587317467, + "max_abs_delta": 0.6875 + }, + "system_period": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9924254086465467, + "source_mean_relative_l2": 0.12008173950016499, + "max_abs_delta": 0.75 + }, + "bos_at_s0": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9929789541834626, + "source_mean_relative_l2": 0.11644237861037254, + "max_abs_delta": 0.671875 + }, + "bos_at_s1": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9914418460585136, + "source_mean_relative_l2": 0.12898368947207928, + "max_abs_delta": 0.6015625 + }, + "x_at_s0": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9918605942093865, + "source_mean_relative_l2": 0.12597420625388622, + "max_abs_delta": 1.0283203125 + }, + "x_at_s1": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9873358699498256, + "source_mean_relative_l2": 0.15701978653669357, + "max_abs_delta": 1.2236328125 + }, + "period_at_s0": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9917831985660679, + "source_mean_relative_l2": 0.12508670426905155, + "max_abs_delta": 1.05859375 + }, + "period_at_s1": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9868288818973204, + "source_mean_relative_l2": 0.15916423499584198, + "max_abs_delta": 1.3095703125 + } + }, + "layer_07": { + "system_eos": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9976726854374396, + "source_mean_relative_l2": 0.06444285716861486, + "max_abs_delta": 0.421875 + }, + "system_bos": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9950344819390313, + "source_mean_relative_l2": 0.09652220271527767, + "max_abs_delta": 0.625 + }, + "system_x": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9916802198518047, + "source_mean_relative_l2": 0.12428629025816917, + "max_abs_delta": 0.75 + }, + "system_period": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9915676540103406, + "source_mean_relative_l2": 0.12566916272044182, + "max_abs_delta": 0.65625 + }, + "bos_at_s0": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9924671328858118, + "source_mean_relative_l2": 0.1199086382985115, + "max_abs_delta": 0.724609375 + }, + "bos_at_s1": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9909616707108956, + "source_mean_relative_l2": 0.13029347360134125, + "max_abs_delta": 0.8125 + }, + "x_at_s0": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9911716437142198, + "source_mean_relative_l2": 0.1305361520498991, + "max_abs_delta": 1.171875 + }, + "x_at_s1": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.986413698499374, + "source_mean_relative_l2": 0.16145308688282967, + "max_abs_delta": 1.3994140625 + }, + "period_at_s0": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9911013397063998, + "source_mean_relative_l2": 0.12985962256789207, + "max_abs_delta": 1.125 + }, + "period_at_s1": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.985924593816146, + "source_mean_relative_l2": 0.16368545219302177, + "max_abs_delta": 1.3994140625 + } + }, + "layer_08": { + "system_eos": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9971454662183372, + "source_mean_relative_l2": 0.06999542377889156, + "max_abs_delta": 0.78125 + }, + "system_bos": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9944880370935683, + "source_mean_relative_l2": 0.10132874548435211, + "max_abs_delta": 0.5625 + }, + "system_x": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9902811659633785, + "source_mean_relative_l2": 0.13395505584776402, + "max_abs_delta": 0.90625 + }, + "system_period": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9903421700000763, + "source_mean_relative_l2": 0.13522289134562016, + "max_abs_delta": 0.875 + }, + "bos_at_s0": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.991853283090486, + "source_mean_relative_l2": 0.12350798584520817, + "max_abs_delta": 0.84375 + }, + "bos_at_s1": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9902784771682149, + "source_mean_relative_l2": 0.13384709507226944, + "max_abs_delta": 0.828125 + }, + "x_at_s0": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9902629001035216, + "source_mean_relative_l2": 0.13740837574005127, + "max_abs_delta": 1.3125 + }, + "x_at_s1": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9851026329217036, + "source_mean_relative_l2": 0.16824854537844658, + "max_abs_delta": 1.466796875 + }, + "period_at_s0": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9901294996395954, + "source_mean_relative_l2": 0.13706321455538273, + "max_abs_delta": 1.3125 + }, + "period_at_s1": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9848923376910594, + "source_mean_relative_l2": 0.1695690155029297, + "max_abs_delta": 1.25 + } + }, + "layer_09": { + "system_eos": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9971187254671234, + "source_mean_relative_l2": 0.0691371550783515, + "max_abs_delta": 1.1875 + }, + "system_bos": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9948404314438941, + "source_mean_relative_l2": 0.09689535573124886, + "max_abs_delta": 0.75 + }, + "system_x": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9903403981614508, + "source_mean_relative_l2": 0.13072161935269833, + "max_abs_delta": 1.84375 + }, + "system_period": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9906261410173132, + "source_mean_relative_l2": 0.13114848174154758, + "max_abs_delta": 1.5 + }, + "bos_at_s0": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9924692341965207, + "source_mean_relative_l2": 0.11671219021081924, + "max_abs_delta": 1.15625 + }, + "bos_at_s1": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9911022164874314, + "source_mean_relative_l2": 0.1259345319122076, + "max_abs_delta": 1.0625 + }, + "x_at_s0": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9909941547483371, + "source_mean_relative_l2": 0.1300618089735508, + "max_abs_delta": 1.640625 + }, + "x_at_s1": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9857263660562631, + "source_mean_relative_l2": 0.1621253453195095, + "max_abs_delta": 2.25 + }, + "period_at_s0": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9909225293944554, + "source_mean_relative_l2": 0.12995763681828976, + "max_abs_delta": 1.53125 + }, + "period_at_s1": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9859202204488259, + "source_mean_relative_l2": 0.16149339824914932, + "max_abs_delta": 1.75 + } + }, + "layer_10": { + "system_eos": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9966602024123155, + "source_mean_relative_l2": 0.07445487938821316, + "max_abs_delta": 1.65625 + }, + "system_bos": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9941757935516083, + "source_mean_relative_l2": 0.1029715146869421, + "max_abs_delta": 0.75 + }, + "system_x": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9893514266988849, + "source_mean_relative_l2": 0.13577578403055668, + "max_abs_delta": 1.9375 + }, + "system_period": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9896172596275478, + "source_mean_relative_l2": 0.13702654093503952, + "max_abs_delta": 1.625 + }, + "bos_at_s0": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9917231452399196, + "source_mean_relative_l2": 0.12156067043542862, + "max_abs_delta": 1.4375 + }, + "bos_at_s1": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9902971016438626, + "source_mean_relative_l2": 0.13056488893926144, + "max_abs_delta": 1.140625 + }, + "x_at_s0": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9901037851749863, + "source_mean_relative_l2": 0.13586273789405823, + "max_abs_delta": 1.9375 + }, + "x_at_s1": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9844614998411737, + "source_mean_relative_l2": 0.16854194551706314, + "max_abs_delta": 3.171875 + }, + "period_at_s0": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9901189957205103, + "source_mean_relative_l2": 0.13556873425841331, + "max_abs_delta": 2.1875 + }, + "period_at_s1": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9847132576763301, + "source_mean_relative_l2": 0.16846636310219765, + "max_abs_delta": 3.15625 + } + }, + "layer_11": { + "system_eos": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9967226631404287, + "source_mean_relative_l2": 0.07262226566672325, + "max_abs_delta": 1.8125 + }, + "system_bos": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.994777066437579, + "source_mean_relative_l2": 0.09667569771409035, + "max_abs_delta": 1.0625 + }, + "system_x": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9901622943785968, + "source_mean_relative_l2": 0.1287365648895502, + "max_abs_delta": 2.75 + }, + "system_period": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9902134305535101, + "source_mean_relative_l2": 0.1312856450676918, + "max_abs_delta": 3.09375 + }, + "bos_at_s0": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9926928191224514, + "source_mean_relative_l2": 0.11201104335486889, + "max_abs_delta": 1.875 + }, + "bos_at_s1": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9912750804951178, + "source_mean_relative_l2": 0.12150241062045097, + "max_abs_delta": 1.625 + }, + "x_at_s0": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9911999666229796, + "source_mean_relative_l2": 0.12603610754013062, + "max_abs_delta": 2.3125 + }, + "x_at_s1": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9862782482613516, + "source_mean_relative_l2": 0.15643779188394547, + "max_abs_delta": 3.75 + }, + "period_at_s0": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9912295713609095, + "source_mean_relative_l2": 0.12552844546735287, + "max_abs_delta": 2.53125 + }, + "period_at_s1": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9863657225232098, + "source_mean_relative_l2": 0.1569502092897892, + "max_abs_delta": 5.25 + } + }, + "layer_12": { + "system_eos": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9959219509725412, + "source_mean_relative_l2": 0.07923348061740398, + "max_abs_delta": 1.71875 + }, + "system_bos": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9938964107747894, + "source_mean_relative_l2": 0.10326745547354221, + "max_abs_delta": 1.5078125 + }, + "system_x": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9887406012629936, + "source_mean_relative_l2": 0.135897321626544, + "max_abs_delta": 3.0 + }, + "system_period": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9888657891289305, + "source_mean_relative_l2": 0.13813655078411102, + "max_abs_delta": 2.3125 + }, + "bos_at_s0": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9916328191757202, + "source_mean_relative_l2": 0.11920908465981483, + "max_abs_delta": 3.0625 + }, + "bos_at_s1": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9900903100796168, + "source_mean_relative_l2": 0.12815961614251137, + "max_abs_delta": 2.5 + }, + "x_at_s0": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9900004881850922, + "source_mean_relative_l2": 0.1335229743272066, + "max_abs_delta": 3.53125 + }, + "x_at_s1": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9847466962113565, + "source_mean_relative_l2": 0.16444944217801094, + "max_abs_delta": 2.875 + }, + "period_at_s0": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9900095278386911, + "source_mean_relative_l2": 0.13262572512030602, + "max_abs_delta": 4.15625 + }, + "period_at_s1": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.984682252229248, + "source_mean_relative_l2": 0.16584504395723343, + "max_abs_delta": 5.15625 + } + }, + "layer_13": { + "system_eos": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.995716914452242, + "source_mean_relative_l2": 0.08095184527337551, + "max_abs_delta": 2.21875 + }, + "system_bos": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9936372716782501, + "source_mean_relative_l2": 0.1044508945196867, + "max_abs_delta": 1.796875 + }, + "system_x": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9883305608238304, + "source_mean_relative_l2": 0.13755874149501324, + "max_abs_delta": 2.9375 + }, + "system_period": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9885124047158173, + "source_mean_relative_l2": 0.1393746118992567, + "max_abs_delta": 2.375 + }, + "bos_at_s0": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9912524796322565, + "source_mean_relative_l2": 0.1212880127131939, + "max_abs_delta": 3.1875 + }, + "bos_at_s1": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9898148276199952, + "source_mean_relative_l2": 0.12887270003557205, + "max_abs_delta": 3.8125 + }, + "x_at_s0": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9894725039848307, + "source_mean_relative_l2": 0.13574057817459106, + "max_abs_delta": 4.3125 + }, + "x_at_s1": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9844378608366402, + "source_mean_relative_l2": 0.1653139479458332, + "max_abs_delta": 3.0625 + }, + "period_at_s0": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9895650342683107, + "source_mean_relative_l2": 0.1341753751039505, + "max_abs_delta": 5.15625 + }, + "period_at_s1": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9844111556506289, + "source_mean_relative_l2": 0.16628297045826912, + "max_abs_delta": 5.65625 + } + }, + "layer_14": { + "system_eos": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9954713979808006, + "source_mean_relative_l2": 0.08314980007708073, + "max_abs_delta": 2.0625 + }, + "system_bos": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9935238119317682, + "source_mean_relative_l2": 0.10487505048513412, + "max_abs_delta": 1.625 + }, + "system_x": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9878655291723283, + "source_mean_relative_l2": 0.1398953925818205, + "max_abs_delta": 4.8125 + }, + "system_period": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9879804246992038, + "source_mean_relative_l2": 0.14220653101801872, + "max_abs_delta": 3.875 + }, + "bos_at_s0": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.991202313597031, + "source_mean_relative_l2": 0.1216374821960926, + "max_abs_delta": 3.0625 + }, + "bos_at_s1": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9899257136642604, + "source_mean_relative_l2": 0.1281423568725586, + "max_abs_delta": 2.79638671875 + }, + "x_at_s0": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9894455959454426, + "source_mean_relative_l2": 0.13537127524614334, + "max_abs_delta": 3.9375 + }, + "x_at_s1": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9844463851241118, + "source_mean_relative_l2": 0.1645343415439129, + "max_abs_delta": 4.4375 + }, + "period_at_s0": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9895792707224578, + "source_mean_relative_l2": 0.1330706775188446, + "max_abs_delta": 5.125 + }, + "period_at_s1": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9843426746887397, + "source_mean_relative_l2": 0.16611958295106888, + "max_abs_delta": 5.71875 + } + }, + "layer_15": { + "system_eos": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9951592449983839, + "source_mean_relative_l2": 0.08477818220853806, + "max_abs_delta": 2.375 + }, + "system_bos": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9932573605637524, + "source_mean_relative_l2": 0.10627317428588867, + "max_abs_delta": 2.75 + }, + "system_x": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9869014107061355, + "source_mean_relative_l2": 0.14364391565322876, + "max_abs_delta": 6.5 + }, + "system_period": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9872503114339396, + "source_mean_relative_l2": 0.14524320885539055, + "max_abs_delta": 5.625 + }, + "bos_at_s0": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9908631646501426, + "source_mean_relative_l2": 0.12167174369096756, + "max_abs_delta": 3.25 + }, + "bos_at_s1": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9897652128454071, + "source_mean_relative_l2": 0.12803087197244167, + "max_abs_delta": 3.3828125 + }, + "x_at_s0": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9892048359905159, + "source_mean_relative_l2": 0.13508151657879353, + "max_abs_delta": 3.9375 + }, + "x_at_s1": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.983936536213311, + "source_mean_relative_l2": 0.16537272930145264, + "max_abs_delta": 5.875 + }, + "period_at_s0": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9892855793731647, + "source_mean_relative_l2": 0.13299847207963467, + "max_abs_delta": 4.4375 + }, + "period_at_s1": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9836536081127041, + "source_mean_relative_l2": 0.16773514822125435, + "max_abs_delta": 6.46875 + } + }, + "layer_16": { + "system_eos": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9950226520635805, + "source_mean_relative_l2": 0.08591880276799202, + "max_abs_delta": 2.46875 + }, + "system_bos": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9930240404869312, + "source_mean_relative_l2": 0.10776606574654579, + "max_abs_delta": 3.6875 + }, + "system_x": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9863411125557199, + "source_mean_relative_l2": 0.14531600661575794, + "max_abs_delta": 7.375 + }, + "system_period": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.986963017210776, + "source_mean_relative_l2": 0.14642241783440113, + "max_abs_delta": 5.53125 + }, + "bos_at_s0": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9906882762250321, + "source_mean_relative_l2": 0.12250007875263691, + "max_abs_delta": 3.25 + }, + "bos_at_s1": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9895905934644668, + "source_mean_relative_l2": 0.12836803123354912, + "max_abs_delta": 3.798828125 + }, + "x_at_s0": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9889104573766171, + "source_mean_relative_l2": 0.1365127842873335, + "max_abs_delta": 3.65625 + }, + "x_at_s1": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9838652097059218, + "source_mean_relative_l2": 0.1651686690747738, + "max_abs_delta": 6.25 + }, + "period_at_s0": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9891661278779994, + "source_mean_relative_l2": 0.1335543617606163, + "max_abs_delta": 4.0625 + }, + "period_at_s1": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9835892064466002, + "source_mean_relative_l2": 0.16790993139147758, + "max_abs_delta": 6.4375 + } + }, + "layer_17": { + "system_eos": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9953557573958655, + "source_mean_relative_l2": 0.08349586091935635, + "max_abs_delta": 2.5625 + }, + "system_bos": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9934261775477815, + "source_mean_relative_l2": 0.10507036931812763, + "max_abs_delta": 3.875 + }, + "system_x": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9871119593388468, + "source_mean_relative_l2": 0.14146987162530422, + "max_abs_delta": 7.78125 + }, + "system_period": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9877619657727236, + "source_mean_relative_l2": 0.14195030741393566, + "max_abs_delta": 5.875 + }, + "bos_at_s0": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9913929145968421, + "source_mean_relative_l2": 0.11835209652781487, + "max_abs_delta": 3.875 + }, + "bos_at_s1": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9903962770219665, + "source_mean_relative_l2": 0.12377476878464222, + "max_abs_delta": 4.1953125 + }, + "x_at_s0": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9896961822694178, + "source_mean_relative_l2": 0.1324483547359705, + "max_abs_delta": 4.09375 + }, + "x_at_s1": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9851697798591951, + "source_mean_relative_l2": 0.1594161055982113, + "max_abs_delta": 6.375 + }, + "period_at_s0": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9899912657658698, + "source_mean_relative_l2": 0.12906114384531975, + "max_abs_delta": 3.4375 + }, + "period_at_s1": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9849628697442745, + "source_mean_relative_l2": 0.16147689521312714, + "max_abs_delta": 4.25 + } + }, + "layer_18": { + "system_eos": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9953018059717358, + "source_mean_relative_l2": 0.08379390463232994, + "max_abs_delta": 2.8125 + }, + "system_bos": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9934723629147967, + "source_mean_relative_l2": 0.10422959923744202, + "max_abs_delta": 4.625 + }, + "system_x": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9868319614157492, + "source_mean_relative_l2": 0.14307484962046146, + "max_abs_delta": 9.5 + }, + "system_period": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9873932511108356, + "source_mean_relative_l2": 0.1437139306217432, + "max_abs_delta": 7.5 + }, + "bos_at_s0": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9914366204435654, + "source_mean_relative_l2": 0.11729543283581734, + "max_abs_delta": 4.34765625 + }, + "bos_at_s1": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9903608015558337, + "source_mean_relative_l2": 0.1235150508582592, + "max_abs_delta": 5.66796875 + }, + "x_at_s0": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.989721859686941, + "source_mean_relative_l2": 0.13136678002774715, + "max_abs_delta": 5.125 + }, + "x_at_s1": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9851266081491228, + "source_mean_relative_l2": 0.15931980311870575, + "max_abs_delta": 8.25 + }, + "period_at_s0": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9899770535158189, + "source_mean_relative_l2": 0.12830394878983498, + "max_abs_delta": 4.3125 + }, + "period_at_s1": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9847831744186127, + "source_mean_relative_l2": 0.16177145019173622, + "max_abs_delta": 6.0 + } + }, + "layer_19": { + "system_eos": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9951662217055895, + "source_mean_relative_l2": 0.08487173542380333, + "max_abs_delta": 4.3125 + }, + "system_bos": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9934906776768068, + "source_mean_relative_l2": 0.10462883301079273, + "max_abs_delta": 4.09375 + }, + "system_x": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9866711907294574, + "source_mean_relative_l2": 0.14348747953772545, + "max_abs_delta": 9.0 + }, + "system_period": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9874872114118292, + "source_mean_relative_l2": 0.1434745118021965, + "max_abs_delta": 7.25 + }, + "bos_at_s0": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9911608472054835, + "source_mean_relative_l2": 0.11883007548749447, + "max_abs_delta": 4.46875 + }, + "bos_at_s1": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9902303772078035, + "source_mean_relative_l2": 0.123918192461133, + "max_abs_delta": 8.0625 + }, + "x_at_s0": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9895840884901542, + "source_mean_relative_l2": 0.13236168213188648, + "max_abs_delta": 4.25 + }, + "x_at_s1": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9847700748983668, + "source_mean_relative_l2": 0.16073708422482014, + "max_abs_delta": 7.5 + }, + "period_at_s0": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.989919102323648, + "source_mean_relative_l2": 0.12915919721126556, + "max_abs_delta": 3.59375 + }, + "period_at_s1": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9847713939392764, + "source_mean_relative_l2": 0.16236424818634987, + "max_abs_delta": 5.375 + } + }, + "layer_20": { + "system_eos": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9952042809178158, + "source_mean_relative_l2": 0.08585092797875404, + "max_abs_delta": 3.75 + }, + "system_bos": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9936752735909836, + "source_mean_relative_l2": 0.10381054319441319, + "max_abs_delta": 3.65625 + }, + "system_x": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9865950189572013, + "source_mean_relative_l2": 0.14575417153537273, + "max_abs_delta": 8.5 + }, + "system_period": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9870973071340698, + "source_mean_relative_l2": 0.14780616387724876, + "max_abs_delta": 6.25 + }, + "bos_at_s0": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.991319021961307, + "source_mean_relative_l2": 0.11773738265037537, + "max_abs_delta": 5.0625 + }, + "bos_at_s1": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9904628412499612, + "source_mean_relative_l2": 0.12290443480014801, + "max_abs_delta": 6.625 + }, + "x_at_s0": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9897614947998721, + "source_mean_relative_l2": 0.13134975917637348, + "max_abs_delta": 5.875 + }, + "x_at_s1": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9847904947581212, + "source_mean_relative_l2": 0.1623585969209671, + "max_abs_delta": 7.625 + }, + "period_at_s0": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9901119187391924, + "source_mean_relative_l2": 0.12759209237992764, + "max_abs_delta": 4.375 + }, + "period_at_s1": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9846787949951973, + "source_mean_relative_l2": 0.1644841469824314, + "max_abs_delta": 5.125 + } + }, + "layer_21": { + "system_eos": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9945620196300317, + "source_mean_relative_l2": 0.09182966686785221, + "max_abs_delta": 4.8125 + }, + "system_bos": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9931955253551019, + "source_mean_relative_l2": 0.1079721674323082, + "max_abs_delta": 4.25 + }, + "system_x": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.984898981797761, + "source_mean_relative_l2": 0.15545819513499737, + "max_abs_delta": 8.375 + }, + "system_period": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9853168581072138, + "source_mean_relative_l2": 0.15822269022464752, + "max_abs_delta": 6.75 + }, + "bos_at_s0": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9904067692506379, + "source_mean_relative_l2": 0.12317360751330853, + "max_abs_delta": 5.1640625 + }, + "bos_at_s1": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.989549423943567, + "source_mean_relative_l2": 0.1281946785748005, + "max_abs_delta": 6.76171875 + }, + "x_at_s0": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9888362746212364, + "source_mean_relative_l2": 0.13619367219507694, + "max_abs_delta": 7.0 + }, + "x_at_s1": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9830994245426431, + "source_mean_relative_l2": 0.1707014963030815, + "max_abs_delta": 7.5625 + }, + "period_at_s0": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9891352139783828, + "source_mean_relative_l2": 0.13220036029815674, + "max_abs_delta": 5.0 + }, + "period_at_s1": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9831009614204175, + "source_mean_relative_l2": 0.17182442173361778, + "max_abs_delta": 5.25 + } + }, + "layer_22": { + "system_eos": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9942481200010078, + "source_mean_relative_l2": 0.09348548762500286, + "max_abs_delta": 4.875 + }, + "system_bos": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9929286384780104, + "source_mean_relative_l2": 0.10940037854015827, + "max_abs_delta": 4.5 + }, + "system_x": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9843982003670371, + "source_mean_relative_l2": 0.15771857276558876, + "max_abs_delta": 9.25 + }, + "system_period": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9845747150768891, + "source_mean_relative_l2": 0.16190561093389988, + "max_abs_delta": 8.25 + }, + "bos_at_s0": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9897668588885945, + "source_mean_relative_l2": 0.12534299865365028, + "max_abs_delta": 5.25 + }, + "bos_at_s1": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9890458809407376, + "source_mean_relative_l2": 0.13006047159433365, + "max_abs_delta": 7.078125 + }, + "x_at_s0": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9883283761983418, + "source_mean_relative_l2": 0.13791055232286453, + "max_abs_delta": 6.625 + }, + "x_at_s1": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9827276855213207, + "source_mean_relative_l2": 0.17177232913672924, + "max_abs_delta": 7.5 + }, + "period_at_s0": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9886259672062173, + "source_mean_relative_l2": 0.1337152011692524, + "max_abs_delta": 5.125 + }, + "period_at_s1": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9826726696109245, + "source_mean_relative_l2": 0.17317623645067215, + "max_abs_delta": 7.25 + } + }, + "layer_23": { + "system_eos": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9950836786578373, + "source_mean_relative_l2": 0.08753316570073366, + "max_abs_delta": 6.0 + }, + "system_bos": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9931552352496932, + "source_mean_relative_l2": 0.10459265857934952, + "max_abs_delta": 7.94140625 + }, + "system_x": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.986572843065578, + "source_mean_relative_l2": 0.1475757174193859, + "max_abs_delta": 11.375 + }, + "system_period": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9865328455498206, + "source_mean_relative_l2": 0.15234004519879818, + "max_abs_delta": 9.0 + }, + "bos_at_s0": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9901262702862861, + "source_mean_relative_l2": 0.120005426928401, + "max_abs_delta": 9.8125 + }, + "bos_at_s1": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9905031598404627, + "source_mean_relative_l2": 0.12219957076013088, + "max_abs_delta": 8.533203125 + }, + "x_at_s0": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9899422493428816, + "source_mean_relative_l2": 0.12947073578834534, + "max_abs_delta": 12.0 + }, + "x_at_s1": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9851791152308659, + "source_mean_relative_l2": 0.1605143565684557, + "max_abs_delta": 13.25 + }, + "period_at_s0": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9902125429053333, + "source_mean_relative_l2": 0.12529282830655575, + "max_abs_delta": 7.25 + }, + "period_at_s1": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9851061089262778, + "source_mean_relative_l2": 0.16184222884476185, + "max_abs_delta": 9.5 + } + }, + "layer_24": { + "system_eos": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9957608893431352, + "source_mean_relative_l2": 0.08086078613996506, + "max_abs_delta": 12.0 + }, + "system_bos": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.992545402346395, + "source_mean_relative_l2": 0.1034526489675045, + "max_abs_delta": 536.9375 + }, + "system_x": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9878847411324306, + "source_mean_relative_l2": 0.13810196332633495, + "max_abs_delta": 20.265625 + }, + "system_period": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9875769134384492, + "source_mean_relative_l2": 0.14312695525586605, + "max_abs_delta": 31.6015625 + }, + "bos_at_s0": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9898957157332594, + "source_mean_relative_l2": 0.15432175993919373, + "max_abs_delta": 542.53125 + }, + "bos_at_s1": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9917926454083037, + "source_mean_relative_l2": 0.11313869431614876, + "max_abs_delta": 8.96875 + }, + "x_at_s0": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9914026367400891, + "source_mean_relative_l2": 0.1195472925901413, + "max_abs_delta": 15.5 + }, + "x_at_s1": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9866568724424141, + "source_mean_relative_l2": 0.15036649256944656, + "max_abs_delta": 20.3203125 + }, + "period_at_s0": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.991483390495922, + "source_mean_relative_l2": 0.11614440008997917, + "max_abs_delta": 8.5 + }, + "period_at_s1": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9864631762820713, + "source_mean_relative_l2": 0.15188784524798393, + "max_abs_delta": 31.4453125 + } + }, + "layer_25": { + "system_eos": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9968857681224359, + "source_mean_relative_l2": 0.07038007397204638, + "max_abs_delta": 25.0 + }, + "system_bos": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9936815264804587, + "source_mean_relative_l2": 0.0903246346861124, + "max_abs_delta": 542.34375 + }, + "system_x": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9911292150863626, + "source_mean_relative_l2": 0.1204208955168724, + "max_abs_delta": 32.0 + }, + "system_period": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9908548316902878, + "source_mean_relative_l2": 0.12449324131011963, + "max_abs_delta": 33.83203125 + }, + "bos_at_s0": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9921070057384217, + "source_mean_relative_l2": 0.12212573736906052, + "max_abs_delta": 547.6875 + }, + "bos_at_s1": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9942686771819604, + "source_mean_relative_l2": 0.0965933334082365, + "max_abs_delta": 18.0 + }, + "x_at_s0": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.994039717958777, + "source_mean_relative_l2": 0.1019737459719181, + "max_abs_delta": 20.0 + }, + "x_at_s1": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9905235273403358, + "source_mean_relative_l2": 0.12954544089734554, + "max_abs_delta": 26.5 + }, + "period_at_s0": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9941353429088277, + "source_mean_relative_l2": 0.09887840785086155, + "max_abs_delta": 15.5 + }, + "period_at_s1": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9903658849099723, + "source_mean_relative_l2": 0.1305411159992218, + "max_abs_delta": 33.6953125 + } + }, + "layer_26": { + "system_eos": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9961531985530537, + "source_mean_relative_l2": 0.07763442862778902, + "max_abs_delta": 48.5 + }, + "system_bos": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9934049416642162, + "source_mean_relative_l2": 0.09291447699069977, + "max_abs_delta": 60.0 + }, + "system_x": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.987953418855509, + "source_mean_relative_l2": 0.1414299476891756, + "max_abs_delta": 52.0 + }, + "system_period": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9881067936262373, + "source_mean_relative_l2": 0.14312150329351425, + "max_abs_delta": 57.0 + }, + "bos_at_s0": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9923938208192752, + "source_mean_relative_l2": 0.1012085061520338, + "max_abs_delta": 47.5 + }, + "bos_at_s1": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.993569410802251, + "source_mean_relative_l2": 0.10203255154192448, + "max_abs_delta": 66.0 + }, + "x_at_s0": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9937544741683243, + "source_mean_relative_l2": 0.1030249334871769, + "max_abs_delta": 41.5 + }, + "x_at_s1": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9884136783483938, + "source_mean_relative_l2": 0.14409823901951313, + "max_abs_delta": 54.0 + }, + "period_at_s0": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9938224684138325, + "source_mean_relative_l2": 0.10072160325944424, + "max_abs_delta": 42.5 + }, + "period_at_s1": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9888184567841377, + "source_mean_relative_l2": 0.14339252188801765, + "max_abs_delta": 65.0 + } + }, + "final_norm": { + "system_eos": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9951198731667429, + "source_mean_relative_l2": 0.08561180159449577, + "max_abs_delta": 4.5625 + }, + "system_bos": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9916686983727618, + "source_mean_relative_l2": 0.10173401236534119, + "max_abs_delta": 4.375 + }, + "system_x": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9851734746885563, + "source_mean_relative_l2": 0.15075203590095043, + "max_abs_delta": 4.7578125 + }, + "system_period": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9851579203460756, + "source_mean_relative_l2": 0.15515290200710297, + "max_abs_delta": 6.375 + }, + "bos_at_s0": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.990285238179054, + "source_mean_relative_l2": 0.11189868301153183, + "max_abs_delta": 4.671875 + }, + "bos_at_s1": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.99193657926433, + "source_mean_relative_l2": 0.11334333196282387, + "max_abs_delta": 8.625 + }, + "x_at_s0": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9923147855542641, + "source_mean_relative_l2": 0.11668865010142326, + "max_abs_delta": 4.375 + }, + "x_at_s1": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9851419500883113, + "source_mean_relative_l2": 0.16107319481670856, + "max_abs_delta": 4.328125 + }, + "period_at_s0": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9924488339305583, + "source_mean_relative_l2": 0.11321013420820236, + "max_abs_delta": 4.375 + }, + "period_at_s1": { + "sources": 4, + "tokens": 362, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9857751998782817, + "source_mean_relative_l2": 0.15941827930510044, + "max_abs_delta": 4.5 + } + } + }, + "routes": { + "layer_01": { + "system_eos": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 236, + "set_exact_tokens": 272, + "token_weighted_mean_set_jaccard": 0.9261378584583005, + "source_mean_token_weighted_tv": 0.011107640950763397, + "source_mean_aggregate_load_tv": 0.037551178267241955 + }, + "system_bos": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 190, + "set_exact_tokens": 232, + "token_weighted_mean_set_jaccard": 0.8902920284135755, + "source_mean_token_weighted_tv": 0.017007043589627735, + "source_mean_aggregate_load_tv": 0.05111284436120004 + }, + "system_x": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 185, + "set_exact_tokens": 228, + "token_weighted_mean_set_jaccard": 0.8829913180741912, + "source_mean_token_weighted_tv": 0.019545595215009398, + "source_mean_aggregate_load_tv": 0.06161142196684259 + }, + "system_period": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 185, + "set_exact_tokens": 234, + "token_weighted_mean_set_jaccard": 0.8890423572744016, + "source_mean_token_weighted_tv": 0.018556451752720016, + "source_mean_aggregate_load_tv": 0.055807907794725116 + }, + "bos_at_s0": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 144, + "set_exact_tokens": 198, + "token_weighted_mean_set_jaccard": 0.8466850828729282, + "source_mean_token_weighted_tv": 0.028197360822747895, + "source_mean_aggregate_load_tv": 0.07946445496292316 + }, + "bos_at_s1": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 135, + "set_exact_tokens": 178, + "token_weighted_mean_set_jaccard": 0.8351749539594845, + "source_mean_token_weighted_tv": 0.028658658993856296, + "source_mean_aggregate_load_tv": 0.08341254709721446 + }, + "x_at_s0": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 148, + "set_exact_tokens": 203, + "token_weighted_mean_set_jaccard": 0.8568797684819784, + "source_mean_token_weighted_tv": 0.02487843292553278, + "source_mean_aggregate_load_tv": 0.07295837457238431 + }, + "x_at_s1": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 143, + "set_exact_tokens": 187, + "token_weighted_mean_set_jaccard": 0.8428702972901869, + "source_mean_token_weighted_tv": 0.028262304832557105, + "source_mean_aggregate_load_tv": 0.08362276794896925 + }, + "period_at_s0": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 154, + "set_exact_tokens": 206, + "token_weighted_mean_set_jaccard": 0.858195211786372, + "source_mean_token_weighted_tv": 0.024978267434991402, + "source_mean_aggregate_load_tv": 0.0740325056484392 + }, + "period_at_s1": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 146, + "set_exact_tokens": 188, + "token_weighted_mean_set_jaccard": 0.8431991581162853, + "source_mean_token_weighted_tv": 0.028047450796240145, + "source_mean_aggregate_load_tv": 0.08316515816436414 + } + }, + "layer_02": { + "system_eos": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 260, + "set_exact_tokens": 296, + "token_weighted_mean_set_jaccard": 0.9479084451460142, + "source_mean_token_weighted_tv": 0.00998006232676642, + "source_mean_aggregate_load_tv": 0.02260851315172825 + }, + "system_bos": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 203, + "set_exact_tokens": 249, + "token_weighted_mean_set_jaccard": 0.9050249934227834, + "source_mean_token_weighted_tv": 0.01985024447718875, + "source_mean_aggregate_load_tv": 0.04294497389739482 + }, + "system_x": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 192, + "set_exact_tokens": 239, + "token_weighted_mean_set_jaccard": 0.8966719284398843, + "source_mean_token_weighted_tv": 0.020123230329810657, + "source_mean_aggregate_load_tv": 0.04143190908372273 + }, + "system_period": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 193, + "set_exact_tokens": 242, + "token_weighted_mean_set_jaccard": 0.8979873717442778, + "source_mean_token_weighted_tv": 0.02087356973219299, + "source_mean_aggregate_load_tv": 0.04827708992250688 + }, + "bos_at_s0": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 153, + "set_exact_tokens": 208, + "token_weighted_mean_set_jaccard": 0.8639173901604841, + "source_mean_token_weighted_tv": 0.02721123251742101, + "source_mean_aggregate_load_tv": 0.05043307305341596 + }, + "bos_at_s1": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 167, + "set_exact_tokens": 219, + "token_weighted_mean_set_jaccard": 0.8788476716653512, + "source_mean_token_weighted_tv": 0.026934923532337295, + "source_mean_aggregate_load_tv": 0.05601070763388273 + }, + "x_at_s0": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 158, + "set_exact_tokens": 206, + "token_weighted_mean_set_jaccard": 0.8647066561431203, + "source_mean_token_weighted_tv": 0.026559233208697103, + "source_mean_aggregate_load_tv": 0.058751148442031005 + }, + "x_at_s1": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 166, + "set_exact_tokens": 226, + "token_weighted_mean_set_jaccard": 0.8833201789002896, + "source_mean_token_weighted_tv": 0.026784197794863733, + "source_mean_aggregate_load_tv": 0.051448526707175715 + }, + "period_at_s0": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 157, + "set_exact_tokens": 212, + "token_weighted_mean_set_jaccard": 0.8700342015259143, + "source_mean_token_weighted_tv": 0.025891018442987315, + "source_mean_aggregate_load_tv": 0.05661100050172498 + }, + "period_at_s1": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 164, + "set_exact_tokens": 224, + "token_weighted_mean_set_jaccard": 0.8822020520915549, + "source_mean_token_weighted_tv": 0.02679442983401495, + "source_mean_aggregate_load_tv": 0.051448526707175715 + } + }, + "layer_03": { + "system_eos": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 291, + "set_exact_tokens": 320, + "token_weighted_mean_set_jaccard": 0.9668508287292817, + "source_mean_token_weighted_tv": 0.008104365317892223, + "source_mean_aggregate_load_tv": 0.015758051395352024 + }, + "system_bos": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 229, + "set_exact_tokens": 277, + "token_weighted_mean_set_jaccard": 0.930544593528019, + "source_mean_token_weighted_tv": 0.01579175984706541, + "source_mean_aggregate_load_tv": 0.027073878096155354 + }, + "system_x": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 211, + "set_exact_tokens": 262, + "token_weighted_mean_set_jaccard": 0.9187056037884769, + "source_mean_token_weighted_tv": 0.017981147261695706, + "source_mean_aggregate_load_tv": 0.03091239182059218 + }, + "system_period": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 218, + "set_exact_tokens": 263, + "token_weighted_mean_set_jaccard": 0.9189029202841358, + "source_mean_token_weighted_tv": 0.018485460561718715, + "source_mean_aggregate_load_tv": 0.033308620151437054 + }, + "bos_at_s0": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 216, + "set_exact_tokens": 256, + "token_weighted_mean_set_jaccard": 0.9133780584056828, + "source_mean_token_weighted_tv": 0.022446354003000046, + "source_mean_aggregate_load_tv": 0.03882701518807023 + }, + "bos_at_s1": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 195, + "set_exact_tokens": 242, + "token_weighted_mean_set_jaccard": 0.9017363851617995, + "source_mean_token_weighted_tv": 0.024636167622447504, + "source_mean_aggregate_load_tv": 0.042288274779930676 + }, + "x_at_s0": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 204, + "set_exact_tokens": 250, + "token_weighted_mean_set_jaccard": 0.9080505130228885, + "source_mean_token_weighted_tv": 0.021453873574809476, + "source_mean_aggregate_load_tv": 0.03727092412982577 + }, + "x_at_s1": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 191, + "set_exact_tokens": 236, + "token_weighted_mean_set_jaccard": 0.8958168902920286, + "source_mean_token_weighted_tv": 0.02566570005906362, + "source_mean_aggregate_load_tv": 0.03836615618972948 + }, + "period_at_s0": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 216, + "set_exact_tokens": 258, + "token_weighted_mean_set_jaccard": 0.914364640883978, + "source_mean_token_weighted_tv": 0.020749374985660943, + "source_mean_aggregate_load_tv": 0.03296424634777285 + }, + "period_at_s1": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 190, + "set_exact_tokens": 232, + "token_weighted_mean_set_jaccard": 0.8904235727440148, + "source_mean_token_weighted_tv": 0.026816309399795627, + "source_mean_aggregate_load_tv": 0.04246887207868209 + } + }, + "layer_04": { + "system_eos": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 280, + "set_exact_tokens": 311, + "token_weighted_mean_set_jaccard": 0.9597474348855565, + "source_mean_token_weighted_tv": 0.008437214214140273, + "source_mean_aggregate_load_tv": 0.01820727543572233 + }, + "system_bos": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 248, + "set_exact_tokens": 284, + "token_weighted_mean_set_jaccard": 0.9348855564325178, + "source_mean_token_weighted_tv": 0.0156064603652038, + "source_mean_aggregate_load_tv": 0.032175234407202255 + }, + "system_x": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 213, + "set_exact_tokens": 262, + "token_weighted_mean_set_jaccard": 0.9181136543014997, + "source_mean_token_weighted_tv": 0.018350992174247127, + "source_mean_aggregate_load_tv": 0.03260606149518885 + }, + "system_period": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 226, + "set_exact_tokens": 269, + "token_weighted_mean_set_jaccard": 0.923770060510392, + "source_mean_token_weighted_tv": 0.017721100915629433, + "source_mean_aggregate_load_tv": 0.02975280062562363 + }, + "bos_at_s0": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 201, + "set_exact_tokens": 255, + "token_weighted_mean_set_jaccard": 0.914364640883978, + "source_mean_token_weighted_tv": 0.02048685267390577, + "source_mean_aggregate_load_tv": 0.03018832382314436 + }, + "bos_at_s1": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 189, + "set_exact_tokens": 240, + "token_weighted_mean_set_jaccard": 0.8995659037095501, + "source_mean_token_weighted_tv": 0.02461021396049733, + "source_mean_aggregate_load_tv": 0.04166119921546991 + }, + "x_at_s0": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 210, + "set_exact_tokens": 266, + "token_weighted_mean_set_jaccard": 0.9224546172059984, + "source_mean_token_weighted_tv": 0.020396976463200215, + "source_mean_aggregate_load_tv": 0.03286156463984293 + }, + "x_at_s1": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 189, + "set_exact_tokens": 230, + "token_weighted_mean_set_jaccard": 0.8922651933701657, + "source_mean_token_weighted_tv": 0.027089458785980715, + "source_mean_aggregate_load_tv": 0.047588904436716914 + }, + "period_at_s0": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 207, + "set_exact_tokens": 261, + "token_weighted_mean_set_jaccard": 0.9173243883188634, + "source_mean_token_weighted_tv": 0.019900610051352328, + "source_mean_aggregate_load_tv": 0.03139435180278175 + }, + "period_at_s1": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 189, + "set_exact_tokens": 231, + "token_weighted_mean_set_jaccard": 0.8918705603788477, + "source_mean_token_weighted_tv": 0.027546578454362928, + "source_mean_aggregate_load_tv": 0.046861995582884244 + } + }, + "layer_05": { + "system_eos": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 278, + "set_exact_tokens": 307, + "token_weighted_mean_set_jaccard": 0.9554064719810577, + "source_mean_token_weighted_tv": 0.009914816435436347, + "source_mean_aggregate_load_tv": 0.021084886502872012 + }, + "system_bos": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 237, + "set_exact_tokens": 273, + "token_weighted_mean_set_jaccard": 0.9279794790844516, + "source_mean_token_weighted_tv": 0.015351765837810283, + "source_mean_aggregate_load_tv": 0.025647652237636955 + }, + "system_x": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 201, + "set_exact_tokens": 252, + "token_weighted_mean_set_jaccard": 0.9097605893186005, + "source_mean_token_weighted_tv": 0.019729954469164212, + "source_mean_aggregate_load_tv": 0.033852098412306623 + }, + "system_period": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 206, + "set_exact_tokens": 248, + "token_weighted_mean_set_jaccard": 0.9064719810576165, + "source_mean_token_weighted_tv": 0.02065934225376855, + "source_mean_aggregate_load_tv": 0.03538383927296662 + }, + "bos_at_s0": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 201, + "set_exact_tokens": 249, + "token_weighted_mean_set_jaccard": 0.9044330439358065, + "source_mean_token_weighted_tv": 0.02173858585678734, + "source_mean_aggregate_load_tv": 0.03565273754701655 + }, + "bos_at_s1": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 193, + "set_exact_tokens": 246, + "token_weighted_mean_set_jaccard": 0.9060773480662984, + "source_mean_token_weighted_tv": 0.023090913963653162, + "source_mean_aggregate_load_tv": 0.03478111390609031 + }, + "x_at_s0": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 199, + "set_exact_tokens": 244, + "token_weighted_mean_set_jaccard": 0.9004867140226256, + "source_mean_token_weighted_tv": 0.023061668966127522, + "source_mean_aggregate_load_tv": 0.04201126229407698 + }, + "x_at_s1": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 185, + "set_exact_tokens": 237, + "token_weighted_mean_set_jaccard": 0.8943699026571955, + "source_mean_token_weighted_tv": 0.025951089738916244, + "source_mean_aggregate_load_tv": 0.04159423869283702 + }, + "period_at_s0": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 203, + "set_exact_tokens": 248, + "token_weighted_mean_set_jaccard": 0.9031833727966325, + "source_mean_token_weighted_tv": 0.021920848880547888, + "source_mean_aggregate_load_tv": 0.03899891346695995 + }, + "period_at_s1": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 186, + "set_exact_tokens": 239, + "token_weighted_mean_set_jaccard": 0.8958168902920284, + "source_mean_token_weighted_tv": 0.026614177104806222, + "source_mean_aggregate_load_tv": 0.04587412621609827 + } + }, + "layer_06": { + "system_eos": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 274, + "set_exact_tokens": 302, + "token_weighted_mean_set_jaccard": 0.9520520915548539, + "source_mean_token_weighted_tv": 0.010693960775802484, + "source_mean_aggregate_load_tv": 0.022145221654353432 + }, + "system_bos": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 211, + "set_exact_tokens": 266, + "token_weighted_mean_set_jaccard": 0.9218626677190214, + "source_mean_token_weighted_tv": 0.016661665089875533, + "source_mean_aggregate_load_tv": 0.0310986708321133 + }, + "system_x": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 199, + "set_exact_tokens": 257, + "token_weighted_mean_set_jaccard": 0.9141673243883189, + "source_mean_token_weighted_tv": 0.018963210077894966, + "source_mean_aggregate_load_tv": 0.03145928818373136 + }, + "system_period": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 206, + "set_exact_tokens": 254, + "token_weighted_mean_set_jaccard": 0.9123914759273877, + "source_mean_token_weighted_tv": 0.019323248812377715, + "source_mean_aggregate_load_tv": 0.03057329137234689 + }, + "bos_at_s0": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 189, + "set_exact_tokens": 252, + "token_weighted_mean_set_jaccard": 0.909629044988161, + "source_mean_token_weighted_tv": 0.021318621779061984, + "source_mean_aggregate_load_tv": 0.03651722501720142 + }, + "bos_at_s1": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 197, + "set_exact_tokens": 243, + "token_weighted_mean_set_jaccard": 0.9031176006314128, + "source_mean_token_weighted_tv": 0.023810153229742913, + "source_mean_aggregate_load_tv": 0.041927657428312615 + }, + "x_at_s0": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 200, + "set_exact_tokens": 256, + "token_weighted_mean_set_jaccard": 0.9139700078926599, + "source_mean_token_weighted_tv": 0.02153311570416974, + "source_mean_aggregate_load_tv": 0.03784401838152555 + }, + "x_at_s1": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 175, + "set_exact_tokens": 227, + "token_weighted_mean_set_jaccard": 0.8904893449092345, + "source_mean_token_weighted_tv": 0.026637619407792995, + "source_mean_aggregate_load_tv": 0.04548591701533326 + }, + "period_at_s0": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 192, + "set_exact_tokens": 246, + "token_weighted_mean_set_jaccard": 0.9060773480662984, + "source_mean_token_weighted_tv": 0.022407142460076256, + "source_mean_aggregate_load_tv": 0.042302070704504154 + }, + "period_at_s1": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 176, + "set_exact_tokens": 225, + "token_weighted_mean_set_jaccard": 0.887726913970008, + "source_mean_token_weighted_tv": 0.02708378787123921, + "source_mean_aggregate_load_tv": 0.045440057476549195 + } + }, + "layer_07": { + "system_eos": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 261, + "set_exact_tokens": 300, + "token_weighted_mean_set_jaccard": 0.9504735595895817, + "source_mean_token_weighted_tv": 0.012841457901488447, + "source_mean_aggregate_load_tv": 0.026513987398797956 + }, + "system_bos": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 225, + "set_exact_tokens": 266, + "token_weighted_mean_set_jaccard": 0.9230465666929756, + "source_mean_token_weighted_tv": 0.017894490432949828, + "source_mean_aggregate_load_tv": 0.032522456629424476 + }, + "system_x": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 211, + "set_exact_tokens": 258, + "token_weighted_mean_set_jaccard": 0.9159037095501185, + "source_mean_token_weighted_tv": 0.021740357604813243, + "source_mean_aggregate_load_tv": 0.03579234030505201 + }, + "system_period": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 211, + "set_exact_tokens": 258, + "token_weighted_mean_set_jaccard": 0.9150881347013945, + "source_mean_token_weighted_tv": 0.022178852747850232, + "source_mean_aggregate_load_tv": 0.03876978466157359 + }, + "bos_at_s0": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 201, + "set_exact_tokens": 247, + "token_weighted_mean_set_jaccard": 0.9044988161010261, + "source_mean_token_weighted_tv": 0.02397175548029984, + "source_mean_aggregate_load_tv": 0.05067331069117859 + }, + "bos_at_s1": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 195, + "set_exact_tokens": 241, + "token_weighted_mean_set_jaccard": 0.8987108655616944, + "source_mean_token_weighted_tv": 0.024018429361279847, + "source_mean_aggregate_load_tv": 0.04298515172340918 + }, + "x_at_s0": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 197, + "set_exact_tokens": 243, + "token_weighted_mean_set_jaccard": 0.9025256511444357, + "source_mean_token_weighted_tv": 0.025468880756273675, + "source_mean_aggregate_load_tv": 0.04478619165329674 + }, + "x_at_s1": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 178, + "set_exact_tokens": 228, + "token_weighted_mean_set_jaccard": 0.8859773743751644, + "source_mean_token_weighted_tv": 0.028902603559886518, + "source_mean_aggregate_load_tv": 0.0493704667292613 + }, + "period_at_s0": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 203, + "set_exact_tokens": 248, + "token_weighted_mean_set_jaccard": 0.9048276769271244, + "source_mean_token_weighted_tv": 0.02479277359918313, + "source_mean_aggregate_load_tv": 0.04835824716489087 + }, + "period_at_s1": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 177, + "set_exact_tokens": 231, + "token_weighted_mean_set_jaccard": 0.8898973954222575, + "source_mean_token_weighted_tv": 0.02823255193814729, + "source_mean_aggregate_load_tv": 0.047429408121814315 + } + }, + "layer_08": { + "system_eos": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 264, + "set_exact_tokens": 297, + "token_weighted_mean_set_jaccard": 0.9475138121546961, + "source_mean_token_weighted_tv": 0.010771638331791539, + "source_mean_aggregate_load_tv": 0.01673478924324224 + }, + "system_bos": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 223, + "set_exact_tokens": 275, + "token_weighted_mean_set_jaccard": 0.9295580110497238, + "source_mean_token_weighted_tv": 0.015903440419106088, + "source_mean_aggregate_load_tv": 0.027066164679529214 + }, + "system_x": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 196, + "set_exact_tokens": 254, + "token_weighted_mean_set_jaccard": 0.9119310707708499, + "source_mean_token_weighted_tv": 0.019644291098129384, + "source_mean_aggregate_load_tv": 0.029884120283321353 + }, + "system_period": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 192, + "set_exact_tokens": 247, + "token_weighted_mean_set_jaccard": 0.9062746645619574, + "source_mean_token_weighted_tv": 0.021913282538210593, + "source_mean_aggregate_load_tv": 0.03703593716096257 + }, + "bos_at_s0": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 226, + "set_exact_tokens": 264, + "token_weighted_mean_set_jaccard": 0.9202841357537491, + "source_mean_token_weighted_tv": 0.019553039618733753, + "source_mean_aggregate_load_tv": 0.035424417894158615 + }, + "bos_at_s1": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 199, + "set_exact_tokens": 248, + "token_weighted_mean_set_jaccard": 0.9041041831097081, + "source_mean_token_weighted_tv": 0.021058031573018388, + "source_mean_aggregate_load_tv": 0.03616148022582464 + }, + "x_at_s0": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 194, + "set_exact_tokens": 247, + "token_weighted_mean_set_jaccard": 0.9056827150749803, + "source_mean_token_weighted_tv": 0.02339509429736588, + "source_mean_aggregate_load_tv": 0.04202992321671858 + }, + "x_at_s1": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 167, + "set_exact_tokens": 234, + "token_weighted_mean_set_jaccard": 0.8937779531702184, + "source_mean_token_weighted_tv": 0.02558233015397075, + "source_mean_aggregate_load_tv": 0.042247688596565525 + }, + "period_at_s0": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 199, + "set_exact_tokens": 248, + "token_weighted_mean_set_jaccard": 0.9064719810576165, + "source_mean_token_weighted_tv": 0.023368485443989936, + "source_mean_aggregate_load_tv": 0.04346751250077638 + }, + "period_at_s1": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 168, + "set_exact_tokens": 229, + "token_weighted_mean_set_jaccard": 0.8920678768745067, + "source_mean_token_weighted_tv": 0.025385023550349235, + "source_mean_aggregate_load_tv": 0.03907926911898868 + } + }, + "layer_09": { + "system_eos": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 252, + "set_exact_tokens": 292, + "token_weighted_mean_set_jaccard": 0.9435674822415153, + "source_mean_token_weighted_tv": 0.012552303828319181, + "source_mean_aggregate_load_tv": 0.026161491821156825 + }, + "system_bos": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 224, + "set_exact_tokens": 265, + "token_weighted_mean_set_jaccard": 0.9234411996842936, + "source_mean_token_weighted_tv": 0.016783386526030144, + "source_mean_aggregate_load_tv": 0.028072926875600434 + }, + "system_x": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 186, + "set_exact_tokens": 247, + "token_weighted_mean_set_jaccard": 0.903314917127072, + "source_mean_token_weighted_tv": 0.02045919293648309, + "source_mean_aggregate_load_tv": 0.03304460199980157 + }, + "system_period": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 182, + "set_exact_tokens": 238, + "token_weighted_mean_set_jaccard": 0.8979873717442778, + "source_mean_token_weighted_tv": 0.021790232456749253, + "source_mean_aggregate_load_tv": 0.035195705008296205 + }, + "bos_at_s0": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 194, + "set_exact_tokens": 244, + "token_weighted_mean_set_jaccard": 0.8997632202052092, + "source_mean_token_weighted_tv": 0.021319570120139394, + "source_mean_aggregate_load_tv": 0.03762626056385176 + }, + "bos_at_s1": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 192, + "set_exact_tokens": 240, + "token_weighted_mean_set_jaccard": 0.89956590370955, + "source_mean_token_weighted_tv": 0.02160052630449742, + "source_mean_aggregate_load_tv": 0.037723252996838805 + }, + "x_at_s0": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 199, + "set_exact_tokens": 244, + "token_weighted_mean_set_jaccard": 0.8994343593791109, + "source_mean_token_weighted_tv": 0.022651360567047037, + "source_mean_aggregate_load_tv": 0.03537004334839315 + }, + "x_at_s1": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 163, + "set_exact_tokens": 208, + "token_weighted_mean_set_jaccard": 0.8683898973954222, + "source_mean_token_weighted_tv": 0.028669811176339058, + "source_mean_aggregate_load_tv": 0.04619190133602426 + }, + "period_at_s0": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 194, + "set_exact_tokens": 248, + "token_weighted_mean_set_jaccard": 0.9025914233096552, + "source_mean_token_weighted_tv": 0.021988347567505256, + "source_mean_aggregate_load_tv": 0.03210503223300689 + }, + "period_at_s1": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 166, + "set_exact_tokens": 220, + "token_weighted_mean_set_jaccard": 0.8802288871349645, + "source_mean_token_weighted_tv": 0.026792745578912217, + "source_mean_aggregate_load_tv": 0.03966147074790094 + } + }, + "layer_10": { + "system_eos": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 253, + "set_exact_tokens": 282, + "token_weighted_mean_set_jaccard": 0.9344909234411998, + "source_mean_token_weighted_tv": 0.01398054821867425, + "source_mean_aggregate_load_tv": 0.02853766526877375 + }, + "system_bos": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 215, + "set_exact_tokens": 254, + "token_weighted_mean_set_jaccard": 0.9129834254143646, + "source_mean_token_weighted_tv": 0.01893175513247663, + "source_mean_aggregate_load_tv": 0.03154004463093772 + }, + "system_x": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 176, + "set_exact_tokens": 234, + "token_weighted_mean_set_jaccard": 0.8912786108918707, + "source_mean_token_weighted_tv": 0.025574890526731092, + "source_mean_aggregate_load_tv": 0.03865128288738694 + }, + "system_period": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 185, + "set_exact_tokens": 240, + "token_weighted_mean_set_jaccard": 0.8979215995790581, + "source_mean_token_weighted_tv": 0.024712471163493663, + "source_mean_aggregate_load_tv": 0.0420538726191254 + }, + "bos_at_s0": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 204, + "set_exact_tokens": 246, + "token_weighted_mean_set_jaccard": 0.9013417521704816, + "source_mean_token_weighted_tv": 0.022863115648149322, + "source_mean_aggregate_load_tv": 0.03801893396750725 + }, + "bos_at_s1": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 187, + "set_exact_tokens": 237, + "token_weighted_mean_set_jaccard": 0.8955538016311498, + "source_mean_token_weighted_tv": 0.024143096151299694, + "source_mean_aggregate_load_tv": 0.03658134468344945 + }, + "x_at_s0": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 194, + "set_exact_tokens": 249, + "token_weighted_mean_set_jaccard": 0.9043014996053671, + "source_mean_token_weighted_tv": 0.024823234360188406, + "source_mean_aggregate_load_tv": 0.038293914749504526 + }, + "x_at_s1": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 161, + "set_exact_tokens": 212, + "token_weighted_mean_set_jaccard": 0.8722704551433833, + "source_mean_token_weighted_tv": 0.030527342281739808, + "source_mean_aggregate_load_tv": 0.04547212109075979 + }, + "period_at_s0": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 192, + "set_exact_tokens": 246, + "token_weighted_mean_set_jaccard": 0.9001578531965272, + "source_mean_token_weighted_tv": 0.02498796595615177, + "source_mean_aggregate_load_tv": 0.0382452143543356 + }, + "period_at_s1": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 170, + "set_exact_tokens": 224, + "token_weighted_mean_set_jaccard": 0.8836490397263879, + "source_mean_token_weighted_tv": 0.029304947074442006, + "source_mean_aggregate_load_tv": 0.04582461666840093 + } + }, + "layer_11": { + "system_eos": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 257, + "set_exact_tokens": 287, + "token_weighted_mean_set_jaccard": 0.9378453038674033, + "source_mean_token_weighted_tv": 0.012981664118468208, + "source_mean_aggregate_load_tv": 0.0272624131560034 + }, + "system_bos": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 220, + "set_exact_tokens": 265, + "token_weighted_mean_set_jaccard": 0.9181136543014997, + "source_mean_token_weighted_tv": 0.017690445945265774, + "source_mean_aggregate_load_tv": 0.032245444143570785 + }, + "system_x": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 186, + "set_exact_tokens": 246, + "token_weighted_mean_set_jaccard": 0.9014732965009209, + "source_mean_token_weighted_tv": 0.022107293137851654, + "source_mean_aggregate_load_tv": 0.03594597845647778 + }, + "system_period": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 184, + "set_exact_tokens": 240, + "token_weighted_mean_set_jaccard": 0.8977900552486188, + "source_mean_token_weighted_tv": 0.02229099450402379, + "source_mean_aggregate_load_tv": 0.038659805456541504 + }, + "bos_at_s0": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 192, + "set_exact_tokens": 236, + "token_weighted_mean_set_jaccard": 0.8959484346224679, + "source_mean_token_weighted_tv": 0.02099743413576271, + "source_mean_aggregate_load_tv": 0.03835844277310335 + }, + "bos_at_s1": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 176, + "set_exact_tokens": 220, + "token_weighted_mean_set_jaccard": 0.8821362799263353, + "source_mean_token_weighted_tv": 0.02232629134733378, + "source_mean_aggregate_load_tv": 0.03913365122692731 + }, + "x_at_s0": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 179, + "set_exact_tokens": 224, + "token_weighted_mean_set_jaccard": 0.8854248881873191, + "source_mean_token_weighted_tv": 0.023618484179259994, + "source_mean_aggregate_load_tv": 0.042651732987933594 + }, + "x_at_s1": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 156, + "set_exact_tokens": 205, + "token_weighted_mean_set_jaccard": 0.8642462509865826, + "source_mean_token_weighted_tv": 0.02733090552740566, + "source_mean_aggregate_load_tv": 0.048963997401032334 + }, + "period_at_s0": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 172, + "set_exact_tokens": 225, + "token_weighted_mean_set_jaccard": 0.8866745593264931, + "source_mean_token_weighted_tv": 0.023457004624001087, + "source_mean_aggregate_load_tv": 0.04457655560959989 + }, + "period_at_s1": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 141, + "set_exact_tokens": 197, + "token_weighted_mean_set_jaccard": 0.8604314654038411, + "source_mean_token_weighted_tv": 0.027280382464897734, + "source_mean_aggregate_load_tv": 0.04710126274175763 + } + }, + "layer_12": { + "system_eos": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 246, + "set_exact_tokens": 275, + "token_weighted_mean_set_jaccard": 0.9295580110497239, + "source_mean_token_weighted_tv": 0.014976617330898844, + "source_mean_aggregate_load_tv": 0.026540777657589637 + }, + "system_bos": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 210, + "set_exact_tokens": 265, + "token_weighted_mean_set_jaccard": 0.9187056037884767, + "source_mean_token_weighted_tv": 0.02029707630534595, + "source_mean_aggregate_load_tv": 0.0369289677008493 + }, + "system_x": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 192, + "set_exact_tokens": 244, + "token_weighted_mean_set_jaccard": 0.8998947645356487, + "source_mean_token_weighted_tv": 0.023115084507587754, + "source_mean_aggregate_load_tv": 0.032853450428039166 + }, + "system_period": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 195, + "set_exact_tokens": 249, + "token_weighted_mean_set_jaccard": 0.9072612470402526, + "source_mean_token_weighted_tv": 0.022941986610076896, + "source_mean_aggregate_load_tv": 0.03442536911471353 + }, + "bos_at_s0": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 190, + "set_exact_tokens": 254, + "token_weighted_mean_set_jaccard": 0.9112075769534334, + "source_mean_token_weighted_tv": 0.022313644158710337, + "source_mean_aggregate_load_tv": 0.03547839164474645 + }, + "bos_at_s1": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 182, + "set_exact_tokens": 247, + "token_weighted_mean_set_jaccard": 0.9027229676400949, + "source_mean_token_weighted_tv": 0.023030260246418535, + "source_mean_aggregate_load_tv": 0.03401077801250763 + }, + "x_at_s0": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 197, + "set_exact_tokens": 256, + "token_weighted_mean_set_jaccard": 0.9123257037621678, + "source_mean_token_weighted_tv": 0.022740571533610907, + "source_mean_aggregate_load_tv": 0.03568236110001992 + }, + "x_at_s1": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 172, + "set_exact_tokens": 234, + "token_weighted_mean_set_jaccard": 0.8915416995527493, + "source_mean_token_weighted_tv": 0.027588280486080217, + "source_mean_aggregate_load_tv": 0.03952916548696765 + }, + "period_at_s0": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 185, + "set_exact_tokens": 244, + "token_weighted_mean_set_jaccard": 0.9016706129965799, + "source_mean_token_weighted_tv": 0.02399610534584374, + "source_mean_aggregate_load_tv": 0.035658010902435464 + }, + "period_at_s1": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 157, + "set_exact_tokens": 226, + "token_weighted_mean_set_jaccard": 0.8849644830307815, + "source_mean_token_weighted_tv": 0.02924488567152372, + "source_mean_aggregate_load_tv": 0.04410230148186328 + } + }, + "layer_13": { + "system_eos": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 219, + "set_exact_tokens": 265, + "token_weighted_mean_set_jaccard": 0.9194290976058933, + "source_mean_token_weighted_tv": 0.015436224855103238, + "source_mean_aggregate_load_tv": 0.0351224779648357 + }, + "system_bos": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 176, + "set_exact_tokens": 241, + "token_weighted_mean_set_jaccard": 0.899171270718232, + "source_mean_token_weighted_tv": 0.019418520090458743, + "source_mean_aggregate_load_tv": 0.036643263757307074 + }, + "system_x": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 152, + "set_exact_tokens": 218, + "token_weighted_mean_set_jaccard": 0.8754538279400158, + "source_mean_token_weighted_tv": 0.024608667153485995, + "source_mean_aggregate_load_tv": 0.043227844546725354 + }, + "system_period": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 148, + "set_exact_tokens": 210, + "token_weighted_mean_set_jaccard": 0.8695080242041568, + "source_mean_token_weighted_tv": 0.02582104507503609, + "source_mean_aggregate_load_tv": 0.04749677700179798 + }, + "bos_at_s0": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 157, + "set_exact_tokens": 226, + "token_weighted_mean_set_jaccard": 0.8833201789002896, + "source_mean_token_weighted_tv": 0.022511785905681134, + "source_mean_aggregate_load_tv": 0.04220995083175838 + }, + "bos_at_s1": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 167, + "set_exact_tokens": 226, + "token_weighted_mean_set_jaccard": 0.882596685082873, + "source_mean_token_weighted_tv": 0.023671099279120596, + "source_mean_aggregate_load_tv": 0.04122509877206441 + }, + "x_at_s0": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 151, + "set_exact_tokens": 210, + "token_weighted_mean_set_jaccard": 0.8711523283346488, + "source_mean_token_weighted_tv": 0.02592840526693321, + "source_mean_aggregate_load_tv": 0.045453452605945036 + }, + "x_at_s1": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 119, + "set_exact_tokens": 192, + "token_weighted_mean_set_jaccard": 0.8531965272296765, + "source_mean_token_weighted_tv": 0.03129839564083499, + "source_mean_aggregate_load_tv": 0.056565710646652514 + }, + "period_at_s0": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 144, + "set_exact_tokens": 204, + "token_weighted_mean_set_jaccard": 0.8654959221257565, + "source_mean_token_weighted_tv": 0.026175750719979022, + "source_mean_aggregate_load_tv": 0.0516825205106302 + }, + "period_at_s1": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 125, + "set_exact_tokens": 194, + "token_weighted_mean_set_jaccard": 0.8524072612470404, + "source_mean_token_weighted_tv": 0.030063458282567426, + "source_mean_aggregate_load_tv": 0.04890474273285242 + } + }, + "layer_14": { + "system_eos": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 213, + "set_exact_tokens": 259, + "token_weighted_mean_set_jaccard": 0.9157458563535912, + "source_mean_token_weighted_tv": 0.01755135363059553, + "source_mean_aggregate_load_tv": 0.037784763713345645 + }, + "system_bos": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 182, + "set_exact_tokens": 240, + "token_weighted_mean_set_jaccard": 0.893646408839779, + "source_mean_token_weighted_tv": 0.021301026972227178, + "source_mean_aggregate_load_tv": 0.036562676198634694 + }, + "system_x": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 155, + "set_exact_tokens": 215, + "token_weighted_mean_set_jaccard": 0.8762825572217837, + "source_mean_token_weighted_tv": 0.0263908995500856, + "source_mean_aggregate_load_tv": 0.0436093864314851 + }, + "system_period": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 163, + "set_exact_tokens": 215, + "token_weighted_mean_set_jaccard": 0.8709550118389898, + "source_mean_token_weighted_tv": 0.028287533181071384, + "source_mean_aggregate_load_tv": 0.051593233932096125 + }, + "bos_at_s0": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 168, + "set_exact_tokens": 220, + "token_weighted_mean_set_jaccard": 0.8779926335174953, + "source_mean_token_weighted_tv": 0.025653025023748173, + "source_mean_aggregate_load_tv": 0.049970351239752756 + }, + "bos_at_s1": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 166, + "set_exact_tokens": 224, + "token_weighted_mean_set_jaccard": 0.8824651407524337, + "source_mean_token_weighted_tv": 0.024790980873034635, + "source_mean_aggregate_load_tv": 0.044107582399455364 + }, + "x_at_s0": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 158, + "set_exact_tokens": 214, + "token_weighted_mean_set_jaccard": 0.8732570376216786, + "source_mean_token_weighted_tv": 0.02779351885763627, + "source_mean_aggregate_load_tv": 0.041186952649906475 + }, + "x_at_s1": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 139, + "set_exact_tokens": 197, + "token_weighted_mean_set_jaccard": 0.8556958695080242, + "source_mean_token_weighted_tv": 0.031629764257129656, + "source_mean_aggregate_load_tv": 0.04701441622443078 + }, + "period_at_s0": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 161, + "set_exact_tokens": 215, + "token_weighted_mean_set_jaccard": 0.8753617469087083, + "source_mean_token_weighted_tv": 0.025866776735369183, + "source_mean_aggregate_load_tv": 0.042081071235267886 + }, + "period_at_s1": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 150, + "set_exact_tokens": 202, + "token_weighted_mean_set_jaccard": 0.8575374901341752, + "source_mean_token_weighted_tv": 0.03229170229738966, + "source_mean_aggregate_load_tv": 0.05071025442780363 + } + }, + "layer_15": { + "system_eos": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 221, + "set_exact_tokens": 260, + "token_weighted_mean_set_jaccard": 0.9153512233622731, + "source_mean_token_weighted_tv": 0.015969748718928492, + "source_mean_aggregate_load_tv": 0.03090995932155812 + }, + "system_bos": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 183, + "set_exact_tokens": 229, + "token_weighted_mean_set_jaccard": 0.8874638253091292, + "source_mean_token_weighted_tv": 0.02288823187289193, + "source_mean_aggregate_load_tv": 0.041130538838111415 + }, + "system_x": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 162, + "set_exact_tokens": 210, + "token_weighted_mean_set_jaccard": 0.8656274664561957, + "source_mean_token_weighted_tv": 0.029264353059071137, + "source_mean_aggregate_load_tv": 0.048691673462539616 + }, + "system_period": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 148, + "set_exact_tokens": 198, + "token_weighted_mean_set_jaccard": 0.8536569323862141, + "source_mean_token_weighted_tv": 0.029933650621890164, + "source_mean_aggregate_load_tv": 0.04783020329944673 + }, + "bos_at_s0": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 178, + "set_exact_tokens": 234, + "token_weighted_mean_set_jaccard": 0.8872665088134701, + "source_mean_token_weighted_tv": 0.023393340290645936, + "source_mean_aggregate_load_tv": 0.04332710059021249 + }, + "bos_at_s1": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 154, + "set_exact_tokens": 221, + "token_weighted_mean_set_jaccard": 0.8786503551696921, + "source_mean_token_weighted_tv": 0.025199009383879666, + "source_mean_aggregate_load_tv": 0.042885318434037284 + }, + "x_at_s0": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 161, + "set_exact_tokens": 210, + "token_weighted_mean_set_jaccard": 0.8622073138647726, + "source_mean_token_weighted_tv": 0.02791581914267469, + "source_mean_aggregate_load_tv": 0.04109523357233833 + }, + "x_at_s1": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 133, + "set_exact_tokens": 190, + "token_weighted_mean_set_jaccard": 0.8462904498816102, + "source_mean_token_weighted_tv": 0.03220888425741668, + "source_mean_aggregate_load_tv": 0.052921012899655805 + }, + "period_at_s0": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 166, + "set_exact_tokens": 203, + "token_weighted_mean_set_jaccard": 0.8584583004472507, + "source_mean_token_weighted_tv": 0.027511597843401348, + "source_mean_aggregate_load_tv": 0.03868375485894833 + }, + "period_at_s1": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 133, + "set_exact_tokens": 193, + "token_weighted_mean_set_jaccard": 0.8473428045251248, + "source_mean_token_weighted_tv": 0.03308566424057455, + "source_mean_aggregate_load_tv": 0.051819690769631596 + } + }, + "layer_16": { + "system_eos": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 221, + "set_exact_tokens": 263, + "token_weighted_mean_set_jaccard": 0.9165351223362275, + "source_mean_token_weighted_tv": 0.017230122151005285, + "source_mean_aggregate_load_tv": 0.03198368204026222 + }, + "system_bos": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 195, + "set_exact_tokens": 249, + "token_weighted_mean_set_jaccard": 0.9008813470139436, + "source_mean_token_weighted_tv": 0.022380269916859943, + "source_mean_aggregate_load_tv": 0.036799919215824824 + }, + "system_x": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 162, + "set_exact_tokens": 210, + "token_weighted_mean_set_jaccard": 0.8641147066561432, + "source_mean_token_weighted_tv": 0.03030674828195615, + "source_mean_aggregate_load_tv": 0.05137303605321511 + }, + "system_period": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 160, + "set_exact_tokens": 218, + "token_weighted_mean_set_jaccard": 0.8709813207050777, + "source_mean_token_weighted_tv": 0.029978461374349834, + "source_mean_aggregate_load_tv": 0.05112321462133073 + }, + "bos_at_s0": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 175, + "set_exact_tokens": 216, + "token_weighted_mean_set_jaccard": 0.876019468560905, + "source_mean_token_weighted_tv": 0.02532196986244466, + "source_mean_aggregate_load_tv": 0.046304552508907235 + }, + "bos_at_s1": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 175, + "set_exact_tokens": 221, + "token_weighted_mean_set_jaccard": 0.8746382530912918, + "source_mean_token_weighted_tv": 0.02594678692945699, + "source_mean_aggregate_load_tv": 0.04415912365100914 + }, + "x_at_s0": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 159, + "set_exact_tokens": 203, + "token_weighted_mean_set_jaccard": 0.8638516179952644, + "source_mean_token_weighted_tv": 0.029456425094168952, + "source_mean_aggregate_load_tv": 0.053149324990340585 + }, + "x_at_s1": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 142, + "set_exact_tokens": 185, + "token_weighted_mean_set_jaccard": 0.8433307024467247, + "source_mean_token_weighted_tv": 0.03309611754796007, + "source_mean_aggregate_load_tv": 0.058361076425943535 + }, + "period_at_s0": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 165, + "set_exact_tokens": 214, + "token_weighted_mean_set_jaccard": 0.8750328860826099, + "source_mean_token_weighted_tv": 0.026813159159114724, + "source_mean_aggregate_load_tv": 0.047047288991169806 + }, + "period_at_s1": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 141, + "set_exact_tokens": 186, + "token_weighted_mean_set_jaccard": 0.8403051828466191, + "source_mean_token_weighted_tv": 0.035357270214562496, + "source_mean_aggregate_load_tv": 0.062352996395162466 + } + }, + "layer_17": { + "system_eos": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 218, + "set_exact_tokens": 263, + "token_weighted_mean_set_jaccard": 0.9166666666666667, + "source_mean_token_weighted_tv": 0.016247928761580512, + "source_mean_aggregate_load_tv": 0.0253915718470981 + }, + "system_bos": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 181, + "set_exact_tokens": 230, + "token_weighted_mean_set_jaccard": 0.8851617995264405, + "source_mean_token_weighted_tv": 0.023481383641457715, + "source_mean_aggregate_load_tv": 0.04258679660698397 + }, + "system_x": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 152, + "set_exact_tokens": 215, + "token_weighted_mean_set_jaccard": 0.8669429097605894, + "source_mean_token_weighted_tv": 0.029570023877676238, + "source_mean_aggregate_load_tv": 0.051959532996483884 + }, + "system_period": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 159, + "set_exact_tokens": 212, + "token_weighted_mean_set_jaccard": 0.8640489344909235, + "source_mean_token_weighted_tv": 0.029758403459007023, + "source_mean_aggregate_load_tv": 0.04512773972492242 + }, + "bos_at_s0": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 175, + "set_exact_tokens": 226, + "token_weighted_mean_set_jaccard": 0.8821362799263351, + "source_mean_token_weighted_tv": 0.023920933018819604, + "source_mean_aggregate_load_tv": 0.043927970703939515 + }, + "bos_at_s1": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 174, + "set_exact_tokens": 228, + "token_weighted_mean_set_jaccard": 0.8824256774533017, + "source_mean_token_weighted_tv": 0.024971169055884146, + "source_mean_aggregate_load_tv": 0.03877263308013161 + }, + "x_at_s0": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 169, + "set_exact_tokens": 217, + "token_weighted_mean_set_jaccard": 0.8710470928702974, + "source_mean_token_weighted_tv": 0.02903609031680951, + "source_mean_aggregate_load_tv": 0.04429386141097648 + }, + "x_at_s1": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 145, + "set_exact_tokens": 201, + "token_weighted_mean_set_jaccard": 0.849802683504341, + "source_mean_token_weighted_tv": 0.032973989080056346, + "source_mean_aggregate_load_tv": 0.05922985921048492 + }, + "period_at_s0": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 166, + "set_exact_tokens": 222, + "token_weighted_mean_set_jaccard": 0.876835043409629, + "source_mean_token_weighted_tv": 0.026663557926388477, + "source_mean_aggregate_load_tv": 0.044264237857973114 + }, + "period_at_s1": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 148, + "set_exact_tokens": 205, + "token_weighted_mean_set_jaccard": 0.8488161010260457, + "source_mean_token_weighted_tv": 0.03273294779718256, + "source_mean_aggregate_load_tv": 0.0527156646081423 + } + }, + "layer_18": { + "system_eos": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 216, + "set_exact_tokens": 251, + "token_weighted_mean_set_jaccard": 0.9064719810576163, + "source_mean_token_weighted_tv": 0.018366692203672104, + "source_mean_aggregate_load_tv": 0.031195086019215584 + }, + "system_bos": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 189, + "set_exact_tokens": 239, + "token_weighted_mean_set_jaccard": 0.894041041831097, + "source_mean_token_weighted_tv": 0.02244549454199886, + "source_mean_aggregate_load_tv": 0.03951293706336013 + }, + "system_x": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 158, + "set_exact_tokens": 215, + "token_weighted_mean_set_jaccard": 0.8715732701920548, + "source_mean_token_weighted_tv": 0.03075798341670594, + "source_mean_aggregate_load_tv": 0.04667327651015589 + }, + "system_period": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 159, + "set_exact_tokens": 203, + "token_weighted_mean_set_jaccard": 0.8601026045777428, + "source_mean_token_weighted_tv": 0.031269928048425565, + "source_mean_aggregate_load_tv": 0.05046268904424617 + }, + "bos_at_s0": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 165, + "set_exact_tokens": 215, + "token_weighted_mean_set_jaccard": 0.8765456458826626, + "source_mean_token_weighted_tv": 0.025043296716194218, + "source_mean_aggregate_load_tv": 0.0404227068264443 + }, + "bos_at_s1": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 166, + "set_exact_tokens": 205, + "token_weighted_mean_set_jaccard": 0.8662851881083925, + "source_mean_token_weighted_tv": 0.026254440958259077, + "source_mean_aggregate_load_tv": 0.04488279085327932 + }, + "x_at_s0": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 151, + "set_exact_tokens": 209, + "token_weighted_mean_set_jaccard": 0.8685872138910813, + "source_mean_token_weighted_tv": 0.029338434821677056, + "source_mean_aggregate_load_tv": 0.04559630457771615 + }, + "x_at_s1": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 150, + "set_exact_tokens": 200, + "token_weighted_mean_set_jaccard": 0.8570113128124179, + "source_mean_token_weighted_tv": 0.032649224574709534, + "source_mean_aggregate_load_tv": 0.048140088552039446 + }, + "period_at_s0": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 151, + "set_exact_tokens": 196, + "token_weighted_mean_set_jaccard": 0.8568139963167588, + "source_mean_token_weighted_tv": 0.030601696584351787, + "source_mean_aggregate_load_tv": 0.05386527877598464 + }, + "period_at_s1": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 140, + "set_exact_tokens": 188, + "token_weighted_mean_set_jaccard": 0.8435543278084715, + "source_mean_token_weighted_tv": 0.03395350121975317, + "source_mean_aggregate_load_tv": 0.052446773896265536 + } + }, + "layer_19": { + "system_eos": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 209, + "set_exact_tokens": 249, + "token_weighted_mean_set_jaccard": 0.9056169429097606, + "source_mean_token_weighted_tv": 0.018985163337990232, + "source_mean_aggregate_load_tv": 0.036524353625769626 + }, + "system_bos": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 188, + "set_exact_tokens": 235, + "token_weighted_mean_set_jaccard": 0.8910155222309918, + "source_mean_token_weighted_tv": 0.022837449128197008, + "source_mean_aggregate_load_tv": 0.040788589971308103 + }, + "system_x": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 149, + "set_exact_tokens": 193, + "token_weighted_mean_set_jaccard": 0.8481978426729808, + "source_mean_token_weighted_tv": 0.030621442378301906, + "source_mean_aggregate_load_tv": 0.046253011257353455 + }, + "system_period": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 140, + "set_exact_tokens": 197, + "token_weighted_mean_set_jaccard": 0.8501710076295713, + "source_mean_token_weighted_tv": 0.031497229964446094, + "source_mean_aggregate_load_tv": 0.05410211343582397 + }, + "bos_at_s0": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 180, + "set_exact_tokens": 228, + "token_weighted_mean_set_jaccard": 0.8814785582741383, + "source_mean_token_weighted_tv": 0.025885260717391043, + "source_mean_aggregate_load_tv": 0.042193714845977684 + }, + "bos_at_s1": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 171, + "set_exact_tokens": 216, + "token_weighted_mean_set_jaccard": 0.8670744540910288, + "source_mean_token_weighted_tv": 0.02676025309093108, + "source_mean_aggregate_load_tv": 0.04890375712961685 + }, + "x_at_s0": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 161, + "set_exact_tokens": 207, + "token_weighted_mean_set_jaccard": 0.8612075769534333, + "source_mean_token_weighted_tv": 0.02980766586527431, + "source_mean_aggregate_load_tv": 0.050231536097176545 + }, + "x_at_s1": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 130, + "set_exact_tokens": 192, + "token_weighted_mean_set_jaccard": 0.8407918968692449, + "source_mean_token_weighted_tv": 0.03529716424812172, + "source_mean_aggregate_load_tv": 0.05697404279020394 + }, + "period_at_s0": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 163, + "set_exact_tokens": 223, + "token_weighted_mean_set_jaccard": 0.870915548539858, + "source_mean_token_weighted_tv": 0.02869304783022631, + "source_mean_aggregate_load_tv": 0.04792174592630773 + }, + "period_at_s1": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 135, + "set_exact_tokens": 183, + "token_weighted_mean_set_jaccard": 0.8315837937384899, + "source_mean_token_weighted_tv": 0.036980844226122814, + "source_mean_aggregate_load_tv": 0.06159872003665335 + } + }, + "layer_20": { + "system_eos": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 177, + "set_exact_tokens": 232, + "token_weighted_mean_set_jaccard": 0.888779268613523, + "source_mean_token_weighted_tv": 0.020086157145474504, + "source_mean_aggregate_load_tv": 0.041038819760543285 + }, + "system_bos": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 157, + "set_exact_tokens": 211, + "token_weighted_mean_set_jaccard": 0.8714811891607472, + "source_mean_token_weighted_tv": 0.024004172410011577, + "source_mean_aggregate_load_tv": 0.04521418544707165 + }, + "system_x": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 124, + "set_exact_tokens": 177, + "token_weighted_mean_set_jaccard": 0.8374769797421732, + "source_mean_token_weighted_tv": 0.03140957297141148, + "source_mean_aggregate_load_tv": 0.05292061966665134 + }, + "system_period": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 127, + "set_exact_tokens": 175, + "token_weighted_mean_set_jaccard": 0.8323467508550383, + "source_mean_token_weighted_tv": 0.03345166876293469, + "source_mean_aggregate_load_tv": 0.0599697623985358 + }, + "bos_at_s0": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 138, + "set_exact_tokens": 199, + "token_weighted_mean_set_jaccard": 0.8601683767429624, + "source_mean_token_weighted_tv": 0.026905153553579017, + "source_mean_aggregate_load_tv": 0.05190329563539598 + }, + "bos_at_s1": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 144, + "set_exact_tokens": 198, + "token_weighted_mean_set_jaccard": 0.8576690344646147, + "source_mean_token_weighted_tv": 0.02752644237385551, + "source_mean_aggregate_load_tv": 0.052670790672593795 + }, + "x_at_s0": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 131, + "set_exact_tokens": 198, + "token_weighted_mean_set_jaccard": 0.8545119705340701, + "source_mean_token_weighted_tv": 0.028224886811532193, + "source_mean_aggregate_load_tv": 0.0466647615031745 + }, + "x_at_s1": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 112, + "set_exact_tokens": 162, + "token_weighted_mean_set_jaccard": 0.8184030518284662, + "source_mean_token_weighted_tv": 0.03590221272111023, + "source_mean_aggregate_load_tv": 0.066947825744138 + }, + "period_at_s0": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 139, + "set_exact_tokens": 204, + "token_weighted_mean_set_jaccard": 0.8583793738489871, + "source_mean_token_weighted_tv": 0.027700004344828832, + "source_mean_aggregate_load_tv": 0.049634091647892314 + }, + "period_at_s1": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 113, + "set_exact_tokens": 168, + "token_weighted_mean_set_jaccard": 0.8195211786372008, + "source_mean_token_weighted_tv": 0.03645066331394193, + "source_mean_aggregate_load_tv": 0.06640905115497575 + } + }, + "layer_21": { + "system_eos": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 174, + "set_exact_tokens": 231, + "token_weighted_mean_set_jaccard": 0.8896343067613787, + "source_mean_token_weighted_tv": 0.021528628127580055, + "source_mean_aggregate_load_tv": 0.04165777355102713 + }, + "system_bos": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 165, + "set_exact_tokens": 227, + "token_weighted_mean_set_jaccard": 0.8835174953959484, + "source_mean_token_weighted_tv": 0.02375328360836007, + "source_mean_aggregate_load_tv": 0.04481825526750734 + }, + "system_x": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 127, + "set_exact_tokens": 179, + "token_weighted_mean_set_jaccard": 0.8310970797158643, + "source_mean_token_weighted_tv": 0.034082451528989484, + "source_mean_aggregate_load_tv": 0.06065422225368086 + }, + "system_period": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 123, + "set_exact_tokens": 189, + "token_weighted_mean_set_jaccard": 0.8382267824256776, + "source_mean_token_weighted_tv": 0.034334223056423994, + "source_mean_aggregate_load_tv": 0.06515187515678905 + }, + "bos_at_s0": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 162, + "set_exact_tokens": 217, + "token_weighted_mean_set_jaccard": 0.8701920547224415, + "source_mean_token_weighted_tv": 0.02706713321482593, + "source_mean_aggregate_load_tv": 0.04993301427012324 + }, + "bos_at_s1": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 140, + "set_exact_tokens": 198, + "token_weighted_mean_set_jaccard": 0.8601683767429624, + "source_mean_token_weighted_tv": 0.028825203132241684, + "source_mean_aggregate_load_tv": 0.04951558231153249 + }, + "x_at_s0": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 126, + "set_exact_tokens": 181, + "token_weighted_mean_set_jaccard": 0.840370955011839, + "source_mean_token_weighted_tv": 0.03027579670742568, + "source_mean_aggregate_load_tv": 0.05329745787970377 + }, + "x_at_s1": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 106, + "set_exact_tokens": 158, + "token_weighted_mean_set_jaccard": 0.8140883977900553, + "source_mean_token_weighted_tv": 0.038835992211322126, + "source_mean_aggregate_load_tv": 0.0709373056521497 + }, + "period_at_s0": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 150, + "set_exact_tokens": 210, + "token_weighted_mean_set_jaccard": 0.862102078400421, + "source_mean_token_weighted_tv": 0.027715203664185728, + "source_mean_aggregate_load_tv": 0.0422367335283769 + }, + "period_at_s1": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 115, + "set_exact_tokens": 172, + "token_weighted_mean_set_jaccard": 0.8234938174164695, + "source_mean_token_weighted_tv": 0.0371385066004392, + "source_mean_aggregate_load_tv": 0.07271927630204489 + } + }, + "layer_22": { + "system_eos": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 192, + "set_exact_tokens": 229, + "token_weighted_mean_set_jaccard": 0.8867403314917127, + "source_mean_token_weighted_tv": 0.020262693334227644, + "source_mean_aggregate_load_tv": 0.034115314973586844 + }, + "system_bos": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 170, + "set_exact_tokens": 219, + "token_weighted_mean_set_jaccard": 0.8734543541173376, + "source_mean_token_weighted_tv": 0.024799718733119945, + "source_mean_aggregate_load_tv": 0.041114310414503884 + }, + "system_x": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 137, + "set_exact_tokens": 184, + "token_weighted_mean_set_jaccard": 0.8375427519073927, + "source_mean_token_weighted_tv": 0.03500215664429797, + "source_mean_aggregate_load_tv": 0.055676472183705555 + }, + "system_period": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 139, + "set_exact_tokens": 178, + "token_weighted_mean_set_jaccard": 0.8358589844777692, + "source_mean_token_weighted_tv": 0.034930663556619924, + "source_mean_aggregate_load_tv": 0.0590360432330448 + }, + "bos_at_s0": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 161, + "set_exact_tokens": 206, + "token_weighted_mean_set_jaccard": 0.8617469087082347, + "source_mean_token_weighted_tv": 0.028003460258847108, + "source_mean_aggregate_load_tv": 0.05050570772664539 + }, + "bos_at_s1": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 150, + "set_exact_tokens": 199, + "token_weighted_mean_set_jaccard": 0.854117337542752, + "source_mean_token_weighted_tv": 0.02897109626846383, + "source_mean_aggregate_load_tv": 0.04421228824906854 + }, + "x_at_s0": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 145, + "set_exact_tokens": 183, + "token_weighted_mean_set_jaccard": 0.8369771112865036, + "source_mean_token_weighted_tv": 0.03371432112101842, + "source_mean_aggregate_load_tv": 0.056276757489374635 + }, + "x_at_s1": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 111, + "set_exact_tokens": 162, + "token_weighted_mean_set_jaccard": 0.8124835569586951, + "source_mean_token_weighted_tv": 0.04005798169128529, + "source_mean_aggregate_load_tv": 0.069934838770435 + }, + "period_at_s0": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 145, + "set_exact_tokens": 188, + "token_weighted_mean_set_jaccard": 0.8460273612207314, + "source_mean_token_weighted_tv": 0.030574854271197997, + "source_mean_aggregate_load_tv": 0.05208047483187776 + }, + "period_at_s1": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 126, + "set_exact_tokens": 171, + "token_weighted_mean_set_jaccard": 0.820928702972902, + "source_mean_token_weighted_tv": 0.03910673805214896, + "source_mean_aggregate_load_tv": 0.06556890632020218 + } + }, + "layer_23": { + "system_eos": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 183, + "set_exact_tokens": 249, + "token_weighted_mean_set_jaccard": 0.9054853985793214, + "source_mean_token_weighted_tv": 0.018997199615580794, + "source_mean_aggregate_load_tv": 0.03454613449940027 + }, + "system_bos": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 171, + "set_exact_tokens": 223, + "token_weighted_mean_set_jaccard": 0.8821362799263353, + "source_mean_token_weighted_tv": 0.023539396137791817, + "source_mean_aggregate_load_tv": 0.046171430533272356 + }, + "system_x": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 141, + "set_exact_tokens": 191, + "token_weighted_mean_set_jaccard": 0.8500394632991317, + "source_mean_token_weighted_tv": 0.03023432793294501, + "source_mean_aggregate_load_tv": 0.04242486779304732 + }, + "system_period": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 129, + "set_exact_tokens": 189, + "token_weighted_mean_set_jaccard": 0.8501973164956591, + "source_mean_token_weighted_tv": 0.031292469614533074, + "source_mean_aggregate_load_tv": 0.04766868284286087 + }, + "bos_at_s0": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 159, + "set_exact_tokens": 221, + "token_weighted_mean_set_jaccard": 0.8783214943435939, + "source_mean_token_weighted_tv": 0.02523701738889319, + "source_mean_aggregate_load_tv": 0.045821775812016075 + }, + "bos_at_s1": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 134, + "set_exact_tokens": 201, + "token_weighted_mean_set_jaccard": 0.8591160220994475, + "source_mean_token_weighted_tv": 0.02849244576054573, + "source_mean_aggregate_load_tv": 0.054952396624084576 + }, + "x_at_s0": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 140, + "set_exact_tokens": 198, + "token_weighted_mean_set_jaccard": 0.856971849513286, + "source_mean_token_weighted_tv": 0.030379432031758417, + "source_mean_aggregate_load_tv": 0.048696546022780896 + }, + "x_at_s1": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 109, + "set_exact_tokens": 180, + "token_weighted_mean_set_jaccard": 0.8376742962378322, + "source_mean_token_weighted_tv": 0.03543182867107738, + "source_mean_aggregate_load_tv": 0.06293907741890728 + }, + "period_at_s0": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 138, + "set_exact_tokens": 199, + "token_weighted_mean_set_jaccard": 0.8587213891081296, + "source_mean_token_weighted_tv": 0.030016874830998012, + "source_mean_aggregate_load_tv": 0.05537492548738711 + }, + "period_at_s1": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 112, + "set_exact_tokens": 178, + "token_weighted_mean_set_jaccard": 0.8326756116811366, + "source_mean_token_weighted_tv": 0.03702486007492559, + "source_mean_aggregate_load_tv": 0.06353084771759498 + } + }, + "layer_24": { + "system_eos": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 179, + "set_exact_tokens": 226, + "token_weighted_mean_set_jaccard": 0.8801631149697449, + "source_mean_token_weighted_tv": 0.019031125549162437, + "source_mean_aggregate_load_tv": 0.03665422638766885 + }, + "system_bos": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 157, + "set_exact_tokens": 216, + "token_weighted_mean_set_jaccard": 0.8702578268876612, + "source_mean_token_weighted_tv": 0.023422606927213943, + "source_mean_aggregate_load_tv": 0.04732755069075915 + }, + "system_x": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 126, + "set_exact_tokens": 181, + "token_weighted_mean_set_jaccard": 0.834214680347277, + "source_mean_token_weighted_tv": 0.031150283048789553, + "source_mean_aggregate_load_tv": 0.05714125252173268 + }, + "system_period": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 119, + "set_exact_tokens": 170, + "token_weighted_mean_set_jaccard": 0.8217837411207577, + "source_mean_token_weighted_tv": 0.03345508999112358, + "source_mean_aggregate_load_tv": 0.05608578993049254 + }, + "bos_at_s0": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 149, + "set_exact_tokens": 199, + "token_weighted_mean_set_jaccard": 0.8519348975150081, + "source_mean_token_weighted_tv": 0.024823163269593225, + "source_mean_aggregate_load_tv": 0.03920045042319937 + }, + "bos_at_s1": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 134, + "set_exact_tokens": 190, + "token_weighted_mean_set_jaccard": 0.8435937911076034, + "source_mean_token_weighted_tv": 0.026080868840835093, + "source_mean_aggregate_load_tv": 0.04560199385265902 + }, + "x_at_s0": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 142, + "set_exact_tokens": 195, + "token_weighted_mean_set_jaccard": 0.8432912391475929, + "source_mean_token_weighted_tv": 0.026975184190830764, + "source_mean_aggregate_load_tv": 0.04994339965460026 + }, + "x_at_s1": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 108, + "set_exact_tokens": 160, + "token_weighted_mean_set_jaccard": 0.807379636937648, + "source_mean_token_weighted_tv": 0.036220942606091544, + "source_mean_aggregate_load_tv": 0.060260570808962965 + }, + "period_at_s0": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 147, + "set_exact_tokens": 191, + "token_weighted_mean_set_jaccard": 0.8395816890292029, + "source_mean_token_weighted_tv": 0.02682475245018525, + "source_mean_aggregate_load_tv": 0.0501798259570888 + }, + "period_at_s1": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 104, + "set_exact_tokens": 154, + "token_weighted_mean_set_jaccard": 0.7985003946329914, + "source_mean_token_weighted_tv": 0.03739545321499852, + "source_mean_aggregate_load_tv": 0.06268358939859954 + } + }, + "layer_25": { + "system_eos": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 194, + "set_exact_tokens": 227, + "token_weighted_mean_set_jaccard": 0.8848329387003422, + "source_mean_token_weighted_tv": 0.019682953511045397, + "source_mean_aggregate_load_tv": 0.04106073745909369 + }, + "system_bos": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 181, + "set_exact_tokens": 240, + "token_weighted_mean_set_jaccard": 0.8947645356485137, + "source_mean_token_weighted_tv": 0.02145068068092476, + "source_mean_aggregate_load_tv": 0.04009455388421446 + }, + "system_x": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 151, + "set_exact_tokens": 194, + "token_weighted_mean_set_jaccard": 0.8518153117600632, + "source_mean_token_weighted_tv": 0.030097261359507927, + "source_mean_aggregate_load_tv": 0.052115780097650846 + }, + "system_period": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 141, + "set_exact_tokens": 188, + "token_weighted_mean_set_jaccard": 0.8480005261773218, + "source_mean_token_weighted_tv": 0.03308606339599764, + "source_mean_aggregate_load_tv": 0.05639039426549318 + }, + "bos_at_s0": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 155, + "set_exact_tokens": 207, + "token_weighted_mean_set_jaccard": 0.8696395685345962, + "source_mean_token_weighted_tv": 0.025967456433202807, + "source_mean_aggregate_load_tv": 0.04651702940898894 + }, + "bos_at_s1": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 148, + "set_exact_tokens": 201, + "token_weighted_mean_set_jaccard": 0.8646408839779005, + "source_mean_token_weighted_tv": 0.024823285682323996, + "source_mean_aggregate_load_tv": 0.04166932098944684 + }, + "x_at_s0": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 153, + "set_exact_tokens": 217, + "token_weighted_mean_set_jaccard": 0.8743093922651933, + "source_mean_token_weighted_tv": 0.026860571390417587, + "source_mean_aggregate_load_tv": 0.04642061422188666 + }, + "x_at_s1": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 136, + "set_exact_tokens": 182, + "token_weighted_mean_set_jaccard": 0.8406998158379375, + "source_mean_token_weighted_tv": 0.03266344162728571, + "source_mean_aggregate_load_tv": 0.053125559600814054 + }, + "period_at_s0": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 170, + "set_exact_tokens": 223, + "token_weighted_mean_set_jaccard": 0.8790449881610103, + "source_mean_token_weighted_tv": 0.02517923208659628, + "source_mean_aggregate_load_tv": 0.04435821298386817 + }, + "period_at_s1": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 135, + "set_exact_tokens": 182, + "token_weighted_mean_set_jaccard": 0.8408313601683768, + "source_mean_token_weighted_tv": 0.03404954778128281, + "source_mean_aggregate_load_tv": 0.059943957742979684 + } + }, + "layer_26": { + "system_eos": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 194, + "set_exact_tokens": 246, + "token_weighted_mean_set_jaccard": 0.9019337016574586, + "source_mean_token_weighted_tv": 0.01832013413132188, + "source_mean_aggregate_load_tv": 0.02909268340588986 + }, + "system_bos": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 209, + "set_exact_tokens": 251, + "token_weighted_mean_set_jaccard": 0.9062746645619575, + "source_mean_token_weighted_tv": 0.021822109228234177, + "source_mean_aggregate_load_tv": 0.03500983435412588 + }, + "system_x": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 152, + "set_exact_tokens": 201, + "token_weighted_mean_set_jaccard": 0.8613522757169167, + "source_mean_token_weighted_tv": 0.03034389581677751, + "source_mean_aggregate_load_tv": 0.04618280152098493 + }, + "system_period": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 144, + "set_exact_tokens": 189, + "token_weighted_mean_set_jaccard": 0.8505656406208894, + "source_mean_token_weighted_tv": 0.033191861193359255, + "source_mean_aggregate_load_tv": 0.05206139798971221 + }, + "bos_at_s0": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 182, + "set_exact_tokens": 223, + "token_weighted_mean_set_jaccard": 0.8762825572217836, + "source_mean_token_weighted_tv": 0.02699223679921346, + "source_mean_aggregate_load_tv": 0.04503317979096943 + }, + "bos_at_s1": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 166, + "set_exact_tokens": 228, + "token_weighted_mean_set_jaccard": 0.882991318074191, + "source_mean_token_weighted_tv": 0.024364179918998596, + "source_mean_aggregate_load_tv": 0.037873649496702085 + }, + "x_at_s0": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 163, + "set_exact_tokens": 212, + "token_weighted_mean_set_jaccard": 0.8728624046303605, + "source_mean_token_weighted_tv": 0.0257642673864062, + "source_mean_aggregate_load_tv": 0.04033626110429507 + }, + "x_at_s1": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 139, + "set_exact_tokens": 201, + "token_weighted_mean_set_jaccard": 0.8589844777690082, + "source_mean_token_weighted_tv": 0.03105196339451412, + "source_mean_aggregate_load_tv": 0.04359356636522836 + }, + "period_at_s0": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 172, + "set_exact_tokens": 224, + "token_weighted_mean_set_jaccard": 0.8816101026045776, + "source_mean_token_weighted_tv": 0.023992418433147814, + "source_mean_aggregate_load_tv": 0.040242109527692874 + }, + "period_at_s1": { + "sources": 4, + "tokens": 362, + "ordered_topk_exact_tokens": 130, + "set_exact_tokens": 180, + "token_weighted_mean_set_jaccard": 0.8397132333596422, + "source_mean_token_weighted_tv": 0.03410394230606271, + "source_mean_aggregate_load_tv": 0.054285150795782604 + } + } + } + }, + "claim_boundary": [ + "The trace observes one fixed SFT Chat checkpoint, not the Base checkpoint.", + "Target comparisons exclude boundary-crossing tokens and require exact token IDs.", + "Router and hidden associations do not establish mediation or capability causality.", + "CPU in hf_device_map is offload residency, not proof of CPU matrix execution.", + "Prompt-only use_cache=False traces are not generation-time KV or serving traces." + ] +} diff --git a/src/data/deepseek-v2-lite-chat-full-depth.json b/src/data/deepseek-v2-lite-chat-full-depth.json new file mode 100644 index 0000000..901556d --- /dev/null +++ b/src/data/deepseek-v2-lite-chat-full-depth.json @@ -0,0 +1,1136822 @@ +{ + "schema_version": 1, + "captured_at": "2026-07-29T16:18:00+00:00", + "model": { + "repo": "deepseek-ai/DeepSeek-V2-Lite-Chat", + "revision": "85864749cd611b4353ce1decdb286193298f64c7", + "checkpoint_identity": "SFT Chat", + "architecture": "DeepseekV2ForCausalLM", + "dtype": "bfloat16", + "download_revision_contract": { + "metadata_root": "/home/wuyang/.cache/llm-atlas/deepseek-v2-lite-chat-85864749/.cache/huggingface/download", + "all_files_same_revision": true, + "files": { + "config.json": { + "revision": "85864749cd611b4353ce1decdb286193298f64c7", + "etag": "a1aa8126bbf462cbec8fcc79e8c98d8d87f5c7ed" + }, + "configuration_deepseek.py": { + "revision": "85864749cd611b4353ce1decdb286193298f64c7", + "etag": "82e0f5d9d33620a66e328fdeae0b8dc12e2cff7c" + }, + "generation_config.json": { + "revision": "85864749cd611b4353ce1decdb286193298f64c7", + "etag": "458e1d985ba3fbaaf62a4d1a9dd6ff795a451f7e" + }, + "model.safetensors.index.json": { + "revision": "85864749cd611b4353ce1decdb286193298f64c7", + "etag": "5a821356160292c668d01f8e7fdf9abba4a7b72d" + }, + "model-00001-of-000004.safetensors": { + "revision": "85864749cd611b4353ce1decdb286193298f64c7", + "etag": "a314b79a30810b1038f9db08345178e16fb5742aa266c4a3dc05054c59800082" + }, + "model-00002-of-000004.safetensors": { + "revision": "85864749cd611b4353ce1decdb286193298f64c7", + "etag": "b0bd088feada0af954614da3a5b179c4d4d5d8bb2482ec83194d101f3fe91796" + }, + "model-00003-of-000004.safetensors": { + "revision": "85864749cd611b4353ce1decdb286193298f64c7", + "etag": "d31b192e488f0b3a04e007d842c3c9ba5783d944cb1cc27402fe8b8bb837c490" + }, + "model-00004-of-000004.safetensors": { + "revision": "85864749cd611b4353ce1decdb286193298f64c7", + "etag": "304499be0ea06bf8a3937d7a3cc515bc3738dbd288bdd0bbc1b2d3560fce4930" + }, + "modeling_deepseek.py": { + "revision": "85864749cd611b4353ce1decdb286193298f64c7", + "etag": "847a458bedcc8df352b1a89315b8e400b9bc6030" + }, + "tokenization_deepseek_fast.py": { + "revision": "85864749cd611b4353ce1decdb286193298f64c7", + "etag": "d24377191dd00e80c44f22e31dc15272258a22de" + }, + "tokenizer.json": { + "revision": "85864749cd611b4353ce1decdb286193298f64c7", + "etag": "8b284e5afe1730e31c97ed5c3bdf240adbd15c86" + }, + "tokenizer_config.json": { + "revision": "85864749cd611b4353ce1decdb286193298f64c7", + "etag": "685b4b63ad1aedad8f98824ab21d2ff422d9e1b1" + } + } + }, + "files": { + "config.json": { + "bytes": 1522, + "sha256": "f346286b0f1c8b044252fd54cb4fa78b9fab6472a6e8bebb9edfe03d414ea03d" + }, + "configuration_deepseek.py": { + "bytes": 10338, + "sha256": "6de5e7445ab490a16482027b131d5bd6a003da9b58a182a11432115fac84ce59" + }, + "generation_config.json": { + "bytes": 181, + "sha256": "63ec07f6cb36bd8359b44f671123518dd6fbf55007e0c74aa96c296a75def8b5" + }, + "model.safetensors.index.json": { + "bytes": 479924, + "sha256": "d2cdb2f325f6682cf3ad1ad2526a9f979d857390b579380c0331d975136e0acf" + }, + "model-00001-of-000004.safetensors": { + "bytes": 8594887408, + "sha256": "a314b79a30810b1038f9db08345178e16fb5742aa266c4a3dc05054c59800082" + }, + "model-00002-of-000004.safetensors": { + "bytes": 8591757448, + "sha256": "b0bd088feada0af954614da3a5b179c4d4d5d8bb2482ec83194d101f3fe91796" + }, + "model-00003-of-000004.safetensors": { + "bytes": 8590718520, + "sha256": "d31b192e488f0b3a04e007d842c3c9ba5783d944cb1cc27402fe8b8bb837c490" + }, + "model-00004-of-000004.safetensors": { + "bytes": 5636263200, + "sha256": "304499be0ea06bf8a3937d7a3cc515bc3738dbd288bdd0bbc1b2d3560fce4930" + }, + "modeling_deepseek.py": { + "bytes": 78672, + "sha256": "7d8e5221095286eea991137760893fd7ba52727c0b4ebf48ec09e8bc56b45b9c" + }, + "tokenization_deepseek_fast.py": { + "bytes": 1368, + "sha256": "702fc7dbadc450f2fecfbc59e248ecca5845b49101e8f58f805261c920a3effa" + }, + "tokenizer.json": { + "bytes": 4607451, + "sha256": "41f3bf64213da8c012d8bd0871a58a1fdf70463e8f08f110ddbb1082f529f669" + }, + "tokenizer_config.json": { + "bytes": 1279, + "sha256": "31181eaf79394ea26728d95ecb54fe7c8413e6f56085dbabc8b0818134380ec8" + } + } + }, + "tokenizer_contract": { + "length": 100002, + "vocab_size": 100000, + "all_special_ids": [ + 100000, + 100001 + ], + "pad_token_id": 100001, + "conditions": { + "s0_eos": { + "system": 0, + "history": "filler", + "boundary": "eos", + "token_class": "special" + }, + "s1_eos": { + "system": 1, + "history": "filler", + "boundary": "eos", + "token_class": "special" + }, + "s0_bos": { + "system": 0, + "history": "filler", + "boundary": "bos", + "token_class": "special" + }, + "s1_bos": { + "system": 1, + "history": "filler", + "boundary": "bos", + "token_class": "special" + }, + "s0_x": { + "system": 0, + "history": "filler", + "boundary": "x", + "token_class": "ordinary_control" + }, + "s1_x": { + "system": 1, + "history": "filler", + "boundary": "x", + "token_class": "ordinary_control" + }, + "s0_period": { + "system": 0, + "history": "filler", + "boundary": "period", + "token_class": "ordinary_control" + }, + "s1_period": { + "system": 1, + "history": "filler", + "boundary": "period", + "token_class": "ordinary_control" + } + } + }, + "source_contract": { + "reference_path": "src/data/deepseek-v2-lite-routing-special-token-family-control.json", + "reference_sha256": "c372c1b03a8b15f615b54ded5d9257a8fc2cdb7728001735d3d4c1d8534af5bf", + "reference_model_revision": "604d5664dddd88a0433dbae533b7fe9472482de0", + "sample_salt": "llm-atlas-deepseek-routing-template-control-v1", + "domains": [ + "english", + "chinese", + "code", + "math" + ], + "per_domain": 4, + "sources": 16, + "full_source_text_used": true, + "target_scope": "byte-identical interior content tokens; tokens whose offset crosses the content boundary are excluded" + }, + "trace_contract": { + "conditions": [ + "s0_eos", + "s1_eos", + "s0_bos", + "s1_bos", + "s0_x", + "s1_x", + "s0_period", + "s1_period" + ], + "scopes": [ + "target_content", + "full_input" + ], + "edge_pairs": { + "system_eos": [ + "s0_eos", + "s1_eos" + ], + "system_bos": [ + "s0_bos", + "s1_bos" + ], + "system_x": [ + "s0_x", + "s1_x" + ], + "system_period": [ + "s0_period", + "s1_period" + ], + "bos_at_s0": [ + "s0_eos", + "s0_bos" + ], + "bos_at_s1": [ + "s1_eos", + "s1_bos" + ], + "x_at_s0": [ + "s0_eos", + "s0_x" + ], + "x_at_s1": [ + "s1_eos", + "s1_x" + ], + "period_at_s0": [ + "s0_eos", + "s0_period" + ], + "period_at_s1": [ + "s1_eos", + "s1_period" + ] + }, + "decoder_layers": 27, + "moe_gate_layers": [ + 1, + 2, + 3, + 4, + 5, + 6, + 7, + 8, + 9, + 10, + 11, + 12, + 13, + 14, + 15, + 16, + 17, + 18, + 19, + 20, + 21, + 22, + 23, + 24, + 25, + 26 + ], + "experts": 64, + "top_k": 6, + "use_cache": false, + "raw_hidden_tensors_saved": false, + "raw_route_ids_saved": false, + "load_vectors_saved": true, + "hashes_cover_exact_bfloat16_hidden_and_route_values": true + }, + "execution": { + "python": "3.10.14", + "torch": "2.11.0+cu128", + "transformers": "4.41.2", + "accelerate": "1.13.0", + "safetensors": "0.8.0", + "platform": "Linux-7.0.0-28-generic-x86_64-with-glibc2.43", + "gpu": "NVIDIA GeForce RTX 5090", + "gpu_memory_limit": "28GiB", + "cpu_memory_limit": "80GiB", + "pytorch_cuda_alloc_conf": "expandable_segments:True", + "input_device": "cuda:0", + "device_map": { + "model.embed_tokens": 0, + "model.layers.0": 0, + "model.layers.1": 0, + "model.layers.2": 0, + "model.layers.3": 0, + "model.layers.4": 0, + "model.layers.5": 0, + "model.layers.6": 0, + "model.layers.7": 0, + "model.layers.8": 0, + "model.layers.9": 0, + "model.layers.10": 0, + "model.layers.11": 0, + "model.layers.12": 0, + "model.layers.13": 0, + "model.layers.14": 0, + "model.layers.15": 0, + "model.layers.16": 0, + "model.layers.17": 0, + "model.layers.18": 0, + "model.layers.19": 0, + "model.layers.20": 0, + "model.layers.21": 0, + "model.layers.22": 0, + "model.layers.23": 0, + "model.layers.24": "cpu", + "model.layers.25": "cpu", + "model.layers.26": "cpu", + "model.norm": "cpu", + "lm_head": "cpu" + }, + "load_seconds": 8.372377096995478, + "forward_seconds": 13.551748474012129, + "load_peak_cuda_memory_allocated_bytes": 28616922624, + "peak_cuda_memory_allocated_bytes": 28754760704, + "process_max_rss_kib": 18807600 + }, + "sources": [ + { + "id": "wikitext2/raw-validation/0443", + "domain": "english", + "label": "English encyclopedia", + "within_domain_index": 0, + "selection_rank": "004b632f55ea14a7a1f99552db185df62bb0bbd0914ca94c411d0325d0e96639", + "source_text_sha256": "d975cf38b1f984b025b2aee92f625916a07cb7f35335865ca9020146ca1458f0", + "source_characters": 506, + "source_tokens": 114, + "content_token_ids_sha256": "10896deb639b620f1a6bf8efdb19850401765d0c8ec23461f6a6f9d5307755d8", + "prompt_tokens_by_condition": { + "s0_eos": 138, + "s1_eos": 154, + "s0_bos": 138, + "s1_bos": 154, + "s0_x": 138, + "s1_x": 154, + "s0_period": 138, + "s1_period": 154 + }, + "batch_prompt_tokens": 154, + "content_tokens": 113, + "boundary_crossing_tokens_by_condition": { + "s0_eos": 1, + "s1_eos": 1, + "s0_bos": 1, + "s1_bos": 1, + "s0_x": 1, + "s1_x": 1, + "s0_period": 1, + "s1_period": 1 + }, + "forward_seconds": 1.4937810789851937, + "peak_cuda_memory_allocated_bytes": 28754760704, + "hidden_stages": { + "embedding": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d53c0716736484e930f7088bb8e19dabbe2b7f0d6811be1665adda77ed6a9d39", + "mean": -0.00043402970186434686, + "std": 0.09982675313949585, + "rms": 0.09982769191265106, + "max_abs": 1.6875 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d3383f03d4e2ae5778e2a9982356a13d52f998772a8accfc5eac2cd1c22e127c", + "mean": -0.0005247168010100722, + "std": 0.09743694216012955, + "rms": 0.09743835777044296, + "max_abs": 2.046875 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d53c0716736484e930f7088bb8e19dabbe2b7f0d6811be1665adda77ed6a9d39", + "mean": -0.00043402970186434686, + "std": 0.09982675313949585, + "rms": 0.09982769191265106, + "max_abs": 1.6875 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2c2d2e87b43f747b1d78225e2cfa4b3da81913f8d21751854449f16805ff1c4d", + "mean": -0.0006984685314819217, + "std": 0.09822402894496918, + "rms": 0.09822650998830795, + "max_abs": 2.046875 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d53c0716736484e930f7088bb8e19dabbe2b7f0d6811be1665adda77ed6a9d39", + "mean": -0.00043402970186434686, + "std": 0.09982675313949585, + "rms": 0.09982769191265106, + "max_abs": 1.6875 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5db779cb8c13e3e0be83e25fb72f9bf9cc06f173ac4506e0074449b53132e84e", + "mean": -0.0005136067047715187, + "std": 0.09729783236980438, + "rms": 0.09729919582605362, + "max_abs": 2.046875 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d53c0716736484e930f7088bb8e19dabbe2b7f0d6811be1665adda77ed6a9d39", + "mean": -0.00043402970186434686, + "std": 0.09982675313949585, + "rms": 0.09982769191265106, + "max_abs": 1.6875 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b64a6d9705b151c569efc426f74e575a3d26a7ef6d1906643fc4a0dca8a9583f", + "mean": -0.0006885126931592822, + "std": 0.09810040146112442, + "rms": 0.09810281544923782, + "max_abs": 2.046875 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d53c0716736484e930f7088bb8e19dabbe2b7f0d6811be1665adda77ed6a9d39", + "mean": -0.00043402970186434686, + "std": 0.09982675313949585, + "rms": 0.09982769191265106, + "max_abs": 1.6875 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ff2697ba5c44ae21ef5b915989f74d84971e46619eb04bbbd2a2cb1721dbeec7", + "mean": -0.0005408708821050823, + "std": 0.09739165753126144, + "rms": 0.09739316254854202, + "max_abs": 2.046875 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d53c0716736484e930f7088bb8e19dabbe2b7f0d6811be1665adda77ed6a9d39", + "mean": -0.00043402970186434686, + "std": 0.09982675313949585, + "rms": 0.09982769191265106, + "max_abs": 1.6875 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2613a760ad9339e3f67ec57a15ca5c6581a94a5a81bd4c3063452b0bcf85a2d6", + "mean": -0.0007129443110898137, + "std": 0.09818375110626221, + "rms": 0.09818633645772934, + "max_abs": 2.046875 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d53c0716736484e930f7088bb8e19dabbe2b7f0d6811be1665adda77ed6a9d39", + "mean": -0.00043402970186434686, + "std": 0.09982675313949585, + "rms": 0.09982769191265106, + "max_abs": 1.6875 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "78828c0fef2990035d371374770d4829fa5c6657616b1ea3610273d5794d576c", + "mean": -0.0005414588376879692, + "std": 0.09728485345840454, + "rms": 0.09728635847568512, + "max_abs": 2.046875 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d53c0716736484e930f7088bb8e19dabbe2b7f0d6811be1665adda77ed6a9d39", + "mean": -0.00043402970186434686, + "std": 0.09982675313949585, + "rms": 0.09982769191265106, + "max_abs": 1.6875 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "760ee49a1e785a35bc42df9726c13dd0698a7c678d75fc57f105baf842097b80", + "mean": -0.0007134712068364024, + "std": 0.0980888158082962, + "rms": 0.09809140861034393, + "max_abs": 2.046875 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 113, + "exact_hidden_rows": 113, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999999403953552, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "system_bos": { + "tokens": 113, + "exact_hidden_rows": 113, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999999403953552, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "system_x": { + "tokens": 113, + "exact_hidden_rows": 113, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999999403953552, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "system_period": { + "tokens": 113, + "exact_hidden_rows": 113, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999999403953552, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "bos_at_s0": { + "tokens": 113, + "exact_hidden_rows": 113, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999999403953552, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "bos_at_s1": { + "tokens": 113, + "exact_hidden_rows": 113, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999999403953552, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "x_at_s0": { + "tokens": 113, + "exact_hidden_rows": 113, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999999403953552, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "x_at_s1": { + "tokens": 113, + "exact_hidden_rows": 113, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999999403953552, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "period_at_s0": { + "tokens": 113, + "exact_hidden_rows": 113, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999999403953552, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "period_at_s1": { + "tokens": 113, + "exact_hidden_rows": 113, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999999403953552, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + } + } + }, + "layer_00": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2f1bbdffcf323da8053d12716261cde814cd58d98ee13af6a5ea721dd93dc660", + "mean": -0.0010536519112065434, + "std": 0.09251875430345535, + "rms": 0.09252475202083588, + "max_abs": 2.703125 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9599e27e6f7b301cac43cd391dc365e6a95f053573967ca12340ea60ff1b8360", + "mean": -0.0011447048746049404, + "std": 0.0920712873339653, + "rms": 0.09207840263843536, + "max_abs": 2.703125 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9d5d9949477929a1f6d10e59caffae529a01732760cde047e448e7f9888598cf", + "mean": -0.0010563991963863373, + "std": 0.09249912947416306, + "rms": 0.09250516444444656, + "max_abs": 2.71875 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e5c36add7aa0e95d832101398b271e0a5db6868c66a405fb953888b88929e047", + "mean": -0.0012680164072662592, + "std": 0.09271085262298584, + "rms": 0.09271952509880066, + "max_abs": 2.71875 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "46db6749ea8811fdcdadbaf1f193fea672bfc86fb3256de0b436a62b283ad2f2", + "mean": -0.0009914825204759836, + "std": 0.09217599034309387, + "rms": 0.09218131750822067, + "max_abs": 2.65625 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "78df5dd7fbd6eb27bae90885664d5596664936cdf7454eaedceb939529773bfe", + "mean": -0.0010781977325677872, + "std": 0.09155725687742233, + "rms": 0.09156360477209091, + "max_abs": 2.65625 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f8499e2ebfb93508862f166372a31c481d28a93565ca29ac8513fc1b650caaf2", + "mean": -0.0010176958749070764, + "std": 0.09207440167665482, + "rms": 0.0920800268650055, + "max_abs": 2.671875 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fbeebeace4bc737169dd6c6aa441f967392093457eec095953dc750070764d21", + "mean": -0.001227085362188518, + "std": 0.09220237284898758, + "rms": 0.09221053868532181, + "max_abs": 2.671875 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "97483c46b663832d36223b9a7b9692b8c440af18dcd6315db0fe5100c6687547", + "mean": -0.0010011948179453611, + "std": 0.09181138128042221, + "rms": 0.09181684255599976, + "max_abs": 2.65625 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "090cca53e1f1bb9b130506ae6d3ba3ccd40c62fcd1c7be614d17f75279e9f9ee", + "mean": -0.001102607580833137, + "std": 0.09135772287845612, + "rms": 0.09136437624692917, + "max_abs": 2.65625 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "46176a008b3ec671d2a3be2f44d1335f56840a68e6cb47e4c6535940d45b3019", + "mean": -0.0010377498110756278, + "std": 0.09179408848285675, + "rms": 0.09179995208978653, + "max_abs": 2.671875 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "28e78c534831c029256e4426ee9d636b7678cc0bc07ec43e027271d624f25ca9", + "mean": -0.0012593102874234319, + "std": 0.09210041165351868, + "rms": 0.09210902452468872, + "max_abs": 2.671875 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "932229495aa97307968c6a2e57d1f8abc15f7665c634b00cb77beff06dcea65f", + "mean": -0.000992701854556799, + "std": 0.09182782471179962, + "rms": 0.09183319658041, + "max_abs": 2.65625 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "517d95b752630a987dfced7df0975741877fdedc817709ef339461f185b1a3f4", + "mean": -0.001094943261705339, + "std": 0.09120003134012222, + "rms": 0.09120660275220871, + "max_abs": 2.65625 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "11d583ca0efd13a29ae785817e6b1de93993f9304dcd80d2b988701980a4201d", + "mean": -0.0010309192584827542, + "std": 0.09182051569223404, + "rms": 0.09182630479335785, + "max_abs": 2.671875 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "dffbd4dd6bf0111b15aa0b1ea0767ca314462a42eeeafe34954b7ec35eff7322", + "mean": -0.0012522534234449267, + "std": 0.0919509083032608, + "rms": 0.09195943176746368, + "max_abs": 2.671875 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9997221827507019, + "min_cosine_similarity": 0.9980820417404175, + "mean_relative_l2": 0.021312547847628593, + "max_abs_delta": 0.1484375 + }, + "system_bos": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9995481371879578, + "min_cosine_similarity": 0.9963990449905396, + "mean_relative_l2": 0.02772281877696514, + "max_abs_delta": 0.1328125 + }, + "system_x": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9995695948600769, + "min_cosine_similarity": 0.9969266057014465, + "mean_relative_l2": 0.027342643588781357, + "max_abs_delta": 0.1328125 + }, + "system_period": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.999589204788208, + "min_cosine_similarity": 0.9971126317977905, + "mean_relative_l2": 0.026808325201272964, + "max_abs_delta": 0.1328125 + }, + "bos_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9906498789787292, + "min_cosine_similarity": 0.9718236923217773, + "mean_relative_l2": 0.1344381421804428, + "max_abs_delta": 0.2421875 + }, + "bos_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9917864799499512, + "min_cosine_similarity": 0.9739056825637817, + "mean_relative_l2": 0.12585008144378662, + "max_abs_delta": 0.21875 + }, + "x_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9914627075195312, + "min_cosine_similarity": 0.972315788269043, + "mean_relative_l2": 0.12793302536010742, + "max_abs_delta": 0.2421875 + }, + "x_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9924183487892151, + "min_cosine_similarity": 0.9746434688568115, + "mean_relative_l2": 0.1204017773270607, + "max_abs_delta": 0.22265625 + }, + "period_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9915669560432434, + "min_cosine_similarity": 0.9727926850318909, + "mean_relative_l2": 0.1272892951965332, + "max_abs_delta": 0.24609375 + }, + "period_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9924859404563904, + "min_cosine_similarity": 0.9750243425369263, + "mean_relative_l2": 0.11998613178730011, + "max_abs_delta": 0.23046875 + } + } + }, + "layer_01": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "17662f543527b3bb30c5d8b8ecbe726432e1e5afa78f7f0f1034dbf2745e69b6", + "mean": -0.0014351572608575225, + "std": 0.1079927310347557, + "rms": 0.10800226777791977, + "max_abs": 3.34375 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "814327de6bae4611bd3be9868e6e7b6f31c9b6aded18dd8d5763f882091bcc12", + "mean": -0.003496825462207198, + "std": 0.6859102845191956, + "rms": 0.6859192252159119, + "max_abs": 126.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "921091a54324b6c91c2118b33a8155e47eacd0be7cd929f4fbeaa0e5526bcdf4", + "mean": -0.001431984594091773, + "std": 0.10797784477472305, + "rms": 0.10798734426498413, + "max_abs": 3.34375 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "54b29864ecb275aa5a4bac667a4b770dd752b391e0b53c514ad17ece99a6530b", + "mean": -0.0035769084934145212, + "std": 0.6744586229324341, + "rms": 0.6744681000709534, + "max_abs": 135.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fc0bb528fac1dec2504bfec054398b9ed7b5d1a30211824cd68be059ffe7ddbd", + "mean": -0.0014403036329895258, + "std": 0.10820881277322769, + "rms": 0.10821840167045593, + "max_abs": 3.28125 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "006cc86947dc8040a20fd61fe029b9ffa74dbe5278d108df404df2b459605a13", + "mean": -0.0014370157150551677, + "std": 0.10940384119749069, + "rms": 0.109413281083107, + "max_abs": 4.71875 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ab96b9e901b53fce37eb7a598e5724e36f7dfe0604ae577ce2721a4f65bedd81", + "mean": -0.001535512157715857, + "std": 0.10768002271652222, + "rms": 0.1076909676194191, + "max_abs": 3.3125 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6e6174a6fc8d9029ebcb98368783a960ec281db9933527f88b2916a344197485", + "mean": -0.001703433459624648, + "std": 0.1094687357544899, + "rms": 0.10948198288679123, + "max_abs": 4.71875 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f106a0efc2a95d2ac59c57c6d0fdb429da5ac9775fe5dd5302c6c3d92ac7b225", + "mean": -0.001444854075089097, + "std": 0.10840662568807602, + "rms": 0.10841625183820724, + "max_abs": 3.328125 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9c42ac560b959394ff634691f619c3d742d98d72dc9c7935cb8f0e055477e540", + "mean": -0.001441582920961082, + "std": 0.10958254337310791, + "rms": 0.1095920279622078, + "max_abs": 4.71875 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "901a96160c704a2220a68443936760999d4a631bcf5bcb74ec4d7750a582ab6f", + "mean": -0.0015392918139696121, + "std": 0.10752952843904495, + "rms": 0.1075405478477478, + "max_abs": 3.3125 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ddfde994d4f3618715c8b1d48615241e69088fed0d710cb7631adc31ecf4f46d", + "mean": -0.0017091283807531, + "std": 0.10939668118953705, + "rms": 0.10941003262996674, + "max_abs": 4.71875 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7433216fee3d602ea666a697f00eff8968d06d3e7848fcb350802ff03b61e6cd", + "mean": -0.0014393111923709512, + "std": 0.10834342241287231, + "rms": 0.10835298150777817, + "max_abs": 3.328125 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d91ab041961c0d94c5f1599ee7e05486d0107bacdc023c9aaa36e5a56a2b0121", + "mean": -0.0014489397872239351, + "std": 0.10928400605916977, + "rms": 0.10929360240697861, + "max_abs": 4.71875 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a6d0020b5ab07752ff4dc8b4dffa8d435bf0273260c8c3e0ca7166f1cb97585b", + "mean": -0.001538389129564166, + "std": 0.10751010477542877, + "rms": 0.10752111673355103, + "max_abs": 3.328125 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "238d75239612836a12dd682c51cfe107207626fc9ab53afd6b1c835cc7c18276", + "mean": -0.001717252191156149, + "std": 0.10916383564472198, + "rms": 0.10917734354734421, + "max_abs": 4.71875 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.999332070350647, + "min_cosine_similarity": 0.9877874851226807, + "mean_relative_l2": 0.03250262513756752, + "max_abs_delta": 0.095703125 + }, + "system_bos": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9969303607940674, + "min_cosine_similarity": 0.9613133072853088, + "mean_relative_l2": 0.07191566377878189, + "max_abs_delta": 0.2421875 + }, + "system_x": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9955715537071228, + "min_cosine_similarity": 0.9573301672935486, + "mean_relative_l2": 0.08516521006822586, + "max_abs_delta": 0.2578125 + }, + "system_period": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9956812262535095, + "min_cosine_similarity": 0.959312915802002, + "mean_relative_l2": 0.08394642919301987, + "max_abs_delta": 0.2421875 + }, + "bos_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9908356070518494, + "min_cosine_similarity": 0.9685279130935669, + "mean_relative_l2": 0.13316646218299866, + "max_abs_delta": 0.21630859375 + }, + "bos_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.990551769733429, + "min_cosine_similarity": 0.9661278128623962, + "mean_relative_l2": 0.13329610228538513, + "max_abs_delta": 0.21484375 + }, + "x_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9920395016670227, + "min_cosine_similarity": 0.969312846660614, + "mean_relative_l2": 0.12379526346921921, + "max_abs_delta": 0.27734375 + }, + "x_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9899810552597046, + "min_cosine_similarity": 0.9559794664382935, + "mean_relative_l2": 0.13584262132644653, + "max_abs_delta": 0.287109375 + }, + "period_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9921920895576477, + "min_cosine_similarity": 0.9716655015945435, + "mean_relative_l2": 0.12266384065151215, + "max_abs_delta": 0.26953125 + }, + "period_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9899620413780212, + "min_cosine_similarity": 0.9546369314193726, + "mean_relative_l2": 0.13586027920246124, + "max_abs_delta": 0.28515625 + } + } + }, + "layer_02": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1ac82c30960f5164b8ed860f2f164470ea74c58ff275b0722c16ae2353c1cdee", + "mean": -0.0011392420856282115, + "std": 0.12930455803871155, + "rms": 0.12930957973003387, + "max_abs": 3.5 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "774c8e6852615fad4bab5adee65f2fcdf5562ac93562b10064d5c02cd13a9754", + "mean": -0.008064049296081066, + "std": 2.047982931137085, + "rms": 2.0479986667633057, + "max_abs": 392.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0a304e5aa12bc379f1092356753ecd26e86442900b501bc667cd9ca78c7ca60a", + "mean": -0.0010662305867299438, + "std": 0.12929953634738922, + "rms": 0.1293039321899414, + "max_abs": 3.53125 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ed14157d108a16c6e5dca201d416b5aae2248770d216a8ab68227f4c8c2cf1db", + "mean": -0.008485733531415462, + "std": 2.1478500366210938, + "rms": 2.14786696434021, + "max_abs": 436.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0e4f730a5aefbafb2b60a48ea93c06dc67a1beee80dd6792af834577e9f3c086", + "mean": -0.001176035962998867, + "std": 0.13076217472553253, + "rms": 0.13076744973659515, + "max_abs": 3.5 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "af9c3e215c9691ec90039b9eaec2bccaee8fab99067732a49b3f1d50aa16e2ec", + "mean": -0.0014768254477530718, + "std": 0.1905517280101776, + "rms": 0.19055746495723724, + "max_abs": 23.875 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5957b0c2aa7fc62c2182c7b7fa84c08b302cebe8816e7b292a18961d8d47b811", + "mean": -0.0010270543862134218, + "std": 0.1306433081626892, + "rms": 0.13064734637737274, + "max_abs": 3.578125 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "968b0b13a7c19aa58d1c5470d751fb3b16fd549b4ef5ec0cf288e003ebdd7952", + "mean": -0.0014481215039268136, + "std": 0.18547135591506958, + "rms": 0.18547698855400085, + "max_abs": 23.875 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ddbccdff9d180749178d518e75d071dd8b059bd8dcded48e2e1fdc2e60bba025", + "mean": -0.0012168713146820664, + "std": 0.13061565160751343, + "rms": 0.1306213140487671, + "max_abs": 3.53125 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e0c708677e87cd7ab2625cbe50e7b04e9d2da76e2f575856b1abed9a1dc2fb04", + "mean": -0.0015086422208696604, + "std": 0.1904982179403305, + "rms": 0.19050419330596924, + "max_abs": 23.875 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3083a66a978f2953a9f65c8e759279d0391b5df63dc7484b57532abba443d000", + "mean": -0.0010128418216481805, + "std": 0.13025224208831787, + "rms": 0.13025617599487305, + "max_abs": 3.578125 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "22fb44a1071820e1933f28f12deac34584e8f3c5a2590725899453d769c92f69", + "mean": -0.0014351537683978677, + "std": 0.18530724942684174, + "rms": 0.18531279265880585, + "max_abs": 23.875 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "088d90326c2491b28e94ac0c880d5a29573a0e96b5a6258061b993ff24fb5ce5", + "mean": -0.00119820109102875, + "std": 0.13041427731513977, + "rms": 0.1304197907447815, + "max_abs": 3.53125 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "519da5cac0dbff6cfac22317aa48e055134eae891d5b0d22f12a9375e301525c", + "mean": -0.0015355455689132214, + "std": 0.19013944268226624, + "rms": 0.19014564156532288, + "max_abs": 23.875 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "84ce32fc40f936ec7c62688fbc712a5d276e318655ac0ea32df84af008a9635f", + "mean": -0.0010107774287462234, + "std": 0.13007238507270813, + "rms": 0.1300763189792633, + "max_abs": 3.578125 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c2a4d69e88347e8bcbbc9ef34c59ac7c204b2ea00fd21b2be507c77103c518e5", + "mean": -0.0014644251205027103, + "std": 0.18495875597000122, + "rms": 0.18496455252170563, + "max_abs": 23.875 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9990944266319275, + "min_cosine_similarity": 0.9909971952438354, + "mean_relative_l2": 0.03915632888674736, + "max_abs_delta": 0.078125 + }, + "system_bos": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9961217045783997, + "min_cosine_similarity": 0.9523675441741943, + "mean_relative_l2": 0.08167710900306702, + "max_abs_delta": 0.23828125 + }, + "system_x": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9942656755447388, + "min_cosine_similarity": 0.944365918636322, + "mean_relative_l2": 0.0986102893948555, + "max_abs_delta": 0.24072265625 + }, + "system_period": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9944137930870056, + "min_cosine_similarity": 0.9442073702812195, + "mean_relative_l2": 0.09727276861667633, + "max_abs_delta": 0.23291015625 + }, + "bos_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9914987683296204, + "min_cosine_similarity": 0.9611548185348511, + "mean_relative_l2": 0.1284102499485016, + "max_abs_delta": 0.2890625 + }, + "bos_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9899072051048279, + "min_cosine_similarity": 0.9663558006286621, + "mean_relative_l2": 0.13895556330680847, + "max_abs_delta": 0.384765625 + }, + "x_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9919906854629517, + "min_cosine_similarity": 0.9596129059791565, + "mean_relative_l2": 0.12389137595891953, + "max_abs_delta": 0.37890625 + }, + "x_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9883956909179688, + "min_cosine_similarity": 0.9546267986297607, + "mean_relative_l2": 0.14745238423347473, + "max_abs_delta": 0.4765625 + }, + "period_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9920236468315125, + "min_cosine_similarity": 0.9620989561080933, + "mean_relative_l2": 0.12375875562429428, + "max_abs_delta": 0.3828125 + }, + "period_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9882157444953918, + "min_cosine_similarity": 0.9553108811378479, + "mean_relative_l2": 0.14835992455482483, + "max_abs_delta": 0.486328125 + } + } + }, + "layer_03": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1bc538abbc171b9b18ea03cc6d97274fd4e47bd3ec4239a7beda2a14e09e6f9b", + "mean": -0.002146470593288541, + "std": 0.1557542383670807, + "rms": 0.15576902031898499, + "max_abs": 4.1875 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f2b5ad5ae951b83ff411f0409518c9448ace49ece46f7df32233ac2ff6512a3e", + "mean": -0.01128356996923685, + "std": 6.138321399688721, + "rms": 6.138331890106201, + "max_abs": 1136.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "97a6036b774ab67965df1aae26dadd9f6d93d301a152672c06ccd2366b7dd782", + "mean": -0.0020910128951072693, + "std": 0.15602900087833405, + "rms": 0.15604300796985626, + "max_abs": 4.25 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0e063fe0f3ce736e892859338f769b45d9d6e0928cd0d9ea834c8e92c01d3cf2", + "mean": -0.011624856851994991, + "std": 5.996391773223877, + "rms": 5.996402740478516, + "max_abs": 1136.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bbdc4f08b24184af52df35f78d5a8793e0a430821346e666d59ae0796764c542", + "mean": -0.002216243650764227, + "std": 0.15773901343345642, + "rms": 0.157754585146904, + "max_abs": 4.1875 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b955038ace16f89defbc7b4d72740ec89551146bc8da3585926d5fe443ec5b12", + "mean": -0.003955663647502661, + "std": 5.469537258148193, + "rms": 5.469539642333984, + "max_abs": 1136.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4096b3e0b0acabbb933fc9242bbf2d3a4934d798484b8c750fff3b6fcaa620c9", + "mean": -0.0021844145376235247, + "std": 0.15809990465641022, + "rms": 0.1581149846315384, + "max_abs": 4.34375 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "54de9bb9cbc1b879b1e18a72d9ff4908a24a59fa26bf51cc14de20dd9e8d7914", + "mean": -0.003920757211744785, + "std": 5.177855968475342, + "rms": 5.177857875823975, + "max_abs": 1136.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cdc5ee0fe7e8ca9a461825d00096837c1ad22d387ae28a1a76e2a3bc9c9f8a69", + "mean": -0.0022846157662570477, + "std": 0.15701398253440857, + "rms": 0.1570305973291397, + "max_abs": 4.1875 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ea3dc151b34f72d12865f49a05b9dcd61c3cd3af8d48e3a505d7c41496d2437f", + "mean": -0.0040422058664262295, + "std": 5.469508647918701, + "rms": 5.469510555267334, + "max_abs": 1136.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9275d79a77e28105d0b15e175891c07212d02b36e0139f8c2e893bdccf5d4aed", + "mean": -0.002238604938611388, + "std": 0.15756608545780182, + "rms": 0.15758199989795685, + "max_abs": 4.34375 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "458f1e9a8da3f5abd4cf6338558ba895e8505d7391c7c77e93c0bea79aa136fe", + "mean": -0.003985793329775333, + "std": 5.177837371826172, + "rms": 5.1778388023376465, + "max_abs": 1136.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "79dd6724ec3062f2eebdb518ddc006f9c7c4a5ce4a1e820c8ef5f68772098ded", + "mean": -0.0022784704342484474, + "std": 0.15694479644298553, + "rms": 0.1569613367319107, + "max_abs": 4.1875 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8fc1413f59c11ddcc7befc06adf7e4c5c5f28ca8625d003f632b9dc7c0b04bad", + "mean": -0.004039406310766935, + "std": 5.469499111175537, + "rms": 5.46950101852417, + "max_abs": 1136.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "30771e4914109067068ca77964b60fb82c3ac677c026bfb00b5ac5db04460d39", + "mean": -0.0022118063643574715, + "std": 0.15754744410514832, + "rms": 0.1575629562139511, + "max_abs": 4.3125 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9954568e21398497fed83c12e39406d2ce23292f0cdecd45cc8ccbfa5a4bb332", + "mean": -0.00396459037438035, + "std": 5.177829265594482, + "rms": 5.177831172943115, + "max_abs": 1136.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9990189671516418, + "min_cosine_similarity": 0.9899377822875977, + "mean_relative_l2": 0.04074745252728462, + "max_abs_delta": 0.09375 + }, + "system_bos": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9960381388664246, + "min_cosine_similarity": 0.9599736928939819, + "mean_relative_l2": 0.08257518708705902, + "max_abs_delta": 0.2275390625 + }, + "system_x": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9938066005706787, + "min_cosine_similarity": 0.951924204826355, + "mean_relative_l2": 0.10164394974708557, + "max_abs_delta": 0.2763671875 + }, + "system_period": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9938927888870239, + "min_cosine_similarity": 0.9515929222106934, + "mean_relative_l2": 0.10117707401514053, + "max_abs_delta": 0.27294921875 + }, + "bos_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9923728108406067, + "min_cosine_similarity": 0.9625496864318848, + "mean_relative_l2": 0.12159082293510437, + "max_abs_delta": 0.25390625 + }, + "bos_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9905562400817871, + "min_cosine_similarity": 0.9669970273971558, + "mean_relative_l2": 0.13422562181949615, + "max_abs_delta": 0.375 + }, + "x_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9927719235420227, + "min_cosine_similarity": 0.9654824733734131, + "mean_relative_l2": 0.1171141266822815, + "max_abs_delta": 0.37109375 + }, + "x_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.988713264465332, + "min_cosine_similarity": 0.9572775363922119, + "mean_relative_l2": 0.14481878280639648, + "max_abs_delta": 0.48828125 + }, + "period_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9927834272384644, + "min_cosine_similarity": 0.9669764637947083, + "mean_relative_l2": 0.11733114719390869, + "max_abs_delta": 0.3828125 + }, + "period_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9883951544761658, + "min_cosine_similarity": 0.95557701587677, + "mean_relative_l2": 0.14672580361366272, + "max_abs_delta": 0.494140625 + } + } + }, + "layer_04": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fdc80fc6ce20bd43c37d046dda8671444fb8595968b876334f5d9b2e0ae00124", + "mean": -0.0019429582171142101, + "std": 0.18456611037254333, + "rms": 0.1845763474702835, + "max_abs": 5.0 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f77352180532482a44872f4bfb9841dcddc8d54f1fe36f56fd3e5a2f325c8579", + "mean": -0.010954242199659348, + "std": 6.405308246612549, + "rms": 6.405317306518555, + "max_abs": 1152.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e58e2eb33e672beccbc02cd09b79078cbe809d9e7a81bda5667f7efe38140a5a", + "mean": -0.0018568086670711637, + "std": 0.18476955592632294, + "rms": 0.18477889895439148, + "max_abs": 5.0 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "aca31e889502d3bc8e72b8ee30ddc6f6208f3312839a7ef6aee4cb396724a659", + "mean": -0.011348272673785686, + "std": 6.240849018096924, + "rms": 6.240859508514404, + "max_abs": 1152.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ae3a782ff3d16f86da5b0c767ea0f5f1588d3808e22a77dcde2afb56240b4411", + "mean": -0.0020650746300816536, + "std": 0.18701042234897614, + "rms": 0.18702183663845062, + "max_abs": 5.09375 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d59cc49afa5473f762c24663e9205e78993a43e21d935ffeafbe6b8257eaf2f6", + "mean": -0.0036842869594693184, + "std": 5.73739767074585, + "rms": 5.737399101257324, + "max_abs": 1152.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8a08b449d49f8a284bc233047fb3527d5ea9f72d44cf881ef14e32abacc23737", + "mean": -0.001971755176782608, + "std": 0.18734772503376007, + "rms": 0.18735811114311218, + "max_abs": 5.125 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1f878b588f8f1484342f80cb925b604502fec3673f961e33287b584c5fc22e5d", + "mean": -0.0036513933446258307, + "std": 5.425801753997803, + "rms": 5.425802707672119, + "max_abs": 1152.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7cfab6fa697893605068c9904a7278e03c4aac94520eee45ffdba7e939d56ac5", + "mean": -0.002056541619822383, + "std": 0.18552634119987488, + "rms": 0.18553772568702698, + "max_abs": 5.09375 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ad719890dfd6b5f6ae1defc797ad03475be258bae415c813c13aca96b98ae89f", + "mean": -0.003647914854809642, + "std": 5.737334251403809, + "rms": 5.737335205078125, + "max_abs": 1152.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "14c772d7c3a342a5a7d1397fd4f15c71c644a11cdf457a9b8c8976a282cc3606", + "mean": -0.0019418577430769801, + "std": 0.18632382154464722, + "rms": 0.18633392453193665, + "max_abs": 5.15625 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "89917efe6a9cceade393b929579e8195c8abd944d6d9dbcef903dac96eacb93e", + "mean": -0.0036098554264754057, + "std": 5.425754070281982, + "rms": 5.425755023956299, + "max_abs": 1152.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7c83334ec3c72766ac5315de7966db8375a6c0f4c46cebd6948b1a3312445313", + "mean": -0.0019809191580861807, + "std": 0.18558306992053986, + "rms": 0.1855936497449875, + "max_abs": 5.125 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a4940a12eea0adf6d26837e2d56fbe4ba8d8c235209d5a3b641339c96802bb89", + "mean": -0.0035976353101432323, + "std": 5.73732852935791, + "rms": 5.737329006195068, + "max_abs": 1152.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "313317789deb86aabd4b2b95799668c58ce5a2da6da50e4cf38defc3ad8d5f76", + "mean": -0.0019313957309350371, + "std": 0.1863587647676468, + "rms": 0.18636876344680786, + "max_abs": 5.15625 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9d294ce0f946130b0585d078f53e37e4b81d6599cdf98c33a33f82a398078f04", + "mean": -0.003604280762374401, + "std": 5.425747394561768, + "rms": 5.425748348236084, + "max_abs": 1152.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9988705515861511, + "min_cosine_similarity": 0.991459846496582, + "mean_relative_l2": 0.04283842816948891, + "max_abs_delta": 0.09375 + }, + "system_bos": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9962909817695618, + "min_cosine_similarity": 0.9734877943992615, + "mean_relative_l2": 0.08173518627882004, + "max_abs_delta": 0.306640625 + }, + "system_x": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9938160181045532, + "min_cosine_similarity": 0.9654372334480286, + "mean_relative_l2": 0.1044437438249588, + "max_abs_delta": 0.380859375 + }, + "system_period": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9937536716461182, + "min_cosine_similarity": 0.9649587273597717, + "mean_relative_l2": 0.10505062341690063, + "max_abs_delta": 0.37109375 + }, + "bos_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.993809163570404, + "min_cosine_similarity": 0.9742564558982849, + "mean_relative_l2": 0.10977648943662643, + "max_abs_delta": 0.40625 + }, + "bos_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9918197989463806, + "min_cosine_similarity": 0.9751914739608765, + "mean_relative_l2": 0.12556292116641998, + "max_abs_delta": 0.3515625 + }, + "x_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9937109351158142, + "min_cosine_similarity": 0.9765484929084778, + "mean_relative_l2": 0.10878957062959671, + "max_abs_delta": 0.3828125 + }, + "x_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9893700480461121, + "min_cosine_similarity": 0.9668853282928467, + "mean_relative_l2": 0.14126060903072357, + "max_abs_delta": 0.53515625 + }, + "period_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9935994744300842, + "min_cosine_similarity": 0.9773837924003601, + "mean_relative_l2": 0.10994137823581696, + "max_abs_delta": 0.390625 + }, + "period_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.988925576210022, + "min_cosine_similarity": 0.9648511409759521, + "mean_relative_l2": 0.14423632621765137, + "max_abs_delta": 0.5546875 + } + } + }, + "layer_05": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d8f4a0fa5cb188de4d122d4efa5db155dc5fffce692bdba9e86157c00374b7dd", + "mean": -0.0010589959565550089, + "std": 0.20785583555698395, + "rms": 0.20785853266716003, + "max_abs": 5.4375 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "45bb7c5453d0a1ba4b9c4f10f94f97b9e5317a225d1f913cb1c570cbebbe02ef", + "mean": -0.011359811760485172, + "std": 6.600690841674805, + "rms": 6.600700855255127, + "max_abs": 1152.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8888c22b573d008bb992f64d15052a3351ff4a83060b6b05068fa8ed907a8e10", + "mean": -0.0010844425996765494, + "std": 0.2081674337387085, + "rms": 0.20817026495933533, + "max_abs": 5.53125 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e1502e75341c3fd3cc83ebbb093faa927130c789e215b7de34fb18ef8fdd1a0c", + "mean": -0.011714259162545204, + "std": 6.433863162994385, + "rms": 6.433874130249023, + "max_abs": 1152.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5313a7b72846969df471cc91586e2a70a2fbfe79cc37079dfa4253c205333208", + "mean": -0.001218360266648233, + "std": 0.21087661385536194, + "rms": 0.21088014543056488, + "max_abs": 5.5 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f3e83e41e1bae301ad7053eacd6ef0581da930af6ea0dbc8230f973ff6707331", + "mean": -0.003398354398086667, + "std": 5.838001251220703, + "rms": 5.8380022048950195, + "max_abs": 1152.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5f66106a0b0d4035a09176e1833a2685246af71b6dcc8426050fee03d1939649", + "mean": -0.0012629317352548242, + "std": 0.21139420568943024, + "rms": 0.21139799058437347, + "max_abs": 5.8125 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ac921c4ee4c40658776df9f0eaedcfeddc723fad511d8eb6758c42e17057a5ee", + "mean": -0.003395708743482828, + "std": 5.5205583572387695, + "rms": 5.520558834075928, + "max_abs": 1152.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "aa19f1949821805d68db992701635c481243b21cc00fa0bbd8fec7a9ffe43a0b", + "mean": -0.0013567798305302858, + "std": 0.2089119404554367, + "rms": 0.2089163362979889, + "max_abs": 5.53125 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5d4d88842594902bd39189a712dd6b1560d956b695863d35c3c1ed174941546e", + "mean": -0.0034581965301185846, + "std": 5.837919235229492, + "rms": 5.83791971206665, + "max_abs": 1152.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1a53f190a5613560be0f80f2e0c90a58e35eac915ecafe117a219262cdde0b2c", + "mean": -0.0014642545720562339, + "std": 0.2099093347787857, + "rms": 0.209914430975914, + "max_abs": 5.875 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "da618ecec084333ae1bb55293855c2d86dc967e2af34dbe8e202837624e0e23e", + "mean": -0.0035084972623735666, + "std": 5.52049446105957, + "rms": 5.520496368408203, + "max_abs": 1152.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "67fd70634f498ccd0c4bccf28539d955de04a0d311cdf0c7784c98a5e5ec1e73", + "mean": -0.001320706564001739, + "std": 0.20955637097358704, + "rms": 0.20956052839756012, + "max_abs": 5.5625 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4718345a5dd34cb178085615c4b87d0508b4d052cd9f94fbe3e3873271d78695", + "mean": -0.0034368413034826517, + "std": 5.837925434112549, + "rms": 5.837926387786865, + "max_abs": 1152.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "be9daaf541d4b6aacc94f6aebff0def3fefd6953b772d19d120a019dfebeb48c", + "mean": -0.0015042772283777595, + "std": 0.21036064624786377, + "rms": 0.21036602556705475, + "max_abs": 5.84375 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3f93218342e37dec8aec63fb2bc634835c68f5e13aa9da65ac2b7850d49ff07f", + "mean": -0.0035582920536398888, + "std": 5.520496845245361, + "rms": 5.520497798919678, + "max_abs": 1152.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9985262155532837, + "min_cosine_similarity": 0.9921691417694092, + "mean_relative_l2": 0.050230033695697784, + "max_abs_delta": 0.15625 + }, + "system_bos": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9956742525100708, + "min_cosine_similarity": 0.977787971496582, + "mean_relative_l2": 0.08865790069103241, + "max_abs_delta": 0.32763671875 + }, + "system_x": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9924167990684509, + "min_cosine_similarity": 0.9642490148544312, + "mean_relative_l2": 0.11603672802448273, + "max_abs_delta": 0.433837890625 + }, + "system_period": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9922227263450623, + "min_cosine_similarity": 0.9611437320709229, + "mean_relative_l2": 0.11764302849769592, + "max_abs_delta": 0.421875 + }, + "bos_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9929938912391663, + "min_cosine_similarity": 0.9765225648880005, + "mean_relative_l2": 0.11710509657859802, + "max_abs_delta": 0.484375 + }, + "bos_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9910252094268799, + "min_cosine_similarity": 0.9707159996032715, + "mean_relative_l2": 0.13181264698505402, + "max_abs_delta": 0.5625 + }, + "x_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9929341077804565, + "min_cosine_similarity": 0.975569486618042, + "mean_relative_l2": 0.1154162660241127, + "max_abs_delta": 0.453125 + }, + "x_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9880233407020569, + "min_cosine_similarity": 0.9616934657096863, + "mean_relative_l2": 0.14944978058338165, + "max_abs_delta": 0.5703125 + }, + "period_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.992841899394989, + "min_cosine_similarity": 0.9783788919448853, + "mean_relative_l2": 0.11716505885124207, + "max_abs_delta": 0.390625 + }, + "period_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9875551462173462, + "min_cosine_similarity": 0.9587463736534119, + "mean_relative_l2": 0.15314026176929474, + "max_abs_delta": 0.578125 + } + } + }, + "layer_06": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9131db709462ae8b0ed3b067c64f132932a42db610d5931c4b764da602ddc24b", + "mean": -0.0022660589311271906, + "std": 0.23981525003910065, + "rms": 0.23982594907283783, + "max_abs": 6.78125 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d4d38da394cdaf171afa70a9f8adf11230b1a4ef5ee28f5f61a1083ac13440e3", + "mean": -0.01280540507286787, + "std": 6.721546173095703, + "rms": 6.721558094024658, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8e75d7c7fed95124f4ecd05a7304db36028fe60d466c3dc4199597233a7eea6b", + "mean": -0.002330823801457882, + "std": 0.23985303938388824, + "rms": 0.23986436426639557, + "max_abs": 6.78125 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3157a36c7b2ee33629e31c3bb067e2245ccd1aa4d03a1600fb2c5dd145622efe", + "mean": -0.013145051896572113, + "std": 6.550924301147461, + "rms": 6.550938129425049, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c3b861c9ebd860d80109e616af2e4065ce4c94e5fd278d2bf8dd67f585e67db2", + "mean": -0.0023989614564925432, + "std": 0.24243973195552826, + "rms": 0.24245159327983856, + "max_abs": 6.8125 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0becae16295d66afcfe9076f5f1003ab36ea5af857ab0cc9f9179fb4ec496405", + "mean": -0.004597831983119249, + "std": 5.932371616363525, + "rms": 5.932373046875, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4f774c4b0bac860d052a042ce86a47164a55b0144c922c3e6ab69cbf427fd64a", + "mean": -0.0024276841431856155, + "std": 0.24316303431987762, + "rms": 0.24317514896392822, + "max_abs": 6.8125 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d4d2bd252bd3f741367b8e7147bdf9e2127b3b3e865ac1c1732bc23aad327a4a", + "mean": -0.004555906169116497, + "std": 5.6099958419799805, + "rms": 5.609997749328613, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "41ee7a49904a110e19276283cd81c67e193d6cdd19ce7c1049a2a31e14ddb045", + "mean": -0.0023832640144973993, + "std": 0.2409551739692688, + "rms": 0.24096696078777313, + "max_abs": 6.78125 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f6be5e9f03480925c0a617f4055c898b7d5fc180309895980651d710aad5da95", + "mean": -0.004500598646700382, + "std": 5.932292938232422, + "rms": 5.9322943687438965, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4af3982f65dc07da169d71a867b65f830adaa9246f3b70abc8f1a3700b60574c", + "mean": -0.002502556424587965, + "std": 0.24149030447006226, + "rms": 0.2415032535791397, + "max_abs": 6.90625 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d46f61b9f2029655c9c9ed8c772743cf17f1ba7dd164d44bac9711f4fba52fee", + "mean": -0.004549815319478512, + "std": 5.609914302825928, + "rms": 5.609916687011719, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e60f016ccc2cf547be9128eec190b19411f55939c62b8143d954a8bf716a5173", + "mean": -0.0024247150868177414, + "std": 0.2407974898815155, + "rms": 0.24080969393253326, + "max_abs": 6.75 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d61bf4b261a691322eca3dbfc912e87fbfb0cc7b5d3d9b92115b0b54d113e483", + "mean": -0.004521306604146957, + "std": 5.932281017303467, + "rms": 5.9322829246521, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "53e6aed47a6a0114efb6731515fdedb40a2b6e4372e7476cc8fd0e694c482efe", + "mean": -0.002587525872513652, + "std": 0.2411433309316635, + "rms": 0.24115721881389618, + "max_abs": 6.9375 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ead3e78de9fe7a8de571178116931d91b3059ffaaac570a253376960ec20d40c", + "mean": -0.004624545574188232, + "std": 5.609897136688232, + "rms": 5.609899520874023, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9982527494430542, + "min_cosine_similarity": 0.9911060333251953, + "mean_relative_l2": 0.05462394654750824, + "max_abs_delta": 0.1875 + }, + "system_bos": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9954628944396973, + "min_cosine_similarity": 0.9771460294723511, + "mean_relative_l2": 0.0912398099899292, + "max_abs_delta": 0.53125 + }, + "system_x": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9913433194160461, + "min_cosine_similarity": 0.9602885246276855, + "mean_relative_l2": 0.12508413195610046, + "max_abs_delta": 0.6875 + }, + "system_period": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9911192059516907, + "min_cosine_similarity": 0.9540954232215881, + "mean_relative_l2": 0.12696748971939087, + "max_abs_delta": 0.75 + }, + "bos_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9934759736061096, + "min_cosine_similarity": 0.9766287803649902, + "mean_relative_l2": 0.11210053414106369, + "max_abs_delta": 0.46875 + }, + "bos_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9913944602012634, + "min_cosine_similarity": 0.9699451923370361, + "mean_relative_l2": 0.128859743475914, + "max_abs_delta": 0.53125 + }, + "x_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9930292367935181, + "min_cosine_similarity": 0.9730231761932373, + "mean_relative_l2": 0.11472073942422867, + "max_abs_delta": 0.5 + }, + "x_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9876500964164734, + "min_cosine_similarity": 0.9572745561599731, + "mean_relative_l2": 0.15276019275188446, + "max_abs_delta": 0.6328125 + }, + "period_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9929952621459961, + "min_cosine_similarity": 0.9805446863174438, + "mean_relative_l2": 0.11564838141202927, + "max_abs_delta": 0.44140625 + }, + "period_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9868640303611755, + "min_cosine_similarity": 0.9580013751983643, + "mean_relative_l2": 0.15783262252807617, + "max_abs_delta": 0.6875 + } + } + }, + "layer_07": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "63c3082fcf9c3aa49b75df9cc17f9c65598dbce39259a4a0465806f3b859758a", + "mean": -0.0031761289574205875, + "std": 0.26246175169944763, + "rms": 0.2624809443950653, + "max_abs": 7.0625 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ca4708fe1332963ee9deaacbea7628ae60fb98baa5e8291a22a77c3ef69d91ea", + "mean": -0.013564765453338623, + "std": 6.741655349731445, + "rms": 6.741668224334717, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0dc1e493bbdf6e3833dbc00b531855ac722c643cf20dce326c81fa947424bb6b", + "mean": -0.0031756374519318342, + "std": 0.26280346512794495, + "rms": 0.26282262802124023, + "max_abs": 7.0625 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "53a7a95b36f952d21515bcfb560721f5e38f57505b4c6b5baf29880f327f99a1", + "mean": -0.014111128635704517, + "std": 6.570806980133057, + "rms": 6.570821762084961, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e06887e7ff9302e20b432d83e6adbd4ab5cf5341c416369c751aded6a3284b17", + "mean": -0.003171108663082123, + "std": 0.26432257890701294, + "rms": 0.2643415629863739, + "max_abs": 7.09375 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0274970d08ca62a4648324da97ec269da65a64092bf421680ee0f53a87137321", + "mean": -0.005217272788286209, + "std": 5.943832874298096, + "rms": 5.9438347816467285, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a70877edde40af1adf259ee05f9efbc2c586d0e3ac27be4dbb65c5d060663b84", + "mean": -0.003255383810028434, + "std": 0.26539868116378784, + "rms": 0.2654186189174652, + "max_abs": 7.1875 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "da29fe19a41a7a22c0fb6a5ef194a040b2b2fc17edb5b1cf716521f885e6b531", + "mean": -0.005482131615281105, + "std": 5.620984077453613, + "rms": 5.620986461639404, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "50fc855e09bf0752feafed52748141617c9f3cec7093e803bb4a52ce95ca1214", + "mean": -0.0031929141841828823, + "std": 0.26268765330314636, + "rms": 0.26270705461502075, + "max_abs": 7.125 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a6edb8d2caaa12bba6b22af1573ec3e0bde8606d2225cc38e3c664820582fa3d", + "mean": -0.005254304967820644, + "std": 5.9437384605407715, + "rms": 5.9437408447265625, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9510b3717728a6f20f8e8c5e055fc5cd9d16c9fe9e23cfb06ea173f27bf3a5f3", + "mean": -0.0033660405315458775, + "std": 0.2643415033817291, + "rms": 0.2643629312515259, + "max_abs": 7.1875 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "aaa1c6d428d5e8ff90429a9f3635d14b36a2a737c0748b2dff9e0a26d9355c92", + "mean": -0.005573672708123922, + "std": 5.620914936065674, + "rms": 5.620917320251465, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "87f0cdd6748104bb1212d0f2f5e634e2f2c8c882a26e7d2276df6c65d8c821f2", + "mean": -0.0032365473452955484, + "std": 0.26256033778190613, + "rms": 0.2625803053379059, + "max_abs": 7.125 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "794961c5f7d2dbe965ef900ff800d817d18ea5ecd1d8ee6468e6dbdea00e6a9e", + "mean": -0.005207936279475689, + "std": 5.943735122680664, + "rms": 5.943737506866455, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5bf5d1caa1a4661bacd220a6e7fff8e43d8f11b65b4090332ee8bcd734290058", + "mean": -0.003427712479606271, + "std": 0.2643836736679077, + "rms": 0.26440590620040894, + "max_abs": 7.25 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9e360c4453ece1c65d20feb3d2750ae8279a71bac01b0511724d8c47994a1899", + "mean": -0.00556659372523427, + "std": 5.620918273925781, + "rms": 5.6209211349487305, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9979904890060425, + "min_cosine_similarity": 0.988330066204071, + "mean_relative_l2": 0.058342523872852325, + "max_abs_delta": 0.265625 + }, + "system_bos": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9949450492858887, + "min_cosine_similarity": 0.9669644832611084, + "mean_relative_l2": 0.09542916715145111, + "max_abs_delta": 0.359375 + }, + "system_x": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9900511503219604, + "min_cosine_similarity": 0.9349111318588257, + "mean_relative_l2": 0.1325308233499527, + "max_abs_delta": 0.5625 + }, + "system_period": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.990019679069519, + "min_cosine_similarity": 0.9388324022293091, + "mean_relative_l2": 0.1335073709487915, + "max_abs_delta": 0.515625 + }, + "bos_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9929670691490173, + "min_cosine_similarity": 0.9675246477127075, + "mean_relative_l2": 0.11486538499593735, + "max_abs_delta": 0.5 + }, + "bos_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9907457232475281, + "min_cosine_similarity": 0.9523415565490723, + "mean_relative_l2": 0.13184085488319397, + "max_abs_delta": 0.515625 + }, + "x_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9923909902572632, + "min_cosine_similarity": 0.9745655059814453, + "mean_relative_l2": 0.11893667280673981, + "max_abs_delta": 0.59375 + }, + "x_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9864311814308167, + "min_cosine_similarity": 0.9301891326904297, + "mean_relative_l2": 0.15871040523052216, + "max_abs_delta": 0.6953125 + }, + "period_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9923813939094543, + "min_cosine_similarity": 0.9814035892486572, + "mean_relative_l2": 0.11963316053152084, + "max_abs_delta": 0.5234375 + }, + "period_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9858137369155884, + "min_cosine_similarity": 0.9416147470474243, + "mean_relative_l2": 0.16337455809116364, + "max_abs_delta": 0.71875 + } + } + }, + "layer_08": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "62fc2d444b617d779767b7ea7129c1878ce762dc4843091c7bd6231b9ea70782", + "mean": -0.005683980882167816, + "std": 0.2998650372028351, + "rms": 0.29991888999938965, + "max_abs": 8.125 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "21db61c50252b5c6a269ef82061e0d299b16a6c301348a811521a2107540fb50", + "mean": -0.015827935189008713, + "std": 6.765299320220947, + "rms": 6.765318393707275, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0db6022934b386bd637a5b11699dffd5a2475e8371d3bc329179e8bf0ef847ed", + "mean": -0.005652768537402153, + "std": 0.3001452088356018, + "rms": 0.30019843578338623, + "max_abs": 8.25 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "60304bd1985e4f9330e4e4132a3ed9832a9b115e0b00f0b7e669bbe8cca9a576", + "mean": -0.01596379280090332, + "std": 6.594196319580078, + "rms": 6.594215393066406, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9d23360e54f0a387fa8e0a6f878b7cebdcb3b055499a12f3e1311ee5a0b8379c", + "mean": -0.0055963327176868916, + "std": 0.3014891445636749, + "rms": 0.3015410900115967, + "max_abs": 8.3125 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d231e801efbefb1c6cf5672996b3cbab9a85964dd03fe069e21b92ae01d46631", + "mean": -0.0074537587352097034, + "std": 5.957518100738525, + "rms": 5.957522869110107, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "16bcfd2ba69446729dd01e8a470f0b93d1c10c9d527bcd3c6fff76fd9e31999d", + "mean": -0.0056669083423912525, + "std": 0.30371928215026855, + "rms": 0.3037721514701843, + "max_abs": 8.625 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9855ec24d279c401121b2b714352543c2a25c4da073b4ccab2e169b90f1dcf7b", + "mean": -0.007356957066804171, + "std": 5.6340837478637695, + "rms": 5.634088516235352, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5716f66f59da623c320ba658ed71cf20738e5a1c15052f7c94aff8a6338cd57a", + "mean": -0.005774355493485928, + "std": 0.2991870939731598, + "rms": 0.2992428243160248, + "max_abs": 8.25 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7b23b884b8eb3889b75f25016eb4372ed2c272cceac7d31842ea04965db8ef23", + "mean": -0.007593107409775257, + "std": 5.957398891448975, + "rms": 5.957404613494873, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c61a21bc96a01a567868c02e4c543e4bc8ee1d9dfd3204e46f57018bc10c3c43", + "mean": -0.0057924892753362656, + "std": 0.30237647891044617, + "rms": 0.30243194103240967, + "max_abs": 8.625 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "223099a5d9017a7da0307c84142bf924c20dd111d6b33d3e7340ec1ba20e19cb", + "mean": -0.007408363278955221, + "std": 5.634010314941406, + "rms": 5.634015083312988, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "73ccebec26339e98df953f9e45478e895705252429083148de936e56b6ee16ee", + "mean": -0.005885384976863861, + "std": 0.29884210228919983, + "rms": 0.2989000380039215, + "max_abs": 8.25 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d8152105db03550b98b138db61d658cfc50f95f6056a6acd7bb94deec7c77ba1", + "mean": -0.007683950010687113, + "std": 5.957385063171387, + "rms": 5.957390308380127, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2ac764a1e26177945d8624c9ca8ca46e6926d09793f43dbc7d98247b66e4586a", + "mean": -0.005831951275467873, + "std": 0.3015359342098236, + "rms": 0.30159232020378113, + "max_abs": 8.5625 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "27100bb00aeb0a7dbb549ac44bdc372a63ba914201b4b1efe9add3c3b89eab42", + "mean": -0.007392780389636755, + "std": 5.633974075317383, + "rms": 5.633979320526123, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9974679946899414, + "min_cosine_similarity": 0.9877510666847229, + "mean_relative_l2": 0.06510790437459946, + "max_abs_delta": 0.4375 + }, + "system_bos": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9943881630897522, + "min_cosine_similarity": 0.9664707779884338, + "mean_relative_l2": 0.10105594992637634, + "max_abs_delta": 0.5625 + }, + "system_x": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9885627031326294, + "min_cosine_similarity": 0.9312549829483032, + "mean_relative_l2": 0.14342200756072998, + "max_abs_delta": 0.875 + }, + "system_period": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.988574206829071, + "min_cosine_similarity": 0.9382044672966003, + "mean_relative_l2": 0.1440514624118805, + "max_abs_delta": 0.875 + }, + "bos_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9925498366355896, + "min_cosine_similarity": 0.9662308096885681, + "mean_relative_l2": 0.11791577935218811, + "max_abs_delta": 0.53125 + }, + "bos_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9901475310325623, + "min_cosine_similarity": 0.9428545832633972, + "mean_relative_l2": 0.13635852932929993, + "max_abs_delta": 0.6875 + }, + "x_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9915470480918884, + "min_cosine_similarity": 0.9723999500274658, + "mean_relative_l2": 0.12465959787368774, + "max_abs_delta": 0.8125 + }, + "x_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.985365092754364, + "min_cosine_similarity": 0.9122870564460754, + "mean_relative_l2": 0.16450965404510498, + "max_abs_delta": 0.75 + }, + "period_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9913360476493835, + "min_cosine_similarity": 0.9732851982116699, + "mean_relative_l2": 0.12711019814014435, + "max_abs_delta": 0.75 + }, + "period_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9848883152008057, + "min_cosine_similarity": 0.9323902130126953, + "mean_relative_l2": 0.16818088293075562, + "max_abs_delta": 0.84375 + } + } + }, + "layer_09": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cdb234029b77c0c0350e0ffc1f46c18c9b954ae0f763b9b4113b0471aa99184f", + "mean": -0.006967094726860523, + "std": 0.3532663881778717, + "rms": 0.35333508253097534, + "max_abs": 11.3125 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bb61887eb035977eaa9bf72f244ee2d45cf7b4c000aafcdc4d96dd7a498e36d0", + "mean": -0.016696970909833908, + "std": 6.768218517303467, + "rms": 6.7682390213012695, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f7140bf0896da1e2f52f72e806749d4210bc5c116e2af0ea2c77ca22b8e20be1", + "mean": -0.006980285048484802, + "std": 0.3534722626209259, + "rms": 0.35354116559028625, + "max_abs": 11.5 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a7dfba9494374629cb33d6c3ccce36d87e89356d55eb524c2ae4c533a3bf1421", + "mean": -0.01722230762243271, + "std": 6.597047328948975, + "rms": 6.59706974029541, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a40ff35489edec771008545855c5e4b02bf02ad0b997e912eb5da259aeb9ffa7", + "mean": -0.00715146167203784, + "std": 0.3561810553073883, + "rms": 0.35625284910202026, + "max_abs": 11.125 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c036e6dfa9363746931876e45bf0f8c97c9d67a5c6e376ba6ea281c9b3c6089f", + "mean": -0.008630791679024696, + "std": 5.9608259201049805, + "rms": 5.960832118988037, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4ac363aef2504478f5afafd0c764780c03b6999ea3a47926286ac977a7336e3a", + "mean": -0.006976454984396696, + "std": 0.3569134771823883, + "rms": 0.35698166489601135, + "max_abs": 11.4375 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4dc11093021391887bd96711e80043c7fd5a16829e898373cea62d82b1516cd9", + "mean": -0.008706695400178432, + "std": 5.637425422668457, + "rms": 5.63743257522583, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "df4dbcf0bb064ad5fb592277d8b9ac55b75e15132f9a926e8ade1c401182dbc6", + "mean": -0.007251422386616468, + "std": 0.3531748950481415, + "rms": 0.35324934124946594, + "max_abs": 11.0 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9e89e7255e3a9d7aa2abc97433f17b637d8a49b8aad8993cdf6b4ab9ddb016a0", + "mean": -0.008684864267706871, + "std": 5.960655689239502, + "rms": 5.960661888122559, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "229fd1bf1239a39e23ccaf93e959d4be8cb90269cc95e24e3288dfca4993ba18", + "mean": -0.007069807033985853, + "std": 0.35293880105018616, + "rms": 0.3530096113681793, + "max_abs": 11.375 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8949ede31716a4d58d9d89fc4c2c85684dccce54b08cb2f467d30280f1445e9b", + "mean": -0.008746644482016563, + "std": 5.637200832366943, + "rms": 5.637207984924316, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cb46f3b7f5db601f16d41b4d082124f07cfef7ee74798340402c645287e2dbfb", + "mean": -0.007350392173975706, + "std": 0.3521765172481537, + "rms": 0.3522532284259796, + "max_abs": 10.9375 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "645e82d962cc861b41a2b98f7972b170cf941226389c1caf49a4db21fdded965", + "mean": -0.008689849637448788, + "std": 5.960585117340088, + "rms": 5.960590839385986, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7fda9d24b675771f4104ff38cc3e756ac204c3f7ee1818519858d87b245c2242", + "mean": -0.007312544621527195, + "std": 0.3527224361896515, + "rms": 0.352798193693161, + "max_abs": 11.375 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3526fcadc71f07ca551604c4c01962d1b86900af2792137c6d0630a34491f39a", + "mean": -0.008811186999082565, + "std": 5.637167453765869, + "rms": 5.637174606323242, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9976502656936646, + "min_cosine_similarity": 0.9896465539932251, + "mean_relative_l2": 0.06331700831651688, + "max_abs_delta": 0.5625 + }, + "system_bos": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9948639273643494, + "min_cosine_similarity": 0.9760004281997681, + "mean_relative_l2": 0.09626422077417374, + "max_abs_delta": 0.6875 + }, + "system_x": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9889329075813293, + "min_cosine_similarity": 0.9420279860496521, + "mean_relative_l2": 0.1401238739490509, + "max_abs_delta": 1.03125 + }, + "system_period": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9891225099563599, + "min_cosine_similarity": 0.9542107582092285, + "mean_relative_l2": 0.14024055004119873, + "max_abs_delta": 1.3125 + }, + "bos_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9933048486709595, + "min_cosine_similarity": 0.9757208824157715, + "mean_relative_l2": 0.11197496205568314, + "max_abs_delta": 0.6875 + }, + "bos_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9910955429077148, + "min_cosine_similarity": 0.9575067162513733, + "mean_relative_l2": 0.12979727983474731, + "max_abs_delta": 1.03125 + }, + "x_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.992343008518219, + "min_cosine_similarity": 0.9772577285766602, + "mean_relative_l2": 0.118791364133358, + "max_abs_delta": 0.78125 + }, + "x_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.985938549041748, + "min_cosine_similarity": 0.9251168370246887, + "mean_relative_l2": 0.1604180783033371, + "max_abs_delta": 1.3125 + }, + "period_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9921755790710449, + "min_cosine_similarity": 0.9791029095649719, + "mean_relative_l2": 0.12123650312423706, + "max_abs_delta": 0.90625 + }, + "period_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9859663248062134, + "min_cosine_similarity": 0.9496022462844849, + "mean_relative_l2": 0.16167277097702026, + "max_abs_delta": 1.28125 + } + } + }, + "layer_10": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7c98958d5bb1f9eeff83ed1d0623e2a0372efd82ce15ef3fdc6ad7b70779a48a", + "mean": -0.00500774709507823, + "std": 0.3983820676803589, + "rms": 0.3984135687351227, + "max_abs": 12.5625 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7001782a257df4a67f7bdbbc88b6a62696d93bf5a6410813f1d4e0d884699ea4", + "mean": -0.01554434560239315, + "std": 6.776191711425781, + "rms": 6.776209354400635, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "88a20c097d65709cbe5652b7c45ce51aedeb18523048896199d9ecad1caf0fb7", + "mean": -0.005140254274010658, + "std": 0.3989020586013794, + "rms": 0.3989351987838745, + "max_abs": 12.625 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "52f78b31137473302a037a06ef0ad5c2763779a2917a88cfea94d0bc2eb2bef9", + "mean": -0.01639482192695141, + "std": 6.604781150817871, + "rms": 6.604801177978516, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "557da05f14840d5a8d033a04545949392cd42059fdfcf385bed2bc47b73c2fb2", + "mean": -0.005299775395542383, + "std": 0.40175899863243103, + "rms": 0.4017939269542694, + "max_abs": 12.5625 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5cdc372b1c64e462222fe05832b495531778cb1cd096c3b7b08326afe7a51714", + "mean": -0.007616246119141579, + "std": 5.969588756561279, + "rms": 5.969593524932861, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5208503cfc3a7ddded9362a388bd6c0dc7c02951ecd6fb113eab0c6ad75f9e5c", + "mean": -0.005464000627398491, + "std": 0.4031049311161041, + "rms": 0.40314194560050964, + "max_abs": 12.75 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "21ae79e38b6d04b404c198283c5dcacebd59dd25e8cc375085e210498a516748", + "mean": -0.008126338012516499, + "std": 5.646072864532471, + "rms": 5.646079063415527, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d1377571021358832b484b33291fc69bc55bf34e91c598b223c3e798d5d5ac40", + "mean": -0.0055068782530725, + "std": 0.3988889157772064, + "rms": 0.39892691373825073, + "max_abs": 12.375 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6e8fd2453875b73d20ae312a4d6639dfcc4e43cc39f2c26f80cfe5ca429a5e9c", + "mean": -0.007768102455884218, + "std": 5.96940279006958, + "rms": 5.969407558441162, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1c370a143642ce0ed45e67bf1bd1ff96e05e20ba2325edcd0a34140c677ee16c", + "mean": -0.005965178366750479, + "std": 0.4002460837364197, + "rms": 0.4002905488014221, + "max_abs": 12.6875 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "96b715b9478916ed1608119c4af5a4aabbd184399bbcbafa34865b15b924078b", + "mean": -0.008476253598928452, + "std": 5.64586877822876, + "rms": 5.645874977111816, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e444ac911ddb2e095669a35f8b769523738bc27eea19ca2627f0d527973337bf", + "mean": -0.005610155873000622, + "std": 0.3979409337043762, + "rms": 0.3979804813861847, + "max_abs": 12.25 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d6612aa364b1333c7afd2c20902d38daa872fb4a7fa5b099bb55ba86dd459bf6", + "mean": -0.007724568247795105, + "std": 5.96933126449585, + "rms": 5.969336032867432, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bb9288f2c48a28a94317f4ff7b403c72e7c41bb53681ebf4bd6df3d8b9834a2d", + "mean": -0.0060975030064582825, + "std": 0.3996521234512329, + "rms": 0.3996986448764801, + "max_abs": 12.75 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "33da38ca295c14c045ba7d666b8a03b4809d143a6849c7e3cde5fbb292b65ea7", + "mean": -0.008443649858236313, + "std": 5.645818710327148, + "rms": 5.645824432373047, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9971579909324646, + "min_cosine_similarity": 0.9901207685470581, + "mean_relative_l2": 0.06969459354877472, + "max_abs_delta": 0.5 + }, + "system_bos": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9940230846405029, + "min_cosine_similarity": 0.9746941328048706, + "mean_relative_l2": 0.10462448000907898, + "max_abs_delta": 0.75 + }, + "system_x": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.987547755241394, + "min_cosine_similarity": 0.9279312491416931, + "mean_relative_l2": 0.14928068220615387, + "max_abs_delta": 1.1875 + }, + "system_period": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9874391555786133, + "min_cosine_similarity": 0.9477257132530212, + "mean_relative_l2": 0.1512371152639389, + "max_abs_delta": 1.3125 + }, + "bos_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9925563931465149, + "min_cosine_similarity": 0.9755402207374573, + "mean_relative_l2": 0.11805038154125214, + "max_abs_delta": 0.65625 + }, + "bos_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9900986552238464, + "min_cosine_similarity": 0.9581678509712219, + "mean_relative_l2": 0.13693684339523315, + "max_abs_delta": 0.75 + }, + "x_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9912657737731934, + "min_cosine_similarity": 0.9770196080207825, + "mean_relative_l2": 0.12729060649871826, + "max_abs_delta": 0.8125 + }, + "x_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9842873811721802, + "min_cosine_similarity": 0.9120314121246338, + "mean_relative_l2": 0.1702626347541809, + "max_abs_delta": 1.0 + }, + "period_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9911600351333618, + "min_cosine_similarity": 0.9786127805709839, + "mean_relative_l2": 0.12916970252990723, + "max_abs_delta": 0.9375 + }, + "period_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9841408729553223, + "min_cosine_similarity": 0.9439095258712769, + "mean_relative_l2": 0.1722390204668045, + "max_abs_delta": 1.0 + } + } + }, + "layer_11": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7e66ca9c1b91c5967a770e87e262ed1fd98e455d2e3bb076864bd34cdb7a35e1", + "mean": -0.008473815396428108, + "std": 0.506109893321991, + "rms": 0.5061808228492737, + "max_abs": 17.0 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ef2d98b2dac9c64fa66e8256f73e9801674769c25416dfc82b0e42fb2cce6c0a", + "mean": -0.018045218661427498, + "std": 6.817704677581787, + "rms": 6.8177289962768555, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "45b7cea7d184f8feb38d520d063050941779ec2700ab0fa36cac758eadf44101", + "mean": -0.008607870899140835, + "std": 0.5052498579025269, + "rms": 0.5053231716156006, + "max_abs": 17.0 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d2cbf763bae9dbfff9a62d3a10df31c9ab656890ed94ac61a57688790d254dfa", + "mean": -0.018668949604034424, + "std": 6.6443939208984375, + "rms": 6.6444196701049805, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1982d19f01fc3342a3cb3739fa58535dc515f20491eff9e047fda6a5b384d7b9", + "mean": -0.008884627372026443, + "std": 0.5089828372001648, + "rms": 0.5090603828430176, + "max_abs": 17.0 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "235067efbb80d480de76af8ba968095141cc9cca1c48b5aca9cafa3733694edf", + "mean": -0.010183221660554409, + "std": 6.005112648010254, + "rms": 6.00512170791626, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8e76314e251cc9724e0d593995d15243284a5d462e3ce72c066b1f5466d167f3", + "mean": -0.008691788651049137, + "std": 0.509784460067749, + "rms": 0.5098585486412048, + "max_abs": 16.875 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fda87c27e9c7dc76512945d1d89b082dfbe7460a4e07cf7eb1abb9873a53bb4f", + "mean": -0.01021071057766676, + "std": 5.680197715759277, + "rms": 5.680206775665283, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "94fbcec40f58bb7591b18bfdf4e2ac58a2320b3abb0ecea7a64cf0908ef72c53", + "mean": -0.008990786969661713, + "std": 0.5059683322906494, + "rms": 0.5060482025146484, + "max_abs": 16.875 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a72879dba195ce0f382a3c995d44e3c9d6b1a6fed921b387332a83565526057c", + "mean": -0.01019312720745802, + "std": 6.0049004554748535, + "rms": 6.004909038543701, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d838065c3874d3f21b48b47f501d2416c15d52516d74e4e055a695666e210811", + "mean": -0.009201301261782646, + "std": 0.5057496428489685, + "rms": 0.5058333277702332, + "max_abs": 16.875 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2db58d3e78103e33a3eb87e1f8cdc60f7eb59994c58b0a0011777c406582f167", + "mean": -0.010463867336511612, + "std": 5.6798224449157715, + "rms": 5.6798319816589355, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "988c4da5b4ec751caea9d49acdb99a759e7d60f5e6bc09848090e1832e039244", + "mean": -0.009232824668288231, + "std": 0.5043060183525085, + "rms": 0.5043905377388, + "max_abs": 17.0 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "625a6750da2c739ae0ac90ee5a67a67c5a6108b1668ce2c4a97277a1b48b36ce", + "mean": -0.010273966006934643, + "std": 6.004742622375488, + "rms": 6.004751682281494, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4d12a57a5b9edb755b6aa09df823225b07e89c266608c354b3f8aed8c23bb8e2", + "mean": -0.00936164055019617, + "std": 0.505280077457428, + "rms": 0.5053668022155762, + "max_abs": 16.625 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e2535790b157e32054e82e583b1f7fa789631517f3557fe84bbc47d3bf30060a", + "mean": -0.010447312146425247, + "std": 5.679773807525635, + "rms": 5.679783344268799, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9974430203437805, + "min_cosine_similarity": 0.9903321862220764, + "mean_relative_l2": 0.06676697731018066, + "max_abs_delta": 0.5625 + }, + "system_bos": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9949392676353455, + "min_cosine_similarity": 0.9818789958953857, + "mean_relative_l2": 0.09678909182548523, + "max_abs_delta": 0.75 + }, + "system_x": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9891856908798218, + "min_cosine_similarity": 0.9437886476516724, + "mean_relative_l2": 0.14053873717784882, + "max_abs_delta": 1.25 + }, + "system_period": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9886032342910767, + "min_cosine_similarity": 0.9565185308456421, + "mean_relative_l2": 0.14484968781471252, + "max_abs_delta": 1.3125 + }, + "bos_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9938875436782837, + "min_cosine_similarity": 0.962144672870636, + "mean_relative_l2": 0.1061655580997467, + "max_abs_delta": 1.0625 + }, + "bos_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9917424321174622, + "min_cosine_similarity": 0.9602886438369751, + "mean_relative_l2": 0.12478458881378174, + "max_abs_delta": 0.875 + }, + "x_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.992633581161499, + "min_cosine_similarity": 0.9722225666046143, + "mean_relative_l2": 0.11727353930473328, + "max_abs_delta": 1.0 + }, + "x_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9867178201675415, + "min_cosine_similarity": 0.9362244606018066, + "mean_relative_l2": 0.1572560966014862, + "max_abs_delta": 1.125 + }, + "period_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.992561399936676, + "min_cosine_similarity": 0.9712584614753723, + "mean_relative_l2": 0.11842527985572815, + "max_abs_delta": 1.0 + }, + "period_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9863747358322144, + "min_cosine_similarity": 0.9546806216239929, + "mean_relative_l2": 0.16018842160701752, + "max_abs_delta": 1.21875 + } + } + }, + "layer_12": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "830df3747b02b49b78b2018efc4a5071aacf27354bb94579c9127e995b01c615", + "mean": -0.009097037836909294, + "std": 0.5334962606430054, + "rms": 0.5335738062858582, + "max_abs": 17.0 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "73d27858d91c12d57e6bf0b408d09a00f83c97e63647fcb01eff8ffbdaf57040", + "mean": -0.019059089943766594, + "std": 6.865880489349365, + "rms": 6.865907192230225, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2719b1f9eae7c883eeecda3c4931ea23e11e13c75b639ddd41e74894c8f5c564", + "mean": -0.009007297456264496, + "std": 0.5330325961112976, + "rms": 0.533108651638031, + "max_abs": 16.875 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5a238bdc161591d8b81a84221b5ab96fef5e124914d0b67557c3eda647332b43", + "mean": -0.019125960767269135, + "std": 6.693582057952881, + "rms": 6.693609237670898, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "faf21ba64332a7ca183815877caf4eaf3998ce4d9a3323368f5964e3bfb95965", + "mean": -0.009303851053118706, + "std": 0.5369843244552612, + "rms": 0.5370649099349976, + "max_abs": 17.0 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bf2529b88ee6ade5c7627580ccfb3d647ae2f9b1af3ed8d941cbbaa9f127272a", + "mean": -0.010838540270924568, + "std": 6.016930103302002, + "rms": 6.016939640045166, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1315b3714a02b925d86f6b53e01c26b1596e3f4032b6c170dacba9d286f7afb0", + "mean": -0.008742349222302437, + "std": 0.5365563631057739, + "rms": 0.5366275906562805, + "max_abs": 16.875 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6357400ee9a50cccfa02505133e2279231c9dc07233b21694a69269fee48835f", + "mean": -0.010352193377912045, + "std": 5.691924095153809, + "rms": 5.691933631896973, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a228fe159ec4c56978321095b70576364f5b7997046416b101cbd118ba03d65e", + "mean": -0.009561057202517986, + "std": 0.5342397093772888, + "rms": 0.5343252420425415, + "max_abs": 16.75 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "06d97878e1cda69b4ee9a3904a2b5d4bd72f1a98d78232323f6f8f6ab93b4fdb", + "mean": -0.011240043677389622, + "std": 6.016730308532715, + "rms": 6.016740798950195, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0dfb0a1fe02b3bca179e213986590854cbd421e8007f8d5b9a74959ce39b8724", + "mean": -0.009416756220161915, + "std": 0.5325754880905151, + "rms": 0.5326586961746216, + "max_abs": 16.75 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8bc4231c3cf5da8b491e8dfb830d6fcbf2e70711cd564c8ddb9be2ca9a389e8c", + "mean": -0.010825703851878643, + "std": 5.69148588180542, + "rms": 5.691495895385742, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b36aa3d6c938f1fd50011c1d7db4b1babdaa5c890ee127e72b52a34a839cbdf2", + "mean": -0.00974983349442482, + "std": 0.5337862968444824, + "rms": 0.5338753461837769, + "max_abs": 16.75 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b07f7cea6c2d8d23f21a58bdac5d01ea96167b23b8efa5ef278db6003ab1ab11", + "mean": -0.011171416379511356, + "std": 6.016642093658447, + "rms": 6.0166521072387695, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "181b8aa30333f350ef7a060757411e2944473f3f4ba472e457126176d2d1ca58", + "mean": -0.009544776752591133, + "std": 0.5334251523017883, + "rms": 0.5335105061531067, + "max_abs": 16.625 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2706d53450dcb1fe66607df83fafa301a0dc2b382b1fc8a95e590950b865a1dd", + "mean": -0.010708224028348923, + "std": 5.691556453704834, + "rms": 5.691566467285156, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9968933463096619, + "min_cosine_similarity": 0.9859265089035034, + "mean_relative_l2": 0.07362473011016846, + "max_abs_delta": 0.5 + }, + "system_bos": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9939222931861877, + "min_cosine_similarity": 0.9766981601715088, + "mean_relative_l2": 0.10553818941116333, + "max_abs_delta": 0.75 + }, + "system_x": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9874807596206665, + "min_cosine_similarity": 0.9428878426551819, + "mean_relative_l2": 0.15097659826278687, + "max_abs_delta": 1.125 + }, + "system_period": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9868152141571045, + "min_cosine_similarity": 0.9549368619918823, + "mean_relative_l2": 0.156192347407341, + "max_abs_delta": 1.1875 + }, + "bos_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9928309917449951, + "min_cosine_similarity": 0.9695798754692078, + "mean_relative_l2": 0.11549156159162521, + "max_abs_delta": 0.875 + }, + "bos_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9902839064598083, + "min_cosine_similarity": 0.9654521942138672, + "mean_relative_l2": 0.1353396773338318, + "max_abs_delta": 1.0 + }, + "x_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9912378787994385, + "min_cosine_similarity": 0.9726595878601074, + "mean_relative_l2": 0.12864109873771667, + "max_abs_delta": 1.0625 + }, + "x_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9845338463783264, + "min_cosine_similarity": 0.9311631321907043, + "mean_relative_l2": 0.17037063837051392, + "max_abs_delta": 1.6875 + }, + "period_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9912070631980896, + "min_cosine_similarity": 0.9714773297309875, + "mean_relative_l2": 0.1290285289287567, + "max_abs_delta": 1.125 + }, + "period_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9840646982192993, + "min_cosine_similarity": 0.952465295791626, + "mean_relative_l2": 0.1739063709974289, + "max_abs_delta": 1.390625 + } + } + }, + "layer_13": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "426190d33777587cb0651bbec68cd83c49899afe221fff375f8fe2c4b2c62ee2", + "mean": -0.008361594751477242, + "std": 0.5909140110015869, + "rms": 0.5909731388092041, + "max_abs": 19.25 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9a48c9878ed46b0a5c44b42bcd84e8b59d22478de83f70b6b1e6e773a141710b", + "mean": -0.018548866733908653, + "std": 6.874675273895264, + "rms": 6.874700546264648, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0a063d1a7c52920020aabe6e89b6fdd1c8bd78662d763b070688f181be069b6b", + "mean": -0.008293856866657734, + "std": 0.5910078883171082, + "rms": 0.5910660624504089, + "max_abs": 19.125 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c7aed3227d62c1cca16526591d1ef78c665ddcaffb0bc700422d2a17e68b726a", + "mean": -0.019101286306977272, + "std": 6.702455043792725, + "rms": 6.7024827003479, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b1ade8507547b9b9368c6a8f1465030ea0da83700fd0ef17dd5a85dcb95977a5", + "mean": -0.008620317094027996, + "std": 0.5956765413284302, + "rms": 0.5957388877868652, + "max_abs": 19.25 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "48cd1c84b9d6b72de5d6af22370db41d67eec4d2237d0fb6fe5db858b1c2e71b", + "mean": -0.01036227960139513, + "std": 6.025634288787842, + "rms": 6.025643348693848, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "92716b108d1f676f709a49cc7676cc3dc41c3d6134156bc76db77795152e6bd1", + "mean": -0.008065733127295971, + "std": 0.595078706741333, + "rms": 0.595133364200592, + "max_abs": 19.125 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d5d730cca1cb32e6cecd7a3a030bba2b57f6985844a5dff2700eb99dbf98a216", + "mean": -0.010347804054617882, + "std": 5.700866222381592, + "rms": 5.700876235961914, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "45a1b7ee33d60b6f521bfc4dc0653b1d005e94c87aa98bb9d67743723f809d88", + "mean": -0.008683810010552406, + "std": 0.5926710367202759, + "rms": 0.5927346348762512, + "max_abs": 19.25 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a2feebfb18a3acc725d5111e59514beffcac058f898a15196befe95e3646d87e", + "mean": -0.01064276322722435, + "std": 6.025452136993408, + "rms": 6.025461196899414, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e59d9a6c6c9f4ddf94c5ee6fe87d33d4a867664ce9b3ae5404eef3aedd35c68b", + "mean": -0.008507237769663334, + "std": 0.5903785228729248, + "rms": 0.5904397964477539, + "max_abs": 18.75 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a6c9cc189ceb7cb0b836ec0b81f003510a4947550ea029454e52b44dbecd1b26", + "mean": -0.01060454547405243, + "std": 5.700380802154541, + "rms": 5.700390338897705, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0b48a50d09f0eb5b08d7c175ea8cd78bd81b5288324957fb6794b8a11cff2fd6", + "mean": -0.008823106065392494, + "std": 0.5917252898216248, + "rms": 0.5917910933494568, + "max_abs": 19.125 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "33bf5af267860bc95d47a6249ea759256e0895c3dd92c76aac04cce3de69b79d", + "mean": -0.010540226474404335, + "std": 6.025302410125732, + "rms": 6.02531099319458, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "33606b16e836c044d3ee89331e08f59b6d596c6abae681e8bb25ba5d99f0c6a9", + "mean": -0.00893173273652792, + "std": 0.5905401110649109, + "rms": 0.5906076431274414, + "max_abs": 18.75 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d35ccf788f89f1a1ebc7749d6c0c2bf8356e70561437359ef5eeef801d6c95a7", + "mean": -0.010739774443209171, + "std": 5.7004008293151855, + "rms": 5.700410842895508, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9968598484992981, + "min_cosine_similarity": 0.9874759316444397, + "mean_relative_l2": 0.0740702673792839, + "max_abs_delta": 0.75 + }, + "system_bos": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9936150312423706, + "min_cosine_similarity": 0.9725015163421631, + "mean_relative_l2": 0.1077328771352768, + "max_abs_delta": 0.875 + }, + "system_x": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.987345814704895, + "min_cosine_similarity": 0.9514749050140381, + "mean_relative_l2": 0.15202055871486664, + "max_abs_delta": 1.15625 + }, + "system_period": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9866088628768921, + "min_cosine_similarity": 0.9589805603027344, + "mean_relative_l2": 0.15721698105335236, + "max_abs_delta": 1.21875 + }, + "bos_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9924392104148865, + "min_cosine_similarity": 0.9722787141799927, + "mean_relative_l2": 0.11866473406553268, + "max_abs_delta": 1.125 + }, + "bos_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9899708032608032, + "min_cosine_similarity": 0.9695903658866882, + "mean_relative_l2": 0.1372028887271881, + "max_abs_delta": 1.5 + }, + "x_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9906883835792542, + "min_cosine_similarity": 0.9752545356750488, + "mean_relative_l2": 0.13198144733905792, + "max_abs_delta": 1.0625 + }, + "x_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9841785430908203, + "min_cosine_similarity": 0.940581202507019, + "mean_relative_l2": 0.17194147408008575, + "max_abs_delta": 1.75 + }, + "period_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9908919930458069, + "min_cosine_similarity": 0.9739128351211548, + "mean_relative_l2": 0.13076704740524292, + "max_abs_delta": 1.1875 + }, + "period_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9839559197425842, + "min_cosine_similarity": 0.9537861347198486, + "mean_relative_l2": 0.1739121675491333, + "max_abs_delta": 1.6875 + } + } + }, + "layer_14": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d3a98a8eff267c9749cda55ed6c4a7bb9aebd9478c49f39b275362a38aafe0b5", + "mean": -0.008190703578293324, + "std": 0.6763670444488525, + "rms": 0.6764166355133057, + "max_abs": 22.25 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "22691e09c7de06090ccbdcf3a9050d0caa623c93364b75b659f423811bf11983", + "mean": -0.018050789833068848, + "std": 6.893535614013672, + "rms": 6.893559455871582, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f2d083f14dce85ec56c493ea13471393d1cfbe466dd85470e4bd6fc9ab49e625", + "mean": -0.00836133025586605, + "std": 0.6765623092651367, + "rms": 0.6766139268875122, + "max_abs": 22.25 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a2323fdd6177b342d9c79420eaa0503153445619759afa5f21454445f1dc8e1c", + "mean": -0.018999764695763588, + "std": 6.720197677612305, + "rms": 6.720224380493164, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ba60c5823e17d24ea8c81844da7896e443ac89e4e7d515169287036a6a45d100", + "mean": -0.008417034521698952, + "std": 0.6814781427383423, + "rms": 0.6815301179885864, + "max_abs": 22.375 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8e70057d00766146dd76fa65432aaaf43496ba430e452aa6400e7abd2cc3ec93", + "mean": -0.009835334494709969, + "std": 6.046422481536865, + "rms": 6.0464301109313965, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "23763c71e4707631139e000ad30862bcdb75095322be851eed4f6d583a00981b", + "mean": -0.008188930340111256, + "std": 0.68116694688797, + "rms": 0.6812161803245544, + "max_abs": 22.625 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b45e31b16e724f215e86f7ce52adf27b1d9d878d10a7a1b2d7a686831e7ef7a1", + "mean": -0.010234578512609005, + "std": 5.720993995666504, + "rms": 5.72100305557251, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9a41e2af10510d3c35b2eb29baf5014b9f578330181ade955540777a10995a0a", + "mean": -0.008439389988780022, + "std": 0.6781485676765442, + "rms": 0.6782011389732361, + "max_abs": 22.5 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e63a0f88c2f05746766ff94ddbf4751168c3b6fc7dc94ed59d1086bcb3da7d98", + "mean": -0.010079050436615944, + "std": 6.046213150024414, + "rms": 6.046221733093262, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "826537e71e552ac430b662524cab9787c745ad014bfa25ac1449eef5901af1ad", + "mean": -0.008803287521004677, + "std": 0.675789475440979, + "rms": 0.6758467555046082, + "max_abs": 22.5 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1ebd989df9641b5918df22213b682d10c9f69c71a1baa589b9c1ba4668d6ec32", + "mean": -0.010616917163133621, + "std": 5.7204461097717285, + "rms": 5.720456123352051, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1efa25b4495bceca9b8558530b731d6411fb455ac541aba29d642ee11e27af5e", + "mean": -0.008748472668230534, + "std": 0.6765644550323486, + "rms": 0.6766210198402405, + "max_abs": 22.5 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fbf845f093b2c3c7d1539ae4f5e49241cfc02f79ab5cbe0aa60e482702549dad", + "mean": -0.0101168816909194, + "std": 6.045981407165527, + "rms": 6.045989990234375, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "85b8b5ebccfdfbfea6a82864af685269b0f968689a5263d4fe82fd5a7aa38a21", + "mean": -0.009116822853684425, + "std": 0.675266444683075, + "rms": 0.6753280162811279, + "max_abs": 22.5 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "09101d6ca9208dddae25fcea830094fc05426593af2933cbd15a2a2e160de40b", + "mean": -0.010693863965570927, + "std": 5.7203779220581055, + "rms": 5.720387935638428, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9968206882476807, + "min_cosine_similarity": 0.988024115562439, + "mean_relative_l2": 0.07478779554367065, + "max_abs_delta": 0.875 + }, + "system_bos": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9937336444854736, + "min_cosine_similarity": 0.9713619947433472, + "mean_relative_l2": 0.10649891197681427, + "max_abs_delta": 0.875 + }, + "system_x": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9873447418212891, + "min_cosine_similarity": 0.9526000022888184, + "mean_relative_l2": 0.15168479084968567, + "max_abs_delta": 1.3125 + }, + "system_period": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9866495132446289, + "min_cosine_similarity": 0.9606350064277649, + "mean_relative_l2": 0.15632665157318115, + "max_abs_delta": 1.4375 + }, + "bos_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9925382733345032, + "min_cosine_similarity": 0.973783016204834, + "mean_relative_l2": 0.1177758276462555, + "max_abs_delta": 1.0 + }, + "bos_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9904077053070068, + "min_cosine_similarity": 0.970794141292572, + "mean_relative_l2": 0.13404320180416107, + "max_abs_delta": 1.5625 + }, + "x_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9910219311714172, + "min_cosine_similarity": 0.9762903451919556, + "mean_relative_l2": 0.12988750636577606, + "max_abs_delta": 1.25 + }, + "x_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9846665263175964, + "min_cosine_similarity": 0.9414781332015991, + "mean_relative_l2": 0.16873949766159058, + "max_abs_delta": 2.125 + }, + "period_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.991299569606781, + "min_cosine_similarity": 0.9757561683654785, + "mean_relative_l2": 0.12779346108436584, + "max_abs_delta": 1.3125 + }, + "period_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9844070076942444, + "min_cosine_similarity": 0.9479917287826538, + "mean_relative_l2": 0.17074964940547943, + "max_abs_delta": 2.125 + } + } + }, + "layer_15": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8d488371264e279b79fc0f2f11cfbccc08528bb0a4c6fefe75d9a281337eb523", + "mean": -0.011030556634068489, + "std": 0.7495222091674805, + "rms": 0.7496033906936646, + "max_abs": 24.5 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "47eee0fdf48ec0e8c3463d67506b866b96af17318c44ce342c551607e789cbc5", + "mean": -0.0200137160718441, + "std": 6.903679847717285, + "rms": 6.9037089347839355, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c2227a516675b048cf4253ae55829dd273beae7c7ecc97d3764319bcf003582d", + "mean": -0.011272658593952656, + "std": 0.7486189007759094, + "rms": 0.7487037777900696, + "max_abs": 24.25 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "613747ab70a288c6f54ce070bdb3e36089796e941ae6df0022e52ccff585c0d8", + "mean": -0.021030094474554062, + "std": 6.730649471282959, + "rms": 6.730682373046875, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7c44159e6e81dabb6ef7a76a30deb4a482b3da13d7f8a6720642eb17934fc1e1", + "mean": -0.011255279183387756, + "std": 0.7544611096382141, + "rms": 0.7545450925827026, + "max_abs": 24.375 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0c56acd2c62e1bc5c7b02a0b8d6d50b19bb11627f6fa7cdea64f7d25e322ccd0", + "mean": -0.011812282726168633, + "std": 6.057451248168945, + "rms": 6.0574631690979, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "40d4508ae6cb60ea60383051e428ded96cd86afe61787073814ee555806b83de", + "mean": -0.010992174968123436, + "std": 0.7524078488349915, + "rms": 0.7524880766868591, + "max_abs": 23.875 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ef95bccee5067edc9ec7624a9ea52ffea34ed245ddd7e8319ed9af3ea2fe743f", + "mean": -0.012203142046928406, + "std": 5.732516288757324, + "rms": 5.732529163360596, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e453a494be8ca52ec3c7232154b09c1195338f9af0ebbab4920104ed91274fdc", + "mean": -0.011056126095354557, + "std": 0.7492140531539917, + "rms": 0.7492955923080444, + "max_abs": 24.5 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cb68ce379a34f23ef70c9d97188fbd1af32501bf2d4fab0fc0d1bb45b2ea0729", + "mean": -0.011858676560223103, + "std": 6.056987762451172, + "rms": 6.056999683380127, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8588bbd361556267c8a8ff7ef1026b29622cc9aa37e7829f5ad21bd3690d4574", + "mean": -0.011928100138902664, + "std": 0.745028555393219, + "rms": 0.7451239824295044, + "max_abs": 23.75 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1c10a9b203291db0cc3dc7687ffa57f926d99a56d1804c70153d56a4034a1b9c", + "mean": -0.012843593023717403, + "std": 5.731661796569824, + "rms": 5.731677055358887, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a1bf7e664dd97125fbad7e57fa63c24fc3dee06a66f34e5cfede9b55188c3315", + "mean": -0.011384653858840466, + "std": 0.747865617275238, + "rms": 0.7479522228240967, + "max_abs": 24.125 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "391cc399e9cb7b08efbba7cbd57162bc42b9da5ccbac07bc65da082af3f73771", + "mean": -0.011903929524123669, + "std": 6.0567779541015625, + "rms": 6.056789875030518, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "01822066bfa686c210a7f48074da4f32cc530a900153a7f2e6828eac10d952ca", + "mean": -0.012267732992768288, + "std": 0.7441877126693726, + "rms": 0.7442888617515564, + "max_abs": 23.75 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "442c7fab8d700e43578f9314c28d487c37f36b4a613019096488440210535c1b", + "mean": -0.012918665073812008, + "std": 5.731585502624512, + "rms": 5.731599807739258, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9966205954551697, + "min_cosine_similarity": 0.9866850972175598, + "mean_relative_l2": 0.07705523073673248, + "max_abs_delta": 0.9375 + }, + "system_bos": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9935474395751953, + "min_cosine_similarity": 0.97100830078125, + "mean_relative_l2": 0.10792209208011627, + "max_abs_delta": 1.5 + }, + "system_x": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9868021607398987, + "min_cosine_similarity": 0.9528759717941284, + "mean_relative_l2": 0.15483619272708893, + "max_abs_delta": 1.75 + }, + "system_period": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9861184358596802, + "min_cosine_similarity": 0.9597011208534241, + "mean_relative_l2": 0.15924608707427979, + "max_abs_delta": 1.75 + }, + "bos_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9924470782279968, + "min_cosine_similarity": 0.9727170467376709, + "mean_relative_l2": 0.11825092136859894, + "max_abs_delta": 1.25 + }, + "bos_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9902967214584351, + "min_cosine_similarity": 0.9661417007446289, + "mean_relative_l2": 0.13469430804252625, + "max_abs_delta": 2.125 + }, + "x_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9909073114395142, + "min_cosine_similarity": 0.9740807414054871, + "mean_relative_l2": 0.13058312237262726, + "max_abs_delta": 1.5625 + }, + "x_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9842464327812195, + "min_cosine_similarity": 0.9388010501861572, + "mean_relative_l2": 0.17054550349712372, + "max_abs_delta": 2.375 + }, + "period_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.991210401058197, + "min_cosine_similarity": 0.9754184484481812, + "mean_relative_l2": 0.12825140357017517, + "max_abs_delta": 1.75 + }, + "period_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9840248823165894, + "min_cosine_similarity": 0.9475868940353394, + "mean_relative_l2": 0.1724759042263031, + "max_abs_delta": 2.25 + } + } + }, + "layer_16": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ac78cc74336a5198712589bb1cfd1fdc2d548b4c669262aea6e361e3a378f65e", + "mean": -0.014605400152504444, + "std": 0.874299168586731, + "rms": 0.8744211196899414, + "max_abs": 26.875 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4d0322a6933558e3277396b722a55ca64997593bbe61de8ab4d1940a6ed9f479", + "mean": -0.022860143333673477, + "std": 6.920103549957275, + "rms": 6.920141220092773, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9fa6880dc8c19ad2cc8dfbe7a868814f00da6f02f0826f66d9578a667a1e7964", + "mean": -0.014898142777383327, + "std": 0.8745629787445068, + "rms": 0.8746898770332336, + "max_abs": 26.875 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f2b3eeb5d587988630efb9fe9d5a36e6b7928e94513bc32dcc1d9393dd59591e", + "mean": -0.023448742926120758, + "std": 6.746831893920898, + "rms": 6.746872425079346, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "68acfa93381ac5878558f6c975ed3fe6f085b254ec8be99547f143e363142da2", + "mean": -0.014635613188147545, + "std": 0.8793728947639465, + "rms": 0.8794946670532227, + "max_abs": 26.75 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9d2bb8247c9a2a18a85d7bc639f292e405087f3d44aff4a9e7cabb981f1f3149", + "mean": -0.014420702122151852, + "std": 6.07533073425293, + "rms": 6.075347423553467, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cbca934215d908619563e7268d4df8b77bf5ee812943efc4561ee64122c1258e", + "mean": -0.014216422103345394, + "std": 0.8775417804718018, + "rms": 0.8776569366455078, + "max_abs": 26.75 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "da2d0ef2010c06585d3d3e7a9e6479f172b907a4139d4cd350be417f42176ee7", + "mean": -0.014216741546988487, + "std": 5.750737190246582, + "rms": 5.7507548332214355, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f676a1b013c06bb09255c77a564110cc6e0bb7165aca53b33f9bfaa4d3cc40c1", + "mean": -0.014613153412938118, + "std": 0.8746819496154785, + "rms": 0.8748040199279785, + "max_abs": 27.0 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "eb7bfe3e48889df74e6ece7c3255943f85deb6937ae37f953c38a70e0971058b", + "mean": -0.014647606760263443, + "std": 6.075003147125244, + "rms": 6.075019836425781, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "30cfc7742152c6714f3061a1a1674f7c5add73e19dcd386b4817921af1f16176", + "mean": -0.015306792221963406, + "std": 0.8698534369468689, + "rms": 0.8699880838394165, + "max_abs": 26.875 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "72d621f78f53ba3dc33c1fdde9e9cc29b9a68ef5f20dca76c6e936c60b64b458", + "mean": -0.015047239139676094, + "std": 5.7499098777771, + "rms": 5.749929904937744, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "03f00f86fbcf6e94f4f43497f6a87c60fbcfb99526e8294b268a2b499efe3f91", + "mean": -0.014883922412991524, + "std": 0.8738458156585693, + "rms": 0.8739725351333618, + "max_abs": 27.0 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fc585f8c438889c5b4bb15aec6e9abc6f498dea5e429f11ed02c8076e0ec4349", + "mean": -0.014609167352318764, + "std": 6.074709415435791, + "rms": 6.074726581573486, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2719c16217694c4dabcc592e4bf2a2b9b3a56abb10d1e68a7746278fe6fda338", + "mean": -0.015615910291671753, + "std": 0.8696047067642212, + "rms": 0.8697449564933777, + "max_abs": 26.875 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "21fd501fee0f912fbef59868e43ab159a38315b4a490c359e7041b69ea04b35d", + "mean": -0.0150176752358675, + "std": 5.749770164489746, + "rms": 5.749789714813232, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9965681433677673, + "min_cosine_similarity": 0.9813411831855774, + "mean_relative_l2": 0.07716744393110275, + "max_abs_delta": 1.0 + }, + "system_bos": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9935207962989807, + "min_cosine_similarity": 0.9690133333206177, + "mean_relative_l2": 0.10781941562891006, + "max_abs_delta": 1.75 + }, + "system_x": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9867204427719116, + "min_cosine_similarity": 0.9537458419799805, + "mean_relative_l2": 0.15510664880275726, + "max_abs_delta": 2.5625 + }, + "system_period": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9860380291938782, + "min_cosine_similarity": 0.9500013589859009, + "mean_relative_l2": 0.1593114584684372, + "max_abs_delta": 2.4375 + }, + "bos_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9922894239425659, + "min_cosine_similarity": 0.9693018198013306, + "mean_relative_l2": 0.11912427842617035, + "max_abs_delta": 1.25 + }, + "bos_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9902918934822083, + "min_cosine_similarity": 0.9625864028930664, + "mean_relative_l2": 0.1341562122106552, + "max_abs_delta": 1.875 + }, + "x_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9907318949699402, + "min_cosine_similarity": 0.9681297540664673, + "mean_relative_l2": 0.1315622180700302, + "max_abs_delta": 1.875 + }, + "x_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9840769171714783, + "min_cosine_similarity": 0.9438816905021667, + "mean_relative_l2": 0.17075064778327942, + "max_abs_delta": 2.125 + }, + "period_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9911770224571228, + "min_cosine_similarity": 0.9750142097473145, + "mean_relative_l2": 0.12822824716567993, + "max_abs_delta": 1.875 + }, + "period_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9838196039199829, + "min_cosine_similarity": 0.9372920989990234, + "mean_relative_l2": 0.17292051017284393, + "max_abs_delta": 2.75 + } + } + }, + "layer_17": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2759c81595cd97a2de055975183d1bb6184c7e404644e32dc49bc274089d99ff", + "mean": -0.01575958915054798, + "std": 0.9915484189987183, + "rms": 0.9916736483573914, + "max_abs": 31.0 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "961f491f90fbeffe6520560a75e84cbdc57de842a35bfd1e851d3f3ff229b7b7", + "mean": -0.024228664115071297, + "std": 6.937838554382324, + "rms": 6.937880992889404, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bae1a5847ba7e6617787b18f74ad693d1296624f87590957267f795a705848fb", + "mean": -0.016172105446457863, + "std": 0.9922819137573242, + "rms": 0.9924136996269226, + "max_abs": 30.5 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3bd3fb8879ab67a17cf629e8801fe5a3464eef07b7adb53cc353bf7d72779d8d", + "mean": -0.025231439620256424, + "std": 6.764952182769775, + "rms": 6.764998912811279, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "16f256809f3e16249d935f311a0bae5b7b7e9a19382482993d5598c58a6e042a", + "mean": -0.015427665784955025, + "std": 0.9977209568023682, + "rms": 0.9978402256965637, + "max_abs": 31.75 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3678cc7b0468acc1ed09a690a1cd460621fad3c9400a5f7605564a01cea411f7", + "mean": -0.015468902885913849, + "std": 6.09515380859375, + "rms": 6.095173358917236, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "596794a4abff816b7043f75ddf56fc09e3ce5547bd5427fc0ef866807fb9a18b", + "mean": -0.01513487659394741, + "std": 0.996783435344696, + "rms": 0.996898353099823, + "max_abs": 31.75 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b8f5539b16826f4937dbf8b78a32dec751f1e4aa804ea7dbe354f074247a0d4b", + "mean": -0.015803802758455276, + "std": 5.771748065948486, + "rms": 5.771770000457764, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0a810cf88c072359f783c3d493689fcc4cc5644e23aff13eb2e93d9370a872d7", + "mean": -0.015368625521659851, + "std": 0.9941262006759644, + "rms": 0.9942449927330017, + "max_abs": 32.0 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "44c81873969f6318dd42e2adc3b324a6cf6951ab912854c56b984c113147dc93", + "mean": -0.015694404020905495, + "std": 6.094983100891113, + "rms": 6.095003128051758, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9b09ecf5f6735201827758c4991d3e301f5e2f727089299c5e482be3c6f6d766", + "mean": -0.01650046929717064, + "std": 0.9907698631286621, + "rms": 0.9909071922302246, + "max_abs": 32.0 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1c5e2bd6fef48e483c6f2ae64fd1b2a2df396999086a44c89c5b0afb47389896", + "mean": -0.0168377123773098, + "std": 5.771087646484375, + "rms": 5.771111488342285, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d8e6ff7feabb2181bbfc9db69bc475b60e8bf9ad31e7ff8e8f4ec544de99267c", + "mean": -0.015629921108484268, + "std": 0.9921820759773254, + "rms": 0.9923051595687866, + "max_abs": 31.625 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "124201bab7cdaf4fa76ca844c23645cb82c262595a3a6417e6fad50d35a50aaf", + "mean": -0.015602398663759232, + "std": 6.094485759735107, + "rms": 6.094505786895752, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "61e9b1fa3c612f54a15fd1f4a804a8490d6a07836253c4545b801f95a31abb92", + "mean": -0.01659388840198517, + "std": 0.989604115486145, + "rms": 0.9897432327270508, + "max_abs": 31.75 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "dea1b97863c156a70c144461c7ac45627b3c5579b62754ab1a1cab4cce70b885", + "mean": -0.016620444133877754, + "std": 5.770886421203613, + "rms": 5.770909786224365, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9967402815818787, + "min_cosine_similarity": 0.980531632900238, + "mean_relative_l2": 0.075264111161232, + "max_abs_delta": 1.125 + }, + "system_bos": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9938520789146423, + "min_cosine_similarity": 0.9703764319419861, + "mean_relative_l2": 0.10473588109016418, + "max_abs_delta": 2.4375 + }, + "system_x": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9876254796981812, + "min_cosine_similarity": 0.9554654359817505, + "mean_relative_l2": 0.14961731433868408, + "max_abs_delta": 2.625 + }, + "system_period": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9870441555976868, + "min_cosine_similarity": 0.9446736574172974, + "mean_relative_l2": 0.15321564674377441, + "max_abs_delta": 2.9375 + }, + "bos_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9928451180458069, + "min_cosine_similarity": 0.9637051224708557, + "mean_relative_l2": 0.11463769525289536, + "max_abs_delta": 1.25 + }, + "bos_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9908984303474426, + "min_cosine_similarity": 0.9586648344993591, + "mean_relative_l2": 0.12979596853256226, + "max_abs_delta": 2.125 + }, + "x_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9912985563278198, + "min_cosine_similarity": 0.9590681791305542, + "mean_relative_l2": 0.1270831972360611, + "max_abs_delta": 2.625 + }, + "x_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9849752187728882, + "min_cosine_similarity": 0.9380594491958618, + "mean_relative_l2": 0.16565687954425812, + "max_abs_delta": 2.5 + }, + "period_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9918233752250671, + "min_cosine_similarity": 0.9667336344718933, + "mean_relative_l2": 0.12313149869441986, + "max_abs_delta": 1.9375 + }, + "period_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9849222898483276, + "min_cosine_similarity": 0.928604245185852, + "mean_relative_l2": 0.166459321975708, + "max_abs_delta": 3.0 + } + } + }, + "layer_18": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3e3c0434463f21ad56dfba59bc6d0c843112f215b0b38bc043c002b8e809c2e3", + "mean": -0.017454968765378, + "std": 1.109922170639038, + "rms": 1.110059380531311, + "max_abs": 33.0 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ea3831f0aa60aca61e81da8a310d1145ad603e078e3076216a862216a2bd9581", + "mean": -0.025540418922901154, + "std": 6.960414409637451, + "rms": 6.960461139678955, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7fdf14cab99467af81ebe552aff04d9e6b62e13125aadcfd90f3d0e7ad0d8fc1", + "mean": -0.01814289391040802, + "std": 1.1102652549743652, + "rms": 1.1104135513305664, + "max_abs": 33.0 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e0bf17b5f5af37f590bf6a0ab66b74e6984c7694b358a6ef388c026c85164711", + "mean": -0.02646399848163128, + "std": 6.787914752960205, + "rms": 6.787966728210449, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "62d6c8ba158b8ea4cb458a969360a00738d1ab78d9e323426c80b1f1ed29d12c", + "mean": -0.017329925671219826, + "std": 1.1157066822052002, + "rms": 1.115841269493103, + "max_abs": 33.5 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "03d4ecfa5d441deaf863037e7f528b204e0f05370d89c6374ea03a82fd5b0b7e", + "mean": -0.016910361126065254, + "std": 6.118509292602539, + "rms": 6.118532657623291, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e123171219386b056a72f33f443666af31d52d740779b00d0105afab5bafa97c", + "mean": -0.016961131244897842, + "std": 1.114111304283142, + "rms": 1.1142404079437256, + "max_abs": 33.5 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d48b6bd96ccc16fe2348c5d29f1b01b29a6228a7f5bc020f69b8ba3259fdb5e1", + "mean": -0.016866007819771767, + "std": 5.796339511871338, + "rms": 5.796364784240723, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5f555fad4fcc379f9f1710639d088271b9628a7f7db399ef2ea1d60ece0327b8", + "mean": -0.017085831612348557, + "std": 1.1112498044967651, + "rms": 1.11138117313385, + "max_abs": 33.75 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0672bbcce31b98240f5ec43b8daa68773b510072ddf1da44d73828fc69b0cf75", + "mean": -0.01703629270195961, + "std": 6.118136405944824, + "rms": 6.118160724639893, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "da61449e8af42ef16eccd056b5e24ea19951a19e0cba679edc021f127f8fd451", + "mean": -0.01838141493499279, + "std": 1.1067662239074707, + "rms": 1.1069188117980957, + "max_abs": 33.5 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cea5f51ede58840e4ff1c6bd990ee471556c9e9164411fb15413c76e3eb17636", + "mean": -0.017970437183976173, + "std": 5.795490741729736, + "rms": 5.7955193519592285, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ca8b5cd5ce67d78db96399a33688ecb51d9e29945be7324fc71ea81aa383c367", + "mean": -0.0174399483948946, + "std": 1.1096875667572021, + "rms": 1.109824538230896, + "max_abs": 33.25 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "89ee6382e724acf81c5da14b37000aae7b2fec177314690a80f34b9e3a326a0f", + "mean": -0.017006555572152138, + "std": 6.117672920227051, + "rms": 6.117696285247803, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "36e2866acb6f327c3c78f630db7dbfe882606b447edb5588ae9669d29737569e", + "mean": -0.01852489821612835, + "std": 1.104721188545227, + "rms": 1.1048765182495117, + "max_abs": 33.75 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7854bd6b13fc674168ac803d9d963ac6fb65a99b20675dc081b7dc8539302b9a", + "mean": -0.01784634031355381, + "std": 5.7950825691223145, + "rms": 5.79511022567749, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9967058300971985, + "min_cosine_similarity": 0.97922283411026, + "mean_relative_l2": 0.07589522004127502, + "max_abs_delta": 1.4375 + }, + "system_bos": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9938108921051025, + "min_cosine_similarity": 0.9654548168182373, + "mean_relative_l2": 0.1048687994480133, + "max_abs_delta": 3.0 + }, + "system_x": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9875888228416443, + "min_cosine_similarity": 0.9541311860084534, + "mean_relative_l2": 0.15029999613761902, + "max_abs_delta": 3.375 + }, + "system_period": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9868279099464417, + "min_cosine_similarity": 0.9373139142990112, + "mean_relative_l2": 0.1545809507369995, + "max_abs_delta": 3.5 + }, + "bos_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9929950833320618, + "min_cosine_similarity": 0.9620134234428406, + "mean_relative_l2": 0.11334570497274399, + "max_abs_delta": 1.75 + }, + "bos_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9909623861312866, + "min_cosine_similarity": 0.9540720582008362, + "mean_relative_l2": 0.12912067770957947, + "max_abs_delta": 3.1875 + }, + "x_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9914416670799255, + "min_cosine_similarity": 0.958753228187561, + "mean_relative_l2": 0.12582646310329437, + "max_abs_delta": 3.25 + }, + "x_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9849521517753601, + "min_cosine_similarity": 0.932593584060669, + "mean_relative_l2": 0.16570121049880981, + "max_abs_delta": 3.0 + }, + "period_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9919962882995605, + "min_cosine_similarity": 0.9678667187690735, + "mean_relative_l2": 0.12193173170089722, + "max_abs_delta": 2.0 + }, + "period_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9847778677940369, + "min_cosine_similarity": 0.9169935584068298, + "mean_relative_l2": 0.16704003512859344, + "max_abs_delta": 3.5 + } + } + }, + "layer_19": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c33112891dee5db9936e518eb60cca826d290a59606ff2d0619c012679663b2d", + "mean": -0.01964775286614895, + "std": 1.2651469707489014, + "rms": 1.2652994394302368, + "max_abs": 34.25 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "802acb4424eee96a1e2732938f07fee99879ae8da5150c4368c790d072d9dd57", + "mean": -0.02693236991763115, + "std": 6.982442855834961, + "rms": 6.982495307922363, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b93f190bf00f5366402bdbda04439e299c4d397a8f3f8462389d99fe795fce7c", + "mean": -0.020356766879558563, + "std": 1.2655278444290161, + "rms": 1.2656916379928589, + "max_abs": 34.5 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f20f5eab87ebec8c5098bbfe0e1396b64e8ab03910cfb09301f60a6e87e7da9e", + "mean": -0.027339866384863853, + "std": 6.810430526733398, + "rms": 6.81048583984375, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3ce64ba0027fc217f9bc305c37161ad5f13a656c6bcd3f7ec693e29ffb28bb7c", + "mean": -0.019220001995563507, + "std": 1.2712427377700806, + "rms": 1.2713879346847534, + "max_abs": 34.75 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1ed337872c96934f277e6ea672b3151ed3fcf51e638966dcdba350b9cb7010a0", + "mean": -0.018184097483754158, + "std": 6.144125938415527, + "rms": 6.144152641296387, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "889325d6495b0a12787840b011be3a0fd497af86e9660da8fc568dc6a3ec7f1b", + "mean": -0.018695008009672165, + "std": 1.2704991102218628, + "rms": 1.2706365585327148, + "max_abs": 35.25 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ddadbeb5eb8cfb209893a7fd7f6e842ed4af4d660428f8d4979d74c22b393366", + "mean": -0.01740601472556591, + "std": 5.8229169845581055, + "rms": 5.822943210601807, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "afb3965981e2764ec1abc2aed8f2e7644abf0ab98f42a1fd0202939fbaa856e1", + "mean": -0.018799209967255592, + "std": 1.267333745956421, + "rms": 1.2674731016159058, + "max_abs": 33.5 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7a6b056811f701223f845963c83368f33549591edf3acb4b774309369a46b457", + "mean": -0.018137773498892784, + "std": 6.143889427185059, + "rms": 6.14391565322876, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b622f5b91118e38648d945d8c79458f8143ec53a95edd05350092c123459ff07", + "mean": -0.01917024701833725, + "std": 1.2639389038085938, + "rms": 1.2640843391418457, + "max_abs": 34.75 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4c56284e99339a8d6c6ab483d228bd222aaac05011a316a872be6a3802b880b7", + "mean": -0.01780497096478939, + "std": 5.822002410888672, + "rms": 5.8220295906066895, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e2eeacb5e09626defdd37b1993bd863db0432f19873802ef8d7e380fd1813a07", + "mean": -0.019252851605415344, + "std": 1.265727162361145, + "rms": 1.265873670578003, + "max_abs": 34.0 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e72ca1d6e12c825ede08fd7556a15438eeef68a932be34f79791df1e28ea83e4", + "mean": -0.018311534076929092, + "std": 6.1432576179504395, + "rms": 6.143284797668457, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e1ef31c10a0295462dda834853aed5293539c6e71beaa1a37ad94c5e65ad9928", + "mean": -0.019415734335780144, + "std": 1.260269045829773, + "rms": 1.2604185342788696, + "max_abs": 35.25 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a5dc7ed0ca2fcec78615541c2f5eb96c2be74c591ac165a4939ab0392c7bfc67", + "mean": -0.017930347472429276, + "std": 5.821345329284668, + "rms": 5.821372985839844, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9965598583221436, + "min_cosine_similarity": 0.9768079519271851, + "mean_relative_l2": 0.07722535729408264, + "max_abs_delta": 1.5 + }, + "system_bos": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.993600070476532, + "min_cosine_similarity": 0.9567068219184875, + "mean_relative_l2": 0.10613559931516647, + "max_abs_delta": 2.75 + }, + "system_x": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9874021410942078, + "min_cosine_similarity": 0.9421955347061157, + "mean_relative_l2": 0.15111297369003296, + "max_abs_delta": 3.125 + }, + "system_period": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9868850111961365, + "min_cosine_similarity": 0.9436914324760437, + "mean_relative_l2": 0.15414276719093323, + "max_abs_delta": 3.375 + }, + "bos_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9920409917831421, + "min_cosine_similarity": 0.8967671990394592, + "mean_relative_l2": 0.11705456674098969, + "max_abs_delta": 2.06640625 + }, + "bos_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9906220436096191, + "min_cosine_similarity": 0.9111320972442627, + "mean_relative_l2": 0.1299925148487091, + "max_abs_delta": 2.875 + }, + "x_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9908041954040527, + "min_cosine_similarity": 0.9096177816390991, + "mean_relative_l2": 0.1278671771287918, + "max_abs_delta": 3.125 + }, + "x_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9840444326400757, + "min_cosine_similarity": 0.8821195363998413, + "mean_relative_l2": 0.16880297660827637, + "max_abs_delta": 3.0625 + }, + "period_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9916431307792664, + "min_cosine_similarity": 0.9350706934928894, + "mean_relative_l2": 0.12314600497484207, + "max_abs_delta": 2.125 + }, + "period_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9845706820487976, + "min_cosine_similarity": 0.9110816717147827, + "mean_relative_l2": 0.1671755313873291, + "max_abs_delta": 3.4375 + } + } + }, + "layer_20": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e352e8e7d825d7314b21d0e2a44acb50216a175d9317eb337bdeecc95a910315", + "mean": -0.020985499024391174, + "std": 1.4328689575195312, + "rms": 1.4330226182937622, + "max_abs": 39.0 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5fd1d5a931f484a2c8dec07abbc946154502af0e65b48f8b0fcabfee942df1dd", + "mean": -0.02804986573755741, + "std": 7.220231533050537, + "rms": 7.220285415649414, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0655def8479ebeca539c2a39cf0a3d83fdd1338be7021aead3b17b45445c52c2", + "mean": -0.021776877343654633, + "std": 1.434328556060791, + "rms": 1.434493899345398, + "max_abs": 39.5 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5763be525d75312c039f4f62b1f49aa86a4c70a18f8a063d75f416031cc431bc", + "mean": -0.028388533741235733, + "std": 7.050578594207764, + "rms": 7.050635814666748, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "387fc9dae98a3275a04488cd8e5db0270c702e66207150a35ca06eb8b15626f8", + "mean": -0.020092546939849854, + "std": 1.4392282962799072, + "rms": 1.4393686056137085, + "max_abs": 39.0 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7f7ca79c3412563a4b46aba9bf7b9a488b9153be04893ab0cfdb9b6d8adbbb25", + "mean": -0.01929420419037342, + "std": 6.179800987243652, + "rms": 6.179831027984619, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d30c1f095a2247b4cf3edcfb70567b81df542c7a1c6fcbfcd1762d69fd643e14", + "mean": -0.019994117319583893, + "std": 1.4401345252990723, + "rms": 1.4402732849121094, + "max_abs": 39.0 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4c3b23f82c97c1649db7eec9604de23515e9ea1a42c5fdbd1652b8fedc29864a", + "mean": -0.01865246705710888, + "std": 5.8606672286987305, + "rms": 5.860696792602539, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2e30028a296c74148b195b0303cb7de30d899ff8fecab80c069c5a87b35731ee", + "mean": -0.01970151625573635, + "std": 1.4350277185440063, + "rms": 1.435162901878357, + "max_abs": 39.0 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "740e30f726092f87f083941fea67d8d4cf36be562a0a9774e7587c6c66c7808c", + "mean": -0.019283419474959373, + "std": 6.179568767547607, + "rms": 6.179598808288574, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cb87bd3bef6b2c82eb7ea247e25baf33f2f6635542ff733dff9863c2be4c6629", + "mean": -0.02039310522377491, + "std": 1.433814287185669, + "rms": 1.4339593648910522, + "max_abs": 39.5 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b3a25eef37e61c88edf868759a3d4115f64d47a1d3576c53be7269e325dc78b1", + "mean": -0.01906578242778778, + "std": 5.859890460968018, + "rms": 5.859921455383301, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5586fcc0b801cbebf8e72224710f2a8de40f6d136f583ae143f59b2e7fd6136b", + "mean": -0.020236652344465256, + "std": 1.4329090118408203, + "rms": 1.4330519437789917, + "max_abs": 39.0 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "217a239b5219d361217fefd61d09dc724ea99c20074fc829eba29c6e7134ecae", + "mean": -0.019447363913059235, + "std": 6.178759574890137, + "rms": 6.178790092468262, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b8691b1cb5da13a3ca8c36ad49ca97375f381285d118f24011cfed2e6a965afb", + "mean": -0.0215887650847435, + "std": 1.430235505104065, + "rms": 1.4303983449935913, + "max_abs": 39.25 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8d09d8de1d152ddad4fd31bc8485c9a3a731fa3cab0323b1a19c9fc6f42bf99e", + "mean": -0.019890565425157547, + "std": 5.859067440032959, + "rms": 5.85910177230835, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9965575337409973, + "min_cosine_similarity": 0.9778860807418823, + "mean_relative_l2": 0.07789141684770584, + "max_abs_delta": 1.875 + }, + "system_bos": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9937185645103455, + "min_cosine_similarity": 0.9604488015174866, + "mean_relative_l2": 0.1054714247584343, + "max_abs_delta": 2.8125 + }, + "system_x": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9871711134910583, + "min_cosine_similarity": 0.9409354329109192, + "mean_relative_l2": 0.1527373343706131, + "max_abs_delta": 3.4375 + }, + "system_period": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9863001108169556, + "min_cosine_similarity": 0.941483199596405, + "mean_relative_l2": 0.15783260762691498, + "max_abs_delta": 3.3125 + }, + "bos_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9922077655792236, + "min_cosine_similarity": 0.9011150598526001, + "mean_relative_l2": 0.1157752126455307, + "max_abs_delta": 3.0 + }, + "bos_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9908453822135925, + "min_cosine_similarity": 0.9118919968605042, + "mean_relative_l2": 0.12837736308574677, + "max_abs_delta": 3.875 + }, + "x_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9910663366317749, + "min_cosine_similarity": 0.9136289358139038, + "mean_relative_l2": 0.12582169473171234, + "max_abs_delta": 3.125 + }, + "x_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9839425086975098, + "min_cosine_similarity": 0.880715548992157, + "mean_relative_l2": 0.1691112220287323, + "max_abs_delta": 4.375 + }, + "period_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.991897463798523, + "min_cosine_similarity": 0.9391651153564453, + "mean_relative_l2": 0.12132816016674042, + "max_abs_delta": 2.25 + }, + "period_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9842372536659241, + "min_cosine_similarity": 0.9071357846260071, + "mean_relative_l2": 0.1689172387123108, + "max_abs_delta": 4.5 + } + } + }, + "layer_21": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9c50ba90870180deb315646630e79679d994af77c4c2ffafec3d9586f542ec02", + "mean": -0.019701967015862465, + "std": 1.5594888925552368, + "rms": 1.5596133470535278, + "max_abs": 52.75 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "797123d686560789d77939ad3cf44965b6759a89f75d8efe93a9711c641fe3c6", + "mean": -0.026378119364380836, + "std": 7.309744834899902, + "rms": 7.3097920417785645, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d464a4ee8a6fd0301f09249dd005130cf55dd7472fbaefe82232c21cf1c911f1", + "mean": -0.02055787667632103, + "std": 1.5622005462646484, + "rms": 1.5623358488082886, + "max_abs": 52.25 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "15cd012884833720e104f256c10f80918d25898c0ca6eb9e6ac6f2bfaeae0adc", + "mean": -0.02669024094939232, + "std": 7.135456562042236, + "rms": 7.135506629943848, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ec3e9bddec8d3d75e76d370a73ee7e7a86ba0f881cd1015b5a4e8aed7b1e7a84", + "mean": -0.018928958103060722, + "std": 1.5680365562438965, + "rms": 1.5681507587432861, + "max_abs": 53.5 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "588dbe56a1cf7135ed60b93320f5721eb126e05b96fb0575a2acc914de2f494d", + "mean": -0.01768864132463932, + "std": 6.1951799392700195, + "rms": 6.195205211639404, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "57cc93af1e788949a871e8963abec0143c2eba893ea3b6efb535f747d9b42543", + "mean": -0.01894203945994377, + "std": 1.567179799079895, + "rms": 1.5672942399978638, + "max_abs": 53.5 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b3baffcd2360e98765f79e4f87e8bcb5929f2465705b882316346d3f2b736f8a", + "mean": -0.01693946309387684, + "std": 5.880422592163086, + "rms": 5.880446910858154, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b0b2ebac7c815a0a8336100cf0a678a88713780700a07897311471f9ed53bcef", + "mean": -0.01831328496336937, + "std": 1.5654451847076416, + "rms": 1.5655522346496582, + "max_abs": 51.0 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "07ac09f4689d7aa8472586be9150f92bf002e8f207181c74d9ad24a56cad3b19", + "mean": -0.01742786355316639, + "std": 6.195614337921143, + "rms": 6.195638656616211, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8cba98c74f1f64b5196ddfbaf774c9af01b263d14859a0ef6df0101d41b59753", + "mean": -0.019822057336568832, + "std": 1.564339518547058, + "rms": 1.564465045928955, + "max_abs": 48.5 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "36cd0809d7bbff810df73cd3b3eea5d0b4a4f5c31737f2919ee8b5998ead18d8", + "mean": -0.018003854900598526, + "std": 5.880865573883057, + "rms": 5.880893230438232, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "288457e720f0edfc730c3ff8d5cabc8faafe625c51fad4664c75815306cf5ce8", + "mean": -0.019244655966758728, + "std": 1.5631389617919922, + "rms": 1.5632574558258057, + "max_abs": 51.0 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7eb4e8deef9962a48700e85ed7d2f275a2d8dabcc413cbc8e8740708ca7ba997", + "mean": -0.017970312386751175, + "std": 6.1943511962890625, + "rms": 6.1943769454956055, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b9aa139320a98312d0eb1288e31127a1463739ea6318fde741e3cbe896f95a59", + "mean": -0.020821724086999893, + "std": 1.5604044198989868, + "rms": 1.5605432987213135, + "max_abs": 48.0 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "33c9c3d67dc3b5da9cfa756a68160baca37c941855e31df047ebe5f32e249f04", + "mean": -0.018608005717396736, + "std": 5.879360675811768, + "rms": 5.879389762878418, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.996186375617981, + "min_cosine_similarity": 0.9795420169830322, + "mean_relative_l2": 0.08246654272079468, + "max_abs_delta": 1.75 + }, + "system_bos": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9932109117507935, + "min_cosine_similarity": 0.9614323377609253, + "mean_relative_l2": 0.10990652441978455, + "max_abs_delta": 2.75 + }, + "system_x": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9859945178031921, + "min_cosine_similarity": 0.9397321939468384, + "mean_relative_l2": 0.16007840633392334, + "max_abs_delta": 3.75 + }, + "system_period": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9846076369285583, + "min_cosine_similarity": 0.9338674545288086, + "mean_relative_l2": 0.16751202940940857, + "max_abs_delta": 3.25 + }, + "bos_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9916022419929504, + "min_cosine_similarity": 0.8851878643035889, + "mean_relative_l2": 0.12002845108509064, + "max_abs_delta": 3.25 + }, + "bos_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9901674389839172, + "min_cosine_similarity": 0.8987550735473633, + "mean_relative_l2": 0.13307879865169525, + "max_abs_delta": 3.375 + }, + "x_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9903320074081421, + "min_cosine_similarity": 0.9013464450836182, + "mean_relative_l2": 0.13103912770748138, + "max_abs_delta": 2.875 + }, + "x_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9823949337005615, + "min_cosine_similarity": 0.8649215698242188, + "mean_relative_l2": 0.17758488655090332, + "max_abs_delta": 4.5 + }, + "period_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9912014007568359, + "min_cosine_similarity": 0.9273707866668701, + "mean_relative_l2": 0.12632286548614502, + "max_abs_delta": 2.75 + }, + "period_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9825854301452637, + "min_cosine_similarity": 0.8994073867797852, + "mean_relative_l2": 0.17814919352531433, + "max_abs_delta": 4.25 + } + } + }, + "layer_22": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "eb35ba3086ecfa41b32aac2a02d906558b3709aafccc6a50aa855c716a71fe5a", + "mean": -0.02802419103682041, + "std": 1.8098907470703125, + "rms": 1.810107707977295, + "max_abs": 70.0 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "303fbd92624b6b9fba1691260c7fc43e2064a301cb4dd188e4de600f728a32d2", + "mean": -0.033454395830631256, + "std": 7.361957550048828, + "rms": 7.362033843994141, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c2e58e82a6919d2728bc880b0d23e4d21d1d06225b58f121d4bfd954fc1b4a18", + "mean": -0.028435928747057915, + "std": 1.8139822483062744, + "rms": 1.8142051696777344, + "max_abs": 69.0 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "22f6c84e9a6004157ae31555264cd28d5eb0b4802cf76df352b86298f8c752ed", + "mean": -0.032900549471378326, + "std": 7.191290855407715, + "rms": 7.191366195678711, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "08de9a6fd2d8fc0e63947864e9381e55978a6e6864867559efac80ff1461e2b9", + "mean": -0.027663137763738632, + "std": 1.8197054862976074, + "rms": 1.819915771484375, + "max_abs": 71.0 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4d8045aed5d66606909e70759be9df183765e146738eb4a4bcc493d5787ba4eb", + "mean": -0.025178877636790276, + "std": 6.257797718048096, + "rms": 6.257848262786865, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3ed7ae0a191a04bcf37979d44dcabad761df59eda074e301ab5cebae727c44f5", + "mean": -0.02710416167974472, + "std": 1.8182072639465332, + "rms": 1.8184092044830322, + "max_abs": 70.5 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "972189b6e2a4b42a37cb65128325fbcfb5cadb6262c6b6b3faf4b3f9c6c90e7d", + "mean": -0.023336201906204224, + "std": 5.948661804199219, + "rms": 5.948707580566406, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2d49a7eb1ada6672ca1ee33de08eebe3cc20ac799372ef89676521214c00ede4", + "mean": -0.026558592915534973, + "std": 1.8141261339187622, + "rms": 1.81432044506073, + "max_abs": 68.0 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "603ef6bef9e142ccf0d0680e68d10a00497c6dc08f118892f4419dffa2c0f0be", + "mean": -0.02436046674847603, + "std": 6.257664203643799, + "rms": 6.257711887359619, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e08a59b1022e9b96fec44bbed402abd05a6b437c502815804dec5aabdbda0fd3", + "mean": -0.027848834171891212, + "std": 1.8161499500274658, + "rms": 1.8163634538650513, + "max_abs": 64.5 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e9ea75bbc7e352082bb3713a4ec261a0588f4930d558f2e30d1986db302f2423", + "mean": -0.024111559614539146, + "std": 5.949745178222656, + "rms": 5.949793338775635, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "28f5546249b05f66bad3d9fd66ea3cf79abf954d8376e11203537ee8a9cb2154", + "mean": -0.027552595362067223, + "std": 1.8107985258102417, + "rms": 1.8110082149505615, + "max_abs": 68.0 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "14d1d7167e37c55caa2fad96cde13c9b6b27fd535d1dc6e1459039b724235a3e", + "mean": -0.025095771998167038, + "std": 6.255931377410889, + "rms": 6.2559814453125, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d93f6c749cc10dde71e94d23ec92b65ce533747f3600d77f7765d5b76b3aa501", + "mean": -0.028978174552321434, + "std": 1.8104026317596436, + "rms": 1.8106346130371094, + "max_abs": 64.0 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f86e98e076995f2c197c833fa8f42cbda7fa7804b2110c4f385fcba9390274f0", + "mean": -0.024818535894155502, + "std": 5.947561264038086, + "rms": 5.947612762451172, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9961153268814087, + "min_cosine_similarity": 0.9792107939720154, + "mean_relative_l2": 0.08325718343257904, + "max_abs_delta": 2.0625 + }, + "system_bos": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9930847883224487, + "min_cosine_similarity": 0.9666670560836792, + "mean_relative_l2": 0.1108260303735733, + "max_abs_delta": 3.25 + }, + "system_x": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9859416484832764, + "min_cosine_similarity": 0.9463651180267334, + "mean_relative_l2": 0.16049824655056, + "max_abs_delta": 5.25 + }, + "system_period": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9844979047775269, + "min_cosine_similarity": 0.9338734149932861, + "mean_relative_l2": 0.16824458539485931, + "max_abs_delta": 4.5 + }, + "bos_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9914088249206543, + "min_cosine_similarity": 0.8882110714912415, + "mean_relative_l2": 0.12104206532239914, + "max_abs_delta": 4.5 + }, + "bos_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9900698661804199, + "min_cosine_similarity": 0.9019773602485657, + "mean_relative_l2": 0.13360022008419037, + "max_abs_delta": 5.25 + }, + "x_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9901754856109619, + "min_cosine_similarity": 0.9024501442909241, + "mean_relative_l2": 0.13156838715076447, + "max_abs_delta": 3.5 + }, + "x_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9823263883590698, + "min_cosine_similarity": 0.8649990558624268, + "mean_relative_l2": 0.17790468037128448, + "max_abs_delta": 6.25 + }, + "period_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9911506175994873, + "min_cosine_similarity": 0.9270023107528687, + "mean_relative_l2": 0.12612448632717133, + "max_abs_delta": 4.25 + }, + "period_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9826027750968933, + "min_cosine_similarity": 0.90034019947052, + "mean_relative_l2": 0.1783154308795929, + "max_abs_delta": 6.0 + } + } + }, + "layer_23": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "00be9576cb42901175d14e1bed7ac507cddf2d22587a83c77e65edc34a43af85", + "mean": -0.035699427127838135, + "std": 2.1930501461029053, + "rms": 2.193340539932251, + "max_abs": 90.0 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "037d288e65e06b6378009d99eefbfb98629886c75ecfca179a0981a4f68150e9", + "mean": -0.039802324026823044, + "std": 7.430131435394287, + "rms": 7.430237770080566, + "max_abs": 1160.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "37c2d6e123324bab0d605e6dcd92fed9c0e332680157e10e0d5540a5e30d945a", + "mean": -0.036287613213062286, + "std": 2.2042882442474365, + "rms": 2.2045867443084717, + "max_abs": 89.0 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "30f663892f41e76629d5defd6b06b63c63ae9eb0bf9509a6f4594bbb217d82bc", + "mean": -0.03785325586795807, + "std": 7.265896320343018, + "rms": 7.265994548797607, + "max_abs": 1160.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2da38a5869a683de73e9b374f550932fe1047423ad6846f9c3e65a69d6d05aeb", + "mean": -0.03588642179965973, + "std": 2.2061843872070312, + "rms": 2.2064762115478516, + "max_abs": 91.0 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9dbb3c8292aaacb8c71614c2a38c48e5f01e24a036712f1504805b145f46c880", + "mean": -0.0319436639547348, + "std": 6.348278999328613, + "rms": 6.348359107971191, + "max_abs": 1160.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "021d57def2363a5eaf9da0dd9a1bc206fd61a5529d9edb357e9d872c3275e03a", + "mean": -0.034877050668001175, + "std": 2.2022173404693604, + "rms": 2.20249342918396, + "max_abs": 90.0 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "181d1e0307095dd64404d34a9fa9fac6c868d8fd4218bddec8c290bd5ad4a14f", + "mean": -0.028152698650956154, + "std": 6.048316478729248, + "rms": 6.04838228225708, + "max_abs": 1160.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0228e018c6c8b9fcacb5f6e2a6aba19440a02b8df530f0eb51c6fc19a8d267d7", + "mean": -0.034013163298368454, + "std": 2.1944844722747803, + "rms": 2.1947481632232666, + "max_abs": 87.0 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e2cdbc95dfd4cc2f448498c900b525e934ed27c9dc6f62645e56de1995c90536", + "mean": -0.03038511425256729, + "std": 6.347356796264648, + "rms": 6.347429275512695, + "max_abs": 1160.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9014998bd00f4d0218fdbf08e11d3c73463d2f9ca91ef22b9525161d946d55d1", + "mean": -0.035458870232105255, + "std": 2.2049334049224854, + "rms": 2.20521879196167, + "max_abs": 87.0 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bb338c7b5601fc1b97217de0c24c1ea59d4d484d3f79a27572b6e9c61a5a4cbd", + "mean": -0.029017813503742218, + "std": 6.0522918701171875, + "rms": 6.052361488342285, + "max_abs": 1160.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2444922c565201d6346a0737f4fc732fb138922805128236bf09481be4e1e387", + "mean": -0.03532535582780838, + "std": 2.1881930828094482, + "rms": 2.1884782314300537, + "max_abs": 87.0 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a40be97ea2600c8337fc52819e3f659991622c28c8bf8304d5c7bc7a30854b6d", + "mean": -0.03160236030817032, + "std": 6.343695640563965, + "rms": 6.343774318695068, + "max_abs": 1160.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b62b33c79a74ea4771f25d1acb08c214f53e6e323541909371ced8fe35a986d6", + "mean": -0.03690863028168678, + "std": 2.198089599609375, + "rms": 2.198399305343628, + "max_abs": 87.0 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "dc40bab2164af0fb7588151707d606d1dfb909d73d94027bfeaa38f10ded73a0", + "mean": -0.030113911256194115, + "std": 6.048816204071045, + "rms": 6.048891067504883, + "max_abs": 1160.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.996443510055542, + "min_cosine_similarity": 0.9779228568077087, + "mean_relative_l2": 0.07981536537408829, + "max_abs_delta": 3.25 + }, + "system_bos": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9916804432868958, + "min_cosine_similarity": 0.7494205236434937, + "mean_relative_l2": 0.10960721224546432, + "max_abs_delta": 7.94140625 + }, + "system_x": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9872086048126221, + "min_cosine_similarity": 0.9381478428840637, + "mean_relative_l2": 0.1528700441122055, + "max_abs_delta": 7.5 + }, + "system_period": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9859322905540466, + "min_cosine_similarity": 0.9146924018859863, + "mean_relative_l2": 0.16019432246685028, + "max_abs_delta": 6.0 + }, + "bos_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9890386462211609, + "min_cosine_similarity": 0.5948775410652161, + "mean_relative_l2": 0.12327371537685394, + "max_abs_delta": 9.8125 + }, + "bos_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9910528063774109, + "min_cosine_similarity": 0.9163330793380737, + "mean_relative_l2": 0.1263757199048996, + "max_abs_delta": 7.5 + }, + "x_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9911704659461975, + "min_cosine_similarity": 0.9197101593017578, + "mean_relative_l2": 0.1243780329823494, + "max_abs_delta": 5.0 + }, + "x_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9841524362564087, + "min_cosine_similarity": 0.8893861174583435, + "mean_relative_l2": 0.16820377111434937, + "max_abs_delta": 8.0 + }, + "period_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9921171069145203, + "min_cosine_similarity": 0.939386248588562, + "mean_relative_l2": 0.11889084428548813, + "max_abs_delta": 5.5 + }, + "period_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9843916296958923, + "min_cosine_similarity": 0.9163578748703003, + "mean_relative_l2": 0.16848134994506836, + "max_abs_delta": 8.0 + } + } + }, + "layer_24": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a5cad7808b47bf99801ad7da26e037962726a2d09d43ec29801ebabbf714f2d5", + "mean": -0.047737445682287216, + "std": 4.3528852462768555, + "rms": 4.353146553039551, + "max_abs": 544.0 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "11df0c5af806294c9ddf42ed2987f6f70ebe5299c525c132d1ceebe7579df540", + "mean": -0.05078449100255966, + "std": 7.780366897583008, + "rms": 7.7805328369140625, + "max_abs": 1008.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1e14b9d8022b01e4bcda7348181c7fab62e8123d5558ef05ed209231e9497c0c", + "mean": -0.04791897535324097, + "std": 4.30634880065918, + "rms": 4.306615352630615, + "max_abs": 532.0 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "009082c76435f119495ca46505182c8ec35be9fb799ef1b714a86c0870a8c8f4", + "mean": -0.047168850898742676, + "std": 7.734245300292969, + "rms": 7.734388828277588, + "max_abs": 1120.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fb27874c79cc370d006bec05a3221dda8c60185a5f8bb5720810c6ad76f446a5", + "mean": -0.047552842646837234, + "std": 4.457462310791016, + "rms": 4.45771598815918, + "max_abs": 544.0 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "51e5ece8ea3793c4cc95a55f6b78af5fc93cfd480b32f3790ca32782780b258d", + "mean": -0.04157073423266411, + "std": 5.7931413650512695, + "rms": 5.793290615081787, + "max_abs": 840.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "beb82f9dd94cc9c3789c49a9e46044d23a4304ea5bd4877deda71920804a6eb1", + "mean": -0.045800644904375076, + "std": 4.306339263916016, + "rms": 4.306582927703857, + "max_abs": 532.0 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "db7c604bdfaea714dbec5d9bffcabbe78717d6b5b5ffa021453221f339010f08", + "mean": -0.03603067249059677, + "std": 5.471087455749512, + "rms": 5.471206188201904, + "max_abs": 840.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4ed078cac175a40519cb3d266d8bff0ed0787d7b3cd4eaecbe7db0772bd965dd", + "mean": -0.044987887144088745, + "std": 4.380701065063477, + "rms": 4.380931854248047, + "max_abs": 552.0 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1e4efa13da45b9c1f700869f709a51a4b6a07017c7e7d8b5cdd05fc2321d2b69", + "mean": -0.03958379849791527, + "std": 5.748540878295898, + "rms": 5.7486772537231445, + "max_abs": 840.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f89891215aec5648047ebe30e689741e1d44d7fca7a46ae0213dc82575ed092e", + "mean": -0.04613427445292473, + "std": 4.320428848266602, + "rms": 4.320674896240234, + "max_abs": 536.0 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "38792070e8ae34802f28e853129724fa9db1335f0fbf30c97d91e8b7e6ba0e1b", + "mean": -0.03694961220026016, + "std": 5.4844560623168945, + "rms": 5.484580039978027, + "max_abs": 840.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "249f57a1ffbbb8898c887391b2f01f8b560f21f7d68d87e0c98cb94227f7001a", + "mean": -0.0464622899889946, + "std": 4.3760528564453125, + "rms": 4.376299858093262, + "max_abs": 552.0 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3ed002f9103771f7b39dcb2be23a0058e6f08fa7f408bdf17fe101f400b839cb", + "mean": -0.04077095910906792, + "std": 5.743256092071533, + "rms": 5.743400573730469, + "max_abs": 840.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "517f7d4dd8606cdc7fcc45c74a7eabd6ae6844ca056581f41784bf2948abbe02", + "mean": -0.04738312587141991, + "std": 4.303414821624756, + "rms": 4.303675174713135, + "max_abs": 532.0 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b33b81b82e6a2343dd64223d4e0a4fe848057b5a4dd267512ecee7a1e3d210ec", + "mean": -0.037691108882427216, + "std": 5.472176551818848, + "rms": 5.472306251525879, + "max_abs": 840.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9970229864120483, + "min_cosine_similarity": 0.9832577109336853, + "mean_relative_l2": 0.07280184328556061, + "max_abs_delta": 12.0 + }, + "system_bos": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9879795908927917, + "min_cosine_similarity": 0.2779192626476288, + "mean_relative_l2": 0.126705139875412, + "max_abs_delta": 536.9375 + }, + "system_x": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9877621531486511, + "min_cosine_similarity": 0.7974647879600525, + "mean_relative_l2": 0.14456374943256378, + "max_abs_delta": 20.265625 + }, + "system_period": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9856801629066467, + "min_cosine_similarity": 0.647202730178833, + "mean_relative_l2": 0.15368202328681946, + "max_abs_delta": 31.6015625 + }, + "bos_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9852491617202759, + "min_cosine_similarity": 0.09400931000709534, + "mean_relative_l2": 0.289397269487381, + "max_abs_delta": 542.53125 + }, + "bos_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9921980500221252, + "min_cosine_similarity": 0.9369434118270874, + "mean_relative_l2": 0.1171364039182663, + "max_abs_delta": 8.5 + }, + "x_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9924269318580627, + "min_cosine_similarity": 0.9387621283531189, + "mean_relative_l2": 0.11437739431858063, + "max_abs_delta": 8.0 + }, + "x_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9850351214408875, + "min_cosine_similarity": 0.7854456901550293, + "mean_relative_l2": 0.15945737063884735, + "max_abs_delta": 20.3203125 + }, + "period_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9932123422622681, + "min_cosine_similarity": 0.9524458050727844, + "mean_relative_l2": 0.10948647558689117, + "max_abs_delta": 8.0 + }, + "period_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9842430949211121, + "min_cosine_similarity": 0.6483789086341858, + "mean_relative_l2": 0.1620362251996994, + "max_abs_delta": 31.4453125 + } + } + }, + "layer_25": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0c4823efbcfbd0c84cc761f86ece3c247ac78d24232f2d9f57e88f93565e6502", + "mean": -0.07854839414358139, + "std": 4.898215293884277, + "rms": 4.898845195770264, + "max_abs": 548.0 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c32818e4b188c67c87cbdc28f84d0ef8faaee14f4025baf5d4dc041d1fd80c40", + "mean": -0.07891132682561874, + "std": 6.700925827026367, + "rms": 6.701390266418457, + "max_abs": 872.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6ed80072a0a56f9d2611338e8d78f7f08c9edfcb4cb4e984a3b679905c76f3a0", + "mean": -0.07710490375757217, + "std": 4.864954948425293, + "rms": 4.865565776824951, + "max_abs": 536.0 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "49d5e3419ab105d88bd77f4f595589e3b32bb478bbbe5adc39cebb803b728627", + "mean": -0.07228472083806992, + "std": 6.76425313949585, + "rms": 6.764639854431152, + "max_abs": 984.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d089c80a2a9692bdfcfd9e5fb1f17fa6937f90e9e8d26f9c1a139b37aab9a4e4", + "mean": -0.07824323326349258, + "std": 5.00306510925293, + "rms": 5.003676891326904, + "max_abs": 548.0 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "26cd70a3f668ce371b598427d016e2f9753fb273c06b6b360ffeeccb089d9c6d", + "mean": -0.06897006183862686, + "std": 4.875951766967773, + "rms": 4.876439571380615, + "max_abs": 548.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "37ad5d5f2bf2a0d49769aee958cab16e156cfc0391407014d6f30f4a9c0bf9a4", + "mean": -0.07603790611028671, + "std": 4.867063999176025, + "rms": 4.867657661437988, + "max_abs": 536.0 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7e9880388460f6e5e1e199b5376039f95506b780ae12a34cc90d9ad02fa2eb07", + "mean": -0.061283841729164124, + "std": 4.664547443389893, + "rms": 4.664950370788574, + "max_abs": 536.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2101867bb6986bd8ce92b37a40b3bb8c2d70cfdb6763f2263c1d5262d9314b02", + "mean": -0.07514001429080963, + "std": 4.924431800842285, + "rms": 4.9250054359436035, + "max_abs": 556.0 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "40ed2ae879257b4e3a27f24801d7658070816b68308c144bcb825eb1877cc23e", + "mean": -0.06695438921451569, + "std": 4.818663597106934, + "rms": 4.819128513336182, + "max_abs": 556.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "875597b3e562184bd10c2c6fd632a4f62689647522367da525e0e83e936b5eff", + "mean": -0.07370245456695557, + "std": 4.87979793548584, + "rms": 4.880354881286621, + "max_abs": 540.0 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f015bf7da76e418cd75a0e095a900657c3505f10c427d68b350a3268ce2199dd", + "mean": -0.059993185102939606, + "std": 4.685618877410889, + "rms": 4.6860032081604, + "max_abs": 540.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d3a17b8a59304484a007ecfd4cc18fdaea1c94626fd358e4dbdc002ae411cb0f", + "mean": -0.07778959721326828, + "std": 4.922356605529785, + "rms": 4.922970771789551, + "max_abs": 556.0 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "60ffad79aae4e61051403928c06bc7c5d3685a3a40778e9e4b0963f9ceea6738", + "mean": -0.06891989707946777, + "std": 4.811600208282471, + "rms": 4.812093734741211, + "max_abs": 556.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "65cf3a324714b27c726f10a3ec6bb46dd529d6ea2927f8d6c97f27a1e28a5662", + "mean": -0.07562432438135147, + "std": 4.858972072601318, + "rms": 4.859560489654541, + "max_abs": 536.0 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "42baee9bafe395d9ea6ce2d42f171bb597a989ab5d2fc07f0f60f59d3977c5d4", + "mean": -0.061183422803878784, + "std": 4.664764404296875, + "rms": 4.665165901184082, + "max_abs": 536.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9976603984832764, + "min_cosine_similarity": 0.987959623336792, + "mean_relative_l2": 0.0652039498090744, + "max_abs_delta": 12.0 + }, + "system_bos": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9882203340530396, + "min_cosine_similarity": 0.1910419762134552, + "mean_relative_l2": 0.1148790717124939, + "max_abs_delta": 542.34375 + }, + "system_x": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9904977083206177, + "min_cosine_similarity": 0.8815234899520874, + "mean_relative_l2": 0.1296372264623642, + "max_abs_delta": 21.64453125 + }, + "system_period": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9890085458755493, + "min_cosine_similarity": 0.7626643776893616, + "mean_relative_l2": 0.13601279258728027, + "max_abs_delta": 33.83203125 + }, + "bos_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.986666738986969, + "min_cosine_similarity": 0.10051020979881287, + "mean_relative_l2": 0.20894944667816162, + "max_abs_delta": 547.6875 + }, + "bos_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9941928386688232, + "min_cosine_similarity": 0.9575831890106201, + "mean_relative_l2": 0.10219673812389374, + "max_abs_delta": 10.0 + }, + "x_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9941614270210266, + "min_cosine_similarity": 0.9584795236587524, + "mean_relative_l2": 0.0999574214220047, + "max_abs_delta": 8.25 + }, + "x_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9885734915733337, + "min_cosine_similarity": 0.8775192499160767, + "mean_relative_l2": 0.1412428617477417, + "max_abs_delta": 21.6953125 + }, + "period_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9947760701179504, + "min_cosine_similarity": 0.9674731492996216, + "mean_relative_l2": 0.09562500566244125, + "max_abs_delta": 8.0 + }, + "period_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9881600141525269, + "min_cosine_similarity": 0.7637943625450134, + "mean_relative_l2": 0.14112012088298798, + "max_abs_delta": 33.6953125 + } + } + }, + "layer_26": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "022b0ebd062d9659cf39a8fc444cd62e5d4af6b439dcc86c83ae298145a2d6cc", + "mean": -0.11754771322011948, + "std": 3.7796082496643066, + "rms": 3.781435489654541, + "max_abs": 292.0 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b69dc68d9dd7dc10da4a5536a97d563c3d6a69d60a4ec3f8b0721a5fb660aaa6", + "mean": -0.11784318834543228, + "std": 6.111133098602295, + "rms": 6.112269401550293, + "max_abs": 840.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fca1fb1e23f65e9972b1e78e485e43cc3fc65a983daea5c7ccaf89ca01acba34", + "mean": -0.11257413774728775, + "std": 3.7401299476623535, + "rms": 3.741823673248291, + "max_abs": 276.0 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "48acfa42ed6b130dd9926ccfb1847ffbf193939ea09f7a1d35e342e4c12cdaf5", + "mean": -0.10084252804517746, + "std": 6.307148456573486, + "rms": 6.307954788208008, + "max_abs": 872.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a3d0fe5fa24b3fbbf2f654d324fa8cea3cdbe81c32cc24fb53f6eb070cf30470", + "mean": -0.11627980321645737, + "std": 3.801626205444336, + "rms": 3.8034040927886963, + "max_abs": 300.0 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c74f6dbfa87f4951692a5e32135199b81903ae6a6e3d0bdf1433cfc41dd2ea22", + "mean": -0.10517682135105133, + "std": 4.357218265533447, + "rms": 4.358487606048584, + "max_abs": 768.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c116c3fd283b6bad71635d1f86b05cc37f47e96371c4f56935b8f9b101a9d77e", + "mean": -0.11177762597799301, + "std": 3.7658777236938477, + "rms": 3.767536163330078, + "max_abs": 300.0 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6500cf20b8ed04431eff5b4594a797c8f50173849f89904955a201268143f22c", + "mean": -0.08873739838600159, + "std": 4.453985214233398, + "rms": 4.454868793487549, + "max_abs": 768.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "745a6496d8f661e5e3ce43f952532c53b3b1dff8d44432c642de61adf72bd845", + "mean": -0.11389226466417313, + "std": 3.805082321166992, + "rms": 3.80678653717041, + "max_abs": 274.0 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ba60ec44290cf49ef20e62ad4bce3f15f98519d572482d43435fde6a9cb63233", + "mean": -0.10429387539625168, + "std": 4.373155117034912, + "rms": 4.374398708343506, + "max_abs": 768.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7f57b6efc9b58c769ca797279ebbfcbfb2858a56719b271c3677a712f0c3bc34", + "mean": -0.10504551231861115, + "std": 3.741670608520508, + "rms": 3.7431447505950928, + "max_abs": 222.0 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fcd53c8c101de1cbd227c7c1484c5c51201b808dadeadc431f3fad9268cb570d", + "mean": -0.08370555192232132, + "std": 4.447371006011963, + "rms": 4.448158264160156, + "max_abs": 768.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "16e9c90cb63611f977d896e4dec2772fcc55593b664468149e1ac7515650bd55", + "mean": -0.11637266725301743, + "std": 3.782198190689087, + "rms": 3.7839879989624023, + "max_abs": 268.0 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7ded9efc3035ed1653cbd1fa41a9e1c76c7d70a1cdff0a86f575df363c66240a", + "mean": -0.10591582953929901, + "std": 4.341578006744385, + "rms": 4.342869758605957, + "max_abs": 768.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bb8bb655ee748fb683f77bc08a0040e85d167718812b6ec7fd0d616f1bf6daa2", + "mean": -0.1051512286067009, + "std": 3.649883508682251, + "rms": 3.651397943496704, + "max_abs": 211.0 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6534e5888458b95a6186e8addeff8a5bec911bf5e3d8f5706bf073605e74b3ca", + "mean": -0.08372847735881805, + "std": 4.378088474273682, + "rms": 4.378889083862305, + "max_abs": 768.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9967420697212219, + "min_cosine_similarity": 0.9813876152038574, + "mean_relative_l2": 0.07858797907829285, + "max_abs_delta": 16.0 + }, + "system_bos": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9884387254714966, + "min_cosine_similarity": 0.6793320775032043, + "mean_relative_l2": 0.11741674691438675, + "max_abs_delta": 40.0 + }, + "system_x": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9850279092788696, + "min_cosine_similarity": 0.8989631533622742, + "mean_relative_l2": 0.16809670627117157, + "max_abs_delta": 52.0 + }, + "system_period": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9842096567153931, + "min_cosine_similarity": 0.8585271239280701, + "mean_relative_l2": 0.1726963222026825, + "max_abs_delta": 57.0 + }, + "bos_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9876506328582764, + "min_cosine_similarity": 0.6543735861778259, + "mean_relative_l2": 0.11975479125976562, + "max_abs_delta": 39.0 + }, + "bos_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9922128915786743, + "min_cosine_similarity": 0.9563272595405579, + "mean_relative_l2": 0.12074700742959976, + "max_abs_delta": 31.5 + }, + "x_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9925398230552673, + "min_cosine_similarity": 0.941789448261261, + "mean_relative_l2": 0.1141623929142952, + "max_abs_delta": 19.0 + }, + "x_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9828919172286987, + "min_cosine_similarity": 0.915803849697113, + "mean_relative_l2": 0.1805131435394287, + "max_abs_delta": 54.0 + }, + "period_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9933307766914368, + "min_cosine_similarity": 0.9599606990814209, + "mean_relative_l2": 0.10898343473672867, + "max_abs_delta": 24.0 + }, + "period_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9841140508651733, + "min_cosine_similarity": 0.8535122871398926, + "mean_relative_l2": 0.17175793647766113, + "max_abs_delta": 65.0 + } + } + }, + "final_norm": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f1ba0f1903d5aceda141fecfa97c78cd9f210d250403d4f04ab6d032c8324828", + "mean": -0.02115202136337757, + "std": 0.6914010643959045, + "rms": 0.6917245388031006, + "max_abs": 19.125 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0cd4841c1380aa97ec7cf712863746649b610d9de05057a37877a39a1beecd41", + "mean": -0.018728071823716164, + "std": 0.6751999258995056, + "rms": 0.6754595637321472, + "max_abs": 19.125 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b4d0f1cba4d20032e44e05d2c2471502f5f21be14bd6d1dbe60d3d0241d5f509", + "mean": -0.020380960777401924, + "std": 0.687268078327179, + "rms": 0.6875702142715454, + "max_abs": 19.25 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d026d47f1838c46788d7abc4fd049007943bcd0ea24e9d2d99f0f1d96c75f741", + "mean": -0.015555482357740402, + "std": 0.6539818048477173, + "rms": 0.6541667580604553, + "max_abs": 19.25 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8ae0c8bbff80c894a9a765cd8f8fc0044ad9b6b9d02dcf4aeba9934c31cfc840", + "mean": -0.020871499553322792, + "std": 0.6958492398262024, + "rms": 0.696162223815918, + "max_abs": 19.375 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d44e31ded12544742c1799d39b8270e6cc199e1d794181b4dbed88d907ce5b04", + "mean": -0.018223466351628304, + "std": 0.6784814596176147, + "rms": 0.6787261366844177, + "max_abs": 20.375 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0d8e4a298118b6de972540cf1a1b9c1a0abc8c4a55d3824b51d10faba51755d3", + "mean": -0.020113689824938774, + "std": 0.6903103590011597, + "rms": 0.6906033158302307, + "max_abs": 19.375 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "01546bda21dd69ea4a800c7d04c083e9e1723d66a03fd0192f63b029db510b61", + "mean": -0.015165945515036583, + "std": 0.656859278678894, + "rms": 0.6570343375205994, + "max_abs": 19.375 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8a26a2326a3d440426eada07823e5c6cfca4fc0c17968fed80822ac4497e1b70", + "mean": -0.019925175234675407, + "std": 0.6819267868995667, + "rms": 0.6822177767753601, + "max_abs": 18.875 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2d45fe526c555619525975cdf80f2ae0a4a4b79a2777841f936963bbb4683b1e", + "mean": -0.017576711252331734, + "std": 0.6649170517921448, + "rms": 0.6651493310928345, + "max_abs": 18.875 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6040333074cb5063aef7be4982543c4fe92b66f2e038a0f39704b27dda035470", + "mean": -0.01824580691754818, + "std": 0.6619762778282166, + "rms": 0.6622276306152344, + "max_abs": 19.5 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e1163c78fc29122a4abf6d3792f4ef53c59a588fe77710641f2a3828888faf08", + "mean": -0.013770660385489464, + "std": 0.6326709389686584, + "rms": 0.6328208446502686, + "max_abs": 19.5 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d65a3626bca2029c399457d5619c94e717b303d38f447ee1892bdfa69a2aa3b1", + "mean": -0.02075923979282379, + "std": 0.6906752586364746, + "rms": 0.6909871697425842, + "max_abs": 19.125 + }, + "full_input": { + "shape": [ + 138, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e870a03e9eb29b6151163c55fff7630e4ba8e82c7d37db8d948ba543291615a8", + "mean": -0.018316633999347687, + "std": 0.6744245886802673, + "rms": 0.6746732592582703, + "max_abs": 19.125 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 113, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "21666d9c580a559f3a085f99b75e7bc36eed42704984041481eb23b0ea4c263b", + "mean": -0.019020913168787956, + "std": 0.6757084727287292, + "rms": 0.6759760975837708, + "max_abs": 19.25 + }, + "full_input": { + "shape": [ + 154, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a3f3599da0939a77a8e9bfd31132c15841452feafb8b04a6b567a4b9da7f6a4b", + "mean": -0.014406450092792511, + "std": 0.6454811096191406, + "rms": 0.6456418633460999, + "max_abs": 19.625 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9964771270751953, + "min_cosine_similarity": 0.9816595315933228, + "mean_relative_l2": 0.07881716638803482, + "max_abs_delta": 2.359375 + }, + "system_bos": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.985511064529419, + "min_cosine_similarity": 0.48463115096092224, + "mean_relative_l2": 0.11758219450712204, + "max_abs_delta": 4.375 + }, + "system_x": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9840049147605896, + "min_cosine_similarity": 0.8626371026039124, + "mean_relative_l2": 0.16604167222976685, + "max_abs_delta": 4.7578125 + }, + "system_period": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9833887219429016, + "min_cosine_similarity": 0.7544017434120178, + "mean_relative_l2": 0.1699935495853424, + "max_abs_delta": 4.25 + }, + "bos_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9845415353775024, + "min_cosine_similarity": 0.451196551322937, + "mean_relative_l2": 0.12244438380002975, + "max_abs_delta": 4.671875 + }, + "bos_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9918462634086609, + "min_cosine_similarity": 0.9655454158782959, + "mean_relative_l2": 0.121504046022892, + "max_abs_delta": 2.40625 + }, + "x_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9920994639396667, + "min_cosine_similarity": 0.9518811702728271, + "mean_relative_l2": 0.11726148426532745, + "max_abs_delta": 2.65625 + }, + "x_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9812418818473816, + "min_cosine_similarity": 0.8399401307106018, + "mean_relative_l2": 0.18315312266349792, + "max_abs_delta": 4.1640625 + }, + "period_at_s0": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9930456876754761, + "min_cosine_similarity": 0.9649147391319275, + "mean_relative_l2": 0.110467329621315, + "max_abs_delta": 1.84375 + }, + "period_at_s1": { + "tokens": 113, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9828068614006042, + "min_cosine_similarity": 0.742523193359375, + "mean_relative_l2": 0.1738423854112625, + "max_abs_delta": 4.18359375 + } + } + } + }, + "router_layers": { + "layer_01": { + "layer": 1, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "9f92d443785fff2792412dd51ff8da1294d00a9f326fca199656d3d76b4a16da", + "route_weight_sha256": "fe8d48295271716fd7b9cba7bddff54deef82defc307a7fae6b25d0847c2e673", + "loads": [ + 8, + 12, + 15, + 15, + 9, + 10, + 6, + 13, + 22, + 3, + 15, + 7, + 6, + 27, + 8, + 6, + 2, + 1, + 20, + 8, + 0, + 8, + 7, + 12, + 17, + 16, + 15, + 10, + 16, + 15, + 12, + 8, + 0, + 1, + 9, + 12, + 4, + 18, + 11, + 11, + 18, + 8, + 8, + 9, + 14, + 8, + 13, + 10, + 10, + 14, + 3, + 7, + 7, + 18, + 23, + 16, + 6, + 4, + 17, + 12, + 9, + 12, + 6, + 11 + ], + "weighted_loads": [ + 0.4310906697064638, + 0.49878833815455437, + 0.9792825058102608, + 1.461191687732935, + 0.5227417442947626, + 0.786855760961771, + 0.2442566156387329, + 0.831889258697629, + 0.9376737251877785, + 0.12043197080492973, + 1.0711841154843569, + 0.48097066208720207, + 0.18098467588424683, + 1.582610983401537, + 0.6380659881979227, + 0.3874790892004967, + 0.05594553053379059, + 0.02781652845442295, + 1.159206073731184, + 0.5811289139091969, + 0.0, + 0.8238248974084854, + 0.3657431975007057, + 0.7740329205989838, + 1.1733825840055943, + 1.1594135351479053, + 0.4709204602986574, + 0.49300768598914146, + 0.856335585936904, + 1.0668931603431702, + 0.8872846476733685, + 0.45299815759062767, + 0.0, + 0.0277322456240654, + 0.4471137523651123, + 0.5212863963097334, + 0.24275343865156174, + 1.3774929568171501, + 0.8147946782410145, + 0.8284859135746956, + 1.1637447942048311, + 0.6557619273662567, + 0.8242757990956306, + 0.6006031651049852, + 0.8540051523596048, + 0.33996752835810184, + 1.037992212921381, + 0.5602144151926041, + 0.36273693293333054, + 0.6305986978113651, + 0.10242769680917263, + 0.6496144980192184, + 0.6032258123159409, + 0.6785713899880648, + 1.6229120716452599, + 0.6788872051984072, + 0.19722753018140793, + 0.15219096653163433, + 0.7154896836727858, + 0.6702961549162865, + 0.7582856137305498, + 1.0926156416535378, + 0.30801542289555073, + 0.5692898854613304 + ], + "unique_experts": 62, + "load_cv": 0.5312929225741313, + "normalized_load_entropy": 0.961847236959854, + "max_load_share": 0.03982300884955752 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "3dfaf0c510b2b13459546ab5f3f1252aedc1a8e1427c4261a7b66c9cdd5f993c", + "route_weight_sha256": "4f471a7980d49dc3316cf0c699b39cbaf6bba186694d5477f056dafd1db4e737", + "loads": [ + 9, + 12, + 17, + 15, + 13, + 11, + 7, + 15, + 39, + 3, + 17, + 9, + 6, + 27, + 8, + 15, + 2, + 2, + 20, + 8, + 3, + 8, + 8, + 12, + 17, + 20, + 28, + 10, + 16, + 15, + 12, + 13, + 2, + 3, + 9, + 12, + 4, + 18, + 11, + 14, + 19, + 18, + 8, + 14, + 15, + 19, + 14, + 10, + 11, + 14, + 7, + 8, + 11, + 18, + 26, + 20, + 9, + 12, + 19, + 23, + 10, + 16, + 6, + 11 + ], + "weighted_loads": [ + 0.5101463887840509, + 0.49878833815455437, + 1.081498745828867, + 1.461191687732935, + 0.6786534916609526, + 0.8184053227305412, + 0.3060809075832367, + 1.0994584877043962, + 1.8800595477223396, + 0.12043197080492973, + 1.3425502721220255, + 0.5366910044103861, + 0.18098467588424683, + 1.582610983401537, + 0.6380659881979227, + 1.00511659309268, + 0.05594553053379059, + 0.09927813895046711, + 1.159206073731184, + 0.5811289139091969, + 0.358273983001709, + 0.8238248974084854, + 0.3958726543933153, + 0.7740329205989838, + 1.1733825840055943, + 1.3304713666439056, + 1.281051630154252, + 0.49300768598914146, + 0.856335585936904, + 1.0668931603431702, + 0.8872846476733685, + 0.8353116193320602, + 0.09308639168739319, + 0.2102363407611847, + 0.4471137523651123, + 0.5212863963097334, + 0.24275343865156174, + 1.3774929568171501, + 0.8147946782410145, + 1.0609317608177662, + 1.2075622249394655, + 1.0690368823707104, + 0.8242757990956306, + 0.7101400145329535, + 1.8384117428213358, + 1.16094288835302, + 1.1223372481763363, + 0.5602144151926041, + 0.407622579485178, + 0.6305986978113651, + 0.2145108189433813, + 0.6502195622306317, + 0.8829199708998203, + 0.6785713899880648, + 1.6683343876502477, + 1.2077601719647646, + 0.4746612273156643, + 0.6290383469313383, + 0.762040575966239, + 1.3876002095639706, + 0.8492099959403276, + 1.3116969801485538, + 0.30801542289555073, + 0.5692898854613304 + ], + "unique_experts": 64, + "load_cv": 0.5261710139880056, + "normalized_load_entropy": 0.9669046358549277, + "max_load_share": 0.04710144927536232 + } + }, + "s1_eos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "6552d828c12b2a0a7f05f0e7da91a6d005d2d04545b3b2f0423100e509bff9e5", + "route_weight_sha256": "1a54da03cf25091a6374c669445c6d5a0519eb7e5da75aa833d756b9cc40b7ea", + "loads": [ + 9, + 14, + 15, + 15, + 8, + 10, + 5, + 11, + 20, + 3, + 15, + 8, + 6, + 27, + 9, + 6, + 2, + 1, + 20, + 8, + 0, + 8, + 8, + 12, + 17, + 16, + 13, + 10, + 16, + 15, + 12, + 8, + 0, + 1, + 9, + 12, + 3, + 18, + 11, + 12, + 17, + 8, + 8, + 9, + 16, + 8, + 13, + 10, + 10, + 14, + 3, + 7, + 7, + 17, + 23, + 16, + 5, + 4, + 17, + 13, + 11, + 13, + 6, + 10 + ], + "weighted_loads": [ + 0.4575401321053505, + 0.5530715938657522, + 0.9759455434978008, + 1.4764769189059734, + 0.48976703360676765, + 0.7946233972907066, + 0.20834205485880375, + 0.7816475611180067, + 0.8445519786328077, + 0.1209307387471199, + 1.0688425973057747, + 0.5184651780873537, + 0.17678910493850708, + 1.5833231508731842, + 0.6524205077439547, + 0.3885685633867979, + 0.05647804215550423, + 0.026249190792441368, + 1.1678046062588692, + 0.582488588988781, + 0.0, + 0.8195468075573444, + 0.39579480327665806, + 0.7798003256320953, + 1.1352984700351954, + 1.147726520895958, + 0.41617592982947826, + 0.47637538611888885, + 0.8641138467937708, + 1.0821937043219805, + 0.8954988904297352, + 0.44438471272587776, + 0.0, + 0.025435710325837135, + 0.44917857833206654, + 0.5125812273472548, + 0.20894897356629372, + 1.3730754870921373, + 0.8164026793092489, + 0.8422418218106031, + 1.1107171531766653, + 0.6623454391956329, + 0.8211002834141254, + 0.5943368375301361, + 0.9110684804618359, + 0.33759346418082714, + 1.037424761801958, + 0.5759780667722225, + 0.3609323054552078, + 0.641106866300106, + 0.10348146222531796, + 0.6521870270371437, + 0.6121897660195827, + 0.6582686342298985, + 1.6333387047052383, + 0.6811371631920338, + 0.17330152168869972, + 0.16075166314840317, + 0.7238342110067606, + 0.6921763084828854, + 0.8106515649706125, + 1.1169063299894333, + 0.31571088917553425, + 0.5465519428253174 + ], + "unique_experts": 62, + "load_cv": 0.5265548696990368, + "normalized_load_entropy": 0.9619388281493825, + "max_load_share": 0.03982300884955752 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "20618d60a687f236bf60495fc9d9a07a1943c136c9f125912dcb8d8bfffb9f7c", + "route_weight_sha256": "d43e81d149d7f1bb0c1551673c8b021b43f574c042efd3b15071e04fc92cb02b", + "loads": [ + 12, + 14, + 18, + 15, + 15, + 13, + 6, + 14, + 43, + 3, + 20, + 11, + 6, + 28, + 9, + 18, + 2, + 6, + 21, + 9, + 3, + 10, + 13, + 13, + 19, + 21, + 32, + 11, + 16, + 17, + 13, + 15, + 2, + 3, + 9, + 12, + 4, + 19, + 11, + 17, + 18, + 20, + 11, + 15, + 18, + 19, + 14, + 14, + 13, + 14, + 12, + 11, + 12, + 17, + 28, + 20, + 14, + 16, + 20, + 24, + 13, + 18, + 6, + 14 + ], + "weighted_loads": [ + 0.6394137293100357, + 0.5530715938657522, + 1.1423093639314175, + 1.4764769189059734, + 0.881378723308444, + 0.9615719020366669, + 0.25366939045488834, + 1.019009618088603, + 2.193310659378767, + 0.1209307387471199, + 1.5296629928052425, + 0.7260848563164473, + 0.17678910493850708, + 1.6233634538948536, + 0.6524205077439547, + 1.091652175411582, + 0.05647804215550423, + 0.22789298556745052, + 1.2068871594965458, + 0.6485559344291687, + 0.29438310861587524, + 1.0246771834790707, + 0.6671482989622746, + 0.8141419477760792, + 1.2071190234273672, + 1.3441898133605719, + 1.6928076203912497, + 0.5185502804815769, + 0.8641138467937708, + 1.244247054681182, + 0.9817571006715298, + 1.0553124813304748, + 0.081205103546381, + 0.166266156360507, + 0.44917857833206654, + 0.5125812273472548, + 0.4680723287165165, + 1.4067352581769228, + 0.8164026793092489, + 1.1929765846580267, + 1.1554132010787725, + 1.2363913971930742, + 1.0287069045007229, + 0.7921143267303705, + 2.0521134547889233, + 1.1066465635376517, + 1.120165441185236, + 0.6782295515877195, + 0.5579123757779598, + 0.641106866300106, + 0.4995556380599737, + 1.017007503658533, + 0.955494835972786, + 0.6582686342298985, + 1.7273120565223508, + 1.1877054311335087, + 0.6069942507892847, + 0.8625152967870235, + 0.8242883551865816, + 1.3642258681356907, + 0.926450977101922, + 1.427088152617216, + 0.31571088917553425, + 1.0387816056609154 + ], + "unique_experts": 64, + "load_cv": 0.4932596025551127, + "normalized_load_entropy": 0.9705432860446815, + "max_load_share": 0.046536796536796536 + } + }, + "s0_bos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "40151ca51e6acf33e54f26b13210f4fd78ad6d012e0debd3b3dab756c480d9dd", + "route_weight_sha256": "e3c252eeda316b2664c54e54dce2d0587a1f029b5ecd1fb79713a61e03cd1ad0", + "loads": [ + 8, + 12, + 16, + 15, + 7, + 9, + 5, + 13, + 18, + 4, + 14, + 8, + 5, + 27, + 10, + 8, + 2, + 2, + 18, + 8, + 0, + 8, + 10, + 13, + 18, + 16, + 10, + 10, + 17, + 15, + 12, + 8, + 0, + 1, + 10, + 8, + 4, + 17, + 11, + 12, + 14, + 8, + 8, + 11, + 20, + 7, + 14, + 10, + 12, + 15, + 5, + 7, + 7, + 14, + 23, + 17, + 6, + 4, + 15, + 12, + 10, + 14, + 6, + 10 + ], + "weighted_loads": [ + 0.45655080303549767, + 0.5176762044429779, + 1.0361466631293297, + 1.4827047735452652, + 0.4655347913503647, + 0.6763010676950216, + 0.19779606722295284, + 0.8068755678832531, + 0.690797321498394, + 0.14700280129909515, + 0.9796926993876696, + 0.5293922089040279, + 0.1682005226612091, + 1.5473501645028591, + 0.7253572233021259, + 0.44961257837712765, + 0.05505375936627388, + 0.06248755566775799, + 1.0547207444906235, + 0.5802704505622387, + 0.0, + 0.7705280035734177, + 0.45012785121798515, + 0.8631640207022429, + 1.081586703658104, + 1.1807066053152084, + 0.353559672832489, + 0.48801469802856445, + 0.9180005565285683, + 1.181615611538291, + 0.8745007999241352, + 0.44951721280813217, + 0.0, + 0.03304962068796158, + 0.520813474431634, + 0.3901381380856037, + 0.25204215571284294, + 1.2583307400345802, + 0.8475220147520304, + 0.828593272715807, + 0.8953013531863689, + 0.5745030231773853, + 0.8293747529387474, + 0.6559469029307365, + 1.0634075328707695, + 0.3105973917990923, + 1.0697421971708536, + 0.6046383939683437, + 0.4085490480065346, + 0.6698495429009199, + 0.16626188345253468, + 0.6588511243462563, + 0.6216302514076233, + 0.5136165209114552, + 1.63561387732625, + 0.7329218424856663, + 0.20152444764971733, + 0.14285781979560852, + 0.6617513727396727, + 0.6364647224545479, + 0.7300750222057104, + 1.1596723981201649, + 0.32377474941313267, + 0.5384714864194393 + ], + "unique_experts": 62, + "load_cv": 0.5093516397756153, + "normalized_load_entropy": 0.9648731482596529, + "max_load_share": 0.03982300884955752 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "88989ba7c7652771bc4b7938f9f4c726adaf3be29abaa21efef07c61884d206f", + "route_weight_sha256": "2ab237d9b35ddbade176cf493981d25b042d10025fcd2ab28d7687b60e043430", + "loads": [ + 10, + 12, + 18, + 15, + 11, + 10, + 6, + 15, + 34, + 4, + 16, + 11, + 5, + 27, + 11, + 17, + 2, + 4, + 18, + 8, + 3, + 8, + 11, + 13, + 18, + 20, + 23, + 10, + 17, + 15, + 12, + 12, + 2, + 3, + 10, + 8, + 4, + 17, + 11, + 15, + 15, + 19, + 9, + 15, + 20, + 17, + 16, + 10, + 13, + 15, + 9, + 7, + 11, + 14, + 25, + 21, + 10, + 13, + 15, + 22, + 12, + 18, + 6, + 10 + ], + "weighted_loads": [ + 0.5603278428316116, + 0.5176762044429779, + 1.1211858615279198, + 1.4827047735452652, + 0.6256112046539783, + 0.7118507195264101, + 0.2596203591674566, + 1.0663447715342045, + 1.5499581918120384, + 0.14700280129909515, + 1.242254400625825, + 0.6055086106061935, + 0.1682005226612091, + 1.5473501645028591, + 0.7495209500193596, + 1.067250082269311, + 0.05505375936627388, + 0.16873029805719852, + 1.0547207444906235, + 0.5802704505622387, + 0.30439577996730804, + 0.7705280035734177, + 0.48025730811059475, + 0.8631640207022429, + 1.081586703658104, + 1.3580787405371666, + 1.1623942535370588, + 0.48801469802856445, + 0.9180005565285683, + 1.181615611538291, + 0.8745007999241352, + 0.8518923968076706, + 0.09178755059838295, + 0.21310533583164215, + 0.520813474431634, + 0.3901381380856037, + 0.25204215571284294, + 1.2583307400345802, + 0.8475220147520304, + 1.0665852166712284, + 0.9301802292466164, + 1.0088363252580166, + 0.8723193928599358, + 0.7650038357824087, + 1.0634075328707695, + 1.1310739535838366, + 1.1937542855739594, + 0.6046383939683437, + 0.45362795889377594, + 0.6698495429009199, + 0.28660221956670284, + 0.6588511243462563, + 0.8870839625597, + 0.5136165209114552, + 1.680586313828826, + 1.2622813247144222, + 0.5415415838360786, + 0.6997077912092209, + 0.6617513727396727, + 1.3203236386179924, + 0.9261238407343626, + 1.38164734095335, + 0.32377474941313267, + 0.5384714864194393 + ], + "unique_experts": 64, + "load_cv": 0.4787973373385439, + "normalized_load_entropy": 0.9714906295697996, + "max_load_share": 0.04106280193236715 + } + }, + "s1_bos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "4e54773213daf7cb9650248de31d0f4dd1f42b15815843c8d2e3fee2e9b4e579", + "route_weight_sha256": "e1ef46208c7e07a774ebc9de9cc932d408406197d576391771ba742b65e7d543", + "loads": [ + 7, + 12, + 15, + 15, + 7, + 9, + 5, + 14, + 19, + 3, + 12, + 9, + 6, + 27, + 10, + 10, + 4, + 1, + 18, + 8, + 0, + 8, + 11, + 13, + 16, + 16, + 24, + 10, + 17, + 15, + 12, + 9, + 0, + 0, + 12, + 7, + 4, + 17, + 11, + 12, + 14, + 10, + 8, + 9, + 20, + 7, + 14, + 11, + 12, + 14, + 4, + 7, + 7, + 13, + 23, + 15, + 6, + 3, + 12, + 10, + 7, + 14, + 6, + 7 + ], + "weighted_loads": [ + 0.41948225907981396, + 0.5123022887855768, + 0.9488701075315475, + 1.4736719354987144, + 0.4718651659786701, + 0.7288840189576149, + 0.20535698719322681, + 0.8498407918959856, + 0.7231195531785488, + 0.1232566349208355, + 0.9010447226464748, + 0.5583630036562681, + 0.18709300458431244, + 1.5514335669577122, + 0.6882699877023697, + 0.500947767868638, + 0.09915012493729591, + 0.03602084890007973, + 1.0632659085094929, + 0.5761692672967911, + 0.0, + 0.8028721828013659, + 0.47959519177675247, + 0.8348348271101713, + 1.0311004221439362, + 1.1350175738334656, + 0.7651900053024292, + 0.4551369436085224, + 0.916347885504365, + 1.1459817290306091, + 0.8979262076318264, + 0.47259710170328617, + 0.0, + 0.0, + 0.5651880968362093, + 0.3637690842151642, + 0.25226297974586487, + 1.2181445509195328, + 0.8420293983072042, + 0.8169910535216331, + 0.813265722244978, + 0.7301173638552427, + 0.8060858622193336, + 0.5906931087374687, + 1.0757527612149715, + 0.306053226813674, + 1.066765496507287, + 0.6531040817499161, + 0.4117564018815756, + 0.6369186080992222, + 0.14447963424026966, + 0.6691547185182571, + 0.6223343648016453, + 0.5048311837017536, + 1.689693532884121, + 0.6731801331043243, + 0.20157569833099842, + 0.13134818896651268, + 0.5607643239200115, + 0.599893594160676, + 0.6371931973844767, + 1.1477267798036337, + 0.33638504706323147, + 0.46767496317625046 + ], + "unique_experts": 61, + "load_cv": 0.5307685609276278, + "normalized_load_entropy": 0.96153619120174, + "max_load_share": 0.03982300884955752 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "f1abfba7234a51ce9a1b4cb62f5bc904cf7152a152b8be71ef6f116019ab931e", + "route_weight_sha256": "5e980d3707fe5f3b69b09678b827beed498fb4a370beaf21d10f0eb9dec95b44", + "loads": [ + 11, + 12, + 18, + 16, + 14, + 12, + 6, + 17, + 41, + 3, + 17, + 12, + 6, + 28, + 11, + 22, + 4, + 6, + 19, + 9, + 3, + 10, + 15, + 14, + 18, + 21, + 43, + 11, + 17, + 17, + 13, + 15, + 2, + 2, + 12, + 7, + 5, + 18, + 11, + 17, + 15, + 22, + 12, + 15, + 21, + 17, + 16, + 14, + 15, + 14, + 13, + 11, + 12, + 13, + 27, + 19, + 16, + 17, + 14, + 20, + 10, + 19, + 6, + 11 + ], + "weighted_loads": [ + 0.6177708227187395, + 0.5123022887855768, + 1.101556271314621, + 1.5055582225322723, + 0.873100882396102, + 0.9004049338400364, + 0.2506843227893114, + 1.0779887977987528, + 1.9878660645335913, + 0.1232566349208355, + 1.3535852283239365, + 0.7603855412453413, + 0.18709300458431244, + 1.5914738699793816, + 0.7104012668132782, + 1.2040313798934221, + 0.09915012493729591, + 0.23766464367508888, + 1.1023484617471695, + 0.6422366127371788, + 0.24650394171476364, + 1.008002558723092, + 0.7506411038339138, + 0.8691764492541552, + 1.102920975536108, + 1.339545102789998, + 2.0404519606381655, + 0.4973118379712105, + 0.916347885504365, + 1.3080350793898106, + 0.984184417873621, + 1.1003076303750277, + 0.07933318614959717, + 0.13819904252886772, + 0.5651880968362093, + 0.3637690842151642, + 0.5113863348960876, + 1.2518043220043182, + 0.8420293983072042, + 1.1742445416748524, + 0.8466511070728302, + 1.304163321852684, + 1.0501163341104984, + 0.7884705979377031, + 1.2277306579053402, + 1.0746423471719027, + 1.1945238951593637, + 0.7559161651879549, + 0.6082110311836004, + 0.6369186080992222, + 0.5550203118473291, + 1.0339751951396465, + 0.9404770918190479, + 0.5048311837017536, + 1.7832467406988144, + 1.1761221811175346, + 0.6892067193984985, + 0.9351468905806541, + 0.63583704829216, + 1.2373746503144503, + 0.8553835470229387, + 1.4601441454142332, + 0.33638504706323147, + 0.9599046260118484 + ], + "unique_experts": 64, + "load_cv": 0.5152606381568312, + "normalized_load_entropy": 0.9693589383041239, + "max_load_share": 0.046536796536796536 + } + }, + "s0_x": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "cce691f3dbb6eea9d27f6229a49cc6c139b6ea1ae85875619ff75120eb559e71", + "route_weight_sha256": "924073df64dd9ecc6a87370665ec7956f627ba4166eac6521b413c69770065a6", + "loads": [ + 7, + 13, + 15, + 15, + 7, + 9, + 5, + 12, + 19, + 3, + 14, + 8, + 5, + 27, + 10, + 7, + 1, + 3, + 19, + 8, + 0, + 8, + 8, + 13, + 18, + 16, + 13, + 10, + 17, + 15, + 12, + 8, + 0, + 0, + 10, + 9, + 4, + 17, + 11, + 12, + 15, + 9, + 8, + 11, + 19, + 7, + 14, + 10, + 14, + 14, + 4, + 7, + 7, + 15, + 23, + 17, + 6, + 4, + 19, + 9, + 9, + 14, + 6, + 9 + ], + "weighted_loads": [ + 0.43245565332472324, + 0.5319562368094921, + 0.9808088690042496, + 1.4375396445393562, + 0.46008745953440666, + 0.7285825330764055, + 0.20517828688025475, + 0.7798460572957993, + 0.7645306959748268, + 0.12091328948736191, + 1.0224044974893332, + 0.512791084125638, + 0.16411083191633224, + 1.6099937334656715, + 0.7348201610147953, + 0.41413443349301815, + 0.03042985126376152, + 0.07988021522760391, + 1.137541987001896, + 0.5811079367995262, + 0.0, + 0.7855551745742559, + 0.40098118409514427, + 0.8390077203512192, + 1.1445133537054062, + 1.1586236245930195, + 0.44147974252700806, + 0.4923867806792259, + 0.9084052704274654, + 1.146687975153327, + 0.867480743676424, + 0.4566359147429466, + 0.0, + 0.0, + 0.49964291974902153, + 0.41794816963374615, + 0.24415528774261475, + 1.3430536054074764, + 0.8237341400235891, + 0.8161948211491108, + 1.0294834561645985, + 0.6414794400334358, + 0.8305891901254654, + 0.6618422064930201, + 1.0215483102947474, + 0.31553620658814907, + 1.0518265049904585, + 0.5858144573867321, + 0.4608604796230793, + 0.6329746190458536, + 0.13962368108332157, + 0.6583578437566757, + 0.600869607180357, + 0.5536005329340696, + 1.669261272996664, + 0.7374592926353216, + 0.19772201776504517, + 0.145479129627347, + 0.785712094977498, + 0.5682401098310947, + 0.7149999998509884, + 1.1431787200272083, + 0.3244603779166937, + 0.5186940096318722 + ], + "unique_experts": 61, + "load_cv": 0.5284024942053063, + "normalized_load_entropy": 0.9614490555770567, + "max_load_share": 0.03982300884955752 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "24ba0b653bff302e66e3f728c9710a99c5fde92e595d818c70ca03358432bd4c", + "route_weight_sha256": "7f0df0cdecbfe76a2a04a2661245ba0b4060f3434cf09e111c21c8a2fb64c82b", + "loads": [ + 8, + 13, + 17, + 15, + 11, + 10, + 6, + 15, + 35, + 4, + 16, + 9, + 5, + 27, + 11, + 17, + 1, + 4, + 19, + 8, + 3, + 8, + 10, + 13, + 18, + 20, + 27, + 10, + 17, + 15, + 12, + 12, + 2, + 2, + 10, + 9, + 4, + 17, + 11, + 15, + 16, + 21, + 8, + 15, + 19, + 18, + 15, + 10, + 15, + 14, + 8, + 7, + 11, + 15, + 25, + 21, + 9, + 12, + 20, + 20, + 10, + 18, + 6, + 9 + ], + "weighted_loads": [ + 0.5120250601321459, + 0.5319562368094921, + 1.075236015021801, + 1.4375396445393562, + 0.6189505644142628, + 0.7697162944823503, + 0.26700257882475853, + 1.0786935035139322, + 1.6257178001105785, + 0.14716748893260956, + 1.2921100836247206, + 0.533793855458498, + 0.16411083191633224, + 1.6099937334656715, + 0.7618492767214775, + 1.148846672847867, + 0.03042985126376152, + 0.15134182572364807, + 1.137541987001896, + 0.5811079367995262, + 0.300245501101017, + 0.7855551745742559, + 0.46209025755524635, + 0.8390077203512192, + 1.1445133537054062, + 1.3402047120034695, + 1.2813789919018745, + 0.4923867806792259, + 0.9084052704274654, + 1.146687975153327, + 0.867480743676424, + 0.8647268041968346, + 0.09269380196928978, + 0.18061702325940132, + 0.49964291974902153, + 0.41794816963374615, + 0.24415528774261475, + 1.3430536054074764, + 0.8237341400235891, + 1.0764725990593433, + 1.0667249858379364, + 1.1306576766073704, + 0.8305891901254654, + 0.7708991393446922, + 1.0215483102947474, + 1.1697115544229746, + 1.1507099028676748, + 0.5858144573867321, + 0.5108705870807171, + 0.6329746190458536, + 0.257695022970438, + 0.6583578437566757, + 0.8519274406135082, + 0.5536005329340696, + 1.71423370949924, + 1.283082952722907, + 0.39027227833867073, + 0.6211354359984398, + 0.814101891592145, + 1.3506282903254032, + 0.8059243820607662, + 1.3619598187506199, + 0.3244603779166937, + 0.5186940096318722 + ], + "unique_experts": 64, + "load_cv": 0.5062792713049835, + "normalized_load_entropy": 0.9680758487574751, + "max_load_share": 0.042270531400966184 + } + }, + "s1_x": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "76154b19bb567b87189ad392e5ec9830983a38529c91dc23436c61bd0e93f67a", + "route_weight_sha256": "7af1bbc490709fc5606cfaeb0f0131be2b3b862dd30f8dfe720fa709b8ca24e5", + "loads": [ + 7, + 13, + 15, + 15, + 7, + 9, + 5, + 13, + 19, + 3, + 12, + 9, + 6, + 27, + 9, + 9, + 3, + 0, + 18, + 8, + 0, + 8, + 10, + 13, + 16, + 16, + 30, + 10, + 17, + 15, + 12, + 9, + 0, + 0, + 12, + 8, + 4, + 17, + 10, + 12, + 14, + 11, + 8, + 9, + 18, + 6, + 14, + 11, + 14, + 12, + 4, + 7, + 7, + 13, + 24, + 15, + 6, + 3, + 13, + 10, + 6, + 13, + 6, + 8 + ], + "weighted_loads": [ + 0.4170054513961077, + 0.5342677608132362, + 0.9212164506316185, + 1.433000858873129, + 0.4633423164486885, + 0.7513056229799986, + 0.21117744036018848, + 0.8197353109717369, + 0.7286057434976101, + 0.12148726359009743, + 0.9087736140936613, + 0.5474333111196756, + 0.1817784644663334, + 1.6019552163779736, + 0.6622259300202131, + 0.4698865469545126, + 0.07612842507660389, + 0.0, + 1.0702097564935684, + 0.5728895794600248, + 0.0, + 0.8154617119580507, + 0.4534067567437887, + 0.8244671933352947, + 1.0662193596363068, + 1.1123305521905422, + 0.9766803607344627, + 0.4550929591059685, + 0.9144507981836796, + 1.127229493111372, + 0.9032616093754768, + 0.47538210824131966, + 0.0, + 0.0, + 0.5504229906946421, + 0.3904499541968107, + 0.24833344668149948, + 1.2478574365377426, + 0.7995395194739103, + 0.811399795114994, + 0.8747508823871613, + 0.7886647935956717, + 0.7977884784340858, + 0.5893797930330038, + 1.0334083065390587, + 0.2842815201729536, + 1.0585200060158968, + 0.6421183608472347, + 0.46751357801258564, + 0.5757046677172184, + 0.14154284447431564, + 0.6640126034617424, + 0.6109987422823906, + 0.5109298974275589, + 1.7167633920907974, + 0.6790575459599495, + 0.20276171155273914, + 0.13333509862422943, + 0.5971836857497692, + 0.6063010357320309, + 0.6182718053460121, + 1.110851589590311, + 0.34005027264356613, + 0.4944537580013275 + ], + "unique_experts": 60, + "load_cv": 0.5598739240536832, + "normalized_load_entropy": 0.9579676490481371, + "max_load_share": 0.04424778761061947 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "47947d8d025c02c4c52d632049a37c4fe582aeb13a187eaed049b7518a863930", + "route_weight_sha256": "38f7b40ff4bc9d57e9c4c1884cb2d253dd743575f1f0a8429065c6bbb46f1d37", + "loads": [ + 10, + 13, + 18, + 15, + 14, + 12, + 6, + 17, + 41, + 4, + 17, + 12, + 6, + 28, + 9, + 22, + 3, + 5, + 19, + 9, + 3, + 10, + 14, + 14, + 18, + 21, + 50, + 11, + 17, + 17, + 13, + 15, + 2, + 2, + 12, + 8, + 5, + 18, + 10, + 17, + 15, + 24, + 11, + 15, + 19, + 17, + 16, + 14, + 17, + 12, + 13, + 11, + 12, + 13, + 28, + 19, + 15, + 15, + 16, + 21, + 8, + 18, + 6, + 12 + ], + "weighted_loads": [ + 0.5896717924624681, + 0.5342677608132362, + 1.0812027864158154, + 1.433000858873129, + 0.8623203169554472, + 0.9251433182507753, + 0.2565047759562731, + 1.0851283464580774, + 1.9900007005780935, + 0.1463700756430626, + 1.3619546461850405, + 0.7461076974868774, + 0.1817784644663334, + 1.641995519399643, + 0.6622259300202131, + 1.2837810274213552, + 0.07612842507660389, + 0.20164379477500916, + 1.109292309731245, + 0.6389569249004126, + 0.24268075823783875, + 1.020592087879777, + 0.72445266880095, + 0.8588088154792786, + 1.1380399130284786, + 1.321187635883689, + 2.2910483088344336, + 0.49726785346865654, + 0.9144507981836796, + 1.2892828434705734, + 0.9895198196172714, + 1.105784397572279, + 0.080379668623209, + 0.14046062901616096, + 0.5504229906946421, + 0.3904499541968107, + 0.5074568018317223, + 1.281517207622528, + 0.7995395194739103, + 1.1865313239395618, + 0.9092794135212898, + 1.4293826892971992, + 1.0053950995206833, + 0.7871572822332382, + 1.1853862032294273, + 1.0876050237566233, + 1.1911660265177488, + 0.744529752060771, + 0.6674933526664972, + 0.5757046677172184, + 0.5504958853125572, + 1.0288330800831318, + 0.9150674901902676, + 0.5109298974275589, + 1.8103165999054909, + 1.1917506530880928, + 0.5615178719162941, + 0.8305004872381687, + 0.6991412155330181, + 1.3380434848368168, + 0.7340712174773216, + 1.4195545092225075, + 0.34005027264356613, + 0.9866834208369255 + ], + "unique_experts": 64, + "load_cv": 0.5538250065598059, + "normalized_load_entropy": 0.9662779601737247, + "max_load_share": 0.05411255411255411 + } + }, + "s0_period": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "39506ad33ab05bf9aaf9e5911449ded533804d5329e006a59e3f8cc645b0ca65", + "route_weight_sha256": "e6d32c3ab5bafd41ad4f094af700ea4ed4a544ce0069813ea8cce82af5df7459", + "loads": [ + 7, + 13, + 15, + 15, + 7, + 9, + 5, + 12, + 19, + 3, + 14, + 8, + 5, + 27, + 10, + 7, + 2, + 3, + 19, + 8, + 0, + 8, + 8, + 13, + 18, + 16, + 13, + 11, + 16, + 15, + 12, + 8, + 0, + 0, + 10, + 10, + 4, + 17, + 11, + 12, + 15, + 9, + 8, + 10, + 19, + 7, + 14, + 10, + 14, + 14, + 4, + 7, + 7, + 15, + 23, + 16, + 6, + 3, + 18, + 10, + 10, + 14, + 6, + 9 + ], + "weighted_loads": [ + 0.43022140488028526, + 0.5323326848447323, + 0.97996836155653, + 1.4342798590660095, + 0.46027911454439163, + 0.7307032011449337, + 0.2127726934850216, + 0.7845686879009008, + 0.7636340390890837, + 0.1207202672958374, + 1.014655837789178, + 0.5146663933992386, + 0.16453199088573456, + 1.609252329915762, + 0.7325516082346439, + 0.41121574863791466, + 0.05394698493182659, + 0.07954757288098335, + 1.1246392503380775, + 0.5794210340827703, + 0.0, + 0.7904620505869389, + 0.40060570277273655, + 0.8401866462081671, + 1.1667656023055315, + 1.1582680940628052, + 0.439991757273674, + 0.5200496576726437, + 0.8775247093290091, + 1.1352018043398857, + 0.8703412376344204, + 0.4535296559333801, + 0.0, + 0.0, + 0.49571431055665016, + 0.4437296148389578, + 0.2441369816660881, + 1.3404290340840816, + 0.8286557495594025, + 0.818822817876935, + 1.0348035749047995, + 0.6407611835747957, + 0.8285158351063728, + 0.6363290902227163, + 1.0210409592837095, + 0.3162572309374809, + 1.0554576329886913, + 0.583323035389185, + 0.4582759477198124, + 0.62890999391675, + 0.13857735320925713, + 0.6572994962334633, + 0.6042108796536922, + 0.5572982355952263, + 1.667523242533207, + 0.7146178036928177, + 0.19834688119590282, + 0.12197839841246605, + 0.7600747067481279, + 0.59431510604918, + 0.7387114837765694, + 1.1402496434748173, + 0.32766519859433174, + 0.5185793060809374 + ], + "unique_experts": 61, + "load_cv": 0.5217737939281516, + "normalized_load_entropy": 0.962383410056441, + "max_load_share": 0.03982300884955752 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "1d0d8920eadebfe355fa274be9baaf888c0f7893861d9b428ad2ea80d38eae80", + "route_weight_sha256": "cd506e4a8b45c9c68bc77e5004ba0f83c568fd92dacc4b33a4080690bac0ef54", + "loads": [ + 8, + 13, + 17, + 15, + 12, + 10, + 6, + 14, + 35, + 4, + 16, + 11, + 5, + 27, + 11, + 16, + 2, + 4, + 19, + 8, + 3, + 8, + 9, + 13, + 18, + 20, + 26, + 11, + 16, + 15, + 12, + 12, + 2, + 2, + 10, + 11, + 4, + 17, + 11, + 15, + 16, + 20, + 8, + 15, + 19, + 17, + 15, + 10, + 16, + 14, + 8, + 8, + 11, + 15, + 25, + 20, + 9, + 10, + 19, + 21, + 11, + 18, + 6, + 9 + ], + "weighted_loads": [ + 0.5103385485708714, + 0.5323326848447323, + 1.065568346530199, + 1.4342798590660095, + 0.7407124750316143, + 0.7675009742379189, + 0.2745969854295254, + 1.0357172172516584, + 1.5993999298661947, + 0.14627580530941486, + 1.283050687983632, + 0.6973529886454344, + 0.16453199088573456, + 1.609252329915762, + 0.7590602990239859, + 1.028853252530098, + 0.05394698493182659, + 0.1510091833770275, + 1.1246392503380775, + 0.5794210340827703, + 0.2927856668829918, + 0.7904620505869389, + 0.43073515966534615, + 0.8401866462081671, + 1.1667656023055315, + 1.3394538760185242, + 1.2501786015927792, + 0.5200496576726437, + 0.8775247093290091, + 1.1352018043398857, + 0.8703412376344204, + 0.8641818016767502, + 0.09234577044844627, + 0.1805097907781601, + 0.49571431055665016, + 0.4650566428899765, + 0.2441369816660881, + 1.3404290340840816, + 0.8286557495594025, + 1.0593094285577536, + 1.071754114702344, + 1.073934068903327, + 0.8285158351063728, + 0.7711842432618141, + 1.0210409592837095, + 1.1367337927222252, + 1.1519863121211529, + 0.583323035389185, + 0.5297568663954735, + 0.62890999391675, + 0.2565356623381376, + 0.7103001549839973, + 0.8685650415718555, + 0.5572982355952263, + 1.7124956790357828, + 1.2627066671848297, + 0.3912359606474638, + 0.5691037587821484, + 0.7881407272070646, + 1.3082103822380304, + 0.8296358659863472, + 1.3562274537980556, + 0.32766519859433174, + 0.5185793060809374 + ], + "unique_experts": 64, + "load_cv": 0.4939598762129051, + "normalized_load_entropy": 0.9698081290003171, + "max_load_share": 0.042270531400966184 + } + }, + "s1_period": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "2d9da99984f1e515a32ab5d8608b2ba47fcaae4608b451284c204af21365d27e", + "route_weight_sha256": "701db676b99e27cd66923e117dc454a12cde19b45a1e06a036b4a8dbf59d4d1b", + "loads": [ + 7, + 14, + 15, + 15, + 7, + 9, + 5, + 13, + 19, + 3, + 12, + 9, + 6, + 27, + 9, + 9, + 3, + 0, + 18, + 8, + 0, + 8, + 10, + 13, + 16, + 16, + 29, + 10, + 17, + 15, + 12, + 9, + 0, + 0, + 12, + 8, + 3, + 17, + 10, + 12, + 14, + 11, + 8, + 9, + 18, + 6, + 14, + 11, + 13, + 12, + 4, + 7, + 7, + 14, + 24, + 15, + 6, + 3, + 14, + 10, + 6, + 13, + 6, + 8 + ], + "weighted_loads": [ + 0.4168581012636423, + 0.5658595263957977, + 0.9225921370089054, + 1.4268815778195858, + 0.462684603407979, + 0.7506632506847382, + 0.21278253942728043, + 0.8222252484411001, + 0.7259762175381184, + 0.12164574861526489, + 0.9087150078266859, + 0.5484927278012037, + 0.18240210227668285, + 1.6052479036152363, + 0.6617155205458403, + 0.4713637437671423, + 0.0764320157468319, + 0.0, + 1.0696254465728998, + 0.572398891672492, + 0.0, + 0.8189983461052179, + 0.45415032655000687, + 0.8241357151418924, + 1.0731004420667887, + 1.1102380529046059, + 0.9562346804887056, + 0.4547193795442581, + 0.9123700279742479, + 1.123426180332899, + 0.9029653109610081, + 0.4744484703987837, + 0.0, + 0.0, + 0.5509807746857405, + 0.39058549515902996, + 0.21558713167905807, + 1.2512853406369686, + 0.8014865983277559, + 0.8134506028145552, + 0.8805633652955294, + 0.790747981518507, + 0.7970231026411057, + 0.5894600804895163, + 1.031789431348443, + 0.28438129648566246, + 1.0588866118341684, + 0.6410722434520721, + 0.4369104541838169, + 0.5745956115424633, + 0.14069220423698425, + 0.6615384072065353, + 0.6112938188016415, + 0.5443817246705294, + 1.716533936560154, + 0.6790482793003321, + 0.20193804800510406, + 0.13318390399217606, + 0.6170123238116503, + 0.6072609443217516, + 0.6199930887669325, + 1.1096912864595652, + 0.3427874092012644, + 0.49376511201262474 + ], + "unique_experts": 60, + "load_cv": 0.55837988673549, + "normalized_load_entropy": 0.9577650621163397, + "max_load_share": 0.04277286135693215 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "861e4565ec6e4f7b02aa7442c23e5f18ecbeb11a3b06f8e9c23707b74522a10e", + "route_weight_sha256": "ba1894e0d4dae9f6756eed53e3b122c869cb6f632197210bbc809cf5d92558f0", + "loads": [ + 10, + 14, + 18, + 15, + 15, + 12, + 6, + 16, + 40, + 3, + 17, + 14, + 6, + 28, + 9, + 21, + 3, + 5, + 19, + 9, + 3, + 10, + 14, + 14, + 18, + 21, + 49, + 11, + 17, + 17, + 14, + 15, + 2, + 2, + 12, + 8, + 5, + 18, + 10, + 17, + 15, + 24, + 11, + 15, + 19, + 16, + 15, + 14, + 16, + 12, + 13, + 12, + 13, + 14, + 28, + 19, + 15, + 15, + 17, + 20, + 8, + 18, + 6, + 12 + ], + "weighted_loads": [ + 0.5915699917823076, + 0.5658595263957977, + 1.0720035322010517, + 1.4268815778195858, + 0.981889333575964, + 0.9226139709353447, + 0.258109875023365, + 1.0377412047237158, + 1.9438502062112093, + 0.12164574861526489, + 1.3618501890450716, + 0.9146875385195017, + 0.18240210227668285, + 1.6452882066369057, + 0.6617155205458403, + 1.1744473557919264, + 0.0764320157468319, + 0.20164379477500916, + 1.1087079998105764, + 0.6384662371128798, + 0.23236003145575523, + 1.0241287220269442, + 0.7251962386071682, + 0.8584773372858763, + 1.1449209954589605, + 1.3181982357054949, + 2.26093433983624, + 0.4968942739069462, + 0.9123700279742479, + 1.2854795306921005, + 1.0100762825459242, + 1.1066114362329245, + 0.0802991185337305, + 0.14061115309596062, + 0.5509807746857405, + 0.39058549515902996, + 0.49669439531862736, + 1.284945111721754, + 0.8014865983277559, + 1.169296944513917, + 0.9149664100259542, + 1.4001730922609568, + 1.004629723727703, + 0.7872375696897507, + 1.1837673280388117, + 1.0529704168438911, + 1.1557987947016954, + 0.7433943375945091, + 0.6392318569123745, + 0.5745956115424633, + 0.5495761707425117, + 1.069136556237936, + 0.9500712361186743, + 0.5443817246705294, + 1.8100871443748474, + 1.1930204723030329, + 0.5639970060437918, + 0.8301893230527639, + 0.7187995482236147, + 1.2447420004755259, + 0.735792500898242, + 1.413269093260169, + 0.3427874092012644, + 0.9859947748482227 + ], + "unique_experts": 64, + "load_cv": 0.5430269623980645, + "normalized_load_entropy": 0.9669834840236917, + "max_load_share": 0.05303030303030303 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 113, + "ordered_topk_exact_tokens": 91, + "set_exact_tokens": 97, + "mean_set_jaccard": 0.9595448798988622, + "mean_token_weighted_tv": 0.006617110098951158, + "aggregate_load_tv": 0.019174041297935103 + }, + "system_bos": { + "tokens": 113, + "ordered_topk_exact_tokens": 64, + "set_exact_tokens": 77, + "mean_set_jaccard": 0.9032869785082176, + "mean_token_weighted_tv": 0.01493981765764477, + "aggregate_load_tv": 0.04277286135693215 + }, + "system_x": { + "tokens": 113, + "ordered_topk_exact_tokens": 64, + "set_exact_tokens": 77, + "mean_set_jaccard": 0.899494310998736, + "mean_token_weighted_tv": 0.01680662349459872, + "aggregate_load_tv": 0.05014749262536873 + }, + "system_period": { + "tokens": 113, + "ordered_topk_exact_tokens": 64, + "set_exact_tokens": 77, + "mean_set_jaccard": 0.9032869785082176, + "mean_token_weighted_tv": 0.0163658810037691, + "aggregate_load_tv": 0.048672566371681415 + }, + "bos_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 50, + "set_exact_tokens": 72, + "mean_set_jaccard": 0.8792667509481668, + "mean_token_weighted_tv": 0.022493343206897245, + "aggregate_load_tv": 0.05014749262536873 + }, + "bos_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 48, + "set_exact_tokens": 62, + "mean_set_jaccard": 0.8634639696586599, + "mean_token_weighted_tv": 0.022391963610013502, + "aggregate_load_tv": 0.06637168141592921 + }, + "x_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 55, + "set_exact_tokens": 77, + "mean_set_jaccard": 0.9013906447534766, + "mean_token_weighted_tv": 0.017598708976159054, + "aggregate_load_tv": 0.0471976401179941 + }, + "x_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 48, + "set_exact_tokens": 62, + "mean_set_jaccard": 0.8615676359039192, + "mean_token_weighted_tv": 0.02224793066723948, + "aggregate_load_tv": 0.06932153392330384 + }, + "period_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 58, + "set_exact_tokens": 78, + "mean_set_jaccard": 0.9039190897597977, + "mean_token_weighted_tv": 0.017172280196265308, + "aggregate_load_tv": 0.04424778761061947 + }, + "period_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 50, + "set_exact_tokens": 64, + "mean_set_jaccard": 0.8666245259165615, + "mean_token_weighted_tv": 0.02168539954365882, + "aggregate_load_tv": 0.06489675516224189 + } + } + }, + "layer_02": { + "layer": 2, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "6ccb1fcbdbfcaa236d05caa3a13161bf1bc6c887b5b01d7d188cbcba81edc520", + "route_weight_sha256": "2aa09bbf04e681c8ad7a7eaee721860d5f2d1c1353299952bdb51621802971ce", + "loads": [ + 12, + 7, + 7, + 7, + 20, + 14, + 12, + 4, + 10, + 17, + 11, + 12, + 8, + 11, + 7, + 17, + 14, + 5, + 7, + 13, + 4, + 11, + 11, + 7, + 9, + 9, + 9, + 12, + 8, + 5, + 13, + 18, + 11, + 16, + 11, + 13, + 16, + 5, + 6, + 8, + 7, + 11, + 10, + 3, + 9, + 12, + 10, + 23, + 10, + 9, + 7, + 3, + 8, + 20, + 19, + 10, + 12, + 8, + 8, + 13, + 18, + 8, + 8, + 15 + ], + "weighted_loads": [ + 1.257627584040165, + 0.8062581140547991, + 0.3478984273970127, + 0.3806343823671341, + 1.6284459494054317, + 0.9865749664604664, + 1.0959984585642815, + 0.2529724333435297, + 0.778778363019228, + 1.4269851241260767, + 0.6363959349691868, + 0.7393904896453023, + 0.3397318050265312, + 0.43136640451848507, + 0.6323488540947437, + 1.1559832077473402, + 0.6958173476159573, + 0.2079916838556528, + 0.5037330035120249, + 0.6658981665968895, + 0.23142065852880478, + 1.0011192541569471, + 1.70342817902565, + 0.4453459493815899, + 0.4154962692409754, + 0.7156070843338966, + 0.6569900885224342, + 0.7625524047762156, + 0.28221777454018593, + 0.21804799139499664, + 0.8562207650393248, + 1.4364844746887684, + 0.7074352093040943, + 1.3709700498729944, + 0.8890311624854803, + 0.6781282443553209, + 1.3029143568128347, + 0.7781452164053917, + 0.33403889648616314, + 0.5164963006973267, + 0.5327165070921183, + 0.7073261458426714, + 0.6215034704655409, + 0.17158585041761398, + 0.6044112630188465, + 0.9019400700926781, + 0.6437846012413502, + 1.7306092530488968, + 0.7746948562562466, + 0.39615749567747116, + 1.0263854041695595, + 0.10629564337432384, + 0.5602163337171078, + 1.7086336202919483, + 1.252440918236971, + 0.5434330720454454, + 1.2728244066238403, + 0.6645894311368465, + 0.7652639336884022, + 1.058414101600647, + 1.5892551727592945, + 1.1079711131751537, + 0.34041498228907585, + 1.030752670019865 + ], + "unique_experts": 64, + "load_cv": 0.41204065251577265, + "normalized_load_entropy": 0.9798515560848667, + "max_load_share": 0.03392330383480826 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "0c142e763f44e2f6290c1c92e1c392d97ad772491404d40756bf3fc546419ab9", + "route_weight_sha256": "753628cc72ec4443b185529eca3f12296637c3b620ca921fd986117c5a47073d", + "loads": [ + 12, + 17, + 7, + 9, + 20, + 14, + 12, + 6, + 13, + 17, + 14, + 12, + 8, + 12, + 15, + 17, + 14, + 6, + 8, + 17, + 7, + 20, + 11, + 7, + 12, + 9, + 10, + 14, + 10, + 5, + 13, + 19, + 11, + 16, + 16, + 29, + 16, + 5, + 9, + 8, + 7, + 11, + 17, + 3, + 9, + 12, + 12, + 27, + 11, + 9, + 7, + 10, + 8, + 21, + 19, + 10, + 12, + 16, + 16, + 16, + 28, + 12, + 13, + 25 + ], + "weighted_loads": [ + 1.257627584040165, + 1.7551977168768644, + 0.3478984273970127, + 2.0821705013513565, + 1.6284459494054317, + 0.9865749664604664, + 1.0959984585642815, + 0.4331082608550787, + 1.0316516607999802, + 1.4269851241260767, + 0.762042447924614, + 0.7393904896453023, + 0.3397318050265312, + 0.45374682545661926, + 0.9815660733729601, + 1.1559832077473402, + 0.6958173476159573, + 0.20868774672271684, + 0.5053217097884044, + 1.4181066527962685, + 0.5671926382929087, + 1.6954613123089075, + 1.70342817902565, + 0.4453459493815899, + 0.5745908226817846, + 0.7156070843338966, + 0.6578330655465834, + 0.9990632776170969, + 0.49050090834498405, + 0.21804799139499664, + 0.8562207650393248, + 1.4371772802551277, + 0.7074352093040943, + 1.3709700498729944, + 1.1137714143842459, + 2.6888953056186438, + 1.3029143568128347, + 0.7781452164053917, + 0.4274270748719573, + 0.5164963006973267, + 0.5327165070921183, + 0.7073261458426714, + 1.3910841215401888, + 0.17158585041761398, + 0.6044112630188465, + 0.9019400700926781, + 0.7104635369032621, + 1.9872192181646824, + 0.8001037072390318, + 0.39615749567747116, + 1.0263854041695595, + 0.7407476808875799, + 0.5602163337171078, + 1.7099395400146022, + 1.252440918236971, + 0.5434330720454454, + 1.2728244066238403, + 1.107911717146635, + 1.1290354169905186, + 1.1694084014743567, + 2.420602535828948, + 1.3046471755951643, + 0.735254991799593, + 1.7061240896582603 + ], + "unique_experts": 64, + "load_cv": 0.42597082339488884, + "normalized_load_entropy": 0.979060357421996, + "max_load_share": 0.035024154589371984 + } + }, + "s1_eos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "3a5a997cbe860f477c7ee85927f49fe55fb467c1c4c0d744109e758efae1cfb6", + "route_weight_sha256": "ce90cc1154037b21e924f2f6458bd382d6babc6d7810987746d6904090b5c9e9", + "loads": [ + 12, + 8, + 9, + 7, + 21, + 14, + 11, + 4, + 10, + 17, + 11, + 14, + 7, + 10, + 6, + 17, + 13, + 5, + 7, + 14, + 4, + 13, + 11, + 7, + 9, + 9, + 9, + 11, + 7, + 5, + 12, + 16, + 11, + 15, + 11, + 13, + 16, + 5, + 6, + 8, + 7, + 11, + 10, + 3, + 9, + 12, + 10, + 23, + 10, + 9, + 7, + 3, + 9, + 20, + 20, + 10, + 12, + 8, + 7, + 13, + 19, + 8, + 8, + 15 + ], + "weighted_loads": [ + 1.2610518112778664, + 0.8294902574270964, + 0.4235735069960356, + 0.3824677001684904, + 1.663620663806796, + 0.999355161562562, + 1.0838614255189896, + 0.2523601297289133, + 0.7829720042645931, + 1.4524933956563473, + 0.6373534165322781, + 0.8084631245583296, + 0.3146130032837391, + 0.3831057120114565, + 0.5994122289121151, + 1.176393212750554, + 0.6711416970938444, + 0.20614172518253326, + 0.4992532916367054, + 0.6847474928945303, + 0.2324567213654518, + 1.0450603235512972, + 1.7148431725800037, + 0.4445422440767288, + 0.4103023298084736, + 0.708341596648097, + 0.6500478461384773, + 0.7351676914840937, + 0.2616771049797535, + 0.2159135788679123, + 0.8342366963624954, + 1.3650184404104948, + 0.7012460865080357, + 1.340246400795877, + 0.8967858348041773, + 0.6658966224640608, + 1.3226881194859743, + 0.7973855920135975, + 0.3292633332312107, + 0.520919993519783, + 0.5544734615832567, + 0.7143536545336246, + 0.6217635665088892, + 0.17110217735171318, + 0.6043708510696888, + 0.887582141906023, + 0.6523185856640339, + 1.7156649846583605, + 0.7807152159512043, + 0.39370145089924335, + 1.024290006607771, + 0.10803090780973434, + 0.5916301682591438, + 1.7235052436590195, + 1.3009254354983568, + 0.546204773709178, + 1.2703441083431244, + 0.6372292898595333, + 0.7248791698366404, + 1.0549819841980934, + 1.6280057542026043, + 1.111131202429533, + 0.3245614543557167, + 1.0672096069902182 + ], + "unique_experts": 64, + "load_cv": 0.4174119473506227, + "normalized_load_entropy": 0.9794149042581166, + "max_load_share": 0.03392330383480826 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "4b736816a63e128d23b2b7533302caa49dc2435e5e7d7be1742d1e21be94188b", + "route_weight_sha256": "f3c9a2f6167dc88cfd26d461db1dd7252404c2ea825d5710097571a12449c074", + "loads": [ + 16, + 19, + 10, + 10, + 22, + 15, + 11, + 8, + 19, + 18, + 18, + 14, + 7, + 13, + 18, + 18, + 15, + 6, + 8, + 20, + 7, + 23, + 12, + 7, + 16, + 10, + 10, + 14, + 11, + 5, + 13, + 18, + 11, + 15, + 20, + 30, + 16, + 6, + 11, + 11, + 7, + 11, + 20, + 4, + 12, + 12, + 16, + 30, + 12, + 10, + 8, + 12, + 10, + 24, + 20, + 10, + 16, + 16, + 9, + 24, + 29, + 15, + 18, + 28 + ], + "weighted_loads": [ + 1.7803549095988274, + 1.8347449246793985, + 0.4490436315536499, + 2.118647215887904, + 1.6938614696264267, + 1.14093435741961, + 1.0838614255189896, + 0.49759054370224476, + 1.5805969219654799, + 1.569318015128374, + 0.9426504224538803, + 0.8084631245583296, + 0.3146130032837391, + 0.4314292600611225, + 1.202762633562088, + 1.20880070887506, + 0.7348331641405821, + 0.20672544708941132, + 0.5006353731732816, + 1.474550561979413, + 0.5435169190168381, + 1.8158693872392178, + 1.753690391778946, + 0.4445422440767288, + 0.7289188764989376, + 0.7586464192718267, + 0.6508754950482398, + 1.3686918262392282, + 0.4816889651119709, + 0.2159135788679123, + 0.8681668601930141, + 1.407976085320115, + 0.7012460865080357, + 1.340246400795877, + 1.2639201935380697, + 2.4001368079334497, + 1.3226881194859743, + 0.8392249383032322, + 0.4845104143023491, + 0.8744435235857964, + 0.5544734615832567, + 0.7143536545336246, + 1.8387540224939585, + 0.35193372890353203, + 1.2542722262442112, + 0.887582141906023, + 1.226427424699068, + 2.0932788532227278, + 0.8495678827166557, + 0.43661646731197834, + 1.0504794083535671, + 0.9943315573036671, + 0.7678443416953087, + 1.9078547793906182, + 1.3009254354983568, + 0.546204773709178, + 1.5244903713464737, + 1.0107342228293419, + 0.8355190139263868, + 1.5112702157348394, + 2.3030202854424715, + 1.5823511481285095, + 1.1652425806969404, + 2.126653414219618 + ], + "unique_experts": 64, + "load_cv": 0.4250147577130798, + "normalized_load_entropy": 0.9787896491538832, + "max_load_share": 0.032467532467532464 + } + }, + "s0_bos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "7afa2e07fcab185e3ecc48b79ef128354540a27b62ce3ca923903f4956afa0ad", + "route_weight_sha256": "42b237157c0c16eb48bf6c5510e65851962c839a26d5ea2f84b19cf705548568", + "loads": [ + 12, + 9, + 4, + 7, + 24, + 14, + 12, + 5, + 10, + 16, + 9, + 12, + 3, + 9, + 7, + 18, + 12, + 5, + 8, + 10, + 4, + 13, + 11, + 8, + 10, + 8, + 9, + 12, + 11, + 5, + 13, + 18, + 12, + 11, + 11, + 11, + 16, + 5, + 6, + 8, + 7, + 11, + 11, + 3, + 8, + 12, + 9, + 22, + 11, + 11, + 7, + 2, + 9, + 21, + 19, + 10, + 13, + 9, + 8, + 13, + 20, + 8, + 11, + 15 + ], + "weighted_loads": [ + 1.2742939330637455, + 0.8920192699879408, + 0.2716250382363796, + 0.3936138227581978, + 1.7953807227313519, + 0.9927097726613283, + 1.1217158045619726, + 0.2956387046724558, + 0.7449038736522198, + 1.3951705433428288, + 0.587088456377387, + 0.7031573764979839, + 0.13777168653905392, + 0.3451238479465246, + 0.6067880000919104, + 1.225813440978527, + 0.6405481044203043, + 0.2234120424836874, + 0.5381968393921852, + 0.5467770732939243, + 0.22729076817631721, + 1.061757568269968, + 1.7301992401480675, + 0.4775362368673086, + 0.42803086899220943, + 0.6830386593937874, + 0.6163661703467369, + 0.7861775122582912, + 0.41705342568457127, + 0.21992026641964912, + 0.8909706510603428, + 1.4064831007272005, + 0.7766120992600918, + 1.086887788027525, + 0.8710125461220741, + 0.6034861523658037, + 1.3580881394445896, + 0.8303696252405643, + 0.3364532720297575, + 0.5326100066304207, + 0.5437158942222595, + 0.7250543683767319, + 0.68708211556077, + 0.1764221303164959, + 0.584789328277111, + 0.8789849653840065, + 0.6365829892456532, + 1.7696723379194736, + 0.8555091265588999, + 0.4500102885067463, + 1.0437460616230965, + 0.08189664222300053, + 0.6185534000396729, + 1.7258672807365656, + 1.2407335061579943, + 0.5221192352473736, + 1.2985100373625755, + 0.6293084789067507, + 0.7985769212245941, + 1.0377757214009762, + 1.789999732747674, + 1.167627975344658, + 0.4852119144052267, + 1.0980104003101587 + ], + "unique_experts": 64, + "load_cv": 0.43441022755413927, + "normalized_load_entropy": 0.9774789075438387, + "max_load_share": 0.035398230088495575 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "44689769aa065bff1085c3f6599cf83316760e6d720a7f2bddce3d0205cdf878", + "route_weight_sha256": "ebadc5b3cc2246e44c2f7ec61fa46ba5e5db8d668cfada120c354741b504ff9e", + "loads": [ + 12, + 19, + 4, + 8, + 24, + 14, + 12, + 7, + 13, + 16, + 12, + 12, + 4, + 9, + 13, + 18, + 13, + 5, + 8, + 14, + 6, + 22, + 11, + 8, + 12, + 8, + 9, + 14, + 13, + 5, + 13, + 18, + 12, + 11, + 16, + 27, + 16, + 6, + 10, + 8, + 7, + 11, + 19, + 3, + 8, + 12, + 11, + 26, + 12, + 11, + 7, + 8, + 9, + 21, + 19, + 10, + 13, + 18, + 16, + 19, + 31, + 12, + 17, + 26 + ], + "weighted_loads": [ + 1.2742939330637455, + 1.8409588728100061, + 0.2716250382363796, + 1.122272677719593, + 1.7953807227313519, + 0.9927097726613283, + 1.1217158045619726, + 0.4545133765786886, + 1.0083626061677933, + 1.3951705433428288, + 0.7127349693328142, + 0.7031573764979839, + 0.16979272849857807, + 0.3451238479465246, + 0.8492991887032986, + 1.225813440978527, + 0.6705860886722803, + 0.2234120424836874, + 0.5381968393921852, + 1.2586903758347034, + 0.5180194266140461, + 1.766925361007452, + 1.7301992401480675, + 0.4775362368673086, + 0.5478667635470629, + 0.6830386593937874, + 0.6163661703467369, + 1.031311970204115, + 0.6756304446607828, + 0.21992026641964912, + 0.8909706510603428, + 1.4064831007272005, + 0.7766120992600918, + 1.086887788027525, + 1.0957527980208397, + 2.640682255849242, + 1.3580881394445896, + 0.8513332400470972, + 0.5167777007445693, + 0.5326100066304207, + 0.5437158942222595, + 0.7250543683767319, + 1.4929923601448536, + 0.1764221303164959, + 0.584789328277111, + 0.8789849653840065, + 0.7032619249075651, + 2.022088013589382, + 0.8809179775416851, + 0.4500102885067463, + 1.0437460616230965, + 0.7264735866338015, + 0.6185534000396729, + 1.7258672807365656, + 1.2407335061579943, + 0.5221192352473736, + 1.2985100373625755, + 1.083434259518981, + 1.1623484045267105, + 1.2583678234368563, + 2.653981864452362, + 1.360415618866682, + 0.965904338285327, + 2.0493373330682516 + ], + "unique_experts": 64, + "load_cv": 0.45969934173918986, + "normalized_load_entropy": 0.9754366171045112, + "max_load_share": 0.03743961352657005 + } + }, + "s1_bos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "ad8c590d9487f4fb6b615c767e776e6be1c29e612e435799ef7a63f40e2e2cfd", + "route_weight_sha256": "1f09f3b3b87ada29a3701169200d39b89343c41bbabd852c35aa473fd96686b7", + "loads": [ + 12, + 10, + 6, + 7, + 24, + 14, + 12, + 4, + 10, + 16, + 8, + 12, + 5, + 9, + 3, + 20, + 12, + 5, + 7, + 11, + 4, + 13, + 12, + 7, + 10, + 9, + 9, + 13, + 10, + 5, + 14, + 18, + 13, + 13, + 11, + 11, + 18, + 5, + 5, + 8, + 8, + 11, + 11, + 3, + 7, + 11, + 9, + 23, + 11, + 10, + 7, + 1, + 9, + 20, + 20, + 10, + 12, + 8, + 8, + 13, + 21, + 8, + 7, + 15 + ], + "weighted_loads": [ + 1.2139898501336575, + 0.9198179170489311, + 0.32138753682374954, + 0.40150702372193336, + 1.7871187683194876, + 1.0051715299487114, + 1.132369976490736, + 0.26851264014840126, + 0.7844171337783337, + 1.416027458384633, + 0.5663810018450022, + 0.7162230322137475, + 0.21376118808984756, + 0.3463907949626446, + 0.45262644067406654, + 1.3595051746815443, + 0.6393811143934727, + 0.21184934675693512, + 0.500379528850317, + 0.5532082580029964, + 0.23086653277277946, + 1.0455870758742094, + 1.813698111101985, + 0.4379209354519844, + 0.4204396139830351, + 0.709363067522645, + 0.6211600508540869, + 0.8035409059375525, + 0.38861597143113613, + 0.20725075528025627, + 0.9130263105034828, + 1.4543136339634657, + 0.7854796331375837, + 1.321712994016707, + 0.8851928655058146, + 0.6234319638460875, + 1.493002975359559, + 0.8177985846996307, + 0.3110523074865341, + 0.5232209824025631, + 0.6071262303739786, + 0.7378494590520859, + 0.6770423911511898, + 0.1628151312470436, + 0.5507282391190529, + 0.8094000853598118, + 0.6528970412909985, + 1.793428234755993, + 0.8512058537453413, + 0.4130524042993784, + 1.042389051988721, + 0.05068482086062431, + 0.6071085035800934, + 1.6904046516865492, + 1.321016876026988, + 0.553051920607686, + 1.2546878904104233, + 0.5873189121484756, + 0.7757686041295528, + 1.049938853830099, + 1.8010486867278814, + 1.1572126969695091, + 0.2931574173271656, + 1.0843681674450636 + ], + "unique_experts": 64, + "load_cv": 0.4623558582646061, + "normalized_load_entropy": 0.9743763157308244, + "max_load_share": 0.035398230088495575 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "d593944c41bf38d6800a60aa4618513007608543520a269e87e3a312733c6abb", + "route_weight_sha256": "2a24087c5dda51f4751ce4f067646243e8ab6ba725eb505c44f4905178e0f0b9", + "loads": [ + 16, + 21, + 7, + 10, + 25, + 15, + 12, + 8, + 19, + 17, + 15, + 12, + 6, + 11, + 12, + 21, + 15, + 5, + 7, + 17, + 8, + 23, + 13, + 7, + 16, + 10, + 9, + 16, + 14, + 5, + 15, + 20, + 13, + 13, + 20, + 29, + 18, + 6, + 11, + 11, + 8, + 11, + 22, + 4, + 10, + 11, + 16, + 30, + 13, + 11, + 8, + 10, + 10, + 23, + 20, + 10, + 16, + 14, + 10, + 25, + 32, + 15, + 18, + 29 + ], + "weighted_loads": [ + 1.7332929484546185, + 1.9250725843012333, + 0.34685766138136387, + 1.1946916729211807, + 1.8173595741391182, + 1.1467507258057594, + 1.132369976490736, + 0.4913860894739628, + 1.600877931341529, + 1.53285207785666, + 0.8716780077666044, + 0.7162230322137475, + 0.24147947132587433, + 0.39329705759882927, + 0.9299733396619558, + 1.3919126708060503, + 0.731676334515214, + 0.21184934675693512, + 0.500379528850317, + 1.2860977873206139, + 0.5457649007439613, + 1.8390474952757359, + 1.8525453303009272, + 0.4379209354519844, + 0.703729247674346, + 0.7596678901463747, + 0.6211600508540869, + 1.4501194711774588, + 0.6546277236193419, + 0.20725075528025627, + 0.9469564743340015, + 1.497271278873086, + 0.7854796331375837, + 1.321712994016707, + 1.252327224239707, + 2.4536224100738764, + 1.493002975359559, + 0.8596379309892654, + 0.5792668387293816, + 0.8767445124685764, + 0.6071262303739786, + 0.7378494590520859, + 1.9255293440073729, + 0.34364668279886246, + 1.2006296142935753, + 0.8094000853598118, + 1.267615806311369, + 2.1668290682137012, + 0.9200585205107927, + 0.4559674207121134, + 1.068578453734517, + 1.0138114504516125, + 0.7833226770162582, + 1.873665178194642, + 1.321016876026988, + 0.553051920607686, + 1.5088341534137726, + 0.8572966083884239, + 0.8864084482192993, + 1.5329771284013987, + 2.5080189555883408, + 1.6348698884248734, + 1.2155531775206327, + 2.355600882321596 + ], + "unique_experts": 64, + "load_cv": 0.4481930890061662, + "normalized_load_entropy": 0.9766203744736915, + "max_load_share": 0.03463203463203463 + } + }, + "s0_x": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "bb9e8ce221ef1e6286792cc13d4ad935e4d0ea16649beefee91dc8e1035159e3", + "route_weight_sha256": "3d33b9853f2690643c201112eb9773cf33ca49abb5d677e466d5c99ed520d633", + "loads": [ + 12, + 8, + 6, + 7, + 23, + 14, + 9, + 5, + 10, + 16, + 8, + 12, + 5, + 8, + 7, + 18, + 13, + 5, + 8, + 10, + 4, + 12, + 11, + 7, + 9, + 9, + 9, + 13, + 11, + 5, + 12, + 17, + 13, + 12, + 11, + 12, + 16, + 5, + 6, + 8, + 7, + 11, + 12, + 3, + 9, + 12, + 10, + 23, + 10, + 11, + 8, + 3, + 9, + 21, + 20, + 10, + 12, + 8, + 8, + 13, + 19, + 8, + 9, + 16 + ], + "weighted_loads": [ + 1.3001432456076145, + 0.8571769427508116, + 0.32732950523495674, + 0.3842336777597666, + 1.747902611270547, + 1.0068878959864378, + 1.0196757968515158, + 0.28526866994798183, + 0.7559238448739052, + 1.4125098250806332, + 0.5434947237372398, + 0.7055157264694571, + 0.21026502177119255, + 0.31742413714528084, + 0.6136816181242466, + 1.2071892526000738, + 0.6687171850353479, + 0.22559796646237373, + 0.5325779281556606, + 0.5593609362840652, + 0.23221785575151443, + 1.0099104326218367, + 1.722238551825285, + 0.447725934907794, + 0.4019505511969328, + 0.731070464476943, + 0.6333728656172752, + 0.812107415869832, + 0.4101183842867613, + 0.22443876042962074, + 0.8392355479300022, + 1.3608366772532463, + 0.8112891986966133, + 1.0927289631217718, + 0.8857899717986584, + 0.6493917927145958, + 1.3511311654001474, + 0.7974454797804356, + 0.3354568798094988, + 0.5316873788833618, + 0.5214101914316416, + 0.7147518079727888, + 0.6972295716404915, + 0.17825203388929367, + 0.6145581100136042, + 0.882262472063303, + 0.6599348373711109, + 1.7709157783538103, + 0.813959039747715, + 0.447615722194314, + 1.0845999717712402, + 0.10574301518499851, + 0.6336659826338291, + 1.7044701278209686, + 1.2646825090050697, + 0.5183171592652798, + 1.2426579147577286, + 0.611287783831358, + 0.7751523666083813, + 1.0624727830290794, + 1.7243429813534021, + 1.1920946091413498, + 0.41619932278990746, + 1.0915335603058338 + ], + "unique_experts": 64, + "load_cv": 0.42566892961931174, + "normalized_load_entropy": 0.978985502648963, + "max_load_share": 0.03392330383480826 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "ed531eff54b08ebbf9f9a97860e7feb11e9cf815ab73cbcb1f7a5deff1108ede", + "route_weight_sha256": "4b87e9ac54d75b657fa304fc9e3ec28523ae2d55a07f2192289a3b4476392ad6", + "loads": [ + 12, + 18, + 6, + 8, + 23, + 14, + 10, + 7, + 13, + 16, + 13, + 13, + 6, + 8, + 14, + 18, + 14, + 5, + 8, + 14, + 8, + 22, + 11, + 7, + 11, + 9, + 9, + 15, + 13, + 5, + 12, + 17, + 13, + 12, + 16, + 27, + 16, + 5, + 9, + 8, + 7, + 11, + 19, + 3, + 9, + 12, + 12, + 28, + 11, + 11, + 8, + 9, + 9, + 21, + 20, + 10, + 12, + 15, + 17, + 17, + 31, + 11, + 14, + 26 + ], + "weighted_loads": [ + 1.3001432456076145, + 1.806116545572877, + 0.32732950523495674, + 1.1128925327211618, + 1.747902611270547, + 1.0068878959864378, + 1.054718853905797, + 0.4487244877964258, + 1.0153409130871296, + 1.4125098250806332, + 0.7783913426101208, + 0.740670464001596, + 0.24023711495101452, + 0.31742413714528084, + 0.8875943310558796, + 1.2071892526000738, + 0.6996322125196457, + 0.22559796646237373, + 0.5325779281556606, + 1.2804742455482483, + 0.575291458517313, + 2.0124739911407232, + 1.722238551825285, + 0.447725934907794, + 0.5197234880179167, + 0.731070464476943, + 0.6333728656172752, + 1.0543651152402163, + 0.6705457400530577, + 0.22443876042962074, + 0.8392355479300022, + 1.3608366772532463, + 0.8112891986966133, + 1.0927289631217718, + 1.110530223697424, + 2.633698958903551, + 1.3511311654001474, + 0.7974454797804356, + 0.43011710327118635, + 0.5316873788833618, + 0.5214101914316416, + 0.7147518079727888, + 1.4155852422118187, + 0.17825203388929367, + 0.6145581100136042, + 0.882262472063303, + 0.7266137730330229, + 2.0577346738427877, + 0.8393678907305002, + 0.447615722194314, + 1.0845999717712402, + 0.6988477874547243, + 0.6336659826338291, + 1.7044701278209686, + 1.2646825090050697, + 0.5183171592652798, + 1.2426579147577286, + 0.9912524074316025, + 1.2674454860389233, + 1.243994863703847, + 2.6416602209210396, + 1.3571527414023876, + 0.8464286848902702, + 1.7356405667960644 + ], + "unique_experts": 64, + "load_cv": 0.45046852108903995, + "normalized_load_entropy": 0.9769425021752794, + "max_load_share": 0.03743961352657005 + } + }, + "s1_x": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "8d58d454da9157f639c9c90ccddef138a7881da87d6a5bc2e8246ab9560d3846", + "route_weight_sha256": "60005a0958ddddbbd73d3176fc2427071b2ac3f21c6e6593c0354e5d3084ecbc", + "loads": [ + 12, + 8, + 6, + 7, + 24, + 14, + 11, + 4, + 10, + 16, + 8, + 12, + 7, + 9, + 3, + 18, + 12, + 5, + 6, + 11, + 4, + 13, + 12, + 6, + 10, + 11, + 10, + 13, + 9, + 5, + 14, + 17, + 13, + 14, + 10, + 12, + 18, + 5, + 5, + 8, + 8, + 10, + 10, + 3, + 8, + 11, + 11, + 24, + 11, + 9, + 8, + 1, + 9, + 20, + 20, + 10, + 12, + 8, + 8, + 13, + 21, + 8, + 8, + 15 + ], + "weighted_loads": [ + 1.2556018084287643, + 0.8518331274390221, + 0.3218979351222515, + 0.3886003792285919, + 1.7626989018172026, + 1.000068435445428, + 1.09317940287292, + 0.26522438786923885, + 0.7918501049280167, + 1.4253472872078419, + 0.5620467606931925, + 0.7246231054887176, + 0.2981331702321768, + 0.34308812767267227, + 0.43121689558029175, + 1.2944463025778532, + 0.6397987958043814, + 0.20417870953679085, + 0.4633927345275879, + 0.5586262494325638, + 0.23371494188904762, + 1.0210325997322798, + 1.832712097093463, + 0.4075928255915642, + 0.41636794432997704, + 0.7695405520498753, + 0.6564848870038986, + 0.8043207488954067, + 0.33877985551953316, + 0.2048870287835598, + 0.8919133078306913, + 1.4134676661342382, + 0.7863552048802376, + 1.3481018878519535, + 0.857798496261239, + 0.6862280461937189, + 1.4894854240119457, + 0.8023486062884331, + 0.3045407049357891, + 0.5209965575486422, + 0.6004149466753006, + 0.6990097686648369, + 0.6392182968556881, + 0.15811840817332268, + 0.577636668458581, + 0.8058607690036297, + 0.725297225639224, + 1.812169460579753, + 0.8540980126708746, + 0.38736227340996265, + 1.0704065319150686, + 0.04661120846867561, + 0.6118663176894188, + 1.6851036697626114, + 1.3335921671241522, + 0.5554269179701805, + 1.2288816291838884, + 0.6000922583043575, + 0.7676777876913548, + 1.0651986878365278, + 1.760458093136549, + 1.1551193557679653, + 0.3066409919410944, + 1.046374574303627 + ], + "unique_experts": 64, + "load_cv": 0.4575125191797325, + "normalized_load_entropy": 0.97494590426279, + "max_load_share": 0.035398230088495575 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "b28955e0a75a021b4f3308ecb65d6ceab267b61eef588727f760341104e25cf9", + "route_weight_sha256": "713b5181c6341409a3da9119e723bb082e46e787aabb993dbba9148a2c3d85d1", + "loads": [ + 16, + 19, + 7, + 9, + 25, + 15, + 11, + 8, + 19, + 17, + 17, + 13, + 8, + 11, + 11, + 19, + 15, + 5, + 6, + 17, + 8, + 24, + 13, + 6, + 16, + 12, + 10, + 16, + 13, + 5, + 15, + 19, + 13, + 14, + 19, + 30, + 18, + 6, + 10, + 11, + 8, + 10, + 20, + 4, + 11, + 11, + 18, + 32, + 13, + 10, + 9, + 9, + 10, + 23, + 20, + 10, + 16, + 14, + 11, + 25, + 33, + 15, + 18, + 28 + ], + "weighted_loads": [ + 1.7749049067497253, + 1.8570877946913242, + 0.34736805967986584, + 1.149351492524147, + 1.7929397076368332, + 1.141647631302476, + 1.09317940287292, + 0.48320996575057507, + 1.6023473981767893, + 1.5421719066798687, + 0.9812502544373274, + 0.7595077371224761, + 0.3244545999914408, + 0.38998207077383995, + 0.8770244028419256, + 1.3268537987023592, + 0.737578859552741, + 0.20417870953679085, + 0.4633927345275879, + 1.296866100281477, + 0.5512146633118391, + 2.096266184002161, + 1.8715593162924051, + 0.4075928255915642, + 0.6979471184313297, + 0.819845374673605, + 0.6564848870038986, + 1.4555940888822079, + 0.6047100089490414, + 0.2048870287835598, + 0.9258434716612101, + 1.4564253110438585, + 0.7863552048802376, + 1.3481018878519535, + 1.2249328549951315, + 2.482799058780074, + 1.4894854240119457, + 0.8441879525780678, + 0.4568127207458019, + 0.8745200876146555, + 0.6004149466753006, + 0.6990097686648369, + 1.8217317126691341, + 0.3389499597251415, + 1.2275380436331034, + 0.8058607690036297, + 1.3390446286648512, + 2.215278809890151, + 0.922950679436326, + 0.43027728982269764, + 1.0965959336608648, + 0.9499771259725094, + 0.7880804911255836, + 1.8683641962707043, + 1.3335921671241522, + 0.5554269179701805, + 1.4830278921872377, + 0.8697970323264599, + 0.9842947646975517, + 1.5537323970347643, + 2.5150366965681314, + 1.6322959922254086, + 1.1750802844762802, + 2.0523621048778296 + ], + "unique_experts": 64, + "load_cv": 0.45235506046577706, + "normalized_load_entropy": 0.9763979679957857, + "max_load_share": 0.03571428571428571 + } + }, + "s0_period": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "7a2311c2c84f1dfb46b73041843078e92e518943725c6f0643b02418c2386c97", + "route_weight_sha256": "13d100e53fa84d07f03fc281a71f06f4cc6526cd0cb2fe1b5798668ccb5f3a12", + "loads": [ + 12, + 9, + 5, + 7, + 24, + 14, + 9, + 5, + 10, + 16, + 8, + 12, + 5, + 8, + 7, + 18, + 13, + 5, + 8, + 10, + 4, + 12, + 11, + 7, + 9, + 8, + 8, + 12, + 11, + 5, + 13, + 17, + 13, + 12, + 11, + 12, + 16, + 5, + 6, + 8, + 7, + 11, + 12, + 3, + 9, + 12, + 9, + 23, + 10, + 11, + 8, + 3, + 9, + 21, + 20, + 10, + 12, + 8, + 9, + 13, + 19, + 8, + 11, + 15 + ], + "weighted_loads": [ + 1.2903693169355392, + 0.8748083338141441, + 0.2945513501763344, + 0.3795353639870882, + 1.7830105666071177, + 1.005855130031705, + 1.0214022248983383, + 0.2857730593532324, + 0.7468097098171711, + 1.4065504781901836, + 0.5445968527346849, + 0.7080021221190691, + 0.20885652676224709, + 0.31952323392033577, + 0.6182381641119719, + 1.2120620775967836, + 0.6757689863443375, + 0.22051734291017056, + 0.5317062437534332, + 0.5575252436101437, + 0.2311481572687626, + 1.0074696205556393, + 1.7202477157115936, + 0.4487274568527937, + 0.40263273380696774, + 0.694177832454443, + 0.6019102521240711, + 0.7808296103030443, + 0.4099295809864998, + 0.2261948138475418, + 0.8686237800866365, + 1.3626349307596684, + 0.8143956623971462, + 1.1133863339200616, + 0.8900217786431313, + 0.6430769339203835, + 1.3558271173387766, + 0.7941402494907379, + 0.331907669082284, + 0.530536200851202, + 0.5259446129202843, + 0.7180023398250341, + 0.6976963989436626, + 0.1760544218122959, + 0.6177188381552696, + 0.8761108666658401, + 0.6225830838084221, + 1.758747247979045, + 0.8124919086694717, + 0.4476670175790787, + 1.0821078307926655, + 0.10381517373025417, + 0.6312347799539566, + 1.7016731891781092, + 1.2691413387656212, + 0.5196984689682722, + 1.2480082660913467, + 0.6089079566299915, + 0.7938594948500395, + 1.0634950324892998, + 1.7110734730958939, + 1.1925340108573437, + 0.4842170048505068, + 1.056099435314536 + ], + "unique_experts": 64, + "load_cv": 0.4298998902609776, + "normalized_load_entropy": 0.9786082002181933, + "max_load_share": 0.035398230088495575 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "6dbdb63cef857741cadd4339f206fbbeb34180d43211ebac36689619fc5c3140", + "route_weight_sha256": "ba1ac41629c6bf916038469a21373cad251d4b2de2f555a4b10bed979ef9fea1", + "loads": [ + 13, + 19, + 5, + 9, + 24, + 14, + 9, + 7, + 14, + 16, + 11, + 12, + 5, + 8, + 14, + 19, + 13, + 5, + 8, + 14, + 8, + 21, + 11, + 7, + 12, + 8, + 8, + 14, + 13, + 5, + 13, + 17, + 13, + 13, + 16, + 26, + 16, + 5, + 10, + 8, + 7, + 11, + 19, + 3, + 9, + 12, + 12, + 28, + 12, + 11, + 8, + 9, + 9, + 21, + 20, + 10, + 12, + 15, + 17, + 17, + 32, + 11, + 16, + 24 + ], + "weighted_loads": [ + 1.583320751786232, + 1.8237479366362095, + 0.2945513501763344, + 1.1410220470279455, + 1.7830105666071177, + 1.005855130031705, + 1.0214022248983383, + 0.445515314117074, + 1.0502821765840054, + 1.4065504781901836, + 0.6702433656901121, + 0.7080021221190691, + 0.20885652676224709, + 0.31952323392033577, + 0.8902361746877432, + 1.2568950448185205, + 0.6757689863443375, + 0.22051734291017056, + 0.5317062437534332, + 1.301710482686758, + 0.5161238461732864, + 1.8802701644599438, + 1.7202477157115936, + 0.4487274568527937, + 0.550646772608161, + 0.694177832454443, + 0.6019102521240711, + 1.0261676330119371, + 0.6415497213602066, + 0.2261948138475418, + 0.8686237800866365, + 1.3626349307596684, + 0.8143956623971462, + 1.16204531211406, + 1.1147620305418968, + 2.5656020119786263, + 1.3558271173387766, + 0.7941402494907379, + 0.4866881584748626, + 0.530536200851202, + 0.5259446129202843, + 0.7180023398250341, + 1.4389013312757015, + 0.1760544218122959, + 0.6177188381552696, + 0.8761108666658401, + 0.7153593264520168, + 2.047384472563863, + 0.8639516420662403, + 0.4476670175790787, + 1.0821078307926655, + 0.6702580507844687, + 0.6312347799539566, + 1.7016731891781092, + 1.2691413387656212, + 0.5196984689682722, + 1.2480082660913467, + 0.987613569945097, + 1.1576309781521559, + 1.2441734969615936, + 2.6346143521368504, + 1.3677936270833015, + 0.9135386738926172, + 1.6543498691171408 + ], + "unique_experts": 64, + "load_cv": 0.45336047297175436, + "normalized_load_entropy": 0.9764134445834722, + "max_load_share": 0.03864734299516908 + } + }, + "s1_period": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "8e8918ea80f8ec798d13df29bef88ef2bd429f242243cd79ff0815a12ab110d3", + "route_weight_sha256": "49e06ba81d6a83e29caea102174683548217fb581898a30c631989b0da84a806", + "loads": [ + 12, + 8, + 5, + 7, + 24, + 14, + 11, + 4, + 10, + 16, + 8, + 12, + 7, + 9, + 3, + 20, + 13, + 5, + 6, + 11, + 4, + 13, + 11, + 7, + 10, + 10, + 10, + 13, + 9, + 5, + 14, + 18, + 13, + 13, + 11, + 12, + 18, + 5, + 4, + 8, + 8, + 12, + 11, + 3, + 8, + 11, + 10, + 23, + 12, + 9, + 7, + 1, + 9, + 20, + 20, + 10, + 12, + 8, + 8, + 13, + 20, + 8, + 8, + 14 + ], + "weighted_loads": [ + 1.2470287084579468, + 0.8501687832176685, + 0.2889111712574959, + 0.38985327258706093, + 1.7620613500475883, + 0.9987250305712223, + 1.0946335885673761, + 0.26574521139264107, + 0.7819512821733952, + 1.4251801911741495, + 0.5634691137820482, + 0.7259439900517464, + 0.2956359051167965, + 0.34289237670600414, + 0.4273205101490021, + 1.3578625041991472, + 0.666296923533082, + 0.20414666086435318, + 0.463820468634367, + 0.5581010952591896, + 0.23382487520575523, + 1.0199110079556704, + 1.7946354821324348, + 0.4348279181867838, + 0.4181716311722994, + 0.7309970464557409, + 0.6550763957202435, + 0.8033828604966402, + 0.34285879880189896, + 0.2060367316007614, + 0.8913131766021252, + 1.4473844189196825, + 0.7916999198496342, + 1.3468017000705004, + 0.8880511745810509, + 0.6831583939492702, + 1.4892646074295044, + 0.8040018528699875, + 0.28338606283068657, + 0.5185041781514883, + 0.6026840023696423, + 0.7656766325235367, + 0.6630575321614742, + 0.1561267040669918, + 0.5779635459184647, + 0.8061795309185982, + 0.6859497707337141, + 1.7695081811398268, + 0.8936206642538309, + 0.38849559240043163, + 1.0399579592049122, + 0.04516907036304474, + 0.6151346042752266, + 1.683019632473588, + 1.3329587057232857, + 0.5582558941096067, + 1.2286410219967365, + 0.5936208181083202, + 0.7603248544037342, + 1.06184540130198, + 1.7167240753769875, + 1.1509284488856792, + 0.31059920229017735, + 0.9998276326805353 + ], + "unique_experts": 64, + "load_cv": 0.45963775985530647, + "normalized_load_entropy": 0.9744968810875915, + "max_load_share": 0.035398230088495575 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "4e01ef814638bbefea659566f557190e6d874d1d1a8a56dbea93475752e7a3b0", + "route_weight_sha256": "452f08a5d025384d5ed3831d97fa5cc0a5a47ccb3c477845c37d8b2d9195bc01", + "loads": [ + 17, + 19, + 6, + 10, + 25, + 15, + 11, + 8, + 20, + 17, + 15, + 12, + 7, + 11, + 11, + 22, + 16, + 5, + 6, + 17, + 8, + 23, + 12, + 7, + 16, + 11, + 10, + 16, + 13, + 5, + 15, + 20, + 13, + 14, + 20, + 28, + 18, + 6, + 10, + 11, + 8, + 12, + 21, + 4, + 11, + 11, + 18, + 31, + 15, + 10, + 8, + 9, + 10, + 23, + 20, + 10, + 16, + 14, + 10, + 25, + 33, + 15, + 18, + 26 + ], + "weighted_loads": [ + 2.0338003784418106, + 1.8554234504699707, + 0.3143812958151102, + 1.1857937686145306, + 1.792302155867219, + 1.1403042264282703, + 1.0946335885673761, + 0.48577769473195076, + 1.634245315566659, + 1.5420048106461763, + 0.8687661197036505, + 0.7259439900517464, + 0.2956359051167965, + 0.38980095461010933, + 0.8694242108613253, + 1.425336441025138, + 0.7631633635610342, + 0.20414666086435318, + 0.463820468634367, + 1.3274220265448093, + 0.5090886242687702, + 1.9212994277477264, + 1.833482701331377, + 0.4348279181867838, + 0.6999033261090517, + 0.7813018690794706, + 0.6550763957202435, + 1.457875119522214, + 0.5788961723446846, + 0.2060367316007614, + 0.9252433404326439, + 1.4903420638293028, + 0.7916999198496342, + 1.3867157381027937, + 1.2551855333149433, + 2.38116766884923, + 1.4892646074295044, + 0.8458411991596222, + 0.5046179667115211, + 0.8720277082175016, + 0.6026840023696423, + 0.7656766325235367, + 1.8632646761834621, + 0.33695825561881065, + 1.227864921092987, + 0.8061795309185982, + 1.3256393168121576, + 2.177156852558255, + 0.986979654058814, + 0.4314106088131666, + 1.0661473609507084, + 0.905496209859848, + 0.7913487777113914, + 1.8662801589816809, + 1.3329587057232857, + 0.5582558941096067, + 1.4827872850000858, + 0.862940039485693, + 0.8709646984934807, + 1.5540458355098963, + 2.4880945570766926, + 1.6396571435034275, + 1.179645113646984, + 1.948257613927126 + ], + "unique_experts": 64, + "load_cv": 0.447356048236377, + "normalized_load_entropy": 0.9765592513686546, + "max_load_share": 0.03571428571428571 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 113, + "ordered_topk_exact_tokens": 85, + "set_exact_tokens": 98, + "mean_set_jaccard": 0.9620733249051834, + "mean_token_weighted_tv": 0.008283837104990947, + "aggregate_load_tv": 0.017699115044247787 + }, + "system_bos": { + "tokens": 113, + "ordered_topk_exact_tokens": 69, + "set_exact_tokens": 84, + "mean_set_jaccard": 0.9266750948166879, + "mean_token_weighted_tv": 0.016978048546388087, + "aggregate_load_tv": 0.030973451327433628 + }, + "system_x": { + "tokens": 113, + "ordered_topk_exact_tokens": 64, + "set_exact_tokens": 79, + "mean_set_jaccard": 0.9140328697850824, + "mean_token_weighted_tv": 0.02072923596684648, + "aggregate_load_tv": 0.0368731563421829 + }, + "system_period": { + "tokens": 113, + "ordered_topk_exact_tokens": 62, + "set_exact_tokens": 80, + "mean_set_jaccard": 0.9146649810366625, + "mean_token_weighted_tv": 0.020659981530357516, + "aggregate_load_tv": 0.038348082595870206 + }, + "bos_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 53, + "set_exact_tokens": 74, + "mean_set_jaccard": 0.8938053097345132, + "mean_token_weighted_tv": 0.02512209286781407, + "aggregate_load_tv": 0.04424778761061947 + }, + "bos_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 57, + "set_exact_tokens": 74, + "mean_set_jaccard": 0.8975979772439949, + "mean_token_weighted_tv": 0.024596805210365395, + "aggregate_load_tv": 0.045722713864306784 + }, + "x_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 57, + "set_exact_tokens": 78, + "mean_set_jaccard": 0.9058154235145386, + "mean_token_weighted_tv": 0.022000965110100475, + "aggregate_load_tv": 0.03687315634218289 + }, + "x_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 58, + "set_exact_tokens": 76, + "mean_set_jaccard": 0.9007585335018965, + "mean_token_weighted_tv": 0.024138355693590324, + "aggregate_load_tv": 0.04129793510324484 + }, + "period_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 56, + "set_exact_tokens": 79, + "mean_set_jaccard": 0.9083438685208597, + "mean_token_weighted_tv": 0.02137335534083896, + "aggregate_load_tv": 0.04129793510324484 + }, + "period_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 56, + "set_exact_tokens": 76, + "mean_set_jaccard": 0.9007585335018964, + "mean_token_weighted_tv": 0.023909700239093695, + "aggregate_load_tv": 0.04129793510324484 + } + } + }, + "layer_03": { + "layer": 3, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "8610a4200590c4deaaa179e071c01fef9ea0c94e6db8d45fa602d5c4251edbfe", + "route_weight_sha256": "fbeaeea5525b26b0d60dc1a01fe986f5bc2f49f31e619b64cbf21b1fa3e42d22", + "loads": [ + 2, + 14, + 7, + 11, + 7, + 12, + 6, + 4, + 11, + 12, + 9, + 16, + 6, + 6, + 16, + 11, + 11, + 13, + 6, + 10, + 18, + 12, + 9, + 10, + 7, + 12, + 2, + 8, + 15, + 2, + 10, + 10, + 24, + 5, + 7, + 6, + 9, + 17, + 10, + 17, + 10, + 16, + 1, + 18, + 10, + 13, + 18, + 16, + 7, + 7, + 34, + 2, + 8, + 5, + 10, + 14, + 13, + 13, + 5, + 11, + 11, + 16, + 18, + 2 + ], + "weighted_loads": [ + 0.08814897388219833, + 1.1043955013155937, + 0.4455699734389782, + 0.7405131831765175, + 0.4496558550745249, + 0.7000440899282694, + 0.23834986612200737, + 0.25241008028388023, + 0.7750371266156435, + 0.671327967196703, + 1.1559685170650482, + 0.8945362530648708, + 0.3591437377035618, + 0.30926375463604927, + 2.043415602296591, + 1.3456047251820564, + 0.7572074215859175, + 1.0657993648201227, + 0.2536870576441288, + 0.6189726945012808, + 1.3211510851979256, + 0.9494247436523438, + 0.5295337587594986, + 0.9707304257899523, + 0.5199023522436619, + 0.9612938426434994, + 0.07666663825511932, + 0.5890651028603315, + 1.2034997083246708, + 0.13288690894842148, + 0.9432330392301083, + 0.44116015546023846, + 1.9947272203862667, + 0.34938162937760353, + 1.0108899623155594, + 0.2849382497370243, + 0.34352363273501396, + 1.0005111582577229, + 0.8734832741320133, + 1.6175800487399101, + 0.577646266669035, + 1.44739094004035, + 0.032675690948963165, + 1.7558037899434566, + 0.9545713253319263, + 1.2698316238820553, + 1.1847308650612831, + 1.3161971122026443, + 0.3697753958404064, + 0.6871449463069439, + 2.8420648146420717, + 0.18051773123443127, + 0.8064396753907204, + 0.40550729259848595, + 1.2141683660447598, + 1.1723427139222622, + 1.6236082706600428, + 0.4754192717373371, + 0.2892104908823967, + 0.6071649305522442, + 0.4818867966532707, + 1.3162374384701252, + 1.8335256949067116, + 0.08815117180347443 + ], + "unique_experts": 64, + "load_cv": 0.5349490627476604, + "normalized_load_entropy": 0.9657824395081648, + "max_load_share": 0.05014749262536873 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "be3332afefd73eb84b7a6144522fe3da1590c50f3bef0fdd250319078a691b89", + "route_weight_sha256": "6c7515b2c5f8df85e463b7d846999c603c6d1d77a33d5d9cd896d4cdf4174b99", + "loads": [ + 11, + 14, + 7, + 21, + 10, + 15, + 6, + 12, + 11, + 17, + 11, + 17, + 8, + 10, + 23, + 11, + 11, + 13, + 6, + 10, + 20, + 14, + 13, + 12, + 7, + 14, + 2, + 14, + 15, + 5, + 11, + 10, + 24, + 5, + 16, + 6, + 9, + 17, + 10, + 17, + 10, + 17, + 11, + 18, + 10, + 15, + 30, + 16, + 14, + 17, + 35, + 2, + 9, + 5, + 15, + 15, + 13, + 14, + 6, + 11, + 19, + 16, + 21, + 4 + ], + "weighted_loads": [ + 1.4192206040024757, + 1.1043955013155937, + 0.4455699734389782, + 1.3297344669699669, + 0.5285133001161739, + 0.8710028287023306, + 0.23834986612200737, + 1.5334779918193817, + 0.7750371266156435, + 0.9127481819014065, + 1.2289321757853031, + 0.8954158620908856, + 0.3710678250354249, + 0.6626562215387821, + 2.558222610503435, + 1.3456047251820564, + 0.7572074215859175, + 1.0657993648201227, + 0.2536870576441288, + 0.6189726945012808, + 1.389810549095273, + 1.1157871410250664, + 0.8601634167134762, + 1.0284560918807983, + 0.5199023522436619, + 0.9748470005579293, + 0.07666663825511932, + 0.8137225899845362, + 1.2034997083246708, + 0.2800425700843334, + 0.9901626668870449, + 0.44116015546023846, + 1.9947272203862667, + 0.34938162937760353, + 2.047143794596195, + 0.2849382497370243, + 0.34352363273501396, + 1.0005111582577229, + 0.8734832741320133, + 1.6175800487399101, + 0.577646266669035, + 1.4587178071960807, + 0.6307468004524708, + 1.7558037899434566, + 0.9545713253319263, + 1.3932122774422169, + 2.7836224548518658, + 1.3161971122026443, + 1.1247998885810375, + 1.3020375482738018, + 2.8962098825722933, + 0.18051773123443127, + 0.8210413996130228, + 0.40550729259848595, + 3.206452611833811, + 1.2502006776630878, + 1.6236082706600428, + 0.4881095727905631, + 0.324651338160038, + 0.6071649305522442, + 1.0707102362066507, + 1.3162374384701252, + 2.1595487147569656, + 0.1595315933227539 + ], + "unique_experts": 64, + "load_cv": 0.46514991408945033, + "normalized_load_entropy": 0.9743161693824962, + "max_load_share": 0.042270531400966184 + } + }, + "s1_eos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "59a0cf2b6fbe54a148c34e6abc6fd58264bb549c3393617659ec7b72b7cddb31", + "route_weight_sha256": "5f57d120a0e0520c6b153a2070d944e855852a0ea14b995c4520708f96df8366", + "loads": [ + 2, + 14, + 7, + 12, + 7, + 13, + 6, + 4, + 11, + 11, + 9, + 15, + 6, + 5, + 16, + 12, + 11, + 13, + 6, + 10, + 18, + 12, + 9, + 11, + 7, + 12, + 2, + 8, + 16, + 2, + 10, + 10, + 24, + 5, + 8, + 5, + 9, + 17, + 10, + 17, + 10, + 16, + 1, + 17, + 10, + 13, + 17, + 16, + 7, + 7, + 34, + 2, + 8, + 5, + 10, + 13, + 14, + 13, + 5, + 12, + 10, + 16, + 18, + 2 + ], + "weighted_loads": [ + 0.08584564179182053, + 1.0934759303927422, + 0.44359051808714867, + 0.7661150544881821, + 0.44794722832739353, + 0.7500055525451899, + 0.2391734141856432, + 0.252227108925581, + 0.7677481360733509, + 0.6316709257662296, + 1.1568679846823215, + 0.8744641281664371, + 0.3586242254823446, + 0.2813643701374531, + 2.03692989051342, + 1.4107287749648094, + 0.7657789047807455, + 1.0763183552771807, + 0.2518801037222147, + 0.6191379800438881, + 1.3011974655091763, + 0.9622106179594994, + 0.5334632657468319, + 1.0023382157087326, + 0.5232969708740711, + 0.9676497392356396, + 0.07676158100366592, + 0.5899395495653152, + 1.2730677910149097, + 0.13022495433688164, + 0.9414462558925152, + 0.44194612838327885, + 2.0147406421601772, + 0.3428857885301113, + 1.026470785960555, + 0.24768859706819057, + 0.34413216821849346, + 1.0255917087197304, + 0.8842173777520657, + 1.6142334938049316, + 0.582002080976963, + 1.4440412186086178, + 0.030766084790229797, + 1.7101147547364235, + 0.9502034354954958, + 1.2460477240383625, + 1.1687840670347214, + 1.3260768428444862, + 0.3770965076982975, + 0.6802084557712078, + 2.8313957136124372, + 0.180276645347476, + 0.792748212814331, + 0.4096313491463661, + 1.2362082675099373, + 1.147073969244957, + 1.653331022709608, + 0.46998852118849754, + 0.2819400876760483, + 0.6515154484659433, + 0.42362701892852783, + 1.3180155660957098, + 1.8444133140146732, + 0.09062907472252846 + ], + "unique_experts": 64, + "load_cv": 0.5341677108103174, + "normalized_load_entropy": 0.9656785914818933, + "max_load_share": 0.05014749262536873 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "589edb9857449e0878f804ceac16cd2e4bd2bdbdf7a556e7daa5f95da3231278", + "route_weight_sha256": "5e574147b2661036b5d77e60421249e58818706067ce850c6a661938da5fa7d4", + "loads": [ + 15, + 16, + 7, + 23, + 9, + 18, + 6, + 15, + 11, + 19, + 12, + 16, + 10, + 10, + 25, + 13, + 13, + 13, + 7, + 10, + 20, + 17, + 18, + 12, + 9, + 15, + 2, + 11, + 16, + 5, + 11, + 10, + 24, + 7, + 16, + 5, + 9, + 22, + 10, + 18, + 11, + 17, + 16, + 19, + 10, + 18, + 33, + 16, + 16, + 17, + 35, + 8, + 12, + 10, + 16, + 18, + 14, + 14, + 13, + 13, + 24, + 17, + 23, + 9 + ], + "weighted_loads": [ + 1.7808852307498455, + 1.167781751602888, + 0.44359051808714867, + 1.422420296818018, + 0.49924232333432883, + 1.018436485901475, + 0.2391734141856432, + 1.6185870189219713, + 0.7677481360733509, + 1.0538501084665768, + 1.2420406509190798, + 0.875343737192452, + 0.44793309763190337, + 0.6953482180833817, + 2.7301559560000896, + 1.459928222000599, + 0.9803098123520613, + 1.0763183552771807, + 0.30712644197046757, + 0.6191379800438881, + 1.3675706125795841, + 1.2240016125142574, + 1.3748825043439865, + 1.0321498289704323, + 0.6266159303486347, + 1.0244888518936932, + 0.07676158100366592, + 0.6861121896654367, + 1.2730677910149097, + 0.26990843936800957, + 0.9827100783586502, + 0.44194612838327885, + 2.0147406421601772, + 0.4156319499015808, + 1.943521263077855, + 0.24768859706819057, + 0.34413216821849346, + 1.4434712640941143, + 0.8842173777520657, + 1.6644629836082458, + 0.6568230390548706, + 1.452879031188786, + 0.760128416121006, + 1.7836544811725616, + 0.9502034354954958, + 1.6115207187831402, + 3.3424200899899006, + 1.3260768428444862, + 1.4440325498580933, + 1.1451022885739803, + 2.8806522507220507, + 0.9601177629083395, + 1.0029918001964688, + 1.1260246858000755, + 3.327549397945404, + 1.4589816462248564, + 1.653331022709608, + 0.47900614235550165, + 0.8047396615147591, + 0.6821664571762085, + 1.2869487144052982, + 1.3680536542087793, + 2.257288586348295, + 0.5333637334406376 + ], + "unique_experts": 64, + "load_cv": 0.42342442563379495, + "normalized_load_entropy": 0.9788971334902337, + "max_load_share": 0.03787878787878788 + } + }, + "s0_bos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "9724ed2c2e0c585122c939003331f271b6f67557ec1affbd843f94305b083bdf", + "route_weight_sha256": "98de73fac44b726bc7f2fc4e290ac810eea34f58736062d61faa7bdc5bfafd13", + "loads": [ + 2, + 14, + 7, + 12, + 7, + 12, + 5, + 5, + 12, + 10, + 9, + 19, + 6, + 7, + 16, + 12, + 9, + 13, + 6, + 9, + 18, + 12, + 8, + 11, + 8, + 12, + 2, + 8, + 15, + 2, + 10, + 7, + 23, + 5, + 8, + 7, + 8, + 17, + 10, + 17, + 11, + 15, + 2, + 18, + 9, + 15, + 17, + 17, + 7, + 6, + 36, + 2, + 8, + 5, + 11, + 14, + 13, + 10, + 5, + 10, + 12, + 15, + 18, + 2 + ], + "weighted_loads": [ + 0.08295648545026779, + 1.1187514960765839, + 0.43340643867850304, + 0.79853580519557, + 0.45555152371525764, + 0.6608870774507523, + 0.20349366031587124, + 0.2685241065919399, + 0.7944137807935476, + 0.583137784153223, + 1.182255793362856, + 1.0229561422020197, + 0.3663814924657345, + 0.35599055141210556, + 2.016292069107294, + 1.4220135491341352, + 0.6824209298938513, + 1.0607825294137, + 0.23756710067391396, + 0.597009290009737, + 1.3062902316451073, + 0.9650948829948902, + 0.4755161590874195, + 1.014612728729844, + 0.535608047619462, + 0.9430629592388868, + 0.07322748750448227, + 0.5805175248533487, + 1.233035733923316, + 0.1241503618657589, + 0.9365261346101761, + 0.349227549508214, + 1.9245151281356812, + 0.33107802271842957, + 1.0069270115345716, + 0.30644883774220943, + 0.2989233825355768, + 1.0432770401239395, + 0.8914834093302488, + 1.5834410451352596, + 0.6068080589175224, + 1.4254916124045849, + 0.06123148091137409, + 1.7392067983746529, + 0.940204918384552, + 1.3438123185187578, + 1.158907750621438, + 1.374602546915412, + 0.35750490613281727, + 0.6141469813883305, + 3.0779562275856733, + 0.175762340426445, + 0.8280453830957413, + 0.4113040380179882, + 1.253414936363697, + 1.190815281122923, + 1.700534138828516, + 0.3517856150865555, + 0.3072333950549364, + 0.5965550541877747, + 0.5083535276353359, + 1.293717373162508, + 1.8283106982707977, + 0.08360182866454124 + ], + "unique_experts": 64, + "load_cv": 0.546789995174262, + "normalized_load_entropy": 0.9654531962432634, + "max_load_share": 0.05309734513274336 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "254da6a55b287a1a68ac3f57c71844e7213d208a29c9a9d63da3075e96f47d6b", + "route_weight_sha256": "3798ef2f6591d515df830da9831a47f73cb1d94a4fe782544344e397b64fb94b", + "loads": [ + 12, + 14, + 7, + 22, + 10, + 14, + 5, + 14, + 12, + 15, + 11, + 20, + 7, + 11, + 23, + 12, + 9, + 13, + 7, + 9, + 20, + 15, + 13, + 13, + 8, + 13, + 2, + 14, + 15, + 6, + 11, + 7, + 23, + 5, + 16, + 7, + 8, + 17, + 10, + 17, + 11, + 15, + 13, + 18, + 9, + 17, + 29, + 17, + 15, + 16, + 37, + 2, + 8, + 5, + 15, + 16, + 13, + 10, + 6, + 10, + 19, + 15, + 21, + 4 + ], + "weighted_loads": [ + 1.5200119614601135, + 1.1187514960765839, + 0.43340643867850304, + 1.3877570889890194, + 0.5395305984420702, + 0.7570328712463379, + 0.20349366031587124, + 1.5310297422111034, + 0.7944137807935476, + 0.8428670742432587, + 1.2552194520831108, + 1.0238357512280345, + 0.36685747306910343, + 0.7303153276443481, + 2.548483934253454, + 1.4220135491341352, + 0.6824209298938513, + 1.0607825294137, + 0.27371105179190636, + 0.597009290009737, + 1.3781386446207762, + 1.2124567292630672, + 0.858897726982832, + 1.072060488164425, + 0.535608047619462, + 0.9435911974869668, + 0.07322748750448227, + 0.8051750119775534, + 1.233035733923316, + 0.31015191227197647, + 0.9834557622671127, + 0.349227549508214, + 1.9245151281356812, + 0.33107802271842957, + 2.005665263161063, + 0.30644883774220943, + 0.2989233825355768, + 1.0432770401239395, + 0.8914834093302488, + 1.5834410451352596, + 0.6068080589175224, + 1.4254916124045849, + 0.777913635596633, + 1.7392067983746529, + 0.940204918384552, + 1.4702555779367685, + 2.7577993404120207, + 1.374602546915412, + 1.1899532917886972, + 1.2290395833551884, + 3.1264236699789762, + 0.175762340426445, + 0.8280453830957413, + 0.4113040380179882, + 2.5062829330563545, + 1.3481087945401669, + 1.700534138828516, + 0.3517856150865555, + 0.3471342418342829, + 0.5965550541877747, + 0.9772026035934687, + 1.293717373162508, + 2.154333718121052, + 0.15496474504470825 + ], + "unique_experts": 64, + "load_cv": 0.4762559841319863, + "normalized_load_entropy": 0.9733570402979108, + "max_load_share": 0.04468599033816425 + } + }, + "s1_bos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "e84633124924187836af8e54c578401ff6ef14b570d47490447f274d6fdb93a0", + "route_weight_sha256": "c87d83a25eb47e159b944a027552091acadad8bf6bf04438bad0c310b43005ac", + "loads": [ + 2, + 15, + 8, + 12, + 6, + 11, + 6, + 5, + 13, + 10, + 10, + 16, + 6, + 7, + 16, + 12, + 10, + 14, + 4, + 9, + 18, + 11, + 9, + 11, + 6, + 14, + 2, + 7, + 17, + 2, + 10, + 8, + 25, + 5, + 8, + 6, + 9, + 16, + 10, + 17, + 11, + 16, + 1, + 18, + 9, + 15, + 18, + 16, + 7, + 6, + 36, + 2, + 8, + 5, + 10, + 13, + 14, + 12, + 4, + 12, + 8, + 15, + 17, + 2 + ], + "weighted_loads": [ + 0.07718052342534065, + 1.162921231240034, + 0.476915180683136, + 0.7973973117768764, + 0.4296656660735607, + 0.6147272661328316, + 0.22813740745186806, + 0.27016428858041763, + 0.8324912320822477, + 0.5507519356906414, + 1.2122898027300835, + 0.943191472440958, + 0.3687174152582884, + 0.3465677946805954, + 2.0268551521003246, + 1.44986255094409, + 0.7239296324551105, + 1.1139755249023438, + 0.18278010562062263, + 0.577603105455637, + 1.267395455390215, + 0.9232773631811142, + 0.5345389246940613, + 1.0329885445535183, + 0.4733853340148926, + 0.9744893293827772, + 0.07481546327471733, + 0.542250495404005, + 1.3881647866219282, + 0.12832308188080788, + 0.9246474355459213, + 0.38251789286732674, + 2.0394746400415897, + 0.3353896252810955, + 0.9894572645425797, + 0.25734226033091545, + 0.3377057146281004, + 0.9684228859841824, + 0.90434255823493, + 1.5678672976791859, + 0.5897270925343037, + 1.4617554787546396, + 0.03685847669839859, + 1.6837321668863297, + 0.9053080454468727, + 1.3386733941733837, + 1.2341972906142473, + 1.353967720642686, + 0.356299078091979, + 0.6105141919106245, + 3.0272944159805775, + 0.17662381567060947, + 0.8133990466594696, + 0.4153428189456463, + 1.2252172082662582, + 1.1362794116139412, + 1.7341012209653854, + 0.41727349162101746, + 0.2608276791870594, + 0.6830632034689188, + 0.33860702998936176, + 1.2953255102038383, + 1.7147967927157879, + 0.09156659990549088 + ], + "unique_experts": 64, + "load_cv": 0.5601225428326894, + "normalized_load_entropy": 0.9632096937600108, + "max_load_share": 0.05309734513274336 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "c13ccfe6eb3f717d5bb5be639ce53563ae0f3cac22a9d3da3532c9fcf77b2220", + "route_weight_sha256": "b2d0491922e02e091a2434f843b8991991c743b1b3bc539ca37cac27839d1323", + "loads": [ + 15, + 17, + 8, + 23, + 8, + 16, + 6, + 16, + 13, + 18, + 13, + 17, + 9, + 12, + 25, + 13, + 12, + 14, + 6, + 9, + 20, + 17, + 19, + 12, + 8, + 16, + 2, + 10, + 17, + 5, + 11, + 8, + 25, + 7, + 16, + 6, + 9, + 21, + 10, + 18, + 12, + 16, + 17, + 20, + 9, + 20, + 35, + 16, + 17, + 16, + 37, + 8, + 11, + 10, + 15, + 19, + 14, + 12, + 12, + 13, + 21, + 16, + 22, + 9 + ], + "weighted_loads": [ + 1.779062245041132, + 1.23722705245018, + 0.476915180683136, + 1.4537025541067123, + 0.47835647396277636, + 0.8644671179354191, + 0.22813740745186806, + 1.583215182647109, + 0.8324912320822477, + 0.9872743167798035, + 1.2974624689668417, + 0.9440710814669728, + 0.4500696754839737, + 0.7818337790668011, + 2.73773156106472, + 1.4990619979798794, + 0.9384605400264263, + 1.1139755249023438, + 0.2744436748325825, + 0.577603105455637, + 1.337862428277731, + 1.2569563165307045, + 1.4103245250880718, + 1.0636103078722954, + 0.5767042934894562, + 1.0225118934176862, + 0.07481546327471733, + 0.6384231355041265, + 1.3881647866219282, + 0.26655104756355286, + 0.9659112580120564, + 0.38251789286732674, + 2.0394746400415897, + 0.408135786652565, + 1.9148315861821175, + 0.25734226033091545, + 0.3377057146281004, + 1.3863024413585663, + 0.90434255823493, + 1.6180967874825, + 0.6645480506122112, + 1.4617554787546396, + 0.908607542514801, + 1.7572718933224678, + 0.9053080454468727, + 1.7227765507996082, + 3.445489166304469, + 1.353967720642686, + 1.4824903476983309, + 1.075408024713397, + 3.0685183480381966, + 0.956464933231473, + 1.0132211335003376, + 1.1317361555993557, + 2.4852437898516655, + 1.5135179441422224, + 1.7341012209653854, + 0.41727349162101746, + 0.787179484963417, + 0.713714212179184, + 1.0773392263799906, + 1.3453635983169079, + 2.12767206504941, + 0.5342279095202684 + ], + "unique_experts": 64, + "load_cv": 0.4402620814062992, + "normalized_load_entropy": 0.977559739663468, + "max_load_share": 0.04004329004329004 + } + }, + "s0_x": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "295eeb69965c1dee564167f6ca93833b2582dac110bc228a3a84b9687df5ad4c", + "route_weight_sha256": "90a251c50d7e4d1beadba263a2b19a320d80910dde19f9fc4b99affb02c6d51d", + "loads": [ + 2, + 16, + 8, + 12, + 7, + 12, + 6, + 5, + 13, + 10, + 10, + 17, + 6, + 7, + 16, + 11, + 9, + 13, + 7, + 10, + 18, + 12, + 8, + 11, + 7, + 11, + 2, + 8, + 16, + 2, + 10, + 9, + 23, + 5, + 7, + 7, + 7, + 17, + 10, + 17, + 11, + 15, + 1, + 18, + 10, + 15, + 14, + 17, + 7, + 6, + 36, + 2, + 8, + 5, + 11, + 14, + 13, + 10, + 5, + 10, + 11, + 15, + 18, + 2 + ], + "weighted_loads": [ + 0.08511894568800926, + 1.2130346037447453, + 0.47327568754553795, + 0.7817303463816643, + 0.46572697907686234, + 0.6531151179224253, + 0.23217814229428768, + 0.27341387793421745, + 0.8418025374412537, + 0.5761948935687542, + 1.2093515284359455, + 0.9416172821074724, + 0.370482599362731, + 0.34434718638658524, + 2.0104737877845764, + 1.412263184785843, + 0.6855783127248287, + 1.0486473981291056, + 0.27076859027147293, + 0.6266512162983418, + 1.3134641461074352, + 0.9577058814466, + 0.48076165094971657, + 1.0084256175905466, + 0.49282592721283436, + 0.8987775892019272, + 0.07525213807821274, + 0.5726559534668922, + 1.2893677596002817, + 0.12477816268801689, + 0.9438252337276936, + 0.41496201045811176, + 1.9607911333441734, + 0.34063368290662766, + 0.9572299085557461, + 0.3089644405990839, + 0.276597710326314, + 1.0339228101074696, + 0.8863656222820282, + 1.612360417842865, + 0.5987379215657711, + 1.424418492242694, + 0.02910364232957363, + 1.7103293985128403, + 0.9707748051732779, + 1.352881295606494, + 1.083214396610856, + 1.392927573993802, + 0.3558090701699257, + 0.6254608538001776, + 3.0188596472144127, + 0.17792098596692085, + 0.8431193493306637, + 0.4088495150208473, + 1.2639673110097647, + 1.1995686329901218, + 1.6730905435979366, + 0.3566972501575947, + 0.30356689542531967, + 0.5879209246486425, + 0.46086713299155235, + 1.283421590924263, + 1.8555784933269024, + 0.08619973808526993 + ], + "unique_experts": 64, + "load_cv": 0.5419305378874573, + "normalized_load_entropy": 0.9656578916017385, + "max_load_share": 0.05309734513274336 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "11601385c2f6083400102ea676b5b95e7d1ec37ad5c754beef32bd1ed4f0c9f6", + "route_weight_sha256": "17186c566c07baec257d46b8e78c2a509670d7d06916274176d37b3cd6febe5e", + "loads": [ + 10, + 16, + 8, + 23, + 11, + 13, + 6, + 14, + 13, + 15, + 12, + 18, + 7, + 11, + 23, + 11, + 9, + 13, + 7, + 10, + 19, + 15, + 13, + 13, + 7, + 12, + 3, + 15, + 16, + 6, + 11, + 9, + 23, + 5, + 16, + 7, + 8, + 17, + 10, + 17, + 11, + 15, + 12, + 18, + 10, + 17, + 26, + 17, + 13, + 17, + 37, + 2, + 8, + 5, + 15, + 16, + 13, + 10, + 6, + 10, + 18, + 15, + 21, + 4 + ], + "weighted_loads": [ + 1.21512695774436, + 1.2130346037447453, + 0.47327568754553795, + 1.5051954463124275, + 0.5706023041857406, + 0.7008450869470835, + 0.23217814229428768, + 1.5554364770650864, + 0.8418025374412537, + 0.8587708600680344, + 1.2823151871562004, + 0.9424968911334872, + 0.37095857996609993, + 0.7188738584518433, + 2.486701510846615, + 1.412263184785843, + 0.6855783127248287, + 1.0486473981291056, + 0.27076859027147293, + 0.6266512162983418, + 1.3402491230517626, + 1.2076518908143044, + 0.8576620519161224, + 1.0666017290204763, + 0.49282592721283436, + 0.8993058274500072, + 0.11744838207960129, + 0.8448158875107765, + 1.2893677596002817, + 0.3192397393286228, + 0.9907548613846302, + 0.41496201045811176, + 1.9607911333441734, + 0.34063368290662766, + 2.0579171366989613, + 0.3089644405990839, + 0.3254286628216505, + 1.0339228101074696, + 0.8863656222820282, + 1.612360417842865, + 0.5987379215657711, + 1.424418492242694, + 0.6960657555609941, + 1.7103293985128403, + 0.9707748051732779, + 1.477423807606101, + 2.6821059864014387, + 1.392927573993802, + 1.0361434817314148, + 1.3042957466095686, + 3.0687312334775925, + 0.17792098596692085, + 0.8431193493306637, + 0.4088495150208473, + 2.47745961509645, + 1.3571166954934597, + 1.6730905435979366, + 0.3566972501575947, + 0.35943976044654846, + 0.5879209246486425, + 0.9720094818621874, + 1.283421590924263, + 2.1816015131771564, + 0.15853552147746086 + ], + "unique_experts": 64, + "load_cv": 0.45990236674267915, + "normalized_load_entropy": 0.9752589262293403, + "max_load_share": 0.04468599033816425 + } + }, + "s1_x": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "3645a80cb179cfbd56feee74f0a4f1d5925e0e4fdfdfb8c76565277d35a31493", + "route_weight_sha256": "9c44e7b69a51631aa10a65e54f2a28e30e664c73fee81ebfa41cc5bf3027f6d7", + "loads": [ + 2, + 16, + 8, + 11, + 6, + 10, + 6, + 5, + 12, + 10, + 11, + 16, + 6, + 6, + 16, + 12, + 10, + 14, + 6, + 10, + 18, + 12, + 9, + 11, + 7, + 12, + 2, + 9, + 17, + 2, + 10, + 9, + 25, + 5, + 7, + 6, + 7, + 18, + 10, + 17, + 11, + 14, + 1, + 18, + 9, + 15, + 18, + 17, + 7, + 5, + 35, + 2, + 8, + 5, + 11, + 13, + 13, + 11, + 4, + 11, + 8, + 15, + 17, + 4 + ], + "weighted_loads": [ + 0.07662270963191986, + 1.213723324239254, + 0.4821670465171337, + 0.7588973864912987, + 0.4281396120786667, + 0.5627562776207924, + 0.2274281233549118, + 0.27199486643075943, + 0.8158508725464344, + 0.5442070066928864, + 1.243698488920927, + 0.9392900671809912, + 0.3710799813270569, + 0.2896928619593382, + 2.038871541619301, + 1.4702061377465725, + 0.7284565940499306, + 1.106667835265398, + 0.24226240999996662, + 0.599185898900032, + 1.2610854506492615, + 0.9587151072919369, + 0.5421987771987915, + 1.0307127758860588, + 0.5007717087864876, + 0.9157609511166811, + 0.07504476234316826, + 0.5827723909169436, + 1.4218955803662539, + 0.12922349572181702, + 0.9272147007286549, + 0.4133438281714916, + 2.048171080648899, + 0.334144476801157, + 0.956867516040802, + 0.25963587313890457, + 0.26419452391564846, + 1.0242017153650522, + 0.9082876089960337, + 1.5867796391248703, + 0.5878829658031464, + 1.3953815810382366, + 0.03870626911520958, + 1.6480903327465057, + 0.8984333127737045, + 1.3232236541807652, + 1.2829506192356348, + 1.3963010795414448, + 0.3524947613477707, + 0.5916416589170694, + 2.9456055220216513, + 0.1889960914850235, + 0.817219115793705, + 0.4115756154060364, + 1.2510784789919853, + 1.1383196748793125, + 1.6796864904463291, + 0.3943228591233492, + 0.25452451407909393, + 0.6494127344340086, + 0.32808598689734936, + 1.2689478993415833, + 1.7158002220094204, + 0.15566225908696651 + ], + "unique_experts": 64, + "load_cv": 0.5493303381059106, + "normalized_load_entropy": 0.9648151105817157, + "max_load_share": 0.051622418879056046 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "aeba10f4062e8fd0bf373c371b24746c8c972ce7130966fd388092a943d90641", + "route_weight_sha256": "6cf1a14ab2524343941ec2e007800e9659ba126ae60aebb259662ae58f09ed20", + "loads": [ + 13, + 18, + 8, + 23, + 8, + 14, + 6, + 16, + 12, + 18, + 14, + 17, + 9, + 11, + 25, + 13, + 12, + 14, + 7, + 10, + 19, + 18, + 19, + 12, + 9, + 14, + 3, + 13, + 17, + 6, + 11, + 9, + 25, + 7, + 15, + 6, + 8, + 23, + 10, + 18, + 12, + 14, + 17, + 20, + 9, + 20, + 35, + 17, + 16, + 16, + 36, + 8, + 11, + 10, + 16, + 19, + 13, + 11, + 12, + 12, + 21, + 16, + 22, + 11 + ], + "weighted_loads": [ + 1.5009062960743904, + 1.2880291454494, + 0.4821670465171337, + 1.5629694573581219, + 0.4595001832349226, + 0.7604339234530926, + 0.2274281233549118, + 1.591287275776267, + 0.8158508725464344, + 0.9974369124392979, + 1.3288711551576853, + 0.940169676207006, + 0.4524322415527422, + 0.7196445185691118, + 2.714473158121109, + 1.519405584782362, + 0.9429875016212463, + 1.106667835265398, + 0.2975087482482195, + 0.599185898900032, + 1.2932459153234959, + 1.2943465784192085, + 1.4152844995260239, + 1.062201827764511, + 0.6040906682610512, + 0.9637835151515901, + 0.11412451043725014, + 0.7242413684725761, + 1.4218955803662539, + 0.31267832964658737, + 0.9684785231947899, + 0.4133438281714916, + 2.048171080648899, + 0.4068906381726265, + 1.9262205511331558, + 0.25963587313890457, + 0.30442692898213863, + 1.4420812707394361, + 0.9082876089960337, + 1.6370091289281845, + 0.6627039238810539, + 1.3953815810382366, + 0.8249912858009338, + 1.721630059182644, + 0.8984333127737045, + 1.7108005285263062, + 3.497370271012187, + 1.3963010795414448, + 1.3596851043403149, + 1.1157208438962698, + 2.985531782731414, + 0.968837209045887, + 1.017041202634573, + 1.1279689520597458, + 2.4730587154626846, + 1.5105764847248793, + 1.6796864904463291, + 0.3943228591233492, + 0.7904084287583828, + 0.6800637431442738, + 1.1212836001068354, + 1.3189859874546528, + 2.1286754943430424, + 0.5991213005036116 + ], + "unique_experts": 64, + "load_cv": 0.43062170819052503, + "normalized_load_entropy": 0.978944911629887, + "max_load_share": 0.03896103896103896 + } + }, + "s0_period": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "dd1500cea9d47aeda8812c1ab6ea4b5cad74a6cc1e88738c71fee9dc625a378e", + "route_weight_sha256": "aada0706bb58896290135f6796e34160c39d81d1d68aa2e51ac8cd19ba6148b2", + "loads": [ + 2, + 16, + 8, + 12, + 7, + 12, + 6, + 5, + 13, + 10, + 9, + 17, + 6, + 7, + 16, + 11, + 9, + 13, + 6, + 10, + 18, + 12, + 8, + 11, + 7, + 11, + 2, + 8, + 16, + 3, + 10, + 10, + 24, + 5, + 7, + 6, + 7, + 17, + 10, + 17, + 10, + 15, + 1, + 18, + 10, + 15, + 15, + 17, + 7, + 5, + 36, + 2, + 8, + 5, + 11, + 14, + 13, + 10, + 5, + 11, + 11, + 15, + 18, + 2 + ], + "weighted_loads": [ + 0.08503296971321106, + 1.2116437889635563, + 0.47440529987215996, + 0.7766201384365559, + 0.46398729272186756, + 0.653139840811491, + 0.23562258668243885, + 0.2703859508037567, + 0.842064468190074, + 0.5711537450551987, + 1.174745749682188, + 0.9435747992247343, + 0.3684555198997259, + 0.3410024903714657, + 2.011736299842596, + 1.4132257550954819, + 0.6796971000730991, + 1.0465683415532112, + 0.2397949881851673, + 0.628960944712162, + 1.3067687302827835, + 0.9647679291665554, + 0.4724593237042427, + 1.0084377992898226, + 0.503075260668993, + 0.9060190469026566, + 0.07539540529251099, + 0.5760048814117908, + 1.294241914525628, + 0.1509807389229536, + 0.947410237044096, + 0.4476771764457226, + 1.9993785619735718, + 0.3402770459651947, + 0.9618614129722118, + 0.26961364783346653, + 0.27725074626505375, + 1.0124887395650148, + 0.886763347312808, + 1.6163884699344635, + 0.5619492940604687, + 1.4264559522271156, + 0.028721189126372337, + 1.7287076562643051, + 0.9609265122562647, + 1.3641107138246298, + 1.1053637135773897, + 1.3882348593324423, + 0.35222276486456394, + 0.6006992384791374, + 3.018972121179104, + 0.17770884931087494, + 0.8434000164270401, + 0.4085448682308197, + 1.2483192663639784, + 1.1909480094909668, + 1.6840186472982168, + 0.3595760352909565, + 0.30622396245598793, + 0.6294801067560911, + 0.4624324142932892, + 1.2962101958692074, + 1.8708871565759182, + 0.08648088946938515 + ], + "unique_experts": 64, + "load_cv": 0.5475533355618746, + "normalized_load_entropy": 0.9651984768708047, + "max_load_share": 0.05309734513274336 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "cff2ea74505a0790aaa87d72c60ea2a560e0d2f6317370af9f1af5374adc5c56", + "route_weight_sha256": "8450698983968bcbd6629d8c9f13a18ffa79f637b2474b73fcbdb70e0621f704", + "loads": [ + 10, + 17, + 8, + 23, + 11, + 13, + 6, + 14, + 13, + 16, + 11, + 18, + 7, + 11, + 23, + 11, + 9, + 13, + 6, + 10, + 19, + 15, + 13, + 13, + 7, + 12, + 2, + 14, + 16, + 7, + 11, + 10, + 24, + 5, + 15, + 6, + 7, + 17, + 10, + 17, + 10, + 15, + 12, + 18, + 10, + 18, + 27, + 17, + 13, + 15, + 37, + 2, + 8, + 5, + 15, + 16, + 13, + 10, + 7, + 11, + 19, + 15, + 21, + 4 + ], + "weighted_loads": [ + 1.1465929634869099, + 1.358049426227808, + 0.47440529987215996, + 1.4356224723160267, + 0.5794473876012489, + 0.7008698098361492, + 0.23562258668243885, + 1.5946689695119858, + 0.842064468190074, + 1.0109815985779278, + 1.247709408402443, + 0.9444544082507491, + 0.36893150050309487, + 0.7132477276027203, + 2.611047688871622, + 1.4132257550954819, + 0.6796971000730991, + 1.0465683415532112, + 0.2397949881851673, + 0.628960944712162, + 1.3335537072271109, + 1.2131070159375668, + 0.8481306210160255, + 1.0670520029962063, + 0.503075260668993, + 0.9065472851507366, + 0.07539540529251099, + 0.8006623685359955, + 1.294241914525628, + 0.3378917705267668, + 0.9943398647010326, + 0.4476771764457226, + 1.9993785619735718, + 0.3402770459651947, + 1.9605996645987034, + 0.26961364783346653, + 0.27725074626505375, + 1.0124887395650148, + 0.886763347312808, + 1.6163884699344635, + 0.5619492940604687, + 1.4264559522271156, + 0.6978536266833544, + 1.7287076562643051, + 0.9609265122562647, + 1.5415012445300817, + 2.7042553033679724, + 1.3882348593324423, + 1.0282638315111399, + 1.2155918404459953, + 3.0689187422394753, + 0.17770884931087494, + 0.8434000164270401, + 0.4085448682308197, + 2.4600889664143324, + 1.3444741442799568, + 1.6840186472982168, + 0.3595760352909565, + 0.3960682898759842, + 0.6294801067560911, + 0.9862056467682123, + 1.2962101958692074, + 2.1969101764261723, + 0.1583944819867611 + ], + "unique_experts": 64, + "load_cv": 0.46874841983599486, + "normalized_load_entropy": 0.9741890431854172, + "max_load_share": 0.04468599033816425 + } + }, + "s1_period": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "f6a127463ff479b78a33c8b363291795dd429100ee5b2aa98a99bab0ecf0157e", + "route_weight_sha256": "844728e9247a01b0e070019ac2f232b99be67e0141d00c643939e396560a5f6b", + "loads": [ + 2, + 15, + 8, + 11, + 6, + 10, + 6, + 5, + 13, + 10, + 12, + 16, + 6, + 6, + 16, + 12, + 10, + 14, + 6, + 10, + 18, + 12, + 8, + 11, + 7, + 12, + 2, + 8, + 17, + 2, + 10, + 9, + 25, + 5, + 7, + 6, + 7, + 17, + 10, + 17, + 12, + 14, + 1, + 17, + 9, + 15, + 18, + 17, + 7, + 5, + 35, + 2, + 8, + 5, + 11, + 13, + 13, + 11, + 4, + 12, + 9, + 15, + 17, + 4 + ], + "weighted_loads": [ + 0.07698150724172592, + 1.173631265759468, + 0.48213252052664757, + 0.7585455402731895, + 0.4228206016123295, + 0.5621391274034977, + 0.22985115461051464, + 0.2714751996099949, + 0.8631131127476692, + 0.5437052138149738, + 1.266712475568056, + 0.9239583630114794, + 0.36868416145443916, + 0.28901122137904167, + 2.0475671477615833, + 1.4690941721200943, + 0.7342929616570473, + 1.1011873856186867, + 0.2428572177886963, + 0.5991790238767862, + 1.2587486542761326, + 0.9544055573642254, + 0.47965938225388527, + 1.0281428471207619, + 0.5038622207939625, + 0.9154624007642269, + 0.07398698851466179, + 0.5619718451052904, + 1.422558005899191, + 0.12992101162672043, + 0.9287689588963985, + 0.4130138624459505, + 2.063356928527355, + 0.3334907367825508, + 0.9564345218241215, + 0.26128225587308407, + 0.26567902602255344, + 0.9847568646073341, + 0.9052903652191162, + 1.5850430056452751, + 0.628177534788847, + 1.3959187865257263, + 0.03914829343557358, + 1.610716674476862, + 0.8902850151062012, + 1.3303390182554722, + 1.2832521069794893, + 1.4007194191217422, + 0.34603191539645195, + 0.5873753447085619, + 2.96285630017519, + 0.18915152549743652, + 0.823098823428154, + 0.4116642437875271, + 1.2491285875439644, + 1.137488029897213, + 1.6926308423280716, + 0.3948185332119465, + 0.2552111968398094, + 0.681240938603878, + 0.3777226749807596, + 1.2867542766034603, + 1.7274860627949238, + 0.15612155012786388 + ], + "unique_experts": 64, + "load_cv": 0.5462805090010924, + "normalized_load_entropy": 0.9650820615625794, + "max_load_share": 0.051622418879056046 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "c2f38bcbf03a680d6694955df66915cfbcaa807928260a60b049382651d27630", + "route_weight_sha256": "cdc10c4bbd426357b2c9ba7b7b06016cf94d341ea67903e8e53e529c92bb13b1", + "loads": [ + 12, + 18, + 8, + 23, + 9, + 14, + 6, + 17, + 13, + 19, + 15, + 17, + 9, + 11, + 25, + 13, + 12, + 14, + 7, + 10, + 19, + 18, + 18, + 12, + 9, + 14, + 2, + 11, + 17, + 6, + 11, + 9, + 25, + 7, + 14, + 6, + 7, + 22, + 10, + 18, + 13, + 14, + 18, + 19, + 9, + 21, + 34, + 17, + 15, + 15, + 36, + 8, + 11, + 10, + 16, + 19, + 13, + 11, + 13, + 13, + 23, + 16, + 22, + 11 + ], + "weighted_loads": [ + 1.4024168401956558, + 1.357040572911501, + 0.48213252052664757, + 1.4730482697486877, + 0.49999108992051333, + 0.7618463821709156, + 0.22985115461051464, + 1.6721385661512613, + 0.8631131127476692, + 1.1229798548738472, + 1.3518851418048143, + 0.9248379720374942, + 0.4500364216801245, + 0.7173389345407486, + 2.799802877008915, + 1.5182936191558838, + 0.948823869228363, + 1.1011873856186867, + 0.29810355603694916, + 0.5991790238767862, + 1.290909118950367, + 1.2874228581786156, + 1.3712889775633812, + 1.0596387721598148, + 0.6071811802685261, + 0.9634849647991359, + 0.07398698851466179, + 0.6581444852054119, + 1.422558005899191, + 0.308152437210083, + 0.9700327813625336, + 0.4130138624459505, + 2.063356928527355, + 0.4062368981540203, + 1.833938118070364, + 0.26128225587308407, + 0.26567902602255344, + 1.402636419981718, + 0.9052903652191162, + 1.6352724954485893, + 0.7029984928667545, + 1.3959187865257263, + 0.9135217778384686, + 1.684256400913, + 0.8902850151062012, + 1.780003860592842, + 3.4568881299346685, + 1.4007194191217422, + 1.3086742162704468, + 1.0522691775113344, + 3.002699188888073, + 0.9689926430583, + 1.022920910269022, + 1.1280575804412365, + 2.463449988514185, + 1.5067317131906748, + 1.6926308423280716, + 0.3948185332119465, + 0.8346546106040478, + 0.7118919473141432, + 1.1773528512567282, + 1.3367923647165298, + 2.1403613351285458, + 0.5997918266803026 + ], + "unique_experts": 64, + "load_cv": 0.43114362137048784, + "normalized_load_entropy": 0.9785322770899254, + "max_load_share": 0.03896103896103896 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 113, + "ordered_topk_exact_tokens": 93, + "set_exact_tokens": 102, + "mean_set_jaccard": 0.9721871049304678, + "mean_token_weighted_tv": 0.007465748413078553, + "aggregate_load_tv": 0.011799410029498525 + }, + "system_bos": { + "tokens": 113, + "ordered_topk_exact_tokens": 71, + "set_exact_tokens": 85, + "mean_set_jaccard": 0.9254108723135273, + "mean_token_weighted_tv": 0.016994532568594522, + "aggregate_load_tv": 0.03392330383480826 + }, + "system_x": { + "tokens": 113, + "ordered_topk_exact_tokens": 70, + "set_exact_tokens": 81, + "mean_set_jaccard": 0.913400758533502, + "mean_token_weighted_tv": 0.02079993590251007, + "aggregate_load_tv": 0.028023598820058997 + }, + "system_period": { + "tokens": 113, + "ordered_topk_exact_tokens": 69, + "set_exact_tokens": 79, + "mean_set_jaccard": 0.9102402022756005, + "mean_token_weighted_tv": 0.020955893878651932, + "aggregate_load_tv": 0.02654867256637168 + }, + "bos_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 73, + "set_exact_tokens": 81, + "mean_set_jaccard": 0.9152970922882429, + "mean_token_weighted_tv": 0.020890740265624715, + "aggregate_load_tv": 0.030973451327433628 + }, + "bos_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 65, + "set_exact_tokens": 78, + "mean_set_jaccard": 0.9077117572692796, + "mean_token_weighted_tv": 0.023021293235365795, + "aggregate_load_tv": 0.032448377581120944 + }, + "x_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 70, + "set_exact_tokens": 84, + "mean_set_jaccard": 0.9247787610619469, + "mean_token_weighted_tv": 0.018962100065783062, + "aggregate_load_tv": 0.030973451327433628 + }, + "x_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 58, + "set_exact_tokens": 71, + "mean_set_jaccard": 0.8900126422250317, + "mean_token_weighted_tv": 0.025928669403084612, + "aggregate_load_tv": 0.03687315634218289 + }, + "period_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 72, + "set_exact_tokens": 83, + "mean_set_jaccard": 0.9222503160556259, + "mean_token_weighted_tv": 0.019259649922296538, + "aggregate_load_tv": 0.02654867256637168 + }, + "period_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 59, + "set_exact_tokens": 70, + "mean_set_jaccard": 0.8855878634639698, + "mean_token_weighted_tv": 0.026883867453882652, + "aggregate_load_tv": 0.035398230088495575 + } + } + }, + "layer_04": { + "layer": 4, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "467cf283799077a21c859aef036ba1ab9b8d5cb819f1788fb7b9baf8836fdc5f", + "route_weight_sha256": "1321edb6c09e3e15ee960c7d998cbd073be71967a4554cb61985fa98d15b024b", + "loads": [ + 11, + 23, + 13, + 5, + 2, + 8, + 24, + 13, + 11, + 3, + 11, + 5, + 15, + 0, + 7, + 13, + 10, + 16, + 4, + 12, + 14, + 9, + 14, + 12, + 10, + 5, + 10, + 9, + 21, + 9, + 9, + 16, + 7, + 25, + 3, + 6, + 6, + 21, + 10, + 14, + 4, + 5, + 2, + 12, + 7, + 14, + 7, + 9, + 2, + 12, + 19, + 12, + 15, + 6, + 5, + 11, + 8, + 23, + 19, + 15, + 3, + 8, + 9, + 15 + ], + "weighted_loads": [ + 0.7636147886514664, + 1.9705647509545088, + 0.9848261699080467, + 0.3311116397380829, + 0.19651171192526817, + 0.49396470189094543, + 1.6015387624502182, + 0.7499450445175171, + 0.8425483293831348, + 0.12561440467834473, + 1.0678624510765076, + 0.17491971142590046, + 1.2443137727677822, + 0.0, + 0.9953942857682705, + 0.8390298672020435, + 0.8855725526809692, + 1.334542691707611, + 0.29770132154226303, + 1.1563678104430437, + 1.3018806874752045, + 0.3776037208735943, + 1.1990999206900597, + 0.8721703067421913, + 1.009591531008482, + 0.19999301992356777, + 0.5729375127702951, + 0.4942375645041466, + 1.8273709863424301, + 0.47914931923151016, + 0.6286627948284149, + 0.708179822191596, + 0.3088661693036556, + 1.7948863115161657, + 0.14363104104995728, + 0.22777397744357586, + 0.3950049914419651, + 1.8551276791840792, + 0.946995422244072, + 1.1287868320941925, + 0.1683915201574564, + 0.23358221724629402, + 0.14689235016703606, + 1.1192397996783257, + 0.4024772457778454, + 2.1710003800690174, + 0.23421345092356205, + 0.4469077382236719, + 0.06538514420390129, + 0.8523341044783592, + 1.2285170648247004, + 0.4971781559288502, + 1.373536005616188, + 0.28749528899788857, + 0.45988593250513077, + 0.8854592405259609, + 0.6058381628245115, + 1.6338493078947067, + 1.3330596163868904, + 1.2665404956787825, + 0.14076712355017662, + 0.5752274915575981, + 0.5077791679650545, + 1.169136967509985 + ], + "unique_experts": 63, + "load_cv": 0.5490768327014587, + "normalized_load_entropy": 0.9620972410947348, + "max_load_share": 0.03687315634218289 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "021d5f385d6fefc28eaa16e7fed24df123afcbefa4f0aaf5da2b9248b50c063c", + "route_weight_sha256": "7e2c6050af8f9646ed1dce737d009a766b30430413a545399945c08a136ebc17", + "loads": [ + 11, + 26, + 15, + 9, + 2, + 8, + 25, + 13, + 11, + 4, + 21, + 7, + 15, + 13, + 9, + 16, + 10, + 16, + 9, + 12, + 14, + 11, + 16, + 12, + 10, + 11, + 15, + 10, + 21, + 25, + 10, + 18, + 7, + 27, + 14, + 6, + 6, + 23, + 12, + 14, + 7, + 7, + 10, + 12, + 7, + 15, + 18, + 9, + 3, + 14, + 21, + 12, + 15, + 6, + 5, + 11, + 8, + 23, + 19, + 30, + 7, + 8, + 12, + 15 + ], + "weighted_loads": [ + 0.7636147886514664, + 2.1212868820875883, + 1.1063427180051804, + 0.6369358079973608, + 0.19651171192526817, + 0.49396470189094543, + 1.658218514174223, + 0.7499450445175171, + 0.8425483293831348, + 0.15610678121447563, + 1.725509863346815, + 0.20146007742732763, + 1.2443137727677822, + 0.9363741986453533, + 1.0417938902974129, + 1.0307010039687157, + 0.8855725526809692, + 1.334542691707611, + 0.6111712640558835, + 1.1563678104430437, + 1.3018806874752045, + 1.444650899618864, + 1.3295119404792786, + 0.8721703067421913, + 1.009591531008482, + 0.6410168167203665, + 1.0654136631637812, + 0.5022308640182018, + 1.8273709863424301, + 1.7732226915541105, + 0.6774008683860302, + 0.739018720574677, + 0.3088661693036556, + 1.8350743120536208, + 1.2038020086765755, + 0.22777397744357586, + 0.3950049914419651, + 1.9424098413437605, + 2.077481135725975, + 1.1287868320941925, + 0.30978778563439846, + 0.3444770276546478, + 0.5051693543791771, + 1.1192397996783257, + 0.4024772457778454, + 2.2010571099817753, + 1.3885537777096033, + 0.4469077382236719, + 0.10233510658144951, + 0.9026215597987175, + 1.3257382977753878, + 0.4971781559288502, + 1.373536005616188, + 0.28749528899788857, + 0.45988593250513077, + 0.8854592405259609, + 0.6058381628245115, + 1.6338493078947067, + 1.3330596163868904, + 2.045004015788436, + 0.5397477466904093, + 0.5752274915575981, + 0.7280960660427809, + 1.169136967509985 + ], + "unique_experts": 64, + "load_cv": 0.47468531186559854, + "normalized_load_entropy": 0.9734582412037852, + "max_load_share": 0.036231884057971016 + } + }, + "s1_eos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "7967914d5da72ac5de28c27aaf6930dc73fc7ae46204dd8896ee7a58b2ea20c0", + "route_weight_sha256": "4f3a86de2edb1b8f57f5004d90dc39debd56aef671134b37f7237897774688ee", + "loads": [ + 11, + 24, + 13, + 5, + 2, + 8, + 25, + 13, + 11, + 3, + 11, + 5, + 15, + 0, + 7, + 13, + 10, + 16, + 5, + 12, + 14, + 9, + 14, + 11, + 8, + 4, + 10, + 9, + 20, + 11, + 8, + 16, + 7, + 25, + 3, + 5, + 6, + 21, + 10, + 15, + 5, + 5, + 2, + 12, + 7, + 14, + 8, + 9, + 1, + 12, + 18, + 12, + 15, + 6, + 5, + 11, + 8, + 21, + 19, + 16, + 4, + 9, + 9, + 15 + ], + "weighted_loads": [ + 0.7708200924098492, + 2.003603182733059, + 0.9689081683754921, + 0.32789697870612144, + 0.19755887612700462, + 0.4891172908246517, + 1.6185921654105186, + 0.7480660602450371, + 0.8489699922502041, + 0.1262354739010334, + 1.0575830452144146, + 0.17471917159855366, + 1.250089980661869, + 0.0, + 0.996245376765728, + 0.8421153649687767, + 0.861808355897665, + 1.328057486563921, + 0.3440489396452904, + 1.1442170403897762, + 1.308970257639885, + 0.3774632140994072, + 1.2058491297066212, + 0.8425498269498348, + 0.9433274921029806, + 0.171719865873456, + 0.5706060715019703, + 0.5018299296498299, + 1.791905738413334, + 0.5688479635864496, + 0.5782107412815094, + 0.7078323196619749, + 0.3091206159442663, + 1.790620120242238, + 0.15140013583004475, + 0.19377153366804123, + 0.39271383360028267, + 1.8644815534353256, + 0.9352241419255733, + 1.1973504163324833, + 0.19478454254567623, + 0.2288241982460022, + 0.14274248853325844, + 1.1163420155644417, + 0.3983706720173359, + 2.1853068098425865, + 0.27184937708079815, + 0.43522758036851883, + 0.038281526416540146, + 0.8505459427833557, + 1.1787382327020168, + 0.5070982966572046, + 1.3712426461279392, + 0.29157349094748497, + 0.4556051418185234, + 0.8883518390357494, + 0.6027708258479834, + 1.5187468156218529, + 1.3391468729823828, + 1.2892286833375692, + 0.16835206001996994, + 0.6219749636948109, + 0.5078694932162762, + 1.177068330347538 + ], + "unique_experts": 63, + "load_cv": 0.5475533355618746, + "normalized_load_entropy": 0.9620631583384144, + "max_load_share": 0.03687315634218289 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "6ca5a6e813b2140fb63907b7ddfdbdd994b4523155565eae5bbed1b7c87e784d", + "route_weight_sha256": "310cdccde5486134dcf8b8c409cabaa7197bf3f8d58333828f95b30f7a2cb556", + "loads": [ + 11, + 26, + 16, + 14, + 3, + 8, + 28, + 13, + 11, + 11, + 20, + 7, + 16, + 14, + 10, + 17, + 12, + 18, + 13, + 14, + 15, + 12, + 19, + 12, + 8, + 14, + 18, + 10, + 20, + 31, + 9, + 18, + 7, + 27, + 18, + 5, + 7, + 24, + 14, + 18, + 8, + 10, + 11, + 12, + 9, + 16, + 18, + 13, + 2, + 15, + 21, + 12, + 19, + 10, + 11, + 11, + 13, + 23, + 19, + 32, + 11, + 11, + 13, + 16 + ], + "weighted_loads": [ + 0.7708200924098492, + 2.1308022178709507, + 1.1396535746753216, + 1.0964393695467152, + 0.22885703667998314, + 0.4891172908246517, + 1.8322658725082874, + 0.7480660602450371, + 0.8489699922502041, + 1.1729160211980343, + 1.6473294720053673, + 0.2012461144477129, + 1.3559556603431702, + 0.9958263076841831, + 1.0710131395608187, + 1.1131697781383991, + 1.2246929369866848, + 1.3986774068325758, + 0.9784189809288364, + 1.2345329783856869, + 1.3579006716609001, + 1.4743774458765984, + 1.6313896663486958, + 0.9367409087717533, + 0.9433274921029806, + 0.8890535030514002, + 1.3412018902599812, + 0.5101495366543531, + 1.791905738413334, + 1.8009640574455261, + 0.6248473115265369, + 0.7384012043476105, + 0.3091206159442663, + 1.8312914837151766, + 1.5068176338390913, + 0.19377153366804123, + 0.42002736404538155, + 1.9908448606729507, + 2.268294133245945, + 1.4087184928357601, + 0.3553051855415106, + 0.4425166722503491, + 0.574986819177866, + 1.1163420155644417, + 0.46795017644762993, + 2.2158414347213693, + 1.459361432120204, + 0.7722809389233589, + 0.06782120652496815, + 0.9375076536089182, + 1.3169235289096832, + 0.5070982966572046, + 1.8075552992522717, + 0.474678460508585, + 1.005950704216957, + 0.8883518390357494, + 1.0266514848917723, + 1.5916092339903116, + 1.3391468729823828, + 2.155410112813115, + 1.043900977820158, + 0.8173931501805782, + 0.7998716272413731, + 1.2214993610978127 + ], + "unique_experts": 64, + "load_cv": 0.4260716813412665, + "normalized_load_entropy": 0.9783615823338556, + "max_load_share": 0.03463203463203463 + } + }, + "s0_bos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "ab055421675ff1485183ee2388909b7160cc2f437066105f9a291ef195fb8f68", + "route_weight_sha256": "8d3c59036b48de6eb750e1b44c616e21cd63386267850608ac8f311e2dea9e30", + "loads": [ + 11, + 24, + 13, + 5, + 2, + 8, + 26, + 16, + 11, + 3, + 11, + 5, + 15, + 0, + 7, + 13, + 10, + 16, + 4, + 11, + 15, + 12, + 14, + 11, + 9, + 5, + 9, + 9, + 20, + 7, + 8, + 16, + 7, + 25, + 3, + 5, + 8, + 21, + 10, + 14, + 5, + 5, + 2, + 12, + 6, + 16, + 7, + 9, + 0, + 12, + 23, + 12, + 15, + 6, + 5, + 11, + 7, + 22, + 18, + 15, + 3, + 8, + 7, + 13 + ], + "weighted_loads": [ + 0.7702208794653416, + 2.041252803057432, + 1.0291740745306015, + 0.3296382836997509, + 0.20127757638692856, + 0.5275130458176136, + 1.690748343244195, + 0.8287348579615355, + 0.8578537665307522, + 0.13430487364530563, + 1.027601718902588, + 0.18477222509682178, + 1.2955851145088673, + 0.0, + 1.0088941976428032, + 0.8552093096077442, + 0.8788646273314953, + 1.3510849364101887, + 0.2716129831969738, + 1.116501647979021, + 1.3827883303165436, + 0.4700554069131613, + 1.199750043451786, + 0.8139422331005335, + 1.0142118092626333, + 0.18906359560787678, + 0.5366902872920036, + 0.5073791723698378, + 1.7976427860558033, + 0.37365031242370605, + 0.6146350987255573, + 0.72417251765728, + 0.32410621643066406, + 1.8173322416841984, + 0.13187121413648129, + 0.18713063560426235, + 0.4868917390704155, + 1.8228240814059973, + 0.9353122711181641, + 1.1537208780646324, + 0.20346785336732864, + 0.23464453220367432, + 0.14429201930761337, + 1.1371890790760517, + 0.3581145144999027, + 2.3155028223991394, + 0.24357043579220772, + 0.46917697228491306, + 0.0, + 0.839758213609457, + 1.40583367459476, + 0.5301135499030352, + 1.349891658872366, + 0.2959009185433388, + 0.453646682202816, + 0.9020982831716537, + 0.574723694473505, + 1.6013577673584223, + 1.3225159645080566, + 1.2805765736848116, + 0.1443246342241764, + 0.5844286046922207, + 0.45914771407842636, + 1.0920408740639687 + ], + "unique_experts": 62, + "load_cv": 0.5743583271151282, + "normalized_load_entropy": 0.9581366770484531, + "max_load_share": 0.038348082595870206 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "6b21c567c064a6a3bf74af507d7ffc20c50b78b6a17f4cd5f6928ec0cebcab33", + "route_weight_sha256": "b8da4fa6f1aab7608f3052f53341234b00bf26d15c54b2c334fb484d26a00f55", + "loads": [ + 11, + 27, + 15, + 10, + 2, + 8, + 27, + 16, + 11, + 3, + 21, + 6, + 15, + 13, + 9, + 16, + 10, + 16, + 9, + 11, + 15, + 13, + 16, + 11, + 9, + 11, + 14, + 9, + 20, + 26, + 9, + 17, + 7, + 26, + 15, + 5, + 8, + 23, + 12, + 15, + 8, + 7, + 10, + 12, + 6, + 17, + 18, + 10, + 1, + 13, + 25, + 12, + 15, + 6, + 5, + 11, + 7, + 22, + 18, + 29, + 8, + 8, + 10, + 13 + ], + "weighted_loads": [ + 0.7702208794653416, + 2.1851026713848114, + 1.1506906226277351, + 0.678969636792317, + 0.20127757638692856, + 0.5275130458176136, + 1.7427776623517275, + 0.8287348579615355, + 0.8578537665307522, + 0.13430487364530563, + 1.6852491311728954, + 0.20189966447651386, + 1.2955851145088673, + 0.9226667881011963, + 1.0552938021719456, + 1.0485254898667336, + 0.8788646273314953, + 1.3510849364101887, + 0.6614987327193376, + 1.116501647979021, + 1.3827883303165436, + 0.7610557731240988, + 1.321050189435482, + 0.8139422331005335, + 1.0142118092626333, + 0.6437153983861208, + 1.0441773682832718, + 0.5073791723698378, + 1.7976427860558033, + 1.9122579984250478, + 0.6603419370949268, + 0.7425446975976229, + 0.32410621643066406, + 1.842684743925929, + 1.2571089514822233, + 0.18713063560426235, + 0.4868917390704155, + 1.9112423975020647, + 2.0541470274329185, + 1.1855285242199898, + 0.3448641188442707, + 0.35130003094673157, + 0.5025690235197544, + 1.1371890790760517, + 0.3581145144999027, + 2.3455595523118973, + 1.397910762578249, + 0.5030025485903025, + 0.03694996237754822, + 0.8677579089999199, + 1.5037054736167192, + 0.5301135499030352, + 1.349891658872366, + 0.2959009185433388, + 0.453646682202816, + 0.9020982831716537, + 0.574723694473505, + 1.6013577673584223, + 1.3225159645080566, + 2.020347783342004, + 0.7469127942167688, + 0.5844286046922207, + 0.6804347708821297, + 1.0920408740639687 + ], + "unique_experts": 64, + "load_cv": 0.4918766469019062, + "normalized_load_entropy": 0.9708528120706339, + "max_load_share": 0.035024154589371984 + } + }, + "s1_bos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "38ad88d591fc0bef5027be241892f3c2cdb49583c96501ef4ac5e93d4e30bd78", + "route_weight_sha256": "d907f12215fb9b01a71dff6547b6477bd5c592fbf4cd03bca132c7290f226f74", + "loads": [ + 11, + 24, + 15, + 4, + 2, + 8, + 24, + 17, + 11, + 2, + 10, + 5, + 15, + 0, + 8, + 13, + 10, + 17, + 5, + 11, + 16, + 11, + 13, + 13, + 8, + 4, + 9, + 8, + 19, + 7, + 8, + 15, + 8, + 25, + 3, + 5, + 8, + 21, + 10, + 14, + 5, + 5, + 3, + 12, + 6, + 14, + 7, + 9, + 0, + 12, + 21, + 12, + 15, + 6, + 5, + 11, + 8, + 20, + 18, + 15, + 5, + 8, + 8, + 16 + ], + "weighted_loads": [ + 0.7825876660645008, + 2.009973803535104, + 1.0527299232780933, + 0.28713173419237137, + 0.20420075953006744, + 0.5287723578512669, + 1.5808883402496576, + 0.8723694980144501, + 0.8820333741605282, + 0.0989869236946106, + 1.0222649313509464, + 0.18454615026712418, + 1.3043841123580933, + 0.0, + 1.0207858476787806, + 0.8706140033900738, + 0.8637445829808712, + 1.4100909605622292, + 0.31414756178855896, + 1.0773590989410877, + 1.4315470643341541, + 0.4417289774864912, + 1.1156046725809574, + 0.9006673283874989, + 0.977567920461297, + 0.17483524233102798, + 0.5636634230613708, + 0.4778047427535057, + 1.7813385985791683, + 0.37190018221735954, + 0.6067181527614594, + 0.7000565975904465, + 0.36314259469509125, + 1.8074223045259714, + 0.13194071501493454, + 0.1765956413000822, + 0.4958265833556652, + 1.8147356119006872, + 0.9268936552107334, + 1.1501953229308128, + 0.2014898546040058, + 0.23211708292365074, + 0.17426520213484764, + 1.1413489952683449, + 0.3563723359256983, + 2.200502585619688, + 0.23990699462592602, + 0.4498285409063101, + 0.0, + 0.8552203290164471, + 1.3255974985659122, + 0.5189947225153446, + 1.276998095214367, + 0.31140876933932304, + 0.4661070331931114, + 0.8992676101624966, + 0.6215709745883942, + 1.5485288463532925, + 1.3297307416796684, + 1.316587494686246, + 0.20924660190939903, + 0.5970409363508224, + 0.4867212362587452, + 1.2316231206059456 + ], + "unique_experts": 62, + "load_cv": 0.5556303845325287, + "normalized_load_entropy": 0.9601201729417176, + "max_load_share": 0.03687315634218289 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "3a2674b4391c2d20f9a923c2f85a93eaf9893a01ea286ba5d2978dd719ff36ef", + "route_weight_sha256": "12feea1590a96daa52f3892d870885d9a568bb8561ac0f9d5c3028ae2fa00cd5", + "loads": [ + 11, + 26, + 18, + 14, + 3, + 8, + 27, + 17, + 11, + 10, + 19, + 6, + 16, + 14, + 11, + 17, + 12, + 19, + 13, + 13, + 17, + 13, + 18, + 14, + 8, + 14, + 17, + 8, + 19, + 28, + 9, + 16, + 8, + 26, + 19, + 5, + 9, + 24, + 14, + 17, + 8, + 10, + 12, + 12, + 8, + 16, + 18, + 13, + 1, + 14, + 24, + 12, + 19, + 10, + 11, + 11, + 13, + 22, + 18, + 30, + 14, + 10, + 12, + 18 + ], + "weighted_loads": [ + 0.7825876660645008, + 2.134657980874181, + 1.2234753295779228, + 1.0960617629461922, + 0.24057356640696526, + 0.5287723578512669, + 1.7767619956284761, + 0.8723694980144501, + 0.8820333741605282, + 1.1456674709916115, + 1.612011358141899, + 0.20167358964681625, + 1.4102497920393944, + 0.9804045744240284, + 1.0955536104738712, + 1.1523764804005623, + 1.226629164069891, + 1.480710880830884, + 1.0123284582223278, + 1.1676750369369984, + 1.4804774783551693, + 0.7728454153984785, + 1.5210551135241985, + 0.9948584102094173, + 0.977567920461297, + 0.8722478710114956, + 1.3446549326181412, + 0.4778047427535057, + 1.7813385985791683, + 1.6829558927565813, + 0.6535818055272102, + 0.7184287775307894, + 0.36314259469509125, + 1.832774806767702, + 1.5096009677217808, + 0.1765956413000822, + 0.5231401138007641, + 1.9415046442300081, + 2.2530923783779144, + 1.3615633994340897, + 0.36201049759984016, + 0.4582857404020615, + 0.6065095327794552, + 1.1413489952683449, + 0.4259518403559923, + 2.231037210498471, + 1.4756264183670282, + 0.7868818994611502, + 0.029539680108428, + 0.9193025343120098, + 1.463809259235859, + 0.5189947225153446, + 1.7133107483386993, + 0.49451373890042305, + 1.016452595591545, + 0.8992676101624966, + 1.045451633632183, + 1.6213912647217512, + 1.3297307416796684, + 2.1372364722192287, + 1.3266797251999378, + 0.7924591228365898, + 0.7876310609281063, + 1.3096019439399242 + ], + "unique_experts": 64, + "load_cv": 0.41139209394170506, + "normalized_load_entropy": 0.978915277725728, + "max_load_share": 0.032467532467532464 + } + }, + "s0_x": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "c67d187e839cf376b2c6720715775575da886730fc7b51942dbc6f006df2e169", + "route_weight_sha256": "c22df296b4362ae5bd94672c3c21a943bedd8751860fa8fcb29ad2f69216e606", + "loads": [ + 11, + 23, + 14, + 5, + 2, + 8, + 25, + 15, + 11, + 3, + 10, + 5, + 15, + 0, + 8, + 12, + 10, + 16, + 5, + 11, + 16, + 10, + 15, + 11, + 9, + 4, + 10, + 9, + 19, + 6, + 8, + 16, + 8, + 25, + 3, + 6, + 7, + 21, + 10, + 14, + 5, + 5, + 2, + 12, + 6, + 14, + 8, + 9, + 2, + 12, + 21, + 11, + 15, + 6, + 5, + 11, + 7, + 22, + 18, + 16, + 4, + 9, + 9, + 13 + ], + "weighted_loads": [ + 0.7715515121817589, + 2.0110651087015867, + 1.0446713715791702, + 0.341861579567194, + 0.19759390130639076, + 0.5250356942415237, + 1.6705789770931005, + 0.7955616265535355, + 0.8421204835176468, + 0.13209332525730133, + 1.0015756152570248, + 0.1815808340907097, + 1.2760974392294884, + 0.0, + 1.0241996012628078, + 0.8297888487577438, + 0.8925707116723061, + 1.36830735206604, + 0.32667524740099907, + 1.1178390197455883, + 1.4078424274921417, + 0.4099895264953375, + 1.2851977609097958, + 0.8263186514377594, + 0.9716284908354282, + 0.1489062923938036, + 0.5971701890230179, + 0.5067035928368568, + 1.7732058111578226, + 0.32571809366345406, + 0.607483733445406, + 0.7161152213811874, + 0.34917018562555313, + 1.8079214300960302, + 0.1492882054299116, + 0.22981054708361626, + 0.44592104107141495, + 1.8217848930507898, + 0.9320004992187023, + 1.1437001042068005, + 0.20441198907792568, + 0.2379142828285694, + 0.1478237845003605, + 1.1340271569788456, + 0.35941075161099434, + 2.2494788095355034, + 0.2772061564028263, + 0.4647688511759043, + 0.0648290142416954, + 0.8487155996263027, + 1.307763695716858, + 0.4794146195054054, + 1.3679146282374859, + 0.2906148359179497, + 0.4639918804168701, + 0.899406835436821, + 0.5641018450260162, + 1.6130688600242138, + 1.340336736291647, + 1.2959510181099176, + 0.17972614988684654, + 0.6324287354946136, + 0.534321766346693, + 1.078035969287157 + ], + "unique_experts": 63, + "load_cv": 0.5490768327014587, + "normalized_load_entropy": 0.9623980248621323, + "max_load_share": 0.03687315634218289 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "73714549da7d0d35ecf26f1ba95dafc656c3a03b5a144b3ff76f1c02a0a9f87e", + "route_weight_sha256": "d5c4646c635712ebe4870f0c5abe7896c9a214b6b5103903a8998cfd5d2a6981", + "loads": [ + 11, + 27, + 17, + 9, + 2, + 8, + 25, + 15, + 11, + 3, + 21, + 6, + 15, + 12, + 10, + 15, + 10, + 16, + 10, + 11, + 16, + 11, + 17, + 11, + 9, + 10, + 15, + 9, + 19, + 22, + 9, + 17, + 8, + 26, + 13, + 6, + 7, + 23, + 12, + 14, + 9, + 7, + 11, + 12, + 6, + 15, + 21, + 10, + 4, + 13, + 23, + 11, + 15, + 6, + 5, + 11, + 7, + 22, + 18, + 31, + 8, + 9, + 12, + 14 + ], + "weighted_loads": [ + 0.7715515121817589, + 2.2032726239413023, + 1.1974125169217587, + 0.6569632703904063, + 0.19759390130639076, + 0.5250356942415237, + 1.6705789770931005, + 0.7955616265535355, + 0.8421204835176468, + 0.13209332525730133, + 1.8749561831355095, + 0.19870827347040176, + 1.2760974392294884, + 0.8834008239209652, + 1.0705992057919502, + 1.0305568426847458, + 0.8925707116723061, + 1.36830735206604, + 0.6164910307561513, + 1.1178390197455883, + 1.4078424274921417, + 0.700989892706275, + 1.4163864254951477, + 0.8263186514377594, + 0.9716284908354282, + 0.5401966515928507, + 1.1451401039958, + 0.5067035928368568, + 1.7732058111578226, + 1.560729014861863, + 0.6603634916245937, + 0.7344874013215303, + 0.34917018562555313, + 1.833273932337761, + 1.0583536126941908, + 0.22981054708361626, + 0.44592104107141495, + 1.912523465231061, + 2.041487541049719, + 1.1437001042068005, + 0.4033719878643751, + 0.3536565788090229, + 0.5414817370474339, + 1.1340271569788456, + 0.35941075161099434, + 2.2795355394482613, + 1.678048986941576, + 0.49992471747100353, + 0.14526980370283127, + 0.8767152950167656, + 1.4061480276286602, + 0.4794146195054054, + 1.3679146282374859, + 0.2906148359179497, + 0.4639918804168701, + 0.899406835436821, + 0.5641018450260162, + 1.6130688600242138, + 1.340336736291647, + 2.105268247425556, + 0.5677177924953867, + 0.6324287354946136, + 0.7492525279521942, + 1.1095207743346691 + ], + "unique_experts": 64, + "load_cv": 0.47310942516542015, + "normalized_load_entropy": 0.9737027217842901, + "max_load_share": 0.03743961352657005 + } + }, + "s1_x": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "1730868fe3d2592968f9866523c0b09fbc975aec191823397839f53ed4f71387", + "route_weight_sha256": "243786eda8f036ff0a37fa2800a254b85f139c183b0dac66fa3ea6f5fc4e94cb", + "loads": [ + 11, + 23, + 14, + 5, + 2, + 8, + 24, + 16, + 11, + 4, + 10, + 4, + 15, + 0, + 8, + 14, + 10, + 16, + 5, + 11, + 16, + 11, + 13, + 13, + 8, + 4, + 9, + 8, + 19, + 7, + 8, + 16, + 8, + 24, + 2, + 5, + 8, + 21, + 10, + 14, + 6, + 7, + 2, + 12, + 5, + 14, + 7, + 9, + 0, + 12, + 19, + 11, + 15, + 6, + 5, + 11, + 8, + 22, + 19, + 15, + 5, + 8, + 8, + 17 + ], + "weighted_loads": [ + 0.7813452258706093, + 1.9752704910933971, + 1.0299147237092257, + 0.34835294634103775, + 0.19985084235668182, + 0.5345141217112541, + 1.5556268766522408, + 0.8236050177365541, + 0.8716587647795677, + 0.16041307523846626, + 1.0337831862270832, + 0.15634506940841675, + 1.2823116295039654, + 0.0, + 1.011567261070013, + 0.8889144919812679, + 0.8766944147646427, + 1.3928977996110916, + 0.3237160034477711, + 1.0672550834715366, + 1.4345792271196842, + 0.4485944230109453, + 1.114845123142004, + 0.9135311301797628, + 0.9563826955854893, + 0.16318370401859283, + 0.5589432418346405, + 0.48749174922704697, + 1.768411174416542, + 0.3609909936785698, + 0.6112442389130592, + 0.7113770842552185, + 0.35938379541039467, + 1.7708023991435766, + 0.11542906239628792, + 0.17855260707437992, + 0.48670654743909836, + 1.808633990585804, + 0.9178262203931808, + 1.1566846668720245, + 0.2305291909724474, + 0.3019447438418865, + 0.14259163290262222, + 1.115898236632347, + 0.3226798363029957, + 2.2371090464293957, + 0.24006754718720913, + 0.44924366287887096, + 0.0, + 0.8549975119531155, + 1.2509274557232857, + 0.48309015296399593, + 1.3034214563667774, + 0.30978209152817726, + 0.4701043516397476, + 0.8890995308756828, + 0.6191466432064772, + 1.6214634329080582, + 1.3783816397190094, + 1.3289197236299515, + 0.20519248582422733, + 0.5983041450381279, + 0.49343112856149673, + 1.2312670834362507 + ], + "unique_experts": 62, + "load_cv": 0.5485694704422482, + "normalized_load_entropy": 0.9608302797145738, + "max_load_share": 0.035398230088495575 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "98b7901f01e35a4b64311b403d7216d534bce0f12710ad76e010f5d13491eb01", + "route_weight_sha256": "b45dc2d5494fd94a35c9e593e631ddc63ef0b380414f73f2c1910ce6afb24639", + "loads": [ + 11, + 26, + 18, + 14, + 3, + 8, + 26, + 16, + 11, + 12, + 20, + 5, + 16, + 13, + 11, + 18, + 12, + 18, + 12, + 13, + 17, + 13, + 18, + 14, + 8, + 14, + 17, + 8, + 19, + 27, + 9, + 17, + 8, + 25, + 16, + 5, + 9, + 24, + 14, + 17, + 10, + 12, + 12, + 12, + 7, + 16, + 19, + 14, + 1, + 14, + 22, + 11, + 19, + 10, + 11, + 11, + 13, + 24, + 19, + 30, + 13, + 10, + 12, + 20 + ], + "weighted_loads": [ + 0.7813452258706093, + 2.1485542356967926, + 1.235315253958106, + 1.1243513641529717, + 0.2370040826499462, + 0.5345141217112541, + 1.7011380307376385, + 0.8236050177365541, + 0.8716587647795677, + 1.2070936225354671, + 1.814215138554573, + 0.17347250878810883, + 1.3881773091852665, + 0.9384488947689533, + 1.0863350238651037, + 1.1730396300554276, + 1.2395789958536625, + 1.4635177198797464, + 0.8673213582660537, + 1.1575710214674473, + 1.4835096411406994, + 0.7797108609229326, + 1.5221572779119015, + 1.0077222120016813, + 0.9563826955854893, + 0.8107090480625629, + 1.3619306460022926, + 0.48749174922704697, + 1.768411174416542, + 1.4960693698376417, + 0.6664314866065979, + 0.7297492641955614, + 0.35938379541039467, + 1.7961549013853073, + 1.2710651909874287, + 0.17855260707437992, + 0.5140200778841972, + 1.9362761750817299, + 2.232450809329748, + 1.3680527433753014, + 0.4454087521880865, + 0.5322678972152062, + 0.6153358072042465, + 1.115898236632347, + 0.3922593407332897, + 2.2676436713081785, + 1.6823240499943495, + 0.818833427503705, + 0.029539680108428, + 0.9190797172486782, + 1.388508390635252, + 0.48309015296399593, + 1.7397341094911098, + 0.49288706108927727, + 1.0204499140381813, + 0.8890995308756828, + 1.043027302250266, + 1.694325851276517, + 1.3783816397190094, + 2.188050128519535, + 1.102604916319251, + 0.7937223315238953, + 0.7821266241371632, + 1.3392140213400126 + ], + "unique_experts": 64, + "load_cv": 0.4064425602787489, + "normalized_load_entropy": 0.9791978539290548, + "max_load_share": 0.032467532467532464 + } + }, + "s0_period": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "9af9adbe6e818bda2c9c1f0aab1f1c8b9d264a40c200c6aff5892b92d9e93751", + "route_weight_sha256": "866f32c371a8cf6c5b2554e82d91609ac619f710aa1671e3c268e7ddf0a0a283", + "loads": [ + 11, + 23, + 14, + 5, + 2, + 8, + 25, + 13, + 11, + 3, + 11, + 5, + 15, + 0, + 9, + 14, + 10, + 16, + 5, + 11, + 16, + 10, + 15, + 11, + 9, + 4, + 10, + 9, + 19, + 5, + 8, + 16, + 7, + 25, + 3, + 5, + 7, + 20, + 10, + 14, + 6, + 6, + 2, + 12, + 6, + 14, + 8, + 9, + 1, + 12, + 22, + 10, + 15, + 6, + 5, + 11, + 7, + 22, + 19, + 15, + 4, + 9, + 10, + 13 + ], + "weighted_loads": [ + 0.7750578075647354, + 2.0162599459290504, + 1.048441305756569, + 0.33976512774825096, + 0.19706618413329124, + 0.5234549939632416, + 1.649307046085596, + 0.733697198331356, + 0.8476705923676491, + 0.13252266868948936, + 1.0404817312955856, + 0.1821571420878172, + 1.2846615053713322, + 0.0, + 1.0524911172688007, + 0.902578204870224, + 0.8932399749755859, + 1.3727494850754738, + 0.32865243032574654, + 1.1279512234032154, + 1.4024151600897312, + 0.40669216215610504, + 1.2416276186704636, + 0.8340569511055946, + 0.971938980743289, + 0.1504061073064804, + 0.5999187380075455, + 0.49910290725529194, + 1.7908932529389858, + 0.2742865402251482, + 0.6067739389836788, + 0.7199935335665941, + 0.3127170354127884, + 1.802229167893529, + 0.15227794460952282, + 0.19176398031413555, + 0.44552792608737946, + 1.7896274235099554, + 0.9170895479619503, + 1.1412051282823086, + 0.23210625909268856, + 0.27614183351397514, + 0.1464257538318634, + 1.1403612457215786, + 0.35979827493429184, + 2.266570806503296, + 0.27496884018182755, + 0.46413302049040794, + 0.03868436440825462, + 0.8434738107025623, + 1.3378053270280361, + 0.44591338001191616, + 1.3810522966086864, + 0.28690414130687714, + 0.46747488155961037, + 0.9018818624317646, + 0.5690268501639366, + 1.6257081665098667, + 1.3612176142632961, + 1.246892061084509, + 0.16902501694858074, + 0.6305546350777149, + 0.5642418712377548, + 1.069791067391634 + ], + "unique_experts": 63, + "load_cv": 0.5518589873368365, + "normalized_load_entropy": 0.9616653308798828, + "max_load_share": 0.03687315634218289 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "b2b59688967e96982e91793a553494e08a35e37e9b8bec6d6255190937c4fc53", + "route_weight_sha256": "605080cae391f1623546ebfd26b583e123953593861e84f6c125789974a69313", + "loads": [ + 11, + 27, + 16, + 9, + 2, + 8, + 25, + 13, + 11, + 3, + 21, + 6, + 15, + 12, + 11, + 17, + 10, + 16, + 10, + 11, + 16, + 11, + 18, + 11, + 9, + 10, + 16, + 9, + 19, + 22, + 9, + 17, + 7, + 26, + 13, + 5, + 7, + 22, + 12, + 14, + 9, + 8, + 10, + 12, + 6, + 15, + 20, + 10, + 3, + 13, + 24, + 11, + 16, + 6, + 5, + 11, + 7, + 22, + 19, + 29, + 8, + 9, + 13, + 15 + ], + "weighted_loads": [ + 0.7750578075647354, + 2.2170069478452206, + 1.1699578538537025, + 0.6544680858496577, + 0.19706618413329124, + 0.5234549939632416, + 1.649307046085596, + 0.733697198331356, + 0.8476705923676491, + 0.13252266868948936, + 1.6981291435658932, + 0.19928458146750927, + 1.2846615053713322, + 0.8605449236929417, + 1.0988907217979431, + 1.0871838219463825, + 0.8932399749755859, + 1.3727494850754738, + 0.619573164585745, + 1.1279512234032154, + 1.4024151600897312, + 0.6976925283670425, + 1.4042021706700325, + 0.8340569511055946, + 0.971938980743289, + 0.5256543718278408, + 1.4157700538635254, + 0.49910290725529194, + 1.7908932529389858, + 1.5282065953942947, + 0.6610744744539261, + 0.738365713506937, + 0.3127170354127884, + 1.8275816701352596, + 1.0457946197420824, + 0.19176398031413555, + 0.44552792608737946, + 1.8793061804026365, + 2.0443087480962276, + 1.1412051282823086, + 0.3735025245696306, + 0.3921314887702465, + 0.5047027580440044, + 1.1403612457215786, + 0.35979827493429184, + 2.2966275364160538, + 1.5894176289439201, + 0.4981592521071434, + 0.129856925457716, + 0.8714735060930252, + 1.4350356422364712, + 0.5704857166856527, + 1.4456287808716297, + 0.28690414130687714, + 0.46747488155961037, + 0.9018818624317646, + 0.5690268501639366, + 1.6257081665098667, + 1.3612176142632961, + 2.031690414994955, + 0.54938650506665, + 0.6305546350777149, + 0.7800515182316303, + 1.1296830978244543 + ], + "unique_experts": 64, + "load_cv": 0.47172620575906243, + "normalized_load_entropy": 0.9733562344084696, + "max_load_share": 0.035024154589371984 + } + }, + "s1_period": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "58a50c55765ae1415d30db13e26b0b55d6b908377a571f38c79f1c676f6ecb86", + "route_weight_sha256": "2131d3613116537d57ed358ad7a7574002389059ccad549e1b003a62c7764f08", + "loads": [ + 11, + 24, + 14, + 4, + 2, + 8, + 24, + 17, + 11, + 4, + 10, + 4, + 15, + 0, + 8, + 14, + 10, + 16, + 5, + 11, + 16, + 11, + 14, + 12, + 9, + 4, + 10, + 8, + 18, + 5, + 8, + 15, + 7, + 24, + 2, + 5, + 8, + 21, + 10, + 15, + 6, + 7, + 2, + 13, + 5, + 14, + 7, + 9, + 0, + 12, + 21, + 11, + 15, + 6, + 5, + 11, + 7, + 21, + 20, + 15, + 5, + 8, + 8, + 16 + ], + "weighted_loads": [ + 0.7896550968289375, + 2.0082090236246586, + 1.0177884344011545, + 0.292669840157032, + 0.20097876340150833, + 0.531642809510231, + 1.5420687440782785, + 0.8669588584452868, + 0.8699009381234646, + 0.15908825397491455, + 1.034621063619852, + 0.15890631265938282, + 1.2944851368665695, + 0.0, + 1.0136263277381659, + 0.8901655040681362, + 0.8793454356491566, + 1.38534339889884, + 0.3215969540178776, + 1.0750136226415634, + 1.430153839290142, + 0.4456370584666729, + 1.12058749422431, + 0.8988555073738098, + 0.9610484577715397, + 0.1673869676887989, + 0.6081767491996288, + 0.48201559484004974, + 1.7480798438191414, + 0.2714271992444992, + 0.6072315163910389, + 0.6883841026574373, + 0.3168616332113743, + 1.7637904454022646, + 0.11330025643110275, + 0.17441053688526154, + 0.48071910068392754, + 1.8158229943364859, + 0.9012540802359581, + 1.21371228992939, + 0.22883703745901585, + 0.30002943240106106, + 0.141665767878294, + 1.165630016475916, + 0.32402848824858665, + 2.2401240654289722, + 0.2392363902181387, + 0.4528157003223896, + 0.0, + 0.855757474899292, + 1.3149802032858133, + 0.47873600013554096, + 1.282607477158308, + 0.30819278210401535, + 0.4694722220301628, + 0.8873571455478668, + 0.5885913781821728, + 1.5696753803640604, + 1.3999982867389917, + 1.3183987513184547, + 0.20529144257307053, + 0.5956949852406979, + 0.48847870901227, + 1.1917744651436806 + ], + "unique_experts": 62, + "load_cv": 0.5591274044196046, + "normalized_load_entropy": 0.9594280865563126, + "max_load_share": 0.035398230088495575 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "cf97cc1a740bbaeaa48f48962cfd0fd3093ce268569d86a2a95eeff416ff984f", + "route_weight_sha256": "0eedf6cf47fce2622eb48791478fd62ac3e92600f1702dce57f72be307c52c3d", + "loads": [ + 11, + 27, + 17, + 13, + 3, + 8, + 26, + 17, + 11, + 12, + 19, + 5, + 16, + 13, + 11, + 18, + 12, + 18, + 12, + 13, + 17, + 13, + 20, + 13, + 9, + 13, + 19, + 8, + 18, + 25, + 9, + 16, + 7, + 25, + 15, + 5, + 9, + 25, + 14, + 18, + 9, + 12, + 11, + 13, + 7, + 16, + 18, + 14, + 1, + 14, + 24, + 12, + 20, + 10, + 11, + 11, + 12, + 23, + 20, + 30, + 13, + 10, + 12, + 21 + ], + "weighted_loads": [ + 0.7896550968289375, + 2.169387847185135, + 1.188533840700984, + 1.0703387526446022, + 0.23542147502303123, + 0.531642809510231, + 1.6875798981636763, + 0.8669588584452868, + 0.8699009381234646, + 1.2057688012719154, + 1.6243674904108047, + 0.1760337520390749, + 1.4003508165478706, + 0.9086652882397175, + 1.0883940905332565, + 1.1802559532225132, + 1.2422300167381763, + 1.4559633191674948, + 0.8646695476199966, + 1.165329560637474, + 1.4790842533111572, + 0.7767534963786602, + 1.5611452832818031, + 0.9930465891957283, + 0.9610484577715397, + 0.7556372694671154, + 1.7122477404773235, + 0.48201559484004974, + 1.7480798438191414, + 1.3939635399729013, + 0.6607262790203094, + 0.7067562825977802, + 0.3168616332113743, + 1.7891429476439953, + 1.213326011406025, + 0.17441053688526154, + 0.5080326311290264, + 1.9852342139929533, + 2.2215134240686893, + 1.4250803664326668, + 0.3893576804548502, + 0.5275077156838961, + 0.5739100985229015, + 1.165630016475916, + 0.3936079926788807, + 2.270658690307755, + 1.534289812669158, + 0.8209748044610023, + 0.029539680108428, + 0.9198396801948547, + 1.451848117634654, + 0.5745320785790682, + 1.771216657012701, + 0.49129775166511536, + 1.0198177844285965, + 0.8873571455478668, + 1.0124720372259617, + 1.6425377987325191, + 1.3999982867389917, + 2.2309391498565674, + 1.1019629538059235, + 0.7911131717264652, + 0.7898636870086193, + 1.3634085152298212 + ], + "unique_experts": 64, + "load_cv": 0.41266561590790524, + "normalized_load_entropy": 0.9786194042689351, + "max_load_share": 0.032467532467532464 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 113, + "ordered_topk_exact_tokens": 92, + "set_exact_tokens": 102, + "mean_set_jaccard": 0.9721871049304678, + "mean_token_weighted_tv": 0.007287137737843842, + "aggregate_load_tv": 0.016224188790560472 + }, + "system_bos": { + "tokens": 113, + "ordered_topk_exact_tokens": 81, + "set_exact_tokens": 92, + "mean_set_jaccard": 0.9431099873577751, + "mean_token_weighted_tv": 0.014143970522996598, + "aggregate_load_tv": 0.02654867256637168 + }, + "system_x": { + "tokens": 113, + "ordered_topk_exact_tokens": 70, + "set_exact_tokens": 84, + "mean_set_jaccard": 0.9247787610619469, + "mean_token_weighted_tv": 0.018035399628621815, + "aggregate_load_tv": 0.028023598820058997 + }, + "system_period": { + "tokens": 113, + "ordered_topk_exact_tokens": 74, + "set_exact_tokens": 87, + "mean_set_jaccard": 0.9342604298356512, + "mean_token_weighted_tv": 0.016931161919064755, + "aggregate_load_tv": 0.028023598820058997 + }, + "bos_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 71, + "set_exact_tokens": 83, + "mean_set_jaccard": 0.9241466498103666, + "mean_token_weighted_tv": 0.01947674826117216, + "aggregate_load_tv": 0.028023598820058997 + }, + "bos_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 61, + "set_exact_tokens": 74, + "mean_set_jaccard": 0.8994943109987359, + "mean_token_weighted_tv": 0.023384518558736397, + "aggregate_load_tv": 0.03392330383480826 + }, + "x_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 69, + "set_exact_tokens": 84, + "mean_set_jaccard": 0.9266750948166879, + "mean_token_weighted_tv": 0.018710116344809003, + "aggregate_load_tv": 0.028023598820058997 + }, + "x_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 67, + "set_exact_tokens": 77, + "mean_set_jaccard": 0.9051833122629585, + "mean_token_weighted_tv": 0.023406912350153502, + "aggregate_load_tv": 0.035398230088495575 + }, + "period_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 72, + "set_exact_tokens": 82, + "mean_set_jaccard": 0.915929203539823, + "mean_token_weighted_tv": 0.020028952212460274, + "aggregate_load_tv": 0.030973451327433628 + }, + "period_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 65, + "set_exact_tokens": 77, + "mean_set_jaccard": 0.9032869785082173, + "mean_token_weighted_tv": 0.02375141884801926, + "aggregate_load_tv": 0.038348082595870206 + } + } + }, + "layer_05": { + "layer": 5, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "5ccf99c62db8d467b2c6ac87dabeee257ecc84e1256f28affb2e8598480d664f", + "route_weight_sha256": "0f3594c8fdfa3551600f50c733525008be3dfb33a303ecc6013d01ed4d1df158", + "loads": [ + 11, + 8, + 8, + 12, + 12, + 12, + 10, + 15, + 9, + 10, + 6, + 4, + 11, + 10, + 4, + 14, + 5, + 6, + 8, + 6, + 9, + 12, + 15, + 14, + 6, + 9, + 9, + 15, + 13, + 10, + 23, + 3, + 4, + 28, + 10, + 12, + 6, + 10, + 0, + 9, + 9, + 1, + 20, + 15, + 15, + 16, + 11, + 18, + 9, + 1, + 2, + 5, + 11, + 12, + 7, + 13, + 13, + 19, + 15, + 2, + 16, + 22, + 13, + 15 + ], + "weighted_loads": [ + 0.7520563714206219, + 0.42348581925034523, + 0.41498891450464725, + 0.8063372112810612, + 0.7261637188494205, + 1.502757664769888, + 0.7348427586257458, + 1.1850281208753586, + 0.8684238940477371, + 0.6242943368852139, + 0.2501914370805025, + 0.20013273134827614, + 0.8356817327439785, + 0.49212370067834854, + 0.15062214620411396, + 0.9084823727607727, + 0.3076595962047577, + 0.4087873324751854, + 0.4429421816021204, + 0.23035231605172157, + 0.679608915001154, + 0.9601630829274654, + 1.0007244162261486, + 0.9337265454232693, + 0.3923995550721884, + 0.5298118386417627, + 0.44911474362015724, + 1.5395793281495571, + 2.4002824872732162, + 0.6055063456296921, + 2.0566510930657387, + 0.12593630701303482, + 0.16000417061150074, + 2.122057933360338, + 0.6591532379388809, + 0.7181500624865294, + 0.46630265191197395, + 0.8123530931770802, + 0.0, + 0.7288748323917389, + 0.9019800163805485, + 0.03229616954922676, + 2.112451173365116, + 1.041653361171484, + 0.9879346191883087, + 1.1732805371284485, + 0.7268065437674522, + 1.0365749327465892, + 1.1663751900196075, + 0.038688063621520996, + 0.11076517030596733, + 0.22394349798560143, + 0.47287091333419085, + 0.8205071464180946, + 0.6129233725368977, + 1.1047033444046974, + 1.0168467685580254, + 1.8129305690526962, + 1.3442523013800383, + 0.12365100160241127, + 1.8026262037456036, + 1.3234475683420897, + 0.72841358743608, + 1.27054001390934 + ], + "unique_experts": 63, + "load_cv": 0.5153300304970148, + "normalized_load_entropy": 0.965079307578016, + "max_load_share": 0.04129793510324484 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "226c5106fd67deec001942c677916fcd5d8f4dd14b0620bcac5ac2d5607377fc", + "route_weight_sha256": "97e7e82d4781c7d8916c1978bde74243a9db8877869171639a0af3fab6e8b009", + "loads": [ + 11, + 9, + 8, + 12, + 13, + 14, + 12, + 17, + 10, + 11, + 16, + 4, + 14, + 10, + 4, + 26, + 7, + 12, + 17, + 7, + 11, + 12, + 15, + 14, + 6, + 17, + 9, + 15, + 13, + 10, + 23, + 3, + 4, + 28, + 10, + 17, + 7, + 10, + 11, + 16, + 13, + 9, + 28, + 17, + 16, + 16, + 11, + 20, + 9, + 5, + 10, + 5, + 13, + 21, + 10, + 22, + 13, + 19, + 15, + 3, + 16, + 22, + 13, + 17 + ], + "weighted_loads": [ + 0.7520563714206219, + 0.4269884880632162, + 0.41498891450464725, + 0.8063372112810612, + 0.7279265399556607, + 1.5713072419166565, + 0.8084959276020527, + 1.2337681846693158, + 0.8717762706801295, + 0.6288196421228349, + 0.8457591366022825, + 0.20013273134827614, + 1.0392996668815613, + 0.49212370067834854, + 0.15062214620411396, + 2.8901914753951132, + 0.44828425347805023, + 0.7059692889451981, + 1.360794683918357, + 0.24342724215239286, + 0.6950465166009963, + 0.9601630829274654, + 1.0007244162261486, + 0.9337265454232693, + 0.3923995550721884, + 1.4335969295352697, + 0.44911474362015724, + 1.5395793281495571, + 2.4002824872732162, + 0.6055063456296921, + 2.0566510930657387, + 0.12593630701303482, + 0.16000417061150074, + 2.122057933360338, + 0.6591532379388809, + 1.1397244092077017, + 0.5088948607444763, + 0.8123530931770802, + 1.0665963999927044, + 1.3944200463593006, + 1.0785182788968086, + 0.8344189673662186, + 2.6105422526597977, + 1.1549513079226017, + 1.0686769261956215, + 1.1732805371284485, + 0.7268065437674522, + 1.0545313118491322, + 1.1663751900196075, + 0.22723414283245802, + 0.8056873269379139, + 0.22394349798560143, + 2.1025635870173573, + 1.4167574346065521, + 0.629782028729096, + 1.788255948573351, + 1.0168467685580254, + 1.8129305690526962, + 1.3442523013800383, + 0.1700356788933277, + 1.8026262037456036, + 1.3234475683420897, + 0.72841358743608, + 2.20635399594903 + ], + "unique_experts": 64, + "load_cv": 0.4416790674336617, + "normalized_load_entropy": 0.976181993626385, + "max_load_share": 0.033816425120772944 + } + }, + "s1_eos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "1e9b8f8d47b42a7a65bd30f5fd31f407fb120a5226f4a21354912a3f3a78cbdc", + "route_weight_sha256": "f44d8bfdaa926a09dca9e37a609efa2b664767949332617a392fcfd48786f892", + "loads": [ + 10, + 8, + 7, + 12, + 12, + 13, + 8, + 15, + 8, + 10, + 6, + 4, + 11, + 11, + 4, + 15, + 5, + 6, + 9, + 6, + 10, + 12, + 15, + 15, + 5, + 9, + 11, + 15, + 13, + 9, + 23, + 3, + 4, + 28, + 10, + 12, + 7, + 10, + 1, + 8, + 9, + 1, + 20, + 15, + 15, + 16, + 10, + 18, + 9, + 1, + 2, + 5, + 11, + 12, + 7, + 13, + 13, + 19, + 15, + 2, + 16, + 21, + 13, + 15 + ], + "weighted_loads": [ + 0.7137001678347588, + 0.4182802103459835, + 0.38380105793476105, + 0.8075918592512608, + 0.7319436855614185, + 1.557663906365633, + 0.6679480075836182, + 1.1812196671962738, + 0.8434167951345444, + 0.6289450563490391, + 0.24908766150474548, + 0.19986720755696297, + 0.8234878107905388, + 0.5242042075842619, + 0.15280523337423801, + 0.9652178268879652, + 0.30834751203656197, + 0.4083970710635185, + 0.47959543764591217, + 0.22920429520308971, + 0.6897627133876085, + 0.9539844132959843, + 1.0087495185434818, + 0.9731966704130173, + 0.3542798589915037, + 0.5258651450276375, + 0.5196348018944263, + 1.5205484330654144, + 2.3748322874307632, + 0.5677915159612894, + 2.0722253285348415, + 0.12686173990368843, + 0.15644936822354794, + 2.1276621408760548, + 0.6525665186345577, + 0.722749026492238, + 0.5043356828391552, + 0.8127310872077942, + 0.034322161227464676, + 0.6699745692312717, + 0.8985938504338264, + 0.033249348402023315, + 2.140344560146332, + 1.0359265021979809, + 0.9926612451672554, + 1.1707171350717545, + 0.7014786973595619, + 1.0572918532416224, + 1.193001389503479, + 0.04049775376915932, + 0.11435816437005997, + 0.22320623323321342, + 0.47098246216773987, + 0.8172753751277924, + 0.6099386177957058, + 1.0958959236741066, + 1.0311439335346222, + 1.8093556892126799, + 1.3493054695427418, + 0.12092079967260361, + 1.8065658621490002, + 1.2943748645484447, + 0.7349589709192514, + 1.2752714455127716 + ], + "unique_experts": 64, + "load_cv": 0.5145188858242123, + "normalized_load_entropy": 0.9659021871269874, + "max_load_share": 0.04129793510324484 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "83f6a4cfe60325d547cc1ba640ab2a4291333b17fbc779e7518f08d5fa9af90e", + "route_weight_sha256": "513044a13cfcb622140911331cb442959d4c088327693f9e5872157163e44a8e", + "loads": [ + 11, + 9, + 7, + 18, + 13, + 15, + 17, + 18, + 9, + 11, + 19, + 7, + 16, + 11, + 5, + 29, + 8, + 17, + 21, + 16, + 12, + 12, + 16, + 15, + 6, + 17, + 11, + 17, + 13, + 10, + 23, + 3, + 5, + 29, + 11, + 17, + 9, + 13, + 13, + 19, + 13, + 14, + 33, + 20, + 16, + 16, + 10, + 21, + 9, + 15, + 12, + 7, + 13, + 22, + 11, + 23, + 13, + 19, + 16, + 3, + 17, + 21, + 13, + 19 + ], + "weighted_loads": [ + 0.750152450054884, + 0.4218486456666142, + 0.38380105793476105, + 1.2223216332495213, + 0.7337130055529997, + 1.62935359030962, + 1.6906784065067768, + 1.2796603976748884, + 0.8467762738000602, + 0.6333768158219755, + 1.0432662833482027, + 0.5629830844700336, + 1.2596875838935375, + 0.5242042075842619, + 0.18713638372719288, + 3.4472791240550578, + 0.5314244590699673, + 1.0862288177013397, + 1.7355049550533295, + 1.0806293273344636, + 0.7051087631843984, + 0.9539844132959843, + 1.0463803745806217, + 0.9731966704130173, + 0.4304592292755842, + 1.242084639146924, + 0.5196348018944263, + 1.6939840838313103, + 2.3748322874307632, + 0.6166029367595911, + 2.0722253285348415, + 0.12686173990368843, + 0.2753459420055151, + 2.1708237044513226, + 0.6871853247284889, + 1.261150212958455, + 0.5893941037356853, + 0.9654997698962688, + 1.2411885485053062, + 1.7970787286758423, + 1.0614116080105305, + 1.244467407464981, + 2.9751305542886257, + 1.3460804261267185, + 1.054401259869337, + 1.1707171350717545, + 0.7014786973595619, + 1.1083980749826878, + 1.193001389503479, + 0.8717432944104075, + 1.1945234574377537, + 0.290747057646513, + 2.1003375947475433, + 1.622005421668291, + 0.6652686991728842, + 1.7095349542796612, + 1.0311439335346222, + 1.8093556892126799, + 1.4193246848881245, + 0.16859709843993187, + 1.8527458012104034, + 1.2943748645484447, + 0.7349589709192514, + 2.4530786126852036 + ], + "unique_experts": 64, + "load_cv": 0.41321020950139137, + "normalized_load_entropy": 0.97916166036892, + "max_load_share": 0.03571428571428571 + } + }, + "s0_bos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "a3f9bf41e230d58161da797fab3746b17219407d11ddc6e60dc77ee0a028e14b", + "route_weight_sha256": "234ca369d091a27cbb8aabdd5eacf67f6eba6dac19273d3c88236eef1fdf6abc", + "loads": [ + 10, + 9, + 8, + 12, + 12, + 13, + 8, + 15, + 8, + 9, + 5, + 5, + 11, + 11, + 5, + 14, + 4, + 6, + 8, + 5, + 8, + 11, + 15, + 15, + 5, + 7, + 12, + 16, + 13, + 10, + 23, + 3, + 3, + 28, + 11, + 12, + 7, + 9, + 1, + 8, + 9, + 0, + 19, + 15, + 15, + 16, + 11, + 16, + 9, + 0, + 2, + 5, + 11, + 12, + 7, + 16, + 15, + 19, + 15, + 2, + 16, + 23, + 13, + 17 + ], + "weighted_loads": [ + 0.7413857635110617, + 0.4316615145653486, + 0.4162696208804846, + 0.8508611619472504, + 0.6808502189815044, + 1.5869144685566425, + 0.6435490772128105, + 1.2055113315582275, + 0.8177654650062323, + 0.5811270736157894, + 0.21117259934544563, + 0.22653394378721714, + 0.8231107145547867, + 0.5401355400681496, + 0.1752056796103716, + 0.9446943309158087, + 0.2833532467484474, + 0.4191335327923298, + 0.4732369128614664, + 0.18976176343858242, + 0.6354130320250988, + 0.9377686269581318, + 1.0202167257666588, + 0.982852503657341, + 0.36181867867708206, + 0.4674174599349499, + 0.5594132542610168, + 1.5633099898695946, + 2.466436017304659, + 0.6235706359148026, + 2.066515728831291, + 0.12768958508968353, + 0.12610588036477566, + 2.1785055361688137, + 0.701371144503355, + 0.7357013933360577, + 0.49292879924178123, + 0.7937517836689949, + 0.029924655333161354, + 0.66970269754529, + 0.8977590203285217, + 0.0, + 2.1185077764093876, + 1.0350214280188084, + 1.001475878059864, + 1.173043329268694, + 0.7346299514174461, + 1.0006800284609199, + 1.1578406319022179, + 0.0, + 0.11922808736562729, + 0.22170360386371613, + 0.4515390647575259, + 0.8146647326648235, + 0.6035857535898685, + 1.2154869548976421, + 1.110953962430358, + 1.8595340866595507, + 1.4175970815122128, + 0.13573257625102997, + 1.8851681165397167, + 1.3810092061758041, + 0.7391492184251547, + 1.3584905229508877 + ], + "unique_experts": 62, + "load_cv": 0.5328629115465746, + "normalized_load_entropy": 0.9619240683108221, + "max_load_share": 0.04129793510324484 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "7fba417396a4860580ed9286aa151d1dcf9f8885044d7cd9c9eec92ccf14e65a", + "route_weight_sha256": "ff8e1181b2ae0259e321f2e06ce8e6da68690222d631ac8cd83164e1faee4dfe", + "loads": [ + 10, + 10, + 8, + 12, + 12, + 15, + 10, + 17, + 9, + 9, + 15, + 5, + 14, + 11, + 5, + 27, + 6, + 12, + 18, + 6, + 9, + 11, + 15, + 15, + 5, + 15, + 12, + 16, + 13, + 10, + 23, + 4, + 3, + 28, + 11, + 17, + 7, + 9, + 13, + 16, + 13, + 8, + 28, + 17, + 16, + 16, + 11, + 17, + 9, + 4, + 10, + 5, + 12, + 21, + 9, + 26, + 15, + 19, + 15, + 3, + 16, + 23, + 13, + 19 + ], + "weighted_loads": [ + 0.7413857635110617, + 0.4351641833782196, + 0.4162696208804846, + 0.8508611619472504, + 0.6808502189815044, + 1.655464045703411, + 0.7134940922260284, + 1.2524697156623006, + 0.8211178416386247, + 0.5811270736157894, + 0.8175829723477364, + 0.22653394378721714, + 1.030843984335661, + 0.5401355400681496, + 0.1752056796103716, + 2.9788836245425045, + 0.4242519289255142, + 0.7163154892623425, + 1.5280534643679857, + 0.2028366895392537, + 0.64796482026577, + 0.9377686269581318, + 1.0202167257666588, + 0.982852503657341, + 0.36181867867708206, + 1.3712025508284569, + 0.5594132542610168, + 1.5633099898695946, + 2.466436017304659, + 0.6235706359148026, + 2.066515728831291, + 0.16426602751016617, + 0.12610588036477566, + 2.1785055361688137, + 0.701371144503355, + 1.1568964533507824, + 0.49292879924178123, + 0.7937517836689949, + 1.270081153139472, + 1.3589573614299297, + 1.0742972828447819, + 0.8376574516296387, + 2.6869797818362713, + 1.1542567871510983, + 1.0822181850671768, + 1.173043329268694, + 0.7346299514174461, + 1.0162402028217912, + 1.1578406319022179, + 0.19281354825943708, + 0.8089026883244514, + 0.22170360386371613, + 1.1166067970916629, + 1.410915020853281, + 0.6185412390623242, + 1.8993325494229794, + 1.110953962430358, + 1.8595340866595507, + 1.4175970815122128, + 0.1821172535419464, + 1.8851681165397167, + 1.3810092061758041, + 0.7391492184251547, + 2.2943045049905777 + ], + "unique_experts": 64, + "load_cv": 0.4611186395885092, + "normalized_load_entropy": 0.9743353927342158, + "max_load_share": 0.033816425120772944 + } + }, + "s1_bos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "3253f255d9cc281899e2559ca84ef9dae07494eea9b7211ce449b8557545953a", + "route_weight_sha256": "cda06ac41a81bb89220ad23263562b31118f87413892baa5e073406acad95d90", + "loads": [ + 9, + 9, + 8, + 11, + 12, + 15, + 8, + 15, + 9, + 9, + 5, + 4, + 11, + 12, + 4, + 14, + 4, + 7, + 7, + 6, + 8, + 13, + 16, + 15, + 4, + 7, + 11, + 15, + 13, + 9, + 23, + 3, + 5, + 28, + 11, + 11, + 7, + 10, + 2, + 8, + 9, + 0, + 19, + 15, + 15, + 16, + 11, + 17, + 10, + 1, + 3, + 5, + 10, + 12, + 7, + 14, + 13, + 18, + 15, + 2, + 16, + 23, + 13, + 16 + ], + "weighted_loads": [ + 0.7315899096429348, + 0.430695328861475, + 0.42526909336447716, + 0.8203851766884327, + 0.6941553615033627, + 1.6919504087418318, + 0.6410212330520153, + 1.1944989934563637, + 0.8816110771149397, + 0.5742736347019672, + 0.20677009038627148, + 0.1937081255018711, + 0.7905673459172249, + 0.5947759114205837, + 0.1396988406777382, + 1.0351719483733177, + 0.2819485627114773, + 0.47420288249850273, + 0.4219122529029846, + 0.2291226778179407, + 0.6234670523554087, + 1.0020225904881954, + 1.0502126775681973, + 0.9860626477748156, + 0.3263871967792511, + 0.4662526287138462, + 0.516853827983141, + 1.5288125164806843, + 2.401792924851179, + 0.6080838833004236, + 2.0872348994016647, + 0.13175849243998528, + 0.18647455051541328, + 2.1408712156116962, + 0.7038773633539677, + 0.7095801681280136, + 0.48638737574219704, + 0.818010039627552, + 0.06466633267700672, + 0.6031018570065498, + 0.902687132358551, + 0.0, + 2.1568495482206345, + 1.0362186580896378, + 1.028696108609438, + 1.1870621852576733, + 0.7546614520251751, + 1.0442095631733537, + 1.2329322323203087, + 0.04174322262406349, + 0.16423721611499786, + 0.22258893214166164, + 0.43304030038416386, + 0.8079503774642944, + 0.5932225026190281, + 1.102474207058549, + 1.0606381185352802, + 1.8144525699317455, + 1.4167647883296013, + 0.12888528406620026, + 1.901013307273388, + 1.384052287787199, + 0.7348085027188063, + 1.3263792507350445 + ], + "unique_experts": 63, + "load_cv": 0.5207053710245587, + "normalized_load_entropy": 0.9648886047058032, + "max_load_share": 0.04129793510324484 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "52ef361c2eda1ece079196485537e3efe4c3df9cb10b805406339944ff9b4e9f", + "route_weight_sha256": "b43ac15f9156814c5f11208ce3ce7f233a416c5696ff4b170f101dcb85104b99", + "loads": [ + 10, + 10, + 8, + 17, + 12, + 17, + 17, + 18, + 10, + 9, + 18, + 7, + 16, + 12, + 5, + 29, + 8, + 18, + 21, + 16, + 9, + 13, + 17, + 15, + 5, + 15, + 11, + 17, + 13, + 10, + 23, + 4, + 6, + 29, + 12, + 16, + 8, + 13, + 15, + 19, + 12, + 13, + 33, + 20, + 16, + 16, + 11, + 19, + 10, + 14, + 14, + 7, + 11, + 22, + 10, + 25, + 13, + 18, + 16, + 3, + 17, + 23, + 13, + 20 + ], + "weighted_loads": [ + 0.76804219186306, + 0.43426376418210566, + 0.42526909336447716, + 1.2351149506866932, + 0.6941553615033627, + 1.7636400926858187, + 1.6592467091977596, + 1.2911139666102827, + 0.8849705557804555, + 0.5742736347019672, + 1.0084868371486664, + 0.5568240024149418, + 1.2389603070914745, + 0.5947759114205837, + 0.17402999103069305, + 3.5757224303670228, + 0.5425161197781563, + 1.152034629136324, + 1.8354492746293545, + 1.0805477099493146, + 0.6360188405960798, + 1.0020225904881954, + 1.0878435336053371, + 0.9860626477748156, + 0.4025665670633316, + 1.1824721228331327, + 0.516853827983141, + 1.7022481672465801, + 2.401792924851179, + 0.6568953040987253, + 2.0872348994016647, + 0.1688118577003479, + 0.30537112429738045, + 2.184032779186964, + 0.7384961694478989, + 1.24460569024086, + 0.5319030210375786, + 0.9707787223160267, + 1.439414257183671, + 1.6873757801949978, + 1.0308337956666946, + 1.2229496538639069, + 3.0414187610149384, + 1.3531983084976673, + 1.0904361233115196, + 1.1870621852576733, + 0.7546614520251751, + 1.0928694596514106, + 1.2329322323203087, + 0.8405308937653899, + 1.295500461012125, + 0.2901297565549612, + 1.0981080327183008, + 1.6126804240047932, + 0.6465556430630386, + 1.7380375284701586, + 1.0606381185352802, + 1.8144525699317455, + 1.486784003674984, + 0.17656158283352852, + 1.9471932463347912, + 1.384052287787199, + 0.7348085027188063, + 2.5041864179074764 + ], + "unique_experts": 64, + "load_cv": 0.4161026710821413, + "normalized_load_entropy": 0.9791408028526498, + "max_load_share": 0.03571428571428571 + } + }, + "s0_x": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "3f98f7a9c7bf2f34c0dd86fcc61a65440502447445c7832cea06383f49b0315a", + "route_weight_sha256": "e70174ac05bb4e2dd5f79497bc6fc0d1d5e4214b3ef1ba63ed07baea17c6623b", + "loads": [ + 10, + 10, + 8, + 12, + 11, + 13, + 8, + 15, + 7, + 10, + 5, + 4, + 11, + 11, + 3, + 15, + 4, + 5, + 9, + 6, + 9, + 10, + 16, + 15, + 5, + 8, + 11, + 16, + 13, + 9, + 23, + 3, + 3, + 27, + 10, + 13, + 7, + 9, + 1, + 9, + 9, + 0, + 19, + 15, + 15, + 16, + 11, + 17, + 9, + 2, + 3, + 5, + 12, + 12, + 7, + 13, + 15, + 19, + 15, + 2, + 16, + 23, + 13, + 16 + ], + "weighted_loads": [ + 0.7259682100266218, + 0.4757905378937721, + 0.4096757546067238, + 0.8231569714844227, + 0.6577835083007812, + 1.6216964833438396, + 0.6400393471121788, + 1.1791357956826687, + 0.7756582424044609, + 0.605239050462842, + 0.21718242019414902, + 0.19776728004217148, + 0.8207761012017727, + 0.5369523726403713, + 0.11925678327679634, + 0.9948686063289642, + 0.28268279135227203, + 0.373512651771307, + 0.5133129246532917, + 0.23877568170428276, + 0.6720223128795624, + 0.9002271704375744, + 1.009505471214652, + 0.9653579220175743, + 0.35242412611842155, + 0.49543839506804943, + 0.5184986218810081, + 1.5675888434052467, + 2.4409660547971725, + 0.57970280200243, + 2.0775582380592823, + 0.12843221798539162, + 0.12407650984823704, + 2.154736716300249, + 0.669839795678854, + 0.770213296636939, + 0.49238921515643597, + 0.7853518798947334, + 0.02910199761390686, + 0.7017534878104925, + 0.9012308605015278, + 0.0, + 2.092798825353384, + 1.0273124873638153, + 0.9969141967594624, + 1.1761493310332298, + 0.7340792156755924, + 1.0381984943524003, + 1.133024238049984, + 0.0878097377717495, + 0.17238060384988785, + 0.2258463278412819, + 0.47611898742616177, + 0.807268038392067, + 0.5971846990287304, + 1.0919308308511972, + 1.1025335919111967, + 1.8381802011281252, + 1.4017753638327122, + 0.13416371494531631, + 1.8831303156912327, + 1.379436206072569, + 0.7292002234607935, + 1.2927088364958763 + ], + "unique_experts": 63, + "load_cv": 0.5239041031170542, + "normalized_load_entropy": 0.9639893024284767, + "max_load_share": 0.03982300884955752 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "6cdbd6b8e51069e42e4ceb573ca22b87101d07e9be72286c057c3d91e7d04b55", + "route_weight_sha256": "32c4f895d7cf118fecf7f5f5921f06041c4e4303977396dda9c454e6184d5799", + "loads": [ + 10, + 11, + 8, + 12, + 11, + 15, + 10, + 17, + 8, + 10, + 16, + 4, + 14, + 11, + 3, + 28, + 6, + 11, + 18, + 7, + 10, + 10, + 16, + 15, + 5, + 17, + 11, + 16, + 13, + 9, + 23, + 4, + 3, + 27, + 10, + 18, + 7, + 9, + 11, + 16, + 15, + 8, + 27, + 17, + 16, + 16, + 11, + 18, + 9, + 5, + 11, + 5, + 13, + 23, + 9, + 23, + 15, + 19, + 15, + 3, + 16, + 23, + 13, + 18 + ], + "weighted_loads": [ + 0.7259682100266218, + 0.4792932067066431, + 0.4096757546067238, + 0.8231569714844227, + 0.6577835083007812, + 1.6902460604906082, + 0.7078676633536816, + 1.2252647476270795, + 0.7790106190368533, + 0.605239050462842, + 0.9161739721894264, + 0.19776728004217148, + 1.036718174815178, + 0.5369523726403713, + 0.11925678327679634, + 3.215117479208857, + 0.4247220903635025, + 0.6706946082413197, + 1.4372450299561024, + 0.25185060780495405, + 0.6845741011202335, + 0.9002271704375744, + 1.009505471214652, + 0.9653579220175743, + 0.35242412611842155, + 1.4850279856473207, + 0.5184986218810081, + 1.5675888434052467, + 2.4409660547971725, + 0.57970280200243, + 2.0775582380592823, + 0.16657429933547974, + 0.12407650984823704, + 2.154736716300249, + 0.669839795678854, + 1.1855471711605787, + 0.49238921515643597, + 0.7853518798947334, + 0.9527336545288563, + 1.3616142813116312, + 1.1923151090741158, + 0.8001177161931992, + 2.5444188341498375, + 1.1488180384039879, + 1.0776565037667751, + 1.1761493310332298, + 0.7340792156755924, + 1.0537586687132716, + 1.133024238049984, + 0.2377600846812129, + 0.8439557403326035, + 0.2258463278412819, + 1.1411867197602987, + 1.51832165569067, + 0.612140184501186, + 1.8521380256861448, + 1.1025335919111967, + 1.8381802011281252, + 1.4017753638327122, + 0.18054839223623276, + 1.8831303156912327, + 1.379436206072569, + 0.7292002234607935, + 2.2285228185355663 + ], + "unique_experts": 64, + "load_cv": 0.461927708993789, + "normalized_load_entropy": 0.9737999298572727, + "max_load_share": 0.033816425120772944 + } + }, + "s1_x": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "56dedbe93490c91865d057fc7dd1209f97c913ab2720a6e33b856a22eac866f1", + "route_weight_sha256": "463e7301157c65a7c142a2cf55dd53f4f3f21258772bb33238d1acf836bf53c3", + "loads": [ + 10, + 10, + 8, + 11, + 12, + 15, + 8, + 14, + 8, + 9, + 6, + 5, + 11, + 12, + 3, + 15, + 4, + 7, + 7, + 6, + 10, + 11, + 15, + 15, + 5, + 7, + 11, + 16, + 13, + 10, + 23, + 3, + 6, + 28, + 10, + 13, + 6, + 9, + 0, + 8, + 9, + 1, + 19, + 15, + 15, + 16, + 11, + 17, + 10, + 1, + 3, + 5, + 11, + 12, + 7, + 12, + 14, + 18, + 15, + 2, + 16, + 21, + 13, + 15 + ], + "weighted_loads": [ + 0.7508333660662174, + 0.47345952689647675, + 0.45266385190188885, + 0.768928125500679, + 0.6942722070962191, + 1.7726110219955444, + 0.6419016569852829, + 1.1391183324158192, + 0.8533648997545242, + 0.5741677060723305, + 0.23876766487956047, + 0.2337048463523388, + 0.7860650755465031, + 0.5967766456305981, + 0.11530150659382343, + 1.0767342150211334, + 0.28066572546958923, + 0.4688641056418419, + 0.418811010196805, + 0.23602841794490814, + 0.6733889579772949, + 0.9408680684864521, + 0.9823311939835548, + 0.9974226355552673, + 0.3642832338809967, + 0.4647568576037884, + 0.5121885724365711, + 1.5582850761711597, + 2.3842359371483326, + 0.6266426928341389, + 2.038250047713518, + 0.13341794908046722, + 0.21770762465894222, + 2.101134527474642, + 0.6709130257368088, + 0.7845523841679096, + 0.4546300172805786, + 0.7713422775268555, + 0.0, + 0.5644701384007931, + 0.9102020636200905, + 0.029117237776517868, + 2.12441673129797, + 1.0259520895779133, + 1.0488762818276882, + 1.1888985671103, + 0.7560626342892647, + 1.0432324847206473, + 1.241159662604332, + 0.04189733788371086, + 0.16784914955496788, + 0.2246606331318617, + 0.4738123491406441, + 0.8273939192295074, + 0.5887698344886303, + 1.0378079153597355, + 1.0811422243714333, + 1.801623022183776, + 1.3774973154067993, + 0.12808562442660332, + 1.9319328516721725, + 1.2771343272179365, + 0.738603301346302, + 1.2698994502425194 + ], + "unique_experts": 63, + "load_cv": 0.5112614380341307, + "normalized_load_entropy": 0.9655236761501466, + "max_load_share": 0.04129793510324484 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "857a284ddbf84ea57b685f69b27aa0fccc0e6fbe21da8d6546cbf7090ffade1f", + "route_weight_sha256": "d970c57f3cec2746c12d1996b9d66341dadabd5d320977c0f251e701aa1a605a", + "loads": [ + 11, + 11, + 8, + 17, + 12, + 17, + 16, + 17, + 9, + 9, + 20, + 8, + 16, + 12, + 4, + 30, + 8, + 18, + 20, + 16, + 11, + 11, + 16, + 15, + 6, + 16, + 11, + 18, + 13, + 11, + 23, + 4, + 7, + 30, + 11, + 19, + 7, + 12, + 11, + 19, + 13, + 13, + 32, + 20, + 16, + 16, + 11, + 19, + 10, + 14, + 12, + 7, + 12, + 24, + 10, + 23, + 14, + 18, + 16, + 3, + 17, + 22, + 13, + 19 + ], + "weighted_loads": [ + 0.7872856482863426, + 0.4770279622171074, + 0.45266385190188885, + 1.1836578994989395, + 0.6942722070962191, + 1.8443007059395313, + 1.6230838224291801, + 1.2343997745774686, + 0.85672437842004, + 0.5741677060723305, + 1.1336134057492018, + 0.5968207232654095, + 1.2440082728862762, + 0.5967766456305981, + 0.1496326569467783, + 3.826481253374368, + 0.5521242320537567, + 1.146695852279663, + 1.6557720210403204, + 1.087453450076282, + 0.6859407462179661, + 0.9408680684864521, + 1.0199620500206947, + 0.9974226355552673, + 0.4404626041650772, + 1.259071884676814, + 0.5121885724365711, + 1.7317207269370556, + 2.3842359371483326, + 0.6754541136324406, + 2.038250047713518, + 0.17559172585606575, + 0.3366041984409094, + 2.1885413005948067, + 0.70553183183074, + 1.3550439551472664, + 0.5001456625759602, + 0.9241109602153301, + 1.0410803519189358, + 1.6479899361729622, + 1.1129106730222702, + 1.1590114645659924, + 2.9223951809108257, + 1.3459535837173462, + 1.11061629652977, + 1.1888985671103, + 0.7560626342892647, + 1.0918923811987042, + 1.241159662604332, + 0.8369960626587272, + 1.1812391020357609, + 0.29220145754516125, + 1.138880081474781, + 1.7433283925056458, + 0.6421029749326408, + 1.749457061290741, + 1.0811422243714333, + 1.801623022183776, + 1.447516530752182, + 0.17576192319393158, + 1.9781127907335758, + 1.31346276961267, + 0.738603301346302, + 2.4477066174149513 + ], + "unique_experts": 64, + "load_cv": 0.4153814439407656, + "normalized_load_entropy": 0.9792858338295932, + "max_load_share": 0.03463203463203463 + } + }, + "s0_period": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "85884a702e4406980bdaf94cca2e547528d76665bc5f3cc933ca62317b901746", + "route_weight_sha256": "ae640b3bf91eae145c6087d4ef36abb9e7d7be1744f1518cf6fad49387ec140f", + "loads": [ + 10, + 10, + 8, + 12, + 11, + 13, + 7, + 15, + 8, + 10, + 5, + 4, + 11, + 11, + 4, + 13, + 4, + 5, + 8, + 6, + 8, + 10, + 15, + 15, + 5, + 8, + 11, + 16, + 13, + 10, + 23, + 3, + 3, + 27, + 10, + 12, + 7, + 9, + 1, + 9, + 9, + 0, + 19, + 15, + 15, + 16, + 11, + 18, + 9, + 2, + 3, + 5, + 13, + 12, + 7, + 15, + 15, + 19, + 15, + 2, + 16, + 23, + 13, + 16 + ], + "weighted_loads": [ + 0.7281474079936743, + 0.47283319756388664, + 0.41016246378421783, + 0.8270475976169109, + 0.6612086445093155, + 1.611762948334217, + 0.5961024314165115, + 1.1848080530762672, + 0.8288253024220467, + 0.6087603457272053, + 0.2138615995645523, + 0.19565458595752716, + 0.8053443469107151, + 0.5298758428543806, + 0.1458914764225483, + 0.8977293744683266, + 0.28699666261672974, + 0.37411320582032204, + 0.46369507908821106, + 0.23603545129299164, + 0.6406813710927963, + 0.9026511162519455, + 0.9877877160906792, + 0.9700462371110916, + 0.3548799194395542, + 0.4974473174661398, + 0.5188130289316177, + 1.5701489858329296, + 2.4466408863663673, + 0.6241939142346382, + 2.082782816141844, + 0.12701516598463058, + 0.12203089334070683, + 2.141734629869461, + 0.6619761437177658, + 0.7339464388787746, + 0.4928162284195423, + 0.780078511685133, + 0.028719525784254074, + 0.6854615360498428, + 0.8999545499682426, + 0.0, + 2.0846197344362736, + 1.019383255392313, + 0.9980302229523659, + 1.182505790144205, + 0.7356436401605606, + 1.063064948655665, + 1.1440139301121235, + 0.08673711866140366, + 0.1692425012588501, + 0.22537201270461082, + 0.5136809479445219, + 0.8106113411486149, + 0.5991273261606693, + 1.178852828219533, + 1.0888526402413845, + 1.8465689085423946, + 1.4058873821049929, + 0.13602468371391296, + 1.8806859105825424, + 1.3813181705772877, + 0.7182221747934818, + 1.2902578543871641 + ], + "unique_experts": 63, + "load_cv": 0.5233723387366856, + "normalized_load_entropy": 0.964222449167267, + "max_load_share": 0.03982300884955752 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "6b4d8b4e10a98894740d853dcca8d5b70bb4ab525507e0eccdc4928fa83674df", + "route_weight_sha256": "37dd0ed05b960c36eac672cd626acceb8b8ed1a2c0d104c108b561cf88d4804f", + "loads": [ + 10, + 11, + 8, + 12, + 11, + 15, + 9, + 17, + 9, + 10, + 16, + 4, + 14, + 11, + 4, + 26, + 7, + 12, + 17, + 7, + 9, + 10, + 15, + 15, + 5, + 16, + 11, + 16, + 13, + 10, + 23, + 4, + 3, + 27, + 10, + 18, + 7, + 9, + 11, + 16, + 14, + 8, + 27, + 17, + 17, + 16, + 11, + 19, + 9, + 5, + 11, + 5, + 14, + 21, + 9, + 25, + 15, + 19, + 15, + 3, + 16, + 23, + 13, + 18 + ], + "weighted_loads": [ + 0.7281474079936743, + 0.4763358663767576, + 0.41016246378421783, + 0.8270475976169109, + 0.6612086445093155, + 1.6803125254809856, + 0.6646109968423843, + 1.2307410994544625, + 0.8321776790544391, + 0.6087603457272053, + 0.9132693111896515, + 0.19565458595752716, + 1.017653927206993, + 0.5298758428543806, + 0.1458914764225483, + 2.951079996768385, + 0.46564507484436035, + 0.7281926050782204, + 1.3302229940891266, + 0.24911037739366293, + 0.6532331593334675, + 0.9026511162519455, + 0.9877877160906792, + 0.9700462371110916, + 0.3548799194395542, + 1.4012324083596468, + 0.5188130289316177, + 1.5701489858329296, + 2.4466408863663673, + 0.6241939142346382, + 2.082782816141844, + 0.17067019268870354, + 0.12203089334070683, + 2.141734629869461, + 0.6619761437177658, + 1.1934050843119621, + 0.4928162284195423, + 0.780078511685133, + 0.9156903438270092, + 1.3317123539745808, + 1.1341105960309505, + 0.8307992815971375, + 2.5497665256261826, + 1.1347635686397552, + 1.1339209377765656, + 1.182505790144205, + 0.7356436401605606, + 1.0786251230165362, + 1.1440139301121235, + 0.23721595760434866, + 0.8611583784222603, + 0.22537201270461082, + 1.1787486802786589, + 1.4068616293370724, + 0.614082811633125, + 2.0685177948325872, + 1.0888526402413845, + 1.8465689085423946, + 1.4058873821049929, + 0.1824093610048294, + 1.8806859105825424, + 1.3813181705772877, + 0.7182221747934818, + 2.226071836426854 + ], + "unique_experts": 64, + "load_cv": 0.45274232410163834, + "normalized_load_entropy": 0.9748810246210935, + "max_load_share": 0.03260869565217391 + } + }, + "s1_period": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "976323c7645b79ec20f06b0d47a45ea41b2514636601e0e39c5f1829b9f95998", + "route_weight_sha256": "5d1b95dc837df408f103e1f730b97ff353cc92e00a3ffdffdf083a974733007e", + "loads": [ + 10, + 10, + 8, + 11, + 12, + 15, + 8, + 14, + 8, + 10, + 5, + 5, + 11, + 12, + 3, + 15, + 4, + 7, + 7, + 6, + 10, + 11, + 14, + 15, + 5, + 7, + 11, + 16, + 13, + 10, + 23, + 4, + 5, + 28, + 10, + 12, + 7, + 9, + 0, + 8, + 9, + 1, + 19, + 15, + 15, + 16, + 11, + 18, + 10, + 1, + 3, + 5, + 11, + 12, + 7, + 13, + 14, + 18, + 15, + 2, + 16, + 21, + 12, + 15 + ], + "weighted_loads": [ + 0.7512223124504089, + 0.4712861031293869, + 0.4492055308073759, + 0.7775050066411495, + 0.7043263502418995, + 1.7838439121842384, + 0.6365928612649441, + 1.1542139127850533, + 0.8585483022034168, + 0.601594740524888, + 0.20419986359775066, + 0.23281043022871017, + 0.7805494740605354, + 0.5946877337992191, + 0.11579072661697865, + 1.037274707108736, + 0.28252626955509186, + 0.46648746728897095, + 0.4059854634106159, + 0.234014131128788, + 0.6724670734256506, + 0.9549824967980385, + 0.9415025860071182, + 0.9809645786881447, + 0.36601347476243973, + 0.4729434475302696, + 0.5121910348534584, + 1.5589847341179848, + 2.3935477696359158, + 0.6084830220788717, + 2.056576482951641, + 0.16167946718633175, + 0.1828828528523445, + 2.1220009066164494, + 0.6692030765116215, + 0.7508984692394733, + 0.4900223836302757, + 0.7719856649637222, + 0.0, + 0.5579553227871656, + 0.9146534539759159, + 0.028916174545884132, + 2.1365575566887856, + 1.02932083979249, + 1.0499290898442268, + 1.1928638499230146, + 0.7582115232944489, + 1.0661136098206043, + 1.2405805811285973, + 0.04098374769091606, + 0.16176972165703773, + 0.22438384033739567, + 0.4741022866219282, + 0.8270713686943054, + 0.5914319306612015, + 1.0820852406322956, + 1.0950331278145313, + 1.7923036571592093, + 1.3770523145794868, + 0.13315509259700775, + 1.9709534458816051, + 1.2881976217031479, + 0.710394412279129, + 1.2788192965090275 + ], + "unique_experts": 63, + "load_cv": 0.5109890467188498, + "normalized_load_entropy": 0.9656559932110541, + "max_load_share": 0.04129793510324484 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "5a203209081bb959a1f5add0cb53b136c93a9a6b5a17d75617703efcb899d9f3", + "route_weight_sha256": "3dbe0cd19a78ff390b8334385401d9a4f87791edbdd2d0f9d76f6a6b21b116b7", + "loads": [ + 11, + 11, + 8, + 17, + 12, + 17, + 16, + 17, + 9, + 10, + 19, + 8, + 16, + 12, + 4, + 31, + 8, + 19, + 20, + 16, + 11, + 11, + 15, + 15, + 6, + 15, + 11, + 18, + 13, + 11, + 23, + 5, + 6, + 29, + 11, + 18, + 8, + 12, + 11, + 19, + 13, + 14, + 32, + 20, + 17, + 16, + 11, + 20, + 10, + 14, + 12, + 7, + 12, + 22, + 10, + 24, + 14, + 18, + 16, + 3, + 17, + 22, + 12, + 19 + ], + "weighted_loads": [ + 0.7876745946705341, + 0.47485453845001757, + 0.4492055308073759, + 1.19223478063941, + 0.7043263502418995, + 1.8555335961282253, + 1.6177750267088413, + 1.2490890487097204, + 0.8619077808689326, + 0.601594740524888, + 1.1088803075253963, + 0.5959263071417809, + 1.2378835119307041, + 0.5946877337992191, + 0.1501218769699335, + 3.6554444138891995, + 0.5755721479654312, + 1.186703983694315, + 1.6085186414420605, + 1.0854391632601619, + 0.6850188616663218, + 0.9549824967980385, + 0.9791334420442581, + 0.9809645786881447, + 0.44219284504652023, + 1.1891629416495562, + 0.5121910348534584, + 1.7324203848838806, + 2.3935477696359158, + 0.6572944428771734, + 2.056576482951641, + 0.2074363436549902, + 0.3017794266343117, + 2.165162470191717, + 0.7038218826055527, + 1.3545702658593655, + 0.5355380289256573, + 0.9247543476521969, + 0.999813262373209, + 1.6457739938050508, + 1.0942644216120243, + 1.2748917993158102, + 2.9594633728265762, + 1.3420531898736954, + 1.1570092216134071, + 1.1928638499230146, + 0.7582115232944489, + 1.1147735062986612, + 1.2405805811285973, + 0.834421924315393, + 1.1766742803156376, + 0.29192466475069523, + 1.1391700189560652, + 1.6318014152348042, + 0.644765071105212, + 1.8726392462849617, + 1.0950331278145313, + 1.7923036571592093, + 1.4470715299248695, + 0.180831391364336, + 2.0171333849430084, + 1.3250942267477512, + 0.710394412279129, + 2.4566264636814594 + ], + "unique_experts": 64, + "load_cv": 0.41175635928717513, + "normalized_load_entropy": 0.9797503460435102, + "max_load_share": 0.03463203463203463 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 113, + "ordered_topk_exact_tokens": 100, + "set_exact_tokens": 103, + "mean_set_jaccard": 0.974715549936789, + "mean_token_weighted_tv": 0.007267593426745286, + "aggregate_load_tv": 0.014749262536873156 + }, + "system_bos": { + "tokens": 113, + "ordered_topk_exact_tokens": 82, + "set_exact_tokens": 92, + "mean_set_jaccard": 0.9450063211125157, + "mean_token_weighted_tv": 0.014817337592058213, + "aggregate_load_tv": 0.025073746312684365 + }, + "system_x": { + "tokens": 113, + "ordered_topk_exact_tokens": 69, + "set_exact_tokens": 86, + "mean_set_jaccard": 0.9317319848293301, + "mean_token_weighted_tv": 0.019053700652006452, + "aggregate_load_tv": 0.02654867256637168 + }, + "system_period": { + "tokens": 113, + "ordered_topk_exact_tokens": 70, + "set_exact_tokens": 82, + "mean_set_jaccard": 0.9216182048040454, + "mean_token_weighted_tv": 0.020317327762764376, + "aggregate_load_tv": 0.028023598820058997 + }, + "bos_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 73, + "set_exact_tokens": 85, + "mean_set_jaccard": 0.9254108723135273, + "mean_token_weighted_tv": 0.01957741208308566, + "aggregate_load_tv": 0.030973451327433628 + }, + "bos_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 74, + "set_exact_tokens": 88, + "mean_set_jaccard": 0.9348925410872313, + "mean_token_weighted_tv": 0.02018755479855875, + "aggregate_load_tv": 0.028023598820058997 + }, + "x_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 74, + "set_exact_tokens": 86, + "mean_set_jaccard": 0.9260429835651074, + "mean_token_weighted_tv": 0.01878761067838136, + "aggregate_load_tv": 0.030973451327433628 + }, + "x_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 74, + "set_exact_tokens": 89, + "mean_set_jaccard": 0.9355246523388117, + "mean_token_weighted_tv": 0.021192341062149643, + "aggregate_load_tv": 0.025073746312684365 + }, + "period_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 76, + "set_exact_tokens": 86, + "mean_set_jaccard": 0.9245680573114199, + "mean_token_weighted_tv": 0.01874515651189516, + "aggregate_load_tv": 0.029498525073746312 + }, + "period_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 74, + "set_exact_tokens": 87, + "mean_set_jaccard": 0.9285714285714285, + "mean_token_weighted_tv": 0.022233325118545148, + "aggregate_load_tv": 0.02359882005899705 + } + } + }, + "layer_06": { + "layer": 6, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "0fa01a2bd960a537e62ff4df9d92f507b0555d13af835337829a771bae912cb5", + "route_weight_sha256": "eb30b8bb66c9a71fc84d56eca24c8447e2e4778ec2ffe4221c12700fe9416354", + "loads": [ + 1, + 12, + 15, + 6, + 2, + 11, + 19, + 15, + 2, + 13, + 6, + 5, + 16, + 18, + 17, + 3, + 15, + 4, + 16, + 4, + 17, + 7, + 11, + 8, + 17, + 6, + 9, + 3, + 1, + 23, + 11, + 14, + 12, + 23, + 3, + 2, + 15, + 14, + 18, + 3, + 7, + 13, + 10, + 11, + 3, + 5, + 2, + 11, + 28, + 15, + 10, + 12, + 4, + 4, + 24, + 2, + 11, + 4, + 5, + 7, + 24, + 22, + 14, + 13 + ], + "weighted_loads": [ + 0.03946894779801369, + 0.6723145693540573, + 0.9950683936476707, + 0.24390483647584915, + 0.11249645054340363, + 0.7260293737053871, + 1.7828047312796116, + 1.0046605505049229, + 0.16307033970952034, + 0.8757769577205181, + 0.448979614302516, + 0.38153771683573723, + 1.370425671339035, + 1.549985058605671, + 0.9722368214279413, + 0.29072748124599457, + 0.9514599069952965, + 0.16946909949183464, + 1.325703538954258, + 0.21606852114200592, + 1.287685103714466, + 0.41985294595360756, + 0.9268845468759537, + 0.5031461976468563, + 0.8150125648826361, + 0.3151438757777214, + 0.463063171133399, + 0.3757452368736267, + 0.04858769103884697, + 2.0927886441349983, + 0.49992084316909313, + 1.0800599865615368, + 0.8714993670582771, + 1.6506792679429054, + 0.22091348841786385, + 0.0599915087223053, + 1.3379700630903244, + 0.7700986228883266, + 1.0187822859734297, + 0.1612851694226265, + 0.4073825739324093, + 1.0617287121713161, + 0.41098999977111816, + 0.754502672702074, + 0.0979455653578043, + 0.30022478103637695, + 0.10632675513625145, + 1.0061353296041489, + 2.91931214556098, + 1.3566115833818913, + 0.6407872512936592, + 1.2688394375145435, + 0.20714374631643295, + 0.16905507072806358, + 1.8943494334816933, + 0.08376114070415497, + 0.8032366260886192, + 0.4650142267346382, + 0.1973896063864231, + 0.32135019823908806, + 1.610462848097086, + 1.5420575439929962, + 0.7629565969109535, + 0.8372689038515091 + ], + "unique_experts": 64, + "load_cv": 0.6336005772781643, + "normalized_load_entropy": 0.949076423149661, + "max_load_share": 0.04129793510324484 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "77e6d90c2ef932d604f596ce6da9d059b4c8821b4467767f11ce527a7d1b3550", + "route_weight_sha256": "5e08538396202b7f3375536fe04f9f6e6bd2c5482b4878f2b0a6299d8a555ce9", + "loads": [ + 1, + 15, + 15, + 6, + 3, + 11, + 27, + 15, + 2, + 13, + 6, + 11, + 16, + 20, + 19, + 3, + 20, + 5, + 16, + 12, + 18, + 10, + 13, + 9, + 17, + 7, + 9, + 3, + 1, + 26, + 11, + 14, + 15, + 23, + 4, + 7, + 16, + 23, + 18, + 12, + 7, + 18, + 12, + 11, + 3, + 10, + 14, + 13, + 32, + 15, + 17, + 19, + 4, + 5, + 24, + 12, + 21, + 5, + 5, + 16, + 24, + 22, + 14, + 13 + ], + "weighted_loads": [ + 0.03946894779801369, + 0.7432736158370972, + 0.9950683936476707, + 0.24390483647584915, + 0.14132205210626125, + 0.7260293737053871, + 2.66039165109396, + 1.0046605505049229, + 0.16307033970952034, + 0.8757769577205181, + 0.448979614302516, + 0.7786858137696981, + 1.370425671339035, + 1.5780503582209349, + 1.144961567595601, + 0.29072748124599457, + 1.2856572307646275, + 0.17355844331905246, + 1.325703538954258, + 0.7654728889465332, + 1.3313340209424496, + 0.5742479953914881, + 2.420633092522621, + 0.538861021399498, + 0.8150125648826361, + 0.34301861748099327, + 0.463063171133399, + 0.3757452368736267, + 0.04858769103884697, + 2.2681008391082287, + 0.49992084316909313, + 1.0800599865615368, + 0.9597135446965694, + 1.6506792679429054, + 0.2555124759674072, + 0.5302604660391808, + 1.4211438745260239, + 1.5371072739362717, + 1.0187822859734297, + 0.5253588631749153, + 0.4073825739324093, + 1.460469551384449, + 0.46886423975229263, + 0.754502672702074, + 0.0979455653578043, + 0.4351046700030565, + 1.5095973014831543, + 1.0285016384441406, + 3.1099190749228, + 1.3566115833818913, + 1.0730703845620155, + 1.5758305974304676, + 0.20714374631643295, + 0.2152569778263569, + 1.8943494334816933, + 0.8452574871480465, + 1.935561828315258, + 0.5022161267697811, + 0.1973896063864231, + 1.279756586998701, + 1.610462848097086, + 1.5420575439929962, + 0.7629565969109535, + 0.8372689038515091 + ], + "unique_experts": 64, + "load_cv": 0.5424197959034875, + "normalized_load_entropy": 0.9613700589561139, + "max_load_share": 0.03864734299516908 + } + }, + "s1_eos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "890a9bef817310c66f296c697209b276131e3c49d24ce9198b962c59a925a4e3", + "route_weight_sha256": "6b5025b88ca9ed97ee267c3ce00bdda3f93559d6bf3155b130e836b7601176d3", + "loads": [ + 2, + 11, + 14, + 6, + 2, + 12, + 19, + 15, + 2, + 12, + 5, + 5, + 15, + 18, + 16, + 3, + 15, + 5, + 15, + 4, + 17, + 7, + 11, + 7, + 16, + 6, + 9, + 3, + 1, + 22, + 11, + 14, + 11, + 24, + 3, + 2, + 15, + 15, + 18, + 2, + 8, + 13, + 10, + 11, + 3, + 6, + 3, + 13, + 28, + 15, + 10, + 12, + 4, + 3, + 25, + 2, + 11, + 4, + 5, + 8, + 25, + 22, + 14, + 13 + ], + "weighted_loads": [ + 0.0713663212954998, + 0.630460225045681, + 0.952939298003912, + 0.24381045997142792, + 0.10849396511912346, + 0.7647351436316967, + 1.7771213874220848, + 1.004925787448883, + 0.16415156051516533, + 0.8451849222183228, + 0.420129781588912, + 0.3892771862447262, + 1.3267512433230877, + 1.5639128722250462, + 0.9261825643479824, + 0.2923572286963463, + 0.9468717835843563, + 0.22184161469340324, + 1.2708134427666664, + 0.21680103242397308, + 1.3088871091604233, + 0.4137274734675884, + 0.9161780513823032, + 0.48339948058128357, + 0.7613046448677778, + 0.29897046834230423, + 0.4573170728981495, + 0.3810785636305809, + 0.04660407826304436, + 2.0228826738893986, + 0.49328818917274475, + 1.0801709108054638, + 0.8244576565921307, + 1.6867125928401947, + 0.21923400461673737, + 0.05983761511743069, + 1.3270288072526455, + 0.8296053521335125, + 1.0174414329230785, + 0.13434256240725517, + 0.43311517871916294, + 1.051271267235279, + 0.421528447419405, + 0.7596477344632149, + 0.11320812627673149, + 0.32406179793179035, + 0.14883390069007874, + 1.0641916245222092, + 2.8897796757519245, + 1.3708972930908203, + 0.6360278241336346, + 1.2654272690415382, + 0.20499640703201294, + 0.14330944791436195, + 1.9088033810257912, + 0.08416185900568962, + 0.7980913743376732, + 0.46060171723365784, + 0.20166331343352795, + 0.36336807161569595, + 1.6430318169295788, + 1.5302463732659817, + 0.7673891577869654, + 0.8466372974216938 + ], + "unique_experts": 64, + "load_cv": 0.6327210150697298, + "normalized_load_entropy": 0.9497835569031596, + "max_load_share": 0.04129793510324484 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "0f7835bf3f3d1e15079ab81327906a0bea2493c1e5a0d406a7668156b92c7d65", + "route_weight_sha256": "ff1e098138d8ada354cac78b9db90e610864005ada6f41f47abb5f789e3021ba", + "loads": [ + 2, + 13, + 17, + 7, + 4, + 12, + 34, + 16, + 7, + 18, + 5, + 15, + 19, + 20, + 25, + 4, + 24, + 6, + 17, + 14, + 19, + 11, + 13, + 8, + 18, + 8, + 9, + 4, + 2, + 25, + 11, + 17, + 17, + 25, + 7, + 9, + 17, + 32, + 18, + 11, + 8, + 18, + 12, + 11, + 4, + 9, + 19, + 16, + 31, + 15, + 18, + 18, + 5, + 7, + 25, + 13, + 28, + 4, + 5, + 19, + 30, + 22, + 14, + 13 + ], + "weighted_loads": [ + 0.0713663212954998, + 0.6700617526657879, + 1.0964314602315426, + 0.2813148833811283, + 0.25970192812383175, + 0.7647351436316967, + 3.0782361030578613, + 1.0663639605045319, + 0.5016474612057209, + 1.5460865944623947, + 0.420129781588912, + 1.0597663596272469, + 1.6563800945878029, + 1.5922102737240493, + 1.627602394670248, + 0.40401284396648407, + 1.6627409905195236, + 0.22590534249320626, + 1.4185368493199348, + 0.9734250120818615, + 1.4011723436415195, + 0.6465761009603739, + 2.4084617532789707, + 0.5187483727931976, + 0.8283414114266634, + 0.3770594671368599, + 0.4573170728981495, + 0.4074756130576134, + 0.08397511392831802, + 2.217928070574999, + 0.49328818917274475, + 1.280000638216734, + 1.008313324302435, + 1.7202638946473598, + 0.47698497772216797, + 0.7426958177238703, + 1.4408915378153324, + 2.15642586350441, + 1.0174414329230785, + 0.6120760515332222, + 0.43311517871916294, + 1.4624137617647648, + 0.47944340482354164, + 0.7596477344632149, + 0.19774015620350838, + 0.39111356576904655, + 1.865174738690257, + 1.1178414325695485, + 3.0448794700205326, + 1.3708972930908203, + 1.1548344120383263, + 1.505429670214653, + 0.24164627119898796, + 0.35426752269268036, + 1.9088033810257912, + 1.0946363806724548, + 2.54691469296813, + 0.46060171723365784, + 0.20166331343352795, + 1.4174998216331005, + 1.907243985682726, + 1.5302463732659817, + 0.7673891577869654, + 0.8466372974216938 + ], + "unique_experts": 64, + "load_cv": 0.5413679110892492, + "normalized_load_entropy": 0.9635692470456365, + "max_load_share": 0.0367965367965368 + } + }, + "s0_bos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "8a91378c75f114093dd86393582c77471e9390af1285f3333d31f7f5d24e4812", + "route_weight_sha256": "d827a314a04eb9aa954262f4ff17989fd2ecdf07557129acf3c2269be8a3cec3", + "loads": [ + 1, + 12, + 14, + 8, + 2, + 11, + 19, + 15, + 2, + 14, + 5, + 5, + 16, + 18, + 16, + 3, + 14, + 4, + 13, + 5, + 17, + 7, + 12, + 7, + 15, + 5, + 7, + 3, + 1, + 23, + 11, + 13, + 13, + 22, + 3, + 1, + 15, + 14, + 17, + 4, + 8, + 13, + 11, + 11, + 3, + 5, + 4, + 14, + 29, + 15, + 10, + 12, + 4, + 3, + 26, + 2, + 12, + 4, + 6, + 6, + 24, + 22, + 14, + 13 + ], + "weighted_loads": [ + 0.03882932290434837, + 0.6960358396172523, + 0.9516721554100513, + 0.31626690551638603, + 0.09088815748691559, + 0.742596760392189, + 1.7688585929572582, + 0.9814328290522099, + 0.1663617342710495, + 0.9332338869571686, + 0.43924352526664734, + 0.3925188481807709, + 1.3565678223967552, + 1.5921863205730915, + 0.9795842245221138, + 0.2937086597084999, + 0.9113319218158722, + 0.1581687070429325, + 1.1464247442781925, + 0.24801921844482422, + 1.3065392822027206, + 0.4205728620290756, + 0.9622441157698631, + 0.4805437698960304, + 0.7662015855312347, + 0.25000983476638794, + 0.35477165132761, + 0.36357004940509796, + 0.04729964956641197, + 2.115516260266304, + 0.5036591161042452, + 1.0403213761746883, + 0.9310504030436277, + 1.5755207501351833, + 0.21835415810346603, + 0.040237147361040115, + 1.3328585028648376, + 0.7705092281103134, + 1.0099498517811298, + 0.18575453758239746, + 0.44841501489281654, + 1.066710114479065, + 0.4474583975970745, + 0.7548514623194933, + 0.09975954331457615, + 0.28067266568541527, + 0.20127496495842934, + 1.134770331904292, + 3.2039255015552044, + 1.3854627758264542, + 0.6569726206362247, + 1.2626877017319202, + 0.20488103106617928, + 0.14884928613901138, + 2.0174087919294834, + 0.08329407498240471, + 0.9164433889091015, + 0.4603504091501236, + 0.2252567671239376, + 0.2785522975027561, + 1.6486424170434475, + 1.5603085812181234, + 0.7795151434838772, + 0.8256540559232235 + ], + "unique_experts": 64, + "load_cv": 0.6327210150697298, + "normalized_load_entropy": 0.9494801028855939, + "max_load_share": 0.04277286135693215 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "0b71f4d2b2382850a8d4940674707f1ec27cf3ec6675b397ccd61be4b4184884", + "route_weight_sha256": "e6204a9ad687483b772dbf000d0818b5f1ed7c3ec801bd1153698a373344e72a", + "loads": [ + 1, + 14, + 14, + 8, + 3, + 11, + 27, + 15, + 2, + 14, + 5, + 11, + 16, + 19, + 19, + 4, + 20, + 4, + 13, + 13, + 18, + 10, + 13, + 8, + 15, + 6, + 7, + 3, + 1, + 27, + 11, + 13, + 16, + 22, + 4, + 6, + 16, + 25, + 17, + 13, + 8, + 18, + 13, + 11, + 3, + 9, + 17, + 15, + 33, + 15, + 17, + 19, + 4, + 4, + 26, + 12, + 22, + 4, + 6, + 15, + 24, + 22, + 14, + 13 + ], + "weighted_loads": [ + 0.03882932290434837, + 0.7622457593679428, + 0.9516721554100513, + 0.31626690551638603, + 0.11971375904977322, + 0.742596760392189, + 2.6568586751818657, + 0.9814328290522099, + 0.1663617342710495, + 0.9332338869571686, + 0.43924352526664734, + 0.7998995278030634, + 1.3565678223967552, + 1.6152828969061375, + 1.2017821408808231, + 0.34046391770243645, + 1.2899640910327435, + 0.1581687070429325, + 1.1464247442781925, + 0.7834959998726845, + 1.3501881994307041, + 0.5739259663969278, + 1.5086130127310753, + 0.5162585936486721, + 0.7662015855312347, + 0.2778845764696598, + 0.35477165132761, + 0.36357004940509796, + 0.04729964956641197, + 2.3371352963149548, + 0.5036591161042452, + 1.0403213761746883, + 1.01926458068192, + 1.5755207501351833, + 0.2529531456530094, + 0.5055522508919239, + 1.4034733846783638, + 1.6292112618684769, + 1.0099498517811298, + 0.545995868742466, + 0.44841501489281654, + 1.4654509536921978, + 0.505332637578249, + 0.7548514623194933, + 0.09975954331457615, + 0.41150614619255066, + 1.830832228064537, + 1.153868542984128, + 3.3992748633027077, + 1.3854627758264542, + 1.1399118416011333, + 1.5696788616478443, + 0.20488103106617928, + 0.19173604995012283, + 2.0174087919294834, + 0.8447904214262962, + 2.1213696636259556, + 0.4603504091501236, + 0.2252567671239376, + 1.2369586862623692, + 1.6486424170434475, + 1.5603085812181234, + 0.7795151434838772, + 0.8256540559232235 + ], + "unique_experts": 64, + "load_cv": 0.5578612101003704, + "normalized_load_entropy": 0.9595719738476434, + "max_load_share": 0.03985507246376811 + } + }, + "s1_bos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "68354c4c6d68aa6efc0b72857c73accbc8cb3f6769dcb2b1871e572c304d7278", + "route_weight_sha256": "71c7513a76202cb615f93fcb70fdf13f5ecfdca675759c12b40e678ede76e7b3", + "loads": [ + 2, + 12, + 14, + 7, + 1, + 12, + 20, + 15, + 2, + 14, + 6, + 5, + 16, + 18, + 16, + 3, + 15, + 4, + 13, + 4, + 17, + 7, + 11, + 7, + 15, + 5, + 8, + 3, + 1, + 23, + 10, + 15, + 12, + 22, + 3, + 1, + 15, + 13, + 18, + 2, + 8, + 13, + 12, + 10, + 2, + 6, + 4, + 12, + 29, + 14, + 10, + 11, + 5, + 4, + 25, + 2, + 12, + 4, + 5, + 7, + 24, + 25, + 14, + 13 + ], + "weighted_loads": [ + 0.06849403120577335, + 0.6813866831362247, + 0.9533292464911938, + 0.29505282640457153, + 0.05040765553712845, + 0.8016930632293224, + 1.8102809898555279, + 1.0015359185636044, + 0.16698185727000237, + 0.9528837259858847, + 0.45988378301262856, + 0.4085451737046242, + 1.4045266211032867, + 1.590182475745678, + 0.9689014367759228, + 0.3172632306814194, + 0.9394194558262825, + 0.16374525614082813, + 1.1532362289726734, + 0.22007280588150024, + 1.302312046289444, + 0.4197215661406517, + 0.9047185555100441, + 0.4837937168776989, + 0.7695258744060993, + 0.25098566338419914, + 0.37910142727196217, + 0.37898722290992737, + 0.04632246121764183, + 2.057575646787882, + 0.4702215902507305, + 1.120906699448824, + 0.8807005323469639, + 1.5615837760269642, + 0.21743762865662575, + 0.03740205615758896, + 1.3310570530593395, + 0.7140782997012138, + 1.046380802989006, + 0.12610599398612976, + 0.4287542309612036, + 1.06113875284791, + 0.4934284891933203, + 0.7372427098453045, + 0.06867319159209728, + 0.30470626428723335, + 0.23051408305764198, + 1.0758126303553581, + 3.1719255819916725, + 1.3389009311795235, + 0.6548407711088657, + 1.203217327594757, + 0.24048027768731117, + 0.18984327837824821, + 1.9733872190117836, + 0.08553622290492058, + 0.9428906813263893, + 0.4642191082239151, + 0.20476960763335228, + 0.31871717795729637, + 1.6623695716261864, + 1.6445976588875055, + 0.7842077203094959, + 0.81357267126441 + ], + "unique_experts": 64, + "load_cv": 0.6423299601379041, + "normalized_load_entropy": 0.9480131554580061, + "max_load_share": 0.04277286135693215 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "b07698510635c8fe4cd27935bb8bed500dbcdeb5f1a19fb1fdfeee1842a652b2", + "route_weight_sha256": "6c1a82c1b63f5297548fe749d261d1da626af3bb02aa8bdfc2bc16208f2fb7d1", + "loads": [ + 2, + 13, + 17, + 8, + 3, + 12, + 36, + 16, + 7, + 20, + 6, + 15, + 20, + 19, + 25, + 5, + 25, + 4, + 15, + 14, + 19, + 11, + 12, + 8, + 17, + 7, + 8, + 4, + 2, + 26, + 10, + 18, + 18, + 23, + 7, + 8, + 17, + 30, + 18, + 11, + 8, + 18, + 14, + 10, + 3, + 8, + 21, + 15, + 32, + 14, + 19, + 17, + 6, + 8, + 25, + 13, + 29, + 4, + 5, + 18, + 29, + 25, + 14, + 13 + ], + "weighted_loads": [ + 0.06849403120577335, + 0.7162269875407219, + 1.0968214087188244, + 0.3325572498142719, + 0.20161561854183674, + 0.8016930632293224, + 3.1774885691702366, + 1.0629740916192532, + 0.5044777579605579, + 1.6537853982299566, + 0.45988378301262856, + 1.0979215577244759, + 1.734155472368002, + 1.613279052078724, + 1.6782009862363338, + 0.4807828217744827, + 1.6995205469429493, + 0.16374525614082813, + 1.3009596355259418, + 0.9683698080480099, + 1.3945972807705402, + 0.6519301291555166, + 1.4510874524712563, + 0.519142609089613, + 0.8355273529887199, + 0.3290746621787548, + 0.37910142727196217, + 0.40538427233695984, + 0.0836934968829155, + 2.251876626163721, + 0.4702215902507305, + 1.320736426860094, + 1.0688451454043388, + 1.5951350778341293, + 0.47518860176205635, + 0.7254731468856335, + 1.4325469247996807, + 2.079446420073509, + 1.046380802989006, + 0.6038394831120968, + 0.4287542309612036, + 1.4722812473773956, + 0.5513434465974569, + 0.7372427098453045, + 0.15320522151887417, + 0.3679743353277445, + 2.1045066732913256, + 1.1834225207567215, + 3.340184696018696, + 1.3389009311795235, + 1.2669788785278797, + 1.4432197287678719, + 0.2771301418542862, + 0.39923010393977165, + 1.9733872190117836, + 1.0960107445716858, + 2.763538431376219, + 0.4642191082239151, + 0.20476960763335228, + 1.372848927974701, + 1.9265817403793335, + 1.6445976588875055, + 0.7842077203094959, + 0.81357267126441 + ], + "unique_experts": 64, + "load_cv": 0.555041834406712, + "normalized_load_entropy": 0.961791941273844, + "max_load_share": 0.03896103896103896 + } + }, + "s0_x": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "2eafc9fad2f70b04730a8be4e1b354d5a579848b80a6679e01b65b515be1f408", + "route_weight_sha256": "969326d9034cd779372410b0551e8192a491a0d734171d7c1d396786e15afacd", + "loads": [ + 1, + 12, + 12, + 6, + 2, + 11, + 19, + 14, + 2, + 13, + 5, + 5, + 16, + 17, + 17, + 3, + 15, + 3, + 14, + 5, + 17, + 7, + 13, + 8, + 17, + 6, + 9, + 4, + 1, + 23, + 10, + 13, + 14, + 22, + 3, + 1, + 15, + 12, + 16, + 3, + 9, + 13, + 11, + 11, + 3, + 6, + 4, + 12, + 29, + 15, + 10, + 12, + 4, + 3, + 26, + 1, + 12, + 4, + 5, + 8, + 24, + 23, + 14, + 13 + ], + "weighted_loads": [ + 0.03846403583884239, + 0.6932062357664108, + 0.8565048538148403, + 0.255322840064764, + 0.09384877234697342, + 0.7375819534063339, + 1.722742035984993, + 0.9510126151144505, + 0.16379966959357262, + 0.8758775033056736, + 0.44074074551463127, + 0.3950742036104202, + 1.3492403589189053, + 1.5352381467819214, + 1.0479805562645197, + 0.28645894676446915, + 0.9649251215159893, + 0.11169444769620895, + 1.1783475764095783, + 0.25416402146220207, + 1.2941257767379284, + 0.4321901239454746, + 0.9942900277674198, + 0.5011440441012383, + 0.8376962579786777, + 0.2966048903763294, + 0.4206908270716667, + 0.41770675778388977, + 0.047954343259334564, + 2.0944791175425053, + 0.4675343930721283, + 1.011192463338375, + 0.9700250066816807, + 1.5581197999417782, + 0.21736545115709305, + 0.03546394780278206, + 1.3438856080174446, + 0.7187206465750933, + 0.9795774072408676, + 0.16242125630378723, + 0.47622692957520485, + 1.0510826222598553, + 0.45168359763920307, + 0.7701435089111328, + 0.10418341867625713, + 0.30641575902700424, + 0.21224288269877434, + 1.067158890888095, + 3.159216407686472, + 1.3739684596657753, + 0.6804144494235516, + 1.2555789947509766, + 0.2056657001376152, + 0.15090196207165718, + 1.991483185440302, + 0.04671692103147507, + 0.9198126867413521, + 0.4415115863084793, + 0.20369400084018707, + 0.34935103729367256, + 1.6342421658337116, + 1.6372515223920345, + 0.7646211124956608, + 0.8234276063740253 + ], + "unique_experts": 64, + "load_cv": 0.6342594484826288, + "normalized_load_entropy": 0.9489256398781014, + "max_load_share": 0.04277286135693215 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "eeef5cfa41edaa364d0eefb413398b9c19675e2d443b666170c8c33b41fcca48", + "route_weight_sha256": "be1457c850b8d69cd765cbb2eb72e28a07e0b1bfdc8c3c83bc41242c16479fea", + "loads": [ + 1, + 14, + 12, + 6, + 3, + 11, + 29, + 14, + 2, + 13, + 5, + 10, + 16, + 18, + 20, + 4, + 20, + 3, + 14, + 14, + 18, + 10, + 14, + 9, + 17, + 7, + 9, + 4, + 1, + 26, + 10, + 13, + 17, + 22, + 4, + 6, + 16, + 23, + 16, + 11, + 9, + 20, + 13, + 11, + 3, + 10, + 16, + 13, + 33, + 15, + 15, + 20, + 4, + 4, + 26, + 12, + 21, + 4, + 5, + 18, + 24, + 23, + 14, + 13 + ], + "weighted_loads": [ + 0.03846403583884239, + 0.7594161555171013, + 0.8565048538148403, + 0.255322840064764, + 0.12267437390983105, + 0.7375819534063339, + 2.9008623994886875, + 0.9510126151144505, + 0.16379966959357262, + 0.8758775033056736, + 0.44074074551463127, + 0.74867526255548, + 1.3492403589189053, + 1.5583347231149673, + 1.2672341149300337, + 0.32992810010910034, + 1.2971219159662724, + 0.11169444769620895, + 1.1783475764095783, + 0.8583422861993313, + 1.3377746939659119, + 0.5811284687370062, + 1.540658924728632, + 0.5368588678538799, + 0.8376962579786777, + 0.3244796320796013, + 0.4206908270716667, + 0.41770675778388977, + 0.047954343259334564, + 2.2678851932287216, + 0.4675343930721283, + 1.011192463338375, + 1.058239184319973, + 1.5581197999417782, + 0.25196443870663643, + 0.5311524532735348, + 1.4112335965037346, + 1.528773421421647, + 0.9795774072408676, + 0.47979073598980904, + 0.47622692957520485, + 1.5883827432990074, + 0.5095578376203775, + 0.7701435089111328, + 0.10418341867625713, + 0.43724923953413963, + 1.5638214573264122, + 1.0862571019679308, + 3.3598732613027096, + 1.3739684596657753, + 1.0365943424403667, + 1.597910389304161, + 0.2056657001376152, + 0.19308293983340263, + 1.991483185440302, + 0.8639698587357998, + 1.9862638637423515, + 0.4415115863084793, + 0.20369400084018707, + 1.3837015964090824, + 1.6342421658337116, + 1.6372515223920345, + 0.7646211124956608, + 0.8234276063740253 + ], + "unique_experts": 64, + "load_cv": 0.5606987302606412, + "normalized_load_entropy": 0.9592776372237166, + "max_load_share": 0.03985507246376811 + } + }, + "s1_x": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "dd90746a239431370bdff1688de012c2f944f81af682fb77e2d149a766841062", + "route_weight_sha256": "5e5478a0fe4673c13c2880c4800b609bdfba1ea3bcaf4d31a5420d17ea4da748", + "loads": [ + 2, + 11, + 15, + 7, + 1, + 11, + 20, + 15, + 2, + 14, + 5, + 5, + 17, + 16, + 16, + 3, + 14, + 3, + 15, + 4, + 17, + 8, + 10, + 7, + 17, + 4, + 9, + 4, + 1, + 24, + 10, + 15, + 12, + 21, + 3, + 1, + 15, + 12, + 17, + 3, + 8, + 13, + 11, + 11, + 3, + 5, + 5, + 13, + 29, + 16, + 10, + 11, + 5, + 3, + 26, + 1, + 12, + 4, + 5, + 8, + 24, + 23, + 13, + 13 + ], + "weighted_loads": [ + 0.0706738755106926, + 0.6532066240906715, + 0.9995359107851982, + 0.2973179891705513, + 0.04919445514678955, + 0.7644265070557594, + 1.837066389620304, + 0.9982003606855869, + 0.166516475379467, + 0.952228706330061, + 0.4389739762991667, + 0.4215863198041916, + 1.4508023411035538, + 1.5085983760654926, + 0.976655125617981, + 0.30331042408943176, + 0.8849215768277645, + 0.13397954031825066, + 1.2332330420613289, + 0.22540080174803734, + 1.3104124665260315, + 0.45026494935154915, + 0.8526132702827454, + 0.47471676394343376, + 0.821739898994565, + 0.2174988128244877, + 0.408511396497488, + 0.4170246794819832, + 0.04772625491023064, + 2.0320422276854515, + 0.4648972228169441, + 1.0880876556038857, + 0.8693753927946091, + 1.4978569000959396, + 0.2191750891506672, + 0.03569555655121803, + 1.343751072883606, + 0.6688993759453297, + 1.0138688459992409, + 0.158341433852911, + 0.42095103301107883, + 1.0564846061170101, + 0.46648704819381237, + 0.7812205404043198, + 0.11247760057449341, + 0.2699040025472641, + 0.283553633838892, + 1.127920351922512, + 3.152892593294382, + 1.424738820642233, + 0.6653259173035622, + 1.2124751321971416, + 0.23956676945090294, + 0.15460727736353874, + 1.937595073133707, + 0.04991426691412926, + 0.8647458739578724, + 0.4397832825779915, + 0.21261965483427048, + 0.35432257503271103, + 1.6657191067934036, + 1.589487724006176, + 0.7383554093539715, + 0.8034014515578747 + ], + "unique_experts": 64, + "load_cv": 0.6421131719071592, + "normalized_load_entropy": 0.9478362617896782, + "max_load_share": 0.04277286135693215 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "7b83eb337001c24f96cfecc44e951686de6bc310a88be4135ef501eb253b97b9", + "route_weight_sha256": "2a5a01732476811dea0225ed43d34695c07f1fa3b9b7426fa673469d89b68d77", + "loads": [ + 2, + 12, + 18, + 8, + 3, + 11, + 38, + 16, + 7, + 20, + 5, + 14, + 21, + 17, + 25, + 5, + 23, + 3, + 17, + 16, + 19, + 12, + 11, + 8, + 19, + 6, + 9, + 5, + 2, + 27, + 10, + 18, + 17, + 22, + 7, + 8, + 17, + 28, + 17, + 12, + 8, + 20, + 13, + 11, + 4, + 7, + 21, + 15, + 32, + 16, + 18, + 18, + 6, + 6, + 26, + 13, + 28, + 4, + 5, + 20, + 29, + 23, + 13, + 13 + ], + "weighted_loads": [ + 0.0706738755106926, + 0.6880469284951687, + 1.1430280730128288, + 0.3348224125802517, + 0.20040241815149784, + 0.7644265070557594, + 3.5223602689802647, + 1.0596385337412357, + 0.5040123760700226, + 1.653130378574133, + 0.4389739762991667, + 1.061646930873394, + 1.780431192368269, + 1.5316949523985386, + 1.676030494272709, + 0.48158277571201324, + 1.6030369848012924, + 0.13397954031825066, + 1.3809564486145973, + 1.066883347928524, + 1.4026977010071278, + 0.6826058123260736, + 1.3989821672439575, + 0.5100656561553478, + 0.8875425588339567, + 0.29558781161904335, + 0.408511396497488, + 0.44342172890901566, + 0.0850972905755043, + 2.2227812223136425, + 0.4648972228169441, + 1.2879173830151558, + 1.0185298770666122, + 1.5314082019031048, + 0.4769260622560978, + 0.7174566760659218, + 1.4507046043872833, + 1.8910458236932755, + 1.0138688459992409, + 0.636074922978878, + 0.42095103301107883, + 1.5998234301805496, + 0.524402005597949, + 0.7812205404043198, + 0.1970096305012703, + 0.33317207358777523, + 1.8797506038099527, + 1.1782917343080044, + 3.3253347650170326, + 1.424738820642233, + 1.195102270692587, + 1.4818799421191216, + 0.27621663361787796, + 0.3221423365175724, + 1.937595073133707, + 1.131151132285595, + 2.507738944143057, + 0.4397832825779915, + 0.21261965483427048, + 1.4797358103096485, + 1.9299312755465508, + 1.589487724006176, + 0.7383554093539715, + 0.8034014515578747 + ], + "unique_experts": 64, + "load_cv": 0.5586764162673811, + "normalized_load_entropy": 0.9612206685177217, + "max_load_share": 0.04112554112554113 + } + }, + "s0_period": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "114fd575808236b2d7735c96dcf93a4148568660e018c2108031359b3fb58536", + "route_weight_sha256": "61ebc434f8f2122397478f5efd4d51e71203c68d09f3656198c33126e0811c00", + "loads": [ + 1, + 12, + 13, + 6, + 2, + 11, + 19, + 15, + 2, + 13, + 5, + 5, + 16, + 17, + 17, + 3, + 13, + 4, + 14, + 5, + 17, + 8, + 13, + 8, + 16, + 6, + 9, + 4, + 1, + 23, + 11, + 13, + 13, + 22, + 3, + 1, + 15, + 13, + 16, + 3, + 8, + 13, + 11, + 11, + 4, + 5, + 5, + 12, + 29, + 15, + 10, + 12, + 4, + 3, + 26, + 1, + 12, + 4, + 5, + 7, + 24, + 22, + 14, + 13 + ], + "weighted_loads": [ + 0.03826751559972763, + 0.70836416259408, + 0.8958458453416824, + 0.2515309862792492, + 0.09444597363471985, + 0.744594395160675, + 1.7335949391126633, + 0.989568367600441, + 0.16487639397382736, + 0.8881603367626667, + 0.4412927906960249, + 0.39790206402540207, + 1.335306953638792, + 1.5399391204118729, + 1.0332710072398186, + 0.27698586136102676, + 0.8732999712228775, + 0.15806437656283379, + 1.1838009916245937, + 0.2615789845585823, + 1.291201751679182, + 0.4727856144309044, + 0.9942555781453848, + 0.5064235422760248, + 0.8006845638155937, + 0.29799698665738106, + 0.42726720310747623, + 0.4138571061193943, + 0.0484037920832634, + 2.0877601467072964, + 0.5270842127501965, + 1.0212924033403397, + 0.9351459313184023, + 1.5257344469428062, + 0.21557868272066116, + 0.032292407006025314, + 1.3439760617911816, + 0.7682214789092541, + 0.9659988284111023, + 0.16293277218937874, + 0.4380842372775078, + 1.0622088089585304, + 0.45808470994234085, + 0.7457568868994713, + 0.14167595654726028, + 0.27669813111424446, + 0.2545675225555897, + 1.0796112082898617, + 3.153835780918598, + 1.3740929700434208, + 0.6881099976599216, + 1.258351631462574, + 0.20791346579790115, + 0.15033763274550438, + 1.9641702435910702, + 0.046788908541202545, + 0.8893986828625202, + 0.44384123384952545, + 0.19956394284963608, + 0.3151729740202427, + 1.6283733993768692, + 1.5844030976295471, + 0.7573638297617435, + 0.8191839978098869 + ], + "unique_experts": 64, + "load_cv": 0.6269737848623093, + "normalized_load_entropy": 0.9501888152440686, + "max_load_share": 0.04277286135693215 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "03afa9bb24771f516b4a9db40d73c76f17364fa6913806b280123e3cb22d021d", + "route_weight_sha256": "7a5dffd3ff003047e40dd1c06c4db9b2abeb11f992729165b68f07996d637b20", + "loads": [ + 1, + 14, + 13, + 6, + 3, + 11, + 29, + 15, + 2, + 13, + 5, + 10, + 17, + 18, + 19, + 4, + 18, + 4, + 14, + 15, + 18, + 11, + 14, + 9, + 16, + 7, + 9, + 4, + 2, + 26, + 11, + 13, + 16, + 22, + 4, + 6, + 16, + 24, + 16, + 11, + 8, + 19, + 13, + 11, + 4, + 9, + 17, + 13, + 33, + 15, + 15, + 20, + 4, + 4, + 26, + 12, + 21, + 4, + 5, + 16, + 24, + 22, + 14, + 13 + ], + "weighted_loads": [ + 0.03826751559972763, + 0.7745740823447704, + 0.8958458453416824, + 0.2515309862792492, + 0.12327157519757748, + 0.744594395160675, + 2.789269495755434, + 0.989568367600441, + 0.16487639397382736, + 0.8881603367626667, + 0.4412927906960249, + 0.7544310074299574, + 1.388823539018631, + 1.5630356967449188, + 1.2136120721697807, + 0.314785722643137, + 1.1971716061234474, + 0.15806437656283379, + 1.1838009916245937, + 0.9599874503910542, + 1.3348506689071655, + 0.621326444670558, + 1.540624475106597, + 0.5421383660286665, + 0.8006845638155937, + 0.3258717283606529, + 0.42726720310747623, + 0.4138571061193943, + 0.15565130859613419, + 2.2650827541947365, + 0.5270842127501965, + 1.0212924033403397, + 1.0233601089566946, + 1.5257344469428062, + 0.25017767027020454, + 0.530557956546545, + 1.4116543047130108, + 1.6678839176893234, + 0.9659988284111023, + 0.48030225187540054, + 0.4380842372775078, + 1.5170309282839298, + 0.5159589499235153, + 0.7457568868994713, + 0.14167595654726028, + 0.40753161162137985, + 1.605277094990015, + 1.0987094193696976, + 3.3491124734282494, + 1.3740929700434208, + 1.039135403931141, + 1.5994877479970455, + 0.20791346579790115, + 0.19378318265080452, + 1.9641702435910702, + 0.9553478099405766, + 1.9388507641851902, + 0.44384123384952545, + 0.19956394284963608, + 1.2735793627798557, + 1.6283733993768692, + 1.5844030976295471, + 0.7573638297617435, + 0.8191839978098869 + ], + "unique_experts": 64, + "load_cv": 0.5511270671376233, + "normalized_load_entropy": 0.9611304694291884, + "max_load_share": 0.03985507246376811 + } + }, + "s1_period": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "10b5c0f158882875b2609646d8d190ad1b6ee9170d20dcb9a7c69ccca618fb26", + "route_weight_sha256": "8e6a1635ac0b89a8427653fe578aaa6d46bc9fab70b2bf2d4417c44562de7d3d", + "loads": [ + 3, + 12, + 15, + 7, + 1, + 11, + 20, + 13, + 2, + 15, + 5, + 5, + 16, + 17, + 15, + 3, + 14, + 3, + 15, + 5, + 17, + 8, + 11, + 7, + 17, + 5, + 9, + 3, + 1, + 24, + 10, + 14, + 12, + 21, + 3, + 1, + 15, + 13, + 17, + 3, + 7, + 13, + 10, + 10, + 4, + 5, + 4, + 13, + 29, + 16, + 10, + 11, + 5, + 4, + 26, + 2, + 12, + 4, + 5, + 8, + 24, + 22, + 13, + 13 + ], + "weighted_loads": [ + 0.10410761460661888, + 0.6999278552830219, + 1.0062052235007286, + 0.29284700378775597, + 0.0521697998046875, + 0.7610584087669849, + 1.8396432437002659, + 0.9213757626712322, + 0.16671405360102654, + 0.984296727925539, + 0.43306330777704716, + 0.42444758117198944, + 1.3799001425504684, + 1.5683387331664562, + 0.9440341033041477, + 0.30327627062797546, + 0.883914690464735, + 0.13458960130810738, + 1.209705427289009, + 0.2714052349328995, + 1.2929770089685917, + 0.45048240944743156, + 0.9006719812750816, + 0.4820687361061573, + 0.8402833621948957, + 0.2575766071677208, + 0.41391964070498943, + 0.3769245222210884, + 0.048067621886730194, + 2.0369062460958958, + 0.4653695747256279, + 1.052579514682293, + 0.8802495449781418, + 1.4859676659107208, + 0.21974441036581993, + 0.03542037308216095, + 1.335906032472849, + 0.7085429988801479, + 1.0039122514426708, + 0.159232459962368, + 0.3783791419118643, + 1.0533422082662582, + 0.4296747352927923, + 0.7259972840547562, + 0.14190992526710033, + 0.27075763791799545, + 0.2505369707942009, + 1.1414689905941486, + 3.1511393636465073, + 1.4110489934682846, + 0.6831909157335758, + 1.2052989453077316, + 0.24382515624165535, + 0.1886322721838951, + 1.9386779963970184, + 0.0855451263487339, + 0.860433753579855, + 0.4412192106246948, + 0.20798511989414692, + 0.3600013814866543, + 1.6411398611962795, + 1.5541391130536795, + 0.7190139349550009, + 0.7968595623970032 + ], + "unique_experts": 64, + "load_cv": 0.631619839888225, + "normalized_load_entropy": 0.9501347097837612, + "max_load_share": 0.04277286135693215 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "dddcee01381f9255517dfd4d55c3b7595975bfba292544a431ada5309ac06e48", + "route_weight_sha256": "fb2b7be55b617e03ad881312279c8581621a12194105883e1a2dbb05d1d5f715", + "loads": [ + 3, + 13, + 18, + 8, + 3, + 11, + 38, + 14, + 7, + 21, + 5, + 14, + 21, + 18, + 24, + 5, + 23, + 3, + 17, + 17, + 19, + 12, + 12, + 8, + 19, + 7, + 9, + 4, + 3, + 27, + 10, + 17, + 17, + 22, + 7, + 8, + 17, + 30, + 17, + 12, + 7, + 19, + 12, + 10, + 5, + 7, + 21, + 15, + 31, + 16, + 17, + 18, + 6, + 7, + 26, + 14, + 28, + 4, + 5, + 19, + 29, + 22, + 13, + 13 + ], + "weighted_loads": [ + 0.10410761460661888, + 0.7347681596875191, + 1.1496973857283592, + 0.33035142719745636, + 0.2033777628093958, + 0.7610584087669849, + 3.3798410519957542, + 0.982813935726881, + 0.5042099542915821, + 1.685198400169611, + 0.43306330777704716, + 1.0642514526844025, + 1.7745277173817158, + 1.5914353094995022, + 1.6442875005304813, + 0.4685034565627575, + 1.5973105728626251, + 0.13458960130810738, + 1.3574288338422775, + 1.210355643182993, + 1.385262243449688, + 0.6821568999439478, + 1.4470408782362938, + 0.5174176283180714, + 0.9076451007276773, + 0.33566560596227646, + 0.41391964070498943, + 0.4033215716481209, + 0.207847710698843, + 2.230131860822439, + 0.4653695747256279, + 1.252409242093563, + 1.029404029250145, + 1.519518967717886, + 0.47749538347125053, + 0.7251684702932835, + 1.4436232559382915, + 2.06837709620595, + 1.0039122514426708, + 0.636965949088335, + 0.3783791419118643, + 1.507604356855154, + 0.487589692696929, + 0.7259972840547562, + 0.22644195519387722, + 0.3340257089585066, + 1.8812571298331022, + 1.191840372979641, + 3.2479730546474457, + 1.4110489934682846, + 1.1514646857976913, + 1.4780306816101074, + 0.28047502040863037, + 0.35616733133792877, + 1.9386779963970184, + 1.2284270599484444, + 2.484011210501194, + 0.4412192106246948, + 0.20798511989414692, + 1.4141331315040588, + 1.9053520299494267, + 1.5541391130536795, + 0.7190139349550009, + 0.7968595623970032 + ], + "unique_experts": 64, + "load_cv": 0.5526054992853132, + "normalized_load_entropy": 0.962569030886594, + "max_load_share": 0.04112554112554113 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 113, + "ordered_topk_exact_tokens": 86, + "set_exact_tokens": 95, + "mean_set_jaccard": 0.95448798988622, + "mean_token_weighted_tv": 0.01004271876825168, + "aggregate_load_tv": 0.019174041297935103 + }, + "system_bos": { + "tokens": 113, + "ordered_topk_exact_tokens": 70, + "set_exact_tokens": 86, + "mean_set_jaccard": 0.9317319848293301, + "mean_token_weighted_tv": 0.01635250299179976, + "aggregate_load_tv": 0.025073746312684365 + }, + "system_x": { + "tokens": 113, + "ordered_topk_exact_tokens": 61, + "set_exact_tokens": 80, + "mean_set_jaccard": 0.9165613147914032, + "mean_token_weighted_tv": 0.02091681480045076, + "aggregate_load_tv": 0.028023598820058997 + }, + "system_period": { + "tokens": 113, + "ordered_topk_exact_tokens": 64, + "set_exact_tokens": 80, + "mean_set_jaccard": 0.9146649810366625, + "mean_token_weighted_tv": 0.02101340883337291, + "aggregate_load_tv": 0.029498525073746312 + }, + "bos_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 63, + "set_exact_tokens": 87, + "mean_set_jaccard": 0.9342604298356512, + "mean_token_weighted_tv": 0.018446932266573464, + "aggregate_load_tv": 0.028023598820058997 + }, + "bos_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 61, + "set_exact_tokens": 78, + "mean_set_jaccard": 0.911504424778761, + "mean_token_weighted_tv": 0.02308486859454254, + "aggregate_load_tv": 0.029498525073746312 + }, + "x_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 60, + "set_exact_tokens": 85, + "mean_set_jaccard": 0.9292035398230089, + "mean_token_weighted_tv": 0.0190681795861605, + "aggregate_load_tv": 0.028023598820058997 + }, + "x_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 50, + "set_exact_tokens": 70, + "mean_set_jaccard": 0.8912768647281922, + "mean_token_weighted_tv": 0.026833187318942714, + "aggregate_load_tv": 0.035398230088495575 + }, + "period_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 61, + "set_exact_tokens": 87, + "mean_set_jaccard": 0.934260429835651, + "mean_token_weighted_tv": 0.018240922633393677, + "aggregate_load_tv": 0.025073746312684365 + }, + "period_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 50, + "set_exact_tokens": 70, + "mean_set_jaccard": 0.8893805309734514, + "mean_token_weighted_tv": 0.027462334957270497, + "aggregate_load_tv": 0.035398230088495575 + } + } + }, + "layer_07": { + "layer": 7, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "7bd7e8a424721f3e3eeb411e1807ea82457b8604c7ae1b4f4ffc9ffa1e6c2dae", + "route_weight_sha256": "570281a4d1c708e71f6bd1873cb584eaae18642a93a2be612a457639a05bfd2f", + "loads": [ + 18, + 8, + 6, + 9, + 9, + 14, + 9, + 16, + 9, + 8, + 33, + 9, + 10, + 0, + 2, + 10, + 5, + 11, + 19, + 24, + 1, + 14, + 17, + 19, + 14, + 13, + 8, + 13, + 1, + 6, + 8, + 0, + 2, + 4, + 10, + 7, + 7, + 12, + 14, + 14, + 8, + 4, + 14, + 9, + 16, + 17, + 15, + 30, + 4, + 12, + 1, + 17, + 11, + 2, + 9, + 1, + 3, + 14, + 10, + 14, + 24, + 5, + 15, + 10 + ], + "weighted_loads": [ + 1.0898468159139156, + 0.4594305269420147, + 0.465043094009161, + 0.39319685474038124, + 0.5699567385017872, + 1.061343315988779, + 0.40316291898489, + 1.0912520457059145, + 0.5911301970481873, + 0.7628420107066631, + 2.106365382671356, + 0.559883788228035, + 0.5142667889595032, + 0.0, + 0.07369593903422356, + 0.508346538990736, + 0.21187811717391014, + 0.5411485359072685, + 2.03215947188437, + 2.129897002130747, + 0.03271441161632538, + 1.017968539148569, + 1.0838972590863705, + 1.2581139504909515, + 1.4372550677508116, + 0.8126889411360025, + 0.5479713119566441, + 1.0519598759710789, + 0.0358380526304245, + 0.5186114571988583, + 0.4907345771789551, + 0.0, + 0.2024650201201439, + 0.15034755691885948, + 0.5247956290841103, + 0.365797258913517, + 0.5302286371588707, + 0.8749684318900108, + 1.1194360479712486, + 0.8390320762991905, + 0.5121629349887371, + 0.29832189716398716, + 1.1319434493780136, + 0.6392915789037943, + 1.289870884269476, + 1.0257311146706343, + 1.535991381853819, + 2.382527556270361, + 0.26863639801740646, + 0.6654179338365793, + 0.12560832500457764, + 1.1905469968914986, + 1.054607082158327, + 0.07599660381674767, + 0.5091579183936119, + 0.08254557847976685, + 0.11862294375896454, + 0.7923920936882496, + 0.5962066873908043, + 0.6221186891198158, + 1.6394779328256845, + 0.2594622652977705, + 1.0585936978459358, + 0.6732296012341976 + ], + "unique_experts": 62, + "load_cv": 0.6408109023823972, + "normalized_load_entropy": 0.9473718345827732, + "max_load_share": 0.048672566371681415 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "045a60220d3056b417d84e838b778a7e7af1c9967aa11d09c6ffd9984d0f2e91", + "route_weight_sha256": "f69dd0eb0e3e610dc00e43b1edd00b180042e71baa07dc30d51002726c968978", + "loads": [ + 18, + 8, + 6, + 12, + 9, + 15, + 14, + 16, + 17, + 8, + 35, + 12, + 10, + 5, + 2, + 10, + 19, + 14, + 21, + 25, + 1, + 14, + 20, + 21, + 19, + 13, + 11, + 13, + 4, + 6, + 8, + 0, + 5, + 6, + 10, + 7, + 7, + 12, + 24, + 17, + 8, + 15, + 19, + 11, + 20, + 17, + 17, + 32, + 4, + 12, + 17, + 17, + 11, + 3, + 9, + 8, + 3, + 14, + 14, + 14, + 24, + 11, + 17, + 17 + ], + "weighted_loads": [ + 1.0898468159139156, + 0.4594305269420147, + 0.465043094009161, + 0.50423988327384, + 0.5699567385017872, + 1.1030422300100327, + 0.8850494176149368, + 1.0912520457059145, + 1.2432815544307232, + 0.7628420107066631, + 2.191924747079611, + 1.0563188791275024, + 0.5142667889595032, + 0.28649481758475304, + 0.07369593903422356, + 0.508346538990736, + 2.1794180274009705, + 0.7147650010883808, + 2.073599634692073, + 2.2063278444111347, + 0.03271441161632538, + 1.017968539148569, + 1.2569033056497574, + 1.395538255572319, + 1.597553368192166, + 0.8126889411360025, + 0.8072088696062565, + 1.0519598759710789, + 0.0991812041029334, + 0.5186114571988583, + 0.4907345771789551, + 0.0, + 0.3173840530216694, + 0.24837295338511467, + 0.5247956290841103, + 0.365797258913517, + 0.5302286371588707, + 0.8749684318900108, + 2.0797024331986904, + 0.9693925492465496, + 0.5121629349887371, + 1.278035907074809, + 1.4936259798705578, + 0.6712839854881167, + 2.8099156469106674, + 1.0257311146706343, + 1.6218138299882412, + 2.5581984855234623, + 0.26863639801740646, + 0.6654179338365793, + 1.301146935671568, + 1.1905469968914986, + 1.054607082158327, + 0.10756539180874825, + 0.5091579183936119, + 0.7381862998008728, + 0.11862294375896454, + 0.7923920936882496, + 0.681786285713315, + 0.6221186891198158, + 1.6394779328256845, + 0.5568417403846979, + 1.078942786436528, + 0.9377822056412697 + ], + "unique_experts": 63, + "load_cv": 0.5368843138941909, + "normalized_load_entropy": 0.9632167415837158, + "max_load_share": 0.042270531400966184 + } + }, + "s1_eos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "c334703c91003c0109d86e5ba23bb502aa78bf2c3a04ee247c46d482046af70a", + "route_weight_sha256": "2f1850b5e72ebd13f1b6aeeec96c59f0958daf2b3050f22a449634ed3e66e72b", + "loads": [ + 18, + 8, + 7, + 10, + 9, + 14, + 10, + 14, + 9, + 8, + 32, + 10, + 10, + 0, + 1, + 9, + 6, + 11, + 19, + 24, + 1, + 14, + 16, + 19, + 14, + 13, + 8, + 14, + 1, + 6, + 8, + 0, + 2, + 5, + 10, + 6, + 8, + 12, + 15, + 15, + 8, + 5, + 13, + 9, + 15, + 17, + 15, + 30, + 4, + 13, + 1, + 17, + 11, + 3, + 8, + 1, + 2, + 14, + 9, + 15, + 23, + 4, + 15, + 10 + ], + "weighted_loads": [ + 1.081038124859333, + 0.46179596334695816, + 0.48968226835131645, + 0.43039226345717907, + 0.5688354633748531, + 1.0467173289507627, + 0.4478680044412613, + 1.0163831003010273, + 0.5682492032647133, + 0.7503737732768059, + 2.072446061298251, + 0.5839007534086704, + 0.5051739141345024, + 0.0, + 0.040344223380088806, + 0.46323130652308464, + 0.26224174350500107, + 0.5206697583198547, + 2.040370650589466, + 2.0957432240247726, + 0.03125135600566864, + 1.023384340107441, + 1.0600931402295828, + 1.251553263515234, + 1.419770972803235, + 0.8159808162599802, + 0.5195806957781315, + 1.0950205512344837, + 0.034843891859054565, + 0.5288903005421162, + 0.49619220942258835, + 0.0, + 0.21196208521723747, + 0.1829508487135172, + 0.5278544202446938, + 0.32162561267614365, + 0.557525122538209, + 0.8830615729093552, + 1.1462016999721527, + 0.8618530482053757, + 0.5080443359911442, + 0.32164001651108265, + 1.0855248533189297, + 0.6314961388707161, + 1.2558768205344677, + 1.0254517626017332, + 1.5460022948682308, + 2.352774728089571, + 0.2632385976612568, + 0.6925834361463785, + 0.11998140066862106, + 1.1851415745913982, + 1.0550073869526386, + 0.12792951241135597, + 0.4631420634686947, + 0.08323346078395844, + 0.08764339983463287, + 0.7951640486717224, + 0.5611063651740551, + 0.6672938242554665, + 1.574825331568718, + 0.21825066953897476, + 1.0535923801362514, + 0.6682313419878483 + ], + "unique_experts": 62, + "load_cv": 0.630958212307409, + "normalized_load_entropy": 0.9481182612172783, + "max_load_share": 0.0471976401179941 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "a11c367f18e2beeec139676e54d6b91f35324f8cee005a9e0053094df99f1419", + "route_weight_sha256": "6c309e18d9346f83b3b9bd2d8caf9ce98c4f51b14eea619f9f0875603273fda6", + "loads": [ + 18, + 8, + 7, + 12, + 10, + 15, + 17, + 14, + 25, + 10, + 40, + 15, + 10, + 6, + 3, + 10, + 21, + 15, + 21, + 25, + 1, + 14, + 18, + 22, + 19, + 13, + 15, + 15, + 4, + 12, + 8, + 0, + 8, + 14, + 10, + 6, + 8, + 16, + 32, + 19, + 10, + 21, + 23, + 12, + 25, + 17, + 17, + 36, + 4, + 13, + 23, + 17, + 11, + 3, + 12, + 10, + 2, + 20, + 12, + 15, + 23, + 10, + 19, + 13 + ], + "weighted_loads": [ + 1.081038124859333, + 0.46179596334695816, + 0.48968226835131645, + 0.4933751877397299, + 0.616231057792902, + 1.0912575107067823, + 0.9283902551978827, + 1.0163831003010273, + 1.9280467703938484, + 0.8523112274706364, + 2.6802389342337847, + 1.214361671358347, + 0.5051739141345024, + 0.33542478270828724, + 0.10942089930176735, + 0.5177191868424416, + 2.638251133263111, + 0.7481208741664886, + 2.081403186544776, + 2.1719148084521294, + 0.03125135600566864, + 1.023384340107441, + 1.1812670696526766, + 1.423345860093832, + 1.576999428216368, + 0.8159808162599802, + 1.1286906152963638, + 1.1254470366984606, + 0.09836767893284559, + 1.3030217252671719, + 0.49619220942258835, + 0.0, + 0.5971831455826759, + 0.766825282946229, + 0.5278544202446938, + 0.32162561267614365, + 0.557525122538209, + 1.1103532798588276, + 2.938235193490982, + 1.037314873188734, + 0.7296496517956257, + 1.7589456383138895, + 1.88832276314497, + 0.7030839892104268, + 3.317248187959194, + 1.0254517626017332, + 1.6521652713418007, + 2.7159672807902098, + 0.2632385976612568, + 0.6925834361463785, + 1.7059569079428911, + 1.1851415745913982, + 1.0550073869526386, + 0.12792951241135597, + 0.6705231070518494, + 0.8466494251042604, + 0.08764339983463287, + 1.3317276537418365, + 0.6181864738464355, + 0.6672938242554665, + 1.574825331568718, + 0.5138698853552341, + 1.139656106941402, + 0.7577254921197891 + ], + "unique_experts": 63, + "load_cv": 0.5413679110892492, + "normalized_load_entropy": 0.9630619120325722, + "max_load_share": 0.04329004329004329 + } + }, + "s0_bos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "1836a72bae3e2e1cacff4bf6dc0d502d73ea280c2683da5f30a1e4716179fabf", + "route_weight_sha256": "f2309a9d4a9acc1f1f456d13b6d6085bcdd9dff47b1507bad487ac72ea8cda2b", + "loads": [ + 18, + 7, + 6, + 12, + 9, + 13, + 9, + 14, + 9, + 8, + 30, + 10, + 11, + 0, + 1, + 10, + 4, + 9, + 21, + 25, + 1, + 14, + 16, + 19, + 13, + 14, + 11, + 15, + 0, + 6, + 7, + 0, + 2, + 5, + 10, + 6, + 7, + 13, + 15, + 13, + 8, + 4, + 14, + 9, + 16, + 17, + 16, + 29, + 5, + 12, + 1, + 17, + 13, + 2, + 8, + 1, + 3, + 13, + 9, + 15, + 22, + 5, + 16, + 10 + ], + "weighted_loads": [ + 1.0932834036648273, + 0.41835255548357964, + 0.46446526050567627, + 0.5204672757536173, + 0.5696207545697689, + 1.029200367629528, + 0.36018500477075577, + 1.021076150238514, + 0.5912203378975391, + 0.7676211781799793, + 1.98919677734375, + 0.5982874091714621, + 0.566284216940403, + 0.0, + 0.043017223477363586, + 0.5008507035672665, + 0.19229432940483093, + 0.44052961468696594, + 2.135210642591119, + 2.1865744180977345, + 0.03411341458559036, + 0.9989212937653065, + 1.061894241720438, + 1.263408763334155, + 1.4071564190089703, + 0.8423566333949566, + 0.6858142539858818, + 1.110007654875517, + 0.0, + 0.5554775260388851, + 0.48267941549420357, + 0.0, + 0.20639599114656448, + 0.19599532894790173, + 0.5226102881133556, + 0.3487814888358116, + 0.5110166426748037, + 0.9378774575889111, + 1.1971799060702324, + 0.7947076708078384, + 0.5199146829545498, + 0.2961503341794014, + 1.1272060312330723, + 0.6689741834998131, + 1.290111031383276, + 1.0044317804276943, + 1.541314024478197, + 2.347107905894518, + 0.31977538019418716, + 0.6900633573532104, + 0.12618039548397064, + 1.178679745644331, + 1.1251365914940834, + 0.07661217451095581, + 0.49736700020730495, + 0.08338556438684464, + 0.11504081636667252, + 0.790917282924056, + 0.5465185828506947, + 0.6454730648547411, + 1.5378219820559025, + 0.23609009012579918, + 1.107588917016983, + 0.6728252731263638 + ], + "unique_experts": 61, + "load_cv": 0.630958212307409, + "normalized_load_entropy": 0.946531136285117, + "max_load_share": 0.04424778761061947 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "598e6549dfd7c051bc56714bd2f78275e6a5d265ec422d42358cb054643611cc", + "route_weight_sha256": "ef2579b698746bca9aed90ad6149227cf9578eb07eecc253eb499638f632e86c", + "loads": [ + 18, + 7, + 6, + 15, + 9, + 14, + 15, + 14, + 17, + 8, + 32, + 14, + 11, + 5, + 1, + 10, + 18, + 12, + 24, + 27, + 1, + 14, + 19, + 21, + 17, + 14, + 15, + 15, + 2, + 6, + 7, + 0, + 5, + 7, + 10, + 6, + 7, + 13, + 25, + 16, + 8, + 15, + 19, + 10, + 20, + 17, + 18, + 31, + 5, + 12, + 16, + 17, + 13, + 4, + 8, + 8, + 3, + 13, + 12, + 15, + 22, + 11, + 17, + 17 + ], + "weighted_loads": [ + 1.0932834036648273, + 0.41835255548357964, + 0.46446526050567627, + 0.631510304287076, + 0.5696207545697689, + 1.0708992816507816, + 0.9433463290333748, + 1.021076150238514, + 1.2391132824122906, + 0.7676211781799793, + 2.0711292922496796, + 1.1891053970903158, + 0.566284216940403, + 0.28649481758475304, + 0.043017223477363586, + 0.5008507035672665, + 2.1723080910742283, + 0.6051928289234638, + 2.2175191398710012, + 2.331649549305439, + 0.03411341458559036, + 0.9989212937653065, + 1.234900288283825, + 1.399440323933959, + 1.5603742878884077, + 0.8423566333949566, + 1.0169824957847595, + 1.110007654875517, + 0.05013463832437992, + 0.5554775260388851, + 0.48267941549420357, + 0.0, + 0.32131502404809, + 0.30966747365891933, + 0.5226102881133556, + 0.3487814888358116, + 0.5110166426748037, + 0.9378774575889111, + 2.215751949697733, + 0.9237569309771061, + 0.5199146829545498, + 1.269710212945938, + 1.491573490202427, + 0.6865651272237301, + 1.9849397279322147, + 1.0044317804276943, + 1.6425310410559177, + 2.516911495476961, + 0.31977538019418716, + 0.6900633573532104, + 1.3359824009239674, + 1.178679745644331, + 1.1251365914940834, + 0.15236689522862434, + 0.49736700020730495, + 0.7390262857079506, + 0.11504081636667252, + 0.790917282924056, + 0.6169957593083382, + 0.6454730648547411, + 1.5378219820559025, + 0.5334695652127266, + 1.1222924031317234, + 0.9373778775334358 + ], + "unique_experts": 63, + "load_cv": 0.531466838253681, + "normalized_load_entropy": 0.9628184353214592, + "max_load_share": 0.03864734299516908 + } + }, + "s1_bos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "a614b67121af0f4f8e9e7a240c822d514add20b828ddd553efa3dbbe3baf9d8b", + "route_weight_sha256": "ce253972e84a4d16bf48eb6d4090dde65bac780c4380a0cd3c889155ed338976", + "loads": [ + 18, + 5, + 6, + 11, + 9, + 12, + 11, + 13, + 9, + 11, + 32, + 10, + 11, + 0, + 1, + 10, + 5, + 9, + 21, + 27, + 0, + 14, + 16, + 19, + 13, + 14, + 9, + 14, + 0, + 6, + 8, + 0, + 2, + 5, + 10, + 5, + 7, + 14, + 15, + 13, + 8, + 4, + 13, + 9, + 17, + 17, + 15, + 30, + 5, + 12, + 2, + 17, + 13, + 3, + 8, + 1, + 3, + 14, + 7, + 15, + 20, + 3, + 17, + 10 + ], + "weighted_loads": [ + 1.105887208133936, + 0.342334121465683, + 0.47697849944233894, + 0.48892442882061005, + 0.5701309703290462, + 0.9850076418370008, + 0.47160089388489723, + 0.9728334285318851, + 0.5706171244382858, + 0.8459061086177826, + 2.012756310403347, + 0.5979936178773642, + 0.5561023689806461, + 0.0, + 0.03801173344254494, + 0.4746856093406677, + 0.2606624197214842, + 0.4372192621231079, + 2.098077056929469, + 2.291270647197962, + 0.0, + 1.0052508302032948, + 1.0701613649725914, + 1.252571664750576, + 1.4190661869943142, + 0.8611015006899834, + 0.5959432795643806, + 1.0763883702456951, + 0.0, + 0.5630168877542019, + 0.5215694531798363, + 0.0, + 0.21103836223483086, + 0.19800809770822525, + 0.5181383602321148, + 0.32646629959344864, + 0.517754090949893, + 0.9698178879916668, + 1.1602782793343067, + 0.7889270670711994, + 0.5272138006985188, + 0.29620683938264847, + 1.09848165884614, + 0.6437996719032526, + 1.3659251853823662, + 1.0085982456803322, + 1.543699987232685, + 2.344513826072216, + 0.32359135150909424, + 0.6823107488453388, + 0.15527791529893875, + 1.1835806220769882, + 1.1153888907283545, + 0.11278935894370079, + 0.46471885964274406, + 0.08128878474235535, + 0.11378019861876965, + 0.7825397308915854, + 0.49796082079410553, + 0.6513348296284676, + 1.4477918334305286, + 0.16959119960665703, + 1.129520632326603, + 0.6603369638323784 + ], + "unique_experts": 60, + "load_cv": 0.6490144793974197, + "normalized_load_entropy": 0.9443059318824458, + "max_load_share": 0.0471976401179941 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "ddce3a7004cbf104da1ec08a5b207da1e9723716675e3e69dbdc492c445223ee", + "route_weight_sha256": "a4b795c2eba916b52a5e208bf78854c1b0e85cc17c376c8a5bed05ba264f38ea", + "loads": [ + 18, + 5, + 6, + 13, + 10, + 13, + 19, + 13, + 24, + 13, + 40, + 15, + 11, + 6, + 3, + 11, + 20, + 13, + 24, + 29, + 1, + 14, + 18, + 23, + 17, + 14, + 17, + 15, + 2, + 12, + 8, + 0, + 8, + 14, + 10, + 5, + 7, + 18, + 32, + 17, + 10, + 20, + 23, + 11, + 27, + 17, + 18, + 36, + 5, + 12, + 23, + 17, + 13, + 3, + 12, + 10, + 3, + 20, + 9, + 15, + 20, + 9, + 20, + 13 + ], + "weighted_loads": [ + 1.105887208133936, + 0.342334121465683, + 0.47697849944233894, + 0.5519073531031609, + 0.6175265647470951, + 1.0295478235930204, + 1.084930645301938, + 0.9728334285318851, + 1.8826807662844658, + 0.9478435628116131, + 2.620866883546114, + 1.2499600108712912, + 0.5561023689806461, + 0.33542478270828724, + 0.10708840936422348, + 0.5291734896600246, + 2.647111577913165, + 0.6509392410516739, + 2.1772877760231495, + 2.436901655048132, + 0.04004080593585968, + 1.0052508302032948, + 1.1913352943956852, + 1.4739567562937737, + 1.569123363122344, + 0.8611015006899834, + 1.2693012356758118, + 1.106814855709672, + 0.049777647480368614, + 1.3371483124792576, + 0.5215694531798363, + 0.0, + 0.5962594226002693, + 0.794840894639492, + 0.5181383602321148, + 0.32646629959344864, + 0.517754090949893, + 1.1971095949411392, + 2.9658200442790985, + 0.9640909135341644, + 0.7488191165030003, + 1.721844855695963, + 1.9034365750849247, + 0.7014894653111696, + 2.5896771363914013, + 1.0085982456803322, + 1.6982644759118557, + 2.7050552908331156, + 0.32359135150909424, + 0.6823107488453388, + 1.8242459055036306, + 1.1835806220769882, + 1.1153888907283545, + 0.11278935894370079, + 0.6720999032258987, + 0.8447047490626574, + 0.11378019861876965, + 1.3191033359616995, + 0.5396285317838192, + 0.6513348296284676, + 1.4477918334305286, + 0.4652104154229164, + 1.2100463472306728, + 0.7498311139643192 + ], + "unique_experts": 63, + "load_cv": 0.557736391585177, + "normalized_load_entropy": 0.9607869131695742, + "max_load_share": 0.04329004329004329 + } + }, + "s0_x": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "b734f227d0b1b59e2d17743c1623211d025e65cc970500ee628de0c43e36ce9d", + "route_weight_sha256": "fbc8cd81e3d79802b30c410ebfcffe4b85324f5b765b9cf2760ba4a427e83190", + "loads": [ + 18, + 6, + 6, + 13, + 9, + 14, + 7, + 14, + 8, + 8, + 32, + 11, + 11, + 0, + 1, + 12, + 4, + 9, + 19, + 24, + 1, + 14, + 16, + 20, + 13, + 14, + 12, + 13, + 0, + 6, + 7, + 0, + 2, + 5, + 10, + 6, + 7, + 12, + 15, + 13, + 8, + 3, + 14, + 9, + 16, + 17, + 15, + 29, + 4, + 13, + 1, + 17, + 13, + 2, + 9, + 1, + 3, + 14, + 10, + 14, + 23, + 5, + 15, + 11 + ], + "weighted_loads": [ + 1.1041758470237255, + 0.37887638434767723, + 0.47620515897870064, + 0.5368270222097635, + 0.5686936862766743, + 1.0523656010627747, + 0.2797660119831562, + 1.0161223039031029, + 0.544223491102457, + 0.7743635140359402, + 2.0776560567319393, + 0.6315065678209066, + 0.5790525581687689, + 0.0, + 0.04843658208847046, + 0.5594804752618074, + 0.19821836985647678, + 0.44789985567331314, + 2.0567850451916456, + 2.1529688090085983, + 0.033818796277046204, + 0.9922931827604771, + 1.0877800025045872, + 1.3199889473617077, + 1.424989314749837, + 0.8491654619574547, + 0.8030023947358131, + 1.0270406790077686, + 0.0, + 0.5265813991427422, + 0.48137273639440536, + 0.0, + 0.20875532180070877, + 0.1856484618037939, + 0.5176239907741547, + 0.34646905213594437, + 0.5190118439495564, + 0.8983090035617352, + 1.1824140809476376, + 0.792176004499197, + 0.5179599449038506, + 0.27516650035977364, + 1.1233131438493729, + 0.6481275502592325, + 1.3015480674803257, + 1.0101295076310635, + 1.5120030976831913, + 2.36862713098526, + 0.28643567860126495, + 0.728426106274128, + 0.11312054097652435, + 1.182311337441206, + 1.1409562528133392, + 0.07648437470197678, + 0.5213290471583605, + 0.08449123799800873, + 0.1194726936519146, + 0.8192904777824879, + 0.5865491814911366, + 0.616436317563057, + 1.6059485767036676, + 0.23538921400904655, + 1.078546941280365, + 0.7170988544821739 + ], + "unique_experts": 61, + "load_cv": 0.639505980963127, + "normalized_load_entropy": 0.9452994948269567, + "max_load_share": 0.0471976401179941 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "2aea13ed989d33b1f4191549d8191f0c7880a110dfe050a6ea159fc4c26ddab1", + "route_weight_sha256": "4c6c498caf2305b684cc7f89ce04930f2f55ecd85238f49c36f6e8a1a17f5795", + "loads": [ + 18, + 6, + 6, + 16, + 9, + 16, + 11, + 14, + 15, + 8, + 34, + 15, + 11, + 6, + 1, + 12, + 20, + 12, + 21, + 25, + 1, + 14, + 19, + 22, + 17, + 14, + 16, + 13, + 2, + 6, + 7, + 0, + 5, + 7, + 10, + 6, + 7, + 12, + 25, + 16, + 8, + 14, + 19, + 10, + 19, + 17, + 18, + 32, + 4, + 13, + 15, + 17, + 13, + 3, + 9, + 8, + 3, + 14, + 13, + 14, + 23, + 12, + 16, + 19 + ], + "weighted_loads": [ + 1.1041758470237255, + 0.37887638434767723, + 0.47620515897870064, + 0.6478700507432222, + 0.5686936862766743, + 1.150087732821703, + 0.6456362940371037, + 1.0161223039031029, + 1.1440846771001816, + 0.7743635140359402, + 2.1624989360570908, + 1.2144437786191702, + 0.5790525581687689, + 0.3200710527598858, + 0.04843658208847046, + 0.5594804752618074, + 2.507128881290555, + 0.6269183233380318, + 2.0982252079993486, + 2.2313776463270187, + 0.033818796277046204, + 0.9922931827604771, + 1.260786049067974, + 1.4534726366400719, + 1.5782071836292744, + 0.8491654619574547, + 1.1213934682309628, + 1.0270406790077686, + 0.05013463832437992, + 0.5265813991427422, + 0.48137273639440536, + 0.0, + 0.32367435470223427, + 0.3068129476159811, + 0.5176239907741547, + 0.34646905213594437, + 0.5190118439495564, + 0.8983090035617352, + 2.111520003527403, + 0.9193119145929813, + 0.5179599449038506, + 1.1866047903895378, + 1.4913437068462372, + 0.6657184939831495, + 1.9497096166014671, + 1.0101295076310635, + 1.6430727392435074, + 2.5868805646896362, + 0.28643567860126495, + 0.728426106274128, + 1.1416287533938885, + 1.182311337441206, + 1.1409562528133392, + 0.10805316269397736, + 0.5213290471583605, + 0.7401319593191147, + 0.1194726936519146, + 0.8192904777824879, + 0.6570263579487801, + 0.616436317563057, + 1.6059485767036676, + 0.5852095782756805, + 1.0932504273951054, + 1.0610913075506687 + ], + "unique_experts": 63, + "load_cv": 0.5381000664245907, + "normalized_load_entropy": 0.9620445256310076, + "max_load_share": 0.04106280193236715 + } + }, + "s1_x": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "a96734c601d4a01de832a7088d4187abbb5abbaf44d0e9aedd7ae6eaa169ffea", + "route_weight_sha256": "0ed48fe88438633a61daa1be62a31dbd5ac1150530580abb0399173f03fbe205", + "loads": [ + 18, + 7, + 7, + 11, + 9, + 13, + 11, + 12, + 8, + 11, + 30, + 10, + 10, + 0, + 1, + 9, + 3, + 10, + 21, + 27, + 0, + 14, + 16, + 20, + 14, + 14, + 10, + 13, + 0, + 6, + 8, + 0, + 2, + 5, + 10, + 6, + 7, + 13, + 15, + 11, + 8, + 4, + 14, + 8, + 16, + 19, + 16, + 29, + 6, + 12, + 2, + 17, + 12, + 2, + 9, + 1, + 4, + 13, + 9, + 15, + 19, + 4, + 17, + 10 + ], + "weighted_loads": [ + 1.1197080984711647, + 0.4224967919290066, + 0.5062870942056179, + 0.4776720870286226, + 0.5654415376484394, + 1.0118079334497452, + 0.46040911599993706, + 0.9242433644831181, + 0.5232657045125961, + 0.8573475759476423, + 1.886695558205247, + 0.5905362162739038, + 0.5299318097531796, + 0.0, + 0.03891462832689285, + 0.4097190126776695, + 0.1905758287757635, + 0.49822357296943665, + 2.0810951068997383, + 2.2553606424480677, + 0.0, + 0.9988116323947906, + 1.0898522548377514, + 1.285687681287527, + 1.4519718158990145, + 0.874541025608778, + 0.6937066167593002, + 1.037573467940092, + 0.0, + 0.5352550186216831, + 0.5258315093815327, + 0.0, + 0.21187447383999825, + 0.1877058707177639, + 0.5156154036521912, + 0.3538079671561718, + 0.5216733645647764, + 0.9406490735709667, + 1.1380891911685467, + 0.7067390084266663, + 0.5296727009117603, + 0.27851129323244095, + 1.142750095576048, + 0.6009626463055611, + 1.3477148097008467, + 1.0933192502707243, + 1.5705587323755026, + 2.2741288654506207, + 0.3889925517141819, + 0.6738659404218197, + 0.1462216041982174, + 1.1894354335963726, + 1.1112267188727856, + 0.07344085350632668, + 0.46398735605180264, + 0.08252796530723572, + 0.15371772460639477, + 0.751640209928155, + 0.5664990730583668, + 0.6637422516942024, + 1.421750832349062, + 0.20166650041937828, + 1.1359625235199928, + 0.6652148179709911 + ], + "unique_experts": 60, + "load_cv": 0.6329410202103808, + "normalized_load_entropy": 0.9460886260115204, + "max_load_share": 0.04424778761061947 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "3d33b26f52292b57be09bb5038395e3b3ec04ecb5531adf8b74403c59f605993", + "route_weight_sha256": "6f1e7a2edc434534124efec9fd1b11e0856a76d52349c1392d4ae003faedeee6", + "loads": [ + 18, + 7, + 7, + 13, + 10, + 15, + 17, + 12, + 24, + 13, + 38, + 15, + 10, + 7, + 3, + 10, + 19, + 14, + 23, + 28, + 0, + 14, + 18, + 24, + 19, + 14, + 17, + 14, + 2, + 12, + 8, + 0, + 8, + 14, + 10, + 6, + 7, + 17, + 31, + 15, + 10, + 19, + 24, + 10, + 25, + 19, + 20, + 36, + 6, + 12, + 23, + 17, + 12, + 2, + 13, + 10, + 4, + 19, + 11, + 15, + 19, + 11, + 20, + 14 + ], + "weighted_loads": [ + 1.1197080984711647, + 0.4224967919290066, + 0.5062870942056179, + 0.5406550113111734, + 0.6128371320664883, + 1.1096414513885975, + 0.8440165389329195, + 0.9242433644831181, + 1.8614340610802174, + 0.9592850301414728, + 2.489586642012, + 1.2559133265167475, + 0.5299318097531796, + 0.3652608785778284, + 0.1079913042485714, + 0.46420689299702644, + 2.8397120106965303, + 0.7297863736748695, + 2.122127642855048, + 2.326680952683091, + 0.0, + 0.9988116323947906, + 1.2110261842608452, + 1.4901299253106117, + 1.6353642381727695, + 0.874541025608778, + 1.2956013046205044, + 1.067999953404069, + 0.049777647480368614, + 1.3093864433467388, + 0.5258315093815327, + 0.0, + 0.5970955342054367, + 0.7915532924234867, + 0.5156154036521912, + 0.3538079671561718, + 0.5216733645647764, + 1.1679407805204391, + 2.8305255509912968, + 0.8816325180232525, + 0.7512780167162418, + 1.5781503356993198, + 1.9469707570970058, + 0.6586524397134781, + 2.5350617226213217, + 1.0933192502707243, + 1.7593504022806883, + 2.6952786128968, + 0.3889925517141819, + 0.6738659404218197, + 1.6240304429084063, + 1.1894354335963726, + 1.1112267188727856, + 0.07344085350632668, + 0.6713683996349573, + 0.8459439296275377, + 0.15371772460639477, + 1.288203814998269, + 0.6081667840480804, + 0.6637422516942024, + 1.421750832349062, + 0.5501409694552422, + 1.2164882384240627, + 0.8232252225279808 + ], + "unique_experts": 62, + "load_cv": 0.5376163269519825, + "normalized_load_entropy": 0.9625070203993676, + "max_load_share": 0.04112554112554113 + } + }, + "s0_period": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "18ec830d964738f829af1cdf0130848e3963d6090f643d09c578d3174df52b83", + "route_weight_sha256": "23c5f6d0d860ec75fa33a4eed3e54ffabe1aded66f9b4bd0ac66491ec32b9216", + "loads": [ + 18, + 7, + 6, + 13, + 9, + 14, + 7, + 14, + 9, + 8, + 32, + 10, + 11, + 0, + 1, + 12, + 4, + 11, + 18, + 24, + 1, + 13, + 16, + 20, + 13, + 14, + 10, + 13, + 1, + 6, + 7, + 0, + 2, + 5, + 10, + 6, + 6, + 13, + 15, + 13, + 8, + 3, + 13, + 9, + 17, + 17, + 15, + 29, + 4, + 12, + 1, + 17, + 13, + 2, + 9, + 1, + 3, + 14, + 10, + 14, + 23, + 5, + 17, + 10 + ], + "weighted_loads": [ + 1.111059758812189, + 0.42741716653108597, + 0.4737146496772766, + 0.5453413464128971, + 0.5641464814543724, + 1.0563062261790037, + 0.28004729375243187, + 1.0137034729123116, + 0.6024939753115177, + 0.7606952711939812, + 2.0718478709459305, + 0.6024354845285416, + 0.57664018496871, + 0.0, + 0.048123668879270554, + 0.5801164079457521, + 0.20215297676622868, + 0.5439996123313904, + 2.035643246024847, + 2.0984279438853264, + 0.031705256551504135, + 0.9443763270974159, + 1.099730011075735, + 1.3175696618855, + 1.4206964373588562, + 0.8474324215203524, + 0.7122452259063721, + 1.03266217187047, + 0.03400430083274841, + 0.5262322090566158, + 0.4783880151808262, + 0.0, + 0.21477092802524567, + 0.18394671380519867, + 0.5132642462849617, + 0.34059322997927666, + 0.4851304180920124, + 0.9244331233203411, + 1.1836601085960865, + 0.7924861796200275, + 0.5230325758457184, + 0.2790372893214226, + 1.0780028477311134, + 0.6573261730372906, + 1.3187943771481514, + 1.0071836896240711, + 1.5120369233191013, + 2.3850617855787277, + 0.2912968546152115, + 0.6992910392582417, + 0.12075488269329071, + 1.1837456822395325, + 1.1292496994137764, + 0.07802939042448997, + 0.5057032946497202, + 0.08543646335601807, + 0.11975453794002533, + 0.8179279081523418, + 0.6213260404765606, + 0.6137772276997566, + 1.606831008568406, + 0.24965349957346916, + 1.1575517281889915, + 0.6701577454805374 + ], + "unique_experts": 62, + "load_cv": 0.6371066833683652, + "normalized_load_entropy": 0.946551106226679, + "max_load_share": 0.0471976401179941 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "9ea7d2a3ec9f0d6fef5463d6363c9790884cf921174f83c0b1f6289280d7eab4", + "route_weight_sha256": "0db0e6b7ae2d23228096b03ca379481b43568ce083c7e741e1df3a57de6b71d7", + "loads": [ + 18, + 7, + 6, + 16, + 9, + 15, + 12, + 14, + 17, + 8, + 34, + 14, + 11, + 5, + 1, + 12, + 20, + 14, + 20, + 25, + 1, + 13, + 20, + 22, + 17, + 14, + 13, + 13, + 3, + 6, + 7, + 0, + 5, + 7, + 10, + 6, + 6, + 13, + 26, + 16, + 8, + 15, + 18, + 10, + 20, + 17, + 16, + 31, + 4, + 12, + 18, + 17, + 13, + 3, + 9, + 8, + 3, + 14, + 13, + 14, + 23, + 11, + 18, + 17 + ], + "weighted_loads": [ + 1.111059758812189, + 0.42741716653108597, + 0.4737146496772766, + 0.6563843749463558, + 0.5641464814543724, + 1.0980051402002573, + 0.6826478205621243, + 1.0137034729123116, + 1.2918726354837418, + 0.7606952711939812, + 2.1573428250849247, + 1.1910517290234566, + 0.57664018496871, + 0.28649481758475304, + 0.048123668879270554, + 0.5801164079457521, + 2.496643817052245, + 0.7101009748876095, + 2.07708340883255, + 2.1734340339899063, + 0.031705256551504135, + 0.9443763270974159, + 1.317050863057375, + 1.4497923851013184, + 1.5739143062382936, + 0.8474324215203524, + 0.9686300121247768, + 1.03266217187047, + 0.08413893915712833, + 0.5262322090566158, + 0.4783880151808262, + 0.0, + 0.32968996092677116, + 0.2992440089583397, + 0.5132642462849617, + 0.34059322997927666, + 0.4851304180920124, + 0.9244331233203411, + 2.2175167687237263, + 0.920452568680048, + 0.5230325758457184, + 1.2546321377158165, + 1.4398655146360397, + 0.6749171167612076, + 1.966638907790184, + 1.0071836896240711, + 1.5671482123434544, + 2.5570336133241653, + 0.2912968546152115, + 0.6992910392582417, + 1.5531067550182343, + 1.1837456822395325, + 1.1292496994137764, + 0.10959817841649055, + 0.5057032946497202, + 0.741077184677124, + 0.11975453794002533, + 0.8179279081523418, + 0.6918032169342041, + 0.6137772276997566, + 1.606831008568406, + 0.5470329746603966, + 1.172255214303732, + 0.9347103498876095 + ], + "unique_experts": 63, + "load_cv": 0.536362433514332, + "normalized_load_entropy": 0.9623537132924279, + "max_load_share": 0.04106280193236715 + } + }, + "s1_period": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "5ace31832d9a74a8dcc80476fc5d3f80ad005edd67bc9774c81195a651f807c4", + "route_weight_sha256": "edca6da6e54ab743f6a096a6d3b396d184fc72beb747bbc4ac5b680579cc8d7d", + "loads": [ + 18, + 7, + 7, + 12, + 9, + 13, + 12, + 13, + 8, + 10, + 29, + 10, + 10, + 0, + 1, + 9, + 3, + 10, + 21, + 27, + 0, + 14, + 16, + 20, + 14, + 14, + 10, + 13, + 0, + 6, + 7, + 0, + 2, + 5, + 10, + 6, + 8, + 14, + 14, + 12, + 8, + 4, + 13, + 8, + 16, + 18, + 16, + 29, + 6, + 12, + 2, + 17, + 12, + 3, + 8, + 1, + 4, + 13, + 9, + 14, + 20, + 4, + 17, + 10 + ], + "weighted_loads": [ + 1.1123233251273632, + 0.43047767877578735, + 0.5123833268880844, + 0.5182651840150356, + 0.5634765215218067, + 1.0118392053991556, + 0.49854077957570553, + 0.9794836305081844, + 0.5106374695897102, + 0.8246550690382719, + 1.8487067185342312, + 0.595243152230978, + 0.549133101478219, + 0.0, + 0.038893651217222214, + 0.4084657747298479, + 0.19586899131536484, + 0.49397213384509087, + 2.109040781855583, + 2.2326147202402353, + 0.0, + 0.9971909187734127, + 1.0936290137469769, + 1.2899486124515533, + 1.4479778502136469, + 0.8663937076926231, + 0.7226677089929581, + 1.0406312458217144, + 0.0, + 0.5390236638486385, + 0.4918387085199356, + 0.0, + 0.21584006771445274, + 0.18398340605199337, + 0.5135388486087322, + 0.354405514895916, + 0.554259717464447, + 0.9693651776760817, + 1.1117517240345478, + 0.7452632188796997, + 0.5347695052623749, + 0.2858220934867859, + 1.0834006629884243, + 0.6240472197532654, + 1.3185707703232765, + 1.050778890028596, + 1.56232301145792, + 2.2724235244095325, + 0.37788505107164383, + 0.6689589507877827, + 0.1387043111026287, + 1.1963821984827518, + 1.1091476082801819, + 0.12513887137174606, + 0.42392653226852417, + 0.08339336514472961, + 0.14517574198544025, + 0.7522344943135977, + 0.5935852564871311, + 0.6101578399538994, + 1.4619773551821709, + 0.20332608744502068, + 1.1245120018720627, + 0.6609039604663849 + ], + "unique_experts": 60, + "load_cv": 0.6269737848623093, + "normalized_load_entropy": 0.9469429559220881, + "max_load_share": 0.04277286135693215 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "9bf2ef6f20221df1a3d30c5c2fa556fde6a2622f58480dd491c00b758c8714b0", + "route_weight_sha256": "4bdbfdfbb0f3af466de52433beeed3ca4143a3b1b38242fafe5b689964b51ff3", + "loads": [ + 18, + 7, + 7, + 14, + 10, + 14, + 19, + 13, + 25, + 12, + 37, + 15, + 10, + 6, + 3, + 10, + 19, + 14, + 23, + 27, + 0, + 14, + 19, + 23, + 18, + 14, + 18, + 14, + 2, + 12, + 7, + 0, + 9, + 14, + 10, + 6, + 8, + 18, + 31, + 16, + 10, + 21, + 23, + 10, + 25, + 18, + 18, + 35, + 6, + 12, + 25, + 17, + 12, + 3, + 12, + 10, + 4, + 19, + 11, + 14, + 20, + 10, + 20, + 13 + ], + "weighted_loads": [ + 1.1123233251273632, + 0.43047767877578735, + 0.5123833268880844, + 0.5812481082975864, + 0.6108721159398556, + 1.0563793871551752, + 0.9200380109250546, + 0.9794836305081844, + 1.9042310789227486, + 0.9265925232321024, + 2.4524343349039555, + 1.2179734148085117, + 0.549133101478219, + 0.33542478270828724, + 0.10797032713890076, + 0.4629536550492048, + 2.786659959703684, + 0.7119925245642662, + 2.150073317810893, + 2.2326147202402353, + 0.0, + 0.9971909187734127, + 1.2473972253501415, + 1.4600530490279198, + 1.5980350263416767, + 0.8663937076926231, + 1.3843527622520924, + 1.0710577312856913, + 0.049777647480368614, + 1.3131550885736942, + 0.4918387085199356, + 0.0, + 0.6350613199174404, + 0.7832431811839342, + 0.5135388486087322, + 0.354405514895916, + 0.554259717464447, + 1.196656884625554, + 2.889727760106325, + 0.9217000976204872, + 0.7563748210668564, + 1.6980417929589748, + 1.8826910480856895, + 0.6817370131611824, + 2.506781056523323, + 1.050778890028596, + 1.66848598793149, + 2.6267746593803167, + 0.37788505107164383, + 0.6689589507877827, + 2.058019118383527, + 1.1963821984827518, + 1.1091476082801819, + 0.12513887137174606, + 0.6313075758516788, + 0.8468093294650316, + 0.14517574198544025, + 1.2887980993837118, + 0.6352529674768448, + 0.6101578399538994, + 1.4619773551821709, + 0.49894530326128006, + 1.2050377167761326, + 0.7503981105983257 + ], + "unique_experts": 62, + "load_cv": 0.5329951983709411, + "normalized_load_entropy": 0.9630050831356506, + "max_load_share": 0.04004329004329004 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 113, + "ordered_topk_exact_tokens": 85, + "set_exact_tokens": 97, + "mean_set_jaccard": 0.9595448798988622, + "mean_token_weighted_tv": 0.009632760469298975, + "aggregate_load_tv": 0.02064896755162242 + }, + "system_bos": { + "tokens": 113, + "ordered_topk_exact_tokens": 74, + "set_exact_tokens": 87, + "mean_set_jaccard": 0.9323640960809103, + "mean_token_weighted_tv": 0.015951610425800348, + "aggregate_load_tv": 0.02654867256637168 + }, + "system_x": { + "tokens": 113, + "ordered_topk_exact_tokens": 60, + "set_exact_tokens": 75, + "mean_set_jaccard": 0.8993678887484198, + "mean_token_weighted_tv": 0.023446180907168747, + "aggregate_load_tv": 0.04277286135693215 + }, + "system_period": { + "tokens": 113, + "ordered_topk_exact_tokens": 64, + "set_exact_tokens": 79, + "mean_set_jaccard": 0.9068689422671724, + "mean_token_weighted_tv": 0.023045503443716902, + "aggregate_load_tv": 0.03982300884955752 + }, + "bos_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 65, + "set_exact_tokens": 80, + "mean_set_jaccard": 0.9146649810366625, + "mean_token_weighted_tv": 0.01999782644772688, + "aggregate_load_tv": 0.03392330383480826 + }, + "bos_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 60, + "set_exact_tokens": 75, + "mean_set_jaccard": 0.8986514959966289, + "mean_token_weighted_tv": 0.02339831042408416, + "aggregate_load_tv": 0.03687315634218289 + }, + "x_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 66, + "set_exact_tokens": 83, + "mean_set_jaccard": 0.9222503160556259, + "mean_token_weighted_tv": 0.019590700416108674, + "aggregate_load_tv": 0.030973451327433628 + }, + "x_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 51, + "set_exact_tokens": 65, + "mean_set_jaccard": 0.8721871049304677, + "mean_token_weighted_tv": 0.028939135380880495, + "aggregate_load_tv": 0.04277286135693215 + }, + "period_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 70, + "set_exact_tokens": 85, + "mean_set_jaccard": 0.927307206068268, + "mean_token_weighted_tv": 0.018719892355456815, + "aggregate_load_tv": 0.029498525073746312 + }, + "period_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 53, + "set_exact_tokens": 68, + "mean_set_jaccard": 0.8828487147071219, + "mean_token_weighted_tv": 0.027716150630957784, + "aggregate_load_tv": 0.04129793510324484 + } + } + }, + "layer_08": { + "layer": 8, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "8682bc4c8be100d8c9d07d81f87ceaf86417cf7168cef44bfd13f6e149dceebd", + "route_weight_sha256": "b3ff7dac1e5d3ce154b7c879d9e072ec3e76b1d2ff79577064f508f3515681c4", + "loads": [ + 7, + 0, + 3, + 15, + 23, + 4, + 14, + 12, + 2, + 15, + 16, + 15, + 1, + 8, + 6, + 42, + 3, + 12, + 10, + 15, + 17, + 14, + 0, + 6, + 3, + 8, + 0, + 0, + 8, + 21, + 27, + 15, + 12, + 8, + 12, + 8, + 5, + 13, + 4, + 31, + 22, + 21, + 7, + 16, + 10, + 15, + 6, + 11, + 5, + 1, + 3, + 6, + 10, + 6, + 13, + 8, + 6, + 13, + 9, + 21, + 8, + 15, + 8, + 3 + ], + "weighted_loads": [ + 0.4863005094230175, + 0.0, + 0.10210791788995266, + 1.187927383929491, + 1.6196674797683954, + 0.19405537471175194, + 0.9921583719551563, + 0.6256895251572132, + 0.09759335219860077, + 1.0737364068627357, + 1.19861426576972, + 1.0121262650936842, + 0.08367142826318741, + 0.48601341620087624, + 0.27114856988191605, + 3.033617600798607, + 0.11215728335082531, + 0.6896109730005264, + 0.42829716205596924, + 0.8301431089639664, + 1.487342443317175, + 0.8446661531925201, + 0.0, + 0.2630412019789219, + 0.1792222000658512, + 0.5445207878947258, + 0.0, + 0.0, + 0.4766284339129925, + 1.453214704990387, + 1.9620783887803555, + 1.2711460702121258, + 1.2761738076806068, + 0.3921111263334751, + 0.7810390200465918, + 0.3445527143776417, + 0.23712321557104588, + 0.552119268104434, + 0.19469923339784145, + 2.807823272421956, + 2.2413169369101524, + 1.0576818995177746, + 0.38801918737590313, + 0.6631424091756344, + 0.4239979740232229, + 1.128167163580656, + 0.3404344655573368, + 0.8424321748316288, + 0.3954007774591446, + 0.053510796278715134, + 0.09559409879148006, + 0.3819539397954941, + 0.5141952820122242, + 0.42653801292181015, + 1.165522351861, + 0.5042714755982161, + 0.21986592188477516, + 0.8696366008371115, + 0.4561733454465866, + 1.820412889122963, + 0.4098195806145668, + 0.6563861966133118, + 0.46457473933696747, + 0.1382068246603012 + ], + "unique_experts": 60, + "load_cv": 0.7387069157284544, + "normalized_load_entropy": 0.9348754161937023, + "max_load_share": 0.061946902654867256 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "6383ec901a2edfd9491b401d76f0eb4a46dfc63944ec80212afa62c36b41140a", + "route_weight_sha256": "7757252d82bffeba14bd72eb9579daa9478d1e68742ce6cf14201e166afdaa07", + "loads": [ + 7, + 6, + 5, + 16, + 25, + 4, + 19, + 13, + 10, + 15, + 18, + 18, + 8, + 15, + 6, + 42, + 3, + 15, + 11, + 15, + 18, + 14, + 2, + 6, + 3, + 19, + 0, + 0, + 8, + 21, + 30, + 16, + 16, + 20, + 12, + 8, + 5, + 13, + 4, + 38, + 29, + 21, + 7, + 16, + 10, + 21, + 13, + 15, + 5, + 4, + 6, + 6, + 22, + 6, + 17, + 15, + 6, + 13, + 13, + 21, + 8, + 15, + 9, + 6 + ], + "weighted_loads": [ + 0.4863005094230175, + 0.36991639994084835, + 0.1410921085625887, + 1.2534795887768269, + 1.68329449580051, + 0.19405537471175194, + 1.4613376297056675, + 0.670819852501154, + 0.6827173717319965, + 1.0737364068627357, + 1.3236435502767563, + 1.1145607829093933, + 0.46313852816820145, + 0.9588487967848778, + 0.27114856988191605, + 3.033617600798607, + 0.11215728335082531, + 0.8577098697423935, + 0.4627268724143505, + 0.8301431089639664, + 1.5501733906567097, + 0.8446661531925201, + 0.0734008401632309, + 0.2630412019789219, + 0.1792222000658512, + 1.3140952996909618, + 0.0, + 0.0, + 0.4766284339129925, + 1.453214704990387, + 2.0227112164720893, + 1.4101794324815273, + 1.4478779956698418, + 1.350179424509406, + 0.7810390200465918, + 0.3445527143776417, + 0.23712321557104588, + 0.552119268104434, + 0.19469923339784145, + 3.0161511502228677, + 2.6292183473706245, + 1.0576818995177746, + 0.38801918737590313, + 0.6631424091756344, + 0.4239979740232229, + 1.610469039529562, + 1.086998913437128, + 0.9655435653403401, + 0.3954007774591446, + 0.19962386414408684, + 0.265663193538785, + 0.3819539397954941, + 1.2037605345249176, + 0.42653801292181015, + 2.7450628019869328, + 0.9667108096182346, + 0.21986592188477516, + 0.8696366008371115, + 0.5726308724842966, + 1.820412889122963, + 0.4098195806145668, + 0.6563861966133118, + 0.5107761137187481, + 0.34443502128124237 + ], + "unique_experts": 62, + "load_cv": 0.6456644182670487, + "normalized_load_entropy": 0.9502260776845914, + "max_load_share": 0.050724637681159424 + } + }, + "s1_eos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "ffe596bdd733182a5a9b0eabe30b3128040d7e2ea5debd473977f3f98ee70715", + "route_weight_sha256": "16717bdd40c65e4108ca64b606f949065d3a94ec47ab6e3872d709abf703e79a", + "loads": [ + 8, + 0, + 3, + 15, + 22, + 4, + 14, + 12, + 2, + 15, + 15, + 17, + 1, + 8, + 6, + 40, + 4, + 12, + 9, + 14, + 17, + 14, + 0, + 6, + 3, + 9, + 0, + 0, + 8, + 21, + 26, + 15, + 12, + 8, + 12, + 7, + 5, + 15, + 4, + 31, + 22, + 21, + 7, + 17, + 11, + 15, + 5, + 12, + 5, + 1, + 3, + 5, + 9, + 7, + 13, + 8, + 6, + 13, + 8, + 21, + 8, + 16, + 8, + 3 + ], + "weighted_loads": [ + 0.5138419438153505, + 0.0, + 0.10224665515124798, + 1.183340061455965, + 1.5621241182088852, + 0.19814854115247726, + 0.9711174108088017, + 0.6316834054887295, + 0.10107388347387314, + 1.0712325349450111, + 1.1512309946119785, + 1.0822483468800783, + 0.08448847383260727, + 0.4814327023923397, + 0.27432993799448013, + 2.9371370300650597, + 0.14813009835779667, + 0.6413164809346199, + 0.37487529404461384, + 0.795176412910223, + 1.4923511110246181, + 0.8440710939466953, + 0.0, + 0.2607504427433014, + 0.17292747646570206, + 0.5859408266842365, + 0.0, + 0.0, + 0.4696418344974518, + 1.449520718306303, + 1.9146867096424103, + 1.274258591234684, + 1.2673061713576317, + 0.3888235129415989, + 0.7822106909006834, + 0.3197608757764101, + 0.23851412534713745, + 0.6331490855664015, + 0.18600880540907383, + 2.7691425308585167, + 2.2482678666710854, + 1.0406224094331264, + 0.3891558237373829, + 0.7173690535128117, + 0.45780493319034576, + 1.0696085020899773, + 0.2949296608567238, + 0.8882189318537712, + 0.3952544629573822, + 0.05221438407897949, + 0.094027791172266, + 0.3437003009021282, + 0.4835144877433777, + 0.47353821992874146, + 1.146439790725708, + 0.49516360834240913, + 0.22196675837039948, + 0.8588798567652702, + 0.42641399428248405, + 1.8115136250853539, + 0.41050664335489273, + 0.689010152593255, + 0.462118960916996, + 0.14136509969830513 + ], + "unique_experts": 60, + "load_cv": 0.7259694298116959, + "normalized_load_entropy": 0.9358908112059359, + "max_load_share": 0.058997050147492625 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "36a3a2c5a8446a46a5b1d5f91570f321e2dea93385ccc02f8b2ed167e4da9f7d", + "route_weight_sha256": "489c164d97673d489d23c654163371605c2f7ff86453076391ec58e5a34cf77d", + "loads": [ + 9, + 5, + 13, + 17, + 23, + 5, + 25, + 12, + 15, + 15, + 19, + 21, + 10, + 15, + 6, + 40, + 4, + 26, + 11, + 14, + 18, + 14, + 1, + 10, + 3, + 20, + 0, + 2, + 9, + 21, + 28, + 16, + 16, + 27, + 12, + 7, + 5, + 15, + 11, + 37, + 35, + 21, + 9, + 17, + 11, + 27, + 20, + 16, + 8, + 6, + 7, + 5, + 19, + 13, + 17, + 17, + 6, + 13, + 11, + 23, + 8, + 20, + 10, + 8 + ], + "weighted_loads": [ + 0.5530566778033972, + 0.28076453506946564, + 0.7243006806820631, + 1.30506107583642, + 1.6031821705400944, + 0.24230623990297318, + 1.936606515198946, + 0.6316834054887295, + 0.970268614590168, + 1.0712325349450111, + 1.3670977465808392, + 1.2009150262456387, + 0.6168560013175011, + 0.9307111650705338, + 0.27432993799448013, + 2.9371370300650597, + 0.14813009835779667, + 1.6409377567470074, + 0.4702386911958456, + 0.795176412910223, + 1.5570348836481571, + 0.8440710939466953, + 0.039504680782556534, + 0.4490201584994793, + 0.17292747646570206, + 1.6954353973269463, + 0.0, + 0.11953316256403923, + 0.5117103196680546, + 1.449520718306303, + 1.9374784817919135, + 1.4023413732647896, + 1.4121616296470165, + 1.6570885237306356, + 0.7822106909006834, + 0.3197608757764101, + 0.23851412534713745, + 0.6331490855664015, + 0.6216683853417635, + 2.932557923719287, + 2.854237448424101, + 1.0406224094331264, + 0.5576583929359913, + 0.7173690535128117, + 0.45780493319034576, + 2.1200736314058304, + 1.3856060579419136, + 1.0056803319603205, + 0.7124243155121803, + 0.36285538971424103, + 0.3149389438331127, + 0.3437003009021282, + 1.0386938340961933, + 1.1459486931562424, + 2.7317858021706343, + 1.1551702357828617, + 0.22196675837039948, + 0.8588798567652702, + 0.5294236999470741, + 1.884594488888979, + 0.41050664335489273, + 0.8772835228592157, + 0.5626129917800426, + 0.4399961531162262 + ], + "unique_experts": 63, + "load_cv": 0.58656011850807, + "normalized_load_entropy": 0.9577528017579576, + "max_load_share": 0.04329004329004329 + } + }, + "s0_bos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "b02cb11e94c1fa3b09d8a22625eb66e79c975c54bc280f29d54fc57734af1119", + "route_weight_sha256": "5872e140d962bed1701cd35c8f85aa4f82de3a760767f5198903c28cc07edaef", + "loads": [ + 7, + 0, + 3, + 15, + 24, + 4, + 14, + 12, + 1, + 14, + 15, + 15, + 1, + 7, + 5, + 41, + 3, + 12, + 10, + 13, + 17, + 15, + 0, + 7, + 3, + 10, + 0, + 0, + 8, + 21, + 27, + 15, + 12, + 7, + 12, + 9, + 5, + 15, + 4, + 30, + 22, + 21, + 7, + 18, + 10, + 15, + 8, + 10, + 6, + 1, + 2, + 7, + 10, + 6, + 12, + 8, + 6, + 12, + 8, + 22, + 8, + 16, + 8, + 2 + ], + "weighted_loads": [ + 0.4814317524433136, + 0.0, + 0.10560544766485691, + 1.1857411190867424, + 1.6119701713323593, + 0.19710035249590874, + 1.0313972048461437, + 0.6423572935163975, + 0.03912126645445824, + 1.0448158793151379, + 1.1562987342476845, + 1.0178844518959522, + 0.0836123526096344, + 0.45338378101587296, + 0.23790903761982918, + 2.988150965422392, + 0.1274254471063614, + 0.6664185095578432, + 0.41574275121092796, + 0.7330062836408615, + 1.4660033509135246, + 0.8979056105017662, + 0.0, + 0.3154584988951683, + 0.18198485672473907, + 0.6423737518489361, + 0.0, + 0.0, + 0.4821358323097229, + 1.4911190010607243, + 1.9529376924037933, + 1.289539996534586, + 1.308090627193451, + 0.3720797151327133, + 0.7973226495087147, + 0.38343068957328796, + 0.21965735778212547, + 0.6416038107126951, + 0.18530592136085033, + 2.782063828781247, + 2.2195134311914444, + 1.0554480738937855, + 0.3968250248581171, + 0.7529949974268675, + 0.429844006896019, + 1.0682000778615475, + 0.4474055599421263, + 0.824598602950573, + 0.4286949411034584, + 0.051521286368370056, + 0.06329973414540291, + 0.40843939781188965, + 0.5257677547633648, + 0.4389331191778183, + 1.1443712785840034, + 0.5108595322817564, + 0.20412016287446022, + 0.8611776363104582, + 0.4166507013142109, + 1.8397299405187368, + 0.41261737048625946, + 0.664947371929884, + 0.468765314668417, + 0.10186972841620445 + ], + "unique_experts": 60, + "load_cv": 0.7377639504439095, + "normalized_load_entropy": 0.9337660487642032, + "max_load_share": 0.06047197640117994 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "b8b3381a4025cc21a5732a623aa095550baf15d8b12a29ffa62042ec8af432cc", + "route_weight_sha256": "3014f8219b389ff253785f49c8d44ff83485998802fb8a977044665616bb6b30", + "loads": [ + 7, + 6, + 5, + 16, + 25, + 4, + 19, + 13, + 9, + 14, + 16, + 18, + 8, + 14, + 5, + 42, + 3, + 16, + 11, + 13, + 18, + 15, + 2, + 7, + 4, + 21, + 0, + 0, + 8, + 21, + 30, + 16, + 16, + 21, + 12, + 9, + 5, + 15, + 4, + 36, + 28, + 21, + 7, + 18, + 10, + 22, + 15, + 13, + 6, + 4, + 5, + 7, + 22, + 6, + 16, + 15, + 6, + 12, + 11, + 22, + 8, + 16, + 9, + 5 + ], + "weighted_loads": [ + 0.4814317524433136, + 0.36991639994084835, + 0.14458963833749294, + 1.2480055056512356, + 1.6727659553289413, + 0.19710035249590874, + 1.5211376212537289, + 0.6874876208603382, + 0.6433715038001537, + 1.0448158793151379, + 1.2260397896170616, + 1.1214040163904428, + 0.46307945251464844, + 0.9275977909564972, + 0.23790903761982918, + 3.033568948507309, + 0.1274254471063614, + 0.8889959622174501, + 0.45127303525805473, + 0.7330062836408615, + 1.528795599937439, + 0.8979056105017662, + 0.0734008401632309, + 0.3154584988951683, + 0.2268514260649681, + 1.4119482636451721, + 0.0, + 0.0, + 0.4821358323097229, + 1.4911190010607243, + 2.062741132453084, + 1.429536823183298, + 1.4797948151826859, + 1.4901341702789068, + 0.7973226495087147, + 0.38343068957328796, + 0.21965735778212547, + 0.6416038107126951, + 0.18530592136085033, + 3.0018035247921944, + 2.592655036598444, + 1.0554480738937855, + 0.3968250248581171, + 0.7529949974268675, + 0.429844006896019, + 1.6008253023028374, + 1.1331116650253534, + 0.938265566714108, + 0.4286949411034584, + 0.1975853219628334, + 0.23336882889270782, + 0.40843939781188965, + 1.2210449017584324, + 0.4389331191778183, + 1.8529853969812393, + 0.9968943186104298, + 0.20412016287446022, + 0.8611776363104582, + 0.5300524905323982, + 1.8397299405187368, + 0.41261737048625946, + 0.664947371929884, + 0.5149666890501976, + 0.3080979250371456 + ], + "unique_experts": 62, + "load_cv": 0.6411667292318393, + "normalized_load_entropy": 0.9506443807382737, + "max_load_share": 0.050724637681159424 + } + }, + "s1_bos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "c5012be3e9f9756dd2a193dfc3bd80fa140a9b829300fa84e5224ae488d53966", + "route_weight_sha256": "857588c4185b90e6041a68175064bdb96e093a82997e5650885c66021fc76d57", + "loads": [ + 8, + 0, + 3, + 15, + 23, + 4, + 14, + 11, + 2, + 13, + 15, + 15, + 2, + 7, + 6, + 42, + 3, + 10, + 8, + 15, + 17, + 15, + 0, + 7, + 3, + 11, + 0, + 0, + 8, + 21, + 27, + 16, + 12, + 8, + 12, + 9, + 7, + 13, + 4, + 30, + 23, + 23, + 7, + 18, + 10, + 13, + 6, + 10, + 6, + 1, + 1, + 6, + 10, + 6, + 12, + 8, + 6, + 13, + 7, + 22, + 8, + 17, + 8, + 1 + ], + "weighted_loads": [ + 0.5057813730090857, + 0.0, + 0.10734625719487667, + 1.1984300166368484, + 1.5144634190946817, + 0.19629968330264091, + 1.0175257846713066, + 0.6064326446503401, + 0.09941359609365463, + 0.9814801923930645, + 1.1551968194544315, + 0.9990055412054062, + 0.11639952845871449, + 0.44520482048392296, + 0.2806374467909336, + 3.038444347679615, + 0.1267915889620781, + 0.584055058658123, + 0.34219950810074806, + 0.8195374347269535, + 1.4646294340491295, + 0.9019836485385895, + 0.0, + 0.31668735295534134, + 0.17470843344926834, + 0.6838490404188633, + 0.0, + 0.0, + 0.4755407087504864, + 1.4765943586826324, + 1.943597950041294, + 1.306909192353487, + 1.2840163558721542, + 0.4122207947075367, + 0.784348089247942, + 0.39550573378801346, + 0.2921988647431135, + 0.5677599683403969, + 0.17631058767437935, + 2.7446404676884413, + 2.296033451333642, + 1.1098339408636093, + 0.39451603405177593, + 0.7663717232644558, + 0.4443403631448746, + 0.9950593672692776, + 0.34213571809232235, + 0.8414218723773956, + 0.43673809990286827, + 0.05314088240265846, + 0.02863653004169464, + 0.36736237443983555, + 0.507399283349514, + 0.43940266221761703, + 1.127423882484436, + 0.4992491640150547, + 0.20230194739997387, + 0.8727001026272774, + 0.3698292262852192, + 1.8319546934217215, + 0.4154729060828686, + 0.6882401760667562, + 0.45717403292655945, + 0.03829321637749672 + ], + "unique_experts": 60, + "load_cv": 0.7473263720979709, + "normalized_load_entropy": 0.9329448423221669, + "max_load_share": 0.061946902654867256 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "812add15028e739646c7bb8feff3d3b26dfa27008b69ff58e7f3fff019133bec", + "route_weight_sha256": "9262c139d16cda78b91144ba5c0f6ffd6921734321cd5f23b1cc9ffc3bd423db", + "loads": [ + 9, + 5, + 13, + 17, + 25, + 5, + 25, + 11, + 15, + 13, + 18, + 18, + 11, + 14, + 6, + 43, + 3, + 25, + 10, + 15, + 18, + 15, + 1, + 11, + 4, + 22, + 0, + 2, + 9, + 21, + 30, + 17, + 16, + 30, + 12, + 9, + 7, + 13, + 10, + 35, + 35, + 23, + 9, + 18, + 10, + 26, + 21, + 13, + 9, + 6, + 5, + 6, + 20, + 12, + 15, + 17, + 6, + 13, + 9, + 23, + 8, + 21, + 10, + 6 + ], + "weighted_loads": [ + 0.5449961069971323, + 0.28076453506946564, + 0.7294002827256918, + 1.3185150176286697, + 1.6016055401414633, + 0.24045738205313683, + 1.9950526356697083, + 0.6064326446503401, + 0.9986587129533291, + 0.9814801923930645, + 1.3124508745968342, + 1.1144995670765638, + 0.6487670559436083, + 0.8975194692611694, + 0.2806374467909336, + 3.0793315656483173, + 0.1267915889620781, + 1.6421303674578667, + 0.4419943019747734, + 0.8195374347269535, + 1.532922551035881, + 0.9019836485385895, + 0.039504680782556534, + 0.5049570687115192, + 0.214723888784647, + 1.793343611061573, + 0.0, + 0.11953316256403923, + 0.5176091939210892, + 1.4765943586826324, + 2.0511144790798426, + 1.4249586798250675, + 1.428871814161539, + 1.902002016082406, + 0.784348089247942, + 0.39550573378801346, + 0.2921988647431135, + 0.5677599683403969, + 0.5716686993837357, + 2.916030164808035, + 2.899977931752801, + 1.1098339408636093, + 0.5630186032503843, + 0.7663717232644558, + 0.4443403631448746, + 2.1124202460050583, + 1.3952693548053503, + 0.9498223485425115, + 0.7539079524576664, + 0.3645022623240948, + 0.24954768270254135, + 0.36736237443983555, + 1.0644259825348854, + 1.111813135445118, + 1.7991945799440145, + 1.1824939958751202, + 0.20230194739997387, + 0.8727001026272774, + 0.4699179008603096, + 1.8653652612119913, + 0.4154729060828686, + 0.8765135463327169, + 0.5576680637896061, + 0.3369242697954178 + ], + "unique_experts": 63, + "load_cv": 0.6041869615627301, + "normalized_load_entropy": 0.9560604534321847, + "max_load_share": 0.046536796536796536 + } + }, + "s0_x": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "52d187becb13dd60cd47af7cd95ed6f239f8bff70986dd366b6693393daaa240", + "route_weight_sha256": "5572d48f7bca6a2f38e47f786ff7a81bf9a7f9c781f53f182739a8b6f5a65bbc", + "loads": [ + 8, + 0, + 3, + 15, + 22, + 4, + 14, + 10, + 2, + 15, + 15, + 15, + 1, + 7, + 5, + 40, + 3, + 10, + 9, + 13, + 17, + 15, + 0, + 7, + 3, + 9, + 0, + 0, + 8, + 20, + 26, + 15, + 12, + 7, + 12, + 8, + 6, + 17, + 5, + 30, + 22, + 21, + 7, + 18, + 9, + 16, + 7, + 10, + 5, + 1, + 1, + 7, + 11, + 6, + 14, + 8, + 7, + 13, + 9, + 23, + 8, + 17, + 8, + 2 + ], + "weighted_loads": [ + 0.5152359120547771, + 0.0, + 0.10448875650763512, + 1.1883134506642818, + 1.5599743537604809, + 0.19694945961236954, + 0.9875225126743317, + 0.5596761554479599, + 0.10320746898651123, + 1.0886605866253376, + 1.1463571675121784, + 1.0077811852097511, + 0.08035346865653992, + 0.4404907375574112, + 0.23371151089668274, + 2.944959692656994, + 0.11204952374100685, + 0.5772828478366137, + 0.3971513696014881, + 0.7239569798111916, + 1.4527764469385147, + 0.8998147062957287, + 0.0, + 0.2936658523976803, + 0.18621864169836044, + 0.5995239224284887, + 0.0, + 0.0, + 0.47049228101968765, + 1.4256347976624966, + 1.8969201371073723, + 1.2881252504885197, + 1.2808186747133732, + 0.38190294802188873, + 0.7897071670740843, + 0.350052896887064, + 0.2723441254347563, + 0.7408640254288912, + 0.22828124649822712, + 2.815890334546566, + 2.2388201728463173, + 1.0475482791662216, + 0.3886789456009865, + 0.7641418147832155, + 0.4009641706943512, + 1.1558430790901184, + 0.4104286376386881, + 0.8313777409493923, + 0.3892502412199974, + 0.052733976393938065, + 0.029371410608291626, + 0.41693538054823875, + 0.5354161784052849, + 0.42616239562630653, + 1.2340512070804834, + 0.5124741829931736, + 0.23912101052701473, + 0.8708706349134445, + 0.45917798578739166, + 1.8726689778268337, + 0.40487683936953545, + 0.7238516695797443, + 0.46956151723861694, + 0.10036332160234451 + ], + "unique_experts": 60, + "load_cv": 0.72922239381455, + "normalized_load_entropy": 0.9346013271439658, + "max_load_share": 0.058997050147492625 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "4b38276f1afe8b6270c5510c621073fdc6182c24c8f32cdc8dc1711c9ff19b85", + "route_weight_sha256": "c7ab8562dd9572bf2af251e8ff0f5243a600c73c11b9de871d1d7275e1e656a1", + "loads": [ + 8, + 7, + 6, + 17, + 23, + 4, + 20, + 11, + 12, + 15, + 16, + 18, + 8, + 15, + 5, + 40, + 3, + 13, + 10, + 13, + 17, + 15, + 2, + 7, + 3, + 21, + 0, + 0, + 8, + 20, + 27, + 16, + 17, + 19, + 12, + 8, + 6, + 17, + 6, + 35, + 28, + 21, + 7, + 18, + 9, + 23, + 14, + 13, + 5, + 5, + 5, + 7, + 22, + 6, + 16, + 15, + 7, + 13, + 12, + 23, + 8, + 17, + 9, + 5 + ], + "weighted_loads": [ + 0.5152359120547771, + 0.4226067941635847, + 0.18557675555348396, + 1.3024635836482048, + 1.620770137757063, + 0.19694945961236954, + 1.5024360306560993, + 0.6048064827919006, + 0.8278368338942528, + 1.0886605866253376, + 1.2135962508618832, + 1.1127200853079557, + 0.45982056856155396, + 1.0017395466566086, + 0.23371151089668274, + 2.944959692656994, + 0.11204952374100685, + 0.7513782475143671, + 0.4327034205198288, + 0.7239569798111916, + 1.4527764469385147, + 0.8998147062957287, + 0.0734008401632309, + 0.2936658523976803, + 0.18621864169836044, + 1.4682873133569956, + 0.0, + 0.0, + 0.47049228101968765, + 1.4256347976624966, + 1.9130875039845705, + 1.4149524457752705, + 1.49589654058218, + 1.2774137426167727, + 0.7897071670740843, + 0.350052896887064, + 0.2723441254347563, + 0.7408640254288912, + 0.2660846132785082, + 2.9808445293456316, + 2.5834984593093395, + 1.0475482791662216, + 0.3886789456009865, + 0.7641418147832155, + 0.4009641706943512, + 1.6735406443476677, + 1.1098977979272604, + 0.9450447047129273, + 0.3892502412199974, + 0.249109897762537, + 0.2532318979501724, + 0.41693538054823875, + 1.1904647164046764, + 0.42616239562630653, + 1.859645077958703, + 0.9925181698054075, + 0.23912101052701473, + 0.8708706349134445, + 0.572579775005579, + 1.8726689778268337, + 0.40487683936953545, + 0.7238516695797443, + 0.5157628916203976, + 0.3065915182232857 + ], + "unique_experts": 62, + "load_cv": 0.6156151448602044, + "normalized_load_entropy": 0.9536198031684306, + "max_load_share": 0.04830917874396135 + } + }, + "s1_x": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "d5cf3dc49ff2659d2731bcd0922b400e37ec7796ec23ea6636d6c39f852bfae2", + "route_weight_sha256": "7b7eb8300bee787933af9997166b3c8faefabc1cb0bb0ba8f294069d3276672a", + "loads": [ + 9, + 0, + 3, + 15, + 22, + 4, + 14, + 11, + 2, + 14, + 15, + 15, + 2, + 8, + 6, + 42, + 3, + 9, + 8, + 14, + 17, + 16, + 0, + 9, + 3, + 11, + 0, + 0, + 7, + 21, + 27, + 15, + 12, + 6, + 12, + 8, + 5, + 14, + 4, + 30, + 23, + 22, + 7, + 18, + 11, + 14, + 7, + 10, + 6, + 1, + 1, + 5, + 10, + 6, + 12, + 8, + 6, + 14, + 7, + 23, + 8, + 16, + 8, + 2 + ], + "weighted_loads": [ + 0.5408566631376743, + 0.0, + 0.10609967447817326, + 1.1921210922300816, + 1.4530936423689127, + 0.19775725156068802, + 0.998966246843338, + 0.6191567629575729, + 0.10088370740413666, + 1.0049166269600391, + 1.1371793113648891, + 1.0034531373530626, + 0.11608597449958324, + 0.4747159108519554, + 0.2825150489807129, + 2.995354510843754, + 0.12255289405584335, + 0.4988464303314686, + 0.33737316727638245, + 0.7786050364375114, + 1.4483546800911427, + 0.9525852538645267, + 0.0, + 0.3870411515235901, + 0.16889160126447678, + 0.7269835956394672, + 0.0, + 0.0, + 0.41940281353890896, + 1.469971802085638, + 1.9414863474667072, + 1.2596610821783543, + 1.2830958664417267, + 0.28071050345897675, + 0.788315175101161, + 0.3564399518072605, + 0.2327086254954338, + 0.5871480330824852, + 0.1782460492104292, + 2.735503090545535, + 2.333783321082592, + 1.0758715961128473, + 0.3861377239227295, + 0.7591423653066158, + 0.46350525692105293, + 1.0556599386036396, + 0.4351951330900192, + 0.8617442958056927, + 0.4189790189266205, + 0.05395779013633728, + 0.028894294053316116, + 0.3359145186841488, + 0.5104569084942341, + 0.4186795651912689, + 1.1301539093255997, + 0.5105168465524912, + 0.20021123997867107, + 0.8985097613185644, + 0.3671660088002682, + 1.8625179696828127, + 0.41496313735842705, + 0.6687229666858912, + 0.4607737623155117, + 0.08728508278727531 + ], + "unique_experts": 60, + "load_cv": 0.7462077415228177, + "normalized_load_entropy": 0.933240029143851, + "max_load_share": 0.061946902654867256 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "6f095cc02917e1996c519e0115e6edf5123444a69d507d135fece077a74ba0e8", + "route_weight_sha256": "ecc3800aa8f66b118543ef3405e29b76d0b3a5e09b2c86d62507668bb2bee900", + "loads": [ + 10, + 6, + 14, + 17, + 22, + 5, + 26, + 11, + 17, + 14, + 19, + 19, + 11, + 17, + 6, + 42, + 3, + 23, + 10, + 14, + 18, + 16, + 1, + 13, + 3, + 24, + 0, + 2, + 8, + 21, + 29, + 16, + 17, + 25, + 12, + 8, + 5, + 14, + 11, + 34, + 35, + 22, + 9, + 18, + 11, + 26, + 21, + 13, + 9, + 7, + 6, + 5, + 19, + 12, + 14, + 16, + 6, + 14, + 9, + 24, + 8, + 20, + 10, + 7 + ], + "weighted_loads": [ + 0.580071397125721, + 0.32456282153725624, + 0.7650436218827963, + 1.3098020479083061, + 1.4530936423689127, + 0.24191495031118393, + 2.0053777880966663, + 0.6191567629575729, + 1.068318422883749, + 1.0049166269600391, + 1.3518828451633453, + 1.15727973356843, + 0.648453501984477, + 1.0617369525134563, + 0.2825150489807129, + 2.995354510843754, + 0.12255289405584335, + 1.5064518228173256, + 0.4458388313651085, + 0.7786050364375114, + 1.5117137990891933, + 0.9525852538645267, + 0.039504680782556534, + 0.575310867279768, + 0.16889160126447678, + 2.0064756758511066, + 0.0, + 0.11953316256403923, + 0.46147129870951176, + 1.469971802085638, + 1.9994392488151789, + 1.371322300285101, + 1.469550296664238, + 1.4704342242330313, + 0.788315175101161, + 0.3564399518072605, + 0.2327086254954338, + 0.5871480330824852, + 0.6156021784991026, + 2.8604893907904625, + 2.8807263486087322, + 1.0758715961128473, + 0.5546402931213379, + 0.7591423653066158, + 0.46350525692105293, + 2.0855514891445637, + 1.4199988171458244, + 0.9701447719708085, + 0.7361488714814186, + 0.41674575209617615, + 0.32160480692982674, + 0.3359145186841488, + 1.0327963829040527, + 1.0910900384187698, + 1.7553747836500406, + 1.0918562654405832, + 0.20021123997867107, + 0.8985097613185644, + 0.4672546833753586, + 1.8959285374730825, + 0.41496313735842705, + 0.8569963369518518, + 0.5612677931785583, + 0.3859161362051964 + ], + "unique_experts": 63, + "load_cv": 0.5852807448957791, + "normalized_load_entropy": 0.9577889338648837, + "max_load_share": 0.045454545454545456 + } + }, + "s0_period": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "00482ea8807ec8e80ec07d6f306074a5781be3e7eec87dc9a771f9a6bd399882", + "route_weight_sha256": "8b3df02aaa8f12262d2a8daaf5eae7060c3463205309f8b7aed48514bb610e43", + "loads": [ + 9, + 0, + 3, + 15, + 23, + 4, + 14, + 11, + 1, + 15, + 15, + 15, + 1, + 7, + 5, + 41, + 2, + 11, + 10, + 13, + 17, + 15, + 0, + 6, + 3, + 8, + 0, + 0, + 8, + 20, + 26, + 15, + 12, + 8, + 12, + 9, + 7, + 16, + 5, + 30, + 22, + 21, + 7, + 18, + 11, + 15, + 8, + 10, + 5, + 1, + 1, + 7, + 9, + 6, + 14, + 8, + 6, + 12, + 8, + 22, + 8, + 17, + 8, + 2 + ], + "weighted_loads": [ + 0.5640036668628454, + 0.0, + 0.1043520700186491, + 1.1951484642922878, + 1.6046205591410398, + 0.19495154544711113, + 0.9908866081386805, + 0.6113610342144966, + 0.043783511966466904, + 1.0907847620546818, + 1.1461368426680565, + 0.9992912858724594, + 0.08246488869190216, + 0.43580497801303864, + 0.2374090999364853, + 2.9667657800018787, + 0.07979697734117508, + 0.6343901343643665, + 0.42582344077527523, + 0.7339503206312656, + 1.4669329151511192, + 0.91718390583992, + 0.0, + 0.26854662597179413, + 0.18217211216688156, + 0.5694792922586203, + 0.0, + 0.0, + 0.47775560803711414, + 1.433229360729456, + 1.8950587771832943, + 1.3034319542348385, + 1.301208756864071, + 0.4029605854302645, + 0.7893407680094242, + 0.39115341380238533, + 0.30519241094589233, + 0.6983521860092878, + 0.22858816385269165, + 2.7921413220465183, + 2.209990967065096, + 1.03044768050313, + 0.39197457395493984, + 0.7793475147336721, + 0.4715367555618286, + 1.106242822483182, + 0.47103472612798214, + 0.8371070325374603, + 0.39300649985671043, + 0.054850466549396515, + 0.029108813032507896, + 0.41766760125756264, + 0.4755783900618553, + 0.4298669956624508, + 1.229909509420395, + 0.513351334258914, + 0.20694725029170513, + 0.8443750273436308, + 0.42367151379585266, + 1.8339968007057905, + 0.41009534150362015, + 0.7219052966684103, + 0.47190116345882416, + 0.0997607558965683 + ], + "unique_experts": 60, + "load_cv": 0.7351172127064941, + "normalized_load_entropy": 0.9333790664540301, + "max_load_share": 0.06047197640117994 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "7eb30389aea0f3323d0760034d97a7ad9954f579f4ceb0a30faefd3b9ad690d5", + "route_weight_sha256": "7b25e49ba00e11b96496b8c8920255c2f6320c077c605dbfb5c62cc27efec8df", + "loads": [ + 9, + 6, + 5, + 17, + 24, + 4, + 22, + 12, + 10, + 15, + 16, + 18, + 8, + 15, + 5, + 41, + 2, + 14, + 11, + 13, + 18, + 15, + 2, + 6, + 3, + 20, + 0, + 0, + 8, + 20, + 27, + 16, + 16, + 20, + 12, + 9, + 7, + 16, + 6, + 35, + 27, + 21, + 7, + 18, + 11, + 22, + 16, + 13, + 5, + 6, + 4, + 7, + 20, + 6, + 16, + 15, + 6, + 12, + 11, + 22, + 8, + 17, + 9, + 6 + ], + "weighted_loads": [ + 0.5640036668628454, + 0.36991639994084835, + 0.14333626069128513, + 1.3134484142065048, + 1.6654163431376219, + 0.19495154544711113, + 1.6444542575627565, + 0.6564913615584373, + 0.7563030272722244, + 1.0907847620546818, + 1.2157664895057678, + 1.1043316293507814, + 0.4619319885969162, + 0.9530499130487442, + 0.2374090999364853, + 2.9667657800018787, + 0.07979697734117508, + 0.800586748868227, + 0.46172250621020794, + 0.7339503206312656, + 1.5294543206691742, + 0.91718390583992, + 0.0734008401632309, + 0.26854662597179413, + 0.18217211216688156, + 1.428137855604291, + 0.0, + 0.0, + 0.47775560803711414, + 1.433229360729456, + 1.9112261440604925, + 1.4351131282746792, + 1.4729129448533058, + 1.3083459362387657, + 0.7893407680094242, + 0.39115341380238533, + 0.30519241094589233, + 0.6983521860092878, + 0.266084011644125, + 2.958059201017022, + 2.511033356189728, + 1.03044768050313, + 0.39197457395493984, + 0.7793475147336721, + 0.4715367555618286, + 1.618804769590497, + 1.2199533265084028, + 0.9507739963009953, + 0.39300649985671043, + 0.2837141379714012, + 0.1991779077798128, + 0.41766760125756264, + 1.1306269280612469, + 0.4298669956624508, + 1.8555033802986145, + 0.9750991724431515, + 0.20694725029170513, + 0.8443750273436308, + 0.53707330301404, + 1.8339968007057905, + 0.41009534150362015, + 0.7219052966684103, + 0.5181025378406048, + 0.427209734916687 + ], + "unique_experts": 62, + "load_cv": 0.6181876276362187, + "normalized_load_entropy": 0.9530380186892761, + "max_load_share": 0.049516908212560384 + } + }, + "s1_period": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "8854455c1a633423ac5aa8b7c42d58d36c7a594fd3959f78341502b72e75884b", + "route_weight_sha256": "e822d784bd6c2cf2672a3de139caf9e58aeb33002a5dd197dbd9f08d39c4da8e", + "loads": [ + 10, + 0, + 3, + 15, + 22, + 4, + 14, + 12, + 2, + 13, + 16, + 15, + 2, + 7, + 6, + 42, + 3, + 9, + 7, + 13, + 17, + 16, + 0, + 9, + 3, + 9, + 0, + 0, + 8, + 20, + 26, + 16, + 12, + 5, + 12, + 9, + 7, + 13, + 4, + 30, + 23, + 22, + 7, + 18, + 11, + 13, + 7, + 10, + 6, + 1, + 1, + 6, + 11, + 7, + 11, + 8, + 6, + 14, + 7, + 22, + 8, + 17, + 8, + 3 + ], + "weighted_loads": [ + 0.5811895970255136, + 0.0, + 0.10466567426919937, + 1.1944859698414803, + 1.4506910480558872, + 0.19860191643238068, + 0.9905173666775227, + 0.6669354662299156, + 0.10756297409534454, + 0.9592701084911823, + 1.191233817487955, + 0.9964330494403839, + 0.1169196106493473, + 0.43536921218037605, + 0.2843112573027611, + 3.0000555403530598, + 0.1210595890879631, + 0.49869708716869354, + 0.3110007233917713, + 0.745687447488308, + 1.449966412037611, + 0.9573358371853828, + 0.0, + 0.3855369873344898, + 0.16739239543676376, + 0.6325521618127823, + 0.0, + 0.0, + 0.46235192008316517, + 1.4211611188948154, + 1.8926357366144657, + 1.3271656185388565, + 1.2955931574106216, + 0.23540162667632103, + 0.7929083444178104, + 0.3911914825439453, + 0.3049235586076975, + 0.5637848228216171, + 0.17728446796536446, + 2.7323376554995775, + 2.264900991693139, + 1.07941335439682, + 0.3938964754343033, + 0.7757632024586201, + 0.46638037264347076, + 1.0203862003982067, + 0.4152175821363926, + 0.872124258428812, + 0.4223795160651207, + 0.057273294776678085, + 0.0286405049264431, + 0.3647170979529619, + 0.5396861881017685, + 0.4601925350725651, + 1.0812222994863987, + 0.5169591121375561, + 0.21499351598322392, + 0.8988653644919395, + 0.3720599636435509, + 1.8373245652765036, + 0.4157068468630314, + 0.713583929464221, + 0.4531806707382202, + 0.12214856222271919 + ], + "unique_experts": 60, + "load_cv": 0.7360635687138763, + "normalized_load_entropy": 0.9350332131915258, + "max_load_share": 0.061946902654867256 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "a0a6635849b6fa754d64b8f7c4ab997dffa2a4810ede0bec4c055dc85d782075", + "route_weight_sha256": "db9ab22c3ba33d6c446dfd1c3cb82d12e9b36d866417304deceaeeeb4601f62e", + "loads": [ + 11, + 5, + 13, + 17, + 22, + 5, + 27, + 12, + 17, + 13, + 20, + 18, + 11, + 14, + 6, + 42, + 3, + 24, + 9, + 13, + 18, + 16, + 1, + 13, + 3, + 22, + 0, + 2, + 9, + 20, + 28, + 17, + 16, + 24, + 12, + 9, + 7, + 13, + 11, + 34, + 35, + 22, + 9, + 18, + 11, + 24, + 23, + 13, + 9, + 9, + 5, + 6, + 20, + 13, + 13, + 17, + 6, + 14, + 9, + 23, + 8, + 21, + 10, + 9 + ], + "weighted_loads": [ + 0.6204043310135603, + 0.28076453506946564, + 0.7267196998000145, + 1.3117177821695805, + 1.4506910480558872, + 0.2427596151828766, + 2.093178078532219, + 0.6669354662299156, + 1.091171257197857, + 0.9592701084911823, + 1.4037224762141705, + 1.1119270753115416, + 0.6492871381342411, + 0.8882384337484837, + 0.2843112573027611, + 3.0000555403530598, + 0.1210595890879631, + 1.5600064061582088, + 0.4194357246160507, + 0.745687447488308, + 1.5117910616099834, + 0.9573358371853828, + 0.039504680782556534, + 0.5738067030906677, + 0.16739239543676376, + 1.8724790439009666, + 0.0, + 0.11953316256403923, + 0.504420405253768, + 1.4211611188948154, + 1.9503304492682219, + 1.4442479982972145, + 1.4404486157000065, + 1.4376271534711123, + 0.7929083444178104, + 0.3911914825439453, + 0.3049235586076975, + 0.5637848228216171, + 0.6156210042536259, + 2.85887797921896, + 2.8243277315050364, + 1.07941335439682, + 0.5623990446329117, + 0.7757632024586201, + 0.46638037264347076, + 2.020017482340336, + 1.5452176630496979, + 0.9805247345939279, + 0.7395493686199188, + 0.5166861824691296, + 0.2495516575872898, + 0.3647170979529619, + 1.0620256625115871, + 1.132603008300066, + 1.7064431738108397, + 1.1366584859788418, + 0.21499351598322392, + 0.8988653644919395, + 0.4721486382186413, + 1.8707351330667734, + 0.4157068468630314, + 0.9018572997301817, + 0.5536747016012669, + 0.5014912262558937 + ], + "unique_experts": 63, + "load_cv": 0.5755948082266162, + "normalized_load_entropy": 0.9592661763231656, + "max_load_share": 0.045454545454545456 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 113, + "ordered_topk_exact_tokens": 90, + "set_exact_tokens": 99, + "mean_set_jaccard": 0.9646017699115044, + "mean_token_weighted_tv": 0.009205944704270996, + "aggregate_load_tv": 0.017699115044247787 + }, + "system_bos": { + "tokens": 113, + "ordered_topk_exact_tokens": 74, + "set_exact_tokens": 87, + "mean_set_jaccard": 0.934260429835651, + "mean_token_weighted_tv": 0.015227202202432451, + "aggregate_load_tv": 0.025073746312684365 + }, + "system_x": { + "tokens": 113, + "ordered_topk_exact_tokens": 65, + "set_exact_tokens": 84, + "mean_set_jaccard": 0.924778761061947, + "mean_token_weighted_tv": 0.01956155998385058, + "aggregate_load_tv": 0.030973451327433628 + }, + "system_period": { + "tokens": 113, + "ordered_topk_exact_tokens": 58, + "set_exact_tokens": 76, + "mean_set_jaccard": 0.9045512010113781, + "mean_token_weighted_tv": 0.022235007808271763, + "aggregate_load_tv": 0.03392330383480826 + }, + "bos_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 79, + "set_exact_tokens": 90, + "mean_set_jaccard": 0.9418457648546145, + "mean_token_weighted_tv": 0.015420447482801644, + "aggregate_load_tv": 0.02359882005899705 + }, + "bos_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 63, + "set_exact_tokens": 79, + "mean_set_jaccard": 0.9102402022756005, + "mean_token_weighted_tv": 0.019929339614721524, + "aggregate_load_tv": 0.03687315634218289 + }, + "x_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 70, + "set_exact_tokens": 86, + "mean_set_jaccard": 0.9279393173198484, + "mean_token_weighted_tv": 0.017389184869496168, + "aggregate_load_tv": 0.032448377581120944 + }, + "x_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 60, + "set_exact_tokens": 82, + "mean_set_jaccard": 0.9163506110408767, + "mean_token_weighted_tv": 0.02137427679798772, + "aggregate_load_tv": 0.03392330383480826 + }, + "period_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 73, + "set_exact_tokens": 86, + "mean_set_jaccard": 0.9279393173198484, + "mean_token_weighted_tv": 0.017750870922695748, + "aggregate_load_tv": 0.029498525073746312 + }, + "period_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 50, + "set_exact_tokens": 69, + "mean_set_jaccard": 0.8887484197218712, + "mean_token_weighted_tv": 0.02448400895449176, + "aggregate_load_tv": 0.04129793510324484 + } + } + }, + "layer_09": { + "layer": 9, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "ae2d3ee74f85f970c71ab9466ad86bf32b1ffb4dbaf98a193cd73078ccc3f91d", + "route_weight_sha256": "9b9e27c2021e4752c2704943125305c6d344fd71528727f0452a75217d4388cb", + "loads": [ + 10, + 11, + 8, + 28, + 22, + 9, + 16, + 18, + 1, + 12, + 5, + 5, + 4, + 27, + 2, + 13, + 17, + 28, + 14, + 6, + 15, + 7, + 10, + 9, + 6, + 12, + 3, + 2, + 3, + 12, + 11, + 2, + 0, + 2, + 4, + 11, + 18, + 2, + 3, + 2, + 12, + 6, + 11, + 20, + 11, + 9, + 10, + 12, + 16, + 7, + 11, + 13, + 15, + 4, + 7, + 19, + 3, + 24, + 16, + 13, + 16, + 5, + 12, + 16 + ], + "weighted_loads": [ + 0.458599966019392, + 0.824776966124773, + 0.4680120050907135, + 1.6634619235992432, + 1.8201797604560852, + 0.5178702846169472, + 0.9530260749161243, + 1.1214269548654556, + 0.09114360809326172, + 0.963594526052475, + 0.22282152250409126, + 0.2479603812098503, + 0.22922391816973686, + 2.3825539145618677, + 0.09381073340773582, + 0.9831677228212357, + 1.6504700295627117, + 1.3841461669653654, + 0.757279297336936, + 0.44039979577064514, + 0.6919101402163506, + 0.41422196477651596, + 0.45754830725491047, + 0.4346744157373905, + 0.2523500323295593, + 0.4768478088080883, + 0.1188352108001709, + 0.11177776753902435, + 0.18118445575237274, + 0.6481343880295753, + 0.6506941169500351, + 0.12640522047877312, + 0.0, + 0.11488255485892296, + 0.18438943848013878, + 0.8116068355739117, + 1.5462963115423918, + 0.08136586844921112, + 0.10518039390444756, + 0.14388536661863327, + 0.673828985542059, + 0.39490818977355957, + 0.5808664113283157, + 1.189456008374691, + 1.2216671276837587, + 0.3909592963755131, + 0.7604684792459011, + 1.0122012346982956, + 1.283323958516121, + 0.424745824187994, + 0.5345280058681965, + 0.9012230485677719, + 0.9998836405575275, + 0.13470392674207687, + 0.5058226101100445, + 1.6473957188427448, + 0.156975656747818, + 1.234812244772911, + 1.307936791330576, + 1.4063937924802303, + 1.0425042435526848, + 0.22938058525323868, + 0.7912022713571787, + 1.0072189830243587 + ], + "unique_experts": 63, + "load_cv": 0.6399412504252155, + "normalized_load_entropy": 0.9484629879102389, + "max_load_share": 0.04129793510324484 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "9502c4713e519a995c5fb97e8150cb7c49a4c472aa2b77f39423dd1b1056ab2f", + "route_weight_sha256": "7f7475d799cbc1a716bec270026525ba097a9a98be3e56f28e3873f52fa882ee", + "loads": [ + 17, + 13, + 8, + 28, + 24, + 9, + 16, + 18, + 3, + 12, + 16, + 5, + 7, + 32, + 2, + 13, + 18, + 30, + 14, + 15, + 15, + 7, + 16, + 12, + 9, + 14, + 3, + 3, + 3, + 12, + 12, + 8, + 1, + 2, + 13, + 18, + 18, + 2, + 6, + 2, + 12, + 16, + 11, + 20, + 15, + 16, + 22, + 13, + 19, + 7, + 15, + 14, + 15, + 7, + 7, + 24, + 8, + 24, + 18, + 17, + 16, + 5, + 14, + 17 + ], + "weighted_loads": [ + 0.9354554302990437, + 1.0015054605901241, + 0.4680120050907135, + 1.6634619235992432, + 2.0699415504932404, + 0.5178702846169472, + 0.9530260749161243, + 1.1214269548654556, + 0.18506445735692978, + 0.963594526052475, + 1.3914694227278233, + 0.2479603812098503, + 0.2836588337086141, + 2.535061941947788, + 0.09381073340773582, + 0.9831677228212357, + 1.6917611099779606, + 1.45833626575768, + 0.757279297336936, + 1.3043069057166576, + 0.6919101402163506, + 0.41422196477651596, + 2.0771001502871513, + 0.6519409008324146, + 0.3833424113690853, + 0.6200529001653194, + 0.1188352108001709, + 0.1247774176299572, + 0.18118445575237274, + 0.6481343880295753, + 0.6903637684881687, + 0.31708876602351665, + 0.003740650601685047, + 0.11488255485892296, + 0.6772228255867958, + 1.3106638751924038, + 1.5462963115423918, + 0.08136586844921112, + 0.24650102108716965, + 0.14388536661863327, + 0.673828985542059, + 1.3424324505031109, + 0.5808664113283157, + 1.189456008374691, + 1.4926902130246162, + 0.9742541611194611, + 1.807266741991043, + 1.08456489443779, + 1.4915088713169098, + 0.424745824187994, + 0.737446241080761, + 0.9350328557193279, + 0.9998836405575275, + 0.2539845183491707, + 0.5058226101100445, + 1.9272484686225653, + 0.3993503078818321, + 1.234812244772911, + 1.456972248852253, + 1.5791940093040466, + 1.0425042435526848, + 0.22938058525323868, + 0.8471089489758015, + 1.0433651693165302 + ], + "unique_experts": 64, + "load_cv": 0.5427638890605451, + "normalized_load_entropy": 0.961432970615452, + "max_load_share": 0.03864734299516908 + } + }, + "s1_eos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "baf4631936a95e821247b11194c2b81ff9b35bae8a4252f00857070fb8fa29fd", + "route_weight_sha256": "721bf8bd405c343b3bfc6b235e94110bd29f12161a2bb968bb080b1dc62abfec", + "loads": [ + 9, + 11, + 8, + 28, + 23, + 9, + 17, + 18, + 1, + 12, + 4, + 5, + 4, + 29, + 2, + 13, + 17, + 26, + 13, + 6, + 15, + 7, + 12, + 10, + 5, + 11, + 2, + 2, + 3, + 12, + 11, + 2, + 1, + 2, + 4, + 10, + 18, + 2, + 2, + 2, + 12, + 6, + 13, + 20, + 10, + 9, + 9, + 12, + 16, + 7, + 11, + 13, + 15, + 5, + 7, + 18, + 3, + 24, + 16, + 13, + 16, + 7, + 12, + 16 + ], + "weighted_loads": [ + 0.41186427511274815, + 0.801963709294796, + 0.4649016372859478, + 1.6634031012654305, + 1.8381430767476559, + 0.5266414768993855, + 0.9819358438253403, + 1.1213671490550041, + 0.09163057804107666, + 0.9544434100389481, + 0.17794357240200043, + 0.24966659396886826, + 0.22380047291517258, + 2.4607050232589245, + 0.09656093642115593, + 0.9568185582756996, + 1.6824498064815998, + 1.3101542871445417, + 0.718896646052599, + 0.43168020993471146, + 0.6890832111239433, + 0.41668838262557983, + 0.5372377522289753, + 0.48195967450737953, + 0.22070852480828762, + 0.44706576131284237, + 0.08598056435585022, + 0.1290588155388832, + 0.17189190536737442, + 0.6416671425104141, + 0.6558253988623619, + 0.12721120938658714, + 0.029023263603448868, + 0.1159806102514267, + 0.1856335997581482, + 0.7623502984642982, + 1.5710350014269352, + 0.07915263622999191, + 0.07736963778734207, + 0.14316222071647644, + 0.670633926987648, + 0.39885980635881424, + 0.6368843447417021, + 1.2024127542972565, + 1.2005526944994926, + 0.4208238795399666, + 0.6877527125179768, + 1.0034716539084911, + 1.2738511003553867, + 0.44381316006183624, + 0.5283735170960426, + 0.8826407082378864, + 0.9913904964923859, + 0.1727311834692955, + 0.4941651448607445, + 1.6077704392373562, + 0.15569880977272987, + 1.2382034100592136, + 1.2824732773005962, + 1.3783045075833797, + 1.0383469946682453, + 0.31093258783221245, + 0.7838405892252922, + 1.0126091912388802 + ], + "unique_experts": 64, + "load_cv": 0.643196382380308, + "normalized_load_entropy": 0.9485031713623056, + "max_load_share": 0.04277286135693215 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "32717cbbff10312387cdc2fef570934820e860c417759f680df0cae8280d5737", + "route_weight_sha256": "63f230dcfc781100a296ae6ac98e0b2541632bd4fc0f957132da064e52b50e44", + "loads": [ + 20, + 15, + 8, + 28, + 25, + 9, + 17, + 18, + 8, + 14, + 15, + 7, + 7, + 33, + 3, + 13, + 18, + 28, + 13, + 15, + 15, + 10, + 17, + 21, + 10, + 20, + 6, + 3, + 9, + 12, + 13, + 7, + 2, + 5, + 10, + 22, + 18, + 5, + 7, + 3, + 18, + 21, + 15, + 20, + 15, + 21, + 30, + 13, + 23, + 12, + 13, + 14, + 15, + 8, + 8, + 23, + 8, + 24, + 21, + 17, + 16, + 8, + 14, + 18 + ], + "weighted_loads": [ + 1.1219653096050024, + 1.0667539052665234, + 0.4649016372859478, + 1.6634031012654305, + 2.1238324157893658, + 0.5266414768993855, + 0.9819358438253403, + 1.1213671490550041, + 0.5109858065843582, + 1.0446118526160717, + 1.2637414559721947, + 0.34518785774707794, + 0.2779584061354399, + 2.554072314640507, + 0.13594774156808853, + 0.9568185582756996, + 1.7288742028176785, + 1.4009142499417067, + 0.718896646052599, + 1.3927823826670647, + 0.6890832111239433, + 0.5439722798764706, + 2.109720077365637, + 1.3012567423284054, + 0.4111304450780153, + 0.9513519909232855, + 0.3391325920820236, + 0.14205846562981606, + 0.5923646688461304, + 0.6416671425104141, + 0.7937217615544796, + 0.27267335425131023, + 0.032645973144099116, + 0.33911238238215446, + 0.4926150254905224, + 1.5850015059113503, + 1.5710350014269352, + 0.2199496142566204, + 0.3413209393620491, + 0.21022822707891464, + 1.0730423219501972, + 1.8349925242364407, + 0.7297226097434759, + 1.2024127542972565, + 1.3848586780950427, + 1.3970554508268833, + 2.553631830960512, + 1.0711149163544178, + 1.7217502258718014, + 0.7714425586163998, + 0.6429865062236786, + 0.9157150574028492, + 0.9913904964923859, + 0.32179420068860054, + 0.5356332659721375, + 1.8786757569760084, + 0.3902898021042347, + 1.2382034100592136, + 1.5873058773577213, + 1.5605840496718884, + 1.0383469946682453, + 0.34928881749510765, + 0.9406528249382973, + 1.0831765346229076 + ], + "unique_experts": 64, + "load_cv": 0.4837456536099118, + "normalized_load_entropy": 0.9705564953325931, + "max_load_share": 0.03571428571428571 + } + }, + "s0_bos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "8e02a7625be8fcf1b22c13e762519f07454a81de20485ab1be1bd8924ffa3543", + "route_weight_sha256": "8b7cf3a80fb30cd18fd216b74be19545fdf9c80ec9cd3054a766984b467c498b", + "loads": [ + 10, + 11, + 8, + 27, + 24, + 9, + 16, + 18, + 1, + 12, + 4, + 4, + 5, + 27, + 3, + 12, + 17, + 27, + 14, + 6, + 16, + 7, + 11, + 9, + 7, + 9, + 2, + 1, + 3, + 12, + 13, + 3, + 2, + 1, + 3, + 11, + 18, + 2, + 2, + 2, + 11, + 7, + 10, + 21, + 13, + 8, + 10, + 13, + 16, + 7, + 11, + 13, + 15, + 2, + 7, + 19, + 3, + 26, + 15, + 13, + 16, + 6, + 11, + 16 + ], + "weighted_loads": [ + 0.4459460247308016, + 0.806099783629179, + 0.4630704093724489, + 1.655295804142952, + 1.9102263636887074, + 0.5107480809092522, + 0.9423794411122799, + 1.1175699084997177, + 0.09402232617139816, + 0.9785377904772758, + 0.18330060690641403, + 0.21215807646512985, + 0.25449782609939575, + 2.377779148519039, + 0.13230635970830917, + 0.8788815774023533, + 1.6614297516644, + 1.3574241138994694, + 0.7735853418707848, + 0.46746427938342094, + 0.7133388519287109, + 0.4192805774509907, + 0.4802439995110035, + 0.45410656183958054, + 0.26750335842370987, + 0.3878719210624695, + 0.08645006269216537, + 0.06223537027835846, + 0.17130275070667267, + 0.618653479963541, + 0.7300965525209904, + 0.15896338783204556, + 0.07184363715350628, + 0.08509936928749084, + 0.16472919285297394, + 0.8044626675546169, + 1.6014981921762228, + 0.08428249880671501, + 0.06920557096600533, + 0.13863014057278633, + 0.6526736915111542, + 0.44449272751808167, + 0.5469229407608509, + 1.225055530667305, + 1.3361248467117548, + 0.4138946384191513, + 0.7849446833133698, + 1.0427029244601727, + 1.289588749408722, + 0.4225662797689438, + 0.5575851909816265, + 0.8939133733510971, + 0.9891489110887051, + 0.07179096341133118, + 0.4895462393760681, + 1.6318567134439945, + 0.15381092578172684, + 1.311243437230587, + 1.2322432436048985, + 1.3792981542646885, + 1.0476474799215794, + 0.2838917709887028, + 0.7690829895436764, + 1.0256111435592175 + ], + "unique_experts": 64, + "load_cv": 0.6507283701362738, + "normalized_load_entropy": 0.9470033827904424, + "max_load_share": 0.03982300884955752 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "205a08b847d6f6cde7e991cd0c867bceae63b6a47d5825dd5f4e97bdeab15a43", + "route_weight_sha256": "c0e9facf963a45c26ca7fc257e905bdb6eab008e6c6f1dfda7d063c1bcb42504", + "loads": [ + 18, + 13, + 8, + 27, + 27, + 9, + 16, + 18, + 3, + 12, + 15, + 4, + 7, + 31, + 3, + 12, + 18, + 31, + 14, + 15, + 16, + 7, + 16, + 12, + 10, + 11, + 2, + 2, + 3, + 12, + 14, + 8, + 2, + 1, + 12, + 18, + 18, + 2, + 4, + 3, + 11, + 17, + 10, + 21, + 16, + 15, + 22, + 14, + 19, + 7, + 17, + 14, + 15, + 5, + 7, + 24, + 8, + 26, + 17, + 17, + 16, + 6, + 13, + 17 + ], + "weighted_loads": [ + 0.9715041387826204, + 0.9740501530468464, + 0.4630704093724489, + 1.655295804142952, + 2.2149966917932034, + 0.5107480809092522, + 0.9423794411122799, + 1.1175699084997177, + 0.18794317543506622, + 0.9785377904772758, + 1.351948507130146, + 0.21215807646512985, + 0.3014967404305935, + 2.5424520894885063, + 0.13230635970830917, + 0.8788815774023533, + 1.702720832079649, + 1.509895447641611, + 0.7735853418707848, + 1.3313713893294334, + 0.7133388519287109, + 0.4192805774509907, + 1.1646482478827238, + 0.7228907607495785, + 0.39849573746323586, + 0.5319627523422241, + 0.08645006269216537, + 0.0752350203692913, + 0.17130275070667267, + 0.618653479963541, + 0.769766204059124, + 0.34690573532134295, + 0.07184363715350628, + 0.08509936928749084, + 0.657562579959631, + 1.286870326846838, + 1.6014981921762228, + 0.08428249880671501, + 0.16567032039165497, + 0.18372667208313942, + 0.6526736915111542, + 1.4328493662178516, + 0.5469229407608509, + 1.225055530667305, + 1.5994775909930468, + 1.151921235024929, + 1.8393112979829311, + 1.119961928576231, + 1.4939667023718357, + 0.4225662797689438, + 0.8372614793479443, + 0.9277231805026531, + 0.9891489110887051, + 0.19376497343182564, + 0.4895462393760681, + 1.914830094203353, + 0.39618557691574097, + 1.311243437230587, + 1.3796256557106972, + 1.5520983710885048, + 1.0476474799215794, + 0.2838917709887028, + 0.8249896671622992, + 1.061757329851389 + ], + "unique_experts": 64, + "load_cv": 0.5591983072714328, + "normalized_load_entropy": 0.9592378051463987, + "max_load_share": 0.03743961352657005 + } + }, + "s1_bos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "54179a93e48aaf52d0d78f286185e66f755625cde354d920959bdadfbc005168", + "route_weight_sha256": "b0bd34cd8c439a24caa3665a3fac81fd47fcd7274fb3fc2bb80c7737ad4ad13d", + "loads": [ + 11, + 12, + 8, + 27, + 23, + 9, + 16, + 18, + 1, + 12, + 4, + 4, + 4, + 26, + 3, + 14, + 17, + 28, + 13, + 6, + 15, + 8, + 11, + 10, + 7, + 10, + 3, + 1, + 3, + 13, + 12, + 3, + 2, + 1, + 3, + 11, + 18, + 2, + 2, + 2, + 11, + 5, + 10, + 20, + 13, + 7, + 9, + 13, + 16, + 7, + 11, + 12, + 15, + 4, + 7, + 18, + 3, + 25, + 16, + 13, + 16, + 7, + 11, + 16 + ], + "weighted_loads": [ + 0.49126265943050385, + 0.8455229811370373, + 0.4582324344664812, + 1.6357812583446503, + 1.8553748242557049, + 0.5208595469594002, + 0.9177728332579136, + 1.124919105321169, + 0.09388162195682526, + 0.9532117992639542, + 0.1769532784819603, + 0.2102452740073204, + 0.21559405326843262, + 2.3317535929381847, + 0.1354951225221157, + 0.9723572954535484, + 1.6713678427040577, + 1.4189183730632067, + 0.7286341339349747, + 0.48652446642518044, + 0.6795591302216053, + 0.44956613704562187, + 0.49377746134996414, + 0.5068463943898678, + 0.27238825149834156, + 0.4175354689359665, + 0.11801521852612495, + 0.06139064580202103, + 0.17251379042863846, + 0.6411284953355789, + 0.6803436279296875, + 0.16358009912073612, + 0.0728638805449009, + 0.0859706699848175, + 0.1656523495912552, + 0.7891955859959126, + 1.6130450386554003, + 0.08293667808175087, + 0.07292409986257553, + 0.12896651402115822, + 0.6391147524118423, + 0.34245777875185013, + 0.5431908126920462, + 1.1704363021999598, + 1.3234059810638428, + 0.3526521064341068, + 0.6922480724751949, + 1.0271252542734146, + 1.2987331859767437, + 0.4351302981376648, + 0.5549772791564465, + 0.8274413868784904, + 0.9971083961427212, + 0.13696689158678055, + 0.46552596613764763, + 1.5937479678541422, + 0.14986368268728256, + 1.2937859259545803, + 1.2803694382309914, + 1.3365040123462677, + 1.0280522145330906, + 0.315384216606617, + 0.7715485952794552, + 1.0334974825382233 + ], + "unique_experts": 64, + "load_cv": 0.6384165089635208, + "normalized_load_entropy": 0.9489147635179267, + "max_load_share": 0.04129793510324484 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "6671c8cdfc58d10248f127ddd410823b9f8b33679ec82dd32435b11b6bbd06f7", + "route_weight_sha256": "3b4cc6b7586652929c9f9e96393601d0076a51bdfa2da44f1c91a09fcefdba24", + "loads": [ + 23, + 16, + 8, + 27, + 26, + 9, + 16, + 18, + 8, + 14, + 15, + 6, + 6, + 31, + 4, + 14, + 18, + 33, + 13, + 15, + 15, + 11, + 15, + 21, + 12, + 19, + 7, + 2, + 9, + 13, + 14, + 7, + 2, + 4, + 9, + 23, + 18, + 5, + 6, + 4, + 17, + 19, + 12, + 20, + 16, + 19, + 30, + 14, + 23, + 12, + 15, + 13, + 15, + 7, + 8, + 23, + 8, + 25, + 21, + 17, + 16, + 8, + 13, + 17 + ], + "weighted_loads": [ + 1.2948631942272186, + 1.100781835615635, + 0.4582324344664812, + 1.6357812583446503, + 2.179892558604479, + 0.5208595469594002, + 0.9177728332579136, + 1.124919105321169, + 0.5132368505001068, + 1.0433802418410778, + 1.2627511620521545, + 0.3057665377855301, + 0.2627962250262499, + 2.512569446116686, + 0.1748819276690483, + 0.9723572954535484, + 1.7177922390401363, + 1.6336024980992079, + 0.7286341339349747, + 1.4476266391575336, + 0.6795591302216053, + 0.5768500342965126, + 1.1350616067647934, + 1.3413963727653027, + 0.46281017176806927, + 0.9192017167806625, + 0.37116724625229836, + 0.07439029589295387, + 0.5929865539073944, + 0.6411284953355789, + 0.8182399906218052, + 0.30621686298400164, + 0.0728638805449009, + 0.3091024421155453, + 0.4726337753236294, + 1.5892517194151878, + 1.6130450386554003, + 0.22373365610837936, + 0.28821590170264244, + 0.24037783592939377, + 1.0415231473743916, + 1.7882640957832336, + 0.63602907769382, + 1.1704363021999598, + 1.4533875994384289, + 1.5370668955147266, + 2.5758812688291073, + 1.1067134588956833, + 1.7406555898487568, + 0.7627596966922283, + 0.7450569178909063, + 0.8605157360434532, + 0.9971083961427212, + 0.2903978191316128, + 0.5069940872490406, + 1.860386174172163, + 0.3844546750187874, + 1.2937859259545803, + 1.5793763473629951, + 1.5187835544347763, + 1.0280522145330906, + 0.3537404462695122, + 0.9283608309924603, + 1.0694957040250301 + ], + "unique_experts": 64, + "load_cv": 0.4932596025551127, + "normalized_load_entropy": 0.9695479440298346, + "max_load_share": 0.03571428571428571 + } + }, + "s0_x": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "1e8005e80494628714ec935839277e584dc9db85aeebb0534128c52145adb70c", + "route_weight_sha256": "8b69c272207621e91c880a6549ed1bc65662ae647609778a3e285a06e98e71a6", + "loads": [ + 10, + 12, + 8, + 27, + 24, + 9, + 14, + 18, + 1, + 12, + 3, + 4, + 5, + 26, + 2, + 12, + 17, + 26, + 14, + 6, + 14, + 7, + 12, + 9, + 6, + 10, + 3, + 3, + 3, + 11, + 13, + 2, + 1, + 2, + 4, + 11, + 17, + 2, + 2, + 2, + 11, + 7, + 12, + 21, + 13, + 6, + 12, + 14, + 16, + 7, + 12, + 13, + 15, + 3, + 7, + 17, + 3, + 26, + 16, + 13, + 17, + 6, + 11, + 16 + ], + "weighted_loads": [ + 0.47654102370142937, + 0.8610666245222092, + 0.4729067664593458, + 1.6528886444866657, + 1.8928333520889282, + 0.5184055268764496, + 0.8496043793857098, + 1.1094020754098892, + 0.0939408466219902, + 0.9801961667835712, + 0.1395791918039322, + 0.2108379490673542, + 0.25652673840522766, + 2.333064954727888, + 0.09044491872191429, + 0.9015141502022743, + 1.6336567662656307, + 1.3368789814412594, + 0.775726243853569, + 0.4590403214097023, + 0.6512614078819752, + 0.4189603142440319, + 0.506818201392889, + 0.4383510425686836, + 0.2512296997010708, + 0.44924940168857574, + 0.11924678832292557, + 0.15212589502334595, + 0.17602065205574036, + 0.5854554250836372, + 0.7270972635596991, + 0.12116800248622894, + 0.028876299038529396, + 0.11943369358778, + 0.18570602126419544, + 0.8145558722317219, + 1.5509110242128372, + 0.08230610564351082, + 0.06994841620326042, + 0.1417924426496029, + 0.6391404680907726, + 0.45514024421572685, + 0.6154309511184692, + 1.2313581220805645, + 1.3745553828775883, + 0.250483063980937, + 0.8784302249550819, + 1.1114698722958565, + 1.2843071073293686, + 0.3978339210152626, + 0.6102226004004478, + 0.8818212077021599, + 1.000941462814808, + 0.10317904688417912, + 0.5117471888661385, + 1.5612274315208197, + 0.15255143120884895, + 1.3061855882406235, + 1.2719139158725739, + 1.3913389556109905, + 1.079280536621809, + 0.2842077314853668, + 0.7622911781072617, + 1.00461221113801 + ], + "unique_experts": 64, + "load_cv": 0.6375435909024695, + "normalized_load_entropy": 0.9489957241561013, + "max_load_share": 0.03982300884955752 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "d5d87eab2e1a87f40216c3c05490481f7f320442eefec8ffe224a69c32f63034", + "route_weight_sha256": "e23e619919e8d21c7df71076466feb1a9880dd69a6e552454cb8249d58806d4f", + "loads": [ + 19, + 14, + 8, + 27, + 26, + 9, + 14, + 18, + 3, + 12, + 15, + 4, + 7, + 30, + 2, + 12, + 19, + 28, + 14, + 15, + 14, + 7, + 17, + 12, + 9, + 13, + 3, + 4, + 3, + 11, + 14, + 7, + 1, + 2, + 14, + 17, + 17, + 2, + 5, + 2, + 11, + 17, + 12, + 21, + 16, + 13, + 24, + 15, + 19, + 7, + 16, + 14, + 15, + 6, + 7, + 22, + 8, + 26, + 18, + 18, + 17, + 6, + 13, + 17 + ], + "weighted_loads": [ + 1.1246052086353302, + 1.0327472016215324, + 0.4729067664593458, + 1.6528886444866657, + 2.143942967057228, + 0.5184055268764496, + 0.8496043793857098, + 1.1094020754098892, + 0.18786169588565826, + 0.9801961667835712, + 1.4591574966907501, + 0.2108379490673542, + 0.3035256527364254, + 2.4719553031027317, + 0.09044491872191429, + 0.9015141502022743, + 1.7111067399382591, + 1.4123039171099663, + 0.775726243853569, + 1.3229474313557148, + 0.6512614078819752, + 0.4189603142440319, + 1.184641843661666, + 0.6667811386287212, + 0.38222207874059677, + 0.6514350213110447, + 0.11924678832292557, + 0.1651255451142788, + 0.17602065205574036, + 0.5854554250836372, + 0.7667669150978327, + 0.30911034997552633, + 0.028876299038529396, + 0.11943369358778, + 0.774009695276618, + 1.2555811554193497, + 1.5509110242128372, + 0.08230610564351082, + 0.2130211666226387, + 0.1417924426496029, + 0.6391404680907726, + 1.3831937722861767, + 0.6154309511184692, + 1.2313581220805645, + 1.6379081271588802, + 0.7725993264466524, + 1.8733144402503967, + 1.1897879391908646, + 1.4897112362086773, + 0.3978339210152626, + 0.8133532367646694, + 0.9156310148537159, + 1.000941462814808, + 0.22214948199689388, + 0.5117471888661385, + 1.8484192192554474, + 0.3949260823428631, + 1.3061855882406235, + 1.4220895282924175, + 1.6047646291553974, + 1.079280536621809, + 0.2842077314853668, + 0.8181978557258844, + 1.0407583974301815 + ], + "unique_experts": 64, + "load_cv": 0.543107764212844, + "normalized_load_entropy": 0.9610967068290223, + "max_load_share": 0.036231884057971016 + } + }, + "s1_x": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "a4a6ec84b0ec027fdf836de70fe51d284e099441ce58873dff0ff2b878ced06d", + "route_weight_sha256": "90594c82f51552bba0a04b55229b075984eddba468b59ef34b51683c8b46adad", + "loads": [ + 12, + 11, + 8, + 26, + 22, + 8, + 16, + 18, + 1, + 12, + 3, + 4, + 4, + 28, + 3, + 14, + 17, + 29, + 13, + 7, + 13, + 7, + 12, + 8, + 6, + 12, + 3, + 1, + 3, + 12, + 12, + 3, + 2, + 2, + 3, + 10, + 18, + 2, + 3, + 2, + 11, + 7, + 12, + 19, + 13, + 10, + 9, + 13, + 16, + 6, + 14, + 13, + 15, + 3, + 7, + 16, + 3, + 24, + 16, + 13, + 16, + 6, + 11, + 15 + ], + "weighted_loads": [ + 0.5659188143908978, + 0.8058200143277645, + 0.45730105973780155, + 1.5577044654637575, + 1.7895498014986515, + 0.4810415804386139, + 0.8851449079811573, + 1.103361316025257, + 0.09205561131238937, + 0.9409482553601265, + 0.13864946737885475, + 0.2044997401535511, + 0.2030923143029213, + 2.4271867759525776, + 0.12857608497142792, + 0.9778533354401588, + 1.6324871703982353, + 1.4648710638284683, + 0.7313898019492626, + 0.523322094231844, + 0.6330858431756496, + 0.4109704792499542, + 0.5121532250195742, + 0.37736877240240574, + 0.22578029707074165, + 0.5209796596318483, + 0.12460330873727798, + 0.057533279061317444, + 0.17264645546674728, + 0.5980334989726543, + 0.6802512407302856, + 0.1559463795274496, + 0.07407976873219013, + 0.11528389900922775, + 0.1590997539460659, + 0.7501781657338142, + 1.6095935255289078, + 0.08310283347964287, + 0.10726230964064598, + 0.129744004458189, + 0.6444635763764381, + 0.4519738033413887, + 0.600802743807435, + 1.1091280803084373, + 1.3533740397542715, + 0.4381547346711159, + 0.7059475444257259, + 1.0504664182662964, + 1.2820196822285652, + 0.36619235947728157, + 0.6864187493920326, + 0.8785101436078548, + 0.991321288049221, + 0.10783601924777031, + 0.47324832156300545, + 1.5059085320681334, + 0.14758720248937607, + 1.2557141240686178, + 1.2600554078817368, + 1.3323988616466522, + 1.008952610194683, + 0.2727503664791584, + 0.7641717717051506, + 0.9589363597333431 + ], + "unique_experts": 64, + "load_cv": 0.6344789201727484, + "normalized_load_entropy": 0.9498238745047322, + "max_load_share": 0.04277286135693215 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "a086e4dbcbe5b8b6884f9c1429a8795bb22b3ea7c07ddda5fb14474ee088be71", + "route_weight_sha256": "ad6a54b2e4f0219d098ed63abf604e85aaa7c061a3cdfcfd85793c49e6fe8e64", + "loads": [ + 26, + 15, + 8, + 26, + 24, + 8, + 16, + 18, + 9, + 14, + 15, + 6, + 6, + 31, + 4, + 14, + 19, + 32, + 13, + 17, + 13, + 10, + 16, + 19, + 11, + 22, + 8, + 2, + 9, + 12, + 14, + 7, + 2, + 5, + 10, + 21, + 18, + 5, + 8, + 4, + 17, + 22, + 14, + 19, + 16, + 19, + 29, + 14, + 23, + 11, + 16, + 14, + 15, + 5, + 8, + 21, + 8, + 24, + 22, + 18, + 16, + 7, + 13, + 16 + ], + "weighted_loads": [ + 1.5007205717265606, + 1.0522164404392242, + 0.45730105973780155, + 1.5577044654637575, + 2.057632427662611, + 0.4810415804386139, + 0.8851449079811573, + 1.103361316025257, + 0.5526573769748211, + 1.0311166979372501, + 1.3843671344220638, + 0.3000210039317608, + 0.25029448606073856, + 2.516061283648014, + 0.16796289011836052, + 0.9778533354401588, + 1.7192192822694778, + 1.6038052923977375, + 0.7313898019492626, + 1.5315389148890972, + 0.6330858431756496, + 0.538254376500845, + 1.1542799193412066, + 1.2186893355101347, + 0.41620221734046936, + 1.071299159899354, + 0.42392636463046074, + 0.07053292915225029, + 0.5931192189455032, + 0.5980334989726543, + 0.8181476034224033, + 0.2985831433907151, + 0.07407976873219013, + 0.3384156711399555, + 0.5254425182938576, + 1.4967567026615143, + 1.6095935255289078, + 0.22389981150627136, + 0.37428533658385277, + 0.23966596275568008, + 1.0468719713389874, + 1.797042015939951, + 0.6936410088092089, + 1.1091280803084373, + 1.4833556581288576, + 1.19801864027977, + 2.4362933337688446, + 1.1140157505869865, + 1.7289789021015167, + 0.6938217580318451, + 0.8018210306763649, + 0.9115844927728176, + 0.991321288049221, + 0.20829478278756142, + 0.5147164426743984, + 1.7556338049471378, + 0.3821781948208809, + 1.2557141240686178, + 1.6182380318641663, + 1.567619413137436, + 1.008952610194683, + 0.3111065961420536, + 0.9209840074181557, + 0.99493458122015 + ], + "unique_experts": 64, + "load_cv": 0.48652693397969066, + "normalized_load_entropy": 0.9701477012961263, + "max_load_share": 0.03463203463203463 + } + }, + "s0_period": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "b82464e0a66e3ea1eda4643ed2fdffb7b45a6acba75a7086f784c38b59a84ca8", + "route_weight_sha256": "c5487846a9700d28907e9e2c354efacc08823de16e14461c541bd1737283dadb", + "loads": [ + 8, + 12, + 8, + 27, + 22, + 9, + 16, + 18, + 1, + 12, + 3, + 4, + 5, + 27, + 2, + 13, + 17, + 27, + 14, + 6, + 15, + 7, + 12, + 8, + 5, + 9, + 2, + 3, + 3, + 12, + 12, + 2, + 2, + 1, + 4, + 11, + 17, + 2, + 2, + 2, + 11, + 6, + 14, + 21, + 13, + 7, + 10, + 14, + 16, + 7, + 12, + 13, + 15, + 5, + 7, + 18, + 3, + 26, + 16, + 13, + 16, + 6, + 11, + 16 + ], + "weighted_loads": [ + 0.4073794521391392, + 0.8606990240514278, + 0.47122601605951786, + 1.6727622374892235, + 1.817771714180708, + 0.5097201876342297, + 0.9234691224992275, + 1.107745487242937, + 0.0957978293299675, + 0.989404235035181, + 0.14515746757388115, + 0.21638263016939163, + 0.2585507705807686, + 2.361942835152149, + 0.0908498503267765, + 0.9458016566932201, + 1.6290559396147728, + 1.3610332198441029, + 0.7880452945828438, + 0.4444301463663578, + 0.6966823861002922, + 0.4226906783878803, + 0.5097088478505611, + 0.4058065824210644, + 0.2184360008686781, + 0.401964258402586, + 0.0852699913084507, + 0.15231683105230331, + 0.17740308493375778, + 0.6343349479138851, + 0.6874289326369762, + 0.12148281931877136, + 0.06854708679020405, + 0.08869598805904388, + 0.18497945368289948, + 0.8143847808241844, + 1.5843256004154682, + 0.08315291255712509, + 0.07016192749142647, + 0.1425778567790985, + 0.6415366418659687, + 0.40047865360975266, + 0.6897272132337093, + 1.233888540416956, + 1.371675668284297, + 0.30540903471410275, + 0.7953518740832806, + 1.1180215887725353, + 1.2751289457082748, + 0.4054329991340637, + 0.6067536622285843, + 0.8788020275533199, + 0.98328647762537, + 0.16978632099926472, + 0.5111378356814384, + 1.625192018225789, + 0.15963318571448326, + 1.318544838577509, + 1.274023000150919, + 1.4116556197404861, + 1.0506287924945354, + 0.2814582847058773, + 0.7630584016442299, + 1.006178829818964 + ], + "unique_experts": 64, + "load_cv": 0.6444938318026373, + "normalized_load_entropy": 0.9480857165374542, + "max_load_share": 0.03982300884955752 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "8412ee87d33de7d94da9f6e5e3621b1fda999e4f76e66ad71e716599aed1ac89", + "route_weight_sha256": "f4c0a7f5b919d5c30cae45721a8c62d67537489eda1977d0da98a791b8240d83", + "loads": [ + 17, + 14, + 8, + 27, + 24, + 9, + 16, + 18, + 3, + 12, + 15, + 4, + 7, + 31, + 2, + 13, + 18, + 31, + 14, + 15, + 15, + 7, + 16, + 11, + 8, + 11, + 2, + 4, + 3, + 12, + 13, + 7, + 2, + 1, + 14, + 17, + 17, + 2, + 5, + 2, + 11, + 17, + 14, + 21, + 16, + 14, + 23, + 15, + 19, + 7, + 16, + 14, + 15, + 7, + 7, + 23, + 9, + 26, + 18, + 17, + 16, + 6, + 13, + 17 + ], + "weighted_loads": [ + 1.0317474007606506, + 1.024428479373455, + 0.47122601605951786, + 1.6727622374892235, + 2.063997011631727, + 0.5097201876342297, + 0.9234691224992275, + 1.107745487242937, + 0.18971867859363556, + 0.989404235035181, + 1.408421192318201, + 0.21638263016939163, + 0.3055496849119663, + 2.502977643162012, + 0.0908498503267765, + 0.9458016566932201, + 1.6703470200300217, + 1.5249145068228245, + 0.7880452945828438, + 1.3083372563123703, + 0.6966823861002922, + 0.4226906783878803, + 1.1576763298362494, + 0.6354328989982605, + 0.3494283799082041, + 0.5541389994323254, + 0.0852699913084507, + 0.16531648114323616, + 0.17740308493375778, + 0.6343349479138851, + 0.7270985841751099, + 0.30942516680806875, + 0.06854708679020405, + 0.08869598805904388, + 0.735149122774601, + 1.242127638310194, + 1.5843256004154682, + 0.08315291255712509, + 0.2090359441936016, + 0.1425778567790985, + 0.6415366418659687, + 1.3747503645718098, + 0.6897272132337093, + 1.233888540416956, + 1.635028412565589, + 0.8435707520693541, + 1.9176005125045776, + 1.1934447474777699, + 1.4729863107204437, + 0.4054329991340637, + 0.8093175515532494, + 0.912611834704876, + 0.98328647762537, + 0.2461542058736086, + 0.5111378356814384, + 1.9193850420415401, + 0.4405609145760536, + 1.318544838577509, + 1.4216491803526878, + 1.5844558365643024, + 1.0506287924945354, + 0.2814582847058773, + 0.8189650792628527, + 1.0423250161111355 + ], + "unique_experts": 64, + "load_cv": 0.5475584892869249, + "normalized_load_entropy": 0.9606150136919185, + "max_load_share": 0.03743961352657005 + } + }, + "s1_period": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "d177dd4f7d7a33ea7859446eaf2335dc750a953c28e2fb3dce03e3b7cfd2e98d", + "route_weight_sha256": "8e8695d70202b8cf98ebd79a7eb04641bb9638ef846fa697012513301c254294", + "loads": [ + 11, + 12, + 8, + 26, + 23, + 8, + 16, + 18, + 1, + 12, + 3, + 4, + 4, + 27, + 3, + 16, + 17, + 27, + 13, + 6, + 15, + 8, + 11, + 10, + 5, + 13, + 3, + 2, + 3, + 13, + 12, + 3, + 1, + 2, + 3, + 10, + 17, + 2, + 2, + 2, + 11, + 5, + 10, + 20, + 13, + 6, + 9, + 14, + 16, + 7, + 12, + 12, + 15, + 4, + 7, + 19, + 3, + 26, + 16, + 13, + 16, + 6, + 10, + 16 + ], + "weighted_loads": [ + 0.525948029011488, + 0.8480211347341537, + 0.45328633673489094, + 1.5913215056061745, + 1.826709784567356, + 0.4744126833975315, + 0.8880761973559856, + 1.102161716669798, + 0.09376752376556396, + 0.9416886530816555, + 0.13821760937571526, + 0.2050824649631977, + 0.21512197330594063, + 2.39510864764452, + 0.12945480272173882, + 1.0767681747674942, + 1.6274889186024666, + 1.3794198334217072, + 0.7371585741639137, + 0.4556427076458931, + 0.7003289200365543, + 0.4539599195122719, + 0.4641838036477566, + 0.46913905441761017, + 0.20887631550431252, + 0.5497964657843113, + 0.11820271611213684, + 0.11660151556134224, + 0.16859960928559303, + 0.6491984501481056, + 0.6780569553375244, + 0.1589117906987667, + 0.0304997731000185, + 0.11629528924822807, + 0.16232068464159966, + 0.7555672340095043, + 1.5657226331532001, + 0.08370986208319664, + 0.07396387308835983, + 0.1310247853398323, + 0.6338370591402054, + 0.34535956010222435, + 0.5434129051864147, + 1.1334919296205044, + 1.3326340354979038, + 0.26371060498058796, + 0.7074929773807526, + 1.0914048179984093, + 1.2787455096840858, + 0.4205964170396328, + 0.6021297946572304, + 0.8152645826339722, + 0.9971519559621811, + 0.13723069056868553, + 0.48049332574009895, + 1.6218085587024689, + 0.15047666430473328, + 1.338472431525588, + 1.2660928219556808, + 1.3443387933075428, + 1.0169232487678528, + 0.27985040098428726, + 0.7317420318722725, + 1.0300758555531502 + ], + "unique_experts": 64, + "load_cv": 0.6453573489532756, + "normalized_load_entropy": 0.9479439840625623, + "max_load_share": 0.03982300884955752 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "2c12c3dd49b5ac78d5cfa0d5c6aba3eef13f103b72e851c924d9faf09977bded", + "route_weight_sha256": "ee2eb9bc8386a1ab63334281fa2d13c8d3122b42918fca13568bfa3a3d46f9a5", + "loads": [ + 24, + 16, + 8, + 26, + 25, + 8, + 16, + 18, + 8, + 14, + 15, + 6, + 6, + 30, + 4, + 16, + 18, + 31, + 13, + 15, + 15, + 11, + 15, + 21, + 10, + 24, + 7, + 3, + 9, + 13, + 14, + 7, + 1, + 5, + 9, + 22, + 17, + 5, + 7, + 3, + 17, + 21, + 12, + 20, + 16, + 15, + 31, + 15, + 23, + 12, + 14, + 13, + 15, + 7, + 8, + 24, + 9, + 26, + 22, + 17, + 16, + 7, + 12, + 17 + ], + "weighted_loads": [ + 1.362174291163683, + 1.0882015712559223, + 0.45328633673489094, + 1.5913215056061745, + 2.0934756994247437, + 0.4744126833975315, + 0.8880761973559856, + 1.102161716669798, + 0.5131227523088455, + 1.0318570956587791, + 1.2960383854806423, + 0.3006037287414074, + 0.2623241450637579, + 2.484458066523075, + 0.16884160786867142, + 1.0767681747674942, + 1.6739133149385452, + 1.573410276323557, + 0.7371585741639137, + 1.4167448803782463, + 0.7003289200365543, + 0.5812438167631626, + 1.1098358929157257, + 1.2955402582883835, + 0.3992982357740402, + 1.138056505471468, + 0.37135474383831024, + 0.12960116565227509, + 0.589072372764349, + 0.6491984501481056, + 0.8159533180296421, + 0.3015485545620322, + 0.0304997731000185, + 0.33942706137895584, + 0.46930211037397385, + 1.543293684720993, + 1.5657226331532001, + 0.22450684010982513, + 0.35509075596928596, + 0.1980907917022705, + 1.0362454541027546, + 1.783430840820074, + 0.6362511701881886, + 1.1334919296205044, + 1.46261565387249, + 1.0229417402297258, + 2.66940825805068, + 1.1633886396884918, + 1.7190175279974937, + 0.7482258155941963, + 0.7174232415854931, + 0.8483389317989349, + 0.9971519559621811, + 0.2859950587153435, + 0.5219614468514919, + 1.8757743332535028, + 0.4260110855102539, + 1.338472431525588, + 1.6222005523741245, + 1.5266183353960514, + 1.0169232487678528, + 0.31820663064718246, + 0.8885542675852776, + 1.066074077039957 + ], + "unique_experts": 64, + "load_cv": 0.4953826265652117, + "normalized_load_entropy": 0.9690475868633367, + "max_load_share": 0.03354978354978355 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 113, + "ordered_topk_exact_tokens": 85, + "set_exact_tokens": 98, + "mean_set_jaccard": 0.9620733249051834, + "mean_token_weighted_tv": 0.009331835812963216, + "aggregate_load_tv": 0.019174041297935103 + }, + "system_bos": { + "tokens": 113, + "ordered_topk_exact_tokens": 78, + "set_exact_tokens": 92, + "mean_set_jaccard": 0.9469026548672567, + "mean_token_weighted_tv": 0.013857472061583427, + "aggregate_load_tv": 0.02064896755162242 + }, + "system_x": { + "tokens": 113, + "ordered_topk_exact_tokens": 59, + "set_exact_tokens": 74, + "mean_set_jaccard": 0.8919089759797725, + "mean_token_weighted_tv": 0.02389869993898721, + "aggregate_load_tv": 0.038348082595870206 + }, + "system_period": { + "tokens": 113, + "ordered_topk_exact_tokens": 60, + "set_exact_tokens": 77, + "mean_set_jaccard": 0.9051833122629583, + "mean_token_weighted_tv": 0.022033721628903814, + "aggregate_load_tv": 0.029498525073746312 + }, + "bos_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 65, + "set_exact_tokens": 80, + "mean_set_jaccard": 0.9146649810366625, + "mean_token_weighted_tv": 0.018981930882200203, + "aggregate_load_tv": 0.029498525073746312 + }, + "bos_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 63, + "set_exact_tokens": 78, + "mean_set_jaccard": 0.9096080910240203, + "mean_token_weighted_tv": 0.020180256715852076, + "aggregate_load_tv": 0.030973451327433628 + }, + "x_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 74, + "set_exact_tokens": 84, + "mean_set_jaccard": 0.9266750948166879, + "mean_token_weighted_tv": 0.01844422014809288, + "aggregate_load_tv": 0.035398230088495575 + }, + "x_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 56, + "set_exact_tokens": 70, + "mean_set_jaccard": 0.879898862199747, + "mean_token_weighted_tv": 0.028066870451500987, + "aggregate_load_tv": 0.03687315634218289 + }, + "period_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 68, + "set_exact_tokens": 85, + "mean_set_jaccard": 0.9292035398230089, + "mean_token_weighted_tv": 0.017438162810507075, + "aggregate_load_tv": 0.030973451327433628 + }, + "period_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 56, + "set_exact_tokens": 75, + "mean_set_jaccard": 0.8982300884955754, + "mean_token_weighted_tv": 0.024425820068382058, + "aggregate_load_tv": 0.035398230088495575 + } + } + }, + "layer_10": { + "layer": 10, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "8a7acf0a74b70545a21cd50d6da9a963733d337822b399f58deefb110cbc4724", + "route_weight_sha256": "a0f023277b72e14ebd76d7940e2819a4047edd04e7659cf8621b2258c87517bc", + "loads": [ + 11, + 12, + 5, + 2, + 4, + 32, + 5, + 3, + 9, + 9, + 13, + 14, + 4, + 12, + 21, + 11, + 11, + 6, + 12, + 59, + 3, + 4, + 3, + 25, + 12, + 9, + 11, + 16, + 5, + 15, + 6, + 3, + 7, + 36, + 9, + 20, + 0, + 5, + 9, + 4, + 8, + 18, + 15, + 9, + 0, + 5, + 2, + 7, + 6, + 10, + 0, + 4, + 10, + 15, + 11, + 14, + 20, + 12, + 10, + 7, + 14, + 7, + 17, + 0 + ], + "weighted_loads": [ + 0.6812670901417732, + 0.5739321410655975, + 0.264189500361681, + 0.07278962060809135, + 0.1990804821252823, + 3.012853156775236, + 0.2206736095249653, + 0.1731429547071457, + 0.6672159507870674, + 0.5956339910626411, + 0.6183896455913782, + 0.8974006772041321, + 0.171706635504961, + 0.6057542562484741, + 1.4735977463424206, + 0.6805027835071087, + 0.8928137831389904, + 0.3941708505153656, + 0.7324567586183548, + 4.318052414804697, + 0.17627396062016487, + 0.242381501942873, + 0.12674634158611298, + 1.579126138240099, + 0.9175399914383888, + 1.0431972816586494, + 0.8560307696461678, + 0.8423999398946762, + 0.30929985269904137, + 1.1797926500439644, + 0.29311130568385124, + 0.13204515352845192, + 0.5849816054105759, + 2.525009511038661, + 0.6284988410770893, + 1.3123273365199566, + 0.0, + 0.24950815737247467, + 0.6463355384767056, + 0.13650712370872498, + 0.4111579582095146, + 1.148875791579485, + 1.1959371343255043, + 0.35177823528647423, + 0.0, + 0.19520608708262444, + 0.08015887998044491, + 0.5236195102334023, + 0.31754567474126816, + 0.5597972646355629, + 0.0, + 0.19650883227586746, + 0.537651464343071, + 1.1021484807133675, + 0.7519744597375393, + 1.1442830823361874, + 1.4057334512472153, + 1.0249578580260277, + 0.4615063965320587, + 0.3169124126434326, + 0.97836884111166, + 0.4466065280139446, + 1.036698218435049, + 0.0 + ], + "unique_experts": 60, + "load_cv": 0.8761359906735648, + "normalized_load_entropy": 0.925149204087473, + "max_load_share": 0.08702064896755163 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "2adcabafb4a564d8a62e76bfe68dcb6a8af28efb8195cf4701b934f31eef8c21", + "route_weight_sha256": "c578aa6bd67ead2d40a2c7427231cc84cff6863d6409ef34c2fbb2eaaf4fe935", + "loads": [ + 11, + 12, + 7, + 2, + 4, + 32, + 5, + 7, + 9, + 11, + 15, + 16, + 5, + 15, + 23, + 11, + 11, + 9, + 19, + 62, + 7, + 6, + 4, + 25, + 12, + 11, + 11, + 22, + 6, + 16, + 8, + 4, + 7, + 44, + 10, + 21, + 0, + 5, + 9, + 4, + 8, + 28, + 19, + 11, + 4, + 8, + 8, + 10, + 6, + 12, + 2, + 10, + 10, + 18, + 11, + 23, + 20, + 18, + 10, + 18, + 19, + 20, + 17, + 0 + ], + "weighted_loads": [ + 0.6812670901417732, + 0.5739321410655975, + 0.28326747054234147, + 0.07278962060809135, + 0.1990804821252823, + 3.012853156775236, + 0.2206736095249653, + 0.34960633888840675, + 0.6672159507870674, + 0.620167157612741, + 0.7138296980410814, + 0.9976061321794987, + 0.20442868396639824, + 2.0207618586719036, + 1.6299076415598392, + 0.6805027835071087, + 0.8928137831389904, + 0.6442260295152664, + 1.118708221707493, + 4.460063721984625, + 0.3415391109883785, + 0.3260929696261883, + 0.1305218779016286, + 1.579126138240099, + 0.9175399914383888, + 1.106742860749364, + 0.8560307696461678, + 1.5232557989656925, + 0.3557187207043171, + 1.22255365177989, + 0.49457355216145515, + 0.14582176320254803, + 0.5849816054105759, + 2.8934065867215395, + 0.6583226770162582, + 1.3492250517010689, + 0.0, + 0.24950815737247467, + 0.6463355384767056, + 0.13650712370872498, + 0.4111579582095146, + 2.192329455167055, + 1.308997499756515, + 0.44936367124319077, + 0.20984120294451714, + 0.34040922671556473, + 0.35175509192049503, + 0.654289411380887, + 0.31754567474126816, + 0.6481592729687691, + 0.0953390821814537, + 0.5011109746992588, + 0.537651464343071, + 1.2632692232728004, + 0.7519744597375393, + 1.812581617385149, + 1.4057334512472153, + 1.371927160769701, + 0.4615063965320587, + 0.9922777973115444, + 1.3266097456216812, + 1.6634543649852276, + 1.036698218435049, + 0.0 + ], + "unique_experts": 62, + "load_cv": 0.7763061061134586, + "normalized_load_entropy": 0.9395499113333339, + "max_load_share": 0.0748792270531401 + } + }, + "s1_eos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "f7aa95741eb7657a420d0170b9c93cbb139f6616950ffb874e2ec7ca7c522698", + "route_weight_sha256": "09734aacda41b3c15485f519e971d5ea2688a8c2745ca149a1622a5635223933", + "loads": [ + 11, + 11, + 7, + 3, + 2, + 32, + 6, + 4, + 9, + 9, + 12, + 14, + 3, + 11, + 21, + 10, + 11, + 5, + 12, + 58, + 3, + 4, + 3, + 24, + 13, + 9, + 11, + 15, + 7, + 16, + 6, + 3, + 8, + 36, + 8, + 20, + 0, + 4, + 9, + 3, + 7, + 17, + 14, + 7, + 0, + 5, + 2, + 8, + 7, + 11, + 0, + 4, + 10, + 15, + 11, + 15, + 22, + 12, + 10, + 9, + 14, + 8, + 17, + 0 + ], + "weighted_loads": [ + 0.690702274441719, + 0.5410025957971811, + 0.32427636347711086, + 0.10363573394715786, + 0.12106626480817795, + 3.00227677449584, + 0.2641117759048939, + 0.216746736317873, + 0.657540712505579, + 0.5916899405419827, + 0.5909645557403564, + 0.8788365162909031, + 0.13541516289114952, + 0.5743775106966496, + 1.4700428619980812, + 0.6354884579777718, + 0.894153282046318, + 0.36719101294875145, + 0.7329237423837185, + 4.337589526548982, + 0.16895397379994392, + 0.23708976432681084, + 0.13637837767601013, + 1.5499602518975735, + 0.9481330066919327, + 1.0296810045838356, + 0.8585255965590477, + 0.7774694804102182, + 0.41525137424468994, + 1.1969313584268093, + 0.28687750548124313, + 0.13714835792779922, + 0.6138659827411175, + 2.5225294455885887, + 0.5848949141800404, + 1.2915052846074104, + 0.0, + 0.20611091703176498, + 0.648036852478981, + 0.10778313502669334, + 0.37354234606027603, + 1.1213805824518204, + 1.1624702028930187, + 0.2798479665070772, + 0.0, + 0.19741474092006683, + 0.07703603804111481, + 0.5635727494955063, + 0.35590649396181107, + 0.5918557569384575, + 0.0, + 0.1987420730292797, + 0.5463153999298811, + 1.0840053334832191, + 0.7325859218835831, + 1.1652281004935503, + 1.4784357473254204, + 1.0158991143107414, + 0.4629274979233742, + 0.3952650800347328, + 0.9635750465095043, + 0.49323103204369545, + 1.0456710644066334, + 0.0 + ], + "unique_experts": 60, + "load_cv": 0.8671914168882181, + "normalized_load_entropy": 0.9258649271267104, + "max_load_share": 0.0855457227138643 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "ad2943c6851494a9e72e940b2b89094bfed78929e05efe92a9cadd22a2029cdc", + "route_weight_sha256": "832d0705298ff9cf79ee86620868ea83fdf43fe02bb7d022a614190d1e5bb50a", + "loads": [ + 12, + 11, + 10, + 3, + 6, + 32, + 6, + 6, + 9, + 11, + 15, + 18, + 7, + 13, + 24, + 10, + 11, + 10, + 18, + 59, + 4, + 5, + 4, + 24, + 14, + 12, + 12, + 35, + 7, + 19, + 14, + 4, + 13, + 53, + 10, + 22, + 3, + 7, + 10, + 3, + 8, + 33, + 18, + 9, + 3, + 10, + 7, + 11, + 15, + 14, + 3, + 17, + 11, + 19, + 11, + 28, + 23, + 19, + 10, + 28, + 24, + 19, + 17, + 1 + ], + "weighted_loads": [ + 0.725331824272871, + 0.5410025957971811, + 0.38372126733884215, + 0.10363573394715786, + 0.3235265351831913, + 3.00227677449584, + 0.2641117759048939, + 0.30309902131557465, + 0.657540712505579, + 0.6168348165228963, + 0.7069120407104492, + 1.0992307364940643, + 0.3347127176821232, + 1.9489105977118015, + 1.699765369296074, + 0.6354884579777718, + 0.894153282046318, + 0.7259656153619289, + 1.1025731661356986, + 4.380007794126868, + 0.2091146670281887, + 0.28655286878347397, + 0.1402948764152825, + 1.5499602518975735, + 0.9894626922905445, + 1.3561622817069292, + 0.9005032330751419, + 2.089595390483737, + 0.41525137424468994, + 1.3292242549359798, + 0.9509292468428612, + 0.15092496760189533, + 1.10189962759614, + 3.3592990040779114, + 0.7279025875031948, + 1.4569624997675419, + 0.11324933357536793, + 0.33467984572052956, + 0.6840062364935875, + 0.10778313502669334, + 0.415881909430027, + 2.4739439226686954, + 1.2600493440404534, + 0.34828547574579716, + 0.17843879759311676, + 0.44974327459931374, + 0.3597046732902527, + 0.6865020710974932, + 1.005658246576786, + 0.7562179528176785, + 0.18131470307707787, + 0.991741381585598, + 0.6157781612128019, + 1.2833707593381405, + 0.7325859218835831, + 2.077828975394368, + 1.5506972298026085, + 1.4074305295944214, + 0.4629274979233742, + 1.575259804725647, + 1.6992592997848988, + 1.559942588210106, + 1.0456710644066334, + 0.03558279946446419 + ], + "unique_experts": 64, + "load_cv": 0.7484922345460173, + "normalized_load_entropy": 0.9431959872181559, + "max_load_share": 0.06385281385281386 + } + }, + "s0_bos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "bcf422656ce658a555d52b721f41577894bf8ba115a4f1e9fde8a1eb1a6fd0ac", + "route_weight_sha256": "b13c7216833eb2ca151b39340546a01fe328d1a7c1a49d86e4b95c6ede0d4926", + "loads": [ + 12, + 12, + 6, + 2, + 4, + 34, + 6, + 4, + 10, + 10, + 9, + 14, + 5, + 13, + 22, + 12, + 11, + 6, + 12, + 60, + 2, + 5, + 2, + 24, + 12, + 9, + 11, + 14, + 5, + 15, + 6, + 1, + 9, + 31, + 8, + 20, + 0, + 6, + 9, + 4, + 7, + 18, + 14, + 7, + 0, + 5, + 1, + 11, + 6, + 12, + 0, + 4, + 10, + 15, + 11, + 13, + 21, + 12, + 9, + 8, + 14, + 7, + 16, + 0 + ], + "weighted_loads": [ + 0.7239778153598309, + 0.5717508513480425, + 0.316086795181036, + 0.0706072449684143, + 0.1940728761255741, + 3.083538692444563, + 0.27113062888383865, + 0.22620944306254387, + 0.733267679810524, + 0.6184351965785027, + 0.46831123530864716, + 0.8672312796115875, + 0.20622911304235458, + 0.655517190694809, + 1.5216158144176006, + 0.7202263809740543, + 0.89136066660285, + 0.41367189958691597, + 0.7209521681070328, + 4.393473979085684, + 0.13565387949347496, + 0.2758206520229578, + 0.08515391126275063, + 1.5509424023330212, + 0.8980570919811726, + 1.0421965941786766, + 0.8644367940723896, + 0.7292328849434853, + 0.25615041330456734, + 1.1589152738451958, + 0.28596213832497597, + 0.04158833250403404, + 0.6587745305150747, + 2.470801493152976, + 0.59375936165452, + 1.3024477809667587, + 0.0, + 0.2718323562294245, + 0.6428219117224216, + 0.14065865986049175, + 0.36031055077910423, + 1.1441319100558758, + 1.1190634071826935, + 0.2798077464103699, + 0.0, + 0.19155091792345047, + 0.04328287020325661, + 0.6926891766488552, + 0.30683398246765137, + 0.6330832205712795, + 0.0, + 0.20300740376114845, + 0.5200576800853014, + 1.0753733664751053, + 0.7757954336702824, + 1.081402812153101, + 1.470299605280161, + 1.0153514482080936, + 0.4367777928709984, + 0.34364113956689835, + 0.9681598916649818, + 0.46849463507533073, + 1.0059923715889454, + 0.0 + ], + "unique_experts": 60, + "load_cv": 0.8713556733796454, + "normalized_load_entropy": 0.9250487168047746, + "max_load_share": 0.08849557522123894 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "3b7cfdda0adda8083ea141891641f4076ef6d732c414353ee17e94e228c6823b", + "route_weight_sha256": "46b968cd3465c8f79c269bdbb24ca612ca39aa83553480fccc9bc549a823647e", + "loads": [ + 12, + 12, + 7, + 2, + 5, + 34, + 6, + 9, + 10, + 11, + 11, + 16, + 6, + 16, + 25, + 12, + 11, + 9, + 18, + 62, + 7, + 7, + 2, + 24, + 12, + 11, + 11, + 21, + 6, + 16, + 9, + 2, + 9, + 39, + 9, + 21, + 0, + 6, + 9, + 4, + 7, + 28, + 18, + 9, + 3, + 8, + 7, + 14, + 6, + 14, + 2, + 10, + 10, + 17, + 11, + 22, + 21, + 18, + 9, + 20, + 19, + 20, + 16, + 0 + ], + "weighted_loads": [ + 0.7239778153598309, + 0.5717508513480425, + 0.33023743238300085, + 0.0706072449684143, + 0.22460591048002243, + 3.083538692444563, + 0.27113062888383865, + 0.43705974891781807, + 0.733267679810524, + 0.634660804644227, + 0.5637512877583504, + 0.9676373079419136, + 0.2389511615037918, + 1.202819962054491, + 1.7308865897357464, + 0.7202263809740543, + 0.89136066660285, + 0.6638939119875431, + 1.1247543841600418, + 4.50740048289299, + 0.370608139783144, + 0.3595321197062731, + 0.08515391126275063, + 1.5509424023330212, + 0.8980570919811726, + 1.105742173269391, + 0.8644367940723896, + 1.5425981357693672, + 0.30256928130984306, + 1.2016762755811214, + 0.5256843902170658, + 0.05536494217813015, + 0.6587745305150747, + 2.8446465637534857, + 0.623583197593689, + 1.339345496147871, + 0.0, + 0.2718323562294245, + 0.6428219117224216, + 0.14065865986049175, + 0.36031055077910423, + 2.375883176922798, + 1.2731572818011045, + 0.3773931823670864, + 0.1989169791340828, + 0.33675405755639076, + 0.31487908214330673, + 0.8172207083553076, + 0.30683398246765137, + 0.7618308514356613, + 0.0953390821814537, + 0.4827173203229904, + 0.5200576800853014, + 1.1975115463137627, + 0.7757954336702824, + 1.75791409984231, + 1.470299605280161, + 1.362320750951767, + 0.4367777928709984, + 1.0826417841017246, + 1.3168574199080467, + 1.6948219798505306, + 1.0059923715889454, + 0.0 + ], + "unique_experts": 62, + "load_cv": 0.7634531704965752, + "normalized_load_entropy": 0.9402289075623739, + "max_load_share": 0.0748792270531401 + } + }, + "s1_bos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "1a4f31311640aced099f61e23aa3458832498d38e969de4ed29da2f49bfd6592", + "route_weight_sha256": "6f04ff7900fd9b45f31b059e53b4eda900ddc5a24e0400ea2f53278f23a03054", + "loads": [ + 12, + 9, + 7, + 3, + 3, + 34, + 5, + 4, + 12, + 10, + 9, + 13, + 5, + 11, + 22, + 11, + 10, + 6, + 13, + 60, + 4, + 5, + 2, + 24, + 13, + 9, + 11, + 13, + 6, + 15, + 6, + 3, + 8, + 33, + 10, + 20, + 0, + 5, + 9, + 4, + 7, + 18, + 14, + 5, + 0, + 6, + 2, + 9, + 6, + 13, + 0, + 4, + 10, + 15, + 10, + 14, + 21, + 12, + 10, + 7, + 13, + 7, + 16, + 0 + ], + "weighted_loads": [ + 0.735542144626379, + 0.47351012378931046, + 0.359417287632823, + 0.09699719771742821, + 0.1527775041759014, + 3.0558594465255737, + 0.2365993596613407, + 0.23974477499723434, + 0.7921432815492153, + 0.6049152202904224, + 0.45697208121418953, + 0.8358311429619789, + 0.2062874399125576, + 0.6027469635009766, + 1.512870479375124, + 0.6654079109430313, + 0.850309282541275, + 0.4159414619207382, + 0.784567978233099, + 4.372835278511047, + 0.18102319911122322, + 0.2704723384231329, + 0.09145405888557434, + 1.539270680397749, + 0.9553514868021011, + 1.0521191284060478, + 0.8571772947907448, + 0.6974921897053719, + 0.31219498813152313, + 1.1788009032607079, + 0.28640804439783096, + 0.12795012071728706, + 0.6204012483358383, + 2.432513114064932, + 0.6726655140519142, + 1.3003857024013996, + 0.0, + 0.23455654084682465, + 0.6614929027855396, + 0.14902428723871708, + 0.3467443771660328, + 1.1455328688025475, + 1.143799364566803, + 0.19997570291161537, + 0.0, + 0.23469848558306694, + 0.05691876262426376, + 0.6363107599318027, + 0.31367776542901993, + 0.6617796383798122, + 0.0, + 0.2075079083442688, + 0.5191618856042624, + 1.0945682190358639, + 0.7331068068742752, + 1.1063915602862835, + 1.472978688776493, + 1.0209004431962967, + 0.47180215269327164, + 0.3226254768669605, + 0.9311430864036083, + 0.45449893176555634, + 1.0074837915599346, + 0.0 + ], + "unique_experts": 60, + "load_cv": 0.872154212454046, + "normalized_load_entropy": 0.9269553649658959, + "max_load_share": 0.08849557522123894 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "337875b6e06be0dcdfcb7d49ee7016c5f7d46112d07be0cb9ea38420a0e172d7", + "route_weight_sha256": "f485d3864db5420481e318768213f6138e44858d3510983fb7419c0201c36861", + "loads": [ + 12, + 10, + 9, + 3, + 8, + 34, + 5, + 6, + 12, + 11, + 12, + 17, + 9, + 13, + 26, + 11, + 10, + 10, + 18, + 62, + 6, + 6, + 2, + 24, + 14, + 12, + 12, + 34, + 6, + 18, + 15, + 4, + 13, + 50, + 12, + 22, + 3, + 8, + 10, + 4, + 8, + 35, + 16, + 7, + 3, + 11, + 7, + 12, + 14, + 17, + 3, + 17, + 11, + 18, + 10, + 26, + 22, + 19, + 10, + 27, + 23, + 18, + 16, + 1 + ], + "weighted_loads": [ + 0.735542144626379, + 0.5009004678577185, + 0.41384624410420656, + 0.09699719771742821, + 0.3978022150695324, + 3.0558594465255737, + 0.2365993596613407, + 0.326097059994936, + 0.7921432815492153, + 0.6211408283561468, + 0.5729195661842823, + 1.0571423135697842, + 0.40558499470353127, + 1.1117987148463726, + 1.7870094887912273, + 0.6654079109430313, + 0.850309282541275, + 0.7201101258397102, + 1.183809146285057, + 4.46301232278347, + 0.27960092946887016, + 0.31993544287979603, + 0.09145405888557434, + 1.539270680397749, + 0.996681172400713, + 1.3786004055291414, + 0.899154931306839, + 2.0936800464987755, + 0.31219498813152313, + 1.3110937997698784, + 0.9969736263155937, + 0.14172673039138317, + 1.1084348931908607, + 3.2807822301983833, + 0.8156731873750687, + 1.465842917561531, + 0.11324933357536793, + 0.3631254695355892, + 0.6974622868001461, + 0.14902428723871708, + 0.38908394053578377, + 2.7998422645032406, + 1.1896079778671265, + 0.2684132121503353, + 0.2164098098874092, + 0.48702701926231384, + 0.33958739787340164, + 0.7537628095597029, + 0.9634295180439949, + 0.8903249017894268, + 0.18131470307707787, + 0.971027348190546, + 0.5886246468871832, + 1.2543558590114117, + 0.7331068068742752, + 2.0087463296949863, + 1.5452401712536812, + 1.4124318584799767, + 0.47180215269327164, + 1.594485528767109, + 1.6715194061398506, + 1.5270527563989162, + 1.0074837915599346, + 0.03558279946446419 + ], + "unique_experts": 64, + "load_cv": 0.7483920783572243, + "normalized_load_entropy": 0.9438250211063727, + "max_load_share": 0.0670995670995671 + } + }, + "s0_x": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "63e77a00a6cd130265d9ad35b83839ec455c72eccfa015d831fc3ecc2aceae10", + "route_weight_sha256": "cc7e280da72f36cee6512ced6eb09925c6001eaa567d39bca0c60163954669b5", + "loads": [ + 11, + 11, + 5, + 2, + 4, + 33, + 6, + 6, + 10, + 9, + 13, + 15, + 4, + 12, + 21, + 11, + 11, + 6, + 12, + 58, + 3, + 4, + 3, + 25, + 12, + 9, + 11, + 15, + 5, + 15, + 5, + 3, + 8, + 33, + 8, + 21, + 0, + 6, + 9, + 4, + 7, + 19, + 13, + 8, + 0, + 5, + 1, + 8, + 6, + 11, + 0, + 4, + 10, + 15, + 10, + 16, + 20, + 12, + 9, + 8, + 14, + 6, + 17, + 0 + ], + "weighted_loads": [ + 0.678056426346302, + 0.5317815821617842, + 0.2691688910126686, + 0.07116349972784519, + 0.20734617859125137, + 3.0100554935634136, + 0.26885300129652023, + 0.2831943966448307, + 0.7422931045293808, + 0.5785355716943741, + 0.6071807444095612, + 0.9174744412302971, + 0.17214712128043175, + 0.6179765239357948, + 1.469125673174858, + 0.6763543970882893, + 0.8823933228850365, + 0.4245273806154728, + 0.7152373939752579, + 4.289641294628382, + 0.1557413749396801, + 0.23887045681476593, + 0.13211147114634514, + 1.5864348970353603, + 0.8936139419674873, + 1.0439591780304909, + 0.8679133094847202, + 0.7929977420717478, + 0.3104318492114544, + 1.17187837138772, + 0.24964307248592377, + 0.1268870271742344, + 0.6369944699108601, + 2.551853146404028, + 0.5850070789456367, + 1.3443143963813782, + 0.0, + 0.27083105221390724, + 0.6456138230860233, + 0.13816403597593307, + 0.3593631386756897, + 1.1786207780241966, + 1.094904288649559, + 0.32118137180805206, + 0.0, + 0.1925223208963871, + 0.029108894988894463, + 0.5654750317335129, + 0.31800856813788414, + 0.5934597477316856, + 0.0, + 0.20248007774353027, + 0.5475649572908878, + 1.0653406754136086, + 0.7282252609729767, + 1.1644753776490688, + 1.4118925128132105, + 1.019837610423565, + 0.4381469897925854, + 0.34968892112374306, + 0.9807559996843338, + 0.4196658320724964, + 1.0430708527565002, + 0.0 + ], + "unique_experts": 60, + "load_cv": 0.8613922892488709, + "normalized_load_entropy": 0.9265649427215014, + "max_load_share": 0.0855457227138643 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "2172f3a87ad249ae0617eb68dc46a0cb3947bfe761be59a64d19fbd8f0eeb627", + "route_weight_sha256": "25397c126249930009373edd81e5fb5c1d69638c292b638b486c34569202484b", + "loads": [ + 12, + 12, + 6, + 2, + 4, + 33, + 6, + 11, + 10, + 10, + 15, + 17, + 5, + 14, + 23, + 11, + 11, + 10, + 17, + 60, + 7, + 6, + 3, + 25, + 12, + 11, + 11, + 20, + 6, + 16, + 8, + 4, + 8, + 42, + 9, + 22, + 0, + 6, + 9, + 4, + 7, + 28, + 16, + 10, + 4, + 9, + 8, + 11, + 6, + 14, + 2, + 10, + 10, + 17, + 10, + 25, + 20, + 19, + 9, + 19, + 19, + 20, + 17, + 0 + ], + "weighted_loads": [ + 0.7221391052007675, + 0.5695659797638655, + 0.28331952821463346, + 0.07116349972784519, + 0.20734617859125137, + 3.0100554935634136, + 0.26885300129652023, + 0.49927138164639473, + 0.7422931045293808, + 0.5947611797600985, + 0.7026207968592644, + 1.019431784749031, + 0.20486916974186897, + 1.1218897588551044, + 1.6325651705265045, + 0.6763543970882893, + 0.8823933228850365, + 0.7097883857786655, + 1.0556236803531647, + 4.404006335884333, + 0.32100652530789375, + 0.3225819244980812, + 0.13211147114634514, + 1.5864348970353603, + 0.8936139419674873, + 1.1075047571212053, + 0.8679133094847202, + 1.4155970606952906, + 0.3568507172167301, + 1.2146393731236458, + 0.49743688851594925, + 0.1406636368483305, + 0.6369944699108601, + 2.9687794595956802, + 0.6148309148848057, + 1.3812121115624905, + 0.0, + 0.27083105221390724, + 0.6456138230860233, + 0.13816403597593307, + 0.3593631386756897, + 2.1348277404904366, + 1.1998585890978575, + 0.4187668077647686, + 0.21429362148046494, + 0.40737176686525345, + 0.35065227560698986, + 0.6939049009233713, + 0.31800856813788414, + 0.7216415777802467, + 0.0953390821814537, + 0.527699176222086, + 0.5475649572908878, + 1.1847114451229572, + 0.7282252609729767, + 1.768900003284216, + 1.4118925128132105, + 1.4298608042299747, + 0.4381469897925854, + 1.0407503545284271, + 1.3140496239066124, + 1.7099474482238293, + 1.0430708527565002, + 0.0 + ], + "unique_experts": 62, + "load_cv": 0.75768446134115, + "normalized_load_entropy": 0.9413324044070033, + "max_load_share": 0.07246376811594203 + } + }, + "s1_x": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "7caec5108f1208b45fd5a5e07c761071f80c1b1dda809f8cf495cd48954fcee9", + "route_weight_sha256": "a76cc36171846b0836c9576135391fa242e45deb075924c12b541fd0a80f1701", + "loads": [ + 12, + 9, + 5, + 3, + 6, + 35, + 5, + 7, + 11, + 9, + 8, + 13, + 4, + 12, + 21, + 12, + 10, + 6, + 12, + 59, + 3, + 5, + 3, + 25, + 13, + 9, + 11, + 13, + 6, + 15, + 5, + 2, + 7, + 36, + 9, + 20, + 0, + 5, + 9, + 5, + 7, + 17, + 13, + 4, + 0, + 7, + 1, + 8, + 7, + 12, + 0, + 4, + 10, + 15, + 10, + 16, + 22, + 12, + 9, + 8, + 13, + 7, + 16, + 0 + ], + "weighted_loads": [ + 0.7247263304889202, + 0.4619203582406044, + 0.2691211514174938, + 0.09997307322919369, + 0.27803267538547516, + 3.064236279577017, + 0.23630085587501526, + 0.3182873837649822, + 0.7596395425498486, + 0.5614344961941242, + 0.4132898077368736, + 0.8385934457182884, + 0.16983967274427414, + 0.6077163685113192, + 1.4343175813555717, + 0.6900399178266525, + 0.828387513756752, + 0.43814176693558693, + 0.7536230310797691, + 4.322050258517265, + 0.17254000157117844, + 0.25896042212843895, + 0.12495705485343933, + 1.562013752758503, + 0.944519966840744, + 1.0155229270458221, + 0.8508158326148987, + 0.7081909980624914, + 0.296200105920434, + 1.1711872518062592, + 0.2382960207760334, + 0.08749353140592575, + 0.5871642865240574, + 2.45816595479846, + 0.631546750664711, + 1.2807796970009804, + 0.0, + 0.23279742896556854, + 0.6558698117733002, + 0.17155303247272968, + 0.3398120701313019, + 1.0858463421463966, + 1.0866022258996964, + 0.16521500796079636, + 0.0, + 0.2734462209045887, + 0.040921635925769806, + 0.5811607204377651, + 0.3662247583270073, + 0.6167579609900713, + 0.0, + 0.2154591679573059, + 0.5318680815398693, + 1.0646582916378975, + 0.7177278064191341, + 1.1395052373409271, + 1.4910470824688673, + 1.0240027979016304, + 0.4381492957472801, + 0.3725368119776249, + 0.8988127075135708, + 0.4586667940020561, + 0.9995825663208961, + 0.0 + ], + "unique_experts": 60, + "load_cv": 0.8815223465077654, + "normalized_load_entropy": 0.9253798291029898, + "max_load_share": 0.08702064896755163 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "dabe58f1cc2d2e3b28f9bf548f28d48ed452f23b03eed58438467158b327b75f", + "route_weight_sha256": "8d9f8d2324972d1daa493ad315230a7849558e059599a42ede466be7c6e9aecd", + "loads": [ + 13, + 10, + 7, + 3, + 11, + 35, + 5, + 10, + 11, + 10, + 12, + 18, + 8, + 13, + 25, + 12, + 10, + 11, + 16, + 60, + 4, + 6, + 3, + 25, + 14, + 12, + 12, + 31, + 6, + 18, + 14, + 3, + 12, + 53, + 11, + 22, + 3, + 8, + 10, + 5, + 8, + 33, + 15, + 6, + 2, + 13, + 7, + 12, + 15, + 16, + 5, + 17, + 11, + 19, + 10, + 26, + 23, + 20, + 9, + 26, + 23, + 19, + 16, + 1 + ], + "weighted_loads": [ + 0.7638712674379349, + 0.5084399096667767, + 0.3235501078888774, + 0.09997307322919369, + 0.5333351455628872, + 3.064236279577017, + 0.23630085587501526, + 0.45536670833826065, + 0.7596395425498486, + 0.5776601042598486, + 0.578946053981781, + 1.101375225931406, + 0.3691372275352478, + 1.076814966276288, + 1.7284290418028831, + 0.6900399178266525, + 0.828387513756752, + 0.7601695396006107, + 1.083723772317171, + 4.352614125236869, + 0.21270069479942322, + 0.3084235265851021, + 0.12495705485343933, + 1.562013752758503, + 0.9858496524393559, + 1.3420042041689157, + 0.8927934691309929, + 1.9064043518155813, + 0.296200105920434, + 1.3034801483154297, + 0.9549427069723606, + 0.10127014108002186, + 1.0751979313790798, + 3.313241794705391, + 0.7745544239878654, + 1.4462369121611118, + 0.11324933357536793, + 0.3613663576543331, + 0.6918391957879066, + 0.17155303247272968, + 0.38215163350105286, + 2.3895450942218304, + 1.1324108392000198, + 0.2336525171995163, + 0.14353502541780472, + 0.5892666429281235, + 0.38886435329914093, + 0.749143959954381, + 1.0159765109419823, + 0.8191435225307941, + 0.28028983250260353, + 1.031411912292242, + 0.6013308428227901, + 1.2616786062717438, + 0.7177278064191341, + 1.8573313280940056, + 1.5633085649460554, + 1.4669390805065632, + 0.4381492957472801, + 1.5294439308345318, + 1.6174814850091934, + 1.603799406439066, + 0.9995825663208961, + 0.03558279946446419 + ], + "unique_experts": 64, + "load_cv": 0.7419539610823641, + "normalized_load_entropy": 0.9446501228848057, + "max_load_share": 0.06493506493506493 + } + }, + "s0_period": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "6246b6d01ddf90740afda8fa88dc62996db7a919822334d491cb1b26832f0431", + "route_weight_sha256": "bd4c0b21305595b3b1c7cbb17b3cd892552fdade2b85f467f55c1abef6999cd8", + "loads": [ + 11, + 11, + 6, + 2, + 5, + 34, + 6, + 6, + 9, + 9, + 14, + 15, + 4, + 12, + 21, + 11, + 11, + 6, + 12, + 58, + 2, + 4, + 3, + 25, + 13, + 9, + 11, + 14, + 5, + 15, + 6, + 3, + 8, + 32, + 8, + 20, + 0, + 5, + 9, + 3, + 7, + 18, + 14, + 8, + 0, + 4, + 2, + 9, + 7, + 11, + 0, + 4, + 10, + 15, + 10, + 15, + 21, + 12, + 9, + 7, + 14, + 6, + 17, + 0 + ], + "weighted_loads": [ + 0.6779155731201172, + 0.5390140414237976, + 0.301670802757144, + 0.07135829143226147, + 0.23827063106000423, + 3.083126410841942, + 0.27040474861860275, + 0.29071126878261566, + 0.6856319755315781, + 0.5811275541782379, + 0.6551112234592438, + 0.9208270907402039, + 0.16911553964018822, + 0.6086516231298447, + 1.4788947440683842, + 0.6719607785344124, + 0.8810550197958946, + 0.4134144261479378, + 0.7203638404607773, + 4.350620340555906, + 0.1252772957086563, + 0.2472144477069378, + 0.13454055413603783, + 1.573528353124857, + 0.9368532560765743, + 1.0406563505530357, + 0.8588255196809769, + 0.7642356585711241, + 0.3146544620394707, + 1.177488025277853, + 0.2936960868537426, + 0.13208486512303352, + 0.6387103646993637, + 2.3998287990689278, + 0.5813428945839405, + 1.2826013565063477, + 0.0, + 0.23999077454209328, + 0.6586737558245659, + 0.11335509642958641, + 0.36617404967546463, + 1.162541702389717, + 1.1542234532535076, + 0.3227428775280714, + 0.0, + 0.15387577190995216, + 0.06234603747725487, + 0.6148612983524799, + 0.35466695576906204, + 0.5977358557283878, + 0.0, + 0.20353557169437408, + 0.5448291804641485, + 1.0810825116932392, + 0.7245469614863396, + 1.1387089379131794, + 1.4567452799528837, + 1.0175139904022217, + 0.44135382771492004, + 0.31360963732004166, + 0.9984513372182846, + 0.418474018573761, + 1.0605031736195087, + 0.0 + ], + "unique_experts": 60, + "load_cv": 0.8599363968286343, + "normalized_load_entropy": 0.9268825214115761, + "max_load_share": 0.0855457227138643 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "9f393f4750f3b28a70b6e598aed466deae1e2166fbae6b95129e6cf8536c8d70", + "route_weight_sha256": "34920765bbffa9c0391fc2c1811a3fdc71591e3f1552a347202ee937f915bb16", + "loads": [ + 12, + 11, + 7, + 2, + 6, + 34, + 6, + 10, + 9, + 10, + 16, + 17, + 5, + 14, + 23, + 11, + 11, + 9, + 17, + 60, + 6, + 6, + 3, + 25, + 13, + 11, + 11, + 20, + 6, + 16, + 10, + 4, + 8, + 40, + 9, + 21, + 0, + 5, + 9, + 3, + 7, + 28, + 17, + 10, + 3, + 8, + 8, + 12, + 7, + 14, + 3, + 11, + 10, + 17, + 10, + 24, + 21, + 19, + 9, + 18, + 20, + 19, + 17, + 0 + ], + "weighted_loads": [ + 0.7112540118396282, + 0.5390140414237976, + 0.31582143995910883, + 0.07135829143226147, + 0.27051798067986965, + 3.083126410841942, + 0.27040474861860275, + 0.4671746529638767, + 0.6856319755315781, + 0.5973531622439623, + 0.750551275908947, + 1.0233502425253391, + 0.20183758810162544, + 1.1125648580491543, + 1.6374559290707111, + 0.6719607785344124, + 0.8810550197958946, + 0.6659762375056744, + 1.060750126838684, + 4.462305676192045, + 0.29054244607686996, + 0.33092591539025307, + 0.13454055413603783, + 1.573528353124857, + 0.9368532560765743, + 1.1042019296437502, + 0.8588255196809769, + 1.4338417258113623, + 0.3610733300447464, + 1.2202490270137787, + 0.616232767701149, + 0.14586147479712963, + 0.6387103646993637, + 2.7634001709520817, + 0.6111667305231094, + 1.31949907168746, + 0.0, + 0.23999077454209328, + 0.6586737558245659, + 0.11335509642958641, + 0.36617404967546463, + 2.2045607678592205, + 1.259177753701806, + 0.42032831348478794, + 0.1670902594923973, + 0.3432583771646023, + 0.333942249417305, + 0.742656646296382, + 0.35466695576906204, + 0.7398306503891945, + 0.1327262558043003, + 0.5952351130545139, + 0.5448291804641485, + 1.2017512395977974, + 0.7245469614863396, + 1.7635826505720615, + 1.4567452799528837, + 1.4415610991418362, + 0.44135382771492004, + 1.01907454803586, + 1.3810410760343075, + 1.6524226516485214, + 1.0605031736195087, + 0.0 + ], + "unique_experts": 62, + "load_cv": 0.7513746960166355, + "normalized_load_entropy": 0.9420517579327076, + "max_load_share": 0.07246376811594203 + } + }, + "s1_period": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "60bfbcc4c8fd0d95187d26ee9fffec40bbe1aae445a007aff7515659f74c0062", + "route_weight_sha256": "fa82e5a6f2b8ff4511b48e4895c19f1d33d03cc3be3da3d2c15128646f96632e", + "loads": [ + 12, + 10, + 6, + 3, + 5, + 37, + 5, + 7, + 13, + 9, + 9, + 14, + 3, + 12, + 21, + 12, + 10, + 6, + 13, + 57, + 3, + 5, + 4, + 25, + 13, + 9, + 11, + 13, + 5, + 15, + 5, + 2, + 7, + 36, + 8, + 21, + 0, + 5, + 9, + 5, + 7, + 17, + 13, + 3, + 0, + 6, + 1, + 7, + 7, + 12, + 0, + 4, + 10, + 15, + 11, + 14, + 21, + 12, + 10, + 7, + 13, + 7, + 16, + 0 + ], + "weighted_loads": [ + 0.7159565910696983, + 0.5022943168878555, + 0.30056553333997726, + 0.09825088270008564, + 0.2372027039527893, + 3.137226365506649, + 0.2334914356470108, + 0.3164300248026848, + 0.8136249929666519, + 0.5646794177591801, + 0.4415724612772465, + 0.8805082254111767, + 0.12891097739338875, + 0.6035246960818768, + 1.4440840408205986, + 0.6925224028527737, + 0.8283985815942287, + 0.43607043102383614, + 0.7812062464654446, + 4.288698587566614, + 0.15259819850325584, + 0.2727534119039774, + 0.16771872527897358, + 1.5499414689838886, + 0.9410322979092598, + 1.018476165831089, + 0.8556598275899887, + 0.7143149524927139, + 0.33445268496870995, + 1.18114298209548, + 0.2399577833712101, + 0.09020133316516876, + 0.5869273096323013, + 2.4297655038535595, + 0.5895446948707104, + 1.3240301050245762, + 0.0, + 0.2364494651556015, + 0.6628145277500153, + 0.18013433180749416, + 0.3411203734576702, + 1.0958626791834831, + 1.0914880707859993, + 0.12749889865517616, + 0.0, + 0.23811695352196693, + 0.042054057121276855, + 0.5408661589026451, + 0.3677189126610756, + 0.6166657581925392, + 0.0, + 0.21907328441739082, + 0.5436645969748497, + 1.0586881302297115, + 0.7642869912087917, + 1.0561062172055244, + 1.4821650311350822, + 1.0258605293929577, + 0.4787490740418434, + 0.315236359834671, + 0.9085541814565659, + 0.45615404099226, + 1.0146004781126976, + 0.0 + ], + "unique_experts": 60, + "load_cv": 0.8774063433701951, + "normalized_load_entropy": 0.9247840371713556, + "max_load_share": 0.084070796460177 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "0c2380f58486d8884d426726e98921f086a9f46ea049db5d277e1d9fd3e85e77", + "route_weight_sha256": "cbda3588cee0b85485acef8cf2572bf6f67cbe54027711938aa468e1d99e9b1b", + "loads": [ + 12, + 11, + 8, + 4, + 10, + 37, + 5, + 9, + 13, + 10, + 12, + 18, + 7, + 13, + 25, + 12, + 10, + 11, + 17, + 58, + 4, + 6, + 4, + 25, + 14, + 12, + 12, + 31, + 5, + 18, + 15, + 3, + 12, + 53, + 10, + 23, + 3, + 8, + 10, + 5, + 8, + 34, + 15, + 5, + 2, + 12, + 6, + 11, + 15, + 15, + 4, + 18, + 11, + 19, + 11, + 25, + 22, + 20, + 10, + 26, + 24, + 19, + 16, + 1 + ], + "weighted_loads": [ + 0.7159565910696983, + 0.536544930189848, + 0.35499448981136084, + 0.15467547066509724, + 0.4968842640519142, + 3.137226365506649, + 0.2334914356470108, + 0.40278230980038643, + 0.8136249929666519, + 0.5809050258249044, + 0.5575199462473392, + 1.098873034119606, + 0.3282085321843624, + 1.0726232938468456, + 1.7153183221817017, + 0.6925224028527737, + 0.8283985815942287, + 0.8100170604884624, + 1.1113069877028465, + 4.318814292550087, + 0.19275889173150063, + 0.3222165163606405, + 0.16771872527897358, + 1.5499414689838886, + 0.9823619835078716, + 1.3449574429541826, + 0.8976374641060829, + 1.9173343926668167, + 0.33445268496870995, + 1.3134358786046505, + 1.0470680333673954, + 0.10397794283926487, + 1.0749609544873238, + 3.264480046927929, + 0.7325523681938648, + 1.4894873201847076, + 0.11324933357536793, + 0.3650183938443661, + 0.6987839117646217, + 0.18013433180749416, + 0.3834599368274212, + 2.448925018310547, + 1.1372966840863228, + 0.1959364078938961, + 0.14353502541780472, + 0.5274401344358921, + 0.32472269237041473, + 0.707827040925622, + 1.0174706652760506, + 0.7768145203590393, + 0.24727822467684746, + 1.1280598193407059, + 0.6131273582577705, + 1.2520137801766396, + 0.7642869912087917, + 1.833800669759512, + 1.5544265136122704, + 1.549158338457346, + 0.4787490740418434, + 1.5031606182456017, + 1.6572118625044823, + 1.5794510506093502, + 1.0146004781126976, + 0.03558279946446419 + ], + "unique_experts": 64, + "load_cv": 0.7410441149588947, + "normalized_load_entropy": 0.9443290465229598, + "max_load_share": 0.06277056277056277 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 113, + "ordered_topk_exact_tokens": 78, + "set_exact_tokens": 89, + "mean_set_jaccard": 0.9374209860935525, + "mean_token_weighted_tv": 0.012970006612615775, + "aggregate_load_tv": 0.028023598820059 + }, + "system_bos": { + "tokens": 113, + "ordered_topk_exact_tokens": 66, + "set_exact_tokens": 78, + "mean_set_jaccard": 0.911504424778761, + "mean_token_weighted_tv": 0.018721727085654186, + "aggregate_load_tv": 0.029498525073746312 + }, + "system_x": { + "tokens": 113, + "ordered_topk_exact_tokens": 52, + "set_exact_tokens": 72, + "mean_set_jaccard": 0.8887484197218712, + "mean_token_weighted_tv": 0.025923009516786687, + "aggregate_load_tv": 0.0368731563421829 + }, + "system_period": { + "tokens": 113, + "ordered_topk_exact_tokens": 56, + "set_exact_tokens": 69, + "mean_set_jaccard": 0.8830594184576486, + "mean_token_weighted_tv": 0.026076982861005626, + "aggregate_load_tv": 0.04129793510324484 + }, + "bos_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 66, + "set_exact_tokens": 81, + "mean_set_jaccard": 0.9190897597977244, + "mean_token_weighted_tv": 0.019308793284328638, + "aggregate_load_tv": 0.03687315634218288 + }, + "bos_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 57, + "set_exact_tokens": 73, + "mean_set_jaccard": 0.8969658659924147, + "mean_token_weighted_tv": 0.02335464992288467, + "aggregate_load_tv": 0.03982300884955752 + }, + "x_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 70, + "set_exact_tokens": 87, + "mean_set_jaccard": 0.934260429835651, + "mean_token_weighted_tv": 0.017431594629203323, + "aggregate_load_tv": 0.023598820058997053 + }, + "x_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 46, + "set_exact_tokens": 67, + "mean_set_jaccard": 0.8780025284450064, + "mean_token_weighted_tv": 0.028090034347785786, + "aggregate_load_tv": 0.04277286135693216 + }, + "period_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 65, + "set_exact_tokens": 85, + "mean_set_jaccard": 0.927307206068268, + "mean_token_weighted_tv": 0.01806223834246661, + "aggregate_load_tv": 0.026548672566371685 + }, + "period_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 53, + "set_exact_tokens": 69, + "mean_set_jaccard": 0.8849557522123895, + "mean_token_weighted_tv": 0.026764698788128066, + "aggregate_load_tv": 0.04424778761061947 + } + } + }, + "layer_11": { + "layer": 11, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "f569ba6e8cfe238d384a487794e180857a7886d37eebfd5a96c69443399e5ba6", + "route_weight_sha256": "ba263a2920e5a33b3c0fa40513d346ac4f597db64e9f1adb785349443fe5bc01", + "loads": [ + 9, + 11, + 12, + 6, + 13, + 3, + 7, + 1, + 12, + 7, + 7, + 8, + 6, + 14, + 2, + 12, + 9, + 18, + 2, + 16, + 14, + 13, + 13, + 9, + 9, + 5, + 12, + 11, + 4, + 3, + 0, + 13, + 6, + 36, + 21, + 12, + 14, + 1, + 13, + 6, + 21, + 38, + 9, + 4, + 13, + 6, + 12, + 6, + 12, + 15, + 17, + 9, + 18, + 0, + 2, + 13, + 6, + 9, + 4, + 21, + 27, + 13, + 13, + 0 + ], + "weighted_loads": [ + 0.5452217161655426, + 0.5745788551867008, + 0.8666536808013916, + 0.2625165395438671, + 0.8105362057685852, + 0.16075067222118378, + 0.47457049414515495, + 0.10170896351337433, + 0.8275441378355026, + 0.25999701023101807, + 0.3665805757045746, + 0.4072125144302845, + 0.21673712879419327, + 0.9366390593349934, + 0.06647331640124321, + 0.6345595363527536, + 0.4360719732940197, + 0.7334641981869936, + 0.07313431054353714, + 0.8754462338984013, + 0.8464730866253376, + 0.957587044686079, + 0.7282353825867176, + 0.6215967163443565, + 0.41239284351468086, + 0.252555925399065, + 0.5438171941787004, + 0.5421699583530426, + 0.22462986409664154, + 0.15544601902365685, + 0.0, + 1.6339779011905193, + 0.245444405823946, + 2.7853749692440033, + 1.5542614832520485, + 0.9180498383939266, + 0.9313388355076313, + 0.027268828824162483, + 0.597539521753788, + 0.25675916858017445, + 1.6626920476555824, + 2.4708259031176567, + 0.4455612786114216, + 0.19562023878097534, + 1.655762828886509, + 0.21745665185153484, + 0.7107751704752445, + 0.3849397264420986, + 0.6615470349788666, + 1.3068951703608036, + 1.0095007307827473, + 1.047146949917078, + 1.176844384521246, + 0.0, + 0.06973643787205219, + 0.5708836130797863, + 0.3628488518297672, + 0.42380794882774353, + 0.1660480536520481, + 1.8971427008509636, + 1.4766536988317966, + 0.6997247748076916, + 0.7511755153536797, + 0.0 + ], + "unique_experts": 61, + "load_cv": 0.7001970641765374, + "normalized_load_entropy": 0.9418361874582664, + "max_load_share": 0.05604719764011799 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "751cbd60e813e34db3ff92a44f9128bf57b21f7c21ffcd89f884f18ff517dc04", + "route_weight_sha256": "f1dd8ae201c39115a039ea7f6c163685b02a59151eea7335c60425b58c4b0f50", + "loads": [ + 9, + 12, + 13, + 6, + 17, + 3, + 7, + 1, + 16, + 9, + 10, + 11, + 6, + 14, + 2, + 18, + 15, + 20, + 14, + 16, + 14, + 13, + 14, + 14, + 9, + 6, + 13, + 12, + 10, + 3, + 6, + 20, + 8, + 36, + 25, + 15, + 14, + 1, + 13, + 6, + 27, + 38, + 9, + 26, + 16, + 6, + 12, + 14, + 12, + 17, + 17, + 10, + 18, + 0, + 8, + 18, + 6, + 9, + 7, + 22, + 27, + 17, + 21, + 0 + ], + "weighted_loads": [ + 0.5452217161655426, + 0.6079163625836372, + 0.925380278378725, + 0.2625165395438671, + 1.0082122050225735, + 0.16075067222118378, + 0.47457049414515495, + 0.10170896351337433, + 1.084361720830202, + 0.3181065134704113, + 0.43921150639653206, + 0.46117025800049305, + 0.21673712879419327, + 0.9366390593349934, + 0.06647331640124321, + 0.8633959423750639, + 1.0178073607385159, + 0.7633755216374993, + 2.142073653638363, + 0.8754462338984013, + 0.8464730866253376, + 0.957587044686079, + 0.7321806997060776, + 0.8721589110791683, + 0.41239284351468086, + 0.35268722102046013, + 0.5471883772406727, + 0.5547699183225632, + 0.642209853976965, + 0.15544601902365685, + 0.29325506649911404, + 1.9523523077368736, + 0.31262417510151863, + 2.7853749692440033, + 1.720641978085041, + 1.217430468648672, + 0.9313388355076313, + 0.027268828824162483, + 0.597539521753788, + 0.25675916858017445, + 1.979866862297058, + 2.4708259031176567, + 0.4455612786114216, + 2.3302236162126064, + 1.819233451038599, + 0.21745665185153484, + 0.7107751704752445, + 0.9952860474586487, + 0.6615470349788666, + 1.4026677943766117, + 1.0095007307827473, + 1.147384125739336, + 1.176844384521246, + 0.0, + 0.38832040317356586, + 0.7855989672243595, + 0.3628488518297672, + 0.42380794882774353, + 0.30318134650588036, + 1.9368562288582325, + 1.4766536988317966, + 0.8773432541638613, + 1.2406844906508923, + 0.0 + ], + "unique_experts": 62, + "load_cv": 0.5963591527528443, + "normalized_load_entropy": 0.9550487588323694, + "max_load_share": 0.04589371980676329 + } + }, + "s1_eos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "5ea0ba193549c3f522eb35a3b230a3a0ea6cb7d710befd363682408bd81cfbf6", + "route_weight_sha256": "e2b7f081a3b7a6f4891d111a5b70ece6125c022c9fb7443ed7e5ea7855b6612d", + "loads": [ + 11, + 11, + 12, + 7, + 13, + 3, + 8, + 1, + 12, + 6, + 8, + 8, + 5, + 14, + 3, + 14, + 9, + 17, + 2, + 16, + 13, + 14, + 12, + 9, + 9, + 5, + 10, + 11, + 4, + 3, + 0, + 13, + 6, + 35, + 20, + 11, + 13, + 0, + 12, + 6, + 21, + 38, + 8, + 4, + 13, + 6, + 13, + 6, + 12, + 15, + 17, + 9, + 18, + 0, + 1, + 15, + 6, + 10, + 4, + 21, + 28, + 14, + 13, + 0 + ], + "weighted_loads": [ + 0.6187312919646502, + 0.5735314376652241, + 0.8441456072032452, + 0.31026728078722954, + 0.8275060541927814, + 0.16164352372288704, + 0.518216896802187, + 0.10134657472372055, + 0.8211480155587196, + 0.22902203537523746, + 0.4006691873073578, + 0.41871941462159157, + 0.18745818734169006, + 0.9417894706130028, + 0.09925394505262375, + 0.6801284197717905, + 0.41664859279990196, + 0.7011655420064926, + 0.07303105294704437, + 0.9066048059612513, + 0.8019127659499645, + 0.9920951426029205, + 0.7055571582168341, + 0.6255751177668571, + 0.4093790054321289, + 0.2491618786007166, + 0.45131603069603443, + 0.5428114347159863, + 0.2152954526245594, + 0.17033061012625694, + 0.0, + 1.619294460862875, + 0.24854148924350739, + 2.709008540958166, + 1.4919220469892025, + 0.8822726272046566, + 0.8934696093201637, + 0.0, + 0.553746473044157, + 0.25069576129317284, + 1.6680064052343369, + 2.4835611283779144, + 0.40955791994929314, + 0.19703255593776703, + 1.6441722512245178, + 0.22094234265387058, + 0.7363403346389532, + 0.3859739527106285, + 0.6664654072374105, + 1.3161896839737892, + 1.0112063754349947, + 1.0436263233423233, + 1.178492221981287, + 0.0, + 0.04152107238769531, + 0.6418528519570827, + 0.36479736492037773, + 0.4545953404158354, + 0.16681377217173576, + 1.889679066836834, + 1.4698905311524868, + 0.7523521017283201, + 0.726976877078414, + 0.0 + ], + "unique_experts": 60, + "load_cv": 0.6988038090929548, + "normalized_load_entropy": 0.940748341641824, + "max_load_share": 0.05604719764011799 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "d937ea6fd271dc2a2cfdf525ebfc158015bb40072b9a04f06050a59e862c917d", + "route_weight_sha256": "ba76d64674b593d7a28be65d32ed4a5d5383171534ad8f8276d5527e54796570", + "loads": [ + 13, + 12, + 13, + 7, + 24, + 7, + 8, + 3, + 22, + 6, + 12, + 11, + 5, + 14, + 3, + 15, + 26, + 19, + 13, + 17, + 14, + 15, + 15, + 14, + 9, + 7, + 13, + 13, + 14, + 3, + 8, + 20, + 6, + 35, + 25, + 16, + 13, + 0, + 12, + 7, + 28, + 38, + 8, + 31, + 15, + 6, + 14, + 19, + 12, + 18, + 17, + 10, + 18, + 5, + 20, + 26, + 12, + 11, + 6, + 25, + 29, + 22, + 24, + 1 + ], + "weighted_loads": [ + 0.7668782267719507, + 0.6061463914811611, + 0.8931396715342999, + 0.31026728078722954, + 1.408820018172264, + 0.29896536469459534, + 0.518216896802187, + 0.2307860553264618, + 1.4388052597641945, + 0.22902203537523746, + 0.514993651304394, + 0.47191001288592815, + 0.18745818734169006, + 0.9417894706130028, + 0.09925394505262375, + 0.7199479695409536, + 2.0007844902575016, + 0.7302591968327761, + 2.1300984621047974, + 0.9452262837439775, + 0.8752023167908192, + 1.0636801645159721, + 0.8186092982068658, + 0.8475331328809261, + 0.4093790054321289, + 0.36771312169730663, + 0.529850299237296, + 0.5946830995380878, + 0.9418963901698589, + 0.17033061012625694, + 0.40727002918720245, + 1.9267430789768696, + 0.24854148924350739, + 2.709008540958166, + 1.7136149741709232, + 1.383968535810709, + 0.8934696093201637, + 0.0, + 0.553746473044157, + 0.29765158519148827, + 2.00694103166461, + 2.4835611283779144, + 0.40955791994929314, + 2.669618584215641, + 1.778093047440052, + 0.22094234265387058, + 0.7826799917966127, + 1.3994589745998383, + 0.6664654072374105, + 1.534649707376957, + 1.0112063754349947, + 1.1384004801511765, + 1.178492221981287, + 0.3026953712105751, + 1.2156538516283035, + 1.1566739231348038, + 0.8342693448066711, + 0.49709864519536495, + 0.26865051686763763, + 2.0556755624711514, + 1.5083685368299484, + 1.1128861214965582, + 1.303236985579133, + 0.04126733914017677 + ], + "unique_experts": 63, + "load_cv": 0.5669343138492422, + "normalized_load_entropy": 0.9599673173913618, + "max_load_share": 0.04112554112554113 + } + }, + "s0_bos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "d22f44197633f71d302d146e509d40ddad423574f7cb761e9c95d63abe1f277d", + "route_weight_sha256": "4ffda4b5b46ed88c0c8fa87e1e19177b0f0126d4285d8f7bc07de219db9abacb", + "loads": [ + 11, + 10, + 13, + 6, + 13, + 3, + 7, + 1, + 12, + 6, + 7, + 9, + 6, + 13, + 3, + 12, + 9, + 18, + 2, + 16, + 13, + 13, + 13, + 9, + 15, + 5, + 11, + 11, + 4, + 3, + 0, + 13, + 5, + 37, + 20, + 11, + 13, + 1, + 12, + 6, + 23, + 39, + 9, + 4, + 13, + 4, + 11, + 6, + 11, + 15, + 17, + 9, + 19, + 0, + 1, + 11, + 7, + 8, + 5, + 21, + 28, + 12, + 13, + 0 + ], + "weighted_loads": [ + 0.624966699630022, + 0.5445742830634117, + 0.9101826064288616, + 0.263886995613575, + 0.821196012198925, + 0.1679331213235855, + 0.48102133721113205, + 0.10367902368307114, + 0.8316140547394753, + 0.21268513798713684, + 0.37270740792155266, + 0.4620332159101963, + 0.21900513395667076, + 0.9026755094528198, + 0.09667197801172733, + 0.6704506166279316, + 0.4503762386739254, + 0.7424321416765451, + 0.07858362793922424, + 0.8710836805403233, + 0.807519219815731, + 0.9599716439843178, + 0.7257448621094227, + 0.6205665245652199, + 0.6075770147144794, + 0.2653708029538393, + 0.5077282749116421, + 0.5471224784851074, + 0.2343733124434948, + 0.12598769553005695, + 0.0, + 1.651712141931057, + 0.20749356970191002, + 2.8018020167946815, + 1.4788000229746103, + 0.8660085760056973, + 0.9112282246351242, + 0.026490619406104088, + 0.5448663532733917, + 0.25525184348225594, + 1.7424429897218943, + 2.474969470873475, + 0.41890471056103706, + 0.19900179654359818, + 1.6883946657180786, + 0.1599748358130455, + 0.6845278218388557, + 0.3849467672407627, + 0.628869891166687, + 1.3150581903755665, + 1.0148229487240314, + 1.0190240144729614, + 1.2151392847299576, + 0.0, + 0.04660545662045479, + 0.4788508974015713, + 0.409291572868824, + 0.37568100541830063, + 0.19748110696673393, + 1.9175292737782001, + 1.5062940008938313, + 0.6810747478157282, + 0.7256792224943638, + 0.0 + ], + "unique_experts": 61, + "load_cv": 0.7184510971608776, + "normalized_load_entropy": 0.939784435853531, + "max_load_share": 0.05752212389380531 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "5271dc438d279e1aab5463178312f5e2b806a6eed3ec517d11666e258da300b8", + "route_weight_sha256": "ead00e148619edc57608369f971ffa668d07c6fe31f9d024bc9b4c969650b04b", + "loads": [ + 11, + 11, + 14, + 6, + 17, + 3, + 7, + 1, + 16, + 9, + 9, + 11, + 6, + 13, + 3, + 19, + 15, + 19, + 13, + 16, + 13, + 13, + 13, + 14, + 15, + 6, + 11, + 13, + 10, + 3, + 6, + 20, + 7, + 37, + 24, + 14, + 13, + 1, + 12, + 6, + 30, + 39, + 9, + 27, + 16, + 4, + 11, + 14, + 11, + 17, + 17, + 10, + 19, + 0, + 6, + 15, + 7, + 8, + 8, + 22, + 28, + 18, + 22, + 0 + ], + "weighted_loads": [ + 0.624966699630022, + 0.5779117904603481, + 0.9689092040061951, + 0.263886995613575, + 1.0188720114529133, + 0.1679331213235855, + 0.48102133721113205, + 0.10367902368307114, + 1.089145664125681, + 0.3068477660417557, + 0.4401847533881664, + 0.5038371346890926, + 0.21900513395667076, + 0.9026755094528198, + 0.09667197801172733, + 0.9313894435763359, + 1.0553865171968937, + 0.7572723729535937, + 1.2521617263555527, + 0.8710836805403233, + 0.807519219815731, + 0.9599716439843178, + 0.7257448621094227, + 0.8711287193000317, + 0.6075770147144794, + 0.3663641232997179, + 0.5077282749116421, + 0.604220911860466, + 0.6489458382129669, + 0.12598769553005695, + 0.29325506649911404, + 1.9700865484774113, + 0.27467333897948265, + 2.8018020167946815, + 1.6485798228532076, + 1.169994805008173, + 0.9112282246351242, + 0.026490619406104088, + 0.5448663532733917, + 0.25525184348225594, + 2.1485075186938047, + 2.474969470873475, + 0.41890471056103706, + 2.53300953283906, + 1.8518652878701687, + 0.1599748358130455, + 0.6845278218388557, + 0.9868521653115749, + 0.628869891166687, + 1.4108308143913746, + 1.0148229487240314, + 1.130337730050087, + 1.2151392847299576, + 0.0, + 0.3258390985429287, + 0.6346407830715179, + 0.409291572868824, + 0.37568100541830063, + 0.3346143998205662, + 1.9541367553174496, + 1.5062940008938313, + 0.9528114311397076, + 1.289653204381466, + 0.0 + ], + "unique_experts": 62, + "load_cv": 0.6162214010739513, + "normalized_load_entropy": 0.9531763362944112, + "max_load_share": 0.04710144927536232 + } + }, + "s1_bos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "4dd5bde2ccee9b0034284ef7e6fb814eeef13831d6efeb6006ccd8c59e7108c1", + "route_weight_sha256": "abe5ae60886288ffea48b8068a1165b4fdf71d47905c3a6924df88c517e5f69d", + "loads": [ + 11, + 10, + 13, + 6, + 13, + 3, + 7, + 1, + 12, + 9, + 7, + 8, + 5, + 13, + 2, + 12, + 9, + 17, + 2, + 16, + 14, + 14, + 14, + 9, + 12, + 4, + 11, + 10, + 4, + 2, + 0, + 13, + 6, + 35, + 21, + 11, + 13, + 1, + 10, + 7, + 24, + 39, + 8, + 4, + 13, + 5, + 12, + 6, + 11, + 16, + 17, + 9, + 19, + 1, + 1, + 12, + 6, + 8, + 5, + 21, + 27, + 14, + 13, + 0 + ], + "weighted_loads": [ + 0.6342646963894367, + 0.5312606059014797, + 0.9030870832502842, + 0.26411348208785057, + 0.8131646513938904, + 0.16485105454921722, + 0.4873998500406742, + 0.10079003870487213, + 0.8247618712484837, + 0.31450374238193035, + 0.37009262293577194, + 0.41767580434679985, + 0.1836700662970543, + 0.9205390773713589, + 0.06970202922821045, + 0.6615368537604809, + 0.4322919510304928, + 0.6989286560565233, + 0.07134762033820152, + 0.8999843783676624, + 0.8242417089641094, + 1.0046694688498974, + 0.772957207635045, + 0.6275189183652401, + 0.5106372088193893, + 0.22002984769642353, + 0.5165026392787695, + 0.5120059661567211, + 0.2258184775710106, + 0.10683409124612808, + 0.0, + 1.6279216334223747, + 0.2470153607428074, + 2.666933361440897, + 1.4930066000670195, + 0.8636413663625717, + 0.888894896954298, + 0.026095332577824593, + 0.4621421806514263, + 0.28518445417284966, + 1.7980278264731169, + 2.432186832651496, + 0.380813617259264, + 0.19253677502274513, + 1.68646789342165, + 0.193178229033947, + 0.7171905264258385, + 0.37984225153923035, + 0.6297786198556423, + 1.3532824590802193, + 1.0074510388076305, + 1.0385700277984142, + 1.2202140875160694, + 0.027517816051840782, + 0.04627794027328491, + 0.526226531714201, + 0.37591950967907906, + 0.3912631385028362, + 0.19775860756635666, + 1.916791945695877, + 1.4450801014900208, + 0.7577119674533606, + 0.7151048630475998, + 0.0 + ], + "unique_experts": 62, + "load_cv": 0.7106573667022178, + "normalized_load_entropy": 0.9407154448705654, + "max_load_share": 0.05752212389380531 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "731a6c18163b82848eeadfda77b01bb7cd99905b5861b39c9f0654a1f5e65317", + "route_weight_sha256": "55102cabe846c22fc940836358adecc4766fed7d9c25c1592974de7914fe71d5", + "loads": [ + 13, + 11, + 14, + 6, + 24, + 7, + 7, + 3, + 22, + 10, + 10, + 10, + 5, + 13, + 2, + 15, + 26, + 18, + 12, + 17, + 15, + 15, + 16, + 14, + 12, + 6, + 13, + 12, + 13, + 2, + 8, + 20, + 6, + 35, + 26, + 16, + 13, + 1, + 10, + 8, + 31, + 39, + 8, + 32, + 15, + 5, + 13, + 20, + 11, + 19, + 17, + 10, + 19, + 6, + 20, + 22, + 12, + 9, + 7, + 25, + 28, + 24, + 25, + 1 + ], + "weighted_loads": [ + 0.7824116311967373, + 0.5638755597174168, + 0.9520811475813389, + 0.26411348208785057, + 1.394478615373373, + 0.3021728955209255, + 0.4873998500406742, + 0.23022951930761337, + 1.4490680806338787, + 0.3482091035693884, + 0.4792626090347767, + 0.4594435319304466, + 0.1836700662970543, + 0.9205390773713589, + 0.06970202922821045, + 0.7750720754265785, + 2.0739534609019756, + 0.7137688873335719, + 1.2304494194686413, + 0.9386058561503887, + 0.8975312598049641, + 1.076254490762949, + 0.8822254966944456, + 0.8494769334793091, + 0.5106372088193893, + 0.34757119975984097, + 0.5918619651347399, + 0.5638776309788227, + 0.9221933446824551, + 0.10683409124612808, + 0.40727002918720245, + 1.9353702515363693, + 0.2470153607428074, + 2.666933361440897, + 1.7117070090025663, + 1.3732288032770157, + 0.888894896954298, + 0.026095332577824593, + 0.4621421806514263, + 0.3321402780711651, + 2.1994468215852976, + 2.432186832651496, + 0.380813617259264, + 2.9691508896648884, + 1.8203886896371841, + 0.193178229033947, + 0.763530183583498, + 1.445154558867216, + 0.6297786198556423, + 1.571742482483387, + 1.0074510388076305, + 1.1495711393654346, + 1.2202140875160694, + 0.3302131872624159, + 1.2357654832303524, + 0.988005954772234, + 0.8453914895653725, + 0.4337664432823658, + 0.29959535226225853, + 2.0762481950223446, + 1.4835581071674824, + 1.1966579835861921, + 1.3378165401518345, + 0.04126733914017677 + ], + "unique_experts": 64, + "load_cv": 0.5801350370663592, + "normalized_load_entropy": 0.9588859119729726, + "max_load_share": 0.04220779220779221 + } + }, + "s0_x": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "3e4d991111fbfb2521bf2ef4e7cc9bfdf0770e6bfda91520d4fe00d8f7fa9519", + "route_weight_sha256": "dfcd458826e4bcd0defaf5ebb92487d65683725f1848c084dd817d35f95f0fb9", + "loads": [ + 11, + 10, + 13, + 7, + 13, + 3, + 7, + 1, + 12, + 5, + 8, + 10, + 6, + 13, + 3, + 10, + 9, + 17, + 2, + 16, + 12, + 13, + 14, + 9, + 13, + 4, + 11, + 10, + 4, + 3, + 0, + 13, + 5, + 38, + 20, + 11, + 13, + 1, + 13, + 7, + 23, + 38, + 8, + 5, + 13, + 6, + 12, + 6, + 12, + 15, + 17, + 9, + 18, + 0, + 1, + 11, + 6, + 9, + 5, + 21, + 28, + 11, + 14, + 0 + ], + "weighted_loads": [ + 0.6211899928748608, + 0.5253672823309898, + 0.8975119367241859, + 0.3082200363278389, + 0.8524491004645824, + 0.16592884808778763, + 0.4863918498158455, + 0.10678078234195709, + 0.8235749825835228, + 0.17424430698156357, + 0.4117200542241335, + 0.4873679094016552, + 0.22058606892824173, + 0.8929971344769001, + 0.09772587567567825, + 0.5710889585316181, + 0.4536834917962551, + 0.6978243421763182, + 0.07371391355991364, + 0.8631018064916134, + 0.7743725590407848, + 0.9584144353866577, + 0.7562132123857737, + 0.6201076321303844, + 0.5599810779094696, + 0.20878199115395546, + 0.5164121836423874, + 0.49960771203041077, + 0.22621337324380875, + 0.16562259942293167, + 0.0, + 1.6611684933304787, + 0.21317698806524277, + 2.872825402766466, + 1.5082447081804276, + 0.8490726836025715, + 0.9142251424491405, + 0.028064506128430367, + 0.5946672484278679, + 0.295530341565609, + 1.7808790616691113, + 2.439962200820446, + 0.3790030237287283, + 0.21451513841748238, + 1.698493778705597, + 0.22676950320601463, + 0.7267626505345106, + 0.3778249956667423, + 0.6694601029157639, + 1.3035720810294151, + 1.0478205531835556, + 1.031584583222866, + 1.1796673983335495, + 0.0, + 0.04411016404628754, + 0.4907703399658203, + 0.3639419972896576, + 0.407573439180851, + 0.1947658695280552, + 1.911422822624445, + 1.5108624082058668, + 0.638784121721983, + 0.7823374196887016, + 0.0 + ], + "unique_experts": 61, + "load_cv": 0.7124183898769926, + "normalized_load_entropy": 0.9408276940283045, + "max_load_share": 0.05604719764011799 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "81f69a36d638552bc7d4255fa5a7be2245693b300aeaa34db75151cfd9232ee4", + "route_weight_sha256": "6b65f42a3a57f687947f48955a207a8e9e2cd5d562e216a410634ac7712421e1", + "loads": [ + 11, + 11, + 14, + 7, + 17, + 3, + 7, + 1, + 16, + 7, + 10, + 12, + 6, + 13, + 3, + 16, + 13, + 19, + 14, + 16, + 12, + 13, + 14, + 14, + 13, + 5, + 11, + 11, + 10, + 3, + 6, + 21, + 7, + 38, + 24, + 14, + 13, + 1, + 13, + 7, + 28, + 38, + 8, + 27, + 16, + 6, + 12, + 14, + 12, + 19, + 17, + 10, + 18, + 1, + 6, + 17, + 6, + 9, + 9, + 22, + 28, + 16, + 23, + 0 + ], + "weighted_loads": [ + 0.6211899928748608, + 0.5587047897279263, + 0.9562385343015194, + 0.3082200363278389, + 1.0501250997185707, + 0.16592884808778763, + 0.4863918498158455, + 0.10678078234195709, + 1.0840371884405613, + 0.2323538102209568, + 0.47919739969074726, + 0.5291718281805515, + 0.22058606892824173, + 0.8929971344769001, + 0.09772587567567825, + 0.7999253645539284, + 0.9349433518946171, + 0.7477057678624988, + 1.3374889194965363, + 0.8631018064916134, + 0.7743725590407848, + 0.9584144353866577, + 0.7562132123857737, + 0.8706698268651962, + 0.5599810779094696, + 0.2973279841244221, + 0.5164121836423874, + 0.5122076719999313, + 0.6514872461557388, + 0.16562259942293167, + 0.29325506649911404, + 2.028781022876501, + 0.2803567573428154, + 2.872825402766466, + 1.7127686366438866, + 1.1328924857079983, + 0.9142251424491405, + 0.028064506128430367, + 0.5946672484278679, + 0.295530341565609, + 2.0636861510574818, + 2.439962200820446, + 0.3790030237287283, + 2.2456631176173687, + 1.861964400857687, + 0.22676950320601463, + 0.7267626505345106, + 0.980003897100687, + 0.6694601029157639, + 1.4901786856353283, + 1.0478205531835556, + 1.1337203979492188, + 1.1796673983335495, + 0.054990898817777634, + 0.3325299955904484, + 0.7540313377976418, + 0.3639419972896576, + 0.407573439180851, + 0.3921099528670311, + 1.9476002641022205, + 1.5108624082058668, + 0.8778533395379782, + 1.3040953800082207, + 0.0 + ], + "unique_experts": 63, + "load_cv": 0.6073714604896193, + "normalized_load_entropy": 0.9551652151346316, + "max_load_share": 0.04589371980676329 + } + }, + "s1_x": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "6cbc980b05a93480e85caa58c658bf3a9d13b5806c55778687f0b19ccf410dc8", + "route_weight_sha256": "8477abe511bba319d88bfdb89a95c7b03e0aa120a2822402c6b57e8decb68a47", + "loads": [ + 10, + 10, + 13, + 5, + 15, + 3, + 7, + 1, + 12, + 8, + 7, + 9, + 6, + 13, + 3, + 11, + 8, + 14, + 2, + 16, + 14, + 14, + 14, + 9, + 14, + 4, + 11, + 10, + 4, + 2, + 0, + 13, + 6, + 35, + 21, + 12, + 13, + 0, + 11, + 7, + 24, + 38, + 8, + 5, + 13, + 5, + 13, + 7, + 11, + 15, + 17, + 9, + 19, + 1, + 1, + 11, + 5, + 8, + 5, + 21, + 28, + 12, + 15, + 0 + ], + "weighted_loads": [ + 0.5925728157162666, + 0.5181953758001328, + 0.8845669068396091, + 0.2173255980014801, + 0.9056285973638296, + 0.1608944572508335, + 0.48650482669472694, + 0.10152118653059006, + 0.8300282247364521, + 0.28984787687659264, + 0.37854788452386856, + 0.4417881853878498, + 0.20925897918641567, + 0.9081636518239975, + 0.10414297133684158, + 0.6271641813218594, + 0.36601391434669495, + 0.5593294445425272, + 0.07298365980386734, + 0.8900920003652573, + 0.8383970055729151, + 0.9816505387425423, + 0.7629358060657978, + 0.6165577061474323, + 0.5865098014473915, + 0.19172901660203934, + 0.526233471930027, + 0.49856559559702873, + 0.2178131751716137, + 0.09536127373576164, + 0.0, + 1.6057534217834473, + 0.2541215531527996, + 2.6428430695086718, + 1.47799489274621, + 0.8921046480536461, + 0.8850981332361698, + 0.0, + 0.5119662061333656, + 0.28707359731197357, + 1.8044634908437729, + 2.401093700900674, + 0.3722533565014601, + 0.20903225243091583, + 1.6924617886543274, + 0.19410912692546844, + 0.7612072862684727, + 0.41899893805384636, + 0.6393488645553589, + 1.3179655484855175, + 1.0195659026503563, + 1.0221534259617329, + 1.2007658518850803, + 0.030308814719319344, + 0.03886999562382698, + 0.48910312727093697, + 0.32637402042746544, + 0.38787636533379555, + 0.1985812932252884, + 1.8975756205618382, + 1.4601828008890152, + 0.6804357431828976, + 0.832637645304203, + 0.0 + ], + "unique_experts": 61, + "load_cv": 0.707319027192558, + "normalized_load_entropy": 0.9404385468912055, + "max_load_share": 0.05604719764011799 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "2ef585644a598e931cb44abed915ea7c2f2d3da9aa7ac0fb7d2d7e25ea5cb1e7", + "route_weight_sha256": "ffe21da33a663d56932f054a56d1b71b09df9baa775121995b1602aae698df2e", + "loads": [ + 12, + 11, + 14, + 5, + 26, + 7, + 7, + 3, + 22, + 8, + 10, + 11, + 6, + 13, + 3, + 12, + 24, + 15, + 13, + 17, + 15, + 15, + 16, + 14, + 14, + 6, + 13, + 13, + 14, + 2, + 8, + 21, + 6, + 35, + 26, + 17, + 13, + 0, + 11, + 8, + 30, + 38, + 8, + 32, + 15, + 5, + 14, + 19, + 11, + 20, + 17, + 10, + 19, + 7, + 21, + 23, + 11, + 9, + 8, + 24, + 29, + 20, + 27, + 1 + ], + "weighted_loads": [ + 0.7407197505235672, + 0.5508103296160698, + 0.9335609711706638, + 0.2173255980014801, + 1.4869425613433123, + 0.2982162982225418, + 0.48650482669472694, + 0.2309606671333313, + 1.4580900333821774, + 0.28984787687659264, + 0.4877178706228733, + 0.4835559129714966, + 0.20925897918641567, + 0.9081636518239975, + 0.10414297133684158, + 0.6669837310910225, + 1.8953743316233158, + 0.5741696758195758, + 1.308908835053444, + 0.9287134781479836, + 0.9116865564137697, + 1.0532355606555939, + 0.8722040951251984, + 0.8385157212615013, + 0.5865098014473915, + 0.2891796790063381, + 0.6015927977859974, + 0.5946205221116543, + 0.9683920927345753, + 0.09536127373576164, + 0.40727002918720245, + 1.962897788733244, + 0.2541215531527996, + 2.6428430695086718, + 1.7253931164741516, + 1.3612329363822937, + 0.8850981332361698, + 0.0, + 0.5119662061333656, + 0.334029421210289, + 2.089325789362192, + 2.401093700900674, + 0.3722533565014601, + 2.535295072942972, + 1.8263825848698616, + 0.19410912692546844, + 0.8075469434261322, + 1.3648945204913616, + 0.6393488645553589, + 1.6211680807173252, + 1.0195659026503563, + 1.1164102964103222, + 1.2007658518850803, + 0.38556049205362797, + 1.2280321065336466, + 1.068705789744854, + 0.7958460003137589, + 0.4303796701133251, + 0.34738441929221153, + 2.0226555801928043, + 1.4986608065664768, + 1.0400626547634602, + 1.4582385942339897, + 0.04126733914017677 + ], + "unique_experts": 63, + "load_cv": 0.5752039782319853, + "normalized_load_entropy": 0.9590129184150138, + "max_load_share": 0.04112554112554113 + } + }, + "s0_period": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "b174ed5264d3ad98178de0cb36a6486c83d92d7dfa91865b64f4d03ff9ce88b0", + "route_weight_sha256": "33202c0f7a9128aeaeaac32e02c7615187dd256800068600690e5741f44e4c29", + "loads": [ + 11, + 10, + 13, + 7, + 12, + 4, + 7, + 1, + 12, + 6, + 8, + 9, + 6, + 14, + 4, + 9, + 9, + 16, + 2, + 16, + 13, + 13, + 14, + 9, + 13, + 3, + 11, + 10, + 4, + 3, + 0, + 13, + 5, + 38, + 21, + 11, + 13, + 1, + 11, + 7, + 23, + 38, + 8, + 4, + 13, + 6, + 12, + 6, + 12, + 15, + 17, + 10, + 18, + 0, + 2, + 11, + 7, + 9, + 5, + 21, + 27, + 11, + 14, + 0 + ], + "weighted_loads": [ + 0.6295146010816097, + 0.5322942696511745, + 0.9075727835297585, + 0.3079010471701622, + 0.8064866475760937, + 0.20023801922798157, + 0.48873908817768097, + 0.10792254656553268, + 0.8293855860829353, + 0.20564362592995167, + 0.4130053836852312, + 0.44716233387589455, + 0.2306545339524746, + 0.9308472461998463, + 0.13221820443868637, + 0.5488264299929142, + 0.44131555408239365, + 0.6629244163632393, + 0.07395383343100548, + 0.877803735435009, + 0.8064561169594526, + 0.9540336020290852, + 0.7495289146900177, + 0.6255721971392632, + 0.5613407716155052, + 0.17691030353307724, + 0.5160289276391268, + 0.5055701732635498, + 0.2305285558104515, + 0.16703401319682598, + 0.0, + 1.6729280464351177, + 0.21720993891358376, + 2.899369541555643, + 1.5547941122204065, + 0.874333668500185, + 0.9201184809207916, + 0.027470020577311516, + 0.4950843118131161, + 0.3025183789432049, + 1.7912229150533676, + 2.4413328245282173, + 0.38143029622733593, + 0.19528904557228088, + 1.6955513134598732, + 0.22563230618834496, + 0.7160047106444836, + 0.3806154653429985, + 0.6704379022121429, + 1.2967489063739777, + 1.0473088938742876, + 1.067965367808938, + 1.182692687958479, + 0.0, + 0.08202117308974266, + 0.4944794028997421, + 0.40382178500294685, + 0.4178829751908779, + 0.19532708451151848, + 1.8981103859841824, + 1.4657943975180387, + 0.650032177567482, + 0.7735214587301016, + 0.0 + ], + "unique_experts": 61, + "load_cv": 0.7063341599117122, + "normalized_load_entropy": 0.9422480714791959, + "max_load_share": 0.05604719764011799 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "88aa31b0a54aa7ab46372381a0f2e4ae330c6b5be01867b65b26618d26a24291", + "route_weight_sha256": "b6dca97034d53695599191769b8eb9ebf8a52af263b1975d20ff2f727cd200af", + "loads": [ + 11, + 11, + 14, + 7, + 17, + 4, + 7, + 1, + 16, + 8, + 10, + 11, + 6, + 14, + 4, + 16, + 14, + 17, + 14, + 16, + 13, + 13, + 14, + 14, + 13, + 4, + 11, + 11, + 11, + 3, + 6, + 21, + 7, + 38, + 25, + 15, + 13, + 1, + 11, + 7, + 28, + 38, + 8, + 26, + 16, + 6, + 12, + 14, + 12, + 18, + 17, + 11, + 18, + 0, + 7, + 18, + 7, + 9, + 8, + 22, + 27, + 16, + 21, + 0 + ], + "weighted_loads": [ + 0.6295146010816097, + 0.565631777048111, + 0.9662993811070919, + 0.3079010471701622, + 1.089486837387085, + 0.20023801922798157, + 0.48873908817768097, + 0.10792254656553268, + 1.0841064117848873, + 0.2637531291693449, + 0.480482729151845, + 0.4889662526547909, + 0.2306545339524746, + 0.9308472461998463, + 0.13221820443868637, + 0.8180275112390518, + 0.974370252341032, + 0.6777646476402879, + 1.2889812402427197, + 0.877803735435009, + 0.8064561169594526, + 0.9540336020290852, + 0.7495289146900177, + 0.8761343918740749, + 0.5613407716155052, + 0.2755681052803993, + 0.5160289276391268, + 0.5181701332330704, + 0.6887643337249756, + 0.16703401319682598, + 0.29325506649911404, + 2.0326428562402725, + 0.2843897081911564, + 2.899369541555643, + 1.7279823627322912, + 1.3281249441206455, + 0.9201184809207916, + 0.027470020577311516, + 0.4950843118131161, + 0.3025183789432049, + 2.07673666626215, + 2.4413328245282173, + 0.38143029622733593, + 2.2807490304112434, + 1.8590219356119633, + 0.22563230618834496, + 0.7160047106444836, + 0.977271493524313, + 0.6704379022121429, + 1.4431194812059402, + 1.0473088938742876, + 1.175639333203435, + 1.182692687958479, + 0.0, + 0.37334034591913223, + 0.7774162888526917, + 0.40382178500294685, + 0.4178829751908779, + 0.3324603773653507, + 1.9328538104891777, + 1.4657943975180387, + 0.8897001463919878, + 1.2180621679872274, + 0.0 + ], + "unique_experts": 62, + "load_cv": 0.5985466306254812, + "normalized_load_entropy": 0.955774914522417, + "max_load_share": 0.04589371980676329 + } + }, + "s1_period": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "2a3ef638ec3210c7f4df23b1bd5944952ebda35dd91108d6e6dd0234a17d04e9", + "route_weight_sha256": "4135825c86e3340a42373aafda6a4fb91c87aef3ca2ba2f9fd4a454b56a682d4", + "loads": [ + 9, + 10, + 12, + 8, + 13, + 3, + 7, + 1, + 12, + 9, + 8, + 10, + 6, + 13, + 3, + 9, + 7, + 17, + 2, + 16, + 13, + 14, + 14, + 9, + 12, + 4, + 12, + 10, + 4, + 1, + 0, + 13, + 6, + 36, + 21, + 12, + 13, + 2, + 11, + 7, + 23, + 38, + 8, + 4, + 13, + 5, + 12, + 6, + 11, + 16, + 17, + 9, + 19, + 1, + 1, + 12, + 6, + 10, + 5, + 21, + 27, + 12, + 13, + 0 + ], + "weighted_loads": [ + 0.5556900203227997, + 0.5307380743324757, + 0.8527499139308929, + 0.33831632509827614, + 0.8226642236113548, + 0.16572869569063187, + 0.489840492606163, + 0.10197113454341888, + 0.8070897497236729, + 0.322220241650939, + 0.4139496125280857, + 0.46555691212415695, + 0.22684443555772305, + 0.9127850420773029, + 0.10700182989239693, + 0.5159173160791397, + 0.2836859002709389, + 0.6947874091565609, + 0.07365021109580994, + 0.8830431662499905, + 0.7936155013740063, + 0.9865601360797882, + 0.7602238655090332, + 0.6199735775589943, + 0.5084847956895828, + 0.2042996920645237, + 0.5601714979857206, + 0.4952588491141796, + 0.2295980006456375, + 0.09158666431903839, + 0.0, + 1.619466945528984, + 0.259360171854496, + 2.6856942251324654, + 1.4905980359762907, + 0.89401501044631, + 0.8896935880184174, + 0.06271449103951454, + 0.514339517802, + 0.2903916295617819, + 1.762776918709278, + 2.3702822849154472, + 0.3718568067997694, + 0.1627865470945835, + 1.6775860115885735, + 0.19935031607747078, + 0.7184760868549347, + 0.3817961812019348, + 0.6419241167604923, + 1.3620765767991543, + 1.0306035168468952, + 1.0140501596033573, + 1.2044063117355108, + 0.03021560050547123, + 0.03655866160988808, + 0.5277777202427387, + 0.36458177492022514, + 0.473614651709795, + 0.1980956606566906, + 1.8906424678862095, + 1.4329523611813784, + 0.6710715834051371, + 0.7186887599527836, + 0.0 + ], + "unique_experts": 62, + "load_cv": 0.7013890800447158, + "normalized_load_entropy": 0.9424055019025245, + "max_load_share": 0.05604719764011799 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "86c7d727528331af660efa6c3f6297b4403daa903d67952d523a65e6ff93785c", + "route_weight_sha256": "426a6ba49f043cdef414947ef75efcc306768b581d18962db8d4ebb401194299", + "loads": [ + 11, + 11, + 13, + 8, + 25, + 8, + 7, + 3, + 22, + 9, + 11, + 12, + 6, + 13, + 4, + 12, + 23, + 18, + 12, + 17, + 14, + 15, + 16, + 14, + 12, + 6, + 14, + 12, + 15, + 1, + 9, + 20, + 6, + 36, + 26, + 18, + 13, + 2, + 11, + 8, + 29, + 38, + 8, + 31, + 15, + 5, + 13, + 19, + 11, + 20, + 17, + 10, + 19, + 6, + 20, + 24, + 12, + 11, + 7, + 24, + 28, + 20, + 23, + 1 + ], + "weighted_loads": [ + 0.7038369551301003, + 0.5633530281484127, + 0.9017439782619476, + 0.33831632509827614, + 1.471376944333315, + 0.3454647697508335, + 0.489840492606163, + 0.23141061514616013, + 1.4234895668923855, + 0.322220241650939, + 0.5231195986270905, + 0.5073246397078037, + 0.22684443555772305, + 0.9127850420773029, + 0.14662592858076096, + 0.6217728145420551, + 1.8302983343601227, + 0.7096276404336095, + 1.2327520102262497, + 0.9216646440327168, + 0.8669050522148609, + 1.0581451579928398, + 0.8694921545684338, + 0.8419315926730633, + 0.5084847956895828, + 0.3124408572912216, + 0.635530823841691, + 0.5471305139362812, + 1.0435160174965858, + 0.09158666431903839, + 0.4459274262189865, + 1.9269155636429787, + 0.259360171854496, + 2.6856942251324654, + 1.7255863789469004, + 1.4595856070518494, + 0.8896935880184174, + 0.06271449103951454, + 0.514339517802, + 0.3373474534600973, + 2.03605598770082, + 2.3702822849154472, + 0.3718568067997694, + 2.5260899364948273, + 1.8115068078041077, + 0.19935031607747078, + 0.7648157440125942, + 1.3682925775647163, + 0.6419241167604923, + 1.6207167617976665, + 1.0306035168468952, + 1.1198958493769169, + 1.2044063117355108, + 0.33291097171604633, + 1.180562112480402, + 1.088582582771778, + 0.8340537548065186, + 0.5161179564893246, + 0.29993240535259247, + 2.0157224275171757, + 1.47143036685884, + 1.0307829808443785, + 1.2401459030807018, + 0.04126733914017677 + ], + "unique_experts": 64, + "load_cv": 0.5563907441897383, + "normalized_load_entropy": 0.9623015909055022, + "max_load_share": 0.04112554112554113 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 113, + "ordered_topk_exact_tokens": 87, + "set_exact_tokens": 96, + "mean_set_jaccard": 0.9570164348925411, + "mean_token_weighted_tv": 0.009713162635082165, + "aggregate_load_tv": 0.022123893805309734 + }, + "system_bos": { + "tokens": 113, + "ordered_topk_exact_tokens": 72, + "set_exact_tokens": 88, + "mean_set_jaccard": 0.9329962073324906, + "mean_token_weighted_tv": 0.014820935699132691, + "aggregate_load_tv": 0.025073746312684365 + }, + "system_x": { + "tokens": 113, + "ordered_topk_exact_tokens": 59, + "set_exact_tokens": 77, + "mean_set_jaccard": 0.9051833122629583, + "mean_token_weighted_tv": 0.021395493933387036, + "aggregate_load_tv": 0.029498525073746312 + }, + "system_period": { + "tokens": 113, + "ordered_topk_exact_tokens": 59, + "set_exact_tokens": 81, + "mean_set_jaccard": 0.9152970922882427, + "mean_token_weighted_tv": 0.020186524541504616, + "aggregate_load_tv": 0.028023598820058997 + }, + "bos_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 69, + "set_exact_tokens": 81, + "mean_set_jaccard": 0.9152970922882427, + "mean_token_weighted_tv": 0.017576645944366413, + "aggregate_load_tv": 0.028023598820058997 + }, + "bos_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 59, + "set_exact_tokens": 72, + "mean_set_jaccard": 0.8963337547408345, + "mean_token_weighted_tv": 0.02078397147588234, + "aggregate_load_tv": 0.032448377581120944 + }, + "x_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 65, + "set_exact_tokens": 79, + "mean_set_jaccard": 0.9121365360303413, + "mean_token_weighted_tv": 0.01851332677215074, + "aggregate_load_tv": 0.032448377581120944 + }, + "x_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 55, + "set_exact_tokens": 67, + "mean_set_jaccard": 0.8817951959544881, + "mean_token_weighted_tv": 0.024432140542606336, + "aggregate_load_tv": 0.04277286135693216 + }, + "period_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 64, + "set_exact_tokens": 80, + "mean_set_jaccard": 0.9146649810366625, + "mean_token_weighted_tv": 0.01817645797654327, + "aggregate_load_tv": 0.03392330383480826 + }, + "period_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 47, + "set_exact_tokens": 64, + "mean_set_jaccard": 0.8761061946902655, + "mean_token_weighted_tv": 0.024457289070814056, + "aggregate_load_tv": 0.038348082595870206 + } + } + }, + "layer_12": { + "layer": 12, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "29c0fb37fa7e43ea554d40a9bfa082131cefd6ee71acce789cd13e19cd479856", + "route_weight_sha256": "86d6fc5f95154c14fda0172e92e543772038cda8bd58f6f2b8c7157b3a1b3da5", + "loads": [ + 9, + 13, + 6, + 10, + 11, + 3, + 0, + 10, + 7, + 1, + 0, + 16, + 16, + 19, + 31, + 1, + 23, + 5, + 11, + 47, + 9, + 16, + 19, + 7, + 10, + 10, + 9, + 5, + 7, + 7, + 1, + 18, + 2, + 16, + 6, + 0, + 25, + 11, + 11, + 11, + 3, + 1, + 5, + 15, + 40, + 10, + 10, + 12, + 18, + 2, + 13, + 5, + 22, + 6, + 11, + 3, + 15, + 7, + 0, + 9, + 5, + 14, + 8, + 5 + ], + "weighted_loads": [ + 0.5357415042817593, + 0.8064684588462114, + 0.23847866989672184, + 0.7131032235920429, + 0.7378521859645844, + 0.12464231997728348, + 0.0, + 0.5870099924504757, + 0.32218915969133377, + 0.11419637501239777, + 0.0, + 1.030076127499342, + 1.2591290138661861, + 1.0840373411774635, + 1.9370010420680046, + 0.04442603513598442, + 1.5256754606962204, + 0.3344622850418091, + 0.5848332606256008, + 2.5331476610153913, + 0.54406981728971, + 1.1042860969901085, + 1.5292658768594265, + 0.5448596216738224, + 0.4845541641116142, + 0.6966162249445915, + 0.5522351488471031, + 0.22648689895868301, + 0.5282237604260445, + 0.4122467674314976, + 0.03901141509413719, + 1.4208157025277615, + 0.07563943788409233, + 1.5221850760281086, + 0.43545572087168694, + 0.0, + 1.3580692000687122, + 0.8924253284931183, + 0.8872969169169664, + 0.6507806852459908, + 0.1047336682677269, + 0.06124860793352127, + 0.20182431116700172, + 1.3250801973044872, + 2.9059934355318546, + 0.7095184661448002, + 0.5977438390254974, + 0.6491967737674713, + 1.0799640379846096, + 0.08096171170473099, + 1.2058640290051699, + 0.34632252529263496, + 1.6823630183935165, + 0.37062517926096916, + 1.0904815830290318, + 0.13527879118919373, + 1.0448884814977646, + 0.3603721000254154, + 0.0, + 0.5778870172798634, + 0.2566861920058727, + 1.0734401419758797, + 0.6889595575630665, + 0.23086999729275703 + ], + "unique_experts": 60, + "load_cv": 0.8346310411559059, + "normalized_load_entropy": 0.923100604961383, + "max_load_share": 0.06932153392330384 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "9d20f197012e411d34cdd2e7b7115c863b054db7d4a4b3cc247d9115671936ff", + "route_weight_sha256": "85c6fdb3bd32799f0f361b1036f4cd96789bbb580b12cdfa6c5c4ce56c555025", + "loads": [ + 9, + 13, + 6, + 15, + 16, + 4, + 0, + 13, + 13, + 1, + 0, + 16, + 21, + 20, + 31, + 1, + 24, + 5, + 11, + 47, + 10, + 16, + 20, + 12, + 10, + 10, + 10, + 12, + 22, + 17, + 3, + 23, + 3, + 18, + 6, + 7, + 25, + 15, + 25, + 11, + 3, + 8, + 12, + 15, + 42, + 11, + 11, + 17, + 23, + 2, + 14, + 5, + 22, + 6, + 11, + 3, + 18, + 7, + 0, + 12, + 5, + 19, + 13, + 8 + ], + "weighted_loads": [ + 0.5357415042817593, + 0.8064684588462114, + 0.23847866989672184, + 0.8388375865761191, + 2.38627970777452, + 0.12871320126578212, + 0.0, + 0.789154626429081, + 0.6992990169674158, + 0.11419637501239777, + 0.0, + 1.030076127499342, + 1.493634656071663, + 1.1978077366948128, + 1.9370010420680046, + 0.04442603513598442, + 1.5639901384711266, + 0.3344622850418091, + 0.5848332606256008, + 2.5331476610153913, + 0.5463824949692935, + 1.1042860969901085, + 1.5793804563581944, + 0.9978060908615589, + 0.4845541641116142, + 0.6966162249445915, + 0.5849483236670494, + 0.6231987327337265, + 2.4720663242042065, + 1.798696968704462, + 0.10302337259054184, + 1.7164225168526173, + 0.12183145433664322, + 1.612506315112114, + 0.43545572087168694, + 0.4992538057267666, + 1.3580692000687122, + 1.0064331218600273, + 2.045182505622506, + 0.6507806852459908, + 0.1047336682677269, + 0.6744534596800804, + 0.63824313133955, + 1.3250801973044872, + 3.0269056372344494, + 0.7491656094789505, + 0.6449755541980267, + 0.9590609762817621, + 1.4056693129241467, + 0.08096171170473099, + 1.2188035417348146, + 0.34632252529263496, + 1.6823630183935165, + 0.37062517926096916, + 1.0904815830290318, + 0.13527879118919373, + 1.150759382173419, + 0.3603721000254154, + 0.0, + 0.6718954890966415, + 0.2566861920058727, + 1.2621940113604069, + 0.885124709457159, + 0.32767594791948795 + ], + "unique_experts": 61, + "load_cv": 0.706421604035699, + "normalized_load_entropy": 0.9397475530066529, + "max_load_share": 0.05676328502415459 + } + }, + "s1_eos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "7a9925b6e54ce602792c38d5b68e8a2378ef566899be2a4c606353818840dca0", + "route_weight_sha256": "c333c348fd02c640767069b186aa6f2d4433b506d247486c9f257102fe492e23", + "loads": [ + 9, + 13, + 5, + 11, + 13, + 2, + 0, + 10, + 6, + 1, + 0, + 15, + 16, + 19, + 32, + 2, + 21, + 5, + 9, + 49, + 8, + 16, + 21, + 7, + 10, + 10, + 9, + 5, + 6, + 7, + 1, + 18, + 2, + 16, + 8, + 0, + 24, + 11, + 12, + 11, + 2, + 1, + 6, + 16, + 40, + 10, + 9, + 12, + 17, + 3, + 13, + 5, + 23, + 6, + 12, + 3, + 14, + 5, + 0, + 10, + 5, + 13, + 8, + 5 + ], + "weighted_loads": [ + 0.5263665206730366, + 0.8076748009771109, + 0.21193350851535797, + 0.7593868672847748, + 0.8185937162488699, + 0.09060166776180267, + 0.0, + 0.5778435319662094, + 0.2895127981901169, + 0.11026296764612198, + 0.0, + 1.0082545541226864, + 1.2909435145556927, + 1.0945056043565273, + 2.0116617809981108, + 0.08818885684013367, + 1.4216446448117495, + 0.3318910263478756, + 0.4884674735367298, + 2.652706377208233, + 0.5065485276281834, + 1.1120357438921928, + 1.590404575690627, + 0.5620597824454308, + 0.47473038733005524, + 0.6987662203609943, + 0.5464760400354862, + 0.22251015156507492, + 0.48850272968411446, + 0.4012641739100218, + 0.03616056963801384, + 1.4082864373922348, + 0.07530347257852554, + 1.5113048665225506, + 0.5099315140396357, + 0.0, + 1.317143065854907, + 0.8857209496200085, + 0.9502529446035624, + 0.6526476107537746, + 0.07094304263591766, + 0.061246052384376526, + 0.23813223093748093, + 1.3449102975428104, + 2.8618911132216454, + 0.7091214023530483, + 0.5461713187396526, + 0.6503757890313864, + 1.0097112320363522, + 0.11546854302287102, + 1.1822410356253386, + 0.34815720841288567, + 1.7266172282397747, + 0.37138646468520164, + 1.135619580745697, + 0.13538912683725357, + 1.0142537243664265, + 0.2949011102318764, + 0.0, + 0.6192819662392139, + 0.25346317887306213, + 1.044501319527626, + 0.6914819367229939, + 0.22793859243392944 + ], + "unique_experts": 60, + "load_cv": 0.8500029559896943, + "normalized_load_entropy": 0.9215809708279931, + "max_load_share": 0.07227138643067847 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "f7d88e26d9d7d3af5fc18ad81fbf5b40ab71e771c3ea72374e795fe0c85d0691", + "route_weight_sha256": "22c2b1d6ce1ec4569f42cf7c35f71cfa8d44d76da17ca1fc21943ac8cb9afe34", + "loads": [ + 13, + 13, + 5, + 14, + 17, + 3, + 0, + 17, + 13, + 4, + 1, + 15, + 20, + 20, + 32, + 2, + 24, + 7, + 10, + 49, + 9, + 18, + 23, + 13, + 10, + 10, + 12, + 12, + 23, + 22, + 12, + 23, + 6, + 21, + 13, + 7, + 24, + 15, + 30, + 11, + 2, + 14, + 15, + 18, + 53, + 14, + 12, + 19, + 25, + 3, + 15, + 5, + 23, + 9, + 12, + 3, + 17, + 11, + 0, + 14, + 7, + 22, + 13, + 5 + ], + "weighted_loads": [ + 0.7181279435753822, + 0.8076748009771109, + 0.21193350851535797, + 0.8157149995677173, + 2.442134914919734, + 0.09454396227374673, + 0.0, + 0.9581753388047218, + 0.8038387075066566, + 0.42916812002658844, + 0.04140305519104004, + 1.0082545541226864, + 1.4665378890931606, + 1.203286100178957, + 2.0116617809981108, + 0.08818885684013367, + 1.6162689793854952, + 0.44406668096780777, + 0.5241948589682579, + 2.652706377208233, + 0.5088803181424737, + 1.2023907601833344, + 1.6773347724229097, + 1.0274771936237812, + 0.47473038733005524, + 0.6987662203609943, + 0.6687186323106289, + 0.5788014493882656, + 2.7197862789034843, + 2.5797007512301207, + 0.8965141512453556, + 1.6974993590265512, + 0.2526818569749594, + 1.8047632239758968, + 0.7658211644738913, + 0.5671764742583036, + 1.317143065854907, + 1.0588112939149141, + 2.3901180643588305, + 0.6526476107537746, + 0.07094304263591766, + 1.1747115962207317, + 0.7725125625729561, + 1.4535880535840988, + 4.076430566608906, + 1.0175308547914028, + 0.6796662248671055, + 1.04811230301857, + 1.4509273767471313, + 0.11546854302287102, + 1.2486938554793596, + 0.34815720841288567, + 1.7266172282397747, + 0.524515688419342, + 1.135619580745697, + 0.13538912683725357, + 1.092778808902949, + 0.5482664946466684, + 0.0, + 0.7419991195201874, + 0.32293055579066277, + 1.4813333041965961, + 0.9082169607281685, + 0.22793859243392944 + ], + "unique_experts": 62, + "load_cv": 0.6819384213362346, + "normalized_load_entropy": 0.9459610491333871, + "max_load_share": 0.05735930735930736 + } + }, + "s0_bos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "c976d53a25d4f1db37f0ec6c2475d652ef064942ae4de9d4a0ab6c0c74ae00fe", + "route_weight_sha256": "855ac0eb9c8366fd846f32d20838d950f6d7b86f8af89a2ee7fc1b3eba3b513b", + "loads": [ + 8, + 13, + 6, + 10, + 13, + 2, + 0, + 10, + 6, + 1, + 0, + 16, + 16, + 19, + 30, + 1, + 23, + 5, + 9, + 47, + 8, + 15, + 21, + 6, + 10, + 9, + 8, + 6, + 6, + 8, + 1, + 18, + 2, + 17, + 6, + 0, + 25, + 10, + 11, + 11, + 3, + 2, + 4, + 15, + 40, + 10, + 10, + 12, + 19, + 2, + 13, + 5, + 23, + 6, + 12, + 3, + 16, + 7, + 0, + 11, + 5, + 13, + 9, + 5 + ], + "weighted_loads": [ + 0.4829664006829262, + 0.7929439339786768, + 0.2515803687274456, + 0.7095599584281445, + 0.7753945849835873, + 0.09008025750517845, + 0.0, + 0.5931533873081207, + 0.28662750124931335, + 0.11626743525266647, + 0.0, + 1.0702445469796658, + 1.265392404049635, + 1.0860624350607395, + 1.9605130683630705, + 0.046906035393476486, + 1.5157247725874186, + 0.3272602967917919, + 0.4931623041629791, + 2.6713525503873825, + 0.533463642001152, + 1.04964330047369, + 1.5892851520329714, + 0.5349779389798641, + 0.4984627962112427, + 0.618782889097929, + 0.5245230682194233, + 0.26548123359680176, + 0.49175725504755974, + 0.4334730748087168, + 0.03484668955206871, + 1.4154449552297592, + 0.07692350819706917, + 1.5265985541045666, + 0.43510641157627106, + 0.0, + 1.3706445302814245, + 0.8434591107070446, + 0.8900297582149506, + 0.6627661660313606, + 0.09888025373220444, + 0.10266099870204926, + 0.166059672832489, + 1.3340594042092562, + 2.953882407397032, + 0.7411278039216995, + 0.5992005132138729, + 0.6463015042245388, + 1.132204683497548, + 0.07987247407436371, + 1.150755012407899, + 0.3608834743499756, + 1.7186584621667862, + 0.35311318933963776, + 1.1295583695173264, + 0.1378878466784954, + 1.062019843608141, + 0.3568437024950981, + 0.0, + 0.6396057121455669, + 0.263215322047472, + 1.0372744128108025, + 0.7252273634076118, + 0.23062092438340187 + ], + "unique_experts": 60, + "load_cv": 0.8412770417790623, + "normalized_load_entropy": 0.9218900875397107, + "max_load_share": 0.06932153392330384 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "8d597437b0f2b08c3cf5691ce49385a720a34257ce4647e564d13d286625f07c", + "route_weight_sha256": "32b4ae506cbf5b0a2cdb291135b3a320c23f269511cfaf5ce29b79b5f2c652ad", + "loads": [ + 8, + 13, + 6, + 14, + 17, + 2, + 0, + 13, + 12, + 1, + 0, + 16, + 22, + 20, + 30, + 1, + 27, + 5, + 9, + 47, + 8, + 15, + 22, + 11, + 10, + 9, + 10, + 13, + 22, + 18, + 3, + 24, + 3, + 19, + 6, + 7, + 25, + 14, + 25, + 11, + 3, + 9, + 10, + 16, + 42, + 11, + 11, + 17, + 24, + 2, + 14, + 5, + 23, + 6, + 12, + 3, + 18, + 7, + 0, + 14, + 5, + 17, + 13, + 8 + ], + "weighted_loads": [ + 0.4829664006829262, + 0.7929439339786768, + 0.2515803687274456, + 0.8321964647620916, + 1.473428012803197, + 0.09008025750517845, + 0.0, + 0.8092033043503761, + 0.7054149862378836, + 0.11626743525266647, + 0.0, + 1.0702445469796658, + 1.5661859139800072, + 1.2011032663285732, + 1.9605130683630705, + 0.046906035393476486, + 1.667761953547597, + 0.3272602967917919, + 0.4931623041629791, + 2.6713525503873825, + 0.533463642001152, + 1.04964330047369, + 1.6393997315317392, + 0.9879244081676006, + 0.4984627962112427, + 0.618782889097929, + 0.5985338389873505, + 0.6621930673718452, + 2.4608830735087395, + 1.9364567827433348, + 0.09885864704847336, + 1.7712494917213917, + 0.12311552464962006, + 1.6229735389351845, + 0.43510641157627106, + 0.4992538057267666, + 1.3706445302814245, + 0.9574669040739536, + 2.11930163949728, + 0.6627661660313606, + 0.09888025373220444, + 0.738005917519331, + 0.5653178691864014, + 1.3685554545372725, + 3.0578346624970436, + 0.7807749472558498, + 0.6458702720701694, + 0.9627510663121939, + 1.4502253476530313, + 0.07987247407436371, + 1.1636945251375437, + 0.3608834743499756, + 1.7186584621667862, + 0.35311318933963776, + 1.1295583695173264, + 0.1378878466784954, + 1.163324585184455, + 0.3568437024950981, + 0.0, + 0.7833899892866611, + 0.263215322047472, + 1.1941842809319496, + 0.8725792765617371, + 0.3274268750101328 + ], + "unique_experts": 61, + "load_cv": 0.721717141986349, + "normalized_load_entropy": 0.9370560038760609, + "max_load_share": 0.05676328502415459 + } + }, + "s1_bos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "7c5ab3f797c5b0efd1e491f2d01dd5d50f7efe4c6df032a10371ca09daf90831", + "route_weight_sha256": "9785bfd90554d8a8a23edccdcf7816cdfe8a3c5af17c3e4041b0e43901c1cd2a", + "loads": [ + 8, + 12, + 6, + 11, + 12, + 3, + 0, + 10, + 6, + 1, + 0, + 16, + 17, + 21, + 33, + 1, + 23, + 5, + 9, + 47, + 8, + 15, + 20, + 6, + 10, + 9, + 7, + 6, + 6, + 8, + 1, + 18, + 2, + 17, + 8, + 0, + 24, + 12, + 11, + 12, + 2, + 2, + 6, + 14, + 42, + 10, + 9, + 11, + 17, + 2, + 10, + 5, + 24, + 5, + 10, + 2, + 15, + 7, + 0, + 10, + 6, + 13, + 10, + 5 + ], + "weighted_loads": [ + 0.5085743814706802, + 0.7450804766267538, + 0.25479090586304665, + 0.7423924505710602, + 0.7454900592565536, + 0.1268416941165924, + 0.0, + 0.5884980224072933, + 0.28783368319272995, + 0.11342049390077591, + 0.0, + 1.0720770806074142, + 1.32263595610857, + 1.2063946202397346, + 2.0670966003090143, + 0.04633001983165741, + 1.501122971996665, + 0.32667088881134987, + 0.5027615576982498, + 2.7258109021931887, + 0.5124705173075199, + 1.0421199351549149, + 1.5371148828417063, + 0.5279052555561066, + 0.49529625847935677, + 0.6199415177106857, + 0.467024851590395, + 0.26815587654709816, + 0.48007672280073166, + 0.4094683211296797, + 0.0356452502310276, + 1.4170307479798794, + 0.07264421880245209, + 1.5532790906727314, + 0.5009320136159658, + 0.0, + 1.3278051298111677, + 0.9409603998064995, + 0.9055472388863564, + 0.6951414868235588, + 0.06849686428904533, + 0.10994876176118851, + 0.2270665504038334, + 1.2644932940602303, + 3.0604846887290478, + 0.7546840235590935, + 0.5590806975960732, + 0.5922664366662502, + 1.040243737399578, + 0.08266220614314079, + 1.0197432450950146, + 0.3563765548169613, + 1.7590224221348763, + 0.32229161262512207, + 1.0566509552299976, + 0.0939803309738636, + 1.0538490191102028, + 0.3507418278604746, + 0.0, + 0.5978924594819546, + 0.2941114492714405, + 1.060418151319027, + 0.7902355566620827, + 0.22778641805052757 + ], + "unique_experts": 60, + "load_cv": 0.8576667630457507, + "normalized_load_entropy": 0.9204323153809469, + "max_load_share": 0.06932153392330384 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "b9e448ffd0bdb850221f3097cf0cf216d30772f3b8f42cda93ea2318a3f92ef4", + "route_weight_sha256": "62b9438fe700a9229863d7a1585e78088cfcf715d1b6ac30685ce25d13bea8b2", + "loads": [ + 12, + 12, + 6, + 13, + 15, + 3, + 0, + 17, + 13, + 4, + 1, + 16, + 22, + 22, + 33, + 1, + 27, + 7, + 10, + 47, + 8, + 17, + 22, + 12, + 10, + 9, + 10, + 13, + 23, + 25, + 12, + 24, + 6, + 22, + 13, + 7, + 24, + 16, + 29, + 12, + 2, + 15, + 14, + 17, + 55, + 14, + 12, + 18, + 26, + 2, + 12, + 5, + 24, + 8, + 10, + 2, + 17, + 13, + 0, + 14, + 8, + 21, + 15, + 5 + ], + "weighted_loads": [ + 0.7003358043730259, + 0.7450804766267538, + 0.25479090586304665, + 0.7957789022475481, + 1.4187076762318611, + 0.1268416941165924, + 0.0, + 0.9782759100198746, + 0.843581423163414, + 0.43232564628124237, + 0.04140305519104004, + 1.0720770806074142, + 1.575168427079916, + 1.3134738877415657, + 2.0670966003090143, + 0.04633001983165741, + 1.7455955278128386, + 0.43884654343128204, + 0.5384889431297779, + 2.7258109021931887, + 0.5124705173075199, + 1.1324749514460564, + 1.624045079573989, + 0.993322666734457, + 0.49529625847935677, + 0.6199415177106857, + 0.5892674438655376, + 0.6244471743702888, + 2.8323051892220974, + 2.818140434101224, + 0.8959988318383694, + 1.7428891006857157, + 0.2500226031988859, + 1.8494816944003105, + 0.7568216640502214, + 0.5671764742583036, + 1.3278051298111677, + 1.1140507441014051, + 2.4428738355636597, + 0.6951414868235588, + 0.06849686428904533, + 1.2428123652935028, + 0.7369703836739063, + 1.409114696085453, + 4.269410602748394, + 1.063093475997448, + 0.6913704797625542, + 1.0175145994871855, + 1.500811979174614, + 0.08266220614314079, + 1.0861960649490356, + 0.3563765548169613, + 1.7590224221348763, + 0.47542083635926247, + 1.0566509552299976, + 0.0939803309738636, + 1.1192634757608175, + 0.6041072122752666, + 0.0, + 0.7549643740057945, + 0.36357882618904114, + 1.4629860743880272, + 1.0069705806672573, + 0.22778641805052757 + ], + "unique_experts": 62, + "load_cv": 0.6995194146021492, + "normalized_load_entropy": 0.9428242877322466, + "max_load_share": 0.05952380952380952 + } + }, + "s0_x": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "183e979ac00ebc814149ff98dd9fada76280e8cb2916908dfff6d4259f6cf1c6", + "route_weight_sha256": "d0309467ad04172a05dc6db15197c82658df776fc22a6ac5d3505b019774e7a5", + "loads": [ + 9, + 10, + 8, + 10, + 12, + 2, + 0, + 10, + 6, + 1, + 0, + 16, + 17, + 20, + 36, + 1, + 22, + 5, + 10, + 50, + 8, + 16, + 20, + 6, + 9, + 9, + 9, + 6, + 6, + 7, + 1, + 18, + 2, + 16, + 7, + 0, + 24, + 12, + 11, + 13, + 3, + 2, + 5, + 14, + 41, + 10, + 10, + 11, + 18, + 2, + 13, + 5, + 22, + 5, + 11, + 3, + 15, + 5, + 0, + 9, + 4, + 13, + 7, + 5 + ], + "weighted_loads": [ + 0.5374045297503471, + 0.700346328318119, + 0.3218889385461807, + 0.7270379960536957, + 0.7492045573890209, + 0.08102023601531982, + 0.0, + 0.5892237611114979, + 0.28730081021785736, + 0.1100221648812294, + 0.0, + 1.0574853532016277, + 1.3001324087381363, + 1.1457719262689352, + 2.213483879342675, + 0.04675993695855141, + 1.499350594356656, + 0.3325493559241295, + 0.5383752696216106, + 2.777370249852538, + 0.5364935882389545, + 1.1108927987515926, + 1.5510372444987297, + 0.517455268651247, + 0.4651053063571453, + 0.6243381835520267, + 0.5394299551844597, + 0.26875995472073555, + 0.4750386755913496, + 0.3896345254033804, + 0.0326557494699955, + 1.4126248098909855, + 0.07903734594583511, + 1.4806113690137863, + 0.46487862430512905, + 0.0, + 1.3256340119987726, + 0.9341282173991203, + 0.8970401287078857, + 0.7399242632091045, + 0.0978911779820919, + 0.10544648766517639, + 0.20977137982845306, + 1.3279965184628963, + 2.985473047941923, + 0.734825175255537, + 0.6140298284590244, + 0.5873140692710876, + 1.109422691166401, + 0.07808035612106323, + 1.1763629540801048, + 0.3576078899204731, + 1.6754470467567444, + 0.32146144285798073, + 1.116877768188715, + 0.1370251066982746, + 1.0476959645748138, + 0.2928774990141392, + 0.0, + 0.5847729481756687, + 0.22610359638929367, + 1.04385831579566, + 0.6252852901816368, + 0.23490749672055244 + ], + "unique_experts": 60, + "load_cv": 0.8789917024222362, + "normalized_load_entropy": 0.9182481525609714, + "max_load_share": 0.07374631268436578 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "57c12d267b60dc2f7d4609e34038fdbda3e274fc93f26bf7c3f4774b6bc07557", + "route_weight_sha256": "027a9242c5865a0caadb1c844a6379e50befa95ab54bec3bf17e772b6cb396e9", + "loads": [ + 9, + 10, + 8, + 14, + 16, + 2, + 0, + 13, + 12, + 1, + 0, + 16, + 22, + 21, + 36, + 1, + 23, + 5, + 10, + 50, + 8, + 16, + 21, + 12, + 9, + 9, + 10, + 14, + 23, + 17, + 4, + 23, + 3, + 18, + 7, + 8, + 24, + 16, + 25, + 13, + 3, + 9, + 11, + 14, + 43, + 12, + 11, + 16, + 23, + 2, + 14, + 5, + 22, + 5, + 11, + 3, + 17, + 5, + 0, + 11, + 4, + 19, + 11, + 8 + ], + "weighted_loads": [ + 0.5374045297503471, + 0.700346328318119, + 0.3218889385461807, + 0.8496745023876429, + 1.4472379852086306, + 0.08102023601531982, + 0.0, + 0.8176232911646366, + 0.663960887119174, + 0.1100221648812294, + 0.0, + 1.0574853532016277, + 1.5330689698457718, + 1.243108144029975, + 2.213483879342675, + 0.04675993695855141, + 1.5445987228304148, + 0.3325493559241295, + 0.5383752696216106, + 2.777370249852538, + 0.5364935882389545, + 1.1108927987515926, + 1.6011518239974976, + 1.119993183761835, + 0.4651053063571453, + 0.6243381835520267, + 0.572143130004406, + 0.7226120121777058, + 2.653837548568845, + 1.5682258252054453, + 0.15083926543593407, + 1.7337057627737522, + 0.125229362398386, + 1.5785358101129532, + 0.46487862430512905, + 0.575243417173624, + 1.3256340119987726, + 1.0481360107660294, + 1.9753665924072266, + 0.7399242632091045, + 0.0978911779820919, + 0.7253800742328167, + 0.6048959791660309, + 1.3279965184628963, + 3.0792274065315723, + 0.8258559517562389, + 0.6608081944286823, + 0.879143325611949, + 1.4422212652862072, + 0.07808035612106323, + 1.1893024668097496, + 0.3576078899204731, + 1.6754470467567444, + 0.32146144285798073, + 1.116877768188715, + 0.1370251066982746, + 1.1490007061511278, + 0.2928774990141392, + 0.0, + 0.670352429151535, + 0.22610359638929367, + 1.3003366459161043, + 0.772637203335762, + 0.33171344734728336 + ], + "unique_experts": 61, + "load_cv": 0.742123962319415, + "normalized_load_entropy": 0.935577419609889, + "max_load_share": 0.06038647342995169 + } + }, + "s1_x": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "6efba095416b53ba175b97a8c3d71482b4e8cf23a3e0b4b166f111b5a9b9b299", + "route_weight_sha256": "7e9bb712513eada4bd2142d22345a93ce5b139a235231378ed89640ae4fe52b4", + "loads": [ + 8, + 10, + 6, + 11, + 14, + 2, + 0, + 10, + 6, + 2, + 0, + 16, + 17, + 21, + 36, + 1, + 20, + 5, + 9, + 48, + 8, + 15, + 20, + 6, + 9, + 9, + 8, + 6, + 6, + 6, + 1, + 18, + 2, + 17, + 8, + 0, + 23, + 12, + 11, + 11, + 2, + 2, + 6, + 14, + 42, + 10, + 9, + 14, + 17, + 2, + 12, + 5, + 24, + 5, + 10, + 2, + 16, + 7, + 0, + 9, + 6, + 13, + 8, + 5 + ], + "weighted_loads": [ + 0.49761252850294113, + 0.6724265627563, + 0.25459063798189163, + 0.7279746271669865, + 0.8188291862607002, + 0.08390000462532043, + 0.0, + 0.5865889862179756, + 0.28220266103744507, + 0.15182948857545853, + 0.0, + 1.0596635024994612, + 1.3113325126469135, + 1.2328430823981762, + 2.2662082109600306, + 0.043088771402835846, + 1.395538005977869, + 0.3284978121519089, + 0.49011093005537987, + 2.795800097286701, + 0.502226747572422, + 1.095953855663538, + 1.4998080357909203, + 0.5323840752243996, + 0.4468856453895569, + 0.6087234243750572, + 0.5153337940573692, + 0.27193351089954376, + 0.44259675592184067, + 0.32580796256661415, + 0.03690639138221741, + 1.3968322053551674, + 0.06985203176736832, + 1.5322633013129234, + 0.5051638148725033, + 0.0, + 1.2645968440920115, + 0.9431179855018854, + 0.9358387030661106, + 0.6496861465275288, + 0.0678720735013485, + 0.10911659896373749, + 0.2512180022895336, + 1.3207945264875889, + 2.883256621658802, + 0.7524089738726616, + 0.5639282763004303, + 0.6815196070820093, + 1.0369822792708874, + 0.07837862521409988, + 1.0891529731452465, + 0.34339389204978943, + 1.7430515512824059, + 0.31571466848254204, + 1.062795765697956, + 0.09452763944864273, + 1.1027915365993977, + 0.34429887495934963, + 0.0, + 0.5587230008095503, + 0.2909807413816452, + 1.049409069120884, + 0.6753531582653522, + 0.2364150509238243 + ], + "unique_experts": 60, + "load_cv": 0.8715154397283984, + "normalized_load_entropy": 0.9190724409727419, + "max_load_share": 0.07079646017699115 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "990499c360b6ef6adf5cd302f61bf0ee51290a469f0b191d68580a913ec3e30a", + "route_weight_sha256": "8fac4b98c3a4c4e8827b871ea3898af41ec7e27eda34cbab7ccde7fe83ccd1b7", + "loads": [ + 12, + 10, + 6, + 13, + 17, + 2, + 0, + 17, + 13, + 5, + 1, + 16, + 21, + 22, + 36, + 1, + 23, + 7, + 10, + 48, + 8, + 18, + 22, + 13, + 9, + 9, + 11, + 14, + 25, + 21, + 13, + 23, + 6, + 22, + 13, + 8, + 23, + 16, + 28, + 11, + 2, + 15, + 14, + 16, + 56, + 15, + 12, + 21, + 25, + 2, + 14, + 5, + 24, + 8, + 10, + 2, + 17, + 13, + 0, + 12, + 8, + 22, + 13, + 5 + ], + "weighted_loads": [ + 0.6893739514052868, + 0.6724265627563, + 0.25459063798189163, + 0.7813610788434744, + 1.4920468032360077, + 0.08390000462532043, + 0.0, + 0.9858992509543896, + 0.7567583508789539, + 0.470734640955925, + 0.04140305519104004, + 1.0596635024994612, + 1.487254697829485, + 1.3355869837105274, + 2.2662082109600306, + 0.043088771402835846, + 1.5883488021790981, + 0.44067346677184105, + 0.525838315486908, + 2.795800097286701, + 0.502226747572422, + 1.2188882417976856, + 1.586738232523203, + 1.1305859722197056, + 0.4468856453895569, + 0.6087234243750572, + 0.6375763863325119, + 0.7020803652703762, + 2.9832461662590504, + 2.2133412435650826, + 0.9353776648640633, + 1.689834775403142, + 0.24723041616380215, + 1.824510220438242, + 0.7610534653067589, + 0.6647388692945242, + 1.2645968440920115, + 1.116208329796791, + 2.231411661952734, + 0.6496861465275288, + 0.0678720735013485, + 1.213646337389946, + 0.7428695671260357, + 1.4294722825288773, + 4.125014238059521, + 1.1041382811963558, + 0.700861319899559, + 1.0172810144722462, + 1.4644865207374096, + 0.07837862521409988, + 1.1556057929992676, + 0.34339389204978943, + 1.7430515512824059, + 0.46884389221668243, + 1.062795765697956, + 0.09452763944864273, + 1.1305327471345663, + 0.5976642593741417, + 0.0, + 0.6735749151557684, + 0.36044811829924583, + 1.505643516778946, + 0.8920881822705269, + 0.2364150509238243 + ], + "unique_experts": 62, + "load_cv": 0.7053886403513813, + "normalized_load_entropy": 0.9424137171554406, + "max_load_share": 0.06060606060606061 + } + }, + "s0_period": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "07b40988dbbe95985b27393e50cbcfe89560517aab41532f0264aeeb03158ffc", + "route_weight_sha256": "58e38cbc87f020e1ef160b4a96f3e72f31e19aabda71f005e84af8817c02c1cc", + "loads": [ + 8, + 10, + 7, + 9, + 11, + 1, + 0, + 10, + 6, + 2, + 0, + 15, + 17, + 19, + 36, + 1, + 22, + 5, + 9, + 49, + 8, + 16, + 21, + 6, + 10, + 9, + 9, + 6, + 7, + 6, + 1, + 16, + 2, + 15, + 7, + 0, + 25, + 11, + 11, + 13, + 3, + 2, + 5, + 15, + 42, + 10, + 10, + 13, + 18, + 2, + 13, + 5, + 22, + 6, + 11, + 3, + 15, + 6, + 0, + 10, + 6, + 13, + 7, + 5 + ], + "weighted_loads": [ + 0.48237550258636475, + 0.6971274092793465, + 0.28020204231143, + 0.6827746517956257, + 0.7079756110906601, + 0.04299018904566765, + 0.0, + 0.5949830152094364, + 0.2814205400645733, + 0.14723535627126694, + 0.0, + 1.0186760239303112, + 1.282484944909811, + 1.0975275784730911, + 2.214439880102873, + 0.04988817498087883, + 1.5055423211306334, + 0.33307787775993347, + 0.504638809710741, + 2.7307958863675594, + 0.5348973274230957, + 1.107239842414856, + 1.5860427673906088, + 0.5155440308153629, + 0.5030750967562199, + 0.6153869368135929, + 0.557111207395792, + 0.26266881078481674, + 0.5238393042236567, + 0.38327643647789955, + 0.03313592076301575, + 1.3202803954482079, + 0.07923935726284981, + 1.4326997995376587, + 0.47335394099354744, + 0.0, + 1.3732022233307362, + 0.8710450362414122, + 0.9121006019413471, + 0.7404675893485546, + 0.09715302288532257, + 0.10616837814450264, + 0.20967231690883636, + 1.3711399883031845, + 3.116534136235714, + 0.739655401557684, + 0.6232173219323158, + 0.6579361576586962, + 1.0932400785386562, + 0.08060267567634583, + 1.1749233696609735, + 0.35588889569044113, + 1.6773004196584225, + 0.3721700832247734, + 1.1123832874000072, + 0.13448406383395195, + 1.0308061204850674, + 0.31967633962631226, + 0.0, + 0.6173526346683502, + 0.2993564084172249, + 1.041844580322504, + 0.6279584877192974, + 0.2297626994550228 + ], + "unique_experts": 60, + "load_cv": 0.8747046385876508, + "normalized_load_entropy": 0.919261877363748, + "max_load_share": 0.07227138643067847 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "aa5f58fbdf15742e6d769f91df74204577b74b10785b86be667ddc9863b6cee9", + "route_weight_sha256": "277a352f525027fb654bca4f908cfdc8bdbf1909160a001e327ec93191b95757", + "loads": [ + 8, + 10, + 7, + 13, + 15, + 1, + 0, + 13, + 12, + 2, + 0, + 15, + 22, + 20, + 36, + 1, + 25, + 5, + 9, + 49, + 8, + 16, + 22, + 12, + 10, + 9, + 10, + 14, + 23, + 15, + 4, + 21, + 3, + 17, + 7, + 8, + 25, + 15, + 25, + 13, + 3, + 10, + 11, + 15, + 44, + 11, + 11, + 19, + 22, + 2, + 14, + 5, + 22, + 6, + 11, + 3, + 17, + 6, + 0, + 12, + 6, + 18, + 12, + 8 + ], + "weighted_loads": [ + 0.48237550258636475, + 0.6971274092793465, + 0.28020204231143, + 0.8054111581295729, + 1.4060090389102697, + 0.04299018904566765, + 0.0, + 0.8256037048995495, + 0.6635543890297413, + 0.14723535627126694, + 0.0, + 1.0186760239303112, + 1.5188861712813377, + 1.2089520245790482, + 2.214439880102873, + 0.04988817498087883, + 1.6501270476728678, + 0.33307787775993347, + 0.504638809710741, + 2.7307958863675594, + 0.5348973274230957, + 1.107239842414856, + 1.6361573468893766, + 1.0208742916584015, + 0.5030750967562199, + 0.6153869368135929, + 0.5898243822157383, + 0.7004270926117897, + 2.7320968117564917, + 1.5430976375937462, + 0.12794384732842445, + 1.6379000023007393, + 0.1254313737154007, + 1.5323193930089474, + 0.47335394099354744, + 0.5540821105241776, + 1.3732022233307362, + 0.9850528296083212, + 2.004484612494707, + 0.7404675893485546, + 0.09715302288532257, + 0.8094039671123028, + 0.6088339611887932, + 1.3711399883031845, + 3.212611261755228, + 0.7793025448918343, + 0.6710379086434841, + 0.9848220199346542, + 1.3883232399821281, + 0.08060267567634583, + 1.1878628823906183, + 0.35588889569044113, + 1.6773004196584225, + 0.3721700832247734, + 1.1123832874000072, + 0.13448406383395195, + 1.1321108620613813, + 0.31967633962631226, + 0.0, + 0.7029321156442165, + 0.2993564084172249, + 1.2504348680377007, + 0.8251405358314514, + 0.32656865008175373 + ], + "unique_experts": 61, + "load_cv": 0.7378347394140351, + "normalized_load_entropy": 0.9366118527383884, + "max_load_share": 0.059178743961352656 + } + }, + "s1_period": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "8997af98f1b9c6caa400a3872358cbe3aef0e3702826d8e99a76a1e8c159a07a", + "route_weight_sha256": "79e09bcafa52228eb3d54fdb14bef0135f9722748f6f9b7e276341cbdf4a23f0", + "loads": [ + 8, + 12, + 6, + 10, + 13, + 3, + 0, + 10, + 7, + 1, + 0, + 17, + 16, + 22, + 34, + 0, + 20, + 5, + 9, + 49, + 8, + 15, + 20, + 6, + 9, + 9, + 8, + 6, + 8, + 7, + 1, + 17, + 2, + 17, + 8, + 0, + 21, + 12, + 11, + 11, + 2, + 2, + 5, + 14, + 41, + 10, + 10, + 12, + 18, + 2, + 12, + 5, + 24, + 5, + 11, + 4, + 15, + 6, + 0, + 9, + 6, + 13, + 9, + 5 + ], + "weighted_loads": [ + 0.49562834575772285, + 0.7620110064744949, + 0.2555302754044533, + 0.7046574987471104, + 0.7952020913362503, + 0.12748314812779427, + 0.0, + 0.5860925242304802, + 0.3165179565548897, + 0.11119259893894196, + 0.0, + 1.0952524710446596, + 1.2849334850907326, + 1.2679262794554234, + 2.139210008084774, + 0.0, + 1.3884618934243917, + 0.33302193880081177, + 0.4875193387269974, + 2.8270203713327646, + 0.5210826992988586, + 1.0813274830579758, + 1.504178248345852, + 0.5419823452830315, + 0.4546971991658211, + 0.610564861446619, + 0.5054169818758965, + 0.26771798729896545, + 0.5292983241379261, + 0.34434080496430397, + 0.037411730736494064, + 1.3422847613692284, + 0.07085343077778816, + 1.5124628283083439, + 0.5054796505719423, + 0.0, + 1.2022173814475536, + 0.9306114390492439, + 0.9150207340717316, + 0.6388092413544655, + 0.06657519564032555, + 0.10818907245993614, + 0.22844843938946724, + 1.3159385174512863, + 2.877571675926447, + 0.7218016162514687, + 0.5992806926369667, + 0.6146717071533203, + 1.0546197816729546, + 0.07757024466991425, + 1.0926070734858513, + 0.3435707874596119, + 1.757289171218872, + 0.32189858704805374, + 1.0860778279602528, + 0.17495772615075111, + 1.0676688514649868, + 0.31088415533304214, + 0.0, + 0.5628750175237656, + 0.2905859537422657, + 1.0581901483237743, + 0.7201349437236786, + 0.2339225485920906 + ], + "unique_experts": 59, + "load_cv": 0.8588023297080623, + "normalized_load_entropy": 0.9203566556190939, + "max_load_share": 0.07227138643067847 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "fb013bdcc0b08d11761f28d0ced828a2f87d4624438574df1a54575aeab82593", + "route_weight_sha256": "979da96a3570db8f8d98765831c22093f870057d5cc630cfb281230c8d4dc0e6", + "loads": [ + 12, + 12, + 6, + 12, + 16, + 3, + 0, + 18, + 14, + 4, + 1, + 17, + 20, + 23, + 34, + 0, + 23, + 7, + 10, + 49, + 8, + 17, + 22, + 13, + 9, + 9, + 11, + 13, + 27, + 21, + 13, + 22, + 6, + 22, + 13, + 8, + 21, + 16, + 29, + 11, + 2, + 16, + 14, + 16, + 55, + 14, + 13, + 19, + 26, + 2, + 14, + 5, + 24, + 8, + 11, + 4, + 16, + 12, + 0, + 12, + 8, + 22, + 14, + 5 + ], + "weighted_loads": [ + 0.6873897686600685, + 0.7620110064744949, + 0.2555302754044533, + 0.7580439504235983, + 1.4684197083115578, + 0.12748314812779427, + 0.0, + 1.0237291939556599, + 0.8025455176830292, + 0.4300977513194084, + 0.04140305519104004, + 1.0952524710446596, + 1.4547605887055397, + 1.3703018836677074, + 2.139210008084774, + 0.0, + 1.5927456077188253, + 0.44519759342074394, + 0.5232467241585255, + 2.8270203713327646, + 0.5210826992988586, + 1.1716824993491173, + 1.5911084450781345, + 1.0586970448493958, + 0.4546971991658211, + 0.610564861446619, + 0.6276595741510391, + 0.6240092851221561, + 3.0877647884190083, + 2.1955770291388035, + 0.9347972720861435, + 1.6306186933070421, + 0.248231815174222, + 1.8104099035263062, + 0.7613693010061979, + 0.6246759127825499, + 1.2022173814475536, + 1.1037017833441496, + 2.248675998300314, + 0.6388092413544655, + 0.06657519564032555, + 1.3399293348193169, + 0.770120695233345, + 1.4246162734925747, + 4.118849590420723, + 1.0302110686898232, + 0.7476242072880268, + 0.9757019635289907, + 1.4630708135664463, + 0.07757024466991425, + 1.1590598933398724, + 0.3435707874596119, + 1.757289171218872, + 0.47502781078219414, + 1.0860778279602528, + 0.17495772615075111, + 1.0954100620001554, + 0.5642495397478342, + 0.0, + 0.6777269318699837, + 0.36005333065986633, + 1.5158598497509956, + 0.9368699677288532, + 0.2339225485920906 + ], + "unique_experts": 61, + "load_cv": 0.6996265672722684, + "normalized_load_entropy": 0.9430076800012339, + "max_load_share": 0.05952380952380952 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 113, + "ordered_topk_exact_tokens": 82, + "set_exact_tokens": 90, + "mean_set_jaccard": 0.9418457648546146, + "mean_token_weighted_tv": 0.01268765944328192, + "aggregate_load_tv": 0.02654867256637168 + }, + "system_bos": { + "tokens": 113, + "ordered_topk_exact_tokens": 72, + "set_exact_tokens": 86, + "mean_set_jaccard": 0.9298356510745891, + "mean_token_weighted_tv": 0.01759576495835739, + "aggregate_load_tv": 0.029498525073746312 + }, + "system_x": { + "tokens": 113, + "ordered_topk_exact_tokens": 64, + "set_exact_tokens": 81, + "mean_set_jaccard": 0.9119258322798147, + "mean_token_weighted_tv": 0.022746936797238555, + "aggregate_load_tv": 0.029498525073746312 + }, + "system_period": { + "tokens": 113, + "ordered_topk_exact_tokens": 59, + "set_exact_tokens": 78, + "mean_set_jaccard": 0.9096080910240204, + "mean_token_weighted_tv": 0.023386791397908092, + "aggregate_load_tv": 0.03687315634218289 + }, + "bos_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 68, + "set_exact_tokens": 81, + "mean_set_jaccard": 0.9190897597977244, + "mean_token_weighted_tv": 0.01911261269773266, + "aggregate_load_tv": 0.022123893805309734 + }, + "bos_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 61, + "set_exact_tokens": 75, + "mean_set_jaccard": 0.9001264222503161, + "mean_token_weighted_tv": 0.023444288731676286, + "aggregate_load_tv": 0.035398230088495575 + }, + "x_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 61, + "set_exact_tokens": 77, + "mean_set_jaccard": 0.90897597977244, + "mean_token_weighted_tv": 0.021521027175198614, + "aggregate_load_tv": 0.030973451327433624 + }, + "x_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 54, + "set_exact_tokens": 73, + "mean_set_jaccard": 0.8935946059839865, + "mean_token_weighted_tv": 0.027350549544908304, + "aggregate_load_tv": 0.0368731563421829 + }, + "period_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 63, + "set_exact_tokens": 76, + "mean_set_jaccard": 0.9045512010113781, + "mean_token_weighted_tv": 0.022428705085035975, + "aggregate_load_tv": 0.032448377581120944 + }, + "period_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 52, + "set_exact_tokens": 70, + "mean_set_jaccard": 0.8874841972187105, + "mean_token_weighted_tv": 0.027710926620108364, + "aggregate_load_tv": 0.03687315634218289 + } + } + }, + "layer_13": { + "layer": 13, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "793ee1f08aa80320930a5e173ff9223067516b285e1ecd42bccb37f9c5d82743", + "route_weight_sha256": "335a4762bbaec9e3b9b63d99fcf70cd447936e6def0ed7c1ad526308ae2190c1", + "loads": [ + 3, + 8, + 5, + 32, + 13, + 26, + 6, + 5, + 4, + 10, + 20, + 8, + 5, + 4, + 12, + 10, + 6, + 10, + 25, + 0, + 4, + 9, + 17, + 5, + 21, + 1, + 14, + 6, + 62, + 2, + 0, + 10, + 19, + 11, + 4, + 12, + 8, + 0, + 9, + 2, + 5, + 2, + 8, + 7, + 3, + 13, + 1, + 19, + 15, + 0, + 1, + 39, + 1, + 7, + 13, + 3, + 19, + 28, + 6, + 1, + 17, + 18, + 10, + 14 + ], + "weighted_loads": [ + 0.30967239290475845, + 0.3859378509223461, + 0.2614700347185135, + 1.8738345094025135, + 0.5176747534424067, + 1.6696167942136526, + 0.23837072402238846, + 0.5438841041177511, + 0.19516339153051376, + 0.6469909735023975, + 2.433656994253397, + 0.40550856478512287, + 0.30391450226306915, + 0.22046275436878204, + 0.8293169122189283, + 0.885864831507206, + 0.37247587367892265, + 0.44095344468951225, + 1.789912186563015, + 0.0, + 0.30214730091392994, + 0.4442568998783827, + 1.1355512533336878, + 0.23316795006394386, + 1.509323988109827, + 0.033698670566082, + 0.44651661068201065, + 0.2965441048145294, + 3.985853288322687, + 0.07184989750385284, + 0.0, + 0.6641501449048519, + 1.3736566230654716, + 0.781109169125557, + 0.2904188595712185, + 1.2596010006964207, + 0.40994912944734097, + 0.0, + 0.6044968143105507, + 0.1356223151087761, + 0.28367235884070396, + 0.0633488018065691, + 0.3186853062361479, + 0.4130329489707947, + 0.16732198372483253, + 0.8518361356109381, + 0.029694635421037674, + 0.7285761311650276, + 1.858482737094164, + 0.0, + 0.02939492091536522, + 2.2704515121877193, + 0.03179901838302612, + 0.3177940584719181, + 1.1533552762120962, + 0.12174995616078377, + 0.8999421671032906, + 1.3428305238485336, + 0.294010516256094, + 0.03597467765212059, + 1.043434266000986, + 1.0359587725251913, + 0.6414567604660988, + 0.9130614027380943 + ], + "unique_experts": 60, + "load_cv": 0.9902677274511279, + "normalized_load_entropy": 0.9019691529414059, + "max_load_share": 0.09144542772861357 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "bd6c978ea69edfabba49240ebd7c1f906ee3c235b1d7ca2e518c1bfa8eb7af97", + "route_weight_sha256": "f7b78809b7886f8ad24ed833226ae465d26410b9ddd90070e146f5476468424d", + "loads": [ + 3, + 12, + 5, + 32, + 13, + 27, + 24, + 5, + 4, + 13, + 31, + 14, + 5, + 4, + 13, + 16, + 6, + 12, + 26, + 1, + 4, + 11, + 17, + 6, + 25, + 1, + 17, + 6, + 62, + 15, + 1, + 10, + 20, + 17, + 5, + 12, + 12, + 1, + 9, + 4, + 5, + 5, + 11, + 9, + 13, + 23, + 2, + 21, + 16, + 1, + 2, + 39, + 4, + 10, + 15, + 3, + 22, + 28, + 12, + 5, + 17, + 19, + 10, + 15 + ], + "weighted_loads": [ + 0.30967239290475845, + 0.5966190434992313, + 0.2614700347185135, + 1.8738345094025135, + 0.5176747534424067, + 1.7002775482833385, + 1.6873721592128277, + 0.5438841041177511, + 0.19516339153051376, + 0.7639213427901268, + 3.1435314137488604, + 0.6959338709712029, + 0.30391450226306915, + 0.22046275436878204, + 0.8747852575033903, + 1.194450855255127, + 0.37247587367892265, + 0.4884208934381604, + 1.8319259583950043, + 0.04486439377069473, + 0.30214730091392994, + 0.5502777118235826, + 1.1355512533336878, + 0.29070791602134705, + 1.6516026016324759, + 0.033698670566082, + 0.5707198083400726, + 0.2965441048145294, + 3.985853288322687, + 0.9014979973435402, + 0.04403387010097504, + 0.6641501449048519, + 1.4067957513034344, + 1.4779571518301964, + 0.31323971413075924, + 1.2596010006964207, + 0.6515406351536512, + 0.03363347426056862, + 0.6044968143105507, + 0.20351024717092514, + 0.28367235884070396, + 0.22148125432431698, + 0.4545788113027811, + 0.5092822052538395, + 0.9590831510722637, + 1.8178092297166586, + 0.0614328496158123, + 1.920248605310917, + 1.8905494697391987, + 0.04069572314620018, + 0.06800621375441551, + 2.2704515121877193, + 0.14199085906147957, + 0.45243264734745026, + 1.242462059482932, + 0.12174995616078377, + 1.0598587319254875, + 1.3428305238485336, + 0.5904791597276926, + 0.24388130381703377, + 1.043434266000986, + 1.0649494882673025, + 0.6414567604660988, + 0.9504639431834221 + ], + "unique_experts": 64, + "load_cv": 0.8241353334368607, + "normalized_load_entropy": 0.927486401437966, + "max_load_share": 0.0748792270531401 + } + }, + "s1_eos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "4d90cec3b9694fb304564d94d2956b35e5d6925b2801913810081042e6902ccb", + "route_weight_sha256": "f77aeabd8bb2d6f137c196879c57e579953c938f2e2e783efb42fd0d53b66d67", + "loads": [ + 3, + 8, + 6, + 32, + 12, + 26, + 6, + 5, + 4, + 9, + 19, + 9, + 5, + 3, + 11, + 10, + 6, + 11, + 26, + 0, + 4, + 9, + 17, + 5, + 22, + 1, + 12, + 6, + 60, + 3, + 0, + 10, + 18, + 11, + 4, + 12, + 8, + 0, + 9, + 2, + 6, + 2, + 7, + 7, + 4, + 13, + 1, + 20, + 16, + 0, + 1, + 40, + 1, + 7, + 13, + 4, + 20, + 27, + 6, + 1, + 18, + 17, + 10, + 13 + ], + "weighted_loads": [ + 0.31304042786359787, + 0.39081030897796154, + 0.2937844693660736, + 1.8830100558698177, + 0.4960523024201393, + 1.6670920830219984, + 0.2297748662531376, + 0.5465597100555897, + 0.19967031851410866, + 0.6292049027979374, + 2.381270255893469, + 0.45194162614643574, + 0.302794374525547, + 0.18672452867031097, + 0.7764777969568968, + 0.891458423808217, + 0.3746252991259098, + 0.47861431166529655, + 1.8034401945769787, + 0.0, + 0.29512419179081917, + 0.44778743013739586, + 1.1377133522182703, + 0.2313031069934368, + 1.5330358743667603, + 0.03489447385072708, + 0.3864535056054592, + 0.29071252793073654, + 3.883212059736252, + 0.11384803056716919, + 0.0, + 0.6553130932152271, + 1.345388911664486, + 0.8088880442082882, + 0.28900402784347534, + 1.2604048177599907, + 0.40877615846693516, + 0.0, + 0.6033806763589382, + 0.13465721905231476, + 0.320630069822073, + 0.05812655948102474, + 0.2710101529955864, + 0.41018839552998543, + 0.21199501864612103, + 0.8500929176807404, + 0.02935118041932583, + 0.7729767989367247, + 1.901008140295744, + 0.0, + 0.02821650542318821, + 2.289920812472701, + 0.03294793516397476, + 0.3235815688967705, + 1.1584194134920835, + 0.15261885151267052, + 0.9496741965413094, + 1.2936023212969303, + 0.29125904478132725, + 0.037115681916475296, + 1.0789475794881582, + 1.017621774226427, + 0.6391923986375332, + 0.8488911651074886 + ], + "unique_experts": 60, + "load_cv": 0.977389904802158, + "normalized_load_entropy": 0.9039787052830128, + "max_load_share": 0.08849557522123894 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "86bfd0ac2420df032cfc9835f661e85819b2a4a9d7d638532b5a227294c4e4db", + "route_weight_sha256": "ea86763f025f0221b0f3c3f4438822d44053588137b2945d87ef2027fd249d7a", + "loads": [ + 8, + 12, + 6, + 32, + 12, + 27, + 35, + 5, + 4, + 12, + 31, + 21, + 5, + 3, + 12, + 17, + 6, + 14, + 28, + 3, + 4, + 14, + 17, + 9, + 26, + 1, + 16, + 6, + 60, + 21, + 8, + 11, + 19, + 22, + 7, + 13, + 13, + 1, + 10, + 3, + 8, + 7, + 15, + 8, + 20, + 24, + 3, + 23, + 18, + 6, + 2, + 40, + 4, + 9, + 15, + 6, + 23, + 38, + 14, + 5, + 19, + 19, + 10, + 14 + ], + "weighted_loads": [ + 0.5167880393564701, + 0.6304043363779783, + 0.2937844693660736, + 1.8830100558698177, + 0.4960523024201393, + 1.7033479791134596, + 2.599177001044154, + 0.5465597100555897, + 0.19967031851410866, + 0.7512592040002346, + 3.1285173688083887, + 1.2437371206469834, + 0.302794374525547, + 0.18672452867031097, + 0.8201611321419477, + 1.2661095391958952, + 0.3746252991259098, + 0.5633981935679913, + 1.8684769365936518, + 0.12323972955346107, + 0.29512419179081917, + 0.71075289696455, + 1.1377133522182703, + 0.3966735564172268, + 1.69512930046767, + 0.03489447385072708, + 0.546816261485219, + 0.29071252793073654, + 3.883212059736252, + 1.62798722833395, + 0.45467234030365944, + 0.6953903883695602, + 1.379877407103777, + 2.006660118699074, + 0.5154600385576487, + 1.3140684887766838, + 0.7422919180244207, + 0.03331625834107399, + 0.6467354856431484, + 0.17777244746685028, + 0.4010188840329647, + 0.2950842175632715, + 0.9310726504772902, + 0.48587843403220177, + 1.4343495983630419, + 1.8119281232357025, + 0.10360612533986568, + 2.0024784933775663, + 2.1539652459323406, + 0.2797306440770626, + 0.06537091918289661, + 2.289920812472701, + 0.1382041834294796, + 0.4064418561756611, + 1.2287434935569763, + 0.22459368035197258, + 1.1022094711661339, + 2.0052558071911335, + 0.6567287594079971, + 0.24167470261454582, + 1.1067663431167603, + 1.1004365533590317, + 0.6391923986375332, + 0.9053668938577175 + ], + "unique_experts": 64, + "load_cv": 0.7584410642628211, + "normalized_load_entropy": 0.9375414663612482, + "max_load_share": 0.06493506493506493 + } + }, + "s0_bos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "7fe13098d0b9da6dccb0abd5a3e9f80d32036d4be5fe275f6a405cf9b6254653", + "route_weight_sha256": "35599145ff0c12c412f7dc924d749d69d9550d972e2b9a0b9b52cb6da4fac1b6", + "loads": [ + 3, + 10, + 5, + 31, + 11, + 29, + 7, + 4, + 4, + 9, + 20, + 7, + 5, + 3, + 12, + 12, + 6, + 7, + 24, + 0, + 4, + 9, + 17, + 5, + 19, + 1, + 12, + 7, + 63, + 3, + 0, + 11, + 19, + 11, + 4, + 13, + 8, + 0, + 10, + 2, + 5, + 0, + 7, + 6, + 3, + 13, + 1, + 18, + 15, + 0, + 1, + 41, + 1, + 8, + 14, + 4, + 20, + 27, + 8, + 2, + 15, + 19, + 10, + 13 + ], + "weighted_loads": [ + 0.3125205412507057, + 0.4785002302378416, + 0.2633998580276966, + 1.8466512449085712, + 0.4370547700673342, + 1.7671466525644064, + 0.26523416116833687, + 0.5259480625391006, + 0.2068357653915882, + 0.6072420664131641, + 2.444651026278734, + 0.4250531233847141, + 0.30479956790804863, + 0.18101456388831139, + 0.8505115266889334, + 0.9239441007375717, + 0.35097577795386314, + 0.33285546861588955, + 1.788383400067687, + 0.0, + 0.2879051882773638, + 0.4459702670574188, + 1.126487910747528, + 0.23387008160352707, + 1.4163302145898342, + 0.03448734059929848, + 0.3894835878163576, + 0.3411576449871063, + 4.087816517800093, + 0.1082441583275795, + 0.0, + 0.6822700314223766, + 1.3586628157645464, + 0.800957690924406, + 0.29432497173547745, + 1.2832272630184889, + 0.41586167737841606, + 0.0, + 0.6476873327046633, + 0.13539379090070724, + 0.2835710868239403, + 0.0, + 0.2859759647399187, + 0.308422327041626, + 0.16030795127153397, + 0.8518060017377138, + 0.02781997062265873, + 0.6714098267257214, + 1.847738642245531, + 0.0, + 0.03225398808717728, + 2.339998608455062, + 0.039224397391080856, + 0.35818679071962833, + 1.2016007732599974, + 0.15377946943044662, + 0.9295737445354462, + 1.3055146411061287, + 0.34969289042055607, + 0.06679743900895119, + 0.9550308585166931, + 1.0693049188703299, + 0.6419615745544434, + 0.8868700712919235 + ], + "unique_experts": 59, + "load_cv": 1.0024248148549184, + "normalized_load_entropy": 0.9003250321794455, + "max_load_share": 0.09292035398230089 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "78c507e74e80d99a93ae4e49e674262d88c18e3dbf14e7cf6d34ccd91b817e3b", + "route_weight_sha256": "7f4362ff46e6199c1249865ce9aa1fc32432a536f2fd73a1acf9774877b6f655", + "loads": [ + 3, + 16, + 6, + 31, + 12, + 30, + 24, + 4, + 4, + 14, + 31, + 11, + 5, + 3, + 12, + 18, + 6, + 8, + 25, + 1, + 4, + 12, + 17, + 6, + 22, + 1, + 15, + 7, + 63, + 17, + 0, + 11, + 20, + 16, + 5, + 13, + 11, + 1, + 10, + 4, + 5, + 3, + 10, + 8, + 13, + 23, + 2, + 19, + 16, + 1, + 2, + 41, + 4, + 12, + 16, + 4, + 24, + 27, + 14, + 6, + 15, + 20, + 10, + 14 + ], + "weighted_loads": [ + 0.3125205412507057, + 0.7955231796950102, + 0.3324033133685589, + 1.8466512449085712, + 0.4850969407707453, + 1.7978074066340923, + 1.7376408837735653, + 0.5259480625391006, + 0.2068357653915882, + 0.8358592949807644, + 3.0976603757590055, + 0.6457502227276564, + 0.30479956790804863, + 0.18101456388831139, + 0.8505115266889334, + 1.2325301244854927, + 0.35097577795386314, + 0.3673322256654501, + 1.8303971718996763, + 0.04486439377069473, + 0.2879051882773638, + 0.5978346168994904, + 1.126487910747528, + 0.2935442514717579, + 1.570180095732212, + 0.03448734059929848, + 0.5136867854744196, + 0.3411576449871063, + 4.087816517800093, + 0.9461118020117283, + 0.0, + 0.6822700314223766, + 1.3948414493352175, + 1.479456078261137, + 0.3171458262950182, + 1.2832272630184889, + 0.6048458553850651, + 0.03363347426056862, + 0.6476873327046633, + 0.2032817229628563, + 0.2835710868239403, + 0.15404748916625977, + 0.4464260842651129, + 0.41691796481609344, + 0.948575846850872, + 1.8177790958434343, + 0.05955818481743336, + 1.0323501341044903, + 1.8798053748905659, + 0.04579374939203262, + 0.07086528092622757, + 2.339998608455062, + 0.1494162380695343, + 0.5533351134508848, + 1.2907075565308332, + 0.15377946943044662, + 1.1990790888667107, + 1.3055146411061287, + 0.6429014075547457, + 0.27470406517386436, + 0.9550308585166931, + 1.098295634612441, + 0.6419615745544434, + 0.9242726117372513 + ], + "unique_experts": 63, + "load_cv": 0.837394710007015, + "normalized_load_entropy": 0.9249753243251041, + "max_load_share": 0.07608695652173914 + } + }, + "s1_bos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "6fb8e2a1a124cc8d5229e09c30463fe21edae559aa6a68fd9fbd14d260ec1df3", + "route_weight_sha256": "bc06b49fb30e05107f80bfdde2684e186549d24e1ce261085088d947c3b1a498", + "loads": [ + 3, + 11, + 5, + 30, + 10, + 26, + 6, + 5, + 4, + 10, + 19, + 7, + 5, + 3, + 12, + 12, + 6, + 9, + 26, + 0, + 4, + 9, + 17, + 4, + 21, + 1, + 13, + 7, + 63, + 3, + 0, + 12, + 18, + 11, + 5, + 12, + 7, + 0, + 9, + 2, + 5, + 1, + 8, + 6, + 4, + 13, + 2, + 18, + 15, + 0, + 1, + 40, + 1, + 7, + 13, + 4, + 20, + 26, + 8, + 1, + 17, + 19, + 10, + 12 + ], + "weighted_loads": [ + 0.31150712072849274, + 0.4981250520795584, + 0.2651234269142151, + 1.7846559919416904, + 0.4128183089196682, + 1.6799496281892061, + 0.25345588102936745, + 0.5739285610616207, + 0.1853724792599678, + 0.6481989398598671, + 2.3813577443361282, + 0.41417899541556835, + 0.30434830859303474, + 0.18050827831029892, + 0.8521398268640041, + 0.9221588838845491, + 0.3399563282728195, + 0.40726842544972897, + 1.9085435681045055, + 0.0, + 0.28789002262055874, + 0.4496016651391983, + 1.1629275232553482, + 0.21022294461727142, + 1.5223551541566849, + 0.038604121655225754, + 0.4263016637414694, + 0.3324216976761818, + 4.160520303994417, + 0.11448181420564651, + 0.0, + 0.7160426285117865, + 1.360990971326828, + 0.7830423079431057, + 0.3285914659500122, + 1.2515937872231007, + 0.38760647363960743, + 0.0, + 0.6283484995365143, + 0.13502376526594162, + 0.2887384742498398, + 0.029994376003742218, + 0.3115955740213394, + 0.31260713562369347, + 0.200631370767951, + 0.8505830857902765, + 0.06895493157207966, + 0.6685535125434399, + 1.8805554937571287, + 0.0, + 0.027004338800907135, + 2.305843349546194, + 0.03757914528250694, + 0.3244904726743698, + 1.1656377110630274, + 0.15117978677153587, + 0.9455855786800385, + 1.2666888236999512, + 0.3304353579878807, + 0.04040089622139931, + 1.0124565958976746, + 1.098432594910264, + 0.6390922926366329, + 0.8435452058911324 + ], + "unique_experts": 60, + "load_cv": 0.9884383106841172, + "normalized_load_entropy": 0.9034881828948003, + "max_load_share": 0.09292035398230089 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "a2713000fcd5b6d02cdfc2ed19f89bbeabce1f33584049b9710a0889dcbed2f4", + "route_weight_sha256": "65ac89abeb9815130d7615c13839bd0f616c53efca947b26ee93fbab8b3ab769", + "loads": [ + 8, + 16, + 6, + 30, + 10, + 27, + 34, + 5, + 4, + 14, + 32, + 17, + 5, + 3, + 12, + 19, + 6, + 11, + 28, + 3, + 4, + 14, + 17, + 8, + 25, + 1, + 17, + 7, + 63, + 21, + 9, + 13, + 19, + 22, + 8, + 13, + 13, + 1, + 10, + 3, + 7, + 6, + 16, + 7, + 20, + 24, + 4, + 20, + 17, + 6, + 2, + 40, + 4, + 9, + 15, + 6, + 23, + 37, + 16, + 5, + 18, + 21, + 10, + 13 + ], + "weighted_loads": [ + 0.515254732221365, + 0.8078279215842485, + 0.30527445301413536, + 1.7846559919416904, + 0.4128183089196682, + 1.7162055242806673, + 2.6616674829274416, + 0.5739285610616207, + 0.1853724792599678, + 0.836665615439415, + 3.1649888660758734, + 1.1479098349809647, + 0.30434830859303474, + 0.18050827831029892, + 0.8521398268640041, + 1.2968099992722273, + 0.3399563282728195, + 0.4783517364412546, + 1.9735803101211786, + 0.12323972955346107, + 0.28789002262055874, + 0.716407835483551, + 1.1629275232553482, + 0.38807127997279167, + 1.7535055615007877, + 0.038604121655225754, + 0.5866644196212292, + 0.3324216976761818, + 4.160520303994417, + 1.6436135321855545, + 0.48755278065800667, + 0.7561199236661196, + 1.395784679800272, + 2.0075166076421738, + 0.5550474766641855, + 1.3052574582397938, + 0.7642750646919012, + 0.03331625834107399, + 0.6717033088207245, + 0.17813899368047714, + 0.3691272884607315, + 0.2639608681201935, + 0.9873627331107855, + 0.3889929987490177, + 1.4320011008530855, + 1.8124182913452387, + 0.14320987649261951, + 1.0686922185122967, + 2.1335125993937254, + 0.2872663289308548, + 0.06415875256061554, + 2.305843349546194, + 0.14283539354801178, + 0.4073507599532604, + 1.2359617911279202, + 0.22315461561083794, + 1.098120853304863, + 1.9783423095941544, + 0.6740458831191063, + 0.24495991691946983, + 1.0402753595262766, + 1.1812473740428686, + 0.6390922926366329, + 0.9000209346413612 + ], + "unique_experts": 64, + "load_cv": 0.7630722067201786, + "normalized_load_entropy": 0.937692390181523, + "max_load_share": 0.06818181818181818 + } + }, + "s0_x": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "461d032f97bd4cda43daa05b3d11782963fc3f270dba36bfbd837078bc4faccc", + "route_weight_sha256": "d4ddbefeae7ffa61a6584f328b03c145b15aa252862831c3483f2c560dcbc760", + "loads": [ + 3, + 9, + 4, + 31, + 12, + 29, + 8, + 5, + 3, + 10, + 17, + 7, + 5, + 4, + 13, + 11, + 5, + 10, + 26, + 0, + 4, + 9, + 17, + 5, + 20, + 1, + 14, + 8, + 62, + 2, + 0, + 11, + 17, + 11, + 5, + 13, + 8, + 0, + 9, + 2, + 5, + 1, + 7, + 5, + 4, + 13, + 1, + 16, + 14, + 0, + 0, + 44, + 1, + 7, + 14, + 4, + 20, + 28, + 7, + 1, + 15, + 19, + 11, + 11 + ], + "weighted_loads": [ + 0.31161534786224365, + 0.4317316636443138, + 0.21682675927877426, + 1.8913067318499088, + 0.49033331498503685, + 1.7439520135521889, + 0.31002928875386715, + 0.5730433892458677, + 0.16937381029129028, + 0.6090287640690804, + 2.313371527940035, + 0.37958126328885555, + 0.30911509320139885, + 0.21248589269816875, + 0.9018879681825638, + 0.9077927935868502, + 0.3359624855220318, + 0.45177863724529743, + 1.8820122499018908, + 0.0, + 0.2870981153100729, + 0.44690582901239395, + 1.1481084022670984, + 0.2310483269393444, + 1.4800593666732311, + 0.03442692011594772, + 0.47343771159648895, + 0.3785895109176636, + 4.0428575202822685, + 0.07242341712117195, + 0.0, + 0.698504064232111, + 1.310139998793602, + 0.7950904481112957, + 0.3265690226107836, + 1.2817035764455795, + 0.44722344167530537, + 0.0, + 0.6037759743630886, + 0.1337157040834427, + 0.28509023413062096, + 0.030812999233603477, + 0.293386846780777, + 0.2610494941473007, + 0.20226198807358742, + 0.8413476217538118, + 0.028179841116070747, + 0.5958437118679285, + 1.812774233520031, + 0.0, + 0.0, + 2.6116680800914764, + 0.0358496755361557, + 0.31152201630175114, + 1.2016128525137901, + 0.14888495206832886, + 0.9274304378777742, + 1.353442346677184, + 0.32228255830705166, + 0.037724778056144714, + 0.9589179903268814, + 1.0619920901954174, + 0.6896543204784393, + 0.8056768216192722 + ], + "unique_experts": 59, + "load_cv": 1.010172673390976, + "normalized_load_entropy": 0.8988338388240678, + "max_load_share": 0.09144542772861357 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "16058d74042a429dd19eb5a1a1ebd2b08586096a4956a8973ebe990f2abad71c", + "route_weight_sha256": "299ca98f8769c6579ce9ee7763586a1721fb3b81ff428eb700a2f2cc64413c0f", + "loads": [ + 3, + 13, + 4, + 31, + 12, + 30, + 26, + 5, + 3, + 13, + 29, + 12, + 5, + 4, + 13, + 18, + 5, + 11, + 27, + 1, + 4, + 12, + 17, + 6, + 25, + 1, + 17, + 8, + 62, + 15, + 0, + 11, + 18, + 17, + 6, + 13, + 11, + 1, + 9, + 4, + 5, + 4, + 10, + 6, + 16, + 24, + 3, + 17, + 15, + 1, + 1, + 44, + 4, + 10, + 16, + 4, + 23, + 28, + 12, + 5, + 15, + 20, + 11, + 12 + ], + "weighted_loads": [ + 0.31161534786224365, + 0.6376753561198711, + 0.21682675927877426, + 1.8913067318499088, + 0.49033331498503685, + 1.7746127676218748, + 1.7609581518918276, + 0.5730433892458677, + 0.16937381029129028, + 0.7148948684334755, + 2.96561043523252, + 0.6548673622310162, + 0.30911509320139885, + 0.21248589269816875, + 0.9018879681825638, + 1.4353408757597208, + 0.3359624855220318, + 0.486255394294858, + 1.92402602173388, + 0.04486439377069473, + 0.2870981153100729, + 0.6004440374672413, + 1.1481084022670984, + 0.300696175545454, + 1.716965425759554, + 0.03442692011594772, + 0.5976409092545509, + 0.3785895109176636, + 4.0428575202822685, + 0.859947182238102, + 0.0, + 0.698504064232111, + 1.3511055372655392, + 1.4966059513390064, + 0.3493898771703243, + 1.2817035764455795, + 0.6355931628495455, + 0.03363347426056862, + 0.6037759743630886, + 0.20160363614559174, + 0.28509023413062096, + 0.18345692194998264, + 0.428426131606102, + 0.30597251653671265, + 1.105568215250969, + 2.006820799782872, + 0.08845829218626022, + 0.9567840192466974, + 1.8448409661650658, + 0.04005884751677513, + 0.03861129283905029, + 2.6116680800914764, + 0.14604151621460915, + 0.4461606051772833, + 1.290719635784626, + 0.14888495206832886, + 1.0873470026999712, + 1.353442346677184, + 0.5998622458428144, + 0.2456314042210579, + 0.9589179903268814, + 1.0909828059375286, + 0.6896543204784393, + 0.8430793620646 + ], + "unique_experts": 63, + "load_cv": 0.8468173251970944, + "normalized_load_entropy": 0.9234959597084696, + "max_load_share": 0.0748792270531401 + } + }, + "s1_x": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "5606c048e337ecf9d34cdebe5dbd7b68b4fc805d3ef6a163d05c0d345a814eae", + "route_weight_sha256": "96818e94fdcda942092eab64a00f1c92412690c1ff927c87b2a8e7eb6ee262d1", + "loads": [ + 3, + 10, + 5, + 31, + 9, + 25, + 7, + 7, + 3, + 9, + 19, + 7, + 5, + 4, + 10, + 11, + 6, + 10, + 26, + 0, + 4, + 9, + 17, + 4, + 20, + 1, + 15, + 8, + 66, + 4, + 0, + 12, + 18, + 11, + 4, + 12, + 5, + 0, + 10, + 2, + 6, + 2, + 5, + 6, + 4, + 13, + 2, + 19, + 14, + 0, + 0, + 41, + 1, + 7, + 13, + 4, + 19, + 27, + 7, + 1, + 16, + 18, + 12, + 12 + ], + "weighted_loads": [ + 0.31411728262901306, + 0.4721650183200836, + 0.26921702548861504, + 1.8522570095956326, + 0.36298086680471897, + 1.62266393750906, + 0.28449302539229393, + 0.6206185296177864, + 0.14008234813809395, + 0.5825487710535526, + 2.3507160656154156, + 0.3871390875428915, + 0.3052821345627308, + 0.1828626524657011, + 0.7499103136360645, + 0.9202548526227474, + 0.35557541996240616, + 0.44871455058455467, + 1.9390539340674877, + 0.0, + 0.28476671874523163, + 0.46795405074954033, + 1.1474278140813112, + 0.19420252367854118, + 1.496190082281828, + 0.038145098835229874, + 0.5065288618206978, + 0.37100400030612946, + 4.283207958564162, + 0.14826574362814426, + 0.0, + 0.7257302515208721, + 1.3564760498702526, + 0.777377612888813, + 0.29265257716178894, + 1.2198737896978855, + 0.33323555439710617, + 0.0, + 0.6646988391876221, + 0.13261505216360092, + 0.32118842750787735, + 0.07035408914089203, + 0.2240505963563919, + 0.28761620074510574, + 0.19989335536956787, + 0.8609320987015963, + 0.07428330928087234, + 0.7008531652390957, + 1.847330991178751, + 0.0, + 0.0, + 2.435401914641261, + 0.031726349145174026, + 0.3169249650090933, + 1.1512712519615889, + 0.151184793561697, + 0.9221468903124332, + 1.256738904863596, + 0.2935237865895033, + 0.04094327986240387, + 0.9839529916644096, + 1.03719075396657, + 0.7140018902719021, + 0.8531538248062134 + ], + "unique_experts": 59, + "load_cv": 1.0152593559121454, + "normalized_load_entropy": 0.9007247159894398, + "max_load_share": 0.09734513274336283 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "ddbb0d42cc0ebc0263209e27412bdaa120cdbd1ed25bdb237ecb946a9c6b58d0", + "route_weight_sha256": "bb62647a747074601fbf0c1281ddad6ed212690dc7475fdc1600a6704c382739", + "loads": [ + 8, + 14, + 5, + 31, + 9, + 26, + 34, + 7, + 3, + 10, + 30, + 17, + 5, + 4, + 10, + 19, + 6, + 12, + 28, + 3, + 4, + 14, + 17, + 8, + 25, + 1, + 20, + 8, + 66, + 22, + 8, + 13, + 19, + 23, + 7, + 13, + 10, + 1, + 11, + 3, + 8, + 8, + 13, + 6, + 22, + 25, + 5, + 21, + 16, + 6, + 1, + 41, + 4, + 9, + 15, + 7, + 22, + 39, + 14, + 5, + 17, + 21, + 12, + 13 + ], + "weighted_loads": [ + 0.5178648941218853, + 0.693855807185173, + 0.26921702548861504, + 1.8522570095956326, + 0.36298086680471897, + 1.658919833600521, + 2.4942547623068094, + 0.6206185296177864, + 0.14008234813809395, + 0.6131141372025013, + 2.9730802197009325, + 1.1310464069247246, + 0.3052821345627308, + 0.1828626524657011, + 0.7499103136360645, + 1.4374406263232231, + 0.35557541996240616, + 0.5197978615760803, + 2.004090676084161, + 0.12323972955346107, + 0.28476671874523163, + 0.7310996688902378, + 1.1474278140813112, + 0.35894374176859856, + 1.7180835455656052, + 0.038145098835229874, + 0.6993310134857893, + 0.37100400030612946, + 4.283207958564162, + 1.5897672977298498, + 0.45162419974803925, + 0.7658075466752052, + 1.4001988396048546, + 1.9768727831542492, + 0.5191085878759623, + 1.2735374607145786, + 0.641910295933485, + 0.03331625834107399, + 0.7080536484718323, + 0.17573028057813644, + 0.4015772417187691, + 0.3217272087931633, + 0.8831712435930967, + 0.28761620074510574, + 1.535714142024517, + 1.967707784846425, + 0.19186757504940033, + 1.1009918712079525, + 2.1002880968153477, + 0.2791612930595875, + 0.037154413759708405, + 2.435401914641261, + 0.13698259741067886, + 0.3997852522879839, + 1.2215953320264816, + 0.2634291797876358, + 1.0746821649372578, + 2.012357261031866, + 0.5620088782161474, + 0.2455023005604744, + 1.0117717552930117, + 1.154626488685608, + 0.7140018902719021, + 0.9096295535564423 + ], + "unique_experts": 64, + "load_cv": 0.7854369658354754, + "normalized_load_entropy": 0.935503505271892, + "max_load_share": 0.07142857142857142 + } + }, + "s0_period": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "07bc98c467fcc3563b2032a02899ad82f38cde9f61644e5c697c2e6f1584b6aa", + "route_weight_sha256": "5ae44d4f190798d863363a8844ecbd17856cc44fb793989bcd63b4e10e3aa8de", + "loads": [ + 3, + 9, + 5, + 31, + 11, + 27, + 7, + 4, + 3, + 9, + 17, + 6, + 6, + 3, + 12, + 11, + 6, + 8, + 26, + 0, + 4, + 9, + 17, + 5, + 21, + 1, + 16, + 6, + 62, + 3, + 0, + 11, + 17, + 11, + 5, + 13, + 8, + 0, + 9, + 2, + 6, + 1, + 9, + 5, + 4, + 13, + 1, + 16, + 14, + 0, + 1, + 43, + 1, + 7, + 14, + 4, + 21, + 30, + 7, + 1, + 16, + 19, + 10, + 11 + ], + "weighted_loads": [ + 0.31067442148923874, + 0.4455770459026098, + 0.2524085231125355, + 1.8741290047764778, + 0.45051291957497597, + 1.6613039895892143, + 0.2701768334954977, + 0.5334329642355442, + 0.1627153567969799, + 0.586241576820612, + 2.291632067412138, + 0.3526708781719208, + 0.33933467231690884, + 0.18265590444207191, + 0.8643570207059383, + 0.9070309177041054, + 0.36565786600112915, + 0.3727499172091484, + 1.8916526101529598, + 0.0, + 0.2969129905104637, + 0.45220425724983215, + 1.1578820459544659, + 0.22308814711868763, + 1.4982593022286892, + 0.036098163574934006, + 0.5351515393704176, + 0.3057759329676628, + 4.035850798711181, + 0.11907409876585007, + 0.0, + 0.708732258528471, + 1.3274923339486122, + 0.810566421598196, + 0.31788746640086174, + 1.2947879564017057, + 0.4227155800908804, + 0.0, + 0.6099862419068813, + 0.1346270963549614, + 0.3143453262746334, + 0.030591147020459175, + 0.3549668975174427, + 0.2679666504263878, + 0.22036872431635857, + 0.828586757183075, + 0.027518998831510544, + 0.5966470446437597, + 1.8015317134559155, + 0.0, + 0.028971726074814796, + 2.550957404077053, + 0.03461509570479393, + 0.31632976047694683, + 1.212731571868062, + 0.15016206353902817, + 0.9675207026302814, + 1.4455867260694504, + 0.3270433060824871, + 0.03727874159812927, + 0.9901718385517597, + 1.0655525960028172, + 0.6494862511754036, + 0.8035980351269245 + ], + "unique_experts": 60, + "load_cv": 1.0083793691179532, + "normalized_load_entropy": 0.9000085035265539, + "max_load_share": 0.09144542772861357 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "d5dfad644757940d45e5ae4e1d85cfd88f9b874333c11b9350c82c2b272ee041", + "route_weight_sha256": "747dd7a0b80922a25fbdee36ab6a21ac2f8b69965bec07695c8a8ea254086e09", + "loads": [ + 3, + 14, + 5, + 31, + 11, + 28, + 24, + 4, + 3, + 12, + 28, + 11, + 6, + 3, + 12, + 17, + 6, + 9, + 27, + 1, + 4, + 13, + 17, + 6, + 25, + 1, + 19, + 6, + 62, + 17, + 0, + 11, + 18, + 18, + 6, + 13, + 12, + 1, + 9, + 4, + 6, + 5, + 12, + 7, + 15, + 23, + 2, + 17, + 15, + 1, + 2, + 43, + 4, + 10, + 16, + 4, + 24, + 30, + 12, + 5, + 16, + 20, + 10, + 12 + ], + "weighted_loads": [ + 0.31067442148923874, + 0.8367386888712645, + 0.2524085231125355, + 1.8741290047764778, + 0.45051291957497597, + 1.6919647436589003, + 1.6507193613797426, + 0.5334329642355442, + 0.1627153567969799, + 0.7033576890826225, + 2.966867921873927, + 0.6416330654174089, + 0.33933467231690884, + 0.18265590444207191, + 0.8643570207059383, + 1.2156169414520264, + 0.36565786600112915, + 0.40722667425870895, + 1.9336663819849491, + 0.04486439377069473, + 0.2969129905104637, + 0.6286794822663069, + 1.1578820459544659, + 0.2898601535707712, + 1.7700376734137535, + 0.036098163574934006, + 0.6593547370284796, + 0.3057759329676628, + 4.035850798711181, + 0.9781070463359356, + 0.0, + 0.708732258528471, + 1.3676671460270882, + 1.5532119199633598, + 0.3407083209604025, + 1.2947879564017057, + 0.6829613018780947, + 0.03363347426056862, + 0.6099862419068813, + 0.20251502841711044, + 0.3143453262746334, + 0.23103838227689266, + 0.4791176952421665, + 0.37714382261037827, + 1.0633741468191147, + 1.7945598512887955, + 0.05925721302628517, + 0.9575873520225286, + 1.8335984461009502, + 0.05212266743183136, + 0.06758301891386509, + 2.550957404077053, + 0.14480693638324738, + 0.450968349352479, + 1.301838355138898, + 0.15016206353902817, + 1.1274372674524784, + 1.4455867260694504, + 0.5799253545701504, + 0.24518536776304245, + 0.9901718385517597, + 1.0945433117449284, + 0.6494862511754036, + 0.8410005755722523 + ], + "unique_experts": 63, + "load_cv": 0.839732484359913, + "normalized_load_entropy": 0.924638873289332, + "max_load_share": 0.0748792270531401 + } + }, + "s1_period": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "31990000f633445732ce62bf27594d5ac29e031bb9a147143e750ebdc525c854", + "route_weight_sha256": "101e91ebda5e1fec7e886fc2bf6fb2db2df4f5eb61c4d3e811cabcfee75a483b", + "loads": [ + 3, + 10, + 7, + 30, + 11, + 26, + 5, + 6, + 3, + 9, + 20, + 6, + 5, + 4, + 11, + 12, + 6, + 8, + 25, + 0, + 4, + 7, + 17, + 4, + 20, + 1, + 16, + 8, + 64, + 3, + 0, + 12, + 18, + 11, + 4, + 13, + 5, + 0, + 10, + 2, + 6, + 2, + 6, + 7, + 4, + 13, + 2, + 21, + 14, + 0, + 0, + 40, + 1, + 8, + 13, + 4, + 20, + 28, + 5, + 1, + 16, + 18, + 10, + 13 + ], + "weighted_loads": [ + 0.3197691813111305, + 0.4596596974879503, + 0.32789270393550396, + 1.8227486200630665, + 0.42970204912126064, + 1.6319231763482094, + 0.18214446492493153, + 0.5881987437605858, + 0.13112960010766983, + 0.5729351341724396, + 2.379440937191248, + 0.3583257123827934, + 0.30184306763112545, + 0.20393719337880611, + 0.7906094826757908, + 0.9352857209742069, + 0.34143930673599243, + 0.3744928129017353, + 1.9229166619479656, + 0.0, + 0.29369769990444183, + 0.3849138803780079, + 1.168974980711937, + 0.18821245431900024, + 1.4908010885119438, + 0.038351453840732574, + 0.5151486452668905, + 0.36839088797569275, + 4.194001443684101, + 0.12369414791464806, + 0.0, + 0.7244881018996239, + 1.3618021681904793, + 0.7621573694050312, + 0.28328029811382294, + 1.2526179160922766, + 0.3260273989289999, + 0.0, + 0.6780324578285217, + 0.13076994568109512, + 0.31225381046533585, + 0.07796939834952354, + 0.263967489823699, + 0.3666658215224743, + 0.1975112184882164, + 0.8607034869492054, + 0.06971308775246143, + 0.7753980476409197, + 1.86498449370265, + 0.0, + 0.0, + 2.383940586820245, + 0.032482896000146866, + 0.3524318765848875, + 1.1456200685352087, + 0.1528732255101204, + 0.9379392117261887, + 1.2845022641122341, + 0.25506292656064034, + 0.039660707116127014, + 0.9838219881057739, + 1.0418289806693792, + 0.6470668613910675, + 0.8681045137345791 + ], + "unique_experts": 59, + "load_cv": 1.0046445858622506, + "normalized_load_entropy": 0.9004940700223947, + "max_load_share": 0.0943952802359882 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "75138b4e8fbf979f8a95dee4a85414ae8cc5d66633be4ae9e6369b3c59138680", + "route_weight_sha256": "f0bf45444afeb3079c276959d4d320a240c7fb921ad575c8e2e932ba5e5aafeb", + "loads": [ + 8, + 15, + 7, + 30, + 11, + 27, + 32, + 6, + 3, + 11, + 31, + 17, + 5, + 4, + 11, + 19, + 6, + 10, + 27, + 3, + 4, + 12, + 17, + 8, + 24, + 1, + 20, + 8, + 64, + 22, + 8, + 14, + 19, + 24, + 7, + 14, + 11, + 1, + 11, + 3, + 8, + 7, + 14, + 8, + 22, + 25, + 4, + 23, + 16, + 6, + 1, + 40, + 4, + 10, + 15, + 6, + 23, + 40, + 11, + 5, + 17, + 20, + 10, + 14 + ], + "weighted_loads": [ + 0.5235167928040028, + 0.8411257434636354, + 0.32789270393550396, + 1.8227486200630665, + 0.42970204912126064, + 1.6681790724396706, + 2.366128586232662, + 0.5881987437605858, + 0.13112960010766983, + 0.6337869577109814, + 3.0676841903477907, + 1.1303145196288824, + 0.30184306763112545, + 0.20393719337880611, + 0.7906094826757908, + 1.309936836361885, + 0.34143930673599243, + 0.44557612389326096, + 1.9879534039646387, + 0.12323972955346107, + 0.29369769990444183, + 0.6498249545693398, + 1.168974980711937, + 0.3446517698466778, + 1.7922507263720036, + 0.038351453840732574, + 0.6755114011466503, + 0.36839088797569275, + 4.194001443684101, + 1.6429852098226547, + 0.46401742100715637, + 0.797667920589447, + 1.4072511941194534, + 2.0192465260624886, + 0.5097363088279963, + 1.3062815871089697, + 0.707493806257844, + 0.03331625834107399, + 0.7213872671127319, + 0.17388517409563065, + 0.39264262467622757, + 0.3148205354809761, + 0.9096214435994625, + 0.4061349406838417, + 1.5179716404527426, + 1.8542395420372486, + 0.1439680326730013, + 1.1755367536097765, + 2.1179415993392467, + 0.28607814759016037, + 0.037154413759708405, + 2.383940586820245, + 0.1377391442656517, + 0.4352921638637781, + 1.2159441486001015, + 0.22484805434942245, + 1.0904744863510132, + 2.031106561422348, + 0.4888218007981777, + 0.24421972781419754, + 1.011640751734376, + 1.1246437598019838, + 0.6470668613910675, + 0.924580242484808 + ], + "unique_experts": 64, + "load_cv": 0.772930357587977, + "normalized_load_entropy": 0.9366130497579199, + "max_load_share": 0.06926406926406926 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 113, + "ordered_topk_exact_tokens": 80, + "set_exact_tokens": 95, + "mean_set_jaccard": 0.95448798988622, + "mean_token_weighted_tv": 0.010893615902261396, + "aggregate_load_tv": 0.02064896755162242 + }, + "system_bos": { + "tokens": 113, + "ordered_topk_exact_tokens": 63, + "set_exact_tokens": 81, + "mean_set_jaccard": 0.9190897597977244, + "mean_token_weighted_tv": 0.017072739079594612, + "aggregate_load_tv": 0.02654867256637168 + }, + "system_x": { + "tokens": 113, + "ordered_topk_exact_tokens": 57, + "set_exact_tokens": 77, + "mean_set_jaccard": 0.9032869785082174, + "mean_token_weighted_tv": 0.02238993069766897, + "aggregate_load_tv": 0.03982300884955752 + }, + "system_period": { + "tokens": 113, + "ordered_topk_exact_tokens": 53, + "set_exact_tokens": 70, + "mean_set_jaccard": 0.8836915297092288, + "mean_token_weighted_tv": 0.02514080474960857, + "aggregate_load_tv": 0.04277286135693216 + }, + "bos_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 58, + "set_exact_tokens": 77, + "mean_set_jaccard": 0.90897597977244, + "mean_token_weighted_tv": 0.018650927185286992, + "aggregate_load_tv": 0.035398230088495575 + }, + "bos_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 58, + "set_exact_tokens": 73, + "mean_set_jaccard": 0.8988621997471556, + "mean_token_weighted_tv": 0.021615223044249336, + "aggregate_load_tv": 0.03097345132743363 + }, + "x_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 55, + "set_exact_tokens": 74, + "mean_set_jaccard": 0.8994943109987359, + "mean_token_weighted_tv": 0.02161774361522588, + "aggregate_load_tv": 0.038348082595870206 + }, + "x_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 46, + "set_exact_tokens": 63, + "mean_set_jaccard": 0.8697850821744629, + "mean_token_weighted_tv": 0.027749968486615515, + "aggregate_load_tv": 0.04129793510324484 + }, + "period_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 53, + "set_exact_tokens": 74, + "mean_set_jaccard": 0.9013906447534766, + "mean_token_weighted_tv": 0.02162716312713064, + "aggregate_load_tv": 0.03982300884955753 + }, + "period_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 48, + "set_exact_tokens": 64, + "mean_set_jaccard": 0.8723135271807839, + "mean_token_weighted_tv": 0.026882632874545797, + "aggregate_load_tv": 0.03982300884955752 + } + } + }, + "layer_14": { + "layer": 14, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "300655b9abc2b7c2a04c742b5d92aae985acd7583d89018b4db6e1c00d20f1b6", + "route_weight_sha256": "1803354ee6019f45b5b42d0a608eaaa26b0793401fbed8a336a05987a0337695", + "loads": [ + 14, + 4, + 18, + 5, + 12, + 7, + 2, + 11, + 13, + 4, + 17, + 4, + 2, + 12, + 12, + 14, + 2, + 10, + 3, + 15, + 19, + 16, + 1, + 6, + 2, + 17, + 9, + 13, + 5, + 19, + 12, + 13, + 4, + 1, + 5, + 12, + 6, + 11, + 17, + 7, + 14, + 22, + 10, + 0, + 27, + 6, + 21, + 19, + 9, + 7, + 1, + 14, + 8, + 0, + 8, + 12, + 11, + 7, + 11, + 20, + 10, + 9, + 13, + 43 + ], + "weighted_loads": [ + 1.3853178769350052, + 0.15825817734003067, + 0.9020190052688122, + 0.1947254203259945, + 0.786377988755703, + 0.5806219819933176, + 0.05168576259166002, + 0.4107742942869663, + 0.7234119158238173, + 0.23907045274972916, + 0.9473387598991394, + 0.12302392162382603, + 0.08156740665435791, + 2.047683723270893, + 0.5677811093628407, + 0.8178716469556093, + 0.06792281195521355, + 0.7358936704695225, + 0.44514933973550797, + 2.3602857291698456, + 1.4336611069738865, + 1.2745176069438457, + 0.04899193346500397, + 0.3022715114057064, + 0.07415148988366127, + 0.9198133964091539, + 0.8904303219169378, + 0.7113047055900097, + 0.30886833369731903, + 1.2145694606006145, + 0.626499243080616, + 0.5440214909613132, + 0.302767988294363, + 0.0887451171875, + 0.28093789517879486, + 0.637175539508462, + 0.2942458651959896, + 0.8086006939411163, + 1.2751230839639902, + 0.665047861635685, + 0.6123009081929922, + 1.0981168579310179, + 0.4377239290624857, + 0.0, + 1.2751786354929209, + 0.40071477741003036, + 2.1085922475904226, + 2.2157474476844072, + 0.8095018956810236, + 0.780225396156311, + 0.047414205968379974, + 0.7869613021612167, + 0.8076848648488522, + 0.0, + 0.35719545744359493, + 0.66086295992136, + 1.286632776260376, + 0.30621681548655033, + 0.5152053833007812, + 1.3704711440950632, + 0.5418385043740273, + 0.6023517958819866, + 1.0737792328000069, + 2.8403061758726835 + ], + "unique_experts": 62, + "load_cv": 0.6905868701946164, + "normalized_load_entropy": 0.9429703632220787, + "max_load_share": 0.06342182890855458 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "7bc29d49ff91cf638eb3faa9a3e82c23788952f49607358ec510b18fe37e2b1a", + "route_weight_sha256": "e9a67acecbfa605a9b2a356a45a65b36594c53b2b6c4ca6efdbea712e5724cd1", + "loads": [ + 20, + 4, + 18, + 7, + 12, + 18, + 2, + 13, + 13, + 12, + 19, + 7, + 2, + 12, + 13, + 19, + 2, + 10, + 8, + 16, + 19, + 16, + 1, + 17, + 3, + 17, + 15, + 19, + 13, + 19, + 15, + 18, + 4, + 8, + 5, + 12, + 8, + 12, + 19, + 7, + 14, + 22, + 11, + 1, + 29, + 6, + 27, + 21, + 9, + 8, + 4, + 19, + 14, + 6, + 8, + 16, + 11, + 7, + 11, + 33, + 10, + 10, + 13, + 44 + ], + "weighted_loads": [ + 2.042597534134984, + 0.15825817734003067, + 0.9020190052688122, + 0.2713233679533005, + 0.786377988755703, + 1.5476653333753347, + 0.05168576259166002, + 0.4836384579539299, + 0.7234119158238173, + 0.8788185343146324, + 1.0135764796286821, + 0.3130842987447977, + 0.08156740665435791, + 2.047683723270893, + 0.6073777265846729, + 1.1519594099372625, + 0.06792281195521355, + 0.7358936704695225, + 0.8285802211612463, + 2.400155909359455, + 1.4336611069738865, + 1.2745176069438457, + 0.04899193346500397, + 0.7790824398398399, + 0.09674151241779327, + 0.9198133964091539, + 1.2359440568834543, + 1.1032017534598708, + 1.4245471507310867, + 1.2145694606006145, + 0.8273217082023621, + 0.7453546244651079, + 0.302767988294363, + 0.6944915242493153, + 0.28093789517879486, + 0.637175539508462, + 0.39049579203128815, + 0.8511809259653091, + 1.3811889048665762, + 0.665047861635685, + 0.6123009081929922, + 1.0981168579310179, + 0.48677302710711956, + 0.0483388714492321, + 1.3390313144773245, + 0.40071477741003036, + 2.4078409634530544, + 2.3021250776946545, + 0.8095018956810236, + 0.82291579246521, + 0.172641322016716, + 2.07997564971447, + 1.5538046024739742, + 0.42256834730505943, + 0.35719545744359493, + 1.0206436663866043, + 1.286632776260376, + 0.30621681548655033, + 0.5152053833007812, + 1.9312129616737366, + 0.5418385043740273, + 0.6073736762627959, + 1.0737792328000069, + 2.8873485904186964 + ], + "unique_experts": 64, + "load_cv": 0.6024330855248143, + "normalized_load_entropy": 0.9570405813995845, + "max_load_share": 0.05314009661835749 + } + }, + "s1_eos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "96d3ef3ef4bb26defa79c9e771f2d3c0fb8d54b9c84142a20746ab1ce9ec5182", + "route_weight_sha256": "4c92717a417df31d7b4a1d32819c5d2c09d5a9eddc841b3463590d88b54df730", + "loads": [ + 14, + 3, + 18, + 5, + 12, + 7, + 2, + 10, + 13, + 4, + 17, + 4, + 3, + 11, + 14, + 13, + 2, + 11, + 3, + 14, + 18, + 18, + 1, + 6, + 2, + 16, + 9, + 13, + 6, + 19, + 11, + 11, + 3, + 1, + 5, + 12, + 6, + 12, + 17, + 7, + 16, + 22, + 9, + 0, + 29, + 6, + 21, + 18, + 10, + 7, + 1, + 13, + 8, + 0, + 9, + 12, + 11, + 7, + 10, + 19, + 9, + 9, + 13, + 46 + ], + "weighted_loads": [ + 1.3827023729681969, + 0.11838678643107414, + 0.9090910814702511, + 0.18794164434075356, + 0.7930141277611256, + 0.5853247717022896, + 0.05529021192342043, + 0.3805636391043663, + 0.7132590133696795, + 0.2549484372138977, + 0.9767118263989687, + 0.12341206707060337, + 0.11008875630795956, + 2.0257479324936867, + 0.6164971571415663, + 0.795685563236475, + 0.06852759420871735, + 0.7723817620426416, + 0.4403417631983757, + 2.290616098791361, + 1.3981495089828968, + 1.2958588562905788, + 0.050103332847356796, + 0.3059343919157982, + 0.07264624536037445, + 0.8828270938247442, + 0.8771179169416428, + 0.7288373615592718, + 0.3300487454980612, + 1.2016018815338612, + 0.6105866394937038, + 0.486269298940897, + 0.2736956402659416, + 0.08862610906362534, + 0.2776339016854763, + 0.6442971453070641, + 0.3020603284239769, + 0.8452299274504185, + 1.2787559311836958, + 0.6678959056735039, + 0.6987574622035027, + 1.091245710849762, + 0.38914231583476067, + 0.0, + 1.3010297771543264, + 0.40562883391976357, + 2.1045980267226696, + 2.17695989087224, + 0.8220638707280159, + 0.77215276658535, + 0.049934133887290955, + 0.7695418410003185, + 0.8146742396056652, + 0.0, + 0.3874204698950052, + 0.6525385305285454, + 1.287665892392397, + 0.3111446127295494, + 0.4779910482466221, + 1.293343560770154, + 0.4985335245728493, + 0.5979385003447533, + 1.0771161913871765, + 2.935846623033285 + ], + "unique_experts": 62, + "load_cv": 0.7141750707086623, + "normalized_load_entropy": 0.9411927495807031, + "max_load_share": 0.06784660766961652 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "75833e64ea364af831c7931a249137be29a45422706ca2c1cd531979751faa71", + "route_weight_sha256": "4d9ebeed642c893d01003e48ff875091dd6413d55f1a5b5d12fd755b0b7f98aa", + "loads": [ + 21, + 4, + 18, + 8, + 16, + 24, + 2, + 14, + 15, + 15, + 17, + 7, + 8, + 11, + 15, + 19, + 2, + 11, + 10, + 18, + 20, + 21, + 1, + 16, + 8, + 18, + 14, + 21, + 19, + 20, + 16, + 14, + 5, + 12, + 6, + 13, + 7, + 15, + 20, + 8, + 16, + 22, + 11, + 1, + 31, + 6, + 27, + 20, + 13, + 8, + 15, + 17, + 16, + 9, + 11, + 15, + 12, + 8, + 11, + 39, + 12, + 11, + 15, + 49 + ], + "weighted_loads": [ + 2.1252007707953453, + 0.17004387080669403, + 0.9090910814702511, + 0.29837751761078835, + 1.0449002869427204, + 1.772517278790474, + 0.05529021192342043, + 0.5448580123484135, + 0.8821964580565691, + 1.172533005475998, + 0.9767118263989687, + 0.3390010576695204, + 0.46147878654301167, + 2.0257479324936867, + 0.648022660985589, + 1.1714945137500763, + 0.06852759420871735, + 0.7723817620426416, + 0.9835284538567066, + 2.492898980155587, + 1.6277130953967571, + 1.4187832958996296, + 0.050103332847356796, + 0.7276570722460747, + 0.35078008845448494, + 0.9566913917660713, + 1.2457466796040535, + 1.0365675296634436, + 1.9680524375289679, + 1.249828401952982, + 0.859689936041832, + 0.5757725350558758, + 0.3524645157158375, + 1.1900415010750294, + 0.3239506930112839, + 0.72372617572546, + 0.3477604016661644, + 1.19862412661314, + 1.4736125562340021, + 0.7272237502038479, + 0.6987574622035027, + 1.091245710849762, + 0.4885425232350826, + 0.044879086315631866, + 1.3648066315799952, + 0.40562883391976357, + 2.4283870607614517, + 2.2448618914932013, + 0.980165284126997, + 0.8063059784471989, + 0.950529407709837, + 2.03394578024745, + 1.6201713681221008, + 0.7027744203805923, + 0.46890891529619694, + 0.956123523414135, + 1.3387274257838726, + 0.34846485778689384, + 0.5876605324447155, + 2.3831408713012934, + 0.7506521791219711, + 0.6441238061524928, + 1.1814611293375492, + 3.0431526824831963 + ], + "unique_experts": 64, + "load_cv": 0.5645493035320418, + "normalized_load_entropy": 0.9632411742423105, + "max_load_share": 0.05303030303030303 + } + }, + "s0_bos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "eab88191f0dd55ff3bb36bc1807ff8a4c22ae9ad6a3bdacfd4977dc77ded3e96", + "route_weight_sha256": "e16f96ff85848ecd1bb25fe5f1d3917a2f305f1a96dfcdd5003e2a0db4a3e33e", + "loads": [ + 15, + 7, + 21, + 6, + 13, + 6, + 1, + 10, + 13, + 4, + 18, + 4, + 2, + 12, + 10, + 14, + 1, + 9, + 3, + 15, + 19, + 15, + 1, + 6, + 2, + 17, + 9, + 11, + 7, + 19, + 11, + 11, + 5, + 1, + 5, + 13, + 9, + 12, + 15, + 9, + 13, + 21, + 11, + 0, + 22, + 7, + 23, + 18, + 10, + 7, + 2, + 13, + 8, + 0, + 7, + 12, + 11, + 5, + 9, + 19, + 9, + 10, + 13, + 47 + ], + "weighted_loads": [ + 1.4151131585240364, + 0.26475576870143414, + 1.0481959655880928, + 0.2190736960619688, + 0.8270639330148697, + 0.5579511690884829, + 0.03887490555644035, + 0.3692683819681406, + 0.727811211720109, + 0.2332441285252571, + 0.980379119515419, + 0.1277425792068243, + 0.0835212767124176, + 2.108085388317704, + 0.5351917874068022, + 0.8156836945563555, + 0.033646050840616226, + 0.7075842395424843, + 0.45137258991599083, + 2.3569474555552006, + 1.471623845398426, + 1.2758109495043755, + 0.046299129724502563, + 0.3023458495736122, + 0.0785495974123478, + 0.9159314818680286, + 0.8819649629294872, + 0.6812140066176653, + 0.3747711982578039, + 1.1965072825551033, + 0.5905018039047718, + 0.46407627686858177, + 0.3385479375720024, + 0.07731172442436218, + 0.2716740369796753, + 0.6818228885531425, + 0.4034188333898783, + 0.8445385619997978, + 1.2059783264994621, + 0.7439510226249695, + 0.5795643664896488, + 1.1100515276193619, + 0.4678043033927679, + 0.0, + 1.077199007384479, + 0.40017977729439735, + 2.162655744701624, + 2.1297057438641787, + 0.855118976905942, + 0.77801663428545, + 0.07084564305841923, + 0.7446699645370245, + 0.7844538316130638, + 0.0, + 0.31174342706799507, + 0.6758706979453564, + 1.2973931021988392, + 0.2373809739947319, + 0.4352791868150234, + 1.3394684754312038, + 0.4919152408838272, + 0.6194373145699501, + 1.074938803911209, + 3.054120283573866 + ], + "unique_experts": 62, + "load_cv": 0.7003958743707236, + "normalized_load_entropy": 0.9432536197657088, + "max_load_share": 0.06932153392330384 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "cdab40582d7043dd3575fd46f20b18410b675e1d6029513854a43b89b437c933", + "route_weight_sha256": "839e638b8440ac3a8d190b61cfcb6190193090b56f71041c1a1e6b45ab446a75", + "loads": [ + 21, + 7, + 21, + 9, + 13, + 16, + 1, + 11, + 13, + 12, + 20, + 7, + 2, + 12, + 11, + 19, + 1, + 9, + 9, + 16, + 19, + 15, + 1, + 16, + 3, + 17, + 15, + 17, + 16, + 19, + 14, + 15, + 5, + 8, + 5, + 13, + 11, + 13, + 17, + 9, + 13, + 21, + 11, + 1, + 25, + 7, + 29, + 20, + 10, + 8, + 5, + 18, + 14, + 6, + 7, + 16, + 11, + 6, + 10, + 32, + 9, + 10, + 13, + 48 + ], + "weighted_loads": [ + 2.0723928157240152, + 0.26475576870143414, + 1.0481959655880928, + 0.33729483745992184, + 0.8270639330148697, + 1.4880311731249094, + 0.03887490555644035, + 0.402808615937829, + 0.727811211720109, + 0.9107369855046272, + 1.0466168392449617, + 0.317802956327796, + 0.0835212767124176, + 2.108085388317704, + 0.5748162847012281, + 1.1551158968359232, + 0.033646050840616226, + 0.7075842395424843, + 0.9112540315836668, + 2.39681763574481, + 1.471623845398426, + 1.2758109495043755, + 0.046299129724502563, + 0.7514582481235266, + 0.1011396199464798, + 0.9159314818680286, + 1.2274786978960037, + 1.133663496002555, + 1.5736506190150976, + 1.1965072825551033, + 0.7909302562475204, + 0.6663490459322929, + 0.3385479375720024, + 0.683987207710743, + 0.2716740369796753, + 0.6818228885531425, + 0.5017784032970667, + 0.8871187940239906, + 1.3186684548854828, + 0.7439510226249695, + 0.5795643664896488, + 1.1100515276193619, + 0.4678043033927679, + 0.0483388714492321, + 1.2130056014284492, + 0.40017977729439735, + 2.448198078200221, + 2.216083373874426, + 0.855118976905942, + 0.8207070305943489, + 0.2041232418268919, + 1.232919979840517, + 1.5305735692381859, + 0.42256834730505943, + 0.31174342706799507, + 1.0697933174669743, + 1.2973931021988392, + 0.28014538809657097, + 0.47662319988012314, + 1.9055679589509964, + 0.4919152408838272, + 0.6194373145699501, + 1.074938803911209, + 3.1043093502521515 + ], + "unique_experts": 64, + "load_cv": 0.6053701043133372, + "normalized_load_entropy": 0.9575352226659748, + "max_load_share": 0.057971014492753624 + } + }, + "s1_bos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "1648f74f0c8864a5065feb1afe731125ec93654a3e1832f524674eb3e75a897a", + "route_weight_sha256": "6a1d3ce8f65aaa015d9e808febf0499efc491f4f9b8ddac395acb9aa51a4f42a", + "loads": [ + 13, + 6, + 19, + 6, + 12, + 8, + 2, + 9, + 13, + 4, + 19, + 4, + 2, + 12, + 12, + 14, + 0, + 10, + 3, + 15, + 19, + 17, + 1, + 6, + 2, + 17, + 9, + 12, + 5, + 19, + 11, + 12, + 3, + 1, + 4, + 11, + 11, + 12, + 15, + 8, + 13, + 17, + 11, + 0, + 27, + 6, + 22, + 18, + 10, + 7, + 2, + 13, + 8, + 1, + 10, + 12, + 11, + 6, + 9, + 19, + 10, + 10, + 13, + 45 + ], + "weighted_loads": [ + 1.3585282918065786, + 0.2240984309464693, + 0.9517062455415726, + 0.23122150637209415, + 0.8034353591501713, + 0.6419350113719702, + 0.055869968608021736, + 0.33240113593637943, + 0.7143960669636726, + 0.22279700636863708, + 1.0314881019294262, + 0.12869605980813503, + 0.0874063428491354, + 2.1150277499109507, + 0.6020008213818073, + 0.7958043925464153, + 0.0, + 0.7576247453689575, + 0.45462358742952347, + 2.390444589778781, + 1.4566316958516836, + 1.3356285281479359, + 0.04709051921963692, + 0.31686877831816673, + 0.07896909490227699, + 0.9042965415865183, + 0.873102804645896, + 0.6842697160318494, + 0.2755446322262287, + 1.1971873883157969, + 0.6160730421543121, + 0.490203145891428, + 0.2676481604576111, + 0.08202286064624786, + 0.2342274710536003, + 0.6120180357247591, + 0.4745290484279394, + 0.8477688729763031, + 1.208660189062357, + 0.7197159379720688, + 0.5767647661268711, + 0.9542996324598789, + 0.46273026801645756, + 0.0, + 1.2711026687175035, + 0.37847596779465675, + 2.134106282144785, + 2.158664895221591, + 0.833759393543005, + 0.7654229253530502, + 0.08683522790670395, + 0.7573177423328161, + 0.7817010208964348, + 0.043491773307323456, + 0.41473823599517345, + 0.6592497229576111, + 1.2960505187511444, + 0.2720479816198349, + 0.4458084888756275, + 1.3960869051516056, + 0.5212466195225716, + 0.6042981222271919, + 1.0722974464297295, + 2.9780516419559717 + ], + "unique_experts": 62, + "load_cv": 0.6909899634534302, + "normalized_load_entropy": 0.9438403843452136, + "max_load_share": 0.06637168141592921 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "7500a9311103d252890fe088768d840e3bfbaa1cdaba3e4ff71900643cb79f0a", + "route_weight_sha256": "03613b6db4928f439b0bc96c00ff937bcae58ef29d95c54bed9e04c64d410688", + "loads": [ + 20, + 7, + 19, + 8, + 15, + 24, + 2, + 12, + 15, + 15, + 20, + 7, + 7, + 12, + 13, + 21, + 0, + 10, + 10, + 19, + 21, + 19, + 1, + 15, + 8, + 19, + 14, + 20, + 19, + 20, + 16, + 15, + 5, + 12, + 5, + 12, + 12, + 15, + 18, + 9, + 13, + 17, + 12, + 1, + 29, + 7, + 28, + 21, + 13, + 8, + 17, + 17, + 16, + 10, + 12, + 15, + 12, + 8, + 10, + 39, + 13, + 11, + 15, + 49 + ], + "weighted_loads": [ + 2.101026689633727, + 0.2757555153220892, + 0.9517062455415726, + 0.3203724753111601, + 1.0115616619586945, + 1.7714848201721907, + 0.055869968608021736, + 0.45923307351768017, + 0.8833335116505623, + 1.1519402638077736, + 1.063355766236782, + 0.34428505040705204, + 0.4387963730841875, + 2.1150277499109507, + 0.6390617899596691, + 1.1999038979411125, + 0.0, + 0.7576247453689575, + 0.9438732676208019, + 2.5927274711430073, + 1.686195282265544, + 1.4103594720363617, + 0.04709051921963692, + 0.7110342439264059, + 0.3571029379963875, + 0.9781608395278454, + 1.2417315673083067, + 1.0776746040210128, + 2.098697926849127, + 1.2454139087349176, + 0.8795739039778709, + 0.6281200535595417, + 0.34641703590750694, + 1.168538935482502, + 0.2805442623794079, + 0.6914470661431551, + 0.5191552359610796, + 1.2011630721390247, + 1.410771906375885, + 0.7790437825024128, + 0.5767647661268711, + 0.9542996324598789, + 0.5171365570276976, + 0.044879086315631866, + 1.3348795231431723, + 0.4145926795899868, + 2.454964142292738, + 2.2620047703385353, + 0.9918608069419861, + 0.7995761372148991, + 1.021764937788248, + 1.197121148929, + 1.5871981494128704, + 0.7462661936879158, + 0.49622668139636517, + 1.0137799680233002, + 1.34711205214262, + 0.3522444777190685, + 0.5554779730737209, + 2.505114868283272, + 0.7733652740716934, + 0.645727202296257, + 1.1766423843801022, + 3.129499452188611 + ], + "unique_experts": 63, + "load_cv": 0.5576019729794809, + "normalized_load_entropy": 0.9633299104563955, + "max_load_share": 0.05303030303030303 + } + }, + "s0_x": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "fca0dfe61036908773a6f2e0ec2505c08838ea9bfa2f11b094c7cba36df7921d", + "route_weight_sha256": "df08ecf2dca9390d6468b4851f3122ad871fbe0f00b14e0d8479055531c6b31c", + "loads": [ + 15, + 7, + 20, + 4, + 13, + 7, + 1, + 10, + 13, + 4, + 20, + 4, + 2, + 12, + 10, + 14, + 1, + 10, + 2, + 14, + 19, + 17, + 1, + 4, + 2, + 17, + 9, + 11, + 5, + 19, + 12, + 10, + 4, + 1, + 5, + 13, + 9, + 11, + 15, + 8, + 10, + 21, + 10, + 0, + 28, + 8, + 22, + 17, + 9, + 7, + 2, + 14, + 8, + 1, + 9, + 12, + 11, + 6, + 9, + 20, + 10, + 10, + 13, + 46 + ], + "weighted_loads": [ + 1.4131400417536497, + 0.2849206496030092, + 1.0188711620867252, + 0.15341676771640778, + 0.8406344018876553, + 0.6087673120200634, + 0.03802157938480377, + 0.3694916646927595, + 0.7604851759970188, + 0.23222488164901733, + 1.069637168198824, + 0.12838007509708405, + 0.08258378878235817, + 2.127371709793806, + 0.5179925505071878, + 0.8229077607393265, + 0.033921029418706894, + 0.749396063387394, + 0.4063337445259094, + 2.307077817618847, + 1.458470195531845, + 1.3275664653629065, + 0.04892537742853165, + 0.23192963376641273, + 0.08033640310168266, + 0.9266910664737225, + 0.8800222333520651, + 0.6920921970158815, + 0.3042237348854542, + 1.2273902632296085, + 0.6409672237932682, + 0.41781967878341675, + 0.29697103053331375, + 0.08316697180271149, + 0.2913414537906647, + 0.6491418480873108, + 0.3908988069742918, + 0.786852914839983, + 1.1898055970668793, + 0.7114843539893627, + 0.46312365122139454, + 1.1234187707304955, + 0.4592744577676058, + 0.0, + 1.287600421346724, + 0.42978932801634073, + 2.1317853406071663, + 2.1178524643182755, + 0.8502205163240433, + 0.7988850995898247, + 0.08482294157147408, + 0.772992093116045, + 0.7736947871744633, + 0.04281598702073097, + 0.3956922683864832, + 0.6758575513958931, + 1.3342644199728966, + 0.2773122005164623, + 0.4219488874077797, + 1.4483429789543152, + 0.5251596700400114, + 0.6165726780891418, + 1.0827426724135876, + 3.0216636043041945 + ], + "unique_experts": 63, + "load_cv": 0.7149544322808808, + "normalized_load_entropy": 0.9413986384618138, + "max_load_share": 0.06784660766961652 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "46073004d30da1d481569a6ee0e1a57cf6b3e0cbbd44010bda7f0b8295511634", + "route_weight_sha256": "98e2b4c5cb46d9b72d481d74cc551b19526480fe628a7a8ed2e37f73d3e8579a", + "loads": [ + 22, + 7, + 20, + 6, + 14, + 20, + 1, + 12, + 13, + 11, + 22, + 7, + 2, + 12, + 11, + 19, + 1, + 10, + 7, + 16, + 19, + 17, + 1, + 14, + 3, + 17, + 16, + 16, + 13, + 19, + 15, + 14, + 4, + 8, + 5, + 13, + 11, + 13, + 16, + 8, + 10, + 21, + 10, + 1, + 30, + 8, + 28, + 19, + 9, + 8, + 5, + 17, + 14, + 8, + 9, + 16, + 11, + 7, + 9, + 34, + 10, + 10, + 13, + 46 + ], + "weighted_loads": [ + 2.175740025937557, + 0.2849206496030092, + 1.0188711620867252, + 0.23678869009017944, + 0.8887633830308914, + 1.7478372976183891, + 0.03802157938480377, + 0.45068938843905926, + 0.7604851759970188, + 0.7402095422148705, + 1.1358748879283667, + 0.3184404522180557, + 0.08258378878235817, + 2.127371709793806, + 0.5552769992500544, + 1.1141047962009907, + 0.033921029418706894, + 0.749396063387394, + 0.7728440929204226, + 2.42111986130476, + 1.458470195531845, + 1.3275664653629065, + 0.04892537742853165, + 0.6810420323163271, + 0.10292642563581467, + 0.9266910664737225, + 1.3354510013014078, + 1.0719506721943617, + 1.2812169678509235, + 1.2273902632296085, + 0.8366974219679832, + 0.614736907184124, + 0.29697103053331375, + 0.7119397819042206, + 0.2913414537906647, + 0.6491418480873108, + 0.4929788466542959, + 0.9046629704535007, + 1.2489096596837044, + 0.7114843539893627, + 0.46312365122139454, + 1.1234187707304955, + 0.4592744577676058, + 0.0483388714492321, + 1.3514531003311276, + 0.42978932801634073, + 2.421560013666749, + 2.2042300943285227, + 0.8502205163240433, + 0.8415754958987236, + 0.22041378170251846, + 1.1816654037684202, + 1.5198145247995853, + 0.5499134659767151, + 0.3956922683864832, + 1.0304083451628685, + 1.3342644199728966, + 0.3180411197245121, + 0.4219488874077797, + 2.0707715898752213, + 0.5251596700400114, + 0.6165726780891418, + 1.0827426724135876, + 3.0216636043041945 + ], + "unique_experts": 64, + "load_cv": 0.6147046394332898, + "normalized_load_entropy": 0.956185771574257, + "max_load_share": 0.05555555555555555 + } + }, + "s1_x": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "5c4dff62cb14cfb6bb53d0873a5a8b21d991ca4fbbe44d0a1de6fa9e3d00e957", + "route_weight_sha256": "87a58a348cf27977fd3cb620af1c16bfe9c352e9466eed1b1f1c4a606171b940", + "loads": [ + 13, + 7, + 20, + 4, + 12, + 7, + 1, + 10, + 12, + 4, + 19, + 4, + 2, + 12, + 13, + 14, + 2, + 13, + 4, + 14, + 17, + 17, + 1, + 6, + 2, + 17, + 8, + 10, + 4, + 20, + 11, + 9, + 3, + 2, + 5, + 10, + 13, + 12, + 16, + 8, + 12, + 18, + 9, + 0, + 29, + 8, + 23, + 16, + 9, + 7, + 3, + 13, + 9, + 1, + 10, + 12, + 11, + 6, + 8, + 19, + 9, + 10, + 13, + 45 + ], + "weighted_loads": [ + 1.3658260498195887, + 0.27902355417609215, + 0.994837686419487, + 0.14335530437529087, + 0.8083643279969692, + 0.6265622563660145, + 0.04850160330533981, + 0.3591654412448406, + 0.7100427597761154, + 0.2353963814675808, + 1.0110644064843655, + 0.1286752913147211, + 0.08456932567059994, + 2.086280722171068, + 0.6094551719725132, + 0.8079900164157152, + 0.0717097856104374, + 0.8696876130998135, + 0.48035916686058044, + 2.329794403165579, + 1.3539730310440063, + 1.3331349231302738, + 0.045183781534433365, + 0.3114771395921707, + 0.0805496908724308, + 0.9172048978507519, + 0.8410633783787489, + 0.6283308230340481, + 0.21883191168308258, + 1.232613818719983, + 0.6533390507102013, + 0.39501651749014854, + 0.261396586894989, + 0.11036601662635803, + 0.26686806604266167, + 0.5804693698883057, + 0.5341307483613491, + 0.8390983678400517, + 1.2135555781424046, + 0.7250700891017914, + 0.528472263365984, + 0.9827537573873997, + 0.4013976491987705, + 0.0, + 1.326076460070908, + 0.42722547613084316, + 2.168952226638794, + 2.1018768548965454, + 0.8202384114265442, + 0.7878722175955772, + 0.11945950426161289, + 0.7371596712619066, + 0.8022235799580812, + 0.04370740428566933, + 0.4181532543152571, + 0.6761324517428875, + 1.2986932918429375, + 0.2981199398636818, + 0.3855340704321861, + 1.3460870198905468, + 0.495579332113266, + 0.5884130820631981, + 1.0837025046348572, + 2.924073724076152 + ], + "unique_experts": 63, + "load_cv": 0.6952083319618879, + "normalized_load_entropy": 0.9453072872254312, + "max_load_share": 0.06637168141592921 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "af8acdb17bf6821ae49880a60af1b68a1bafb2fce8a813ba73a6e7729d0543bc", + "route_weight_sha256": "1ec338a9b12f30f06ebf2afdea635c41484fdfba051da621f6066f2fd13f6db3", + "loads": [ + 21, + 8, + 20, + 6, + 16, + 27, + 1, + 14, + 14, + 14, + 19, + 8, + 7, + 12, + 13, + 19, + 2, + 13, + 10, + 18, + 19, + 19, + 1, + 16, + 8, + 20, + 14, + 17, + 17, + 21, + 17, + 11, + 5, + 13, + 7, + 11, + 14, + 16, + 19, + 9, + 12, + 18, + 11, + 1, + 31, + 8, + 29, + 18, + 12, + 8, + 17, + 16, + 17, + 11, + 12, + 15, + 12, + 7, + 9, + 38, + 12, + 11, + 15, + 48 + ], + "weighted_loads": [ + 2.1882851738482714, + 0.33068063855171204, + 0.994837686419487, + 0.21739915944635868, + 1.0628933645784855, + 2.0603235587477684, + 0.04850160330533981, + 0.5260644741356373, + 0.8789802044630051, + 0.962567899376154, + 1.0110644064843655, + 0.3915728013962507, + 0.43595935590565205, + 2.086280722171068, + 0.6094551719725132, + 1.1052613575011492, + 0.0717097856104374, + 0.8696876130998135, + 0.9329091869294643, + 2.532077284529805, + 1.5835366174578667, + 1.4078658670186996, + 0.045183781534433365, + 0.760049493983388, + 0.3586835339665413, + 1.0220204181969166, + 1.312899535521865, + 0.9230992812663317, + 1.6310600563883781, + 1.280840339139104, + 0.9257406964898109, + 0.4737543500959873, + 0.3401654623448849, + 1.166434284299612, + 0.34587693586945534, + 0.6598984003067017, + 0.5778044834733009, + 1.2863858416676521, + 1.390547476708889, + 0.7843979336321354, + 0.528472263365984, + 0.9827537573873997, + 0.5116956979036331, + 0.044879086315631866, + 1.3898533144965768, + 0.42722547613084316, + 2.4805486127734184, + 2.1697788555175066, + 0.9783398248255253, + 0.8220254294574261, + 1.0148217137902975, + 1.1489805858582258, + 1.6077207084745169, + 0.8672365956008434, + 0.4996416997164488, + 0.9183867461979389, + 1.3497548252344131, + 0.33544018492102623, + 0.49520355463027954, + 2.410743620246649, + 0.7476979866623878, + 0.6298421621322632, + 1.1880474425852299, + 3.031379783526063 + ], + "unique_experts": 64, + "load_cv": 0.552334132011305, + "normalized_load_entropy": 0.9647147836321752, + "max_load_share": 0.05194805194805195 + } + }, + "s0_period": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "a86cf2e4a7bdb6ad2f27044b2d7692a559453773e787dd1592a09f4d7ada4b44", + "route_weight_sha256": "61ac41c7908213759a1b10db21fe63c9f675c04946b94a19c528f6a535023881", + "loads": [ + 13, + 7, + 20, + 4, + 12, + 8, + 1, + 11, + 13, + 4, + 19, + 4, + 2, + 12, + 11, + 13, + 2, + 10, + 2, + 14, + 19, + 17, + 1, + 5, + 2, + 16, + 9, + 11, + 6, + 19, + 11, + 10, + 4, + 2, + 4, + 13, + 10, + 11, + 15, + 8, + 11, + 21, + 9, + 0, + 27, + 9, + 21, + 17, + 10, + 7, + 2, + 14, + 8, + 0, + 9, + 12, + 11, + 7, + 9, + 21, + 10, + 10, + 13, + 45 + ], + "weighted_loads": [ + 1.3507851865142584, + 0.277728620916605, + 1.0110667645931244, + 0.1531916745007038, + 0.8097617626190186, + 0.6274883300065994, + 0.03575447201728821, + 0.4001103825867176, + 0.7497424259781837, + 0.25452838465571404, + 1.0469575058668852, + 0.12547699362039566, + 0.08231167122721672, + 2.101372465491295, + 0.558685652911663, + 0.8356067724525928, + 0.06751852855086327, + 0.7442486993968487, + 0.396877259016037, + 2.3039722703397274, + 1.4472458809614182, + 1.3267148323357105, + 0.05106906220316887, + 0.2649698071181774, + 0.07689693942666054, + 0.8804296869784594, + 0.8925951160490513, + 0.6980951204895973, + 0.36960354819893837, + 1.226507306098938, + 0.6112036108970642, + 0.42734570801258087, + 0.2956971116364002, + 0.12424829229712486, + 0.2527666687965393, + 0.6584274657070637, + 0.4238912742584944, + 0.7831214517354965, + 1.1929459124803543, + 0.7108032591640949, + 0.5143924430012703, + 1.120144683867693, + 0.4127887338399887, + 0.0, + 1.2611921411007643, + 0.44460275676101446, + 2.1064961142838, + 2.1122276354581118, + 0.8559036944061518, + 0.7987797930836678, + 0.08733337000012398, + 0.76814254373312, + 0.7561198435723782, + 0.0, + 0.4021169953048229, + 0.6725190691649914, + 1.322672601789236, + 0.31792918406426907, + 0.4204428158700466, + 1.4496055208146572, + 0.5234454814344645, + 0.6182630509138107, + 1.090240877121687, + 2.960776664316654 + ], + "unique_experts": 62, + "load_cv": 0.6944068088756595, + "normalized_load_entropy": 0.9438794132299714, + "max_load_share": 0.06637168141592921 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "345c4c723c2b185987a842d492626b862b3b135287a7fb37d8431f139a3c6be6", + "route_weight_sha256": "54505e1e9ee22291c12ca2a01b53894a266a93a1526b53ea783050e3763c49ec", + "loads": [ + 20, + 7, + 20, + 6, + 13, + 20, + 1, + 13, + 13, + 11, + 21, + 7, + 2, + 12, + 11, + 18, + 2, + 10, + 7, + 15, + 19, + 17, + 1, + 15, + 3, + 16, + 16, + 16, + 14, + 19, + 14, + 14, + 4, + 9, + 4, + 13, + 12, + 13, + 16, + 8, + 11, + 21, + 9, + 1, + 29, + 9, + 26, + 20, + 10, + 9, + 6, + 17, + 14, + 7, + 9, + 16, + 11, + 8, + 9, + 35, + 10, + 11, + 13, + 45 + ], + "weighted_loads": [ + 2.053019940853119, + 0.277728620916605, + 1.0110667645931244, + 0.23547568172216415, + 0.8554541245102882, + 1.6728871427476406, + 0.03575447201728821, + 0.48159413039684296, + 0.7497424259781837, + 0.7885775826871395, + 1.113195225596428, + 0.31553737074136734, + 0.08231167122721672, + 2.101372465491295, + 0.558685652911663, + 1.1456362269818783, + 0.06751852855086327, + 0.7442486993968487, + 0.7675264049321413, + 2.343842450529337, + 1.4472458809614182, + 1.3267148323357105, + 0.05106906220316887, + 0.7140822056680918, + 0.09948696196079254, + 0.8804296869784594, + 1.2905891053378582, + 1.08168563246727, + 1.4303074963390827, + 1.226507306098938, + 0.8058698698878288, + 0.6184529028832912, + 0.2956971116364002, + 0.7457445189356804, + 0.2527666687965393, + 0.6584274657070637, + 0.5234180111438036, + 0.8853178322315216, + 1.2520499750971794, + 0.7108032591640949, + 0.5143924430012703, + 1.120144683867693, + 0.4127887338399887, + 0.0483388714492321, + 1.3250448200851679, + 0.44460275676101446, + 2.339539946988225, + 2.264546874910593, + 0.8559036944061518, + 0.8883950263261795, + 0.269879836589098, + 1.1750357318669558, + 1.5022395811975002, + 0.5094132982194424, + 0.4021169953048229, + 1.0885040201246738, + 1.322672601789236, + 0.35700770281255245, + 0.4204428158700466, + 2.0518658366054296, + 0.5234454814344645, + 0.6592210568487644, + 1.090240877121687, + 2.960776664316654 + ], + "unique_experts": 64, + "load_cv": 0.5968285729523263, + "normalized_load_entropy": 0.9585740567734211, + "max_load_share": 0.05434782608695652 + } + }, + "s1_period": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "663b9fa35393c9199b7947ea24808d5183366cc30f7963837b53ebd076d4e365", + "route_weight_sha256": "41187da323ee7b3bdcc59d23e55f7424694e4c9e398898e93259b4e1abb32b5b", + "loads": [ + 17, + 6, + 19, + 6, + 12, + 8, + 1, + 10, + 12, + 4, + 19, + 4, + 2, + 12, + 12, + 14, + 2, + 11, + 3, + 14, + 18, + 15, + 1, + 6, + 2, + 21, + 8, + 12, + 4, + 20, + 10, + 10, + 3, + 1, + 4, + 9, + 12, + 12, + 15, + 9, + 11, + 17, + 10, + 0, + 31, + 8, + 21, + 17, + 9, + 7, + 2, + 12, + 9, + 1, + 10, + 12, + 11, + 6, + 7, + 20, + 9, + 10, + 13, + 45 + ], + "weighted_loads": [ + 1.4757135696709156, + 0.2433641441166401, + 0.9526084177196026, + 0.22293450869619846, + 0.7871844843029976, + 0.6574552021920681, + 0.044361330568790436, + 0.3652147725224495, + 0.7013254389166832, + 0.2293013595044613, + 1.0228628683835268, + 0.1297012809664011, + 0.08302950114011765, + 2.1186836287379265, + 0.5633137691766024, + 0.79750095307827, + 0.06817660853266716, + 0.7951220106333494, + 0.4283182956278324, + 2.3273042254149914, + 1.3815485537052155, + 1.2467474974691868, + 0.047591451555490494, + 0.321246225386858, + 0.07904966175556183, + 1.0709629580378532, + 0.8603022899478674, + 0.693987812846899, + 0.21129538118839264, + 1.2460024878382683, + 0.6004430316388607, + 0.42622682824730873, + 0.25332553684711456, + 0.06644337624311447, + 0.2391672134399414, + 0.5372366867959499, + 0.507664093747735, + 0.8374930247664452, + 1.1620951257646084, + 0.7286721039563417, + 0.5192468464374542, + 0.9214177429676056, + 0.4373148940503597, + 0.0, + 1.3952221861109138, + 0.466234028339386, + 2.1218426302075386, + 2.1644204016774893, + 0.8072835989296436, + 0.7852178514003754, + 0.0881488285958767, + 0.7147613037377596, + 0.7775247115641832, + 0.04144864156842232, + 0.4228479228913784, + 0.6713474877178669, + 1.2863015606999397, + 0.3043841887265444, + 0.34760598838329315, + 1.3605693764984608, + 0.48263879865407944, + 0.5778677277266979, + 1.0744332447648048, + 2.9609856866300106 + ], + "unique_experts": 63, + "load_cv": 0.7088919688227073, + "normalized_load_entropy": 0.9428730975549705, + "max_load_share": 0.06637168141592921 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "1533d017aa2cee23840adaed0847c5acb793aa29f9dc00f8484546a64ebcf2b7", + "route_weight_sha256": "2d2ff9aa3fbacaa0aa514f67dd10379abe7bfdd0b28265fce756b0c450b4a7d9", + "loads": [ + 25, + 7, + 19, + 8, + 15, + 26, + 1, + 14, + 14, + 15, + 19, + 7, + 7, + 12, + 12, + 19, + 2, + 11, + 9, + 18, + 20, + 17, + 1, + 15, + 9, + 23, + 14, + 18, + 17, + 21, + 17, + 12, + 5, + 11, + 5, + 10, + 13, + 16, + 17, + 11, + 11, + 17, + 11, + 1, + 33, + 8, + 26, + 20, + 12, + 9, + 16, + 15, + 17, + 11, + 12, + 15, + 12, + 9, + 8, + 40, + 12, + 12, + 15, + 50 + ], + "weighted_loads": [ + 2.277084417641163, + 0.29502122849226, + 0.9526084177196026, + 0.29526606388390064, + 0.9953107871115208, + 1.9029474668204784, + 0.044361330568790436, + 0.5319897383451462, + 0.8702628836035728, + 1.0371689647436142, + 1.0228628683835268, + 0.3452902715653181, + 0.43441953137516975, + 2.1186836287379265, + 0.5633137691766024, + 1.0917274244129658, + 0.06817660853266716, + 0.7951220106333494, + 0.9065572917461395, + 2.5295871067792177, + 1.6111121401190758, + 1.3214784413576126, + 0.047591451555490494, + 0.7154116909950972, + 0.3940095007419586, + 1.1448272559791803, + 1.2706471737474203, + 0.9447839464992285, + 1.6000971794128418, + 1.294229008257389, + 0.918600294739008, + 0.5049646608531475, + 0.3320944122970104, + 1.1000881157815456, + 0.285484004765749, + 0.6166657172143459, + 0.5545696374028921, + 1.2972463630139828, + 1.3033208958804607, + 0.823586942628026, + 0.5192468464374542, + 0.9214177429676056, + 0.49172118306159973, + 0.044879086315631866, + 1.4589990405365825, + 0.466234028339386, + 2.3953081592917442, + 2.275993950664997, + 0.9653850123286247, + 0.8607081510126591, + 0.993001863360405, + 1.1300263833254576, + 1.5830218400806189, + 0.8255739398300648, + 0.5043363682925701, + 0.9856608472764492, + 1.3373630940914154, + 0.4304762203246355, + 0.45727547258138657, + 2.4555598106235266, + 0.7347574532032013, + 0.6560289077460766, + 1.1787781827151775, + 3.1456868574023247 + ], + "unique_experts": 64, + "load_cv": 0.5728533987615897, + "normalized_load_entropy": 0.9630248617044694, + "max_load_share": 0.05411255411255411 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 113, + "ordered_topk_exact_tokens": 80, + "set_exact_tokens": 91, + "mean_set_jaccard": 0.9443742098609356, + "mean_token_weighted_tv": 0.01221811529084117, + "aggregate_load_tv": 0.025073746312684362 + }, + "system_bos": { + "tokens": 113, + "ordered_topk_exact_tokens": 68, + "set_exact_tokens": 78, + "mean_set_jaccard": 0.9039190897597977, + "mean_token_weighted_tv": 0.0194288295636003, + "aggregate_load_tv": 0.035398230088495575 + }, + "system_x": { + "tokens": 113, + "ordered_topk_exact_tokens": 49, + "set_exact_tokens": 71, + "mean_set_jaccard": 0.8824273072060683, + "mean_token_weighted_tv": 0.02594051645673086, + "aggregate_load_tv": 0.038348082595870206 + }, + "system_period": { + "tokens": 113, + "ordered_topk_exact_tokens": 56, + "set_exact_tokens": 71, + "mean_set_jaccard": 0.8843236409608093, + "mean_token_weighted_tv": 0.026633906532573488, + "aggregate_load_tv": 0.04424778761061947 + }, + "bos_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 64, + "set_exact_tokens": 78, + "mean_set_jaccard": 0.9058154235145386, + "mean_token_weighted_tv": 0.01962075316536743, + "aggregate_load_tv": 0.045722713864306784 + }, + "bos_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 60, + "set_exact_tokens": 74, + "mean_set_jaccard": 0.8957016434892541, + "mean_token_weighted_tv": 0.02274017063159067, + "aggregate_load_tv": 0.04129793510324484 + }, + "x_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 53, + "set_exact_tokens": 70, + "mean_set_jaccard": 0.8874841972187105, + "mean_token_weighted_tv": 0.02347355037185866, + "aggregate_load_tv": 0.039823008849557515 + }, + "x_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 46, + "set_exact_tokens": 63, + "mean_set_jaccard": 0.8584070796460178, + "mean_token_weighted_tv": 0.029319015298599163, + "aggregate_load_tv": 0.05014749262536873 + }, + "period_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 57, + "set_exact_tokens": 74, + "mean_set_jaccard": 0.8957016434892541, + "mean_token_weighted_tv": 0.022227335902573787, + "aggregate_load_tv": 0.03982300884955752 + }, + "period_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 53, + "set_exact_tokens": 67, + "mean_set_jaccard": 0.8704171934260431, + "mean_token_weighted_tv": 0.027731994488400167, + "aggregate_load_tv": 0.05604719764011799 + } + } + }, + "layer_15": { + "layer": 15, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "1a9d52ac732de053854b368d83ec304d9217c0c25d29c0b3e50c5d20bd5430dd", + "route_weight_sha256": "d3c15472220a2210e60dc727172b0304cd8d41e01c55461e601a9da826d07794", + "loads": [ + 8, + 8, + 7, + 0, + 11, + 10, + 11, + 9, + 0, + 0, + 10, + 16, + 12, + 6, + 5, + 4, + 6, + 5, + 1, + 10, + 15, + 14, + 8, + 2, + 1, + 24, + 19, + 22, + 10, + 27, + 10, + 5, + 7, + 18, + 3, + 6, + 21, + 8, + 67, + 6, + 8, + 10, + 12, + 13, + 8, + 5, + 8, + 12, + 18, + 5, + 21, + 11, + 21, + 6, + 6, + 10, + 8, + 8, + 11, + 0, + 26, + 7, + 11, + 1 + ], + "weighted_loads": [ + 0.4784231297671795, + 0.7812559343874454, + 0.7035963535308838, + 0.0, + 0.5991037860512733, + 0.41297199577093124, + 1.4410947188735008, + 0.4506859611719847, + 0.0, + 0.0, + 0.890509270131588, + 1.2401829175651073, + 0.735245194286108, + 0.29155729338526726, + 0.27630533650517464, + 0.2147519774734974, + 0.34427595511078835, + 0.3113905154168606, + 0.04040059447288513, + 0.6670567188411951, + 1.0526718627661467, + 0.8809431903064251, + 0.4191586375236511, + 0.25632851384580135, + 0.10368835180997849, + 1.566629733890295, + 1.5536364912986755, + 1.6666214521974325, + 0.4918686654418707, + 1.3356763310730457, + 0.5522306133061647, + 0.17821460217237473, + 0.2930297404527664, + 1.29255885258317, + 0.1727612055838108, + 0.4070710763335228, + 2.210596337914467, + 0.42613306269049644, + 5.4746222058311105, + 0.25065633095800877, + 0.8875570674426854, + 0.5697252321988344, + 0.8925366476178169, + 0.8221309147775173, + 0.30594904720783234, + 0.33032144978642464, + 0.750445768237114, + 1.169141311198473, + 1.0534863714128733, + 0.3029012903571129, + 2.3992308005690575, + 0.41716896183788776, + 3.197825960814953, + 0.335500979796052, + 0.2644004411995411, + 0.6855177953839302, + 0.3636443391442299, + 0.6038638390600681, + 1.4160248935222626, + 0.0, + 1.4510110057890415, + 0.36338866129517555, + 0.9493442848324776, + 0.018797336146235466 + ], + "unique_experts": 60, + "load_cv": 0.903517238971692, + "normalized_load_entropy": 0.9239808522117873, + "max_load_share": 0.09882005899705015 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "726aa5f7c48c549459181c0ec35c8b606d5b09969bc76e00c57ea45577bbf9da", + "route_weight_sha256": "3ea6a381a2f6e58758d2e96d644a9aadebafa9ae5142d669096d854282eac355", + "loads": [ + 11, + 8, + 7, + 0, + 17, + 13, + 18, + 11, + 7, + 1, + 15, + 17, + 17, + 6, + 16, + 5, + 13, + 7, + 1, + 12, + 15, + 14, + 8, + 8, + 3, + 25, + 29, + 22, + 14, + 28, + 14, + 5, + 12, + 20, + 3, + 7, + 26, + 8, + 68, + 6, + 14, + 12, + 12, + 15, + 8, + 5, + 9, + 13, + 19, + 13, + 27, + 13, + 26, + 6, + 6, + 14, + 8, + 8, + 12, + 0, + 26, + 9, + 11, + 5 + ], + "weighted_loads": [ + 0.675926685333252, + 0.7812559343874454, + 0.7035963535308838, + 0.0, + 0.9517239648848772, + 0.4937500348314643, + 2.0412021540105343, + 0.5173577833920717, + 0.44384774193167686, + 0.03147429600358009, + 1.078908046707511, + 1.2703895010054111, + 1.130170788615942, + 0.29155729338526726, + 0.681778084486723, + 0.24574628472328186, + 1.056616261601448, + 0.40426139160990715, + 0.04040059447288513, + 0.7766408566385508, + 1.0526718627661467, + 0.8809431903064251, + 0.4191586375236511, + 0.56391298212111, + 0.1336538048926741, + 1.59515973739326, + 2.2150986827909946, + 1.6666214521974325, + 0.6331689786165953, + 1.43688440695405, + 0.7277968917042017, + 0.17821460217237473, + 0.6952169854193926, + 1.382089588791132, + 0.1727612055838108, + 0.43311718851327896, + 2.9292182717472315, + 0.42613306269049644, + 5.504410562105477, + 0.25065633095800877, + 1.263735645217821, + 0.6101668579503894, + 0.8925366476178169, + 0.9054044522345066, + 0.30594904720783234, + 0.33032144978642464, + 0.8603634536266327, + 1.20364735648036, + 1.0669971937313676, + 1.1242468878626823, + 2.7604507878422737, + 0.5025408063083887, + 3.346664692275226, + 0.335500979796052, + 0.2644004411995411, + 2.3604568988084793, + 0.3636443391442299, + 0.6038638390600681, + 1.4674692898988724, + 0.0, + 1.4510110057890415, + 0.4394125398248434, + 0.9493442848324776, + 0.19175161980092525 + ], + "unique_experts": 62, + "load_cv": 0.764674940704876, + "normalized_load_entropy": 0.9418516946800626, + "max_load_share": 0.0821256038647343 + } + }, + "s1_eos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "cfca1e97a8b9e2b2b21986ab4300e160febe864263271f7952d162d157a48fe2", + "route_weight_sha256": "e1b77f928b4acdc8b5c64ff804a1487bcafca833929cfe970c30e3ae14d3ddba", + "loads": [ + 8, + 9, + 8, + 0, + 12, + 10, + 11, + 7, + 1, + 0, + 9, + 16, + 13, + 6, + 6, + 5, + 6, + 6, + 1, + 10, + 15, + 15, + 8, + 2, + 1, + 24, + 19, + 21, + 10, + 26, + 9, + 7, + 7, + 17, + 3, + 6, + 21, + 8, + 67, + 6, + 8, + 10, + 12, + 13, + 7, + 4, + 8, + 11, + 17, + 4, + 22, + 12, + 20, + 6, + 6, + 11, + 8, + 7, + 11, + 0, + 24, + 7, + 13, + 1 + ], + "weighted_loads": [ + 0.47114984691143036, + 0.8084664363414049, + 0.707164378836751, + 0.0, + 0.6325167752802372, + 0.4216608349233866, + 1.4734348058700562, + 0.38090184703469276, + 0.03401865437626839, + 0.0, + 0.8356923758983612, + 1.229620199650526, + 0.7799402549862862, + 0.27845901623368263, + 0.33499354869127274, + 0.2728518694639206, + 0.3416716828942299, + 0.3360607512295246, + 0.04431542381644249, + 0.6933051589876413, + 1.0657830238342285, + 0.908570327796042, + 0.418941643089056, + 0.2520956974476576, + 0.10238712280988693, + 1.5482167843729258, + 1.5578964687883854, + 1.6262936741113663, + 0.4820840172469616, + 1.3103197365999222, + 0.5067960415035486, + 0.2507975809276104, + 0.2902895137667656, + 1.262421878054738, + 0.17024911381304264, + 0.43817731738090515, + 2.1794978491961956, + 0.42207771725952625, + 5.501998422667384, + 0.24958843365311623, + 0.8825154742226005, + 0.5829445403069258, + 0.9013477563858032, + 0.8085316270589828, + 0.26935206912457943, + 0.29792390018701553, + 0.752153504639864, + 1.118619330227375, + 1.0036805123090744, + 0.2623979263007641, + 2.41076722368598, + 0.4615014400333166, + 3.1679762192070484, + 0.3333236873149872, + 0.2693124860525131, + 0.7148105278611183, + 0.3705171849578619, + 0.5737940594553947, + 1.4144035689532757, + 0.0, + 1.3759358935058117, + 0.35922454111278057, + 1.019526582211256, + 0.019076189026236534 + ], + "unique_experts": 61, + "load_cv": 0.8920414461876105, + "normalized_load_entropy": 0.926658385748092, + "max_load_share": 0.09882005899705015 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "15f5e9dc2db6fc7267160450ebe771d8a72bfec3b7f331eadeb8990d082185d5", + "route_weight_sha256": "8eed2657a640b5efab795fa898ae2efd22ceaf3fe69999a3683567136f39162b", + "loads": [ + 29, + 10, + 8, + 0, + 20, + 15, + 24, + 8, + 13, + 1, + 14, + 20, + 19, + 7, + 12, + 14, + 18, + 11, + 2, + 14, + 16, + 16, + 8, + 7, + 4, + 25, + 29, + 23, + 15, + 28, + 15, + 11, + 12, + 19, + 5, + 6, + 27, + 8, + 70, + 7, + 13, + 13, + 12, + 16, + 7, + 5, + 9, + 12, + 20, + 16, + 30, + 15, + 22, + 7, + 6, + 15, + 8, + 13, + 13, + 4, + 24, + 14, + 15, + 5 + ], + "weighted_loads": [ + 1.8514112178236246, + 0.8348903078585863, + 0.707164378836751, + 0.0, + 1.0800710916519165, + 0.6278226645663381, + 2.539025966078043, + 0.4122419133782387, + 0.6333302771672606, + 0.031008608639240265, + 1.068972323089838, + 1.565150037407875, + 1.2954089753329754, + 0.36007601395249367, + 0.5408100010827184, + 0.928214818239212, + 1.507741130888462, + 0.5362498536705971, + 0.09405451640486717, + 0.9566979743540287, + 1.0953534133732319, + 0.9891960928216577, + 0.418941643089056, + 0.5015591438859701, + 0.16857272968627512, + 1.5766316782683134, + 2.260888710618019, + 1.7521956153213978, + 0.8674845658242702, + 1.4363016225397587, + 0.7363343853503466, + 0.6981600634753704, + 0.6921726353466511, + 1.3813408445566893, + 0.3179625701159239, + 0.43817731738090515, + 2.903303364291787, + 0.42207771725952625, + 5.594224398955703, + 0.28562669828534126, + 1.160015489673242, + 0.7103128889575601, + 0.9013477563858032, + 1.1240829043090343, + 0.26935206912457943, + 0.3355106860399246, + 0.8753393329679966, + 1.1527107805013657, + 1.1479695355519652, + 1.8885543122887611, + 2.8276837449520826, + 0.5575657431036234, + 3.2160483291372657, + 0.48025910556316376, + 0.2693124860525131, + 2.360664412379265, + 0.3705171849578619, + 1.2399472296237946, + 1.4957189969718456, + 0.1735280230641365, + 1.3759358935058117, + 0.7303051520138979, + 1.135431032627821, + 0.17962465062737465 + ], + "unique_experts": 63, + "load_cv": 0.6948962193076231, + "normalized_load_entropy": 0.9513867918980157, + "max_load_share": 0.07575757575757576 + } + }, + "s0_bos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "3af8098307dcb086a995b06890ff4140beb8e19b8ee0c4c1f42b26d02db833a8", + "route_weight_sha256": "977d3c8e5552b80b36ad90cbbf5db5660122145faabdef0bb3968f3ed7dab3d6", + "loads": [ + 8, + 9, + 8, + 1, + 13, + 11, + 11, + 10, + 0, + 0, + 10, + 16, + 14, + 6, + 6, + 5, + 6, + 6, + 1, + 11, + 14, + 16, + 8, + 1, + 2, + 24, + 17, + 22, + 10, + 26, + 10, + 5, + 7, + 15, + 3, + 5, + 22, + 9, + 66, + 3, + 8, + 8, + 12, + 12, + 8, + 5, + 8, + 12, + 17, + 4, + 19, + 15, + 20, + 6, + 6, + 11, + 7, + 7, + 11, + 0, + 25, + 7, + 12, + 1 + ], + "weighted_loads": [ + 0.4741343967616558, + 0.8341049663722515, + 0.7504002191126347, + 0.03280482813715935, + 0.6616745498031378, + 0.44523425959050655, + 1.4304388165473938, + 0.49472889490425587, + 0.0, + 0.0, + 0.8876446671783924, + 1.2366391941905022, + 0.796511011198163, + 0.2844341844320297, + 0.3108895383775234, + 0.28104810789227486, + 0.3317016176879406, + 0.33571920171380043, + 0.03838183730840683, + 0.7039586994796991, + 1.038060212507844, + 0.9196601873263717, + 0.4165107272565365, + 0.24909017980098724, + 0.13538772240281105, + 1.5344142857939005, + 1.4351619370281696, + 1.6776570156216621, + 0.4668169394135475, + 1.3774594627320766, + 0.5045307986438274, + 0.17713149636983871, + 0.2993067279458046, + 1.2283745594322681, + 0.17458294704556465, + 0.28000298514962196, + 2.2456223368644714, + 0.4622882716357708, + 5.499355612322688, + 0.13906733319163322, + 0.8863881705328822, + 0.5254263840615749, + 0.9047155231237411, + 0.7721414752304554, + 0.29717329889535904, + 0.35438771545886993, + 0.7230149619281292, + 1.147820109501481, + 0.9625506196171045, + 0.26758693531155586, + 2.3857777025550604, + 0.6206208765506744, + 3.1538199931383133, + 0.3439176455140114, + 0.2550499588251114, + 0.7169584706425667, + 0.32484340481460094, + 0.5755444280803204, + 1.4527860172092915, + 0.0, + 1.432922950014472, + 0.35619443096220493, + 1.0133204869925976, + 0.018800299614667892 + ], + "unique_experts": 61, + "load_cv": 0.8849901664891552, + "normalized_load_entropy": 0.9265626943390454, + "max_load_share": 0.09734513274336283 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "4eb7eddcaad1a1f806c8bb184eb5afa5ea63094069f2664c36a34c3e0803a0bf", + "route_weight_sha256": "bde951b733ac3e702acf040c29489134d678f342b7587aba3b51f8c46e4e8c85", + "loads": [ + 12, + 9, + 8, + 1, + 19, + 14, + 18, + 12, + 5, + 1, + 15, + 17, + 19, + 6, + 16, + 6, + 13, + 8, + 1, + 13, + 14, + 16, + 8, + 7, + 3, + 25, + 27, + 22, + 14, + 27, + 14, + 5, + 12, + 18, + 3, + 6, + 27, + 9, + 67, + 3, + 15, + 8, + 12, + 14, + 8, + 5, + 9, + 13, + 18, + 13, + 25, + 18, + 25, + 6, + 8, + 13, + 7, + 7, + 12, + 0, + 25, + 9, + 12, + 6 + ], + "weighted_loads": [ + 0.7724895030260086, + 0.8341049663722515, + 0.7504002191126347, + 0.03280482813715935, + 0.9697185102850199, + 0.5556582659482956, + 1.96244166046381, + 0.5614007171243429, + 0.35928834415972233, + 0.03147429600358009, + 1.0760434437543154, + 1.266845777630806, + 1.2072912100702524, + 0.2844341844320297, + 0.7069045174866915, + 0.3120424151420593, + 1.0430948212742805, + 0.4182327426970005, + 0.03838183730840683, + 0.8135428372770548, + 1.038060212507844, + 0.9196601873263717, + 0.4165107272565365, + 0.5566746480762959, + 0.1616661511361599, + 1.5629442892968655, + 2.0966241285204887, + 1.6776570156216621, + 0.6081172525882721, + 1.4867387898266315, + 0.6800970770418644, + 0.17713149636983871, + 0.7014939729124308, + 1.3658208027482033, + 0.17458294704556465, + 0.35630350932478905, + 3.002057636156678, + 0.4622882716357708, + 5.533926384523511, + 0.13906733319163322, + 1.3758844202384353, + 0.5254263840615749, + 0.9047155231237411, + 0.8554150126874447, + 0.29717329889535904, + 0.35438771545886993, + 0.827050443738699, + 1.182326154783368, + 0.9760614419355989, + 1.1634925790131092, + 2.7996261809021235, + 0.7512050233781338, + 3.3026587245985866, + 0.3439176455140114, + 0.3549908362329006, + 1.3622624725103378, + 0.32484340481460094, + 0.5755444280803204, + 1.5042304135859013, + 0.0, + 1.432922950014472, + 0.4322183094918728, + 1.0133204869925976, + 0.23177799209952354 + ], + "unique_experts": 63, + "load_cv": 0.7512504453735904, + "normalized_load_entropy": 0.9434210652898808, + "max_load_share": 0.08091787439613526 + } + }, + "s1_bos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "94802d83c2d05b37c7544809b4854e5370291a6ea21c11e339897ba10ef3593c", + "route_weight_sha256": "30c3968b538ec531f37b126ad978f26dfab6ff6b283b3ba51ac31528f27b5439", + "loads": [ + 8, + 8, + 7, + 1, + 11, + 10, + 11, + 7, + 0, + 0, + 10, + 15, + 15, + 5, + 9, + 3, + 6, + 6, + 1, + 11, + 14, + 14, + 9, + 2, + 1, + 24, + 16, + 22, + 10, + 26, + 11, + 6, + 9, + 15, + 3, + 4, + 22, + 7, + 67, + 5, + 8, + 8, + 12, + 13, + 6, + 5, + 8, + 11, + 17, + 5, + 21, + 16, + 21, + 6, + 7, + 12, + 8, + 7, + 11, + 0, + 25, + 6, + 12, + 2 + ], + "weighted_loads": [ + 0.4673411715775728, + 0.7955981753766537, + 0.6943856738507748, + 0.03267651051282883, + 0.5981169659644365, + 0.42390344105660915, + 1.4477115720510483, + 0.36511390656232834, + 0.0, + 0.0, + 0.9174101054668427, + 1.2093972116708755, + 0.8555112387984991, + 0.23893695324659348, + 0.43692243564873934, + 0.20182913169264793, + 0.32464461401104927, + 0.3259282521903515, + 0.04434928297996521, + 0.7161648739129305, + 1.0466433241963387, + 0.8755978047847748, + 0.4580344706773758, + 0.2686546556651592, + 0.09136080741882324, + 1.5580632258206606, + 1.4446666911244392, + 1.6534082479774952, + 0.471119312569499, + 1.3341813739389181, + 0.5471940357238054, + 0.2068856842815876, + 0.38526543602347374, + 1.2163968905806541, + 0.16845137253403664, + 0.275461632758379, + 2.2122942823916674, + 0.3930848017334938, + 5.596449816599488, + 0.2215355671942234, + 0.9076324300840497, + 0.519369576126337, + 0.9015522263944149, + 0.8216130211949348, + 0.21828998625278473, + 0.3551444411277771, + 0.7417595945298672, + 1.121193539351225, + 0.9580863248556852, + 0.3059266395866871, + 2.3988196924328804, + 0.7151409797370434, + 3.232544459402561, + 0.3333220612257719, + 0.30323346704244614, + 0.7366824112832546, + 0.3728369288146496, + 0.5649031102657318, + 1.4299478232860565, + 0.0, + 1.368642870336771, + 0.3218473345041275, + 1.0419990792870522, + 0.047734228894114494 + ], + "unique_experts": 61, + "load_cv": 0.8956239954693701, + "normalized_load_entropy": 0.9260862125459569, + "max_load_share": 0.09882005899705015 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "0d6e899d2f7693d235c7b742d29958ebbb964a7cf67c1ed0f2c587fda6b995c6", + "route_weight_sha256": "98ff90a43339107baf17f4e30fcefeffe72c954129cdada25789d0fd4dc4356e", + "loads": [ + 29, + 9, + 7, + 1, + 20, + 15, + 24, + 8, + 10, + 1, + 15, + 19, + 21, + 6, + 15, + 12, + 18, + 11, + 2, + 15, + 15, + 15, + 9, + 7, + 4, + 25, + 26, + 24, + 15, + 28, + 17, + 10, + 14, + 17, + 5, + 4, + 29, + 7, + 70, + 6, + 14, + 9, + 12, + 15, + 6, + 6, + 9, + 12, + 20, + 19, + 30, + 18, + 23, + 7, + 7, + 15, + 8, + 13, + 13, + 4, + 25, + 13, + 14, + 7 + ], + "weighted_loads": [ + 1.913251707330346, + 0.8220220468938351, + 0.6943856738507748, + 0.03267651051282883, + 1.0262488145381212, + 0.6647180654108524, + 2.436974711716175, + 0.39645397290587425, + 0.516762531362474, + 0.031008608639240265, + 1.1506900526583195, + 1.5449270494282246, + 1.381999896839261, + 0.3205539509654045, + 0.6609389455989003, + 0.8571920804679394, + 1.4956304468214512, + 0.5191549174487591, + 0.09408837556838989, + 0.9795576892793179, + 1.076213713735342, + 0.9562235698103905, + 0.4580344706773758, + 0.5181181021034718, + 0.20575020276010036, + 1.5864781197160482, + 2.147658932954073, + 1.7793101891875267, + 0.8565198611468077, + 1.4706374425441027, + 0.7767323795706034, + 0.6542481668293476, + 0.7871485576033592, + 1.3353158570826054, + 0.3161648288369179, + 0.275461632758379, + 3.010625157505274, + 0.3930848017334938, + 5.695445874705911, + 0.25757383182644844, + 1.3632541736587882, + 0.6070456020534039, + 0.9015522263944149, + 1.0928863808512688, + 0.21828998625278473, + 0.3927312269806862, + 0.8464293964207172, + 1.1552849896252155, + 1.102375348098576, + 2.0885063000023365, + 2.8580007944256067, + 0.7858288176357746, + 3.2806165693327785, + 0.4802574794739485, + 0.30323346704244614, + 1.4542099870741367, + 0.3728369288146496, + 1.2310562804341316, + 1.5112632513046265, + 0.1735280230641365, + 1.368642870336771, + 0.6929279454052448, + 1.157903529703617, + 0.25038847513496876 + ], + "unique_experts": 64, + "load_cv": 0.7014456582704971, + "normalized_load_entropy": 0.9508218105187, + "max_load_share": 0.07575757575757576 + } + }, + "s0_x": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "a32090435027397902bb1b54a8449e2bb2de8b1a49aa33cf2ecea3bc449e9015", + "route_weight_sha256": "0d6747a636191bc4830dc274024eb6fc4b8d55987b7929e5e9fc403a75b84b32", + "loads": [ + 8, + 9, + 8, + 1, + 11, + 9, + 11, + 8, + 0, + 0, + 10, + 14, + 14, + 6, + 8, + 4, + 6, + 7, + 1, + 10, + 14, + 15, + 8, + 1, + 2, + 23, + 18, + 22, + 10, + 26, + 10, + 6, + 7, + 16, + 3, + 4, + 23, + 9, + 68, + 4, + 8, + 8, + 12, + 12, + 6, + 6, + 8, + 11, + 16, + 5, + 23, + 16, + 21, + 7, + 5, + 10, + 7, + 7, + 11, + 0, + 25, + 7, + 11, + 2 + ], + "weighted_loads": [ + 0.4780065044760704, + 0.8412970434874296, + 0.7251608353108168, + 0.032514024525880814, + 0.5749306045472622, + 0.39087636582553387, + 1.4442210532724857, + 0.43093983083963394, + 0.0, + 0.0, + 0.9117548391222954, + 1.1398634910583496, + 0.7912398278713226, + 0.2981681674718857, + 0.37748065404593945, + 0.23746293410658836, + 0.3397003076970577, + 0.3570971190929413, + 0.03850968927145004, + 0.6583606861531734, + 1.0327762868255377, + 0.8868245398625731, + 0.4142373241484165, + 0.2398812472820282, + 0.13729078322649002, + 1.453645559027791, + 1.4741176012903452, + 1.6648273803293705, + 0.47499919310212135, + 1.4424141570925713, + 0.5201159883290529, + 0.21443657018244267, + 0.3008737098425627, + 1.259945623576641, + 0.1715072151273489, + 0.26090889051556587, + 2.3066027127206326, + 0.46346720308065414, + 5.66850462090224, + 0.17560723796486855, + 0.8778963703662157, + 0.5282036662101746, + 0.8974356167018414, + 0.7862791940569878, + 0.2322036474943161, + 0.3790522888302803, + 0.7404071129858494, + 1.1269846092909575, + 1.0009003356099129, + 0.3155297040939331, + 2.537381464615464, + 0.6641602274030447, + 3.2162125445902348, + 0.3792933113873005, + 0.22822996973991394, + 0.7020731717348099, + 0.32885668985545635, + 0.5756030343472958, + 1.423640489578247, + 0.0, + 1.4583727456629276, + 0.36561874859035015, + 0.9888079538941383, + 0.05307677574455738 + ], + "unique_experts": 61, + "load_cv": 0.9062866764399783, + "normalized_load_entropy": 0.9255072714399714, + "max_load_share": 0.10029498525073746 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "5988b7c160cc881113a691cf1c28f4572a22a070e82f72b2576b19ab661b7647", + "route_weight_sha256": "27079a2343611ea5d3c31ef1ec9a477bed379de0b7931f4c0b6ac11524c522ff", + "loads": [ + 11, + 9, + 8, + 1, + 17, + 10, + 18, + 10, + 7, + 1, + 16, + 15, + 19, + 6, + 18, + 5, + 13, + 9, + 1, + 13, + 14, + 15, + 8, + 8, + 3, + 24, + 29, + 22, + 14, + 27, + 14, + 6, + 12, + 18, + 3, + 5, + 28, + 9, + 69, + 4, + 14, + 9, + 12, + 15, + 6, + 6, + 9, + 12, + 17, + 13, + 29, + 18, + 27, + 7, + 5, + 13, + 7, + 7, + 12, + 0, + 25, + 10, + 11, + 5 + ], + "weighted_loads": [ + 0.7034310474991798, + 0.8412970434874296, + 0.7251608353108168, + 0.032514024525880814, + 0.9119548369199038, + 0.40961040928959846, + 2.062116004526615, + 0.497611653059721, + 0.4715958684682846, + 0.03147429600358009, + 1.1713590901345015, + 1.1700700744986534, + 1.176939234137535, + 0.2981681674718857, + 0.7674590796232224, + 0.26845724135637283, + 1.0418770238757133, + 0.46236395463347435, + 0.03850968927145004, + 0.8173586986958981, + 1.0327762868255377, + 0.8868245398625731, + 0.4142373241484165, + 0.6411988697946072, + 0.16356921195983887, + 1.482175562530756, + 2.252518964931369, + 1.6648273803293705, + 0.6162995062768459, + 1.559401772916317, + 0.6956822667270899, + 0.21443657018244267, + 0.7030609548091888, + 1.3494763597846031, + 0.1715072151273489, + 0.2859567981213331, + 3.0231871511787176, + 0.46346720308065414, + 5.69839679915458, + 0.17560723796486855, + 1.2935151625424623, + 0.5694559551775455, + 0.8974356167018414, + 0.9489032328128815, + 0.2322036474943161, + 0.3790522888302803, + 0.8434028215706348, + 1.1614906545728445, + 1.0144111579284072, + 1.0960892960429192, + 2.8652790132910013, + 0.7495320718735456, + 3.402414041571319, + 0.3792933113873005, + 0.22822996973991394, + 1.3960436172783375, + 0.32885668985545635, + 0.5756030343472958, + 1.4750848859548569, + 0.0, + 1.4583727456629276, + 0.50565305352211, + 0.9888079538941383, + 0.183536471799016 + ], + "unique_experts": 63, + "load_cv": 0.7775076795696447, + "normalized_load_entropy": 0.9410015975709186, + "max_load_share": 0.08333333333333333 + } + }, + "s1_x": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "a4c01bb08d6b46c505d7408a2d05349019d4917818a773f2187cb1a92343a762", + "route_weight_sha256": "b7d8b35c32647ca946b5d9f3b1513263c00a093d5bf3f2a8774df8301d730ace", + "loads": [ + 6, + 8, + 8, + 0, + 11, + 9, + 11, + 6, + 0, + 0, + 10, + 16, + 14, + 4, + 8, + 4, + 5, + 6, + 0, + 10, + 14, + 14, + 9, + 1, + 1, + 25, + 17, + 21, + 9, + 26, + 11, + 5, + 9, + 18, + 3, + 6, + 22, + 8, + 69, + 6, + 8, + 8, + 12, + 13, + 6, + 5, + 8, + 12, + 15, + 6, + 23, + 16, + 20, + 7, + 7, + 11, + 8, + 7, + 12, + 0, + 23, + 6, + 13, + 2 + ], + "weighted_loads": [ + 0.383222833275795, + 0.7848704978823662, + 0.711112517863512, + 0.0, + 0.5775565803050995, + 0.380849689245224, + 1.4672889411449432, + 0.3231431618332863, + 0.0, + 0.0, + 0.9124847203493118, + 1.2138737849891186, + 0.8096226546913385, + 0.20210369303822517, + 0.3947059605270624, + 0.23212118074297905, + 0.27213846147060394, + 0.305284708738327, + 0.0, + 0.6602246277034283, + 1.0336200781166553, + 0.8879924872890115, + 0.4551375098526478, + 0.23823381960391998, + 0.0937328115105629, + 1.5762667171657085, + 1.5048245284706354, + 1.6011637561023235, + 0.41689577884972095, + 1.3803466632962227, + 0.5466862544417381, + 0.1768631413578987, + 0.3927442394196987, + 1.3471223637461662, + 0.16196287982165813, + 0.3352735862135887, + 2.2052131574600935, + 0.42117126658558846, + 5.841848093084991, + 0.2533133700489998, + 0.9218908231705427, + 0.5212074145674706, + 0.89557945728302, + 0.8227491416037083, + 0.233265221118927, + 0.3361591175198555, + 0.7339350208640099, + 1.1728875543922186, + 0.9267323724925518, + 0.3246706426143646, + 2.412873525172472, + 0.7329390197992325, + 3.195005588233471, + 0.3668567109853029, + 0.2974393889307976, + 0.7001865562051535, + 0.38847155310213566, + 0.5610056109726429, + 1.43816133774817, + 0.0, + 1.3089912123978138, + 0.3167296536266804, + 1.059864167124033, + 0.048289138823747635 + ], + "unique_experts": 59, + "load_cv": 0.9175843281656286, + "normalized_load_entropy": 0.9219041621262443, + "max_load_share": 0.10176991150442478 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "02bd17dc60bfdecaa49188e6dfb7bc7d74fa3c48fce32a92ba7ef3a578317829", + "route_weight_sha256": "607c78bb6b66265a993786015ac6f58cf92c40178de1ae6ff3cb3da6739617d0", + "loads": [ + 27, + 9, + 8, + 0, + 18, + 12, + 25, + 7, + 13, + 1, + 16, + 20, + 20, + 5, + 13, + 13, + 17, + 11, + 1, + 15, + 16, + 15, + 9, + 7, + 3, + 26, + 28, + 23, + 14, + 28, + 17, + 9, + 15, + 20, + 5, + 6, + 28, + 8, + 71, + 7, + 12, + 10, + 12, + 16, + 7, + 6, + 9, + 13, + 18, + 18, + 30, + 19, + 23, + 8, + 7, + 14, + 8, + 13, + 14, + 4, + 23, + 14, + 15, + 5 + ], + "weighted_loads": [ + 1.7813233900815248, + 0.8112943693995476, + 0.711112517863512, + 0.0, + 0.9194378890097141, + 0.531871410086751, + 2.530984379351139, + 0.3544832281768322, + 0.6877578860148787, + 0.031008608639240265, + 1.2002253457903862, + 1.5494036227464676, + 1.3092613611370325, + 0.2837206907570362, + 0.5889872424304485, + 0.8874841295182705, + 1.3946264386177063, + 0.5122255049645901, + 0.04973909258842468, + 0.9733653422445059, + 1.0906813386827707, + 0.9686182523146272, + 0.4551375098526478, + 0.562992550432682, + 0.156255716457963, + 1.6046816110610962, + 2.3318067397922277, + 1.727065697312355, + 0.8022963274270296, + 1.5005495212972164, + 0.7762245982885361, + 0.6242256239056587, + 0.8376317173242569, + 1.4660413302481174, + 0.3096763361245394, + 0.3352735862135887, + 2.831906992942095, + 0.42117126658558846, + 5.908007903955877, + 0.2893516346812248, + 1.1942417584359646, + 0.6547617502510548, + 0.89557945728302, + 1.2201674617826939, + 0.270073302090168, + 0.3737459033727646, + 0.8566912934184074, + 1.2069790046662092, + 1.0710213957354426, + 1.7974655106663704, + 2.6914251875132322, + 0.8385530337691307, + 3.2742051566019654, + 0.5137921292334795, + 0.2974393889307976, + 1.3837407287210226, + 0.38847155310213566, + 1.2271587811410427, + 1.5194767657667398, + 0.1735280230641365, + 1.3089912123978138, + 0.738899577409029, + 1.175768617540598, + 0.16389271803200245 + ], + "unique_experts": 63, + "load_cv": 0.7049634352400082, + "normalized_load_entropy": 0.9496580653503319, + "max_load_share": 0.07683982683982683 + } + }, + "s0_period": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "c2204a5c0fcb11a92526b5b5fafe27f169f681b5c1a7d12c4a3a029c5993db5f", + "route_weight_sha256": "6596ceac6c5339990b5267d9baead60896d87618b7ac607126d6aebdcdc22d3f", + "loads": [ + 8, + 9, + 8, + 1, + 12, + 8, + 11, + 9, + 0, + 0, + 10, + 15, + 13, + 6, + 8, + 4, + 6, + 7, + 0, + 11, + 14, + 14, + 8, + 1, + 2, + 23, + 18, + 22, + 9, + 25, + 10, + 5, + 9, + 16, + 3, + 3, + 22, + 9, + 67, + 4, + 8, + 8, + 12, + 12, + 8, + 6, + 8, + 11, + 18, + 5, + 21, + 16, + 21, + 7, + 6, + 10, + 7, + 7, + 11, + 0, + 25, + 7, + 12, + 2 + ], + "weighted_loads": [ + 0.48637864366173744, + 0.8143746256828308, + 0.7455559987574816, + 0.03247430920600891, + 0.6219252627342939, + 0.35276201739907265, + 1.4627420380711555, + 0.44557851925492287, + 0.0, + 0.0, + 0.9118849523365498, + 1.1923965513706207, + 0.7622951976954937, + 0.2865275852382183, + 0.382547240704298, + 0.2434188798069954, + 0.35199256986379623, + 0.3583442308008671, + 0.0, + 0.7000384163111448, + 1.0399142187088728, + 0.8719117818400264, + 0.42836107686161995, + 0.2366477996110916, + 0.13306770473718643, + 1.4414394963532686, + 1.5031847413629293, + 1.6748285368084908, + 0.4402695745229721, + 1.391825819388032, + 0.5061155539005995, + 0.17764628492295742, + 0.3747372105717659, + 1.2622537054121494, + 0.16787843219935894, + 0.2385094277560711, + 2.2470707818865776, + 0.4644988663494587, + 5.596325673162937, + 0.17660735175013542, + 0.873942659702152, + 0.5193336270749569, + 0.8933165892958641, + 0.7964135259389877, + 0.2959658596664667, + 0.38551517575979233, + 0.7519860863685608, + 1.1422414872795343, + 1.0503226183354855, + 0.31272872909903526, + 2.406180350109935, + 0.6700252592563629, + 3.226669952273369, + 0.36727670952677727, + 0.2591129504144192, + 0.7031287811696529, + 0.3288310803472996, + 0.5826452821493149, + 1.4417106658220291, + 0.0, + 1.4262786600738764, + 0.36032450571656227, + 1.0132179707288742, + 0.05310562066733837 + ], + "unique_experts": 60, + "load_cv": 0.8925095507493177, + "normalized_load_entropy": 0.925829726706679, + "max_load_share": 0.09882005899705015 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "fab71c16736cbfd82a0af98566537b5206a3b8b40cbbfbc338f4094afdc33ffd", + "route_weight_sha256": "c937918f21ffecda1b44760b4f08f6c5deda5730cb3ddf78dd8898a8cd39fbaf", + "loads": [ + 11, + 9, + 8, + 1, + 18, + 9, + 19, + 11, + 7, + 1, + 15, + 17, + 18, + 6, + 18, + 5, + 13, + 9, + 0, + 13, + 14, + 14, + 8, + 8, + 3, + 24, + 29, + 22, + 13, + 26, + 14, + 5, + 14, + 18, + 3, + 3, + 28, + 9, + 68, + 4, + 14, + 9, + 12, + 14, + 8, + 6, + 9, + 12, + 19, + 13, + 27, + 18, + 26, + 7, + 6, + 13, + 7, + 7, + 13, + 0, + 25, + 10, + 12, + 6 + ], + "weighted_loads": [ + 0.711514126509428, + 0.8143746256828308, + 0.7455559987574816, + 0.03247430920600891, + 1.001217134296894, + 0.37149606086313725, + 2.1122110672295094, + 0.5122503414750099, + 0.46036234125494957, + 0.03147429600358009, + 1.1002837289124727, + 1.2548459693789482, + 1.1282069720327854, + 0.2865275852382183, + 0.7722576055675745, + 0.27441318705677986, + 1.0471463091671467, + 0.4602053053677082, + 0.0, + 0.8096225541085005, + 1.0399142187088728, + 0.8719117818400264, + 0.42836107686161995, + 0.6170492880046368, + 0.15934613347053528, + 1.4699694998562336, + 2.21105713583529, + 1.6748285368084908, + 0.5815698876976967, + 1.5193186942487955, + 0.6816818322986364, + 0.17764628492295742, + 0.7769244555383921, + 1.3517844416201115, + 0.16787843219935894, + 0.2385094277560711, + 3.0222066696733236, + 0.4644988663494587, + 5.629521802067757, + 0.17660735175013542, + 1.3609698838554323, + 0.561216726899147, + 0.8933165892958641, + 0.879687063395977, + 0.2959658596664667, + 0.38551517575979233, + 0.8575848713517189, + 1.1767475325614214, + 1.0638334406539798, + 1.1188914440572262, + 2.738675219938159, + 0.7553971037268639, + 3.375508683733642, + 0.36727670952677727, + 0.2591129504144192, + 1.4082235507667065, + 0.3288310803472996, + 0.5826452821493149, + 1.546087671071291, + 0.0, + 1.4262786600738764, + 0.5878786351531744, + 1.0132179707288742, + 0.21137679554522038 + ], + "unique_experts": 62, + "load_cv": 0.7668692218777102, + "normalized_load_entropy": 0.9409777214890784, + "max_load_share": 0.0821256038647343 + } + }, + "s1_period": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "9ea5c510b699459baf5c7716ede2017100b318fb112f95c93acff613598c8509", + "route_weight_sha256": "68e1b76986d8ac4437f28f69050d374e0ac41f3bc19d596afd975b1cd846ef42", + "loads": [ + 8, + 7, + 8, + 0, + 11, + 9, + 11, + 7, + 0, + 0, + 10, + 16, + 14, + 4, + 6, + 3, + 6, + 6, + 1, + 10, + 14, + 13, + 9, + 1, + 2, + 25, + 18, + 21, + 8, + 25, + 12, + 4, + 8, + 18, + 3, + 8, + 21, + 7, + 71, + 5, + 9, + 8, + 12, + 13, + 5, + 5, + 8, + 12, + 14, + 4, + 25, + 18, + 20, + 7, + 7, + 10, + 8, + 7, + 12, + 0, + 23, + 6, + 13, + 2 + ], + "weighted_loads": [ + 0.4145476296544075, + 0.735637066885829, + 0.6966583728790283, + 0.0, + 0.5874376110732555, + 0.3654940649867058, + 1.4982953071594238, + 0.3710609935224056, + 0.0, + 0.0, + 0.9131618067622185, + 1.2158584855496883, + 0.8068098649382591, + 0.19749359041452408, + 0.3061833940446377, + 0.17102490738034248, + 0.29389507696032524, + 0.3079066798090935, + 0.04073628410696983, + 0.646879555657506, + 1.0410972461104393, + 0.841590465977788, + 0.4631194658577442, + 0.2466978132724762, + 0.1344381459057331, + 1.5812203511595726, + 1.5745551902800798, + 1.572450626641512, + 0.37681817822158337, + 1.3799210134893656, + 0.5741503443568945, + 0.1423747055232525, + 0.34534114226698875, + 1.3751049786806107, + 0.16790246590971947, + 0.5094865337014198, + 2.151025664061308, + 0.38363008201122284, + 5.8683586195111275, + 0.20658930949866772, + 0.9342043721117079, + 0.50373575091362, + 0.8952937088906765, + 0.8120771870017052, + 0.19557470828294754, + 0.3250090964138508, + 0.7415256574749947, + 1.2035337258130312, + 0.8590269275009632, + 0.2510293945670128, + 2.4739301465451717, + 0.806604890152812, + 3.2179586179554462, + 0.3669068403542042, + 0.30310240760445595, + 0.6609728932380676, + 0.38662280328571796, + 0.5610660575330257, + 1.4338745195418596, + 0.0, + 1.298441968858242, + 0.31702196411788464, + 1.0411609038710594, + 0.053043562918901443 + ], + "unique_experts": 60, + "load_cv": 0.9387346552789243, + "normalized_load_entropy": 0.9207685868071209, + "max_load_share": 0.10471976401179942 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "5779be3110e22ee7b2d0a73465f83c70c48700a5f506699d896ba0891ca10fc8", + "route_weight_sha256": "2586456bcb3f48631c6743750f67a8ecdb432cdbc2c3648fccfab22665663701", + "loads": [ + 30, + 8, + 8, + 0, + 19, + 12, + 24, + 8, + 13, + 1, + 16, + 20, + 20, + 5, + 11, + 13, + 18, + 11, + 2, + 14, + 16, + 14, + 9, + 6, + 4, + 26, + 29, + 23, + 13, + 27, + 18, + 8, + 13, + 21, + 5, + 8, + 27, + 7, + 73, + 6, + 14, + 10, + 12, + 16, + 5, + 6, + 9, + 13, + 17, + 15, + 33, + 21, + 22, + 8, + 7, + 13, + 8, + 13, + 15, + 4, + 23, + 14, + 15, + 5 + ], + "weighted_loads": [ + 1.8211697656661272, + 0.7620609384030104, + 0.6966583728790283, + 0.0, + 1.0102216489613056, + 0.5165157858282328, + 2.5773861594498158, + 0.40240105986595154, + 0.6387868961319327, + 0.031008608639240265, + 1.1763103809207678, + 1.5513883233070374, + 1.3006446696817875, + 0.2791105881333351, + 0.5004646759480238, + 0.8628750704228878, + 1.421619452536106, + 0.5070559158921242, + 0.09047537669539452, + 0.9102723710238934, + 1.100216442719102, + 0.9222162310034037, + 0.4631194658577442, + 0.4961612597107887, + 0.1969610508531332, + 1.6096352450549603, + 2.3241933528333902, + 1.6983525678515434, + 0.762218726798892, + 1.500450847670436, + 0.8036886882036924, + 0.5897371880710125, + 0.7472242638468742, + 1.525905717164278, + 0.3156159222126007, + 0.5094865337014198, + 2.924813548102975, + 0.38363008201122284, + 5.934518430382013, + 0.24262757413089275, + 1.303657487500459, + 0.633794978260994, + 0.8952937088906765, + 1.1415104269981384, + 0.19557470828294754, + 0.3625958822667599, + 0.8636238798499107, + 1.2376251760870218, + 1.003315950743854, + 1.7372515723109245, + 2.8088908325880766, + 0.9054133202880621, + 3.2660307278856635, + 0.5138422586023808, + 0.30310240760445595, + 1.3453163020312786, + 0.38662280328571796, + 1.2272192277014256, + 1.5767373833805323, + 0.1735280230641365, + 1.298441968858242, + 0.8685120213776827, + 1.1570653542876244, + 0.16864714212715626 + ], + "unique_experts": 63, + "load_cv": 0.7266411398958667, + "normalized_load_entropy": 0.9479208783439772, + "max_load_share": 0.07900432900432901 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 113, + "ordered_topk_exact_tokens": 80, + "set_exact_tokens": 91, + "mean_set_jaccard": 0.9443742098609356, + "mean_token_weighted_tv": 0.0135992850337705, + "aggregate_load_tv": 0.02359882005899705 + }, + "system_bos": { + "tokens": 113, + "ordered_topk_exact_tokens": 65, + "set_exact_tokens": 79, + "mean_set_jaccard": 0.9121365360303414, + "mean_token_weighted_tv": 0.020834722284194643, + "aggregate_load_tv": 0.033923303834808266 + }, + "system_x": { + "tokens": 113, + "ordered_topk_exact_tokens": 58, + "set_exact_tokens": 75, + "mean_set_jaccard": 0.8925410872313526, + "mean_token_weighted_tv": 0.02731178025921098, + "aggregate_load_tv": 0.0368731563421829 + }, + "system_period": { + "tokens": 113, + "ordered_topk_exact_tokens": 51, + "set_exact_tokens": 65, + "mean_set_jaccard": 0.8691529709228825, + "mean_token_weighted_tv": 0.030403740374387894, + "aggregate_load_tv": 0.05014749262536873 + }, + "bos_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 60, + "set_exact_tokens": 79, + "mean_set_jaccard": 0.9121365360303413, + "mean_token_weighted_tv": 0.021358112930278995, + "aggregate_load_tv": 0.035398230088495575 + }, + "bos_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 51, + "set_exact_tokens": 70, + "mean_set_jaccard": 0.8855878634639698, + "mean_token_weighted_tv": 0.026244964326970873, + "aggregate_load_tv": 0.038348082595870206 + }, + "x_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 54, + "set_exact_tokens": 72, + "mean_set_jaccard": 0.8849557522123894, + "mean_token_weighted_tv": 0.02635218375527292, + "aggregate_load_tv": 0.039823008849557515 + }, + "x_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 47, + "set_exact_tokens": 67, + "mean_set_jaccard": 0.8742098609355249, + "mean_token_weighted_tv": 0.030752989100869252, + "aggregate_load_tv": 0.03982300884955753 + }, + "period_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 57, + "set_exact_tokens": 74, + "mean_set_jaccard": 0.8938053097345132, + "mean_token_weighted_tv": 0.024396200792089238, + "aggregate_load_tv": 0.03687315634218289 + }, + "period_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 45, + "set_exact_tokens": 70, + "mean_set_jaccard": 0.8761061946902655, + "mean_token_weighted_tv": 0.030514022040766028, + "aggregate_load_tv": 0.0471976401179941 + } + } + }, + "layer_16": { + "layer": 16, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "85b221c982584780c36bb1db31c36db8d6f810a6204626f8f2284a223bb8b2cb", + "route_weight_sha256": "475a098e4877be9797d3e8fa6655dc6e6accfee000196da2bb79b820e1632b5e", + "loads": [ + 12, + 16, + 16, + 8, + 8, + 14, + 14, + 11, + 5, + 7, + 1, + 7, + 3, + 11, + 16, + 15, + 13, + 10, + 15, + 9, + 3, + 7, + 4, + 13, + 11, + 11, + 19, + 18, + 12, + 16, + 20, + 4, + 10, + 8, + 47, + 8, + 10, + 12, + 10, + 0, + 10, + 5, + 14, + 5, + 7, + 10, + 1, + 8, + 4, + 10, + 0, + 8, + 48, + 15, + 7, + 1, + 15, + 2, + 9, + 1, + 17, + 10, + 5, + 12 + ], + "weighted_loads": [ + 0.9243872761726379, + 1.040847323834896, + 0.6469918508082628, + 0.8720357306301594, + 0.293531134724617, + 0.7963905818760395, + 0.6232181377708912, + 0.9231308307498693, + 0.3641140013933182, + 0.3281082324683666, + 0.023163143545389175, + 0.24006377719342709, + 0.11845256388187408, + 0.7613212913274765, + 1.5192790739238262, + 1.275358809158206, + 1.5240070056170225, + 0.8880950883030891, + 0.7111533880233765, + 0.7192115969955921, + 0.15803981572389603, + 1.7642894480377436, + 0.17908071354031563, + 0.8283585906028748, + 1.44269909709692, + 0.6579558178782463, + 0.9911466557532549, + 1.134988222271204, + 0.9998659640550613, + 0.7535527795553207, + 1.8666991516947746, + 0.19619789719581604, + 0.5375312510877848, + 0.33462691865861416, + 2.9529872573912144, + 0.9846210852265358, + 0.45297938771545887, + 1.5609206715598702, + 0.6971847116947174, + 0.0, + 0.5198085084557533, + 0.22492528520524502, + 0.7669416889548302, + 0.21305166743695736, + 0.2548111453652382, + 0.7340374998748302, + 0.014370146207511425, + 0.9054967500269413, + 0.1925479993224144, + 0.5165519742295146, + 0.0, + 0.4178710840642452, + 4.642154103145003, + 3.4022392434999347, + 0.38064178824424744, + 0.13748101890087128, + 0.8662738427519798, + 0.06395970098674297, + 0.4705229885876179, + 0.03912677988409996, + 2.7163743264973164, + 0.45795088820159435, + 0.38857611641287804, + 0.9397841095924377 + ], + "unique_experts": 62, + "load_cv": 0.7808533170739506, + "normalized_load_entropy": 0.9385451597301593, + "max_load_share": 0.07079646017699115 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "49f95236a38fdc78ac64ff822078da41f2a90cf113796a52921c69eeb28ca7c4", + "route_weight_sha256": "db1ace0b9c7749761be44f7b6ade8f62fca1ceac86d5a7e7e1dc527fb9b04795", + "loads": [ + 12, + 17, + 16, + 8, + 8, + 22, + 19, + 11, + 5, + 9, + 4, + 8, + 3, + 14, + 16, + 22, + 22, + 15, + 20, + 11, + 14, + 9, + 6, + 13, + 19, + 11, + 23, + 18, + 12, + 16, + 23, + 4, + 11, + 15, + 47, + 8, + 10, + 20, + 11, + 0, + 11, + 12, + 16, + 5, + 11, + 11, + 1, + 8, + 4, + 10, + 0, + 10, + 48, + 26, + 7, + 11, + 15, + 2, + 10, + 1, + 20, + 13, + 5, + 19 + ], + "weighted_loads": [ + 0.9243872761726379, + 1.0733417980372906, + 0.6469918508082628, + 0.8720357306301594, + 0.293531134724617, + 1.5911157503724098, + 0.8455196134746075, + 0.9231308307498693, + 0.3641140013933182, + 1.656286459416151, + 0.19824504479765892, + 0.2757705021649599, + 0.11845256388187408, + 0.8551740031689405, + 1.5192790739238262, + 1.8938329424709082, + 1.9921487653627992, + 1.2634791266173124, + 1.258298745378852, + 0.7600073299836367, + 1.1288716737180948, + 1.843846844509244, + 0.3015963286161423, + 0.8283585906028748, + 2.1374106407165527, + 0.6579558178782463, + 1.2324229404330254, + 1.134988222271204, + 0.9998659640550613, + 0.7535527795553207, + 1.9971690196543932, + 0.19619789719581604, + 0.5772993620485067, + 0.7059867205098271, + 2.9529872573912144, + 0.9846210852265358, + 0.45297938771545887, + 1.9957029139623046, + 0.7309737205505371, + 0.0, + 0.5646556802093983, + 1.2243166845291853, + 0.8333196751773357, + 0.21305166743695736, + 0.41693592444062233, + 0.8003100194036961, + 0.014370146207511425, + 0.9054967500269413, + 0.1925479993224144, + 0.5165519742295146, + 0.0, + 0.5179079435765743, + 4.642154103145003, + 4.167158004827797, + 0.38064178824424744, + 0.9467918500304222, + 0.8662738427519798, + 0.06395970098674297, + 0.5590977184474468, + 0.03912677988409996, + 2.9132755286991596, + 0.5888928436907008, + 0.38857611641287804, + 1.2728928001597524 + ], + "unique_experts": 62, + "load_cv": 0.6789287488930046, + "normalized_load_entropy": 0.9479874825302943, + "max_load_share": 0.057971014492753624 + } + }, + "s1_eos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "a6d25502d5333bccc7857f9dcb6e30194b4aab5d3ebce2ad3f1baede134061c1", + "route_weight_sha256": "b51cce2ea8481fd3648b977fde982a3659bd924394586a195c2435b916283fd1", + "loads": [ + 14, + 15, + 14, + 8, + 8, + 13, + 13, + 11, + 5, + 7, + 1, + 5, + 2, + 9, + 16, + 14, + 14, + 10, + 14, + 9, + 3, + 8, + 4, + 12, + 11, + 12, + 18, + 18, + 12, + 16, + 20, + 4, + 10, + 8, + 50, + 8, + 12, + 12, + 10, + 0, + 10, + 6, + 14, + 5, + 7, + 10, + 1, + 10, + 3, + 11, + 0, + 10, + 49, + 15, + 9, + 1, + 14, + 2, + 9, + 1, + 17, + 7, + 5, + 12 + ], + "weighted_loads": [ + 0.9745507184416056, + 0.99021240696311, + 0.5889286249876022, + 0.8454056084156036, + 0.29653964936733246, + 0.7715161461383104, + 0.5973194427788258, + 0.9315954130142927, + 0.38002992793917656, + 0.32685951329767704, + 0.024012774229049683, + 0.18201898597180843, + 0.07434712070971727, + 0.7089541312307119, + 1.5216886159032583, + 1.2586434930562973, + 1.5267160311341286, + 0.8666860461235046, + 0.689885450527072, + 0.7388216014951468, + 0.1622627004981041, + 1.809661379083991, + 0.17631662636995316, + 0.8169749937951565, + 1.460955198854208, + 0.6735885143280029, + 0.9634795822203159, + 1.1340757757425308, + 0.9977703150361776, + 0.7443082816898823, + 1.8676601443439722, + 0.20119339227676392, + 0.5336643606424332, + 0.3277285397052765, + 3.1466882526874542, + 0.9682054296135902, + 0.5168425031006336, + 1.5427636308595538, + 0.6990132555365562, + 0.0, + 0.5164378304034472, + 0.2618327774107456, + 0.7543225698173046, + 0.2148570381104946, + 0.25626079738140106, + 0.729838278144598, + 0.014805961400270462, + 0.9332448579370975, + 0.16234774142503738, + 0.5468200854957104, + 0.0, + 0.4754751306027174, + 4.67571160197258, + 3.3703809771686792, + 0.448764443397522, + 0.13869915902614594, + 0.823876416310668, + 0.06657397374510765, + 0.48018378019332886, + 0.0422610379755497, + 2.696420907974243, + 0.36531080305576324, + 0.3948654569685459, + 0.926144546829164 + ], + "unique_experts": 62, + "load_cv": 0.8040445181238839, + "normalized_load_entropy": 0.9364423012716226, + "max_load_share": 0.07374631268436578 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "9194943fa194ca45f147b201c129a1c457c6c13520aae68748fc3f1dfe6400fe", + "route_weight_sha256": "af250583e3b9b9aeab18039c9cc1f36afdafd7fc8625a4e8839eb19eaa8733dc", + "loads": [ + 14, + 19, + 14, + 10, + 8, + 21, + 18, + 12, + 5, + 11, + 6, + 8, + 2, + 12, + 17, + 25, + 22, + 22, + 21, + 10, + 14, + 10, + 7, + 13, + 25, + 12, + 27, + 18, + 12, + 16, + 25, + 4, + 15, + 15, + 51, + 10, + 12, + 21, + 13, + 3, + 14, + 20, + 17, + 7, + 10, + 15, + 2, + 17, + 6, + 14, + 7, + 11, + 49, + 27, + 9, + 12, + 16, + 2, + 10, + 2, + 21, + 9, + 8, + 19 + ], + "weighted_loads": [ + 0.9745507184416056, + 1.1434233821928501, + 0.5889286249876022, + 0.9354970678687096, + 0.29653964936733246, + 1.6174430567771196, + 0.8662807606160641, + 0.9577621705830097, + 0.38002992793917656, + 1.7191735543310642, + 0.20590129122138023, + 0.27024081349372864, + 0.07434712070971727, + 0.8026206865906715, + 1.5770708080381155, + 2.346609715372324, + 1.8912645201198757, + 1.705386495217681, + 1.4812072478234768, + 0.7412799301091582, + 1.1073151472955942, + 1.9000473339110613, + 0.30031146109104156, + 0.8935426883399487, + 2.673875868320465, + 0.6735885143280029, + 2.084644390270114, + 1.1340757757425308, + 0.9977703150361776, + 0.7443082816898823, + 2.0630587358027697, + 0.20119339227676392, + 0.7539990786463022, + 0.6198884816840291, + 3.1823170594871044, + 1.0868975147604942, + 0.5168425031006336, + 2.0269892821088433, + 0.8557503968477249, + 0.17629733681678772, + 0.6613872144371271, + 2.35369561240077, + 0.8476136568933725, + 0.30891847610473633, + 0.3628600500524044, + 0.9650263302028179, + 0.04555107466876507, + 1.262145459651947, + 0.28733163326978683, + 0.7079495154321194, + 0.28631974570453167, + 0.5156235489994287, + 4.67571160197258, + 4.4476225432008505, + 0.448764443397522, + 1.0815634839236736, + 0.9320628400892019, + 0.06657397374510765, + 0.5746055319905281, + 0.24346036091446877, + 2.8806122541427612, + 0.45843983930535614, + 0.7246135175228119, + 1.2807610547170043 + ], + "unique_experts": 64, + "load_cv": 0.6251627849701424, + "normalized_load_entropy": 0.9578764639738219, + "max_load_share": 0.05519480519480519 + } + }, + "s0_bos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "6eacbd3360dbde5c07eb75953619e00184971404a1ac5848750f1225bc49544c", + "route_weight_sha256": "3cf1bd9a80f1b43e3c64b10741d04262cc9f9a568fc97fe11a50f8a9a55a08e2", + "loads": [ + 15, + 15, + 16, + 8, + 6, + 15, + 13, + 11, + 6, + 9, + 1, + 7, + 4, + 10, + 16, + 14, + 12, + 10, + 14, + 6, + 3, + 9, + 4, + 13, + 11, + 11, + 18, + 19, + 11, + 15, + 20, + 3, + 11, + 7, + 48, + 8, + 11, + 13, + 11, + 0, + 10, + 7, + 13, + 4, + 8, + 10, + 0, + 9, + 3, + 11, + 0, + 9, + 48, + 15, + 7, + 1, + 13, + 2, + 8, + 0, + 18, + 10, + 5, + 13 + ], + "weighted_loads": [ + 1.0168251544237137, + 1.0008904412388802, + 0.6225686296820641, + 0.852946300059557, + 0.23646866157650948, + 0.7907026745378971, + 0.6078190095722675, + 0.9485548045486212, + 0.3865317590534687, + 0.3756288979202509, + 0.022167567163705826, + 0.24480637349188328, + 0.15378319844603539, + 0.718959454447031, + 1.5977533925324678, + 1.2841751147061586, + 1.4666591919958591, + 0.8723857887089252, + 0.6613014061003923, + 0.6245073303580284, + 0.16973568499088287, + 1.818493926897645, + 0.1850540153682232, + 0.8454662319272757, + 1.5200980305671692, + 0.6388401389122009, + 0.9834402725100517, + 1.1935606226325035, + 0.9798750765621662, + 0.7446565739810467, + 1.8432093653827906, + 0.15612198039889336, + 0.5759076923131943, + 0.32219178788363934, + 3.0990889836102724, + 1.00708182528615, + 0.4693525359034538, + 1.5919931819662452, + 0.7623002678155899, + 0.0, + 0.5136880576610565, + 0.289072684943676, + 0.7309851720929146, + 0.17904601246118546, + 0.2763763777911663, + 0.733724769204855, + 0.0, + 0.9148873053491116, + 0.16589709371328354, + 0.5533759444952011, + 0.0, + 0.45693669095635414, + 4.661240939050913, + 3.354463736526668, + 0.3913751654326916, + 0.13520695269107819, + 0.7957689389586449, + 0.07003772258758545, + 0.43021225929260254, + 0.0, + 2.7863253001123667, + 0.4653836861252785, + 0.3895100876688957, + 0.96188950445503 + ], + "unique_experts": 60, + "load_cv": 0.7897179942801195, + "normalized_load_entropy": 0.9356767929381283, + "max_load_share": 0.07079646017699115 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "05b5418bb708c82e55bec705d63fc778575da059d6e1f58c47b7f324957e8220", + "route_weight_sha256": "57a89ab8f7fa972823041aaaa6a9846271e7e1d2a9ecc6f8bc6ddb8619386c58", + "loads": [ + 15, + 15, + 16, + 8, + 6, + 24, + 18, + 11, + 6, + 11, + 4, + 9, + 5, + 13, + 16, + 21, + 19, + 15, + 19, + 8, + 14, + 11, + 6, + 13, + 18, + 11, + 21, + 19, + 11, + 15, + 23, + 3, + 12, + 13, + 49, + 8, + 12, + 21, + 12, + 0, + 11, + 15, + 15, + 4, + 12, + 11, + 0, + 10, + 3, + 12, + 2, + 11, + 48, + 26, + 7, + 11, + 13, + 2, + 9, + 0, + 20, + 12, + 5, + 18 + ], + "weighted_loads": [ + 1.0168251544237137, + 1.0008904412388802, + 0.6225686296820641, + 0.852946300059557, + 0.23646866157650948, + 1.6263449303805828, + 0.822792049497366, + 0.9485548045486212, + 0.3865317590534687, + 0.7951950486749411, + 0.19724946841597557, + 0.31666543520987034, + 0.22679365798830986, + 0.8158674780279398, + 1.5977533925324678, + 1.9117713924497366, + 2.3604584261775017, + 1.2317193355411291, + 1.219454549252987, + 0.6933644767850637, + 1.1405675429850817, + 1.8980513233691454, + 0.30756963044404984, + 0.8454662319272757, + 2.1657386645674706, + 0.6388401389122009, + 1.1578037645667791, + 1.1935606226325035, + 0.9798750765621662, + 0.7446565739810467, + 1.9730611220002174, + 0.15612198039889336, + 0.6156758032739162, + 0.6648491472005844, + 3.2128037828952074, + 1.00708182528615, + 0.5017146654427052, + 2.0267754243686795, + 0.7948438860476017, + 0.0, + 0.5585352294147015, + 1.3781654872000217, + 0.7915613502264023, + 0.17904601246118546, + 0.4244705084711313, + 0.7999972887337208, + 0.0, + 0.9482018314301968, + 0.16589709371328354, + 0.5986295454204082, + 0.06915747560560703, + 0.5569735504686832, + 4.661240939050913, + 4.119382497854531, + 0.3913751654326916, + 0.9445177838206291, + 0.7957689389586449, + 0.07003772258758545, + 0.5056184008717537, + 0.0, + 2.914063611999154, + 0.5827451981604099, + 0.3895100876688957, + 1.2489375127479434 + ], + "unique_experts": 61, + "load_cv": 0.6803023353437451, + "normalized_load_entropy": 0.947890211012192, + "max_load_share": 0.059178743961352656 + } + }, + "s1_bos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "cb5d6658fdadb8da896300d888244358376e9838589d7545008e5b68e6c320e2", + "route_weight_sha256": "0a01ddd88cc49a1d133fdc2c12c77f3807f61fc028d6c90903d2d87010e886f0", + "loads": [ + 16, + 15, + 15, + 8, + 7, + 14, + 14, + 11, + 6, + 9, + 0, + 6, + 3, + 9, + 16, + 14, + 12, + 10, + 15, + 8, + 3, + 9, + 4, + 13, + 11, + 12, + 18, + 20, + 11, + 16, + 21, + 4, + 10, + 7, + 52, + 8, + 8, + 13, + 10, + 0, + 11, + 7, + 13, + 4, + 7, + 10, + 0, + 9, + 3, + 10, + 0, + 9, + 48, + 15, + 7, + 1, + 12, + 2, + 8, + 0, + 17, + 10, + 5, + 12 + ], + "weighted_loads": [ + 1.05601585842669, + 0.9908299334347248, + 0.5957386139780283, + 0.8477979488670826, + 0.272017739713192, + 0.7883686572313309, + 0.6477370355278254, + 0.9382229913026094, + 0.41045571118593216, + 0.3900180794298649, + 0.0, + 0.2084201332181692, + 0.10558622889220715, + 0.6831123437732458, + 1.5812875870615244, + 1.2239895183593035, + 1.4871427193284035, + 0.8428269531577826, + 0.6971663516014814, + 0.6809627916663885, + 0.17366105690598488, + 1.8360708951950073, + 0.17840543761849403, + 0.8607549779117107, + 1.5263326466083527, + 0.6691682487726212, + 1.0257618390023708, + 1.2064360789954662, + 0.9348273724317551, + 0.7782748565077782, + 1.8639267329126596, + 0.1907226089388132, + 0.5421000774949789, + 0.3010943830013275, + 3.2629315201193094, + 0.9980716928839684, + 0.37623341381549835, + 1.5391951026394963, + 0.7100547030568123, + 0.0, + 0.5562126860022545, + 0.2795368041843176, + 0.7127035707235336, + 0.17657973989844322, + 0.2590296473354101, + 0.738064106553793, + 0.0, + 0.9339232593774796, + 0.1592547856271267, + 0.5189903508871794, + 0.0, + 0.4627176783978939, + 4.821722216904163, + 3.380277829244733, + 0.3910326659679413, + 0.1330862045288086, + 0.7651764638721943, + 0.0661080814898014, + 0.4188680239021778, + 0.0, + 2.782982612028718, + 0.4609217196702957, + 0.3984334282577038, + 0.9279001727700233 + ], + "unique_experts": 59, + "load_cv": 0.821686168190861, + "normalized_load_entropy": 0.9318868809686179, + "max_load_share": 0.07669616519174041 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "d15a2a4d4d205e0470c1864a65cd31b3668f8e971e971cff8053d74ac68f9e9f", + "route_weight_sha256": "1b93a3809194b16e171409a188b37910edd9f79acc12abed7bd72d9a4072bdd5", + "loads": [ + 16, + 19, + 15, + 10, + 7, + 22, + 19, + 12, + 6, + 12, + 5, + 10, + 3, + 13, + 17, + 25, + 20, + 21, + 22, + 8, + 14, + 11, + 6, + 14, + 24, + 12, + 27, + 20, + 11, + 16, + 26, + 4, + 15, + 15, + 53, + 10, + 8, + 22, + 13, + 3, + 15, + 22, + 16, + 6, + 12, + 15, + 1, + 15, + 6, + 14, + 7, + 10, + 48, + 27, + 7, + 12, + 14, + 2, + 9, + 1, + 22, + 11, + 8, + 18 + ], + "weighted_loads": [ + 1.05601585842669, + 1.1420774031430483, + 0.5957386139780283, + 0.9378894083201885, + 0.272017739713192, + 1.63429556787014, + 0.9065499771386385, + 0.9643897488713264, + 0.41045571118593216, + 0.839935913681984, + 0.18188851699233055, + 0.3267914317548275, + 0.10558622889220715, + 0.8079379498958588, + 1.6366697791963816, + 2.311713559553027, + 2.291570331901312, + 1.6301102489233017, + 1.4818215258419514, + 0.6809627916663885, + 1.118713503703475, + 1.9264568500220776, + 0.2616952620446682, + 0.9373226724565029, + 2.7138296216726303, + 0.6691682487726212, + 2.1506710555404425, + 1.2064360789954662, + 0.9348273724317551, + 0.7782748565077782, + 2.059136999770999, + 0.1907226089388132, + 0.762434795498848, + 0.6636102925986052, + 3.2985603269189596, + 1.1167637780308723, + 0.37623341381549835, + 2.023420753888786, + 0.8648733347654343, + 0.17629733681678772, + 0.7013070210814476, + 2.465182600542903, + 0.8001219071447849, + 0.27064117789268494, + 0.4476580526679754, + 0.9732521586120129, + 0.030745113268494606, + 1.2306600622832775, + 0.28423867747187614, + 0.7189514879137278, + 0.29959522746503353, + 0.5028660967946053, + 4.821722216904163, + 4.457519395276904, + 0.3910326659679413, + 1.0759505294263363, + 0.8733628876507282, + 0.0661080814898014, + 0.4988640584051609, + 0.20119932293891907, + 3.0107251554727554, + 0.534896157681942, + 0.7281814888119698, + 1.268572747707367 + ], + "unique_experts": 64, + "load_cv": 0.6395069173048761, + "normalized_load_entropy": 0.9554122227619153, + "max_load_share": 0.05735930735930736 + } + }, + "s0_x": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "10ef4a3a7e5e69cb172a3fffdf8afd1ef13eed5c81e396664826cb5c1485f495", + "route_weight_sha256": "b96dfcb5e059218a3343f6a9199ca2af817b2807fc124adcec1626e6fb7c2ca8", + "loads": [ + 13, + 16, + 14, + 9, + 6, + 14, + 13, + 11, + 6, + 10, + 2, + 6, + 3, + 9, + 16, + 17, + 12, + 10, + 13, + 4, + 4, + 9, + 4, + 14, + 11, + 13, + 18, + 21, + 11, + 14, + 20, + 3, + 11, + 7, + 50, + 8, + 10, + 12, + 11, + 0, + 10, + 6, + 13, + 3, + 7, + 10, + 1, + 9, + 4, + 11, + 0, + 9, + 49, + 15, + 8, + 1, + 12, + 2, + 8, + 1, + 18, + 10, + 5, + 11 + ], + "weighted_loads": [ + 0.9518147967755795, + 1.0460978616029024, + 0.5634649936109781, + 0.8809064161032438, + 0.2396844644099474, + 0.7618866451084614, + 0.596117727458477, + 0.927681565284729, + 0.4166284780949354, + 0.42481797747313976, + 0.047403398901224136, + 0.20479287579655647, + 0.14963681623339653, + 0.6805113069713116, + 1.5823570843786001, + 1.3231993075460196, + 1.5436819605529308, + 0.8505041375756264, + 0.6396941523998976, + 0.562350258231163, + 0.18915283493697643, + 1.8186741638928652, + 0.18434960395097733, + 0.9031548462808132, + 1.4633855260908604, + 0.7096290811896324, + 1.013686964288354, + 1.362191915512085, + 0.9888834729790688, + 0.7320014573633671, + 1.8277125488966703, + 0.15405455976724625, + 0.5735953282564878, + 0.33661807887256145, + 3.1672612465918064, + 1.0084430277347565, + 0.4547360334545374, + 1.5598666025325656, + 0.745085259899497, + 0.0, + 0.5154268946498632, + 0.24948528222739697, + 0.7300266027450562, + 0.14662214368581772, + 0.2384762279689312, + 0.7497862093150616, + 0.014286392368376255, + 0.9035557024180889, + 0.19976389221847057, + 0.5371394120156765, + 0.0, + 0.4612809494137764, + 4.794610023498535, + 3.357957597821951, + 0.4300270639359951, + 0.12737323343753815, + 0.7855804041028023, + 0.0693267323076725, + 0.43453356623649597, + 0.033860765397548676, + 2.8339817449450493, + 0.478090500459075, + 0.3916223496198654, + 0.940868305042386 + ], + "unique_experts": 62, + "load_cv": 0.8095665853133387, + "normalized_load_entropy": 0.9361193560599889, + "max_load_share": 0.07374631268436578 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "ff5bf314af3db05af25afbfb687b65c65d2ec915e55561fcd88bb3e407b48520", + "route_weight_sha256": "a381ce951b349bbce6444ca8b18a891badf301f03fbea8057b53d578c7494c38", + "loads": [ + 13, + 17, + 14, + 9, + 6, + 22, + 18, + 11, + 6, + 11, + 5, + 6, + 3, + 11, + 16, + 24, + 19, + 16, + 18, + 5, + 17, + 12, + 7, + 14, + 20, + 13, + 22, + 21, + 11, + 14, + 24, + 3, + 13, + 11, + 50, + 8, + 10, + 21, + 12, + 0, + 11, + 13, + 15, + 3, + 10, + 11, + 1, + 9, + 4, + 11, + 1, + 11, + 49, + 27, + 8, + 12, + 12, + 2, + 9, + 1, + 21, + 12, + 5, + 17 + ], + "weighted_loads": [ + 0.9518147967755795, + 1.0788850951939821, + 0.5634649936109781, + 0.8809064161032438, + 0.2396844644099474, + 1.5566118136048317, + 0.8317029885947704, + 0.927681565284729, + 0.4166284780949354, + 0.8028522711247206, + 0.22248530015349388, + 0.20479287579655647, + 0.14963681623339653, + 0.7440648879855871, + 1.5823570843786001, + 1.9473610017448664, + 1.8883324414491653, + 1.2437039222568274, + 1.260658498853445, + 0.6006790660321712, + 1.448893640190363, + 1.9332795422524214, + 0.3443468436598778, + 0.9031548462808132, + 2.2516326792538166, + 0.7096290811896324, + 1.2392043843865395, + 1.362191915512085, + 0.9888834729790688, + 0.7320014573633671, + 2.006532959640026, + 0.15405455976724625, + 0.6855548191815615, + 0.6018555238842964, + 3.1672612465918064, + 1.0084430277347565, + 0.4547360334545374, + 2.028783448971808, + 0.779385419562459, + 0.0, + 0.5602740664035082, + 1.2113736774772406, + 0.7952894754707813, + 0.14662214368581772, + 0.35338733345270157, + 0.8160587288439274, + 0.014286392368376255, + 0.9035557024180889, + 0.19976389221847057, + 0.5371394120156765, + 0.035098299384117126, + 0.5613178089261055, + 4.794610023498535, + 4.254671020433307, + 0.4300270639359951, + 1.04984899610281, + 0.7855804041028023, + 0.0693267323076725, + 0.5294105783104897, + 0.033860765397548676, + 3.0322481095790863, + 0.6164306867867708, + 0.3916223496198654, + 1.2658158782869577 + ], + "unique_experts": 63, + "load_cv": 0.7033756701981413, + "normalized_load_entropy": 0.9460462613276857, + "max_load_share": 0.06038647342995169 + } + }, + "s1_x": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "887509343b554b6332c07324b2deb15e5845b248bc9076f3a05e279a127701e5", + "route_weight_sha256": "38d67cac36d3facefa0178a405f4ea2326564ec5a0273e36207562af77d36e14", + "loads": [ + 16, + 16, + 16, + 8, + 4, + 14, + 15, + 11, + 5, + 7, + 1, + 5, + 3, + 10, + 16, + 15, + 13, + 10, + 14, + 5, + 3, + 8, + 4, + 12, + 12, + 13, + 19, + 23, + 11, + 15, + 20, + 5, + 11, + 9, + 50, + 8, + 8, + 13, + 10, + 0, + 10, + 5, + 12, + 4, + 6, + 10, + 0, + 9, + 4, + 9, + 0, + 9, + 48, + 15, + 8, + 2, + 12, + 2, + 9, + 2, + 17, + 11, + 5, + 11 + ], + "weighted_loads": [ + 1.0429339446127415, + 1.061733417212963, + 0.630443524569273, + 0.823756817728281, + 0.15516878478229046, + 0.7776506990194321, + 0.707258140668273, + 0.926374401897192, + 0.3788321577012539, + 0.32214280031621456, + 0.024978477507829666, + 0.16893604025244713, + 0.14057327061891556, + 0.7276436779648066, + 1.5621809121221304, + 1.1556719178333879, + 1.5327173750847578, + 0.7768733836710453, + 0.6687073614448309, + 0.5734325125813484, + 0.17523175850510597, + 1.7786348480731249, + 0.1762320064008236, + 0.8250490576028824, + 1.4635083377361298, + 0.6835084296762943, + 0.9926879499107599, + 1.445047777146101, + 0.9412569180130959, + 0.7436819113790989, + 1.8462422639131546, + 0.2138237040489912, + 0.5718057304620743, + 0.36852006055414677, + 3.174587246030569, + 0.9723844490945339, + 0.37325428053736687, + 1.5295336544513702, + 0.7213589251041412, + 0.0, + 0.5371662750840187, + 0.2205219306051731, + 0.6723178662359715, + 0.17560510337352753, + 0.2316268254071474, + 0.7395989969372749, + 0.0, + 0.9047503340989351, + 0.1930418536067009, + 0.4822249710559845, + 0.0, + 0.4616626128554344, + 4.765153057873249, + 3.3206992940977216, + 0.42771054431796074, + 0.15048156306147575, + 0.7552737165242434, + 0.07247451692819595, + 0.4649575799703598, + 0.06161281652748585, + 2.8237055595964193, + 0.5097892954945564, + 0.40866655111312866, + 0.9090064913034439 + ], + "unique_experts": 61, + "load_cv": 0.8140256826797292, + "normalized_load_entropy": 0.9343612477382262, + "max_load_share": 0.07374631268436578 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "b41702fdd97aafbda0e80ce8522673c8e4efdf7219e59c999ca6958518b51f04", + "route_weight_sha256": "eab8626bb3e3b1516d807c798b110744a479d40800eda7d1832579352d0a1be5", + "loads": [ + 16, + 20, + 16, + 10, + 4, + 22, + 20, + 12, + 5, + 9, + 7, + 8, + 3, + 13, + 17, + 26, + 20, + 22, + 21, + 5, + 17, + 11, + 8, + 13, + 27, + 13, + 30, + 23, + 11, + 16, + 25, + 5, + 17, + 14, + 51, + 10, + 8, + 22, + 13, + 3, + 13, + 19, + 13, + 7, + 8, + 15, + 1, + 15, + 8, + 12, + 6, + 10, + 48, + 28, + 8, + 14, + 14, + 3, + 10, + 3, + 20, + 12, + 8, + 16 + ], + "weighted_loads": [ + 1.0429339446127415, + 1.2267113775014877, + 0.630443524569273, + 0.913848277181387, + 0.15516878478229046, + 1.6235776096582413, + 0.9769940208643675, + 0.952541159465909, + 0.3788321577012539, + 0.7353414911776781, + 0.2345176450908184, + 0.25980738177895546, + 0.14057327061891556, + 0.8213102333247662, + 1.6175631042569876, + 2.1906840102747083, + 1.7931920569390059, + 1.5986529383808374, + 1.4193531088531017, + 0.5734325125813484, + 1.5005931984633207, + 1.9068970028311014, + 0.3291374705731869, + 0.9016167521476746, + 2.7819000892341137, + 0.6835084296762943, + 2.153070591390133, + 1.445047777146101, + 0.9412569180130959, + 0.7741872873157263, + 2.032576136291027, + 0.2138237040489912, + 0.8578860405832529, + 0.5927772857248783, + 3.2102160528302193, + 1.091076534241438, + 0.37325428053736687, + 2.0137593057006598, + 0.8790913484990597, + 0.17629733681678772, + 0.6466610692441463, + 2.1814547032117844, + 0.7090785354375839, + 0.29621025547385216, + 0.30177117325365543, + 0.9747870489954948, + 0.030745113268494606, + 1.201487137004733, + 0.3531060740351677, + 0.6433544009923935, + 0.24622689001262188, + 0.5018110312521458, + 4.765153057873249, + 4.493537315167487, + 0.42771054431796074, + 1.2250885888934135, + 0.8634601403027773, + 0.13529742509126663, + 0.5499951764941216, + 0.2628121394664049, + 2.9588849749416113, + 0.5827137231826782, + 0.7384146116673946, + 1.1754132732748985 + ], + "unique_experts": 64, + "load_cv": 0.6403269109413532, + "normalized_load_entropy": 0.9557412483379889, + "max_load_share": 0.05519480519480519 + } + }, + "s0_period": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "30a4a0c1b5c14bc5e28ac8a8fa5d7ea56f74f0b9b52d992fcf1dda8dc160aabb", + "route_weight_sha256": "8abee61528ac82bdaed7ef468e20dbb79f67b6276a71fd2cb9c83d9af7c4fea2", + "loads": [ + 14, + 16, + 15, + 8, + 5, + 12, + 13, + 11, + 5, + 7, + 1, + 7, + 4, + 8, + 16, + 14, + 12, + 10, + 14, + 5, + 3, + 9, + 3, + 14, + 11, + 12, + 19, + 20, + 11, + 15, + 20, + 3, + 11, + 7, + 49, + 8, + 10, + 13, + 11, + 0, + 10, + 7, + 15, + 4, + 8, + 10, + 0, + 9, + 4, + 12, + 0, + 9, + 49, + 15, + 8, + 1, + 13, + 2, + 8, + 2, + 19, + 10, + 5, + 12 + ], + "weighted_loads": [ + 0.9896045848727226, + 1.0472560804337263, + 0.6091785524040461, + 0.8452400788664818, + 0.19292812794446945, + 0.701594166457653, + 0.6013306528329849, + 0.935012225061655, + 0.38160801865160465, + 0.33016515523195267, + 0.02298974245786667, + 0.2449881974607706, + 0.15582137368619442, + 0.6625381838530302, + 1.571221748366952, + 1.2662432212382555, + 1.556311497464776, + 0.8898075595498085, + 0.6800089627504349, + 0.5886611379683018, + 0.16678722575306892, + 1.8315059002488852, + 0.15229172259569168, + 0.9042070806026459, + 1.5033776015043259, + 0.6741709969937801, + 1.0386886224150658, + 1.2981395982205868, + 0.9759463034570217, + 0.7436442449688911, + 1.846982877701521, + 0.15674392133951187, + 0.5701915863901377, + 0.34031103551387787, + 3.090330131351948, + 0.9859817177057266, + 0.45647554099559784, + 1.5504426304250956, + 0.740183075889945, + 0.0, + 0.5150561779737473, + 0.2885501142591238, + 0.7871369626373053, + 0.16664107330143452, + 0.269474133849144, + 0.7375675775110722, + 0.0, + 0.8927402123808861, + 0.19887324795126915, + 0.5680691562592983, + 0.0, + 0.44589070603251457, + 4.812543231993914, + 3.361724656075239, + 0.4405885748565197, + 0.12426050007343292, + 0.8036693353205919, + 0.06766112893819809, + 0.44316552206873894, + 0.07413528487086296, + 2.8519237525761127, + 0.4684674609452486, + 0.3844227306544781, + 0.9562286958098412 + ], + "unique_experts": 61, + "load_cv": 0.8069828212202366, + "normalized_load_entropy": 0.9350647705319761, + "max_load_share": 0.07227138643067847 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "cf4b668faf3b104d7a39f36f73689a12c4bbc7fafc2096606ab241e1b0540c7f", + "route_weight_sha256": "d9d46c048a5b1c3e1054b576bd4cedd534505000a1e14d52821c19cdf122a942", + "loads": [ + 14, + 17, + 15, + 8, + 5, + 21, + 18, + 11, + 5, + 8, + 5, + 8, + 4, + 10, + 16, + 21, + 19, + 16, + 19, + 6, + 16, + 11, + 7, + 14, + 20, + 12, + 23, + 20, + 11, + 15, + 24, + 3, + 12, + 11, + 49, + 8, + 10, + 21, + 12, + 0, + 11, + 14, + 17, + 4, + 12, + 11, + 0, + 10, + 4, + 12, + 0, + 11, + 49, + 26, + 8, + 12, + 13, + 2, + 9, + 2, + 22, + 12, + 5, + 17 + ], + "weighted_loads": [ + 0.9896045848727226, + 1.0798310283571482, + 0.6091785524040461, + 0.8452400788664818, + 0.19292812794446945, + 1.5433808378875256, + 0.8319539241492748, + 0.935012225061655, + 0.38160801865160465, + 0.7081994488835335, + 0.24553289636969566, + 0.27779251895844936, + 0.15582137368619442, + 0.7298281639814377, + 1.571221748366952, + 1.8713746946305037, + 1.9392395112663507, + 1.388376286253333, + 1.2546593826264143, + 0.62698994576931, + 1.2656780052930117, + 1.9110632967203856, + 0.3544282838702202, + 0.9042070806026459, + 2.33326243981719, + 0.6741709969937801, + 1.2889988627284765, + 1.2981395982205868, + 0.9759463034570217, + 0.7436442449688911, + 2.038953272625804, + 0.15674392133951187, + 0.6099596973508596, + 0.6025740001350641, + 3.090330131351948, + 0.9859817177057266, + 0.45647554099559784, + 1.98522487282753, + 0.7746065836399794, + 0.0, + 0.5599033497273922, + 1.2797789704054594, + 0.8510566279292107, + 0.16664107330143452, + 0.43310228548943996, + 0.803840097039938, + 0.0, + 0.9323276244103909, + 0.19887324795126915, + 0.5680691562592983, + 0.0, + 0.5459275655448437, + 4.812543231993914, + 4.126643417403102, + 0.4405885748565197, + 0.9967989847064018, + 0.8036693353205919, + 0.06766112893819809, + 0.5349666513502598, + 0.07413528487086296, + 3.042889293283224, + 0.608972018584609, + 0.3844227306544781, + 1.2351221404969692 + ], + "unique_experts": 61, + "load_cv": 0.6948297607774111, + "normalized_load_entropy": 0.9460055874763086, + "max_load_share": 0.059178743961352656 + } + }, + "s1_period": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "fa1a9bc172f520aff3e0fb6363e6866a9f8ef8edb191c17b77f2f3ae12711b52", + "route_weight_sha256": "ffca61289bd3fca295fcf61a392ed3d2f384d2e44178509df9c54ada7e3bda49", + "loads": [ + 16, + 16, + 16, + 7, + 5, + 15, + 15, + 11, + 6, + 7, + 1, + 5, + 4, + 9, + 16, + 14, + 12, + 10, + 13, + 5, + 3, + 9, + 5, + 12, + 12, + 12, + 18, + 23, + 11, + 14, + 20, + 3, + 13, + 8, + 49, + 9, + 9, + 13, + 11, + 0, + 11, + 5, + 13, + 4, + 5, + 10, + 0, + 9, + 4, + 10, + 0, + 9, + 48, + 15, + 8, + 1, + 13, + 2, + 9, + 2, + 17, + 9, + 5, + 12 + ], + "weighted_loads": [ + 1.0409871265292168, + 1.0539720356464386, + 0.636623527854681, + 0.827298529446125, + 0.1922121588140726, + 0.81128915771842, + 0.699305709451437, + 0.9242831636220217, + 0.39943901635706425, + 0.32111850194633007, + 0.024243704974651337, + 0.17417697422206402, + 0.16421914100646973, + 0.6523865219205618, + 1.5509670823812485, + 1.1192289404571056, + 1.4983219299465418, + 0.7686045654118061, + 0.642821965739131, + 0.5773235335946083, + 0.17379231378436089, + 1.8294586464762688, + 0.2037467323243618, + 0.8221348524093628, + 1.5088998936116695, + 0.6493298318237066, + 0.9778865203261375, + 1.4540349766612053, + 0.9380993936210871, + 0.6817607171833515, + 1.8553852625191212, + 0.15725760906934738, + 0.6401905324310064, + 0.3373150862753391, + 3.1202200446277857, + 1.0138927698135376, + 0.4015032444149256, + 1.531398263759911, + 0.7374364323914051, + 0.0, + 0.5756283048540354, + 0.18828319013118744, + 0.6936888210475445, + 0.1711888574063778, + 0.185315553098917, + 0.7405444532632828, + 0.0, + 0.9022158402949572, + 0.19425421208143234, + 0.4982616789638996, + 0.0, + 0.4491240046918392, + 4.807516997680068, + 3.3213118109852076, + 0.42706509307026863, + 0.12783174216747284, + 0.7889195587486029, + 0.07211926206946373, + 0.47248170897364616, + 0.06502142362296581, + 2.8341957833617926, + 0.4373450856655836, + 0.4096289500594139, + 0.9520055083557963 + ], + "unique_experts": 61, + "load_cv": 0.8059469962845209, + "normalized_load_entropy": 0.9347888745438647, + "max_load_share": 0.07227138643067847 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "89204e231872f7bac14c31085647fea07bfbdc624d370502bf24ab569b6f0579", + "route_weight_sha256": "c59166166fe647f022e0dea935db441d5d72a22ec1a473ff009779ad673f9ebd", + "loads": [ + 16, + 20, + 16, + 9, + 5, + 24, + 20, + 12, + 6, + 9, + 6, + 8, + 4, + 12, + 17, + 25, + 18, + 23, + 20, + 5, + 15, + 11, + 8, + 13, + 27, + 12, + 28, + 23, + 11, + 15, + 26, + 3, + 20, + 13, + 50, + 11, + 9, + 22, + 15, + 3, + 15, + 20, + 14, + 7, + 7, + 15, + 1, + 16, + 7, + 13, + 5, + 10, + 48, + 28, + 8, + 13, + 15, + 2, + 10, + 4, + 21, + 10, + 8, + 17 + ], + "weighted_loads": [ + 1.0409871265292168, + 1.215444266796112, + 0.636623527854681, + 0.917389988899231, + 0.1922121588140726, + 1.6931947395205498, + 0.9729826711118221, + 0.9504499211907387, + 0.39943901635706425, + 0.7343171928077936, + 0.2061322219669819, + 0.26263981498777866, + 0.16421914100646973, + 0.7460530772805214, + 1.6063492745161057, + 2.1647599563002586, + 1.722558492794633, + 1.682153007015586, + 1.4351021833717823, + 0.5773235335946083, + 1.1762921009212732, + 1.919844601303339, + 0.33035649359226227, + 0.898702546954155, + 2.8481755442917347, + 0.6493298318237066, + 2.12090702727437, + 1.4540349766612053, + 0.9380993936210871, + 0.7117935288697481, + 2.1203822549432516, + 0.15725760906934738, + 0.9230988994240761, + 0.5616312231868505, + 3.155848851427436, + 1.1325848549604416, + 0.4015032444149256, + 2.0156239150092006, + 0.9347626715898514, + 0.17629733681678772, + 0.7269681971520185, + 2.190732952207327, + 0.730449490249157, + 0.29382891207933426, + 0.25545990094542503, + 0.9757325053215027, + 0.030745113268494606, + 1.232344588264823, + 0.3192381039261818, + 0.6593911089003086, + 0.21978558972477913, + 0.48927242308855057, + 4.807516997680068, + 4.459034727886319, + 0.42706509307026863, + 1.1194009259343147, + 0.8971059825271368, + 0.07211926206946373, + 0.5808946453034878, + 0.2963090632110834, + 3.0344296526163816, + 0.5140575226396322, + 0.7393770106136799, + 1.2281501097604632 + ], + "unique_experts": 64, + "load_cv": 0.6395069173048761, + "normalized_load_entropy": 0.9552714146015384, + "max_load_share": 0.05411255411255411 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 113, + "ordered_topk_exact_tokens": 74, + "set_exact_tokens": 91, + "mean_set_jaccard": 0.9443742098609356, + "mean_token_weighted_tv": 0.013264969036609462, + "aggregate_load_tv": 0.028023598820058997 + }, + "system_bos": { + "tokens": 113, + "ordered_topk_exact_tokens": 73, + "set_exact_tokens": 91, + "mean_set_jaccard": 0.9443742098609356, + "mean_token_weighted_tv": 0.016552752411339137, + "aggregate_load_tv": 0.02359882005899705 + }, + "system_x": { + "tokens": 113, + "ordered_topk_exact_tokens": 58, + "set_exact_tokens": 74, + "mean_set_jaccard": 0.8938053097345132, + "mean_token_weighted_tv": 0.027189296859819276, + "aggregate_load_tv": 0.038348082595870206 + }, + "system_period": { + "tokens": 113, + "ordered_topk_exact_tokens": 54, + "set_exact_tokens": 73, + "mean_set_jaccard": 0.8931731984829332, + "mean_token_weighted_tv": 0.02723795067584884, + "aggregate_load_tv": 0.032448377581120944 + }, + "bos_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 64, + "set_exact_tokens": 78, + "mean_set_jaccard": 0.9096080910240202, + "mean_token_weighted_tv": 0.020628219243732437, + "aggregate_load_tv": 0.035398230088495575 + }, + "bos_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 61, + "set_exact_tokens": 77, + "mean_set_jaccard": 0.9018120522545302, + "mean_token_weighted_tv": 0.023493484305465117, + "aggregate_load_tv": 0.035398230088495575 + }, + "x_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 54, + "set_exact_tokens": 66, + "mean_set_jaccard": 0.8792667509481671, + "mean_token_weighted_tv": 0.026012520627242273, + "aggregate_load_tv": 0.04424778761061947 + }, + "x_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 46, + "set_exact_tokens": 62, + "mean_set_jaccard": 0.8653603034134009, + "mean_token_weighted_tv": 0.031057339841582342, + "aggregate_load_tv": 0.04424778761061947 + }, + "period_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 58, + "set_exact_tokens": 74, + "mean_set_jaccard": 0.8994943109987359, + "mean_token_weighted_tv": 0.02259359736226301, + "aggregate_load_tv": 0.03982300884955753 + }, + "period_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 49, + "set_exact_tokens": 62, + "mean_set_jaccard": 0.8638853771597134, + "mean_token_weighted_tv": 0.031096695374235907, + "aggregate_load_tv": 0.045722713864306784 + } + } + }, + "layer_17": { + "layer": 17, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "c37ca16bcf153207281ec466d0c9d583ab9418e4400d1cdf7c6b64175e726df6", + "route_weight_sha256": "f9b01d79c0bb4afdbd7abe9f7804c94f5295659f53edda282ba7e2baac24b458", + "loads": [ + 18, + 12, + 6, + 9, + 6, + 12, + 0, + 10, + 14, + 9, + 10, + 15, + 8, + 10, + 30, + 25, + 13, + 2, + 11, + 13, + 15, + 5, + 17, + 10, + 8, + 6, + 9, + 12, + 10, + 10, + 11, + 3, + 4, + 13, + 14, + 4, + 2, + 7, + 14, + 14, + 5, + 11, + 9, + 21, + 4, + 29, + 10, + 17, + 9, + 13, + 17, + 11, + 9, + 17, + 6, + 9, + 3, + 8, + 17, + 2, + 7, + 10, + 13, + 0 + ], + "weighted_loads": [ + 0.7599770240485668, + 0.5342848524451256, + 0.26625537127256393, + 0.7852261886000633, + 0.4370600301772356, + 2.5016480572521687, + 0.0, + 0.7035322934389114, + 0.9200507886707783, + 0.7362701278179884, + 0.7564677260816097, + 1.3068786412477493, + 0.3852225150913, + 0.696218766272068, + 2.2339639123529196, + 2.3947639381513, + 0.812125263735652, + 0.07499215379357338, + 0.9295459985733032, + 0.6538136079907417, + 0.5589093659073114, + 0.21266703493893147, + 1.287388313561678, + 1.053070480003953, + 0.6647535003721714, + 0.3762059696018696, + 0.6160593768581748, + 0.5450461618602276, + 1.2025283388793468, + 0.850158728659153, + 1.5989324860274792, + 0.16804016381502151, + 0.1745738834142685, + 0.9455954190343618, + 1.278450857847929, + 0.4939828924834728, + 0.1109774298965931, + 0.2964802011847496, + 2.5257538687437773, + 0.8606781885027885, + 0.3398201912641525, + 0.6279997322708368, + 0.7433136254549026, + 1.0333878248929977, + 0.282572977244854, + 4.172600696794689, + 0.48177274875342846, + 1.0364813581109047, + 0.7544817486777902, + 0.6032291296869516, + 0.9683999586850405, + 0.7568620759993792, + 0.5830367095768452, + 1.4445582143962383, + 0.29205792024731636, + 0.7501205541193485, + 0.12601425498723984, + 0.618947422131896, + 1.2402200419455767, + 0.08332090079784393, + 0.3012461382895708, + 0.5736253391951323, + 1.4198947586119175, + 0.0 + ], + "unique_experts": 62, + "load_cv": 0.5680208903906516, + "normalized_load_entropy": 0.9596898277125613, + "max_load_share": 0.04424778761061947 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "deb6b0a18a92ed7bf71e6d4c81b1704295e803bcac08c667c3c8f8224e464478", + "route_weight_sha256": "8d46af31d71debb182b289a2bbca81409b07e145daae00f5bb7ba77afc6fff13", + "loads": [ + 26, + 13, + 8, + 16, + 6, + 12, + 2, + 10, + 14, + 12, + 16, + 16, + 11, + 18, + 30, + 28, + 14, + 9, + 13, + 13, + 18, + 5, + 17, + 16, + 14, + 14, + 18, + 16, + 15, + 12, + 11, + 3, + 12, + 13, + 15, + 4, + 3, + 7, + 18, + 14, + 12, + 17, + 10, + 23, + 4, + 33, + 10, + 17, + 9, + 14, + 18, + 11, + 11, + 17, + 6, + 14, + 3, + 12, + 17, + 2, + 7, + 11, + 18, + 0 + ], + "weighted_loads": [ + 1.017500557936728, + 0.5704154297709465, + 0.36120210215449333, + 1.371796116232872, + 0.4370600301772356, + 2.5016480572521687, + 0.09579388424754143, + 0.7035322934389114, + 0.9200507886707783, + 0.8466667700558901, + 1.1517121195793152, + 1.3253548499196768, + 0.48527117259800434, + 1.2907082587480545, + 2.2339639123529196, + 2.5749512864276767, + 0.9058110024780035, + 0.7303306348621845, + 0.9830682091414928, + 0.6538136079907417, + 0.8493575770407915, + 0.21266703493893147, + 1.287388313561678, + 1.3226583749055862, + 1.1560980901122093, + 0.8606897965073586, + 2.2594297556206584, + 0.7259550653398037, + 1.3976452182978392, + 0.8904258762486279, + 1.5989324860274792, + 0.16804016381502151, + 0.49816265469416976, + 0.9455954190343618, + 1.359040830284357, + 0.4939828924834728, + 0.14470494538545609, + 0.2964802011847496, + 2.687613820657134, + 0.8606781885027885, + 1.2838774807751179, + 0.8215769599191844, + 0.8500671535730362, + 1.0554041529539973, + 0.282572977244854, + 4.923728439025581, + 0.48177274875342846, + 1.0364813581109047, + 0.7544817486777902, + 0.6371368486434221, + 1.0361576545983553, + 0.7568620759993792, + 0.7514789812266827, + 1.4445582143962383, + 0.29205792024731636, + 1.0702085308730602, + 0.12601425498723984, + 0.8481368850916624, + 1.2402200419455767, + 0.08332090079784393, + 0.3012461382895708, + 0.6370423641055822, + 1.7800012454390526, + 0.0 + ], + "unique_experts": 63, + "load_cv": 0.5010898528518146, + "normalized_load_entropy": 0.9673591426007514, + "max_load_share": 0.03985507246376811 + } + }, + "s1_eos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "59dabaa7938d3b2acb0d6013930f19e953de609419144d84444e1fc0c54666b6", + "route_weight_sha256": "76f68bc9533d2fbbad78cd67199e26920111719ad7e744cd9b5a9803cc9bd5fc", + "loads": [ + 16, + 13, + 6, + 9, + 6, + 11, + 0, + 10, + 14, + 10, + 10, + 15, + 8, + 10, + 30, + 26, + 12, + 2, + 12, + 12, + 13, + 8, + 16, + 8, + 8, + 5, + 10, + 13, + 11, + 10, + 11, + 3, + 4, + 12, + 14, + 4, + 2, + 7, + 13, + 15, + 5, + 11, + 10, + 22, + 4, + 29, + 10, + 17, + 10, + 13, + 16, + 11, + 10, + 17, + 6, + 9, + 3, + 7, + 17, + 2, + 7, + 10, + 13, + 0 + ], + "weighted_loads": [ + 0.6889019552618265, + 0.5579199157655239, + 0.2544308602809906, + 0.8052055407315493, + 0.4281291216611862, + 2.432578695937991, + 0.0, + 0.7010586448013783, + 0.9252528250217438, + 0.7670089453458786, + 0.7627300508320332, + 1.2916955053806305, + 0.41445961222052574, + 0.7036039680242538, + 2.303857147693634, + 2.416217894293368, + 0.7864168211817741, + 0.06776401773095131, + 0.9513266030699015, + 0.6189870052039623, + 0.4917482025921345, + 0.3561840485781431, + 1.2718394361436367, + 1.0078110806643963, + 0.6614557318389416, + 0.34584062546491623, + 0.6535701686516404, + 0.5926793944090605, + 1.2159334495663643, + 0.833764374256134, + 1.5596676766872406, + 0.1724151410162449, + 0.17148232646286488, + 0.9150950759649277, + 1.272795107215643, + 0.4806854650378227, + 0.11154432222247124, + 0.3052014745771885, + 2.448186555877328, + 0.9041539151221514, + 0.3432075008749962, + 0.6403952613472939, + 0.7796280477195978, + 1.0384267568588257, + 0.278907835483551, + 4.169506403617561, + 0.4881978314369917, + 1.0362032689154148, + 0.7711061788722873, + 0.6209051199257374, + 0.9251156244426966, + 0.7521938160061836, + 0.633278276771307, + 1.4439531899988651, + 0.28466087579727173, + 0.7268413826823235, + 0.12501356191933155, + 0.5844734702259302, + 1.229479942470789, + 0.08228200674057007, + 0.28726546093821526, + 0.551787119358778, + 1.4467436894774437, + 0.0 + ], + "unique_experts": 62, + "load_cv": 0.5648255074950481, + "normalized_load_entropy": 0.9602607533285464, + "max_load_share": 0.04424778761061947 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "fd674cbb62068b23268e83fcb17498e1e535eddc75dbb6cb7f8c1cf984e457a5", + "route_weight_sha256": "409a42752c3f33fdd6771e86ea6164706ee06a089d8269778f63fb999fff3d55", + "loads": [ + 24, + 14, + 8, + 16, + 12, + 11, + 3, + 11, + 14, + 15, + 17, + 17, + 8, + 18, + 30, + 33, + 15, + 7, + 14, + 12, + 14, + 9, + 16, + 17, + 18, + 27, + 25, + 16, + 14, + 12, + 12, + 4, + 10, + 12, + 15, + 4, + 8, + 9, + 16, + 16, + 17, + 18, + 12, + 23, + 6, + 34, + 12, + 19, + 10, + 14, + 17, + 17, + 15, + 17, + 7, + 17, + 10, + 20, + 18, + 4, + 8, + 15, + 21, + 0 + ], + "weighted_loads": [ + 1.001840359531343, + 0.6005626581609249, + 0.3359610587358475, + 1.460361810401082, + 0.8199413120746613, + 2.432578695937991, + 0.12018890678882599, + 0.7561891339719296, + 0.9252528250217438, + 0.926132008433342, + 1.2493264563381672, + 1.358524238690734, + 0.41445961222052574, + 1.314617034047842, + 2.303857147693634, + 2.770286181010306, + 1.04025923833251, + 0.6002118848264217, + 1.01709327660501, + 0.6189870052039623, + 0.5628040321171284, + 0.4334136825054884, + 1.2718394361436367, + 1.6682838425040245, + 1.3216027654707432, + 1.808729762211442, + 2.5442517073825, + 0.7188250627368689, + 1.3494123071432114, + 0.919096440076828, + 1.6197833716869354, + 0.21111874654889107, + 0.3860434917733073, + 0.9150950759649277, + 1.35250848159194, + 0.4806854650378227, + 0.41919586807489395, + 0.378918319940567, + 2.744517805054784, + 0.9375979881733656, + 1.9338444285094738, + 1.0238486141897738, + 0.8782731872051954, + 1.0572301037609577, + 0.5133610889315605, + 5.354728805832565, + 0.7069028671830893, + 1.1686003468930721, + 0.7711061788722873, + 0.6555676385760307, + 1.0586907211691141, + 1.0488853510469198, + 0.9509171769022942, + 1.4439531899988651, + 0.37268100678920746, + 1.2425142657011747, + 0.7427666503936052, + 1.3320016656070948, + 1.2528457175940275, + 0.17473744973540306, + 0.32211029902100563, + 0.8375863581895828, + 2.0704507790505886, + 0.0 + ], + "unique_experts": 63, + "load_cv": 0.4592622717995216, + "normalized_load_entropy": 0.9732919888928689, + "max_load_share": 0.0367965367965368 + } + }, + "s0_bos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "e88370caae99ef7e50f74dbe3c8b6d4ba6bab93dedd0852140ab0fc75e4b3ec0", + "route_weight_sha256": "99d7cb37643c3eaeab765be09b61575ebff8aa6e6d86ec59f41d83c88b8e05be", + "loads": [ + 16, + 16, + 5, + 9, + 6, + 11, + 0, + 10, + 14, + 12, + 10, + 15, + 7, + 10, + 30, + 24, + 13, + 1, + 12, + 14, + 14, + 6, + 18, + 8, + 8, + 5, + 11, + 12, + 11, + 9, + 10, + 3, + 4, + 12, + 15, + 5, + 2, + 6, + 14, + 13, + 5, + 10, + 8, + 21, + 4, + 28, + 11, + 18, + 8, + 11, + 18, + 10, + 9, + 18, + 6, + 9, + 3, + 9, + 17, + 2, + 8, + 10, + 14, + 0 + ], + "weighted_loads": [ + 0.6805600598454475, + 0.6517712567001581, + 0.2210159543901682, + 0.7718475908041, + 0.4427971728146076, + 2.5295944772660732, + 0.0, + 0.6882455237209797, + 0.9275330193340778, + 0.8197940438985825, + 0.7656967882066965, + 1.2787205465137959, + 0.3773828521370888, + 0.7180394195020199, + 2.340896848589182, + 2.4167343247681856, + 0.8316990491002798, + 0.04715060442686081, + 0.96710748039186, + 0.6697230823338032, + 0.5347242187708616, + 0.25722858496010303, + 1.3822756372392178, + 0.999787962064147, + 0.6620308868587017, + 0.34150515496730804, + 0.6747751049697399, + 0.5355890579521656, + 1.230122447013855, + 0.7870612777769566, + 1.523689629510045, + 0.1735796257853508, + 0.16713116131722927, + 0.9332377500832081, + 1.313825972378254, + 0.5359593518078327, + 0.11049500107765198, + 0.2568547297269106, + 2.4997705165296793, + 0.8182776868343353, + 0.3223940208554268, + 0.567690771073103, + 0.7400081474334002, + 1.020330274477601, + 0.2853984385728836, + 4.158054863102734, + 0.549684189260006, + 1.0918447487056255, + 0.7418858055025339, + 0.5238810181617737, + 0.9672351917251945, + 0.7360035330057144, + 0.5984513461589813, + 1.4524590391665697, + 0.2950999513268471, + 0.7498108148574829, + 0.12824991531670094, + 0.6493752505630255, + 1.2332205008715391, + 0.0858919583261013, + 0.32461852580308914, + 0.5585919842123985, + 1.4676979128271341, + 0.0 + ], + "unique_experts": 62, + "load_cv": 0.5709546021964007, + "normalized_load_entropy": 0.9586464048169571, + "max_load_share": 0.04424778761061947 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "8d5918ba6d59af73a76a24e0b0049cd87f93a94347ff48f4a4127df37b44696c", + "route_weight_sha256": "1e3c9469d50c075242730f505f7fbbe6b59948064488f221b4432c1218f4b2f8", + "loads": [ + 23, + 18, + 6, + 16, + 6, + 11, + 2, + 10, + 14, + 15, + 16, + 16, + 11, + 18, + 30, + 27, + 14, + 8, + 14, + 15, + 17, + 6, + 18, + 14, + 14, + 13, + 19, + 15, + 16, + 11, + 10, + 3, + 11, + 12, + 16, + 5, + 2, + 6, + 18, + 13, + 13, + 15, + 9, + 22, + 4, + 32, + 11, + 18, + 8, + 13, + 19, + 10, + 11, + 19, + 6, + 14, + 3, + 13, + 17, + 3, + 8, + 11, + 20, + 0 + ], + "weighted_loads": [ + 0.9567090589553118, + 0.7370058875530958, + 0.274265231564641, + 1.3584175184369087, + 0.4427971728146076, + 2.5295944772660732, + 0.09579388424754143, + 0.6882455237209797, + 0.9275330193340778, + 0.9301906861364841, + 1.160941181704402, + 1.2971967551857233, + 0.6345183923840523, + 1.3125289119780064, + 2.340896848589182, + 2.608246335759759, + 0.9316444080322981, + 0.702489085495472, + 1.0206296909600496, + 0.7261111028492451, + 0.8391913529485464, + 0.25722858496010303, + 1.3822756372392178, + 1.2693758569657803, + 1.165618747472763, + 0.8326087221503258, + 1.3938303515315056, + 0.6644208207726479, + 1.4159962143748999, + 0.8502208851277828, + 1.523689629510045, + 0.1735796257853508, + 0.48144297301769257, + 0.9332377500832081, + 1.3990164324641228, + 0.5359593518078327, + 0.11049500107765198, + 0.2568547297269106, + 2.661630468443036, + 0.8182776868343353, + 1.2889529280364513, + 0.7562387976795435, + 0.8467616755515337, + 1.039133621379733, + 0.2853984385728836, + 4.895266165025532, + 0.549684189260006, + 1.0918447487056255, + 0.7418858055025339, + 0.6947720274329185, + 1.0349928876385093, + 0.7360035330057144, + 0.7553454264998436, + 1.5033303368836641, + 0.2950999513268471, + 1.0722557865083218, + 0.12824991531670094, + 0.8951839301735163, + 1.2332205008715391, + 0.12864326685667038, + 0.32461852580308914, + 0.6172716058790684, + 1.897663725540042, + 0.0 + ], + "unique_experts": 63, + "load_cv": 0.4979127476273403, + "normalized_load_entropy": 0.9673642756668034, + "max_load_share": 0.03864734299516908 + } + }, + "s1_bos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "4bb25d285eca95d66e0702398bfc706469bff4f43d8977cba917632b3b7fb7c8", + "route_weight_sha256": "beaf2fc9154fc10c2427ab45589a6986abad0408101f8d1d22ebda882647218e", + "loads": [ + 16, + 10, + 4, + 9, + 6, + 13, + 0, + 10, + 14, + 11, + 10, + 15, + 9, + 10, + 30, + 25, + 13, + 1, + 11, + 13, + 12, + 8, + 19, + 9, + 10, + 6, + 11, + 11, + 12, + 10, + 10, + 4, + 3, + 13, + 15, + 5, + 2, + 6, + 14, + 13, + 5, + 8, + 10, + 21, + 4, + 30, + 11, + 18, + 8, + 12, + 17, + 11, + 9, + 15, + 6, + 9, + 3, + 7, + 18, + 1, + 8, + 11, + 13, + 0 + ], + "weighted_loads": [ + 0.6728924624621868, + 0.4318574108183384, + 0.1741284318268299, + 0.8089119289070368, + 0.4477897137403488, + 2.529888354241848, + 0.0, + 0.6832499094307423, + 0.954858485609293, + 0.8062473032623529, + 0.7774734813719988, + 1.292812269181013, + 0.4723463077098131, + 0.7171242590993643, + 2.446122284978628, + 2.3832209445536137, + 0.7996147125959396, + 0.04324270039796829, + 0.9947628621011972, + 0.6287441998720169, + 0.45031451247632504, + 0.34226433653384447, + 1.4190746769309044, + 1.0328739993274212, + 0.7411404512822628, + 0.35349513217806816, + 0.6901032589375973, + 0.5300831906497478, + 1.2927084993571043, + 0.8284488767385483, + 1.5177053045481443, + 0.18167520873248577, + 0.13997107930481434, + 0.9932003393769264, + 1.3526672162115574, + 0.5267472974956036, + 0.11313768476247787, + 0.26185803581029177, + 2.48728396743536, + 0.8204869478940964, + 0.31765561923384666, + 0.5299501642584801, + 0.8262231666594744, + 1.00485472753644, + 0.2845485173165798, + 4.19969729334116, + 0.5351131428033113, + 1.089925603941083, + 0.7275773314759135, + 0.5604451652616262, + 0.8938091322779655, + 0.7702139653265476, + 0.6020859256386757, + 1.3759492691606283, + 0.28723419830203056, + 0.7284873016178608, + 0.13033586367964745, + 0.6004633121192455, + 1.2905086185783148, + 0.040666550397872925, + 0.3095857035368681, + 0.6082612685859203, + 1.4842344224452972, + 0.0 + ], + "unique_experts": 62, + "load_cv": 0.574842928315784, + "normalized_load_entropy": 0.9582883245235402, + "max_load_share": 0.04424778761061947 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "ea121a6900a54f6442a98651b1d016323e8b77fcc04ed1f7f5d4cf276390da78", + "route_weight_sha256": "cc2e031438a99c978c19c0e7d1b279aaf66a5b93288571769c4e5359f6f8c637", + "loads": [ + 22, + 13, + 6, + 16, + 12, + 13, + 3, + 11, + 14, + 17, + 17, + 17, + 11, + 18, + 30, + 32, + 16, + 6, + 13, + 13, + 13, + 9, + 19, + 18, + 19, + 28, + 25, + 14, + 13, + 11, + 11, + 5, + 8, + 13, + 16, + 5, + 7, + 8, + 17, + 14, + 18, + 14, + 12, + 22, + 6, + 35, + 13, + 20, + 8, + 14, + 19, + 17, + 14, + 15, + 7, + 17, + 11, + 20, + 19, + 3, + 9, + 16, + 22, + 0 + ], + "weighted_loads": [ + 0.9338198453187943, + 0.5774485729634762, + 0.2556586302816868, + 1.4640681985765696, + 0.8396019041538239, + 2.529888354241848, + 0.12018890678882599, + 0.7383803986012936, + 0.954858485609293, + 1.0152041483670473, + 1.2640698868781328, + 1.3596410024911165, + 0.5667705591768026, + 1.3281373251229525, + 2.446122284978628, + 2.7558888755738735, + 1.0609243847429752, + 0.5756905674934387, + 1.0605295356363058, + 0.6287441998720169, + 0.5476652588695288, + 0.41949397046118975, + 1.4190746769309044, + 1.6933467611670494, + 1.4115554988384247, + 1.8221437837928534, + 1.6657718922942877, + 0.6634700857102871, + 1.3316772114485502, + 0.9085752964019775, + 1.5778209995478392, + 0.22037881426513195, + 0.33827568404376507, + 0.9932003393769264, + 1.4360751248896122, + 0.5267472974956036, + 0.37524667009711266, + 0.3355748811736703, + 2.783615216612816, + 0.8539310209453106, + 1.9395940452814102, + 0.9190965946763754, + 0.924868306145072, + 1.023658074438572, + 0.5190017707645893, + 5.504293657839298, + 0.7538181785494089, + 1.2223226819187403, + 0.7275773314759135, + 0.6326145231723785, + 1.0802555419504642, + 1.0669055003672838, + 0.9188746400177479, + 1.3759492691606283, + 0.3752543292939663, + 1.2444156426936388, + 0.7876611277461052, + 1.394943356513977, + 1.3138743937015533, + 0.13312199339270592, + 0.34443054161965847, + 0.8920478112995625, + 2.1581403091549873, + 0.0 + ], + "unique_experts": 63, + "load_cv": 0.4676727382971575, + "normalized_load_entropy": 0.9722669813664303, + "max_load_share": 0.03787878787878788 + } + }, + "s0_x": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "440d52c96c8b5438111b8e679f8b45c8d076ede5857c434c23c1c9d3368bd416", + "route_weight_sha256": "6d9d6c2444e56746bdf1a0a26b3a66fe94f466a180a3b3b8f49e76d6000b85b7", + "loads": [ + 17, + 12, + 6, + 9, + 6, + 13, + 0, + 12, + 14, + 10, + 8, + 15, + 9, + 10, + 32, + 25, + 13, + 1, + 12, + 14, + 15, + 6, + 20, + 7, + 9, + 7, + 10, + 11, + 11, + 10, + 10, + 3, + 4, + 12, + 15, + 6, + 3, + 7, + 13, + 13, + 5, + 6, + 8, + 21, + 4, + 31, + 10, + 17, + 9, + 10, + 15, + 10, + 9, + 18, + 7, + 9, + 3, + 8, + 16, + 2, + 7, + 9, + 14, + 0 + ], + "weighted_loads": [ + 0.7209475375711918, + 0.5313081685453653, + 0.2531247455626726, + 0.7972368393093348, + 0.45905495434999466, + 2.5860714334994555, + 0.0, + 0.7719717193394899, + 0.9379546865820885, + 0.7687435168772936, + 0.6943903267383575, + 1.2842643111944199, + 0.41930959932506084, + 0.6960742603987455, + 2.5087480172514915, + 2.4178127190098166, + 0.8157064933329821, + 0.04030349478125572, + 0.9794963151216507, + 0.707976084202528, + 0.5938061494380236, + 0.27684699930250645, + 1.4854991659522057, + 0.9697771426290274, + 0.7148045673966408, + 0.41622336208820343, + 0.6299797771498561, + 0.5112382918596268, + 1.2040249668061733, + 0.8307850658893585, + 1.5087919756770134, + 0.17590123042464256, + 0.1742402371019125, + 0.9298545457422733, + 1.3326020911335945, + 0.5587735483422875, + 0.13865243270993233, + 0.313786999322474, + 2.504295475780964, + 0.824319738894701, + 0.3242945410311222, + 0.44147490337491035, + 0.7411008980125189, + 0.9767115786671638, + 0.2910842187702656, + 4.236397814936936, + 0.5128260962665081, + 1.0711474604904652, + 0.7298367889598012, + 0.44777459278702736, + 0.8815437350422144, + 0.774236835539341, + 0.5945228040218353, + 1.4678657781332731, + 0.3252552840858698, + 0.7492759972810745, + 0.1319508533924818, + 0.6406091451644897, + 1.1794368997216225, + 0.08677688613533974, + 0.2676221113651991, + 0.5114147402346134, + 1.5119774863123894, + 0.0 + ], + "unique_experts": 62, + "load_cv": 0.5877761551436418, + "normalized_load_entropy": 0.9582666619538274, + "max_load_share": 0.0471976401179941 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "2a6b573365acbc85b7a16a5b6d32d14bcca1672a222685da39ffb0306132db72", + "route_weight_sha256": "2ac3cd0635ad482b27080eeacc1399600437bb5c17506e2b9b7aa74150d845ca", + "loads": [ + 23, + 13, + 8, + 17, + 6, + 13, + 2, + 12, + 14, + 14, + 15, + 16, + 11, + 19, + 32, + 28, + 14, + 9, + 14, + 14, + 17, + 6, + 20, + 14, + 15, + 15, + 18, + 14, + 16, + 12, + 10, + 3, + 11, + 12, + 16, + 6, + 4, + 7, + 17, + 13, + 12, + 11, + 9, + 22, + 4, + 35, + 10, + 17, + 10, + 11, + 17, + 10, + 11, + 18, + 7, + 15, + 3, + 12, + 16, + 2, + 7, + 10, + 19, + 0 + ], + "weighted_loads": [ + 0.9389003496617079, + 0.5674387458711863, + 0.3545906115323305, + 1.5334139931946993, + 0.45905495434999466, + 2.5860714334994555, + 0.09579388424754143, + 0.7719717193394899, + 0.9379546865820885, + 0.9229021463543177, + 1.2403910346329212, + 1.3027405198663473, + 0.4822486136108637, + 1.3290506061166525, + 2.5087480172514915, + 2.6149753918871284, + 0.9086881224066019, + 0.7411671429872513, + 1.0330185256898403, + 0.707976084202528, + 0.8016587365418673, + 0.27684699930250645, + 1.4854991659522057, + 1.2969272285699844, + 1.199800718575716, + 0.9099651984870434, + 1.3018037406727672, + 0.640070054680109, + 1.3968767430633307, + 0.8997862860560417, + 1.5087919756770134, + 0.17590123042464256, + 0.4943132996559143, + 0.9298545457422733, + 1.4106053188443184, + 0.5587735483422875, + 0.18031594157218933, + 0.313786999322474, + 2.6661554276943207, + 0.824319738894701, + 1.217261180281639, + 0.6433544587343931, + 0.8478544261306524, + 0.9955149255692959, + 0.2910842187702656, + 5.016550925560296, + 0.5128260962665081, + 1.0711474604904652, + 0.7713567772880197, + 0.4847235567867756, + 1.0194905418902636, + 0.774236835539341, + 0.7489488124847412, + 1.4678657781332731, + 0.3252552840858698, + 1.1033110432326794, + 0.1319508533924818, + 0.8609835803508759, + 1.1794368997216225, + 0.08677688613533974, + 0.2676221113651991, + 0.572146225720644, + 1.8529304526746273, + 0.0 + ], + "unique_experts": 63, + "load_cv": 0.5035058772765278, + "normalized_load_entropy": 0.9680251657624377, + "max_load_share": 0.042270531400966184 + } + }, + "s1_x": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "a0fa0ba33b40b8769ad5a579d34f35c8a58a2a7fb5dc6c3ea7064bf12c7b4eb5", + "route_weight_sha256": "ac75f8d5dff38dcdd56912d0dbb11b9cf4f396ddaffac20698b427430a6475cf", + "loads": [ + 17, + 12, + 5, + 10, + 6, + 11, + 0, + 13, + 14, + 8, + 10, + 15, + 10, + 10, + 34, + 26, + 14, + 0, + 11, + 13, + 14, + 8, + 19, + 7, + 10, + 6, + 12, + 9, + 13, + 11, + 10, + 4, + 4, + 13, + 15, + 4, + 2, + 5, + 13, + 13, + 5, + 5, + 10, + 22, + 4, + 30, + 11, + 17, + 8, + 10, + 17, + 11, + 9, + 17, + 6, + 9, + 3, + 7, + 18, + 1, + 5, + 8, + 14, + 0 + ], + "weighted_loads": [ + 0.6992369201034307, + 0.5274491179734468, + 0.21010060980916023, + 0.8259200863540173, + 0.4463189635425806, + 2.5201270263642073, + 0.0, + 0.8079398348927498, + 0.9242614842951298, + 0.7204856779426336, + 0.7631232049316168, + 1.285636130720377, + 0.5225696079432964, + 0.6903998218476772, + 2.6985154319554567, + 2.4086756948381662, + 0.8381892163306475, + 0.0, + 0.9772769473493099, + 0.6585576124489307, + 0.4989264141768217, + 0.3237130679190159, + 1.4092187583446503, + 0.95775499753654, + 0.725877096876502, + 0.39931511506438255, + 0.6969917695969343, + 0.46135640889406204, + 1.3156643435359001, + 0.8827761597931385, + 1.5047071352601051, + 0.20502686873078346, + 0.1681780442595482, + 0.9924649391323328, + 1.3539223372936249, + 0.5150694660842419, + 0.1140146255493164, + 0.23294264823198318, + 2.449583800509572, + 0.8058469630777836, + 0.2875903844833374, + 0.3867380768060684, + 0.864721953868866, + 0.9374825116246939, + 0.2850918658077717, + 4.22008653357625, + 0.5337813459336758, + 1.0564429126679897, + 0.7029221821576357, + 0.4799619223922491, + 0.9128119088709354, + 0.7943268977105618, + 0.6119009964168072, + 1.4346368722617626, + 0.27825961634516716, + 0.685851227492094, + 0.1377793848514557, + 0.6000160817056894, + 1.264529699459672, + 0.038611892610788345, + 0.18695631437003613, + 0.48513465747237206, + 1.4982042107731104, + 0.0 + ], + "unique_experts": 61, + "load_cv": 0.6157706709483216, + "normalized_load_entropy": 0.9530804931860031, + "max_load_share": 0.05014749262536873 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "cc69d302c209ad7f9dde768ae40c2a3f0107dbedd9061211faa9d731f521cd6c", + "route_weight_sha256": "bd29ec83b898a79ba13a4a62f7f34c329461edf81fb86c88be3a39d716b3f556", + "loads": [ + 23, + 13, + 8, + 18, + 12, + 11, + 3, + 14, + 14, + 14, + 18, + 17, + 10, + 19, + 34, + 34, + 17, + 6, + 13, + 13, + 14, + 9, + 19, + 17, + 19, + 29, + 24, + 11, + 14, + 12, + 11, + 5, + 9, + 13, + 16, + 4, + 8, + 7, + 16, + 14, + 17, + 11, + 12, + 23, + 6, + 35, + 13, + 19, + 9, + 10, + 19, + 17, + 14, + 17, + 7, + 17, + 10, + 21, + 20, + 3, + 6, + 14, + 22, + 0 + ], + "weighted_loads": [ + 0.9591496977955103, + 0.5700918603688478, + 0.35102376714348793, + 1.6444805823266506, + 0.8381311539560556, + 2.5201270263642073, + 0.12018890678882599, + 0.8630703240633011, + 0.9242614842951298, + 0.9167904797941446, + 1.390996491536498, + 1.3524648640304804, + 0.5225696079432964, + 1.3610470071434975, + 2.6985154319554567, + 2.8178361784666777, + 1.0887429397553205, + 0.5826075561344624, + 1.0430436208844185, + 0.6585576124489307, + 0.4989264141768217, + 0.40094270184636116, + 1.4092187583446503, + 1.6473665609955788, + 1.3610287699848413, + 1.8694831524044275, + 1.5414163116365671, + 0.5372592099010944, + 1.355828084051609, + 0.9629025794565678, + 1.5648228302598, + 0.24373047426342964, + 0.3961944542825222, + 0.9924649391323328, + 1.4373454600572586, + 0.5150694660842419, + 0.43046820908784866, + 0.3066594935953617, + 2.745915049687028, + 0.8392910361289978, + 1.800684604793787, + 0.7501998972147703, + 0.9633670933544636, + 0.9562858585268259, + 0.5195451192557812, + 5.346814315766096, + 0.7524863816797733, + 1.188839990645647, + 0.7414548080414534, + 0.4799619223922491, + 1.134972419589758, + 1.091018432751298, + 0.9253736697137356, + 1.4346368722617626, + 0.3662797473371029, + 1.1916381623595953, + 0.7555324733257294, + 1.3848298843950033, + 1.3390793204307556, + 0.13106733560562134, + 0.2218011524528265, + 0.7911876048892736, + 2.056645268574357, + 0.0 + ], + "unique_experts": 63, + "load_cv": 0.49356345080295033, + "normalized_load_entropy": 0.9699229112211392, + "max_load_share": 0.03787878787878788 + } + }, + "s0_period": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "681cb2f1503c93d434ea49291670ee0e6fb7d15dbe537f30744c02c2ed1e1d39", + "route_weight_sha256": "8e36cc8049a4c3b7eb2e4ed4042f68953b91384c8e61c45257d77989b689e67f", + "loads": [ + 16, + 12, + 5, + 9, + 6, + 13, + 0, + 12, + 14, + 9, + 8, + 16, + 8, + 10, + 32, + 25, + 13, + 1, + 12, + 14, + 14, + 6, + 17, + 8, + 10, + 7, + 10, + 12, + 12, + 10, + 10, + 3, + 4, + 12, + 15, + 6, + 3, + 6, + 14, + 13, + 6, + 7, + 8, + 22, + 4, + 29, + 11, + 18, + 8, + 10, + 16, + 12, + 9, + 16, + 6, + 9, + 3, + 7, + 16, + 2, + 8, + 10, + 14, + 0 + ], + "weighted_loads": [ + 0.6851665880531073, + 0.5207733865827322, + 0.2137047816067934, + 0.7930908426642418, + 0.4548501167446375, + 2.6010486632585526, + 0.0, + 0.770253948867321, + 0.9238932877779007, + 0.7419583667069674, + 0.7030784487724304, + 1.325161885470152, + 0.3831594195216894, + 0.7060352265834808, + 2.4867449067533016, + 2.375706799328327, + 0.8223829064518213, + 0.044182296842336655, + 0.9808077085763216, + 0.7053304016590118, + 0.5429530907422304, + 0.284783030860126, + 1.4139168187975883, + 1.003560472279787, + 0.7071549035608768, + 0.4390154704451561, + 0.6093583358451724, + 0.54387410543859, + 1.22695395629853, + 0.8191177770495415, + 1.4772937167435884, + 0.17333970218896866, + 0.1730236280709505, + 0.9258275032043457, + 1.3463242948055267, + 0.5569157153367996, + 0.13251196406781673, + 0.30255548283457756, + 2.518164472654462, + 0.8259915933012962, + 0.3928345739841461, + 0.493844386190176, + 0.742888392880559, + 1.0253363847732544, + 0.28984905034303665, + 4.145354769192636, + 0.5484874881803989, + 1.0724284211173654, + 0.7125462340191007, + 0.45979876443743706, + 0.9201157335191965, + 0.8365252781659365, + 0.597898542881012, + 1.391696736216545, + 0.28947364166378975, + 0.7642447724938393, + 0.13226924650371075, + 0.5917509943246841, + 1.1895774882286787, + 0.09260769188404083, + 0.32581848092377186, + 0.5525096617639065, + 1.5379951372742653, + 0.0 + ], + "unique_experts": 62, + "load_cv": 0.5762942869395777, + "normalized_load_entropy": 0.9591665243487582, + "max_load_share": 0.0471976401179941 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "6a48a503af9f6da0286277f662168b5896b2e7208a08e4fdae4d72a767d69073", + "route_weight_sha256": "4e2802c5d594b4acfd4bf3f618933c68ad19e818b7aa28b1553c84ae7b27f77e", + "loads": [ + 22, + 13, + 7, + 17, + 6, + 13, + 2, + 12, + 14, + 12, + 14, + 17, + 10, + 18, + 32, + 28, + 14, + 8, + 14, + 14, + 17, + 6, + 17, + 14, + 16, + 17, + 18, + 16, + 17, + 12, + 10, + 3, + 11, + 12, + 16, + 6, + 4, + 6, + 18, + 13, + 14, + 12, + 10, + 23, + 4, + 33, + 11, + 18, + 8, + 10, + 18, + 12, + 11, + 16, + 6, + 16, + 3, + 11, + 16, + 2, + 8, + 11, + 19, + 0 + ], + "weighted_loads": [ + 0.9074783511459827, + 0.5569039639085531, + 0.3319316301494837, + 1.4205289594829082, + 0.4548501167446375, + 2.6010486632585526, + 0.09579388424754143, + 0.770253948867321, + 0.9238932877779007, + 0.852355008944869, + 1.0983228422701359, + 1.3436380941420794, + 0.44609843380749226, + 1.3005247190594673, + 2.4867449067533016, + 2.5662049390375614, + 0.9132407251745462, + 0.6995207779109478, + 1.0343299191445112, + 0.7053304016590118, + 0.8034818153828382, + 0.284783030860126, + 1.4139168187975883, + 1.2731483671814203, + 1.1739942654967308, + 1.024154145270586, + 1.2739265924319625, + 0.7083829138427973, + 1.4153289655223489, + 0.8879081308841705, + 1.4772937167435884, + 0.17333970218896866, + 0.502714853733778, + 0.9258275032043457, + 1.4338630214333534, + 0.5569157153367996, + 0.17123816721141338, + 0.30255548283457756, + 2.6800244245678186, + 0.8259915933012962, + 1.3353694677352905, + 0.7013331260532141, + 0.8913385663181543, + 1.0441397316753864, + 0.28984905034303665, + 4.9893287336453795, + 0.5484874881803989, + 1.0724284211173654, + 0.7125462340191007, + 0.45979876443743706, + 1.0553261060267687, + 0.8365252781659365, + 0.7559100687503815, + 1.391696736216545, + 0.28947364166378975, + 1.3151462525129318, + 0.13226924650371075, + 0.8057934939861298, + 1.1895774882286787, + 0.09260769188404083, + 0.32581848092377186, + 0.6124504469335079, + 1.88887345418334, + 0.0 + ], + "unique_experts": 63, + "load_cv": 0.49978407902867444, + "normalized_load_entropy": 0.9679248238806188, + "max_load_share": 0.03985507246376811 + } + }, + "s1_period": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "7ef7e77fe30b550b6c70b8714bbf7382b082a190a911e309f181e385bd3bddb2", + "route_weight_sha256": "0f741561053b7d55706a2d199776e31e3f0db1d3a8705c74b5bc618ec4d30209", + "loads": [ + 17, + 12, + 6, + 9, + 6, + 13, + 0, + 12, + 14, + 8, + 9, + 14, + 11, + 10, + 32, + 26, + 14, + 0, + 13, + 15, + 13, + 7, + 18, + 9, + 8, + 7, + 12, + 11, + 10, + 11, + 10, + 4, + 4, + 13, + 15, + 5, + 2, + 5, + 13, + 13, + 5, + 5, + 10, + 22, + 4, + 28, + 9, + 17, + 9, + 11, + 17, + 12, + 9, + 17, + 7, + 8, + 3, + 6, + 18, + 2, + 5, + 9, + 14, + 0 + ], + "weighted_loads": [ + 0.698191462084651, + 0.5265700407326221, + 0.23820790834724903, + 0.796196885406971, + 0.44718078151345253, + 2.594941545277834, + 0.0, + 0.7645702287554741, + 0.9169225078076124, + 0.725453058257699, + 0.7574976850301027, + 1.2425338625907898, + 0.5500407759100199, + 0.6897667236626148, + 2.516151662915945, + 2.3769024945795536, + 0.8400743212550879, + 0.0, + 1.0469925496727228, + 0.7334735840559006, + 0.5117076430469751, + 0.2927030883729458, + 1.389654230326414, + 1.0158193707466125, + 0.6229121349751949, + 0.4492447152733803, + 0.6859039952978492, + 0.526320293545723, + 1.204431228339672, + 0.8691059518605471, + 1.5036456417292356, + 0.2035214677453041, + 0.16420290060341358, + 1.004174791276455, + 1.3440706431865692, + 0.5232296576723456, + 0.11244714632630348, + 0.23597919568419456, + 2.4537208769470453, + 0.8024504706263542, + 0.2620422951877117, + 0.3856211379170418, + 0.8341421578079462, + 0.9656254835426807, + 0.28671738132834435, + 4.1508580055087805, + 0.4735211245715618, + 1.0336711071431637, + 0.735103570856154, + 0.5301975291222334, + 0.9000678434967995, + 0.8312966860830784, + 0.5949459187686443, + 1.4280432984232903, + 0.3226666282862425, + 0.6220215708017349, + 0.13428421318531036, + 0.5669645834714174, + 1.2744778450578451, + 0.08142600953578949, + 0.18274754658341408, + 0.518005758523941, + 1.4792326427996159, + 0.0 + ], + "unique_experts": 61, + "load_cv": 0.5901400936187331, + "normalized_load_entropy": 0.9561162543609026, + "max_load_share": 0.0471976401179941 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "75287e629c76f198cc476abc6df15c11efaeb7d3042f645a5ee85111be3abaae", + "route_weight_sha256": "f0b20aa172722e043d28601dbcc4423e37d0c2d9ec766c8a1f34f9c084eed4e1", + "loads": [ + 23, + 13, + 9, + 17, + 12, + 13, + 3, + 13, + 14, + 13, + 16, + 16, + 11, + 18, + 32, + 33, + 17, + 5, + 15, + 15, + 13, + 8, + 18, + 18, + 17, + 31, + 25, + 13, + 12, + 12, + 11, + 5, + 9, + 13, + 16, + 5, + 8, + 7, + 16, + 14, + 18, + 11, + 14, + 23, + 6, + 33, + 11, + 19, + 9, + 11, + 19, + 18, + 14, + 17, + 8, + 18, + 10, + 21, + 19, + 4, + 6, + 15, + 21, + 0 + ], + "weighted_loads": [ + 0.9589152056723833, + 0.5692127831280231, + 0.3626890014857054, + 1.5094365254044533, + 0.8389929719269276, + 2.594941545277834, + 0.12018890678882599, + 0.8197007179260254, + 0.9169225078076124, + 0.8845761213451624, + 1.2440940905362368, + 1.3093625959008932, + 0.5500407759100199, + 1.300779789686203, + 2.516151662915945, + 2.7295511215925217, + 1.0974966082721949, + 0.5324478670954704, + 1.1127592232078314, + 0.7334735840559006, + 0.5117076430469751, + 0.36993272230029106, + 1.389654230326414, + 1.6762921325862408, + 1.2519882023334503, + 2.036165753379464, + 1.5575881404802203, + 0.6022230945527554, + 1.271786404773593, + 0.9492323715239763, + 1.5637613367289305, + 0.2422250732779503, + 0.3754818569868803, + 1.004174791276455, + 1.4303513318300247, + 0.5232296576723456, + 0.4323095828294754, + 0.3096960410475731, + 2.7500521261245012, + 0.8358945436775684, + 1.8222959116101265, + 0.7529994677752256, + 1.0143070351332426, + 0.9844288304448128, + 0.5211706347763538, + 5.478324456140399, + 0.6922261603176594, + 1.166068185120821, + 0.735103570856154, + 0.5301975291222334, + 1.1051381677389145, + 1.1279882211238146, + 0.9198762811720371, + 1.4280432984232903, + 0.4106867592781782, + 1.3387434463948011, + 0.752037301659584, + 1.4100379291921854, + 1.2978436201810837, + 0.17388145253062248, + 0.21759238466620445, + 0.8262892793864012, + 1.983704499900341, + 0.0 + ], + "unique_experts": 63, + "load_cv": 0.47656419809469813, + "normalized_load_entropy": 0.9717290283993872, + "max_load_share": 0.03571428571428571 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 113, + "ordered_topk_exact_tokens": 78, + "set_exact_tokens": 92, + "mean_set_jaccard": 0.9469026548672567, + "mean_token_weighted_tv": 0.013518173527796712, + "aggregate_load_tv": 0.022123893805309734 + }, + "system_bos": { + "tokens": 113, + "ordered_topk_exact_tokens": 67, + "set_exact_tokens": 81, + "mean_set_jaccard": 0.9190897597977244, + "mean_token_weighted_tv": 0.01976169465703115, + "aggregate_load_tv": 0.035398230088495575 + }, + "system_x": { + "tokens": 113, + "ordered_topk_exact_tokens": 53, + "set_exact_tokens": 74, + "mean_set_jaccard": 0.8957016434892542, + "mean_token_weighted_tv": 0.027547210817579673, + "aggregate_load_tv": 0.04129793510324484 + }, + "system_period": { + "tokens": 113, + "ordered_topk_exact_tokens": 49, + "set_exact_tokens": 72, + "mean_set_jaccard": 0.8839022334597556, + "mean_token_weighted_tv": 0.028845682810266726, + "aggregate_load_tv": 0.03982300884955752 + }, + "bos_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 70, + "set_exact_tokens": 82, + "mean_set_jaccard": 0.9178255372945638, + "mean_token_weighted_tv": 0.019550023938372598, + "aggregate_load_tv": 0.03392330383480826 + }, + "bos_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 58, + "set_exact_tokens": 70, + "mean_set_jaccard": 0.8912768647281922, + "mean_token_weighted_tv": 0.02465929660072501, + "aggregate_load_tv": 0.03982300884955752 + }, + "x_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 63, + "set_exact_tokens": 76, + "mean_set_jaccard": 0.9026548672566371, + "mean_token_weighted_tv": 0.023045990805644376, + "aggregate_load_tv": 0.038348082595870206 + }, + "x_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 41, + "set_exact_tokens": 60, + "mean_set_jaccard": 0.8531394858828488, + "mean_token_weighted_tv": 0.033344380780065484, + "aggregate_load_tv": 0.05014749262536873 + }, + "period_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 63, + "set_exact_tokens": 75, + "mean_set_jaccard": 0.9039190897597977, + "mean_token_weighted_tv": 0.02253552527883939, + "aggregate_load_tv": 0.038348082595870206 + }, + "period_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 48, + "set_exact_tokens": 64, + "mean_set_jaccard": 0.8613569321533923, + "mean_token_weighted_tv": 0.03218984322424615, + "aggregate_load_tv": 0.04867256637168142 + } + } + }, + "layer_18": { + "layer": 18, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "003a92e71e30783a7f26eb110b664bb44ef544c70e403f77466f568e5b99e734", + "route_weight_sha256": "3b3b8436e889ecdd0069f66be66000db84050c41e4dda6c979b98eb98f460034", + "loads": [ + 8, + 11, + 21, + 6, + 6, + 13, + 11, + 16, + 10, + 0, + 5, + 14, + 1, + 7, + 19, + 5, + 13, + 4, + 8, + 11, + 17, + 1, + 10, + 18, + 13, + 5, + 17, + 11, + 8, + 10, + 14, + 8, + 13, + 8, + 3, + 4, + 8, + 35, + 5, + 15, + 11, + 9, + 6, + 19, + 3, + 18, + 6, + 15, + 16, + 19, + 27, + 7, + 10, + 9, + 13, + 7, + 11, + 9, + 12, + 15, + 6, + 4, + 0, + 14 + ], + "weighted_loads": [ + 0.5664918068796396, + 0.46079470589756966, + 2.1773136034607887, + 0.3459447808563709, + 0.3918048180639744, + 0.8709587380290031, + 0.8925063889473677, + 1.3544674180448055, + 1.3483004458248615, + 0.0, + 0.21748564019799232, + 0.7073699496686459, + 0.08200376480817795, + 0.7549933884292841, + 1.539990458637476, + 0.11503099277615547, + 0.9465133640915155, + 0.14410283043980598, + 0.4148006737232208, + 0.6912436485290527, + 1.328526895493269, + 0.02822551503777504, + 2.107482884079218, + 1.0511502660810947, + 0.652875532861799, + 0.25362055748701096, + 0.743111340329051, + 0.565369158051908, + 1.575169812887907, + 0.5740464869886637, + 1.1893945317715406, + 0.31053026020526886, + 1.0907119745388627, + 0.42411788180470467, + 0.42328596115112305, + 0.15392956137657166, + 0.3432709388434887, + 2.1137979570776224, + 0.202702596783638, + 0.533845629543066, + 0.6236581727862358, + 0.4518641773611307, + 0.23220455460250378, + 1.3650217670947313, + 0.10466626659035683, + 1.252630591392517, + 0.5089246369898319, + 1.2408609380945563, + 0.6733484379947186, + 1.972502637654543, + 1.2251861225813627, + 0.3292568624019623, + 1.0341813638806343, + 0.6507493332028389, + 1.2434470877051353, + 0.6773216892033815, + 0.4305240362882614, + 0.46537341363728046, + 3.145773157477379, + 0.919614901766181, + 0.32581086084246635, + 0.118300287052989, + 0.0, + 0.7518191933631897 + ], + "unique_experts": 62, + "load_cv": 0.5939028241739067, + "normalized_load_entropy": 0.9564432416145123, + "max_load_share": 0.051622418879056046 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "879328da2f2cd438f6414d72f1f2b721b74e700964b60e5b5be17c4fd9bcac22", + "route_weight_sha256": "b680a8c971f34634bd67c18aa5a45c9d7d3214575e012b70e60cd9c61e7b3890", + "loads": [ + 14, + 12, + 33, + 6, + 6, + 16, + 11, + 16, + 18, + 0, + 6, + 18, + 2, + 7, + 24, + 10, + 13, + 4, + 26, + 11, + 17, + 2, + 10, + 18, + 13, + 5, + 17, + 12, + 8, + 10, + 22, + 8, + 13, + 8, + 3, + 7, + 9, + 37, + 5, + 18, + 17, + 10, + 9, + 19, + 4, + 18, + 13, + 15, + 19, + 31, + 30, + 10, + 19, + 17, + 13, + 7, + 13, + 10, + 13, + 18, + 6, + 6, + 0, + 16 + ], + "weighted_loads": [ + 0.9509093817323446, + 0.531625110656023, + 3.2088122069835663, + 0.3459447808563709, + 0.3918048180639744, + 0.9419459663331509, + 0.8925063889473677, + 1.3544674180448055, + 1.8300997912883759, + 0.0, + 0.22853907570242882, + 1.111284550279379, + 0.11841418594121933, + 0.7549933884292841, + 2.4730900898575783, + 0.27524989284574986, + 0.9465133640915155, + 0.14410283043980598, + 1.5478402003645897, + 0.6912436485290527, + 1.328526895493269, + 0.05374618247151375, + 2.107482884079218, + 1.0511502660810947, + 0.652875532861799, + 0.25362055748701096, + 0.743111340329051, + 0.6366418963298202, + 1.575169812887907, + 0.5740464869886637, + 1.5331780826672912, + 0.31053026020526886, + 1.0907119745388627, + 0.42411788180470467, + 0.42328596115112305, + 0.2825479060411453, + 0.3669428415596485, + 2.1737546399235725, + 0.202702596783638, + 0.638939343392849, + 0.9666054770350456, + 0.4802536107599735, + 0.32220860198140144, + 1.3650217670947313, + 0.14330678060650826, + 1.252630591392517, + 2.0137055553495884, + 1.2408609380945563, + 0.8179671503603458, + 2.5097756441682577, + 1.3157213237136602, + 0.5288363117724657, + 1.646943999454379, + 1.2303197756409645, + 1.2434470877051353, + 0.6773216892033815, + 1.42724609375, + 0.5012693833559752, + 3.175057178363204, + 1.011128008365631, + 0.32581086084246635, + 0.17278343252837658, + 0.0, + 0.8421918824315071 + ], + "unique_experts": 62, + "load_cv": 0.5962025972201204, + "normalized_load_entropy": 0.956073183685554, + "max_load_share": 0.04468599033816425 + } + }, + "s1_eos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "fb173e2211a8bafaed94b2d616f4d2677f5e75e9520bf96ab86da36905aa80e3", + "route_weight_sha256": "a86fd30ed81a7e458e11e4aba25e99d67dde23e6c0197ac31f53c74574026498", + "loads": [ + 7, + 9, + 21, + 6, + 6, + 12, + 11, + 16, + 11, + 1, + 5, + 14, + 1, + 7, + 19, + 5, + 13, + 4, + 9, + 10, + 18, + 1, + 10, + 18, + 16, + 5, + 17, + 11, + 7, + 9, + 14, + 7, + 12, + 8, + 3, + 7, + 6, + 36, + 5, + 15, + 11, + 9, + 5, + 19, + 3, + 19, + 6, + 15, + 16, + 19, + 26, + 7, + 10, + 9, + 13, + 7, + 9, + 9, + 12, + 14, + 9, + 5, + 0, + 14 + ], + "weighted_loads": [ + 0.5755189801566303, + 0.38161771930754185, + 2.1616953015327454, + 0.3418510630726814, + 0.42653269693255424, + 0.8096174970269203, + 0.8671439457684755, + 1.345440287142992, + 1.415489268489182, + 0.033566638827323914, + 0.2149205207824707, + 0.7015881463885307, + 0.10567093640565872, + 0.7619553953409195, + 1.5514942314475775, + 0.12795850820839405, + 0.9488352574408054, + 0.1453357320278883, + 0.4398137889802456, + 0.6314290408045053, + 1.3608131632208824, + 0.02488451637327671, + 2.120649851858616, + 1.0596197117120028, + 0.7183171520009637, + 0.2530501075088978, + 0.73799386061728, + 0.5758795272558928, + 1.5442277304828167, + 0.5294341035187244, + 1.1775484345853329, + 0.26834658719599247, + 1.0391665305942297, + 0.42307473346590996, + 0.4183674678206444, + 0.25100869685411453, + 0.2781815342605114, + 2.1652768459171057, + 0.20598543994128704, + 0.5334967747330666, + 0.6234597079455853, + 0.4592064209282398, + 0.20669449865818024, + 1.3690494615584612, + 0.1029942687600851, + 1.2903830744326115, + 0.49843863397836685, + 1.215593472123146, + 0.6835286691784859, + 1.96720627322793, + 1.1617843192070723, + 0.33166615292429924, + 1.070546429604292, + 0.6255691647529602, + 1.248137367889285, + 0.6650181580334902, + 0.35843590274453163, + 0.45065861102193594, + 3.126860499382019, + 0.9164734799414873, + 0.4352302588522434, + 0.1379524003714323, + 0.0, + 0.7758407555520535 + ], + "unique_experts": 63, + "load_cv": 0.5962424725752327, + "normalized_load_entropy": 0.9574996643581383, + "max_load_share": 0.05309734513274336 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "6ee176aeb4e6c36595d2812e1ea54dcc959bd6af6e204832a42a12bb65b73667", + "route_weight_sha256": "953c7aa6fb443b5d3fc6af8fcd7f1321267266528a7198a359264b4ba0c2454c", + "loads": [ + 15, + 13, + 34, + 6, + 7, + 16, + 12, + 18, + 21, + 2, + 6, + 18, + 1, + 8, + 28, + 8, + 13, + 14, + 32, + 11, + 18, + 1, + 10, + 18, + 16, + 5, + 17, + 12, + 7, + 10, + 25, + 9, + 13, + 9, + 7, + 21, + 7, + 42, + 6, + 18, + 17, + 9, + 8, + 25, + 4, + 19, + 23, + 19, + 19, + 33, + 27, + 10, + 19, + 21, + 15, + 8, + 12, + 14, + 14, + 19, + 9, + 7, + 0, + 19 + ], + "weighted_loads": [ + 1.0186130995862186, + 0.5467004887759686, + 3.2303677797317505, + 0.3418510630726814, + 0.4648919217288494, + 0.9258981700986624, + 0.8974640667438507, + 1.414024768397212, + 2.2683421904221177, + 0.07038159668445587, + 0.22663975227624178, + 1.1021485105156898, + 0.10567093640565872, + 0.8075400851666927, + 2.663260269910097, + 0.21206008829176426, + 0.9488352574408054, + 0.7424988877028227, + 2.3471375051885843, + 0.7668693009763956, + 1.3608131632208824, + 0.02488451637327671, + 2.120649851858616, + 1.0596197117120028, + 0.7183171520009637, + 0.2530501075088978, + 0.73799386061728, + 0.6659802626818419, + 1.5442277304828167, + 0.5659844875335693, + 1.7775003043934703, + 0.510906221345067, + 1.0961424577981234, + 0.4986261986196041, + 0.8429937697947025, + 1.5037126615643501, + 0.3015830647200346, + 2.4236679431051016, + 0.2412255685776472, + 0.6238809283822775, + 0.9479296579957008, + 0.4592064209282398, + 0.2945739645510912, + 1.8511877562850714, + 0.14429318718612194, + 1.2903830744326115, + 3.0965681001544, + 1.3972225077450275, + 0.7784492075443268, + 2.5831099320203066, + 1.1880390830338001, + 0.525836206972599, + 1.650247098878026, + 1.382171893492341, + 1.368618069216609, + 0.7001335266977549, + 1.3707378096878529, + 0.6848249854519963, + 3.462311502546072, + 1.1813412066549063, + 0.4352302588522434, + 0.2023510541766882, + 0.0, + 0.9811942335218191 + ], + "unique_experts": 63, + "load_cv": 0.5847682117167288, + "normalized_load_entropy": 0.9577766923025319, + "max_load_share": 0.045454545454545456 + } + }, + "s0_bos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "76fcef633f585d03b23818362a647e3f4c11431a9cbab0abf8f0c74c7029af5f", + "route_weight_sha256": "36640d6fcd9fcef343909e96d60cc1660d1f1b9a15295620204dedd10818784e", + "loads": [ + 9, + 8, + 20, + 6, + 8, + 14, + 11, + 16, + 10, + 0, + 5, + 14, + 1, + 7, + 21, + 5, + 12, + 3, + 8, + 10, + 17, + 2, + 10, + 17, + 16, + 4, + 18, + 11, + 8, + 10, + 13, + 9, + 13, + 8, + 3, + 7, + 6, + 38, + 4, + 14, + 10, + 7, + 5, + 20, + 3, + 17, + 6, + 14, + 17, + 18, + 28, + 7, + 10, + 8, + 13, + 7, + 11, + 9, + 12, + 14, + 8, + 4, + 0, + 14 + ], + "weighted_loads": [ + 0.6373610347509384, + 0.35816652700304985, + 2.1360584907233715, + 0.3423166088759899, + 0.6200051307678223, + 0.9035730771720409, + 0.9018640285357833, + 1.3808284848928452, + 1.3497376032173634, + 0.0, + 0.22607120126485825, + 0.703546442091465, + 0.07017813622951508, + 0.7525233440101147, + 1.6280533764511347, + 0.126212352886796, + 0.9138059448450804, + 0.09381081350147724, + 0.4204181134700775, + 0.63617760874331, + 1.3255631849169731, + 0.057794131338596344, + 2.0978888235986233, + 1.001253079622984, + 0.7097074594348669, + 0.20918118581175804, + 0.7552749402821064, + 0.5492408238351345, + 1.5824766270816326, + 0.5743918847292662, + 1.102362321689725, + 0.38484466075897217, + 1.0944646503776312, + 0.4291115403175354, + 0.4205300509929657, + 0.2631484568119049, + 0.25844324566423893, + 2.307048335671425, + 0.1733367219567299, + 0.5001151338219643, + 0.5917903184890747, + 0.34913269616663456, + 0.20741270296275616, + 1.4249841403216124, + 0.12121795490384102, + 1.2274549454450607, + 0.48145876079797745, + 1.1597932148724794, + 0.7138255704194307, + 1.9445607885718346, + 1.2409753929823637, + 0.32796093448996544, + 1.0335536375641823, + 0.6100724693387747, + 1.2506503406912088, + 0.6754741296172142, + 0.4308534525334835, + 0.45668381080031395, + 3.086156778037548, + 0.9243789128959179, + 0.3738537076860666, + 0.10570231266319752, + 0.0, + 0.7711696736514568 + ], + "unique_experts": 62, + "load_cv": 0.6171257830658811, + "normalized_load_entropy": 0.9548571455033225, + "max_load_share": 0.05604719764011799 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "9aaafc113617ae6d90f5ec98dae8051e6f930e4e340b634469c6f4871ea9e87d", + "route_weight_sha256": "410fae798fe238557ad24293e7136c064f9888b87c7c4addffc54c1179ec1c00", + "loads": [ + 15, + 9, + 31, + 6, + 8, + 17, + 11, + 16, + 18, + 0, + 5, + 18, + 2, + 7, + 26, + 8, + 12, + 3, + 27, + 10, + 17, + 3, + 10, + 20, + 16, + 4, + 18, + 12, + 8, + 10, + 19, + 9, + 13, + 8, + 3, + 11, + 6, + 40, + 4, + 18, + 17, + 9, + 8, + 20, + 4, + 17, + 14, + 14, + 20, + 29, + 31, + 10, + 19, + 16, + 13, + 7, + 12, + 10, + 13, + 17, + 8, + 6, + 0, + 16 + ], + "weighted_loads": [ + 1.0217786096036434, + 0.4289969317615032, + 3.1408343389630318, + 0.3423166088759899, + 0.6200051307678223, + 0.9739310592412949, + 0.9018640285357833, + 1.3808284848928452, + 1.8315369486808777, + 0.0, + 0.22607120126485825, + 1.0257662534713745, + 0.24881970882415771, + 0.7525233440101147, + 2.477873472496867, + 0.22315574996173382, + 0.9138059448450804, + 0.09381081350147724, + 1.5717540849000216, + 0.63617760874331, + 1.3255631849169731, + 0.08331479877233505, + 2.0978888235986233, + 1.1116611156612635, + 0.7097074594348669, + 0.20918118581175804, + 0.7552749402821064, + 0.6258576847612858, + 1.5824766270816326, + 0.5743918847292662, + 1.4205245729535818, + 0.38484466075897217, + 1.0944646503776312, + 0.4291115403175354, + 0.4205300509929657, + 0.44697393476963043, + 0.25844324566423893, + 2.367005018517375, + 0.1733367219567299, + 0.6828101240098476, + 0.995314497500658, + 0.44331372156739235, + 0.3202352486550808, + 1.4249841403216124, + 0.16633370146155357, + 1.2274549454450607, + 1.9890507832169533, + 1.1597932148724794, + 0.858444282785058, + 2.442989757284522, + 1.3338014595210552, + 0.5259279366582632, + 1.646316273137927, + 1.2061337810009718, + 1.2506503406912088, + 0.6754741296172142, + 0.6539251618087292, + 0.4918382875621319, + 3.1154407989233732, + 1.0730727165937424, + 0.3738537076860666, + 0.1601854581385851, + 0.0, + 0.8615423627197742 + ], + "unique_experts": 62, + "load_cv": 0.6093662435992381, + "normalized_load_entropy": 0.9545502457298117, + "max_load_share": 0.04830917874396135 + } + }, + "s1_bos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "365d4e9fa2e123571e206f092ff55024c17bba45c8f771e953079e3e4c8a3fb6", + "route_weight_sha256": "99b85860d8c6d52ca483f03a8babff4c49a5fbf26fd81fe1585833df12ba5e53", + "loads": [ + 9, + 8, + 21, + 6, + 8, + 13, + 8, + 16, + 8, + 2, + 6, + 15, + 2, + 9, + 20, + 7, + 12, + 4, + 7, + 11, + 17, + 2, + 10, + 19, + 16, + 4, + 16, + 11, + 7, + 8, + 13, + 8, + 14, + 8, + 3, + 6, + 5, + 40, + 4, + 9, + 11, + 7, + 4, + 20, + 4, + 19, + 6, + 15, + 17, + 19, + 25, + 7, + 10, + 8, + 12, + 7, + 10, + 9, + 12, + 15, + 10, + 4, + 0, + 15 + ], + "weighted_loads": [ + 0.6474348520860076, + 0.34554655477404594, + 2.165873911231756, + 0.35008513554930687, + 0.640224039554596, + 0.8237058445811272, + 0.804622832685709, + 1.375305712223053, + 1.2906611114740372, + 0.051102180033922195, + 0.24741928279399872, + 0.7347503211349249, + 0.0982643086463213, + 0.8438402488827705, + 1.5832874421030283, + 0.19328100234270096, + 0.9098449349403381, + 0.12708639912307262, + 0.4024902321398258, + 0.6627722531557083, + 1.3711793012917042, + 0.05697932280600071, + 2.1155043337494135, + 1.0914265122264624, + 0.6902454989030957, + 0.20563770458102226, + 0.6766433473676443, + 0.583367089740932, + 1.5783979073166847, + 0.5227232091128826, + 1.1591155901551247, + 0.3464199807494879, + 1.130040667951107, + 0.4157958123832941, + 0.4242809861898422, + 0.24140673503279686, + 0.24880529381334782, + 2.4051016326993704, + 0.17775620892643929, + 0.34531921334564686, + 0.6164229661226273, + 0.32904029078781605, + 0.17456747964024544, + 1.4019927941262722, + 0.16082974709570408, + 1.313219828531146, + 0.4632074683904648, + 1.1814062912017107, + 0.695549450814724, + 1.975008212029934, + 1.1310495249927044, + 0.33137693256139755, + 1.066508311778307, + 0.5784324258565903, + 1.249490113928914, + 0.687251852825284, + 0.3836536817252636, + 0.46376492362469435, + 3.1382725089788437, + 0.9634920731186867, + 0.46609569154679775, + 0.10224247723817825, + 0.0, + 0.7673586700111628 + ], + "unique_experts": 63, + "load_cv": 0.619602457887031, + "normalized_load_entropy": 0.9569902408058533, + "max_load_share": 0.058997050147492625 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "292e3023a7b98519533a8b978bfdeed320475bdf4a349d7ffbfe6c80bb71bf04", + "route_weight_sha256": "9d87581074854fb85f4cbfdf0c96d72901e4e29eb836121d24b553045791dca7", + "loads": [ + 16, + 12, + 32, + 6, + 9, + 16, + 9, + 18, + 18, + 3, + 6, + 19, + 2, + 10, + 29, + 9, + 12, + 14, + 30, + 12, + 17, + 2, + 10, + 21, + 16, + 4, + 16, + 12, + 7, + 9, + 22, + 10, + 15, + 9, + 7, + 20, + 5, + 45, + 5, + 12, + 18, + 8, + 8, + 26, + 5, + 19, + 24, + 19, + 20, + 33, + 27, + 10, + 19, + 20, + 14, + 8, + 12, + 16, + 14, + 19, + 10, + 9, + 0, + 20 + ], + "weighted_loads": [ + 1.0561852855607867, + 0.5110433008521795, + 3.1701606065034866, + 0.35008513554930687, + 0.6785832643508911, + 0.912420304492116, + 0.8349429536610842, + 1.443890193477273, + 2.143514033406973, + 0.08791713789105415, + 0.24741928279399872, + 1.106249986216426, + 0.0982643086463213, + 0.8894249387085438, + 2.8196591958403587, + 0.25121608190238476, + 0.9098449349403381, + 0.724249554798007, + 2.2962364815175533, + 0.7982125133275986, + 1.3711793012917042, + 0.05697932280600071, + 2.1155043337494135, + 1.1592725683003664, + 0.6902454989030957, + 0.20563770458102226, + 0.6766433473676443, + 0.664872813038528, + 1.5783979073166847, + 0.5592735931277275, + 1.7167656868696213, + 0.5889796148985624, + 1.1870165951550007, + 0.49134727753698826, + 0.8489072881639004, + 1.5183427594602108, + 0.24880529381334782, + 2.62473470531404, + 0.21299633756279945, + 0.43226856738328934, + 0.9933511540293694, + 0.360953526571393, + 0.3101582992821932, + 1.8841310888528824, + 0.202970577403903, + 1.313219828531146, + 3.0818001329898834, + 1.3630353268235922, + 0.7904699891805649, + 2.607898348942399, + 1.1885508839040995, + 0.5303891822695732, + 1.646208981052041, + 1.3213773276656866, + 1.369970815256238, + 0.7223672214895487, + 0.6441975496709347, + 0.76800945866853, + 3.4737235121428967, + 1.2762831151485443, + 0.46609569154679775, + 0.26519592478871346, + 0.0, + 0.9727121479809284 + ], + "unique_experts": 63, + "load_cv": 0.5823275187601382, + "normalized_load_entropy": 0.9593384681470286, + "max_load_share": 0.048701298701298704 + } + }, + "s0_x": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "8a2f323074986689e62bf2ff90765da722ecdf7e8560768592bc4807aff4df2e", + "route_weight_sha256": "f1679779d25d716303bdc77b0405f2bd767cd4ae9e2dcc715538789242ae0ed2", + "loads": [ + 9, + 8, + 21, + 6, + 7, + 13, + 9, + 16, + 10, + 1, + 5, + 13, + 1, + 8, + 21, + 4, + 14, + 3, + 8, + 10, + 17, + 2, + 10, + 20, + 15, + 5, + 18, + 11, + 7, + 9, + 14, + 8, + 13, + 10, + 3, + 6, + 7, + 39, + 4, + 7, + 11, + 9, + 4, + 19, + 3, + 18, + 6, + 15, + 15, + 19, + 28, + 7, + 10, + 8, + 12, + 7, + 11, + 9, + 12, + 14, + 10, + 4, + 0, + 15 + ], + "weighted_loads": [ + 0.6421577483415604, + 0.36205534264445305, + 2.1945154778659344, + 0.35134653747081757, + 0.5210755690932274, + 0.8750421479344368, + 0.8523215670138597, + 1.3906418085098267, + 1.3364267153665423, + 0.018851378932595253, + 0.22569579258561134, + 0.6773369070142508, + 0.10683582723140717, + 0.7688011955469847, + 1.5936719086021185, + 0.09312549140304327, + 1.0004668738692999, + 0.09567277505993843, + 0.4315965212881565, + 0.6338923256844282, + 1.3481642417609692, + 0.06160210259258747, + 2.1555069517344236, + 1.1479219980537891, + 0.6724343858659267, + 0.24795613065361977, + 0.7881069835275412, + 0.5545889670029283, + 1.5686309561133385, + 0.5590211115777493, + 1.2332287803292274, + 0.33560241013765335, + 1.138797402381897, + 0.48292206414043903, + 0.426336333155632, + 0.23468583449721336, + 0.28472073562443256, + 2.273098623380065, + 0.18120716884732246, + 0.262251490727067, + 0.6211697496473789, + 0.4055750221014023, + 0.19383174553513527, + 1.4266050159931183, + 0.10989063791930676, + 1.2676911912858486, + 0.5035518892109394, + 1.2497585592791438, + 0.6377254128456116, + 2.0550114326179028, + 1.227534707635641, + 0.3241228386759758, + 1.0728845857083797, + 0.5910220518708229, + 1.24385591968894, + 0.6940131951123476, + 0.42611935548484325, + 0.4735815357416868, + 3.0714480504393578, + 0.9350185347720981, + 0.44733483530581, + 0.10598087683320045, + 0.0, + 0.7957103103399277 + ], + "unique_experts": 63, + "load_cv": 0.6287477587532833, + "normalized_load_entropy": 0.9545928365975981, + "max_load_share": 0.05752212389380531 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "7c0de88a931a0ab6f404a37b1c46cab8ce69c00f2fd6737ce19979fa64c59492", + "route_weight_sha256": "6b7a8c6c4ebfcc16bf6c85fd8b1ff24bc5719f59740b63f25aaaec65359c62b6", + "loads": [ + 17, + 9, + 34, + 6, + 7, + 15, + 9, + 16, + 18, + 1, + 5, + 17, + 2, + 8, + 26, + 8, + 14, + 3, + 26, + 10, + 17, + 3, + 10, + 20, + 15, + 5, + 18, + 12, + 7, + 9, + 20, + 8, + 13, + 10, + 3, + 10, + 7, + 42, + 4, + 10, + 17, + 10, + 6, + 19, + 4, + 18, + 13, + 15, + 19, + 31, + 29, + 11, + 20, + 16, + 12, + 7, + 12, + 10, + 15, + 16, + 10, + 6, + 0, + 18 + ], + "weighted_loads": [ + 1.1071479879319668, + 0.4328857474029064, + 3.3959196507930756, + 0.35134653747081757, + 0.5210755690932274, + 0.9237195551395416, + 0.8523215670138597, + 1.3906418085098267, + 1.8182260608300567, + 0.018851378932595253, + 0.22569579258561134, + 1.0570214372128248, + 0.13198873959481716, + 0.7688011955469847, + 2.529712224379182, + 0.2281114710494876, + 1.0004668738692999, + 0.09567277505993843, + 1.593103177845478, + 0.6338923256844282, + 1.3481642417609692, + 0.08712277002632618, + 2.1555069517344236, + 1.1479219980537891, + 0.6724343858659267, + 0.24795613065361977, + 0.7881069835275412, + 0.6208587000146508, + 1.5686309561133385, + 0.5590211115777493, + 1.5369051340967417, + 0.33560241013765335, + 1.138797402381897, + 0.48292206414043903, + 0.426336333155632, + 0.3964253105223179, + 0.28472073562443256, + 2.3685115054249763, + 0.18120716884732246, + 0.37205720506608486, + 0.986805722117424, + 0.4353357832878828, + 0.24882554076611996, + 1.4266050159931183, + 0.14371839724481106, + 1.2676911912858486, + 1.9279556162655354, + 1.2497585592791438, + 0.8254214599728584, + 2.6020120698958635, + 1.2538123037666082, + 0.5666210539638996, + 1.7851460073143244, + 1.1354420520365238, + 1.24385591968894, + 0.6940131951123476, + 0.6491910647600889, + 0.5132957492023706, + 3.201630273833871, + 1.0126418275758624, + 0.44733483530581, + 0.16046402230858803, + 0.0, + 0.9651625156402588 + ], + "unique_experts": 63, + "load_cv": 0.6219513618156393, + "normalized_load_entropy": 0.954499006451163, + "max_load_share": 0.050724637681159424 + } + }, + "s1_x": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "e964b48dc5d73356fca1fd81a83b203e53306e694925cdccdf9eb864a56bca3c", + "route_weight_sha256": "03d096df35298b092e73d151c055d7f2a58b4f5a14bd6576489b771508dd13ca", + "loads": [ + 8, + 8, + 21, + 6, + 7, + 13, + 10, + 17, + 7, + 1, + 7, + 16, + 1, + 8, + 20, + 6, + 14, + 3, + 8, + 9, + 18, + 2, + 10, + 19, + 16, + 4, + 17, + 12, + 7, + 9, + 14, + 7, + 13, + 7, + 3, + 7, + 4, + 38, + 4, + 8, + 12, + 9, + 4, + 21, + 4, + 18, + 6, + 16, + 15, + 19, + 24, + 7, + 10, + 8, + 14, + 8, + 10, + 9, + 12, + 14, + 11, + 4, + 0, + 14 + ], + "weighted_loads": [ + 0.6204150766134262, + 0.3366690147668123, + 2.1920743621885777, + 0.35671868175268173, + 0.6739825382828712, + 0.8355556279420853, + 0.86065514665097, + 1.3837115429341793, + 1.2848528511822224, + 0.01771647110581398, + 0.27357970736920834, + 0.7774398289620876, + 0.08914574235677719, + 0.784817099571228, + 1.511683264747262, + 0.15993881784379482, + 0.9934952892363071, + 0.1006386112421751, + 0.44201268441975117, + 0.5948182400316, + 1.4009455554187298, + 0.061775295063853264, + 2.1200787238776684, + 1.1242043003439903, + 0.6877863905392587, + 0.19543364271521568, + 0.743010837584734, + 0.6316891275346279, + 1.5606102123856544, + 0.5545815639197826, + 1.2340038530528545, + 0.30598822608590126, + 1.0916056148707867, + 0.3265508208423853, + 0.41586166620254517, + 0.2880791164934635, + 0.20126079581677914, + 2.32209718413651, + 0.17127341404557228, + 0.30656702257692814, + 0.6410908661782742, + 0.4176139086484909, + 0.1604103296995163, + 1.4236740823835135, + 0.14599133282899857, + 1.2568662092089653, + 0.4892454743385315, + 1.2222266914322972, + 0.6515601743012667, + 1.989162351936102, + 1.1123809423297644, + 0.33403242006897926, + 1.1178095303475857, + 0.4563545621931553, + 1.3570929635316133, + 0.7285952623933554, + 0.36325105279684067, + 0.4830952640622854, + 3.1109107732772827, + 0.9314250340685248, + 0.49289910309016705, + 0.10492748580873013, + 0.0, + 0.7815460711717606 + ], + "unique_experts": 63, + "load_cv": 0.6157706709483216, + "normalized_load_entropy": 0.9555334211351474, + "max_load_share": 0.05604719764011799 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "b0a5535e78310d088959d7bfd6f920b4226f309951d3c977cbc9c8b1a566056c", + "route_weight_sha256": "407cddc9a73d22370b5feb067671b4946ea1c3554829dea45009f3f6741d7a60", + "loads": [ + 18, + 11, + 33, + 6, + 9, + 16, + 11, + 19, + 18, + 2, + 7, + 20, + 1, + 9, + 29, + 9, + 14, + 13, + 30, + 10, + 18, + 2, + 10, + 20, + 16, + 4, + 17, + 13, + 7, + 10, + 23, + 9, + 14, + 8, + 7, + 20, + 4, + 44, + 5, + 11, + 18, + 9, + 6, + 28, + 5, + 18, + 23, + 20, + 20, + 33, + 25, + 11, + 20, + 20, + 16, + 9, + 12, + 14, + 14, + 17, + 12, + 6, + 1, + 20 + ], + "weighted_loads": [ + 1.2508380487561226, + 0.4732071030884981, + 3.316834069788456, + 0.35671868175268173, + 0.7455200627446175, + 0.9242700878530741, + 0.8909752676263452, + 1.4522960241883993, + 2.1784419678151608, + 0.05453142896294594, + 0.27357970736920834, + 1.0906966887414455, + 0.08914574235677719, + 0.8304017893970013, + 2.4763572812080383, + 0.2445031087845564, + 0.9934952892363071, + 0.6978017669171095, + 2.3606393933296204, + 0.7302585002034903, + 1.4009455554187298, + 0.061775295063853264, + 2.1200787238776684, + 1.1635984741151333, + 0.6877863905392587, + 0.19543364271521568, + 0.743010837584734, + 0.733748484402895, + 1.5606102123856544, + 0.5911319479346275, + 1.7660012505948544, + 0.5485478602349758, + 1.1485815420746803, + 0.40210228599607944, + 0.8404879681766033, + 1.5238884463906288, + 0.20126079581677914, + 2.580843796953559, + 0.20651354268193245, + 0.398995004594326, + 0.9641169644892216, + 0.4176139086484909, + 0.21238341741263866, + 1.9614418167620897, + 0.1790463924407959, + 1.2568662092089653, + 2.9591762870550156, + 1.4038557270541787, + 0.8147546369582415, + 2.5986610297113657, + 1.1386357061564922, + 0.5820294246077538, + 1.7754135746508837, + 1.131241051480174, + 1.4775736648589373, + 0.76371063105762, + 0.6237949207425117, + 0.7172616384923458, + 3.4463617764413357, + 1.1529910219833255, + 0.5227782055735588, + 0.16932613961398602, + 0.03053954802453518, + 1.0525093469768763 + ], + "unique_experts": 64, + "load_cv": 0.5871987600152292, + "normalized_load_entropy": 0.958386795714221, + "max_load_share": 0.047619047619047616 + } + }, + "s0_period": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "64db915624c59a15c735ae26a826ee78c4fc9a6ec5cad62b4b8edd6a7e189312", + "route_weight_sha256": "76f45882c58b29f93d336d3c6018fe5dc2154681423a7061f578dd6b3226e30f", + "loads": [ + 9, + 8, + 21, + 6, + 6, + 15, + 9, + 16, + 9, + 0, + 5, + 13, + 1, + 7, + 20, + 3, + 14, + 3, + 9, + 9, + 17, + 2, + 10, + 20, + 17, + 4, + 17, + 10, + 7, + 11, + 15, + 7, + 13, + 11, + 3, + 7, + 7, + 36, + 4, + 9, + 11, + 9, + 4, + 19, + 3, + 17, + 6, + 16, + 17, + 19, + 26, + 7, + 10, + 8, + 12, + 7, + 11, + 8, + 13, + 15, + 11, + 4, + 0, + 15 + ], + "weighted_loads": [ + 0.6415237579494715, + 0.3638099767267704, + 2.195810906589031, + 0.36561109870672226, + 0.3980015851557255, + 0.9543567448854446, + 0.8578550983220339, + 1.4032042995095253, + 1.3161287438124418, + 0.0, + 0.21422179602086544, + 0.6750249806791544, + 0.11879909038543701, + 0.7593634575605392, + 1.54063961468637, + 0.07979153282940388, + 0.9914475716650486, + 0.09704683162271976, + 0.45377909950912, + 0.6055305227637291, + 1.3446241989731789, + 0.061501169577240944, + 2.1123224645853043, + 1.1335750594735146, + 0.7358118374831975, + 0.2083573155105114, + 0.7674279175698757, + 0.553268488496542, + 1.5625619664788246, + 0.6122657414525747, + 1.2707269433885813, + 0.3038951363414526, + 1.1192427016794682, + 0.51365065574646, + 0.424025721848011, + 0.2725394666194916, + 0.2883313656784594, + 2.1624209117144346, + 0.1875324882566929, + 0.3258808497339487, + 0.6152327805757523, + 0.4069326352328062, + 0.19004372507333755, + 1.419852651655674, + 0.11152028478682041, + 1.2257311083376408, + 0.5642955712974072, + 1.2887632120400667, + 0.7137310393154621, + 2.03306370601058, + 1.1599783897399902, + 0.3289298191666603, + 1.0584346503019333, + 0.6179510354995728, + 1.245812464505434, + 0.671469759196043, + 0.4267749711871147, + 0.4376112297177315, + 3.1245324797928333, + 0.9623694401234388, + 0.48263400234282017, + 0.10595819912850857, + 0.0, + 0.7859816551208496 + ], + "unique_experts": 62, + "load_cv": 0.613278521966303, + "normalized_load_entropy": 0.9540270244078074, + "max_load_share": 0.05309734513274336 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "3d3f811acdbefa7c85d6a5dbb33cf30eb9435cecbd0f83068dfe5416dfe14b36", + "route_weight_sha256": "3fa95b351fa53cc1b7921169510e7299285b67f83a18ff6f6601a3790c03605e", + "loads": [ + 17, + 9, + 32, + 6, + 6, + 17, + 9, + 16, + 17, + 0, + 5, + 17, + 2, + 7, + 25, + 7, + 14, + 3, + 29, + 9, + 17, + 3, + 10, + 20, + 17, + 4, + 17, + 11, + 7, + 11, + 22, + 8, + 13, + 11, + 3, + 10, + 7, + 38, + 4, + 12, + 17, + 10, + 6, + 19, + 4, + 17, + 14, + 16, + 21, + 31, + 28, + 9, + 20, + 17, + 12, + 7, + 12, + 10, + 15, + 17, + 11, + 6, + 0, + 17 + ], + "weighted_loads": [ + 1.1047125235199928, + 0.43464038148522377, + 3.2005867548286915, + 0.36561109870672226, + 0.3980015851557255, + 1.0030341520905495, + 0.8578550983220339, + 1.4032042995095253, + 1.7979280892759562, + 0.0, + 0.21422179602086544, + 1.0419828984886408, + 0.1445593275129795, + 0.7593634575605392, + 2.5532878283411264, + 0.21238375268876553, + 0.9914475716650486, + 0.09704683162271976, + 1.6824255492538214, + 0.6055305227637291, + 1.3446241989731789, + 0.08702183701097965, + 2.1123224645853043, + 1.1335750594735146, + 0.7358118374831975, + 0.2083573155105114, + 0.7674279175698757, + 0.6282975114881992, + 1.5625619664788246, + 0.6122657414525747, + 1.5963118690997362, + 0.3328653648495674, + 1.1192427016794682, + 0.51365065574646, + 0.424025721848011, + 0.39989976957440376, + 0.2883313656784594, + 2.2223775945603848, + 0.1875324882566929, + 0.4376907516270876, + 0.9602826572954655, + 0.4364285320043564, + 0.24503752030432224, + 1.419852651655674, + 0.14743426255881786, + 1.2257311083376408, + 2.200915690511465, + 1.2887632120400667, + 0.8900578990578651, + 2.5736134108155966, + 1.2197590116411448, + 0.500626340508461, + 1.7426228504627943, + 1.235169593244791, + 1.245812464505434, + 0.671469759196043, + 0.6498466804623604, + 0.5217706076800823, + 3.191160986199975, + 1.0405637566000223, + 0.48263400234282017, + 0.16044134460389614, + 0.0, + 0.876354344189167 + ], + "unique_experts": 62, + "load_cv": 0.6122700053894836, + "normalized_load_entropy": 0.9537221914553742, + "max_load_share": 0.04589371980676329 + } + }, + "s1_period": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "a5b998a51dd7fb16db11eb2bfed188e47a6ff9c8558c995a6dbd4540d04e7aec", + "route_weight_sha256": "fe0654bb78c0f02ddf914c232b5b693cc1c3de8aed2fd6b125d8ccdd5ea9fdcf", + "loads": [ + 8, + 7, + 22, + 6, + 7, + 15, + 8, + 17, + 7, + 1, + 6, + 16, + 1, + 9, + 20, + 4, + 12, + 3, + 7, + 10, + 18, + 3, + 10, + 20, + 16, + 4, + 16, + 12, + 8, + 9, + 14, + 7, + 13, + 8, + 3, + 9, + 5, + 38, + 4, + 7, + 12, + 6, + 5, + 20, + 3, + 18, + 6, + 17, + 17, + 19, + 25, + 7, + 10, + 8, + 13, + 7, + 10, + 9, + 12, + 14, + 11, + 4, + 0, + 15 + ], + "weighted_loads": [ + 0.6289081340655684, + 0.30832715332508087, + 2.2136168349534273, + 0.35467175021767616, + 0.6103803031146526, + 0.8938399609178305, + 0.8219539243727922, + 1.3913110680878162, + 1.2294281097128987, + 0.017640192061662674, + 0.23760410770773888, + 0.7703035101294518, + 0.08391173928976059, + 0.8269382026046515, + 1.5155189465731382, + 0.10843494907021523, + 0.9148630816489458, + 0.09924396686255932, + 0.36713397316634655, + 0.6399329397827387, + 1.3887085691094398, + 0.08033800683915615, + 2.130390401929617, + 1.143350224941969, + 0.7042097146622837, + 0.1971583552658558, + 0.7110329791903496, + 0.6249043997377157, + 1.5670603439211845, + 0.55559241771698, + 1.2334371283650398, + 0.29677939042449, + 1.0824362896382809, + 0.39584244787693024, + 0.4154357388615608, + 0.3356279730796814, + 0.23207387141883373, + 2.2874332554638386, + 0.17504677549004555, + 0.27094317227602005, + 0.6226801238954067, + 0.30568158254027367, + 0.19090046919882298, + 1.397052763029933, + 0.1109754778444767, + 1.2565346136689186, + 0.47520672902464867, + 1.2446534279733896, + 0.7216397020965815, + 1.9607535749673843, + 1.1423209719359875, + 0.34060022607445717, + 1.1241622902452946, + 0.4326005559414625, + 1.3384564071893692, + 0.6788654513657093, + 0.36865489557385445, + 0.4897053800523281, + 3.1193571984767914, + 0.9489613585174084, + 0.5144218672066927, + 0.1039978638291359, + 0.0, + 0.8124007247388363 + ], + "unique_experts": 63, + "load_cv": 0.6269737848623093, + "normalized_load_entropy": 0.9542321253889366, + "max_load_share": 0.05604719764011799 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "627c190951bdc62e75341d523f4e6fdc26e4c495852c2119397fcf110ae43f77", + "route_weight_sha256": "1004703342a311368a1c9eb20a918064c962bb86639605f8eea2bef0df1008dc", + "loads": [ + 16, + 10, + 33, + 6, + 9, + 18, + 9, + 19, + 17, + 3, + 6, + 20, + 1, + 10, + 29, + 7, + 12, + 13, + 29, + 11, + 18, + 4, + 10, + 20, + 16, + 4, + 16, + 13, + 8, + 10, + 22, + 9, + 14, + 9, + 7, + 23, + 5, + 44, + 5, + 10, + 18, + 6, + 7, + 27, + 4, + 18, + 24, + 21, + 20, + 33, + 26, + 12, + 20, + 21, + 15, + 8, + 12, + 15, + 14, + 17, + 12, + 7, + 1, + 21 + ], + "weighted_loads": [ + 1.0756387105211616, + 0.44486524164676666, + 3.2179035302251577, + 0.35467175021767616, + 0.6775873526930809, + 0.9825544208288193, + 0.8522740453481674, + 1.4598955493420362, + 2.0822810316458344, + 0.10060107707977295, + 0.23760410770773888, + 1.1364631727337837, + 0.08391173928976059, + 0.8725228924304247, + 2.6595710031688213, + 0.19324782490730286, + 0.9148630816489458, + 0.6964071225374937, + 2.2446088567376137, + 0.7753731999546289, + 1.3887085691094398, + 0.11215384863317013, + 2.130390401929617, + 1.143350224941969, + 0.7042097146622837, + 0.1971583552658558, + 0.7110329791903496, + 0.7377009373158216, + 1.5670603439211845, + 0.5921428017318249, + 1.7366359010338783, + 0.5393390245735645, + 1.1394122168421745, + 0.4713939130306244, + 0.840062040835619, + 1.5897310450673103, + 0.23207387141883373, + 2.543005134910345, + 0.21028690412640572, + 0.3712104018777609, + 0.9297868348658085, + 0.30568158254027367, + 0.24287355691194534, + 1.9137046989053488, + 0.14972910284996033, + 1.2565346136689186, + 3.0384629108011723, + 1.426282463595271, + 0.8165602404624224, + 2.5799588169902563, + 1.1685757357627153, + 0.6527654938399792, + 1.765941260382533, + 1.162936232984066, + 1.4589371085166931, + 0.713980820029974, + 0.6291987635195255, + 0.7956667710095644, + 3.4548082016408443, + 1.1763359531760216, + 0.5398837793618441, + 0.19990353286266327, + 0.03196365013718605, + 1.0509567987173796 + ], + "unique_experts": 64, + "load_cv": 0.5883465677761888, + "normalized_load_entropy": 0.9587766812127879, + "max_load_share": 0.047619047619047616 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 113, + "ordered_topk_exact_tokens": 76, + "set_exact_tokens": 86, + "mean_set_jaccard": 0.9317319848293298, + "mean_token_weighted_tv": 0.014295953779225856, + "aggregate_load_tv": 0.02359882005899705 + }, + "system_bos": { + "tokens": 113, + "ordered_topk_exact_tokens": 64, + "set_exact_tokens": 78, + "mean_set_jaccard": 0.9039190897597977, + "mean_token_weighted_tv": 0.020566869143858156, + "aggregate_load_tv": 0.03982300884955752 + }, + "system_x": { + "tokens": 113, + "ordered_topk_exact_tokens": 52, + "set_exact_tokens": 68, + "mean_set_jaccard": 0.8805309734513276, + "mean_token_weighted_tv": 0.028525905660971736, + "aggregate_load_tv": 0.03392330383480826 + }, + "system_period": { + "tokens": 113, + "ordered_topk_exact_tokens": 44, + "set_exact_tokens": 62, + "mean_set_jaccard": 0.8638853771597135, + "mean_token_weighted_tv": 0.030150206617401105, + "aggregate_load_tv": 0.04129793510324484 + }, + "bos_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 51, + "set_exact_tokens": 72, + "mean_set_jaccard": 0.8944374209860937, + "mean_token_weighted_tv": 0.022342589055394046, + "aggregate_load_tv": 0.03392330383480826 + }, + "bos_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 54, + "set_exact_tokens": 69, + "mean_set_jaccard": 0.8830594184576486, + "mean_token_weighted_tv": 0.024842689194988492, + "aggregate_load_tv": 0.045722713864306784 + }, + "x_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 49, + "set_exact_tokens": 68, + "mean_set_jaccard": 0.8786346396965865, + "mean_token_weighted_tv": 0.025334479421195863, + "aggregate_load_tv": 0.03982300884955752 + }, + "x_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 47, + "set_exact_tokens": 63, + "mean_set_jaccard": 0.867888748419722, + "mean_token_weighted_tv": 0.031083437103151746, + "aggregate_load_tv": 0.04129793510324484 + }, + "period_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 44, + "set_exact_tokens": 64, + "mean_set_jaccard": 0.8723135271807839, + "mean_token_weighted_tv": 0.025196285335248154, + "aggregate_load_tv": 0.045722713864306784 + }, + "period_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 42, + "set_exact_tokens": 61, + "mean_set_jaccard": 0.8594605983986515, + "mean_token_weighted_tv": 0.03156904618264036, + "aggregate_load_tv": 0.04867256637168141 + } + } + }, + "layer_19": { + "layer": 19, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "e1f712a2f92372863a5e3b2ee750469a89ebd106672a1d3ac26e6f88293e0e26", + "route_weight_sha256": "2feecedce259f5ce046782dbc3f0785c428c907a2eb0c35f65fbcb620eaba23d", + "loads": [ + 8, + 12, + 28, + 8, + 17, + 4, + 9, + 2, + 9, + 24, + 10, + 8, + 17, + 10, + 16, + 11, + 12, + 0, + 7, + 15, + 10, + 17, + 10, + 5, + 11, + 11, + 5, + 11, + 5, + 11, + 11, + 11, + 0, + 23, + 31, + 9, + 5, + 6, + 11, + 12, + 5, + 4, + 12, + 8, + 12, + 9, + 7, + 9, + 4, + 12, + 11, + 7, + 14, + 31, + 0, + 16, + 7, + 22, + 11, + 12, + 6, + 7, + 5, + 5 + ], + "weighted_loads": [ + 0.3134255539625883, + 1.8712856322526932, + 2.552396665327251, + 1.6300215581431985, + 1.587804388254881, + 0.16403701156377792, + 0.6287503093481064, + 0.09311724826693535, + 0.7577088922262192, + 1.7331925686448812, + 0.3874602187424898, + 0.4648941829800606, + 0.7458050064742565, + 0.32887441478669643, + 1.1547943577170372, + 0.49343057721853256, + 0.7074574679136276, + 0.0, + 0.36162157356739044, + 1.2007657755166292, + 0.6552116982638836, + 0.9119651280343533, + 0.7883230596780777, + 0.2134320829063654, + 0.9956534989178181, + 1.3482003696262836, + 0.21131739020347595, + 0.579288337379694, + 0.3043777346611023, + 1.968261806294322, + 0.5772759728133678, + 1.1075014509260654, + 0.0, + 1.4107628781348467, + 5.297150671482086, + 0.9326094090938568, + 0.19401980936527252, + 0.22041558101773262, + 1.2010170109570026, + 0.9740659967064857, + 0.1728897150605917, + 0.22010445222258568, + 0.41895447485148907, + 0.317614508792758, + 0.7142517305910587, + 0.4745713286101818, + 0.246070496737957, + 0.7856616303324699, + 0.21629207953810692, + 0.939218282699585, + 0.37923180870711803, + 0.3045494370162487, + 0.9927002433687449, + 3.326908399350941, + 0.0, + 0.9610562417656183, + 0.8125467803329229, + 1.386770335957408, + 1.729314174503088, + 0.5927569810301065, + 0.19495346397161484, + 0.42720822244882584, + 0.1080295480787754, + 0.5598758421838284 + ], + "unique_experts": 61, + "load_cv": 0.6171257830658811, + "normalized_load_entropy": 0.9549217839254414, + "max_load_share": 0.045722713864306784 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "40bed1fd8279ba3bb893a71aa3e5051b9c81ab4f3074abaffa2c30d5c2f9a95d", + "route_weight_sha256": "4919b20457f265bd556d23e753862e3c3dc1449923d279a1b12def026722cd1d", + "loads": [ + 10, + 14, + 30, + 8, + 22, + 5, + 19, + 2, + 9, + 28, + 10, + 8, + 25, + 11, + 21, + 11, + 15, + 1, + 7, + 21, + 10, + 17, + 15, + 14, + 20, + 12, + 5, + 13, + 5, + 16, + 18, + 11, + 0, + 23, + 31, + 10, + 7, + 13, + 12, + 13, + 7, + 8, + 20, + 9, + 13, + 9, + 7, + 14, + 5, + 12, + 12, + 7, + 14, + 34, + 6, + 17, + 7, + 22, + 16, + 12, + 7, + 11, + 12, + 5 + ], + "weighted_loads": [ + 0.3568987655453384, + 2.0061989054083824, + 2.60991592425853, + 1.6300215581431985, + 2.2965243104845285, + 0.17721997201442719, + 1.0414684731513262, + 0.09311724826693535, + 0.7577088922262192, + 1.9762968998402357, + 0.3874602187424898, + 0.4648941829800606, + 1.2876507081091404, + 0.36813528276979923, + 1.6820486895740032, + 0.49343057721853256, + 0.8200335167348385, + 0.049435749650001526, + 0.36162157356739044, + 1.547876002267003, + 0.6552116982638836, + 0.9119651280343533, + 0.970909932628274, + 0.529895469546318, + 1.564948839135468, + 1.5567897744476795, + 0.21131739020347595, + 0.7174890786409378, + 0.3043777346611023, + 2.1623988021165133, + 0.8555751405656338, + 1.1075014509260654, + 0.0, + 1.4107628781348467, + 5.297150671482086, + 0.9930124282836914, + 0.23688366846181452, + 0.5228319894522429, + 1.2425424605607986, + 1.021276205778122, + 0.18805248057469726, + 0.39800984039902687, + 1.0047979149967432, + 0.3741866145282984, + 0.7249695565551519, + 0.4745713286101818, + 0.246070496737957, + 1.2330043390393257, + 0.25368764996528625, + 0.939218282699585, + 0.42062179185450077, + 0.3045494370162487, + 0.9927002433687449, + 3.568766829557717, + 1.7409261129796505, + 1.0083001274615526, + 0.8125467803329229, + 1.386770335957408, + 1.957456536591053, + 0.5927569810301065, + 0.2237052097916603, + 0.6487600617110729, + 0.6469449456781149, + 0.5598758421838284 + ], + "unique_experts": 63, + "load_cv": 0.5524804623263203, + "normalized_load_entropy": 0.9630903219602841, + "max_load_share": 0.04106280193236715 + } + }, + "s1_eos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "927f70b91221f3cc910d40b4276b6c2b3df96100acca97e9cfc9bc0a97295fa9", + "route_weight_sha256": "2079fd2706290d6e0b7a5a9247dd53a15eec58ea75004dcd73a71d33554c885b", + "loads": [ + 7, + 12, + 25, + 8, + 18, + 5, + 8, + 2, + 9, + 22, + 7, + 8, + 18, + 9, + 16, + 12, + 13, + 1, + 8, + 17, + 10, + 17, + 9, + 5, + 10, + 12, + 6, + 13, + 5, + 11, + 9, + 11, + 0, + 23, + 31, + 9, + 5, + 6, + 11, + 12, + 5, + 4, + 13, + 8, + 12, + 9, + 8, + 9, + 4, + 12, + 12, + 6, + 15, + 31, + 0, + 14, + 6, + 22, + 10, + 11, + 8, + 7, + 6, + 6 + ], + "weighted_loads": [ + 0.26947541534900665, + 1.8712616711854935, + 2.465374430641532, + 1.635446305386722, + 1.6299328282475471, + 0.1978707779198885, + 0.5962949693202972, + 0.09675025939941406, + 0.737329788506031, + 1.620819192379713, + 0.3073740042746067, + 0.4586475268006325, + 0.7612324543297291, + 0.2971442211419344, + 1.1665263250470161, + 0.5238484814763069, + 0.7223804444074631, + 0.04895969107747078, + 0.3925925325602293, + 1.2606819132342935, + 0.6524989679455757, + 0.915845425799489, + 0.747686505317688, + 0.2125568427145481, + 0.9822222329676151, + 1.363034300506115, + 0.23927556350827217, + 0.6386361476033926, + 0.30037789419293404, + 1.9853381179273129, + 0.4895993862301111, + 1.124327477067709, + 0.0, + 1.4131857436150312, + 5.3433246202766895, + 0.9224291034042835, + 0.20933801122009754, + 0.23220232129096985, + 1.1947373449802399, + 0.9714804422110319, + 0.17453571036458015, + 0.234494149684906, + 0.44592653401196003, + 0.31234570778906345, + 0.6849721316248178, + 0.48401325568556786, + 0.2883766256272793, + 0.7665489800274372, + 0.25003189593553543, + 0.9569671414792538, + 0.42148598842322826, + 0.28395677730441093, + 1.0204546172171831, + 3.27105310279876, + 0.0, + 0.9113895762711763, + 0.7723457347601652, + 1.3862120788544416, + 1.6885140389204025, + 0.5613492578268051, + 0.2559147849678993, + 0.42857571318745613, + 0.13955537136644125, + 0.5711447596549988 + ], + "unique_experts": 62, + "load_cv": 0.6020518166693284, + "normalized_load_entropy": 0.9574930288408071, + "max_load_share": 0.045722713864306784 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "c1c04f44dd88e62a109386d871806e2a276f4af0fe9bf97f41ae19999e23e4af", + "route_weight_sha256": "4b29f6c13640377b67b4bdbc84902cf31a8b45c9e0851423734257506a132aff", + "loads": [ + 9, + 17, + 27, + 8, + 30, + 7, + 21, + 3, + 9, + 29, + 8, + 15, + 29, + 9, + 27, + 14, + 16, + 6, + 9, + 26, + 14, + 18, + 14, + 12, + 22, + 13, + 6, + 15, + 6, + 12, + 15, + 11, + 4, + 23, + 31, + 9, + 8, + 10, + 13, + 14, + 9, + 13, + 23, + 9, + 13, + 9, + 8, + 21, + 5, + 13, + 17, + 6, + 18, + 40, + 5, + 15, + 8, + 24, + 19, + 12, + 9, + 16, + 15, + 8 + ], + "weighted_loads": [ + 0.29494780488312244, + 2.166736427694559, + 2.5260854568332434, + 1.635446305386722, + 3.0600850488990545, + 0.29134236462414265, + 1.2053340654820204, + 0.12948039174079895, + 0.737329788506031, + 1.9453099519014359, + 0.3727846033871174, + 1.1955910474061966, + 1.4112348817288876, + 0.2971442211419344, + 2.0761082153767347, + 0.6339074820280075, + 1.1200006566941738, + 0.27362885139882565, + 0.4924247171729803, + 1.7344665573909879, + 0.9849449675530195, + 0.9703303184360266, + 0.9522542059421539, + 0.43697520438581705, + 1.8057703962549567, + 1.5801541581749916, + 0.23927556350827217, + 0.7685913685709238, + 0.33931904658675194, + 2.0213350281119347, + 0.7212095186114311, + 1.124327477067709, + 0.15090540051460266, + 1.4131857436150312, + 5.3433246202766895, + 0.9224291034042835, + 0.29330818774178624, + 0.40613256953656673, + 1.2785637713968754, + 1.074172193184495, + 0.27084537222981453, + 0.6456513591110706, + 1.194917468354106, + 0.3505513872951269, + 0.6956899575889111, + 0.48401325568556786, + 0.2883766256272793, + 1.605217780917883, + 0.28392692282795906, + 1.0017326325178146, + 0.7693994026631117, + 0.28395677730441093, + 1.164316836744547, + 4.0598314525559545, + 1.7157514616847038, + 0.9510252792388201, + 0.8534339908510447, + 1.4745814483612776, + 2.1356352269649506, + 0.5959288738667965, + 0.29501495137810707, + 0.8252838831394911, + 0.8514803489670157, + 0.7338588945567608 + ], + "unique_experts": 64, + "load_cv": 0.5353807611035646, + "normalized_load_entropy": 0.9676383271825074, + "max_load_share": 0.04329004329004329 + } + }, + "s0_bos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "5028b21ebe8af0bf2bd5bdf47b82c1b1974e6f5e6ef656a73b963533a8a29c13", + "route_weight_sha256": "4bbee080ec0c4128db3344b1256f4d5b43d246b919932216974346f4de4956a7", + "loads": [ + 8, + 14, + 26, + 8, + 17, + 5, + 8, + 2, + 9, + 25, + 9, + 10, + 18, + 11, + 17, + 11, + 13, + 0, + 9, + 17, + 10, + 16, + 10, + 5, + 12, + 12, + 3, + 14, + 5, + 11, + 10, + 10, + 0, + 21, + 31, + 9, + 5, + 6, + 11, + 13, + 5, + 4, + 10, + 10, + 11, + 9, + 9, + 8, + 3, + 12, + 11, + 6, + 14, + 29, + 0, + 16, + 6, + 22, + 10, + 10, + 6, + 7, + 5, + 4 + ], + "weighted_loads": [ + 0.3187960982322693, + 1.8876162506639957, + 2.5062478128820658, + 1.6411616802215576, + 1.558092139661312, + 0.1931743435561657, + 0.5877952668815851, + 0.09235148504376411, + 0.7568725384771824, + 1.8637050781399012, + 0.33941194601356983, + 0.5076282732188702, + 0.7553535476326942, + 0.34743313305079937, + 1.2331632860004902, + 0.4763843920081854, + 0.7288585361093283, + 0.0, + 0.4235390219837427, + 1.2805300755426288, + 0.6702690534293652, + 0.8940481673926115, + 0.8172839190810919, + 0.21505964547395706, + 1.0700604021549225, + 1.3981898725032806, + 0.13975152373313904, + 0.6743633504956961, + 0.29699672013521194, + 2.0055681951344013, + 0.519262045621872, + 1.1001567728817463, + 0.0, + 1.3922952339053154, + 5.023019025102258, + 0.9294132608920336, + 0.20396323315799236, + 0.23861942812800407, + 1.2168755121529102, + 0.9928435571491718, + 0.1792416926473379, + 0.22411702200770378, + 0.34312284644693136, + 0.40137165784835815, + 0.6964980103075504, + 0.4708847291767597, + 0.312665730714798, + 0.7155125439167023, + 0.16265388578176498, + 0.9473358616232872, + 0.39721731655299664, + 0.27258638478815556, + 1.023381743580103, + 3.2004345385357738, + 0.0, + 0.9651716612279415, + 0.8241120912134647, + 1.3987772706896067, + 1.6821440197527409, + 0.5555002763867378, + 0.20073573291301727, + 0.441423024982214, + 0.10014996025711298, + 0.5139469038695097 + ], + "unique_experts": 61, + "load_cv": 0.6098637251008181, + "normalized_load_entropy": 0.954656333947171, + "max_load_share": 0.045722713864306784 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "bbd373d34497de0cdc97286d8f71c849e9d8844d2826f6e2b9238ab5fc502c56", + "route_weight_sha256": "2e059d4b30a1c30e659081dcd39e370e827708ffda289341d6414c5b54a33ca3", + "loads": [ + 9, + 16, + 28, + 8, + 22, + 6, + 17, + 2, + 9, + 29, + 9, + 10, + 26, + 14, + 22, + 11, + 16, + 1, + 9, + 24, + 10, + 16, + 15, + 11, + 20, + 13, + 4, + 16, + 5, + 16, + 19, + 10, + 0, + 21, + 32, + 11, + 5, + 13, + 12, + 14, + 6, + 9, + 18, + 11, + 12, + 10, + 9, + 13, + 5, + 12, + 12, + 6, + 14, + 32, + 5, + 17, + 6, + 22, + 15, + 10, + 7, + 10, + 12, + 4 + ], + "weighted_loads": [ + 0.35785724595189095, + 2.0169546380639076, + 2.567643102258444, + 1.6411616802215576, + 2.178714783862233, + 0.20635730400681496, + 0.9622248113155365, + 0.09235148504376411, + 0.7568725384771824, + 2.130515879020095, + 0.33941194601356983, + 0.5076282732188702, + 1.3051688447594643, + 0.4692942854017019, + 1.7607171460986137, + 0.4763843920081854, + 0.8414345849305391, + 0.7229619026184082, + 0.4235390219837427, + 1.8875018497928977, + 0.6702690534293652, + 0.8940481673926115, + 0.9998707920312881, + 0.44562442507594824, + 1.7085254043340683, + 1.5981359630823135, + 0.17238032072782516, + 0.7949373591691256, + 0.29699672013521194, + 2.1997051909565926, + 0.8725262843072414, + 1.1001567728817463, + 0.0, + 1.3922952339053154, + 5.067962719127536, + 1.0069755483418703, + 0.20396323315799236, + 0.537811990827322, + 1.2584009617567062, + 1.040053766220808, + 0.18984840996563435, + 0.4399494603276253, + 0.9289662865921855, + 0.45794376358389854, + 0.7072158362716436, + 0.49751292541623116, + 0.312665730714798, + 1.1613657176494598, + 0.23800018802285194, + 0.9473358616232872, + 0.43156289868056774, + 0.27258638478815556, + 1.023381743580103, + 3.399605861864984, + 0.7971097491681576, + 1.0203285738825798, + 0.8241120912134647, + 1.3987772706896067, + 1.9102863818407059, + 0.5555002763867378, + 0.236362524330616, + 0.6286029666662216, + 0.6390653578564525, + 0.5139469038695097 + ], + "unique_experts": 63, + "load_cv": 0.5531559181755157, + "normalized_load_entropy": 0.9624316144219034, + "max_load_share": 0.03864734299516908 + } + }, + "s1_bos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "7a96d46473c1fbb20106e91a2518fd4e12c6a94272d4b761c84019c95926d1c0", + "route_weight_sha256": "ceb07320a00813519e382ed46c3951d6ca80ffa56ac19db3ede035b45d355970", + "loads": [ + 9, + 15, + 24, + 8, + 17, + 4, + 8, + 2, + 9, + 23, + 10, + 10, + 19, + 9, + 17, + 10, + 13, + 0, + 7, + 17, + 10, + 16, + 10, + 5, + 11, + 11, + 4, + 13, + 6, + 12, + 11, + 10, + 0, + 21, + 31, + 10, + 5, + 7, + 13, + 14, + 4, + 4, + 10, + 8, + 12, + 8, + 8, + 8, + 6, + 12, + 9, + 5, + 14, + 30, + 0, + 14, + 7, + 22, + 10, + 9, + 10, + 7, + 6, + 4 + ], + "weighted_loads": [ + 0.3442492224276066, + 1.8934589941054583, + 2.4445660933852196, + 1.6664171181619167, + 1.6709261126816273, + 0.16092360764741898, + 0.5718580782413483, + 0.10077336430549622, + 0.7583042420446873, + 1.6610250510275364, + 0.38951797783374786, + 0.506717698648572, + 0.7967012748122215, + 0.25213233940303326, + 1.2114418223500252, + 0.432056974619627, + 0.7517142165452242, + 0.0, + 0.3502930738031864, + 1.323485697619617, + 0.6666869111359119, + 0.9082818645983934, + 0.8079812191426754, + 0.21872908622026443, + 1.0746138747781515, + 1.3666994869709015, + 0.16488154791295528, + 0.6440456211566925, + 0.3281663004308939, + 2.0214263601228595, + 0.5529842171818018, + 1.1433435808867216, + 0.0, + 1.421079870313406, + 5.06304494664073, + 0.9721469506621361, + 0.21996807493269444, + 0.26642657816410065, + 1.2442802414298058, + 1.0119656156748533, + 0.14642711356282234, + 0.2331855669617653, + 0.35532858967781067, + 0.33109079860150814, + 0.7058572098612785, + 0.45082923024892807, + 0.29058258049190044, + 0.6994899734854698, + 0.24582338146865368, + 0.9639021120965481, + 0.34881905652582645, + 0.23556800186634064, + 1.0535466149449348, + 3.310008179396391, + 0.0, + 0.9053157567977905, + 0.8277571778744459, + 1.3959906660020351, + 1.6727300621569157, + 0.49910538271069527, + 0.3198731020092964, + 0.43766388669610023, + 0.12884882744401693, + 0.4940034653991461 + ], + "unique_experts": 61, + "load_cv": 0.5969425789511856, + "normalized_load_entropy": 0.9565997461763562, + "max_load_share": 0.045722713864306784 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "2ad5b4f60d3d157d5831cf1a3df8e9e1893065309114ce352383f3c44184e958", + "route_weight_sha256": "0bb1815adcae26efadf31c28c2c1398eba877567601e45e45dd3bfcf6bc33779", + "loads": [ + 10, + 20, + 26, + 8, + 29, + 6, + 19, + 2, + 9, + 32, + 11, + 17, + 30, + 11, + 28, + 12, + 16, + 5, + 8, + 27, + 14, + 17, + 15, + 10, + 22, + 12, + 4, + 15, + 7, + 13, + 19, + 10, + 3, + 21, + 32, + 11, + 7, + 11, + 15, + 17, + 8, + 13, + 20, + 10, + 13, + 8, + 8, + 19, + 7, + 13, + 14, + 5, + 17, + 39, + 4, + 15, + 9, + 24, + 19, + 10, + 12, + 15, + 15, + 6 + ], + "weighted_loads": [ + 0.36537012830376625, + 2.188690820708871, + 2.505277119576931, + 1.6664171181619167, + 3.218755530193448, + 0.2543951943516731, + 1.098241439089179, + 0.10077336430549622, + 0.7583042420446873, + 2.077943153679371, + 0.45492857694625854, + 1.243661219254136, + 1.4567604698240757, + 0.33176049776375294, + 2.118554448708892, + 0.5421159751713276, + 1.149334428831935, + 0.22466916032135487, + 0.4501252584159374, + 2.088713306002319, + 0.9991329107433558, + 0.962766757234931, + 1.0125489197671413, + 0.3970177536830306, + 1.9398794956505299, + 1.5634972751140594, + 0.16488154791295528, + 0.7562061473727226, + 0.3671074528247118, + 2.0574232703074813, + 0.8642314076423645, + 1.1433435808867216, + 0.11529303342103958, + 1.421079870313406, + 5.102341890335083, + 1.0241183154284954, + 0.3000212963670492, + 0.42485913448035717, + 1.3281066678464413, + 1.1542560663074255, + 0.25628671795129776, + 0.6587839536368847, + 1.087149653583765, + 0.39867046289145947, + 0.7165750358253717, + 0.45082923024892807, + 0.29058258049190044, + 1.5079785287380219, + 0.2797184083610773, + 1.008667603135109, + 0.6910167317837477, + 0.23556800186634064, + 1.1974088344722986, + 4.0612749718129635, + 0.7740064188838005, + 0.9568983726203442, + 0.9088454339653254, + 1.484360035508871, + 2.1198512502014637, + 0.5336849987506866, + 0.3894905000925064, + 0.8000632878392935, + 0.8407738050445914, + 0.6567176003009081 + ], + "unique_experts": 64, + "load_cv": 0.5438545901786016, + "normalized_load_entropy": 0.9658224664187045, + "max_load_share": 0.04220779220779221 + } + }, + "s0_x": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "b7dd4c4206731284d0cd046dfe994f551bde9fb46c9be9c96b416beb0afd8950", + "route_weight_sha256": "eb3d99e84a19d237700e64d620a78f3d607f242d324c3888625b9ed1c64b4c1e", + "loads": [ + 7, + 12, + 25, + 8, + 16, + 5, + 9, + 2, + 9, + 24, + 9, + 10, + 20, + 11, + 17, + 10, + 12, + 2, + 8, + 19, + 10, + 17, + 9, + 4, + 12, + 11, + 4, + 12, + 5, + 12, + 10, + 10, + 0, + 23, + 32, + 9, + 4, + 6, + 12, + 13, + 4, + 4, + 11, + 7, + 12, + 8, + 9, + 9, + 4, + 12, + 12, + 7, + 15, + 29, + 0, + 15, + 5, + 22, + 11, + 9, + 8, + 7, + 4, + 4 + ], + "weighted_loads": [ + 0.28912870958447456, + 1.8962054122239351, + 2.514251932501793, + 1.6665768660604954, + 1.5540700908750296, + 0.19228996895253658, + 0.6081408839672804, + 0.09438158944249153, + 0.7878668829798698, + 1.8157130405306816, + 0.34823686070740223, + 0.5246230494230986, + 0.8421416319906712, + 0.3369649164378643, + 1.2050801180303097, + 0.4602660797536373, + 0.6826826706528664, + 0.07637520134449005, + 0.39212206564843655, + 1.4009008780121803, + 0.6685492694377899, + 0.9258905909955502, + 0.7881952654570341, + 0.16623820550739765, + 1.0831643901765347, + 1.415806908160448, + 0.17912327498197556, + 0.5991197321563959, + 0.29476361349225044, + 2.059141393750906, + 0.5235103890299797, + 1.084151403978467, + 0.0, + 1.490297781303525, + 5.206909954547882, + 0.9365255981683731, + 0.17723479121923447, + 0.22441696375608444, + 1.229536347091198, + 0.9780356977134943, + 0.14603392966091633, + 0.1715375524945557, + 0.4155629314482212, + 0.2645172607153654, + 0.7459151539951563, + 0.4246148206293583, + 0.32176485657691956, + 0.8020286560058594, + 0.23106964118778706, + 0.9318634606897831, + 0.42240177281200886, + 0.3080711718648672, + 1.0538867972791195, + 3.1840569395571947, + 0.0, + 0.9365992043167353, + 0.7558172531425953, + 1.3863565158098936, + 1.7122331038117409, + 0.5334627460688353, + 0.27717035729438066, + 0.4541565254330635, + 0.06451687775552273, + 0.5228542797267437 + ], + "unique_experts": 62, + "load_cv": 0.6173513458953219, + "normalized_load_entropy": 0.9551174046055966, + "max_load_share": 0.0471976401179941 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "44d839b380b3fa49652bee87d7f1cb7ba31b28a51db59da8a8111d5d158ab3ea", + "route_weight_sha256": "fb01433eeee8c1c6788f29b3b8a330dc80c2333b8938a55be93bb23247bcb689", + "loads": [ + 8, + 14, + 26, + 8, + 22, + 7, + 19, + 2, + 9, + 28, + 9, + 10, + 31, + 12, + 23, + 10, + 15, + 3, + 8, + 25, + 10, + 17, + 15, + 11, + 18, + 12, + 4, + 14, + 5, + 17, + 17, + 10, + 0, + 23, + 33, + 10, + 4, + 12, + 13, + 15, + 6, + 8, + 20, + 9, + 13, + 8, + 9, + 15, + 5, + 12, + 13, + 7, + 15, + 31, + 5, + 16, + 5, + 22, + 17, + 9, + 8, + 10, + 12, + 4 + ], + "weighted_loads": [ + 0.3281898573040962, + 2.02862417511642, + 2.5388140361756086, + 1.6665768660604954, + 2.2786821145564318, + 0.2914001550525427, + 1.0367930456995964, + 0.09438158944249153, + 0.7878668829798698, + 2.0820035561919212, + 0.34823686070740223, + 0.5246230494230986, + 1.574868943542242, + 0.3762257844209671, + 1.7543629109859467, + 0.4602660797536373, + 0.7952587194740772, + 0.13011642172932625, + 0.39212206564843655, + 1.7246855273842812, + 0.6685492694377899, + 0.9258905909955502, + 1.0200361609458923, + 0.43226116243749857, + 1.5714344009757042, + 1.6388767249882221, + 0.17912327498197556, + 0.747556721791625, + 0.29476361349225044, + 2.2532783895730972, + 0.8026176393032074, + 1.084151403978467, + 0.0, + 1.490297781303525, + 5.236890407279134, + 0.9969286173582077, + 0.17723479121923447, + 0.45803337544202805, + 1.271061796694994, + 1.0578917916864157, + 0.20423043705523014, + 0.34204279677942395, + 1.142223671078682, + 0.3594758789986372, + 0.7566329799592495, + 0.4246148206293583, + 0.32176485657691956, + 1.3360796943306923, + 0.2684652116149664, + 0.9318634606897831, + 0.46413842774927616, + 0.3080711718648672, + 1.0538867972791195, + 3.357598038390279, + 0.7971097491681576, + 0.9767836090177298, + 0.7558172531425953, + 1.3863565158098936, + 1.9860195629298687, + 0.5334627460688353, + 0.27717035729438066, + 0.6413364671170712, + 0.6518899500370026, + 0.5228542797267437 + ], + "unique_experts": 63, + "load_cv": 0.5679770772479464, + "normalized_load_entropy": 0.9613836988516363, + "max_load_share": 0.03985507246376811 + } + }, + "s1_x": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "3764ab9f4ad59b3a1918af0d0943f331018afdf111cb40cd1fa26f481c222d49", + "route_weight_sha256": "192392c48a9773bdf6a8dc531d6f56a6342c351f49e99a0b890a5744d83bb060", + "loads": [ + 7, + 16, + 24, + 8, + 17, + 4, + 9, + 2, + 8, + 24, + 9, + 9, + 18, + 8, + 15, + 10, + 14, + 1, + 7, + 15, + 10, + 17, + 10, + 4, + 11, + 11, + 4, + 11, + 6, + 12, + 9, + 10, + 0, + 21, + 31, + 10, + 5, + 7, + 13, + 14, + 5, + 4, + 10, + 9, + 13, + 9, + 9, + 10, + 6, + 13, + 12, + 7, + 14, + 32, + 0, + 13, + 5, + 22, + 10, + 9, + 9, + 7, + 5, + 4 + ], + "weighted_loads": [ + 0.25890821404755116, + 2.0269719380885363, + 2.4587099961936474, + 1.6786419861018658, + 1.6355076432228088, + 0.1605616044253111, + 0.5868979338556528, + 0.09005249664187431, + 0.7275576330721378, + 1.6437216475605965, + 0.33504339307546616, + 0.46199133805930614, + 0.777869326993823, + 0.23208182863891125, + 1.024126349017024, + 0.429984737187624, + 0.7585986144840717, + 0.037703774869441986, + 0.33263866417109966, + 1.36799868196249, + 0.6658283732831478, + 0.9295125585049391, + 0.8247712478041649, + 0.16296738013625145, + 1.0723901074379683, + 1.4008748028427362, + 0.16140766069293022, + 0.5602782294154167, + 0.3193127475678921, + 2.0626273062080145, + 0.45760309882462025, + 1.0923293735831976, + 0.0, + 1.4179279953241348, + 5.245507786050439, + 0.9915257282555103, + 0.22212818264961243, + 0.26586671732366085, + 1.2026023659855127, + 1.015921575948596, + 0.1770207118242979, + 0.2315739467740059, + 0.3657497148960829, + 0.3610902577638626, + 0.7704561203718185, + 0.47243890166282654, + 0.32513242959976196, + 0.7785419896245003, + 0.26594890654087067, + 0.9908637180924416, + 0.44813728146255016, + 0.30362942814826965, + 1.0066840201616287, + 3.3030962692573667, + 0.0, + 0.8810612540692091, + 0.7252304293215275, + 1.3795313723385334, + 1.6801227107644081, + 0.4961522985249758, + 0.2822407325729728, + 0.4464670531451702, + 0.10419031232595444, + 0.49355051666498184 + ], + "unique_experts": 62, + "load_cv": 0.6045902444216343, + "normalized_load_entropy": 0.9569018038290072, + "max_load_share": 0.0471976401179941 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "94d40993bccc0b308ccdd4bc9ca01e23df5fd932f0e6f9779e28695b25a39774", + "route_weight_sha256": "8d91a7547d46d2ed1c0786948389d3d5375111ce4f4ac8f4c73b069cb7737903", + "loads": [ + 8, + 22, + 26, + 8, + 29, + 7, + 21, + 3, + 8, + 31, + 10, + 16, + 31, + 8, + 27, + 12, + 17, + 8, + 8, + 23, + 14, + 18, + 16, + 9, + 20, + 12, + 4, + 13, + 7, + 13, + 15, + 10, + 5, + 21, + 31, + 10, + 7, + 9, + 15, + 16, + 7, + 13, + 21, + 11, + 14, + 9, + 9, + 22, + 7, + 14, + 17, + 7, + 17, + 41, + 4, + 14, + 7, + 24, + 20, + 10, + 10, + 17, + 15, + 6 + ], + "weighted_loads": [ + 0.2800291199237108, + 2.377023031935096, + 2.519421022385359, + 1.6786419861018658, + 2.9479996021836996, + 0.2998222280293703, + 1.1455997973680496, + 0.13505959510803223, + 0.7275576330721378, + 1.9514380283653736, + 0.40045399218797684, + 1.1989348586648703, + 1.5562230180948973, + 0.23208182863891125, + 1.914421882480383, + 0.5400437377393246, + 1.1562188267707825, + 0.3369352202862501, + 0.43247084878385067, + 1.774754125624895, + 0.9982743728905916, + 0.9839974511414766, + 1.0648374781012535, + 0.3412560475990176, + 1.7493065632879734, + 1.6089240554720163, + 0.16140766069293022, + 0.7068115435540676, + 0.35825389996171, + 2.0986242163926363, + 0.6840809099376202, + 1.0923293735831976, + 0.21223727613687515, + 1.4179279953241348, + 5.245507786050439, + 0.9915257282555103, + 0.3021814040839672, + 0.33252850361168385, + 1.2864287924021482, + 1.118613326922059, + 0.23002936504781246, + 0.6400480270385742, + 1.2933926116675138, + 0.44626692309975624, + 0.7811739463359118, + 0.47243890166282654, + 0.32513242959976196, + 1.6457222998142242, + 0.2998439334332943, + 1.0356292091310024, + 0.806164575740695, + 0.30362942814826965, + 1.1505462396889925, + 4.021562946029007, + 0.7740064188838005, + 0.9155152160674334, + 0.8063186854124069, + 1.4679007418453693, + 2.1594146452844143, + 0.5307319145649672, + 0.3213408989831805, + 0.9005620423704386, + 0.9014196172356606, + 0.6562646515667439 + ], + "unique_experts": 64, + "load_cv": 0.5435788542637086, + "normalized_load_entropy": 0.9666604927869162, + "max_load_share": 0.044372294372294376 + } + }, + "s0_period": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "2dc03f9a557c743b4fececf1cfd3673bc88089da3528f9f8219afda8f0f3a312", + "route_weight_sha256": "16e8a0883ed1bfd959791433471e6885fbdab9d1848af9523eb967cef06f1c5a", + "loads": [ + 7, + 12, + 25, + 8, + 17, + 3, + 9, + 2, + 9, + 25, + 9, + 11, + 17, + 10, + 17, + 10, + 13, + 2, + 8, + 19, + 10, + 17, + 9, + 5, + 12, + 11, + 3, + 14, + 5, + 12, + 11, + 10, + 0, + 23, + 31, + 9, + 4, + 5, + 11, + 13, + 4, + 4, + 11, + 8, + 14, + 9, + 7, + 9, + 4, + 12, + 14, + 7, + 14, + 28, + 0, + 16, + 5, + 22, + 11, + 8, + 7, + 7, + 5, + 4 + ], + "weighted_loads": [ + 0.29169273748993874, + 1.9042025953531265, + 2.504460794851184, + 1.657316274009645, + 1.5766732413321733, + 0.1345772072672844, + 0.6012703906744719, + 0.09660208597779274, + 0.7858465425670147, + 1.8239827435463667, + 0.355176305398345, + 0.5439667701721191, + 0.7437206041067839, + 0.3238238636404276, + 1.2320066392421722, + 0.460302896797657, + 0.7282297946512699, + 0.07365670427680016, + 0.3863677754998207, + 1.3713484816253185, + 0.6692521274089813, + 0.9271202441304922, + 0.7799331862479448, + 0.2003794852644205, + 1.1077948343008757, + 1.4163623247295618, + 0.1566765308380127, + 0.6649217773228884, + 0.2780403681099415, + 2.021644866093993, + 0.5514188874512911, + 1.1001172419637442, + 0.0, + 1.473088437691331, + 5.195834511891007, + 0.9345131535083055, + 0.1757817268371582, + 0.1718104500323534, + 1.20121631026268, + 0.9868286941200495, + 0.14656027778983116, + 0.20031890273094177, + 0.39975283527746797, + 0.30278995260596275, + 0.7937821205705404, + 0.46592944487929344, + 0.2606586664915085, + 0.8162085488438606, + 0.24919073283672333, + 0.9384356737136841, + 0.4765563067048788, + 0.3054504171013832, + 1.0127838272601366, + 3.161115356720984, + 0.0, + 0.9879040811210871, + 0.7758386321365833, + 1.3889372292906046, + 1.6975071541965008, + 0.4784008003771305, + 0.24646390974521637, + 0.44986608624458313, + 0.09787644725292921, + 0.5211420189589262 + ], + "unique_experts": 62, + "load_cv": 0.6155445288897122, + "normalized_load_entropy": 0.9545913885968185, + "max_load_share": 0.045722713864306784 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "7dfb8f6188c5dac170a68ebb1aa33e0a93369f63627aec9926f3cb1cb9ee429c", + "route_weight_sha256": "e812815727172fc08c57fbf85497ac6aa9f9d2ab62f2dfa3fdc892a2ccbd64b0", + "loads": [ + 8, + 14, + 26, + 8, + 23, + 5, + 18, + 2, + 9, + 30, + 9, + 11, + 26, + 11, + 23, + 10, + 16, + 3, + 8, + 26, + 10, + 17, + 14, + 12, + 18, + 12, + 3, + 16, + 5, + 17, + 18, + 10, + 0, + 23, + 33, + 10, + 5, + 12, + 12, + 14, + 6, + 8, + 19, + 9, + 15, + 9, + 7, + 16, + 5, + 12, + 15, + 7, + 14, + 30, + 5, + 17, + 5, + 22, + 16, + 8, + 8, + 11, + 13, + 4 + ], + "weighted_loads": [ + 0.3307538852095604, + 2.050218217074871, + 2.5290228985249996, + 1.657316274009645, + 2.3465244825929403, + 0.2242325097322464, + 0.9756999351084232, + 0.09660208597779274, + 0.7858465425670147, + 2.11671693995595, + 0.355176305398345, + 0.5439667701721191, + 1.3471103180199862, + 0.3630847316235304, + 1.8107888922095299, + 0.460302896797657, + 0.8408058434724808, + 0.1328156515955925, + 0.3863677754998207, + 1.7458489686250687, + 0.6692521274089813, + 0.9271202441304922, + 0.9625200591981411, + 0.4601704003289342, + 1.5624501127749681, + 1.6355467084795237, + 0.1566765308380127, + 0.8130714204162359, + 0.2780403681099415, + 2.2157818619161844, + 0.8305621389299631, + 1.1001172419637442, + 0.0, + 1.473088437691331, + 5.293262157589197, + 0.9949161726981401, + 0.22866292297840118, + 0.43455307371914387, + 1.242741759866476, + 1.0340389031916857, + 0.20263323187828064, + 0.36959460750222206, + 0.9855962754227221, + 0.35936205834150314, + 0.8044999465346336, + 0.46592944487929344, + 0.2606586664915085, + 1.4141862578690052, + 0.28658630326390266, + 0.9384356737136841, + 0.5214025806635618, + 0.3054504171013832, + 1.0127838272601366, + 3.364960760809481, + 0.7971097491681576, + 1.0353457126766443, + 0.7758386321365833, + 1.3889372292906046, + 1.9256495162844658, + 0.4784008003771305, + 0.2721019499003887, + 0.7269915007054806, + 0.6716148452833295, + 0.5211420189589262 + ], + "unique_experts": 63, + "load_cv": 0.5646803675333986, + "normalized_load_entropy": 0.9612230120561487, + "max_load_share": 0.03985507246376811 + } + }, + "s1_period": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "15194d76946f481901350b0c26a94b9bf3ba5b387925c6b7cd52e080b81d7787", + "route_weight_sha256": "a19a4b10772a4811722380a480029572c97b7695042ce63fddb3dd61c6dafbec", + "loads": [ + 8, + 16, + 25, + 8, + 17, + 4, + 9, + 2, + 8, + 24, + 10, + 9, + 18, + 8, + 16, + 10, + 13, + 0, + 7, + 15, + 10, + 17, + 10, + 4, + 9, + 12, + 5, + 12, + 5, + 12, + 10, + 10, + 0, + 23, + 31, + 10, + 5, + 6, + 11, + 14, + 4, + 4, + 11, + 10, + 12, + 9, + 6, + 10, + 5, + 12, + 13, + 6, + 14, + 30, + 0, + 14, + 5, + 22, + 12, + 9, + 10, + 7, + 6, + 4 + ], + "weighted_loads": [ + 0.31331581622362137, + 1.9883734844624996, + 2.5045378878712654, + 1.7023599967360497, + 1.6082498971372843, + 0.1595546416938305, + 0.5774850696325302, + 0.09726916626095772, + 0.719108272343874, + 1.583032999187708, + 0.39534609392285347, + 0.4624408408999443, + 0.7800976354628801, + 0.23100712522864342, + 1.0550169833004475, + 0.4211024306714535, + 0.7453944589942694, + 0.0, + 0.32655126973986626, + 1.3395309513434768, + 0.6555457673966885, + 0.9355624411255121, + 0.820931663736701, + 0.1787915825843811, + 1.0024446807801723, + 1.4178784545511007, + 0.20326352305710316, + 0.5917744543403387, + 0.2748102769255638, + 2.029719417914748, + 0.48887857235968113, + 1.1067115515470505, + 0.0, + 1.457209262996912, + 5.262207269668579, + 0.9916725791990757, + 0.2186142187565565, + 0.21797754801809788, + 1.119133424013853, + 1.0133618619292974, + 0.1421719528734684, + 0.23416007682681084, + 0.40000013168901205, + 0.3911469206213951, + 0.6996536552906036, + 0.46459344401955605, + 0.2422019187361002, + 0.7457846216857433, + 0.23024677485227585, + 0.9500758200883865, + 0.4862552843987942, + 0.27303410321474075, + 1.0104535017162561, + 3.2930812491104007, + 0.0, + 0.9110853169113398, + 0.7367539219558239, + 1.359511736780405, + 1.748659247532487, + 0.48875254578888416, + 0.29467776976525784, + 0.43294884264469147, + 0.12586971186101437, + 0.5059938486665487 + ], + "unique_experts": 61, + "load_cv": 0.6103201352585569, + "normalized_load_entropy": 0.9548681407769455, + "max_load_share": 0.045722713864306784 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "514cdcca0f6f1874d7f2744aaa73db98319a8b8a5cfbd8fcd121132ebf16876c", + "route_weight_sha256": "baf452dd7457ba824fb4648ee7cb73d719593ecdb009fb004bc918c997230c47", + "loads": [ + 9, + 21, + 27, + 8, + 29, + 7, + 20, + 3, + 8, + 32, + 11, + 16, + 30, + 8, + 29, + 12, + 16, + 6, + 8, + 24, + 14, + 18, + 15, + 9, + 17, + 13, + 5, + 14, + 6, + 13, + 16, + 11, + 4, + 23, + 32, + 10, + 7, + 7, + 13, + 17, + 6, + 13, + 21, + 11, + 13, + 9, + 6, + 23, + 6, + 13, + 18, + 6, + 17, + 40, + 4, + 15, + 7, + 24, + 21, + 10, + 13, + 18, + 16, + 6 + ], + "weighted_loads": [ + 0.33443672209978104, + 2.30139883980155, + 2.565248914062977, + 1.7023599967360497, + 3.0332199186086655, + 0.29672127217054367, + 1.103868430480361, + 0.14615510776638985, + 0.719108272343874, + 1.908997394144535, + 0.46075669303536415, + 1.1993843615055084, + 1.474375730380416, + 0.23100712522864342, + 1.9866033177822828, + 0.5311614312231541, + 1.14301467128098, + 0.25845914892852306, + 0.42638345435261726, + 1.799520100466907, + 0.9879917670041323, + 0.9900473337620497, + 1.025499364361167, + 0.3570802500471473, + 1.6245824079960585, + 1.6251047905534506, + 0.20326352305710316, + 0.7273969668895006, + 0.3137514293193817, + 2.06571632809937, + 0.7168469578027725, + 1.139511700719595, + 0.1702577956020832, + 1.457209262996912, + 5.321351796388626, + 0.9916725791990757, + 0.2986674401909113, + 0.24731017090380192, + 1.2029598504304886, + 1.1626043189316988, + 0.19518060609698296, + 0.6604056991636753, + 1.1481159841641784, + 0.4293526001274586, + 0.7103714812546968, + 0.46459344401955605, + 0.2422019187361002, + 1.7007910050451756, + 0.2641418017446995, + 0.9948413111269474, + 0.8434240706264973, + 0.27303410321474075, + 1.15431572124362, + 4.078226561658084, + 0.7740064188838005, + 0.9472640138119459, + 0.8178421780467033, + 1.447881106287241, + 2.195780435577035, + 0.5233321618288755, + 0.41912047006189823, + 0.919222055003047, + 0.8801945764571428, + 0.6687079835683107 + ], + "unique_experts": 64, + "load_cv": 0.5584079992601069, + "normalized_load_entropy": 0.9643822793253232, + "max_load_share": 0.04329004329004329 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 113, + "ordered_topk_exact_tokens": 73, + "set_exact_tokens": 82, + "mean_set_jaccard": 0.9216182048040454, + "mean_token_weighted_tv": 0.0168901613534354, + "aggregate_load_tv": 0.030973451327433628 + }, + "system_bos": { + "tokens": 113, + "ordered_topk_exact_tokens": 66, + "set_exact_tokens": 77, + "mean_set_jaccard": 0.9051833122629582, + "mean_token_weighted_tv": 0.021073142598193567, + "aggregate_load_tv": 0.035398230088495575 + }, + "system_x": { + "tokens": 113, + "ordered_topk_exact_tokens": 51, + "set_exact_tokens": 66, + "mean_set_jaccard": 0.8645174884112937, + "mean_token_weighted_tv": 0.03143696344160862, + "aggregate_load_tv": 0.04129793510324484 + }, + "system_period": { + "tokens": 113, + "ordered_topk_exact_tokens": 47, + "set_exact_tokens": 67, + "mean_set_jaccard": 0.8685208596713022, + "mean_token_weighted_tv": 0.03213200748453032, + "aggregate_load_tv": 0.04129793510324484 + }, + "bos_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 69, + "set_exact_tokens": 77, + "mean_set_jaccard": 0.9051833122629583, + "mean_token_weighted_tv": 0.024029042097879986, + "aggregate_load_tv": 0.035398230088495575 + }, + "bos_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 60, + "set_exact_tokens": 73, + "mean_set_jaccard": 0.8912768647281922, + "mean_token_weighted_tv": 0.027475723943186807, + "aggregate_load_tv": 0.04424778761061947 + }, + "x_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 61, + "set_exact_tokens": 71, + "mean_set_jaccard": 0.8881163084702908, + "mean_token_weighted_tv": 0.027467815883342274, + "aggregate_load_tv": 0.03982300884955752 + }, + "x_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 45, + "set_exact_tokens": 68, + "mean_set_jaccard": 0.8710493046776234, + "mean_token_weighted_tv": 0.03415330282651481, + "aggregate_load_tv": 0.045722713864306784 + }, + "period_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 66, + "set_exact_tokens": 79, + "mean_set_jaccard": 0.9007585335018964, + "mean_token_weighted_tv": 0.026579907409170957, + "aggregate_load_tv": 0.03687315634218289 + }, + "period_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 54, + "set_exact_tokens": 69, + "mean_set_jaccard": 0.8792667509481669, + "mean_token_weighted_tv": 0.032477730930477906, + "aggregate_load_tv": 0.03982300884955752 + } + } + }, + "layer_20": { + "layer": 20, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "5eadb619baec7126a8cd36c81427af18bb272e7e26583c45439ea8b2e86446c5", + "route_weight_sha256": "3d283153e85d490557d454d9d8c39daf0762613b742469d8e41dbd81e801773f", + "loads": [ + 15, + 13, + 11, + 10, + 32, + 21, + 11, + 5, + 10, + 5, + 12, + 11, + 30, + 12, + 11, + 4, + 10, + 28, + 10, + 2, + 2, + 8, + 8, + 15, + 8, + 5, + 8, + 7, + 13, + 9, + 4, + 4, + 20, + 6, + 9, + 8, + 9, + 8, + 11, + 12, + 9, + 26, + 7, + 12, + 21, + 14, + 0, + 4, + 7, + 5, + 4, + 11, + 7, + 25, + 11, + 10, + 6, + 3, + 7, + 13, + 12, + 10, + 8, + 9 + ], + "weighted_loads": [ + 0.7055004313588142, + 0.5412053242325783, + 0.422545631416142, + 0.719927903264761, + 2.7294206582009792, + 1.4426519758999348, + 1.5465937033295631, + 0.18854781612753868, + 0.513981394469738, + 0.2939998544752598, + 1.6173675041645765, + 0.4869682043790817, + 3.2892583832144737, + 1.5416875518858433, + 0.44431701116263866, + 0.3372759744524956, + 0.4914180636405945, + 2.3870017156004906, + 0.6452367175370455, + 0.05582423694431782, + 0.08382381126284599, + 0.35678259283304214, + 0.5456716902554035, + 0.8107247445732355, + 0.5118765234947205, + 0.1766914427280426, + 0.2778488826006651, + 0.5210971459746361, + 1.4128946959972382, + 0.3358386680483818, + 0.15102005004882812, + 0.13522673957049847, + 1.9295446369796991, + 0.20148604176938534, + 0.2966352067887783, + 0.4823552295565605, + 0.8124279603362083, + 0.28068231232464314, + 0.37283565383404493, + 0.6867132484912872, + 0.38117679953575134, + 2.3381775580346584, + 0.3873176071792841, + 2.557582700625062, + 1.1586997527629137, + 1.020014975219965, + 0.0, + 0.16939402744174004, + 0.24335357546806335, + 0.25762518867850304, + 0.19637966714799404, + 0.5542238336056471, + 0.20330373058095574, + 1.8580085150897503, + 0.4967803359031677, + 0.5325324721634388, + 0.25215655378997326, + 0.10195626877248287, + 0.2843846771866083, + 0.5767805222421885, + 0.878187594935298, + 0.4198617022484541, + 0.4733489193022251, + 0.45247200690209866 + ], + "unique_experts": 63, + "load_cv": 0.623857192590845, + "normalized_load_entropy": 0.9574523039204643, + "max_load_share": 0.0471976401179941 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "de35d4c386410b39c4744760aa1d5e14d72020157eae940fd5dfca078c502630", + "route_weight_sha256": "9faea989f645eaffcc652b693db513583d6e53407135dfb65b9daa99ba4925f4", + "loads": [ + 15, + 15, + 11, + 18, + 40, + 25, + 16, + 11, + 10, + 5, + 13, + 12, + 32, + 12, + 11, + 11, + 11, + 29, + 20, + 2, + 6, + 8, + 15, + 15, + 8, + 11, + 9, + 7, + 13, + 11, + 4, + 4, + 20, + 8, + 11, + 8, + 11, + 11, + 13, + 13, + 10, + 28, + 10, + 16, + 31, + 14, + 0, + 4, + 9, + 6, + 12, + 11, + 7, + 31, + 11, + 13, + 6, + 9, + 7, + 13, + 24, + 14, + 8, + 9 + ], + "weighted_loads": [ + 0.7055004313588142, + 0.5857710856944323, + 0.422545631416142, + 1.3128067143261433, + 3.12667378783226, + 1.6049326285719872, + 1.6989280264824629, + 0.5367433000355959, + 0.513981394469738, + 0.2939998544752598, + 1.650794232264161, + 0.5372664220631123, + 3.3473490476608276, + 1.5416875518858433, + 0.44431701116263866, + 0.6122275795787573, + 0.5292717777192593, + 2.4531059488654137, + 1.529521582648158, + 0.05582423694431782, + 0.18676726520061493, + 0.35678259283304214, + 0.9952310584485531, + 0.8107247445732355, + 0.5118765234947205, + 0.6508703455328941, + 0.2952951844781637, + 0.5210971459746361, + 1.4128946959972382, + 0.4009233880788088, + 0.15102005004882812, + 0.13522673957049847, + 1.9295446369796991, + 0.30232877656817436, + 0.37774036452174187, + 0.4823552295565605, + 0.8591913487762213, + 0.3654209319502115, + 1.6918123541399837, + 0.7494647577404976, + 0.4353986009955406, + 2.4137132614851, + 0.5631126891821623, + 2.69710512063466, + 1.5135221928358078, + 1.020014975219965, + 0.0, + 0.16939402744174004, + 0.2806444234447554, + 0.29721320047974586, + 1.2439865712076426, + 0.5542238336056471, + 0.20330373058095574, + 2.1610748283565044, + 0.4967803359031677, + 0.9584621042013168, + 0.25215655378997326, + 0.2985660172998905, + 0.2843846771866083, + 0.5767805222421885, + 2.1540161771699786, + 0.6669093575328588, + 0.4733489193022251, + 0.45247200690209866 + ], + "unique_experts": 63, + "load_cv": 0.5925904046728496, + "normalized_load_entropy": 0.9614302301743418, + "max_load_share": 0.04830917874396135 + } + }, + "s1_eos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "0744268b046ecc2280a5876ce0b9d396b66eca8a2c24b825a7ffac171a216a5f", + "route_weight_sha256": "d923a52e334f70a2d275d1668cfab432dd08f18edffb64ece6693746d16719ba", + "loads": [ + 14, + 13, + 9, + 9, + 31, + 19, + 11, + 5, + 12, + 5, + 15, + 11, + 27, + 12, + 11, + 5, + 8, + 29, + 10, + 2, + 3, + 8, + 7, + 14, + 8, + 6, + 7, + 7, + 13, + 10, + 5, + 4, + 20, + 6, + 11, + 8, + 10, + 8, + 10, + 13, + 7, + 27, + 7, + 12, + 22, + 13, + 0, + 4, + 7, + 5, + 4, + 10, + 9, + 27, + 10, + 11, + 6, + 3, + 7, + 13, + 13, + 8, + 8, + 9 + ], + "weighted_loads": [ + 0.6770756542682648, + 0.5529663022607565, + 0.37147846911102533, + 0.6695705242455006, + 2.6551406905055046, + 1.2959845941513777, + 1.5681606270372868, + 0.1948479227721691, + 0.5570603436790407, + 0.298640888184309, + 1.7014707550406456, + 0.4540370684117079, + 3.190020339563489, + 1.52161156386137, + 0.4538954757153988, + 0.34947565756738186, + 0.44523803889751434, + 2.4111076686531305, + 0.625241132453084, + 0.05553903803229332, + 0.12034332752227783, + 0.35536210611462593, + 0.4999306835234165, + 0.7698232568800449, + 0.5020368956029415, + 0.21869791485369205, + 0.2449604645371437, + 0.5231936294585466, + 1.400757934898138, + 0.35277690179646015, + 0.19075125083327293, + 0.1317017488181591, + 1.9166476298123598, + 0.1895820964127779, + 0.35973528772592545, + 0.4761266801506281, + 0.8343803137540817, + 0.28216785565018654, + 0.33900238992646337, + 0.7127127647399902, + 0.3072606585919857, + 2.365367190912366, + 0.3736403379589319, + 2.5876336451619864, + 1.2166099976748228, + 1.001819383352995, + 0.0, + 0.16968198120594025, + 0.2484726868569851, + 0.2523826640099287, + 0.19307827576994896, + 0.5520389694720507, + 0.2859871028922498, + 1.8809947818517685, + 0.4648112580180168, + 0.5572574138641357, + 0.2589977104216814, + 0.10138902254402637, + 0.2795012854039669, + 0.5691101811826229, + 0.9261681018397212, + 0.368030171841383, + 0.47727954760193825, + 0.41789630241692066 + ], + "unique_experts": 63, + "load_cv": 0.6173513458953219, + "normalized_load_entropy": 0.9585963978500672, + "max_load_share": 0.045722713864306784 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "68885c0d4fc8f64617313bb37ff2441e2b94c0ea643575cca56a2720f4a77401", + "route_weight_sha256": "e6d68e3758064bd1cbd9764db0bf14357574e4e31d41902f9253052d3892a936", + "loads": [ + 19, + 15, + 9, + 20, + 39, + 24, + 13, + 11, + 12, + 7, + 18, + 11, + 29, + 13, + 12, + 18, + 13, + 30, + 20, + 3, + 7, + 9, + 18, + 16, + 9, + 19, + 8, + 9, + 13, + 15, + 5, + 5, + 21, + 7, + 14, + 10, + 13, + 16, + 13, + 18, + 11, + 28, + 10, + 19, + 35, + 14, + 0, + 4, + 8, + 10, + 16, + 10, + 9, + 36, + 11, + 23, + 9, + 11, + 9, + 16, + 26, + 10, + 9, + 9 + ], + "weighted_loads": [ + 0.9085485134273767, + 0.5971554424613714, + 0.37147846911102533, + 1.4267020672559738, + 3.07626299187541, + 1.502362372353673, + 1.6367278695106506, + 0.6460687909275293, + 0.5570603436790407, + 0.5311088748276234, + 1.8239198997616768, + 0.4540370684117079, + 3.256786933168769, + 1.805360846221447, + 0.5137853659689426, + 1.0807813480496407, + 0.7456087097525597, + 2.4842002037912607, + 1.6001353729516268, + 0.08805892243981361, + 0.23358436091803014, + 0.3912128582596779, + 1.2124410010874271, + 0.9428183026611805, + 0.5224734470248222, + 1.08548722602427, + 0.26240676641464233, + 0.604035934433341, + 1.400757934898138, + 0.5129637494683266, + 0.19075125083327293, + 0.1624217052012682, + 1.9666462261229753, + 0.2522993180900812, + 0.49803796224296093, + 0.6533338073641062, + 0.937511220574379, + 0.5672698467969894, + 1.697354041505605, + 0.9583895020186901, + 0.48742977902293205, + 2.4198749121278524, + 0.5543482955545187, + 2.873009300092235, + 2.041096992790699, + 1.0745061822235584, + 0.0, + 0.16968198120594025, + 0.25020938692614436, + 0.5602735225111246, + 1.7595369517803192, + 0.5520389694720507, + 0.2859871028922498, + 2.2757311649620533, + 0.49673646315932274, + 1.6484239287674427, + 0.3757337983697653, + 0.6714240536093712, + 0.3509545661509037, + 0.6494905296713114, + 2.338051243685186, + 0.5151486210525036, + 0.5373066700994968, + 0.41789630241692066 + ], + "unique_experts": 63, + "load_cv": 0.546192725264341, + "normalized_load_entropy": 0.9657703205992612, + "max_load_share": 0.04220779220779221 + } + }, + "s0_bos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "2f51c87fed8507695344e4b19e2c3c9acb0c3c409b4fa80af0b45f7b8650cbe8", + "route_weight_sha256": "7ec24e840919d8c788a080f942350a1adaacd627948f8166208057756dd5e553", + "loads": [ + 15, + 14, + 8, + 10, + 34, + 19, + 11, + 6, + 8, + 5, + 15, + 9, + 30, + 12, + 10, + 4, + 8, + 29, + 11, + 1, + 3, + 7, + 8, + 16, + 9, + 6, + 6, + 7, + 14, + 12, + 6, + 4, + 17, + 5, + 9, + 8, + 10, + 7, + 8, + 12, + 6, + 25, + 6, + 12, + 19, + 15, + 0, + 5, + 8, + 5, + 4, + 12, + 7, + 28, + 12, + 10, + 6, + 3, + 8, + 12, + 12, + 11, + 7, + 12 + ], + "weighted_loads": [ + 0.7152804527431726, + 0.5589262451976538, + 0.3474535644054413, + 0.7207947783172131, + 2.892183570191264, + 1.1567206680774689, + 1.5629153586924076, + 0.22314751520752907, + 0.4694678131490946, + 0.3030474800616503, + 1.6729147639125586, + 0.4070074427872896, + 3.2734591364860535, + 1.5080807209014893, + 0.4380401112139225, + 0.3335467278957367, + 0.45449623838067055, + 2.441060170531273, + 0.6893465649336576, + 0.036687400192022324, + 0.12402983754873276, + 0.33323824405670166, + 0.5370253659784794, + 0.8592742420732975, + 0.547044426202774, + 0.19784537889063358, + 0.2195751741528511, + 0.5326546467840672, + 1.437293142080307, + 0.4239931870251894, + 0.22955762967467308, + 0.13529561832547188, + 1.8046920150518417, + 0.16792254708707333, + 0.31090428680181503, + 0.4929381310939789, + 0.8494970481842756, + 0.24690407887101173, + 0.2861459730193019, + 0.691660588607192, + 0.26874126493930817, + 2.3286472465842962, + 0.35645192489027977, + 2.530594954267144, + 1.0266258902847767, + 1.0508533418178558, + 0.0, + 0.20175953023135662, + 0.26712217926979065, + 0.2549427505582571, + 0.18422409519553185, + 0.5552366259507835, + 0.20561117585748434, + 2.033874113112688, + 0.5499410349875689, + 0.5377946887165308, + 0.24037770554423332, + 0.10485407151281834, + 0.32495576702058315, + 0.5473509449511766, + 0.8569371337071061, + 0.44564513489603996, + 0.4454679302871227, + 0.5642310678958893 + ], + "unique_experts": 63, + "load_cv": 0.6392882350970672, + "normalized_load_entropy": 0.9560032107057901, + "max_load_share": 0.05014749262536873 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "9687833c2c5e0c6a8f3e2bead48a5923602b7dc62dd9da8efb2b2124af74fe52", + "route_weight_sha256": "14bed3c8169c4a568f2d11390c7c7b28aec24a90072b89339e58eef8c1798e4f", + "loads": [ + 15, + 15, + 8, + 18, + 42, + 23, + 16, + 12, + 8, + 5, + 16, + 10, + 33, + 12, + 10, + 10, + 9, + 30, + 21, + 1, + 6, + 7, + 16, + 16, + 9, + 13, + 9, + 7, + 14, + 14, + 7, + 5, + 17, + 7, + 10, + 8, + 12, + 10, + 9, + 13, + 7, + 27, + 9, + 16, + 30, + 15, + 1, + 6, + 9, + 5, + 12, + 12, + 7, + 34, + 12, + 13, + 6, + 8, + 8, + 12, + 23, + 14, + 7, + 12 + ], + "weighted_loads": [ + 0.7152804527431726, + 0.583053220063448, + 0.3474535644054413, + 1.3136735893785954, + 3.289436699822545, + 1.3195645567029715, + 1.7152496818453074, + 0.5545982103794813, + 0.4694678131490946, + 0.3030474800616503, + 1.706397632136941, + 1.0831165183335543, + 3.375106520950794, + 1.5080807209014893, + 0.4380401112139225, + 0.6374536231160164, + 0.4923499524593353, + 2.5039630830287933, + 1.5736314300447702, + 0.036687400192022324, + 0.22384017705917358, + 0.33323824405670166, + 1.0648916140198708, + 0.8592742420732975, + 0.547044426202774, + 0.6863502915948629, + 0.3227218668907881, + 0.5326546467840672, + 1.437293142080307, + 0.4890779070556164, + 0.2679041400551796, + 0.14890731032937765, + 1.8046920150518417, + 0.2598247416317463, + 0.35280682891607285, + 0.4929381310939789, + 0.8962604366242886, + 0.3316426984965801, + 0.6506644962355494, + 0.7349238190799952, + 0.31431031599640846, + 2.3811585577204823, + 0.527331380173564, + 2.750361366197467, + 1.40149194188416, + 1.0508533418178558, + 0.13811376690864563, + 0.21541334595531225, + 0.3027818165719509, + 0.2549427505582571, + 1.2783753648400307, + 0.5552366259507835, + 0.20561117585748434, + 2.360844559967518, + 0.5499410349875689, + 0.9754243325442076, + 0.24037770554423332, + 0.264388844370842, + 0.32495576702058315, + 0.5473509449511766, + 2.1313769770786166, + 0.6640994176268578, + 0.4454679302871227, + 0.5642310678958893 + ], + "unique_experts": 64, + "load_cv": 0.6090597791334602, + "normalized_load_entropy": 0.9605966523726593, + "max_load_share": 0.050724637681159424 + } + }, + "s1_bos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "1e47479ee85915d67c7278822e47fb659fa8db5edaa4b04adb8edd8af038e136", + "route_weight_sha256": "8d8906d7f3791ced78a50a4bd6079ee8b217d2be0342f1d926fb4638346d026b", + "loads": [ + 15, + 14, + 7, + 10, + 35, + 19, + 11, + 6, + 10, + 6, + 12, + 7, + 31, + 13, + 10, + 5, + 9, + 29, + 10, + 1, + 2, + 7, + 7, + 15, + 9, + 6, + 7, + 7, + 13, + 10, + 5, + 6, + 17, + 5, + 10, + 8, + 10, + 6, + 11, + 12, + 6, + 28, + 7, + 12, + 21, + 14, + 0, + 3, + 7, + 7, + 4, + 11, + 8, + 28, + 10, + 10, + 7, + 3, + 7, + 13, + 12, + 9, + 7, + 11 + ], + "weighted_loads": [ + 0.6891882810741663, + 0.5586270708590746, + 0.3220329796895385, + 0.7128060720860958, + 2.9392052926123142, + 1.1751119382679462, + 1.5954316183924675, + 0.22804053500294685, + 0.4788227314129472, + 0.3261699713766575, + 1.5434569735080004, + 0.33030401170253754, + 3.4388560224324465, + 1.5342317447066307, + 0.430431941524148, + 0.3544367738068104, + 0.47468830086290836, + 2.501428533345461, + 0.6288476847112179, + 0.03680837154388428, + 0.09282806888222694, + 0.3307183086872101, + 0.47941984236240387, + 0.8209651671350002, + 0.54695232398808, + 0.21022072434425354, + 0.2442810870707035, + 0.5372315123677254, + 1.4222039133310318, + 0.35750153101980686, + 0.20020882785320282, + 0.21185040846467018, + 1.754038518294692, + 0.17143219895660877, + 0.34409045800566673, + 0.49626465514302254, + 0.8535697441548109, + 0.23034586384892464, + 0.3640902601182461, + 0.6842045783996582, + 0.28094709664583206, + 2.3862347919493914, + 0.3862630445510149, + 2.570688819512725, + 1.092961834743619, + 1.035691635683179, + 0.0, + 0.1338503733277321, + 0.24217347986996174, + 0.3107139226049185, + 0.18821300566196442, + 0.5470416806638241, + 0.23750356771051884, + 1.8038901686668396, + 0.4887441098690033, + 0.5437148921191692, + 0.27015718445181847, + 0.10769130848348141, + 0.29966842755675316, + 0.5816137827932835, + 0.8429988427087665, + 0.4135462027043104, + 0.43398623168468475, + 0.6224540304392576 + ], + "unique_experts": 63, + "load_cv": 0.6571156491233984, + "normalized_load_entropy": 0.9544866715656688, + "max_load_share": 0.051622418879056046 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "f4a90a2aac21aea3eb8f40edeb0eadee8de22369a2b55605afb613678bc35e76", + "route_weight_sha256": "39d9707985fc8b7033027279351b0656680bd2542b881c6b4408603ebaabd83a", + "loads": [ + 19, + 16, + 7, + 21, + 43, + 25, + 13, + 14, + 10, + 8, + 15, + 7, + 33, + 14, + 11, + 19, + 14, + 30, + 20, + 2, + 7, + 8, + 19, + 17, + 10, + 19, + 9, + 8, + 13, + 14, + 5, + 7, + 18, + 6, + 12, + 10, + 13, + 13, + 13, + 17, + 10, + 30, + 10, + 19, + 34, + 15, + 0, + 4, + 7, + 12, + 17, + 11, + 8, + 38, + 11, + 21, + 8, + 11, + 8, + 16, + 24, + 12, + 8, + 11 + ], + "weighted_loads": [ + 0.8836881369352341, + 0.6084013171494007, + 0.3220329796895385, + 1.469937615096569, + 3.3603275939822197, + 1.445016510784626, + 1.6639988608658314, + 0.7488783877342939, + 0.4788227314129472, + 0.5586379580199718, + 1.6677796561270952, + 0.33030401170253754, + 3.5056226160377264, + 1.8179810270667076, + 0.49032183177769184, + 1.1677270159125328, + 0.7750589717179537, + 2.5715244822204113, + 1.6037419252097607, + 0.06932825595140457, + 0.2836488541215658, + 0.36656906083226204, + 1.2457264438271523, + 0.9939602129161358, + 0.5673888754099607, + 1.0508278273046017, + 0.309224471449852, + 0.574085608124733, + 1.4222039133310318, + 0.4701268598437309, + 0.20020882785320282, + 0.24257036484777927, + 1.8040371146053076, + 0.2339706141501665, + 0.4216711353510618, + 0.6734717823565006, + 0.9567006509751081, + 0.48880498483777046, + 0.7715975046157837, + 0.9304477274417877, + 0.4574459604918957, + 2.4758906196802855, + 0.5731189455837011, + 2.932517511770129, + 1.9206584766507149, + 1.1083784345537424, + 0.0, + 0.17170444503426552, + 0.24217347986996174, + 0.6429246235638857, + 1.8908124044537544, + 0.5470416806638241, + 0.23750356771051884, + 2.266347724944353, + 0.5206693150103092, + 1.6540851518511772, + 0.31567031517624855, + 0.6765540950000286, + 0.3356621600687504, + 0.6619941312819719, + 2.253015742637217, + 0.5936334114521742, + 0.49401335418224335, + 0.6224540304392576 + ], + "unique_experts": 63, + "load_cv": 0.5781935902570361, + "normalized_load_entropy": 0.9624842004261805, + "max_load_share": 0.046536796536796536 + } + }, + "s0_x": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "77272744960714b3d6900dfbede77d61eddc974248c902d8f308e32b9b7f8e69", + "route_weight_sha256": "a27d65831268f9e8bd8e67b239a0ab78144176c7721ff772b250e1f73a7f04f1", + "loads": [ + 12, + 13, + 8, + 9, + 36, + 21, + 11, + 5, + 11, + 4, + 14, + 10, + 27, + 13, + 10, + 5, + 8, + 27, + 10, + 1, + 3, + 7, + 7, + 14, + 9, + 7, + 7, + 7, + 14, + 9, + 5, + 4, + 20, + 6, + 9, + 8, + 9, + 7, + 9, + 11, + 8, + 27, + 6, + 11, + 19, + 15, + 0, + 5, + 8, + 6, + 5, + 10, + 8, + 26, + 11, + 12, + 6, + 5, + 8, + 13, + 12, + 10, + 8, + 12 + ], + "weighted_loads": [ + 0.6116918846964836, + 0.5338407903909683, + 0.3571406891569495, + 0.6631963588297367, + 2.891660165041685, + 1.3805909119546413, + 1.5375759415328503, + 0.18878763914108276, + 0.5283276359550655, + 0.2766998242586851, + 1.663412667810917, + 0.4207393638789654, + 3.316025462001562, + 1.5145889427512884, + 0.4422068763524294, + 0.3698909841477871, + 0.46739503741264343, + 2.412243992090225, + 0.6392217297106981, + 0.029461951926350594, + 0.12312322482466698, + 0.33537886291742325, + 0.5032723359763622, + 0.8004814460873604, + 0.5458150915801525, + 0.23871437087655067, + 0.2516409959644079, + 0.5342957675457001, + 1.4546994753181934, + 0.34965156577527523, + 0.19203126803040504, + 0.1531263031065464, + 1.9087414015084505, + 0.2048964500427246, + 0.2996447719633579, + 0.486879575997591, + 0.7993651144206524, + 0.25770118832588196, + 0.3001720807515085, + 0.65721720084548, + 0.33686302974820137, + 2.4002047441899776, + 0.35994474589824677, + 2.5826536267995834, + 1.081101244315505, + 1.0521283894777298, + 0.0, + 0.20596311055123806, + 0.2619721069931984, + 0.29954707995057106, + 0.2326780054718256, + 0.5474663861095905, + 0.2383298692293465, + 1.9330900833010674, + 0.5130299739539623, + 0.585194343701005, + 0.24070726707577705, + 0.16589348763227463, + 0.3201564271003008, + 0.5895409490913153, + 0.869496806524694, + 0.41860780492424965, + 0.4867228679358959, + 0.5663232319056988 + ], + "unique_experts": 63, + "load_cv": 0.6251947773869049, + "normalized_load_entropy": 0.9584596842265484, + "max_load_share": 0.05309734513274336 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "823dcb1f644fec5ac5973b226d89269bf943a23bab9b80407ac7d9dda1a92238", + "route_weight_sha256": "2af60edde193c423cdf98aa3e003f7541ae189a85931fd60e4b89b2b7c31cd92", + "loads": [ + 12, + 15, + 8, + 17, + 45, + 24, + 17, + 11, + 12, + 4, + 15, + 10, + 29, + 14, + 10, + 11, + 9, + 28, + 21, + 1, + 6, + 7, + 14, + 14, + 9, + 14, + 8, + 7, + 14, + 13, + 5, + 4, + 20, + 8, + 10, + 8, + 12, + 10, + 10, + 12, + 9, + 29, + 8, + 14, + 30, + 15, + 0, + 5, + 9, + 7, + 13, + 10, + 8, + 31, + 11, + 16, + 6, + 11, + 8, + 13, + 24, + 13, + 8, + 12 + ], + "weighted_loads": [ + 0.6116918846964836, + 0.5948664043098688, + 0.3571406891569495, + 1.256075169891119, + 3.412589877843857, + 1.4910872541368008, + 1.728589380159974, + 0.5036047473549843, + 0.5527191790752113, + 0.2766998242586851, + 1.6922340225428343, + 0.4207393638789654, + 3.374116126447916, + 1.5420579928904772, + 0.4422068763524294, + 0.6413872689008713, + 0.5052487514913082, + 2.4827102050185204, + 1.6241826619952917, + 0.029461951926350594, + 0.2229335643351078, + 0.33537886291742325, + 0.9442271292209625, + 0.8004814460873604, + 0.5458150915801525, + 0.7297106757760048, + 0.26908729784190655, + 0.5342957675457001, + 1.4546994753181934, + 0.4809028431773186, + 0.19203126803040504, + 0.1531263031065464, + 1.9087414015084505, + 0.3312069680541754, + 0.33652057126164436, + 0.486879575997591, + 0.8788120839744806, + 0.34243980795145035, + 0.664690603967756, + 0.7198746763169765, + 0.3688995838165283, + 2.4692037738859653, + 0.5061586275696754, + 2.7311806175857782, + 1.474477306008339, + 1.0521283894777298, + 0.0, + 0.20596311055123806, + 0.29763174429535866, + 0.337971493601799, + 1.2989868689328432, + 0.5474663861095905, + 0.2383298692293465, + 2.2123251147568226, + 0.5130299739539623, + 1.0398652981966734, + 0.24070726707577705, + 0.37276546470820904, + 0.3201564271003008, + 0.5895409490913153, + 2.3250119844451547, + 0.610356729477644, + 0.4867228679358959, + 0.5663232319056988 + ], + "unique_experts": 63, + "load_cv": 0.6061406387107756, + "normalized_load_entropy": 0.960185032429216, + "max_load_share": 0.05434782608695652 + } + }, + "s1_x": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "54ffe5727358f133f9519c7811b5234e5c619c779ef01c766ca1b640220636d0", + "route_weight_sha256": "4dc31f47459ee6bb873c1bdf805e4680ca89d730a42bdacdec904ba250a4e099", + "loads": [ + 13, + 14, + 7, + 10, + 39, + 29, + 11, + 7, + 11, + 6, + 13, + 7, + 28, + 13, + 8, + 5, + 10, + 31, + 11, + 1, + 2, + 8, + 6, + 14, + 8, + 7, + 5, + 7, + 13, + 9, + 5, + 6, + 17, + 5, + 9, + 8, + 10, + 7, + 10, + 11, + 3, + 27, + 6, + 12, + 21, + 14, + 0, + 5, + 7, + 7, + 5, + 10, + 6, + 25, + 10, + 9, + 6, + 5, + 5, + 13, + 13, + 9, + 8, + 11 + ], + "weighted_loads": [ + 0.6115936990827322, + 0.5679449122399092, + 0.2750238059088588, + 0.66702975705266, + 3.0642894878983498, + 1.8443847857415676, + 1.5801628269255161, + 0.25855477154254913, + 0.5380744026042521, + 0.33729702793061733, + 1.5930292587727308, + 0.33742234483361244, + 3.283916736021638, + 1.535808015614748, + 0.3647054061293602, + 0.35888809338212013, + 0.5530382096767426, + 2.582270096987486, + 0.6601564735174179, + 0.03295508027076721, + 0.08497709035873413, + 0.363790612667799, + 0.3769501503556967, + 0.7757518030703068, + 0.5008905194699764, + 0.24414629861712456, + 0.17924180999398232, + 0.5177941508591175, + 1.4280656091868877, + 0.3276703618466854, + 0.1863038819283247, + 0.22363187745213509, + 1.742045046761632, + 0.18897168524563313, + 0.3088805805891752, + 0.4893938675522804, + 0.84157426469028, + 0.2640537638217211, + 0.3479000460356474, + 0.6505600456148386, + 0.1691066212952137, + 2.383353315293789, + 0.3645809255540371, + 2.6087922379374504, + 1.1107718776911497, + 1.0277775060385466, + 0.0, + 0.20795896276831627, + 0.23821092955768108, + 0.2999904304742813, + 0.17692861706018448, + 0.5113208796828985, + 0.16839660797268152, + 1.6784184481948614, + 0.4645282384008169, + 0.4848477765917778, + 0.2343048993498087, + 0.18348263576626778, + 0.22900628298521042, + 0.5898136422038078, + 0.895983848720789, + 0.3929320462048054, + 0.4804496057331562, + 0.6280210837721825 + ], + "unique_experts": 63, + "load_cv": 0.6905868701946164, + "normalized_load_entropy": 0.951356154181656, + "max_load_share": 0.05752212389380531 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "3faaa96658d622a8c1eae46d215a7733b3f1370b8a4de57430d425a37a8906d9", + "route_weight_sha256": "ef10931d37b2f0b951272f68b7e1e007870e3d4e0ace299c0f32df15010ce27d", + "loads": [ + 17, + 15, + 7, + 22, + 50, + 36, + 14, + 13, + 11, + 8, + 15, + 7, + 31, + 14, + 9, + 17, + 16, + 32, + 22, + 2, + 5, + 9, + 17, + 16, + 10, + 19, + 6, + 10, + 13, + 14, + 5, + 8, + 18, + 6, + 13, + 10, + 13, + 16, + 12, + 16, + 6, + 28, + 8, + 17, + 35, + 15, + 0, + 5, + 7, + 11, + 18, + 10, + 6, + 34, + 11, + 20, + 7, + 13, + 6, + 16, + 26, + 11, + 9, + 11 + ], + "weighted_loads": [ + 0.8060935549438, + 0.5920718871057034, + 0.2750238059088588, + 1.4565012827515602, + 3.6630187071859837, + 2.1228293739259243, + 1.6881464719772339, + 0.678643150255084, + 0.5380744026042521, + 0.5697650145739317, + 1.6848261822015047, + 0.33742234483361244, + 3.3851186018437147, + 1.819557297974825, + 0.42459529638290405, + 1.084599930793047, + 0.9916602149605751, + 2.6550686918199062, + 1.7447587251663208, + 0.0654749646782875, + 0.19502695836126804, + 0.39964136481285095, + 1.0287508312612772, + 0.9487468488514423, + 0.5629372298717499, + 1.015868853777647, + 0.19668811187148094, + 0.6609153300523758, + 1.4280656091868877, + 0.47642201371490955, + 0.1863038819283247, + 0.2849343419075012, + 1.7920436430722475, + 0.23998360894620419, + 0.4458829239010811, + 0.6666009947657585, + 0.9447051715105772, + 0.6034117694944143, + 0.755407290533185, + 0.8803461622446775, + 0.3083977550268173, + 2.4378610365092754, + 0.5171904526650906, + 2.8525850996375084, + 1.9640394560992718, + 1.10046430490911, + 0.0, + 0.20795896276831627, + 0.23821092955768108, + 0.5402802415192127, + 1.7358598411083221, + 0.5113208796828985, + 0.16839660797268152, + 2.0551645662635565, + 0.49645344354212284, + 1.5685730315744877, + 0.2798180300742388, + 0.7680384442210197, + 0.26500001549720764, + 0.6701939906924963, + 2.3999345619231462, + 0.502081360667944, + 0.5404767282307148, + 0.6280210837721825 + ], + "unique_experts": 63, + "load_cv": 0.6268392289107669, + "normalized_load_entropy": 0.9573225595151663, + "max_load_share": 0.05411255411255411 + } + }, + "s0_period": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "86162931b016286549ceb0fba8e160fec0ea9519bf6e6d1cb12ec0639d03dcb1", + "route_weight_sha256": "04b3d4f6342b6612e62124f0a48ebdcd471caf8f28a7b64874955d3fcc43ec07", + "loads": [ + 13, + 13, + 8, + 10, + 33, + 24, + 10, + 7, + 8, + 4, + 14, + 7, + 29, + 13, + 11, + 5, + 8, + 28, + 10, + 2, + 3, + 6, + 7, + 14, + 8, + 6, + 8, + 7, + 14, + 12, + 5, + 3, + 20, + 6, + 9, + 8, + 10, + 8, + 9, + 11, + 7, + 27, + 6, + 11, + 21, + 14, + 0, + 6, + 8, + 7, + 6, + 11, + 6, + 26, + 12, + 11, + 6, + 3, + 7, + 13, + 12, + 9, + 8, + 10 + ], + "weighted_loads": [ + 0.6372822318226099, + 0.5398688595741987, + 0.3541309414431453, + 0.7015020474791527, + 2.827573072165251, + 1.4888597168028355, + 1.5340579897165298, + 0.2617754153907299, + 0.4384265895932913, + 0.2641379348933697, + 1.6352804824709892, + 0.32670953311026096, + 3.325628224760294, + 1.5274908188730478, + 0.46788783743977547, + 0.36340490356087685, + 0.46420175768435, + 2.445603657513857, + 0.6614208221435547, + 0.05340801924467087, + 0.12309559062123299, + 0.29735350608825684, + 0.5071759782731533, + 0.7836356777697802, + 0.49970515444874763, + 0.21071786805987358, + 0.29372046142816544, + 0.5385324470698833, + 1.4422663561999798, + 0.44133499450981617, + 0.18993601202964783, + 0.11402736231684685, + 1.8806442562490702, + 0.20544542372226715, + 0.302360650151968, + 0.49286121129989624, + 0.8324063271284103, + 0.28626816533505917, + 0.29657991230487823, + 0.6617018058896065, + 0.30172691494226456, + 2.373823754489422, + 0.3609127998352051, + 2.6077595353126526, + 1.1411702018231153, + 1.0241357553750277, + 0.0, + 0.22850119695067406, + 0.27011098340153694, + 0.33809018321335316, + 0.2724458575248718, + 0.5508384010754526, + 0.17857370525598526, + 1.9328432250767946, + 0.5503319501876831, + 0.5490590948611498, + 0.24470717459917068, + 0.10099703073501587, + 0.28168891929090023, + 0.5860029794275761, + 0.8543692147359252, + 0.3899067770689726, + 0.4887259937822819, + 0.48480249755084515 + ], + "unique_experts": 63, + "load_cv": 0.6351368802123226, + "normalized_load_entropy": 0.9571422693913767, + "max_load_share": 0.048672566371681415 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "7da3dee987491df36f061d415615c0de8ac08a564cd5cce55a1742e9f0e02faa", + "route_weight_sha256": "65b015dc7a28560d53d17cf0d2af4e17ced5fcbe3128a2a4e5d8fdc5b20c8500", + "loads": [ + 13, + 15, + 8, + 18, + 42, + 27, + 16, + 14, + 8, + 4, + 15, + 7, + 32, + 13, + 11, + 11, + 9, + 29, + 20, + 2, + 7, + 6, + 14, + 14, + 8, + 13, + 9, + 7, + 14, + 15, + 5, + 3, + 20, + 8, + 10, + 8, + 12, + 11, + 10, + 13, + 8, + 29, + 9, + 14, + 34, + 14, + 0, + 6, + 9, + 8, + 14, + 11, + 6, + 31, + 12, + 14, + 6, + 8, + 7, + 13, + 23, + 13, + 8, + 10 + ], + "weighted_loads": [ + 0.6372822318226099, + 0.6071208603680134, + 0.3541309414431453, + 1.294380858540535, + 3.272724822163582, + 1.5903237834572792, + 1.7474520932883024, + 0.7442254591733217, + 0.4384265895932913, + 0.2641379348933697, + 1.6681202128529549, + 0.32670953311026096, + 3.4295258969068527, + 1.5274908188730478, + 0.46788783743977547, + 0.6118440292775631, + 0.5020554717630148, + 2.5225998125970364, + 1.5457056872546673, + 0.05340801924467087, + 0.26842543855309486, + 0.29735350608825684, + 0.9538210146129131, + 0.7836356777697802, + 0.49970515444874763, + 0.7573461048305035, + 0.31116676330566406, + 0.5385324470698833, + 1.4422663561999798, + 0.541704710572958, + 0.18993601202964783, + 0.11402736231684685, + 1.8806442562490702, + 0.32016429118812084, + 0.33777160197496414, + 0.49286121129989624, + 0.8791697155684233, + 0.37100678496062756, + 0.6610984355211258, + 0.7682957910001278, + 0.3568846210837364, + 2.4452147260308266, + 0.5351905357092619, + 2.748155504465103, + 1.6049181744456291, + 1.0241357553750277, + 0.0, + 0.22850119695067406, + 0.3057706207036972, + 0.39802353642880917, + 1.3190668486058712, + 0.5508384010754526, + 0.17857370525598526, + 2.218560701236129, + 0.5503319501876831, + 0.9674832280725241, + 0.24470717459917068, + 0.25769722275435925, + 0.28168891929090023, + 0.5860029794275761, + 2.1288090581074357, + 0.622304180637002, + 0.4887259937822819, + 0.48480249755084515 + ], + "unique_experts": 63, + "load_cv": 0.6213506963897563, + "normalized_load_entropy": 0.9583628344819635, + "max_load_share": 0.050724637681159424 + } + }, + "s1_period": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "4836d900346123473fac7694fb71062408ea3aac7e3538430d813921dde56a99", + "route_weight_sha256": "770075a18617be6611c56c934d7db7ad1cab2056c43e5d7803d8f1430a8637dd", + "loads": [ + 13, + 11, + 9, + 10, + 39, + 33, + 10, + 7, + 10, + 5, + 14, + 5, + 27, + 12, + 9, + 5, + 10, + 29, + 11, + 2, + 3, + 8, + 6, + 15, + 8, + 9, + 4, + 7, + 13, + 10, + 5, + 4, + 19, + 6, + 12, + 8, + 10, + 7, + 9, + 11, + 2, + 27, + 6, + 12, + 19, + 14, + 0, + 5, + 6, + 9, + 3, + 10, + 8, + 23, + 11, + 8, + 6, + 4, + 6, + 13, + 13, + 9, + 8, + 11 + ], + "weighted_loads": [ + 0.6212623938918114, + 0.47736310213804245, + 0.3365529994480312, + 0.6624434608966112, + 3.1078417859971523, + 2.153358282521367, + 1.563451997935772, + 0.25560190714895725, + 0.4882493307814002, + 0.29856599122285843, + 1.6150238402187824, + 0.2621052786707878, + 3.258284291252494, + 1.52303727529943, + 0.3949936833232641, + 0.3374864384531975, + 0.5391483809798956, + 2.5152344591915607, + 0.649481788277626, + 0.04738103039562702, + 0.1203464176505804, + 0.3625299669802189, + 0.3601101730018854, + 0.7932642083615065, + 0.49335773289203644, + 0.2930599804967642, + 0.14822044223546982, + 0.5295158438384533, + 1.4223741367459297, + 0.3576078098267317, + 0.18757998943328857, + 0.14738715812563896, + 1.8162315040826797, + 0.19734418392181396, + 0.38553596660494804, + 0.4865443557500839, + 0.8287397027015686, + 0.2625712789595127, + 0.317069286480546, + 0.6507335416972637, + 0.12491874769330025, + 2.381767049431801, + 0.36411015316843987, + 2.5881865713745356, + 1.002664739266038, + 1.0238289590924978, + 0.0, + 0.21460429579019547, + 0.21252621710300446, + 0.37587567046284676, + 0.11167820170521736, + 0.5304708033800125, + 0.2266971431672573, + 1.5740424580872059, + 0.49527619034051895, + 0.449021402746439, + 0.2412033285945654, + 0.15591313131153584, + 0.2657324820756912, + 0.5931561104953289, + 0.8897833209484816, + 0.39811802096664906, + 0.4681897684931755, + 0.5940203722566366 + ], + "unique_experts": 63, + "load_cv": 0.6919966693300013, + "normalized_load_entropy": 0.951017730192851, + "max_load_share": 0.05752212389380531 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "e2ae7000a9b47428e58de2a11ed6ed9e3bc98deb5d7f9afbfaafe652d793c7c5", + "route_weight_sha256": "98d392baa6abba57843f1b264024a08fa0c87c07b1db66257096c19980e0b9d4", + "loads": [ + 17, + 12, + 9, + 21, + 49, + 39, + 13, + 14, + 10, + 7, + 16, + 5, + 30, + 13, + 10, + 16, + 16, + 30, + 21, + 3, + 7, + 9, + 17, + 17, + 9, + 23, + 5, + 9, + 13, + 14, + 5, + 5, + 20, + 7, + 15, + 10, + 13, + 18, + 11, + 16, + 6, + 29, + 8, + 17, + 33, + 15, + 0, + 5, + 6, + 14, + 16, + 10, + 8, + 32, + 12, + 20, + 7, + 11, + 7, + 16, + 26, + 12, + 9, + 11 + ], + "weighted_loads": [ + 0.8157622497528791, + 0.5014900770038366, + 0.3365529994480312, + 1.4195750039070845, + 3.595245774835348, + 2.390616411343217, + 1.674874883145094, + 0.7441005147993565, + 0.4882493307814002, + 0.5310339778661728, + 1.7068207636475563, + 0.2621052786707878, + 3.3666903246194124, + 1.8067865576595068, + 0.454883573576808, + 1.0298122838139534, + 0.8773045111447573, + 2.5881929360330105, + 1.6243760287761688, + 0.07990091480314732, + 0.27138175815343857, + 0.39838071912527084, + 1.032644895836711, + 0.966259254142642, + 0.5137942843139172, + 1.1838625874370337, + 0.16566674411296844, + 0.6376412995159626, + 1.4223741367459297, + 0.47023313865065575, + 0.18757998943328857, + 0.17810711450874805, + 1.8662301003932953, + 0.24684011563658714, + 0.4852174539119005, + 0.663751482963562, + 0.9318706095218658, + 0.6718408651649952, + 0.7245765309780836, + 0.8947495929896832, + 0.3045933283865452, + 2.4778470173478127, + 0.517301220446825, + 2.8338663559406996, + 1.8558161035180092, + 1.0965157579630613, + 0.0, + 0.21460429579019547, + 0.21252621710300446, + 0.7023411318659782, + 1.663522843271494, + 0.5304708033800125, + 0.2266971431672573, + 1.9404023997485638, + 0.5272013954818249, + 1.5462329722940922, + 0.2867164593189955, + 0.6947325672954321, + 0.30172621458768845, + 0.6735364589840174, + 2.3427034951746464, + 0.546966390684247, + 0.5282168909907341, + 0.5940203722566366 + ], + "unique_experts": 63, + "load_cv": 0.6202271328876285, + "normalized_load_entropy": 0.9579777460314823, + "max_load_share": 0.05303030303030303 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 113, + "ordered_topk_exact_tokens": 62, + "set_exact_tokens": 77, + "mean_set_jaccard": 0.90897597977244, + "mean_token_weighted_tv": 0.017232996246785717, + "aggregate_load_tv": 0.03392330383480826 + }, + "system_bos": { + "tokens": 113, + "ordered_topk_exact_tokens": 54, + "set_exact_tokens": 71, + "mean_set_jaccard": 0.8881163084702908, + "mean_token_weighted_tv": 0.022379976027620447, + "aggregate_load_tv": 0.038348082595870206 + }, + "system_x": { + "tokens": 113, + "ordered_topk_exact_tokens": 36, + "set_exact_tokens": 49, + "mean_set_jaccard": 0.8286978508217446, + "mean_token_weighted_tv": 0.03472565159003819, + "aggregate_load_tv": 0.05309734513274336 + }, + "system_period": { + "tokens": 113, + "ordered_topk_exact_tokens": 33, + "set_exact_tokens": 49, + "mean_set_jaccard": 0.8234302570585758, + "mean_token_weighted_tv": 0.03596648824425925, + "aggregate_load_tv": 0.06047197640117995 + }, + "bos_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 49, + "set_exact_tokens": 66, + "mean_set_jaccard": 0.877370417193426, + "mean_token_weighted_tv": 0.025542346855411225, + "aggregate_load_tv": 0.04867256637168142 + }, + "bos_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 48, + "set_exact_tokens": 66, + "mean_set_jaccard": 0.8716814159292036, + "mean_token_weighted_tv": 0.028190439684415418, + "aggregate_load_tv": 0.04424778761061947 + }, + "x_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 50, + "set_exact_tokens": 66, + "mean_set_jaccard": 0.8683101559207754, + "mean_token_weighted_tv": 0.026559856823291136, + "aggregate_load_tv": 0.045722713864306784 + }, + "x_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 37, + "set_exact_tokens": 50, + "mean_set_jaccard": 0.8198482932996207, + "mean_token_weighted_tv": 0.03754679502639095, + "aggregate_load_tv": 0.06342182890855456 + }, + "period_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 49, + "set_exact_tokens": 68, + "mean_set_jaccard": 0.8786346396965866, + "mean_token_weighted_tv": 0.02514066770507962, + "aggregate_load_tv": 0.04424778761061947 + }, + "period_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 40, + "set_exact_tokens": 51, + "mean_set_jaccard": 0.8246944795617364, + "mean_token_weighted_tv": 0.038146204055509475, + "aggregate_load_tv": 0.06489675516224189 + } + } + }, + "layer_21": { + "layer": 21, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "2b252e6f7b977da1f92cdb95916c001561d9b82e79cb1e858328810a685e78d0", + "route_weight_sha256": "46167e743e19a96b514e08f20d48865d5e0d7bda1625749eb62e803dbf5970f3", + "loads": [ + 17, + 11, + 15, + 6, + 6, + 7, + 8, + 14, + 13, + 6, + 20, + 10, + 14, + 4, + 2, + 4, + 3, + 14, + 19, + 25, + 8, + 7, + 16, + 10, + 12, + 9, + 12, + 0, + 6, + 8, + 31, + 23, + 4, + 7, + 2, + 0, + 7, + 12, + 9, + 5, + 5, + 11, + 15, + 3, + 4, + 10, + 16, + 13, + 23, + 9, + 8, + 14, + 18, + 22, + 4, + 16, + 10, + 5, + 9, + 7, + 12, + 30, + 4, + 4 + ], + "weighted_loads": [ + 0.7036740668118, + 1.0581659656018019, + 1.1580993505194783, + 0.6522097289562225, + 0.263705488294363, + 0.39525948092341423, + 0.4059264063835144, + 2.1257400158792734, + 0.6296234615147114, + 0.5681930091232061, + 1.5030624326318502, + 0.4392616041004658, + 1.1882850211113691, + 0.17127656191587448, + 0.07806726172566414, + 0.1700026299804449, + 0.1259545348584652, + 1.3850944954901934, + 1.3858141116797924, + 0.9071520157158375, + 0.5336713120341301, + 0.667534701526165, + 1.0711629409343004, + 0.487365385517478, + 0.9907606244087219, + 0.3884617816656828, + 0.6286954041570425, + 0.0, + 0.2199063077569008, + 0.6859280467033386, + 3.8059105426073074, + 1.010208056308329, + 0.1783692017197609, + 0.3228747546672821, + 0.07819516584277153, + 0.0, + 0.34976390190422535, + 0.802344836294651, + 0.6635448634624481, + 0.19062522426247597, + 0.21022302471101284, + 0.5274159722030163, + 0.8882268033921719, + 0.3582672197371721, + 0.17803311720490456, + 0.3936790693551302, + 1.3961565773934126, + 0.9668685235083103, + 1.029977997764945, + 0.6128685250878334, + 0.609472494572401, + 0.9227129276841879, + 1.2748167533427477, + 1.282160671427846, + 0.15643754042685032, + 1.6995912063866854, + 1.271782048046589, + 0.46944141760468483, + 0.35913082771003246, + 1.0019216239452362, + 0.5428833365440369, + 3.4663774706423283, + 0.15004366263747215, + 0.2099389974027872 + ], + "unique_experts": 62, + "load_cv": 0.6418963104603301, + "normalized_load_entropy": 0.9507058237017265, + "max_load_share": 0.045722713864306784 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "2f6cc74f1ff054744c003b7c9a8a6fc178b807f8d60dbc25d41a96690ff703c9", + "route_weight_sha256": "4cab09bb0da54b192a005b90df9942ee43135e71793467fc0c74b23dd51221f1", + "loads": [ + 17, + 12, + 18, + 6, + 13, + 7, + 11, + 14, + 15, + 6, + 29, + 10, + 19, + 9, + 4, + 10, + 5, + 17, + 20, + 28, + 8, + 14, + 16, + 11, + 12, + 10, + 20, + 5, + 9, + 8, + 33, + 23, + 5, + 7, + 3, + 10, + 7, + 12, + 9, + 7, + 6, + 11, + 18, + 3, + 4, + 10, + 16, + 13, + 37, + 10, + 8, + 21, + 28, + 23, + 8, + 19, + 11, + 5, + 13, + 9, + 12, + 32, + 8, + 4 + ], + "weighted_loads": [ + 0.7036740668118, + 1.1012782473117113, + 1.231386121129617, + 0.6522097289562225, + 0.5206451248377562, + 0.39525948092341423, + 0.6551690921187401, + 2.1257400158792734, + 0.7632911913096905, + 0.5681930091232061, + 1.9828958865255117, + 0.4392616041004658, + 1.4056804720312357, + 0.4884115420281887, + 0.16955874115228653, + 0.36659861356019974, + 0.17569336853921413, + 1.4710508496500552, + 1.435907982289791, + 2.428895141929388, + 0.5336713120341301, + 1.1010281089693308, + 1.0711629409343004, + 0.5324922855943441, + 0.9907606244087219, + 0.424605680629611, + 0.9992099534720182, + 0.4941320903599262, + 0.28021790413185954, + 0.6859280467033386, + 3.9442822225391865, + 1.010208056308329, + 0.20121771469712257, + 0.3228747546672821, + 0.12707333639264107, + 0.5778346601873636, + 0.34976390190422535, + 0.802344836294651, + 0.6635448634624481, + 0.27255965769290924, + 0.26381452940404415, + 0.5274159722030163, + 1.0775885432958603, + 0.3582672197371721, + 0.17803311720490456, + 0.3936790693551302, + 1.3961565773934126, + 0.9668685235083103, + 1.7457025591284037, + 0.737825982272625, + 0.609472494572401, + 1.2420369032770395, + 1.9040898885577917, + 1.295172043144703, + 0.2843864103779197, + 1.973747344687581, + 1.3127949200570583, + 0.46944141760468483, + 0.5192513130605221, + 1.0724510252475739, + 0.5428833365440369, + 3.5845682732760906, + 0.3206421919167042, + 0.2099389974027872 + ], + "unique_experts": 64, + "load_cv": 0.5983906473977038, + "normalized_load_entropy": 0.9607187905674157, + "max_load_share": 0.04468599033816425 + } + }, + "s1_eos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "c65c69f852de4373a9f89b4a40754ea9738099020962dd651e5e7cb22e7c31d9", + "route_weight_sha256": "99ac84890409e4355aef2ebfab1526402755924d2051c8d56c45be976e12e525", + "loads": [ + 17, + 10, + 15, + 7, + 7, + 7, + 8, + 13, + 12, + 6, + 20, + 10, + 15, + 3, + 2, + 4, + 2, + 14, + 20, + 26, + 8, + 8, + 15, + 9, + 12, + 10, + 12, + 0, + 7, + 8, + 31, + 18, + 4, + 4, + 2, + 0, + 6, + 13, + 9, + 5, + 6, + 11, + 16, + 3, + 4, + 13, + 16, + 13, + 24, + 10, + 8, + 12, + 20, + 23, + 5, + 16, + 10, + 4, + 10, + 6, + 12, + 30, + 3, + 4 + ], + "weighted_loads": [ + 0.7260330766439438, + 1.0228882115334272, + 1.1757649332284927, + 0.7014345936477184, + 0.317869883030653, + 0.37589733488857746, + 0.4107625652104616, + 2.0882038194686174, + 0.5895669981837273, + 0.5671276524662971, + 1.5154481306672096, + 0.44098713248968124, + 1.2515685856342316, + 0.13383767753839493, + 0.07483746856451035, + 0.1678796075284481, + 0.08676058799028397, + 1.368769096210599, + 1.3877740986645222, + 0.9636184293776751, + 0.5312576498836279, + 0.7139394916594028, + 1.055791575461626, + 0.4498806782066822, + 0.9720153920352459, + 0.4222425054758787, + 0.6055270545184612, + 0.0, + 0.23974736221134663, + 0.6822957433760166, + 3.7747241258621216, + 0.8249610057100654, + 0.17700987681746483, + 0.2080216407775879, + 0.08752188086509705, + 0.0, + 0.31909414380788803, + 0.8328089155256748, + 0.6599517948925495, + 0.19185758754611015, + 0.23954624868929386, + 0.5197621434926987, + 0.9284762386232615, + 0.36726467311382294, + 0.17545568197965622, + 0.4927063658833504, + 1.371787704527378, + 0.9714044742286205, + 1.084583468735218, + 0.6466332711279392, + 0.6005570720881224, + 0.910568755120039, + 1.359496222808957, + 1.2752796337008476, + 0.19151877611875534, + 1.6737255547195673, + 1.2582107074558735, + 0.42588132433593273, + 0.3964429497718811, + 0.9433370940387249, + 0.5395517144352198, + 3.5379881635308266, + 0.11047955974936485, + 0.21508699841797352 + ], + "unique_experts": 62, + "load_cv": 0.650086190622402, + "normalized_load_entropy": 0.9490055852765861, + "max_load_share": 0.045722713864306784 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "193db4eebf85ee2157f69758a22528103a12fc4822ed4b348565b059e1928782", + "route_weight_sha256": "f15e55ccc3935476d251054314a9d91b5f1cae38c282248753546d8039843098", + "loads": [ + 26, + 12, + 18, + 7, + 7, + 8, + 13, + 14, + 16, + 9, + 31, + 10, + 20, + 13, + 10, + 7, + 4, + 22, + 22, + 30, + 9, + 18, + 16, + 14, + 13, + 12, + 20, + 8, + 10, + 9, + 36, + 18, + 5, + 8, + 2, + 18, + 7, + 14, + 10, + 5, + 6, + 13, + 25, + 3, + 5, + 14, + 16, + 13, + 37, + 14, + 9, + 22, + 30, + 24, + 17, + 26, + 15, + 4, + 13, + 10, + 13, + 33, + 6, + 5 + ], + "weighted_loads": [ + 1.277364132925868, + 1.1031816471368074, + 1.869390720501542, + 0.7014345936477184, + 0.317869883030653, + 0.39129644725471735, + 0.6576383132487535, + 2.1703685987740755, + 0.7943314909934998, + 0.7434910554438829, + 2.0464170202612877, + 0.44098713248968124, + 1.4971306137740612, + 0.7295217663049698, + 0.3958623856306076, + 0.255981826223433, + 0.13485191948711872, + 1.6489125355146825, + 1.4410670958459377, + 2.5009805765002966, + 0.5795619171112776, + 1.246652954723686, + 1.0858995709568262, + 0.9377779345959425, + 1.0082206055521965, + 0.4996047802269459, + 0.899195458739996, + 0.7930489405989647, + 0.2751897284761071, + 0.731393177062273, + 4.03053998015821, + 0.8249610057100654, + 0.1997333224862814, + 0.8035734444856644, + 0.08752188086509705, + 0.9654335658997297, + 0.3899565488100052, + 0.873615175485611, + 0.7118697725236416, + 0.19185758754611015, + 0.23954624868929386, + 0.6445150300860405, + 1.3707526121288538, + 0.36726467311382294, + 0.236747395247221, + 0.550501961261034, + 1.371787704527378, + 0.9714044742286205, + 1.9931633956730366, + 1.5928405597805977, + 0.6543328817933798, + 1.6266976408660412, + 1.954905552789569, + 1.2882910054177046, + 0.8968725437298417, + 2.301791476085782, + 1.4637911915779114, + 0.42588132433593273, + 0.5250996295362711, + 1.140639642253518, + 0.561940161511302, + 3.7071130014955997, + 0.22712887451052666, + 0.3017688114196062 + ], + "unique_experts": 64, + "load_cv": 0.5767657091991808, + "normalized_load_entropy": 0.9616307906541239, + "max_load_share": 0.04004329004329004 + } + }, + "s0_bos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "9b714229af2ea9022315b3d5dfa51d23edd7c9cb65af0d13b18d2c9b24cfbb63", + "route_weight_sha256": "c5095c8e7a0ade31be8779451c1601de1c635e18ab0ec5f7bcf3d0f4437cf926", + "loads": [ + 18, + 10, + 16, + 6, + 6, + 7, + 6, + 12, + 13, + 6, + 21, + 10, + 14, + 5, + 2, + 4, + 3, + 14, + 20, + 22, + 8, + 7, + 15, + 9, + 12, + 13, + 11, + 1, + 5, + 9, + 31, + 22, + 2, + 6, + 2, + 0, + 7, + 12, + 9, + 5, + 6, + 11, + 16, + 3, + 4, + 12, + 18, + 14, + 22, + 8, + 9, + 13, + 17, + 28, + 4, + 16, + 9, + 5, + 9, + 6, + 10, + 30, + 3, + 4 + ], + "weighted_loads": [ + 0.7718486301600933, + 1.035841683857143, + 1.150883355177939, + 0.6409434080123901, + 0.26041264086961746, + 0.4114123061299324, + 0.345179945230484, + 2.0800513550639153, + 0.6422350704669952, + 0.5808901246637106, + 1.5169578902423382, + 0.428450383245945, + 1.186854314059019, + 0.24436426535248756, + 0.07423286139965057, + 0.16771924309432507, + 0.12093400955200195, + 1.4020247235894203, + 1.4309146106243134, + 0.8066104985773563, + 0.5586230903863907, + 0.6663991585373878, + 1.0552392899990082, + 0.44832993671298027, + 0.9926519133150578, + 0.5347369257360697, + 0.5870502833276987, + 0.03557770699262619, + 0.18896079156547785, + 0.7265173867344856, + 4.007658068090677, + 0.9633134379982948, + 0.1052979938685894, + 0.28195893950760365, + 0.08536920323967934, + 0.0, + 0.356865506619215, + 0.7981018014252186, + 0.6575335189700127, + 0.19299956783652306, + 0.23948865942656994, + 0.530247587710619, + 0.8865359546616673, + 0.3881918881088495, + 0.17136656120419502, + 0.4674561023712158, + 1.5130647402256727, + 1.0231698714196682, + 0.9853425715118647, + 0.5449361987411976, + 0.6478089988231659, + 0.8655473943799734, + 1.2667069248855114, + 1.4917349070310593, + 0.15327597595751286, + 1.649431822821498, + 1.228685948997736, + 0.4494636803865433, + 0.358768105506897, + 0.939405657351017, + 0.472539059817791, + 3.490307904779911, + 0.11275143548846245, + 0.20995660312473774 + ], + "unique_experts": 63, + "load_cv": 0.6585971009665047, + "normalized_load_entropy": 0.9490202265743142, + "max_load_share": 0.045722713864306784 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "55c0f8ed5c1eea4c2b9ddbe82a6d95ca8a81460c1f9b251b2b106c6f3960ac24", + "route_weight_sha256": "30dad3ea47af2233cb9b8dd7d3ee721dfa168a6c1f6a23e05c419c8b45fb7f48", + "loads": [ + 18, + 12, + 18, + 7, + 12, + 7, + 8, + 12, + 16, + 6, + 28, + 10, + 19, + 10, + 5, + 9, + 5, + 16, + 22, + 24, + 8, + 13, + 15, + 10, + 12, + 14, + 19, + 6, + 7, + 9, + 33, + 24, + 3, + 6, + 3, + 10, + 7, + 12, + 9, + 8, + 8, + 11, + 19, + 3, + 4, + 13, + 18, + 14, + 35, + 9, + 9, + 20, + 27, + 29, + 8, + 20, + 10, + 5, + 11, + 8, + 10, + 33, + 8, + 4 + ], + "weighted_loads": [ + 0.7718486301600933, + 1.1198327532038093, + 1.2216320736333728, + 0.8413521498441696, + 0.48186529241502285, + 0.4114123061299324, + 0.5298273600637913, + 2.0800513550639153, + 0.8095948249101639, + 0.5808901246637106, + 1.8867009580135345, + 0.428450383245945, + 1.40094462223351, + 0.5583337843418121, + 0.20726525411009789, + 0.34835959412157536, + 0.17309715412557125, + 1.4839384444057941, + 1.5363138616085052, + 1.3860494904220104, + 0.5586230903863907, + 1.0983794862404466, + 1.0552392899990082, + 0.4934568367898464, + 0.9926519133150578, + 0.5708808246999979, + 0.9575648326426744, + 0.5370080694556236, + 0.2448524972423911, + 0.7265173867344856, + 4.15739207342267, + 1.121938779950142, + 0.12814650684595108, + 0.28195893950760365, + 0.13424737378954887, + 0.5778346601873636, + 0.356865506619215, + 0.7981018014252186, + 0.6575335189700127, + 0.3094700761139393, + 0.37042143009603024, + 0.530247587710619, + 1.0758976945653558, + 0.3881918881088495, + 0.17136656120419502, + 0.5652915313839912, + 1.5130647402256727, + 1.0231698714196682, + 1.655291235074401, + 0.6698936559259892, + 0.6478089988231659, + 1.184871369972825, + 1.8959800601005554, + 1.5047462787479162, + 0.2812248459085822, + 1.9469414055347443, + 1.2696988210082054, + 0.4494636803865433, + 0.4192373435944319, + 1.0099350586533546, + 0.472539059817791, + 3.6455895379185677, + 0.3413870744407177, + 0.20995660312473774 + ], + "unique_experts": 64, + "load_cv": 0.5999486547145312, + "normalized_load_entropy": 0.9602848558221505, + "max_load_share": 0.042270531400966184 + } + }, + "s1_bos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "e246e5ad9d13b3b12fb0f8c629da57b6a71b5358e3bd969ae72eb5d14186db9e", + "route_weight_sha256": "b86b3eb87b2b546c916c30f46c0f919fe429202998dc97ce975afc3e4197df88", + "loads": [ + 19, + 11, + 15, + 6, + 7, + 10, + 8, + 13, + 13, + 6, + 20, + 9, + 17, + 6, + 2, + 4, + 2, + 13, + 17, + 23, + 8, + 7, + 16, + 8, + 12, + 11, + 10, + 0, + 6, + 9, + 31, + 20, + 2, + 5, + 2, + 0, + 6, + 13, + 9, + 5, + 4, + 11, + 15, + 3, + 4, + 12, + 19, + 13, + 22, + 8, + 9, + 12, + 18, + 24, + 5, + 16, + 10, + 6, + 10, + 6, + 12, + 31, + 3, + 4 + ], + "weighted_loads": [ + 0.8150116112083197, + 1.0706785768270493, + 1.1797457188367844, + 0.6656684689223766, + 0.2966809459030628, + 0.533270388841629, + 0.3892149031162262, + 2.0804705433547497, + 0.6307046338915825, + 0.5733412560075521, + 1.4916677605360746, + 0.39147841557860374, + 1.3161228951066732, + 0.2424482498317957, + 0.07618752121925354, + 0.16195496544241905, + 0.08654515445232391, + 1.3602490574121475, + 1.3154352754354477, + 0.8731433860957623, + 0.5602129586040974, + 0.6535698287189007, + 1.096831489354372, + 0.3955223187804222, + 1.0081911459565163, + 0.47079029120504856, + 0.5611027218401432, + 0.0, + 0.21217653155326843, + 0.71975352242589, + 3.858652364462614, + 0.8640876235440373, + 0.10221928358078003, + 0.23999459110200405, + 0.0831122100353241, + 0.0, + 0.32679084315896034, + 0.8506738357245922, + 0.6726385839283466, + 0.18883945420384407, + 0.16576096788048744, + 0.5079584885388613, + 0.8534679505974054, + 0.4258090239018202, + 0.17043321020901203, + 0.46931598521769047, + 1.5261327382177114, + 0.9772400707006454, + 0.991727476939559, + 0.5435986444354057, + 0.6388122551143169, + 0.8865452259778976, + 1.2637494429945946, + 1.3402714300900698, + 0.1879056990146637, + 1.6010792944580317, + 1.255460076034069, + 0.49029574170708656, + 0.4156952239573002, + 0.9164804071187973, + 0.5407529249787331, + 3.620056577026844, + 0.11868399009108543, + 0.22282898053526878 + ], + "unique_experts": 62, + "load_cv": 0.6464351232865075, + "normalized_load_entropy": 0.949318389134653, + "max_load_share": 0.045722713864306784 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "e78f7c69870f4081291e3eb30280abe203c0ae046b2e9c5a6b8b7c8d8e580962", + "route_weight_sha256": "51685212a001eceeac7da650a957df72cefc14949ee9b9fb1b8b249437223f68", + "loads": [ + 28, + 13, + 18, + 6, + 9, + 11, + 13, + 15, + 17, + 9, + 28, + 10, + 22, + 15, + 9, + 7, + 4, + 19, + 20, + 26, + 9, + 16, + 17, + 13, + 13, + 13, + 18, + 10, + 9, + 10, + 37, + 21, + 3, + 9, + 2, + 17, + 7, + 14, + 10, + 8, + 5, + 13, + 24, + 3, + 5, + 13, + 19, + 13, + 34, + 12, + 10, + 22, + 28, + 25, + 16, + 26, + 14, + 6, + 11, + 10, + 13, + 34, + 8, + 5 + ], + "weighted_loads": [ + 1.3660336583852768, + 1.1610484682023525, + 1.9133576024323702, + 0.6656684689223766, + 0.3670838847756386, + 0.5486695012077689, + 0.6595990620553493, + 2.199024397879839, + 0.8485013023018837, + 0.7497046589851379, + 1.9315145295113325, + 0.42948174849152565, + 1.5565735176205635, + 0.8042206298559904, + 0.3819085657596588, + 0.282726988196373, + 0.1349861677736044, + 1.5944003127515316, + 1.4322683364152908, + 1.4703357219696045, + 0.608517225831747, + 1.1801375346258283, + 1.1269394848495722, + 0.8834195751696825, + 1.0443963594734669, + 0.5481525659561157, + 0.8547711260616779, + 0.9136567674577236, + 0.27297058515250683, + 0.7688509561121464, + 4.148228140547872, + 0.9581625433638692, + 0.1249427292495966, + 0.8355463948100805, + 0.0831122100353241, + 0.9363676831126213, + 0.3976532481610775, + 0.8914800956845284, + 0.7245565615594387, + 0.2942022494971752, + 0.21013549715280533, + 0.6327113751322031, + 1.301034426316619, + 0.4258090239018202, + 0.2317249234765768, + 0.5271115805953741, + 1.5261327382177114, + 0.9772400707006454, + 1.8732840921729803, + 1.572514433413744, + 0.6925880648195744, + 1.6026741117238998, + 1.8591587729752064, + 1.3532828018069267, + 0.8602424236014485, + 2.245516212657094, + 1.417016141116619, + 0.49029574170708656, + 0.4406632650643587, + 1.1137829553335905, + 0.5631413720548153, + 3.80472145229578, + 0.3398223780095577, + 0.3095107935369015 + ], + "unique_experts": 64, + "load_cv": 0.5509752908309398, + "normalized_load_entropy": 0.9646477839233996, + "max_load_share": 0.04004329004329004 + } + }, + "s0_x": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "629fcab8ab877e2eb7dedc0dda77c8916c05bfdd60709ada02016bac4d52a01d", + "route_weight_sha256": "8871c90d6a503921e95793f23d8292287c3ddce5b44dbad00ac7f6595a2f689e", + "loads": [ + 17, + 12, + 14, + 6, + 6, + 5, + 5, + 14, + 11, + 6, + 18, + 9, + 14, + 3, + 2, + 4, + 3, + 14, + 21, + 21, + 8, + 8, + 15, + 8, + 12, + 13, + 11, + 0, + 7, + 9, + 33, + 23, + 3, + 5, + 1, + 0, + 7, + 12, + 9, + 5, + 7, + 11, + 17, + 3, + 4, + 13, + 18, + 13, + 23, + 7, + 9, + 12, + 18, + 32, + 5, + 16, + 8, + 4, + 10, + 7, + 11, + 30, + 2, + 4 + ], + "weighted_loads": [ + 0.7473902609199286, + 1.0990842720493674, + 1.1076917359605432, + 0.6670963652431965, + 0.26413678377866745, + 0.3362768366932869, + 0.30178842321038246, + 2.1751260552555323, + 0.5793935209512711, + 0.5847317632287741, + 1.426359748467803, + 0.3894842267036438, + 1.14378073066473, + 0.14722131937742233, + 0.07242414355278015, + 0.16538903303444386, + 0.11934585496783257, + 1.3965580947697163, + 1.4298788607120514, + 0.7810210064053535, + 0.5485133901238441, + 0.6739459931850433, + 1.0427971854805946, + 0.44598977640271187, + 1.0065918117761612, + 0.5122153703123331, + 0.5907064285129309, + 0.0, + 0.25181494001299143, + 0.7499261610209942, + 4.141757819801569, + 1.00415672454983, + 0.1453358195722103, + 0.24560505524277687, + 0.038556307554244995, + 0.0, + 0.3674146868288517, + 0.8067007251083851, + 0.6443157978355885, + 0.1843319647014141, + 0.2934107631444931, + 0.5332070142030716, + 0.935031889937818, + 0.36004173941910267, + 0.18922946974635124, + 0.5161323733627796, + 1.5055636391043663, + 0.9738351404666901, + 0.990578219294548, + 0.5096824802458286, + 0.5983690246939659, + 0.8213621824979782, + 1.3084669150412083, + 1.6582766063511372, + 0.19173500500619411, + 1.725119449198246, + 1.1942149847745895, + 0.47758181765675545, + 0.38822992891073227, + 0.9690415151417255, + 0.4904113281518221, + 3.5267056971788406, + 0.07458597049117088, + 0.18979857303202152 + ], + "unique_experts": 62, + "load_cv": 0.689981788761798, + "normalized_load_entropy": 0.9441215988902374, + "max_load_share": 0.048672566371681415 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "90422ae6e5c35f837103b5eb6edcaf73e2b124dcc8aa4298b5e7ae7370095735", + "route_weight_sha256": "7a4aacf2d59fccf018e23d58dd0225e74d2b51e0eb4d529ec170c577b73b4276", + "loads": [ + 17, + 13, + 16, + 6, + 12, + 5, + 8, + 14, + 13, + 6, + 28, + 9, + 20, + 7, + 5, + 8, + 5, + 18, + 22, + 23, + 8, + 13, + 15, + 9, + 12, + 14, + 19, + 5, + 10, + 9, + 35, + 23, + 4, + 5, + 2, + 11, + 7, + 12, + 9, + 6, + 8, + 11, + 22, + 3, + 4, + 13, + 18, + 13, + 39, + 9, + 9, + 19, + 29, + 33, + 9, + 19, + 10, + 4, + 11, + 9, + 11, + 32, + 6, + 4 + ], + "weighted_loads": [ + 0.7473902609199286, + 1.1337103201076388, + 1.178440454415977, + 0.6670963652431965, + 0.48558943532407284, + 0.3362768366932869, + 0.5343606472015381, + 2.1751260552555323, + 0.7196847945451736, + 0.5847317632287741, + 1.9236088786274195, + 0.3894842267036438, + 1.4092005640268326, + 0.4161101430654526, + 0.188653614372015, + 0.31200470589101315, + 0.16949274949729443, + 1.5476675145328045, + 1.4728697389364243, + 1.3604599982500076, + 0.5485133901238441, + 1.0639276253059506, + 1.0427971854805946, + 0.491116676479578, + 1.0065918117761612, + 0.5483592692762613, + 0.9612209778279066, + 0.494839821010828, + 0.3499867422506213, + 0.7499261610209942, + 4.293386436998844, + 1.00415672454983, + 0.168184332549572, + 0.24560505524277687, + 0.08743447810411453, + 0.6732313949614763, + 0.3674146868288517, + 0.8067007251083851, + 0.6443157978355885, + 0.22426464408636093, + 0.3324612192809582, + 0.5332070142030716, + 1.2141142701730132, + 0.36004173941910267, + 0.18922946974635124, + 0.5161323733627796, + 1.5055636391043663, + 0.9738351404666901, + 1.8223524410277605, + 0.6984411887824535, + 0.5983690246939659, + 1.1406861580908298, + 2.127379424870014, + 1.6712879780679941, + 0.31968387495726347, + 1.9971931241452694, + 1.2813746556639671, + 0.47758181765675545, + 0.4128906633704901, + 1.0395709164440632, + 0.4904113281518221, + 3.6530414521694183, + 0.23259497806429863, + 0.18979857303202152 + ], + "unique_experts": 64, + "load_cv": 0.6408754718302988, + "normalized_load_entropy": 0.9553735780738233, + "max_load_share": 0.04710144927536232 + } + }, + "s1_x": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "bccc161451ed9a53f8b8104e4a47390432a5cb62e70b010103d1075dd0faeef3", + "route_weight_sha256": "bc062f1db04e1304b70a9b5b98dd01ea457dcc91d83b80dd8d6b0729d77af003", + "loads": [ + 18, + 12, + 18, + 7, + 7, + 10, + 6, + 15, + 11, + 6, + 20, + 9, + 14, + 4, + 2, + 3, + 4, + 14, + 17, + 28, + 8, + 6, + 15, + 10, + 12, + 11, + 10, + 0, + 7, + 9, + 31, + 17, + 3, + 3, + 1, + 0, + 6, + 12, + 9, + 3, + 5, + 11, + 17, + 3, + 4, + 7, + 18, + 13, + 24, + 7, + 8, + 12, + 17, + 34, + 4, + 16, + 9, + 6, + 9, + 8, + 10, + 32, + 3, + 3 + ], + "weighted_loads": [ + 0.7843876127153635, + 1.1101789865642786, + 1.2416220735758543, + 0.7285437323153019, + 0.311415895819664, + 0.523720633238554, + 0.31864840909838676, + 2.0935631040483713, + 0.5445523522794247, + 0.5779508985579014, + 1.5043826568871737, + 0.4038066416978836, + 1.2067520190030336, + 0.1699051521718502, + 0.06973185762763023, + 0.1288544051349163, + 0.15714797005057335, + 1.3893485758453608, + 1.2810858897864819, + 1.0735246259719133, + 0.5454824529588223, + 0.5977600067853928, + 1.003146581351757, + 0.5431775189936161, + 1.0061021223664284, + 0.45673450641334057, + 0.5270547308027744, + 0.0, + 0.25302241556346416, + 0.7133479006588459, + 3.7746046110987663, + 0.7231069002300501, + 0.13048101402819157, + 0.16821351274847984, + 0.03795845806598663, + 0.0, + 0.34340694546699524, + 0.821590568870306, + 0.6609804779291153, + 0.09877759963274002, + 0.20155347511172295, + 0.5165025368332863, + 0.9769416367635131, + 0.3922599758952856, + 0.17602046951651573, + 0.26826703175902367, + 1.486422535032034, + 0.9451723378151655, + 1.1289558410644531, + 0.4760631062090397, + 0.5812957305461168, + 0.8718326985836029, + 1.236719835549593, + 1.7406978327780962, + 0.13944785110652447, + 1.6585619449615479, + 1.247030958533287, + 0.4912101197987795, + 0.3552051167935133, + 0.9412438962608576, + 0.44451090320944786, + 3.683461509644985, + 0.11023636534810066, + 0.17697127163410187 + ], + "unique_experts": 62, + "load_cv": 0.7110490821007417, + "normalized_load_entropy": 0.9418739803715294, + "max_load_share": 0.05014749262536873 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "f9412eb0460c9b73186f685f44e2a21056196614137c8d1f7c9c330709243360", + "route_weight_sha256": "8b26b6b562f16598cace7b8f21eb5cdc9a0b3ebfdec3837d0d85bd69033bcdbb", + "loads": [ + 27, + 13, + 20, + 8, + 7, + 11, + 10, + 16, + 14, + 9, + 30, + 9, + 21, + 13, + 9, + 6, + 6, + 19, + 19, + 32, + 9, + 14, + 16, + 16, + 13, + 16, + 18, + 8, + 9, + 10, + 37, + 17, + 4, + 7, + 1, + 19, + 7, + 13, + 10, + 5, + 5, + 14, + 28, + 3, + 7, + 8, + 18, + 13, + 38, + 10, + 9, + 22, + 28, + 36, + 15, + 25, + 13, + 6, + 11, + 12, + 11, + 35, + 5, + 4 + ], + "weighted_loads": [ + 1.3295623399317265, + 1.1581522729247808, + 1.93258960172534, + 0.7614718116819859, + 0.311415895819664, + 0.5391197456046939, + 0.46702270582318306, + 2.1757278833538294, + 0.7124865353107452, + 0.7543143015354872, + 1.990146180614829, + 0.4038066416978836, + 1.5604233089834452, + 0.66907112672925, + 0.33843692392110825, + 0.24862969294190407, + 0.20550856925547123, + 1.59243137948215, + 1.3343788869678974, + 1.7003147266805172, + 0.5937867201864719, + 1.084874209947884, + 1.0332545768469572, + 1.0881651397794485, + 1.042307335883379, + 0.6566292531788349, + 0.8207231350243092, + 0.7869820073246956, + 0.2841218877583742, + 0.7624453343451023, + 4.059808084741235, + 0.7231069002300501, + 0.15320445969700813, + 0.7637653164565563, + 0.03795845806598663, + 1.0389614030718803, + 0.4142693504691124, + 0.8623968288302422, + 0.7128984555602074, + 0.1707974225282669, + 0.20155347511172295, + 0.7146736979484558, + 1.524869698099792, + 0.3922599758952856, + 0.32508915290236473, + 0.3260626271367073, + 1.486422535032034, + 0.9451723378151655, + 2.232801530510187, + 1.379888143390417, + 0.6350715402513742, + 1.587961584329605, + 2.0321834832429886, + 1.7888641841709614, + 0.8117845756933093, + 2.2793465182185173, + 1.408587023615837, + 0.4912101197987795, + 0.41517431288957596, + 1.1385464444756508, + 0.4668993502855301, + 3.8494879007339478, + 0.18133410811424255, + 0.26365308463573456 + ], + "unique_experts": 64, + "load_cv": 0.6147643419368224, + "normalized_load_entropy": 0.9575551343874064, + "max_load_share": 0.04112554112554113 + } + }, + "s0_period": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "fabfe1403095aae82985c5c88526d83b6d4e5c268a81178886b701bd1d60d47c", + "route_weight_sha256": "901ff10f965ebc55fa48382ca9a3b746e20ef3a5500eb86c0e83050b2410b3ac", + "loads": [ + 18, + 11, + 16, + 6, + 6, + 6, + 6, + 15, + 13, + 6, + 18, + 10, + 14, + 4, + 2, + 5, + 2, + 14, + 20, + 22, + 8, + 7, + 15, + 10, + 12, + 11, + 11, + 1, + 6, + 9, + 32, + 22, + 3, + 5, + 1, + 0, + 7, + 12, + 9, + 5, + 7, + 11, + 16, + 3, + 4, + 10, + 20, + 12, + 24, + 8, + 9, + 11, + 18, + 28, + 3, + 16, + 9, + 4, + 8, + 8, + 12, + 30, + 3, + 4 + ], + "weighted_loads": [ + 0.7727402560412884, + 1.0667872233316302, + 1.174811251461506, + 0.6742513030767441, + 0.2631511986255646, + 0.3717287816107273, + 0.34239552915096283, + 2.1897958256304264, + 0.6645540930330753, + 0.5836441479623318, + 1.4071485251188278, + 0.43328792601823807, + 1.151028174906969, + 0.19371522590517998, + 0.07350209727883339, + 0.19641463086009026, + 0.08351822197437286, + 1.3886246010661125, + 1.4096281081438065, + 0.8321629855781794, + 0.5491382069885731, + 0.6455216221511364, + 1.0542227979749441, + 0.5045669488608837, + 0.9861478209495544, + 0.4652871657162905, + 0.597605012357235, + 0.025647150352597237, + 0.2241181582212448, + 0.73783028870821, + 4.0407280549407005, + 0.9917452083900571, + 0.1453365832567215, + 0.2368803545832634, + 0.035286128520965576, + 0.0, + 0.37336285784840584, + 0.8221718594431877, + 0.6540024057030678, + 0.18965303525328636, + 0.2933900076895952, + 0.5278158076107502, + 0.9079059129580855, + 0.379931865260005, + 0.18974311277270317, + 0.40488307923078537, + 1.5734551008790731, + 0.9450068734586239, + 1.0539868641644716, + 0.5379583463072777, + 0.5920358821749687, + 0.7996091395616531, + 1.286563541740179, + 1.5136845745146275, + 0.10785119608044624, + 1.7245451007038355, + 1.231638077646494, + 0.4847807474434376, + 0.34510741010308266, + 1.0238384883850813, + 0.5155056957155466, + 3.5382123216986656, + 0.10730809345841408, + 0.1895631831139326 + ], + "unique_experts": 63, + "load_cv": 0.6705385255035886, + "normalized_load_entropy": 0.9470658953807266, + "max_load_share": 0.0471976401179941 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "fd355cbd76775196227d594676768d0ed9e1f7b00932e0529e35ff2ca9067c48", + "route_weight_sha256": "ebb23289f39b0dc84799146d369016180c78c043840bac8c8e2436934d25902e", + "loads": [ + 18, + 12, + 18, + 6, + 14, + 6, + 9, + 15, + 15, + 6, + 25, + 10, + 20, + 9, + 5, + 10, + 3, + 18, + 22, + 24, + 8, + 12, + 15, + 11, + 12, + 12, + 19, + 6, + 9, + 9, + 34, + 22, + 4, + 5, + 2, + 11, + 7, + 12, + 9, + 6, + 7, + 11, + 20, + 3, + 4, + 10, + 20, + 12, + 37, + 10, + 9, + 19, + 28, + 29, + 7, + 21, + 10, + 4, + 10, + 12, + 12, + 32, + 7, + 4 + ], + "weighted_loads": [ + 0.7727402560412884, + 1.102100103162229, + 1.2455599699169397, + 0.6742513030767441, + 0.5575823169201612, + 0.3717287816107273, + 0.607901506125927, + 2.1897958256304264, + 0.8007307834923267, + 0.5836441479623318, + 1.7850069664418697, + 0.43328792601823807, + 1.4328871667385101, + 0.4813134968280792, + 0.19986893609166145, + 0.39615678787231445, + 0.09678754396736622, + 1.5425706394016743, + 1.4950079545378685, + 1.4116019774228334, + 0.5491382069885731, + 1.0355032542720437, + 1.0542227979749441, + 0.5496938489377499, + 0.9861478209495544, + 0.5014310646802187, + 0.9681195616722107, + 0.49840432219207287, + 0.3202566560357809, + 0.73783028870821, + 4.200451001524925, + 0.9917452083900571, + 0.16818509623408318, + 0.2368803545832634, + 0.08416429907083511, + 0.6350622233003378, + 0.37336285784840584, + 0.8221718594431877, + 0.6540024057030678, + 0.2295614778995514, + 0.2933900076895952, + 0.5278158076107502, + 1.145390204153955, + 0.379931865260005, + 0.18974311277270317, + 0.40488307923078537, + 1.5734551008790731, + 0.9450068734586239, + 1.7565844859927893, + 0.7853118255734444, + 0.5920358821749687, + 1.1756592392921448, + 1.915836676955223, + 1.5266959462314844, + 0.2358000660315156, + 2.120456440374255, + 1.2726509496569633, + 0.4847807474434376, + 0.40168206207454205, + 1.2301568146795034, + 0.5155056957155466, + 3.6639786921441555, + 0.2861597202718258, + 0.1895631831139326 + ], + "unique_experts": 64, + "load_cv": 0.6121175192392103, + "normalized_load_entropy": 0.9580692564616076, + "max_load_share": 0.04468599033816425 + } + }, + "s1_period": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "bb24992034283b4056e56ea697d3710e9fc984f9e12c2fa629aa5fa1af669aed", + "route_weight_sha256": "852389932ff8f3ef2029a544d71ca1fa5889df56c554cb8621d4d5dd746912c3", + "loads": [ + 18, + 12, + 17, + 7, + 8, + 11, + 7, + 13, + 11, + 6, + 19, + 9, + 14, + 4, + 1, + 3, + 4, + 14, + 18, + 28, + 8, + 6, + 16, + 11, + 12, + 11, + 10, + 0, + 6, + 10, + 31, + 19, + 2, + 3, + 1, + 0, + 7, + 13, + 9, + 1, + 4, + 12, + 16, + 3, + 4, + 7, + 16, + 12, + 22, + 8, + 9, + 13, + 18, + 30, + 3, + 16, + 10, + 6, + 10, + 7, + 12, + 33, + 3, + 4 + ], + "weighted_loads": [ + 0.7826808709651232, + 1.107405537739396, + 1.2146985288709402, + 0.7227014526724815, + 0.35791920125484467, + 0.5595651417970657, + 0.34992849081754684, + 2.026542814448476, + 0.5533712804317474, + 0.5746583826839924, + 1.491788025945425, + 0.4034540355205536, + 1.1957901939749718, + 0.17367584630846977, + 0.03532404825091362, + 0.12874500267207623, + 0.1623917780816555, + 1.3697662819176912, + 1.3134152553975582, + 1.0912055559456348, + 0.5334936007857323, + 0.5948781110346317, + 1.054789075627923, + 0.628183776512742, + 0.982996266335249, + 0.4624491557478905, + 0.5331623777747154, + 0.0, + 0.2255171686410904, + 0.7513921819627285, + 3.716106627136469, + 0.8039356023073196, + 0.09538566693663597, + 0.17101228795945644, + 0.03541649505496025, + 0.0, + 0.3868064135313034, + 0.8627918809652328, + 0.6728960946202278, + 0.03298738971352577, + 0.16405373811721802, + 0.5477710328996181, + 0.9099141089245677, + 0.4421357102692127, + 0.17664671689271927, + 0.2528562005609274, + 1.4151024147868156, + 0.8947110958397388, + 0.977677034214139, + 0.5212689265608788, + 0.59331632591784, + 0.8546905778348446, + 1.2582514937967062, + 1.584622859954834, + 0.11118392273783684, + 1.694509258493781, + 1.2911084741353989, + 0.49362785927951336, + 0.4057484529912472, + 0.9356211572885513, + 0.5275313854217529, + 3.7291129771620035, + 0.11825988441705704, + 0.2195402756333351 + ], + "unique_experts": 62, + "load_cv": 0.6982058486868735, + "normalized_load_entropy": 0.9414613369067674, + "max_load_share": 0.048672566371681415 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "eab2c94933bed356eb7b7ae6182a13b6dc199c5575960d4d205b55e54243b84f", + "route_weight_sha256": "4842bd006c27b0b708558302495546155499e316a8c0713642ab0d9e43294eba", + "loads": [ + 27, + 13, + 19, + 7, + 9, + 12, + 12, + 14, + 14, + 9, + 27, + 9, + 20, + 14, + 8, + 6, + 6, + 19, + 21, + 34, + 9, + 14, + 17, + 17, + 13, + 13, + 18, + 8, + 8, + 11, + 36, + 19, + 3, + 7, + 1, + 20, + 8, + 14, + 10, + 2, + 5, + 14, + 27, + 3, + 6, + 8, + 16, + 12, + 35, + 12, + 10, + 24, + 28, + 31, + 16, + 26, + 14, + 6, + 11, + 13, + 13, + 36, + 5, + 5 + ], + "weighted_loads": [ + 1.3246138989925385, + 1.1553788240998983, + 1.9056660570204258, + 0.7227014526724815, + 0.4021199122071266, + 0.5749642541632056, + 0.5569762885570526, + 2.108707593753934, + 0.71269316598773, + 0.7510217856615782, + 1.9262119121849537, + 0.4034540355205536, + 1.5291911996901035, + 0.7078243792057037, + 0.3274019956588745, + 0.25390094332396984, + 0.20691022276878357, + 1.5728490855544806, + 1.4091342389583588, + 1.7882702350616455, + 0.581797868013382, + 1.081992314197123, + 1.0848970711231232, + 1.1733813174068928, + 1.0192014798521996, + 0.5398114304989576, + 0.8268307819962502, + 0.7804790958762169, + 0.25661664083600044, + 0.8004896156489849, + 3.9569693077355623, + 0.8039356023073196, + 0.11810911260545254, + 0.7665640916675329, + 0.03541649505496025, + 1.0569332018494606, + 0.45766881853342056, + 0.903598140925169, + 0.7248140722513199, + 0.06262165307998657, + 0.19526942446827888, + 0.67252391949296, + 1.4779542675241828, + 0.4421357102692127, + 0.2747622951865196, + 0.31065179593861103, + 1.4151024147868156, + 0.8947110958397388, + 1.9229823183268309, + 1.5737053863704205, + 0.6470921356230974, + 1.631730068475008, + 1.853660823777318, + 1.597634231671691, + 0.8466546954587102, + 2.3712427262216806, + 1.452664539217949, + 0.49362785927951336, + 0.4307164940983057, + 1.2383564580231905, + 0.5499198324978352, + 3.878966147080064, + 0.19020681828260422, + 0.3062220886349678 + ], + "unique_experts": 64, + "load_cv": 0.5982019872801138, + "normalized_load_entropy": 0.9583962295468439, + "max_load_share": 0.03896103896103896 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 113, + "ordered_topk_exact_tokens": 66, + "set_exact_tokens": 79, + "mean_set_jaccard": 0.9087652760219133, + "mean_token_weighted_tv": 0.0187729542737052, + "aggregate_load_tv": 0.030973451327433628 + }, + "system_bos": { + "tokens": 113, + "ordered_topk_exact_tokens": 52, + "set_exact_tokens": 70, + "mean_set_jaccard": 0.8855878634639697, + "mean_token_weighted_tv": 0.0239225646637512, + "aggregate_load_tv": 0.038348082595870206 + }, + "system_x": { + "tokens": 113, + "ordered_topk_exact_tokens": 41, + "set_exact_tokens": 63, + "mean_set_jaccard": 0.8489254108723135, + "mean_token_weighted_tv": 0.034562589823210664, + "aggregate_load_tv": 0.05457227138643068 + }, + "system_period": { + "tokens": 113, + "ordered_topk_exact_tokens": 41, + "set_exact_tokens": 64, + "mean_set_jaccard": 0.8560893383902234, + "mean_token_weighted_tv": 0.03425914697777645, + "aggregate_load_tv": 0.05457227138643068 + }, + "bos_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 63, + "set_exact_tokens": 82, + "mean_set_jaccard": 0.9106616097766541, + "mean_token_weighted_tv": 0.022218868111680567, + "aggregate_load_tv": 0.03687315634218289 + }, + "bos_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 44, + "set_exact_tokens": 68, + "mean_set_jaccard": 0.8733670459334177, + "mean_token_weighted_tv": 0.027760981936502244, + "aggregate_load_tv": 0.038348082595870206 + }, + "x_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 47, + "set_exact_tokens": 67, + "mean_set_jaccard": 0.8727349346818374, + "mean_token_weighted_tv": 0.027413471424704895, + "aggregate_load_tv": 0.05014749262536873 + }, + "x_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 43, + "set_exact_tokens": 60, + "mean_set_jaccard": 0.8459755583649389, + "mean_token_weighted_tv": 0.0358596285969942, + "aggregate_load_tv": 0.0575221238938053 + }, + "period_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 45, + "set_exact_tokens": 69, + "mean_set_jaccard": 0.8789296249473242, + "mean_token_weighted_tv": 0.026905767796808377, + "aggregate_load_tv": 0.038348082595870206 + }, + "period_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 50, + "set_exact_tokens": 67, + "mean_set_jaccard": 0.8603034134007586, + "mean_token_weighted_tv": 0.03459210056745637, + "aggregate_load_tv": 0.05752212389380531 + } + } + }, + "layer_22": { + "layer": 22, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "7f2c13b0afde1acd2db9b5d38f79f6efef083130b99752a6602d45d9608f9ddc", + "route_weight_sha256": "b19876dbf371fc4a07122b679a326afe6468b7920618d5e72da263e3af04a71e", + "loads": [ + 23, + 17, + 9, + 12, + 4, + 7, + 7, + 6, + 32, + 7, + 24, + 16, + 21, + 9, + 4, + 11, + 18, + 9, + 11, + 11, + 13, + 6, + 5, + 9, + 2, + 1, + 3, + 7, + 8, + 4, + 6, + 8, + 11, + 20, + 9, + 6, + 14, + 11, + 10, + 6, + 4, + 8, + 14, + 5, + 41, + 9, + 7, + 7, + 0, + 12, + 14, + 7, + 4, + 10, + 3, + 10, + 11, + 22, + 9, + 15, + 5, + 29, + 4, + 11 + ], + "weighted_loads": [ + 2.125399261713028, + 0.6463698130100965, + 1.468717560172081, + 1.454757310450077, + 0.22029630467295647, + 0.2409614846110344, + 1.0276880767196417, + 0.2703419029712677, + 2.1631792187690735, + 0.43930509500205517, + 1.510054673999548, + 2.254868349060416, + 1.3145237118005753, + 0.4798885900527239, + 0.13597587123513222, + 0.4109351821243763, + 1.0871257074177265, + 0.8954645432531834, + 0.691674280911684, + 0.46015864238142967, + 0.7843165677040815, + 0.3502910491079092, + 0.17456350475549698, + 0.6464731507003307, + 0.11768829822540283, + 0.0330805741250515, + 0.12267431244254112, + 0.4404536671936512, + 0.3816222921013832, + 0.13637636974453926, + 0.23088889382779598, + 0.5996175035834312, + 0.49923528358340263, + 1.9159542620182037, + 0.7132026813924313, + 0.2832205183804035, + 1.0548827275633812, + 0.4659088924527168, + 0.8276583850383759, + 0.8332082964479923, + 0.14972471445798874, + 0.637323934584856, + 1.0123625881969929, + 0.22340548411011696, + 6.0948844365775585, + 0.4234863631427288, + 0.8851424306631088, + 0.4714876860380173, + 0.0, + 1.9213518612086773, + 0.47869694977998734, + 0.43038225546479225, + 0.11205075494945049, + 0.49212269857525826, + 0.08222251012921333, + 0.5495365839451551, + 0.8682771660387516, + 1.4893805384635925, + 0.46743451803922653, + 1.0438464898616076, + 0.4283268302679062, + 2.078779384493828, + 0.12203075736761093, + 0.4940088987350464 + ], + "unique_experts": 63, + "load_cv": 0.7035691972371629, + "normalized_load_entropy": 0.9481045150005163, + "max_load_share": 0.06047197640117994 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "07673773141e7bceb02170e90b5e6b23800d4797be5fc3d492aa6b6ac9ec2dfe", + "route_weight_sha256": "f4837c787d3df8149f2723d40448d65f8946d1e72ba6aca7cf8ddf98b07ae788", + "loads": [ + 27, + 18, + 11, + 21, + 4, + 9, + 11, + 7, + 45, + 12, + 24, + 18, + 21, + 9, + 10, + 11, + 18, + 10, + 11, + 11, + 13, + 13, + 6, + 10, + 2, + 3, + 3, + 11, + 8, + 4, + 6, + 8, + 13, + 27, + 11, + 10, + 14, + 13, + 10, + 6, + 8, + 9, + 18, + 5, + 43, + 11, + 8, + 7, + 3, + 14, + 17, + 7, + 5, + 12, + 3, + 24, + 14, + 25, + 10, + 15, + 13, + 37, + 4, + 17 + ], + "weighted_loads": [ + 2.302129856310785, + 0.6963264215737581, + 1.5494127720594406, + 3.326844923198223, + 0.22029630467295647, + 0.31344569101929665, + 1.2522597899660468, + 0.32277555018663406, + 3.347036262974143, + 0.6346625350415707, + 1.510054673999548, + 2.284192966297269, + 1.3145237118005753, + 0.4798885900527239, + 0.9050452332012355, + 0.4109351821243763, + 1.0871257074177265, + 0.9211988262832165, + 0.691674280911684, + 0.46015864238142967, + 0.7843165677040815, + 0.9482381213456392, + 0.20370755344629288, + 0.7089930586516857, + 0.11768829822540283, + 0.09729443490505219, + 0.12267431244254112, + 0.6040000077337027, + 0.3816222921013832, + 0.13637636974453926, + 0.23088889382779598, + 0.5996175035834312, + 0.5412293281406164, + 2.170619949698448, + 0.8204241991043091, + 0.4412112347781658, + 1.0548827275633812, + 0.5335799772292376, + 0.8276583850383759, + 0.8332082964479923, + 0.35761570557951927, + 0.7139199711382389, + 1.2776814438402653, + 0.22340548411011696, + 6.201179191470146, + 0.4925796873867512, + 0.9268524646759033, + 0.4714876860380173, + 0.14382335171103477, + 2.1102175898849964, + 0.6409892365336418, + 0.43038225546479225, + 0.14318331331014633, + 0.6077563688158989, + 0.08222251012921333, + 1.6791351474821568, + 0.9871603604406118, + 1.5945649817585945, + 0.5029229260981083, + 1.0438464898616076, + 1.53260712698102, + 2.3647091574966908, + 0.12203075736761093, + 0.7269982732832432 + ], + "unique_experts": 64, + "load_cv": 0.6782409124883682, + "normalized_load_entropy": 0.9525431268663964, + "max_load_share": 0.05434782608695652 + } + }, + "s1_eos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "33ae000686ddfbcde1e0ffa3d9e0d2f4d85354482ba16e8a3599e9e6916a2c2f", + "route_weight_sha256": "5a44283ec14e14a5382c6b5d0441d3383787bd26fc927c0191d4dd330b0070f1", + "loads": [ + 25, + 16, + 10, + 13, + 4, + 6, + 7, + 8, + 37, + 7, + 25, + 16, + 21, + 8, + 3, + 11, + 18, + 9, + 10, + 12, + 13, + 6, + 4, + 9, + 3, + 1, + 3, + 7, + 8, + 3, + 8, + 7, + 11, + 20, + 8, + 6, + 14, + 8, + 11, + 7, + 5, + 8, + 14, + 6, + 41, + 8, + 6, + 7, + 0, + 11, + 12, + 7, + 2, + 8, + 4, + 10, + 12, + 22, + 10, + 14, + 5, + 27, + 4, + 12 + ], + "weighted_loads": [ + 2.1691674180328846, + 0.5968665406107903, + 1.5336510073393583, + 1.4838433703407645, + 0.21247016079723835, + 0.20561417192220688, + 1.02564219199121, + 0.33275884203612804, + 2.235276399180293, + 0.4571441784501076, + 1.5110555402934551, + 2.267310969531536, + 1.3213303312659264, + 0.4561545364558697, + 0.12529315799474716, + 0.4035351313650608, + 1.0981014259159565, + 0.8860106877982616, + 0.6430290006101131, + 0.5186988897621632, + 0.7740597799420357, + 0.34924725256860256, + 0.13984757848083973, + 0.600837554782629, + 0.13545944914221764, + 0.033796437084674835, + 0.12643931061029434, + 0.4341496117413044, + 0.3975252825766802, + 0.09923088550567627, + 0.30266488529741764, + 0.5579613484442234, + 0.5057925172150135, + 1.9160307087004185, + 0.7183259315788746, + 0.26621267944574356, + 1.035615250468254, + 0.3662826642394066, + 0.860507857054472, + 0.8685357831418514, + 0.18517150729894638, + 0.6427539326250553, + 0.9861229732632637, + 0.25782094709575176, + 6.0347430016845465, + 0.3800390623509884, + 0.8466948643326759, + 0.47353947907686234, + 0.0, + 1.8788146264851093, + 0.4259342644363642, + 0.4231758303940296, + 0.059853533282876015, + 0.4322327896952629, + 0.11945709586143494, + 0.545558562502265, + 0.8861597720533609, + 1.5178405418992043, + 0.5074967537075281, + 1.0157261863350868, + 0.43322447314858437, + 1.9894524868577719, + 0.13547633402049541, + 0.532260574400425 + ], + "unique_experts": 63, + "load_cv": 0.7282671480096987, + "normalized_load_entropy": 0.9454672955249289, + "max_load_share": 0.06047197640117994 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "2c4520d347ec64cfce4a641c1d9af1c5a797b7c7da53929779871b76dfd8ad4c", + "route_weight_sha256": "4620bbc14342414db31063f55140f7c28f2ccc14f204357f2d4b94a6046efd02", + "loads": [ + 27, + 21, + 10, + 24, + 4, + 8, + 13, + 9, + 57, + 16, + 25, + 21, + 24, + 8, + 8, + 15, + 21, + 11, + 11, + 12, + 14, + 18, + 5, + 10, + 3, + 2, + 3, + 11, + 9, + 3, + 9, + 7, + 13, + 29, + 16, + 14, + 16, + 10, + 11, + 8, + 16, + 10, + 18, + 8, + 43, + 10, + 7, + 9, + 3, + 14, + 22, + 10, + 7, + 11, + 4, + 30, + 16, + 24, + 13, + 14, + 19, + 37, + 6, + 17 + ], + "weighted_loads": [ + 2.2908374881371856, + 1.0528149716556072, + 1.5336510073393583, + 3.6218181839212775, + 0.21247016079723835, + 0.2670662850141525, + 1.3363820184022188, + 0.3758385609835386, + 3.928538367152214, + 0.9221043158322573, + 1.5110555402934551, + 2.566453205421567, + 1.4610535614192486, + 0.4561545364558697, + 0.7979649659246206, + 0.6385427713394165, + 1.2441203780472279, + 0.9359273687005043, + 0.6829872727394104, + 0.5186988897621632, + 0.8232165053486824, + 1.3898310493677855, + 0.1827604677528143, + 0.661799967288971, + 0.13545944914221764, + 0.05929065681993961, + 0.12643931061029434, + 0.5901958271861076, + 0.4810879472643137, + 0.09923088550567627, + 0.36090523190796375, + 0.5579613484442234, + 0.5602418445050716, + 2.2413402814418077, + 1.0897841155529022, + 0.6202236674726009, + 1.126382753252983, + 0.4381201006472111, + 0.860507857054472, + 0.9079729951918125, + 0.8721690028905869, + 0.7295013405382633, + 1.297821570187807, + 0.393287917599082, + 6.109826574102044, + 0.4602787308394909, + 0.8811094351112843, + 0.5408977158367634, + 0.14514778554439545, + 2.3910026773810387, + 0.9149768836796284, + 0.6344785988330841, + 0.609351733699441, + 0.571904867887497, + 0.11945709586143494, + 2.2439712989144027, + 1.1118255089968443, + 1.5809563733637333, + 0.6106103658676147, + 1.0157261863350868, + 2.3387168273329735, + 2.413326980546117, + 0.20446200482547283, + 0.7647480554878712 + ], + "unique_experts": 64, + "load_cv": 0.6775272108046907, + "normalized_load_entropy": 0.952505957582771, + "max_load_share": 0.06168831168831169 + } + }, + "s0_bos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "b4c3ccacfc96cfd5eb4ae9b92311a029e64f5ac425f757541e7eec7790b1836f", + "route_weight_sha256": "f016e77cf416046720181ccc024c981dad7ec6bb42c3e8f46be072680ff1004e", + "loads": [ + 24, + 14, + 9, + 12, + 3, + 6, + 7, + 7, + 31, + 6, + 26, + 16, + 21, + 8, + 5, + 11, + 19, + 9, + 12, + 9, + 12, + 6, + 3, + 8, + 2, + 0, + 3, + 8, + 7, + 4, + 6, + 8, + 14, + 20, + 9, + 6, + 14, + 10, + 10, + 7, + 1, + 8, + 14, + 6, + 44, + 9, + 10, + 8, + 0, + 10, + 13, + 8, + 1, + 9, + 5, + 8, + 11, + 22, + 12, + 16, + 5, + 31, + 5, + 10 + ], + "weighted_loads": [ + 2.0768576096743345, + 0.5152727849781513, + 1.4796573612838984, + 1.4448043163865805, + 0.1831361185759306, + 0.21799442172050476, + 1.0452465638518333, + 0.31343272142112255, + 2.039202218875289, + 0.4245700128376484, + 1.542944671586156, + 2.1595106571912766, + 1.3278202190995216, + 0.46345869451761246, + 0.18280582875013351, + 0.4079754650592804, + 1.1318904906511307, + 0.9083348475396633, + 0.7255637608468533, + 0.390826940536499, + 0.7431978601962328, + 0.3226429522037506, + 0.09081321768462658, + 0.616190243512392, + 0.09515548124909401, + 0.0, + 0.12534744292497635, + 0.4582000896334648, + 0.34000073559582233, + 0.13770632818341255, + 0.24344263412058353, + 0.6006006319075823, + 0.6133643761277199, + 1.9696737192571163, + 0.7342096548527479, + 0.27229846082627773, + 1.0606747046113014, + 0.443075442686677, + 0.8323044143617153, + 0.8813495859503746, + 0.04261494427919388, + 0.619917381554842, + 1.003560595214367, + 0.2662094570696354, + 6.276626341044903, + 0.4215903412550688, + 1.0128853768110275, + 0.5207822397351265, + 0.0, + 1.7966118678450584, + 0.44836328364908695, + 0.46297242119908333, + 0.05649228021502495, + 0.48364894837141037, + 0.14575008675456047, + 0.4822809360921383, + 0.8610377833247185, + 1.4894057717174292, + 0.5953579805791378, + 1.0810059569776058, + 0.38432805240154266, + 2.3196329586207867, + 0.15627875179052353, + 0.45287853851914406 + ], + "unique_experts": 62, + "load_cv": 0.7420916696194871, + "normalized_load_entropy": 0.9415981848638463, + "max_load_share": 0.06489675516224189 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "cd449cb2af2be88790784e66cd3ba124da9d152f9e6928f9399f6cf8420d9372", + "route_weight_sha256": "678ec6d1354cd1dbb15fa864f7875e1a8902552894e68def6282d33b7505eacb", + "loads": [ + 28, + 14, + 11, + 20, + 3, + 7, + 11, + 8, + 43, + 11, + 27, + 18, + 21, + 8, + 8, + 12, + 19, + 10, + 12, + 9, + 12, + 13, + 4, + 9, + 3, + 2, + 3, + 13, + 7, + 4, + 6, + 8, + 15, + 27, + 11, + 11, + 14, + 13, + 10, + 7, + 5, + 9, + 19, + 6, + 46, + 10, + 11, + 8, + 4, + 12, + 15, + 8, + 1, + 11, + 5, + 21, + 14, + 26, + 13, + 16, + 14, + 39, + 5, + 18 + ], + "weighted_loads": [ + 2.2535882042720914, + 0.5152727849781513, + 1.560352573171258, + 2.4255435671657324, + 0.1831361185759306, + 0.23058537766337395, + 1.2871312983334064, + 1.239900914952159, + 3.181857578456402, + 0.6199274528771639, + 1.559725858271122, + 2.2036932706832886, + 1.3278202190995216, + 0.46345869451761246, + 0.8626250848174095, + 0.4511525146663189, + 1.1318904906511307, + 0.9340691305696964, + 0.7255637608468533, + 0.390826940536499, + 0.7431978601962328, + 0.9287151955068111, + 0.11995726637542248, + 0.6810137741267681, + 0.0990415511187166, + 0.06421386078000069, + 0.12534744292497635, + 0.6538243088871241, + 0.34000073559582233, + 0.13770632818341255, + 0.24344263412058353, + 0.6006006319075823, + 0.6488642022013664, + 2.2255050241947174, + 0.8380906786769629, + 0.5034336652606726, + 1.0606747046113014, + 0.5638749673962593, + 0.8323044143617153, + 0.8813495859503746, + 0.25249190628528595, + 0.6947006396949291, + 1.2039972757920623, + 0.2662094570696354, + 6.3951158337295055, + 0.45356845296919346, + 1.054595410823822, + 0.5207822397351265, + 0.24763204529881477, + 1.926893389550969, + 0.568482855334878, + 0.46297242119908333, + 0.05649228021502495, + 0.5936694405972958, + 0.14575008675456047, + 1.5899160588160157, + 0.9799209777265787, + 1.6014137999154627, + 0.6279277913272381, + 1.0810059569776058, + 1.579844567924738, + 2.6055627316236496, + 0.15627875179052353, + 0.7837051562964916 + ], + "unique_experts": 64, + "load_cv": 0.6989822335397847, + "normalized_load_entropy": 0.9494803233325129, + "max_load_share": 0.05555555555555555 + } + }, + "s1_bos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "5e47d393891319b4f645d8438034d684645b3024dd01a100d36828b5308778ef", + "route_weight_sha256": "2054500609da13929f09cfaaa0c18202f076da62e961d64aec2053f78cde1ebb", + "loads": [ + 23, + 12, + 9, + 12, + 3, + 6, + 6, + 7, + 32, + 7, + 24, + 16, + 21, + 9, + 4, + 10, + 19, + 9, + 10, + 9, + 12, + 6, + 4, + 8, + 2, + 1, + 4, + 9, + 8, + 2, + 7, + 7, + 14, + 19, + 9, + 7, + 14, + 9, + 11, + 8, + 2, + 8, + 13, + 6, + 44, + 10, + 8, + 8, + 0, + 11, + 10, + 9, + 1, + 11, + 7, + 9, + 12, + 23, + 12, + 16, + 5, + 28, + 4, + 12 + ], + "weighted_loads": [ + 2.0602710116654634, + 0.43175170570611954, + 1.5333829578012228, + 1.4556519342586398, + 0.17697983793914318, + 0.20741279050707817, + 0.98212069272995, + 0.3053679410368204, + 2.0296124555170536, + 0.48080219328403473, + 1.5116934943944216, + 2.1286025680601597, + 1.3348224349319935, + 0.46980202943086624, + 0.1465547550469637, + 0.35298522748053074, + 1.1427065916359425, + 0.9004936963319778, + 0.6622462831437588, + 0.40125085040926933, + 0.7268695887178183, + 0.3268041219562292, + 0.13665458746254444, + 0.5939875096082687, + 0.0943558868020773, + 0.034277111291885376, + 0.15100188180804253, + 0.47473436780273914, + 0.380316773429513, + 0.07731515541672707, + 0.2597018461674452, + 0.563637163490057, + 0.6057127360254526, + 1.806162403896451, + 0.7982051353901625, + 0.3039847929030657, + 1.0693172477185726, + 0.4000669773668051, + 0.8731513321399689, + 0.9026289079338312, + 0.07869809493422508, + 0.6229301430284977, + 0.9491547904908657, + 0.2753099575638771, + 6.275468165054917, + 0.4655618015676737, + 0.9268964901566505, + 0.5302815437316895, + 0.0, + 1.8535536639392376, + 0.36100627295672894, + 0.5118120387196541, + 0.04169423133134842, + 0.5644792020320892, + 0.22272672317922115, + 0.4896993227303028, + 0.9251561164855957, + 1.5916135050356388, + 0.5755341574549675, + 1.0823469907045364, + 0.4161715395748615, + 2.146503895521164, + 0.1376822330057621, + 0.5379106141626835 + ], + "unique_experts": 63, + "load_cv": 0.7198063240138198, + "normalized_load_entropy": 0.9457075566201073, + "max_load_share": 0.06489675516224189 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "33c6dbbbb9581204e489aa226551e2851166c1ce50b1d4b7652cf6b18a29aeb6", + "route_weight_sha256": "1eb0837f2a5f0bb44bc99560aa9de84c59782d5df9e0686a64364d1af36c6317", + "loads": [ + 25, + 17, + 9, + 22, + 3, + 7, + 11, + 8, + 52, + 16, + 24, + 22, + 24, + 9, + 8, + 15, + 22, + 11, + 11, + 9, + 13, + 18, + 5, + 9, + 2, + 2, + 4, + 12, + 9, + 2, + 8, + 7, + 16, + 28, + 17, + 16, + 16, + 12, + 11, + 9, + 13, + 10, + 18, + 8, + 46, + 10, + 9, + 10, + 5, + 14, + 19, + 12, + 6, + 15, + 7, + 29, + 16, + 26, + 13, + 16, + 20, + 38, + 5, + 18 + ], + "weighted_loads": [ + 2.1819410817697644, + 0.8877001367509365, + 1.5333829578012228, + 2.6989758713170886, + 0.17697983793914318, + 0.22000374644994736, + 1.2847253270447254, + 0.348447659984231, + 3.7107770275324583, + 0.9457623306661844, + 1.5116934943944216, + 2.492487460374832, + 1.4745456650853157, + 0.46980202943086624, + 0.8754787594079971, + 0.6292241457849741, + 1.2887255437672138, + 0.9504103772342205, + 0.702204555273056, + 0.40125085040926933, + 0.776026314124465, + 1.397438993677497, + 0.179567476734519, + 0.6562195308506489, + 0.0943558868020773, + 0.059771331027150154, + 0.15100188180804253, + 0.5967682767659426, + 0.4638794381171465, + 0.07731515541672707, + 0.3053428400307894, + 0.563637163490057, + 0.6959924716502428, + 2.1314719766378403, + 1.1685559544712305, + 0.711654556915164, + 1.1600847505033016, + 0.5152451265603304, + 0.8731513321399689, + 0.9420661199837923, + 0.7740847878158092, + 0.7213319316506386, + 1.2715342044830322, + 0.41077692806720734, + 6.367583701387048, + 0.4655618015676737, + 0.9613110609352589, + 0.5976397804915905, + 0.30726853013038635, + 2.3758253641426563, + 0.8068392798304558, + 0.7231148071587086, + 0.5911924317479134, + 0.7407002672553062, + 0.22272672317922115, + 2.2106671994552016, + 1.150821853429079, + 1.696744680404663, + 0.6232994012534618, + 1.0823469907045364, + 2.463726118206978, + 2.570378389209509, + 0.16650033369660378, + 0.8378045931458473 + ], + "unique_experts": 64, + "load_cv": 0.6586776048287512, + "normalized_load_entropy": 0.9541994478506421, + "max_load_share": 0.05627705627705628 + } + }, + "s0_x": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "fec1efe4c0a2a32409f6daa170d89dd63064f55ad8403dccca8b006114a65a35", + "route_weight_sha256": "d4c77344e7739fe84ee38daef98da0bff970d33db05d4f4d30e98c9b9a8a4a94", + "loads": [ + 24, + 13, + 10, + 12, + 3, + 7, + 6, + 7, + 30, + 6, + 24, + 16, + 21, + 8, + 4, + 9, + 18, + 10, + 11, + 9, + 12, + 6, + 4, + 8, + 2, + 1, + 4, + 9, + 7, + 2, + 7, + 8, + 13, + 20, + 8, + 8, + 14, + 7, + 10, + 6, + 3, + 8, + 14, + 7, + 44, + 8, + 8, + 9, + 1, + 11, + 13, + 9, + 1, + 10, + 6, + 11, + 11, + 21, + 11, + 16, + 5, + 31, + 5, + 11 + ], + "weighted_loads": [ + 2.0726051311939955, + 0.517648858949542, + 1.489731289446354, + 1.403750577941537, + 0.16200952976942062, + 0.24769942089915276, + 1.0245118588209152, + 0.315604817122221, + 2.1013059113174677, + 0.4322572611272335, + 1.4836170077323914, + 2.2330546770244837, + 1.3294119611382484, + 0.47726231813430786, + 0.13540924340486526, + 0.31570360623300076, + 1.0852502323687077, + 0.9401833862066269, + 0.6856849230825901, + 0.37833721935749054, + 0.7334555815905333, + 0.3248910326510668, + 0.13954950869083405, + 0.6365412324666977, + 0.09496859833598137, + 0.0365154966711998, + 0.16138275153934956, + 0.4930658470839262, + 0.3325343281030655, + 0.07675191760063171, + 0.2576957270503044, + 0.5908057931810617, + 0.5606579780578613, + 1.9777796436101198, + 0.6905197724699974, + 0.32932292111217976, + 1.0750507302582264, + 0.3180915042757988, + 0.8462690077722073, + 0.8357547298073769, + 0.12064855545759201, + 0.6224446222186089, + 0.9994448386132717, + 0.2982311248779297, + 6.312804980203509, + 0.38159093260765076, + 0.9448599368333817, + 0.5325681753456593, + 0.040556371212005615, + 1.844301626086235, + 0.45323263108730316, + 0.49373751506209373, + 0.02233874797821045, + 0.491841621696949, + 0.18388048000633717, + 0.5924828685820103, + 0.853124026209116, + 1.4802622310817242, + 0.5391479022800922, + 1.091165842488408, + 0.39240384846925735, + 2.3811833262443542, + 0.16897097043693066, + 0.4945768043398857 + ], + "unique_experts": 64, + "load_cv": 0.719225825195413, + "normalized_load_entropy": 0.9470590249132207, + "max_load_share": 0.06489675516224189 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "2a0c182fd35d7a12fc8b80dc77a85ca940a794e4ab134b07ea7765bac65235c2", + "route_weight_sha256": "5fd48ee9d12ebb3343b89946a2dd9ef2e1c9dc1f890cc98a9a052a55ddf212e5", + "loads": [ + 28, + 14, + 12, + 21, + 3, + 8, + 10, + 7, + 43, + 12, + 24, + 17, + 21, + 8, + 8, + 9, + 18, + 12, + 11, + 9, + 12, + 14, + 5, + 9, + 2, + 3, + 4, + 12, + 7, + 2, + 8, + 8, + 14, + 29, + 10, + 12, + 14, + 8, + 10, + 6, + 7, + 9, + 18, + 7, + 46, + 10, + 9, + 9, + 3, + 13, + 17, + 9, + 2, + 12, + 6, + 26, + 14, + 23, + 12, + 16, + 13, + 40, + 5, + 18 + ], + "weighted_loads": [ + 2.2493357257917523, + 0.5594485457986593, + 1.5704265013337135, + 2.4677005652338266, + 0.16200952976942062, + 0.26029037684202194, + 1.3076760210096836, + 0.315604817122221, + 3.2815739884972572, + 0.6596784461289644, + 1.4836170077323914, + 2.245509719476104, + 1.3294119611382484, + 0.47726231813430786, + 0.7906631976366043, + 0.31570360623300076, + 1.0852502323687077, + 1.0015103109180927, + 0.6856849230825901, + 0.37833721935749054, + 0.7334555815905333, + 0.9958437513560057, + 0.16869355738162994, + 0.6941921226680279, + 0.09496859833598137, + 0.10072935745120049, + 0.16138275153934956, + 0.6106689088046551, + 0.3325343281030655, + 0.07675191760063171, + 0.3018800877034664, + 0.5908057931810617, + 0.5961578041315079, + 2.3236423898488283, + 0.7996593415737152, + 0.4890174549072981, + 1.0750507302582264, + 0.35850078612565994, + 0.8462690077722073, + 0.8357547298073769, + 0.3359998017549515, + 0.7001971378922462, + 1.269109208136797, + 0.2982311248779297, + 6.428896168246865, + 0.448715265840292, + 0.9865699708461761, + 0.5325681753456593, + 0.13671700656414032, + 2.1024152487516403, + 0.6612329855561256, + 0.49373751506209373, + 0.05363057553768158, + 0.5831076689064503, + 0.18388048000633717, + 1.9123042533174157, + 0.9720072206109762, + 1.5367715787142515, + 0.5773385241627693, + 1.091165842488408, + 1.531665463000536, + 2.7215685695409775, + 0.16897097043693066, + 0.7627916298806667 + ], + "unique_experts": 64, + "load_cv": 0.7008494793928951, + "normalized_load_entropy": 0.9498554195920887, + "max_load_share": 0.05555555555555555 + } + }, + "s1_x": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "5856c7b4c2aa3e21260016403f079f1cbd270505d12b4bcbcceb1d384223378f", + "route_weight_sha256": "86656ec8332d234b80d52bede649ef16e2407457e0b1e461f7bdd8b297e54889", + "loads": [ + 25, + 7, + 10, + 12, + 3, + 6, + 6, + 5, + 34, + 5, + 24, + 16, + 22, + 11, + 4, + 7, + 20, + 8, + 10, + 9, + 11, + 6, + 2, + 10, + 3, + 1, + 4, + 8, + 7, + 1, + 8, + 7, + 11, + 18, + 9, + 6, + 14, + 8, + 11, + 8, + 4, + 8, + 12, + 7, + 44, + 7, + 10, + 9, + 0, + 11, + 10, + 9, + 1, + 10, + 7, + 16, + 11, + 23, + 9, + 16, + 5, + 34, + 3, + 15 + ], + "weighted_loads": [ + 2.155078962445259, + 0.2682105489075184, + 1.5310325603932142, + 1.4221312450245023, + 0.18567988090217113, + 0.20649483986198902, + 1.0261062383651733, + 0.22878142073750496, + 2.1034409683197737, + 0.41019435226917267, + 1.4641390349715948, + 2.1342726051807404, + 1.3847238421440125, + 0.5494155623018742, + 0.1386696621775627, + 0.23213055357336998, + 1.1233131773769855, + 0.8615086600184441, + 0.6690894328057766, + 0.37754400819540024, + 0.6759461984038353, + 0.3155802544206381, + 0.07965323328971863, + 0.6753849424421787, + 0.1366813573986292, + 0.04234215244650841, + 0.15036969631910324, + 0.43188816122710705, + 0.35199401527643204, + 0.03983170911669731, + 0.28362030163407326, + 0.5497581772506237, + 0.499587494879961, + 1.7839135639369488, + 0.7537009157240391, + 0.2310304157435894, + 1.0798906832933426, + 0.34024082124233246, + 0.8715222701430321, + 0.9041564241051674, + 0.18647590652108192, + 0.6090709902346134, + 0.8928232043981552, + 0.2956365514546633, + 6.19331144541502, + 0.3548574335873127, + 0.9786258041858673, + 0.544671218842268, + 0.0, + 1.8263345062732697, + 0.33998666144907475, + 0.49461983516812325, + 0.018639838322997093, + 0.5058716218918562, + 0.2560224439948797, + 0.7890438307076693, + 0.8527107574045658, + 1.61200993321836, + 0.43513137847185135, + 1.0867985486984253, + 0.3812962584197521, + 2.5409982427954674, + 0.12764529511332512, + 0.6303748954087496 + ], + "unique_experts": 63, + "load_cv": 0.7682709495999438, + "normalized_load_entropy": 0.9394832865585743, + "max_load_share": 0.06489675516224189 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "969ad110003ebd9d97c2c0174ccd8d6b5292950c8bca68642fb8b226341ba6c3", + "route_weight_sha256": "420df2763909ae9c636cd334abc85091fac3b4d6c4257c028f7ff6a3af0d951f", + "loads": [ + 28, + 12, + 10, + 23, + 3, + 7, + 12, + 7, + 56, + 15, + 24, + 21, + 25, + 11, + 8, + 11, + 23, + 10, + 11, + 9, + 12, + 19, + 3, + 11, + 3, + 2, + 4, + 10, + 8, + 1, + 8, + 7, + 13, + 27, + 17, + 13, + 16, + 9, + 11, + 9, + 16, + 10, + 16, + 9, + 45, + 7, + 11, + 11, + 2, + 14, + 21, + 12, + 6, + 13, + 7, + 39, + 15, + 25, + 11, + 16, + 19, + 46, + 5, + 19 + ], + "weighted_loads": [ + 2.3166766157373786, + 0.7241589799523354, + 1.5310325603932142, + 2.715373885817826, + 0.18567988090217113, + 0.2190857958048582, + 1.3708200193941593, + 0.31690792366862297, + 3.8703608363866806, + 0.9202994164079428, + 1.4641390349715948, + 2.4526851028203964, + 1.5244470722973347, + 0.5494155623018742, + 0.6763283628970385, + 0.4671381935477257, + 1.269332129508257, + 0.9114253409206867, + 0.7090477049350739, + 0.37754400819540024, + 0.725102923810482, + 1.4417666997760534, + 0.12256612256169319, + 0.7379429452121258, + 0.1366813573986292, + 0.06783637218177319, + 0.15036969631910324, + 0.51281245239079, + 0.43555667996406555, + 0.03983170911669731, + 0.28362030163407326, + 0.5497581772506237, + 0.5848558098077774, + 2.109223136678338, + 1.1310572139918804, + 0.5231305658817291, + 1.1706581860780716, + 0.3739784397184849, + 0.8715222701430321, + 0.9435936361551285, + 0.9076438173651695, + 0.680694468319416, + 1.2505807541310787, + 0.4311035219579935, + 6.232752826064825, + 0.3548574335873127, + 1.0130403749644756, + 0.612029455602169, + 0.09518440067768097, + 2.3648726642131805, + 0.8911322206258774, + 0.7059226036071777, + 0.568138038739562, + 0.637535871937871, + 0.2560224439948797, + 2.8448027772828937, + 1.0783764943480492, + 1.6751719620078802, + 0.5356951393187046, + 1.0867985486984253, + 2.310672588646412, + 3.1247082129120827, + 0.19653427600860596, + 0.8169269766658545 + ], + "unique_experts": 64, + "load_cv": 0.7297294108260223, + "normalized_load_entropy": 0.9457225184406989, + "max_load_share": 0.06060606060606061 + } + }, + "s0_period": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "7df761b127862fac65b2f4c16c266f48f30942e7ccc2c1f419f3d5cbed2c1b1b", + "route_weight_sha256": "ddd4c68a1977591355ae93a400c16836232a6768250cdd2061422c4b7c5f304a", + "loads": [ + 24, + 14, + 10, + 12, + 3, + 6, + 6, + 6, + 29, + 5, + 23, + 16, + 21, + 8, + 4, + 9, + 19, + 11, + 11, + 10, + 13, + 7, + 2, + 8, + 2, + 1, + 4, + 10, + 6, + 3, + 6, + 8, + 12, + 21, + 9, + 7, + 14, + 9, + 11, + 7, + 3, + 8, + 12, + 7, + 43, + 8, + 9, + 9, + 1, + 11, + 13, + 8, + 2, + 11, + 6, + 10, + 11, + 21, + 11, + 16, + 5, + 28, + 5, + 13 + ], + "weighted_loads": [ + 2.0884329341351986, + 0.5564757399260998, + 1.4875387959182262, + 1.4170807795599103, + 0.16826225444674492, + 0.22370611503720284, + 1.0047618299722672, + 0.29445173777639866, + 2.040344091132283, + 0.3934998922049999, + 1.4673462212085724, + 2.234721688553691, + 1.3253312893211842, + 0.47292594239115715, + 0.14015944115817547, + 0.32567431777715683, + 1.123115424066782, + 0.9762764871120453, + 0.6881278865039349, + 0.42041658237576485, + 0.778848284855485, + 0.38812728598713875, + 0.074444979429245, + 0.6124199330806732, + 0.0968925766646862, + 0.03864491358399391, + 0.16495171934366226, + 0.5380434896796942, + 0.2990302499383688, + 0.11047236993908882, + 0.2406021449714899, + 0.5846052914857864, + 0.5432026870548725, + 1.9827679060399532, + 0.7343458272516727, + 0.30154414288699627, + 1.0739712342619896, + 0.39054254442453384, + 0.8715631850063801, + 0.8838857598602772, + 0.11960437148809433, + 0.6269745416939259, + 0.9139348492026329, + 0.29059422947466373, + 6.145575821399689, + 0.38421766459941864, + 0.9598790816962719, + 0.5192593615502119, + 0.03860712796449661, + 1.853160072118044, + 0.45139656215906143, + 0.4552750326693058, + 0.04117819294333458, + 0.5283883176743984, + 0.17455756291747093, + 0.5442203152924776, + 0.8628972247242928, + 1.4990454949438572, + 0.531655365601182, + 1.0808910485357046, + 0.44309068471193314, + 2.178189430385828, + 0.1680579725652933, + 0.5471123978495598 + ], + "unique_experts": 64, + "load_cv": 0.6999981975172176, + "normalized_load_entropy": 0.9488007874535168, + "max_load_share": 0.06342182890855458 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "ce8380e857f00dbd770d886bb4d279caab94b6310555c5bed256762513cc7fd4", + "route_weight_sha256": "f187da32692d1d6953d92e9a5fc3a6b6bf156feae6fdade4948719f76cb6381f", + "loads": [ + 28, + 15, + 12, + 20, + 3, + 7, + 10, + 6, + 41, + 10, + 23, + 18, + 21, + 8, + 9, + 9, + 19, + 13, + 11, + 10, + 13, + 16, + 3, + 9, + 2, + 3, + 4, + 13, + 6, + 4, + 6, + 8, + 13, + 28, + 11, + 11, + 14, + 10, + 11, + 8, + 8, + 9, + 16, + 7, + 45, + 9, + 10, + 9, + 4, + 12, + 18, + 8, + 2, + 14, + 6, + 24, + 14, + 24, + 12, + 16, + 14, + 36, + 5, + 20 + ], + "weighted_loads": [ + 2.2651635287329555, + 0.6495301760733128, + 1.5682340078055859, + 2.397820030339062, + 0.16826225444674492, + 0.23629707098007202, + 1.255697201937437, + 0.29445173777639866, + 3.182999450713396, + 0.5888573322445154, + 1.4673462212085724, + 2.2838673759251833, + 1.3253312893211842, + 0.47292594239115715, + 0.828028092160821, + 0.32567431777715683, + 1.123115424066782, + 1.054510872811079, + 0.6881278865039349, + 0.42041658237576485, + 0.778848284855485, + 1.120707456022501, + 0.1035890281200409, + 0.6751996949315071, + 0.0968925766646862, + 0.1028587743639946, + 0.16495171934366226, + 0.6544772833585739, + 0.2990302499383688, + 0.16117765381932259, + 0.2406021449714899, + 0.5846052914857864, + 0.5787025131285191, + 2.2432500645518303, + 0.8489109240472317, + 0.45663012005388737, + 1.0739712342619896, + 0.4356844760477543, + 0.8715631850063801, + 0.917432751506567, + 0.3928600214421749, + 0.7032621912658215, + 1.1451657637953758, + 0.29059422947466373, + 6.250621791929007, + 0.4161957763135433, + 1.0015891157090664, + 0.5192593615502119, + 0.1733708344399929, + 1.9798791743814945, + 0.7404954433441162, + 0.4552750326693058, + 0.04117819294333458, + 0.6781840324401855, + 0.17455756291747093, + 1.7655080324038863, + 0.981780419126153, + 1.6013402808457613, + 0.5724005680531263, + 1.0808910485357046, + 1.6608043499290943, + 2.464119203388691, + 0.1680579725652933, + 0.8225991278886795 + ], + "unique_experts": 64, + "load_cv": 0.6703496948525278, + "normalized_load_entropy": 0.9529027170299923, + "max_load_share": 0.05434782608695652 + } + }, + "s1_period": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "1402914f519667dd104c5e15ed3a723133ff3e0ce64dc40e178f1052f4426e33", + "route_weight_sha256": "61cf51ed80d9caf1dbb6c99387518dec38a13d7a45f7a3042bc2a01072bf91aa", + "loads": [ + 24, + 9, + 10, + 12, + 4, + 6, + 6, + 8, + 33, + 5, + 24, + 17, + 22, + 9, + 5, + 8, + 19, + 8, + 10, + 9, + 12, + 6, + 2, + 9, + 3, + 1, + 3, + 8, + 8, + 1, + 7, + 7, + 12, + 17, + 8, + 6, + 14, + 8, + 11, + 8, + 6, + 8, + 12, + 8, + 43, + 7, + 8, + 10, + 1, + 10, + 10, + 9, + 2, + 10, + 8, + 16, + 11, + 24, + 9, + 15, + 5, + 31, + 2, + 14 + ], + "weighted_loads": [ + 2.158752277493477, + 0.341457050293684, + 1.5363514441996813, + 1.4303722456097603, + 0.22898227162659168, + 0.2019770685583353, + 0.9878670126199722, + 0.322339104488492, + 1.9528418071568012, + 0.3876037448644638, + 1.4845020323991776, + 2.1560997888445854, + 1.3817719891667366, + 0.48348257318139076, + 0.17288633435964584, + 0.2782528195530176, + 1.0914025288075209, + 0.8607436083257198, + 0.6543705984950066, + 0.3899562545120716, + 0.7195879183709621, + 0.32516595534980297, + 0.07099302113056183, + 0.6171400211751461, + 0.1343446895480156, + 0.038309965282678604, + 0.1158594898879528, + 0.44603321328759193, + 0.38513354770839214, + 0.035051438957452774, + 0.2497081384062767, + 0.5419271737337112, + 0.5419439934194088, + 1.6915635839104652, + 0.7606030181050301, + 0.23921826854348183, + 1.0711210556328297, + 0.34394471533596516, + 0.8554494790732861, + 0.9148904979228973, + 0.2794172950088978, + 0.610705878585577, + 0.8781924955546856, + 0.3433861881494522, + 6.2064093463122845, + 0.3452954590320587, + 0.8840761780738831, + 0.5742276534438133, + 0.03790692612528801, + 1.7737328447401524, + 0.3365483917295933, + 0.4965734928846359, + 0.05687141232192516, + 0.49869011901319027, + 0.2861356195062399, + 0.7801461387425661, + 0.8481278717517853, + 1.609078947454691, + 0.44217229448258877, + 1.0331624448299408, + 0.38141709566116333, + 2.3679594676941633, + 0.11298790574073792, + 0.6009516529738903 + ], + "unique_experts": 64, + "load_cv": 0.733410694652436, + "normalized_load_entropy": 0.9451016784644938, + "max_load_share": 0.06342182890855458 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "57d88d6eaa1c9d05bf830a97da7a0de6154409dace19142886875faaff823835", + "route_weight_sha256": "be0cae35cda3bb2916234ab925bf29c068b4b4dd7af827d65a113aff87b7bbc0", + "loads": [ + 26, + 15, + 10, + 22, + 4, + 7, + 11, + 10, + 54, + 14, + 24, + 22, + 25, + 9, + 9, + 12, + 22, + 10, + 11, + 9, + 13, + 20, + 3, + 10, + 3, + 2, + 3, + 10, + 9, + 1, + 7, + 7, + 13, + 27, + 16, + 12, + 16, + 10, + 11, + 10, + 19, + 10, + 17, + 10, + 44, + 7, + 9, + 12, + 3, + 13, + 22, + 12, + 7, + 13, + 8, + 38, + 15, + 26, + 11, + 15, + 20, + 42, + 4, + 18 + ], + "weighted_loads": [ + 2.280422347597778, + 0.8412930034101009, + 1.5363514441996813, + 2.673696182668209, + 0.22898227162659168, + 0.2145680245012045, + 1.2985516414046288, + 0.4042497258633375, + 3.6747880075126886, + 0.8525638822466135, + 1.4845020323991776, + 2.477243833243847, + 1.5214952193200588, + 0.48348257318139076, + 0.7335936706513166, + 0.5132604595273733, + 1.2374214809387922, + 0.9106602892279625, + 0.6943288706243038, + 0.3899562545120716, + 0.7687446437776089, + 1.494327476248145, + 0.11390591040253639, + 0.6749232336878777, + 0.1343446895480156, + 0.06380418501794338, + 0.1158594898879528, + 0.5259584337472916, + 0.46869621239602566, + 0.035051438957452774, + 0.2497081384062767, + 0.5419271737337112, + 0.5903197675943375, + 2.055799560621381, + 1.1350013613700867, + 0.49317925050854683, + 1.1618885584175587, + 0.40763620659708977, + 0.8554494790732861, + 0.9811980072408915, + 1.0475228019058704, + 0.684492502361536, + 1.2592486292123795, + 0.47885315865278244, + 6.234614294022322, + 0.3452954590320587, + 0.9184907488524914, + 0.6415858902037144, + 0.13309132680296898, + 2.2695170305669308, + 0.9640526790171862, + 0.7078762613236904, + 0.6063696127384901, + 0.6508243959397078, + 0.2861356195062399, + 2.7393984934315085, + 1.0737936086952686, + 1.6729213036596775, + 0.5442103240638971, + 1.0331624448299408, + 2.375506140291691, + 2.8327369447797537, + 0.18442651629447937, + 0.7849536836147308 + ], + "unique_experts": 64, + "load_cv": 0.6989834048574486, + "normalized_load_entropy": 0.9491177511702267, + "max_load_share": 0.05844155844155844 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 113, + "ordered_topk_exact_tokens": 63, + "set_exact_tokens": 75, + "mean_set_jaccard": 0.9020227560050569, + "mean_token_weighted_tv": 0.019042699148598234, + "aggregate_load_tv": 0.035398230088495575 + }, + "system_bos": { + "tokens": 113, + "ordered_topk_exact_tokens": 57, + "set_exact_tokens": 71, + "mean_set_jaccard": 0.8885377159713443, + "mean_token_weighted_tv": 0.02533486067210283, + "aggregate_load_tv": 0.03687315634218289 + }, + "system_x": { + "tokens": 113, + "ordered_topk_exact_tokens": 45, + "set_exact_tokens": 60, + "mean_set_jaccard": 0.8512431521281079, + "mean_token_weighted_tv": 0.03500670856029718, + "aggregate_load_tv": 0.05604719764011799 + }, + "system_period": { + "tokens": 113, + "ordered_topk_exact_tokens": 44, + "set_exact_tokens": 56, + "mean_set_jaccard": 0.8437420986093553, + "mean_token_weighted_tv": 0.036479559640474286, + "aggregate_load_tv": 0.05752212389380531 + }, + "bos_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 57, + "set_exact_tokens": 70, + "mean_set_jaccard": 0.881795195954488, + "mean_token_weighted_tv": 0.02636054609036815, + "aggregate_load_tv": 0.04424778761061947 + }, + "bos_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 49, + "set_exact_tokens": 61, + "mean_set_jaccard": 0.8537715971344291, + "mean_token_weighted_tv": 0.03064697939671774, + "aggregate_load_tv": 0.05162241887905604 + }, + "x_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 50, + "set_exact_tokens": 65, + "mean_set_jaccard": 0.8672566371681416, + "mean_token_weighted_tv": 0.030093421236471792, + "aggregate_load_tv": 0.048672566371681415 + }, + "x_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 36, + "set_exact_tokens": 50, + "mean_set_jaccard": 0.812684365781711, + "mean_token_weighted_tv": 0.04118028494933274, + "aggregate_load_tv": 0.07079646017699115 + }, + "period_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 50, + "set_exact_tokens": 63, + "mean_set_jaccard": 0.8640960809102403, + "mean_token_weighted_tv": 0.028850492918286966, + "aggregate_load_tv": 0.05162241887905605 + }, + "period_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 40, + "set_exact_tokens": 53, + "mean_set_jaccard": 0.8240623683101559, + "mean_token_weighted_tv": 0.03956271650731168, + "aggregate_load_tv": 0.06342182890855458 + } + } + }, + "layer_23": { + "layer": 23, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "ac4c8e6e37f6bce07303e72efca3dda1ac6366ef3d8843fd46bed367665f998d", + "route_weight_sha256": "d8e9a0d12843f70381538e0ce35facfe5f0326558bc6d7c9ed82949f16a9d800", + "loads": [ + 16, + 9, + 10, + 11, + 2, + 12, + 6, + 8, + 15, + 6, + 15, + 13, + 14, + 12, + 10, + 15, + 14, + 15, + 20, + 12, + 12, + 6, + 15, + 10, + 11, + 0, + 15, + 20, + 8, + 8, + 12, + 3, + 15, + 0, + 12, + 6, + 6, + 13, + 11, + 5, + 21, + 12, + 12, + 4, + 9, + 11, + 22, + 7, + 12, + 11, + 2, + 17, + 16, + 8, + 14, + 8, + 3, + 9, + 4, + 0, + 21, + 7, + 19, + 6 + ], + "weighted_loads": [ + 1.594980463385582, + 0.6849879771471024, + 0.6562668848782778, + 1.7923833467066288, + 0.13852345198392868, + 0.6227304972708225, + 0.4763026814907789, + 0.39408764615654945, + 1.6709753014147282, + 0.3049000781029463, + 0.8138181418180466, + 0.5250105559825897, + 0.6968452986329794, + 0.5934126358479261, + 0.6575586423277855, + 1.0800267457962036, + 1.2605876084417105, + 1.0668121464550495, + 1.235424805432558, + 0.588313365355134, + 0.6138328667730093, + 0.21923489682376385, + 1.9776012673974037, + 0.6803000941872597, + 0.47132606245577335, + 0.0, + 2.842313291504979, + 1.339709796011448, + 0.44225207157433033, + 0.5132206305861473, + 0.5820710379630327, + 0.15722084790468216, + 0.8772406317293644, + 0.0, + 0.5920038409531116, + 0.5090154781937599, + 0.41757121309638023, + 0.6127308718860149, + 0.7309654708951712, + 0.25431943126022816, + 1.835772953927517, + 0.7761850822716951, + 0.47678722999989986, + 0.16790563985705376, + 0.6337564010173082, + 1.095470767468214, + 1.5587237849831581, + 0.5846809446811676, + 0.8946588821709156, + 0.48128187470138073, + 0.09700081497430801, + 1.0885704010725021, + 1.43679378926754, + 0.4159828685224056, + 0.6509782187640667, + 0.5612034238874912, + 0.2029264196753502, + 0.5843394510447979, + 0.18580080941319466, + 0.0, + 0.9904425144195557, + 0.43890266865491867, + 1.061001617461443, + 0.25150309316813946 + ], + "unique_experts": 61, + "load_cv": 0.5016397438676795, + "normalized_load_entropy": 0.9637441190876402, + "max_load_share": 0.032448377581120944 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "efec099afe40da4a4770b73b93202f590559917e2c984eaf0b3b797c09126ada", + "route_weight_sha256": "206b338bddb3e0ee150796d6f7973c1a7ae4695510be62b25dad7dd431dda371", + "loads": [ + 21, + 12, + 10, + 20, + 8, + 14, + 12, + 12, + 16, + 14, + 15, + 13, + 15, + 17, + 12, + 15, + 17, + 15, + 20, + 12, + 12, + 6, + 17, + 20, + 15, + 1, + 15, + 20, + 8, + 8, + 12, + 3, + 17, + 4, + 12, + 7, + 7, + 13, + 16, + 7, + 28, + 13, + 15, + 4, + 9, + 17, + 33, + 10, + 13, + 11, + 3, + 19, + 16, + 8, + 24, + 10, + 3, + 18, + 6, + 0, + 22, + 7, + 22, + 7 + ], + "weighted_loads": [ + 1.792639530962333, + 0.8508179932832718, + 0.6562668848782778, + 2.0498032823670655, + 0.4027333538979292, + 0.6786199742928147, + 0.8782775308936834, + 0.5637357085943222, + 1.6717230581562035, + 0.5927872825413942, + 0.8138181418180466, + 0.5250105559825897, + 0.70703708473593, + 0.8006716966629028, + 0.77439771220088, + 1.0800267457962036, + 1.3123713750392199, + 1.0668121464550495, + 1.235424805432558, + 0.588313365355134, + 0.6138328667730093, + 0.21923489682376385, + 2.0755612943321466, + 1.9171302169561386, + 0.6169626954942942, + 0.02790551260113716, + 2.842313291504979, + 1.339709796011448, + 0.44225207157433033, + 0.5132206305861473, + 0.5820710379630327, + 0.15722084790468216, + 0.9981715753674507, + 0.25232404842972755, + 0.5920038409531116, + 0.5403135940432549, + 0.462299857288599, + 0.6127308718860149, + 0.9456897880882025, + 0.3051595352590084, + 2.2063596211373806, + 0.8320432994514704, + 0.5572086311876774, + 0.16790563985705376, + 0.6337564010173082, + 3.0968690030276775, + 2.520374059677124, + 0.6477668664883822, + 0.933334942907095, + 0.48128187470138073, + 0.16247226297855377, + 1.2155861593782902, + 1.43679378926754, + 0.4159828685224056, + 1.5729538314044476, + 0.6314159743487835, + 0.2029264196753502, + 1.5553213767707348, + 0.28848326206207275, + 0.0, + 1.0204299222677946, + 0.43890266865491867, + 1.153856586664915, + 0.31909447722136974 + ], + "unique_experts": 63, + "load_cv": 0.49016560110518054, + "normalized_load_entropy": 0.9682959685663832, + "max_load_share": 0.03985507246376811 + } + }, + "s1_eos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "223a5921dbdedcb9f2c482b5c5f8ea9a3510539b141fb17cfa29ca49d079f456", + "route_weight_sha256": "2620ba3c73f4c0371b67744816206db8876fb1b9c40cc08877e1d499f8013685", + "loads": [ + 15, + 10, + 11, + 11, + 2, + 12, + 5, + 8, + 14, + 5, + 13, + 16, + 14, + 11, + 10, + 15, + 14, + 15, + 20, + 14, + 12, + 6, + 15, + 9, + 10, + 0, + 13, + 20, + 10, + 8, + 11, + 3, + 19, + 0, + 12, + 6, + 6, + 12, + 11, + 3, + 20, + 11, + 10, + 4, + 9, + 10, + 22, + 6, + 12, + 11, + 2, + 17, + 14, + 12, + 17, + 8, + 3, + 9, + 4, + 0, + 22, + 7, + 20, + 7 + ], + "weighted_loads": [ + 1.5293552801012993, + 0.732260774821043, + 0.6826744321733713, + 1.792738312855363, + 0.12540678679943085, + 0.6246515680104494, + 0.4443509876728058, + 0.38291675969958305, + 1.6418480202555656, + 0.2647145166993141, + 0.7591077424585819, + 0.6475243866443634, + 0.7281319927424192, + 0.5676716677844524, + 0.6296557430177927, + 1.0666353292763233, + 1.238477610051632, + 1.0398114249110222, + 1.2360777668654919, + 0.6299190055578947, + 0.591487867757678, + 0.21843396313488483, + 1.9367854669690132, + 0.7082394100725651, + 0.4709545597434044, + 0.0, + 2.803522050380707, + 1.3713044039905071, + 0.4964149836450815, + 0.5028975363820791, + 0.5408601611852646, + 0.15257900580763817, + 1.0316689722239971, + 0.0, + 0.5965772680938244, + 0.5249144211411476, + 0.3676127679646015, + 0.5627906899899244, + 0.7241892497986555, + 0.16798260435461998, + 1.7198290470987558, + 0.7395281530916691, + 0.4118479900062084, + 0.18524600565433502, + 0.6253237389028072, + 1.0726906191557646, + 1.5045487098395824, + 0.5588427670300007, + 0.8960881568491459, + 0.46999997831881046, + 0.08296076580882072, + 1.0638048388063908, + 1.3618956618010998, + 0.5401361044496298, + 0.7591165788471699, + 0.5331034101545811, + 0.19664204120635986, + 0.595037117600441, + 0.17290658131241798, + 0.0, + 1.0147720575332642, + 0.42056069150567055, + 1.1392411272972822, + 0.3048403337597847 + ], + "unique_experts": 61, + "load_cv": 0.5147894093936639, + "normalized_load_entropy": 0.9620622893521638, + "max_load_share": 0.032448377581120944 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "785c3f91c53485e1f3850d566a40caf8c11304c0a9d604e0a4ebf01fa3e18349", + "route_weight_sha256": "0cd78fc4fd4bc14a73dc57d83bfb911ffa28f2c7a0c9773124916c25fb3aab7b", + "loads": [ + 21, + 16, + 17, + 20, + 8, + 15, + 18, + 15, + 16, + 9, + 15, + 17, + 15, + 16, + 12, + 18, + 18, + 16, + 22, + 15, + 13, + 6, + 17, + 23, + 13, + 1, + 13, + 20, + 10, + 9, + 11, + 3, + 22, + 12, + 12, + 6, + 12, + 13, + 19, + 4, + 29, + 12, + 12, + 4, + 11, + 15, + 38, + 10, + 19, + 14, + 2, + 28, + 20, + 13, + 27, + 9, + 3, + 26, + 5, + 0, + 24, + 8, + 27, + 10 + ], + "weighted_loads": [ + 1.854246592381969, + 1.0931919142603874, + 1.0003417897969484, + 2.2860636317636818, + 0.3502296395599842, + 0.7253067484125495, + 1.2134889103472233, + 0.6151602100580931, + 1.6765206747222692, + 0.42200359143316746, + 0.853489987552166, + 0.6785390116274357, + 0.7383234482258558, + 0.7714807149022818, + 0.7733197342604399, + 1.1882173847407103, + 1.3156060576438904, + 1.0990526117384434, + 1.327752746641636, + 0.6598462406545877, + 0.6397134494036436, + 0.21843396313488483, + 2.0168742313981056, + 2.494832444936037, + 0.5937933921813965, + 0.03683112934231758, + 2.803522050380707, + 1.3713044039905071, + 0.4964149836450815, + 0.5477677267044783, + 0.5408601611852646, + 0.15257900580763817, + 1.1888092048466206, + 0.7210606241133064, + 0.5965772680938244, + 0.5249144211411476, + 0.8014653511345387, + 0.6108258981257677, + 1.1905073821544647, + 0.19136868044734, + 2.11327513307333, + 0.7947557456791401, + 0.4698906224220991, + 0.18524600565433502, + 0.7267732061445713, + 3.064504014328122, + 3.126245092600584, + 0.7869743795599788, + 1.1872828919440508, + 0.6206714008003473, + 0.08296076580882072, + 1.7627177257090807, + 2.0019700303673744, + 0.5716019812971354, + 1.725050125271082, + 0.5715976431965828, + 0.19664204120635986, + 2.2048185765743256, + 0.25544266775250435, + 0.0, + 1.0875192750245333, + 0.5449419729411602, + 1.4011895041912794, + 0.44600023701786995 + ], + "unique_experts": 63, + "load_cv": 0.5108775375747654, + "normalized_load_entropy": 0.9655776826793543, + "max_load_share": 0.04112554112554113 + } + }, + "s0_bos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "23421b0b7548caa63d6c8ab96e222fa78653631f1d00714cc3c54da40f1ecc3b", + "route_weight_sha256": "c059e23fc5fc175f695c3e6073d66bfa4a222db4aba7c5fc74a9081a20293dc1", + "loads": [ + 14, + 9, + 11, + 11, + 3, + 11, + 6, + 7, + 15, + 8, + 13, + 13, + 13, + 12, + 10, + 14, + 15, + 14, + 19, + 13, + 12, + 6, + 15, + 10, + 13, + 0, + 14, + 20, + 9, + 8, + 11, + 3, + 20, + 1, + 9, + 6, + 6, + 19, + 11, + 7, + 21, + 12, + 8, + 4, + 9, + 10, + 25, + 7, + 12, + 12, + 1, + 15, + 17, + 8, + 11, + 7, + 3, + 9, + 5, + 1, + 21, + 7, + 14, + 8 + ], + "weighted_loads": [ + 1.5306667312979698, + 0.6960835717618465, + 0.7175667770206928, + 1.8191826194524765, + 0.18038169667124748, + 0.5795443560928106, + 0.4650793503969908, + 0.35477165319025517, + 1.67333959415555, + 0.37972552329301834, + 0.7237693816423416, + 0.5202175043523312, + 0.8014384247362614, + 0.5931599643081427, + 0.6072066221386194, + 1.062861867249012, + 1.2500619608908892, + 1.0522205047309399, + 1.2126137465238571, + 0.6282910257577896, + 0.6495856735855341, + 0.21691730991005898, + 1.9664395917207003, + 0.6946982499212027, + 0.5480737257748842, + 0.0, + 2.8324013501405716, + 1.3632503002882004, + 0.4739827774465084, + 0.509667782112956, + 0.5274946875870228, + 0.15212838351726532, + 1.0679729096591473, + 0.022534891963005066, + 0.43426528945565224, + 0.5601694248616695, + 0.3918989934027195, + 0.8240531627088785, + 0.7604885995388031, + 0.3163468334823847, + 1.819183612242341, + 0.7891236059367657, + 0.34359353221952915, + 0.16796842217445374, + 0.6326407231390476, + 1.0984630584716797, + 1.6372417453676462, + 0.6181422211229801, + 0.8652661684900522, + 0.5312269143760204, + 0.04264064133167267, + 1.022197987884283, + 1.4877004139125347, + 0.38028671965003014, + 0.5718752946704626, + 0.5057684518396854, + 0.20353714376688004, + 0.5670510940253735, + 0.23153342679142952, + 0.029850197955965996, + 0.9482452794909477, + 0.4258558452129364, + 0.9062662683427334, + 0.3158622067421675 + ], + "unique_experts": 63, + "load_cv": 0.49941447255253174, + "normalized_load_entropy": 0.9663162600498862, + "max_load_share": 0.03687315634218289 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "734db4ba1c1478d9d5babdfeed6647c5655f8d98194c646889a5525754a59741", + "route_weight_sha256": "9688603ccd3dfe4361f2a8e5ce8a6be772f866aeea6829dba3595d9ffadc6843", + "loads": [ + 17, + 12, + 11, + 19, + 8, + 13, + 12, + 14, + 15, + 14, + 13, + 13, + 15, + 17, + 11, + 14, + 18, + 14, + 19, + 14, + 12, + 6, + 18, + 21, + 16, + 0, + 15, + 20, + 9, + 8, + 11, + 3, + 22, + 4, + 9, + 7, + 6, + 19, + 15, + 9, + 30, + 13, + 10, + 6, + 9, + 15, + 37, + 9, + 13, + 12, + 2, + 16, + 17, + 9, + 21, + 10, + 3, + 19, + 8, + 2, + 22, + 7, + 16, + 9 + ], + "weighted_loads": [ + 1.6587257063947618, + 0.861913587898016, + 0.7175667770206928, + 2.073020261246711, + 0.40761775337159634, + 0.6354338331148028, + 0.8702350649982691, + 0.622808899730444, + 1.67333959415555, + 0.5997295714914799, + 0.7237693816423416, + 0.5202175043523312, + 0.8401335319504142, + 0.8004190251231194, + 0.6807251144200563, + 1.062861867249012, + 1.3018457274883986, + 1.0522205047309399, + 1.2126137465238571, + 0.815368264913559, + 0.6495856735855341, + 0.21691730991005898, + 2.108064942061901, + 2.0295852217823267, + 0.6482975725084543, + 0.0, + 2.9434741362929344, + 1.3632503002882004, + 0.4739827774465084, + 0.509667782112956, + 0.5274946875870228, + 0.15212838351726532, + 1.183913554996252, + 0.2832709029316902, + 0.43426528945565224, + 0.5914675407111645, + 0.3918989934027195, + 0.8240531627088785, + 0.9431345127522945, + 0.36718693748116493, + 2.2782606221735477, + 0.8467227108776569, + 0.3966650851070881, + 0.2281016744673252, + 0.6326407231390476, + 2.1235524117946625, + 2.646268868818879, + 0.6773800905793905, + 0.9039422292262316, + 0.5312269143760204, + 0.1031368263065815, + 1.1108491607010365, + 1.4877004139125347, + 0.4201143607497215, + 1.4938509073108435, + 0.62007662281394, + 0.20353714376688004, + 1.580610316246748, + 0.3870687372982502, + 0.29232813231647015, + 0.9793169070035219, + 0.4258558452129364, + 0.9741585347801447, + 0.3797312658280134 + ], + "unique_experts": 63, + "load_cv": 0.4954694505505408, + "normalized_load_entropy": 0.9689842707936394, + "max_load_share": 0.04468599033816425 + } + }, + "s1_bos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "e213bd2a114ce5b52db70295aa2c0f0b1cfc644f8cf7ba8cde464dd57a40f538", + "route_weight_sha256": "b92dd2aca25fadcd8d82d262cf8bbe54874bd7ec1d75f9f9d17fe6ec6892181f", + "loads": [ + 13, + 9, + 11, + 11, + 1, + 13, + 6, + 8, + 16, + 7, + 13, + 16, + 14, + 10, + 10, + 15, + 13, + 15, + 22, + 12, + 12, + 6, + 16, + 9, + 9, + 0, + 13, + 20, + 7, + 8, + 10, + 3, + 16, + 0, + 10, + 6, + 8, + 18, + 11, + 7, + 26, + 12, + 8, + 4, + 9, + 10, + 22, + 9, + 12, + 10, + 2, + 17, + 16, + 8, + 13, + 8, + 1, + 10, + 5, + 1, + 20, + 7, + 18, + 6 + ], + "weighted_loads": [ + 1.426680777221918, + 0.7030132748186588, + 0.7168477438390255, + 1.8209393694996834, + 0.09239096939563751, + 0.6553468238562346, + 0.4707036428153515, + 0.37673957273364067, + 1.7422413416206837, + 0.3488582596182823, + 0.7106089815497398, + 0.6518498230725527, + 0.8250860404223204, + 0.5572236217558384, + 0.5766470246016979, + 1.0895757880061865, + 1.174832634627819, + 1.0780285131186247, + 1.3010117188096046, + 0.5959382243454456, + 0.6457748170942068, + 0.22561512514948845, + 1.9720660634338856, + 0.6548097617924213, + 0.44164857640862465, + 0.0, + 2.790720898658037, + 1.3600486926734447, + 0.4137326255440712, + 0.5101661682128906, + 0.5031053386628628, + 0.14450915157794952, + 0.9371445253491402, + 0.0, + 0.5116629078984261, + 0.5791029185056686, + 0.43718698620796204, + 0.7841055858880281, + 0.7222729176282883, + 0.32239479571580887, + 1.9513699393719435, + 0.785219568759203, + 0.3295898884534836, + 0.16028714552521706, + 0.6333161033689976, + 1.0637632850557566, + 1.4972293507307768, + 0.6779781933873892, + 0.8728430047631264, + 0.42662751488387585, + 0.08539938926696777, + 1.0702650845050812, + 1.5021023154258728, + 0.35082766227424145, + 0.6381922792643309, + 0.5385180115699768, + 0.11118630319833755, + 0.6197820417582989, + 0.2282509095966816, + 0.03780065476894379, + 0.9468235392123461, + 0.434362031519413, + 1.0896345898509026, + 0.23823762498795986 + ], + "unique_experts": 62, + "load_cv": 0.5228400335155401, + "normalized_load_entropy": 0.9621936111617022, + "max_load_share": 0.038348082595870206 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "a0643e7354aceeb1d70cb8864d48a6d001713edce5965dcbbee16e8ccf4ee262", + "route_weight_sha256": "6fffdaba6cb6d0d3ca212896d28e9a39535c3dbaf9144fc774f89b0cba046edf", + "loads": [ + 18, + 15, + 17, + 19, + 5, + 16, + 18, + 16, + 18, + 11, + 15, + 17, + 15, + 15, + 11, + 18, + 17, + 16, + 24, + 12, + 13, + 6, + 19, + 24, + 11, + 1, + 13, + 20, + 7, + 9, + 11, + 3, + 18, + 11, + 10, + 6, + 14, + 19, + 18, + 8, + 37, + 13, + 10, + 4, + 11, + 14, + 38, + 12, + 19, + 13, + 2, + 28, + 22, + 11, + 23, + 9, + 1, + 28, + 9, + 1, + 23, + 8, + 24, + 10 + ], + "weighted_loads": [ + 1.7633064626716077, + 1.0639444142580032, + 1.0345151014626026, + 2.3107234206981957, + 0.24722009524703026, + 0.7517765341326594, + 1.2083872631192207, + 0.6672934051603079, + 1.822594776749611, + 0.5071288552135229, + 0.8049912266433239, + 0.682864448055625, + 0.835277495905757, + 0.7610326688736677, + 0.6744041480123997, + 1.2111578434705734, + 1.2519610822200775, + 1.1372696999460459, + 1.3926866985857487, + 0.5959382243454456, + 0.6940003987401724, + 0.22561512514948845, + 2.1207601577043533, + 2.5884267948567867, + 0.5210471302270889, + 0.028327468782663345, + 2.790720898658037, + 1.3600486926734447, + 0.4137326255440712, + 0.5550363585352898, + 0.5429668128490448, + 0.14450915157794952, + 1.0564165860414505, + 0.7245877217501402, + 0.5116629078984261, + 0.5791029185056686, + 0.8710395693778992, + 0.8321407940238714, + 1.1353615690022707, + 0.3457808718085289, + 2.4604721665382385, + 0.8436702787876129, + 0.38443557918071747, + 0.16028714552521706, + 0.7347655706107616, + 2.0795490723103285, + 3.1189257334917784, + 0.9024060145020485, + 1.1640377398580313, + 0.5772989373654127, + 0.08539938926696777, + 1.723359091207385, + 2.1421766839921474, + 0.49747089855372906, + 1.604125825688243, + 0.5872767344117165, + 0.11118630319833755, + 2.282244499772787, + 0.4538852907717228, + 0.03780065476894379, + 1.050559526309371, + 0.5587433129549026, + 1.3239365965127945, + 0.41977729089558125 + ], + "unique_experts": 64, + "load_cv": 0.5256309785758209, + "normalized_load_entropy": 0.9648434453642606, + "max_load_share": 0.04112554112554113 + } + }, + "s0_x": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "3317dfef2e76866b5f524398bbdad093046f2b3d4a45ce9196eb6a3e57acdeeb", + "route_weight_sha256": "e4f4c43e9d9707b668a62d40b6632ee43d54c240707401e5ea2ae24e923c5670", + "loads": [ + 13, + 9, + 11, + 11, + 1, + 12, + 6, + 8, + 15, + 5, + 14, + 13, + 13, + 11, + 9, + 15, + 14, + 15, + 19, + 17, + 12, + 6, + 13, + 10, + 10, + 1, + 12, + 21, + 8, + 8, + 11, + 3, + 17, + 2, + 10, + 6, + 7, + 16, + 11, + 6, + 23, + 12, + 12, + 4, + 8, + 10, + 25, + 6, + 10, + 9, + 1, + 16, + 14, + 9, + 18, + 7, + 3, + 10, + 4, + 2, + 21, + 8, + 17, + 8 + ], + "weighted_loads": [ + 1.448136493563652, + 0.6978050470352173, + 0.7176293693482876, + 1.7879789359867573, + 0.08668147027492523, + 0.6334932576864958, + 0.45789568684995174, + 0.3815543223172426, + 1.6861382815986872, + 0.272647500038147, + 0.7594050876796246, + 0.5018568430095911, + 0.7837367616593838, + 0.536197217181325, + 0.5540179759263992, + 1.0971143171191216, + 1.2231410946696997, + 1.0842578448355198, + 1.2041532881557941, + 0.7637469656765461, + 0.6431996934115887, + 0.21954231522977352, + 1.9242765493690968, + 0.7024168353527784, + 0.46641068905591965, + 0.031599223613739014, + 2.774391807615757, + 1.3914607390761375, + 0.4547199048101902, + 0.5214376654475927, + 0.5154343638569117, + 0.16047624498605728, + 0.9399590473622084, + 0.050123609602451324, + 0.496652752161026, + 0.5298779420554638, + 0.44871437922120094, + 0.7383082173764706, + 0.7509603258222342, + 0.27985617332160473, + 1.955615809187293, + 0.7752382457256317, + 0.4688624646514654, + 0.18298490718007088, + 0.6172155980020761, + 1.0856112875044346, + 1.6941319201141596, + 0.5696303900331259, + 0.7948872074484825, + 0.39830517023801804, + 0.047431983053684235, + 1.0802153944969177, + 1.4202297367155552, + 0.416900334879756, + 0.8284665625542402, + 0.49308522790670395, + 0.2016126811504364, + 0.6168058589100838, + 0.18968822434544563, + 0.09193890541791916, + 0.9750388022512197, + 0.4676764905452728, + 1.0117103550583124, + 0.32063909992575645 + ], + "unique_experts": 64, + "load_cv": 0.5079831022501297, + "normalized_load_entropy": 0.9663047664051296, + "max_load_share": 0.03687315634218289 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "a6b91f05e30d17aa3d5fbd68df62e3c1183b7647e0a76b0279b7d463b68b6e76", + "route_weight_sha256": "6b04bcfe153a6518e2117cb7eb4582af15f119a9706bd933c262262956852aa9", + "loads": [ + 17, + 12, + 11, + 21, + 6, + 14, + 13, + 15, + 15, + 11, + 14, + 14, + 14, + 16, + 11, + 15, + 18, + 15, + 19, + 17, + 12, + 6, + 15, + 21, + 14, + 1, + 12, + 21, + 8, + 8, + 11, + 3, + 19, + 6, + 10, + 7, + 8, + 16, + 16, + 8, + 30, + 13, + 14, + 4, + 8, + 16, + 39, + 8, + 11, + 9, + 1, + 18, + 14, + 9, + 29, + 8, + 3, + 19, + 5, + 2, + 22, + 8, + 19, + 9 + ], + "weighted_loads": [ + 1.648116064723581, + 0.8636350631713867, + 0.7176293693482876, + 2.1808484089560807, + 0.3056886773556471, + 0.689382734708488, + 0.8988373260945082, + 0.6282642595469952, + 1.6861382815986872, + 0.4740736521780491, + 0.7594050876796246, + 0.5287314783781767, + 0.7939285477623343, + 0.7434562779963017, + 0.672618743032217, + 1.0971143171191216, + 1.3045731540769339, + 1.0842578448355198, + 1.2041532881557941, + 0.7637469656765461, + 0.6431996934115887, + 0.21954231522977352, + 2.0197904985398054, + 1.982466982677579, + 0.6074395403265953, + 0.031599223613739014, + 2.774391807615757, + 1.3914607390761375, + 0.4547199048101902, + 0.5214376654475927, + 0.5154343638569117, + 0.16047624498605728, + 1.0744482968002558, + 0.35178597643971443, + 0.496652752161026, + 0.5611760579049587, + 0.488860622048378, + 0.7383082173764706, + 0.9913415815681219, + 0.330696277320385, + 2.306589787825942, + 0.8254673331975937, + 0.5219340175390244, + 0.18298490718007088, + 0.6172155980020761, + 2.1479838863015175, + 2.8635427188128233, + 0.6288682594895363, + 0.8335632681846619, + 0.39830517023801804, + 0.047431983053684235, + 1.2154037058353424, + 1.4202297367155552, + 0.416900334879756, + 1.8868512939661741, + 0.5276432819664478, + 0.2016126811504364, + 1.591940812766552, + 0.2465522587299347, + 0.09193890541791916, + 1.0034214407205582, + 0.4676764905452728, + 1.0796026214957237, + 0.3784114830195904 + ], + "unique_experts": 64, + "load_cv": 0.529178488170496, + "normalized_load_entropy": 0.966072352442975, + "max_load_share": 0.04710144927536232 + } + }, + "s1_x": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "2ef7e4c508e91210fc7e93ad7160e71bc5aa030adf36c9622f3456d90284177c", + "route_weight_sha256": "3c2b122751cdf06c1636f8ec3480976a331d277096b24408aa0de2d00fe6bf73", + "loads": [ + 12, + 9, + 11, + 11, + 1, + 10, + 6, + 6, + 16, + 6, + 12, + 15, + 13, + 11, + 10, + 16, + 14, + 14, + 19, + 16, + 9, + 6, + 15, + 10, + 9, + 0, + 12, + 21, + 8, + 7, + 11, + 3, + 18, + 1, + 11, + 6, + 8, + 16, + 11, + 6, + 18, + 12, + 13, + 4, + 9, + 10, + 23, + 8, + 10, + 9, + 1, + 18, + 15, + 9, + 20, + 8, + 3, + 10, + 4, + 2, + 20, + 7, + 20, + 9 + ], + "weighted_loads": [ + 1.3426901437342167, + 0.696366086602211, + 0.7004779316484928, + 1.795765869319439, + 0.08416576683521271, + 0.5323031581938267, + 0.42559538781642914, + 0.29475902393460274, + 1.6931488141417503, + 0.3149612993001938, + 0.6600371040403843, + 0.6006033346056938, + 0.8199749868363142, + 0.5765194892883301, + 0.5866173468530178, + 1.110853474587202, + 1.2274259235709906, + 1.0352555699646473, + 1.213453745469451, + 0.7454638630151749, + 0.5450208559632301, + 0.2367603313177824, + 1.9083755556493998, + 0.7274086847901344, + 0.4116126820445061, + 0.0, + 2.737100560218096, + 1.4261818826198578, + 0.42747394554317, + 0.4673825390636921, + 0.5237014032900333, + 0.16491330042481422, + 0.9949250258505344, + 0.02672533690929413, + 0.5209341086447239, + 0.5689495541155338, + 0.4780171886086464, + 0.7098010331392288, + 0.7090868391096592, + 0.2916176375001669, + 1.6557171195745468, + 0.7720030099153519, + 0.4950569160282612, + 0.15223588794469833, + 0.631312008947134, + 1.066167626529932, + 1.5420227237045765, + 0.6388775911182165, + 0.7797111719846725, + 0.35766580142080784, + 0.04345787316560745, + 1.108030242845416, + 1.4379457011818886, + 0.37723915465176105, + 1.0071509890258312, + 0.5407984554767609, + 0.1866377256810665, + 0.6212647818028927, + 0.1799497753381729, + 0.08317049592733383, + 0.9588415790349245, + 0.4329427145421505, + 1.160143706947565, + 0.36213963851332664 + ], + "unique_experts": 63, + "load_cv": 0.5068856119040192, + "normalized_load_entropy": 0.9649170535232737, + "max_load_share": 0.03392330383480826 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "aeca2ddeaf1e88d5f1dca605368736b076147625b58cf17dc9d828f451785219", + "route_weight_sha256": "a478d26883c93d3eeab4825ac6d595c8169b8f5469526eaca127c71466f8329e", + "loads": [ + 17, + 16, + 17, + 20, + 5, + 12, + 19, + 12, + 17, + 9, + 14, + 17, + 14, + 16, + 11, + 19, + 19, + 15, + 21, + 16, + 10, + 6, + 17, + 26, + 11, + 1, + 12, + 21, + 8, + 8, + 11, + 3, + 20, + 11, + 11, + 6, + 14, + 17, + 19, + 7, + 27, + 13, + 15, + 4, + 11, + 14, + 42, + 11, + 18, + 12, + 1, + 30, + 21, + 11, + 33, + 8, + 3, + 27, + 6, + 3, + 22, + 8, + 27, + 12 + ], + "weighted_loads": [ + 1.6489987797103822, + 1.0875740926712751, + 1.01814528927207, + 2.3482716497965157, + 0.23349165171384811, + 0.5763180488720536, + 1.1767162792384624, + 0.4903970118612051, + 1.7270971722900867, + 0.4293551091104746, + 0.7544193491339684, + 0.6586364917457104, + 0.8301664423197508, + 0.7803285364061594, + 0.6843744702637196, + 1.232435530051589, + 1.3438814599066973, + 1.0944967567920685, + 1.305128725245595, + 0.7454638630151749, + 0.5932464376091957, + 0.2367603313177824, + 1.9866320323199034, + 2.6010509617626667, + 0.49101123586297035, + 0.044620100408792496, + 2.737100560218096, + 1.4261818826198578, + 0.42747394554317, + 0.5122527293860912, + 0.5237014032900333, + 0.16491330042481422, + 1.098097376525402, + 0.6722669620066881, + 0.5209341086447239, + 0.5689495541155338, + 0.9118697717785835, + 0.7578362412750721, + 1.1806835010647774, + 0.3150037135928869, + 1.9925573896616697, + 0.8263545595109463, + 0.5545819755643606, + 0.15223588794469833, + 0.7327614761888981, + 2.081953413784504, + 3.4592268019914627, + 0.8633054122328758, + 1.1406472455710173, + 0.5083372239023447, + 0.04345787316560745, + 1.9135936237871647, + 2.0780200697481632, + 0.4472597222775221, + 2.2069659791886806, + 0.5407984554767609, + 0.1866377256810665, + 2.2047354839742184, + 0.30024708434939384, + 0.11923936009407043, + 1.0315887965261936, + 0.5573239959776402, + 1.4292591735720634, + 0.4885808452963829 + ], + "unique_experts": 64, + "load_cv": 0.5412294272573258, + "normalized_load_entropy": 0.9641289700088596, + "max_load_share": 0.045454545454545456 + } + }, + "s0_period": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "e624c09b7defe477a115e2bf2387b2932f84140da48de373abbd603d5799af1b", + "route_weight_sha256": "dfc600549aa32faf7c0121a265daa2bd908aba1ee34833fd4c0d84396d69810f", + "loads": [ + 13, + 9, + 11, + 11, + 1, + 11, + 6, + 8, + 15, + 6, + 13, + 15, + 13, + 11, + 10, + 16, + 14, + 15, + 20, + 16, + 10, + 6, + 13, + 10, + 11, + 1, + 14, + 20, + 8, + 7, + 12, + 3, + 17, + 2, + 11, + 6, + 7, + 13, + 11, + 6, + 21, + 12, + 12, + 4, + 8, + 10, + 24, + 6, + 12, + 11, + 1, + 15, + 14, + 7, + 17, + 8, + 3, + 9, + 5, + 2, + 21, + 7, + 17, + 10 + ], + "weighted_loads": [ + 1.4091240521520376, + 0.695165328681469, + 0.7146722339093685, + 1.8038840740919113, + 0.0835648700594902, + 0.5854244437068701, + 0.4642728101462126, + 0.379977161064744, + 1.671188473701477, + 0.30003682896494865, + 0.7171220071613789, + 0.5685021970421076, + 0.7659506779164076, + 0.5583302583545446, + 0.587064953520894, + 1.1255777813494205, + 1.1836151331663132, + 1.0733137391507626, + 1.2309034764766693, + 0.7350424397736788, + 0.5839031059294939, + 0.2309287954121828, + 1.8881978206336498, + 0.720653735101223, + 0.5006788969039917, + 0.030728641897439957, + 2.79895231500268, + 1.3584943152964115, + 0.45489269495010376, + 0.4862233139574528, + 0.5694497600197792, + 0.1601690836250782, + 0.9363220427185297, + 0.051657216623425484, + 0.5431056320667267, + 0.5292471460998058, + 0.4322461299598217, + 0.6360396705567837, + 0.7308965809643269, + 0.28662512451410294, + 1.8425938226282597, + 0.7712012566626072, + 0.4800590705126524, + 0.17671245336532593, + 0.6081442963331938, + 1.064732389524579, + 1.6482076030224562, + 0.5710605476051569, + 0.8515876363962889, + 0.4874708876013756, + 0.04310400038957596, + 1.034301783889532, + 1.4160644114017487, + 0.35713718831539154, + 0.78406254760921, + 0.5589346326887608, + 0.2015046402812004, + 0.597793310880661, + 0.229655921459198, + 0.07937255874276161, + 0.9807831887155771, + 0.4431096129119396, + 1.0056259986013174, + 0.40371459908783436 + ], + "unique_experts": 64, + "load_cv": 0.4909798883582398, + "normalized_load_entropy": 0.967928610330309, + "max_load_share": 0.035398230088495575 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "1c164f860ccad70255c3c4da29712d9ec954acd7c27844a141cbbcf823ef307e", + "route_weight_sha256": "61fb0aa1c3351ccd3d7bcd263fd6e7ad9e052eda0c25ee0cc126212954b2afe0", + "loads": [ + 17, + 12, + 12, + 19, + 7, + 13, + 14, + 14, + 15, + 13, + 13, + 16, + 14, + 16, + 11, + 16, + 17, + 15, + 20, + 16, + 10, + 6, + 15, + 20, + 14, + 2, + 14, + 20, + 8, + 7, + 12, + 3, + 19, + 6, + 11, + 7, + 7, + 13, + 17, + 8, + 29, + 13, + 14, + 4, + 8, + 15, + 37, + 8, + 13, + 11, + 2, + 17, + 14, + 8, + 28, + 9, + 3, + 19, + 6, + 2, + 22, + 7, + 19, + 11 + ], + "weighted_loads": [ + 1.602151486556977, + 0.8609953448176384, + 0.7617178522050381, + 2.057721715886146, + 0.3536286186426878, + 0.6413139207288623, + 0.9733057375997305, + 0.6097462847828865, + 1.671188473701477, + 0.5616315007209778, + 0.7171220071613789, + 0.5938745085150003, + 0.7761424640193582, + 0.7655893191695213, + 0.660583445802331, + 1.1255777813494205, + 1.2353988997638226, + 1.0733137391507626, + 1.2309034764766693, + 0.7350424397736788, + 0.5839031059294939, + 0.2309287954121828, + 1.9894956704229116, + 1.9849646016955376, + 0.6009027436375618, + 0.06016812473535538, + 2.79895231500268, + 1.3584943152964115, + 0.45489269495010376, + 0.4862233139574528, + 0.5694497600197792, + 0.1601690836250782, + 1.0662599932402372, + 0.3694710563868284, + 0.5431056320667267, + 0.5605452619493008, + 0.4322461299598217, + 0.6360396705567837, + 1.1027216762304306, + 0.3374652285128832, + 2.245661586523056, + 0.8250245377421379, + 0.5331306234002113, + 0.17671245336532593, + 0.6081442963331938, + 2.089821742847562, + 2.7000182326883078, + 0.6302984170615673, + 0.8902636971324682, + 0.4874708876013756, + 0.09137922152876854, + 1.1738021932542324, + 1.4160644114017487, + 0.4026857353746891, + 1.7514313999563456, + 0.5934926867485046, + 0.2015046402812004, + 1.6198251955211163, + 0.28651995584368706, + 0.07937255874276161, + 1.0101001858711243, + 0.4431096129119396, + 1.0735182650387287, + 0.461208114400506 + ], + "unique_experts": 64, + "load_cv": 0.5012761143034111, + "normalized_load_entropy": 0.969458455810088, + "max_load_share": 0.04468599033816425 + } + }, + "s1_period": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "e67cd08689c9215868a600d755204a88f7f719b2c39a67c628dede8781fa9881", + "route_weight_sha256": "fb7e83b237578ef3367c9de1d1d5b679957524f7d203348b5a2222b18913de88", + "loads": [ + 12, + 10, + 12, + 11, + 2, + 10, + 7, + 6, + 16, + 7, + 12, + 14, + 12, + 11, + 9, + 16, + 14, + 15, + 17, + 15, + 10, + 6, + 16, + 8, + 10, + 1, + 12, + 20, + 8, + 7, + 9, + 3, + 17, + 1, + 12, + 6, + 8, + 14, + 11, + 7, + 20, + 13, + 12, + 5, + 10, + 10, + 21, + 8, + 11, + 10, + 1, + 18, + 16, + 7, + 20, + 8, + 2, + 10, + 4, + 2, + 22, + 7, + 18, + 9 + ], + "weighted_loads": [ + 1.359023556113243, + 0.7403183542191982, + 0.7557142823934555, + 1.8108294401317835, + 0.11462696269154549, + 0.5625517480075359, + 0.4559454694390297, + 0.28893963247537613, + 1.6966300196945667, + 0.31723025254905224, + 0.6541282944381237, + 0.5798193477094173, + 0.7413710243999958, + 0.594941757619381, + 0.5592713039368391, + 1.1173909902572632, + 1.2080644201487303, + 1.0378171745687723, + 1.132412575185299, + 0.7051540575921535, + 0.5845548287034035, + 0.23250054381787777, + 1.9644333962351084, + 0.5942620970308781, + 0.4669831059873104, + 0.032741252332925797, + 2.7519624792039394, + 1.3647709786891937, + 0.42868736386299133, + 0.46073080599308014, + 0.447661641985178, + 0.15505940094590187, + 0.9536306746304035, + 0.026796521618962288, + 0.5620940513908863, + 0.5723084136843681, + 0.4697846844792366, + 0.6195798702538013, + 0.6873783208429813, + 0.3349860683083534, + 1.6819941885769367, + 0.8125948458909988, + 0.46270410902798176, + 0.18409965187311172, + 0.674227874726057, + 1.064601507037878, + 1.3970191068947315, + 0.6298597697168589, + 0.8169890530407429, + 0.4027486518025398, + 0.041632696986198425, + 1.1111809108406305, + 1.4652923233807087, + 0.30315260775387287, + 0.9873049296438694, + 0.5263171046972275, + 0.13968628644943237, + 0.6574840098619461, + 0.17901970073580742, + 0.09068407490849495, + 1.004572195932269, + 0.4282720573246479, + 1.1113559808582067, + 0.3575749881565571 + ], + "unique_experts": 64, + "load_cv": 0.48955999632509534, + "normalized_load_entropy": 0.9678502614585377, + "max_load_share": 0.032448377581120944 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "5ae71b3dfd1ecdff7e714aec74c5fbb890ea514ac8a968ff41df28903a193553", + "route_weight_sha256": "ba91e9ba53b9b877e4081135e6ae09465600a2423d81a5ea98d69f8815505f67", + "loads": [ + 18, + 16, + 18, + 20, + 6, + 12, + 21, + 14, + 17, + 12, + 14, + 15, + 13, + 16, + 10, + 19, + 18, + 16, + 19, + 15, + 11, + 6, + 18, + 23, + 12, + 2, + 12, + 20, + 8, + 8, + 9, + 3, + 19, + 12, + 12, + 6, + 14, + 15, + 20, + 8, + 29, + 14, + 16, + 5, + 12, + 14, + 40, + 11, + 18, + 13, + 1, + 29, + 22, + 9, + 32, + 8, + 2, + 27, + 5, + 3, + 24, + 8, + 24, + 11 + ], + "weighted_loads": [ + 1.689900433178991, + 1.1012494936585426, + 1.0733816400170326, + 2.3413508222438395, + 0.26561011373996735, + 0.6065666386857629, + 1.2741107866168022, + 0.5536207575351, + 1.7305783778429031, + 0.5067763067781925, + 0.7485105395317078, + 0.6108339726924896, + 0.7515624798834324, + 0.7987508047372103, + 0.6570284273475409, + 1.2389730457216501, + 1.2851928677409887, + 1.0970583613961935, + 1.224087554961443, + 0.7051540575921535, + 0.632780410349369, + 0.23250054381787777, + 2.0397802125662565, + 2.4223680086433887, + 0.5463816598057747, + 0.07832732796669006, + 2.7519624792039394, + 1.3647709786891937, + 0.42868736386299133, + 0.5056009963154793, + 0.447661641985178, + 0.15505940094590187, + 1.0453548207879066, + 0.7823711596429348, + 0.5620940513908863, + 0.5723084136843681, + 0.9036372676491737, + 0.6676150783896446, + 1.308795589953661, + 0.35837214440107346, + 2.0339557360857725, + 0.8660480342805386, + 0.5796235557645559, + 0.18409965187311172, + 0.7756773419678211, + 2.08038729429245, + 3.1592383347451687, + 0.8542875908315182, + 1.1081837881356478, + 0.5534200742840767, + 0.041632696986198425, + 1.8155355006456375, + 2.1053666919469833, + 0.37800254859030247, + 2.0591538175940514, + 0.5263171046972275, + 0.13968628644943237, + 2.230378843843937, + 0.2615557871758938, + 0.1269012726843357, + 1.0773194134235382, + 0.5526533387601376, + 1.3456579875200987, + 0.4409688264131546 + ], + "unique_experts": 64, + "load_cv": 0.5229143364926354, + "normalized_load_entropy": 0.9660767337408966, + "max_load_share": 0.04329004329004329 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 113, + "ordered_topk_exact_tokens": 57, + "set_exact_tokens": 76, + "mean_set_jaccard": 0.904551201011378, + "mean_token_weighted_tv": 0.019058955858041227, + "aggregate_load_tv": 0.03392330383480826 + }, + "system_bos": { + "tokens": 113, + "ordered_topk_exact_tokens": 55, + "set_exact_tokens": 68, + "mean_set_jaccard": 0.8767383059418459, + "mean_token_weighted_tv": 0.024199162486248312, + "aggregate_load_tv": 0.051622418879056046 + }, + "system_x": { + "tokens": 113, + "ordered_topk_exact_tokens": 48, + "set_exact_tokens": 63, + "mean_set_jaccard": 0.8678887484197219, + "mean_token_weighted_tv": 0.029095157890259165, + "aggregate_load_tv": 0.03687315634218289 + }, + "system_period": { + "tokens": 113, + "ordered_topk_exact_tokens": 40, + "set_exact_tokens": 57, + "mean_set_jaccard": 0.8527180783817953, + "mean_token_weighted_tv": 0.03221178741350902, + "aggregate_load_tv": 0.04424778761061947 + }, + "bos_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 48, + "set_exact_tokens": 64, + "mean_set_jaccard": 0.8647281921618205, + "mean_token_weighted_tv": 0.02780055869535535, + "aggregate_load_tv": 0.0471976401179941 + }, + "bos_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 35, + "set_exact_tokens": 55, + "mean_set_jaccard": 0.8419721871049304, + "mean_token_weighted_tv": 0.0322302869578774, + "aggregate_load_tv": 0.05309734513274336 + }, + "x_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 44, + "set_exact_tokens": 61, + "mean_set_jaccard": 0.8609355246523389, + "mean_token_weighted_tv": 0.02881282974298285, + "aggregate_load_tv": 0.048672566371681415 + }, + "x_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 32, + "set_exact_tokens": 57, + "mean_set_jaccard": 0.8432364096080911, + "mean_token_weighted_tv": 0.03585167769012989, + "aggregate_load_tv": 0.05309734513274336 + }, + "period_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 45, + "set_exact_tokens": 62, + "mean_set_jaccard": 0.8691529709228825, + "mean_token_weighted_tv": 0.02736847312807773, + "aggregate_load_tv": 0.03982300884955752 + }, + "period_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 34, + "set_exact_tokens": 54, + "mean_set_jaccard": 0.8280657395701645, + "mean_token_weighted_tv": 0.03799735607200228, + "aggregate_load_tv": 0.057522123893805316 + } + } + }, + "layer_24": { + "layer": 24, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "52409db1382f23eeafb1352e74cca5d21262c68d992a22e1b9bae2e769ec202e", + "route_weight_sha256": "d25ae5a8b3fe2e46da2cbb2a817635cf8390c91e82b360d612dbb215599c56ff", + "loads": [ + 5, + 4, + 6, + 11, + 6, + 23, + 11, + 12, + 11, + 19, + 9, + 13, + 13, + 13, + 6, + 20, + 1, + 12, + 11, + 10, + 23, + 7, + 1, + 11, + 17, + 14, + 73, + 1, + 4, + 10, + 1, + 10, + 17, + 8, + 4, + 6, + 10, + 7, + 20, + 14, + 6, + 8, + 8, + 6, + 8, + 17, + 3, + 2, + 11, + 10, + 8, + 6, + 4, + 11, + 10, + 5, + 9, + 4, + 3, + 9, + 20, + 15, + 12, + 9 + ], + "weighted_loads": [ + 0.16217878460884094, + 0.15322330966591835, + 0.25778225250542164, + 0.42529639787971973, + 0.40694041922688484, + 1.1880128774791956, + 0.45641077496111393, + 0.6671585738658905, + 1.1429186537861824, + 1.0775475017726421, + 1.63333335891366, + 0.8005472999066114, + 0.8949442263692617, + 0.8022743053734303, + 0.31138115003705025, + 1.0577745772898197, + 0.15097501873970032, + 0.67689492367208, + 0.403324281796813, + 0.35145479413336034, + 1.1317709106951952, + 0.3475962057709694, + 0.038277313113212585, + 0.8110296502709389, + 0.7123282346874475, + 0.8814443182200193, + 6.842646215111017, + 0.021231068298220634, + 0.1849086731672287, + 0.5738197509199381, + 0.04485439509153366, + 0.3466642632381536, + 0.8897286765277386, + 1.3478128634233144, + 0.1508113369345665, + 0.4111598879098892, + 0.44385302998125553, + 0.2602677902425512, + 0.8072035387158394, + 0.6686062049120665, + 0.3633312061429024, + 0.38975939899683, + 0.25786082155855183, + 0.1873369049280882, + 0.348234536126256, + 1.3611086569726467, + 0.10141656175255775, + 0.06400881335139275, + 1.4048718810081482, + 0.7379662003368139, + 1.4041409734636545, + 0.33197519183158875, + 0.1178341694176197, + 0.9023063704371452, + 0.8686469309031963, + 0.2228431161493063, + 0.4628967419266701, + 0.22604705020785332, + 0.2906516343355179, + 0.33001103810966015, + 1.0596327744424343, + 1.155642420053482, + 0.6418972108513117, + 0.33790676668286324 + ], + "unique_experts": 64, + "load_cv": 0.8974874746254566, + "normalized_load_entropy": 0.9359054055603252, + "max_load_share": 0.10766961651917405 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "9b301ddcacbbd04c952dccfc6b9d5958a262a02ac4a3e24a9acb1109cf06ed9b", + "route_weight_sha256": "2d68e9a3148b0667d47c7dfa9487f6b6096c54caa3a1ae4ec81eaddcdc08cbce", + "loads": [ + 5, + 4, + 8, + 11, + 6, + 28, + 11, + 13, + 19, + 19, + 18, + 13, + 15, + 13, + 7, + 20, + 2, + 12, + 11, + 11, + 24, + 7, + 6, + 11, + 26, + 14, + 75, + 1, + 12, + 15, + 1, + 14, + 18, + 12, + 11, + 7, + 11, + 9, + 21, + 15, + 6, + 9, + 12, + 6, + 8, + 19, + 3, + 7, + 11, + 10, + 14, + 12, + 7, + 14, + 10, + 5, + 9, + 5, + 11, + 9, + 24, + 32, + 16, + 13 + ], + "weighted_loads": [ + 0.16217878460884094, + 0.15322330966591835, + 0.32435514219105244, + 0.42529639787971973, + 0.40694041922688484, + 1.376686312025413, + 0.45641077496111393, + 0.7221277244389057, + 1.4966022842563689, + 1.0775475017726421, + 1.9624417060986161, + 0.8005472999066114, + 0.9341604337096214, + 0.8022743053734303, + 0.3442511521279812, + 1.0577745772898197, + 0.18958460539579391, + 0.67689492367208, + 0.403324281796813, + 0.38034359897142167, + 1.1652185935527086, + 0.3475962057709694, + 0.4877289943397045, + 0.8110296502709389, + 1.0434644212946296, + 0.8814443182200193, + 6.9552678763866425, + 0.021231068298220634, + 0.496707322075963, + 0.7694410961121321, + 0.04485439509153366, + 0.4716257139341451, + 0.9188315104693174, + 1.5335614032883313, + 0.40320378728210926, + 0.458065252751112, + 0.5362287703901529, + 1.157962106003879, + 0.846412543207407, + 0.7136907186359167, + 0.3633312061429024, + 0.45080266147851944, + 0.3755353124611247, + 0.1873369049280882, + 0.348234536126256, + 1.4559575878083706, + 0.10141656175255775, + 0.42296276916749775, + 1.4048718810081482, + 0.7379662003368139, + 1.6450645364820957, + 0.7557175122201443, + 0.20235403068363667, + 1.04052809253335, + 0.8686469309031963, + 0.2228431161493063, + 0.4628967419266701, + 0.2775775082409382, + 0.552179598424118, + 0.33001103810966015, + 1.1987427733838558, + 2.3840759438462555, + 0.7287461466621608, + 2.36962403729558 + ], + "unique_experts": 64, + "load_cv": 0.7770272731567923, + "normalized_load_entropy": 0.9480195936333069, + "max_load_share": 0.09057971014492754 + } + }, + "s1_eos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "881f539078100523b9aac5d4894bf80032051ce6a4a9212d631eae9d152b6bdf", + "route_weight_sha256": "863b907fdfb671fc3284ea7ac74fc5e6780fdf0a130f1130abbb37ff7fa73f5f", + "loads": [ + 4, + 3, + 6, + 11, + 7, + 22, + 9, + 11, + 11, + 18, + 9, + 13, + 12, + 13, + 6, + 20, + 1, + 12, + 10, + 9, + 22, + 6, + 2, + 11, + 19, + 14, + 74, + 1, + 4, + 10, + 1, + 11, + 18, + 8, + 3, + 7, + 10, + 8, + 22, + 15, + 6, + 8, + 8, + 4, + 8, + 17, + 3, + 3, + 11, + 9, + 8, + 6, + 5, + 11, + 10, + 5, + 10, + 4, + 3, + 10, + 20, + 14, + 13, + 9 + ], + "weighted_loads": [ + 0.13432378508150578, + 0.11166523024439812, + 0.2602315191179514, + 0.43656102754175663, + 0.44421581365168095, + 1.156537540256977, + 0.37477219477295876, + 0.6571148671209812, + 1.1400533951818943, + 1.0497221145778894, + 1.625712838023901, + 0.795949874445796, + 0.8647915683686733, + 0.7872817888855934, + 0.3032638356089592, + 1.039932420477271, + 0.10470721870660782, + 0.6908332798629999, + 0.3700303751975298, + 0.33225995652287565, + 0.992169389501214, + 0.30415749177336693, + 0.06349502690136433, + 0.804223857820034, + 0.7547536473721266, + 0.8911879863590002, + 6.834602268412709, + 0.02082090638577938, + 0.17721635103225708, + 0.5725798159837723, + 0.0436924546957016, + 0.38075355708951975, + 0.9223725236952305, + 1.3280926487132092, + 0.11724337562918663, + 0.4319525081664324, + 0.43728615529835224, + 0.2833277050046945, + 0.8934303838759661, + 0.6885739732533693, + 0.37314489483833313, + 0.4002605490386486, + 0.25288073847104897, + 0.13535224087536335, + 0.33455357886850834, + 1.3495330065488815, + 0.10128104873001575, + 0.0890057273209095, + 1.3735344968736172, + 0.7086120024323463, + 1.3916978035122156, + 0.3246702216565609, + 0.1463414542376995, + 0.9088039882481098, + 0.8474053107202053, + 0.22108159959316254, + 0.5150314420461655, + 0.24866283312439919, + 0.2998625710606575, + 0.34774817712605, + 1.0496089681982994, + 1.1194053627550602, + 0.6506182011216879, + 0.33893162570893764 + ], + "unique_experts": 64, + "load_cv": 0.9090476767839046, + "normalized_load_entropy": 0.9350841464247384, + "max_load_share": 0.10914454277286136 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "a0b0b4f99d57a22e7957ccb6fca2f7673f114d6bc682204b8803beb871ff74f5", + "route_weight_sha256": "f9fd4496575cb5a0a857ea9b241f5cee0951c3dd00d45f493317342311726678", + "loads": [ + 4, + 3, + 7, + 12, + 9, + 31, + 9, + 12, + 20, + 21, + 16, + 15, + 15, + 13, + 9, + 20, + 2, + 12, + 11, + 13, + 26, + 6, + 12, + 12, + 28, + 14, + 76, + 2, + 24, + 16, + 1, + 15, + 19, + 14, + 10, + 9, + 17, + 11, + 23, + 16, + 7, + 15, + 13, + 6, + 10, + 18, + 3, + 10, + 11, + 9, + 14, + 20, + 12, + 15, + 12, + 7, + 11, + 6, + 17, + 10, + 24, + 33, + 22, + 14 + ], + "weighted_loads": [ + 0.13432378508150578, + 0.11166523024439812, + 0.2853097431361675, + 0.551492827013135, + 0.5051760207861662, + 1.467299367999658, + 0.37477219477295876, + 0.6945958733558655, + 1.7321050129830837, + 1.1809472423046827, + 1.9189108535647392, + 0.8624071329832077, + 0.9252902527805418, + 0.7872817888855934, + 0.40014662593603134, + 1.039932420477271, + 0.13341465219855309, + 0.6908332798629999, + 0.40298409946262836, + 0.46737822867839895, + 1.1772066783159971, + 0.30415749177336693, + 0.7713301535695791, + 0.8290664367377758, + 1.0809756787493825, + 0.8911879863590002, + 6.9472358878701925, + 0.05266354791820049, + 1.1428226698189974, + 0.8285471890121698, + 0.0436924546957016, + 0.5475242853945019, + 0.95124327018857, + 1.6318140002622386, + 0.37020566454157233, + 0.5324673447757959, + 0.9586868193000555, + 1.2269914175956274, + 0.9424630720168352, + 0.7366579342633486, + 0.4875612407922745, + 0.814671665430069, + 0.3961447089727699, + 0.3413379918783903, + 0.4362471494823694, + 1.4082521386444569, + 0.10128104873001575, + 0.6347499313997105, + 1.3735344968736172, + 0.7086120024323463, + 1.6226657051593065, + 1.3041545078158379, + 0.35297284089028835, + 1.1920747309923172, + 1.0230133011937141, + 0.3178491182625294, + 0.5433612503111362, + 0.33655573800206184, + 0.8676945246406831, + 0.34774817712605, + 1.204936584457755, + 2.966595380101353, + 1.0902881029760465, + 2.4100809413939714 + ], + "unique_experts": 64, + "load_cv": 0.7136295031097202, + "normalized_load_entropy": 0.9531694113947106, + "max_load_share": 0.08225108225108226 + } + }, + "s0_bos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "9bbff5ceaf05437ad8c80bfd32d18a4cc9d080eb0ee53f8384dba701ad234430", + "route_weight_sha256": "212757381b0a89adbc0faf5b6a42c34a5f4b66c84189a21c7b86eb93e8a726c7", + "loads": [ + 3, + 3, + 7, + 12, + 6, + 20, + 10, + 12, + 11, + 19, + 10, + 13, + 13, + 13, + 7, + 21, + 1, + 12, + 11, + 11, + 18, + 7, + 1, + 11, + 18, + 14, + 76, + 1, + 3, + 10, + 1, + 9, + 18, + 9, + 4, + 6, + 9, + 8, + 19, + 15, + 5, + 7, + 8, + 6, + 10, + 18, + 3, + 2, + 10, + 10, + 9, + 6, + 8, + 10, + 10, + 6, + 8, + 3, + 3, + 9, + 20, + 15, + 12, + 8 + ], + "weighted_loads": [ + 0.1010700948536396, + 0.11649460718035698, + 0.24721531942486763, + 0.4486390855163336, + 0.42215265706181526, + 1.152339607477188, + 0.4492125641554594, + 0.6644875053316355, + 1.141843982040882, + 1.0751948151737452, + 1.6351149193942547, + 0.8167113922536373, + 0.9015033524483442, + 0.7982097938656807, + 0.3577951565384865, + 1.0908976197242737, + 0.0846279188990593, + 0.6362416563260922, + 0.39566587656736374, + 0.33969372083174676, + 0.9214369934052229, + 0.3674047850072384, + 0.036726076155900955, + 0.8206705562770367, + 0.7366314493119717, + 0.8966486398130655, + 6.973973769694567, + 0.021511653438210487, + 0.1387959159910679, + 0.5875812955200672, + 0.05111432820558548, + 0.30110226731721923, + 0.9025573544204235, + 1.35628940247625, + 0.150575190782547, + 0.4204771500080824, + 0.4109163098037243, + 0.259741908772412, + 0.8000690173357725, + 0.6938717477023602, + 0.27885303273797035, + 0.35098855197429657, + 0.2111181485306588, + 0.18717225454747677, + 0.4150455668568611, + 1.3867649864405394, + 0.10883273556828499, + 0.06364953517913818, + 1.3705423213541508, + 0.739213963970542, + 2.405634567141533, + 0.3209085091948509, + 0.2167779542505741, + 0.8740279302001, + 0.872980922460556, + 0.26090285927057266, + 0.4269781578332186, + 0.12104387395083904, + 0.3001598287373781, + 0.2979861907660961, + 1.0282516535371542, + 1.170982301235199, + 0.6564968712627888, + 0.28971211053431034 + ], + "unique_experts": 64, + "load_cv": 0.9192518550376393, + "normalized_load_entropy": 0.9344289841874135, + "max_load_share": 0.11209439528023599 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "15cd9a88df3934f79b312827b8fb83d1e09729ecbb254c0690dcf69f568008a7", + "route_weight_sha256": "69affd8b5a8eb1fc4ff4b7eed2bfd97272a06426ae0573385da4ed4c841229f4", + "loads": [ + 3, + 3, + 10, + 12, + 6, + 25, + 11, + 13, + 18, + 19, + 18, + 13, + 14, + 13, + 8, + 21, + 1, + 12, + 11, + 13, + 19, + 7, + 7, + 11, + 26, + 14, + 79, + 2, + 11, + 16, + 2, + 14, + 19, + 13, + 11, + 6, + 10, + 10, + 19, + 16, + 5, + 8, + 13, + 6, + 10, + 20, + 4, + 6, + 10, + 10, + 16, + 12, + 11, + 13, + 10, + 6, + 8, + 4, + 10, + 9, + 24, + 33, + 14, + 10 + ], + "weighted_loads": [ + 0.1010700948536396, + 0.11649460718035698, + 0.3394218888133764, + 0.4486390855163336, + 0.42215265706181526, + 1.3437948094215244, + 0.5040861647576094, + 0.7194566559046507, + 1.4909917823970318, + 1.0751948151737452, + 1.9507395420223475, + 0.8167113922536373, + 0.9042462073266506, + 0.7982097938656807, + 0.3906651586294174, + 1.0908976197242737, + 0.0846279188990593, + 0.6362416563260922, + 0.39566587656736374, + 0.41316930335688085, + 0.9548846762627363, + 0.3674047850072384, + 0.6048392578959465, + 0.8206705562770367, + 1.0395134529098868, + 0.8966486398130655, + 7.534128505736589, + 0.050898993387818336, + 0.45456184819340706, + 0.8191467300057411, + 0.09146208688616753, + 0.45384549695972964, + 0.9316601883620024, + 1.542037942341267, + 0.37427409552037716, + 0.4204771500080824, + 0.5032920502126217, + 1.1603168723122508, + 0.8000690173357725, + 0.7374618910253048, + 0.27885303273797035, + 0.412031814455986, + 0.43995728379377397, + 0.18717225454747677, + 0.4150455668568611, + 1.4999660979956388, + 0.1646651178598404, + 0.45380057231523097, + 1.3705423213541508, + 0.739213963970542, + 2.7112280670553446, + 0.7206267043948174, + 0.30129781551659107, + 1.0122496522963047, + 0.872980922460556, + 0.26090285927057266, + 0.4269781578332186, + 0.1729451473802328, + 0.5594290513545275, + 0.2979861907660961, + 1.1678649801760912, + 2.4630995211191475, + 0.7169200801290572, + 1.3075516317039728 + ], + "unique_experts": 64, + "load_cv": 0.7999947489850773, + "normalized_load_entropy": 0.9470516142667882, + "max_load_share": 0.09541062801932366 + } + }, + "s1_bos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "7c87025fc34fcd04e64c62679bfed39af747e98e56b3b93a4665ece264c415c4", + "route_weight_sha256": "8a129170b622a01ebe38ff24a98949582a0b522a9cecdcf0dfc27d3cc65b9159", + "loads": [ + 4, + 4, + 6, + 10, + 6, + 21, + 9, + 12, + 12, + 19, + 10, + 13, + 12, + 13, + 6, + 21, + 1, + 12, + 11, + 10, + 20, + 8, + 0, + 11, + 17, + 13, + 76, + 2, + 4, + 10, + 1, + 9, + 20, + 8, + 4, + 6, + 7, + 7, + 22, + 15, + 5, + 7, + 7, + 6, + 9, + 17, + 3, + 2, + 11, + 9, + 9, + 6, + 8, + 10, + 10, + 5, + 10, + 5, + 4, + 10, + 19, + 14, + 12, + 8 + ], + "weighted_loads": [ + 0.1310253944247961, + 0.1396113969385624, + 0.2481540683656931, + 0.3887315168976784, + 0.43089114129543304, + 1.124867307022214, + 0.39061676152050495, + 0.7050850335508585, + 1.1877075172960758, + 1.060148486867547, + 1.5754183009266853, + 0.8396523036062717, + 0.8808629792183638, + 0.8008613996207714, + 0.3111923187971115, + 1.0961532890796661, + 0.12156334519386292, + 0.6979886535555124, + 0.4062072429805994, + 0.3389671675968202, + 0.9459899142384529, + 0.37496077828109264, + 0.0, + 0.7900545075535774, + 0.6929367482662201, + 0.8687673769891262, + 6.9976682141423225, + 0.05708060413599014, + 0.17079193331301212, + 0.5732980705797672, + 0.04516725242137909, + 0.3016372827877376, + 0.985306553542614, + 1.3664787994548533, + 0.1465202234685421, + 0.4205366764217615, + 0.31317598186433315, + 0.2577639433641252, + 0.9062040466815233, + 0.6913402527570724, + 0.31888408213853836, + 0.34776794351637363, + 0.2147723147634224, + 0.18259866908192635, + 0.38051898777484894, + 1.3457645662128925, + 0.10747676901519299, + 0.06330579146742821, + 1.3900117576122284, + 0.7177694998681545, + 1.5157132018357515, + 0.3180413208901882, + 0.21534219197928905, + 0.889241348952055, + 0.9110260270535946, + 0.24460476636886597, + 0.5298827309161425, + 0.2518170475959778, + 0.32407232373952866, + 0.3517376687377691, + 0.9699035231024027, + 1.105770442634821, + 0.6483872104436159, + 0.28893336094915867 + ], + "unique_experts": 63, + "load_cv": 0.9228796371619997, + "normalized_load_entropy": 0.9343300757068485, + "max_load_share": 0.11209439528023599 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "0073a6164d2b97eac234bf16523a44013aeb09cd767bb6ff397708223d71179e", + "route_weight_sha256": "89c1ca2441aadddda7dc70de8d6efb668205bfbce9c3351a45d6119ec337af5e", + "loads": [ + 4, + 4, + 9, + 11, + 8, + 30, + 9, + 13, + 20, + 22, + 16, + 15, + 15, + 13, + 9, + 21, + 2, + 12, + 12, + 15, + 24, + 8, + 11, + 12, + 26, + 13, + 78, + 3, + 25, + 16, + 1, + 14, + 20, + 14, + 11, + 8, + 15, + 10, + 22, + 16, + 6, + 14, + 13, + 9, + 10, + 19, + 3, + 9, + 11, + 9, + 16, + 20, + 15, + 14, + 12, + 7, + 10, + 6, + 17, + 10, + 22, + 34, + 20, + 11 + ], + "weighted_loads": [ + 0.1310253944247961, + 0.1396113969385624, + 0.3402332440018654, + 0.5036633163690567, + 0.4918513484299183, + 1.4336599686648697, + 0.39061676152050495, + 0.7425660397857428, + 1.7754182294011116, + 1.1913736145943403, + 1.8556324075907469, + 0.9061095621436834, + 0.9413616636302322, + 0.8008613996207714, + 0.4096353203058243, + 1.0961532890796661, + 0.15027077868580818, + 0.6979886535555124, + 0.439160967245698, + 0.5062858693408998, + 1.131027203053236, + 0.37496077828109264, + 0.8247713260352612, + 0.8148970864713192, + 1.019158779643476, + 0.8687673769891262, + 7.116295073181391, + 0.0871540792286396, + 1.1790313832461834, + 0.8384604025632143, + 0.04516725242137909, + 0.5084630047966812, + 0.985306553542614, + 1.6702001510038826, + 0.38604785269126296, + 0.5210515130311251, + 0.8906072769314051, + 1.1978515374560175, + 0.9062040466815233, + 0.7375226691365242, + 0.4333004280924797, + 0.762179059907794, + 0.5084402691561536, + 0.44968774914741516, + 0.41939807683229446, + 1.4489728659391403, + 0.10747676901519299, + 0.6628376415465027, + 1.3900117576122284, + 0.7177694998681545, + 1.856754457578063, + 1.2575917281210423, + 0.4219735786318779, + 1.1725120916962624, + 1.0866340175271034, + 0.3413722850382328, + 0.5298827309161425, + 0.2965398021042347, + 0.8911439068615437, + 0.3517376687377691, + 1.0767641142010689, + 3.0179023281671107, + 1.1205625836737454, + 1.3475217949599028 + ], + "unique_experts": 64, + "load_cv": 0.7172965535140796, + "normalized_load_entropy": 0.9542716630388438, + "max_load_share": 0.08441558441558442 + } + }, + "s0_x": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "82422aeac3d9bcf0e0d4c545c15ea513305c541da1b6b9a17d56f3885de53197", + "route_weight_sha256": "4191ac7e291260d4586c708a622859aa9640ae7d90129523d0f5d96825a570b5", + "loads": [ + 6, + 5, + 8, + 11, + 7, + 22, + 11, + 10, + 11, + 19, + 10, + 13, + 12, + 13, + 6, + 19, + 1, + 11, + 10, + 9, + 21, + 6, + 0, + 10, + 19, + 16, + 74, + 1, + 5, + 11, + 1, + 12, + 17, + 8, + 5, + 7, + 9, + 7, + 20, + 14, + 6, + 7, + 8, + 6, + 9, + 18, + 3, + 2, + 10, + 10, + 7, + 6, + 4, + 10, + 10, + 5, + 8, + 4, + 2, + 10, + 19, + 15, + 14, + 8 + ], + "weighted_loads": [ + 0.18160458095371723, + 0.1777641847729683, + 0.32700804993510246, + 0.4079790133982897, + 0.4466863591223955, + 1.1799666713923216, + 0.4518816042691469, + 0.6076803859323263, + 1.1361995302140713, + 1.0619532708078623, + 1.6746764443814754, + 0.8098339419811964, + 0.8659907188266516, + 0.8195398896932602, + 0.3155125416815281, + 1.0219117384403944, + 0.12339372932910919, + 0.6372031904757023, + 0.3728528991341591, + 0.30744258674485536, + 1.0639707334339619, + 0.3127230368554592, + 0.0, + 0.7618926130235195, + 0.8025926798582077, + 0.9839663319289684, + 6.955335829406977, + 0.02231246791779995, + 0.21049227938055992, + 0.6130736339837313, + 0.04518627002835274, + 0.3968158908899113, + 0.9061456024646759, + 1.347486663302334, + 0.19385038316249847, + 0.4430125281214714, + 0.4198770150542259, + 0.25561735619999126, + 0.8131997082382441, + 0.676804918795824, + 0.34942200779914856, + 0.37378718331456184, + 0.2612518836892832, + 0.1904759258031845, + 0.3752111401408911, + 1.332725239917636, + 0.11307428032159805, + 0.06688189134001732, + 1.3964034356176853, + 0.7312480248510838, + 1.3783349059522152, + 0.32307662442326546, + 0.12207969091832638, + 0.8641536608338356, + 0.892664197832346, + 0.21163203567266464, + 0.45326560549438, + 0.2323385663330555, + 0.2574802413582802, + 0.3552284352481365, + 0.9985406547784805, + 1.1788478270173073, + 0.7040813732892275, + 0.28140266984701157 + ], + "unique_experts": 63, + "load_cv": 0.9029006548356666, + "normalized_load_entropy": 0.9351558595064862, + "max_load_share": 0.10914454277286136 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "c6b190901c24314b50722878a4e89defc57459f5e70536844eaf4434ef2c91a8", + "route_weight_sha256": "355d42f98e99631017540c28e16dba4da1d6b3dbece905eeed77b4dcd865c523", + "loads": [ + 6, + 5, + 11, + 11, + 7, + 28, + 11, + 12, + 19, + 19, + 19, + 13, + 13, + 13, + 7, + 19, + 2, + 12, + 10, + 10, + 22, + 6, + 5, + 10, + 28, + 16, + 75, + 1, + 14, + 17, + 1, + 14, + 18, + 12, + 13, + 8, + 11, + 9, + 21, + 15, + 6, + 8, + 11, + 6, + 9, + 20, + 3, + 7, + 10, + 10, + 13, + 12, + 7, + 14, + 10, + 5, + 8, + 4, + 10, + 10, + 23, + 32, + 16, + 11 + ], + "weighted_loads": [ + 0.18160458095371723, + 0.1777641847729683, + 0.4281576797366142, + 0.4079790133982897, + 0.4466863591223955, + 1.400235125562176, + 0.4518816042691469, + 0.6974707897752523, + 1.5660682618618011, + 1.0619532708078623, + 2.0428485069423914, + 0.8098339419811964, + 0.868733573704958, + 0.8195398896932602, + 0.34838254377245903, + 1.0219117384403944, + 0.1682874709367752, + 0.665613466873765, + 0.3728528991341591, + 0.337076049173902, + 1.0974184162914753, + 0.3127230368554592, + 0.4109025150537491, + 0.7618926130235195, + 1.133716662414372, + 0.9839663319289684, + 7.023997630923986, + 0.02231246791779995, + 0.5685318484902382, + 0.8445353303104639, + 0.04518627002835274, + 0.45847515619948354, + 0.9352484364062548, + 1.5332352031673508, + 0.4747448656708002, + 0.47650786861777306, + 0.5548874251544476, + 1.157653006065857, + 0.8506693858653307, + 0.7197113372385502, + 0.34942200779914856, + 0.4348304457962513, + 0.3430417372062493, + 0.1904759258031845, + 0.3752111401408911, + 1.417482240125537, + 0.11307428032159805, + 0.489753375062719, + 1.3964034356176853, + 0.7312480248510838, + 1.6148904878646135, + 0.752922061830759, + 0.20659955218434334, + 1.0509168319404125, + 0.892664197832346, + 0.21163203567266464, + 0.45326560549438, + 0.2323385663330555, + 0.5477951783686876, + 0.3552284352481365, + 1.1345530524849892, + 2.4108949792571366, + 0.7548350621946156, + 1.347423069179058 + ], + "unique_experts": 64, + "load_cv": 0.7782277331412786, + "normalized_load_entropy": 0.9478937172063048, + "max_load_share": 0.09057971014492754 + } + }, + "s1_x": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "1ce8e5bc134ff03777a843feecce8ecabaebf0b151387ddaa478d9d44adf18ea", + "route_weight_sha256": "bd58d5d7e73cb7048b9b9cf9ac72e554bfcab5e596f519c83d15293d3dc69ef6", + "loads": [ + 6, + 6, + 6, + 13, + 6, + 20, + 9, + 11, + 11, + 19, + 10, + 12, + 12, + 13, + 5, + 19, + 1, + 12, + 10, + 7, + 24, + 6, + 0, + 10, + 21, + 15, + 75, + 3, + 9, + 8, + 1, + 11, + 20, + 8, + 3, + 7, + 7, + 7, + 18, + 12, + 5, + 5, + 7, + 7, + 10, + 17, + 4, + 2, + 11, + 10, + 9, + 6, + 2, + 11, + 10, + 6, + 8, + 4, + 5, + 12, + 19, + 14, + 13, + 8 + ], + "weighted_loads": [ + 0.18900352157652378, + 0.2100028246641159, + 0.2461850717663765, + 0.4942086488008499, + 0.4128693528473377, + 1.0509729012846947, + 0.3713250048458576, + 0.682938614860177, + 1.1534201614558697, + 1.0575234908610582, + 1.6041954942047596, + 0.7934728264808655, + 0.83751524053514, + 0.7920942530035973, + 0.25112004950642586, + 1.0111777186393738, + 0.11390595883131027, + 0.6715865544974804, + 0.3623317461460829, + 0.22997828493203087, + 1.1635650675743818, + 0.31214121729135513, + 0.0, + 0.7392916418612003, + 0.8178476169705391, + 0.9293595589697361, + 6.9526691026985645, + 0.08404145017266273, + 0.4255909975618124, + 0.4765626937150955, + 0.042789164930582047, + 0.36078142506084987, + 0.9886975027620792, + 1.3222967516776407, + 0.1078508235514164, + 0.4427661430090666, + 0.2977682389318943, + 0.23216743536977447, + 0.7353840991854668, + 0.6080808974802494, + 0.28488363325595856, + 0.28363493271172047, + 0.21329415862032874, + 0.21792479418218136, + 0.3917831964790821, + 1.2759207431226969, + 0.1406191848218441, + 0.06145675107836723, + 1.362947165966034, + 0.7132079750299454, + 1.6100168973207474, + 0.3257181718945503, + 0.06556905247271061, + 0.9379658252000809, + 0.8976772949099541, + 0.24946177192032337, + 0.4666398037225008, + 0.21896949969232082, + 0.35327849350869656, + 0.4041487071663141, + 0.9925387501716614, + 1.1263691522181034, + 0.651752756908536, + 0.29116478376090527 + ], + "unique_experts": 63, + "load_cv": 0.9150012637563207, + "normalized_load_entropy": 0.9348016073315802, + "max_load_share": 0.11061946902654868 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "b5bf0dfeddedaa8cab81de627db5c465a8d7b54a7e92a4a5dcb41e241da8fb1d", + "route_weight_sha256": "9d7c4dcd7963201e1ed4b6db9341dcbe113ed7cf20a616b3b865f251e8c8fcc7", + "loads": [ + 6, + 6, + 8, + 14, + 8, + 30, + 10, + 12, + 20, + 22, + 16, + 14, + 15, + 13, + 8, + 19, + 3, + 12, + 11, + 10, + 30, + 6, + 9, + 11, + 30, + 15, + 76, + 4, + 31, + 15, + 1, + 15, + 20, + 15, + 10, + 10, + 16, + 9, + 18, + 13, + 6, + 13, + 11, + 9, + 11, + 18, + 4, + 7, + 11, + 10, + 13, + 20, + 9, + 16, + 12, + 8, + 9, + 5, + 19, + 12, + 23, + 34, + 21, + 12 + ], + "weighted_loads": [ + 0.18900352157652378, + 0.2100028246641159, + 0.30804635025560856, + 0.6091404482722282, + 0.47382955998182297, + 1.3845856913831085, + 0.40030381083488464, + 0.7204196210950613, + 1.791252974420786, + 1.1887486185878515, + 1.8844096008688211, + 0.8599300850182772, + 0.8980139249470085, + 0.7920942530035973, + 0.3526194542646408, + 1.0111777186393738, + 0.17672495916485786, + 0.6715865544974804, + 0.39528547041118145, + 0.320183267019047, + 1.4185903575271368, + 0.31214121729135513, + 0.609371080994606, + 0.7641342207789421, + 1.144069648347795, + 0.9293595589697361, + 7.026264172047377, + 0.11020923033356667, + 1.4678641315549612, + 0.762430252507329, + 0.042789164930582047, + 0.5255573684444244, + 0.9886975027620792, + 1.664205852910527, + 0.34796125581488013, + 0.5959701593965292, + 0.9392785541713238, + 1.1401766701856104, + 0.7353840991854668, + 0.6573359109461308, + 0.3992999792098999, + 0.735724302008748, + 0.31272167146721586, + 0.4239105451852083, + 0.43066228553652763, + 1.3346398752182722, + 0.1406191848218441, + 0.5706537126097828, + 1.362947165966034, + 0.7132079750299454, + 1.771222461014986, + 1.3028924278914928, + 0.27220043912529945, + 1.2541928552091122, + 1.073285285383463, + 0.3462292905896902, + 0.49565851874649525, + 0.25073392130434513, + 0.9682373870164156, + 0.4041487071663141, + 1.1443043444305658, + 2.9931072131730616, + 1.0894930590875447, + 1.4059955682605505 + ], + "unique_experts": 64, + "load_cv": 0.7235396874766685, + "normalized_load_entropy": 0.9535618868193099, + "max_load_share": 0.08225108225108226 + } + }, + "s0_period": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "a9a9ed1f1f662fcbde6170f4d4323b73046fa162632a1d245464e87d5bb4f964", + "route_weight_sha256": "b2cf3d3f828e96409818a09bcf61aa22ff039ab9e4a60f2294d4f57ca5edda34", + "loads": [ + 5, + 5, + 7, + 11, + 7, + 21, + 12, + 9, + 11, + 19, + 9, + 13, + 13, + 13, + 6, + 20, + 1, + 11, + 10, + 11, + 22, + 6, + 1, + 11, + 14, + 12, + 75, + 1, + 5, + 10, + 1, + 13, + 19, + 8, + 5, + 7, + 9, + 7, + 20, + 14, + 6, + 7, + 8, + 6, + 10, + 18, + 4, + 1, + 10, + 10, + 7, + 6, + 5, + 10, + 10, + 6, + 10, + 5, + 3, + 8, + 19, + 15, + 13, + 7 + ], + "weighted_loads": [ + 0.16043119877576828, + 0.17547062784433365, + 0.30364572070539, + 0.41038618609309196, + 0.44766586273908615, + 1.1665918957442045, + 0.4793427214026451, + 0.5864730626344681, + 1.128184787929058, + 1.0650728158652782, + 1.6253177598118782, + 0.8109072148799896, + 0.8887226209044456, + 0.8077875301241875, + 0.3071996308863163, + 1.0593750029802322, + 0.07646474987268448, + 0.6556956134736538, + 0.37137193605303764, + 0.3801012585611261, + 1.0805099159479141, + 0.31494269520044327, + 0.03817764297127724, + 0.7729128152132034, + 0.6208173800259829, + 0.8093016222119331, + 7.033615853637457, + 0.022103190422058105, + 0.22327602468430996, + 0.5712723135948181, + 0.04328759014606476, + 0.43100723914494665, + 0.9581530168652534, + 1.3614878692642378, + 0.19821710139513016, + 0.43769773095846176, + 0.4279606584459543, + 0.25668522389128157, + 0.8166093770414591, + 0.6767132431268692, + 0.3624274283647537, + 0.370117774233222, + 0.26265360382581093, + 0.18696070462465286, + 0.4037222769111395, + 1.3460173718631268, + 0.1431209221482277, + 0.023903587833046913, + 1.3936362713575363, + 0.7275689970701933, + 1.3604938630014658, + 0.3292115144431591, + 0.14918594621121883, + 0.8618498165160418, + 0.9052397944033146, + 0.23454776220023632, + 0.5111270602792501, + 0.253815608099103, + 0.29476233199238777, + 0.28014278411865234, + 0.9970836527645588, + 1.1861763335764408, + 0.6834800075739622, + 0.26279422640800476 + ], + "unique_experts": 64, + "load_cv": 0.9065938694921772, + "normalized_load_entropy": 0.936748032198713, + "max_load_share": 0.11061946902654868 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "572bc728e8df22473e5e8cf56087a2f47aad2207d6b23d714b7d6d3d2072d451", + "route_weight_sha256": "e9cbbe0206074ce094fa2758a2bd89074d0e791910fc19ac020d9ea0644e171b", + "loads": [ + 5, + 5, + 10, + 11, + 7, + 27, + 12, + 11, + 18, + 19, + 17, + 13, + 14, + 13, + 7, + 20, + 2, + 12, + 10, + 12, + 23, + 6, + 6, + 11, + 22, + 12, + 76, + 1, + 14, + 15, + 1, + 15, + 20, + 13, + 12, + 7, + 10, + 10, + 20, + 15, + 6, + 9, + 12, + 7, + 10, + 19, + 4, + 6, + 10, + 10, + 14, + 13, + 8, + 13, + 10, + 6, + 11, + 6, + 10, + 8, + 23, + 33, + 16, + 10 + ], + "weighted_loads": [ + 0.16043119877576828, + 0.17547062784433365, + 0.3999024089425802, + 0.41038618609309196, + 0.44766586273908615, + 1.3913087917026132, + 0.4793427214026451, + 0.6806206665933132, + 1.4773325882852077, + 1.0650728158652782, + 1.940942382439971, + 0.8109072148799896, + 0.891465475782752, + 0.8077875301241875, + 0.34006963297724724, + 1.0593750029802322, + 0.14853005856275558, + 0.6840934678912163, + 0.37137193605303764, + 0.41174492488812575, + 1.1139575988054276, + 0.31494269520044327, + 0.46162738278508186, + 0.7729128152132034, + 0.923699383623898, + 0.8093016222119331, + 7.103651870042086, + 0.022103190422058105, + 0.5792212467640638, + 0.7668936587870121, + 0.04328759014606476, + 0.49430166847696455, + 0.9872558508068323, + 1.5850164593175577, + 0.4497308563441038, + 0.43769773095846176, + 0.5203363988548517, + 1.1882715639610524, + 0.8166093770414591, + 0.7231802493333817, + 0.3624274283647537, + 0.49190555326640606, + 0.3805646916405294, + 0.22433705255389214, + 0.4037222769111395, + 1.3955126963555813, + 0.1431209221482277, + 0.45058887102641165, + 1.3936362713575363, + 0.7275689970701933, + 1.6814159639179707, + 0.8377767130732536, + 0.2337058074772358, + 1.0000715386122465, + 0.9052397944033146, + 0.23454776220023632, + 0.5419809762388468, + 0.2850186061114073, + 0.5545330382883549, + 0.28014278411865234, + 1.1312103532254696, + 2.503108431119472, + 0.7698812861926854, + 1.340317029505968 + ], + "unique_experts": 64, + "load_cv": 0.7707547417600943, + "normalized_load_entropy": 0.9502532380025009, + "max_load_share": 0.09178743961352658 + } + }, + "s1_period": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "b4f589689bc495caa15ca416415bb259a7a2d5a15419e674a3330ad7be6ebd11", + "route_weight_sha256": "a021340a3a51aa43bb9db6d343e5f54ca25ad78e4f65fca9fd32d44469e71022", + "loads": [ + 6, + 4, + 6, + 12, + 7, + 19, + 9, + 11, + 10, + 19, + 10, + 12, + 11, + 13, + 5, + 18, + 1, + 11, + 10, + 8, + 27, + 6, + 1, + 11, + 18, + 16, + 75, + 2, + 11, + 9, + 1, + 13, + 21, + 8, + 3, + 7, + 5, + 7, + 17, + 13, + 5, + 6, + 7, + 7, + 10, + 17, + 5, + 1, + 11, + 10, + 8, + 7, + 3, + 11, + 10, + 6, + 8, + 5, + 4, + 11, + 19, + 14, + 12, + 8 + ], + "weighted_loads": [ + 0.19587824121117592, + 0.14931166544556618, + 0.24184269085526466, + 0.4737309664487839, + 0.45586055144667625, + 1.012491075322032, + 0.37190745398402214, + 0.6765782628208399, + 1.11674515157938, + 1.0609829500317574, + 1.6124340929090977, + 0.7878100648522377, + 0.813513670116663, + 0.7884362079203129, + 0.23977255076169968, + 0.9717947319149971, + 0.09001347422599792, + 0.63082573749125, + 0.369946613907814, + 0.25850632335527735, + 1.3050954043865204, + 0.31153156980872154, + 0.037878695875406265, + 0.7941526733338833, + 0.6910426393151283, + 0.9543611835688353, + 6.88190334290266, + 0.06083895079791546, + 0.5287759024649858, + 0.5067802332341671, + 0.04034273326396942, + 0.4222714321855392, + 1.0106430687010288, + 1.318923096105209, + 0.10797679424285889, + 0.4459196701645851, + 0.22686109691858292, + 0.22655459360998975, + 0.7122815307229757, + 0.6370507944375277, + 0.30495699867606163, + 0.31388239935040474, + 0.22132513806377574, + 0.21937711350619793, + 0.382929103448987, + 1.2642895504832268, + 0.1630220077931881, + 0.024864306673407555, + 1.4051507338881493, + 0.7080210708081722, + 1.6058617066591978, + 0.37748127430677414, + 0.09019703231751919, + 0.9409385733306408, + 0.8991914764046669, + 0.242742870002985, + 0.48619814217090607, + 0.23092983290553093, + 0.32266996800899506, + 0.3618062883615494, + 0.9872186277061701, + 1.090332467108965, + 0.6117993108928204, + 0.2962784245610237 + ], + "unique_experts": 64, + "load_cv": 0.9154576282591836, + "normalized_load_entropy": 0.9353938376685453, + "max_load_share": 0.11061946902654868 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "5d73b80eb1264ead35515e144d4425983963f5d6877254f732ee2967816df9fb", + "route_weight_sha256": "ac239c809caf5d21bc567029a16eda82d970726e88eb20ceeb0c3b05a1dc0c2a", + "loads": [ + 6, + 4, + 8, + 13, + 9, + 29, + 9, + 13, + 18, + 22, + 16, + 14, + 14, + 13, + 9, + 18, + 2, + 11, + 11, + 11, + 32, + 6, + 10, + 12, + 28, + 16, + 76, + 3, + 33, + 15, + 1, + 16, + 22, + 14, + 10, + 9, + 12, + 10, + 17, + 14, + 6, + 15, + 10, + 10, + 11, + 18, + 5, + 7, + 11, + 10, + 15, + 22, + 10, + 16, + 12, + 8, + 9, + 5, + 19, + 11, + 22, + 34, + 20, + 12 + ], + "weighted_loads": [ + 0.19587824121117592, + 0.14931166544556618, + 0.30380977503955364, + 0.5886627659201622, + 0.5168207585811615, + 1.3416909349616617, + 0.37190745398402214, + 0.7531316410750151, + 1.7044558636844158, + 1.1922080777585506, + 1.8926481995731592, + 0.8542673233896494, + 0.8740123545285314, + 0.7884362079203129, + 0.36592536233365536, + 0.9717947319149971, + 0.11872090771794319, + 0.63082573749125, + 0.4029003381729126, + 0.3474268439738353, + 1.5213482026010752, + 0.31153156980872154, + 0.6547763012349606, + 0.8189952522516251, + 1.0545676751062274, + 0.9543611835688353, + 6.951636612415314, + 0.08942510560154915, + 1.594226874411106, + 0.7665511388331652, + 0.04034273326396942, + 0.5612044090572681, + 1.044046562165022, + 1.6226444476542383, + 0.3537015705369413, + 0.5464345067739487, + 0.7482617609202862, + 1.1700580702893149, + 0.7122815307229757, + 0.6833957452327013, + 0.419373344630003, + 0.8174592740833759, + 0.2950170807928316, + 0.47367661260068417, + 0.42180819250643253, + 1.323008682578802, + 0.1630220077931881, + 0.6114289837423712, + 1.4051507338881493, + 0.7080210708081722, + 1.905409274622798, + 1.396904917433858, + 0.29682841897010803, + 1.268230862915516, + 1.0747994668781757, + 0.33951038867235184, + 0.5147860944271088, + 0.23092983290553093, + 0.9673456326127052, + 0.3618062883615494, + 1.0997433364391327, + 2.952216359321028, + 1.0525741004385054, + 1.4176887162029743 + ], + "unique_experts": 64, + "load_cv": 0.7269505573783525, + "normalized_load_entropy": 0.9527289232722663, + "max_load_share": 0.08225108225108226 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 113, + "ordered_topk_exact_tokens": 70, + "set_exact_tokens": 86, + "mean_set_jaccard": 0.9279393173198484, + "mean_token_weighted_tv": 0.014700354675527407, + "aggregate_load_tv": 0.025073746312684362 + }, + "system_bos": { + "tokens": 113, + "ordered_topk_exact_tokens": 56, + "set_exact_tokens": 77, + "mean_set_jaccard": 0.8987357774968395, + "mean_token_weighted_tv": 0.024286282780028975, + "aggregate_load_tv": 0.030973451327433628 + }, + "system_x": { + "tokens": 113, + "ordered_topk_exact_tokens": 46, + "set_exact_tokens": 61, + "mean_set_jaccard": 0.8537715971344291, + "mean_token_weighted_tv": 0.029555195849385416, + "aggregate_load_tv": 0.04867256637168142 + }, + "system_period": { + "tokens": 113, + "ordered_topk_exact_tokens": 36, + "set_exact_tokens": 54, + "mean_set_jaccard": 0.8360724820901811, + "mean_token_weighted_tv": 0.032845959117259724, + "aggregate_load_tv": 0.05604719764011799 + }, + "bos_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 54, + "set_exact_tokens": 72, + "mean_set_jaccard": 0.8908171474543156, + "mean_token_weighted_tv": 0.025442712343185354, + "aggregate_load_tv": 0.03392330383480825 + }, + "bos_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 48, + "set_exact_tokens": 73, + "mean_set_jaccard": 0.8893805309734514, + "mean_token_weighted_tv": 0.022586345653447165, + "aggregate_load_tv": 0.03687315634218289 + }, + "x_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 60, + "set_exact_tokens": 79, + "mean_set_jaccard": 0.9121365360303414, + "mean_token_weighted_tv": 0.01882340106826793, + "aggregate_load_tv": 0.032448377581120944 + }, + "x_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 43, + "set_exact_tokens": 56, + "mean_set_jaccard": 0.8392330383480827, + "mean_token_weighted_tv": 0.032212978042937004, + "aggregate_load_tv": 0.054572271386430685 + }, + "period_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 57, + "set_exact_tokens": 75, + "mean_set_jaccard": 0.902022756005057, + "mean_token_weighted_tv": 0.01939667118019911, + "aggregate_load_tv": 0.035398230088495575 + }, + "period_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 34, + "set_exact_tokens": 52, + "mean_set_jaccard": 0.8268015170670038, + "mean_token_weighted_tv": 0.0344842473821039, + "aggregate_load_tv": 0.05899705014749264 + } + } + }, + "layer_25": { + "layer": 25, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "3afb80f9de0636066f3f3bf74839d2d4c31aa2e48011cfcafa131a63f52f947d", + "route_weight_sha256": "88fce0c3a88127f1efeb853be8620f99b20ee707a4ea1f572c7c2ccf9d0e6aed", + "loads": [ + 7, + 8, + 5, + 17, + 16, + 9, + 21, + 9, + 10, + 21, + 6, + 8, + 7, + 7, + 12, + 9, + 9, + 16, + 21, + 10, + 10, + 6, + 9, + 31, + 8, + 12, + 2, + 13, + 12, + 9, + 25, + 12, + 7, + 4, + 3, + 13, + 12, + 8, + 10, + 4, + 14, + 6, + 10, + 7, + 7, + 12, + 3, + 8, + 9, + 4, + 11, + 5, + 12, + 16, + 18, + 13, + 20, + 5, + 9, + 7, + 8, + 9, + 9, + 18 + ], + "weighted_loads": [ + 0.46984798088669777, + 0.7195708639919758, + 0.19322295300662518, + 1.4414246324449778, + 0.913110263645649, + 0.5720708407461643, + 1.5836561881005764, + 1.2062031738460064, + 0.4663160089403391, + 0.9340682215988636, + 0.2989922743290663, + 0.3990663979202509, + 0.43629996106028557, + 0.32077566161751747, + 0.9079345595091581, + 0.4144850391894579, + 0.44567546620965004, + 1.1441188920289278, + 2.7249234057962894, + 0.8824440222233534, + 0.705306887626648, + 0.20772827044129372, + 0.481731291860342, + 1.8307508025318384, + 0.5588349960744381, + 1.3515926394611597, + 0.08951601386070251, + 0.7409630231559277, + 0.48922632448375225, + 0.3659679424017668, + 1.7248467281460762, + 0.9383057300001383, + 0.29828903265297413, + 0.15915045142173767, + 0.08386771567165852, + 1.2985860519111156, + 0.6477810461074114, + 0.3650849387049675, + 1.353062480688095, + 0.9931624718010426, + 0.7682829983532429, + 0.2846454381942749, + 0.6387712750583887, + 0.328085582703352, + 0.5785873513668776, + 0.7423425298184156, + 0.11972241848707199, + 1.0925307385623455, + 1.5479917209595442, + 0.1244593895971775, + 0.6249904725700617, + 0.20415384881198406, + 1.1170402057468891, + 0.993158521130681, + 1.218974780291319, + 0.9799095280468464, + 0.7901131883263588, + 0.19916815124452114, + 0.37614746391773224, + 0.27325122617185116, + 0.477207001298666, + 0.6867856234312057, + 1.2080823350697756, + 1.2885102704167366 + ], + "unique_experts": 64, + "load_cv": 0.5215068934118596, + "normalized_load_entropy": 0.9699168904809683, + "max_load_share": 0.045722713864306784 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "ece8c6236a0608e5c24e2914864b7a2827736c49dd87f00bc31c3a2c4db2fc9a", + "route_weight_sha256": "e2e66793d416f3c62a278d7ce65478a7004be3ee0dbcd5244f9419212b57e808", + "loads": [ + 9, + 26, + 11, + 18, + 17, + 9, + 27, + 10, + 10, + 21, + 15, + 12, + 10, + 8, + 12, + 9, + 9, + 20, + 23, + 10, + 10, + 7, + 9, + 35, + 8, + 12, + 2, + 13, + 13, + 11, + 25, + 13, + 9, + 5, + 5, + 14, + 12, + 9, + 20, + 6, + 20, + 7, + 10, + 8, + 13, + 22, + 6, + 9, + 9, + 4, + 21, + 5, + 18, + 16, + 27, + 13, + 21, + 7, + 9, + 7, + 10, + 9, + 15, + 18 + ], + "weighted_loads": [ + 0.5794898457825184, + 2.188596841180697, + 0.5464115999639034, + 1.5066372994333506, + 1.0429935827851295, + 0.5720708407461643, + 1.9948021285235882, + 1.2426435761153698, + 0.4663160089403391, + 0.9340682215988636, + 1.1987530644983053, + 1.0832346328534186, + 0.5893984027206898, + 0.3867740295827389, + 0.9079345595091581, + 0.4144850391894579, + 0.44567546620965004, + 1.2741716280579567, + 2.8097302634269, + 0.8824440222233534, + 0.705306887626648, + 0.2626446783542633, + 0.481731291860342, + 1.9785483609884977, + 0.5588349960744381, + 1.3515926394611597, + 0.08951601386070251, + 0.7409630231559277, + 0.5307217258960009, + 0.43501745350658894, + 1.7248467281460762, + 1.0271514374762774, + 0.4047431033104658, + 0.21967210993170738, + 0.19103826023638248, + 1.4067825488746166, + 0.6477810461074114, + 0.4190319813787937, + 2.780224597081542, + 1.1925073862075806, + 1.0208359584212303, + 0.3137774094939232, + 0.6387712750583887, + 0.3609098345041275, + 1.043204603716731, + 1.6166490726172924, + 0.2107921369606629, + 1.1292852498590946, + 1.5479917209595442, + 0.1244593895971775, + 1.2145367246121168, + 0.20415384881198406, + 1.4176724995486438, + 0.993158521130681, + 1.6556839845143259, + 0.9799095280468464, + 0.8241625130176544, + 0.27021064050495625, + 0.37614746391773224, + 0.27325122617185116, + 0.5712879821658134, + 0.6867856234312057, + 1.6558994706720114, + 1.2885102704167366 + ], + "unique_experts": 64, + "load_cv": 0.5094041979944324, + "normalized_load_entropy": 0.9707589966266863, + "max_load_share": 0.042270531400966184 + } + }, + "s1_eos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "c23bd90c14067c62e658d09369f52e26628452672bd69401642c7bd073c285e1", + "route_weight_sha256": "720337b9a202dc9c8c03664d91b6c413542ec1faf173d61d4533352c6ee9211c", + "loads": [ + 9, + 8, + 6, + 18, + 15, + 9, + 22, + 9, + 11, + 21, + 5, + 7, + 7, + 8, + 11, + 11, + 9, + 16, + 21, + 9, + 10, + 6, + 7, + 29, + 9, + 12, + 3, + 13, + 11, + 9, + 25, + 12, + 7, + 4, + 4, + 13, + 13, + 8, + 10, + 4, + 13, + 5, + 9, + 6, + 7, + 12, + 3, + 9, + 8, + 4, + 10, + 6, + 12, + 16, + 17, + 14, + 23, + 5, + 9, + 6, + 8, + 9, + 9, + 17 + ], + "weighted_loads": [ + 0.5402358863502741, + 0.695597268640995, + 0.24615989066660404, + 1.475718593224883, + 0.9273258708417416, + 0.5691359750926495, + 1.6124835498631, + 1.203844852745533, + 0.4826690685003996, + 0.8866237327456474, + 0.26640986278653145, + 0.3700059801340103, + 0.4207024946808815, + 0.33458653278648853, + 0.8798870332539082, + 0.470943808555603, + 0.4362664744257927, + 1.1248939577490091, + 2.6955220755189657, + 0.8087718021124601, + 0.7113596834242344, + 0.20408395491540432, + 0.42751217633485794, + 1.7602299191057682, + 0.5766264442354441, + 1.3596787191927433, + 0.12010127864778042, + 0.73320447281003, + 0.46164637617766857, + 0.36969044245779514, + 1.7585480827838182, + 0.9298524986952543, + 0.2972311582416296, + 0.16566544398665428, + 0.11414578929543495, + 1.2573823891580105, + 0.6883191522210836, + 0.3207793887704611, + 1.3456119522452354, + 1.0119578167796135, + 0.7094968482851982, + 0.25883008912205696, + 0.6056522503495216, + 0.30606265366077423, + 0.5598400123417377, + 0.7281482089310884, + 0.11127943731844425, + 1.114153603091836, + 1.485433004796505, + 0.1191400308161974, + 0.6047500222921371, + 0.22159921191632748, + 1.1240645051002502, + 1.0055478494614363, + 1.1723042633384466, + 1.0260672215372324, + 0.8956281468272209, + 0.19171585515141487, + 0.37373244762420654, + 0.25453620962798595, + 0.46255174092948437, + 0.6847259700298309, + 1.2471514008939266, + 1.245991112664342 + ], + "unique_experts": 64, + "load_cv": 0.5174868670456882, + "normalized_load_entropy": 0.9705682886564048, + "max_load_share": 0.04277286135693215 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "5edec84ddf1c8713a90dd5354c92a637d078a79f8e3908f88853468b32e7cc83", + "route_weight_sha256": "975bd90cc06662dc4bd9cf3dce42b891bb359515280fa91bb91e2f0251065239", + "loads": [ + 12, + 32, + 14, + 20, + 16, + 11, + 28, + 10, + 13, + 22, + 26, + 11, + 12, + 9, + 11, + 12, + 10, + 24, + 23, + 10, + 13, + 14, + 7, + 35, + 9, + 12, + 4, + 13, + 12, + 12, + 25, + 15, + 12, + 4, + 6, + 14, + 14, + 14, + 20, + 8, + 20, + 5, + 10, + 7, + 17, + 27, + 5, + 9, + 8, + 6, + 22, + 7, + 19, + 23, + 30, + 15, + 25, + 8, + 10, + 7, + 12, + 10, + 14, + 19 + ], + "weighted_loads": [ + 0.8137191366404295, + 2.6941283775959164, + 0.6987604890018702, + 1.604802655056119, + 1.0385063476860523, + 0.6446959599852562, + 2.171883776783943, + 1.2383361533284187, + 0.5969071183353662, + 0.914631076157093, + 2.120581228286028, + 1.0899914456531405, + 0.7059844695031643, + 0.3769619558006525, + 0.8798870332539082, + 0.5168388187885284, + 0.4714602269232273, + 1.7723117042332888, + 2.802653880789876, + 0.8321314696222544, + 0.9696442596614361, + 0.8914500139653683, + 0.42751217633485794, + 1.979870043694973, + 0.5766264442354441, + 1.3596787191927433, + 0.1538983192294836, + 0.73320447281003, + 0.5063063409179449, + 0.47574801556766033, + 1.7585480827838182, + 1.400441063567996, + 0.5246015302836895, + 0.16566544398665428, + 0.22301923111081123, + 1.3575879447162151, + 0.7343154419213533, + 0.5943583380430937, + 3.0320179164409637, + 1.3922453373670578, + 1.0316571444272995, + 0.25883008912205696, + 0.6916855946183205, + 0.3362751603126526, + 1.3213637731969357, + 2.0635420344769955, + 0.15387121075764298, + 1.114153603091836, + 1.485433004796505, + 0.19409888423979282, + 1.34290018863976, + 0.26859605498611927, + 1.5588860153220594, + 1.5124668758362532, + 1.9898262056522071, + 1.0525682885199785, + 0.9773616027086973, + 0.30254006013274193, + 0.41162316128611565, + 0.34205679409205914, + 0.6952626761049032, + 0.728229220956564, + 1.6683992370963097, + 1.3048068825155497 + ], + "unique_experts": 64, + "load_cv": 0.5010997818406346, + "normalized_load_entropy": 0.9713064311380174, + "max_load_share": 0.03787878787878788 + } + }, + "s0_bos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "1f619effffa8334c3f7acff1f42fc3254e8ca88a4bbbcf55b78e9038c90d302b", + "route_weight_sha256": "d5a3efe903a4dd8c53f4a81ea655d5fab35dec50ce8b22ba654466056aab0386", + "loads": [ + 8, + 8, + 8, + 17, + 15, + 11, + 20, + 9, + 10, + 23, + 5, + 8, + 8, + 5, + 11, + 9, + 9, + 16, + 21, + 9, + 10, + 5, + 8, + 31, + 9, + 12, + 2, + 13, + 11, + 9, + 24, + 13, + 7, + 5, + 3, + 13, + 11, + 7, + 10, + 4, + 14, + 6, + 9, + 6, + 8, + 13, + 5, + 9, + 8, + 3, + 12, + 6, + 12, + 16, + 18, + 13, + 19, + 5, + 8, + 6, + 9, + 9, + 9, + 18 + ], + "weighted_loads": [ + 0.515064524486661, + 0.701490955427289, + 0.28572000190615654, + 1.4428296592086554, + 0.9169931523501873, + 0.6333314292132854, + 1.5826994702219963, + 1.2114786505699158, + 0.4588698148727417, + 0.9748660791665316, + 0.2664767988026142, + 0.3936125822365284, + 0.4555455781519413, + 0.22634144313633442, + 0.884814914315939, + 0.38198799826204777, + 0.44578592106699944, + 1.0892927255481482, + 2.70759155228734, + 0.8591313846409321, + 0.7238882146775723, + 0.17876118049025536, + 0.45597900077700615, + 1.783814411610365, + 0.5735101848840714, + 1.347472906112671, + 0.0901545099914074, + 0.7352316975593567, + 0.474359679967165, + 0.37024736404418945, + 1.7793646492064, + 0.9630938582122326, + 0.29355368949472904, + 0.17601303942501545, + 0.09797091968357563, + 1.3108651116490364, + 0.5932695865631104, + 0.2999366484582424, + 1.3269020207226276, + 0.9362048879265785, + 0.7867819517850876, + 0.2903874609619379, + 0.6088369563221931, + 0.24128069542348385, + 0.5973011609166861, + 0.7780338246375322, + 0.19471650943160057, + 1.1261786259710789, + 1.4941807687282562, + 0.10544686950743198, + 0.6711681112647057, + 0.23535613529384136, + 1.1210823580622673, + 0.99521928653121, + 1.2403181158006191, + 1.0177044365555048, + 0.7453243210911751, + 0.1958903670310974, + 0.33756910637021065, + 0.2292834408581257, + 0.523410614579916, + 0.694607213139534, + 1.1709075011312962, + 1.738835446536541 + ], + "unique_experts": 64, + "load_cv": 0.5161399004091037, + "normalized_load_entropy": 0.9705836103634566, + "max_load_share": 0.045722713864306784 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "8f979e3f798e170249225cdcf3f41b2d4157a62ab5649f0c04b23ef1e3d17bbc", + "route_weight_sha256": "a79547363d5b75cbbcd9d049b03247a33854632d5317d1e536bccb3e749601de", + "loads": [ + 9, + 26, + 15, + 18, + 16, + 11, + 26, + 11, + 10, + 23, + 15, + 11, + 11, + 6, + 11, + 9, + 9, + 20, + 23, + 9, + 10, + 6, + 8, + 34, + 9, + 12, + 2, + 13, + 12, + 10, + 25, + 14, + 8, + 6, + 5, + 14, + 11, + 8, + 19, + 5, + 20, + 8, + 9, + 8, + 14, + 22, + 8, + 9, + 8, + 4, + 22, + 6, + 17, + 16, + 28, + 13, + 19, + 9, + 9, + 6, + 10, + 9, + 15, + 19 + ], + "weighted_loads": [ + 0.5688643958419561, + 2.136278437683359, + 0.7439120039343834, + 1.573084807023406, + 1.0580060444772243, + 0.6333314292132854, + 1.993845410645008, + 1.2987494952976704, + 0.4588698148727417, + 0.9748660791665316, + 1.2338033020496368, + 1.0685530491173267, + 0.6438477709889412, + 0.2880632486194372, + 0.884814914315939, + 0.38198799826204777, + 0.44578592106699944, + 1.219345461577177, + 2.789842428639531, + 0.8591313846409321, + 0.7238882146775723, + 0.23631004244089127, + 0.45597900077700615, + 1.909278567880392, + 0.5735101848840714, + 1.347472906112671, + 0.0901545099914074, + 0.7352316975593567, + 0.5158550813794136, + 0.40356022119522095, + 1.9608647264540195, + 1.0519395656883717, + 0.3459726069122553, + 0.23653469793498516, + 0.21330168657004833, + 1.423109531402588, + 0.5932695865631104, + 0.3513510972261429, + 1.844252998009324, + 1.0905950590968132, + 1.039334911853075, + 0.35715329088270664, + 0.6088369563221931, + 0.31198023818433285, + 1.0558571312576532, + 1.6090785786509514, + 0.3313440904021263, + 1.1261786259710789, + 1.4941807687282562, + 0.14941503293812275, + 1.2607143633067608, + 0.23535613529384136, + 1.417526300996542, + 0.99521928653121, + 1.7328681773506105, + 1.0177044365555048, + 0.7453243210911751, + 0.3363856691867113, + 0.3648632876574993, + 0.2292834408581257, + 0.5766190811991692, + 0.694607213139534, + 1.618724636733532, + 1.7704566977918148 + ], + "unique_experts": 64, + "load_cv": 0.5077522207471783, + "normalized_load_entropy": 0.9708181102597224, + "max_load_share": 0.04106280193236715 + } + }, + "s1_bos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "424f69b1d4b817e8b169b57277a6dc0f17cf20f603057d6ab4142bfcf122c436", + "route_weight_sha256": "c68f4fdabfcd0b4069245c39c202084e210e765ecdb45f099ba6ca522c9da9b0", + "loads": [ + 8, + 8, + 8, + 18, + 15, + 10, + 20, + 9, + 8, + 20, + 5, + 6, + 7, + 7, + 12, + 11, + 10, + 16, + 20, + 9, + 10, + 6, + 7, + 31, + 10, + 12, + 4, + 13, + 10, + 8, + 24, + 13, + 8, + 5, + 2, + 13, + 11, + 8, + 10, + 4, + 14, + 7, + 10, + 6, + 8, + 12, + 4, + 9, + 9, + 3, + 12, + 6, + 12, + 16, + 17, + 14, + 19, + 4, + 8, + 8, + 9, + 9, + 9, + 17 + ], + "weighted_loads": [ + 0.5265239551663399, + 0.701538810506463, + 0.2973198052495718, + 1.4946216903626919, + 0.9624660275876522, + 0.6046716794371605, + 1.5672033727169037, + 1.179590456187725, + 0.38020288944244385, + 0.8287207260727882, + 0.2749561481177807, + 0.3416343741118908, + 0.41336972638964653, + 0.2950810883194208, + 0.9106337167322636, + 0.47902221977710724, + 0.4855803232640028, + 1.091461069881916, + 2.6427884213626385, + 0.8524873144924641, + 0.705417700111866, + 0.20567450486123562, + 0.4234921261668205, + 1.8101661410182714, + 0.6201310083270073, + 1.3937614243477583, + 0.1458497066050768, + 0.7343931458890438, + 0.44688801281154156, + 0.34319281205534935, + 1.8159984145313501, + 0.9526789840310812, + 0.31036668457090855, + 0.1962397787719965, + 0.06085896119475365, + 1.310241762548685, + 0.5989205688238144, + 0.3264046646654606, + 1.337613306939602, + 0.9329242892563343, + 0.760663740336895, + 0.3366430178284645, + 0.6318698357790709, + 0.28120565973222256, + 0.5747190937399864, + 0.7286081481724977, + 0.15876001864671707, + 1.046388067305088, + 1.5313777178525925, + 0.10552020370960236, + 0.6768196374177933, + 0.23592353984713554, + 1.1548644304275513, + 1.0260296445339918, + 1.1888024061918259, + 1.0696574933826923, + 0.7590538635849953, + 0.18123528361320496, + 0.3275830056518316, + 0.2776837460696697, + 0.5028692930936813, + 0.6976168155670166, + 1.3656022418290377, + 1.2531732879579067 + ], + "unique_experts": 64, + "load_cv": 0.4991356160812761, + "normalized_load_entropy": 0.9723247030134036, + "max_load_share": 0.045722713864306784 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "e4996da069b85180857f41c1f199e3f05ce7a9107981f5770c712d03367234c5", + "route_weight_sha256": "c89b4e46b27b087b6e30ac169ea2c2f0cf54c5323e9901f154690c56e5d6be97", + "loads": [ + 11, + 33, + 18, + 19, + 16, + 12, + 26, + 10, + 12, + 21, + 27, + 9, + 14, + 7, + 12, + 11, + 10, + 24, + 22, + 10, + 13, + 14, + 7, + 37, + 10, + 12, + 5, + 13, + 11, + 10, + 24, + 16, + 14, + 5, + 4, + 14, + 12, + 13, + 19, + 7, + 21, + 7, + 11, + 7, + 18, + 27, + 6, + 9, + 9, + 5, + 24, + 7, + 18, + 23, + 31, + 15, + 22, + 7, + 9, + 9, + 12, + 10, + 14, + 19 + ], + "weighted_loads": [ + 0.7687878347933292, + 2.699652742827311, + 0.8729798253625631, + 1.5601240880787373, + 1.1010634265840054, + 0.6802316643297672, + 2.126603599637747, + 1.2145615369081497, + 0.5798309184610844, + 0.8567280694842339, + 2.2542826160788536, + 1.0370976328849792, + 0.7859023679047823, + 0.2950810883194208, + 0.9106337167322636, + 0.47902221977710724, + 0.4855803232640028, + 1.7388788163661957, + 2.7482821457087994, + 0.8758469820022583, + 0.9637022763490677, + 0.9034661240875721, + 0.4234921261668205, + 2.0354833137243986, + 0.6201310083270073, + 1.3937614243477583, + 0.17964674718677998, + 0.7343931458890438, + 0.4915479775518179, + 0.4136359840631485, + 1.8159984145313501, + 1.423267548903823, + 0.5886024236679077, + 0.1962397787719965, + 0.16757765784859657, + 1.4191228784620762, + 0.6449168585240841, + 0.5598331950604916, + 2.123062938451767, + 1.2617463059723377, + 1.0828240364789963, + 0.3366430178284645, + 0.7179031800478697, + 0.3114181663841009, + 1.3530967943370342, + 2.0297621693462133, + 0.2596678175032139, + 1.046388067305088, + 1.5313777178525925, + 0.19796960055828094, + 1.4149698037654161, + 0.26520245522260666, + 1.5854927226901054, + 1.5329486709088087, + 2.048824371304363, + 1.0961585603654385, + 0.9080683831125498, + 0.3103192187845707, + 0.3598995488137007, + 0.3652043305337429, + 0.6799687631428242, + 0.7411200664937496, + 1.7868500780314207, + 1.3119890578091145 + ], + "unique_experts": 64, + "load_cv": 0.5064565051049563, + "normalized_load_entropy": 0.971042114340632, + "max_load_share": 0.04004329004329004 + } + }, + "s0_x": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "54e1f37df06472a88567cbad813d2519a2e825d88cf3810822384c07aac4f858", + "route_weight_sha256": "1670ca72fdf66caf05c5915e962f662b82aeb1e2185c62ab464b41c6b96af685", + "loads": [ + 8, + 8, + 6, + 16, + 16, + 10, + 20, + 9, + 9, + 24, + 5, + 8, + 7, + 6, + 13, + 10, + 8, + 16, + 20, + 10, + 10, + 5, + 8, + 30, + 8, + 12, + 2, + 13, + 10, + 8, + 24, + 12, + 7, + 5, + 4, + 13, + 13, + 8, + 10, + 4, + 15, + 7, + 10, + 8, + 7, + 12, + 4, + 9, + 8, + 3, + 12, + 6, + 12, + 15, + 18, + 13, + 18, + 5, + 8, + 6, + 10, + 9, + 10, + 18 + ], + "weighted_loads": [ + 0.5010751951485872, + 0.7185431607067585, + 0.2206195704638958, + 1.397525031119585, + 0.943205701187253, + 0.6011333502829075, + 1.6012839786708355, + 1.2304082624614239, + 0.418149009346962, + 1.038935525342822, + 0.28590577095746994, + 0.4059045631438494, + 0.42499564588069916, + 0.2841861341148615, + 0.928921289741993, + 0.4470368269830942, + 0.3934016413986683, + 1.1030561588704586, + 2.712655331939459, + 0.906389057636261, + 0.7248802743852139, + 0.1741417646408081, + 0.45407386124134064, + 1.8155471440404654, + 0.5539322830736637, + 1.3657539151608944, + 0.08709350228309631, + 0.7403108067810535, + 0.4241259917616844, + 0.33541647903621197, + 1.7802602015435696, + 0.9021918624639511, + 0.288645813241601, + 0.18578578904271126, + 0.117610614746809, + 1.3170045390725136, + 0.6566339824348688, + 0.33926589600741863, + 1.3294577598571777, + 0.9600542075932026, + 0.7949438747018576, + 0.3011744040995836, + 0.6332836486399174, + 0.36556245386600494, + 0.5893582608550787, + 0.7216613460332155, + 0.1646956093609333, + 1.1194425448775291, + 1.4949816726148129, + 0.10332453437149525, + 0.677859490737319, + 0.2283787652850151, + 1.131233997642994, + 0.956607423722744, + 1.2654914539307356, + 0.9906044416129589, + 0.7044617272913456, + 0.19804706424474716, + 0.33047050796449184, + 0.21474295482039452, + 0.5342877749353647, + 0.7034982852637768, + 1.3111298717558384, + 1.2393544986844063 + ], + "unique_experts": 64, + "load_cv": 0.5079831022501297, + "normalized_load_entropy": 0.9713828797475117, + "max_load_share": 0.04424778761061947 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "fb4b96b061c60d53f8c3bb5814414c9a0ad139f517ea68f9717831517bdf656b", + "route_weight_sha256": "65267f5716231381a2855a0435fa5fb813028f31e0b2f7e6355dc2b85c3cb28d", + "loads": [ + 10, + 27, + 11, + 17, + 17, + 10, + 28, + 10, + 9, + 24, + 14, + 11, + 9, + 6, + 13, + 10, + 8, + 20, + 23, + 10, + 10, + 6, + 8, + 34, + 8, + 12, + 2, + 13, + 11, + 10, + 24, + 14, + 8, + 6, + 5, + 14, + 13, + 9, + 20, + 5, + 22, + 7, + 10, + 9, + 13, + 21, + 7, + 9, + 9, + 3, + 22, + 6, + 18, + 15, + 28, + 13, + 18, + 8, + 9, + 6, + 12, + 9, + 17, + 18 + ], + "weighted_loads": [ + 0.5896503236144781, + 2.23870137357153, + 0.5474441796541214, + 1.4339955262839794, + 1.0509354192763567, + 0.6011333502829075, + 2.1332164518535137, + 1.2616493422538042, + 0.418149009346962, + 1.038935525342822, + 1.161284290254116, + 1.113021420314908, + 0.5535895898938179, + 0.2841861341148615, + 0.928921289741993, + 0.4470368269830942, + 0.3934016413986683, + 1.2331088948994875, + 2.818714965134859, + 0.906389057636261, + 0.7248802743852139, + 0.21865010634064674, + 0.45407386124134064, + 1.9652794916182756, + 0.5539322830736637, + 1.3657539151608944, + 0.08709350228309631, + 0.7403108067810535, + 0.46562139317393303, + 0.39977844804525375, + 1.7802602015435696, + 1.086230255663395, + 0.34106473065912724, + 0.24630744755268097, + 0.17719368264079094, + 1.4218433946371078, + 0.6566339824348688, + 0.4045768063515425, + 1.9615834187716246, + 1.1144443787634373, + 1.0956702288240194, + 0.3011744040995836, + 0.6332836486399174, + 0.39838670566678047, + 1.0429303925484419, + 1.5778631791472435, + 0.29818883165717125, + 1.1194425448775291, + 1.5353406853973866, + 0.10332453437149525, + 1.2674057427793741, + 0.2283787652850151, + 1.5411805994808674, + 0.956607423722744, + 1.7840428608469665, + 0.9906044416129589, + 0.7044617272913456, + 0.2865061108022928, + 0.35820805467665195, + 0.21474295482039452, + 0.6308729518204927, + 0.7034982852637768, + 1.7977118343114853, + 1.2393544986844063 + ], + "unique_experts": 64, + "load_cv": 0.519205693823082, + "normalized_load_entropy": 0.9695040487651876, + "max_load_share": 0.04106280193236715 + } + }, + "s1_x": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "59a989139acf9c2c00ae0649e5aad758b5b553d83b0eae83a10ff882d3155c53", + "route_weight_sha256": "9f11b9d86cc2397cdc15e3f27b130dc56217821e8edb6f6175119b420d8e2d86", + "loads": [ + 7, + 8, + 10, + 18, + 16, + 11, + 21, + 9, + 8, + 23, + 5, + 7, + 7, + 6, + 11, + 8, + 9, + 18, + 19, + 10, + 10, + 7, + 7, + 29, + 9, + 13, + 4, + 13, + 9, + 9, + 22, + 12, + 6, + 8, + 2, + 14, + 10, + 7, + 10, + 4, + 16, + 7, + 9, + 6, + 9, + 12, + 6, + 8, + 9, + 3, + 12, + 6, + 12, + 16, + 17, + 13, + 19, + 6, + 8, + 6, + 9, + 9, + 9, + 15 + ], + "weighted_loads": [ + 0.4548567868769169, + 0.6887263506650925, + 0.36566444858908653, + 1.4624125957489014, + 0.9597303420305252, + 0.6465829107910395, + 1.6390115227550268, + 1.0891711078584194, + 0.3481954410672188, + 0.959328792989254, + 0.3267166092991829, + 0.37877022475004196, + 0.38203224912285805, + 0.2602008320391178, + 0.8460768815129995, + 0.36961219273507595, + 0.4329867847263813, + 1.1516176033765078, + 2.648593533784151, + 0.8320414442569017, + 0.6973969824612141, + 0.23545063473284245, + 0.42536308243870735, + 1.8309088982641697, + 0.590629804879427, + 1.4087985586374998, + 0.13242286443710327, + 0.7361516878008842, + 0.39715483970940113, + 0.3678225688636303, + 1.75462881103158, + 0.8817586414515972, + 0.23662742599844933, + 0.264153691008687, + 0.0616089291870594, + 1.3414187617599964, + 0.5485920738428831, + 0.29276949912309647, + 1.350685015320778, + 0.9323673285543919, + 0.7689707297831774, + 0.3154690060764551, + 0.5924782939255238, + 0.23224281147122383, + 0.6210118476301432, + 0.6843903735280037, + 0.2233223281800747, + 1.0721668675541878, + 1.5111106224358082, + 0.09609201736748219, + 0.6591816544532776, + 0.23196019977331161, + 1.1744184978306293, + 1.0381961949169636, + 1.1449756938964128, + 0.9684632625430822, + 0.7526679076254368, + 0.2308902908116579, + 0.31199913285672665, + 0.2105349749326706, + 0.4672092627733946, + 0.6896556578576565, + 1.3382362201809883, + 1.3989206477999687 + ], + "unique_experts": 64, + "load_cv": 0.4901284467463649, + "normalized_load_entropy": 0.973345493175044, + "max_load_share": 0.04277286135693215 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "f00a7cdbc67d53b902d6de605fe4195ecc724133206de6d943cee7153c2857ef", + "route_weight_sha256": "746ea4df80b419ff89a0a5adcddfb8f96450b992384152df57779e8b1c7b0e8a", + "loads": [ + 9, + 33, + 19, + 18, + 17, + 13, + 29, + 10, + 10, + 24, + 26, + 11, + 12, + 6, + 11, + 9, + 10, + 27, + 21, + 11, + 13, + 15, + 7, + 35, + 9, + 13, + 5, + 14, + 10, + 11, + 22, + 16, + 11, + 8, + 4, + 15, + 11, + 12, + 20, + 7, + 23, + 7, + 10, + 7, + 20, + 26, + 7, + 8, + 9, + 4, + 26, + 7, + 20, + 23, + 30, + 14, + 20, + 9, + 9, + 7, + 13, + 10, + 14, + 17 + ], + "weighted_loads": [ + 0.6490717232227325, + 2.696576157817617, + 0.8616665359586477, + 1.4624125957489014, + 1.036220759153366, + 0.7221428956836462, + 2.398057060316205, + 1.125687774270773, + 0.46243349090218544, + 0.9873361364006996, + 2.1556650325655937, + 1.1552658714354038, + 0.6563450433313847, + 0.2602008320391178, + 0.8460768815129995, + 0.4205119963735342, + 0.483010645955801, + 1.8442052695900202, + 2.7466027587652206, + 0.855401111766696, + 0.9556815586984158, + 0.918418649584055, + 0.42536308243870735, + 2.0604059919714928, + 0.590629804879427, + 1.4087985586374998, + 0.16621990501880646, + 0.7723547965288162, + 0.44181480444967747, + 0.43826574087142944, + 1.75462881103158, + 1.4595504216849804, + 0.4639977980405092, + 0.264153691008687, + 0.16781560704112053, + 1.4396075569093227, + 0.5945883635431528, + 0.5169083550572395, + 2.198874481022358, + 1.2611893452703953, + 1.0911310259252787, + 0.3154690060764551, + 0.6785116381943226, + 0.2624553181231022, + 1.3998046945780516, + 1.9779524244368076, + 0.2645806297659874, + 1.0721668675541878, + 1.5111106224358082, + 0.14470612816512585, + 1.5386086348444223, + 0.2916025146842003, + 1.7766843177378178, + 1.5451152212917805, + 2.0186856272630394, + 0.9949643295258284, + 0.7826727349311113, + 0.3352451715618372, + 0.3546303305774927, + 0.2980555593967438, + 0.6812076773494482, + 0.7331589087843895, + 1.7594840563833714, + 1.4577364176511765 + ], + "unique_experts": 64, + "load_cv": 0.5142412562590393, + "normalized_load_entropy": 0.9700367762916434, + "max_load_share": 0.03787878787878788 + } + }, + "s0_period": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "da955e33e5f2c4d8dd6b7535afcd08b3d4f2ae336972240e2294c4228877adf2", + "route_weight_sha256": "d62e233bc9bdb82353032384bf6bc3df7195085b4a89efc575b676fa8ab393cb", + "loads": [ + 9, + 8, + 7, + 18, + 15, + 10, + 20, + 9, + 10, + 22, + 5, + 7, + 7, + 7, + 13, + 12, + 9, + 16, + 21, + 9, + 10, + 4, + 9, + 30, + 8, + 12, + 2, + 13, + 10, + 10, + 24, + 12, + 7, + 4, + 3, + 13, + 13, + 8, + 10, + 4, + 16, + 6, + 8, + 7, + 7, + 12, + 4, + 8, + 9, + 3, + 12, + 6, + 12, + 15, + 18, + 13, + 18, + 5, + 8, + 5, + 9, + 9, + 10, + 18 + ], + "weighted_loads": [ + 0.5544426925480366, + 0.7146453969180584, + 0.2589972522109747, + 1.4750242475420237, + 0.9113165214657784, + 0.598876865580678, + 1.575582679361105, + 1.1643209494650364, + 0.46447998844087124, + 0.9028206821531057, + 0.31987860053777695, + 0.3915792554616928, + 0.4134159982204437, + 0.33095584623515606, + 0.9237124882638454, + 0.5112743582576513, + 0.4370745923370123, + 1.0927119348198175, + 2.7686972487717867, + 0.876758610829711, + 0.7281606644392014, + 0.1537784207612276, + 0.4901231862604618, + 1.7789728250354528, + 0.5576996356248856, + 1.3481545243412256, + 0.09264439344406128, + 0.7403681129217148, + 0.42675564624369144, + 0.3897790554910898, + 1.8002755157649517, + 0.9128541443496943, + 0.2983943708240986, + 0.14518963545560837, + 0.0914103202521801, + 1.3157486114650965, + 0.664707163348794, + 0.35157992877066135, + 1.3295142091810703, + 0.9835333079099655, + 0.8319066390395164, + 0.27463739179074764, + 0.5648391023278236, + 0.3406286481767893, + 0.5816751308739185, + 0.7320228461176157, + 0.1648392602801323, + 1.0543824881315231, + 1.5263116154819727, + 0.10183586366474628, + 0.6739148963242769, + 0.234881192445755, + 1.1138280220329762, + 0.9491117410361767, + 1.2400231342762709, + 1.009232895448804, + 0.698737371712923, + 0.20249056816101074, + 0.3371814861893654, + 0.19183292798697948, + 0.5208337940275669, + 0.6929428055882454, + 1.2940724212676287, + 1.2516392804682255 + ], + "unique_experts": 64, + "load_cv": 0.5134353661888076, + "normalized_load_entropy": 0.970226147165311, + "max_load_share": 0.04424778761061947 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "fdb714dbdd32b5620b971b8c3c1126bc97092b0e6fe6e54f9e9b9f851fab7d13", + "route_weight_sha256": "2f340fa1b554ddb1117d23f1b37a6da13c238dcad1d72a9f6e2651ee8c96ec81", + "loads": [ + 11, + 27, + 12, + 18, + 16, + 10, + 26, + 10, + 10, + 22, + 15, + 10, + 11, + 9, + 13, + 13, + 9, + 20, + 23, + 9, + 10, + 5, + 9, + 32, + 8, + 12, + 2, + 13, + 11, + 12, + 25, + 13, + 8, + 5, + 5, + 14, + 13, + 9, + 19, + 5, + 22, + 6, + 8, + 9, + 13, + 22, + 7, + 8, + 9, + 3, + 22, + 6, + 18, + 15, + 28, + 13, + 18, + 8, + 9, + 5, + 11, + 9, + 16, + 19 + ], + "weighted_loads": [ + 0.6534338518977165, + 2.3069689909461886, + 0.5821144189685583, + 1.4750242475420237, + 1.0395391508936882, + 0.598876865580678, + 1.9867286197841167, + 1.196591354906559, + 0.46447998844087124, + 0.9028206821531057, + 1.2876331582665443, + 1.0945272743701935, + 0.6141041107475758, + 0.4137792680412531, + 0.9237124882638454, + 0.5541267786175013, + 0.4370745923370123, + 1.2227646708488464, + 2.845479916781187, + 0.876758610829711, + 0.7281606644392014, + 0.19894309155642986, + 0.4901231862604618, + 1.870367182418704, + 0.5576996356248856, + 1.3481545243412256, + 0.09264439344406128, + 0.7403681129217148, + 0.46825104765594006, + 0.4554475899785757, + 1.8299582824110985, + 1.0016998518258333, + 0.35081328824162483, + 0.20571129396557808, + 0.19807396456599236, + 1.4240367133170366, + 0.664707163348794, + 0.4119363706558943, + 1.8468651864677668, + 1.1379234790802002, + 1.084459599107504, + 0.27463739179074764, + 0.5648391023278236, + 0.40165700018405914, + 1.0305727794766426, + 1.7081963568925858, + 0.2984466105699539, + 1.0543824881315231, + 1.5263116154819727, + 0.10183586366474628, + 1.263461148366332, + 0.234881192445755, + 1.4476891942322254, + 0.9491117410361767, + 1.7129907901398838, + 1.009232895448804, + 0.698737371712923, + 0.2923710625618696, + 0.36606357991695404, + 0.19183292798697948, + 0.6145594418048859, + 0.6929428055882454, + 1.7418895568698645, + 1.3859330601990223 + ], + "unique_experts": 64, + "load_cv": 0.5066479101242318, + "normalized_load_entropy": 0.9703192434639679, + "max_load_share": 0.03864734299516908 + } + }, + "s1_period": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "2cfef66afde2ac9ba3c54f4fd4af59fdac7f572d4105023bc282e346f44546b5", + "route_weight_sha256": "7dd6038468aafffbe831c355b8abd839dfe80cbeb0487d8607d98e0f5f3b2b81", + "loads": [ + 7, + 8, + 8, + 18, + 17, + 11, + 21, + 10, + 8, + 20, + 6, + 7, + 6, + 7, + 12, + 10, + 10, + 16, + 20, + 10, + 10, + 7, + 8, + 30, + 8, + 13, + 2, + 12, + 10, + 8, + 24, + 12, + 7, + 4, + 2, + 14, + 10, + 6, + 10, + 4, + 16, + 6, + 9, + 4, + 11, + 12, + 6, + 9, + 9, + 2, + 11, + 6, + 12, + 16, + 17, + 13, + 18, + 7, + 9, + 8, + 9, + 9, + 9, + 17 + ], + "weighted_loads": [ + 0.4549016188830137, + 0.6716205701231956, + 0.3022332638502121, + 1.45810953900218, + 1.0196208097040653, + 0.6370042376220226, + 1.6282140798866749, + 1.14274051040411, + 0.34346294589340687, + 0.8094415161758661, + 0.3029379602521658, + 0.35963270626962185, + 0.3262433260679245, + 0.2902242857962847, + 0.9325662478804588, + 0.4338106494396925, + 0.46817406080663204, + 1.0566817745566368, + 2.692799888551235, + 0.8630937319248915, + 0.7051950730383396, + 0.2428395412862301, + 0.45597903057932854, + 1.8685455303639174, + 0.5511208921670914, + 1.4168655909597874, + 0.06654395908117294, + 0.7019411101937294, + 0.4264646451920271, + 0.336233077570796, + 1.8005470484495163, + 0.884745754301548, + 0.255003921687603, + 0.13954354636371136, + 0.06053902395069599, + 1.342579672113061, + 0.5460872501134872, + 0.2608477920293808, + 1.344299703836441, + 0.9292334876954556, + 0.7616804633289576, + 0.2950098551809788, + 0.58014084585011, + 0.17053799331188202, + 0.6886470541357994, + 0.6595984883606434, + 0.2268066592514515, + 1.0347652733325958, + 1.4964504223316908, + 0.05938214808702469, + 0.6272379644215107, + 0.2281169593334198, + 1.1835719160735607, + 1.0239660497754812, + 1.1451032441109419, + 0.9886681996285915, + 0.7171374727040529, + 0.2510151732712984, + 0.3500137124210596, + 0.26329088024795055, + 0.4847872033715248, + 0.6906332820653915, + 1.3064943812787533, + 1.5833063926547766 + ], + "unique_experts": 64, + "load_cv": 0.5033022407581372, + "normalized_load_entropy": 0.9711273168678292, + "max_load_share": 0.04424778761061947 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "bbbdf8b57405bc1be44eb6e04319ff9b3d71478b0f68c6537b09c078a5725a8d", + "route_weight_sha256": "3f182e3231936e79aa2f9b8f2680f7664dfbc436e02b3598d456d81d0677511f", + "loads": [ + 10, + 33, + 16, + 19, + 18, + 13, + 27, + 11, + 10, + 21, + 27, + 10, + 12, + 7, + 12, + 12, + 11, + 24, + 21, + 11, + 13, + 14, + 8, + 35, + 8, + 13, + 3, + 12, + 11, + 10, + 25, + 15, + 13, + 4, + 5, + 15, + 11, + 11, + 19, + 7, + 23, + 6, + 10, + 5, + 22, + 27, + 7, + 9, + 9, + 3, + 23, + 7, + 19, + 23, + 31, + 14, + 20, + 11, + 10, + 9, + 13, + 10, + 14, + 22 + ], + "weighted_loads": [ + 0.7125412914901972, + 2.7250524370465428, + 0.7756358720362186, + 1.497651383280754, + 1.0988376773893833, + 0.7125642225146294, + 2.187614306807518, + 1.1779861152172089, + 0.4577009957283735, + 0.8374488595873117, + 2.1390402782708406, + 1.078403351828456, + 0.6398504003882408, + 0.2902242857962847, + 0.9325662478804588, + 0.524689732119441, + 0.5178481806069613, + 1.7040995210409164, + 2.746368497610092, + 0.8864533994346857, + 0.9634796492755413, + 0.8834402579814196, + 0.45597903057932854, + 2.0604850593954325, + 0.5511208921670914, + 1.4168655909597874, + 0.10034099966287613, + 0.7019411101937294, + 0.47112460993230343, + 0.40667624957859516, + 1.8451478444039822, + 1.3553343191742897, + 0.5186680015176535, + 0.13954354636371136, + 0.21865723095834255, + 1.4383633900433779, + 0.5920835398137569, + 0.46904432214796543, + 2.129749335348606, + 1.258055504411459, + 1.0838407594710588, + 0.2950098551809788, + 0.6661741901189089, + 0.20075049996376038, + 1.4711985532194376, + 2.0079160816967487, + 0.2680649608373642, + 1.0347652733325958, + 1.4964504223316908, + 0.10799625888466835, + 1.3653881307691336, + 0.28527116775512695, + 1.66685850918293, + 1.5308850761502981, + 1.9944907980971038, + 1.0151692666113377, + 0.8002393282949924, + 0.3904795665293932, + 0.390488950535655, + 0.35081146471202374, + 0.7056840099394321, + 0.7341365329921246, + 1.7277422174811363, + 1.9525294620543718 + ], + "unique_experts": 64, + "load_cv": 0.5133658892756793, + "normalized_load_entropy": 0.9694536787776364, + "max_load_share": 0.03787878787878788 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 113, + "ordered_topk_exact_tokens": 75, + "set_exact_tokens": 82, + "mean_set_jaccard": 0.9216182048040455, + "mean_token_weighted_tv": 0.016209357080206408, + "aggregate_load_tv": 0.028023598820058997 + }, + "system_bos": { + "tokens": 113, + "ordered_topk_exact_tokens": 67, + "set_exact_tokens": 81, + "mean_set_jaccard": 0.9138221660345553, + "mean_token_weighted_tv": 0.022399567693999384, + "aggregate_load_tv": 0.028023598820058997 + }, + "system_x": { + "tokens": 113, + "ordered_topk_exact_tokens": 56, + "set_exact_tokens": 70, + "mean_set_jaccard": 0.8803202697008007, + "mean_token_weighted_tv": 0.02847050835864734, + "aggregate_load_tv": 0.04572271386430678 + }, + "system_period": { + "tokens": 113, + "ordered_topk_exact_tokens": 55, + "set_exact_tokens": 67, + "mean_set_jaccard": 0.8746312684365782, + "mean_token_weighted_tv": 0.030690414575546717, + "aggregate_load_tv": 0.04277286135693215 + }, + "bos_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 63, + "set_exact_tokens": 77, + "mean_set_jaccard": 0.9056047197640119, + "mean_token_weighted_tv": 0.024230399754195088, + "aggregate_load_tv": 0.029498525073746312 + }, + "bos_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 56, + "set_exact_tokens": 69, + "mean_set_jaccard": 0.888748419721871, + "mean_token_weighted_tv": 0.023980917013456338, + "aggregate_load_tv": 0.035398230088495575 + }, + "x_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 65, + "set_exact_tokens": 81, + "mean_set_jaccard": 0.9152970922882427, + "mean_token_weighted_tv": 0.020310607920112335, + "aggregate_load_tv": 0.030973451327433628 + }, + "x_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 43, + "set_exact_tokens": 61, + "mean_set_jaccard": 0.8594605983986516, + "mean_token_weighted_tv": 0.0323191912251368, + "aggregate_load_tv": 0.05162241887905604 + }, + "period_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 72, + "set_exact_tokens": 84, + "mean_set_jaccard": 0.9266750948166879, + "mean_token_weighted_tv": 0.018740036228127713, + "aggregate_load_tv": 0.029498525073746312 + }, + "period_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 43, + "set_exact_tokens": 60, + "mean_set_jaccard": 0.8550358196375896, + "mean_token_weighted_tv": 0.03381310467632998, + "aggregate_load_tv": 0.05014749262536873 + } + } + }, + "layer_26": { + "layer": 26, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "3150edb138408ada5238c304858bf1db86fa58d80d7ab0aca7605b9982e7c8a4", + "route_weight_sha256": "4aa42e0b5f1f67f99a6fc4327710ae5d55aaed63a64a9bcdb6a3536e8e699ea4", + "loads": [ + 8, + 10, + 15, + 3, + 10, + 3, + 17, + 3, + 6, + 8, + 15, + 12, + 13, + 7, + 6, + 3, + 11, + 9, + 2, + 12, + 12, + 10, + 8, + 11, + 6, + 12, + 9, + 19, + 14, + 19, + 5, + 12, + 25, + 15, + 9, + 7, + 12, + 6, + 22, + 5, + 14, + 2, + 7, + 21, + 1, + 11, + 16, + 14, + 3, + 9, + 6, + 24, + 18, + 19, + 6, + 6, + 10, + 11, + 14, + 18, + 5, + 11, + 15, + 6 + ], + "weighted_loads": [ + 0.4098007082939148, + 0.9111402407288551, + 1.1208324413746595, + 0.12982161715626717, + 0.9972531646490097, + 0.1327309012413025, + 1.9037433937191963, + 0.11547920107841492, + 0.22139618173241615, + 0.7649858891963959, + 0.880771417170763, + 1.6210011411458254, + 1.4858587197959423, + 0.3142661452293396, + 0.5082293264567852, + 0.32199856638908386, + 0.766695648431778, + 0.7121121808886528, + 0.0745297484099865, + 0.6877893302589655, + 0.9638790246099234, + 0.8629248775541782, + 0.29267290234565735, + 0.5670629478991032, + 0.43593571707606316, + 0.9581973217427731, + 0.6751778144389391, + 1.5557878129184246, + 0.9036831595003605, + 0.7716093813069165, + 0.15682009607553482, + 0.5435751080513, + 3.6597239077091217, + 0.747779805213213, + 0.5649421960115433, + 0.4818073697388172, + 1.065186232328415, + 0.2972949370741844, + 1.4038485288619995, + 0.6833616495132446, + 1.2524448446929455, + 0.06655892357230186, + 0.2528027445077896, + 2.3881069011986256, + 0.07020463049411774, + 0.506439246237278, + 0.5766713358461857, + 0.9855667967349291, + 0.24525839276611805, + 0.9691369161009789, + 0.2915620431303978, + 2.6601684037595987, + 1.969874082133174, + 0.8755778539925814, + 0.43179285526275635, + 0.3386482037603855, + 0.8519523721188307, + 1.640692062675953, + 0.9311990160495043, + 1.196626476943493, + 0.2278265431523323, + 0.6777802109718323, + 1.303569434210658, + 1.5422395803034306 + ], + "unique_experts": 64, + "load_cv": 0.5305061857463081, + "normalized_load_entropy": 0.9650247556964137, + "max_load_share": 0.03687315634218289 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "990aef89baeac823d748ed4d5d38c11057271f7a5f4c414e5ce1094c091857e0", + "route_weight_sha256": "de214feeaa2a71ea294879374c065fb12b46837e54aa8c4a62219eee33304627", + "loads": [ + 8, + 11, + 15, + 4, + 10, + 3, + 17, + 4, + 6, + 13, + 19, + 17, + 14, + 8, + 21, + 5, + 11, + 20, + 3, + 13, + 12, + 11, + 8, + 11, + 13, + 12, + 15, + 26, + 14, + 19, + 12, + 12, + 28, + 15, + 12, + 7, + 18, + 6, + 22, + 5, + 15, + 2, + 8, + 24, + 2, + 11, + 20, + 15, + 5, + 10, + 15, + 25, + 22, + 19, + 7, + 6, + 24, + 19, + 20, + 19, + 6, + 11, + 16, + 7 + ], + "weighted_loads": [ + 0.4098007082939148, + 1.0258329659700394, + 1.1208324413746595, + 0.1579680349677801, + 0.9972531646490097, + 0.1327309012413025, + 1.9037433937191963, + 0.20496196299791336, + 0.22139618173241615, + 1.0733483377844095, + 1.1474365331232548, + 1.925599040929228, + 1.6178444735705853, + 0.3737354688346386, + 1.1803503037663177, + 0.4188370630145073, + 0.766695648431778, + 1.2519012985285372, + 0.10735908523201942, + 0.74571299739182, + 0.9638790246099234, + 0.8949922546744347, + 0.29267290234565735, + 0.5670629478991032, + 0.8298199474811554, + 0.9581973217427731, + 1.6571068689227104, + 1.8396468590945005, + 0.9036831595003605, + 0.7716093813069165, + 0.7769309878349304, + 0.5435751080513, + 3.7846369482576847, + 0.747779805213213, + 0.7497548013925552, + 0.4818073697388172, + 1.3541969116777182, + 0.2972949370741844, + 1.4038485288619995, + 0.6833616495132446, + 1.2933346070349216, + 0.06655892357230186, + 0.31413255631923676, + 2.5401302836835384, + 0.12557406723499298, + 0.506439246237278, + 0.7944742627441883, + 1.0189102981239557, + 0.357693949714303, + 1.955472432076931, + 0.6698714103549719, + 2.845593446865678, + 2.43093997053802, + 0.8755778539925814, + 0.4787084236741066, + 0.3386482037603855, + 1.9310259390622377, + 2.035876414272934, + 1.1661842558532953, + 1.2442596517503262, + 0.22862459113821387, + 0.6777802109718323, + 1.34450145624578, + 1.5861011520028114 + ], + "unique_experts": 64, + "load_cv": 0.4994103737112333, + "normalized_load_entropy": 0.968221838432933, + "max_load_share": 0.033816425120772944 + } + }, + "s1_eos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "e4190c48ae70dda206c9e37e70d8bf5249ab33b62acaec8fe4faaed2f8a591b5", + "route_weight_sha256": "28b90a2e4c93bdab7a28158cc106a5b1eaedcec17b12abe3f5a095d54be81acf", + "loads": [ + 8, + 10, + 16, + 5, + 10, + 2, + 17, + 3, + 4, + 8, + 15, + 11, + 14, + 8, + 6, + 3, + 11, + 9, + 2, + 12, + 12, + 11, + 6, + 10, + 6, + 12, + 10, + 20, + 14, + 20, + 6, + 11, + 26, + 17, + 8, + 7, + 12, + 6, + 21, + 5, + 14, + 2, + 6, + 21, + 2, + 11, + 14, + 13, + 2, + 9, + 4, + 25, + 18, + 18, + 5, + 6, + 10, + 11, + 13, + 19, + 6, + 11, + 15, + 9 + ], + "weighted_loads": [ + 0.40398554131388664, + 0.8979808837175369, + 1.1542838364839554, + 0.21411550417542458, + 0.9739883467555046, + 0.08897582814097404, + 1.8948765527456999, + 0.1136541273444891, + 0.17099386639893055, + 0.7661946751177311, + 0.8726729825139046, + 1.5713921263813972, + 1.4929617326706648, + 0.3583138473331928, + 0.5171647109091282, + 0.3221340999007225, + 0.7652413919568062, + 0.7162084840238094, + 0.073712058365345, + 0.688119426369667, + 0.9081720281392336, + 0.8967905063182116, + 0.23185144551098347, + 0.548373494297266, + 0.4360206760466099, + 0.952519379556179, + 0.6927976869046688, + 1.5750658065080643, + 0.8766268044710159, + 0.7938771485351026, + 0.17708702757954597, + 0.5180765390396118, + 3.6152227353304625, + 0.8145895265042782, + 0.5762639557942748, + 0.48778702318668365, + 1.0621766820549965, + 0.29908666014671326, + 1.385860126465559, + 0.6470484286546707, + 1.2353621181100607, + 0.06616934575140476, + 0.2212146818637848, + 2.3665526434779167, + 0.0977129302918911, + 0.5125541146844625, + 0.4957381095737219, + 0.9667738564312458, + 0.20872458815574646, + 0.942684831097722, + 0.2101597636938095, + 2.629630584269762, + 2.013406565412879, + 0.8207880016416311, + 0.4208682104945183, + 0.3409117292612791, + 0.8344247527420521, + 1.6328904554247856, + 0.9242649674415588, + 1.2259370628744364, + 0.25650161877274513, + 0.693574383854866, + 1.2852300517261028, + 1.6236827969551086 + ], + "unique_experts": 64, + "load_cv": 0.5432135571443619, + "normalized_load_entropy": 0.9637130624590795, + "max_load_share": 0.038348082595870206 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "fe7e8dce1b5738afd549454e29aed2801b852f0923091999e7388767ad34492d", + "route_weight_sha256": "6b0b0a1407deb13fce38e8352c96c690bef8a99a17adb6e0108cbd3b04fa435b", + "loads": [ + 8, + 11, + 16, + 5, + 13, + 2, + 17, + 5, + 4, + 16, + 22, + 18, + 15, + 9, + 21, + 8, + 11, + 16, + 3, + 13, + 12, + 17, + 13, + 10, + 15, + 14, + 22, + 28, + 14, + 24, + 15, + 12, + 31, + 18, + 14, + 7, + 24, + 11, + 24, + 6, + 15, + 2, + 8, + 25, + 2, + 12, + 18, + 15, + 4, + 12, + 12, + 26, + 28, + 20, + 8, + 8, + 28, + 19, + 23, + 26, + 9, + 11, + 18, + 11 + ], + "weighted_loads": [ + 0.40398554131388664, + 1.0086669027805328, + 1.1542838364839554, + 0.21411550417542458, + 1.1542546730488539, + 0.08897582814097404, + 1.8948765527456999, + 0.2685545887798071, + 0.17099386639893055, + 1.2401927895843983, + 1.6138063222169876, + 2.19051532051526, + 1.6200241278856993, + 0.41247623413801193, + 1.3477783771813847, + 0.6237317398190498, + 0.7652413919568062, + 1.116978695616126, + 0.12979916855692863, + 0.7505596987903118, + 0.9081720281392336, + 1.2490736544132233, + 0.7334856893867254, + 0.548373494297266, + 0.8935527801513672, + 1.0576207675039768, + 2.1755571737885475, + 1.8935480527579784, + 0.8766268044710159, + 0.9313399842940271, + 1.065703060477972, + 0.5976662933826447, + 3.828152282163501, + 0.8591920658946037, + 0.9214402614161372, + 0.48778702318668365, + 1.6934181042015553, + 0.6002868562936783, + 1.6648760475218296, + 0.6807246170938015, + 1.2647515572607517, + 0.06616934575140476, + 0.3160935901105404, + 2.5658475756645203, + 0.0977129302918911, + 0.5300366375595331, + 0.7522670608013868, + 1.0708638429641724, + 0.2894403673708439, + 2.0829429049044847, + 0.5322518460452557, + 2.7530417554080486, + 2.8580976016819477, + 1.0129708219319582, + 0.6340858228504658, + 0.45625571347773075, + 2.5191537514328957, + 2.340452378615737, + 1.499424859881401, + 1.5505987033247948, + 0.5024537895806134, + 0.693574383854866, + 1.4087489005178213, + 1.69906372949481 + ], + "unique_experts": 64, + "load_cv": 0.4999016038561761, + "normalized_load_entropy": 0.9679123093883935, + "max_load_share": 0.03354978354978355 + } + }, + "s0_bos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "a5d415cb95c4a5768d877381a00d24c287aa47b231785135341fdf021a25e351", + "route_weight_sha256": "6b358a920aaededfe6856eaec61d9a1ca78b575d6e540b3295ca80b183c7d4c0", + "loads": [ + 9, + 11, + 15, + 4, + 10, + 3, + 17, + 4, + 5, + 8, + 16, + 11, + 14, + 8, + 6, + 3, + 11, + 9, + 1, + 12, + 12, + 11, + 6, + 12, + 6, + 14, + 11, + 20, + 15, + 18, + 5, + 12, + 27, + 15, + 10, + 5, + 12, + 8, + 21, + 6, + 12, + 2, + 5, + 21, + 2, + 9, + 10, + 14, + 4, + 9, + 3, + 24, + 18, + 17, + 5, + 5, + 10, + 11, + 14, + 18, + 5, + 10, + 16, + 11 + ], + "weighted_loads": [ + 0.4707849845290184, + 0.9467094484716654, + 1.123169282451272, + 0.17636956833302975, + 0.9838038645684719, + 0.13606615364551544, + 1.968364767730236, + 0.15916475281119347, + 0.19597358256578445, + 0.7503120116889477, + 0.9135836120694876, + 1.5948258712887764, + 1.5355953332036734, + 0.36182693764567375, + 0.5165239498019218, + 0.32580431550741196, + 0.7767375223338604, + 0.7304653115570545, + 0.044872015714645386, + 0.6876012906432152, + 0.9396217633038759, + 0.8736583953723311, + 0.24159790761768818, + 0.6202293038368225, + 0.43729014694690704, + 1.0272475089877844, + 0.7358905663713813, + 1.5832058116793633, + 0.9405412804335356, + 0.7850328702479601, + 0.14021399058401585, + 0.5448546968400478, + 3.676196290180087, + 0.7191983945667744, + 0.6028278153389692, + 0.38927531614899635, + 1.0446483790874481, + 0.37122261337935925, + 1.4216012097895145, + 0.7632230520248413, + 1.1398726888000965, + 0.06687702983617783, + 0.19150006212294102, + 2.479765312746167, + 0.09034009091556072, + 0.4439428634941578, + 0.3921621348708868, + 1.0013051647692919, + 0.11804202012717724, + 0.9120310451835394, + 0.17025526612997055, + 2.636314520612359, + 1.9849347826093435, + 0.7910248320549726, + 0.4087856151163578, + 0.2552550248801708, + 0.88001106120646, + 1.6474936977028847, + 0.9505978170782328, + 1.2555668447166681, + 0.2073859479278326, + 0.5837564039975405, + 1.3586843614466488, + 2.3454829286783934 + ], + "unique_experts": 64, + "load_cv": 0.5349490627476604, + "normalized_load_entropy": 0.9645769005236275, + "max_load_share": 0.03982300884955752 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "b23f684e26e8a937ed2dbc64d0c986a8a8b093dc4e7cd200f6299b329df192b7", + "route_weight_sha256": "f511d0f8659ae23ab456665af8375e5d44a3ad1fd82789fce9828678bf8cc43c", + "loads": [ + 9, + 12, + 15, + 5, + 10, + 3, + 17, + 5, + 5, + 14, + 19, + 15, + 15, + 9, + 19, + 5, + 11, + 18, + 1, + 13, + 12, + 12, + 7, + 12, + 12, + 14, + 18, + 28, + 15, + 18, + 13, + 12, + 29, + 16, + 14, + 5, + 18, + 8, + 21, + 7, + 13, + 3, + 7, + 24, + 5, + 9, + 12, + 15, + 6, + 9, + 12, + 25, + 22, + 17, + 6, + 5, + 24, + 18, + 20, + 19, + 5, + 10, + 17, + 14 + ], + "weighted_loads": [ + 0.4707849845290184, + 1.0634444523602724, + 1.123169282451272, + 0.20381302759051323, + 0.9838038645684719, + 0.13606615364551544, + 1.968364767730236, + 0.23285316303372383, + 0.19597358256578445, + 1.0952637996524572, + 1.154074577614665, + 1.8973509911447763, + 1.671741297468543, + 0.42129626125097275, + 1.1064957212656736, + 0.4424820877611637, + 0.7767375223338604, + 1.1920777186751366, + 0.044872015714645386, + 0.7474049478769302, + 0.9396217633038759, + 0.9057257724925876, + 0.27461867593228817, + 0.6202293038368225, + 0.7913272455334663, + 1.0272475089877844, + 1.8718672832474113, + 1.9340667147189379, + 0.9405412804335356, + 0.7850328702479601, + 0.8960845079272985, + 0.5448546968400478, + 3.767481477931142, + 0.7691918238997459, + 0.8590269591659307, + 0.38927531614899635, + 1.3363013043999672, + 0.37122261337935925, + 1.4216012097895145, + 0.7852681633085012, + 1.1807624511420727, + 0.4574049934744835, + 0.2924599628895521, + 2.63178869523108, + 0.23388447053730488, + 0.4439428634941578, + 0.5156739223748446, + 1.0294720735400915, + 0.23900398798286915, + 0.9120310451835394, + 0.5480486787855625, + 2.823825502768159, + 2.4402596782892942, + 0.7910248320549726, + 0.45570118352770805, + 0.2552550248801708, + 1.9660463016480207, + 2.0377942118793726, + 1.1855830568820238, + 1.3032000195235014, + 0.2073859479278326, + 0.5837564039975405, + 1.3996163834817708, + 2.4889107290655375 + ], + "unique_experts": 64, + "load_cv": 0.4884485615150724, + "normalized_load_entropy": 0.9698474298227052, + "max_load_share": 0.035024154589371984 + } + }, + "s1_bos": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "c39df137cbea80d8cfe46f6cfcb75fe37a187f2bc34242b4e56b9e018df05844", + "route_weight_sha256": "b115c5a8cda3d008988f54f988d2e12de90f7e2291852779bf1ab3e7cd328942", + "loads": [ + 8, + 11, + 15, + 4, + 10, + 2, + 17, + 4, + 5, + 8, + 14, + 12, + 14, + 8, + 7, + 3, + 11, + 9, + 1, + 12, + 12, + 12, + 7, + 13, + 6, + 13, + 9, + 21, + 14, + 18, + 6, + 12, + 26, + 16, + 10, + 6, + 12, + 7, + 21, + 6, + 14, + 2, + 5, + 21, + 2, + 10, + 13, + 14, + 4, + 9, + 3, + 25, + 17, + 17, + 5, + 6, + 8, + 11, + 14, + 18, + 4, + 10, + 15, + 9 + ], + "weighted_loads": [ + 0.4438144452869892, + 0.9559636004269123, + 1.134571647271514, + 0.18342943862080574, + 0.9843025021255016, + 0.08690427988767624, + 1.9541756212711334, + 0.15994957461953163, + 0.18541353940963745, + 0.745840560644865, + 0.8488354440778494, + 1.6045396905392408, + 1.546317296102643, + 0.3461662922054529, + 0.5613902695477009, + 0.317058689892292, + 0.7888652458786964, + 0.7338573299348354, + 0.042935263365507126, + 0.6980182752013206, + 0.9242663905024529, + 0.9133336506783962, + 0.27295149117708206, + 0.6656883917748928, + 0.44061730429530144, + 1.03022401034832, + 0.649360223673284, + 1.6069906428456306, + 0.9390714205801487, + 0.7343969824723899, + 0.1763820555061102, + 0.5174189824610949, + 3.7000440396368504, + 0.7855412773787975, + 0.5881906831637025, + 0.46425311639904976, + 1.049759216606617, + 0.3325201515108347, + 1.4630964286625385, + 0.779204860329628, + 1.1822895854711533, + 0.06925859674811363, + 0.18332197703421116, + 2.3871314208954573, + 0.08912798762321472, + 0.48872455582022667, + 0.4867877680808306, + 1.0285849180072546, + 0.30021159909665585, + 0.9641629010438919, + 0.1680842973291874, + 2.6522019039839506, + 1.8693633768707514, + 0.8065228760242462, + 0.40211246348917484, + 0.36114631965756416, + 0.7535948641598225, + 1.6462812162935734, + 0.9287226740270853, + 1.2161503173410892, + 0.16866757534444332, + 0.6136092618107796, + 1.319163334555924, + 1.6043195258826017 + ], + "unique_experts": 64, + "load_cv": 0.5341677108103174, + "normalized_load_entropy": 0.9645102014612099, + "max_load_share": 0.038348082595870206 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "019f4a8eca324594747fbe52b0868ffb2eea674b1e876db95c78988110437f8a", + "route_weight_sha256": "f9f4c693023aebda51eda5d723d4c418c2e47d50eb02a7a369de263d008b963d", + "loads": [ + 8, + 12, + 15, + 4, + 13, + 3, + 17, + 6, + 5, + 17, + 22, + 18, + 15, + 9, + 21, + 8, + 11, + 15, + 1, + 13, + 12, + 18, + 14, + 13, + 15, + 15, + 22, + 28, + 14, + 22, + 17, + 13, + 30, + 17, + 18, + 6, + 24, + 12, + 24, + 7, + 15, + 2, + 8, + 26, + 4, + 11, + 16, + 16, + 5, + 11, + 11, + 26, + 26, + 19, + 8, + 8, + 26, + 18, + 24, + 25, + 6, + 10, + 18, + 11 + ], + "weighted_loads": [ + 0.4438144452869892, + 1.0686258412897587, + 1.134571647271514, + 0.18342943862080574, + 1.164568828418851, + 0.12335279956459999, + 1.9541756212711334, + 0.295061107724905, + 0.18541353940963745, + 1.2599483653903008, + 1.7123844604939222, + 2.2214051578193903, + 1.6788910496979952, + 0.400328679010272, + 1.3484160974621773, + 0.6356176696717739, + 0.7888652458786964, + 1.1533342339098454, + 0.042935263365507126, + 0.760654404759407, + 0.9242663905024529, + 1.265616798773408, + 0.7598167285323143, + 0.6656883917748928, + 0.8973858654499054, + 1.1353253982961178, + 2.327456413768232, + 1.8873356059193611, + 0.9390714205801487, + 0.8718598182313144, + 1.210966283455491, + 0.5970087368041277, + 3.8730082027614117, + 0.8316079005599022, + 1.0441912719979882, + 0.46425311639904976, + 1.6887101717293262, + 0.6337203476577997, + 1.7421123497188091, + 0.8128810487687588, + 1.2116790246218443, + 0.06925859674811363, + 0.3110977988690138, + 2.6489737015217543, + 0.1634327583014965, + 0.5062070786952972, + 0.6920538228005171, + 1.111136706545949, + 0.33560158126056194, + 1.1195711642503738, + 0.4883385580033064, + 2.8218378853052855, + 2.6620981376618147, + 0.9987056963145733, + 0.6153300758451223, + 0.4764903038740158, + 2.468318931758404, + 2.348574910312891, + 1.5038825664669275, + 1.5408119577914476, + 0.4136813711374998, + 0.6136092618107796, + 1.4426821833476424, + 1.727025719359517 + ], + "unique_experts": 64, + "load_cv": 0.4860644924329953, + "normalized_load_entropy": 0.9692914131680962, + "max_load_share": 0.032467532467532464 + } + }, + "s0_x": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "5e8416e4d79e142d62058640354dd0ab2524d34325b447faf9bacc6c5de2259e", + "route_weight_sha256": "f2812efc2e67b393a6db23a964b8241184508fc2ba667d4cfd5285d08091223c", + "loads": [ + 8, + 11, + 16, + 4, + 10, + 2, + 18, + 3, + 4, + 8, + 15, + 12, + 12, + 9, + 6, + 4, + 11, + 8, + 1, + 11, + 12, + 9, + 7, + 12, + 6, + 12, + 10, + 19, + 15, + 18, + 5, + 11, + 27, + 15, + 9, + 7, + 12, + 7, + 20, + 5, + 14, + 2, + 4, + 21, + 1, + 8, + 16, + 13, + 4, + 10, + 7, + 24, + 18, + 19, + 5, + 6, + 12, + 11, + 16, + 17, + 4, + 10, + 15, + 10 + ], + "weighted_loads": [ + 0.4390263296663761, + 0.9443572424352169, + 1.150593688711524, + 0.17251061275601387, + 1.005765724927187, + 0.08642781153321266, + 1.9792323308065534, + 0.11383875086903572, + 0.1743462923914194, + 0.7426759079098701, + 0.9054653234779835, + 1.6241156347095966, + 1.4944772943854332, + 0.3955880533903837, + 0.5128786675632, + 0.362332995980978, + 0.8010259754955769, + 0.6590278781950474, + 0.04207481071352959, + 0.6306440774351358, + 0.9770583491772413, + 0.8298728317022324, + 0.2708000149577856, + 0.6158706098794937, + 0.4391306862235069, + 0.9788336008787155, + 0.7298526801168919, + 1.5639932919293642, + 0.9349890425801277, + 0.7632364253513515, + 0.14897317811846733, + 0.4916674233973026, + 3.668389340862632, + 0.7297265753149986, + 0.5837300699204206, + 0.5008144043385983, + 1.0121276080608368, + 0.32724886760115623, + 1.3185802102088928, + 0.765619296580553, + 1.2189277913421392, + 0.06709694862365723, + 0.1607826165854931, + 2.4784634094685316, + 0.05991377308964729, + 0.4299309141933918, + 0.5748543236404657, + 0.9403930008411407, + 0.25844549015164375, + 0.9789294004440308, + 0.35344882495701313, + 2.6912464313209057, + 1.9422369450330734, + 0.8680588789284229, + 0.408101262524724, + 0.3453541975468397, + 0.8901196047663689, + 1.6416268646717072, + 1.010448293760419, + 1.1562584657222033, + 0.16286342032253742, + 0.6139311138540506, + 1.3316261135041714, + 1.6460594646632671 + ], + "unique_experts": 64, + "load_cv": 0.5388388275225972, + "normalized_load_entropy": 0.963587118033054, + "max_load_share": 0.03982300884955752 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "78d9d2596892f1f3c70ae5b0676595efdf70310fc080df8e7fd95a0d4f3debf1", + "route_weight_sha256": "f7a8981bc8b020d12ec92b219647648c16f419101b467c62d2ec40f661c63440", + "loads": [ + 8, + 12, + 16, + 5, + 10, + 2, + 18, + 4, + 4, + 13, + 19, + 18, + 13, + 10, + 20, + 6, + 11, + 20, + 1, + 12, + 12, + 10, + 7, + 12, + 13, + 12, + 16, + 28, + 15, + 19, + 11, + 11, + 29, + 15, + 11, + 7, + 18, + 7, + 20, + 5, + 15, + 2, + 4, + 26, + 2, + 8, + 19, + 14, + 5, + 10, + 15, + 25, + 22, + 19, + 6, + 6, + 29, + 19, + 22, + 18, + 4, + 10, + 16, + 12 + ], + "weighted_loads": [ + 0.4390263296663761, + 1.0540203638374805, + 1.150593688711524, + 0.20091543719172478, + 1.005765724927187, + 0.08642781153321266, + 1.9792323308065534, + 0.18366596475243568, + 0.1743462923914194, + 1.0519244614988565, + 1.176770057529211, + 2.073983469977975, + 1.6173989698290825, + 0.4550573769956827, + 1.2069066781550646, + 0.45750363543629646, + 0.8010259754955769, + 1.310901764780283, + 0.04207481071352959, + 0.6874785702675581, + 0.9770583491772413, + 0.8619402088224888, + 0.2708000149577856, + 0.6158706098794937, + 0.8311965502798557, + 0.9788336008787155, + 1.7129382863640785, + 1.9136536717414856, + 0.9349890425801277, + 0.8110248516313732, + 0.7508972026407719, + 0.4916674233973026, + 3.7586540523916483, + 0.7297265753149986, + 0.7339395042508841, + 0.5008144043385983, + 1.292253227904439, + 0.32724886760115623, + 1.3185802102088928, + 0.765619296580553, + 1.2598175536841154, + 0.06709694862365723, + 0.1607826165854931, + 2.7242616545408964, + 0.11299775913357735, + 0.4299309141933918, + 0.7480463702231646, + 0.975151464343071, + 0.310365904122591, + 0.9789294004440308, + 0.7030993644148111, + 2.8655259869992733, + 2.380364991724491, + 0.8680588789284229, + 0.45501683093607426, + 0.3453541975468397, + 2.1024100705981255, + 2.140793891623616, + 1.24543353356421, + 1.2038916405290365, + 0.16286342032253742, + 0.6139311138540506, + 1.3725581355392933, + 1.7276336252689362 + ], + "unique_experts": 64, + "load_cv": 0.5360142309727137, + "normalized_load_entropy": 0.9632522519314553, + "max_load_share": 0.035024154589371984 + } + }, + "s1_x": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "031f44e6f81317d9df8180774debb9eda20033224331428987f3d45c57ec6317", + "route_weight_sha256": "6e2c9c17d1b059415a22dafca972edbc36301ade1bd3eef9eb72dfd38f35770c", + "loads": [ + 9, + 11, + 15, + 3, + 10, + 3, + 18, + 3, + 5, + 8, + 15, + 11, + 13, + 8, + 9, + 4, + 11, + 8, + 2, + 12, + 12, + 10, + 6, + 13, + 6, + 12, + 11, + 20, + 14, + 17, + 5, + 10, + 25, + 17, + 9, + 6, + 12, + 6, + 21, + 6, + 13, + 2, + 5, + 21, + 1, + 11, + 14, + 14, + 2, + 9, + 4, + 23, + 18, + 16, + 5, + 7, + 9, + 10, + 16, + 19, + 6, + 10, + 17, + 10 + ], + "weighted_loads": [ + 0.4971645139157772, + 0.9401619173586369, + 1.1443980559706688, + 0.15493136644363403, + 0.9856861755251884, + 0.13076532632112503, + 1.9735311474651098, + 0.10919010266661644, + 0.19376832991838455, + 0.7475582025945187, + 0.8437630869448185, + 1.603992410004139, + 1.5101798977702856, + 0.34450277872383595, + 0.6233233325183392, + 0.3620092570781708, + 0.7992734499275684, + 0.6931090950965881, + 0.06963908299803734, + 0.6845761407166719, + 0.882794177159667, + 0.8496983386576176, + 0.2286202646791935, + 0.6730036959052086, + 0.4337055366486311, + 0.967064380645752, + 0.772092055529356, + 1.6181275751441717, + 0.9050463736057281, + 0.7087778514251113, + 0.16503026336431503, + 0.45241396129131317, + 3.531112778931856, + 0.8405964821577072, + 0.5741551239043474, + 0.40488155372440815, + 0.9939928762614727, + 0.29392740689218044, + 1.4582239426672459, + 0.7254314832389355, + 1.0665472783148289, + 0.0669294036924839, + 0.18403352983295918, + 2.2367175947874784, + 0.05285221338272095, + 0.5336606465280056, + 0.487228000536561, + 1.0075224936008453, + 0.24347300454974174, + 0.9933533705770969, + 0.20940405130386353, + 2.487922824919224, + 1.8110067918896675, + 0.6869878768920898, + 0.39108114317059517, + 0.35684050992131233, + 0.7103034313768148, + 1.5921631753444672, + 1.029456326738, + 1.1901320591568947, + 0.2515533473342657, + 0.6215487197041512, + 1.4070234652608633, + 1.6245248299092054 + ], + "unique_experts": 64, + "load_cv": 0.527875261377356, + "normalized_load_entropy": 0.9648937508855936, + "max_load_share": 0.03687315634218289 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "2889a947c3d896a9d6870c5dd1ad3812b798e56cd437a05ec7522b7572663d42", + "route_weight_sha256": "bdeac8f845d280889036680c930aff76cdd5a3fb821d09f5a73421c922fe645d", + "loads": [ + 9, + 12, + 15, + 3, + 13, + 4, + 18, + 5, + 5, + 16, + 23, + 19, + 14, + 9, + 24, + 9, + 11, + 14, + 2, + 13, + 12, + 16, + 12, + 13, + 15, + 14, + 23, + 29, + 14, + 22, + 13, + 11, + 29, + 17, + 16, + 6, + 24, + 11, + 24, + 7, + 14, + 3, + 7, + 25, + 1, + 12, + 17, + 16, + 3, + 11, + 11, + 24, + 27, + 18, + 8, + 9, + 29, + 19, + 27, + 27, + 8, + 10, + 20, + 12 + ], + "weighted_loads": [ + 0.4971645139157772, + 1.0358745642006397, + 1.1443980559706688, + 0.15493136644363403, + 1.1659525018185377, + 0.17545843496918678, + 1.9735311474651098, + 0.24383793026208878, + 0.19376832991838455, + 1.2242716178297997, + 1.6344255283474922, + 2.3873323164880276, + 1.6268998887389898, + 0.39866516552865505, + 1.5230153501033783, + 0.6691503338515759, + 0.7992734499275684, + 1.1110101342201233, + 0.06963908299803734, + 0.7513043005019426, + 0.882794177159667, + 1.2019814867526293, + 0.6798880696296692, + 0.6730036959052086, + 0.8738116454333067, + 1.0721657685935497, + 2.213193867355585, + 1.9689020719379187, + 0.9050463736057281, + 0.9115865705534816, + 1.0030162036418915, + 0.532003715634346, + 3.704213999211788, + 0.8405964821577072, + 0.9469327013939619, + 0.40488155372440815, + 1.6399489492177963, + 0.5951276030391455, + 1.7372398637235165, + 0.7591076716780663, + 1.09593671746552, + 0.09927967563271523, + 0.27714343555271626, + 2.436012526974082, + 0.05285221338272095, + 0.5511431694030762, + 0.6880621965974569, + 1.1244215704500675, + 0.27886298671364784, + 1.1487616337835789, + 0.5003593787550926, + 2.5674705654382706, + 2.587627809494734, + 0.8791706971824169, + 0.6042987555265427, + 0.472184494137764, + 2.466394456103444, + 2.455645725131035, + 1.668357016518712, + 1.560036500915885, + 0.4965671431273222, + 0.6215487197041512, + 1.5305423140525818, + 1.7086284030228853 + ], + "unique_experts": 64, + "load_cv": 0.5069003435061565, + "normalized_load_entropy": 0.9669348305120089, + "max_load_share": 0.031385281385281384 + } + }, + "s0_period": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "4a0f4b09c2b0e1c43fbdf217bdcbb02018341f45294a5f55b5745555b385fbbc", + "route_weight_sha256": "48c1d287656ad7f367785f44df40fa87ea8f2766c2cb278351ffb786ea3485a0", + "loads": [ + 8, + 11, + 16, + 4, + 10, + 2, + 17, + 3, + 4, + 8, + 15, + 12, + 13, + 9, + 6, + 3, + 11, + 8, + 1, + 12, + 12, + 10, + 6, + 12, + 6, + 11, + 9, + 19, + 15, + 18, + 6, + 12, + 25, + 17, + 12, + 7, + 13, + 7, + 20, + 5, + 14, + 2, + 6, + 22, + 2, + 9, + 15, + 14, + 3, + 9, + 4, + 23, + 18, + 19, + 5, + 6, + 11, + 11, + 15, + 17, + 5, + 10, + 15, + 8 + ], + "weighted_loads": [ + 0.44205542653799057, + 0.9391667060554028, + 1.1549221202731133, + 0.18279866501688957, + 0.9958506338298321, + 0.08863753080368042, + 1.9708078932017088, + 0.11774645000696182, + 0.16859558410942554, + 0.7363282404839993, + 0.9054279029369354, + 1.6169863268733025, + 1.5312450006604195, + 0.39901953376829624, + 0.5134064145386219, + 0.3231185972690582, + 0.7892177775502205, + 0.6518914066255093, + 0.04357273504137993, + 0.6807105243206024, + 0.9407193008810282, + 0.862838895060122, + 0.23586901277303696, + 0.6150685213506222, + 0.4310971796512604, + 0.9463466051965952, + 0.6751870298758149, + 1.543796731159091, + 0.9402106888592243, + 0.757751839235425, + 0.18211989663541317, + 0.5453517381101847, + 3.5515216048806906, + 0.7996535431593657, + 0.6622840501368046, + 0.5069783516228199, + 1.0517524760216475, + 0.32895420491695404, + 1.3199828751385212, + 0.7450376264750957, + 1.2242602352052927, + 0.06895612180233002, + 0.21354984864592552, + 2.4914685543626547, + 0.08875376917421818, + 0.4401924442499876, + 0.5450545605272055, + 0.9929858688265085, + 0.23889733478426933, + 0.9306291323155165, + 0.21843987330794334, + 2.6346586979925632, + 1.948485791683197, + 0.8499763030558825, + 0.39645288698375225, + 0.33787570148706436, + 0.8851331360638142, + 1.634811632335186, + 0.9668187499046326, + 1.1634763088077307, + 0.20508938655257225, + 0.6167562529444695, + 1.3099854453466833, + 1.608225543051958 + ], + "unique_experts": 64, + "load_cv": 0.531554909422771, + "normalized_load_entropy": 0.9642457778511406, + "max_load_share": 0.03687315634218289 + }, + "full_input": { + "tokens": 138, + "top_k": 6, + "decisions": 828, + "ordered_route_sha256": "b0925f200dd43c5918889216bf8563728f9ac27bd8c1357cbe22aac8a72144f7", + "route_weight_sha256": "803b7653e00cd26fd82aff414d0c03d808bd01e43555997b958906bb082cfb25", + "loads": [ + 8, + 12, + 16, + 5, + 10, + 2, + 17, + 4, + 4, + 13, + 19, + 16, + 14, + 10, + 20, + 4, + 11, + 18, + 1, + 13, + 12, + 11, + 6, + 12, + 13, + 11, + 15, + 26, + 15, + 18, + 14, + 12, + 28, + 18, + 15, + 7, + 20, + 7, + 20, + 5, + 15, + 2, + 7, + 25, + 4, + 9, + 19, + 15, + 4, + 9, + 13, + 24, + 23, + 19, + 6, + 6, + 27, + 18, + 21, + 18, + 5, + 10, + 16, + 11 + ], + "weighted_loads": [ + 0.44205542653799057, + 1.0568277426064014, + 1.1549221202731133, + 0.21181631088256836, + 0.9958506338298321, + 0.08863753080368042, + 1.9708078932017088, + 0.19416235387325287, + 0.16859558410942554, + 1.0401168633252382, + 1.1787618659436703, + 1.9195114467293024, + 1.6591408476233482, + 0.45848885737359524, + 1.1390967424958944, + 0.38073692470788956, + 0.7892177775502205, + 1.2047224044799805, + 0.04357273504137993, + 0.7392708286643028, + 0.9407193008810282, + 0.8949062721803784, + 0.23586901277303696, + 0.6150685213506222, + 0.8762071765959263, + 0.9463466051965952, + 1.6770123923197389, + 1.827655777335167, + 0.9402106888592243, + 0.757751839235425, + 0.855659618973732, + 0.5453517381101847, + 3.6773543152958155, + 0.8383545521646738, + 0.8455073684453964, + 0.5069783516228199, + 1.3986791912466288, + 0.32895420491695404, + 1.3199828751385212, + 0.7450376264750957, + 1.2651499975472689, + 0.06895612180233002, + 0.26652590557932854, + 2.6434919368475676, + 0.18050841055810452, + 0.4401924442499876, + 0.758115915581584, + 1.0322764087468386, + 0.30637814477086067, + 0.9306291323155165, + 0.5973257310688496, + 2.8166527338325977, + 2.464201644062996, + 0.8499763030558825, + 0.4433684553951025, + 0.33787570148706436, + 2.1280272640287876, + 2.025112146511674, + 1.2018039897084236, + 1.211109483614564, + 0.20508938655257225, + 0.6167562529444695, + 1.3509174673818052, + 1.773804172873497 + ], + "unique_experts": 64, + "load_cv": 0.5117809734205674, + "normalized_load_entropy": 0.9659815052301706, + "max_load_share": 0.033816425120772944 + } + }, + "s1_period": { + "target_content": { + "tokens": 113, + "top_k": 6, + "decisions": 678, + "ordered_route_sha256": "56a93fc78b6053ee6e583989474609d58b5a91a78f2a1274fe81829464021278", + "route_weight_sha256": "b610d0f42b2a6beec405aed4a00637bf19978430a9adee27d1da5095e7d6981d", + "loads": [ + 10, + 11, + 15, + 3, + 10, + 3, + 18, + 2, + 5, + 8, + 15, + 11, + 14, + 7, + 9, + 3, + 11, + 10, + 2, + 13, + 12, + 11, + 8, + 13, + 6, + 13, + 12, + 20, + 14, + 17, + 5, + 11, + 24, + 19, + 10, + 5, + 12, + 6, + 21, + 6, + 13, + 1, + 6, + 21, + 1, + 9, + 16, + 14, + 2, + 10, + 5, + 23, + 17, + 12, + 4, + 7, + 6, + 10, + 16, + 20, + 5, + 10, + 15, + 10 + ], + "weighted_loads": [ + 0.5359042286872864, + 0.9466025941073895, + 1.1353438682854176, + 0.15924567729234695, + 0.9885377623140812, + 0.13973693549633026, + 1.98554090783, + 0.0931520126760006, + 0.1931562926620245, + 0.7697622142732143, + 0.82985994592309, + 1.5883266180753708, + 1.5312615297734737, + 0.31260576844215393, + 0.6215834878385067, + 0.30999794602394104, + 0.7873528636991978, + 0.7713203709572554, + 0.07032232359051704, + 0.7014852222055197, + 0.8686033096164465, + 0.8977413345128298, + 0.2926410995423794, + 0.6675385944545269, + 0.43717610463500023, + 0.9992437995970249, + 0.7741354051977396, + 1.594460129737854, + 0.8906681425869465, + 0.6950110667385161, + 0.15882041677832603, + 0.4885600619018078, + 3.5323834735900164, + 0.8713115341961384, + 0.6257867198437452, + 0.3845636211335659, + 0.9774257019162178, + 0.3020842280238867, + 1.467555545270443, + 0.750116128474474, + 1.0874977819621563, + 0.027836298570036888, + 0.2230842560529709, + 2.224847486242652, + 0.05506996437907219, + 0.44636896438896656, + 0.580589197576046, + 1.0020441208034754, + 0.2182174138724804, + 1.0190004706382751, + 0.2515432573854923, + 2.5271024592220783, + 1.7894616462290287, + 0.5544687155634165, + 0.35962141677737236, + 0.336787935346365, + 0.5658974088728428, + 1.5845559611916542, + 1.0357823986560106, + 1.2333306055516005, + 0.21880827844142914, + 0.6090709697455168, + 1.3045968925580382, + 1.7002001143991947 + ], + "unique_experts": 64, + "load_cv": 0.5341677108103174, + "normalized_load_entropy": 0.9631369291312307, + "max_load_share": 0.035398230088495575 + }, + "full_input": { + "tokens": 154, + "top_k": 6, + "decisions": 924, + "ordered_route_sha256": "1bdcb5d82159d82fdd2dbb824333d064657d9599e8c7e3a233c3252078cb8a12", + "route_weight_sha256": "c3f556de1c09e9da8123432e433143f0f44eaaf8e08435d5a3d11e21c24009f0", + "loads": [ + 10, + 12, + 15, + 3, + 13, + 3, + 18, + 3, + 5, + 16, + 23, + 17, + 15, + 8, + 24, + 8, + 11, + 16, + 2, + 14, + 12, + 17, + 14, + 13, + 16, + 15, + 23, + 29, + 14, + 21, + 14, + 12, + 28, + 20, + 17, + 5, + 25, + 12, + 24, + 7, + 14, + 1, + 9, + 25, + 1, + 10, + 20, + 16, + 3, + 12, + 13, + 24, + 27, + 14, + 8, + 9, + 26, + 17, + 26, + 27, + 7, + 10, + 18, + 13 + ], + "weighted_loads": [ + 0.5359042286872864, + 1.043578702956438, + 1.1353438682854176, + 0.15924567729234695, + 1.1688040886074305, + 0.13973693549633026, + 1.98554090783, + 0.18147089704871178, + 0.1931562926620245, + 1.2435031682252884, + 1.6494427882134914, + 2.2051920853555202, + 1.6442338787019253, + 0.36676815524697304, + 1.509061861783266, + 0.6132128313183784, + 0.7873528636991978, + 1.2414831649512053, + 0.07032232359051704, + 0.7650153990834951, + 0.8686033096164465, + 1.2500244826078415, + 0.7439089044928551, + 0.6675385944545269, + 0.9509427174925804, + 1.1043451875448227, + 2.190320434048772, + 1.9396976083517075, + 0.8906681425869465, + 0.8324739024974406, + 1.036519542336464, + 0.5681498162448406, + 3.7004568334668875, + 0.9072658196091652, + 0.997613413259387, + 0.3845636211335659, + 1.6799576729536057, + 0.6340193562209606, + 1.7465714663267136, + 0.7837923169136047, + 1.1168872211128473, + 0.027836298570036888, + 0.3546927683055401, + 2.4241424184292555, + 0.05506996437907219, + 0.46385148726403713, + 0.8285842463374138, + 1.1201453264802694, + 0.2536073960363865, + 1.174408733844757, + 0.5758846811950207, + 2.6070424802601337, + 2.614834789186716, + 0.7466515358537436, + 0.6111180521547794, + 0.4521319195628166, + 2.3905793838202953, + 2.286849655210972, + 1.6109422910958529, + 1.5579922460019588, + 0.4638220742344856, + 0.6090709697455168, + 1.4281157413497567, + 1.8736704215407372 + ], + "unique_experts": 64, + "load_cv": 0.5057159088103765, + "normalized_load_entropy": 0.9656036920086813, + "max_load_share": 0.031385281385281384 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 113, + "ordered_topk_exact_tokens": 71, + "set_exact_tokens": 89, + "mean_set_jaccard": 0.9393173198482933, + "mean_token_weighted_tv": 0.014341651676305099, + "aggregate_load_tv": 0.029498525073746312 + }, + "system_bos": { + "tokens": 113, + "ordered_topk_exact_tokens": 73, + "set_exact_tokens": 91, + "mean_set_jaccard": 0.936156763590392, + "mean_token_weighted_tv": 0.024379006442737525, + "aggregate_load_tv": 0.025073746312684365 + }, + "system_x": { + "tokens": 113, + "ordered_topk_exact_tokens": 51, + "set_exact_tokens": 73, + "mean_set_jaccard": 0.8912768647281922, + "mean_token_weighted_tv": 0.0296500940596998, + "aggregate_load_tv": 0.042772861356932146 + }, + "system_period": { + "tokens": 113, + "ordered_topk_exact_tokens": 47, + "set_exact_tokens": 64, + "mean_set_jaccard": 0.8670459334176149, + "mean_token_weighted_tv": 0.03317239930836764, + "aggregate_load_tv": 0.05457227138643067 + }, + "bos_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 66, + "set_exact_tokens": 78, + "mean_set_jaccard": 0.9013906447534766, + "mean_token_weighted_tv": 0.02824515056079336, + "aggregate_load_tv": 0.04277286135693215 + }, + "bos_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 58, + "set_exact_tokens": 82, + "mean_set_jaccard": 0.9216182048040454, + "mean_token_weighted_tv": 0.022204195998147526, + "aggregate_load_tv": 0.030973451327433628 + }, + "x_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 64, + "set_exact_tokens": 75, + "mean_set_jaccard": 0.9039190897597978, + "mean_token_weighted_tv": 0.022786574718435253, + "aggregate_load_tv": 0.035398230088495575 + }, + "x_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 47, + "set_exact_tokens": 72, + "mean_set_jaccard": 0.8925410872313527, + "mean_token_weighted_tv": 0.029351348397363208, + "aggregate_load_tv": 0.03392330383480826 + }, + "period_at_s0": { + "tokens": 113, + "ordered_topk_exact_tokens": 69, + "set_exact_tokens": 86, + "mean_set_jaccard": 0.9317319848293298, + "mean_token_weighted_tv": 0.019341009261037132, + "aggregate_load_tv": 0.030973451327433628 + }, + "period_at_s1": { + "tokens": 113, + "ordered_topk_exact_tokens": 44, + "set_exact_tokens": 63, + "mean_set_jaccard": 0.8683101559207754, + "mean_token_weighted_tv": 0.033187482699718884, + "aggregate_load_tv": 0.051622418879056046 + } + } + } + } + }, + { + "id": "wikitext2/raw-validation/0030", + "domain": "english", + "label": "English encyclopedia", + "within_domain_index": 1, + "selection_rank": "0064700bc7cd279cd9669445fce1a5a410d6e0cae091efed9c8f0182e47d7ab0", + "source_text_sha256": "3fa876ef33c7fd8fc094f7d15c183449fdf696aadd239223616f9e6086b319d5", + "source_characters": 213, + "source_tokens": 53, + "content_token_ids_sha256": "2b6a05b0fcb5ee34d10ced7cbac994105394a3609b1eae46c5e576fc55ccdaf1", + "prompt_tokens_by_condition": { + "s0_eos": 77, + "s1_eos": 93, + "s0_bos": 77, + "s1_bos": 93, + "s0_x": 77, + "s1_x": 93, + "s0_period": 77, + "s1_period": 93 + }, + "batch_prompt_tokens": 93, + "content_tokens": 52, + "boundary_crossing_tokens_by_condition": { + "s0_eos": 1, + "s1_eos": 1, + "s0_bos": 1, + "s1_bos": 1, + "s0_x": 1, + "s1_x": 1, + "s0_period": 1, + "s1_period": 1 + }, + "forward_seconds": 0.7045299760065973, + "peak_cuda_memory_allocated_bytes": 27627719168, + "hidden_stages": { + "embedding": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0a5819b4c3e62e28e54a07e8cd8b286b7d5165dba9ca456536865e8bff0776e3", + "mean": -3.918703441740945e-05, + "std": 0.10906141996383667, + "rms": 0.10906142741441727, + "max_abs": 1.7109375 + }, + "full_input": { + "shape": [ + 77, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d08132a29c5687e3076c130cc3ca0eba314f2db052de545d529f7706b06788a0", + "mean": -0.000329912785673514, + "std": 0.1020946279168129, + "rms": 0.10209516435861588, + "max_abs": 2.046875 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0a5819b4c3e62e28e54a07e8cd8b286b7d5165dba9ca456536865e8bff0776e3", + "mean": -3.918703441740945e-05, + "std": 0.10906141996383667, + "rms": 0.10906142741441727, + "max_abs": 1.7109375 + }, + "full_input": { + "shape": [ + 93, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "74c2bfe26048c5d6e4d1f53dd3a64630a5fabe3c12332fd79e33bb96c3e079f2", + "mean": -0.0006511452374979854, + "std": 0.10255975276231766, + "rms": 0.1025618240237236, + "max_abs": 2.046875 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0a5819b4c3e62e28e54a07e8cd8b286b7d5165dba9ca456536865e8bff0776e3", + "mean": -3.918703441740945e-05, + "std": 0.10906141996383667, + "rms": 0.10906142741441727, + "max_abs": 1.7109375 + }, + "full_input": { + "shape": [ + 77, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5b4531d6780ba8bb13aa38f202c13c95eb67f7651fe990d70d941ceca32937be", + "mean": -0.00031000119633972645, + "std": 0.1018565446138382, + "rms": 0.1018570140004158, + "max_abs": 2.046875 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0a5819b4c3e62e28e54a07e8cd8b286b7d5165dba9ca456536865e8bff0776e3", + "mean": -3.918703441740945e-05, + "std": 0.10906141996383667, + "rms": 0.10906142741441727, + "max_abs": 1.7109375 + }, + "full_input": { + "shape": [ + 93, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2da2fc76126ce60c0f5edf653513a8e39c4b065a3d8fd5cb85a156abb107ada7", + "mean": -0.0006346592563204467, + "std": 0.10236361622810364, + "rms": 0.10236558318138123, + "max_abs": 2.046875 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0a5819b4c3e62e28e54a07e8cd8b286b7d5165dba9ca456536865e8bff0776e3", + "mean": -3.918703441740945e-05, + "std": 0.10906141996383667, + "rms": 0.10906142741441727, + "max_abs": 1.7109375 + }, + "full_input": { + "shape": [ + 77, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "569168c9c263117b3d633ea5d2988dca0541a44e12244bb581909f493b4a30d7", + "mean": -0.00035886437399312854, + "std": 0.10201720893383026, + "rms": 0.102017842233181, + "max_abs": 2.046875 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0a5819b4c3e62e28e54a07e8cd8b286b7d5165dba9ca456536865e8bff0776e3", + "mean": -3.918703441740945e-05, + "std": 0.10906141996383667, + "rms": 0.10906142741441727, + "max_abs": 1.7109375 + }, + "full_input": { + "shape": [ + 93, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e45c98f34eb1bbc98de616894d7fadcbac90897c32b76466e78a68f783a422f1", + "mean": -0.0006751159089617431, + "std": 0.10249587893486023, + "rms": 0.10249809920787811, + "max_abs": 2.046875 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0a5819b4c3e62e28e54a07e8cd8b286b7d5165dba9ca456536865e8bff0776e3", + "mean": -3.918703441740945e-05, + "std": 0.10906141996383667, + "rms": 0.10906142741441727, + "max_abs": 1.7109375 + }, + "full_input": { + "shape": [ + 77, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3121cb1d9b57f9ab69c0d1c8b41b374949c5371d4f1d463cf7c958c4c70ac278", + "mean": -0.00035991810727864504, + "std": 0.10183440893888474, + "rms": 0.10183504223823547, + "max_abs": 2.046875 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0a5819b4c3e62e28e54a07e8cd8b286b7d5165dba9ca456536865e8bff0776e3", + "mean": -3.918703441740945e-05, + "std": 0.10906141996383667, + "rms": 0.10906142741441727, + "max_abs": 1.7109375 + }, + "full_input": { + "shape": [ + 93, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "588925e7a1bda3b45b34df28e02c66c2bd03a074d2ab2e8892f45319b76dfbbf", + "mean": -0.0006759883835911751, + "std": 0.10234525054693222, + "rms": 0.1023474857211113, + "max_abs": 2.046875 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 52, + "exact_hidden_rows": 52, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 1.0, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "system_bos": { + "tokens": 52, + "exact_hidden_rows": 52, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 1.0, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "system_x": { + "tokens": 52, + "exact_hidden_rows": 52, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 1.0, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "system_period": { + "tokens": 52, + "exact_hidden_rows": 52, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 1.0, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "bos_at_s0": { + "tokens": 52, + "exact_hidden_rows": 52, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 1.0, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "bos_at_s1": { + "tokens": 52, + "exact_hidden_rows": 52, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 1.0, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "x_at_s0": { + "tokens": 52, + "exact_hidden_rows": 52, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 1.0, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "x_at_s1": { + "tokens": 52, + "exact_hidden_rows": 52, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 1.0, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "period_at_s0": { + "tokens": 52, + "exact_hidden_rows": 52, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 1.0, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "period_at_s1": { + "tokens": 52, + "exact_hidden_rows": 52, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 1.0, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + } + } + }, + "layer_00": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ccbd913d0e0a939f37b7b6ff1077141860f4bf652c49873b96611c2075c0554b", + "mean": -0.0008088569738902152, + "std": 0.10085459053516388, + "rms": 0.10085783153772354, + "max_abs": 2.8125 + }, + "full_input": { + "shape": [ + 77, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "401b73cd6f349d792c8332b94fc250b87ddf67a5fcf2a075383353ff0ca34c65", + "mean": -0.0010543547105044127, + "std": 0.09747309237718582, + "rms": 0.09747879207134247, + "max_abs": 2.8125 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "29158ab7af3fa9b130283736b40f1608f35a2256c76a9bdab32ab12409e5f1fe", + "mean": -0.0008175189141184092, + "std": 0.10089345276355743, + "rms": 0.10089676082134247, + "max_abs": 2.8125 + }, + "full_input": { + "shape": [ + 93, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0cb53fd2e22d0844cedb0260076da89a5da7d1cf8718ecb7af83153a9a8969d3", + "mean": -0.0012751867761835456, + "std": 0.09760748594999313, + "rms": 0.0976158156991005, + "max_abs": 2.8125 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7fb46cdc750b131e916e023e3dd9608663576de7a9478b8c4da4733b14c7b45c", + "mean": -0.0007680632988922298, + "std": 0.10005676746368408, + "rms": 0.10005971789360046, + "max_abs": 2.734375 + }, + "full_input": { + "shape": [ + 77, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "27bf8f5e8e6fcc6624dac65364fa820fdb2604367f3a8879c5b846f8e5a9dde4", + "mean": -0.0009985927026718855, + "std": 0.0965200811624527, + "rms": 0.09652524441480637, + "max_abs": 2.734375 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8c9fcfd7ad9abbdfe39d9c13fd3084dc8f7515c3be26e5e9bb3c134dcb1b94cc", + "mean": -0.0007907961262390018, + "std": 0.09999891370534897, + "rms": 0.10000204294919968, + "max_abs": 2.734375 + }, + "full_input": { + "shape": [ + 93, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "884475f6673daf50bffd7786ee65cd6c3f5743a57797360db8bb3bef378c54dd", + "mean": -0.0012387889437377453, + "std": 0.09678450971841812, + "rms": 0.09679243713617325, + "max_abs": 2.734375 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fdf18d2576704cb91da4d04d75266b966b21d265d2c384805ef1ead51984b0b4", + "mean": -0.0007771424716338515, + "std": 0.0997786745429039, + "rms": 0.09978169947862625, + "max_abs": 2.75 + }, + "full_input": { + "shape": [ + 77, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ed3f8aa910f6e80261573bbe1030a291380fed9730c909b988a0843da3378e9f", + "mean": -0.0010336402337998152, + "std": 0.09649774432182312, + "rms": 0.09650327265262604, + "max_abs": 2.75 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "904f3bb27049d5e523ebbeb40b9070c17f638435447bf30e4f85d1124ce779f3", + "mean": -0.0008065922884270549, + "std": 0.09980826824903488, + "rms": 0.09981152415275574, + "max_abs": 2.734375 + }, + "full_input": { + "shape": [ + 93, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bbf9e5d6d51f0abbccdab799acac140e2bb7ca57475f69106b336cd266e994f4", + "mean": -0.0012766578001901507, + "std": 0.09684070944786072, + "rms": 0.09684912115335464, + "max_abs": 2.734375 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8aff02afb8be3d2bb5c43519f35d4128ceb3404d482e33cf1ba2e1a12c683c9d", + "mean": -0.0007616159273311496, + "std": 0.09983336180448532, + "rms": 0.09983626008033752, + "max_abs": 2.734375 + }, + "full_input": { + "shape": [ + 77, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "57c5a7723d3c7ba2875c0768d0ccb5d1761583ccdc99f7b67b0d02ec39214be2", + "mean": -0.0010213805362582207, + "std": 0.09624625742435455, + "rms": 0.09625167399644852, + "max_abs": 2.734375 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a3d186cc00b68f405d11a99f8f5aff4b3142d04d094e3ccc4c8f7ecc7e92dab7", + "mean": -0.0007932055159471929, + "std": 0.09985218942165375, + "rms": 0.09985533356666565, + "max_abs": 2.734375 + }, + "full_input": { + "shape": [ + 93, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fae773e8fcf130707e37194896c964f58551d9e96759374b8503210080191342", + "mean": -0.0012659829808399081, + "std": 0.09659967571496964, + "rms": 0.09660796821117401, + "max_abs": 2.734375 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9995861053466797, + "min_cosine_similarity": 0.9977127313613892, + "mean_relative_l2": 0.024861972779035568, + "max_abs_delta": 0.171875 + }, + "system_bos": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9994515180587769, + "min_cosine_similarity": 0.9963483810424805, + "mean_relative_l2": 0.029809338971972466, + "max_abs_delta": 0.16015625 + }, + "system_x": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9994578957557678, + "min_cosine_similarity": 0.9967932105064392, + "mean_relative_l2": 0.030023477971553802, + "max_abs_delta": 0.15625 + }, + "system_period": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9995206594467163, + "min_cosine_similarity": 0.9972470998764038, + "mean_relative_l2": 0.028327763080596924, + "max_abs_delta": 0.16015625 + }, + "bos_at_s0": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9886589050292969, + "min_cosine_similarity": 0.9732634425163269, + "mean_relative_l2": 0.14822229743003845, + "max_abs_delta": 0.232421875 + }, + "bos_at_s1": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9901658296585083, + "min_cosine_similarity": 0.977372407913208, + "mean_relative_l2": 0.13833113014698029, + "max_abs_delta": 0.2265625 + }, + "x_at_s0": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9892070293426514, + "min_cosine_similarity": 0.9737879037857056, + "mean_relative_l2": 0.14441512525081635, + "max_abs_delta": 0.234375 + }, + "x_at_s1": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9906233549118042, + "min_cosine_similarity": 0.9781753420829773, + "mean_relative_l2": 0.1348254680633545, + "max_abs_delta": 0.2265625 + }, + "period_at_s0": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9893532991409302, + "min_cosine_similarity": 0.9735977649688721, + "mean_relative_l2": 0.14346125721931458, + "max_abs_delta": 0.2392578125 + }, + "period_at_s1": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9907236099243164, + "min_cosine_similarity": 0.9784629344940186, + "mean_relative_l2": 0.13417425751686096, + "max_abs_delta": 0.2314453125 + } + } + }, + "layer_01": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1681af8a347b7003dd56d4d3d065e9d28c00c6ce4ea73cc4c7c49cc405b9d259", + "mean": -0.001430164324119687, + "std": 0.11825185269117355, + "rms": 0.11826050281524658, + "max_abs": 3.25 + }, + "full_input": { + "shape": [ + 77, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d7e4280d9a8c9ee89d31aa4d3d7eac668b86a038e120b7695fcdd8a683d66842", + "mean": -0.005127113778144121, + "std": 0.9150820374488831, + "rms": 0.9150963425636292, + "max_abs": 126.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1a5c847388b8dc67ce5483208e01f914e08f50c8e612f2661247b4020beb56ac", + "mean": -0.001444626715965569, + "std": 0.11856435984373093, + "rms": 0.1185731589794159, + "max_abs": 3.28125 + }, + "full_input": { + "shape": [ + 93, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9b78482c5906cd86ec185d82596792c39f297b05dccda55c46bfb2e945909a5d", + "mean": -0.004992544651031494, + "std": 0.8638446927070618, + "rms": 0.8638590574264526, + "max_abs": 135.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d65e8af78bebbe7212f3d3e0a0aa94f0b438d539919f3f9fee0d26573dc50663", + "mean": -0.0014880573144182563, + "std": 0.11784271150827408, + "rms": 0.1178520992398262, + "max_abs": 3.25 + }, + "full_input": { + "shape": [ + 77, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fc794b3df868df9fbe1f166f4f82eb825ed6f79725d98e0a01dd37d93770561e", + "mean": -0.001473223906941712, + "std": 0.116770438849926, + "rms": 0.11677972972393036, + "max_abs": 4.6875 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b1cdd0b8525c7fc582d409cb002f00fba806d97c212de82d0aaa02b9b1733051", + "mean": -0.0016209122259169817, + "std": 0.11752237379550934, + "rms": 0.11753355711698532, + "max_abs": 3.265625 + }, + "full_input": { + "shape": [ + 93, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2bf10c01cf8d4adb48333f44ccbc9d59206d0d1a31465c19567071b2d666fc6a", + "mean": -0.0018644534284248948, + "std": 0.11602649092674255, + "rms": 0.11604146659374237, + "max_abs": 4.6875 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fbaf414406595a64228bb66e39eb610ce8651fd0801ebc37b1ed518e81bcfe91", + "mean": -0.0014725662767887115, + "std": 0.11785657703876495, + "rms": 0.11786577850580215, + "max_abs": 3.28125 + }, + "full_input": { + "shape": [ + 77, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d528daa9ede3df6010c63e1d9f450573d0e8a4f62b78f2944b1dee1d0c14400a", + "mean": -0.0014620907604694366, + "std": 0.1168130412697792, + "rms": 0.11682218313217163, + "max_abs": 4.6875 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "777250451441ce681b5c2ed86d9de02b987c6496d9013c7846cb816ee13b77d9", + "mean": -0.0016186549328267574, + "std": 0.11732159554958344, + "rms": 0.11733275651931763, + "max_abs": 3.28125 + }, + "full_input": { + "shape": [ + 93, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1b402d1fc52e60c7fffaf44e57635d510ee8ca489c693a32d869596d12773a4d", + "mean": -0.0018666615942493081, + "std": 0.11598403751850128, + "rms": 0.11599905043840408, + "max_abs": 4.6875 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7a3e838adcb2bc964ab71294c7ccf8efea82517dcabda3c3df15ac5126595678", + "mean": -0.0014865635894238949, + "std": 0.11785126477479935, + "rms": 0.11786063760519028, + "max_abs": 3.28125 + }, + "full_input": { + "shape": [ + 77, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "08d976203824c99a7fe46c1f7fe146f260513fcdcd37bf44af1e1b08de904727", + "mean": -0.0014935166109353304, + "std": 0.11639139801263809, + "rms": 0.11640097945928574, + "max_abs": 4.6875 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9e18f5e340fb5f6718906329d5896c9f2e01f92567ca102be4c95ae901264f30", + "mean": -0.0016254063230007887, + "std": 0.11732466518878937, + "rms": 0.11733592301607132, + "max_abs": 3.28125 + }, + "full_input": { + "shape": [ + 93, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "19bfe83afa8689b35e6a188f019a85d92273947da7ac6cfa1ee727f37ddc2f47", + "mean": -0.0018849755870178342, + "std": 0.11563695967197418, + "rms": 0.11565231531858444, + "max_abs": 4.6875 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.999060869216919, + "min_cosine_similarity": 0.9952362775802612, + "mean_relative_l2": 0.040969111025333405, + "max_abs_delta": 0.1328125 + }, + "system_bos": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9966192841529846, + "min_cosine_similarity": 0.9855709075927734, + "mean_relative_l2": 0.07610655575990677, + "max_abs_delta": 0.1328125 + }, + "system_x": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9947994947433472, + "min_cosine_similarity": 0.9757063388824463, + "mean_relative_l2": 0.09180014580488205, + "max_abs_delta": 0.140625 + }, + "system_period": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9949690699577332, + "min_cosine_similarity": 0.9761037230491638, + "mean_relative_l2": 0.09000340104103088, + "max_abs_delta": 0.125 + }, + "bos_at_s0": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9868177771568298, + "min_cosine_similarity": 0.9504265785217285, + "mean_relative_l2": 0.15732119977474213, + "max_abs_delta": 0.25 + }, + "bos_at_s1": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9864922165870667, + "min_cosine_similarity": 0.9496041536331177, + "mean_relative_l2": 0.1570751965045929, + "max_abs_delta": 0.2421875 + }, + "x_at_s0": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9886609315872192, + "min_cosine_similarity": 0.9555788636207581, + "mean_relative_l2": 0.1460142731666565, + "max_abs_delta": 0.29296875 + }, + "x_at_s1": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9853449463844299, + "min_cosine_similarity": 0.9482600688934326, + "mean_relative_l2": 0.16236494481563568, + "max_abs_delta": 0.306640625 + }, + "period_at_s0": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9890514016151428, + "min_cosine_similarity": 0.9566606283187866, + "mean_relative_l2": 0.14364126324653625, + "max_abs_delta": 0.28515625 + }, + "period_at_s1": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9857149720191956, + "min_cosine_similarity": 0.9504892826080322, + "mean_relative_l2": 0.16040752828121185, + "max_abs_delta": 0.30078125 + } + } + }, + "layer_02": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6307a7b05c6b7dbee1ef68a9ae74e9990bcdef3dc55408229c16f97dfaf9397b", + "mean": -0.0005714641883969307, + "std": 0.140661358833313, + "rms": 0.14066250622272491, + "max_abs": 3.125 + }, + "full_input": { + "shape": [ + 77, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "471f6d3b8356314a6d0997c875f4ba71a92b80a006ceddabe4d06c7bf5ff8e0f", + "mean": -0.013164106756448746, + "std": 2.74033784866333, + "rms": 2.7403693199157715, + "max_abs": 392.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9ceb21f6c92ed9dea335fb517ce2b7425dba5af4262a4312724744104ceb1cfe", + "mean": -0.0004865758528467268, + "std": 0.14107394218444824, + "rms": 0.1410747766494751, + "max_abs": 3.109375 + }, + "full_input": { + "shape": [ + 93, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d6cec9bba2dfb156f14158a4b09ec6e753a1088c4e4843a8498fc667072bfd0c", + "mean": -0.013047092594206333, + "std": 2.7597734928131104, + "rms": 2.7598042488098145, + "max_abs": 436.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8ada49bd9a86ae565b0b545d6171635838f342b9818791f4d69c467938019ca9", + "mean": -0.0006040515145286918, + "std": 0.14049169421195984, + "rms": 0.1404929906129837, + "max_abs": 3.328125 + }, + "full_input": { + "shape": [ + 77, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1b47857f2c686f5fe1d88b5a21b8f51ca6c0fc3e0f0bb7d6667eb8db88d86495", + "mean": -0.00134635204449296, + "std": 0.22974444925785065, + "rms": 0.22974839806556702, + "max_abs": 23.75 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fed68b65d10b736c9cfb4e53182cab3ef41338de79885f014d124f846d034c7c", + "mean": -0.00047066694241948426, + "std": 0.1402219533920288, + "rms": 0.14022275805473328, + "max_abs": 3.203125 + }, + "full_input": { + "shape": [ + 93, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2a9241fbc71b6497c9fa91f2e7061d5d752c8f02383789176734be6be8b65ad5", + "mean": -0.0014285182114690542, + "std": 0.216325044631958, + "rms": 0.21632976830005646, + "max_abs": 23.75 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ae890582189080f0af973197329119b7668175c72667daf03ab5f89dca530274", + "mean": -0.0006459249998442829, + "std": 0.14012359082698822, + "rms": 0.1401250809431076, + "max_abs": 3.296875 + }, + "full_input": { + "shape": [ + 77, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "84a4809dc671d7dbe2796972ecc4680c1f4202122f9208fdb0f5ef732a54190a", + "mean": -0.0013693948276340961, + "std": 0.22962936758995056, + "rms": 0.22963345050811768, + "max_abs": 23.75 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5b67ce3f36aa6df04403946aff7432edcac6208e62f0e408f75a31a3fca93983", + "mean": -0.0004668775654863566, + "std": 0.13961486518383026, + "rms": 0.13961564004421234, + "max_abs": 3.171875 + }, + "full_input": { + "shape": [ + 93, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9d958f5a77957067ce3ba25a03382fcfc9b1c1c9592aff36401247df689e6eac", + "mean": -0.001420548651367426, + "std": 0.21615397930145264, + "rms": 0.21615862846374512, + "max_abs": 23.75 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1503f65d47c756685efea7f2dcde4b30ff7b454266a8b52b0356e2003d6dc9a5", + "mean": -0.000611846218816936, + "std": 0.14004629850387573, + "rms": 0.14004763960838318, + "max_abs": 3.25 + }, + "full_input": { + "shape": [ + 77, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ed5e68ed72c92740e1e4f99bcc452cb85757a368169c5730d33fb55b337e2a0b", + "mean": -0.0014205368934199214, + "std": 0.22923247516155243, + "rms": 0.22923685610294342, + "max_abs": 23.75 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "80bbed1c24d952afeda3ed5e6c0e61c9cb70d8e59a30362e0cd6f2d608b01d9d", + "mean": -0.0004570496384985745, + "std": 0.13959741592407227, + "rms": 0.13959816098213196, + "max_abs": 3.203125 + }, + "full_input": { + "shape": [ + 93, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4aacd3f5ab41cb783ec583827c713e1862e23ecc8a244e8b44c5e1d9bab261b9", + "mean": -0.0014653282705694437, + "std": 0.21579274535179138, + "rms": 0.21579772233963013, + "max_abs": 23.75 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9985567331314087, + "min_cosine_similarity": 0.9937171936035156, + "mean_relative_l2": 0.05156804993748665, + "max_abs_delta": 0.171875 + }, + "system_bos": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9957391023635864, + "min_cosine_similarity": 0.9884151220321655, + "mean_relative_l2": 0.08908172696828842, + "max_abs_delta": 0.21875 + }, + "system_x": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9937307834625244, + "min_cosine_similarity": 0.9800949096679688, + "mean_relative_l2": 0.1054871529340744, + "max_abs_delta": 0.3125 + }, + "system_period": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9940298795700073, + "min_cosine_similarity": 0.9810506105422974, + "mean_relative_l2": 0.1029595211148262, + "max_abs_delta": 0.2734375 + }, + "bos_at_s0": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9865520000457764, + "min_cosine_similarity": 0.9503688812255859, + "mean_relative_l2": 0.15989652276039124, + "max_abs_delta": 0.3046875 + }, + "bos_at_s1": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9847292304039001, + "min_cosine_similarity": 0.9456278085708618, + "mean_relative_l2": 0.16882270574569702, + "max_abs_delta": 0.392578125 + }, + "x_at_s0": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9871948957443237, + "min_cosine_similarity": 0.9530218839645386, + "mean_relative_l2": 0.15525919198989868, + "max_abs_delta": 0.388671875 + }, + "x_at_s1": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9819930791854858, + "min_cosine_similarity": 0.9397870302200317, + "mean_relative_l2": 0.1817333698272705, + "max_abs_delta": 0.470703125 + }, + "period_at_s0": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.987155020236969, + "min_cosine_similarity": 0.9514182209968567, + "mean_relative_l2": 0.1551978886127472, + "max_abs_delta": 0.3984375 + }, + "period_at_s1": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9821189045906067, + "min_cosine_similarity": 0.940549373626709, + "mean_relative_l2": 0.18104475736618042, + "max_abs_delta": 0.478515625 + } + } + }, + "layer_03": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "46d132a37c424a42e89c48f7b5689191a9bf594768e8acd4f329dc8a3eb0c1a4", + "mean": -0.0014621707377955317, + "std": 0.1642524152994156, + "rms": 0.1642589271068573, + "max_abs": 3.828125 + }, + "full_input": { + "shape": [ + 77, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "baa398be47a4f3e6ab1371c949a3bfcbf5e504e4ac418b1f1b80e51ab956cd33", + "mean": -0.018033916130661964, + "std": 8.206435203552246, + "rms": 8.206454277038574, + "max_abs": 1136.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "61440ffd588b8a496a86643591811019669cb511e0f522b0a2e20701eed96062", + "mean": -0.0014226617058739066, + "std": 0.16499978303909302, + "rms": 0.16500592231750488, + "max_abs": 3.84375 + }, + "full_input": { + "shape": [ + 93, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c47bb00ecace6ba8eec75feaf2bc108c897f1c6ed544b6819cadbd29abf7d41b", + "mean": -0.01751904934644699, + "std": 7.7107696533203125, + "rms": 7.710789680480957, + "max_abs": 1136.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "603acde36873f8934a67cdeb8d16e6d4fd9f3a42db3d772feb64aa11439c3361", + "mean": -0.001658788649365306, + "std": 0.1656305193901062, + "rms": 0.16563881933689117, + "max_abs": 3.875 + }, + "full_input": { + "shape": [ + 77, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8654c804e69946118ada7dddd2fa2923b1fe3b98fa3c14a89f4c81f1c6fd9ce6", + "mean": -0.004982123151421547, + "std": 7.3160223960876465, + "rms": 7.316023349761963, + "max_abs": 1136.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a465b234ec7a85e724cf02f5beeac876e9f601fbe5187b1089b8a71c7071f3d5", + "mean": -0.0017196714179590344, + "std": 0.1666693538427353, + "rms": 0.16667823493480682, + "max_abs": 3.921875 + }, + "full_input": { + "shape": [ + 93, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "385d83b5e94de86fc74d877466413e9f8001e69c5c72dced2cd7f71c3ba5781c", + "mean": -0.004812727216631174, + "std": 6.657317638397217, + "rms": 6.65731954574585, + "max_abs": 1136.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "58436950ffdbc2448adb4e80de1b41dcc6dead191d8e58cbac006d81e585a1f1", + "mean": -0.0017863907851278782, + "std": 0.16478364169597626, + "rms": 0.16479332745075226, + "max_abs": 3.8125 + }, + "full_input": { + "shape": [ + 77, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "91939279da3ed4096cae48e23a04d998ebd966f37f8cb0de21b6091a715bff50", + "mean": -0.005124274175614119, + "std": 7.315993309020996, + "rms": 7.315994739532471, + "max_abs": 1136.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f90de3079f21293f63bd5aa1df478daad16e3552e24f1b4fd958e75c794635df", + "mean": -0.0018128915689885616, + "std": 0.16592423617839813, + "rms": 0.16593413054943085, + "max_abs": 3.921875 + }, + "full_input": { + "shape": [ + 93, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "38659a84196a767a4537bdacc6231b525df33c54fb1feb9b9969a4ef431ddb61", + "mean": -0.0049154870212078094, + "std": 6.657297134399414, + "rms": 6.657299041748047, + "max_abs": 1136.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "65f86ab1ae4ccdc58dd760d090b2007026fe43aa083d336bad4e45ae5aee086a", + "mean": -0.0017859943909570575, + "std": 0.16505183279514313, + "rms": 0.16506148874759674, + "max_abs": 3.8125 + }, + "full_input": { + "shape": [ + 77, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "69be7d043198e0ebcd412ba4ff835b9f5a82b608760dbbdec4fee895a8680097", + "mean": -0.005124631803482771, + "std": 7.315986633300781, + "rms": 7.315988540649414, + "max_abs": 1136.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "65ec5ed7aa6f315a3412abdc4272260c44a5ef8d1a2f5b3117c454a56b9a25ba", + "mean": -0.001779681770130992, + "std": 0.16591228544712067, + "rms": 0.16592183709144592, + "max_abs": 3.9375 + }, + "full_input": { + "shape": [ + 93, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f912861224cdfba15c290cd5941036a7a422ee83bc1220713b3067770bdcd082", + "mean": -0.004890838172286749, + "std": 6.657287120819092, + "rms": 6.657288551330566, + "max_abs": 1136.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9986262917518616, + "min_cosine_similarity": 0.9952982664108276, + "mean_relative_l2": 0.05088374391198158, + "max_abs_delta": 0.171875 + }, + "system_bos": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9953804016113281, + "min_cosine_similarity": 0.9875520467758179, + "mean_relative_l2": 0.09377182275056839, + "max_abs_delta": 0.1875 + }, + "system_x": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9934056997299194, + "min_cosine_similarity": 0.9756041765213013, + "mean_relative_l2": 0.10994318872690201, + "max_abs_delta": 0.234375 + }, + "system_period": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9938614964485168, + "min_cosine_similarity": 0.9805659055709839, + "mean_relative_l2": 0.10614561289548874, + "max_abs_delta": 0.3125 + }, + "bos_at_s0": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9873290657997131, + "min_cosine_similarity": 0.9677181243896484, + "mean_relative_l2": 0.15734992921352386, + "max_abs_delta": 0.296875 + }, + "bos_at_s1": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9851328730583191, + "min_cosine_similarity": 0.9647637009620667, + "mean_relative_l2": 0.17017680406570435, + "max_abs_delta": 0.4140625 + }, + "x_at_s0": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9875816702842712, + "min_cosine_similarity": 0.9703272581100464, + "mean_relative_l2": 0.15456756949424744, + "max_abs_delta": 0.38671875 + }, + "x_at_s1": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9824546575546265, + "min_cosine_similarity": 0.9580235481262207, + "mean_relative_l2": 0.1830773502588272, + "max_abs_delta": 0.505859375 + }, + "period_at_s0": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9878323078155518, + "min_cosine_similarity": 0.9674965739250183, + "mean_relative_l2": 0.15281081199645996, + "max_abs_delta": 0.3984375 + }, + "period_at_s1": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9827384948730469, + "min_cosine_similarity": 0.9564218521118164, + "mean_relative_l2": 0.18127328157424927, + "max_abs_delta": 0.513671875 + } + } + }, + "layer_04": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cafb0d1ef30b7c5e528b557b4ec85ec83ca6537394603c479a81acb9f78a5b1d", + "mean": -0.001955339452251792, + "std": 0.2022656947374344, + "rms": 0.2022751420736313, + "max_abs": 5.5 + }, + "full_input": { + "shape": [ + 77, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7b155c6f3d5a55634b451865e9425be07eeacaab4ba9f830f35fd9d0a6fcfd52", + "mean": -0.018068915233016014, + "std": 8.564435005187988, + "rms": 8.564454078674316, + "max_abs": 1152.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "316aebacd8d17e32b7de06b41f53335bb94a5ccd3d39feba27cb499fe8364fa9", + "mean": -0.001897488022223115, + "std": 0.20282964408397675, + "rms": 0.20283851027488708, + "max_abs": 5.5 + }, + "full_input": { + "shape": [ + 93, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "60ec7f125e9024621fef0dfaa5c3caf88ae0f03f7b2b59af83925bac55432661", + "mean": -0.01762346550822258, + "std": 8.02511215209961, + "rms": 8.025132179260254, + "max_abs": 1152.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "53444548dfdda416b1abee52e7c50929fe28673430838aa2d1fc02a5b4e46409", + "mean": -0.001962175127118826, + "std": 0.20509032905101776, + "rms": 0.20509971678256989, + "max_abs": 5.6875 + }, + "full_input": { + "shape": [ + 77, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "140683281a8fc915f1aad011d7563710fdee6868fb6c6fc54a2db858fdc90b9f", + "mean": -0.004909017588943243, + "std": 7.675192356109619, + "rms": 7.675193786621094, + "max_abs": 1152.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8236f53746dfd55764c61c1941ce4532b7b1c76b275aa3701fd8c838eeba916e", + "mean": -0.002008868148550391, + "std": 0.206316277384758, + "rms": 0.20632605254650116, + "max_abs": 5.75 + }, + "full_input": { + "shape": [ + 93, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "585816f2edc0fae57c6b2a926738be339dad94e56b8394ae2812764df2f77f51", + "mean": -0.004798695910722017, + "std": 6.976104736328125, + "rms": 6.976107120513916, + "max_abs": 1152.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "799bf90319ac24a64a51c2de3bd20339ba34115d49c26e414e8c5b57274b25dc", + "mean": -0.0019859878811985254, + "std": 0.20324411988258362, + "rms": 0.2032538205385208, + "max_abs": 5.6875 + }, + "full_input": { + "shape": [ + 77, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e5df58ea31cbe1285cb9cb8a7950885bd07c3a41f3fec05c4fcf4787457cadd3", + "mean": -0.004872445948421955, + "std": 7.675126552581787, + "rms": 7.67512845993042, + "max_abs": 1152.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ef453da80237843773db747de3232eb140a99031717dc6bc11798df3f1b622fd", + "mean": -0.0019928293768316507, + "std": 0.2050192803144455, + "rms": 0.2050289660692215, + "max_abs": 5.71875 + }, + "full_input": { + "shape": [ + 93, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "50c0bc581a21d1ece76457c7ddfb3d9feb7e1b9b272d5c6049b94da89ac12c11", + "mean": -0.004758686292916536, + "std": 6.976054668426514, + "rms": 6.976057052612305, + "max_abs": 1152.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1b6ca65390301cc1a6331a17d27f2d9e8767f3fde8c02d0cb04de3e9db4c94ce", + "mean": -0.0018836831441149116, + "std": 0.20290744304656982, + "rms": 0.2029161900281906, + "max_abs": 5.6875 + }, + "full_input": { + "shape": [ + 77, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9fb3fd37785efbe795d4b5538af6bc5bf82c977733d45143c130a3c4125a57cf", + "mean": -0.004820892121642828, + "std": 7.675110816955566, + "rms": 7.675112247467041, + "max_abs": 1152.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0d26cd4d4e89a56d9779ef76ea548891dfaeb2f25554957bc8854d24eb9ea6ee", + "mean": -0.001953749218955636, + "std": 0.20490716397762299, + "rms": 0.20491647720336914, + "max_abs": 5.75 + }, + "full_input": { + "shape": [ + 93, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f9bae01e6c069fa5bcbe64d9f29ae843152087ab8a8d92aa56ddd5c6c795fa6b", + "mean": -0.004737868905067444, + "std": 6.976043224334717, + "rms": 6.97604513168335, + "max_abs": 1152.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9987117052078247, + "min_cosine_similarity": 0.9968633651733398, + "mean_relative_l2": 0.04976312816143036, + "max_abs_delta": 0.15625 + }, + "system_bos": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9956871867179871, + "min_cosine_similarity": 0.9860647916793823, + "mean_relative_l2": 0.091465525329113, + "max_abs_delta": 0.328125 + }, + "system_x": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9940356016159058, + "min_cosine_similarity": 0.9829803705215454, + "mean_relative_l2": 0.10696907341480255, + "max_abs_delta": 0.25 + }, + "system_period": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9941444396972656, + "min_cosine_similarity": 0.9846755266189575, + "mean_relative_l2": 0.10607640445232391, + "max_abs_delta": 0.3125 + }, + "bos_at_s0": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9904552698135376, + "min_cosine_similarity": 0.9809466600418091, + "mean_relative_l2": 0.13990972936153412, + "max_abs_delta": 0.46875 + }, + "bos_at_s1": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9887341856956482, + "min_cosine_similarity": 0.9776147603988647, + "mean_relative_l2": 0.15150105953216553, + "max_abs_delta": 0.390625 + }, + "x_at_s0": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9900398850440979, + "min_cosine_similarity": 0.9785439968109131, + "mean_relative_l2": 0.14046797156333923, + "max_abs_delta": 0.40625 + }, + "x_at_s1": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9858129024505615, + "min_cosine_similarity": 0.9688962697982788, + "mean_relative_l2": 0.16743183135986328, + "max_abs_delta": 0.53515625 + }, + "period_at_s0": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9902418851852417, + "min_cosine_similarity": 0.9798365831375122, + "mean_relative_l2": 0.13869360089302063, + "max_abs_delta": 0.41796875 + }, + "period_at_s1": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.985977053642273, + "min_cosine_similarity": 0.9699474573135376, + "mean_relative_l2": 0.16631709039211273, + "max_abs_delta": 0.54296875 + } + } + }, + "layer_05": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "12532efc16023e1fbe1110ad6ae7406ee225772a6e7138602c636d1fb7950955", + "mean": -0.0012418405385687947, + "std": 0.22489410638809204, + "rms": 0.22489754855632782, + "max_abs": 5.1875 + }, + "full_input": { + "shape": [ + 77, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d8e85be455976ca25493c89247c72ba33d0b1e28e05860429e66123b832804ab", + "mean": -0.019573252648115158, + "std": 8.825454711914062, + "rms": 8.82547664642334, + "max_abs": 1152.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ad79fd9ba49ce09780e33fe1813ac11dc2679a97f7bb96f24560545e672adf91", + "mean": -0.0013047405518591404, + "std": 0.22570860385894775, + "rms": 0.225712388753891, + "max_abs": 5.28125 + }, + "full_input": { + "shape": [ + 93, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "12dc82cd500a27ce6732084bf4f1bfc2ea5400cfd952ad237e2c81c7e3e6bb43", + "mean": -0.01877998560667038, + "std": 8.27311897277832, + "rms": 8.273138999938965, + "max_abs": 1152.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b7601c6f26569d8f9c6eb1e8547a59bc41b09efc79d6edd7dbb688d1491a250a", + "mean": -0.0013593564508482814, + "std": 0.22862854599952698, + "rms": 0.2286325842142105, + "max_abs": 5.28125 + }, + "full_input": { + "shape": [ + 77, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8fad5956fbfac194e7dae3e50a484aa937162d5e67c30aa706b7d3f7b5140655", + "mean": -0.005188151262700558, + "std": 7.809781551361084, + "rms": 7.809782981872559, + "max_abs": 1152.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0652654d84f42c3d9031a5badf98ac64fc5c8a61077faa1f9f26ea2edd55fbf4", + "mean": -0.0014945409493520856, + "std": 0.23008406162261963, + "rms": 0.23008890450000763, + "max_abs": 5.34375 + }, + "full_input": { + "shape": [ + 93, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f850a5e6caa9974810770239d41a0c50d50e2e761af56c8ea143929326d6b783", + "mean": -0.004903722554445267, + "std": 7.097529888153076, + "rms": 7.097532272338867, + "max_abs": 1152.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f1c73ffd2a12ae317925e410a1601180a9dba1213e221553d4cc853882f90e61", + "mean": -0.0013542311498895288, + "std": 0.22592613101005554, + "rms": 0.22593019902706146, + "max_abs": 5.3125 + }, + "full_input": { + "shape": [ + 77, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b360baf9016401ad15367e236f74c64cc9703a0978843288adbd0c6d496f9c14", + "mean": -0.005073516629636288, + "std": 7.809695243835449, + "rms": 7.809697151184082, + "max_abs": 1152.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ff966bf3fccf74f9eec5a6a0bbf891905692ba01a5f34d5d6f340fa6dfb8518c", + "mean": -0.0015483649913221598, + "std": 0.22798769176006317, + "rms": 0.2279929369688034, + "max_abs": 5.28125 + }, + "full_input": { + "shape": [ + 93, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5d1ba33c17831ac3c9fe3d118d18ab2a803591de9c4f6fc1ef764c649f4c6dc8", + "mean": -0.004867774900048971, + "std": 7.097464561462402, + "rms": 7.097465991973877, + "max_abs": 1152.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c47a03ba8d9c57428a85ee7713edcf381f638bac067c95af64f98e209c5c5ab1", + "mean": -0.0013520800275728106, + "std": 0.2258894443511963, + "rms": 0.22589349746704102, + "max_abs": 5.34375 + }, + "full_input": { + "shape": [ + 77, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b8fdc6837ae63646cc52f2c9802c87ad2d9db471ed1888ab66a856204332d86e", + "mean": -0.005075796507298946, + "std": 7.809678554534912, + "rms": 7.809679985046387, + "max_abs": 1152.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "80580e6573468eeb02aae5cec45334a562e061a4ff58c7f49f3651424a72635d", + "mean": -0.0015470207436010242, + "std": 0.2277965396642685, + "rms": 0.22780178487300873, + "max_abs": 5.34375 + }, + "full_input": { + "shape": [ + 93, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "12fdc0a7cf2a0fbecdb7aec17ded913e1fbaa34c00cc225a3e471a0e5a234333", + "mean": -0.004885496571660042, + "std": 7.097446918487549, + "rms": 7.097448348999023, + "max_abs": 1152.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9980143904685974, + "min_cosine_similarity": 0.9926857948303223, + "mean_relative_l2": 0.06097143515944481, + "max_abs_delta": 0.2578125 + }, + "system_bos": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9948132038116455, + "min_cosine_similarity": 0.9866369962692261, + "mean_relative_l2": 0.10058124363422394, + "max_abs_delta": 0.2919921875 + }, + "system_x": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9925801157951355, + "min_cosine_similarity": 0.9789440631866455, + "mean_relative_l2": 0.11959287524223328, + "max_abs_delta": 0.29541015625 + }, + "system_period": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9924865365028381, + "min_cosine_similarity": 0.9799852967262268, + "mean_relative_l2": 0.1201673075556755, + "max_abs_delta": 0.31640625 + }, + "bos_at_s0": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9894295334815979, + "min_cosine_similarity": 0.9805777668952942, + "mean_relative_l2": 0.14656789600849152, + "max_abs_delta": 0.4375 + }, + "bos_at_s1": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9874762296676636, + "min_cosine_similarity": 0.9776620864868164, + "mean_relative_l2": 0.15986205637454987, + "max_abs_delta": 0.53125 + }, + "x_at_s0": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9888880252838135, + "min_cosine_similarity": 0.9704460501670837, + "mean_relative_l2": 0.14791129529476166, + "max_abs_delta": 0.40625 + }, + "x_at_s1": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9839197993278503, + "min_cosine_similarity": 0.9628643989562988, + "mean_relative_l2": 0.17849412560462952, + "max_abs_delta": 0.578125 + }, + "period_at_s0": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9891179800033569, + "min_cosine_similarity": 0.9739891290664673, + "mean_relative_l2": 0.14624880254268646, + "max_abs_delta": 0.375 + }, + "period_at_s1": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9842057824134827, + "min_cosine_similarity": 0.9666547179222107, + "mean_relative_l2": 0.1767677217721939, + "max_abs_delta": 0.5703125 + } + } + }, + "layer_06": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "270e51e7936887c4e492c2a748a6ea5ba1f807fc30d2b256bd0188f2ad0141b6", + "mean": -0.0018287240527570248, + "std": 0.25871238112449646, + "rms": 0.2587188482284546, + "max_abs": 6.78125 + }, + "full_input": { + "shape": [ + 77, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0bf12238b4812ac2916507955023a904f6750227846c807f0cb1ee9fe1256937", + "mean": -0.020765505731105804, + "std": 8.986371040344238, + "rms": 8.986394882202148, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3699b270f5228c9b40ecdcc536f11b931e5599867024516b43ff688d4552d3cc", + "mean": -0.0019423943012952805, + "std": 0.25948092341423035, + "rms": 0.25948816537857056, + "max_abs": 6.875 + }, + "full_input": { + "shape": [ + 93, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1ecc5a9d719e963753ac1eb7a0a321166fb5f5bef78be5ef97a0eb501e0e2a99", + "mean": -0.01997983083128929, + "std": 8.42330551147461, + "rms": 8.42332935333252, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d1beff4f9018fcc64d299467e1bd3ab17172f835d1a6169bb97bffb89cd36d05", + "mean": -0.0020293639972805977, + "std": 0.26122021675109863, + "rms": 0.261228084564209, + "max_abs": 6.84375 + }, + "full_input": { + "shape": [ + 77, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "424ddbdbc4eee0405595589c643089d6fd636b28119ef74aa259d899ae7ef565", + "mean": -0.006044141482561827, + "std": 7.935492515563965, + "rms": 7.935494422912598, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c3cc581f28b5086e20f8c2fb600270e67706f292c4193f80283e32f9dd5285d7", + "mean": -0.0021020635031163692, + "std": 0.2624959349632263, + "rms": 0.26250433921813965, + "max_abs": 7.0 + }, + "full_input": { + "shape": [ + 93, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f0a5c1ef40ef6b0406c6ed0e6d838e18f8da11ffe1f21510333807e58f41ab1f", + "mean": -0.005742958281189203, + "std": 7.212045192718506, + "rms": 7.212047100067139, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "734a374152847ddb23b311d3296fc1748368a170e47d609b25807d5da42d8bf0", + "mean": -0.0019096569158136845, + "std": 0.25980374217033386, + "rms": 0.25981074571609497, + "max_abs": 6.875 + }, + "full_input": { + "shape": [ + 77, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "954523286eff400b6e1de1553907c7de40ce22f74db2e7e5395ef0f12d114d7d", + "mean": -0.005827486515045166, + "std": 7.935420989990234, + "rms": 7.935423851013184, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3bf961fc59f75e17f71ec8686f0ceaff6dc71914e52c51761311f2497a0ca241", + "mean": -0.0021151297260075808, + "std": 0.26042482256889343, + "rms": 0.2604334056377411, + "max_abs": 6.9375 + }, + "full_input": { + "shape": [ + 93, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f2d82df9bd0b41e3b56a5f33a956c2da33a9cae9a15e0c8bb94b4dc154382e6b", + "mean": -0.005643690936267376, + "std": 7.211967468261719, + "rms": 7.211969375610352, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f7831cd8a91d2beb43f54960806389fb90418d5701c04cf620ea87f9b20ff94a", + "mean": -0.0019149892032146454, + "std": 0.25942862033843994, + "rms": 0.2594356834888458, + "max_abs": 6.8125 + }, + "full_input": { + "shape": [ + 77, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cfeeb4fd4e0bc676c2ec3d6dc3c6cda94359ea411d4aece3c6d26a1ceeb383ff", + "mean": -0.005800505634397268, + "std": 7.935403823852539, + "rms": 7.935405731201172, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "be7d165b80c9dc53ed021648eb3d9bbb6425338357b42d2b209ba9deaa45992d", + "mean": -0.002148726023733616, + "std": 0.26002222299575806, + "rms": 0.2600311040878296, + "max_abs": 6.96875 + }, + "full_input": { + "shape": [ + 93, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "36d3ef82fbe7995d682e45975364df9c4f84fb3f59e99137e8e4cf829e41b846", + "mean": -0.005674947984516621, + "std": 7.211949348449707, + "rms": 7.211951732635498, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.99756920337677, + "min_cosine_similarity": 0.9902044534683228, + "mean_relative_l2": 0.06716816872358322, + "max_abs_delta": 0.25 + }, + "system_bos": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9946747422218323, + "min_cosine_similarity": 0.9827458262443542, + "mean_relative_l2": 0.10104500502347946, + "max_abs_delta": 0.34375 + }, + "system_x": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9925035238265991, + "min_cosine_similarity": 0.9746605753898621, + "mean_relative_l2": 0.11963608860969543, + "max_abs_delta": 0.53125 + }, + "system_period": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9923540353775024, + "min_cosine_similarity": 0.9758179187774658, + "mean_relative_l2": 0.12083708494901657, + "max_abs_delta": 0.53125 + }, + "bos_at_s0": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9898062944412231, + "min_cosine_similarity": 0.9730713367462158, + "mean_relative_l2": 0.14212943613529205, + "max_abs_delta": 0.375 + }, + "bos_at_s1": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9882990717887878, + "min_cosine_similarity": 0.9790253639221191, + "mean_relative_l2": 0.15324020385742188, + "max_abs_delta": 0.4375 + }, + "x_at_s0": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9892497658729553, + "min_cosine_similarity": 0.9756397604942322, + "mean_relative_l2": 0.14554721117019653, + "max_abs_delta": 0.5625 + }, + "x_at_s1": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9841749668121338, + "min_cosine_similarity": 0.9637478590011597, + "mean_relative_l2": 0.17630378901958466, + "max_abs_delta": 0.578125 + }, + "period_at_s0": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9892941117286682, + "min_cosine_similarity": 0.9766904711723328, + "mean_relative_l2": 0.14495691657066345, + "max_abs_delta": 0.5 + }, + "period_at_s1": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9842113256454468, + "min_cosine_similarity": 0.965275228023529, + "mean_relative_l2": 0.1760668009519577, + "max_abs_delta": 0.62109375 + } + } + }, + "layer_07": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "eba2c797e2a5250fe603973eb1c2be585ace050e821444cdf4846e946e76c915", + "mean": -0.0038819448091089725, + "std": 0.2804558575153351, + "rms": 0.2804827392101288, + "max_abs": 7.21875 + }, + "full_input": { + "shape": [ + 77, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9ac6e3a2c290527d74e7ea8578fe0f1041044a94268a4c988248496d374e9737", + "mean": -0.022233126685023308, + "std": 9.012796401977539, + "rms": 9.012823104858398, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6e47b1c67fb793ff22bed2e762a44890af472894e5dbb4012bf13f77300e536b", + "mean": -0.003946310840547085, + "std": 0.2820229232311249, + "rms": 0.2820505201816559, + "max_abs": 7.1875 + }, + "full_input": { + "shape": [ + 93, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0e5996ba89b6f6c987dd9aa9c0d13a17e011a78f09d104adb2b76e03a2af43a8", + "mean": -0.02173893339931965, + "std": 8.44845199584961, + "rms": 8.448479652404785, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "51dc9bfa7c6239bfafe6a3e0e891167759bb3b498c3a5f4fa5cd08a34a67326c", + "mean": -0.00400932040065527, + "std": 0.2818284332752228, + "rms": 0.2818569540977478, + "max_abs": 7.25 + }, + "full_input": { + "shape": [ + 77, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "784cc2987b59d19af849dc9eeb8bef0feb5f6770ff3c8c1731a17bd1ec09bea9", + "mean": -0.007401552516967058, + "std": 7.95030403137207, + "rms": 7.950307369232178, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "faebc9c73c680064cff019c3afc88d6f2867dc341c8be679b71ec2397be2809b", + "mean": -0.004149832762777805, + "std": 0.28396227955818176, + "rms": 0.28399261832237244, + "max_abs": 7.21875 + }, + "full_input": { + "shape": [ + 93, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4a422a0e6de62476e31e9b7c54928f8b4237bac1333e4101b0026c8820f42802", + "mean": -0.007448418997228146, + "std": 7.225691318511963, + "rms": 7.2256951332092285, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0bb4c99a30d218da256d4ef1e32272eeb04ae9c96f712e0416d3b4881cbbee0a", + "mean": -0.003950309939682484, + "std": 0.28049156069755554, + "rms": 0.28051939606666565, + "max_abs": 7.28125 + }, + "full_input": { + "shape": [ + 77, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "405b3f3d3afadc047a8354d180e6ae7f221a32c094e7278e221ce33035e02231", + "mean": -0.007407634984701872, + "std": 7.950222969055176, + "rms": 7.950225830078125, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2ecb2e5c1dc944027e807b4b6acc7b06357b8b997ca5ee550cdce95e633fa14b", + "mean": -0.00415687495842576, + "std": 0.28209900856018066, + "rms": 0.2821296453475952, + "max_abs": 7.28125 + }, + "full_input": { + "shape": [ + 93, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7ef8501913e5d92e965363eef264679aec698d8e71d20b0072e1512634c0beb8", + "mean": -0.007465672213584185, + "std": 7.225607872009277, + "rms": 7.225611686706543, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cbc60f0bacb6a364f9f20e395e18d35d670aa8f6d19df2a3eaaf9d9225c8770c", + "mean": -0.003975373692810535, + "std": 0.27983713150024414, + "rms": 0.2798653841018677, + "max_abs": 7.21875 + }, + "full_input": { + "shape": [ + 77, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "12e2320f9b38777267944fd8dad17f564ee8f25a10a5b45ebac6399bd546a895", + "mean": -0.007274700328707695, + "std": 7.95020866394043, + "rms": 7.950212001800537, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b72bbc9e20a3485fc374b5a9885837aab50d36a59e52be83129617f6273a56e6", + "mean": -0.0042050061747431755, + "std": 0.2818581759929657, + "rms": 0.28188952803611755, + "max_abs": 7.3125 + }, + "full_input": { + "shape": [ + 93, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "43f1a271db182447f7e8b4dfee77407ab78970480effde3e5553980b10aa2b93", + "mean": -0.007403666619211435, + "std": 7.225603103637695, + "rms": 7.225606441497803, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9973148107528687, + "min_cosine_similarity": 0.9918735027313232, + "mean_relative_l2": 0.07093916088342667, + "max_abs_delta": 0.34375 + }, + "system_bos": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9940363764762878, + "min_cosine_similarity": 0.9828959107398987, + "mean_relative_l2": 0.10708660632371902, + "max_abs_delta": 0.578125 + }, + "system_x": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9919701814651489, + "min_cosine_similarity": 0.9772297143936157, + "mean_relative_l2": 0.12405197322368622, + "max_abs_delta": 0.46875 + }, + "system_period": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9915250539779663, + "min_cosine_similarity": 0.9780588150024414, + "mean_relative_l2": 0.12743856012821198, + "max_abs_delta": 0.5546875 + }, + "bos_at_s0": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9883593916893005, + "min_cosine_similarity": 0.9675092101097107, + "mean_relative_l2": 0.150238499045372, + "max_abs_delta": 0.5703125 + }, + "bos_at_s1": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.987230658531189, + "min_cosine_similarity": 0.9672708511352539, + "mean_relative_l2": 0.15854841470718384, + "max_abs_delta": 0.640625 + }, + "x_at_s0": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9880913496017456, + "min_cosine_similarity": 0.9733982086181641, + "mean_relative_l2": 0.15215107798576355, + "max_abs_delta": 0.59375 + }, + "x_at_s1": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9830573201179504, + "min_cosine_similarity": 0.9615797996520996, + "mean_relative_l2": 0.18142566084861755, + "max_abs_delta": 0.6875 + }, + "period_at_s0": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9879480004310608, + "min_cosine_similarity": 0.9725781083106995, + "mean_relative_l2": 0.15283818542957306, + "max_abs_delta": 0.65625 + }, + "period_at_s1": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9827954173088074, + "min_cosine_similarity": 0.9614719152450562, + "mean_relative_l2": 0.18256546556949615, + "max_abs_delta": 0.84375 + } + } + }, + "layer_08": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "34cf9491417eec3a17b0f2b9a4b018f0d0caac3850a8bf8854a4eacd688f3b3d", + "mean": -0.005971619859337807, + "std": 0.3230685889720917, + "rms": 0.3231237828731537, + "max_abs": 8.375 + }, + "full_input": { + "shape": [ + 77, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c73a7bbac7e51e2ca508e4f87b1308e0c20dfa0d672fa256e1930f25c17cb96b", + "mean": -0.024003561586141586, + "std": 9.043733596801758, + "rms": 9.043766021728516, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4ce339c85be55f8b7aa53b54cbd2e968ec54904706ec91f1ecf3f5985825c47f", + "mean": -0.005830908194184303, + "std": 0.32402005791664124, + "rms": 0.3240725100040436, + "max_abs": 8.375 + }, + "full_input": { + "shape": [ + 93, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9af02bc1b2285cff550f901dc637e1bf67973f6e1f05228a74b6a102320cc600", + "mean": -0.022817816585302353, + "std": 8.477932929992676, + "rms": 8.4779634475708, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "03bc6068e81f47d0b9ee643c85c8ee12768d9964188c1e109f638198c9cdd093", + "mean": -0.006102284416556358, + "std": 0.324415922164917, + "rms": 0.3244733214378357, + "max_abs": 8.375 + }, + "full_input": { + "shape": [ + 77, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f903a46b901373753ac3b2debc6d4e4be1734edb3a0766968ddc912ec3c09feb", + "mean": -0.009273508563637733, + "std": 7.96783971786499, + "rms": 7.967845916748047, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "83501c1146a1030b145f54286095a704b75a1ecec5e4480bfd1d21e91f21de84", + "mean": -0.006153703201562166, + "std": 0.32623767852783203, + "rms": 0.3262957036495209, + "max_abs": 8.3125 + }, + "full_input": { + "shape": [ + 93, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "89212f27fbf4b19f994fc564986f941a99a2928f426af82bf21b9855c3330981", + "mean": -0.0087202750146389, + "std": 7.241769313812256, + "rms": 7.241774082183838, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b4d437d5fb3ebe9aef738b6b7940e363e26a8435ef8d81b58e36a85268743654", + "mean": -0.005986777599900961, + "std": 0.32350146770477295, + "rms": 0.3235568404197693, + "max_abs": 8.4375 + }, + "full_input": { + "shape": [ + 77, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5f37f584edac2097138309d7f5f6ed39d81a2cc222d9e622fc451d7ed23d39df", + "mean": -0.00919308327138424, + "std": 7.967781066894531, + "rms": 7.9677863121032715, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ece7f839f94a7867f43bbf1449361962f74ea042a4b8d0a17c58a099cc34b7a7", + "mean": -0.006175051908940077, + "std": 0.32423675060272217, + "rms": 0.3242955505847931, + "max_abs": 8.375 + }, + "full_input": { + "shape": [ + 93, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "04f0cc2f866b67e31f8c63651654105c82387689ad7f889aef4a55aaa87c5aca", + "mean": -0.008637813851237297, + "std": 7.241687774658203, + "rms": 7.241692543029785, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "57295481b5c5d3d91d020df7b318302e66641c1fb3f1ee116c63aa5829f86a60", + "mean": -0.006130292546004057, + "std": 0.3228030204772949, + "rms": 0.3228611946105957, + "max_abs": 8.3125 + }, + "full_input": { + "shape": [ + 77, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "688d095f3b22ad1c633b13aa7c31fcc85b65fdd2d0100cbf062a908216f73e6f", + "mean": -0.009262829087674618, + "std": 7.967765808105469, + "rms": 7.967771053314209, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9f101df26a7e43402936f08f259a863acfeb6fd64d6b3f1b8df11e26eef93794", + "mean": -0.006238853093236685, + "std": 0.3239666223526001, + "rms": 0.3240266740322113, + "max_abs": 8.375 + }, + "full_input": { + "shape": [ + 93, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "001f784824c3d0c22694cf061742d5dd83cdf422dc27978172290e60c9c5a19d", + "mean": -0.008607035502791405, + "std": 7.241678714752197, + "rms": 7.241683483123779, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9964524507522583, + "min_cosine_similarity": 0.9890409708023071, + "mean_relative_l2": 0.08019674569368362, + "max_abs_delta": 0.375 + }, + "system_bos": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9930422902107239, + "min_cosine_similarity": 0.984469473361969, + "mean_relative_l2": 0.11543317139148712, + "max_abs_delta": 0.65625 + }, + "system_x": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9905545711517334, + "min_cosine_similarity": 0.9745890498161316, + "mean_relative_l2": 0.1336861252784729, + "max_abs_delta": 0.5625 + }, + "system_period": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9902617931365967, + "min_cosine_similarity": 0.9747657775878906, + "mean_relative_l2": 0.1357056051492691, + "max_abs_delta": 0.6875 + }, + "bos_at_s0": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9865952730178833, + "min_cosine_similarity": 0.9572025537490845, + "mean_relative_l2": 0.15990163385868073, + "max_abs_delta": 0.609375 + }, + "bos_at_s1": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9855170845985413, + "min_cosine_similarity": 0.9564449787139893, + "mean_relative_l2": 0.16758698225021362, + "max_abs_delta": 0.859375 + }, + "x_at_s0": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9857679605484009, + "min_cosine_similarity": 0.9545472860336304, + "mean_relative_l2": 0.16546741127967834, + "max_abs_delta": 0.8125 + }, + "x_at_s1": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9802541136741638, + "min_cosine_similarity": 0.953799843788147, + "mean_relative_l2": 0.19502335786819458, + "max_abs_delta": 1.0 + }, + "period_at_s0": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9857940673828125, + "min_cosine_similarity": 0.9590311050415039, + "mean_relative_l2": 0.16534234583377838, + "max_abs_delta": 0.75 + }, + "period_at_s1": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9802348613739014, + "min_cosine_similarity": 0.9499638080596924, + "mean_relative_l2": 0.1950540393590927, + "max_abs_delta": 0.9375 + } + } + }, + "layer_09": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0dc93add4dc483d6cb50c3ec32988fe4ee9754a298cd72827953404e545b82ee", + "mean": -0.00470966100692749, + "std": 0.3749181926250458, + "rms": 0.37494775652885437, + "max_abs": 10.625 + }, + "full_input": { + "shape": [ + 77, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f03b3f5ef61f5a53ef3c85e87fb40ea707f9cadc851cf5ecab83c1e6c5d077ac", + "mean": -0.02274281345307827, + "std": 9.046177864074707, + "rms": 9.0462064743042, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "33c3ae3232217391e473f3753c2d1c4eac03e891b0f2f768a81670729b305b43", + "mean": -0.004629249218851328, + "std": 0.3747636377811432, + "rms": 0.3747922480106354, + "max_abs": 10.8125 + }, + "full_input": { + "shape": [ + 93, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f7617f0eabf06f66e7f0e734620a78829814b8d642da3e83a38bbab33e664d8b", + "mean": -0.02253006026148796, + "std": 8.480262756347656, + "rms": 8.480292320251465, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0c7c2886efae78620434b62b68f134556ac33403c07ce1e6755d27e67be37218", + "mean": -0.004961573053151369, + "std": 0.37751930952072144, + "rms": 0.3775519132614136, + "max_abs": 10.6875 + }, + "full_input": { + "shape": [ + 77, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fea9f215d108523efd1d3aa675115c6082e295c5ebf9edb1f60aa66e9473548e", + "mean": -0.008236030116677284, + "std": 7.970529079437256, + "rms": 7.97053337097168, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bbb6e46d149b830c2a31174dff77332a618c200dbcf912c6c32db282bf5f51dd", + "mean": -0.005043073557317257, + "std": 0.37909215688705444, + "rms": 0.3791256844997406, + "max_abs": 10.75 + }, + "full_input": { + "shape": [ + 93, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5242631f9dfad556b512a307f414c915ddfed7cfc8256870c67e5c206cd3d030", + "mean": -0.008656410500407219, + "std": 7.24454402923584, + "rms": 7.244548797607422, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "301c4009ea973c845aa5ea7330942c951fd23d243c106b8827369a0ba3468100", + "mean": -0.004761706572026014, + "std": 0.3759864270687103, + "rms": 0.3760165870189667, + "max_abs": 10.75 + }, + "full_input": { + "shape": [ + 77, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "13c429ad844f105af4e2291a128dc8ab20acf758f4baca3985cbadf5210953cb", + "mean": -0.008053382858633995, + "std": 7.970442771911621, + "rms": 7.970446586608887, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e93f7d3c8a23aeb9ce53beba8b64603d5510c9e877bb1898eca634f33e30cb70", + "mean": -0.005073793698102236, + "std": 0.37467020750045776, + "rms": 0.3747045695781708, + "max_abs": 10.625 + }, + "full_input": { + "shape": [ + 93, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b008faa48c3a8830cd830672b2b430fdeeadbcc9e5d41d7063b247d8065e59d4", + "mean": -0.008645003661513329, + "std": 7.244367599487305, + "rms": 7.244372367858887, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6c56352e6d2a20f689cd31d03a72f16d862f3b3ce16631bda5927ef5a70f3464", + "mean": -0.005014799069613218, + "std": 0.3751755654811859, + "rms": 0.37520909309387207, + "max_abs": 10.625 + }, + "full_input": { + "shape": [ + 77, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "66f01bd549b64a112354bae8b988a795bc2ef27edb15104d6907c1a17b25d7fc", + "mean": -0.00809791311621666, + "std": 7.9703898429870605, + "rms": 7.970394134521484, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f130c01b754b71f083bdcee07f824b4a6b591b21ee2d62430405d102a382f4f6", + "mean": -0.005296255461871624, + "std": 0.37516680359840393, + "rms": 0.3752041757106781, + "max_abs": 10.5625 + }, + "full_input": { + "shape": [ + 93, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "91d1b9cd5668cccc34361198318428c930b7e8565e2e85796e4bce2a755b951e", + "mean": -0.008599541150033474, + "std": 7.244349479675293, + "rms": 7.244354724884033, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9965842366218567, + "min_cosine_similarity": 0.9900285005569458, + "mean_relative_l2": 0.07853125780820847, + "max_abs_delta": 0.46875 + }, + "system_bos": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9939430952072144, + "min_cosine_similarity": 0.986578643321991, + "mean_relative_l2": 0.10786665976047516, + "max_abs_delta": 0.5 + }, + "system_x": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9912249445915222, + "min_cosine_similarity": 0.9763344526290894, + "mean_relative_l2": 0.12889093160629272, + "max_abs_delta": 0.8125 + }, + "system_period": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9909378290176392, + "min_cosine_similarity": 0.9768130779266357, + "mean_relative_l2": 0.130646213889122, + "max_abs_delta": 0.65625 + }, + "bos_at_s0": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9876560568809509, + "min_cosine_similarity": 0.9564815759658813, + "mean_relative_l2": 0.15328140556812286, + "max_abs_delta": 0.875 + }, + "bos_at_s1": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9865477085113525, + "min_cosine_similarity": 0.9622885584831238, + "mean_relative_l2": 0.1621200293302536, + "max_abs_delta": 0.84375 + }, + "x_at_s0": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9867836833000183, + "min_cosine_similarity": 0.9558022618293762, + "mean_relative_l2": 0.15936605632305145, + "max_abs_delta": 0.75 + }, + "x_at_s1": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9818586707115173, + "min_cosine_similarity": 0.9586213231086731, + "mean_relative_l2": 0.1869458556175232, + "max_abs_delta": 0.8671875 + }, + "period_at_s0": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9867345094680786, + "min_cosine_similarity": 0.9573109745979309, + "mean_relative_l2": 0.1597592681646347, + "max_abs_delta": 0.9375 + }, + "period_at_s1": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9820891618728638, + "min_cosine_similarity": 0.959876298904419, + "mean_relative_l2": 0.18607565760612488, + "max_abs_delta": 0.9296875 + } + } + }, + "layer_10": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6ca4ab381e8001eedc8345956ac816ec66519de4665953113479b9dc3d6c1012", + "mean": -0.003858281997963786, + "std": 0.4181557595729828, + "rms": 0.41817355155944824, + "max_abs": 11.375 + }, + "full_input": { + "shape": [ + 77, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "52d3632a97da349ff4901affc8df5d262f322c08de59d202d23c40bd749f10c1", + "mean": -0.022900903597474098, + "std": 9.055380821228027, + "rms": 9.05540943145752, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "07a0de0b813eefa0a1bcaa203683640cc9d5fcf5b819d5b3ff6e7b4df0c9c265", + "mean": -0.003859676420688629, + "std": 0.4190041720867157, + "rms": 0.41902196407318115, + "max_abs": 11.375 + }, + "full_input": { + "shape": [ + 93, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5ea2c0b07e8871856ea19962202490526a4b87943ab600b1a78d4687b82db843", + "mean": -0.022929463535547256, + "std": 8.488917350769043, + "rms": 8.488947868347168, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "94ec6d1e33712866eb414ba339926a8baf73d159719588fdc0e1db8cc20319f5", + "mean": -0.004247197415679693, + "std": 0.42207175493240356, + "rms": 0.42209312319755554, + "max_abs": 11.5625 + }, + "full_input": { + "shape": [ + 77, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e81b8045d52a39dbe531ea5d0039b0ce20949a99581d511bb9553ad3d33505a1", + "mean": -0.008576065301895142, + "std": 7.980587482452393, + "rms": 7.980591773986816, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "53c9de75fc1e4b249075f43480a99536efe77d90e7f4daf059886f1cb77f2301", + "mean": -0.004368910565972328, + "std": 0.4229258596897125, + "rms": 0.42294842004776, + "max_abs": 11.5 + }, + "full_input": { + "shape": [ + 93, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "519d88ea6f0ba9305346fae30aa6d053972c22b9ef78b053a607cc8feaf99c31", + "mean": -0.009095819666981697, + "std": 7.254080295562744, + "rms": 7.254086017608643, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a74d4c0b50954a5debabf2ced6bad83563807894c92de522465fef9f8042f944", + "mean": -0.004023530054837465, + "std": 0.4210161566734314, + "rms": 0.42103537917137146, + "max_abs": 11.5625 + }, + "full_input": { + "shape": [ + 77, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d9be5f5b7e8d43e5d7c449b54522eaca49de458bcfba651f94afed67496c8383", + "mean": -0.00842338241636753, + "std": 7.9805097579956055, + "rms": 7.9805145263671875, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d32535c5a838d99b7ea95d580ab1cfd7ad7e2f546f5a9659b38a759f196b9842", + "mean": -0.004185195080935955, + "std": 0.4192792773246765, + "rms": 0.4193001687526703, + "max_abs": 11.8125 + }, + "full_input": { + "shape": [ + 93, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fae95f10d6744b400c6bbc86c16c3783afe7eb206e7cc50601b52857de0164b4", + "mean": -0.00898185558617115, + "std": 7.253899574279785, + "rms": 7.253905296325684, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "00f392d0987fbef6d6f61a883ed7f93cbb0975f8e4cf75cf83a22b7c9c8ab024", + "mean": -0.004152275621891022, + "std": 0.42049655318260193, + "rms": 0.42051705718040466, + "max_abs": 11.625 + }, + "full_input": { + "shape": [ + 77, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "038300678256004bec188d33352b1f2f82444530e99194ff379ae9152dc57c2e", + "mean": -0.008273674175143242, + "std": 7.980472564697266, + "rms": 7.980477333068848, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "121663a14fc36d04db39c4b7e70394958d8800d41ae7da8565bf7d64e4d527de", + "mean": -0.0044551449827849865, + "std": 0.41906216740608215, + "rms": 0.41908586025238037, + "max_abs": 11.875 + }, + "full_input": { + "shape": [ + 93, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a03ebdd890254cc684577789773ad6d1c1681b6a6be0969571bd4e8aafbfe904", + "mean": -0.008946972899138927, + "std": 7.2538676261901855, + "rms": 7.253872394561768, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9958915710449219, + "min_cosine_similarity": 0.9846270084381104, + "mean_relative_l2": 0.08610092848539352, + "max_abs_delta": 0.625 + }, + "system_bos": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9929738640785217, + "min_cosine_similarity": 0.9852385520935059, + "mean_relative_l2": 0.11542881280183792, + "max_abs_delta": 0.4375 + }, + "system_x": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9897496104240417, + "min_cosine_similarity": 0.9733414649963379, + "mean_relative_l2": 0.13852640986442566, + "max_abs_delta": 0.96875 + }, + "system_period": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9896512627601624, + "min_cosine_similarity": 0.9670211672782898, + "mean_relative_l2": 0.13849006593227386, + "max_abs_delta": 0.59375 + }, + "bos_at_s0": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9860464930534363, + "min_cosine_similarity": 0.9584988951683044, + "mean_relative_l2": 0.16268838942050934, + "max_abs_delta": 0.75 + }, + "bos_at_s1": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9845748543739319, + "min_cosine_similarity": 0.9621492624282837, + "mean_relative_l2": 0.1726648062467575, + "max_abs_delta": 1.0 + }, + "x_at_s0": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9846316576004028, + "min_cosine_similarity": 0.9597390294075012, + "mean_relative_l2": 0.17189185321331024, + "max_abs_delta": 0.8125 + }, + "x_at_s1": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9801418781280518, + "min_cosine_similarity": 0.9593206644058228, + "mean_relative_l2": 0.19525162875652313, + "max_abs_delta": 1.1875 + }, + "period_at_s0": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9849936962127686, + "min_cosine_similarity": 0.959071695804596, + "mean_relative_l2": 0.17003582417964935, + "max_abs_delta": 1.0 + }, + "period_at_s1": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9803418517112732, + "min_cosine_similarity": 0.9579194188117981, + "mean_relative_l2": 0.19422976672649384, + "max_abs_delta": 1.25 + } + } + }, + "layer_11": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "00c3eb7dd70ada6e534d346f4f6153b7a3202c1a15346e31c0d6e67761e80241", + "mean": -0.008790032006800175, + "std": 0.5378577709197998, + "rms": 0.5379295945167542, + "max_abs": 16.625 + }, + "full_input": { + "shape": [ + 77, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0f11cdb0b524acc3f27f7ad1008118beae5f87123bc2835d92823cf892635eee", + "mean": -0.02575037069618702, + "std": 9.107465744018555, + "rms": 9.107501983642578, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bae179e099a2c2d5fcfbb4bd90760eb2dba62841856c5be6a195379bffaff2f9", + "mean": -0.008669109083712101, + "std": 0.5380493402481079, + "rms": 0.5381191968917847, + "max_abs": 16.75 + }, + "full_input": { + "shape": [ + 93, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "32d7988313ef833cbed287f3a04049aa521aaab838fdc2f61d7591bd8223ec31", + "mean": -0.02522306889295578, + "std": 8.536758422851562, + "rms": 8.536795616149902, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9e4eefb90b5e4b10436d6ed224baa7f553f7ca5ca832946e06008f460d74d535", + "mean": -0.009264005348086357, + "std": 0.5396825075149536, + "rms": 0.539762020111084, + "max_abs": 15.8125 + }, + "full_input": { + "shape": [ + 77, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8b0002e049c462e78b5595c9dad2d60fd0e03d5cd7085a86cffebdb9e86d85e4", + "mean": -0.011430351063609123, + "std": 8.02410888671875, + "rms": 8.024116516113281, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9f2a7d8b77bd3dac5f80d5787ab3422edd319062da6057adea6818334131d49f", + "mean": -0.009323256090283394, + "std": 0.5419948101043701, + "rms": 0.5420750379562378, + "max_abs": 15.75 + }, + "full_input": { + "shape": [ + 93, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "aec5eb00d7a081e5bb4127be37d4690dc9e6ad9455ed5ac4f29d1b12cdb967c2", + "mean": -0.011451858095824718, + "std": 7.294259071350098, + "rms": 7.2942681312561035, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "441c325b62aca17e20aaaf4f5490f9f9713bcf69e163007e37a37b3148c0ddc9", + "mean": -0.009036042727530003, + "std": 0.5385266542434692, + "rms": 0.5386024117469788, + "max_abs": 15.75 + }, + "full_input": { + "shape": [ + 77, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6b8b51dde230132beff670575a7624a825dde3d0c574d1054e117ab18a88093d", + "mean": -0.01106588076800108, + "std": 8.024045944213867, + "rms": 8.024052619934082, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "05c0b881cc5df8d165eef15e57ebd3ce6c24b1e6ad971ff26f471b1a3fb3ed1f", + "mean": -0.009195135906338692, + "std": 0.5363664627075195, + "rms": 0.5364453196525574, + "max_abs": 16.25 + }, + "full_input": { + "shape": [ + 93, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "410778ef188a52034335328f73f02be5f8dc77205af33b48f908842bc9982424", + "mean": -0.011164507828652859, + "std": 7.29390287399292, + "rms": 7.293911457061768, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "33ee2998f38421268c5cd3504447302e6b223a1ac395cca659a97b8e117fc068", + "mean": -0.009383702650666237, + "std": 0.5361713171005249, + "rms": 0.5362534523010254, + "max_abs": 15.5 + }, + "full_input": { + "shape": [ + 77, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c96b6967749d9c2bd7562702e470361d098b298fbd00dc9533207bcf7dd90dd1", + "mean": -0.011087348684668541, + "std": 8.023889541625977, + "rms": 8.023897171020508, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "69dfb8dc4a140979a5b4e3c05ef31d856c1a13472d35fb2e51a500251ae13a33", + "mean": -0.009514623321592808, + "std": 0.5373525023460388, + "rms": 0.5374367833137512, + "max_abs": 16.0 + }, + "full_input": { + "shape": [ + 93, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ab1bbadbe5a2b3621e975c3d14716e3d19d4cfcfe7936a8d41f2861d66a2bb13", + "mean": -0.011169961653649807, + "std": 7.293910503387451, + "rms": 7.293919563293457, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9964373707771301, + "min_cosine_similarity": 0.9891195297241211, + "mean_relative_l2": 0.08059578388929367, + "max_abs_delta": 0.625 + }, + "system_bos": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9941433668136597, + "min_cosine_similarity": 0.986433744430542, + "mean_relative_l2": 0.10547804832458496, + "max_abs_delta": 0.75 + }, + "system_x": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.990788996219635, + "min_cosine_similarity": 0.9723392724990845, + "mean_relative_l2": 0.13091729581356049, + "max_abs_delta": 1.140625 + }, + "system_period": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9904274344444275, + "min_cosine_similarity": 0.9622094631195068, + "mean_relative_l2": 0.13299037516117096, + "max_abs_delta": 1.28125 + }, + "bos_at_s0": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9885603189468384, + "min_cosine_similarity": 0.9679773449897766, + "mean_relative_l2": 0.145674929022789, + "max_abs_delta": 1.109375 + }, + "bos_at_s1": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9875504970550537, + "min_cosine_similarity": 0.9674686193466187, + "mean_relative_l2": 0.15431396663188934, + "max_abs_delta": 1.4375 + }, + "x_at_s0": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9877604246139526, + "min_cosine_similarity": 0.9699497818946838, + "mean_relative_l2": 0.152594655752182, + "max_abs_delta": 1.125 + }, + "x_at_s1": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9837608933448792, + "min_cosine_similarity": 0.9629999399185181, + "mean_relative_l2": 0.17568013072013855, + "max_abs_delta": 1.453125 + }, + "period_at_s0": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9878753423690796, + "min_cosine_similarity": 0.9684511423110962, + "mean_relative_l2": 0.15205919742584229, + "max_abs_delta": 1.5625 + }, + "period_at_s1": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.983790397644043, + "min_cosine_similarity": 0.9628499150276184, + "mean_relative_l2": 0.1758030205965042, + "max_abs_delta": 1.625 + } + } + }, + "layer_12": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b60e36901570c44ca69217d5ee436ad0890eeb41c2764df5387633a85e79eadf", + "mean": -0.010675381869077682, + "std": 0.6054854989051819, + "rms": 0.6055796146392822, + "max_abs": 17.625 + }, + "full_input": { + "shape": [ + 77, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "58b910113314f1e148060bf1444f77db92da9f430b443a7d77c42daa6ffa49b2", + "mean": -0.027917811647057533, + "std": 9.172706604003906, + "rms": 9.172749519348145, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e442d636cb5a7d79fe6dc7f409362cc85a2ca53e09e6a26d924d9b3d81c46d92", + "mean": -0.010335275903344154, + "std": 0.605585515499115, + "rms": 0.6056737303733826, + "max_abs": 17.75 + }, + "full_input": { + "shape": [ + 93, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4fea0e0fe0737354e1998cdfe5b9f930ad0ecf0aff13ce90219bb02357b50e59", + "mean": -0.02648874744772911, + "std": 8.60059642791748, + "rms": 8.60063648223877, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0a0678b0848fa6cca8138ddd7a7e253c4ee5b87fe7369066c4b8f4db31c0b450", + "mean": -0.01103791780769825, + "std": 0.6065366864204407, + "rms": 0.6066370606422424, + "max_abs": 18.125 + }, + "full_input": { + "shape": [ + 77, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e546b32e83d654ab5e321c6942b0093838d3f8a11c260b6e491f6de4e5e1dde3", + "mean": -0.013226805254817009, + "std": 8.040494918823242, + "rms": 8.040504455566406, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7658e450c166b843929ecf2d9268f9585cddf878adb4b71215a39f5ceddb65c0", + "mean": -0.010976810939610004, + "std": 0.6096645593643188, + "rms": 0.6097633838653564, + "max_abs": 18.25 + }, + "full_input": { + "shape": [ + 93, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b7a1c0b625a2db26209dabf8b99d2cc35de2feb140afa728aae6d97e4e0ad2a9", + "mean": -0.012608678080141544, + "std": 7.310068130493164, + "rms": 7.3100786209106445, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d0b71ba5a866c993e3c8195c172881b6d8a088dacfec947b52ffb157f590e4c6", + "mean": -0.010921173729002476, + "std": 0.6071150898933411, + "rms": 0.6072133183479309, + "max_abs": 18.0 + }, + "full_input": { + "shape": [ + 77, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "16ae61c96fb7802ab43f121f5bcecfc6c5e47ee67d550a932ac04d1fdc296fed", + "mean": -0.013375474140048027, + "std": 8.040514945983887, + "rms": 8.040525436401367, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "49016bbcc28ba1574e8f8311fae828cbe30ef6d2699f4922607154303c41b5c3", + "mean": -0.010816249996423721, + "std": 0.6064637899398804, + "rms": 0.606560230255127, + "max_abs": 18.125 + }, + "full_input": { + "shape": [ + 93, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "804cee194bfaf59e27d5a22426c88ee5cfb53c6c053e05a14ddce5ab00e4b5ea", + "mean": -0.012484781444072723, + "std": 7.309696197509766, + "rms": 7.309706687927246, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "910a25ef5e22034eb0086b94d7bbb85e643fb37ab013251ebeed7d2d3d7b2afd", + "mean": -0.011227864772081375, + "std": 0.6055461168289185, + "rms": 0.6056501269340515, + "max_abs": 18.0 + }, + "full_input": { + "shape": [ + 77, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "633cd8017732f8bf693f206ce9e926cf04f13c5b35da1a91066fb52641062a2b", + "mean": -0.01322788093239069, + "std": 8.04038143157959, + "rms": 8.04039192199707, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3a8e093758447d52a6a38d04d1b9abdd797381ddcb2851e60ad4e2fbc20616ec", + "mean": -0.011168275959789753, + "std": 0.606253981590271, + "rms": 0.6063568592071533, + "max_abs": 18.0 + }, + "full_input": { + "shape": [ + 93, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "32663a1995206ad6411ab136212649b6e09440568d8be2fec60bc3c6a27f7f1d", + "mean": -0.012404891662299633, + "std": 7.3097052574157715, + "rms": 7.309715747833252, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9960123300552368, + "min_cosine_similarity": 0.9896804094314575, + "mean_relative_l2": 0.08535356819629669, + "max_abs_delta": 0.875 + }, + "system_bos": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9934647083282471, + "min_cosine_similarity": 0.9838719367980957, + "mean_relative_l2": 0.11123059689998627, + "max_abs_delta": 1.2421875 + }, + "system_x": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9897448420524597, + "min_cosine_similarity": 0.9697859287261963, + "mean_relative_l2": 0.1379517912864685, + "max_abs_delta": 1.625 + }, + "system_period": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9895385503768921, + "min_cosine_similarity": 0.9611517190933228, + "mean_relative_l2": 0.13872459530830383, + "max_abs_delta": 2.234375 + }, + "bos_at_s0": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9875527620315552, + "min_cosine_similarity": 0.9635574221611023, + "mean_relative_l2": 0.15100958943367004, + "max_abs_delta": 0.8125 + }, + "bos_at_s1": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9865267872810364, + "min_cosine_similarity": 0.9622688889503479, + "mean_relative_l2": 0.15996305644512177, + "max_abs_delta": 1.625 + }, + "x_at_s0": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9866368770599365, + "min_cosine_similarity": 0.9680286645889282, + "mean_relative_l2": 0.15872451663017273, + "max_abs_delta": 1.0 + }, + "x_at_s1": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9823830127716064, + "min_cosine_similarity": 0.9555341601371765, + "mean_relative_l2": 0.18264755606651306, + "max_abs_delta": 1.765625 + }, + "period_at_s0": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.986757218837738, + "min_cosine_similarity": 0.9595035314559937, + "mean_relative_l2": 0.15793655812740326, + "max_abs_delta": 1.0625 + }, + "period_at_s1": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9826072454452515, + "min_cosine_similarity": 0.952756404876709, + "mean_relative_l2": 0.18133904039859772, + "max_abs_delta": 2.109375 + } + } + }, + "layer_13": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5941b9598cc524942125173bae8bea5ec6dd6748a730b68ca67657042849583f", + "mean": -0.01256999559700489, + "std": 0.6649470925331116, + "rms": 0.6650658845901489, + "max_abs": 20.875 + }, + "full_input": { + "shape": [ + 77, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "879097c552aa033a33f5e50124b1f6ed3602c1f235439929a16b0202285891a4", + "mean": -0.029181405901908875, + "std": 9.182097434997559, + "rms": 9.182144165039062, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e1a17b00788b829e0f4e5b23320df9bb3cc2372e9a3259d190b1a41b6d1ea562", + "mean": -0.012280003167688847, + "std": 0.6654201149940491, + "rms": 0.6655333638191223, + "max_abs": 21.0 + }, + "full_input": { + "shape": [ + 93, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "dccf0d9efefbac4a63ac4a47846a034622d75be40ef7af9f8db92fa9c8e60b69", + "mean": -0.028284244239330292, + "std": 8.609909057617188, + "rms": 8.609955787658691, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b98b14a11ce5f4ed3a9bd6e178edfc6478726356a0d92d271bb779034560c1a5", + "mean": -0.012749245390295982, + "std": 0.6661284565925598, + "rms": 0.6662504076957703, + "max_abs": 21.375 + }, + "full_input": { + "shape": [ + 77, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "54bbc512fcf70e0555bc1f8db66366a517bdcdf170adfdc271cc2c806c29e599", + "mean": -0.01432906836271286, + "std": 8.049337387084961, + "rms": 8.049349784851074, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d12072e65f2c0c2a8f7b08a74e7380ed0bc4bc513b096b63dc75fb8a08d01daf", + "mean": -0.012567623518407345, + "std": 0.6691010594367981, + "rms": 0.6692190766334534, + "max_abs": 21.625 + }, + "full_input": { + "shape": [ + 93, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b22553aa7244c432c6c3609ccd216c4af288d4efabad8369e3e9a72643a4e89d", + "mean": -0.014160272665321827, + "std": 7.319008827209473, + "rms": 7.319022178649902, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "87a5aafc8e4e5e38010aa28cb80f48c271970d465e417337ade9098e956335b7", + "mean": -0.012667381204664707, + "std": 0.6668885946273804, + "rms": 0.6670088768005371, + "max_abs": 21.25 + }, + "full_input": { + "shape": [ + 77, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "804ea8d78750af9f24a388a893e1f43bebf52ff692dff109c0352c7e6ab1b1b3", + "mean": -0.014566183090209961, + "std": 8.049453735351562, + "rms": 8.049467086791992, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3258d3b01cb035374ad686dbc9510e4e8b8ab9e44f13e1970703ad90d9715425", + "mean": -0.012565204873681068, + "std": 0.6655960083007812, + "rms": 0.6657145619392395, + "max_abs": 21.375 + }, + "full_input": { + "shape": [ + 93, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cbdd861b5e08a18bc774d73b188026156554d7963bfa106004b5983f5b71eeaf", + "mean": -0.014155878685414791, + "std": 7.318652629852295, + "rms": 7.318665981292725, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "320024bd6b03188318cee44f5c0297bf57eadb987395e8995ee528b555b17c0e", + "mean": -0.013016038574278355, + "std": 0.6656957268714905, + "rms": 0.6658229827880859, + "max_abs": 21.25 + }, + "full_input": { + "shape": [ + 77, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d7cd3f9b32f23f7386f161df761ece19965a3fe61e6ae01e343d0a22e95eb961", + "mean": -0.014479980804026127, + "std": 8.049293518066406, + "rms": 8.049306869506836, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ecc6ebd16dce6af5e2c488801a7ccb433a8cb7e9999add295d78a9895cb55496", + "mean": -0.012929070740938187, + "std": 0.6657816767692566, + "rms": 0.6659071445465088, + "max_abs": 21.25 + }, + "full_input": { + "shape": [ + 93, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a803d8ceccfdf3f608c8df1843f5cff1d7e5a37e87218507c7c27b6875eaf930", + "mean": -0.014140231534838676, + "std": 7.318669319152832, + "rms": 7.318682670593262, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9960228800773621, + "min_cosine_similarity": 0.9905722141265869, + "mean_relative_l2": 0.0853601023554802, + "max_abs_delta": 0.9375 + }, + "system_bos": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9934075474739075, + "min_cosine_similarity": 0.9843394756317139, + "mean_relative_l2": 0.11195361614227295, + "max_abs_delta": 1.03125 + }, + "system_x": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9897060990333557, + "min_cosine_similarity": 0.9700564742088318, + "mean_relative_l2": 0.1383795142173767, + "max_abs_delta": 1.40625 + }, + "system_period": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9894963502883911, + "min_cosine_similarity": 0.9640418291091919, + "mean_relative_l2": 0.13928717374801636, + "max_abs_delta": 1.890625 + }, + "bos_at_s0": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9877115488052368, + "min_cosine_similarity": 0.9642437696456909, + "mean_relative_l2": 0.15068183839321136, + "max_abs_delta": 1.0 + }, + "bos_at_s1": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9867091774940491, + "min_cosine_similarity": 0.9621418714523315, + "mean_relative_l2": 0.15915952622890472, + "max_abs_delta": 1.6875 + }, + "x_at_s0": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9870815277099609, + "min_cosine_similarity": 0.9661508798599243, + "mean_relative_l2": 0.15625452995300293, + "max_abs_delta": 1.0 + }, + "x_at_s1": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9827414155006409, + "min_cosine_similarity": 0.9548341631889343, + "mean_relative_l2": 0.18067048490047455, + "max_abs_delta": 1.75 + }, + "period_at_s0": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9870313405990601, + "min_cosine_similarity": 0.9586981534957886, + "mean_relative_l2": 0.1563803255558014, + "max_abs_delta": 1.0 + }, + "period_at_s1": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9832206964492798, + "min_cosine_similarity": 0.9521159529685974, + "mean_relative_l2": 0.1781259924173355, + "max_abs_delta": 2.046875 + } + } + }, + "layer_14": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "561139fc1461cb5e167f81889f862ae5a1115ff4d332ba6cfbb02e96c015a635", + "mean": -0.011849280446767807, + "std": 0.7684287428855896, + "rms": 0.7685201168060303, + "max_abs": 23.375 + }, + "full_input": { + "shape": [ + 77, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f0203319ab73dd2f5f035b1e247780c858ce27397ba76dc0ca14d334bbf906e3", + "mean": -0.027990758419036865, + "std": 9.204256057739258, + "rms": 9.20429801940918, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7c4fa2c3792835ae4de2ea8b2d9e6f2ed6a41555dbf0e89a8f8221bf31b68eb1", + "mean": -0.011898613534867764, + "std": 0.7677364349365234, + "rms": 0.767828643321991, + "max_abs": 23.5 + }, + "full_input": { + "shape": [ + 93, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2d59581df7614b0325007e4cc01cf15e285ce05347fb00837c8c8e1f2dcc08dd", + "mean": -0.0277180727571249, + "std": 8.629813194274902, + "rms": 8.629858016967773, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "745153acff90a2d7ea2b4a38d868825c25dc4ac5fd6afd54f292e5c81588dfdd", + "mean": -0.012123693712055683, + "std": 0.7706877589225769, + "rms": 0.7707831263542175, + "max_abs": 23.875 + }, + "full_input": { + "shape": [ + 77, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "01d83f76f75d3b173e1e2a0f2267d2df15eec3686852a30128f28f57167b0796", + "mean": -0.013220774941146374, + "std": 8.073619842529297, + "rms": 8.073630332946777, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b2a86c27c0b7cb10093aadc649484a0c655af29772eebaf31e01d7e277943d20", + "mean": -0.012163861654698849, + "std": 0.773656964302063, + "rms": 0.7737525701522827, + "max_abs": 24.125 + }, + "full_input": { + "shape": [ + 93, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "19258c6d8a69400b68bf027e3bcd115c968b7cf9e9e98613d68f550112dbfbf4", + "mean": -0.013516263104975224, + "std": 7.341543197631836, + "rms": 7.341555595397949, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "137852a3694e93491c3dd59bb12bfcba92ee8866918c3e4a80094cfbe375cadd", + "mean": -0.01210126094520092, + "std": 0.7722946405410767, + "rms": 0.7723894715309143, + "max_abs": 23.75 + }, + "full_input": { + "shape": [ + 77, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "504e210a3dbb80aaa9e48000ca3bcc3c0c322c9a849ded6dcf384783308c3da9", + "mean": -0.013408055528998375, + "std": 8.073834419250488, + "rms": 8.073845863342285, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "433e16d05ff2024a969035a92f7ecc301d606702ec7746ec9d3deb0b4ed16e19", + "mean": -0.012199646793305874, + "std": 0.769566535949707, + "rms": 0.7696632146835327, + "max_abs": 23.875 + }, + "full_input": { + "shape": [ + 93, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5bdbb3ff9517b6376477b1d7306b87a4d7adc65d81cf9decb9c2f8f5c8137cc7", + "mean": -0.013548729009926319, + "std": 7.341162204742432, + "rms": 7.341174602508545, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7211f21fd83561c4ac026e35b80fd03dd04bd06bd7456790a4bebe003065c402", + "mean": -0.012280882336199284, + "std": 0.7716798186302185, + "rms": 0.7717775702476501, + "max_abs": 23.75 + }, + "full_input": { + "shape": [ + 77, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6f4298e6467a28c26dd96ba4a40c0d69f903dcce32825b06634cbf445005eb41", + "mean": -0.013221177272498608, + "std": 8.073677062988281, + "rms": 8.073686599731445, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bc736770b457ff19144ee1280a8e5291160c186e5d3065275db3f34ddd566d71", + "mean": -0.0124210761860013, + "std": 0.7689322829246521, + "rms": 0.7690325975418091, + "max_abs": 23.75 + }, + "full_input": { + "shape": [ + 93, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "053b855bdd3433dfd22fccb25babbaab2c11001542d8a21b528d842df2ce482f", + "mean": -0.013499160297214985, + "std": 7.3410844802856445, + "rms": 7.3410964012146, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9961075186729431, + "min_cosine_similarity": 0.9896994829177856, + "mean_relative_l2": 0.08438163250684738, + "max_abs_delta": 1.0625 + }, + "system_bos": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9935339689254761, + "min_cosine_similarity": 0.984599232673645, + "mean_relative_l2": 0.11091586202383041, + "max_abs_delta": 1.125 + }, + "system_x": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9895857572555542, + "min_cosine_similarity": 0.9713526964187622, + "mean_relative_l2": 0.1393176168203354, + "max_abs_delta": 1.25 + }, + "system_period": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9894144535064697, + "min_cosine_similarity": 0.9664143323898315, + "mean_relative_l2": 0.13984067738056183, + "max_abs_delta": 1.375 + }, + "bos_at_s0": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.988539457321167, + "min_cosine_similarity": 0.9641454219818115, + "mean_relative_l2": 0.14626483619213104, + "max_abs_delta": 1.8125 + }, + "bos_at_s1": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9874787926673889, + "min_cosine_similarity": 0.9645797610282898, + "mean_relative_l2": 0.15501202642917633, + "max_abs_delta": 2.1875 + }, + "x_at_s0": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9881316423416138, + "min_cosine_similarity": 0.9707024097442627, + "mean_relative_l2": 0.15081985294818878, + "max_abs_delta": 1.0 + }, + "x_at_s1": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9836628437042236, + "min_cosine_similarity": 0.957243800163269, + "mean_relative_l2": 0.17632804811000824, + "max_abs_delta": 2.0625 + }, + "period_at_s0": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.988066554069519, + "min_cosine_similarity": 0.9574182033538818, + "mean_relative_l2": 0.1513592004776001, + "max_abs_delta": 1.6875 + }, + "period_at_s1": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9839892983436584, + "min_cosine_similarity": 0.9537213444709778, + "mean_relative_l2": 0.17439879477024078, + "max_abs_delta": 2.1875 + } + } + }, + "layer_15": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4b88493f6220ac281cacd47a29e866911ccdb77b0a7c3fb434d444c7886edac1", + "mean": -0.013796629384160042, + "std": 0.8381950855255127, + "rms": 0.838308572769165, + "max_abs": 24.5 + }, + "full_input": { + "shape": [ + 77, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1a7984d2924002e93c16d8aa2e806c50a0fa849c5959280275dad787abb6378e", + "mean": -0.028752531856298447, + "std": 9.21370792388916, + "rms": 9.213753700256348, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "df69f1ae0fe3e0b82cdada79f07be6248bd604a70ed1ad6a9fe13b6ea363bda4", + "mean": -0.013805453665554523, + "std": 0.8360404968261719, + "rms": 0.8361544609069824, + "max_abs": 24.625 + }, + "full_input": { + "shape": [ + 93, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c37e5a3a4654a08941544383531ff623768f64702b3f07d321d3028760cfdc50", + "mean": -0.02869533747434616, + "std": 8.639554023742676, + "rms": 8.639601707458496, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "300244517d39068a30b7e87bb201af7d34484166dac6dab8f65ef68a519ffc4e", + "mean": -0.014410020783543587, + "std": 0.8420068025588989, + "rms": 0.8421301245689392, + "max_abs": 25.0 + }, + "full_input": { + "shape": [ + 77, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "68939ecf03f5b8cd94154deef72da3551388f22f9bc020bce7e1f50417337bb6", + "mean": -0.014270137064158916, + "std": 8.08377742767334, + "rms": 8.083789825439453, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e4118edd0e5c80bd2030c187caec143e05ae199ac3b11ab7d8c11bcf062e0f52", + "mean": -0.014413854107260704, + "std": 0.8440003395080566, + "rms": 0.8441234230995178, + "max_abs": 25.25 + }, + "full_input": { + "shape": [ + 93, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "afd34edda25b8c6362917cbfc6c81f097fd037c25963e9816f2e260bd6154c9f", + "mean": -0.014796655625104904, + "std": 7.352287292480469, + "rms": 7.352302074432373, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "caf4a82a0fdefd8ab9a7b01c804fb27bb71f0884ed31c7a30e410278739a0750", + "mean": -0.014290900900959969, + "std": 0.8418378829956055, + "rms": 0.8419591784477234, + "max_abs": 24.75 + }, + "full_input": { + "shape": [ + 77, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "26c7e94e6acdd7758040b28a663615eb91fc17329864f64272888e863afae316", + "mean": -0.014242487959563732, + "std": 8.083845138549805, + "rms": 8.083857536315918, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "83ae589e5bbcc5df2e81c1f99d44a1338a59c1ed05055d0262c8a000ccececf9", + "mean": -0.014526566490530968, + "std": 0.8371455073356628, + "rms": 0.8372714519500732, + "max_abs": 24.875 + }, + "full_input": { + "shape": [ + 93, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f5206861ff8a85e66905892aa4c9c35fa6de3a9511d0ee1c532d9912909f221a", + "mean": -0.014806042425334454, + "std": 7.351629734039307, + "rms": 7.351644515991211, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "91415c1c004c0f234ab9ad1a10ff309afd37b765ed3105619046f52f9ad0f824", + "mean": -0.01443301048129797, + "std": 0.8406764268875122, + "rms": 0.8408002853393555, + "max_abs": 24.875 + }, + "full_input": { + "shape": [ + 77, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "99c5fa46ea3c15e7816c7b4d0f0229615d60130b17809c3945ede6b6170750b7", + "mean": -0.014024386182427406, + "std": 8.083666801452637, + "rms": 8.08367919921875, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7a37935f010e972557bff449bf503e88a49734f2b2378b5c0d93d21dfdd584a5", + "mean": -0.014739006757736206, + "std": 0.8371602892875671, + "rms": 0.8372900485992432, + "max_abs": 24.875 + }, + "full_input": { + "shape": [ + 93, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cc69045364ab4f5ff67e034c21c76e1c555ca9ef055584f88dd7d3164c317a11", + "mean": -0.014684135094285011, + "std": 7.351624488830566, + "rms": 7.351639270782471, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9960566163063049, + "min_cosine_similarity": 0.9885201454162598, + "mean_relative_l2": 0.0849025696516037, + "max_abs_delta": 1.125 + }, + "system_bos": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.993615448474884, + "min_cosine_similarity": 0.9832859039306641, + "mean_relative_l2": 0.11008118838071823, + "max_abs_delta": 1.25 + }, + "system_x": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9895934462547302, + "min_cosine_similarity": 0.9719230532646179, + "mean_relative_l2": 0.1394699066877365, + "max_abs_delta": 1.46875 + }, + "system_period": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9892049431800842, + "min_cosine_similarity": 0.9661941528320312, + "mean_relative_l2": 0.1412915736436844, + "max_abs_delta": 1.328125 + }, + "bos_at_s0": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9887675046920776, + "min_cosine_similarity": 0.9629372358322144, + "mean_relative_l2": 0.14504247903823853, + "max_abs_delta": 1.3125 + }, + "bos_at_s1": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9876811504364014, + "min_cosine_similarity": 0.9648667573928833, + "mean_relative_l2": 0.15386854112148285, + "max_abs_delta": 2.1875 + }, + "x_at_s0": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9885108470916748, + "min_cosine_similarity": 0.96977698802948, + "mean_relative_l2": 0.1486215889453888, + "max_abs_delta": 1.375 + }, + "x_at_s1": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9838066101074219, + "min_cosine_similarity": 0.9571706056594849, + "mean_relative_l2": 0.1752394139766693, + "max_abs_delta": 2.125 + }, + "period_at_s0": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9883078336715698, + "min_cosine_similarity": 0.9562684297561646, + "mean_relative_l2": 0.14983811974525452, + "max_abs_delta": 2.0 + }, + "period_at_s1": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9841102957725525, + "min_cosine_similarity": 0.9531331658363342, + "mean_relative_l2": 0.17332932353019714, + "max_abs_delta": 1.875 + } + } + }, + "layer_16": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c96c2d10c1eef7f8f8d4459d1e688fcf1bd330898b9dde759cbbef0db576d323", + "mean": -0.015644168481230736, + "std": 0.9957462549209595, + "rms": 0.9958691596984863, + "max_abs": 25.875 + }, + "full_input": { + "shape": [ + 77, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3225c664290bfe87167d69e797f7343afafcf07e7cd7729bd77e9ca39d67ef94", + "mean": -0.02979661524295807, + "std": 9.230171203613281, + "rms": 9.230218887329102, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "af76be3b0de9f6d4b2811701e678d79956003564fd45f15b660c3e923ce97c33", + "mean": -0.01570141315460205, + "std": 0.9950623512268066, + "rms": 0.9951862096786499, + "max_abs": 26.125 + }, + "full_input": { + "shape": [ + 93, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "52aae3429a46837fa6cc0c85ed4381d721cc355daf48a68a73731d57b9583ffc", + "mean": -0.029254218563437462, + "std": 8.655463218688965, + "rms": 8.655511856079102, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "08f9fc8da37fd149aa1b30ab52e6aaba03ff1945e23e77cd50a61a24b2b3462c", + "mean": -0.016558296978473663, + "std": 0.9993888139724731, + "rms": 0.9995259046554565, + "max_abs": 26.0 + }, + "full_input": { + "shape": [ + 77, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3314468c680846b4a7b59c00dcfe9c6825077a9bd280621f73e438ce544ac5c8", + "mean": -0.0154810706153512, + "std": 8.101383209228516, + "rms": 8.101397514343262, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4241ba0bfcd8a0bc7b5a2718970b2e9e2d910be865effdecd8aecd42226e1309", + "mean": -0.01636737957596779, + "std": 1.002278447151184, + "rms": 1.00241219997406, + "max_abs": 26.25 + }, + "full_input": { + "shape": [ + 93, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "16078001939ae88cb918ed9e3fcea2a9f19c1c4fe2654a842bca8d0dad3af02e", + "mean": -0.015236173756420612, + "std": 7.370063304901123, + "rms": 7.370078086853027, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c9a883c4ac9f633bf8ac998318dfbfabe8ecd15c60d738f2717248774fe248ad", + "mean": -0.016866646707057953, + "std": 0.9997445940971375, + "rms": 0.9998868107795715, + "max_abs": 25.875 + }, + "full_input": { + "shape": [ + 77, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f4768ad4591e83ba3b2accb010960e424697f4e90f1003e7235bad2603973f8f", + "mean": -0.015759620815515518, + "std": 8.101694107055664, + "rms": 8.101709365844727, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0f14ad00180949af628e0cca64b4f69f9b2b30477a83e7aa7db143097b016a4b", + "mean": -0.016508810222148895, + "std": 0.9940217137336731, + "rms": 0.9941588044166565, + "max_abs": 25.875 + }, + "full_input": { + "shape": [ + 93, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "24015d690f643b053bd2736be1c8d25e27e032090006fd02ab9df1b015807af5", + "mean": -0.015433416701853275, + "std": 7.369464874267578, + "rms": 7.369481086730957, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1f0ae6ae59766c01f2338744bb4eb9745294f02ccaa4750413123b542c47f5f0", + "mean": -0.01674060709774494, + "std": 0.998887300491333, + "rms": 0.9990276098251343, + "max_abs": 25.875 + }, + "full_input": { + "shape": [ + 77, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bcc26188cc75c1a0f3239844a4c982b95459f419f3c0e60f6aa141b317993fb7", + "mean": -0.015273657627403736, + "std": 8.101369857788086, + "rms": 8.101384162902832, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7ba255f14e878fd194acd3e73016f729cd8b6a4833ae64a8b1eb2dcec84372bb", + "mean": -0.016750279814004898, + "std": 0.9950149655342102, + "rms": 0.9951559901237488, + "max_abs": 25.875 + }, + "full_input": { + "shape": [ + 93, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c83389bc781f6c947173b39554c40cadbb3a32fc1455ac3f8d26597845004ed2", + "mean": -0.015150710009038448, + "std": 7.369384288787842, + "rms": 7.3694000244140625, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9959046244621277, + "min_cosine_similarity": 0.9891141653060913, + "mean_relative_l2": 0.08692217618227005, + "max_abs_delta": 1.5 + }, + "system_bos": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9933527708053589, + "min_cosine_similarity": 0.9825186133384705, + "mean_relative_l2": 0.11246322095394135, + "max_abs_delta": 1.5 + }, + "system_x": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9891055226325989, + "min_cosine_similarity": 0.9726704359054565, + "mean_relative_l2": 0.14259260892868042, + "max_abs_delta": 1.5 + }, + "system_period": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9885405898094177, + "min_cosine_similarity": 0.9668658375740051, + "mean_relative_l2": 0.14561966061592102, + "max_abs_delta": 1.625 + }, + "bos_at_s0": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9885346293449402, + "min_cosine_similarity": 0.9702885150909424, + "mean_relative_l2": 0.1470170021057129, + "max_abs_delta": 1.6875 + }, + "bos_at_s1": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9874061346054077, + "min_cosine_similarity": 0.9675483703613281, + "mean_relative_l2": 0.15582332015037537, + "max_abs_delta": 3.25 + }, + "x_at_s0": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9886474013328552, + "min_cosine_similarity": 0.9774110317230225, + "mean_relative_l2": 0.14881490170955658, + "max_abs_delta": 1.3125 + }, + "x_at_s1": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9836318492889404, + "min_cosine_similarity": 0.9589551687240601, + "mean_relative_l2": 0.1764133870601654, + "max_abs_delta": 2.0 + }, + "period_at_s0": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9882947206497192, + "min_cosine_similarity": 0.9586434364318848, + "mean_relative_l2": 0.15014545619487762, + "max_abs_delta": 1.8125 + }, + "period_at_s1": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9837929010391235, + "min_cosine_similarity": 0.9556280970573425, + "mean_relative_l2": 0.17505529522895813, + "max_abs_delta": 2.25 + } + } + }, + "layer_17": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0b797853c75dc0c4dd3274915a6cceddd20258b3381a4c5d71069869feed8280", + "mean": -0.01881793513894081, + "std": 1.129936933517456, + "rms": 1.1300935745239258, + "max_abs": 28.875 + }, + "full_input": { + "shape": [ + 77, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f59c80882d2bb2e5a7d4a8c1149dd4757a3099007cebe65e589458d41ea4ac23", + "mean": -0.032653819769620895, + "std": 9.246980667114258, + "rms": 9.247038841247559, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7a0157efc84f8ff9a49216b4dc6281d9600b8c36c9a0d4686055c42ee2d524c6", + "mean": -0.019025366753339767, + "std": 1.1273735761642456, + "rms": 1.127534031867981, + "max_abs": 29.125 + }, + "full_input": { + "shape": [ + 93, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9c565a82d657f594db1171d1ac6f60b002ccaded380baf9f9ea7c1a6fc0dafbb", + "mean": -0.032680317759513855, + "std": 8.672554969787598, + "rms": 8.672616958618164, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "328e1d3547a16cbad89fc7da3bd08f71518a42885d3e633b2b4a99455a110050", + "mean": -0.01962433010339737, + "std": 1.1346423625946045, + "rms": 1.1348121166229248, + "max_abs": 28.875 + }, + "full_input": { + "shape": [ + 77, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f6d3871f6520169077e99e0ba7797b108d142953c144b0605fdaa0c5f4a09a91", + "mean": -0.018194876611232758, + "std": 8.119916915893555, + "rms": 8.119937896728516, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d6c2e2fb9ce11403485ddde5e8ccc45fdf89e70bcc7193a463bf682bd1f57e15", + "mean": -0.019559981301426888, + "std": 1.1366180181503296, + "rms": 1.1367863416671753, + "max_abs": 28.75 + }, + "full_input": { + "shape": [ + 93, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7b15380f170421df82f26be5951d9c276f80a65b48c6ca15f8ad1a980d4ac352", + "mean": -0.018700873479247093, + "std": 7.389683246612549, + "rms": 7.389707088470459, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "46be57cc9c2e94c0028c8c7b57192e615ce2bc8f2e0a3fa5d9d06d030ea1c819", + "mean": -0.02011626586318016, + "std": 1.1355723142623901, + "rms": 1.1357505321502686, + "max_abs": 28.75 + }, + "full_input": { + "shape": [ + 77, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5b02b1bdb26cbcc35d5f3145dc381304b1d8444d06ef0f0b75cc21c09878d268", + "mean": -0.018738504499197006, + "std": 8.12041187286377, + "rms": 8.120433807373047, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "31856bc7ab46f035ec80af944ee320893918aadea13b76d3502c1a7ce193f942", + "mean": -0.019973773509263992, + "std": 1.1293983459472656, + "rms": 1.1295748949050903, + "max_abs": 28.75 + }, + "full_input": { + "shape": [ + 93, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "09b56d1bc0b8bc4527d64c736ded3f97426b39a3fe63f89ec19685a663b468eb", + "mean": -0.019186094403266907, + "std": 7.389187335968018, + "rms": 7.389212608337402, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ba0e7d26ac17878562ed76279312c20c8f376535e16562650bc6cf3cc9e320b9", + "mean": -0.019772466272115707, + "std": 1.1353100538253784, + "rms": 1.1354821920394897, + "max_abs": 28.75 + }, + "full_input": { + "shape": [ + 77, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c2c13faf0ae80dc383e852938db84b9d006d3f55a8d1c351708fe45b1b7a8e5b", + "mean": -0.01803544908761978, + "std": 8.120079040527344, + "rms": 8.120099067687988, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "08f489668e7afafc4111f6c83d709ffaece60fed87bd0a6df5dc06facb91a363", + "mean": -0.019939478486776352, + "std": 1.1293082237243652, + "rms": 1.1294841766357422, + "max_abs": 28.625 + }, + "full_input": { + "shape": [ + 93, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "70e0b96faae86f8e2d56c2f429bcc13d7b6fc27965f5b39b45e6db5ca29b8189", + "mean": -0.018659688532352448, + "std": 7.389103889465332, + "rms": 7.3891282081604, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9961594939231873, + "min_cosine_similarity": 0.9881056547164917, + "mean_relative_l2": 0.08389198780059814, + "max_abs_delta": 1.5 + }, + "system_bos": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9935404062271118, + "min_cosine_similarity": 0.9831770658493042, + "mean_relative_l2": 0.11062129586935043, + "max_abs_delta": 1.5 + }, + "system_x": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9896153807640076, + "min_cosine_similarity": 0.974002480506897, + "mean_relative_l2": 0.13963887095451355, + "max_abs_delta": 1.625 + }, + "system_period": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9885987639427185, + "min_cosine_similarity": 0.9672484993934631, + "mean_relative_l2": 0.1442529857158661, + "max_abs_delta": 2.0 + }, + "bos_at_s0": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9893357753753662, + "min_cosine_similarity": 0.9710208177566528, + "mean_relative_l2": 0.14176735281944275, + "max_abs_delta": 1.8125 + }, + "bos_at_s1": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9880403280258179, + "min_cosine_similarity": 0.9718685746192932, + "mean_relative_l2": 0.151767760515213, + "max_abs_delta": 3.0 + }, + "x_at_s0": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9896554350852966, + "min_cosine_similarity": 0.9760643839836121, + "mean_relative_l2": 0.1420230269432068, + "max_abs_delta": 1.375 + }, + "x_at_s1": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9846640229225159, + "min_cosine_similarity": 0.9595159292221069, + "mean_relative_l2": 0.17103272676467896, + "max_abs_delta": 2.375 + }, + "period_at_s0": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9889237284660339, + "min_cosine_similarity": 0.9483417272567749, + "mean_relative_l2": 0.14529553055763245, + "max_abs_delta": 1.9375 + }, + "period_at_s1": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9846827387809753, + "min_cosine_similarity": 0.9530849456787109, + "mean_relative_l2": 0.17036493122577667, + "max_abs_delta": 2.0 + } + } + }, + "layer_18": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "871f168478be35ebc86c5a8f27c7bf1d495f81640399ceef9aeb833673095283", + "mean": -0.019917596131563187, + "std": 1.239103078842163, + "rms": 1.2392630577087402, + "max_abs": 31.375 + }, + "full_input": { + "shape": [ + 77, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b0d98431ad21ac6c9d7f71660eb6a36a081b479a4f1b034e08ada753642afbd9", + "mean": -0.03330514207482338, + "std": 9.267083168029785, + "rms": 9.267143249511719, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "269d52eefcef4d97df9e290f905a0a66c1f6e145877e48ccc3bd5a3c74b0860f", + "mean": -0.020281247794628143, + "std": 1.235527753829956, + "rms": 1.235694169998169, + "max_abs": 31.5 + }, + "full_input": { + "shape": [ + 93, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4fcd4f1514f2be2f5e0afa5c63a78739949a3ff8bf438c2bf56900cecd12bbe7", + "mean": -0.03300907462835312, + "std": 8.693039894104004, + "rms": 8.693102836608887, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "226f189c51caac1ea955b10becd9a94096fcd76f85bf739415a9120099c30f64", + "mean": -0.020956506952643394, + "std": 1.2451800107955933, + "rms": 1.2453563213348389, + "max_abs": 31.375 + }, + "full_input": { + "shape": [ + 77, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "427045781e544f1838ca6fd6d37fc4db6edf323762f421b6b7359ae0a465534d", + "mean": -0.01892814040184021, + "std": 8.13981819152832, + "rms": 8.139840126037598, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "99ea27433269437fdf888fcbf0b6193ae9598517736e9402ae0fd4d2f9eeabf3", + "mean": -0.02101501077413559, + "std": 1.2453322410583496, + "rms": 1.2455095052719116, + "max_abs": 31.5 + }, + "full_input": { + "shape": [ + 93, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5dcf74fe3af95a9e16f9401d5c7492fc4317a88039fdbc6cd3c3f268a0259655", + "mean": -0.01909821853041649, + "std": 7.4109086990356445, + "rms": 7.410933971405029, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5da920dde39ef6bfa662f5d2d28eeafa3b0f6dee119ef36adb858bb327c90082", + "mean": -0.020968982949852943, + "std": 1.2454181909561157, + "rms": 1.2455947399139404, + "max_abs": 31.25 + }, + "full_input": { + "shape": [ + 77, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8a09d63143cbb59ab87f8bf3d26158e0769bb53a6bdcc1ed28f83cf90df0f26c", + "mean": -0.019139964133501053, + "std": 8.14026165008545, + "rms": 8.140283584594727, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "53cd44e42f5535a7c26df35ad189d381e3211ce172f18d56651a9ba2f8673379", + "mean": -0.021415727213025093, + "std": 1.2350754737854004, + "rms": 1.235261082649231, + "max_abs": 31.25 + }, + "full_input": { + "shape": [ + 93, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0468520d78062eb38b9c558b50de65ad952aea2a384282a004cffb2b9d34ce78", + "mean": -0.01949474588036537, + "std": 7.410195350646973, + "rms": 7.410220623016357, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "65a4813fea4e2b208888d7db2223ec2a38f812b6cc4009c96083887a55a917e9", + "mean": -0.020680926740169525, + "std": 1.244518756866455, + "rms": 1.2446905374526978, + "max_abs": 31.125 + }, + "full_input": { + "shape": [ + 77, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fbb689ecb64d353d239a5199dd945b32c9bc66898f3fd06bd8904c31534fe4dc", + "mean": -0.018455756828188896, + "std": 8.13991928100586, + "rms": 8.13994026184082, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f53f37bb009db155f9735803067ae82f12a74969128860619957b05a030dc45e", + "mean": -0.02138284035027027, + "std": 1.23408842086792, + "rms": 1.2342737913131714, + "max_abs": 31.25 + }, + "full_input": { + "shape": [ + 93, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2f89f6b715043c77537805b2c1ffdbba4b2a05c3d57f193df665d858ef920ad6", + "mean": -0.019048815593123436, + "std": 7.409934997558594, + "rms": 7.40995979309082, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9961437582969666, + "min_cosine_similarity": 0.9874793291091919, + "mean_relative_l2": 0.08421030640602112, + "max_abs_delta": 2.125 + }, + "system_bos": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9934570789337158, + "min_cosine_similarity": 0.9788340330123901, + "mean_relative_l2": 0.11107825487852097, + "max_abs_delta": 2.375 + }, + "system_x": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.989522397518158, + "min_cosine_similarity": 0.9707027673721313, + "mean_relative_l2": 0.14004658162593842, + "max_abs_delta": 2.125 + }, + "system_period": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9882215857505798, + "min_cosine_similarity": 0.9645122289657593, + "mean_relative_l2": 0.14654824137687683, + "max_abs_delta": 2.75 + }, + "bos_at_s0": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9897903203964233, + "min_cosine_similarity": 0.9684458374977112, + "mean_relative_l2": 0.13920246064662933, + "max_abs_delta": 2.0 + }, + "bos_at_s1": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9880588054656982, + "min_cosine_similarity": 0.9739153385162354, + "mean_relative_l2": 0.15191586315631866, + "max_abs_delta": 3.625 + }, + "x_at_s0": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9901027679443359, + "min_cosine_similarity": 0.9753875732421875, + "mean_relative_l2": 0.13855062425136566, + "max_abs_delta": 1.625 + }, + "x_at_s1": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9848269820213318, + "min_cosine_similarity": 0.9678000211715698, + "mean_relative_l2": 0.1702006757259369, + "max_abs_delta": 3.5 + }, + "period_at_s0": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9892479777336121, + "min_cosine_similarity": 0.9464123249053955, + "mean_relative_l2": 0.14259588718414307, + "max_abs_delta": 2.25 + }, + "period_at_s1": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9847270250320435, + "min_cosine_similarity": 0.9618983268737793, + "mean_relative_l2": 0.17018279433250427, + "max_abs_delta": 3.5 + } + } + }, + "layer_19": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ef017a4cd954b429063c3b440d2154804ba6d7c62b7fdffbb7d0795bf68ae962", + "mean": -0.026295503601431847, + "std": 1.3509372472763062, + "rms": 1.3511931896209717, + "max_abs": 32.0 + }, + "full_input": { + "shape": [ + 77, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "af9af6865d5d4c8922ac0c2a1d7e60412bbd75681aa647a130e3936e64f48e11", + "mean": -0.03707676753401756, + "std": 9.27816104888916, + "rms": 9.27823543548584, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "00afb2028bdaad19a436059435e74c025103983c3d4459fde686aac7093578b8", + "mean": -0.026317328214645386, + "std": 1.3474599123001099, + "rms": 1.3477169275283813, + "max_abs": 32.25 + }, + "full_input": { + "shape": [ + 93, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a006c296a61cc62570272630c803bcf11d7666a1408a2e1376f1718466e8d4b5", + "mean": -0.03522409126162529, + "std": 8.705561637878418, + "rms": 8.705632209777832, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9737982557932bba46247f7636b57b2b54d5b9f8c92a4bc132a56629b53c32aa", + "mean": -0.02792971022427082, + "std": 1.3569077253341675, + "rms": 1.3571951389312744, + "max_abs": 32.25 + }, + "full_input": { + "shape": [ + 77, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a13bee7cf4d19d8208037d355bf4b7aeb0011bbadbf2335102fe5bad24578d87", + "mean": -0.0233319029211998, + "std": 8.152913093566895, + "rms": 8.152946472167969, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b173a5b57b0f11863debbd4846b53faa22a64d05014506cb037a436322cba7b3", + "mean": -0.027657832950353622, + "std": 1.3585741519927979, + "rms": 1.3588556051254272, + "max_abs": 32.25 + }, + "full_input": { + "shape": [ + 93, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7aee1b4dcfb3e00c270dcd523b974e22f7086b6173fe23eb8c25af68158a4e32", + "mean": -0.02178148552775383, + "std": 7.425872325897217, + "rms": 7.425903797149658, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3e267110de68bb1752c91c3aeb914fb6b11e7b7a6d854a8a22f9ab47eb24e7e3", + "mean": -0.0278399009257555, + "std": 1.3556534051895142, + "rms": 1.3559391498565674, + "max_abs": 32.0 + }, + "full_input": { + "shape": [ + 77, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4510cd9a083a511f43a99bdc4911ff3ac1b7b8c1babfb808647abbdba8c6da53", + "mean": -0.023473013192415237, + "std": 8.153393745422363, + "rms": 8.153428077697754, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "64516bd2362428c6eca91a607535fd3fe94aa67684ba349cc459dee2958a49ab", + "mean": -0.027723591774702072, + "std": 1.3450123071670532, + "rms": 1.3452980518341064, + "max_abs": 32.5 + }, + "full_input": { + "shape": [ + 93, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a35d8b1420c05585a200ed07f47f037f14a920612eae5061eb08d3369d5be76f", + "mean": -0.02185272052884102, + "std": 7.424720287322998, + "rms": 7.4247517585754395, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a8d71d5fd1703bedffd37f6c1810aca05e1d8e32929be9558a9316c9c6df24ee", + "mean": -0.027412790805101395, + "std": 1.3568079471588135, + "rms": 1.35708487033844, + "max_abs": 32.0 + }, + "full_input": { + "shape": [ + 77, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d12cb311d9513c5f5ce5474d59837acbff14427eabdf90baa99cfe4a273e75aa", + "mean": -0.022843722254037857, + "std": 8.15313720703125, + "rms": 8.153168678283691, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "45fa13d74246532afb0dd0de93fdfc51b7464d047b5a25db0725125228ee875b", + "mean": -0.027132997289299965, + "std": 1.3424365520477295, + "rms": 1.3427106142044067, + "max_abs": 32.0 + }, + "full_input": { + "shape": [ + 93, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "473a6599f5a91245426bf54ad3ed0dc59ef6bca1becfb566dade50612e107baa", + "mean": -0.021325815469026566, + "std": 7.424324035644531, + "rms": 7.424354076385498, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9960275888442993, + "min_cosine_similarity": 0.9876827001571655, + "mean_relative_l2": 0.0855899304151535, + "max_abs_delta": 1.625 + }, + "system_bos": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9930903911590576, + "min_cosine_similarity": 0.9761255979537964, + "mean_relative_l2": 0.11379717290401459, + "max_abs_delta": 2.25 + }, + "system_x": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9889277219772339, + "min_cosine_similarity": 0.9677091240882874, + "mean_relative_l2": 0.14360776543617249, + "max_abs_delta": 2.224609375 + }, + "system_period": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9872493147850037, + "min_cosine_similarity": 0.958000659942627, + "mean_relative_l2": 0.15178124606609344, + "max_abs_delta": 2.859375 + }, + "bos_at_s0": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9892457127571106, + "min_cosine_similarity": 0.9624356627464294, + "mean_relative_l2": 0.1429234892129898, + "max_abs_delta": 2.375 + }, + "bos_at_s1": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9873891472816467, + "min_cosine_similarity": 0.9683781862258911, + "mean_relative_l2": 0.15594980120658875, + "max_abs_delta": 3.625 + }, + "x_at_s0": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9895868301391602, + "min_cosine_similarity": 0.9704786539077759, + "mean_relative_l2": 0.1419745832681656, + "max_abs_delta": 1.875 + }, + "x_at_s1": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9840023517608643, + "min_cosine_similarity": 0.9559767246246338, + "mean_relative_l2": 0.17435550689697266, + "max_abs_delta": 3.625 + }, + "period_at_s0": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9885984659194946, + "min_cosine_similarity": 0.9370836615562439, + "mean_relative_l2": 0.14623211324214935, + "max_abs_delta": 3.0 + }, + "period_at_s1": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.983812689781189, + "min_cosine_similarity": 0.9428495168685913, + "mean_relative_l2": 0.17458292841911316, + "max_abs_delta": 3.5 + } + } + }, + "layer_20": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "57fea8ffe8d5540569cfd536e3c1f53da5c8a6b053ea4238257fa279917d7bd9", + "mean": -0.027922477573156357, + "std": 1.5279734134674072, + "rms": 1.5282284021377563, + "max_abs": 39.5 + }, + "full_input": { + "shape": [ + 77, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "255c12c8a43e3bb47f8d93bf30d0e0afcde8790c679eebfdd3d984a2028e7924", + "mean": -0.038197483867406845, + "std": 9.57779312133789, + "rms": 9.577869415283203, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8aaef20596000b9ed81246759160e34f869fcf46a1e73bf107734bdf00d1cd7d", + "mean": -0.027889978140592575, + "std": 1.5250462293624878, + "rms": 1.5253013372421265, + "max_abs": 39.5 + }, + "full_input": { + "shape": [ + 93, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "abd9042e05f8dfeff920817df74cda34ce21ac423ac04c9e98ceca6ea0f4e2da", + "mean": -0.03612769767642021, + "std": 9.001058578491211, + "rms": 9.001131057739258, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "78071512effb63754c30c3293b6b43d71c07c2488cb2a8c1c76c139dfba59118", + "mean": -0.029611028730869293, + "std": 1.5344176292419434, + "rms": 1.534703254699707, + "max_abs": 39.5 + }, + "full_input": { + "shape": [ + 77, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "135d4bb5b1e8b06527684096e28a7a5d8b3014d4565b652cbc9cff9a6ece2040", + "mean": -0.02535794861614704, + "std": 8.181675910949707, + "rms": 8.18171501159668, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3b272965d8d2e6d3261e56798b7861f261dc57b0d90ffea382c34614e50d5f02", + "mean": -0.028751272708177567, + "std": 1.5342236757278442, + "rms": 1.5344929695129395, + "max_abs": 39.0 + }, + "full_input": { + "shape": [ + 93, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "acbbffa985ae4167a22290e136874b81d0541916793d2fd968065a50ca6da0c0", + "mean": -0.02302548475563526, + "std": 7.456786155700684, + "rms": 7.456820964813232, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a4838f658a2cdc959f3c5f073d031bce2e87ad1fab8ec76525cdcc7d32adbb3e", + "mean": -0.028960077092051506, + "std": 1.530727744102478, + "rms": 1.5310016870498657, + "max_abs": 39.5 + }, + "full_input": { + "shape": [ + 77, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "22a7541f32fee41ae921546344925830d32f647d5edfc75bb601d937af076412", + "mean": -0.02516181208193302, + "std": 8.18200397491455, + "rms": 8.182043075561523, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cb126d1d9fb027f135fc26151dad3578587a561a20d51014982d2753251c3873", + "mean": -0.02828061953186989, + "std": 1.520539402961731, + "rms": 1.52080237865448, + "max_abs": 39.0 + }, + "full_input": { + "shape": [ + 93, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "60ec8461e83902483183a91c07191c3a7cfc27f7deb7cc967e19744c01b8f698", + "mean": -0.02288578450679779, + "std": 7.455725193023682, + "rms": 7.455759525299072, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "31d5d22269fabf1c29b924a2ca26e414d6930694d777ec1217a8da9409287b51", + "mean": -0.028605695813894272, + "std": 1.5332903861999512, + "rms": 1.5335572957992554, + "max_abs": 39.5 + }, + "full_input": { + "shape": [ + 77, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "561bce7185b286b5869d22c1ba4bfdce6debbd30d575443e32885f67f8e309ca", + "mean": -0.024432159960269928, + "std": 8.18188190460205, + "rms": 8.18191909790039, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a8c303a7d7ba445e2446614934f1e9e9eb6c8b84ccd4b7c852f8e054e8c11767", + "mean": -0.028475698083639145, + "std": 1.5170750617980957, + "rms": 1.5173423290252686, + "max_abs": 38.5 + }, + "full_input": { + "shape": [ + 93, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f06dc4e12858bd6a548bd3294b898ea1d2e448d9a327bb74d41b6d77c960ac1a", + "mean": -0.022759724408388138, + "std": 7.455040454864502, + "rms": 7.455074787139893, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9959917068481445, + "min_cosine_similarity": 0.9877578616142273, + "mean_relative_l2": 0.08641331642866135, + "max_abs_delta": 2.5 + }, + "system_bos": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9930702447891235, + "min_cosine_similarity": 0.976447343826294, + "mean_relative_l2": 0.11396297812461853, + "max_abs_delta": 2.875 + }, + "system_x": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9884678721427917, + "min_cosine_similarity": 0.9673794507980347, + "mean_relative_l2": 0.14680643379688263, + "max_abs_delta": 3.125 + }, + "system_period": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9861835837364197, + "min_cosine_similarity": 0.954549252986908, + "mean_relative_l2": 0.1581786423921585, + "max_abs_delta": 4.125 + }, + "bos_at_s0": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9895007610321045, + "min_cosine_similarity": 0.9614741802215576, + "mean_relative_l2": 0.141324982047081, + "max_abs_delta": 2.75 + }, + "bos_at_s1": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9874556064605713, + "min_cosine_similarity": 0.9727705717086792, + "mean_relative_l2": 0.15529677271842957, + "max_abs_delta": 4.0 + }, + "x_at_s0": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9897087812423706, + "min_cosine_similarity": 0.9703395962715149, + "mean_relative_l2": 0.1412402093410492, + "max_abs_delta": 2.125 + }, + "x_at_s1": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9838499426841736, + "min_cosine_similarity": 0.9640821218490601, + "mean_relative_l2": 0.17564009130001068, + "max_abs_delta": 4.875 + }, + "period_at_s0": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9887279272079468, + "min_cosine_similarity": 0.9360345602035522, + "mean_relative_l2": 0.14531084895133972, + "max_abs_delta": 3.65625 + }, + "period_at_s1": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9832428693771362, + "min_cosine_similarity": 0.9515091180801392, + "mean_relative_l2": 0.17826098203659058, + "max_abs_delta": 3.75 + } + } + }, + "layer_21": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c44bc0767e00a46aa9d514f70d78099c4c753b708df5633aea28b971e7efe8b8", + "mean": -0.026521263644099236, + "std": 1.6613138914108276, + "rms": 1.6615254878997803, + "max_abs": 47.75 + }, + "full_input": { + "shape": [ + 77, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "15a27845e4f8397afc0ac0ca18194219bc3443093506400c08ae5b79eb76ebaf", + "mean": -0.03628568723797798, + "std": 9.685840606689453, + "rms": 9.685908317565918, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "270463d4f2119dfe9263d21eabf8de4d09aa12797d2d3aa475e2e30aa6db78cc", + "mean": -0.026599181815981865, + "std": 1.658289909362793, + "rms": 1.6585032939910889, + "max_abs": 48.25 + }, + "full_input": { + "shape": [ + 93, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a88220c44b0e946bbc4d49946c76035e51efbd8169ed938623f05211f5dfbc14", + "mean": -0.03415345028042793, + "std": 9.099078178405762, + "rms": 9.099142074584961, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c6f21b6fa61b046058169ed9c282f893dc0f01d4c7b6bc4a1e0c6c433f686c27", + "mean": -0.028560923412442207, + "std": 1.6716772317886353, + "rms": 1.6719212532043457, + "max_abs": 48.5 + }, + "full_input": { + "shape": [ + 77, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "989fc0476a383be2b651a786908317324aa5add610502e15dc6ce6c0cc79c0d6", + "mean": -0.023473434150218964, + "std": 8.185824394226074, + "rms": 8.185857772827148, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "55c5a653d30a916743bf9e94d401b86c362896e5f1b37c54ae4ef7292cf14c90", + "mean": -0.027420012280344963, + "std": 1.6694773435592651, + "rms": 1.6697025299072266, + "max_abs": 48.25 + }, + "full_input": { + "shape": [ + 93, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "98f6d87271f6ce7fc93409f39d02b95aff9de691834628f32e2cb89835636924", + "mean": -0.020877070724964142, + "std": 7.467485427856445, + "rms": 7.4675140380859375, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "061abff401f6035cd745aa81321c465b4c7e7155be043f4a720e68fbc84b869a", + "mean": -0.028061242774128914, + "std": 1.6648502349853516, + "rms": 1.6650867462158203, + "max_abs": 49.0 + }, + "full_input": { + "shape": [ + 77, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "91a12c50206f351b798623e30ac997f3bb8f2b36ee48fe0d7d36d141cd84ef35", + "mean": -0.023435581475496292, + "std": 8.18617057800293, + "rms": 8.18620491027832, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "33a93dc60289a2e4b9e59ad0abab652827f6f49d00106b7e85d91b3946758534", + "mean": -0.027383187785744667, + "std": 1.6600366830825806, + "rms": 1.6602624654769897, + "max_abs": 48.5 + }, + "full_input": { + "shape": [ + 93, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3a326e0dd155dbab842521a6528d02da7fbfb1836e0e1e759f7ddf22b2feb472", + "mean": -0.021448427811264992, + "std": 7.467682838439941, + "rms": 7.467713356018066, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1057d428ebe0168d22d5e44dfd36dbd6068063425968cfa0556d3d006c7a127b", + "mean": -0.027489377185702324, + "std": 1.672624111175537, + "rms": 1.6728500127792358, + "max_abs": 49.0 + }, + "full_input": { + "shape": [ + 77, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fe53ec1f20be140fb8817a80af5c32e12a7e12efa21eea911560e5a235dc34eb", + "mean": -0.02264620177447796, + "std": 8.186327934265137, + "rms": 8.186359405517578, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1db1568bc4bd79bc4025d83aa756609943f1dfc13c332b6d4ffe2ce7f36560c8", + "mean": -0.027619821950793266, + "std": 1.6533857583999634, + "rms": 1.6536164283752441, + "max_abs": 48.0 + }, + "full_input": { + "shape": [ + 93, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8f20c0b7c8b983597304bc7e0d4c5c04d8c4ede05bccb7f125dda9729f40dda2", + "mean": -0.02123517543077469, + "std": 7.465893268585205, + "rms": 7.465923309326172, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9956222176551819, + "min_cosine_similarity": 0.9855464696884155, + "mean_relative_l2": 0.09031395614147186, + "max_abs_delta": 2.15625 + }, + "system_bos": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9924907088279724, + "min_cosine_similarity": 0.9737374782562256, + "mean_relative_l2": 0.11840339004993439, + "max_abs_delta": 3.0 + }, + "system_x": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9870494604110718, + "min_cosine_similarity": 0.966543972492218, + "mean_relative_l2": 0.15552759170532227, + "max_abs_delta": 3.0 + }, + "system_period": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9843625426292419, + "min_cosine_similarity": 0.9440603852272034, + "mean_relative_l2": 0.1670287549495697, + "max_abs_delta": 4.75 + }, + "bos_at_s0": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9886730909347534, + "min_cosine_similarity": 0.9525719881057739, + "mean_relative_l2": 0.14688357710838318, + "max_abs_delta": 3.31640625 + }, + "bos_at_s1": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9865474104881287, + "min_cosine_similarity": 0.9679610729217529, + "mean_relative_l2": 0.16106602549552917, + "max_abs_delta": 4.375 + }, + "x_at_s0": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9889370799064636, + "min_cosine_similarity": 0.968500018119812, + "mean_relative_l2": 0.14677593111991882, + "max_abs_delta": 3.0 + }, + "x_at_s1": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9823346734046936, + "min_cosine_similarity": 0.9636541604995728, + "mean_relative_l2": 0.18440872430801392, + "max_abs_delta": 4.875 + }, + "period_at_s0": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9875619411468506, + "min_cosine_similarity": 0.9191086292266846, + "mean_relative_l2": 0.15250562131404877, + "max_abs_delta": 3.96875 + }, + "period_at_s1": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9817454814910889, + "min_cosine_similarity": 0.9529322981834412, + "mean_relative_l2": 0.1863357126712799, + "max_abs_delta": 3.875 + } + } + }, + "layer_22": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5ffc905a2134740b36d6be2b82d70a900c0ff6e59ea12d32f276b032c0855afb", + "mean": -0.027954641729593277, + "std": 1.9143178462982178, + "rms": 1.9145219326019287, + "max_abs": 62.5 + }, + "full_input": { + "shape": [ + 77, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "60fcc23792683fe6a7e70df740d208fa2d426f70ba683bb989d0be2b99912990", + "mean": -0.03765226528048515, + "std": 9.724246978759766, + "rms": 9.724320411682129, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "841719287a85ae0e51cda6b0aea160e43f22340772c0d9dacac2f193c39a5b4b", + "mean": -0.027054177597165108, + "std": 1.9132312536239624, + "rms": 1.9134225845336914, + "max_abs": 63.25 + }, + "full_input": { + "shape": [ + 93, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "56959b2febd33ad3481204adb389c8e2bc395637e6a93d35df46a54caa7196c3", + "mean": -0.03523627296090126, + "std": 9.143095970153809, + "rms": 9.143163681030273, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "40739597c803be9b8e51c49c5e754fca634b7886eb47f3dfcf94946f76edec35", + "mean": -0.030348699539899826, + "std": 1.923965573310852, + "rms": 1.92420494556427, + "max_abs": 63.75 + }, + "full_input": { + "shape": [ + 77, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d39367a1efb4437c8ae918ceab6483e4fd0148fa417986694c9e003cdc74599f", + "mean": -0.025280307978391647, + "std": 8.231929779052734, + "rms": 8.231968879699707, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "207faf28521a6a6c381d57e8b57a8674e11f6f81a1ba6c45a2f438d28980eeda", + "mean": -0.027890773490071297, + "std": 1.9185360670089722, + "rms": 1.918738842010498, + "max_abs": 63.0 + }, + "full_input": { + "shape": [ + 93, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6c13e2966b2ca6df33af035a60755860dc708ceb1d52d62b8807a6533d2e814a", + "mean": -0.02204333245754242, + "std": 7.521065711975098, + "rms": 7.5210981369018555, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b0a732751002401b509c7715ff44e958307420736ffda3033346d7c4548fd31e", + "mean": -0.030107388272881508, + "std": 1.9148951768875122, + "rms": 1.9151318073272705, + "max_abs": 64.5 + }, + "full_input": { + "shape": [ + 77, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "40d18fc8b985015971755e2e180be5ebb073d95831281423032451c2268b1440", + "mean": -0.025320496410131454, + "std": 8.23220443725586, + "rms": 8.232243537902832, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "086cfcbdf4aab3fc669f9863e51fbfc1cc389100f582d4a745b83b342b0b18ef", + "mean": -0.027971971780061722, + "std": 1.9106576442718506, + "rms": 1.9108624458312988, + "max_abs": 63.75 + }, + "full_input": { + "shape": [ + 93, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c093ae12bb387b4a2d0297b41ca23383b800a01c23772c8ae23077987b6ff766", + "mean": -0.022498246282339096, + "std": 7.521930694580078, + "rms": 7.521964073181152, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "13170115e6bf8f8e71151b01fa1984bbbddef40446c24faa348b69f29ea5f485", + "mean": -0.028572725132107735, + "std": 1.923529863357544, + "rms": 1.9237419366836548, + "max_abs": 64.5 + }, + "full_input": { + "shape": [ + 77, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d0a834836326230432184cc8969df8dc5ebe5968f5ee54fe302cc30de1667226", + "mean": -0.023995179682970047, + "std": 8.23245620727539, + "rms": 8.232491493225098, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "246d90398f2ef0ef7e3ecc6a581c448de22ed6ff82de92b1eb9ac2229b7678a7", + "mean": -0.028940627351403236, + "std": 1.9017030000686646, + "rms": 1.9019231796264648, + "max_abs": 63.0 + }, + "full_input": { + "shape": [ + 93, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0b54267e9a4964d9f2712c9c40e6128d226785c51b9bbd9308ddb4857dcd6d2a", + "mean": -0.022568339481949806, + "std": 7.5194597244262695, + "rms": 7.519493579864502, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9955254197120667, + "min_cosine_similarity": 0.9861201643943787, + "mean_relative_l2": 0.0916331559419632, + "max_abs_delta": 2.0 + }, + "system_bos": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.991855263710022, + "min_cosine_similarity": 0.9714124798774719, + "mean_relative_l2": 0.12228932976722717, + "max_abs_delta": 3.7421875 + }, + "system_x": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.986500084400177, + "min_cosine_similarity": 0.9623821973800659, + "mean_relative_l2": 0.15819361805915833, + "max_abs_delta": 3.625 + }, + "system_period": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9835919737815857, + "min_cosine_similarity": 0.9352210164070129, + "mean_relative_l2": 0.17004813253879547, + "max_abs_delta": 4.75 + }, + "bos_at_s0": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9883860349655151, + "min_cosine_similarity": 0.9493303298950195, + "mean_relative_l2": 0.14807891845703125, + "max_abs_delta": 5.0859375 + }, + "bos_at_s1": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9860613942146301, + "min_cosine_similarity": 0.968355119228363, + "mean_relative_l2": 0.16315141320228577, + "max_abs_delta": 5.5 + }, + "x_at_s0": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9887381196022034, + "min_cosine_similarity": 0.9707466959953308, + "mean_relative_l2": 0.14758364856243134, + "max_abs_delta": 3.5 + }, + "x_at_s1": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9819338321685791, + "min_cosine_similarity": 0.9546499252319336, + "mean_relative_l2": 0.18573257327079773, + "max_abs_delta": 5.75 + }, + "period_at_s0": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9872159957885742, + "min_cosine_similarity": 0.9157781600952148, + "mean_relative_l2": 0.15368139743804932, + "max_abs_delta": 5.30859375 + }, + "period_at_s1": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9812361001968384, + "min_cosine_similarity": 0.9403541684150696, + "mean_relative_l2": 0.18832722306251526, + "max_abs_delta": 4.875 + } + } + }, + "layer_23": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6c47f04ee1b0ef4e44b34f76172c7a33ecdf0a966e46738ae1bd1424d8f783f1", + "mean": -0.0362248569726944, + "std": 2.2995893955230713, + "rms": 2.299874782562256, + "max_abs": 90.5 + }, + "full_input": { + "shape": [ + 77, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "94f771dd34660cd4085ffb917d05a5345d91a72eddc2486bc038e4184b98c4d1", + "mean": -0.042852580547332764, + "std": 9.757702827453613, + "rms": 9.757796287536621, + "max_abs": 1160.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7199d4339affa4ec1b62a994e4f2a9f5e18519f2534dbb02c0f478c86d52ffe2", + "mean": -0.034939639270305634, + "std": 2.2977569103240967, + "rms": 2.298022508621216, + "max_abs": 92.0 + }, + "full_input": { + "shape": [ + 93, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c525d62c8dc5cdd211455c2765fc7f57b3f9ed41abd3cc3d6e9aa9b0c6534d37", + "mean": -0.037992242723703384, + "std": 9.183812141418457, + "rms": 9.183890342712402, + "max_abs": 1160.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6b06145d367c2124c8ca8152aefca6fb5ce365e7c71e21fe4abc92e473710df2", + "mean": -0.03949993848800659, + "std": 2.3079984188079834, + "rms": 2.3083364963531494, + "max_abs": 89.5 + }, + "full_input": { + "shape": [ + 77, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bf174b21e21619e9fd948b6f33322963d8ba73f7a0841f1037675c5b5f14163c", + "mean": -0.03124030865728855, + "std": 8.283835411071777, + "rms": 8.283894538879395, + "max_abs": 1160.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ef7c9c728df1aa64e34740115fae51893cc33ea2784630f3313b7ddafbd726ea", + "mean": -0.036272402852773666, + "std": 2.2956619262695312, + "rms": 2.2959485054016113, + "max_abs": 92.0 + }, + "full_input": { + "shape": [ + 93, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4a9e86407286c6dfb92245d1894119f528a86b2ac5746f02f2d9eb6752268130", + "mean": -0.02522783912718296, + "std": 7.58667516708374, + "rms": 7.586717128753662, + "max_abs": 1160.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f46ced8380d805aa72245625b8606e643e0209d4b1bbbb042a3d4bd54a3054c6", + "mean": -0.03807637467980385, + "std": 2.298011541366577, + "rms": 2.2983267307281494, + "max_abs": 89.0 + }, + "full_input": { + "shape": [ + 77, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "38ed72d111420b61f4504904600f3681a818937fb8ec2463099658636f560608", + "mean": -0.0303428303450346, + "std": 8.285195350646973, + "rms": 8.28525161743164, + "max_abs": 1160.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "71a9f84adb0721765efe2d626b7467dfc94d078106091ce889a0ea7504f260a3", + "mean": -0.034435298293828964, + "std": 2.285982370376587, + "rms": 2.2862415313720703, + "max_abs": 91.0 + }, + "full_input": { + "shape": [ + 93, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c86da3153c32f9af08010ed7c148916e0fb6eaaf72db883736eb0ce4aad313e6", + "mean": -0.02514137327671051, + "std": 7.5893025398254395, + "rms": 7.589344024658203, + "max_abs": 1160.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8a12de5ccfbc90711381220ec42e5b6dc364eaf7a4e46ba5f93e381193705b3c", + "mean": -0.03600793331861496, + "std": 2.300760507583618, + "rms": 2.301042079925537, + "max_abs": 88.5 + }, + "full_input": { + "shape": [ + 77, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ed99de6e9f6fc79ca9b21b43b79db23e0bd2ee40a1e1f9ded723a6602979e1d7", + "mean": -0.02889886684715748, + "std": 8.283489227294922, + "rms": 8.283539772033691, + "max_abs": 1160.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "281e6f8c6b381a2a43c4db0a9b8de365d063bc3a39fdb936fd79ea5770780bae", + "mean": -0.0357634611427784, + "std": 2.279186487197876, + "rms": 2.2794668674468994, + "max_abs": 92.0 + }, + "full_input": { + "shape": [ + 93, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6b010a9c691ed931ff784e248c8c5114525714599e1eb8e8e77cdae22b18c0e3", + "mean": -0.025535577908158302, + "std": 7.586094856262207, + "rms": 7.586137771606445, + "max_abs": 1160.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9958285093307495, + "min_cosine_similarity": 0.987790048122406, + "mean_relative_l2": 0.08894172310829163, + "max_abs_delta": 3.0 + }, + "system_bos": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9922110438346863, + "min_cosine_similarity": 0.972870409488678, + "mean_relative_l2": 0.11945445835590363, + "max_abs_delta": 5.0625 + }, + "system_x": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9871466159820557, + "min_cosine_similarity": 0.9601122140884399, + "mean_relative_l2": 0.15366289019584656, + "max_abs_delta": 8.0 + }, + "system_period": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9847741723060608, + "min_cosine_similarity": 0.9348222613334656, + "mean_relative_l2": 0.16432520747184753, + "max_abs_delta": 7.0 + }, + "bos_at_s0": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9889744520187378, + "min_cosine_similarity": 0.952059268951416, + "mean_relative_l2": 0.1440218687057495, + "max_abs_delta": 6.4375 + }, + "bos_at_s1": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9867315292358398, + "min_cosine_similarity": 0.9582965970039368, + "mean_relative_l2": 0.1586388200521469, + "max_abs_delta": 7.25 + }, + "x_at_s0": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9895986318588257, + "min_cosine_similarity": 0.9722236394882202, + "mean_relative_l2": 0.1414431631565094, + "max_abs_delta": 4.0 + }, + "x_at_s1": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9828847050666809, + "min_cosine_similarity": 0.9379255175590515, + "mean_relative_l2": 0.17988167703151703, + "max_abs_delta": 8.5 + }, + "period_at_s0": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9879456758499146, + "min_cosine_similarity": 0.9187641143798828, + "mean_relative_l2": 0.14834338426589966, + "max_abs_delta": 8.0 + }, + "period_at_s1": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.982559323310852, + "min_cosine_similarity": 0.9440757036209106, + "mean_relative_l2": 0.18164154887199402, + "max_abs_delta": 7.0 + } + } + }, + "layer_24": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9ac09e6ceb330999e77a578b644657c9120a84d2161fa6cc2a788ceea849ea4d", + "mean": -0.05109279975295067, + "std": 2.740572690963745, + "rms": 2.741048812866211, + "max_abs": 109.5 + }, + "full_input": { + "shape": [ + 77, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c2efda2a024732497086cfcec85a5b7c9cd9abc029a74fcaf0effd03d8297bb4", + "mean": -0.054879479110240936, + "std": 9.238767623901367, + "rms": 9.238930702209473, + "max_abs": 1008.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c54f4610762c99614bde8a5f5fec3cde901afbc0247d1387926c60d0f3fb7310", + "mean": -0.0496632419526577, + "std": 2.7401297092437744, + "rms": 2.740579605102539, + "max_abs": 110.5 + }, + "full_input": { + "shape": [ + 93, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6d0fa1e85e2376558b8be3b95db8ccd4fdc7495f6c1e221ec6308a8f0efccbe1", + "mean": -0.0475386306643486, + "std": 8.980449676513672, + "rms": 8.980575561523438, + "max_abs": 1120.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "535267ccbd91b52b4cac67fe438af9a2eb384206b8a9845b56d04c662c5783a7", + "mean": -0.053998444229364395, + "std": 2.7437314987182617, + "rms": 2.7442626953125, + "max_abs": 110.5 + }, + "full_input": { + "shape": [ + 77, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "80a29cdfab969c18d478cb7e316398bb0f678496b9925b8b8d22248dad800172", + "mean": -0.041240815073251724, + "std": 6.000430107116699, + "rms": 6.0005717277526855, + "max_abs": 840.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "142e113483ec50023b8a8ceb9d217fd7339b39b9bcbdc53e8521093fc6a621dc", + "mean": -0.04986613988876343, + "std": 2.730440139770508, + "rms": 2.7308952808380127, + "max_abs": 110.0 + }, + "full_input": { + "shape": [ + 93, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "96b3de39fd14d4ea9048602d3dbcdc36f7fc704b4c8539e85e8bd963375107f5", + "mean": -0.03238143026828766, + "std": 5.581573963165283, + "rms": 5.581667900085449, + "max_abs": 840.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a990722bbcc9e0fd7c662ef650f6106817144b3957b1d0033644a5ed93c5d822", + "mean": -0.05286508426070213, + "std": 2.7376742362976074, + "rms": 2.7381844520568848, + "max_abs": 112.5 + }, + "full_input": { + "shape": [ + 77, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "594febe0518d91a429a1520e26e1578be22e2080b0b045c63a1a9e6305df5fff", + "mean": -0.040712133049964905, + "std": 6.004788875579834, + "rms": 6.004926681518555, + "max_abs": 840.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f0a9c95b46322dab85c8a10f8323cdc7e145031038f01eb8eef68ed662cc35d8", + "mean": -0.04645604267716408, + "std": 2.724302291870117, + "rms": 2.724698305130005, + "max_abs": 111.0 + }, + "full_input": { + "shape": [ + 93, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "979d433a31d735934bd6b9e1485f9a2f91da10b6fe8e215b309f0b0f546faa8d", + "mean": -0.03187067434191704, + "std": 5.588817596435547, + "rms": 5.5889081954956055, + "max_abs": 840.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "10670e0302ab07a9b8b2a73fc403f294438280af52257889bc0f674b5a064b49", + "mean": -0.05002517253160477, + "std": 2.739314317703247, + "rms": 2.7397711277008057, + "max_abs": 112.0 + }, + "full_input": { + "shape": [ + 77, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "929c1d16fe9fffeb8ae09182305ba7828e90273745505b3c9410e20c16c3bb33", + "mean": -0.038369420915842056, + "std": 6.001771450042725, + "rms": 6.001893997192383, + "max_abs": 840.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5726f29887a37773a053e9a95508c1e3e1af7e1429ac4ae6fc629b038e7aa9ab", + "mean": -0.0480685792863369, + "std": 2.7166476249694824, + "rms": 2.7170729637145996, + "max_abs": 111.0 + }, + "full_input": { + "shape": [ + 93, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c907316a91fb53cef034860e0d5507e5301dee3f3d61614d2e41bebb9f59bf76", + "mean": -0.03213875740766525, + "std": 5.582771301269531, + "rms": 5.582863807678223, + "max_abs": 840.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9961252808570862, + "min_cosine_similarity": 0.9894700646400452, + "mean_relative_l2": 0.0859835296869278, + "max_abs_delta": 5.75 + }, + "system_bos": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9925956130027771, + "min_cosine_similarity": 0.9757785797119141, + "mean_relative_l2": 0.11592880636453629, + "max_abs_delta": 9.5 + }, + "system_x": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.987861692905426, + "min_cosine_similarity": 0.9511418342590332, + "mean_relative_l2": 0.14859525859355927, + "max_abs_delta": 16.0 + }, + "system_period": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9858255982398987, + "min_cosine_similarity": 0.9268907308578491, + "mean_relative_l2": 0.1586349755525589, + "max_abs_delta": 15.5 + }, + "bos_at_s0": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9895896315574646, + "min_cosine_similarity": 0.9568113088607788, + "mean_relative_l2": 0.1394728571176529, + "max_abs_delta": 7.0 + }, + "bos_at_s1": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.987459123134613, + "min_cosine_similarity": 0.952214777469635, + "mean_relative_l2": 0.15317657589912415, + "max_abs_delta": 9.0 + }, + "x_at_s0": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9902379512786865, + "min_cosine_similarity": 0.9743686318397522, + "mean_relative_l2": 0.1366409957408905, + "max_abs_delta": 5.0 + }, + "x_at_s1": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9838777184486389, + "min_cosine_similarity": 0.9281615018844604, + "mean_relative_l2": 0.1736055314540863, + "max_abs_delta": 12.5 + }, + "period_at_s0": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9884531497955322, + "min_cosine_similarity": 0.9175184965133667, + "mean_relative_l2": 0.14441607892513275, + "max_abs_delta": 9.5 + }, + "period_at_s1": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9838278293609619, + "min_cosine_similarity": 0.9379913806915283, + "mean_relative_l2": 0.1747390329837799, + "max_abs_delta": 12.5 + } + } + }, + "layer_25": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "eb2afe9f34bc119d6acce3fe0fb1e9127a48ea571fa6b8a3d031a8a7bab07213", + "mean": -0.08683259040117264, + "std": 3.498464345932007, + "rms": 3.499541997909546, + "max_abs": 158.0 + }, + "full_input": { + "shape": [ + 77, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b7fadbd5759ee4a35798228a07817ac9e481586fa768aa7f5704f14cab98bcc6", + "mean": -0.08353409171104431, + "std": 7.304269790649414, + "rms": 7.304747581481934, + "max_abs": 872.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8f14a0899fcca83809f726507244c1a38450ffd159a9548b162385bd42a1d9b8", + "mean": -0.08251183480024338, + "std": 3.4964308738708496, + "rms": 3.4974043369293213, + "max_abs": 157.0 + }, + "full_input": { + "shape": [ + 93, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1d5bf1d041c56ac8d4f70fd3a12daba427950a11fc1813e56805edcddd264983", + "mean": -0.07190607488155365, + "std": 7.336371898651123, + "rms": 7.336724281311035, + "max_abs": 984.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5e9c963e35e2636d0ca188d1a7ef70c4b6bc0e31429a970a1e9672e6c7ba59cb", + "mean": -0.09008930623531342, + "std": 3.496058225631714, + "rms": 3.4972188472747803, + "max_abs": 154.0 + }, + "full_input": { + "shape": [ + 77, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "557ae5483d5f557e4b6af1d952a728dbbc04857110068485292f1a67149ca3ce", + "mean": -0.06911078095436096, + "std": 3.760690927505493, + "rms": 3.7613255977630615, + "max_abs": 252.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3ec279cc0391903111c1a425a928c84b36f628e3cb5a67d4d912d0931d64ac09", + "mean": -0.0834697037935257, + "std": 3.4828503131866455, + "rms": 3.4838504791259766, + "max_abs": 153.0 + }, + "full_input": { + "shape": [ + 93, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b34bef434345130600f06889ee61ea7100125a0788db570d7083877c0fc86e38", + "mean": -0.056160446256399155, + "std": 3.7498481273651123, + "rms": 3.7502686977386475, + "max_abs": 252.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "48fb6ae567d545c8eab459ae0f0dffce20e2bc90ae041d28d2a893b0ef43b6d4", + "mean": -0.08743627369403839, + "std": 3.4852917194366455, + "rms": 3.4863882064819336, + "max_abs": 156.0 + }, + "full_input": { + "shape": [ + 77, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d0081d9da7bb4e43b744e21b77de7eef5ab9517aa2a8751738b0d66e3447ef6a", + "mean": -0.0680931955575943, + "std": 3.772216796875, + "rms": 3.7728312015533447, + "max_abs": 252.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e7bf53699e579b44dc0c03382b1f632b89cb190c457c1301436c76ef874de134", + "mean": -0.07770200073719025, + "std": 3.4659605026245117, + "rms": 3.4668314456939697, + "max_abs": 156.0 + }, + "full_input": { + "shape": [ + 93, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3122ef10535c8766b4920207e636ea6e41cec99ca9b4960c73dc392e1c81a609", + "mean": -0.054136764258146286, + "std": 3.7635152339935303, + "rms": 3.7639048099517822, + "max_abs": 252.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d67b87570d363eaa6bcb0a063a98e2d18ca4a39b4e28f0553929245511ad1c38", + "mean": -0.08489561080932617, + "std": 3.495584487915039, + "rms": 3.496615171432495, + "max_abs": 156.0 + }, + "full_input": { + "shape": [ + 77, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e093ed884f348b162cde7d578fcd83fe71cea97a5534db284134f321b80eb2d8", + "mean": -0.06543619930744171, + "std": 3.768230438232422, + "rms": 3.768798351287842, + "max_abs": 252.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "65b415e1a964ea5c7d24a0fd6cc050d9b3cfa9198daa9d0f1f480ebafccccde8", + "mean": -0.07908694446086884, + "std": 3.447582960128784, + "rms": 3.4484896659851074, + "max_abs": 154.0 + }, + "full_input": { + "shape": [ + 93, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "646f4c6551438ceea9be2b92bc4fec461635fd301db631129c570632d44f4790", + "mean": -0.054025109857320786, + "std": 3.743591547012329, + "rms": 3.74398136138916, + "max_abs": 252.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9966992735862732, + "min_cosine_similarity": 0.9917559027671814, + "mean_relative_l2": 0.07939065247774124, + "max_abs_delta": 6.0 + }, + "system_bos": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9934287667274475, + "min_cosine_similarity": 0.9765948057174683, + "mean_relative_l2": 0.10846146941184998, + "max_abs_delta": 11.0 + }, + "system_x": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9891839623451233, + "min_cosine_similarity": 0.953222393989563, + "mean_relative_l2": 0.13956907391548157, + "max_abs_delta": 17.0 + }, + "system_period": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9877366423606873, + "min_cosine_similarity": 0.9349061846733093, + "mean_relative_l2": 0.14809174835681915, + "max_abs_delta": 16.5 + }, + "bos_at_s0": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.991182267665863, + "min_cosine_similarity": 0.9648085236549377, + "mean_relative_l2": 0.12739361822605133, + "max_abs_delta": 12.5 + }, + "bos_at_s1": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9890918731689453, + "min_cosine_similarity": 0.9528950452804565, + "mean_relative_l2": 0.14148280024528503, + "max_abs_delta": 11.0 + }, + "x_at_s0": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9917750954627991, + "min_cosine_similarity": 0.9741775989532471, + "mean_relative_l2": 0.12436682730913162, + "max_abs_delta": 8.0 + }, + "x_at_s1": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9859101176261902, + "min_cosine_similarity": 0.923416256904602, + "mean_relative_l2": 0.1608327478170395, + "max_abs_delta": 13.5 + }, + "period_at_s0": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.99019855260849, + "min_cosine_similarity": 0.9288771152496338, + "mean_relative_l2": 0.13205371797084808, + "max_abs_delta": 18.0 + }, + "period_at_s1": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9862040281295776, + "min_cosine_similarity": 0.9474931955337524, + "mean_relative_l2": 0.16088995337486267, + "max_abs_delta": 11.5 + } + } + }, + "layer_26": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "764ddac1fd489bbdc945b4466079330d8f48819f4b24e02410adc3f05f927841", + "mean": -0.12172861397266388, + "std": 4.070923328399658, + "rms": 4.072742462158203, + "max_abs": 180.0 + }, + "full_input": { + "shape": [ + 77, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "55b5d45abd0d427f89f6331ed99e3cd35056fcbd8255c87fed31098504eee660", + "mean": -0.11943314224481583, + "std": 7.557873725891113, + "rms": 7.558816909790039, + "max_abs": 840.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "caa07ab11d88d6f1297ee8541403dc04f1c3d652b3cb2f4aa21100f944f92fe8", + "mean": -0.1135609820485115, + "std": 3.989804983139038, + "rms": 3.9914207458496094, + "max_abs": 182.0 + }, + "full_input": { + "shape": [ + 93, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "215e05c9837c5b3056dd3e8b31812848bf2eddf1f1add5767e3363e8d7d63405", + "mean": -0.09374130517244339, + "std": 7.598862648010254, + "rms": 7.599441051483154, + "max_abs": 868.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6c120b4cab4d0c05d71917899ac4fd90e1cc6ffeb6691b45fb4126ff389f5302", + "mean": -0.12308526784181595, + "std": 4.007748126983643, + "rms": 4.00963830947876, + "max_abs": 189.0 + }, + "full_input": { + "shape": [ + 77, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0eef0f868f1558b959bd3d2b6a4af99d509cd56eef532c4a75169dfe8a46aea8", + "mean": -0.10073624551296234, + "std": 4.864425182342529, + "rms": 4.8654680252075195, + "max_abs": 768.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0b5bc904e6e7bee83b50a278bbe193e5ddaf525b489c894d36235c20ecfc89e7", + "mean": -0.1105344146490097, + "std": 3.8805623054504395, + "rms": 3.882136344909668, + "max_abs": 182.0 + }, + "full_input": { + "shape": [ + 93, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "00c6c6cd7eeb68215198e4645c749a1d47d22991c92976365fb3ff92b5425dd9", + "mean": -0.07386544346809387, + "std": 4.9092254638671875, + "rms": 4.909780979156494, + "max_abs": 768.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "888936c053e4b6028597c7aed7a7c2cdac04ee4528d78ad1ec68250db03804c6", + "mean": -0.12095470726490021, + "std": 4.0353827476501465, + "rms": 4.037195205688477, + "max_abs": 180.0 + }, + "full_input": { + "shape": [ + 77, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "47039d56b52de1b52f1c2acbb2580812e43b791b81e317cde8c1f2584346ca7e", + "mean": -0.10036800056695938, + "std": 4.892258644104004, + "rms": 4.8932881355285645, + "max_abs": 768.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4ecd6cd7747536a0d1179ea6ededfb0694c463852202aa60cd9609bcdbfd30e3", + "mean": -0.09968134015798569, + "std": 3.748476266860962, + "rms": 3.7498013973236084, + "max_abs": 172.0 + }, + "full_input": { + "shape": [ + 93, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "73e5bd770eed2b502ac30ef53892e7ece8a2c3b3b751afcc08b6e0dad43516fc", + "mean": -0.06815943121910095, + "std": 4.8619184494018555, + "rms": 4.862396240234375, + "max_abs": 768.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "efc65d32aa6c05c755a300a3ff8aee66b754d9bf1ac51a6836b8a80e31c39ad6", + "mean": -0.1176401674747467, + "std": 4.005621910095215, + "rms": 4.007349014282227, + "max_abs": 182.0 + }, + "full_input": { + "shape": [ + 77, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a0c5f8fd67c4fb94c4fc321ca02899e914dfde29fdbeedec95b18b5a874e4872", + "mean": -0.09699690341949463, + "std": 4.855055809020996, + "rms": 4.856024742126465, + "max_abs": 768.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f7fc82c46e52727c85af43fdb93ae7c51a11591e83e0c3a310076a7d7d211c2b", + "mean": -0.09973876178264618, + "std": 3.687582492828369, + "rms": 3.6889309883117676, + "max_abs": 166.0 + }, + "full_input": { + "shape": [ + 93, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cf6023c7b64a10925c4129ac0e21987bbbea3555047e1e6ce629936baf42e2cb", + "mean": -0.06740391999483109, + "std": 4.812708854675293, + "rms": 4.813180446624756, + "max_abs": 768.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9959262013435364, + "min_cosine_similarity": 0.9874764680862427, + "mean_relative_l2": 0.09022128582000732, + "max_abs_delta": 23.5 + }, + "system_bos": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9912948608398438, + "min_cosine_similarity": 0.9588059782981873, + "mean_relative_l2": 0.12921525537967682, + "max_abs_delta": 31.0 + }, + "system_x": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9843552708625793, + "min_cosine_similarity": 0.9280651807785034, + "mean_relative_l2": 0.17791397869586945, + "max_abs_delta": 53.5 + }, + "system_period": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9836419224739075, + "min_cosine_similarity": 0.9248480796813965, + "mean_relative_l2": 0.18601512908935547, + "max_abs_delta": 58.0 + }, + "bos_at_s0": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9898139238357544, + "min_cosine_similarity": 0.9648662805557251, + "mean_relative_l2": 0.1400788426399231, + "max_abs_delta": 31.0 + }, + "bos_at_s1": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9858646392822266, + "min_cosine_similarity": 0.9344038963317871, + "mean_relative_l2": 0.16081516444683075, + "max_abs_delta": 50.5 + }, + "x_at_s0": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9904604554176331, + "min_cosine_similarity": 0.9635176658630371, + "mean_relative_l2": 0.13360819220542908, + "max_abs_delta": 17.0 + }, + "x_at_s1": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9810393452644348, + "min_cosine_similarity": 0.8838772773742676, + "mean_relative_l2": 0.1916610151529312, + "max_abs_delta": 49.5 + }, + "period_at_s0": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9888700246810913, + "min_cosine_similarity": 0.9300896525382996, + "mean_relative_l2": 0.14315129816532135, + "max_abs_delta": 44.0 + }, + "period_at_s1": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9818547964096069, + "min_cosine_similarity": 0.9253203868865967, + "mean_relative_l2": 0.1945914328098297, + "max_abs_delta": 51.5 + } + } + }, + "final_norm": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d32e3795bd5586387aaadb14f7f74c7ec4257ca73ddd94ea7145255934fcc3f6", + "mean": -0.017191581428050995, + "std": 0.6772955060005188, + "rms": 0.6775136590003967, + "max_abs": 16.5 + }, + "full_input": { + "shape": [ + 77, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "56d8210260c90d4256b2032a0a8845685db148ff72bf96115a540d80afe35700", + "mean": -0.013713907450437546, + "std": 0.6528229117393494, + "rms": 0.6529669761657715, + "max_abs": 17.625 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "979ead5f9c7d4e206ac32b420c0ef002375eb938f73f747da166f09946bf8032", + "mean": -0.016192086040973663, + "std": 0.677037239074707, + "rms": 0.6772308945655823, + "max_abs": 16.25 + }, + "full_input": { + "shape": [ + 93, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "802cc015bef8c07da8e1e7cfa432acdd6d28b6a92b202c70d67e712fa98de7ff", + "mean": -0.009944688528776169, + "std": 0.6282655596733093, + "rms": 0.6283442378044128, + "max_abs": 17.75 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3ece6fe072b550eb1b47ba454d3b387ec44de1dfb98c631d57b0d08975b4e992", + "mean": -0.01789935491979122, + "std": 0.6860969662666321, + "rms": 0.6863303780555725, + "max_abs": 16.875 + }, + "full_input": { + "shape": [ + 77, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "49ba10451113ce6cb6c5a90d4be4270fdbd47ef8fe0c000ad57bfadfb3013f7f", + "mean": -0.014030024409294128, + "std": 0.6587255001068115, + "rms": 0.6588748693466187, + "max_abs": 20.5 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "52826c66c11f748f667431f196c851128087cfcceb167e9a17533438544395af", + "mean": -0.016783319413661957, + "std": 0.6916287541389465, + "rms": 0.6918323040008545, + "max_abs": 16.5 + }, + "full_input": { + "shape": [ + 93, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d1f170ebf032070826b3fafaeccf475aaabf1ddecf8e54da5bd824786aa9c6dd", + "mean": -0.010255686938762665, + "std": 0.6359602212905884, + "rms": 0.6360428929328918, + "max_abs": 16.625 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3feccc87e4a2fcfcd23f7a23794a9951cadce440f91e4bc1b558eebfc7e8d391", + "mean": -0.017084594815969467, + "std": 0.67396479845047, + "rms": 0.6741812825202942, + "max_abs": 16.375 + }, + "full_input": { + "shape": [ + 77, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1935b0161c05ac22440f2489f5996e6c893ebb30b144f214d325d431f39f957b", + "mean": -0.013585235923528671, + "std": 0.6472844481468201, + "rms": 0.647426962852478, + "max_abs": 17.625 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e39abd8cf0682217ad5be7deedaef8b7b9b7744492229fc8385d4e38d816c77d", + "mean": -0.015244807116687298, + "std": 0.6795778274536133, + "rms": 0.6797487735748291, + "max_abs": 16.25 + }, + "full_input": { + "shape": [ + 93, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0183b9539c6aac38654eb2f7ffb6fbd02cdfad3bac6a99abbca6aae694b5e431", + "mean": -0.00947724562138319, + "std": 0.6253859400749207, + "rms": 0.625457763671875, + "max_abs": 17.25 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4a711cabe87ae556e25bac03e7526874e0bc399df8dce6f3c06830bb08cb6d47", + "mean": -0.016628555953502655, + "std": 0.6786600947380066, + "rms": 0.6788637042045593, + "max_abs": 16.375 + }, + "full_input": { + "shape": [ + 77, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6283a60007ec996400a79fbbb72c7dc62d53183cf662a9098b7f7ec1777604f5", + "mean": -0.013203333131968975, + "std": 0.6541228294372559, + "rms": 0.6542560458183289, + "max_abs": 17.625 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3fffc20901722df2005662e0dc21811dbcc66bc719c36932accb3f4981b13d66", + "mean": -0.01567498967051506, + "std": 0.6886329650878906, + "rms": 0.6888113617897034, + "max_abs": 16.75 + }, + "full_input": { + "shape": [ + 93, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ea750d24d28c73b7c505b946671113256b3a34afa5a162cf5a481bd19242d50c", + "mean": -0.00967338401824236, + "std": 0.6345974206924438, + "rms": 0.6346710920333862, + "max_abs": 19.125 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9953964948654175, + "min_cosine_similarity": 0.9874393939971924, + "mean_relative_l2": 0.09299684315919876, + "max_abs_delta": 1.25 + }, + "system_bos": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9909764528274536, + "min_cosine_similarity": 0.9642017483711243, + "mean_relative_l2": 0.1265435367822647, + "max_abs_delta": 2.8125 + }, + "system_x": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.983017086982727, + "min_cosine_similarity": 0.9239365458488464, + "mean_relative_l2": 0.17889785766601562, + "max_abs_delta": 3.5 + }, + "system_period": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9822645783424377, + "min_cosine_similarity": 0.9263114929199219, + "mean_relative_l2": 0.18459509313106537, + "max_abs_delta": 5.0 + }, + "bos_at_s0": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9883587956428528, + "min_cosine_similarity": 0.9519534707069397, + "mean_relative_l2": 0.14583902060985565, + "max_abs_delta": 2.859375 + }, + "bos_at_s1": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9852355122566223, + "min_cosine_similarity": 0.9270026087760925, + "mean_relative_l2": 0.16645744442939758, + "max_abs_delta": 4.375 + }, + "x_at_s0": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9894097447395325, + "min_cosine_similarity": 0.9643092751502991, + "mean_relative_l2": 0.13877242803573608, + "max_abs_delta": 2.03125 + }, + "x_at_s1": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9795993566513062, + "min_cosine_similarity": 0.8722050189971924, + "mean_relative_l2": 0.1950753778219223, + "max_abs_delta": 2.8125 + }, + "period_at_s0": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9872320890426636, + "min_cosine_similarity": 0.8979601860046387, + "mean_relative_l2": 0.14875827729701996, + "max_abs_delta": 2.71875 + }, + "period_at_s1": { + "tokens": 52, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9805406332015991, + "min_cosine_similarity": 0.9160998463630676, + "mean_relative_l2": 0.19571083784103394, + "max_abs_delta": 3.75 + } + } + } + }, + "router_layers": { + "layer_01": { + "layer": 1, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "37754eee0612801a0d51823c63b9dadbcc71933c6a66c1995aca22c163d520b5", + "route_weight_sha256": "8331b6cd15eb366c36d5a84353138b0ee6c305f54985ffd2e87a118bcaaf5e88", + "loads": [ + 1, + 3, + 1, + 9, + 5, + 4, + 5, + 3, + 11, + 4, + 1, + 3, + 10, + 3, + 0, + 10, + 3, + 2, + 5, + 5, + 0, + 3, + 3, + 8, + 5, + 3, + 6, + 3, + 12, + 3, + 15, + 3, + 0, + 2, + 4, + 5, + 5, + 1, + 8, + 4, + 7, + 4, + 4, + 4, + 15, + 9, + 6, + 6, + 6, + 8, + 11, + 4, + 4, + 5, + 2, + 4, + 4, + 0, + 2, + 8, + 4, + 10, + 2, + 2 + ], + "weighted_loads": [ + 0.056918345391750336, + 0.1883242428302765, + 0.042866211384534836, + 0.8288588337600231, + 0.5092736966907978, + 0.5734213292598724, + 0.1963525228202343, + 0.11111701466143131, + 0.44506561756134033, + 0.3121269568800926, + 0.02650873176753521, + 0.2595473900437355, + 0.33482724241912365, + 0.23501262068748474, + 0.0, + 0.6400394514203072, + 0.07676217705011368, + 0.10443112626671791, + 0.29148709401488304, + 0.32947342842817307, + 0.0, + 0.42883528769016266, + 0.19937869906425476, + 0.6774656288325787, + 0.333220474421978, + 0.2958047613501549, + 0.1753074675798416, + 0.08560943976044655, + 1.181630663573742, + 0.17834148183465004, + 1.3347953781485558, + 0.334169439971447, + 0.0, + 0.10903905145823956, + 0.40322013199329376, + 0.21430758759379387, + 0.4851030297577381, + 0.05828651785850525, + 0.4532963950186968, + 0.36530790477991104, + 0.29238962568342686, + 0.2805744558572769, + 0.30615515261888504, + 0.36805527843534946, + 1.2321541868150234, + 0.5211386010050774, + 0.578151497989893, + 0.5493555478751659, + 0.3353510405868292, + 0.8438605405390263, + 1.1146754436194897, + 0.2623591534793377, + 0.21256441995501518, + 0.23943225666880608, + 0.17247606068849564, + 0.18373282253742218, + 0.11422857828438282, + 0.0, + 0.061232976615428925, + 0.484291585162282, + 0.11417067423462868, + 0.7388246897608042, + 0.07081979513168335, + 0.10230083204805851 + ], + "unique_experts": 60, + "load_cv": 0.699863798151599, + "normalized_load_entropy": 0.9407712420590306, + "max_load_share": 0.04807692307692308 + }, + "full_input": { + "tokens": 77, + "top_k": 6, + "decisions": 462, + "ordered_route_sha256": "b37b3c23c161a9efa924725848375efe2f8fe4c449dec88e06411e793a5e2c67", + "route_weight_sha256": "479b1b1dea9fb911ef77d9850afde9d9394248f8cee2162f00d62a8260657d06", + "loads": [ + 2, + 3, + 3, + 9, + 9, + 5, + 6, + 5, + 28, + 4, + 3, + 5, + 10, + 3, + 0, + 19, + 3, + 4, + 5, + 5, + 3, + 5, + 4, + 8, + 5, + 7, + 19, + 3, + 12, + 3, + 15, + 8, + 1, + 4, + 4, + 5, + 5, + 1, + 8, + 7, + 8, + 14, + 4, + 9, + 16, + 20, + 7, + 6, + 7, + 8, + 15, + 5, + 8, + 5, + 5, + 8, + 7, + 8, + 2, + 19, + 5, + 14, + 2, + 2 + ], + "weighted_loads": [ + 0.13587556034326553, + 0.1883242428302765, + 0.1452956423163414, + 0.8288588337600231, + 0.6552564855664968, + 0.6049181707203388, + 0.258375346660614, + 0.3784188497811556, + 1.3915595281869173, + 0.3121269568800926, + 0.2953964527696371, + 0.3096989933401346, + 0.33482724241912365, + 0.23501262068748474, + 0.0, + 1.2551744282245636, + 0.07676217705011368, + 0.20509576983749866, + 0.29148709401488304, + 0.32947342842817307, + 0.3587223216891289, + 0.47396769747138023, + 0.22968809120357037, + 0.6774656288325787, + 0.333220474421978, + 0.4685575030744076, + 0.9843149315565825, + 0.08560943976044655, + 1.181630663573742, + 0.17834148183465004, + 1.3347953781485558, + 0.7634556143311784, + 0.06173285096883774, + 0.3262550141662359, + 0.40322013199329376, + 0.21430758759379387, + 0.4851030297577381, + 0.05828651785850525, + 0.4532963950186968, + 0.5950360223650932, + 0.3317044172435999, + 0.6911207884550095, + 0.30615515261888504, + 0.47785236054915003, + 2.2165278755128384, + 1.3379475100664422, + 0.6621433235704899, + 0.5493555478751659, + 0.38031798414886, + 0.8438605405390263, + 1.2153046652674675, + 0.26296314992941916, + 0.48145337402820587, + 0.23943225666880608, + 0.2176906545064412, + 0.7310327887535095, + 0.3875770438462496, + 0.4893081448972225, + 0.061232976615428925, + 1.2011144775897264, + 0.20475850626826286, + 0.9446916934102774, + 0.07081979513168335, + 0.10230083204805851 + ], + "unique_experts": 63, + "load_cv": 0.7461852410328625, + "normalized_load_entropy": 0.9417210782844805, + "max_load_share": 0.06060606060606061 + } + }, + "s1_eos": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "4fd07ad595c8305989b52822ba518a748056cc97c2f4c8ccf99bcb29ef76ef26", + "route_weight_sha256": "112026e2da0777265e87f4e01e6e2d779411ba62fdaefe66468b9ed45cc7d507", + "loads": [ + 2, + 3, + 1, + 9, + 5, + 4, + 5, + 4, + 10, + 4, + 1, + 3, + 7, + 3, + 0, + 10, + 5, + 2, + 5, + 6, + 0, + 3, + 3, + 8, + 5, + 3, + 4, + 2, + 12, + 3, + 15, + 3, + 0, + 2, + 4, + 4, + 6, + 1, + 8, + 4, + 7, + 4, + 4, + 3, + 15, + 9, + 6, + 7, + 6, + 8, + 12, + 4, + 4, + 5, + 2, + 4, + 4, + 0, + 3, + 8, + 4, + 10, + 2, + 2 + ], + "weighted_loads": [ + 0.07978788390755653, + 0.1878778040409088, + 0.043759774416685104, + 0.8561041727662086, + 0.49451175704598427, + 0.5851919278502464, + 0.19194529950618744, + 0.13342306204140186, + 0.36511182226240635, + 0.30705300718545914, + 0.027458272874355316, + 0.2655830904841423, + 0.2401408925652504, + 0.2255200445652008, + 0.0, + 0.6469143331050873, + 0.11960249952971935, + 0.10732629336416721, + 0.2931300438940525, + 0.3598160035908222, + 0.0, + 0.44000443816185, + 0.2005789317190647, + 0.6691414415836334, + 0.33022595569491386, + 0.27635158598423004, + 0.12344308011233807, + 0.05964713916182518, + 1.1850853487849236, + 0.17966661974787712, + 1.344972986727953, + 0.3255465403199196, + 0.0, + 0.10961456410586834, + 0.4050362929701805, + 0.19522057846188545, + 0.5033646021038294, + 0.05891742929816246, + 0.45188863202929497, + 0.3588359020650387, + 0.2962981406599283, + 0.2842315696179867, + 0.30749987065792084, + 0.3451673835515976, + 1.2329401895403862, + 0.5226585995405912, + 0.5838593803346157, + 0.5972330253571272, + 0.34042066521942616, + 0.8437817767262459, + 1.148032320663333, + 0.2626225855201483, + 0.21800136752426624, + 0.24250578321516514, + 0.17591361701488495, + 0.18141508661210537, + 0.11473873630166054, + 0.0, + 0.08340061083436012, + 0.4835097286850214, + 0.11174055002629757, + 0.7504095695912838, + 0.06634287908673286, + 0.10391416400671005 + ], + "unique_experts": 60, + "load_cv": 0.6884985426716693, + "normalized_load_entropy": 0.9427793324135165, + "max_load_share": 0.04807692307692308 + }, + "full_input": { + "tokens": 93, + "top_k": 6, + "decisions": 558, + "ordered_route_sha256": "3fc35f1a01807a5ccb982ae6a7d17065b14ac3c1f2107f0dd17975f98b060b4b", + "route_weight_sha256": "2b9df4de41adebe1fbfb3b3f745dc5b6a0a309dad707821f1e381c7a8088d16d", + "loads": [ + 5, + 3, + 4, + 9, + 12, + 7, + 6, + 7, + 33, + 4, + 6, + 6, + 7, + 4, + 0, + 22, + 5, + 8, + 6, + 7, + 3, + 7, + 7, + 9, + 7, + 8, + 23, + 3, + 12, + 5, + 16, + 10, + 1, + 4, + 4, + 4, + 7, + 2, + 8, + 9, + 8, + 16, + 7, + 9, + 17, + 20, + 7, + 10, + 9, + 8, + 21, + 9, + 9, + 5, + 7, + 8, + 13, + 12, + 5, + 19, + 6, + 15, + 2, + 6 + ], + "weighted_loads": [ + 0.2612900957465172, + 0.1878778040409088, + 0.2095278687775135, + 0.8561041727662086, + 0.8763012606650591, + 0.7528162710368633, + 0.23736712336540222, + 0.37038781493902206, + 1.721966890618205, + 0.30705300718545914, + 0.48986732587218285, + 0.46257891319692135, + 0.2401408925652504, + 0.26538848876953125, + 0.0, + 1.3499565310776234, + 0.11960249952971935, + 0.33623054809868336, + 0.33262403309345245, + 0.42564521357417107, + 0.2930540665984154, + 0.6893828716129065, + 0.4710583668202162, + 0.7036686688661575, + 0.40197103284299374, + 0.4750143736600876, + 1.4016883373260498, + 0.10178681463003159, + 1.1850853487849236, + 0.3415912613272667, + 1.431198362261057, + 0.9798157559707761, + 0.04932907968759537, + 0.28179322741925716, + 0.4050362929701805, + 0.19522057846188545, + 0.7620474491268396, + 0.09272128343582153, + 0.45188863202929497, + 0.7075980454683304, + 0.3351855669170618, + 0.8583700247108936, + 0.5150071997195482, + 0.5435224249958992, + 2.3747816309332848, + 1.2906955319049302, + 0.6663523577153683, + 0.6798468577617314, + 0.5375518370419741, + 0.8437817767262459, + 1.5355695057660341, + 0.6278214206977282, + 0.5520887654274702, + 0.24250578321516514, + 0.26949968218104914, + 0.7060744296759367, + 0.5471705961972475, + 0.713495496660471, + 0.15876632556319237, + 1.1545629370957613, + 0.22712930664420128, + 1.0481892749667168, + 0.06634287908673286, + 0.5962000638246536 + ], + "unique_experts": 63, + "load_cv": 0.6768691702916025, + "normalized_load_entropy": 0.9517088233100756, + "max_load_share": 0.05913978494623656 + } + }, + "s0_bos": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "60e1d6cba6972479f3dc4effb09c4d9ca67de2d09713427552430f3db513de46", + "route_weight_sha256": "ca87571ef9a86ace587b28c5d19f8c20cb6c0a49845d0101fc6b1848e6e2cce8", + "loads": [ + 3, + 3, + 1, + 10, + 5, + 4, + 8, + 3, + 8, + 4, + 2, + 5, + 6, + 3, + 0, + 8, + 2, + 7, + 4, + 5, + 0, + 3, + 3, + 8, + 5, + 3, + 6, + 3, + 12, + 3, + 15, + 3, + 1, + 3, + 4, + 4, + 6, + 1, + 8, + 4, + 6, + 3, + 4, + 3, + 15, + 7, + 6, + 6, + 7, + 8, + 13, + 4, + 4, + 3, + 2, + 4, + 4, + 0, + 2, + 8, + 3, + 10, + 2, + 2 + ], + "weighted_loads": [ + 0.11217108927667141, + 0.18255074694752693, + 0.044321246445178986, + 0.8788421135395765, + 0.5042779799550772, + 0.49719323217868805, + 0.305569427087903, + 0.0992314275354147, + 0.3101422879844904, + 0.3372575119137764, + 0.05180170759558678, + 0.30667919293046, + 0.21521930024027824, + 0.21873532235622406, + 0.0, + 0.6151923984289169, + 0.044301837682724, + 0.33841870725154877, + 0.23078953847289085, + 0.3290886767208576, + 0.0, + 0.39888568967580795, + 0.20249700546264648, + 0.701169665902853, + 0.3293050713837147, + 0.2888110503554344, + 0.17333594523370266, + 0.08614692464470863, + 1.1989776045084, + 0.1864062212407589, + 1.2837083414196968, + 0.3007182329893112, + 0.03813314065337181, + 0.17319021746516228, + 0.41641974449157715, + 0.1855771765112877, + 0.5128354541957378, + 0.05855610966682434, + 0.4808785170316696, + 0.3452616259455681, + 0.2630873844027519, + 0.22566933371126652, + 0.31005408614873886, + 0.35663260519504547, + 1.2921720929443836, + 0.4392742421478033, + 0.5573843345046043, + 0.5523468367755413, + 0.35759963653981686, + 0.8353216387331486, + 1.2158813625574112, + 0.2710018288344145, + 0.2244035229086876, + 0.18026764318346977, + 0.172812782227993, + 0.1722718756645918, + 0.12645274959504604, + 0.0, + 0.05164842680096626, + 0.46042943559587, + 0.0774164330214262, + 0.7293712384998798, + 0.06457987427711487, + 0.10606351681053638 + ], + "unique_experts": 61, + "load_cv": 0.6740225347740982, + "normalized_load_entropy": 0.9468482736939957, + "max_load_share": 0.04807692307692308 + }, + "full_input": { + "tokens": 77, + "top_k": 6, + "decisions": 462, + "ordered_route_sha256": "b77be78a1756014f8bd2ad8adfd9d036fe37f3a5ff6bde1f1681b5920e58312d", + "route_weight_sha256": "e0160a8057b48cfe1848b7cac9bb02bd87c369d51bca60b1ba1d1fd9edd777bd", + "loads": [ + 5, + 3, + 3, + 10, + 9, + 5, + 9, + 5, + 24, + 4, + 4, + 8, + 6, + 3, + 0, + 17, + 2, + 10, + 4, + 5, + 3, + 3, + 4, + 8, + 5, + 7, + 19, + 3, + 12, + 3, + 15, + 7, + 2, + 5, + 4, + 4, + 6, + 1, + 8, + 7, + 7, + 15, + 5, + 7, + 15, + 17, + 8, + 6, + 8, + 8, + 17, + 4, + 8, + 3, + 4, + 8, + 8, + 9, + 2, + 18, + 5, + 14, + 2, + 2 + ], + "weighted_loads": [ + 0.21590179949998856, + 0.18255074694752693, + 0.12947575375437737, + 0.8788421135395765, + 0.6495390832424164, + 0.5325289815664291, + 0.36759225092828274, + 0.35894533060491085, + 1.1746840681880713, + 0.3372575119137764, + 0.3077060468494892, + 0.3807231988757849, + 0.21521930024027824, + 0.21873532235622406, + 0.0, + 1.2303273752331734, + 0.044301837682724, + 0.48317623883485794, + 0.23078953847289085, + 0.3290886767208576, + 0.30202580988407135, + 0.39888568967580795, + 0.2328063976019621, + 0.701169665902853, + 0.3293050713837147, + 0.464732401072979, + 0.9823609702289104, + 0.08614692464470863, + 1.1989776045084, + 0.1864062212407589, + 1.2837083414196968, + 0.7521501928567886, + 0.09986599162220955, + 0.3893815316259861, + 0.41641974449157715, + 0.1855771765112877, + 0.5128354541957378, + 0.05855610966682434, + 0.4808785170316696, + 0.577475618571043, + 0.30308394134044647, + 0.6819141041487455, + 0.35291771218180656, + 0.46595252864062786, + 1.2921720929443836, + 1.2555838730186224, + 0.6811847910284996, + 0.5523468367755413, + 0.4025354404002428, + 0.8353216387331486, + 1.3261034097522497, + 0.2710018288344145, + 0.48210516571998596, + 0.18026764318346977, + 0.2175764050334692, + 0.719117371365428, + 0.46769568882882595, + 0.5629907567054033, + 0.05164842680096626, + 1.1439291033893824, + 0.2731145154684782, + 0.937629159539938, + 0.06457987427711487, + 0.10606351681053638 + ], + "unique_experts": 63, + "load_cv": 0.6928435850024063, + "normalized_load_entropy": 0.9471056910813209, + "max_load_share": 0.05194805194805195 + } + }, + "s1_bos": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "4767a3669be9d45dcd8ce62b5e241ead1ed1d9468aaf05100261822581812b32", + "route_weight_sha256": "f617f164b1aa40d2b3798d2dd3f420bd142ac73c49881f2ef3a6028a5fc8c4df", + "loads": [ + 2, + 3, + 1, + 10, + 5, + 4, + 6, + 2, + 9, + 4, + 1, + 5, + 5, + 3, + 0, + 10, + 2, + 6, + 4, + 5, + 1, + 3, + 3, + 8, + 5, + 3, + 10, + 3, + 12, + 3, + 15, + 4, + 1, + 2, + 4, + 4, + 5, + 1, + 8, + 4, + 6, + 5, + 4, + 3, + 15, + 6, + 6, + 7, + 7, + 8, + 12, + 4, + 4, + 4, + 2, + 4, + 3, + 0, + 3, + 9, + 0, + 10, + 2, + 2 + ], + "weighted_loads": [ + 0.08145005442202091, + 0.18696702271699905, + 0.04345899075269699, + 0.8872003238648176, + 0.4949116203933954, + 0.5176633335649967, + 0.2349294926971197, + 0.07462063990533352, + 0.3051250949501991, + 0.3226619139313698, + 0.02698836661875248, + 0.31118532456457615, + 0.17828068137168884, + 0.19742582738399506, + 0.0, + 0.675814799964428, + 0.04528100974857807, + 0.2757092956453562, + 0.2290612906217575, + 0.33217815682291985, + 0.027952834963798523, + 0.4165569990873337, + 0.20306963473558426, + 0.6755216382443905, + 0.3273208737373352, + 0.2586996853351593, + 0.28154496289789677, + 0.08662776835262775, + 1.1962329745292664, + 0.18503230065107346, + 1.3131062015891075, + 0.3274217899888754, + 0.03485054895281792, + 0.12654533237218857, + 0.4110536500811577, + 0.18629482202231884, + 0.4885922335088253, + 0.05770699307322502, + 0.47820452228188515, + 0.341014314442873, + 0.25067631527781487, + 0.29929913580417633, + 0.30274466425180435, + 0.34625575691461563, + 1.3169800154864788, + 0.410481009632349, + 0.5667552277445793, + 0.6102036386728287, + 0.3677685633301735, + 0.834555096924305, + 1.1873550452291965, + 0.27098244428634644, + 0.22353783249855042, + 0.20898903161287308, + 0.18002431839704514, + 0.16712088137865067, + 0.09924332797527313, + 0.0, + 0.07296683639287949, + 0.4940989725291729, + 0.0, + 0.7368630431592464, + 0.0627866629511118, + 0.10678083263337612 + ], + "unique_experts": 61, + "load_cv": 0.6970398573881121, + "normalized_load_entropy": 0.9424122320004641, + "max_load_share": 0.04807692307692308 + }, + "full_input": { + "tokens": 93, + "top_k": 6, + "decisions": 558, + "ordered_route_sha256": "7452b80a252593192aa5da8aa994a9b9140ff649b42e018d5c5cc1c81517a1a6", + "route_weight_sha256": "647c321c08a04d23accd9cf6a7c06a3c17775b91ea946035c332dbdb83296c37", + "loads": [ + 6, + 3, + 4, + 11, + 12, + 7, + 7, + 5, + 31, + 4, + 6, + 9, + 5, + 4, + 0, + 22, + 2, + 12, + 5, + 6, + 4, + 5, + 7, + 9, + 7, + 8, + 29, + 4, + 12, + 5, + 16, + 10, + 2, + 4, + 4, + 4, + 6, + 2, + 8, + 9, + 7, + 18, + 8, + 9, + 16, + 16, + 8, + 9, + 10, + 8, + 21, + 8, + 9, + 4, + 7, + 8, + 13, + 13, + 5, + 19, + 3, + 15, + 2, + 6 + ], + "weighted_loads": [ + 0.27934910356998444, + 0.18696702271699905, + 0.19543803855776787, + 0.9190701376646757, + 0.8783174902200699, + 0.68992805108428, + 0.2803513165563345, + 0.30271651968359947, + 1.5773193575441837, + 0.3226619139313698, + 0.4732292275875807, + 0.5331895090639591, + 0.17828068137168884, + 0.2372942715883255, + 0.0, + 1.378856997936964, + 0.04528100974857807, + 0.5122559107840061, + 0.26855527982115746, + 0.3980073668062687, + 0.27237076312303543, + 0.6208933293819427, + 0.4735490698367357, + 0.7100488655269146, + 0.3990659508854151, + 0.46297208964824677, + 1.5603881273418665, + 0.12876744382083416, + 1.1962329745292664, + 0.34695694223046303, + 1.3993315771222115, + 1.0011615138500929, + 0.08417962864041328, + 0.29223450273275375, + 0.4110536500811577, + 0.18629482202231884, + 0.7472750805318356, + 0.0915108472108841, + 0.47820452228188515, + 0.693796880543232, + 0.28564514219760895, + 0.8977510072290897, + 0.5466261561959982, + 0.5446107983589172, + 1.469730120152235, + 1.1780567951500416, + 0.6942494604736567, + 0.6925045102834702, + 0.5644530057907104, + 0.834555096924305, + 1.5890344977378845, + 0.6358743347227573, + 0.5332416854798794, + 0.20898903161287308, + 0.2966444045305252, + 0.6840647980570793, + 0.5849178414791822, + 0.7847472708672285, + 0.14833255112171173, + 1.1305580213665962, + 0.21723241917788982, + 1.0371096804738045, + 0.0627866629511118, + 0.5990667324513197 + ], + "unique_experts": 63, + "load_cv": 0.6975079841900664, + "normalized_load_entropy": 0.948780054432147, + "max_load_share": 0.05555555555555555 + } + }, + "s0_x": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "6a64014d723cfa8cfe378ee09223d2e0413c53bf9deaa4e41da946244de8e2bf", + "route_weight_sha256": "1022162b969e0c364bc914154cec7ff85c5a1a73e093cd6a5c9ab24308d98e37", + "loads": [ + 3, + 3, + 1, + 10, + 5, + 4, + 7, + 2, + 8, + 4, + 3, + 3, + 7, + 3, + 0, + 8, + 3, + 7, + 4, + 5, + 0, + 3, + 3, + 8, + 5, + 3, + 7, + 3, + 12, + 3, + 15, + 3, + 1, + 3, + 4, + 4, + 5, + 1, + 8, + 4, + 6, + 3, + 4, + 4, + 15, + 7, + 6, + 6, + 7, + 8, + 12, + 4, + 4, + 3, + 2, + 4, + 4, + 0, + 3, + 8, + 3, + 10, + 2, + 2 + ], + "weighted_loads": [ + 0.11106160841882229, + 0.1847008280456066, + 0.044621292501688004, + 0.8559523485600948, + 0.5128561668097973, + 0.5580001883208752, + 0.28328438475728035, + 0.07354039140045643, + 0.33368052542209625, + 0.33131318539381027, + 0.07769615761935711, + 0.25611478835344315, + 0.24373865500092506, + 0.23438488692045212, + 0.0, + 0.6001271829009056, + 0.06767978705465794, + 0.3516085185110569, + 0.23492678627371788, + 0.3335604667663574, + 0.0, + 0.41270916163921356, + 0.20181887596845627, + 0.6892399489879608, + 0.34485824033617973, + 0.2859248071908951, + 0.20641734451055527, + 0.08466905914247036, + 1.1815972663462162, + 0.1809491030871868, + 1.2905057035386562, + 0.3066007196903229, + 0.04007657617330551, + 0.18798184394836426, + 0.4055521711707115, + 0.18569124676287174, + 0.4851762019097805, + 0.061271075159311295, + 0.4580238237977028, + 0.3464047238230705, + 0.2804860770702362, + 0.23706106282770634, + 0.3080076202750206, + 0.37710366025567055, + 1.2706274949014187, + 0.4467199221253395, + 0.5624557808041573, + 0.5383909493684769, + 0.3643690049648285, + 0.8238496892154217, + 1.1599346995353699, + 0.27298017777502537, + 0.2165403552353382, + 0.18033125437796116, + 0.1800902932882309, + 0.17649245262145996, + 0.1220830287784338, + 0.0, + 0.07888327538967133, + 0.46392938308417797, + 0.08028269559144974, + 0.7186901364475489, + 0.06666064262390137, + 0.10657165385782719 + ], + "unique_experts": 61, + "load_cv": 0.6622139266741004, + "normalized_load_entropy": 0.9485316406665516, + "max_load_share": 0.04807692307692308 + }, + "full_input": { + "tokens": 77, + "top_k": 6, + "decisions": 462, + "ordered_route_sha256": "af1574e77237361be1d9c239ccca3271e420832c0087b0533c256b5bafa95c26", + "route_weight_sha256": "e11994e3b30d9bf5574a22af5d54bda27680704cd9d0b88b8b5de4286e243f27", + "loads": [ + 4, + 3, + 3, + 10, + 9, + 5, + 8, + 5, + 24, + 5, + 5, + 5, + 7, + 3, + 0, + 18, + 3, + 9, + 4, + 5, + 3, + 3, + 5, + 8, + 5, + 7, + 21, + 3, + 12, + 3, + 15, + 7, + 2, + 5, + 4, + 4, + 5, + 1, + 8, + 7, + 7, + 16, + 4, + 8, + 15, + 18, + 7, + 6, + 8, + 8, + 16, + 4, + 8, + 3, + 4, + 8, + 7, + 8, + 3, + 19, + 4, + 14, + 2, + 2 + ], + "weighted_loads": [ + 0.1906519066542387, + 0.1847008280456066, + 0.1390606164932251, + 0.8559523485600948, + 0.6609628889709711, + 0.5991209670901299, + 0.34530720859766006, + 0.37272183410823345, + 1.1993943117558956, + 0.3577193431556225, + 0.3403776790946722, + 0.29887531884014606, + 0.24373865500092506, + 0.23438488692045212, + 0.0, + 1.332242414355278, + 0.06767978705465794, + 0.46042192727327347, + 0.23492678627371788, + 0.3335604667663574, + 0.29684387519955635, + 0.41270916163921356, + 0.26301268860697746, + 0.6892399489879608, + 0.34485824033617973, + 0.4669032283127308, + 1.0452973078936338, + 0.08466905914247036, + 1.1815972663462162, + 0.1809491030871868, + 1.2905057035386562, + 0.7771986350417137, + 0.10180942714214325, + 0.40793977677822113, + 0.4055521711707115, + 0.18569124676287174, + 0.4851762019097805, + 0.061271075159311295, + 0.4580238237977028, + 0.6025789380073547, + 0.3237612433731556, + 0.74934047088027, + 0.3080076202750206, + 0.48642358370125294, + 1.2706274949014187, + 1.2968236021697521, + 0.6616711616516113, + 0.5383909493684769, + 0.41449665278196335, + 0.8238496892154217, + 1.2706018947064877, + 0.27298017777502537, + 0.45480919629335403, + 0.18033125437796116, + 0.22485391609370708, + 0.74672432243824, + 0.3140983711928129, + 0.4810778684914112, + 0.07888327538967133, + 1.2457813415676355, + 0.17087052762508392, + 0.9233646523207426, + 0.06666064262390137, + 0.10657165385782719 + ], + "unique_experts": 63, + "load_cv": 0.7120521289140014, + "normalized_load_entropy": 0.9458440673591278, + "max_load_share": 0.05194805194805195 + } + }, + "s1_x": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "4bdbbc6a3e00f1cd5d04534a2a618d70401c02ccefe8746c474ea2730a2b75aa", + "route_weight_sha256": "66373133150a22f89dc48b03177547d794c96f3915189135e239f01bc73f4abd", + "loads": [ + 1, + 3, + 1, + 10, + 5, + 4, + 7, + 2, + 10, + 4, + 1, + 3, + 4, + 3, + 0, + 10, + 2, + 6, + 4, + 5, + 0, + 3, + 3, + 8, + 5, + 3, + 16, + 3, + 12, + 3, + 15, + 3, + 0, + 3, + 4, + 4, + 5, + 1, + 8, + 4, + 6, + 5, + 4, + 3, + 15, + 6, + 6, + 7, + 7, + 8, + 12, + 4, + 4, + 3, + 2, + 4, + 3, + 0, + 3, + 8, + 0, + 10, + 2, + 2 + ], + "weighted_loads": [ + 0.05747745931148529, + 0.18705273419618607, + 0.0424746535718441, + 0.8678166922181845, + 0.4969375729560852, + 0.5360558368265629, + 0.2684404328465462, + 0.07465679571032524, + 0.3264315351843834, + 0.31462058424949646, + 0.026513468474149704, + 0.2609983794391155, + 0.14674561470746994, + 0.20379217714071274, + 0.0, + 0.6755346320569515, + 0.04639270342886448, + 0.2692794129252434, + 0.22422125190496445, + 0.3309270553290844, + 0.0, + 0.4238141179084778, + 0.20323177427053452, + 0.6728746518492699, + 0.334782499819994, + 0.2505704089999199, + 0.4614595603197813, + 0.08559317886829376, + 1.188130546361208, + 0.1830509826540947, + 1.318354208022356, + 0.2929168567061424, + 0.0, + 0.1613936498761177, + 0.40419135987758636, + 0.18636581674218178, + 0.48162437975406647, + 0.05820731446146965, + 0.4667964279651642, + 0.34123432636260986, + 0.257577370852232, + 0.30633035488426685, + 0.2981499210000038, + 0.3374957740306854, + 1.324400868266821, + 0.4135426729917526, + 0.5668858624994755, + 0.608744028955698, + 0.369782829657197, + 0.8305736556649208, + 1.1728842556476593, + 0.27175853587687016, + 0.2178850807249546, + 0.18435447290539742, + 0.18170582503080368, + 0.16890720650553703, + 0.09719707816839218, + 0.0, + 0.07850972935557365, + 0.4732949733734131, + 0.0, + 0.7312328722327948, + 0.06375478394329548, + 0.10759728588163853 + ], + "unique_experts": 59, + "load_cv": 0.7567361314550619, + "normalized_load_entropy": 0.9323249838787253, + "max_load_share": 0.05128205128205128 + }, + "full_input": { + "tokens": 93, + "top_k": 6, + "decisions": 558, + "ordered_route_sha256": "2ffc6bfcce340c71c381da48023c3bb6df1810ac8c6ce79f5e66e289ccb6afda", + "route_weight_sha256": "3e65019391399410197795ef1e71021322fc05ddcbcad3567ea6970c56f07317", + "loads": [ + 4, + 3, + 4, + 10, + 12, + 7, + 8, + 6, + 32, + 5, + 6, + 6, + 4, + 4, + 0, + 23, + 2, + 12, + 5, + 6, + 3, + 5, + 7, + 9, + 7, + 8, + 36, + 4, + 12, + 5, + 16, + 9, + 1, + 5, + 4, + 4, + 6, + 2, + 8, + 9, + 7, + 19, + 7, + 9, + 16, + 17, + 8, + 9, + 10, + 8, + 21, + 8, + 9, + 3, + 7, + 8, + 12, + 12, + 5, + 19, + 2, + 15, + 2, + 6 + ], + "weighted_loads": [ + 0.23005551472306252, + 0.18705273419618607, + 0.2016618438065052, + 0.8678166922181845, + 0.8811814654618502, + 0.7106119021773338, + 0.31386225670576096, + 0.3406377490609884, + 1.595605581998825, + 0.3395566791296005, + 0.4712582230567932, + 0.4534068964421749, + 0.14674561470746994, + 0.24366062134504318, + 0.0, + 1.4891068190336227, + 0.04639270342886448, + 0.5054600145667791, + 0.2637152411043644, + 0.39675626531243324, + 0.24055929481983185, + 0.6281504482030869, + 0.473711209371686, + 0.707401879131794, + 0.40652757696807384, + 0.4597771093249321, + 1.7796094007790089, + 0.12773285433650017, + 1.188130546361208, + 0.34497562423348427, + 1.40457958355546, + 0.9766816273331642, + 0.04932907968759537, + 0.3289817273616791, + 0.40419135987758636, + 0.18636581674218178, + 0.7403072267770767, + 0.09201116859912872, + 0.4667964279651642, + 0.7132689096033573, + 0.29233649373054504, + 0.9708605073392391, + 0.5056572500616312, + 0.535850815474987, + 1.4771509729325771, + 1.2159069888293743, + 0.6990681886672974, + 0.6910449005663395, + 0.5699098985642195, + 0.8305736556649208, + 1.5791247356683016, + 0.6366504263132811, + 0.5083730779588223, + 0.18435447290539742, + 0.29734957590699196, + 0.6975632719695568, + 0.45580668188631535, + 0.6996001414954662, + 0.1538754440844059, + 1.2040710411965847, + 0.11538875661790371, + 1.0285222735255957, + 0.06375478394329548, + 0.5998831856995821 + ], + "unique_experts": 63, + "load_cv": 0.7644330302153707, + "normalized_load_entropy": 0.9413823190592785, + "max_load_share": 0.06451612903225806 + } + }, + "s0_period": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "7b9bb9fb19d284306774200949444b5592d35930a76bdad54ee92ab68c8b3ac7", + "route_weight_sha256": "565cc833b703d8c7c7799881f9b9002a9e50c9b4a6703703d91669bd6d8f7311", + "loads": [ + 3, + 3, + 1, + 10, + 5, + 4, + 7, + 2, + 8, + 4, + 2, + 3, + 7, + 3, + 0, + 8, + 3, + 7, + 4, + 5, + 0, + 3, + 3, + 8, + 5, + 3, + 7, + 3, + 12, + 3, + 15, + 3, + 1, + 3, + 4, + 4, + 5, + 1, + 8, + 4, + 6, + 3, + 4, + 4, + 15, + 7, + 6, + 6, + 8, + 8, + 12, + 4, + 4, + 3, + 2, + 4, + 4, + 0, + 3, + 8, + 3, + 10, + 2, + 2 + ], + "weighted_loads": [ + 0.11079471930861473, + 0.18291398510336876, + 0.044776417315006256, + 0.8540006298571825, + 0.4992299284785986, + 0.5591964013874531, + 0.2877297196537256, + 0.07410567812621593, + 0.3305113520473242, + 0.3322599455714226, + 0.053839292377233505, + 0.2548133060336113, + 0.24582736566662788, + 0.2346346378326416, + 0.0, + 0.5994786769151688, + 0.06942389532923698, + 0.3350060172379017, + 0.23556942865252495, + 0.33431192860007286, + 0.0, + 0.41646939516067505, + 0.20323296636343002, + 0.6873712092638016, + 0.34731898456811905, + 0.2849526032805443, + 0.2058377619832754, + 0.08619656600058079, + 1.1823117658495903, + 0.18214039131999016, + 1.2924145981669426, + 0.3107152208685875, + 0.038146235048770905, + 0.18232835829257965, + 0.4051728844642639, + 0.1867571547627449, + 0.4855928048491478, + 0.06031915917992592, + 0.4610645230859518, + 0.34919771179556847, + 0.27865175902843475, + 0.23671777732670307, + 0.3081286549568176, + 0.3760021738708019, + 1.2662438601255417, + 0.44682446122169495, + 0.570051196962595, + 0.5399264730513096, + 0.38599261455237865, + 0.8269023634493351, + 1.167070111259818, + 0.2710979748517275, + 0.21576040983200073, + 0.18181818164885044, + 0.178998164832592, + 0.17690067365765572, + 0.12220764346420765, + 0.0, + 0.07719326578080654, + 0.4659032020717859, + 0.08036201260983944, + 0.7207585200667381, + 0.06583399325609207, + 0.10693950206041336 + ], + "unique_experts": 61, + "load_cv": 0.6671595810901378, + "normalized_load_entropy": 0.947680343634803, + "max_load_share": 0.04807692307692308 + }, + "full_input": { + "tokens": 77, + "top_k": 6, + "decisions": 462, + "ordered_route_sha256": "e707dd36a396038be2aabba001c2a98c6aa0d47790bc567efb3974dc9a357603", + "route_weight_sha256": "0fbdd5323dea2e3918c32a846b331d0a1632d182432e164f3a38f2d44158f298", + "loads": [ + 4, + 3, + 3, + 10, + 10, + 5, + 8, + 4, + 24, + 5, + 4, + 7, + 7, + 3, + 0, + 17, + 3, + 9, + 4, + 5, + 3, + 3, + 4, + 8, + 5, + 7, + 20, + 3, + 12, + 3, + 15, + 7, + 2, + 5, + 4, + 5, + 5, + 1, + 8, + 7, + 7, + 15, + 4, + 9, + 15, + 17, + 7, + 6, + 10, + 8, + 16, + 5, + 8, + 3, + 4, + 8, + 7, + 7, + 3, + 19, + 4, + 14, + 2, + 2 + ], + "weighted_loads": [ + 0.1909111998975277, + 0.18291398510336876, + 0.13048849627375603, + 0.8540006298571825, + 0.7697385177016258, + 0.5959936529397964, + 0.34975254349410534, + 0.3259404134005308, + 1.1702896188944578, + 0.35781557857990265, + 0.31500834599137306, + 0.4561164528131485, + 0.24582736566662788, + 0.2346346378326416, + 0.0, + 1.2146136537194252, + 0.06942389532923698, + 0.4433278404176235, + 0.23556942865252495, + 0.33431192860007286, + 0.29125768318772316, + 0.41646939516067505, + 0.23354235850274563, + 0.6873712092638016, + 0.34731898456811905, + 0.46549128368496895, + 1.0150229092687368, + 0.08619656600058079, + 1.1823117658495903, + 0.18214039131999016, + 1.2924145981669426, + 0.7842544838786125, + 0.09987908601760864, + 0.40228329598903656, + 0.4051728844642639, + 0.207972114905715, + 0.4855928048491478, + 0.06031915917992592, + 0.4610645230859518, + 0.5857005715370178, + 0.32088276371359825, + 0.693545276299119, + 0.3081286549568176, + 0.5111922267824411, + 1.2662438601255417, + 1.263134092092514, + 0.6664345599710941, + 0.5399264730513096, + 0.4574511181563139, + 0.8269023634493351, + 1.2777576819062233, + 0.3243525605648756, + 0.46734917536377907, + 0.18181818164885044, + 0.2237617876380682, + 0.7492055483162403, + 0.31440561078488827, + 0.4527139216661453, + 0.07719326578080654, + 1.1793827190995216, + 0.17094984464347363, + 0.9228202812373638, + 0.06583399325609207, + 0.10693950206041336 + ], + "unique_experts": 63, + "load_cv": 0.6971578891418778, + "normalized_load_entropy": 0.9472214333902285, + "max_load_share": 0.05194805194805195 + } + }, + "s1_period": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "beae77086ec533e22b321cf12947b3f9d9791003fd09f89e1899a889d1d8eef4", + "route_weight_sha256": "b6f8658b212919f2c6fbbd3209569a191b2d00cbfe2a3bdf9fd4193baf06a1fb", + "loads": [ + 1, + 3, + 1, + 10, + 5, + 4, + 6, + 2, + 10, + 4, + 1, + 3, + 5, + 3, + 0, + 10, + 3, + 6, + 4, + 5, + 0, + 3, + 3, + 8, + 5, + 3, + 15, + 3, + 12, + 3, + 15, + 3, + 0, + 3, + 4, + 4, + 5, + 1, + 8, + 4, + 6, + 5, + 4, + 3, + 15, + 6, + 6, + 7, + 7, + 8, + 12, + 4, + 4, + 3, + 2, + 4, + 3, + 0, + 3, + 8, + 0, + 10, + 2, + 2 + ], + "weighted_loads": [ + 0.05723528563976288, + 0.18668688088655472, + 0.04240500181913376, + 0.8681988567113876, + 0.48521997407078743, + 0.5341006331145763, + 0.24018317461013794, + 0.07493569701910019, + 0.3239720519632101, + 0.31601962447166443, + 0.026737229898571968, + 0.25968992710113525, + 0.1756686568260193, + 0.20672176033258438, + 0.0, + 0.6741198413074017, + 0.06977624073624611, + 0.25767467357218266, + 0.22517675533890724, + 0.33054840192198753, + 0.0, + 0.4259738177061081, + 0.20372963696718216, + 0.6726841293275356, + 0.33422647789120674, + 0.24992909282445908, + 0.43678779900074005, + 0.08633758127689362, + 1.188524041324854, + 0.18174495175480843, + 1.3193283081054688, + 0.2974604517221451, + 0.0, + 0.15733787789940834, + 0.4050162509083748, + 0.1874338537454605, + 0.4820779152214527, + 0.058147069066762924, + 0.4692845195531845, + 0.34105856344103813, + 0.25820721685886383, + 0.3065105862915516, + 0.2982797473669052, + 0.337646521627903, + 1.3221797607839108, + 0.4125826954841614, + 0.5703928284347057, + 0.6078304275870323, + 0.36958310939371586, + 0.8325112126767635, + 1.1774957608431578, + 0.2698653116822243, + 0.21638496965169907, + 0.18548087775707245, + 0.18193590641021729, + 0.16903960332274437, + 0.09729920886456966, + 0.0, + 0.07675780728459358, + 0.47552305087447166, + 0.0, + 0.7344883847981691, + 0.0642793495208025, + 0.10795027390122414 + ], + "unique_experts": 59, + "load_cv": 0.7435897435897436, + "normalized_load_entropy": 0.9340204019018814, + "max_load_share": 0.04807692307692308 + }, + "full_input": { + "tokens": 93, + "top_k": 6, + "decisions": 558, + "ordered_route_sha256": "b1b2cd3551c6634d5ce9f09d20b6c7cb5f58f85a2c541e59757faca4a96c4783", + "route_weight_sha256": "301907c2d437dc11729792714b9e6ccd9ead9ccb71920cff7cb8b475e5c6ec37", + "loads": [ + 4, + 3, + 4, + 10, + 13, + 7, + 7, + 5, + 31, + 4, + 6, + 8, + 5, + 4, + 0, + 22, + 3, + 12, + 5, + 6, + 3, + 5, + 7, + 9, + 7, + 8, + 35, + 4, + 12, + 5, + 17, + 9, + 1, + 5, + 4, + 4, + 7, + 2, + 8, + 9, + 7, + 19, + 7, + 9, + 16, + 16, + 7, + 9, + 10, + 8, + 21, + 9, + 10, + 3, + 7, + 8, + 12, + 12, + 5, + 18, + 2, + 15, + 2, + 6 + ], + "weighted_loads": [ + 0.2314758189022541, + 0.18668688088655472, + 0.19146113097667694, + 0.8681988567113876, + 0.9885921087116003, + 0.7067881338298321, + 0.2856049984693527, + 0.29120167903602123, + 1.5494399312883615, + 0.31601962447166443, + 0.46983677707612514, + 0.6180656757205725, + 0.1756686568260193, + 0.24659020453691483, + 0.0, + 1.3771620392799377, + 0.06977624073624611, + 0.4933352507650852, + 0.2646707445383072, + 0.3963776119053364, + 0.2319023609161377, + 0.6303101480007172, + 0.4742090720683336, + 0.7072113566100597, + 0.4059715550392866, + 0.458070270717144, + 1.7452066335827112, + 0.12847725674510002, + 1.188524041324854, + 0.343669593334198, + 1.4264127388596535, + 0.9840337261557579, + 0.04932907968759537, + 0.3249337188899517, + 0.4050162509083748, + 0.1874338537454605, + 0.7627628222107887, + 0.091950923204422, + 0.4692845195531845, + 0.6941429190337658, + 0.292275819927454, + 0.9401099514216185, + 0.5057870764285326, + 0.5360015630722046, + 1.474929865449667, + 1.180158481001854, + 0.6663887538015842, + 0.6901312991976738, + 0.5719251539558172, + 0.8325112126767635, + 1.5841255970299244, + 0.6778135374188423, + 0.5414449796080589, + 0.18548087775707245, + 0.29795377887785435, + 0.6993171088397503, + 0.45810090005397797, + 0.699650103226304, + 0.15212352201342583, + 1.111982099711895, + 0.11538875661790371, + 1.0272151920944452, + 0.0642793495208025, + 0.6002361737191677 + ], + "unique_experts": 63, + "load_cv": 0.7439931296081989, + "normalized_load_entropy": 0.9436235398904406, + "max_load_share": 0.06272401433691756 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 52, + "ordered_topk_exact_tokens": 40, + "set_exact_tokens": 42, + "mean_set_jaccard": 0.9368131868131869, + "mean_token_weighted_tv": 0.00993720108929735, + "aggregate_load_tv": 0.028846153846153848 + }, + "system_bos": { + "tokens": 52, + "ordered_topk_exact_tokens": 31, + "set_exact_tokens": 35, + "mean_set_jaccard": 0.9024725274725274, + "mean_token_weighted_tv": 0.015207568667112635, + "aggregate_load_tv": 0.04807692307692308 + }, + "system_x": { + "tokens": 52, + "ordered_topk_exact_tokens": 26, + "set_exact_tokens": 35, + "mean_set_jaccard": 0.9024725274725274, + "mean_token_weighted_tv": 0.016814185306429863, + "aggregate_load_tv": 0.05128205128205127 + }, + "system_period": { + "tokens": 52, + "ordered_topk_exact_tokens": 32, + "set_exact_tokens": 37, + "mean_set_jaccard": 0.9134615384615384, + "mean_token_weighted_tv": 0.015741394528259452, + "aggregate_load_tv": 0.04807692307692307 + }, + "bos_at_s0": { + "tokens": 52, + "ordered_topk_exact_tokens": 24, + "set_exact_tokens": 35, + "mean_set_jaccard": 0.881868131868132, + "mean_token_weighted_tv": 0.025056863526025645, + "aggregate_load_tv": 0.0641025641025641 + }, + "bos_at_s1": { + "tokens": 52, + "ordered_topk_exact_tokens": 22, + "set_exact_tokens": 30, + "mean_set_jaccard": 0.8635531135531136, + "mean_token_weighted_tv": 0.024427411916594092, + "aggregate_load_tv": 0.0673076923076923 + }, + "x_at_s0": { + "tokens": 52, + "ordered_topk_exact_tokens": 29, + "set_exact_tokens": 37, + "mean_set_jaccard": 0.9010989010989012, + "mean_token_weighted_tv": 0.021465777079216562, + "aggregate_load_tv": 0.05769230769230768 + }, + "x_at_s1": { + "tokens": 52, + "ordered_topk_exact_tokens": 21, + "set_exact_tokens": 31, + "mean_set_jaccard": 0.8690476190476191, + "mean_token_weighted_tv": 0.023945752549200103, + "aggregate_load_tv": 0.07371794871794872 + }, + "period_at_s0": { + "tokens": 52, + "ordered_topk_exact_tokens": 30, + "set_exact_tokens": 37, + "mean_set_jaccard": 0.9010989010989012, + "mean_token_weighted_tv": 0.020891025823612627, + "aggregate_load_tv": 0.05769230769230768 + }, + "period_at_s1": { + "tokens": 52, + "ordered_topk_exact_tokens": 23, + "set_exact_tokens": 32, + "mean_set_jaccard": 0.8745421245421247, + "mean_token_weighted_tv": 0.02314003134289613, + "aggregate_load_tv": 0.06730769230769232 + } + } + }, + "layer_02": { + "layer": 2, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "e3e95d98fd9d17f7235a4622cc2781c19e46d17e43037504650976ce9869edc5", + "route_weight_sha256": "0ec3a0b4d4b651fe3a1df726d6e662ec64fd2e22e31b7247887929a6d5b988ce", + "loads": [ + 6, + 3, + 10, + 3, + 4, + 5, + 9, + 4, + 5, + 2, + 8, + 9, + 2, + 8, + 4, + 9, + 6, + 3, + 3, + 4, + 4, + 4, + 5, + 5, + 2, + 2, + 2, + 4, + 6, + 10, + 3, + 5, + 2, + 10, + 2, + 8, + 5, + 1, + 6, + 1, + 5, + 10, + 2, + 7, + 4, + 10, + 4, + 7, + 10, + 7, + 10, + 1, + 3, + 1, + 3, + 3, + 7, + 2, + 2, + 2, + 9, + 3, + 1, + 5 + ], + "weighted_loads": [ + 0.7187405005097389, + 0.21712307259440422, + 1.677410401403904, + 0.1631111390888691, + 0.2718115895986557, + 0.35201772302389145, + 0.7013223096728325, + 0.18003037199378014, + 0.3011615313589573, + 0.25073783099651337, + 0.545417707413435, + 0.8776294812560081, + 0.05668115243315697, + 0.5908506996929646, + 0.14309183694422245, + 0.7194550167769194, + 0.277517382055521, + 0.39114563912153244, + 0.5080713257193565, + 0.19304915703833103, + 0.2890786826610565, + 0.30905163660645485, + 0.707755021750927, + 0.992186289280653, + 0.24477427452802658, + 0.12292364984750748, + 0.0993647500872612, + 0.2585507109761238, + 0.4362092409282923, + 0.8033670522272587, + 0.23542348481714725, + 0.30260466411709785, + 0.08928404748439789, + 0.3761180341243744, + 0.2114679031074047, + 0.49438081681728363, + 0.29913002997636795, + 0.05688243731856346, + 0.5519107021391392, + 0.09167544543743134, + 0.16671580262482166, + 0.80964145809412, + 0.10566872358322144, + 0.8226210903376341, + 0.24631449580192566, + 0.7524697706103325, + 0.21717333048582077, + 0.7151311449706554, + 1.5355450101196766, + 0.4398487601429224, + 0.837190231308341, + 0.025718839839100838, + 0.20879211649298668, + 0.034550707787275314, + 0.11795492097735405, + 0.17148233577609062, + 0.5244811214506626, + 0.07548443228006363, + 0.20858392119407654, + 0.32665346562862396, + 0.9590028077363968, + 0.4228045716881752, + 0.04593782499432564, + 0.30904581397771835 + ], + "unique_experts": 64, + "load_cv": 0.578487906291204, + "normalized_load_entropy": 0.9594428827142609, + "max_load_share": 0.03205128205128205 + }, + "full_input": { + "tokens": 77, + "top_k": 6, + "decisions": 462, + "ordered_route_sha256": "5f07227923bd491615f3568c80a5ad357844a154aa92fd5ef8af0f51bac14355", + "route_weight_sha256": "bd9eb43925f00b07e639424f22e02d566b811d7104e8429939a7f5cfdea6ab2f", + "loads": [ + 6, + 13, + 10, + 5, + 4, + 5, + 9, + 6, + 8, + 2, + 11, + 9, + 2, + 9, + 13, + 9, + 6, + 4, + 4, + 8, + 6, + 13, + 5, + 5, + 5, + 2, + 3, + 6, + 8, + 10, + 3, + 6, + 2, + 10, + 7, + 23, + 5, + 1, + 10, + 1, + 5, + 10, + 9, + 7, + 4, + 10, + 6, + 11, + 11, + 7, + 10, + 7, + 3, + 2, + 3, + 3, + 7, + 10, + 10, + 7, + 19, + 7, + 6, + 14 + ], + "weighted_loads": [ + 0.7187405005097389, + 1.1610137671232224, + 1.677410401403904, + 1.8605423457920551, + 0.2718115895986557, + 0.35201772302389145, + 0.7013223096728325, + 0.35914895310997963, + 0.5442921444773674, + 0.25073783099651337, + 0.6716112233698368, + 0.8776294812560081, + 0.05668115243315697, + 0.6145205646753311, + 0.5218156594783068, + 0.7194550167769194, + 0.277517382055521, + 0.39184135873802006, + 0.5096546622226015, + 0.9516032878309488, + 0.6006749123334885, + 1.0029709339141846, + 0.707755021750927, + 0.992186289280653, + 0.4011112302541733, + 0.12292364984750748, + 0.10020772169809788, + 0.5306635946035385, + 0.643609682098031, + 0.8033670522272587, + 0.23542348481714725, + 0.3032983272569254, + 0.08928404748439789, + 0.3761180341243744, + 0.43525807932019234, + 2.454877885989845, + 0.29913002997636795, + 0.05688243731856346, + 0.6740257740020752, + 0.09167544543743134, + 0.16671580262482166, + 0.80964145809412, + 0.879446305334568, + 0.8226210903376341, + 0.24631449580192566, + 0.7524697706103325, + 0.28381077386438847, + 0.9772376716136932, + 1.561195407062769, + 0.4398487601429224, + 0.837190231308341, + 0.6370449457317591, + 0.20879211649298668, + 0.035863446770235896, + 0.11795492097735405, + 0.17148233577609062, + 0.5244811214506626, + 0.49862635508179665, + 0.5725732110440731, + 0.5256381090730429, + 1.7862163176760077, + 0.6350143067538738, + 0.4522993825376034, + 0.845724668353796 + ], + "unique_experts": 64, + "load_cv": 0.5624208037341831, + "normalized_load_entropy": 0.9634464222244082, + "max_load_share": 0.049783549783549784 + } + }, + "s1_eos": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "32facc6236021cc79c95fc3d39d4575985d16075b644cd34adde501b7797473b", + "route_weight_sha256": "2ec7a218a7a0ecb34d15ae4aba046fe0e019c8c0c5bd72cb711cd7499b02592d", + "loads": [ + 6, + 4, + 10, + 3, + 4, + 5, + 9, + 3, + 5, + 2, + 8, + 9, + 2, + 6, + 3, + 9, + 6, + 3, + 3, + 3, + 4, + 4, + 5, + 6, + 2, + 2, + 2, + 4, + 6, + 10, + 3, + 5, + 2, + 9, + 2, + 8, + 5, + 1, + 5, + 1, + 6, + 10, + 3, + 7, + 4, + 10, + 4, + 7, + 10, + 7, + 12, + 1, + 4, + 1, + 3, + 3, + 7, + 1, + 2, + 2, + 9, + 3, + 1, + 6 + ], + "weighted_loads": [ + 0.7324301414191723, + 0.23297289945185184, + 1.6887881439179182, + 0.163657383993268, + 0.27319253236055374, + 0.3609369657933712, + 0.6885210759937763, + 0.14746141619980335, + 0.30725930631160736, + 0.25303834676742554, + 0.5496133752167225, + 0.8865750320255756, + 0.057345468550920486, + 0.5213024690747261, + 0.09901420213282108, + 0.7325769551098347, + 0.2833496332168579, + 0.37895066291093826, + 0.5167580880224705, + 0.1675349399447441, + 0.29363133385777473, + 0.3041459582746029, + 0.6890461258590221, + 1.0080252699553967, + 0.23947783559560776, + 0.12185299955308437, + 0.10097522288560867, + 0.25933021306991577, + 0.42538174614310265, + 0.8121126629412174, + 0.23563138768076897, + 0.3006781302392483, + 0.08748723566532135, + 0.34220005944371223, + 0.20865072682499886, + 0.4838731847703457, + 0.2993253283202648, + 0.0566176138818264, + 0.5028694644570351, + 0.08930372446775436, + 0.20837510377168655, + 0.8225348126143217, + 0.14550595358014107, + 0.8286823015660048, + 0.2490195855498314, + 0.7420629486441612, + 0.22455907613039017, + 0.7055287584662437, + 1.556986566632986, + 0.4302539397031069, + 0.9125637486577034, + 0.02517106384038925, + 0.241131704300642, + 0.032544706016778946, + 0.12053520604968071, + 0.17328114062547684, + 0.5139949768781662, + 0.05345332995057106, + 0.20644207298755646, + 0.341554656624794, + 0.9579927194863558, + 0.4170495867729187, + 0.04278501123189926, + 0.3514512926340103 + ], + "unique_experts": 64, + "load_cv": 0.5863895705656037, + "normalized_load_entropy": 0.9584118291927218, + "max_load_share": 0.038461538461538464 + }, + "full_input": { + "tokens": 93, + "top_k": 6, + "decisions": 558, + "ordered_route_sha256": "fea3f6f5e36b65b3a4243e054e9cf5910037463eeaf3430da3a3f41985012439", + "route_weight_sha256": "d7bafdd3a6994699a43b0d8bec5d7e60c6eab76eabbc67ae2958eec5b5084a93", + "loads": [ + 10, + 15, + 11, + 6, + 5, + 6, + 9, + 7, + 14, + 3, + 15, + 9, + 2, + 9, + 15, + 10, + 8, + 4, + 4, + 9, + 6, + 15, + 6, + 6, + 8, + 3, + 3, + 7, + 10, + 10, + 4, + 7, + 2, + 9, + 11, + 25, + 5, + 2, + 10, + 4, + 6, + 10, + 13, + 8, + 7, + 10, + 12, + 14, + 12, + 8, + 13, + 10, + 5, + 5, + 3, + 3, + 12, + 8, + 4, + 12, + 19, + 10, + 11, + 19 + ], + "weighted_loads": [ + 1.2528172433376312, + 1.238521484658122, + 1.7142112161964178, + 1.8953881468623877, + 0.3035116195678711, + 0.5017316900193691, + 0.6885210759937763, + 0.3927853051573038, + 1.0871461667120457, + 0.3701857328414917, + 0.8545022234320641, + 0.8865750320255756, + 0.057345468550920486, + 0.5698651783168316, + 0.7033991105854511, + 0.7646645605564117, + 0.34727735817432404, + 0.3795346491388045, + 0.5181389807257801, + 0.9644977822899818, + 0.5826552845537663, + 1.0962198544293642, + 0.7277295216917992, + 1.0080252699553967, + 0.5194920748472214, + 0.17204842530190945, + 0.10180038399994373, + 0.925192579627037, + 0.64418207667768, + 0.8121126629412174, + 0.26942040398716927, + 0.3435365706682205, + 0.08748723566532135, + 0.34220005944371223, + 0.5766521636396646, + 2.2179268142208457, + 0.2993253283202648, + 0.09821624308824539, + 0.6651778351515532, + 0.4456266164779663, + 0.20837510377168655, + 0.8225348126143217, + 1.370545756071806, + 1.0105019491165876, + 0.8940593227744102, + 0.7420629486441612, + 0.8732625804841518, + 1.0876253359019756, + 1.625726567581296, + 0.47383072413504124, + 0.9389571845531464, + 0.9164543747901917, + 0.4176870845258236, + 0.21670333482325077, + 0.12053520604968071, + 0.17328114062547684, + 0.7965671084821224, + 0.370165441185236, + 0.31720535084605217, + 0.7887921202927828, + 1.6318935165181756, + 0.9010244160890579, + 0.8923869542777538, + 1.2897744718939066 + ], + "unique_experts": 64, + "load_cv": 0.5218593682115242, + "normalized_load_entropy": 0.9679731335762001, + "max_load_share": 0.044802867383512544 + } + }, + "s0_bos": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "cf221a079755c87651b1d5a0931445afaa54ecbf6678ec96a489eb6ce3974961", + "route_weight_sha256": "203177c6748a4f34b97139163a23e0af45895e58d17fdd8f7695ab6b2f3b2b83", + "loads": [ + 6, + 3, + 11, + 4, + 4, + 5, + 8, + 3, + 5, + 2, + 9, + 8, + 1, + 7, + 5, + 9, + 6, + 3, + 3, + 4, + 4, + 3, + 5, + 7, + 2, + 2, + 2, + 4, + 9, + 10, + 2, + 6, + 1, + 8, + 2, + 7, + 6, + 1, + 6, + 2, + 3, + 10, + 4, + 7, + 3, + 10, + 4, + 7, + 10, + 5, + 10, + 0, + 3, + 1, + 2, + 3, + 7, + 3, + 2, + 3, + 10, + 3, + 1, + 6 + ], + "weighted_loads": [ + 0.7973758280277252, + 0.23732588440179825, + 1.6706779580563307, + 0.20796993002295494, + 0.2619238905608654, + 0.33709364756941795, + 0.6389805786311626, + 0.1651347205042839, + 0.2999699078500271, + 0.2524316906929016, + 0.5715161021798849, + 0.8292793035507202, + 0.025129172950983047, + 0.4949101284146309, + 0.17285358346998692, + 0.7254265286028385, + 0.29573720321059227, + 0.39708373695611954, + 0.470860131084919, + 0.19285931810736656, + 0.29767901077866554, + 0.26463547721505165, + 0.7150388322770596, + 1.0811628960072994, + 0.2480853721499443, + 0.15399996936321259, + 0.10662725940346718, + 0.22828491032123566, + 0.5560168512165546, + 0.8248572498559952, + 0.18930606357753277, + 0.3555871844291687, + 0.04588860645890236, + 0.3140120282769203, + 0.20548541471362114, + 0.5047642886638641, + 0.36514559388160706, + 0.06449763476848602, + 0.5417341254651546, + 0.10153230279684067, + 0.108710503205657, + 0.7963286675512791, + 0.19367682188749313, + 0.7835903447121382, + 0.213089469820261, + 0.7971566095948219, + 0.24691467732191086, + 0.6969051398336887, + 1.617309331893921, + 0.3623092770576477, + 0.8608873039484024, + 0.0, + 0.20947518199682236, + 0.0399102158844471, + 0.07409377582371235, + 0.16754049062728882, + 0.510771319270134, + 0.10735055059194565, + 0.18600378185510635, + 0.35092173516750336, + 1.019548075273633, + 0.40403228998184204, + 0.050089966505765915, + 0.3624341059476137 + ], + "unique_experts": 63, + "load_cv": 0.5908573652206622, + "normalized_load_entropy": 0.9562038860028315, + "max_load_share": 0.035256410256410256 + }, + "full_input": { + "tokens": 77, + "top_k": 6, + "decisions": 462, + "ordered_route_sha256": "77c8b3618cb05064f54630e7d4a0c500f3c1098440b569944498b4e6596f7573", + "route_weight_sha256": "d1c5604dc4a8af2face5b65175bb65c7d9e3c1a0bbb8dca24b7533a4fb7b29ce", + "loads": [ + 6, + 13, + 11, + 5, + 4, + 5, + 8, + 5, + 8, + 2, + 12, + 8, + 2, + 8, + 10, + 9, + 7, + 3, + 3, + 8, + 6, + 12, + 5, + 7, + 4, + 2, + 2, + 6, + 12, + 10, + 2, + 6, + 1, + 8, + 7, + 23, + 6, + 1, + 11, + 2, + 3, + 10, + 12, + 7, + 3, + 10, + 6, + 11, + 11, + 5, + 10, + 7, + 3, + 1, + 2, + 3, + 7, + 12, + 10, + 8, + 21, + 7, + 7, + 16 + ], + "weighted_loads": [ + 0.7973758280277252, + 1.1812165789306164, + 1.6706779580563307, + 0.9324990175664425, + 0.2619238905608654, + 0.33709364756941795, + 0.6389805786311626, + 0.3226441368460655, + 0.5466012805700302, + 0.2524316906929016, + 0.6977096181362867, + 0.8292793035507202, + 0.05705122649669647, + 0.5205904021859169, + 0.38962386175990105, + 0.7254265286028385, + 0.3255899380892515, + 0.39708373695611954, + 0.470860131084919, + 0.9043394736945629, + 0.5880577452480793, + 0.9693901278078556, + 0.7150388322770596, + 1.0811628960072994, + 0.3623647205531597, + 0.15399996936321259, + 0.10662725940346718, + 0.5042453929781914, + 0.8427876979112625, + 0.8248572498559952, + 0.18930606357753277, + 0.3555871844291687, + 0.04588860645890236, + 0.3140120282769203, + 0.42927559092640877, + 2.547062545083463, + 0.36514559388160706, + 0.06449763476848602, + 0.7495192736387253, + 0.10153230279684067, + 0.108710503205657, + 0.7963286675512791, + 0.9991576336324215, + 0.7835903447121382, + 0.213089469820261, + 0.7971566095948219, + 0.31355212070047855, + 0.9557376876473427, + 1.6429597288370132, + 0.3623092770576477, + 0.8608873039484024, + 0.6816014982759953, + 0.20947518199682236, + 0.0399102158844471, + 0.07409377582371235, + 0.16754049062728882, + 0.510771319270134, + 0.5471518188714981, + 0.5499930717051029, + 0.5473776161670685, + 1.8819874385371804, + 0.6034400574862957, + 0.542118139564991, + 1.162644987925887 + ], + "unique_experts": 64, + "load_cv": 0.6104817099164098, + "normalized_load_entropy": 0.95639103351906, + "max_load_share": 0.049783549783549784 + } + }, + "s1_bos": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "9894fa9ce088c7d925848617522b5863d42ee704f964c963c5a57d059a881ce3", + "route_weight_sha256": "6b88330a86e27598589e5492c7a30abe5c2d2f069a2075717f65b2748cdc782a", + "loads": [ + 6, + 3, + 10, + 4, + 4, + 5, + 8, + 3, + 5, + 2, + 10, + 9, + 2, + 7, + 2, + 9, + 6, + 3, + 3, + 3, + 4, + 4, + 5, + 7, + 2, + 2, + 2, + 4, + 10, + 10, + 2, + 5, + 2, + 8, + 3, + 8, + 5, + 1, + 6, + 1, + 6, + 10, + 4, + 7, + 3, + 10, + 4, + 7, + 10, + 5, + 10, + 0, + 3, + 1, + 2, + 3, + 7, + 1, + 2, + 2, + 9, + 3, + 1, + 7 + ], + "weighted_loads": [ + 0.8085912577807903, + 0.23633889853954315, + 1.6728232111781836, + 0.20734953880310059, + 0.2614969462156296, + 0.3528328128159046, + 0.6260579563677311, + 0.1582677699625492, + 0.32711952552199364, + 0.2517217919230461, + 0.6397199537605047, + 0.8790570087730885, + 0.05867266282439232, + 0.4890349842607975, + 0.07519926503300667, + 0.7509746812283993, + 0.29929523542523384, + 0.3940785601735115, + 0.47637632489204407, + 0.16320474073290825, + 0.29787439852952957, + 0.30789195373654366, + 0.7387728542089462, + 1.0573581233620644, + 0.24391748756170273, + 0.15506397187709808, + 0.10144178941845894, + 0.23446698859333992, + 0.5660540461540222, + 0.8251910880208015, + 0.19567192159593105, + 0.3248040936887264, + 0.06784083694219589, + 0.31260113045573235, + 0.2334161289036274, + 0.5214232448488474, + 0.3383818343281746, + 0.06075812876224518, + 0.5173477903008461, + 0.07526522129774094, + 0.20842932164669037, + 0.820001557469368, + 0.18675648793578148, + 0.7894156388938427, + 0.2276858501136303, + 0.7878120914101601, + 0.2620588168501854, + 0.6891854666173458, + 1.6414363160729408, + 0.3524098973721266, + 0.8607407622039318, + 0.0, + 0.20118412375450134, + 0.0399860218167305, + 0.07835624553263187, + 0.16761668771505356, + 0.4872417878359556, + 0.049969833344221115, + 0.1828797459602356, + 0.35662950575351715, + 0.9474374633282423, + 0.37729670107364655, + 0.03919471055269241, + 0.39087638817727566 + ], + "unique_experts": 63, + "load_cv": 0.6029731290412742, + "normalized_load_entropy": 0.9543528552580702, + "max_load_share": 0.03205128205128205 + }, + "full_input": { + "tokens": 93, + "top_k": 6, + "decisions": 558, + "ordered_route_sha256": "b18f4da1340fe8c66cd1dbb57be1d856b0c16913ea7fe680feee5463d470a5a6", + "route_weight_sha256": "f411aa04d6809f686f33772ad70a564c920f3eba7643fa01dfa3a54d7d1b8fb0", + "loads": [ + 10, + 14, + 11, + 7, + 5, + 6, + 8, + 7, + 14, + 3, + 17, + 9, + 3, + 9, + 11, + 10, + 9, + 3, + 3, + 9, + 6, + 15, + 6, + 7, + 7, + 3, + 2, + 7, + 16, + 10, + 3, + 7, + 2, + 8, + 12, + 26, + 5, + 2, + 12, + 4, + 6, + 10, + 15, + 8, + 6, + 10, + 12, + 14, + 12, + 6, + 11, + 9, + 4, + 4, + 2, + 3, + 12, + 7, + 4, + 12, + 20, + 10, + 12, + 21 + ], + "weighted_loads": [ + 1.3289783596992493, + 1.2418874837458134, + 1.6982462834566832, + 0.9962122179567814, + 0.29181603342294693, + 0.49362753704190254, + 0.6260579563677311, + 0.3800297863781452, + 1.1314960047602654, + 0.3688691779971123, + 0.9446088019758463, + 0.8790570087730885, + 0.08627184852957726, + 0.5401483681052923, + 0.5507582444697618, + 0.7830622866749763, + 0.3919081278145313, + 0.3940785601735115, + 0.47637632489204407, + 0.8981344364583492, + 0.5740693584084511, + 1.1230095494538546, + 0.7774562500417233, + 1.0573581233620644, + 0.48926158994436264, + 0.20525939762592316, + 0.10144178941845894, + 0.9124309308826923, + 0.8795305266976357, + 0.8251910880208015, + 0.22946093790233135, + 0.36766253411769867, + 0.06784083694219589, + 0.31260113045573235, + 0.6014175657182932, + 2.3570506842806935, + 0.3383818343281746, + 0.10235675796866417, + 0.7866048980504274, + 0.4315881133079529, + 0.20842932164669037, + 0.820001557469368, + 1.437512457370758, + 0.9712352864444256, + 0.8727255873382092, + 0.7878120914101601, + 0.9178083688020706, + 1.0688675045967102, + 1.7101763170212507, + 0.39598668180406094, + 0.8871341980993748, + 0.9659257382154465, + 0.3777395039796829, + 0.22305652871727943, + 0.07835624553263187, + 0.16761668771505356, + 0.7698139194399118, + 0.3098577484488487, + 0.2936430238187313, + 0.8041643891483545, + 1.6552066588774323, + 0.8628669753670692, + 0.9802792556583881, + 1.5366935580968857 + ], + "unique_experts": 64, + "load_cv": 0.565343309314093, + "normalized_load_entropy": 0.9627794503442145, + "max_load_share": 0.04659498207885305 + } + }, + "s0_x": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "cff64fc0d0edec28588cf36812cabe32520759697a472cd1a480c96baead6dbc", + "route_weight_sha256": "9a73928b05bce7b20a4cbe6ebd06e53facf9ae9525b03e7c84a53bc3c39616c6", + "loads": [ + 6, + 3, + 10, + 4, + 4, + 5, + 9, + 3, + 5, + 2, + 9, + 9, + 1, + 7, + 6, + 9, + 6, + 3, + 3, + 2, + 4, + 3, + 5, + 6, + 2, + 2, + 2, + 4, + 9, + 10, + 2, + 6, + 2, + 8, + 2, + 8, + 6, + 1, + 5, + 1, + 4, + 10, + 4, + 6, + 3, + 10, + 4, + 7, + 10, + 6, + 10, + 1, + 3, + 1, + 2, + 3, + 7, + 2, + 2, + 2, + 10, + 3, + 2, + 6 + ], + "weighted_loads": [ + 0.8175782822072506, + 0.21992959827184677, + 1.634214747697115, + 0.20615408942103386, + 0.2593989744782448, + 0.3312976621091366, + 0.6594668999314308, + 0.1596379317343235, + 0.3176135681569576, + 0.25506874173879623, + 0.5565604064613581, + 0.8559114225208759, + 0.025631936267018318, + 0.5042364820837975, + 0.1983943898230791, + 0.7304339595139027, + 0.2934790626168251, + 0.40857598185539246, + 0.4636021591722965, + 0.13056690618395805, + 0.2999633848667145, + 0.2615298144519329, + 0.7053790464997292, + 1.0474479161202908, + 0.24538470059633255, + 0.15064390003681183, + 0.10463124513626099, + 0.23770324513316154, + 0.5578377060592175, + 0.7997548654675484, + 0.20059661753475666, + 0.347944188863039, + 0.08169774897396564, + 0.3138463497161865, + 0.20131932944059372, + 0.5553467068821192, + 0.36149824410676956, + 0.059983037412166595, + 0.4719731844961643, + 0.08824019879102707, + 0.13433021493256092, + 0.7931067701429129, + 0.19159618951380253, + 0.7582024969160557, + 0.19828926771879196, + 0.7999165803194046, + 0.2519191540777683, + 0.6909716539084911, + 1.5985377728939056, + 0.3938590530306101, + 0.8540193792432547, + 0.02172555774450302, + 0.21746331825852394, + 0.03869340568780899, + 0.07391229271888733, + 0.16807304322719574, + 0.5108587667346001, + 0.07920368388295174, + 0.1809779554605484, + 0.30953124165534973, + 1.0253366958349943, + 0.40912844985723495, + 0.08343667909502983, + 0.35810541175305843 + ], + "unique_experts": 64, + "load_cv": 0.5919690451597537, + "normalized_load_entropy": 0.9573124587385853, + "max_load_share": 0.03205128205128205 + }, + "full_input": { + "tokens": 77, + "top_k": 6, + "decisions": 462, + "ordered_route_sha256": "5b2c8aebfdf88909a66591714f07276e4ca10662e161078c7fbc8dc1689c9d20", + "route_weight_sha256": "f746c4cde8db0f7314bdc4203fc5afd2716366121c075af76a847ebd61d31a4f", + "loads": [ + 6, + 13, + 10, + 5, + 4, + 5, + 10, + 5, + 8, + 2, + 14, + 10, + 2, + 8, + 10, + 9, + 7, + 3, + 3, + 6, + 6, + 13, + 5, + 6, + 4, + 2, + 2, + 6, + 12, + 10, + 2, + 6, + 2, + 8, + 7, + 23, + 6, + 1, + 9, + 1, + 4, + 10, + 11, + 6, + 3, + 10, + 6, + 12, + 11, + 6, + 10, + 7, + 3, + 1, + 2, + 4, + 7, + 9, + 11, + 7, + 22, + 7, + 7, + 15 + ], + "weighted_loads": [ + 0.8175782822072506, + 1.163820292800665, + 1.634214747697115, + 0.9306831769645214, + 0.2593989744782448, + 0.3312976621091366, + 0.6943050213158131, + 0.3224937729537487, + 0.5694314017891884, + 0.25506874173879623, + 0.7913938146084547, + 0.8911988995969296, + 0.0555419921875, + 0.5307672787457705, + 0.3967138174921274, + 0.7304339595139027, + 0.324424734339118, + 0.40857598185539246, + 0.4636021591722965, + 0.8544496856629848, + 0.6008222103118896, + 1.2634028308093548, + 0.7053790464997292, + 1.0474479161202908, + 0.35541561618447304, + 0.15064390003681183, + 0.10463124513626099, + 0.5158523358404636, + 0.8456622008234262, + 0.7997548654675484, + 0.20059661753475666, + 0.347944188863039, + 0.08169774897396564, + 0.3138463497161865, + 0.42510950565338135, + 2.5442666830495, + 0.36149824410676956, + 0.059983037412166595, + 0.5942841470241547, + 0.08824019879102707, + 0.13433021493256092, + 0.7931067701429129, + 0.9149471651762724, + 0.7582024969160557, + 0.19828926771879196, + 0.7999165803194046, + 0.318556597456336, + 0.9866183884441853, + 1.624188169836998, + 0.3938590530306101, + 0.8540193792432547, + 0.6196825131773949, + 0.21746331825852394, + 0.03869340568780899, + 0.07391229271888733, + 0.18615618161857128, + 0.5108587667346001, + 0.4425908215343952, + 0.6736582927405834, + 0.5146483033895493, + 1.9392187492921948, + 0.6134506575763226, + 0.5234885886311531, + 0.8485763166099787 + ], + "unique_experts": 64, + "load_cv": 0.6139102055855596, + "normalized_load_entropy": 0.9565591835597118, + "max_load_share": 0.049783549783549784 + } + }, + "s1_x": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "d85c041a1157c1b488b8078e31ea0a11d968d9fc0470346438f0aaf23d68e975", + "route_weight_sha256": "348b410d7e1188d0a55a1e4dd7425f9c62fb7b2d8f97d5c8d0c9e008b5a91841", + "loads": [ + 6, + 3, + 10, + 4, + 4, + 5, + 8, + 3, + 5, + 2, + 9, + 9, + 2, + 7, + 3, + 9, + 6, + 3, + 3, + 2, + 3, + 4, + 5, + 7, + 2, + 2, + 2, + 4, + 9, + 10, + 2, + 7, + 3, + 8, + 3, + 8, + 7, + 1, + 5, + 1, + 6, + 10, + 4, + 6, + 3, + 10, + 5, + 7, + 10, + 5, + 10, + 0, + 3, + 1, + 2, + 3, + 7, + 1, + 2, + 2, + 10, + 3, + 1, + 5 + ], + "weighted_loads": [ + 0.8375623896718025, + 0.22641504183411598, + 1.6718994155526161, + 0.20652620121836662, + 0.259633332490921, + 0.3539094217121601, + 0.6027301363646984, + 0.16333366930484772, + 0.33007995784282684, + 0.2552908658981323, + 0.599592050537467, + 0.8833284862339497, + 0.0579033475369215, + 0.4775053672492504, + 0.10729609057307243, + 0.7676116712391376, + 0.2914353013038635, + 0.39156118780374527, + 0.46724118664860725, + 0.13357988744974136, + 0.2620849460363388, + 0.30113623291254044, + 0.7367863841354847, + 1.0439641643315554, + 0.2398575097322464, + 0.15785720571875572, + 0.1026327908039093, + 0.23509661853313446, + 0.5300373528152704, + 0.8083111681044102, + 0.1978192050009966, + 0.3856696914881468, + 0.1044606976211071, + 0.30920879542827606, + 0.22732012160122395, + 0.5612058732658625, + 0.384229039773345, + 0.05821510776877403, + 0.44587281346321106, + 0.07673216611146927, + 0.20972375571727753, + 0.8160626571625471, + 0.18757917173206806, + 0.7654116675257683, + 0.22026633098721504, + 0.7794617228209972, + 0.3049301430583, + 0.6938169077038765, + 1.629554234445095, + 0.3489605691283941, + 0.8471050225198269, + 0.0, + 0.20126623287796974, + 0.03855405002832413, + 0.07842167839407921, + 0.16659298166632652, + 0.48620185256004333, + 0.04978509247303009, + 0.18159906566143036, + 0.34339578449726105, + 0.9777330551296473, + 0.36934948712587357, + 0.0329480804502964, + 0.32923460006713867 + ], + "unique_experts": 63, + "load_cv": 0.5963950435698978, + "normalized_load_entropy": 0.9551918191774769, + "max_load_share": 0.03205128205128205 + }, + "full_input": { + "tokens": 93, + "top_k": 6, + "decisions": 558, + "ordered_route_sha256": "6d008ee3e58bc8a722b71a713d7b39df46b8cba5103643da27342aa1b68e9a20", + "route_weight_sha256": "c629236ffc1a28ee6ad1b87e4db25359bebec27a51c37b313e104ed6356a0d7e", + "loads": [ + 10, + 14, + 11, + 6, + 5, + 6, + 8, + 7, + 14, + 3, + 18, + 10, + 3, + 9, + 11, + 10, + 9, + 3, + 3, + 8, + 5, + 16, + 6, + 7, + 7, + 3, + 2, + 7, + 14, + 10, + 3, + 9, + 3, + 8, + 12, + 26, + 7, + 2, + 10, + 4, + 6, + 10, + 14, + 7, + 6, + 10, + 13, + 15, + 12, + 6, + 11, + 8, + 4, + 4, + 2, + 4, + 12, + 7, + 5, + 12, + 22, + 10, + 11, + 18 + ], + "weighted_loads": [ + 1.3579494915902615, + 1.2319636270403862, + 1.6973224878311157, + 0.9627925008535385, + 0.2899524196982384, + 0.49470414593815804, + 0.6027301363646984, + 0.382113441824913, + 1.1303896270692348, + 0.3724382519721985, + 1.0185123588889837, + 0.9180398397147655, + 0.08420854806900024, + 0.5292992144823074, + 0.5515036769211292, + 0.7996992766857147, + 0.3893514722585678, + 0.39156118780374527, + 0.46724118664860725, + 0.8750360533595085, + 0.5389022827148438, + 1.4001209493726492, + 0.7754697799682617, + 1.0439641643315554, + 0.4824438653886318, + 0.2080526314675808, + 0.1026327908039093, + 0.9193038493394852, + 0.8286399934440851, + 0.8083111681044102, + 0.2316082213073969, + 0.428528131917119, + 0.1044606976211071, + 0.30920879542827606, + 0.5953215584158897, + 2.36326811183244, + 0.384229039773345, + 0.09981373697519302, + 0.597835248336196, + 0.4330550581216812, + 0.20972375571727753, + 0.8160626571625471, + 1.3766312543302774, + 0.9472313150763512, + 0.8653060682117939, + 0.7794617228209972, + 0.9602098315954208, + 1.1060648169368505, + 1.698294235393405, + 0.3925373535603285, + 0.8734984584152699, + 0.8893232457339764, + 0.3778216131031513, + 0.22162455692887306, + 0.07842167839407921, + 0.1854211762547493, + 0.7687739841639996, + 0.30843671038746834, + 0.3983534760773182, + 0.7935608699917793, + 1.7320636035874486, + 0.8569956794381142, + 0.9192465916275978, + 1.2036594189703465 + ], + "unique_experts": 64, + "load_cv": 0.5569182040003672, + "normalized_load_entropy": 0.9643174802067085, + "max_load_share": 0.04659498207885305 + } + }, + "s0_period": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "c0a451592768459d87b3903ea4a5cddbe3ccf94e3eb0e7b9d72ba045b61cf416", + "route_weight_sha256": "a7164c81e0cd6d488c5bc6a90ae6128b731f55a94396982d8f091fbd92fc762c", + "loads": [ + 6, + 3, + 11, + 4, + 4, + 5, + 8, + 3, + 5, + 2, + 9, + 8, + 2, + 7, + 4, + 9, + 6, + 3, + 3, + 3, + 4, + 3, + 5, + 6, + 2, + 2, + 2, + 4, + 9, + 10, + 2, + 5, + 2, + 8, + 2, + 7, + 7, + 1, + 5, + 1, + 5, + 10, + 4, + 6, + 3, + 10, + 4, + 7, + 10, + 6, + 10, + 1, + 3, + 1, + 2, + 3, + 7, + 2, + 2, + 2, + 11, + 3, + 2, + 6 + ], + "weighted_loads": [ + 0.8188558220863342, + 0.21277880668640137, + 1.6716247275471687, + 0.2069910354912281, + 0.25920119136571884, + 0.33434512093663216, + 0.6183573789894581, + 0.1595456264913082, + 0.312309205532074, + 0.2569716051220894, + 0.5547502227127552, + 0.8222459740936756, + 0.05654456280171871, + 0.5111667737364769, + 0.14709244295954704, + 0.7321002371609211, + 0.2944531701505184, + 0.4066573902964592, + 0.4660008139908314, + 0.15353897958993912, + 0.2972126379609108, + 0.2552534490823746, + 0.7022098451852798, + 1.0524997375905514, + 0.2469281405210495, + 0.1475798897445202, + 0.10366332903504372, + 0.23707900196313858, + 0.5549112483859062, + 0.7853485345840454, + 0.2000568900257349, + 0.3133687265217304, + 0.08406956493854523, + 0.31592685729265213, + 0.20214176550507545, + 0.5181325785815716, + 0.3835028875619173, + 0.05994280427694321, + 0.4663940295577049, + 0.08812566846609116, + 0.16880825720727444, + 0.7931208088994026, + 0.1959429495036602, + 0.7608826719224453, + 0.19892976060509682, + 0.7962398454546928, + 0.25094185769557953, + 0.6843687705695629, + 1.6026108302175999, + 0.39479247480630875, + 0.8547717239707708, + 0.021645279601216316, + 0.2161574736237526, + 0.04007165506482124, + 0.07438665442168713, + 0.16810452565550804, + 0.5119040869176388, + 0.07902250252664089, + 0.17889271676540375, + 0.3108307421207428, + 1.060381818562746, + 0.42046304047107697, + 0.0829373151063919, + 0.3522817026823759 + ], + "unique_experts": 64, + "load_cv": 0.587509704481518, + "normalized_load_entropy": 0.9587237322251373, + "max_load_share": 0.035256410256410256 + }, + "full_input": { + "tokens": 77, + "top_k": 6, + "decisions": 462, + "ordered_route_sha256": "ad00dc21bc045aff14a06bb784cb8a17d17224d973e4bf16760ab0201a2e6176", + "route_weight_sha256": "1762186171ec6bdc8aadf30d9551579775b3435f5b1924d455e60f399db3a4bc", + "loads": [ + 7, + 13, + 11, + 6, + 4, + 5, + 8, + 5, + 9, + 2, + 12, + 8, + 2, + 8, + 8, + 10, + 6, + 3, + 3, + 7, + 6, + 12, + 5, + 6, + 5, + 2, + 2, + 6, + 12, + 10, + 2, + 5, + 2, + 9, + 7, + 21, + 7, + 1, + 10, + 1, + 5, + 10, + 11, + 6, + 3, + 10, + 7, + 12, + 12, + 6, + 10, + 7, + 3, + 1, + 2, + 4, + 7, + 9, + 10, + 7, + 24, + 7, + 7, + 14 + ], + "weighted_loads": [ + 1.114685297012329, + 1.1566695012152195, + 1.6716247275471687, + 0.9645293168723583, + 0.25920119136571884, + 0.33434512093663216, + 0.6183573789894581, + 0.31939272955060005, + 0.6093146689236164, + 0.2569716051220894, + 0.680943738669157, + 0.8222459740936756, + 0.05654456280171871, + 0.5372848752886057, + 0.3425390012562275, + 0.7770582064986229, + 0.2944531701505184, + 0.4066573902964592, + 0.4660008139908314, + 0.902365081012249, + 0.5409654080867767, + 1.1269941702485085, + 0.7022098451852798, + 1.0524997375905514, + 0.3873928226530552, + 0.1475798897445202, + 0.10366332903504372, + 0.5178069174289703, + 0.8140934649854898, + 0.7853485345840454, + 0.2000568900257349, + 0.3133687265217304, + 0.08406956493854523, + 0.36359892413020134, + 0.4259319417178631, + 2.446530538611114, + 0.3835028875619173, + 0.05994280427694321, + 0.648032121360302, + 0.08812566846609116, + 0.16880825720727444, + 0.7931208088994026, + 0.940642237663269, + 0.7608826719224453, + 0.19892976060509682, + 0.7962398454546928, + 0.34356002882122993, + 0.9823343530297279, + 1.654487930238247, + 0.39479247480630875, + 0.8547717239707708, + 0.5917511899024248, + 0.2161574736237526, + 0.04007165506482124, + 0.07438665442168713, + 0.18599224090576172, + 0.5119040869176388, + 0.44117422215640545, + 0.5428820066154003, + 0.5173650104552507, + 1.9802208980545402, + 0.6353707537055016, + 0.5245055593550205, + 0.7945483569055796 + ], + "unique_experts": 64, + "load_cv": 0.5995788205833864, + "normalized_load_entropy": 0.9584173002272631, + "max_load_share": 0.05194805194805195 + } + }, + "s1_period": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "c3a50fe55064facc259c0257455c8fd1b972a3bc69fa59c36c4bdae445153055", + "route_weight_sha256": "d4ac63a1e4ffd0e1552b3e3ae64ba7ada5e0f65754eef614cd725840b8eb0f19", + "loads": [ + 6, + 3, + 10, + 4, + 4, + 5, + 8, + 3, + 5, + 2, + 9, + 9, + 2, + 7, + 2, + 9, + 6, + 3, + 3, + 2, + 3, + 3, + 5, + 7, + 2, + 2, + 2, + 4, + 10, + 10, + 2, + 7, + 3, + 8, + 3, + 8, + 8, + 1, + 5, + 1, + 6, + 10, + 4, + 6, + 3, + 10, + 5, + 7, + 10, + 5, + 10, + 0, + 3, + 1, + 2, + 3, + 7, + 1, + 2, + 2, + 10, + 3, + 1, + 5 + ], + "weighted_loads": [ + 0.8343848772346973, + 0.22296464070677757, + 1.6732890848070383, + 0.20586654543876648, + 0.25965652987360954, + 0.3554682470858097, + 0.6068582721054554, + 0.16277096420526505, + 0.32140305265784264, + 0.25620730221271515, + 0.6001748312264681, + 0.8780955038964748, + 0.0585227869451046, + 0.48362958431243896, + 0.07372363284230232, + 0.7561991363763809, + 0.29106419160962105, + 0.39411356300115585, + 0.47342628613114357, + 0.1347632259130478, + 0.2611336447298527, + 0.26249831169843674, + 0.7385042384266853, + 1.0426226016134024, + 0.23948006331920624, + 0.15612861514091492, + 0.10166370496153831, + 0.23454636707901955, + 0.5648332517594099, + 0.8043845519423485, + 0.1990597601979971, + 0.3847667220979929, + 0.10746672935783863, + 0.3074932172894478, + 0.22880877181887627, + 0.5594595186412334, + 0.419092807918787, + 0.0588211826980114, + 0.4481087401509285, + 0.07762016355991364, + 0.2104456014931202, + 0.8191870879381895, + 0.18939512223005295, + 0.7624589949846268, + 0.21850407123565674, + 0.7796854116022587, + 0.3026558719575405, + 0.6858236826956272, + 1.6383756920695305, + 0.3486413452774286, + 0.8515929356217384, + 0.0, + 0.2010994702577591, + 0.03854886069893837, + 0.0786929577589035, + 0.16916616633534431, + 0.4882710874080658, + 0.05029366910457611, + 0.1794850453734398, + 0.33751027286052704, + 0.9745642095804214, + 0.37094365805387497, + 0.033940982073545456, + 0.3255561999976635 + ], + "unique_experts": 63, + "load_cv": 0.6084005393694704, + "normalized_load_entropy": 0.9535687040698434, + "max_load_share": 0.03205128205128205 + }, + "full_input": { + "tokens": 93, + "top_k": 6, + "decisions": 558, + "ordered_route_sha256": "291cd4e263451c0252a61f95a2d0d76b4d29b314b9f0422f3a0799ee30b3472f", + "route_weight_sha256": "4e6a074e9d858e2fba27522177376d6eeb12e6d93f76872bff9d6a477abcc32a", + "loads": [ + 11, + 14, + 11, + 7, + 5, + 6, + 8, + 7, + 15, + 3, + 16, + 9, + 2, + 9, + 10, + 11, + 9, + 3, + 3, + 8, + 5, + 14, + 6, + 7, + 7, + 3, + 2, + 7, + 15, + 10, + 3, + 9, + 3, + 9, + 12, + 24, + 8, + 2, + 11, + 4, + 6, + 10, + 14, + 7, + 6, + 10, + 14, + 15, + 13, + 6, + 11, + 8, + 4, + 4, + 2, + 4, + 12, + 7, + 4, + 12, + 23, + 10, + 11, + 17 + ], + "weighted_loads": [ + 1.6222797706723213, + 1.2285132259130478, + 1.698712157085538, + 0.9979509152472019, + 0.2899756170809269, + 0.49626297131180763, + 0.6068582721054554, + 0.38288360834121704, + 1.1656732372939587, + 0.3733546882867813, + 0.9050636794418097, + 0.8780955038964748, + 0.0585227869451046, + 0.5349427778273821, + 0.5140974000096321, + 0.8233854435384274, + 0.3877842351794243, + 0.39411356300115585, + 0.47342628613114357, + 0.907568171620369, + 0.4945062883198261, + 1.188815025612712, + 0.7771876342594624, + 1.0426226016134024, + 0.4827863425016403, + 0.20632404088974, + 0.10166370496153831, + 0.9210390634834766, + 0.8315659407526255, + 0.8043845519423485, + 0.2328487765043974, + 0.42762516252696514, + 0.10746672935783863, + 0.3476076051592827, + 0.5968102086335421, + 2.263548410497606, + 0.419092807918787, + 0.10041981190443039, + 0.6681696716696024, + 0.4339430555701256, + 0.2104456014931202, + 0.8191870879381895, + 1.3951227478682995, + 0.9442786425352097, + 0.8635438084602356, + 0.7796854116022587, + 0.9839400369673967, + 1.1021187752485275, + 1.731249276548624, + 0.392218129709363, + 0.8779863715171814, + 0.8546732142567635, + 0.3776548504829407, + 0.2216193675994873, + 0.0786929577589035, + 0.187959935516119, + 0.770843219012022, + 0.3084123283624649, + 0.2902483232319355, + 0.791993310675025, + 1.7458885973319411, + 0.8686398193240166, + 0.9205978885293007, + 1.1449726931750774 + ], + "unique_experts": 64, + "load_cv": 0.54686226498651, + "normalized_load_entropy": 0.9646302542084115, + "max_load_share": 0.043010752688172046 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 52, + "ordered_topk_exact_tokens": 40, + "set_exact_tokens": 44, + "mean_set_jaccard": 0.9560439560439562, + "mean_token_weighted_tv": 0.010899700940801548, + "aggregate_load_tv": 0.025641025641025644 + }, + "system_bos": { + "tokens": 52, + "ordered_topk_exact_tokens": 35, + "set_exact_tokens": 39, + "mean_set_jaccard": 0.9285714285714287, + "mean_token_weighted_tv": 0.0178285026922822, + "aggregate_load_tv": 0.03846153846153846 + }, + "system_x": { + "tokens": 52, + "ordered_topk_exact_tokens": 33, + "set_exact_tokens": 38, + "mean_set_jaccard": 0.9230769230769231, + "mean_token_weighted_tv": 0.020665328591488875, + "aggregate_load_tv": 0.03205128205128205 + }, + "system_period": { + "tokens": 52, + "ordered_topk_exact_tokens": 33, + "set_exact_tokens": 38, + "mean_set_jaccard": 0.9230769230769231, + "mean_token_weighted_tv": 0.0204542250945591, + "aggregate_load_tv": 0.03525641025641026 + }, + "bos_at_s0": { + "tokens": 52, + "ordered_topk_exact_tokens": 27, + "set_exact_tokens": 33, + "mean_set_jaccard": 0.8914835164835165, + "mean_token_weighted_tv": 0.029377181172514193, + "aggregate_load_tv": 0.057692307692307696 + }, + "bos_at_s1": { + "tokens": 52, + "ordered_topk_exact_tokens": 26, + "set_exact_tokens": 34, + "mean_set_jaccard": 0.8969780219780219, + "mean_token_weighted_tv": 0.02984223781655041, + "aggregate_load_tv": 0.04166666666666667 + }, + "x_at_s0": { + "tokens": 52, + "ordered_topk_exact_tokens": 28, + "set_exact_tokens": 33, + "mean_set_jaccard": 0.8914835164835165, + "mean_token_weighted_tv": 0.027640026438838013, + "aggregate_load_tv": 0.04807692307692308 + }, + "x_at_s1": { + "tokens": 52, + "ordered_topk_exact_tokens": 26, + "set_exact_tokens": 31, + "mean_set_jaccard": 0.8804945054945056, + "mean_token_weighted_tv": 0.032755571542880856, + "aggregate_load_tv": 0.05128205128205129 + }, + "period_at_s0": { + "tokens": 52, + "ordered_topk_exact_tokens": 29, + "set_exact_tokens": 34, + "mean_set_jaccard": 0.8969780219780219, + "mean_token_weighted_tv": 0.027279587623734888, + "aggregate_load_tv": 0.04807692307692308 + }, + "period_at_s1": { + "tokens": 52, + "ordered_topk_exact_tokens": 24, + "set_exact_tokens": 30, + "mean_set_jaccard": 0.875, + "mean_token_weighted_tv": 0.0328365160474697, + "aggregate_load_tv": 0.057692307692307696 + } + } + }, + "layer_03": { + "layer": 3, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "812645484748285e75e869256b5a446eaa43643c6af243e040719ad39db40b3d", + "route_weight_sha256": "e86ab7f0786bded77c7f34c0df090aab39188849c07834fc3fc6d2605a5f00db", + "loads": [ + 1, + 8, + 4, + 6, + 4, + 3, + 11, + 1, + 0, + 4, + 16, + 11, + 3, + 2, + 8, + 1, + 3, + 4, + 1, + 5, + 6, + 7, + 2, + 4, + 8, + 3, + 2, + 3, + 2, + 2, + 4, + 16, + 9, + 5, + 5, + 3, + 13, + 3, + 13, + 4, + 11, + 8, + 7, + 2, + 1, + 4, + 3, + 3, + 1, + 0, + 4, + 6, + 2, + 2, + 5, + 5, + 4, + 4, + 0, + 5, + 13, + 3, + 8, + 1 + ], + "weighted_loads": [ + 0.027322739362716675, + 0.9835987389087677, + 0.2923046350479126, + 0.29348963871598244, + 0.12130706757307053, + 0.14601239934563637, + 0.7224978283047676, + 0.06924017518758774, + 0.0, + 0.17314519360661507, + 1.632260512560606, + 1.430864481255412, + 0.09514130651950836, + 0.11578717082738876, + 0.7232000716030598, + 0.013237090781331062, + 0.2098628133535385, + 0.25410982221364975, + 0.028354326263070107, + 0.3035726323723793, + 0.49610207229852676, + 0.4581182226538658, + 0.13714351505041122, + 0.228788323700428, + 0.5580497980117798, + 0.13352131098508835, + 0.08337252214550972, + 0.13329488411545753, + 0.06762487441301346, + 0.0866311676800251, + 0.42204852402210236, + 2.2012666277587414, + 0.7924324907362461, + 0.3767414949834347, + 0.23565709963440895, + 0.19702043011784554, + 1.6577976159751415, + 0.26782988011837006, + 1.2856239210814238, + 0.37752869725227356, + 1.005757424980402, + 0.7466320935636759, + 0.44953623600304127, + 0.126616433262825, + 0.055554088205099106, + 0.30148415453732014, + 0.10451886802911758, + 0.3217460811138153, + 0.030398350208997726, + 0.0, + 0.1596379056572914, + 0.5697065815329552, + 0.15288332104682922, + 0.16648602485656738, + 0.5662549771368504, + 0.369002353399992, + 0.7120647951960564, + 0.1882041059434414, + 0.0, + 0.2394651100039482, + 0.7788286320865154, + 0.17457441240549088, + 0.7077622264623642, + 0.035396870225667953 + ], + "unique_experts": 61, + "load_cv": 0.7789978221006827, + "normalized_load_entropy": 0.9310890828309105, + "max_load_share": 0.05128205128205128 + }, + "full_input": { + "tokens": 77, + "top_k": 6, + "decisions": 462, + "ordered_route_sha256": "eb87007acd8eaf8ded041214e6293fd3b53b7fe7aba4f174d81bd4ef78656fbd", + "route_weight_sha256": "9d3db991cbbc62cd5f87ec2df0f4c735dc90764e8c36b8a5e21a03cd2a4d567c", + "loads": [ + 9, + 8, + 4, + 16, + 7, + 4, + 11, + 9, + 0, + 9, + 17, + 12, + 5, + 6, + 15, + 1, + 3, + 4, + 1, + 5, + 8, + 10, + 8, + 6, + 8, + 5, + 2, + 10, + 2, + 5, + 5, + 16, + 9, + 5, + 14, + 3, + 13, + 3, + 13, + 4, + 11, + 9, + 17, + 2, + 1, + 5, + 15, + 3, + 8, + 10, + 5, + 6, + 3, + 2, + 10, + 7, + 4, + 5, + 1, + 5, + 21, + 3, + 11, + 3 + ], + "weighted_loads": [ + 1.2475606985390186, + 0.9835987389087677, + 0.2923046350479126, + 0.885965321213007, + 0.20075812452705577, + 0.1932869553565979, + 0.7224978283047676, + 1.35382542014122, + 0.0, + 0.4110992754576728, + 1.6680448651313782, + 1.4317433920805342, + 0.10716778907226399, + 0.4628514125943184, + 1.2376502677798271, + 0.013237090781331062, + 0.2098628133535385, + 0.25410982221364975, + 0.028354326263070107, + 0.3035726323723793, + 0.5688659269362688, + 0.6762023754417896, + 0.5969991162419319, + 0.29594320617616177, + 0.5580497980117798, + 0.1472180251730606, + 0.08337252214550972, + 0.39419342763721943, + 0.06762487441301346, + 0.23070111125707626, + 0.46863045915961266, + 2.2012666277587414, + 0.7924324907362461, + 0.3767414949834347, + 1.266023762524128, + 0.19702043011784554, + 1.6577976159751415, + 0.26782988011837006, + 1.2856239210814238, + 0.37752869725227356, + 1.005757424980402, + 0.7580329710617661, + 1.0458190310746431, + 0.126616433262825, + 0.055554088205099106, + 0.35353453271090984, + 1.7080419175326824, + 0.3217460811138153, + 0.786406371742487, + 0.6147607415914536, + 0.19432826340198517, + 0.5697065815329552, + 0.16762726195156574, + 0.16648602485656738, + 2.5459042750298977, + 0.49389250576496124, + 0.7120647951960564, + 0.2009968487545848, + 0.03722543269395828, + 0.2394651100039482, + 1.3876848183572292, + 0.17457441240549088, + 1.0330056622624397, + 0.1150239109992981 + ], + "unique_experts": 63, + "load_cv": 0.6550257062222234, + "normalized_load_entropy": 0.947928240165671, + "max_load_share": 0.045454545454545456 + } + }, + "s1_eos": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "365a6e37e5ee839bc5cf986842c1d6a2c4e7ef7b1f35dfe4a089506ee21c5cdb", + "route_weight_sha256": "120d77aa9c393de86943d39fa9340801711510b0ca06e96b0db1a7ba034348b0", + "loads": [ + 1, + 8, + 4, + 6, + 3, + 3, + 10, + 1, + 0, + 4, + 16, + 11, + 3, + 2, + 8, + 1, + 3, + 4, + 1, + 5, + 6, + 7, + 2, + 4, + 8, + 4, + 2, + 3, + 4, + 2, + 4, + 16, + 9, + 5, + 5, + 3, + 12, + 3, + 13, + 4, + 11, + 7, + 7, + 2, + 1, + 4, + 3, + 3, + 1, + 0, + 4, + 6, + 2, + 2, + 5, + 5, + 4, + 5, + 0, + 5, + 13, + 3, + 8, + 1 + ], + "weighted_loads": [ + 0.02653200551867485, + 0.9894858337938786, + 0.2824573814868927, + 0.287513792514801, + 0.09945491887629032, + 0.14186851680278778, + 0.680681686848402, + 0.06789760291576385, + 0.0, + 0.17023369297385216, + 1.6408703792840242, + 1.4167225640267134, + 0.09626350924372673, + 0.11447952687740326, + 0.7240108624100685, + 0.01303146593272686, + 0.21371959149837494, + 0.2561091110110283, + 0.028689077123999596, + 0.30440570786595345, + 0.4955507591366768, + 0.44950916804373264, + 0.13456733524799347, + 0.22990436851978302, + 0.5511232167482376, + 0.1620487943291664, + 0.08457651361823082, + 0.1308378167450428, + 0.12142064236104488, + 0.08355904370546341, + 0.42013656347990036, + 2.2230743654072285, + 0.812518086284399, + 0.35785949043929577, + 0.2351568005979061, + 0.1951214224100113, + 1.6266368087381124, + 0.2624303363263607, + 1.2929519284516573, + 0.3750673979520798, + 0.9978133104741573, + 0.7219863794744015, + 0.4504318665713072, + 0.1265035718679428, + 0.05713693052530289, + 0.2953720763325691, + 0.10372554510831833, + 0.3321194425225258, + 0.0316072553396225, + 0.0, + 0.15767157450318336, + 0.5622420944273472, + 0.15097879245877266, + 0.16389480233192444, + 0.5566140189766884, + 0.36149377189576626, + 0.7024056389927864, + 0.21431835740804672, + 0.0, + 0.23917727544903755, + 0.7619546018540859, + 0.17090749368071556, + 0.704066164791584, + 0.03397784009575844 + ], + "unique_experts": 61, + "load_cv": 0.7619311773386475, + "normalized_load_entropy": 0.9335781363856526, + "max_load_share": 0.05128205128205128 + }, + "full_input": { + "tokens": 93, + "top_k": 6, + "decisions": 558, + "ordered_route_sha256": "3b6063a2c06f1c295f045f8e06a5429f0d755fb72a40dc26147613b128b9c195", + "route_weight_sha256": "081195235403d2f3ea874f9f9709747085fa532a8fcee8f5cd4d5365a7a67585", + "loads": [ + 13, + 10, + 4, + 17, + 5, + 6, + 10, + 12, + 0, + 12, + 21, + 12, + 7, + 7, + 17, + 2, + 5, + 4, + 2, + 5, + 8, + 13, + 13, + 5, + 10, + 7, + 2, + 5, + 4, + 5, + 5, + 16, + 9, + 7, + 13, + 3, + 12, + 8, + 13, + 5, + 12, + 8, + 22, + 4, + 1, + 8, + 19, + 3, + 10, + 10, + 5, + 12, + 6, + 7, + 11, + 11, + 4, + 6, + 8, + 6, + 26, + 4, + 13, + 8 + ], + "weighted_loads": [ + 1.635589960962534, + 1.063992777839303, + 0.2824573814868927, + 0.9462007768452168, + 0.151273294177372, + 0.2897212654352188, + 0.680681686848402, + 1.4244862366467714, + 0.0, + 0.5924416164634749, + 1.7837913166731596, + 1.4176014748518355, + 0.185511298768688, + 0.5249037034809589, + 1.4146174006164074, + 0.06190531514585018, + 0.4265707954764366, + 0.2561091110110283, + 0.0841814000159502, + 0.30440570786595345, + 0.5618086978793144, + 0.7578447889536619, + 1.075566291809082, + 0.2694331556558609, + 0.6535138674080372, + 0.21858734532725066, + 0.08457651361823082, + 0.19789263978600502, + 0.12142064236104488, + 0.219609834253788, + 0.4617558792233467, + 2.2230743654072285, + 0.812518086284399, + 0.43065388314425945, + 1.1527879275381565, + 0.1951214224100113, + 1.6266368087381124, + 0.6782466396689415, + 1.2929519284516573, + 0.4254910498857498, + 1.0731455497443676, + 0.7308475011959672, + 1.1731635313481092, + 0.1967817023396492, + 0.05713693052530289, + 0.588534202426672, + 2.282368578016758, + 0.3321194425225258, + 1.098270382732153, + 0.46659478917717934, + 0.19111695140600204, + 1.3376874141395092, + 0.36214060615748167, + 0.8788511827588081, + 2.6480581909418106, + 0.710535079240799, + 0.7024056389927864, + 0.22339063975960016, + 0.51973507553339, + 0.2694720961153507, + 1.6450723987072706, + 0.22116976231336594, + 1.1169986799359322, + 0.48017333820462227 + ], + "unique_experts": 63, + "load_cv": 0.6009439182125733, + "normalized_load_entropy": 0.9573595739201983, + "max_load_share": 0.04659498207885305 + } + }, + "s0_bos": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "b138aa9f5735d1cec2a57bc2d0a45d1720c73930a01c647cc306d0c53346cd10", + "route_weight_sha256": "067f4ca497045aa0624c12787682bc84391cd696936213c9f4f8d64dd0e562f1", + "loads": [ + 1, + 7, + 3, + 7, + 2, + 3, + 12, + 1, + 0, + 4, + 17, + 11, + 3, + 2, + 8, + 1, + 3, + 6, + 1, + 5, + 7, + 8, + 2, + 5, + 7, + 3, + 2, + 3, + 4, + 2, + 4, + 16, + 9, + 5, + 4, + 3, + 12, + 2, + 11, + 4, + 10, + 7, + 5, + 2, + 1, + 3, + 4, + 3, + 1, + 0, + 5, + 6, + 2, + 2, + 5, + 5, + 4, + 3, + 0, + 6, + 15, + 2, + 8, + 3 + ], + "weighted_loads": [ + 0.024850700050592422, + 0.9558390527963638, + 0.2612987235188484, + 0.3625461161136627, + 0.0628772471100092, + 0.15199147909879684, + 0.7140225358307362, + 0.06396490335464478, + 0.0, + 0.20489251986145973, + 1.7085523512214422, + 1.4582064263522625, + 0.09341322630643845, + 0.11045442521572113, + 0.705443449318409, + 0.012414094991981983, + 0.21690110489726067, + 0.2956459131091833, + 0.021763868629932404, + 0.28235993534326553, + 0.5960463099181652, + 0.5240784846246243, + 0.1236036941409111, + 0.23836039192974567, + 0.6160969287157059, + 0.14067427814006805, + 0.08899529278278351, + 0.1307947337627411, + 0.133111959323287, + 0.08063803240656853, + 0.3922100365161896, + 2.1953199356794357, + 0.8350938856601715, + 0.34715320356190205, + 0.17840932309627533, + 0.18405263870954514, + 1.56976686604321, + 0.22484656050801277, + 1.2571982219815254, + 0.39230191707611084, + 0.9890277869999409, + 0.7060024626553059, + 0.40943552181124687, + 0.1267268918454647, + 0.056222204118967056, + 0.26126421988010406, + 0.1765537615865469, + 0.3285837396979332, + 0.02818424627184868, + 0.0, + 0.24366827681660652, + 0.5586641430854797, + 0.1608574390411377, + 0.15921077877283096, + 0.555020198225975, + 0.36699965223670006, + 0.7386717908084393, + 0.1256333403289318, + 0.0, + 0.290422173216939, + 0.9348673075437546, + 0.12054039165377617, + 0.6859188862144947, + 0.08900395408272743 + ], + "unique_experts": 61, + "load_cv": 0.7848834802571265, + "normalized_load_entropy": 0.930930593125322, + "max_load_share": 0.05448717948717949 + }, + "full_input": { + "tokens": 77, + "top_k": 6, + "decisions": 462, + "ordered_route_sha256": "bdc0a6822b7f64211e9be1ece99714bbb69ee1d9797b9d34b60106b7c3ced7e5", + "route_weight_sha256": "aba3a638f354487b109fd1f4fb4b4bc3e092153cccab85d5938fe751fac1e50d", + "loads": [ + 10, + 7, + 3, + 17, + 5, + 5, + 12, + 9, + 0, + 9, + 19, + 12, + 4, + 6, + 15, + 1, + 3, + 6, + 2, + 5, + 9, + 11, + 7, + 7, + 7, + 4, + 2, + 10, + 4, + 6, + 5, + 16, + 9, + 5, + 12, + 3, + 12, + 2, + 11, + 4, + 10, + 7, + 16, + 2, + 1, + 5, + 16, + 3, + 9, + 10, + 6, + 6, + 2, + 2, + 9, + 7, + 4, + 3, + 1, + 6, + 23, + 2, + 11, + 5 + ], + "weighted_loads": [ + 1.373546577990055, + 0.9558390527963638, + 0.2612987235188484, + 0.9550217986106873, + 0.14692360983463004, + 0.24781247973442078, + 0.7140225358307362, + 1.2963316887617111, + 0.0, + 0.4615992362378165, + 1.7766973096877337, + 1.4590853371773846, + 0.09389211266534403, + 0.47454819083213806, + 1.2347425557672977, + 0.012414094991981983, + 0.21690110489726067, + 0.2956459131091833, + 0.058722641319036484, + 0.28235993534326553, + 0.6679861377924681, + 0.7665768042206764, + 0.501262366771698, + 0.3026465177536011, + 0.6160969287157059, + 0.1412041540024802, + 0.08899529278278351, + 0.391693277284503, + 0.133111959323287, + 0.26742666959762573, + 0.4387919716536999, + 2.1953199356794357, + 0.8350938856601715, + 0.34715320356190205, + 1.1720255240797997, + 0.18405263870954514, + 1.56976686604321, + 0.22484656050801277, + 1.2571982219815254, + 0.39230191707611084, + 0.9890277869999409, + 0.7060024626553059, + 1.1234744787216187, + 0.1267268918454647, + 0.056222204118967056, + 0.37530459463596344, + 1.7800768110901117, + 0.3285837396979332, + 0.8751124329864979, + 0.6147607415914536, + 0.27704649791121483, + 0.5586641430854797, + 0.1608574390411377, + 0.15921077877283096, + 1.8070178925991058, + 0.4929376654326916, + 0.7386717908084393, + 0.1256333403289318, + 0.039606258273124695, + 0.290422173216939, + 1.4990695137530565, + 0.12054039165377617, + 1.0111623220145702, + 0.16839376837015152 + ], + "unique_experts": 63, + "load_cv": 0.6713028203586684, + "normalized_load_entropy": 0.9467400026142908, + "max_load_share": 0.049783549783549784 + } + }, + "s1_bos": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "d75fa84e35c262f73070c7f8160c73ca3651f72f5c2892fd28af7f6038e8f56c", + "route_weight_sha256": "40a2fc6c29509f4eecd28464958a7abc7f0b57e3b152269969de1d934bae9606", + "loads": [ + 1, + 8, + 3, + 7, + 4, + 2, + 11, + 1, + 0, + 4, + 16, + 11, + 2, + 2, + 8, + 1, + 3, + 6, + 0, + 5, + 7, + 7, + 2, + 6, + 8, + 3, + 4, + 4, + 3, + 1, + 4, + 16, + 9, + 5, + 4, + 3, + 11, + 2, + 12, + 4, + 10, + 7, + 5, + 2, + 1, + 4, + 4, + 3, + 1, + 0, + 5, + 7, + 2, + 2, + 3, + 5, + 4, + 4, + 0, + 6, + 16, + 2, + 7, + 2 + ], + "weighted_loads": [ + 0.025452280417084694, + 0.979158341884613, + 0.24461955204606056, + 0.3547690585255623, + 0.1228449996560812, + 0.1006808876991272, + 0.6713623031973839, + 0.06214151158928871, + 0.0, + 0.19353360310196877, + 1.6746546756476164, + 1.4286223538219929, + 0.06272012554109097, + 0.11137106642127037, + 0.7041072137653828, + 0.01257461216300726, + 0.22106417268514633, + 0.29563023149967194, + 0.0, + 0.2737633716315031, + 0.5575352683663368, + 0.4683155547827482, + 0.127673652023077, + 0.26238184981048107, + 0.6304959766566753, + 0.13457300886511803, + 0.1495317444205284, + 0.17360229417681694, + 0.09948253445327282, + 0.045635636895895004, + 0.3912508115172386, + 2.240763582289219, + 0.8639309294521809, + 0.3185649774968624, + 0.1801273562014103, + 0.18307599052786827, + 1.5415934585034847, + 0.21929247677326202, + 1.3066243771463633, + 0.39081116765737534, + 0.9781375508755445, + 0.6831593811511993, + 0.4132549427449703, + 0.12909625098109245, + 0.05187895894050598, + 0.2819833271205425, + 0.20298511907458305, + 0.33291293680667877, + 0.029670633375644684, + 0.0, + 0.22828036174178123, + 0.6082459278404713, + 0.15769685059785843, + 0.15962377190589905, + 0.48034436255693436, + 0.35240133479237556, + 0.721543975174427, + 0.1766190156340599, + 0.0, + 0.2927092928439379, + 0.9852793999016285, + 0.12489185854792595, + 0.6076630279421806, + 0.06078767776489258 + ], + "unique_experts": 60, + "load_cv": 0.7857206895407468, + "normalized_load_entropy": 0.9286033366841634, + "max_load_share": 0.05128205128205128 + }, + "full_input": { + "tokens": 93, + "top_k": 6, + "decisions": 558, + "ordered_route_sha256": "140246295d2f1618becf4487f00cc5946a1b054d6496cd2132473202b6fa02b4", + "route_weight_sha256": "b5c797b2e59c15a1d541f30b3f49a6c46b5c54866e0f39fd37ec5e638022e478", + "loads": [ + 13, + 10, + 3, + 18, + 7, + 6, + 11, + 12, + 0, + 12, + 21, + 12, + 5, + 7, + 17, + 2, + 5, + 6, + 2, + 5, + 9, + 13, + 12, + 7, + 10, + 5, + 4, + 6, + 3, + 4, + 5, + 16, + 9, + 7, + 12, + 3, + 11, + 7, + 12, + 5, + 11, + 7, + 21, + 4, + 1, + 9, + 21, + 3, + 11, + 10, + 6, + 13, + 5, + 7, + 8, + 11, + 4, + 4, + 8, + 7, + 29, + 3, + 12, + 9 + ], + "weighted_loads": [ + 1.672217844054103, + 1.0536652859300375, + 0.24461955204606056, + 1.013456042855978, + 0.20608300232561305, + 0.2978794015944004, + 0.6713623031973839, + 1.3744595181196928, + 0.0, + 0.6317468489287421, + 1.8175756130367517, + 1.429501264647115, + 0.14399146876530722, + 0.5400244444608688, + 1.4197354912757874, + 0.06144846137613058, + 0.433915376663208, + 0.29563023149967194, + 0.09194441139698029, + 0.2737633716315031, + 0.6279427744448185, + 0.8036065306514502, + 0.9853854104876518, + 0.30178474448621273, + 0.7328866273164749, + 0.18225329916458577, + 0.1495317444205284, + 0.24065711721777916, + 0.09948253445327282, + 0.18277717754244804, + 0.43287012726068497, + 2.240763582289219, + 0.8639309294521809, + 0.3913593702018261, + 1.1062566377222538, + 0.18307599052786827, + 1.5415934585034847, + 0.6351087801158428, + 1.3066243771463633, + 0.4412348195910454, + 1.0534697901457548, + 0.6831593811511993, + 1.2788605503737926, + 0.19937438145279884, + 0.05187895894050598, + 0.6537522710859776, + 2.4192558750510216, + 0.33291293680667877, + 1.1637617219239473, + 0.46659478917717934, + 0.2602422721683979, + 1.3836912475526333, + 0.3584075905382633, + 0.8745801523327827, + 1.738688550889492, + 0.6913271080702543, + 0.721543975174427, + 0.1766190156340599, + 0.5224115252494812, + 0.32300411351025105, + 1.8075071405619383, + 0.17515412718057632, + 1.0205955430865288, + 0.5067698061466217 + ], + "unique_experts": 63, + "load_cv": 0.6224497048776905, + "normalized_load_entropy": 0.9555931749413453, + "max_load_share": 0.05197132616487455 + } + }, + "s0_x": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "b16146322b76f684a00e2cb538f84ee87d381c3861144c865800350ecf30bd2a", + "route_weight_sha256": "fc6dc9e3e6c2e5710f610af092c4fa7d12dc135f9839867dece8703c1cf712b0", + "loads": [ + 1, + 8, + 3, + 8, + 2, + 2, + 12, + 1, + 0, + 5, + 17, + 11, + 3, + 3, + 8, + 1, + 3, + 6, + 1, + 6, + 7, + 8, + 2, + 4, + 8, + 3, + 2, + 3, + 3, + 2, + 4, + 16, + 9, + 5, + 4, + 3, + 12, + 2, + 12, + 4, + 9, + 7, + 5, + 2, + 1, + 3, + 3, + 3, + 1, + 0, + 5, + 6, + 2, + 2, + 5, + 5, + 4, + 4, + 0, + 6, + 13, + 2, + 8, + 2 + ], + "weighted_loads": [ + 0.025684954598546028, + 0.9562855996191502, + 0.2665187567472458, + 0.3739266023039818, + 0.0606499258428812, + 0.09036094322800636, + 0.7258465737104416, + 0.06419295072555542, + 0.0, + 0.2562129609286785, + 1.6665384620428085, + 1.4451818875968456, + 0.09729097038507462, + 0.14642010256648064, + 0.7146362289786339, + 0.012570885941386223, + 0.21249352768063545, + 0.29572202265262604, + 0.021199265494942665, + 0.31192727386951447, + 0.5910871177911758, + 0.5122087001800537, + 0.12945879995822906, + 0.20867786929011345, + 0.6329920738935471, + 0.13879330828785896, + 0.08691390976309776, + 0.12981833890080452, + 0.09717450477182865, + 0.08060094714164734, + 0.39432118088006973, + 2.1800553426146507, + 0.8235507719218731, + 0.35143023543059826, + 0.17820410430431366, + 0.1916956752538681, + 1.5692227203398943, + 0.224159874022007, + 1.2830676287412643, + 0.3855157941579819, + 0.9673689305782318, + 0.7119699344038963, + 0.3669203147292137, + 0.12654661387205124, + 0.05615236237645149, + 0.27203160896897316, + 0.1480019185692072, + 0.3293880820274353, + 0.028584972023963928, + 0.0, + 0.2406257800757885, + 0.5548727586865425, + 0.15878216177225113, + 0.15982826799154282, + 0.5648434981703758, + 0.37628474831581116, + 0.7316595837473869, + 0.16816771402955055, + 0.0, + 0.2787466421723366, + 0.7560690380632877, + 0.12268391251564026, + 0.6990729160606861, + 0.06487187556922436 + ], + "unique_experts": 61, + "load_cv": 0.7815256745706755, + "normalized_load_entropy": 0.930543902507727, + "max_load_share": 0.05448717948717949 + }, + "full_input": { + "tokens": 77, + "top_k": 6, + "decisions": 462, + "ordered_route_sha256": "87b6c0698bc296654760d4525a75e5260d9fd5992aae59905456ac1e63a363ea", + "route_weight_sha256": "ad00846abde19ca2dc363bf9d7a25ba4e6e6e026b8526237951acd4659fd5d10", + "loads": [ + 8, + 8, + 3, + 19, + 6, + 3, + 12, + 10, + 0, + 10, + 18, + 12, + 4, + 7, + 15, + 1, + 3, + 6, + 1, + 6, + 8, + 11, + 7, + 6, + 8, + 4, + 3, + 11, + 3, + 6, + 5, + 16, + 9, + 5, + 13, + 3, + 13, + 2, + 12, + 4, + 9, + 7, + 16, + 2, + 1, + 5, + 15, + 3, + 7, + 11, + 6, + 6, + 2, + 2, + 9, + 7, + 4, + 4, + 1, + 6, + 21, + 2, + 11, + 4 + ], + "weighted_loads": [ + 1.0697227735072374, + 0.9562855996191502, + 0.2665187567472458, + 1.1000065132975578, + 0.1657088872161694, + 0.1376354992389679, + 0.7258465737104416, + 1.3509326055645943, + 0.0, + 0.5347689072368667, + 1.7023228146135807, + 1.4460607984219678, + 0.0977698567439802, + 0.5066510699689388, + 1.1841706447303295, + 0.012570885941386223, + 0.21249352768063545, + 0.29572202265262604, + 0.021199265494942665, + 0.31192727386951447, + 0.6179256606847048, + 0.7536938562989235, + 0.5001954697072506, + 0.274109972640872, + 0.6329920738935471, + 0.13932318415027112, + 0.1288529857993126, + 0.43807889334857464, + 0.09717450477182865, + 0.27695198729634285, + 0.44090311601758003, + 2.1800553426146507, + 0.8235507719218731, + 0.35143023543059826, + 1.2734759524464607, + 0.1916956752538681, + 1.6175095941871405, + 0.224159874022007, + 1.2830676287412643, + 0.3855157941579819, + 0.9673689305782318, + 0.7119699344038963, + 1.0316104367375374, + 0.12654661387205124, + 0.05615236237645149, + 0.39198755472898483, + 1.751524968072772, + 0.3293880820274353, + 0.7210535891354084, + 0.678125835955143, + 0.27368463203310966, + 0.5548727586865425, + 0.15878216177225113, + 0.15982826799154282, + 1.7773359902203083, + 0.5063175484538078, + 0.7316595837473869, + 0.16816771402955055, + 0.05605923384428024, + 0.2787466421723366, + 1.345430813729763, + 0.12268391251564026, + 1.0243163518607616, + 0.14425386302173138 + ], + "unique_experts": 63, + "load_cv": 0.6699614988097233, + "normalized_load_entropy": 0.9460075878451562, + "max_load_share": 0.045454545454545456 + } + }, + "s1_x": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "844cb0b7d18b48f8b6ac7db128ac6d7977b5038d6aba6a6cbdd4d4f7f4038cbd", + "route_weight_sha256": "2c1a91a4101789cdca58b14adf4a5047bcdad2cefedcf54de5b3bc0450e270e3", + "loads": [ + 1, + 8, + 3, + 8, + 4, + 2, + 11, + 1, + 0, + 4, + 17, + 11, + 3, + 2, + 9, + 1, + 3, + 5, + 0, + 5, + 7, + 6, + 2, + 6, + 8, + 3, + 3, + 4, + 2, + 1, + 4, + 16, + 9, + 5, + 4, + 3, + 12, + 2, + 12, + 4, + 10, + 7, + 5, + 2, + 1, + 4, + 4, + 3, + 1, + 0, + 5, + 7, + 2, + 2, + 3, + 5, + 4, + 4, + 0, + 5, + 16, + 2, + 7, + 2 + ], + "weighted_loads": [ + 0.02519010379910469, + 0.9471256211400032, + 0.24696281179785728, + 0.37857053242623806, + 0.12358319014310837, + 0.09496283158659935, + 0.6699500884860754, + 0.06120472773909569, + 0.0, + 0.19348738342523575, + 1.7068138308823109, + 1.4288937374949455, + 0.09150363318622112, + 0.11149615049362183, + 0.7388214971870184, + 0.01290597952902317, + 0.22941386699676514, + 0.2696792781352997, + 0.0, + 0.2730623930692673, + 0.5565433502197266, + 0.4330967627465725, + 0.1332155093550682, + 0.2613378670066595, + 0.6210194192826748, + 0.1349186785519123, + 0.12032757885754108, + 0.16939428821206093, + 0.07428879663348198, + 0.046191271394491196, + 0.389455184340477, + 2.237904541194439, + 0.8558951616287231, + 0.32361801341176033, + 0.17350860312581062, + 0.18642159178853035, + 1.5646902192384005, + 0.21993934735655785, + 1.2832806669175625, + 0.3895716294646263, + 0.9736937936395407, + 0.6791102290153503, + 0.3790197800844908, + 0.13347314670681953, + 0.05293070152401924, + 0.27590472623705864, + 0.21827903017401695, + 0.33429425209760666, + 0.029798343777656555, + 0.0, + 0.22977450862526894, + 0.6199119128286839, + 0.16135277226567268, + 0.15770180523395538, + 0.4845530465245247, + 0.3540132977068424, + 0.7271967679262161, + 0.18107951432466507, + 0.0, + 0.2634348198771477, + 0.9703157022595406, + 0.12757845595479012, + 0.595965351909399, + 0.06398269534111023 + ], + "unique_experts": 60, + "load_cv": 0.8047361449474469, + "normalized_load_entropy": 0.9263899712697492, + "max_load_share": 0.05448717948717949 + }, + "full_input": { + "tokens": 93, + "top_k": 6, + "decisions": 558, + "ordered_route_sha256": "bda2e4b337605cbdcaff1d4ebcfbbf539d243632643bde88912132259347c4ef", + "route_weight_sha256": "fdd8897c3f6aa5014fe9ae6390f80a2d981648d3b6e885bdec781e0099f7eb5d", + "loads": [ + 12, + 10, + 3, + 20, + 6, + 5, + 11, + 12, + 0, + 12, + 22, + 12, + 6, + 7, + 18, + 2, + 5, + 5, + 2, + 5, + 8, + 12, + 11, + 7, + 10, + 5, + 4, + 7, + 2, + 5, + 5, + 16, + 9, + 7, + 12, + 3, + 13, + 7, + 12, + 5, + 11, + 7, + 21, + 4, + 1, + 9, + 21, + 3, + 10, + 11, + 6, + 13, + 5, + 7, + 8, + 11, + 4, + 4, + 8, + 6, + 29, + 3, + 12, + 9 + ], + "weighted_loads": [ + 1.4186570011079311, + 1.0216325651854277, + 0.24696281179785728, + 1.185753220692277, + 0.1554470926639624, + 0.24281558021903038, + 0.6699500884860754, + 1.3752142023295164, + 0.0, + 0.6468454952118918, + 1.8497347682714462, + 1.4297726483200677, + 0.17277497641043738, + 0.5335459522902966, + 1.4135437104851007, + 0.06177982874214649, + 0.4422650709748268, + 0.2696792781352997, + 0.09741932153701782, + 0.2730623930692673, + 0.5886799246072769, + 0.7764692604541779, + 0.94913350045681, + 0.30145017616450787, + 0.7234100699424744, + 0.18259896885138005, + 0.15933781303465366, + 0.2814546637237072, + 0.07428879663348198, + 0.2284146286547184, + 0.43107450008392334, + 2.237904541194439, + 0.8558951616287231, + 0.396412406116724, + 1.1438784040510654, + 0.18642159178853035, + 1.6049831788986921, + 0.6357556506991386, + 1.2832806669175625, + 0.43999528139829636, + 1.049026032909751, + 0.6791102290153503, + 1.158659627661109, + 0.20375127717852592, + 0.05293070152401924, + 0.6568825207650661, + 2.437677960842848, + 0.33429425209760666, + 1.0495394859462976, + 0.5263139791786671, + 0.2610699497163296, + 1.3953572325408459, + 0.3620635122060776, + 0.8726581856608391, + 1.7068782895803452, + 0.6940361242741346, + 0.7271967679262161, + 0.18107951432466507, + 0.5322534441947937, + 0.29372964054346085, + 1.8360803369432688, + 0.1778407245874405, + 1.0088978670537472, + 0.5105717219412327 + ], + "unique_experts": 63, + "load_cv": 0.6374590010194818, + "normalized_load_entropy": 0.9537957015302629, + "max_load_share": 0.05197132616487455 + } + }, + "s0_period": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "aa539f77904bc16d2746342291741d97a269d31c8678bf91fdcd5567518f166a", + "route_weight_sha256": "c30038f5a32297cc5c7b962ebd62f1361a372c14dc8574fff3ef086f5344d934", + "loads": [ + 1, + 8, + 3, + 7, + 2, + 2, + 12, + 1, + 0, + 4, + 16, + 11, + 3, + 2, + 8, + 1, + 3, + 5, + 1, + 5, + 7, + 9, + 2, + 5, + 7, + 3, + 2, + 3, + 4, + 2, + 4, + 16, + 9, + 5, + 5, + 3, + 11, + 3, + 11, + 4, + 11, + 7, + 6, + 2, + 1, + 3, + 3, + 3, + 1, + 0, + 5, + 6, + 2, + 2, + 5, + 5, + 4, + 4, + 0, + 6, + 14, + 2, + 8, + 2 + ], + "weighted_loads": [ + 0.025666190311312675, + 0.9671759009361267, + 0.2661583200097084, + 0.34556368365883827, + 0.06095212697982788, + 0.08964293450117111, + 0.7342388313263655, + 0.06403347104787827, + 0.0, + 0.20158299431204796, + 1.6374642830342054, + 1.4447152987122536, + 0.09874353371560574, + 0.11194901540875435, + 0.7105913162231445, + 0.012602109462022781, + 0.2153017893433571, + 0.2687177173793316, + 0.021191561594605446, + 0.28048533014953136, + 0.5826385729014874, + 0.5462908856570721, + 0.12547700107097626, + 0.24033049307763577, + 0.5959013924002647, + 0.1384938843548298, + 0.08588559553027153, + 0.1303374394774437, + 0.12970177456736565, + 0.07984022423624992, + 0.3951405957341194, + 2.194938689470291, + 0.8201938308775425, + 0.34891688637435436, + 0.21463526412844658, + 0.19331666082143784, + 1.527370773255825, + 0.25389664620161057, + 1.2333344798535109, + 0.3844505622982979, + 1.0204031821340322, + 0.7039859145879745, + 0.3932988066226244, + 0.12828077748417854, + 0.05660336837172508, + 0.27039602771401405, + 0.14733096212148666, + 0.32733678072690964, + 0.029060909524559975, + 0.0, + 0.2409788742661476, + 0.5701098591089249, + 0.1581628955900669, + 0.15914642810821533, + 0.5656252838671207, + 0.37250708416104317, + 0.734109677374363, + 0.1689995937049389, + 0.0, + 0.27880483493208885, + 0.7873785570263863, + 0.1258537508547306, + 0.7038678377866745, + 0.06495874002575874 + ], + "unique_experts": 61, + "load_cv": 0.7730673554708377, + "normalized_load_entropy": 0.9315641402103823, + "max_load_share": 0.05128205128205128 + }, + "full_input": { + "tokens": 77, + "top_k": 6, + "decisions": 462, + "ordered_route_sha256": "1fefce22246ad56d883e338a4b8b27bb5551ddc8036791fa850ef12a13aa9290", + "route_weight_sha256": "3383da7658a9eecc83e1c230dcef66850745e765a991a3f8cb7329225a54c291", + "loads": [ + 8, + 9, + 3, + 18, + 6, + 4, + 12, + 10, + 0, + 10, + 17, + 12, + 4, + 6, + 15, + 1, + 3, + 5, + 1, + 5, + 8, + 12, + 7, + 7, + 7, + 4, + 2, + 10, + 4, + 6, + 5, + 16, + 9, + 5, + 13, + 3, + 11, + 3, + 11, + 4, + 11, + 7, + 17, + 2, + 1, + 6, + 15, + 3, + 7, + 10, + 6, + 6, + 2, + 2, + 9, + 7, + 4, + 4, + 2, + 6, + 22, + 2, + 11, + 4 + ], + "weighted_loads": [ + 1.0004943329840899, + 1.1135563403367996, + 0.2661583200097084, + 1.0073759965598583, + 0.1764869157341309, + 0.17873193323612213, + 0.7342388313263655, + 1.3911080621182919, + 0.0, + 0.6384460682747886, + 1.6732486356049776, + 1.4455942095373757, + 0.09922242007451132, + 0.4717498607933521, + 1.3059531934559345, + 0.012602109462022781, + 0.2153017893433571, + 0.2687177173793316, + 0.021191561594605446, + 0.28048533014953136, + 0.6094771157950163, + 0.7850729338824749, + 0.5057089515030384, + 0.3055758886039257, + 0.5959013924002647, + 0.13902376021724194, + 0.08588559553027153, + 0.3912359829992056, + 0.12970177456736565, + 0.26748408004641533, + 0.4417225308716297, + 2.194938689470291, + 0.8201938308775425, + 0.34891688637435436, + 1.208251465111971, + 0.19331666082143784, + 1.527370773255825, + 0.25389664620161057, + 1.2333344798535109, + 0.3844505622982979, + 1.0204031821340322, + 0.7039859145879745, + 1.0593080688267946, + 0.12828077748417854, + 0.05660336837172508, + 0.4410538114607334, + 1.7508540116250515, + 0.32733678072690964, + 0.7152469400316477, + 0.6147607415914536, + 0.2744714580476284, + 0.5701098591089249, + 0.1581628955900669, + 0.15914642810821533, + 1.7764590829610825, + 0.4980684705078602, + 0.734109677374363, + 0.1689995937049389, + 0.08891551569104195, + 0.27880483493208885, + 1.3380446564406157, + 0.1258537508547306, + 1.02911127358675, + 0.1443166807293892 + ], + "unique_experts": 63, + "load_cv": 0.661403296462305, + "normalized_load_entropy": 0.9479172689198857, + "max_load_share": 0.047619047619047616 + } + }, + "s1_period": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "86f8f5f67eaf1a9d5e9c7a4eca6e07f830ab0075c6d866b223baddc0dcd293d4", + "route_weight_sha256": "1b2438744e04ab82f2361c6a8082fe9a04d8f48b135b7644fbe26962cf33f841", + "loads": [ + 1, + 8, + 3, + 7, + 4, + 2, + 11, + 1, + 0, + 4, + 16, + 11, + 3, + 2, + 9, + 1, + 3, + 5, + 0, + 5, + 7, + 7, + 2, + 5, + 8, + 3, + 3, + 3, + 4, + 1, + 4, + 16, + 9, + 5, + 5, + 3, + 11, + 2, + 12, + 4, + 11, + 7, + 5, + 2, + 1, + 4, + 4, + 3, + 1, + 0, + 5, + 7, + 2, + 2, + 4, + 5, + 4, + 3, + 0, + 5, + 16, + 2, + 7, + 2 + ], + "weighted_loads": [ + 0.025172138586640358, + 0.9504695124924183, + 0.24775949865579605, + 0.35260695591568947, + 0.1231380719691515, + 0.09819644317030907, + 0.6749234851449728, + 0.061133209615945816, + 0.0, + 0.18697788938879967, + 1.6736979950219393, + 1.4162111263722181, + 0.09149033017456532, + 0.10997053980827332, + 0.7387251369655132, + 0.01287466287612915, + 0.22976818680763245, + 0.26904332637786865, + 0.0, + 0.2777560278773308, + 0.5583346746861935, + 0.4583735056221485, + 0.12907589226961136, + 0.23666750267148018, + 0.615461315959692, + 0.13429023697972298, + 0.12164970673620701, + 0.12929542735219002, + 0.12817753478884697, + 0.046580031514167786, + 0.3906709775328636, + 2.233283758163452, + 0.8536917492747307, + 0.32066307961940765, + 0.21689872816205025, + 0.1880764439702034, + 1.5443758107721806, + 0.21881484612822533, + 1.2797571681439877, + 0.38989225775003433, + 1.005683721974492, + 0.6946246474981308, + 0.3732575736939907, + 0.13520561531186104, + 0.05360778421163559, + 0.2774946056306362, + 0.2174916621297598, + 0.3334968462586403, + 0.02992151863873005, + 0.0, + 0.2303333356976509, + 0.6376314423978329, + 0.16295669600367546, + 0.15967188775539398, + 0.5284501649439335, + 0.354163970798254, + 0.7270971871912479, + 0.14012056589126587, + 0.0, + 0.2607159912586212, + 0.96250294521451, + 0.1292620673775673, + 0.5973572507500648, + 0.06488358415663242 + ], + "unique_experts": 60, + "load_cv": 0.7907253305184243, + "normalized_load_entropy": 0.9281851722834098, + "max_load_share": 0.05128205128205128 + }, + "full_input": { + "tokens": 93, + "top_k": 6, + "decisions": 558, + "ordered_route_sha256": "488d2b8b43e3b95ab458539d8fc266ba6cd35a70a6d60dce7b00cfa73a6a3e6e", + "route_weight_sha256": "63847de543c9018a602e97ff390f340e44fc2128209f5b46449434a351116a50", + "loads": [ + 11, + 11, + 3, + 19, + 7, + 5, + 11, + 13, + 0, + 13, + 21, + 12, + 6, + 7, + 18, + 2, + 5, + 5, + 2, + 5, + 8, + 13, + 12, + 6, + 10, + 5, + 3, + 5, + 4, + 5, + 5, + 16, + 9, + 7, + 12, + 3, + 11, + 7, + 12, + 5, + 12, + 7, + 22, + 4, + 1, + 10, + 20, + 3, + 9, + 10, + 6, + 13, + 5, + 7, + 9, + 11, + 4, + 3, + 9, + 6, + 29, + 3, + 12, + 9 + ], + "weighted_loads": [ + 1.319053402170539, + 1.1341776419430971, + 0.24775949865579605, + 1.0699323564767838, + 0.19985338562401012, + 0.2460491918027401, + 0.6749234851449728, + 1.454578785225749, + 0.0, + 0.7658717575250193, + 1.8166189324110746, + 1.4170900371973403, + 0.17276167339878157, + 0.53089964017272, + 1.494016908109188, + 0.06174851208925247, + 0.4426193907856941, + 0.26904332637786865, + 0.09819530323147774, + 0.2777560278773308, + 0.5904712490737438, + 0.7955887503921986, + 1.0151836462318897, + 0.27626216039061546, + 0.7178519666194916, + 0.18197052727919072, + 0.12164970673620701, + 0.19635025039315224, + 0.12817753478884697, + 0.222771055996418, + 0.43229029327630997, + 2.233283758163452, + 0.8536917492747307, + 0.39345747232437134, + 1.0955728851258755, + 0.1880764439702034, + 1.5443758107721806, + 0.6346311494708061, + 1.2797571681439877, + 0.4403159096837044, + 1.0810159612447023, + 0.6946246474981308, + 1.2394121140241623, + 0.20548374578356743, + 0.05360778421163559, + 0.7213955037295818, + 2.3961346950381994, + 0.3334968462586403, + 0.9982826244086027, + 0.46659478917717934, + 0.26249391585588455, + 1.4130767621099949, + 0.36366743594408035, + 0.8746282681822777, + 1.7433110922574997, + 0.690353149548173, + 0.7270971871912479, + 0.14012056589126587, + 0.5745502300560474, + 0.2910108119249344, + 1.7848138455301523, + 0.17952433601021767, + 1.010289765894413, + 0.5112860482186079 + ], + "unique_experts": 63, + "load_cv": 0.6339021529119049, + "normalized_load_entropy": 0.9540433506993917, + "max_load_share": 0.05197132616487455 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 52, + "ordered_topk_exact_tokens": 47, + "set_exact_tokens": 48, + "mean_set_jaccard": 0.9780219780219781, + "mean_token_weighted_tv": 0.007389336340845778, + "aggregate_load_tv": 0.012820512820512817 + }, + "system_bos": { + "tokens": 52, + "ordered_topk_exact_tokens": 27, + "set_exact_tokens": 33, + "mean_set_jaccard": 0.8956043956043955, + "mean_token_weighted_tv": 0.021717280382290483, + "aggregate_load_tv": 0.041666666666666664 + }, + "system_x": { + "tokens": 52, + "ordered_topk_exact_tokens": 32, + "set_exact_tokens": 35, + "mean_set_jaccard": 0.9065934065934065, + "mean_token_weighted_tv": 0.022678738836055763, + "aggregate_load_tv": 0.04487179487179487 + }, + "system_period": { + "tokens": 52, + "ordered_topk_exact_tokens": 35, + "set_exact_tokens": 39, + "mean_set_jaccard": 0.9285714285714287, + "mean_token_weighted_tv": 0.019160824917400114, + "aggregate_load_tv": 0.03525641025641026 + }, + "bos_at_s0": { + "tokens": 52, + "ordered_topk_exact_tokens": 25, + "set_exact_tokens": 32, + "mean_set_jaccard": 0.8901098901098903, + "mean_token_weighted_tv": 0.02843308168499229, + "aggregate_load_tv": 0.05448717948717948 + }, + "bos_at_s1": { + "tokens": 52, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 26, + "mean_set_jaccard": 0.853021978021978, + "mean_token_weighted_tv": 0.03366415731859608, + "aggregate_load_tv": 0.060897435897435896 + }, + "x_at_s0": { + "tokens": 52, + "ordered_topk_exact_tokens": 21, + "set_exact_tokens": 29, + "mean_set_jaccard": 0.8736263736263736, + "mean_token_weighted_tv": 0.029286119800347548, + "aggregate_load_tv": 0.04807692307692307 + }, + "x_at_s1": { + "tokens": 52, + "ordered_topk_exact_tokens": 19, + "set_exact_tokens": 25, + "mean_set_jaccard": 0.8475274725274725, + "mean_token_weighted_tv": 0.034682473418517754, + "aggregate_load_tv": 0.06089743589743589 + }, + "period_at_s0": { + "tokens": 52, + "ordered_topk_exact_tokens": 26, + "set_exact_tokens": 34, + "mean_set_jaccard": 0.8969780219780219, + "mean_token_weighted_tv": 0.026358902400646072, + "aggregate_load_tv": 0.041666666666666664 + }, + "period_at_s1": { + "tokens": 52, + "ordered_topk_exact_tokens": 22, + "set_exact_tokens": 30, + "mean_set_jaccard": 0.875, + "mean_token_weighted_tv": 0.03157941561837036, + "aggregate_load_tv": 0.04807692307692307 + } + } + }, + "layer_04": { + "layer": 4, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "52f7eb7092f06629cdb0c69024783cc3362ed0a6c46abc152a70ebf6ad7a7291", + "route_weight_sha256": "92d115a28fd2fc6a443b69b89ee6b61a3f6e4ff8a2903839ead542e32f427928", + "loads": [ + 4, + 11, + 23, + 1, + 4, + 1, + 3, + 6, + 5, + 0, + 4, + 8, + 1, + 0, + 17, + 6, + 5, + 5, + 1, + 2, + 4, + 2, + 5, + 2, + 8, + 0, + 3, + 5, + 6, + 6, + 1, + 2, + 7, + 7, + 0, + 1, + 33, + 12, + 5, + 3, + 0, + 4, + 4, + 1, + 4, + 0, + 17, + 6, + 0, + 5, + 1, + 6, + 3, + 2, + 8, + 6, + 1, + 9, + 3, + 5, + 0, + 3, + 2, + 3 + ], + "weighted_loads": [ + 0.20728561282157898, + 0.475997481495142, + 2.2602390870451927, + 0.06350935250520706, + 0.22335052117705345, + 0.031916432082653046, + 0.11295659653842449, + 0.284550067037344, + 0.46447579190135, + 0.0, + 0.44193530827760696, + 0.5512276906520128, + 0.04056469351053238, + 0.0, + 2.3262120503932238, + 0.2998691201210022, + 0.5608543083071709, + 0.3766891211271286, + 0.06605049222707748, + 0.12427176907658577, + 0.359966941177845, + 0.1706617772579193, + 0.3734782226383686, + 0.24227844178676605, + 0.3315399382263422, + 0.0, + 0.4537578970193863, + 0.3101060464978218, + 0.42421838641166687, + 0.24328568764030933, + 0.11629605293273926, + 0.07375718280673027, + 0.7769693583250046, + 0.23540036380290985, + 0.0, + 0.05494116619229317, + 3.865576047450304, + 0.6197106149047613, + 0.372850950807333, + 0.2076055109500885, + 0.0, + 0.1753261536359787, + 0.17044853419065475, + 0.06616842746734619, + 0.40321608632802963, + 0.0, + 1.438369220122695, + 0.47728900611400604, + 0.0, + 0.22230836004018784, + 0.12704865634441376, + 0.364863570779562, + 0.2240748405456543, + 0.06758858636021614, + 0.41503317654132843, + 0.47278885170817375, + 0.02636338584125042, + 0.7923560403287411, + 0.23236217349767685, + 0.28667550534009933, + 0.0, + 0.17977282404899597, + 0.17820855975151062, + 0.17985711991786957 + ], + "unique_experts": 56, + "load_cv": 1.1383575836114417, + "normalized_load_entropy": 0.882440957092944, + "max_load_share": 0.10576923076923077 + }, + "full_input": { + "tokens": 77, + "top_k": 6, + "decisions": 462, + "ordered_route_sha256": "3e6fdb6e5f6143a66ae5e19bd84365050be55a866a18e7413e3f8cc736080424", + "route_weight_sha256": "e8d329758f399d04e1d972007c5286a00889fa043a1685e490c17b5a80ecad50", + "loads": [ + 4, + 14, + 25, + 5, + 4, + 1, + 4, + 6, + 5, + 0, + 14, + 10, + 1, + 13, + 19, + 9, + 5, + 5, + 5, + 2, + 4, + 4, + 7, + 2, + 8, + 6, + 8, + 6, + 6, + 24, + 2, + 4, + 7, + 9, + 11, + 1, + 33, + 14, + 8, + 3, + 3, + 6, + 12, + 1, + 4, + 1, + 28, + 7, + 1, + 7, + 3, + 6, + 3, + 2, + 8, + 6, + 1, + 9, + 3, + 18, + 4, + 3, + 5, + 3 + ], + "weighted_loads": [ + 0.20728561282157898, + 0.628597766160965, + 2.382138919085264, + 0.40327670736587606, + 0.22335052117705345, + 0.031916432082653046, + 0.1709564570337534, + 0.284550067037344, + 0.46447579190135, + 0.0, + 1.098911203444004, + 0.5777134289965034, + 0.04056469351053238, + 0.9344998709857464, + 2.3719664067029953, + 0.48632557317614555, + 0.5608543083071709, + 0.3766891211271286, + 0.32971892910427414, + 0.12427176907658577, + 0.359966941177845, + 1.236746907234192, + 0.5005516186356544, + 0.24227844178676605, + 0.3315399382263422, + 0.42229902371764183, + 0.9419872611761093, + 0.3180728890001774, + 0.42421838641166687, + 1.6021885053924052, + 0.16396994143724442, + 0.10467857867479324, + 0.7769693583250046, + 0.27559299394488335, + 1.009174834965961, + 0.05494116619229317, + 3.865576047450304, + 0.7161870766431093, + 1.5403431355953217, + 0.2076055109500885, + 0.13991666212677956, + 0.30185921490192413, + 0.5314774811267853, + 0.06616842746734619, + 0.40321608632802963, + 0.030036618933081627, + 2.590038551017642, + 0.5076773315668106, + 0.03672486171126366, + 0.2725843023508787, + 0.2163860723376274, + 0.364863570779562, + 0.2240748405456543, + 0.06758858636021614, + 0.41503317654132843, + 0.47278885170817375, + 0.02636338584125042, + 0.7923560403287411, + 0.23236217349767685, + 0.9910667594522238, + 0.4017873169213999, + 0.17977282404899597, + 0.4125969782471657, + 0.17985711991786957 + ], + "unique_experts": 63, + "load_cv": 0.9255467949400952, + "normalized_load_entropy": 0.9164937737234166, + "max_load_share": 0.07142857142857142 + } + }, + "s1_eos": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "39f74f5903848c7bf996e4180582d438fac5518af94502072e70a95693b2a179", + "route_weight_sha256": "f8d7a0cfb782ceab097caababf23fb44d76f0190d124e1e33832ec49f24a9f7d", + "loads": [ + 4, + 11, + 22, + 1, + 4, + 1, + 3, + 6, + 5, + 0, + 4, + 8, + 1, + 0, + 18, + 7, + 5, + 5, + 1, + 2, + 4, + 2, + 5, + 2, + 7, + 0, + 3, + 5, + 7, + 6, + 1, + 2, + 6, + 7, + 0, + 1, + 32, + 13, + 5, + 3, + 0, + 4, + 4, + 1, + 4, + 0, + 17, + 6, + 0, + 5, + 1, + 6, + 3, + 2, + 7, + 6, + 1, + 9, + 3, + 5, + 0, + 3, + 3, + 3 + ], + "weighted_loads": [ + 0.21033885329961777, + 0.4627477638423443, + 2.2066223472356796, + 0.062169402837753296, + 0.22867197543382645, + 0.03164888918399811, + 0.11513903364539146, + 0.27892426773905754, + 0.4783828742802143, + 0.0, + 0.43352238088846207, + 0.5617351848632097, + 0.03996555134654045, + 0.0, + 2.3423810862004757, + 0.33301301300525665, + 0.5596674755215645, + 0.37458378821611404, + 0.06371922045946121, + 0.1201288215816021, + 0.35999251529574394, + 0.16478790901601315, + 0.3763408102095127, + 0.23828592151403427, + 0.28438607417047024, + 0.0, + 0.4442935101687908, + 0.307878989726305, + 0.46316520124673843, + 0.24186171777546406, + 0.11253967881202698, + 0.06981990858912468, + 0.7378739342093468, + 0.23217502422630787, + 0.0, + 0.05493791401386261, + 3.7935194112360477, + 0.6538598891347647, + 0.38788872584700584, + 0.21059769578278065, + 0.0, + 0.18226295709609985, + 0.17206388339400291, + 0.06537044048309326, + 0.3968014344573021, + 0.0, + 1.4511418789625168, + 0.4667242616415024, + 0.0, + 0.22421866655349731, + 0.12381061911582947, + 0.37780047953128815, + 0.2170877903699875, + 0.06867771223187447, + 0.37843456119298935, + 0.46468963474035263, + 0.025156164541840553, + 0.7978733442723751, + 0.23724797740578651, + 0.2849564217031002, + 0.0, + 0.18192164599895477, + 0.21342948451638222, + 0.18176138401031494 + ], + "unique_experts": 56, + "load_cv": 1.1203103730745374, + "normalized_load_entropy": 0.8843330091256296, + "max_load_share": 0.10256410256410256 + }, + "full_input": { + "tokens": 93, + "top_k": 6, + "decisions": 558, + "ordered_route_sha256": "8b969fe9a47a368805f3e69edabebc222aa751c25672b2e3195ec70381bed596", + "route_weight_sha256": "00878d1038586b6a336ed8dd2164ad81c3ec28c0af9bd0e4ac40cea1f3bed8c4", + "loads": [ + 4, + 13, + 25, + 10, + 5, + 1, + 6, + 6, + 5, + 9, + 13, + 10, + 2, + 14, + 21, + 11, + 7, + 7, + 9, + 4, + 5, + 5, + 11, + 3, + 7, + 10, + 11, + 6, + 7, + 27, + 2, + 4, + 6, + 9, + 15, + 1, + 32, + 16, + 10, + 6, + 3, + 9, + 13, + 1, + 5, + 2, + 27, + 10, + 1, + 8, + 4, + 6, + 7, + 6, + 13, + 6, + 6, + 11, + 3, + 19, + 7, + 5, + 7, + 4 + ], + "weighted_loads": [ + 0.21033885329961777, + 0.5938824824988842, + 2.3769709654152393, + 0.8638137194502633, + 0.2596945334225893, + 0.03164888918399811, + 0.3280796930193901, + 0.27892426773905754, + 0.4783828742802143, + 1.07797596976161, + 1.020030453801155, + 0.5882536191493273, + 0.14090420678257942, + 0.9931229092180729, + 2.417398188263178, + 0.5992287956178188, + 0.9239934757351875, + 0.44526416808366776, + 0.6915121525526047, + 0.21033766865730286, + 0.4090305045247078, + 1.261602209880948, + 0.8214265592396259, + 0.33138347417116165, + 0.28438607417047024, + 0.7024915181100368, + 1.2107440494000912, + 0.31619944144040346, + 0.46316520124673843, + 1.515290055423975, + 0.15893908590078354, + 0.10040471889078617, + 0.7378739342093468, + 0.2728033596649766, + 1.3364648495044094, + 0.05493791401386261, + 3.7935194112360477, + 0.7888114657253027, + 1.7561726793646812, + 0.42225960455834866, + 0.15958108007907867, + 0.40753810123715084, + 0.5985707268118858, + 0.06537044048309326, + 0.4347623437643051, + 0.02968064195010811, + 2.6493563018739223, + 0.8052488677203655, + 0.029832590371370316, + 0.31092699244618416, + 0.2546808123588562, + 0.37780047953128815, + 0.6552460640668869, + 0.24977989494800568, + 0.933025635778904, + 0.46468963474035263, + 0.4463487435132265, + 0.8709787297993898, + 0.23724797740578651, + 1.0697362553328276, + 0.8918014653027058, + 0.3774356171488762, + 0.5200551375746727, + 0.2257254384458065 + ], + "unique_experts": 64, + "load_cv": 0.7462000617712435, + "normalized_load_entropy": 0.9419418496804748, + "max_load_share": 0.05734767025089606 + } + }, + "s0_bos": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "0f59fa51fe13ef1411f705ba27a45e816868d20d109f2a56893be5f49a34b672", + "route_weight_sha256": "f7a40dcf6f1905fefe620e1a69a479048ed6dd9dd905b95016871c38d2a3376a", + "loads": [ + 5, + 9, + 24, + 1, + 4, + 1, + 2, + 6, + 5, + 0, + 4, + 6, + 0, + 0, + 17, + 8, + 5, + 5, + 1, + 2, + 4, + 2, + 5, + 2, + 7, + 0, + 3, + 5, + 6, + 5, + 1, + 3, + 6, + 8, + 0, + 1, + 34, + 11, + 5, + 2, + 1, + 4, + 3, + 1, + 4, + 0, + 17, + 6, + 1, + 4, + 2, + 6, + 4, + 2, + 8, + 6, + 1, + 10, + 3, + 6, + 0, + 3, + 2, + 3 + ], + "weighted_loads": [ + 0.24586650356650352, + 0.38182846270501614, + 2.3819882832467556, + 0.06339728832244873, + 0.2232370860874653, + 0.030405811965465546, + 0.07528219558298588, + 0.28697829879820347, + 0.4691352806985378, + 0.0, + 0.43861542642116547, + 0.4917096719145775, + 0.0, + 0.0, + 2.2686645817011595, + 0.4048585668206215, + 0.5836821645498276, + 0.3864628076553345, + 0.05544818565249443, + 0.10982804000377655, + 0.3897366002202034, + 0.16002336516976357, + 0.3543057516217232, + 0.23983853310346603, + 0.3126888331025839, + 0.0, + 0.4396131932735443, + 0.33408380672335625, + 0.41237974539399147, + 0.19093970581889153, + 0.11473853886127472, + 0.11169357225298882, + 0.7804288677871227, + 0.2828858960419893, + 0.0, + 0.04974571615457535, + 3.9442324340343475, + 0.608286164700985, + 0.37890588492155075, + 0.1863395944237709, + 0.035702791064977646, + 0.1869417130947113, + 0.12517588771879673, + 0.06379459798336029, + 0.4147528409957886, + 0.0, + 1.41037873364985, + 0.46568234637379646, + 0.03480962663888931, + 0.17663029953837395, + 0.16465338319540024, + 0.36343032866716385, + 0.2559251543134451, + 0.07060954719781876, + 0.4193616695702076, + 0.46015748009085655, + 0.027728084474802017, + 0.8392960615456104, + 0.22125642374157906, + 0.3279406391084194, + 0.0, + 0.18722128868103027, + 0.150095347315073, + 0.17793874815106392 + ], + "unique_experts": 57, + "load_cv": 1.15441581379389, + "normalized_load_entropy": 0.8836113418794509, + "max_load_share": 0.10897435897435898 + }, + "full_input": { + "tokens": 77, + "top_k": 6, + "decisions": 462, + "ordered_route_sha256": "660cbe46302ec3fad5d2cef44973b02a9c922711ef7da936783d5804cfa4d705", + "route_weight_sha256": "454edd1d14dd1e6d91ca345d235d18c4406f135f9a018c144ac0eca929f6441e", + "loads": [ + 5, + 12, + 26, + 6, + 4, + 1, + 3, + 6, + 5, + 0, + 14, + 7, + 0, + 13, + 19, + 11, + 5, + 5, + 6, + 2, + 4, + 3, + 7, + 2, + 7, + 6, + 8, + 5, + 6, + 24, + 2, + 4, + 6, + 9, + 12, + 1, + 34, + 13, + 8, + 3, + 4, + 6, + 11, + 1, + 4, + 1, + 28, + 7, + 2, + 5, + 4, + 6, + 4, + 2, + 8, + 6, + 1, + 10, + 3, + 19, + 5, + 3, + 5, + 3 + ], + "weighted_loads": [ + 0.24586650356650352, + 0.5293811578303576, + 2.503888115286827, + 0.4563572884944733, + 0.2232370860874653, + 0.030405811965465546, + 0.12821105308830738, + 0.28697829879820347, + 0.4691352806985378, + 0.0, + 1.0955913215875626, + 0.5088069755584002, + 0.0, + 0.9271319508552551, + 2.314418938010931, + 0.5894525535404682, + 0.5836821645498276, + 0.3864628076553345, + 0.4359182122570928, + 0.10982804000377655, + 0.3897366002202034, + 0.450713399797678, + 0.4799371734261513, + 0.23983853310346603, + 0.3126888331025839, + 0.4372449293732643, + 0.9423017352819443, + 0.33408380672335625, + 0.41237974539399147, + 1.715923508789274, + 0.1598959118127823, + 0.1300615854561329, + 0.7804288677871227, + 0.308198532089591, + 1.0902953855984379, + 0.04974571615457535, + 3.9442324340343475, + 0.7018194682896137, + 1.5350695736706257, + 0.21920818090438843, + 0.1756194531917572, + 0.3169504776597023, + 0.48620483465492725, + 0.06379459798336029, + 0.4147528409957886, + 0.030036618933081627, + 2.562048064544797, + 0.4996296800673008, + 0.07153448835015297, + 0.204606669023633, + 0.2553418464958668, + 0.36343032866716385, + 0.2559251543134451, + 0.07060954719781876, + 0.4193616695702076, + 0.46015748009085655, + 0.027728084474802017, + 0.8392960615456104, + 0.22125642374157906, + 1.0312654431909323, + 0.6016383008391131, + 0.18722128868103027, + 0.38499488681554794, + 0.17793874815106392 + ], + "unique_experts": 62, + "load_cv": 0.9368169413082181, + "normalized_load_entropy": 0.9153126405770469, + "max_load_share": 0.0735930735930736 + } + }, + "s1_bos": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "99b7770cd68719ac947a4608d68168aa23d841af82708221b84f9525173cd0eb", + "route_weight_sha256": "42c2e7f6fd11c61861a9fbfa98b70dca73ca4075503c962cd939894475d58212", + "loads": [ + 6, + 8, + 24, + 1, + 4, + 1, + 2, + 6, + 5, + 0, + 4, + 10, + 0, + 0, + 17, + 7, + 5, + 5, + 1, + 2, + 4, + 3, + 5, + 2, + 7, + 0, + 4, + 4, + 6, + 3, + 1, + 3, + 6, + 8, + 0, + 1, + 34, + 12, + 5, + 2, + 0, + 4, + 3, + 1, + 4, + 0, + 17, + 6, + 1, + 4, + 1, + 6, + 3, + 2, + 8, + 6, + 1, + 10, + 3, + 6, + 0, + 3, + 2, + 3 + ], + "weighted_loads": [ + 0.2697978727519512, + 0.31537456065416336, + 2.406753869727254, + 0.06007599085569382, + 0.2297778557986021, + 0.027401117607951164, + 0.07282602600753307, + 0.288412356749177, + 0.4891760125756264, + 0.0, + 0.4152088165283203, + 0.6613081246614456, + 0.0, + 0.0, + 2.3183187674731016, + 0.35338157415390015, + 0.6155900843441486, + 0.39047418534755707, + 0.050480879843235016, + 0.09832080081105232, + 0.392769455909729, + 0.18321838416159153, + 0.34617049247026443, + 0.24050705879926682, + 0.30535655468702316, + 0.0, + 0.4826774299144745, + 0.2920283414423466, + 0.4215241279453039, + 0.08948371931910515, + 0.1080223098397255, + 0.10473142564296722, + 0.8173339124768972, + 0.2755577303469181, + 0.0, + 0.043540578335523605, + 3.9233301393687725, + 0.6267747618257999, + 0.36692241579294205, + 0.19508877396583557, + 0.0, + 0.1901758499443531, + 0.1285109743475914, + 0.061554763466119766, + 0.41941656172275543, + 0.0, + 1.4031994603574276, + 0.4641713537275791, + 0.029895249754190445, + 0.18074694275856018, + 0.12195988744497299, + 0.37824852764606476, + 0.21941304951906204, + 0.06745325401425362, + 0.41964052245020866, + 0.4586263857781887, + 0.02884136699140072, + 0.8413480669260025, + 0.22565216198563576, + 0.3229541666805744, + 0.0, + 0.19361786171793938, + 0.1444334238767624, + 0.17369252815842628 + ], + "unique_experts": 56, + "load_cv": 1.1663144015942728, + "normalized_load_entropy": 0.8793441964868461, + "max_load_share": 0.10897435897435898 + }, + "full_input": { + "tokens": 93, + "top_k": 6, + "decisions": 558, + "ordered_route_sha256": "d1495510150f56f9e51db34cddb11488a57c0dc5ee4ffd245c78896598e65a7d", + "route_weight_sha256": "5d0c5ffddba93b0a674628435cd17769a9a0933090e6994f66bdcb3b2defe1dc", + "loads": [ + 6, + 10, + 27, + 11, + 5, + 1, + 5, + 6, + 5, + 9, + 13, + 11, + 1, + 14, + 20, + 11, + 7, + 7, + 9, + 4, + 5, + 5, + 11, + 3, + 7, + 10, + 12, + 4, + 6, + 24, + 2, + 4, + 6, + 9, + 16, + 1, + 35, + 15, + 9, + 6, + 3, + 9, + 12, + 1, + 5, + 2, + 28, + 10, + 2, + 6, + 4, + 6, + 7, + 6, + 14, + 6, + 6, + 12, + 3, + 20, + 9, + 5, + 6, + 4 + ], + "weighted_loads": [ + 0.2697978727519512, + 0.4429517537355423, + 2.5771024879068136, + 0.9066910694527905, + 0.26648680679500103, + 0.027401117607951164, + 0.26797552965581417, + 0.288412356749177, + 0.4891760125756264, + 1.07797596976161, + 1.0017168894410133, + 0.6784054283052683, + 0.10093865543603897, + 0.9808505475521088, + 2.393335869535804, + 0.6314481720328331, + 0.9799160845577717, + 0.4611545652151108, + 0.7466176673769951, + 0.18852964788675308, + 0.44180744513869286, + 0.5143455173820257, + 0.789799802005291, + 0.3336046114563942, + 0.30535655468702316, + 0.6796901598572731, + 1.263538584113121, + 0.2920283414423466, + 0.4215241279453039, + 1.4042812008410692, + 0.1545051485300064, + 0.1230994388461113, + 0.8173339124768972, + 0.3008703663945198, + 1.370067593845306, + 0.043540578335523605, + 3.9567438028752804, + 0.7606910690665245, + 1.6899330355226994, + 0.44279247522354126, + 0.15958108007907867, + 0.4188999274483649, + 0.5550178177654743, + 0.061554763466119766, + 0.45737747102975845, + 0.02968064195010811, + 2.6496294885873795, + 0.8026959598064423, + 0.05972784012556076, + 0.24453908763825893, + 0.25498102232813835, + 0.37824852764606476, + 0.6575713232159615, + 0.24855543673038483, + 0.9742315970361233, + 0.4586263857781887, + 0.4500339459627867, + 0.9144534524530172, + 0.22565216198563576, + 1.107257692143321, + 1.1285817958414555, + 0.3891318328678608, + 0.4618980549275875, + 0.21765658259391785 + ], + "unique_experts": 64, + "load_cv": 0.7697920146976504, + "normalized_load_entropy": 0.9395646972126475, + "max_load_share": 0.06272401433691756 + } + }, + "s0_x": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "00b6b35244db8fa7b5af77348b7755b6e23d6aeb9a086a388c01e5bba5f43c4a", + "route_weight_sha256": "52ec75b1e63bfd61161945e819ffb7e11b6373ed6f0b765ac691e0bd910ec038", + "loads": [ + 5, + 8, + 24, + 1, + 4, + 2, + 2, + 5, + 5, + 0, + 4, + 5, + 1, + 0, + 16, + 8, + 5, + 5, + 1, + 2, + 4, + 2, + 5, + 2, + 9, + 0, + 4, + 5, + 5, + 3, + 1, + 3, + 6, + 7, + 0, + 1, + 34, + 12, + 5, + 2, + 1, + 4, + 3, + 1, + 4, + 0, + 17, + 6, + 4, + 4, + 2, + 6, + 3, + 2, + 7, + 6, + 1, + 10, + 3, + 7, + 0, + 3, + 2, + 3 + ], + "weighted_loads": [ + 0.24309000745415688, + 0.3492756225168705, + 2.400449827313423, + 0.0629359558224678, + 0.21595634892582893, + 0.059694891795516014, + 0.07767939008772373, + 0.24981914833188057, + 0.4563867934048176, + 0.0, + 0.4339510276913643, + 0.44152871891856194, + 0.02524920552968979, + 0.0, + 2.2292740792036057, + 0.3987661488354206, + 0.6022894196212292, + 0.3844266012310982, + 0.05519158020615578, + 0.11539730802178383, + 0.37464436143636703, + 0.15866785682737827, + 0.3823813125491142, + 0.23374085873365402, + 0.39006875455379486, + 0.0, + 0.540602833032608, + 0.33523116260766983, + 0.3884105794131756, + 0.08992617577314377, + 0.11528501659631729, + 0.10886520892381668, + 0.7606824114918709, + 0.24053518660366535, + 0.0, + 0.04941600561141968, + 3.928497213870287, + 0.6149451080709696, + 0.3754686564207077, + 0.19063114374876022, + 0.037400759756565094, + 0.19377196207642555, + 0.13199781253933907, + 0.062442973256111145, + 0.42023733258247375, + 0.0, + 1.390706267207861, + 0.4663347452878952, + 0.14121289551258087, + 0.1747746467590332, + 0.16137196496129036, + 0.3559787906706333, + 0.2402871623635292, + 0.06967695243656635, + 0.3925396278500557, + 0.4635007977485657, + 0.028805233538150787, + 0.8306143507361412, + 0.22698808833956718, + 0.36982671543955803, + 0.0, + 0.1902460679411888, + 0.1578560434281826, + 0.18071284890174866 + ], + "unique_experts": 58, + "load_cv": 1.1423933030741262, + "normalized_load_entropy": 0.8885702247614361, + "max_load_share": 0.10897435897435898 + }, + "full_input": { + "tokens": 77, + "top_k": 6, + "decisions": 462, + "ordered_route_sha256": "48753235d9d0625c61db2537dbccf2dab82e214fdb557d361032e8cc922820e0", + "route_weight_sha256": "e3458b3a15c56ea1cc59a94046c412094d19a5cf8cba5ad53ee90886167b861b", + "loads": [ + 5, + 12, + 27, + 5, + 4, + 2, + 2, + 5, + 5, + 0, + 15, + 6, + 1, + 12, + 18, + 11, + 5, + 5, + 5, + 2, + 4, + 3, + 7, + 2, + 9, + 6, + 9, + 5, + 5, + 19, + 2, + 4, + 6, + 8, + 10, + 1, + 34, + 14, + 7, + 4, + 5, + 6, + 12, + 1, + 4, + 1, + 30, + 7, + 6, + 5, + 4, + 6, + 3, + 2, + 7, + 6, + 1, + 10, + 3, + 21, + 5, + 3, + 5, + 3 + ], + "weighted_loads": [ + 0.24309000745415688, + 0.5425675809383392, + 2.5533085204660892, + 0.41989284320152365, + 0.21595634892582893, + 0.059694891795516014, + 0.07767939008772373, + 0.24981914833188057, + 0.4563867934048176, + 0.0, + 1.30705476552248, + 0.4586260225623846, + 0.02524920552968979, + 0.890140239149332, + 2.275028435513377, + 0.5926540233194828, + 0.6022894196212292, + 0.3844266012310982, + 0.29303072424954735, + 0.11539730802178383, + 0.37464436143636703, + 0.4493578914552927, + 0.5205514878034592, + 0.23374085873365402, + 0.39006875455379486, + 0.3696969412267208, + 1.0817100554704666, + 0.33523116260766983, + 0.3884105794131756, + 1.3204710466525285, + 0.1679709553718567, + 0.12723322212696075, + 0.7606824114918709, + 0.26584782265126705, + 0.8710586987726856, + 0.04941600561141968, + 3.928497213870287, + 0.7089728247374296, + 1.4858065396547318, + 0.2512352652847767, + 0.23411820456385612, + 0.3243725411593914, + 0.5286171734333038, + 0.062442973256111145, + 0.42023733258247375, + 0.030036618933081627, + 2.78666028752923, + 0.5010790079832077, + 0.22102126851677895, + 0.20275101624429226, + 0.25580810010433197, + 0.3559787906706333, + 0.2402871623635292, + 0.06967695243656635, + 0.3925396278500557, + 0.4635007977485657, + 0.028805233538150787, + 0.8306143507361412, + 0.22698808833956718, + 1.1457415651530027, + 0.4342659735411871, + 0.1902460679411888, + 0.38855988532304764, + 0.18071284890174866 + ], + "unique_experts": 63, + "load_cv": 0.9355357961492315, + "normalized_load_entropy": 0.9179464781101305, + "max_load_share": 0.0735930735930736 + } + }, + "s1_x": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "87fbb3173605470a8819c48b3822e729b15384f20d9fe23644a7eaf34f3a1497", + "route_weight_sha256": "61bf3e4e3d83a935e37f969c9c31ca3bbe1a67022d59878400a976b3c89b9377", + "loads": [ + 5, + 7, + 25, + 1, + 4, + 1, + 2, + 6, + 5, + 0, + 4, + 9, + 1, + 0, + 16, + 7, + 5, + 5, + 1, + 2, + 4, + 3, + 5, + 2, + 8, + 0, + 4, + 5, + 6, + 2, + 1, + 3, + 7, + 6, + 0, + 1, + 34, + 12, + 5, + 2, + 0, + 4, + 3, + 1, + 4, + 0, + 17, + 6, + 3, + 4, + 1, + 6, + 3, + 2, + 8, + 6, + 1, + 10, + 3, + 6, + 0, + 3, + 2, + 3 + ], + "weighted_loads": [ + 0.23576630279421806, + 0.2813333794474602, + 2.4982421658933163, + 0.06181982904672623, + 0.22861419804394245, + 0.02907498925924301, + 0.07111907191574574, + 0.28601176477968693, + 0.47987352684140205, + 0.0, + 0.40963783860206604, + 0.6054988708347082, + 0.02547859214246273, + 0.0, + 2.2921260725706816, + 0.35377687960863113, + 0.6265631206333637, + 0.38903044536709785, + 0.05198714882135391, + 0.09784660115838051, + 0.3846147283911705, + 0.18621383793652058, + 0.35436683148145676, + 0.2378871664404869, + 0.3540843427181244, + 0.0, + 0.5070085413753986, + 0.32452087476849556, + 0.41447014920413494, + 0.05801818333566189, + 0.10742919892072678, + 0.10114002227783203, + 0.8475325684994459, + 0.20505743101239204, + 0.0, + 0.04231330752372742, + 3.8532239757478237, + 0.6108064819127321, + 0.3496978133916855, + 0.19839700311422348, + 0.0, + 0.19347478821873665, + 0.1252459418028593, + 0.06126601994037628, + 0.42201535403728485, + 0.0, + 1.3945600613951683, + 0.4719269499182701, + 0.09182559698820114, + 0.1814359910786152, + 0.12174733728170395, + 0.38143041729927063, + 0.23656396567821503, + 0.067171735689044, + 0.43170252069830894, + 0.45951689407229424, + 0.029406573623418808, + 0.8382375203073025, + 0.22589176148176193, + 0.32329875975847244, + 0.0, + 0.19456813484430313, + 0.14567653462290764, + 0.17501363903284073 + ], + "unique_experts": 57, + "load_cv": 1.1617959753035068, + "normalized_load_entropy": 0.8829545218667276, + "max_load_share": 0.10897435897435898 + }, + "full_input": { + "tokens": 93, + "top_k": 6, + "decisions": 558, + "ordered_route_sha256": "294aeee2391767e545c7e1d424b8411a456a991563634072cba1291e5493c5ce", + "route_weight_sha256": "31b19e6d6cddfabe6bbcad84fcbb2c9cfced646af8649a6adc1d7eee22bd2cca", + "loads": [ + 5, + 10, + 29, + 10, + 5, + 1, + 4, + 6, + 5, + 9, + 14, + 10, + 2, + 13, + 19, + 11, + 7, + 7, + 8, + 4, + 5, + 5, + 11, + 3, + 8, + 10, + 12, + 5, + 6, + 22, + 2, + 4, + 7, + 7, + 14, + 1, + 35, + 15, + 9, + 5, + 4, + 9, + 13, + 1, + 5, + 2, + 29, + 11, + 4, + 6, + 4, + 6, + 7, + 6, + 14, + 6, + 6, + 12, + 3, + 21, + 8, + 5, + 6, + 5 + ], + "weighted_loads": [ + 0.23576630279421806, + 0.45597829669713974, + 2.703525546938181, + 0.8694603431213181, + 0.26575889997184277, + 0.02907498925924301, + 0.21634245477616787, + 0.28601176477968693, + 0.47987352684140205, + 1.07797596976161, + 1.1857751086354256, + 0.6225961744785309, + 0.1264172475785017, + 0.9420130215585232, + 2.3671431746333838, + 0.6351683251559734, + 0.9908891208469868, + 0.45971082523465157, + 0.5861858129501343, + 0.18805544823408127, + 0.43365271762013435, + 0.5173409711569548, + 0.8003341779112816, + 0.3309847190976143, + 0.3540843427181244, + 0.6267662569880486, + 1.3029601834714413, + 0.32452087476849556, + 0.41447014920413494, + 1.1961994543671608, + 0.16250012069940567, + 0.1195080354809761, + 0.8475325684994459, + 0.23037006705999374, + 1.145793737116037, + 0.04231330752372742, + 3.888252541422844, + 0.7464064341038465, + 1.661779973655939, + 0.4100589118897915, + 0.21417035534977913, + 0.425950225602719, + 0.5916208159178495, + 0.06126601994037628, + 0.4599762633442879, + 0.02968064195010811, + 2.847765017300844, + 0.8431860506534576, + 0.12165818735957146, + 0.24522813595831394, + 0.255982231348753, + 0.38143041729927063, + 0.6747222393751144, + 0.2482739184051752, + 0.9862935952842236, + 0.45951689407229424, + 0.45059915259480476, + 0.9113429058343172, + 0.22589176148176193, + 1.173311872407794, + 0.9036894515156746, + 0.39008210599422455, + 0.4495082348585129, + 0.25207172706723213 + ], + "unique_experts": 64, + "load_cv": 0.7689905478359702, + "normalized_load_entropy": 0.9413333816583315, + "max_load_share": 0.06272401433691756 + } + }, + "s0_period": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "d341aad8e6b99faaef9be85bf3bca74d3c9e8a388e85fb49f5167b465cd38f1d", + "route_weight_sha256": "7d507d5aaf8c60e773a8f87632701b7c287c5d5934917aa5643700e9fbad593a", + "loads": [ + 5, + 8, + 23, + 1, + 4, + 2, + 3, + 5, + 5, + 0, + 4, + 4, + 0, + 0, + 16, + 8, + 5, + 5, + 1, + 2, + 4, + 2, + 5, + 2, + 9, + 0, + 4, + 5, + 5, + 3, + 1, + 2, + 6, + 6, + 0, + 1, + 34, + 13, + 5, + 2, + 1, + 4, + 4, + 1, + 4, + 0, + 17, + 6, + 4, + 4, + 2, + 6, + 3, + 2, + 9, + 6, + 1, + 10, + 3, + 7, + 0, + 3, + 2, + 3 + ], + "weighted_loads": [ + 0.24263110011816025, + 0.35564152151346207, + 2.3579207751899958, + 0.06178213283419609, + 0.21687393449246883, + 0.060253897681832314, + 0.10823334194719791, + 0.25561922416090965, + 0.466194961220026, + 0.0, + 0.4323253408074379, + 0.41268293745815754, + 0.0, + 0.0, + 2.231396282091737, + 0.40021342411637306, + 0.60330431163311, + 0.3839205242693424, + 0.05502988025546074, + 0.11587941274046898, + 0.3738717548549175, + 0.15692144632339478, + 0.3619556874036789, + 0.2317158356308937, + 0.38552311435341835, + 0.0, + 0.5312439613044262, + 0.3315965607762337, + 0.38897086307406425, + 0.08462619595229626, + 0.11336025595664978, + 0.07649977877736092, + 0.765468243509531, + 0.2077654991298914, + 0.0, + 0.04864504188299179, + 3.861999614164233, + 0.6614064686000347, + 0.3656080923974514, + 0.19038905948400497, + 0.03755718842148781, + 0.1919996291399002, + 0.16373667865991592, + 0.06310513615608215, + 0.41988736391067505, + 0.0, + 1.3864086456596851, + 0.4678421728312969, + 0.13515464961528778, + 0.17747250944375992, + 0.15948747098445892, + 0.3534383364021778, + 0.24049406498670578, + 0.06926455907523632, + 0.46549234725534916, + 0.46718984097242355, + 0.029659980908036232, + 0.8321659937500954, + 0.22048357501626015, + 0.3655308894813061, + 0.0, + 0.19066715613007545, + 0.1611153669655323, + 0.17945338785648346 + ], + "unique_experts": 57, + "load_cv": 1.1406654574120627, + "normalized_load_entropy": 0.8867216166251727, + "max_load_share": 0.10897435897435898 + }, + "full_input": { + "tokens": 77, + "top_k": 6, + "decisions": 462, + "ordered_route_sha256": "4b54e4690d5a12207db7fc3962833a776368c876be4cee625a8bf52a81cb669e", + "route_weight_sha256": "6637312e76957e2c698147bf9e8c744357bcba32ce57438408f3ea1e0dd168e9", + "loads": [ + 5, + 12, + 25, + 5, + 4, + 2, + 3, + 5, + 5, + 0, + 14, + 5, + 0, + 12, + 18, + 11, + 5, + 5, + 5, + 2, + 4, + 3, + 8, + 2, + 9, + 6, + 10, + 5, + 5, + 20, + 2, + 3, + 6, + 7, + 10, + 1, + 34, + 15, + 7, + 4, + 4, + 6, + 12, + 1, + 4, + 1, + 29, + 7, + 6, + 5, + 4, + 7, + 4, + 2, + 9, + 6, + 1, + 10, + 3, + 21, + 5, + 3, + 5, + 3 + ], + "weighted_loads": [ + 0.24263110011816025, + 0.5582320727407932, + 2.4798206072300673, + 0.41363305537379347, + 0.21687393449246883, + 0.060253897681832314, + 0.10823334194719791, + 0.25561922416090965, + 0.466194961220026, + 0.0, + 1.089301235973835, + 0.4297802411019802, + 0.0, + 0.8670019842684269, + 2.2771506384015083, + 0.57692064717412, + 0.60330431163311, + 0.3839205242693424, + 0.29150825025863014, + 0.11587941274046898, + 0.3738717548549175, + 0.4476114809513092, + 0.5294506810605526, + 0.2317158356308937, + 0.38552311435341835, + 0.35347839444875717, + 1.335782278329134, + 0.3315965607762337, + 0.38897086307406425, + 1.3343506121746032, + 0.1675654947757721, + 0.09486779198050499, + 0.765468243509531, + 0.2330781351774931, + 0.8565436676435638, + 0.04864504188299179, + 3.861999614164233, + 0.7551344186067581, + 1.4931172393262386, + 0.2517252266407013, + 0.17747385054826736, + 0.3197328820824623, + 0.5247656255960464, + 0.06310513615608215, + 0.41988736391067505, + 0.030036618933081627, + 2.698697056621313, + 0.5017574951052666, + 0.2260415144264698, + 0.20544887892901897, + 0.25216130167245865, + 0.4807501472532749, + 0.30490339547395706, + 0.06926455907523632, + 0.46549234725534916, + 0.46718984097242355, + 0.029659980908036232, + 0.8321659937500954, + 0.22048357501626015, + 1.1450192835181952, + 0.4276088425249327, + 0.19066715613007545, + 0.39149774238467216, + 0.17945338785648346 + ], + "unique_experts": 62, + "load_cv": 0.92327625727311, + "normalized_load_entropy": 0.9179206012121865, + "max_load_share": 0.0735930735930736 + } + }, + "s1_period": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "8ce6a2d2825481d83899d4cb229157144a460255aebd989646d110006b7c1ab8", + "route_weight_sha256": "ef0ae12fadf97ac73f096663f93020798d154f36dba25aa02a0d0ae8bbbf1a88", + "loads": [ + 5, + 8, + 25, + 1, + 4, + 1, + 2, + 6, + 5, + 0, + 4, + 10, + 1, + 0, + 17, + 7, + 5, + 5, + 1, + 2, + 4, + 3, + 5, + 2, + 8, + 0, + 4, + 5, + 6, + 0, + 1, + 3, + 7, + 6, + 0, + 1, + 33, + 13, + 5, + 3, + 0, + 4, + 3, + 1, + 4, + 0, + 18, + 6, + 0, + 4, + 1, + 6, + 3, + 2, + 8, + 6, + 1, + 10, + 3, + 6, + 0, + 3, + 2, + 3 + ], + "weighted_loads": [ + 0.23725558072328568, + 0.31803034618496895, + 2.480751521885395, + 0.06168774515390396, + 0.23154543340206146, + 0.029294125735759735, + 0.06965663656592369, + 0.2879589609801769, + 0.4834861159324646, + 0.0, + 0.4236904978752136, + 0.6346457097679377, + 0.02493963949382305, + 0.0, + 2.3337277583777905, + 0.35127322003245354, + 0.6206904426217079, + 0.38812755048274994, + 0.052240047603845596, + 0.09794993698596954, + 0.3839423395693302, + 0.18200394324958324, + 0.34237945824861526, + 0.23505094647407532, + 0.356349591165781, + 0.0, + 0.5042140707373619, + 0.3216225393116474, + 0.414524644613266, + 0.0, + 0.10786010324954987, + 0.10232321545481682, + 0.8455559853464365, + 0.20680290274322033, + 0.0, + 0.04127829149365425, + 3.8405917957425117, + 0.6530707776546478, + 0.3466797322034836, + 0.23364710994064808, + 0.0, + 0.19330808147788048, + 0.1243372280150652, + 0.06205540522933006, + 0.41952741146087646, + 0.0, + 1.4359064418822527, + 0.4737420454621315, + 0.0, + 0.182937603443861, + 0.12103018909692764, + 0.37172214314341545, + 0.23183254897594452, + 0.06779847107827663, + 0.4322611577808857, + 0.45607201755046844, + 0.02951403521001339, + 0.8295575492084026, + 0.2240946888923645, + 0.3211193047463894, + 0.0, + 0.19447147846221924, + 0.14911777898669243, + 0.17151208594441414 + ], + "unique_experts": 55, + "load_cv": 1.1764174099440474, + "normalized_load_entropy": 0.8751155490189985, + "max_load_share": 0.10576923076923077 + }, + "full_input": { + "tokens": 93, + "top_k": 6, + "decisions": 558, + "ordered_route_sha256": "750d5c0d420f19221ff82d9c0b2388d0de300d28012d027c31369d86c8f4646e", + "route_weight_sha256": "2876c00c8c6efb5ef79d52083cf63038cd57bc3f5d9cf781d860e79171d88b85", + "loads": [ + 5, + 11, + 28, + 10, + 5, + 1, + 4, + 6, + 5, + 9, + 13, + 11, + 2, + 13, + 20, + 11, + 7, + 7, + 8, + 4, + 5, + 5, + 12, + 3, + 8, + 10, + 13, + 5, + 6, + 20, + 2, + 4, + 7, + 7, + 13, + 1, + 34, + 17, + 9, + 6, + 3, + 9, + 12, + 1, + 5, + 2, + 29, + 11, + 1, + 6, + 4, + 7, + 8, + 6, + 14, + 6, + 6, + 12, + 3, + 21, + 8, + 5, + 6, + 6 + ], + "weighted_loads": [ + 0.23725558072328568, + 0.4821372255682945, + 2.6511001400649548, + 0.8716379690158647, + 0.26588549837470055, + 0.029294125735759735, + 0.21488001942634583, + 0.2879589609801769, + 0.4834861159324646, + 1.07797596976161, + 1.0101985707879066, + 0.6517430134117603, + 0.12587829492986202, + 0.9141652025282383, + 2.4087448604404926, + 0.6386636309325695, + 0.985016442835331, + 0.45880793035030365, + 0.5888990052044392, + 0.1881587840616703, + 0.43298032879829407, + 0.5131310764700174, + 0.8215372040867805, + 0.3281484991312027, + 0.356349591165781, + 0.5956954266875982, + 1.602362982928753, + 0.3216225393116474, + 0.414524644613266, + 1.1258705873042345, + 0.16094741225242615, + 0.12069122865796089, + 0.8455559853464365, + 0.23211553879082203, + 1.0914634440268856, + 0.04127829149365425, + 3.8775403387844563, + 0.8313297256827354, + 1.6644386909902096, + 0.4453090187162161, + 0.15958108007907867, + 0.42106298000726383, + 0.5508440714329481, + 0.06205540522933006, + 0.4574883207678795, + 0.02968064195010811, + 2.742621323093772, + 0.8433027863502502, + 0.029832590371370316, + 0.24672974832355976, + 0.2538147419691086, + 0.4669303484261036, + 0.7227979749441147, + 0.24890065379440784, + 0.9868522323668003, + 0.45607201755046844, + 0.45070661418139935, + 0.9026629347354174, + 0.2240946888923645, + 1.2245352920144796, + 0.902898795902729, + 0.38998544961214066, + 0.4658849574625492, + 0.2805533595383167 + ], + "unique_experts": 64, + "load_cv": 0.7598481774061462, + "normalized_load_entropy": 0.9409147893366128, + "max_load_share": 0.06093189964157706 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 52, + "ordered_topk_exact_tokens": 45, + "set_exact_tokens": 47, + "mean_set_jaccard": 0.9725274725274726, + "mean_token_weighted_tv": 0.008339825337036299, + "aggregate_load_tv": 0.016025641025641024 + }, + "system_bos": { + "tokens": 52, + "ordered_topk_exact_tokens": 36, + "set_exact_tokens": 41, + "mean_set_jaccard": 0.9354395604395607, + "mean_token_weighted_tv": 0.01740189009489348, + "aggregate_load_tv": 0.02564102564102564 + }, + "system_x": { + "tokens": 52, + "ordered_topk_exact_tokens": 36, + "set_exact_tokens": 41, + "mean_set_jaccard": 0.9395604395604397, + "mean_token_weighted_tv": 0.018156861510271065, + "aggregate_load_tv": 0.03205128205128205 + }, + "system_period": { + "tokens": 52, + "ordered_topk_exact_tokens": 31, + "set_exact_tokens": 34, + "mean_set_jaccard": 0.9010989010989012, + "mean_token_weighted_tv": 0.020975965755776718, + "aggregate_load_tv": 0.054487179487179495 + }, + "bos_at_s0": { + "tokens": 52, + "ordered_topk_exact_tokens": 30, + "set_exact_tokens": 34, + "mean_set_jaccard": 0.9010989010989012, + "mean_token_weighted_tv": 0.025017566029698804, + "aggregate_load_tv": 0.041666666666666664 + }, + "bos_at_s1": { + "tokens": 52, + "ordered_topk_exact_tokens": 24, + "set_exact_tokens": 28, + "mean_set_jaccard": 0.8681318681318682, + "mean_token_weighted_tv": 0.030877646130438034, + "aggregate_load_tv": 0.05128205128205129 + }, + "x_at_s0": { + "tokens": 52, + "ordered_topk_exact_tokens": 26, + "set_exact_tokens": 29, + "mean_set_jaccard": 0.8695054945054946, + "mean_token_weighted_tv": 0.029156028830374662, + "aggregate_load_tv": 0.057692307692307696 + }, + "x_at_s1": { + "tokens": 52, + "ordered_topk_exact_tokens": 23, + "set_exact_tokens": 25, + "mean_set_jaccard": 0.8475274725274725, + "mean_token_weighted_tv": 0.034347711972749, + "aggregate_load_tv": 0.0576923076923077 + }, + "period_at_s0": { + "tokens": 52, + "ordered_topk_exact_tokens": 30, + "set_exact_tokens": 32, + "mean_set_jaccard": 0.885989010989011, + "mean_token_weighted_tv": 0.026924130614273824, + "aggregate_load_tv": 0.057692307692307696 + }, + "period_at_s1": { + "tokens": 52, + "ordered_topk_exact_tokens": 22, + "set_exact_tokens": 28, + "mean_set_jaccard": 0.8681318681318682, + "mean_token_weighted_tv": 0.0313361557200551, + "aggregate_load_tv": 0.05128205128205129 + } + } + }, + "layer_05": { + "layer": 5, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "a1360cc363a957741ee4e87e50de39dedaf5527c73a10f392e41feb2ec9846ce", + "route_weight_sha256": "da944ae3a363580ecae721453d9453048e49b3f20c9149afe74b5434cc58d3f5", + "loads": [ + 5, + 2, + 11, + 2, + 0, + 0, + 0, + 2, + 13, + 5, + 3, + 2, + 2, + 5, + 3, + 6, + 7, + 3, + 1, + 7, + 14, + 1, + 0, + 3, + 3, + 0, + 7, + 6, + 3, + 4, + 5, + 2, + 2, + 8, + 14, + 7, + 3, + 0, + 0, + 1, + 8, + 0, + 13, + 2, + 12, + 6, + 4, + 8, + 3, + 0, + 0, + 2, + 1, + 5, + 16, + 12, + 6, + 5, + 2, + 6, + 5, + 13, + 5, + 16 + ], + "weighted_loads": [ + 0.3369220308959484, + 0.05614655092358589, + 0.603973988443613, + 0.13788753747940063, + 0.0, + 0.0, + 0.0, + 0.15382648259401321, + 1.878781571984291, + 0.2073474731296301, + 0.10415402054786682, + 0.09376357309520245, + 0.16346056014299393, + 0.28053683042526245, + 0.10284418798983097, + 0.36594192683696747, + 0.3165712505578995, + 0.16377432644367218, + 0.027994578704237938, + 0.3847192171961069, + 2.1102240942418575, + 0.09968318790197372, + 0.0, + 0.2910109832882881, + 0.2143099084496498, + 0.0, + 0.39029440842568874, + 0.5904709808528423, + 0.2425365336239338, + 0.3495648726820946, + 0.4125404432415962, + 0.05905748903751373, + 0.06751851551234722, + 0.3617269676178694, + 1.0850437581539154, + 0.34333901666104794, + 0.23877839744091034, + 0.0, + 0.0, + 0.049186624586582184, + 1.1284458730369806, + 0.0, + 0.943028200417757, + 0.1818665713071823, + 0.9250468723475933, + 0.45582929253578186, + 0.1852513700723648, + 0.316524026915431, + 0.2798778899013996, + 0.0, + 0.0, + 0.07982908561825752, + 0.021406181156635284, + 0.34676193445920944, + 1.6587277725338936, + 0.8146951235830784, + 0.5387354977428913, + 0.6379826255142689, + 0.12197364866733551, + 0.4128503128886223, + 0.7832104489207268, + 0.8739187959581614, + 0.33429335802793503, + 1.5646613910794258 + ], + "unique_experts": 54, + "load_cv": 0.8937653875863268, + "normalized_load_entropy": 0.9011530560820183, + "max_load_share": 0.05128205128205128 + }, + "full_input": { + "tokens": 77, + "top_k": 6, + "decisions": 462, + "ordered_route_sha256": "a9f35c142ef52f5b1a374b56ff7702ed5b56c0c11b6d5b0b8a36bab8817b04f3", + "route_weight_sha256": "5d4f108dba52de1a11728cbeb47313fb4f73543d7995f577a003488166171619", + "loads": [ + 5, + 3, + 11, + 2, + 1, + 1, + 1, + 4, + 14, + 6, + 14, + 2, + 5, + 5, + 3, + 18, + 9, + 9, + 10, + 8, + 16, + 1, + 0, + 3, + 3, + 8, + 7, + 6, + 3, + 4, + 5, + 2, + 2, + 8, + 14, + 12, + 4, + 0, + 11, + 8, + 12, + 8, + 21, + 4, + 13, + 6, + 4, + 10, + 3, + 4, + 8, + 2, + 3, + 14, + 19, + 21, + 6, + 5, + 2, + 7, + 5, + 14, + 5, + 18 + ], + "weighted_loads": [ + 0.3369220308959484, + 0.05963675072416663, + 0.603973988443613, + 0.13788753747940063, + 0.0017730272375047207, + 0.036490555852651596, + 0.03232313320040703, + 0.203564808703959, + 1.8821200844831765, + 0.2118843817152083, + 0.7368643879890442, + 0.09376357309520245, + 0.3680852837860584, + 0.28053683042526245, + 0.10284418798983097, + 2.3462669160217047, + 0.46102531999349594, + 0.4617075063288212, + 0.9438521470874548, + 0.3978181481361389, + 2.125677838921547, + 0.09968318790197372, + 0.0, + 0.2910109832882881, + 0.2143099084496498, + 0.9009432755410671, + 0.39029440842568874, + 0.5904709808528423, + 0.2425365336239338, + 0.3495648726820946, + 0.4125404432415962, + 0.05905748903751373, + 0.06751851551234722, + 0.3617269676178694, + 1.0850437581539154, + 0.7640771511942148, + 0.28087013214826584, + 0.0, + 1.049376841634512, + 0.6423206478357315, + 1.3039059322327375, + 0.8044362775981426, + 1.4842577017843723, + 0.2985645942389965, + 1.0064535029232502, + 0.45582929253578186, + 0.1852513700723648, + 0.3344972941558808, + 0.2798778899013996, + 0.18845894001424313, + 0.6888740472495556, + 0.07982908561825752, + 1.6504285410046577, + 0.9412202462553978, + 1.6756091276183724, + 1.4998455755412579, + 0.5387354977428913, + 0.6379826255142689, + 0.12197364866733551, + 0.4585196003317833, + 0.7832104489207268, + 0.9137445222586393, + 0.33429335802793503, + 2.501121036708355 + ], + "unique_experts": 62, + "load_cv": 0.742963594427246, + "normalized_load_entropy": 0.9343595488372798, + "max_load_share": 0.045454545454545456 + } + }, + "s1_eos": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "3d0789496f23177ae3f6da98bef20b60ac2e91f6717f770441f6960730b72fd3", + "route_weight_sha256": "1d9895f3c23a1c3e66239704bc82f519122abfbe54ba0a9638c425630090bfb9", + "loads": [ + 5, + 2, + 11, + 2, + 0, + 0, + 0, + 2, + 13, + 6, + 3, + 2, + 2, + 4, + 2, + 6, + 7, + 3, + 1, + 8, + 13, + 1, + 0, + 3, + 3, + 0, + 7, + 6, + 3, + 4, + 6, + 2, + 3, + 8, + 14, + 7, + 3, + 0, + 0, + 1, + 8, + 0, + 13, + 2, + 12, + 6, + 4, + 8, + 3, + 0, + 0, + 2, + 0, + 5, + 17, + 11, + 6, + 5, + 2, + 6, + 5, + 13, + 5, + 16 + ], + "weighted_loads": [ + 0.3304445743560791, + 0.057164497673511505, + 0.5977664776146412, + 0.13856294751167297, + 0.0, + 0.0, + 0.0, + 0.14378366246819496, + 1.8721224665641785, + 0.24017896316945553, + 0.1029367744922638, + 0.09808699041604996, + 0.16366182267665863, + 0.23862841352820396, + 0.0652761310338974, + 0.37246114388108253, + 0.3342357277870178, + 0.16486984491348267, + 0.02693469263613224, + 0.43117848224937916, + 2.07510806620121, + 0.102369524538517, + 0.0, + 0.29524093121290207, + 0.21596281975507736, + 0.0, + 0.39810936711728573, + 0.5874113105237484, + 0.24028171971440315, + 0.3453119844198227, + 0.46260611712932587, + 0.05979481153190136, + 0.0881377998739481, + 0.36172589287161827, + 1.0869206860661507, + 0.3343014232814312, + 0.24620379880070686, + 0.0, + 0.0, + 0.04673527553677559, + 1.1575851924717426, + 0.0, + 0.942013792693615, + 0.17935555428266525, + 0.9206263609230518, + 0.45960869640111923, + 0.18716310523450375, + 0.32144634425640106, + 0.28838348016142845, + 0.0, + 0.0, + 0.0779312252998352, + 0.0, + 0.34482915699481964, + 1.6987722031772137, + 0.7843597307801247, + 0.5376820862293243, + 0.6304019838571548, + 0.12237544730305672, + 0.41614488512277603, + 0.7953191101551056, + 0.8664694000035524, + 0.3338778391480446, + 1.5733603537082672 + ], + "unique_experts": 53, + "load_cv": 0.8974358974358975, + "normalized_load_entropy": 0.8990895103258323, + "max_load_share": 0.05448717948717949 + }, + "full_input": { + "tokens": 93, + "top_k": 6, + "decisions": 558, + "ordered_route_sha256": "f1ea32a8d012047da296b66158a4113018fe9907589c1b3fa30b30b2a33b4343", + "route_weight_sha256": "b876da880ca8c631fb915ac645e129502c41fa74fa921f00180c2251239dba2a", + "loads": [ + 6, + 4, + 11, + 8, + 1, + 2, + 9, + 5, + 14, + 7, + 16, + 5, + 7, + 4, + 3, + 20, + 10, + 14, + 13, + 18, + 15, + 1, + 1, + 3, + 4, + 8, + 7, + 8, + 3, + 6, + 6, + 2, + 4, + 9, + 15, + 12, + 5, + 3, + 12, + 12, + 12, + 13, + 25, + 7, + 13, + 6, + 4, + 11, + 3, + 14, + 10, + 3, + 2, + 15, + 21, + 21, + 6, + 5, + 3, + 7, + 6, + 13, + 5, + 20 + ], + "weighted_loads": [ + 0.36734357103705406, + 0.08113461174070835, + 0.5977664776146412, + 0.5546591281890869, + 0.0017664865590631962, + 0.07459281384944916, + 1.0123813450336456, + 0.24306406849063933, + 1.8754886004608124, + 0.24460396775975823, + 0.8969654254615307, + 0.4713106080889702, + 0.5972523726522923, + 0.23862841352820396, + 0.09896247833967209, + 2.8234823080711067, + 0.5607686638832092, + 0.845815397799015, + 1.29305480979383, + 1.280497256666422, + 2.0904515387956053, + 0.102369524538517, + 0.03791392222046852, + 0.29524093121290207, + 0.2926030829548836, + 0.7188140731304884, + 0.39810936711728573, + 0.7607960887253284, + 0.24028171971440315, + 0.43193693086504936, + 0.46260611712932587, + 0.05979481153190136, + 0.20718672312796116, + 0.40488334745168686, + 1.1214915923774242, + 0.8698817752301693, + 0.33078036084771156, + 0.15153377503156662, + 1.1944547519087791, + 1.0957461632788181, + 1.3191581182181835, + 1.220138605684042, + 1.7872330248355865, + 0.49746841192245483, + 0.9829232916235924, + 0.45960869640111923, + 0.18716310523450375, + 0.3724421167280525, + 0.28838348016142845, + 0.8284440264105797, + 1.0819819532334805, + 0.12594083324074745, + 1.6289309859275818, + 1.1543313227593899, + 1.7537081530317664, + 1.3988973274827003, + 0.5376820862293243, + 0.6304019838571548, + 0.1926211230456829, + 0.4634952060878277, + 0.8413733765482903, + 0.8664694000035524, + 0.3338778391480446, + 2.7486819848418236 + ], + "unique_experts": 64, + "load_cv": 0.6533825055056113, + "normalized_load_entropy": 0.9493061344242425, + "max_load_share": 0.044802867383512544 + } + }, + "s0_bos": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "19287c8ac076a99f71efa2ad0b8e6f5c62e216b96b17d952ba035fe1a979cdb1", + "route_weight_sha256": "6a17248c17b4163493a1c6d3b3a384dadfb0d68fe86f76f25cb960a24ec1a203", + "loads": [ + 7, + 2, + 11, + 2, + 0, + 0, + 0, + 3, + 13, + 5, + 3, + 2, + 2, + 6, + 3, + 6, + 5, + 4, + 1, + 6, + 14, + 1, + 0, + 3, + 3, + 0, + 5, + 6, + 3, + 4, + 5, + 2, + 1, + 8, + 13, + 7, + 4, + 0, + 1, + 1, + 8, + 1, + 12, + 2, + 13, + 6, + 3, + 8, + 3, + 1, + 0, + 2, + 0, + 5, + 16, + 12, + 6, + 4, + 2, + 6, + 5, + 14, + 5, + 16 + ], + "weighted_loads": [ + 0.4107722118496895, + 0.056903183460235596, + 0.6091169863939285, + 0.14693138748407364, + 0.0, + 0.0, + 0.0, + 0.19057423062622547, + 1.9022930413484573, + 0.20405582711100578, + 0.0994622241705656, + 0.08627907373011112, + 0.16232497990131378, + 0.32526668906211853, + 0.09980297833681107, + 0.3601118177175522, + 0.2502814084291458, + 0.19311716966331005, + 0.027012290433049202, + 0.33496110886335373, + 2.1653600074350834, + 0.11407475918531418, + 0.0, + 0.28375261276960373, + 0.2153225876390934, + 0.0, + 0.33449285477399826, + 0.6064472049474716, + 0.2542731314897537, + 0.333003681153059, + 0.43995213881134987, + 0.06088147312402725, + 0.03778868541121483, + 0.36256921477615833, + 1.0452108345925808, + 0.34255528450012207, + 0.25399893894791603, + 0.0, + 0.0317104309797287, + 0.05236239731311798, + 1.1233227141201496, + 0.027837635949254036, + 0.9458733536303043, + 0.1775742471218109, + 0.9947581589221954, + 0.4600224271416664, + 0.14306508004665375, + 0.32133842818439007, + 0.2918732836842537, + 0.02910010516643524, + 0.0, + 0.07506642118096352, + 0.0, + 0.33219821751117706, + 1.6356435529887676, + 0.873209897428751, + 0.5686586406081915, + 0.6316304467618465, + 0.11618192121386528, + 0.40676721930503845, + 0.8019280880689621, + 0.950548492372036, + 0.3343564458191395, + 1.608384095132351 + ], + "unique_experts": 56, + "load_cv": 0.8848940475249947, + "normalized_load_entropy": 0.9053694339530596, + "max_load_share": 0.05128205128205128 + }, + "full_input": { + "tokens": 77, + "top_k": 6, + "decisions": 462, + "ordered_route_sha256": "e1269634c02c6cf3a0d6a19c2f47910337c562c4be7dc6ced745e5936a4ece57", + "route_weight_sha256": "aed1ac7ce7b3f088d5c1108e80e9d698fbc30e8c021327c4e4dee11cc1674bef", + "loads": [ + 7, + 3, + 11, + 2, + 0, + 1, + 1, + 5, + 14, + 5, + 14, + 2, + 5, + 6, + 3, + 19, + 7, + 10, + 11, + 7, + 15, + 1, + 0, + 3, + 3, + 8, + 5, + 6, + 3, + 4, + 5, + 3, + 1, + 8, + 13, + 12, + 4, + 0, + 13, + 9, + 12, + 9, + 21, + 4, + 14, + 6, + 3, + 9, + 3, + 5, + 8, + 2, + 1, + 14, + 18, + 22, + 6, + 4, + 2, + 7, + 5, + 15, + 5, + 18 + ], + "weighted_loads": [ + 0.4107722118496895, + 0.060393383260816336, + 0.6091169863939285, + 0.14693138748407364, + 0.0, + 0.036490555852651596, + 0.03232313320040703, + 0.23501435201615095, + 1.9056315538473427, + 0.20405582711100578, + 0.7415369842201471, + 0.08627907373011112, + 0.3673638142645359, + 0.32526668906211853, + 0.09980297833681107, + 2.3947549257427454, + 0.3964030593633652, + 0.49105034954845905, + 1.0674185510724783, + 0.34806003980338573, + 2.177912387996912, + 0.11407475918531418, + 0.0, + 0.28375261276960373, + 0.2153225876390934, + 0.9009432755410671, + 0.33449285477399826, + 0.6064472049474716, + 0.2542731314897537, + 0.333003681153059, + 0.43995213881134987, + 0.09763994067907333, + 0.03778868541121483, + 0.36256921477615833, + 1.0452108345925808, + 0.7638403810560703, + 0.25399893894791603, + 0.0, + 1.256386861205101, + 0.6843937635421753, + 1.2987827733159065, + 0.8653737921267748, + 1.56252084299922, + 0.30063823610544205, + 1.0761647894978523, + 0.4600224271416664, + 0.14306508004665375, + 0.3369056135416031, + 0.2918732836842537, + 0.2209748588502407, + 0.698503915220499, + 0.07506642118096352, + 0.6645369529724121, + 0.9266565293073654, + 1.6506173531524837, + 1.5602869130671024, + 0.5686586406081915, + 0.6316304467618465, + 0.11618192121386528, + 0.45243650674819946, + 0.8019280880689621, + 0.9883028492331505, + 0.3343564458191395, + 2.54484374076128 + ], + "unique_experts": 61, + "load_cv": 0.7613019063207483, + "normalized_load_entropy": 0.929721801371023, + "max_load_share": 0.047619047619047616 + } + }, + "s1_bos": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "05143f4ef8c64fa6553e7af3e2659ae8a3b0511df3cdf92331a47207bd424d58", + "route_weight_sha256": "6c9ed40bb1c6ff76035ee3bb2e921c3a5e3f91bbb5d368378c14d5d6af8dbd08", + "loads": [ + 5, + 3, + 11, + 2, + 0, + 0, + 0, + 4, + 14, + 5, + 4, + 2, + 2, + 5, + 2, + 6, + 6, + 4, + 0, + 6, + 14, + 1, + 0, + 3, + 3, + 0, + 6, + 6, + 3, + 4, + 5, + 3, + 1, + 9, + 13, + 6, + 4, + 0, + 0, + 1, + 8, + 0, + 12, + 2, + 13, + 6, + 3, + 8, + 3, + 2, + 0, + 2, + 1, + 4, + 16, + 10, + 6, + 4, + 2, + 6, + 5, + 15, + 5, + 16 + ], + "weighted_loads": [ + 0.33302419632673264, + 0.08742732182145119, + 0.6125933825969696, + 0.1541970856487751, + 0.0, + 0.0, + 0.0, + 0.2308860868215561, + 1.960240999236703, + 0.20958543196320534, + 0.12262209504842758, + 0.08473188802599907, + 0.15617647022008896, + 0.2956191971898079, + 0.06466370075941086, + 0.365631815046072, + 0.29687804728746414, + 0.2008409984409809, + 0.0, + 0.33760224655270576, + 2.1618303693830967, + 0.1221332773566246, + 0.0, + 0.2842274196445942, + 0.2198561243712902, + 0.0, + 0.37722685374319553, + 0.6054198257625103, + 0.23287450894713402, + 0.3516241982579231, + 0.455290038138628, + 0.09635875187814236, + 0.03753219544887543, + 0.3986827526241541, + 1.0443562716245651, + 0.3027213364839554, + 0.25537341833114624, + 0.0, + 0.0, + 0.04515105485916138, + 1.1629512086510658, + 0.0, + 0.9268224723637104, + 0.17568349093198776, + 0.9799571223556995, + 0.45887966454029083, + 0.1474861428141594, + 0.3259622659534216, + 0.31686096638441086, + 0.06681053340435028, + 0.0, + 0.07264471426606178, + 0.02216275967657566, + 0.2907421700656414, + 1.6475930027663708, + 0.8765301220119, + 0.5650197342038155, + 0.6213812679052353, + 0.1120651438832283, + 0.4037797823548317, + 0.8330133855342865, + 0.9414268769323826, + 0.34022365137934685, + 1.6540474854409695 + ], + "unique_experts": 54, + "load_cv": 0.8900797414210145, + "normalized_load_entropy": 0.9029235195968944, + "max_load_share": 0.05128205128205128 + }, + "full_input": { + "tokens": 93, + "top_k": 6, + "decisions": 558, + "ordered_route_sha256": "66345f38c7f48f9c613b8c6df79a3bc6aacee3cf8b4f0db768fe6f4f7f1dd97d", + "route_weight_sha256": "9858cd66ed26c5a6de5c3cfda951c7e836c2096e6901e24f16b3b93a1c3f0b5c", + "loads": [ + 6, + 5, + 11, + 8, + 0, + 2, + 8, + 7, + 15, + 5, + 17, + 5, + 7, + 5, + 3, + 21, + 10, + 15, + 14, + 16, + 15, + 1, + 1, + 3, + 4, + 8, + 6, + 8, + 3, + 6, + 5, + 4, + 2, + 10, + 14, + 11, + 5, + 3, + 13, + 12, + 11, + 13, + 25, + 7, + 14, + 6, + 3, + 10, + 3, + 15, + 11, + 3, + 2, + 14, + 19, + 21, + 6, + 4, + 3, + 7, + 6, + 16, + 5, + 20 + ], + "weighted_loads": [ + 0.3699231930077076, + 0.11139743588864803, + 0.6125933825969696, + 0.570293266326189, + 0.0, + 0.07459281384944916, + 0.9701206125319004, + 0.3242828289512545, + 1.963607133133337, + 0.20958543196320534, + 0.923882894217968, + 0.4579555056989193, + 0.5885877944529057, + 0.2956191971898079, + 0.09835004806518555, + 2.8758899378590286, + 0.5632709860801697, + 0.8817865513265133, + 1.4166773594915867, + 1.1869210209697485, + 2.1743827499449253, + 0.1221332773566246, + 0.03791392222046852, + 0.2842274196445942, + 0.2964963875710964, + 0.7188140731304884, + 0.37722685374319553, + 0.7788046039640903, + 0.23287450894713402, + 0.4382491447031498, + 0.455290038138628, + 0.13394772075116634, + 0.1565811187028885, + 0.4418402072042227, + 1.0789271779358387, + 0.83393944054842, + 0.3004359044134617, + 0.15153377503156662, + 1.3583927303552628, + 1.066095732152462, + 1.2908971160650253, + 1.2326228730380535, + 1.813756089657545, + 0.49654026329517365, + 1.04225405305624, + 0.45887966454029083, + 0.1474861428141594, + 0.3745170757174492, + 0.31686096638441086, + 0.858065091073513, + 1.1582725569605827, + 0.12065432220697403, + 0.6866997126489878, + 1.1002443358302116, + 1.7005399335175753, + 1.5138218365609646, + 0.5650197342038155, + 0.6213812679052353, + 0.1823108196258545, + 0.45113010331988335, + 0.8790676519274712, + 0.9800480008125305, + 0.34022365137934685, + 2.829369116574526 + ], + "unique_experts": 63, + "load_cv": 0.6618219153077425, + "normalized_load_entropy": 0.9469383522235718, + "max_load_share": 0.044802867383512544 + } + }, + "s0_x": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "c97ad6043f9fb8182c720d6a6100d2dbce4116457d9c2bd21ff3891a54dcb50a", + "route_weight_sha256": "d74e68c0dcfd9963105eb327c729dfb5b4183575938fd5e1057785ed6591374d", + "loads": [ + 7, + 2, + 11, + 2, + 0, + 0, + 0, + 2, + 13, + 5, + 4, + 2, + 2, + 4, + 3, + 6, + 5, + 4, + 0, + 8, + 14, + 1, + 0, + 3, + 3, + 0, + 6, + 6, + 3, + 4, + 5, + 3, + 1, + 7, + 14, + 7, + 3, + 0, + 0, + 1, + 9, + 0, + 12, + 2, + 13, + 6, + 3, + 8, + 3, + 1, + 0, + 2, + 0, + 4, + 16, + 14, + 6, + 4, + 2, + 6, + 5, + 14, + 5, + 16 + ], + "weighted_loads": [ + 0.40952846966683865, + 0.05671445094048977, + 0.606400802731514, + 0.13951356709003448, + 0.0, + 0.0, + 0.0, + 0.13646212592720985, + 1.911932062357664, + 0.20790048874914646, + 0.1331232376396656, + 0.07954693958163261, + 0.16520049422979355, + 0.23932627588510513, + 0.09990811720490456, + 0.3687238283455372, + 0.2594866957515478, + 0.1950074601918459, + 0.0, + 0.41818566992878914, + 2.142254214733839, + 0.10851515084505081, + 0.0, + 0.2691144831478596, + 0.20446709543466568, + 0.0, + 0.3661671560257673, + 0.5938647091388702, + 0.23387421667575836, + 0.3332783877849579, + 0.4345725253224373, + 0.09038816019892693, + 0.03752501308917999, + 0.33707137778401375, + 1.0883781500160694, + 0.361219197511673, + 0.20935925841331482, + 0.0, + 0.0, + 0.05282658338546753, + 1.1736987568438053, + 0.0, + 0.9000034667551517, + 0.1768616884946823, + 1.0014553107321262, + 0.46559350937604904, + 0.13934458047151566, + 0.32009847462177277, + 0.28774573653936386, + 0.029183149337768555, + 0.0, + 0.07634561136364937, + 0.0, + 0.2781262435019016, + 1.6377176195383072, + 0.9300867542624474, + 0.5661338251084089, + 0.6252986080944538, + 0.1198684461414814, + 0.38724949583411217, + 0.7960262894630432, + 0.9152512550354004, + 0.33283938094973564, + 1.578802790492773 + ], + "unique_experts": 53, + "load_cv": 0.917002807294752, + "normalized_load_entropy": 0.896324335135053, + "max_load_share": 0.05128205128205128 + }, + "full_input": { + "tokens": 77, + "top_k": 6, + "decisions": 462, + "ordered_route_sha256": "efbc67fd60f0018856ca7341c744b75d59238e8d26dee7b49e8c1680cafc0e48", + "route_weight_sha256": "85abbe5f0981dcd789821470b888a98eed7e826bad340e54953b8e7034fe1c59", + "loads": [ + 7, + 3, + 11, + 2, + 0, + 1, + 1, + 4, + 14, + 5, + 16, + 2, + 5, + 4, + 3, + 19, + 7, + 10, + 9, + 9, + 15, + 1, + 0, + 3, + 3, + 9, + 6, + 6, + 3, + 4, + 5, + 4, + 1, + 7, + 14, + 12, + 3, + 0, + 10, + 8, + 15, + 8, + 20, + 4, + 14, + 6, + 3, + 9, + 3, + 4, + 8, + 2, + 1, + 15, + 18, + 24, + 6, + 4, + 2, + 7, + 5, + 15, + 5, + 18 + ], + "weighted_loads": [ + 0.40952846966683865, + 0.06020465074107051, + 0.606400802731514, + 0.13951356709003448, + 0.0, + 0.036490555852651596, + 0.03232313320040703, + 0.1811551945284009, + 1.9152705748565495, + 0.20790048874914646, + 0.8724411688745022, + 0.07954693958163261, + 0.37655017152428627, + 0.23932627588510513, + 0.09990811720490456, + 2.58916156925261, + 0.4061129819601774, + 0.4929406400769949, + 0.9018510468304157, + 0.43128460086882114, + 2.1548065952956676, + 0.10851515084505081, + 0.0, + 0.2691144831478596, + 0.20446709543466568, + 0.9864833019673824, + 0.3661671560257673, + 0.5938647091388702, + 0.23387421667575836, + 0.3332783877849579, + 0.4345725253224373, + 0.12842560186982155, + 0.03752501308917999, + 0.33707137778401375, + 1.0883781500160694, + 0.7764481864869595, + 0.20935925841331482, + 0.0, + 0.9059070348739624, + 0.6588109955191612, + 1.4634549841284752, + 0.8007961809635162, + 1.3950529359281063, + 0.2869875058531761, + 1.0828619413077831, + 0.46559350937604904, + 0.13934458047151566, + 0.3356656599789858, + 0.28774573653936386, + 0.17722856998443604, + 0.6751608438789845, + 0.07634561136364937, + 0.6645369529724121, + 0.9856106713414192, + 1.6526914197020233, + 1.6900925561785698, + 0.5661338251084089, + 0.6252986080944538, + 0.1198684461414814, + 0.4329187832772732, + 0.7960262894630432, + 0.9541007317602634, + 0.33283938094973564, + 2.515262436121702 + ], + "unique_experts": 61, + "load_cv": 0.7830473622998356, + "normalized_load_entropy": 0.9269547727132522, + "max_load_share": 0.05194805194805195 + } + }, + "s1_x": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "50ab8268541a621b5f0047e2139e01b1ec38452aee4175bdbca6cafccc7ca100", + "route_weight_sha256": "cd1e4452b70c02232d5e90cc3ab44af43ae0a2bbaf46f05dd2a888a9bfa45ef0", + "loads": [ + 5, + 3, + 11, + 2, + 0, + 0, + 0, + 4, + 14, + 5, + 4, + 2, + 2, + 5, + 1, + 6, + 6, + 4, + 0, + 6, + 14, + 1, + 0, + 3, + 3, + 0, + 6, + 6, + 3, + 4, + 5, + 4, + 1, + 8, + 13, + 6, + 3, + 0, + 0, + 1, + 8, + 0, + 12, + 2, + 13, + 6, + 3, + 8, + 3, + 2, + 0, + 2, + 0, + 5, + 16, + 11, + 6, + 5, + 2, + 6, + 5, + 15, + 5, + 16 + ], + "weighted_loads": [ + 0.3289848417043686, + 0.08600633777678013, + 0.612982802093029, + 0.1553906351327896, + 0.0, + 0.0, + 0.0, + 0.22757262364029884, + 1.9790053330361843, + 0.21057680621743202, + 0.12600280717015266, + 0.07931862957775593, + 0.15654140710830688, + 0.30044834688305855, + 0.032509077340364456, + 0.3682741019874811, + 0.30042869970202446, + 0.20383318699896336, + 0.0, + 0.34810553677380085, + 2.1612235568463802, + 0.12238625437021255, + 0.0, + 0.2746966890990734, + 0.21290262416005135, + 0.0, + 0.3674334939569235, + 0.6072276756167412, + 0.2159132994711399, + 0.3533351309597492, + 0.4493750296533108, + 0.13327288068830967, + 0.03796966001391411, + 0.3619366567581892, + 1.0317540429532528, + 0.3065141048282385, + 0.21712712571024895, + 0.0, + 0.0, + 0.04189814627170563, + 1.1603259425610304, + 0.0, + 0.9029569812119007, + 0.17382468283176422, + 1.005504708737135, + 0.4555457830429077, + 0.14418911188840866, + 0.3269288633018732, + 0.309396855533123, + 0.06629233062267303, + 0.0, + 0.07178287953138351, + 0.0, + 0.3222353793680668, + 1.648789867758751, + 0.8870827928185463, + 0.5629197061061859, + 0.6555871982127428, + 0.11370497569441795, + 0.3796587847173214, + 0.8459714949131012, + 0.9340611137449741, + 0.3380650319159031, + 1.6152431592345238 + ], + "unique_experts": 53, + "load_cv": 0.8967029974382416, + "normalized_load_entropy": 0.8999724390455967, + "max_load_share": 0.05128205128205128 + }, + "full_input": { + "tokens": 93, + "top_k": 6, + "decisions": 558, + "ordered_route_sha256": "ecdf9bfd43c297f14b61cc3a678fcc8def34cde3c4f1c1d8e1677db5e0a31efc", + "route_weight_sha256": "c1fbf028dca6b1f07a777579020352649d73c7bc09f1ec4d516a01581563eed4", + "loads": [ + 6, + 5, + 11, + 8, + 0, + 2, + 8, + 7, + 15, + 5, + 18, + 5, + 7, + 5, + 2, + 21, + 10, + 15, + 13, + 16, + 15, + 1, + 1, + 3, + 4, + 9, + 6, + 8, + 3, + 6, + 5, + 5, + 2, + 10, + 14, + 12, + 4, + 3, + 11, + 12, + 12, + 12, + 24, + 7, + 14, + 6, + 3, + 10, + 3, + 15, + 9, + 3, + 1, + 17, + 19, + 22, + 6, + 5, + 3, + 7, + 6, + 16, + 5, + 20 + ], + "weighted_loads": [ + 0.36588383838534355, + 0.10997645184397697, + 0.612982802093029, + 0.5714868158102036, + 0.0, + 0.07459281384944916, + 0.9701206125319004, + 0.3183568643871695, + 1.9823714669328183, + 0.21057680621743202, + 1.0190036334097385, + 0.45254224725067616, + 0.5985459499061108, + 0.30044834688305855, + 0.06619542464613914, + 3.0867284326814115, + 0.5772210024297237, + 0.8847787398844957, + 1.242528885602951, + 1.1974243111908436, + 2.173775937408209, + 0.12238625437021255, + 0.03791392222046852, + 0.2746966890990734, + 0.28954288735985756, + 0.7967130746692419, + 0.3674334939569235, + 0.7806124538183212, + 0.2159132994711399, + 0.4399600774049759, + 0.4493750296533108, + 0.17524812184274197, + 0.15701858326792717, + 0.44890342839062214, + 1.0663249492645264, + 0.8751993868499994, + 0.2621896117925644, + 0.15153377503156662, + 1.0278265923261642, + 1.0574058964848518, + 1.361816769465804, + 1.134374313056469, + 1.6964585110545158, + 0.4899488724768162, + 1.0678016394376755, + 0.4555457830429077, + 0.14418911188840866, + 0.3754836730659008, + 0.309396855533123, + 0.8534965887665749, + 1.0275029987096786, + 0.11979248747229576, + 0.6645369529724121, + 1.2442593798041344, + 1.7017367985099554, + 1.597483366727829, + 0.5629197061061859, + 0.6555871982127428, + 0.18395065143704414, + 0.42700910568237305, + 0.8920257613062859, + 0.9719892255961895, + 0.3380650319159031, + 2.79056479036808 + ], + "unique_experts": 63, + "load_cv": 0.6689270655466293, + "normalized_load_entropy": 0.945438030153292, + "max_load_share": 0.043010752688172046 + } + }, + "s0_period": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "9d43958d7a78b2a06c1441f0b04cb3e4c098241a6cb3154054d03b33092a5d36", + "route_weight_sha256": "6ef6576c867af12932a14d86403c488cdfaad6c766793b3ceb592e21cfea8059", + "loads": [ + 5, + 2, + 11, + 2, + 0, + 0, + 0, + 2, + 13, + 5, + 4, + 2, + 2, + 4, + 2, + 6, + 5, + 4, + 0, + 8, + 14, + 1, + 0, + 3, + 3, + 0, + 6, + 6, + 3, + 4, + 6, + 3, + 1, + 7, + 14, + 8, + 3, + 0, + 0, + 1, + 9, + 0, + 12, + 2, + 13, + 6, + 3, + 8, + 3, + 2, + 0, + 2, + 0, + 5, + 16, + 13, + 6, + 4, + 2, + 6, + 5, + 14, + 5, + 16 + ], + "weighted_loads": [ + 0.3392151780426502, + 0.05557690188288689, + 0.613038208335638, + 0.1399953030049801, + 0.0, + 0.0, + 0.0, + 0.13817834481596947, + 1.8966820165514946, + 0.21475619077682495, + 0.13120527379214764, + 0.08025726117193699, + 0.16552019119262695, + 0.2394973747432232, + 0.06582461297512054, + 0.3588488716632128, + 0.26282069459557533, + 0.1915066111832857, + 0.0, + 0.4182088654488325, + 2.127946637570858, + 0.11318939924240112, + 0.0, + 0.27890443801879883, + 0.20782902836799622, + 0.0, + 0.35809789784252644, + 0.5892709754407406, + 0.23537401109933853, + 0.3334040232002735, + 0.48648619279265404, + 0.09074796922504902, + 0.036427248269319534, + 0.33668186143040657, + 1.08720787987113, + 0.3833416812121868, + 0.21556038782000542, + 0.0, + 0.0, + 0.05177123099565506, + 1.1736474186182022, + 0.0, + 0.8988295830786228, + 0.17579414695501328, + 1.0133596919476986, + 0.4728446304798126, + 0.14138810709118843, + 0.3245782498270273, + 0.28105467930436134, + 0.06494500115513802, + 0.0, + 0.07869415357708931, + 0.0, + 0.3177085667848587, + 1.6333318948745728, + 0.8959189672023058, + 0.5588700827211142, + 0.6136390902101994, + 0.11564023047685623, + 0.38329727575182915, + 0.8027766197919846, + 0.9175035879015923, + 0.3403269797563553, + 1.5793315544724464 + ], + "unique_experts": 53, + "load_cv": 0.910527225875113, + "normalized_load_entropy": 0.8974651970502125, + "max_load_share": 0.05128205128205128 + }, + "full_input": { + "tokens": 77, + "top_k": 6, + "decisions": 462, + "ordered_route_sha256": "70125e7e88e8edc5b3c696fd3a76bff6ac9f24ddaeb42e78a61039bf2da5ac92", + "route_weight_sha256": "63f22ae0e8269b97fa04091114b4d0a1237547fb8bc08d8a2d7d7f08b5252b6d", + "loads": [ + 5, + 3, + 11, + 2, + 0, + 1, + 1, + 4, + 14, + 5, + 16, + 2, + 5, + 4, + 2, + 19, + 8, + 11, + 9, + 9, + 15, + 1, + 0, + 3, + 3, + 8, + 6, + 6, + 3, + 4, + 6, + 4, + 1, + 7, + 14, + 14, + 3, + 0, + 10, + 8, + 14, + 8, + 20, + 4, + 15, + 6, + 3, + 9, + 3, + 5, + 8, + 2, + 1, + 14, + 18, + 23, + 6, + 4, + 2, + 7, + 5, + 15, + 5, + 18 + ], + "weighted_loads": [ + 0.3392151780426502, + 0.05906710168346763, + 0.613038208335638, + 0.1399953030049801, + 0.0, + 0.036490555852651596, + 0.03232313320040703, + 0.18133678752928972, + 1.90002052905038, + 0.21475619077682495, + 0.8699580077081919, + 0.08025726117193699, + 0.3721293695271015, + 0.2394973747432232, + 0.06582461297512054, + 2.4110150188207626, + 0.44575686752796173, + 0.5461176428943872, + 0.8503479138016701, + 0.4313077963888645, + 2.1404990181326866, + 0.11318939924240112, + 0.0, + 0.27890443801879883, + 0.20782902836799622, + 0.9009432755410671, + 0.35809789784252644, + 0.5892709754407406, + 0.23537401109933853, + 0.3334040232002735, + 0.48648619279265404, + 0.13420852832496166, + 0.036427248269319534, + 0.33668186143040657, + 1.08720787987113, + 0.8431735262274742, + 0.21556038782000542, + 0.0, + 0.8734849877655506, + 0.6444038674235344, + 1.4069196246564388, + 0.8350043743848801, + 1.4101042561233044, + 0.28388669714331627, + 1.1505328826606274, + 0.4728446304798126, + 0.14138810709118843, + 0.34014543518424034, + 0.28105467930436134, + 0.20956577733159065, + 0.6896706409752369, + 0.07869415357708931, + 0.6645369529724121, + 0.9121668785810471, + 1.6483056950382888, + 1.7866449970752, + 0.5588700827211142, + 0.6136390902101994, + 0.11564023047685623, + 0.42896656319499016, + 0.8027766197919846, + 0.955062922090292, + 0.3403269797563553, + 2.5157912001013756 + ], + "unique_experts": 61, + "load_cv": 0.780362319198646, + "normalized_load_entropy": 0.9268275884571971, + "max_load_share": 0.049783549783549784 + } + }, + "s1_period": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "b7d4ae1b229f8d21a4cf99d0dc73d8adffef734f1693b5677b3aeb40eb01d310", + "route_weight_sha256": "bdaf704a7721c117d8588ac0a149a11d5c3389869e6d923b2da1815b3e7f4590", + "loads": [ + 5, + 3, + 11, + 2, + 0, + 0, + 0, + 4, + 14, + 5, + 4, + 2, + 2, + 5, + 1, + 6, + 6, + 4, + 0, + 6, + 14, + 1, + 0, + 3, + 3, + 0, + 6, + 6, + 3, + 4, + 6, + 5, + 1, + 8, + 13, + 6, + 3, + 0, + 0, + 0, + 8, + 0, + 12, + 2, + 13, + 6, + 3, + 8, + 3, + 1, + 0, + 2, + 0, + 5, + 16, + 11, + 6, + 5, + 2, + 6, + 5, + 15, + 5, + 16 + ], + "weighted_loads": [ + 0.3266592677682638, + 0.08535612002015114, + 0.6228723935782909, + 0.15548498183488846, + 0.0, + 0.0, + 0.0, + 0.22997489385306835, + 1.975111797451973, + 0.21286636404693127, + 0.12938658334314823, + 0.08299242332577705, + 0.1590230017900467, + 0.3025822080671787, + 0.03266608715057373, + 0.35743168741464615, + 0.3004324082285166, + 0.2091800719499588, + 0.0, + 0.32805690728127956, + 2.143486950546503, + 0.1212923526763916, + 0.0, + 0.2808905355632305, + 0.21203887462615967, + 0.0, + 0.36989123933017254, + 0.6014144085347652, + 0.21782062202692032, + 0.36109885573387146, + 0.5057804249227047, + 0.1671655923128128, + 0.03715062886476517, + 0.3677325490862131, + 1.0379992686212063, + 0.29765166714787483, + 0.218357153236866, + 0.0, + 0.0, + 0.0, + 1.1420027296990156, + 0.0, + 0.904869269579649, + 0.17553459107875824, + 1.0098114795982838, + 0.4595973566174507, + 0.14472465589642525, + 0.331546887755394, + 0.30736785754561424, + 0.03021339699625969, + 0.0, + 0.07342236489057541, + 0.0, + 0.3280307650566101, + 1.6448406390845776, + 0.8826978038996458, + 0.5582491289824247, + 0.6502899918705225, + 0.11191010847687721, + 0.3847615271806717, + 0.8442857265472412, + 0.9459807146340609, + 0.3463691920042038, + 1.6462242417037487 + ], + "unique_experts": 52, + "load_cv": 0.9025495336819509, + "normalized_load_entropy": 0.8970291831672168, + "max_load_share": 0.05128205128205128 + }, + "full_input": { + "tokens": 93, + "top_k": 6, + "decisions": 558, + "ordered_route_sha256": "27d7e0eff9c31f3c54ba87b7670d1d7b65e05f493daec8a1d03a8d8357eb74c7", + "route_weight_sha256": "a453f40c8a741041f50bc452c4dfcbec836754ccdd6a99de7ff6ffac7ccf4afe", + "loads": [ + 6, + 5, + 11, + 8, + 0, + 2, + 8, + 7, + 15, + 5, + 18, + 5, + 7, + 5, + 2, + 22, + 10, + 16, + 13, + 16, + 15, + 1, + 1, + 3, + 4, + 8, + 6, + 8, + 3, + 6, + 6, + 6, + 2, + 9, + 14, + 12, + 4, + 3, + 11, + 11, + 12, + 13, + 24, + 7, + 15, + 6, + 3, + 10, + 3, + 14, + 9, + 3, + 1, + 15, + 19, + 22, + 6, + 5, + 3, + 7, + 6, + 16, + 5, + 20 + ], + "weighted_loads": [ + 0.3635582644492388, + 0.10932623408734798, + 0.6228723935782909, + 0.5715811625123024, + 0.0, + 0.07459281384944916, + 0.9701206125319004, + 0.319585113087669, + 1.978477931348607, + 0.21286636404693127, + 1.0358757209032774, + 0.4562160409986973, + 0.6022942923009396, + 0.3025822080671787, + 0.06635243445634842, + 2.943724441807717, + 0.5979893524199724, + 0.9318312034010887, + 1.203260775655508, + 1.1773756816983223, + 2.1560393311083317, + 0.1212923526763916, + 0.03791392222046852, + 0.2808905355632305, + 0.2886791378259659, + 0.7188140731304884, + 0.36989123933017254, + 0.7747991867363453, + 0.21782062202692032, + 0.44772380217909813, + 0.5057804249227047, + 0.21281950920820236, + 0.15619955211877823, + 0.4108900036662817, + 1.0725701749324799, + 0.8969177342951298, + 0.26341963931918144, + 0.15153377503156662, + 0.9894742295145988, + 1.0116456672549248, + 1.3214776944369078, + 1.248939123004675, + 1.7196446061134338, + 0.48995986580848694, + 1.1176481805741787, + 0.4595973566174507, + 0.14472465589642525, + 0.3801016975194216, + 0.30736785754561424, + 0.811703983694315, + 1.0247656255960464, + 0.12143197283148766, + 0.6645369529724121, + 1.1375329308211803, + 1.697787569835782, + 1.679571544751525, + 0.5582491289824247, + 0.6502899918705225, + 0.1821557842195034, + 0.43211184814572334, + 0.8903399929404259, + 0.9843294117599726, + 0.3463691920042038, + 2.821545872837305 + ], + "unique_experts": 63, + "load_cv": 0.668619715989907, + "normalized_load_entropy": 0.945711831328664, + "max_load_share": 0.043010752688172046 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 52, + "ordered_topk_exact_tokens": 40, + "set_exact_tokens": 44, + "mean_set_jaccard": 0.9560439560439561, + "mean_token_weighted_tv": 0.01120947695408876, + "aggregate_load_tv": 0.01602564102564103 + }, + "system_bos": { + "tokens": 52, + "ordered_topk_exact_tokens": 34, + "set_exact_tokens": 40, + "mean_set_jaccard": 0.9340659340659342, + "mean_token_weighted_tv": 0.017621389070812326, + "aggregate_load_tv": 0.03525641025641027 + }, + "system_x": { + "tokens": 52, + "ordered_topk_exact_tokens": 30, + "set_exact_tokens": 39, + "mean_set_jaccard": 0.9285714285714286, + "mean_token_weighted_tv": 0.020437522737595897, + "aggregate_load_tv": 0.038461538461538464 + }, + "system_period": { + "tokens": 52, + "ordered_topk_exact_tokens": 31, + "set_exact_tokens": 38, + "mean_set_jaccard": 0.9230769230769231, + "mean_token_weighted_tv": 0.020663231844082475, + "aggregate_load_tv": 0.035256410256410256 + }, + "bos_at_s0": { + "tokens": 52, + "ordered_topk_exact_tokens": 29, + "set_exact_tokens": 38, + "mean_set_jaccard": 0.918956043956044, + "mean_token_weighted_tv": 0.022611595385779556, + "aggregate_load_tv": 0.035256410256410256 + }, + "bos_at_s1": { + "tokens": 52, + "ordered_topk_exact_tokens": 23, + "set_exact_tokens": 31, + "mean_set_jaccard": 0.8846153846153849, + "mean_token_weighted_tv": 0.028888192744209215, + "aggregate_load_tv": 0.05448717948717949 + }, + "x_at_s0": { + "tokens": 52, + "ordered_topk_exact_tokens": 28, + "set_exact_tokens": 38, + "mean_set_jaccard": 0.918956043956044, + "mean_token_weighted_tv": 0.022467597692201916, + "aggregate_load_tv": 0.03846153846153846 + }, + "x_at_s1": { + "tokens": 52, + "ordered_topk_exact_tokens": 24, + "set_exact_tokens": 31, + "mean_set_jaccard": 0.8846153846153846, + "mean_token_weighted_tv": 0.02941583587716405, + "aggregate_load_tv": 0.04807692307692307 + }, + "period_at_s0": { + "tokens": 52, + "ordered_topk_exact_tokens": 27, + "set_exact_tokens": 38, + "mean_set_jaccard": 0.918956043956044, + "mean_token_weighted_tv": 0.021735053724394396, + "aggregate_load_tv": 0.03846153846153846 + }, + "period_at_s1": { + "tokens": 52, + "ordered_topk_exact_tokens": 26, + "set_exact_tokens": 31, + "mean_set_jaccard": 0.8846153846153846, + "mean_token_weighted_tv": 0.029410175388105787, + "aggregate_load_tv": 0.04807692307692307 + } + } + }, + "layer_06": { + "layer": 6, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "a8fba33a2ca729eb9cad52c2e10a05217382c728e43d237785c8574cf14798e1", + "route_weight_sha256": "3f8a24fa6589a8cfb34f47bde1df3824e4c2cac448a418d1c60b10c780cccde8", + "loads": [ + 0, + 6, + 5, + 6, + 0, + 2, + 10, + 3, + 3, + 3, + 4, + 3, + 5, + 21, + 0, + 2, + 3, + 8, + 3, + 1, + 6, + 7, + 3, + 10, + 2, + 4, + 3, + 6, + 12, + 5, + 5, + 2, + 10, + 5, + 3, + 1, + 7, + 4, + 10, + 1, + 7, + 16, + 7, + 6, + 0, + 0, + 0, + 14, + 16, + 5, + 1, + 0, + 2, + 0, + 6, + 3, + 1, + 6, + 7, + 3, + 4, + 6, + 1, + 7 + ], + "weighted_loads": [ + 0.0, + 0.38756129145622253, + 0.34728871285915375, + 0.36562617495656013, + 0.0, + 0.1463129185140133, + 0.6413645390421152, + 0.20621345937252045, + 0.18702629208564758, + 0.1962774582207203, + 0.19520856067538261, + 0.18045945093035698, + 0.46406903862953186, + 1.504361990839243, + 0.0, + 0.0713585913181305, + 0.21184923872351646, + 0.7635389342904091, + 0.2907489091157913, + 0.04926445707678795, + 0.3907299265265465, + 0.3452955074608326, + 0.2533099614083767, + 0.7996230348944664, + 0.12544837966561317, + 0.201274074614048, + 0.14083625189960003, + 0.7040122151374817, + 1.1274482794106007, + 0.3322048932313919, + 0.31178694777190685, + 0.13864139467477798, + 0.9921462051570415, + 0.26078274101018906, + 0.3058365508913994, + 0.038025956600904465, + 0.8621983379125595, + 0.16369761154055595, + 0.845818005502224, + 0.040081024169921875, + 0.4017929919064045, + 1.6209609024226665, + 0.3496262691915035, + 0.36076126992702484, + 0.0, + 0.0, + 0.0, + 1.7895916290581226, + 0.8288447745144367, + 0.34879258647561073, + 0.04905901476740837, + 0.0, + 0.13766272366046906, + 0.0, + 0.34698183089494705, + 0.11816796660423279, + 0.04384273290634155, + 0.2759283445775509, + 0.6216721348464489, + 0.1400366798043251, + 0.32650550827383995, + 0.26617283932864666, + 0.03404078632593155, + 0.491122018545866 + ], + "unique_experts": 56, + "load_cv": 0.8721718641894847, + "normalized_load_entropy": 0.9111423459200102, + "max_load_share": 0.0673076923076923 + }, + "full_input": { + "tokens": 77, + "top_k": 6, + "decisions": 462, + "ordered_route_sha256": "ba8e06722e8d0a77ee9b398232f2fb873f71f9c27446b2c13977b5c01b9881d5", + "route_weight_sha256": "7bbd12bfb1738bb8f85946168bd364588f1b990160c633158ebf042677297455", + "loads": [ + 0, + 9, + 5, + 6, + 1, + 2, + 18, + 3, + 3, + 3, + 4, + 9, + 6, + 23, + 2, + 2, + 8, + 9, + 3, + 9, + 7, + 10, + 5, + 11, + 2, + 5, + 3, + 6, + 12, + 8, + 5, + 2, + 13, + 5, + 4, + 6, + 8, + 14, + 10, + 10, + 7, + 21, + 9, + 6, + 0, + 5, + 11, + 16, + 20, + 5, + 8, + 7, + 2, + 1, + 6, + 13, + 11, + 6, + 7, + 12, + 4, + 6, + 1, + 7 + ], + "weighted_loads": [ + 0.0, + 0.45758742466568947, + 0.34728871285915375, + 0.36562617495656013, + 0.028758414089679718, + 0.1463129185140133, + 1.5212558452039957, + 0.20621345937252045, + 0.18702629208564758, + 0.1962774582207203, + 0.19520856067538261, + 0.5899053886532784, + 0.5211463421583176, + 1.5324257351458073, + 0.1744041070342064, + 0.0713585913181305, + 0.5659529641270638, + 0.7675921455956995, + 0.2907489091157913, + 0.5989967510104179, + 0.43463559076189995, + 0.501179588958621, + 1.7463933788239956, + 0.8354093804955482, + 0.12544837966561317, + 0.22888420149683952, + 0.14083625189960003, + 0.7040122151374817, + 1.1274482794106007, + 0.5188896358013153, + 0.31178694777190685, + 0.13864139467477798, + 1.080003572627902, + 0.26078274101018906, + 0.3406147249042988, + 0.5202030055224895, + 0.9403189495205879, + 0.9016748070716858, + 0.845818005502224, + 0.4019877966493368, + 0.4017929919064045, + 2.018880307674408, + 0.40759082697331905, + 0.36076126992702484, + 0.0, + 0.13318547140806913, + 1.1974364668130875, + 1.811988955596462, + 1.0191965140402317, + 0.34879258647561073, + 0.4873623736202717, + 0.30672092735767365, + 0.13766272366046906, + 0.05570860579609871, + 0.34698183089494705, + 0.8833011947572231, + 1.152878925204277, + 0.2759283445775509, + 0.6216721348464489, + 1.1065886802971363, + 0.32650550827383995, + 0.26617283932864666, + 0.03404078632593155, + 0.491122018545866 + ], + "unique_experts": 62, + "load_cv": 0.6902420588537931, + "normalized_load_entropy": 0.9438432533477632, + "max_load_share": 0.049783549783549784 + } + }, + "s1_eos": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "50557a031990561efd274881c8bb7238ecfcafe2b832f7cb302f23802af6b49d", + "route_weight_sha256": "4618692333cb5eddfca250a7c9d2838ea27419736745462867974cae893f1fae", + "loads": [ + 0, + 6, + 6, + 5, + 0, + 2, + 9, + 3, + 3, + 2, + 4, + 3, + 5, + 21, + 0, + 2, + 3, + 8, + 3, + 1, + 5, + 10, + 3, + 11, + 2, + 3, + 2, + 7, + 11, + 5, + 5, + 2, + 10, + 6, + 3, + 1, + 7, + 2, + 8, + 0, + 9, + 16, + 6, + 6, + 0, + 0, + 0, + 15, + 16, + 5, + 1, + 0, + 2, + 0, + 6, + 3, + 3, + 6, + 7, + 3, + 5, + 6, + 1, + 7 + ], + "weighted_loads": [ + 0.0, + 0.38822002336382866, + 0.3989681713283062, + 0.3217482566833496, + 0.0, + 0.1450297050178051, + 0.5966077968478203, + 0.20522575825452805, + 0.1818280927836895, + 0.15432701259851456, + 0.1930992491543293, + 0.18081451207399368, + 0.46838804706931114, + 1.5100528821349144, + 0.0, + 0.07384152710437775, + 0.21091877296566963, + 0.7519513964653015, + 0.28995369374752045, + 0.04867194965481758, + 0.3631644658744335, + 0.4563717730343342, + 0.2503269873559475, + 0.8449586592614651, + 0.12412552535533905, + 0.17495347559452057, + 0.11074760928750038, + 0.7331791501492262, + 1.0479618981480598, + 0.33572589978575706, + 0.3217117115855217, + 0.14604628831148148, + 1.0069016851484776, + 0.29957007989287376, + 0.30188074707984924, + 0.03619617968797684, + 0.8763479068875313, + 0.07872501760721207, + 0.7632875740528107, + 0.0, + 0.4563949294388294, + 1.6118672490119934, + 0.32064083591103554, + 0.3690648600459099, + 0.0, + 0.0, + 0.0, + 1.8129583038389683, + 0.8340304158627987, + 0.34772438555955887, + 0.049974385648965836, + 0.0, + 0.1397414281964302, + 0.0, + 0.3437250778079033, + 0.11803985759615898, + 0.1244734600186348, + 0.2772890031337738, + 0.6313106119632721, + 0.14244293421506882, + 0.3569626025855541, + 0.26138859800994396, + 0.03211870416998863, + 0.4836706332862377 + ], + "unique_experts": 55, + "load_cv": 0.8878610099067069, + "normalized_load_entropy": 0.9072347095308365, + "max_load_share": 0.0673076923076923 + }, + "full_input": { + "tokens": 93, + "top_k": 6, + "decisions": 558, + "ordered_route_sha256": "3620ea3a1e1ed9eee63dff2fb6363d519f9d441eba62f70318d38bc50a620de2", + "route_weight_sha256": "6d9e82bb9fa627954d96487767717330aad2072ffda49a25a5e7502ebfbc76d8", + "loads": [ + 0, + 8, + 9, + 6, + 2, + 2, + 23, + 4, + 8, + 8, + 4, + 13, + 10, + 23, + 9, + 3, + 13, + 9, + 5, + 11, + 7, + 14, + 5, + 12, + 4, + 4, + 2, + 8, + 12, + 8, + 5, + 5, + 16, + 7, + 7, + 8, + 9, + 19, + 8, + 9, + 9, + 23, + 8, + 6, + 1, + 3, + 14, + 17, + 19, + 5, + 9, + 6, + 3, + 4, + 6, + 14, + 20, + 6, + 7, + 15, + 10, + 6, + 1, + 7 + ], + "weighted_loads": [ + 0.0, + 0.42790985107421875, + 0.5395194217562675, + 0.35918641090393066, + 0.15044708363711834, + 0.1450297050178051, + 1.8579550683498383, + 0.2671627625823021, + 0.523348655551672, + 0.8627287596464157, + 0.1930992491543293, + 0.8556768111884594, + 0.8556650653481483, + 1.5383710726164281, + 0.7059482596814632, + 0.1850888878107071, + 0.9826456308364868, + 0.7560058454982936, + 0.43747173249721527, + 0.802714541554451, + 0.45483626797795296, + 0.6883607674390078, + 1.7416854463517666, + 0.880229227244854, + 0.19100997224450111, + 0.21049148216843605, + 0.11074760928750038, + 0.759632496163249, + 1.0841311104595661, + 0.5473544783890247, + 0.3217117115855217, + 0.3444811888039112, + 1.1916051711887121, + 0.3335125781595707, + 0.5606744438409805, + 0.7377325966954231, + 0.9898863323032856, + 1.3571953848004341, + 0.7632875740528107, + 0.47521258145570755, + 0.4563949294388294, + 2.083019606769085, + 0.37864198349416256, + 0.3690648600459099, + 0.08425655215978622, + 0.06803249614313245, + 1.5101033821702003, + 1.8353658635169268, + 0.990301102399826, + 0.34772438555955887, + 0.5704717487096786, + 0.23829015344381332, + 0.17688671126961708, + 0.22068949788808823, + 0.3437250778079033, + 1.1304739266633987, + 1.8721319548785686, + 0.2772890031337738, + 0.6313106119632721, + 1.2418668922036886, + 0.6205926798284054, + 0.26138859800994396, + 0.03211870416998863, + 0.4836706332862377 + ], + "unique_experts": 63, + "load_cv": 0.6306512470156078, + "normalized_load_entropy": 0.953165448328284, + "max_load_share": 0.04121863799283154 + } + }, + "s0_bos": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "4b45743d89c1ac62adba02143c253667de5e8c89a365484b823622ead1d61aae", + "route_weight_sha256": "1af7ec01f1a9bfafdaea3f188576da47a25a9c78f086108366272091104e544a", + "loads": [ + 0, + 6, + 6, + 6, + 0, + 2, + 10, + 3, + 3, + 2, + 3, + 3, + 5, + 19, + 0, + 1, + 4, + 7, + 3, + 1, + 7, + 9, + 5, + 10, + 2, + 3, + 2, + 6, + 11, + 5, + 5, + 2, + 9, + 3, + 3, + 1, + 7, + 4, + 10, + 1, + 8, + 16, + 6, + 7, + 0, + 0, + 0, + 15, + 17, + 5, + 0, + 2, + 2, + 0, + 5, + 3, + 4, + 6, + 7, + 3, + 4, + 6, + 1, + 6 + ], + "weighted_loads": [ + 0.0, + 0.37778808176517487, + 0.40223396196961403, + 0.3837621621787548, + 0.0, + 0.15125051513314247, + 0.6496789082884789, + 0.21229783073067665, + 0.1757475845515728, + 0.1570843830704689, + 0.15770639665424824, + 0.1878611072897911, + 0.45899762585759163, + 1.4474270567297935, + 0.0, + 0.03457358106970787, + 0.2596520967781544, + 0.750368844717741, + 0.27802276238799095, + 0.05442875623703003, + 0.4388795271515846, + 0.4008648209273815, + 0.3192943222820759, + 0.8539206460118294, + 0.13879818841814995, + 0.17354414984583855, + 0.08297240361571312, + 0.6851702518761158, + 1.038864877074957, + 0.33628634735941887, + 0.3145768754184246, + 0.12642962113022804, + 0.984246414154768, + 0.170522041618824, + 0.2992851212620735, + 0.038854628801345825, + 0.8683789223432541, + 0.17216530814766884, + 0.886836051940918, + 0.038763802498579025, + 0.4300999157130718, + 1.624565090984106, + 0.2982839532196522, + 0.4043915942311287, + 0.0, + 0.0, + 0.0, + 1.8465795069932938, + 0.8671298399567604, + 0.3489058390259743, + 0.0, + 0.06735895946621895, + 0.13069774210453033, + 0.0, + 0.31341200321912766, + 0.12154500931501389, + 0.20058529451489449, + 0.2721490412950516, + 0.61524698138237, + 0.13932016864418983, + 0.2882346101105213, + 0.2765275239944458, + 0.03438565507531166, + 0.4610936716198921 + ], + "unique_experts": 56, + "load_cv": 0.8607902734151036, + "normalized_load_entropy": 0.9123568704282745, + "max_load_share": 0.060897435897435896 + }, + "full_input": { + "tokens": 77, + "top_k": 6, + "decisions": 462, + "ordered_route_sha256": "2cf5ae726e35df4e983e5f13d66db64004acdd24ac947f4ce252c00413251cbb", + "route_weight_sha256": "f29406c871c6bfff812237bce0861b6dc4c4386eecc002f5088417cfc6fd4221", + "loads": [ + 0, + 8, + 6, + 6, + 1, + 2, + 18, + 3, + 3, + 2, + 3, + 9, + 5, + 20, + 3, + 2, + 10, + 7, + 3, + 9, + 8, + 12, + 6, + 11, + 2, + 4, + 2, + 6, + 11, + 9, + 5, + 2, + 12, + 3, + 4, + 6, + 8, + 15, + 10, + 10, + 8, + 21, + 8, + 7, + 0, + 4, + 13, + 16, + 21, + 5, + 7, + 9, + 2, + 1, + 5, + 13, + 14, + 6, + 7, + 12, + 4, + 6, + 1, + 6 + ], + "weighted_loads": [ + 0.0, + 0.4430616572499275, + 0.40223396196961403, + 0.3837621621787548, + 0.028758414089679718, + 0.15125051513314247, + 1.540185235440731, + 0.21229783073067665, + 0.1757475845515728, + 0.1570843830704689, + 0.15770639665424824, + 0.606252059340477, + 0.45899762585759163, + 1.4705454409122467, + 0.2175254337489605, + 0.08141791075468063, + 0.6414222232997417, + 0.750368844717741, + 0.27802276238799095, + 0.5875160358846188, + 0.4827851913869381, + 0.5599784273654222, + 0.8646874316036701, + 0.8897069916129112, + 0.13879818841814995, + 0.20115427672863007, + 0.08297240361571312, + 0.6851702518761158, + 1.038864877074957, + 0.5687507838010788, + 0.3145768754184246, + 0.12642962113022804, + 1.0721037816256285, + 0.170522041618824, + 0.3340632952749729, + 0.5167271718382835, + 0.9390401169657707, + 0.9832053184509277, + 0.886836051940918, + 0.39697043038904667, + 0.4300999157130718, + 2.0224844962358475, + 0.3562485110014677, + 0.4043915942311287, + 0.0, + 0.1291403155773878, + 1.524112917482853, + 1.8657122906297445, + 1.0627534128725529, + 0.3489058390259743, + 0.47692282870411873, + 0.3740798868238926, + 0.13069774210453033, + 0.04680216684937477, + 0.31341200321912766, + 0.8866782374680042, + 1.3754375167191029, + 0.2721490412950516, + 0.61524698138237, + 1.105872169137001, + 0.2882346101105213, + 0.2765275239944458, + 0.03438565507531166, + 0.4610936716198921 + ], + "unique_experts": 62, + "load_cv": 0.7005902038165939, + "normalized_load_entropy": 0.9411336362343856, + "max_load_share": 0.045454545454545456 + } + }, + "s1_bos": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "9142469c0264d093cf1b540875301ee53c11ec7e1209edb998a844cfc7e59e64", + "route_weight_sha256": "0b2eb4886db06ec828b1edf0fafa5f188039c8aea1ad0c412f0f922e9af99313", + "loads": [ + 0, + 7, + 6, + 6, + 0, + 2, + 9, + 4, + 3, + 2, + 3, + 3, + 5, + 20, + 0, + 2, + 3, + 7, + 3, + 1, + 7, + 10, + 4, + 10, + 2, + 3, + 2, + 8, + 11, + 5, + 5, + 2, + 9, + 5, + 3, + 1, + 7, + 3, + 10, + 1, + 7, + 16, + 5, + 7, + 0, + 0, + 0, + 14, + 17, + 5, + 1, + 1, + 2, + 0, + 4, + 3, + 4, + 5, + 7, + 4, + 4, + 6, + 0, + 6 + ], + "weighted_loads": [ + 0.0, + 0.4260083995759487, + 0.4187200777232647, + 0.39343052729964256, + 0.0, + 0.15086207538843155, + 0.6127344965934753, + 0.24067769199609756, + 0.18074191734194756, + 0.16202421486377716, + 0.1525300033390522, + 0.18557703122496605, + 0.47169632837176323, + 1.5194522999227047, + 0.0, + 0.08240101486444473, + 0.2186446450650692, + 0.7048828862607479, + 0.2722564563155174, + 0.05418755114078522, + 0.4485059715807438, + 0.43347759917378426, + 0.28418590128421783, + 0.8491260260343552, + 0.14280183240771294, + 0.1715938225388527, + 0.09051116183400154, + 0.7346607595682144, + 1.0320300720632076, + 0.3360774479806423, + 0.3140830434858799, + 0.1225157305598259, + 0.9830354452133179, + 0.26554980501532555, + 0.30914927273988724, + 0.03592515364289284, + 0.8648725301027298, + 0.11724291741847992, + 0.8638097234070301, + 0.03492225706577301, + 0.38435392268002033, + 1.636423084884882, + 0.27902011200785637, + 0.41356468200683594, + 0.0, + 0.0, + 0.0, + 1.8110532723367214, + 0.8588875010609627, + 0.3446110934019089, + 0.05734613537788391, + 0.039717912673950195, + 0.13514934480190277, + 0.0, + 0.24820290505886078, + 0.1199822761118412, + 0.18974514305591583, + 0.23140723258256912, + 0.625768817961216, + 0.17408960312604904, + 0.2767299525439739, + 0.2804211489856243, + 0.0, + 0.4346836470067501 + ], + "unique_experts": 56, + "load_cv": 0.8653608733685234, + "normalized_load_entropy": 0.9120651124257266, + "max_load_share": 0.0641025641025641 + }, + "full_input": { + "tokens": 93, + "top_k": 6, + "decisions": 558, + "ordered_route_sha256": "02745e52001df20ce6b9806ad4c661224f997cdf8ab05eb3ef59e2d4be485d18", + "route_weight_sha256": "9b7b35e301b5676a2f5ab30b1e38ed9f738b34362258d6e80d0151c8b87d1719", + "loads": [ + 0, + 8, + 9, + 7, + 2, + 2, + 25, + 5, + 8, + 8, + 3, + 13, + 9, + 21, + 9, + 4, + 13, + 7, + 5, + 11, + 9, + 14, + 5, + 11, + 4, + 4, + 2, + 9, + 12, + 8, + 5, + 5, + 15, + 6, + 7, + 8, + 9, + 20, + 10, + 10, + 7, + 23, + 7, + 7, + 1, + 2, + 16, + 16, + 20, + 5, + 10, + 7, + 3, + 4, + 4, + 14, + 21, + 5, + 7, + 16, + 9, + 6, + 0, + 6 + ], + "weighted_loads": [ + 0.0, + 0.46093176305294037, + 0.559271328151226, + 0.4308686815202236, + 0.15044708363711834, + 0.15086207538843155, + 1.9764346852898598, + 0.3026146963238716, + 0.52226248010993, + 0.8704259619116783, + 0.1525300033390522, + 0.8744991682469845, + 0.8007721342146397, + 1.5425706841051579, + 0.7081684060394764, + 0.24661167711019516, + 0.9785539992153645, + 0.7048828862607479, + 0.41977449506521225, + 0.8013298474252224, + 0.5401777736842632, + 0.6709134820848703, + 0.8295790106058121, + 0.8843965940177441, + 0.20869820937514305, + 0.20713182911276817, + 0.09051116183400154, + 0.7611141055822372, + 1.068199284374714, + 0.5412637405097485, + 0.3140830434858799, + 0.32095063105225563, + 1.1709402967244387, + 0.2994923032820225, + 0.5679429695010185, + 0.7321587391197681, + 0.9670900739729404, + 1.4661606959998608, + 0.8638097234070301, + 0.5101348385214806, + 0.38435392268002033, + 2.1075754426419735, + 0.3370212595909834, + 0.41356468200683594, + 0.08425655215978622, + 0.06426137685775757, + 1.781291738152504, + 1.887195872142911, + 1.0307614728808403, + 0.3446110934019089, + 0.664593942463398, + 0.2780080661177635, + 0.17229462787508965, + 0.21338964998722076, + 0.24820290505886078, + 1.132416345179081, + 2.0174246318638325, + 0.23140723258256912, + 0.625768817961216, + 1.2735135611146688, + 0.5403600297868252, + 0.2804211489856243, + 0.0, + 0.4346836470067501 + ], + "unique_experts": 62, + "load_cv": 0.6502290015039188, + "normalized_load_entropy": 0.9496229255560464, + "max_load_share": 0.044802867383512544 + } + }, + "s0_x": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "960cd34e510e70902caab32132473130993dda64036747500d0838b434907324", + "route_weight_sha256": "8dc1ac5138fa4096cebf7c00fe72a75e2c9ccded719f2d6fef73cbf04632f38b", + "loads": [ + 0, + 6, + 6, + 6, + 0, + 2, + 8, + 3, + 3, + 2, + 3, + 3, + 5, + 20, + 0, + 1, + 3, + 7, + 3, + 1, + 7, + 10, + 6, + 10, + 2, + 3, + 2, + 7, + 10, + 5, + 5, + 2, + 9, + 3, + 3, + 1, + 7, + 4, + 10, + 1, + 7, + 16, + 5, + 6, + 0, + 0, + 0, + 16, + 17, + 5, + 1, + 1, + 2, + 0, + 5, + 3, + 4, + 6, + 7, + 4, + 4, + 7, + 1, + 6 + ], + "weighted_loads": [ + 0.0, + 0.3782811462879181, + 0.3944028280675411, + 0.3779935725033283, + 0.0, + 0.1518823839724064, + 0.5604644231498241, + 0.21601617336273193, + 0.17502699047327042, + 0.15065040439367294, + 0.15459224954247475, + 0.18246188014745712, + 0.45071841776371, + 1.4849101901054382, + 0.0, + 0.03577575460076332, + 0.23418006300926208, + 0.7415596805512905, + 0.27252059802412987, + 0.04911439120769501, + 0.4450758881866932, + 0.4233000986278057, + 0.355718694627285, + 0.8539970368146896, + 0.13809798285365105, + 0.17178314924240112, + 0.08392039313912392, + 0.6986667700111866, + 0.9660631604492664, + 0.3343294784426689, + 0.2943035513162613, + 0.13566067814826965, + 0.9844620265066624, + 0.16830160096287727, + 0.31519150733947754, + 0.03978496789932251, + 0.8445517420768738, + 0.1823187954723835, + 0.8826337419450283, + 0.04050486162304878, + 0.40353405103087425, + 1.612544883042574, + 0.27366454899311066, + 0.3741704933345318, + 0.0, + 0.0, + 0.0, + 1.8883772231638432, + 0.876866215839982, + 0.3475281745195389, + 0.058820657432079315, + 0.03643634915351868, + 0.13253576308488846, + 0.0, + 0.29361284151673317, + 0.11594881117343903, + 0.20144060254096985, + 0.2691807486116886, + 0.6285472102463245, + 0.16394280083477497, + 0.28427499532699585, + 0.3237278647720814, + 0.033094391226768494, + 0.4428918845951557 + ], + "unique_experts": 57, + "load_cv": 0.8714177163059708, + "normalized_load_entropy": 0.9125951277768037, + "max_load_share": 0.0641025641025641 + }, + "full_input": { + "tokens": 77, + "top_k": 6, + "decisions": 462, + "ordered_route_sha256": "bf22258e0de924e1ec51a0963ea6e149b22e7b3b9819fe3efe5383db47c72282", + "route_weight_sha256": "dba72702b62f60aca0ecc8cc1ba686519208dea0e43ca55e7c6f54c7c09870be", + "loads": [ + 0, + 8, + 6, + 6, + 1, + 2, + 18, + 3, + 3, + 2, + 3, + 8, + 5, + 21, + 3, + 2, + 8, + 7, + 3, + 10, + 8, + 13, + 7, + 11, + 2, + 4, + 2, + 7, + 10, + 8, + 5, + 2, + 12, + 3, + 4, + 6, + 8, + 15, + 10, + 9, + 7, + 23, + 7, + 6, + 0, + 4, + 12, + 17, + 21, + 5, + 6, + 9, + 2, + 1, + 5, + 14, + 13, + 6, + 7, + 14, + 4, + 7, + 1, + 6 + ], + "weighted_loads": [ + 0.0, + 0.44355472177267075, + 0.3944028280675411, + 0.3779935725033283, + 0.028758414089679718, + 0.1518823839724064, + 1.742023192346096, + 0.21601617336273193, + 0.17502699047327042, + 0.15065040439367294, + 0.15459224954247475, + 0.5404422767460346, + 0.45071841776371, + 1.5080285742878914, + 0.21510428190231323, + 0.07951459661126137, + 0.5695263780653477, + 0.7415596805512905, + 0.27252059802412987, + 0.6512658149003983, + 0.48898155242204666, + 0.5788000766187906, + 0.9011118039488792, + 0.8897833824157715, + 0.13809798285365105, + 0.19939327612519264, + 0.08392039313912392, + 0.6986667700111866, + 0.9660631604492664, + 0.5191022306680679, + 0.2943035513162613, + 0.13566067814826965, + 1.0723193939775229, + 0.16830160096287727, + 0.34996968135237694, + 0.5540311932563782, + 0.9112631231546402, + 0.9286700524389744, + 0.8826337419450283, + 0.35651334933936596, + 0.40353405103087425, + 2.149390686303377, + 0.3316291067749262, + 0.3741704933345318, + 0.0, + 0.1291403155773878, + 1.2341911122202873, + 1.907510006800294, + 1.07986050657928, + 0.3475281745195389, + 0.4117419794201851, + 0.37790320441126823, + 0.13253576308488846, + 0.04694423824548721, + 0.29361284151673317, + 0.9369099624454975, + 1.2382496930658817, + 0.2691807486116886, + 0.6285472102463245, + 1.2060989122837782, + 0.28427499532699585, + 0.3237278647720814, + 0.033094391226768494, + 0.4428918845951557 + ], + "unique_experts": 62, + "load_cv": 0.7229178002973571, + "normalized_load_entropy": 0.9390752196323353, + "max_load_share": 0.049783549783549784 + } + }, + "s1_x": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "0fe5992ca9e13faf2bbc0185ce5aa3a204e3a1ac58a3c8c55e0dfc9171dda59d", + "route_weight_sha256": "1ba77d769575ac784e2e539d502e937c0f8b291e17e5fdc6d35837a2eadf46d1", + "loads": [ + 0, + 5, + 6, + 6, + 0, + 2, + 9, + 4, + 3, + 2, + 3, + 3, + 5, + 20, + 0, + 2, + 3, + 8, + 3, + 1, + 7, + 9, + 4, + 10, + 2, + 3, + 3, + 8, + 11, + 6, + 5, + 2, + 9, + 4, + 3, + 1, + 7, + 3, + 9, + 1, + 7, + 16, + 5, + 7, + 0, + 0, + 0, + 15, + 18, + 5, + 1, + 2, + 2, + 0, + 4, + 3, + 3, + 4, + 7, + 4, + 4, + 7, + 0, + 6 + ], + "weighted_loads": [ + 0.0, + 0.35646966472268105, + 0.4156586229801178, + 0.37812982872128487, + 0.0, + 0.15153498202562332, + 0.6185725592076778, + 0.23558449186384678, + 0.18361186608672142, + 0.16850478947162628, + 0.1494817491620779, + 0.18652695044875145, + 0.46689803525805473, + 1.5049026124179363, + 0.0, + 0.08266207575798035, + 0.22138895839452744, + 0.7271807491779327, + 0.26709649711847305, + 0.05075500160455704, + 0.45938362553715706, + 0.3954356014728546, + 0.27928362414240837, + 0.8500002697110176, + 0.14165068417787552, + 0.170086819678545, + 0.12473773583769798, + 0.7213237062096596, + 1.0222625397145748, + 0.3670513182878494, + 0.2915593832731247, + 0.12385812401771545, + 0.9723734632134438, + 0.22070181369781494, + 0.30217524617910385, + 0.037394192069768906, + 0.8675632625818253, + 0.1242598406970501, + 0.8110941275954247, + 0.03587625175714493, + 0.392634604126215, + 1.6236584819853306, + 0.2765306606888771, + 0.41922301054000854, + 0.0, + 0.0, + 0.0, + 1.8434624709188938, + 0.9085276685655117, + 0.3492933101952076, + 0.058035317808389664, + 0.06864054687321186, + 0.1382228210568428, + 0.0, + 0.239242535084486, + 0.11893946677446365, + 0.13947413861751556, + 0.19753127917647362, + 0.6383241303265095, + 0.175224669277668, + 0.2700619325041771, + 0.3301714025437832, + 0.0, + 0.42802869156003 + ], + "unique_experts": 56, + "load_cv": 0.8744304053835864, + "normalized_load_entropy": 0.9119949898406349, + "max_load_share": 0.0641025641025641 + }, + "full_input": { + "tokens": 93, + "top_k": 6, + "decisions": 558, + "ordered_route_sha256": "595d841239f779a50d189cb4df91373f10384fa7dd97c2b72f1aee790bd57cf2", + "route_weight_sha256": "67101139e74da52ef696457eb4e571661f642de6ee4eb4d6e947b909f3edad3d", + "loads": [ + 0, + 6, + 9, + 7, + 2, + 2, + 27, + 5, + 8, + 8, + 3, + 12, + 9, + 21, + 9, + 4, + 12, + 8, + 5, + 13, + 9, + 13, + 5, + 11, + 4, + 4, + 3, + 9, + 12, + 9, + 5, + 5, + 14, + 5, + 7, + 8, + 9, + 19, + 9, + 10, + 7, + 25, + 7, + 7, + 1, + 2, + 14, + 16, + 21, + 5, + 9, + 9, + 3, + 4, + 4, + 15, + 19, + 4, + 7, + 17, + 9, + 7, + 0, + 6 + ], + "weighted_loads": [ + 0.0, + 0.3913930281996727, + 0.5562098734080791, + 0.4155679829418659, + 0.15044708363711834, + 0.15153498202562332, + 2.3028805032372475, + 0.2975214961916208, + 0.5251324288547039, + 0.8769065365195274, + 0.1494817491620779, + 0.8216489180922508, + 0.7959738411009312, + 1.5280209966003895, + 0.7039088942110538, + 0.261046826839447, + 0.9394984170794487, + 0.7271807491779327, + 0.4146145358681679, + 0.8886773027479649, + 0.5510554276406765, + 0.6325808819383383, + 0.8246767334640026, + 0.8852708376944065, + 0.20740392059087753, + 0.20562482625246048, + 0.12473773583769798, + 0.7477770522236824, + 1.058431752026081, + 0.565107673406601, + 0.2915593832731247, + 0.3222930245101452, + 1.1211434286087751, + 0.25464431196451187, + 0.5609689429402351, + 0.7283117361366749, + 0.974535059183836, + 1.331576507538557, + 0.8110941275954247, + 0.5110888332128525, + 0.392634604126215, + 2.227732952684164, + 0.3345318082720041, + 0.41922301054000854, + 0.08425655215978622, + 0.06426137685775757, + 1.4723047837615013, + 1.8625952545553446, + 1.084515780210495, + 0.3492933101952076, + 0.584271427243948, + 0.3357842341065407, + 0.17536810413002968, + 0.20944330468773842, + 0.239242535084486, + 1.2016723416745663, + 1.789301309734583, + 0.19753127917647362, + 0.6383241303265095, + 1.347677467390895, + 0.5336920097470284, + 0.3301714025437832, + 0.0, + 0.42802869156003 + ], + "unique_experts": 62, + "load_cv": 0.6599558175508452, + "normalized_load_entropy": 0.9491364422837566, + "max_load_share": 0.04838709677419355 + } + }, + "s0_period": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "da8f6b9fe5f70cbd59037dae0c89ba683041cd01509482b14c842fac7f6784ae", + "route_weight_sha256": "c69614c19e6ffc98b563b09dc25ea4db7968c4e0f1ad30735e2bdd92631cdb1a", + "loads": [ + 0, + 6, + 6, + 6, + 0, + 2, + 8, + 4, + 3, + 2, + 3, + 3, + 5, + 19, + 0, + 1, + 3, + 7, + 3, + 1, + 7, + 9, + 5, + 10, + 2, + 3, + 2, + 7, + 11, + 5, + 6, + 2, + 9, + 3, + 3, + 2, + 7, + 6, + 10, + 1, + 7, + 16, + 5, + 6, + 0, + 0, + 0, + 14, + 17, + 5, + 1, + 1, + 2, + 0, + 5, + 3, + 4, + 6, + 7, + 4, + 4, + 7, + 0, + 6 + ], + "weighted_loads": [ + 0.0, + 0.381609421223402, + 0.3906278610229492, + 0.3824450634419918, + 0.0, + 0.14804602786898613, + 0.561964362859726, + 0.2460109405219555, + 0.17942628264427185, + 0.1532788723707199, + 0.1553842332214117, + 0.18645884469151497, + 0.44420114532113075, + 1.4460521712899208, + 0.0, + 0.035658661276102066, + 0.23605254292488098, + 0.7539294548332691, + 0.27607765421271324, + 0.04419008642435074, + 0.4442100524902344, + 0.40003035590052605, + 0.317867249250412, + 0.8634977377951145, + 0.1368459090590477, + 0.17242606729269028, + 0.10407081618905067, + 0.7073966935276985, + 1.0016908459365368, + 0.32486478611826897, + 0.33214806392788887, + 0.13763698190450668, + 0.9786265343427658, + 0.16844315454363823, + 0.3079680949449539, + 0.07022923976182938, + 0.8602768033742905, + 0.27772122249007225, + 0.855583842843771, + 0.037404414266347885, + 0.402002539485693, + 1.596105720847845, + 0.27644212916493416, + 0.3676084838807583, + 0.0, + 0.0, + 0.0, + 1.8178572431206703, + 0.8697476927191019, + 0.338206946849823, + 0.056982625275850296, + 0.034870270639657974, + 0.13671360909938812, + 0.0, + 0.28720515593886375, + 0.11659972369670868, + 0.21187803521752357, + 0.27851469069719315, + 0.6359638571739197, + 0.1655511874705553, + 0.2806258015334606, + 0.3209398649632931, + 0.0, + 0.43968458101153374 + ], + "unique_experts": 56, + "load_cv": 0.845376488299207, + "normalized_load_entropy": 0.9144784460519668, + "max_load_share": 0.060897435897435896 + }, + "full_input": { + "tokens": 77, + "top_k": 6, + "decisions": 462, + "ordered_route_sha256": "170f9e9c8f7e55e350e35be5f451995d9c708e7f15da6ec44474b436777b73c7", + "route_weight_sha256": "f6e4547648c38323848f67460b5772cd579a43f2ea504edace638f055e2702c2", + "loads": [ + 0, + 8, + 6, + 6, + 1, + 2, + 18, + 4, + 3, + 2, + 3, + 8, + 6, + 20, + 2, + 2, + 8, + 7, + 3, + 11, + 8, + 12, + 6, + 11, + 2, + 4, + 2, + 7, + 12, + 8, + 6, + 2, + 12, + 3, + 4, + 7, + 8, + 17, + 10, + 9, + 7, + 22, + 7, + 6, + 0, + 4, + 12, + 15, + 21, + 5, + 6, + 9, + 2, + 1, + 5, + 14, + 13, + 6, + 7, + 13, + 4, + 7, + 0, + 6 + ], + "weighted_loads": [ + 0.0, + 0.4468829967081547, + 0.3906278610229492, + 0.3824450634419918, + 0.028758414089679718, + 0.14804602786898613, + 1.6211189962923527, + 0.2460109405219555, + 0.17942628264427185, + 0.1532788723707199, + 0.1553842332214117, + 0.547623373568058, + 0.49653178453445435, + 1.469170555472374, + 0.1702273264527321, + 0.07356877624988556, + 0.5592384785413742, + 0.7539294548332691, + 0.27607765421271324, + 0.7385416850447655, + 0.48811571672558784, + 0.5558550152927637, + 0.8632603585720062, + 0.8992840833961964, + 0.1368459090590477, + 0.2000361941754818, + 0.10407081618905067, + 0.7073966935276985, + 1.1059087328612804, + 0.511877004057169, + 0.33214806392788887, + 0.13763698190450668, + 1.0664839018136263, + 0.16844315454363823, + 0.3427462689578533, + 0.5842301025986671, + 0.9279019609093666, + 1.1271229907870293, + 0.855583842843771, + 0.35341290198266506, + 0.402002539485693, + 2.05139272660017, + 0.3344066869467497, + 0.3676084838807583, + 0.0, + 0.1291403155773878, + 1.2409488521516323, + 1.836990026757121, + 1.0676735509186983, + 0.338206946849823, + 0.4044696092605591, + 0.376054335385561, + 0.13671360909938812, + 0.04708091914653778, + 0.28720515593886375, + 1.0287289582192898, + 1.2276887372136116, + 0.27851469069719315, + 0.6359638571739197, + 1.1321031879633665, + 0.2806258015334606, + 0.3209398649632931, + 0.0, + 0.43968458101153374 + ], + "unique_experts": 61, + "load_cv": 0.7124731034939767, + "normalized_load_entropy": 0.9387479188706758, + "max_load_share": 0.047619047619047616 + } + }, + "s1_period": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "0286d91fd2ee717725d5cf912249bc6805f3940711aff9202a8e67bd244416bb", + "route_weight_sha256": "45a96c66d4226b44ad598a214cb1f422eb23c8d1f9eefb661e56bef32840d768", + "loads": [ + 0, + 7, + 6, + 6, + 0, + 2, + 9, + 3, + 3, + 2, + 3, + 3, + 5, + 21, + 0, + 2, + 3, + 7, + 3, + 1, + 7, + 9, + 3, + 9, + 2, + 4, + 4, + 8, + 11, + 5, + 5, + 2, + 9, + 4, + 3, + 1, + 7, + 3, + 9, + 1, + 7, + 16, + 6, + 7, + 0, + 0, + 0, + 14, + 18, + 5, + 1, + 1, + 2, + 0, + 4, + 3, + 3, + 6, + 7, + 4, + 3, + 7, + 0, + 6 + ], + "weighted_loads": [ + 0.0, + 0.427278321236372, + 0.4219558537006378, + 0.38132571056485176, + 0.0, + 0.14817561581730843, + 0.6279741823673248, + 0.2032143585383892, + 0.18147733062505722, + 0.16693315654993057, + 0.1501427385956049, + 0.18853744491934776, + 0.4594157300889492, + 1.5372782498598099, + 0.0, + 0.06555916368961334, + 0.21924960613250732, + 0.7087493240833282, + 0.2656625285744667, + 0.04645448550581932, + 0.45581087842583656, + 0.39523352310061455, + 0.24230904132127762, + 0.8247215673327446, + 0.1370331235229969, + 0.2050587236881256, + 0.1583205945789814, + 0.7198303528130054, + 1.0114986151456833, + 0.32648853957653046, + 0.2975736055523157, + 0.1264553815126419, + 0.9799069352447987, + 0.2189691998064518, + 0.3027620166540146, + 0.03400041162967682, + 0.8716762661933899, + 0.13116274029016495, + 0.7919256538152695, + 0.03681087866425514, + 0.3867907878011465, + 1.6056596860289574, + 0.30926719307899475, + 0.40925227850675583, + 0.0, + 0.0, + 0.0, + 1.8178507462143898, + 0.9071003831923008, + 0.34883641451597214, + 0.05686774477362633, + 0.03758697211742401, + 0.13989269733428955, + 0.0, + 0.23934895917773247, + 0.12277679517865181, + 0.144215639680624, + 0.279156643897295, + 0.6286424398422241, + 0.17587679997086525, + 0.23152991384267807, + 0.3273887038230896, + 0.0, + 0.4193274639546871 + ], + "unique_experts": 56, + "load_cv": 0.8789300769744929, + "normalized_load_entropy": 0.9110506794986195, + "max_load_share": 0.0673076923076923 + }, + "full_input": { + "tokens": 93, + "top_k": 6, + "decisions": 558, + "ordered_route_sha256": "f1cd8979e749b4b38ea81c070d3d5825838bc57a3ddb7d1de973261fe2bbab0a", + "route_weight_sha256": "775a9631ab279715f3c89bdbb8dc1f8c3b0d003970e4262c3d2b271d274cd238", + "loads": [ + 0, + 8, + 9, + 7, + 2, + 2, + 27, + 4, + 8, + 8, + 3, + 12, + 10, + 22, + 9, + 4, + 12, + 7, + 5, + 13, + 9, + 13, + 4, + 10, + 4, + 5, + 4, + 9, + 13, + 8, + 5, + 5, + 14, + 5, + 7, + 8, + 9, + 20, + 9, + 10, + 7, + 24, + 8, + 7, + 1, + 2, + 15, + 15, + 20, + 5, + 8, + 8, + 3, + 4, + 4, + 15, + 19, + 6, + 7, + 16, + 8, + 7, + 0, + 6 + ], + "weighted_loads": [ + 0.0, + 0.46220168471336365, + 0.5625071041285992, + 0.4187638647854328, + 0.15044708363711834, + 0.14817561581730843, + 2.1668288707733154, + 0.26515136286616325, + 0.5229978933930397, + 0.8753349035978317, + 0.1501427385956049, + 0.8170898035168648, + 0.8537886552512646, + 1.560396634042263, + 0.7021876163780689, + 0.22996746376156807, + 0.9340284466743469, + 0.7087493240833282, + 0.41318056732416153, + 0.9868943244218826, + 0.547482680529356, + 0.631021173670888, + 0.7877021506428719, + 0.8599921353161335, + 0.20356299355626106, + 0.2405967302620411, + 0.1583205945789814, + 0.7462836988270283, + 1.1707268171012402, + 0.525288462638855, + 0.2975736055523157, + 0.32489028200507164, + 1.12867690064013, + 0.2529116980731487, + 0.5615557134151459, + 0.7367402464151382, + 0.9786295332014561, + 1.4917897507548332, + 0.7919256538152695, + 0.5120234601199627, + 0.3867907878011465, + 2.1201322823762894, + 0.3672683406621218, + 0.40925227850675583, + 0.08425655215978622, + 0.06426137685775757, + 1.5149713456630707, + 1.8369835298508406, + 1.0069202557206154, + 0.34883641451597214, + 0.532048661261797, + 0.308864738792181, + 0.17703798040747643, + 0.20886880531907082, + 0.23934895917773247, + 1.2649429515004158, + 1.7855875790119171, + 0.279156643897295, + 0.6286424398422241, + 1.275300757959485, + 0.4951599910855293, + 0.3273887038230896, + 0.0, + 0.4193274639546871 + ], + "unique_experts": 62, + "load_cv": 0.6533825055056113, + "normalized_load_entropy": 0.9501471746006847, + "max_load_share": 0.04838709677419355 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 52, + "ordered_topk_exact_tokens": 34, + "set_exact_tokens": 38, + "mean_set_jaccard": 0.9230769230769231, + "mean_token_weighted_tv": 0.01500239183839697, + "aggregate_load_tv": 0.04166666666666667 + }, + "system_bos": { + "tokens": 52, + "ordered_topk_exact_tokens": 33, + "set_exact_tokens": 40, + "mean_set_jaccard": 0.9340659340659341, + "mean_token_weighted_tv": 0.017356963828206062, + "aggregate_load_tv": 0.03525641025641024 + }, + "system_x": { + "tokens": 52, + "ordered_topk_exact_tokens": 30, + "set_exact_tokens": 39, + "mean_set_jaccard": 0.9285714285714284, + "mean_token_weighted_tv": 0.019477200927212834, + "aggregate_load_tv": 0.03846153846153846 + }, + "system_period": { + "tokens": 52, + "ordered_topk_exact_tokens": 29, + "set_exact_tokens": 36, + "mean_set_jaccard": 0.9079670329670328, + "mean_token_weighted_tv": 0.021693987091286823, + "aggregate_load_tv": 0.04166666666666666 + }, + "bos_at_s0": { + "tokens": 52, + "ordered_topk_exact_tokens": 25, + "set_exact_tokens": 30, + "mean_set_jaccard": 0.8791208791208793, + "mean_token_weighted_tv": 0.029488303071747605, + "aggregate_load_tv": 0.05128205128205127 + }, + "bos_at_s1": { + "tokens": 52, + "ordered_topk_exact_tokens": 20, + "set_exact_tokens": 29, + "mean_set_jaccard": 0.8736263736263736, + "mean_token_weighted_tv": 0.030054963713225264, + "aggregate_load_tv": 0.05128205128205128 + }, + "x_at_s0": { + "tokens": 52, + "ordered_topk_exact_tokens": 22, + "set_exact_tokens": 31, + "mean_set_jaccard": 0.8804945054945055, + "mean_token_weighted_tv": 0.029678811175891988, + "aggregate_load_tv": 0.05769230769230769 + }, + "x_at_s1": { + "tokens": 52, + "ordered_topk_exact_tokens": 20, + "set_exact_tokens": 25, + "mean_set_jaccard": 0.8516483516483517, + "mean_token_weighted_tv": 0.03329057169433396, + "aggregate_load_tv": 0.057692307692307696 + }, + "period_at_s0": { + "tokens": 52, + "ordered_topk_exact_tokens": 23, + "set_exact_tokens": 31, + "mean_set_jaccard": 0.8804945054945056, + "mean_token_weighted_tv": 0.02883167824564645, + "aggregate_load_tv": 0.0608974358974359 + }, + "period_at_s1": { + "tokens": 52, + "ordered_topk_exact_tokens": 20, + "set_exact_tokens": 27, + "mean_set_jaccard": 0.8626373626373627, + "mean_token_weighted_tv": 0.03172473550344316, + "aggregate_load_tv": 0.05448717948717948 + } + } + }, + "layer_07": { + "layer": 7, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "9fa9c07512af2bd3b5cda1551838ce6fce13c25fae066ddecb48d9521bb0ea73", + "route_weight_sha256": "5f050ad9bea85bc587d04c36c01396270ebba897479c1d3ca3a70050901eff9d", + "loads": [ + 4, + 1, + 2, + 1, + 2, + 7, + 0, + 7, + 2, + 17, + 3, + 5, + 3, + 4, + 14, + 4, + 5, + 1, + 10, + 6, + 0, + 2, + 0, + 6, + 9, + 2, + 3, + 14, + 3, + 2, + 4, + 24, + 6, + 4, + 13, + 11, + 2, + 2, + 3, + 9, + 4, + 1, + 2, + 0, + 5, + 1, + 14, + 1, + 2, + 7, + 3, + 7, + 5, + 15, + 5, + 6, + 1, + 1, + 3, + 0, + 5, + 2, + 5, + 0 + ], + "weighted_loads": [ + 0.2661633975803852, + 0.03418333828449249, + 0.12515055015683174, + 0.03132317215204239, + 0.09291844069957733, + 0.4299473911523819, + 0.0, + 0.7251174412667751, + 0.15072447806596756, + 1.230834137648344, + 0.3849740996956825, + 0.32358928956091404, + 0.12407977692782879, + 0.3460063599050045, + 0.9445627108216286, + 0.26580744609236717, + 0.1961989775300026, + 0.025684967637062073, + 0.41631538420915604, + 0.43464522063732147, + 0.0, + 0.1619608923792839, + 0.0, + 0.20624253526329994, + 0.8196717388927937, + 0.13669054955244064, + 0.16405555605888367, + 1.4656721018254757, + 0.20198972523212433, + 0.12056102603673935, + 0.23272287100553513, + 2.484995935112238, + 0.4189976900815964, + 0.14804723113775253, + 1.208610711619258, + 0.7196100112050772, + 0.07648108154535294, + 0.1372528150677681, + 0.26449423283338547, + 0.4820585362613201, + 0.18220009095966816, + 0.028747687116265297, + 0.21545417606830597, + 0.0, + 0.17387549206614494, + 0.043461330235004425, + 1.2032588757574558, + 0.0486411452293396, + 0.13314878940582275, + 0.3260415904223919, + 0.16277210228145123, + 0.6126117520034313, + 0.45914771035313606, + 0.9731340631842613, + 0.2757256180047989, + 0.4392016790807247, + 0.0382557176053524, + 0.02988973632454872, + 0.3714233972132206, + 0.0, + 0.3156183511018753, + 0.18573573976755142, + 0.2545883320271969, + 0.0 + ], + "unique_experts": 58, + "load_cv": 0.9713177910192724, + "normalized_load_entropy": 0.9003061589311478, + "max_load_share": 0.07692307692307693 + }, + "full_input": { + "tokens": 77, + "top_k": 6, + "decisions": 462, + "ordered_route_sha256": "2ed80f57b9b85803a1b94965a0aa2c72c48665a59ae5310bab67209eb51cd365", + "route_weight_sha256": "9de2e4c80d596a3e8337cce21fd15bd2a67268c1af5089f3a5bb10db478d0994", + "loads": [ + 4, + 1, + 2, + 4, + 2, + 8, + 5, + 7, + 10, + 17, + 5, + 8, + 3, + 9, + 14, + 4, + 19, + 5, + 12, + 7, + 0, + 2, + 3, + 8, + 13, + 2, + 5, + 14, + 6, + 2, + 4, + 24, + 9, + 6, + 13, + 11, + 2, + 2, + 13, + 12, + 4, + 12, + 7, + 2, + 9, + 1, + 16, + 3, + 2, + 7, + 19, + 7, + 5, + 16, + 5, + 13, + 1, + 1, + 7, + 0, + 5, + 8, + 8, + 7 + ], + "weighted_loads": [ + 0.2661633975803852, + 0.03418333828449249, + 0.12515055015683174, + 0.14077379927039146, + 0.09291844069957733, + 0.4717474393546581, + 0.4763828366994858, + 0.7251174412667751, + 0.8384364657104015, + 1.230834137648344, + 0.46318840980529785, + 0.8310336861759424, + 0.12407977692782879, + 0.630559716373682, + 0.9445627108216286, + 0.26580744609236717, + 2.1666163988411427, + 0.2533779852092266, + 0.45775756519287825, + 0.5003418400883675, + 0.0, + 0.1619608923792839, + 0.17194893211126328, + 0.35307473316788673, + 0.9503259249031544, + 0.13669054955244064, + 0.3620707839727402, + 1.4656721018254757, + 0.2650602189823985, + 0.12056102603673935, + 0.23272287100553513, + 2.484995935112238, + 0.5334021784365177, + 0.24878976121544838, + 1.208610711619258, + 0.7196100112050772, + 0.07648108154535294, + 0.1372528150677681, + 1.2170079089701176, + 0.6166529282927513, + 0.18220009095966816, + 0.99586664699018, + 0.5630037486553192, + 0.03197348956018686, + 1.6912782564759254, + 0.043461330235004425, + 1.288922443985939, + 0.22021564841270447, + 0.13314878940582275, + 0.3260415904223919, + 1.3234698977321386, + 0.6126117520034313, + 0.45914771035313606, + 1.0048248618841171, + 0.2757256180047989, + 1.0969442538917065, + 0.0382557176053524, + 0.02988973632454872, + 0.45607185177505016, + 0.0, + 0.3156183511018753, + 0.4829772263765335, + 0.3029235056601465, + 0.26927442848682404 + ], + "unique_experts": 62, + "load_cv": 0.7315761157430517, + "normalized_load_entropy": 0.935606168581543, + "max_load_share": 0.05194805194805195 + } + }, + "s1_eos": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "795225a441a2aeff05b6ff7b972b047dabb59dabf6a732c3b074ad3e9617d1e9", + "route_weight_sha256": "1891f662b29fef01adfe4b2cb27487413d9f5948e81117937ea7896119d9ec98", + "loads": [ + 3, + 2, + 2, + 1, + 2, + 7, + 0, + 7, + 2, + 15, + 3, + 5, + 3, + 4, + 14, + 4, + 5, + 0, + 10, + 6, + 0, + 2, + 0, + 6, + 9, + 2, + 3, + 15, + 3, + 2, + 4, + 25, + 6, + 4, + 13, + 12, + 2, + 2, + 3, + 9, + 4, + 1, + 2, + 1, + 5, + 1, + 15, + 1, + 2, + 5, + 3, + 7, + 5, + 15, + 5, + 6, + 1, + 1, + 3, + 0, + 5, + 2, + 5, + 0 + ], + "weighted_loads": [ + 0.23277347534894943, + 0.07049814611673355, + 0.12453261762857437, + 0.030841665342450142, + 0.09104778990149498, + 0.42700917460024357, + 0.0, + 0.74460344389081, + 0.14439376443624496, + 1.1988902688026428, + 0.3735012635588646, + 0.3258916921913624, + 0.12593840807676315, + 0.33922624588012695, + 0.9150176085531712, + 0.25900911539793015, + 0.1951582469046116, + 0.0, + 0.41153014078736305, + 0.44639497622847557, + 0.0, + 0.16593099385499954, + 0.0, + 0.20370603539049625, + 0.8088727444410324, + 0.1333078257739544, + 0.16069870442152023, + 1.4808639883995056, + 0.19657213613390923, + 0.12060737609863281, + 0.23213926702737808, + 2.508038016036153, + 0.42699847370386124, + 0.14697246626019478, + 1.2336012329906225, + 0.7418520022183657, + 0.0799405388534069, + 0.13770683854818344, + 0.26298578828573227, + 0.48057347536087036, + 0.18071088381111622, + 0.029545752331614494, + 0.20865705609321594, + 0.02621835470199585, + 0.1806399542838335, + 0.0421493761241436, + 1.2397635355591774, + 0.04677823930978775, + 0.13305821269750595, + 0.24463428556919098, + 0.1631221193820238, + 0.62141003459692, + 0.46165183559060097, + 0.984831590205431, + 0.28075044602155685, + 0.4449313282966614, + 0.04343843460083008, + 0.028730986639857292, + 0.3464137203991413, + 0.0, + 0.3130844049155712, + 0.18646042048931122, + 0.2578597590327263, + 0.0 + ], + "unique_experts": 58, + "load_cv": 0.9840944134561789, + "normalized_load_entropy": 0.8995297587514386, + "max_load_share": 0.08012820512820513 + }, + "full_input": { + "tokens": 93, + "top_k": 6, + "decisions": 558, + "ordered_route_sha256": "06ce7a0bb0de39eb86ebd10a0e200a8129d5540ed77b32bed71ed8fd72b79775", + "route_weight_sha256": "1bc1562db8f343808db27c160aa9c9ad14bc14c571616cf0f452ecc203147f23", + "loads": [ + 3, + 2, + 2, + 3, + 3, + 8, + 7, + 7, + 18, + 17, + 10, + 10, + 3, + 9, + 16, + 6, + 20, + 5, + 12, + 7, + 0, + 2, + 2, + 9, + 14, + 2, + 9, + 16, + 6, + 8, + 4, + 25, + 12, + 13, + 13, + 12, + 2, + 6, + 20, + 13, + 6, + 17, + 12, + 4, + 15, + 1, + 17, + 7, + 2, + 5, + 25, + 7, + 5, + 15, + 9, + 15, + 1, + 7, + 6, + 0, + 5, + 8, + 9, + 4 + ], + "weighted_loads": [ + 0.23277347534894943, + 0.07049814611673355, + 0.12453261762857437, + 0.09409971162676811, + 0.1375347524881363, + 0.4710547346621752, + 0.47319547459483147, + 0.74460344389081, + 1.5475594401359558, + 1.300236701965332, + 0.945632204413414, + 0.9365308471024036, + 0.12593840807676315, + 0.6484323516488075, + 0.9832548387348652, + 0.35663218796253204, + 2.574909098446369, + 0.27900267764925957, + 0.45258270483464, + 0.5124394409358501, + 0.0, + 0.16593099385499954, + 0.11821119114756584, + 0.3836467545479536, + 0.9660712359473109, + 0.1333078257739544, + 0.7087194323539734, + 1.5115426778793335, + 0.26021924521774054, + 0.8987498059868813, + 0.23213926702737808, + 2.508038016036153, + 0.8103455826640129, + 0.7298518344759941, + 1.2336012329906225, + 0.7418520022183657, + 0.0799405388534069, + 0.36399692110717297, + 2.039940267801285, + 0.6583311203867197, + 0.40324574150145054, + 1.4663928132504225, + 0.9935065992176533, + 0.09830890223383904, + 2.252913484349847, + 0.0421493761241436, + 1.3444102630019188, + 0.4147402383387089, + 0.13305821269750595, + 0.24463428556919098, + 1.7498845178633928, + 0.62141003459692, + 0.46165183559060097, + 0.984831590205431, + 0.48778877779841423, + 1.2104737143963575, + 0.04343843460083008, + 0.5689919460564852, + 0.4034894807264209, + 0.0, + 0.3130844049155712, + 0.4779335167258978, + 0.3423245707526803, + 0.11605641804635525 + ], + "unique_experts": 62, + "load_cv": 0.6915891119739207, + "normalized_load_entropy": 0.940609626169747, + "max_load_share": 0.044802867383512544 + } + }, + "s0_bos": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "e953244d9e2e71de492690b46eb73125c61452e170da14d025bcae5e549f4a44", + "route_weight_sha256": "5b534bd8c003f98f7c80e015787b8b2310cd639feaf8896eb9bf2f68b01f6096", + "loads": [ + 4, + 1, + 2, + 0, + 2, + 6, + 0, + 7, + 2, + 18, + 3, + 5, + 4, + 4, + 11, + 4, + 5, + 0, + 8, + 6, + 1, + 2, + 0, + 6, + 8, + 2, + 4, + 14, + 4, + 2, + 4, + 27, + 8, + 2, + 12, + 11, + 1, + 2, + 4, + 9, + 3, + 0, + 2, + 1, + 3, + 1, + 16, + 1, + 2, + 7, + 3, + 7, + 5, + 16, + 5, + 6, + 1, + 1, + 4, + 0, + 4, + 2, + 7, + 0 + ], + "weighted_loads": [ + 0.2783641405403614, + 0.04035226255655289, + 0.12890996783971786, + 0.0, + 0.09474020451307297, + 0.40897817723453045, + 0.0, + 0.7341788001358509, + 0.1561460718512535, + 1.3884817138314247, + 0.39487291872501373, + 0.3317500948905945, + 0.18631359189748764, + 0.3259246964007616, + 0.7646246924996376, + 0.2610703818500042, + 0.1883029080927372, + 0.0, + 0.32081011682748795, + 0.4502318985760212, + 0.031907644122838974, + 0.1587916612625122, + 0.0, + 0.2142476588487625, + 0.7636941000819206, + 0.1325424686074257, + 0.2321576066315174, + 1.4247280098497868, + 0.2128973789513111, + 0.12388895079493523, + 0.22955013811588287, + 2.555370634421706, + 0.48701427690684795, + 0.07784520834684372, + 1.1397456601262093, + 0.6839365158230066, + 0.030363749712705612, + 0.1356169804930687, + 0.321381077170372, + 0.48298802971839905, + 0.14658266305923462, + 0.0, + 0.2007451057434082, + 0.0356275700032711, + 0.09915794432163239, + 0.03983955457806587, + 1.2798272036015987, + 0.04367901384830475, + 0.1324371136724949, + 0.3598431646823883, + 0.15978016890585423, + 0.6093116700649261, + 0.46420932561159134, + 1.0344306379556656, + 0.2721937317401171, + 0.4409700147807598, + 0.04000155255198479, + 0.03246491774916649, + 0.4010566733777523, + 0.0, + 0.24648386612534523, + 0.16735126823186874, + 0.32473625615239143, + 0.0 + ], + "unique_experts": 57, + "load_cv": 1.0214658608739533, + "normalized_load_entropy": 0.8934521316340079, + "max_load_share": 0.08653846153846154 + }, + "full_input": { + "tokens": 77, + "top_k": 6, + "decisions": 462, + "ordered_route_sha256": "b0c7038e62556b23f983e56ff39d394e70bad20f22fdd792bac2fc277f478de3", + "route_weight_sha256": "67a5e08df5fe51a85a994d7cbad83b68fbe304b00175ab3c0fe02b3ff9fb6fe5", + "loads": [ + 4, + 1, + 2, + 3, + 2, + 7, + 6, + 7, + 10, + 18, + 5, + 9, + 4, + 9, + 11, + 4, + 20, + 3, + 11, + 7, + 1, + 2, + 3, + 8, + 11, + 2, + 7, + 14, + 6, + 2, + 4, + 27, + 11, + 4, + 12, + 11, + 1, + 2, + 14, + 12, + 3, + 11, + 7, + 2, + 7, + 1, + 18, + 3, + 2, + 7, + 19, + 7, + 5, + 18, + 5, + 13, + 1, + 1, + 7, + 0, + 4, + 8, + 9, + 7 + ], + "weighted_loads": [ + 0.2783641405403614, + 0.04035226255655289, + 0.12890996783971786, + 0.10945062711834908, + 0.09474020451307297, + 0.4507782254368067, + 0.5833190754055977, + 0.7341788001358509, + 0.8336865715682507, + 1.3884817138314247, + 0.47030846402049065, + 0.9041659459471703, + 0.18631359189748764, + 0.6104780528694391, + 0.7646246924996376, + 0.2610703818500042, + 2.2357500046491623, + 0.16502536833286285, + 0.4038804015144706, + 0.5196715407073498, + 0.031907644122838974, + 0.1587916612625122, + 0.17194893211126328, + 0.36278053373098373, + 0.8873035218566656, + 0.1325424686074257, + 0.482775304466486, + 1.4247280098497868, + 0.2628986593335867, + 0.12388895079493523, + 0.22955013811588287, + 2.555370634421706, + 0.6014187652617693, + 0.1908252201974392, + 1.1397456601262093, + 0.6839365158230066, + 0.030363749712705612, + 0.1356169804930687, + 1.3130344301462173, + 0.6209291741251945, + 0.14658266305923462, + 0.9691666029393673, + 0.5376140549778938, + 0.0532375518232584, + 0.7933749072253704, + 0.03983955457806587, + 1.380877859890461, + 0.208748497068882, + 0.1324371136724949, + 0.3598431646823883, + 1.4299865905195475, + 0.6093116700649261, + 0.46420932561159134, + 1.1115284077823162, + 0.2721937317401171, + 1.0987125895917416, + 0.04000155255198479, + 0.03246491774916649, + 0.4707297720015049, + 0.0, + 0.24648386612534523, + 0.46459275484085083, + 0.3674681596457958, + 0.26927442848682404 + ], + "unique_experts": 63, + "load_cv": 0.7722511781060407, + "normalized_load_entropy": 0.9317397941447685, + "max_load_share": 0.05844155844155844 + } + }, + "s1_bos": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "9cce44f560849735803dd2338ad9f2c686e07fc6c05d9aeb6e116b4f6cbfc90a", + "route_weight_sha256": "cf6eb5467bb111f0782a473b7b70079697efb8ba82d2d65cd8461374c36e36f2", + "loads": [ + 3, + 2, + 2, + 0, + 1, + 8, + 0, + 7, + 2, + 19, + 3, + 5, + 4, + 4, + 11, + 3, + 6, + 0, + 10, + 6, + 1, + 2, + 0, + 6, + 8, + 2, + 4, + 15, + 4, + 2, + 4, + 26, + 7, + 3, + 12, + 11, + 2, + 2, + 3, + 8, + 4, + 0, + 2, + 1, + 3, + 1, + 16, + 1, + 2, + 5, + 3, + 7, + 5, + 16, + 5, + 6, + 1, + 1, + 3, + 0, + 4, + 2, + 6, + 0 + ], + "weighted_loads": [ + 0.24082916602492332, + 0.07511691376566887, + 0.13358284533023834, + 0.0, + 0.056035932153463364, + 0.47695850767195225, + 0.0, + 0.7443608641624451, + 0.15399932116270065, + 1.4166702665388584, + 0.3935830220580101, + 0.35103703290224075, + 0.177622988820076, + 0.3566640168428421, + 0.798404898494482, + 0.19046901911497116, + 0.22572525404393673, + 0.0, + 0.3944264780730009, + 0.4723328500986099, + 0.03175622597336769, + 0.16084154695272446, + 0.0, + 0.2148664016276598, + 0.7780327722430229, + 0.13185984268784523, + 0.23683222755789757, + 1.4376698937267065, + 0.20806020870804787, + 0.1301535852253437, + 0.23432915285229683, + 2.487234143540263, + 0.4579173941165209, + 0.11619121208786964, + 1.2140467558056116, + 0.6831725239753723, + 0.06680605933070183, + 0.1365530639886856, + 0.27933240681886673, + 0.4503106474876404, + 0.17645924352109432, + 0.0, + 0.19760432839393616, + 0.04607415199279785, + 0.10340849682688713, + 0.03730257600545883, + 1.2917546927928925, + 0.04476698115468025, + 0.1301686279475689, + 0.24797755479812622, + 0.16311961226165295, + 0.6219548434019089, + 0.468208234757185, + 1.0351923517882824, + 0.2652449235320091, + 0.44383514672517776, + 0.038535553961992264, + 0.031987156718969345, + 0.3781864233314991, + 0.0, + 0.21760515868663788, + 0.16829293221235275, + 0.2859160304069519, + 0.0 + ], + "unique_experts": 57, + "load_cv": 1.023394976588467, + "normalized_load_entropy": 0.8932653638121528, + "max_load_share": 0.08333333333333333 + }, + "full_input": { + "tokens": 93, + "top_k": 6, + "decisions": 558, + "ordered_route_sha256": "e331b4ef884d66c56c208066225e41ea5d7572a950e7f2bb1f9a4cb87196e2a6", + "route_weight_sha256": "8248a3823b1564afc5c523b5df70e635aaf08a8c6fb6dc029bc7444468d9a660", + "loads": [ + 3, + 2, + 2, + 2, + 2, + 9, + 8, + 7, + 17, + 21, + 10, + 10, + 4, + 9, + 13, + 5, + 21, + 4, + 13, + 8, + 2, + 2, + 2, + 10, + 12, + 2, + 11, + 16, + 6, + 8, + 4, + 26, + 13, + 12, + 12, + 11, + 2, + 6, + 20, + 12, + 6, + 16, + 12, + 3, + 13, + 1, + 19, + 7, + 2, + 5, + 25, + 7, + 5, + 16, + 9, + 15, + 1, + 7, + 5, + 0, + 4, + 8, + 9, + 4 + ], + "weighted_loads": [ + 0.24082916602492332, + 0.07511691376566887, + 0.13358284533023834, + 0.06325804628431797, + 0.10252289474010468, + 0.5210040677338839, + 0.6063310280442238, + 0.7443608641624451, + 1.5082266218960285, + 1.5180166997015476, + 0.959744781255722, + 0.9851925745606422, + 0.177622988820076, + 0.6658701226115227, + 0.8666421286761761, + 0.28809209167957306, + 2.61562049202621, + 0.21014147624373436, + 0.4729732992127538, + 0.6025218069553375, + 0.07214399054646492, + 0.16084154695272446, + 0.11821119114756584, + 0.4479856211692095, + 0.9280612803995609, + 0.13185984268784523, + 0.8342893272638321, + 1.4683485832065344, + 0.25797783583402634, + 0.9082960151135921, + 0.23432915285229683, + 2.487234143540263, + 0.8412645030766726, + 0.7115379013121128, + 1.2140467558056116, + 0.6831725239753723, + 0.06680605933070183, + 0.36284314654767513, + 2.056063733994961, + 0.6307551357895136, + 0.39899410121142864, + 1.4314338527619839, + 0.9775430262088776, + 0.10425708256661892, + 1.3345358856022358, + 0.03730257600545883, + 1.4450587965548038, + 0.40516602993011475, + 0.1301686279475689, + 0.24797755479812622, + 1.892223646864295, + 0.6219548434019089, + 0.468208234757185, + 1.0351923517882824, + 0.4722832553088665, + 1.209377532824874, + 0.038535553961992264, + 0.5722481161355972, + 0.4198862463235855, + 0.0, + 0.21760515868663788, + 0.4597660284489393, + 0.36484458670020103, + 0.11605641804635525 + ], + "unique_experts": 63, + "load_cv": 0.7057110113212838, + "normalized_load_entropy": 0.939888965744189, + "max_load_share": 0.04659498207885305 + } + }, + "s0_x": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "7741b6e0775270cf7b1a4dcf718e47031ccdbed242929d59646f756816eff062", + "route_weight_sha256": "e46bd9be4a5808d03b87fd409c2b135d2e3c0177670c97cdcdd0c8c3da3f628b", + "loads": [ + 4, + 2, + 2, + 0, + 1, + 8, + 0, + 7, + 3, + 20, + 3, + 4, + 4, + 5, + 12, + 4, + 4, + 0, + 9, + 6, + 1, + 2, + 0, + 6, + 8, + 2, + 4, + 14, + 3, + 2, + 4, + 26, + 7, + 3, + 13, + 11, + 2, + 2, + 3, + 10, + 3, + 0, + 2, + 1, + 3, + 1, + 14, + 1, + 2, + 6, + 3, + 7, + 5, + 15, + 5, + 6, + 1, + 1, + 3, + 0, + 4, + 2, + 6, + 0 + ], + "weighted_loads": [ + 0.28167373687028885, + 0.07930361106991768, + 0.12856126949191093, + 0.0, + 0.05709895119071007, + 0.4782172739505768, + 0.0, + 0.7416387684643269, + 0.18975474126636982, + 1.4256743099540472, + 0.39193045347929, + 0.30332428589463234, + 0.1687566675245762, + 0.3621675055474043, + 0.8174542747437954, + 0.263101227581501, + 0.15853111445903778, + 0.0, + 0.34248839505016804, + 0.46838023141026497, + 0.03427080065011978, + 0.15807541459798813, + 0.0, + 0.21452202275395393, + 0.7614186778664589, + 0.13996585831046104, + 0.26093828678131104, + 1.4143698811531067, + 0.17682426050305367, + 0.11847535520792007, + 0.23781200498342514, + 2.567693814635277, + 0.4653463941067457, + 0.10624059289693832, + 1.1837035175412893, + 0.7143707666546106, + 0.06843610107898712, + 0.13357052206993103, + 0.2896692603826523, + 0.47695559449493885, + 0.1457328349351883, + 0.0, + 0.20633136481046677, + 0.044560499489307404, + 0.10506038926541805, + 0.03891325369477272, + 1.1936317943036556, + 0.04627387225627899, + 0.12793678790330887, + 0.3167859762907028, + 0.16239598579704762, + 0.6213012710213661, + 0.45376525446772575, + 1.0360972434282303, + 0.2518165484070778, + 0.4423108883202076, + 0.0393005795776844, + 0.03355158865451813, + 0.37702958658337593, + 0.0, + 0.22056399658322334, + 0.1836414560675621, + 0.27382342517375946, + 0.0 + ], + "unique_experts": 57, + "load_cv": 1.0169503597462533, + "normalized_load_entropy": 0.8943014655581659, + "max_load_share": 0.08333333333333333 + }, + "full_input": { + "tokens": 77, + "top_k": 6, + "decisions": 462, + "ordered_route_sha256": "c59833a43850667cbddfcfd31fc2ecf7034eca71cfd9c292e17bae65525e0585", + "route_weight_sha256": "6979e9c81955b5c98de721e5bb390f44dd0abaee4fcae2c8057c209738e3c94a", + "loads": [ + 4, + 2, + 2, + 3, + 1, + 10, + 4, + 7, + 10, + 20, + 5, + 8, + 4, + 11, + 12, + 4, + 20, + 4, + 11, + 7, + 1, + 2, + 3, + 8, + 11, + 2, + 7, + 14, + 5, + 2, + 4, + 26, + 10, + 5, + 13, + 11, + 2, + 2, + 13, + 13, + 3, + 11, + 7, + 2, + 6, + 1, + 17, + 4, + 2, + 6, + 17, + 7, + 5, + 16, + 5, + 13, + 1, + 1, + 6, + 0, + 4, + 9, + 8, + 8 + ], + "weighted_loads": [ + 0.28167373687028885, + 0.07930361106991768, + 0.12856126949191093, + 0.10945062711834908, + 0.05709895119071007, + 0.5768015272915363, + 0.36105698347091675, + 0.7416387684643269, + 0.819420138373971, + 1.4256743099540472, + 0.47110000997781754, + 0.8749040476977825, + 0.1687566675245762, + 0.6799370665103197, + 0.8174542747437954, + 0.263101227581501, + 2.465893290936947, + 0.23954001814126968, + 0.38393057603389025, + 0.5391985587775707, + 0.03427080065011978, + 0.15807541459798813, + 0.17194893211126328, + 0.3619212172925472, + 0.8850280996412039, + 0.13996585831046104, + 0.5051844790577888, + 1.4143698811531067, + 0.22682554088532925, + 0.11847535520792007, + 0.23781200498342514, + 2.567693814635277, + 0.5797508824616671, + 0.2268061302602291, + 1.1837035175412893, + 0.7143707666546106, + 0.06843610107898712, + 0.13357052206993103, + 1.2042019851505756, + 0.6098967250436544, + 0.1457328349351883, + 0.9079787656664848, + 0.5488845631480217, + 0.0621704813092947, + 0.7484859842807055, + 0.03891325369477272, + 1.3252173215150833, + 0.2568684108555317, + 0.12793678790330887, + 0.3167859762907028, + 1.1905501578003168, + 0.6213012710213661, + 0.45376525446772575, + 1.067788042128086, + 0.2518165484070778, + 1.1000534631311893, + 0.0393005795776844, + 0.03355158865451813, + 0.4467026852071285, + 0.0, + 0.22056399658322334, + 0.5333990603685379, + 0.31655532866716385, + 0.34837599843740463 + ], + "unique_experts": 63, + "load_cv": 0.7561644243943917, + "normalized_load_entropy": 0.9340349425524613, + "max_load_share": 0.05627705627705628 + } + }, + "s1_x": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "e3ded82f3079355a564ede107f2fa3da056fb79bfa6e469ffb4dfab11c6d939c", + "route_weight_sha256": "a82bccd4e9f404dc6650eb9992b225239f9d863ca66b6b07f4bae9d5eb325171", + "loads": [ + 3, + 2, + 2, + 0, + 1, + 7, + 0, + 8, + 2, + 21, + 3, + 4, + 4, + 5, + 11, + 3, + 5, + 0, + 10, + 6, + 1, + 2, + 0, + 6, + 7, + 2, + 4, + 15, + 4, + 2, + 4, + 27, + 6, + 3, + 12, + 10, + 2, + 2, + 3, + 9, + 4, + 0, + 2, + 1, + 3, + 1, + 15, + 1, + 2, + 5, + 3, + 7, + 5, + 16, + 5, + 6, + 1, + 1, + 4, + 0, + 5, + 2, + 5, + 0 + ], + "weighted_loads": [ + 0.24186408519744873, + 0.07609977200627327, + 0.1324452906847, + 0.0, + 0.055915527045726776, + 0.45428044721484184, + 0.0, + 0.7916954010725021, + 0.15555047988891602, + 1.4844451993703842, + 0.3885390907526016, + 0.3288569934666157, + 0.16729796305298805, + 0.3935732878744602, + 0.7983143776655197, + 0.19434387609362602, + 0.1937701776623726, + 0.0, + 0.40120337530970573, + 0.4690424054861069, + 0.030419860035181046, + 0.16174541413784027, + 0.0, + 0.22053555771708488, + 0.7333063185214996, + 0.14238495007157326, + 0.24987610429525375, + 1.3970362786203623, + 0.2109952885657549, + 0.1259719617664814, + 0.24367503449320793, + 2.4897090420126915, + 0.42717698588967323, + 0.11181725189089775, + 1.2123539578169584, + 0.6388493850827217, + 0.06698567047715187, + 0.13725774735212326, + 0.27474839985370636, + 0.46803184412419796, + 0.18493587523698807, + 0.0, + 0.20099614560604095, + 0.048820216208696365, + 0.10517320036888123, + 0.036297086626291275, + 1.2537493519484997, + 0.04775773733854294, + 0.12709705531597137, + 0.24985991790890694, + 0.163297139108181, + 0.6298862136900425, + 0.46280841529369354, + 1.0234379507601261, + 0.24950573965907097, + 0.4516461230814457, + 0.03729194775223732, + 0.03196270391345024, + 0.40633318945765495, + 0.0, + 0.24201471731066704, + 0.1868131458759308, + 0.24485429003834724, + 0.0 + ], + "unique_experts": 57, + "load_cv": 1.0437503813870574, + "normalized_load_entropy": 0.891897282072055, + "max_load_share": 0.08653846153846154 + }, + "full_input": { + "tokens": 93, + "top_k": 6, + "decisions": 558, + "ordered_route_sha256": "149d3527c09a8b2d201a5178d5bf5f5fda715fb75de3cb2977b8bf425f7413a5", + "route_weight_sha256": "20602893fd957ad5566128a38fd6b307e0d88d93bc608b81ecdcb660dcc34c09", + "loads": [ + 3, + 2, + 2, + 2, + 2, + 9, + 6, + 8, + 18, + 23, + 10, + 9, + 4, + 11, + 13, + 5, + 21, + 5, + 12, + 7, + 1, + 2, + 2, + 10, + 12, + 2, + 10, + 16, + 6, + 8, + 4, + 27, + 12, + 12, + 12, + 10, + 2, + 6, + 19, + 13, + 6, + 15, + 12, + 3, + 12, + 1, + 19, + 8, + 2, + 5, + 24, + 7, + 5, + 16, + 9, + 15, + 1, + 7, + 6, + 0, + 5, + 9, + 8, + 5 + ], + "weighted_loads": [ + 0.24186408519744873, + 0.07609977200627327, + 0.1324452906847, + 0.06325804628431797, + 0.10240248963236809, + 0.5523475855588913, + 0.37424902617931366, + 0.7916954010725021, + 1.5341038890182972, + 1.5857916325330734, + 0.9545729123055935, + 0.9846367910504341, + 0.16729796305298805, + 0.7330480236560106, + 0.8665516078472137, + 0.2919669486582279, + 2.8463174998760223, + 0.2822518013417721, + 0.4422559393569827, + 0.5389687791466713, + 0.030419860035181046, + 0.16174541413784027, + 0.11821119114756584, + 0.4314993545413017, + 0.9162824004888535, + 0.14238495007157326, + 0.7887668311595917, + 1.4277149681001902, + 0.26091291569173336, + 0.9041143916547298, + 0.24367503449320793, + 2.4897090420126915, + 0.8105240948498249, + 0.7151681184768677, + 1.2123539578169584, + 0.6388493850827217, + 0.06698567047715187, + 0.3635478299111128, + 1.9433688409626484, + 0.643234945833683, + 0.4074707329273224, + 1.3118711188435555, + 0.9854301735758781, + 0.10700314678251743, + 1.2985985688865185, + 0.036297086626291275, + 1.4403034709393978, + 0.46868830546736717, + 0.12709705531597137, + 0.24985991790890694, + 1.6531666815280914, + 0.6298862136900425, + 0.46280841529369354, + 1.0234379507601261, + 0.45654407143592834, + 1.2171885091811419, + 0.03729194775223732, + 0.5722236633300781, + 0.44803301244974136, + 0.0, + 0.24201471731066704, + 0.5320380385965109, + 0.3237828463315964, + 0.1854522954672575 + ], + "unique_experts": 63, + "load_cv": 0.7068751015149083, + "normalized_load_entropy": 0.9399056226200002, + "max_load_share": 0.04838709677419355 + } + }, + "s0_period": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "620a9da767a39314859ea586beb7a0dd99e4d3d6ff2915ae09b4d1c21dea58ea", + "route_weight_sha256": "3735e82804eef40b84195f4287729ecc296cf0eba88ebec32f158b7056de4b66", + "loads": [ + 3, + 2, + 2, + 1, + 1, + 6, + 0, + 7, + 3, + 20, + 3, + 4, + 3, + 5, + 12, + 4, + 4, + 0, + 9, + 6, + 1, + 2, + 0, + 6, + 9, + 2, + 4, + 14, + 4, + 2, + 4, + 26, + 6, + 3, + 12, + 11, + 1, + 2, + 3, + 9, + 3, + 1, + 2, + 2, + 3, + 1, + 15, + 1, + 2, + 6, + 3, + 7, + 5, + 15, + 5, + 6, + 1, + 1, + 4, + 0, + 4, + 2, + 7, + 0 + ], + "weighted_loads": [ + 0.2418583706021309, + 0.07665041461586952, + 0.1293598972260952, + 0.03123961016535759, + 0.056943073868751526, + 0.41500537656247616, + 0.0, + 0.7420122064650059, + 0.19623216800391674, + 1.4113464821130037, + 0.38128772377967834, + 0.29484598338603973, + 0.12212595343589783, + 0.3567955456674099, + 0.8132454417645931, + 0.2557727247476578, + 0.157912977039814, + 0.0, + 0.366040026769042, + 0.46953654289245605, + 0.0330011323094368, + 0.15683133155107498, + 0.0, + 0.2164992280304432, + 0.7934724912047386, + 0.14495612308382988, + 0.26554498821496964, + 1.407021652907133, + 0.2200896367430687, + 0.12000128626823425, + 0.24286268651485443, + 2.5781875140964985, + 0.42582208290696144, + 0.11974361166357994, + 1.171126987785101, + 0.6930349189788103, + 0.031245261430740356, + 0.13424213230609894, + 0.30470551550388336, + 0.4490961004048586, + 0.1478021703660488, + 0.02624763548374176, + 0.20724700391292572, + 0.08004643768072128, + 0.10618355497717857, + 0.04042721539735794, + 1.2242806404829025, + 0.047187577933073044, + 0.1252659410238266, + 0.3193221427500248, + 0.1619353238493204, + 0.6175790801644325, + 0.4605393260717392, + 1.0327317863702774, + 0.25027159973978996, + 0.4411473460495472, + 0.039715372025966644, + 0.03324440121650696, + 0.39901338890194893, + 0.0, + 0.21745439618825912, + 0.1932872086763382, + 0.31014420092105865, + 0.0 + ], + "unique_experts": 59, + "load_cv": 1.0091624950848426, + "normalized_load_entropy": 0.8988082135391724, + "max_load_share": 0.08333333333333333 + }, + "full_input": { + "tokens": 77, + "top_k": 6, + "decisions": 462, + "ordered_route_sha256": "222831c90cbb84fa346a9f0922f164510b5764dbb2d90d05cac18b8410ea1606", + "route_weight_sha256": "ad378506bb2f1d74d63f13506548f08c0f47e72da0d27a244756813689b63a96", + "loads": [ + 3, + 2, + 2, + 4, + 1, + 7, + 4, + 7, + 11, + 20, + 5, + 8, + 3, + 10, + 12, + 4, + 20, + 4, + 11, + 7, + 1, + 2, + 4, + 8, + 12, + 2, + 7, + 14, + 6, + 2, + 4, + 26, + 9, + 5, + 12, + 11, + 1, + 2, + 14, + 12, + 3, + 13, + 7, + 3, + 6, + 1, + 16, + 4, + 2, + 6, + 19, + 7, + 5, + 16, + 5, + 13, + 1, + 1, + 7, + 0, + 4, + 8, + 9, + 7 + ], + "weighted_loads": [ + 0.2418583706021309, + 0.07665041461586952, + 0.1293598972260952, + 0.14069023728370667, + 0.056943073868751526, + 0.4568054247647524, + 0.3503214418888092, + 0.7420122064650059, + 0.9159208629280329, + 1.4113464821130037, + 0.45958442240953445, + 0.8700213804841042, + 0.12212595343589783, + 0.6413489021360874, + 0.8132454417645931, + 0.2557727247476578, + 2.4558123387396336, + 0.22999530658125877, + 0.4074822077527642, + 0.5378746464848518, + 0.0330011323094368, + 0.15683133155107498, + 0.21555903553962708, + 0.36505595222115517, + 0.9170819129794836, + 0.14495612308382988, + 0.5112975127995014, + 1.407021652907133, + 0.2700909171253443, + 0.12000128626823425, + 0.24286268651485443, + 2.5781875140964985, + 0.5402265712618828, + 0.2346125915646553, + 1.171126987785101, + 0.6930349189788103, + 0.031245261430740356, + 0.13424213230609894, + 1.3116107285022736, + 0.5842590723186731, + 0.1478021703660488, + 0.997466005384922, + 0.5457048937678337, + 0.09765641950070858, + 0.7496086284518242, + 0.04042721539735794, + 1.279492698609829, + 0.25233490765094757, + 0.1252659410238266, + 0.3193221427500248, + 1.5247776228934526, + 0.6175790801644325, + 0.4605393260717392, + 1.0644225850701332, + 0.25027159973978996, + 1.098889920860529, + 0.039715372025966644, + 0.03324440121650696, + 0.4686864875257015, + 0.0, + 0.21745439618825912, + 0.4905286952853203, + 0.35287610441446304, + 0.26927442848682404 + ], + "unique_experts": 63, + "load_cv": 0.7616956619798899, + "normalized_load_entropy": 0.9333242497991547, + "max_load_share": 0.05627705627705628 + } + }, + "s1_period": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "08ee8fe0e2d4878636a4ff926f660912d29eff26928bd5b271eb98918ef79367", + "route_weight_sha256": "100f86a4f40b4b58e44d1c4ae0043c1b5f511a43d0e2cde9d937c4a4cf66ae96", + "loads": [ + 3, + 2, + 2, + 0, + 1, + 7, + 0, + 8, + 2, + 21, + 3, + 4, + 5, + 5, + 10, + 3, + 4, + 0, + 10, + 6, + 1, + 2, + 0, + 5, + 7, + 2, + 4, + 15, + 4, + 2, + 4, + 26, + 7, + 4, + 12, + 10, + 2, + 2, + 3, + 9, + 4, + 0, + 2, + 1, + 3, + 1, + 16, + 1, + 2, + 5, + 3, + 7, + 5, + 16, + 5, + 6, + 1, + 1, + 4, + 0, + 5, + 2, + 5, + 0 + ], + "weighted_loads": [ + 0.24281077086925507, + 0.08154315873980522, + 0.12815162539482117, + 0.0, + 0.05547456443309784, + 0.4521976411342621, + 0.0, + 0.791249617934227, + 0.15068283677101135, + 1.4803786277770996, + 0.3764933571219444, + 0.32871080562472343, + 0.20205301605165005, + 0.3897711802273989, + 0.7481617070734501, + 0.19198907911777496, + 0.16060534864664078, + 0.0, + 0.39602518267929554, + 0.47307513281702995, + 0.029477842152118683, + 0.16014376282691956, + 0.0, + 0.18753697723150253, + 0.7383427023887634, + 0.13966591656208038, + 0.25523584336042404, + 1.3947123996913433, + 0.22186262533068657, + 0.12689219415187836, + 0.24081837013363838, + 2.4663119819015265, + 0.46943247504532337, + 0.14892404153943062, + 1.2090291380882263, + 0.6499528773128986, + 0.06882211193442345, + 0.13817963749170303, + 0.2815651074051857, + 0.46040282025933266, + 0.18289604596793652, + 0.0, + 0.20306379348039627, + 0.04962635040283203, + 0.10505691543221474, + 0.03720864653587341, + 1.2890770435333252, + 0.048694636672735214, + 0.12792925536632538, + 0.2513679340481758, + 0.16118293441832066, + 0.6227589920163155, + 0.45863352343440056, + 1.0223055109381676, + 0.2537820599973202, + 0.4503086917102337, + 0.03866247832775116, + 0.03170296549797058, + 0.40487150475382805, + 0.0, + 0.23706486076116562, + 0.20129622519016266, + 0.2448260746896267, + 0.0 + ], + "unique_experts": 57, + "load_cv": 1.0329865168453172, + "normalized_load_entropy": 0.8930306518685226, + "max_load_share": 0.08333333333333333 + }, + "full_input": { + "tokens": 93, + "top_k": 6, + "decisions": 558, + "ordered_route_sha256": "6b262f02e0d539b094af3b1a6ffd8585738c220b9f414f3ccb7ec9f8d94507c0", + "route_weight_sha256": "2220c8b4af8b27dcbab36dd4d46b0ff69d7ba21db7f8908b408dd3f7bf0f3b8c", + "loads": [ + 3, + 2, + 2, + 2, + 2, + 8, + 7, + 8, + 19, + 23, + 10, + 9, + 5, + 10, + 12, + 5, + 20, + 5, + 12, + 7, + 1, + 2, + 3, + 8, + 11, + 2, + 10, + 16, + 6, + 8, + 4, + 26, + 14, + 13, + 12, + 10, + 2, + 6, + 20, + 13, + 6, + 17, + 12, + 3, + 12, + 1, + 18, + 7, + 2, + 5, + 26, + 7, + 5, + 16, + 9, + 15, + 1, + 7, + 6, + 0, + 5, + 8, + 8, + 4 + ], + "weighted_loads": [ + 0.24281077086925507, + 0.08154315873980522, + 0.12815162539482117, + 0.06325804628431797, + 0.10196152701973915, + 0.4962432011961937, + 0.406947061419487, + 0.791249617934227, + 1.590392991900444, + 1.5817250609397888, + 0.9423048570752144, + 0.9370338134467602, + 0.20205301605165005, + 0.6989772859960794, + 0.8163989372551441, + 0.28961215168237686, + 2.751498468220234, + 0.27031463384628296, + 0.4370777467265725, + 0.5433935113251209, + 0.029477842152118683, + 0.16014376282691956, + 0.15094778686761856, + 0.36439087614417076, + 0.8883712105453014, + 0.13966591656208038, + 0.7950566411018372, + 1.4253910891711712, + 0.27178025245666504, + 0.9050346240401268, + 0.24081837013363838, + 2.4663119819015265, + 0.8856522273272276, + 0.7473940029740334, + 1.2090291380882263, + 0.6499528773128986, + 0.06882211193442345, + 0.36446972005069256, + 2.0281220339238644, + 0.6366451103240252, + 0.40543090365827084, + 1.4296713024377823, + 0.9860309511423111, + 0.1078092809766531, + 1.2990454360842705, + 0.03720864653587341, + 1.3937237709760666, + 0.4041217267513275, + 0.12792925536632538, + 0.2513679340481758, + 2.093874143436551, + 0.6227589920163155, + 0.45863352343440056, + 1.0223055109381676, + 0.46082039177417755, + 1.2158510778099298, + 0.03866247832775116, + 0.5719639249145985, + 0.44657132774591446, + 0.0, + 0.23706486076116562, + 0.49276932142674923, + 0.3237546309828758, + 0.11605641804635525 + ], + "unique_experts": 63, + "load_cv": 0.7141076735351114, + "normalized_load_entropy": 0.9394377470021281, + "max_load_share": 0.04659498207885305 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 52, + "ordered_topk_exact_tokens": 38, + "set_exact_tokens": 46, + "mean_set_jaccard": 0.967032967032967, + "mean_token_weighted_tv": 0.009741056209000258, + "aggregate_load_tv": 0.019230769230769235 + }, + "system_bos": { + "tokens": 52, + "ordered_topk_exact_tokens": 30, + "set_exact_tokens": 34, + "mean_set_jaccard": 0.8969780219780221, + "mean_token_weighted_tv": 0.021840812548851736, + "aggregate_load_tv": 0.035256410256410256 + }, + "system_x": { + "tokens": 52, + "ordered_topk_exact_tokens": 31, + "set_exact_tokens": 35, + "mean_set_jaccard": 0.9065934065934065, + "mean_token_weighted_tv": 0.022024335662046306, + "aggregate_load_tv": 0.03846153846153846 + }, + "system_period": { + "tokens": 52, + "ordered_topk_exact_tokens": 23, + "set_exact_tokens": 30, + "mean_set_jaccard": 0.8791208791208791, + "mean_token_weighted_tv": 0.025493033337765016, + "aggregate_load_tv": 0.04487179487179487 + }, + "bos_at_s0": { + "tokens": 52, + "ordered_topk_exact_tokens": 22, + "set_exact_tokens": 29, + "mean_set_jaccard": 0.8653846153846155, + "mean_token_weighted_tv": 0.02987437118561222, + "aggregate_load_tv": 0.05769230769230768 + }, + "bos_at_s1": { + "tokens": 52, + "ordered_topk_exact_tokens": 27, + "set_exact_tokens": 33, + "mean_set_jaccard": 0.8914835164835165, + "mean_token_weighted_tv": 0.027403393993154168, + "aggregate_load_tv": 0.04807692307692306 + }, + "x_at_s0": { + "tokens": 52, + "ordered_topk_exact_tokens": 24, + "set_exact_tokens": 31, + "mean_set_jaccard": 0.8804945054945056, + "mean_token_weighted_tv": 0.028479698346927762, + "aggregate_load_tv": 0.051282051282051266 + }, + "x_at_s1": { + "tokens": 52, + "ordered_topk_exact_tokens": 20, + "set_exact_tokens": 27, + "mean_set_jaccard": 0.8626373626373627, + "mean_token_weighted_tv": 0.03299446742480191, + "aggregate_load_tv": 0.051282051282051266 + }, + "period_at_s0": { + "tokens": 52, + "ordered_topk_exact_tokens": 23, + "set_exact_tokens": 29, + "mean_set_jaccard": 0.8653846153846154, + "mean_token_weighted_tv": 0.030422219540923834, + "aggregate_load_tv": 0.054487179487179474 + }, + "period_at_s1": { + "tokens": 52, + "ordered_topk_exact_tokens": 18, + "set_exact_tokens": 25, + "mean_set_jaccard": 0.8475274725274726, + "mean_token_weighted_tv": 0.03463132976769255, + "aggregate_load_tv": 0.05769230769230768 + } + } + }, + "layer_08": { + "layer": 8, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "bf1aa7a7d53d078a8800b77b3634623fed3a86705f45b7f2e949709b7c237ea1", + "route_weight_sha256": "7ff337ac9aff06e85059c39f4c61cfe59943b63ea047aab1f5a8420a6293ff96", + "loads": [ + 1, + 6, + 0, + 2, + 1, + 0, + 3, + 2, + 0, + 2, + 2, + 5, + 4, + 19, + 7, + 12, + 21, + 9, + 2, + 3, + 2, + 0, + 11, + 0, + 1, + 4, + 0, + 0, + 2, + 1, + 25, + 8, + 2, + 5, + 5, + 0, + 20, + 0, + 1, + 20, + 5, + 7, + 1, + 0, + 9, + 5, + 0, + 5, + 6, + 2, + 2, + 12, + 8, + 2, + 10, + 0, + 12, + 0, + 2, + 6, + 5, + 1, + 0, + 4 + ], + "weighted_loads": [ + 0.057911910116672516, + 0.2888205498456955, + 0.0, + 0.165012888610363, + 0.05032229423522949, + 0.0, + 0.23372279107570648, + 0.07675718143582344, + 0.0, + 0.10079782828688622, + 0.19601714611053467, + 0.21328062936663628, + 0.2680359110236168, + 1.4378174170851707, + 0.4135252274572849, + 0.6566227823495865, + 1.517049491405487, + 0.4379945211112499, + 0.10879978910088539, + 0.23218055814504623, + 0.21191740781068802, + 0.0, + 0.9444410502910614, + 0.0, + 0.06101153418421745, + 0.15567112527787685, + 0.0, + 0.0, + 0.0862739346921444, + 0.08113591372966766, + 2.5018345937132835, + 0.6871658489108086, + 0.09065286815166473, + 0.23861434310674667, + 0.38968395441770554, + 0.0, + 1.3895701132714748, + 0.0, + 0.04141921550035477, + 1.0395203288644552, + 0.19097331166267395, + 0.3732494041323662, + 0.04281238466501236, + 0.0, + 0.5843765251338482, + 0.3747249022126198, + 0.0, + 0.2650994658470154, + 0.48280415683984756, + 0.12186819687485695, + 0.1316949538886547, + 1.1141601353883743, + 0.4966726303100586, + 0.09067724272608757, + 0.5241106450557709, + 0.0, + 0.9696820601820946, + 0.0, + 0.09654807299375534, + 0.6741350516676903, + 0.40838129073381424, + 0.035052746534347534, + 0.0, + 0.4831223115324974 + ], + "unique_experts": 50, + "load_cv": 1.1892019102877158, + "normalized_load_entropy": 0.851027133578204, + "max_load_share": 0.08012820512820513 + }, + "full_input": { + "tokens": 77, + "top_k": 6, + "decisions": 462, + "ordered_route_sha256": "bf98e773f579f224361df5d2b51aba6a1339fbee683846413de37482974bb0ac", + "route_weight_sha256": "7c2fefac76b8855f22b1d288b41eeef13ac7b9624aa3c52fd1abd33ec4cfc896", + "loads": [ + 1, + 12, + 2, + 3, + 3, + 0, + 8, + 3, + 8, + 2, + 3, + 7, + 11, + 26, + 7, + 12, + 21, + 12, + 3, + 3, + 3, + 0, + 13, + 0, + 1, + 15, + 0, + 0, + 2, + 1, + 28, + 9, + 6, + 19, + 5, + 0, + 20, + 0, + 1, + 27, + 12, + 7, + 1, + 0, + 9, + 11, + 7, + 9, + 7, + 5, + 5, + 12, + 20, + 2, + 14, + 7, + 12, + 0, + 6, + 6, + 5, + 1, + 1, + 6 + ], + "weighted_loads": [ + 0.057911910116672516, + 0.6556282099336386, + 0.03942152764648199, + 0.23845717310905457, + 0.113510028924793, + 0.0, + 0.6869457513093948, + 0.12231658026576042, + 0.582942545413971, + 0.10079782828688622, + 0.2854742109775543, + 0.2778083076700568, + 0.6511101573705673, + 1.9106742106378078, + 0.4135252274572849, + 0.6566227823495865, + 1.517049491405487, + 0.609401810914278, + 0.1397144440561533, + 0.23218055814504623, + 0.28798243403434753, + 0.0, + 1.018069863319397, + 0.0, + 0.06101153418421745, + 0.9246272463351488, + 0.0, + 0.0, + 0.0862739346921444, + 0.08113591372966766, + 2.5736393854022026, + 0.8248423263430595, + 0.2616650350391865, + 1.3380794767290354, + 0.38968395441770554, + 0.0, + 1.3895701132714748, + 0.0, + 0.04141921550035477, + 1.255834841169417, + 0.5686792433261871, + 0.3732494041323662, + 0.04281238466501236, + 0.0, + 0.5843765251338482, + 0.8890566527843475, + 0.7112256810069084, + 0.38606163766235113, + 0.5219413638114929, + 0.25789622962474823, + 0.3033713698387146, + 1.1141601353883743, + 1.1891477517783642, + 0.09067724272608757, + 2.10444406978786, + 0.42440615966916084, + 0.9696820601820946, + 0.0, + 0.21068473486229777, + 0.6741350516676903, + 0.40838129073381424, + 0.035052746534347534, + 0.04610571637749672, + 0.6505206152796745 + ], + "unique_experts": 55, + "load_cv": 0.9713865151285456, + "normalized_load_entropy": 0.8885233461836125, + "max_load_share": 0.06060606060606061 + } + }, + "s1_eos": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "f5b503effd0662b39b52d49e54af209b5a5ca01a6bfdc2c0a94cab7ac6b30c70", + "route_weight_sha256": "bb9999833c5bec93e5879b403fe6badd28d6c4306ee6684adf9e8e446caa914a", + "loads": [ + 1, + 7, + 0, + 2, + 0, + 0, + 3, + 0, + 0, + 2, + 2, + 5, + 4, + 19, + 7, + 11, + 21, + 10, + 2, + 3, + 2, + 0, + 11, + 0, + 2, + 4, + 0, + 0, + 1, + 1, + 26, + 9, + 2, + 5, + 5, + 0, + 18, + 0, + 0, + 21, + 4, + 8, + 1, + 0, + 11, + 5, + 0, + 7, + 6, + 2, + 2, + 11, + 8, + 2, + 9, + 0, + 12, + 0, + 1, + 6, + 5, + 1, + 1, + 4 + ], + "weighted_loads": [ + 0.05802173912525177, + 0.3070961534976959, + 0.0, + 0.1624395027756691, + 0.0, + 0.0, + 0.23581890761852264, + 0.0, + 0.0, + 0.09802379459142685, + 0.19260044395923615, + 0.21729068458080292, + 0.27924882248044014, + 1.420494008809328, + 0.42176103219389915, + 0.6082310453057289, + 1.5430475324392319, + 0.455117654055357, + 0.10688542202115059, + 0.2342880219221115, + 0.20911312848329544, + 0.0, + 0.9414915330708027, + 0.0, + 0.10128160566091537, + 0.16222603060305119, + 0.0, + 0.0, + 0.050189096480607986, + 0.08062287420034409, + 2.5379597693681717, + 0.7415231615304947, + 0.08592860400676727, + 0.24978067725896835, + 0.3966396413743496, + 0.0, + 1.295599427074194, + 0.0, + 0.0, + 1.0739878416061401, + 0.1574360877275467, + 0.4076080471277237, + 0.043303847312927246, + 0.0, + 0.661331232637167, + 0.36968184262514114, + 0.0, + 0.35543018206954, + 0.48843174427747726, + 0.11857343465089798, + 0.13752541318535805, + 1.059287205338478, + 0.4991053156554699, + 0.08872414380311966, + 0.48324819654226303, + 0.0, + 0.9547167122364044, + 0.0, + 0.05637253820896149, + 0.67289674654603, + 0.4165925830602646, + 0.03265759348869324, + 0.04355119541287422, + 0.47430161014199257 + ], + "unique_experts": 48, + "load_cv": 1.2062188191117, + "normalized_load_entropy": 0.8437729712197387, + "max_load_share": 0.08333333333333333 + }, + "full_input": { + "tokens": 93, + "top_k": 6, + "decisions": 558, + "ordered_route_sha256": "a548a6bbe5df246bd048848bf1e03b5df6305b507589d7fb51e98e2bfaf5f9d4", + "route_weight_sha256": "08888ab31ea22da0bd56d86b82667f852302790866308a69f6fb081a97325646", + "loads": [ + 2, + 13, + 10, + 4, + 0, + 1, + 14, + 0, + 12, + 2, + 6, + 9, + 13, + 26, + 7, + 11, + 21, + 24, + 4, + 3, + 3, + 0, + 12, + 4, + 2, + 15, + 0, + 2, + 1, + 1, + 29, + 10, + 6, + 25, + 5, + 0, + 18, + 0, + 6, + 27, + 17, + 8, + 3, + 0, + 11, + 17, + 15, + 11, + 9, + 7, + 6, + 11, + 18, + 8, + 13, + 10, + 12, + 0, + 4, + 8, + 5, + 5, + 3, + 9 + ], + "weighted_loads": [ + 0.09745170921087265, + 0.6306910924613476, + 0.6210970478132367, + 0.29082925990223885, + 0.0, + 0.04445334151387215, + 1.1848377510905266, + 0.0, + 0.8177941665053368, + 0.09802379459142685, + 0.42616017907857895, + 0.3372381185181439, + 0.810079388320446, + 1.869394939392805, + 0.42176103219389915, + 0.6082310453057289, + 1.5430475324392319, + 1.4573930725455284, + 0.19809838756918907, + 0.2342880219221115, + 0.2880447953939438, + 0.0, + 0.9818096086382866, + 0.18676426820456982, + 0.10128160566091537, + 1.2775630000978708, + 0.0, + 0.11869189888238907, + 0.050189096480607986, + 0.08062287420034409, + 2.606365555431694, + 0.8703374266624451, + 0.22976243495941162, + 1.6187898814678192, + 0.3966396413743496, + 0.0, + 1.295599427074194, + 0.0, + 0.3964602090418339, + 1.2409457112662494, + 0.7620663717389107, + 0.4076080471277237, + 0.21099387481808662, + 0.0, + 0.661331232637167, + 1.4426895827054977, + 1.0878613144159317, + 0.47225792054086924, + 0.8094925433397293, + 0.4256031662225723, + 0.35628389567136765, + 1.059287205338478, + 1.0518535170704126, + 0.7730699703097343, + 2.0688093416392803, + 0.6532470360398293, + 0.9547167122364044, + 0.0, + 0.15777752711437643, + 0.7449789568781853, + 0.4165925830602646, + 0.22056128829717636, + 0.14443837851285934, + 0.7654966227710247 + ], + "unique_experts": 56, + "load_cv": 0.8468419877661216, + "normalized_load_entropy": 0.9091346491467238, + "max_load_share": 0.05197132616487455 + } + }, + "s0_bos": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "1a23fb90bf9c1c37339dcc9d97325ee465d97d25cd5fc53a2239ab656adde33e", + "route_weight_sha256": "b8e2d8972e9e3e7527cc3c56393fb1bb3adac9d8599c89454468b018e02570f9", + "loads": [ + 1, + 3, + 1, + 2, + 0, + 0, + 3, + 1, + 0, + 2, + 2, + 5, + 4, + 18, + 8, + 11, + 21, + 10, + 2, + 3, + 3, + 0, + 11, + 0, + 1, + 3, + 0, + 0, + 1, + 2, + 25, + 9, + 2, + 6, + 4, + 0, + 17, + 0, + 1, + 20, + 4, + 6, + 1, + 0, + 9, + 4, + 0, + 6, + 6, + 2, + 2, + 12, + 9, + 1, + 13, + 0, + 15, + 0, + 2, + 6, + 5, + 1, + 2, + 4 + ], + "weighted_loads": [ + 0.05326356738805771, + 0.15055743232369423, + 0.037944428622722626, + 0.16059906035661697, + 0.0, + 0.0, + 0.25791575014591217, + 0.04284944385290146, + 0.0, + 0.10334942117333412, + 0.19390369951725006, + 0.20458965748548508, + 0.26106925681233406, + 1.4101866818964481, + 0.47651252150535583, + 0.6139756590127945, + 1.5435493513941765, + 0.4631567522883415, + 0.11305109784007072, + 0.24006254225969315, + 0.24831655248999596, + 0.0, + 0.9261736311018467, + 0.0, + 0.06358414888381958, + 0.13360255770385265, + 0.0, + 0.0, + 0.04747021198272705, + 0.12556373700499535, + 2.5131140537559986, + 0.7271061390638351, + 0.07930459082126617, + 0.266164006665349, + 0.3409038111567497, + 0.0, + 1.2715665325522423, + 0.0, + 0.045482080429792404, + 1.029887642711401, + 0.14467382058501244, + 0.32899482175707817, + 0.04076042398810387, + 0.0, + 0.6188047677278519, + 0.3326045013964176, + 0.0, + 0.32243091613054276, + 0.46668532490730286, + 0.1280757561326027, + 0.12174272164702415, + 1.1102231107652187, + 0.5252599231898785, + 0.048205744475126266, + 0.6348126269876957, + 0.0, + 1.1183429323136806, + 0.0, + 0.08975358307361603, + 0.6534079276025295, + 0.39598971605300903, + 0.03374502807855606, + 0.08371483534574509, + 0.4575560726225376 + ], + "unique_experts": 51, + "load_cv": 1.1886489216922318, + "normalized_load_entropy": 0.8507160101920709, + "max_load_share": 0.08012820512820513 + }, + "full_input": { + "tokens": 77, + "top_k": 6, + "decisions": 462, + "ordered_route_sha256": "f4382910ebbe07cec536f304a0a767287416c5267e318e903b3f78252d0bcbc6", + "route_weight_sha256": "c428c8085e1ceaaded50827de3cf9ab982ac99703eb2411dd6ebd2f38b87b5e7", + "loads": [ + 1, + 9, + 3, + 3, + 1, + 0, + 8, + 2, + 8, + 2, + 3, + 7, + 11, + 25, + 8, + 12, + 21, + 14, + 3, + 3, + 4, + 0, + 13, + 0, + 2, + 14, + 0, + 0, + 1, + 2, + 28, + 10, + 6, + 21, + 4, + 0, + 17, + 0, + 1, + 26, + 10, + 6, + 1, + 0, + 9, + 11, + 7, + 9, + 7, + 5, + 5, + 12, + 21, + 1, + 17, + 7, + 15, + 0, + 5, + 6, + 5, + 1, + 3, + 6 + ], + "weighted_loads": [ + 0.05326356738805771, + 0.5173650924116373, + 0.07736595626920462, + 0.22954873740673065, + 0.06037789583206177, + 0.0, + 0.7168873175978661, + 0.08840884268283844, + 0.6069356352090836, + 0.10334942117333412, + 0.2774123400449753, + 0.2691173357889056, + 0.6441435031592846, + 1.8835539817810059, + 0.47651252150535583, + 0.6602598391473293, + 1.5435493513941765, + 0.6867325343191624, + 0.14767659828066826, + 0.24006254225969315, + 0.31589028611779213, + 0.0, + 0.9998024441301823, + 0.0, + 0.11028387397527695, + 0.9025586787611246, + 0.0, + 0.0, + 0.04747021198272705, + 0.12556373700499535, + 2.6351761631667614, + 0.8669213056564331, + 0.2503167577087879, + 1.4611140452325344, + 0.3409038111567497, + 0.0, + 1.2715665325522423, + 0.0, + 0.045482080429792404, + 1.2590984487906098, + 0.5120480582118034, + 0.32899482175707817, + 0.04076042398810387, + 0.0, + 0.6188047677278519, + 0.8928940892219543, + 0.6516804173588753, + 0.43403302133083344, + 0.5058225318789482, + 0.26465076580643654, + 0.29341913759708405, + 1.1102231107652187, + 1.2231264226138592, + 0.048205744475126266, + 1.3437958005815744, + 0.44181057438254356, + 1.1183429323136806, + 0.0, + 0.2008565217256546, + 0.6534079276025295, + 0.39598971605300903, + 0.03374502807855606, + 0.1298205517232418, + 0.6249543763697147 + ], + "unique_experts": 55, + "load_cv": 0.9720036726249209, + "normalized_load_entropy": 0.8880964925201132, + "max_load_share": 0.06060606060606061 + } + }, + "s1_bos": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "c6457f712e93c54cf5f932bbc31deba93c3f8a01787598c03d3ea0ccaf621eb1", + "route_weight_sha256": "271dae5696c898c13dadc6e2a9f89f17408d9fe5914ff0d415e6db6982e312ca", + "loads": [ + 1, + 3, + 1, + 2, + 0, + 0, + 3, + 2, + 0, + 2, + 2, + 7, + 4, + 19, + 7, + 12, + 22, + 8, + 2, + 3, + 2, + 0, + 11, + 0, + 1, + 2, + 0, + 0, + 1, + 2, + 26, + 9, + 2, + 6, + 5, + 0, + 19, + 0, + 0, + 18, + 4, + 8, + 1, + 0, + 10, + 4, + 0, + 6, + 6, + 3, + 2, + 12, + 8, + 1, + 10, + 0, + 14, + 0, + 2, + 6, + 5, + 0, + 2, + 4 + ], + "weighted_loads": [ + 0.05411294102668762, + 0.1299062930047512, + 0.035953667014837265, + 0.1588693931698799, + 0.0, + 0.0, + 0.2596140578389168, + 0.08010448887944221, + 0.0, + 0.1025584265589714, + 0.187894307076931, + 0.2661167625337839, + 0.2751922905445099, + 1.4213155657052994, + 0.4269798956811428, + 0.6661231070756912, + 1.597178939729929, + 0.3538644500076771, + 0.10665596276521683, + 0.23331695050001144, + 0.20437390357255936, + 0.0, + 0.908815287053585, + 0.0, + 0.06842561811208725, + 0.10746830701828003, + 0.0, + 0.0, + 0.050178542733192444, + 0.13260731101036072, + 2.5648524947464466, + 0.7271495088934898, + 0.0868070088326931, + 0.27969658374786377, + 0.3822896182537079, + 0.0, + 1.3423602059483528, + 0.0, + 0.0, + 0.9724028818309307, + 0.14812990091741085, + 0.40124233812093735, + 0.045788250863552094, + 0.0, + 0.6593883819878101, + 0.3460949957370758, + 0.0, + 0.33068346977233887, + 0.4695117250084877, + 0.16109802946448326, + 0.12142668664455414, + 1.106385812163353, + 0.49721201322972775, + 0.05017508566379547, + 0.5255172960460186, + 0.0, + 1.0454061329364777, + 0.0, + 0.0929771363735199, + 0.6280159018933773, + 0.40967437624931335, + 0.0, + 0.07792530953884125, + 0.4433198533952236 + ], + "unique_experts": 49, + "load_cv": 1.205128205128205, + "normalized_load_entropy": 0.846315205630887, + "max_load_share": 0.08333333333333333 + }, + "full_input": { + "tokens": 93, + "top_k": 6, + "decisions": 558, + "ordered_route_sha256": "f01d6e807187343e4dd18c8e0ad6bd871fd7b265afcc0dba537ba3435fc134ca", + "route_weight_sha256": "cf6dc286d0f672927aa5fe6a82bdf058253eb7513dedc5222d48bd57549881c5", + "loads": [ + 2, + 9, + 11, + 4, + 1, + 1, + 14, + 2, + 13, + 2, + 5, + 10, + 13, + 26, + 7, + 13, + 22, + 23, + 4, + 3, + 3, + 0, + 12, + 4, + 1, + 13, + 0, + 2, + 1, + 2, + 29, + 10, + 6, + 27, + 5, + 0, + 19, + 0, + 7, + 23, + 16, + 8, + 3, + 0, + 10, + 17, + 15, + 9, + 9, + 9, + 6, + 12, + 18, + 7, + 13, + 10, + 14, + 0, + 4, + 7, + 5, + 4, + 4, + 9 + ], + "weighted_loads": [ + 0.0935429111123085, + 0.45350123196840286, + 0.657050714828074, + 0.27930858358740807, + 0.046915311366319656, + 0.04445334151387215, + 1.2081474736332893, + 0.08010448887944221, + 0.9034581892192364, + 0.1025584265589714, + 0.3555067293345928, + 0.38290508929640055, + 0.8060228563845158, + 1.8737688176333904, + 0.4269798956811428, + 0.7055385150015354, + 1.597178939729929, + 1.4158461466431618, + 0.20378945767879486, + 0.23331695050001144, + 0.2724837362766266, + 0.0, + 0.949133362621069, + 0.18676426820456982, + 0.06842561811208725, + 1.2228052765130997, + 0.0, + 0.11869189888238907, + 0.050178542733192444, + 0.13260731101036072, + 2.6797775588929653, + 0.8445690274238586, + 0.23064083978533745, + 1.7543109357357025, + 0.3822896182537079, + 0.0, + 1.3423602059483528, + 0.0, + 0.43880823254585266, + 1.1468859212473035, + 0.7512977067381144, + 0.40124233812093735, + 0.21347827836871147, + 0.0, + 0.6593883819878101, + 1.4707458652555943, + 1.0319484174251556, + 0.43847786262631416, + 0.7905725240707397, + 0.5049976520240307, + 0.34018516913056374, + 1.106385812163353, + 1.0508666634559631, + 0.7345209121704102, + 1.196822453290224, + 0.6666039898991585, + 1.0454061329364777, + 0.0, + 0.19147394597530365, + 0.660965520888567, + 0.40967437624931335, + 0.18790369480848312, + 0.17881249263882637, + 0.7345148660242558 + ], + "unique_experts": 58, + "load_cv": 0.8338784974397888, + "normalized_load_entropy": 0.9134599206603705, + "max_load_share": 0.05197132616487455 + } + }, + "s0_x": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "f8b2bb875a5c7517f12a2cf8ad1f37b6aeda9c24cf77d0f5c032b606f3e3a6f9", + "route_weight_sha256": "82dfdc6133e4e115963ee852116b0c9e2919a7a95303ef866501ce900bfaf2ab", + "loads": [ + 1, + 5, + 1, + 2, + 0, + 0, + 3, + 1, + 0, + 2, + 2, + 5, + 4, + 18, + 8, + 12, + 23, + 9, + 2, + 3, + 3, + 0, + 11, + 0, + 3, + 2, + 0, + 0, + 1, + 1, + 25, + 8, + 2, + 5, + 4, + 0, + 19, + 0, + 1, + 20, + 4, + 7, + 1, + 0, + 8, + 4, + 0, + 6, + 6, + 3, + 2, + 12, + 8, + 2, + 10, + 0, + 16, + 0, + 1, + 6, + 5, + 0, + 1, + 4 + ], + "weighted_loads": [ + 0.050177574157714844, + 0.21695763245224953, + 0.03494497388601303, + 0.16070230305194855, + 0.0, + 0.0, + 0.2577501907944679, + 0.03443038463592529, + 0.0, + 0.10167212039232254, + 0.19297190755605698, + 0.19179327972233295, + 0.2779025249183178, + 1.380182046443224, + 0.46815794706344604, + 0.6688385382294655, + 1.5948656238615513, + 0.4063115492463112, + 0.10484815761446953, + 0.2465822622179985, + 0.23791611939668655, + 0.0, + 0.9024474211037159, + 0.0, + 0.14703771099448204, + 0.09296840056777, + 0.0, + 0.0, + 0.045936428010463715, + 0.07921749353408813, + 2.5259455367922783, + 0.6822283528745174, + 0.09579194337129593, + 0.24828315898776054, + 0.33044254034757614, + 0.0, + 1.3845044523477554, + 0.0, + 0.0432903990149498, + 1.0279884710907936, + 0.15390263684093952, + 0.3688311539590359, + 0.04315853491425514, + 0.0, + 0.5686376802623272, + 0.3642084449529648, + 0.0, + 0.32697195559740067, + 0.45591576397418976, + 0.1642662212252617, + 0.12258360162377357, + 1.1519909501075745, + 0.4936516135931015, + 0.0919087640941143, + 0.5461651310324669, + 0.0, + 1.1676449365913868, + 0.0, + 0.05213559418916702, + 0.6409864909946918, + 0.3952355161309242, + 0.0, + 0.042185232043266296, + 0.4455793723464012 + ], + "unique_experts": 50, + "load_cv": 1.2143672037143198, + "normalized_load_entropy": 0.8464017442372246, + "max_load_share": 0.08012820512820513 + }, + "full_input": { + "tokens": 77, + "top_k": 6, + "decisions": 462, + "ordered_route_sha256": "c10d5803a527c4713a77dcf773e84c070ba35a70a0898cd9125f98fdbb4afb0d", + "route_weight_sha256": "5693b88c8dee55da1a448b2d5fd5e496ccff16153cff7727951f2f65c1923546", + "loads": [ + 1, + 12, + 4, + 3, + 1, + 0, + 9, + 2, + 9, + 2, + 3, + 8, + 11, + 26, + 8, + 12, + 23, + 12, + 3, + 3, + 4, + 0, + 13, + 0, + 3, + 14, + 0, + 0, + 1, + 1, + 27, + 9, + 7, + 18, + 4, + 0, + 19, + 0, + 1, + 25, + 10, + 7, + 1, + 0, + 8, + 11, + 7, + 9, + 7, + 7, + 6, + 12, + 19, + 2, + 12, + 7, + 16, + 0, + 4, + 6, + 5, + 0, + 2, + 6 + ], + "weighted_loads": [ + 0.050177574157714844, + 0.6364026721566916, + 0.11662703659385443, + 0.2242289036512375, + 0.06037789583206177, + 0.0, + 0.7459225915372372, + 0.07998978346586227, + 0.6743510589003563, + 0.10167212039232254, + 0.2708946689963341, + 0.2975978562608361, + 0.6609767712652683, + 1.9406807497143745, + 0.46815794706344604, + 0.6688385382294655, + 1.5948656238615513, + 0.5806185081601143, + 0.13822364434599876, + 0.2465822622179985, + 0.2994745522737503, + 0.0, + 0.9760762341320515, + 0.0, + 0.14703771099448204, + 0.9632401689887047, + 0.0, + 0.0, + 0.045936428010463715, + 0.07921749353408813, + 2.586504317820072, + 0.8094635866582394, + 0.3099323436617851, + 1.2225645538419485, + 0.33044254034757614, + 0.0, + 1.3845044523477554, + 0.0, + 0.0432903990149498, + 1.2004391411319375, + 0.4958853218704462, + 0.3688311539590359, + 0.04315853491425514, + 0.0, + 0.5686376802623272, + 0.9195966236293316, + 0.6690679751336575, + 0.43857406079769135, + 0.4950529709458351, + 0.35598329827189445, + 0.3477449417114258, + 1.1519909501075745, + 1.1511516235768795, + 0.0919087640941143, + 1.170848662033677, + 0.4402536526322365, + 1.1676449365913868, + 0.0, + 0.1632385328412056, + 0.6409864909946918, + 0.3952355161309242, + 0.0, + 0.08829094842076302, + 0.6129776760935783 + ], + "unique_experts": 54, + "load_cv": 0.9526859015913621, + "normalized_load_entropy": 0.8897992839142345, + "max_load_share": 0.05844155844155844 + } + }, + "s1_x": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "e67a636c4dc7db1f5fd781b832a4a687cf8016f6fa8a12f15dd24a6e207dfae3", + "route_weight_sha256": "7a66e4d3bd113f4d324daa9a3d3525047382c5311d374dc6ea12e33ea48e24fa", + "loads": [ + 1, + 3, + 1, + 2, + 0, + 0, + 3, + 2, + 1, + 2, + 2, + 6, + 4, + 18, + 9, + 12, + 23, + 7, + 2, + 3, + 3, + 0, + 11, + 0, + 1, + 2, + 0, + 1, + 1, + 2, + 25, + 9, + 2, + 5, + 5, + 0, + 20, + 0, + 1, + 17, + 4, + 8, + 1, + 0, + 9, + 4, + 0, + 6, + 6, + 3, + 2, + 12, + 8, + 1, + 10, + 0, + 14, + 0, + 2, + 7, + 5, + 0, + 0, + 4 + ], + "weighted_loads": [ + 0.04974113777279854, + 0.12985223159193993, + 0.03470827639102936, + 0.16273042187094688, + 0.0, + 0.0, + 0.2618492394685745, + 0.0855238065123558, + 0.032209135591983795, + 0.1017749197781086, + 0.1902288943529129, + 0.2297499217092991, + 0.29020778089761734, + 1.3623185828328133, + 0.493647925555706, + 0.6728412918746471, + 1.591460196301341, + 0.3037590868771076, + 0.09984511509537697, + 0.23614443838596344, + 0.2383532728999853, + 0.0, + 0.8909481465816498, + 0.0, + 0.07191237062215805, + 0.10943662375211716, + 0.0, + 0.031640030443668365, + 0.04927228018641472, + 0.129115279763937, + 2.5183442160487175, + 0.7305827774107456, + 0.09977169707417488, + 0.24338430166244507, + 0.38054174929857254, + 0.0, + 1.4174366481602192, + 0.0, + 0.03903687000274658, + 0.939507570117712, + 0.1483341846615076, + 0.40773195773363113, + 0.05267547443509102, + 0.0, + 0.6234337277710438, + 0.3499617800116539, + 0.0, + 0.334376011043787, + 0.4611731395125389, + 0.16512705013155937, + 0.1289038024842739, + 1.13570224493742, + 0.49262223206460476, + 0.04880061000585556, + 0.5407573506236076, + 0.0, + 1.0259875617921352, + 0.0, + 0.09108681604266167, + 0.6632642708718777, + 0.41177813708782196, + 0.0, + 0.0, + 0.4483441077172756 + ], + "unique_experts": 51, + "load_cv": 1.1919630050430214, + "normalized_load_entropy": 0.8511134384356421, + "max_load_share": 0.08012820512820513 + }, + "full_input": { + "tokens": 93, + "top_k": 6, + "decisions": 558, + "ordered_route_sha256": "e776beae9d9697e465d210dafbf1116490debb1937175bedcef44ce60519fc99", + "route_weight_sha256": "5566569332c2c94c5f00d46480c207009ca384053d2e3e748ad8f96234e2eb6a", + "loads": [ + 2, + 10, + 12, + 4, + 1, + 1, + 15, + 2, + 15, + 2, + 6, + 10, + 13, + 27, + 9, + 12, + 23, + 21, + 4, + 3, + 4, + 0, + 12, + 4, + 1, + 15, + 0, + 3, + 1, + 2, + 27, + 10, + 7, + 23, + 5, + 0, + 20, + 0, + 8, + 21, + 15, + 8, + 3, + 0, + 9, + 16, + 15, + 9, + 9, + 9, + 7, + 12, + 17, + 7, + 12, + 9, + 14, + 0, + 4, + 8, + 5, + 4, + 2, + 9 + ], + "weighted_loads": [ + 0.08917110785841942, + 0.49743273854255676, + 0.6923893177881837, + 0.2752312906086445, + 0.040864959359169006, + 0.04445334151387215, + 1.2432605810463428, + 0.0855238065123558, + 0.9516392722725868, + 0.1017749197781086, + 0.4176422916352749, + 0.38482294883579016, + 0.8210383467376232, + 1.9506854563951492, + 0.493647925555706, + 0.6728412918746471, + 1.591460196301341, + 1.3145344704389572, + 0.20815332978963852, + 0.23614443838596344, + 0.3007297832518816, + 0.0, + 0.9312662221491337, + 0.18676426820456982, + 0.07191237062215805, + 1.3935421220958233, + 0.0, + 0.15033192932605743, + 0.04927228018641472, + 0.129115279763937, + 2.5783452801406384, + 0.8428681455552578, + 0.28558872267603874, + 1.3966107442975044, + 0.38054174929857254, + 0.0, + 1.4174366481602192, + 0.0, + 0.4815809763967991, + 1.0630552927032113, + 0.6544227283447981, + 0.40773195773363113, + 0.2203655019402504, + 0.0, + 0.6234337277710438, + 1.3868614546954632, + 1.032764721661806, + 0.4421704038977623, + 0.782233938574791, + 0.5215541087090969, + 0.4201471209526062, + 1.13570224493742, + 1.0122068524360657, + 0.7331464365124702, + 1.165596105158329, + 0.5759309493005276, + 1.0259875617921352, + 0.0, + 0.18958362564444542, + 0.6962138898670673, + 0.41177813708782196, + 0.18790369480848312, + 0.10088718309998512, + 0.7395391203463078 + ], + "unique_experts": 58, + "load_cv": 0.8017064699509114, + "normalized_load_entropy": 0.9173161992922909, + "max_load_share": 0.04838709677419355 + } + }, + "s0_period": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "1dcec93a35b2e05b6af5c9583cfc4688fea64cec43eef3c00a354ad421fceb5f", + "route_weight_sha256": "471a4bacf6ccd60eb2ba05713fd721b3d4a2495096c36568291116de4fed9ed5", + "loads": [ + 1, + 3, + 1, + 2, + 0, + 1, + 3, + 1, + 0, + 2, + 2, + 4, + 4, + 18, + 8, + 10, + 22, + 9, + 2, + 3, + 3, + 0, + 11, + 0, + 1, + 3, + 0, + 0, + 1, + 1, + 25, + 9, + 2, + 5, + 4, + 0, + 20, + 0, + 0, + 20, + 5, + 8, + 1, + 0, + 9, + 4, + 0, + 6, + 6, + 2, + 2, + 12, + 8, + 2, + 11, + 0, + 17, + 0, + 2, + 6, + 5, + 0, + 1, + 4 + ], + "weighted_loads": [ + 0.05476955696940422, + 0.1422475017607212, + 0.03341272473335266, + 0.16118402034044266, + 0.0, + 0.040833499282598495, + 0.2576087415218353, + 0.03514672443270683, + 0.0, + 0.10152306407690048, + 0.19203195720911026, + 0.1569874882698059, + 0.2765558622777462, + 1.3819679096341133, + 0.46924829855561256, + 0.5848694443702698, + 1.5620732605457306, + 0.4139059707522392, + 0.10771839693188667, + 0.24555416405200958, + 0.239562775939703, + 0.0, + 0.8910888954997063, + 0.0, + 0.07300293445587158, + 0.125959575176239, + 0.0, + 0.0, + 0.04588775709271431, + 0.0801069587469101, + 2.5250268802046776, + 0.7407091930508614, + 0.098655104637146, + 0.24573806300759315, + 0.33117903769016266, + 0.0, + 1.404946580529213, + 0.0, + 0.0, + 1.0238378643989563, + 0.18996034562587738, + 0.4049766846001148, + 0.042415276169776917, + 0.0, + 0.6131373196840286, + 0.36269333213567734, + 0.0, + 0.32565219700336456, + 0.457484170794487, + 0.12851443141698837, + 0.12542228400707245, + 1.1453585103154182, + 0.4988459683954716, + 0.09131482988595963, + 0.5813847742974758, + 0.0, + 1.2009945921599865, + 0.0, + 0.09374170377850533, + 0.6573771312832832, + 0.41029200702905655, + 0.0, + 0.03975308686494827, + 0.44833139702677727 + ], + "unique_experts": 50, + "load_cv": 1.2229989761755713, + "normalized_load_entropy": 0.8442051091102148, + "max_load_share": 0.08012820512820513 + }, + "full_input": { + "tokens": 77, + "top_k": 6, + "decisions": 462, + "ordered_route_sha256": "3befc42c9d210ebca0d69d7be17b6de8f94009982416dd4f9cf2f104cf0e1510", + "route_weight_sha256": "833388ba6973b5c5e3483b48e7a8be64db96dbc5cf0bbf59b3c5850502170a69", + "loads": [ + 1, + 9, + 3, + 3, + 2, + 1, + 10, + 2, + 9, + 2, + 3, + 6, + 11, + 26, + 8, + 10, + 22, + 13, + 3, + 3, + 4, + 0, + 13, + 0, + 1, + 15, + 0, + 0, + 1, + 1, + 27, + 10, + 6, + 18, + 4, + 0, + 20, + 0, + 0, + 25, + 10, + 8, + 1, + 0, + 9, + 11, + 8, + 9, + 7, + 7, + 5, + 12, + 19, + 2, + 13, + 7, + 17, + 0, + 5, + 6, + 5, + 0, + 2, + 7 + ], + "weighted_loads": [ + 0.05476955696940422, + 0.5090551618486643, + 0.07283425237983465, + 0.22795771062374115, + 0.10241502895951271, + 0.040833499282598495, + 0.8516203202307224, + 0.08070612326264381, + 0.7342189475893974, + 0.10152306407690048, + 0.27232491225004196, + 0.22151516657322645, + 0.6596301086246967, + 1.89878498762846, + 0.46924829855561256, + 0.5848694443702698, + 1.5620732605457306, + 0.6258762776851654, + 0.1416713036596775, + 0.24555416405200958, + 0.3052747882902622, + 0.0, + 0.9647177085280418, + 0.0, + 0.07300293445587158, + 0.9854007326066494, + 0.0, + 0.0, + 0.04588775709271431, + 0.0801069587469101, + 2.5858991853892803, + 0.8720087334513664, + 0.26966727152466774, + 1.2316738609224558, + 0.33117903769016266, + 0.0, + 1.404946580529213, + 0.0, + 0.0, + 1.1972417356446385, + 0.48803913593292236, + 0.4049766846001148, + 0.042415276169776917, + 0.0, + 0.6131373196840286, + 0.9091117568314075, + 0.715093594044447, + 0.43725430220365524, + 0.49662137776613235, + 0.3502536527812481, + 0.29709869995713234, + 1.1453585103154182, + 1.1563459783792496, + 0.09131482988595963, + 1.206068305298686, + 0.42606690153479576, + 1.2009945921599865, + 0.0, + 0.2048446424305439, + 0.6573771312832832, + 0.41029200702905655, + 0.0, + 0.08585880324244499, + 0.738891888409853 + ], + "unique_experts": 54, + "load_cv": 0.9592725859889192, + "normalized_load_entropy": 0.8882523302297659, + "max_load_share": 0.05844155844155844 + } + }, + "s1_period": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "6803b941122380be66803d47372888ac23864e27b09ba52ebeac07b6b43497ef", + "route_weight_sha256": "85cde0e96bdd78e7a5c17310aef0f2a07adbc5dd700f00de1a1da46fe6e61f33", + "loads": [ + 1, + 3, + 1, + 2, + 0, + 1, + 3, + 2, + 1, + 2, + 2, + 5, + 4, + 18, + 8, + 11, + 22, + 7, + 2, + 3, + 3, + 0, + 11, + 0, + 1, + 3, + 0, + 1, + 1, + 1, + 25, + 9, + 2, + 6, + 5, + 0, + 21, + 0, + 1, + 18, + 4, + 7, + 1, + 0, + 9, + 4, + 0, + 6, + 6, + 2, + 2, + 12, + 8, + 1, + 11, + 0, + 15, + 0, + 1, + 6, + 5, + 1, + 1, + 4 + ], + "weighted_loads": [ + 0.05134526267647743, + 0.13530586287379265, + 0.03411351516842842, + 0.16284160688519478, + 0.0, + 0.04230673983693123, + 0.26181038469076157, + 0.0865853913128376, + 0.033265601843595505, + 0.10256583243608475, + 0.18828368932008743, + 0.20149195939302444, + 0.28516385331749916, + 1.364031471312046, + 0.4575316496193409, + 0.6446897387504578, + 1.5549876391887665, + 0.3002147972583771, + 0.10191832482814789, + 0.23742082715034485, + 0.2457335963845253, + 0.0, + 0.8788812533020973, + 0.0, + 0.07377765327692032, + 0.14119873754680157, + 0.0, + 0.032333891838788986, + 0.04716040566563606, + 0.08811219781637192, + 2.514228943735361, + 0.7381415739655495, + 0.10126371681690216, + 0.26402946561574936, + 0.3744197487831116, + 0.0, + 1.4219351224601269, + 0.0, + 0.04125178977847099, + 0.9766913969069719, + 0.1421432252973318, + 0.36799630150198936, + 0.04991266131401062, + 0.0, + 0.6163873374462128, + 0.3554598540067673, + 0.0, + 0.32488416880369186, + 0.46764322742819786, + 0.1279214322566986, + 0.13027256727218628, + 1.1267476715147495, + 0.495593573898077, + 0.048377666622400284, + 0.5814982503652573, + 0.0, + 1.0607390068471432, + 0.0, + 0.05311676859855652, + 0.6305954940617085, + 0.4169968143105507, + 0.03228442370891571, + 0.0332191102206707, + 0.4558532349765301 + ], + "unique_experts": 54, + "load_cv": 1.1947177186894096, + "normalized_load_entropy": 0.8545392071347968, + "max_load_share": 0.08012820512820513 + }, + "full_input": { + "tokens": 93, + "top_k": 6, + "decisions": 558, + "ordered_route_sha256": "da88c9dbf2e1d0b64d62b77405b53d2c12e3c2e60b7cf6ab5b8484823800cfbe", + "route_weight_sha256": "af9cdbaf92fe5f50655a30b60888c5ae0c1265ce77d3de4bd204fdbf54270b07", + "loads": [ + 2, + 9, + 11, + 5, + 1, + 2, + 16, + 2, + 15, + 2, + 6, + 8, + 13, + 25, + 8, + 11, + 22, + 22, + 4, + 3, + 4, + 0, + 12, + 4, + 1, + 16, + 0, + 3, + 1, + 1, + 27, + 10, + 6, + 24, + 5, + 0, + 21, + 0, + 8, + 22, + 15, + 7, + 3, + 0, + 9, + 15, + 16, + 9, + 9, + 10, + 6, + 12, + 17, + 7, + 13, + 10, + 15, + 0, + 3, + 7, + 5, + 5, + 3, + 10 + ], + "weighted_loads": [ + 0.09077523276209831, + 0.4589008018374443, + 0.6552105629816651, + 0.33573463931679726, + 0.04278446361422539, + 0.08676008135080338, + 1.3445077203214169, + 0.0865853913128376, + 0.9754059202969074, + 0.10256583243608475, + 0.41515592113137245, + 0.3182802861556411, + 0.815994419157505, + 1.8176793567836285, + 0.4575316496193409, + 0.6446897387504578, + 1.5549876391887665, + 1.3644954226911068, + 0.20896941795945168, + 0.23742082715034485, + 0.30881398916244507, + 0.0, + 0.9191993288695812, + 0.18676426820456982, + 0.07377765327692032, + 1.3841420877724886, + 0.0, + 0.15102579072117805, + 0.04716040566563606, + 0.08811219781637192, + 2.572586201131344, + 0.8566679432988167, + 0.2450975477695465, + 1.4322465509176254, + 0.3744197487831116, + 0.0, + 1.4219351224601269, + 0.0, + 0.4856119453907013, + 1.1007412364706397, + 0.6592060495167971, + 0.36799630150198936, + 0.21760268881917, + 0.0, + 0.6163873374462128, + 1.360069252550602, + 1.114314954727888, + 0.43267856165766716, + 0.7887040264904499, + 0.583250992000103, + 0.3490310497581959, + 1.1267476715147495, + 1.015178194269538, + 0.732723493129015, + 1.2063370048999786, + 0.6178058199584484, + 1.0607390068471432, + 0.0, + 0.15161357820034027, + 0.6635451130568981, + 0.4169968143105507, + 0.22018811851739883, + 0.13410629332065582, + 0.8243729211390018 + ], + "unique_experts": 58, + "load_cv": 0.8068179176054318, + "normalized_load_entropy": 0.9167358237763577, + "max_load_share": 0.04838709677419355 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 52, + "ordered_topk_exact_tokens": 32, + "set_exact_tokens": 38, + "mean_set_jaccard": 0.9230769230769231, + "mean_token_weighted_tv": 0.016282397555187345, + "aggregate_load_tv": 0.03846153846153845 + }, + "system_bos": { + "tokens": 52, + "ordered_topk_exact_tokens": 31, + "set_exact_tokens": 37, + "mean_set_jaccard": 0.9134615384615384, + "mean_token_weighted_tv": 0.02029059764642555, + "aggregate_load_tv": 0.044871794871794865 + }, + "system_x": { + "tokens": 52, + "ordered_topk_exact_tokens": 31, + "set_exact_tokens": 36, + "mean_set_jaccard": 0.9120879120879122, + "mean_token_weighted_tv": 0.02100717996318753, + "aggregate_load_tv": 0.041666666666666664 + }, + "system_period": { + "tokens": 52, + "ordered_topk_exact_tokens": 32, + "set_exact_tokens": 37, + "mean_set_jaccard": 0.9175824175824174, + "mean_token_weighted_tv": 0.020596229274255726, + "aggregate_load_tv": 0.03205128205128205 + }, + "bos_at_s0": { + "tokens": 52, + "ordered_topk_exact_tokens": 21, + "set_exact_tokens": 30, + "mean_set_jaccard": 0.875, + "mean_token_weighted_tv": 0.028156877781909246, + "aggregate_load_tv": 0.05448717948717949 + }, + "bos_at_s1": { + "tokens": 52, + "ordered_topk_exact_tokens": 21, + "set_exact_tokens": 32, + "mean_set_jaccard": 0.8859890109890111, + "mean_token_weighted_tv": 0.027942953129800465, + "aggregate_load_tv": 0.05448717948717948 + }, + "x_at_s0": { + "tokens": 52, + "ordered_topk_exact_tokens": 23, + "set_exact_tokens": 32, + "mean_set_jaccard": 0.885989010989011, + "mean_token_weighted_tv": 0.02700327684243138, + "aggregate_load_tv": 0.04487179487179488 + }, + "x_at_s1": { + "tokens": 52, + "ordered_topk_exact_tokens": 17, + "set_exact_tokens": 27, + "mean_set_jaccard": 0.8543956043956046, + "mean_token_weighted_tv": 0.033367348494581305, + "aggregate_load_tv": 0.0737179487179487 + }, + "period_at_s0": { + "tokens": 52, + "ordered_topk_exact_tokens": 26, + "set_exact_tokens": 33, + "mean_set_jaccard": 0.8914835164835165, + "mean_token_weighted_tv": 0.02576372643502859, + "aggregate_load_tv": 0.04807692307692307 + }, + "period_at_s1": { + "tokens": 52, + "ordered_topk_exact_tokens": 19, + "set_exact_tokens": 28, + "mean_set_jaccard": 0.8640109890109892, + "mean_token_weighted_tv": 0.03208863190733469, + "aggregate_load_tv": 0.06410256410256408 + } + } + }, + "layer_09": { + "layer": 9, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "3946c32998ff44db5915601464b48064af1807d6b68cda957c53b808093138f0", + "route_weight_sha256": "2ab4c508bc3b04a440e46a2359d7d62440edfff8943e21911d011be356dd4d7b", + "loads": [ + 19, + 2, + 0, + 0, + 11, + 0, + 2, + 12, + 5, + 2, + 6, + 3, + 18, + 21, + 0, + 4, + 15, + 1, + 1, + 0, + 4, + 4, + 0, + 3, + 1, + 8, + 1, + 4, + 3, + 7, + 10, + 0, + 7, + 4, + 4, + 2, + 3, + 7, + 3, + 0, + 1, + 2, + 3, + 1, + 2, + 3, + 0, + 9, + 3, + 4, + 0, + 6, + 4, + 3, + 5, + 6, + 5, + 3, + 3, + 0, + 16, + 4, + 9, + 23 + ], + "weighted_loads": [ + 1.143917627632618, + 0.17823027819395065, + 0.0, + 0.0, + 0.6193315237760544, + 0.0, + 0.08091964200139046, + 1.1199490688741207, + 0.37951408699154854, + 0.08950337395071983, + 0.36167160980403423, + 0.11848129332065582, + 1.5181071292608976, + 1.3454644717276096, + 0.0, + 0.18418293073773384, + 1.2720338888466358, + 0.031759027391672134, + 0.03185960650444031, + 0.0, + 0.26423797756433487, + 0.20358789898455143, + 0.0, + 0.12137161567807198, + 0.03264124318957329, + 0.30119226686656475, + 0.032387033104896545, + 0.3207373432815075, + 0.16564805060625076, + 0.3165350817143917, + 0.42951804026961327, + 0.0, + 0.47167880460619926, + 0.29161511734128, + 0.37005241215229034, + 0.163178913295269, + 0.16586579009890556, + 0.523085031658411, + 0.1541033312678337, + 0.0, + 0.10694366693496704, + 0.07048013806343079, + 0.21353738382458687, + 0.046273697167634964, + 0.10193266719579697, + 0.10570237040519714, + 0.0, + 0.7340245842933655, + 0.21870741620659828, + 0.23294984735548496, + 0.0, + 0.3532063029706478, + 0.22584476321935654, + 0.18678631633520126, + 0.3003021143376827, + 0.2968890331685543, + 0.3770547844469547, + 0.1650681272149086, + 0.22677430883049965, + 0.0, + 1.2774099297821522, + 0.20223145745694637, + 0.7256561890244484, + 2.565027840435505 + ], + "unique_experts": 53, + "load_cv": 1.090572836827525, + "normalized_load_entropy": 0.875226804802372, + "max_load_share": 0.07371794871794872 + }, + "full_input": { + "tokens": 77, + "top_k": 6, + "decisions": 462, + "ordered_route_sha256": "ca9b1aedeb2c97957ea15c9e5a89ad686bbb14d6bec965b03cc5523f0e89c5b5", + "route_weight_sha256": "e701e996a41c53fd2e5df12ed6afe326012f2b5482b65f770a4a235703abb870", + "loads": [ + 26, + 4, + 0, + 0, + 13, + 0, + 2, + 12, + 7, + 2, + 17, + 3, + 21, + 26, + 0, + 4, + 16, + 3, + 1, + 9, + 4, + 4, + 6, + 6, + 5, + 10, + 1, + 5, + 3, + 7, + 11, + 6, + 8, + 4, + 13, + 9, + 3, + 7, + 6, + 0, + 1, + 12, + 3, + 1, + 6, + 10, + 12, + 10, + 6, + 4, + 4, + 7, + 4, + 6, + 5, + 11, + 9, + 3, + 5, + 4, + 16, + 4, + 11, + 24 + ], + "weighted_loads": [ + 1.6208742260932922, + 0.35471197217702866, + 0.0, + 0.0, + 0.8786737024784088, + 0.0, + 0.08091964200139046, + 1.1199490688741207, + 0.47643179446458817, + 0.08950337395071983, + 1.5379747804254293, + 0.11848129332065582, + 1.5711860982701182, + 1.499608613550663, + 0.0, + 0.18418293073773384, + 1.3129720203578472, + 0.10907130315899849, + 0.03185960650444031, + 0.8561690114438534, + 0.26423797756433487, + 0.20358789898455143, + 1.6316859778016806, + 0.3655499331653118, + 0.19848957285284996, + 0.44630720280110836, + 0.032387033104896545, + 0.3336565839126706, + 0.16564805060625076, + 0.3165350817143917, + 0.46930432319641113, + 0.18867460521869361, + 0.4753910230938345, + 0.29161511734128, + 0.8644709456712008, + 0.6373547203838825, + 0.16586579009890556, + 0.523085031658411, + 0.2929665446281433, + 0.0, + 0.10694366693496704, + 1.0210976898670197, + 0.21353738382458687, + 0.046273697167634964, + 0.36970334639772773, + 0.6870676279067993, + 1.0448096729815006, + 0.8065952137112617, + 0.4219345562160015, + 0.23294984735548496, + 0.21246559545397758, + 0.38686706870794296, + 0.22584476321935654, + 0.30663924664258957, + 0.3003021143376827, + 0.5601093992590904, + 0.5817354880273342, + 0.1650681272149086, + 0.4017564058303833, + 0.1744460053741932, + 1.2774099297821522, + 0.20223145745694637, + 0.78168835490942, + 2.601218916475773 + ], + "unique_experts": 59, + "load_cv": 0.8392352984318927, + "normalized_load_entropy": 0.9200942149484527, + "max_load_share": 0.05627705627705628 + } + }, + "s1_eos": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "a86a554c879a1d3afd834e3704b8a96f04e14e23a54d1879073cd50cb52e4dd2", + "route_weight_sha256": "b3b2f608f28243929ff979de842437542ecf544b2d76a1e7db9b9c1a4364e6aa", + "loads": [ + 20, + 2, + 0, + 0, + 11, + 0, + 1, + 12, + 5, + 2, + 5, + 3, + 17, + 21, + 0, + 4, + 16, + 2, + 1, + 0, + 4, + 4, + 2, + 1, + 1, + 7, + 1, + 4, + 3, + 7, + 10, + 1, + 7, + 4, + 3, + 2, + 2, + 7, + 3, + 0, + 1, + 2, + 3, + 1, + 3, + 4, + 0, + 8, + 3, + 5, + 0, + 5, + 4, + 3, + 5, + 7, + 6, + 3, + 3, + 0, + 16, + 4, + 8, + 23 + ], + "weighted_loads": [ + 1.160574771463871, + 0.17422942072153091, + 0.0, + 0.0, + 0.6207912415266037, + 0.0, + 0.034340750426054, + 1.1114040277898312, + 0.3800152875483036, + 0.08750813081860542, + 0.3270704299211502, + 0.12344270199537277, + 1.4590029530227184, + 1.3316042758524418, + 0.0, + 0.1871890015900135, + 1.3018900714814663, + 0.0648690015077591, + 0.03127877414226532, + 0.0, + 0.26648228988051414, + 0.201596699655056, + 0.06257672421634197, + 0.03778039291501045, + 0.0334850512444973, + 0.2802832592278719, + 0.03202768415212631, + 0.306812334805727, + 0.1576242297887802, + 0.3160766139626503, + 0.41836995258927345, + 0.03371536359190941, + 0.473475594073534, + 0.28527985513210297, + 0.34819314628839493, + 0.1608707532286644, + 0.13612787798047066, + 0.5178624428808689, + 0.1631612405180931, + 0.0, + 0.10420136153697968, + 0.07193973660469055, + 0.21610691398382187, + 0.04018090292811394, + 0.13193517737090588, + 0.1476860474795103, + 0.0, + 0.6898587718605995, + 0.2180114984512329, + 0.2814330607652664, + 0.0, + 0.3274545259773731, + 0.2248789444565773, + 0.18905963003635406, + 0.30630872398614883, + 0.3172778971493244, + 0.4050517901778221, + 0.1704036071896553, + 0.2242317833006382, + 0.0, + 1.2631646618247032, + 0.20456273294985294, + 0.7008305191993713, + 2.5347230844199657 + ], + "unique_experts": 55, + "load_cv": 1.0887627561826743, + "normalized_load_entropy": 0.8788368684752424, + "max_load_share": 0.07371794871794872 + }, + "full_input": { + "tokens": 93, + "top_k": 6, + "decisions": 558, + "ordered_route_sha256": "3c5e8d56771060620b9be607263893a96cd4bf6bb941ef7d58b07591128d36cf", + "route_weight_sha256": "91120038f638a5d7cec5299d191bb2a3aefbce8e0c842e5c3682688433efeb59", + "loads": [ + 31, + 6, + 0, + 0, + 13, + 0, + 1, + 12, + 12, + 4, + 16, + 5, + 20, + 26, + 1, + 4, + 17, + 4, + 1, + 9, + 4, + 7, + 7, + 12, + 6, + 16, + 5, + 5, + 9, + 7, + 12, + 6, + 8, + 7, + 10, + 14, + 2, + 10, + 8, + 2, + 7, + 17, + 5, + 1, + 8, + 16, + 20, + 9, + 10, + 10, + 2, + 6, + 4, + 6, + 6, + 11, + 11, + 3, + 8, + 4, + 16, + 5, + 10, + 24 + ], + "weighted_loads": [ + 1.8701788261532784, + 0.4381495378911495, + 0.0, + 0.0, + 0.8989521712064743, + 0.0, + 0.034340750426054, + 1.1114040277898312, + 0.7958487421274185, + 0.178642138838768, + 1.4156577549874783, + 0.22056373581290245, + 1.513614472001791, + 1.4657109258696437, + 0.03949528932571411, + 0.1871890015900135, + 1.3475815951824188, + 0.16061649844050407, + 0.03127877414226532, + 0.9591192007064819, + 0.26648228988051414, + 0.32815318182110786, + 1.6523958891630173, + 0.8732693158090115, + 0.22511085122823715, + 0.7759350463747978, + 0.2866818904876709, + 0.3197315754368901, + 0.5845102071762085, + 0.3160766139626503, + 0.5563455075025558, + 0.17889115633442998, + 0.47709300369024277, + 0.5070146434009075, + 0.683679323643446, + 0.9636303968727589, + 0.13612787798047066, + 0.6600084751844406, + 0.41748499497771263, + 0.10495272278785706, + 0.5035893470048904, + 1.496242817491293, + 0.30829404294490814, + 0.04018090292811394, + 0.3161785267293453, + 1.1230517271906137, + 1.817769791930914, + 0.7569243833422661, + 0.6568944752216339, + 0.6106459125876427, + 0.12574412301182747, + 0.3607700280845165, + 0.2248789444565773, + 0.3375762850046158, + 0.34700382873415947, + 0.5310657266527414, + 0.6397182196378708, + 0.1704036071896553, + 0.5553189367055893, + 0.18039998039603233, + 1.2631646618247032, + 0.24173313938081264, + 0.8594783823937178, + 2.57070679217577 + ], + "unique_experts": 61, + "load_cv": 0.7364959116134885, + "normalized_load_entropy": 0.9355377211609316, + "max_load_share": 0.05555555555555555 + } + }, + "s0_bos": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "17489a9da40efc411916032dff96894d245871d4f95da669106dab94c7ba5208", + "route_weight_sha256": "18e4e123a9fa3e461b3914766eb077ccdb934139b54c56144d67c07dd0e39e73", + "loads": [ + 20, + 2, + 0, + 0, + 10, + 0, + 2, + 12, + 5, + 2, + 7, + 3, + 19, + 23, + 0, + 3, + 15, + 1, + 1, + 0, + 4, + 4, + 0, + 2, + 1, + 7, + 0, + 4, + 3, + 8, + 9, + 2, + 6, + 3, + 4, + 2, + 3, + 7, + 4, + 0, + 2, + 2, + 3, + 1, + 1, + 3, + 0, + 8, + 3, + 4, + 0, + 5, + 4, + 4, + 5, + 7, + 5, + 4, + 3, + 0, + 15, + 3, + 8, + 24 + ], + "weighted_loads": [ + 1.1369819268584251, + 0.1704752892255783, + 0.0, + 0.0, + 0.5670536868274212, + 0.0, + 0.07788635790348053, + 1.1247521080076694, + 0.3671009764075279, + 0.09093556925654411, + 0.38797176629304886, + 0.11391570791602135, + 1.6310036145150661, + 1.4351302161812782, + 0.0, + 0.14779583737254143, + 1.2973911948502064, + 0.03494808077812195, + 0.030161255970597267, + 0.0, + 0.26159344241023064, + 0.2201104834675789, + 0.0, + 0.07780494540929794, + 0.03933862969279289, + 0.2710752934217453, + 0.0, + 0.2873004861176014, + 0.17451665550470352, + 0.3404843360185623, + 0.3867448102682829, + 0.0761462114751339, + 0.4157789945602417, + 0.25871431827545166, + 0.3796117752790451, + 0.16213105618953705, + 0.1720231231302023, + 0.5383836850523949, + 0.17737049609422684, + 0.0, + 0.13204047083854675, + 0.07467920333147049, + 0.20745012536644936, + 0.03976716473698616, + 0.0636516883969307, + 0.11289731785655022, + 0.0, + 0.6762136593461037, + 0.22244691848754883, + 0.22970512695610523, + 0.0, + 0.3133457452058792, + 0.23741110786795616, + 0.2220677062869072, + 0.3051471747457981, + 0.3277610316872597, + 0.3633423484861851, + 0.20636359602212906, + 0.23333890736103058, + 0.0, + 1.2084680907428265, + 0.17378363385796547, + 0.6798545494675636, + 2.6649476625025272 + ], + "unique_experts": 53, + "load_cv": 1.1220695634380033, + "normalized_load_entropy": 0.8727228947890714, + "max_load_share": 0.07692307692307693 + }, + "full_input": { + "tokens": 77, + "top_k": 6, + "decisions": 462, + "ordered_route_sha256": "b72e9a43951f5abe1213fc377450d7c0f108ec4c4e7b6f005687e02678eef6a2", + "route_weight_sha256": "fc20a76549a4746986c4d59d3ef158370054a48c409628838d178701aabf8edd", + "loads": [ + 28, + 4, + 0, + 0, + 13, + 0, + 2, + 12, + 7, + 2, + 18, + 3, + 21, + 27, + 0, + 3, + 16, + 5, + 1, + 9, + 4, + 4, + 5, + 5, + 5, + 9, + 0, + 5, + 3, + 8, + 10, + 7, + 6, + 3, + 13, + 9, + 3, + 7, + 6, + 1, + 2, + 12, + 3, + 1, + 4, + 10, + 12, + 9, + 6, + 4, + 6, + 6, + 4, + 7, + 5, + 12, + 9, + 4, + 5, + 4, + 15, + 3, + 10, + 25 + ], + "weighted_loads": [ + 1.6615422926843166, + 0.3348412439227104, + 0.0, + 0.0, + 0.8983657769858837, + 0.0, + 0.07788635790348053, + 1.1247521080076694, + 0.46401868388056755, + 0.09093556925654411, + 1.564274936914444, + 0.11391570791602135, + 1.6766887996345758, + 1.6039435053244233, + 0.0, + 0.14779583737254143, + 1.3383293263614178, + 0.19252444431185722, + 0.030161255970597267, + 0.8561690114438534, + 0.26159344241023064, + 0.2201104834675789, + 0.7029007878154516, + 0.36175504326820374, + 0.20518695935606956, + 0.4151329770684242, + 0.0, + 0.3002197267487645, + 0.17451665550470352, + 0.3404843360185623, + 0.42653109319508076, + 0.26209877524524927, + 0.4157789945602417, + 0.25871431827545166, + 0.8740303087979555, + 0.6221304424107075, + 0.1720231231302023, + 0.5383836850523949, + 0.27504606172442436, + 0.04502622038125992, + 0.13204047083854675, + 1.0592949762940407, + 0.20745012536644936, + 0.03976716473698616, + 0.3237643977627158, + 0.8294168226420879, + 1.0311563797295094, + 0.7536181807518005, + 0.41913848742842674, + 0.22970512695610523, + 0.2911606505513191, + 0.34700651094317436, + 0.23741110786795616, + 0.344107698649168, + 0.3051471747457981, + 0.5914035253226757, + 0.5680230520665646, + 0.20636359602212906, + 0.40510473772883415, + 0.1744460053741932, + 1.2084680907428265, + 0.17378363385796547, + 0.7358867153525352, + 2.701138738542795 + ], + "unique_experts": 59, + "load_cv": 0.8638831575684721, + "normalized_load_entropy": 0.918189923478399, + "max_load_share": 0.06060606060606061 + } + }, + "s1_bos": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "07d6e85a61bdb9603decc683878a30420a8d0396eda6d3f81bffa36114b4a98a", + "route_weight_sha256": "09044dfe38278e5fbab9296f52a68897eef82775c895011880cb8646607af1fb", + "loads": [ + 17, + 2, + 0, + 0, + 10, + 0, + 0, + 13, + 5, + 2, + 5, + 3, + 20, + 24, + 0, + 2, + 15, + 1, + 1, + 0, + 5, + 4, + 0, + 1, + 1, + 7, + 0, + 4, + 3, + 8, + 9, + 2, + 7, + 3, + 4, + 2, + 3, + 7, + 4, + 0, + 2, + 3, + 3, + 1, + 2, + 4, + 0, + 8, + 3, + 5, + 0, + 5, + 4, + 4, + 5, + 6, + 6, + 4, + 3, + 0, + 15, + 3, + 8, + 24 + ], + "weighted_loads": [ + 1.0399034209549427, + 0.1676197573542595, + 0.0, + 0.0, + 0.5687550865113735, + 0.0, + 0.0, + 1.1508898511528969, + 0.37034132331609726, + 0.09116650745272636, + 0.31978488340973854, + 0.11310838535428047, + 1.6134453043341637, + 1.4769270941615105, + 0.0, + 0.10751724243164062, + 1.2969244420528412, + 0.035564348101615906, + 0.029633264988660812, + 0.0, + 0.2971847914159298, + 0.20982013456523418, + 0.0, + 0.03504979982972145, + 0.03978341072797775, + 0.26709617115557194, + 0.0, + 0.2801722623407841, + 0.1641773320734501, + 0.33952129632234573, + 0.3691899999976158, + 0.07578673586249352, + 0.4628858342766762, + 0.25379960983991623, + 0.37347839772701263, + 0.15834736078977585, + 0.17603326216340065, + 0.5441254414618015, + 0.1844671107828617, + 0.0, + 0.1365141123533249, + 0.11679143086075783, + 0.19804170355200768, + 0.04316035658121109, + 0.10385861247777939, + 0.14985885471105576, + 0.0, + 0.6814098954200745, + 0.2220841348171234, + 0.2773268297314644, + 0.0, + 0.3278561644256115, + 0.24238012731075287, + 0.21149881556630135, + 0.2999609522521496, + 0.29584987089037895, + 0.39842068776488304, + 0.21064110845327377, + 0.22345150634646416, + 0.0, + 1.2026559673249722, + 0.17542177066206932, + 0.6955015733838081, + 2.65345211699605 + ], + "unique_experts": 52, + "load_cv": 1.1244108691938821, + "normalized_load_entropy": 0.8704887757198201, + "max_load_share": 0.07692307692307693 + }, + "full_input": { + "tokens": 93, + "top_k": 6, + "decisions": 558, + "ordered_route_sha256": "7958b69c52bc55284b1b4732d05dd6f335cd5f432234bd57dcd1b3ef832b55a8", + "route_weight_sha256": "78b017451fb5997e38f0ea27f099dde2eaa9a8cd96d686f98d8cfa6def518875", + "loads": [ + 29, + 6, + 0, + 0, + 13, + 0, + 0, + 13, + 12, + 4, + 16, + 5, + 22, + 29, + 1, + 2, + 16, + 6, + 1, + 9, + 5, + 7, + 4, + 12, + 7, + 16, + 4, + 5, + 9, + 8, + 11, + 6, + 7, + 6, + 11, + 14, + 3, + 10, + 8, + 3, + 8, + 17, + 5, + 1, + 5, + 16, + 20, + 9, + 10, + 10, + 3, + 6, + 4, + 7, + 6, + 10, + 11, + 4, + 8, + 4, + 15, + 4, + 10, + 25 + ], + "weighted_loads": [ + 1.831509556621313, + 0.41457710042595863, + 0.0, + 0.0, + 0.9155774228274822, + 0.0, + 0.0, + 1.1508898511528969, + 0.7861747778952122, + 0.18230051547288895, + 1.4083722084760666, + 0.21022941917181015, + 1.6611026711761951, + 1.6606288151815534, + 0.03949528932571411, + 0.10751724243164062, + 1.3426159657537937, + 0.25906772911548615, + 0.029633264988660812, + 0.9591192007064819, + 0.2971847914159298, + 0.33637661673128605, + 0.6661547888070345, + 0.8711908422410488, + 0.2702471986413002, + 0.7599846124649048, + 0.2546542063355446, + 0.2930915029719472, + 0.5910633094608784, + 0.33952129632234573, + 0.5071655549108982, + 0.2181482771411538, + 0.4628858342766762, + 0.4755343981087208, + 0.7089645750820637, + 0.9404818266630173, + 0.17603326216340065, + 0.6862714737653732, + 0.3922150284051895, + 0.15453701838850975, + 0.5359020978212357, + 1.5404920168220997, + 0.29022883251309395, + 0.04316035658121109, + 0.23383579682558775, + 1.3182344026863575, + 1.8260540030896664, + 0.7603219971060753, + 0.6507125534117222, + 0.6065396815538406, + 0.15646654181182384, + 0.3611716665327549, + 0.24238012731075287, + 0.36462894827127457, + 0.3406560570001602, + 0.5059241931885481, + 0.6330871172249317, + 0.21064110845327377, + 0.5456641763448715, + 0.18039998039603233, + 1.2026559673249722, + 0.21259217709302902, + 0.8541494365781546, + 2.689435824751854 + ], + "unique_experts": 60, + "load_cv": 0.7492239789954772, + "normalized_load_entropy": 0.9335088193779556, + "max_load_share": 0.05197132616487455 + } + }, + "s0_x": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "6b1a4b8bf4920eea68f9b8559c2105512417a85217dd6724fbad525669bf81e5", + "route_weight_sha256": "97f09c6b5870bc0012aefced2f5a10d495e88bfdffb97b48c9fcc9af4e1dd7c2", + "loads": [ + 22, + 2, + 0, + 0, + 10, + 0, + 2, + 12, + 5, + 1, + 6, + 2, + 20, + 22, + 0, + 3, + 15, + 1, + 0, + 0, + 4, + 4, + 0, + 2, + 1, + 7, + 0, + 4, + 3, + 8, + 8, + 2, + 6, + 4, + 4, + 2, + 3, + 6, + 3, + 0, + 2, + 3, + 3, + 1, + 2, + 4, + 1, + 8, + 3, + 4, + 0, + 4, + 4, + 4, + 5, + 7, + 5, + 4, + 2, + 0, + 17, + 3, + 8, + 24 + ], + "weighted_loads": [ + 1.1988133825361729, + 0.17614758014678955, + 0.0, + 0.0, + 0.5483808740973473, + 0.0, + 0.07587303221225739, + 1.1216795332729816, + 0.3720434494316578, + 0.056309398263692856, + 0.3708652891218662, + 0.07798219472169876, + 1.6824825592339039, + 1.3464126735925674, + 0.0, + 0.1512189321219921, + 1.2928146719932556, + 0.03637642413377762, + 0.0, + 0.0, + 0.2592722736299038, + 0.21171800792217255, + 0.0, + 0.07847834378480911, + 0.039144597947597504, + 0.2896267268806696, + 0.0, + 0.28283439949154854, + 0.1842651702463627, + 0.344464223831892, + 0.3351560216397047, + 0.07073624432086945, + 0.4280473478138447, + 0.300869669765234, + 0.4062771461904049, + 0.1697365716099739, + 0.16494516842067242, + 0.4841307997703552, + 0.1442316509783268, + 0.0, + 0.12939194217324257, + 0.12553004547953606, + 0.20868835970759392, + 0.03911016508936882, + 0.10394161567091942, + 0.14895220659673214, + 0.03451601415872574, + 0.6851889826357365, + 0.23508093133568764, + 0.2279746923595667, + 0.0, + 0.2700381577014923, + 0.23776360228657722, + 0.21264034882187843, + 0.3020816817879677, + 0.3115260750055313, + 0.39106887206435204, + 0.20152263343334198, + 0.1977039873600006, + 0.0, + 1.3188680373132229, + 0.17501619085669518, + 0.6612410545349121, + 2.708810530602932 + ], + "unique_experts": 53, + "load_cv": 1.1487065017744675, + "normalized_load_entropy": 0.8692967230740433, + "max_load_share": 0.07692307692307693 + }, + "full_input": { + "tokens": 77, + "top_k": 6, + "decisions": 462, + "ordered_route_sha256": "02327a513a517019eb2400b356bcf08134657e29268da014b9144d64bf749ad8", + "route_weight_sha256": "bad6188a2967bb81d1395128c0c4c2f0db09e1ca212e3e9a598a42553130c02a", + "loads": [ + 31, + 4, + 0, + 0, + 12, + 0, + 2, + 12, + 7, + 1, + 18, + 2, + 22, + 26, + 0, + 3, + 17, + 3, + 0, + 9, + 4, + 4, + 5, + 5, + 5, + 10, + 0, + 5, + 3, + 8, + 9, + 7, + 6, + 4, + 14, + 8, + 3, + 6, + 6, + 0, + 2, + 13, + 3, + 1, + 5, + 11, + 13, + 9, + 6, + 4, + 4, + 5, + 4, + 7, + 5, + 12, + 9, + 4, + 4, + 5, + 17, + 3, + 10, + 25 + ], + "weighted_loads": [ + 1.8471445888280869, + 0.3385450765490532, + 0.0, + 0.0, + 0.8077122643589973, + 0.0, + 0.07587303221225739, + 1.1216795332729816, + 0.4689611569046974, + 0.056309398263692856, + 1.6971000991761684, + 0.07798219472169876, + 1.7281677443534136, + 1.4921622024849057, + 0.0, + 0.1512189321219921, + 1.3709095008671284, + 0.11767440289258957, + 0.0, + 0.8561690114438534, + 0.2592722736299038, + 0.21171800792217255, + 0.7019439991563559, + 0.3120283856987953, + 0.20499292761087418, + 0.4909048583358526, + 0.0, + 0.29575364012271166, + 0.1842651702463627, + 0.344464223831892, + 0.37494230456650257, + 0.2566888080909848, + 0.4280473478138447, + 0.300869669765234, + 0.9957582037895918, + 0.5924100056290627, + 0.16494516842067242, + 0.4841307997703552, + 0.284544438123703, + 0.0, + 0.12939194217324257, + 1.0536896586418152, + 0.20868835970759392, + 0.03911016508936882, + 0.36405432503670454, + 0.6528207082301378, + 1.0081392526626587, + 0.7628467045724392, + 0.4325427860021591, + 0.2279746923595667, + 0.21647857502102852, + 0.30369892343878746, + 0.23776360228657722, + 0.33131517469882965, + 0.3020816817879677, + 0.5756130628287792, + 0.5957495756447315, + 0.20152263343334198, + 0.3632396198809147, + 0.2148130238056183, + 1.3188680373132229, + 0.17501619085669518, + 0.7172732204198837, + 2.7450016066432 + ], + "unique_experts": 57, + "load_cv": 0.9088744331004389, + "normalized_load_entropy": 0.9090539640359255, + "max_load_share": 0.0670995670995671 + } + }, + "s1_x": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "7925fc29b4ebb79c05966ef6dc639a93135d33672ff4225b7eaf96cd3fabee0e", + "route_weight_sha256": "f1df0ff275b01ad5b0c0d04be5a29c2851e9acd8973577e15aa7d889c3cfd0c6", + "loads": [ + 19, + 2, + 0, + 0, + 10, + 0, + 0, + 12, + 5, + 1, + 5, + 3, + 22, + 24, + 0, + 3, + 15, + 1, + 1, + 0, + 5, + 4, + 0, + 1, + 2, + 8, + 0, + 4, + 3, + 9, + 6, + 2, + 7, + 3, + 4, + 2, + 2, + 6, + 3, + 0, + 2, + 3, + 3, + 1, + 3, + 4, + 1, + 8, + 3, + 4, + 0, + 6, + 4, + 3, + 5, + 6, + 6, + 4, + 2, + 0, + 15, + 4, + 7, + 24 + ], + "weighted_loads": [ + 1.1366350948810577, + 0.16834469884634018, + 0.0, + 0.0, + 0.5670418962836266, + 0.0, + 0.0, + 1.108092337846756, + 0.3904188610613346, + 0.05413509160280228, + 0.3246544785797596, + 0.11560095101594925, + 1.6797302216291428, + 1.4645758401602507, + 0.0, + 0.1478458009660244, + 1.2991455644369125, + 0.04044438526034355, + 0.027497807517647743, + 0.0, + 0.29155508428812027, + 0.20291837118566036, + 0.0, + 0.034796297550201416, + 0.0909530408680439, + 0.33079866506159306, + 0.0, + 0.2803070731461048, + 0.16780389100313187, + 0.37411821261048317, + 0.27286424674093723, + 0.0728604905307293, + 0.4616370312869549, + 0.24529150873422623, + 0.40618953108787537, + 0.16046343743801117, + 0.14573916792869568, + 0.4786219708621502, + 0.14364615827798843, + 0.0, + 0.13439764454960823, + 0.12488806992769241, + 0.19368081912398338, + 0.04457831382751465, + 0.1335376724600792, + 0.15115692093968391, + 0.03767665475606918, + 0.686465959995985, + 0.22582023590803146, + 0.25244420394301414, + 0.0, + 0.3562876991927624, + 0.2344394065439701, + 0.1670418716967106, + 0.29646869748830795, + 0.2943374142050743, + 0.42139868065714836, + 0.2108321748673916, + 0.182046040892601, + 0.0, + 1.1967149376869202, + 0.20424156449735165, + 0.6231443397700787, + 2.6290130466222763 + ], + "unique_experts": 53, + "load_cv": 1.149278709282819, + "normalized_load_entropy": 0.8693028948698561, + "max_load_share": 0.07692307692307693 + }, + "full_input": { + "tokens": 93, + "top_k": 6, + "decisions": 558, + "ordered_route_sha256": "1d982243b06ad99e61b9f537b9a66328e8ad87b426545e8a519e1fac1bd454f9", + "route_weight_sha256": "9ecb03274e9ab9cd35486a241d29b7150426cc74216b87361f8110779b9f5bcf", + "loads": [ + 33, + 6, + 0, + 0, + 12, + 0, + 0, + 12, + 13, + 3, + 17, + 5, + 24, + 27, + 1, + 3, + 17, + 4, + 1, + 10, + 5, + 7, + 4, + 12, + 7, + 18, + 5, + 5, + 9, + 9, + 8, + 6, + 7, + 6, + 12, + 13, + 2, + 9, + 8, + 3, + 8, + 18, + 5, + 1, + 6, + 13, + 20, + 9, + 10, + 9, + 2, + 7, + 4, + 5, + 6, + 10, + 11, + 4, + 8, + 5, + 15, + 5, + 9, + 25 + ], + "weighted_loads": [ + 2.0703043155372143, + 0.4047376997768879, + 0.0, + 0.0, + 0.8503476604819298, + 0.0, + 0.0, + 1.108092337846756, + 0.8477892205119133, + 0.14526909962296486, + 1.575157105922699, + 0.21272198483347893, + 1.7273875884711742, + 1.555306195281446, + 0.03949528932571411, + 0.1478458009660244, + 1.3853866308927536, + 0.1881270483136177, + 0.027497807517647743, + 1.005787156522274, + 0.29155508428812027, + 0.3294748533517122, + 0.6638715472072363, + 0.8768205605447292, + 0.28257884085178375, + 0.8727111965417862, + 0.30103909224271774, + 0.29322631377726793, + 0.5946898683905602, + 0.37411821261048317, + 0.4108398016542196, + 0.2152220318093896, + 0.4616370312869549, + 0.4670262970030308, + 0.801959402859211, + 0.8872530534863472, + 0.14573916792869568, + 0.6207680031657219, + 0.40853165090084076, + 0.14791011437773705, + 0.533785630017519, + 1.4444828517735004, + 0.28586794808506966, + 0.04457831382751465, + 0.26351485680788755, + 0.9018814526498318, + 1.7152941934764385, + 0.7492880113422871, + 0.6600096113979816, + 0.5816570557653904, + 0.12272222340106964, + 0.3896032012999058, + 0.2344394065439701, + 0.26699190959334373, + 0.3371638022363186, + 0.5056718271225691, + 0.656065110117197, + 0.2108321748673916, + 0.5566437914967537, + 0.2340603657066822, + 1.1967149376869202, + 0.24141197092831135, + 0.7817922029644251, + 2.6649967543780804 + ], + "unique_experts": 60, + "load_cv": 0.775909090893697, + "normalized_load_entropy": 0.9305749021333906, + "max_load_share": 0.05913978494623656 + } + }, + "s0_period": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "2b25439d25ff19522a2138baad3b1412c77f28d42e58d18f36c527336a4e3245", + "route_weight_sha256": "647ac2db4692b693d4ab1d3bc0e0085f438ce4f7f904cfabe8b2d041c2652093", + "loads": [ + 22, + 2, + 0, + 0, + 9, + 0, + 2, + 13, + 5, + 1, + 6, + 2, + 19, + 22, + 0, + 3, + 15, + 1, + 0, + 0, + 4, + 4, + 0, + 1, + 1, + 7, + 0, + 4, + 3, + 9, + 9, + 2, + 6, + 4, + 4, + 2, + 2, + 7, + 3, + 0, + 2, + 3, + 3, + 0, + 1, + 4, + 1, + 8, + 3, + 4, + 0, + 5, + 4, + 3, + 5, + 8, + 4, + 4, + 2, + 0, + 17, + 4, + 9, + 24 + ], + "weighted_loads": [ + 1.2045502439141273, + 0.17401298135519028, + 0.0, + 0.0, + 0.5285744778811932, + 0.0, + 0.07287517189979553, + 1.1706439815461636, + 0.37472519651055336, + 0.05476904287934303, + 0.37037547305226326, + 0.07909568771719933, + 1.676007628440857, + 1.3649961613118649, + 0.0, + 0.15022101253271103, + 1.2851073704659939, + 0.03659951314330101, + 0.0, + 0.0, + 0.2672877199947834, + 0.21370408684015274, + 0.0, + 0.03703487291932106, + 0.03993307426571846, + 0.29334208741784096, + 0.0, + 0.3015499487519264, + 0.17767054960131645, + 0.39110126718878746, + 0.36541364155709743, + 0.07131139189004898, + 0.43087856844067574, + 0.2862169221043587, + 0.41881536319851875, + 0.1695825457572937, + 0.13668940961360931, + 0.5171342231333256, + 0.1442973092198372, + 0.0, + 0.1294049359858036, + 0.12525690719485283, + 0.21048155799508095, + 0.0, + 0.06330657005310059, + 0.14668578654527664, + 0.036716215312480927, + 0.6939855590462685, + 0.23473049700260162, + 0.22779321111738682, + 0.0, + 0.3104093559086323, + 0.2342265211045742, + 0.17703692242503166, + 0.30401984974741936, + 0.35585806146264076, + 0.3546052910387516, + 0.20487917587161064, + 0.19719282537698746, + 0.0, + 1.3119603842496872, + 0.20364262163639069, + 0.7062813341617584, + 2.7014644630253315 + ], + "unique_experts": 52, + "load_cv": 1.1583955895463096, + "normalized_load_entropy": 0.8639593385754214, + "max_load_share": 0.07692307692307693 + }, + "full_input": { + "tokens": 77, + "top_k": 6, + "decisions": 462, + "ordered_route_sha256": "3d75ce58eb1825276788a557f3f42cce689f13d8ba4f8f5fd2f96815ed43400b", + "route_weight_sha256": "12f7bf538a4a618492cadf21a979a6042c572320703d7760dcca6af82d95edce", + "loads": [ + 31, + 4, + 0, + 0, + 11, + 0, + 2, + 13, + 7, + 1, + 18, + 2, + 21, + 26, + 0, + 3, + 16, + 5, + 0, + 9, + 4, + 4, + 4, + 4, + 5, + 9, + 0, + 5, + 3, + 9, + 10, + 7, + 6, + 4, + 14, + 8, + 2, + 7, + 6, + 0, + 2, + 14, + 3, + 0, + 4, + 11, + 14, + 9, + 6, + 4, + 4, + 6, + 4, + 5, + 5, + 13, + 9, + 4, + 4, + 4, + 17, + 4, + 11, + 25 + ], + "weighted_loads": [ + 1.8320592977106571, + 0.3323060944676399, + 0.0, + 0.0, + 0.7881173454225063, + 0.0, + 0.07287517189979553, + 1.1706439815461636, + 0.471642903983593, + 0.05476904287934303, + 1.6424360163509846, + 0.07909568771719933, + 1.7216928135603666, + 1.5082951793447137, + 0.0, + 0.15022101253271103, + 1.3260455019772053, + 0.2053266316652298, + 0.0, + 0.8561690114438534, + 0.2672877199947834, + 0.21370408684015274, + 0.6656183991581202, + 0.2799326218664646, + 0.20578140392899513, + 0.4453185237944126, + 0.0, + 0.31446918938308954, + 0.17767054960131645, + 0.39110126718878746, + 0.4051999244838953, + 0.25726395566016436, + 0.43087856844067574, + 0.2862169221043587, + 0.9700294528156519, + 0.5827002935111523, + 0.13668940961360931, + 0.5171342231333256, + 0.2803616039454937, + 0.0, + 0.1294049359858036, + 1.1144436225295067, + 0.21048155799508095, + 0.0, + 0.3234192794188857, + 0.6704332306981087, + 1.1322582103312016, + 0.770431213080883, + 0.42385413497686386, + 0.22779321111738682, + 0.21277223154902458, + 0.34407012164592743, + 0.2342265211045742, + 0.2536423020064831, + 0.30401984974741936, + 0.6271361485123634, + 0.5972787849605083, + 0.20487917587161064, + 0.3638862706720829, + 0.1744460053741932, + 1.3119603842496872, + 0.20364262163639069, + 0.76231350004673, + 2.7376555390655994 + ], + "unique_experts": 56, + "load_cv": 0.9128247378769765, + "normalized_load_entropy": 0.9067034786452126, + "max_load_share": 0.0670995670995671 + } + }, + "s1_period": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "f7241df296e40bd38b831334b101f07b000b79fe26c807b11a4e27e89035d02a", + "route_weight_sha256": "c430d98f6f7569d90b30ab7f97aee60c4d86c10ab766ef4adb1bff200ba6092d", + "loads": [ + 20, + 2, + 0, + 0, + 10, + 0, + 0, + 12, + 5, + 1, + 5, + 3, + 22, + 24, + 0, + 3, + 15, + 1, + 1, + 0, + 4, + 4, + 0, + 1, + 1, + 7, + 0, + 4, + 3, + 9, + 7, + 2, + 7, + 3, + 4, + 2, + 2, + 6, + 3, + 0, + 2, + 3, + 3, + 1, + 3, + 3, + 0, + 8, + 3, + 4, + 0, + 6, + 4, + 3, + 5, + 6, + 6, + 4, + 3, + 0, + 15, + 5, + 8, + 24 + ], + "weighted_loads": [ + 1.200106903910637, + 0.1681397706270218, + 0.0, + 0.0, + 0.5638644993305206, + 0.0, + 0.0, + 1.1115386635065079, + 0.38154080137610435, + 0.0535910539329052, + 0.32684991881251335, + 0.11748724803328514, + 1.694577619433403, + 1.4731737524271011, + 0.0, + 0.14725175127387047, + 1.2967665009200573, + 0.043528001755476, + 0.027774620801210403, + 0.0, + 0.263393621891737, + 0.20611421763896942, + 0.0, + 0.03505612909793854, + 0.041347939521074295, + 0.28505763225257397, + 0.0, + 0.2835412211716175, + 0.16464923322200775, + 0.3695807196199894, + 0.29589902982115746, + 0.07259314134716988, + 0.46072300896048546, + 0.2487194985151291, + 0.39224500954151154, + 0.1625225692987442, + 0.13841906189918518, + 0.4859084337949753, + 0.1423054188489914, + 0.0, + 0.13288474828004837, + 0.12530476972460747, + 0.19435588270425797, + 0.04190714657306671, + 0.13332897797226906, + 0.11777617782354355, + 0.0, + 0.6978142783045769, + 0.2247607298195362, + 0.2487412877380848, + 0.0, + 0.35899529606103897, + 0.22985710948705673, + 0.17086943238973618, + 0.3027220368385315, + 0.30557020753622055, + 0.4291107803583145, + 0.21043188869953156, + 0.2175910845398903, + 0.0, + 1.1976403892040253, + 0.23033332265913486, + 0.6827192716300488, + 2.6393393762409687 + ], + "unique_experts": 52, + "load_cv": 1.1623617391428858, + "normalized_load_entropy": 0.8653608950852822, + "max_load_share": 0.07692307692307693 + }, + "full_input": { + "tokens": 93, + "top_k": 6, + "decisions": 558, + "ordered_route_sha256": "451ccb2a518fae56171975fed181bb4f8338fff80de4de25ed00da9408bcfd43", + "route_weight_sha256": "63daaecb1447ac023bcc661b433e25f8f9f37be8331806d6e4a810e45646def6", + "loads": [ + 33, + 6, + 0, + 0, + 12, + 0, + 0, + 12, + 12, + 3, + 17, + 5, + 24, + 28, + 1, + 3, + 16, + 5, + 1, + 9, + 4, + 7, + 4, + 12, + 6, + 17, + 4, + 5, + 9, + 9, + 9, + 6, + 7, + 6, + 11, + 14, + 2, + 9, + 8, + 2, + 8, + 19, + 5, + 1, + 6, + 12, + 21, + 9, + 10, + 9, + 2, + 7, + 4, + 6, + 6, + 10, + 12, + 4, + 9, + 4, + 15, + 6, + 10, + 25 + ], + "weighted_loads": [ + 2.0342055819928646, + 0.39912445843219757, + 0.0, + 0.0, + 0.8423003554344177, + 0.0, + 0.0, + 1.1115386635065079, + 0.7973742559552193, + 0.14472506195306778, + 1.4860768169164658, + 0.21460828185081482, + 1.7422349862754345, + 1.5958145456388593, + 0.03949528932571411, + 0.14725175127387047, + 1.3424580246210098, + 0.24482835084199905, + 0.027774620801210403, + 0.9591192007064819, + 0.263393621891737, + 0.3326706998050213, + 0.6659697238355875, + 0.861194834113121, + 0.23297373950481415, + 0.83185113966465, + 0.2546542063355446, + 0.29646046180278063, + 0.591535210609436, + 0.3695807196199894, + 0.43387458473443985, + 0.21495468262583017, + 0.46072300896048546, + 0.47045428678393364, + 0.7277311868965626, + 0.9336239211261272, + 0.13841906189918518, + 0.628054466098547, + 0.42053548991680145, + 0.10495272278785706, + 0.5322727337479591, + 1.5388656444847584, + 0.28654301166534424, + 0.04190714657306671, + 0.2633061623200774, + 0.8700073286890984, + 1.8919414393603802, + 0.7697334364056587, + 0.6569402925670147, + 0.577954139560461, + 0.12219616025686264, + 0.3923107981681824, + 0.22985710948705673, + 0.3201879896223545, + 0.34341714158654213, + 0.5207682568579912, + 0.7047131434082985, + 0.21043188869953156, + 0.5918146632611752, + 0.18039998039603233, + 1.1976403892040253, + 0.26750372909009457, + 0.8413671348243952, + 2.6753230839967728 + ], + "unique_experts": 60, + "load_cv": 0.78407834050808, + "normalized_load_entropy": 0.929265056540036, + "max_load_share": 0.05913978494623656 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 52, + "ordered_topk_exact_tokens": 33, + "set_exact_tokens": 37, + "mean_set_jaccard": 0.9175824175824178, + "mean_token_weighted_tv": 0.01624964655806812, + "aggregate_load_tv": 0.035256410256410256 + }, + "system_bos": { + "tokens": 52, + "ordered_topk_exact_tokens": 36, + "set_exact_tokens": 41, + "mean_set_jaccard": 0.9395604395604397, + "mean_token_weighted_tv": 0.015931261703372, + "aggregate_load_tv": 0.03205128205128204 + }, + "system_x": { + "tokens": 52, + "ordered_topk_exact_tokens": 29, + "set_exact_tokens": 33, + "mean_set_jaccard": 0.8873626373626374, + "mean_token_weighted_tv": 0.02541057591756376, + "aggregate_load_tv": 0.05128205128205129 + }, + "system_period": { + "tokens": 52, + "ordered_topk_exact_tokens": 27, + "set_exact_tokens": 33, + "mean_set_jaccard": 0.8759157509157508, + "mean_token_weighted_tv": 0.027467996884997074, + "aggregate_load_tv": 0.054487179487179495 + }, + "bos_at_s0": { + "tokens": 52, + "ordered_topk_exact_tokens": 26, + "set_exact_tokens": 35, + "mean_set_jaccard": 0.8983516483516485, + "mean_token_weighted_tv": 0.026482373870049532, + "aggregate_load_tv": 0.044871794871794865 + }, + "bos_at_s1": { + "tokens": 52, + "ordered_topk_exact_tokens": 20, + "set_exact_tokens": 26, + "mean_set_jaccard": 0.8489010989010988, + "mean_token_weighted_tv": 0.031618031225382134, + "aggregate_load_tv": 0.05769230769230768 + }, + "x_at_s0": { + "tokens": 52, + "ordered_topk_exact_tokens": 20, + "set_exact_tokens": 30, + "mean_set_jaccard": 0.8708791208791209, + "mean_token_weighted_tv": 0.029986426753636736, + "aggregate_load_tv": 0.057692307692307696 + }, + "x_at_s1": { + "tokens": 52, + "ordered_topk_exact_tokens": 16, + "set_exact_tokens": 25, + "mean_set_jaccard": 0.8310439560439562, + "mean_token_weighted_tv": 0.03632849231004142, + "aggregate_load_tv": 0.0673076923076923 + }, + "period_at_s0": { + "tokens": 52, + "ordered_topk_exact_tokens": 19, + "set_exact_tokens": 28, + "mean_set_jaccard": 0.8557692307692307, + "mean_token_weighted_tv": 0.03144351507608707, + "aggregate_load_tv": 0.060897435897435896 + }, + "period_at_s1": { + "tokens": 52, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 24, + "mean_set_jaccard": 0.8337912087912088, + "mean_token_weighted_tv": 0.03526272357871326, + "aggregate_load_tv": 0.05769230769230769 + } + } + }, + "layer_10": { + "layer": 10, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "88ec0f60225c1cb71894ac7f849c4159ae04acf6ce8cd8582d4dbad64e0abb5f", + "route_weight_sha256": "a38d61acad29b398d8f98e17b69d567d2d004d06b6b2fcaf6044c105bb8f40e1", + "loads": [ + 1, + 0, + 0, + 7, + 2, + 1, + 0, + 3, + 1, + 12, + 3, + 4, + 3, + 1, + 10, + 12, + 11, + 1, + 6, + 8, + 3, + 6, + 3, + 3, + 8, + 15, + 5, + 0, + 48, + 2, + 3, + 8, + 0, + 28, + 4, + 1, + 1, + 1, + 6, + 1, + 0, + 7, + 10, + 0, + 1, + 11, + 1, + 8, + 0, + 2, + 2, + 5, + 3, + 2, + 2, + 3, + 3, + 3, + 0, + 0, + 4, + 6, + 5, + 2 + ], + "weighted_loads": [ + 0.04654700681567192, + 0.0, + 0.0, + 0.48613421991467476, + 0.12951260432600975, + 0.029774531722068787, + 0.0, + 0.1419580690562725, + 0.04349123314023018, + 1.0255970731377602, + 0.16846531257033348, + 0.3066875673830509, + 0.12244303897023201, + 0.04325180873274803, + 0.5023260358721018, + 0.8729010447859764, + 0.855365939438343, + 0.050702743232250214, + 0.33684180304408073, + 0.3692808486521244, + 0.15936294570565224, + 0.36648689210414886, + 0.3288383223116398, + 0.26571179181337357, + 0.6802807673811913, + 1.6016215160489082, + 0.3752020597457886, + 0.0, + 4.020238384604454, + 0.1753738671541214, + 0.2172037810087204, + 0.5890560299158096, + 0.0, + 1.5927760228514671, + 0.39382505416870117, + 0.033960457891225815, + 0.054910238832235336, + 0.029531637206673622, + 0.5202183425426483, + 0.08182715624570847, + 0.0, + 0.3842644765973091, + 0.6481957696378231, + 0.0, + 0.026399100199341774, + 0.7464837990701199, + 0.06887250393629074, + 0.4399486482143402, + 0.0, + 0.1267586313188076, + 0.07581958919763565, + 0.4162650555372238, + 0.17445703223347664, + 0.17931532114744186, + 0.07880472019314766, + 0.20940137654542923, + 0.1880716308951378, + 0.2018933780491352, + 0.0, + 0.0, + 0.2919195517897606, + 0.5015996135771275, + 0.3557542413473129, + 0.08525465056300163 + ], + "unique_experts": 54, + "load_cv": 1.4687183068327883, + "normalized_load_entropy": 0.8401164984510507, + "max_load_share": 0.15384615384615385 + }, + "full_input": { + "tokens": 77, + "top_k": 6, + "decisions": 462, + "ordered_route_sha256": "6910a83cb45593872694dbda52c36f70929e3505e0352776dc2292360d04e026", + "route_weight_sha256": "1b3f26ea2f34c97a033ebe494cabb9a4bddb9789b93208bd7d3b837585c5732c", + "loads": [ + 1, + 0, + 2, + 7, + 2, + 1, + 0, + 7, + 1, + 14, + 5, + 6, + 4, + 4, + 12, + 12, + 11, + 4, + 13, + 11, + 6, + 8, + 4, + 3, + 8, + 17, + 5, + 6, + 49, + 4, + 5, + 9, + 0, + 36, + 5, + 2, + 1, + 1, + 6, + 1, + 0, + 16, + 14, + 2, + 5, + 14, + 7, + 11, + 0, + 4, + 4, + 11, + 3, + 5, + 2, + 13, + 3, + 9, + 0, + 11, + 9, + 19, + 5, + 2 + ], + "weighted_loads": [ + 0.04654700681567192, + 0.0, + 0.01896607130765915, + 0.48613421991467476, + 0.12951260432600975, + 0.029774531722068787, + 0.0, + 0.3175343871116638, + 0.04349123314023018, + 1.049997005611658, + 0.2642279118299484, + 0.4283164069056511, + 0.1552657000720501, + 1.4607296735048294, + 0.6419332269579172, + 0.8729010447859764, + 0.855365939438343, + 0.24426674842834473, + 0.7226342605426908, + 0.5112473294138908, + 0.27239975705742836, + 0.4510076008737087, + 0.3325581520330161, + 0.26571179181337357, + 0.6802807673811913, + 1.6655829716473818, + 0.3752020597457886, + 0.7576507888734341, + 4.066666059195995, + 0.269608449190855, + 0.420337051153183, + 0.602777891792357, + 0.0, + 1.968136515468359, + 0.4236070569604635, + 0.07094723731279373, + 0.054910238832235336, + 0.029531637206673622, + 0.5202183425426483, + 0.08182715624570847, + 0.0, + 1.4293666444718838, + 0.7611266011372209, + 0.0970296747982502, + 0.23545956052839756, + 0.8918047286570072, + 0.33674146607518196, + 0.5522861201316118, + 0.0, + 0.2184816487133503, + 0.17292022705078125, + 0.7269352562725544, + 0.17445703223347664, + 0.3650220260024071, + 0.07880472019314766, + 0.9749945402145386, + 0.1880716308951378, + 0.5443819798529148, + 0.0, + 0.6754339672625065, + 0.6680434420704842, + 1.7062962725758553, + 0.3557542413473129, + 0.08525465056300163 + ], + "unique_experts": 58, + "load_cv": 1.1078107315128367, + "normalized_load_entropy": 0.8887195638443404, + "max_load_share": 0.10606060606060606 + } + }, + "s1_eos": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "8f5688c8f9c38e5f329305c8fc36a7302257fa62f4f40bdb9a7729937dadfbb1", + "route_weight_sha256": "736dd57201bcbca3c9b6c16acfa1a08fa594f378d36977e7e42681ac29ba87d1", + "loads": [ + 1, + 0, + 0, + 7, + 2, + 1, + 0, + 3, + 1, + 12, + 3, + 4, + 3, + 1, + 10, + 12, + 11, + 1, + 6, + 8, + 3, + 5, + 3, + 3, + 8, + 15, + 5, + 0, + 48, + 2, + 3, + 7, + 0, + 28, + 4, + 1, + 1, + 1, + 6, + 1, + 0, + 7, + 10, + 0, + 1, + 11, + 1, + 8, + 0, + 2, + 1, + 6, + 3, + 2, + 2, + 3, + 3, + 3, + 1, + 0, + 4, + 7, + 5, + 2 + ], + "weighted_loads": [ + 0.046304672956466675, + 0.0, + 0.0, + 0.49611711874604225, + 0.11394238844513893, + 0.03025970794260502, + 0.0, + 0.1368740350008011, + 0.044046707451343536, + 1.0498479939997196, + 0.16458242759108543, + 0.31247421354055405, + 0.12356757745146751, + 0.045978743582963943, + 0.4867473803460598, + 0.8506727702915668, + 0.8432947769761086, + 0.05394351854920387, + 0.33785371482372284, + 0.379511084407568, + 0.16136455535888672, + 0.3253735676407814, + 0.3283091224730015, + 0.27061276882886887, + 0.6725340932607651, + 1.5692632980644703, + 0.3752761706709862, + 0.0, + 4.048488549888134, + 0.17565582692623138, + 0.21933576464653015, + 0.5578749887645245, + 0.0, + 1.6119985785335302, + 0.3967995345592499, + 0.03198055550456047, + 0.055072665214538574, + 0.028078831732273102, + 0.5084300339221954, + 0.0806221142411232, + 0.0, + 0.3779693581163883, + 0.6410999968647957, + 0.0, + 0.02568993717432022, + 0.7588233947753906, + 0.0700959861278534, + 0.42602529004216194, + 0.0, + 0.12453654780983925, + 0.03887495771050453, + 0.4515255503356457, + 0.1729014664888382, + 0.17791693657636642, + 0.08501683920621872, + 0.21314549818634987, + 0.18960903212428093, + 0.19890985265374184, + 0.03927085921168327, + 0.0, + 0.2958479933440685, + 0.5424542427062988, + 0.3524274043738842, + 0.08738410472869873 + ], + "unique_experts": 55, + "load_cv": 1.4678227468063294, + "normalized_load_entropy": 0.841295347861051, + "max_load_share": 0.15384615384615385 + }, + "full_input": { + "tokens": 93, + "top_k": 6, + "decisions": 558, + "ordered_route_sha256": "30a05c75f262714d5c993cd9449b133120ab978375ad4ba834d57f636f1b1935", + "route_weight_sha256": "1b4b92c404b373eacf2a19c4f971ef0c0b9b40bf84c5393fc29d6d056fb49287", + "loads": [ + 2, + 0, + 2, + 7, + 6, + 1, + 0, + 4, + 1, + 14, + 5, + 8, + 7, + 3, + 14, + 12, + 11, + 6, + 12, + 9, + 4, + 7, + 4, + 3, + 9, + 18, + 7, + 20, + 48, + 6, + 11, + 8, + 5, + 46, + 6, + 3, + 3, + 3, + 7, + 1, + 1, + 22, + 14, + 2, + 4, + 16, + 7, + 11, + 8, + 5, + 4, + 21, + 4, + 6, + 2, + 17, + 4, + 9, + 1, + 17, + 14, + 18, + 5, + 3 + ], + "weighted_loads": [ + 0.08092916756868362, + 0.0, + 0.019111032597720623, + 0.49611711874604225, + 0.3142346329987049, + 0.03025970794260502, + 0.0, + 0.17569784447550774, + 0.044046707451343536, + 1.0750327855348587, + 0.24282210692763329, + 0.557812262326479, + 0.3212304972112179, + 1.4214413948357105, + 0.7338603399693966, + 0.8506727702915668, + 0.8432947769761086, + 0.3499835692346096, + 0.7050292203202844, + 0.4262741170823574, + 0.2018068991601467, + 0.4135468788444996, + 0.33223076816648245, + 0.27061276882886887, + 0.7136356085538864, + 1.897470073774457, + 0.44557193107903004, + 1.3591916393488646, + 4.048488549888134, + 0.3652656450867653, + 0.8944324478507042, + 0.5715968506410718, + 0.4934713989496231, + 2.48776688054204, + 0.5403089355677366, + 0.19690906256437302, + 0.14036621525883675, + 0.11520763486623764, + 0.5463526882231236, + 0.0806221142411232, + 0.042539797723293304, + 1.7375154830515385, + 0.7393285240978003, + 0.06819391809403896, + 0.20166751742362976, + 1.0160429626703262, + 0.39934835210442543, + 0.5351768974214792, + 0.6462859362363815, + 0.29026012495160103, + 0.21682659909129143, + 1.327816791832447, + 0.2433052659034729, + 0.4016655869781971, + 0.08501683920621872, + 1.21779640391469, + 0.26252250000834465, + 0.5381691828370094, + 0.03927085921168327, + 1.0866470113396645, + 1.0586569495499134, + 1.6147483810782433, + 0.3524274043738842, + 0.12321250513195992 + ], + "unique_experts": 62, + "load_cv": 1.013056932686902, + "normalized_load_entropy": 0.9061517381068109, + "max_load_share": 0.08602150537634409 + } + }, + "s0_bos": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "191c4e1b4bd8628fb6ce692f3aadba53808fb19331b1e7e24b2f3300f191d82a", + "route_weight_sha256": "34c085c2db1359ead3c6d3f1233204480ac28178778ace0ffb29401e27f18ed1", + "loads": [ + 2, + 0, + 0, + 7, + 2, + 1, + 0, + 2, + 1, + 12, + 3, + 4, + 3, + 1, + 8, + 12, + 11, + 1, + 6, + 8, + 3, + 6, + 2, + 3, + 9, + 15, + 5, + 0, + 48, + 2, + 3, + 8, + 0, + 29, + 4, + 1, + 1, + 1, + 6, + 1, + 0, + 7, + 10, + 0, + 0, + 12, + 2, + 9, + 0, + 3, + 2, + 5, + 3, + 2, + 0, + 3, + 2, + 2, + 0, + 1, + 4, + 7, + 5, + 2 + ], + "weighted_loads": [ + 0.07477391511201859, + 0.0, + 0.0, + 0.4574909880757332, + 0.11318084225058556, + 0.029740585014224052, + 0.0, + 0.10507157444953918, + 0.042913783341646194, + 1.042345229536295, + 0.1620945818722248, + 0.28958747535943985, + 0.13246474787592888, + 0.04647265002131462, + 0.4456198737025261, + 0.8665098808705807, + 0.8966751545667648, + 0.05198615416884422, + 0.34014376997947693, + 0.3742660693824291, + 0.1604854352772236, + 0.3694609999656677, + 0.2747355252504349, + 0.26098041236400604, + 0.7022237405180931, + 1.6085220947861671, + 0.3760220780968666, + 0.0, + 4.090424448251724, + 0.16727148741483688, + 0.2238846868276596, + 0.5872341990470886, + 0.0, + 1.693378672003746, + 0.39950549602508545, + 0.03510463610291481, + 0.05711977556347847, + 0.03321519121527672, + 0.5046415254473686, + 0.07728896290063858, + 0.0, + 0.39302176982164383, + 0.6216960772871971, + 0.0, + 0.0, + 0.8011190444231033, + 0.09274312481284142, + 0.4492633789777756, + 0.0, + 0.1580049693584442, + 0.0738985724747181, + 0.4238468147814274, + 0.18080619350075722, + 0.17601430416107178, + 0.0, + 0.21981140226125717, + 0.14903898164629936, + 0.1662055253982544, + 0.0, + 0.03418121859431267, + 0.3006388731300831, + 0.5701094307005405, + 0.35595762729644775, + 0.08000252395868301 + ], + "unique_experts": 53, + "load_cv": 1.4860738595735488, + "normalized_load_entropy": 0.835331386663976, + "max_load_share": 0.15384615384615385 + }, + "full_input": { + "tokens": 77, + "top_k": 6, + "decisions": 462, + "ordered_route_sha256": "e4d5e6fec96bfb9038bd1beaa2479c28891cc444fdd4742a7727861b9ae054eb", + "route_weight_sha256": "2a7fb26083af4e142d4fb70be64230efb4de733adc0bd73ac3cb3d7f919c8435", + "loads": [ + 2, + 0, + 1, + 7, + 3, + 1, + 0, + 6, + 1, + 13, + 5, + 6, + 4, + 4, + 11, + 12, + 11, + 4, + 12, + 11, + 7, + 8, + 2, + 3, + 9, + 17, + 5, + 7, + 49, + 4, + 5, + 9, + 0, + 37, + 5, + 2, + 1, + 1, + 6, + 1, + 0, + 16, + 14, + 2, + 3, + 15, + 8, + 12, + 0, + 6, + 4, + 11, + 3, + 4, + 0, + 13, + 2, + 8, + 0, + 13, + 9, + 20, + 5, + 2 + ], + "weighted_loads": [ + 0.07477391511201859, + 0.0, + 0.014097096398472786, + 0.4574909880757332, + 0.14330237545073032, + 0.029740585014224052, + 0.0, + 0.2806478925049305, + 0.042913783341646194, + 1.0585875194519758, + 0.25785718113183975, + 0.40411150828003883, + 0.16528740897774696, + 0.5954513810575008, + 0.6449482329189777, + 0.8665098808705807, + 0.8966751545667648, + 0.25145599991083145, + 0.7428796105086803, + 0.5285439342260361, + 0.3457299806177616, + 0.4539817087352276, + 0.2747355252504349, + 0.26098041236400604, + 0.7022237405180931, + 1.6724835503846407, + 0.3760220780968666, + 0.8823128566145897, + 4.1368521228432655, + 0.25654590129852295, + 0.41569895297288895, + 0.600956060923636, + 0.0, + 2.0732328221201897, + 0.4292874988168478, + 0.07209141552448273, + 0.05711977556347847, + 0.03321519121527672, + 0.5046415254473686, + 0.07728896290063858, + 0.0, + 1.6437087841331959, + 0.7772234492003918, + 0.0970296747982502, + 0.197666198015213, + 0.9464399740099907, + 0.36061208695173264, + 0.5655564833432436, + 0.0, + 0.3241572752594948, + 0.1709992103278637, + 0.708431314677, + 0.18080619350075722, + 0.3103451170027256, + 0.0, + 0.9893044345080853, + 0.14903898164629936, + 0.508694127202034, + 0.0, + 0.7472003176808357, + 0.6716156415641308, + 1.7837038710713387, + 0.35595762729644775, + 0.08000252395868301 + ], + "unique_experts": 57, + "load_cv": 1.127130080547124, + "normalized_load_entropy": 0.883320949187793, + "max_load_share": 0.10606060606060606 + } + }, + "s1_bos": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "32566604c56837cf51fbec770aec34b8655530211c0097363d086e481763b145", + "route_weight_sha256": "8723466b31899a8eecf593b7a4d4f63d57fac5fdaa0038633d7ce04f145b899d", + "loads": [ + 2, + 1, + 0, + 8, + 2, + 1, + 0, + 3, + 1, + 12, + 2, + 4, + 3, + 1, + 9, + 13, + 11, + 1, + 6, + 8, + 3, + 6, + 2, + 3, + 8, + 15, + 5, + 0, + 47, + 2, + 3, + 7, + 0, + 27, + 4, + 1, + 1, + 0, + 6, + 2, + 0, + 8, + 10, + 0, + 1, + 12, + 2, + 8, + 0, + 3, + 1, + 5, + 3, + 2, + 1, + 3, + 2, + 2, + 0, + 1, + 4, + 7, + 5, + 2 + ], + "weighted_loads": [ + 0.07311394438147545, + 0.029779614880681038, + 0.0, + 0.5161487497389317, + 0.11527711153030396, + 0.03119424544274807, + 0.0, + 0.13593389093875885, + 0.0445326566696167, + 1.0407144203782082, + 0.10579843074083328, + 0.2981615997850895, + 0.12968022748827934, + 0.044184841215610504, + 0.48193006217479706, + 0.8824160397052765, + 0.8885678090155125, + 0.05628839135169983, + 0.33316826820373535, + 0.355391263961792, + 0.1594158597290516, + 0.3572056479752064, + 0.2940186560153961, + 0.2608115002512932, + 0.6651893816888332, + 1.5931431539356709, + 0.3703456111252308, + 0.0, + 4.090282432734966, + 0.16271336376667023, + 0.2154744490981102, + 0.5514201782643795, + 0.0, + 1.6118980385363102, + 0.40418922156095505, + 0.034143220633268356, + 0.06819160282611847, + 0.0, + 0.506905309855938, + 0.11841356754302979, + 0.0, + 0.4266193136572838, + 0.6190431155264378, + 0.0, + 0.025213507935404778, + 0.8023182228207588, + 0.10615185275673866, + 0.4101978875696659, + 0.0, + 0.15122132748365402, + 0.03488735482096672, + 0.4305054247379303, + 0.17172140255570412, + 0.1702452227473259, + 0.03318467736244202, + 0.21811549738049507, + 0.16022228822112083, + 0.16343630105257034, + 0.0, + 0.035292014479637146, + 0.3025052882730961, + 0.609226044267416, + 0.35293958708643913, + 0.08299294859170914 + ], + "unique_experts": 55, + "load_cv": 1.445253402158149, + "normalized_load_entropy": 0.8431340861544975, + "max_load_share": 0.15064102564102563 + }, + "full_input": { + "tokens": 93, + "top_k": 6, + "decisions": 558, + "ordered_route_sha256": "36a949bc96217a7132aa23c37811e9548057f7b18adff9ee03e526d6610dce82", + "route_weight_sha256": "e8c5fc6261fbc090c6e2396ea8db4fa32cd972cc3f0caef7c27283c3b213b692", + "loads": [ + 2, + 2, + 1, + 8, + 7, + 1, + 0, + 4, + 1, + 13, + 4, + 9, + 7, + 3, + 14, + 13, + 11, + 5, + 11, + 10, + 5, + 8, + 2, + 3, + 9, + 18, + 7, + 21, + 47, + 6, + 11, + 8, + 5, + 45, + 6, + 3, + 3, + 2, + 7, + 2, + 1, + 24, + 12, + 2, + 4, + 17, + 8, + 11, + 8, + 7, + 4, + 20, + 4, + 5, + 1, + 16, + 3, + 8, + 0, + 19, + 14, + 18, + 5, + 3 + ], + "weighted_loads": [ + 0.07311394438147545, + 0.05719372257590294, + 0.014097096398472786, + 0.5161487497389317, + 0.35885197669267654, + 0.03119424544274807, + 0.0, + 0.1747577004134655, + 0.0445326566696167, + 1.056956710293889, + 0.18403811007738113, + 0.5796183533966541, + 0.3273431472480297, + 0.5542408525943756, + 0.7953387461602688, + 0.8824160397052765, + 0.8885678090155125, + 0.3045646399259567, + 0.7366046495735645, + 0.4400685504078865, + 0.25431083887815475, + 0.44537895917892456, + 0.2940186560153961, + 0.2608115002512932, + 0.7062908969819546, + 1.9213499296456575, + 0.44064137153327465, + 1.4296512547880411, + 4.090282432734966, + 0.3444933705031872, + 0.8868106305599213, + 0.5651420401409268, + 0.4934713989496231, + 2.499231429770589, + 0.5476986225694418, + 0.1990717276930809, + 0.15348515287041664, + 0.08712880313396454, + 0.5448279641568661, + 0.11841356754302979, + 0.042539797723293304, + 2.068013809621334, + 0.6648765131831169, + 0.06819391809403896, + 0.23992821760475636, + 1.0595377907156944, + 0.4354042187333107, + 0.5261656735092402, + 0.6462859362363815, + 0.3789200410246849, + 0.21283899620175362, + 1.2819730825722218, + 0.24212520197033882, + 0.33887604624032974, + 0.03318467736244202, + 1.1937707215547562, + 0.23313575610518456, + 0.5026956312358379, + 0.0, + 1.1961888819932938, + 1.0612973608076572, + 1.6883738972246647, + 0.35293958708643913, + 0.11882134899497032 + ], + "unique_experts": 62, + "load_cv": 1.008583299403762, + "normalized_load_entropy": 0.9049716742462186, + "max_load_share": 0.08422939068100359 + } + }, + "s0_x": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "07d0f0aef7708c04f28c0f37f52e4223ae29b437afb541808d3d12b11a0a423f", + "route_weight_sha256": "2e714f268aca2b1f30432ed9f0901835309645dcfdc8c1c6ad222d76fef99aa9", + "loads": [ + 1, + 0, + 0, + 6, + 4, + 0, + 0, + 3, + 1, + 11, + 3, + 4, + 3, + 1, + 9, + 12, + 11, + 1, + 6, + 4, + 4, + 5, + 3, + 4, + 9, + 15, + 5, + 0, + 47, + 2, + 3, + 8, + 0, + 31, + 4, + 1, + 1, + 1, + 6, + 1, + 0, + 8, + 10, + 0, + 1, + 11, + 2, + 8, + 0, + 4, + 1, + 6, + 3, + 2, + 0, + 3, + 2, + 2, + 1, + 0, + 4, + 7, + 5, + 2 + ], + "weighted_loads": [ + 0.05326233059167862, + 0.0, + 0.0, + 0.42099015414714813, + 0.19833208620548248, + 0.0, + 0.0, + 0.14684955030679703, + 0.038107551634311676, + 1.005201667547226, + 0.16246559470891953, + 0.29917243868112564, + 0.13144441321492195, + 0.04599197953939438, + 0.45981133729219437, + 0.8748695589601994, + 0.9085713140666485, + 0.05215265601873398, + 0.3292926698923111, + 0.20279718935489655, + 0.19186653196811676, + 0.33083630725741386, + 0.31062671542167664, + 0.30747444555163383, + 0.722113374620676, + 1.6167148128151894, + 0.36894019693136215, + 0.0, + 4.071890503168106, + 0.16964708268642426, + 0.23019855469465256, + 0.5562251955270767, + 0.0, + 1.7805159501731396, + 0.3881443440914154, + 0.05572298541665077, + 0.05210226774215698, + 0.03289107605814934, + 0.5134538859128952, + 0.07715968787670135, + 0.0, + 0.4503779709339142, + 0.6179990470409393, + 0.0, + 0.025504866614937782, + 0.7594587132334709, + 0.09550618380308151, + 0.40469635650515556, + 0.0, + 0.20083178207278252, + 0.03452819213271141, + 0.4718649573624134, + 0.17623069882392883, + 0.18268036842346191, + 0.0, + 0.22408828884363174, + 0.14486181735992432, + 0.15974869579076767, + 0.03766518086194992, + 0.0, + 0.30314548313617706, + 0.576483715325594, + 0.356247927993536, + 0.08030203357338905 + ], + "unique_experts": 53, + "load_cv": 1.4794227422309392, + "normalized_load_entropy": 0.8368236799633365, + "max_load_share": 0.15064102564102563 + }, + "full_input": { + "tokens": 77, + "top_k": 6, + "decisions": 462, + "ordered_route_sha256": "9191ebbd8ea226bff1f63a098146e71ba2ef5d697b05b54f23e78a5b9b244f8d", + "route_weight_sha256": "6fbf67d1687aeb1b96873ab01ed29ba029b07ac20c9e46ed53e737e72d8bc0cd", + "loads": [ + 2, + 1, + 1, + 6, + 4, + 0, + 0, + 8, + 1, + 12, + 5, + 7, + 4, + 3, + 11, + 12, + 11, + 5, + 11, + 6, + 7, + 7, + 3, + 4, + 9, + 17, + 5, + 5, + 48, + 4, + 5, + 9, + 0, + 40, + 5, + 2, + 1, + 1, + 6, + 1, + 0, + 16, + 13, + 2, + 5, + 15, + 9, + 12, + 0, + 6, + 3, + 12, + 3, + 4, + 0, + 13, + 2, + 9, + 1, + 11, + 9, + 21, + 5, + 2 + ], + "weighted_loads": [ + 0.09757034480571747, + 0.03820816054940224, + 0.014097096398472786, + 0.42099015414714813, + 0.19833208620548248, + 0.0, + 0.0, + 0.3616899512708187, + 0.038107551634311676, + 1.0214439574629068, + 0.25822819396853447, + 0.4616052769124508, + 0.16426707431674004, + 0.5510139279067516, + 0.6098511330783367, + 0.8748695589601994, + 0.9085713140666485, + 0.28731971606612206, + 0.6680393032729626, + 0.3214469328522682, + 0.3049033433198929, + 0.4153570160269737, + 0.31062671542167664, + 0.30747444555163383, + 0.722113374620676, + 1.680676268413663, + 0.36894019693136215, + 0.6816448085010052, + 4.118318177759647, + 0.2573798820376396, + 0.4346010908484459, + 0.5699470574036241, + 0.0, + 2.202526278793812, + 0.41792634688317776, + 0.09270976483821869, + 0.05210226774215698, + 0.03289107605814934, + 0.5134538859128952, + 0.07715968787670135, + 0.0, + 1.4194310791790485, + 0.7229271307587624, + 0.0970296747982502, + 0.23875375278294086, + 0.9749103337526321, + 0.4135487899184227, + 0.5619600918143988, + 0.0, + 0.2911827564239502, + 0.131628829985857, + 0.7996850274503231, + 0.17623069882392883, + 0.31433042511343956, + 0.0, + 0.9177847132086754, + 0.14486181735992432, + 0.5653256997466087, + 0.03766518086194992, + 0.688063520938158, + 0.6695635840296745, + 1.8580699861049652, + 0.356247927993536, + 0.08030203357338905 + ], + "unique_experts": 58, + "load_cv": 1.132967508150373, + "normalized_load_entropy": 0.8853471731653957, + "max_load_share": 0.1038961038961039 + } + }, + "s1_x": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "cfe2e6af055a59218f09aa92c6e9564fe17d545064e3b00a7dce29cc69cebc17", + "route_weight_sha256": "ae114f46c611c1f2ad96834ae45f01739fb7a3646837c1da04b60cd086375d2e", + "loads": [ + 1, + 0, + 0, + 8, + 3, + 1, + 0, + 3, + 1, + 12, + 3, + 5, + 3, + 1, + 10, + 12, + 11, + 1, + 6, + 6, + 3, + 5, + 3, + 3, + 8, + 15, + 5, + 0, + 47, + 2, + 3, + 7, + 0, + 26, + 4, + 1, + 1, + 2, + 6, + 2, + 0, + 8, + 10, + 0, + 0, + 13, + 2, + 9, + 0, + 1, + 1, + 6, + 3, + 2, + 0, + 3, + 3, + 2, + 1, + 0, + 4, + 7, + 5, + 2 + ], + "weighted_loads": [ + 0.05011661723256111, + 0.0, + 0.0, + 0.5264225341379642, + 0.16491186246275902, + 0.03343017399311066, + 0.0, + 0.1371610164642334, + 0.03976602107286453, + 1.0333715789020061, + 0.1588086634874344, + 0.3301561623811722, + 0.12698832526803017, + 0.044483035802841187, + 0.5253591574728489, + 0.807570431381464, + 0.8826306611299515, + 0.05828036367893219, + 0.3284720443189144, + 0.26836875081062317, + 0.15344443544745445, + 0.3245205394923687, + 0.3224482387304306, + 0.27358829230070114, + 0.6898570954799652, + 1.5571419224143028, + 0.3663633018732071, + 0.0, + 4.111274596303701, + 0.16109448671340942, + 0.21669786050915718, + 0.5117886625230312, + 0.0, + 1.4980723205953836, + 0.3825439587235451, + 0.03320403769612312, + 0.06201593205332756, + 0.053324757143855095, + 0.5066467672586441, + 0.1199999526143074, + 0.0, + 0.4322798103094101, + 0.6114517040550709, + 0.0, + 0.0, + 0.8507036156952381, + 0.1058000847697258, + 0.4338453821837902, + 0.0, + 0.07636412978172302, + 0.035788290202617645, + 0.46441350132226944, + 0.16914679110050201, + 0.16987394541502, + 0.0, + 0.21891145035624504, + 0.2018800936639309, + 0.16507937014102936, + 0.03819958493113518, + 0.0, + 0.30509521439671516, + 0.6066219843924046, + 0.35610243305563927, + 0.08442483842372894 + ], + "unique_experts": 53, + "load_cv": 1.4393274051985834, + "normalized_load_entropy": 0.8407661219197844, + "max_load_share": 0.15064102564102563 + }, + "full_input": { + "tokens": 93, + "top_k": 6, + "decisions": 558, + "ordered_route_sha256": "eaddd48d79af3aaadac660a68c0f87866e70d847a40090420308d8b63fe3bce2", + "route_weight_sha256": "8960642d232fae4a2351c987c644afdf31f0b5d0b79c309ee89c3553c3902515", + "loads": [ + 2, + 1, + 1, + 8, + 8, + 1, + 0, + 5, + 1, + 13, + 6, + 10, + 7, + 2, + 15, + 12, + 11, + 6, + 10, + 7, + 4, + 7, + 3, + 3, + 9, + 18, + 7, + 18, + 47, + 6, + 12, + 8, + 5, + 44, + 6, + 3, + 3, + 4, + 7, + 2, + 1, + 23, + 13, + 2, + 2, + 19, + 9, + 13, + 8, + 4, + 6, + 21, + 4, + 6, + 0, + 14, + 4, + 9, + 1, + 16, + 14, + 19, + 5, + 3 + ], + "weighted_loads": [ + 0.08893725275993347, + 0.04658631235361099, + 0.014097096398472786, + 0.5264225341379642, + 0.4173377528786659, + 0.03343017399311066, + 0.0, + 0.22520528361201286, + 0.03976602107286453, + 1.049613868817687, + 0.2853497564792633, + 0.6180365718901157, + 0.32465124502778053, + 0.514616996049881, + 0.8513443283736706, + 0.807570431381464, + 0.8826306611299515, + 0.3299781456589699, + 0.6557951793074608, + 0.3056376203894615, + 0.19388677924871445, + 0.4126938506960869, + 0.3224482387304306, + 0.27358829230070114, + 0.7309586107730865, + 1.8853486981242895, + 0.43665906228125095, + 1.2199847977608442, + 4.111274596303701, + 0.3434903584420681, + 0.9395755156874657, + 0.5255105243995786, + 0.4934713989496231, + 2.3915242962539196, + 0.5260533597320318, + 0.19813254475593567, + 0.14730948209762573, + 0.14045356027781963, + 0.5445694215595722, + 0.1199999526143074, + 0.042539797723293304, + 1.6930993273854256, + 0.6875917818397284, + 0.06819391809403896, + 0.14202117547392845, + 1.171044711023569, + 0.5027133114635944, + 0.5991268809884787, + 0.6462859362363815, + 0.2517375238239765, + 0.3227928504347801, + 1.3670682683587074, + 0.23955059051513672, + 0.36934778094291687, + 0.0, + 1.0147438496351242, + 0.2747935615479946, + 0.557071927934885, + 0.03819958493113518, + 1.0650451108813286, + 1.0370218306779861, + 1.7562290616333485, + 0.35610243305563927, + 0.12025323882699013 + ], + "unique_experts": 62, + "load_cv": 0.9927668418291004, + "normalized_load_entropy": 0.9069876423449807, + "max_load_share": 0.08422939068100359 + } + }, + "s0_period": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "e1ffa0c1290b246713be79b580e956cdbca60fa57d58082db7cf67919699b56e", + "route_weight_sha256": "e9a5cf8fab1f482f76521d3af750ec9c9d05d08f5caa2cb4afddb2f8ea0bac78", + "loads": [ + 1, + 0, + 1, + 6, + 4, + 0, + 0, + 3, + 0, + 12, + 3, + 4, + 3, + 1, + 10, + 12, + 11, + 1, + 6, + 6, + 3, + 5, + 3, + 4, + 9, + 15, + 5, + 0, + 47, + 2, + 3, + 8, + 1, + 28, + 4, + 1, + 1, + 1, + 6, + 1, + 0, + 8, + 10, + 0, + 1, + 11, + 2, + 8, + 0, + 2, + 2, + 6, + 3, + 2, + 0, + 3, + 2, + 2, + 1, + 0, + 4, + 7, + 5, + 2 + ], + "weighted_loads": [ + 0.050462063401937485, + 0.0, + 0.04821893945336342, + 0.43642351031303406, + 0.20471403375267982, + 0.0, + 0.0, + 0.14734632149338722, + 0.0, + 1.0503131002187729, + 0.15950291231274605, + 0.30683013796806335, + 0.1329893358051777, + 0.04610802233219147, + 0.4901581760495901, + 0.8851044215261936, + 0.9045828580856323, + 0.05175468325614929, + 0.34126532077789307, + 0.28114189952611923, + 0.16064810380339622, + 0.33150124177336693, + 0.3173488527536392, + 0.3059031590819359, + 0.7211861461400986, + 1.6050798147916794, + 0.37970272824168205, + 0.0, + 4.0645791962742805, + 0.16862714290618896, + 0.22253131866455078, + 0.5637407153844833, + 0.041175439953804016, + 1.5765896532684565, + 0.3900267332792282, + 0.057709950953722, + 0.054699137806892395, + 0.033652324229478836, + 0.5250327810645103, + 0.07887838035821915, + 0.0, + 0.4512661062180996, + 0.6257054880261421, + 0.0, + 0.026223476976156235, + 0.7617182247340679, + 0.0947253666818142, + 0.42599572986364365, + 0.0, + 0.1267821192741394, + 0.07285511493682861, + 0.4730970673263073, + 0.1707751527428627, + 0.1835024356842041, + 0.0, + 0.22591006755828857, + 0.1467217206954956, + 0.1595234051346779, + 0.04005986824631691, + 0.0, + 0.3038944788277149, + 0.5760611295700073, + 0.355633158236742, + 0.08480216562747955 + ], + "unique_experts": 54, + "load_cv": 1.4502487940901818, + "normalized_load_entropy": 0.8416600726761322, + "max_load_share": 0.15064102564102563 + }, + "full_input": { + "tokens": 77, + "top_k": 6, + "decisions": 462, + "ordered_route_sha256": "e6939cd66a929c3fe5fc628adeaf2a98840d3a01010b38c8c0dc228542f16288", + "route_weight_sha256": "99c0cb0e098ceb45f628af9bc1ddda879f2733cebbdbf42d77545ee26cb10ecb", + "loads": [ + 2, + 0, + 2, + 6, + 5, + 0, + 0, + 7, + 0, + 13, + 5, + 6, + 5, + 3, + 12, + 12, + 11, + 4, + 11, + 8, + 6, + 7, + 3, + 4, + 9, + 17, + 5, + 6, + 48, + 4, + 6, + 9, + 1, + 36, + 5, + 2, + 1, + 1, + 6, + 1, + 0, + 17, + 13, + 2, + 4, + 15, + 8, + 11, + 0, + 5, + 4, + 13, + 3, + 5, + 0, + 13, + 2, + 9, + 1, + 11, + 10, + 20, + 5, + 2 + ], + "weighted_loads": [ + 0.0836717002093792, + 0.0, + 0.062316035851836205, + 0.43642351031303406, + 0.23703601583838463, + 0.0, + 0.0, + 0.32292263954877853, + 0.0, + 1.0665553901344538, + 0.255265511572361, + 0.4268213324248791, + 0.2027619145810604, + 0.5511299706995487, + 0.6362238097935915, + 0.8851044215261936, + 0.9045828580856323, + 0.2571580484509468, + 0.6800119541585445, + 0.39634429290890694, + 0.27368491515517235, + 0.4160219505429268, + 0.3173488527536392, + 0.3059031590819359, + 0.7211861461400986, + 1.669041270390153, + 0.37970272824168205, + 0.7124479487538338, + 4.111006870865822, + 0.2574225813150406, + 0.498881995677948, + 0.5774625772610307, + 0.041175439953804016, + 1.9451186899095774, + 0.41980873607099056, + 0.09469673037528992, + 0.054699137806892395, + 0.033652324229478836, + 0.5250327810645103, + 0.07887838035821915, + 0.0, + 1.4989263862371445, + 0.7306335717439651, + 0.0970296747982502, + 0.19285688921809196, + 0.9508288353681564, + 0.3625943288207054, + 0.5434850845485926, + 0.0, + 0.2727595940232277, + 0.1699557527899742, + 0.8684777170419693, + 0.1707751527428627, + 0.35769088566303253, + 0.0, + 0.9422308877110481, + 0.1467217206954956, + 0.5754242464900017, + 0.04005986824631691, + 0.7091194093227386, + 0.7219088599085808, + 1.80091667547822, + 0.355633158236742, + 0.08480216562747955 + ], + "unique_experts": 57, + "load_cv": 1.1002060385838845, + "normalized_load_entropy": 0.8882789616912118, + "max_load_share": 0.1038961038961039 + } + }, + "s1_period": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "dab8440e0212abae3e73f6faa4604eee6207a7b224c86962476a149da9514ebc", + "route_weight_sha256": "2169081d6b3ada018fa8b5df6421a54b2f5087068df273e40acebcc350016d09", + "loads": [ + 1, + 0, + 0, + 8, + 3, + 1, + 0, + 3, + 0, + 12, + 2, + 3, + 3, + 1, + 9, + 13, + 11, + 1, + 6, + 8, + 3, + 5, + 2, + 3, + 8, + 14, + 5, + 0, + 47, + 2, + 3, + 8, + 0, + 25, + 4, + 2, + 1, + 2, + 6, + 3, + 0, + 8, + 10, + 0, + 1, + 14, + 2, + 9, + 0, + 1, + 1, + 6, + 3, + 2, + 0, + 3, + 3, + 2, + 1, + 0, + 4, + 7, + 5, + 2 + ], + "weighted_loads": [ + 0.04964173585176468, + 0.0, + 0.0, + 0.5405727289617062, + 0.1576603688299656, + 0.032366346567869186, + 0.0, + 0.1363757625222206, + 0.0, + 1.0343584828078747, + 0.10176077485084534, + 0.2593410536646843, + 0.12710761278867722, + 0.04465777054429054, + 0.4796130992472172, + 0.8498697467148304, + 0.8778653591871262, + 0.06068844348192215, + 0.3331207446753979, + 0.354292344301939, + 0.15513231977820396, + 0.32440996542572975, + 0.26968955993652344, + 0.27683138847351074, + 0.6890654377639294, + 1.5246934182941914, + 0.37706733122467995, + 0.0, + 4.0789407677948475, + 0.16216891258955002, + 0.21543490141630173, + 0.5516906306147575, + 0.0, + 1.4793778154999018, + 0.3838372230529785, + 0.08368805795907974, + 0.057269394397735596, + 0.053887227550148964, + 0.5157053992152214, + 0.1622045561671257, + 0.0, + 0.43284593895077705, + 0.6143319420516491, + 0.0, + 0.026175010949373245, + 0.8885550871491432, + 0.10609637573361397, + 0.4406701810657978, + 0.0, + 0.07785793393850327, + 0.035664308816194534, + 0.4674043096601963, + 0.16947339847683907, + 0.17201561480760574, + 0.0, + 0.21669361367821693, + 0.19632410258054733, + 0.15680436789989471, + 0.03922570124268532, + 0.0, + 0.2969534397125244, + 0.6037922091782093, + 0.3514138460159302, + 0.08209617808461189 + ], + "unique_experts": 53, + "load_cv": 1.434293976507384, + "normalized_load_entropy": 0.8410828179248747, + "max_load_share": 0.15064102564102563 + }, + "full_input": { + "tokens": 93, + "top_k": 6, + "decisions": 558, + "ordered_route_sha256": "ec631869edf417ccef76859afeba14208130c939670863e29cc6ac56b360828d", + "route_weight_sha256": "c1ed2a167a9786fc459d86d17caf75338d47e4b8c4c61ef2899fb1ddb1710165", + "loads": [ + 1, + 1, + 1, + 9, + 8, + 1, + 0, + 4, + 0, + 13, + 4, + 8, + 7, + 2, + 14, + 13, + 11, + 6, + 10, + 9, + 4, + 7, + 2, + 3, + 9, + 17, + 7, + 18, + 47, + 6, + 13, + 9, + 5, + 43, + 6, + 4, + 3, + 4, + 7, + 3, + 1, + 24, + 12, + 2, + 3, + 20, + 8, + 13, + 8, + 4, + 5, + 22, + 4, + 6, + 0, + 15, + 4, + 9, + 1, + 16, + 15, + 19, + 5, + 3 + ], + "weighted_loads": [ + 0.04964173585176468, + 0.034368835389614105, + 0.014097096398472786, + 0.5972388498485088, + 0.41403330862522125, + 0.032366346567869186, + 0.0, + 0.17519957199692726, + 0.0, + 1.0506007727235556, + 0.1800004541873932, + 0.5498404875397682, + 0.3247705325484276, + 0.5147917307913303, + 0.7845292538404465, + 0.8498697467148304, + 0.8778653591871262, + 0.3910822309553623, + 0.6604438796639442, + 0.393248088657856, + 0.19557466357946396, + 0.41258327662944794, + 0.26968955993652344, + 0.27683138847351074, + 0.7301669530570507, + 1.852900194004178, + 0.4473630916327238, + 1.2267365138977766, + 4.0789407677948475, + 0.3449162244796753, + 1.0349053516983986, + 0.5654124924913049, + 0.4934713989496231, + 2.3535189405083656, + 0.5273466240614653, + 0.2486165650188923, + 0.14256294444203377, + 0.1410160306841135, + 0.5536280535161495, + 0.1622045561671257, + 0.042539797723293304, + 1.7449014484882355, + 0.6601653397083282, + 0.06819391809403896, + 0.1681961864233017, + 1.1831655502319336, + 0.435348741710186, + 0.6048190388828516, + 0.6462859362363815, + 0.24257544800639153, + 0.28725740686059, + 1.4602663852274418, + 0.23987719789147377, + 0.37516508996486664, + 0.0, + 1.0696929432451725, + 0.26923757046461105, + 0.6266558952629566, + 0.03922570124268532, + 1.043523170053959, + 1.065979264676571, + 1.7327753454446793, + 0.3514138460159302, + 0.11792457848787308 + ], + "unique_experts": 61, + "load_cv": 0.9971053027909039, + "normalized_load_entropy": 0.9043916308826276, + "max_load_share": 0.08422939068100359 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 52, + "ordered_topk_exact_tokens": 40, + "set_exact_tokens": 45, + "mean_set_jaccard": 0.9615384615384616, + "mean_token_weighted_tv": 0.0119484077530125, + "aggregate_load_tv": 0.009615384615384616 + }, + "system_bos": { + "tokens": 52, + "ordered_topk_exact_tokens": 37, + "set_exact_tokens": 42, + "mean_set_jaccard": 0.9450549450549453, + "mean_token_weighted_tv": 0.01759799111347932, + "aggregate_load_tv": 0.028846153846153855 + }, + "system_x": { + "tokens": 52, + "ordered_topk_exact_tokens": 27, + "set_exact_tokens": 36, + "mean_set_jaccard": 0.9120879120879122, + "mean_token_weighted_tv": 0.02316551155840548, + "aggregate_load_tv": 0.04487179487179487 + }, + "system_period": { + "tokens": 52, + "ordered_topk_exact_tokens": 29, + "set_exact_tokens": 36, + "mean_set_jaccard": 0.9120879120879122, + "mean_token_weighted_tv": 0.022653762000397995, + "aggregate_load_tv": 0.04807692307692307 + }, + "bos_at_s0": { + "tokens": 52, + "ordered_topk_exact_tokens": 32, + "set_exact_tokens": 40, + "mean_set_jaccard": 0.9340659340659341, + "mean_token_weighted_tv": 0.02144889307853121, + "aggregate_load_tv": 0.028846153846153855 + }, + "bos_at_s1": { + "tokens": 52, + "ordered_topk_exact_tokens": 25, + "set_exact_tokens": 35, + "mean_set_jaccard": 0.9065934065934068, + "mean_token_weighted_tv": 0.026210763008118823, + "aggregate_load_tv": 0.03525641025641027 + }, + "x_at_s0": { + "tokens": 52, + "ordered_topk_exact_tokens": 27, + "set_exact_tokens": 33, + "mean_set_jaccard": 0.8956043956043958, + "mean_token_weighted_tv": 0.027893102835290708, + "aggregate_load_tv": 0.04807692307692309 + }, + "x_at_s1": { + "tokens": 52, + "ordered_topk_exact_tokens": 27, + "set_exact_tokens": 39, + "mean_set_jaccard": 0.9285714285714286, + "mean_token_weighted_tv": 0.024190465167451363, + "aggregate_load_tv": 0.032051282051282055 + }, + "period_at_s0": { + "tokens": 52, + "ordered_topk_exact_tokens": 27, + "set_exact_tokens": 36, + "mean_set_jaccard": 0.9120879120879122, + "mean_token_weighted_tv": 0.0251683745569048, + "aggregate_load_tv": 0.03525641025641027 + }, + "period_at_s1": { + "tokens": 52, + "ordered_topk_exact_tokens": 25, + "set_exact_tokens": 35, + "mean_set_jaccard": 0.9024725274725275, + "mean_token_weighted_tv": 0.027676656519850858, + "aggregate_load_tv": 0.04487179487179487 + } + } + }, + "layer_11": { + "layer": 11, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "00dacce188f8f31d5d8c8f86236d95f5ad63bd4e7de6839c6c9514055ff24d9e", + "route_weight_sha256": "cf98cb66546b42acb1f40742c8a416042f493b440124eacf413d7767d81894a3", + "loads": [ + 4, + 0, + 6, + 3, + 8, + 7, + 4, + 3, + 2, + 0, + 1, + 1, + 0, + 7, + 9, + 1, + 2, + 1, + 0, + 2, + 1, + 3, + 1, + 2, + 1, + 3, + 4, + 9, + 2, + 30, + 2, + 0, + 4, + 12, + 22, + 2, + 4, + 0, + 4, + 8, + 25, + 0, + 9, + 0, + 3, + 1, + 2, + 1, + 1, + 19, + 5, + 7, + 8, + 0, + 4, + 1, + 1, + 7, + 4, + 27, + 3, + 9, + 0, + 0 + ], + "weighted_loads": [ + 0.2506537586450577, + 0.0, + 0.47837085649371147, + 0.1519549861550331, + 0.5205384306609631, + 0.4255118928849697, + 0.25774025544524193, + 0.2032669484615326, + 0.1592913344502449, + 0.0, + 0.038888826966285706, + 0.040984585881233215, + 0.0, + 0.5509978234767914, + 0.4902047775685787, + 0.04180775210261345, + 0.08157183974981308, + 0.03969584032893181, + 0.0, + 0.07470434159040451, + 0.04726646840572357, + 0.2082236409187317, + 0.03172731399536133, + 0.12086867168545723, + 0.036604490131139755, + 0.17892376706004143, + 0.18323056027293205, + 0.49015235155820847, + 0.06255869939923286, + 2.190782565623522, + 0.14526715129613876, + 0.0, + 0.209621824324131, + 0.8489421904087067, + 1.7805299796164036, + 0.17449532821774483, + 0.2329605482518673, + 0.0, + 0.2036767452955246, + 0.45647560618817806, + 1.795461941510439, + 0.0, + 0.5640560910105705, + 0.0, + 0.14510367065668106, + 0.06061564385890961, + 0.07006732374429703, + 0.050041183829307556, + 0.052076008170843124, + 1.7726658843457699, + 0.2926596887409687, + 0.632331807166338, + 0.5645296797156334, + 0.0, + 0.16523131355643272, + 0.03124995157122612, + 0.04700928553938866, + 0.3597597610205412, + 0.1973266676068306, + 2.1534246429800987, + 0.08376861363649368, + 0.4846730213612318, + 0.0, + 0.0 + ], + "unique_experts": 53, + "load_cv": 1.3375180877687156, + "normalized_load_entropy": 0.8392899360996801, + "max_load_share": 0.09615384615384616 + }, + "full_input": { + "tokens": 77, + "top_k": 6, + "decisions": 462, + "ordered_route_sha256": "65322157ed2d7a0917fcb9ed6c31525f3a35ee704f7507039b3f4f53b837afc2", + "route_weight_sha256": "216d187d8b5c7a4b85bff5bebf0c6f6fdf7f9238dcc2d70cd5484d3b9e7fab06", + "loads": [ + 4, + 0, + 7, + 3, + 13, + 7, + 4, + 3, + 6, + 1, + 4, + 4, + 0, + 7, + 9, + 7, + 7, + 3, + 12, + 2, + 1, + 3, + 2, + 7, + 1, + 4, + 5, + 10, + 8, + 30, + 8, + 8, + 6, + 12, + 26, + 5, + 4, + 0, + 4, + 8, + 31, + 0, + 9, + 22, + 6, + 1, + 2, + 9, + 1, + 21, + 5, + 8, + 8, + 0, + 10, + 6, + 1, + 7, + 7, + 28, + 4, + 13, + 8, + 0 + ], + "weighted_loads": [ + 0.2506537586450577, + 0.0, + 0.5364216044545174, + 0.1519549861550331, + 0.7448404096066952, + 0.4255118928849697, + 0.25774025544524193, + 0.2032669484615326, + 0.4167700260877609, + 0.03038082830607891, + 0.11060627782717347, + 0.09485776256769896, + 0.0, + 0.5509978234767914, + 0.4902047775685787, + 0.2742169313132763, + 0.621055506169796, + 0.06960411462932825, + 2.0730249993503094, + 0.07470434159040451, + 0.04726646840572357, + 0.2082236409187317, + 0.035688336938619614, + 0.3739730976521969, + 0.036604490131139755, + 0.2804229222238064, + 0.18660324648953974, + 0.5026875659823418, + 0.5045588091015816, + 2.190782565623522, + 0.4415629394352436, + 0.3565845526754856, + 0.27411425299942493, + 0.8489421904087067, + 1.9485089182853699, + 0.4428494982421398, + 0.2329605482518673, + 0.0, + 0.2036767452955246, + 0.45647560618817806, + 2.115157190710306, + 0.0, + 0.5640560910105705, + 2.1154257878661156, + 0.3094653747975826, + 0.06061564385890961, + 0.07006732374429703, + 0.6452708691358566, + 0.052076008170843124, + 1.8680853843688965, + 0.2926596887409687, + 0.7345625273883343, + 0.5645296797156334, + 0.0, + 0.48627587873488665, + 0.246401347219944, + 0.04700928553938866, + 0.3597597610205412, + 0.3350933641195297, + 2.193024206906557, + 0.11548106744885445, + 0.6629462838172913, + 0.4945526607334614, + 0.0 + ], + "unique_experts": 58, + "load_cv": 0.9827411925296188, + "normalized_load_entropy": 0.9004982701862014, + "max_load_share": 0.0670995670995671 + } + }, + "s1_eos": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "de494be18b64605c7e20323918ba293ca850909e79766f8ba80cb4ff9e173662", + "route_weight_sha256": "362f80fafe79613f63995f5e95e0c3ab13b3798a0261627fd84c4b266c581704", + "loads": [ + 4, + 0, + 6, + 4, + 8, + 7, + 4, + 3, + 2, + 0, + 1, + 1, + 0, + 7, + 9, + 1, + 3, + 1, + 0, + 2, + 2, + 3, + 1, + 2, + 1, + 2, + 5, + 9, + 2, + 31, + 2, + 0, + 4, + 12, + 21, + 2, + 4, + 0, + 4, + 8, + 25, + 0, + 7, + 0, + 3, + 2, + 1, + 1, + 1, + 19, + 5, + 7, + 8, + 0, + 4, + 1, + 1, + 7, + 4, + 26, + 1, + 11, + 0, + 0 + ], + "weighted_loads": [ + 0.2536660358309746, + 0.0, + 0.46835678815841675, + 0.2098260410130024, + 0.5179204903542995, + 0.4271903596818447, + 0.2542361691594124, + 0.20423021912574768, + 0.15864484757184982, + 0.0, + 0.03908245265483856, + 0.03861445561051369, + 0.0, + 0.5557078495621681, + 0.4823354557156563, + 0.042247023433446884, + 0.11290651932358742, + 0.04252277687191963, + 0.0, + 0.08060228452086449, + 0.07329997979104519, + 0.19840572029352188, + 0.032191623002290726, + 0.12104811146855354, + 0.03779352828860283, + 0.1393018290400505, + 0.21918988227844238, + 0.4833962842822075, + 0.06037856079638004, + 2.2314383238554, + 0.13078732416033745, + 0.0, + 0.20462167635560036, + 0.8144909925758839, + 1.7270777523517609, + 0.1719612553715706, + 0.22514940425753593, + 0.0, + 0.2002832628786564, + 0.4515684489160776, + 1.7780263908207417, + 0.0, + 0.4705023430287838, + 0.0, + 0.14097148552536964, + 0.08953668922185898, + 0.037742793560028076, + 0.05011364072561264, + 0.05277532711625099, + 1.7618945352733135, + 0.29795949161052704, + 0.6199786737561226, + 0.5645391643047333, + 0.0, + 0.15972011163830757, + 0.03282677009701729, + 0.04619563743472099, + 0.36736734956502914, + 0.19597797840833664, + 2.084807403385639, + 0.032668616622686386, + 0.551972659304738, + 0.0, + 0.0 + ], + "unique_experts": 53, + "load_cv": 1.3335798588662404, + "normalized_load_entropy": 0.8397811455874538, + "max_load_share": 0.09935897435897435 + }, + "full_input": { + "tokens": 93, + "top_k": 6, + "decisions": 558, + "ordered_route_sha256": "79cacaa31814dd7520ef87a832cf84d39cc8fb05a5a8f3c831fa885d6de58103", + "route_weight_sha256": "e82dde2f5132d5f2f8c193aa62f13c6bf034401a7ad8c40e352d683dc038214a", + "loads": [ + 6, + 1, + 7, + 4, + 18, + 10, + 4, + 5, + 12, + 0, + 5, + 4, + 0, + 7, + 9, + 3, + 22, + 3, + 11, + 3, + 3, + 4, + 4, + 6, + 1, + 3, + 8, + 11, + 12, + 31, + 11, + 7, + 5, + 12, + 26, + 7, + 4, + 0, + 4, + 9, + 31, + 0, + 7, + 27, + 5, + 2, + 2, + 14, + 1, + 22, + 5, + 8, + 8, + 5, + 23, + 12, + 7, + 8, + 6, + 30, + 2, + 19, + 11, + 1 + ], + "weighted_loads": [ + 0.40039240568876266, + 0.03271032124757767, + 0.5141906999051571, + 0.2098260410130024, + 1.0633065775036812, + 0.5355096161365509, + 0.2542361691594124, + 0.33308812230825424, + 0.7851884253323078, + 0.0, + 0.1537721548229456, + 0.09177037514746189, + 0.0, + 0.5557078495621681, + 0.4823354557156563, + 0.11394042149186134, + 1.7951885089278221, + 0.07162514887750149, + 2.0635831579566, + 0.1195027120411396, + 0.14508464001119137, + 0.26972198486328125, + 0.14389655785635114, + 0.29831743985414505, + 0.03779352828860283, + 0.2231036126613617, + 0.2994954416062683, + 0.533743504434824, + 0.794430723413825, + 2.2314383238554, + 0.5826098937541246, + 0.2886345759034157, + 0.23762879893183708, + 0.8144909925758839, + 1.948990311473608, + 0.6509299874305725, + 0.22514940425753593, + 0.0, + 0.2002832628786564, + 0.49841116555035114, + 2.074664629995823, + 0.0, + 0.4705023430287838, + 2.4575459994375706, + 0.26065536960959435, + 0.08953668922185898, + 0.08378320559859276, + 1.0457267761230469, + 0.05277532711625099, + 1.983133364468813, + 0.29795949161052704, + 0.7143603414297104, + 0.5645391643047333, + 0.3046531714498997, + 1.3501118095591664, + 0.5384670048952103, + 0.5151668079197407, + 0.4106903746724129, + 0.2987732104957104, + 2.2536355294287205, + 0.07034694030880928, + 0.9018131401389837, + 0.5738236233592033, + 0.040536053478717804 + ], + "unique_experts": 60, + "load_cv": 0.9115999692434543, + "normalized_load_entropy": 0.9099547835819844, + "max_load_share": 0.05555555555555555 + } + }, + "s0_bos": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "10a9f8b280458df6e0e553c61096d267bae381bd843f587c633eea4d936707bc", + "route_weight_sha256": "37a34b4249abde31316a86da66593d7c6ccf4c5649c780ab1e9ba25d77771bef", + "loads": [ + 4, + 0, + 6, + 3, + 9, + 6, + 4, + 2, + 2, + 0, + 1, + 1, + 1, + 7, + 9, + 1, + 4, + 1, + 0, + 4, + 1, + 3, + 2, + 2, + 1, + 3, + 7, + 7, + 1, + 29, + 2, + 0, + 4, + 12, + 21, + 3, + 3, + 0, + 4, + 7, + 24, + 1, + 8, + 0, + 3, + 1, + 1, + 1, + 3, + 20, + 5, + 7, + 8, + 0, + 4, + 1, + 1, + 7, + 3, + 24, + 3, + 10, + 0, + 0 + ], + "weighted_loads": [ + 0.24962503090500832, + 0.0, + 0.4667716696858406, + 0.15335391461849213, + 0.5300359111279249, + 0.37823250889778137, + 0.2565665729343891, + 0.16799357533454895, + 0.15591641515493393, + 0.0, + 0.04340227320790291, + 0.03703860193490982, + 0.031027263030409813, + 0.5637133829295635, + 0.5023591034114361, + 0.039675358682870865, + 0.1609739474952221, + 0.03969678282737732, + 0.0, + 0.16663965210318565, + 0.04565398395061493, + 0.2044023983180523, + 0.06791102513670921, + 0.1144992746412754, + 0.03661568462848663, + 0.18792614713311195, + 0.2868124321103096, + 0.4257436841726303, + 0.03592970222234726, + 2.103378051891923, + 0.12201322987675667, + 0.0, + 0.20189262926578522, + 0.8496022187173367, + 1.7227922901511192, + 0.22157079353928566, + 0.19130688160657883, + 0.0, + 0.19155898317694664, + 0.4431253671646118, + 1.738492488861084, + 0.028451861813664436, + 0.5271972455084324, + 0.0, + 0.14761157892644405, + 0.08166956156492233, + 0.041290272027254105, + 0.05232619121670723, + 0.12995950877666473, + 1.8480375707149506, + 0.29259342327713966, + 0.6337335705757141, + 0.5692402049899101, + 0.0, + 0.16718140617012978, + 0.031195400282740593, + 0.04722489044070244, + 0.3480653911828995, + 0.1521235965192318, + 2.031709622591734, + 0.08932253532111645, + 0.5470754466950893, + 0.0, + 0.0 + ], + "unique_experts": 55, + "load_cv": 1.2730452910057857, + "normalized_load_entropy": 0.8519118856320166, + "max_load_share": 0.09294871794871795 + }, + "full_input": { + "tokens": 77, + "top_k": 6, + "decisions": 462, + "ordered_route_sha256": "38e1ff8b1c159ebf2c8725cf3653770d9480611fd77f0a086aecd56d783e66b5", + "route_weight_sha256": "c8295184efad1b02e8a25d236f6a560de558ca02491046dd9a4b8b73a47538b3", + "loads": [ + 4, + 0, + 7, + 3, + 14, + 6, + 4, + 2, + 6, + 2, + 3, + 3, + 1, + 7, + 9, + 8, + 9, + 2, + 11, + 4, + 1, + 3, + 2, + 7, + 1, + 4, + 7, + 9, + 7, + 29, + 8, + 8, + 6, + 12, + 25, + 6, + 3, + 0, + 4, + 7, + 31, + 1, + 8, + 23, + 6, + 1, + 1, + 9, + 3, + 22, + 5, + 8, + 8, + 0, + 9, + 6, + 1, + 7, + 6, + 25, + 3, + 16, + 9, + 0 + ], + "weighted_loads": [ + 0.24962503090500832, + 0.0, + 0.5248224176466465, + 0.15335391461849213, + 0.754337890073657, + 0.37823250889778137, + 0.2565665729343891, + 0.16799357533454895, + 0.40539390966296196, + 0.0666364561766386, + 0.10997902415692806, + 0.07870749477297068, + 0.031027263030409813, + 0.5637133829295635, + 0.5023591034114361, + 0.3041122257709503, + 0.7378942370414734, + 0.05451799649745226, + 1.1777090542018414, + 0.16663965210318565, + 0.04565398395061493, + 0.2044023983180523, + 0.06791102513670921, + 0.36760370060801506, + 0.03661568462848663, + 0.28864165022969246, + 0.2868124321103096, + 0.4834650494158268, + 0.46658237278461456, + 2.103378051891923, + 0.4183090180158615, + 0.3565845526754856, + 0.26638505794107914, + 0.8496022187173367, + 1.893790990114212, + 0.5094961486756802, + 0.19130688160657883, + 0.0, + 0.19155898317694664, + 0.4431253671646118, + 2.148161966353655, + 0.028451861813664436, + 0.5271972455084324, + 2.3217035606503487, + 0.3119732830673456, + 0.08166956156492233, + 0.041290272027254105, + 0.6309049092233181, + 0.12995950877666473, + 1.9434570707380772, + 0.29259342327713966, + 0.7453815340995789, + 0.5692402049899101, + 0.0, + 0.46034368965774775, + 0.239227881655097, + 0.04722489044070244, + 0.3480653911828995, + 0.2898902930319309, + 2.0682528913021088, + 0.08932253532111645, + 0.82514070533216, + 0.5630458295345306, + 0.0 + ], + "unique_experts": 60, + "load_cv": 0.9645717213993374, + "normalized_load_entropy": 0.9048085882266992, + "max_load_share": 0.0670995670995671 + } + }, + "s1_bos": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "1da9dde12ee240aadb753765953ba0fd68028b5a818496d7357ab9b79d365de0", + "route_weight_sha256": "c5648a616a07c97202b024d403420022bdaeeba62ef0354824f10687e5c763e6", + "loads": [ + 4, + 0, + 6, + 3, + 9, + 6, + 4, + 2, + 2, + 0, + 1, + 1, + 1, + 7, + 10, + 1, + 4, + 1, + 0, + 2, + 1, + 3, + 2, + 2, + 1, + 3, + 5, + 8, + 0, + 29, + 2, + 0, + 4, + 12, + 21, + 3, + 4, + 0, + 4, + 8, + 23, + 0, + 8, + 0, + 2, + 2, + 1, + 1, + 2, + 21, + 5, + 8, + 8, + 0, + 4, + 1, + 1, + 7, + 4, + 24, + 4, + 10, + 0, + 0 + ], + "weighted_loads": [ + 0.25919580087065697, + 0.0, + 0.4629810228943825, + 0.16232872009277344, + 0.5287826433777809, + 0.3727605640888214, + 0.24804559722542763, + 0.17154782265424728, + 0.15901266783475876, + 0.0, + 0.040969692170619965, + 0.036403972655534744, + 0.03283398598432541, + 0.562240444123745, + 0.5175642892718315, + 0.04056135192513466, + 0.1646765749901533, + 0.04445846378803253, + 0.0, + 0.07717698439955711, + 0.04914163053035736, + 0.1983688697218895, + 0.06896761804819107, + 0.12065885961055756, + 0.03596533089876175, + 0.19194313138723373, + 0.22239220887422562, + 0.46316854655742645, + 0.0, + 2.171135162934661, + 0.11081676185131073, + 0.0, + 0.20288263633847237, + 0.8283198364078999, + 1.7225822284817696, + 0.2228565216064453, + 0.2235652543604374, + 0.0, + 0.18322916328907013, + 0.472798814997077, + 1.664707999676466, + 0.0, + 0.515205655246973, + 0.0, + 0.11570042744278908, + 0.1049267128109932, + 0.039158932864665985, + 0.05448978394269943, + 0.0901816189289093, + 1.8895137421786785, + 0.2952185794711113, + 0.6677850168198347, + 0.5705573745071888, + 0.0, + 0.15198442712426186, + 0.031039530411362648, + 0.04760634899139404, + 0.3586570378392935, + 0.19430091232061386, + 2.036124676465988, + 0.12394815869629383, + 0.5449039302766323, + 0.0, + 0.0 + ], + "unique_experts": 53, + "load_cv": 1.2817948461487167, + "normalized_load_entropy": 0.8467184294170006, + "max_load_share": 0.09294871794871795 + }, + "full_input": { + "tokens": 93, + "top_k": 6, + "decisions": 558, + "ordered_route_sha256": "9314b75b61fbca6ebf211ac8c694a1873ba2a07a065b6ebad10194433d37adb7", + "route_weight_sha256": "f986bfee8dd5f5bec147dff458a0a0b7ab03ce6026f654115b14f1666080b335", + "loads": [ + 6, + 1, + 7, + 3, + 19, + 9, + 4, + 4, + 12, + 1, + 4, + 3, + 1, + 7, + 10, + 4, + 22, + 2, + 10, + 3, + 2, + 4, + 4, + 6, + 1, + 4, + 7, + 10, + 9, + 29, + 11, + 7, + 5, + 12, + 26, + 8, + 4, + 0, + 4, + 9, + 30, + 0, + 8, + 28, + 4, + 2, + 2, + 15, + 2, + 24, + 5, + 9, + 8, + 5, + 23, + 12, + 7, + 8, + 6, + 28, + 5, + 20, + 12, + 1 + ], + "weighted_loads": [ + 0.40592217072844505, + 0.03271032124757767, + 0.5088149346411228, + 0.16232872009277344, + 1.0741687305271626, + 0.4810798205435276, + 0.24804559722542763, + 0.30040572583675385, + 0.7788927108049393, + 0.034006267786026, + 0.15050584636628628, + 0.07812432665377855, + 0.03283398598432541, + 0.562240444123745, + 0.5175642892718315, + 0.14399629831314087, + 1.8713089060038328, + 0.05927967745810747, + 1.1657195910811424, + 0.11607741191983223, + 0.12092629075050354, + 0.26968513429164886, + 0.17688973248004913, + 0.29792818799614906, + 0.03596533089876175, + 0.2845921516418457, + 0.2995217479765415, + 0.513515766710043, + 0.6978888846933842, + 2.171135162934661, + 0.5626393314450979, + 0.2886345759034157, + 0.2358897589147091, + 0.8283198364078999, + 1.9422547109425068, + 0.7088531777262688, + 0.2235652543604374, + 0.0, + 0.18322916328907013, + 0.5196415316313505, + 2.064598396420479, + 0.0, + 0.515205655246973, + 2.742146711796522, + 0.23538431152701378, + 0.1049267128109932, + 0.08519934490323067, + 1.0800555013120174, + 0.0901816189289093, + 2.110752571374178, + 0.2952185794711113, + 0.7782052587717772, + 0.5705573745071888, + 0.3046531714498997, + 1.357292071916163, + 0.5422246884554625, + 0.5165775194764137, + 0.4019800629466772, + 0.2970961444079876, + 2.19821884483099, + 0.16162648238241673, + 0.9836513586342335, + 0.6095593385398388, + 0.040536053478717804 + ], + "unique_experts": 62, + "load_cv": 0.8995701752356123, + "normalized_load_entropy": 0.9135036112113172, + "max_load_share": 0.053763440860215055 + } + }, + "s0_x": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "87256678c141da4dc94e1e3f6da9a657f21a8e9408ff75985db26c8411bf5284", + "route_weight_sha256": "32cbfee11cde5901416e82c52f5fd6ae6378df774d7004202af2c89f59c1c42f", + "loads": [ + 4, + 0, + 6, + 3, + 9, + 6, + 4, + 2, + 2, + 0, + 1, + 1, + 1, + 7, + 10, + 1, + 4, + 1, + 0, + 2, + 3, + 3, + 1, + 2, + 1, + 3, + 2, + 7, + 1, + 31, + 3, + 0, + 4, + 12, + 21, + 3, + 4, + 0, + 4, + 8, + 25, + 0, + 9, + 0, + 3, + 1, + 2, + 1, + 3, + 19, + 5, + 7, + 8, + 0, + 4, + 1, + 1, + 7, + 4, + 24, + 2, + 9, + 0, + 0 + ], + "weighted_loads": [ + 0.25682368129491806, + 0.0, + 0.4725956693291664, + 0.153233103454113, + 0.5415421854704618, + 0.3930538184940815, + 0.26330338791012764, + 0.17612328380346298, + 0.15693993866443634, + 0.0, + 0.03923382610082626, + 0.03670276701450348, + 0.029874829575419426, + 0.5717366114258766, + 0.5597662031650543, + 0.04045379161834717, + 0.16134180687367916, + 0.03980226442217827, + 0.0, + 0.09060480818152428, + 0.10799790360033512, + 0.20816738530993462, + 0.029062462970614433, + 0.12175086513161659, + 0.034964725375175476, + 0.1743742674589157, + 0.08133726939558983, + 0.42497850582003593, + 0.03594456613063812, + 2.1807610113173723, + 0.18401292338967323, + 0.0, + 0.20132813602685928, + 0.8794732578098774, + 1.7549147605895996, + 0.2119649015367031, + 0.22592023015022278, + 0.0, + 0.18924659490585327, + 0.4729888252913952, + 1.7689875476062298, + 0.0, + 0.5701430700719357, + 0.0, + 0.16362389549613, + 0.06942734867334366, + 0.07196525856852531, + 0.05436636507511139, + 0.12862906977534294, + 1.8088798075914383, + 0.29963676258921623, + 0.6362139321863651, + 0.5717405341565609, + 0.0, + 0.15790186077356339, + 0.032710958272218704, + 0.045884087681770325, + 0.36505754850804806, + 0.19293881952762604, + 2.033882863819599, + 0.05729406140744686, + 0.48293207213282585, + 0.0, + 0.0 + ], + "unique_experts": 54, + "load_cv": 1.305176060781991, + "normalized_load_entropy": 0.8468373819193853, + "max_load_share": 0.09935897435897435 + }, + "full_input": { + "tokens": 77, + "top_k": 6, + "decisions": 462, + "ordered_route_sha256": "87e053e4dfdb3555c2119a7437b39d38f2df79c83250252f7a8840b85de4d268", + "route_weight_sha256": "581485743f9b3cda843fc7a29c3a6c5a1be12dd1301826c6a2f01e77ccbc8dfd", + "loads": [ + 4, + 0, + 7, + 3, + 14, + 6, + 4, + 2, + 6, + 1, + 3, + 3, + 1, + 7, + 10, + 7, + 8, + 3, + 12, + 2, + 3, + 3, + 1, + 7, + 1, + 4, + 2, + 8, + 7, + 31, + 9, + 9, + 6, + 12, + 25, + 6, + 4, + 0, + 4, + 8, + 30, + 0, + 9, + 22, + 6, + 1, + 2, + 9, + 3, + 23, + 5, + 8, + 8, + 1, + 9, + 7, + 1, + 7, + 8, + 25, + 2, + 14, + 9, + 0 + ], + "weighted_loads": [ + 0.25682368129491806, + 0.0, + 0.5306464172899723, + 0.153233103454113, + 0.765844164416194, + 0.3930538184940815, + 0.26330338791012764, + 0.17612328380346298, + 0.4128313958644867, + 0.03038082830607891, + 0.10581057704985142, + 0.07837165985256433, + 0.029874829575419426, + 0.5717366114258766, + 0.5597662031650543, + 0.27286297082901, + 0.6469009835273027, + 0.0900667430832982, + 1.2690711133182049, + 0.09060480818152428, + 0.10799790360033512, + 0.20816738530993462, + 0.029062462970614433, + 0.37485529109835625, + 0.034964725375175476, + 0.2621300220489502, + 0.08133726939558983, + 0.43751372024416924, + 0.48827794939279556, + 2.1807610113173723, + 0.4803087115287781, + 0.4058726355433464, + 0.2658205647021532, + 0.8794732578098774, + 1.961513176560402, + 0.489964347332716, + 0.22592023015022278, + 0.0, + 0.18924659490585327, + 0.4729888252913952, + 2.056387733668089, + 0.0, + 0.5701430700719357, + 2.0250878743827343, + 0.32798559963703156, + 0.06942734867334366, + 0.07196525856852531, + 0.6453693173825741, + 0.12862906977534294, + 1.9939073398709297, + 0.29963676258921623, + 0.7383321560919285, + 0.5717405341565609, + 0.05492044612765312, + 0.462254268117249, + 0.29770103469491005, + 0.045884087681770325, + 0.36505754850804806, + 0.39200640097260475, + 2.0701210908591747, + 0.05729406140744686, + 0.7245081830769777, + 0.5163647159934044, + 0.0 + ], + "unique_experts": 60, + "load_cv": 0.9729286748423371, + "normalized_load_entropy": 0.9030792335866467, + "max_load_share": 0.0670995670995671 + } + }, + "s1_x": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "e2e470b74102b1b68d6707a14d79d05a7e63c38da65a132e3751557599a5fa15", + "route_weight_sha256": "79177b4a449a615142d59720dac4521d974c3d682c1f4bc34491e44a879098f4", + "loads": [ + 4, + 0, + 6, + 3, + 9, + 6, + 4, + 2, + 2, + 0, + 1, + 2, + 1, + 7, + 11, + 1, + 3, + 1, + 0, + 2, + 1, + 3, + 1, + 2, + 1, + 3, + 5, + 8, + 2, + 31, + 2, + 0, + 4, + 13, + 21, + 2, + 4, + 0, + 4, + 8, + 24, + 0, + 8, + 0, + 2, + 2, + 1, + 1, + 2, + 20, + 5, + 7, + 8, + 0, + 3, + 1, + 1, + 7, + 4, + 23, + 3, + 10, + 0, + 0 + ], + "weighted_loads": [ + 0.2628997825086117, + 0.0, + 0.4705074653029442, + 0.16022339090704918, + 0.5330536626279354, + 0.38234228640794754, + 0.25193125754594803, + 0.17448512464761734, + 0.16066934913396835, + 0.0, + 0.04155493527650833, + 0.0779259130358696, + 0.03250633552670479, + 0.5633080825209618, + 0.5788006149232388, + 0.04217446222901344, + 0.13825644180178642, + 0.04524121806025505, + 0.0, + 0.08917326480150223, + 0.046428948640823364, + 0.19566351547837257, + 0.03139160946011543, + 0.11848117411136627, + 0.036120690405368805, + 0.16261913999915123, + 0.1828110795468092, + 0.46734892576932907, + 0.05745968781411648, + 2.219326278194785, + 0.141142126172781, + 0.0, + 0.20459450036287308, + 0.8754471652209759, + 1.7066538520157337, + 0.17648423835635185, + 0.22602089121937752, + 0.0, + 0.1817924864590168, + 0.46302536875009537, + 1.6991113349795341, + 0.0, + 0.5061948746442795, + 0.0, + 0.12709121778607368, + 0.09402703493833542, + 0.040506213903427124, + 0.05587008222937584, + 0.08539891615509987, + 1.8382840044796467, + 0.3030595928430557, + 0.6292267069220543, + 0.5648726336658001, + 0.0, + 0.11398458108305931, + 0.03205642104148865, + 0.04564058035612106, + 0.3696342967450619, + 0.19765904545783997, + 1.986252587288618, + 0.09229628182947636, + 0.5348975416272879, + 0.0, + 0.0 + ], + "unique_experts": 54, + "load_cv": 1.3041682026696944, + "normalized_load_entropy": 0.845660509852506, + "max_load_share": 0.09935897435897435 + }, + "full_input": { + "tokens": 93, + "top_k": 6, + "decisions": 558, + "ordered_route_sha256": "64773a5ce6fd6a52fedce5eaed6de65807b8ae1baa25dcd8b23cad2c9e0d34d7", + "route_weight_sha256": "e825098ea251d6ce1817257c75d4b606cb23e879766eeee0b9a0c83aaee4dd2a", + "loads": [ + 6, + 1, + 7, + 3, + 19, + 9, + 4, + 4, + 12, + 0, + 4, + 4, + 1, + 7, + 11, + 3, + 21, + 2, + 11, + 3, + 2, + 4, + 3, + 6, + 1, + 4, + 7, + 11, + 12, + 31, + 11, + 8, + 5, + 13, + 26, + 7, + 4, + 0, + 4, + 9, + 29, + 0, + 8, + 26, + 4, + 2, + 2, + 14, + 2, + 24, + 5, + 8, + 8, + 6, + 23, + 12, + 7, + 9, + 7, + 27, + 4, + 18, + 12, + 1 + ], + "weighted_loads": [ + 0.40962615236639977, + 0.03271032124757767, + 0.5163413770496845, + 0.16022339090704918, + 1.078439749777317, + 0.49066154286265373, + 0.25193125754594803, + 0.3033430278301239, + 0.7746937796473503, + 0.0, + 0.15109108947217464, + 0.11964626703411341, + 0.03250633552670479, + 0.5633080825209618, + 0.5788006149232388, + 0.1138678602874279, + 1.7834748029708862, + 0.06006243173032999, + 1.2432959377765656, + 0.12807369232177734, + 0.11821360886096954, + 0.26697978004813194, + 0.1393137238919735, + 0.2957505024969578, + 0.036120690405368805, + 0.22578084096312523, + 0.2599406186491251, + 0.5610549673438072, + 0.7925494592636824, + 2.219326278194785, + 0.5929646957665682, + 0.3383409157395363, + 0.2376016229391098, + 0.8754471652209759, + 1.953131414949894, + 0.6221452094614506, + 0.22602089121937752, + 0.0, + 0.1817924864590168, + 0.5098680853843689, + 1.9511524885892868, + 0.0, + 0.5061948746442795, + 2.2652787417173386, + 0.24677510187029839, + 0.09402703493833542, + 0.0865466259419918, + 1.0172105319797993, + 0.08539891615509987, + 2.1081409081816673, + 0.3030595928430557, + 0.7235947996377945, + 0.5648726336658001, + 0.355325635522604, + 1.319529521279037, + 0.5657201483845711, + 0.5146117508411407, + 0.44508450105786324, + 0.3478893078863621, + 2.1455888114869595, + 0.12997460551559925, + 0.8904227297753096, + 0.6291576698422432, + 0.040536053478717804 + ], + "unique_experts": 61, + "load_cv": 0.8889972763147246, + "normalized_load_entropy": 0.9133624407756015, + "max_load_share": 0.05555555555555555 + } + }, + "s0_period": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "9dcba84125f576d50c4673e14bcc692bf350a958277b986894c6a84349151015", + "route_weight_sha256": "4a8e1fd81c1a2ee562ff46588b04f035d771aa376a4968481a5e531dda9f7686", + "loads": [ + 4, + 0, + 6, + 2, + 9, + 6, + 4, + 2, + 2, + 0, + 1, + 1, + 1, + 7, + 10, + 1, + 3, + 1, + 0, + 2, + 3, + 3, + 1, + 2, + 1, + 3, + 2, + 8, + 2, + 30, + 3, + 0, + 4, + 12, + 21, + 3, + 4, + 0, + 4, + 8, + 25, + 0, + 9, + 0, + 3, + 1, + 1, + 1, + 3, + 19, + 5, + 7, + 8, + 0, + 4, + 1, + 1, + 8, + 4, + 26, + 1, + 9, + 0, + 0 + ], + "weighted_loads": [ + 0.2596839666366577, + 0.0, + 0.47860458493232727, + 0.10571250692009926, + 0.5510124713182449, + 0.38631097227334976, + 0.26368073001503944, + 0.18000920861959457, + 0.1596459373831749, + 0.0, + 0.040449999272823334, + 0.03653533011674881, + 0.030502304434776306, + 0.5715640187263489, + 0.5564923770725727, + 0.0411871075630188, + 0.128678597509861, + 0.04122624918818474, + 0.0, + 0.09327676892280579, + 0.11167273856699467, + 0.19983220100402832, + 0.029598530381917953, + 0.12897907570004463, + 0.03524762764573097, + 0.17525745555758476, + 0.07723558321595192, + 0.4500526934862137, + 0.06092824786901474, + 2.152612054720521, + 0.1911371909081936, + 0.0, + 0.20097916945815086, + 0.8835264481604099, + 1.745134349912405, + 0.21062932163476944, + 0.23168715462088585, + 0.0, + 0.19741276651620865, + 0.458997568115592, + 1.762053120881319, + 0.0, + 0.583961796015501, + 0.0, + 0.16552859731018543, + 0.07496228069067001, + 0.04354064166545868, + 0.05362492799758911, + 0.1273113414645195, + 1.8049571886658669, + 0.3031092807650566, + 0.6436650231480598, + 0.5662304796278477, + 0.0, + 0.1615300364792347, + 0.033388376235961914, + 0.046269144862890244, + 0.3952421620488167, + 0.1974620297551155, + 2.117845505475998, + 0.03312160447239876, + 0.46975328773260117, + 0.0, + 0.0 + ], + "unique_experts": 54, + "load_cv": 1.3187067559614145, + "normalized_load_entropy": 0.8433672985904234, + "max_load_share": 0.09615384615384616 + }, + "full_input": { + "tokens": 77, + "top_k": 6, + "decisions": 462, + "ordered_route_sha256": "4308c7cf2cac7db5b5319baa98c14590abaa48c5925676b078a20e26df6429ef", + "route_weight_sha256": "ec48512c3e769c1f708e8a1203593f946685361164564db773b835645862cc0f", + "loads": [ + 4, + 0, + 7, + 2, + 15, + 6, + 4, + 2, + 6, + 1, + 3, + 3, + 1, + 7, + 10, + 8, + 8, + 2, + 12, + 2, + 3, + 3, + 1, + 7, + 1, + 4, + 2, + 9, + 9, + 30, + 9, + 9, + 6, + 12, + 24, + 7, + 4, + 0, + 4, + 8, + 30, + 0, + 9, + 23, + 6, + 1, + 1, + 9, + 3, + 22, + 5, + 8, + 8, + 0, + 9, + 8, + 1, + 8, + 7, + 27, + 1, + 14, + 7, + 0 + ], + "weighted_loads": [ + 0.2596839666366577, + 0.0, + 0.5366553328931332, + 0.10571250692009926, + 0.858341634273529, + 0.38631097227334976, + 0.26368073001503944, + 0.18000920861959457, + 0.41191960871219635, + 0.03038082830607891, + 0.10702675022184849, + 0.07820422295480967, + 0.030502304434776306, + 0.5715640187263489, + 0.5564923770725727, + 0.31563105061650276, + 0.660936526954174, + 0.05604746285825968, + 1.2198271714150906, + 0.09327676892280579, + 0.11167273856699467, + 0.19983220100402832, + 0.029598530381917953, + 0.3820835016667843, + 0.03524762764573097, + 0.2735446058213711, + 0.07723558321595192, + 0.462587907910347, + 0.5576936043798923, + 2.152612054720521, + 0.48743297904729843, + 0.3958481699228287, + 0.2654715981334448, + 0.8835264481604099, + 1.8818171098828316, + 0.6513660550117493, + 0.23168715462088585, + 0.0, + 0.19741276651620865, + 0.458997568115592, + 2.04603224247694, + 0.0, + 0.583961796015501, + 2.1222739443182945, + 0.329890301451087, + 0.07496228069067001, + 0.04354064166545868, + 0.6479847840964794, + 0.1273113414645195, + 1.9501531533896923, + 0.3031092807650566, + 0.7516948133707047, + 0.5662304796278477, + 0.0, + 0.4596228050068021, + 0.3134238086640835, + 0.046269144862890244, + 0.3952421620488167, + 0.33522872626781464, + 2.152813281863928, + 0.03312160447239876, + 0.7098921705037355, + 0.4453055188059807, + 0.0 + ], + "unique_experts": 59, + "load_cv": 0.9830462554762693, + "normalized_load_entropy": 0.8983845849905093, + "max_load_share": 0.06493506493506493 + } + }, + "s1_period": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "03d4dc5b6accae3897aad20b50cc1e780364deab7e4251ddf9b78fb68ae66b5b", + "route_weight_sha256": "3f23a0ec977be14cd06247489c77c827d02f6e830aa5746ebc244feafb9ac670", + "loads": [ + 4, + 0, + 6, + 3, + 9, + 6, + 4, + 2, + 2, + 0, + 1, + 2, + 1, + 7, + 10, + 1, + 3, + 1, + 0, + 2, + 2, + 3, + 1, + 2, + 1, + 3, + 6, + 8, + 2, + 30, + 2, + 0, + 4, + 12, + 21, + 2, + 4, + 0, + 4, + 8, + 24, + 0, + 8, + 0, + 2, + 1, + 1, + 1, + 2, + 20, + 5, + 8, + 8, + 0, + 3, + 1, + 1, + 7, + 4, + 24, + 3, + 10, + 0, + 0 + ], + "weighted_loads": [ + 0.2622297443449497, + 0.0, + 0.4737776443362236, + 0.14926907047629356, + 0.5413327254354954, + 0.38814032822847366, + 0.25557754933834076, + 0.1826879158616066, + 0.15775014460086823, + 0.0, + 0.040437452495098114, + 0.0769018828868866, + 0.03228822723031044, + 0.571599155664444, + 0.5295843593776226, + 0.041501495987176895, + 0.1266605257987976, + 0.04489194229245186, + 0.0, + 0.0936281569302082, + 0.08302213996648788, + 0.20425992831587791, + 0.03297871723771095, + 0.12507406249642372, + 0.03434306010603905, + 0.167921245098114, + 0.229478370398283, + 0.4571661725640297, + 0.05739566124975681, + 2.1844698153436184, + 0.1497964821755886, + 0.0, + 0.20482279732823372, + 0.8279915861785412, + 1.6860692650079727, + 0.18087846785783768, + 0.22793400660157204, + 0.0, + 0.18347084149718285, + 0.4609679542481899, + 1.701778743416071, + 0.0, + 0.49447210878133774, + 0.0, + 0.1299135945737362, + 0.06388729810714722, + 0.04033476486802101, + 0.05541092902421951, + 0.08910360932350159, + 1.8606322072446346, + 0.30453767627477646, + 0.6660921219736338, + 0.5568894743919373, + 0.0, + 0.11199275404214859, + 0.03472981974482536, + 0.04711806774139404, + 0.37205516546964645, + 0.1968512423336506, + 1.9913947358727455, + 0.09132402762770653, + 0.5242464076727629, + 0.0, + 0.0 + ], + "unique_experts": 54, + "load_cv": 1.2955697535035673, + "normalized_load_entropy": 0.8467546208747129, + "max_load_share": 0.09615384615384616 + }, + "full_input": { + "tokens": 93, + "top_k": 6, + "decisions": 558, + "ordered_route_sha256": "2fa163cded5624c4d95e38235b5f79ec099d1e96d711df96393e21e98b2156a6", + "route_weight_sha256": "2a98438a3ddd8843ce645bd749d702028259f056e6fa84d6096a9f40d7cc2b81", + "loads": [ + 6, + 1, + 7, + 3, + 20, + 10, + 4, + 4, + 12, + 0, + 4, + 4, + 1, + 7, + 11, + 4, + 21, + 2, + 10, + 3, + 3, + 4, + 3, + 6, + 1, + 4, + 8, + 10, + 13, + 30, + 11, + 7, + 5, + 12, + 26, + 8, + 4, + 0, + 4, + 9, + 30, + 0, + 8, + 26, + 4, + 1, + 2, + 14, + 2, + 24, + 5, + 9, + 8, + 5, + 22, + 13, + 7, + 9, + 6, + 27, + 4, + 18, + 11, + 1 + ], + "weighted_loads": [ + 0.4089561142027378, + 0.03271032124757767, + 0.5196115560829639, + 0.14926907047629356, + 1.152144655585289, + 0.5374259538948536, + 0.25557754933834076, + 0.31154581904411316, + 0.7621914707124233, + 0.0, + 0.14997360669076443, + 0.1186222368851304, + 0.03228822723031044, + 0.571599155664444, + 0.5698967948555946, + 0.14606720954179764, + 1.7775260172784328, + 0.0597131559625268, + 1.1657195910811424, + 0.13252858445048332, + 0.15480680018663406, + 0.2755761928856373, + 0.14090083166956902, + 0.30234339088201523, + 0.03434306010603905, + 0.24107606709003448, + 0.3066079095005989, + 0.5075133927166462, + 0.8546855580061674, + 2.1844698153436184, + 0.6016190517693758, + 0.2886345759034157, + 0.23782991990447044, + 0.8279915861785412, + 1.9209878668189049, + 0.7318765558302402, + 0.22793400660157204, + 0.0, + 0.18347084149718285, + 0.5078106708824635, + 1.9741777386516333, + 0.0, + 0.49447210878133774, + 2.285220019519329, + 0.2495974786579609, + 0.06388729810714722, + 0.0863751769065857, + 1.0213934071362019, + 0.08910360932350159, + 2.1216971203684807, + 0.30453767627477646, + 0.7707053069025278, + 0.5568894743919373, + 0.3046531714498997, + 1.2722633155062795, + 0.5924606472253799, + 0.5160892382264137, + 0.4479350745677948, + 0.2996464744210243, + 2.1192107498645782, + 0.12900235131382942, + 0.8854900728911161, + 0.5613906309008598, + 0.040536053478717804 + ], + "unique_experts": 61, + "load_cv": 0.8876089177293086, + "normalized_load_entropy": 0.9134452382831838, + "max_load_share": 0.053763440860215055 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 52, + "ordered_topk_exact_tokens": 35, + "set_exact_tokens": 43, + "mean_set_jaccard": 0.9505494505494506, + "mean_token_weighted_tv": 0.011620040105369229, + "aggregate_load_tv": 0.02564102564102564 + }, + "system_bos": { + "tokens": 52, + "ordered_topk_exact_tokens": 32, + "set_exact_tokens": 42, + "mean_set_jaccard": 0.9450549450549451, + "mean_token_weighted_tv": 0.014518754807515787, + "aggregate_load_tv": 0.028846153846153844 + }, + "system_x": { + "tokens": 52, + "ordered_topk_exact_tokens": 27, + "set_exact_tokens": 39, + "mean_set_jaccard": 0.9244505494505494, + "mean_token_weighted_tv": 0.018011331325396895, + "aggregate_load_tv": 0.03846153846153846 + }, + "system_period": { + "tokens": 52, + "ordered_topk_exact_tokens": 31, + "set_exact_tokens": 39, + "mean_set_jaccard": 0.9285714285714287, + "mean_token_weighted_tv": 0.01858993865048083, + "aggregate_load_tv": 0.03525641025641025 + }, + "bos_at_s0": { + "tokens": 52, + "ordered_topk_exact_tokens": 29, + "set_exact_tokens": 36, + "mean_set_jaccard": 0.9079670329670331, + "mean_token_weighted_tv": 0.022338982134197768, + "aggregate_load_tv": 0.05128205128205128 + }, + "bos_at_s1": { + "tokens": 52, + "ordered_topk_exact_tokens": 27, + "set_exact_tokens": 34, + "mean_set_jaccard": 0.896978021978022, + "mean_token_weighted_tv": 0.02358806894447368, + "aggregate_load_tv": 0.048076923076923066 + }, + "x_at_s0": { + "tokens": 52, + "ordered_topk_exact_tokens": 26, + "set_exact_tokens": 38, + "mean_set_jaccard": 0.9230769230769231, + "mean_token_weighted_tv": 0.02056897465641109, + "aggregate_load_tv": 0.03846153846153845 + }, + "x_at_s1": { + "tokens": 52, + "ordered_topk_exact_tokens": 23, + "set_exact_tokens": 32, + "mean_set_jaccard": 0.885989010989011, + "mean_token_weighted_tv": 0.025706256865165554, + "aggregate_load_tv": 0.03846153846153846 + }, + "period_at_s0": { + "tokens": 52, + "ordered_topk_exact_tokens": 26, + "set_exact_tokens": 39, + "mean_set_jaccard": 0.9285714285714287, + "mean_token_weighted_tv": 0.01951695357162792, + "aggregate_load_tv": 0.035256410256410256 + }, + "period_at_s1": { + "tokens": 52, + "ordered_topk_exact_tokens": 24, + "set_exact_tokens": 34, + "mean_set_jaccard": 0.8928571428571428, + "mean_token_weighted_tv": 0.024981098625665672, + "aggregate_load_tv": 0.03846153846153845 + } + } + }, + "layer_12": { + "layer": 12, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "e30d2785da36c2d2ca2288c91d0db45e6254ffa31eebe8f52687bee0bd64334b", + "route_weight_sha256": "2416393232a2bc0741b8b5ffa377a8e2c8db52ee21a32cd77f4975220ea3d985", + "loads": [ + 3, + 3, + 1, + 1, + 1, + 10, + 0, + 2, + 11, + 1, + 3, + 2, + 12, + 15, + 0, + 1, + 4, + 2, + 8, + 4, + 2, + 6, + 12, + 8, + 0, + 3, + 2, + 0, + 6, + 0, + 1, + 15, + 1, + 23, + 0, + 6, + 2, + 8, + 0, + 4, + 0, + 3, + 1, + 9, + 1, + 5, + 0, + 2, + 3, + 2, + 3, + 8, + 10, + 6, + 0, + 3, + 10, + 11, + 0, + 1, + 0, + 27, + 15, + 9 + ], + "weighted_loads": [ + 0.14043228141963482, + 0.22831613197922707, + 0.05918603762984276, + 0.03753316402435303, + 0.042024120688438416, + 0.8189050443470478, + 0.0, + 0.1397709995508194, + 0.6322620771825314, + 0.07116969674825668, + 0.11571007966995239, + 0.13342417404055595, + 0.8089214861392975, + 1.0094760283827782, + 0.0, + 0.030661743134260178, + 0.15359894558787346, + 0.14594504237174988, + 0.38947074115276337, + 0.14550455659627914, + 0.09701035916805267, + 0.2642761692404747, + 1.0265940129756927, + 0.4456441383808851, + 0.0, + 0.15495699644088745, + 0.0847909189760685, + 0.0, + 0.24823111295700073, + 0.0, + 0.056232940405607224, + 1.4501185417175293, + 0.03874991834163666, + 2.837246283888817, + 0.0, + 0.4131087213754654, + 0.10084127634763718, + 0.8447132483124733, + 0.0, + 0.2229432798922062, + 0.0, + 0.14084497466683388, + 0.04945563152432442, + 0.5865791812539101, + 0.061044950038194656, + 0.38473448902368546, + 0.0, + 0.13064435124397278, + 0.12107371911406517, + 0.09173920750617981, + 0.28066860139369965, + 0.6506285108625889, + 0.7588639408349991, + 0.38996943831443787, + 0.0, + 0.15602732449769974, + 0.5327375158667564, + 0.6333338804543018, + 0.0, + 0.03200273960828781, + 0.0, + 2.45846726000309, + 1.2963817287236452, + 0.5130427237600088 + ], + "unique_experts": 52, + "load_cv": 1.1441185393499027, + "normalized_load_entropy": 0.8601819438706999, + "max_load_share": 0.08653846153846154 + }, + "full_input": { + "tokens": 77, + "top_k": 6, + "decisions": 462, + "ordered_route_sha256": "faf3d5dc79ed62f227a3164e52bceda385c8f558a05d22699da2d6f862105f0d", + "route_weight_sha256": "7c67523b0648bd6b739e7ecdea30c052243266b145e62c5bd67882276fcdd096", + "loads": [ + 3, + 3, + 1, + 6, + 3, + 11, + 0, + 5, + 17, + 1, + 3, + 2, + 17, + 16, + 0, + 1, + 5, + 2, + 8, + 4, + 3, + 6, + 13, + 14, + 0, + 3, + 3, + 8, + 21, + 10, + 3, + 21, + 2, + 25, + 0, + 13, + 2, + 12, + 14, + 4, + 0, + 9, + 8, + 9, + 3, + 6, + 1, + 7, + 8, + 2, + 4, + 8, + 10, + 6, + 0, + 3, + 13, + 11, + 0, + 5, + 0, + 32, + 20, + 12 + ], + "weighted_loads": [ + 0.14043228141963482, + 0.22831613197922707, + 0.05918603762984276, + 0.16309769335202873, + 1.594816192984581, + 0.8229819140397012, + 0.0, + 0.3376394808292389, + 1.004276180639863, + 0.07116969674825668, + 0.11571007966995239, + 0.13342417404055595, + 1.0453457534313202, + 1.1244961395859718, + 0.0, + 0.030661743134260178, + 0.2008831538259983, + 0.14594504237174988, + 0.38947074115276337, + 0.14550455659627914, + 0.09932716563344002, + 0.2642761692404747, + 1.0765880197286606, + 0.9368163365870714, + 0.0, + 0.15495699644088745, + 0.11757570877671242, + 0.4299297444522381, + 2.1922747418284416, + 1.3095475174486637, + 0.12055203877389431, + 1.780108354985714, + 0.08506163582205772, + 2.931392077356577, + 0.0, + 0.9126384481787682, + 0.10084127634763718, + 0.9577877670526505, + 1.0917173251509666, + 0.2229432798922062, + 0.0, + 0.7211089245975018, + 0.4916693978011608, + 0.5865791812539101, + 0.17921406775712967, + 0.4241257570683956, + 0.05230727419257164, + 0.43627554923295975, + 0.47260842472314835, + 0.09173920750617981, + 0.29362356197088957, + 0.6506285108625889, + 0.7588639408349991, + 0.38996943831443787, + 0.0, + 0.15602732449769974, + 0.6365511561743915, + 0.6333338804543018, + 0.0, + 0.18156668543815613, + 0.0, + 2.6473971009254456, + 1.4896349869668484, + 0.6084889639168978 + ], + "unique_experts": 56, + "load_cv": 0.9438321554028472, + "normalized_load_entropy": 0.8964237903463476, + "max_load_share": 0.06926406926406926 + } + }, + "s1_eos": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "3b69d81878db5a2560b36e197bfac34bae0419703fa37484281d37d6ebd6215b", + "route_weight_sha256": "08af2c978c47f8ff5fed87e4c0a3a06b30ab1c76a18797cf61f7abee4df43447", + "loads": [ + 3, + 3, + 1, + 1, + 1, + 9, + 0, + 2, + 12, + 1, + 3, + 2, + 13, + 15, + 0, + 1, + 4, + 2, + 7, + 4, + 2, + 6, + 12, + 7, + 0, + 4, + 2, + 0, + 6, + 1, + 1, + 14, + 0, + 23, + 0, + 6, + 2, + 8, + 0, + 4, + 0, + 4, + 1, + 9, + 2, + 5, + 0, + 3, + 3, + 2, + 3, + 7, + 10, + 6, + 0, + 3, + 10, + 13, + 0, + 1, + 0, + 26, + 14, + 8 + ], + "weighted_loads": [ + 0.1474260501563549, + 0.22405359521508217, + 0.06189291551709175, + 0.038854192942380905, + 0.04255314916372299, + 0.7955061737447977, + 0.0, + 0.13855048269033432, + 0.6898636594414711, + 0.071163609623909, + 0.10875282809138298, + 0.13385482132434845, + 0.8284463286399841, + 0.9984322786331177, + 0.0, + 0.030659576877951622, + 0.1500251479446888, + 0.14387982338666916, + 0.3646462894976139, + 0.14269836246967316, + 0.08887799456715584, + 0.2540861200541258, + 1.0173212308436632, + 0.4311232566833496, + 0.0, + 0.18978045135736465, + 0.0834599956870079, + 0.0, + 0.24856514856219292, + 0.03209652751684189, + 0.05036766082048416, + 1.4122723676264286, + 0.0, + 2.818722566589713, + 0.0, + 0.40269596315920353, + 0.09757352247834206, + 0.8295046202838421, + 0.0, + 0.22370227053761482, + 0.0, + 0.1750122234225273, + 0.04617955535650253, + 0.5978320054709911, + 0.09315188229084015, + 0.38167792558670044, + 0.0, + 0.16539836674928665, + 0.12717339769005775, + 0.08653877303004265, + 0.27199066430330276, + 0.6248938888311386, + 0.7612889632582664, + 0.38611703738570213, + 0.0, + 0.15686852857470512, + 0.5352549590170383, + 0.6984726469963789, + 0.0, + 0.032134078443050385, + 0.0, + 2.399502620100975, + 1.285312209278345, + 0.47970028407871723 + ], + "unique_experts": 52, + "load_cv": 1.1226553476404941, + "normalized_load_entropy": 0.8642882942785884, + "max_load_share": 0.08333333333333333 + }, + "full_input": { + "tokens": 93, + "top_k": 6, + "decisions": 558, + "ordered_route_sha256": "b07c68915b7064147588429c702adbfde001d8d80be329d8487aeef39359916b", + "route_weight_sha256": "378f20f6b638756da893f8821fd482194b3a7696b5fc8e4730d379b046ae5729", + "loads": [ + 7, + 3, + 1, + 4, + 5, + 10, + 0, + 10, + 18, + 4, + 4, + 2, + 16, + 16, + 0, + 1, + 7, + 4, + 8, + 4, + 3, + 8, + 15, + 13, + 0, + 4, + 5, + 7, + 22, + 16, + 12, + 19, + 4, + 28, + 5, + 14, + 2, + 12, + 18, + 4, + 1, + 16, + 10, + 11, + 15, + 9, + 3, + 10, + 11, + 2, + 5, + 7, + 10, + 9, + 0, + 4, + 13, + 17, + 0, + 6, + 2, + 35, + 19, + 8 + ], + "weighted_loads": [ + 0.3404139019548893, + 0.22405359521508217, + 0.06189291551709175, + 0.09459860809147358, + 1.6655146554112434, + 0.7994518638588488, + 0.0, + 0.5655855648219585, + 1.1578641906380653, + 0.38595400750637054, + 0.15212294086813927, + 0.13385482132434845, + 0.9677749015390873, + 1.1074738129973412, + 0.0, + 0.030659576877951622, + 0.3525950536131859, + 0.2578413225710392, + 0.40038150176405907, + 0.14269836246967316, + 0.0912103638984263, + 0.3434090409427881, + 1.1388639453798532, + 0.8847031779587269, + 0.0, + 0.18978045135736465, + 0.20596970990300179, + 0.3586306981742382, + 2.474386263638735, + 2.1326050236821175, + 0.9135915134102106, + 1.6925275642424822, + 0.1777528077363968, + 3.113984728232026, + 0.2551962547004223, + 1.0122366193681955, + 0.09757352247834206, + 1.0062386188656092, + 1.352159272879362, + 0.22370227053761482, + 0.029669860377907753, + 1.2453359700739384, + 0.5786300338804722, + 0.7058939673006535, + 1.3148747831583023, + 0.6874704137444496, + 0.1456768624484539, + 0.5622006338089705, + 0.6098518930375576, + 0.08653877303004265, + 0.33802865352481604, + 0.6248938888311386, + 0.7612889632582664, + 0.5441526100039482, + 0.0, + 0.18820669502019882, + 0.6139027327299118, + 0.8886363487690687, + 0.0, + 0.2051899330690503, + 0.06887535564601421, + 2.8389499075710773, + 1.5149124935269356, + 0.47970028407871723 + ], + "unique_experts": 59, + "load_cv": 0.8111373232357003, + "normalized_load_entropy": 0.9208943345410328, + "max_load_share": 0.06272401433691756 + } + }, + "s0_bos": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "5add05360ee932df7201f81dc0cd6dbc8d57d576e975c08ddb9d39ba70956e1b", + "route_weight_sha256": "7c58f1d888c2affeeffec3ab288b2da0c52b057df7ab15af2d75b0c86b8833b8", + "loads": [ + 3, + 3, + 1, + 1, + 1, + 9, + 0, + 2, + 10, + 1, + 3, + 2, + 12, + 16, + 0, + 0, + 7, + 2, + 7, + 4, + 2, + 6, + 12, + 7, + 0, + 4, + 2, + 0, + 7, + 0, + 1, + 15, + 1, + 23, + 0, + 6, + 2, + 7, + 1, + 4, + 0, + 4, + 1, + 9, + 2, + 5, + 0, + 2, + 2, + 2, + 3, + 7, + 10, + 6, + 0, + 3, + 10, + 11, + 0, + 1, + 0, + 28, + 14, + 8 + ], + "weighted_loads": [ + 0.15319712832570076, + 0.2286844626069069, + 0.06861835718154907, + 0.035684213042259216, + 0.04787236452102661, + 0.7956724539399147, + 0.0, + 0.1400585025548935, + 0.6726172007620335, + 0.06701922416687012, + 0.12146515399217606, + 0.123534070327878, + 0.8335142247378826, + 1.0331697892397642, + 0.0, + 0.0, + 0.23687389306724072, + 0.14489129185676575, + 0.36585742607712746, + 0.15356124937534332, + 0.09344498813152313, + 0.2632194459438324, + 1.0337870325893164, + 0.43253055959939957, + 0.0, + 0.18720639124512672, + 0.0861703772097826, + 0.0, + 0.27975500002503395, + 0.0, + 0.05572979897260666, + 1.4118007682263851, + 0.039491381496191025, + 2.8299545012414455, + 0.0, + 0.3917511645704508, + 0.09656457230448723, + 0.791212722659111, + 0.03786919638514519, + 0.22872701659798622, + 0.0, + 0.17408691719174385, + 0.04531652480363846, + 0.6482891701161861, + 0.10040779039263725, + 0.38700783997774124, + 0.0, + 0.12939519807696342, + 0.09134456142783165, + 0.08124058693647385, + 0.30163202434778214, + 0.6169822253286839, + 0.75997544080019, + 0.37742650508880615, + 0.0, + 0.17740053683519363, + 0.5312068089842796, + 0.6069762092083693, + 0.0, + 0.03083464875817299, + 0.0, + 2.46887737326324, + 1.257336761802435, + 0.48995645716786385 + ], + "unique_experts": 52, + "load_cv": 1.143543749793731, + "normalized_load_entropy": 0.8621045145382522, + "max_load_share": 0.08974358974358974 + }, + "full_input": { + "tokens": 77, + "top_k": 6, + "decisions": 462, + "ordered_route_sha256": "bd63a59142b900f3e308430dcf5f6c85f45f5f5db48cef0f63aebdee38247643", + "route_weight_sha256": "e3098b6622a8ea9aa2d8afa2e05196aeeee222c680314e11070f57078d75748f", + "loads": [ + 3, + 3, + 1, + 5, + 2, + 9, + 0, + 5, + 16, + 1, + 3, + 2, + 18, + 17, + 0, + 0, + 11, + 2, + 7, + 4, + 2, + 6, + 13, + 13, + 0, + 4, + 4, + 8, + 23, + 10, + 3, + 22, + 2, + 25, + 0, + 13, + 2, + 11, + 15, + 4, + 0, + 10, + 7, + 10, + 4, + 6, + 1, + 7, + 7, + 2, + 4, + 7, + 10, + 6, + 0, + 3, + 12, + 11, + 0, + 5, + 0, + 32, + 18, + 11 + ], + "weighted_loads": [ + 0.15319712832570076, + 0.2286844626069069, + 0.06861835718154907, + 0.15813102573156357, + 0.6504295468330383, + 0.7956724539399147, + 0.0, + 0.34236713871359825, + 1.0981396939605474, + 0.06701922416687012, + 0.12146515399217606, + 0.123534070327878, + 1.1367862448096275, + 1.146490616723895, + 0.0, + 0.0, + 0.39310204423964024, + 0.14489129185676575, + 0.36585742607712746, + 0.15356124937534332, + 0.09344498813152313, + 0.2632194459438324, + 1.0837810393422842, + 0.9237027578055859, + 0.0, + 0.18720639124512672, + 0.1615337561815977, + 0.4299297444522381, + 2.2430761381983757, + 1.4176332280039787, + 0.12004889734089375, + 1.791481725871563, + 0.08580309897661209, + 2.923061963170767, + 0.0, + 0.8912808913737535, + 0.09656457230448723, + 0.9042872413992882, + 1.2123218290507793, + 0.22872701659798622, + 0.0, + 0.7747389115393162, + 0.4534612074494362, + 0.6833141483366489, + 0.21379581093788147, + 0.4263991080224514, + 0.05262286961078644, + 0.44234609231352806, + 0.4385104104876518, + 0.08124058693647385, + 0.31458698492497206, + 0.6169822253286839, + 0.75997544080019, + 0.37742650508880615, + 0.0, + 0.17740053683519363, + 0.630438432097435, + 0.6069762092083693, + 0.0, + 0.22576332930475473, + 0.0, + 2.626233307644725, + 1.4038453828543425, + 0.5854026973247528 + ], + "unique_experts": 55, + "load_cv": 0.9523711136839301, + "normalized_load_entropy": 0.8941942493648681, + "max_load_share": 0.06926406926406926 + } + }, + "s1_bos": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "d8a14e296ca6493ff73d2ef2cf7fd546bffb408da107c039f9c864c678880550", + "route_weight_sha256": "54a479cf0c9d88963a67e54da150f6cf7445033b02794da19b07e92747e140eb", + "loads": [ + 3, + 3, + 2, + 2, + 1, + 9, + 0, + 2, + 12, + 1, + 3, + 3, + 12, + 15, + 0, + 1, + 4, + 2, + 7, + 5, + 2, + 4, + 12, + 6, + 0, + 3, + 2, + 0, + 7, + 1, + 1, + 15, + 0, + 23, + 0, + 6, + 3, + 7, + 1, + 4, + 0, + 4, + 2, + 9, + 2, + 5, + 0, + 2, + 2, + 2, + 3, + 7, + 10, + 6, + 0, + 2, + 10, + 11, + 0, + 1, + 0, + 27, + 15, + 8 + ], + "weighted_loads": [ + 0.15365956723690033, + 0.22192050516605377, + 0.09415914118289948, + 0.0727584958076477, + 0.04972333088517189, + 0.8318479359149933, + 0.0, + 0.14250636100769043, + 0.7970844730734825, + 0.06756534427404404, + 0.11797796934843063, + 0.172989409416914, + 0.8096280358731747, + 1.0073474906384945, + 0.0, + 0.030210837721824646, + 0.13799164071679115, + 0.1405710205435753, + 0.36881178990006447, + 0.18168694898486137, + 0.09235051646828651, + 0.19587741047143936, + 1.0340044032782316, + 0.3981536887586117, + 0.0, + 0.1361493431031704, + 0.08583796210587025, + 0.0, + 0.2835645377635956, + 0.029008280485868454, + 0.0542503260076046, + 1.3876931965351105, + 0.0, + 2.803182141855359, + 0.0, + 0.3881653528660536, + 0.11895371228456497, + 0.8004213012754917, + 0.042170844972133636, + 0.22908885031938553, + 0.0, + 0.1886824555695057, + 0.07925314456224442, + 0.6551962159574032, + 0.09250294789671898, + 0.37576669082045555, + 0.0, + 0.12961438670754433, + 0.09565484151244164, + 0.07628064975142479, + 0.2983925826847553, + 0.6321360915899277, + 0.7612104266881943, + 0.394587442278862, + 0.0, + 0.13138876482844353, + 0.5299131534993649, + 0.6038527637720108, + 0.0, + 0.029965365305542946, + 0.0, + 2.447566809132695, + 1.2854451723396778, + 0.4702885150909424 + ], + "unique_experts": 53, + "load_cv": 1.125579695776819, + "normalized_load_entropy": 0.867822201861977, + "max_load_share": 0.08653846153846154 + }, + "full_input": { + "tokens": 93, + "top_k": 6, + "decisions": 558, + "ordered_route_sha256": "981d72e126800573abd42ea8d487ea94c4abfd5cf9a9138ddbb324a35ff6d73e", + "route_weight_sha256": "1898ef76b64320d6478f71ed523c829b3e75c44606da3f5e8907e4434d36392d", + "loads": [ + 7, + 3, + 2, + 4, + 4, + 9, + 0, + 10, + 18, + 4, + 4, + 3, + 16, + 16, + 0, + 1, + 8, + 4, + 8, + 5, + 2, + 6, + 15, + 12, + 0, + 3, + 5, + 7, + 23, + 18, + 12, + 21, + 4, + 28, + 5, + 14, + 3, + 11, + 19, + 4, + 1, + 16, + 10, + 12, + 15, + 9, + 3, + 9, + 11, + 2, + 5, + 7, + 10, + 9, + 0, + 3, + 12, + 15, + 0, + 6, + 2, + 35, + 20, + 8 + ], + "weighted_loads": [ + 0.3466474190354347, + 0.22192050516605377, + 0.09415914118289948, + 0.12555397301912308, + 0.7224783785641193, + 0.8318479359149933, + 0.0, + 0.5744440853595734, + 1.3343339674174786, + 0.3823557421565056, + 0.16134808212518692, + 0.172989409416914, + 1.0226791016757488, + 1.1143748573958874, + 0.0, + 0.030210837721824646, + 0.3848244845867157, + 0.25453251972794533, + 0.40454700216650963, + 0.18168694898486137, + 0.09235051646828651, + 0.2852003313601017, + 1.1555471178144217, + 0.851733610033989, + 0.0, + 0.1361493431031704, + 0.20834767632186413, + 0.3586306981742382, + 2.6113700047135353, + 2.3451446034014225, + 0.917474178597331, + 1.7052546869963408, + 0.1777528077363968, + 3.096838204190135, + 0.2551962547004223, + 0.9977060090750456, + 0.11895371228456497, + 0.9771552998572588, + 1.5105925910174847, + 0.22908885031938553, + 0.029669860377907753, + 1.2867824956774712, + 0.5880908481776714, + 0.7991746105253696, + 1.3196637257933617, + 0.6815591789782047, + 0.1408289410173893, + 0.5556932557374239, + 0.5959480442106724, + 0.07628064975142479, + 0.3644305719062686, + 0.6321360915899277, + 0.7612104266881943, + 0.5526230148971081, + 0.0, + 0.16272693127393723, + 0.592139046639204, + 0.7940164655447006, + 0.0, + 0.23266518395394087, + 0.06887535564601421, + 2.852833302691579, + 1.5150454565882683, + 0.4702885150909424 + ], + "unique_experts": 59, + "load_cv": 0.8234606142710232, + "normalized_load_entropy": 0.9198225801912409, + "max_load_share": 0.06272401433691756 + } + }, + "s0_x": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "dd7d51664e2c8c4c6aaba242d2dac7fa91d35dd60c3bf1ef7ba1d798655ebb0f", + "route_weight_sha256": "af3655007545c52f71837318312212ee8fa909da8ea38ce1955f447438500505", + "loads": [ + 3, + 3, + 1, + 2, + 1, + 10, + 0, + 2, + 12, + 1, + 4, + 2, + 12, + 15, + 0, + 1, + 8, + 2, + 7, + 3, + 3, + 6, + 13, + 6, + 0, + 4, + 2, + 0, + 8, + 0, + 1, + 15, + 1, + 21, + 0, + 6, + 2, + 7, + 1, + 4, + 0, + 3, + 1, + 9, + 2, + 5, + 0, + 2, + 2, + 1, + 3, + 6, + 10, + 6, + 0, + 2, + 10, + 11, + 0, + 1, + 0, + 26, + 14, + 9 + ], + "weighted_loads": [ + 0.15368115529417992, + 0.22570457682013512, + 0.06420762091875076, + 0.07143893837928772, + 0.04336504265666008, + 0.8163696452975273, + 0.0, + 0.14008527994155884, + 0.7348394840955734, + 0.07074441760778427, + 0.15697594359517097, + 0.11815370433032513, + 0.832741865888238, + 0.9831732399761677, + 0.0, + 0.0410996749997139, + 0.27346923761069775, + 0.14052025973796844, + 0.3615116197615862, + 0.11235442757606506, + 0.12387862801551819, + 0.2644086740911007, + 1.068792788311839, + 0.4194199815392494, + 0.0, + 0.19347479566931725, + 0.08827775716781616, + 0.0, + 0.31099964305758476, + 0.0, + 0.05505180358886719, + 1.4034367576241493, + 0.03863183408975601, + 2.743247229605913, + 0.0, + 0.3858076371252537, + 0.09622339904308319, + 0.7798029482364655, + 0.040189873427152634, + 0.2334406040608883, + 0.0, + 0.1485152505338192, + 0.04895641654729843, + 0.6410857290029526, + 0.09708216041326523, + 0.39669228345155716, + 0.0, + 0.1299426071345806, + 0.0969436727464199, + 0.03979291394352913, + 0.30026957765221596, + 0.6031784154474735, + 0.7611746229231358, + 0.3823439031839371, + 0.0, + 0.12549851834774017, + 0.5319853723049164, + 0.5908121839165688, + 0.0, + 0.029941478744149208, + 0.0, + 2.4449709095060825, + 1.2427433244884014, + 0.5366744175553322 + ], + "unique_experts": 53, + "load_cv": 1.1073242503430352, + "normalized_load_entropy": 0.8665490601011452, + "max_load_share": 0.08333333333333333 + }, + "full_input": { + "tokens": 77, + "top_k": 6, + "decisions": 462, + "ordered_route_sha256": "94e1e17ef20932e712be84977b5b817b55bdf30b33cadb191aaed63682804860", + "route_weight_sha256": "5df2a5148722359d0d030cd7801e105e2969d5321da353b645b277884c1458da", + "loads": [ + 3, + 3, + 1, + 6, + 2, + 10, + 0, + 5, + 18, + 1, + 4, + 2, + 17, + 16, + 0, + 1, + 10, + 2, + 7, + 3, + 3, + 6, + 14, + 13, + 0, + 4, + 3, + 9, + 25, + 10, + 4, + 21, + 2, + 23, + 0, + 14, + 2, + 11, + 15, + 4, + 0, + 9, + 7, + 9, + 4, + 7, + 1, + 7, + 7, + 1, + 4, + 6, + 10, + 6, + 0, + 2, + 12, + 11, + 0, + 3, + 0, + 32, + 18, + 12 + ], + "weighted_loads": [ + 0.15368115529417992, + 0.22570457682013512, + 0.06420762091875076, + 0.19388575106859207, + 0.6459222249686718, + 0.8163696452975273, + 0.0, + 0.35593996942043304, + 1.1219801660627127, + 0.07074441760778427, + 0.15697594359517097, + 0.11815370433032513, + 1.0663065630942583, + 1.0804444812238216, + 0.0, + 0.0410996749997139, + 0.3680537771433592, + 0.14052025973796844, + 0.3615116197615862, + 0.11235442757606506, + 0.12387862801551819, + 0.2644086740911007, + 1.118786795064807, + 1.061820860952139, + 0.0, + 0.19347479566931725, + 0.12106254696846008, + 0.4873616583645344, + 2.498072925955057, + 1.1556397750973701, + 0.17373199202120304, + 1.751371592283249, + 0.08494355157017708, + 2.8318794704973698, + 0.0, + 0.959763091057539, + 0.09622339904308319, + 0.8928774669766426, + 1.0824050307273865, + 0.2334406040608883, + 0.0, + 0.7548118196427822, + 0.4473964162170887, + 0.6410857290029526, + 0.2046753130853176, + 0.48796191811561584, + 0.04625728353857994, + 0.4191351793706417, + 0.4342161938548088, + 0.03979291394352913, + 0.3132245382294059, + 0.6031784154474735, + 0.7611746229231358, + 0.3823439031839371, + 0.0, + 0.12549851834774017, + 0.6312169954180717, + 0.5908121839165688, + 0.0, + 0.11464888509362936, + 0.0, + 2.7035471070557833, + 1.389251945540309, + 0.6321206577122211 + ], + "unique_experts": 56, + "load_cv": 0.9530005855204516, + "normalized_load_entropy": 0.8943595591063942, + "max_load_share": 0.06926406926406926 + } + }, + "s1_x": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "4d736d59b93c21e0638cfa549a2ff74457bfe7930be8a59ba3c605e22ee37037", + "route_weight_sha256": "6fd8e2205c0959c474d4dbb399ebc96b6deaea8d95dda4ab5d7f4478f7519fc9", + "loads": [ + 3, + 3, + 2, + 2, + 1, + 9, + 0, + 2, + 12, + 1, + 4, + 3, + 13, + 16, + 0, + 2, + 3, + 2, + 7, + 4, + 2, + 5, + 12, + 6, + 0, + 2, + 2, + 0, + 8, + 0, + 1, + 13, + 0, + 23, + 0, + 5, + 3, + 7, + 1, + 4, + 0, + 3, + 2, + 9, + 2, + 5, + 0, + 2, + 2, + 1, + 3, + 7, + 10, + 6, + 0, + 2, + 10, + 12, + 0, + 1, + 0, + 27, + 16, + 9 + ], + "weighted_loads": [ + 0.14899490401148796, + 0.21524256467819214, + 0.09128536097705364, + 0.07648316398262978, + 0.047630324959754944, + 0.8372659869492054, + 0.0, + 0.14151401072740555, + 0.8010625652968884, + 0.06290076673030853, + 0.14663276448845863, + 0.17438041046261787, + 0.8415456227958202, + 1.0381618943065405, + 0.0, + 0.07050529308617115, + 0.10919733345508575, + 0.14506515860557556, + 0.3645114004611969, + 0.15050852298736572, + 0.08793313428759575, + 0.2285621017217636, + 1.0239487066864967, + 0.4194847084581852, + 0.0, + 0.10632067546248436, + 0.08665531314909458, + 0.0, + 0.3058191407471895, + 0.0, + 0.0474725104868412, + 1.3002978898584843, + 0.0, + 2.765423921868205, + 0.0, + 0.34913110360503197, + 0.11633665673434734, + 0.7777289934456348, + 0.0468980148434639, + 0.23932164907455444, + 0.0, + 0.16464342549443245, + 0.08447111025452614, + 0.6446119658648968, + 0.09224780276417732, + 0.3748936429619789, + 0.0, + 0.12681521847844124, + 0.09394928440451622, + 0.038715705275535583, + 0.288228552788496, + 0.6338294204324484, + 0.7533723190426826, + 0.39431900158524513, + 0.0, + 0.11881503462791443, + 0.5295848697423935, + 0.6453702189028263, + 0.0, + 0.02952750399708748, + 0.0, + 2.4853608068078756, + 1.3202494569122791, + 0.4894295856356621 + ], + "unique_experts": 52, + "load_cv": 1.143543749793731, + "normalized_load_entropy": 0.8628407306584716, + "max_load_share": 0.08653846153846154 + }, + "full_input": { + "tokens": 93, + "top_k": 6, + "decisions": 558, + "ordered_route_sha256": "f25892e5f8f8dc1252ebbc55635eef622633dd9ec09040c280134b58675e46e6", + "route_weight_sha256": "389c7430189b1bcbddea9e259be4556845c090cfb7ddcc03fadb303f93f4e5f4", + "loads": [ + 7, + 3, + 2, + 4, + 4, + 9, + 0, + 10, + 18, + 4, + 5, + 3, + 16, + 17, + 0, + 2, + 7, + 4, + 8, + 4, + 2, + 8, + 15, + 13, + 0, + 2, + 5, + 8, + 26, + 15, + 13, + 18, + 4, + 27, + 5, + 14, + 3, + 11, + 18, + 4, + 1, + 15, + 10, + 11, + 16, + 10, + 3, + 9, + 10, + 1, + 5, + 7, + 10, + 9, + 0, + 3, + 11, + 16, + 0, + 5, + 2, + 36, + 21, + 9 + ], + "weighted_loads": [ + 0.34198275581002235, + 0.21524256467819214, + 0.09128536097705364, + 0.12927864119410515, + 0.7203853726387024, + 0.8372659869492054, + 0.0, + 0.5871269479393959, + 1.2523386031389236, + 0.3776911646127701, + 0.19000287726521492, + 0.17438041046261787, + 0.9792929515242577, + 1.1401352789252996, + 0.0, + 0.07050529308617115, + 0.36703845486044884, + 0.2590266577899456, + 0.40024661272764206, + 0.15050852298736572, + 0.08793313428759575, + 0.34864805825054646, + 1.1454914212226868, + 1.0053855702280998, + 0.0, + 0.10632067546248436, + 0.20916502736508846, + 0.4336346723139286, + 2.7982995826750994, + 1.7912472821772099, + 0.9579685311764479, + 1.6197251249104738, + 0.1777528077363968, + 3.007623279467225, + 0.2551962547004223, + 1.0558943189680576, + 0.11633665673434734, + 0.9544629920274019, + 1.2655031085014343, + 0.23932164907455444, + 0.029669860377907753, + 1.2415114343166351, + 0.5625390224158764, + 0.7526739276945591, + 1.34162974730134, + 0.722058966755867, + 0.14643818140029907, + 0.46287682093679905, + 0.5406384319067001, + 0.038715705275535583, + 0.3542665420100093, + 0.6338294204324484, + 0.7533723190426826, + 0.5523545742034912, + 0.0, + 0.15015320107340813, + 0.5573651678860188, + 0.8355339206755161, + 0.0, + 0.18605845142155886, + 0.06887535564601421, + 2.9440974090248346, + 1.5498497411608696, + 0.4894295856356621 + ], + "unique_experts": 59, + "load_cv": 0.8291818586382764, + "normalized_load_entropy": 0.9191072259918744, + "max_load_share": 0.06451612903225806 + } + }, + "s0_period": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "a94a6fd0212437562ae6a2630e3f10ea47e7e3c9c9ac78d7f20803a7cb7aeabc", + "route_weight_sha256": "074cd3b3ca6283abd2947be5b6d91d5a8746ac808593359730bc428d1f51ca0e", + "loads": [ + 3, + 3, + 1, + 2, + 1, + 10, + 0, + 2, + 12, + 1, + 3, + 2, + 12, + 15, + 0, + 0, + 5, + 2, + 7, + 3, + 3, + 6, + 12, + 7, + 0, + 4, + 2, + 0, + 8, + 1, + 1, + 15, + 0, + 21, + 0, + 6, + 2, + 7, + 1, + 4, + 0, + 4, + 2, + 8, + 2, + 5, + 0, + 2, + 2, + 2, + 3, + 7, + 10, + 6, + 0, + 3, + 10, + 11, + 0, + 1, + 0, + 27, + 15, + 8 + ], + "weighted_loads": [ + 0.16883407905697823, + 0.22282182052731514, + 0.06341805309057236, + 0.07269790768623352, + 0.043242476880550385, + 0.8023759946227074, + 0.0, + 0.14122642576694489, + 0.7493170611560345, + 0.06643505394458771, + 0.11841252446174622, + 0.1179711390286684, + 0.8416969105601311, + 1.0071440041065216, + 0.0, + 0.0, + 0.18231699243187904, + 0.14305950701236725, + 0.3663238249719143, + 0.1141405887901783, + 0.11734365299344063, + 0.2687036283314228, + 1.0326269268989563, + 0.4308771528303623, + 0.0, + 0.19628895074129105, + 0.09395921602845192, + 0.0, + 0.30865492671728134, + 0.03202565759420395, + 0.05862864479422569, + 1.4069890193641186, + 0.0, + 2.7170888110995293, + 0.0, + 0.39374328032135963, + 0.09786827117204666, + 0.7917590215802193, + 0.037471964955329895, + 0.23635882511734962, + 0.0, + 0.18815073370933533, + 0.07766778767108917, + 0.6143469512462616, + 0.10058724507689476, + 0.39469238743185997, + 0.0, + 0.13270774483680725, + 0.09875307232141495, + 0.0787527970969677, + 0.29977504536509514, + 0.6413249559700489, + 0.7583517171442509, + 0.37789856269955635, + 0.0, + 0.16540680080652237, + 0.5422163009643555, + 0.6032840367406607, + 0.0, + 0.029892774298787117, + 0.0, + 2.4816325195133686, + 1.277499321848154, + 0.4908018112182617 + ], + "unique_experts": 52, + "load_cv": 1.1132458126201237, + "normalized_load_entropy": 0.8665629220478986, + "max_load_share": 0.08653846153846154 + }, + "full_input": { + "tokens": 77, + "top_k": 6, + "decisions": 462, + "ordered_route_sha256": "ccc44dab3096cb05df32ea68b4274ef1ee285e5143c4989ea73cd70dca07c478", + "route_weight_sha256": "64be80fd988a64154320b31469125f812489c0d6bb81ecea2fa612835970d04f", + "loads": [ + 3, + 3, + 1, + 6, + 2, + 10, + 0, + 5, + 18, + 1, + 3, + 2, + 17, + 16, + 0, + 0, + 9, + 2, + 7, + 3, + 3, + 6, + 13, + 14, + 0, + 4, + 3, + 9, + 24, + 10, + 4, + 21, + 1, + 23, + 0, + 14, + 2, + 11, + 15, + 4, + 0, + 11, + 8, + 8, + 4, + 6, + 1, + 8, + 6, + 2, + 4, + 7, + 10, + 6, + 0, + 3, + 12, + 11, + 0, + 3, + 0, + 32, + 20, + 11 + ], + "weighted_loads": [ + 0.16883407905697823, + 0.22282182052731514, + 0.06341805309057236, + 0.19514472037553787, + 0.6457996591925621, + 0.8023759946227074, + 0.0, + 0.3568873144686222, + 1.1427848301827908, + 0.06643505394458771, + 0.11841252446174622, + 0.1179711390286684, + 1.0742924138903618, + 1.1193230375647545, + 0.0, + 0.0, + 0.36845891550183296, + 0.14305950701236725, + 0.3663238249719143, + 0.1141405887901783, + 0.11734365299344063, + 0.2687036283314228, + 1.0826209336519241, + 0.9790591709315777, + 0.0, + 0.19628895074129105, + 0.12674400582909584, + 0.46781666204333305, + 2.51854906976223, + 1.1947744563221931, + 0.15414897538721561, + 1.7541067712008953, + 0.046311717480421066, + 2.8094579465687275, + 0.0, + 0.9422310553491116, + 0.09786827117204666, + 0.9048335403203964, + 1.1051201857626438, + 0.23635882511734962, + 0.0, + 0.8686886876821518, + 0.48094412684440613, + 0.6143469512462616, + 0.2111704684793949, + 0.43408365547657013, + 0.05005744472146034, + 0.4606108423322439, + 0.38342360034585, + 0.0787527970969677, + 0.31273000594228506, + 0.6413249559700489, + 0.7583517171442509, + 0.37789856269955635, + 0.0, + 0.16540680080652237, + 0.6414479240775108, + 0.6032840367406607, + 0.0, + 0.11460018064826727, + 0.0, + 2.6914022341370583, + 1.4722216706722975, + 0.5862480513751507 + ], + "unique_experts": 55, + "load_cv": 0.9564552754977481, + "normalized_load_entropy": 0.892654276483854, + "max_load_share": 0.06926406926406926 + } + }, + "s1_period": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "8acb1cbf110eef10f6b7902f1c4eaeb859f868188b66581166afba0893c096c4", + "route_weight_sha256": "d45ba5f2fe5c7f96e9116ab31a83802b163f02702d380ea794f54ac851a9cf44", + "loads": [ + 3, + 3, + 1, + 2, + 1, + 10, + 0, + 2, + 12, + 1, + 4, + 3, + 13, + 16, + 0, + 2, + 4, + 2, + 7, + 3, + 2, + 6, + 12, + 6, + 0, + 2, + 2, + 0, + 7, + 1, + 1, + 13, + 0, + 22, + 0, + 5, + 3, + 7, + 1, + 4, + 0, + 3, + 2, + 9, + 2, + 5, + 0, + 2, + 2, + 1, + 3, + 7, + 10, + 6, + 0, + 2, + 10, + 12, + 0, + 1, + 0, + 27, + 16, + 9 + ], + "weighted_loads": [ + 0.17064466699957848, + 0.22070515528321266, + 0.06178336963057518, + 0.07828914374113083, + 0.04694800078868866, + 0.8490028344094753, + 0.0, + 0.1435561627149582, + 0.7863866463303566, + 0.06434717029333115, + 0.1599058248102665, + 0.16840903647243977, + 0.8386780172586441, + 1.0185780301690102, + 0.0, + 0.0721373688429594, + 0.13138788007199764, + 0.14134911447763443, + 0.35655372962355614, + 0.12165104225277901, + 0.09095143899321556, + 0.2674512155354023, + 1.0179018191993237, + 0.40888144448399544, + 0.0, + 0.10955866426229477, + 0.08797367475926876, + 0.0, + 0.2917448990046978, + 0.029947923496365547, + 0.043179865926504135, + 1.29902945458889, + 0.0, + 2.7157701030373573, + 0.0, + 0.36140990257263184, + 0.12115384079515934, + 0.7770136892795563, + 0.044843386858701706, + 0.24521631374955177, + 0.0, + 0.1624179482460022, + 0.08118194714188576, + 0.6367548182606697, + 0.09854118525981903, + 0.37215230241417885, + 0.0, + 0.1301584541797638, + 0.09204884245991707, + 0.03776112571358681, + 0.28919898346066475, + 0.6411989629268646, + 0.7540828287601471, + 0.3864488862454891, + 0.0, + 0.12193591147661209, + 0.5270733833312988, + 0.6369751896709204, + 0.0, + 0.029039723798632622, + 0.0, + 2.4760921373963356, + 1.3165056593716145, + 0.5268026106059551 + ], + "unique_experts": 53, + "load_cv": 1.1343075056715213, + "normalized_load_entropy": 0.8648134093225232, + "max_load_share": 0.08653846153846154 + }, + "full_input": { + "tokens": 93, + "top_k": 6, + "decisions": 558, + "ordered_route_sha256": "feea91332f7abef9c46f0ae4dcfa9e40bac3485010214459a55af6b7bdf75193", + "route_weight_sha256": "37974df10a7f05373776493f56f05f1c9f9b6496ceba07b7aaa1174c140a9630", + "loads": [ + 7, + 3, + 1, + 4, + 4, + 10, + 0, + 11, + 18, + 4, + 5, + 3, + 16, + 17, + 0, + 2, + 8, + 4, + 8, + 3, + 2, + 8, + 15, + 13, + 0, + 2, + 5, + 7, + 26, + 15, + 12, + 18, + 4, + 27, + 5, + 14, + 3, + 11, + 19, + 4, + 1, + 16, + 11, + 11, + 16, + 9, + 3, + 9, + 9, + 1, + 5, + 7, + 10, + 9, + 0, + 3, + 11, + 16, + 0, + 4, + 2, + 36, + 22, + 9 + ], + "weighted_loads": [ + 0.36363251879811287, + 0.22070515528321266, + 0.06178336963057518, + 0.1310846209526062, + 0.7197030484676361, + 0.8490028344094753, + 0.0, + 0.6279764082282782, + 1.236793253570795, + 0.3791375681757927, + 0.20327593758702278, + 0.16840903647243977, + 0.9730642959475517, + 1.122249148786068, + 0.0, + 0.0721373688429594, + 0.40178646706044674, + 0.25531061366200447, + 0.3922889418900013, + 0.12165104225277901, + 0.09095143899321556, + 0.35677413642406464, + 1.1394445337355137, + 0.9123949930071831, + 0.0, + 0.10955866426229477, + 0.21048338897526264, + 0.3586306981742382, + 2.8467035368084908, + 1.7795508671551943, + 0.9064037185162306, + 1.6067333947867155, + 0.1777528077363968, + 3.005017638206482, + 0.2551962547004223, + 1.0234836898744106, + 0.12115384079515934, + 0.9537476878613234, + 1.304967936128378, + 0.24521631374955177, + 0.029669860377907753, + 1.3541703335940838, + 0.5974118076264858, + 0.744816780090332, + 1.357619110494852, + 0.677944790571928, + 0.16015326976776123, + 0.48839924670755863, + 0.4917082451283932, + 0.03776112571358681, + 0.355236972682178, + 0.6411989629268646, + 0.7540828287601471, + 0.5444844588637352, + 0.0, + 0.1532740779221058, + 0.5548536814749241, + 0.8271388914436102, + 0.0, + 0.1408047927543521, + 0.06887535564601421, + 2.9347221218049526, + 1.582421451807022, + 0.5268026106059551 + ], + "unique_experts": 59, + "load_cv": 0.8402629369208531, + "normalized_load_entropy": 0.9167310306501981, + "max_load_share": 0.06451612903225806 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 52, + "ordered_topk_exact_tokens": 33, + "set_exact_tokens": 40, + "mean_set_jaccard": 0.9340659340659341, + "mean_token_weighted_tv": 0.014360280313457433, + "aggregate_load_tv": 0.028846153846153844 + }, + "system_bos": { + "tokens": 52, + "ordered_topk_exact_tokens": 32, + "set_exact_tokens": 38, + "mean_set_jaccard": 0.918956043956044, + "mean_token_weighted_tv": 0.018903756729112223, + "aggregate_load_tv": 0.035256410256410256 + }, + "system_x": { + "tokens": 52, + "ordered_topk_exact_tokens": 29, + "set_exact_tokens": 34, + "mean_set_jaccard": 0.9010989010989012, + "mean_token_weighted_tv": 0.0231080052192108, + "aggregate_load_tv": 0.04807692307692307 + }, + "system_period": { + "tokens": 52, + "ordered_topk_exact_tokens": 29, + "set_exact_tokens": 35, + "mean_set_jaccard": 0.9065934065934065, + "mean_token_weighted_tv": 0.02224525800333, + "aggregate_load_tv": 0.038461538461538464 + }, + "bos_at_s0": { + "tokens": 52, + "ordered_topk_exact_tokens": 28, + "set_exact_tokens": 39, + "mean_set_jaccard": 0.9203296703296704, + "mean_token_weighted_tv": 0.02230065666998808, + "aggregate_load_tv": 0.03205128205128205 + }, + "bos_at_s1": { + "tokens": 52, + "ordered_topk_exact_tokens": 30, + "set_exact_tokens": 36, + "mean_set_jaccard": 0.907967032967033, + "mean_token_weighted_tv": 0.02403206707766423, + "aggregate_load_tv": 0.035256410256410256 + }, + "x_at_s0": { + "tokens": 52, + "ordered_topk_exact_tokens": 21, + "set_exact_tokens": 30, + "mean_set_jaccard": 0.8791208791208793, + "mean_token_weighted_tv": 0.027858135290443897, + "aggregate_load_tv": 0.044871794871794865 + }, + "x_at_s1": { + "tokens": 52, + "ordered_topk_exact_tokens": 25, + "set_exact_tokens": 32, + "mean_set_jaccard": 0.881868131868132, + "mean_token_weighted_tv": 0.028445613373500798, + "aggregate_load_tv": 0.04807692307692308 + }, + "period_at_s0": { + "tokens": 52, + "ordered_topk_exact_tokens": 25, + "set_exact_tokens": 33, + "mean_set_jaccard": 0.8914835164835165, + "mean_token_weighted_tv": 0.026090765031627737, + "aggregate_load_tv": 0.038461538461538464 + }, + "period_at_s1": { + "tokens": 52, + "ordered_topk_exact_tokens": 25, + "set_exact_tokens": 32, + "mean_set_jaccard": 0.8859890109890111, + "mean_token_weighted_tv": 0.02780489963837541, + "aggregate_load_tv": 0.04487179487179487 + } + } + }, + "layer_13": { + "layer": 13, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "a40db3588e8cfd13c70c31608630f541c4995431b42b5e1aeb7dd0bcaaaf3d10", + "route_weight_sha256": "e6c21e4320f38f25226c58ef90c89eaf15c7538053ef20257897f002cc09801e", + "loads": [ + 1, + 12, + 2, + 2, + 2, + 12, + 3, + 2, + 0, + 1, + 14, + 1, + 0, + 4, + 1, + 14, + 8, + 2, + 2, + 0, + 0, + 3, + 9, + 3, + 5, + 2, + 15, + 6, + 5, + 0, + 0, + 5, + 9, + 4, + 5, + 18, + 10, + 1, + 4, + 0, + 2, + 4, + 0, + 1, + 1, + 12, + 9, + 4, + 20, + 0, + 1, + 0, + 0, + 1, + 10, + 1, + 1, + 5, + 1, + 2, + 9, + 15, + 4, + 22 + ], + "weighted_loads": [ + 0.033019013702869415, + 0.5732133369892836, + 0.07294296845793724, + 0.07993557304143906, + 0.07564239203929901, + 0.5707877371460199, + 0.10613519698381424, + 0.11149267852306366, + 0.0, + 0.046244654804468155, + 1.0552486293017864, + 0.04286333918571472, + 0.0, + 0.1546105518937111, + 0.03271213918924332, + 1.0294033773243427, + 0.3628016319125891, + 0.06383437290787697, + 0.07584565877914429, + 0.0, + 0.0, + 0.14720520563423634, + 0.5599927995353937, + 0.11761336401104927, + 0.20827213674783707, + 0.07789529487490654, + 0.5267159901559353, + 0.3865700326859951, + 0.18203837983310223, + 0.0, + 0.0, + 0.3869495093822479, + 0.4273337721824646, + 0.26482027024030685, + 0.20126543194055557, + 2.8925289437174797, + 0.6240459941327572, + 0.029284952208399773, + 0.19883747398853302, + 0.0, + 0.07571014761924744, + 0.13173376582562923, + 0.0, + 0.029077930375933647, + 0.02630528435111046, + 1.1994395144283772, + 0.46195749193429947, + 0.14368247613310814, + 2.104171220213175, + 0.0, + 0.04349385201931, + 0.0, + 0.0, + 0.04531169682741165, + 0.6967602223157883, + 0.048248808830976486, + 0.040001168847084045, + 0.28920647129416466, + 0.030167479068040848, + 0.105644091963768, + 0.5281100608408451, + 1.1194929368793964, + 0.2573496885597706, + 1.5779663491994143 + ], + "unique_experts": 53, + "load_cv": 1.1120640226769969, + "normalized_load_entropy": 0.8622815049181572, + "max_load_share": 0.07051282051282051 + }, + "full_input": { + "tokens": 77, + "top_k": 6, + "decisions": 462, + "ordered_route_sha256": "e48fc6b6b91ff63189f6cd515697095825d785509350aac99688a916f9aaf75c", + "route_weight_sha256": "0c7a475a8634e2c96d6d2afdfe1943882d4a6ddec36ba7d6b80ca9a9f59c818f", + "loads": [ + 1, + 17, + 2, + 2, + 2, + 12, + 19, + 2, + 0, + 4, + 24, + 7, + 0, + 4, + 2, + 20, + 8, + 4, + 3, + 1, + 0, + 5, + 9, + 4, + 9, + 2, + 18, + 6, + 5, + 12, + 1, + 5, + 10, + 10, + 6, + 18, + 14, + 2, + 4, + 1, + 2, + 8, + 3, + 3, + 12, + 22, + 11, + 6, + 21, + 1, + 2, + 0, + 4, + 4, + 12, + 1, + 4, + 5, + 7, + 7, + 9, + 16, + 4, + 23 + ], + "weighted_loads": [ + 0.033019013702869415, + 0.8359053675085306, + 0.07294296845793724, + 0.07993557304143906, + 0.07564239203929901, + 0.5707877371460199, + 1.4731852672994137, + 0.11149267852306366, + 0.0, + 0.1622812319546938, + 1.7309781275689602, + 0.3596292668953538, + 0.0, + 0.1546105518937111, + 0.07799070701003075, + 1.3385808058083057, + 0.3628016319125891, + 0.1117053059861064, + 0.11764157563447952, + 0.045552294701337814, + 0.0, + 0.25340342707931995, + 0.5599927995353937, + 0.17544230818748474, + 0.3897118382155895, + 0.07789529487490654, + 0.650173507630825, + 0.3865700326859951, + 0.18203837983310223, + 0.7399646155536175, + 0.04378461837768555, + 0.3869495093822479, + 0.4604974538087845, + 0.9915697611868382, + 0.22413161769509315, + 2.8925289437174797, + 0.8730778899043798, + 0.06295778416097164, + 0.19883747398853302, + 0.03522319719195366, + 0.07571014761924744, + 0.3344744201749563, + 0.1379496455192566, + 0.1248281467705965, + 0.7741630971431732, + 2.157805759459734, + 0.5270868837833405, + 1.3361177407205105, + 2.1362478509545326, + 0.04093454033136368, + 0.08222141489386559, + 0.0, + 0.14375486969947815, + 0.18450858816504478, + 0.7852006889879704, + 0.048248808830976486, + 0.20459239184856415, + 0.28920647129416466, + 0.32695077918469906, + 0.34458785131573677, + 0.5281100608408451, + 1.1491805110126734, + 0.2573496885597706, + 1.6158691886812449 + ], + "unique_experts": 60, + "load_cv": 0.8965847675611531, + "normalized_load_entropy": 0.9071713784874894, + "max_load_share": 0.05194805194805195 + } + }, + "s1_eos": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "f640bb8aa8577ab2d9a85233c8d02a49ac771798bcd090481e4714f94e99054f", + "route_weight_sha256": "229d19db4f5a3cfa885020f54695b1f7b0881002c661160a43206ef629f576f8", + "loads": [ + 1, + 12, + 2, + 2, + 2, + 11, + 4, + 2, + 0, + 1, + 14, + 2, + 0, + 4, + 0, + 13, + 8, + 2, + 2, + 0, + 0, + 3, + 8, + 4, + 4, + 2, + 18, + 6, + 5, + 0, + 0, + 5, + 9, + 4, + 3, + 18, + 10, + 0, + 4, + 0, + 2, + 4, + 0, + 1, + 0, + 13, + 8, + 5, + 19, + 0, + 1, + 0, + 0, + 1, + 10, + 1, + 1, + 5, + 1, + 3, + 10, + 14, + 4, + 24 + ], + "weighted_loads": [ + 0.032257482409477234, + 0.5892286486923695, + 0.07058433070778847, + 0.07677502930164337, + 0.07629719004034996, + 0.5279262624680996, + 0.14228642359375954, + 0.11163775995373726, + 0.0, + 0.04494524002075195, + 1.0365246832370758, + 0.07460209727287292, + 0.0, + 0.14767849259078503, + 0.0, + 0.9825080707669258, + 0.36454229429364204, + 0.060973918065428734, + 0.06940620765089989, + 0.0, + 0.0, + 0.15005582757294178, + 0.5267486684024334, + 0.15019559860229492, + 0.17913378775119781, + 0.08258219435811043, + 0.606879347935319, + 0.3832067959010601, + 0.18258894607424736, + 0.0, + 0.0, + 0.38243894651532173, + 0.42683329805731773, + 0.2632380835711956, + 0.14741547778248787, + 2.8803142681717873, + 0.6112411245703697, + 0.0, + 0.20086310058832169, + 0.0, + 0.07452952489256859, + 0.14081105962395668, + 0.0, + 0.028798284009099007, + 0.0, + 1.2348834462463856, + 0.42943597584962845, + 0.1742919236421585, + 2.045072801411152, + 0.0, + 0.04101155325770378, + 0.0, + 0.0, + 0.04463665559887886, + 0.6942840982228518, + 0.050845917314291, + 0.04240604117512703, + 0.27455350384116173, + 0.028296928852796555, + 0.1490813009440899, + 0.5562360566109419, + 1.0956601276993752, + 0.26487117260694504, + 1.6207387316972017 + ], + "unique_experts": 50, + "load_cv": 1.1372018903352146, + "normalized_load_entropy": 0.8557092061374203, + "max_load_share": 0.07692307692307693 + }, + "full_input": { + "tokens": 93, + "top_k": 6, + "decisions": 558, + "ordered_route_sha256": "4d1dc4a958df2eb1d93bb3e83aa045e34e4b672691aa8857f1cb690e380ea884", + "route_weight_sha256": "4d4d0586b002454a86c5aa100dd536074c264c0a04ecbda2b4beec628bb6b12c", + "loads": [ + 6, + 17, + 2, + 2, + 2, + 12, + 32, + 2, + 0, + 4, + 25, + 14, + 0, + 4, + 1, + 20, + 8, + 4, + 4, + 3, + 0, + 8, + 8, + 8, + 8, + 2, + 22, + 6, + 5, + 19, + 8, + 6, + 10, + 15, + 6, + 19, + 15, + 1, + 5, + 1, + 4, + 10, + 8, + 2, + 16, + 24, + 10, + 8, + 21, + 6, + 2, + 0, + 2, + 3, + 12, + 3, + 4, + 16, + 9, + 7, + 11, + 16, + 4, + 26 + ], + "weighted_loads": [ + 0.23470711708068848, + 0.8539583012461662, + 0.07058433070778847, + 0.07677502930164337, + 0.07629719004034996, + 0.563937958329916, + 2.4589312486350536, + 0.11163775995373726, + 0.0, + 0.16625372134149075, + 1.7470196522772312, + 0.8936300165951252, + 0.0, + 0.14767849259078503, + 0.04368198662996292, + 1.3629414327442646, + 0.36454229429364204, + 0.11353745497763157, + 0.13541199080646038, + 0.1226227805018425, + 0.0, + 0.41535040736198425, + 0.5267486684024334, + 0.31457826122641563, + 0.38946265494450927, + 0.08258219435811043, + 0.7634804211556911, + 0.3832067959010601, + 0.18258894607424736, + 1.483059423044324, + 0.4350193776190281, + 0.42174157127738, + 0.4615408107638359, + 1.4657637923955917, + 0.3719492740929127, + 2.9354330487549305, + 0.9479461703449488, + 0.033387187868356705, + 0.24375976622104645, + 0.044785454869270325, + 0.15760918334126472, + 0.4368392117321491, + 0.6658008713275194, + 0.10325435735285282, + 1.1805353872478008, + 2.2192286998033524, + 0.5022263266146183, + 1.403507862240076, + 2.2963727489113808, + 0.2774028070271015, + 0.0776037648320198, + 0.0, + 0.06810076162219048, + 0.12488994374871254, + 0.7641212772578001, + 0.1231631226837635, + 0.18777593597769737, + 0.9822565764188766, + 0.39393439143896103, + 0.3492431491613388, + 0.5842930655926466, + 1.1843045614659786, + 0.26487117260694504, + 1.7085794117301702 + ], + "unique_experts": 60, + "load_cv": 0.8531294197916832, + "normalized_load_entropy": 0.9144999737092967, + "max_load_share": 0.05734767025089606 + } + }, + "s0_bos": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "4ed95602a76dddf2601020a4296aea58108ed25267e21ed6c127c4232f21098e", + "route_weight_sha256": "c34978f98f5ebe13096f1909ea4b1b14575f54e5b59226043dd2d4d86f597a5e", + "loads": [ + 1, + 13, + 2, + 2, + 1, + 14, + 3, + 2, + 0, + 1, + 12, + 1, + 0, + 4, + 1, + 14, + 8, + 2, + 2, + 0, + 0, + 2, + 10, + 4, + 2, + 2, + 11, + 6, + 4, + 0, + 1, + 5, + 9, + 5, + 6, + 18, + 11, + 0, + 4, + 0, + 2, + 4, + 0, + 2, + 1, + 13, + 7, + 5, + 20, + 0, + 1, + 0, + 0, + 2, + 12, + 1, + 1, + 5, + 3, + 3, + 9, + 14, + 4, + 20 + ], + "weighted_loads": [ + 0.032454054802656174, + 0.6029345523566008, + 0.07553425058722496, + 0.0792359746992588, + 0.04089897871017456, + 0.6354058645665646, + 0.10926301404833794, + 0.12448623776435852, + 0.0, + 0.04641399532556534, + 0.9597826935350895, + 0.04276976361870766, + 0.0, + 0.14335570484399796, + 0.03701996058225632, + 1.0485494248569012, + 0.32316040620207787, + 0.06401768885552883, + 0.08002062514424324, + 0.0, + 0.0, + 0.12191897630691528, + 0.5869094152003527, + 0.15473973378539085, + 0.09972812980413437, + 0.07999070733785629, + 0.3945860546082258, + 0.3930462747812271, + 0.15138116851449013, + 0.0, + 0.025041205808520317, + 0.38823311775922775, + 0.44102904200553894, + 0.2990780547261238, + 0.23599493317306042, + 2.968406580388546, + 0.6200652308762074, + 0.0, + 0.1930813007056713, + 0.0, + 0.07364314049482346, + 0.13037110678851604, + 0.0, + 0.05859998241066933, + 0.026063228026032448, + 1.2018503788858652, + 0.37539209611713886, + 0.17227608151733875, + 2.0820325575768948, + 0.0, + 0.04354830086231232, + 0.0, + 0.0, + 0.0806565098464489, + 0.7882396746426821, + 0.04997684434056282, + 0.040016788989305496, + 0.29463018476963043, + 0.08641302026808262, + 0.15198741108179092, + 0.5351630784571171, + 1.1016310788691044, + 0.2703726477921009, + 1.4624114129692316 + ], + "unique_experts": 53, + "load_cv": 1.0827072990111493, + "normalized_load_entropy": 0.867088992305566, + "max_load_share": 0.0641025641025641 + }, + "full_input": { + "tokens": 77, + "top_k": 6, + "decisions": 462, + "ordered_route_sha256": "0875b8c4f9ac60a0bd1e18497f382a06c4214949055ccb468455865298296eaf", + "route_weight_sha256": "541c33774363ec98865e763c2485764f7f2c8d29e975d7e3892d296722cdc578", + "loads": [ + 1, + 19, + 3, + 2, + 2, + 14, + 19, + 2, + 0, + 6, + 22, + 5, + 0, + 4, + 1, + 20, + 8, + 3, + 3, + 1, + 0, + 5, + 10, + 5, + 5, + 2, + 14, + 6, + 4, + 13, + 1, + 5, + 10, + 10, + 7, + 18, + 14, + 1, + 4, + 1, + 2, + 8, + 3, + 4, + 12, + 23, + 9, + 6, + 21, + 1, + 2, + 0, + 4, + 6, + 14, + 1, + 5, + 5, + 9, + 8, + 9, + 15, + 4, + 21 + ], + "weighted_loads": [ + 0.032454054802656174, + 0.9306753110140562, + 0.14614393934607506, + 0.0792359746992588, + 0.0913005881011486, + 0.6354058645665646, + 1.5168612599372864, + 0.12448623776435852, + 0.0, + 0.2756910566240549, + 1.5801874548196793, + 0.2891533989459276, + 0.0, + 0.14335570484399796, + 0.03701996058225632, + 1.3577268533408642, + 0.32316040620207787, + 0.0989005845040083, + 0.12181654199957848, + 0.045552294701337814, + 0.0, + 0.27149274572730064, + 0.5869094152003527, + 0.21343949064612389, + 0.27758421935141087, + 0.07999070733785629, + 0.5180435720831156, + 0.3930462747812271, + 0.15138116851449013, + 0.7558358572423458, + 0.025041205808520317, + 0.38823311775922775, + 0.47721050679683685, + 0.9768340662121773, + 0.258861118927598, + 2.968406580388546, + 0.8336865995079279, + 0.03367283195257187, + 0.1930813007056713, + 0.03522319719195366, + 0.07364314049482346, + 0.333279388025403, + 0.15964125096797943, + 0.16809216514229774, + 0.7847003396600485, + 2.160216623917222, + 0.44052148796617985, + 0.5334896463900805, + 2.1141091883182526, + 0.04535295069217682, + 0.0822758637368679, + 0.0, + 0.14375486969947815, + 0.2839060351252556, + 0.8766801413148642, + 0.04997684434056282, + 0.32337386533617973, + 0.29463018476963043, + 0.383188359439373, + 0.3909311704337597, + 0.5351630784571171, + 1.1313186530023813, + 0.2703726477921009, + 1.5003142524510622 + ], + "unique_experts": 60, + "load_cv": 0.8820870831349172, + "normalized_load_entropy": 0.9082968653473256, + "max_load_share": 0.049783549783549784 + } + }, + "s1_bos": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "ad81aab68e594e5c5f3a951ab907429a9712d3f43a77416984bcdfcc284aa800", + "route_weight_sha256": "a0c3bc6143a35ec3fcdbe0a3cd02b08347bf5bf6ba9aa2175344d2aeee6d1a72", + "loads": [ + 1, + 14, + 2, + 2, + 2, + 14, + 1, + 2, + 0, + 1, + 14, + 1, + 0, + 4, + 1, + 13, + 8, + 2, + 2, + 0, + 0, + 2, + 11, + 3, + 2, + 2, + 11, + 6, + 4, + 0, + 1, + 5, + 8, + 5, + 4, + 18, + 12, + 0, + 4, + 0, + 2, + 5, + 0, + 2, + 1, + 13, + 7, + 5, + 18, + 0, + 1, + 0, + 0, + 2, + 12, + 1, + 1, + 5, + 4, + 3, + 9, + 15, + 4, + 20 + ], + "weighted_loads": [ + 0.03361973538994789, + 0.6755102761089802, + 0.06820839270949364, + 0.07564182579517365, + 0.0798664316534996, + 0.6205814275890589, + 0.05184105783700943, + 0.12822241336107254, + 0.0, + 0.05085858330130577, + 1.0091554038226604, + 0.04693172127008438, + 0.0, + 0.1431148797273636, + 0.03363553062081337, + 0.9666355550289154, + 0.3362963255494833, + 0.06497703865170479, + 0.08385403826832771, + 0.0, + 0.0, + 0.12817446142435074, + 0.6222764421254396, + 0.11483681946992874, + 0.10850806906819344, + 0.08826571330428123, + 0.37758168391883373, + 0.38960565254092216, + 0.1517379991710186, + 0.0, + 0.025069765746593475, + 0.3901933766901493, + 0.4112357757985592, + 0.30730064027011395, + 0.17467515729367733, + 2.9694351591169834, + 0.6755142658948898, + 0.0, + 0.19523868337273598, + 0.0, + 0.07090775109827518, + 0.15417157113552094, + 0.0, + 0.05792882479727268, + 0.02771514654159546, + 1.1923420391976833, + 0.3928564805537462, + 0.17617943324148655, + 1.9917002283036709, + 0.0, + 0.040402308106422424, + 0.0, + 0.0, + 0.08252133429050446, + 0.7959465440362692, + 0.04980192705988884, + 0.03908926993608475, + 0.29761648550629616, + 0.11644846014678478, + 0.14869551174342632, + 0.5338125340640545, + 1.1351899094879627, + 0.28711891546845436, + 1.4430501144379377 + ], + "unique_experts": 53, + "load_cv": 1.0875543620742818, + "normalized_load_entropy": 0.8655826787006332, + "max_load_share": 0.0641025641025641 + }, + "full_input": { + "tokens": 93, + "top_k": 6, + "decisions": 558, + "ordered_route_sha256": "212fd9aebf5e7a1cc70e51d369d3a2adc253bd2c3fd7eb737a0a51940b4cc2c6", + "route_weight_sha256": "749b7cb5cf41c1f008f430c921587cedff00ee44180b3d309eb42ee9d03b4e82", + "loads": [ + 6, + 20, + 3, + 2, + 2, + 15, + 29, + 2, + 0, + 5, + 25, + 11, + 0, + 4, + 1, + 20, + 8, + 3, + 4, + 3, + 0, + 7, + 11, + 7, + 6, + 2, + 15, + 6, + 4, + 19, + 9, + 6, + 9, + 16, + 7, + 19, + 18, + 1, + 5, + 1, + 4, + 11, + 8, + 3, + 17, + 24, + 9, + 7, + 20, + 6, + 2, + 0, + 2, + 4, + 14, + 3, + 5, + 16, + 12, + 7, + 10, + 17, + 4, + 22 + ], + "weighted_loads": [ + 0.23606937006115913, + 1.0079747401177883, + 0.11925547569990158, + 0.07564182579517365, + 0.0798664316534996, + 0.6565931234508753, + 2.448633197695017, + 0.12822241336107254, + 0.0, + 0.23837117291986942, + 1.728176310658455, + 0.7910366747528315, + 0.0, + 0.1431148797273636, + 0.03363553062081337, + 1.3470689170062542, + 0.3362963255494833, + 0.10387058556079865, + 0.1498598214238882, + 0.1226227805018425, + 0.0, + 0.39908004738390446, + 0.6222764421254396, + 0.29162368550896645, + 0.3758265096694231, + 0.08826571330428123, + 0.5341827571392059, + 0.38960565254092216, + 0.1517379991710186, + 1.4964107368141413, + 0.4553757905960083, + 0.42949600145220757, + 0.44584105908870697, + 1.5129903573542833, + 0.39920895360410213, + 3.0245539397001266, + 1.0667779464274645, + 0.033387187868356705, + 0.23813534900546074, + 0.044785454869270325, + 0.15398740954697132, + 0.4422307573258877, + 0.6760381329804659, + 0.13376911915838718, + 1.2258459441363811, + 2.17668729275465, + 0.4656468313187361, + 0.5758560132235289, + 2.2430001758038998, + 0.2851506508886814, + 0.07699451968073845, + 0.0, + 0.06810076162219048, + 0.16277462244033813, + 0.8657837230712175, + 0.12211913242936134, + 0.22603827342391014, + 1.005319558084011, + 0.45163557678461075, + 0.34885735996067524, + 0.5618695430457592, + 1.2238343432545662, + 0.28711891546845436, + 1.5308907944709063 + ], + "unique_experts": 60, + "load_cv": 0.8222115975852002, + "normalized_load_entropy": 0.9182970527244261, + "max_load_share": 0.05197132616487455 + } + }, + "s0_x": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "bdb117fd1874f517e3e6efadaa056d72f32b70e4efb486cebacb79d2ab9d9152", + "route_weight_sha256": "89fa88a012eade97cec63ab6850156d4590fc77842c1c89ddff60501b380e6da", + "loads": [ + 1, + 11, + 2, + 2, + 2, + 14, + 3, + 1, + 0, + 1, + 14, + 1, + 0, + 4, + 2, + 14, + 7, + 2, + 3, + 0, + 0, + 2, + 9, + 5, + 2, + 2, + 13, + 6, + 4, + 0, + 1, + 5, + 9, + 5, + 5, + 18, + 11, + 0, + 4, + 0, + 2, + 4, + 0, + 1, + 1, + 13, + 8, + 4, + 19, + 0, + 1, + 0, + 0, + 1, + 11, + 1, + 1, + 5, + 2, + 3, + 9, + 14, + 4, + 23 + ], + "weighted_loads": [ + 0.03331000730395317, + 0.5542290937155485, + 0.0712440237402916, + 0.07953647524118423, + 0.07050727680325508, + 0.6533515527844429, + 0.12136838771402836, + 0.08868537843227386, + 0.0, + 0.04329974949359894, + 1.0278042238205671, + 0.04232307896018028, + 0.0, + 0.15573878958821297, + 0.07079831510782242, + 1.035751223564148, + 0.3070139866322279, + 0.0654251966625452, + 0.109392449259758, + 0.0, + 0.0, + 0.12230240926146507, + 0.557990588247776, + 0.18619896471500397, + 0.09887495636940002, + 0.08545052260160446, + 0.44680164009332657, + 0.3934803418815136, + 0.15189050883054733, + 0.0, + 0.02601657621562481, + 0.3938652314245701, + 0.44333434104919434, + 0.3043727073818445, + 0.21958570741117, + 2.9504812248051167, + 0.6299956664443016, + 0.0, + 0.18234633654356003, + 0.0, + 0.07520439848303795, + 0.12964838556945324, + 0.0, + 0.03328587859869003, + 0.027834760025143623, + 1.1823131795972586, + 0.38485126942396164, + 0.14351336285471916, + 2.025794442743063, + 0.0, + 0.04232339188456535, + 0.0, + 0.0, + 0.04943901300430298, + 0.7159269470721483, + 0.04628092795610428, + 0.04129374027252197, + 0.2895127758383751, + 0.06478738971054554, + 0.15098079852759838, + 0.5402148105204105, + 1.0888207256793976, + 0.26718179136514664, + 1.5677660778164864 + ], + "unique_experts": 53, + "load_cv": 1.1085110933957583, + "normalized_load_entropy": 0.8635617753290856, + "max_load_share": 0.07371794871794872 + }, + "full_input": { + "tokens": 77, + "top_k": 6, + "decisions": 462, + "ordered_route_sha256": "c9fa424387f53527125f425f4382417ab3d6d5d674e322d301463c5eda35c0bb", + "route_weight_sha256": "a9668e80dbecb8b06f63b95183fa1f2fcfe4781d17dc3d92e3f26fbf34f4b337", + "loads": [ + 1, + 16, + 2, + 2, + 2, + 14, + 19, + 1, + 0, + 4, + 25, + 6, + 0, + 4, + 2, + 21, + 7, + 3, + 4, + 1, + 0, + 5, + 9, + 6, + 7, + 2, + 16, + 6, + 4, + 12, + 1, + 5, + 10, + 11, + 6, + 18, + 14, + 1, + 4, + 1, + 2, + 8, + 3, + 2, + 14, + 24, + 11, + 5, + 20, + 1, + 2, + 0, + 4, + 4, + 13, + 1, + 4, + 5, + 7, + 8, + 9, + 15, + 4, + 24 + ], + "weighted_loads": [ + 0.03331000730395317, + 0.7940409872680902, + 0.0712440237402916, + 0.07953647524118423, + 0.07050727680325508, + 0.6533515527844429, + 1.483383970335126, + 0.08868537843227386, + 0.0, + 0.14891083352267742, + 1.6472843680530787, + 0.3392782900482416, + 0.0, + 0.15573878958821297, + 0.07079831510782242, + 1.5647598505020142, + 0.3070139866322279, + 0.10030809231102467, + 0.15118836611509323, + 0.045552294701337814, + 0.0, + 0.27776074409484863, + 0.557990588247776, + 0.2551979348063469, + 0.3581437598913908, + 0.08545052260160446, + 0.5702591575682163, + 0.3934803418815136, + 0.15189050883054733, + 0.7236844599246979, + 0.02601657621562481, + 0.3938652314245701, + 0.48472535610198975, + 1.0300328712910414, + 0.2424518931657076, + 2.9504812248051167, + 0.8340071272104979, + 0.03367283195257187, + 0.18234633654356003, + 0.03522319719195366, + 0.07520439848303795, + 0.3296837564557791, + 0.13406745344400406, + 0.07827988266944885, + 0.9222404155880213, + 2.3391167279332876, + 0.4789876639842987, + 0.5047269277274609, + 2.0578710734844208, + 0.04048535227775574, + 0.08105095475912094, + 0.0, + 0.14375486969947815, + 0.1886359043419361, + 0.8043674137443304, + 0.04628092795610428, + 0.20588496327400208, + 0.2895127758383751, + 0.33015626296401024, + 0.38992455787956715, + 0.5402148105204105, + 1.1185082998126745, + 0.26718179136514664, + 1.605668917298317 + ], + "unique_experts": 60, + "load_cv": 0.9213256285244532, + "normalized_load_entropy": 0.9025693011995893, + "max_load_share": 0.05411255411255411 + } + }, + "s1_x": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "97e1269f3cbba4fd78664e927cfdff80b940ec7190143aec6586272927acf7cf", + "route_weight_sha256": "d87c9b8527b73686b034472a36e607a72d27e6832f061e9beae8171c267f0563", + "loads": [ + 1, + 13, + 1, + 2, + 1, + 13, + 4, + 2, + 0, + 1, + 15, + 2, + 0, + 3, + 1, + 12, + 7, + 2, + 2, + 0, + 0, + 2, + 10, + 2, + 3, + 4, + 14, + 6, + 5, + 0, + 1, + 5, + 9, + 5, + 5, + 18, + 13, + 0, + 4, + 0, + 2, + 4, + 1, + 0, + 1, + 12, + 8, + 4, + 18, + 0, + 1, + 0, + 0, + 1, + 13, + 1, + 2, + 5, + 1, + 2, + 9, + 15, + 4, + 20 + ], + "weighted_loads": [ + 0.033937834203243256, + 0.6192888021469116, + 0.029820989817380905, + 0.07891543582081795, + 0.038521137088537216, + 0.5673226397484541, + 0.15200052596628666, + 0.11980780400335789, + 0.0, + 0.046135447919368744, + 1.0229211803525686, + 0.07436558231711388, + 0.0, + 0.1160723865032196, + 0.03459843248128891, + 0.8987879361957312, + 0.3214654978364706, + 0.06738385930657387, + 0.08273250982165337, + 0.0, + 0.0, + 0.12612932920455933, + 0.5933239459991455, + 0.09131073206663132, + 0.14131157845258713, + 0.15204705484211445, + 0.4709813743829727, + 0.3934696465730667, + 0.17517685890197754, + 0.0, + 0.026114581152796745, + 0.3994424585253, + 0.44763123989105225, + 0.31641779839992523, + 0.20809533447027206, + 2.970552273094654, + 0.7292418889701366, + 0.0, + 0.18792102485895157, + 0.0, + 0.07159555330872536, + 0.13307823054492474, + 0.03489910438656807, + 0.0, + 0.02977333776652813, + 1.1445518024265766, + 0.38960694149136543, + 0.14783818274736404, + 1.9566032253205776, + 0.0, + 0.03578141704201698, + 0.0, + 0.0, + 0.05204201117157936, + 0.8109709341078997, + 0.046146832406520844, + 0.0867241621017456, + 0.2923607714474201, + 0.03581667318940163, + 0.11827537789940834, + 0.5468228682875633, + 1.1168649345636368, + 0.27094243466854095, + 1.4170443695038557 + ], + "unique_experts": 53, + "load_cv": 1.0995785457636702, + "normalized_load_entropy": 0.862457697856607, + "max_load_share": 0.0641025641025641 + }, + "full_input": { + "tokens": 93, + "top_k": 6, + "decisions": 558, + "ordered_route_sha256": "120484b773d33fc66be2a780e5cfd70761082f659bd118f192b98635a44d6a03", + "route_weight_sha256": "928503dd5fac8194a6c62e22ff0a00052604650f5a82e801e1ba1f47011f3d59", + "loads": [ + 6, + 17, + 1, + 2, + 1, + 14, + 31, + 2, + 0, + 2, + 24, + 12, + 0, + 3, + 1, + 20, + 7, + 3, + 4, + 3, + 0, + 7, + 10, + 6, + 8, + 4, + 19, + 6, + 5, + 20, + 9, + 6, + 10, + 17, + 8, + 19, + 19, + 1, + 5, + 1, + 4, + 11, + 9, + 0, + 19, + 24, + 11, + 6, + 20, + 6, + 2, + 0, + 2, + 3, + 15, + 4, + 5, + 17, + 7, + 6, + 10, + 18, + 4, + 22 + ], + "weighted_loads": [ + 0.2363874688744545, + 0.8157597593963146, + 0.029820989817380905, + 0.07891543582081795, + 0.038521137088537216, + 0.6033343356102705, + 2.371385818347335, + 0.11980780400335789, + 0.0, + 0.07657776959240437, + 1.5721643771976233, + 0.8108854945749044, + 0.0, + 0.1160723865032196, + 0.03459843248128891, + 1.423796670511365, + 0.3214654978364706, + 0.10627740621566772, + 0.14873829297721386, + 0.1226227805018425, + 0.0, + 0.38953288830816746, + 0.5933239459991455, + 0.25574206560850143, + 0.39200284518301487, + 0.15204705484211445, + 0.6596192363649607, + 0.3934696465730667, + 0.17517685890197754, + 1.4761523958295584, + 0.4611713159829378, + 0.4387450832873583, + 0.4922926127910614, + 1.5037356689572334, + 0.43262913078069687, + 3.0256710536777973, + 1.0671432707458735, + 0.033387187868356705, + 0.23081769049167633, + 0.044785454869270325, + 0.1546752117574215, + 0.4387959372252226, + 0.6971391644328833, + 0.0, + 1.3301307577639818, + 2.273367166519165, + 0.504998367279768, + 0.5475147627294064, + 2.2079031728208065, + 0.2757151499390602, + 0.07237362861633301, + 0.0, + 0.06810076162219048, + 0.13229529932141304, + 0.880808113142848, + 0.15987011790275574, + 0.23209405690431595, + 1.0400179512798786, + 0.2645562645047903, + 0.31843722611665726, + 0.574879877269268, + 1.2403977699577808, + 0.27094243466854095, + 1.5048850495368242 + ], + "unique_experts": 59, + "load_cv": 0.8576949345260861, + "normalized_load_entropy": 0.9100045588201077, + "max_load_share": 0.05555555555555555 + } + }, + "s0_period": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "472e8f0394f55a70ad6c6ea6a74f1276709b1c69b30d1ef333e60a748889e460", + "route_weight_sha256": "66a65e3b9100862546743d408fe22388224315ca45720e4c52686a741413a710", + "loads": [ + 1, + 11, + 2, + 2, + 2, + 14, + 3, + 1, + 0, + 1, + 15, + 1, + 0, + 4, + 2, + 14, + 7, + 2, + 3, + 0, + 0, + 2, + 9, + 2, + 3, + 2, + 14, + 6, + 3, + 0, + 0, + 5, + 9, + 5, + 6, + 18, + 12, + 1, + 4, + 0, + 2, + 5, + 0, + 1, + 0, + 14, + 9, + 4, + 18, + 0, + 1, + 0, + 0, + 1, + 10, + 1, + 1, + 5, + 2, + 3, + 9, + 14, + 4, + 22 + ], + "weighted_loads": [ + 0.03388334810733795, + 0.5550813972949982, + 0.07211387157440186, + 0.0776330977678299, + 0.07110093161463737, + 0.6416672803461552, + 0.12353043630719185, + 0.08529692888259888, + 0.0, + 0.04481672868132591, + 1.0757437869906425, + 0.045047514140605927, + 0.0, + 0.1569959968328476, + 0.0720891859382391, + 1.0311531387269497, + 0.318558506667614, + 0.06246214359998703, + 0.11236217617988586, + 0.0, + 0.0, + 0.12074682116508484, + 0.5631622448563576, + 0.09650293365120888, + 0.13060259446501732, + 0.08936713635921478, + 0.4765141773968935, + 0.387336365878582, + 0.11311521753668785, + 0.0, + 0.0, + 0.38716963306069374, + 0.4445066936314106, + 0.31120620481669903, + 0.24030052684247494, + 2.9664345271885395, + 0.6558646894991398, + 0.030507929623126984, + 0.17676012590527534, + 0.0, + 0.07686647213995457, + 0.15987278707325459, + 0.0, + 0.033330176025629044, + 0.0, + 1.2239983305335045, + 0.40311120077967644, + 0.13807686790823936, + 1.9852969348430634, + 0.0, + 0.043727338314056396, + 0.0, + 0.0, + 0.04887128248810768, + 0.7192081734538078, + 0.046446070075035095, + 0.04183589667081833, + 0.29173747450113297, + 0.06656263023614883, + 0.1454166155308485, + 0.5371323376893997, + 1.0996177811175585, + 0.2643910124897957, + 1.5583596862852573 + ], + "unique_experts": 52, + "load_cv": 1.1132458126201237, + "normalized_load_entropy": 0.8602609938348478, + "max_load_share": 0.07051282051282051 + }, + "full_input": { + "tokens": 77, + "top_k": 6, + "decisions": 462, + "ordered_route_sha256": "a3d64fecfc6929702ec0074e9bfce41315a1e8d1d1a0aca6267747276dfb0a3f", + "route_weight_sha256": "f5c0804e6ee4583f240eae1905743ab79c83242cbbdcffa18ed4618219a30baa", + "loads": [ + 1, + 17, + 2, + 2, + 2, + 14, + 18, + 1, + 0, + 4, + 25, + 6, + 0, + 4, + 3, + 20, + 7, + 3, + 4, + 1, + 0, + 5, + 9, + 3, + 7, + 2, + 17, + 6, + 3, + 13, + 0, + 5, + 10, + 12, + 7, + 18, + 16, + 2, + 4, + 1, + 2, + 10, + 3, + 3, + 12, + 24, + 11, + 5, + 19, + 1, + 2, + 0, + 4, + 4, + 12, + 1, + 4, + 5, + 7, + 8, + 9, + 15, + 4, + 23 + ], + "weighted_loads": [ + 0.03388334810733795, + 0.986859530210495, + 0.07211387157440186, + 0.0776330977678299, + 0.07110093161463737, + 0.6416672803461552, + 1.4349377378821373, + 0.08529692888259888, + 0.0, + 0.16168376244604588, + 1.7177146710455418, + 0.35981166176497936, + 0.0, + 0.1569959968328476, + 0.10424979962408543, + 1.3403305672109127, + 0.318558506667614, + 0.09734503924846649, + 0.1541580930352211, + 0.045552294701337814, + 0.0, + 0.2728716470301151, + 0.5631622448563576, + 0.16288617625832558, + 0.43565247766673565, + 0.08936713635921478, + 0.5999716948717833, + 0.387336365878582, + 0.11311521753668785, + 0.802958607673645, + 0.0, + 0.38716963306069374, + 0.4842354729771614, + 1.0903655905276537, + 0.2631667125970125, + 2.9664345271885395, + 0.9238210041075945, + 0.06418076157569885, + 0.17676012590527534, + 0.03522319719195366, + 0.07686647213995457, + 0.4128441121429205, + 0.12427163869142532, + 0.14020563662052155, + 0.8361570239067078, + 2.1823645755648613, + 0.4682405926287174, + 0.49929043278098106, + 2.017373565584421, + 0.05301478132605553, + 0.08245490118861198, + 0.0, + 0.14375486969947815, + 0.18806817382574081, + 0.8076486401259899, + 0.046446070075035095, + 0.20642711967229843, + 0.29173747450113297, + 0.3095057066529989, + 0.38436037488281727, + 0.5371323376893997, + 1.1293053552508354, + 0.2643910124897957, + 1.596262525767088 + ], + "unique_experts": 59, + "load_cv": 0.9147934933898657, + "normalized_load_entropy": 0.9025524449513627, + "max_load_share": 0.05411255411255411 + } + }, + "s1_period": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "975fa502183b37f692150c407a36f5f8321c6810ede42a36babe04d6fce2ad94", + "route_weight_sha256": "8f188c59de25704ed4b4eaee6418fd2ceb20c911a6a894eba0e86c7171f61a68", + "loads": [ + 1, + 11, + 1, + 2, + 2, + 12, + 4, + 2, + 0, + 0, + 14, + 2, + 0, + 4, + 1, + 13, + 7, + 2, + 2, + 0, + 0, + 2, + 11, + 2, + 3, + 3, + 15, + 6, + 5, + 0, + 1, + 5, + 9, + 5, + 6, + 18, + 13, + 0, + 4, + 0, + 2, + 4, + 0, + 0, + 1, + 12, + 9, + 5, + 18, + 0, + 1, + 0, + 0, + 1, + 12, + 1, + 2, + 5, + 0, + 2, + 9, + 15, + 4, + 21 + ], + "weighted_loads": [ + 0.03333956375718117, + 0.5445321816951036, + 0.03046126663684845, + 0.07782722637057304, + 0.0740446150302887, + 0.5434562973678112, + 0.14810285717248917, + 0.12686027586460114, + 0.0, + 0.0, + 0.9864978734403849, + 0.07237660139799118, + 0.0, + 0.14824022725224495, + 0.03745461255311966, + 0.9440627209842205, + 0.32840512320399284, + 0.0724276676774025, + 0.08384094387292862, + 0.0, + 0.0, + 0.12527510151267052, + 0.6378384530544281, + 0.09145216271281242, + 0.1431555673480034, + 0.11886230669915676, + 0.5141610745340586, + 0.4011758528649807, + 0.180534940212965, + 0.0, + 0.026078229770064354, + 0.38523532822728157, + 0.4565459229052067, + 0.3054162748157978, + 0.2415076084434986, + 2.9767176248133183, + 0.723377387970686, + 0.0, + 0.1902293562889099, + 0.0, + 0.07380600273609161, + 0.12981856614351273, + 0.0, + 0.0, + 0.028891075402498245, + 1.160077340900898, + 0.4208191391080618, + 0.1869521290063858, + 1.9677489139139652, + 0.0, + 0.04125072807073593, + 0.0, + 0.0, + 0.0505165196955204, + 0.785845847800374, + 0.04635966196656227, + 0.09160012379288673, + 0.28249503672122955, + 0.0, + 0.11358696967363358, + 0.5434859264642, + 1.105778992176056, + 0.2557949721813202, + 1.4724081382155418 + ], + "unique_experts": 50, + "load_cv": 1.1073242503430352, + "normalized_load_entropy": 0.8573639286279494, + "max_load_share": 0.0673076923076923 + }, + "full_input": { + "tokens": 93, + "top_k": 6, + "decisions": 558, + "ordered_route_sha256": "559f6416abe18a2baf6602052b107a7ac06985611cabc29d0232c9d2722d0427", + "route_weight_sha256": "5d9a0b63f93e861b157213f770851b1177df8572f5ea823eb26a17d4d97849f6", + "loads": [ + 6, + 15, + 1, + 2, + 2, + 13, + 31, + 2, + 0, + 2, + 24, + 13, + 0, + 4, + 1, + 20, + 7, + 3, + 4, + 3, + 0, + 8, + 11, + 6, + 7, + 3, + 19, + 6, + 5, + 20, + 9, + 7, + 10, + 18, + 9, + 19, + 19, + 1, + 5, + 1, + 5, + 10, + 8, + 1, + 19, + 23, + 11, + 7, + 20, + 6, + 2, + 0, + 2, + 3, + 14, + 3, + 5, + 17, + 6, + 6, + 10, + 17, + 4, + 23 + ], + "weighted_loads": [ + 0.2357891984283924, + 0.8629037197679281, + 0.03046126663684845, + 0.07782722637057304, + 0.0740446150302887, + 0.5794679932296276, + 2.3372641392052174, + 0.12686027586460114, + 0.0, + 0.060668349266052246, + 1.6402006465941668, + 0.8396217543631792, + 0.0, + 0.14824022725224495, + 0.03745461255311966, + 1.3244960829615593, + 0.32840512320399284, + 0.11132121458649635, + 0.1498467270284891, + 0.1226227805018425, + 0.0, + 0.4167946260422468, + 0.6378384530544281, + 0.24991066381335258, + 0.4822439793497324, + 0.11886230669915676, + 0.6707621477544308, + 0.4011758528649807, + 0.180534940212965, + 1.4854429420083761, + 0.47081383876502514, + 0.4603140465915203, + 0.5020194463431835, + 1.5292062871158123, + 0.4660414047539234, + 3.0318364053964615, + 1.0939517337828875, + 0.033387187868356705, + 0.23312602192163467, + 0.044785454869270325, + 0.1860127206891775, + 0.42304401472210884, + 0.6524775195866823, + 0.03912494704127312, + 1.3050846867263317, + 2.1444225944578648, + 0.49360948987305164, + 0.5866287089884281, + 2.219048861414194, + 0.2815111204981804, + 0.07784293964505196, + 0.0, + 0.06810076162219048, + 0.13076980784535408, + 0.8556830268353224, + 0.11867686733603477, + 0.23697001859545708, + 1.0229991786181927, + 0.22453449107706547, + 0.3137488178908825, + 0.5715429354459047, + 1.1944234259426594, + 0.2557949721813202, + 1.5602488182485104 + ], + "unique_experts": 60, + "load_cv": 0.8482970698440967, + "normalized_load_entropy": 0.9129470599731156, + "max_load_share": 0.05555555555555555 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 52, + "ordered_topk_exact_tokens": 30, + "set_exact_tokens": 38, + "mean_set_jaccard": 0.9230769230769231, + "mean_token_weighted_tv": 0.014244888550960101, + "aggregate_load_tv": 0.03846153846153846 + }, + "system_bos": { + "tokens": 52, + "ordered_topk_exact_tokens": 34, + "set_exact_tokens": 40, + "mean_set_jaccard": 0.9340659340659341, + "mean_token_weighted_tv": 0.016003280627326325, + "aggregate_load_tv": 0.028846153846153848 + }, + "system_x": { + "tokens": 52, + "ordered_topk_exact_tokens": 20, + "set_exact_tokens": 29, + "mean_set_jaccard": 0.8612637362637364, + "mean_token_weighted_tv": 0.026500784738275867, + "aggregate_load_tv": 0.06089743589743589 + }, + "system_period": { + "tokens": 52, + "ordered_topk_exact_tokens": 22, + "set_exact_tokens": 28, + "mean_set_jaccard": 0.85989010989011, + "mean_token_weighted_tv": 0.026539883970354613, + "aggregate_load_tv": 0.05448717948717949 + }, + "bos_at_s0": { + "tokens": 52, + "ordered_topk_exact_tokens": 23, + "set_exact_tokens": 29, + "mean_set_jaccard": 0.8653846153846155, + "mean_token_weighted_tv": 0.026195564701293524, + "aggregate_load_tv": 0.05769230769230769 + }, + "bos_at_s1": { + "tokens": 52, + "ordered_topk_exact_tokens": 18, + "set_exact_tokens": 23, + "mean_set_jaccard": 0.8282967032967034, + "mean_token_weighted_tv": 0.02999095070677308, + "aggregate_load_tv": 0.07692307692307691 + }, + "x_at_s0": { + "tokens": 52, + "ordered_topk_exact_tokens": 25, + "set_exact_tokens": 28, + "mean_set_jaccard": 0.864010989010989, + "mean_token_weighted_tv": 0.026200444580843814, + "aggregate_load_tv": 0.04487179487179487 + }, + "x_at_s1": { + "tokens": 52, + "ordered_topk_exact_tokens": 20, + "set_exact_tokens": 25, + "mean_set_jaccard": 0.8360805860805862, + "mean_token_weighted_tv": 0.03240340659753061, + "aggregate_load_tv": 0.0737179487179487 + }, + "period_at_s0": { + "tokens": 52, + "ordered_topk_exact_tokens": 25, + "set_exact_tokens": 31, + "mean_set_jaccard": 0.8804945054945055, + "mean_token_weighted_tv": 0.02416601486933919, + "aggregate_load_tv": 0.044871794871794865 + }, + "period_at_s1": { + "tokens": 52, + "ordered_topk_exact_tokens": 23, + "set_exact_tokens": 29, + "mean_set_jaccard": 0.8612637362637364, + "mean_token_weighted_tv": 0.0287458416289435, + "aggregate_load_tv": 0.0641025641025641 + } + } + }, + "layer_14": { + "layer": 14, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "f8e118b5022dcd71ff009b99893a5370700bf53e284ad41b8dc8e998220fec2e", + "route_weight_sha256": "0a22337b45ca354c7763201c111d20c1ddda5135a5ca999f2bd8c94a8fa45e53", + "loads": [ + 15, + 0, + 3, + 4, + 4, + 3, + 8, + 1, + 1, + 0, + 1, + 1, + 0, + 0, + 3, + 6, + 0, + 0, + 1, + 21, + 1, + 3, + 23, + 2, + 1, + 1, + 1, + 2, + 4, + 4, + 3, + 4, + 4, + 0, + 1, + 1, + 1, + 10, + 0, + 5, + 0, + 0, + 9, + 0, + 17, + 2, + 26, + 19, + 12, + 5, + 3, + 3, + 0, + 0, + 7, + 3, + 0, + 8, + 0, + 20, + 1, + 0, + 7, + 27 + ], + "weighted_loads": [ + 2.7675612661987543, + 0.0, + 0.1280694529414177, + 0.12695338763296604, + 0.2743254788219929, + 0.11492250859737396, + 0.7598743829876184, + 0.035700224339962006, + 0.04493186995387077, + 0.0, + 0.03517253324389458, + 0.03643346577882767, + 0.0, + 0.0, + 0.1107623279094696, + 0.32960646599531174, + 0.0, + 0.0, + 0.04063301533460617, + 4.0233394876122475, + 0.04275858402252197, + 0.1908649317920208, + 1.2599551770836115, + 0.06812179833650589, + 0.12245474010705948, + 0.07672751694917679, + 0.09578502178192139, + 0.04822011664509773, + 0.15701540932059288, + 0.1814667358994484, + 0.16944889724254608, + 0.19484016112983227, + 0.2097107246518135, + 0.0, + 0.03573310002684593, + 0.08893057703971863, + 0.0368010438978672, + 0.8349482007324696, + 0.0, + 0.200784245505929, + 0.0, + 0.0, + 0.4678912926465273, + 0.0, + 0.6901408806443214, + 0.07711277902126312, + 1.7899888586252928, + 2.3017278723418713, + 1.339962525293231, + 0.4315548613667488, + 0.10213492438197136, + 0.18348831683397293, + 0.0, + 0.0, + 0.9188022464513779, + 0.1117701455950737, + 0.0, + 0.3931151479482651, + 0.0, + 1.4268430415540934, + 0.08484101295471191, + 0.0, + 0.46744927391409874, + 1.665712395682931 + ], + "unique_experts": 48, + "load_cv": 1.3947869506624766, + "normalized_load_entropy": 0.812015391799622, + "max_load_share": 0.08653846153846154 + }, + "full_input": { + "tokens": 77, + "top_k": 6, + "decisions": 462, + "ordered_route_sha256": "a7dbe0b80ce28b5a8967250443f2948127be01d6130a5b53679087888d18c248", + "route_weight_sha256": "98e1cff4613541ba3a8d4b8b80e301d2e22cd0bc6f257aac5a762e958fbea758", + "loads": [ + 21, + 0, + 3, + 6, + 4, + 14, + 8, + 3, + 1, + 8, + 3, + 4, + 0, + 0, + 4, + 11, + 0, + 0, + 6, + 22, + 1, + 3, + 23, + 13, + 2, + 2, + 7, + 8, + 12, + 4, + 6, + 9, + 4, + 7, + 1, + 1, + 3, + 11, + 2, + 5, + 0, + 0, + 10, + 1, + 19, + 2, + 32, + 21, + 12, + 6, + 6, + 8, + 6, + 6, + 7, + 7, + 0, + 8, + 0, + 33, + 1, + 1, + 7, + 27 + ], + "weighted_loads": [ + 3.423045292496681, + 0.0, + 0.1280694529414177, + 0.20347416959702969, + 0.2743254788219929, + 1.0709819663316011, + 0.7598743829876184, + 0.10855390504002571, + 0.04493186995387077, + 0.5501608625054359, + 0.10090845450758934, + 0.22880318015813828, + 0.0, + 0.0, + 0.1491927020251751, + 0.7197263203561306, + 0.0, + 0.0, + 0.44485464692115784, + 4.063178643584251, + 0.04275858402252197, + 0.1908649317920208, + 1.2599551770836115, + 0.5353340320289135, + 0.14506585523486137, + 0.11719348281621933, + 0.44289133325219154, + 0.46347209345549345, + 1.319650787860155, + 0.1814667358994484, + 0.3739594407379627, + 0.39733688812702894, + 0.2097107246518135, + 0.5847482793033123, + 0.03573310002684593, + 0.08893057703971863, + 0.13456102460622787, + 0.8781766816973686, + 0.11354415491223335, + 0.200784245505929, + 0.0, + 0.0, + 0.5182137694209814, + 0.04877877235412598, + 0.755370955914259, + 0.07711277902126312, + 2.089778585359454, + 2.388240322470665, + 1.339962525293231, + 0.4732643812894821, + 0.24436518549919128, + 1.487717665731907, + 0.7303246408700943, + 0.431700948625803, + 0.9188022464513779, + 0.4526141695678234, + 0.0, + 0.3931151479482651, + 0.0, + 2.0072770584374666, + 0.08484101295471191, + 0.005029291845858097, + 0.46744927391409874, + 1.665712395682931 + ], + "unique_experts": 55, + "load_cv": 1.0714876016796522, + "normalized_load_entropy": 0.8772762992078379, + "max_load_share": 0.07142857142857142 + } + }, + "s1_eos": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "4e2121273b7d60907cec48feb77ff95953a95f9607351c112d978303735773db", + "route_weight_sha256": "80b49e40db7dba960e8d116a937254c330442d0b104b990313fe5caca30f25ad", + "loads": [ + 15, + 0, + 3, + 5, + 4, + 3, + 8, + 1, + 1, + 0, + 1, + 1, + 0, + 0, + 3, + 6, + 0, + 0, + 1, + 21, + 1, + 3, + 24, + 2, + 2, + 1, + 1, + 2, + 4, + 4, + 3, + 3, + 5, + 0, + 1, + 1, + 1, + 9, + 0, + 6, + 0, + 0, + 8, + 0, + 17, + 2, + 24, + 19, + 12, + 4, + 3, + 3, + 0, + 0, + 7, + 3, + 0, + 8, + 0, + 21, + 1, + 0, + 6, + 28 + ], + "weighted_loads": [ + 2.7905454002320766, + 0.0, + 0.1314757503569126, + 0.15715107135474682, + 0.27893736213445663, + 0.1140093244612217, + 0.7446612231433392, + 0.034759942442178726, + 0.046846821904182434, + 0.0, + 0.030274586752057076, + 0.03869905322790146, + 0.0, + 0.0, + 0.11400815099477768, + 0.3303561322391033, + 0.0, + 0.0, + 0.044040482491254807, + 3.9924449250102043, + 0.04210850968956947, + 0.18855420127511024, + 1.2337505798786879, + 0.0647575631737709, + 0.14775608479976654, + 0.07289477437734604, + 0.09902513772249222, + 0.04668862372636795, + 0.1501916255801916, + 0.1843450739979744, + 0.17288253083825111, + 0.16948696970939636, + 0.2429809533059597, + 0.0, + 0.03980403393507004, + 0.08662949502468109, + 0.03503042086958885, + 0.8091479446738958, + 0.0, + 0.2293845359236002, + 0.0, + 0.0, + 0.46050870418548584, + 0.0, + 0.6804037988185883, + 0.07551030069589615, + 1.7193669471889734, + 2.2944172229617834, + 1.3010039404034615, + 0.40474526956677437, + 0.10056634992361069, + 0.18749941885471344, + 0.0, + 0.0, + 0.9072706364095211, + 0.11008105054497719, + 0.0, + 0.38575178012251854, + 0.0, + 1.4490153454244137, + 0.08203382790088654, + 0.0, + 0.43699165992438793, + 1.6847714968025684 + ], + "unique_experts": 48, + "load_cv": 1.397141818033362, + "normalized_load_entropy": 0.8126817413076444, + "max_load_share": 0.08974358974358974 + }, + "full_input": { + "tokens": 93, + "top_k": 6, + "decisions": 558, + "ordered_route_sha256": "d5dd9e5091be184ccec2079cef696c02178a13d9e18ac981e35f62ef626adf2b", + "route_weight_sha256": "9848771990987ce7ddaaa1b2c6377e2ad69e6c63a28a91b90a9ed5d60add0e53", + "loads": [ + 23, + 1, + 3, + 8, + 7, + 20, + 8, + 5, + 3, + 11, + 1, + 4, + 6, + 0, + 4, + 12, + 0, + 0, + 8, + 25, + 3, + 7, + 24, + 12, + 7, + 4, + 6, + 10, + 17, + 5, + 8, + 6, + 7, + 11, + 2, + 2, + 2, + 12, + 3, + 7, + 0, + 0, + 10, + 1, + 19, + 2, + 30, + 21, + 14, + 5, + 17, + 6, + 8, + 9, + 9, + 6, + 1, + 9, + 1, + 41, + 4, + 2, + 8, + 31 + ], + "weighted_loads": [ + 3.5787846464663744, + 0.05181483179330826, + 0.1314757503569126, + 0.26740781404078007, + 0.4859298765659332, + 1.30841763317585, + 0.7446612231433392, + 0.19837360829114914, + 0.21430407464504242, + 0.8503076694905758, + 0.030274586752057076, + 0.25549475848674774, + 0.3941652178764343, + 0.0, + 0.1455305591225624, + 0.748215813189745, + 0.0, + 0.0, + 0.6029986068606377, + 4.193357028067112, + 0.2720341086387634, + 0.3384064566344023, + 1.2337505798786879, + 0.48339108005166054, + 0.3906550705432892, + 0.18793592974543571, + 0.4262217506766319, + 0.37895943503826857, + 1.8102207463234663, + 0.23281513899564743, + 0.43757807090878487, + 0.2570700189098716, + 0.32415830343961716, + 1.1018818877637386, + 0.08710897713899612, + 0.16751626878976822, + 0.08126048371195793, + 1.1667929608374834, + 0.18983841687440872, + 0.286223566159606, + 0.0, + 0.0, + 0.5570893846452236, + 0.04568227753043175, + 0.7450581416487694, + 0.07551030069589615, + 2.040563879534602, + 2.363623643293977, + 1.4284110888838768, + 0.4384063333272934, + 1.0176886804401875, + 1.434843622148037, + 0.792192667722702, + 0.6990889348089695, + 0.9899169094860554, + 0.38587484136223793, + 0.05276861414313316, + 0.42391614615917206, + 0.10671580582857132, + 2.546684231609106, + 0.33180122449994087, + 0.043941470328718424, + 0.5395493600517511, + 1.7931384295225143 + ], + "unique_experts": 59, + "load_cv": 0.9627042648435848, + "normalized_load_entropy": 0.9008733032344609, + "max_load_share": 0.07347670250896057 + } + }, + "s0_bos": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "10f6f05c037f80fd87c4836028829185a42a63d5a2f694d9d1b152721ee0cbf5", + "route_weight_sha256": "3a0e7ba8287ff8576273cb14b6cf08e1651e53886c4223a4ec9a18f5608ee14a", + "loads": [ + 14, + 0, + 3, + 5, + 4, + 2, + 9, + 1, + 1, + 0, + 2, + 1, + 1, + 0, + 3, + 6, + 0, + 0, + 1, + 21, + 1, + 3, + 25, + 1, + 2, + 1, + 1, + 0, + 4, + 4, + 3, + 4, + 4, + 0, + 1, + 1, + 1, + 10, + 0, + 4, + 0, + 0, + 8, + 0, + 16, + 2, + 24, + 19, + 12, + 5, + 3, + 4, + 1, + 0, + 8, + 3, + 0, + 9, + 0, + 21, + 1, + 0, + 6, + 26 + ], + "weighted_loads": [ + 2.7747112549841404, + 0.0, + 0.13581250235438347, + 0.16429899632930756, + 0.28345993533730507, + 0.08604008331894875, + 0.7984348572790623, + 0.03567946329712868, + 0.05191648751497269, + 0.0, + 0.05998947098851204, + 0.027485590428113937, + 0.030758703127503395, + 0.0, + 0.11309638433158398, + 0.3200637809932232, + 0.0, + 0.0, + 0.03620173782110214, + 4.074826642870903, + 0.050184085965156555, + 0.19150490686297417, + 1.3049072679132223, + 0.03580482304096222, + 0.15406547114253044, + 0.07762299478054047, + 0.10733704268932343, + 0.0, + 0.15651879459619522, + 0.19428426772356033, + 0.15592630207538605, + 0.19657649472355843, + 0.2097848542034626, + 0.0, + 0.037720195949077606, + 0.08821860700845718, + 0.03716833144426346, + 0.8362380620092154, + 0.0, + 0.17010879516601562, + 0.0, + 0.0, + 0.4402022287249565, + 0.0, + 0.6734113488346338, + 0.06280257180333138, + 1.7122836373746395, + 2.227920850738883, + 1.345246197655797, + 0.4415631564334035, + 0.09927916899323463, + 0.21624601632356644, + 0.03499608859419823, + 0.0, + 0.93266854993999, + 0.1132995430380106, + 0.0, + 0.4318999797105789, + 0.0, + 1.3925716951489449, + 0.08740738779306412, + 0.0, + 0.42643843591213226, + 1.6125508155673742 + ], + "unique_experts": 49, + "load_cv": 1.3815255172332506, + "normalized_load_entropy": 0.8152467919213341, + "max_load_share": 0.08333333333333333 + }, + "full_input": { + "tokens": 77, + "top_k": 6, + "decisions": 462, + "ordered_route_sha256": "8fb6b798bbd7059ecfb0905799a82e2cb240f28567766ec26674a4a53eea8b62", + "route_weight_sha256": "50e284b51b87039a270507a591ec1feaa85c9976a429578dd0766f1e57552e25", + "loads": [ + 20, + 0, + 3, + 8, + 4, + 12, + 9, + 2, + 1, + 8, + 4, + 4, + 1, + 0, + 4, + 11, + 0, + 0, + 7, + 22, + 1, + 3, + 25, + 11, + 3, + 3, + 7, + 6, + 13, + 4, + 5, + 9, + 4, + 6, + 1, + 1, + 3, + 11, + 2, + 4, + 0, + 0, + 8, + 1, + 19, + 2, + 30, + 21, + 12, + 6, + 6, + 9, + 7, + 6, + 8, + 7, + 0, + 10, + 1, + 34, + 1, + 0, + 6, + 26 + ], + "weighted_loads": [ + 3.4301952812820673, + 0.0, + 0.13581250235438347, + 0.2829568088054657, + 0.28345993533730507, + 1.0047352891415358, + 0.7984348572790623, + 0.06920654326677322, + 0.05191648751497269, + 0.5647736303508282, + 0.1257253922522068, + 0.21985530480742455, + 0.030758703127503395, + 0.0, + 0.15274698100984097, + 0.7144844271242619, + 0.0, + 0.0, + 0.5198400504887104, + 4.114665798842907, + 0.050184085965156555, + 0.19150490686297417, + 1.3049072679132223, + 0.47535712644457817, + 0.17667658627033234, + 0.15963339433073997, + 0.4544433541595936, + 0.46829008497297764, + 1.410108745098114, + 0.19428426772356033, + 0.3232066035270691, + 0.43198881670832634, + 0.2097848542034626, + 0.5655429139733315, + 0.037720195949077606, + 0.08821860700845718, + 0.13572798669338226, + 0.8794665429741144, + 0.1243455782532692, + 0.17010879516601562, + 0.0, + 0.0, + 0.4402022287249565, + 0.04877877235412598, + 0.8164205085486174, + 0.06280257180333138, + 2.0029863975942135, + 2.3144333008676767, + 1.345246197655797, + 0.4832726763561368, + 0.2514151781797409, + 0.7277052029967308, + 0.7653207294642925, + 0.431700948625803, + 0.93266854993999, + 0.47679790668189526, + 0.0, + 0.4746725410223007, + 0.04220915213227272, + 1.9719159230589867, + 0.08740738779306412, + 0.0, + 0.42643843591213226, + 1.6125508155673742 + ], + "unique_experts": 56, + "load_cv": 1.0591030962340802, + "normalized_load_entropy": 0.880722380058098, + "max_load_share": 0.0735930735930736 + } + }, + "s1_bos": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "5e829ef2c26e6b1cb025ba63e2718a5fe761dbfa4bd2bb566d7314980830cf8b", + "route_weight_sha256": "0d0622f597779c45ace7099c27118a432cdc413f29c537432f7983f4771abcee", + "loads": [ + 16, + 0, + 4, + 4, + 4, + 2, + 8, + 0, + 1, + 0, + 0, + 2, + 1, + 0, + 2, + 6, + 0, + 0, + 2, + 22, + 1, + 3, + 24, + 2, + 2, + 1, + 1, + 1, + 4, + 4, + 3, + 4, + 4, + 0, + 1, + 1, + 2, + 9, + 0, + 5, + 0, + 0, + 8, + 0, + 18, + 2, + 24, + 18, + 11, + 5, + 3, + 4, + 0, + 0, + 7, + 3, + 0, + 8, + 0, + 20, + 1, + 0, + 6, + 28 + ], + "weighted_loads": [ + 2.8318300284445286, + 0.0, + 0.16631877422332764, + 0.13217006623744965, + 0.2895510196685791, + 0.08210288360714912, + 0.7872361876070499, + 0.0, + 0.05479033291339874, + 0.0, + 0.0, + 0.059792421758174896, + 0.03029078245162964, + 0.0, + 0.07114334776997566, + 0.33206726610660553, + 0.0, + 0.0, + 0.06930725276470184, + 4.083301534876227, + 0.04915744438767433, + 0.20353048294782639, + 1.234088663943112, + 0.06599169224500656, + 0.15171963348984718, + 0.0740589126944542, + 0.11419812589883804, + 0.01613626629114151, + 0.14670632779598236, + 0.19283652305603027, + 0.1671840324997902, + 0.1986110582947731, + 0.21011145785450935, + 0.0, + 0.040205687284469604, + 0.08791764825582504, + 0.06879157572984695, + 0.8170659942552447, + 0.0, + 0.19506948441267014, + 0.0, + 0.0, + 0.4465850405395031, + 0.0, + 0.7566111925989389, + 0.07322742603719234, + 1.689395098015666, + 2.2263999171555042, + 1.36378588154912, + 0.4491449659690261, + 0.10291534662246704, + 0.21296169608831406, + 0.0, + 0.0, + 0.9008134268224239, + 0.11352816224098206, + 0.0, + 0.3988687265664339, + 0.0, + 1.3774667605757713, + 0.0822562575340271, + 0.0, + 0.42296459153294563, + 1.704959043301642 + ], + "unique_experts": 47, + "load_cv": 1.3980826543810856, + "normalized_load_entropy": 0.8120753518346829, + "max_load_share": 0.08974358974358974 + }, + "full_input": { + "tokens": 93, + "top_k": 6, + "decisions": 558, + "ordered_route_sha256": "77c200519475c2223499247fceae1ce8a67e0d9c43865bcc68b23ddf584d8e3b", + "route_weight_sha256": "350caf0806bcd1dbaa02a43d7894fe21eabc19f41a6d4103e17ba959e4c4aa40", + "loads": [ + 24, + 1, + 4, + 6, + 7, + 18, + 8, + 3, + 3, + 11, + 1, + 5, + 7, + 0, + 3, + 13, + 0, + 0, + 9, + 26, + 3, + 6, + 24, + 11, + 7, + 3, + 6, + 9, + 18, + 5, + 8, + 7, + 6, + 11, + 2, + 2, + 3, + 12, + 3, + 6, + 0, + 0, + 9, + 1, + 20, + 3, + 30, + 21, + 13, + 6, + 18, + 7, + 8, + 9, + 9, + 6, + 1, + 10, + 1, + 41, + 4, + 1, + 8, + 31 + ], + "weighted_loads": [ + 3.6200692746788263, + 0.05181483179330826, + 0.16631877422332764, + 0.22199461981654167, + 0.4965435341000557, + 1.2185203544795513, + 0.7872361876070499, + 0.12607728317379951, + 0.22224758565425873, + 0.8401025719940662, + 0.03212002292275429, + 0.2765881270170212, + 0.42445600032806396, + 0.0, + 0.10740649327635765, + 0.7789915315806866, + 0.0, + 0.0, + 0.5689023286104202, + 4.284213637933135, + 0.2790830433368683, + 0.3046129699796438, + 1.234088663943112, + 0.4571502283215523, + 0.3946186192333698, + 0.1479022018611431, + 0.44139473885297775, + 0.41939530707895756, + 1.9518423900008202, + 0.2413065880537033, + 0.4339645653963089, + 0.33441416919231415, + 0.2912888079881668, + 1.113527312874794, + 0.08751063048839569, + 0.16880442202091217, + 0.11426150053739548, + 1.1747110104188323, + 0.2044881135225296, + 0.2519085146486759, + 0.0, + 0.0, + 0.4984453283250332, + 0.04568227753043175, + 0.8212655354291201, + 0.11304297484457493, + 2.0260853189975023, + 2.334896594285965, + 1.4911930300295353, + 0.4828060297295451, + 1.0569498278200626, + 0.6463850326836109, + 0.792192667722702, + 0.6990889348089695, + 0.9834596998989582, + 0.4427901431918144, + 0.05276861414313316, + 0.48039439506828785, + 0.10671580582857132, + 2.531512353569269, + 0.33202365413308144, + 0.039175208657979965, + 0.5255222916603088, + 1.8133259760215878 + ], + "unique_experts": 59, + "load_cv": 0.9712071241316421, + "normalized_load_entropy": 0.8994408857178047, + "max_load_share": 0.07347670250896057 + } + }, + "s0_x": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "5c176d3ca877f6f2aec87972bb679da39553d9b69fe4706086860ca9f536645c", + "route_weight_sha256": "fe739f78a1295939b32828e715940277eb0dc88e2e3318ac8a2a261f19623037", + "loads": [ + 14, + 0, + 3, + 2, + 4, + 4, + 7, + 0, + 1, + 0, + 1, + 2, + 1, + 0, + 2, + 6, + 0, + 0, + 2, + 21, + 1, + 3, + 26, + 1, + 1, + 1, + 1, + 1, + 3, + 4, + 3, + 4, + 4, + 0, + 1, + 1, + 2, + 9, + 0, + 4, + 0, + 0, + 8, + 0, + 15, + 1, + 24, + 19, + 12, + 5, + 4, + 5, + 0, + 0, + 9, + 3, + 0, + 9, + 0, + 25, + 1, + 0, + 5, + 27 + ], + "weighted_loads": [ + 2.768624110147357, + 0.0, + 0.13194067776203156, + 0.06573711708188057, + 0.28158070519566536, + 0.14521592110395432, + 0.7122211046516895, + 0.0, + 0.03956851735711098, + 0.0, + 0.030199425294995308, + 0.06241943500936031, + 0.029677385464310646, + 0.0, + 0.08901456743478775, + 0.32706285268068314, + 0.0, + 0.0, + 0.07127708196640015, + 4.056307267397642, + 0.04453771188855171, + 0.20126527547836304, + 1.336437439545989, + 0.0321502760052681, + 0.1240326538681984, + 0.07590004801750183, + 0.09464861452579498, + 0.02974296547472477, + 0.12478330731391907, + 0.19094006344676018, + 0.16035645455121994, + 0.20713096484541893, + 0.2079712115228176, + 0.0, + 0.03770894557237625, + 0.08435572683811188, + 0.06847130507230759, + 0.7819106224924326, + 0.0, + 0.16918466612696648, + 0.0, + 0.0, + 0.4415201358497143, + 0.0, + 0.5872157402336597, + 0.027134036645293236, + 1.713596137240529, + 2.251489521935582, + 1.3907319623976946, + 0.41961605474352837, + 0.13698542304337025, + 0.2513442561030388, + 0.0, + 0.0, + 1.0095642302185297, + 0.11713583953678608, + 0.0, + 0.43129197880625725, + 0.0, + 1.5860595144331455, + 0.088589146733284, + 0.0, + 0.3919253759086132, + 1.632916260510683 + ], + "unique_experts": 48, + "load_cv": 1.4297027548154513, + "normalized_load_entropy": 0.8072055728504771, + "max_load_share": 0.08653846153846154 + }, + "full_input": { + "tokens": 77, + "top_k": 6, + "decisions": 462, + "ordered_route_sha256": "3540aed29a7ee07c931d723e425c855d9e8a7ee70fc211bf68ecdcfa8b657b83", + "route_weight_sha256": "59f3087729082f263d73625085c2d8118548157e5cab21ca768dc7e75429049a", + "loads": [ + 21, + 0, + 3, + 4, + 4, + 17, + 7, + 1, + 1, + 7, + 3, + 5, + 1, + 0, + 3, + 11, + 0, + 0, + 6, + 23, + 1, + 3, + 26, + 11, + 2, + 3, + 8, + 6, + 11, + 4, + 5, + 8, + 4, + 7, + 1, + 1, + 4, + 11, + 2, + 4, + 0, + 0, + 9, + 1, + 17, + 1, + 30, + 21, + 12, + 6, + 7, + 8, + 6, + 7, + 9, + 7, + 0, + 10, + 0, + 39, + 1, + 0, + 5, + 27 + ], + "weighted_loads": [ + 3.531348016113043, + 0.0, + 0.13194067776203156, + 0.14921819418668747, + 0.28158070519566536, + 1.273493466898799, + 0.7122211046516895, + 0.033527079969644547, + 0.03956851735711098, + 0.45636867731809616, + 0.09593534655869007, + 0.2547891493886709, + 0.029677385464310646, + 0.0, + 0.1263570822775364, + 0.6702251024544239, + 0.0, + 0.0, + 0.40157361328601837, + 4.16910507902503, + 0.04453771188855171, + 0.20126527547836304, + 1.336437439545989, + 0.47170257940888405, + 0.1466437689960003, + 0.1572955623269081, + 0.5548904575407505, + 0.41480827704072, + 1.1411533132195473, + 0.19094006344676018, + 0.32800113409757614, + 0.40376588329672813, + 0.2079712115228176, + 0.6197693459689617, + 0.03770894557237625, + 0.08435572683811188, + 0.17067157849669456, + 0.8990938644856215, + 0.11252633109688759, + 0.16918466612696648, + 0.0, + 0.0, + 0.4899734817445278, + 0.04877877235412598, + 0.6524458155035973, + 0.027134036645293236, + 2.016892099753022, + 2.338001972064376, + 1.3907319623976946, + 0.4613255746662617, + 0.2922623138874769, + 0.6780800893902779, + 0.7303246408700943, + 0.5175943858921528, + 1.0095642302185297, + 0.435571676120162, + 0.0, + 0.47185392305254936, + 0.0, + 2.2343899980187416, + 0.088589146733284, + 0.0, + 0.3919253759086132, + 1.632916260510683 + ], + "unique_experts": 55, + "load_cv": 1.1265979054886495, + "normalized_load_entropy": 0.8694157381927625, + "max_load_share": 0.08441558441558442 + } + }, + "s1_x": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "a3d061ccc58cdd671adeac18983686dd10a57444c040e263eb01fd414ba19bfc", + "route_weight_sha256": "25a04b4283909efc82fedd51066c211925741e76fe8c7000b024686f44cfa9f2", + "loads": [ + 15, + 0, + 4, + 4, + 4, + 4, + 7, + 0, + 1, + 0, + 1, + 1, + 1, + 0, + 2, + 6, + 0, + 0, + 2, + 21, + 1, + 3, + 24, + 1, + 2, + 1, + 1, + 1, + 3, + 4, + 3, + 3, + 4, + 0, + 1, + 1, + 1, + 9, + 0, + 4, + 0, + 0, + 8, + 0, + 19, + 2, + 24, + 18, + 12, + 5, + 3, + 4, + 0, + 0, + 8, + 3, + 0, + 8, + 1, + 23, + 1, + 0, + 5, + 28 + ], + "weighted_loads": [ + 2.8029747772961855, + 0.0, + 0.17643385753035545, + 0.13431725837290287, + 0.2935639023780823, + 0.14775114506483078, + 0.7376450672745705, + 0.0, + 0.04446575045585632, + 0.0, + 0.027932478114962578, + 0.03280804306268692, + 0.030804526060819626, + 0.0, + 0.06815729662775993, + 0.3216355238109827, + 0.0, + 0.0, + 0.0717301145195961, + 4.041730400174856, + 0.04189179092645645, + 0.21114621311426163, + 1.1695452965795994, + 0.03583653271198273, + 0.14914818480610847, + 0.07695519924163818, + 0.11043724417686462, + 0.027817169204354286, + 0.11399982497096062, + 0.18686021491885185, + 0.16863372921943665, + 0.16885920986533165, + 0.20263615995645523, + 0.0, + 0.04255838692188263, + 0.08725347369909286, + 0.0411837138235569, + 0.8341062944382429, + 0.0, + 0.15414815582334995, + 0.0, + 0.0, + 0.44953690841794014, + 0.0, + 0.7607306418940425, + 0.0733068510890007, + 1.6847263425588608, + 2.1731204949319363, + 1.4007516540586948, + 0.44733327627182007, + 0.10544120892882347, + 0.21589172258973122, + 0.0, + 0.0, + 0.9602280799299479, + 0.11443036049604416, + 0.0, + 0.3837567511945963, + 0.01633715257048607, + 1.5344096422195435, + 0.08059881627559662, + 0.0, + 0.3946080580353737, + 1.7040863204747438 + ], + "unique_experts": 49, + "load_cv": 1.4181596727204957, + "normalized_load_entropy": 0.8104964697689055, + "max_load_share": 0.08974358974358974 + }, + "full_input": { + "tokens": 93, + "top_k": 6, + "decisions": 558, + "ordered_route_sha256": "9a063cc2480e418fa3fd51fc269e320eb3f6ba243974bfbfd8f99aa12ea9dbfa", + "route_weight_sha256": "47e2a510700f6063e7a856163e8551f89b8b8d3b7886743485cc8fa553238fbc", + "loads": [ + 24, + 1, + 4, + 6, + 8, + 23, + 7, + 3, + 3, + 10, + 1, + 5, + 7, + 0, + 2, + 11, + 0, + 0, + 8, + 25, + 3, + 6, + 24, + 11, + 7, + 4, + 7, + 9, + 16, + 5, + 9, + 5, + 6, + 11, + 3, + 2, + 2, + 13, + 2, + 5, + 0, + 0, + 10, + 1, + 21, + 2, + 30, + 20, + 14, + 6, + 17, + 6, + 8, + 10, + 10, + 6, + 1, + 9, + 2, + 44, + 4, + 1, + 7, + 31 + ], + "weighted_loads": [ + 3.6703374311327934, + 0.05181483179330826, + 0.17643385753035545, + 0.20815533213317394, + 0.5360848754644394, + 1.54768156260252, + 0.7376450672745705, + 0.12607728317379951, + 0.2119230031967163, + 0.6794736795127392, + 0.027932478114962578, + 0.2974312864243984, + 0.42496974393725395, + 0.0, + 0.06815729662775993, + 0.6285990085452795, + 0.0, + 0.0, + 0.5173172689974308, + 4.242642503231764, + 0.2718173898756504, + 0.31222870014607906, + 1.1695452965795994, + 0.48099400848150253, + 0.3920471705496311, + 0.18221519142389297, + 0.5419901683926582, + 0.3559840992093086, + 1.4744464047253132, + 0.2353302799165249, + 0.4368238262832165, + 0.24565155804157257, + 0.2838135100901127, + 1.0658809840679169, + 0.124103594571352, + 0.16814024746418, + 0.08659376204013824, + 1.2895274106413126, + 0.1411319300532341, + 0.21098718605935574, + 0.0, + 0.0, + 0.5586733222007751, + 0.04568227753043175, + 0.8253849847242236, + 0.0733068510890007, + 2.0182527005672455, + 2.2423269152641296, + 1.5281588025391102, + 0.4809943400323391, + 1.015782367438078, + 0.6180565543472767, + 0.792192667722702, + 0.8191585130989552, + 1.0428743530064821, + 0.3573271706700325, + 0.05276861414313316, + 0.4219211172312498, + 0.12305295839905739, + 2.6769285202026367, + 0.33036621287465096, + 0.039175208657979965, + 0.4971657581627369, + 1.8124532531946898 + ], + "unique_experts": 59, + "load_cv": 0.9995759689881247, + "normalized_load_entropy": 0.8957789903662658, + "max_load_share": 0.07885304659498207 + } + }, + "s0_period": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "47cde77b1616f70b0aaccdbc8d4359336b684daf0413f7420bb72f167dddf2e1", + "route_weight_sha256": "4fcfe13cb114488c7078a463450666dd713c330f9f867bbcb64a393e8931b496", + "loads": [ + 14, + 0, + 4, + 2, + 4, + 4, + 7, + 1, + 1, + 0, + 1, + 2, + 0, + 0, + 1, + 6, + 0, + 1, + 2, + 21, + 1, + 3, + 25, + 1, + 1, + 1, + 1, + 1, + 4, + 4, + 3, + 3, + 4, + 0, + 1, + 1, + 3, + 10, + 0, + 4, + 0, + 0, + 8, + 0, + 16, + 2, + 24, + 19, + 12, + 5, + 3, + 4, + 0, + 0, + 9, + 3, + 0, + 8, + 0, + 24, + 1, + 0, + 5, + 27 + ], + "weighted_loads": [ + 2.8117626905441284, + 0.0, + 0.16845377162098885, + 0.06478719785809517, + 0.2877643220126629, + 0.1530579160898924, + 0.7121286280453205, + 0.03458444029092789, + 0.041215743869543076, + 0.0, + 0.03102632611989975, + 0.06384853832423687, + 0.0, + 0.0, + 0.044428735971450806, + 0.31845981255173683, + 0.0, + 0.028563978150486946, + 0.07317658513784409, + 4.066800698637962, + 0.04390566051006317, + 0.201000414788723, + 1.3172838017344475, + 0.038332510739564896, + 0.12560422718524933, + 0.07464902102947235, + 0.08425541967153549, + 0.029772400856018066, + 0.15816541761159897, + 0.18620964884757996, + 0.15815796330571175, + 0.17699221149086952, + 0.20445169135928154, + 0.0, + 0.03754764422774315, + 0.08535623550415039, + 0.0984551478177309, + 0.8351725451648235, + 0.0, + 0.16725853085517883, + 0.0, + 0.0, + 0.42533280327916145, + 0.0, + 0.633696018718183, + 0.07321878522634506, + 1.7107246331870556, + 2.2548238709568977, + 1.3818585462868214, + 0.41402213647961617, + 0.102127430960536, + 0.21323243714869022, + 0.0, + 0.0, + 1.0026801880449057, + 0.11465149372816086, + 0.0, + 0.38393498584628105, + 0.0, + 1.5417783483862877, + 0.08709751814603806, + 0.0, + 0.38495684415102005, + 1.6770434714853764 + ], + "unique_experts": 49, + "load_cv": 1.4135160463936123, + "normalized_load_entropy": 0.8111958579134311, + "max_load_share": 0.08653846153846154 + }, + "full_input": { + "tokens": 77, + "top_k": 6, + "decisions": 462, + "ordered_route_sha256": "4990bbe359c8a4b4c93119ff70349bda4752dab314fc1aeb53488eea4565ca10", + "route_weight_sha256": "d2adbec6aea46b8fa570f7ccaddcc61fc06a66a1db63be82d801c805fb207303", + "loads": [ + 21, + 0, + 4, + 4, + 4, + 16, + 7, + 2, + 1, + 7, + 3, + 5, + 0, + 0, + 1, + 10, + 0, + 1, + 7, + 22, + 1, + 3, + 25, + 11, + 3, + 2, + 8, + 7, + 12, + 4, + 6, + 7, + 4, + 7, + 1, + 1, + 6, + 12, + 2, + 4, + 0, + 0, + 8, + 1, + 18, + 2, + 29, + 22, + 12, + 7, + 7, + 7, + 6, + 7, + 9, + 7, + 0, + 9, + 0, + 37, + 1, + 0, + 5, + 27 + ], + "weighted_loads": [ + 3.5156403351575136, + 0.0, + 0.16845377162098885, + 0.1462152637541294, + 0.2877643220126629, + 1.1897916980087757, + 0.7121286280453205, + 0.06811152026057243, + 0.041215743869543076, + 0.47013290598988533, + 0.09676224738359451, + 0.2562182527035475, + 0.0, + 0.0, + 0.044428735971450806, + 0.6526166722178459, + 0.0, + 0.028563978150486946, + 0.44113537669181824, + 4.106639854609966, + 0.04390566051006317, + 0.201000414788723, + 1.3172838017344475, + 0.47788481414318085, + 0.1851276196539402, + 0.1150968186557293, + 0.48550085350871086, + 0.46171117387712, + 1.2569925487041473, + 0.18620964884757996, + 0.3672436475753784, + 0.3713882379233837, + 0.20445169135928154, + 0.6374374590814114, + 0.03754764422774315, + 0.08535623550415039, + 0.24278303049504757, + 0.9395597726106644, + 0.12167927995324135, + 0.16725853085517883, + 0.0, + 0.0, + 0.42533280327916145, + 0.04877877235412598, + 0.6989260939881206, + 0.07321878522634506, + 1.9633959122002125, + 2.407110285013914, + 1.3818585462868214, + 0.5026739537715912, + 0.30728394724428654, + 0.6401393730193377, + 0.7303246408700943, + 0.5142095051705837, + 1.0026801880449057, + 0.5106856413185596, + 0.0, + 0.4224540628492832, + 0.0, + 2.1128099113702774, + 0.08709751814603806, + 0.0, + 0.38495684415102005, + 1.6770434714853764 + ], + "unique_experts": 55, + "load_cv": 1.0958368057126064, + "normalized_load_entropy": 0.8738514549233486, + "max_load_share": 0.08008658008658008 + } + }, + "s1_period": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "c37367afe815a3db0c4fbfb91f3eb055acdf6365ca6da03745c8d853beb6ebc7", + "route_weight_sha256": "e0d3d4f5732518af4a7c4e5c9ca1398962b1a2d92ed298604d07760e2e170240", + "loads": [ + 15, + 0, + 4, + 3, + 4, + 4, + 7, + 0, + 2, + 0, + 0, + 1, + 1, + 0, + 1, + 6, + 0, + 0, + 2, + 21, + 1, + 3, + 25, + 2, + 1, + 1, + 1, + 1, + 4, + 4, + 3, + 3, + 4, + 0, + 1, + 1, + 2, + 9, + 0, + 5, + 0, + 0, + 8, + 0, + 18, + 2, + 24, + 18, + 12, + 5, + 3, + 5, + 0, + 0, + 7, + 3, + 0, + 8, + 0, + 22, + 1, + 0, + 5, + 29 + ], + "weighted_loads": [ + 2.8166426345705986, + 0.0, + 0.17698529362678528, + 0.10124630108475685, + 0.2872675694525242, + 0.14370101317763329, + 0.7264738343656063, + 0.0, + 0.07467366382479668, + 0.0, + 0.0, + 0.026631096377968788, + 0.030617132782936096, + 0.0, + 0.04430721327662468, + 0.3275325186550617, + 0.0, + 0.0, + 0.07168425992131233, + 4.041010566055775, + 0.04386382922530174, + 0.2108900137245655, + 1.2084927782416344, + 0.06401688419282436, + 0.11701148748397827, + 0.07705342024564743, + 0.0891314446926117, + 0.028362169861793518, + 0.13144420832395554, + 0.18918029218912125, + 0.16588103398680687, + 0.16732166707515717, + 0.2121276892721653, + 0.0, + 0.04233259707689285, + 0.08401917666196823, + 0.07424032315611839, + 0.8379315370693803, + 0.0, + 0.1860927753150463, + 0.0, + 0.0, + 0.44533640891313553, + 0.0, + 0.7267043655738235, + 0.07332372665405273, + 1.6830201111733913, + 2.214047996327281, + 1.391377316787839, + 0.4370490899309516, + 0.10317008383572102, + 0.2474934458732605, + 0.0, + 0.0, + 0.9283375963568687, + 0.11720621772110462, + 0.0, + 0.39695706963539124, + 0.0, + 1.4732340388000011, + 0.08252269774675369, + 0.0, + 0.39602429047226906, + 1.7056575864553452 + ], + "unique_experts": 47, + "load_cv": 1.4246353213424718, + "normalized_load_entropy": 0.8074958399277375, + "max_load_share": 0.09294871794871795 + }, + "full_input": { + "tokens": 93, + "top_k": 6, + "decisions": 558, + "ordered_route_sha256": "f31d9ed12a0bcf0691719de3367c5eae0aefabb122257d8742b6b38016a82179", + "route_weight_sha256": "abe2ff46ed46afde0ab48fb0da51a3494d6e3dadfe75bcc253d2f474631055a6", + "loads": [ + 24, + 1, + 4, + 5, + 7, + 22, + 7, + 4, + 4, + 11, + 0, + 4, + 7, + 0, + 1, + 11, + 0, + 0, + 8, + 25, + 3, + 6, + 25, + 11, + 7, + 4, + 7, + 8, + 17, + 5, + 9, + 5, + 6, + 11, + 2, + 2, + 3, + 13, + 2, + 7, + 0, + 0, + 9, + 1, + 20, + 2, + 29, + 21, + 14, + 7, + 17, + 7, + 8, + 10, + 9, + 6, + 2, + 11, + 1, + 41, + 4, + 1, + 7, + 33 + ], + "weighted_loads": [ + 3.6617175471037626, + 0.05181483179330826, + 0.17698529362678528, + 0.17409051954746246, + 0.4942600838840008, + 1.4053988121449947, + 0.7264738343656063, + 0.16354212164878845, + 0.24213091656565666, + 0.7573897428810596, + 0.0, + 0.24342680163681507, + 0.4247823506593704, + 0.0, + 0.04430721327662468, + 0.6154176704585552, + 0.0, + 0.0, + 0.5472929775714874, + 4.241922669112682, + 0.2737894281744957, + 0.31197250075638294, + 1.2084927782416344, + 0.4551754202693701, + 0.3970603086054325, + 0.18499530479311943, + 0.45712101086974144, + 0.31654362566769123, + 1.46637661755085, + 0.23765035718679428, + 0.44488807767629623, + 0.2441140152513981, + 0.29330503940582275, + 1.0707579627633095, + 0.08963754028081894, + 0.16490595042705536, + 0.12120143324136734, + 1.2883867816999555, + 0.1411319300532341, + 0.27866848185658455, + 0.0, + 0.0, + 0.4971966966986656, + 0.04568227753043175, + 0.7913587084040046, + 0.07332372665405273, + 1.9733052402734756, + 2.3246156852692366, + 1.5187844652682543, + 0.5127356862649322, + 1.0255632642656565, + 0.6548221930861473, + 0.792192667722702, + 0.7761642746627331, + 1.010983869433403, + 0.43290108628571033, + 0.08891618996858597, + 0.5220840089023113, + 0.10671580582857132, + 2.5314985141158104, + 0.33229009434580803, + 0.039175208657979965, + 0.49858199059963226, + 1.8460462465882301 + ], + "unique_experts": 58, + "load_cv": 0.9873690027365191, + "normalized_load_entropy": 0.8954740662280122, + "max_load_share": 0.07347670250896057 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 52, + "ordered_topk_exact_tokens": 37, + "set_exact_tokens": 43, + "mean_set_jaccard": 0.9505494505494506, + "mean_token_weighted_tv": 0.012782160407648636, + "aggregate_load_tv": 0.022435897435897433 + }, + "system_bos": { + "tokens": 52, + "ordered_topk_exact_tokens": 28, + "set_exact_tokens": 31, + "mean_set_jaccard": 0.8804945054945056, + "mean_token_weighted_tv": 0.02222476404411002, + "aggregate_load_tv": 0.04487179487179488 + }, + "system_x": { + "tokens": 52, + "ordered_topk_exact_tokens": 27, + "set_exact_tokens": 32, + "mean_set_jaccard": 0.8901098901098901, + "mean_token_weighted_tv": 0.024193288928542573, + "aggregate_load_tv": 0.03846153846153846 + }, + "system_period": { + "tokens": 52, + "ordered_topk_exact_tokens": 32, + "set_exact_tokens": 36, + "mean_set_jaccard": 0.9120879120879122, + "mean_token_weighted_tv": 0.021321415901184082, + "aggregate_load_tv": 0.035256410256410256 + }, + "bos_at_s0": { + "tokens": 52, + "ordered_topk_exact_tokens": 24, + "set_exact_tokens": 31, + "mean_set_jaccard": 0.868131868131868, + "mean_token_weighted_tv": 0.026867015690256197, + "aggregate_load_tv": 0.038461538461538464 + }, + "bos_at_s1": { + "tokens": 52, + "ordered_topk_exact_tokens": 27, + "set_exact_tokens": 35, + "mean_set_jaccard": 0.8951465201465202, + "mean_token_weighted_tv": 0.025137753745254416, + "aggregate_load_tv": 0.035256410256410256 + }, + "x_at_s0": { + "tokens": 52, + "ordered_topk_exact_tokens": 22, + "set_exact_tokens": 28, + "mean_set_jaccard": 0.8516483516483516, + "mean_token_weighted_tv": 0.028365045767993882, + "aggregate_load_tv": 0.06089743589743589 + }, + "x_at_s1": { + "tokens": 52, + "ordered_topk_exact_tokens": 26, + "set_exact_tokens": 31, + "mean_set_jaccard": 0.8690476190476192, + "mean_token_weighted_tv": 0.02939776887293332, + "aggregate_load_tv": 0.03846153846153846 + }, + "period_at_s0": { + "tokens": 52, + "ordered_topk_exact_tokens": 27, + "set_exact_tokens": 32, + "mean_set_jaccard": 0.8736263736263736, + "mean_token_weighted_tv": 0.026100847646235846, + "aggregate_load_tv": 0.05128205128205129 + }, + "period_at_s1": { + "tokens": 52, + "ordered_topk_exact_tokens": 23, + "set_exact_tokens": 33, + "mean_set_jaccard": 0.8873626373626373, + "mean_token_weighted_tv": 0.025707301907599546, + "aggregate_load_tv": 0.041666666666666664 + } + } + }, + "layer_15": { + "layer": 15, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "ca96c3dac12076f64a91d5da84e99bbb32b4a4a560a2f66a83e34c4736b1c1e0", + "route_weight_sha256": "01560684078ddd9cfd37533921d2c01dd4aec0ebbeb50750ccb025afd972af04", + "loads": [ + 1, + 3, + 3, + 1, + 1, + 0, + 2, + 0, + 0, + 0, + 2, + 20, + 12, + 0, + 2, + 2, + 1, + 1, + 0, + 2, + 1, + 4, + 0, + 3, + 31, + 17, + 11, + 3, + 0, + 1, + 1, + 1, + 2, + 6, + 2, + 10, + 11, + 1, + 21, + 1, + 9, + 0, + 7, + 9, + 3, + 2, + 7, + 24, + 3, + 4, + 3, + 0, + 13, + 5, + 0, + 4, + 7, + 2, + 2, + 5, + 2, + 14, + 5, + 2 + ], + "weighted_loads": [ + 0.03003573976457119, + 0.10447850450873375, + 0.30034883320331573, + 0.04258882254362106, + 0.030734198167920113, + 0.0, + 0.0569005161523819, + 0.0, + 0.0, + 0.0, + 0.21851523220539093, + 3.000830812379718, + 0.5841439682990313, + 0.0, + 0.09181761369109154, + 0.09211119636893272, + 0.04590628668665886, + 0.04727155342698097, + 0.0, + 0.08962804824113846, + 0.03063906729221344, + 0.21812980249524117, + 0.0, + 0.11133156716823578, + 2.1216022884473205, + 2.5526021160185337, + 0.43966362066566944, + 0.23464469984173775, + 0.0, + 0.040798675268888474, + 0.04093051329255104, + 0.04103919118642807, + 0.0863628052175045, + 0.5009207203984261, + 0.08507423847913742, + 0.44490612111985683, + 0.5867235641926527, + 0.027163997292518616, + 1.3407040257006884, + 0.06632817536592484, + 0.5883615165948868, + 0.0, + 0.5836483612656593, + 0.7600965276360512, + 0.17112972773611546, + 0.13288391381502151, + 0.6363988481462002, + 2.4491161182522774, + 0.13727374374866486, + 0.5538778733462095, + 0.12051030248403549, + 0.0, + 1.172410387545824, + 0.717362878844142, + 0.0, + 0.35120120272040367, + 0.4445639569312334, + 0.06519493646919727, + 0.12073895707726479, + 0.21024331636726856, + 0.08838731795549393, + 1.4233800657093525, + 0.27497453428804874, + 0.09122466295957565 + ], + "unique_experts": 53, + "load_cv": 1.3041682026696944, + "normalized_load_entropy": 0.8396747790727681, + "max_load_share": 0.09935897435897435 + }, + "full_input": { + "tokens": 77, + "top_k": 6, + "decisions": 462, + "ordered_route_sha256": "0b458b4123e15371199aa16ebe76e94f4fdaadc27c18c23b986ca8992da1b0c4", + "route_weight_sha256": "913881fba8d78d36c2a213cc87b69493d2d12e3dc351d4312f56f9265fc408ef", + "loads": [ + 4, + 3, + 3, + 1, + 7, + 3, + 8, + 2, + 6, + 1, + 7, + 21, + 17, + 0, + 13, + 3, + 8, + 4, + 0, + 4, + 1, + 4, + 0, + 8, + 34, + 18, + 21, + 3, + 4, + 2, + 5, + 1, + 7, + 8, + 2, + 11, + 16, + 1, + 24, + 1, + 15, + 2, + 7, + 11, + 3, + 2, + 8, + 25, + 4, + 12, + 8, + 2, + 18, + 5, + 0, + 8, + 7, + 2, + 3, + 5, + 2, + 16, + 5, + 6 + ], + "weighted_loads": [ + 0.2516929190605879, + 0.10447850450873375, + 0.30034883320331573, + 0.04258882254362106, + 0.4216209352016449, + 0.08021837752312422, + 0.5997583977878094, + 0.06447239220142365, + 0.41855959966778755, + 0.03144008666276932, + 0.4114321321249008, + 3.0309305507689714, + 0.9597448091953993, + 0.0, + 0.495591183193028, + 0.12355021014809608, + 0.7155428491532803, + 0.1574343703687191, + 0.0, + 0.19868065044283867, + 0.03063906729221344, + 0.21812980249524117, + 0.0, + 0.38608844950795174, + 2.179594215704128, + 2.5811372958123684, + 1.1027987282723188, + 0.23464469984173775, + 0.1485718097537756, + 0.14217569306492805, + 0.2149585708975792, + 0.04103919118642807, + 0.48979917354881763, + 0.5952243357896805, + 0.08507423847913742, + 0.47120638377964497, + 1.3081352338194847, + 0.027163997292518616, + 1.450550138950348, + 0.06632817536592484, + 1.0117528908886015, + 0.04319789865985513, + 0.5836483612656593, + 0.8439735360443592, + 0.17112972773611546, + 0.13288391381502151, + 0.7456590794026852, + 2.4834836907684803, + 0.15077215526252985, + 1.3759530950337648, + 0.45330599695444107, + 0.0875227190554142, + 1.320386152714491, + 0.717362878844142, + 0.0, + 2.0183762572705746, + 0.4445639569312334, + 0.06519493646919727, + 0.16972170025110245, + 0.21024331636726856, + 0.08838731795549393, + 1.499722957611084, + 0.27497453428804874, + 0.26352807879447937 + ], + "unique_experts": 60, + "load_cv": 0.9787667217711447, + "normalized_load_entropy": 0.8988028311969505, + "max_load_share": 0.0735930735930736 + } + }, + "s1_eos": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "c1cf11bfcae18c20ddc7444cc426a39c88d1ab16f99990207db97c7d1f4983ca", + "route_weight_sha256": "14269a6a792d6159108602ff4dc26f6548c15cb9d708aa569a1e0906be55071b", + "loads": [ + 1, + 3, + 4, + 1, + 2, + 0, + 1, + 0, + 1, + 0, + 2, + 20, + 12, + 0, + 2, + 2, + 1, + 1, + 1, + 2, + 1, + 4, + 0, + 4, + 29, + 19, + 9, + 3, + 0, + 1, + 1, + 1, + 2, + 7, + 3, + 9, + 12, + 1, + 19, + 1, + 8, + 0, + 7, + 9, + 3, + 2, + 7, + 23, + 3, + 5, + 3, + 0, + 13, + 5, + 0, + 4, + 6, + 2, + 2, + 4, + 2, + 14, + 6, + 2 + ], + "weighted_loads": [ + 0.030359243974089622, + 0.11028316430747509, + 0.34148450568318367, + 0.03900134935975075, + 0.06152029149234295, + 0.0, + 0.031851161271333694, + 0.0, + 0.02845689281821251, + 0.0, + 0.20879755169153214, + 2.970906261354685, + 0.5664599891752005, + 0.0, + 0.09056726098060608, + 0.09241272136569023, + 0.047104623168706894, + 0.04636317119002342, + 0.03140711039304733, + 0.0950101912021637, + 0.029483994469046593, + 0.2222292199730873, + 0.0, + 0.13131988607347012, + 2.077383164316416, + 2.651252403855324, + 0.3792699072510004, + 0.23143001645803452, + 0.0, + 0.04529538005590439, + 0.040044352412223816, + 0.04065730422735214, + 0.08454989269375801, + 0.5245624892413616, + 0.11880318075418472, + 0.4035299811512232, + 0.6091453824192286, + 0.029189277440309525, + 1.2939472831785679, + 0.06779710948467255, + 0.5610927008092403, + 0.0, + 0.58445068821311, + 0.7575542218983173, + 0.16822699829936028, + 0.13050418719649315, + 0.6474595330655575, + 2.3707868438214064, + 0.13118954747915268, + 0.5413147835060954, + 0.11643294803798199, + 0.0, + 1.1533712185919285, + 0.7161622773855925, + 0.0, + 0.3464362137019634, + 0.41750818863511086, + 0.06417419388890266, + 0.12199116870760918, + 0.18113237991929054, + 0.09076094627380371, + 1.43003292940557, + 0.312808096408844, + 0.08842267096042633 + ], + "unique_experts": 55, + "load_cv": 1.2537910952202718, + "normalized_load_entropy": 0.8501623618556615, + "max_load_share": 0.09294871794871795 + }, + "full_input": { + "tokens": 93, + "top_k": 6, + "decisions": 558, + "ordered_route_sha256": "83ae62859fba5d8e15ffb82f6f10026b960cac501bde01d1c28325ddaa0a7428", + "route_weight_sha256": "3b69cbdfe783de187bf60e181103bd4caccfc1c096e698190045c745a2e5cae9", + "loads": [ + 20, + 4, + 4, + 1, + 10, + 5, + 14, + 1, + 11, + 1, + 8, + 24, + 18, + 1, + 8, + 12, + 13, + 6, + 2, + 6, + 2, + 5, + 0, + 9, + 32, + 20, + 19, + 5, + 5, + 3, + 7, + 5, + 7, + 9, + 5, + 9, + 18, + 1, + 23, + 2, + 15, + 3, + 7, + 11, + 3, + 3, + 8, + 24, + 6, + 17, + 11, + 3, + 15, + 6, + 0, + 8, + 6, + 8, + 4, + 8, + 2, + 21, + 8, + 6 + ], + "weighted_loads": [ + 1.3442724626511335, + 0.13556976802647114, + 0.34148450568318367, + 0.03900134935975075, + 0.5478381123393774, + 0.2057711174711585, + 1.072779955342412, + 0.03405535966157913, + 0.5979769956320524, + 0.03103499673306942, + 0.46037421748042107, + 3.3045161832123995, + 1.0567111875861883, + 0.08086966723203659, + 0.2929566353559494, + 0.7545842388644814, + 1.2100404389202595, + 0.2420833669602871, + 0.08443334698677063, + 0.3664000518620014, + 0.058156246319413185, + 0.30556415766477585, + 0.0, + 0.37918482162058353, + 2.142697885632515, + 2.679765474051237, + 1.0930335205048323, + 0.3570929355919361, + 0.3860398977994919, + 0.17362861707806587, + 0.2663248460739851, + 0.48380348458886147, + 0.48342083767056465, + 0.6386633180081844, + 0.26739952340722084, + 0.4035299811512232, + 1.322728231549263, + 0.029189277440309525, + 1.4159517008811235, + 0.10454145818948746, + 0.9599968031980097, + 0.1308814538642764, + 0.58445068821311, + 1.036426693201065, + 0.16822699829936028, + 0.1697881855070591, + 0.7707616947591305, + 2.4049798268824816, + 0.27362986374646425, + 2.1946525080129504, + 0.5304573252797127, + 0.09316787123680115, + 1.2016471698880196, + 0.848343787714839, + 0.0, + 1.9945498146116734, + 0.41750818863511086, + 0.7285687290132046, + 0.2025449275970459, + 0.35671626031398773, + 0.09076094627380371, + 1.812489042058587, + 0.43188294023275375, + 0.24614958465099335 + ], + "unique_experts": 62, + "load_cv": 0.8006802647246583, + "normalized_load_entropy": 0.9264217891049277, + "max_load_share": 0.05734767025089606 + } + }, + "s0_bos": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "a11b3bed2a0c373c8577f38ffd5e5fa463d64e75ba7411391b51f02f20cefcc2", + "route_weight_sha256": "d114bbad2283421c7ce4461665d72f0bfff28ae61e03ea9250ee3ad4e83095a5", + "loads": [ + 2, + 3, + 4, + 1, + 2, + 0, + 1, + 0, + 0, + 0, + 2, + 21, + 10, + 0, + 1, + 1, + 1, + 0, + 0, + 2, + 1, + 4, + 1, + 4, + 32, + 17, + 9, + 3, + 0, + 0, + 1, + 1, + 1, + 7, + 3, + 11, + 10, + 1, + 21, + 1, + 10, + 0, + 8, + 9, + 3, + 2, + 7, + 23, + 3, + 4, + 2, + 0, + 14, + 5, + 0, + 5, + 6, + 2, + 2, + 4, + 1, + 15, + 6, + 2 + ], + "weighted_loads": [ + 0.07320764474570751, + 0.09777596965432167, + 0.3228386789560318, + 0.044572699815034866, + 0.06011389568448067, + 0.0, + 0.03021475113928318, + 0.0, + 0.0, + 0.0, + 0.2161647006869316, + 3.1219131760299206, + 0.5183725319802761, + 0.0, + 0.05811014026403427, + 0.05302181467413902, + 0.04918641224503517, + 0.0, + 0.0, + 0.10639942809939384, + 0.02897047810256481, + 0.23127715662121773, + 0.037962935864925385, + 0.13223806768655777, + 2.0722609609365463, + 2.5238986760377884, + 0.3856876492500305, + 0.23599953576922417, + 0.0, + 0.0, + 0.043127451092004776, + 0.033135782927274704, + 0.04549436643719673, + 0.5393892508000135, + 0.12937072664499283, + 0.474066611379385, + 0.5449183210730553, + 0.028880015015602112, + 1.336988279595971, + 0.0604286789894104, + 0.5791022386401892, + 0.0, + 0.6225787661969662, + 0.777459803968668, + 0.18126601353287697, + 0.13592945039272308, + 0.6361643932759762, + 2.4301119446754456, + 0.16071883961558342, + 0.5348283210769296, + 0.09127451851963997, + 0.0, + 1.1766986548900604, + 0.6975366026163101, + 0.0, + 0.39360572025179863, + 0.4157598130404949, + 0.058806037530303, + 0.11464044079184532, + 0.1560191623866558, + 0.05411902815103531, + 1.5075784362852573, + 0.316611485555768, + 0.08573439717292786 + ], + "unique_experts": 52, + "load_cv": 1.323683025552852, + "normalized_load_entropy": 0.8338923938782417, + "max_load_share": 0.10256410256410256 + }, + "full_input": { + "tokens": 77, + "top_k": 6, + "decisions": 462, + "ordered_route_sha256": "52da378d73e9ef06d9471ffc0414838c91b37c7fb2273eb7c08db9037c017ffe", + "route_weight_sha256": "3684c1ab64bc26e060df37fa840f06d0baaf43aac46c400cb964dd07df865a57", + "loads": [ + 6, + 3, + 4, + 1, + 7, + 3, + 7, + 2, + 4, + 1, + 7, + 22, + 15, + 0, + 11, + 2, + 8, + 3, + 0, + 4, + 1, + 4, + 1, + 9, + 34, + 18, + 19, + 3, + 4, + 1, + 5, + 1, + 6, + 9, + 3, + 13, + 15, + 1, + 24, + 1, + 17, + 1, + 8, + 11, + 3, + 2, + 8, + 24, + 4, + 12, + 8, + 3, + 19, + 5, + 2, + 7, + 6, + 2, + 3, + 4, + 1, + 17, + 6, + 7 + ], + "weighted_loads": [ + 0.3656000252813101, + 0.09777596965432167, + 0.3228386789560318, + 0.044572699815034866, + 0.37385241128504276, + 0.10805148258805275, + 0.52642603777349, + 0.06447239220142365, + 0.32722676172852516, + 0.03144008666276932, + 0.4090816006064415, + 3.152012914419174, + 0.922883428633213, + 0.0, + 0.45250859297811985, + 0.08446082845330238, + 0.7257640399038792, + 0.10360568389296532, + 0.0, + 0.21545203030109406, + 0.02897047810256481, + 0.23127715662121773, + 0.037962935864925385, + 0.4069949500262737, + 2.1265529096126556, + 2.552433855831623, + 1.04882275685668, + 0.23599953576922417, + 0.1485718097537756, + 0.10684867203235626, + 0.21715550869703293, + 0.033135782927274704, + 0.44893073476850986, + 0.633692866191268, + 0.12937072664499283, + 0.5932038072496653, + 1.303365247324109, + 0.028880015015602112, + 1.4636509586125612, + 0.0604286789894104, + 1.093707511201501, + 0.03324645757675171, + 0.6225787661969662, + 0.861336812376976, + 0.18126601353287697, + 0.13592945039272308, + 0.7402896843850613, + 2.4644795171916485, + 0.1742172511294484, + 1.3416561679914594, + 0.526624295860529, + 0.1377033144235611, + 1.3246744200587273, + 0.6975366026163101, + 0.10493927076458931, + 1.0320653654634953, + 0.4157598130404949, + 0.058806037530303, + 0.16362318396568298, + 0.1560191623866558, + 0.05411902815103531, + 1.5839213281869888, + 0.316611485555768, + 0.30223348177969456 + ], + "unique_experts": 62, + "load_cv": 0.9729286748423371, + "normalized_load_entropy": 0.9010973880387846, + "max_load_share": 0.0735930735930736 + } + }, + "s1_bos": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "ab9a13bd566112d1d1ab1f78bd7fec7986e573d287e3a3cc8cc368c07e69b437", + "route_weight_sha256": "d65f8187cfa0d26be45bb8be43a153d574edfee42cfdb26e4425cdf0078cc444", + "loads": [ + 2, + 3, + 4, + 1, + 2, + 0, + 1, + 0, + 1, + 0, + 2, + 20, + 11, + 0, + 1, + 2, + 1, + 0, + 0, + 3, + 1, + 4, + 1, + 4, + 31, + 17, + 8, + 3, + 1, + 0, + 2, + 1, + 2, + 6, + 3, + 11, + 11, + 1, + 21, + 1, + 9, + 0, + 7, + 9, + 3, + 2, + 7, + 23, + 3, + 4, + 1, + 0, + 14, + 5, + 0, + 4, + 7, + 2, + 2, + 4, + 1, + 14, + 6, + 2 + ], + "weighted_loads": [ + 0.08056707307696342, + 0.09732827916741371, + 0.3373726699501276, + 0.04328625649213791, + 0.06334925815463066, + 0.0, + 0.031930796802043915, + 0.0, + 0.02805478312075138, + 0.0, + 0.20220841467380524, + 3.063162112608552, + 0.5426653437316418, + 0.0, + 0.05738263204693794, + 0.07898507453501225, + 0.049116626381874084, + 0.0, + 0.0, + 0.1481323316693306, + 0.024706045165657997, + 0.22814171016216278, + 0.03804359957575798, + 0.13962142169475555, + 2.0958445966243744, + 2.6101563535630703, + 0.3445153571665287, + 0.23737138509750366, + 0.03609300032258034, + 0.0, + 0.0746682733297348, + 0.03353389352560043, + 0.07249215990304947, + 0.5157046467065811, + 0.1314970850944519, + 0.4760719835758209, + 0.5760604925453663, + 0.02790684439241886, + 1.374128671362996, + 0.05585649609565735, + 0.5516109317541122, + 0.0, + 0.6079318411648273, + 0.7615401186048985, + 0.16919232159852982, + 0.1340385042130947, + 0.6358904018998146, + 2.417908251285553, + 0.1498607099056244, + 0.5358255645260215, + 0.06306153535842896, + 0.0, + 1.1979444660246372, + 0.686848308891058, + 0.0, + 0.3414088934659958, + 0.46117946691811085, + 0.05929642356932163, + 0.11287988722324371, + 0.15175247564911842, + 0.05495607480406761, + 1.4724340122193098, + 0.32440713234245777, + 0.08492005243897438 + ], + "unique_experts": 54, + "load_cv": 1.2889557669289031, + "normalized_load_entropy": 0.8436541589094411, + "max_load_share": 0.09935897435897435 + }, + "full_input": { + "tokens": 93, + "top_k": 6, + "decisions": 558, + "ordered_route_sha256": "f62a3cb11a876b3b507ab75278e7a717ff5350ef73e6c738616e6a7c5e06db68", + "route_weight_sha256": "da1584928f7e5f1113f5b123f178e7533418c400fc7df0cb92c01e26532b670f", + "loads": [ + 21, + 4, + 4, + 1, + 10, + 5, + 13, + 1, + 10, + 1, + 8, + 24, + 17, + 1, + 7, + 12, + 13, + 5, + 1, + 7, + 2, + 5, + 1, + 9, + 34, + 18, + 18, + 5, + 6, + 2, + 9, + 5, + 7, + 8, + 5, + 11, + 18, + 1, + 26, + 2, + 16, + 2, + 7, + 11, + 3, + 3, + 8, + 24, + 6, + 16, + 10, + 2, + 16, + 6, + 0, + 7, + 7, + 8, + 4, + 8, + 1, + 21, + 8, + 7 + ], + "weighted_loads": [ + 1.443927925080061, + 0.12261488288640976, + 0.3373726699501276, + 0.04328625649213791, + 0.47134929895401, + 0.2436024695634842, + 0.9652225244790316, + 0.03405535966157913, + 0.5304139759391546, + 0.03103499673306942, + 0.45378508046269417, + 3.3967720344662666, + 1.043692085891962, + 0.08086966723203659, + 0.2777426205575466, + 0.7411565920338035, + 1.2192892022430897, + 0.18622074462473392, + 0.0530262365937233, + 0.4195221923291683, + 0.05337829701602459, + 0.3114766478538513, + 0.03804359957575798, + 0.387486357241869, + 2.2096697818487883, + 2.6386694237589836, + 1.0582789704203606, + 0.36303430423140526, + 0.4221328981220722, + 0.1398775838315487, + 0.35021976195275784, + 0.47668007388710976, + 0.4713631048798561, + 0.6298054754734039, + 0.280093427747488, + 0.4760719835758209, + 1.3609475959092379, + 0.02790684439241886, + 1.5602300427854061, + 0.09260084480047226, + 1.0635673273354769, + 0.11815778911113739, + 0.6079318411648273, + 1.0404125899076462, + 0.16919232159852982, + 0.17332250252366066, + 0.7428325414657593, + 2.452101234346628, + 0.29230102617293596, + 2.190456918440759, + 0.517452510073781, + 0.06722193956375122, + 1.2462204173207283, + 0.8190298192203045, + 0.0, + 1.0608810409903526, + 0.46117946691811085, + 0.7236909586936235, + 0.19343364611268044, + 0.3273363560438156, + 0.05495607480406761, + 1.8548901248723269, + 0.44348197616636753, + 0.2863911036401987 + ], + "unique_experts": 63, + "load_cv": 0.8229612350741737, + "normalized_load_entropy": 0.923400199327469, + "max_load_share": 0.06093189964157706 + } + }, + "s0_x": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "c8e65eebdbf4a8081e56bb4a66e342473345c0323e8e394d5a00f8c22221d642", + "route_weight_sha256": "30c79b8250fc48553d42f4103daea7a08e6b17fbc1c6aa8bfde7241bcf5fa454", + "loads": [ + 2, + 2, + 1, + 0, + 2, + 0, + 1, + 0, + 1, + 0, + 2, + 21, + 10, + 0, + 1, + 1, + 1, + 0, + 0, + 2, + 1, + 4, + 1, + 4, + 31, + 18, + 11, + 3, + 0, + 1, + 1, + 1, + 1, + 7, + 3, + 11, + 12, + 1, + 21, + 3, + 8, + 0, + 7, + 10, + 3, + 2, + 7, + 22, + 3, + 5, + 2, + 0, + 14, + 5, + 0, + 5, + 7, + 2, + 2, + 4, + 1, + 14, + 5, + 2 + ], + "weighted_loads": [ + 0.08105044439435005, + 0.07114468514919281, + 0.23944459855556488, + 0.0, + 0.05690504424273968, + 0.0, + 0.03070751391351223, + 0.0, + 0.029042433947324753, + 0.0, + 0.20204975455999374, + 3.0684975180774927, + 0.5151622984558344, + 0.0, + 0.06363733857870102, + 0.05186625197529793, + 0.048702336847782135, + 0.0, + 0.0, + 0.10331960022449493, + 0.03643588721752167, + 0.22148097306489944, + 0.03955290466547012, + 0.14242763072252274, + 2.0472419299185276, + 2.5462823789566755, + 0.4552595689892769, + 0.23545149713754654, + 0.0, + 0.042060211300849915, + 0.04319130629301071, + 0.03219945356249809, + 0.04195227846503258, + 0.5484836846590042, + 0.13059280440211296, + 0.49419412575662136, + 0.6235804185271263, + 0.02799650840461254, + 1.3577496483922005, + 0.1276095286011696, + 0.5319836810231209, + 0.0, + 0.5757812969386578, + 0.7931021694093943, + 0.18338383175432682, + 0.13169020414352417, + 0.6388091072440147, + 2.3416765555739403, + 0.15329784899950027, + 0.5716386884450912, + 0.09461280517280102, + 0.0, + 1.2006661482155323, + 0.7204816676676273, + 0.0, + 0.37459276989102364, + 0.4399489462375641, + 0.06130180507898331, + 0.12376144900918007, + 0.16023897007107735, + 0.05146488919854164, + 1.47293571382761, + 0.28055425733327866, + 0.08295271918177605 + ], + "unique_experts": 53, + "load_cv": 1.3112069410815996, + "normalized_load_entropy": 0.8359142343536999, + "max_load_share": 0.09935897435897435 + }, + "full_input": { + "tokens": 77, + "top_k": 6, + "decisions": 462, + "ordered_route_sha256": "1e7da4b8e8b0d4905ccee2c8b92b30fbe6112adf86f471e6dd772805391f49df", + "route_weight_sha256": "ba80966c11211eb30bbcf8155fd229b67d719e97dde344a7fcc08378852147c9", + "loads": [ + 5, + 2, + 1, + 0, + 8, + 1, + 7, + 2, + 7, + 1, + 8, + 22, + 15, + 0, + 11, + 3, + 8, + 3, + 0, + 5, + 1, + 4, + 1, + 10, + 33, + 19, + 22, + 3, + 4, + 2, + 5, + 1, + 6, + 9, + 3, + 12, + 17, + 1, + 24, + 3, + 13, + 1, + 7, + 13, + 3, + 2, + 8, + 23, + 4, + 13, + 7, + 2, + 20, + 5, + 0, + 8, + 7, + 2, + 3, + 4, + 1, + 17, + 5, + 5 + ], + "weighted_loads": [ + 0.29414643347263336, + 0.07114468514919281, + 0.23944459855556488, + 0.0, + 0.41653968393802643, + 0.0187469981610775, + 0.6053883451968431, + 0.06447239220142365, + 0.4751671180129051, + 0.03144008666276932, + 0.4641250893473625, + 3.0985972564667463, + 0.8979703653603792, + 0.0, + 0.45226846262812614, + 0.11787945404648781, + 0.7277576513588428, + 0.10891619697213173, + 0.0, + 0.26048940047621727, + 0.03643588721752167, + 0.22148097306489944, + 0.03955290466547012, + 0.5123027376830578, + 2.101533878594637, + 2.57481755875051, + 1.2375332675874233, + 0.23545149713754654, + 0.1485718097537756, + 0.15805627405643463, + 0.21721936389803886, + 0.03219945356249809, + 0.4453886467963457, + 0.6427873000502586, + 0.13059280440211296, + 0.5192019622772932, + 1.3121930379420519, + 0.02799650840461254, + 1.4712294451892376, + 0.1276095286011696, + 0.9527075327932835, + 0.042760591953992844, + 0.5757812969386578, + 0.9598217215389013, + 0.18338383175432682, + 0.13169020414352417, + 0.7410579770803452, + 2.376044128090143, + 0.16679626051336527, + 1.322271429002285, + 0.40257774852216244, + 0.0875227190554142, + 1.3860443532466888, + 0.7204816676676273, + 0.0, + 1.0620781853795052, + 0.4399489462375641, + 0.06130180507898331, + 0.17274419218301773, + 0.16023897007107735, + 0.05146488919854164, + 1.6150261871516705, + 0.28055425733327866, + 0.21314246580004692 + ], + "unique_experts": 60, + "load_cv": 0.9879144512496768, + "normalized_load_entropy": 0.894723105828927, + "max_load_share": 0.07142857142857142 + } + }, + "s1_x": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "b0e839f9d26d5b9c483a3e798c0daa804348ffcda1b3c72a86b64885eb536466", + "route_weight_sha256": "b38840fbd7d9d9ab65b128012675c99ba4eb2a80ce5492c15c1a29b8779aa031", + "loads": [ + 2, + 3, + 3, + 0, + 2, + 0, + 1, + 0, + 1, + 0, + 2, + 21, + 10, + 0, + 3, + 1, + 1, + 1, + 0, + 3, + 1, + 4, + 1, + 3, + 31, + 18, + 9, + 3, + 1, + 1, + 2, + 1, + 0, + 8, + 3, + 9, + 11, + 0, + 21, + 2, + 8, + 0, + 7, + 10, + 4, + 2, + 7, + 23, + 3, + 4, + 1, + 0, + 14, + 5, + 0, + 4, + 6, + 2, + 2, + 4, + 1, + 14, + 7, + 1 + ], + "weighted_loads": [ + 0.08389648795127869, + 0.08807867765426636, + 0.31570589542388916, + 0.0, + 0.06965952925384045, + 0.0, + 0.03322619944810867, + 0.0, + 0.033636510372161865, + 0.0, + 0.19148680567741394, + 3.0402197893708944, + 0.503782806918025, + 0.0, + 0.1252905149012804, + 0.052408989518880844, + 0.0496927835047245, + 0.04371752217411995, + 0.0, + 0.16729912161827087, + 0.028225058689713478, + 0.22636687755584717, + 0.04038510471582413, + 0.09693128801882267, + 2.054229188710451, + 2.6069366987794638, + 0.3752984832972288, + 0.22730214893817902, + 0.035074274986982346, + 0.033973004668951035, + 0.07360144518315792, + 0.0330931656062603, + 0.0, + 0.579406326636672, + 0.13646109774708748, + 0.4228970780968666, + 0.5702454261481762, + 0.0, + 1.3586932923644781, + 0.08049644157290459, + 0.5350816547870636, + 0.0, + 0.6112884096801281, + 0.7951070629060268, + 0.20095065794885159, + 0.13790737465023994, + 0.6277960762381554, + 2.406292997300625, + 0.14949066564440727, + 0.5287652965635061, + 0.0670645460486412, + 0.0, + 1.228611871600151, + 0.7067862264811993, + 0.0, + 0.3381478376686573, + 0.41975951939821243, + 0.061096902936697006, + 0.11920186132192612, + 0.1699608378112316, + 0.05517333373427391, + 1.4990598000586033, + 0.3554152883589268, + 0.044908300042152405 + ], + "unique_experts": 53, + "load_cv": 1.3031595650844165, + "normalized_load_entropy": 0.8395393341268346, + "max_load_share": 0.09935897435897435 + }, + "full_input": { + "tokens": 93, + "top_k": 6, + "decisions": 558, + "ordered_route_sha256": "0c0f7077bb0bd1f5ff3e95c6bbbfd84c95d04da231c8b2ff1cc6d4ab45355b67", + "route_weight_sha256": "6fb7158121af2c5aa3347be61f7f6fc137eb7de944a6d379daef461f3bcb124f", + "loads": [ + 22, + 4, + 3, + 0, + 9, + 3, + 14, + 1, + 12, + 1, + 9, + 25, + 16, + 1, + 8, + 11, + 13, + 6, + 1, + 8, + 3, + 5, + 1, + 9, + 33, + 19, + 20, + 5, + 6, + 3, + 8, + 5, + 6, + 10, + 5, + 9, + 17, + 0, + 23, + 3, + 14, + 2, + 7, + 13, + 4, + 3, + 8, + 24, + 6, + 16, + 9, + 4, + 16, + 6, + 0, + 7, + 6, + 8, + 4, + 8, + 1, + 22, + 9, + 4 + ], + "weighted_loads": [ + 1.412742106243968, + 0.1133652813732624, + 0.31570589542388916, + 0.0, + 0.43546938337385654, + 0.15121406316757202, + 1.0496368575841188, + 0.03405535966157913, + 0.6784889865666628, + 0.03103499673306942, + 0.4955602437257767, + 3.373829711228609, + 0.9889117535203695, + 0.08086966723203659, + 0.31619352847337723, + 0.7145805070176721, + 1.1564326770603657, + 0.2366168461740017, + 0.0530262365937233, + 0.48966817557811737, + 0.08577284403145313, + 0.3097018152475357, + 0.04038510471582413, + 0.4162589441984892, + 2.115878948941827, + 2.635449768975377, + 1.2152478862553835, + 0.3529650680720806, + 0.42111417278647423, + 0.15578114986419678, + 0.2998819388449192, + 0.4762393459677696, + 0.45200498029589653, + 0.6935071554034948, + 0.2850574404001236, + 0.4228970780968666, + 1.2188021186739206, + 0.0, + 1.4234676100313663, + 0.1172407902777195, + 0.9232156630605459, + 0.11887264996767044, + 0.6112884096801281, + 1.20065426081419, + 0.20095065794885159, + 0.1771913729608059, + 0.7531052157282829, + 2.4404859803617, + 0.29193098191171885, + 2.0116542149335146, + 0.3889269921928644, + 0.1277467329055071, + 1.2768878228962421, + 0.8389677368104458, + 0.0, + 1.0151186622679234, + 0.41975951939821243, + 0.7254914380609989, + 0.19975562021136284, + 0.3455447182059288, + 0.05517333373427391, + 1.9331082366406918, + 0.47449013218283653, + 0.15870137885212898 + ], + "unique_experts": 61, + "load_cv": 0.8189552392337437, + "normalized_load_entropy": 0.9223867404304655, + "max_load_share": 0.05913978494623656 + } + }, + "s0_period": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "1f61b1264d5ed6308ced68085877586940f18e8c77ef07919fcb7703930a3e54", + "route_weight_sha256": "140850ab1af4990103e46cef90e3103c3c6b5aebedf7b70fd8fcacdc23d74fb7", + "loads": [ + 2, + 2, + 2, + 0, + 1, + 0, + 1, + 0, + 1, + 0, + 2, + 22, + 10, + 0, + 1, + 2, + 1, + 1, + 0, + 2, + 1, + 4, + 1, + 4, + 31, + 18, + 11, + 3, + 0, + 1, + 1, + 0, + 1, + 7, + 3, + 10, + 10, + 1, + 22, + 2, + 9, + 0, + 7, + 9, + 4, + 2, + 7, + 24, + 3, + 5, + 1, + 0, + 14, + 5, + 0, + 5, + 6, + 2, + 2, + 4, + 2, + 14, + 5, + 1 + ], + "weighted_loads": [ + 0.07933393120765686, + 0.06547254882752895, + 0.27039699628949165, + 0.0, + 0.031831495463848114, + 0.0, + 0.03413074091076851, + 0.0, + 0.028039131313562393, + 0.0, + 0.21052108705043793, + 3.085819438099861, + 0.5150478407740593, + 0.0, + 0.060504358261823654, + 0.08373765833675861, + 0.04598197340965271, + 0.0456140860915184, + 0.0, + 0.11278954520821571, + 0.03631255775690079, + 0.21813718229532242, + 0.039378292858600616, + 0.13846209272742271, + 2.0616134889423847, + 2.517501153051853, + 0.46390266343951225, + 0.236990038305521, + 0.0, + 0.0415002778172493, + 0.04245757684111595, + 0.0, + 0.041403885930776596, + 0.5577084608376026, + 0.13482185080647469, + 0.4767432454973459, + 0.5561191514134407, + 0.02875928394496441, + 1.382870426401496, + 0.08738957718014717, + 0.5696415789425373, + 0.0, + 0.5915416106581688, + 0.7751255482435226, + 0.21123254671692848, + 0.13277331739664078, + 0.6330411247909069, + 2.4526646193116903, + 0.15289556980133057, + 0.5407866612076759, + 0.06338728219270706, + 0.0, + 1.2155477441847324, + 0.7141275778412819, + 0.0, + 0.38812312856316566, + 0.4169112555682659, + 0.06223773770034313, + 0.12717140093445778, + 0.16616668179631233, + 0.08831633627414703, + 1.4937348403036594, + 0.27614884451031685, + 0.0416998527944088 + ], + "unique_experts": 53, + "load_cv": 1.3360426123192848, + "normalized_load_entropy": 0.8331244840452661, + "max_load_share": 0.09935897435897435 + }, + "full_input": { + "tokens": 77, + "top_k": 6, + "decisions": 462, + "ordered_route_sha256": "009236d72edaefcc859a61f93eed5408f9ea8d0eb6e65459993e6d51412085a5", + "route_weight_sha256": "90cadffb95757be9fe9c0530e4b5ef85ac75023f1d3ba33123ca4190760f90b5", + "loads": [ + 5, + 2, + 2, + 0, + 7, + 1, + 8, + 2, + 8, + 1, + 7, + 24, + 15, + 0, + 11, + 3, + 8, + 4, + 0, + 4, + 1, + 4, + 1, + 10, + 33, + 19, + 22, + 3, + 4, + 2, + 5, + 0, + 6, + 9, + 3, + 10, + 15, + 1, + 25, + 2, + 15, + 1, + 7, + 11, + 4, + 2, + 8, + 25, + 4, + 13, + 6, + 2, + 19, + 5, + 0, + 8, + 6, + 2, + 4, + 4, + 2, + 17, + 5, + 5 + ], + "weighted_loads": [ + 0.2889172025024891, + 0.06547254882752895, + 0.27039699628949165, + 0.0, + 0.4310730528086424, + 0.0187469981610775, + 0.6251835785806179, + 0.06447239220142365, + 0.5141447596251965, + 0.03144008666276932, + 0.4034379869699478, + 3.148182727396488, + 0.8742130473256111, + 0.0, + 0.4487551897764206, + 0.11517667211592197, + 0.7259894460439682, + 0.1498791202902794, + 0.0, + 0.22184214740991592, + 0.03631255775690079, + 0.21813718229532242, + 0.039378292858600616, + 0.50862967222929, + 2.115905437618494, + 2.546036332845688, + 1.1693043000996113, + 0.236990038305521, + 0.1485718097537756, + 0.16980914026498795, + 0.2164856344461441, + 0.0, + 0.44484025426208973, + 0.652012076228857, + 0.13482185080647469, + 0.4767432454973459, + 1.2912096250802279, + 0.02875928394496441, + 1.5005626045167446, + 0.08738957718014717, + 1.1135587953031063, + 0.03665974736213684, + 0.5915416106581688, + 0.8590025566518307, + 0.21123254671692848, + 0.13277331739664078, + 0.7397289834916592, + 2.4870321918278933, + 0.16639398131519556, + 1.3473676443099976, + 0.3902287743985653, + 0.0875227190554142, + 1.3635235093533993, + 0.7141275778412819, + 0.0, + 1.0828664489090443, + 0.4169112555682659, + 0.06223773770034313, + 0.2269996479153633, + 0.16616668179631233, + 0.08831633627414703, + 1.711707815527916, + 0.27614884451031685, + 0.199373384937644 + ], + "unique_experts": 59, + "load_cv": 1.000580779980204, + "normalized_load_entropy": 0.8935814261736588, + "max_load_share": 0.07142857142857142 + } + }, + "s1_period": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "eba129515673d2226fe0124de92713d0e0d84631415601d9776165e1d90fa80a", + "route_weight_sha256": "3c331cf3fd891842e0484e7bed93cb89b1e8bff4c9b22814434681ccbc50af91", + "loads": [ + 2, + 1, + 3, + 1, + 2, + 0, + 2, + 0, + 1, + 0, + 2, + 21, + 11, + 0, + 2, + 2, + 1, + 1, + 0, + 3, + 1, + 4, + 1, + 3, + 31, + 18, + 7, + 3, + 1, + 0, + 2, + 1, + 0, + 8, + 3, + 9, + 11, + 1, + 21, + 1, + 8, + 0, + 7, + 9, + 3, + 2, + 7, + 25, + 3, + 4, + 2, + 0, + 15, + 5, + 0, + 4, + 6, + 2, + 2, + 4, + 1, + 14, + 7, + 1 + ], + "weighted_loads": [ + 0.08355234563350677, + 0.030550234019756317, + 0.30728336423635483, + 0.03333979472517967, + 0.0655583068728447, + 0.0, + 0.0646109189838171, + 0.0, + 0.03391733765602112, + 0.0, + 0.20114481821656227, + 3.048347745090723, + 0.5502259135246277, + 0.0, + 0.09068068861961365, + 0.08568799868226051, + 0.04463662952184677, + 0.04712160304188728, + 0.0, + 0.15204986557364464, + 0.03231826052069664, + 0.23104334995150566, + 0.040255140513181686, + 0.10001690685749054, + 2.024282803758979, + 2.6045571248978376, + 0.30944835394620895, + 0.2309923656284809, + 0.03733654320240021, + 0.0, + 0.0747396033257246, + 0.03281364589929581, + 0.0, + 0.5770686790347099, + 0.1345127522945404, + 0.4331726133823395, + 0.5672434270381927, + 0.028881894424557686, + 1.3360121380537748, + 0.04464522376656532, + 0.5331939812749624, + 0.0, + 0.6056698895990849, + 0.7764545977115631, + 0.17960618063807487, + 0.13801763579249382, + 0.6167449504137039, + 2.4745847675949335, + 0.1478019580245018, + 0.5418390007689595, + 0.09881545789539814, + 0.0, + 1.263800673186779, + 0.7095657475292683, + 0.0, + 0.3359759971499443, + 0.4266561195254326, + 0.059780463576316833, + 0.12060781195759773, + 0.17380841448903084, + 0.05671319365501404, + 1.5094764567911625, + 0.3618834838271141, + 0.042204853147268295 + ], + "unique_experts": 54, + "load_cv": 1.323683025552852, + "normalized_load_entropy": 0.8385421906226247, + "max_load_share": 0.09935897435897435 + }, + "full_input": { + "tokens": 93, + "top_k": 6, + "decisions": 558, + "ordered_route_sha256": "ef8188c1e6ad8c7ccfdaab56f29534566a0b760704c4adf9c071f17e1bbd0177", + "route_weight_sha256": "a1f1c821dec3cc4d880ee7bcbcb9c83a19f02077fb670ae1973636ea3a7a74f5", + "loads": [ + 22, + 2, + 3, + 1, + 10, + 3, + 14, + 1, + 12, + 1, + 9, + 25, + 17, + 1, + 7, + 14, + 13, + 6, + 1, + 8, + 3, + 5, + 1, + 8, + 33, + 19, + 18, + 5, + 6, + 2, + 8, + 5, + 5, + 11, + 5, + 9, + 17, + 1, + 24, + 2, + 14, + 2, + 7, + 12, + 3, + 3, + 8, + 26, + 6, + 15, + 9, + 3, + 17, + 6, + 0, + 7, + 6, + 8, + 5, + 8, + 1, + 22, + 9, + 4 + ], + "weighted_loads": [ + 1.4003393612802029, + 0.055836837738752365, + 0.30728336423635483, + 0.03333979472517967, + 0.5047792419791222, + 0.15121406316757202, + 1.0681374296545982, + 0.03405535966157913, + 0.6580665577203035, + 0.03103499673306942, + 0.4828048534691334, + 3.3819576669484377, + 1.0171292573213577, + 0.08086966723203659, + 0.28158370219171047, + 0.8132706778123975, + 1.1411718539893627, + 0.24303285032510757, + 0.0530262365937233, + 0.47769396379590034, + 0.09143734537065029, + 0.3143782876431942, + 0.040255140513181686, + 0.34788184240460396, + 2.0859325639903545, + 2.633070195093751, + 1.0698220878839493, + 0.3566552847623825, + 0.4233764410018921, + 0.11951755359768867, + 0.3010200969874859, + 0.47595982626080513, + 0.39887094497680664, + 0.7232251539826393, + 0.2831090949475765, + 0.4331726133823395, + 1.328485256060958, + 0.028881894424557686, + 1.450535424053669, + 0.08138957247138023, + 0.9865921176970005, + 0.12166667357087135, + 0.6056698895990849, + 1.1042750738561153, + 0.17960618063807487, + 0.17730163410305977, + 0.7384435534477234, + 2.5087777506560087, + 0.2902422742918134, + 2.000247669406235, + 0.3937631845474243, + 0.0974808856844902, + 1.31207662448287, + 0.8417472578585148, + 0.0, + 1.0231381841003895, + 0.4266561195254326, + 0.7241749987006187, + 0.2652050405740738, + 0.349392294883728, + 0.05671319365501404, + 2.0442273393273354, + 0.48095832765102386, + 0.15599793195724487 + ], + "unique_experts": 63, + "load_cv": 0.8348638967724276, + "normalized_load_entropy": 0.9209274111885821, + "max_load_share": 0.05913978494623656 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 52, + "ordered_topk_exact_tokens": 31, + "set_exact_tokens": 38, + "mean_set_jaccard": 0.9230769230769231, + "mean_token_weighted_tv": 0.015066535534480443, + "aggregate_load_tv": 0.03846153846153845 + }, + "system_bos": { + "tokens": 52, + "ordered_topk_exact_tokens": 29, + "set_exact_tokens": 40, + "mean_set_jaccard": 0.9340659340659342, + "mean_token_weighted_tv": 0.01744589492535362, + "aggregate_load_tv": 0.028846153846153844 + }, + "system_x": { + "tokens": 52, + "ordered_topk_exact_tokens": 32, + "set_exact_tokens": 35, + "mean_set_jaccard": 0.9024725274725275, + "mean_token_weighted_tv": 0.024324318626895547, + "aggregate_load_tv": 0.044871794871794865 + }, + "system_period": { + "tokens": 52, + "ordered_topk_exact_tokens": 29, + "set_exact_tokens": 32, + "mean_set_jaccard": 0.8901098901098903, + "mean_token_weighted_tv": 0.02419524379253674, + "aggregate_load_tv": 0.05448717948717949 + }, + "bos_at_s0": { + "tokens": 52, + "ordered_topk_exact_tokens": 26, + "set_exact_tokens": 32, + "mean_set_jaccard": 0.8859890109890111, + "mean_token_weighted_tv": 0.026596305085919224, + "aggregate_load_tv": 0.05128205128205129 + }, + "bos_at_s1": { + "tokens": 52, + "ordered_topk_exact_tokens": 27, + "set_exact_tokens": 33, + "mean_set_jaccard": 0.8956043956043958, + "mean_token_weighted_tv": 0.02675217966764019, + "aggregate_load_tv": 0.044871794871794865 + }, + "x_at_s0": { + "tokens": 52, + "ordered_topk_exact_tokens": 25, + "set_exact_tokens": 30, + "mean_set_jaccard": 0.875, + "mean_token_weighted_tv": 0.028002254512662497, + "aggregate_load_tv": 0.054487179487179495 + }, + "x_at_s1": { + "tokens": 52, + "ordered_topk_exact_tokens": 27, + "set_exact_tokens": 31, + "mean_set_jaccard": 0.8804945054945056, + "mean_token_weighted_tv": 0.029656790564051613, + "aggregate_load_tv": 0.05448717948717949 + }, + "period_at_s0": { + "tokens": 52, + "ordered_topk_exact_tokens": 26, + "set_exact_tokens": 33, + "mean_set_jaccard": 0.8873626373626373, + "mean_token_weighted_tv": 0.026566666416608944, + "aggregate_load_tv": 0.04807692307692309 + }, + "period_at_s1": { + "tokens": 52, + "ordered_topk_exact_tokens": 28, + "set_exact_tokens": 34, + "mean_set_jaccard": 0.8969780219780219, + "mean_token_weighted_tv": 0.02732315661314015, + "aggregate_load_tv": 0.05448717948717949 + } + } + }, + "layer_16": { + "layer": 16, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "674f5838de6e7ee015df9f4762ed8da2183b8afe89baf295d748fc3c6b677661", + "route_weight_sha256": "5cbaf9a3f6286623474f92845a59fe40400cbff6a911a1fb7b99b623f196feec", + "loads": [ + 4, + 4, + 0, + 2, + 0, + 0, + 10, + 4, + 2, + 4, + 0, + 11, + 4, + 0, + 0, + 1, + 2, + 3, + 6, + 2, + 3, + 2, + 1, + 3, + 7, + 6, + 3, + 28, + 3, + 8, + 6, + 1, + 8, + 1, + 3, + 3, + 2, + 15, + 6, + 0, + 47, + 2, + 1, + 0, + 1, + 8, + 1, + 14, + 2, + 0, + 0, + 1, + 2, + 14, + 4, + 2, + 5, + 7, + 5, + 0, + 8, + 5, + 2, + 13 + ], + "weighted_loads": [ + 0.3086724430322647, + 0.18686167895793915, + 0.0, + 0.11760474368929863, + 0.0, + 0.0, + 1.4445463381707668, + 0.320085134357214, + 0.23749297857284546, + 0.3474292457103729, + 0.0, + 0.6249902248382568, + 0.148593008518219, + 0.0, + 0.0, + 0.04559871926903725, + 0.11061014607548714, + 0.2587168365716934, + 0.19923561345785856, + 0.07519567012786865, + 0.10695553943514824, + 0.12721387296915054, + 0.03992975875735283, + 0.11687762290239334, + 0.23497124668210745, + 0.3431215062737465, + 0.13861945644021034, + 2.2539174454286695, + 0.12929412722587585, + 0.2879419233649969, + 0.2252285722643137, + 0.021459519863128662, + 0.3391118887811899, + 0.015390698798000813, + 0.16602905094623566, + 0.24414457008242607, + 0.07886971905827522, + 1.6951791103929281, + 0.42685528099536896, + 0.0, + 10.699119865894318, + 0.07472925260663033, + 0.05680128559470177, + 0.0, + 0.026929248124361038, + 0.7922505810856819, + 0.029492704197764397, + 0.8429610878229141, + 0.12847816944122314, + 0.0, + 0.0, + 0.04579593613743782, + 0.04933692514896393, + 1.2664064355194569, + 0.18411019816994667, + 0.046457329764962196, + 0.30787893012166023, + 0.3813634756952524, + 0.2776562459766865, + 0.0, + 0.38026456721127033, + 0.19875666871666908, + 0.16410905867815018, + 0.6628447417169809 + ], + "unique_experts": 53, + "load_cv": 1.4646839745484843, + "normalized_load_entropy": 0.8383176462246432, + "max_load_share": 0.15064102564102563 + }, + "full_input": { + "tokens": 77, + "top_k": 6, + "decisions": 462, + "ordered_route_sha256": "08cadf0dab05f7da77cfa14238f913458d9ba9c2a008a9c7a9f5ccb26f03fee4", + "route_weight_sha256": "7f757343e794a2b4faf05c5b4e3c262d462bc06b9620beb4a91ae3922642c73b", + "loads": [ + 4, + 5, + 0, + 2, + 0, + 8, + 15, + 4, + 2, + 6, + 3, + 12, + 4, + 3, + 0, + 8, + 11, + 8, + 11, + 3, + 14, + 4, + 3, + 3, + 15, + 6, + 7, + 28, + 3, + 8, + 8, + 1, + 9, + 8, + 3, + 3, + 2, + 24, + 7, + 0, + 48, + 9, + 1, + 0, + 7, + 9, + 1, + 14, + 2, + 1, + 0, + 3, + 2, + 25, + 4, + 12, + 5, + 7, + 6, + 0, + 11, + 8, + 2, + 20 + ], + "weighted_loads": [ + 0.3086724430322647, + 0.21962245553731918, + 0.0, + 0.11760474368929863, + 0.0, + 0.7775776125490665, + 1.6645361967384815, + 0.320085134357214, + 0.23749297857284546, + 1.6744037866592407, + 0.1758052371442318, + 0.6613838337361813, + 0.148593008518219, + 0.10822493769228458, + 0.0, + 0.5686092600226402, + 0.5763134337030351, + 0.6587793938815594, + 0.8003110913559794, + 0.07766934088431299, + 1.0945624187588692, + 0.20723213627934456, + 0.16270844265818596, + 0.11687762290239334, + 0.9224556302651763, + 0.3431215062737465, + 0.3867067638784647, + 2.2539174454286695, + 0.12929412722587585, + 0.2879419233649969, + 0.3378493022173643, + 0.021459519863128662, + 0.3795366305857897, + 0.3937211586162448, + 0.16602905094623566, + 0.24414457008242607, + 0.07886971905827522, + 2.1658717561513186, + 0.4566650316119194, + 0.0, + 10.745538722723722, + 1.1330027170479298, + 0.05680128559470177, + 0.0, + 0.2668224163353443, + 0.8601967915892601, + 0.029492704197764397, + 0.8429610878229141, + 0.12847816944122314, + 0.01732088439166546, + 0.0, + 0.14348461851477623, + 0.04933692514896393, + 2.0346757639199495, + 0.18411019816994667, + 0.8488112147897482, + 0.30787893012166023, + 0.3813634756952524, + 0.3672999478876591, + 0.0, + 0.5803720485419035, + 0.3391387538285926, + 0.16410905867815018, + 1.0087615801021457 + ], + "unique_experts": 57, + "load_cv": 1.1061855555858353, + "normalized_load_entropy": 0.8851011353414429, + "max_load_share": 0.1038961038961039 + } + }, + "s1_eos": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "7c0cbff516be456defa9d69b49b26c0cc6582e453c45e90d5a30226ccb51ef27", + "route_weight_sha256": "a4bc3c87d61d7a0c551adf13e94e487d64fb9ff2c4dd48ddc7d6fb28958898a2", + "loads": [ + 4, + 4, + 2, + 2, + 0, + 0, + 10, + 6, + 2, + 3, + 0, + 13, + 4, + 0, + 0, + 1, + 2, + 3, + 5, + 2, + 3, + 2, + 1, + 3, + 7, + 6, + 3, + 28, + 2, + 8, + 4, + 0, + 10, + 1, + 3, + 3, + 2, + 15, + 6, + 0, + 47, + 2, + 1, + 0, + 0, + 8, + 1, + 14, + 2, + 0, + 0, + 1, + 1, + 14, + 5, + 2, + 4, + 7, + 5, + 0, + 9, + 5, + 2, + 12 + ], + "weighted_loads": [ + 0.3110552355647087, + 0.19019449688494205, + 0.04894157126545906, + 0.11104924231767654, + 0.0, + 0.0, + 1.4402483627200127, + 0.4062498062849045, + 0.22142118215560913, + 0.2807398848235607, + 0.0, + 0.6908946093171835, + 0.1509734932333231, + 0.0, + 0.0, + 0.04698994383215904, + 0.11247429996728897, + 0.2559274472296238, + 0.17444843612611294, + 0.07823341339826584, + 0.10504116863012314, + 0.133926123380661, + 0.03968365490436554, + 0.12393259257078171, + 0.23825224675238132, + 0.34159886464476585, + 0.136938888579607, + 2.2799732591956854, + 0.08960981667041779, + 0.28484696336090565, + 0.15909112431108952, + 0.0, + 0.3897177018225193, + 0.015228974632918835, + 0.1676827371120453, + 0.23545842245221138, + 0.08058009296655655, + 1.686864586547017, + 0.4305046685039997, + 0.0, + 10.61678059771657, + 0.07269951328635216, + 0.05165071785449982, + 0.0, + 0.0, + 0.7817981131374836, + 0.030908556655049324, + 0.8242065776139498, + 0.12939639762043953, + 0.0, + 0.0, + 0.046105872839689255, + 0.020857632160186768, + 1.2491196282207966, + 0.20898172445595264, + 0.04607361927628517, + 0.28105688840150833, + 0.3689570911228657, + 0.25694356113672256, + 0.0, + 0.42362555116415024, + 0.1955590657889843, + 0.1664212867617607, + 0.6157966796308756 + ], + "unique_experts": 52, + "load_cv": 1.4763086328702342, + "normalized_load_entropy": 0.8336091667184424, + "max_load_share": 0.15064102564102563 + }, + "full_input": { + "tokens": 93, + "top_k": 6, + "decisions": 558, + "ordered_route_sha256": "fdb7d5f2bad7240e4e3e93fc0217e58e5f26dff426c994585d440b9dd436d5d5", + "route_weight_sha256": "7fa10317f5ab74491c47c783c5ce728fe292fb0ff9c04ac8df4a0a3925de276a", + "loads": [ + 4, + 8, + 2, + 4, + 0, + 8, + 16, + 7, + 2, + 7, + 5, + 14, + 4, + 4, + 1, + 12, + 12, + 15, + 12, + 4, + 14, + 4, + 4, + 4, + 21, + 6, + 13, + 28, + 2, + 8, + 8, + 0, + 15, + 8, + 4, + 5, + 2, + 24, + 9, + 3, + 50, + 16, + 2, + 2, + 5, + 13, + 2, + 20, + 5, + 5, + 6, + 1, + 1, + 26, + 5, + 13, + 6, + 7, + 6, + 1, + 13, + 7, + 5, + 18 + ], + "weighted_loads": [ + 0.3110552355647087, + 0.34294010885059834, + 0.04894157126545906, + 0.20187632367014885, + 0.0, + 0.7608080916106701, + 1.7521478459239006, + 0.4310239125043154, + 0.22142118215560913, + 1.6753175556659698, + 0.1801309809088707, + 0.7223325576633215, + 0.1509734932333231, + 0.13964711502194405, + 0.04410126060247421, + 1.0538406632840633, + 0.5371999563649297, + 1.1238140389323235, + 0.9843688402324915, + 0.1159091517329216, + 1.0196578968316317, + 0.23078745231032372, + 0.16459529101848602, + 0.2003060057759285, + 1.428670970723033, + 0.34159886464476585, + 1.3067472409456968, + 2.2799732591956854, + 0.08960981667041779, + 0.28484696336090565, + 0.3343345932662487, + 0.0, + 0.605920696631074, + 0.3228393029421568, + 0.20280510559678078, + 0.3641246482729912, + 0.08058009296655655, + 2.167874513193965, + 0.5836776476353407, + 0.1772170215845108, + 10.724677998572588, + 2.164956595748663, + 0.08839458227157593, + 0.09283439815044403, + 0.18243962340056896, + 1.012025821954012, + 0.06228560395538807, + 1.1182511877268553, + 0.2543781194835901, + 0.2097755465656519, + 0.2605593837797642, + 0.046105872839689255, + 0.020857632160186768, + 2.331174213439226, + 0.20898172445595264, + 1.034239873290062, + 0.38921093568205833, + 0.3689570911228657, + 0.35286645591259, + 0.1970146894454956, + 0.6038251593708992, + 0.3002748171566054, + 0.49142083898186684, + 0.9334721649065614 + ], + "unique_experts": 62, + "load_cv": 0.9508886943149496, + "normalized_load_entropy": 0.9121814902858452, + "max_load_share": 0.08960573476702509 + } + }, + "s0_bos": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "0e56620930b7bf312b5842d309b59fe8b74a945f51e5aef6fcf597c5ac1a52ff", + "route_weight_sha256": "97d079e58f415e34e4cad3f75e26602001c4f67b80b195099bb97ad9b0fdab54", + "loads": [ + 4, + 4, + 1, + 2, + 0, + 0, + 8, + 6, + 2, + 4, + 0, + 12, + 3, + 0, + 0, + 1, + 3, + 3, + 6, + 2, + 1, + 2, + 1, + 3, + 7, + 7, + 3, + 30, + 4, + 8, + 5, + 0, + 8, + 1, + 3, + 3, + 1, + 15, + 6, + 0, + 47, + 1, + 1, + 0, + 0, + 9, + 1, + 14, + 2, + 0, + 0, + 1, + 1, + 14, + 6, + 2, + 4, + 7, + 5, + 0, + 9, + 5, + 2, + 12 + ], + "weighted_loads": [ + 0.3091062270104885, + 0.1877528801560402, + 0.0235330481082201, + 0.11440864205360413, + 0.0, + 0.0, + 1.3183744605630636, + 0.40116432309150696, + 0.2287924364209175, + 0.3526829183101654, + 0.0, + 0.6312965489923954, + 0.11111503839492798, + 0.0, + 0.0, + 0.06062696874141693, + 0.12485934142023325, + 0.2540352791547775, + 0.21442880481481552, + 0.07381146028637886, + 0.037607576698064804, + 0.1283346451818943, + 0.03693065047264099, + 0.1232256181538105, + 0.21329024154692888, + 0.37163402885198593, + 0.15508169308304787, + 2.50242568179965, + 0.18622729182243347, + 0.30375783890485764, + 0.17733359895646572, + 0.0, + 0.32759691774845123, + 0.014432714320719242, + 0.16328433901071548, + 0.23409054055809975, + 0.04214814305305481, + 1.7842926997691393, + 0.43397094309329987, + 0.0, + 10.644547928124666, + 0.04729003831744194, + 0.054600488394498825, + 0.0, + 0.0, + 0.8139536194503307, + 0.028515370562672615, + 0.8499042298644781, + 0.12909049168229103, + 0.0, + 0.0, + 0.0417187362909317, + 0.02067967690527439, + 1.2399367429316044, + 0.23804697580635548, + 0.04034101217985153, + 0.2703402005136013, + 0.34433347545564175, + 0.2794904038310051, + 0.0, + 0.3977179788053036, + 0.19512638449668884, + 0.1495688483119011, + 0.627196591347456 + ], + "unique_experts": 52, + "load_cv": 1.4940161160981758, + "normalized_load_entropy": 0.8297859851890678, + "max_load_share": 0.15064102564102563 + }, + "full_input": { + "tokens": 77, + "top_k": 6, + "decisions": 462, + "ordered_route_sha256": "0f3732a03540a0beabcef77027f17fd9caccd8519816f99be693335864e0404a", + "route_weight_sha256": "a881fcc2b0c2b10be338777e132ab5dabac23cb7421abd89901547c4c802ffd3", + "loads": [ + 4, + 5, + 1, + 2, + 0, + 8, + 13, + 6, + 2, + 6, + 3, + 14, + 4, + 4, + 0, + 8, + 11, + 8, + 11, + 3, + 12, + 4, + 3, + 3, + 14, + 7, + 6, + 30, + 4, + 8, + 7, + 0, + 9, + 7, + 4, + 3, + 1, + 24, + 6, + 0, + 48, + 9, + 2, + 0, + 7, + 10, + 1, + 14, + 2, + 2, + 1, + 3, + 1, + 25, + 6, + 12, + 4, + 7, + 6, + 0, + 11, + 7, + 2, + 17 + ], + "weighted_loads": [ + 0.3091062270104885, + 0.22022442519664764, + 0.0235330481082201, + 0.11440864205360413, + 0.0, + 0.7775776125490665, + 1.535657623782754, + 0.40116432309150696, + 0.2287924364209175, + 0.7699865475296974, + 0.1758052371442318, + 0.706302884966135, + 0.18617259711027145, + 0.13927963562309742, + 0.0, + 0.5919454507529736, + 1.022100887261331, + 0.6576350517570972, + 0.8031746074557304, + 0.10584119334816933, + 1.0252144560217857, + 0.20835290849208832, + 0.15970933437347412, + 0.1232256181538105, + 0.8386895330622792, + 0.37163402885198593, + 0.33121836371719837, + 2.50242568179965, + 0.18622729182243347, + 0.30375783890485764, + 0.28923979215323925, + 0.0, + 0.368021659553051, + 0.37845736648887396, + 0.28680601716041565, + 0.23409054055809975, + 0.04214814305305481, + 2.2549853455275297, + 0.43397094309329987, + 0.0, + 10.690966784954071, + 1.1781732104718685, + 0.09089428931474686, + 0.0, + 0.2650553807616234, + 0.8818998299539089, + 0.028515370562672615, + 0.8499042298644781, + 0.12909049168229103, + 0.05986724607646465, + 0.04350579157471657, + 0.1394074186682701, + 0.02067967690527439, + 2.008206071332097, + 0.23804697580635548, + 0.8426948972046375, + 0.2703402005136013, + 0.34433347545564175, + 0.3560306206345558, + 0.0, + 0.5264367312192917, + 0.32967810705304146, + 0.1495688483119011, + 0.9285711161792278 + ], + "unique_experts": 58, + "load_cv": 1.0972040600140407, + "normalized_load_entropy": 0.8892501249852778, + "max_load_share": 0.1038961038961039 + } + }, + "s1_bos": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "257aa940ddeb8909effc6c9ff49572daefec223e803fdbf239e453079776c76b", + "route_weight_sha256": "eec33f9ecad9875ed2f1061c60d052a3e83f0ff21f0e0fa376d944d208bf51da", + "loads": [ + 4, + 4, + 1, + 1, + 0, + 0, + 8, + 6, + 2, + 4, + 0, + 13, + 3, + 0, + 0, + 2, + 2, + 2, + 6, + 2, + 2, + 2, + 1, + 3, + 6, + 7, + 3, + 30, + 3, + 9, + 5, + 0, + 8, + 1, + 4, + 3, + 1, + 15, + 6, + 0, + 47, + 1, + 1, + 0, + 0, + 9, + 0, + 14, + 2, + 0, + 0, + 1, + 2, + 14, + 6, + 2, + 5, + 7, + 6, + 0, + 7, + 4, + 2, + 13 + ], + "weighted_loads": [ + 0.3141525313258171, + 0.18704305216670036, + 0.021227799355983734, + 0.08389748632907867, + 0.0, + 0.0, + 1.2868425250053406, + 0.4015531502664089, + 0.22207187861204147, + 0.3149863500148058, + 0.0, + 0.6907228846102953, + 0.11546102538704872, + 0.0, + 0.0, + 0.08667973428964615, + 0.11210938170552254, + 0.22969843447208405, + 0.20036388840526342, + 0.07947945594787598, + 0.0784866251051426, + 0.12509874626994133, + 0.033650953322649, + 0.12395473942160606, + 0.18793757632374763, + 0.3934899605810642, + 0.15415681153535843, + 2.4577354984357953, + 0.14936364814639091, + 0.3433654308319092, + 0.1760837845504284, + 0.0, + 0.30854418873786926, + 0.014321503229439259, + 0.2096257545053959, + 0.23075127601623535, + 0.04241732135415077, + 1.770320976153016, + 0.4224926717579365, + 0.0, + 10.686727073043585, + 0.051362697035074234, + 0.05331335589289665, + 0.0, + 0.0, + 0.8225867599248886, + 0.0, + 0.8431763742119074, + 0.12745123729109764, + 0.0, + 0.0, + 0.04366809502243996, + 0.054238155484199524, + 1.247505061328411, + 0.2506994232535362, + 0.03700678609311581, + 0.3028770834207535, + 0.3680746555328369, + 0.319331893697381, + 0.0, + 0.33624456636607647, + 0.1584902349859476, + 0.15814054012298584, + 0.6285937149077654 + ], + "unique_experts": 51, + "load_cv": 1.500164356544623, + "normalized_load_entropy": 0.8276105219496176, + "max_load_share": 0.15064102564102563 + }, + "full_input": { + "tokens": 93, + "top_k": 6, + "decisions": 558, + "ordered_route_sha256": "f658e609a34be4ef5926d198508fb5c0b47ecf8ab1b5d72e891fa79c1f7b5021", + "route_weight_sha256": "9b88a9afcc2d16d43cf63139649960962a63ff51e173a86de9db2f38b6ebe502", + "loads": [ + 4, + 7, + 1, + 3, + 0, + 8, + 14, + 7, + 2, + 7, + 5, + 15, + 3, + 4, + 1, + 13, + 10, + 13, + 13, + 2, + 13, + 4, + 4, + 4, + 19, + 7, + 13, + 30, + 3, + 9, + 9, + 0, + 13, + 9, + 6, + 5, + 1, + 24, + 9, + 3, + 50, + 16, + 3, + 2, + 8, + 14, + 1, + 20, + 5, + 5, + 6, + 1, + 2, + 26, + 6, + 13, + 7, + 7, + 7, + 1, + 13, + 5, + 5, + 18 + ], + "weighted_loads": [ + 0.3141525313258171, + 0.3077552169561386, + 0.021227799355983734, + 0.17472456768155098, + 0.0, + 0.7608080916106701, + 1.5912547782063484, + 0.4263272564858198, + 0.22207187861204147, + 0.7683846186846495, + 0.1801309809088707, + 0.7539021838456392, + 0.11546102538704872, + 0.12148980796337128, + 0.04410126060247421, + 1.0837703123688698, + 0.9150879308581352, + 1.0386225879192352, + 1.044714423827827, + 0.07947945594787598, + 0.9931033533066511, + 0.22196007519960403, + 0.14785603433847427, + 0.20032815262675285, + 1.3114523626863956, + 0.3934899605810642, + 1.3173870872706175, + 2.4577354984357953, + 0.14936364814639091, + 0.3433654308319092, + 0.35151749290525913, + 0.0, + 0.5247471835464239, + 0.40264435950666666, + 0.28760967776179314, + 0.35941750183701515, + 0.04241732135415077, + 2.251330902799964, + 0.5727116838097572, + 0.1772170215845108, + 10.794624473899603, + 2.244233835488558, + 0.12486515939235687, + 0.09283439815044403, + 0.27816127613186836, + 1.052814468741417, + 0.031377047300338745, + 1.137220984324813, + 0.25243295915424824, + 0.2097755465656519, + 0.2667018435895443, + 0.04366809502243996, + 0.054238155484199524, + 2.3295596465468407, + 0.2506994232535362, + 1.0251730401068926, + 0.4110311307013035, + 0.3680746555328369, + 0.3997772578150034, + 0.1970146894454956, + 0.6161473412066698, + 0.2394330222159624, + 0.48314009234309196, + 0.9464932698756456 + ], + "unique_experts": 62, + "load_cv": 0.9506725064740165, + "normalized_load_entropy": 0.9117348244579239, + "max_load_share": 0.08960573476702509 + } + }, + "s0_x": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "c78a96f112125aab420392fd4f054ed072737174ea2db927d95ac5194655719d", + "route_weight_sha256": "1c8dfae4af7cc635ad5638532b99a35b9caa7198777d365f2b7ca865eee2e627", + "loads": [ + 4, + 4, + 1, + 2, + 0, + 0, + 9, + 5, + 2, + 4, + 0, + 10, + 3, + 0, + 0, + 1, + 2, + 2, + 4, + 1, + 6, + 2, + 1, + 2, + 8, + 6, + 3, + 29, + 5, + 10, + 6, + 1, + 9, + 1, + 4, + 3, + 1, + 15, + 6, + 0, + 47, + 1, + 1, + 0, + 0, + 8, + 0, + 14, + 2, + 0, + 0, + 0, + 1, + 14, + 5, + 2, + 5, + 8, + 4, + 0, + 9, + 5, + 2, + 12 + ], + "weighted_loads": [ + 0.31396107003092766, + 0.19188941456377506, + 0.025347251445055008, + 0.10888108611106873, + 0.0, + 0.0, + 1.4145214762538671, + 0.35537276044487953, + 0.21966611593961716, + 0.34410796500742435, + 0.0, + 0.5693197250366211, + 0.1208702102303505, + 0.0, + 0.0, + 0.06114863604307175, + 0.10215308144688606, + 0.22192229330539703, + 0.14762417040765285, + 0.04192735254764557, + 0.2046677591279149, + 0.13419370725750923, + 0.04616439715027809, + 0.09092613123357296, + 0.24195833504199982, + 0.3387879319489002, + 0.15719809010624886, + 2.3593694726005197, + 0.21397463977336884, + 0.3579419422894716, + 0.21264907158911228, + 0.02262130193412304, + 0.37313120625913143, + 0.014695427380502224, + 0.19857096672058105, + 0.22764508798718452, + 0.04125719889998436, + 1.7398143745958805, + 0.41173900850117207, + 0.0, + 10.72256164997816, + 0.04860513284802437, + 0.055766936391592026, + 0.0, + 0.0, + 0.7850983962416649, + 0.0, + 0.8320505190640688, + 0.12363046407699585, + 0.0, + 0.0, + 0.0, + 0.02995792031288147, + 1.237302128225565, + 0.1957956049591303, + 0.038721442222595215, + 0.29490905813872814, + 0.3877117335796356, + 0.243501927703619, + 0.0, + 0.40358940325677395, + 0.20885498449206352, + 0.15460122376680374, + 0.6252758614718914 + ], + "unique_experts": 51, + "load_cv": 1.4869584274254337, + "normalized_load_entropy": 0.8282537493613283, + "max_load_share": 0.15064102564102563 + }, + "full_input": { + "tokens": 77, + "top_k": 6, + "decisions": 462, + "ordered_route_sha256": "bb8d257322e6752b4a9a532b66d13459be11bb13af4a2db4054a5b337a12331f", + "route_weight_sha256": "f859056f9d10b824770811b51f423a5d0a3cffebfbd618ba0036bea524c93a1a", + "loads": [ + 4, + 5, + 1, + 2, + 0, + 8, + 14, + 5, + 2, + 5, + 3, + 10, + 3, + 2, + 0, + 8, + 8, + 8, + 9, + 1, + 19, + 5, + 4, + 2, + 17, + 6, + 7, + 29, + 5, + 10, + 9, + 1, + 11, + 5, + 4, + 3, + 1, + 25, + 7, + 0, + 48, + 8, + 3, + 0, + 4, + 9, + 0, + 14, + 2, + 1, + 1, + 2, + 1, + 26, + 5, + 13, + 5, + 8, + 5, + 0, + 12, + 7, + 2, + 18 + ], + "weighted_loads": [ + 0.31396107003092766, + 0.22478425316512585, + 0.025347251445055008, + 0.10888108611106873, + 0.0, + 0.7775776125490665, + 1.6264816541224718, + 0.35537276044487953, + 0.21966611593961716, + 0.7210642788559198, + 0.1758052371442318, + 0.5693197250366211, + 0.1208702102303505, + 0.0679480079561472, + 0.0, + 0.6153256855905056, + 0.4082001317292452, + 0.6520734876394272, + 0.8125210609287024, + 0.04192735254764557, + 1.4813799234107137, + 0.24918626621365547, + 0.20672444626688957, + 0.09092613123357296, + 1.0131112337112427, + 0.3387879319489002, + 0.38325117714703083, + 2.3593694726005197, + 0.21397463977336884, + 0.3579419422894716, + 0.3712483961135149, + 0.02262130193412304, + 0.48591445200145245, + 0.28166829887777567, + 0.19857096672058105, + 0.22764508798718452, + 0.04125719889998436, + 2.2444949746131897, + 0.43665712513029575, + 0.0, + 10.768980506807566, + 1.0564426071941853, + 0.13060817122459412, + 0.0, + 0.1558813415467739, + 0.8530446067452431, + 0.0, + 0.8320505190640688, + 0.12363046407699585, + 0.01732088439166546, + 0.03531424701213837, + 0.09768868237733841, + 0.02995792031288147, + 2.138551624491811, + 0.1957956049591303, + 0.9540394507348537, + 0.29490905813872814, + 0.3877117335796356, + 0.33823688700795174, + 0.0, + 0.6027103830128908, + 0.33717796206474304, + 0.15460122376680374, + 0.975207444280386 + ], + "unique_experts": 58, + "load_cv": 1.132967508150373, + "normalized_load_entropy": 0.8806646458125177, + "max_load_share": 0.1038961038961039 + } + }, + "s1_x": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "80edfed5d9d7d63ac7133703604efd669dae0cc4403eb7eb08b80bf499938bf5", + "route_weight_sha256": "4dee825f14bb025a467c8681acfc9def87d0b56331053eb8f5b65d89016e8b6b", + "loads": [ + 4, + 4, + 1, + 2, + 0, + 0, + 8, + 6, + 2, + 4, + 0, + 12, + 2, + 0, + 0, + 2, + 2, + 2, + 6, + 1, + 4, + 2, + 1, + 3, + 6, + 7, + 4, + 29, + 4, + 11, + 4, + 1, + 9, + 1, + 3, + 3, + 1, + 15, + 6, + 0, + 47, + 1, + 1, + 0, + 0, + 8, + 0, + 14, + 2, + 0, + 0, + 1, + 1, + 13, + 6, + 1, + 5, + 8, + 5, + 1, + 8, + 6, + 2, + 10 + ], + "weighted_loads": [ + 0.31897781416773796, + 0.1973755694925785, + 0.021874282509088516, + 0.11775122955441475, + 0.0, + 0.0, + 1.304906688630581, + 0.41358354315161705, + 0.2118372991681099, + 0.3143810834735632, + 0.0, + 0.6787717714905739, + 0.0833313874900341, + 0.0, + 0.0, + 0.09011036157608032, + 0.11247708648443222, + 0.21557068079710007, + 0.19045674428343773, + 0.0439230278134346, + 0.14752215147018433, + 0.1424526609480381, + 0.04186317324638367, + 0.11903925612568855, + 0.21871232613921165, + 0.39402933791279793, + 0.19269992411136627, + 2.3590129734948277, + 0.18244439736008644, + 0.3740830384194851, + 0.14422626793384552, + 0.02091619372367859, + 0.33538652770221233, + 0.014208802953362465, + 0.17351039499044418, + 0.2297443374991417, + 0.03888656198978424, + 1.7593492697924376, + 0.4271200206130743, + 0.0, + 10.462859217077494, + 0.04941452667117119, + 0.04886458441615105, + 0.0, + 0.0, + 0.7628113068640232, + 0.0, + 0.8230414148420095, + 0.12923532724380493, + 0.0, + 0.0, + 0.0388144813477993, + 0.03782886266708374, + 1.2231262512505054, + 0.2430295031517744, + 0.018939374014735222, + 0.3001181147992611, + 0.40222487039864063, + 0.299398897215724, + 0.0240849107503891, + 0.3707256857305765, + 0.2116890260949731, + 0.16744272783398628, + 0.5340386796742678 + ], + "unique_experts": 53, + "load_cv": 1.4780889273161373, + "normalized_load_entropy": 0.8333709089249237, + "max_load_share": 0.15064102564102563 + }, + "full_input": { + "tokens": 93, + "top_k": 6, + "decisions": 558, + "ordered_route_sha256": "095d72e6d67af89332d79aa9bd0f88562e64d4935a9737a97f2b936902dd82a6", + "route_weight_sha256": "63d37065eb3939b020235b8b39dacaaf2ead7638bfe8e995c961a67d4236fea1", + "loads": [ + 4, + 8, + 1, + 4, + 0, + 8, + 14, + 7, + 2, + 6, + 7, + 13, + 2, + 3, + 1, + 13, + 9, + 14, + 13, + 1, + 18, + 5, + 5, + 4, + 21, + 7, + 14, + 29, + 4, + 12, + 7, + 1, + 15, + 6, + 4, + 5, + 1, + 24, + 9, + 3, + 51, + 15, + 2, + 3, + 4, + 13, + 1, + 20, + 6, + 5, + 5, + 1, + 1, + 26, + 6, + 13, + 7, + 9, + 6, + 2, + 12, + 7, + 5, + 14 + ], + "weighted_loads": [ + 0.31897781416773796, + 0.36306536942720413, + 0.021874282509088516, + 0.20857831090688705, + 0.0, + 0.7608080916106701, + 1.606897085905075, + 0.43835764937102795, + 0.2118372991681099, + 0.729861369356513, + 0.23508936911821365, + 0.7102097198367119, + 0.0833313874900341, + 0.0904591903090477, + 0.04410126060247421, + 1.0591075830161572, + 0.38302725926041603, + 1.0435458607971668, + 0.9847273677587509, + 0.0439230278134346, + 1.4282757993787527, + 0.27488818392157555, + 0.1967852432280779, + 0.19541266933083534, + 1.504904791712761, + 0.39402933791279793, + 1.333256432786584, + 2.3590129734948277, + 0.18244439736008644, + 0.40418250299990177, + 0.282970292493701, + 0.02091619372367859, + 0.6166431941092014, + 0.23628432489931583, + 0.20863276347517967, + 0.3584105633199215, + 0.03888656198978424, + 2.2403591964393854, + 0.5852690655738115, + 0.1772170215845108, + 10.618123400956392, + 1.9506993666291237, + 0.08560844883322716, + 0.12238538451492786, + 0.13082051649689674, + 0.9930390156805515, + 0.031377047300338745, + 1.117086024954915, + 0.28906661085784435, + 0.2097755465656519, + 0.22083299607038498, + 0.0388144813477993, + 0.03782886266708374, + 2.4031817205250263, + 0.2430295031517744, + 1.142201567068696, + 0.4082721620798111, + 0.45877563394606113, + 0.38497853837907314, + 0.2210996001958847, + 0.5354728642851114, + 0.29080128762871027, + 0.4924422800540924, + 0.787913242354989 + ], + "unique_experts": 63, + "load_cv": 0.9620635209365468, + "normalized_load_entropy": 0.9107358431512348, + "max_load_share": 0.0913978494623656 + } + }, + "s0_period": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "2ba92f610978bfe1725d1833eedfbe1c82e4fd8292410f9923aa51499541a869", + "route_weight_sha256": "5eb3e34bc201742209a4972b80493a3a0f1d5eed19572570d445e162b0c0c616", + "loads": [ + 4, + 4, + 0, + 1, + 0, + 0, + 8, + 5, + 2, + 4, + 0, + 11, + 2, + 0, + 0, + 1, + 2, + 2, + 5, + 1, + 5, + 2, + 1, + 3, + 8, + 6, + 4, + 29, + 5, + 10, + 5, + 1, + 9, + 1, + 4, + 3, + 1, + 15, + 6, + 0, + 47, + 1, + 1, + 0, + 0, + 8, + 0, + 14, + 2, + 0, + 0, + 0, + 2, + 14, + 6, + 2, + 5, + 8, + 5, + 0, + 9, + 5, + 2, + 11 + ], + "weighted_loads": [ + 0.31393158435821533, + 0.18677657842636108, + 0.0, + 0.08755204826593399, + 0.0, + 0.0, + 1.3613346721976995, + 0.36189985647797585, + 0.2279495745897293, + 0.345175813883543, + 0.0, + 0.6364882625639439, + 0.0811937153339386, + 0.0, + 0.0, + 0.057792097330093384, + 0.10885336250066757, + 0.22064656019210815, + 0.186976857483387, + 0.04185617342591286, + 0.1667353669181466, + 0.13655519858002663, + 0.04231572896242142, + 0.1184249259531498, + 0.2437589094042778, + 0.3323061838746071, + 0.19633837789297104, + 2.3791006607934833, + 0.21241579577326775, + 0.3695790823549032, + 0.16958647221326828, + 0.022565504536032677, + 0.3550247475504875, + 0.014914252795279026, + 0.20524826645851135, + 0.2308368869125843, + 0.0398407019674778, + 1.7987283077090979, + 0.4274096339941025, + 0.0, + 10.690142344683409, + 0.04602343589067459, + 0.05046182870864868, + 0.0, + 0.0, + 0.7904862128198147, + 0.0, + 0.8284330293536186, + 0.124583650380373, + 0.0, + 0.0, + 0.0, + 0.055668825283646584, + 1.2412722520530224, + 0.23404312320053577, + 0.03692698758095503, + 0.2912962455302477, + 0.3926873691380024, + 0.28334520012140274, + 0.0, + 0.40550673194229603, + 0.19685034453868866, + 0.15282148867845535, + 0.5910908989608288 + ], + "unique_experts": 50, + "load_cv": 1.4856313781406127, + "normalized_load_entropy": 0.827236869790638, + "max_load_share": 0.15064102564102563 + }, + "full_input": { + "tokens": 77, + "top_k": 6, + "decisions": 462, + "ordered_route_sha256": "8be4f7d8aa03b78242c805de0e6dd881cd57d72711877adc72d0f0ccde6bfd04", + "route_weight_sha256": "6bcc942e46e6fcf791b3e60220fab90029ced4680df810598aa734edcafcb16f", + "loads": [ + 4, + 5, + 0, + 1, + 0, + 9, + 13, + 5, + 2, + 5, + 4, + 12, + 2, + 2, + 0, + 8, + 9, + 8, + 10, + 1, + 18, + 4, + 5, + 3, + 17, + 6, + 8, + 29, + 5, + 10, + 8, + 1, + 10, + 5, + 4, + 3, + 1, + 24, + 7, + 0, + 48, + 8, + 3, + 0, + 4, + 9, + 0, + 15, + 2, + 1, + 0, + 2, + 2, + 25, + 6, + 13, + 5, + 8, + 6, + 0, + 12, + 7, + 2, + 16 + ], + "weighted_loads": [ + 0.31393158435821533, + 0.21924768760800362, + 0.0, + 0.08755204826593399, + 0.0, + 0.8236536867916584, + 1.578651150688529, + 0.36189985647797585, + 0.2279495745897293, + 0.7221321277320385, + 0.23011978715658188, + 0.6688756346702576, + 0.0811937153339386, + 0.06635930947959423, + 0.0, + 0.5963110737502575, + 0.4898729454725981, + 0.7755816616117954, + 0.8018977120518684, + 0.04185617342591286, + 1.2760646240785718, + 0.21657346189022064, + 0.24250229075551033, + 0.1184249259531498, + 1.0518014803528786, + 0.3323061838746071, + 0.44912385009229183, + 2.3791006607934833, + 0.21241579577326775, + 0.3695790823549032, + 0.34330495819449425, + 0.022565504536032677, + 0.3954494893550873, + 0.276564116589725, + 0.20524826645851135, + 0.2308368869125843, + 0.0398407019674778, + 2.2694209534674883, + 0.4518105164170265, + 0.0, + 10.736561201512814, + 1.0718962252140045, + 0.12405388429760933, + 0.0, + 0.16177326813340187, + 0.8584324233233929, + 0.0, + 0.8677653297781944, + 0.124583650380373, + 0.01732088439166546, + 0.0, + 0.09768868237733841, + 0.055668825283646584, + 2.009541580453515, + 0.23404312320053577, + 0.9033976336941123, + 0.2912962455302477, + 0.3926873691380024, + 0.37427350878715515, + 0.0, + 0.5951265674084425, + 0.32364847883582115, + 0.15282148867845535, + 0.9011146761476994 + ], + "unique_experts": 56, + "load_cv": 1.1193887796669337, + "normalized_load_entropy": 0.880376347725111, + "max_load_share": 0.1038961038961039 + } + }, + "s1_period": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "d62d19d633d8c15263f65ea4f430e08648bdad3b89270a7ad92a47d1d3cadd82", + "route_weight_sha256": "6690d85aceb2ecdef32df6d654653e6815bd6f25fb6a14a675db5bde92557e64", + "loads": [ + 4, + 5, + 1, + 2, + 0, + 0, + 8, + 6, + 2, + 5, + 0, + 12, + 2, + 0, + 0, + 1, + 2, + 2, + 6, + 2, + 1, + 1, + 1, + 2, + 7, + 7, + 4, + 29, + 3, + 10, + 4, + 0, + 10, + 1, + 3, + 3, + 1, + 15, + 6, + 0, + 47, + 1, + 1, + 1, + 0, + 8, + 0, + 14, + 3, + 0, + 0, + 1, + 2, + 14, + 6, + 2, + 5, + 8, + 7, + 0, + 9, + 4, + 2, + 9 + ], + "weighted_loads": [ + 0.3192053809762001, + 0.2239968366920948, + 0.02169213816523552, + 0.11444064974784851, + 0.0, + 0.0, + 1.3034188393503428, + 0.40672542527318, + 0.21403709053993225, + 0.3420234676450491, + 0.0, + 0.6656146738678217, + 0.08315816149115562, + 0.0, + 0.0, + 0.05377761647105217, + 0.11259739473462105, + 0.21653977036476135, + 0.1924480628222227, + 0.08293896913528442, + 0.040777917951345444, + 0.09403301030397415, + 0.043765533715486526, + 0.09485005587339401, + 0.2265233937650919, + 0.38563184812664986, + 0.19643783941864967, + 2.3669682051986456, + 0.13988468796014786, + 0.37327138148248196, + 0.13762319646775723, + 0.0, + 0.3683922216296196, + 0.014497603289783001, + 0.17212453857064247, + 0.2193242572247982, + 0.03841042518615723, + 1.7740418072789907, + 0.4260503649711609, + 0.0, + 10.520773623138666, + 0.047267645597457886, + 0.04929683730006218, + 0.03683186322450638, + 0.0, + 0.7816441841423512, + 0.0, + 0.8333143405616283, + 0.16221864894032478, + 0.0, + 0.0, + 0.04099062457680702, + 0.05623219907283783, + 1.2564839571714401, + 0.23891680128872395, + 0.03615769371390343, + 0.29601268470287323, + 0.4222399741411209, + 0.3577674422413111, + 0.0, + 0.4187075309455395, + 0.14983911626040936, + 0.16817496716976166, + 0.5080889631062746 + ], + "unique_experts": 52, + "load_cv": 1.4865162092959738, + "normalized_load_entropy": 0.8293431003744058, + "max_load_share": 0.15064102564102563 + }, + "full_input": { + "tokens": 93, + "top_k": 6, + "decisions": 558, + "ordered_route_sha256": "d5129655306cf56927cd73f76e919f969b179228771a6e35a89d891ec8c9ae9b", + "route_weight_sha256": "6661a4e4520ca951f664b20abb74d4334ae23becbe4709dd4f228d3cf142b520", + "loads": [ + 4, + 9, + 1, + 4, + 0, + 9, + 14, + 7, + 2, + 7, + 6, + 13, + 2, + 3, + 1, + 12, + 8, + 15, + 13, + 2, + 13, + 3, + 4, + 3, + 22, + 7, + 14, + 29, + 3, + 10, + 9, + 0, + 16, + 6, + 4, + 5, + 1, + 24, + 10, + 3, + 50, + 16, + 2, + 4, + 4, + 13, + 1, + 20, + 7, + 5, + 5, + 1, + 2, + 27, + 7, + 14, + 7, + 8, + 8, + 2, + 14, + 5, + 5, + 13 + ], + "weighted_loads": [ + 0.3192053809762001, + 0.3859313763678074, + 0.02169213816523552, + 0.20526773110032082, + 0.0, + 0.795093510299921, + 1.6117471773177385, + 0.4314995314925909, + 0.21403709053993225, + 0.7575037535279989, + 0.20911736972630024, + 0.6970526222139597, + 0.08315816149115562, + 0.0904591903090477, + 0.04410126060247421, + 1.0089776329696178, + 0.34277618303894997, + 1.1307377815246582, + 1.004563683643937, + 0.08293896913528442, + 1.007194509729743, + 0.19089433923363686, + 0.16711091250181198, + 0.1712234690785408, + 1.5416175741702318, + 0.38563184812664986, + 1.3609961289912462, + 2.3669682051986456, + 0.13988468796014786, + 0.37327138148248196, + 0.38100238516926765, + 0.0, + 0.6209619101136923, + 0.23793696891516447, + 0.20724690705537796, + 0.347990483045578, + 0.03841042518615723, + 2.2550517339259386, + 0.6284139677882195, + 0.1772170215845108, + 10.628671023994684, + 1.929337777197361, + 0.08604070171713829, + 0.1592600867152214, + 0.1275424137711525, + 1.0118718929588795, + 0.031377047300338745, + 1.1273589506745338, + 0.31709661707282066, + 0.2097755465656519, + 0.22083299607038498, + 0.04099062457680702, + 0.05623219907283783, + 2.3994738087058067, + 0.2744531277567148, + 1.0740493312478065, + 0.40416673198342323, + 0.4222399741411209, + 0.4616687837988138, + 0.22965369001030922, + 0.6684992574155331, + 0.22293483279645443, + 0.4931745193898678, + 0.7684639561921358 + ], + "unique_experts": 62, + "load_cv": 0.9586389871846515, + "normalized_load_entropy": 0.9101186719706748, + "max_load_share": 0.08960573476702509 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 52, + "ordered_topk_exact_tokens": 34, + "set_exact_tokens": 41, + "mean_set_jaccard": 0.9395604395604397, + "mean_token_weighted_tv": 0.01539813437893127, + "aggregate_load_tv": 0.03205128205128205 + }, + "system_bos": { + "tokens": 52, + "ordered_topk_exact_tokens": 34, + "set_exact_tokens": 40, + "mean_set_jaccard": 0.9340659340659341, + "mean_token_weighted_tv": 0.01804434282418627, + "aggregate_load_tv": 0.02884615384615384 + }, + "system_x": { + "tokens": 52, + "ordered_topk_exact_tokens": 28, + "set_exact_tokens": 34, + "mean_set_jaccard": 0.9010989010989012, + "mean_token_weighted_tv": 0.024624189908186402, + "aggregate_load_tv": 0.048076923076923093 + }, + "system_period": { + "tokens": 52, + "ordered_topk_exact_tokens": 27, + "set_exact_tokens": 35, + "mean_set_jaccard": 0.9065934065934067, + "mean_token_weighted_tv": 0.024570190535786633, + "aggregate_load_tv": 0.04807692307692307 + }, + "bos_at_s0": { + "tokens": 52, + "ordered_topk_exact_tokens": 30, + "set_exact_tokens": 37, + "mean_set_jaccard": 0.9052197802197802, + "mean_token_weighted_tv": 0.026806427389741518, + "aggregate_load_tv": 0.04166666666666667 + }, + "bos_at_s1": { + "tokens": 52, + "ordered_topk_exact_tokens": 27, + "set_exact_tokens": 35, + "mean_set_jaccard": 0.8942307692307693, + "mean_token_weighted_tv": 0.027778148203371808, + "aggregate_load_tv": 0.05128205128205128 + }, + "x_at_s0": { + "tokens": 52, + "ordered_topk_exact_tokens": 21, + "set_exact_tokens": 34, + "mean_set_jaccard": 0.9010989010989012, + "mean_token_weighted_tv": 0.026579586242755446, + "aggregate_load_tv": 0.05128205128205128 + }, + "x_at_s1": { + "tokens": 52, + "ordered_topk_exact_tokens": 21, + "set_exact_tokens": 32, + "mean_set_jaccard": 0.877747252747253, + "mean_token_weighted_tv": 0.030330248239736717, + "aggregate_load_tv": 0.057692307692307696 + }, + "period_at_s0": { + "tokens": 52, + "ordered_topk_exact_tokens": 25, + "set_exact_tokens": 37, + "mean_set_jaccard": 0.9134615384615384, + "mean_token_weighted_tv": 0.02683509001508355, + "aggregate_load_tv": 0.05128205128205128 + }, + "period_at_s1": { + "tokens": 52, + "ordered_topk_exact_tokens": 23, + "set_exact_tokens": 33, + "mean_set_jaccard": 0.8873626373626373, + "mean_token_weighted_tv": 0.029685029688362893, + "aggregate_load_tv": 0.057692307692307696 + } + } + }, + "layer_17": { + "layer": 17, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "9e618058159f5b0f2de726a9de9f13b7c2067f753b89d0553de0e48298119137", + "route_weight_sha256": "99214986aba9e48c753e3b7a9f10b449d7685f702d0e43e6f9c2f0b4ddf89157", + "loads": [ + 2, + 2, + 0, + 3, + 1, + 1, + 6, + 3, + 4, + 25, + 13, + 2, + 0, + 2, + 5, + 17, + 5, + 4, + 1, + 4, + 7, + 3, + 1, + 17, + 1, + 4, + 6, + 0, + 17, + 6, + 5, + 2, + 5, + 5, + 9, + 3, + 0, + 13, + 14, + 4, + 1, + 0, + 3, + 2, + 2, + 11, + 2, + 5, + 9, + 3, + 2, + 2, + 1, + 2, + 0, + 4, + 1, + 10, + 11, + 2, + 1, + 14, + 2, + 0 + ], + "weighted_loads": [ + 0.10882759839296341, + 0.04066850896924734, + 0.0, + 0.1620928905904293, + 0.055691588670015335, + 0.031944941729307175, + 0.2593800351023674, + 0.13026252388954163, + 0.24097802117466927, + 1.2106956103816628, + 1.1083563026040792, + 0.11296271532773972, + 0.0, + 0.09347614645957947, + 0.2738517075777054, + 1.0851411521434784, + 0.22867439687252045, + 0.1421084040775895, + 0.030144616961479187, + 0.1448974385857582, + 0.9837263897061348, + 0.11731277778744698, + 0.05456199124455452, + 4.51673686504364, + 0.05467432737350464, + 0.28263009339571, + 0.29229550808668137, + 0.0, + 1.4801578186452389, + 0.24948288965970278, + 0.4628376793116331, + 0.10957595333456993, + 0.19658851623535156, + 0.32025454193353653, + 0.701427910476923, + 0.38879355043172836, + 0.0, + 0.6477101165801287, + 3.0772305093705654, + 0.24049356393516064, + 0.04060693830251694, + 0.0, + 0.2229936681687832, + 0.07367154769599438, + 0.10729371011257172, + 0.4216012666001916, + 0.09389937669038773, + 0.25137824565172195, + 1.652679555118084, + 0.10360666364431381, + 0.18852151930332184, + 0.26955701410770416, + 0.040107108652591705, + 0.1235351599752903, + 0.0, + 0.2655063420534134, + 0.07821697741746902, + 0.6226715166121721, + 0.8348121559247375, + 0.0985167920589447, + 0.028261886909604073, + 1.0789342634379864, + 0.12430328596383333, + 0.0 + ], + "unique_experts": 57, + "load_cv": 1.064334234898321, + "normalized_load_entropy": 0.8829688612370531, + "max_load_share": 0.08012820512820513 + }, + "full_input": { + "tokens": 77, + "top_k": 6, + "decisions": 462, + "ordered_route_sha256": "f458f11a4a6457964c12231ff0bcaf3ecf4bd9a2df3cd0067df831450728e8cc", + "route_weight_sha256": "771e8c81ce1ceae99183c85f9c647d49f08ad209cf8c416f290457750d4bcb4d", + "loads": [ + 10, + 3, + 2, + 10, + 1, + 1, + 8, + 3, + 4, + 29, + 20, + 3, + 3, + 10, + 5, + 19, + 6, + 11, + 3, + 4, + 10, + 3, + 1, + 23, + 7, + 12, + 14, + 3, + 22, + 8, + 5, + 2, + 14, + 5, + 10, + 3, + 1, + 13, + 18, + 4, + 8, + 5, + 5, + 4, + 2, + 15, + 2, + 5, + 9, + 4, + 3, + 2, + 3, + 2, + 0, + 9, + 1, + 14, + 11, + 2, + 1, + 15, + 7, + 0 + ], + "weighted_loads": [ + 0.3773695845156908, + 0.07654893305152655, + 0.09500415623188019, + 0.7449562735855579, + 0.055691588670015335, + 0.031944941729307175, + 0.3555883355438709, + 0.13026252388954163, + 0.24097802117466927, + 1.357387867756188, + 1.536210237070918, + 0.13151287846267223, + 0.10004289261996746, + 0.6941953115165234, + 0.2738517075777054, + 1.1762262172996998, + 0.3211703225970268, + 0.7987269693985581, + 0.08272631838917732, + 0.1448974385857582, + 1.2628293931484222, + 0.11731277778744698, + 0.05456199124455452, + 4.785779427736998, + 0.6111460104584694, + 0.7570232972502708, + 1.9019015543162823, + 0.1425129771232605, + 1.6719277501106262, + 0.2868985407985747, + 0.4628376793116331, + 0.10957595333456993, + 0.5394574450328946, + 0.32025454193353653, + 0.7829466573894024, + 0.38879355043172836, + 0.034116290509700775, + 0.6477101165801287, + 3.2371083181351423, + 0.24049356393516064, + 0.9622511155903339, + 0.16078990139067173, + 0.41407962515950203, + 0.09575177426449955, + 0.10729371011257172, + 1.1610250631347299, + 0.09389937669038773, + 0.25137824565172195, + 1.652679555118084, + 0.1379866749048233, + 0.2580546438694, + 0.26955701410770416, + 0.18745166063308716, + 0.1235351599752903, + 0.0, + 0.6050567775964737, + 0.07821697741746902, + 0.8750648628920317, + 0.8348121559247375, + 0.0985167920589447, + 0.028261886909604073, + 1.1581591702997684, + 0.5168997691944242, + 0.0 + ], + "unique_experts": 62, + "load_cv": 0.872517239207859, + "normalized_load_entropy": 0.9158536976537331, + "max_load_share": 0.06277056277056277 + } + }, + "s1_eos": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "80493a9a030da64706c62695fef03e1952dfbf2bd27f559d0ce71771ecd8407e", + "route_weight_sha256": "51d0bd3be8dae9e93bdeb3fc25e8c9e530bffc514a0ed473e164789e5e30ac53", + "loads": [ + 2, + 1, + 0, + 3, + 1, + 1, + 6, + 3, + 4, + 25, + 14, + 2, + 0, + 2, + 5, + 17, + 5, + 4, + 2, + 4, + 7, + 3, + 1, + 17, + 1, + 4, + 6, + 0, + 16, + 6, + 5, + 2, + 5, + 6, + 9, + 3, + 0, + 14, + 14, + 3, + 1, + 0, + 3, + 2, + 2, + 11, + 2, + 5, + 9, + 3, + 2, + 2, + 1, + 3, + 0, + 3, + 1, + 10, + 11, + 2, + 1, + 14, + 1, + 0 + ], + "weighted_loads": [ + 0.10769134014844894, + 0.03245935216546059, + 0.0, + 0.16151872090995312, + 0.05439615994691849, + 0.03251728415489197, + 0.23935693129897118, + 0.1343255303800106, + 0.2425554133951664, + 1.2121231285855174, + 1.0918324356898665, + 0.11658262833952904, + 0.0, + 0.09014477580785751, + 0.25871773809194565, + 1.1068252734839916, + 0.2307148426771164, + 0.14073771052062511, + 0.0628131777048111, + 0.14668191969394684, + 0.9626426659524441, + 0.11748655140399933, + 0.049814991652965546, + 4.401835881173611, + 0.05971626192331314, + 0.3016204573214054, + 0.2832548301666975, + 0.0, + 1.4511504294350743, + 0.2597453258931637, + 0.4543097373098135, + 0.11005460470914841, + 0.19973932951688766, + 0.36479808390140533, + 0.7091948948800564, + 0.39790214598178864, + 0.0, + 0.6665373584255576, + 3.086110435426235, + 0.21325664594769478, + 0.040032073855400085, + 0.0, + 0.23177869990468025, + 0.07042701356112957, + 0.10787143930792809, + 0.41151724196970463, + 0.09338053315877914, + 0.2529437132179737, + 1.605062548071146, + 0.0983613096177578, + 0.2004651576280594, + 0.2757427394390106, + 0.04138471931219101, + 0.15379858016967773, + 0.0, + 0.23129535466432571, + 0.07578258216381073, + 0.612498227506876, + 0.8458023089915514, + 0.10385983437299728, + 0.035476744174957275, + 1.0874372981488705, + 0.10850228369235992, + 0.0 + ], + "unique_experts": 57, + "load_cv": 1.0704936279563129, + "normalized_load_entropy": 0.881327603821952, + "max_load_share": 0.08012820512820513 + }, + "full_input": { + "tokens": 93, + "top_k": 6, + "decisions": 558, + "ordered_route_sha256": "491e967481e070547ac4db8b7088103fae9e90ff9e23c310767fef6bc0db0d7a", + "route_weight_sha256": "a4b6eafd6c9e7ca3216f67528b0efdbaaf162872f3eb11ca9e39931dedbb0f65", + "loads": [ + 11, + 2, + 3, + 9, + 7, + 1, + 9, + 4, + 4, + 30, + 22, + 4, + 0, + 10, + 5, + 23, + 8, + 12, + 4, + 4, + 8, + 4, + 1, + 25, + 11, + 26, + 18, + 3, + 19, + 9, + 7, + 3, + 10, + 6, + 10, + 3, + 5, + 16, + 17, + 4, + 13, + 7, + 6, + 3, + 4, + 16, + 4, + 7, + 9, + 3, + 3, + 8, + 5, + 3, + 1, + 12, + 8, + 22, + 12, + 4, + 2, + 19, + 10, + 0 + ], + "weighted_loads": [ + 0.4669586345553398, + 0.07533080503344536, + 0.1045491024851799, + 0.7820209246128798, + 0.45423926785588264, + 0.03251728415489197, + 0.35969825461506844, + 0.19033753126859665, + 0.2425554133951664, + 1.3696838365867734, + 1.6421896563842893, + 0.18483118899166584, + 0.0, + 0.6855531670153141, + 0.25871773809194565, + 1.3975960165262222, + 0.48432058095932007, + 0.8083199542015791, + 0.1283716894686222, + 0.14668191969394684, + 1.0314534418284893, + 0.19413774460554123, + 0.049814991652965546, + 5.027916608378291, + 0.7107027769088745, + 1.7713962066918612, + 2.0904848873615265, + 0.13290195539593697, + 1.5834210822358727, + 0.376505883410573, + 0.5493796449154615, + 0.1493842862546444, + 0.3736926135607064, + 0.36479808390140533, + 0.7885910160839558, + 0.39790214598178864, + 0.2725214697420597, + 0.7406609924510121, + 3.377583097666502, + 0.24671897664666176, + 1.64090371504426, + 0.3961438052356243, + 0.39238985255360603, + 0.08927297405898571, + 0.3473629988729954, + 1.5617012102156878, + 0.31035255640745163, + 0.38489746674895287, + 1.605062548071146, + 0.0983613096177578, + 0.334876149892807, + 0.5727819204330444, + 0.2993178926408291, + 0.15379858016967773, + 0.08728892356157303, + 0.7979935295879841, + 0.6907956562936306, + 1.2852096073329449, + 0.8696856554597616, + 0.19666999951004982, + 0.06727350503206253, + 1.3813531324267387, + 0.8133456241339445, + 0.0 + ], + "unique_experts": 62, + "load_cv": 0.7968202244945459, + "normalized_load_entropy": 0.9285429096722967, + "max_load_share": 0.053763440860215055 + } + }, + "s0_bos": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "fe002617a6d0219e6a6284019734eede6434da4824da3854425cab2057ccf4b6", + "route_weight_sha256": "c47de48d29f81a055095b2ca66a68ac7d4128ba0c8aaa19ece91d476bace3072", + "loads": [ + 4, + 2, + 0, + 4, + 1, + 1, + 5, + 2, + 4, + 23, + 15, + 2, + 0, + 2, + 5, + 18, + 5, + 3, + 2, + 4, + 7, + 3, + 1, + 18, + 1, + 3, + 5, + 0, + 17, + 5, + 6, + 2, + 6, + 6, + 8, + 3, + 0, + 13, + 14, + 4, + 1, + 0, + 4, + 1, + 2, + 11, + 2, + 3, + 9, + 3, + 3, + 2, + 1, + 4, + 0, + 3, + 1, + 9, + 10, + 2, + 1, + 14, + 2, + 0 + ], + "weighted_loads": [ + 0.17796693556010723, + 0.03871653322130442, + 0.0, + 0.17741618677973747, + 0.05971026048064232, + 0.03386089205741882, + 0.2204308696091175, + 0.09795461967587471, + 0.23654669150710106, + 1.1533034145832062, + 1.1466969791799784, + 0.11466159299015999, + 0.0, + 0.09121130034327507, + 0.25914081931114197, + 1.1387849412858486, + 0.2272372543811798, + 0.13126728311181068, + 0.06452530436217785, + 0.1673007495701313, + 0.9522673711180687, + 0.11431653797626495, + 0.05176498368382454, + 4.6634284649044275, + 0.0567505806684494, + 0.23213781788945198, + 0.25880827382206917, + 0.0, + 1.5049597602337599, + 0.22146011050790548, + 0.47636824287474155, + 0.11564616113901138, + 0.21627758257091045, + 0.3689330071210861, + 0.6938058026134968, + 0.3953617587685585, + 0.0, + 0.6763392770662904, + 3.07516354508698, + 0.2467348575592041, + 0.0416659452021122, + 0.0, + 0.27398063614964485, + 0.044281456619501114, + 0.10024839639663696, + 0.42910533770918846, + 0.0867312066257, + 0.18877092376351357, + 1.6562778241932392, + 0.10245421528816223, + 0.23431411758065224, + 0.2655169442296028, + 0.039801113307476044, + 0.19290325790643692, + 0.0, + 0.2273896560072899, + 0.07761040329933167, + 0.5963709764182568, + 0.8207368217408657, + 0.10058915987610817, + 0.0427534282207489, + 1.0879890322685242, + 0.11655616573989391, + 0.0 + ], + "unique_experts": 57, + "load_cv": 1.0562733294382554, + "normalized_load_entropy": 0.8843400615482024, + "max_load_share": 0.07371794871794872 + }, + "full_input": { + "tokens": 77, + "top_k": 6, + "decisions": 462, + "ordered_route_sha256": "0bac5a32ba7d187803a40c935e93cef4128b1212872568226e7beab86aba4961", + "route_weight_sha256": "a7e9cdf58d0006a2ff491e49ede9ca0efbaa39e918f49bfa86dbe5b9cf2ef9e7", + "loads": [ + 11, + 4, + 1, + 11, + 1, + 1, + 7, + 2, + 4, + 27, + 22, + 3, + 4, + 10, + 5, + 20, + 6, + 10, + 4, + 5, + 10, + 3, + 1, + 24, + 7, + 11, + 12, + 2, + 22, + 7, + 6, + 2, + 14, + 6, + 9, + 3, + 0, + 13, + 18, + 4, + 9, + 4, + 6, + 2, + 2, + 15, + 2, + 3, + 9, + 5, + 4, + 2, + 3, + 5, + 0, + 8, + 1, + 13, + 10, + 3, + 1, + 15, + 8, + 0 + ], + "weighted_loads": [ + 0.46203823015093803, + 0.12238550279289484, + 0.05276928469538689, + 0.7602795697748661, + 0.05971026048064232, + 0.03386089205741882, + 0.31663917005062103, + 0.09795461967587471, + 0.23654669150710106, + 1.2999956719577312, + 1.5745509136468172, + 0.1332117561250925, + 0.2621032726019621, + 0.691930465400219, + 0.25914081931114197, + 1.221094150096178, + 0.32240671664476395, + 0.7878858484327793, + 0.11710700578987598, + 0.2249927595257759, + 1.2504690065979958, + 0.11431653797626495, + 0.05176498368382454, + 4.932471027597785, + 0.5897857770323753, + 0.758016686886549, + 0.9481065720319748, + 0.09002082794904709, + 1.6887211743742228, + 0.28564419504255056, + 0.47636824287474155, + 0.11564616113901138, + 0.5550407748669386, + 0.3689330071210861, + 0.779126975685358, + 0.3953617587685585, + 0.0, + 0.6763392770662904, + 3.2350413538515568, + 0.2467348575592041, + 1.0044772177934647, + 0.1496562734246254, + 0.4567757733166218, + 0.06312741711735725, + 0.10024839639663696, + 1.1258999854326248, + 0.0867312066257, + 0.18877092376351357, + 1.6562778241932392, + 0.2950928211212158, + 0.3038472421467304, + 0.2655169442296028, + 0.18402095884084702, + 0.24356145039200783, + 0.0, + 0.5744899399578571, + 0.07761040329933167, + 0.8460733406245708, + 0.8207368217408657, + 0.14330672472715378, + 0.0427534282207489, + 1.174302600324154, + 0.5365394186228514, + 0.0 + ], + "unique_experts": 61, + "load_cv": 0.8683835936833315, + "normalized_load_entropy": 0.9152403821849385, + "max_load_share": 0.05844155844155844 + } + }, + "s1_bos": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "90ae054d26b644e3a74f9c1781c951876b8ccc2d351244e33b4a21b276949264", + "route_weight_sha256": "0b06b3afac9567986cb0399df79a83afe5e12d10cd8e43fed2a749718c5be67c", + "loads": [ + 4, + 2, + 0, + 3, + 1, + 1, + 5, + 2, + 4, + 23, + 15, + 2, + 0, + 2, + 5, + 18, + 5, + 4, + 1, + 4, + 7, + 3, + 1, + 17, + 1, + 3, + 5, + 1, + 19, + 5, + 6, + 2, + 4, + 6, + 9, + 3, + 0, + 13, + 15, + 4, + 1, + 0, + 4, + 1, + 2, + 10, + 2, + 4, + 10, + 2, + 3, + 2, + 2, + 4, + 0, + 3, + 1, + 9, + 10, + 2, + 1, + 13, + 1, + 0 + ], + "weighted_loads": [ + 0.1743965595960617, + 0.04201195668429136, + 0.0, + 0.1542227566242218, + 0.0615500770509243, + 0.03510880097746849, + 0.20924531668424606, + 0.10590370744466782, + 0.24197059497237206, + 1.1951505495235324, + 1.095550313591957, + 0.11534317582845688, + 0.0, + 0.09253727272152901, + 0.2537435218691826, + 1.0844248812645674, + 0.23432381823658943, + 0.14971613232046366, + 0.028098905459046364, + 0.16235359758138657, + 0.9471963923424482, + 0.11842381209135056, + 0.04675411805510521, + 4.65256436355412, + 0.055725034326314926, + 0.23594612628221512, + 0.24941395409405231, + 0.03391729295253754, + 1.5823290115222335, + 0.2656762693077326, + 0.4939653240144253, + 0.11329305544495583, + 0.1441120021045208, + 0.37048280984163284, + 0.7396567612886429, + 0.3892383798956871, + 0.0, + 0.6673036804422736, + 3.0791239701211452, + 0.2509610429406166, + 0.041932281106710434, + 0.0, + 0.2766469307243824, + 0.040628645569086075, + 0.10465680435299873, + 0.4115731352940202, + 0.08642837405204773, + 0.22817817702889442, + 1.7024286054074764, + 0.06477712653577328, + 0.23811548203229904, + 0.2927737236022949, + 0.07767099142074585, + 0.18255038000643253, + 0.0, + 0.2269074060022831, + 0.07817188650369644, + 0.5928413849323988, + 0.8281627744436264, + 0.09567466378211975, + 0.03397597372531891, + 1.1031223349273205, + 0.09870480000972748, + 0.0 + ], + "unique_experts": 58, + "load_cv": 1.066802259626396, + "normalized_load_entropy": 0.8837415710215473, + "max_load_share": 0.07371794871794872 + }, + "full_input": { + "tokens": 93, + "top_k": 6, + "decisions": 558, + "ordered_route_sha256": "b5f411dfcc36410bfec5d24090473fa939b81ec19745eea3b64fad2ed8497ae0", + "route_weight_sha256": "493c1d3f32f149396ecdc5c406396de1d5c5af5091ada2f1c159a1726df49b1b", + "loads": [ + 12, + 5, + 3, + 9, + 7, + 1, + 8, + 3, + 4, + 29, + 23, + 4, + 2, + 10, + 5, + 24, + 8, + 12, + 3, + 4, + 8, + 4, + 1, + 25, + 10, + 24, + 16, + 4, + 20, + 7, + 8, + 3, + 8, + 6, + 10, + 3, + 4, + 15, + 18, + 5, + 14, + 6, + 7, + 2, + 4, + 15, + 4, + 6, + 10, + 4, + 5, + 8, + 6, + 4, + 1, + 12, + 8, + 21, + 11, + 4, + 2, + 18, + 11, + 0 + ], + "weighted_loads": [ + 0.5212243273854256, + 0.18850793968886137, + 0.1045491024851799, + 0.7747249603271484, + 0.46139318495988846, + 0.03510880097746849, + 0.3295866400003433, + 0.16191570833325386, + 0.24197059497237206, + 1.4122317405417562, + 1.6459075342863798, + 0.18359173648059368, + 0.10129949077963829, + 0.6879456639289856, + 0.2537435218691826, + 1.3728130515664816, + 0.49852658435702324, + 0.8172983760014176, + 0.09365741722285748, + 0.16235359758138657, + 1.0467304941266775, + 0.19507500529289246, + 0.04675411805510521, + 5.2786450907588005, + 0.7067723758518696, + 1.7127130012959242, + 1.156301237642765, + 0.1569751836359501, + 1.6206203838810325, + 0.37943091057240963, + 0.5890352316200733, + 0.1526227369904518, + 0.3083972856402397, + 0.37048280984163284, + 0.826435424387455, + 0.3892383798956871, + 0.22741620987653732, + 0.7414273144677281, + 3.370596632361412, + 0.2844233736395836, + 1.6670550927519798, + 0.39412394538521767, + 0.4487241320312023, + 0.059474606066942215, + 0.344148363918066, + 1.6939436355605721, + 0.3034003973007202, + 0.3601319305598736, + 1.7024286054074764, + 0.13872244767844677, + 0.431258674710989, + 0.5898129045963287, + 0.3311953507363796, + 0.18255038000643253, + 0.08728892356157303, + 0.7880709506571293, + 0.6931849606335163, + 1.2745154593139887, + 0.8520461209118366, + 0.1884848289191723, + 0.06577273458242416, + 1.4024217575788498, + 0.8197840619832277, + 0.0 + ], + "unique_experts": 63, + "load_cv": 0.7724575651751198, + "normalized_load_entropy": 0.934013844544524, + "max_load_share": 0.05197132616487455 + } + }, + "s0_x": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "db855519dc29ed56ad7c098a1794df4a901af3ce054627f2ddbab56bd7879947", + "route_weight_sha256": "2a1d31e1fb95db3a2eb7d3822c5760168060e16c34c8d00010a6b8b1b307886d", + "loads": [ + 4, + 1, + 0, + 3, + 1, + 1, + 5, + 3, + 4, + 24, + 14, + 2, + 0, + 2, + 5, + 17, + 5, + 5, + 2, + 4, + 7, + 3, + 2, + 17, + 1, + 3, + 2, + 1, + 18, + 5, + 4, + 2, + 7, + 6, + 9, + 3, + 0, + 14, + 14, + 3, + 1, + 0, + 4, + 1, + 2, + 12, + 2, + 4, + 8, + 3, + 2, + 2, + 1, + 4, + 1, + 3, + 1, + 10, + 10, + 1, + 1, + 14, + 2, + 0 + ], + "weighted_loads": [ + 0.17061422020196915, + 0.03024112805724144, + 0.0, + 0.16370993480086327, + 0.05819901078939438, + 0.03156591206789017, + 0.20870989933609962, + 0.13002752512693405, + 0.23650212958455086, + 1.1727054547518492, + 1.096160788089037, + 0.10782001912593842, + 0.0, + 0.09079258516430855, + 0.2634628377854824, + 1.0643935203552246, + 0.2272031009197235, + 0.19166726991534233, + 0.0635141097009182, + 0.158624067902565, + 1.0365183129906654, + 0.11582356318831444, + 0.08049200475215912, + 4.605737045407295, + 0.04522091895341873, + 0.25376546010375023, + 0.15151621401309967, + 0.02722282148897648, + 1.487188664264977, + 0.2200641967356205, + 0.3935179263353348, + 0.11776312068104744, + 0.23642398323863745, + 0.36534011736512184, + 0.7216250151395798, + 0.3846644163131714, + 0.0, + 0.7027076818048954, + 3.0530721899122, + 0.22367697954177856, + 0.0422520637512207, + 0.0, + 0.2626575827598572, + 0.04146302118897438, + 0.10080991685390472, + 0.4678127635270357, + 0.08680048957467079, + 0.2175572980195284, + 1.6097010225057602, + 0.1100439801812172, + 0.19853974878787994, + 0.28551337122917175, + 0.04143505543470383, + 0.19257736764848232, + 0.03206329420208931, + 0.22683490812778473, + 0.0744381844997406, + 0.6221493687480688, + 0.819268386811018, + 0.05657382309436798, + 0.033456429839134216, + 1.0972448848187923, + 0.12759528495371342, + 0.0 + ], + "unique_experts": 59, + "load_cv": 1.0661857890406046, + "normalized_load_entropy": 0.8850826104604743, + "max_load_share": 0.07692307692307693 + }, + "full_input": { + "tokens": 77, + "top_k": 6, + "decisions": 462, + "ordered_route_sha256": "9884f3a12bebda3bda03f32ea88da2e18468762d6bcc0daeeb899ae690ed18ff", + "route_weight_sha256": "04c5ada436bd67b1b60711ac10a83e8821de8d4eacc28653d20739ec90555e6d", + "loads": [ + 10, + 2, + 2, + 11, + 1, + 1, + 7, + 3, + 4, + 29, + 22, + 3, + 2, + 11, + 5, + 19, + 6, + 13, + 4, + 4, + 9, + 3, + 2, + 24, + 7, + 11, + 9, + 3, + 23, + 7, + 4, + 2, + 15, + 6, + 10, + 3, + 1, + 14, + 18, + 3, + 8, + 4, + 6, + 2, + 2, + 16, + 2, + 4, + 9, + 4, + 4, + 2, + 3, + 4, + 1, + 9, + 1, + 14, + 10, + 1, + 1, + 15, + 7, + 0 + ], + "weighted_loads": [ + 0.3987962771207094, + 0.06612155213952065, + 0.09967286512255669, + 0.8985220976173878, + 0.05819901078939438, + 0.03156591206789017, + 0.30491819977760315, + 0.13002752512693405, + 0.23650212958455086, + 1.3642033729702234, + 1.673243012279272, + 0.12637018226087093, + 0.06467943079769611, + 0.729744378477335, + 0.2634628377854824, + 1.152555674314499, + 0.32116247713565826, + 0.8943463116884232, + 0.11609581112861633, + 0.158624067902565, + 1.2344244942069054, + 0.11582356318831444, + 0.08049200475215912, + 4.9321593567729, + 0.6345825344324112, + 0.7673316597938538, + 0.7928181923925877, + 0.11724364943802357, + 1.6801773020997643, + 0.28578638285398483, + 0.3935179263353348, + 0.11776312068104744, + 0.5797432353720069, + 0.36534011736512184, + 0.7995029464364052, + 0.3846644163131714, + 0.04206298291683197, + 0.7027076818048954, + 3.212949998676777, + 0.22367697954177856, + 0.9553858190774918, + 0.16288277134299278, + 0.44635939598083496, + 0.06030898168683052, + 0.10080991685390472, + 1.2258965466171503, + 0.08680048957467079, + 0.2175572980195284, + 1.6495614051818848, + 0.1470133513212204, + 0.3349335491657257, + 0.28551337122917175, + 0.18543986231088638, + 0.19257736764848232, + 0.03206329420208931, + 0.6173597201704979, + 0.0744381844997406, + 0.8634778875857592, + 0.819268386811018, + 0.05657382309436798, + 0.033456429839134216, + 1.1741441078484058, + 0.4845116753131151, + 0.0 + ], + "unique_experts": 63, + "load_cv": 0.8959156587536198, + "normalized_load_entropy": 0.913703081068556, + "max_load_share": 0.06277056277056277 + } + }, + "s1_x": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "651f7bda6fc10eb4231773513b6c60cb18c36bb6ee120544f93cf765a6a762a1", + "route_weight_sha256": "20eb2cc380342f2c4b97c3cd62f4480deca4bf2878be2011d24999f16750ab1b", + "loads": [ + 3, + 4, + 0, + 3, + 1, + 1, + 5, + 4, + 4, + 23, + 13, + 2, + 0, + 2, + 5, + 16, + 5, + 5, + 1, + 3, + 6, + 3, + 1, + 17, + 1, + 3, + 4, + 0, + 19, + 4, + 6, + 2, + 5, + 6, + 9, + 3, + 0, + 14, + 15, + 4, + 1, + 0, + 4, + 1, + 2, + 11, + 2, + 4, + 10, + 3, + 2, + 2, + 1, + 4, + 1, + 4, + 2, + 10, + 10, + 1, + 0, + 14, + 1, + 0 + ], + "weighted_loads": [ + 0.14160258322954178, + 0.09089267440140247, + 0.0, + 0.17163337022066116, + 0.05812662094831467, + 0.036133959889411926, + 0.1585377873852849, + 0.18968134000897408, + 0.23779580742120743, + 1.1423854632303119, + 1.0557503327727318, + 0.1189354881644249, + 0.0, + 0.09685615077614784, + 0.2559119500219822, + 1.0371538493782282, + 0.23154734633862972, + 0.18682288005948067, + 0.027481969445943832, + 0.1060783602297306, + 0.9476794432848692, + 0.11631951481103897, + 0.04831548035144806, + 4.651537988334894, + 0.042683832347393036, + 0.26407983899116516, + 0.2228344026952982, + 0.0, + 1.5418360009789467, + 0.2041957788169384, + 0.47632729820907116, + 0.1149291917681694, + 0.1823180429637432, + 0.37858618795871735, + 0.7207359336316586, + 0.3788409009575844, + 0.0, + 0.7029743641614914, + 3.076271878555417, + 0.2524784728884697, + 0.042362459003925323, + 0.0, + 0.2915610782802105, + 0.03812903165817261, + 0.10476524382829666, + 0.43597561586648226, + 0.08484761044383049, + 0.22755016386508942, + 1.6963795311748981, + 0.10495040938258171, + 0.20296772569417953, + 0.28672075271606445, + 0.038521863520145416, + 0.18298112973570824, + 0.031210053712129593, + 0.258402431383729, + 0.1374923251569271, + 0.6350918803364038, + 0.8197788670659065, + 0.0500921830534935, + 0.0, + 1.2117556035518646, + 0.10695318877696991, + 0.0 + ], + "unique_experts": 57, + "load_cv": 1.0575174680667323, + "normalized_load_entropy": 0.8832203031979329, + "max_load_share": 0.07371794871794872 + }, + "full_input": { + "tokens": 93, + "top_k": 6, + "decisions": 558, + "ordered_route_sha256": "babfb5885f6f393324e4beef495773a64442644a2541b5c3635753099b40e2ee", + "route_weight_sha256": "6db03065e8bcea9bb16cf16c17831ab7ff635bbdc16c36b34532431b40ecccbb", + "loads": [ + 9, + 5, + 4, + 10, + 7, + 1, + 8, + 5, + 4, + 29, + 23, + 4, + 0, + 11, + 5, + 22, + 8, + 14, + 3, + 3, + 6, + 4, + 1, + 26, + 10, + 25, + 14, + 2, + 20, + 6, + 8, + 3, + 9, + 6, + 10, + 3, + 5, + 16, + 18, + 5, + 13, + 6, + 7, + 2, + 4, + 16, + 4, + 6, + 11, + 3, + 4, + 8, + 5, + 4, + 2, + 14, + 9, + 23, + 12, + 3, + 1, + 20, + 9, + 0 + ], + "weighted_loads": [ + 0.38857898488640785, + 0.13376412726938725, + 0.15993143245577812, + 0.9526000544428825, + 0.4579697288572788, + 0.036133959889411926, + 0.27887911070138216, + 0.24569334089756012, + 0.23779580742120743, + 1.3373712124302983, + 1.7946544643491507, + 0.1871840488165617, + 0.0, + 0.7539509199559689, + 0.2559119500219822, + 1.331204516813159, + 0.48194525204598904, + 0.9054891429841518, + 0.09304048120975494, + 0.1060783602297306, + 0.9476794432848692, + 0.19297070801258087, + 0.04831548035144806, + 5.306378925219178, + 0.687752366065979, + 1.7163135800510645, + 1.038157381117344, + 0.07597267255187035, + 1.583326417952776, + 0.3150259256362915, + 0.5713972058147192, + 0.1542588733136654, + 0.35546229779720306, + 0.37858618795871735, + 0.8044700957834721, + 0.3788409009575844, + 0.28346212953329086, + 0.7770979981869459, + 3.367744540795684, + 0.2859408035874367, + 1.5312695428729057, + 0.3681185431778431, + 0.44141506403684616, + 0.05697499215602875, + 0.34425680339336395, + 1.5823512868955731, + 0.301819633692503, + 0.3595039173960686, + 1.7363364957273006, + 0.10495040938258171, + 0.42346807569265366, + 0.5837599337100983, + 0.3033478446304798, + 0.18298112973570824, + 0.11849897727370262, + 0.8322563152760267, + 0.752505399286747, + 1.3603117745369673, + 0.8944414779543877, + 0.14290234819054604, + 0.031796760857105255, + 1.5306714233011007, + 0.6744465064257383, + 0.0 + ], + "unique_experts": 62, + "load_cv": 0.7986238983628923, + "normalized_load_entropy": 0.9283116675466956, + "max_load_share": 0.05197132616487455 + } + }, + "s0_period": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "c5d100e56108b4154f950378e9baa7d66dbc12df89dfe63dd07c81ba6f363475", + "route_weight_sha256": "9b61d727fd18dd54970e16e65c0b145b3a79ad2f62f35689728f90f9002ee729", + "loads": [ + 5, + 2, + 0, + 4, + 1, + 1, + 6, + 2, + 4, + 24, + 14, + 2, + 0, + 2, + 5, + 19, + 5, + 3, + 2, + 4, + 7, + 3, + 1, + 17, + 1, + 5, + 3, + 0, + 17, + 5, + 4, + 2, + 6, + 6, + 8, + 3, + 0, + 14, + 14, + 4, + 1, + 0, + 4, + 1, + 2, + 11, + 2, + 4, + 9, + 3, + 2, + 2, + 1, + 3, + 1, + 3, + 1, + 10, + 10, + 1, + 0, + 14, + 2, + 0 + ], + "weighted_loads": [ + 0.20951400138437748, + 0.04026573430746794, + 0.0, + 0.18220332823693752, + 0.05882468819618225, + 0.03336619958281517, + 0.24571023508906364, + 0.09971758723258972, + 0.23479733988642693, + 1.1932259257882833, + 1.0954770473763347, + 0.11000173538923264, + 0.0, + 0.09233511984348297, + 0.25788282603025436, + 1.174961593002081, + 0.22661499120295048, + 0.1305843759328127, + 0.060237547382712364, + 0.16312537714838982, + 0.9915109798312187, + 0.11674106493592262, + 0.044103462249040604, + 4.7117681205272675, + 0.049260299652814865, + 0.30434970557689667, + 0.18308788165450096, + 0.0, + 1.4725105073302984, + 0.21577691659331322, + 0.39211107790470123, + 0.11844856292009354, + 0.21736250072717667, + 0.3666730336844921, + 0.6873039491474628, + 0.39172501116991043, + 0.0, + 0.7033217623829842, + 3.063834836706519, + 0.25101699121296406, + 0.04111439734697342, + 0.0, + 0.2691510170698166, + 0.040159858763217926, + 0.10058033838868141, + 0.43981228582561016, + 0.09095608443021774, + 0.21455230005085468, + 1.6339733451604843, + 0.10471007972955704, + 0.18638060986995697, + 0.30043119192123413, + 0.04088711738586426, + 0.1653340570628643, + 0.02990204654633999, + 0.2257412038743496, + 0.07601269334554672, + 0.6440476216375828, + 0.813372690230608, + 0.061537060886621475, + 0.0, + 1.108772549778223, + 0.12998437695205212, + 0.0 + ], + "unique_experts": 57, + "load_cv": 1.0741723110591492, + "normalized_load_entropy": 0.8811833857927872, + "max_load_share": 0.07692307692307693 + }, + "full_input": { + "tokens": 77, + "top_k": 6, + "decisions": 462, + "ordered_route_sha256": "1f0cead018eb259a839e6d9a4bad22cc3293a623dae38e2f8cbe77b997eb3afa", + "route_weight_sha256": "17269b055cb1890872aa4f580e15d219df021d530fd10283304a06c4dc4fbdbe", + "loads": [ + 11, + 3, + 3, + 12, + 1, + 1, + 8, + 2, + 4, + 28, + 21, + 3, + 2, + 10, + 5, + 21, + 6, + 10, + 4, + 4, + 10, + 3, + 1, + 23, + 7, + 14, + 10, + 3, + 22, + 7, + 4, + 2, + 14, + 6, + 9, + 3, + 1, + 14, + 18, + 4, + 8, + 4, + 7, + 2, + 2, + 15, + 2, + 4, + 9, + 3, + 4, + 2, + 3, + 3, + 1, + 10, + 1, + 15, + 10, + 1, + 0, + 15, + 7, + 0 + ], + "weighted_loads": [ + 0.4444351941347122, + 0.07614615838974714, + 0.15506566315889359, + 0.8106002528220415, + 0.05882468819618225, + 0.03336619958281517, + 0.34191853553056717, + 0.09971758723258972, + 0.23479733988642693, + 1.3399181831628084, + 1.5233309818431735, + 0.12855189852416515, + 0.06467943079769611, + 0.6930542849004269, + 0.25788282603025436, + 1.2588119320571423, + 0.31732321716845036, + 0.7872029412537813, + 0.1128192488104105, + 0.16312537714838982, + 1.2381645776331425, + 0.11674106493592262, + 0.044103462249040604, + 4.980810683220625, + 0.6186022944748402, + 0.883392583578825, + 0.8125321716070175, + 0.12674180790781975, + 1.6614024844020605, + 0.27980541810393333, + 0.39211107790470123, + 0.11844856292009354, + 0.5580030530691147, + 0.3666730336844921, + 0.7738409601151943, + 0.39172501116991043, + 0.04117351025342941, + 0.7033217623829842, + 3.223712645471096, + 0.25101699121296406, + 0.9823847748339176, + 0.16926388069987297, + 0.5015131756663322, + 0.059005819261074066, + 0.10058033838868141, + 1.3064354192465544, + 0.09095608443021774, + 0.21455230005085468, + 1.6339733451604843, + 0.10471007972955704, + 0.32527635246515274, + 0.30043119192123413, + 0.19042836129665375, + 0.1653340570628643, + 0.02990204654633999, + 0.783628586679697, + 0.07601269334554672, + 0.9205271154642105, + 0.813372690230608, + 0.061537060886621475, + 0.0, + 1.1745156161487103, + 0.5030128713697195, + 0.0 + ], + "unique_experts": 62, + "load_cv": 0.886833280269041, + "normalized_load_entropy": 0.9127059827030156, + "max_load_share": 0.06060606060606061 + } + }, + "s1_period": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "6680af20f8f9db42d92a7a873874663b21b3f8a8065cd9ce2936285a430bcac3", + "route_weight_sha256": "077318917e997384441b90d158e34462d28696384907cf22f0aae883117faa77", + "loads": [ + 3, + 5, + 0, + 3, + 1, + 1, + 6, + 4, + 4, + 23, + 13, + 2, + 0, + 2, + 5, + 18, + 6, + 4, + 1, + 3, + 6, + 2, + 1, + 17, + 1, + 6, + 5, + 0, + 18, + 5, + 6, + 2, + 3, + 6, + 9, + 3, + 0, + 13, + 15, + 4, + 1, + 0, + 4, + 1, + 2, + 10, + 2, + 3, + 10, + 3, + 3, + 2, + 2, + 2, + 0, + 4, + 2, + 9, + 10, + 2, + 0, + 13, + 1, + 0 + ], + "weighted_loads": [ + 0.1478135697543621, + 0.09858627337962389, + 0.0, + 0.16763007640838623, + 0.059223055839538574, + 0.039227116852998734, + 0.20285456720739603, + 0.1897423416376114, + 0.23823453858494759, + 1.1342700263485312, + 1.0505224950611591, + 0.1166657842695713, + 0.0, + 0.09673818945884705, + 0.23834609985351562, + 1.0718806479126215, + 0.26962410658597946, + 0.15208108443766832, + 0.027917666360735893, + 0.10842210799455643, + 0.9526351112872362, + 0.07347218319773674, + 0.042630817741155624, + 4.636090103536844, + 0.04824645817279816, + 0.38173673301935196, + 0.23967887088656425, + 0.0, + 1.5516354562714696, + 0.22448216192424297, + 0.4644639138132334, + 0.11832604184746742, + 0.10956381261348724, + 0.38668977096676826, + 0.7332444228231907, + 0.3772783800959587, + 0.0, + 0.6693785022944212, + 3.0752670597285032, + 0.246111698448658, + 0.03857750818133354, + 0.0, + 0.28933698683977127, + 0.03592659533023834, + 0.10415611416101456, + 0.4074887279421091, + 0.08059817180037498, + 0.19204756245017052, + 1.6873336806893349, + 0.10753178037703037, + 0.24624976515769958, + 0.2917131632566452, + 0.07644105330109596, + 0.12069611996412277, + 0.0, + 0.2619167920202017, + 0.13806263729929924, + 0.5672237519174814, + 0.8311188630759716, + 0.09418484568595886, + 0.0, + 1.1297267451882362, + 0.10589585453271866, + 0.0 + ], + "unique_experts": 56, + "load_cv": 1.0494042015221088, + "normalized_load_entropy": 0.8836677810829603, + "max_load_share": 0.07371794871794872 + }, + "full_input": { + "tokens": 93, + "top_k": 6, + "decisions": 558, + "ordered_route_sha256": "e0905dae2bf5e0eb0faaa98cd89fde00475f02256582e5924121b10617060540", + "route_weight_sha256": "5accabc80dfd93330dfc431c9edea6e6bb95cd00bba41e1c348b208df0370458", + "loads": [ + 10, + 6, + 4, + 10, + 7, + 1, + 9, + 5, + 4, + 28, + 22, + 4, + 0, + 10, + 5, + 24, + 9, + 12, + 3, + 3, + 6, + 3, + 1, + 25, + 10, + 29, + 16, + 2, + 20, + 7, + 8, + 3, + 7, + 6, + 10, + 3, + 5, + 15, + 18, + 5, + 14, + 6, + 9, + 2, + 4, + 15, + 4, + 5, + 10, + 3, + 5, + 8, + 6, + 2, + 1, + 15, + 9, + 23, + 11, + 4, + 1, + 18, + 8, + 0 + ], + "weighted_loads": [ + 0.44572722166776657, + 0.14145772624760866, + 0.1501091718673706, + 0.8438073098659515, + 0.45906616374850273, + 0.039227116852998734, + 0.3231958905234933, + 0.24575434252619743, + 0.23823453858494759, + 1.2918307343497872, + 1.629470445215702, + 0.1849143449217081, + 0.0, + 0.6921465806663036, + 0.23834609985351562, + 1.3728482071310282, + 0.5287511795759201, + 0.8196633281186223, + 0.093476178124547, + 0.10842210799455643, + 0.9526351112872362, + 0.15012337639927864, + 0.042630817741155624, + 5.262170830741525, + 0.6831448301672935, + 1.9557245653122663, + 1.0746007282286882, + 0.07597267255187035, + 1.6213996754959226, + 0.3391162510961294, + 0.5595338214188814, + 0.1576557233929634, + 0.2758041098713875, + 0.38668977096676826, + 0.8184273727238178, + 0.3772783800959587, + 0.28376658633351326, + 0.7435021363198757, + 3.36673972196877, + 0.27957402914762497, + 1.5537060387432575, + 0.38106442615389824, + 0.5214776992797852, + 0.05477255582809448, + 0.34364767372608185, + 1.746372388675809, + 0.29757019504904747, + 0.3240013159811497, + 1.6873336806893349, + 0.10753178037703037, + 0.44194766879081726, + 0.588752344250679, + 0.34285593032836914, + 0.12069611996412277, + 0.08728892356157303, + 0.9842999037355185, + 0.7530757114291191, + 1.3490810636430979, + 0.8550022095441818, + 0.1869950108230114, + 0.031796760857105255, + 1.4070794880390167, + 0.6117032784968615, + 0.0 + ], + "unique_experts": 62, + "load_cv": 0.8075818443974377, + "normalized_load_entropy": 0.926708988201682, + "max_load_share": 0.05197132616487455 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 52, + "ordered_topk_exact_tokens": 37, + "set_exact_tokens": 46, + "mean_set_jaccard": 0.9670329670329672, + "mean_token_weighted_tv": 0.012636920643182328, + "aggregate_load_tv": 0.01602564102564103 + }, + "system_bos": { + "tokens": 52, + "ordered_topk_exact_tokens": 29, + "set_exact_tokens": 35, + "mean_set_jaccard": 0.9024725274725275, + "mean_token_weighted_tv": 0.02230094229050267, + "aggregate_load_tv": 0.028846153846153848 + }, + "system_x": { + "tokens": 52, + "ordered_topk_exact_tokens": 21, + "set_exact_tokens": 30, + "mean_set_jaccard": 0.8717948717948717, + "mean_token_weighted_tv": 0.027828163834503636, + "aggregate_load_tv": 0.04807692307692308 + }, + "system_period": { + "tokens": 52, + "ordered_topk_exact_tokens": 17, + "set_exact_tokens": 27, + "mean_set_jaccard": 0.8511904761904762, + "mean_token_weighted_tv": 0.031833653759139664, + "aggregate_load_tv": 0.06730769230769232 + }, + "bos_at_s0": { + "tokens": 52, + "ordered_topk_exact_tokens": 23, + "set_exact_tokens": 32, + "mean_set_jaccard": 0.8859890109890111, + "mean_token_weighted_tv": 0.0278418399572659, + "aggregate_load_tv": 0.048076923076923093 + }, + "bos_at_s1": { + "tokens": 52, + "ordered_topk_exact_tokens": 22, + "set_exact_tokens": 32, + "mean_set_jaccard": 0.8859890109890112, + "mean_token_weighted_tv": 0.028937553574975867, + "aggregate_load_tv": 0.054487179487179495 + }, + "x_at_s0": { + "tokens": 52, + "ordered_topk_exact_tokens": 24, + "set_exact_tokens": 33, + "mean_set_jaccard": 0.8914835164835165, + "mean_token_weighted_tv": 0.025357110721345704, + "aggregate_load_tv": 0.05448717948717951 + }, + "x_at_s1": { + "tokens": 52, + "ordered_topk_exact_tokens": 22, + "set_exact_tokens": 30, + "mean_set_jaccard": 0.870879120879121, + "mean_token_weighted_tv": 0.0328640371758061, + "aggregate_load_tv": 0.057692307692307696 + }, + "period_at_s0": { + "tokens": 52, + "ordered_topk_exact_tokens": 28, + "set_exact_tokens": 35, + "mean_set_jaccard": 0.9024725274725275, + "mean_token_weighted_tv": 0.026320802486644916, + "aggregate_load_tv": 0.04807692307692309 + }, + "period_at_s1": { + "tokens": 52, + "ordered_topk_exact_tokens": 17, + "set_exact_tokens": 27, + "mean_set_jaccard": 0.8543956043956045, + "mean_token_weighted_tv": 0.03401021534899393, + "aggregate_load_tv": 0.06730769230769232 + } + } + }, + "layer_18": { + "layer": 18, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "c3e95f73b4930732c610dffc9d47e063d79cd2dde5f38f5f072d903fe7043955", + "route_weight_sha256": "8cc55e22d70f2ad7f23d573e27f6b79019fd536ac0b6e9ccb65b9066d3bb99a7", + "loads": [ + 5, + 1, + 12, + 4, + 20, + 1, + 2, + 2, + 1, + 3, + 1, + 8, + 1, + 2, + 8, + 0, + 4, + 28, + 0, + 5, + 10, + 1, + 4, + 7, + 0, + 0, + 0, + 10, + 4, + 2, + 3, + 1, + 14, + 1, + 3, + 0, + 3, + 1, + 16, + 2, + 1, + 4, + 0, + 1, + 7, + 4, + 1, + 0, + 7, + 13, + 19, + 6, + 1, + 2, + 2, + 2, + 0, + 1, + 18, + 2, + 1, + 0, + 2, + 28 + ], + "weighted_loads": [ + 0.2548301611095667, + 0.031866494566202164, + 0.7319433614611626, + 0.21063200756907463, + 1.4131407253444195, + 0.11620110273361206, + 0.07354670390486717, + 0.13977234810590744, + 0.04451443627476692, + 0.19783778488636017, + 0.037029337137937546, + 0.3549060747027397, + 0.03137446567416191, + 0.07175060734152794, + 0.5733801890164614, + 0.0, + 0.25117769092321396, + 3.04617016389966, + 0.0, + 0.4080122970044613, + 0.6591157298535109, + 0.03699803352355957, + 0.24066023156046867, + 0.3838516063988209, + 0.0, + 0.0, + 0.0, + 0.7316230721771717, + 0.3032513000071049, + 0.13064226508140564, + 0.15351948142051697, + 0.028136398643255234, + 2.238101776689291, + 0.036711715161800385, + 0.10836974903941154, + 0.0, + 0.12595145404338837, + 0.029387783259153366, + 1.0382752809673548, + 0.07142817415297031, + 0.06121714040637016, + 0.13535420410335064, + 0.0, + 0.02870657481253147, + 0.34216396510601044, + 0.2059481330215931, + 0.09771325439214706, + 0.0, + 0.2666929569095373, + 1.0033222828060389, + 0.81898975931108, + 0.2876475751399994, + 0.048331741243600845, + 0.10549908503890038, + 0.10988564416766167, + 0.12782682105898857, + 0.0, + 0.07666154205799103, + 2.581534892320633, + 0.31302254647016525, + 0.045928869396448135, + 0.0, + 0.09483492001891136, + 1.7502907570451498 + ], + "unique_experts": 54, + "load_cv": 1.3187067559614145, + "normalized_load_entropy": 0.8365683362684576, + "max_load_share": 0.08974358974358974 + }, + "full_input": { + "tokens": 77, + "top_k": 6, + "decisions": 462, + "ordered_route_sha256": "f9857c1a1c982c51a84e601e2b1b58e4be4a98fb66594d949888916479b9571c", + "route_weight_sha256": "1ff7185a985ff701c851684ec878a90a49b982f861fdabb67e6b6af3f138496a", + "loads": [ + 11, + 3, + 24, + 4, + 20, + 3, + 2, + 2, + 9, + 3, + 2, + 12, + 2, + 2, + 13, + 5, + 4, + 28, + 19, + 5, + 10, + 2, + 4, + 7, + 0, + 0, + 0, + 11, + 4, + 2, + 11, + 1, + 14, + 1, + 3, + 3, + 4, + 3, + 16, + 5, + 7, + 5, + 4, + 1, + 8, + 4, + 8, + 0, + 9, + 25, + 22, + 8, + 10, + 10, + 2, + 2, + 2, + 2, + 19, + 5, + 1, + 2, + 2, + 30 + ], + "weighted_loads": [ + 0.6464893836528063, + 0.13443654589354992, + 1.762748695909977, + 0.21063200756907463, + 1.4131407253444195, + 0.16529457829892635, + 0.07354670390486717, + 0.13977234810590744, + 0.5218356661498547, + 0.19783778488636017, + 0.04796396382153034, + 0.7486454769968987, + 0.0643097572028637, + 0.07175060734152794, + 1.504431875422597, + 0.15911263041198254, + 0.25117769092321396, + 3.04617016389966, + 1.0957074463367462, + 0.4080122970044613, + 0.6591157298535109, + 0.062089841812849045, + 0.24066023156046867, + 0.3838516063988209, + 0.0, + 0.0, + 0.0, + 0.802869651466608, + 0.3032513000071049, + 0.13064226508140564, + 0.49093038216233253, + 0.028136398643255234, + 2.238101776689291, + 0.036711715161800385, + 0.10836974903941154, + 0.15680792927742004, + 0.1494799256324768, + 0.09004928730428219, + 1.0382752809673548, + 0.17150932736694813, + 0.3709178790450096, + 0.16353306733071804, + 0.11914231069386005, + 0.02870657481253147, + 0.3804144971072674, + 0.2059481330215931, + 1.730441264808178, + 0.0, + 0.3766930680721998, + 1.5333609860390425, + 0.9101184848695993, + 0.4659023731946945, + 0.6626932788640261, + 0.6880877949297428, + 0.10988564416766167, + 0.12782682105898857, + 0.9985769242048264, + 0.10404429584741592, + 2.610844785347581, + 0.4138198234140873, + 0.045928869396448135, + 0.05386722646653652, + 0.09483492001891136, + 1.8437188547104597 + ], + "unique_experts": 60, + "load_cv": 1.0071519514532514, + "normalized_load_entropy": 0.8933644032587198, + "max_load_share": 0.06493506493506493 + } + }, + "s1_eos": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "f5a8b5b450e53b9e37b2855789dba40fadb2094530cd3873cc9d9dccb9fca502", + "route_weight_sha256": "7547c1c4e25671be182ca650a5b436cd0f96d7c555a37a3aa31fddd06b4ae61b", + "loads": [ + 5, + 1, + 12, + 3, + 19, + 1, + 2, + 1, + 1, + 3, + 1, + 7, + 1, + 2, + 7, + 0, + 4, + 28, + 0, + 5, + 10, + 1, + 4, + 7, + 0, + 0, + 0, + 10, + 4, + 2, + 3, + 1, + 14, + 2, + 3, + 0, + 5, + 1, + 17, + 2, + 1, + 4, + 0, + 1, + 6, + 4, + 1, + 0, + 8, + 13, + 17, + 5, + 1, + 3, + 2, + 2, + 0, + 2, + 18, + 2, + 2, + 0, + 3, + 28 + ], + "weighted_loads": [ + 0.26899759098887444, + 0.036629099398851395, + 0.7276929039508104, + 0.18262656405568123, + 1.3619719929993153, + 0.10401338338851929, + 0.071245476603508, + 0.10179805010557175, + 0.04570366442203522, + 0.2126356102526188, + 0.038796570152044296, + 0.32448978535830975, + 0.033543918281793594, + 0.08033576607704163, + 0.5490561369806528, + 0.0, + 0.24778084456920624, + 3.052450142800808, + 0.0, + 0.404883299022913, + 0.6673813555389643, + 0.03964667767286301, + 0.2229214422404766, + 0.3834875710308552, + 0.0, + 0.0, + 0.0, + 0.6965963244438171, + 0.315660510212183, + 0.13367558270692825, + 0.15427405387163162, + 0.02785544842481613, + 2.231651049107313, + 0.06939326412975788, + 0.10493659228086472, + 0.0, + 0.19531899876892567, + 0.028105834499001503, + 1.0867842063307762, + 0.07744185253977776, + 0.06006157398223877, + 0.1292998529970646, + 0.0, + 0.02749023400247097, + 0.31660566106438637, + 0.20631355792284012, + 0.09269663691520691, + 0.0, + 0.30723314732313156, + 1.010320471599698, + 0.7401422169059515, + 0.2603851705789566, + 0.04461272060871124, + 0.1325292158871889, + 0.1139969453215599, + 0.12306100502610207, + 0.0, + 0.1041142251342535, + 2.5491482503712177, + 0.3022339195013046, + 0.0780672337859869, + 0.0, + 0.12737881392240524, + 1.678682528436184 + ], + "unique_experts": 54, + "load_cv": 1.2955697535035673, + "normalized_load_entropy": 0.8423032557887756, + "max_load_share": 0.08974358974358974 + }, + "full_input": { + "tokens": 93, + "top_k": 6, + "decisions": 558, + "ordered_route_sha256": "c0c345a6e664c3b9aad2035bb63a4652146368b1a272959613c7e4efae08abf9", + "route_weight_sha256": "13adea3efa5fe96dd0657dae263b118c54b9c3da5c311f489863ecee5af3f56f", + "loads": [ + 12, + 5, + 25, + 3, + 20, + 4, + 3, + 3, + 11, + 5, + 2, + 11, + 1, + 3, + 16, + 3, + 4, + 38, + 23, + 6, + 10, + 2, + 5, + 7, + 0, + 0, + 0, + 11, + 4, + 3, + 13, + 3, + 15, + 3, + 7, + 15, + 6, + 6, + 18, + 5, + 6, + 4, + 3, + 6, + 7, + 4, + 18, + 3, + 11, + 27, + 18, + 8, + 10, + 15, + 4, + 3, + 3, + 8, + 20, + 7, + 2, + 2, + 3, + 35 + ], + "weighted_loads": [ + 0.6560951359570026, + 0.2107008546590805, + 1.8304511699825525, + 0.18262656405568123, + 1.4025753699243069, + 0.19230158627033234, + 0.10075819306075573, + 0.17127668671309948, + 0.8937227614223957, + 0.2746327742934227, + 0.05051718279719353, + 0.7079189848154783, + 0.033543918281793594, + 0.12336555123329163, + 1.6220109220594168, + 0.08027374558150768, + 0.24778084456920624, + 3.6441708095371723, + 1.8140924740582705, + 0.5394406504929066, + 0.6673813555389643, + 0.06674115173518658, + 0.25653306022286415, + 0.3834875710308552, + 0.0, + 0.0, + 0.0, + 0.7875754088163376, + 0.315660510212183, + 0.1709703914821148, + 0.7168717263266444, + 0.27145225927233696, + 2.2872478552162647, + 0.14603418298065662, + 0.5215803198516369, + 1.2821437008678913, + 0.21881096437573433, + 0.24600273557007313, + 1.123444203287363, + 0.1847606711089611, + 0.30929999612271786, + 0.1292998529970646, + 0.08760253340005875, + 0.48333619721233845, + 0.35836244374513626, + 0.20631355792284012, + 2.8667080476880074, + 0.15783889219164848, + 0.40278771333396435, + 1.637746686115861, + 0.7663980834186077, + 0.4695727303624153, + 0.6204572338610888, + 0.8894334249198437, + 0.235639538615942, + 0.15804629027843475, + 1.010756641626358, + 0.36488628946244717, + 2.879991129040718, + 0.5769265647977591, + 0.0780672337859869, + 0.06444993428885937, + 0.12737881392240524, + 1.9559731725603342 + ], + "unique_experts": 61, + "load_cv": 0.9314515051522159, + "normalized_load_entropy": 0.9103179110518235, + "max_load_share": 0.06810035842293907 + } + }, + "s0_bos": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "767bf2f81be6ccbafe5ad18aab0e38744d1ff4cf28e2a5c9afba8313ef36ff11", + "route_weight_sha256": "4c8c8f84870868993d60f48842c02aa045e5309b5418cdd126d78a2ce5ccb358", + "loads": [ + 5, + 2, + 12, + 4, + 21, + 1, + 2, + 1, + 0, + 3, + 0, + 7, + 0, + 2, + 8, + 0, + 4, + 27, + 0, + 5, + 9, + 1, + 4, + 5, + 1, + 0, + 0, + 10, + 4, + 2, + 4, + 1, + 14, + 3, + 3, + 0, + 4, + 2, + 15, + 3, + 3, + 4, + 0, + 1, + 7, + 4, + 1, + 0, + 10, + 11, + 17, + 7, + 1, + 2, + 2, + 2, + 0, + 1, + 18, + 2, + 1, + 0, + 2, + 27 + ], + "weighted_loads": [ + 0.2589894197881222, + 0.07753627374768257, + 0.7483989596366882, + 0.20365217328071594, + 1.4629484359174967, + 0.11464530229568481, + 0.07151342183351517, + 0.10295168310403824, + 0.0, + 0.17808624729514122, + 0.0, + 0.3208059687167406, + 0.0, + 0.07888682186603546, + 0.5615476556122303, + 0.0, + 0.24211163073778152, + 2.9638467580080032, + 0.0, + 0.373719722032547, + 0.627532135695219, + 0.04135259613394737, + 0.25589582324028015, + 0.273300901055336, + 0.024511344730854034, + 0.0, + 0.0, + 0.7248651944100857, + 0.28746604919433594, + 0.13223646208643913, + 0.18605384975671768, + 0.034352630376815796, + 2.2423294745385647, + 0.09378428012132645, + 0.12425404042005539, + 0.0, + 0.15988017059862614, + 0.05995593033730984, + 1.040970230475068, + 0.10283422842621803, + 0.12047150544822216, + 0.13736622221767902, + 0.0, + 0.031470127403736115, + 0.3566995933651924, + 0.21125413849949837, + 0.09119270741939545, + 0.0, + 0.37224894016981125, + 0.8829411678016186, + 0.8285004086792469, + 0.34063251316547394, + 0.04272926598787308, + 0.11012960970401764, + 0.11064789816737175, + 0.1278190240263939, + 0.0, + 0.07455327361822128, + 2.606342177838087, + 0.30540161207318306, + 0.04426509141921997, + 0.0, + 0.09504778683185577, + 1.7340682167559862 + ], + "unique_experts": 52, + "load_cv": 1.2735616346859122, + "normalized_load_entropy": 0.8429444754796791, + "max_load_share": 0.08653846153846154 + }, + "full_input": { + "tokens": 77, + "top_k": 6, + "decisions": 462, + "ordered_route_sha256": "ac6ef79e37ea4f8fe89c7cff1ba04f8951d01f650fd94a1776b15c90f97fcb2b", + "route_weight_sha256": "ae118576e93fd39f0decae9974fc7c81a5ca8df6e10e21f47a28b8e5b49b0c7f", + "loads": [ + 11, + 4, + 23, + 4, + 21, + 3, + 2, + 1, + 8, + 3, + 0, + 10, + 1, + 2, + 13, + 3, + 4, + 27, + 20, + 5, + 9, + 2, + 4, + 7, + 1, + 0, + 1, + 11, + 4, + 2, + 11, + 1, + 14, + 3, + 3, + 4, + 4, + 4, + 15, + 7, + 10, + 6, + 4, + 1, + 8, + 4, + 9, + 0, + 12, + 22, + 20, + 9, + 10, + 10, + 2, + 2, + 1, + 2, + 19, + 5, + 1, + 2, + 2, + 29 + ], + "weighted_loads": [ + 0.6506486423313618, + 0.17926564253866673, + 1.75278858281672, + 0.20365217328071594, + 1.4629484359174967, + 0.1637387778609991, + 0.07151342183351517, + 0.10295168310403824, + 0.47732122987508774, + 0.17808624729514122, + 0.0, + 0.5879991818219423, + 0.17234456539154053, + 0.07888682186603546, + 1.4125194884836674, + 0.09533186070621014, + 0.24211163073778152, + 2.9638467580080032, + 1.1189482118934393, + 0.373719722032547, + 0.627532135695219, + 0.06644440442323685, + 0.25589582324028015, + 0.3509561512619257, + 0.024511344730854034, + 0.0, + 0.0491938591003418, + 0.7990500889718533, + 0.28746604919433594, + 0.13223646208643913, + 0.5236980058252811, + 0.034352630376815796, + 2.2423294745385647, + 0.09378428012132645, + 0.12425404042005539, + 0.20928464084863663, + 0.15988017059862614, + 0.12061743438243866, + 1.040970230475068, + 0.28518351167440414, + 0.47734840027987957, + 0.23272552341222763, + 0.1437819916754961, + 0.031470127403736115, + 0.39978715032339096, + 0.21125413849949837, + 1.7443787157535553, + 0.0, + 0.48224905133247375, + 1.3690203465521336, + 0.9220980871468782, + 0.5147145465016365, + 0.6570908036082983, + 0.718787707388401, + 0.11064789816737175, + 0.1278190240263939, + 0.22312144935131073, + 0.11058281362056732, + 2.635652070865035, + 0.4650144688785076, + 0.04426509141921997, + 0.05386722646653652, + 0.09504778683185577, + 1.8274963144212961 + ], + "unique_experts": 61, + "load_cv": 0.9720036726249209, + "normalized_load_entropy": 0.897837090143861, + "max_load_share": 0.06277056277056277 + } + }, + "s1_bos": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "70a3d64dd02b4261d6d16a318f87bbf6ae933f6c3a775facf5d1d819870a500c", + "route_weight_sha256": "c2c1cbcc86c1d7e66e925557eb58a739003ef4ce575b113e118a60d725c95087", + "loads": [ + 6, + 2, + 12, + 3, + 21, + 1, + 2, + 2, + 0, + 3, + 1, + 7, + 1, + 2, + 9, + 0, + 4, + 26, + 1, + 5, + 7, + 1, + 4, + 7, + 0, + 0, + 0, + 10, + 4, + 2, + 5, + 1, + 14, + 2, + 3, + 0, + 4, + 2, + 18, + 3, + 2, + 4, + 0, + 1, + 6, + 4, + 1, + 0, + 7, + 11, + 17, + 5, + 1, + 2, + 2, + 2, + 0, + 1, + 18, + 2, + 3, + 1, + 1, + 26 + ], + "weighted_loads": [ + 0.3140925467014313, + 0.08259011432528496, + 0.7454166859388351, + 0.1681489534676075, + 1.4204618129879236, + 0.11693468689918518, + 0.07304038107395172, + 0.13773968070745468, + 0.0, + 0.1871047466993332, + 0.037614740431308746, + 0.3079489078372717, + 0.03394845500588417, + 0.079132579267025, + 0.6182122696191072, + 0.0, + 0.23766757175326347, + 2.9727327432483435, + 0.032498519867658615, + 0.3713238127529621, + 0.5776691548526287, + 0.03923815116286278, + 0.2526855766773224, + 0.3664073012769222, + 0.0, + 0.0, + 0.0, + 0.6916814930737019, + 0.29817409813404083, + 0.13877656683325768, + 0.20370411686599255, + 0.03518743813037872, + 2.2512194141745567, + 0.06409700401127338, + 0.12675482779741287, + 0.0, + 0.16071560233831406, + 0.055959880352020264, + 1.146235141903162, + 0.0958016961812973, + 0.08762572333216667, + 0.13756792433559895, + 0.0, + 0.03002658486366272, + 0.3148865271359682, + 0.20959265530109406, + 0.09807207435369492, + 0.0, + 0.27643122151494026, + 0.8875556327402592, + 0.842446094378829, + 0.2567574642598629, + 0.04199163243174553, + 0.10397312045097351, + 0.1128312349319458, + 0.11801322549581528, + 0.0, + 0.079198457300663, + 2.591008897870779, + 0.29776105657219887, + 0.11389316245913506, + 0.025171298533678055, + 0.034835122525691986, + 1.6008345950394869 + ], + "unique_experts": 55, + "load_cv": 1.2548394157171443, + "normalized_load_entropy": 0.8506549536674317, + "max_load_share": 0.08333333333333333 + }, + "full_input": { + "tokens": 93, + "top_k": 6, + "decisions": 558, + "ordered_route_sha256": "82a413a02316dc541f21bbd0a5101675129a7d01aca13a2f5b57097b31ff4aeb", + "route_weight_sha256": "d44aa0598381766819bc21ae36471117f84fe0a8e4f674c1755b50ea9948f74c", + "loads": [ + 12, + 6, + 23, + 3, + 22, + 4, + 3, + 4, + 10, + 5, + 1, + 11, + 1, + 3, + 18, + 3, + 4, + 36, + 25, + 6, + 7, + 2, + 5, + 8, + 0, + 0, + 0, + 11, + 4, + 3, + 14, + 3, + 15, + 3, + 7, + 14, + 4, + 7, + 19, + 6, + 8, + 5, + 4, + 6, + 7, + 4, + 19, + 3, + 10, + 25, + 19, + 7, + 10, + 14, + 4, + 3, + 2, + 8, + 20, + 6, + 3, + 5, + 1, + 33 + ], + "weighted_loads": [ + 0.6664230078458786, + 0.25211905129253864, + 1.787303140386939, + 0.1681489534676075, + 1.4610651899129152, + 0.20522288978099823, + 0.10255309753119946, + 0.20721831731498241, + 0.8480190970003605, + 0.2491019107401371, + 0.037614740431308746, + 0.669022349640727, + 0.03394845500588417, + 0.122162364423275, + 1.81620286218822, + 0.08440838940441608, + 0.23766757175326347, + 3.564453409984708, + 1.897405743598938, + 0.5058811642229557, + 0.5776691548526287, + 0.06633262522518635, + 0.28629719465970993, + 0.39326948300004005, + 0.0, + 0.0, + 0.0, + 0.7758322395384312, + 0.29817409813404083, + 0.1760713756084442, + 0.761442156508565, + 0.27878424897789955, + 2.3068162202835083, + 0.14073792286217213, + 0.543398555368185, + 1.27559519931674, + 0.16071560233831406, + 0.2738567814230919, + 1.1828951388597488, + 0.1814633123576641, + 0.3662483114749193, + 0.17622330226004124, + 0.14207075536251068, + 0.4858725480735302, + 0.35846940614283085, + 0.20959265530109406, + 2.8493445590138435, + 0.15783889219164848, + 0.37198578752577305, + 1.5183865763247013, + 0.9008830524981022, + 0.43178607150912285, + 0.617836145684123, + 0.8437841851264238, + 0.2344738282263279, + 0.15299851074814796, + 0.2587135136127472, + 0.3773087467998266, + 2.9218517765402794, + 0.6136448197066784, + 0.11389316245913506, + 0.1608468983322382, + 0.034835122525691986, + 1.8781252391636372 + ], + "unique_experts": 61, + "load_cv": 0.9106976041931065, + "normalized_load_entropy": 0.9120714418736554, + "max_load_share": 0.06451612903225806 + } + }, + "s0_x": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "58cd8916278919582b0aa45e46c41ecba6c1a66930500d99ebdb2beb37e89067", + "route_weight_sha256": "8109db49265b4e87411b993f6677545bbb28c51e269cde7d314d1f4313dd8dd2", + "loads": [ + 7, + 0, + 12, + 3, + 21, + 1, + 2, + 2, + 0, + 3, + 0, + 7, + 0, + 2, + 8, + 0, + 4, + 25, + 0, + 5, + 9, + 1, + 4, + 7, + 0, + 0, + 1, + 10, + 4, + 2, + 4, + 1, + 14, + 2, + 3, + 0, + 4, + 2, + 18, + 3, + 1, + 4, + 0, + 1, + 8, + 4, + 1, + 0, + 8, + 11, + 17, + 6, + 1, + 2, + 2, + 2, + 0, + 1, + 18, + 3, + 1, + 0, + 2, + 28 + ], + "weighted_loads": [ + 0.3427533656358719, + 0.0, + 0.7464739326387644, + 0.16062306612730026, + 1.4522747825831175, + 0.11446841061115265, + 0.06928472965955734, + 0.13776078447699547, + 0.0, + 0.18381791189312935, + 0.0, + 0.31478918343782425, + 0.0, + 0.07817905023694038, + 0.5661656837910414, + 0.0, + 0.24304188787937164, + 2.9869269356131554, + 0.0, + 0.3735770657658577, + 0.6242424994707108, + 0.03645193204283714, + 0.25346172600984573, + 0.3458044435828924, + 0.0, + 0.0, + 0.02889169193804264, + 0.7535995170474052, + 0.2910904884338379, + 0.13309909775853157, + 0.17763320356607437, + 0.03766237944364548, + 2.2114810198545456, + 0.06258844211697578, + 0.12277591228485107, + 0.0, + 0.14958097971975803, + 0.05638190358877182, + 1.1109818760305643, + 0.10464487224817276, + 0.06046668067574501, + 0.14009833335876465, + 0.0, + 0.029364245012402534, + 0.38342355750501156, + 0.20714443176984787, + 0.1016811653971672, + 0.0, + 0.3182985093444586, + 0.8778591994196177, + 0.7728351410478354, + 0.286833081394434, + 0.05101333186030388, + 0.1102231815457344, + 0.11359279975295067, + 0.11170896515250206, + 0.0, + 0.07566234469413757, + 2.548782493919134, + 0.32593885250389576, + 0.04132993519306183, + 0.0, + 0.08452598750591278, + 1.7380058523267508 + ], + "unique_experts": 51, + "load_cv": 1.2858916839097265, + "normalized_load_entropy": 0.8378884275931581, + "max_load_share": 0.08974358974358974 + }, + "full_input": { + "tokens": 77, + "top_k": 6, + "decisions": 462, + "ordered_route_sha256": "6ba95fb274e566d773dbd5639a3b4ed69b3cc80df97934727d524be75ae92a67", + "route_weight_sha256": "0425f19010a4ea9b68e29cf4a496fb11ca7afb91f14ae4655820dc2df8d9170b", + "loads": [ + 15, + 2, + 25, + 3, + 21, + 3, + 2, + 2, + 8, + 3, + 0, + 11, + 0, + 2, + 13, + 4, + 4, + 25, + 19, + 5, + 9, + 2, + 4, + 7, + 0, + 0, + 1, + 11, + 4, + 2, + 11, + 1, + 14, + 2, + 3, + 4, + 4, + 4, + 18, + 6, + 7, + 5, + 3, + 1, + 9, + 4, + 8, + 0, + 11, + 23, + 18, + 10, + 11, + 10, + 2, + 2, + 1, + 1, + 21, + 5, + 1, + 2, + 2, + 31 + ], + "weighted_loads": [ + 0.816596444696188, + 0.09971261024475098, + 1.9473788440227509, + 0.16062306612730026, + 1.4522747825831175, + 0.16356188617646694, + 0.06928472965955734, + 0.13776078447699547, + 0.47732122987508774, + 0.18381791189312935, + 0.0, + 0.7025414183735847, + 0.0, + 0.07817905023694038, + 1.4836501609534025, + 0.1335280891507864, + 0.24304188787937164, + 2.9869269356131554, + 1.0849564857780933, + 0.3735770657658577, + 0.6242424994707108, + 0.06154374033212662, + 0.25346172600984573, + 0.3458044435828924, + 0.0, + 0.0, + 0.02889169193804264, + 0.8201146423816681, + 0.2910904884338379, + 0.13309909775853157, + 0.5054276175796986, + 0.03766237944364548, + 2.2114810198545456, + 0.06258844211697578, + 0.12277591228485107, + 0.21707455441355705, + 0.14958097971975803, + 0.11704340763390064, + 1.1109818760305643, + 0.1918606497347355, + 0.3734569810330868, + 0.1698068156838417, + 0.08622693456709385, + 0.029364245012402534, + 0.41707144118845463, + 0.20714443176984787, + 1.70831847935915, + 0.0, + 0.47011115588247776, + 1.3984332140535116, + 0.7991198264062405, + 0.5317706055939198, + 0.7632528860121965, + 0.6878493949770927, + 0.11359279975295067, + 0.11170896515250206, + 0.22312144935131073, + 0.07566234469413757, + 2.678432935848832, + 0.4084003735333681, + 0.04132993519306183, + 0.05386722646653652, + 0.08452598750591278, + 1.9095229785889387 + ], + "unique_experts": 59, + "load_cv": 1.0116078227192347, + "normalized_load_entropy": 0.8885980824297722, + "max_load_share": 0.0670995670995671 + } + }, + "s1_x": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "f4c9a70d7d0a6c88a3471244e203207c34d29beb15d0497c4b43a710b77c727f", + "route_weight_sha256": "09aed5556c046d21c9db27b5b849dfc270ef1feca22b1a4c8df763990a54466d", + "loads": [ + 8, + 1, + 12, + 3, + 21, + 1, + 2, + 2, + 1, + 3, + 1, + 6, + 0, + 2, + 8, + 0, + 4, + 25, + 1, + 5, + 10, + 1, + 4, + 7, + 0, + 0, + 0, + 10, + 5, + 2, + 5, + 2, + 14, + 2, + 4, + 0, + 5, + 2, + 17, + 3, + 1, + 2, + 0, + 1, + 6, + 4, + 1, + 0, + 7, + 13, + 13, + 5, + 1, + 2, + 2, + 2, + 0, + 2, + 18, + 2, + 3, + 1, + 1, + 26 + ], + "weighted_loads": [ + 0.36578585766255856, + 0.04384961351752281, + 0.7445495091378689, + 0.16088296100497246, + 1.4004185162484646, + 0.11724817752838135, + 0.06644750759005547, + 0.13631627708673477, + 0.04293045774102211, + 0.1942346803843975, + 0.03981618210673332, + 0.28111155703663826, + 0.0, + 0.07911080121994019, + 0.5853716861456633, + 0.0, + 0.2478553242981434, + 2.9456152636557817, + 0.034011080861091614, + 0.38274602219462395, + 0.669887762516737, + 0.037080757319927216, + 0.2682102732360363, + 0.3703417293727398, + 0.0, + 0.0, + 0.0, + 0.718665637075901, + 0.3236767649650574, + 0.14527244865894318, + 0.1973313856869936, + 0.06712335534393787, + 2.2348064593970776, + 0.06289081647992134, + 0.1588196810334921, + 0.0, + 0.18232937902212143, + 0.05917229689657688, + 1.0796309560537338, + 0.09935631603002548, + 0.05695634335279465, + 0.0811658650636673, + 0.0, + 0.030104458332061768, + 0.3133069984614849, + 0.2042527236044407, + 0.0989694744348526, + 0.0, + 0.2704896852374077, + 0.9312654286623001, + 0.6406642217189074, + 0.26421281322836876, + 0.04837081581354141, + 0.10386363044381142, + 0.11320678889751434, + 0.11472749337553978, + 0.0, + 0.11822225898504257, + 2.597150806337595, + 0.28363145142793655, + 0.1124105378985405, + 0.026523947715759277, + 0.03359520062804222, + 1.6110469456762075 + ], + "unique_experts": 55, + "load_cv": 1.229433035357626, + "normalized_load_entropy": 0.85341382792641, + "max_load_share": 0.08333333333333333 + }, + "full_input": { + "tokens": 93, + "top_k": 6, + "decisions": 558, + "ordered_route_sha256": "fe9a128f4edecb268d8b55b42d51afc33425304739faccdbb4210f6bc4920d76", + "route_weight_sha256": "3427d02e0f9ae96e8b597942c397d9bc2eb6894aacb314a1ecf16fbef04516aa", + "loads": [ + 17, + 4, + 24, + 3, + 23, + 4, + 3, + 4, + 12, + 5, + 1, + 10, + 0, + 3, + 17, + 3, + 4, + 35, + 24, + 6, + 10, + 3, + 5, + 7, + 0, + 0, + 0, + 11, + 5, + 3, + 14, + 4, + 15, + 3, + 8, + 13, + 5, + 7, + 18, + 6, + 6, + 2, + 2, + 7, + 7, + 4, + 18, + 3, + 11, + 27, + 14, + 9, + 11, + 14, + 4, + 3, + 2, + 7, + 20, + 5, + 3, + 4, + 2, + 34 + ], + "weighted_loads": [ + 0.9174536596983671, + 0.18738773837685585, + 1.9077361170202494, + 0.16088296100497246, + 1.473026618361473, + 0.2055363804101944, + 0.0959602240473032, + 0.2057949136942625, + 0.9332843869924545, + 0.2562318444252014, + 0.03981618210673332, + 0.5887583531439304, + 0.0, + 0.12214058637619019, + 1.549781771376729, + 0.08061007224023342, + 0.2478553242981434, + 3.537335930392146, + 1.8797678891569376, + 0.5173033736646175, + 0.669887762516737, + 0.09897114895284176, + 0.30182189121842384, + 0.3703417293727398, + 0.0, + 0.0, + 0.0, + 0.8245086222887039, + 0.3236767649650574, + 0.18256725743412971, + 0.7051310185343027, + 0.3107201661914587, + 2.290403265506029, + 0.13953173533082008, + 0.5754634086042643, + 1.2611204460263252, + 0.18232937902212143, + 0.2770691979676485, + 1.1162909530103207, + 0.1956946738064289, + 0.32174730859696865, + 0.0811658650636673, + 0.05194880813360214, + 0.5339865908026695, + 0.3468456491827965, + 0.2042527236044407, + 2.567571572959423, + 0.15783889219164848, + 0.4048477318137884, + 1.5485431663691998, + 0.6669200882315636, + 0.5219748429954052, + 0.7010198403149843, + 0.7900416906923056, + 0.23484938219189644, + 0.14971277862787247, + 0.2587135136127472, + 0.34902541898190975, + 2.9279936850070953, + 0.5020980536937714, + 0.1124105378985405, + 0.11862059868872166, + 0.06402610242366791, + 1.9522315561771393 + ], + "unique_experts": 60, + "load_cv": 0.9178916861023887, + "normalized_load_entropy": 0.9096711101137902, + "max_load_share": 0.06272401433691756 + } + }, + "s0_period": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "66323a87fbf7e3ed34c7315d224cce2fe78b9e490445a89a5679df6381f292bc", + "route_weight_sha256": "c579b8a0a01f1f94efd250aa5118b5ea17eb3202e0bfc6f2c868fd059a270d16", + "loads": [ + 7, + 0, + 12, + 3, + 20, + 2, + 3, + 1, + 0, + 3, + 0, + 7, + 0, + 2, + 8, + 0, + 4, + 26, + 0, + 5, + 9, + 1, + 4, + 7, + 0, + 0, + 0, + 10, + 4, + 2, + 4, + 2, + 14, + 1, + 3, + 0, + 4, + 2, + 17, + 3, + 1, + 4, + 0, + 0, + 6, + 4, + 1, + 0, + 10, + 12, + 17, + 7, + 1, + 2, + 2, + 2, + 1, + 2, + 18, + 3, + 1, + 0, + 2, + 26 + ], + "weighted_loads": [ + 0.3405430130660534, + 0.0, + 0.7562340348958969, + 0.1595331970602274, + 1.4569382555782795, + 0.150846429169178, + 0.1081036925315857, + 0.10295972973108292, + 0.0, + 0.18041559681296349, + 0.0, + 0.31376703456044197, + 0.0, + 0.07709749788045883, + 0.5713686645030975, + 0.0, + 0.24402080476284027, + 3.0122169945389032, + 0.0, + 0.3717656098306179, + 0.6284441463649273, + 0.03791384771466255, + 0.2915775626897812, + 0.36040340922772884, + 0.0, + 0.0, + 0.0, + 0.7204489558935165, + 0.292843971401453, + 0.13060226291418076, + 0.1733474787324667, + 0.06764443218708038, + 2.2473745569586754, + 0.03497612848877907, + 0.11984254792332649, + 0.0, + 0.16071634367108345, + 0.059130992740392685, + 1.094255231320858, + 0.10390271432697773, + 0.058933135122060776, + 0.14645613357424736, + 0.0, + 0.0, + 0.31775179505348206, + 0.20675673708319664, + 0.10097777098417282, + 0.0, + 0.36814288794994354, + 0.8893715776503086, + 0.8053828775882721, + 0.30898286774754524, + 0.04980137571692467, + 0.10756326466798782, + 0.11455671861767769, + 0.10953820124268532, + 0.03869771212339401, + 0.10735416412353516, + 2.5614267252385616, + 0.3348292540758848, + 0.043692510575056076, + 0.0, + 0.09008992090821266, + 1.717209106311202 + ], + "unique_experts": 50, + "load_cv": 1.2647551236039511, + "normalized_load_entropy": 0.8395229937335815, + "max_load_share": 0.08333333333333333 + }, + "full_input": { + "tokens": 77, + "top_k": 6, + "decisions": 462, + "ordered_route_sha256": "02b2a858f89b60a24dfb3878f325d914d32eb5887034d81837f8a8a26752d371", + "route_weight_sha256": "2be41dd3b339ac08b1db1a23e4676eca141f1b83cf8f882f758498bfab5e3608", + "loads": [ + 15, + 2, + 23, + 3, + 20, + 4, + 3, + 1, + 8, + 3, + 0, + 11, + 0, + 2, + 13, + 4, + 4, + 26, + 20, + 5, + 9, + 3, + 4, + 7, + 0, + 0, + 0, + 11, + 4, + 2, + 11, + 3, + 14, + 1, + 3, + 3, + 4, + 4, + 17, + 6, + 7, + 5, + 3, + 0, + 7, + 4, + 9, + 0, + 12, + 24, + 19, + 10, + 11, + 11, + 2, + 2, + 2, + 3, + 20, + 5, + 1, + 2, + 2, + 28 + ], + "weighted_loads": [ + 0.8117789402604103, + 0.09508519992232323, + 1.7606236580759287, + 0.1595331970602274, + 1.4569382555782795, + 0.1999399047344923, + 0.1081036925315857, + 0.10295972973108292, + 0.47732122987508774, + 0.18041559681296349, + 0.0, + 0.6841160245239735, + 0.0, + 0.07709749788045883, + 1.6750535517930984, + 0.13294760324060917, + 0.24402080476284027, + 3.0122169945389032, + 1.1501295901834965, + 0.3717656098306179, + 0.6284441463649273, + 0.09358656965196133, + 0.2915775626897812, + 0.36040340922772884, + 0.0, + 0.0, + 0.0, + 0.7965784892439842, + 0.292843971401453, + 0.13060226291418076, + 0.497153552249074, + 0.09372685477137566, + 2.2473745569586754, + 0.03497612848877907, + 0.11984254792332649, + 0.17193326354026794, + 0.16071634367108345, + 0.11979249678552151, + 1.094255231320858, + 0.1868573073297739, + 0.36310477182269096, + 0.1762206107378006, + 0.08622693456709385, + 0.0, + 0.35349801182746887, + 0.20675673708319664, + 1.8704045861959457, + 0.0, + 0.47814299911260605, + 1.401689987629652, + 0.8646448608487844, + 0.5165609046816826, + 0.7396561224013567, + 0.7533248737454414, + 0.11455671861767769, + 0.10953820124268532, + 0.26181916147470474, + 0.15823865309357643, + 2.62822319380939, + 0.4144193474203348, + 0.043692510575056076, + 0.05386722646653652, + 0.09008992090821266, + 1.810637203976512 + ], + "unique_experts": 57, + "load_cv": 0.9866996540702956, + "normalized_load_entropy": 0.8908481541813729, + "max_load_share": 0.06060606060606061 + } + }, + "s1_period": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "31dae2eaec1941e84642057eda6e6f3a42c88ac90d1f7f5c9581180fb582d780", + "route_weight_sha256": "d1c5a24781cd095473c137c56e7ef176624a74e8c743ff9b9e0de512330f07a4", + "loads": [ + 7, + 2, + 12, + 2, + 21, + 1, + 1, + 2, + 1, + 3, + 0, + 5, + 0, + 2, + 9, + 0, + 4, + 26, + 1, + 5, + 8, + 1, + 4, + 7, + 0, + 0, + 0, + 10, + 4, + 2, + 5, + 2, + 14, + 3, + 4, + 0, + 4, + 2, + 16, + 3, + 1, + 4, + 0, + 1, + 6, + 4, + 1, + 0, + 8, + 13, + 13, + 5, + 1, + 2, + 2, + 2, + 0, + 2, + 18, + 2, + 5, + 0, + 1, + 28 + ], + "weighted_loads": [ + 0.35145872831344604, + 0.08354666084051132, + 0.7416630890220404, + 0.1333104521036148, + 1.3994276951998472, + 0.11894072592258453, + 0.03601975366473198, + 0.13101525604724884, + 0.045036956667900085, + 0.20544862002134323, + 0.0, + 0.2477799579501152, + 0.0, + 0.08462987467646599, + 0.6098107844591141, + 0.0, + 0.25301552191376686, + 3.0425797924399376, + 0.03431212902069092, + 0.383990291506052, + 0.608750119805336, + 0.035258110612630844, + 0.2595183998346329, + 0.3865368328988552, + 0.0, + 0.0, + 0.0, + 0.7228690013289452, + 0.3025563210248947, + 0.14874321222305298, + 0.19069183431565762, + 0.062364982441067696, + 2.2398057021200657, + 0.09317692741751671, + 0.15588828548789024, + 0.0, + 0.16106940060853958, + 0.05923847109079361, + 1.0721161104738712, + 0.10172986425459385, + 0.054700106382369995, + 0.13269339501857758, + 0.0, + 0.029610522091388702, + 0.30884140357375145, + 0.20857958123087883, + 0.09799114614725113, + 0.0, + 0.3113652225583792, + 0.9362828470766544, + 0.6271674875169992, + 0.25585050135850906, + 0.045499712228775024, + 0.10719499364495277, + 0.11241977661848068, + 0.1156674399971962, + 0.0, + 0.1280692145228386, + 2.5779372714459896, + 0.28965291008353233, + 0.17723800987005234, + 0.0, + 0.03133861720561981, + 1.681363359093666 + ], + "unique_experts": 53, + "load_cv": 1.2569334337206302, + "normalized_load_entropy": 0.8480355980494838, + "max_load_share": 0.08974358974358974 + }, + "full_input": { + "tokens": 93, + "top_k": 6, + "decisions": 558, + "ordered_route_sha256": "26b502b784cc137b4abdf71dcd9d3cef2f45ddc5c641949cea79090a659a3126", + "route_weight_sha256": "ae58620c2672c84ff37aea10195ea4e235d96d1a0b3c5368a0a99ecae864e3b8", + "loads": [ + 14, + 5, + 23, + 2, + 23, + 4, + 2, + 4, + 11, + 6, + 0, + 9, + 0, + 3, + 18, + 3, + 4, + 36, + 23, + 6, + 8, + 3, + 5, + 7, + 0, + 0, + 0, + 11, + 4, + 3, + 12, + 5, + 15, + 4, + 8, + 14, + 4, + 7, + 17, + 6, + 6, + 4, + 2, + 6, + 7, + 4, + 19, + 3, + 11, + 27, + 14, + 10, + 11, + 15, + 4, + 3, + 2, + 8, + 20, + 5, + 5, + 4, + 2, + 37 + ], + "weighted_loads": [ + 0.7407228499650955, + 0.22708478569984436, + 1.7835495434701443, + 0.1333104521036148, + 1.467537272721529, + 0.20722892880439758, + 0.06553247012197971, + 0.20049389265477657, + 0.8930560536682606, + 0.32157447934150696, + 0.0, + 0.6039857566356659, + 0.0, + 0.127659659832716, + 1.7300177030265331, + 0.08004259690642357, + 0.25301552191376686, + 3.634300459176302, + 1.832101022824645, + 0.5185476429760456, + 0.608750119805336, + 0.1003281082957983, + 0.2931300178170204, + 0.3865368328988552, + 0.0, + 0.0, + 0.0, + 0.838196337223053, + 0.3025563210248947, + 0.18603802099823952, + 0.6342513430863619, + 0.3359565455466509, + 2.2954025082290173, + 0.16981784626841545, + 0.5725320130586624, + 1.2845747508108616, + 0.16106940060853958, + 0.27713537216186523, + 1.108776107430458, + 0.19599583558738232, + 0.2828930411487818, + 0.13269339501857758, + 0.05194880813360214, + 0.4854564853012562, + 0.34636883810162544, + 0.20857958123087883, + 2.659012660384178, + 0.15783889219164848, + 0.40691978856921196, + 1.5697434060275555, + 0.6534233540296555, + 0.5810743644833565, + 0.6822656001895666, + 0.8296865876764059, + 0.23406236991286278, + 0.15065272524952888, + 0.2587135136127472, + 0.4303631316870451, + 2.90878015011549, + 0.5113918893039227, + 0.17723800987005234, + 0.1197441853582859, + 0.06334470584988594, + 2.019450504332781 + ], + "unique_experts": 59, + "load_cv": 0.9307892474771753, + "normalized_load_entropy": 0.9083066156984824, + "max_load_share": 0.06630824372759857 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 52, + "ordered_topk_exact_tokens": 36, + "set_exact_tokens": 41, + "mean_set_jaccard": 0.9395604395604397, + "mean_token_weighted_tv": 0.0163158206985547, + "aggregate_load_tv": 0.02884615384615384 + }, + "system_bos": { + "tokens": 52, + "ordered_topk_exact_tokens": 24, + "set_exact_tokens": 35, + "mean_set_jaccard": 0.8983516483516485, + "mean_token_weighted_tv": 0.023670789749863055, + "aggregate_load_tv": 0.04807692307692309 + }, + "system_x": { + "tokens": 52, + "ordered_topk_exact_tokens": 24, + "set_exact_tokens": 34, + "mean_set_jaccard": 0.8846153846153846, + "mean_token_weighted_tv": 0.027513704961165786, + "aggregate_load_tv": 0.05448717948717949 + }, + "system_period": { + "tokens": 52, + "ordered_topk_exact_tokens": 20, + "set_exact_tokens": 28, + "mean_set_jaccard": 0.8566849816849818, + "mean_token_weighted_tv": 0.03190173384232017, + "aggregate_load_tv": 0.060897435897435896 + }, + "bos_at_s0": { + "tokens": 52, + "ordered_topk_exact_tokens": 20, + "set_exact_tokens": 26, + "mean_set_jaccard": 0.8498168498168498, + "mean_token_weighted_tv": 0.031015766193517126, + "aggregate_load_tv": 0.04807692307692307 + }, + "bos_at_s1": { + "tokens": 52, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 23, + "mean_set_jaccard": 0.8324175824175826, + "mean_token_weighted_tv": 0.03470842097885907, + "aggregate_load_tv": 0.05128205128205129 + }, + "x_at_s0": { + "tokens": 52, + "ordered_topk_exact_tokens": 21, + "set_exact_tokens": 26, + "mean_set_jaccard": 0.8530219780219781, + "mean_token_weighted_tv": 0.03025617953748084, + "aggregate_load_tv": 0.044871794871794865 + }, + "x_at_s1": { + "tokens": 52, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 21, + "mean_set_jaccard": 0.804945054945055, + "mean_token_weighted_tv": 0.04062790212293084, + "aggregate_load_tv": 0.05448717948717948 + }, + "period_at_s0": { + "tokens": 52, + "ordered_topk_exact_tokens": 21, + "set_exact_tokens": 27, + "mean_set_jaccard": 0.8543956043956045, + "mean_token_weighted_tv": 0.03151153615460946, + "aggregate_load_tv": 0.05448717948717949 + }, + "period_at_s1": { + "tokens": 52, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 23, + "mean_set_jaccard": 0.8241758241758242, + "mean_token_weighted_tv": 0.03890261817007111, + "aggregate_load_tv": 0.060897435897435896 + } + } + }, + "layer_19": { + "layer": 19, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "06ed18765e52c771868e8dd96c43630006675a1d13697b836da014e5b0c4729f", + "route_weight_sha256": "12f22a9f8af0403f8be2573197bc48228fbc675ac98b03b92252b2b4dc21a880", + "loads": [ + 2, + 6, + 13, + 1, + 3, + 2, + 18, + 5, + 8, + 5, + 1, + 0, + 16, + 3, + 2, + 2, + 16, + 0, + 3, + 3, + 1, + 3, + 14, + 1, + 3, + 8, + 17, + 2, + 1, + 2, + 1, + 2, + 0, + 3, + 0, + 13, + 1, + 21, + 9, + 3, + 6, + 0, + 8, + 2, + 1, + 3, + 2, + 3, + 1, + 9, + 2, + 0, + 2, + 3, + 1, + 2, + 0, + 6, + 23, + 5, + 12, + 4, + 2, + 1 + ], + "weighted_loads": [ + 0.07168446853756905, + 0.2127653732895851, + 1.1232537925243378, + 0.09498220682144165, + 0.1937469057738781, + 0.07825101166963577, + 1.8461135681718588, + 0.462036669254303, + 0.6227833293378353, + 0.22074921429157257, + 0.026184529066085815, + 0.0, + 0.7978390567004681, + 0.09716161899268627, + 0.14053699001669884, + 0.08300920948386192, + 1.3906035348773003, + 0.0, + 0.11327774450182915, + 0.12200316786766052, + 0.10277549922466278, + 0.14538446441292763, + 0.7180704977363348, + 0.03721463680267334, + 0.12970111891627312, + 0.8620359562337399, + 0.7157671693712473, + 0.2282841056585312, + 0.039383601397275925, + 0.0666284766048193, + 0.08389299362897873, + 0.1989816129207611, + 0.0, + 0.19422420859336853, + 0.0, + 1.0959673933684826, + 0.06920260936021805, + 1.2475874498486519, + 0.7263928912580013, + 0.22723181545734406, + 0.29089489951729774, + 0.0, + 0.30156428553164005, + 0.05724184028804302, + 0.08396697789430618, + 0.17512653023004532, + 0.11262194812297821, + 0.22781886160373688, + 0.06369323283433914, + 0.8590860329568386, + 0.06907619908452034, + 0.0, + 0.10462390258908272, + 0.1049285288900137, + 0.05296914651989937, + 0.09674080088734627, + 0.0, + 0.41480155661702156, + 4.086353078484535, + 0.1963188201189041, + 0.821008512750268, + 0.22546431794762611, + 0.23991919308900833, + 0.03326743096113205 + ], + "unique_experts": 57, + "load_cv": 1.1372018903352146, + "normalized_load_entropy": 0.8691051135229484, + "max_load_share": 0.07371794871794872 + }, + "full_input": { + "tokens": 77, + "top_k": 6, + "decisions": 462, + "ordered_route_sha256": "d062ac6966f301d1a93d0c1df0137aabdc4848855a73452de4c98196eca86964", + "route_weight_sha256": "2acbae6180c02fa4037d343301637f390d7683a3e8ef5e4b5c161d2046811c67", + "loads": [ + 4, + 8, + 14, + 1, + 8, + 3, + 27, + 5, + 8, + 8, + 1, + 0, + 24, + 5, + 7, + 2, + 19, + 1, + 3, + 10, + 1, + 3, + 19, + 10, + 12, + 9, + 17, + 4, + 2, + 7, + 7, + 2, + 0, + 3, + 0, + 14, + 3, + 28, + 10, + 3, + 9, + 3, + 16, + 3, + 2, + 3, + 2, + 8, + 2, + 9, + 3, + 0, + 2, + 6, + 8, + 3, + 0, + 6, + 30, + 5, + 13, + 8, + 8, + 1 + ], + "weighted_loads": [ + 0.11530353128910065, + 0.3698517233133316, + 1.147708062082529, + 0.09498220682144165, + 0.8878474067896605, + 0.09147063456475735, + 2.2290640752762556, + 0.462036669254303, + 0.6227833293378353, + 0.4054616652429104, + 0.026184529066085815, + 0.0, + 1.319950107485056, + 0.19629423506557941, + 0.6432385966181755, + 0.08300920948386192, + 1.5040538664907217, + 0.04706785827875137, + 0.11327774450182915, + 0.527992807328701, + 0.10277549922466278, + 0.14538446441292763, + 0.8988422844558954, + 0.3498052731156349, + 0.6230765045620501, + 1.0710903368890285, + 0.7157671693712473, + 0.3541162684559822, + 0.07493786886334419, + 0.2600154932588339, + 0.3523016441613436, + 0.1989816129207611, + 0.0, + 0.19422420859336853, + 0.0, + 1.1555161625146866, + 0.1123507940210402, + 1.541837990283966, + 0.768381904810667, + 0.22723181545734406, + 0.35671160090714693, + 0.1786365732550621, + 0.898717088624835, + 0.1139476578682661, + 0.09468060731887817, + 0.17512653023004532, + 0.11262194812297821, + 0.6334586292505264, + 0.10128938034176826, + 0.8590860329568386, + 0.1138969138264656, + 0.0, + 0.10462390258908272, + 0.34542044810950756, + 1.8224438149482012, + 0.1449197456240654, + 0.0, + 0.41480155661702156, + 4.379086660221219, + 0.1963188201189041, + 0.8509255424141884, + 0.457105316221714, + 0.7449691891670227, + 0.03326743096113205 + ], + "unique_experts": 59, + "load_cv": 0.9701510223300654, + "normalized_load_entropy": 0.8990918166283841, + "max_load_share": 0.06493506493506493 + } + }, + "s1_eos": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "a32026afca34cfbe12977fb113199d7c6352c359136632168100788df8205a63", + "route_weight_sha256": "5ae2b4ff868f34d60fe2ee00b7499bcf78e46a47096b1adea7d9cfbd81879928", + "loads": [ + 2, + 7, + 12, + 1, + 3, + 2, + 17, + 5, + 8, + 5, + 2, + 0, + 16, + 3, + 2, + 2, + 17, + 0, + 3, + 3, + 1, + 3, + 14, + 2, + 4, + 8, + 16, + 2, + 1, + 2, + 1, + 2, + 0, + 3, + 0, + 12, + 1, + 20, + 9, + 3, + 6, + 0, + 8, + 2, + 1, + 4, + 3, + 3, + 1, + 9, + 2, + 0, + 2, + 3, + 1, + 1, + 0, + 6, + 23, + 4, + 12, + 4, + 2, + 1 + ], + "weighted_loads": [ + 0.0718354657292366, + 0.23366623371839523, + 1.0578691679984331, + 0.09793388098478317, + 0.1963711716234684, + 0.07394525036215782, + 1.7838975377380848, + 0.46381330117583275, + 0.6304008476436138, + 0.2087322287261486, + 0.059243110939860344, + 0.0, + 0.7660033013671637, + 0.10027063079178333, + 0.14522018656134605, + 0.08559168502688408, + 1.4228409063071012, + 0.0, + 0.1078738160431385, + 0.12131035327911377, + 0.10398516803979874, + 0.1473951656371355, + 0.6981871295720339, + 0.08335672691464424, + 0.155911386013031, + 0.8618280291557312, + 0.6930294036865234, + 0.21940283104777336, + 0.03902916610240936, + 0.062356144189834595, + 0.08015680313110352, + 0.20282193273305893, + 0.0, + 0.2014436088502407, + 0.0, + 1.0562718659639359, + 0.07290911674499512, + 1.2273368518799543, + 0.7255840376019478, + 0.22827525436878204, + 0.28871314227581024, + 0.0, + 0.29595437087118626, + 0.05896235257387161, + 0.08616304397583008, + 0.2026173397898674, + 0.1509883962571621, + 0.2308371141552925, + 0.06204045191407204, + 0.8584353663027287, + 0.06822668388485909, + 0.0, + 0.1071077398955822, + 0.1102671530097723, + 0.052434321492910385, + 0.047803062945604324, + 0.0, + 0.42868561297655106, + 4.083686670288444, + 0.16752899810671806, + 0.8267188090831041, + 0.22693181037902832, + 0.2258020117878914, + 0.03097083419561386 + ], + "unique_experts": 57, + "load_cv": 1.1079178307932462, + "normalized_load_entropy": 0.8743225477570281, + "max_load_share": 0.07371794871794872 + }, + "full_input": { + "tokens": 93, + "top_k": 6, + "decisions": 558, + "ordered_route_sha256": "df866fb54cb9ebf7fa8a633c570c2c68b10fcfa4bb42a9df55cdfa9216c73cae", + "route_weight_sha256": "bd4e2dabcd15d832074463a3389f99f8fab2b661a5737cc376e15887e765092c", + "loads": [ + 4, + 12, + 14, + 1, + 15, + 4, + 30, + 6, + 8, + 10, + 3, + 7, + 28, + 4, + 13, + 4, + 20, + 5, + 4, + 13, + 4, + 4, + 20, + 8, + 15, + 9, + 16, + 4, + 3, + 3, + 7, + 3, + 3, + 3, + 0, + 12, + 4, + 25, + 10, + 5, + 10, + 8, + 17, + 3, + 2, + 4, + 3, + 15, + 2, + 10, + 8, + 0, + 5, + 12, + 7, + 2, + 2, + 8, + 32, + 6, + 13, + 12, + 11, + 3 + ], + "weighted_loads": [ + 0.09756927192211151, + 0.5494314506649971, + 1.117254702374339, + 0.09793388098478317, + 1.547180762514472, + 0.1623613927513361, + 2.380795981734991, + 0.4965510591864586, + 0.6304008476436138, + 0.45993828028440475, + 0.1260381918400526, + 0.7217902317643166, + 1.406073410063982, + 0.15756168402731419, + 1.0465650763362646, + 0.19388547539710999, + 1.8149699922651052, + 0.2264703344553709, + 0.20572838559746742, + 0.6568042784929276, + 0.40786583721637726, + 0.20241637341678143, + 0.9392297156155109, + 0.28038659133017063, + 0.8796166954562068, + 1.0808199048042297, + 0.6930294036865234, + 0.35193393006920815, + 0.1166641041636467, + 0.0986410602927208, + 0.3591461069881916, + 0.24325479194521904, + 0.12169552408158779, + 0.2014436088502407, + 0.0, + 1.0562718659639359, + 0.1569036296568811, + 1.4303102642297745, + 0.7724301032721996, + 0.33195347897708416, + 0.38944394001737237, + 0.401138536632061, + 1.042751619592309, + 0.09712076187133789, + 0.09687667340040207, + 0.2026173397898674, + 0.1509883962571621, + 1.0589859336614609, + 0.09540082886815071, + 0.9043157659471035, + 0.46099335327744484, + 0.0, + 0.2526911459863186, + 0.9090152066200972, + 1.7958520501852036, + 0.08759095519781113, + 0.08130139857530594, + 0.5171647258102894, + 4.544163776561618, + 0.23290646821260452, + 0.8679542671889067, + 0.6016859784722328, + 0.9596542418003082, + 0.19457347318530083 + ], + "unique_experts": 62, + "load_cv": 0.8161897116197868, + "normalized_load_entropy": 0.9278438278949406, + "max_load_share": 0.05734767025089606 + } + }, + "s0_bos": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "ddf2410b389c6bcefc1a6ec4f5c419ff11fe770172c46f7be9076c6781fc4307", + "route_weight_sha256": "267a5db5d8cc63b04e10552800e60146722325b32a06e68f495a9f12117b6199", + "loads": [ + 1, + 7, + 12, + 2, + 4, + 2, + 17, + 5, + 8, + 5, + 1, + 0, + 16, + 4, + 2, + 3, + 17, + 0, + 3, + 3, + 1, + 3, + 15, + 1, + 5, + 8, + 17, + 2, + 1, + 3, + 1, + 2, + 0, + 3, + 0, + 11, + 1, + 18, + 9, + 2, + 6, + 0, + 9, + 2, + 1, + 4, + 2, + 3, + 1, + 9, + 3, + 0, + 1, + 3, + 1, + 2, + 0, + 6, + 22, + 5, + 10, + 4, + 2, + 1 + ], + "weighted_loads": [ + 0.036096930503845215, + 0.24478626251220703, + 1.1122447960078716, + 0.12078901752829552, + 0.22418317943811417, + 0.07778595387935638, + 1.8443933837115765, + 0.4635995924472809, + 0.6159574240446091, + 0.22630166076123714, + 0.034079018980264664, + 0.0, + 0.7720746099948883, + 0.14354982040822506, + 0.14212283492088318, + 0.13844073936343193, + 1.4311639815568924, + 0.0, + 0.11110144481062889, + 0.12513066083192825, + 0.10893533378839493, + 0.15557296574115753, + 0.765177933499217, + 0.038200851529836655, + 0.19326965138316154, + 0.8357748948037624, + 0.748882994055748, + 0.23010049015283585, + 0.04014754667878151, + 0.09210296906530857, + 0.08747757971286774, + 0.20524869114160538, + 0.0, + 0.20268473029136658, + 0.0, + 1.024440761655569, + 0.06529827415943146, + 1.137703537940979, + 0.7063720785081387, + 0.1815810203552246, + 0.28903526812791824, + 0.0, + 0.3326175343245268, + 0.05814296565949917, + 0.07734709978103638, + 0.2145102247595787, + 0.11093681305646896, + 0.23168983682990074, + 0.06844118982553482, + 0.866682805120945, + 0.09239248558878899, + 0.0, + 0.07099462300539017, + 0.11682256311178207, + 0.06260986626148224, + 0.10761062800884247, + 0.0, + 0.421468798071146, + 4.107065439224243, + 0.19313672184944153, + 0.7623259201645851, + 0.21640731394290924, + 0.30832427740097046, + 0.032229408621788025 + ], + "unique_experts": 57, + "load_cv": 1.0845274862849539, + "normalized_load_entropy": 0.8766192548768101, + "max_load_share": 0.07051282051282051 + }, + "full_input": { + "tokens": 77, + "top_k": 6, + "decisions": 462, + "ordered_route_sha256": "cad8d007eab184b6757f4acae57a703f82ec6c036c08d3ba1aa1b59d794f4f95", + "route_weight_sha256": "9b41d5f73a39e6f3abb2693954b6e96c4966722528d0190a4dedc559bf064f54", + "loads": [ + 3, + 9, + 14, + 2, + 8, + 3, + 25, + 5, + 8, + 8, + 1, + 0, + 24, + 8, + 7, + 3, + 20, + 1, + 3, + 11, + 1, + 3, + 20, + 7, + 12, + 9, + 18, + 4, + 1, + 8, + 10, + 2, + 0, + 3, + 0, + 13, + 1, + 24, + 10, + 2, + 8, + 4, + 17, + 3, + 2, + 5, + 2, + 8, + 3, + 9, + 4, + 1, + 1, + 6, + 7, + 3, + 0, + 6, + 29, + 5, + 11, + 8, + 8, + 1 + ], + "weighted_loads": [ + 0.10648008063435555, + 0.39273345470428467, + 1.1769450977444649, + 0.12078901752829552, + 0.791562968865037, + 0.09100557677447796, + 2.1887531504034996, + 0.4635995924472809, + 0.6159574240446091, + 0.4271030221134424, + 0.034079018980264664, + 0.0, + 1.3087626360356808, + 0.32667618058621883, + 0.6524911858141422, + 0.13844073936343193, + 1.5446143131703138, + 0.7306824326515198, + 0.11110144481062889, + 0.7551455199718475, + 0.10893533378839493, + 0.15557296574115753, + 0.9459497202187777, + 0.26477022282779217, + 0.7072900217026472, + 1.0335390828549862, + 0.7824736759066582, + 0.3424665406346321, + 0.04014754667878151, + 0.28548998571932316, + 0.4751916918903589, + 0.20524869114160538, + 0.0, + 0.20268473029136658, + 0.0, + 1.103692291304469, + 0.06529827415943146, + 1.4036377370357513, + 0.7483610920608044, + 0.1815810203552246, + 0.35026735812425613, + 0.19708480685949326, + 0.9297703374177217, + 0.11484878323972225, + 0.08806072920560837, + 0.24110211618244648, + 0.11093681305646896, + 0.653812151402235, + 0.14191726967692375, + 0.866682805120945, + 0.12742076069116592, + 0.016027705743908882, + 0.07099462300539017, + 0.3153506740927696, + 0.8883604984730482, + 0.16397136449813843, + 0.0, + 0.421468798071146, + 4.399799020960927, + 0.19313672184944153, + 0.7969307377934456, + 0.44481201097369194, + 0.8133742734789848, + 0.032229408621788025 + ], + "unique_experts": 60, + "load_cv": 0.9352152356357328, + "normalized_load_entropy": 0.9036328215220686, + "max_load_share": 0.06277056277056277 + } + }, + "s1_bos": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "e35d70b804b906b96eea35cf9457d75ff6bfaee4bf35b49cf91836e34f3a7f4b", + "route_weight_sha256": "7245b26847e4291b2d67aa49472c9fb7603378727e06ba8d562189e9e730da05", + "loads": [ + 2, + 6, + 12, + 1, + 4, + 2, + 17, + 5, + 7, + 7, + 1, + 0, + 16, + 4, + 2, + 3, + 17, + 0, + 3, + 3, + 1, + 2, + 14, + 1, + 4, + 8, + 19, + 1, + 1, + 2, + 1, + 2, + 0, + 3, + 0, + 13, + 1, + 19, + 9, + 3, + 5, + 0, + 10, + 1, + 1, + 4, + 2, + 3, + 1, + 9, + 2, + 0, + 2, + 4, + 1, + 1, + 0, + 6, + 23, + 4, + 11, + 4, + 2, + 0 + ], + "weighted_loads": [ + 0.07046417146921158, + 0.20656260289251804, + 1.1710288831964135, + 0.09477991610765457, + 0.22393545508384705, + 0.07718299329280853, + 1.8115332834422588, + 0.45088980346918106, + 0.5739591047167778, + 0.2749865874648094, + 0.029318420216441154, + 0.0, + 0.7524377498775721, + 0.1442390214651823, + 0.1412334181368351, + 0.12808336317539215, + 1.4904123190790415, + 0.0, + 0.1102188229560852, + 0.12782175093889236, + 0.10539808124303818, + 0.12026561424136162, + 0.725985798984766, + 0.043934229761362076, + 0.1620892658829689, + 0.8511309176683426, + 0.7973568607121706, + 0.18818607926368713, + 0.04185820743441582, + 0.07788410410284996, + 0.08284232765436172, + 0.2146207019686699, + 0.0, + 0.20612799003720284, + 0.0, + 1.0993695091456175, + 0.07841295003890991, + 1.164702907204628, + 0.7029552273452282, + 0.21495425328612328, + 0.2566033862531185, + 0.0, + 0.3441771324723959, + 0.025764990597963333, + 0.08425823599100113, + 0.21054991334676743, + 0.10680248215794563, + 0.23573803901672363, + 0.06637834012508392, + 0.8653252497315407, + 0.06210308335721493, + 0.0, + 0.10577571392059326, + 0.15423395112156868, + 0.060284990817308426, + 0.05717262253165245, + 0.0, + 0.42973731830716133, + 4.117683647200465, + 0.15653870813548565, + 0.7667292393743992, + 0.21356556937098503, + 0.29453639686107635, + 0.0 + ], + "unique_experts": 56, + "load_cv": 1.1348869731451656, + "normalized_load_entropy": 0.866334159332205, + "max_load_share": 0.07371794871794872 + }, + "full_input": { + "tokens": 93, + "top_k": 6, + "decisions": 558, + "ordered_route_sha256": "043f499aac22adba30ce80915760f7a9679e66b028ad0714c7f5aff0839e92e4", + "route_weight_sha256": "bbd364697c6b6ebe34e1e9a29ed026bc44432edc3c755c31b53f74104fd256a4", + "loads": [ + 3, + 11, + 15, + 1, + 17, + 4, + 28, + 5, + 7, + 14, + 2, + 7, + 29, + 7, + 13, + 5, + 20, + 5, + 4, + 13, + 4, + 3, + 20, + 5, + 14, + 9, + 19, + 3, + 2, + 3, + 8, + 3, + 2, + 3, + 0, + 14, + 4, + 24, + 10, + 6, + 8, + 8, + 18, + 3, + 2, + 4, + 2, + 14, + 2, + 10, + 8, + 0, + 5, + 13, + 6, + 2, + 2, + 8, + 32, + 6, + 14, + 12, + 11, + 2 + ], + "weighted_loads": [ + 0.09184000641107559, + 0.5184830110520124, + 1.2723153280094266, + 0.09477991610765457, + 1.6952204965054989, + 0.1655991356819868, + 2.32888063788414, + 0.45088980346918106, + 0.5739591047167778, + 0.6317172423005104, + 0.09611350111663342, + 0.7217902317643166, + 1.4448150806128979, + 0.2775487955659628, + 1.0261292662471533, + 0.23637715354561806, + 1.8825414050370455, + 0.2264703344553709, + 0.20807339251041412, + 0.8809969089925289, + 0.4092787504196167, + 0.17528682202100754, + 0.9670283850282431, + 0.19117645733058453, + 0.939542418345809, + 1.0505701899528503, + 0.7973568607121706, + 0.30029795691370964, + 0.07851864397525787, + 0.11416902020573616, + 0.38635796308517456, + 0.25505356118083, + 0.08596224151551723, + 0.20612799003720284, + 0.0, + 1.162682307884097, + 0.19454341009259224, + 1.3611506894230843, + 0.74980129301548, + 0.3628497924655676, + 0.3459217697381973, + 0.40083663910627365, + 1.0492421071976423, + 0.09856601059436798, + 0.09497186541557312, + 0.21054991334676743, + 0.10680248215794563, + 1.0197505876421928, + 0.0997387170791626, + 0.9112056493759155, + 0.44332911632955074, + 0.0, + 0.25135912001132965, + 0.910984244197607, + 0.8622377589344978, + 0.10908075422048569, + 0.08130139857530594, + 0.5182164311408997, + 4.5781607534736395, + 0.2219161782413721, + 0.8781156577169895, + 0.5844217613339424, + 1.0283886268734932, + 0.16360263898968697 + ], + "unique_experts": 62, + "load_cv": 0.8351100649282364, + "normalized_load_entropy": 0.9227160878585253, + "max_load_share": 0.05734767025089606 + } + }, + "s0_x": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "19650e426dd7f1587f53cc603a86470c55179ef6d960e684efda17bfa2c4c292", + "route_weight_sha256": "eeeb922259d33e0ea274d12a022bd36e8d5cf0f66091afd50e9627414a1fbc0b", + "loads": [ + 1, + 6, + 12, + 1, + 4, + 2, + 17, + 5, + 8, + 5, + 1, + 0, + 16, + 4, + 2, + 2, + 17, + 0, + 3, + 3, + 1, + 3, + 16, + 1, + 4, + 8, + 20, + 3, + 1, + 2, + 1, + 2, + 0, + 3, + 0, + 10, + 1, + 19, + 9, + 2, + 5, + 0, + 9, + 4, + 1, + 3, + 1, + 3, + 1, + 9, + 2, + 0, + 1, + 4, + 1, + 2, + 0, + 6, + 23, + 3, + 12, + 4, + 2, + 1 + ], + "weighted_loads": [ + 0.034137435257434845, + 0.21720990352332592, + 1.1310105938464403, + 0.10309915989637375, + 0.23358860611915588, + 0.07919720560312271, + 1.8024864792823792, + 0.44246170297265053, + 0.6112034097313881, + 0.20819519646465778, + 0.025627415627241135, + 0.0, + 0.7747882660478354, + 0.1491604559123516, + 0.14414162188768387, + 0.0929415114223957, + 1.4596529752016068, + 0.0, + 0.11771117150783539, + 0.1337488777935505, + 0.10344887524843216, + 0.15711470693349838, + 0.7738483417779207, + 0.03264840692281723, + 0.1581366453319788, + 0.8466580137610435, + 0.8274980131536722, + 0.2519520875066519, + 0.04100607708096504, + 0.06688358820974827, + 0.08357077091932297, + 0.19907744973897934, + 0.0, + 0.19243117794394493, + 0.0, + 0.9903750047087669, + 0.07766532897949219, + 1.1961960177868605, + 0.7012676298618317, + 0.1834683120250702, + 0.2452644668519497, + 0.0, + 0.30825584102422, + 0.12688096053898335, + 0.07969912141561508, + 0.16521493718028069, + 0.06805896013975143, + 0.2306554578244686, + 0.06545047461986542, + 0.8521541319787502, + 0.0712197944521904, + 0.0, + 0.07142668962478638, + 0.15355291590094566, + 0.0626557320356369, + 0.10082413256168365, + 0.0, + 0.40583350136876106, + 4.080852534621954, + 0.1297383289784193, + 0.8286838047206402, + 0.21880880743265152, + 0.2884151116013527, + 0.033816367387771606 + ], + "unique_experts": 57, + "load_cv": 1.1418176450365292, + "normalized_load_entropy": 0.8675997428342027, + "max_load_share": 0.07371794871794872 + }, + "full_input": { + "tokens": 77, + "top_k": 6, + "decisions": 462, + "ordered_route_sha256": "173bafd3e1dd91cdc9f3b4325f24e81d4ac84204f7dfb511ae300c38623e1b8a", + "route_weight_sha256": "0948325bedeef5f99128fde005bb9ff8dbe46f96b5af0bd0f24fa36a7761b8e7", + "loads": [ + 2, + 8, + 14, + 1, + 10, + 4, + 26, + 5, + 8, + 8, + 1, + 0, + 27, + 6, + 8, + 2, + 20, + 0, + 3, + 9, + 1, + 3, + 22, + 8, + 11, + 9, + 20, + 5, + 1, + 7, + 8, + 2, + 0, + 3, + 0, + 11, + 1, + 25, + 10, + 2, + 8, + 3, + 18, + 5, + 2, + 3, + 1, + 9, + 2, + 9, + 3, + 0, + 1, + 7, + 7, + 3, + 0, + 6, + 31, + 3, + 12, + 8, + 9, + 1 + ], + "weighted_loads": [ + 0.07331161573529243, + 0.36153885163366795, + 1.1923503894358873, + 0.10309915989637375, + 0.9634351339191198, + 0.17873878590762615, + 2.202399153262377, + 0.44246170297265053, + 0.6112034097313881, + 0.4041776042431593, + 0.025627415627241135, + 0.0, + 1.5123979523777962, + 0.24405338242650032, + 0.6788315773010254, + 0.0929415114223957, + 1.5731033068150282, + 0.0, + 0.11771117150783539, + 0.4663376584649086, + 0.10344887524843216, + 0.15711470693349838, + 1.0040569212287664, + 0.29304282553493977, + 0.5763777010142803, + 1.0694079175591469, + 0.8274980131536722, + 0.369442505761981, + 0.04100607708096504, + 0.26027060486376286, + 0.3855698350816965, + 0.19907744973897934, + 0.0, + 0.19243117794394493, + 0.0, + 1.049923773854971, + 0.07766532897949219, + 1.4258796703070402, + 0.7432566434144974, + 0.1834683120250702, + 0.3540256395936012, + 0.16553178429603577, + 1.0472480589523911, + 0.18358677811920643, + 0.09041275084018707, + 0.16521493718028069, + 0.06805896013975143, + 0.7397969774901867, + 0.10304662212729454, + 0.8521541319787502, + 0.10739141702651978, + 0.0, + 0.07142668962478638, + 0.3577551431953907, + 0.8884063642472029, + 0.14091473072767258, + 0.0, + 0.40583350136876106, + 4.420672131702304, + 0.1297383289784193, + 0.8286838047206402, + 0.4505719617009163, + 0.8415149264037609, + 0.033816367387771606 + ], + "unique_experts": 58, + "load_cv": 1.0062584094465798, + "normalized_load_entropy": 0.8899125814587608, + "max_load_share": 0.0670995670995671 + } + }, + "s1_x": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "fe97bed4039fc5c8fb59e827bee204d801e948416987d0bc832cc2b7fed55ea0", + "route_weight_sha256": "bca20aadae87eaefb856e0e0b5e449bd9203ef01af48b3f47350af428f5963ce", + "loads": [ + 2, + 8, + 13, + 1, + 4, + 2, + 17, + 5, + 8, + 7, + 2, + 0, + 16, + 4, + 2, + 1, + 17, + 0, + 3, + 3, + 1, + 3, + 14, + 2, + 4, + 8, + 18, + 3, + 1, + 1, + 1, + 2, + 0, + 3, + 0, + 12, + 1, + 21, + 9, + 2, + 6, + 0, + 9, + 4, + 1, + 2, + 2, + 3, + 1, + 9, + 1, + 0, + 1, + 4, + 1, + 1, + 0, + 6, + 21, + 2, + 11, + 4, + 2, + 0 + ], + "weighted_loads": [ + 0.07838613167405128, + 0.27120258659124374, + 1.18897058442235, + 0.1324860155582428, + 0.2387520596385002, + 0.08331620693206787, + 1.8090920969843864, + 0.44295406714081764, + 0.5987705774605274, + 0.24780912324786186, + 0.05549164116382599, + 0.0, + 0.7455158662050962, + 0.14670225977897644, + 0.1333979293704033, + 0.05831135809421539, + 1.4867556244134903, + 0.0, + 0.11306508257985115, + 0.13160806894302368, + 0.10339374840259552, + 0.15669245272874832, + 0.71526207216084, + 0.0758536346256733, + 0.15753034874796867, + 0.8463657982647419, + 0.7827214915305376, + 0.24345200695097446, + 0.04496331512928009, + 0.04468526318669319, + 0.07201333343982697, + 0.22071658819913864, + 0.0, + 0.1939350813627243, + 0.0, + 1.0755017939954996, + 0.07770805060863495, + 1.2883832063525915, + 0.725921306759119, + 0.18199703097343445, + 0.27706882543861866, + 0.0, + 0.31937807612121105, + 0.12658669613301754, + 0.0791625902056694, + 0.14342929050326347, + 0.09324894845485687, + 0.2254115417599678, + 0.06546442210674286, + 0.8357886783778667, + 0.03621367737650871, + 0.0, + 0.070001520216465, + 0.17467958107590675, + 0.06682021915912628, + 0.041586268693208694, + 0.0, + 0.41929200291633606, + 3.9766553826630116, + 0.10689066350460052, + 0.7664682921022177, + 0.2028547152876854, + 0.307912714779377, + 0.0 + ], + "unique_experts": 56, + "load_cv": 1.1284964658802763, + "normalized_load_entropy": 0.8662691323996359, + "max_load_share": 0.0673076923076923 + }, + "full_input": { + "tokens": 93, + "top_k": 6, + "decisions": 558, + "ordered_route_sha256": "aaf19f7bf6baa36e43519af4b3a8700a55ee4e144df2a41c4af06ac328e11ee6", + "route_weight_sha256": "0cf71f085d912383ddf16db64f833e1dec3836b50911bc5114d681e3bbfd355b", + "loads": [ + 3, + 14, + 15, + 1, + 16, + 5, + 29, + 6, + 8, + 12, + 3, + 7, + 31, + 5, + 14, + 3, + 20, + 6, + 4, + 11, + 4, + 4, + 21, + 6, + 13, + 9, + 18, + 5, + 2, + 2, + 7, + 3, + 4, + 3, + 0, + 12, + 3, + 24, + 10, + 5, + 8, + 8, + 19, + 6, + 2, + 2, + 2, + 15, + 2, + 10, + 7, + 0, + 4, + 13, + 6, + 2, + 2, + 8, + 31, + 4, + 12, + 13, + 12, + 2 + ], + "weighted_loads": [ + 0.0997619666159153, + 0.6284478195011616, + 1.248356118798256, + 0.1324860155582428, + 1.6157301757484674, + 0.21432259865105152, + 2.3588318675756454, + 0.48946043103933334, + 0.5987705774605274, + 0.47217826917767525, + 0.12228672206401825, + 0.7217902317643166, + 1.6036905720829964, + 0.19451629742980003, + 1.0038311462849379, + 0.1666051484644413, + 1.8788847103714943, + 0.2593350913375616, + 0.21091965213418007, + 0.5376969985663891, + 0.40727441757917404, + 0.21171366050839424, + 0.9906584732234478, + 0.22309586219489574, + 0.7892545890063047, + 1.0555916614830494, + 0.7827214915305376, + 0.3587705213576555, + 0.08162375167012215, + 0.08097017928957939, + 0.3296777382493019, + 0.26114944741129875, + 0.18219059146940708, + 0.1939350813627243, + 0.0, + 1.0755017939954996, + 0.1577770933508873, + 1.3915394246578217, + 0.7727673724293709, + 0.3197163213044405, + 0.32968352548778057, + 0.3791927546262741, + 1.264523634687066, + 0.20623288862407207, + 0.0898762196302414, + 0.14342929050326347, + 0.09324894845485687, + 1.0607584677636623, + 0.09882479906082153, + 0.8816690780222416, + 0.4194909930229187, + 0.0, + 0.21558492630720139, + 0.9074838533997536, + 0.8687729872763157, + 0.07617967203259468, + 0.08130139857530594, + 0.5077711157500744, + 4.468918051570654, + 0.17226813361048698, + 0.8077037502080202, + 0.6275435015559196, + 1.1295736134052277, + 0.16360263898968697 + ], + "unique_experts": 62, + "load_cv": 0.8424616625440375, + "normalized_load_entropy": 0.9223511399593503, + "max_load_share": 0.05555555555555555 + } + }, + "s0_period": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "59bd9eead258a4e2055d8eeca8ae2b706a227e02628ec5be4939463b111f3a7c", + "route_weight_sha256": "b42f071145c2d0b78e22657751ba53e0b651faee6c81476e0669dd4b3105544f", + "loads": [ + 2, + 7, + 14, + 1, + 3, + 2, + 17, + 5, + 8, + 4, + 2, + 0, + 17, + 4, + 2, + 1, + 17, + 0, + 3, + 3, + 1, + 3, + 16, + 1, + 5, + 8, + 18, + 3, + 1, + 2, + 1, + 2, + 0, + 3, + 0, + 10, + 1, + 17, + 9, + 2, + 6, + 0, + 8, + 2, + 1, + 4, + 1, + 3, + 1, + 9, + 2, + 0, + 1, + 3, + 1, + 2, + 0, + 6, + 23, + 3, + 14, + 4, + 2, + 1 + ], + "weighted_loads": [ + 0.06866714358329773, + 0.2603623252362013, + 1.223301517777145, + 0.10257275402545929, + 0.2110922858119011, + 0.08286509290337563, + 1.8556674271821976, + 0.4309307672083378, + 0.6071357987821102, + 0.1900421567261219, + 0.05676272511482239, + 0.0, + 0.7983956541866064, + 0.14446254447102547, + 0.14171043410897255, + 0.06183449923992157, + 1.446374949067831, + 0.0, + 0.1163693442940712, + 0.12502504140138626, + 0.10402782261371613, + 0.15338994935154915, + 0.7826291732490063, + 0.035125818103551865, + 0.19128102995455265, + 0.8446245864033699, + 0.7742839772254229, + 0.24620139598846436, + 0.04229215905070305, + 0.06624398566782475, + 0.08041609823703766, + 0.20614050328731537, + 0.0, + 0.18704749271273613, + 0.0, + 0.9873490855097771, + 0.08342856913805008, + 1.1586220264434814, + 0.7105441391468048, + 0.18669866770505905, + 0.26978001929819584, + 0.0, + 0.2970719411969185, + 0.05650991201400757, + 0.0819450318813324, + 0.20168258249759674, + 0.06933650374412537, + 0.22571704536676407, + 0.06351016461849213, + 0.8461802266538143, + 0.06844010762870312, + 0.0, + 0.06995601207017899, + 0.11883175000548363, + 0.06076052039861679, + 0.10676959902048111, + 0.0, + 0.4055298212915659, + 4.129084385931492, + 0.13426782004535198, + 0.8938822224736214, + 0.21906787902116776, + 0.3496587872505188, + 0.037127189338207245 + ], + "unique_experts": 57, + "load_cv": 1.136045021378242, + "normalized_load_entropy": 0.8677506796692711, + "max_load_share": 0.07371794871794872 + }, + "full_input": { + "tokens": 77, + "top_k": 6, + "decisions": 462, + "ordered_route_sha256": "25e2c7cf0c7d8850df11cef5fe99817c558a607290a87435b5497d0ecbb7311c", + "route_weight_sha256": "9fbe1f4884fb25ff2697a6fec80842832ea6e3842d5a0ff92439f0da2b39f799", + "loads": [ + 3, + 9, + 16, + 1, + 9, + 4, + 25, + 5, + 8, + 7, + 2, + 0, + 26, + 6, + 8, + 1, + 21, + 0, + 3, + 10, + 1, + 3, + 21, + 8, + 11, + 9, + 18, + 5, + 1, + 7, + 8, + 2, + 0, + 3, + 1, + 11, + 2, + 24, + 10, + 2, + 9, + 3, + 16, + 3, + 2, + 4, + 1, + 10, + 2, + 9, + 3, + 0, + 1, + 5, + 7, + 3, + 0, + 6, + 30, + 3, + 15, + 9, + 9, + 1 + ], + "weighted_loads": [ + 0.10784132406115532, + 0.41254247538745403, + 1.280090275220573, + 0.10257275402545929, + 1.0353747252374887, + 0.16943254508078098, + 2.2000271938741207, + 0.4309307672083378, + 0.6071357987821102, + 0.39125294983386993, + 0.05676272511482239, + 0.0, + 1.410387335345149, + 0.238839752972126, + 0.71216094866395, + 0.06183449923992157, + 1.5881767459213734, + 0.0, + 0.1163693442940712, + 0.504710253328085, + 0.10402782261371613, + 0.15338994935154915, + 0.9634009599685669, + 0.29227589070796967, + 0.5505653843283653, + 1.0653986856341362, + 0.7742839772254229, + 0.35680609196424484, + 0.04229215905070305, + 0.25963100232183933, + 0.38387238420546055, + 0.20614050328731537, + 0.0, + 0.18704749271273613, + 0.06594666093587875, + 1.046897854655981, + 0.1410522423684597, + 1.416244726628065, + 0.7525331526994705, + 0.18669866770505905, + 0.3749947901815176, + 0.16658369079232216, + 0.8942247442901134, + 0.11321572959423065, + 0.09265866130590439, + 0.20168258249759674, + 0.06933650374412537, + 0.8086403124034405, + 0.10110631212592125, + 0.8461802266538143, + 0.10554182343184948, + 0.0, + 0.06995601207017899, + 0.3131961338222027, + 0.8865111526101828, + 0.152055274695158, + 0.0, + 0.4055298212915659, + 4.421817967668176, + 0.13426782004535198, + 0.9187502283602953, + 0.5443189963698387, + 0.8933127112686634, + 0.037127189338207245 + ], + "unique_experts": 59, + "load_cv": 0.9778472421153017, + "normalized_load_entropy": 0.8949305682733295, + "max_load_share": 0.06493506493506493 + } + }, + "s1_period": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "1c18f8911afa53984fbd96f0dd9d40f2f1fd524a568229dfda951742f20964c1", + "route_weight_sha256": "f5aa35ce0b27c15b905243df7dfdc34bb281ee3350844fedec662dd28fcd8601", + "loads": [ + 3, + 6, + 13, + 1, + 4, + 2, + 17, + 5, + 8, + 7, + 3, + 0, + 17, + 4, + 2, + 1, + 17, + 0, + 3, + 3, + 1, + 3, + 15, + 1, + 4, + 8, + 18, + 2, + 1, + 2, + 1, + 2, + 0, + 3, + 0, + 11, + 1, + 20, + 9, + 2, + 6, + 0, + 8, + 2, + 1, + 3, + 2, + 3, + 1, + 9, + 1, + 0, + 1, + 4, + 2, + 1, + 0, + 6, + 21, + 3, + 11, + 4, + 2, + 1 + ], + "weighted_loads": [ + 0.1152121052145958, + 0.22552066296339035, + 1.1781925586983562, + 0.11428958177566528, + 0.24208352528512478, + 0.08740656450390816, + 1.8026439510285854, + 0.4603992961347103, + 0.6082610674202442, + 0.24406607821583748, + 0.08534775301814079, + 0.0, + 0.7834903709590435, + 0.1497607585042715, + 0.1329113133251667, + 0.05905700474977493, + 1.4569230861961842, + 0.0, + 0.11263039335608482, + 0.12972084432840347, + 0.10127678513526917, + 0.15867404267191887, + 0.7337678615003824, + 0.0408085435628891, + 0.1602894477546215, + 0.871710654348135, + 0.7817123495042324, + 0.20559206791222095, + 0.04553798958659172, + 0.08863828331232071, + 0.07361144572496414, + 0.2197105661034584, + 0.0, + 0.19903213158249855, + 0.0, + 1.0141085851937532, + 0.0823466032743454, + 1.219834515824914, + 0.7391401529312134, + 0.1750887632369995, + 0.27674500644207, + 0.0, + 0.2811473701149225, + 0.058896057307720184, + 0.0848444402217865, + 0.17413428612053394, + 0.0941793117672205, + 0.2331848442554474, + 0.0682346373796463, + 0.8540238663554192, + 0.03873975947499275, + 0.0, + 0.07028001546859741, + 0.1782393492758274, + 0.0952841229736805, + 0.03967242315411568, + 0.0, + 0.4117940627038479, + 3.9888306986540556, + 0.14080673828721046, + 0.7946354653686285, + 0.19350530952215195, + 0.29032452404499054, + 0.03120305761694908 + ], + "unique_experts": 57, + "load_cv": 1.1167836789939778, + "normalized_load_entropy": 0.8709344824850189, + "max_load_share": 0.0673076923076923 + }, + "full_input": { + "tokens": 93, + "top_k": 6, + "decisions": 558, + "ordered_route_sha256": "9cf092735e4b4df0f904b4fa0289f22e8fd58fc8b46dea8ac676dc1427e47b05", + "route_weight_sha256": "1b11239e1ee85628211ed355ad46563b1930241a3e266eb9513e912881f6e2de", + "loads": [ + 4, + 11, + 16, + 1, + 16, + 5, + 28, + 6, + 8, + 12, + 4, + 7, + 31, + 4, + 15, + 3, + 20, + 6, + 4, + 13, + 4, + 4, + 21, + 6, + 12, + 9, + 18, + 4, + 2, + 3, + 7, + 3, + 3, + 3, + 1, + 11, + 3, + 21, + 10, + 5, + 9, + 9, + 17, + 3, + 2, + 3, + 2, + 16, + 2, + 10, + 7, + 0, + 4, + 14, + 7, + 2, + 2, + 8, + 30, + 5, + 13, + 14, + 12, + 3 + ], + "weighted_loads": [ + 0.1365879401564598, + 0.556246280670166, + 1.2841895101591945, + 0.11428958177566528, + 1.6795760989189148, + 0.21951171196997166, + 2.3199913054704666, + 0.5138506181538105, + 0.6082610674202442, + 0.4996539130806923, + 0.15214283391833305, + 0.7217902317643166, + 1.5498844403773546, + 0.1497607585042715, + 1.0220510717481375, + 0.16735079512000084, + 1.8490521721541882, + 0.25893897376954556, + 0.21048496291041374, + 0.6235766522586346, + 0.4051574543118477, + 0.2136952504515648, + 0.9748104475438595, + 0.21842353604733944, + 0.7315331865102053, + 1.0824146531522274, + 0.7817123495042324, + 0.3159607145935297, + 0.08219842612743378, + 0.12492319941520691, + 0.3170904517173767, + 0.2601434253156185, + 0.1445427555590868, + 0.19903213158249855, + 0.05737581104040146, + 1.0141085851937532, + 0.16241564601659775, + 1.2491640709340572, + 0.7859862186014652, + 0.32303199358284473, + 0.3737529143691063, + 0.42025793343782425, + 1.023280682042241, + 0.09705446660518646, + 0.09555806964635849, + 0.17413428612053394, + 0.0941793117672205, + 1.1659993827342987, + 0.10159501433372498, + 0.899904265999794, + 0.42582816258072853, + 0.0, + 0.2158634215593338, + 0.9694550298154354, + 0.8972368910908699, + 0.07549360394477844, + 0.08130139857530594, + 0.5002731755375862, + 4.44930780492723, + 0.20618420839309692, + 0.8831521291285753, + 0.6597279496490955, + 1.0680516995489597, + 0.19480569660663605 + ], + "unique_experts": 63, + "load_cv": 0.8182019314553078, + "normalized_load_entropy": 0.9268321251319286, + "max_load_share": 0.05555555555555555 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 52, + "ordered_topk_exact_tokens": 38, + "set_exact_tokens": 43, + "mean_set_jaccard": 0.9464285714285716, + "mean_token_weighted_tv": 0.013979098490940837, + "aggregate_load_tv": 0.022435897435897433 + }, + "system_bos": { + "tokens": 52, + "ordered_topk_exact_tokens": 30, + "set_exact_tokens": 37, + "mean_set_jaccard": 0.9093406593406594, + "mean_token_weighted_tv": 0.02204552331330398, + "aggregate_load_tv": 0.04487179487179487 + }, + "system_x": { + "tokens": 52, + "ordered_topk_exact_tokens": 22, + "set_exact_tokens": 33, + "mean_set_jaccard": 0.8873626373626374, + "mean_token_weighted_tv": 0.02605195297823789, + "aggregate_load_tv": 0.044871794871794865 + }, + "system_period": { + "tokens": 52, + "ordered_topk_exact_tokens": 18, + "set_exact_tokens": 28, + "mean_set_jaccard": 0.8516483516483516, + "mean_token_weighted_tv": 0.03308751523638001, + "aggregate_load_tv": 0.04166666666666667 + }, + "bos_at_s0": { + "tokens": 52, + "ordered_topk_exact_tokens": 26, + "set_exact_tokens": 29, + "mean_set_jaccard": 0.8736263736263736, + "mean_token_weighted_tv": 0.02796172588848724, + "aggregate_load_tv": 0.04166666666666667 + }, + "bos_at_s1": { + "tokens": 52, + "ordered_topk_exact_tokens": 25, + "set_exact_tokens": 35, + "mean_set_jaccard": 0.8901098901098901, + "mean_token_weighted_tv": 0.028970655635930598, + "aggregate_load_tv": 0.03846153846153846 + }, + "x_at_s0": { + "tokens": 52, + "ordered_topk_exact_tokens": 25, + "set_exact_tokens": 30, + "mean_set_jaccard": 0.875, + "mean_token_weighted_tv": 0.02762099196955275, + "aggregate_load_tv": 0.044871794871794865 + }, + "x_at_s1": { + "tokens": 52, + "ordered_topk_exact_tokens": 19, + "set_exact_tokens": 26, + "mean_set_jaccard": 0.8447802197802198, + "mean_token_weighted_tv": 0.03683915325941948, + "aggregate_load_tv": 0.04487179487179488 + }, + "period_at_s0": { + "tokens": 52, + "ordered_topk_exact_tokens": 25, + "set_exact_tokens": 32, + "mean_set_jaccard": 0.8777472527472526, + "mean_token_weighted_tv": 0.028818366359561108, + "aggregate_load_tv": 0.04807692307692307 + }, + "period_at_s1": { + "tokens": 52, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 24, + "mean_set_jaccard": 0.8337912087912088, + "mean_token_weighted_tv": 0.03729843655422043, + "aggregate_load_tv": 0.04166666666666667 + } + } + }, + "layer_20": { + "layer": 20, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "13d9b42ad7e588c68614648a3c1fa07c5240b8dbd724a9c9ffadfad25d37db84", + "route_weight_sha256": "328a58a48f2b42c9c6eb89b5b0fc680efbebaa52d36e0783e21dbf987edcdb19", + "loads": [ + 1, + 2, + 3, + 11, + 9, + 17, + 3, + 4, + 1, + 3, + 36, + 0, + 1, + 17, + 1, + 2, + 0, + 7, + 9, + 1, + 0, + 3, + 1, + 3, + 3, + 1, + 1, + 3, + 3, + 18, + 5, + 0, + 21, + 5, + 13, + 0, + 14, + 4, + 2, + 2, + 1, + 6, + 1, + 3, + 1, + 4, + 0, + 0, + 0, + 2, + 0, + 0, + 1, + 1, + 9, + 1, + 4, + 2, + 2, + 3, + 12, + 7, + 21, + 1 + ], + "weighted_loads": [ + 0.040166374295949936, + 0.05692381039261818, + 0.13207026198506355, + 0.7828428372740746, + 0.4917445667088032, + 1.122405394911766, + 0.4216631203889847, + 0.1187690794467926, + 0.0433088093996048, + 0.17938245460391045, + 5.467702595517039, + 0.0, + 0.04197438061237335, + 1.288466775789857, + 0.03704620152711868, + 0.07495694234967232, + 0.0, + 0.3657676372677088, + 0.4009622037410736, + 0.01626446470618248, + 0.0, + 0.11186285875737667, + 0.0895489975810051, + 0.1675805300474167, + 0.11776663735508919, + 0.038084279745817184, + 0.02677817828953266, + 0.22820299863815308, + 0.2945537492632866, + 1.0027605388313532, + 0.1831891182810068, + 0.0, + 2.787935584783554, + 0.19240825437009335, + 0.9393468424677849, + 0.0, + 1.415062315762043, + 0.3701961897313595, + 0.052261585369706154, + 0.09000656753778458, + 0.03815285861492157, + 0.42546059750020504, + 0.0339541882276535, + 0.439461812376976, + 0.05544751137495041, + 0.3775395341217518, + 0.0, + 0.0, + 0.0, + 0.13134365901350975, + 0.0, + 0.0, + 0.037028320133686066, + 0.04884578660130501, + 0.44231969118118286, + 0.03699489310383797, + 0.13394300639629364, + 0.08400645479559898, + 0.08257019519805908, + 0.1587424874305725, + 1.7112213373184204, + 0.2702330183237791, + 1.2836685422807932, + 0.03468853980302811 + ], + "unique_experts": 54, + "load_cv": 1.3599416006334482, + "normalized_load_entropy": 0.8337433845443529, + "max_load_share": 0.11538461538461539 + }, + "full_input": { + "tokens": 77, + "top_k": 6, + "decisions": 462, + "ordered_route_sha256": "bfaaef0986a7749e64ecb2a368d3fb2f4a0492efc6890fe8ed8fc4238c300a92", + "route_weight_sha256": "bbf6943e551e8a31ea810b3db19113fedeef61283a8a00cf16e370bc1682b7df", + "loads": [ + 1, + 4, + 3, + 19, + 17, + 21, + 8, + 10, + 1, + 3, + 37, + 1, + 4, + 17, + 1, + 9, + 1, + 8, + 19, + 1, + 5, + 3, + 8, + 3, + 3, + 8, + 2, + 3, + 3, + 20, + 5, + 0, + 21, + 7, + 15, + 0, + 16, + 6, + 4, + 3, + 2, + 8, + 3, + 7, + 10, + 4, + 0, + 0, + 2, + 3, + 8, + 0, + 1, + 6, + 9, + 4, + 5, + 8, + 2, + 3, + 24, + 11, + 21, + 1 + ], + "weighted_loads": [ + 0.040166374295949936, + 0.10163088887929916, + 0.13207026198506355, + 1.3816306442022324, + 0.892535638064146, + 1.286480000242591, + 0.5735874753445387, + 0.4635481834411621, + 0.0433088093996048, + 0.17938245460391045, + 5.501369452103972, + 0.04840399697422981, + 0.1244549322873354, + 1.288466775789857, + 0.03704620152711868, + 0.37910035997629166, + 0.036868590861558914, + 0.431765953078866, + 1.2853295989334583, + 0.01626446470618248, + 0.1490219330880791, + 0.11186285875737667, + 0.513789176940918, + 0.1675805300474167, + 0.11776663735508919, + 0.5611763596534729, + 0.04425349086523056, + 0.22820299863815308, + 0.2945537492632866, + 1.067463593557477, + 0.1831891182810068, + 0.0, + 2.787935584783554, + 0.2935823183506727, + 1.0203865356743336, + 0.0, + 1.4618869051337242, + 0.4270074274390936, + 1.3704284075647593, + 0.13650914281606674, + 0.09315221384167671, + 0.5051590707153082, + 0.20145241171121597, + 0.5712444654200226, + 0.37375012040138245, + 0.3775395341217518, + 0.0, + 0.0, + 0.03662662650458515, + 0.17148936539888382, + 1.0174061171710491, + 0.0, + 0.037028320133686066, + 0.28210960887372494, + 0.44231969118118286, + 0.5176950134336948, + 0.1654754988849163, + 0.27154408022761345, + 0.08257019519805908, + 0.1587424874305725, + 2.9812627122737467, + 0.5250700283795595, + 1.2836685422807932, + 0.03468853980302811 + ], + "unique_experts": 59, + "load_cv": 1.0233953016512434, + "normalized_load_entropy": 0.8894517025306807, + "max_load_share": 0.08008658008658008 + } + }, + "s1_eos": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "bae29f815b589a204003dc8fb256c3db359bef3d47949f9ec0bf4f60c0262b6c", + "route_weight_sha256": "ead8de734039491ad7bdae9af06bbab7fdcae2762d2d338d9889fe7df2da5fa0", + "loads": [ + 2, + 2, + 3, + 10, + 8, + 17, + 3, + 4, + 1, + 3, + 35, + 0, + 2, + 16, + 1, + 2, + 0, + 8, + 9, + 0, + 0, + 3, + 1, + 4, + 3, + 1, + 1, + 3, + 3, + 18, + 5, + 0, + 20, + 5, + 11, + 0, + 14, + 5, + 2, + 4, + 1, + 7, + 1, + 3, + 1, + 4, + 0, + 0, + 0, + 2, + 0, + 2, + 1, + 1, + 8, + 1, + 4, + 2, + 2, + 3, + 12, + 6, + 21, + 1 + ], + "weighted_loads": [ + 0.07369141839444637, + 0.05761115625500679, + 0.141694949939847, + 0.7351035960018635, + 0.45197901502251625, + 1.150275893509388, + 0.4131159409880638, + 0.11518585123121738, + 0.040846072137355804, + 0.1804201938211918, + 5.455130223184824, + 0.0, + 0.07249300926923752, + 1.2304359190165997, + 0.03311988338828087, + 0.0772494524717331, + 0.0, + 0.3910199198871851, + 0.3870941437780857, + 0.0, + 0.0, + 0.11442836560308933, + 0.08899185061454773, + 0.20187688246369362, + 0.1177784763276577, + 0.03706086426973343, + 0.02736283279955387, + 0.21394573524594307, + 0.2887486666440964, + 0.9808947667479515, + 0.18525829166173935, + 0.0, + 2.711628194898367, + 0.18151887506246567, + 0.8850760497152805, + 0.0, + 1.425119573250413, + 0.4201283175498247, + 0.06060039438307285, + 0.16545064374804497, + 0.03742120414972305, + 0.43630616553127766, + 0.035065967589616776, + 0.4302196968346834, + 0.05721087008714676, + 0.38122354447841644, + 0.0, + 0.0, + 0.0, + 0.13059428334236145, + 0.0, + 0.04897771589457989, + 0.035615380853414536, + 0.0393751785159111, + 0.4214518144726753, + 0.03735600411891937, + 0.1406648214906454, + 0.08397404477000237, + 0.08523430675268173, + 0.1594439446926117, + 1.7044988945126534, + 0.24124016053974628, + 1.268979949876666, + 0.04273391515016556 + ], + "unique_experts": 54, + "load_cv": 1.3117082628131962, + "normalized_load_entropy": 0.8436905980249959, + "max_load_share": 0.11217948717948718 + }, + "full_input": { + "tokens": 93, + "top_k": 6, + "decisions": 558, + "ordered_route_sha256": "c659edfce628889e82975409fe5459b3b83f3a1a28cf9aab94f17e9c78eb3337", + "route_weight_sha256": "2c4f1a9762d1ef3e9e34e1b1ac70b32bed402616a7d56d5be04f18c312d91739", + "loads": [ + 8, + 4, + 3, + 21, + 16, + 22, + 5, + 12, + 1, + 5, + 38, + 0, + 4, + 17, + 2, + 16, + 5, + 9, + 19, + 1, + 6, + 4, + 12, + 6, + 4, + 14, + 2, + 6, + 4, + 25, + 5, + 1, + 21, + 6, + 14, + 1, + 17, + 10, + 5, + 8, + 5, + 8, + 3, + 10, + 14, + 5, + 0, + 0, + 2, + 7, + 12, + 2, + 1, + 9, + 9, + 12, + 6, + 9, + 4, + 5, + 25, + 8, + 22, + 1 + ], + "weighted_loads": [ + 0.3466466497629881, + 0.10190099850296974, + 0.141694949939847, + 1.5039696879684925, + 0.8858765363693237, + 1.3478446509689093, + 0.483491750434041, + 0.6444351281970739, + 0.040846072137355804, + 0.4150591790676117, + 5.577840428799391, + 0.0, + 0.1372989695519209, + 1.5116503648459911, + 0.0920817069709301, + 0.8819423466920853, + 0.29623416624963284, + 0.46559068001806736, + 1.3748387210071087, + 0.03713647276163101, + 0.18850599345751107, + 0.15199091471731663, + 0.7811282984912395, + 0.3743785060942173, + 0.13839714787900448, + 0.9151114523410797, + 0.04483814537525177, + 0.3136866670101881, + 0.3353637382388115, + 1.2086248584091663, + 0.18525829166173935, + 0.029710810631513596, + 2.7584036327898502, + 0.24620556831359863, + 1.0297028627246618, + 0.13056451082229614, + 1.5266340766102076, + 0.6105813104659319, + 1.4174108039587736, + 0.36497311294078827, + 0.21557723358273506, + 0.48741508834064007, + 0.20764609053730965, + 0.7100553542841226, + 0.8754247389733791, + 0.45372145622968674, + 0.0, + 0.0, + 0.03474810556508601, + 0.4342215433716774, + 1.5987908281385899, + 0.04897771589457989, + 0.035615380853414536, + 0.35814661532640457, + 0.4490917269140482, + 1.1317487359046936, + 0.22599742375314236, + 0.6189738903194666, + 0.1580912061035633, + 0.21108581312000751, + 3.1340067862765864, + 0.37697496823966503, + 1.32772302813828, + 0.04273391515016556 + ], + "unique_experts": 61, + "load_cv": 0.8648545733380427, + "normalized_load_entropy": 0.9161107310871687, + "max_load_share": 0.06810035842293907 + } + }, + "s0_bos": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "076a39c14fcd2dbfeb5a1d759fce6e735120081a4eea5be0ba40e9fa55317844", + "route_weight_sha256": "aa905dc5c2ecc9be3966da60fee8dd726b73d62390f073176a4061fa32b275aa", + "loads": [ + 2, + 2, + 4, + 12, + 8, + 16, + 3, + 3, + 0, + 3, + 36, + 0, + 1, + 15, + 1, + 2, + 0, + 8, + 10, + 0, + 0, + 3, + 1, + 2, + 2, + 1, + 0, + 3, + 3, + 20, + 4, + 0, + 21, + 6, + 12, + 1, + 14, + 6, + 2, + 2, + 1, + 6, + 1, + 3, + 1, + 4, + 0, + 1, + 1, + 3, + 0, + 2, + 0, + 2, + 8, + 1, + 6, + 1, + 2, + 3, + 12, + 6, + 18, + 1 + ], + "weighted_loads": [ + 0.0645039938390255, + 0.0598787534981966, + 0.16585613414645195, + 0.8060827516019344, + 0.49058070220053196, + 1.0734085477888584, + 0.4218924157321453, + 0.09739576280117035, + 0.0, + 0.1751076877117157, + 5.5168390814214945, + 0.0, + 0.03871215879917145, + 1.231062337756157, + 0.038814108818769455, + 0.08042309060692787, + 0.0, + 0.38530809059739113, + 0.4217648673802614, + 0.0, + 0.0, + 0.11351106688380241, + 0.09472725540399551, + 0.14173226058483124, + 0.08692171424627304, + 0.03916187956929207, + 0.0, + 0.2036743015050888, + 0.2972979135811329, + 1.0987666454166174, + 0.1546385996043682, + 0.0, + 2.7248948365449905, + 0.2458364125341177, + 0.9415055830031633, + 0.024081828072667122, + 1.366150975227356, + 0.47675295546650887, + 0.05948222428560257, + 0.09131745807826519, + 0.04156947880983353, + 0.3879539854824543, + 0.034906093031167984, + 0.4346753340214491, + 0.06600169837474823, + 0.37485551089048386, + 0.0, + 0.028231170028448105, + 0.03939259424805641, + 0.17082351446151733, + 0.0, + 0.05070145055651665, + 0.0, + 0.07776025496423244, + 0.44510799646377563, + 0.035891011357307434, + 0.1988877635449171, + 0.046603765338659286, + 0.07163058966398239, + 0.16606352478265762, + 1.8596825823187828, + 0.24141456000506878, + 1.1805103030055761, + 0.03137120604515076 + ], + "unique_experts": 54, + "load_cv": 1.3330867622108675, + "normalized_load_entropy": 0.8390305518547864, + "max_load_share": 0.11538461538461539 + }, + "full_input": { + "tokens": 77, + "top_k": 6, + "decisions": 462, + "ordered_route_sha256": "3a2f467bca5aa3a4ea3ea397fb97bb43f773f165a6da9f46d528245c13432fa5", + "route_weight_sha256": "07bbd93fba0100303796361c2cba5323660842d36bc5d6a1142b4064d6cb28a3", + "loads": [ + 2, + 3, + 4, + 20, + 16, + 20, + 8, + 9, + 0, + 3, + 37, + 1, + 4, + 15, + 1, + 10, + 1, + 9, + 20, + 0, + 3, + 3, + 10, + 2, + 2, + 8, + 3, + 3, + 3, + 22, + 5, + 1, + 21, + 8, + 13, + 1, + 16, + 8, + 3, + 3, + 2, + 8, + 3, + 7, + 10, + 4, + 1, + 2, + 2, + 3, + 8, + 2, + 0, + 7, + 8, + 4, + 7, + 6, + 3, + 3, + 23, + 9, + 18, + 1 + ], + "weighted_loads": [ + 0.0645039938390255, + 0.0840056985616684, + 0.16585613414645195, + 1.4048705585300922, + 0.8913717735558748, + 1.238556420430541, + 0.5738167706876993, + 0.4247167147696018, + 0.0, + 0.1751076877117157, + 5.54969790764153, + 0.7050978541374207, + 0.12119271047413349, + 1.231062337756157, + 0.038814108818769455, + 0.48739906400442123, + 0.036868590861558914, + 0.44732099026441574, + 1.3061322625726461, + 0.0, + 0.10755062848329544, + 0.11351106688380241, + 0.6150389574468136, + 0.14173226058483124, + 0.08692171424627304, + 0.5610168352723122, + 0.1010346058756113, + 0.2036743015050888, + 0.2972979135811329, + 1.1634697001427412, + 0.19354962930083275, + 0.011561182327568531, + 2.7248948365449905, + 0.3355130087584257, + 0.9833125602453947, + 0.024081828072667122, + 1.4129755645990372, + 0.533564193174243, + 0.42344651371240616, + 0.12356855161488056, + 0.0848429873585701, + 0.444829891435802, + 0.19765723124146461, + 0.6463932618498802, + 0.3776039741933346, + 0.37485551089048386, + 0.135101318359375, + 0.03906838968396187, + 0.07437257468700409, + 0.17082351446151733, + 1.0537213906645775, + 0.05070145055651665, + 0.0, + 0.3306189626455307, + 0.44510799646377563, + 0.5711901038885117, + 0.23221458680927753, + 0.19611790031194687, + 0.10334276407957077, + 0.16606352478265762, + 3.1283409483730793, + 0.4575134199112654, + 1.1805103030055761, + 0.03137120604515076 + ], + "unique_experts": 61, + "load_cv": 0.9996813645015404, + "normalized_load_entropy": 0.8968807939694932, + "max_load_share": 0.08008658008658008 + } + }, + "s1_bos": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "b29033a01f6415e0541c81ef416ae0b80422061b2481d0d1bebaa7b17b17ce16", + "route_weight_sha256": "6b64f472c9c8bbfe7ba849b6ff289637b8f9f935d8d220741cb1b53e92796f1b", + "loads": [ + 2, + 0, + 4, + 13, + 8, + 16, + 3, + 4, + 0, + 3, + 35, + 0, + 1, + 16, + 1, + 2, + 0, + 8, + 9, + 0, + 0, + 3, + 1, + 4, + 2, + 1, + 0, + 3, + 3, + 19, + 3, + 0, + 21, + 5, + 12, + 0, + 16, + 6, + 2, + 2, + 1, + 7, + 1, + 3, + 1, + 4, + 0, + 1, + 0, + 4, + 0, + 2, + 0, + 1, + 8, + 1, + 5, + 1, + 2, + 3, + 12, + 6, + 20, + 1 + ], + "weighted_loads": [ + 0.06846527382731438, + 0.0, + 0.17984814569354057, + 0.8605907652527094, + 0.49402928352355957, + 1.0202684551477432, + 0.4159753806889057, + 0.11859868466854095, + 0.0, + 0.17705174162983894, + 5.436614887788892, + 0.0, + 0.03308894485235214, + 1.257157277315855, + 0.03290366008877754, + 0.08032611757516861, + 0.0, + 0.40327803790569305, + 0.3669297080487013, + 0.0, + 0.0, + 0.12136976793408394, + 0.09425859898328781, + 0.22312757931649685, + 0.08741046115756035, + 0.03753011301159859, + 0.0, + 0.18524841964244843, + 0.29111116006970406, + 1.0506081841886044, + 0.12776773050427437, + 0.0, + 2.7010049782693386, + 0.18630512058734894, + 0.976429995149374, + 0.0, + 1.4758527483791113, + 0.48775259777903557, + 0.06201452016830444, + 0.09925948828458786, + 0.04099419340491295, + 0.4272583741694689, + 0.034170448780059814, + 0.4181532450020313, + 0.06724201887845993, + 0.3784106448292732, + 0.0, + 0.027179531753063202, + 0.0, + 0.2050253376364708, + 0.0, + 0.05252621881663799, + 0.0, + 0.033570170402526855, + 0.4570189341902733, + 0.0407475046813488, + 0.18755340203642845, + 0.04378809407353401, + 0.07701344043016434, + 0.16372903808951378, + 1.866417333483696, + 0.23967661522328854, + 1.2544483710080385, + 0.039192598313093185 + ], + "unique_experts": 51, + "load_cv": 1.348776444085888, + "normalized_load_entropy": 0.82987669837877, + "max_load_share": 0.11217948717948718 + }, + "full_input": { + "tokens": 93, + "top_k": 6, + "decisions": 558, + "ordered_route_sha256": "419be5516acdd767372075a750ec9964f55bcb8980bfb2fd6d647d3d4d4994bc", + "route_weight_sha256": "d46d711620524dfa0699b55318c6bcc31c828ae412083c03851c2aa85e2a41b6", + "loads": [ + 7, + 2, + 4, + 24, + 16, + 22, + 5, + 13, + 0, + 5, + 38, + 0, + 3, + 17, + 2, + 17, + 5, + 9, + 19, + 1, + 5, + 4, + 13, + 6, + 3, + 14, + 2, + 5, + 4, + 25, + 3, + 1, + 22, + 6, + 14, + 1, + 19, + 11, + 4, + 7, + 5, + 10, + 4, + 9, + 14, + 5, + 0, + 1, + 0, + 9, + 12, + 2, + 0, + 10, + 9, + 12, + 7, + 8, + 3, + 5, + 24, + 9, + 21, + 1 + ], + "weighted_loads": [ + 0.2992892451584339, + 0.05008944869041443, + 0.17984814569354057, + 1.6294568572193384, + 0.927926804870367, + 1.2795188929885626, + 0.4863511901348829, + 0.6744153238832951, + 0.0, + 0.41169072687625885, + 5.560947189107537, + 0.0, + 0.09789490513503551, + 1.5383717231452465, + 0.09186548367142677, + 0.9827586561441422, + 0.29623416624963284, + 0.47401753813028336, + 1.3546742852777243, + 0.03713647276163101, + 0.18837140500545502, + 0.15893231704831123, + 0.8231642320752144, + 0.39562920294702053, + 0.10802913270890713, + 0.9020721279084682, + 0.0648586843162775, + 0.24091722257435322, + 0.3377262316644192, + 1.2309129275381565, + 0.12776773050427437, + 0.029710810631513596, + 2.747780416160822, + 0.2507551610469818, + 1.0523932371288538, + 0.13056451082229614, + 1.577367251738906, + 0.6837897934019566, + 0.4679657407104969, + 0.35292327776551247, + 0.21774573624134064, + 0.5518279373645782, + 0.23768030107021332, + 0.7548848241567612, + 0.877768486738205, + 0.4509085565805435, + 0.0, + 0.027179531753063202, + 0.0, + 0.5426401123404503, + 1.6489967033267021, + 0.05252621881663799, + 0.0, + 0.43278593942523, + 0.48465884663164616, + 1.1677728109061718, + 0.2637963332235813, + 0.5787879396229982, + 0.11366210132837296, + 0.2153709065169096, + 3.294061418622732, + 0.41067720390856266, + 1.3131914492696524, + 0.039192598313093185 + ], + "unique_experts": 59, + "load_cv": 0.8931494033375442, + "normalized_load_entropy": 0.9078990893488695, + "max_load_share": 0.06810035842293907 + } + }, + "s0_x": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "3278eeef02a8168a4902f046214c63fc693b515ca49f4b760562f3e6df3f836f", + "route_weight_sha256": "e201b165bc97269efbebee57637d07cafe7255c5279ab390ca99ef09b97bf36a", + "loads": [ + 2, + 0, + 4, + 12, + 8, + 16, + 3, + 4, + 0, + 3, + 36, + 0, + 1, + 15, + 1, + 2, + 0, + 9, + 8, + 0, + 0, + 3, + 1, + 2, + 2, + 1, + 0, + 3, + 3, + 17, + 5, + 0, + 21, + 7, + 12, + 1, + 15, + 6, + 1, + 2, + 1, + 7, + 1, + 4, + 2, + 4, + 0, + 1, + 1, + 4, + 0, + 2, + 0, + 1, + 8, + 1, + 5, + 1, + 2, + 3, + 12, + 7, + 19, + 0 + ], + "weighted_loads": [ + 0.06295379437506199, + 0.0, + 0.1796373687684536, + 0.7966488413512707, + 0.49031602405011654, + 1.2009055279195309, + 0.42466573789715767, + 0.11795057915151119, + 0.0, + 0.18689247965812683, + 5.5238401386886835, + 0.0, + 0.04040708392858505, + 1.2263011410832405, + 0.03642980009317398, + 0.07593801617622375, + 0.0, + 0.3988632056862116, + 0.3592153675854206, + 0.0, + 0.0, + 0.109613087028265, + 0.09038341045379639, + 0.14636893197894096, + 0.08222025632858276, + 0.03850574046373367, + 0.0, + 0.19775735214352608, + 0.296569861471653, + 0.977361312136054, + 0.176748588681221, + 0.0, + 2.706023931503296, + 0.2583038117736578, + 0.9800600633025169, + 0.025234125554561615, + 1.3541446551680565, + 0.4812241345643997, + 0.02461172081530094, + 0.09974294900894165, + 0.036169640719890594, + 0.40965593606233597, + 0.03346557915210724, + 0.4527398403733969, + 0.10163264721632004, + 0.377231452614069, + 0.0, + 0.02685777097940445, + 0.04079354181885719, + 0.20469916611909866, + 0.0, + 0.050191449001431465, + 0.0, + 0.04483840614557266, + 0.41557712107896805, + 0.03725958615541458, + 0.18416794203221798, + 0.045244909822940826, + 0.07498728483915329, + 0.1609330028295517, + 1.7803713642060757, + 0.2964613027870655, + 1.1641798708587885, + 0.0 + ], + "unique_experts": 52, + "load_cv": 1.329629965380941, + "normalized_load_entropy": 0.8351947158448032, + "max_load_share": 0.11538461538461539 + }, + "full_input": { + "tokens": 77, + "top_k": 6, + "decisions": 462, + "ordered_route_sha256": "fb3641a11c1b1277ebae089b0f4cfa300d964e981668cd2cf186c9ad1108c467", + "route_weight_sha256": "79afeea26181151ac40b61678ea01e12df21b64a0b17a373191312dff180055c", + "loads": [ + 3, + 2, + 4, + 20, + 17, + 19, + 9, + 10, + 0, + 3, + 38, + 0, + 4, + 16, + 1, + 8, + 1, + 10, + 19, + 0, + 3, + 3, + 8, + 2, + 2, + 9, + 1, + 3, + 3, + 21, + 5, + 0, + 21, + 9, + 13, + 1, + 19, + 8, + 2, + 3, + 1, + 8, + 3, + 7, + 12, + 4, + 0, + 1, + 2, + 5, + 8, + 2, + 0, + 6, + 8, + 5, + 5, + 7, + 2, + 3, + 24, + 10, + 19, + 0 + ], + "weighted_loads": [ + 0.09279769472777843, + 0.061337629333138466, + 0.1796373687684536, + 1.3954366482794285, + 1.0152530875056982, + 1.3117380496114492, + 0.6151598077267408, + 0.435002114623785, + 0.0, + 0.18689247965812683, + 5.582376444712281, + 0.0, + 0.1228876356035471, + 1.2541708666831255, + 0.03642980009317398, + 0.3418932221829891, + 0.036868590861558914, + 0.46942602284252644, + 1.341663509607315, + 0.0, + 0.10755062848329544, + 0.109613087028265, + 0.5110801458358765, + 0.14636893197894096, + 0.08222025632858276, + 0.5927785374224186, + 0.0174753125756979, + 0.19775735214352608, + 0.296569861471653, + 1.1089643370360136, + 0.176748588681221, + 0.0, + 2.706023931503296, + 0.38317268155515194, + 1.015690378844738, + 0.025234125554561615, + 1.4664639793336391, + 0.5380353722721338, + 0.38857601024210453, + 0.13000987097620964, + 0.036169640719890594, + 0.45345472916960716, + 0.19801843166351318, + 0.5819596778601408, + 0.45450373739004135, + 0.377231452614069, + 0.0, + 0.02685777097940445, + 0.07577352225780487, + 0.24302493035793304, + 1.002027839422226, + 0.050191449001431465, + 0.0, + 0.283661438152194, + 0.41557712107896805, + 0.5982700511813164, + 0.18416794203221798, + 0.25157638266682625, + 0.07498728483915329, + 0.1609330028295517, + 3.235634110867977, + 0.5071318633854389, + 1.1641798708587885, + 0.0 + ], + "unique_experts": 57, + "load_cv": 1.0379414188723277, + "normalized_load_entropy": 0.883977662723026, + "max_load_share": 0.08225108225108226 + } + }, + "s1_x": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "357df6bffe6ea98037b09fb215669196777af2db43e725c6dca281c49a19add3", + "route_weight_sha256": "12123f1d875f9decb5a50d2b601f37fedfbbf1c1a211c609317ae08bcfa23a19", + "loads": [ + 2, + 1, + 4, + 13, + 8, + 17, + 3, + 4, + 0, + 3, + 36, + 0, + 1, + 17, + 0, + 1, + 0, + 9, + 9, + 0, + 0, + 3, + 1, + 3, + 2, + 1, + 1, + 3, + 3, + 13, + 4, + 0, + 21, + 6, + 12, + 0, + 17, + 6, + 2, + 2, + 1, + 6, + 2, + 3, + 3, + 4, + 0, + 1, + 0, + 3, + 0, + 2, + 0, + 1, + 8, + 1, + 5, + 1, + 2, + 3, + 12, + 6, + 19, + 1 + ], + "weighted_loads": [ + 0.06622437946498394, + 0.03804423660039902, + 0.16480040177702904, + 0.8586743548512459, + 0.5083823055028915, + 1.449024984613061, + 0.4111645855009556, + 0.11828717589378357, + 0.0, + 0.1702451966702938, + 5.555881828069687, + 0.0, + 0.03387140855193138, + 1.297081707045436, + 0.0, + 0.03776643052697182, + 0.0, + 0.41652386263012886, + 0.37373403273522854, + 0.0, + 0.0, + 0.12483061477541924, + 0.0828292965888977, + 0.18680600449442863, + 0.08270249888300896, + 0.03581256791949272, + 0.028849756345152855, + 0.19490714743733406, + 0.28174731135368347, + 0.856984818354249, + 0.15855740942060947, + 0.0, + 2.5918968319892883, + 0.20408554188907146, + 0.9641961194574833, + 0.0, + 1.476438082754612, + 0.48263904079794884, + 0.06004604510962963, + 0.09273581393063068, + 0.038659922778606415, + 0.37843270413577557, + 0.06368524208664894, + 0.3972006905823946, + 0.13999599404633045, + 0.3676456995308399, + 0.0, + 0.02725202962756157, + 0.0, + 0.17747145518660545, + 0.0, + 0.052227793261408806, + 0.0, + 0.03236744925379753, + 0.42637689784169197, + 0.04064851999282837, + 0.1821846291422844, + 0.04649246111512184, + 0.0762552060186863, + 0.15265372768044472, + 1.9014249444007874, + 0.24989759922027588, + 1.193423978984356, + 0.04982449486851692 + ], + "unique_experts": 52, + "load_cv": 1.3380095513486923, + "normalized_load_entropy": 0.8349420408478804, + "max_load_share": 0.11538461538461539 + }, + "full_input": { + "tokens": 93, + "top_k": 6, + "decisions": 558, + "ordered_route_sha256": "a20360d6d7c6fc88dd42f930b786b8a2209ce3c528a7b43a898328818af3ce3f", + "route_weight_sha256": "fea17ac2b76bd7e5030f5db7c6aa26378e5cb8b755666928fd1b0361d570ab7f", + "loads": [ + 6, + 2, + 4, + 25, + 19, + 23, + 6, + 11, + 0, + 5, + 38, + 0, + 3, + 18, + 1, + 15, + 7, + 10, + 20, + 2, + 3, + 5, + 12, + 5, + 4, + 14, + 2, + 7, + 4, + 19, + 4, + 1, + 22, + 7, + 14, + 1, + 20, + 12, + 4, + 7, + 4, + 8, + 4, + 8, + 17, + 5, + 0, + 1, + 0, + 7, + 12, + 2, + 0, + 9, + 9, + 12, + 7, + 9, + 3, + 5, + 25, + 8, + 20, + 1 + ], + "weighted_loads": [ + 0.26251219026744366, + 0.06217118166387081, + 0.16480040177702904, + 1.6593860536813736, + 1.1212554015219212, + 1.687847688794136, + 0.520256532356143, + 0.5686758197844028, + 0.0, + 0.4048841819167137, + 5.6472522132098675, + 0.0, + 0.09867736883461475, + 1.5782961528748274, + 0.05896182358264923, + 0.8056282140314579, + 0.4673988465219736, + 0.4901941977441311, + 1.4745565708726645, + 0.08438853546977043, + 0.10887450724840164, + 0.19457152485847473, + 0.7278443686664104, + 0.3593076281249523, + 0.13438918814063072, + 0.8592498004436493, + 0.046325068920850754, + 0.36458960734307766, + 0.3283623829483986, + 1.034832851961255, + 0.15855740942060947, + 0.029710810631513596, + 2.6386722698807716, + 0.25592161528766155, + 1.0286255273967981, + 0.13056451082229614, + 1.5779525861144066, + 0.7264862023293972, + 0.4659972656518221, + 0.3240873236209154, + 0.17803512141108513, + 0.46129788272082806, + 0.23889349773526192, + 0.6379855815321207, + 0.9873171653598547, + 0.4401436112821102, + 0.0, + 0.02725202962756157, + 0.0, + 0.41290291026234627, + 1.5055770576000214, + 0.052227793261408806, + 0.0, + 0.3456551283597946, + 0.45401681028306484, + 1.1736883521080017, + 0.2595815174281597, + 0.6321766246110201, + 0.11290386691689491, + 0.20429559610784054, + 3.4210834465920925, + 0.3723502643406391, + 1.2521670572459698, + 0.04982449486851692 + ], + "unique_experts": 59, + "load_cv": 0.8926890096004374, + "normalized_load_entropy": 0.9082508795333084, + "max_load_share": 0.06810035842293907 + } + }, + "s0_period": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "7a08dc1dceac9535dfbfecf55f19664c5755127f270c2449cf14b8c4b93a7a66", + "route_weight_sha256": "be2cf4decf5a9486c7dc12a0b497b9020a52f86229d2809da26f377b09592039", + "loads": [ + 1, + 0, + 4, + 12, + 9, + 16, + 3, + 5, + 0, + 3, + 38, + 0, + 1, + 15, + 1, + 2, + 0, + 9, + 9, + 0, + 0, + 3, + 1, + 5, + 2, + 1, + 0, + 3, + 3, + 17, + 3, + 0, + 21, + 5, + 12, + 0, + 17, + 6, + 1, + 2, + 1, + 6, + 1, + 4, + 1, + 4, + 0, + 1, + 1, + 3, + 0, + 1, + 0, + 1, + 8, + 1, + 5, + 1, + 2, + 3, + 12, + 6, + 19, + 1 + ], + "weighted_loads": [ + 0.039014894515275955, + 0.0, + 0.17577970772981644, + 0.8030104711651802, + 0.5177574921399355, + 1.141756884753704, + 0.4245923012495041, + 0.14994635805487633, + 0.0, + 0.1809210255742073, + 5.666978340595961, + 0.0, + 0.040387947112321854, + 1.2177698463201523, + 0.03868122026324272, + 0.07885340973734856, + 0.0, + 0.40364715456962585, + 0.41460333950817585, + 0.0, + 0.0, + 0.1098045315593481, + 0.08768891543149948, + 0.2357610333710909, + 0.08470156416296959, + 0.038876187056303024, + 0.0, + 0.18950210511684418, + 0.30045927315950394, + 1.0027297604829073, + 0.11227863281965256, + 0.0, + 2.7697454318404198, + 0.1774590201675892, + 0.959049642086029, + 0.0, + 1.4576057177037, + 0.4740065075457096, + 0.02464188262820244, + 0.10159135609865189, + 0.037972401827573776, + 0.3830702658742666, + 0.03381374105811119, + 0.45062977261841297, + 0.06900762766599655, + 0.379050150513649, + 0.0, + 0.028455952182412148, + 0.041020605713129044, + 0.17659080773591995, + 0.0, + 0.015286298468708992, + 0.0, + 0.04795008525252342, + 0.4066956005990505, + 0.038825180381536484, + 0.17907999828457832, + 0.043552834540605545, + 0.07676319777965546, + 0.1620655208826065, + 1.8625795282423496, + 0.2386622652411461, + 1.1543291453272104, + 0.03320218250155449 + ], + "unique_experts": 52, + "load_cv": 1.3767583342214154, + "normalized_load_entropy": 0.8276945783177373, + "max_load_share": 0.12179487179487179 + }, + "full_input": { + "tokens": 77, + "top_k": 6, + "decisions": 462, + "ordered_route_sha256": "8734e2503339e8a2c4bb18302d71f888aa7414b19f66d8ee74bcc135c5f61d50", + "route_weight_sha256": "278deed22bdea6f3e684c8918c4e2662ee84b52e2a66423488a5ff8c0634cc14", + "loads": [ + 2, + 2, + 4, + 20, + 18, + 19, + 9, + 12, + 0, + 3, + 40, + 0, + 4, + 15, + 1, + 8, + 1, + 10, + 19, + 0, + 4, + 3, + 8, + 5, + 2, + 10, + 1, + 3, + 3, + 20, + 3, + 0, + 21, + 7, + 13, + 0, + 19, + 8, + 2, + 4, + 2, + 7, + 3, + 7, + 12, + 4, + 0, + 1, + 2, + 4, + 9, + 1, + 0, + 6, + 8, + 4, + 5, + 6, + 2, + 3, + 23, + 10, + 19, + 1 + ], + "weighted_loads": [ + 0.07479318976402283, + 0.0655051190406084, + 0.17577970772981644, + 1.401798278093338, + 0.9697290677577257, + 1.2441622465848923, + 0.6331642959266901, + 0.627615112811327, + 0.0, + 0.1809210255742073, + 5.727575574070215, + 0.0, + 0.1228684987872839, + 1.2177698463201523, + 0.03868122026324272, + 0.33809446915984154, + 0.036868590861558914, + 0.4799572750926018, + 1.2989707347005606, + 0.0, + 0.1545543484389782, + 0.1098045315593481, + 0.5140884257853031, + 0.2357610333710909, + 0.08470156416296959, + 0.6627062186598778, + 0.0174753125756979, + 0.18950210511684418, + 0.30045927315950394, + 1.1017927769571543, + 0.11227863281965256, + 0.0, + 2.7697454318404198, + 0.2923329882323742, + 0.9927733540534973, + 0.0, + 1.5044303070753813, + 0.5308177452534437, + 0.388606172055006, + 0.1712083276361227, + 0.09442189708352089, + 0.4268690589815378, + 0.19927221164107323, + 0.5742795001715422, + 0.4640943892300129, + 0.379050150513649, + 0.0, + 0.028455952182412148, + 0.07600058615207672, + 0.23486213758587837, + 1.0741765052080154, + 0.015286298468708992, + 0.0, + 0.28606335259974003, + 0.4066956005990505, + 0.5684167258441448, + 0.17907999828457832, + 0.19306696951389313, + 0.07676319777965546, + 0.1620655208826065, + 3.131237894296646, + 0.48501410335302353, + 1.1543291453272104, + 0.03320218250155449 + ], + "unique_experts": 57, + "load_cv": 1.05057541429033, + "normalized_load_entropy": 0.8829833739654245, + "max_load_share": 0.08658008658008658 + } + }, + "s1_period": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "fbc91f8dc78aea905307976bcf4f427eeb9b64993de63dbf05870bc0a6d92c12", + "route_weight_sha256": "b3a606ee175524d003a56b318e794226a896ef1845582245993fa4584fab53da", + "loads": [ + 2, + 1, + 3, + 13, + 9, + 21, + 3, + 3, + 0, + 3, + 36, + 0, + 0, + 15, + 1, + 2, + 0, + 7, + 9, + 0, + 0, + 3, + 2, + 4, + 3, + 1, + 1, + 3, + 2, + 13, + 5, + 0, + 20, + 7, + 12, + 0, + 16, + 7, + 1, + 2, + 1, + 6, + 1, + 3, + 1, + 4, + 0, + 1, + 1, + 4, + 0, + 2, + 1, + 0, + 8, + 1, + 5, + 1, + 2, + 3, + 12, + 6, + 18, + 1 + ], + "weighted_loads": [ + 0.06792047619819641, + 0.040115125477313995, + 0.13348879665136337, + 0.8605651967227459, + 0.54240557923913, + 1.681565685197711, + 0.39616534486413, + 0.09916593506932259, + 0.0, + 0.1749390810728073, + 5.533150676637888, + 0.0, + 0.0, + 1.2172130923718214, + 0.0301408302038908, + 0.06690765544772148, + 0.0, + 0.3949351906776428, + 0.39445330761373043, + 0.0, + 0.0, + 0.12170711532235146, + 0.11494158208370209, + 0.21063867397606373, + 0.11219811625778675, + 0.034130681306123734, + 0.027812030166387558, + 0.1806674711406231, + 0.24239152669906616, + 0.8501548264175653, + 0.174786189571023, + 0.0, + 2.5885351728647947, + 0.24748357571661472, + 0.965145306661725, + 0.0, + 1.4459622874855995, + 0.5092974472790956, + 0.035640399903059006, + 0.10061600431799889, + 0.0401165746152401, + 0.3577475640922785, + 0.03309718146920204, + 0.4058659616857767, + 0.0724465399980545, + 0.3624161519110203, + 0.0, + 0.02788507379591465, + 0.041666179895401, + 0.19857023656368256, + 0.0, + 0.051146721467375755, + 0.029885249212384224, + 0.0, + 0.4356755502521992, + 0.04227409139275551, + 0.17322040162980556, + 0.05072404816746712, + 0.07597090676426888, + 0.15346193686127663, + 1.86159223690629, + 0.24746704287827015, + 1.1414267010986805, + 0.048620183020830154 + ], + "unique_experts": 53, + "load_cv": 1.335550424933889, + "normalized_load_entropy": 0.8361605240073513, + "max_load_share": 0.11538461538461539 + }, + "full_input": { + "tokens": 93, + "top_k": 6, + "decisions": 558, + "ordered_route_sha256": "ec48784badc8a37e4f8285ac0e706cb7e7673657449c960ac8ac9165fb1ec7d3", + "route_weight_sha256": "781de53b42f26c2e6613d011afd6b292352b15ec59109a7a606e5156f2e6f7b6", + "loads": [ + 8, + 2, + 3, + 24, + 18, + 27, + 6, + 12, + 0, + 5, + 38, + 0, + 4, + 16, + 2, + 14, + 6, + 8, + 19, + 2, + 4, + 4, + 13, + 6, + 4, + 15, + 2, + 6, + 3, + 19, + 5, + 1, + 21, + 8, + 13, + 1, + 19, + 14, + 3, + 7, + 5, + 8, + 3, + 8, + 15, + 5, + 0, + 1, + 1, + 9, + 12, + 2, + 1, + 8, + 9, + 13, + 6, + 8, + 3, + 5, + 25, + 9, + 19, + 1 + ], + "weighted_loads": [ + 0.32896287366747856, + 0.06424207054078579, + 0.13348879665136337, + 1.629431288689375, + 1.007699143141508, + 1.909886434674263, + 0.5100378524512053, + 0.6557225231081247, + 0.0, + 0.4095780663192272, + 5.6245210617780685, + 0.0, + 0.13903857208788395, + 1.4984275382012129, + 0.08910265378654003, + 0.8004540354013443, + 0.3464009966701269, + 0.46825700253248215, + 1.3821978848427534, + 0.0691339448094368, + 0.15543030574917793, + 0.15926966443657875, + 0.7527330182492733, + 0.3831402976065874, + 0.13281678780913353, + 0.923642385751009, + 0.04528734274208546, + 0.3144506048411131, + 0.2890065982937813, + 1.0203180480748415, + 0.174786189571023, + 0.029710810631513596, + 2.635310610756278, + 0.29682771675288677, + 0.9936216250061989, + 0.13056451082229614, + 1.5474767908453941, + 0.7881732787936926, + 0.44159162044525146, + 0.3461410216987133, + 0.21654751151800156, + 0.44786435924470425, + 0.20064103975892067, + 0.6471583303064108, + 0.9173587560653687, + 0.4349140636622906, + 0.0, + 0.02788507379591465, + 0.041666179895401, + 0.5227925404906273, + 1.5216671489179134, + 0.051146721467375755, + 0.029885249212384224, + 0.33902737125754356, + 0.46331546269357204, + 1.1989344768226147, + 0.21795434691011906, + 0.5857238937169313, + 0.1126195676624775, + 0.20510380528867245, + 3.331022072583437, + 0.40250116027891636, + 1.2001697793602943, + 0.048620183020830154 + ], + "unique_experts": 61, + "load_cv": 0.8827324669537085, + "normalized_load_entropy": 0.9123062404823932, + "max_load_share": 0.06810035842293907 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 52, + "ordered_topk_exact_tokens": 36, + "set_exact_tokens": 43, + "mean_set_jaccard": 0.9464285714285714, + "mean_token_weighted_tv": 0.015327489773671214, + "aggregate_load_tv": 0.032051282051282055 + }, + "system_bos": { + "tokens": 52, + "ordered_topk_exact_tokens": 31, + "set_exact_tokens": 38, + "mean_set_jaccard": 0.9230769230769231, + "mean_token_weighted_tv": 0.02120720367663755, + "aggregate_load_tv": 0.03525641025641024 + }, + "system_x": { + "tokens": 52, + "ordered_topk_exact_tokens": 25, + "set_exact_tokens": 33, + "mean_set_jaccard": 0.8956043956043958, + "mean_token_weighted_tv": 0.027865400681128867, + "aggregate_load_tv": 0.044871794871794865 + }, + "system_period": { + "tokens": 52, + "ordered_topk_exact_tokens": 19, + "set_exact_tokens": 28, + "mean_set_jaccard": 0.864010989010989, + "mean_token_weighted_tv": 0.035161270724179655, + "aggregate_load_tv": 0.06089743589743588 + }, + "bos_at_s0": { + "tokens": 52, + "ordered_topk_exact_tokens": 19, + "set_exact_tokens": 27, + "mean_set_jaccard": 0.8553113553113554, + "mean_token_weighted_tv": 0.031050741421775177, + "aggregate_load_tv": 0.06089743589743589 + }, + "bos_at_s1": { + "tokens": 52, + "ordered_topk_exact_tokens": 26, + "set_exact_tokens": 36, + "mean_set_jaccard": 0.8997252747252745, + "mean_token_weighted_tv": 0.030008040368556976, + "aggregate_load_tv": 0.04487179487179487 + }, + "x_at_s0": { + "tokens": 52, + "ordered_topk_exact_tokens": 19, + "set_exact_tokens": 26, + "mean_set_jaccard": 0.8415750915750917, + "mean_token_weighted_tv": 0.0327206882289969, + "aggregate_load_tv": 0.0673076923076923 + }, + "x_at_s1": { + "tokens": 52, + "ordered_topk_exact_tokens": 21, + "set_exact_tokens": 27, + "mean_set_jaccard": 0.842032967032967, + "mean_token_weighted_tv": 0.03996036647675702, + "aggregate_load_tv": 0.0641025641025641 + }, + "period_at_s0": { + "tokens": 52, + "ordered_topk_exact_tokens": 25, + "set_exact_tokens": 30, + "mean_set_jaccard": 0.8635531135531136, + "mean_token_weighted_tv": 0.03207787514950793, + "aggregate_load_tv": 0.0641025641025641 + }, + "period_at_s1": { + "tokens": 52, + "ordered_topk_exact_tokens": 18, + "set_exact_tokens": 25, + "mean_set_jaccard": 0.8278388278388279, + "mean_token_weighted_tv": 0.04387076807996401, + "aggregate_load_tv": 0.07051282051282051 + } + } + }, + "layer_21": { + "layer": 21, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "493889d8d0cbfa316aa51ff01eabebb0f3f1b1684817c5882e0fb3b8f30dac8b", + "route_weight_sha256": "540c561161cc864674416648ddc28305169ae05866522c1a7d57697021a7dd94", + "loads": [ + 5, + 16, + 14, + 0, + 0, + 2, + 7, + 1, + 4, + 0, + 19, + 2, + 4, + 0, + 2, + 2, + 0, + 14, + 5, + 4, + 3, + 8, + 3, + 3, + 4, + 5, + 8, + 4, + 2, + 3, + 5, + 2, + 3, + 0, + 7, + 22, + 0, + 1, + 9, + 1, + 2, + 10, + 6, + 1, + 0, + 0, + 1, + 4, + 3, + 2, + 1, + 1, + 5, + 4, + 1, + 15, + 17, + 7, + 12, + 2, + 2, + 21, + 0, + 1 + ], + "weighted_loads": [ + 0.27317318692803383, + 2.7750591300427914, + 1.6822920478880405, + 0.0, + 0.0, + 0.12183849886059761, + 0.36572346091270447, + 0.032686490565538406, + 0.17535892501473427, + 0.0, + 1.314155250787735, + 0.08426125347614288, + 0.38180312886834145, + 0.0, + 0.07534540817141533, + 0.0741995070129633, + 0.0, + 1.05064357817173, + 0.4265612047165632, + 0.12198266759514809, + 0.1416790522634983, + 1.6316768433898687, + 0.21321813389658928, + 0.10150977782905102, + 0.24742558598518372, + 0.16793418489396572, + 0.4480868000537157, + 0.2829888053238392, + 0.061064206063747406, + 0.11770967021584511, + 0.16479420848190784, + 0.05807924643158913, + 0.18661293759942055, + 0.0, + 0.3589943293482065, + 2.1836490258574486, + 0.0, + 0.03607124835252762, + 0.7295540496706963, + 0.032247815281152725, + 0.06783417239785194, + 0.47800797410309315, + 0.48563926108181477, + 0.09055006504058838, + 0.0, + 0.0, + 0.04252432659268379, + 0.3623502738773823, + 0.10446305572986603, + 0.08092828840017319, + 0.0361003503203392, + 0.0573703870177269, + 0.391180120408535, + 0.13345638290047646, + 0.02683696523308754, + 1.3771531507372856, + 2.7422802075743675, + 0.44791800156235695, + 0.8886627648025751, + 0.060409704223275185, + 0.0685206688940525, + 2.584879446774721, + 0.0, + 0.08944682776927948 + ], + "unique_experts": 54, + "load_cv": 1.1185484159583199, + "normalized_load_entropy": 0.8683133714022504, + "max_load_share": 0.07051282051282051 + }, + "full_input": { + "tokens": 77, + "top_k": 6, + "decisions": 462, + "ordered_route_sha256": "f7de1c8f9a08477a2bdda7639eec7db9e75fd7db44779efb9c9503ffbd88a455", + "route_weight_sha256": "fe81e52b2774005cfc0a51fd4614f3a52160ada0da6593f09951913eb229db14", + "loads": [ + 5, + 17, + 17, + 0, + 6, + 2, + 10, + 1, + 6, + 0, + 27, + 2, + 8, + 5, + 5, + 8, + 2, + 17, + 5, + 9, + 3, + 16, + 3, + 4, + 4, + 6, + 17, + 9, + 5, + 3, + 7, + 3, + 4, + 0, + 8, + 31, + 0, + 1, + 9, + 4, + 3, + 10, + 10, + 1, + 0, + 0, + 1, + 4, + 13, + 4, + 1, + 8, + 15, + 5, + 5, + 18, + 18, + 7, + 15, + 4, + 3, + 22, + 5, + 1 + ], + "weighted_loads": [ + 0.27317318692803383, + 2.8173663690686226, + 1.7573412952478975, + 0.0, + 0.22633840143680573, + 0.12183849886059761, + 0.6324741058051586, + 0.032686490565538406, + 0.31289733573794365, + 0.0, + 1.7435066662728786, + 0.08426125347614288, + 0.5740057826042175, + 0.31606969237327576, + 0.2015340682119131, + 0.27897948306053877, + 0.062228694558143616, + 1.1359891653992236, + 0.4265612047165632, + 1.7084644697606564, + 0.1416790522634983, + 2.0924038873054087, + 0.21321813389658928, + 0.14585302211344242, + 0.24742558598518372, + 0.20526937954127789, + 0.8733717296272516, + 0.6603331454098225, + 0.12032991833984852, + 0.11770967021584511, + 0.2303207591176033, + 0.10763304308056831, + 0.20946465618908405, + 0.0, + 0.4082558657974005, + 2.739627443253994, + 0.0, + 0.03607124835252762, + 0.7295540496706963, + 0.15377676114439964, + 0.12096747756004333, + 0.47800797410309315, + 0.7322542164474726, + 0.09055006504058838, + 0.0, + 0.0, + 0.04252432659268379, + 0.3623502738773823, + 0.652832381427288, + 0.2731793746352196, + 0.0361003503203392, + 0.3791974224150181, + 1.024024035781622, + 0.14644800685346127, + 0.15433618891984224, + 1.6429974101483822, + 2.7833534628152847, + 0.44791800156235695, + 1.019153082743287, + 0.12921716831624508, + 0.0907478854060173, + 2.6325880587100983, + 0.2066410854458809, + 0.08944682776927948 + ], + "unique_experts": 58, + "load_cv": 0.9336107820758676, + "normalized_load_entropy": 0.9024447132997581, + "max_load_share": 0.0670995670995671 + } + }, + "s1_eos": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "7deed4b6c183ced070f0631594e50ece72d06acb0bb6ee4db5ec88c7eb9b8b11", + "route_weight_sha256": "f0f14e3ff49b5b33d542ac24ef80948bf3e1054f1b027115496407050d931a2a", + "loads": [ + 6, + 16, + 14, + 0, + 0, + 2, + 8, + 1, + 4, + 0, + 19, + 2, + 4, + 0, + 2, + 2, + 0, + 13, + 5, + 5, + 3, + 8, + 3, + 3, + 4, + 5, + 8, + 4, + 1, + 2, + 3, + 3, + 3, + 0, + 7, + 21, + 0, + 2, + 9, + 1, + 2, + 10, + 6, + 1, + 0, + 0, + 1, + 4, + 3, + 1, + 1, + 1, + 6, + 5, + 1, + 15, + 17, + 6, + 11, + 2, + 3, + 21, + 0, + 2 + ], + "weighted_loads": [ + 0.31032056361436844, + 2.7476655207574368, + 1.6649721432477236, + 0.0, + 0.0, + 0.13205698877573013, + 0.411675488576293, + 0.034096475690603256, + 0.16852083429694176, + 0.0, + 1.2934155743569136, + 0.0830606259405613, + 0.37235093861818314, + 0.0, + 0.07149453833699226, + 0.06901084911078215, + 0.0, + 1.0056209452450275, + 0.4210949335247278, + 0.15600488893687725, + 0.12840759754180908, + 1.5911994595080614, + 0.21506719291210175, + 0.10925368592143059, + 0.2526671811938286, + 0.17665261402726173, + 0.4494110718369484, + 0.27919717505574226, + 0.03310386463999748, + 0.08212745189666748, + 0.08881813287734985, + 0.09987642988562584, + 0.18957644328474998, + 0.0, + 0.3743634093552828, + 2.1716610975563526, + 0.0, + 0.062452876940369606, + 0.7150252684950829, + 0.03534422442317009, + 0.06393000669777393, + 0.4683531615883112, + 0.4994006287306547, + 0.09073954075574875, + 0.0, + 0.0, + 0.03878520056605339, + 0.36121948435902596, + 0.10294893756508827, + 0.04026700556278229, + 0.034254975616931915, + 0.059044308960437775, + 0.40259423665702343, + 0.16571937315165997, + 0.02813796140253544, + 1.3934904262423515, + 2.74345351010561, + 0.39381246641278267, + 0.8802322093397379, + 0.054383693262934685, + 0.09268070571124554, + 2.540436662733555, + 0.0, + 0.11502655036747456 + ], + "unique_experts": 54, + "load_cv": 1.1001763052782016, + "normalized_load_entropy": 0.870933774112837, + "max_load_share": 0.0673076923076923 + }, + "full_input": { + "tokens": 93, + "top_k": 6, + "decisions": 558, + "ordered_route_sha256": "a9da979ea95a2e3ad5dc0ef09807c0e5738b868bef40be11a47e8a93ab8574a6", + "route_weight_sha256": "4477a21846767cb6a1f11d169b9c12723a271fe99f85c39da6c54b36b66434a3", + "loads": [ + 13, + 18, + 17, + 0, + 0, + 3, + 12, + 2, + 9, + 2, + 29, + 3, + 9, + 10, + 10, + 7, + 2, + 21, + 7, + 10, + 4, + 15, + 4, + 8, + 5, + 8, + 16, + 13, + 4, + 3, + 7, + 4, + 4, + 4, + 7, + 39, + 1, + 3, + 10, + 3, + 3, + 12, + 13, + 2, + 1, + 1, + 1, + 4, + 14, + 5, + 3, + 11, + 16, + 6, + 15, + 25, + 21, + 6, + 14, + 5, + 4, + 23, + 4, + 3 + ], + "weighted_loads": [ + 0.7783602401614189, + 2.8292194828391075, + 2.356208172161132, + 0.0, + 0.0, + 0.14735741168260574, + 0.5901726726442575, + 0.11383112892508507, + 0.4127714093774557, + 0.14548452012240887, + 1.7871402855962515, + 0.13258790224790573, + 0.630510039627552, + 0.5522814653813839, + 0.3906316813081503, + 0.24488153494894505, + 0.05832705646753311, + 1.2914470061659813, + 0.47463170625269413, + 1.7295940201729536, + 0.17557818815112114, + 2.031149103771895, + 0.24587349221110344, + 0.6010682657361031, + 0.28815045207738876, + 0.27367870695888996, + 0.7374784052371979, + 1.0569996908307076, + 0.06830834038555622, + 0.1309673935174942, + 0.24794617481529713, + 0.14474284648895264, + 0.21224718913435936, + 0.5948567390441895, + 0.3743634093552828, + 3.1412132028490305, + 0.07105211913585663, + 0.10336622782051563, + 0.7706512585282326, + 0.12719496339559555, + 0.10148665122687817, + 0.590259937569499, + 0.8729899134486914, + 0.138757836073637, + 0.06658875942230225, + 0.06036430969834328, + 0.03878520056605339, + 0.36121948435902596, + 0.9209420848637819, + 1.0268401987850666, + 0.11416416801512241, + 0.7892509773373604, + 0.9871153552085161, + 0.17871099710464478, + 0.8040550081059337, + 2.0310718342661858, + 2.899665916338563, + 0.39381246641278267, + 1.020499398931861, + 0.21964010037481785, + 0.11506655812263489, + 2.6408966183662415, + 0.16033277660608292, + 0.20811433531343937 + ], + "unique_experts": 62, + "load_cv": 0.8703037426456028, + "normalized_load_entropy": 0.9182898569846847, + "max_load_share": 0.06989247311827956 + } + }, + "s0_bos": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "2fef4feda6fa83fcea3ba4f7b18640c0bdc9a4ee894bd161e343d5bea814479f", + "route_weight_sha256": "b4da504d047cb7b72eabcf4bfcf2026e5087552ea4f32957d3d0a1ed44cb3514", + "loads": [ + 5, + 17, + 13, + 0, + 1, + 2, + 8, + 0, + 4, + 0, + 19, + 2, + 4, + 0, + 2, + 2, + 0, + 13, + 5, + 4, + 3, + 8, + 2, + 3, + 4, + 4, + 7, + 4, + 1, + 3, + 4, + 4, + 3, + 0, + 8, + 22, + 0, + 1, + 9, + 2, + 2, + 10, + 6, + 1, + 0, + 0, + 1, + 5, + 3, + 3, + 1, + 1, + 5, + 5, + 0, + 16, + 17, + 6, + 11, + 2, + 2, + 21, + 0, + 1 + ], + "weighted_loads": [ + 0.25282055512070656, + 2.754472890868783, + 1.6302823927253485, + 0.0, + 0.031057724729180336, + 0.12614737823605537, + 0.4145946782082319, + 0.0, + 0.1792151965200901, + 0.0, + 1.2860025502741337, + 0.08732442930340767, + 0.40211337246000767, + 0.0, + 0.07105033472180367, + 0.07617941219359636, + 0.0, + 1.0221114363521338, + 0.3969975560903549, + 0.1253383420407772, + 0.1367707997560501, + 1.7875236812978983, + 0.1749156042933464, + 0.09262567572295666, + 0.24856456369161606, + 0.15483755990862846, + 0.3967977538704872, + 0.27105487138032913, + 0.03201480582356453, + 0.11029934883117676, + 0.13604604452848434, + 0.13251696713268757, + 0.19455357640981674, + 0.0, + 0.4244264308363199, + 2.202023644000292, + 0.0, + 0.03480046987533569, + 0.7505795210599899, + 0.07078959792852402, + 0.07511096447706223, + 0.48903914354741573, + 0.4792615380138159, + 0.08469799160957336, + 0.0, + 0.0, + 0.03872828558087349, + 0.38748252019286156, + 0.08728411048650742, + 0.1163059864193201, + 0.03345000371336937, + 0.0774400383234024, + 0.38767529278993607, + 0.16686895675957203, + 0.0, + 1.4042783416807652, + 2.774776104837656, + 0.3958108238875866, + 0.8759315628558397, + 0.05585406348109245, + 0.07413699850440025, + 2.627121075987816, + 0.0, + 0.09459581226110458 + ], + "unique_experts": 53, + "load_cv": 1.1185484159583199, + "normalized_load_entropy": 0.8673892217692054, + "max_load_share": 0.07051282051282051 + }, + "full_input": { + "tokens": 77, + "top_k": 6, + "decisions": 462, + "ordered_route_sha256": "c16616334ec3e2d79f439dea0cde56318797030ff7093d018bbc86bd80bdeb9c", + "route_weight_sha256": "9323e61523aac4f3593c41c4b10c76807c22af9f4e410c2673575f75cf639e7b", + "loads": [ + 5, + 19, + 15, + 1, + 6, + 2, + 10, + 1, + 7, + 0, + 24, + 2, + 8, + 5, + 4, + 7, + 2, + 15, + 7, + 7, + 3, + 15, + 2, + 4, + 4, + 5, + 15, + 9, + 4, + 3, + 5, + 7, + 4, + 0, + 9, + 31, + 0, + 1, + 9, + 6, + 4, + 10, + 10, + 1, + 0, + 1, + 1, + 5, + 13, + 5, + 1, + 8, + 15, + 6, + 5, + 20, + 18, + 6, + 13, + 4, + 3, + 23, + 6, + 1 + ], + "weighted_loads": [ + 0.25282055512070656, + 2.8382659684866667, + 1.702800940722227, + 0.19856595993041992, + 0.2225156594067812, + 0.12614737823605537, + 0.6261900048702955, + 0.034578435122966766, + 0.34639670327305794, + 0.0, + 1.5608521588146687, + 0.08732442930340767, + 0.590728810057044, + 0.31763048097491264, + 0.16770984046161175, + 0.26865509431809187, + 0.05114058032631874, + 1.1034219767898321, + 0.4940379820764065, + 0.7373445145785809, + 0.1367707997560501, + 2.2472144179046154, + 0.1749156042933464, + 0.13696892000734806, + 0.24856456369161606, + 0.19217275455594063, + 0.774729061871767, + 0.6561483144760132, + 0.1171812042593956, + 0.11029934883117676, + 0.1724095717072487, + 0.3313452396541834, + 0.21740529499948025, + 0.0, + 0.4736879672855139, + 2.7580020613968372, + 0.0, + 0.03480046987533569, + 0.7505795210599899, + 0.23110555484890938, + 0.20628532022237778, + 0.48903914354741573, + 0.7160676587373018, + 0.08469799160957336, + 0.0, + 0.10810276865959167, + 0.03872828558087349, + 0.38748252019286156, + 0.6356534361839294, + 0.28936408273875713, + 0.03345000371336937, + 0.3992670737206936, + 1.020519208163023, + 0.17986058071255684, + 0.15996109414845705, + 1.7011366914957762, + 2.8158493600785732, + 0.3958108238875866, + 0.9382480066269636, + 0.12466152757406235, + 0.09636421501636505, + 2.7086889035999775, + 0.26906339451670647, + 0.09459581226110458 + ], + "unique_experts": 60, + "load_cv": 0.9019197680529696, + "normalized_load_entropy": 0.9097498641693361, + "max_load_share": 0.0670995670995671 + } + }, + "s1_bos": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "a64e4f72d4a2dc18e5df32d5cc6721c399d0d1ca117e5d1c1efa21c1e96af093", + "route_weight_sha256": "c0a8652574d7b39b60fa9b7650531d94f8ffe141e53132d4e8eb53503a97d4fd", + "loads": [ + 5, + 16, + 14, + 0, + 1, + 2, + 9, + 0, + 4, + 0, + 19, + 2, + 5, + 1, + 2, + 2, + 0, + 14, + 4, + 4, + 3, + 8, + 2, + 3, + 4, + 4, + 8, + 4, + 1, + 2, + 6, + 2, + 3, + 0, + 8, + 21, + 0, + 1, + 9, + 2, + 4, + 7, + 6, + 1, + 0, + 0, + 1, + 4, + 3, + 1, + 1, + 1, + 5, + 4, + 1, + 16, + 17, + 7, + 12, + 1, + 3, + 21, + 0, + 1 + ], + "weighted_loads": [ + 0.25868817791342735, + 2.7401154190301895, + 1.733257431536913, + 0.0, + 0.03498176112771034, + 0.14131848514080048, + 0.44715336337685585, + 0.0, + 0.1641094796359539, + 0.0, + 1.3136818911880255, + 0.09276849031448364, + 0.43401753529906273, + 0.03496744856238365, + 0.07460863888263702, + 0.07296684570610523, + 0.0, + 1.0536644775420427, + 0.3715860415250063, + 0.13318380154669285, + 0.1209995374083519, + 1.7234762609004974, + 0.17869075387716293, + 0.10206331871449947, + 0.24877456575632095, + 0.15940193831920624, + 0.44947319850325584, + 0.25724805518984795, + 0.03189176693558693, + 0.07599706202745438, + 0.18687694147229195, + 0.059974031522870064, + 0.19001377001404762, + 0.0, + 0.42037095315754414, + 2.1694528870284557, + 0.0, + 0.034517016261816025, + 0.7357023879885674, + 0.07251811400055885, + 0.1437978595495224, + 0.3932696282863617, + 0.48426803946495056, + 0.08503469079732895, + 0.0, + 0.0, + 0.03467690572142601, + 0.36146993190050125, + 0.09001942165195942, + 0.06383786350488663, + 0.03427208587527275, + 0.07856516540050507, + 0.3736516237258911, + 0.13023999147117138, + 0.02739434689283371, + 1.3789279609918594, + 2.770975098013878, + 0.4259210042655468, + 0.92203582637012, + 0.02262858860194683, + 0.1018852349370718, + 2.6106835566461086, + 0.0, + 0.09276215732097626 + ], + "unique_experts": 55, + "load_cv": 1.1150161489825077, + "normalized_load_entropy": 0.8689960757306696, + "max_load_share": 0.0673076923076923 + }, + "full_input": { + "tokens": 93, + "top_k": 6, + "decisions": 558, + "ordered_route_sha256": "ff976e3f903db53da32395d65408b7a9cbfc808a5d629915c8ef0f6effb7c85c", + "route_weight_sha256": "4502d3c77a60f97a64c0e06674d5bb6a1d41bc37e4e5e44592cef5e79388796a", + "loads": [ + 12, + 18, + 16, + 0, + 4, + 3, + 14, + 2, + 10, + 2, + 27, + 4, + 11, + 10, + 9, + 5, + 2, + 21, + 7, + 8, + 4, + 14, + 3, + 8, + 5, + 7, + 16, + 14, + 4, + 3, + 10, + 5, + 4, + 4, + 8, + 38, + 1, + 2, + 10, + 4, + 5, + 9, + 13, + 2, + 1, + 1, + 1, + 4, + 13, + 6, + 3, + 11, + 15, + 5, + 14, + 26, + 21, + 7, + 13, + 4, + 4, + 23, + 6, + 2 + ], + "weighted_loads": [ + 0.7267278544604778, + 2.8308762088418007, + 2.4218211751431227, + 0.0, + 0.14547976478934288, + 0.1566189080476761, + 0.7055262252688408, + 0.1161908395588398, + 0.449950585141778, + 0.14548452012240887, + 1.7363045569509268, + 0.18769598007202148, + 0.7269747536629438, + 0.5514699183404446, + 0.3697618152946234, + 0.19611418806016445, + 0.05058867856860161, + 1.3352090250700712, + 0.49452787078917027, + 0.7671520803123713, + 0.16817012801766396, + 2.1590314023196697, + 0.20949705317616463, + 0.5938778985291719, + 0.28425783663988113, + 0.25642803125083447, + 0.7375405319035053, + 1.072810783982277, + 0.09213985130190849, + 0.1248370036482811, + 0.3460049834102392, + 0.22542461939156055, + 0.212684515863657, + 0.5948567390441895, + 0.42037095315754414, + 3.1096597649157047, + 0.07105211913585663, + 0.07543036714196205, + 0.7913283780217171, + 0.15849672630429268, + 0.18863698095083237, + 0.5151764042675495, + 0.8513134270906448, + 0.1330529861152172, + 0.06658875942230225, + 0.06036430969834328, + 0.03467690572142601, + 0.36146993190050125, + 0.8769442830234766, + 1.1299795173108578, + 0.11418127827346325, + 0.8087718337774277, + 0.9581727422773838, + 0.1432316154241562, + 0.7760926755145192, + 2.020193863660097, + 2.927187504246831, + 0.4259210042655468, + 0.9470291528850794, + 0.18788499571383, + 0.12427108734846115, + 2.7169436179101467, + 0.2724803499877453, + 0.18584994226694107 + ], + "unique_experts": 63, + "load_cv": 0.8427056112705459, + "normalized_load_entropy": 0.9239636158058779, + "max_load_share": 0.06810035842293907 + } + }, + "s0_x": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "f7a7838b24e23a575ac35a4a78ff1ef5a8f67b6abf14aadc90f15f6767bd6d76", + "route_weight_sha256": "e58174a24ac7e11bc20d602fa9461edaa39e2e88d38c49bcb5139df3e887dcfc", + "loads": [ + 5, + 17, + 13, + 0, + 0, + 2, + 8, + 0, + 5, + 0, + 19, + 2, + 4, + 0, + 1, + 2, + 0, + 13, + 4, + 3, + 3, + 8, + 2, + 2, + 4, + 4, + 7, + 4, + 0, + 3, + 5, + 4, + 3, + 0, + 8, + 22, + 0, + 2, + 9, + 2, + 4, + 8, + 6, + 1, + 0, + 0, + 0, + 5, + 4, + 2, + 1, + 3, + 5, + 6, + 0, + 15, + 17, + 7, + 10, + 2, + 3, + 22, + 0, + 1 + ], + "weighted_loads": [ + 0.26523445919156075, + 2.7923992462456226, + 1.704026898369193, + 0.0, + 0.0, + 0.1335524395108223, + 0.39795906469225883, + 0.0, + 0.20358305238187313, + 0.0, + 1.2872193735092878, + 0.0846564806997776, + 0.39380270056426525, + 0.0, + 0.04113828018307686, + 0.07888377737253904, + 0.0, + 1.0254132375121117, + 0.38588114082813263, + 0.09460644796490669, + 0.13825269415974617, + 1.6792894136160612, + 0.177619069814682, + 0.06835205294191837, + 0.24168703332543373, + 0.1612685862928629, + 0.38941342383623123, + 0.2648758180439472, + 0.0, + 0.1264682076871395, + 0.1517103984951973, + 0.13394599221646786, + 0.1826794557273388, + 0.0, + 0.4257174842059612, + 2.252668973058462, + 0.0, + 0.06874971091747284, + 0.7510547302663326, + 0.06898631528019905, + 0.135507145896554, + 0.4143662452697754, + 0.48711012676358223, + 0.09601426124572754, + 0.0, + 0.0, + 0.0, + 0.38550059869885445, + 0.12470422871410847, + 0.08634136244654655, + 0.034036681056022644, + 0.13518121279776096, + 0.3745936118066311, + 0.20098519511520863, + 0.0, + 1.3807017654180527, + 2.7426807768642902, + 0.44910039007663727, + 0.8352451510727406, + 0.06470724940299988, + 0.10112852975726128, + 2.5852294750511646, + 0.0, + 0.08770479261875153 + ], + "unique_experts": 50, + "load_cv": 1.1185484159583199, + "normalized_load_entropy": 0.8641467402974172, + "max_load_share": 0.07051282051282051 + }, + "full_input": { + "tokens": 77, + "top_k": 6, + "decisions": 462, + "ordered_route_sha256": "9183fa23b8a52dadc57dae7cc6cfe842cfedcbc370bde5bb4a139b9d67ee93cf", + "route_weight_sha256": "f621449125ededf3a3f20de0080a733864b8f146a9478be9693c19b9245d1e1e", + "loads": [ + 5, + 18, + 15, + 0, + 5, + 2, + 11, + 0, + 7, + 0, + 29, + 2, + 9, + 4, + 4, + 7, + 2, + 17, + 4, + 8, + 3, + 14, + 2, + 3, + 4, + 5, + 15, + 9, + 3, + 3, + 6, + 5, + 4, + 0, + 9, + 32, + 0, + 2, + 9, + 4, + 4, + 8, + 12, + 1, + 0, + 0, + 0, + 5, + 16, + 5, + 1, + 10, + 16, + 7, + 4, + 18, + 19, + 7, + 11, + 4, + 4, + 23, + 5, + 1 + ], + "weighted_loads": [ + 0.26523445919156075, + 2.8266507871448994, + 1.7765454463660717, + 0.0, + 0.19145793467760086, + 0.1335524395108223, + 0.6550090201199055, + 0.0, + 0.3456211145967245, + 0.0, + 1.7739950101822615, + 0.0846564806997776, + 0.620226664468646, + 0.2809114381670952, + 0.15874646790325642, + 0.2797482581809163, + 0.04910482093691826, + 1.1772491373121738, + 0.38588114082813263, + 0.7687494475394487, + 0.13825269415974617, + 2.0966496765613556, + 0.177619069814682, + 0.11269529722630978, + 0.24168703332543373, + 0.19860378094017506, + 0.7673447318375111, + 0.6390538066625595, + 0.09947842173278332, + 0.1264682076871395, + 0.1887989491224289, + 0.17101405374705791, + 0.2055311743170023, + 0.0, + 0.4749790206551552, + 2.9021683000028133, + 0.0, + 0.06874971091747284, + 0.7510547302663326, + 0.15218180790543556, + 0.135507145896554, + 0.4143662452697754, + 0.821258258074522, + 0.09601426124572754, + 0.0, + 0.0, + 0.0, + 0.38550059869885445, + 0.8004781547933817, + 0.30572669580578804, + 0.034036681056022644, + 0.45700824819505215, + 1.192685142159462, + 0.21397681906819344, + 0.1274992236867547, + 1.651549231261015, + 2.8306127972900867, + 0.44910039007663727, + 0.8599040135741234, + 0.13351471349596977, + 0.12335574626922607, + 2.6397429183125496, + 0.19067611917853355, + 0.08770479261875153 + ], + "unique_experts": 56, + "load_cv": 0.9608341890184561, + "normalized_load_entropy": 0.8971478472689092, + "max_load_share": 0.06926406926406926 + } + }, + "s1_x": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "59f2403411f0120bc0f868afc465c0b583e2844267209ac93c1c21c2e2610223", + "route_weight_sha256": "fd71366d6d429128c522bf64e2eb95653ce1e4c906efc21489931f1b9d7f14d9", + "loads": [ + 7, + 16, + 14, + 0, + 0, + 2, + 8, + 0, + 3, + 0, + 19, + 1, + 4, + 0, + 1, + 2, + 0, + 13, + 3, + 5, + 3, + 8, + 2, + 2, + 4, + 4, + 8, + 4, + 1, + 3, + 5, + 4, + 3, + 0, + 8, + 21, + 0, + 2, + 8, + 1, + 5, + 8, + 6, + 1, + 0, + 0, + 0, + 5, + 5, + 2, + 1, + 2, + 5, + 6, + 0, + 15, + 17, + 7, + 11, + 2, + 2, + 22, + 0, + 1 + ], + "weighted_loads": [ + 0.3813340775668621, + 2.712111111730337, + 1.7611684147268534, + 0.0, + 0.0, + 0.14026609063148499, + 0.4145469758659601, + 0.0, + 0.1114816665649414, + 0.0, + 1.3367916848510504, + 0.05140018090605736, + 0.3700728975236416, + 0.0, + 0.0394255630671978, + 0.07504842150956392, + 0.0, + 1.0383015181869268, + 0.3410266116261482, + 0.16810270585119724, + 0.11962071992456913, + 1.7155897971242666, + 0.1744602471590042, + 0.12428225204348564, + 0.23722328059375286, + 0.1731433253735304, + 0.43538786098361015, + 0.23026596754789352, + 0.033771805465221405, + 0.11071188375353813, + 0.15992118790745735, + 0.1342824548482895, + 0.18498340249061584, + 0.0, + 0.4108188524842262, + 2.222348924726248, + 0.0, + 0.071757473051548, + 0.6753754913806915, + 0.035366278141736984, + 0.17849554307758808, + 0.4423341453075409, + 0.4727525319904089, + 0.098796047270298, + 0.0, + 0.0, + 0.0, + 0.3646235577762127, + 0.14919885993003845, + 0.09824525564908981, + 0.033523235470056534, + 0.1128167137503624, + 0.38389455899596214, + 0.1929610464721918, + 0.0, + 1.3825404271483421, + 2.7277053743600845, + 0.400159627199173, + 0.8500669430941343, + 0.06028474308550358, + 0.06297392584383488, + 2.6696265414357185, + 0.0, + 0.0874878540635109 + ], + "unique_experts": 51, + "load_cv": 1.1156056368106202, + "normalized_load_entropy": 0.863611778034875, + "max_load_share": 0.07051282051282051 + }, + "full_input": { + "tokens": 93, + "top_k": 6, + "decisions": 558, + "ordered_route_sha256": "ffb10e91e681017e2a0783c4275959c74a8f5465f1353089c179e339e6d551b7", + "route_weight_sha256": "270fdb7c1885d75005a33c2c877b063ea5ae0d68cac53d979d8e324d1cb767d1", + "loads": [ + 14, + 17, + 16, + 0, + 1, + 3, + 11, + 1, + 8, + 2, + 28, + 1, + 11, + 9, + 9, + 6, + 2, + 21, + 6, + 10, + 4, + 13, + 3, + 8, + 5, + 9, + 16, + 12, + 3, + 4, + 9, + 4, + 4, + 4, + 8, + 40, + 1, + 3, + 9, + 1, + 5, + 11, + 15, + 2, + 3, + 1, + 0, + 5, + 19, + 6, + 3, + 13, + 16, + 8, + 14, + 24, + 21, + 7, + 12, + 5, + 3, + 24, + 3, + 2 + ], + "weighted_loads": [ + 0.8493737541139126, + 2.7609236761927605, + 2.449732158333063, + 0.0, + 0.030221516266465187, + 0.1555665135383606, + 0.5217587407678366, + 0.07973465323448181, + 0.3652635160833597, + 0.14548452012240887, + 1.8155732993036509, + 0.05140018090605736, + 0.7369933873414993, + 0.5122610107064247, + 0.3352639675140381, + 0.23355224076658487, + 0.0499802865087986, + 1.3580068405717611, + 0.4289465770125389, + 0.8405258264392614, + 0.1667913105338812, + 2.1115490775555372, + 0.2052665464580059, + 0.6683256700634956, + 0.27270655147731304, + 0.3617836534976959, + 0.7234551943838596, + 0.9697997197508812, + 0.06459176912903786, + 0.15955182537436485, + 0.3190492298454046, + 0.1342824548482895, + 0.20765414834022522, + 0.5948567390441895, + 0.4108188524842262, + 3.2686472795903683, + 0.07105211913585663, + 0.11267082393169403, + 0.7310014814138412, + 0.035366278141736984, + 0.17849554307758808, + 0.6405938528478146, + 0.9390559587627649, + 0.14681434258818626, + 0.1482844427227974, + 0.06036430969834328, + 0.0, + 0.3646235577762127, + 1.2238323893398046, + 1.0502729788422585, + 0.11343242786824703, + 0.871611537411809, + 1.1728438287973404, + 0.2411925420165062, + 0.7788882637396455, + 2.0154581665992737, + 2.8839177805930376, + 0.400159627199173, + 0.8750602696090937, + 0.22554115019738674, + 0.08535977825522423, + 2.7685565389692783, + 0.11267002671957016, + 0.1805756390094757 + ], + "unique_experts": 62, + "load_cv": 0.8801673532344702, + "normalized_load_entropy": 0.91543553085054, + "max_load_share": 0.07168458781362007 + } + }, + "s0_period": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "76077e8305efdd4df3d54d6f1b99593d94cf08f8cf5db20e90d9f140807704c6", + "route_weight_sha256": "8280a0200ba00579a01dbf2e6975c0dd5c68d860e4262f7087d93d15b4432040", + "loads": [ + 5, + 17, + 13, + 0, + 0, + 2, + 8, + 0, + 4, + 0, + 20, + 2, + 5, + 0, + 2, + 2, + 0, + 13, + 3, + 4, + 3, + 8, + 2, + 2, + 4, + 4, + 6, + 4, + 1, + 3, + 5, + 4, + 3, + 0, + 8, + 22, + 0, + 2, + 9, + 1, + 5, + 8, + 6, + 1, + 0, + 0, + 1, + 5, + 4, + 2, + 1, + 1, + 5, + 5, + 0, + 16, + 17, + 7, + 11, + 2, + 2, + 21, + 0, + 1 + ], + "weighted_loads": [ + 0.2650374174118042, + 2.811720183119178, + 1.6797921527177095, + 0.0, + 0.0, + 0.13350144401192665, + 0.40061899460852146, + 0.0, + 0.17917680740356445, + 0.0, + 1.3350278865545988, + 0.08326113037765026, + 0.44869025610387325, + 0.0, + 0.06712828576564789, + 0.08328445162624121, + 0.0, + 1.0383130833506584, + 0.35378025472164154, + 0.12398713640868664, + 0.13186600990593433, + 1.8060802295804024, + 0.17378655076026917, + 0.0665987990796566, + 0.24600226059556007, + 0.1644532810896635, + 0.3499469105154276, + 0.2622593529522419, + 0.032060422003269196, + 0.1317392811179161, + 0.15844064205884933, + 0.1301404982805252, + 0.18394899740815163, + 0.0, + 0.4094562176615, + 2.304560575634241, + 0.0, + 0.06953176483511925, + 0.7659565806388855, + 0.03329628333449364, + 0.16687815636396408, + 0.4089338332414627, + 0.49828330241143703, + 0.10154678672552109, + 0.0, + 0.0, + 0.037708580493927, + 0.38783662393689156, + 0.12552732788026333, + 0.08557023108005524, + 0.036496106535196304, + 0.07752660661935806, + 0.3876672759652138, + 0.16836155392229557, + 0.0, + 1.4447560645639896, + 2.711139239370823, + 0.4645996280014515, + 0.8584100771695375, + 0.06432043388485909, + 0.07601289823651314, + 2.5981450714170933, + 0.0, + 0.08536214381456375 + ], + "unique_experts": 52, + "load_cv": 1.1249954342810413, + "normalized_load_entropy": 0.8651359289604488, + "max_load_share": 0.07051282051282051 + }, + "full_input": { + "tokens": 77, + "top_k": 6, + "decisions": 462, + "ordered_route_sha256": "fc0a3fa6f580e4f52ebed35755f69a39dcf547741085ea5a8532ca35bc25999a", + "route_weight_sha256": "84af495e57988685adc1a8419292a8af9e91927eaf17a1d6da7077807f980dd2", + "loads": [ + 5, + 18, + 15, + 0, + 7, + 2, + 11, + 0, + 6, + 0, + 27, + 2, + 11, + 5, + 5, + 7, + 2, + 16, + 4, + 6, + 3, + 14, + 2, + 3, + 4, + 5, + 14, + 9, + 4, + 3, + 6, + 5, + 4, + 0, + 9, + 32, + 0, + 2, + 9, + 3, + 5, + 8, + 11, + 1, + 0, + 0, + 1, + 5, + 15, + 5, + 1, + 9, + 15, + 6, + 7, + 20, + 18, + 7, + 12, + 5, + 3, + 22, + 5, + 1 + ], + "weighted_loads": [ + 0.2650374174118042, + 2.8462971467524767, + 1.7523107007145882, + 0.0, + 0.26154813170433044, + 0.13350144401192665, + 0.6919439900666475, + 0.0, + 0.3104071840643883, + 0.0, + 1.6964437309652567, + 0.08326113037765026, + 0.7158484142273664, + 0.3142959848046303, + 0.1967568565160036, + 0.28297044802457094, + 0.048907630145549774, + 1.157779473811388, + 0.3876403123140335, + 0.7008100245147943, + 0.13186600990593433, + 2.2234404925256968, + 0.17378655076026917, + 0.110942043364048, + 0.24600226059556007, + 0.20178847573697567, + 0.7278782185167074, + 0.6428027711808681, + 0.12637911178171635, + 0.1317392811179161, + 0.1978815346956253, + 0.16386014968156815, + 0.20680071599781513, + 0.0, + 0.45871775411069393, + 2.918657872825861, + 0.0, + 0.06953176483511925, + 0.7659565806388855, + 0.11929444968700409, + 0.16687815636396408, + 0.4089338332414627, + 0.7921024244278669, + 0.10154678672552109, + 0.0, + 0.0, + 0.037708580493927, + 0.38783662393689156, + 0.7499007266014814, + 0.3673124499619007, + 0.036496106535196304, + 0.4647994600236416, + 1.0205111913383007, + 0.18135317787528038, + 0.22254875395447016, + 1.7949157431721687, + 2.75221249461174, + 0.4645996280014515, + 0.8830689396709204, + 0.2152378186583519, + 0.09824011474847794, + 2.6497835107147694, + 0.20255209878087044, + 0.08536214381456375 + ], + "unique_experts": 57, + "load_cv": 0.931037905306382, + "normalized_load_entropy": 0.902681366821935, + "max_load_share": 0.06926406926406926 + } + }, + "s1_period": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "a4546288cd77b04aa29d8f5132765c1207999336a700f5ed1322bbb515d66ca0", + "route_weight_sha256": "e02f61813832e8ee97891b11ccba2fb1a068b4baae37cb54d03956b206e532ef", + "loads": [ + 7, + 15, + 13, + 0, + 0, + 2, + 8, + 0, + 4, + 0, + 19, + 1, + 3, + 0, + 2, + 2, + 1, + 14, + 4, + 6, + 2, + 8, + 2, + 3, + 4, + 4, + 8, + 4, + 1, + 3, + 5, + 3, + 3, + 0, + 8, + 21, + 0, + 2, + 8, + 1, + 5, + 8, + 6, + 1, + 0, + 0, + 1, + 4, + 3, + 2, + 1, + 3, + 5, + 5, + 0, + 16, + 17, + 7, + 11, + 1, + 1, + 23, + 0, + 1 + ], + "weighted_loads": [ + 0.3442762494087219, + 2.6731035821139812, + 1.6974098104983568, + 0.0, + 0.0, + 0.14563055336475372, + 0.43569636531174183, + 0.0, + 0.16876187920570374, + 0.0, + 1.3057227283716202, + 0.05184272304177284, + 0.3433879315853119, + 0.0, + 0.07067427597939968, + 0.07410705834627151, + 0.028584947809576988, + 1.0645460076630116, + 0.3614092990756035, + 0.20124725066125393, + 0.09529374167323112, + 1.7052114438265562, + 0.17985114455223083, + 0.18609360232949257, + 0.23032060265541077, + 0.17856958881020546, + 0.44706664234399796, + 0.24571005627512932, + 0.03529474511742592, + 0.10932479426264763, + 0.16420391388237476, + 0.11137476935982704, + 0.1827518679201603, + 0.0, + 0.4083913452923298, + 2.1893294155597687, + 0.0, + 0.07550905272364616, + 0.7063572145998478, + 0.03346793353557587, + 0.18103092722594738, + 0.4561694674193859, + 0.4639404285699129, + 0.09429648518562317, + 0.0, + 0.0, + 0.04356587678194046, + 0.33121201395988464, + 0.09550355188548565, + 0.09847274422645569, + 0.03462342917919159, + 0.13720634393393993, + 0.3674634285271168, + 0.1567192766815424, + 0.0, + 1.3824281319975853, + 2.725666131824255, + 0.40067149698734283, + 0.872649485245347, + 0.022898690775036812, + 0.03194921836256981, + 2.666353650391102, + 0.0, + 0.08825121074914932 + ], + "unique_experts": 53, + "load_cv": 1.1226553476404941, + "normalized_load_entropy": 0.8656283787641784, + "max_load_share": 0.07371794871794872 + }, + "full_input": { + "tokens": 93, + "top_k": 6, + "decisions": 558, + "ordered_route_sha256": "f125f65d0230bed342a39e938ae9108970d91bdd4eed80bcf05971f6f8694b38", + "route_weight_sha256": "f9a758db0af4c2a2fde6e5ebe7f6d09642962299dabc3bb7ee4f1f5e758126a7", + "loads": [ + 14, + 16, + 15, + 0, + 1, + 3, + 12, + 1, + 8, + 2, + 27, + 1, + 9, + 10, + 9, + 6, + 3, + 21, + 7, + 12, + 3, + 13, + 3, + 9, + 5, + 7, + 16, + 12, + 3, + 4, + 9, + 3, + 4, + 5, + 8, + 42, + 1, + 3, + 9, + 1, + 7, + 10, + 15, + 2, + 2, + 1, + 1, + 4, + 16, + 7, + 3, + 14, + 15, + 6, + 15, + 27, + 21, + 7, + 12, + 6, + 2, + 25, + 1, + 2 + ], + "weighted_loads": [ + 0.8123159259557724, + 2.7219161465764046, + 2.3859735541045666, + 0.0, + 0.04062015190720558, + 0.16093097627162933, + 0.6059702839702368, + 0.07973465323448181, + 0.38664272986352444, + 0.14548452012240887, + 1.746715359389782, + 0.05184272304177284, + 0.7017450332641602, + 0.5464394837617874, + 0.3457215875387192, + 0.2419591322541237, + 0.07495013810694218, + 1.34609055519104, + 0.45697829499840736, + 0.9145203549414873, + 0.14246433228254318, + 2.101170724257827, + 0.21065744385123253, + 0.7382322028279305, + 0.26580387353897095, + 0.2755956817418337, + 0.7351339757442474, + 0.9888755939900875, + 0.06611470878124237, + 0.15816473588347435, + 0.32333195582032204, + 0.11137476935982704, + 0.20542261376976967, + 0.6251892186701298, + 0.4083913452923298, + 3.2889132909476757, + 0.07105211913585663, + 0.11642240360379219, + 0.7619832046329975, + 0.03346793353557587, + 0.24791586585342884, + 0.5780762434005737, + 0.9606637377291918, + 0.14231478050351143, + 0.10798276215791702, + 0.06036430969834328, + 0.04356587678194046, + 0.33121201395988464, + 1.012352529913187, + 1.1901973485946655, + 0.11453262157738209, + 0.9334465470165014, + 0.9519845470786095, + 0.1697109006345272, + 0.830900433473289, + 2.1152458786964417, + 2.881878538057208, + 0.40067149698734283, + 0.8976428117603064, + 0.29698590002954006, + 0.05433507077395916, + 2.7626970149576664, + 0.035965416580438614, + 0.18133899569511414 + ], + "unique_experts": 63, + "load_cv": 0.9013962810310657, + "normalized_load_entropy": 0.913115619321288, + "max_load_share": 0.07526881720430108 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 52, + "ordered_topk_exact_tokens": 37, + "set_exact_tokens": 40, + "mean_set_jaccard": 0.9340659340659341, + "mean_token_weighted_tv": 0.01673927368560376, + "aggregate_load_tv": 0.02884615384615385 + }, + "system_bos": { + "tokens": 52, + "ordered_topk_exact_tokens": 26, + "set_exact_tokens": 33, + "mean_set_jaccard": 0.8956043956043955, + "mean_token_weighted_tv": 0.02487325756989706, + "aggregate_load_tv": 0.04487179487179487 + }, + "system_x": { + "tokens": 52, + "ordered_topk_exact_tokens": 25, + "set_exact_tokens": 38, + "mean_set_jaccard": 0.9189560439560439, + "mean_token_weighted_tv": 0.025994933461054012, + "aggregate_load_tv": 0.032051282051282055 + }, + "system_period": { + "tokens": 52, + "ordered_topk_exact_tokens": 26, + "set_exact_tokens": 33, + "mean_set_jaccard": 0.8873626373626373, + "mean_token_weighted_tv": 0.033720752000450514, + "aggregate_load_tv": 0.04487179487179488 + }, + "bos_at_s0": { + "tokens": 52, + "ordered_topk_exact_tokens": 34, + "set_exact_tokens": 39, + "mean_set_jaccard": 0.9285714285714287, + "mean_token_weighted_tv": 0.026375044217834678, + "aggregate_load_tv": 0.035256410256410256 + }, + "bos_at_s1": { + "tokens": 52, + "ordered_topk_exact_tokens": 25, + "set_exact_tokens": 33, + "mean_set_jaccard": 0.8956043956043955, + "mean_token_weighted_tv": 0.03216057873438471, + "aggregate_load_tv": 0.04807692307692307 + }, + "x_at_s0": { + "tokens": 52, + "ordered_topk_exact_tokens": 22, + "set_exact_tokens": 29, + "mean_set_jaccard": 0.8736263736263736, + "mean_token_weighted_tv": 0.030524514875231452, + "aggregate_load_tv": 0.057692307692307696 + }, + "x_at_s1": { + "tokens": 52, + "ordered_topk_exact_tokens": 21, + "set_exact_tokens": 31, + "mean_set_jaccard": 0.8722527472527474, + "mean_token_weighted_tv": 0.036606653880041376, + "aggregate_load_tv": 0.05448717948717949 + }, + "period_at_s0": { + "tokens": 52, + "ordered_topk_exact_tokens": 29, + "set_exact_tokens": 34, + "mean_set_jaccard": 0.896978021978022, + "mean_token_weighted_tv": 0.030607780575967178, + "aggregate_load_tv": 0.04807692307692307 + }, + "period_at_s1": { + "tokens": 52, + "ordered_topk_exact_tokens": 24, + "set_exact_tokens": 31, + "mean_set_jaccard": 0.8763736263736264, + "mean_token_weighted_tv": 0.0365045221719461, + "aggregate_load_tv": 0.05769230769230769 + } + } + }, + "layer_22": { + "layer": 22, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "a89e987394af20eea0fe71cb09b212afba5973576e7fc22419c7e196da387e24", + "route_weight_sha256": "369b20ad8b416ff979265a5aeaf0b6d56268e42b83c172936143d5533cc05134", + "loads": [ + 16, + 2, + 1, + 16, + 3, + 11, + 11, + 1, + 9, + 4, + 2, + 8, + 5, + 0, + 12, + 2, + 2, + 14, + 2, + 2, + 4, + 2, + 0, + 3, + 0, + 6, + 0, + 4, + 3, + 0, + 0, + 3, + 4, + 6, + 0, + 3, + 7, + 2, + 4, + 0, + 1, + 1, + 9, + 4, + 11, + 0, + 1, + 3, + 1, + 18, + 2, + 1, + 0, + 13, + 3, + 4, + 8, + 13, + 2, + 6, + 1, + 9, + 27, + 0 + ], + "weighted_loads": [ + 1.3977491091936827, + 0.10631812363862991, + 0.042749837040901184, + 2.266481142491102, + 0.3246935196220875, + 0.5124880559742451, + 0.727292574942112, + 0.057616665959358215, + 0.5572437755763531, + 0.2247719056904316, + 0.07950246706604958, + 0.43116006441414356, + 0.22614971548318863, + 0.0, + 0.5075074955821037, + 0.06673170253634453, + 0.1476667821407318, + 1.521428832784295, + 0.07292616739869118, + 0.123763807117939, + 0.3387099504470825, + 0.12804048880934715, + 0.0, + 0.14334389939904213, + 0.0, + 0.34589363262057304, + 0.0, + 0.13941144570708275, + 0.20427662879228592, + 0.0, + 0.0, + 0.15458029881119728, + 0.13612929545342922, + 0.2928137294948101, + 0.0, + 0.12296456284821033, + 0.4818806629627943, + 0.07011515274643898, + 0.22670457512140274, + 0.0, + 0.04158199951052666, + 0.03193092718720436, + 0.32988317497074604, + 0.23975178599357605, + 0.4710998386144638, + 0.0, + 0.06161212921142578, + 0.11982665210962296, + 0.033302657306194305, + 4.437252506613731, + 0.07523638941347599, + 0.0653335377573967, + 0.0, + 0.8639754541218281, + 0.12630686536431313, + 0.24033570103347301, + 0.7725114896893501, + 0.7095831632614136, + 0.169814832508564, + 0.35049591958522797, + 0.10842524468898773, + 0.4882262051105499, + 4.305186990648508, + 0.0 + ], + "unique_experts": 53, + "load_cv": 1.1061361338524611, + "normalized_load_entropy": 0.8687217132481726, + "max_load_share": 0.08653846153846154 + }, + "full_input": { + "tokens": 77, + "top_k": 6, + "decisions": 462, + "ordered_route_sha256": "9101520ff0386e1f09f71123ce2462a62c8826f1bb870be14147d6d2054bfbcf", + "route_weight_sha256": "e7c6cfbbe207939688f064c7d490e08bfaf7bf1be95d7d6f548b69c28ddda2c1", + "loads": [ + 20, + 3, + 3, + 25, + 3, + 13, + 15, + 2, + 23, + 9, + 2, + 10, + 5, + 0, + 17, + 2, + 2, + 15, + 2, + 2, + 5, + 9, + 1, + 4, + 0, + 8, + 0, + 9, + 3, + 0, + 0, + 3, + 8, + 12, + 2, + 7, + 7, + 3, + 4, + 0, + 5, + 2, + 13, + 4, + 12, + 1, + 2, + 3, + 4, + 20, + 6, + 1, + 0, + 15, + 3, + 19, + 11, + 15, + 2, + 6, + 9, + 17, + 28, + 6 + ], + "weighted_loads": [ + 1.57269702013582, + 0.1566375307738781, + 0.12282876670360565, + 4.135037764906883, + 0.3246935196220875, + 0.5824960581958294, + 0.950315267778933, + 0.11036580055952072, + 1.7822160935029387, + 0.4185240063816309, + 0.07950246706604958, + 0.46056068502366543, + 0.22614971548318863, + 0.0, + 1.3157665552571416, + 0.06673170253634453, + 0.1476667821407318, + 1.5471892766654491, + 0.07292616739869118, + 0.123763807117939, + 0.36697273328900337, + 0.7153115719556808, + 0.028518391773104668, + 0.2062361277639866, + 0.0, + 0.40607000328600407, + 0.0, + 0.34534348361194134, + 0.20427662879228592, + 0.0, + 0.0, + 0.15458029881119728, + 0.24200899386778474, + 0.5114583503454924, + 0.11342177912592888, + 0.288424763828516, + 0.4818806629627943, + 0.11730826646089554, + 0.22670457512140274, + 0.0, + 0.25533631071448326, + 0.10970703139901161, + 0.597010912373662, + 0.23975178599357605, + 0.5225650258362293, + 0.03097950667142868, + 0.10235084593296051, + 0.11982665210962296, + 0.18264222890138626, + 4.6326950415968895, + 0.2700952757149935, + 0.0653335377573967, + 0.0, + 0.966260276734829, + 0.12630686536431313, + 1.4387259571813047, + 0.8936286196112633, + 0.7822193540632725, + 0.169814832508564, + 0.35049591958522797, + 1.1944378539919853, + 0.7697136923670769, + 4.355465117841959, + 0.2311331257224083 + ], + "unique_experts": 57, + "load_cv": 0.9485855107701375, + "normalized_load_entropy": 0.8951831507344129, + "max_load_share": 0.06060606060606061 + } + }, + "s1_eos": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "47bac12d64b07371a28f346692130de437484fed713f3689cd161ce25584abb8", + "route_weight_sha256": "8d52ed461c95f13ad763bd98ec9073b22bc9b9fa78a2b57b0c5d96bb2fe269c9", + "loads": [ + 16, + 1, + 1, + 16, + 3, + 10, + 11, + 1, + 10, + 4, + 2, + 6, + 4, + 0, + 11, + 3, + 2, + 15, + 2, + 2, + 5, + 2, + 1, + 3, + 0, + 6, + 0, + 3, + 3, + 0, + 1, + 3, + 4, + 6, + 0, + 3, + 6, + 1, + 4, + 0, + 1, + 1, + 8, + 5, + 13, + 0, + 2, + 3, + 1, + 18, + 2, + 1, + 0, + 12, + 2, + 3, + 8, + 13, + 2, + 8, + 1, + 10, + 27, + 0 + ], + "weighted_loads": [ + 1.3698234781622887, + 0.07805123180150986, + 0.041762713342905045, + 2.234789416193962, + 0.31798097118735313, + 0.4750040303915739, + 0.7066073752939701, + 0.05871516838669777, + 0.5557692125439644, + 0.23615005984902382, + 0.07164471223950386, + 0.38488826528191566, + 0.1987546719610691, + 0.0, + 0.479608491063118, + 0.09831320680677891, + 0.14647166430950165, + 1.521378668025136, + 0.07262555882334709, + 0.12977781519293785, + 0.3792642392218113, + 0.12453422322869301, + 0.035881806164979935, + 0.1506596952676773, + 0.0, + 0.34854137152433395, + 0.0, + 0.11186327785253525, + 0.19696131721138954, + 0.0, + 0.03862837702035904, + 0.15193497203290462, + 0.13944594003260136, + 0.28243608865886927, + 0.0, + 0.13239890336990356, + 0.4521307498216629, + 0.03293945640325546, + 0.23222649097442627, + 0.0, + 0.04403991997241974, + 0.031534187495708466, + 0.28717816062271595, + 0.2935361713171005, + 0.5114159192889929, + 0.0, + 0.10022389516234398, + 0.12184539251029491, + 0.03421766310930252, + 4.3773471750319, + 0.07459861412644386, + 0.06490634381771088, + 0.0, + 0.8295870050787926, + 0.09502794966101646, + 0.20820043794810772, + 0.752588301897049, + 0.718919150531292, + 0.17691275477409363, + 0.4178907014429569, + 0.10196338593959808, + 0.5444945339113474, + 4.2555845230817795, + 0.0 + ], + "unique_experts": 55, + "load_cv": 1.109104038660624, + "normalized_load_entropy": 0.870701298687982, + "max_load_share": 0.08653846153846154 + }, + "full_input": { + "tokens": 93, + "top_k": 6, + "decisions": 558, + "ordered_route_sha256": "8c2b1579c0abc4d3524436763c4e7de71b266a568984d04eff4e085138a994f9", + "route_weight_sha256": "acf2257c367424d23946bc514ada347cd8bdc891b8ac0cd1319701f088ee1873", + "loads": [ + 19, + 6, + 1, + 27, + 3, + 12, + 16, + 2, + 31, + 13, + 2, + 12, + 7, + 0, + 16, + 6, + 5, + 17, + 3, + 2, + 7, + 15, + 2, + 4, + 0, + 7, + 0, + 7, + 4, + 0, + 2, + 3, + 8, + 15, + 8, + 10, + 8, + 2, + 4, + 1, + 12, + 3, + 12, + 7, + 14, + 0, + 3, + 5, + 5, + 21, + 11, + 4, + 5, + 15, + 2, + 25, + 12, + 13, + 4, + 8, + 15, + 20, + 30, + 5 + ], + "weighted_loads": [ + 1.5200454508885741, + 0.5341439582407475, + 0.041762713342905045, + 4.37742755562067, + 0.31798097118735313, + 0.5395466666668653, + 0.9827060624957085, + 0.09960555285215378, + 2.338687098585069, + 0.7141265235841274, + 0.07164471223950386, + 0.7217128034681082, + 0.3377620503306389, + 0.0, + 1.2464870382100344, + 0.29437593184411526, + 0.2916102446615696, + 1.5710807479918003, + 0.11129486933350563, + 0.12977781519293785, + 0.4621088318526745, + 1.197823416441679, + 0.07833579555153847, + 0.21355923265218735, + 0.0, + 0.3740804586559534, + 0.0, + 0.2879656031727791, + 0.2810192368924618, + 0.0, + 0.09065824747085571, + 0.15193497203290462, + 0.2614274686202407, + 0.6186349214985967, + 0.36786031536757946, + 0.437678687274456, + 0.5420353636145592, + 0.08126863464713097, + 0.23222649097442627, + 0.04385436698794365, + 0.733318168669939, + 0.11936510354280472, + 0.6005164701491594, + 0.4309541806578636, + 0.5499967206269503, + 0.0, + 0.13675237819552422, + 0.19109022989869118, + 0.2113187611103058, + 4.85723040252924, + 0.5330939497798681, + 0.2727833688259125, + 0.5396553911268711, + 0.9718096069991589, + 0.09502794966101646, + 1.9991065738722682, + 0.9708493612706661, + 0.718919150531292, + 0.2232963745482266, + 0.4178907014429569, + 2.037791281938553, + 0.9664297606796026, + 4.3745492324233055, + 0.2228133361786604 + ], + "unique_experts": 59, + "load_cv": 0.8579345517707676, + "normalized_load_entropy": 0.9132979611998389, + "max_load_share": 0.05555555555555555 + } + }, + "s0_bos": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "cfe66d3db31880c8979bafc390a58d8e383e56ad93c27efef4b8f198d72ed046", + "route_weight_sha256": "e756f1720aace42d6bd321885bbf02549e80cf053a4f14f86119565305f4f22e", + "loads": [ + 16, + 2, + 1, + 16, + 3, + 12, + 11, + 1, + 9, + 3, + 2, + 8, + 5, + 0, + 11, + 3, + 2, + 14, + 2, + 2, + 4, + 1, + 0, + 4, + 0, + 6, + 0, + 3, + 5, + 0, + 1, + 3, + 3, + 5, + 0, + 3, + 7, + 2, + 4, + 0, + 1, + 1, + 8, + 3, + 12, + 0, + 2, + 3, + 1, + 18, + 3, + 1, + 0, + 11, + 4, + 4, + 8, + 13, + 3, + 6, + 1, + 8, + 27, + 0 + ], + "weighted_loads": [ + 1.4245714899152517, + 0.10662928409874439, + 0.04179220646619797, + 2.2627233676612377, + 0.33281076326966286, + 0.5446888022124767, + 0.7288007065653801, + 0.051986001431941986, + 0.5591434687376022, + 0.19757774099707603, + 0.06995990686118603, + 0.4265481512993574, + 0.23941686004400253, + 0.0, + 0.48106925934553146, + 0.10022581368684769, + 0.14457452297210693, + 1.5478862691670656, + 0.07196012884378433, + 0.11688293516635895, + 0.335870161652565, + 0.08489300310611725, + 0.0, + 0.15265238098800182, + 0.0, + 0.3252762332558632, + 0.0, + 0.11761623620986938, + 0.2743180524557829, + 0.0, + 0.04634840041399002, + 0.15673110075294971, + 0.11762875691056252, + 0.27421218901872635, + 0.0, + 0.11613084375858307, + 0.4710409380495548, + 0.0750291496515274, + 0.23306891694664955, + 0.0, + 0.03949190676212311, + 0.03632143512368202, + 0.2652127481997013, + 0.21981840580701828, + 0.5387408416718245, + 0.0, + 0.09897519275546074, + 0.12447160109877586, + 0.040467310696840286, + 4.428154606372118, + 0.10293405130505562, + 0.06347206234931946, + 0.0, + 0.8395709358155727, + 0.1728755459189415, + 0.30930125527083874, + 0.8257187977433205, + 0.7295679599046707, + 0.18678121268749237, + 0.34693920612335205, + 0.10949155688285828, + 0.4744236171245575, + 4.271909095346928, + 0.0 + ], + "unique_experts": 54, + "load_cv": 1.090572836827525, + "normalized_load_entropy": 0.8737514997866029, + "max_load_share": 0.08653846153846154 + }, + "full_input": { + "tokens": 77, + "top_k": 6, + "decisions": 462, + "ordered_route_sha256": "9fa474a414daa4e5a2dea13f1d7b97f0c98a3650cf8a08f463bc126e76e17624", + "route_weight_sha256": "8b8c3127adda3dce85c953afe6a82734d4cdbaf4462cbafb80a127325dc27e06", + "loads": [ + 20, + 2, + 3, + 24, + 3, + 13, + 14, + 2, + 23, + 8, + 3, + 9, + 5, + 0, + 13, + 4, + 2, + 15, + 2, + 2, + 4, + 8, + 1, + 5, + 1, + 8, + 0, + 9, + 5, + 0, + 1, + 3, + 6, + 11, + 2, + 8, + 7, + 4, + 4, + 0, + 5, + 2, + 12, + 3, + 13, + 1, + 3, + 3, + 5, + 20, + 5, + 1, + 0, + 13, + 4, + 17, + 11, + 17, + 4, + 6, + 10, + 16, + 29, + 8 + ], + "weighted_loads": [ + 1.599519400857389, + 0.10662928409874439, + 0.12187113612890244, + 3.240081712603569, + 0.33281076326966286, + 0.557285089045763, + 0.9406636320054531, + 0.9670618996024132, + 1.793664294295013, + 0.39132984168827534, + 0.09087378531694412, + 0.4390186723321676, + 0.23941686004400253, + 0.0, + 1.0587221905589104, + 0.14334483072161674, + 0.14457452297210693, + 1.5736467130482197, + 0.07196012884378433, + 0.11688293516635895, + 0.335870161652565, + 0.674170296639204, + 0.028518391773104668, + 0.2160967867821455, + 0.004460027441382408, + 0.3854526039212942, + 0.0, + 0.36571560986340046, + 0.2743180524557829, + 0.0, + 0.04634840041399002, + 0.15673110075294971, + 0.22122618556022644, + 0.4928568098694086, + 0.11157219484448433, + 0.3428336903452873, + 0.4710409380495548, + 0.16462747752666473, + 0.23306891694664955, + 0.0, + 0.25090841576457024, + 0.11259273067116737, + 0.4339534477330744, + 0.21981840580701828, + 0.5807584654539824, + 0.03097950667142868, + 0.13971390947699547, + 0.12447160109877586, + 0.286519892513752, + 4.562103630974889, + 0.2227882333099842, + 0.06347206234931946, + 0.0, + 0.9501042515039444, + 0.1728755459189415, + 1.4545445013791323, + 0.9468359276652336, + 0.8409150829538703, + 0.21921823918819427, + 0.34693920612335205, + 1.2883290648460388, + 0.7559111043810844, + 4.3491655346006155, + 0.3319122679531574 + ], + "unique_experts": 59, + "load_cv": 0.9118387660908255, + "normalized_load_entropy": 0.9052480026213172, + "max_load_share": 0.06277056277056277 + } + }, + "s1_bos": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "edbd5a03b8e51e73c84146d628f8d5dcccd807c90d87acdb226b2ab2b913ec77", + "route_weight_sha256": "d8236187be38588b817cba01e87d04cdbbc15b22919026f92e7532d6d73adc86", + "loads": [ + 17, + 2, + 1, + 16, + 3, + 10, + 11, + 2, + 9, + 4, + 1, + 7, + 4, + 0, + 12, + 3, + 2, + 15, + 2, + 2, + 4, + 2, + 1, + 3, + 0, + 6, + 0, + 4, + 3, + 0, + 0, + 2, + 4, + 6, + 0, + 3, + 7, + 2, + 4, + 1, + 1, + 1, + 8, + 4, + 11, + 0, + 2, + 3, + 1, + 18, + 1, + 1, + 0, + 13, + 5, + 3, + 8, + 13, + 3, + 6, + 1, + 8, + 25, + 1 + ], + "weighted_loads": [ + 1.4764130748808384, + 0.1107864286750555, + 0.04433387517929077, + 2.2855287715792656, + 0.3338042013347149, + 0.4780379869043827, + 0.7230067476630211, + 0.08725600689649582, + 0.5673861261457205, + 0.25375884026288986, + 0.041946567595005035, + 0.391548091545701, + 0.21122025325894356, + 0.0, + 0.5281984563916922, + 0.10290473140776157, + 0.14732471853494644, + 1.5554778426885605, + 0.07654181122779846, + 0.11232764646410942, + 0.34479498490691185, + 0.12871907651424408, + 0.03675641119480133, + 0.13664671406149864, + 0.0, + 0.32496344298124313, + 0.0, + 0.15217044204473495, + 0.20235328003764153, + 0.0, + 0.0, + 0.11891942098736763, + 0.1438345555216074, + 0.3296776972711086, + 0.0, + 0.1276746802031994, + 0.4872591197490692, + 0.07448968291282654, + 0.2369854524731636, + 0.03236529603600502, + 0.042004138231277466, + 0.036801017820835114, + 0.27074790373444557, + 0.2688717693090439, + 0.4465689919888973, + 0.0, + 0.10604247450828552, + 0.12429636158049107, + 0.03464091569185257, + 4.414873950183392, + 0.027845649048686028, + 0.06527246534824371, + 0.0, + 0.8658530972898006, + 0.2040099184960127, + 0.2577266860753298, + 0.8033615946769714, + 0.7506165020167828, + 0.1904378980398178, + 0.33680384419858456, + 0.10653109848499298, + 0.4624861031770706, + 4.069226797670126, + 0.031911302357912064 + ], + "unique_experts": 56, + "load_cv": 1.074784200776138, + "normalized_load_entropy": 0.8777949207337497, + "max_load_share": 0.08012820512820513 + }, + "full_input": { + "tokens": 93, + "top_k": 6, + "decisions": 558, + "ordered_route_sha256": "673e6fa95dbcb95a0e5d386ebbc88ed9c3d4e8c0c43a8859e3c88f4b50f10679", + "route_weight_sha256": "f4d7d0434e233920ba2a5539154a37abf2277bddeba144515c9f0742c4593295", + "loads": [ + 20, + 7, + 1, + 26, + 3, + 11, + 15, + 3, + 30, + 13, + 1, + 13, + 7, + 0, + 16, + 7, + 5, + 17, + 3, + 2, + 6, + 14, + 2, + 4, + 0, + 7, + 0, + 9, + 4, + 0, + 1, + 2, + 5, + 15, + 8, + 11, + 9, + 4, + 4, + 2, + 12, + 3, + 12, + 6, + 12, + 0, + 3, + 5, + 7, + 21, + 10, + 4, + 6, + 17, + 5, + 23, + 12, + 14, + 4, + 6, + 16, + 18, + 27, + 8 + ], + "weighted_loads": [ + 1.6266350476071239, + 0.5668791551142931, + 0.04433387517929077, + 3.5337570160627365, + 0.3338042013347149, + 0.490634273737669, + 0.9892262108623981, + 0.12814639136195183, + 2.354620178230107, + 0.7317353039979935, + 0.041946567595005035, + 0.7577398084104061, + 0.35022763162851334, + 0.0, + 1.246578298509121, + 0.34152347035706043, + 0.2924632988870144, + 1.6051799226552248, + 0.115211121737957, + 0.11232764646410942, + 0.43144566193223, + 1.1750969178974628, + 0.07921040058135986, + 0.20072374865412712, + 0.0, + 0.3505025301128626, + 0.0, + 0.37314941734075546, + 0.28641119971871376, + 0.0, + 0.035837046802043915, + 0.11891942098736763, + 0.19204428978264332, + 0.665876530110836, + 0.3680667635053396, + 0.48558763414621353, + 0.5771637335419655, + 0.16186213493347168, + 0.2369854524731636, + 0.07621966302394867, + 0.7445935197174549, + 0.1354830488562584, + 0.5667762123048306, + 0.406289778649807, + 0.4875895231962204, + 0.0, + 0.14257095754146576, + 0.19354119896888733, + 0.375767782330513, + 4.932247504591942, + 0.47304073348641396, + 0.2731494903564453, + 0.5699597559869289, + 1.064072646200657, + 0.2040099184960127, + 1.9826200380921364, + 1.0216226540505886, + 0.7864742167294025, + 0.231702271848917, + 0.33680384419858456, + 2.122949779033661, + 0.8844213299453259, + 4.149006865918636, + 0.36213681288063526 + ], + "unique_experts": 59, + "load_cv": 0.818704213655944, + "normalized_load_entropy": 0.9186710880625947, + "max_load_share": 0.053763440860215055 + } + }, + "s0_x": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "74e4293041c063622d4bad6136979352bce810ac93d91cb60df4790636ff3ca9", + "route_weight_sha256": "ded09d0ddc818da156d06df6c69e9f4ff421e2825f7bdfd030173d4a803f0015", + "loads": [ + 16, + 2, + 1, + 17, + 3, + 11, + 12, + 1, + 11, + 3, + 2, + 8, + 3, + 0, + 10, + 2, + 2, + 14, + 2, + 2, + 4, + 1, + 2, + 3, + 0, + 5, + 0, + 2, + 3, + 1, + 0, + 3, + 4, + 5, + 0, + 3, + 8, + 2, + 4, + 1, + 1, + 0, + 10, + 4, + 12, + 0, + 2, + 3, + 1, + 18, + 2, + 2, + 0, + 9, + 4, + 5, + 8, + 12, + 3, + 6, + 1, + 9, + 27, + 0 + ], + "weighted_loads": [ + 1.4548576828092337, + 0.10253794305026531, + 0.04185742884874344, + 2.255344009026885, + 0.3305239640176296, + 0.5118829496204853, + 0.735221691429615, + 0.03866242617368698, + 0.6729120798408985, + 0.1959775686264038, + 0.06564552336931229, + 0.41530995815992355, + 0.17097020521759987, + 0.0, + 0.4456992894411087, + 0.07452699542045593, + 0.1459389254450798, + 1.5267688985913992, + 0.07861338555812836, + 0.11793416365981102, + 0.34559793025255203, + 0.07714304327964783, + 0.06873182579874992, + 0.13711944222450256, + 0.0, + 0.2947443388402462, + 0.0, + 0.0767677016556263, + 0.1986781246960163, + 0.02871433086693287, + 0.0, + 0.1610911786556244, + 0.14401782304048538, + 0.2779797799885273, + 0.0, + 0.11962531507015228, + 0.5007819049060345, + 0.07384249195456505, + 0.22347446903586388, + 0.034607790410518646, + 0.03859332203865051, + 0.0, + 0.3400691282004118, + 0.23788105696439743, + 0.5232559591531754, + 0.0, + 0.10339988023042679, + 0.1358675006777048, + 0.03561380133032799, + 4.512586265802383, + 0.07293524034321308, + 0.10258910804986954, + 0.0, + 0.7251614034175873, + 0.17960205301642418, + 0.32529075257480145, + 0.8159814216196537, + 0.6972121875733137, + 0.19256335962563753, + 0.34241580963134766, + 0.09777435660362244, + 0.4988614674657583, + 4.234485920518637, + 0.0 + ], + "unique_experts": 55, + "load_cv": 1.0965848605304152, + "normalized_load_entropy": 0.8744759620639875, + "max_load_share": 0.08653846153846154 + }, + "full_input": { + "tokens": 77, + "top_k": 6, + "decisions": 462, + "ordered_route_sha256": "75d99c8148a8528f0d9bcb4e515be62f002f8626eb715360ff4876bc2211f717", + "route_weight_sha256": "5cea60a0e3b9939e8e3f1a0e596b021e35bb7a9a34104ac361d165407c974a46", + "loads": [ + 20, + 3, + 3, + 26, + 3, + 12, + 16, + 1, + 25, + 9, + 2, + 10, + 3, + 0, + 13, + 2, + 2, + 16, + 2, + 2, + 4, + 9, + 3, + 4, + 0, + 7, + 0, + 6, + 3, + 1, + 1, + 3, + 7, + 13, + 2, + 6, + 8, + 3, + 4, + 1, + 5, + 1, + 14, + 4, + 13, + 1, + 3, + 3, + 3, + 20, + 6, + 2, + 0, + 11, + 4, + 21, + 11, + 13, + 4, + 6, + 9, + 18, + 28, + 7 + ], + "weighted_loads": [ + 1.629805593751371, + 0.14474511705338955, + 0.1219363585114479, + 3.3176843840628862, + 0.3305239640176296, + 0.5244792364537716, + 1.016186412423849, + 0.03866242617368698, + 1.909965137951076, + 0.42089769430458546, + 0.06564552336931229, + 0.45942412689328194, + 0.17097020521759987, + 0.0, + 1.1552280336618423, + 0.07452699542045593, + 0.1459389254450798, + 1.5866633653640747, + 0.07861338555812836, + 0.11793416365981102, + 0.34559793025255203, + 0.7324414737522602, + 0.09725021757185459, + 0.1944541484117508, + 0.0, + 0.3549207095056772, + 0.0, + 0.22954448126256466, + 0.1986781246960163, + 0.02871433086693287, + 0.04118916019797325, + 0.1610911786556244, + 0.24293501861393452, + 0.5832795444875956, + 0.11578883975744247, + 0.2409161813557148, + 0.5007819049060345, + 0.11952674761414528, + 0.22347446903586388, + 0.034607790410518646, + 0.25798632204532623, + 0.07663474231958389, + 0.610743073746562, + 0.23788105696439743, + 0.5792624577879906, + 0.03097950667142868, + 0.14413859695196152, + 0.1358675006777048, + 0.12592004239559174, + 4.769588187336922, + 0.2808200977742672, + 0.10258910804986954, + 0.0, + 0.8197871670126915, + 0.17960205301642418, + 1.7208144906908274, + 0.9370985515415668, + 0.7228616867214441, + 0.22154337260872126, + 0.34241580963134766, + 1.208485186100006, + 0.8353574406355619, + 4.282203584909439, + 0.26622937247157097 + ], + "unique_experts": 60, + "load_cv": 0.9542582835101997, + "normalized_load_entropy": 0.899658279207566, + "max_load_share": 0.06060606060606061 + } + }, + "s1_x": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "a063f4f77e0ff110bfd9e820060615ddaaeaadb8d134aea76cf97bccd085ffe7", + "route_weight_sha256": "3dc362add53d7e32caf33a4b48917c86d4834d51dc50cae2cde7d1a638af038e", + "loads": [ + 15, + 2, + 1, + 17, + 2, + 11, + 11, + 1, + 12, + 3, + 1, + 7, + 3, + 0, + 12, + 2, + 2, + 14, + 2, + 2, + 4, + 2, + 2, + 3, + 0, + 6, + 0, + 2, + 3, + 1, + 0, + 3, + 4, + 5, + 0, + 3, + 6, + 1, + 4, + 0, + 2, + 2, + 9, + 4, + 12, + 0, + 2, + 4, + 1, + 18, + 1, + 1, + 0, + 11, + 4, + 5, + 8, + 13, + 2, + 6, + 1, + 11, + 26, + 0 + ], + "weighted_loads": [ + 1.4051442816853523, + 0.10504603385925293, + 0.04004673659801483, + 2.322640247642994, + 0.29885901510715485, + 0.5419803727418184, + 0.7189965173602104, + 0.03802010789513588, + 0.7053398620337248, + 0.18998420983552933, + 0.0312950499355793, + 0.39452591724693775, + 0.17208357900381088, + 0.0, + 0.5833094418048859, + 0.0773145966231823, + 0.14373835176229477, + 1.499337611719966, + 0.08393633738160133, + 0.10874417796730995, + 0.3442568853497505, + 0.12179039418697357, + 0.06992293149232864, + 0.13784748315811157, + 0.0, + 0.3231509029865265, + 0.0, + 0.06633952260017395, + 0.1902037151157856, + 0.027064232155680656, + 0.0, + 0.1489785499870777, + 0.14365866780281067, + 0.2584120184183121, + 0.0, + 0.12085646763443947, + 0.4304441101849079, + 0.03527297079563141, + 0.22994276136159897, + 0.0, + 0.09186915308237076, + 0.06766712665557861, + 0.3078693766146898, + 0.27811064571142197, + 0.47871777787804604, + 0.0, + 0.10178675875067711, + 0.1699870117008686, + 0.03427146375179291, + 4.401432029902935, + 0.030135078355669975, + 0.06045050173997879, + 0.0, + 0.7416685782372952, + 0.17592648044228554, + 0.3455766923725605, + 0.7846942655742168, + 0.7300573997199535, + 0.1994473934173584, + 0.3400240130722523, + 0.08409132808446884, + 0.6002521310001612, + 4.083588548004627, + 0.0 + ], + "unique_experts": 55, + "load_cv": 1.0989804611147098, + "normalized_load_entropy": 0.8720855317409966, + "max_load_share": 0.08333333333333333 + }, + "full_input": { + "tokens": 93, + "top_k": 6, + "decisions": 558, + "ordered_route_sha256": "74d24ad378ee1b1e57c91cc4d2cd08503fa46e70961ccc07331e0230efb4cd78", + "route_weight_sha256": "ec1b4fa2857a58d5edad03a1e936ed3249e031b272a4b14420e0445822c978c4", + "loads": [ + 19, + 7, + 1, + 28, + 2, + 12, + 17, + 3, + 34, + 13, + 1, + 13, + 6, + 0, + 16, + 5, + 5, + 16, + 3, + 2, + 5, + 15, + 3, + 4, + 0, + 7, + 0, + 5, + 4, + 1, + 0, + 3, + 5, + 14, + 8, + 9, + 8, + 2, + 4, + 2, + 14, + 4, + 14, + 6, + 12, + 0, + 3, + 6, + 5, + 21, + 10, + 4, + 5, + 14, + 4, + 28, + 12, + 13, + 4, + 6, + 15, + 23, + 29, + 4 + ], + "weighted_loads": [ + 1.5931297158822417, + 0.5611387602984905, + 0.04004673659801483, + 3.619521975517273, + 0.29885901510715485, + 0.5545766595751047, + 1.056256975978613, + 0.12227846682071686, + 2.549131457693875, + 0.7148133777081966, + 0.0312950499355793, + 0.7455099523067474, + 0.31109095737338066, + 0.0, + 1.1964877638965845, + 0.27337732166051865, + 0.2888769321143627, + 1.5490396916866302, + 0.12260564789175987, + 0.10874417796730995, + 0.39339666068553925, + 1.2105804719030857, + 0.11237692087888718, + 0.20333750545978546, + 0.0, + 0.34868999011814594, + 0.0, + 0.19120249152183533, + 0.27426163479685783, + 0.027064232155680656, + 0.0, + 0.1489785499870777, + 0.1918684020638466, + 0.5946108512580395, + 0.374209800735116, + 0.3828054405748844, + 0.5203487239778042, + 0.07725517079234123, + 0.22994276136159897, + 0.11521868035197258, + 0.8130671046674252, + 0.14054178819060326, + 0.7040370013564825, + 0.41552865505218506, + 0.47871777787804604, + 0.0, + 0.13831524178385735, + 0.23923184908926487, + 0.2002161219716072, + 4.931109972298145, + 0.5092504806816578, + 0.2683275267481804, + 0.5396553911268711, + 0.8764354921877384, + 0.17592648044228554, + 2.4116889592260122, + 1.002955324947834, + 0.7300573997199535, + 0.27660803124308586, + 0.3400240130722523, + 1.9548470675945282, + 1.182462016120553, + 4.198411140590906, + 0.17572682909667492 + ], + "unique_experts": 59, + "load_cv": 0.8979692863904787, + "normalized_load_entropy": 0.9085386979459713, + "max_load_share": 0.06093189964157706 + } + }, + "s0_period": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "9853e292ecc51efc928fcf892dc7ddba2efa3aae74ac546967116f59aff4bcda", + "route_weight_sha256": "b8ad321c041a5427e6bbbc92729cff1c69d2198e1e35e9ec8ac06372d83825d9", + "loads": [ + 16, + 2, + 1, + 16, + 3, + 10, + 11, + 1, + 7, + 3, + 2, + 8, + 4, + 0, + 12, + 2, + 2, + 15, + 2, + 2, + 4, + 2, + 2, + 3, + 0, + 6, + 0, + 3, + 4, + 0, + 1, + 2, + 4, + 5, + 0, + 3, + 7, + 2, + 4, + 0, + 1, + 1, + 8, + 4, + 14, + 0, + 2, + 3, + 1, + 18, + 2, + 1, + 0, + 10, + 4, + 4, + 8, + 14, + 3, + 5, + 1, + 8, + 27, + 2 + ], + "weighted_loads": [ + 1.536776216700673, + 0.11109861359000206, + 0.047597598284482956, + 2.241848036646843, + 0.32271090894937515, + 0.47334875725209713, + 0.7384815998375416, + 0.04060300439596176, + 0.45280153676867485, + 0.19440264999866486, + 0.0700731948018074, + 0.4327236134558916, + 0.19958178885281086, + 0.0, + 0.528953654691577, + 0.07039281539618969, + 0.14340892434120178, + 1.540047848597169, + 0.08226406574249268, + 0.12059750780463219, + 0.33792712539434433, + 0.12671179696917534, + 0.06765599921345711, + 0.1306169144809246, + 0.0, + 0.32824183255434036, + 0.0, + 0.11833091452717781, + 0.23221435025334358, + 0.0, + 0.039372518658638, + 0.1291404739022255, + 0.13993664644658566, + 0.28803664445877075, + 0.0, + 0.12207170389592648, + 0.4567720927298069, + 0.0761207602918148, + 0.23291005194187164, + 0.0, + 0.039199549704790115, + 0.03228477016091347, + 0.26552741788327694, + 0.2505158819258213, + 0.5704183056950569, + 0.0, + 0.1046561673283577, + 0.1287076584994793, + 0.035538580268621445, + 4.491315424442291, + 0.06289620138704777, + 0.06287333369255066, + 0.0, + 0.7223468534648418, + 0.18263892456889153, + 0.3253159523010254, + 0.7934457547962666, + 0.7509623970836401, + 0.21255357563495636, + 0.3153380826115608, + 0.1027001440525055, + 0.47096471674740314, + 4.337357502430677, + 0.06130111590027809 + ], + "unique_experts": 56, + "load_cv": 1.0929816146639546, + "normalized_load_entropy": 0.8779740843271064, + "max_load_share": 0.08653846153846154 + }, + "full_input": { + "tokens": 77, + "top_k": 6, + "decisions": 462, + "ordered_route_sha256": "a9a2217bed55e977675158153ccf98d5d207ac1c400a20d3aaa7eecdff35c79d", + "route_weight_sha256": "d1afcfdfa45bac06cc7a5909012fc6380a1a14e07606fee4b2da5b8cbc878774", + "loads": [ + 20, + 3, + 4, + 24, + 3, + 11, + 14, + 1, + 20, + 8, + 2, + 9, + 4, + 0, + 16, + 2, + 2, + 17, + 2, + 2, + 5, + 11, + 3, + 4, + 0, + 8, + 0, + 8, + 4, + 1, + 1, + 2, + 6, + 11, + 2, + 6, + 7, + 3, + 4, + 0, + 6, + 2, + 12, + 4, + 15, + 1, + 3, + 3, + 3, + 19, + 7, + 1, + 0, + 13, + 4, + 20, + 11, + 16, + 4, + 5, + 10, + 16, + 28, + 9 + ], + "weighted_loads": [ + 1.7117241276428103, + 0.20567135140299797, + 0.15724091790616512, + 3.2192063815891743, + 0.32271090894937515, + 0.4859450440853834, + 0.9503445252776146, + 0.04060300439596176, + 1.6458983486518264, + 0.38815475068986416, + 0.0700731948018074, + 0.4451941344887018, + 0.19958178885281086, + 0.0, + 1.2773782815784216, + 0.07039281539618969, + 0.14340892434120178, + 1.613807562738657, + 0.08226406574249268, + 0.12059750780463219, + 0.36520967446267605, + 0.8299112021923065, + 0.09617439098656178, + 0.19289784133434296, + 0.0, + 0.3884182032197714, + 0.0, + 0.3125274311751127, + 0.23221435025334358, + 0.0515960156917572, + 0.039372518658638, + 0.1291404739022255, + 0.20949076674878597, + 0.506681265309453, + 0.12136047333478928, + 0.23865309916436672, + 0.4567720927298069, + 0.11798052117228508, + 0.23291005194187164, + 0.0, + 0.3192678987979889, + 0.1050126738846302, + 0.4942819084972143, + 0.2505158819258213, + 0.6179425232112408, + 0.03097950667142868, + 0.14539488404989243, + 0.1287076584994793, + 0.12425559014081955, + 4.621338844299316, + 0.3524720948189497, + 0.06287333369255066, + 0.0, + 0.8724799081683159, + 0.18263892456889153, + 1.666185300797224, + 0.9145628847181797, + 0.8192839492112398, + 0.23949630931019783, + 0.3153380826115608, + 1.2795012593269348, + 0.7524522040039301, + 4.384869761765003, + 0.3366658054292202 + ], + "unique_experts": 59, + "load_cv": 0.9161036465345738, + "normalized_load_entropy": 0.903134754250097, + "max_load_share": 0.06060606060606061 + } + }, + "s1_period": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "1d5cc57e7de7dac0dc767478bea325ca11446137bfe64ce89148f7ff7db1449b", + "route_weight_sha256": "ea28e8bf6c240dcd477238f45c2c866272d9e811dfa6670854e43c0bbe16f241", + "loads": [ + 14, + 2, + 1, + 16, + 3, + 10, + 11, + 1, + 14, + 3, + 1, + 7, + 3, + 0, + 14, + 2, + 2, + 14, + 2, + 2, + 4, + 2, + 2, + 3, + 0, + 6, + 0, + 2, + 3, + 1, + 1, + 3, + 3, + 5, + 0, + 3, + 7, + 1, + 4, + 1, + 2, + 1, + 9, + 4, + 11, + 0, + 2, + 3, + 1, + 18, + 1, + 1, + 0, + 11, + 5, + 4, + 8, + 13, + 2, + 5, + 1, + 12, + 25, + 0 + ], + "weighted_loads": [ + 1.3563498258590698, + 0.11013039201498032, + 0.040865883231163025, + 2.2577621825039387, + 0.31863717176020145, + 0.4998066183179617, + 0.7143387831747532, + 0.042625248432159424, + 0.7103455550968647, + 0.19184951856732368, + 0.04153691604733467, + 0.39129944145679474, + 0.1734257936477661, + 0.0, + 0.6201488971710205, + 0.07960274070501328, + 0.14395305514335632, + 1.473628643900156, + 0.08086545020341873, + 0.11545517668128014, + 0.35477327555418015, + 0.12259137257933617, + 0.06920894607901573, + 0.13816718757152557, + 0.0, + 0.3322604075074196, + 0.0, + 0.06768672354519367, + 0.19636651128530502, + 0.026233911514282227, + 0.032511841505765915, + 0.1513540167361498, + 0.10757799074053764, + 0.24469736218452454, + 0.0, + 0.11668496578931808, + 0.46759696677327156, + 0.03732678294181824, + 0.22749889269471169, + 0.033485133200883865, + 0.1032986231148243, + 0.03974176570773125, + 0.30723338201642036, + 0.2842261902987957, + 0.45192890241742134, + 0.0, + 0.10263627395033836, + 0.12518678605556488, + 0.03461235761642456, + 4.462231494486332, + 0.04469072446227074, + 0.061496615409851074, + 0.0, + 0.8032999522984028, + 0.21336754783988, + 0.30957791581749916, + 0.7850459739565849, + 0.7267727628350258, + 0.21163859218358994, + 0.30025075748562813, + 0.08658025413751602, + 0.6349671147763729, + 3.99238833039999, + 0.0 + ], + "unique_experts": 57, + "load_cv": 1.0875543620742818, + "normalized_load_entropy": 0.8756451887297958, + "max_load_share": 0.08012820512820513 + }, + "full_input": { + "tokens": 93, + "top_k": 6, + "decisions": 558, + "ordered_route_sha256": "4e7be560cca8b900c53ac22fb57ab3b5e48274a1a25ba16a89a97230f64284c3", + "route_weight_sha256": "8650cb1377b9f3d1308a3592bdf02ec8058503fde84ee89fe6cd57e961e081f3", + "loads": [ + 17, + 8, + 1, + 26, + 3, + 11, + 15, + 3, + 35, + 12, + 1, + 13, + 6, + 0, + 18, + 5, + 5, + 16, + 3, + 2, + 5, + 16, + 3, + 4, + 0, + 7, + 0, + 4, + 4, + 1, + 2, + 3, + 5, + 15, + 8, + 9, + 9, + 2, + 4, + 4, + 14, + 3, + 14, + 6, + 11, + 0, + 3, + 5, + 5, + 20, + 12, + 4, + 5, + 14, + 5, + 27, + 12, + 13, + 4, + 5, + 16, + 23, + 28, + 4 + ], + "weighted_loads": [ + 1.5065717985853553, + 0.620769027620554, + 0.040865883231163025, + 3.5059904269874096, + 0.31863717176020145, + 0.512402905151248, + 0.9805582463741302, + 0.12273047119379044, + 2.5247482312843204, + 0.6698259823024273, + 0.04153691604733467, + 0.7437731381505728, + 0.3124331720173359, + 0.0, + 1.2473063189536333, + 0.2756654657423496, + 0.28909163549542427, + 1.5233307238668203, + 0.11953476071357727, + 0.11545517668128014, + 0.40391305088996887, + 1.256994403898716, + 0.11166293546557426, + 0.19460587203502655, + 0.0, + 0.35779949463903904, + 0.0, + 0.15012050233781338, + 0.28042443096637726, + 0.026233911514282227, + 0.0747552141547203, + 0.1513540167361498, + 0.18606112897396088, + 0.6167383976280689, + 0.3720687497407198, + 0.36573418229818344, + 0.5575015805661678, + 0.0777798518538475, + 0.22749889269471169, + 0.17722220718860626, + 0.8452952913939953, + 0.11182601004838943, + 0.6791997328400612, + 0.4216441996395588, + 0.45192890241742134, + 0.0, + 0.1391647569835186, + 0.19443162344396114, + 0.1987750492990017, + 4.9046692699193954, + 0.6341671105474234, + 0.2693736404180527, + 0.5396553911268711, + 0.9602284729480743, + 0.21336754783988, + 2.3052907828241587, + 1.003307033330202, + 0.7267727628350258, + 0.2902381606400013, + 0.30025075748562813, + 2.0299196019768715, + 1.0984801724553108, + 4.132553018629551, + 0.17572682909667492 + ], + "unique_experts": 60, + "load_cv": 0.8780630501314621, + "normalized_load_entropy": 0.9132364348773064, + "max_load_share": 0.06272401433691756 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 52, + "ordered_topk_exact_tokens": 27, + "set_exact_tokens": 36, + "mean_set_jaccard": 0.9120879120879122, + "mean_token_weighted_tv": 0.018833705358422145, + "aggregate_load_tv": 0.04166666666666666 + }, + "system_bos": { + "tokens": 52, + "ordered_topk_exact_tokens": 21, + "set_exact_tokens": 32, + "mean_set_jaccard": 0.885989010989011, + "mean_token_weighted_tv": 0.02698733784759847, + "aggregate_load_tv": 0.05128205128205128 + }, + "system_x": { + "tokens": 52, + "ordered_topk_exact_tokens": 25, + "set_exact_tokens": 35, + "mean_set_jaccard": 0.89010989010989, + "mean_token_weighted_tv": 0.029987288665814467, + "aggregate_load_tv": 0.04487179487179487 + }, + "system_period": { + "tokens": 52, + "ordered_topk_exact_tokens": 16, + "set_exact_tokens": 28, + "mean_set_jaccard": 0.85989010989011, + "mean_token_weighted_tv": 0.03527961508370936, + "aggregate_load_tv": 0.0641025641025641 + }, + "bos_at_s0": { + "tokens": 52, + "ordered_topk_exact_tokens": 20, + "set_exact_tokens": 36, + "mean_set_jaccard": 0.9079670329670331, + "mean_token_weighted_tv": 0.029137751463657387, + "aggregate_load_tv": 0.035256410256410256 + }, + "bos_at_s1": { + "tokens": 52, + "ordered_topk_exact_tokens": 20, + "set_exact_tokens": 32, + "mean_set_jaccard": 0.8736263736263736, + "mean_token_weighted_tv": 0.034984728742319234, + "aggregate_load_tv": 0.048076923076923066 + }, + "x_at_s0": { + "tokens": 52, + "ordered_topk_exact_tokens": 22, + "set_exact_tokens": 29, + "mean_set_jaccard": 0.8653846153846154, + "mean_token_weighted_tv": 0.03345537587749557, + "aggregate_load_tv": 0.05128205128205129 + }, + "x_at_s1": { + "tokens": 52, + "ordered_topk_exact_tokens": 21, + "set_exact_tokens": 27, + "mean_set_jaccard": 0.8388278388278388, + "mean_token_weighted_tv": 0.0419645123452378, + "aggregate_load_tv": 0.057692307692307696 + }, + "period_at_s0": { + "tokens": 52, + "ordered_topk_exact_tokens": 21, + "set_exact_tokens": 31, + "mean_set_jaccard": 0.8763736263736264, + "mean_token_weighted_tv": 0.03367294399784161, + "aggregate_load_tv": 0.04487179487179488 + }, + "period_at_s1": { + "tokens": 52, + "ordered_topk_exact_tokens": 16, + "set_exact_tokens": 24, + "mean_set_jaccard": 0.8182234432234433, + "mean_token_weighted_tv": 0.04457582575448144, + "aggregate_load_tv": 0.0673076923076923 + } + } + }, + "layer_23": { + "layer": 23, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "0f9b5386a8158a9b358d163a112be8f8798029aaf93a772abe048d3a4e5d5452", + "route_weight_sha256": "3493d6dcde68684801bb78a1e1b991e0e3f3bc3900808ea2e997950a9b605d40", + "loads": [ + 5, + 7, + 4, + 16, + 1, + 0, + 2, + 0, + 5, + 3, + 3, + 0, + 7, + 9, + 10, + 2, + 13, + 3, + 2, + 2, + 1, + 1, + 1, + 0, + 3, + 6, + 0, + 12, + 9, + 4, + 16, + 3, + 0, + 4, + 4, + 1, + 3, + 5, + 5, + 2, + 2, + 5, + 5, + 0, + 2, + 14, + 13, + 26, + 7, + 1, + 0, + 0, + 2, + 3, + 12, + 1, + 12, + 2, + 0, + 19, + 7, + 0, + 0, + 5 + ], + "weighted_loads": [ + 0.136715741828084, + 0.5987376235425472, + 0.18261962197721004, + 1.3411084972321987, + 0.05848826467990875, + 0.0, + 0.13527758046984673, + 0.0, + 0.37441613897681236, + 0.0767541378736496, + 0.1552000232040882, + 0.0, + 0.30180007964372635, + 0.5756428651511669, + 0.8311440935358405, + 0.14262915402650833, + 0.9589963760226965, + 0.18111447617411613, + 0.11855829507112503, + 0.15759555622935295, + 0.02867109701037407, + 0.032729484140872955, + 0.022179733961820602, + 0.0, + 0.14219287410378456, + 0.21718554571270943, + 0.0, + 0.7689610086381435, + 0.6134082041680813, + 0.18598347529768944, + 2.3529019448906183, + 0.19866865128278732, + 0.0, + 0.22140207886695862, + 0.3080214895308018, + 0.03482211008667946, + 0.16099762916564941, + 0.2230059690773487, + 0.39500946924090385, + 0.09994306415319443, + 0.08705583587288857, + 0.2210511416196823, + 0.16058840416371822, + 0.0, + 0.13786091282963753, + 1.3749276399612427, + 0.7491324776783586, + 6.770817756652832, + 0.4439426064491272, + 0.037597864866256714, + 0.0, + 0.0, + 0.17496353387832642, + 0.09916052035987377, + 0.5053850766271353, + 0.06766807287931442, + 0.6555348783731461, + 0.07825841009616852, + 0.0, + 1.267042476683855, + 0.6356238201260567, + 0.0, + 0.0, + 0.1441929843276739 + ], + "unique_experts": 52, + "load_cv": 1.0977833142875717, + "normalized_load_entropy": 0.8689129517192904, + "max_load_share": 0.08333333333333333 + }, + "full_input": { + "tokens": 77, + "top_k": 6, + "decisions": 462, + "ordered_route_sha256": "67eac3ac2eec7a076b266674c5beaf3b83f32d0823bfb2b9bc737002911a6a34", + "route_weight_sha256": "d7f6737ebac5e941630373e726f31922f2335f914d282aac48c31c5ae11bbddb", + "loads": [ + 10, + 10, + 4, + 25, + 8, + 3, + 8, + 4, + 6, + 13, + 3, + 0, + 8, + 13, + 12, + 2, + 16, + 3, + 2, + 2, + 1, + 1, + 3, + 10, + 5, + 7, + 0, + 12, + 9, + 4, + 16, + 3, + 2, + 8, + 4, + 1, + 4, + 5, + 10, + 4, + 10, + 6, + 7, + 0, + 2, + 20, + 24, + 29, + 8, + 1, + 1, + 2, + 2, + 3, + 22, + 1, + 12, + 13, + 2, + 19, + 8, + 0, + 3, + 6 + ], + "weighted_loads": [ + 0.3274527818430215, + 0.7698663249611855, + 0.18261962197721004, + 1.5996058299206197, + 0.3352573271840811, + 0.12867259280756116, + 0.5209139138460159, + 0.16962118819355965, + 0.37516441353363916, + 0.4265104401856661, + 0.1552000232040882, + 0.0, + 0.31201821006834507, + 0.7541899047791958, + 0.9474571710452437, + 0.14262915402650833, + 1.011216922197491, + 0.18111447617411613, + 0.11855829507112503, + 0.15759555622935295, + 0.02867109701037407, + 0.032729484140872955, + 0.12061701528728008, + 1.2687936052680016, + 0.2170658390969038, + 0.24508612230420113, + 0.0, + 0.7689610086381435, + 0.6134082041680813, + 0.18598347529768944, + 2.3529019448906183, + 0.19866865128278732, + 0.1005098968744278, + 0.4802238845732063, + 0.3080214895308018, + 0.03482211008667946, + 0.20749672502279282, + 0.2230059690773487, + 0.6032695602625608, + 0.15051267482340336, + 0.4772078674286604, + 0.2769283540546894, + 0.21212333627045155, + 0.0, + 0.13786091282963753, + 3.3760294411331415, + 1.7181742200627923, + 6.834058207692578, + 0.48293595388531685, + 0.037597864866256714, + 0.064110167324543, + 0.13212868943810463, + 0.17496353387832642, + 0.09916052035987377, + 1.4267001431435347, + 0.06766807287931442, + 0.6555348783731461, + 1.1451394781470299, + 0.11508770287036896, + 1.267042476683855, + 0.6658773869276047, + 0.0, + 0.09605971537530422, + 0.21692915819585323 + ], + "unique_experts": 60, + "load_cv": 0.9196969442262448, + "normalized_load_entropy": 0.9058070371839932, + "max_load_share": 0.06277056277056277 + } + }, + "s1_eos": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "e9ca200ba5bde34f33d307d8a456a8ed703e1ad6666787ac276f3e61166220f3", + "route_weight_sha256": "9b7398f48ef1dc2491bb4b6425717ae7e4c13fd58982e1ef91d1193975c237e5", + "loads": [ + 7, + 8, + 3, + 16, + 1, + 0, + 2, + 0, + 5, + 4, + 3, + 1, + 7, + 9, + 9, + 2, + 13, + 3, + 2, + 3, + 0, + 1, + 1, + 1, + 3, + 5, + 0, + 12, + 9, + 3, + 18, + 3, + 1, + 5, + 5, + 1, + 3, + 5, + 5, + 2, + 3, + 5, + 4, + 1, + 2, + 14, + 12, + 25, + 6, + 0, + 0, + 0, + 2, + 3, + 10, + 1, + 11, + 2, + 0, + 19, + 8, + 0, + 0, + 3 + ], + "weighted_loads": [ + 0.16356172040104866, + 0.6421832032501698, + 0.15320216491818428, + 1.3183768279850483, + 0.06323044747114182, + 0.0, + 0.13405146822333336, + 0.0, + 0.3673553988337517, + 0.1103680208325386, + 0.16526932641863823, + 0.027619222179055214, + 0.30300067365169525, + 0.5750450547784567, + 0.8170204535126686, + 0.1418173387646675, + 0.9564014840871096, + 0.17472755908966064, + 0.1197889931499958, + 0.1935933530330658, + 0.0, + 0.03167188912630081, + 0.021474437788128853, + 0.03669431805610657, + 0.14825914055109024, + 0.17671650275588036, + 0.0, + 0.7607051096856594, + 0.5926725715398788, + 0.1564558818936348, + 2.4096138514578342, + 0.19937820360064507, + 0.027355005964636803, + 0.26256999745965004, + 0.3713320214301348, + 0.03534969687461853, + 0.15800485014915466, + 0.22212350741028786, + 0.3966607488691807, + 0.10792679525911808, + 0.11969725042581558, + 0.22505581378936768, + 0.11998505424708128, + 0.026116520166397095, + 0.14154309034347534, + 1.3486369960010052, + 0.7125615868717432, + 6.609922721982002, + 0.38806477934122086, + 0.0, + 0.0, + 0.0, + 0.16363037377595901, + 0.1102689765393734, + 0.4343415331095457, + 0.06939376890659332, + 0.6336820311844349, + 0.07684267312288284, + 0.0, + 1.2801084034144878, + 0.6840693466365337, + 0.0, + 0.0, + 0.08760570548474789 + ], + "unique_experts": 54, + "load_cv": 1.0778384388196771, + "normalized_load_entropy": 0.8752601687748397, + "max_load_share": 0.08012820512820513 + }, + "full_input": { + "tokens": 93, + "top_k": 6, + "decisions": 558, + "ordered_route_sha256": "c681e9ea73599e33923831658aa71203031a7142b6a41c417590570b303a9d57", + "route_weight_sha256": "4adb2ba331585e52afed377c790fd2ef3c80135a7969244e139cfe8d86e9d769", + "loads": [ + 12, + 13, + 9, + 25, + 5, + 3, + 15, + 7, + 7, + 8, + 5, + 1, + 9, + 14, + 11, + 5, + 17, + 4, + 4, + 4, + 1, + 1, + 3, + 15, + 5, + 6, + 0, + 12, + 9, + 4, + 18, + 3, + 3, + 17, + 5, + 1, + 9, + 6, + 13, + 3, + 13, + 6, + 5, + 1, + 4, + 22, + 28, + 29, + 12, + 3, + 1, + 11, + 8, + 5, + 20, + 2, + 11, + 20, + 3, + 19, + 10, + 1, + 6, + 6 + ], + "weighted_loads": [ + 0.45884889061562717, + 0.969455175101757, + 0.4631024859845638, + 1.8147907683160156, + 0.20379602164030075, + 0.11050161393359303, + 0.8749165423214436, + 0.2416999414563179, + 0.40386479254812, + 0.26600488275289536, + 0.25832424685359, + 0.027619222179055214, + 0.339798036031425, + 0.7955416720360518, + 0.9482478350400925, + 0.2623617220669985, + 1.0361872618086636, + 0.2367832139134407, + 0.2112242914736271, + 0.2235834915190935, + 0.0468989722430706, + 0.03167188912630081, + 0.1025821603834629, + 1.8676469177007675, + 0.22775395959615707, + 0.21395933255553246, + 0.0, + 0.7607051096856594, + 0.5926725715398788, + 0.20197535678744316, + 2.4096138514578342, + 0.19937820360064507, + 0.12313399277627468, + 0.9858696284936741, + 0.3713320214301348, + 0.03534969687461853, + 0.594589177519083, + 0.26980819925665855, + 0.8541177371516824, + 0.13130373507738113, + 0.5305201634764671, + 0.28032783046364784, + 0.1481730779632926, + 0.026116520166397095, + 0.24481122195720673, + 3.432050073519349, + 2.3289748337119818, + 6.836986728711054, + 0.6479451339691877, + 0.14559119939804077, + 0.02707340382039547, + 0.6956090200692415, + 0.809777706861496, + 0.19034988805651665, + 1.4029335360974073, + 0.10092419758439064, + 0.6336820311844349, + 1.7952437661588192, + 0.17277129366993904, + 1.2801084034144878, + 0.7608882337808609, + 0.12552960216999054, + 0.21727090887725353, + 0.2429435569792986 + ], + "unique_experts": 63, + "load_cv": 0.7903449309659177, + "normalized_load_entropy": 0.9280649407997589, + "max_load_share": 0.05197132616487455 + } + }, + "s0_bos": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "8f948432819b1117b724f3b3ed0e9c60c7112b7f869723b9b2da110c0632ded4", + "route_weight_sha256": "78a92269f1651120ca3cdf7d9e3911ff157207c886c4f92c0bb939c3cd3379cf", + "loads": [ + 5, + 7, + 2, + 16, + 1, + 1, + 2, + 0, + 5, + 4, + 3, + 0, + 8, + 9, + 9, + 4, + 13, + 3, + 2, + 2, + 1, + 0, + 1, + 1, + 3, + 6, + 0, + 12, + 9, + 3, + 18, + 3, + 1, + 5, + 4, + 1, + 3, + 5, + 5, + 2, + 2, + 6, + 3, + 0, + 2, + 14, + 12, + 25, + 7, + 1, + 0, + 0, + 2, + 3, + 13, + 1, + 11, + 1, + 0, + 18, + 9, + 0, + 0, + 3 + ], + "weighted_loads": [ + 0.1349999699741602, + 0.6281527280807495, + 0.13196666538715363, + 1.2961400821805, + 0.06342637538909912, + 0.02980368211865425, + 0.1342516727745533, + 0.0, + 0.3701738268136978, + 0.11551515199244022, + 0.16761315613985062, + 0.0, + 0.36065657436847687, + 0.6024702899158001, + 0.8114331187680364, + 0.2061425819993019, + 0.9633914204314351, + 0.18365493044257164, + 0.12685464695096016, + 0.13128673657774925, + 0.025741642341017723, + 0.0, + 0.021542716771364212, + 0.03639921173453331, + 0.15836499258875847, + 0.2132801115512848, + 0.0, + 0.7415416985750198, + 0.6603269092738628, + 0.15064175054430962, + 2.564578080549836, + 0.19693122431635857, + 0.027043096721172333, + 0.262821689248085, + 0.28424669429659843, + 0.03543085604906082, + 0.15313901379704475, + 0.231313094496727, + 0.37308981642127037, + 0.10914064943790436, + 0.08458642661571503, + 0.253285413607955, + 0.09733174927532673, + 0.0, + 0.14268480613827705, + 1.4069556407630444, + 0.7143318690359592, + 6.715277433395386, + 0.45225998759269714, + 0.02592320553958416, + 0.0, + 0.0, + 0.16885562241077423, + 0.11833297833800316, + 0.5304451193660498, + 0.09750946611166, + 0.6293551288545132, + 0.04067433625459671, + 0.0, + 1.289035726338625, + 0.7547587249428034, + 0.0, + 0.0, + 0.09338499791920185 + ], + "unique_experts": 54, + "load_cv": 1.0893664505768206, + "normalized_load_entropy": 0.8717641715944972, + "max_load_share": 0.08012820512820513 + }, + "full_input": { + "tokens": 77, + "top_k": 6, + "decisions": 462, + "ordered_route_sha256": "c75e9fc75ebe5ab8e887a03cd0443515f3394c023480617fe9d6891daad66a46", + "route_weight_sha256": "a536cb3a4a1b8aac35fcd962c3a09a8c9bbf06756c595a9f3a8d6185c41f8a49", + "loads": [ + 8, + 10, + 2, + 24, + 5, + 4, + 8, + 6, + 5, + 13, + 3, + 0, + 10, + 14, + 10, + 4, + 16, + 3, + 2, + 3, + 1, + 0, + 4, + 12, + 6, + 6, + 1, + 12, + 9, + 3, + 18, + 3, + 2, + 8, + 4, + 1, + 3, + 5, + 8, + 5, + 11, + 7, + 5, + 2, + 2, + 19, + 23, + 27, + 8, + 1, + 1, + 1, + 2, + 4, + 23, + 2, + 11, + 13, + 3, + 19, + 10, + 0, + 3, + 4 + ], + "weighted_loads": [ + 0.25541099440306425, + 0.7992814294993877, + 0.13196666538715363, + 1.5510910893790424, + 0.2337850909680128, + 0.16002547414973378, + 0.5215318910777569, + 0.2415592037141323, + 0.3701738268136978, + 0.4267279617488384, + 0.16761315613985062, + 0.0, + 0.40375041775405407, + 0.8245140016078949, + 0.8848129035905004, + 0.2061425819993019, + 1.0156119666062295, + 0.18365493044257164, + 0.12685464695096016, + 0.2979174964129925, + 0.025741642341017723, + 0.0, + 0.16515197791159153, + 1.4049042873084545, + 0.2834921646863222, + 0.2132801115512848, + 0.14223499596118927, + 0.7415416985750198, + 0.6603269092738628, + 0.15064175054430962, + 2.564578080549836, + 0.19693122431635857, + 0.08180209994316101, + 0.5488963723182678, + 0.28424669429659843, + 0.03543085604906082, + 0.15313901379704475, + 0.231313094496727, + 0.515913350507617, + 0.1852160468697548, + 0.5263661779463291, + 0.31045117042958736, + 0.14915996231138706, + 0.07987251505255699, + 0.14268480613827705, + 2.4316164162009954, + 1.683373611420393, + 6.774702948518097, + 0.4912533350288868, + 0.02592320553958416, + 0.049195244908332825, + 0.09365899860858917, + 0.16885562241077423, + 0.15876482799649239, + 1.4517601858824492, + 0.1437789350748062, + 0.6293551288545132, + 1.1404381431639194, + 0.16376977413892746, + 1.532006148248911, + 0.7852423284202814, + 0.0, + 0.09605971537530422, + 0.1542648058384657 + ], + "unique_experts": 61, + "load_cv": 0.8962502755990147, + "normalized_load_entropy": 0.9109623705519129, + "max_load_share": 0.05844155844155844 + } + }, + "s1_bos": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "d67d8f78ea9394cbcf3fa1d64aa55fa2480bed74b60767ac0fff185d2e42c8b7", + "route_weight_sha256": "000ccde75dff69ef251a4d0a3a1a7bbfd11e32394904cbb50a70ad69fefe0faa", + "loads": [ + 6, + 7, + 2, + 16, + 1, + 1, + 2, + 0, + 4, + 4, + 4, + 1, + 8, + 9, + 11, + 4, + 11, + 3, + 2, + 2, + 2, + 0, + 1, + 1, + 3, + 4, + 0, + 12, + 9, + 1, + 15, + 3, + 1, + 5, + 4, + 1, + 3, + 5, + 5, + 4, + 2, + 6, + 3, + 0, + 2, + 14, + 13, + 25, + 7, + 0, + 0, + 0, + 3, + 3, + 12, + 1, + 11, + 2, + 0, + 18, + 9, + 1, + 0, + 3 + ], + "weighted_loads": [ + 0.14589806646108627, + 0.6131755448877811, + 0.13791803643107414, + 1.288964431732893, + 0.06415090709924698, + 0.02799682505428791, + 0.14042489975690842, + 0.0, + 0.3120877183973789, + 0.1068241223692894, + 0.2089504338800907, + 0.028554605320096016, + 0.34527575224637985, + 0.5913192685693502, + 0.8820418557152152, + 0.21332121640443802, + 0.931001789867878, + 0.17958226427435875, + 0.13261529058218002, + 0.12925159558653831, + 0.05847609601914883, + 0.0, + 0.023393036797642708, + 0.03923194110393524, + 0.15138527750968933, + 0.14555013552308083, + 0.0, + 0.7778038568794727, + 0.6218472607433796, + 0.0811103954911232, + 2.3589491806924343, + 0.19484768435359, + 0.027764564380049706, + 0.2770758531987667, + 0.30997588112950325, + 0.040880557149648666, + 0.14944712445139885, + 0.23301593586802483, + 0.38157470524311066, + 0.1868570391088724, + 0.07867376320064068, + 0.26657089963555336, + 0.09272259194403887, + 0.0, + 0.14423418045043945, + 1.3879424333572388, + 0.7457098755985498, + 6.678531568497419, + 0.43592580035328865, + 0.0, + 0.0, + 0.0, + 0.19717031717300415, + 0.13014115765690804, + 0.49355543218553066, + 0.07646900415420532, + 0.6360247451812029, + 0.06856348924338818, + 0.0, + 1.317484311759472, + 0.7230853792279959, + 0.026117712259292603, + 0.0, + 0.09140766970813274 + ], + "unique_experts": 55, + "load_cv": 1.0581389888186332, + "normalized_load_entropy": 0.8786856487748739, + "max_load_share": 0.08012820512820513 + }, + "full_input": { + "tokens": 93, + "top_k": 6, + "decisions": 558, + "ordered_route_sha256": "4cabc36afa5a49cca2a5c31a13a41e4505705898c0df49eb527828ac594df7d4", + "route_weight_sha256": "6fb11d3a0fa32d594ba69ce7b922e100c01523b8e3aebdf5d32f0e77ae64a0f2", + "loads": [ + 10, + 12, + 8, + 24, + 5, + 4, + 14, + 7, + 5, + 9, + 6, + 1, + 9, + 14, + 12, + 7, + 15, + 4, + 4, + 2, + 3, + 0, + 4, + 16, + 6, + 5, + 0, + 12, + 9, + 2, + 16, + 3, + 3, + 16, + 4, + 1, + 9, + 6, + 12, + 5, + 13, + 7, + 5, + 0, + 4, + 20, + 29, + 28, + 13, + 3, + 1, + 11, + 9, + 7, + 22, + 3, + 11, + 21, + 3, + 18, + 12, + 2, + 6, + 6 + ], + "weighted_loads": [ + 0.4407100426033139, + 0.9404475167393684, + 0.4478183574974537, + 1.7818329683504999, + 0.21430450305342674, + 0.12708677211776376, + 0.8442860543727875, + 0.2693697065114975, + 0.34786926954984665, + 0.3036610335111618, + 0.3020053543150425, + 0.028554605320096016, + 0.355461441911757, + 0.8118158858269453, + 0.9755262797698379, + 0.333865599706769, + 1.010787567589432, + 0.2416379190981388, + 0.2240505889058113, + 0.12925159558653831, + 0.10537506826221943, + 0.0, + 0.17276808992028236, + 1.953815996646881, + 0.28050342202186584, + 0.1736993007361889, + 0.0, + 0.7778038568794727, + 0.6218472607433796, + 0.12662987038493156, + 2.405208371579647, + 0.19484768435359, + 0.1093332152813673, + 1.0051642023026943, + 0.30997588112950325, + 0.040880557149648666, + 0.5860314518213272, + 0.2807006277143955, + 0.7779305661097169, + 0.21023397892713547, + 0.579327778890729, + 0.3246418461203575, + 0.14826581347733736, + 0.0, + 0.24750231206417084, + 2.459557706490159, + 2.3621231224387884, + 6.901899532414973, + 0.6958061549812555, + 0.14559119939804077, + 0.02707340382039547, + 0.650738125666976, + 0.8433176502585411, + 0.32417695969343185, + 1.4621474351733923, + 0.15690409764647484, + 0.6360247451812029, + 1.8055725637823343, + 0.1828734278678894, + 1.317484311759472, + 0.8316344227641821, + 0.15164731442928314, + 0.21727090887725353, + 0.26096983812749386 + ], + "unique_experts": 61, + "load_cv": 0.7727236145004727, + "normalized_load_entropy": 0.9297089637336005, + "max_load_share": 0.05197132616487455 + } + }, + "s0_x": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "2081a8762909977fd5b414d077178a87c0b88febfa2487121792b16525249b22", + "route_weight_sha256": "71ca03e782f413036033e29d62710da88c674d6581e24c69730fb963c62affb8", + "loads": [ + 5, + 7, + 2, + 16, + 1, + 0, + 2, + 0, + 5, + 4, + 4, + 1, + 7, + 10, + 9, + 2, + 14, + 3, + 2, + 1, + 1, + 1, + 1, + 1, + 4, + 7, + 0, + 12, + 9, + 4, + 15, + 3, + 0, + 5, + 4, + 1, + 3, + 5, + 5, + 2, + 3, + 5, + 3, + 0, + 2, + 14, + 14, + 26, + 7, + 0, + 0, + 0, + 2, + 2, + 13, + 1, + 11, + 1, + 0, + 19, + 8, + 0, + 0, + 3 + ], + "weighted_loads": [ + 0.13009001035243273, + 0.6334538757801056, + 0.1443096287548542, + 1.3146909400820732, + 0.058429814875125885, + 0.0, + 0.13532265275716782, + 0.0, + 0.37542155012488365, + 0.09860595688223839, + 0.20379208400845528, + 0.026887789368629456, + 0.3031686246395111, + 0.5967975128442049, + 0.825862281024456, + 0.14268425852060318, + 0.9772021472454071, + 0.1825282908976078, + 0.12409176677465439, + 0.08615678548812866, + 0.027064599096775055, + 0.031058641150593758, + 0.021726461127400398, + 0.03524984046816826, + 0.17667777836322784, + 0.23789085634052753, + 0.0, + 0.7504636831581593, + 0.6138482615351677, + 0.17328746244311333, + 2.3335182648152113, + 0.19444968923926353, + 0.0, + 0.2612130157649517, + 0.31681254133582115, + 0.040209442377090454, + 0.16157754138112068, + 0.23010198399424553, + 0.3957853801548481, + 0.10075725987553596, + 0.11970426887273788, + 0.22789674252271652, + 0.09466530662029982, + 0.0, + 0.13893036544322968, + 1.358301430940628, + 0.8004245664924383, + 6.8638356029987335, + 0.4539903253316879, + 0.0, + 0.0, + 0.0, + 0.17731714248657227, + 0.07861318066716194, + 0.527222404256463, + 0.08238835632801056, + 0.6352809313684702, + 0.04125995561480522, + 0.0, + 1.3006375394761562, + 0.7090624012053013, + 0.0, + 0.0, + 0.09567076154053211 + ], + "unique_experts": 53, + "load_cv": 1.1079178307932462, + "normalized_load_entropy": 0.8671800856815329, + "max_load_share": 0.08333333333333333 + }, + "full_input": { + "tokens": 77, + "top_k": 6, + "decisions": 462, + "ordered_route_sha256": "2a4ef0865b384cadbdaabe671b05845d8d2afcc5e1a2b80a1def26b2f4615cb8", + "route_weight_sha256": "586cbd988488b82a1d3c93f14e4239d9f8f201e6957115394dafdad1da369dbf", + "loads": [ + 9, + 10, + 2, + 26, + 4, + 3, + 9, + 6, + 5, + 13, + 4, + 1, + 8, + 15, + 11, + 2, + 18, + 3, + 2, + 1, + 1, + 1, + 3, + 12, + 7, + 7, + 0, + 12, + 9, + 4, + 15, + 3, + 1, + 9, + 4, + 1, + 4, + 5, + 10, + 5, + 10, + 6, + 5, + 0, + 2, + 20, + 28, + 28, + 8, + 0, + 0, + 2, + 2, + 2, + 24, + 1, + 11, + 12, + 1, + 19, + 9, + 0, + 3, + 4 + ], + "weighted_loads": [ + 0.32654029689729214, + 0.8045825771987438, + 0.1443096287548542, + 1.7087098727934062, + 0.17353861965239048, + 0.12339819269254804, + 0.5815857015550137, + 0.22063698805868626, + 0.37542155012488365, + 0.39154978282749653, + 0.20379208400845528, + 0.026887789368629456, + 0.31338675506412983, + 0.8251930866390467, + 0.943697702139616, + 0.14268425852060318, + 1.0589085430838168, + 0.1825282908976078, + 0.12409176677465439, + 0.08615678548812866, + 0.027064599096775055, + 0.031058641150593758, + 0.11664668843150139, + 1.339635107666254, + 0.302057484164834, + 0.23789085634052753, + 0.0, + 0.7504636831581593, + 0.6138482615351677, + 0.17328746244311333, + 2.3335182648152113, + 0.19444968923926353, + 0.05475900322198868, + 0.6126927100121975, + 0.31681254133582115, + 0.040209442377090454, + 0.20248669758439064, + 0.23010198399424553, + 0.6285426001995802, + 0.17639640159904957, + 0.47056611254811287, + 0.27823977172374725, + 0.14613832999020815, + 0.0, + 0.13893036544322968, + 2.4206122774630785, + 1.9745619166642427, + 6.923261118121445, + 0.4929836727678776, + 0.0, + 0.0, + 0.14142363518476486, + 0.17731714248657227, + 0.07861318066716194, + 1.5830421764403582, + 0.08238835632801056, + 0.6352809313684702, + 1.0962298549711704, + 0.057221293449401855, + 1.3006375394761562, + 0.7376027964055538, + 0.0, + 0.09605971537530422, + 0.14899192936718464 + ], + "unique_experts": 59, + "load_cv": 0.9707689652800122, + "normalized_load_entropy": 0.8955697143049272, + "max_load_share": 0.06060606060606061 + } + }, + "s1_x": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "562d792ad0cd9174191ae44cbb5b183def9d647dccfaf545d38404b4abda7ffc", + "route_weight_sha256": "5ad4776a8a653cd9141f545f0f7d5e69b6830f4cb7ef37200688e572789d1e70", + "loads": [ + 6, + 8, + 2, + 16, + 1, + 1, + 2, + 0, + 5, + 3, + 2, + 1, + 8, + 8, + 9, + 3, + 13, + 3, + 2, + 3, + 0, + 0, + 1, + 1, + 3, + 5, + 0, + 12, + 8, + 2, + 15, + 3, + 0, + 5, + 5, + 1, + 3, + 6, + 5, + 3, + 1, + 6, + 4, + 1, + 2, + 14, + 15, + 26, + 7, + 0, + 0, + 0, + 3, + 2, + 13, + 1, + 11, + 1, + 0, + 19, + 9, + 1, + 0, + 2 + ], + "weighted_loads": [ + 0.14473979081958532, + 0.6449521034955978, + 0.14186931774020195, + 1.2869128473103046, + 0.06255783885717392, + 0.02410849556326866, + 0.1410459317266941, + 0.0, + 0.3450604975223541, + 0.07341055385768414, + 0.14483149349689484, + 0.029526354745030403, + 0.33149809017777443, + 0.5112283565104008, + 0.7910997401922941, + 0.17958338931202888, + 0.9508327189832926, + 0.17296665906906128, + 0.13433220982551575, + 0.14209140092134476, + 0.0, + 0.0, + 0.023098325356841087, + 0.038926638662815094, + 0.14559344947338104, + 0.17697323486208916, + 0.0, + 0.7562660984694958, + 0.5213064290583134, + 0.11495736241340637, + 2.213818598538637, + 0.21622176095843315, + 0.0, + 0.28201884403824806, + 0.3549373187124729, + 0.03865154832601547, + 0.16395733132958412, + 0.2570050749927759, + 0.3769107349216938, + 0.13800998590886593, + 0.053029049187898636, + 0.2580542154610157, + 0.145325499586761, + 0.023911744356155396, + 0.1398838832974434, + 1.4000023640692234, + 0.7986605130136013, + 6.771738873794675, + 0.44050993025302887, + 0.0, + 0.0, + 0.0, + 0.18961081095039845, + 0.08538294956088066, + 0.5472420807927847, + 0.0727262943983078, + 0.6467208378016949, + 0.040322814136743546, + 0.0, + 1.3806552328169346, + 0.7061298601329327, + 0.02857016585767269, + 0.0, + 0.06636772491037846 + ], + "unique_experts": 54, + "load_cv": 1.1061361338524611, + "normalized_load_entropy": 0.8687218857962231, + "max_load_share": 0.08333333333333333 + }, + "full_input": { + "tokens": 93, + "top_k": 6, + "decisions": 558, + "ordered_route_sha256": "87bf293e0958a303f93453117122ef3f129ae660c6f72a9c514480923ea40097", + "route_weight_sha256": "ceebcd661797d739c1a9583c062c48603e1f39d94c06cd1a523c0efdff97d946", + "loads": [ + 11, + 13, + 8, + 25, + 4, + 3, + 15, + 6, + 6, + 6, + 4, + 1, + 9, + 14, + 10, + 6, + 18, + 4, + 4, + 4, + 1, + 0, + 3, + 17, + 5, + 6, + 0, + 12, + 8, + 3, + 15, + 3, + 2, + 15, + 5, + 1, + 10, + 7, + 13, + 5, + 8, + 7, + 6, + 1, + 4, + 21, + 34, + 29, + 14, + 3, + 1, + 12, + 9, + 3, + 26, + 2, + 11, + 19, + 2, + 20, + 11, + 2, + 7, + 4 + ], + "weighted_loads": [ + 0.4664381928741932, + 0.9722240753471851, + 0.4517696388065815, + 1.8389363675378263, + 0.16943489387631416, + 0.06923437165096402, + 0.883966937661171, + 0.20884547010064125, + 0.38084204867482185, + 0.19124566577374935, + 0.23788641393184662, + 0.029526354745030403, + 0.34168377984315157, + 0.763845544308424, + 0.8845841642469168, + 0.30012777261435986, + 1.0555552043952048, + 0.23502231389284134, + 0.22576750814914703, + 0.17560234665870667, + 0.0468989722430706, + 0.0, + 0.10119782760739326, + 1.9152515307068825, + 0.22508826851844788, + 0.22276677191257477, + 0.0, + 0.7562660984694958, + 0.5213064290583134, + 0.16047683730721474, + 2.213818598538637, + 0.21622176095843315, + 0.08192368224263191, + 1.0330743938684464, + 0.3549373187124729, + 0.03865154832601547, + 0.6400505937635899, + 0.3046897668391466, + 0.8313656924292445, + 0.18951979465782642, + 0.3302531559020281, + 0.31330396607518196, + 0.20237590465694666, + 0.023911744356155396, + 0.24315201491117477, + 2.5052117947489023, + 2.722177989780903, + 6.995106837712228, + 0.7541969809681177, + 0.14559119939804077, + 0.02707340382039547, + 0.7854932490736246, + 0.8357581440359354, + 0.11777756735682487, + 1.7663023006170988, + 0.10425672307610512, + 0.6467208378016949, + 1.6681506633758545, + 0.1202344037592411, + 1.4149368479847908, + 0.7829487472772598, + 0.15409976802766323, + 0.2517147082835436, + 0.14318999834358692 + ], + "unique_experts": 62, + "load_cv": 0.846113508350076, + "normalized_load_entropy": 0.9203903667238702, + "max_load_share": 0.06093189964157706 + } + }, + "s0_period": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "00ae6bc3a2bfbfd9cb64f6d7f29118209889710a6ed8c3ccba4c1d62745850ee", + "route_weight_sha256": "4f78e237559c698be0214864812a0149756108444ee2afdce6a0ff7b07780b9b", + "loads": [ + 5, + 7, + 2, + 16, + 1, + 1, + 2, + 0, + 5, + 4, + 4, + 1, + 9, + 9, + 9, + 2, + 14, + 3, + 2, + 1, + 1, + 1, + 1, + 1, + 3, + 6, + 0, + 12, + 9, + 2, + 15, + 3, + 0, + 5, + 4, + 1, + 3, + 5, + 5, + 3, + 4, + 5, + 3, + 0, + 2, + 14, + 13, + 26, + 7, + 0, + 0, + 0, + 2, + 2, + 13, + 1, + 12, + 1, + 0, + 19, + 8, + 0, + 0, + 3 + ], + "weighted_loads": [ + 0.1374144870787859, + 0.6196672022342682, + 0.14413142949342728, + 1.2970307059586048, + 0.06104891374707222, + 0.024013517424464226, + 0.13423290476202965, + 0.0, + 0.37005503848195076, + 0.10021639801561832, + 0.21055445075035095, + 0.027839234098792076, + 0.35243756882846355, + 0.5686867889016867, + 0.8244995158165693, + 0.1457274928689003, + 1.0506128314882517, + 0.18193664774298668, + 0.12661635875701904, + 0.08940508961677551, + 0.027469968423247337, + 0.0377352312207222, + 0.022191554307937622, + 0.03684654086828232, + 0.14149529114365578, + 0.20846189185976982, + 0.0, + 0.7737567760050297, + 0.613132331520319, + 0.12088707834482193, + 2.2321065347641706, + 0.18570242449641228, + 0.0, + 0.26085834205150604, + 0.3090979605913162, + 0.04286220297217369, + 0.15397967770695686, + 0.22254911065101624, + 0.37677865847945213, + 0.13279428705573082, + 0.14547788724303246, + 0.22669127210974693, + 0.0983904805034399, + 0.0, + 0.14046572148799896, + 1.4216983988881111, + 0.7214515395462513, + 6.905268266797066, + 0.44862982258200645, + 0.0, + 0.0, + 0.0, + 0.18308960646390915, + 0.08223811164498329, + 0.5315245669335127, + 0.08919623494148254, + 0.6827584430575371, + 0.04158560186624527, + 0.0, + 1.3958703130483627, + 0.6960590519011021, + 0.0, + 0.0, + 0.09294440969824791 + ], + "unique_experts": 54, + "load_cv": 1.1049467398161663, + "normalized_load_entropy": 0.869012557740591, + "max_load_share": 0.08333333333333333 + }, + "full_input": { + "tokens": 77, + "top_k": 6, + "decisions": 462, + "ordered_route_sha256": "b2bb9d1360e1abeaa4bd0dc1fb98d6b304b60a4d3bed48f644ba5193e41556c6", + "route_weight_sha256": "def34ecbe9160934aaeceea38bd04c3bdeb230c641e4b264af11ec96625c1012", + "loads": [ + 9, + 10, + 3, + 24, + 5, + 4, + 10, + 5, + 5, + 14, + 4, + 1, + 10, + 14, + 10, + 2, + 17, + 3, + 2, + 1, + 1, + 1, + 3, + 11, + 6, + 7, + 0, + 12, + 9, + 2, + 15, + 3, + 1, + 9, + 4, + 1, + 3, + 5, + 11, + 5, + 13, + 6, + 5, + 0, + 2, + 19, + 26, + 28, + 8, + 0, + 0, + 2, + 2, + 3, + 24, + 1, + 12, + 13, + 1, + 19, + 9, + 0, + 3, + 4 + ], + "weighted_loads": [ + 0.32869149278849363, + 0.7907959036529064, + 0.18703259900212288, + 1.5519817131571472, + 0.22014731727540493, + 0.1474019424058497, + 0.6590376384556293, + 0.19905532896518707, + 0.37005503848195076, + 0.4571673087775707, + 0.21055445075035095, + 0.027839234098792076, + 0.3626556992530823, + 0.7954162266105413, + 0.8978793006390333, + 0.1457274928689003, + 1.1028333776630461, + 0.18193664774298668, + 0.12661635875701904, + 0.08940508961677551, + 0.027469968423247337, + 0.0377352312207222, + 0.12283333577215672, + 1.31152955442667, + 0.27384514920413494, + 0.2392580211162567, + 0.0, + 0.7737567760050297, + 0.613132331520319, + 0.12088707834482193, + 2.2321065347641706, + 0.18570242449641228, + 0.05475900322198868, + 0.6071522235870361, + 0.3090979605913162, + 0.04286220297217369, + 0.15397967770695686, + 0.22254911065101624, + 0.7461184896528721, + 0.18336389772593975, + 0.5664099343121052, + 0.2808409593999386, + 0.14918312057852745, + 0.0, + 0.14046572148799896, + 2.446359174326062, + 1.7752760089933872, + 6.964693781919777, + 0.4876231700181961, + 0.0, + 0.0, + 0.14965073019266129, + 0.18308960646390915, + 0.1264851875603199, + 1.5022449363023043, + 0.08919623494148254, + 0.6827584430575371, + 1.1467281505465508, + 0.057221293449401855, + 1.3958703130483627, + 0.7241622805595398, + 0.0, + 0.09605971537530422, + 0.15042684599757195 + ], + "unique_experts": 59, + "load_cv": 0.9470037099643045, + "normalized_load_entropy": 0.8980986775163177, + "max_load_share": 0.06060606060606061 + } + }, + "s1_period": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "0aa1eb92837f74bc140218b63f4b8f49c14d19421c92440eb345ee93da3a038b", + "route_weight_sha256": "ed0795c5ae417775cce2721c18614e20d79607bb369d763ddcddf7a8de0c88a8", + "loads": [ + 6, + 8, + 2, + 16, + 1, + 1, + 2, + 0, + 5, + 3, + 3, + 1, + 8, + 8, + 10, + 3, + 14, + 3, + 2, + 3, + 0, + 1, + 1, + 1, + 3, + 4, + 0, + 12, + 9, + 1, + 15, + 3, + 1, + 5, + 4, + 1, + 3, + 5, + 5, + 4, + 1, + 6, + 4, + 0, + 2, + 14, + 14, + 25, + 7, + 0, + 0, + 0, + 3, + 2, + 13, + 1, + 11, + 1, + 0, + 19, + 9, + 1, + 0, + 2 + ], + "weighted_loads": [ + 0.1428283555433154, + 0.6548305600881577, + 0.14554963260889053, + 1.3079600632190704, + 0.05632670968770981, + 0.02467578463256359, + 0.1421763375401497, + 0.0, + 0.34512829780578613, + 0.07338308170437813, + 0.1822272501885891, + 0.031662218272686005, + 0.34881429374217987, + 0.5184338111430407, + 0.8091911254450679, + 0.17909516394138336, + 0.9309627003967762, + 0.1763824298977852, + 0.13826650753617287, + 0.16250917315483093, + 0.0, + 0.0319918729364872, + 0.023466333746910095, + 0.03524583950638771, + 0.15237749367952347, + 0.14512013085186481, + 0.0, + 0.7498696446418762, + 0.5416382402181625, + 0.07663902640342712, + 2.2615435626357794, + 0.1986965425312519, + 0.025489890947937965, + 0.27998805046081543, + 0.31532616540789604, + 0.036309417337179184, + 0.1691914051771164, + 0.226871520280838, + 0.38960228115320206, + 0.17037099227309227, + 0.05836500972509384, + 0.26449915394186974, + 0.1400690572336316, + 0.0, + 0.14330579340457916, + 1.3773239217698574, + 0.7606839127838612, + 6.741875696927309, + 0.4431133195757866, + 0.0, + 0.0, + 0.0, + 0.19385574758052826, + 0.09155319258570671, + 0.5515891965478659, + 0.0730195865035057, + 0.6314577162265778, + 0.04086250811815262, + 0.0, + 1.3834879342466593, + 0.6937204487621784, + 0.028595084324479103, + 0.0, + 0.06814189441502094 + ], + "unique_experts": 55, + "load_cv": 1.0953850955535296, + "normalized_load_entropy": 0.8709218323290968, + "max_load_share": 0.08012820512820513 + }, + "full_input": { + "tokens": 93, + "top_k": 6, + "decisions": 558, + "ordered_route_sha256": "4287486e55bed53b86ab5c38e56c2bb92fc4351aa4864adeb09325602f26110c", + "route_weight_sha256": "12c59bb55625bdb3c8b70c4608cae5efc76c827f591a4fa7f1018aaa59e50a67", + "loads": [ + 10, + 13, + 8, + 25, + 5, + 3, + 16, + 7, + 6, + 8, + 5, + 1, + 9, + 13, + 11, + 6, + 20, + 4, + 4, + 3, + 1, + 1, + 3, + 15, + 5, + 5, + 0, + 12, + 9, + 2, + 15, + 3, + 3, + 16, + 4, + 1, + 9, + 6, + 14, + 5, + 9, + 7, + 7, + 0, + 4, + 20, + 33, + 28, + 13, + 3, + 1, + 11, + 9, + 5, + 25, + 2, + 11, + 19, + 1, + 21, + 11, + 2, + 6, + 4 + ], + "weighted_loads": [ + 0.4225804731249809, + 0.982102531939745, + 0.4554499536752701, + 1.8388031548820436, + 0.1988888643682003, + 0.06980166072025895, + 0.9461918286979198, + 0.24273502081632614, + 0.38090984895825386, + 0.2629322484135628, + 0.2752821706235409, + 0.031662218272686005, + 0.358999983407557, + 0.7389304284006357, + 0.9026755494996905, + 0.29963954724371433, + 1.0702911172993481, + 0.23843808472156525, + 0.22970180585980415, + 0.16250917315483093, + 0.0468989722430706, + 0.0319918729364872, + 0.09969287551939487, + 1.8221053555607796, + 0.2318723127245903, + 0.19276112504303455, + 0.0, + 0.7498696446418762, + 0.5416382402181625, + 0.12215850129723549, + 2.2615435626357794, + 0.1986965425312519, + 0.10542713664472103, + 1.1105377711355686, + 0.31532616540789604, + 0.036309417337179184, + 0.6057757325470448, + 0.2745562121272087, + 1.013008433394134, + 0.19374793209135532, + 0.3779286500066519, + 0.31739887595176697, + 0.23231191653758287, + 0.0, + 0.24657392501831055, + 2.4489391949027777, + 2.5212983079254627, + 6.9652436608448625, + 0.7029936742037535, + 0.14559119939804077, + 0.02707340382039547, + 0.6998752895742655, + 0.8400030806660652, + 0.20176536589860916, + 1.6390987429767847, + 0.10455001518130302, + 0.6314577162265778, + 1.6921024955809116, + 0.08279148489236832, + 1.4491681680083275, + 0.7705393359065056, + 0.15412468649446964, + 0.21727090887725353, + 0.1478260662406683 + ], + "unique_experts": 62, + "load_cv": 0.8333853608455325, + "normalized_load_entropy": 0.9214640149519342, + "max_load_share": 0.05913978494623656 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 52, + "ordered_topk_exact_tokens": 29, + "set_exact_tokens": 34, + "mean_set_jaccard": 0.9010989010989012, + "mean_token_weighted_tv": 0.019799379909482714, + "aggregate_load_tv": 0.04807692307692307 + }, + "system_bos": { + "tokens": 52, + "ordered_topk_exact_tokens": 32, + "set_exact_tokens": 40, + "mean_set_jaccard": 0.929945054945055, + "mean_token_weighted_tv": 0.020441229831284054, + "aggregate_load_tv": 0.038461538461538464 + }, + "system_x": { + "tokens": 52, + "ordered_topk_exact_tokens": 19, + "set_exact_tokens": 30, + "mean_set_jaccard": 0.875, + "mean_token_weighted_tv": 0.029048618394881487, + "aggregate_load_tv": 0.054487179487179495 + }, + "system_period": { + "tokens": 52, + "ordered_topk_exact_tokens": 21, + "set_exact_tokens": 32, + "mean_set_jaccard": 0.8901098901098903, + "mean_token_weighted_tv": 0.02810015755956276, + "aggregate_load_tv": 0.04487179487179487 + }, + "bos_at_s0": { + "tokens": 52, + "ordered_topk_exact_tokens": 28, + "set_exact_tokens": 33, + "mean_set_jaccard": 0.8873626373626374, + "mean_token_weighted_tv": 0.029995876507690318, + "aggregate_load_tv": 0.04487179487179485 + }, + "bos_at_s1": { + "tokens": 52, + "ordered_topk_exact_tokens": 20, + "set_exact_tokens": 27, + "mean_set_jaccard": 0.8553113553113554, + "mean_token_weighted_tv": 0.033871053135953844, + "aggregate_load_tv": 0.06089743589743589 + }, + "x_at_s0": { + "tokens": 52, + "ordered_topk_exact_tokens": 26, + "set_exact_tokens": 37, + "mean_set_jaccard": 0.9134615384615384, + "mean_token_weighted_tv": 0.023564927387409486, + "aggregate_load_tv": 0.04166666666666666 + }, + "x_at_s1": { + "tokens": 52, + "ordered_topk_exact_tokens": 17, + "set_exact_tokens": 25, + "mean_set_jaccard": 0.8434065934065933, + "mean_token_weighted_tv": 0.036142280262608364, + "aggregate_load_tv": 0.054487179487179495 + }, + "period_at_s0": { + "tokens": 52, + "ordered_topk_exact_tokens": 23, + "set_exact_tokens": 34, + "mean_set_jaccard": 0.8928571428571429, + "mean_token_weighted_tv": 0.02808735761433267, + "aggregate_load_tv": 0.044871794871794865 + }, + "period_at_s1": { + "tokens": 52, + "ordered_topk_exact_tokens": 21, + "set_exact_tokens": 26, + "mean_set_jaccard": 0.8489010989010988, + "mean_token_weighted_tv": 0.03613344979329178, + "aggregate_load_tv": 0.05448717948717949 + } + } + }, + "layer_24": { + "layer": 24, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "78d705ddb3df5ac8dc2ad137276eb9f2f54f10f44a88f51524da4752170ee038", + "route_weight_sha256": "8a6a245771401b2ea265cc707689ef5df70e2209d2c0f27a6afa1e2200075d11", + "loads": [ + 0, + 0, + 3, + 1, + 1, + 0, + 21, + 5, + 19, + 2, + 11, + 0, + 2, + 3, + 1, + 2, + 0, + 0, + 2, + 2, + 7, + 1, + 0, + 15, + 5, + 14, + 1, + 37, + 13, + 9, + 11, + 0, + 5, + 7, + 0, + 2, + 5, + 1, + 7, + 6, + 1, + 1, + 4, + 0, + 2, + 12, + 0, + 0, + 4, + 6, + 5, + 2, + 3, + 14, + 3, + 2, + 1, + 3, + 0, + 0, + 22, + 4, + 1, + 1 + ], + "weighted_loads": [ + 0.0, + 0.0, + 0.09805911220610142, + 0.039064276963472366, + 0.03687044233083725, + 0.0, + 1.6378709748387337, + 0.16377610899508, + 3.1650807075202465, + 0.11419842392206192, + 1.423415895551443, + 0.0, + 0.2212410569190979, + 0.13558896631002426, + 0.04272253066301346, + 0.1087966039776802, + 0.0, + 0.0, + 0.09255148842930794, + 0.08314673975110054, + 0.3788912035524845, + 0.031597573310136795, + 0.0, + 1.2490438930690289, + 0.17753384448587894, + 0.699918769299984, + 0.03996574506163597, + 3.654671970754862, + 0.5842741802334785, + 0.5273598469793797, + 0.5684244651347399, + 0.0, + 0.2661625798791647, + 0.40159315802156925, + 0.0, + 0.053822388872504234, + 0.2056343611329794, + 0.04241156578063965, + 0.24533584527671337, + 0.24612008407711983, + 0.04351095110177994, + 0.043791379779577255, + 0.16503145545721054, + 0.0, + 0.0775860995054245, + 0.43017637357115746, + 0.0, + 0.0, + 0.29654669016599655, + 0.39162299782037735, + 0.2104744054377079, + 0.1748073473572731, + 0.0829952247440815, + 1.8778637200593948, + 0.16198598966002464, + 0.09593293815851212, + 0.04710209369659424, + 0.1318887174129486, + 0.0, + 0.0, + 1.4512953869998455, + 0.17690659314393997, + 0.04271876439452171, + 0.05225691199302673 + ], + "unique_experts": 50, + "load_cv": 1.3738900845762887, + "normalized_load_entropy": 0.826106253492977, + "max_load_share": 0.11858974358974358 + }, + "full_input": { + "tokens": 77, + "top_k": 6, + "decisions": 462, + "ordered_route_sha256": "d0e1b66fcc068ad3e5c78f86604e06ff720cc7f909e6c91b6029ee6519525219", + "route_weight_sha256": "931523e0d832e7318d2105a0e6a0043a87aa595d23342594742053bcd141881d", + "loads": [ + 0, + 0, + 5, + 1, + 1, + 4, + 21, + 7, + 27, + 2, + 20, + 0, + 3, + 3, + 4, + 2, + 1, + 0, + 2, + 2, + 7, + 1, + 6, + 15, + 14, + 14, + 1, + 38, + 23, + 15, + 11, + 4, + 6, + 11, + 7, + 3, + 6, + 3, + 8, + 7, + 1, + 3, + 9, + 0, + 2, + 14, + 0, + 5, + 4, + 6, + 11, + 8, + 6, + 17, + 3, + 2, + 1, + 4, + 7, + 0, + 25, + 21, + 4, + 4 + ], + "weighted_loads": [ + 0.0, + 0.0, + 0.1646935436874628, + 0.039064276963472366, + 0.03687044233083725, + 0.12403003522194922, + 1.6378709748387337, + 0.2701560687273741, + 3.5190495271235704, + 0.11419842392206192, + 1.7529131146147847, + 0.0, + 0.22397374641150236, + 0.13558896631002426, + 0.1407984420657158, + 0.1087966039776802, + 0.03918454423546791, + 0.0, + 0.09255148842930794, + 0.08314673975110054, + 0.3788912035524845, + 0.031597573310136795, + 0.4512234292924404, + 1.2490438930690289, + 0.510598313761875, + 0.699918769299984, + 0.03996574506163597, + 3.6972158662974834, + 0.9622401595115662, + 0.7710685543715954, + 0.5684244651347399, + 0.12681719101965427, + 0.29488310404121876, + 0.5875957924872637, + 0.22359794890508056, + 0.10016568191349506, + 0.30200344137847424, + 0.9331678412854671, + 0.284950977191329, + 0.29129863157868385, + 0.04351095110177994, + 0.14678096398711205, + 0.3119397140108049, + 0.0, + 0.0775860995054245, + 0.5314080603420734, + 0.0, + 0.4072219521040097, + 0.29654669016599655, + 0.39162299782037735, + 0.4682021252810955, + 0.6277057193219662, + 0.16776238195598125, + 2.0152120403945446, + 0.16198598966002464, + 0.09593293815851212, + 0.04710209369659424, + 0.18560056760907173, + 0.2182185456622392, + 0.0, + 1.5671290047466755, + 1.4711716533638537, + 0.0823203343898058, + 2.0378300435841084 + ], + "unique_experts": 57, + "load_cv": 1.0737239830814207, + "normalized_load_entropy": 0.8794381894290645, + "max_load_share": 0.08225108225108226 + } + }, + "s1_eos": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "3dc76abd84620ebf05b3bb30770c08e49062f054dfe611a5e5a4f4b2b856bf1d", + "route_weight_sha256": "ce828ffb0091dbfc683214d9a0bef4163ba57a3bd36b4baf71a859b232163e71", + "loads": [ + 0, + 0, + 4, + 2, + 0, + 0, + 21, + 5, + 19, + 2, + 11, + 0, + 2, + 3, + 2, + 2, + 0, + 0, + 2, + 2, + 8, + 0, + 0, + 13, + 4, + 13, + 2, + 37, + 14, + 9, + 12, + 0, + 5, + 7, + 0, + 2, + 5, + 1, + 7, + 6, + 1, + 1, + 4, + 0, + 2, + 12, + 0, + 1, + 4, + 6, + 6, + 2, + 1, + 14, + 3, + 2, + 1, + 4, + 0, + 0, + 22, + 2, + 1, + 1 + ], + "weighted_loads": [ + 0.0, + 0.0, + 0.12077202275395393, + 0.07440618798136711, + 0.0, + 0.0, + 1.6482972409576178, + 0.1721153873950243, + 3.1081960313022137, + 0.11526406556367874, + 1.4073822721838951, + 0.0, + 0.22330757975578308, + 0.12744328752160072, + 0.10295598581433296, + 0.1100468747317791, + 0.0, + 0.0, + 0.09116604179143906, + 0.08643410727381706, + 0.39683868549764156, + 0.0, + 0.0, + 1.2065036557614803, + 0.13799315504729748, + 0.6384600754827261, + 0.062310608103871346, + 3.621879853308201, + 0.6314128693193197, + 0.5062660500407219, + 0.6290521118789911, + 0.0, + 0.27434354461729527, + 0.4038284756243229, + 0.0, + 0.05441846698522568, + 0.20175467431545258, + 0.04257722198963165, + 0.25316842645406723, + 0.24134817719459534, + 0.05049913749098778, + 0.04569200426340103, + 0.17079271003603935, + 0.0, + 0.08641146123409271, + 0.4174049384891987, + 0.0, + 0.03503112494945526, + 0.2881249524652958, + 0.39172449335455894, + 0.22048635501414537, + 0.1733846366405487, + 0.028154412284493446, + 1.8254734613001347, + 0.16123737394809723, + 0.09934494644403458, + 0.04490530863404274, + 0.16725506633520126, + 0.0, + 0.0, + 1.43971161916852, + 0.07965517789125443, + 0.04269513487815857, + 0.04874124005436897 + ], + "unique_experts": 49, + "load_cv": 1.3705362066556683, + "normalized_load_entropy": 0.825656196495162, + "max_load_share": 0.11858974358974358 + }, + "full_input": { + "tokens": 93, + "top_k": 6, + "decisions": 558, + "ordered_route_sha256": "6f7826b26fc3b6779397b1bcbd41ecf753a5d1d97d0925b4412b553fdc467c17", + "route_weight_sha256": "4b14e0fb8c87e6f2aa324ddfe53f85fe7ed6afe2993b89ed13523ff518dd55f3", + "loads": [ + 0, + 0, + 5, + 3, + 2, + 8, + 21, + 7, + 28, + 5, + 19, + 2, + 5, + 3, + 5, + 2, + 0, + 0, + 3, + 4, + 13, + 0, + 11, + 14, + 13, + 14, + 2, + 39, + 36, + 14, + 12, + 3, + 6, + 13, + 6, + 4, + 12, + 4, + 8, + 7, + 2, + 9, + 11, + 2, + 4, + 13, + 0, + 9, + 4, + 6, + 11, + 16, + 7, + 18, + 6, + 4, + 2, + 6, + 13, + 0, + 26, + 22, + 8, + 6 + ], + "weighted_loads": [ + 0.0, + 0.0, + 0.14545723982155323, + 0.18603450432419777, + 0.0592779666185379, + 0.24006627895869315, + 1.6482972409576178, + 0.2582832109183073, + 3.7018275763839483, + 0.24555610492825508, + 1.7354336669668555, + 0.06580213457345963, + 0.2831000913865864, + 0.12744328752160072, + 0.20607237331569195, + 0.1100468747317791, + 0.0, + 0.0, + 0.12302685156464577, + 0.1435160394757986, + 0.6201978418976068, + 0.0, + 0.7280341573059559, + 1.232391195371747, + 0.46879223617725074, + 0.6664401423186064, + 0.062310608103871346, + 3.7019053772091866, + 1.7041470799595118, + 0.7375266291201115, + 0.6290521118789911, + 0.13971532881259918, + 0.3011748269200325, + 0.7028588578104973, + 0.21619041310623288, + 0.1526929773390293, + 0.7105981633067131, + 0.976621687412262, + 0.30208995565772057, + 0.28980719670653343, + 0.16396288201212883, + 0.4975365027785301, + 0.3749700663611293, + 0.21266700327396393, + 0.1799325905740261, + 0.4779238924384117, + 0.0, + 0.6517942543141544, + 0.2881249524652958, + 0.39172449335455894, + 0.4430726105347276, + 1.1845207326114178, + 0.20341758988797665, + 2.1101452708244324, + 0.3672098461538553, + 0.19889065623283386, + 0.07380681112408638, + 0.2574043720960617, + 0.5392727602738887, + 0.0, + 1.5719046797603369, + 2.02811772050336, + 0.38627657562028617, + 2.11926881223917 + ], + "unique_experts": 57, + "load_cv": 0.9443815313018192, + "normalized_load_entropy": 0.9029005984153607, + "max_load_share": 0.06989247311827956 + } + }, + "s0_bos": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "65d3679d072fe43847739fc2c1ef23c83971429b7941affd0dc39f2c44e94920", + "route_weight_sha256": "c402a7fa82142c47ed789041f6018b19de23df042a2c9b6cdcedbc1a8852121d", + "loads": [ + 1, + 0, + 4, + 1, + 1, + 1, + 19, + 5, + 19, + 2, + 11, + 0, + 3, + 3, + 2, + 2, + 0, + 1, + 2, + 2, + 8, + 1, + 0, + 15, + 3, + 13, + 3, + 37, + 12, + 9, + 10, + 0, + 5, + 7, + 0, + 2, + 5, + 1, + 6, + 5, + 1, + 1, + 5, + 0, + 2, + 12, + 0, + 0, + 3, + 6, + 4, + 2, + 3, + 14, + 3, + 2, + 1, + 3, + 2, + 0, + 21, + 3, + 1, + 2 + ], + "weighted_loads": [ + 0.027695229277014732, + 0.0, + 0.11867670342326164, + 0.04030183330178261, + 0.0456315316259861, + 0.024661988019943237, + 1.5929487626999617, + 0.16397851333022118, + 3.1723023019731045, + 0.11710616201162338, + 1.5124171003699303, + 0.0, + 0.25934433192014694, + 0.1334831640124321, + 0.10276560857892036, + 0.10674026980996132, + 0.0, + 0.04103359580039978, + 0.09798204526305199, + 0.08476723358035088, + 0.39402857795357704, + 0.0330798365175724, + 0.0, + 1.2535186763852835, + 0.11406005918979645, + 0.6446677148342133, + 0.0981315616518259, + 3.688684806227684, + 0.560291925445199, + 0.52513512596488, + 0.6103946268558502, + 0.0, + 0.2773136477917433, + 0.4115165825933218, + 0.0, + 0.05888429842889309, + 0.20460537262260914, + 0.04325076937675476, + 0.21163593977689743, + 0.22002321109175682, + 0.0478813536465168, + 0.0543983168900013, + 0.19992981292307377, + 0.0, + 0.07619654759764671, + 0.4292141739279032, + 0.0, + 0.0, + 0.2527683824300766, + 0.3961628619581461, + 0.14127428270876408, + 0.15320731699466705, + 0.08084656670689583, + 1.8705708868801594, + 0.16460074484348297, + 0.1040373370051384, + 0.0445273295044899, + 0.13677417859435081, + 0.07102794013917446, + 0.0, + 1.4317732136696577, + 0.10843974351882935, + 0.044778771698474884, + 0.07304458133876324 + ], + "unique_experts": 54, + "load_cv": 1.3246760362143066, + "normalized_load_entropy": 0.8436266474625465, + "max_load_share": 0.11858974358974358 + }, + "full_input": { + "tokens": 77, + "top_k": 6, + "decisions": 462, + "ordered_route_sha256": "93ce443b4acd9819f8587b816fb5fe69c251236863d73b88872591f8f6956763", + "route_weight_sha256": "179eaf51abefbf3476d84f927215dc1f8cf805a3efc5da278c76862eb00f038c", + "loads": [ + 1, + 0, + 7, + 1, + 1, + 4, + 20, + 6, + 26, + 2, + 19, + 0, + 4, + 3, + 5, + 2, + 0, + 1, + 2, + 3, + 8, + 1, + 7, + 15, + 11, + 13, + 4, + 39, + 22, + 15, + 11, + 5, + 6, + 11, + 7, + 2, + 6, + 3, + 6, + 6, + 1, + 2, + 11, + 0, + 2, + 14, + 1, + 4, + 3, + 6, + 11, + 8, + 6, + 17, + 3, + 2, + 1, + 4, + 9, + 0, + 24, + 21, + 3, + 4 + ], + "weighted_loads": [ + 0.027695229277014732, + 0.0, + 0.21152869053184986, + 0.04030183330178261, + 0.0456315316259861, + 0.11673945584334433, + 1.6605930980294943, + 0.22016410157084465, + 3.52178268507123, + 0.11710616201162338, + 1.8284415155649185, + 0.0, + 0.2620770214125514, + 0.1334831640124321, + 0.19862321764230728, + 0.10674026980996132, + 0.0, + 0.04103359580039978, + 0.09798204526305199, + 0.12643669545650482, + 0.39402857795357704, + 0.0330798365175724, + 0.5793389678001404, + 1.2535186763852835, + 0.41867496515624225, + 0.6446677148342133, + 0.5417379681020975, + 3.7607935406267643, + 0.9467324297875166, + 0.7829944491386414, + 0.6517011895775795, + 0.15089857950806618, + 0.30603417195379734, + 0.5975192170590162, + 0.20184893859550357, + 0.05888429842889309, + 0.300974452868104, + 0.9342868681997061, + 0.21163593977689743, + 0.26371101662516594, + 0.0478813536465168, + 0.11514629051089287, + 0.4502108204178512, + 0.0, + 0.07619654759764671, + 0.5454367231577635, + 0.058795712888240814, + 0.37269824906252325, + 0.2527683824300766, + 0.3961628619581461, + 0.4639797229319811, + 0.5810603424906731, + 0.16561372391879559, + 2.007919207215309, + 0.16460074484348297, + 0.1040373370051384, + 0.0445273295044899, + 0.18217963352799416, + 0.32239782996475697, + 0.0, + 1.541614020243287, + 1.4647009880281985, + 0.09365501289721578, + 1.0891330260783434 + ], + "unique_experts": 59, + "load_cv": 1.0500044396518255, + "normalized_load_entropy": 0.8865294631892238, + "max_load_share": 0.08441558441558442 + } + }, + "s1_bos": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "bacb481cd30176c1d0d0bc7cda0c143177b736540d05260640425d7bebfeed14", + "route_weight_sha256": "b0271805792442856843d1308a5e10a5eda371e13cd7414e215ffcd0d97db401", + "loads": [ + 1, + 1, + 3, + 1, + 1, + 0, + 21, + 6, + 19, + 2, + 11, + 0, + 3, + 3, + 2, + 2, + 0, + 0, + 2, + 2, + 7, + 0, + 0, + 13, + 3, + 12, + 3, + 37, + 13, + 9, + 10, + 0, + 5, + 8, + 0, + 2, + 5, + 1, + 5, + 5, + 1, + 1, + 6, + 0, + 4, + 11, + 0, + 0, + 4, + 6, + 4, + 2, + 3, + 14, + 3, + 2, + 1, + 4, + 1, + 1, + 21, + 2, + 1, + 2 + ], + "weighted_loads": [ + 0.027370303869247437, + 0.023393502458930016, + 0.0954939741641283, + 0.04157301411032677, + 0.042853448539972305, + 0.0, + 1.612881874665618, + 0.1928066462278366, + 3.141496606171131, + 0.12268542498350143, + 1.5588033571839333, + 0.0, + 0.2653625588864088, + 0.1320011503994465, + 0.11697028949856758, + 0.10963532701134682, + 0.0, + 0.0, + 0.09835707396268845, + 0.08427925407886505, + 0.3638418950140476, + 0.0, + 0.0, + 1.2099079824984074, + 0.10546176135540009, + 0.6120874565094709, + 0.10495759546756744, + 3.651787208393216, + 0.6034247390925884, + 0.5093720369040966, + 0.6015525404363871, + 0.0, + 0.2878500930964947, + 0.43266148306429386, + 0.0, + 0.05799475312232971, + 0.20636522583663464, + 0.04425351321697235, + 0.18086886778473854, + 0.21242216974496841, + 0.05498519167304039, + 0.0558074526488781, + 0.2473459579050541, + 0.0, + 0.1694556586444378, + 0.39527364633977413, + 0.0, + 0.0, + 0.2815020866692066, + 0.39574291929602623, + 0.1298013674095273, + 0.1487830951809883, + 0.08032502233982086, + 1.8530681021511555, + 0.17007232084870338, + 0.10406477749347687, + 0.04236766695976257, + 0.14470814168453217, + 0.04004964604973793, + 0.02710280939936638, + 1.4442051500082016, + 0.07689721882343292, + 0.04755398631095886, + 0.0756852924823761 + ], + "unique_experts": 53, + "load_cv": 1.3301243435223524, + "normalized_load_entropy": 0.8412468622881064, + "max_load_share": 0.11858974358974358 + }, + "full_input": { + "tokens": 93, + "top_k": 6, + "decisions": 558, + "ordered_route_sha256": "868b21aae1dbb3d81e345facb38ab33447312e8c8b6284d40ee2bdc9ca20f820", + "route_weight_sha256": "2ac08c8ace8666a962e66d6a6220ef94ddf74ed0283000701e500d995d33fa6a", + "loads": [ + 1, + 1, + 6, + 2, + 3, + 8, + 21, + 7, + 27, + 5, + 18, + 2, + 6, + 3, + 4, + 2, + 0, + 0, + 3, + 6, + 12, + 0, + 11, + 14, + 12, + 13, + 3, + 39, + 35, + 14, + 10, + 5, + 6, + 14, + 6, + 4, + 12, + 3, + 6, + 6, + 2, + 9, + 13, + 3, + 5, + 13, + 0, + 7, + 4, + 6, + 11, + 16, + 9, + 18, + 6, + 4, + 1, + 5, + 14, + 1, + 25, + 23, + 8, + 5 + ], + "weighted_loads": [ + 0.027370303869247437, + 0.023393502458930016, + 0.1863555684685707, + 0.15320133045315742, + 0.10213141515851021, + 0.24898224347271025, + 1.612881874665618, + 0.23253237083554268, + 3.7307670265436172, + 0.2529774643480778, + 1.873761422932148, + 0.06580213457345963, + 0.32515507051721215, + 0.1320011503994465, + 0.1778376754373312, + 0.10963532701134682, + 0.0, + 0.0, + 0.13021788373589516, + 0.2015946079045534, + 0.5872010514140129, + 0.0, + 0.8027423396706581, + 1.235795522108674, + 0.43626084248535335, + 0.6400675233453512, + 0.10495759546756744, + 3.7306441999971867, + 1.6854525431990623, + 0.765531774610281, + 0.6015525404363871, + 0.20851989462971687, + 0.3162776157259941, + 0.7316918652504683, + 0.21021235035732388, + 0.15626926347613335, + 0.7152087148278952, + 0.9510809071362019, + 0.22385402023792267, + 0.2584824524819851, + 0.16844893619418144, + 0.5196303427219391, + 0.5713677713647485, + 0.2852603495121002, + 0.20860224962234497, + 0.4985726121813059, + 0.0, + 0.6167125420179218, + 0.2815020866692066, + 0.39574291929602623, + 0.4934289092198014, + 1.1211922019720078, + 0.25558819994330406, + 2.137739911675453, + 0.3760447930544615, + 0.20361048728227615, + 0.04236766695976257, + 0.20717890188097954, + 0.609744256362319, + 0.02710280939936638, + 1.5895861592143774, + 2.0530945626087487, + 0.4310994002735242, + 1.1308836862444878 + ], + "unique_experts": 60, + "load_cv": 0.9234730681919769, + "normalized_load_entropy": 0.9092850266018982, + "max_load_share": 0.06989247311827956 + } + }, + "s0_x": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "4419fc96a8e1aa81d28f15b932c7497e9d571ba5681ae013da6d9eb9397af7d8", + "route_weight_sha256": "0d7aafc15f773d39b3bf12a13b0aa9c782b79f4098feb424f709f21dcfc4f4f2", + "loads": [ + 0, + 0, + 3, + 1, + 1, + 1, + 20, + 5, + 19, + 2, + 11, + 0, + 3, + 3, + 2, + 2, + 0, + 2, + 1, + 2, + 9, + 0, + 0, + 14, + 6, + 13, + 3, + 37, + 12, + 9, + 10, + 0, + 5, + 7, + 0, + 2, + 5, + 1, + 5, + 5, + 1, + 1, + 4, + 0, + 2, + 12, + 0, + 0, + 3, + 6, + 4, + 2, + 1, + 15, + 3, + 2, + 1, + 4, + 2, + 0, + 22, + 3, + 1, + 2 + ], + "weighted_loads": [ + 0.0, + 0.0, + 0.08926589228212833, + 0.04173559322953224, + 0.04083343595266342, + 0.025515684857964516, + 1.5848748609423637, + 0.17316873744130135, + 3.1668970733880997, + 0.11680451780557632, + 1.4754584729671478, + 0.0, + 0.26089621149003506, + 0.13328801468014717, + 0.09772733971476555, + 0.11041475459933281, + 0.0, + 0.07201908715069294, + 0.06096094101667404, + 0.08838563784956932, + 0.438210092484951, + 0.0, + 0.0, + 1.2095305435359478, + 0.21761351078748703, + 0.6426483020186424, + 0.10281671769917011, + 3.658340295776725, + 0.5752625465393066, + 0.5085724666714668, + 0.5843455083668232, + 0.0, + 0.2719719223678112, + 0.4193775840103626, + 0.0, + 0.05613509751856327, + 0.20332025736570358, + 0.04356028139591217, + 0.180874764919281, + 0.206256952136755, + 0.04523333162069321, + 0.04967394471168518, + 0.16769757494330406, + 0.0, + 0.07994810491800308, + 0.44699569791555405, + 0.0, + 0.0, + 0.2537601515650749, + 0.3954524714499712, + 0.14825455844402313, + 0.1735573709011078, + 0.02692461758852005, + 1.8793877828866243, + 0.1644924208521843, + 0.10019969940185547, + 0.04845554754137993, + 0.1581713855266571, + 0.06963067129254341, + 0.0, + 1.445931438356638, + 0.10888488218188286, + 0.042098309844732285, + 0.079798623919487 + ], + "unique_experts": 52, + "load_cv": 1.3482889051420417, + "normalized_load_entropy": 0.8358187848115638, + "max_load_share": 0.11858974358974358 + }, + "full_input": { + "tokens": 77, + "top_k": 6, + "decisions": 462, + "ordered_route_sha256": "cab7ea408f83e3b154b22a41ffc63a978172fd1252330e778c104c172fff30b4", + "route_weight_sha256": "25a7cf322bd4281ab0b338477e4edfd67f34281179a004749426dc69f471043d", + "loads": [ + 0, + 0, + 5, + 1, + 1, + 6, + 20, + 8, + 27, + 2, + 20, + 0, + 5, + 3, + 5, + 2, + 0, + 3, + 1, + 2, + 9, + 0, + 6, + 14, + 15, + 14, + 3, + 38, + 21, + 15, + 10, + 2, + 7, + 11, + 8, + 3, + 7, + 3, + 6, + 6, + 1, + 3, + 8, + 0, + 2, + 13, + 0, + 5, + 3, + 6, + 10, + 8, + 4, + 19, + 3, + 2, + 1, + 4, + 9, + 0, + 25, + 20, + 3, + 4 + ], + "weighted_loads": [ + 0.0, + 0.0, + 0.15590032376348972, + 0.04173559322953224, + 0.04083343595266342, + 0.17938714870251715, + 1.5848748609423637, + 0.3014642335474491, + 3.597900338470936, + 0.11680451780557632, + 1.8447474464774132, + 0.0, + 0.29915349651128054, + 0.13328801468014717, + 0.19518093392252922, + 0.11041475459933281, + 0.0, + 0.10047389566898346, + 0.06096094101667404, + 0.08838563784956932, + 0.438210092484951, + 0.0, + 0.42220294661819935, + 1.2095305435359478, + 0.5500160555820912, + 0.6788153015077114, + 0.10281671769917011, + 3.7005925830453634, + 0.9346456117928028, + 0.7617103345692158, + 0.5843455083668232, + 0.06215035729110241, + 0.32706866785883904, + 0.605380218476057, + 0.25136823346838355, + 0.09364846162497997, + 0.3419976532459259, + 0.9359599892050028, + 0.21759265288710594, + 0.2490134797990322, + 0.04523333162069321, + 0.15182697772979736, + 0.2751114214770496, + 0.0, + 0.07994810491800308, + 0.5038667619228363, + 0.0, + 0.4776778758969158, + 0.2537601515650749, + 0.3954524714499712, + 0.40256012976169586, + 0.6392448022961617, + 0.11169177480041981, + 2.065496923401952, + 0.1644924208521843, + 0.10019969940185547, + 0.04845554754137993, + 0.1581713855266571, + 0.3180292956531048, + 0.0, + 1.5593812614679337, + 1.4004797362722456, + 0.08631747623439878, + 1.0958870686590672 + ], + "unique_experts": 56, + "load_cv": 1.0605177098990386, + "normalized_load_entropy": 0.8808765313475742, + "max_load_share": 0.08225108225108226 + } + }, + "s1_x": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "6ccf4ec33d5e9a492938635f4703cb43b193ac0be7323c92ba85b3c3eef6b68b", + "route_weight_sha256": "9429b18a7731ef47591cfa282b92cd8c98161bef4eda6f963777a33676b4e1bd", + "loads": [ + 0, + 0, + 3, + 1, + 0, + 0, + 19, + 6, + 19, + 2, + 11, + 0, + 3, + 2, + 2, + 2, + 0, + 0, + 2, + 2, + 10, + 0, + 0, + 13, + 5, + 12, + 2, + 35, + 19, + 8, + 10, + 1, + 5, + 8, + 0, + 1, + 6, + 1, + 5, + 5, + 1, + 1, + 6, + 0, + 3, + 10, + 0, + 1, + 3, + 5, + 5, + 2, + 3, + 14, + 3, + 2, + 1, + 4, + 0, + 0, + 22, + 3, + 1, + 2 + ], + "weighted_loads": [ + 0.0, + 0.0, + 0.08879491314291954, + 0.043398551642894745, + 0.0, + 0.0, + 1.533581418916583, + 0.19263937510550022, + 3.1298522651195526, + 0.12167144566774368, + 1.6123798005282879, + 0.0, + 0.2606563698500395, + 0.08980938792228699, + 0.10520638898015022, + 0.11587893217802048, + 0.0, + 0.0, + 0.08687159419059753, + 0.08391010016202927, + 0.5316461473703384, + 0.0, + 0.0, + 1.221573069691658, + 0.18029921874403954, + 0.5796861965209246, + 0.07311312854290009, + 3.5491101425141096, + 0.8361297231167555, + 0.44547000899910927, + 0.5957970358431339, + 0.028749700635671616, + 0.297338392585516, + 0.4409898463636637, + 0.0, + 0.024291876703500748, + 0.235106548294425, + 0.04494267329573631, + 0.17572661116719246, + 0.20237522944808006, + 0.05536971613764763, + 0.05874129384756088, + 0.23724822513759136, + 0.0, + 0.13097291067242622, + 0.36427975073456764, + 0.0, + 0.036428410559892654, + 0.24586574733257294, + 0.36115332692861557, + 0.15407441277056932, + 0.18097489327192307, + 0.08052749000489712, + 1.7993436455726624, + 0.16609235107898712, + 0.09577064961194992, + 0.04548145830631256, + 0.1555247027426958, + 0.0, + 0.0, + 1.4499599561095238, + 0.10079457983374596, + 0.04402744770050049, + 0.07911444082856178 + ], + "unique_experts": 50, + "load_cv": 1.3360426123192848, + "normalized_load_entropy": 0.8320886840469932, + "max_load_share": 0.11217948717948718 + }, + "full_input": { + "tokens": 93, + "top_k": 6, + "decisions": 558, + "ordered_route_sha256": "9926137ed9fb93f9e85659f656731d7535724c0ac64ed291ee5c7a8f8f458219", + "route_weight_sha256": "7f554d38408ee8f9018b9ba86ea413e820d7535d60483258eb4b7f166e12aee4", + "loads": [ + 0, + 0, + 4, + 2, + 2, + 9, + 20, + 7, + 29, + 5, + 18, + 2, + 6, + 2, + 5, + 2, + 0, + 0, + 3, + 4, + 17, + 0, + 11, + 14, + 14, + 13, + 2, + 37, + 41, + 13, + 10, + 4, + 6, + 15, + 6, + 4, + 15, + 4, + 5, + 6, + 2, + 8, + 12, + 2, + 4, + 11, + 0, + 8, + 3, + 5, + 9, + 16, + 9, + 19, + 6, + 4, + 2, + 4, + 13, + 0, + 26, + 24, + 8, + 6 + ], + "weighted_loads": [ + 0.0, + 0.0, + 0.11348013021051884, + 0.1550268679857254, + 0.0592779666185379, + 0.2712648215238005, + 1.5628210604190826, + 0.2323650997132063, + 3.800254948437214, + 0.25196348503232, + 1.9273378662765026, + 0.06580213457345963, + 0.32044888148084283, + 0.08980938792228699, + 0.20738682337105274, + 0.11587893217802048, + 0.0, + 0.0, + 0.11873240396380424, + 0.1409920323640108, + 0.8271378353238106, + 0.0, + 0.6635207403451204, + 1.2474606093019247, + 0.5110982998739928, + 0.6076662633568048, + 0.07311312854290009, + 3.6272661071270704, + 1.9020242113620043, + 0.6848960854113102, + 0.5957970358431339, + 0.1684650294482708, + 0.33040256053209305, + 0.7797756101936102, + 0.1818135459907353, + 0.1681601144373417, + 0.8666533511132002, + 0.9850000292062759, + 0.17572661116719246, + 0.2518942691385746, + 0.16883346065878868, + 0.46757301315665245, + 0.4193747015669942, + 0.21266700327396393, + 0.1701195016503334, + 0.42479870468378067, + 0.0, + 0.7368152344133705, + 0.24586574733257294, + 0.36115332692861557, + 0.32344855833798647, + 1.1645451299846172, + 0.2557906676083803, + 2.1173260509967804, + 0.3720648232847452, + 0.1953163594007492, + 0.07503103278577328, + 0.1555247027426958, + 0.5841150246560574, + 0.0, + 1.5983673315495253, + 1.9957130518741906, + 0.457827728590928, + 1.188316397368908 + ], + "unique_experts": 57, + "load_cv": 0.9854936315731835, + "normalized_load_entropy": 0.8964459447648463, + "max_load_share": 0.07347670250896057 + } + }, + "s0_period": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "18fb28bc5efc3feffc834337c595b5fc5fefeae37071f6b6143c3cefcfe2e10b", + "route_weight_sha256": "0606c22ffb9affcebf7946ca05c277d823ae154e865937cc10814f42e0853f74", + "loads": [ + 1, + 0, + 3, + 1, + 1, + 0, + 19, + 5, + 19, + 2, + 11, + 0, + 4, + 2, + 2, + 2, + 0, + 1, + 1, + 2, + 8, + 1, + 0, + 14, + 4, + 13, + 1, + 37, + 14, + 9, + 10, + 0, + 5, + 7, + 0, + 3, + 5, + 1, + 5, + 5, + 1, + 1, + 5, + 0, + 2, + 13, + 0, + 0, + 4, + 6, + 4, + 2, + 2, + 15, + 3, + 2, + 1, + 3, + 2, + 0, + 22, + 3, + 1, + 2 + ], + "weighted_loads": [ + 0.02777060493826866, + 0.0, + 0.09143559075891972, + 0.04023308679461479, + 0.03808211907744408, + 0.0, + 1.569967219606042, + 0.1713168378919363, + 3.1533422246575356, + 0.11667515709996223, + 1.5998560041189194, + 0.0, + 0.29053747467696667, + 0.09172578901052475, + 0.09614282473921776, + 0.11154571920633316, + 0.0, + 0.042410921305418015, + 0.06242363527417183, + 0.0865047350525856, + 0.40630764700472355, + 0.03438420966267586, + 0.0, + 1.2335677668452263, + 0.13356085866689682, + 0.6770485397428274, + 0.03966567665338516, + 3.7007025741040707, + 0.66627780161798, + 0.5037417709827423, + 0.5993468686938286, + 0.0, + 0.2718059867620468, + 0.43566962517797947, + 0.0, + 0.0867652278393507, + 0.1966709941625595, + 0.04337141662836075, + 0.17930409871041775, + 0.20680451393127441, + 0.045115042477846146, + 0.051130782812833786, + 0.19488939084112644, + 0.0, + 0.09290465340018272, + 0.47537964954972267, + 0.0, + 0.0, + 0.28172575682401657, + 0.3993253894150257, + 0.1281766016036272, + 0.16367430239915848, + 0.055101603269577026, + 1.8816987685859203, + 0.16251318529248238, + 0.10262833535671234, + 0.046956617385149, + 0.13486765697598457, + 0.07188144139945507, + 0.0, + 1.4849449824541807, + 0.11626291275024414, + 0.03962196782231331, + 0.07590421475470066 + ], + "unique_experts": 53, + "load_cv": 1.3507248401093255, + "normalized_load_entropy": 0.8359777530071749, + "max_load_share": 0.11858974358974358 + }, + "full_input": { + "tokens": 77, + "top_k": 6, + "decisions": 462, + "ordered_route_sha256": "1c69a527e9e6193e4ab376d95b1b14b284019ce1c1e93cf616ec54cc9411b99f", + "route_weight_sha256": "1c8fa7cc6f1636a5e7c7c692cec78b96be302c49b3ed9de317fd6ea4205542b4", + "loads": [ + 1, + 0, + 5, + 1, + 1, + 5, + 19, + 7, + 26, + 2, + 19, + 0, + 5, + 2, + 5, + 2, + 0, + 2, + 1, + 2, + 8, + 1, + 6, + 14, + 12, + 13, + 1, + 38, + 24, + 15, + 10, + 3, + 6, + 12, + 7, + 3, + 6, + 4, + 5, + 6, + 1, + 4, + 10, + 1, + 2, + 14, + 0, + 5, + 4, + 6, + 11, + 10, + 5, + 18, + 3, + 2, + 2, + 4, + 8, + 0, + 24, + 21, + 4, + 4 + ], + "weighted_loads": [ + 0.02777060493826866, + 0.0, + 0.1580700222402811, + 0.04023308679461479, + 0.03808211907744408, + 0.16365075507201254, + 1.569967219606042, + 0.26796056516468525, + 3.502822607755661, + 0.11667515709996223, + 1.9158804193139076, + 0.0, + 0.29327016416937113, + 0.09172578901052475, + 0.19350304082036018, + 0.11154571920633316, + 0.0, + 0.07067842409014702, + 0.06242363527417183, + 0.0865047350525856, + 0.40630764700472355, + 0.03438420966267586, + 0.42623176611959934, + 1.2335677668452263, + 0.4381757646333426, + 0.6770485397428274, + 0.03966567665338516, + 3.739954572170973, + 1.057209910824895, + 0.7615853399038315, + 0.5993468686938286, + 0.0930539183318615, + 0.3005265109241009, + 0.6574119757860899, + 0.22172892605885863, + 0.0867652278393507, + 0.29304007440805435, + 0.9650231320410967, + 0.17930409871041775, + 0.25349826365709305, + 0.045115042477846146, + 0.2158854454755783, + 0.33229871233925223, + 0.03738779574632645, + 0.09290465340018272, + 0.5322507135570049, + 0.0, + 0.4367464759852737, + 0.28172575682401657, + 0.3993253894150257, + 0.4566114488989115, + 0.7384794615209103, + 0.13986876048147678, + 2.01904708892107, + 0.16251318529248238, + 0.10262833535671234, + 0.07699861191213131, + 0.17880987748503685, + 0.28930594585835934, + 0.0, + 1.5585755612701178, + 1.5173522331751883, + 0.11788296361919492, + 1.0919926594942808 + ], + "unique_experts": 59, + "load_cv": 1.0480035786718018, + "normalized_load_entropy": 0.8865905209189768, + "max_load_share": 0.08225108225108226 + } + }, + "s1_period": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "bee54ee5d049cdaea8269bad22fa0b6956aaee7cc43201cb1074e473110db6b7", + "route_weight_sha256": "25bbd242722a45f9b0369e4f5e4cfdb1134eade507a6dd6b7ac26594094a8c50", + "loads": [ + 0, + 0, + 1, + 1, + 0, + 0, + 19, + 6, + 19, + 2, + 11, + 0, + 3, + 2, + 2, + 2, + 0, + 0, + 1, + 2, + 11, + 1, + 0, + 13, + 4, + 12, + 3, + 36, + 20, + 8, + 9, + 1, + 5, + 8, + 0, + 1, + 6, + 1, + 6, + 5, + 1, + 1, + 6, + 0, + 4, + 8, + 0, + 1, + 3, + 5, + 5, + 3, + 3, + 14, + 3, + 2, + 1, + 4, + 1, + 0, + 21, + 2, + 1, + 2 + ], + "weighted_loads": [ + 0.0, + 0.0, + 0.03518751263618469, + 0.04558076709508896, + 0.0, + 0.0, + 1.5122182499617338, + 0.19488001614809036, + 3.137379679828882, + 0.12272701412439346, + 1.5784168094396591, + 0.0, + 0.25210093706846237, + 0.09068101644515991, + 0.10662323236465454, + 0.11958162114024162, + 0.0, + 0.0, + 0.05474983900785446, + 0.08301904425024986, + 0.555806927382946, + 0.03051122836768627, + 0.0, + 1.2330573163926601, + 0.13396833464503288, + 0.5851885415613651, + 0.10347556509077549, + 3.530952462926507, + 0.9221199676394463, + 0.4472999721765518, + 0.5446059629321098, + 0.029769256711006165, + 0.29402438178658485, + 0.44224583357572556, + 0.0, + 0.024988101795315742, + 0.23236451856791973, + 0.04627593234181404, + 0.2061377502977848, + 0.2062889225780964, + 0.052989933639764786, + 0.058413729071617126, + 0.2393652107566595, + 0.0, + 0.17309195548295975, + 0.3009182717651129, + 0.0, + 0.034482017159461975, + 0.24215636402368546, + 0.36872000992298126, + 0.16039766557514668, + 0.22615430876612663, + 0.07841710187494755, + 1.8258445672690868, + 0.17173827812075615, + 0.10014086961746216, + 0.04142512381076813, + 0.14949060045182705, + 0.028379978612065315, + 0.0, + 1.4043388813734055, + 0.07209195755422115, + 0.04382888227701187, + 0.08379396051168442 + ], + "unique_experts": 52, + "load_cv": 1.3453599612661442, + "normalized_load_entropy": 0.8337380748620775, + "max_load_share": 0.11538461538461539 + }, + "full_input": { + "tokens": 93, + "top_k": 6, + "decisions": 558, + "ordered_route_sha256": "adebd7f7129d25595c04ad42128a70f6356d7a5c4dd1e195a25e8e7499515805", + "route_weight_sha256": "1d3d3d25b305cdbe95a9a97a70c2b5d10253a1dcfcf4b21d7490a05bd77af8f5", + "loads": [ + 0, + 0, + 2, + 2, + 2, + 9, + 19, + 8, + 27, + 5, + 18, + 2, + 6, + 2, + 6, + 2, + 0, + 0, + 2, + 5, + 17, + 1, + 9, + 14, + 13, + 13, + 3, + 38, + 43, + 13, + 9, + 4, + 5, + 14, + 5, + 3, + 14, + 5, + 7, + 6, + 2, + 9, + 11, + 3, + 5, + 9, + 0, + 8, + 3, + 5, + 12, + 17, + 9, + 19, + 6, + 4, + 2, + 4, + 15, + 0, + 25, + 23, + 8, + 6 + ], + "weighted_loads": [ + 0.0, + 0.0, + 0.05987272970378399, + 0.15720908343791962, + 0.0592779666185379, + 0.27070614346303046, + 1.5122182499617338, + 0.2736578658223152, + 3.7266501002013683, + 0.2530190534889698, + 1.8933748751878738, + 0.06580213457345963, + 0.3118934486992657, + 0.09068101644515991, + 0.23347697407007217, + 0.11958162114024162, + 0.0, + 0.0, + 0.08661064878106117, + 0.17387528903782368, + 0.8110490441322327, + 0.03051122836768627, + 0.5917906574904919, + 1.2589448560029268, + 0.46476741577498615, + 0.6131686083972454, + 0.10347556509077549, + 3.6136198807507753, + 2.0664519295096397, + 0.6862740442156792, + 0.5446059629321098, + 0.16948458552360535, + 0.29402438178658485, + 0.7412762157619, + 0.14957084925845265, + 0.12326261214911938, + 0.7782355677336454, + 1.021464478224516, + 0.24632653221488, + 0.25250009447336197, + 0.16645367816090584, + 0.5173888802528381, + 0.38855989929288626, + 0.2527194060385227, + 0.21223854646086693, + 0.3614372257143259, + 0.0, + 0.7150349819567055, + 0.24215636402368546, + 0.36872000992298126, + 0.47613624297082424, + 1.24641951918602, + 0.25368027947843075, + 2.156828597187996, + 0.37771075032651424, + 0.19968657940626144, + 0.07024992629885674, + 0.14949060045182705, + 0.6348312497138977, + 0.0, + 1.5537882093340158, + 1.9645785787142813, + 0.4455941136693582, + 1.187776256352663 + ], + "unique_experts": 58, + "load_cv": 0.9852850366573629, + "normalized_load_entropy": 0.8984375992356243, + "max_load_share": 0.07706093189964158 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 52, + "ordered_topk_exact_tokens": 31, + "set_exact_tokens": 39, + "mean_set_jaccard": 0.9285714285714287, + "mean_token_weighted_tv": 0.016607385764543254, + "aggregate_load_tv": 0.03205128205128205 + }, + "system_bos": { + "tokens": 52, + "ordered_topk_exact_tokens": 24, + "set_exact_tokens": 32, + "mean_set_jaccard": 0.881868131868132, + "mean_token_weighted_tv": 0.02265574905770616, + "aggregate_load_tv": 0.038461538461538464 + }, + "system_x": { + "tokens": 52, + "ordered_topk_exact_tokens": 20, + "set_exact_tokens": 27, + "mean_set_jaccard": 0.8585164835164836, + "mean_token_weighted_tv": 0.029324165411078587, + "aggregate_load_tv": 0.0641025641025641 + }, + "system_period": { + "tokens": 52, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 22, + "mean_set_jaccard": 0.8269230769230769, + "mean_token_weighted_tv": 0.03540148245743834, + "aggregate_load_tv": 0.07692307692307693 + }, + "bos_at_s0": { + "tokens": 52, + "ordered_topk_exact_tokens": 21, + "set_exact_tokens": 27, + "mean_set_jaccard": 0.8626373626373627, + "mean_token_weighted_tv": 0.029146364657208323, + "aggregate_load_tv": 0.04166666666666667 + }, + "bos_at_s1": { + "tokens": 52, + "ordered_topk_exact_tokens": 19, + "set_exact_tokens": 28, + "mean_set_jaccard": 0.8557692307692307, + "mean_token_weighted_tv": 0.03250477498827072, + "aggregate_load_tv": 0.05128205128205129 + }, + "x_at_s0": { + "tokens": 52, + "ordered_topk_exact_tokens": 26, + "set_exact_tokens": 30, + "mean_set_jaccard": 0.8750000000000002, + "mean_token_weighted_tv": 0.026019908774357576, + "aggregate_load_tv": 0.04807692307692308 + }, + "x_at_s1": { + "tokens": 52, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 26, + "mean_set_jaccard": 0.8406593406593407, + "mean_token_weighted_tv": 0.03423854262711337, + "aggregate_load_tv": 0.06410256410256411 + }, + "period_at_s0": { + "tokens": 52, + "ordered_topk_exact_tokens": 21, + "set_exact_tokens": 30, + "mean_set_jaccard": 0.8791208791208793, + "mean_token_weighted_tv": 0.028388597035350707, + "aggregate_load_tv": 0.04487179487179488 + }, + "period_at_s1": { + "tokens": 52, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 25, + "mean_set_jaccard": 0.8228021978021979, + "mean_token_weighted_tv": 0.037135060831832774, + "aggregate_load_tv": 0.08012820512820512 + } + } + }, + "layer_25": { + "layer": 25, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "088c5ea0f6c298831d2f0d8058bf35729d3cf9b0798e63167dfd397d8b8cfa67", + "route_weight_sha256": "ea9f8c257e5037bb95463043d545ec75204e95dc679dbcc8c82e1cef26ca0479", + "loads": [ + 3, + 4, + 2, + 6, + 0, + 3, + 23, + 9, + 1, + 1, + 1, + 2, + 1, + 0, + 14, + 11, + 11, + 7, + 17, + 18, + 2, + 0, + 3, + 20, + 2, + 1, + 0, + 3, + 2, + 1, + 0, + 8, + 1, + 1, + 0, + 8, + 2, + 6, + 16, + 0, + 6, + 1, + 5, + 1, + 4, + 6, + 3, + 2, + 9, + 2, + 7, + 9, + 17, + 5, + 3, + 5, + 1, + 3, + 1, + 0, + 4, + 3, + 5, + 0 + ], + "weighted_loads": [ + 0.13331147283315659, + 0.277497299015522, + 0.05156111530959606, + 0.21925594843924046, + 0.0, + 0.10901174880564213, + 1.8227912858128548, + 0.2654151972383261, + 0.03210648149251938, + 0.02744605392217636, + 0.03962666168808937, + 0.1544417217373848, + 0.04897041991353035, + 0.0, + 1.9843155182898045, + 0.42864614725112915, + 0.6146697541698813, + 0.3590476866811514, + 2.2547062523663044, + 2.5936367474496365, + 0.12365132942795753, + 0.0, + 0.13158942759037018, + 3.044544629752636, + 0.10435670614242554, + 0.08562063425779343, + 0.0, + 0.15533621981739998, + 0.05831653065979481, + 0.03437824174761772, + 0.0, + 0.7990035675466061, + 0.05134930834174156, + 0.039501044899225235, + 0.0, + 0.6719512045383453, + 0.09047787263989449, + 0.27739170007407665, + 2.3270684890449047, + 0.0, + 0.233007675036788, + 0.0380985364317894, + 0.24362360872328281, + 0.035278916358947754, + 0.19555700570344925, + 0.3165027666836977, + 0.14991925656795502, + 0.18452168256044388, + 0.6033228188753128, + 0.059365199878811836, + 0.4311865195631981, + 0.493139173835516, + 2.519438061863184, + 0.35835878551006317, + 0.1437726467847824, + 0.403608825057745, + 0.04864022880792618, + 0.10312418639659882, + 0.03499710559844971, + 0.0, + 0.2126375362277031, + 0.1643569879233837, + 0.31426618434488773, + 0.0 + ], + "unique_experts": 55, + "load_cv": 1.1120640226769969, + "normalized_load_entropy": 0.8695055813945253, + "max_load_share": 0.07371794871794872 + }, + "full_input": { + "tokens": 77, + "top_k": 6, + "decisions": 462, + "ordered_route_sha256": "673377cf08ae0cc85a72e410f04f035f5fe7b84da91b085e559e0f16097362f3", + "route_weight_sha256": "b309dfad7821df5fb845c440c2b843f7fce74911eb2e5aff6a2f86218f25179c", + "loads": [ + 5, + 22, + 9, + 7, + 1, + 3, + 29, + 10, + 1, + 1, + 10, + 6, + 3, + 1, + 14, + 11, + 11, + 12, + 19, + 18, + 2, + 0, + 3, + 24, + 2, + 1, + 0, + 3, + 3, + 3, + 0, + 9, + 3, + 2, + 2, + 9, + 2, + 7, + 26, + 2, + 12, + 2, + 5, + 2, + 10, + 16, + 6, + 3, + 9, + 2, + 17, + 9, + 22, + 5, + 12, + 5, + 3, + 5, + 1, + 0, + 6, + 3, + 11, + 0 + ], + "weighted_loads": [ + 0.24322586879134178, + 1.7397022133227438, + 0.41862051002681255, + 0.2819444928318262, + 0.1301133930683136, + 0.10901174880564213, + 2.2330348938703537, + 0.29894723556935787, + 0.03210648149251938, + 0.02744605392217636, + 0.9922561720013618, + 0.832079516723752, + 0.1956176981329918, + 0.10631465166807175, + 1.9843155182898045, + 0.42864614725112915, + 0.6146697541698813, + 0.5277393218129873, + 2.3118703570216894, + 2.5936367474496365, + 0.12365132942795753, + 0.0, + 0.13158942759037018, + 3.2097900081425905, + 0.10435670614242554, + 0.08562063425779343, + 0.0, + 0.15533621981739998, + 0.10020114667713642, + 0.1037079319357872, + 0.0, + 0.8969077579677105, + 0.16256443411111832, + 0.09930892288684845, + 0.09118183329701424, + 0.7800900042057037, + 0.09047787263989449, + 0.33291503600776196, + 3.751349613070488, + 0.1993619203567505, + 0.4836560823023319, + 0.06755767948925495, + 0.24362360872328281, + 0.06776327639818192, + 0.6421442441642284, + 1.205277755856514, + 0.24091224593576044, + 0.2235080860555172, + 0.6033228188753128, + 0.059365199878811836, + 1.0223318189382553, + 0.493139173835516, + 2.784888645634055, + 0.35835878551006317, + 0.5874553283210844, + 0.403608825057745, + 0.1563883312046528, + 0.1738228127360344, + 0.03499710559844971, + 0.0, + 0.3086870014667511, + 0.1643569879233837, + 0.7593794111162424, + 0.0 + ], + "unique_experts": 59, + "load_cv": 0.9664350672401868, + "normalized_load_entropy": 0.8956162488120225, + "max_load_share": 0.06277056277056277 + } + }, + "s1_eos": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "1e2e96d1e51d45af5c605788a677b8eb0b4c0654caa9527b7f0f3e8117ad0fb7", + "route_weight_sha256": "1ebde72ea75056447fbd64b1deefce955bb9a26e90cc1e42546090717a0c76de", + "loads": [ + 4, + 4, + 4, + 6, + 0, + 3, + 21, + 6, + 1, + 1, + 1, + 3, + 1, + 0, + 14, + 12, + 12, + 6, + 17, + 18, + 2, + 0, + 3, + 20, + 1, + 1, + 0, + 3, + 2, + 1, + 0, + 9, + 1, + 1, + 0, + 8, + 3, + 6, + 16, + 0, + 5, + 1, + 5, + 1, + 5, + 6, + 3, + 2, + 8, + 2, + 7, + 9, + 16, + 5, + 3, + 6, + 1, + 3, + 2, + 1, + 3, + 3, + 4, + 0 + ], + "weighted_loads": [ + 0.15128151327371597, + 0.2737186327576637, + 0.12063512951135635, + 0.21107986010611057, + 0.0, + 0.10452303849160671, + 1.7521530985832214, + 0.1875142902135849, + 0.02989054284989834, + 0.026957133784890175, + 0.040823571383953094, + 0.19437909871339798, + 0.04803919792175293, + 0.0, + 1.9595463871955872, + 0.4610084518790245, + 0.6532400576397777, + 0.3145426958799362, + 2.2026030272245407, + 2.543103989213705, + 0.12336094677448273, + 0.0, + 0.12731656804680824, + 3.0569658018648624, + 0.07255731523036957, + 0.0852254182100296, + 0.0, + 0.1586785912513733, + 0.058336976915597916, + 0.03403626009821892, + 0.0, + 0.8178434371948242, + 0.048167452216148376, + 0.03927575796842575, + 0.0, + 0.6716279573738575, + 0.11609959416091442, + 0.3020821437239647, + 2.2666044887155294, + 0.0, + 0.2166675589978695, + 0.0355512835085392, + 0.24007310532033443, + 0.03409591317176819, + 0.20075055770576, + 0.3035580236464739, + 0.1477794125676155, + 0.1728689968585968, + 0.5638538002967834, + 0.06965136155486107, + 0.41458071395754814, + 0.49308072216808796, + 2.4833888188004494, + 0.36854908615350723, + 0.14438200742006302, + 0.43396701477468014, + 0.04672996327280998, + 0.10188926383852959, + 0.06626046262681484, + 0.026602864265441895, + 0.18879679404199123, + 0.16883650049567223, + 0.2867310233414173, + 0.0 + ], + "unique_experts": 56, + "load_cv": 1.0790577134615802, + "normalized_load_entropy": 0.876455371703996, + "max_load_share": 0.0673076923076923 + }, + "full_input": { + "tokens": 93, + "top_k": 6, + "decisions": 558, + "ordered_route_sha256": "d7f93074427b1d953493bfdf9630cf4a65658ccaa5b2a4c2ef0020345870943a", + "route_weight_sha256": "3e8e60d1fc344a70e9daa504b0264897091b1d5e98946bc357bd735c62e476bd", + "loads": [ + 7, + 28, + 11, + 8, + 1, + 4, + 31, + 7, + 3, + 2, + 22, + 8, + 6, + 1, + 14, + 12, + 13, + 14, + 19, + 19, + 5, + 7, + 3, + 27, + 1, + 1, + 1, + 3, + 3, + 4, + 0, + 12, + 7, + 2, + 3, + 9, + 4, + 12, + 24, + 4, + 12, + 1, + 6, + 2, + 15, + 20, + 5, + 2, + 8, + 3, + 19, + 10, + 22, + 12, + 16, + 7, + 4, + 6, + 3, + 2, + 6, + 4, + 9, + 2 + ], + "weighted_loads": [ + 0.4306015372276306, + 2.278821021085605, + 0.5147810336202383, + 0.34486098028719425, + 0.1132286861538887, + 0.1451119128614664, + 2.441077135503292, + 0.22460150346159935, + 0.1398810986429453, + 0.05562162585556507, + 1.9897808320820332, + 0.9434016179293394, + 0.34919915348291397, + 0.06540346145629883, + 1.9595463871955872, + 0.4610084518790245, + 0.6887383302673697, + 0.9626748487353325, + 2.2845920883119106, + 2.5668711569160223, + 0.3789982199668884, + 0.6472563408315182, + 0.12731656804680824, + 3.3350992649793625, + 0.07255731523036957, + 0.0852254182100296, + 0.03298039361834526, + 0.1586785912513733, + 0.10508846864104271, + 0.1412401907145977, + 0.0, + 1.2864129096269608, + 0.3370242100208998, + 0.08834747597575188, + 0.15438488498330116, + 0.7721535451710224, + 0.1591444555670023, + 0.5665393173694611, + 3.885676672682166, + 0.3824452944099903, + 0.5596664361655712, + 0.0355512835085392, + 0.32581585459411144, + 0.06403952091932297, + 0.9501712005585432, + 1.6278676260262728, + 0.19220464176032692, + 0.1728689968585968, + 0.5638538002967834, + 0.09518422558903694, + 1.1191774792969227, + 0.5399431046098471, + 2.880979644600302, + 0.8766620792448521, + 0.9775821415241808, + 0.46040075086057186, + 0.19451722875237465, + 0.21068259328603745, + 0.10378331877291203, + 0.11649967730045319, + 0.39363756589591503, + 0.2120143584907055, + 0.7103310115635395, + 0.05937333405017853 + ], + "unique_experts": 63, + "load_cv": 0.8603270536407156, + "normalized_load_entropy": 0.9170617463970296, + "max_load_share": 0.05555555555555555 + } + }, + "s0_bos": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "d73cd416c8e7f53b3ef481b0d7143b6944ac924d43eaa2d373aef1e9661c7185", + "route_weight_sha256": "2c01e0f92425ebd734fcfec9ae4e7d622ac4d6385884c3f71804e7d2f393d622", + "loads": [ + 4, + 4, + 3, + 5, + 1, + 3, + 22, + 7, + 3, + 1, + 1, + 2, + 2, + 0, + 13, + 12, + 9, + 6, + 18, + 18, + 2, + 0, + 3, + 19, + 2, + 1, + 0, + 4, + 2, + 1, + 0, + 10, + 1, + 1, + 0, + 8, + 0, + 5, + 15, + 0, + 5, + 1, + 5, + 2, + 4, + 6, + 2, + 2, + 9, + 2, + 8, + 9, + 17, + 5, + 4, + 6, + 1, + 2, + 2, + 0, + 4, + 3, + 5, + 0 + ], + "weighted_loads": [ + 0.16460059210658073, + 0.2623242661356926, + 0.08349891938269138, + 0.18763863295316696, + 0.04202898591756821, + 0.11116807907819748, + 1.833372551947832, + 0.21433741226792336, + 0.08928694576025009, + 0.02861730195581913, + 0.0428275428712368, + 0.15754316747188568, + 0.09049733728170395, + 0.0, + 1.981440220028162, + 0.4455380477011204, + 0.6064557451754808, + 0.31114958599209785, + 2.2703688740730286, + 2.565097499638796, + 0.13135917857289314, + 0.0, + 0.13515669107437134, + 2.977447470650077, + 0.10694070160388947, + 0.07542489469051361, + 0.0, + 0.21277330070734024, + 0.05812709219753742, + 0.033623892813920975, + 0.0, + 0.8888821769505739, + 0.051586657762527466, + 0.04203103855252266, + 0.0, + 0.6907923128455877, + 0.0, + 0.22066731564700603, + 2.2901548091322184, + 0.0, + 0.22524008713662624, + 0.04318467900156975, + 0.2357885967940092, + 0.08435670658946037, + 0.18333560414612293, + 0.2897327449172735, + 0.10222794115543365, + 0.17445015162229538, + 0.6126926690340042, + 0.07058668322861195, + 0.455745380371809, + 0.47647748701274395, + 2.555728644132614, + 0.3638884648680687, + 0.17376008816063404, + 0.430569251999259, + 0.0528741180896759, + 0.06305967085063457, + 0.06514396890997887, + 0.0, + 0.2526056207716465, + 0.17068303748965263, + 0.3445856738835573, + 0.0 + ], + "unique_experts": 55, + "load_cv": 1.0790577134615802, + "normalized_load_entropy": 0.8763217064503953, + "max_load_share": 0.07051282051282051 + }, + "full_input": { + "tokens": 77, + "top_k": 6, + "decisions": 462, + "ordered_route_sha256": "70bfa3602dcaa07a60713716240ded1adb23e944d7f8563ea0dfedfae47ad524", + "route_weight_sha256": "653f400bf94330fd196f5ef457ac5b27ebcc65fb6e33ce088a7e21fbc0819b47", + "loads": [ + 5, + 22, + 11, + 6, + 2, + 3, + 28, + 10, + 3, + 1, + 11, + 4, + 5, + 1, + 13, + 12, + 9, + 11, + 19, + 18, + 2, + 0, + 3, + 23, + 2, + 1, + 0, + 4, + 3, + 2, + 1, + 11, + 3, + 2, + 2, + 9, + 0, + 6, + 24, + 1, + 11, + 3, + 5, + 4, + 10, + 15, + 5, + 2, + 9, + 3, + 18, + 9, + 21, + 5, + 14, + 6, + 2, + 5, + 2, + 0, + 5, + 3, + 11, + 1 + ], + "weighted_loads": [ + 0.2176283560693264, + 1.7041840886231512, + 0.5590775553137064, + 0.3073244243860245, + 0.18350953608751297, + 0.11116807907819748, + 2.243616160005331, + 0.3185464236885309, + 0.08928694576025009, + 0.02861730195581913, + 1.0745477713644505, + 0.7681897804141045, + 0.27869753539562225, + 0.062012650072574615, + 1.981440220028162, + 0.4455380477011204, + 0.6064557451754808, + 0.4798412211239338, + 2.2961358670145273, + 2.565097499638796, + 0.13135917857289314, + 0.0, + 0.13515669107437134, + 3.1462006997317076, + 0.10694070160388947, + 0.07542489469051361, + 0.0, + 0.21277330070734024, + 0.10001170821487904, + 0.06753376871347427, + 0.31388890743255615, + 0.9867863673716784, + 0.1538374163210392, + 0.10183891654014587, + 0.09995836764574051, + 0.803605979308486, + 0.0, + 0.276879383251071, + 2.8042041044682264, + 0.15467169880867004, + 0.4758884944021702, + 0.11964140459895134, + 0.2357885967940092, + 0.15277662500739098, + 0.6355680357664824, + 1.1447168681770563, + 0.2598210796713829, + 0.17445015162229538, + 0.6126926690340042, + 0.11433361656963825, + 1.0468906797468662, + 0.47647748701274395, + 2.8170088045299053, + 0.3638884648680687, + 0.6523200811352581, + 0.430569251999259, + 0.11341610178351402, + 0.17865843884646893, + 0.06514396890997887, + 0.0, + 0.30699070543050766, + 0.17068303748965263, + 0.789698900654912, + 0.03196660429239273 + ], + "unique_experts": 60, + "load_cv": 0.9352152356357328, + "normalized_load_entropy": 0.9018402448397405, + "max_load_share": 0.06060606060606061 + } + }, + "s1_bos": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "ad9d2f16f93527d511a6fbe5043ccce87063c1b2eaa89e6d7a5d7243fcb4ba25", + "route_weight_sha256": "e247427d085eac689067c0f746b13ae4c623b8884537538956d9ae10214d2ec6", + "loads": [ + 4, + 4, + 3, + 5, + 0, + 3, + 23, + 8, + 2, + 1, + 1, + 2, + 2, + 0, + 13, + 11, + 10, + 6, + 18, + 18, + 2, + 0, + 3, + 20, + 2, + 1, + 0, + 4, + 2, + 1, + 1, + 9, + 1, + 1, + 1, + 8, + 2, + 5, + 14, + 0, + 5, + 1, + 5, + 3, + 4, + 6, + 2, + 2, + 9, + 2, + 7, + 9, + 16, + 5, + 4, + 6, + 1, + 2, + 0, + 0, + 4, + 3, + 5, + 0 + ], + "weighted_loads": [ + 0.1635114923119545, + 0.25909004732966423, + 0.11129919067025185, + 0.19166613556444645, + 0.0, + 0.11279367096722126, + 1.8257265742868185, + 0.23849022388458252, + 0.05946380831301212, + 0.028914762660861015, + 0.048857469111680984, + 0.1722051128745079, + 0.08853018656373024, + 0.0, + 1.9383946228772402, + 0.41660781018435955, + 0.6392583679407835, + 0.32960708625614643, + 2.190016381442547, + 2.5907273665070534, + 0.13379881903529167, + 0.0, + 0.12659898772835732, + 3.0205589355900884, + 0.10726917162537575, + 0.08397603034973145, + 0.0, + 0.211728747934103, + 0.05451951362192631, + 0.03358876705169678, + 0.03373958170413971, + 0.8383096940815449, + 0.05194369703531265, + 0.0426996611058712, + 0.02581901289522648, + 0.6847617086023092, + 0.09329402446746826, + 0.22266737930476665, + 2.263526786118746, + 0.0, + 0.23310787230730057, + 0.03918676823377609, + 0.23390777222812176, + 0.12785795331001282, + 0.164056945592165, + 0.2638508044183254, + 0.11078443378210068, + 0.16250032931566238, + 0.6002894379198551, + 0.0728089939802885, + 0.4081484451889992, + 0.48730896785855293, + 2.499699305742979, + 0.3741449601948261, + 0.15622282400727272, + 0.46313601918518543, + 0.055783480405807495, + 0.06503413245081902, + 0.0, + 0.0, + 0.25333980843424797, + 0.1690095216035843, + 0.3588070869445801, + 0.0 + ], + "unique_experts": 56, + "load_cv": 1.0790577134615802, + "normalized_load_entropy": 0.8785069051729437, + "max_load_share": 0.07371794871794872 + }, + "full_input": { + "tokens": 93, + "top_k": 6, + "decisions": 558, + "ordered_route_sha256": "e1d0eea9eaf0ca0c9b8d7a04146e0dd8bd042e92dc0faa251e741236307dc927", + "route_weight_sha256": "cd42c8f5cdedb203f99ef024f8abc3b29ad443575f64cb8ab2d638c7b1a48336", + "loads": [ + 7, + 29, + 12, + 5, + 1, + 4, + 33, + 9, + 6, + 2, + 23, + 6, + 8, + 1, + 13, + 11, + 10, + 14, + 19, + 19, + 5, + 7, + 3, + 28, + 2, + 1, + 1, + 4, + 3, + 3, + 1, + 12, + 8, + 2, + 3, + 9, + 3, + 11, + 21, + 3, + 12, + 1, + 6, + 4, + 14, + 20, + 4, + 2, + 9, + 4, + 19, + 10, + 21, + 12, + 17, + 7, + 4, + 5, + 1, + 1, + 7, + 4, + 10, + 2 + ], + "weighted_loads": [ + 0.4175703376531601, + 2.267713021254167, + 0.639422656968236, + 0.19166613556444645, + 0.13916219770908356, + 0.15338254533708096, + 2.514650611206889, + 0.2709321640431881, + 0.2585755791515112, + 0.05757925473153591, + 2.0763786993920803, + 0.9019628465175629, + 0.4305732324719429, + 0.047172386199235916, + 1.9383946228772402, + 0.41660781018435955, + 0.6392583679407835, + 0.9777392391115427, + 2.2413684092462063, + 2.6144945342093706, + 0.3894360922276974, + 0.6472563408315182, + 0.12659898772835732, + 3.3318205466493964, + 0.10726917162537575, + 0.08397603034973145, + 0.03298039361834526, + 0.211728747934103, + 0.1012710053473711, + 0.10211298987269402, + 0.03373958170413971, + 1.3068791665136814, + 0.390782019123435, + 0.09177137911319733, + 0.14028256945312023, + 0.7945405449718237, + 0.13633888587355614, + 0.4977447781711817, + 2.9814955331385136, + 0.3309635780751705, + 0.5761067494750023, + 0.03918676823377609, + 0.31965052150189877, + 0.1578015610575676, + 0.9281046316027641, + 1.5696868486702442, + 0.21154611930251122, + 0.16250032931566238, + 0.6002894379198551, + 0.14096134714782238, + 1.1127452105283737, + 0.5162230804562569, + 2.8930836394429207, + 0.882257953286171, + 0.9807550420518965, + 0.48956975527107716, + 0.218050517141819, + 0.1947113610804081, + 0.03246148303151131, + 0.08989681303501129, + 0.44815078750252724, + 0.21218737959861755, + 0.7824070751667023, + 0.05937333405017853 + ], + "unique_experts": 64, + "load_cv": 0.866753822204975, + "normalized_load_entropy": 0.9175908205566629, + "max_load_share": 0.05913978494623656 + } + }, + "s0_x": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "4671f5fbe83b480f295fc8f87e9975dda52c0c2aeb9e079e6f59a026c4117d31", + "route_weight_sha256": "4c26575c6364bc38a00b2e64f5c4af3dfd5ea9a43e11bff7fa98236fd008b803", + "loads": [ + 4, + 4, + 3, + 4, + 1, + 3, + 20, + 7, + 3, + 1, + 1, + 3, + 2, + 0, + 14, + 12, + 7, + 7, + 18, + 19, + 2, + 0, + 3, + 22, + 2, + 1, + 0, + 3, + 2, + 1, + 1, + 9, + 1, + 1, + 0, + 8, + 2, + 7, + 16, + 0, + 5, + 1, + 5, + 2, + 4, + 6, + 2, + 2, + 9, + 1, + 7, + 9, + 17, + 5, + 3, + 6, + 0, + 3, + 0, + 0, + 3, + 3, + 5, + 0 + ], + "weighted_loads": [ + 0.16520936600863934, + 0.2757582329213619, + 0.08774996921420097, + 0.1662935297936201, + 0.04510641470551491, + 0.12009773403406143, + 1.6966481171548367, + 0.2027968429028988, + 0.09250657446682453, + 0.029730837792158127, + 0.04245368018746376, + 0.21123768761754036, + 0.09395759180188179, + 0.0, + 1.9997667632997036, + 0.4376944787800312, + 0.5464417263865471, + 0.39599791169166565, + 2.201302792876959, + 2.626396581530571, + 0.1258426420390606, + 0.0, + 0.13181396201252937, + 3.0179494209587574, + 0.10598369315266609, + 0.09506929665803909, + 0.0, + 0.1443893164396286, + 0.05844560265541077, + 0.03256002813577652, + 0.03420305252075195, + 0.8186462242156267, + 0.05297580733895302, + 0.044351622462272644, + 0.0, + 0.6682577487081289, + 0.07661933079361916, + 0.31967667676508427, + 2.3214152920991182, + 0.0, + 0.23350117355585098, + 0.04118337109684944, + 0.2404016125947237, + 0.08233818784356117, + 0.1924811340868473, + 0.3006299138069153, + 0.10906314849853516, + 0.20358767360448837, + 0.6571234911680222, + 0.04229101911187172, + 0.4219236224889755, + 0.47218675538897514, + 2.5146614722907543, + 0.3576625920832157, + 0.12901726365089417, + 0.42163544707000256, + 0.0, + 0.09884530864655972, + 0.0, + 0.0, + 0.17471089586615562, + 0.16130084916949272, + 0.3272170405834913, + 0.0 + ], + "unique_experts": 55, + "load_cv": 1.103756064104148, + "normalized_load_entropy": 0.8728997812703813, + "max_load_share": 0.07051282051282051 + }, + "full_input": { + "tokens": 77, + "top_k": 6, + "decisions": 462, + "ordered_route_sha256": "3ce6d4271d6cf37eb710180e0a8dbc8ffa670c9774a238e7482011c5f3402933", + "route_weight_sha256": "4c8fe443d1944892464f6402c3e69e3e6c76f2f118c9c1e1e961be117f3171ba", + "loads": [ + 6, + 23, + 9, + 5, + 2, + 3, + 28, + 7, + 3, + 1, + 10, + 6, + 4, + 1, + 14, + 12, + 7, + 12, + 21, + 19, + 2, + 0, + 3, + 27, + 2, + 1, + 0, + 3, + 3, + 3, + 1, + 11, + 3, + 2, + 1, + 9, + 2, + 8, + 26, + 1, + 12, + 1, + 5, + 3, + 10, + 15, + 5, + 2, + 10, + 1, + 17, + 9, + 22, + 5, + 13, + 6, + 0, + 5, + 1, + 0, + 4, + 3, + 12, + 0 + ], + "weighted_loads": [ + 0.2553244512528181, + 1.8059733954723924, + 0.4218242857605219, + 0.1990141812711954, + 0.15152312442660332, + 0.12009773403406143, + 2.227339930832386, + 0.2027968429028988, + 0.09250657446682453, + 0.029730837792158127, + 0.9576975628733635, + 0.8654984496533871, + 0.22111863642930984, + 0.06030864268541336, + 1.9997667632997036, + 0.4376944787800312, + 0.5464417263865471, + 0.5646895468235016, + 2.285565624013543, + 2.626396581530571, + 0.1258426420390606, + 0.0, + 0.13181396201252937, + 3.2158866077661514, + 0.10598369315266609, + 0.09506929665803909, + 0.0, + 0.1443893164396286, + 0.10033021867275238, + 0.09724336862564087, + 0.03420305252075195, + 1.0103703755885363, + 0.14762087911367416, + 0.10415950044989586, + 0.049253132194280624, + 0.7725994866341352, + 0.07661933079361916, + 0.37125020287930965, + 2.9479775559157133, + 0.15467169880867004, + 0.5340458210557699, + 0.04118337109684944, + 0.2404016125947237, + 0.11482254788279533, + 0.6456780880689621, + 1.1768395565450191, + 0.2708063870668411, + 0.20358767360448837, + 0.7000651583075523, + 0.04229101911187172, + 1.0130689218640327, + 0.47218675538897514, + 2.8876356706023216, + 0.3576625920832157, + 0.6464952377136797, + 0.42163544707000256, + 0.0, + 0.16204534098505974, + 0.02783609926700592, + 0.0, + 0.22909598052501678, + 0.16130084916949272, + 0.8114001955837011, + 0.0 + ], + "unique_experts": 59, + "load_cv": 0.9990813043536083, + "normalized_load_entropy": 0.8894873206474583, + "max_load_share": 0.06060606060606061 + } + }, + "s1_x": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "2a971dbb7af4846dcd18bb92ce1f6bd30c2c503741841e7682b0a174aff18342", + "route_weight_sha256": "3829be311d7222525232d2d84c8c88690e90cca5f070be39ce4a9b2b4313bbac", + "loads": [ + 4, + 4, + 4, + 5, + 0, + 3, + 20, + 8, + 2, + 1, + 1, + 3, + 2, + 0, + 13, + 13, + 12, + 6, + 18, + 17, + 2, + 0, + 3, + 19, + 2, + 1, + 0, + 4, + 0, + 0, + 1, + 9, + 1, + 1, + 2, + 8, + 2, + 5, + 16, + 0, + 5, + 1, + 4, + 1, + 4, + 6, + 2, + 2, + 9, + 2, + 7, + 9, + 16, + 5, + 3, + 6, + 2, + 3, + 0, + 0, + 4, + 3, + 5, + 1 + ], + "weighted_loads": [ + 0.1595463789999485, + 0.2655925005674362, + 0.13937211222946644, + 0.18605764396488667, + 0.0, + 0.12230673804879189, + 1.6818400584161282, + 0.22901474684476852, + 0.06174617446959019, + 0.03368542715907097, + 0.044617660343647, + 0.21257858350872993, + 0.08634364604949951, + 0.0, + 1.9194347485899925, + 0.4749114103615284, + 0.6953921122476459, + 0.3381405211985111, + 2.214042492210865, + 2.525300692766905, + 0.1365259438753128, + 0.0, + 0.12885509058833122, + 2.793335599824786, + 0.1050720065832138, + 0.09507835656404495, + 0.0, + 0.20411070063710213, + 0.0, + 0.0, + 0.03213133662939072, + 0.8030693512409925, + 0.05529452860355377, + 0.04168305918574333, + 0.05079839564859867, + 0.6391765344887972, + 0.09466885402798653, + 0.25019078329205513, + 2.377543753013015, + 0.0, + 0.23131552711129189, + 0.040680550038814545, + 0.19044301472604275, + 0.03322581946849823, + 0.1446211151778698, + 0.2632691655308008, + 0.10823827609419823, + 0.17973385006189346, + 0.592080257833004, + 0.07096306793391705, + 0.3936173655092716, + 0.4772448241710663, + 2.5151674188673496, + 0.37187959998846054, + 0.12137753888964653, + 0.45821153931319714, + 0.08433846570551395, + 0.1040281355381012, + 0.0, + 0.0, + 0.241913802921772, + 0.1549391858279705, + 0.38208081014454365, + 0.0373949334025383 + ], + "unique_experts": 55, + "load_cv": 1.0618604738896746, + "normalized_load_entropy": 0.8780841318017175, + "max_load_share": 0.0641025641025641 + }, + "full_input": { + "tokens": 93, + "top_k": 6, + "decisions": 558, + "ordered_route_sha256": "1a83dbe07df263e04009eb2120be8670f96990db5748445cc6b3a4b4740892cf", + "route_weight_sha256": "f9c8cd72bcd4b2f5df40278c80dd03b8350b4431326e887f281617c5a6098241", + "loads": [ + 6, + 29, + 12, + 5, + 1, + 4, + 32, + 9, + 4, + 2, + 22, + 9, + 7, + 0, + 13, + 14, + 13, + 15, + 19, + 18, + 5, + 7, + 3, + 27, + 2, + 1, + 1, + 5, + 1, + 2, + 1, + 13, + 6, + 2, + 4, + 9, + 3, + 11, + 24, + 3, + 12, + 1, + 5, + 2, + 15, + 19, + 4, + 2, + 9, + 2, + 21, + 10, + 23, + 12, + 16, + 7, + 3, + 6, + 1, + 1, + 6, + 4, + 10, + 3 + ], + "weighted_loads": [ + 0.3639190308749676, + 2.2870671523269266, + 0.573457507416606, + 0.18605764396488667, + 0.07563770562410355, + 0.16289561241865158, + 2.5653240345418453, + 0.2648847661912441, + 0.17173673026263714, + 0.062349919229745865, + 1.8969166949391365, + 1.020529044792056, + 0.36419064551591873, + 0.0, + 1.9194347485899925, + 0.5176589973270893, + 0.7474430790171027, + 1.0349189937114716, + 2.2653945200145245, + 2.549067860469222, + 0.3921632170677185, + 0.6472563408315182, + 0.12885509058833122, + 3.1132344249635935, + 0.1050720065832138, + 0.09507835656404495, + 0.03298039361834526, + 0.24014707282185555, + 0.046751491725444794, + 0.06852422282099724, + 0.03213133662939072, + 1.378057999536395, + 0.28741870261728764, + 0.09075477719306946, + 0.14979352615773678, + 0.7365714479237795, + 0.1377137154340744, + 0.5047675743699074, + 3.1577595341950655, + 0.3309635780751705, + 0.5743144042789936, + 0.040680550038814545, + 0.27618576399981976, + 0.06316942721605301, + 0.9293854422867298, + 1.5211668591946363, + 0.2043118178844452, + 0.17973385006189346, + 0.592080257833004, + 0.07096306793391705, + 1.241508949548006, + 0.53793840482831, + 3.0674270913004875, + 0.8799925930798054, + 0.9822206308599561, + 0.48464527539908886, + 0.11430558003485203, + 0.2081590462476015, + 0.04191761091351509, + 0.08989681303501129, + 0.3870770186185837, + 0.19811704382300377, + 0.8056807983666658, + 0.09676826745271683 + ], + "unique_experts": 63, + "load_cv": 0.8887660338270124, + "normalized_load_entropy": 0.9108087067495438, + "max_load_share": 0.05734767025089606 + } + }, + "s0_period": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "5d17fce9c38ec7d74c57cbd31d503172ccbda5686c61d74ebf8669248298badf", + "route_weight_sha256": "c55fa30d8cbb0e2ad891ee516c5c5edc9a423d746f183c974b9a72e83f61af63", + "loads": [ + 4, + 4, + 3, + 5, + 1, + 3, + 20, + 7, + 2, + 1, + 1, + 3, + 2, + 0, + 15, + 11, + 8, + 6, + 18, + 19, + 2, + 0, + 3, + 22, + 2, + 1, + 0, + 3, + 1, + 1, + 1, + 9, + 1, + 1, + 0, + 8, + 2, + 5, + 16, + 0, + 4, + 1, + 5, + 2, + 4, + 6, + 3, + 2, + 9, + 1, + 7, + 9, + 17, + 5, + 3, + 7, + 1, + 2, + 1, + 1, + 3, + 3, + 5, + 0 + ], + "weighted_loads": [ + 0.16283504478633404, + 0.25647133588790894, + 0.07817669585347176, + 0.19055887684226036, + 0.04040919244289398, + 0.11598718352615833, + 1.707236122339964, + 0.2104405201971531, + 0.05910804681479931, + 0.030145619064569473, + 0.0442885085940361, + 0.20496749877929688, + 0.09280074015259743, + 0.0, + 2.0274615827947855, + 0.40531705133616924, + 0.6062516197562218, + 0.31589772924780846, + 2.348558012396097, + 2.6166184842586517, + 0.1347367987036705, + 0.0, + 0.13256476446986198, + 3.2336664963513613, + 0.10943052172660828, + 0.09374158084392548, + 0.0, + 0.1451651118695736, + 0.03230446204543114, + 0.03093130886554718, + 0.038410622626543045, + 0.8233443349599838, + 0.05355197563767433, + 0.04412606358528137, + 0.0, + 0.6574873980134726, + 0.07383954524993896, + 0.23904180526733398, + 2.372166559100151, + 0.0, + 0.19791129976511002, + 0.042007144540548325, + 0.23114782385528088, + 0.08020906150341034, + 0.18865922465920448, + 0.29389991983771324, + 0.1390867903828621, + 0.20499590784311295, + 0.6435461901128292, + 0.043373893946409225, + 0.4163762331008911, + 0.47218739427626133, + 2.555504994466901, + 0.35407313518226147, + 0.13338901475071907, + 0.46415851078927517, + 0.04899346083402634, + 0.06551658734679222, + 0.03022868186235428, + 0.0240011103451252, + 0.18044677004218102, + 0.16795283928513527, + 0.37204979732632637, + 0.0 + ], + "unique_experts": 58, + "load_cv": 1.1013708510212579, + "normalized_load_entropy": 0.8772339843231884, + "max_load_share": 0.07051282051282051 + }, + "full_input": { + "tokens": 77, + "top_k": 6, + "decisions": 462, + "ordered_route_sha256": "e8c3aaf3feb27a05a1c45db52d0e23ee1665d22ca0547ded6ca32706a0191015", + "route_weight_sha256": "342d1f3d0484e91c0c334a0acec31347d756d9c625468130c49e023f7c37736c", + "loads": [ + 6, + 23, + 9, + 5, + 2, + 3, + 26, + 7, + 2, + 1, + 11, + 5, + 5, + 2, + 15, + 12, + 8, + 11, + 20, + 19, + 2, + 1, + 3, + 26, + 2, + 1, + 0, + 3, + 2, + 3, + 2, + 10, + 3, + 2, + 2, + 9, + 2, + 6, + 25, + 1, + 10, + 1, + 5, + 3, + 10, + 16, + 6, + 2, + 9, + 1, + 17, + 10, + 22, + 5, + 13, + 7, + 1, + 4, + 2, + 1, + 5, + 3, + 11, + 1 + ], + "weighted_loads": [ + 0.26237972639501095, + 1.874858628725633, + 0.40234736166894436, + 0.19055887684226036, + 0.16634881496429443, + 0.11598718352615833, + 2.117479730397463, + 0.2104405201971531, + 0.05910804681479931, + 0.030145619064569473, + 1.0342092104256153, + 0.8156141117215157, + 0.2562152072787285, + 0.10562802478671074, + 2.0274615827947855, + 0.44768707640469074, + 0.6062516197562218, + 0.4845893643796444, + 2.4038340989500284, + 2.6166184842586517, + 0.1347367987036705, + 0.04521556571125984, + 0.13256476446986198, + 3.3960239831358194, + 0.10943052172660828, + 0.09374158084392548, + 0.0, + 0.1451651118695736, + 0.07418907806277275, + 0.09488780423998833, + 0.06712551973760128, + 0.9212485253810883, + 0.1503080055117607, + 0.10393394157290459, + 0.0918637104332447, + 0.7641056459397078, + 0.07383954524993896, + 0.29951149970293045, + 2.886215854436159, + 0.15467169880867004, + 0.44855970703065395, + 0.042007144540548325, + 0.23114782385528088, + 0.1126934215426445, + 0.6421851441264153, + 1.297361046075821, + 0.30740904062986374, + 0.20499590784311295, + 0.6435461901128292, + 0.043373893946409225, + 1.0075215324759483, + 0.5009762663394213, + 2.8559744860976934, + 0.35407313518226147, + 0.6166387421544641, + 0.46415851078927517, + 0.04899346083402634, + 0.13126853108406067, + 0.0584469698369503, + 0.0240011103451252, + 0.27343885973095894, + 0.16795283928513527, + 0.817163024097681, + 0.13793708384037018 + ], + "unique_experts": 63, + "load_cv": 0.9580214708368281, + "normalized_load_entropy": 0.9015418458445579, + "max_load_share": 0.05627705627705628 + } + }, + "s1_period": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "57b939d441104c53a9687445127b7cdb837a41a7b1ff0466e268506c0212e47b", + "route_weight_sha256": "dd94aa621aedfeb57b5f746c2c0a42542cf65f642b2440d3dad24896ed1b9583", + "loads": [ + 4, + 4, + 4, + 5, + 0, + 3, + 21, + 8, + 3, + 1, + 1, + 3, + 2, + 0, + 13, + 12, + 11, + 7, + 18, + 18, + 2, + 0, + 3, + 19, + 2, + 1, + 0, + 4, + 1, + 0, + 0, + 10, + 1, + 1, + 1, + 8, + 2, + 5, + 15, + 0, + 5, + 1, + 4, + 1, + 4, + 6, + 2, + 2, + 9, + 1, + 7, + 9, + 17, + 5, + 4, + 6, + 1, + 2, + 1, + 0, + 3, + 3, + 5, + 1 + ], + "weighted_loads": [ + 0.16418446227908134, + 0.29445043951272964, + 0.13694697804749012, + 0.18680947832763195, + 0.0, + 0.11860596016049385, + 1.714765902608633, + 0.2315163929015398, + 0.09419071674346924, + 0.03194499388337135, + 0.047831565141677856, + 0.20623040199279785, + 0.08771410211920738, + 0.0, + 1.850843284279108, + 0.441932650282979, + 0.6767228925600648, + 0.34427952766418457, + 2.136769011616707, + 2.5467230305075645, + 0.13444694504141808, + 0.0, + 0.13603798672556877, + 2.7064586766064167, + 0.1064981184899807, + 0.08290165662765503, + 0.0, + 0.2080504074692726, + 0.02602115459740162, + 0.0, + 0.0, + 0.8404076024889946, + 0.053485311567783356, + 0.04087274149060249, + 0.024866711348295212, + 0.6686140634119511, + 0.09700975939631462, + 0.25477202609181404, + 2.3038816545158625, + 0.0, + 0.22787859290838242, + 0.04111890867352486, + 0.19902845472097397, + 0.0324830636382103, + 0.16730329021811485, + 0.25568472035229206, + 0.10810059309005737, + 0.17570574581623077, + 0.6091857701539993, + 0.0442846342921257, + 0.38990456983447075, + 0.48143021389842033, + 2.568914430215955, + 0.3784453384578228, + 0.1527316253632307, + 0.47080665081739426, + 0.05892012268304825, + 0.0743727944791317, + 0.03599110618233681, + 0.0, + 0.19269514828920364, + 0.1536649763584137, + 0.36609834991395473, + 0.03972146660089493 + ], + "unique_experts": 56, + "load_cv": 1.0784482484519533, + "normalized_load_entropy": 0.8758182077654776, + "max_load_share": 0.0673076923076923 + }, + "full_input": { + "tokens": 93, + "top_k": 6, + "decisions": 558, + "ordered_route_sha256": "c2829e74406bcb7401a0be6e3d23ede4f9d0d90d0f3278faa8bbb3ceb6de5717", + "route_weight_sha256": "79449ab18576c3f92652c4a4cb1976156caba6593f7a0b17413b17b78acbab86", + "loads": [ + 8, + 29, + 11, + 5, + 1, + 4, + 31, + 9, + 5, + 2, + 22, + 7, + 8, + 0, + 13, + 14, + 12, + 15, + 19, + 19, + 5, + 7, + 3, + 27, + 2, + 1, + 1, + 4, + 2, + 2, + 0, + 13, + 7, + 2, + 4, + 9, + 3, + 11, + 22, + 3, + 12, + 1, + 5, + 2, + 16, + 20, + 4, + 2, + 9, + 1, + 19, + 10, + 23, + 12, + 18, + 7, + 3, + 5, + 2, + 1, + 6, + 4, + 10, + 4 + ], + "weighted_loads": [ + 0.47453492134809494, + 2.3747834970708936, + 0.5239514298737049, + 0.18680947832763195, + 0.07818915694952011, + 0.15919483453035355, + 2.4036899395287037, + 0.264613987877965, + 0.2041812725365162, + 0.06060948595404625, + 1.9234024286270142, + 0.9354738108813763, + 0.3998943008482456, + 0.0, + 1.850843284279108, + 0.5416279938071966, + 0.7275834651663899, + 0.9924116805195808, + 2.1881210394203663, + 2.570490198209882, + 0.3900842182338238, + 0.6472563408315182, + 0.13603798672556877, + 3.0132632330060005, + 0.1064981184899807, + 0.08290165662765503, + 0.03298039361834526, + 0.2080504074692726, + 0.07277264632284641, + 0.06852422282099724, + 0.0, + 1.3089770749211311, + 0.3253029379993677, + 0.08994445949792862, + 0.168801449239254, + 0.7650660090148449, + 0.1400546208024025, + 0.49662541411817074, + 3.0218504015356302, + 0.3309635780751705, + 0.5708774700760841, + 0.04111890867352486, + 0.284771203994751, + 0.062426671385765076, + 0.9929210934787989, + 1.5736274998635054, + 0.20718081668019295, + 0.17570574581623077, + 0.6091857701539993, + 0.0442846342921257, + 1.0945013351738453, + 0.5385183207690716, + 3.0189167764037848, + 0.8865583315491676, + 1.0153960266616195, + 0.497240386903286, + 0.14670491591095924, + 0.18497304990887642, + 0.07640446349978447, + 0.08989681303501129, + 0.38929443806409836, + 0.19684283435344696, + 0.7896983381360769, + 0.3112446293234825 + ], + "unique_experts": 62, + "load_cv": 0.8787650443875021, + "normalized_load_entropy": 0.9115998477515479, + "max_load_share": 0.05555555555555555 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 52, + "ordered_topk_exact_tokens": 34, + "set_exact_tokens": 37, + "mean_set_jaccard": 0.9175824175824174, + "mean_token_weighted_tv": 0.019913028262985442, + "aggregate_load_tv": 0.03846153846153847 + }, + "system_bos": { + "tokens": 52, + "ordered_topk_exact_tokens": 36, + "set_exact_tokens": 41, + "mean_set_jaccard": 0.9354395604395607, + "mean_token_weighted_tv": 0.022201629436145034, + "aggregate_load_tv": 0.028846153846153844 + }, + "system_x": { + "tokens": 52, + "ordered_topk_exact_tokens": 27, + "set_exact_tokens": 32, + "mean_set_jaccard": 0.8818681318681318, + "mean_token_weighted_tv": 0.03401205345737533, + "aggregate_load_tv": 0.05448717948717949 + }, + "system_period": { + "tokens": 52, + "ordered_topk_exact_tokens": 27, + "set_exact_tokens": 31, + "mean_set_jaccard": 0.8722527472527474, + "mean_token_weighted_tv": 0.03804763378754545, + "aggregate_load_tv": 0.04807692307692307 + }, + "bos_at_s0": { + "tokens": 52, + "ordered_topk_exact_tokens": 30, + "set_exact_tokens": 33, + "mean_set_jaccard": 0.8873626373626374, + "mean_token_weighted_tv": 0.03009788524538565, + "aggregate_load_tv": 0.05128205128205128 + }, + "bos_at_s1": { + "tokens": 52, + "ordered_topk_exact_tokens": 23, + "set_exact_tokens": 29, + "mean_set_jaccard": 0.8653846153846154, + "mean_token_weighted_tv": 0.03642968910459716, + "aggregate_load_tv": 0.0544871794871795 + }, + "x_at_s0": { + "tokens": 52, + "ordered_topk_exact_tokens": 28, + "set_exact_tokens": 31, + "mean_set_jaccard": 0.8804945054945056, + "mean_token_weighted_tv": 0.029473456491429646, + "aggregate_load_tv": 0.05448717948717949 + }, + "x_at_s1": { + "tokens": 52, + "ordered_topk_exact_tokens": 23, + "set_exact_tokens": 29, + "mean_set_jaccard": 0.8571428571428571, + "mean_token_weighted_tv": 0.03837592668759708, + "aggregate_load_tv": 0.05128205128205129 + }, + "period_at_s0": { + "tokens": 52, + "ordered_topk_exact_tokens": 26, + "set_exact_tokens": 33, + "mean_set_jaccard": 0.8832417582417583, + "mean_token_weighted_tv": 0.031781273491035864, + "aggregate_load_tv": 0.0544871794871795 + }, + "period_at_s1": { + "tokens": 52, + "ordered_topk_exact_tokens": 25, + "set_exact_tokens": 31, + "mean_set_jaccard": 0.8681318681318684, + "mean_token_weighted_tv": 0.037644694810016796, + "aggregate_load_tv": 0.05128205128205128 + } + } + }, + "layer_26": { + "layer": 26, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "726f8662f423c29d2189e3156e1a0f784be65c5c70c2138d421f652aea19330c", + "route_weight_sha256": "ec20d104b2123257e974737689d49cd376b4a3902baee51378e07c3558af2b27", + "loads": [ + 2, + 5, + 6, + 4, + 4, + 1, + 3, + 0, + 0, + 2, + 5, + 18, + 4, + 0, + 5, + 4, + 8, + 13, + 0, + 0, + 3, + 6, + 0, + 6, + 1, + 6, + 5, + 6, + 11, + 1, + 1, + 3, + 12, + 2, + 0, + 1, + 3, + 2, + 5, + 6, + 1, + 10, + 0, + 11, + 0, + 6, + 5, + 1, + 2, + 6, + 24, + 4, + 9, + 3, + 6, + 0, + 3, + 18, + 5, + 12, + 2, + 3, + 16, + 1 + ], + "weighted_loads": [ + 0.0806740764528513, + 0.6269881725311279, + 0.47193268686532974, + 0.1945122741162777, + 0.3538185954093933, + 0.044600337743759155, + 0.3782503381371498, + 0.0, + 0.0, + 0.10865490511059761, + 0.3474489636719227, + 2.3809299655258656, + 0.4669128879904747, + 0.0, + 0.29079118743538857, + 0.22494881227612495, + 0.556191947311163, + 0.9192362502217293, + 0.0, + 0.0, + 0.29326850175857544, + 0.3387804329395294, + 0.0, + 0.2970346547663212, + 0.07925951480865479, + 0.2749463673681021, + 0.19869814068078995, + 0.34214720875024796, + 0.9970681481063366, + 0.03471191227436066, + 0.034259069710969925, + 0.173952367156744, + 1.389000665396452, + 0.07707855850458145, + 0.0, + 0.08398591727018356, + 0.15560418739914894, + 0.06027688458561897, + 0.3205200284719467, + 0.5047980956733227, + 0.13434365391731262, + 0.5502871572971344, + 0.0, + 0.4529489427804947, + 0.0, + 0.2615211410447955, + 0.20561381801962852, + 0.051898300647735596, + 0.06283010356128216, + 0.309822466224432, + 1.987566877156496, + 0.2242921907454729, + 0.8651088196784258, + 0.12677622213959694, + 0.3062762916088104, + 0.0, + 0.18959280662238598, + 2.4614427592605352, + 0.2561115976423025, + 0.8795665819197893, + 0.05094604007899761, + 0.12280062958598137, + 3.1622661277651787, + 0.0524350181221962 + ], + "unique_experts": 54, + "load_cv": 1.0182425462392195, + "normalized_load_entropy": 0.8860836022519387, + "max_load_share": 0.07692307692307693 + }, + "full_input": { + "tokens": 77, + "top_k": 6, + "decisions": 462, + "ordered_route_sha256": "0c88fe75b14e5f8f1e710f0111bf757aa2f1186dacd44b732e0d5b4d7dd0ab1b", + "route_weight_sha256": "88d418d4908b96be9f30d38b369e30d452809bb25a65136cec9e7715adde4360", + "loads": [ + 2, + 6, + 6, + 4, + 4, + 1, + 3, + 2, + 0, + 7, + 8, + 23, + 5, + 1, + 20, + 6, + 8, + 24, + 1, + 1, + 3, + 7, + 1, + 6, + 7, + 6, + 11, + 13, + 11, + 1, + 7, + 3, + 15, + 2, + 3, + 1, + 9, + 2, + 5, + 6, + 1, + 10, + 1, + 14, + 1, + 6, + 9, + 2, + 4, + 7, + 33, + 5, + 15, + 3, + 7, + 0, + 18, + 26, + 11, + 13, + 3, + 3, + 17, + 2 + ], + "weighted_loads": [ + 0.0806740764528513, + 0.7414342015981674, + 0.47193268686532974, + 0.1945122741162777, + 0.3538185954093933, + 0.044600337743759155, + 0.3782503381371498, + 0.18917639181017876, + 0.0, + 0.44084250926971436, + 0.5526118986308575, + 2.684336440404877, + 0.5980144068598747, + 0.06319233775138855, + 0.9581956113106571, + 0.3242369331419468, + 0.556191947311163, + 1.461282881675288, + 0.032596345990896225, + 0.05813276767730713, + 0.29326850175857544, + 0.3710427060723305, + 0.05008505657315254, + 0.2970346547663212, + 0.42047514766454697, + 0.2749463673681021, + 1.2123949155211449, + 0.6302989404648542, + 0.9970681481063366, + 0.03471191227436066, + 0.607411652803421, + 0.173952367156744, + 1.4968193247914314, + 0.07707855850458145, + 0.17593211494386196, + 0.08398591727018356, + 0.4555300995707512, + 0.06027688458561897, + 0.3205200284719467, + 0.5047980956733227, + 0.13434365391731262, + 0.5502871572971344, + 0.050419628620147705, + 0.6047468073666096, + 0.05139262601733208, + 0.2615211410447955, + 0.4178631044924259, + 0.08481470867991447, + 0.1602740492671728, + 1.29604097828269, + 2.3659646343439817, + 0.4098269362002611, + 1.403205057606101, + 0.12677622213959694, + 0.3527408838272095, + 0.0, + 1.2718390598893166, + 2.853062187321484, + 0.49388877116143703, + 0.9280938114970922, + 0.0517609974485822, + 0.12280062958598137, + 3.20318540930748, + 0.0989978164434433 + ], + "unique_experts": 62, + "load_cv": 0.9564552754977481, + "normalized_load_entropy": 0.9040460872144224, + "max_load_share": 0.07142857142857142 + } + }, + "s1_eos": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "c2c158d3f9905c219c176d55c43afb9ba5fa9b9e965169dd00d06fa2881fd72a", + "route_weight_sha256": "1322114b9330ac852647aface2c6ba8c2e0f12d1dc144f14118a3fe733325be0", + "loads": [ + 2, + 5, + 6, + 4, + 4, + 1, + 3, + 1, + 0, + 1, + 5, + 18, + 4, + 0, + 5, + 4, + 9, + 14, + 0, + 1, + 3, + 5, + 0, + 7, + 1, + 6, + 5, + 6, + 12, + 2, + 1, + 3, + 11, + 1, + 0, + 1, + 4, + 2, + 5, + 6, + 3, + 8, + 0, + 11, + 0, + 6, + 5, + 1, + 3, + 6, + 24, + 4, + 8, + 3, + 6, + 0, + 3, + 16, + 5, + 11, + 1, + 3, + 16, + 1 + ], + "weighted_loads": [ + 0.08082251623272896, + 0.6323443353176117, + 0.4628479368984699, + 0.18766861222684383, + 0.3472850099205971, + 0.04545198008418083, + 0.37360846251249313, + 0.04450098052620888, + 0.0, + 0.07673637568950653, + 0.32855601981282234, + 2.330901961773634, + 0.46546368673443794, + 0.0, + 0.2706979773938656, + 0.23129532113671303, + 0.5811454318463802, + 0.9203489385545254, + 0.0, + 0.02852189540863037, + 0.29115113615989685, + 0.3067027423530817, + 0.0, + 0.3472661655396223, + 0.07940409332513809, + 0.27656693011522293, + 0.19760246202349663, + 0.3596997633576393, + 0.9995888620615005, + 0.06944615021348, + 0.03371487557888031, + 0.17675242200493813, + 1.3569798804819584, + 0.03255537152290344, + 0.0, + 0.08933893591165543, + 0.17646432481706142, + 0.057959627360105515, + 0.33247774839401245, + 0.489615298807621, + 0.22132720798254013, + 0.48918723687529564, + 0.0, + 0.4456737879663706, + 0.0, + 0.251238077878952, + 0.20797010138630867, + 0.05658234283328056, + 0.0888645276427269, + 0.2961799316108227, + 1.9856057949364185, + 0.21716765314340591, + 0.8259770832955837, + 0.13034045137465, + 0.3061281368136406, + 0.0, + 0.18164465762674809, + 2.3571151085197926, + 0.2502698674798012, + 0.8678932264447212, + 0.03184007108211517, + 0.12229512818157673, + 3.127963248640299, + 0.049353472888469696 + ], + "unique_experts": 56, + "load_cv": 0.9914161502144208, + "normalized_load_entropy": 0.8930547658113176, + "max_load_share": 0.07692307692307693 + }, + "full_input": { + "tokens": 93, + "top_k": 6, + "decisions": 558, + "ordered_route_sha256": "d7d4adc40f907778655e2b45ce49c839e9b4efe53b74fa17ca7805b91dac289f", + "route_weight_sha256": "8087b3853c8ab47ff1f913b101f672314f8fcaa8485de0cc9d301d63ed73a8ea", + "loads": [ + 2, + 6, + 6, + 4, + 7, + 1, + 3, + 3, + 0, + 9, + 11, + 25, + 5, + 1, + 20, + 9, + 9, + 20, + 1, + 2, + 3, + 11, + 8, + 7, + 10, + 8, + 16, + 17, + 12, + 5, + 10, + 4, + 16, + 3, + 5, + 1, + 17, + 7, + 8, + 7, + 4, + 8, + 2, + 15, + 1, + 7, + 9, + 3, + 4, + 9, + 32, + 5, + 19, + 5, + 9, + 2, + 21, + 26, + 15, + 15, + 4, + 3, + 19, + 2 + ], + "weighted_loads": [ + 0.08082251623272896, + 0.7431658282876015, + 0.4628479368984699, + 0.18766861222684383, + 0.5326426737010479, + 0.04545198008418083, + 0.37360846251249313, + 0.241680596023798, + 0.0, + 0.5809342972934246, + 0.9817592427134514, + 2.944630739511922, + 0.5931627340614796, + 0.0578378364443779, + 1.0698487940244377, + 0.5396886393427849, + 0.5811454318463802, + 1.2726405331632122, + 0.05595734715461731, + 0.09095404297113419, + 0.29115113615989685, + 0.6530279759317636, + 0.5540352687239647, + 0.3472661655396223, + 0.5236705802381039, + 0.3819236047565937, + 1.6904460191726685, + 0.7950048856437206, + 0.9995888620615005, + 0.17088576592504978, + 0.9108665287494659, + 0.2566585801541805, + 1.5610447451472282, + 0.12556836754083633, + 0.3011860176920891, + 0.08933893591165543, + 0.8399856500327587, + 0.3541194275021553, + 0.6239525489509106, + 0.5239843428134918, + 0.2519334200769663, + 0.48918723687529564, + 0.09643347561359406, + 0.6406879965215921, + 0.050761401653289795, + 0.26833980344235897, + 0.47902943566441536, + 0.16090825572609901, + 0.1218879371881485, + 1.43644530326128, + 2.298695031553507, + 0.3421688750386238, + 1.716969158500433, + 0.3194205593317747, + 0.5186364278197289, + 0.11658967286348343, + 1.8833801541477442, + 3.1333157694898546, + 0.8270675837993622, + 1.051422394812107, + 0.27349921566201374, + 0.12229512818157673, + 3.254192505031824, + 0.09335514903068542 + ], + "unique_experts": 63, + "load_cv": 0.8004235078439089, + "normalized_load_entropy": 0.9274297935289453, + "max_load_share": 0.05734767025089606 + } + }, + "s0_bos": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "0807389118ef185e8042a525fd10d77e0101f5a6e43161a9b35c21ddd3673179", + "route_weight_sha256": "f4ab02af0de1222c23f355fda8b045df8fc1d11d81bf7470fef4c8f9a9bf6737", + "loads": [ + 2, + 5, + 7, + 3, + 4, + 1, + 3, + 0, + 0, + 1, + 4, + 18, + 4, + 0, + 6, + 3, + 9, + 13, + 0, + 1, + 3, + 6, + 0, + 5, + 1, + 6, + 4, + 6, + 11, + 2, + 1, + 4, + 14, + 2, + 0, + 1, + 3, + 2, + 4, + 7, + 2, + 11, + 0, + 10, + 0, + 7, + 7, + 1, + 3, + 5, + 23, + 5, + 8, + 4, + 5, + 0, + 3, + 16, + 4, + 12, + 1, + 2, + 16, + 1 + ], + "weighted_loads": [ + 0.08294681832194328, + 0.6490873321890831, + 0.5028251707553864, + 0.1673918515443802, + 0.3569229170680046, + 0.04422531649470329, + 0.36645936220884323, + 0.0, + 0.0, + 0.08377326279878616, + 0.3290395401418209, + 2.3957665264606476, + 0.4632607102394104, + 0.0, + 0.33044164068996906, + 0.19138452783226967, + 0.5931205917149782, + 0.8794269971549511, + 0.0, + 0.03306081146001816, + 0.2939295284450054, + 0.33757924288511276, + 0.0, + 0.3014288544654846, + 0.08079665899276733, + 0.2722351737320423, + 0.16166634485125542, + 0.34862662106752396, + 0.9482196792960167, + 0.07282442972064018, + 0.03276001289486885, + 0.20589111559092999, + 1.3910707905888557, + 0.0824563056230545, + 0.0, + 0.09012234956026077, + 0.1512712985277176, + 0.0570404976606369, + 0.2723948247730732, + 0.5711402073502541, + 0.1715059094130993, + 0.5921513456851244, + 0.0, + 0.4402705915272236, + 0.0, + 0.3405282711610198, + 0.2726529464125633, + 0.05632033199071884, + 0.0952246617525816, + 0.25347187742590904, + 1.939314216375351, + 0.2313548419624567, + 0.8005195111036301, + 0.16576486825942993, + 0.2696038708090782, + 0.0, + 0.2016859445720911, + 2.3995523527264595, + 0.2354349121451378, + 0.8756783995777369, + 0.024524079635739326, + 0.09305505268275738, + 3.240949459373951, + 0.05998958647251129 + ], + "unique_experts": 55, + "load_cv": 1.0026263997957514, + "normalized_load_entropy": 0.8887196195097917, + "max_load_share": 0.07371794871794872 + }, + "full_input": { + "tokens": 77, + "top_k": 6, + "decisions": 462, + "ordered_route_sha256": "a386df6c9a78c59eae967e9a85919601727d8cd7c230446e34aec17faebd8985", + "route_weight_sha256": "c87fb036c39e528da8aa38538e28b67ad6e4b3fdaf0edde6542ae457575a88c7", + "loads": [ + 3, + 6, + 7, + 3, + 4, + 1, + 3, + 2, + 0, + 7, + 7, + 22, + 5, + 1, + 19, + 5, + 9, + 23, + 0, + 2, + 3, + 7, + 1, + 5, + 8, + 6, + 11, + 15, + 11, + 2, + 9, + 4, + 15, + 3, + 3, + 1, + 9, + 2, + 4, + 7, + 2, + 12, + 2, + 13, + 2, + 7, + 10, + 2, + 4, + 5, + 32, + 6, + 14, + 4, + 6, + 0, + 17, + 23, + 10, + 13, + 1, + 2, + 17, + 3 + ], + "weighted_loads": [ + 0.11030150763690472, + 0.7663272470235825, + 0.5028251707553864, + 0.1673918515443802, + 0.3569229170680046, + 0.04422531649470329, + 0.36645936220884323, + 0.15344535186886787, + 0.0, + 0.4616813398897648, + 0.5674900598824024, + 2.69709993340075, + 0.5988823920488358, + 0.06319233775138855, + 0.9152288790792227, + 0.3083426207304001, + 0.5931205917149782, + 1.3837512210011482, + 0.0, + 0.09272236004471779, + 0.2939295284450054, + 0.3698415160179138, + 0.03318583592772484, + 0.3014288544654846, + 0.43496723286807537, + 0.2722351737320423, + 1.3115769289433956, + 0.7654555533081293, + 0.9482196792960167, + 0.07282442972064018, + 0.7567207477986813, + 0.20589111559092999, + 1.4293082989752293, + 0.1270410418510437, + 0.21905695647001266, + 0.09012234956026077, + 0.452830383554101, + 0.0570404976606369, + 0.2723948247730732, + 0.5711402073502541, + 0.1715059094130993, + 0.8752541560679674, + 0.10820915922522545, + 0.5920684561133385, + 0.1168924979865551, + 0.3405282711610198, + 0.43533747643232346, + 0.0842813141644001, + 0.1631339844316244, + 0.25347187742590904, + 2.3176273610442877, + 0.41758481599390507, + 1.3399092089384794, + 0.16576486825942993, + 0.31606846302747726, + 0.0, + 1.2420782819390297, + 2.786269186064601, + 0.4732120856642723, + 0.9242056291550398, + 0.024524079635739326, + 0.09305505268275738, + 3.281868740916252, + 0.17654448747634888 + ], + "unique_experts": 61, + "load_cv": 0.911180858843778, + "normalized_load_entropy": 0.910565248566711, + "max_load_share": 0.06926406926406926 + } + }, + "s1_bos": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "95129b343185264e1cf39564176039fa89e4e4f35233a2b800ea63d906e31551", + "route_weight_sha256": "c4408fdb5aa39301b5ab65ed36d75bae6bdfbe8a14e581b99a00f434a4534764", + "loads": [ + 3, + 6, + 7, + 4, + 4, + 2, + 3, + 1, + 0, + 2, + 4, + 17, + 4, + 0, + 5, + 3, + 9, + 13, + 0, + 1, + 3, + 6, + 0, + 6, + 1, + 5, + 4, + 6, + 11, + 3, + 1, + 2, + 12, + 1, + 0, + 1, + 4, + 1, + 4, + 7, + 3, + 13, + 0, + 10, + 0, + 6, + 6, + 1, + 3, + 7, + 23, + 4, + 7, + 4, + 5, + 0, + 2, + 16, + 4, + 12, + 1, + 2, + 16, + 1 + ], + "weighted_loads": [ + 0.1271822601556778, + 0.681903038173914, + 0.49425267800688744, + 0.19689624570310116, + 0.3570767566561699, + 0.0835363157093525, + 0.3565250039100647, + 0.05433426797389984, + 0.0, + 0.08981553092598915, + 0.3347577303647995, + 2.326556146144867, + 0.45911359041929245, + 0.0, + 0.29886284843087196, + 0.19860685244202614, + 0.5818972326815128, + 0.8902599588036537, + 0.0, + 0.03160214424133301, + 0.3091198280453682, + 0.3345348499715328, + 0.0, + 0.3436241187155247, + 0.07878562062978745, + 0.2625261414796114, + 0.15132677555084229, + 0.34689993783831596, + 0.9646505452692509, + 0.10306278616189957, + 0.033179327845573425, + 0.14542124420404434, + 1.2692862898111343, + 0.030995458364486694, + 0.0, + 0.09688080102205276, + 0.18676303885877132, + 0.027093520388007164, + 0.2803717851638794, + 0.5504020377993584, + 0.22939372807741165, + 0.6847556289285421, + 0.0, + 0.4394525922834873, + 0.0, + 0.2892128424718976, + 0.23441296629607677, + 0.06200110912322998, + 0.09570052102208138, + 0.2964955708011985, + 1.9078030735254288, + 0.18384519591927528, + 0.6604745462536812, + 0.16441116482019424, + 0.2813795506954193, + 0.0, + 0.17525462619960308, + 2.4190034195780754, + 0.2425430752336979, + 0.9200039990246296, + 0.02389362081885338, + 0.09649272449314594, + 3.1235623583197594, + 0.050672534853219986 + ], + "unique_experts": 56, + "load_cv": 0.9854296846449043, + "normalized_load_entropy": 0.8929947066007394, + "max_load_share": 0.07371794871794872 + }, + "full_input": { + "tokens": 93, + "top_k": 6, + "decisions": 558, + "ordered_route_sha256": "fc961354eac77febf2ccf998d9e497e513dd4f26856e81e301a798fb4e52334e", + "route_weight_sha256": "c79239cf034bd8036a309b7e268dd61769448cc081bf8acf02af04597b03fb64", + "loads": [ + 3, + 7, + 7, + 4, + 7, + 2, + 3, + 3, + 0, + 11, + 12, + 23, + 5, + 1, + 18, + 8, + 9, + 19, + 0, + 2, + 3, + 12, + 7, + 6, + 10, + 7, + 17, + 16, + 11, + 6, + 12, + 3, + 15, + 3, + 6, + 1, + 17, + 6, + 7, + 8, + 4, + 13, + 3, + 14, + 2, + 7, + 10, + 3, + 4, + 9, + 31, + 5, + 18, + 6, + 8, + 2, + 20, + 25, + 14, + 16, + 3, + 2, + 19, + 3 + ], + "weighted_loads": [ + 0.1271822601556778, + 0.7951262034475803, + 0.49425267800688744, + 0.19689624570310116, + 0.5424344204366207, + 0.0835363157093525, + 0.3565250039100647, + 0.21316127479076385, + 0.0, + 0.651349313557148, + 1.12215219065547, + 2.9380299486219883, + 0.5918429419398308, + 0.0578378364443779, + 1.0184785388410091, + 0.5150295309722424, + 0.5818972326815128, + 1.294900093227625, + 0.0, + 0.09429009258747101, + 0.3091198280453682, + 0.6808600835502148, + 0.48607100173830986, + 0.3436241187155247, + 0.523268960416317, + 0.36788281612098217, + 1.8342138715088367, + 0.7410495691001415, + 0.9646505452692509, + 0.20450240187346935, + 1.0483786091208458, + 0.22532740235328674, + 1.4000088013708591, + 0.1200297512114048, + 0.370980903506279, + 0.09688080102205276, + 0.8560966476798058, + 0.32325332053005695, + 0.5718465857207775, + 0.5847710818052292, + 0.2599999401718378, + 0.6847556289285421, + 0.1444934532046318, + 0.6344668008387089, + 0.08397788926959038, + 0.30631456803530455, + 0.4862057399004698, + 0.14451275020837784, + 0.12872393056750298, + 0.4519080324098468, + 2.218416579067707, + 0.3550044186413288, + 1.5270047802478075, + 0.35349127277731895, + 0.49388784170150757, + 0.11658967286348343, + 1.8586160447448492, + 3.189929571002722, + 0.8193407915532589, + 1.1035331673920155, + 0.26462751254439354, + 0.09649272449314594, + 3.2497916147112846, + 0.17686669155955315 + ], + "unique_experts": 62, + "load_cv": 0.7663129377461003, + "normalized_load_entropy": 0.9315216964640815, + "max_load_share": 0.05555555555555555 + } + }, + "s0_x": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "b0356bd02bb124509e247382d1942f51d291d15751a1ce681a43c953cb577bd2", + "route_weight_sha256": "904e31a0c27fa8fdbe082f0c72b500115f7b4b0134c122ab171cfa8c80f72121", + "loads": [ + 1, + 5, + 6, + 4, + 4, + 1, + 3, + 1, + 0, + 3, + 6, + 18, + 4, + 0, + 6, + 4, + 9, + 13, + 0, + 1, + 3, + 4, + 0, + 5, + 1, + 5, + 4, + 6, + 11, + 3, + 1, + 3, + 12, + 1, + 0, + 1, + 3, + 2, + 4, + 7, + 2, + 11, + 0, + 10, + 0, + 7, + 7, + 1, + 1, + 6, + 24, + 4, + 8, + 4, + 6, + 0, + 3, + 17, + 5, + 11, + 1, + 2, + 16, + 1 + ], + "weighted_loads": [ + 0.06210179626941681, + 0.6360365487635136, + 0.4803726598620415, + 0.20044254325330257, + 0.36066119372844696, + 0.051284994930028915, + 0.35742004215717316, + 0.04830560088157654, + 0.0, + 0.13510276190936565, + 0.3856308478862047, + 2.381468504667282, + 0.4443298950791359, + 0.0, + 0.31219032127410173, + 0.2191210724413395, + 0.5895488820970058, + 0.8519303873181343, + 0.0, + 0.030219724401831627, + 0.3011842593550682, + 0.2680370435118675, + 0.0, + 0.27579930797219276, + 0.08090288937091827, + 0.2530334424227476, + 0.17095449939370155, + 0.338922593742609, + 0.9707485549151897, + 0.09975695237517357, + 0.03347102552652359, + 0.17354292422533035, + 1.2532041668891907, + 0.048522427678108215, + 0.0, + 0.09246932715177536, + 0.15741203352808952, + 0.05677572079002857, + 0.2772790901362896, + 0.522418113425374, + 0.16872654668986797, + 0.6010131370276213, + 0.0, + 0.4354896266013384, + 0.0, + 0.29961069487035275, + 0.2738840840756893, + 0.06546405702829361, + 0.02971271425485611, + 0.3141580503433943, + 1.9876306541264057, + 0.21031387150287628, + 0.7860489375889301, + 0.15841566398739815, + 0.3305683694779873, + 0.0, + 0.21498387679457664, + 2.39927333407104, + 0.2781015746295452, + 0.8895334433764219, + 0.025210706517100334, + 0.09085889719426632, + 3.23396036028862, + 0.0562913715839386 + ], + "unique_experts": 56, + "load_cv": 1.005899756201694, + "normalized_load_entropy": 0.8897916027868912, + "max_load_share": 0.07692307692307693 + }, + "full_input": { + "tokens": 77, + "top_k": 6, + "decisions": 462, + "ordered_route_sha256": "389f4d2ec890c24e1febf7ee008a1c269c623601c468c35c124afc3bcf8b9d87", + "route_weight_sha256": "2dda3556521470fe1f78c168c8fe25334a0484f7abb99136defaabc75d798509", + "loads": [ + 1, + 6, + 6, + 4, + 4, + 1, + 3, + 3, + 0, + 8, + 10, + 24, + 5, + 1, + 21, + 6, + 9, + 25, + 0, + 2, + 3, + 5, + 0, + 5, + 8, + 5, + 9, + 16, + 11, + 4, + 7, + 3, + 14, + 1, + 2, + 1, + 9, + 2, + 4, + 7, + 2, + 11, + 1, + 15, + 0, + 7, + 10, + 2, + 1, + 6, + 32, + 5, + 14, + 4, + 7, + 0, + 20, + 25, + 11, + 12, + 1, + 2, + 17, + 2 + ], + "weighted_loads": [ + 0.06210179626941681, + 0.7448426820337772, + 0.4803726598620415, + 0.20044254325330257, + 0.36066119372844696, + 0.051284994930028915, + 0.35742004215717316, + 0.17307068035006523, + 0.0, + 0.47674799896776676, + 0.696825111284852, + 2.829577447846532, + 0.5657636672258377, + 0.06319233775138855, + 1.0574128339067101, + 0.31471920385956764, + 0.5895488820970058, + 1.4989918023347855, + 0.0, + 0.08709058724343777, + 0.3011842593550682, + 0.3002993166446686, + 0.0, + 0.27579930797219276, + 0.4492658004164696, + 0.2530334424227476, + 1.1069863215088844, + 0.7273633573204279, + 0.9707485549151897, + 0.146438367664814, + 0.6111689805984497, + 0.17354292422533035, + 1.3238021172583103, + 0.048522427678108215, + 0.14627210050821304, + 0.09246932715177536, + 0.45485793985426426, + 0.05677572079002857, + 0.2772790901362896, + 0.522418113425374, + 0.16872654668986797, + 0.6010131370276213, + 0.04473019391298294, + 0.6809527669101954, + 0.0, + 0.29961069487035275, + 0.44337281212210655, + 0.10082565620541573, + 0.02971271425485611, + 0.3141580503433943, + 2.3368641436100006, + 0.3821726143360138, + 1.2968000881373882, + 0.15841566398739815, + 0.37703296169638634, + 0.0, + 1.4044028613716364, + 2.8949388451874256, + 0.5158787481486797, + 0.9380606729537249, + 0.025210706517100334, + 0.09085889719426632, + 3.274879641830921, + 0.1028541699051857 + ], + "unique_experts": 59, + "load_cv": 0.9815199925875318, + "normalized_load_entropy": 0.8950153803113075, + "max_load_share": 0.06926406926406926 + } + }, + "s1_x": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "36ba01d170523ed11ef86be483093947c097e2bc628c4d6b07980c7cb11c29ba", + "route_weight_sha256": "ba2ba574bd918b16829d12f84aaee26ef976e359865b154b259ff0166ee94d4e", + "loads": [ + 1, + 6, + 6, + 4, + 4, + 1, + 3, + 1, + 0, + 1, + 5, + 17, + 4, + 0, + 5, + 4, + 8, + 12, + 0, + 0, + 4, + 4, + 1, + 6, + 1, + 6, + 4, + 6, + 11, + 3, + 1, + 4, + 13, + 1, + 0, + 1, + 4, + 1, + 5, + 6, + 3, + 10, + 0, + 9, + 0, + 5, + 7, + 1, + 1, + 8, + 24, + 5, + 7, + 3, + 6, + 0, + 3, + 16, + 5, + 13, + 1, + 3, + 17, + 1 + ], + "weighted_loads": [ + 0.04774203523993492, + 0.6641904283314943, + 0.45311306044459343, + 0.20249053835868835, + 0.3445315286517143, + 0.04632473364472389, + 0.3541870564222336, + 0.05553975701332092, + 0.0, + 0.04847213253378868, + 0.3438925724476576, + 2.285690449178219, + 0.4374077469110489, + 0.0, + 0.27469318732619286, + 0.22497305646538734, + 0.5424665957689285, + 0.8345962315797806, + 0.0, + 0.0, + 0.33225133642554283, + 0.26692963019013405, + 0.046433866024017334, + 0.3350096084177494, + 0.07562575489282608, + 0.2976258657872677, + 0.14016008749604225, + 0.3518734835088253, + 0.9173704721033573, + 0.10561633855104446, + 0.03478693589568138, + 0.2116485144942999, + 1.231006445363164, + 0.030353769659996033, + 0.0, + 0.10011640936136246, + 0.1929960958659649, + 0.02375367283821106, + 0.3059740588068962, + 0.4853072203695774, + 0.2027940135449171, + 0.6218003816902637, + 0.0, + 0.3888293318450451, + 0.0, + 0.23896654322743416, + 0.28094660490751266, + 0.07275936752557755, + 0.02925558015704155, + 0.32850573025643826, + 1.9417049158364534, + 0.19436854124069214, + 0.6699530705809593, + 0.11331236734986305, + 0.30140845850110054, + 0.0, + 0.19060330651700497, + 2.3726824149489403, + 0.2852410078048706, + 1.0013000927865505, + 0.027498343959450722, + 0.14442998729646206, + 3.1957566514611244, + 0.04717516899108887 + ], + "unique_experts": 56, + "load_cv": 0.997366684039832, + "normalized_load_entropy": 0.8904598063137386, + "max_load_share": 0.07692307692307693 + }, + "full_input": { + "tokens": 93, + "top_k": 6, + "decisions": 558, + "ordered_route_sha256": "045b43d6c29b542ca120ce84944d74ceffb1a52793cf3b3f80cae81c5fd6731f", + "route_weight_sha256": "a7c3f2c288596a03edea90fa558751865cb5e9c6642c65593a7d5fd45e5e0d64", + "loads": [ + 1, + 7, + 6, + 7, + 7, + 2, + 3, + 2, + 0, + 9, + 12, + 25, + 5, + 1, + 21, + 9, + 8, + 18, + 0, + 1, + 4, + 10, + 7, + 6, + 10, + 8, + 16, + 17, + 11, + 7, + 9, + 5, + 16, + 1, + 5, + 1, + 17, + 6, + 8, + 7, + 4, + 11, + 2, + 13, + 1, + 6, + 10, + 3, + 2, + 10, + 31, + 6, + 16, + 5, + 9, + 2, + 23, + 27, + 16, + 18, + 3, + 3, + 20, + 2 + ], + "weighted_loads": [ + 0.04774203523993492, + 0.7604546416550875, + 0.45311306044459343, + 0.3025965355336666, + 0.5298891924321651, + 0.07882372662425041, + 0.3541870564222336, + 0.14470411837100983, + 0.0, + 0.5591916926205158, + 1.1044937018305063, + 3.051022198051214, + 0.5580271705985069, + 0.0578378364443779, + 1.2134528793394566, + 0.533420167863369, + 0.5424665957689285, + 1.2546332478523254, + 0.0, + 0.06617140769958496, + 0.33225133642554283, + 0.613254863768816, + 0.49652106687426567, + 0.3350096084177494, + 0.5132921114563942, + 0.40298254042863846, + 1.5904085002839565, + 0.7909885309636593, + 0.9173704721033573, + 0.28486509434878826, + 0.8842782415449619, + 0.2915546726435423, + 1.3617289569228888, + 0.030353769659996033, + 0.3011860176920891, + 0.10011640936136246, + 0.8610208164900541, + 0.31991347298026085, + 0.5974488593637943, + 0.5196762643754482, + 0.23340022563934326, + 0.6546081081032753, + 0.08547252789139748, + 0.5838435404002666, + 0.03773481398820877, + 0.2560682687908411, + 0.4879780523478985, + 0.19105667248368263, + 0.06227898970246315, + 0.48391819186508656, + 2.223797833546996, + 0.2721928656101227, + 1.4386723898351192, + 0.30239247530698776, + 0.5139167495071888, + 0.11658967286348343, + 1.9661498237401247, + 3.297989532351494, + 0.9288190230727196, + 1.23052679002285, + 0.2682322356849909, + 0.14442998729646206, + 3.3219859078526497, + 0.0911768451333046 + ], + "unique_experts": 62, + "load_cv": 0.8126563379488165, + "normalized_load_entropy": 0.9230131332735014, + "max_load_share": 0.05555555555555555 + } + }, + "s0_period": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "6d4869ad2d402543d3f2f30d942923328de38f5aa5139d8d80a716fe1d6b4026", + "route_weight_sha256": "97d3093ca2a5ce87d534609ea4ba995e7d389ab34ca4eb5a247f20b7fc2cfcd1", + "loads": [ + 1, + 5, + 6, + 4, + 4, + 1, + 3, + 0, + 0, + 2, + 5, + 18, + 4, + 0, + 5, + 4, + 9, + 12, + 0, + 1, + 3, + 6, + 0, + 5, + 1, + 6, + 5, + 6, + 11, + 2, + 1, + 3, + 13, + 2, + 0, + 1, + 3, + 2, + 5, + 7, + 3, + 10, + 0, + 11, + 0, + 6, + 6, + 1, + 2, + 7, + 23, + 4, + 8, + 3, + 6, + 0, + 2, + 17, + 3, + 12, + 2, + 2, + 17, + 1 + ], + "weighted_loads": [ + 0.057562876492738724, + 0.6318277977406979, + 0.4783603362739086, + 0.2013497781008482, + 0.35107193142175674, + 0.05180812254548073, + 0.351834200322628, + 0.0, + 0.0, + 0.10680202022194862, + 0.3456117585301399, + 2.385296393185854, + 0.4358416832983494, + 0.0, + 0.30745940189808607, + 0.20822364278137684, + 0.5815066173672676, + 0.8239629417657852, + 0.0, + 0.029639555141329765, + 0.3007967099547386, + 0.3255408722907305, + 0.0, + 0.26762405782938004, + 0.08313052356243134, + 0.299618698656559, + 0.20029861107468605, + 0.3436633050441742, + 0.9496559612452984, + 0.07108554989099503, + 0.034696467220783234, + 0.1723693571984768, + 1.3846729323267937, + 0.08225912787020206, + 0.0, + 0.09066133946180344, + 0.15275462344288826, + 0.057444093748927116, + 0.3112056367099285, + 0.5255003795027733, + 0.22831843607127666, + 0.5967931151390076, + 0.0, + 0.46301891654729843, + 0.0, + 0.32944586500525475, + 0.24474023841321468, + 0.0579720176756382, + 0.0657736323773861, + 0.32171649392694235, + 1.9425336141139269, + 0.1916323695331812, + 0.81809426471591, + 0.12320638075470924, + 0.3123978264629841, + 0.0, + 0.1734202615916729, + 2.4335818365216255, + 0.20306801423430443, + 0.9353181775659323, + 0.05444636195898056, + 0.09375968761742115, + 3.236056212335825, + 0.06100936606526375 + ], + "unique_experts": 55, + "load_cv": 1.0052459376365466, + "normalized_load_entropy": 0.8889726567528632, + "max_load_share": 0.07371794871794872 + }, + "full_input": { + "tokens": 77, + "top_k": 6, + "decisions": 462, + "ordered_route_sha256": "183144a99320df4961e6cb594c60f76261365de29a8001099b48d90ce2cfd4cd", + "route_weight_sha256": "363d52434a5275657128928792e896d01c0410a7e7ed1329ccaa0965d364c28a", + "loads": [ + 1, + 6, + 6, + 4, + 4, + 1, + 3, + 2, + 0, + 7, + 9, + 22, + 5, + 1, + 20, + 5, + 9, + 23, + 0, + 2, + 3, + 7, + 0, + 5, + 9, + 6, + 11, + 13, + 11, + 2, + 8, + 3, + 16, + 4, + 2, + 1, + 10, + 2, + 5, + 7, + 3, + 10, + 1, + 14, + 1, + 7, + 9, + 2, + 2, + 7, + 32, + 5, + 15, + 3, + 7, + 0, + 18, + 24, + 9, + 13, + 2, + 2, + 18, + 3 + ], + "weighted_loads": [ + 0.057562876492738724, + 0.7481883950531483, + 0.4783603362739086, + 0.2013497781008482, + 0.35107193142175674, + 0.05180812254548073, + 0.351834200322628, + 0.1338467188179493, + 0.0, + 0.4461591802537441, + 0.668447345495224, + 2.6866298001259565, + 0.5637743957340717, + 0.06319233775138855, + 0.9677800415083766, + 0.26706126146018505, + 0.5815066173672676, + 1.429653026163578, + 0.0, + 0.0867909099906683, + 0.3007967099547386, + 0.35780314542353153, + 0.0, + 0.26762405782938004, + 0.5399490036070347, + 0.299618698656559, + 1.1894555129110813, + 0.6318150367587805, + 0.9496559612452984, + 0.07108554989099503, + 0.649986457079649, + 0.1723693571984768, + 1.4901462942361832, + 0.16104786284267902, + 0.14627210050821304, + 0.09066133946180344, + 0.516780074685812, + 0.057444093748927116, + 0.3112056367099285, + 0.5255003795027733, + 0.22831843607127666, + 0.5967931151390076, + 0.04471088945865631, + 0.6148167811334133, + 0.03507543355226517, + 0.36027752608060837, + 0.40560263954102993, + 0.10036181285977364, + 0.0657736323773861, + 0.32171649392694235, + 2.3207001332193613, + 0.36776562966406345, + 1.4011354576796293, + 0.12320638075470924, + 0.35886241868138313, + 0.0, + 1.3879873771220446, + 2.820298669859767, + 0.44084518775343895, + 0.9838454071432352, + 0.05444636195898056, + 0.09375968761742115, + 3.276975493878126, + 0.19481931254267693 + ], + "unique_experts": 60, + "load_cv": 0.9361765878825057, + "normalized_load_entropy": 0.9041982223506743, + "max_load_share": 0.06926406926406926 + } + }, + "s1_period": { + "target_content": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "d16b0770219acac3bc93a23945950b52de12450ae5930b68cf5d4495850f0850", + "route_weight_sha256": "e2934f1095e5e8ae15aebc6a39065d4ff2b5a32120663596b4906713755fa726", + "loads": [ + 1, + 5, + 7, + 4, + 4, + 1, + 3, + 1, + 0, + 1, + 5, + 18, + 4, + 0, + 5, + 3, + 8, + 12, + 0, + 1, + 3, + 5, + 1, + 6, + 1, + 8, + 4, + 6, + 11, + 4, + 1, + 4, + 11, + 1, + 0, + 1, + 5, + 1, + 5, + 6, + 3, + 13, + 0, + 9, + 0, + 5, + 7, + 1, + 1, + 7, + 24, + 4, + 6, + 4, + 6, + 0, + 2, + 16, + 5, + 12, + 1, + 2, + 16, + 1 + ], + "weighted_loads": [ + 0.05057630315423012, + 0.6392990723252296, + 0.4830997958779335, + 0.2042632047086954, + 0.34884626418352127, + 0.04968707263469696, + 0.3502591401338577, + 0.05941864848136902, + 0.0, + 0.06280635297298431, + 0.3438353296369314, + 2.3447478748857975, + 0.46121006458997726, + 0.0, + 0.2824100134894252, + 0.1890021748840809, + 0.5655890963971615, + 0.824939414858818, + 0.0, + 0.037189923226833344, + 0.3025056794285774, + 0.29136000387370586, + 0.04945332929491997, + 0.34770938754081726, + 0.07314706593751907, + 0.3743203841149807, + 0.15111646801233292, + 0.32201195508241653, + 0.9193032402545214, + 0.1377310138195753, + 0.033968523144721985, + 0.20482108741998672, + 1.0836793519556522, + 0.02937803976237774, + 0.0, + 0.09630893915891647, + 0.2365044318139553, + 0.02362300269305706, + 0.30348172038793564, + 0.4796322751790285, + 0.2217659205198288, + 0.682489488273859, + 0.0, + 0.384887358173728, + 0.0, + 0.2353607378900051, + 0.2806385401636362, + 0.057599570602178574, + 0.02940019965171814, + 0.2972904099151492, + 1.9122151359915733, + 0.1661153957247734, + 0.5669490322470665, + 0.14437034353613853, + 0.3147427998483181, + 0.0, + 0.16069281473755836, + 2.391776442527771, + 0.3000958077609539, + 0.9548077546060085, + 0.027494417503476143, + 0.09463071264326572, + 3.1462965607643127, + 0.05024224519729614 + ], + "unique_experts": 57, + "load_cv": 0.997366684039832, + "normalized_load_entropy": 0.891434884122124, + "max_load_share": 0.07692307692307693 + }, + "full_input": { + "tokens": 93, + "top_k": 6, + "decisions": 558, + "ordered_route_sha256": "543822a2a70c5a7270bec7c4975bc65bb7cbf3fd7e378132f72886b13a2b9914", + "route_weight_sha256": "a2f49947da38826d92518017df96fe08e90fc5a9320130772a5f73fd60ad5d6a", + "loads": [ + 1, + 6, + 7, + 6, + 7, + 1, + 3, + 2, + 0, + 9, + 13, + 24, + 5, + 1, + 20, + 8, + 8, + 18, + 0, + 2, + 3, + 11, + 7, + 6, + 11, + 10, + 15, + 17, + 11, + 7, + 10, + 5, + 15, + 1, + 5, + 1, + 19, + 7, + 8, + 7, + 4, + 13, + 3, + 13, + 1, + 6, + 11, + 3, + 2, + 9, + 32, + 5, + 16, + 6, + 10, + 2, + 22, + 25, + 15, + 16, + 3, + 2, + 19, + 3 + ], + "weighted_loads": [ + 0.05057630315423012, + 0.7349297627806664, + 0.4830997958779335, + 0.2693753745406866, + 0.5342039279639721, + 0.04968707263469696, + 0.3502591401338577, + 0.14858300983905792, + 0.0, + 0.5710194446146488, + 1.1522073093801737, + 2.956221677362919, + 0.5747601166367531, + 0.0578378364443779, + 1.169146399013698, + 0.4898543171584606, + 0.5655890963971615, + 1.3085441924631596, + 0.0, + 0.10122870653867722, + 0.3025056794285774, + 0.6376852374523878, + 0.4995405301451683, + 0.34770938754081726, + 0.585748340934515, + 0.47967705875635147, + 1.5449944324791431, + 0.7532551363110542, + 0.9193032402545214, + 0.2391706295311451, + 0.916868744418025, + 0.2847272455692291, + 1.2446560058742762, + 0.02937803976237774, + 0.3011860176920891, + 0.09630893915891647, + 0.9606798682361841, + 0.3522829543799162, + 0.5949565209448338, + 0.5140013191848993, + 0.25237213261425495, + 0.682489488273859, + 0.11763495951890945, + 0.5799015667289495, + 0.05144709348678589, + 0.25246246345341206, + 0.536132050678134, + 0.1770809218287468, + 0.06242360919713974, + 0.4527028715237975, + 2.2278130762279034, + 0.24494558572769165, + 1.3909113183617592, + 0.33345045149326324, + 0.5665837377309799, + 0.11658967286348343, + 2.00122394785285, + 3.1627025939524174, + 0.8768935240805149, + 1.1383369229733944, + 0.2682283092290163, + 0.09463071264326572, + 3.272525817155838, + 0.17569123208522797 + ], + "unique_experts": 62, + "load_cv": 0.7957877182527611, + "normalized_load_entropy": 0.9250677978888524, + "max_load_share": 0.05734767025089606 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 52, + "ordered_topk_exact_tokens": 38, + "set_exact_tokens": 40, + "mean_set_jaccard": 0.9340659340659341, + "mean_token_weighted_tv": 0.019059610920241818, + "aggregate_load_tv": 0.03525641025641026 + }, + "system_bos": { + "tokens": 52, + "ordered_topk_exact_tokens": 27, + "set_exact_tokens": 36, + "mean_set_jaccard": 0.9079670329670328, + "mean_token_weighted_tv": 0.02587291522202297, + "aggregate_load_tv": 0.04487179487179487 + }, + "system_x": { + "tokens": 52, + "ordered_topk_exact_tokens": 20, + "set_exact_tokens": 31, + "mean_set_jaccard": 0.8722527472527474, + "mean_token_weighted_tv": 0.036094330851203546, + "aggregate_load_tv": 0.05448717948717948 + }, + "system_period": { + "tokens": 52, + "ordered_topk_exact_tokens": 19, + "set_exact_tokens": 32, + "mean_set_jaccard": 0.8704212454212453, + "mean_token_weighted_tv": 0.036708590359641954, + "aggregate_load_tv": 0.06089743589743589 + }, + "bos_at_s0": { + "tokens": 52, + "ordered_topk_exact_tokens": 25, + "set_exact_tokens": 35, + "mean_set_jaccard": 0.8983516483516484, + "mean_token_weighted_tv": 0.028063498688145325, + "aggregate_load_tv": 0.05448717948717949 + }, + "bos_at_s1": { + "tokens": 52, + "ordered_topk_exact_tokens": 19, + "set_exact_tokens": 25, + "mean_set_jaccard": 0.8516483516483516, + "mean_token_weighted_tv": 0.03645191767897744, + "aggregate_load_tv": 0.0576923076923077 + }, + "x_at_s0": { + "tokens": 52, + "ordered_topk_exact_tokens": 29, + "set_exact_tokens": 36, + "mean_set_jaccard": 0.907967032967033, + "mean_token_weighted_tv": 0.02572086822384825, + "aggregate_load_tv": 0.04807692307692309 + }, + "x_at_s1": { + "tokens": 52, + "ordered_topk_exact_tokens": 17, + "set_exact_tokens": 27, + "mean_set_jaccard": 0.8502747252747251, + "mean_token_weighted_tv": 0.038580393561950095, + "aggregate_load_tv": 0.05448717948717948 + }, + "period_at_s0": { + "tokens": 52, + "ordered_topk_exact_tokens": 24, + "set_exact_tokens": 37, + "mean_set_jaccard": 0.9175824175824178, + "mean_token_weighted_tv": 0.026823597413917575, + "aggregate_load_tv": 0.032051282051282055 + }, + "period_at_s1": { + "tokens": 52, + "ordered_topk_exact_tokens": 17, + "set_exact_tokens": 27, + "mean_set_jaccard": 0.8502747252747253, + "mean_token_weighted_tv": 0.03909466395942637, + "aggregate_load_tv": 0.05769230769230769 + } + } + } + } + }, + { + "id": "wikitext2/raw-validation/2909", + "domain": "english", + "label": "English encyclopedia", + "within_domain_index": 2, + "selection_rank": "00a0c873d028d892e454883e687d7af51aee2831fe2f7884668ca6dfe0d681c8", + "source_text_sha256": "0a2652ac9273b261bc16986c9fa848ca19ccab027dd1ca4a6e1f80f35b07ff4f", + "source_characters": 1135, + "source_tokens": 246, + "content_token_ids_sha256": "60cc9bc9e2f8d84a575d576ba1112dddb5b657c801d6b621212db1e9010c9ef1", + "prompt_tokens_by_condition": { + "s0_eos": 271, + "s1_eos": 287, + "s0_bos": 271, + "s1_bos": 287, + "s0_x": 271, + "s1_x": 287, + "s0_period": 271, + "s1_period": 287 + }, + "batch_prompt_tokens": 287, + "content_tokens": 246, + "boundary_crossing_tokens_by_condition": { + "s0_eos": 0, + "s1_eos": 0, + "s0_bos": 0, + "s1_bos": 0, + "s0_x": 0, + "s1_x": 0, + "s0_period": 0, + "s1_period": 0 + }, + "forward_seconds": 1.1603107929986436, + "peak_cuda_memory_allocated_bytes": 27895813632, + "hidden_stages": { + "embedding": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "aeed630fea398870b76d7a312d1de3529a7e2836d82beb23aa8bc10c728a41e4", + "mean": -0.0003571443958207965, + "std": 0.09687210619449615, + "rms": 0.09687276929616928, + "max_abs": 1.6875 + }, + "full_input": { + "shape": [ + 271, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "804fb2f5538e738faf3d2773c51a9dda35233541dc5b30f8fa46cdeede3c3da9", + "mean": -0.00041066837729886174, + "std": 0.09585794061422348, + "rms": 0.09585881978273392, + "max_abs": 2.046875 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "aeed630fea398870b76d7a312d1de3529a7e2836d82beb23aa8bc10c728a41e4", + "mean": -0.0003571443958207965, + "std": 0.09687210619449615, + "rms": 0.09687276929616928, + "max_abs": 1.6875 + }, + "full_input": { + "shape": [ + 287, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "744ef2ddafb9a3e27df13176e945b35769ea7629f97aaf2ce4af40c4a4470de4", + "mean": -0.0005102590657770634, + "std": 0.0963764637708664, + "rms": 0.09637781977653503, + "max_abs": 2.046875 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "aeed630fea398870b76d7a312d1de3529a7e2836d82beb23aa8bc10c728a41e4", + "mean": -0.0003571443958207965, + "std": 0.09687210619449615, + "rms": 0.09687276929616928, + "max_abs": 1.6875 + }, + "full_input": { + "shape": [ + 271, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8bf53db1d65679cd41ee9bf3a2849b1fbf891d828ef617f747992f3cfe2b8ca0", + "mean": -0.00040501082548871636, + "std": 0.095785953104496, + "rms": 0.09578680992126465, + "max_abs": 2.046875 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "aeed630fea398870b76d7a312d1de3529a7e2836d82beb23aa8bc10c728a41e4", + "mean": -0.0003571443958207965, + "std": 0.09687210619449615, + "rms": 0.09687276929616928, + "max_abs": 1.6875 + }, + "full_input": { + "shape": [ + 287, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "18147817d6a876b65b035936ea22baa84710ac68b95e0910563a044591444bc0", + "mean": -0.0005049169412814081, + "std": 0.0963088646531105, + "rms": 0.09631019085645676, + "max_abs": 2.046875 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "aeed630fea398870b76d7a312d1de3529a7e2836d82beb23aa8bc10c728a41e4", + "mean": -0.0003571443958207965, + "std": 0.09687210619449615, + "rms": 0.09687276929616928, + "max_abs": 1.6875 + }, + "full_input": { + "shape": [ + 271, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ff66486c6fa002d13ea7b7b36fce0587f54aedccf82aa556421b4d980c171372", + "mean": -0.00041889448766596615, + "std": 0.09583450853824615, + "rms": 0.09583543241024017, + "max_abs": 2.046875 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "aeed630fea398870b76d7a312d1de3529a7e2836d82beb23aa8bc10c728a41e4", + "mean": -0.0003571443958207965, + "std": 0.09687210619449615, + "rms": 0.09687276929616928, + "max_abs": 1.6875 + }, + "full_input": { + "shape": [ + 287, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2ebb217d1e902924b7ca62389c92f024048a2fb3c54bd58f8719598cfa37ec59", + "mean": -0.000518026587087661, + "std": 0.09635445475578308, + "rms": 0.0963558480143547, + "max_abs": 2.046875 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "aeed630fea398870b76d7a312d1de3529a7e2836d82beb23aa8bc10c728a41e4", + "mean": -0.0003571443958207965, + "std": 0.09687210619449615, + "rms": 0.09687276929616928, + "max_abs": 1.6875 + }, + "full_input": { + "shape": [ + 271, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ead36567f0facd81c1c6825c6de9eed842da7611c7433c698026d35455e7a73b", + "mean": -0.00041919387876987457, + "std": 0.09577925503253937, + "rms": 0.09578017890453339, + "max_abs": 2.046875 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "aeed630fea398870b76d7a312d1de3529a7e2836d82beb23aa8bc10c728a41e4", + "mean": -0.0003571443958207965, + "std": 0.09687210619449615, + "rms": 0.09687276929616928, + "max_abs": 1.6875 + }, + "full_input": { + "shape": [ + 287, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "776f85b75fbf767cfec6f187b1af3ee17ba5c2ff5cce18e064c1e6ee85d2964d", + "mean": -0.0005183092434890568, + "std": 0.0963025614619255, + "rms": 0.09630395472049713, + "max_abs": 2.046875 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 246, + "exact_hidden_rows": 246, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999999403953552, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "system_bos": { + "tokens": 246, + "exact_hidden_rows": 246, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999999403953552, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "system_x": { + "tokens": 246, + "exact_hidden_rows": 246, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999999403953552, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "system_period": { + "tokens": 246, + "exact_hidden_rows": 246, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999999403953552, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "bos_at_s0": { + "tokens": 246, + "exact_hidden_rows": 246, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999999403953552, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "bos_at_s1": { + "tokens": 246, + "exact_hidden_rows": 246, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999999403953552, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "x_at_s0": { + "tokens": 246, + "exact_hidden_rows": 246, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999999403953552, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "x_at_s1": { + "tokens": 246, + "exact_hidden_rows": 246, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999999403953552, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "period_at_s0": { + "tokens": 246, + "exact_hidden_rows": 246, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999999403953552, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "period_at_s1": { + "tokens": 246, + "exact_hidden_rows": 246, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999999403953552, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + } + } + }, + "layer_00": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2276db65f63572496f7855d38b399214236309bb661ba89e78fad192cda73113", + "mean": -0.0010382644832134247, + "std": 0.09116791188716888, + "rms": 0.09117382019758224, + "max_abs": 2.8125 + }, + "full_input": { + "shape": [ + 271, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fdf85953d1893d0db7960046b94238c5d40fe70a760ad56c0004fda247ed1541", + "mean": -0.0010818908922374249, + "std": 0.09098844230175018, + "rms": 0.09099487960338593, + "max_abs": 2.8125 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3a5178658d51a4215fd7da457c0f763ec647f68ef945f4395d7be6465092d01c", + "mean": -0.0010367205832153559, + "std": 0.09126549959182739, + "rms": 0.09127138555049896, + "max_abs": 2.84375 + }, + "full_input": { + "shape": [ + 287, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b99103fa06872ca03f0d7b0b07b4937802df02017dfb992c6de820dd3519d434", + "mean": -0.0011496421648189425, + "std": 0.0914839506149292, + "rms": 0.09149117022752762, + "max_abs": 2.84375 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "dd327120946c7b4654904b4616081b983799f5680ed6e5233524ac9ca40a2207", + "mean": -0.0009383479482494295, + "std": 0.0908798947930336, + "rms": 0.0908847376704216, + "max_abs": 2.75 + }, + "full_input": { + "shape": [ + 271, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "566fd4a3557de3f81c1cc9df508c5224ce099f6e30106dfcdd1de68e031fee03", + "mean": -0.0009827279718592763, + "std": 0.09062332659959793, + "rms": 0.09062866121530533, + "max_abs": 2.75 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "630623b3dae344449cb97b56f0a3be72b6824f83953596a6a3b341739fe15322", + "mean": -0.0009664310491643846, + "std": 0.09092869609594345, + "rms": 0.09093382954597473, + "max_abs": 2.78125 + }, + "full_input": { + "shape": [ + 287, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c6d43e3efc2fbe7afbb9cde95d31110b9926831af1ad6943944b41db409b2ae8", + "mean": -0.0010817776201292872, + "std": 0.091096431016922, + "rms": 0.09110286086797714, + "max_abs": 2.78125 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "77f79e5bc9354d5b64ac4b4576919ace73fa5c51cd1e088c0de7c60e2aac3584", + "mean": -0.0009355518268421292, + "std": 0.09056215733289719, + "rms": 0.09056698530912399, + "max_abs": 2.75 + }, + "full_input": { + "shape": [ + 271, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e5ca9800fc844382bc7a811c1634c746e3624dc8a0b65353497c3f2ff868e774", + "mean": -0.0009882005397230387, + "std": 0.0903860479593277, + "rms": 0.09039144963026047, + "max_abs": 2.75 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d6308cb1aab3dfae13437ef12e888696e4ad8cd75c8f3b12a15a70697620ede4", + "mean": -0.0009731625323183835, + "std": 0.09067956358194351, + "rms": 0.09068477898836136, + "max_abs": 2.796875 + }, + "full_input": { + "shape": [ + 287, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1a6efa750692b080b87f1e8910ec6af15883549a5afec9abbf2f9e3d157ef2f1", + "mean": -0.001096769468858838, + "std": 0.09094250947237015, + "rms": 0.09094913303852081, + "max_abs": 2.796875 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7b6e08658698b1368e26ecf2c7352981dd2e6ed7b26b68d5397be118277f8341", + "mean": -0.0009313956252299249, + "std": 0.09057260304689407, + "rms": 0.0905773937702179, + "max_abs": 2.75 + }, + "full_input": { + "shape": [ + 271, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0cddac07d87374b5ff16061246fa56b1575d8a2ae013de4dffb6a6b7671d7417", + "mean": -0.0009842280996963382, + "std": 0.09030834585428238, + "rms": 0.09031371027231216, + "max_abs": 2.75 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7332958c6ec203e2e2f499ef53bc0ad2dc3ecc4b96e5f6aa8885c1870b8937a7", + "mean": -0.0009690943406894803, + "std": 0.0906917005777359, + "rms": 0.09069687128067017, + "max_abs": 2.78125 + }, + "full_input": { + "shape": [ + 287, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "aaf06310128d0a75495d09b2a6bffe9dee45e0a76ea33edfd1fc1bfa6567a309", + "mean": -0.0010922044748440385, + "std": 0.09086188673973083, + "rms": 0.09086844325065613, + "max_abs": 2.78125 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9998815655708313, + "min_cosine_similarity": 0.9971545934677124, + "mean_relative_l2": 0.012137728743255138, + "max_abs_delta": 0.046875 + }, + "system_bos": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9997788667678833, + "min_cosine_similarity": 0.9949690103530884, + "mean_relative_l2": 0.0178928654640913, + "max_abs_delta": 0.078125 + }, + "system_x": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9997838139533997, + "min_cosine_similarity": 0.9965488910675049, + "mean_relative_l2": 0.01828017830848694, + "max_abs_delta": 0.0546875 + }, + "system_period": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9997928738594055, + "min_cosine_similarity": 0.9967182874679565, + "mean_relative_l2": 0.018011359497904778, + "max_abs_delta": 0.046875 + }, + "bos_at_s0": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9922809600830078, + "min_cosine_similarity": 0.9673882722854614, + "mean_relative_l2": 0.12131011486053467, + "max_abs_delta": 0.265625 + }, + "bos_at_s1": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9932620525360107, + "min_cosine_similarity": 0.970564603805542, + "mean_relative_l2": 0.11357307434082031, + "max_abs_delta": 0.28125 + }, + "x_at_s0": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9929507970809937, + "min_cosine_similarity": 0.9667832851409912, + "mean_relative_l2": 0.11549268662929535, + "max_abs_delta": 0.296875 + }, + "x_at_s1": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9938163161277771, + "min_cosine_similarity": 0.9705469012260437, + "mean_relative_l2": 0.10833925753831863, + "max_abs_delta": 0.3125 + }, + "period_at_s0": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9930164217948914, + "min_cosine_similarity": 0.9686399698257446, + "mean_relative_l2": 0.11515973508358002, + "max_abs_delta": 0.3125 + }, + "period_at_s1": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9938596487045288, + "min_cosine_similarity": 0.9717590808868408, + "mean_relative_l2": 0.10811060667037964, + "max_abs_delta": 0.328125 + } + } + }, + "layer_01": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b95ed5e62e7a58107893a8610fd952134838bba001bd214f5b5095383b816937", + "mean": -0.0014051853213459253, + "std": 0.1076931580901146, + "rms": 0.10770231485366821, + "max_abs": 3.015625 + }, + "full_input": { + "shape": [ + 271, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fc9efc410206271dba612a35d205e93858cdb11284f65c8905b47c4e1e369574", + "mean": -0.0024563646875321865, + "std": 0.49555978178977966, + "rms": 0.49556586146354675, + "max_abs": 126.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "30043ccb02b46b7540ed56523b37953e6e01cdc0cfe35de6c3e84b99c095622f", + "mean": -0.0014115149388089776, + "std": 0.10785450786352158, + "rms": 0.10786374658346176, + "max_abs": 3.03125 + }, + "full_input": { + "shape": [ + 287, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "62e4f4cbc7a31b2a04334d890e0f70c36db47e85dd2a812649cab1c4f884048a", + "mean": -0.00256127561442554, + "std": 0.49912509322166443, + "rms": 0.4991316795349121, + "max_abs": 135.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f590ae434e8d7ef039b4f913e52f35c6edcaa2384e9b2c1a692fddcc44e868c2", + "mean": -0.001499759266152978, + "std": 0.10775644332170486, + "rms": 0.10776688158512115, + "max_abs": 3.0 + }, + "full_input": { + "shape": [ + 271, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c45ac4bb8e76075c43f43b4b8ecc0ac6f429dc5299d17854cd0500367167e42d", + "mean": -0.001491109374910593, + "std": 0.10837147384881973, + "rms": 0.1083817332983017, + "max_abs": 4.6875 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1a3625be2eb57aeaf5ac4d4c03136d145ff3947284f3fc696219066c7a551db7", + "mean": -0.0015769709134474397, + "std": 0.10746166110038757, + "rms": 0.1074732318520546, + "max_abs": 3.03125 + }, + "full_input": { + "shape": [ + 287, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fc057df6c0c4d47e87638d1c20f0e1094fbc68a8e346ab7013b4ee9caa67a458", + "mean": -0.0016590026207268238, + "std": 0.10839764773845673, + "rms": 0.10841034352779388, + "max_abs": 4.6875 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c20351d28b7ac337972b9f6d56dd9e5ee57db4bbeb2e4affb2a4ff3740fae4e1", + "mean": -0.0014654542319476604, + "std": 0.10791540890932083, + "rms": 0.10792535543441772, + "max_abs": 3.03125 + }, + "full_input": { + "shape": [ + 271, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "601c66197c19b541e950e0bd834c38a037474aa893d0483f1c40524b36ba7f6d", + "mean": -0.0014591169310733676, + "std": 0.10852732509374619, + "rms": 0.10853713750839233, + "max_abs": 4.6875 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f613e88694a6d712a03911af73c59bf65d45b00904b98c5c31d6e0c62534d052", + "mean": -0.0015791535843163729, + "std": 0.10738490521907806, + "rms": 0.10739652067422867, + "max_abs": 3.078125 + }, + "full_input": { + "shape": [ + 287, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "edae79c4be3e2f14571a5f588c57444427c777b27e29707b1e8d102c0832ec17", + "mean": -0.0016627120785415173, + "std": 0.10836087912321091, + "rms": 0.10837364196777344, + "max_abs": 4.6875 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "44d54671f9d7d0dc2abe23f54a781c51415e47a5e278295d77491de47bdefaa2", + "mean": -0.001461053965613246, + "std": 0.1078815683722496, + "rms": 0.10789146274328232, + "max_abs": 3.03125 + }, + "full_input": { + "shape": [ + 271, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e875a78049f9f82fef5f8d88fc5b6de7bf4773cc102aea070748d0db62a5458f", + "mean": -0.001461779116652906, + "std": 0.1083712950348854, + "rms": 0.10838115960359573, + "max_abs": 4.6875 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "eacee7c4d98e8a9451f53c8e4e86eb9e593f545bbd36807a1a0454bb81a85197", + "mean": -0.0015767039731144905, + "std": 0.10739326477050781, + "rms": 0.10740483552217484, + "max_abs": 3.0625 + }, + "full_input": { + "shape": [ + 287, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "31e79eb58e8a04c5c895224785efcaffe696194f8571bb374c476074adbd1801", + "mean": -0.0016654644859954715, + "std": 0.10825257748365402, + "rms": 0.10826538503170013, + "max_abs": 4.6875 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9995661973953247, + "min_cosine_similarity": 0.9872837066650391, + "mean_relative_l2": 0.02453264594078064, + "max_abs_delta": 0.07958984375 + }, + "system_bos": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9978142976760864, + "min_cosine_similarity": 0.9851877689361572, + "mean_relative_l2": 0.060794759541749954, + "max_abs_delta": 0.09375 + }, + "system_x": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9970687627792358, + "min_cosine_similarity": 0.9763616919517517, + "mean_relative_l2": 0.06915482133626938, + "max_abs_delta": 0.109375 + }, + "system_period": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9971927404403687, + "min_cosine_similarity": 0.9772343635559082, + "mean_relative_l2": 0.06764031946659088, + "max_abs_delta": 0.109375 + }, + "bos_at_s0": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9919994473457336, + "min_cosine_similarity": 0.9675315022468567, + "mean_relative_l2": 0.12301760911941528, + "max_abs_delta": 0.1953125 + }, + "bos_at_s1": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9918623566627502, + "min_cosine_similarity": 0.957468569278717, + "mean_relative_l2": 0.12298060208559036, + "max_abs_delta": 0.24609375 + }, + "x_at_s0": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9930667877197266, + "min_cosine_similarity": 0.9604921340942383, + "mean_relative_l2": 0.1139802485704422, + "max_abs_delta": 0.291015625 + }, + "x_at_s1": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.991693913936615, + "min_cosine_similarity": 0.9417438507080078, + "mean_relative_l2": 0.12288616597652435, + "max_abs_delta": 0.328125 + }, + "period_at_s0": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9931595921516418, + "min_cosine_similarity": 0.9654178619384766, + "mean_relative_l2": 0.1134096086025238, + "max_abs_delta": 0.2890625 + }, + "period_at_s1": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9917362928390503, + "min_cosine_similarity": 0.9441958665847778, + "mean_relative_l2": 0.12275516986846924, + "max_abs_delta": 0.328125 + } + } + }, + "layer_02": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "32823fea3548bb7fb9bd626b25ed95e5e33c74b14ea071f72f20eda410692bff", + "mean": -0.001328810234554112, + "std": 0.12668560445308685, + "rms": 0.12669256329536438, + "max_abs": 3.78125 + }, + "full_input": { + "shape": [ + 271, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "25551cc42c518e78337304266166b53ef0b3effb1f7731e65ad8070a0f362e41", + "mean": -0.004814248066395521, + "std": 1.4635227918624878, + "rms": 1.4635305404663086, + "max_abs": 392.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "10f4733510e09c4f81ee26c21fec37f4073021ffb9e333a2c7daedbb0bfe899e", + "mean": -0.0012854156084358692, + "std": 0.12678363919258118, + "rms": 0.1267901510000229, + "max_abs": 3.65625 + }, + "full_input": { + "shape": [ + 287, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8420c85008096950162f9dc31bf9b7bb0dee3d84883a04de3c19c886a2e2fd34", + "mean": -0.005230136681348085, + "std": 1.5724964141845703, + "rms": 1.572505235671997, + "max_abs": 436.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2a223ce9e17e7df36d8ecf13cb04d13b114ba44e30cc868337b64992ead09a46", + "mean": -0.001318458584137261, + "std": 0.12794312834739685, + "rms": 0.12794992327690125, + "max_abs": 3.625 + }, + "full_input": { + "shape": [ + 271, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a2a34dfd04d25268ead9e2b6ead95da323852e17e46e728fd8246740100c3e07", + "mean": -0.001447609975002706, + "std": 0.1615089476108551, + "rms": 0.16151542961597443, + "max_abs": 23.75 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "abf393398aa8a1343fd9da689345015f0db6c32bea9612b6d6e1e3485bbecfec", + "mean": -0.0012065107002854347, + "std": 0.12785044312477112, + "rms": 0.12785613536834717, + "max_abs": 3.5625 + }, + "full_input": { + "shape": [ + 287, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6bf1b72fac17ad33c6272d3da3093e101f7b057a156b9f1ab6f2947d7e8b99ca", + "mean": -0.0014007780700922012, + "std": 0.15998664498329163, + "rms": 0.1599927693605423, + "max_abs": 23.75 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "49fc6ca68d9dab7b8611d333d0203cbbfe542b9e4c35fa60ae65e8739b943099", + "mean": -0.00134062219876796, + "std": 0.1277080923318863, + "rms": 0.1277151256799698, + "max_abs": 3.6875 + }, + "full_input": { + "shape": [ + 271, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "dc4199c75aa483b14a2ac0df7d4b02080c3a037695f80fc0b6b1f2bc2477ac0a", + "mean": -0.0014672885881736875, + "std": 0.1613624095916748, + "rms": 0.16136908531188965, + "max_abs": 23.75 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "66c2b2a68c59579b26835573d1fec9496f438afab41dab197c89c55f44ee0b38", + "mean": -0.0012301524402573705, + "std": 0.12752825021743774, + "rms": 0.1275341808795929, + "max_abs": 3.546875 + }, + "full_input": { + "shape": [ + 287, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bb6d93f6b9f9fa9f3967b9afa3b899f126c34e1a69fb348caf9f3581ab541ad5", + "mean": -0.0014209720538929105, + "std": 0.1598006933927536, + "rms": 0.1598070114850998, + "max_abs": 23.75 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "87b4441631423336f6fcc746634e098852f5a9271e875f65f5179b1617e84786", + "mean": -0.0013209431199356914, + "std": 0.12767042219638824, + "rms": 0.12767724692821503, + "max_abs": 3.671875 + }, + "full_input": { + "shape": [ + 271, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "405f16f3e819290ffa59d87b8fc629059cc53b6207b236852371d96a5bf55665", + "mean": -0.001471816678531468, + "std": 0.16115804016590118, + "rms": 0.1611647605895996, + "max_abs": 23.75 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fed3647b978f387cf6ff965533102fff0ed3dc6c32cd8c269dc19541a3a9a4d7", + "mean": -0.0012286418350413442, + "std": 0.12752574682235718, + "rms": 0.12753167748451233, + "max_abs": 3.5625 + }, + "full_input": { + "shape": [ + 287, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "608f5c429202882d4e971bcecdd97a103f06eac015e93193030f1ec02afa48ce", + "mean": -0.0014357841573655605, + "std": 0.15964174270629883, + "rms": 0.15964820981025696, + "max_abs": 23.75 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9993311762809753, + "min_cosine_similarity": 0.9893798828125, + "mean_relative_l2": 0.031737808138132095, + "max_abs_delta": 0.140625 + }, + "system_bos": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9972702264785767, + "min_cosine_similarity": 0.979580283164978, + "mean_relative_l2": 0.06883545219898224, + "max_abs_delta": 0.125 + }, + "system_x": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9963064193725586, + "min_cosine_similarity": 0.97394859790802, + "mean_relative_l2": 0.07910390943288803, + "max_abs_delta": 0.171875 + }, + "system_period": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9965055584907532, + "min_cosine_similarity": 0.9726846814155579, + "mean_relative_l2": 0.07704223692417145, + "max_abs_delta": 0.15625 + }, + "bos_at_s0": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9925873279571533, + "min_cosine_similarity": 0.9673690795898438, + "mean_relative_l2": 0.11918392777442932, + "max_abs_delta": 0.240234375 + }, + "bos_at_s1": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9910920858383179, + "min_cosine_similarity": 0.9488469958305359, + "mean_relative_l2": 0.12935729324817657, + "max_abs_delta": 0.359375 + }, + "x_at_s0": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9930832386016846, + "min_cosine_similarity": 0.9515409469604492, + "mean_relative_l2": 0.1135425791144371, + "max_abs_delta": 0.3515625 + }, + "x_at_s1": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9904325604438782, + "min_cosine_similarity": 0.9242144823074341, + "mean_relative_l2": 0.1316758245229721, + "max_abs_delta": 0.44921875 + }, + "period_at_s0": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9931371212005615, + "min_cosine_similarity": 0.9566782712936401, + "mean_relative_l2": 0.11328615248203278, + "max_abs_delta": 0.36328125 + }, + "period_at_s1": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9904183745384216, + "min_cosine_similarity": 0.9270820021629333, + "mean_relative_l2": 0.13195186853408813, + "max_abs_delta": 0.455078125 + } + } + }, + "layer_03": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "701466e1dfc74134df946e7ab5e00a50cbee41648c6ee31c68bede8afc384c5b", + "mean": -0.0016959084896370769, + "std": 0.15124107897281647, + "rms": 0.15125058591365814, + "max_abs": 4.375 + }, + "full_input": { + "shape": [ + 271, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b55e0b493dc705454a7e76c571fb81b45c58d466820e38582961a7f3d5f8f8c2", + "mean": -0.006342621054500341, + "std": 4.373767852783203, + "rms": 4.373772621154785, + "max_abs": 1136.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "81fca80e20ed7cb1c573c00707b1b5b92735327610b6256244940fc0fa05c126", + "mean": -0.0016602387186139822, + "std": 0.1515638381242752, + "rms": 0.15157292783260345, + "max_abs": 4.3125 + }, + "full_input": { + "shape": [ + 287, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "dc76dada7e4f2ebfacd3c9f5af5d656f2644d6cfa0eb3ef1ac8535e6ddfe035a", + "mean": -0.006827979348599911, + "std": 4.388716697692871, + "rms": 4.388721466064453, + "max_abs": 1136.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0012fa37282267cfc3bc28ccd694b5e59a4e2714e337dc3135d05dff2018bbfb", + "mean": -0.0016902720090001822, + "std": 0.15286442637443542, + "rms": 0.15287378430366516, + "max_abs": 4.40625 + }, + "full_input": { + "shape": [ + 271, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c2c3a1c46f0f67f3233f93fa17ee9c64c5a5c2ee6cf83ff8224a982e6538c173", + "mean": -0.0026045450940728188, + "std": 3.9001684188842773, + "rms": 3.9001691341400146, + "max_abs": 1136.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b4675468f8b483fa23b73b017a022292ad5340f2aa3199770c49f844e5cf7069", + "mean": -0.0016478343168273568, + "std": 0.15354210138320923, + "rms": 0.15355093777179718, + "max_abs": 4.4375 + }, + "full_input": { + "shape": [ + 287, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e65149845fb8f9801bcb92964287d2c0b7020237f2dad1bb5b89dff0dfd1d310", + "mean": -0.002635639626532793, + "std": 3.790086507797241, + "rms": 3.7900872230529785, + "max_abs": 1136.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7b62e34af760229bdc4123ae8b96fd2942cc35a5f7269d92938f15ca5bbc4d72", + "mean": -0.0017349664121866226, + "std": 0.1522798240184784, + "rms": 0.15228970348834991, + "max_abs": 4.40625 + }, + "full_input": { + "shape": [ + 271, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9247914ec490aa96001f18af44f9957a909a007c35cb2ca3465eb2e82240eeee", + "mean": -0.0026643730234354734, + "std": 3.9001407623291016, + "rms": 3.900141716003418, + "max_abs": 1136.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a0202abb50f45d4f4270a617afff6d9087467c33170c8cb040bd6f3f604ea198", + "mean": -0.0017079119570553303, + "std": 0.15304239094257355, + "rms": 0.1530519276857376, + "max_abs": 4.375 + }, + "full_input": { + "shape": [ + 287, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4b11cdf5163936872acf56bb93807f5ced483e2700cf3ca546a25c4585321535", + "mean": -0.002705783350393176, + "std": 3.790064573287964, + "rms": 3.7900657653808594, + "max_abs": 1136.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e1d15784e26335699bfe815290b62465268fd50aeab724d4d805abb5872b8229", + "mean": -0.0017172604566439986, + "std": 0.15233930945396423, + "rms": 0.15234898030757904, + "max_abs": 4.40625 + }, + "full_input": { + "shape": [ + 271, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f015f885afb1e02715e93c60e3e8edfc154dafbb408fda694cef7346d6ee41cb", + "mean": -0.002651521936058998, + "std": 3.9001376628875732, + "rms": 3.9001386165618896, + "max_abs": 1136.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7c6b37818b15bd16a4b2abb17a125c019360fae9bedecb82bd6f6d95640bcffa", + "mean": -0.0017046290449798107, + "std": 0.15311108529567719, + "rms": 0.15312054753303528, + "max_abs": 4.375 + }, + "full_input": { + "shape": [ + 287, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4edfacdafa3393cd121dfb9df8d7011c2f15029edc47599da606bc54e9590aef", + "mean": -0.0027042494621127844, + "std": 3.7900617122650146, + "rms": 3.790062665939331, + "max_abs": 1136.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9991751313209534, + "min_cosine_similarity": 0.9906007051467896, + "mean_relative_l2": 0.035582009702920914, + "max_abs_delta": 0.15625 + }, + "system_bos": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9970806241035461, + "min_cosine_similarity": 0.9759484529495239, + "mean_relative_l2": 0.07135006040334702, + "max_abs_delta": 0.203125 + }, + "system_x": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9957894682884216, + "min_cosine_similarity": 0.9666744470596313, + "mean_relative_l2": 0.08425194770097733, + "max_abs_delta": 0.171875 + }, + "system_period": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9960238933563232, + "min_cosine_similarity": 0.9663684368133545, + "mean_relative_l2": 0.0816473439335823, + "max_abs_delta": 0.171875 + }, + "bos_at_s0": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9929964542388916, + "min_cosine_similarity": 0.9673451781272888, + "mean_relative_l2": 0.11476005613803864, + "max_abs_delta": 0.2578125 + }, + "bos_at_s1": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9911501407623291, + "min_cosine_similarity": 0.9493927955627441, + "mean_relative_l2": 0.12835492193698883, + "max_abs_delta": 0.365234375 + }, + "x_at_s0": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9933578968048096, + "min_cosine_similarity": 0.95097815990448, + "mean_relative_l2": 0.1099197044968605, + "max_abs_delta": 0.36328125 + }, + "x_at_s1": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.990235447883606, + "min_cosine_similarity": 0.92274010181427, + "mean_relative_l2": 0.1318359375, + "max_abs_delta": 0.4697265625 + }, + "period_at_s0": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9934512972831726, + "min_cosine_similarity": 0.9505994915962219, + "mean_relative_l2": 0.10930535942316055, + "max_abs_delta": 0.373046875 + }, + "period_at_s1": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9902480244636536, + "min_cosine_similarity": 0.9257279634475708, + "mean_relative_l2": 0.1320265233516693, + "max_abs_delta": 0.4794921875 + } + } + }, + "layer_04": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e024fc8dc3a0e2a00591b5b9738ef635fe4901211a980e90b0af9c460eb6ef80", + "mean": -0.0019170757150277495, + "std": 0.18320566415786743, + "rms": 0.18321570754051208, + "max_abs": 5.9375 + }, + "full_input": { + "shape": [ + 271, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "36184b0d1dcb59581770ca7ddd4cbeafe32af89cdc6cb6f8a7f33356b1357124", + "mean": -0.006479375995695591, + "std": 4.565951347351074, + "rms": 4.565955638885498, + "max_abs": 1152.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "aa87556b66d3c8a7e18de9ab3a053b78d1097c187aa21274655bf9fd866d42f7", + "mean": -0.001912181731313467, + "std": 0.18374069035053253, + "rms": 0.18375062942504883, + "max_abs": 5.875 + }, + "full_input": { + "shape": [ + 287, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e65b97bb96f660fc9a537784c9740b57adc7b76103b41a8b45583d9fc8eea217", + "mean": -0.006998393684625626, + "std": 4.5684027671813965, + "rms": 4.568408012390137, + "max_abs": 1152.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2732c90caa16eb8e109264ae21334113ebee43d87955c61e4678a4b04df7f724", + "mean": -0.002006795722991228, + "std": 0.18563783168792725, + "rms": 0.18564867973327637, + "max_abs": 6.0 + }, + "full_input": { + "shape": [ + 271, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "706fc7cf8cbf3efbc98ec5d7bee6c907eda2e34b297288b4e4f9776bb9da5ed2", + "mean": -0.0028339398559182882, + "std": 4.093143939971924, + "rms": 4.09314489364624, + "max_abs": 1152.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5b4c765e6b14b3c4e43944b9b13b1edc7e54cef6c0d5d8d291dd599e2eaf22b5", + "mean": -0.0020442220848053694, + "std": 0.18633845448493958, + "rms": 0.18634967505931854, + "max_abs": 6.0625 + }, + "full_input": { + "shape": [ + 287, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6b523e52739f227a52d1e0d2d74901b00c00507c7275fe82fdc133edf3e0b20e", + "mean": -0.002929131966084242, + "std": 3.9723799228668213, + "rms": 3.972381114959717, + "max_abs": 1152.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d8a231ff162f93ed5c644b40e2bd348d500a4015acdbff635c577fc1733d56fa", + "mean": -0.002025981666520238, + "std": 0.18486244976520538, + "rms": 0.1848735511302948, + "max_abs": 5.875 + }, + "full_input": { + "shape": [ + 271, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a20b2af4c73ef2e5174a0c08bd1fef291a59cc395a1235a1fb5638243100c728", + "mean": -0.002836213679984212, + "std": 4.09309720993042, + "rms": 4.093098163604736, + "max_abs": 1152.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2542ad31d92a878464deff6d4e3261797b82f3085414f96dd4141a8ff3f33a61", + "mean": -0.002067738911136985, + "std": 0.18585719168186188, + "rms": 0.18586868047714233, + "max_abs": 5.9375 + }, + "full_input": { + "shape": [ + 287, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c1656b568f896bab930845e9a9c1ae4aaa8b7a41e847d9143c504c2933790cab", + "mean": -0.002939753932878375, + "std": 3.9723448753356934, + "rms": 3.9723458290100098, + "max_abs": 1152.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "344c8f548c06a2f30c857974fb640f96eeb1ccf2bb4dad5d989b3c39456c4f6d", + "mean": -0.0019959621131420135, + "std": 0.18488992750644684, + "rms": 0.18490070104599, + "max_abs": 5.875 + }, + "full_input": { + "shape": [ + 271, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "db6a0008321550da168e1631c1fa9cb86ba70f46ed4845b9a73f4ba4f30dcf41", + "mean": -0.0028126647230237722, + "std": 4.093093395233154, + "rms": 4.093094825744629, + "max_abs": 1152.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6660d5ce2bc495d66574b6ca4aea168de88a2f569c7fda563c870848be191fc7", + "mean": -0.0020648790523409843, + "std": 0.1859821379184723, + "rms": 0.18599359691143036, + "max_abs": 5.875 + }, + "full_input": { + "shape": [ + 287, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a9739639faed86c397ed7468429503284d134fcdc96c58a6c2dfa066e1769d28", + "mean": -0.0029367883689701557, + "std": 3.9723446369171143, + "rms": 3.9723455905914307, + "max_abs": 1152.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9990888833999634, + "min_cosine_similarity": 0.9877097606658936, + "mean_relative_l2": 0.03679808974266052, + "max_abs_delta": 0.15625 + }, + "system_bos": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9972273111343384, + "min_cosine_similarity": 0.9800840616226196, + "mean_relative_l2": 0.0696544423699379, + "max_abs_delta": 0.34375 + }, + "system_x": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9956234693527222, + "min_cosine_similarity": 0.9697790145874023, + "mean_relative_l2": 0.08704483509063721, + "max_abs_delta": 0.2705078125 + }, + "system_period": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9957938194274902, + "min_cosine_similarity": 0.9690974354743958, + "mean_relative_l2": 0.08504625409841537, + "max_abs_delta": 0.275390625 + }, + "bos_at_s0": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9940903186798096, + "min_cosine_similarity": 0.9715285301208496, + "mean_relative_l2": 0.10516458004713058, + "max_abs_delta": 0.375 + }, + "bos_at_s1": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9924231767654419, + "min_cosine_similarity": 0.954927921295166, + "mean_relative_l2": 0.11917517334222794, + "max_abs_delta": 0.43359375 + }, + "x_at_s0": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9940205812454224, + "min_cosine_similarity": 0.9599374532699585, + "mean_relative_l2": 0.10383044928312302, + "max_abs_delta": 0.46484375 + }, + "x_at_s1": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9909246563911438, + "min_cosine_similarity": 0.9255114197731018, + "mean_relative_l2": 0.12737658619880676, + "max_abs_delta": 0.6171875 + }, + "period_at_s0": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9940285086631775, + "min_cosine_similarity": 0.952731728553772, + "mean_relative_l2": 0.10362056642770767, + "max_abs_delta": 0.47265625 + }, + "period_at_s1": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9908349514007568, + "min_cosine_similarity": 0.9278198480606079, + "mean_relative_l2": 0.1282869279384613, + "max_abs_delta": 0.6171875 + } + } + }, + "layer_05": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "253711e059cb5b5b4db1917c7ccfc776012e91ba36aaa7fc02cf1c721ca55179", + "mean": -0.0012759543024003506, + "std": 0.20607797801494598, + "rms": 0.20608192682266235, + "max_abs": 5.78125 + }, + "full_input": { + "shape": [ + 271, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "237c2c291621e60098880cea0f535f1d80b2cc55127d9e17e566d504848f7aa1", + "mean": -0.006456420756876469, + "std": 4.705286026000977, + "rms": 4.7052903175354, + "max_abs": 1152.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0aca0878238ef62db33236b0de96e623abacb5361445d4db312b30dec3d23e88", + "mean": -0.0014052398037165403, + "std": 0.2062811404466629, + "rms": 0.20628593862056732, + "max_abs": 5.875 + }, + "full_input": { + "shape": [ + 287, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "deb2be21c78474f5d9795039a9ab50bcfbb393679e2609cd483eb21993b412cf", + "mean": -0.00704327505081892, + "std": 4.710145473480225, + "rms": 4.710150718688965, + "max_abs": 1152.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2c0ddeba90e1462ffa132d051abddb6181c3255137ccde50041a441fc35f5dbd", + "mean": -0.0013989488361403346, + "std": 0.20897401869297028, + "rms": 0.20897871255874634, + "max_abs": 5.90625 + }, + "full_input": { + "shape": [ + 271, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a98c3ddc709e12e53635b6c0389e53ced1c7a9f8686994b08b745b561de3b0f3", + "mean": -0.0024660886265337467, + "std": 4.165184497833252, + "rms": 4.16518497467041, + "max_abs": 1152.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ac405ce9f00adf58b3946f865370ad56720232db1db0e304b94145c365d2021d", + "mean": -0.0015693596797063947, + "std": 0.2087738960981369, + "rms": 0.20877981185913086, + "max_abs": 5.9375 + }, + "full_input": { + "shape": [ + 287, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "87df76ecf6dd17acdfc6d0a74eaedf688263e148a2c3a020959aff82bf6a4e7c", + "mean": -0.002642021281644702, + "std": 4.042183876037598, + "rms": 4.042184352874756, + "max_abs": 1152.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f2dc8cee1f1763e38d533a4cc158f9150c11a8df2edada74dd5384bf2445c2ee", + "mean": -0.001464909058995545, + "std": 0.20735129714012146, + "rms": 0.20735646784305573, + "max_abs": 5.9375 + }, + "full_input": { + "shape": [ + 271, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4e72cf07647d23da94c5fda029ef62b738a08cc1ee8291f96a08e7eec677fbf6", + "mean": -0.002495072316378355, + "std": 4.165094375610352, + "rms": 4.165095329284668, + "max_abs": 1152.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "89d3357f9c783441dd681ca1f5e213aa002710b2246fb4c45cda2caca1c16fac", + "mean": -0.0017901385435834527, + "std": 0.20767977833747864, + "rms": 0.20768749713897705, + "max_abs": 6.0 + }, + "full_input": { + "shape": [ + 287, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6f42f313fee1d63c2a2ec6043bcc962a57596c5e487ebd5ffb9ba1ad8486d778", + "mean": -0.002808179473504424, + "std": 4.042119979858398, + "rms": 4.042120933532715, + "max_abs": 1152.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "05ef95d4135e6f64ffabefda3570c1eb72b6348f542bd925e0a1eb96882c77fc", + "mean": -0.001523043611086905, + "std": 0.20734627544879913, + "rms": 0.20735186338424683, + "max_abs": 5.9375 + }, + "full_input": { + "shape": [ + 271, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "61ad2d02d3cedb716ab67fbc74f799a96f604819511485550ff6a3a4d7bf306a", + "mean": -0.002547557232901454, + "std": 4.165085315704346, + "rms": 4.165086269378662, + "max_abs": 1152.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6857a3a9c46d33fe60501e33eb8f34cc115aa433fe94d7d9bda2dfb1c5e1aca3", + "mean": -0.0018116579158231616, + "std": 0.2077053189277649, + "rms": 0.20771321654319763, + "max_abs": 5.9375 + }, + "full_input": { + "shape": [ + 287, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9510c9ccb60f541b92ce86c5e4c2e7af188e9206b2996214d132170b3ac0c092", + "mean": -0.0028337636031210423, + "std": 4.042113780975342, + "rms": 4.042114734649658, + "max_abs": 1152.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9985767006874084, + "min_cosine_similarity": 0.9853978157043457, + "mean_relative_l2": 0.04765839874744415, + "max_abs_delta": 0.328125 + }, + "system_bos": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.996552586555481, + "min_cosine_similarity": 0.9726462364196777, + "mean_relative_l2": 0.07678841799497604, + "max_abs_delta": 0.4375 + }, + "system_x": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9943320155143738, + "min_cosine_similarity": 0.9575880169868469, + "mean_relative_l2": 0.09868060052394867, + "max_abs_delta": 0.46875 + }, + "system_period": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9944368600845337, + "min_cosine_similarity": 0.9570052623748779, + "mean_relative_l2": 0.09768497198820114, + "max_abs_delta": 0.419921875 + }, + "bos_at_s0": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9932447075843811, + "min_cosine_similarity": 0.971671462059021, + "mean_relative_l2": 0.11219733953475952, + "max_abs_delta": 0.4375 + }, + "bos_at_s1": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9914959073066711, + "min_cosine_similarity": 0.9468390941619873, + "mean_relative_l2": 0.12520086765289307, + "max_abs_delta": 0.453125 + }, + "x_at_s0": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9929471611976624, + "min_cosine_similarity": 0.9493969678878784, + "mean_relative_l2": 0.11209117621183395, + "max_abs_delta": 0.65625 + }, + "x_at_s1": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9891995191574097, + "min_cosine_similarity": 0.9081883430480957, + "mean_relative_l2": 0.1377270668745041, + "max_abs_delta": 0.703125 + }, + "period_at_s0": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.993033766746521, + "min_cosine_similarity": 0.9425381422042847, + "mean_relative_l2": 0.11187922209501266, + "max_abs_delta": 0.59375 + }, + "period_at_s1": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.989340603351593, + "min_cosine_similarity": 0.9086447358131409, + "mean_relative_l2": 0.13740511238574982, + "max_abs_delta": 0.734375 + } + } + }, + "layer_06": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c655096b6d20b88d4b39579d0199f5b7bc3badc023a1c7fdfee136281f9d20c5", + "mean": -0.0023225892800837755, + "std": 0.24130667746067047, + "rms": 0.24131785333156586, + "max_abs": 7.5 + }, + "full_input": { + "shape": [ + 271, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "29412ffc397b7a80e9417df674d2889bc2508695bb041c6c40fc5e17ddf784ee", + "mean": -0.007657134439796209, + "std": 4.792105197906494, + "rms": 4.792111396789551, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7e134ff72f289c03fe7b278dbd1ce56699abba940676e9f3e83e55833e22b1e2", + "mean": -0.002491392893716693, + "std": 0.24205578863620758, + "rms": 0.2420686036348343, + "max_abs": 7.5625 + }, + "full_input": { + "shape": [ + 287, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7653b401f866e04d92101679c338c559e7a54cf4ccb4589d40e35f7551efddfe", + "mean": -0.008285108022391796, + "std": 4.796914100646973, + "rms": 4.796921253204346, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "84b0369dd82f4ade208fb0b06bd2f89ea69c4da7716b2b4a900026fd3eceffa7", + "mean": -0.0022961993236094713, + "std": 0.24383237957954407, + "rms": 0.2438431829214096, + "max_abs": 7.59375 + }, + "full_input": { + "shape": [ + 271, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d6fc10c7bcd00768281d33cd1f6d38cfdb60cd20b42483f852193082fe79a9d9", + "mean": -0.003418208099901676, + "std": 4.233437538146973, + "rms": 4.233438491821289, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e2db9a1385137986fa252f4db6ebf9bec488d4a9ae8a9a8d1356f650ca4e4177", + "mean": -0.0024534452240914106, + "std": 0.24420057237148285, + "rms": 0.24421289563179016, + "max_abs": 7.59375 + }, + "full_input": { + "shape": [ + 287, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "909d119b8386933e0714e32be11f27a427e251c775e0048a8b349d507c6b0574", + "mean": -0.0035923130344599485, + "std": 4.108613014221191, + "rms": 4.108614444732666, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "833128e42732670ff0b33877cf31024bf1468b8a85307ebec8705b3af1809584", + "mean": -0.0024106160271912813, + "std": 0.24276438355445862, + "rms": 0.24277634918689728, + "max_abs": 7.625 + }, + "full_input": { + "shape": [ + 271, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4c83b159f0492a189af9fb4ce80fbcabf278ebaa70d11046dbf6aea56ad81c71", + "mean": -0.0034703868441283703, + "std": 4.233362197875977, + "rms": 4.233363628387451, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6d60fe1b25af2be78b45f1ed08aef6560c07033165e19f410c5653fde8f6c67f", + "mean": -0.0025846250355243683, + "std": 0.2431374341249466, + "rms": 0.24315117299556732, + "max_abs": 7.5625 + }, + "full_input": { + "shape": [ + 287, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2d28fd1c8c7bd068fe819194f440c0c93478361dbd0a5303907a2c119b7dc034", + "mean": -0.0036585538182407618, + "std": 4.108537673950195, + "rms": 4.108539581298828, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4d630d53ac909f67d5c7004676b33a29d5a47ab9bce6bbd7ba16a99cf318902a", + "mean": -0.0024877607356756926, + "std": 0.24203307926654816, + "rms": 0.24204586446285248, + "max_abs": 7.5625 + }, + "full_input": { + "shape": [ + 271, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0ea69c8d6fd1fdd131aff43a0a30360deda8c16a3275c95b095d3ef3baecb95b", + "mean": -0.0035358078312128782, + "std": 4.2333197593688965, + "rms": 4.233321666717529, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "44589d55db64fca76a7443fc2068db1836fb1ffb0eabf744f740bb7493d2f38e", + "mean": -0.0026388990227133036, + "std": 0.242867574095726, + "rms": 0.2428819090127945, + "max_abs": 7.5625 + }, + "full_input": { + "shape": [ + 287, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9779e56772b857003516b18d93694991b70de6fa00505ff9134bc9d0b4810f6b", + "mean": -0.0037054121494293213, + "std": 4.108520030975342, + "rms": 4.108521938323975, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9982650876045227, + "min_cosine_similarity": 0.9797271490097046, + "mean_relative_l2": 0.051900751888751984, + "max_abs_delta": 0.53125 + }, + "system_bos": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9961088299751282, + "min_cosine_similarity": 0.9705284833908081, + "mean_relative_l2": 0.08098519593477249, + "max_abs_delta": 0.5 + }, + "system_x": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9933596849441528, + "min_cosine_similarity": 0.9590086936950684, + "mean_relative_l2": 0.10719849914312363, + "max_abs_delta": 0.8125 + }, + "system_period": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9931779503822327, + "min_cosine_similarity": 0.9569734334945679, + "mean_relative_l2": 0.10893567651510239, + "max_abs_delta": 1.0 + }, + "bos_at_s0": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.993125855922699, + "min_cosine_similarity": 0.961085319519043, + "mean_relative_l2": 0.11161939799785614, + "max_abs_delta": 0.46875 + }, + "bos_at_s1": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.991208553314209, + "min_cosine_similarity": 0.9504048228263855, + "mean_relative_l2": 0.12615706026554108, + "max_abs_delta": 0.71875 + }, + "x_at_s0": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9922136664390564, + "min_cosine_similarity": 0.9374501705169678, + "mean_relative_l2": 0.1164652556180954, + "max_abs_delta": 0.734375 + }, + "x_at_s1": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.987689733505249, + "min_cosine_similarity": 0.9052017331123352, + "mean_relative_l2": 0.14571163058280945, + "max_abs_delta": 1.21875 + }, + "period_at_s0": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9922559857368469, + "min_cosine_similarity": 0.945030927658081, + "mean_relative_l2": 0.1171194389462471, + "max_abs_delta": 0.703125 + }, + "period_at_s1": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.987978458404541, + "min_cosine_similarity": 0.8997882604598999, + "mean_relative_l2": 0.14454814791679382, + "max_abs_delta": 1.015625 + } + } + }, + "layer_07": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "88d745f3b70e97d97b4723bc4bdfce30a3e07ee9894af48914733987137ba988", + "mean": -0.003446451388299465, + "std": 0.2661627531051636, + "rms": 0.26618507504463196, + "max_abs": 7.6875 + }, + "full_input": { + "shape": [ + 271, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c39df042b75f889b1abd4fbcfff4176aa95197c47e281ba2b644d7b1346c1ac1", + "mean": -0.008672378025949001, + "std": 4.807124137878418, + "rms": 4.807131767272949, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b8697c848edd9b8f6ad73562d03550a2142f2d06586eab955b8db7a0c6744398", + "mean": -0.003545139916241169, + "std": 0.2669000029563904, + "rms": 0.26692354679107666, + "max_abs": 7.65625 + }, + "full_input": { + "shape": [ + 287, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1759ada117442ddf75f2842a32b981d7bfefeb7ee544228aa734def69aca82f8", + "mean": -0.009373196400702, + "std": 4.812127590179443, + "rms": 4.812137126922607, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3e86d03605e27ab7c8f75786a3a89f054a7ff08f5fd8040c5483571d59fa61a1", + "mean": -0.003255310235545039, + "std": 0.26795777678489685, + "rms": 0.2679775655269623, + "max_abs": 7.6875 + }, + "full_input": { + "shape": [ + 271, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2148f15e05a74fa2b40a8ff810c53fd58c3d98d996bbbc2bfe98dfc277f69e09", + "mean": -0.004268908407539129, + "std": 4.242386817932129, + "rms": 4.24238920211792, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d9726130f0a70391a006d03cf03e12d38acf7b58cbf2a37915460eadda366ba8", + "mean": -0.003528433619067073, + "std": 0.2691103518009186, + "rms": 0.26913347840309143, + "max_abs": 7.625 + }, + "full_input": { + "shape": [ + 287, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "000f831ed8f022b804873277ac1753e3da88dd31a877ad2a0f2f6afa922dc33e", + "mean": -0.004681087564677, + "std": 4.117435932159424, + "rms": 4.117438316345215, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0d326cee786e68db6cd8b29281146048316e289e7bff4b80c3944eb73ea3e49b", + "mean": -0.0032546462025493383, + "std": 0.2663673460483551, + "rms": 0.2663872241973877, + "max_abs": 7.625 + }, + "full_input": { + "shape": [ + 271, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a8075e0f7f88a3f45ecfdc851c3014d098217cf98f4af1867e3a696b4fb3c91c", + "mean": -0.0042728763073682785, + "std": 4.242268085479736, + "rms": 4.242269992828369, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "34ff4bff13491067aa1eeba38dd18756a5e4de312a956c2043f1ee79238cfa67", + "mean": -0.003620806848630309, + "std": 0.2683664858341217, + "rms": 0.2683909237384796, + "max_abs": 7.625 + }, + "full_input": { + "shape": [ + 287, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6f3d9b5ad281806bf83a30125d74c5b786d7c23a1b9161f4d92c85b0985bf0ed", + "mean": -0.004757552407681942, + "std": 4.117368221282959, + "rms": 4.11737060546875, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6c9c0c15c0919f5894ea6a2e45963b2bcf0b8328e16f84c5d9b2f2351b9adbba", + "mean": -0.003403616836294532, + "std": 0.2659969925880432, + "rms": 0.2660187780857086, + "max_abs": 7.71875 + }, + "full_input": { + "shape": [ + 271, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0a89f1f76ddda1acf5c4a64f295c2c356ed803811edcfeefa9d4115f2bd2ecdf", + "mean": -0.00436017569154501, + "std": 4.242247581481934, + "rms": 4.242249965667725, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cfce2113884da98c9370a6e8b91c29feb23a24175d85b58d83ec3959a74fae63", + "mean": -0.0036915645468980074, + "std": 0.26844218373298645, + "rms": 0.2684675455093384, + "max_abs": 7.625 + }, + "full_input": { + "shape": [ + 287, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5f8ee92598bf7f96d8381bb1287ba27739f2bca6fabba9f5615ea750ccac06f6", + "mean": -0.004779821261763573, + "std": 4.117374420166016, + "rms": 4.117377281188965, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9977802038192749, + "min_cosine_similarity": 0.9713225364685059, + "mean_relative_l2": 0.05811664089560509, + "max_abs_delta": 0.9375 + }, + "system_bos": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9952765703201294, + "min_cosine_similarity": 0.9484190940856934, + "mean_relative_l2": 0.08789094537496567, + "max_abs_delta": 1.1875 + }, + "system_x": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.992365837097168, + "min_cosine_similarity": 0.9485697150230408, + "mean_relative_l2": 0.11418652534484863, + "max_abs_delta": 0.59375 + }, + "system_period": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9920929670333862, + "min_cosine_similarity": 0.9510188102722168, + "mean_relative_l2": 0.1167609766125679, + "max_abs_delta": 0.96875 + }, + "bos_at_s0": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9921987056732178, + "min_cosine_similarity": 0.9511844515800476, + "mean_relative_l2": 0.11687277257442474, + "max_abs_delta": 0.8125 + }, + "bos_at_s1": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9903255701065063, + "min_cosine_similarity": 0.9387081265449524, + "mean_relative_l2": 0.13081522285938263, + "max_abs_delta": 0.53125 + }, + "x_at_s0": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9908152222633362, + "min_cosine_similarity": 0.9194173216819763, + "mean_relative_l2": 0.1236981675028801, + "max_abs_delta": 1.21875 + }, + "x_at_s1": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9856920838356018, + "min_cosine_similarity": 0.8823288679122925, + "mean_relative_l2": 0.15560497343540192, + "max_abs_delta": 1.78125 + }, + "period_at_s0": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9910098314285278, + "min_cosine_similarity": 0.9327589869499207, + "mean_relative_l2": 0.1239260733127594, + "max_abs_delta": 1.140625 + }, + "period_at_s1": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9863325953483582, + "min_cosine_similarity": 0.8755149841308594, + "mean_relative_l2": 0.1526648998260498, + "max_abs_delta": 1.5 + } + } + }, + "layer_08": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "edf64a79b1d6a90b127fd4d7ce9e540e7cdab8c336eb2182cb28db7a0d336bc0", + "mean": -0.005577663891017437, + "std": 0.30763399600982666, + "rms": 0.3076845705509186, + "max_abs": 9.4375 + }, + "full_input": { + "shape": [ + 271, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e2253ca9413c660e4d5f8087def5f61f5bb3ecc7cdd9f9428ee1c373627b953d", + "mean": -0.010712415911257267, + "std": 4.825308322906494, + "rms": 4.825320243835449, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "018ba0eab49ea7bacfd471f26cb050f80ae3dec895c53514b6b66424ab96f47e", + "mean": -0.005591206252574921, + "std": 0.30884936451911926, + "rms": 0.30889996886253357, + "max_abs": 9.5 + }, + "full_input": { + "shape": [ + 287, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b8aea21e1fede35e0d6f7afb7ffe7a8a57c19d3a6e0d3b3799ca127edd472cf7", + "mean": -0.011128352954983711, + "std": 4.830542087554932, + "rms": 4.830554962158203, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d8dc98be1606484eeb6058667407ec8cf05a7b3f849913bec6a19b67d37e59fd", + "mean": -0.0053372010588645935, + "std": 0.3105858266353607, + "rms": 0.310631662607193, + "max_abs": 9.4375 + }, + "full_input": { + "shape": [ + 271, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f6c399391039992e54aa8fdfb0d1ce279bfc2013bdec7e117101e9cdb491cd6a", + "mean": -0.00629867659881711, + "std": 4.253759384155273, + "rms": 4.2537641525268555, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "52e6475986229c0b1cb48e7cb15a0cd9a3c020565d3724bcab778fdb8bc67429", + "mean": -0.0055852425284683704, + "std": 0.31223753094673157, + "rms": 0.31228747963905334, + "max_abs": 9.6875 + }, + "full_input": { + "shape": [ + 287, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8d25c4d5e7f48f4627b87caeb3e1d39e951427084588baa37a7ca7fac5ee135b", + "mean": -0.006481966469436884, + "std": 4.128598690032959, + "rms": 4.128603935241699, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "033968f52f8d5ec9f8f04c5e4baacf18b63f8dfddf5192651b73255ecf092a04", + "mean": -0.005388801451772451, + "std": 0.3081214129924774, + "rms": 0.30816853046417236, + "max_abs": 9.25 + }, + "full_input": { + "shape": [ + 271, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4a01817ba14b5425485e0b31bca28996860e5cec5f9173f460e9f106f2d8ed64", + "mean": -0.006332146469503641, + "std": 4.253580570220947, + "rms": 4.2535858154296875, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fdd11a7ce1ce27fc565408738430ad404b45716f6ef02c2d27714d811e87c330", + "mean": -0.0056380475871264935, + "std": 0.31186041235923767, + "rms": 0.31191137433052063, + "max_abs": 9.5625 + }, + "full_input": { + "shape": [ + 287, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "63b56ae426aeb0e17930a39cddb53d35af870c8fad1cb7c0f129258393a3f51a", + "mean": -0.006504513788968325, + "std": 4.128558158874512, + "rms": 4.128563404083252, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "45ef5d0292b8c50737843f32aae0adaa75a00fa030e76225855661e7c27b08e2", + "mean": -0.005644151009619236, + "std": 0.30741462111473083, + "rms": 0.30746641755104065, + "max_abs": 9.25 + }, + "full_input": { + "shape": [ + 271, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "269527f173c4bab9cb2848ae6b3c910907172aa0eadab43368cb35816098cff6", + "mean": -0.006555881816893816, + "std": 4.253537178039551, + "rms": 4.253542423248291, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "29760def259d03d6ec67e45da5c263d88ca335f45f05fc8cf7197ba9b3f4f9a9", + "mean": -0.0057862866669893265, + "std": 0.3119785785675049, + "rms": 0.31203222274780273, + "max_abs": 9.625 + }, + "full_input": { + "shape": [ + 287, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3f5bbe74eae05f26ff559f1f52069e43744678d71df79eecb439091ffb082210", + "mean": -0.006599062588065863, + "std": 4.128564834594727, + "rms": 4.128570079803467, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9970545768737793, + "min_cosine_similarity": 0.9620789289474487, + "mean_relative_l2": 0.06610897183418274, + "max_abs_delta": 1.0 + }, + "system_bos": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9944128394126892, + "min_cosine_similarity": 0.9375866651535034, + "mean_relative_l2": 0.09484117478132248, + "max_abs_delta": 1.28125 + }, + "system_x": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9909245371818542, + "min_cosine_similarity": 0.9368888139724731, + "mean_relative_l2": 0.12517349421977997, + "max_abs_delta": 0.90625 + }, + "system_period": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9905922412872314, + "min_cosine_similarity": 0.9359287023544312, + "mean_relative_l2": 0.12883947789669037, + "max_abs_delta": 1.125 + }, + "bos_at_s0": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9914411306381226, + "min_cosine_similarity": 0.9272587895393372, + "mean_relative_l2": 0.12233611941337585, + "max_abs_delta": 0.78125 + }, + "bos_at_s1": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9896092414855957, + "min_cosine_similarity": 0.9306011199951172, + "mean_relative_l2": 0.1358073353767395, + "max_abs_delta": 0.96875 + }, + "x_at_s0": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9894720315933228, + "min_cosine_similarity": 0.9009425640106201, + "mean_relative_l2": 0.13118334114551544, + "max_abs_delta": 1.65625 + }, + "x_at_s1": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9843165278434753, + "min_cosine_similarity": 0.845255970954895, + "mean_relative_l2": 0.16276028752326965, + "max_abs_delta": 1.8125 + }, + "period_at_s0": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9896739721298218, + "min_cosine_similarity": 0.9118269681930542, + "mean_relative_l2": 0.13195228576660156, + "max_abs_delta": 1.40625 + }, + "period_at_s1": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9849522709846497, + "min_cosine_similarity": 0.8385149240493774, + "mean_relative_l2": 0.15998594462871552, + "max_abs_delta": 1.5625 + } + } + }, + "layer_09": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a13c5f97e15a62527c5ef661855b9a6dcc531b5e30a41e60284182c1e2cd3a65", + "mean": -0.006518049631267786, + "std": 0.36146852374076843, + "rms": 0.36152729392051697, + "max_abs": 12.75 + }, + "full_input": { + "shape": [ + 271, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "157541fd4b2d13f712eb91cd8e52dbb19a9e3a7dd5ffab662699ec048519da79", + "mean": -0.01149788498878479, + "std": 4.829289436340332, + "rms": 4.829302787780762, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f1ff54f799f90107b4884b08c348599a2059d12b59aa20f0729e28a4e6f3c390", + "mean": -0.006657087709754705, + "std": 0.362321138381958, + "rms": 0.36238229274749756, + "max_abs": 12.625 + }, + "full_input": { + "shape": [ + 287, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "757ca44997be1faf027b7b074c39e940834303f694e62d357442bfd7ceba9b7d", + "mean": -0.01221778616309166, + "std": 4.834403991699219, + "rms": 4.8344197273254395, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7ff171397ad63b3a79a7aca03c47dddffc7053adfbb2fe00e688d93585b734c8", + "mean": -0.006395586300641298, + "std": 0.3639099597930908, + "rms": 0.3639661371707916, + "max_abs": 12.8125 + }, + "full_input": { + "shape": [ + 271, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "63916ea6bf307f0f1217374dd035310e487c0b791df6e273f0bb80eb0de1e2ac", + "mean": -0.00723659060895443, + "std": 4.258190155029297, + "rms": 4.2581963539123535, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "11f567fe91d8b3f423052029465e33adbfdd775bcc0c814b04a0a25f66522202", + "mean": -0.006701772101223469, + "std": 0.3657324016094208, + "rms": 0.36579379439353943, + "max_abs": 12.875 + }, + "full_input": { + "shape": [ + 287, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d005b033b362aaa03c4a0cc84a1cb5e9a3126a90850aafbca92de91a1fce3dcb", + "mean": -0.00766617339104414, + "std": 4.133127212524414, + "rms": 4.133134365081787, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "11093510c4bda513ff910cd14404686186ecfeab4c13091afd9358bdad69b773", + "mean": -0.006309092976152897, + "std": 0.3611923158168793, + "rms": 0.3612474203109741, + "max_abs": 12.625 + }, + "full_input": { + "shape": [ + 271, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1116216b731b8a510b9a59d500713f4db6e0495010290a791f026ad5e8d488d3", + "mean": -0.007131809368729591, + "std": 4.2579665184021, + "rms": 4.257972717285156, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6ff090bcbcc901b14ab789c36552440990dea8ed02027c5c4f84de8e797c1c06", + "mean": -0.006643662694841623, + "std": 0.36413633823394775, + "rms": 0.36419692635536194, + "max_abs": 12.875 + }, + "full_input": { + "shape": [ + 287, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e30c5a4e941458a9b45e2da9149200a37d5d35634538617f9d8ce0fd22281b05", + "mean": -0.0076072015799582005, + "std": 4.13298225402832, + "rms": 4.132988929748535, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8f35423719c375c761a7355423475f74d866f4ef0ed955b9ec59493c7da67839", + "mean": -0.006583784706890583, + "std": 0.3606470227241516, + "rms": 0.3607071042060852, + "max_abs": 12.4375 + }, + "full_input": { + "shape": [ + 271, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4d924d357c143d87878ac6dc2ab4b5448e7b14bee6fbcd22b6e63ecf824ea25e", + "mean": -0.00733734667301178, + "std": 4.257913112640381, + "rms": 4.2579193115234375, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "db152dbb5f742839b164c05137e38365b2f2ffd299117002cfec45aa0289b3c2", + "mean": -0.00676295580342412, + "std": 0.36450254917144775, + "rms": 0.36456528306007385, + "max_abs": 12.875 + }, + "full_input": { + "shape": [ + 287, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "41c528f9777851ed461312dc0ced7257f7bcfe0a113b9e643bb117668ea2ce0b", + "mean": -0.007643252611160278, + "std": 4.132994174957275, + "rms": 4.133001327514648, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9972371459007263, + "min_cosine_similarity": 0.9604101777076721, + "mean_relative_l2": 0.06405817717313766, + "max_abs_delta": 1.09375 + }, + "system_bos": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.994795560836792, + "min_cosine_similarity": 0.940028190612793, + "mean_relative_l2": 0.09092555940151215, + "max_abs_delta": 1.65625 + }, + "system_x": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9913173913955688, + "min_cosine_similarity": 0.9132223129272461, + "mean_relative_l2": 0.12066879123449326, + "max_abs_delta": 1.21875 + }, + "system_period": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9912611246109009, + "min_cosine_similarity": 0.9223310351371765, + "mean_relative_l2": 0.12290030717849731, + "max_abs_delta": 1.25 + }, + "bos_at_s0": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9925256371498108, + "min_cosine_similarity": 0.9311015605926514, + "mean_relative_l2": 0.11316407471895218, + "max_abs_delta": 0.84375 + }, + "bos_at_s1": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9909330010414124, + "min_cosine_similarity": 0.9348530769348145, + "mean_relative_l2": 0.12577733397483826, + "max_abs_delta": 1.28125 + }, + "x_at_s0": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9903290271759033, + "min_cosine_similarity": 0.8986707925796509, + "mean_relative_l2": 0.12466435879468918, + "max_abs_delta": 2.0625 + }, + "x_at_s1": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9859536290168762, + "min_cosine_similarity": 0.8142693042755127, + "mean_relative_l2": 0.15203218162059784, + "max_abs_delta": 1.9375 + }, + "period_at_s0": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9906988143920898, + "min_cosine_similarity": 0.9055228233337402, + "mean_relative_l2": 0.12433300167322159, + "max_abs_delta": 1.625 + }, + "period_at_s1": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.986470639705658, + "min_cosine_similarity": 0.8144065141677856, + "mean_relative_l2": 0.14977094531059265, + "max_abs_delta": 1.625 + } + } + }, + "layer_10": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "dc4be83770bf1a843393952270b40dd07be26376744fd97c53bd60788ca111fc", + "mean": -0.006722286343574524, + "std": 0.40546146035194397, + "rms": 0.4055171608924866, + "max_abs": 13.4375 + }, + "full_input": { + "shape": [ + 271, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e497547fbcb0c68e97561a0b41c064f1a0873592b342c605bc62f5a6ca7f46eb", + "mean": -0.011894355528056622, + "std": 4.836657524108887, + "rms": 4.836672306060791, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "dd074e3f98f1379bb49a84d319516adaf0648353a13310ec3ecbc9afd89a600f", + "mean": -0.0068009695969522, + "std": 0.4059440791606903, + "rms": 0.4060010612010956, + "max_abs": 13.4375 + }, + "full_input": { + "shape": [ + 287, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "adf945fa8db0d30c298e3e56f4dcdf37a376f663bf561c780f0dc83a4761d963", + "mean": -0.012602562084794044, + "std": 4.841638565063477, + "rms": 4.841655254364014, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "000fa934534d0204ba60391cf7e79f6e0353fe461b2e017432855640c7839cf2", + "mean": -0.006741986144334078, + "std": 0.40834274888038635, + "rms": 0.4083983898162842, + "max_abs": 13.75 + }, + "full_input": { + "shape": [ + 271, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "49f03b7ce85852484ba66bcdcef82b3beddd217acac2acd154a9dd622efe1fc3", + "mean": -0.007779614068567753, + "std": 4.266379356384277, + "rms": 4.266385555267334, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d1e8fc0c3bbeb3aca64459993303714c4025d21741f8fb83c271d572864fd2c0", + "mean": -0.006906053051352501, + "std": 0.40990355610847473, + "rms": 0.4099617302417755, + "max_abs": 13.9375 + }, + "full_input": { + "shape": [ + 287, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fab8c7c2eb72961f26ce00da813a2a5760bb469a08cac25cf9ab8c8f0d8ff620", + "mean": -0.00809162575751543, + "std": 4.141319751739502, + "rms": 4.141327857971191, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "88dddbb7e85e439be5bcd0dad29765976ba1aa215c39a68ea20f2ca01620f849", + "mean": -0.006549921818077564, + "std": 0.40529537200927734, + "rms": 0.4053483009338379, + "max_abs": 13.25 + }, + "full_input": { + "shape": [ + 271, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9974b5f6a11f8ca96cbc53519251ca356da1dec77652d30f8a189aec275089d4", + "mean": -0.007584358099848032, + "std": 4.266093730926514, + "rms": 4.2661004066467285, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9fa0dc895b0935da6ff4167453fc78e80721f1c07c9f888279116d0714474351", + "mean": -0.006993167567998171, + "std": 0.40903788805007935, + "rms": 0.4090976417064667, + "max_abs": 13.875 + }, + "full_input": { + "shape": [ + 287, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "71512e1070db2f5123a62aa91336c9c8b4184fdb57fdb05eda71f40ce8ce2a9c", + "mean": -0.008194001391530037, + "std": 4.1412034034729, + "rms": 4.141211986541748, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7d45cd1cfdd7659092a1f16d2292cd8691182accdcc98f679d7280edb55ff1d5", + "mean": -0.006803364492952824, + "std": 0.404828280210495, + "rms": 0.4048854112625122, + "max_abs": 13.0625 + }, + "full_input": { + "shape": [ + 271, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9c417ef7ff0b276c90cc043ca43c0bdb17f60a71d7904bf61fcc9a41920d4805", + "mean": -0.00774067547172308, + "std": 4.266043186187744, + "rms": 4.266049861907959, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c6913db801bdffe393f740bdb424bb59acc8f7e85217fa5b6628b9fe81f045bc", + "mean": -0.007135210558772087, + "std": 0.409476637840271, + "rms": 0.40953880548477173, + "max_abs": 13.875 + }, + "full_input": { + "shape": [ + 287, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f4c9abcc4371e4e789739a8c6a8babcf2326c97817f8a582d573c63cd3fe0c55", + "mean": -0.008242764510214329, + "std": 4.141229152679443, + "rms": 4.141237735748291, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9965145587921143, + "min_cosine_similarity": 0.9542137384414673, + "mean_relative_l2": 0.0711309090256691, + "max_abs_delta": 1.1875 + }, + "system_bos": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9938480854034424, + "min_cosine_similarity": 0.9186078310012817, + "mean_relative_l2": 0.09707910567522049, + "max_abs_delta": 1.84375 + }, + "system_x": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9898877143859863, + "min_cosine_similarity": 0.8847849369049072, + "mean_relative_l2": 0.1284705102443695, + "max_abs_delta": 1.375 + }, + "system_period": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9901812076568604, + "min_cosine_similarity": 0.8984225988388062, + "mean_relative_l2": 0.1297983080148697, + "max_abs_delta": 1.40625 + }, + "bos_at_s0": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9919559359550476, + "min_cosine_similarity": 0.9226120114326477, + "mean_relative_l2": 0.1165400817990303, + "max_abs_delta": 1.25 + }, + "bos_at_s1": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.990441620349884, + "min_cosine_similarity": 0.8978202939033508, + "mean_relative_l2": 0.12786133587360382, + "max_abs_delta": 1.5 + }, + "x_at_s0": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9882748126983643, + "min_cosine_similarity": 0.8723942637443542, + "mean_relative_l2": 0.13571080565452576, + "max_abs_delta": 2.40625 + }, + "x_at_s1": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9845781922340393, + "min_cosine_similarity": 0.7527467012405396, + "mean_relative_l2": 0.1577228158712387, + "max_abs_delta": 2.21875 + }, + "period_at_s0": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.989201009273529, + "min_cosine_similarity": 0.8699750900268555, + "mean_relative_l2": 0.13325276970863342, + "max_abs_delta": 1.84375 + }, + "period_at_s1": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9853413105010986, + "min_cosine_similarity": 0.7554657459259033, + "mean_relative_l2": 0.1545337736606598, + "max_abs_delta": 1.625 + } + } + }, + "layer_11": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1b9f5196f0b20d1b8042c72b339ff84d5df81da6bbc62360fb5f0871cd507175", + "mean": -0.010027713142335415, + "std": 0.5099048614501953, + "rms": 0.5100034475326538, + "max_abs": 18.375 + }, + "full_input": { + "shape": [ + 271, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4d5fbf6b22ae537263f7c232e71db3cbd2474b6609c3e92e4948c5300e51fbde", + "mean": -0.014774425886571407, + "std": 4.870978355407715, + "rms": 4.87100076675415, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c96b6acc60dba399ef7b9195150967618dd97ae9c47a4a90b860162caf87ac50", + "mean": -0.010098807513713837, + "std": 0.5092040300369263, + "rms": 0.5093041658401489, + "max_abs": 18.375 + }, + "full_input": { + "shape": [ + 287, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "60bcad7c0af747b403509cf02551df5c99f074181fe9b76fedd44c182e93ed51", + "mean": -0.015323270112276077, + "std": 4.875003337860107, + "rms": 4.875027179718018, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3ec61ad94e9e3cda5dce353b1aeeb9ad2aa7842ef6691c3fb4f73dd7ba1485c6", + "mean": -0.010080060921609402, + "std": 0.5118101239204407, + "rms": 0.5119093656539917, + "max_abs": 18.25 + }, + "full_input": { + "shape": [ + 271, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "dc4119d06d7cdb1343d8e90cc5f65f12a037a2efa6953f2bd2089707ba938135", + "mean": -0.010667391121387482, + "std": 4.29700231552124, + "rms": 4.297015190124512, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cf413fe9412a17d89a8083b3058a21fddafb6d824b81206d6bc9852a85188117", + "mean": -0.010328423231840134, + "std": 0.5114090442657471, + "rms": 0.511513352394104, + "max_abs": 18.375 + }, + "full_input": { + "shape": [ + 287, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "95c8e91e7b448445e15644e61fa5b08e6ae2d213866c36f1a354371648faa3e2", + "mean": -0.010914759710431099, + "std": 4.171216011047363, + "rms": 4.171230316162109, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "22a11fd9d73047b747d7ebeca10c51579d58a7eb25657dbe61f387e34eb9aa95", + "mean": -0.010009795427322388, + "std": 0.5097484588623047, + "rms": 0.5098466873168945, + "max_abs": 18.125 + }, + "full_input": { + "shape": [ + 271, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bf6daeb66918af76923e3c10473fff83b7a707a52f86043f8346abb641dfe835", + "mean": -0.01054313499480486, + "std": 4.296782970428467, + "rms": 4.296795845031738, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c469c93aa54ab53601151f796a4fc60197db75037c749beed2165e2d71b69ff4", + "mean": -0.010371110402047634, + "std": 0.5094219446182251, + "rms": 0.5095275640487671, + "max_abs": 18.5 + }, + "full_input": { + "shape": [ + 287, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4fac7dd7d85c8e23bfd0294e13f919f4b177568dbc0b47e1fc5c8d5b40707ee8", + "mean": -0.010894663631916046, + "std": 4.170933723449707, + "rms": 4.170947551727295, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "30f3f7ebf7ca00e09444943d05b8c034722698bfc95d80481143501465109ecf", + "mean": -0.01024935394525528, + "std": 0.5091161727905273, + "rms": 0.5092193484306335, + "max_abs": 18.125 + }, + "full_input": { + "shape": [ + 271, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "612535c590bc03bcb299e1f8becb1607cac94c0a61daa2457140d808152568d2", + "mean": -0.01070401631295681, + "std": 4.296689987182617, + "rms": 4.296703338623047, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b8fcf73c32cee55ab4869b1a182a60eac23ad494da7055eb4c8f92f297ecb11e", + "mean": -0.010436411015689373, + "std": 0.5103573799133301, + "rms": 0.510464072227478, + "max_abs": 18.375 + }, + "full_input": { + "shape": [ + 287, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1e27eca317673470374e8a69bba990cdb3e0226cdcccfd50b6e67b0d2297173c", + "mean": -0.010897411033511162, + "std": 4.171018123626709, + "rms": 4.171031951904297, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9970394372940063, + "min_cosine_similarity": 0.9664115309715271, + "mean_relative_l2": 0.06627865880727768, + "max_abs_delta": 1.3125 + }, + "system_bos": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9948001503944397, + "min_cosine_similarity": 0.9378215074539185, + "mean_relative_l2": 0.08914471417665482, + "max_abs_delta": 2.25 + }, + "system_x": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9909350275993347, + "min_cosine_similarity": 0.8593401908874512, + "mean_relative_l2": 0.11924520134925842, + "max_abs_delta": 1.75 + }, + "system_period": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9914055466651917, + "min_cosine_similarity": 0.8860559463500977, + "mean_relative_l2": 0.11883074045181274, + "max_abs_delta": 1.875 + }, + "bos_at_s0": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9936385154724121, + "min_cosine_similarity": 0.9414637088775635, + "mean_relative_l2": 0.1023171916604042, + "max_abs_delta": 1.625 + }, + "bos_at_s1": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9923557639122009, + "min_cosine_similarity": 0.916948139667511, + "mean_relative_l2": 0.1128370389342308, + "max_abs_delta": 2.375 + }, + "x_at_s0": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9900087118148804, + "min_cosine_similarity": 0.8832403421401978, + "mean_relative_l2": 0.12507207691669464, + "max_abs_delta": 3.5 + }, + "x_at_s1": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.986979067325592, + "min_cosine_similarity": 0.7611192464828491, + "mean_relative_l2": 0.14276693761348724, + "max_abs_delta": 2.5625 + }, + "period_at_s0": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.990890383720398, + "min_cosine_similarity": 0.8832287788391113, + "mean_relative_l2": 0.12178727984428406, + "max_abs_delta": 2.875 + }, + "period_at_s1": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9877414703369141, + "min_cosine_similarity": 0.7680280804634094, + "mean_relative_l2": 0.1391552984714508, + "max_abs_delta": 2.15625 + } + } + }, + "layer_12": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "918197a6bfc432c7d2dd72f7a7937410448a04e4db48ebfeea9e5954ee1f9785", + "mean": -0.010711814276874065, + "std": 0.5254679918289185, + "rms": 0.5255771279335022, + "max_abs": 18.5 + }, + "full_input": { + "shape": [ + 271, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e4668e33139531ac05373635cf35d50f5cacfc4ce64ff4dad1a2bf62037288e2", + "mean": -0.01567395217716694, + "std": 4.905605316162109, + "rms": 4.905630588531494, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1e168ff1c56ae092ae7f3df719cd7619930084650efa6b2b8b1a19e972305a8d", + "mean": -0.010890067555010319, + "std": 0.525566816329956, + "rms": 0.5256796479225159, + "max_abs": 18.5 + }, + "full_input": { + "shape": [ + 287, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "48a5df481744c4786e2f64d5865a4889f34d693eda9e1628657661e682190421", + "mean": -0.01613951474428177, + "std": 4.911654472351074, + "rms": 4.911681175231934, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8a5743282598144c83a77a7ad64d4adb23dc9a229f7208856c56dd6593ed1d83", + "mean": -0.010751747526228428, + "std": 0.5263715982437134, + "rms": 0.5264813899993896, + "max_abs": 18.0 + }, + "full_input": { + "shape": [ + 271, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c348f38e4c07957a92c3f24e79b63cff512008ab15fd51b1efc9b1b2881a1dac", + "mean": -0.011477946303784847, + "std": 4.305592060089111, + "rms": 4.305607318878174, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "846cffe3481e957edbc46153d9df4cf98f5bf94cad352cefd43d7ab8e2c95b9f", + "mean": -0.011029365472495556, + "std": 0.5259027481079102, + "rms": 0.5260183811187744, + "max_abs": 18.125 + }, + "full_input": { + "shape": [ + 287, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2f287fb97397274280ff18bf4c818da3b5428b1ddbd06f686a1aa1a236f56d06", + "mean": -0.011634742841124535, + "std": 4.180049419403076, + "rms": 4.180065631866455, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d7d6dd704036cc5b889c2b525d6e93b7f2d93995cfb429d8a52ee02d59791c9d", + "mean": -0.010787107050418854, + "std": 0.5251964926719666, + "rms": 0.5253072381019592, + "max_abs": 18.25 + }, + "full_input": { + "shape": [ + 271, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b9d60904c3d64ca46658bf96b7d22b731ef2f3b16356c284ff0b303ce961992e", + "mean": -0.011546513065695763, + "std": 4.305473327636719, + "rms": 4.3054890632629395, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c083b52449a19a1bdb654bff68165bc595671e64d116432b1b509337ace84b5f", + "mean": -0.011202153749763966, + "std": 0.5239517688751221, + "rms": 0.524071455001831, + "max_abs": 18.25 + }, + "full_input": { + "shape": [ + 287, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fb49b1d921b19aa7c0210424714ba8cdfbd564b72c8e6719a94b8ee15832a0bb", + "mean": -0.011747211217880249, + "std": 4.179718494415283, + "rms": 4.17973518371582, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d1081613befc3e6ba8076fd68f8bee0cf761a1810664ac92dde30ea6f47155f9", + "mean": -0.01088489405810833, + "std": 0.5250519514083862, + "rms": 0.525164783000946, + "max_abs": 18.0 + }, + "full_input": { + "shape": [ + 271, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bcd9cb598e8dc5e70a097733e679b5ecfbb7ec003f4511ef4f88e9c3181dab97", + "mean": -0.011529603973031044, + "std": 4.305419921875, + "rms": 4.3054351806640625, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2a992e7483a6e6c42929744d867d839a41ef524f602e7cf3b9d59a27e7278597", + "mean": -0.011134261265397072, + "std": 0.5245717167854309, + "rms": 0.5246898531913757, + "max_abs": 18.25 + }, + "full_input": { + "shape": [ + 287, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4710bbdbf014f08bf5312c4f40ad161da682b266e937b8adedab1d89cfd8a723", + "mean": -0.011590495705604553, + "std": 4.1797871589660645, + "rms": 4.179803371429443, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.996466875076294, + "min_cosine_similarity": 0.9663779735565186, + "mean_relative_l2": 0.0729370191693306, + "max_abs_delta": 1.125 + }, + "system_bos": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9937598705291748, + "min_cosine_similarity": 0.9018890857696533, + "mean_relative_l2": 0.09777779877185822, + "max_abs_delta": 2.5625 + }, + "system_x": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9890544414520264, + "min_cosine_similarity": 0.744483470916748, + "mean_relative_l2": 0.12913888692855835, + "max_abs_delta": 3.1875 + }, + "system_period": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9899746179580688, + "min_cosine_similarity": 0.8094381093978882, + "mean_relative_l2": 0.12717947363853455, + "max_abs_delta": 3.0625 + }, + "bos_at_s0": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9927887320518494, + "min_cosine_similarity": 0.9281232357025146, + "mean_relative_l2": 0.10908974707126617, + "max_abs_delta": 1.75 + }, + "bos_at_s1": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9913578629493713, + "min_cosine_similarity": 0.8997615575790405, + "mean_relative_l2": 0.11984136700630188, + "max_abs_delta": 2.6875 + }, + "x_at_s0": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9879619479179382, + "min_cosine_similarity": 0.839347243309021, + "mean_relative_l2": 0.1359948217868805, + "max_abs_delta": 4.8125 + }, + "x_at_s1": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.985077440738678, + "min_cosine_similarity": 0.6713991165161133, + "mean_relative_l2": 0.15222692489624023, + "max_abs_delta": 2.71875 + }, + "period_at_s0": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9893356561660767, + "min_cosine_similarity": 0.8312661051750183, + "mean_relative_l2": 0.1310090720653534, + "max_abs_delta": 3.5 + }, + "period_at_s1": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9861261248588562, + "min_cosine_similarity": 0.6796834468841553, + "mean_relative_l2": 0.14753402769565582, + "max_abs_delta": 2.84375 + } + } + }, + "layer_13": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ab9671eec9c651ed26a90831803d8579477989acf27adaee618c60a41095a9de", + "mean": -0.014065796509385109, + "std": 0.5777222514152527, + "rms": 0.5778934955596924, + "max_abs": 21.5 + }, + "full_input": { + "shape": [ + 271, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d67d01e2adfb8c6065a11b59fb46e7532bf5326d5dde77c9f53d906f5d491a57", + "mean": -0.018733281642198563, + "std": 4.914421558380127, + "rms": 4.914457321166992, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0dbc77715d7fa8c442b361b059ad60ec3a4257957cf8f8535217595939296504", + "mean": -0.01440262421965599, + "std": 0.5781697034835815, + "rms": 0.5783491134643555, + "max_abs": 21.625 + }, + "full_input": { + "shape": [ + 287, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2fc51d7d94d2becc6f8d3590324820b4e81fcf2611d90d5efcfca639e5556f95", + "mean": -0.019415387883782387, + "std": 4.920601844787598, + "rms": 4.920640468597412, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c70075de18403a42ef7e1c02d176a1a5124f68a20a7ecbd381ec1a1e3deaeb3f", + "mean": -0.013883234933018684, + "std": 0.5787449479103088, + "rms": 0.5789114236831665, + "max_abs": 21.125 + }, + "full_input": { + "shape": [ + 271, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4a44dc7586e4bf8664dd04dc0edb95e27a95bddc402fe20d444e429ead2b0aa1", + "mean": -0.014319241046905518, + "std": 4.314678192138672, + "rms": 4.314701557159424, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "77c531997b27f9233dd281204d7de27d664cb348bdd8efc4caa57395e1cfc504", + "mean": -0.014365424402058125, + "std": 0.5788419246673584, + "rms": 0.5790202021598816, + "max_abs": 21.25 + }, + "full_input": { + "shape": [ + 287, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fc9bd28903fcb5ba4483331c64db8adae93b1be170bea11e0bca27b0660da5fa", + "mean": -0.01472204178571701, + "std": 4.189451694488525, + "rms": 4.189478397369385, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8c2737ee03d595abb65f9cbd77ffe00460d133ae61adc5b0bc9a24c091bbc71d", + "mean": -0.013942267745733261, + "std": 0.5794327855110168, + "rms": 0.5796005129814148, + "max_abs": 21.375 + }, + "full_input": { + "shape": [ + 271, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f4c195944aeabcab8003779f526b7fcfd16c850a01698eba3548ca39850d610a", + "mean": -0.014443465508520603, + "std": 4.314817905426025, + "rms": 4.314841270446777, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6efff5e4d3a181fe1c6b6099dbd749156b24768155c14ef0747904f76d12bc79", + "mean": -0.014526398852467537, + "std": 0.5770969390869141, + "rms": 0.5772797465324402, + "max_abs": 21.375 + }, + "full_input": { + "shape": [ + 287, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2e5e8753205056dceed863628a9d58b7913f1abc1fe28a2edef98f0da78eb211", + "mean": -0.014844345860183239, + "std": 4.189159393310547, + "rms": 4.189185619354248, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d404422d4b50f0a59eeb7f61a2859bc78fe21245363078b037fb113ae28cc3fd", + "mean": -0.014066053554415703, + "std": 0.5782651901245117, + "rms": 0.5784361958503723, + "max_abs": 21.125 + }, + "full_input": { + "shape": [ + 271, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "531d874bdd23511535cb0edd19eb56657e52b69045f8368c28434da5af1718f0", + "mean": -0.014446067623794079, + "std": 4.314621448516846, + "rms": 4.314645290374756, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d63850cb5d6659c8139f3938663964d756ec913a04981e1ff1940fba7b990e8d", + "mean": -0.014546922408044338, + "std": 0.5771564841270447, + "rms": 0.5773398280143738, + "max_abs": 21.375 + }, + "full_input": { + "shape": [ + 287, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "95254a7281e002b239f6b9f81e3aea9f613854316653b75ed626dcdb260dd26c", + "mean": -0.014771157875657082, + "std": 4.18916130065918, + "rms": 4.189187526702881, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9962419867515564, + "min_cosine_similarity": 0.9648263454437256, + "mean_relative_l2": 0.07586804032325745, + "max_abs_delta": 1.46875 + }, + "system_bos": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9932506084442139, + "min_cosine_similarity": 0.8869367241859436, + "mean_relative_l2": 0.10185254365205765, + "max_abs_delta": 2.5625 + }, + "system_x": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9877852201461792, + "min_cosine_similarity": 0.6427320837974548, + "mean_relative_l2": 0.13302278518676758, + "max_abs_delta": 3.0 + }, + "system_period": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.989323616027832, + "min_cosine_similarity": 0.729625940322876, + "mean_relative_l2": 0.12886494398117065, + "max_abs_delta": 2.6875 + }, + "bos_at_s0": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.992760181427002, + "min_cosine_similarity": 0.9193915128707886, + "mean_relative_l2": 0.10888534039258957, + "max_abs_delta": 2.46875 + }, + "bos_at_s1": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9913969039916992, + "min_cosine_similarity": 0.8903422355651855, + "mean_relative_l2": 0.11901434510946274, + "max_abs_delta": 3.0625 + }, + "x_at_s0": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9866019487380981, + "min_cosine_similarity": 0.8055932521820068, + "mean_relative_l2": 0.14277996122837067, + "max_abs_delta": 4.5625 + }, + "x_at_s1": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9846087098121643, + "min_cosine_similarity": 0.6199374198913574, + "mean_relative_l2": 0.15301808714866638, + "max_abs_delta": 2.75 + }, + "period_at_s0": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9888455867767334, + "min_cosine_similarity": 0.8551186323165894, + "mean_relative_l2": 0.13400225341320038, + "max_abs_delta": 3.25 + }, + "period_at_s1": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9859197735786438, + "min_cosine_similarity": 0.6233224868774414, + "mean_relative_l2": 0.1475902944803238, + "max_abs_delta": 2.9375 + } + } + }, + "layer_14": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "78c800417573572001818f45a917d80d7c371bac75a23968b52962ee73f5d25e", + "mean": -0.012900080531835556, + "std": 0.6627541184425354, + "rms": 0.6628797054290771, + "max_abs": 24.25 + }, + "full_input": { + "shape": [ + 271, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9bd43ebdd0a2b070c7c09e42ff649ee190913058e657785e3b86b3d400766b31", + "mean": -0.01745731011033058, + "std": 4.932918071746826, + "rms": 4.932948589324951, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6dcb2117016cdf130c9dc4874e611776cb1f023afbf219b757be8f21a3b1035c", + "mean": -0.013481391593813896, + "std": 0.6628920435905457, + "rms": 0.6630290746688843, + "max_abs": 24.5 + }, + "full_input": { + "shape": [ + 287, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "24e7bfac57fa159fb0a255f71ad63ae9aabd0dd66774a7c2ab12ec113e2df563", + "mean": -0.018500778824090958, + "std": 4.938326358795166, + "rms": 4.938360691070557, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3c3d07f05227874261f51d6d4a1ebe486af97a657337b4e936cc8e62111f2fd3", + "mean": -0.012804497964680195, + "std": 0.663533627986908, + "rms": 0.6636571884155273, + "max_abs": 24.0 + }, + "full_input": { + "shape": [ + 271, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2f6435fff1ef842429b462bcb8b5cee68bf85c2aa4d6fbd30961ad5b62b9a7d3", + "mean": -0.013128882274031639, + "std": 4.335148334503174, + "rms": 4.335168361663818, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "88a8aae3f3b3b48a9f3b98d8aaf16fdcdbbf924cd64399bd2914cbc4f6edbc64", + "mean": -0.013478877022862434, + "std": 0.6633555293083191, + "rms": 0.6634924411773682, + "max_abs": 24.125 + }, + "full_input": { + "shape": [ + 287, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0d167ad981c139e0c616ba688e96d37a02bd0f1f605d587d053822bf3409ea01", + "mean": -0.013811277225613594, + "std": 4.2096405029296875, + "rms": 4.209663391113281, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2b5adbead80afd555320500ad134e2a1bf967f128c76d443e3aea3e2117a444f", + "mean": -0.013323953375220299, + "std": 0.6640096306800842, + "rms": 0.6641432642936707, + "max_abs": 24.25 + }, + "full_input": { + "shape": [ + 271, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "108805a12a9d759865e7282bfadbddd3038204d27e424089decff9464a7eb0c6", + "mean": -0.01366380788385868, + "std": 4.335298538208008, + "rms": 4.335319995880127, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9aeda389b963c05a0813a1ffa3dc13126c86dc076e52ec46aa229a8ee63892e1", + "mean": -0.013746371492743492, + "std": 0.6617439389228821, + "rms": 0.6618866920471191, + "max_abs": 24.25 + }, + "full_input": { + "shape": [ + 287, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0fa099c78369edbc4ac7000b714ff75595b1cdc20a759b69ba2eecc2dde684dc", + "mean": -0.014029284007847309, + "std": 4.209364414215088, + "rms": 4.20938777923584, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4fefc0ab5fbe4f47e3a42bd900c2f43318fba9a3352177ae9c6b2cc5431fcea8", + "mean": -0.013299699872732162, + "std": 0.6626074910163879, + "rms": 0.66274094581604, + "max_abs": 23.875 + }, + "full_input": { + "shape": [ + 271, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a9a01d1dcb4795e87342e8e54953edcc9a6db2fc8ed94181c48a194f4def0d04", + "mean": -0.013540119864046574, + "std": 4.335039138793945, + "rms": 4.335060119628906, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a05154d0c569a482011a222d2197bb6b38a7aa62cf1d9d7f0fa3c0744dbb4080", + "mean": -0.013637629337608814, + "std": 0.6608728766441345, + "rms": 0.6610135436058044, + "max_abs": 24.25 + }, + "full_input": { + "shape": [ + 287, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bced417e5d0ce36a133af95b50a73161e5467357fe9850102dc217ad3ef48497", + "mean": -0.013878685422241688, + "std": 4.2092180252075195, + "rms": 4.209240913391113, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9962143898010254, + "min_cosine_similarity": 0.9646742343902588, + "mean_relative_l2": 0.07648473978042603, + "max_abs_delta": 1.5 + }, + "system_bos": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9936058521270752, + "min_cosine_similarity": 0.9041529297828674, + "mean_relative_l2": 0.09977414458990097, + "max_abs_delta": 2.75 + }, + "system_x": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9876848459243774, + "min_cosine_similarity": 0.6175792217254639, + "mean_relative_l2": 0.13279342651367188, + "max_abs_delta": 2.5 + }, + "system_period": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.989059329032898, + "min_cosine_similarity": 0.685498058795929, + "mean_relative_l2": 0.1291094422340393, + "max_abs_delta": 2.46875 + }, + "bos_at_s0": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9931469559669495, + "min_cosine_similarity": 0.9207183122634888, + "mean_relative_l2": 0.10585445165634155, + "max_abs_delta": 2.8125 + }, + "bos_at_s1": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9917986392974854, + "min_cosine_similarity": 0.8869472742080688, + "mean_relative_l2": 0.11609971523284912, + "max_abs_delta": 3.375 + }, + "x_at_s0": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9868558645248413, + "min_cosine_similarity": 0.7920328974723816, + "mean_relative_l2": 0.14135366678237915, + "max_abs_delta": 4.28125 + }, + "x_at_s1": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9848496317863464, + "min_cosine_similarity": 0.6019187569618225, + "mean_relative_l2": 0.15113215148448944, + "max_abs_delta": 2.84375 + }, + "period_at_s0": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9890621900558472, + "min_cosine_similarity": 0.8662286400794983, + "mean_relative_l2": 0.13241618871688843, + "max_abs_delta": 3.21875 + }, + "period_at_s1": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9860833883285522, + "min_cosine_similarity": 0.5877967476844788, + "mean_relative_l2": 0.14560145139694214, + "max_abs_delta": 3.75 + } + } + }, + "layer_15": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1c4661b43ef18c2a1b5367ad80df281bd3cb8d470c7bf66b24a096dba68cc9c6", + "mean": -0.01578628271818161, + "std": 0.733225405216217, + "rms": 0.7333953380584717, + "max_abs": 25.625 + }, + "full_input": { + "shape": [ + 271, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a8308b3c2047899b829c1ca29305d27c3993157668a5d72fe4d763dba8e7431c", + "mean": -0.019853314384818077, + "std": 4.9447340965271, + "rms": 4.944774150848389, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "321ef0dde7e307234cb8b60d985b366c233bc3a87b9b95e2b8ad223205141862", + "mean": -0.016408834606409073, + "std": 0.7330518364906311, + "rms": 0.7332354187965393, + "max_abs": 26.0 + }, + "full_input": { + "shape": [ + 287, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8a422c6c68b4dabe4aa9e1a98871da9673f7f03cc4d47429918472dee7cf13b3", + "mean": -0.02095804363489151, + "std": 4.950315952301025, + "rms": 4.950360298156738, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "50a5ad77458725a61efd52ca25f0c81afdd95693dd0c4534b17aff2d0f7f847e", + "mean": -0.01564471237361431, + "std": 0.7341882586479187, + "rms": 0.7343549132347107, + "max_abs": 25.75 + }, + "full_input": { + "shape": [ + 271, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d710b2fc1421d2432fabd7006bb61c552fc55ca4b49148c33c01dac52e09ed4e", + "mean": -0.015499178320169449, + "std": 4.348248481750488, + "rms": 4.348276138305664, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fd0cc9127001cec051bbd8dc4bdd1464c44e53649484ddee3180897210db5751", + "mean": -0.016364576295018196, + "std": 0.7335590720176697, + "rms": 0.7337416410446167, + "max_abs": 25.75 + }, + "full_input": { + "shape": [ + 287, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ee03ed4d8190606eec94a78703e839939b46a6c4749c9dfb5118c584220af7af", + "mean": -0.01625918783247471, + "std": 4.223178386688232, + "rms": 4.223209381103516, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f803ec64ffb8ac5c9d283635db2b9fb7ac091c3045efcc9dfc1cc7f4b823eb5a", + "mean": -0.016530239954590797, + "std": 0.7358134984970093, + "rms": 0.7359991669654846, + "max_abs": 25.75 + }, + "full_input": { + "shape": [ + 271, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "90d1b6c8c7584c657ecead9f33edf7e86866e771eba55e795afe34658536028e", + "mean": -0.01636253111064434, + "std": 4.348576545715332, + "rms": 4.348607063293457, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2187390374532549c22195f1e1c4c5824aa34b14987f40eca275e48de8f420fd", + "mean": -0.017080791294574738, + "std": 0.7311069369316101, + "rms": 0.7313063740730286, + "max_abs": 25.75 + }, + "full_input": { + "shape": [ + 287, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6211852b4f4bfa60ede98e66a516a53709ff055a2ebd2983212266b6f510ddac", + "mean": -0.016878822818398476, + "std": 4.2227373123168945, + "rms": 4.222771167755127, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7d82b7d9a11dc2e509efad759100c8d91594862018caab95e147f07157f3c575", + "mean": -0.01648861914873123, + "std": 0.734284520149231, + "rms": 0.7344696521759033, + "max_abs": 25.75 + }, + "full_input": { + "shape": [ + 271, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8a4cde1651fe8193dc7715fd767eed5f56b98a5f0dcae5822c2bd5d9759be58f", + "mean": -0.01621808111667633, + "std": 4.348277568817139, + "rms": 4.348308086395264, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "36de2378411022c64f51f3413b46327b257391778a8de198edff7d6e0132b91a", + "mean": -0.016915656626224518, + "std": 0.7302087545394897, + "rms": 0.7304046750068665, + "max_abs": 25.75 + }, + "full_input": { + "shape": [ + 287, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6089838aad945c87d5683c591751fa74691bdfa8595cae79ea64fb1329a50774", + "mean": -0.01663883775472641, + "std": 4.222599029541016, + "rms": 4.222631931304932, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9961636066436768, + "min_cosine_similarity": 0.9603108167648315, + "mean_relative_l2": 0.07676253467798233, + "max_abs_delta": 1.5625 + }, + "system_bos": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9936650991439819, + "min_cosine_similarity": 0.9040668606758118, + "mean_relative_l2": 0.0997234433889389, + "max_abs_delta": 2.5 + }, + "system_x": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9877846837043762, + "min_cosine_similarity": 0.6300652027130127, + "mean_relative_l2": 0.1323673278093338, + "max_abs_delta": 2.375 + }, + "system_period": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9891524314880371, + "min_cosine_similarity": 0.7009758949279785, + "mean_relative_l2": 0.12851831316947937, + "max_abs_delta": 2.40625 + }, + "bos_at_s0": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9932997226715088, + "min_cosine_similarity": 0.9185630083084106, + "mean_relative_l2": 0.10427074879407883, + "max_abs_delta": 3.3125 + }, + "bos_at_s1": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9919654130935669, + "min_cosine_similarity": 0.8883346319198608, + "mean_relative_l2": 0.1147182360291481, + "max_abs_delta": 3.625 + }, + "x_at_s0": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9870039224624634, + "min_cosine_similarity": 0.7779566049575806, + "mean_relative_l2": 0.14010089635849, + "max_abs_delta": 4.25 + }, + "x_at_s1": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9851882457733154, + "min_cosine_similarity": 0.6080225706100464, + "mean_relative_l2": 0.14883378148078918, + "max_abs_delta": 3.125 + }, + "period_at_s0": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9892672300338745, + "min_cosine_similarity": 0.8722900152206421, + "mean_relative_l2": 0.13061954081058502, + "max_abs_delta": 3.15625 + }, + "period_at_s1": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9863362312316895, + "min_cosine_similarity": 0.5935829877853394, + "mean_relative_l2": 0.14370638132095337, + "max_abs_delta": 3.8125 + } + } + }, + "layer_16": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8ec96300200ae6c8302dc145525080efeb73822d55e82c1acc04a374c59a044b", + "mean": -0.018356436863541603, + "std": 0.8449833989143372, + "rms": 0.8451827764511108, + "max_abs": 27.75 + }, + "full_input": { + "shape": [ + 271, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0e28db850cd4afa1e046ae53eb17a24da0c81ac77d33bc55341fe8d6f5c577b0", + "mean": -0.02207990363240242, + "std": 4.9640350341796875, + "rms": 4.964084148406982, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a5093cb1a88c22771c5638f18f0251e3930c375b9725d3f71bf2fecccf702976", + "mean": -0.018761076033115387, + "std": 0.8453912734985352, + "rms": 0.8455994725227356, + "max_abs": 28.125 + }, + "full_input": { + "shape": [ + 287, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f654d9ce480522b89ca0d89dc7117dbb54589395f516e3d0bbe49b600a969037", + "mean": -0.02276216261088848, + "std": 4.969305992126465, + "rms": 4.969358444213867, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e72f6f0af38daa3072a21b6719e50d21408f3e20f8cc48a43198a837fed5ea64", + "mean": -0.018677763640880585, + "std": 0.8456166386604309, + "rms": 0.8458228707313538, + "max_abs": 27.875 + }, + "full_input": { + "shape": [ + 271, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c32747fb3de242ccdaf8420f8a2260e93223a8180fa2d1af79fb659cd4a82b1b", + "mean": -0.018159855157136917, + "std": 4.369506359100342, + "rms": 4.36954402923584, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b5234a301006f6456552614c8fbd64a9d97e84a5f79dffc3511bb397c42c1a74", + "mean": -0.018971888348460197, + "std": 0.8455389738082886, + "rms": 0.8457517623901367, + "max_abs": 27.875 + }, + "full_input": { + "shape": [ + 287, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1c8efecaf1ffb6f8a7a52cad0da0463ff3d23197bbfdecd4975682414e7677a8", + "mean": -0.018229886889457703, + "std": 4.244819641113281, + "rms": 4.244858264923096, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2b5bd2374ebd6343dad9b206ff1ad28e822cf4a026c0c773d38f497f57ce27b9", + "mean": -0.01941142976284027, + "std": 0.8487781286239624, + "rms": 0.8489999771118164, + "max_abs": 27.875 + }, + "full_input": { + "shape": [ + 271, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d12d8e4806f02e860e6e07aa6fbabdbc0f518b2790dc48b43cea1cd775fc529d", + "mean": -0.01890854723751545, + "std": 4.370253562927246, + "rms": 4.370294094085693, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3df9c638df12641f36ca6d69d918d02709b62634131b0549bb4a6099a1f4d0e4", + "mean": -0.02016262337565422, + "std": 0.8441303968429565, + "rms": 0.8443711400032043, + "max_abs": 27.875 + }, + "full_input": { + "shape": [ + 287, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "baef1d9ac091ff8151cd789cda1d4a64157334a610f3dd513c5119d095e5f545", + "mean": -0.019324664026498795, + "std": 4.244622707366943, + "rms": 4.244666576385498, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c550a3f808d81f108ac9b44168b706ffc3fac8f3a9378679b381e259c1b14a2f", + "mean": -0.01924530230462551, + "std": 0.8470652103424072, + "rms": 0.8472837805747986, + "max_abs": 27.75 + }, + "full_input": { + "shape": [ + 271, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ac08688e144748e447a45df21221430551b94c15234d2690104fd6de887db9ea", + "mean": -0.018637029454112053, + "std": 4.369803428649902, + "rms": 4.369842529296875, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "72aa3cbdc1ed15b45f9a51470e8b7c066df4010a1a446f65df0014ac7f38fce3", + "mean": -0.01984030194580555, + "std": 0.8428412079811096, + "rms": 0.8430746793746948, + "max_abs": 28.0 + }, + "full_input": { + "shape": [ + 287, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "823f497b2402746501e8e328162bc912b4fcb840baa845924819fa96ba9d0751", + "mean": -0.01889563538134098, + "std": 4.244319438934326, + "rms": 4.244361400604248, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9960633516311646, + "min_cosine_similarity": 0.9589480757713318, + "mean_relative_l2": 0.07767602056264877, + "max_abs_delta": 1.515625 + }, + "system_bos": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9936167597770691, + "min_cosine_similarity": 0.9095502495765686, + "mean_relative_l2": 0.10049710422754288, + "max_abs_delta": 2.625 + }, + "system_x": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9875941276550293, + "min_cosine_similarity": 0.5884250402450562, + "mean_relative_l2": 0.13287071883678436, + "max_abs_delta": 2.828125 + }, + "system_period": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9890017509460449, + "min_cosine_similarity": 0.6760385036468506, + "mean_relative_l2": 0.12857268750667572, + "max_abs_delta": 3.5625 + }, + "bos_at_s0": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9933627843856812, + "min_cosine_similarity": 0.9042649269104004, + "mean_relative_l2": 0.10373760759830475, + "max_abs_delta": 2.6875 + }, + "bos_at_s1": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9919717311859131, + "min_cosine_similarity": 0.8942641019821167, + "mean_relative_l2": 0.11504863947629929, + "max_abs_delta": 3.1875 + }, + "x_at_s0": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9868292808532715, + "min_cosine_similarity": 0.7655723094940186, + "mean_relative_l2": 0.1409250944852829, + "max_abs_delta": 4.28125 + }, + "x_at_s1": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9848824739456177, + "min_cosine_similarity": 0.5696996450424194, + "mean_relative_l2": 0.1497514843940735, + "max_abs_delta": 3.625 + }, + "period_at_s0": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9890527725219727, + "min_cosine_similarity": 0.8680940866470337, + "mean_relative_l2": 0.1314024180173874, + "max_abs_delta": 3.34375 + }, + "period_at_s1": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9863216876983643, + "min_cosine_similarity": 0.5848082304000854, + "mean_relative_l2": 0.14379779994487762, + "max_abs_delta": 3.75 + } + } + }, + "layer_17": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f473c03cfda622262ef3700a33d3e456c89fb74db463d56a8b4871549c681baf", + "mean": -0.02092595584690571, + "std": 0.9630687236785889, + "rms": 0.9632959961891174, + "max_abs": 29.125 + }, + "full_input": { + "shape": [ + 271, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a5cf27ea0126236d6d955889895025bdfdb6677d05d58b026b8530a9c2f8f3a7", + "mean": -0.024591965600848198, + "std": 4.986856460571289, + "rms": 4.986917018890381, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1e819227f96d2be48ba9834d183321e49dc917f41c866a69015ed6536db35e47", + "mean": -0.021366648375988007, + "std": 0.9630536437034607, + "rms": 0.9632906317710876, + "max_abs": 29.375 + }, + "full_input": { + "shape": [ + 287, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e97e90cb8b4a3c3564fd2f277752f43cb4f6af7c9a91e2c3a75307b6d0244128", + "mean": -0.025442084297537804, + "std": 4.992083549499512, + "rms": 4.992148399353027, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "12c19bddc3a2d37056048d8cc9cd0ea41f93d5f50bda49427da60d38858aa8e0", + "mean": -0.0209482591599226, + "std": 0.964857280254364, + "rms": 0.9650846123695374, + "max_abs": 29.125 + }, + "full_input": { + "shape": [ + 271, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c9a6fc6555143b3b8ee891f8b88c5d3ad95424f4e8ce719c62393223a0e4db5c", + "mean": -0.020397711545228958, + "std": 4.395269393920898, + "rms": 4.3953166007995605, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "12137d4a77421b3296e534165cf591c8b00a4e43cced19fc089b459156e408ce", + "mean": -0.021230414509773254, + "std": 0.9633188843727112, + "rms": 0.9635527729988098, + "max_abs": 29.125 + }, + "full_input": { + "shape": [ + 287, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e1373c642ce2ad4b7800050742577bec19d4cdba87575840b68746c1e37e406e", + "mean": -0.02064904011785984, + "std": 4.271128177642822, + "rms": 4.271178245544434, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a8d439592c77cfab4aca355ee383e3627e7dbd4f2761ed6bd51ba5fa23c700d8", + "mean": -0.02179071307182312, + "std": 0.9680442214012146, + "rms": 0.9682894349098206, + "max_abs": 29.375 + }, + "full_input": { + "shape": [ + 271, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "de9a8b9714411291255d8c089f06433b191c3cf57bd9152b2d502b4a218aba21", + "mean": -0.021260257810354233, + "std": 4.396154403686523, + "rms": 4.396205902099609, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "41fd4746e9778652b607385be20e48d5d7d96335f9f08ee915b2f636c3aea662", + "mean": -0.022305699065327644, + "std": 0.9633735418319702, + "rms": 0.9636316895484924, + "max_abs": 29.25 + }, + "full_input": { + "shape": [ + 287, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "eca2c956d651bc31f8a11f3bf91a298cdae9dde47e45278b20c801888838cad9", + "mean": -0.021658943966031075, + "std": 4.271273612976074, + "rms": 4.271328926086426, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d8844414ded7f3e3fc5cd966a81fbe4150a948cfeeb9e27d0b6bdf07c3779687", + "mean": -0.02145342342555523, + "std": 0.9658671021461487, + "rms": 0.9661052823066711, + "max_abs": 29.125 + }, + "full_input": { + "shape": [ + 271, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "96a36156f649e202f38b146a4d09d2fbda17f7d31523ae55b1a2cc710b8eb488", + "mean": -0.020801015198230743, + "std": 4.395535469055176, + "rms": 4.395585060119629, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "42e35e779a03788c99fe6038b868261c28d65825f2d57779d78c8a8d72491697", + "mean": -0.02177288383245468, + "std": 0.9610633254051208, + "rms": 0.9613099098205566, + "max_abs": 29.375 + }, + "full_input": { + "shape": [ + 287, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "508bbc34374d30ad507f3b903898b80bbde1d4fb9d9a25a98698cde9bdfa249b", + "mean": -0.02103467285633087, + "std": 4.270787239074707, + "rms": 4.270839214324951, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9961267113685608, + "min_cosine_similarity": 0.9601829051971436, + "mean_relative_l2": 0.0768602266907692, + "max_abs_delta": 1.890625 + }, + "system_bos": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9938238263130188, + "min_cosine_similarity": 0.9136829376220703, + "mean_relative_l2": 0.09880440682172775, + "max_abs_delta": 2.5625 + }, + "system_x": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9878402352333069, + "min_cosine_similarity": 0.5960439443588257, + "mean_relative_l2": 0.1312512904405594, + "max_abs_delta": 4.0 + }, + "system_period": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9892582297325134, + "min_cosine_similarity": 0.6770669221878052, + "mean_relative_l2": 0.12684239447116852, + "max_abs_delta": 3.5 + }, + "bos_at_s0": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9936197400093079, + "min_cosine_similarity": 0.9089574217796326, + "mean_relative_l2": 0.10183898359537125, + "max_abs_delta": 3.125 + }, + "bos_at_s1": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.992192804813385, + "min_cosine_similarity": 0.8962928056716919, + "mean_relative_l2": 0.11350132524967194, + "max_abs_delta": 2.375 + }, + "x_at_s0": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9870328903198242, + "min_cosine_similarity": 0.7773348689079285, + "mean_relative_l2": 0.13983270525932312, + "max_abs_delta": 4.75 + }, + "x_at_s1": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9853475689888, + "min_cosine_similarity": 0.5782426595687866, + "mean_relative_l2": 0.14758360385894775, + "max_abs_delta": 3.3125 + }, + "period_at_s0": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9892575144767761, + "min_cosine_similarity": 0.8661548495292664, + "mean_relative_l2": 0.13023540377616882, + "max_abs_delta": 3.25 + }, + "period_at_s1": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.986791729927063, + "min_cosine_similarity": 0.5910108089447021, + "mean_relative_l2": 0.1415349543094635, + "max_abs_delta": 3.75 + } + } + }, + "layer_18": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ecc589b9e6991945037c7d0f0c62e0c34954b8b13ce470070f7bf4ac1bfa738f", + "mean": -0.020145565271377563, + "std": 1.1286145448684692, + "rms": 1.1287943124771118, + "max_abs": 31.75 + }, + "full_input": { + "shape": [ + 271, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d366638c0a5875a0515fb775a3d18b86c1b0e932f64530e65f71c0a914fb7845", + "mean": -0.023898262530565262, + "std": 5.023797988891602, + "rms": 5.023854732513428, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e3108704c01370991f23427acbd4042c355756cc779626e72eea0379e6a1df2d", + "mean": -0.020618416368961334, + "std": 1.1266227960586548, + "rms": 1.1268115043640137, + "max_abs": 32.0 + }, + "full_input": { + "shape": [ + 287, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1b3cb9f34e0b75121edffdc9179aaab23fef8ea52e85c2e82e89c0da986ab352", + "mean": -0.02473670244216919, + "std": 5.028193950653076, + "rms": 5.028254508972168, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b8ecd62e9d7ad3dfde42e48ad630f88f257becac5518de07c0b469a7949aca08", + "mean": -0.020185796543955803, + "std": 1.128596305847168, + "rms": 1.1287767887115479, + "max_abs": 31.75 + }, + "full_input": { + "shape": [ + 271, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "926d00761536ba4f4a96425caaa018e6efec1f98118b570befba80bf943d9732", + "mean": -0.01962638832628727, + "std": 4.435108184814453, + "rms": 4.43515157699585, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a1159242814f5df8dfd326d19844a4585bd57e8b691e63f6982711941b292323", + "mean": -0.020235266536474228, + "std": 1.1265053749084473, + "rms": 1.1266870498657227, + "max_abs": 31.75 + }, + "full_input": { + "shape": [ + 287, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3bf45c7cb57fd75f0bac47660fddb19e7fea338f335e0557d2fc349b77f32169", + "mean": -0.01968303695321083, + "std": 4.31151008605957, + "rms": 4.311554908752441, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "70da7311b0e516c3ab76c270f11079db5ed3fb49d13243fbf6269f87d9390de8", + "mean": -0.021221740171313286, + "std": 1.133664608001709, + "rms": 1.1338632106781006, + "max_abs": 32.0 + }, + "full_input": { + "shape": [ + 271, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "37bda1a75b64fb57b328e2d1390fe96707d454e9397bb6731419635dc658eb53", + "mean": -0.02074354514479637, + "std": 4.436610698699951, + "rms": 4.43665885925293, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bc8c5ea16a9fbb06c29a61e37e5bae1357af9f622083e4248953682c769deeae", + "mean": -0.021816927939653397, + "std": 1.124600887298584, + "rms": 1.1248126029968262, + "max_abs": 31.75 + }, + "full_input": { + "shape": [ + 287, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "44f1728ee1bd618419276127b43dc7d39f2264f2b912585f3e4c2edb8691d80f", + "mean": -0.021117135882377625, + "std": 4.311312675476074, + "rms": 4.31136417388916, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b67826087be4e0caa73849bc60a4cb9bf03e18706a84672e2c4ad268977317e6", + "mean": -0.020792922005057335, + "std": 1.1305302381515503, + "rms": 1.1307213306427002, + "max_abs": 31.625 + }, + "full_input": { + "shape": [ + 271, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "44446e496f78aa2b6ee3738ee0c2cd880d0c95c3955c04c470e0c9c599ac9a5d", + "mean": -0.020221484825015068, + "std": 4.435678482055664, + "rms": 4.43572473526001, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8ed2c80e1aaf39217fbaaa7a1a6c1bb34af19241f7e98229fbdcef21b311d0b1", + "mean": -0.02129681594669819, + "std": 1.120168685913086, + "rms": 1.1203709840774536, + "max_abs": 31.875 + }, + "full_input": { + "shape": [ + 287, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5f4e05cfa2fb524584cbc2d513285777cbd3f5623352f375d1d44bae322f6b49", + "mean": -0.02054569497704506, + "std": 4.310207843780518, + "rms": 4.3102569580078125, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9959164261817932, + "min_cosine_similarity": 0.9500148296356201, + "mean_relative_l2": 0.07761308550834656, + "max_abs_delta": 2.9375 + }, + "system_bos": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9937120079994202, + "min_cosine_similarity": 0.90378338098526, + "mean_relative_l2": 0.0986752063035965, + "max_abs_delta": 3.359375 + }, + "system_x": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9872832894325256, + "min_cosine_similarity": 0.523774266242981, + "mean_relative_l2": 0.13192816078662872, + "max_abs_delta": 4.25 + }, + "system_period": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9887206554412842, + "min_cosine_similarity": 0.6217111349105835, + "mean_relative_l2": 0.12762552499771118, + "max_abs_delta": 3.375 + }, + "bos_at_s0": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9937326312065125, + "min_cosine_similarity": 0.9056105613708496, + "mean_relative_l2": 0.10011560469865799, + "max_abs_delta": 2.875 + }, + "bos_at_s1": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.992085337638855, + "min_cosine_similarity": 0.8408067226409912, + "mean_relative_l2": 0.11325717717409134, + "max_abs_delta": 2.5 + }, + "x_at_s0": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9869691133499146, + "min_cosine_similarity": 0.7420622110366821, + "mean_relative_l2": 0.13833700120449066, + "max_abs_delta": 4.3125 + }, + "x_at_s1": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9850589036941528, + "min_cosine_similarity": 0.5395175814628601, + "mean_relative_l2": 0.14735902845859528, + "max_abs_delta": 4.625 + }, + "period_at_s0": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9893114566802979, + "min_cosine_similarity": 0.8545311689376831, + "mean_relative_l2": 0.12875336408615112, + "max_abs_delta": 3.3125 + }, + "period_at_s1": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9864796996116638, + "min_cosine_similarity": 0.5492717027664185, + "mean_relative_l2": 0.14155149459838867, + "max_abs_delta": 4.5625 + } + } + }, + "layer_19": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "354eac2e2eb96aafb8b898cadc17434cc59d186feb9ac9c4ba068ba03c8c3d50", + "mean": -0.020872056484222412, + "std": 1.2678371667861938, + "rms": 1.268009066581726, + "max_abs": 35.75 + }, + "full_input": { + "shape": [ + 271, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ad4639caaa07c3ba686866d26f65e7f6fb77e401cbc01c8af6c18f74bb724031", + "mean": -0.02437102422118187, + "std": 5.054047584533691, + "rms": 5.054106712341309, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9186d4529c13111fa547000add3933169d92a7da8f5ed5d3d66738b25189170a", + "mean": -0.021149342879652977, + "std": 1.2671523094177246, + "rms": 1.2673288583755493, + "max_abs": 35.5 + }, + "full_input": { + "shape": [ + 287, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "95ea1d4fa3c5f65ff429a21a3e21af98211d681e5337c7392a427204430836ae", + "mean": -0.024791842326521873, + "std": 5.058613300323486, + "rms": 5.058673858642578, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "529de41671fc1bf5c4791ab6e049093f78382e08f035de98434cf54ec299028f", + "mean": -0.021092118695378304, + "std": 1.268145203590393, + "rms": 1.2683206796646118, + "max_abs": 35.5 + }, + "full_input": { + "shape": [ + 271, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c7c3a8b98b3e3c3667e5e644f67743532c57a502d1ff0e22bcd3aa31bf30c777", + "mean": -0.02035069838166237, + "std": 4.469648838043213, + "rms": 4.469695091247559, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e566bdf5f7992fa26e1fe0a1c6339b4cc97733c95da4cdc1ac458679df728db7", + "mean": -0.02140004187822342, + "std": 1.2663366794586182, + "rms": 1.2665175199508667, + "max_abs": 35.0 + }, + "full_input": { + "shape": [ + 287, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a071023279cac07899a9483ec25c76550f1e8494de5c089af162862f788788fa", + "mean": -0.020317284390330315, + "std": 4.346711158752441, + "rms": 4.346758842468262, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "45131935734835ec55f0382901921127637735153727721f3fa987cf655cbd75", + "mean": -0.022091589868068695, + "std": 1.2706868648529053, + "rms": 1.2708789110183716, + "max_abs": 35.25 + }, + "full_input": { + "shape": [ + 271, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "84e26e5b9791ea308b5c0ab5ca9e9e586c1cadae4c0b41ac2043b2149e04f062", + "mean": -0.021391764283180237, + "std": 4.470806121826172, + "rms": 4.470857620239258, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e85d7049459c2572b305d56aa948272fd987ef00923fa698e7fcb83a8f0a9559", + "mean": -0.022533943876624107, + "std": 1.2649009227752686, + "rms": 1.2651015520095825, + "max_abs": 35.5 + }, + "full_input": { + "shape": [ + 287, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2d3cc3592546139e8d9e1e3995f4b58c2e10a258fd173df13bf0c53e911bb614", + "mean": -0.021331429481506348, + "std": 4.346621513366699, + "rms": 4.346673488616943, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b3af5a47861c894978d260e0b15fb42d3bc6bf20c78a734bdeaf4bb142e2a15c", + "mean": -0.021484749391674995, + "std": 1.2683733701705933, + "rms": 1.2685554027557373, + "max_abs": 35.5 + }, + "full_input": { + "shape": [ + 271, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e58e8d5178be1d0bc1a0aa1902149710187b8a016985fa6ac7c3a91d486c8951", + "mean": -0.02078825607895851, + "std": 4.469929218292236, + "rms": 4.469977855682373, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "de9d5779e0937af18405cb45745820e464c523f27c978a61473661f62576c5fb", + "mean": -0.022051693871617317, + "std": 1.2602611780166626, + "rms": 1.2604541778564453, + "max_abs": 35.0 + }, + "full_input": { + "shape": [ + 287, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5535330e28bf920890564155a3361163a19e0cafae3e248aaa7834f30db1d6de", + "mean": -0.020900672301650047, + "std": 4.345389366149902, + "rms": 4.345439434051514, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9956679344177246, + "min_cosine_similarity": 0.9426818490028381, + "mean_relative_l2": 0.0795787051320076, + "max_abs_delta": 4.296875 + }, + "system_bos": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9933364391326904, + "min_cosine_similarity": 0.8878023624420166, + "mean_relative_l2": 0.10043444484472275, + "max_abs_delta": 4.640625 + }, + "system_x": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9869855046272278, + "min_cosine_similarity": 0.48263198137283325, + "mean_relative_l2": 0.1319727599620819, + "max_abs_delta": 8.0625 + }, + "system_period": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9884505867958069, + "min_cosine_similarity": 0.5722185969352722, + "mean_relative_l2": 0.12784379720687866, + "max_abs_delta": 5.875 + }, + "bos_at_s0": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9935111403465271, + "min_cosine_similarity": 0.8757743835449219, + "mean_relative_l2": 0.1010478213429451, + "max_abs_delta": 2.375 + }, + "bos_at_s1": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9918351173400879, + "min_cosine_similarity": 0.8131957650184631, + "mean_relative_l2": 0.11423253268003464, + "max_abs_delta": 2.1875 + }, + "x_at_s0": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9864940047264099, + "min_cosine_similarity": 0.7123422026634216, + "mean_relative_l2": 0.13996833562850952, + "max_abs_delta": 4.5625 + }, + "x_at_s1": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9845975637435913, + "min_cosine_similarity": 0.5283057689666748, + "mean_relative_l2": 0.14851491153240204, + "max_abs_delta": 6.5625 + }, + "period_at_s0": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9889768362045288, + "min_cosine_similarity": 0.8280777931213379, + "mean_relative_l2": 0.12965209782123566, + "max_abs_delta": 3.6875 + }, + "period_at_s1": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9862152338027954, + "min_cosine_similarity": 0.5375118851661682, + "mean_relative_l2": 0.14226260781288147, + "max_abs_delta": 5.5625 + } + } + }, + "layer_20": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2ecf64d56a4ade34d6e9aa2fd7681e5f430077f9dc31940584ef3380b73c2200", + "mean": -0.023112980648875237, + "std": 1.4816715717315674, + "rms": 1.4818518161773682, + "max_abs": 40.75 + }, + "full_input": { + "shape": [ + 271, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b53813f3fd3fc6778cca9b0485d724244b986eb8bc22e80f54fcbbabb0703eb8", + "mean": -0.026457078754901886, + "std": 5.2518720626831055, + "rms": 5.251938819885254, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "64b386b642684df13d0ee88df9ecd7008af53e8e7232272f695fec85f16aa4b5", + "mean": -0.022970126941800117, + "std": 1.4807785749435425, + "rms": 1.4809566736221313, + "max_abs": 40.0 + }, + "full_input": { + "shape": [ + 287, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cadb55dadbd7cd5600040efbee5decc9504bea1d020ca0cf45f43eb200a260e1", + "mean": -0.0263714250177145, + "std": 5.262757301330566, + "rms": 5.262823581695557, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "81b55329c95a9ce27a2b8059a22d4257458fe5cb2f5fbd77702d933314d11151", + "mean": -0.02310856059193611, + "std": 1.4819326400756836, + "rms": 1.4821128845214844, + "max_abs": 41.0 + }, + "full_input": { + "shape": [ + 271, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "245be4c113464136e3c3eea13545b7ff1d7b144c8d23ca77658fd134e851583f", + "mean": -0.022455358877778053, + "std": 4.532654285430908, + "rms": 4.53270959854126, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "87657e58c9d42b5700616da1e88c33d3766d86f4b821d64d3bf0d0e23d22bbcb", + "mean": -0.02275928482413292, + "std": 1.478897213935852, + "rms": 1.4790723323822021, + "max_abs": 40.75 + }, + "full_input": { + "shape": [ + 287, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "68860006bb1a2a062c24b840346c2176c7879f0b9a1cbe1b2c12bf50d9bd4530", + "mean": -0.021705998107790947, + "std": 4.410172462463379, + "rms": 4.410226345062256, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "52cfe4a9ca829c8c06db1a7b05c5d3e07ddefc7da4288c6b33722ac1cc8e49e5", + "mean": -0.02405538596212864, + "std": 1.4840397834777832, + "rms": 1.4842348098754883, + "max_abs": 40.25 + }, + "full_input": { + "shape": [ + 271, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7c888736067009d804991f95577fe9012e1be3145a187dc532c658413dee75e3", + "mean": -0.023493021726608276, + "std": 4.533936500549316, + "rms": 4.533998012542725, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2b55e79652d32495aa94e862a35de7367f5761d4ba054a9d4a7ac4c9ae175518", + "mean": -0.023967426270246506, + "std": 1.4782377481460571, + "rms": 1.478432059288025, + "max_abs": 40.25 + }, + "full_input": { + "shape": [ + 287, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4c6323f547eaa29af42bf5c152ca0831d7d0aceaef170f0dd341fabcf27dbe74", + "mean": -0.022814223542809486, + "std": 4.410460948944092, + "rms": 4.410520553588867, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "59045286dcba233a63c03523ea84e108d3466a2fa133c6e7eac98ae746cacc81", + "mean": -0.023320846259593964, + "std": 1.4812363386154175, + "rms": 1.4814199209213257, + "max_abs": 40.0 + }, + "full_input": { + "shape": [ + 271, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0a30ad9ddf97d2b972aa2b8be0030c2c65eb4930cfbde8c0d07a132884a29ff1", + "mean": -0.022752558812499046, + "std": 4.532776832580566, + "rms": 4.532834053039551, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "24ecbfa2ddb81cdb8a97c9bae55c8c5ec9b35de1808a2016730520defd44226a", + "mean": -0.023784490302205086, + "std": 1.4712042808532715, + "rms": 1.4713964462280273, + "max_abs": 39.5 + }, + "full_input": { + "shape": [ + 287, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c05cfa62797eaf64d99ffa6c6ec61916c9568a52e6ed3723ba02e246cb7cc612", + "mean": -0.022587429732084274, + "std": 4.408252716064453, + "rms": 4.408310413360596, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9955769181251526, + "min_cosine_similarity": 0.9355374574661255, + "mean_relative_l2": 0.07965871691703796, + "max_abs_delta": 6.4375 + }, + "system_bos": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9933825135231018, + "min_cosine_similarity": 0.8753321170806885, + "mean_relative_l2": 0.09933162480592728, + "max_abs_delta": 7.5625 + }, + "system_x": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9872797131538391, + "min_cosine_similarity": 0.48432043194770813, + "mean_relative_l2": 0.12939250469207764, + "max_abs_delta": 6.625 + }, + "system_period": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9885926246643066, + "min_cosine_similarity": 0.5751775503158569, + "mean_relative_l2": 0.12659743428230286, + "max_abs_delta": 4.875 + }, + "bos_at_s0": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9936661720275879, + "min_cosine_similarity": 0.8372389078140259, + "mean_relative_l2": 0.09884680062532425, + "max_abs_delta": 4.3125 + }, + "bos_at_s1": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9919123649597168, + "min_cosine_similarity": 0.7642126679420471, + "mean_relative_l2": 0.1120261698961258, + "max_abs_delta": 5.25 + }, + "x_at_s0": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9869128465652466, + "min_cosine_similarity": 0.7012954950332642, + "mean_relative_l2": 0.13748157024383545, + "max_abs_delta": 5.5 + }, + "x_at_s1": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9849462509155273, + "min_cosine_similarity": 0.5262676477432251, + "mean_relative_l2": 0.14618539810180664, + "max_abs_delta": 10.0625 + }, + "period_at_s0": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9893755912780762, + "min_cosine_similarity": 0.8123775124549866, + "mean_relative_l2": 0.12731106579303741, + "max_abs_delta": 4.40625 + }, + "period_at_s1": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9864813685417175, + "min_cosine_similarity": 0.5346883535385132, + "mean_relative_l2": 0.1401839554309845, + "max_abs_delta": 7.9375 + } + } + }, + "layer_21": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "735fc641618c6d421a749e3eddc4dd9b0a4fad013ad2b45cc88164d7db6cc8bc", + "mean": -0.020355263724923134, + "std": 1.6453531980514526, + "rms": 1.6454789638519287, + "max_abs": 52.75 + }, + "full_input": { + "shape": [ + 271, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a5860e1c9812690bd8e3f847a52c0345c5ca6c079e46773488c736cc1637aa6e", + "mean": -0.02373579330742359, + "std": 5.343873977661133, + "rms": 5.343926906585693, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "aa9717a60468cb43225843fe7376e41d305dbc3304688b696ca1731f18c1f7ea", + "mean": -0.02023935690522194, + "std": 1.6458802223205566, + "rms": 1.6460046768188477, + "max_abs": 52.75 + }, + "full_input": { + "shape": [ + 287, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fd0b4fb99c77bc6064101c0531c855d988f96d1dda60c026d29879e2a36809b2", + "mean": -0.02361953631043434, + "std": 5.350397109985352, + "rms": 5.350449085235596, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b39e7eba0379a2902fb0ea2dffc3a0e2065b6bc465c6953bfc5b5adf6a8d1697", + "mean": -0.020373951643705368, + "std": 1.645415186882019, + "rms": 1.6455413103103638, + "max_abs": 52.5 + }, + "full_input": { + "shape": [ + 271, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "256c03f3db7263d5cfa88bfda854df15c46cc4a70552a122d31c8bd896bbf372", + "mean": -0.019702505320310593, + "std": 4.576361179351807, + "rms": 4.576403617858887, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "59b3373123550ee5de8e9ec3d42d550b3f5093686c8a76e506ad2119cafa9557", + "mean": -0.019946888089179993, + "std": 1.6436975002288818, + "rms": 1.6438184976577759, + "max_abs": 51.5 + }, + "full_input": { + "shape": [ + 287, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a1099678a96bcfb5cc78d862b4a95c5a95fb6c7f98fac9ccaacd3dd0ce8e5849", + "mean": -0.018821701407432556, + "std": 4.456878185272217, + "rms": 4.456917762756348, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "aed79464bb9da8e928b0b8fd46a3f99cae2d940861612eac389b15845d097852", + "mean": -0.021193884313106537, + "std": 1.6503255367279053, + "rms": 1.6504615545272827, + "max_abs": 52.5 + }, + "full_input": { + "shape": [ + 271, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3dc6e8efd09d0b66b6405befbf8ddd5a1577c8732d5ccea09f93519d0efd2042", + "mean": -0.0206651221960783, + "std": 4.578982830047607, + "rms": 4.579029083251953, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "52ce785bbf1f31dd8852235ba920252120b68eadfbcfcb32575ab588de6c38e2", + "mean": -0.020899027585983276, + "std": 1.6424555778503418, + "rms": 1.6425883769989014, + "max_abs": 51.75 + }, + "full_input": { + "shape": [ + 287, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "14940c1f881b0ef2e7b534f205e82703b495b669db878544b2e098bbfd7fe8ea", + "mean": -0.01984614133834839, + "std": 4.457479953765869, + "rms": 4.457523345947266, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "94d3d49d46dc585ae991eff5385d7fdd1b34028c60a5e97da4e36d991e6a79fc", + "mean": -0.020428916439414024, + "std": 1.6460851430892944, + "rms": 1.6462117433547974, + "max_abs": 52.75 + }, + "full_input": { + "shape": [ + 271, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "97395573be85a7ab677eaf2b81e0d20da501b78f76d484365ca4cd7b72470665", + "mean": -0.0198950357735157, + "std": 4.5769758224487305, + "rms": 4.577019214630127, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "97046e6b1e3a80f314a35df33e5d3da1f666cee93f9cd11ccf4b1060dc41667a", + "mean": -0.02095489203929901, + "std": 1.6347671747207642, + "rms": 1.6349014043807983, + "max_abs": 51.5 + }, + "full_input": { + "shape": [ + 287, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "191a15b7167d7c02b2bbe522d0e51145477e0cd337abe2c9c1471cb4640f30a1", + "mean": -0.0197608582675457, + "std": 4.454488754272461, + "rms": 4.454532146453857, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9952355623245239, + "min_cosine_similarity": 0.9294159412384033, + "mean_relative_l2": 0.08372020721435547, + "max_abs_delta": 6.25 + }, + "system_bos": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9929168820381165, + "min_cosine_similarity": 0.8708956241607666, + "mean_relative_l2": 0.10324261337518692, + "max_abs_delta": 6.875 + }, + "system_x": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9864756464958191, + "min_cosine_similarity": 0.46698689460754395, + "mean_relative_l2": 0.13436420261859894, + "max_abs_delta": 6.9375 + }, + "system_period": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9875153303146362, + "min_cosine_similarity": 0.537070095539093, + "mean_relative_l2": 0.1323852688074112, + "max_abs_delta": 7.25 + }, + "bos_at_s0": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9932016730308533, + "min_cosine_similarity": 0.8327987194061279, + "mean_relative_l2": 0.10292252153158188, + "max_abs_delta": 5.375 + }, + "bos_at_s1": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.99155592918396, + "min_cosine_similarity": 0.7735047340393066, + "mean_relative_l2": 0.11545177549123764, + "max_abs_delta": 5.0 + }, + "x_at_s0": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9860051870346069, + "min_cosine_similarity": 0.6668614149093628, + "mean_relative_l2": 0.1436316817998886, + "max_abs_delta": 7.0 + }, + "x_at_s1": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9840856790542603, + "min_cosine_similarity": 0.5208042860031128, + "mean_relative_l2": 0.15086615085601807, + "max_abs_delta": 10.25 + }, + "period_at_s0": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9885661602020264, + "min_cosine_similarity": 0.7581899166107178, + "mean_relative_l2": 0.13207252323627472, + "max_abs_delta": 4.0625 + }, + "period_at_s1": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9856863021850586, + "min_cosine_similarity": 0.5251306891441345, + "mean_relative_l2": 0.1444353312253952, + "max_abs_delta": 8.625 + } + } + }, + "layer_22": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4c173b91f6820f1a82b91dce19d2da1cfb1b9414cff07d6482cddeca56b1ebf1", + "mean": -0.031173229217529297, + "std": 1.9020572900772095, + "rms": 1.9023126363754272, + "max_abs": 68.0 + }, + "full_input": { + "shape": [ + 271, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4090acbb0091c5b653a2253f386761c33f230595a335e1c7bc95e4db64d9e46a", + "mean": -0.03367012366652489, + "std": 5.424122333526611, + "rms": 5.424226760864258, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "34af98469ef508b058e63003d244fba2a05ed19931748390614c5bf333595f29", + "mean": -0.030557725578546524, + "std": 1.9020665884017944, + "rms": 1.902312159538269, + "max_abs": 68.0 + }, + "full_input": { + "shape": [ + 287, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "39861817c805b2a45b7655e9f1e9a3bb6703fdd21fbe3f6e47b798d258fe84b9", + "mean": -0.03277407959103584, + "std": 5.431368350982666, + "rms": 5.431467533111572, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6e110230512c3f9438864118f38dd70b6217af8d507df92842c0797963319d89", + "mean": -0.031234923750162125, + "std": 1.902023196220398, + "rms": 1.9022797346115112, + "max_abs": 68.0 + }, + "full_input": { + "shape": [ + 271, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8e43e0c30cc2a0e668a865bebab8061569abde0219bf903706bed0c3e482628f", + "mean": -0.029666224494576454, + "std": 4.669943809509277, + "rms": 4.67003870010376, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b9037e75cb5f4183aa92bf02e438c8bb0611a1600cf81fa4b6d80b0550d80366", + "mean": -0.030088838189840317, + "std": 1.899770736694336, + "rms": 1.900009036064148, + "max_abs": 67.0 + }, + "full_input": { + "shape": [ + 287, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "eb481dc578801800ba9e26781e66d8bc58e6e0137341116d5c75007db18924aa", + "mean": -0.02782556787133217, + "std": 4.5540008544921875, + "rms": 4.554085731506348, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b07addf0d78be5dc17263f732d7ff359d2e431a656547f816769deef899faf3b", + "mean": -0.031205596402287483, + "std": 1.9063819646835327, + "rms": 1.906637191772461, + "max_abs": 68.0 + }, + "full_input": { + "shape": [ + 271, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c853723bcf9be826f1dd2039075d20f87827101c3a6e8623691775dc82c141bd", + "mean": -0.02984752506017685, + "std": 4.672852516174316, + "rms": 4.672947883605957, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2466286f90bc68d9f7e861d5794185acfc345ae1bc7fc88e869471d4bff1f5d6", + "mean": -0.030196405947208405, + "std": 1.8982354402542114, + "rms": 1.8984756469726562, + "max_abs": 67.0 + }, + "full_input": { + "shape": [ + 287, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "41acfe26e94a77b9795481221cf655c3fbff7601249815d534917dd1f2ffa564", + "mean": -0.0279863178730011, + "std": 4.554926872253418, + "rms": 4.5550127029418945, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2fb0340bf28bd5437341d61b769d38e6cc8338d2b8d28bc5f3ddaed8f64b8704", + "mean": -0.03055335208773613, + "std": 1.9011107683181763, + "rms": 1.9013562202453613, + "max_abs": 68.0 + }, + "full_input": { + "shape": [ + 271, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "28d9d11c9eeefd6b042ae54460d882e623a6eff3b0d89361984c69e49ea0b8a6", + "mean": -0.029208218678832054, + "std": 4.670202732086182, + "rms": 4.670293807983398, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9a058b558070f609767e1a2cfee4084a7c43ac4a1f8469c822c520a60a14d559", + "mean": -0.030002417042851448, + "std": 1.8891843557357788, + "rms": 1.8894225358963013, + "max_abs": 67.0 + }, + "full_input": { + "shape": [ + 287, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "214a57e6218082b7af29dc2e4d7e5ddeaba6e90571746ea81a8c860cdc9dccfe", + "mean": -0.02769627794623375, + "std": 4.5509209632873535, + "rms": 4.5510053634643555, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.995106041431427, + "min_cosine_similarity": 0.9148879051208496, + "mean_relative_l2": 0.08389397710561752, + "max_abs_delta": 10.375 + }, + "system_bos": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.992671549320221, + "min_cosine_similarity": 0.8575104475021362, + "mean_relative_l2": 0.10416852682828903, + "max_abs_delta": 11.1875 + }, + "system_x": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9861879348754883, + "min_cosine_similarity": 0.4471210241317749, + "mean_relative_l2": 0.1348911076784134, + "max_abs_delta": 7.0 + }, + "system_period": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.987156093120575, + "min_cosine_similarity": 0.49367794394493103, + "mean_relative_l2": 0.1326112151145935, + "max_abs_delta": 5.125 + }, + "bos_at_s0": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.993005096912384, + "min_cosine_similarity": 0.8197582364082336, + "mean_relative_l2": 0.10314316302537918, + "max_abs_delta": 4.625 + }, + "bos_at_s1": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9912639260292053, + "min_cosine_similarity": 0.7445881366729736, + "mean_relative_l2": 0.1158088967204094, + "max_abs_delta": 6.375 + }, + "x_at_s0": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9856327176094055, + "min_cosine_similarity": 0.6770511865615845, + "mean_relative_l2": 0.1445189267396927, + "max_abs_delta": 9.375 + }, + "x_at_s1": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9835107326507568, + "min_cosine_similarity": 0.49919724464416504, + "mean_relative_l2": 0.15206347405910492, + "max_abs_delta": 16.375 + }, + "period_at_s0": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9882558584213257, + "min_cosine_similarity": 0.7615572214126587, + "mean_relative_l2": 0.13273851573467255, + "max_abs_delta": 6.125 + }, + "period_at_s1": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9851455688476562, + "min_cosine_similarity": 0.49258339405059814, + "mean_relative_l2": 0.1453973352909088, + "max_abs_delta": 14.875 + } + } + }, + "layer_23": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b6ef3e134b213925e229661c1c491bca731ef82ea018dbb48446b0ccfceef1f5", + "mean": -0.043447282165288925, + "std": 2.284489154815674, + "rms": 2.284902334213257, + "max_abs": 90.5 + }, + "full_input": { + "shape": [ + 271, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1775bc35fac51b2c5a9a77fe5b5be0d9af5f8d89e31dc3a33f3d7ee2ed0da1eb", + "mean": -0.0447295717895031, + "std": 5.545228958129883, + "rms": 5.545409202575684, + "max_abs": 1160.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0c7ed4fc6cbdda75c4a8816e06aebcdc321d9419a4c7eebd870264a2f1bd7512", + "mean": -0.04261760041117668, + "std": 2.287752866744995, + "rms": 2.288149833679199, + "max_abs": 91.0 + }, + "full_input": { + "shape": [ + 287, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b4bcfe928e71142418b24babaf85e8350be050dbcf60f5886920315bdff8ec8f", + "mean": -0.04255269095301628, + "std": 5.553744792938232, + "rms": 5.553907871246338, + "max_abs": 1160.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c648c82a9eba8c5fa5bdfa2b69cce4cd33bd08a723a34c61cbfa2509dad3a5f3", + "mean": -0.043849457055330276, + "std": 2.281297206878662, + "rms": 2.2817187309265137, + "max_abs": 90.5 + }, + "full_input": { + "shape": [ + 271, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "735154bb1467dbc7419777376c96d419631d339b63ca0dfac7303db852dcb37d", + "mean": -0.041043203324079514, + "std": 4.8144049644470215, + "rms": 4.814579963684082, + "max_abs": 1160.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e2eb06a2db374159c6c50dbac829364f0e7d7db46b0e3e5da52bb5bd8e89a3be", + "mean": -0.04184351861476898, + "std": 2.2809536457061768, + "rms": 2.2813374996185303, + "max_abs": 90.0 + }, + "full_input": { + "shape": [ + 287, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4fdccef5ce9fa3fe8e70cc2939b9076ff8270d366fb9a83d66e04543b6f68c7c", + "mean": -0.03736342117190361, + "std": 4.705011367797852, + "rms": 4.705159664154053, + "max_abs": 1160.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a9336bf6898b61092dad65437de5c9f5c793548907eb9abe703d340171c78f8a", + "mean": -0.043570782989263535, + "std": 2.2856736183166504, + "rms": 2.286088705062866, + "max_abs": 90.0 + }, + "full_input": { + "shape": [ + 271, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ad7a54d90ed4b26b1758a431b3f24b4f26095f36bb7802de27a3548231755ac4", + "mean": -0.0409683994948864, + "std": 4.818514347076416, + "rms": 4.818688869476318, + "max_abs": 1160.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "20b76b0c5b4ebd48e4daecbc6195b5c2472e233a78f37a1cefd6dede72a9e120", + "mean": -0.041781339794397354, + "std": 2.279264450073242, + "rms": 2.2796473503112793, + "max_abs": 91.0 + }, + "full_input": { + "shape": [ + 287, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b483351bbac8f101361cf646f8647e7ab7f564bc12a6824ec888b9a9a69924d1", + "mean": -0.03742683306336403, + "std": 4.706895351409912, + "rms": 4.707043647766113, + "max_abs": 1160.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "39f394af1b43d9f63e9e6cfcc5efbae54d62b3cf5196e918c847ea5ef3862753", + "mean": -0.042819343507289886, + "std": 2.2798306941986084, + "rms": 2.2802329063415527, + "max_abs": 91.0 + }, + "full_input": { + "shape": [ + 271, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "49860f0b24a131eba6b54750f08434e35c27cb0109871c904f5f80a0801aae82", + "mean": -0.040355384349823, + "std": 4.814728736877441, + "rms": 4.814897537231445, + "max_abs": 1160.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5eea26445f79f33d1f8e7576a82292498d9cb1a467621943f54c27cab3b47bef", + "mean": -0.04155493900179863, + "std": 2.2661635875701904, + "rms": 2.2665445804595947, + "max_abs": 89.0 + }, + "full_input": { + "shape": [ + 287, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "013d4c708e413406a8ed8f0ce52b6dfba81c6071dc886dfcf8832fbe22e91a17", + "mean": -0.03714436665177345, + "std": 4.700210094451904, + "rms": 4.700356483459473, + "max_abs": 1160.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.995660126209259, + "min_cosine_similarity": 0.933835506439209, + "mean_relative_l2": 0.07974013686180115, + "max_abs_delta": 11.0 + }, + "system_bos": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9933818578720093, + "min_cosine_similarity": 0.8902449607849121, + "mean_relative_l2": 0.09936854243278503, + "max_abs_delta": 13.0 + }, + "system_x": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.986617922782898, + "min_cosine_similarity": 0.325123131275177, + "mean_relative_l2": 0.13114622235298157, + "max_abs_delta": 12.625 + }, + "system_period": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9872233271598816, + "min_cosine_similarity": 0.3813803195953369, + "mean_relative_l2": 0.12877413630485535, + "max_abs_delta": 13.5 + }, + "bos_at_s0": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9934757351875305, + "min_cosine_similarity": 0.829240620136261, + "mean_relative_l2": 0.0987081229686737, + "max_abs_delta": 9.8125 + }, + "bos_at_s1": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9921767115592957, + "min_cosine_similarity": 0.7947565913200378, + "mean_relative_l2": 0.10958079993724823, + "max_abs_delta": 14.8125 + }, + "x_at_s0": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9873118996620178, + "min_cosine_similarity": 0.7213754057884216, + "mean_relative_l2": 0.13624827563762665, + "max_abs_delta": 9.75 + }, + "x_at_s1": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9843631982803345, + "min_cosine_similarity": 0.366627037525177, + "mean_relative_l2": 0.14689509570598602, + "max_abs_delta": 12.625 + }, + "period_at_s0": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9896802306175232, + "min_cosine_similarity": 0.7872258424758911, + "mean_relative_l2": 0.12487760931253433, + "max_abs_delta": 9.0 + }, + "period_at_s1": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9857548475265503, + "min_cosine_similarity": 0.395891398191452, + "mean_relative_l2": 0.14015722274780273, + "max_abs_delta": 14.0 + } + } + }, + "layer_24": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "18667a3270899b90b2c44d138c16712b991ebcf85de27631014e73ba39b4b757", + "mean": -0.05441218614578247, + "std": 3.191840171813965, + "rms": 3.1923038959503174, + "max_abs": 376.0 + }, + "full_input": { + "shape": [ + 271, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e14719534fb12face177124957e6afc4c6f36367e01dc7d118feb0c83d17943f", + "mean": -0.055208977311849594, + "std": 5.661123275756836, + "rms": 5.661392688751221, + "max_abs": 1008.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1fe7ff7fa1733508db09f889cb8ad87f481e0f88d218b56fe6622e312f5de30e", + "mean": -0.05342007055878639, + "std": 3.4922709465026855, + "rms": 3.4926795959472656, + "max_abs": 502.0 + }, + "full_input": { + "shape": [ + 287, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "be7e452824b962df429ef87e5c134edbe73a45612e88328972d4642677ebce31", + "mean": -0.05216740444302559, + "std": 5.939295291900635, + "rms": 5.9395246505737305, + "max_abs": 1120.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "52b88bf58d7122763dd17a116a6f377747fbd726401324ae01f35db1f1c67c26", + "mean": -0.05445845425128937, + "std": 3.2163867950439453, + "rms": 3.216848134994507, + "max_abs": 384.0 + }, + "full_input": { + "shape": [ + 271, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bed349a2c108919d211af30f832e94a160f131f84beb75d4b4da9e1d2e0e28b5", + "mean": -0.05066050589084625, + "std": 4.2613325119018555, + "rms": 4.261633396148682, + "max_abs": 840.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "afe463825a39b43616b639b481de4486a478c5063099be9ecd655a1e6960b183", + "mean": -0.052049942314624786, + "std": 3.3386781215667725, + "rms": 3.3390839099884033, + "max_abs": 444.0 + }, + "full_input": { + "shape": [ + 287, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3c31901d8b9872d89ba202fd989a6d82a764e6f4adcd964520d6a400c84c4bb0", + "mean": -0.045868922024965286, + "std": 4.276003837585449, + "rms": 4.276249885559082, + "max_abs": 840.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a598a15c29ad6575c31bfb6775b609157ad2eced6acf64b38b088c37c309472b", + "mean": -0.053554512560367584, + "std": 3.4861700534820557, + "rms": 3.486581325531006, + "max_abs": 500.0 + }, + "full_input": { + "shape": [ + 271, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "971522ad5728aecfe0ee3f09b86d7803e02ddac3812ea6b07a18e1515eb48f3f", + "mean": -0.050024934113025665, + "std": 4.453075408935547, + "rms": 4.4533562660217285, + "max_abs": 840.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "dfd9f98f8bfdad4617a019dbbc5747f1addd0e489a6545f43206740f7f438939", + "mean": -0.05139143019914627, + "std": 3.5235424041748047, + "rms": 3.5239171981811523, + "max_abs": 512.0 + }, + "full_input": { + "shape": [ + 287, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0326d78d3ed54ef82eb13c47b679b9976b6140498b73e043bf79c6b3b22c92e4", + "mean": -0.045550085604190826, + "std": 4.405277729034424, + "rms": 4.405513286590576, + "max_abs": 840.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "32513e50d59c59df11b59c937db8a9870dee04b2945f658e8f98ff426974b575", + "mean": -0.05320855230093002, + "std": 3.3772544860839844, + "rms": 3.377673387527466, + "max_abs": 460.0 + }, + "full_input": { + "shape": [ + 271, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3645a7bde4f52e3e193880535611385c9004d76a76cf2b0f24a1615b7728fc14", + "mean": -0.04972878843545914, + "std": 4.374555587768555, + "rms": 4.374838352203369, + "max_abs": 840.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "187b043277386853bac5fa8678b6a71d803e9ed999a37694b486987b921c5c2d", + "mean": -0.05109497904777527, + "std": 3.4919593334198, + "rms": 3.492332935333252, + "max_abs": 506.0 + }, + "full_input": { + "shape": [ + 287, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e17c2adef04d024ba8d28f23665f7193464c7e217d32e36edbbf70fe2adab215", + "mean": -0.04518081620335579, + "std": 4.381844997406006, + "rms": 4.382077693939209, + "max_abs": 840.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9949710965156555, + "min_cosine_similarity": 0.6775123476982117, + "mean_relative_l2": 0.077718585729599, + "max_abs_delta": 126.0 + }, + "system_bos": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9941385388374329, + "min_cosine_similarity": 0.9009843468666077, + "mean_relative_l2": 0.09452399611473083, + "max_abs_delta": 60.0 + }, + "system_x": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9837912321090698, + "min_cosine_similarity": 0.09535827487707138, + "mean_relative_l2": 0.18055003881454468, + "max_abs_delta": 509.0 + }, + "system_period": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9836694002151489, + "min_cosine_similarity": 0.08088170737028122, + "mean_relative_l2": 0.18268939852714539, + "max_abs_delta": 503.21875 + }, + "bos_at_s0": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9942672848701477, + "min_cosine_similarity": 0.8676726222038269, + "mean_relative_l2": 0.09362172335386276, + "max_abs_delta": 33.5 + }, + "bos_at_s1": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9920990467071533, + "min_cosine_similarity": 0.7041254043579102, + "mean_relative_l2": 0.10545171052217484, + "max_abs_delta": 58.0 + }, + "x_at_s0": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.988544225692749, + "min_cosine_similarity": 0.7607525587081909, + "mean_relative_l2": 0.1292797178030014, + "max_abs_delta": 124.0 + }, + "x_at_s1": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9817685484886169, + "min_cosine_similarity": 0.09144442528486252, + "mean_relative_l2": 0.20011408627033234, + "max_abs_delta": 508.3125 + }, + "period_at_s0": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9910426139831543, + "min_cosine_similarity": 0.8206650614738464, + "mean_relative_l2": 0.1173483356833458, + "max_abs_delta": 84.0 + }, + "period_at_s1": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9830209612846375, + "min_cosine_similarity": 0.07072890549898148, + "mean_relative_l2": 0.19292938709259033, + "max_abs_delta": 502.3125 + } + } + }, + "layer_25": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "73f13bb14d004a19b4a25b8e2cf8e1d6e287661abed19ba5dd501338811be057", + "mean": -0.09011843800544739, + "std": 4.0096659660339355, + "rms": 4.010678291320801, + "max_abs": 378.0 + }, + "full_input": { + "shape": [ + 271, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3447d813c514ed5a51497342159911633427a8b7680383da255a3e44d585303e", + "mean": -0.08894391357898712, + "std": 5.233270645141602, + "rms": 5.234026908874512, + "max_abs": 872.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0e827b6e2012dd2adb3138c4e64e1fd5bc3d0713d8536a6a466333e22c68e770", + "mean": -0.08779162168502808, + "std": 4.255124568939209, + "rms": 4.256030559539795, + "max_abs": 504.0 + }, + "full_input": { + "shape": [ + 287, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "32968efb46b50bd62a35402a6da2a1b2a7a6034f975040612fc06a218a5a9c73", + "mean": -0.08356454223394394, + "std": 5.54865837097168, + "rms": 5.54928731918335, + "max_abs": 984.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a30a86dc8b4b5811ebf9a964133d7f1588e2255ece6b38d0260c2075a7e06010", + "mean": -0.09005820006132126, + "std": 4.024838447570801, + "rms": 4.025846004486084, + "max_abs": 386.0 + }, + "full_input": { + "shape": [ + 271, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0bea4e25a5a4aa62dfb402c27f9aadad4c63bd54e68b16352dab914cba91cbf2", + "mean": -0.08393043279647827, + "std": 4.04409122467041, + "rms": 4.044962406158447, + "max_abs": 386.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4efd86bcf61f2727341be402759568b8ab01403a6100209c21ce38719687e28c", + "mean": -0.08598901331424713, + "std": 4.1218647956848145, + "rms": 4.1227617263793945, + "max_abs": 446.0 + }, + "full_input": { + "shape": [ + 287, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7949638048943b63014c1e24c3182c50de5470f51bb09cf1ee9500a6bbfa7052", + "mean": -0.07653264701366425, + "std": 4.111342430114746, + "rms": 4.112054347991943, + "max_abs": 446.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d200f0e2e580d975c93b6c5a443ec728372c6d59aa5ed4d3cc205f8a338a2221", + "mean": -0.08796335756778717, + "std": 4.243051052093506, + "rms": 4.24396276473999, + "max_abs": 502.0 + }, + "full_input": { + "shape": [ + 271, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "45d02c1d624955eee66c25ac42c847291a825d6113e86fc6fb97a6e242bd8d22", + "mean": -0.08242347836494446, + "std": 4.248816013336182, + "rms": 4.249615669250488, + "max_abs": 502.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4587bab9e0b0ebc57e874754c06951891a560f4f1cc9e81144a41e1394c4ed69", + "mean": -0.0836453065276146, + "std": 4.2651848793029785, + "rms": 4.266005039215088, + "max_abs": 516.0 + }, + "full_input": { + "shape": [ + 287, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a1a1c22c2beef48649464ba159973beb79e722750052bdf7ab57c87118fc00ee", + "mean": -0.074678935110569, + "std": 4.242225646972656, + "rms": 4.242883205413818, + "max_abs": 516.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6c58fd58ba606028d3a0382439fab3c885d7e88a5f334efdf470f197794dba76", + "mean": -0.08762603998184204, + "std": 4.147401332855225, + "rms": 4.148326873779297, + "max_abs": 462.0 + }, + "full_input": { + "shape": [ + 271, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "44ff618d370ffc3e37a8f0fd13b663dc529ab70f6f8faeae288c5a6be53331b5", + "mean": -0.08205097913742065, + "std": 4.15913724899292, + "rms": 4.159945964813232, + "max_abs": 462.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "47172a8b5b3fd905a57f81d57576e03c29e9d48510cfaba4c7d876352f71269f", + "mean": -0.08303894102573395, + "std": 4.228535175323486, + "rms": 4.229350566864014, + "max_abs": 510.0 + }, + "full_input": { + "shape": [ + 287, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "12d74eb6c8876561d7254332fc10809a2ae61c9c9f91c3b2656fc5cce3aa1d33", + "mean": -0.07396510988473892, + "std": 4.207185745239258, + "rms": 4.207835674285889, + "max_abs": 510.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9960184097290039, + "min_cosine_similarity": 0.7298468351364136, + "mean_relative_l2": 0.06919047981500626, + "max_abs_delta": 126.0 + }, + "system_bos": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9954448938369751, + "min_cosine_similarity": 0.9260780215263367, + "mean_relative_l2": 0.08366339653730392, + "max_abs_delta": 60.0 + }, + "system_x": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9859158992767334, + "min_cosine_similarity": 0.09903037548065186, + "mean_relative_l2": 0.14224198460578918, + "max_abs_delta": 514.421875 + }, + "system_period": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9857508540153503, + "min_cosine_similarity": 0.09033145755529404, + "mean_relative_l2": 0.14292718470096588, + "max_abs_delta": 508.90625 + }, + "bos_at_s0": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9958024621009827, + "min_cosine_similarity": 0.9437207579612732, + "mean_relative_l2": 0.08084845542907715, + "max_abs_delta": 34.25 + }, + "bos_at_s1": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9942547082901001, + "min_cosine_similarity": 0.7607530951499939, + "mean_relative_l2": 0.0903710126876831, + "max_abs_delta": 58.0 + }, + "x_at_s0": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9913716912269592, + "min_cosine_similarity": 0.8130090236663818, + "mean_relative_l2": 0.1121358573436737, + "max_abs_delta": 124.0 + }, + "x_at_s1": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9844003319740295, + "min_cosine_similarity": 0.10233981162309647, + "mean_relative_l2": 0.15478746592998505, + "max_abs_delta": 513.078125 + }, + "period_at_s0": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9932592511177063, + "min_cosine_similarity": 0.860626220703125, + "mean_relative_l2": 0.10198501497507095, + "max_abs_delta": 84.0 + }, + "period_at_s1": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9853135943412781, + "min_cosine_similarity": 0.09231864660978317, + "mean_relative_l2": 0.14934362471103668, + "max_abs_delta": 507.078125 + } + } + }, + "layer_26": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a44268bfb16e73091b4ed6642a35d0cd7dc09925585c50183f6697d0327bef52", + "mean": -0.13396160304546356, + "std": 4.300589561462402, + "rms": 4.302675247192383, + "max_abs": 342.0 + }, + "full_input": { + "shape": [ + 271, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "76cae6512e72476b15a97a88816aa675b6d44237a0a5261b1dbe54886e0fa6fd", + "mean": -0.13171717524528503, + "std": 5.473373889923096, + "rms": 5.474958419799805, + "max_abs": 840.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1870f0d90150aac4ae7589c4dbafbc10eb0ce06c2280a85d5aa7a436e78c70ba", + "mean": -0.12843549251556396, + "std": 4.263514518737793, + "rms": 4.265448570251465, + "max_abs": 342.0 + }, + "full_input": { + "shape": [ + 287, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "54ef754c516aea0e01a95bf124dbdb2d343f46d17fcbb86b94026a6431eea2e1", + "mean": -0.11926678568124771, + "std": 5.616634368896484, + "rms": 5.617900371551514, + "max_abs": 868.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3b9fd01c1725c5a3223f01bb2300dbc04a2cb31599d23a8ee2b790bf61323a7f", + "mean": -0.13339895009994507, + "std": 4.28541898727417, + "rms": 4.287494659423828, + "max_abs": 340.0 + }, + "full_input": { + "shape": [ + 271, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "171eb6629dfb5fca94e4ffa75349af0b59fbe68649a6b68a611ff44e43705bb5", + "mean": -0.12540782988071442, + "std": 4.508541584014893, + "rms": 4.510285377502441, + "max_abs": 776.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "02522006f379814288172c0b219fc64737758ed3eef17437b6513f497f012727", + "mean": -0.12613771855831146, + "std": 4.272796154022217, + "rms": 4.274657726287842, + "max_abs": 340.0 + }, + "full_input": { + "shape": [ + 287, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ca26fea60a125a856bfe462ade13b102122a88c7843811be907266c42da1ea04", + "mean": -0.11110323667526245, + "std": 4.56109619140625, + "rms": 4.562448978424072, + "max_abs": 776.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9ba0d096503ae276cbc9a108e961ba3b01632de2586c1f798a0d5522a0a57717", + "mean": -0.13042129576206207, + "std": 4.2820820808410645, + "rms": 4.284067630767822, + "max_abs": 330.0 + }, + "full_input": { + "shape": [ + 271, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "db90bd63d19252c26ba2f0a88c7c9018cb49e28c88c62bf50ede37b6d1b8d27d", + "mean": -0.12334278970956802, + "std": 4.520178318023682, + "rms": 4.5218610763549805, + "max_abs": 776.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "143f42970b96b3bbb8795cce5f5ec87a9d5884d623238ad20270fc7a424f044a", + "mean": -0.11914487183094025, + "std": 4.20786714553833, + "rms": 4.2095537185668945, + "max_abs": 328.0 + }, + "full_input": { + "shape": [ + 287, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fbe0cc2fcaef79cef2f095b35d6032f37e128a53c82dcc45fc6440eb691003f2", + "mean": -0.10522408783435822, + "std": 4.515030384063721, + "rms": 4.516256332397461, + "max_abs": 776.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bbed4e0f37023aa5f088d0f68c2047df1f1e2a4fa952d36cd8d8cf024d2c53f9", + "mean": -0.12992805242538452, + "std": 4.241909503936768, + "rms": 4.243898868560791, + "max_abs": 332.0 + }, + "full_input": { + "shape": [ + 271, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "856304d544d97aa2748fad96a984b6ba8dedbc0d63c72943cc5053a371304890", + "mean": -0.12279465794563293, + "std": 4.477090358734131, + "rms": 4.478774547576904, + "max_abs": 776.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ea40bc994e4dbdf4a69dff7d35d5fa14f8cdc5b681919063b73f9c30d3af33e3", + "mean": -0.11677379161119461, + "std": 4.123939037322998, + "rms": 4.125592231750488, + "max_abs": 320.0 + }, + "full_input": { + "shape": [ + 287, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fcc67ce4353ac4e86f0ecf3f2641c042f526680ea8e4b6d903b497d24d9e272e", + "mean": -0.10306933522224426, + "std": 4.436801910400391, + "rms": 4.4379987716674805, + "max_abs": 776.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9962285757064819, + "min_cosine_similarity": 0.8974173665046692, + "mean_relative_l2": 0.07351682335138321, + "max_abs_delta": 39.0 + }, + "system_bos": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9947799444198608, + "min_cosine_similarity": 0.9043027758598328, + "mean_relative_l2": 0.09216409176588058, + "max_abs_delta": 74.5 + }, + "system_x": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9895726442337036, + "min_cosine_similarity": 0.6737058162689209, + "mean_relative_l2": 0.12385701388120651, + "max_abs_delta": 54.0 + }, + "system_period": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9894610643386841, + "min_cosine_similarity": 0.6348286867141724, + "mean_relative_l2": 0.12545841932296753, + "max_abs_delta": 60.5 + }, + "bos_at_s0": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9958161115646362, + "min_cosine_similarity": 0.9367971420288086, + "mean_relative_l2": 0.08179350942373276, + "max_abs_delta": 46.5 + }, + "bos_at_s1": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9949034452438354, + "min_cosine_similarity": 0.9380893111228943, + "mean_relative_l2": 0.09285055845975876, + "max_abs_delta": 37.0 + }, + "x_at_s0": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.99154132604599, + "min_cosine_similarity": 0.807734489440918, + "mean_relative_l2": 0.1150723546743393, + "max_abs_delta": 45.5 + }, + "x_at_s1": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9884052872657776, + "min_cosine_similarity": 0.6747021675109863, + "mean_relative_l2": 0.1314498484134674, + "max_abs_delta": 63.5 + }, + "period_at_s0": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9928697943687439, + "min_cosine_similarity": 0.8416404128074646, + "mean_relative_l2": 0.10725492984056473, + "max_abs_delta": 53.0 + }, + "period_at_s1": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.989379346370697, + "min_cosine_similarity": 0.6422967910766602, + "mean_relative_l2": 0.12757426500320435, + "max_abs_delta": 61.5 + } + } + }, + "final_norm": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ae8cadcc0d4af96ae9e59741a644ccb18a05e54627ca421257b832a35069e56c", + "mean": -0.020893242210149765, + "std": 0.6573663353919983, + "rms": 0.6576983332633972, + "max_abs": 17.375 + }, + "full_input": { + "shape": [ + 271, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6bbdc754c186e36deec8c858b3a303cf496c6a580b5ad42b2caa33dc317a24cc", + "mean": -0.019610054790973663, + "std": 0.6524320840835571, + "rms": 0.6527267098426819, + "max_abs": 19.75 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7feb6960d91aad40128d4a5dab9eb174239582483e878c8035b56d0ff110fc27", + "mean": -0.019983593374490738, + "std": 0.6525588035583496, + "rms": 0.6528647541999817, + "max_abs": 18.0 + }, + "full_input": { + "shape": [ + 287, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e2a02e7b960f5bd54b39c4c3cdc09e0a054c0b7da5c4f6bde7bfbba60d308887", + "mean": -0.01740194670855999, + "std": 0.6397476196289062, + "rms": 0.6399842500686646, + "max_abs": 20.625 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5d2d14c8c7ad7eb865371d6b7d814e5cc60aef8300a583f68e651f0a2dacfbbd", + "mean": -0.020998457446694374, + "std": 0.6616694927215576, + "rms": 0.6620026230812073, + "max_abs": 18.5 + }, + "full_input": { + "shape": [ + 271, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c2edc5b773c04cd606e41cf2ad49b884ed3102cf815a90721263b60c884327d2", + "mean": -0.019573930650949478, + "std": 0.6566140651702881, + "rms": 0.6569057703018188, + "max_abs": 20.5 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "169550caa6e9e687e58c46d745d71bf144e467d97659af5a209efe021051d762", + "mean": -0.019549207761883736, + "std": 0.6507895588874817, + "rms": 0.6510831117630005, + "max_abs": 18.125 + }, + "full_input": { + "shape": [ + 287, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d0c45d4f5fa317f49b7a62c4335e375325a5ee6f3ad84be858d67aee7a97767d", + "mean": -0.016987722367048264, + "std": 0.6383246183395386, + "rms": 0.6385506391525269, + "max_abs": 21.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "63307c4acb0006439a2787eeefccf51eed59ee48f608cf9b7e6dd9ed64cb6186", + "mean": -0.02022566646337509, + "std": 0.6554446220397949, + "rms": 0.6557566523551941, + "max_abs": 17.875 + }, + "full_input": { + "shape": [ + 271, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8a7451b999e33bf657f496e241ac895a6a0bc2c888cd6f37bd70e73b996ace0d", + "mean": -0.018931858241558075, + "std": 0.6497696042060852, + "rms": 0.6500453352928162, + "max_abs": 19.25 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ce941ab438c649a512878b36828c9b03e7fb835ee25360719fa0cc8353628320", + "mean": -0.018586361780762672, + "std": 0.6412591338157654, + "rms": 0.6415284276008606, + "max_abs": 17.5 + }, + "full_input": { + "shape": [ + 287, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "de43e70cd62cfd6749e744ed932f5bbd0eee125342c8f1fb73ed8f97cd55d296", + "mean": -0.016097309067845345, + "std": 0.6288475394248962, + "rms": 0.62905353307724, + "max_abs": 20.875 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6e358be4e4dbe9a643967dbffc8af630c78802cee077d54bd853bf3aeedad138", + "mean": -0.020515654236078262, + "std": 0.6591444611549377, + "rms": 0.65946364402771, + "max_abs": 17.375 + }, + "full_input": { + "shape": [ + 271, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "43ce32a80978287e610d4ee1a7fb1a3d738a9f95e13e8268bbc70a16c7b6826c", + "mean": -0.019220314919948578, + "std": 0.6539565324783325, + "rms": 0.6542389392852783, + "max_abs": 19.875 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 246, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "558f47e4ca0c6fed0042ce8678322e59cdc950df38a1664ce54665264726309a", + "mean": -0.018716445192694664, + "std": 0.6485831141471863, + "rms": 0.6488531231880188, + "max_abs": 17.75 + }, + "full_input": { + "shape": [ + 287, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5d1f6219c2265b7bfc79dcd6e57355a97ce5ec8be4b4f77182071d245ded305f", + "mean": -0.01619935967028141, + "std": 0.6360311508178711, + "rms": 0.636237382888794, + "max_abs": 21.75 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9944941401481628, + "min_cosine_similarity": 0.8185997009277344, + "mean_relative_l2": 0.08088573068380356, + "max_abs_delta": 4.1015625 + }, + "system_bos": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9931710362434387, + "min_cosine_similarity": 0.8119328022003174, + "mean_relative_l2": 0.09898951649665833, + "max_abs_delta": 3.90625 + }, + "system_x": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9849823713302612, + "min_cosine_similarity": 0.42845478653907776, + "mean_relative_l2": 0.13691025972366333, + "max_abs_delta": 5.8671875 + }, + "system_period": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9847246408462524, + "min_cosine_similarity": 0.40496501326560974, + "mean_relative_l2": 0.13917139172554016, + "max_abs_delta": 6.1953125 + }, + "bos_at_s0": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9943954348564148, + "min_cosine_similarity": 0.8876221776008606, + "mean_relative_l2": 0.09022686630487442, + "max_abs_delta": 3.34375 + }, + "bos_at_s1": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9930184483528137, + "min_cosine_similarity": 0.915563702583313, + "mean_relative_l2": 0.10198509693145752, + "max_abs_delta": 3.15625 + }, + "x_at_s0": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9883428812026978, + "min_cosine_similarity": 0.6227400302886963, + "mean_relative_l2": 0.1270844042301178, + "max_abs_delta": 3.84375 + }, + "x_at_s1": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9834986925125122, + "min_cosine_similarity": 0.42901501059532166, + "mean_relative_l2": 0.1453399509191513, + "max_abs_delta": 4.859375 + }, + "period_at_s0": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9904163479804993, + "min_cosine_similarity": 0.6998363733291626, + "mean_relative_l2": 0.11827777326107025, + "max_abs_delta": 3.921875 + }, + "period_at_s1": { + "tokens": 246, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9847328662872314, + "min_cosine_similarity": 0.411302387714386, + "mean_relative_l2": 0.13884757459163666, + "max_abs_delta": 4.2265625 + } + } + } + }, + "router_layers": { + "layer_01": { + "layer": 1, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "4a81f9720a5f1ffa140912da1ccbe81f700a111f417001ecf12066ed33ef55dd", + "route_weight_sha256": "c3b34901ed7801209f732d675e044b797e5091557e13ed6057713d88e401735c", + "loads": [ + 29, + 24, + 16, + 20, + 14, + 26, + 19, + 17, + 16, + 27, + 28, + 15, + 19, + 46, + 23, + 18, + 31, + 4, + 36, + 23, + 15, + 21, + 32, + 25, + 30, + 32, + 20, + 29, + 34, + 24, + 26, + 18, + 4, + 10, + 13, + 29, + 14, + 32, + 19, + 15, + 39, + 23, + 28, + 30, + 23, + 23, + 27, + 17, + 38, + 24, + 13, + 18, + 21, + 24, + 41, + 29, + 21, + 14, + 29, + 23, + 16, + 24, + 10, + 28 + ], + "weighted_loads": [ + 2.4050198290497065, + 1.392012920230627, + 0.9844366926699877, + 1.6571725476533175, + 0.8295284863561392, + 1.4141215439885855, + 0.7183357682079077, + 0.7317933291196823, + 0.6497246362268925, + 1.9953583851456642, + 2.0229957196861506, + 0.8370682410895824, + 0.665001567453146, + 2.7571044266223907, + 1.0884191133081913, + 1.1795793119817972, + 1.0599827487021685, + 0.11843012645840645, + 2.2158341743052006, + 1.699408195912838, + 0.8453174754977226, + 2.2186436597257853, + 1.29304676130414, + 1.659104023128748, + 1.818779293447733, + 2.117668032646179, + 1.0657885540276766, + 1.2575789988040924, + 1.7803646475076675, + 1.6172206569463015, + 2.128131927922368, + 1.2006260473281145, + 0.20260804891586304, + 0.470825731754303, + 1.074776677414775, + 1.4635637495666742, + 0.8737409096211195, + 2.0651319939643145, + 1.3559277728199959, + 0.88037327863276, + 2.137528697028756, + 1.5485656391829252, + 2.278160685673356, + 2.441952556371689, + 2.004581058397889, + 1.6453760787844658, + 2.1289145294576883, + 1.133527148514986, + 1.155248874798417, + 1.0441693123430014, + 0.8578235022723675, + 1.814642310142517, + 1.3581772223114967, + 1.2128940280526876, + 3.181860025972128, + 1.5312044695019722, + 2.0421610195189714, + 0.5228848606348038, + 1.0551888961344957, + 1.0246683154255152, + 0.8064113482832909, + 2.42393521592021, + 0.7322923541069031, + 1.6013014279305935 + ], + "unique_experts": 64, + "load_cv": 0.3599238402641054, + "normalized_load_entropy": 0.9835114195199895, + "max_load_share": 0.03116531165311653 + }, + "full_input": { + "tokens": 271, + "top_k": 6, + "decisions": 1626, + "ordered_route_sha256": "d4d9bf3e96dcf0d88ee4c09cf54dc59a825c5fbb91740ca5e62c9a80ffb997b1", + "route_weight_sha256": "cb6ea95aa8b636e5a5ac8c7a38779ee73eca010e0e37d9e6484b1919b4521e38", + "loads": [ + 30, + 24, + 18, + 20, + 18, + 26, + 20, + 19, + 33, + 27, + 30, + 17, + 19, + 46, + 24, + 27, + 31, + 5, + 36, + 23, + 18, + 21, + 33, + 25, + 30, + 36, + 33, + 30, + 34, + 24, + 26, + 23, + 5, + 12, + 13, + 29, + 14, + 32, + 19, + 18, + 40, + 33, + 28, + 35, + 24, + 34, + 27, + 18, + 38, + 24, + 17, + 19, + 25, + 24, + 45, + 33, + 25, + 23, + 29, + 34, + 17, + 28, + 10, + 28 + ], + "weighted_loads": [ + 2.4806344527751207, + 1.392012920230627, + 1.0871703568845987, + 1.6571725476533175, + 0.9971133880317211, + 1.4141215439885855, + 0.7800766285508871, + 0.9995186254382133, + 1.5434199962764978, + 1.9953583851456642, + 2.2786550167948008, + 0.8916326556354761, + 0.665001567453146, + 2.7571044266223907, + 1.1092427298426628, + 1.7948411423712969, + 1.0599827487021685, + 0.1898084618151188, + 2.2158341743052006, + 1.699408195912838, + 1.2510678097605705, + 2.2186436597257853, + 1.3233179673552513, + 1.659104023128748, + 1.818779293447733, + 2.288433760404587, + 1.8753936719149351, + 1.329583428800106, + 1.7803646475076675, + 1.6172206569463015, + 2.128131927922368, + 1.6000164205324836, + 0.2642514929175377, + 0.6562704220414162, + 1.074776677414775, + 1.4635637495666742, + 0.8737409096211195, + 2.0651319939643145, + 1.3559277728199959, + 1.114261755719781, + 2.184608669951558, + 1.9592248778790236, + 2.278160685673356, + 2.551705594465602, + 2.9888606909662485, + 2.4628136430401355, + 2.1289145294576883, + 1.1532317511737347, + 1.155248874798417, + 1.0441693123430014, + 0.9941209685057402, + 1.815249397768639, + 1.6333937011659145, + 1.2128940280526876, + 3.251793495786842, + 2.07354723662138, + 2.356468228623271, + 1.0347585454583168, + 1.0551888961344957, + 1.741045543923974, + 0.897036962211132, + 2.6443717442452908, + 0.7322923541069031, + 1.6013014279305935 + ], + "unique_experts": 64, + "load_cv": 0.3304661024159303, + "normalized_load_entropy": 0.9857951076390623, + "max_load_share": 0.028290282902829027 + } + }, + "s1_eos": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "8b4d7928c8c3451d083078c303e0acfbdc6e0f9ccd4b220c23136b4123a101b5", + "route_weight_sha256": "86eb9ed629cb23e9eaffea80992676db09420c0acd0cc9ff9b50f6c1adbe838e", + "loads": [ + 30, + 24, + 15, + 22, + 14, + 26, + 18, + 15, + 14, + 27, + 27, + 16, + 17, + 46, + 23, + 18, + 32, + 4, + 35, + 23, + 14, + 21, + 32, + 25, + 30, + 32, + 20, + 29, + 35, + 24, + 27, + 17, + 4, + 11, + 13, + 28, + 15, + 33, + 20, + 15, + 40, + 25, + 28, + 30, + 25, + 22, + 27, + 18, + 35, + 26, + 13, + 18, + 21, + 24, + 41, + 28, + 21, + 14, + 29, + 22, + 16, + 24, + 10, + 28 + ], + "weighted_loads": [ + 2.418381230905652, + 1.391388950869441, + 0.9510944858193398, + 1.7393957916647196, + 0.8223827257752419, + 1.4330369420349598, + 0.6879991181194782, + 0.674860991537571, + 0.5467181764543056, + 1.9915870167315006, + 1.9815202224999666, + 0.8839955125004053, + 0.5924098435789347, + 2.75700294226408, + 1.088623272255063, + 1.1829119082540274, + 1.0922204926609993, + 0.1166254710406065, + 2.192578464746475, + 1.696646075695753, + 0.8264812584966421, + 2.2416812498122454, + 1.3041616883128881, + 1.6582096591591835, + 1.7959455717355013, + 2.09366119466722, + 1.028774008154869, + 1.2386094331741333, + 1.8188817854970694, + 1.6341861616820097, + 2.157539637759328, + 1.166473226621747, + 0.22207195311784744, + 0.5365313831716776, + 1.0857478454709053, + 1.43838769197464, + 0.9003868065774441, + 2.100234830752015, + 1.3818853162229061, + 0.8760774172842503, + 2.1737962011247873, + 1.5966192856431007, + 2.2816250566393137, + 2.4450579155236483, + 2.0598813630640507, + 1.596195001155138, + 2.1175123564898968, + 1.1869414560496807, + 1.088465141132474, + 1.109436159953475, + 0.8502438645809889, + 1.8207570686936378, + 1.3650310281664133, + 1.215607639402151, + 3.197485012933612, + 1.5016977600753307, + 2.0518041737377644, + 0.5302002653479576, + 1.0691038463264704, + 1.0002969056367874, + 0.8088964000344276, + 2.4321755282580853, + 0.7280728742480278, + 1.586796011775732 + ], + "unique_experts": 64, + "load_cv": 0.3616337985683963, + "normalized_load_entropy": 0.9833305140073175, + "max_load_share": 0.03116531165311653 + }, + "full_input": { + "tokens": 287, + "top_k": 6, + "decisions": 1722, + "ordered_route_sha256": "9fb48f5c6706f7c371ae0429658c7e29c404eeddc37ca530e4382a463d385c08", + "route_weight_sha256": "c7c0339604145d52bb2de46b30c4c0a6c8a84d52b58cc2900754aadb9e6a6a74", + "loads": [ + 33, + 24, + 18, + 22, + 21, + 28, + 19, + 18, + 37, + 27, + 32, + 19, + 17, + 47, + 24, + 30, + 32, + 9, + 36, + 24, + 17, + 23, + 36, + 26, + 32, + 37, + 39, + 31, + 35, + 26, + 28, + 24, + 5, + 13, + 13, + 28, + 16, + 34, + 20, + 20, + 41, + 37, + 31, + 36, + 27, + 33, + 27, + 22, + 37, + 26, + 22, + 23, + 26, + 24, + 47, + 32, + 31, + 27, + 31, + 33, + 18, + 29, + 10, + 32 + ], + "weighted_loads": [ + 2.6116077546030283, + 1.391388950869441, + 1.1167955249547958, + 1.7393957916647196, + 1.2279773987829685, + 1.5711427293717861, + 0.7331706248223782, + 0.9122546631842852, + 1.8549989741295576, + 1.9915870167315006, + 2.4275562781840563, + 1.0851083397865295, + 0.5924098435789347, + 2.7968168444931507, + 1.1094740275293589, + 1.8844744767993689, + 1.0922204926609993, + 0.3179782070219517, + 2.231916557997465, + 1.7627306319773197, + 1.174948064610362, + 2.44631171412766, + 1.5748125351965427, + 1.6928477175533772, + 1.8678552191704512, + 2.2902759928256273, + 2.308898175135255, + 1.3335425481200218, + 1.8188817854970694, + 1.7963718231767416, + 2.243480021134019, + 1.7883805689925794, + 0.27159228175878525, + 0.6785292159765959, + 1.0857478454709053, + 1.43838769197464, + 1.1592424474656582, + 2.133607989177108, + 1.3818853162229061, + 1.2279009111225605, + 2.2212256137281656, + 2.1698883082717657, + 2.4888124763965607, + 2.643641361966729, + 3.2016508169472218, + 2.364180448843399, + 2.1175123564898968, + 1.289503973617684, + 1.2398466132581234, + 1.109436159953475, + 1.2622486483305693, + 2.1865108094352763, + 1.7062497269362211, + 1.215607639402151, + 3.316073275083909, + 2.0214196406304836, + 2.5233296249061823, + 1.2745471354573965, + 1.1442358251661062, + 1.6717678867280483, + 0.924266692250967, + 2.7437903434038162, + 0.7280728742480278, + 2.0789055712521076 + ], + "unique_experts": 64, + "load_cv": 0.3177998335560577, + "normalized_load_entropy": 0.9868999887202278, + "max_load_share": 0.0272938443670151 + } + }, + "s0_bos": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "278116aa4231fca1a0f2e50fa33bbdf0a5228f7de674e60e2b2be8a134e2a81e", + "route_weight_sha256": "87787eca2f065f4a1a3e0eeeb16ebe7176110aae4d184741838176e3631b4d26", + "loads": [ + 30, + 24, + 15, + 21, + 14, + 23, + 15, + 28, + 17, + 27, + 28, + 16, + 19, + 46, + 26, + 18, + 23, + 3, + 35, + 22, + 14, + 19, + 34, + 28, + 31, + 31, + 20, + 31, + 36, + 28, + 27, + 16, + 3, + 9, + 17, + 27, + 13, + 34, + 22, + 15, + 37, + 29, + 28, + 30, + 30, + 23, + 27, + 19, + 33, + 22, + 13, + 18, + 22, + 22, + 42, + 28, + 22, + 10, + 24, + 19, + 12, + 24, + 10, + 27 + ], + "weighted_loads": [ + 2.472417054697871, + 1.399457449093461, + 0.9819460026919842, + 1.7086333520710468, + 0.8083238489925861, + 1.198586130514741, + 0.5723176002502441, + 1.0076387394219637, + 0.5841773375868797, + 2.0894175320863724, + 2.0377717446535826, + 0.8932181540876627, + 0.6734553817659616, + 2.6899454221129417, + 1.1678408663719893, + 1.2608634419739246, + 0.8535284008830786, + 0.0784322191029787, + 2.08830850943923, + 1.659126739948988, + 0.7415435388684273, + 2.0680847130715847, + 1.3890258744359016, + 1.798002114519477, + 1.7625222727656364, + 2.086492095142603, + 1.0699386037886143, + 1.2767509669065475, + 1.8550274074077606, + 1.8360565099865198, + 2.130491344258189, + 1.1360238771885633, + 0.14237808622419834, + 0.3871197085827589, + 1.2057442460209131, + 1.3290983196347952, + 0.8651851247996092, + 2.1493250653147697, + 1.4719260018318892, + 0.918976565822959, + 1.9819866325706244, + 1.642613422125578, + 2.3156754318624735, + 2.417969672009349, + 2.222400140017271, + 1.5598728097975254, + 2.164739452302456, + 1.2628526613116264, + 1.0099656023085117, + 0.9797760006040335, + 0.8727002069354057, + 1.8428929671645164, + 1.4344871938228607, + 1.0967903025448322, + 3.4276475682854652, + 1.4516287744045258, + 2.1977570075541735, + 0.4031525030732155, + 0.8201952762901783, + 0.9419904202222824, + 0.628867557272315, + 2.4441004544496536, + 0.7336504068225622, + 1.5349926091730595 + ], + "unique_experts": 64, + "load_cv": 0.37038248817949354, + "normalized_load_entropy": 0.9819973153620407, + "max_load_share": 0.03116531165311653 + }, + "full_input": { + "tokens": 271, + "top_k": 6, + "decisions": 1626, + "ordered_route_sha256": "199b96a8da9403e31fc9c53d3836f19e2fa879c0088d041afa947b87e15e9c2a", + "route_weight_sha256": "e7e278e39dd5166a15cc5f95d11b8e2b115b89b84b71109921590a42f4964705", + "loads": [ + 32, + 24, + 17, + 21, + 18, + 23, + 16, + 30, + 32, + 27, + 30, + 20, + 19, + 46, + 26, + 27, + 23, + 5, + 35, + 22, + 17, + 19, + 35, + 28, + 31, + 35, + 33, + 32, + 36, + 28, + 27, + 20, + 4, + 11, + 17, + 27, + 14, + 34, + 22, + 18, + 38, + 39, + 29, + 35, + 30, + 33, + 28, + 20, + 33, + 22, + 17, + 18, + 26, + 22, + 45, + 32, + 26, + 20, + 24, + 29, + 14, + 28, + 10, + 27 + ], + "weighted_loads": [ + 2.5882067810744047, + 1.399457449093461, + 1.0670410692691803, + 1.7086333520710468, + 0.977586293593049, + 1.198586130514741, + 0.6340584605932236, + 1.2677070070058107, + 1.403079841285944, + 2.0894175320863724, + 2.29523697309196, + 0.9979223441332579, + 0.6734553817659616, + 2.6899454221129417, + 1.1678408663719893, + 1.8761252723634243, + 0.8535284008830786, + 0.18445836566388607, + 2.08830850943923, + 1.659126739948988, + 1.07712422311306, + 2.0680847130715847, + 1.4192970804870129, + 1.798002114519477, + 1.7625222727656364, + 2.262555420398712, + 1.878109723329544, + 1.3389823138713837, + 1.8550274074077606, + 1.8360565099865198, + 2.130491344258189, + 1.5630353819578886, + 0.204021530225873, + 0.5715017225593328, + 1.2057442460209131, + 1.3290983196347952, + 0.8856750447303057, + 2.1493250653147697, + 1.4719260018318892, + 1.1570106726139784, + 2.025213858112693, + 2.0532726608216763, + 2.358497327193618, + 2.552863024175167, + 2.222400140017271, + 2.37680995836854, + 2.1910197604447603, + 1.282737297937274, + 1.0099656023085117, + 0.9797760006040335, + 1.022542417049408, + 1.8428929671645164, + 1.6969198547303677, + 1.0967903025448322, + 3.4981288835406303, + 1.9841781482100487, + 2.5393520276993513, + 0.9849786572158337, + 0.8201952762901783, + 1.6250291094183922, + 0.8245193418115377, + 2.66689957305789, + 0.7336504068225622, + 1.5349926091730595 + ], + "unique_experts": 64, + "load_cv": 0.3340361050713408, + "normalized_load_entropy": 0.9853238313270594, + "max_load_share": 0.028290282902829027 + } + }, + "s1_bos": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "2fd74f6da8709f77a06e9dd50d2adb51a473dccd7af64b7c95c292bb2ff9dd3b", + "route_weight_sha256": "3816dc11466788faaf8521142dc8c2dfadca1297c4523b31c71a8a7b74b0d1cb", + "loads": [ + 30, + 23, + 15, + 22, + 14, + 25, + 15, + 23, + 13, + 27, + 28, + 16, + 16, + 46, + 23, + 18, + 24, + 2, + 35, + 22, + 14, + 19, + 36, + 28, + 30, + 31, + 26, + 30, + 35, + 26, + 27, + 18, + 3, + 7, + 17, + 27, + 13, + 34, + 22, + 15, + 38, + 35, + 28, + 29, + 36, + 20, + 27, + 19, + 43, + 21, + 13, + 18, + 22, + 22, + 42, + 28, + 20, + 9, + 19, + 22, + 10, + 24, + 11, + 25 + ], + "weighted_loads": [ + 2.375261429697275, + 1.40066746622324, + 0.938483189791441, + 1.7346797212958336, + 0.7983349580317736, + 1.3127254452556372, + 0.5669010654091835, + 0.8876710943877697, + 0.4415576923638582, + 2.0540355257689953, + 2.0125617925077677, + 0.8999323919415474, + 0.5645313784480095, + 2.681049555540085, + 1.036077732220292, + 1.2410027757287025, + 0.8907123878598213, + 0.058311235159635544, + 2.03918887488544, + 1.6303087528795004, + 0.7547507677227259, + 2.1353657357394695, + 1.4932596199214458, + 1.7570677902549505, + 1.7174951303750277, + 2.025559289380908, + 1.274253847077489, + 1.2207557335495949, + 1.803268751129508, + 1.751188999041915, + 2.161361802369356, + 1.2030065637081861, + 0.13806061632931232, + 0.2992196325212717, + 1.207958547398448, + 1.3172595519572496, + 0.8675292376428843, + 2.0856105890125036, + 1.460690088570118, + 0.8972021676599979, + 1.9526829347014427, + 1.9526033345609903, + 2.247387308627367, + 2.3720079138875008, + 2.4206677824258804, + 1.4624510072171688, + 2.139815991744399, + 1.2844441644847393, + 1.2792538348585367, + 0.9695586301386356, + 0.8700260370969772, + 1.8718568831682205, + 1.41631661914289, + 1.1251824162900448, + 3.406748501583934, + 1.4455128088593483, + 2.1270683109760284, + 0.3898820038884878, + 0.6679522171616554, + 1.0189699158072472, + 0.5900180079042912, + 2.4316855296492577, + 0.7515188176184893, + 1.4810103960335255 + ], + "unique_experts": 64, + "load_cv": 0.39791282786125165, + "normalized_load_entropy": 0.979348567864349, + "max_load_share": 0.03116531165311653 + }, + "full_input": { + "tokens": 287, + "top_k": 6, + "decisions": 1722, + "ordered_route_sha256": "34909aa93bcf5e4e9545ced4b4d042d5be580b02079183064dc34257af70de6c", + "route_weight_sha256": "b37e0635c0ab3cffbecddf56e33bd87ccae801fa95e9140451f6db9eb18e91eb", + "loads": [ + 34, + 23, + 18, + 23, + 21, + 27, + 16, + 26, + 34, + 27, + 33, + 20, + 16, + 48, + 24, + 30, + 24, + 7, + 36, + 23, + 17, + 21, + 40, + 29, + 32, + 36, + 45, + 32, + 35, + 28, + 28, + 24, + 4, + 9, + 18, + 27, + 14, + 35, + 22, + 20, + 39, + 47, + 32, + 35, + 37, + 30, + 28, + 22, + 45, + 21, + 22, + 22, + 27, + 22, + 47, + 32, + 30, + 23, + 21, + 32, + 13, + 29, + 11, + 29 + ], + "weighted_loads": [ + 2.607164453715086, + 1.40066746622324, + 1.09088683873415, + 1.76659282669425, + 1.2081983629614115, + 1.4508312325924635, + 0.6120725721120834, + 1.1160545405000448, + 1.6727537270635366, + 2.0540355257689953, + 2.4595905635505915, + 1.1219132039695978, + 0.5645313784480095, + 2.7449890580028296, + 1.0566218849271536, + 1.942565344274044, + 0.8907123878598213, + 0.2596639711409807, + 2.07852696813643, + 1.696393309161067, + 1.0469999480992556, + 2.339996200054884, + 1.7639104668051004, + 1.7917058486491442, + 1.7894047778099775, + 2.229457950219512, + 2.5520352981984615, + 1.3124758414924145, + 1.803268751129508, + 1.9133746605366468, + 2.247302185744047, + 1.849912477657199, + 0.18758094497025013, + 0.44053626619279385, + 1.230908328667283, + 1.3172595519572496, + 1.1263848785310984, + 2.1189837474375963, + 1.460690088570118, + 1.2544352002441883, + 1.9950358681380749, + 2.5258723571896553, + 2.490923276171088, + 2.5705913603305817, + 2.5733492970466614, + 2.229975126683712, + 2.1700536776334047, + 1.3875720016658306, + 1.4306353069841862, + 0.9695586301386356, + 1.305303867906332, + 2.2373035736382008, + 1.7315546292811632, + 1.1251824162900448, + 3.5258101988583803, + 1.9540716484189034, + 2.6126033309847116, + 1.1981417406350374, + 0.7430841960012913, + 1.6559367291629314, + 0.8074416294693947, + 2.7450151816010475, + 0.7515188176184893, + 1.973119955509901 + ], + "unique_experts": 64, + "load_cv": 0.3536103783562421, + "normalized_load_entropy": 0.9839427186945071, + "max_load_share": 0.027874564459930314 + } + }, + "s0_x": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "5dba6e2d455ace0f314e383366861541f9f4ea314289097fadeeed4ba6b8d22d", + "route_weight_sha256": "24fe4ee11557327710d8b4192f54a707b6194b76937935dd1e08981ceb5a28d8", + "loads": [ + 30, + 23, + 15, + 21, + 14, + 23, + 16, + 25, + 18, + 27, + 29, + 15, + 19, + 46, + 24, + 18, + 20, + 4, + 35, + 22, + 14, + 19, + 33, + 25, + 31, + 31, + 26, + 30, + 37, + 25, + 26, + 18, + 4, + 9, + 15, + 27, + 13, + 34, + 21, + 16, + 40, + 34, + 28, + 31, + 27, + 21, + 26, + 19, + 41, + 19, + 12, + 18, + 22, + 22, + 42, + 29, + 20, + 11, + 25, + 19, + 13, + 24, + 10, + 25 + ], + "weighted_loads": [ + 2.4527338966727257, + 1.3746464848518372, + 0.9603114034980536, + 1.6813987269997597, + 0.8017438855022192, + 1.2877675108611584, + 0.6289614960551262, + 0.9339617732912302, + 0.6310917139053345, + 2.0491840057075024, + 2.0721446964889765, + 0.8332929518073797, + 0.6807664204388857, + 2.765403848141432, + 1.1047320887446404, + 1.212374608963728, + 0.7762351017445326, + 0.10819696076214314, + 2.168395012617111, + 1.6257173735648394, + 0.7485946658998728, + 2.117553625255823, + 1.358130907639861, + 1.6340565085411072, + 1.8187298271805048, + 2.05483041703701, + 1.2585317231714725, + 1.2556586358696222, + 1.8666843343526125, + 1.7061018459498882, + 2.088230824097991, + 1.2211707774549723, + 0.1941980179399252, + 0.418092442676425, + 1.139716750010848, + 1.3450872581452131, + 0.8511925488710403, + 2.2276374753564596, + 1.413123156875372, + 0.9427060522139072, + 2.14455134794116, + 1.8364656586199999, + 2.304860746487975, + 2.4572594445198774, + 2.131046462804079, + 1.5354739278554916, + 2.128907036036253, + 1.249517247080803, + 1.2372044268995523, + 0.8964338228106499, + 0.8330671805888414, + 1.8536287099123, + 1.3928898572921753, + 1.101147212088108, + 3.4551221132278442, + 1.491382634267211, + 2.1003464832901955, + 0.44142889603972435, + 0.8598794937133789, + 0.946376858279109, + 0.694224014878273, + 2.3983883522450924, + 0.731682350859046, + 1.5014225598424673 + ], + "unique_experts": 64, + "load_cv": 0.37885170826853126, + "normalized_load_entropy": 0.9818960595289258, + "max_load_share": 0.03116531165311653 + }, + "full_input": { + "tokens": 271, + "top_k": 6, + "decisions": 1626, + "ordered_route_sha256": "9dced91d3b77e9a1cf73bcb0e5bc7a7c9e77760970ab2d2ea52033ef658034c0", + "route_weight_sha256": "387268784297b726577219ce9e870af46f43750e31b19312fd4203ce96f555d3", + "loads": [ + 31, + 23, + 17, + 21, + 18, + 23, + 17, + 28, + 33, + 28, + 31, + 18, + 19, + 46, + 25, + 28, + 20, + 5, + 35, + 22, + 17, + 19, + 35, + 25, + 31, + 35, + 40, + 31, + 37, + 25, + 26, + 22, + 5, + 11, + 15, + 27, + 13, + 34, + 21, + 19, + 41, + 45, + 28, + 36, + 27, + 32, + 26, + 20, + 41, + 19, + 16, + 18, + 26, + 22, + 45, + 33, + 23, + 20, + 25, + 30, + 14, + 28, + 10, + 25 + ], + "weighted_loads": [ + 2.5445364639163017, + 1.3746464848518372, + 1.0546494144946337, + 1.6813987269997597, + 0.9700701683759689, + 1.2877675108611584, + 0.6907023563981056, + 1.2336373291909695, + 1.4528494216501713, + 2.075688913464546, + 2.3303695116192102, + 0.9046250451356173, + 0.6807664204388857, + 2.765403848141432, + 1.12708848901093, + 1.9446314238011837, + 0.7762351017445326, + 0.17957529611885548, + 2.168395012617111, + 1.6257173735648394, + 1.0784799102693796, + 2.117553625255823, + 1.4194847624748945, + 1.6340565085411072, + 1.8187298271805048, + 2.2353885024785995, + 2.0973630603402853, + 1.3220586869865656, + 1.8666843343526125, + 1.7061018459498882, + 2.088230824097991, + 1.6585330907255411, + 0.25584146194159985, + 0.6031937431544065, + 1.139716750010848, + 1.3450872581452131, + 0.8511925488710403, + 2.2276374753564596, + 1.413123156875372, + 1.204738698899746, + 2.1876942105591297, + 2.3028951603919268, + 2.304860746487975, + 2.5961654502898455, + 2.131046462804079, + 2.3862153105437756, + 2.128907036036253, + 1.2683067340403795, + 1.2372044268995523, + 0.8964338228106499, + 0.9835188519209623, + 1.8536287099123, + 1.6386139132082462, + 1.101147212088108, + 3.52592939324677, + 2.0436471980065107, + 2.2931607328355312, + 0.9419030360877514, + 0.8598794937133789, + 1.727199425920844, + 0.7848496288061142, + 2.6184252500534058, + 0.731682350859046, + 1.5014225598424673 + ], + "unique_experts": 64, + "load_cv": 0.35857126509828663, + "normalized_load_entropy": 0.9837196735671523, + "max_load_share": 0.028290282902829027 + } + }, + "s1_x": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "eb45d4a21e69a95cc4f96dd3a448fdef7cdeefe4e76a9b33f283ea787130bfc1", + "route_weight_sha256": "a43eb6b351fc190d862713ec575043636748de42106db3f06db690bd3a66d827", + "loads": [ + 30, + 25, + 15, + 21, + 14, + 25, + 16, + 22, + 12, + 27, + 28, + 15, + 14, + 46, + 23, + 18, + 24, + 1, + 35, + 22, + 14, + 19, + 35, + 27, + 30, + 31, + 35, + 28, + 34, + 24, + 28, + 17, + 4, + 8, + 16, + 27, + 13, + 33, + 21, + 15, + 39, + 36, + 28, + 29, + 34, + 20, + 27, + 19, + 45, + 21, + 13, + 18, + 21, + 22, + 42, + 28, + 19, + 9, + 22, + 20, + 10, + 24, + 11, + 27 + ], + "weighted_loads": [ + 2.3606732841581106, + 1.4533388577401638, + 0.9235930070281029, + 1.6772380843758583, + 0.7863450739532709, + 1.3408212400972843, + 0.5992844272404909, + 0.8631488773971796, + 0.41046215035021305, + 2.020523253828287, + 2.015218798071146, + 0.8570261616259813, + 0.5057245492935181, + 2.7599152252078056, + 1.0229111816734076, + 1.2174098212271929, + 0.8875110894441605, + 0.029565131291747093, + 2.0570599772036076, + 1.6075493190437555, + 0.7571977116167545, + 2.16179346293211, + 1.460316151380539, + 1.7097388245165348, + 1.7350567504763603, + 1.9829372745007277, + 1.5604631789028645, + 1.1632949654012918, + 1.769828300923109, + 1.6819999311119318, + 2.1958804838359356, + 1.179794592782855, + 0.17561797983944416, + 0.3288069237023592, + 1.171666942536831, + 1.3318858873099089, + 0.8575594685971737, + 2.0961343944072723, + 1.4186119083315134, + 0.8943250812590122, + 2.0596416275948286, + 2.000842437148094, + 2.239954059943557, + 2.373299663886428, + 2.3970491904765368, + 1.4749846570193768, + 2.124443566426635, + 1.2813041619956493, + 1.3345015551894903, + 0.9670464191585779, + 0.8720772229135036, + 1.866117000579834, + 1.3660198673605919, + 1.1350484006106853, + 3.3978718128055334, + 1.4491918124258518, + 2.0604102835059166, + 0.3958747647702694, + 0.7570513412356377, + 0.9690204989165068, + 0.6029172874987125, + 2.406313743442297, + 0.7500679586082697, + 1.5409732852131128 + ], + "unique_experts": 64, + "load_cv": 0.40530083895666225, + "normalized_load_entropy": 0.9786257536577012, + "max_load_share": 0.03116531165311653 + }, + "full_input": { + "tokens": 287, + "top_k": 6, + "decisions": 1722, + "ordered_route_sha256": "a7934e44078fce7ee37d4f975394856d87507dd1c40e7da950b51fc6a935d634", + "route_weight_sha256": "80102365ea30b01611467aae23031c0204c2c13110fc7970fb7c9706f934bd0e", + "loads": [ + 33, + 25, + 18, + 21, + 21, + 27, + 17, + 26, + 33, + 28, + 33, + 18, + 14, + 48, + 24, + 31, + 24, + 6, + 36, + 23, + 17, + 21, + 39, + 28, + 32, + 36, + 55, + 30, + 34, + 26, + 29, + 23, + 5, + 10, + 16, + 27, + 14, + 34, + 21, + 20, + 40, + 49, + 31, + 35, + 35, + 31, + 28, + 22, + 48, + 21, + 22, + 22, + 26, + 22, + 47, + 32, + 28, + 22, + 24, + 31, + 12, + 29, + 11, + 31 + ], + "weighted_loads": [ + 2.5670461487025023, + 1.4533388577401638, + 1.0832907445728779, + 1.6772380843758583, + 1.1944600697606802, + 1.4789270274341106, + 0.6444559339433908, + 1.1294399034231901, + 1.6421002950519323, + 2.045484099537134, + 2.4617322124540806, + 1.0506847202777863, + 0.5057245492935181, + 2.825699696317315, + 1.0446788650006056, + 2.0294376853853464, + 0.8875110894441605, + 0.23091786727309227, + 2.0963980704545975, + 1.6736338753253222, + 1.046769868582487, + 2.3664239272475243, + 1.7309669982641935, + 1.7443768829107285, + 1.8069663979113102, + 2.191217863932252, + 2.876715114340186, + 1.2566626723855734, + 1.769828300923109, + 1.8441855926066637, + 2.2818208672106266, + 1.8329359572380781, + 0.22513830848038197, + 0.47112394310534, + 1.171666942536831, + 1.3318858873099089, + 1.1164151094853878, + 2.129507552832365, + 1.4186119083315134, + 1.2693553902208805, + 2.10204772092402, + 2.6406081449240446, + 2.4471414797008038, + 2.571883110329509, + 2.5497307050973177, + 2.277239792048931, + 2.1580826696008444, + 1.3834841512143612, + 1.5074062291532755, + 0.9670464191585779, + 1.305909387767315, + 2.2315636910498142, + 1.6672445051372051, + 1.1350484006106853, + 3.516996653750539, + 1.9680325277149677, + 2.4179862570017576, + 1.1240086313337088, + 0.8321833200752735, + 1.7003725711256266, + 0.7182875797152519, + 2.7178315557539463, + 0.7500679586082697, + 2.0330828446894884 + ], + "unique_experts": 64, + "load_cv": 0.372977849532296, + "normalized_load_entropy": 0.98268049629359, + "max_load_share": 0.03193960511033682 + } + }, + "s0_period": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "b6526d18c87d817d7a815a3d65471988bd5e00a3659c2a554b9b506d83537bce", + "route_weight_sha256": "4d165c5869f18091d36955e5165fd8d1537a062fb9b0264bac6ddb5cf16501fb", + "loads": [ + 30, + 22, + 15, + 21, + 14, + 23, + 16, + 25, + 18, + 27, + 29, + 15, + 19, + 46, + 24, + 18, + 18, + 5, + 35, + 22, + 14, + 19, + 35, + 25, + 31, + 31, + 26, + 29, + 36, + 25, + 26, + 18, + 4, + 10, + 15, + 27, + 13, + 34, + 21, + 16, + 40, + 33, + 28, + 31, + 27, + 21, + 26, + 19, + 41, + 20, + 12, + 18, + 22, + 22, + 42, + 29, + 20, + 11, + 25, + 20, + 13, + 24, + 10, + 25 + ], + "weighted_loads": [ + 2.4537230916321278, + 1.3473222013562918, + 0.9580056853592396, + 1.6753955967724323, + 0.80068589001894, + 1.2937826253473759, + 0.6404269393533468, + 0.9320989530533552, + 0.6253735572099686, + 2.0479433462023735, + 2.0729398261755705, + 0.830105897039175, + 0.6798443030565977, + 2.766188472509384, + 1.103179894387722, + 1.2129438258707523, + 0.7222608085721731, + 0.12994684092700481, + 2.1536093410104513, + 1.6214653588831425, + 0.7455493845045567, + 2.121879640966654, + 1.4376288652420044, + 1.6369577050209045, + 1.8351930379867554, + 2.0552531499415636, + 1.2597920913249254, + 1.2436368204653263, + 1.8049194794148207, + 1.6996962912380695, + 2.0924978852272034, + 1.2199207935482264, + 0.18664932437241077, + 0.44741490110754967, + 1.13570062443614, + 1.3433588035404682, + 0.8493412975221872, + 2.222799466922879, + 1.4164061900228262, + 0.9454481061547995, + 2.1505116634070873, + 1.8092857114970684, + 2.301678305491805, + 2.460455983877182, + 2.1311227027326822, + 1.5389158017933369, + 2.1326016280800104, + 1.2471868097782135, + 1.2307745218276978, + 0.9160431120544672, + 0.8326873350888491, + 1.857120469212532, + 1.389812359586358, + 1.1068815998733044, + 3.441660000011325, + 1.5002050902694464, + 2.106780633330345, + 0.44049579836428165, + 0.859382638707757, + 0.9709545932710171, + 0.6922945603728294, + 2.3960242606699467, + 0.731831768527627, + 1.5049940291792154 + ], + "unique_experts": 64, + "load_cv": 0.3758153959460853, + "normalized_load_entropy": 0.9823438283920071, + "max_load_share": 0.03116531165311653 + }, + "full_input": { + "tokens": 271, + "top_k": 6, + "decisions": 1626, + "ordered_route_sha256": "e602596da7ad4c9e71bd57a3c1ed888d70b793f277cf1b981e64b1fbf3e8b95a", + "route_weight_sha256": "a8187a6389b416d55d16576d0c0d5a45d0a4d2b32551e7e452d1fcef51c4aff3", + "loads": [ + 31, + 22, + 17, + 21, + 19, + 23, + 17, + 27, + 33, + 28, + 31, + 19, + 19, + 47, + 25, + 27, + 18, + 6, + 35, + 22, + 17, + 19, + 36, + 25, + 31, + 35, + 39, + 30, + 36, + 25, + 26, + 22, + 5, + 12, + 15, + 28, + 13, + 34, + 21, + 19, + 41, + 43, + 28, + 37, + 27, + 31, + 26, + 20, + 42, + 20, + 16, + 19, + 26, + 22, + 45, + 33, + 23, + 19, + 25, + 31, + 14, + 28, + 10, + 25 + ], + "weighted_loads": [ + 2.5471085719764233, + 1.3473222013562918, + 1.0435285940766335, + 1.6753955967724323, + 1.0907300729304552, + 1.2937826253473759, + 0.7021677996963263, + 1.1837394814938307, + 1.4238644167780876, + 2.0735422298312187, + 2.330082071945071, + 1.0379663668572903, + 0.6798443030565977, + 2.790101822465658, + 1.125331962481141, + 1.828205656260252, + 0.7222608085721731, + 0.20132517628371716, + 2.1536093410104513, + 1.6214653588831425, + 1.0745440684258938, + 2.121879640966654, + 1.4679000712931156, + 1.6369577050209045, + 1.8351930379867554, + 2.235326213762164, + 2.0687734242528677, + 1.3093036375939846, + 1.8049194794148207, + 1.6996962912380695, + 2.0924978852272034, + 1.6582849640399218, + 0.24829276837408543, + 0.6327722147107124, + 1.13570062443614, + 1.364579325541854, + 0.8493412975221872, + 2.222799466922879, + 1.4164061900228262, + 1.1876780558377504, + 2.194209437817335, + 2.2199449501931667, + 2.301678305491805, + 2.623887948691845, + 2.1311227027326822, + 2.3558529503643513, + 2.1326016280800104, + 1.2659593652933836, + 1.2518189549446106, + 0.9160431120544672, + 0.982936879619956, + 1.9101825803518295, + 1.6487443093210459, + 1.1068815998733044, + 3.5124051589518785, + 2.0554359387606382, + 2.2996776588261127, + 0.9139193724840879, + 0.859382638707757, + 1.6840026155114174, + 0.7829201743006706, + 2.613480005413294, + 0.731831768527627, + 1.5049940291792154 + ], + "unique_experts": 64, + "load_cv": 0.35511160213711546, + "normalized_load_entropy": 0.9841599050177898, + "max_load_share": 0.02890528905289053 + } + }, + "s1_period": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "1de59b6a99e858bf29f05dac0d19a5402dc280625e0a3977ecfa11fc307949da", + "route_weight_sha256": "227dc2ba89fa6bea4b282f4e7dca46f03a506de046aadf6587d3c0c188aee369", + "loads": [ + 30, + 25, + 15, + 21, + 14, + 25, + 16, + 22, + 12, + 27, + 28, + 14, + 13, + 46, + 23, + 18, + 24, + 1, + 35, + 22, + 14, + 19, + 35, + 27, + 30, + 31, + 36, + 29, + 34, + 24, + 27, + 18, + 4, + 8, + 16, + 27, + 13, + 33, + 22, + 15, + 39, + 37, + 28, + 29, + 32, + 20, + 27, + 19, + 43, + 22, + 14, + 18, + 21, + 22, + 42, + 28, + 18, + 10, + 22, + 20, + 10, + 24, + 11, + 27 + ], + "weighted_loads": [ + 2.3599996268749237, + 1.4539052490144968, + 0.922353770583868, + 1.6757962740957737, + 0.7851331811398268, + 1.3428623210638762, + 0.6030485425144434, + 0.8625085838139057, + 0.40616236440837383, + 2.019513349980116, + 2.0151258651167154, + 0.8217297699302435, + 0.4787474926561117, + 2.7598219700157642, + 1.021923627704382, + 1.2192273512482643, + 0.8926995694637299, + 0.029618725180625916, + 2.0530911460518837, + 1.6066612526774406, + 0.7537653520703316, + 2.163358498364687, + 1.460781130939722, + 1.7098013367503881, + 1.7420059610158205, + 1.9825955424457788, + 1.5835432093590498, + 1.1912838239222765, + 1.7698421459645033, + 1.6789848078042269, + 2.1663753464818, + 1.2118122763931751, + 0.17239722050726414, + 0.3298278171569109, + 1.1719183530658484, + 1.3291768822818995, + 0.856214864179492, + 2.0916722640395164, + 1.4551246725022793, + 0.8942869212478399, + 2.060275621712208, + 2.025732746347785, + 2.2387393917888403, + 2.3752728067338467, + 2.3387540262192488, + 1.4745168685913086, + 2.1293070260435343, + 1.2785900495946407, + 1.2823353800922632, + 0.9899854455143213, + 0.8976888004690409, + 1.8671823143959045, + 1.3607991188764572, + 1.1371426302939653, + 3.399463115260005, + 1.4538918044418097, + 2.059110578149557, + 0.418694781139493, + 0.7578214854001999, + 0.9675977230072021, + 0.6011537071317434, + 2.406393591314554, + 0.7519369125366211, + 1.5412829797714949 + ], + "unique_experts": 64, + "load_cv": 0.40209898676288003, + "normalized_load_entropy": 0.9789028880749243, + "max_load_share": 0.03116531165311653 + }, + "full_input": { + "tokens": 287, + "top_k": 6, + "decisions": 1722, + "ordered_route_sha256": "ef7b12d245c779ae4fdb502f526002cf98872f0f1ea4ae0bf15b9520ddb89081", + "route_weight_sha256": "60c0676f9655ef4e08e614899be881e4c393ec6474eb636115d76b39b085eed7", + "loads": [ + 33, + 25, + 18, + 21, + 22, + 27, + 17, + 25, + 32, + 27, + 33, + 20, + 13, + 48, + 24, + 30, + 24, + 6, + 36, + 23, + 17, + 21, + 39, + 28, + 32, + 36, + 56, + 31, + 34, + 26, + 29, + 24, + 5, + 10, + 16, + 27, + 15, + 34, + 22, + 20, + 40, + 50, + 31, + 35, + 33, + 30, + 27, + 22, + 45, + 22, + 23, + 23, + 27, + 22, + 47, + 32, + 27, + 23, + 24, + 30, + 12, + 29, + 11, + 31 + ], + "weighted_loads": [ + 2.5659717991948128, + 1.4539052490144968, + 1.0719569437205791, + 1.6757962740957737, + 1.312630346044898, + 1.4809681084007025, + 0.6482200492173433, + 1.0789789762347937, + 1.596863517537713, + 2.019513349980116, + 2.4626352433115244, + 1.2045553997159004, + 0.4787474926561117, + 2.826966628432274, + 1.043549818918109, + 1.9207899197936058, + 0.8926995694637299, + 0.2309714611619711, + 2.0924292393028736, + 1.6727458089590073, + 1.0447442531585693, + 2.3679889626801014, + 1.7314319778233767, + 1.7444393951445818, + 1.8139156084507704, + 2.1899913530796766, + 2.8903232906013727, + 1.283481789752841, + 1.7698421459645033, + 1.8411704692989588, + 2.2731863036751747, + 1.8652365244925022, + 0.22191754914820194, + 0.47230142541229725, + 1.1719183530658484, + 1.3291768822818995, + 1.1370342541486025, + 2.125045422464609, + 1.4551246725022793, + 1.250438017770648, + 2.102605178952217, + 2.634137559682131, + 2.4459268115460873, + 2.5738562531769276, + 2.4914355408400297, + 2.242040988057852, + 2.1293070260435343, + 1.3807266280055046, + 1.4337168522179127, + 0.9899854455143213, + 1.3312753420323133, + 2.2755580320954323, + 1.6959709040820599, + 1.1371426302939653, + 3.518556609749794, + 1.974153896793723, + 2.4198581594973803, + 1.14634127356112, + 0.8329534642398357, + 1.6045645363628864, + 0.7165239993482828, + 2.7127640694379807, + 0.7519369125366211, + 2.0333925392478704 + ], + "unique_experts": 64, + "load_cv": 0.3681435627889759, + "normalized_load_entropy": 0.9831289821061158, + "max_load_share": 0.032520325203252036 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 246, + "ordered_topk_exact_tokens": 205, + "set_exact_tokens": 219, + "mean_set_jaccard": 0.9677700348432057, + "mean_token_weighted_tv": 0.005404102460791667, + "aggregate_load_tv": 0.012872628726287264 + }, + "system_bos": { + "tokens": 246, + "ordered_topk_exact_tokens": 163, + "set_exact_tokens": 186, + "mean_set_jaccard": 0.9285714285714285, + "mean_token_weighted_tv": 0.011268448296601211, + "aggregate_load_tv": 0.027777777777777776 + }, + "system_x": { + "tokens": 246, + "ordered_topk_exact_tokens": 168, + "set_exact_tokens": 190, + "mean_set_jaccard": 0.9306039488966318, + "mean_token_weighted_tv": 0.011888572480529547, + "aggregate_load_tv": 0.03048780487804878 + }, + "system_period": { + "tokens": 246, + "ordered_topk_exact_tokens": 168, + "set_exact_tokens": 190, + "mean_set_jaccard": 0.9306039488966318, + "mean_token_weighted_tv": 0.011702804655836122, + "aggregate_load_tv": 0.03048780487804878 + }, + "bos_at_s0": { + "tokens": 246, + "ordered_topk_exact_tokens": 135, + "set_exact_tokens": 164, + "mean_set_jaccard": 0.8945025164537359, + "mean_token_weighted_tv": 0.018772306329593424, + "aggregate_load_tv": 0.04065040650406504 + }, + "bos_at_s1": { + "tokens": 246, + "ordered_topk_exact_tokens": 138, + "set_exact_tokens": 159, + "mean_set_jaccard": 0.8893728222996515, + "mean_token_weighted_tv": 0.01911669530777064, + "aggregate_load_tv": 0.044715447154471545 + }, + "x_at_s0": { + "tokens": 246, + "ordered_topk_exact_tokens": 144, + "set_exact_tokens": 167, + "mean_set_jaccard": 0.8995354239256678, + "mean_token_weighted_tv": 0.016714828573470192, + "aggregate_load_tv": 0.03929539295392954 + }, + "x_at_s1": { + "tokens": 246, + "ordered_topk_exact_tokens": 141, + "set_exact_tokens": 160, + "mean_set_jaccard": 0.8931475029036002, + "mean_token_weighted_tv": 0.01835354265370747, + "aggregate_load_tv": 0.04539295392953929 + }, + "period_at_s0": { + "tokens": 246, + "ordered_topk_exact_tokens": 144, + "set_exact_tokens": 167, + "mean_set_jaccard": 0.8995354239256678, + "mean_token_weighted_tv": 0.016763886614755644, + "aggregate_load_tv": 0.03929539295392954 + }, + "period_at_s1": { + "tokens": 246, + "ordered_topk_exact_tokens": 141, + "set_exact_tokens": 160, + "mean_set_jaccard": 0.894889663182346, + "mean_token_weighted_tv": 0.018207291788535147, + "aggregate_load_tv": 0.04539295392953929 + } + } + }, + "layer_02": { + "layer": 2, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "c2cfff45e1c06be6fed1fb8a65e6cd583b35db6560fd1733bacd84c89be6bc2f", + "route_weight_sha256": "9e09badc924379c1a44225f396f6089ab7e75546ebdb523b8d4225b397b7c4ee", + "loads": [ + 28, + 21, + 22, + 28, + 15, + 21, + 18, + 11, + 19, + 39, + 37, + 24, + 19, + 30, + 22, + 30, + 36, + 27, + 21, + 22, + 22, + 24, + 19, + 21, + 20, + 38, + 26, + 23, + 21, + 21, + 14, + 25, + 24, + 19, + 27, + 21, + 17, + 32, + 21, + 16, + 9, + 19, + 11, + 19, + 33, + 28, + 26, + 27, + 20, + 12, + 23, + 7, + 21, + 33, + 26, + 23, + 28, + 18, + 28, + 26, + 34, + 27, + 21, + 16 + ], + "weighted_loads": [ + 2.302527107298374, + 2.018329069018364, + 1.2134520970284939, + 1.8944154866039753, + 0.9783688951283693, + 1.558616641908884, + 1.0099043548107147, + 0.8938801400363445, + 1.3920976463705301, + 3.6154462583363056, + 1.976452900096774, + 2.246373549103737, + 1.0088576581329107, + 1.5857141073793173, + 0.932076895609498, + 2.0031898375600576, + 2.131133757531643, + 2.731631573289633, + 1.5337515249848366, + 1.2913384214043617, + 1.5475229546427727, + 1.939289292320609, + 2.730004431679845, + 0.9510969594120979, + 1.2716043964028358, + 2.3524249270558357, + 2.473815845325589, + 1.93831941857934, + 1.1772804651409388, + 1.8710275534540415, + 0.8327783737331629, + 1.468297241255641, + 1.504947094246745, + 1.0472507532685995, + 1.5268593840301037, + 1.2457396611571312, + 1.3134014569222927, + 2.3424022514373064, + 1.8127450682222843, + 0.9984727948904037, + 0.34361044503748417, + 1.4798857364803553, + 0.8152537010610104, + 1.3175331875681877, + 3.212702626362443, + 2.193032516166568, + 1.710741050541401, + 1.77392946369946, + 1.4898660201579332, + 0.41853922978043556, + 1.4109230134636164, + 0.2986513338983059, + 1.1808745432645082, + 1.8737339302897453, + 1.6797955855727196, + 1.4224159140139818, + 2.33253663033247, + 1.2935998775064945, + 2.266648119315505, + 2.3211471531540155, + 3.5034155771136284, + 1.879767306149006, + 0.9802354574203491, + 1.1355593316257 + ], + "unique_experts": 64, + "load_cv": 0.2931718289430803, + "normalized_load_entropy": 0.9893068278562909, + "max_load_share": 0.026422764227642278 + }, + "full_input": { + "tokens": 271, + "top_k": 6, + "decisions": 1626, + "ordered_route_sha256": "b1defe0065122b7899da513f09ad207dd827e6afa6abc5ee1adc8c0d3d5fb056", + "route_weight_sha256": "3747e7572a9f117343bc5e170c903d23ee3e46f0a326850ecce5a5dd797306c1", + "loads": [ + 28, + 31, + 22, + 30, + 16, + 21, + 18, + 12, + 22, + 39, + 40, + 24, + 19, + 31, + 30, + 30, + 36, + 28, + 22, + 26, + 24, + 33, + 19, + 21, + 23, + 38, + 27, + 25, + 24, + 21, + 14, + 26, + 24, + 19, + 32, + 36, + 17, + 32, + 24, + 16, + 9, + 19, + 18, + 19, + 33, + 28, + 28, + 31, + 21, + 12, + 23, + 13, + 21, + 34, + 26, + 23, + 28, + 26, + 36, + 29, + 45, + 30, + 27, + 27 + ], + "weighted_loads": [ + 2.302527107298374, + 2.9617067500948906, + 1.2134520970284939, + 3.59190546348691, + 0.9985476173460484, + 1.558616641908884, + 1.0099043548107147, + 0.9404894076287746, + 1.6391521524637938, + 3.6154462583363056, + 2.102363785728812, + 2.246373549103737, + 1.0088576581329107, + 1.6067706029862165, + 1.2402785327285528, + 2.0031898375600576, + 2.131133757531643, + 2.732329168356955, + 1.5353389334632084, + 2.041630797088146, + 1.8603625670075417, + 2.6325923819094896, + 2.730004431679845, + 0.9510969594120979, + 1.4260666966438293, + 2.3524249270558357, + 2.4746635163319297, + 2.176032867282629, + 1.4228820484131575, + 1.8710275534540415, + 0.8327783737331629, + 1.4689935590722598, + 1.504947094246745, + 1.0472507532685995, + 1.7506822422146797, + 3.205456342548132, + 1.3134014569222927, + 2.3424022514373064, + 1.9115841425955296, + 0.9984727948904037, + 0.34361044503748417, + 1.4798857364803553, + 1.4847627021372318, + 1.3175331875681877, + 3.212702626362443, + 2.193032516166568, + 1.7773119993507862, + 2.022626617923379, + 1.515402851626277, + 0.41853922978043556, + 1.4109230134636164, + 1.0078934766352177, + 1.1808745432645082, + 1.875049294438213, + 1.6797955855727196, + 1.4224159140139818, + 2.33253663033247, + 1.7201508805155754, + 2.630333038046956, + 2.5100170131772757, + 4.367069789208472, + 2.01057168841362, + 1.3996483515948057, + 1.8855508994311094 + ], + "unique_experts": 64, + "load_cv": 0.28778870919224847, + "normalized_load_entropy": 0.9897875666797501, + "max_load_share": 0.027675276752767528 + } + }, + "s1_eos": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "349689771009e3c62c51e5a81244287766b725b8c26f7f2bc7b191ea50d3b867", + "route_weight_sha256": "b327e191f357bfad5b89fb50d82758ba595401b99ab89eef31b161cd82621609", + "loads": [ + 28, + 21, + 25, + 28, + 15, + 22, + 18, + 11, + 19, + 39, + 39, + 24, + 19, + 30, + 19, + 29, + 36, + 26, + 21, + 21, + 22, + 24, + 19, + 26, + 21, + 38, + 26, + 23, + 21, + 20, + 13, + 23, + 24, + 21, + 27, + 19, + 17, + 31, + 20, + 16, + 11, + 21, + 11, + 20, + 32, + 28, + 26, + 27, + 20, + 12, + 23, + 5, + 21, + 33, + 27, + 21, + 28, + 19, + 28, + 25, + 34, + 29, + 16, + 18 + ], + "weighted_loads": [ + 2.338359020650387, + 2.0034529846161604, + 1.3213914893567562, + 1.9161506928503513, + 0.97423898242414, + 1.5940366853028536, + 1.0086861569434404, + 0.8944250829517841, + 1.4016884714365005, + 3.6607576720416546, + 2.0649541448801756, + 2.2591367550194263, + 1.0109943151474, + 1.56948403082788, + 0.8385169748216867, + 1.9744075164198875, + 2.1271051224321127, + 2.68615441955626, + 1.53415353782475, + 1.2538689579814672, + 1.5550283342599869, + 1.9490044321864843, + 2.74506726115942, + 1.1072567254304886, + 1.2895625345408916, + 2.3645147439092398, + 2.4876387026160955, + 1.959479009732604, + 1.1752199120819569, + 1.860069828107953, + 0.8216927368193865, + 1.4060938488692045, + 1.518457466736436, + 1.0998436342924833, + 1.5598772317171097, + 1.1386016719043255, + 1.3291305229067802, + 2.280022658407688, + 1.7692022863775492, + 1.002457331866026, + 0.40725979022681713, + 1.5465987231582403, + 0.7876928485929966, + 1.3429969549179077, + 3.1518558356910944, + 2.1914777383208275, + 1.718981470912695, + 1.7406743485480547, + 1.502937562763691, + 0.41521530598402023, + 1.416186997666955, + 0.23450555838644505, + 1.1748134922236204, + 1.8784432094544172, + 1.7053363248705864, + 1.3788534998893738, + 2.3292913772165775, + 1.310259798541665, + 2.2720094192773104, + 2.2790720220655203, + 3.486539613455534, + 1.927360249683261, + 0.8291302435100079, + 1.2304283753037453 + ], + "unique_experts": 64, + "load_cv": 0.29725180279327057, + "normalized_load_entropy": 0.9889143925963757, + "max_load_share": 0.026422764227642278 + }, + "full_input": { + "tokens": 287, + "top_k": 6, + "decisions": 1722, + "ordered_route_sha256": "762267b7d941694dbed07b1c95410adfd81e715950b750f81bc7e244f86477ec", + "route_weight_sha256": "e354c794bf0ff121cfed67299c4e1d101a590ce9248cd186cb7b77b089f557f6", + "loads": [ + 32, + 32, + 26, + 31, + 17, + 23, + 18, + 14, + 28, + 40, + 46, + 24, + 19, + 33, + 30, + 30, + 38, + 27, + 22, + 27, + 24, + 35, + 20, + 26, + 27, + 39, + 27, + 26, + 26, + 20, + 14, + 25, + 24, + 21, + 36, + 36, + 17, + 32, + 26, + 19, + 11, + 21, + 21, + 21, + 35, + 28, + 33, + 34, + 22, + 13, + 24, + 14, + 22, + 37, + 27, + 21, + 32, + 27, + 30, + 34, + 45, + 35, + 26, + 32 + ], + "weighted_loads": [ + 2.859654951840639, + 3.013562308624387, + 1.3467981796711683, + 3.647818997502327, + 1.025759644806385, + 1.7341806162148714, + 1.0086861569434404, + 1.005019199103117, + 2.1940413545817137, + 3.7779103629291058, + 2.3702491130679846, + 2.2591367550194263, + 1.0109943151474, + 1.6153956122579984, + 1.3678572494536638, + 2.006470389664173, + 2.1911924816668034, + 2.686738458171021, + 1.5355312158353627, + 2.044988304376602, + 1.8439238369464874, + 2.7421332858502865, + 2.7840725108981133, + 1.1072567254304886, + 1.569871924817562, + 2.4148106034845114, + 2.488463527406566, + 2.585923558101058, + 1.4271580502390862, + 1.860069828107953, + 0.8555525783449411, + 1.4488736186176538, + 1.518457466736436, + 1.0998436342924833, + 1.9277288690209389, + 2.8796959333121777, + 1.3291305229067802, + 2.3216384910047054, + 1.9630439346656203, + 1.3573876582086086, + 0.40725979022681713, + 1.5465987231582403, + 1.9052665401250124, + 1.5252033025026321, + 3.7983755711466074, + 2.1914777383208275, + 2.330578487366438, + 2.1123548708856106, + 1.5719342306256294, + 0.4584578238427639, + 1.442307934165001, + 1.245909696444869, + 1.351533753797412, + 2.063236910267733, + 1.7053363248705864, + 1.3788534998893738, + 2.583903007209301, + 1.6707426328212023, + 2.38275489769876, + 2.762157190591097, + 4.198569026775658, + 2.335806803777814, + 1.6610994208604097, + 2.3740551341325045 + ], + "unique_experts": 64, + "load_cv": 0.2824163076208876, + "normalized_load_entropy": 0.9902255248992066, + "max_load_share": 0.026713124274099883 + } + }, + "s0_bos": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "ba53e4919d0316e77ce8576516bdd5c1a1ba82a5d0a1fac87b7e969956a35752", + "route_weight_sha256": "390456073e890e6986dd060c2929427400df6bc0fee08c144553ef219bc0f2a5", + "loads": [ + 29, + 23, + 20, + 30, + 18, + 21, + 17, + 13, + 20, + 40, + 31, + 20, + 15, + 26, + 19, + 32, + 37, + 29, + 20, + 18, + 22, + 22, + 19, + 21, + 20, + 39, + 26, + 25, + 31, + 20, + 13, + 25, + 23, + 17, + 29, + 22, + 18, + 36, + 18, + 15, + 10, + 17, + 12, + 17, + 32, + 28, + 26, + 27, + 21, + 12, + 23, + 4, + 19, + 35, + 28, + 23, + 28, + 21, + 29, + 27, + 35, + 28, + 16, + 19 + ], + "weighted_loads": [ + 2.318508442491293, + 2.038516327738762, + 1.1668112333863974, + 2.089001577347517, + 1.083061695098877, + 1.5914541091769934, + 0.9659550450742245, + 0.9670393094420433, + 1.4301031492650509, + 3.6451609525829554, + 1.7214280385524035, + 2.059815326705575, + 0.8977919016033411, + 1.4083701130002737, + 0.8353540766984224, + 2.134716212749481, + 2.2335729226469994, + 2.7256260197609663, + 1.461886778473854, + 1.1135004721581936, + 1.5734435338526964, + 1.8619686476886272, + 2.7999579533934593, + 0.9438545908778906, + 1.2751157004386187, + 2.3174313958734274, + 2.525772787630558, + 2.111819149926305, + 1.5282345730811357, + 1.8788636326789856, + 0.8535086326301098, + 1.5472793877124786, + 1.4705769158899784, + 0.9873758610337973, + 1.6357447374612093, + 1.24726471491158, + 1.414071822538972, + 2.5114938654005527, + 1.6331901960074902, + 0.9679705463349819, + 0.4132287800312042, + 1.3881817106157541, + 0.8447025790810585, + 1.276715848594904, + 3.2068166080862284, + 2.2338631860911846, + 1.8047233261168003, + 1.7643059398978949, + 1.5441440753638744, + 0.42842782847583294, + 1.4339406955987215, + 0.20158605836331844, + 1.1249364577233791, + 2.054323771968484, + 1.7387510985136032, + 1.4048541840165854, + 2.3954643793404102, + 1.3930784035474062, + 2.2963769901543856, + 2.4367408379912376, + 3.8376006055623293, + 1.994590325281024, + 0.9082199931144714, + 1.2222537342458963 + ], + "unique_experts": 64, + "load_cv": 0.31500495179039684, + "normalized_load_entropy": 0.9875730102626159, + "max_load_share": 0.02710027100271003 + }, + "full_input": { + "tokens": 271, + "top_k": 6, + "decisions": 1626, + "ordered_route_sha256": "dd72714adcec401cb141111a834dc1548df9ec97c1660bd3675826b604852648", + "route_weight_sha256": "05c587a8bbb8888f813dc3973f4f135de438f1acc44e65a64cb50494337295d4", + "loads": [ + 29, + 33, + 20, + 31, + 18, + 21, + 17, + 14, + 24, + 40, + 34, + 20, + 16, + 27, + 24, + 32, + 38, + 29, + 20, + 22, + 25, + 31, + 19, + 21, + 22, + 39, + 26, + 27, + 34, + 20, + 13, + 25, + 23, + 17, + 34, + 38, + 18, + 36, + 22, + 15, + 10, + 17, + 19, + 17, + 32, + 28, + 29, + 31, + 22, + 12, + 23, + 11, + 19, + 35, + 28, + 23, + 28, + 29, + 37, + 31, + 46, + 31, + 23, + 31 + ], + "weighted_loads": [ + 2.318508442491293, + 2.9818940088152885, + 1.1668112333863974, + 2.8136820010840893, + 1.083061695098877, + 1.5914541091769934, + 0.9659550450742245, + 1.0136485770344734, + 1.6974961496889591, + 3.6451609525829554, + 1.8473389241844416, + 2.059815326705575, + 0.9297451954334974, + 1.431648876518011, + 1.034021608531475, + 2.134716212749481, + 2.2634041719138622, + 2.7256260197609663, + 1.461886778473854, + 1.8166614882647991, + 1.882077842950821, + 2.5661103017628193, + 2.7999579533934593, + 0.9438545908778906, + 1.3852693308144808, + 2.3174313958734274, + 2.525772787630558, + 2.3762093130499125, + 1.815201884135604, + 1.8788636326789856, + 0.8535086326301098, + 1.5472793877124786, + 1.4705769158899784, + 0.9873758610337973, + 1.8595675956457853, + 3.281215248629451, + 1.414071822538972, + 2.5114938654005527, + 1.8191729336977005, + 0.9679705463349819, + 0.4132287800312042, + 1.3881817106157541, + 1.5473354123532772, + 1.276715848594904, + 3.2068166080862284, + 2.2338631860911846, + 1.910233285278082, + 2.012771127745509, + 1.5696809068322182, + 0.42842782847583294, + 1.4339406955987215, + 0.8574542980641127, + 1.1249364577233791, + 2.054323771968484, + 1.7387510985136032, + 1.4048541840165854, + 2.3954643793404102, + 1.787365274503827, + 2.6600619088858366, + 2.5936338417232037, + 4.703776969574392, + 2.1245901454240084, + 1.479931527748704, + 2.230205934494734 + ], + "unique_experts": 64, + "load_cv": 0.30958947786271984, + "normalized_load_entropy": 0.9882749081613267, + "max_load_share": 0.028290282902829027 + } + }, + "s1_bos": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "f3f5d1246e366bbb40f3c3aaadd9044d093bd2ca635acbb5c2c80f1a269e2190", + "route_weight_sha256": "09f004dcafa1570f9e49a6db829d3c0a3202aa427c0fefbcd49689a6e71676db", + "loads": [ + 29, + 22, + 22, + 29, + 16, + 22, + 16, + 11, + 20, + 40, + 31, + 22, + 21, + 26, + 19, + 30, + 37, + 28, + 20, + 18, + 20, + 23, + 19, + 27, + 20, + 40, + 26, + 25, + 29, + 21, + 13, + 23, + 23, + 17, + 29, + 21, + 18, + 35, + 17, + 15, + 11, + 20, + 12, + 20, + 31, + 28, + 26, + 27, + 20, + 12, + 25, + 4, + 19, + 34, + 28, + 27, + 28, + 17, + 29, + 27, + 33, + 26, + 12, + 20 + ], + "weighted_loads": [ + 2.2602215223014355, + 1.9856333304196596, + 1.246356276795268, + 2.021406525745988, + 1.0388500671833754, + 1.6626288648694754, + 0.9392148107290268, + 0.9124619103968143, + 1.4362233597785234, + 3.6758992820978165, + 1.8060884922742844, + 2.1514877416193485, + 1.1006706468760967, + 1.4154712688177824, + 0.8185050878673792, + 2.1196156479418278, + 2.283229010179639, + 2.6948889065533876, + 1.4769874922931194, + 1.1194780096411705, + 1.538124829530716, + 1.908297149464488, + 2.8548611626029015, + 1.1340329609811306, + 1.2424716390669346, + 2.459777755662799, + 2.562924113124609, + 2.0691505391150713, + 1.4503333680331707, + 1.936054391786456, + 0.8664447721093893, + 1.5267380010336637, + 1.4627112820744514, + 0.9622642789036036, + 1.6665521319955587, + 1.1963443569839, + 1.394909968599677, + 2.473420310765505, + 1.5806187894195318, + 0.9497042149305344, + 0.46608953922986984, + 1.5015168245881796, + 0.7949738390743732, + 1.3754916973412037, + 3.151841688901186, + 2.215114088729024, + 1.7964218594133854, + 1.7272369805723429, + 1.5306515246629715, + 0.42167904041707516, + 1.4922470152378082, + 0.183008236810565, + 1.097185229882598, + 1.9869078826159239, + 1.7803166378289461, + 1.5787223484367132, + 2.3846558313816786, + 1.2419101987034082, + 2.2829654198139906, + 2.516653500497341, + 3.6669458504766226, + 1.883491238579154, + 0.7400033846497536, + 1.2530810181051493 + ], + "unique_experts": 64, + "load_cv": 0.3100228362130249, + "normalized_load_entropy": 0.9878002338813505, + "max_load_share": 0.02710027100271003 + }, + "full_input": { + "tokens": 287, + "top_k": 6, + "decisions": 1722, + "ordered_route_sha256": "9018c55a6ca564e5c0a8f1015d5f780dcc6f9644c1edad175f045ac53b556a0c", + "route_weight_sha256": "6bc43219b6d4a57608c49c75f72252bc94c171d69403b96edc5b45edd6291f8c", + "loads": [ + 33, + 33, + 23, + 32, + 17, + 23, + 16, + 14, + 30, + 41, + 38, + 22, + 22, + 28, + 30, + 31, + 40, + 28, + 20, + 24, + 23, + 34, + 20, + 27, + 25, + 41, + 26, + 28, + 34, + 21, + 14, + 25, + 23, + 17, + 38, + 39, + 18, + 37, + 23, + 18, + 11, + 20, + 22, + 21, + 34, + 28, + 34, + 34, + 22, + 13, + 26, + 13, + 20, + 37, + 28, + 27, + 32, + 23, + 31, + 36, + 44, + 32, + 24, + 34 + ], + "weighted_loads": [ + 2.7815174534916878, + 2.995742654427886, + 1.2717629671096802, + 2.8101849500089884, + 1.0693191979080439, + 1.8027727957814932, + 0.9392148107290268, + 1.0230560265481472, + 2.256869476288557, + 3.7930519729852676, + 2.1113834604620934, + 2.1514877416193485, + 1.1282545309513807, + 1.462085921317339, + 1.3172131106257439, + 2.1516785211861134, + 2.376062711700797, + 2.6948889065533876, + 1.4769874922931194, + 1.84839897044003, + 1.830425962805748, + 2.72420471906662, + 2.8938664123415947, + 1.1340329609811306, + 1.4839614629745483, + 2.5100736152380705, + 2.562924113124609, + 2.7239438612014055, + 1.7600813880562782, + 1.936054391786456, + 0.900304613634944, + 1.569517770782113, + 1.4627112820744514, + 0.9622642789036036, + 2.034403769299388, + 3.027292523533106, + 1.394909968599677, + 2.536740753799677, + 1.8509058272466063, + 1.304634541273117, + 0.46608953922986984, + 1.5015168245881796, + 1.9351974222809076, + 1.5576980449259281, + 3.798361424356699, + 2.215114088729024, + 2.4504369124770164, + 2.0966527722775936, + 1.59964819252491, + 0.4649215582758188, + 1.5183679517358541, + 1.2019839268177748, + 1.2739054914563894, + 2.170616241171956, + 1.7803166378289461, + 1.5787223484367132, + 2.639267461374402, + 1.5041884649544954, + 2.3937108982354403, + 2.9508786033838987, + 4.38089772965759, + 2.2886540833860636, + 1.684507904574275, + 2.574955966323614 + ], + "unique_experts": 64, + "load_cv": 0.29284649670436624, + "normalized_load_entropy": 0.9894081449574298, + "max_load_share": 0.025551684088269456 + } + }, + "s0_x": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "639cdedf0cc430b9cf103eaec64e67bffa8a48e479bb749ad854b221586c8e10", + "route_weight_sha256": "17e01bec82fa0f7ebdd7421c8bd86a59dec7d0251f9d342e9d8f2dfa1101738e", + "loads": [ + 29, + 21, + 21, + 32, + 18, + 21, + 17, + 13, + 20, + 38, + 28, + 21, + 18, + 26, + 22, + 30, + 38, + 28, + 20, + 18, + 21, + 22, + 19, + 25, + 20, + 39, + 26, + 23, + 28, + 20, + 13, + 21, + 23, + 18, + 28, + 22, + 18, + 36, + 18, + 16, + 12, + 18, + 12, + 19, + 32, + 28, + 26, + 27, + 20, + 14, + 23, + 5, + 20, + 34, + 25, + 20, + 28, + 22, + 30, + 27, + 35, + 29, + 18, + 17 + ], + "weighted_loads": [ + 2.3444992564618587, + 1.953506102785468, + 1.2031687200069427, + 2.108518907800317, + 1.0884620938450098, + 1.5916213802993298, + 0.9491770435124636, + 0.9747725706547499, + 1.417354479432106, + 3.589032471179962, + 1.6143024414777756, + 2.098388399928808, + 0.9727574922144413, + 1.3957421202212572, + 0.9295219071209431, + 2.037497801706195, + 2.245816284790635, + 2.7635780423879623, + 1.4383243713527918, + 1.1146107818931341, + 1.541173717007041, + 1.81093430519104, + 2.7519185952842236, + 1.0545939356088638, + 1.2681152764707804, + 2.3564719446003437, + 2.519766379147768, + 2.045118249952793, + 1.4295682348310947, + 1.785672402009368, + 0.8278675228357315, + 1.3808939401060343, + 1.5102123990654945, + 0.9995146729052067, + 1.5793716423213482, + 1.287958426401019, + 1.4137827772647142, + 2.4566195253282785, + 1.598942020907998, + 1.0091612599790096, + 0.4604632928967476, + 1.411996552720666, + 0.8158271461725235, + 1.3274793792515993, + 3.1818607691675425, + 2.226292649284005, + 1.8227092064917088, + 1.7173730246722698, + 1.5014413315802813, + 0.49180137552320957, + 1.4303126279264688, + 0.22971497103571892, + 1.1603691838681698, + 2.0006572753190994, + 1.6481611169874668, + 1.3274516314268112, + 2.3803202509880066, + 1.3946512676775455, + 2.284633094444871, + 2.4274258967489004, + 3.7121436689049006, + 2.023570256307721, + 0.9620692078024149, + 1.1602091640233994 + ], + "unique_experts": 64, + "load_cv": 0.2958649668561972, + "normalized_load_entropy": 0.9892139722001455, + "max_load_share": 0.026422764227642278 + }, + "full_input": { + "tokens": 271, + "top_k": 6, + "decisions": 1626, + "ordered_route_sha256": "18a96911ff6e70d3c0c6e724b50f7318d97eb2728e7621b37d1fb1d857eb8840", + "route_weight_sha256": "25e03c8bfd04d8f18f6a8f678bc87f5ce25a2fa83f5a6622fc9d21bbf709b112", + "loads": [ + 29, + 31, + 21, + 33, + 19, + 21, + 18, + 14, + 24, + 38, + 33, + 22, + 19, + 27, + 27, + 30, + 39, + 28, + 20, + 22, + 24, + 32, + 19, + 25, + 22, + 39, + 26, + 25, + 31, + 20, + 13, + 21, + 23, + 18, + 33, + 37, + 18, + 36, + 21, + 16, + 12, + 18, + 18, + 19, + 32, + 28, + 29, + 32, + 21, + 14, + 23, + 11, + 20, + 34, + 25, + 20, + 28, + 28, + 39, + 30, + 47, + 32, + 24, + 28 + ], + "weighted_loads": [ + 2.3444992564618587, + 2.8968837838619947, + 1.2031687200069427, + 2.833199331536889, + 1.111316965892911, + 1.5916213802993298, + 0.9842086266726255, + 1.02138183824718, + 1.6773198805749416, + 3.589032471179962, + 1.849401280283928, + 2.133608266711235, + 1.0026384443044662, + 1.4196063801646233, + 1.1271632108837366, + 2.037497801706195, + 2.276823751628399, + 2.7635780423879623, + 1.4383243713527918, + 1.832009306177497, + 1.8594399709254503, + 2.8111553639173508, + 2.7519185952842236, + 1.0545939356088638, + 1.3780861478298903, + 2.3564719446003437, + 2.519766379147768, + 2.313019722700119, + 1.7169912662357092, + 1.785672402009368, + 0.8278675228357315, + 1.3808939401060343, + 1.5102123990654945, + 0.9995146729052067, + 1.8031945005059242, + 3.2680031191557646, + 1.4137827772647142, + 2.4566195253282785, + 1.696025187149644, + 1.0091612599790096, + 0.4604632928967476, + 1.411996552720666, + 1.4391960725188255, + 1.3274793792515993, + 3.1818607691675425, + 2.226292649284005, + 1.928325716406107, + 2.00002408772707, + 1.526978163048625, + 0.49180137552320957, + 1.4303126279264688, + 0.8002172969281673, + 1.1603691838681698, + 2.0006572753190994, + 1.6481611169874668, + 1.3274516314268112, + 2.3803202509880066, + 1.7138140201568604, + 2.777117570862174, + 2.560571825131774, + 4.630762538872659, + 2.1517063844949007, + 1.4910547994077206, + 1.8615898061543703 + ], + "unique_experts": 64, + "load_cv": 0.29567152234234584, + "normalized_load_entropy": 0.9895024481855941, + "max_load_share": 0.02890528905289053 + } + }, + "s1_x": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "6cb6a3a169f46378654bf477cd5a4cfc6981c39ca46ef2ac9a5c7627bbd54be1", + "route_weight_sha256": "00f7ec1ae2de73ceb23d76401152ce09f0ca87de7d0ef59dc4cde6d9ec61e47e", + "loads": [ + 29, + 22, + 23, + 27, + 16, + 23, + 16, + 11, + 19, + 40, + 31, + 22, + 21, + 27, + 18, + 31, + 36, + 28, + 20, + 17, + 20, + 23, + 19, + 26, + 20, + 39, + 26, + 24, + 27, + 22, + 13, + 22, + 23, + 18, + 29, + 23, + 18, + 34, + 17, + 15, + 12, + 20, + 12, + 20, + 32, + 28, + 26, + 27, + 20, + 13, + 25, + 4, + 19, + 35, + 28, + 27, + 28, + 16, + 30, + 27, + 35, + 26, + 13, + 18 + ], + "weighted_loads": [ + 2.34183020144701, + 1.9640170112252235, + 1.2835918944329023, + 1.9606123082339764, + 1.0342059098184109, + 1.6848244667053223, + 0.9307135958224535, + 0.9159201458096504, + 1.3998422026634216, + 3.6769957430660725, + 1.8088962864130735, + 2.1613927111029625, + 1.089554836973548, + 1.4193208497017622, + 0.774214182049036, + 2.1532718185335398, + 2.220442896708846, + 2.691389299929142, + 1.469491032883525, + 1.0928823687136173, + 1.531026704236865, + 1.8930719196796417, + 2.8567310981452465, + 1.1070752032101154, + 1.2398096304386854, + 2.4495601560920477, + 2.567050736397505, + 2.0419022385030985, + 1.3859579619020224, + 1.8888323437422514, + 0.8423766233026981, + 1.4897980261594057, + 1.496051300317049, + 0.9990740399807692, + 1.67301987670362, + 1.2986365612596273, + 1.387687936425209, + 2.412036158144474, + 1.4866640735417604, + 0.9564212746918201, + 0.48458052799105644, + 1.509035823866725, + 0.7925315350294113, + 1.3689028061926365, + 3.1702727004885674, + 2.2084914818406105, + 1.8246786147356033, + 1.7128832917660475, + 1.51663276553154, + 0.45102330669760704, + 1.4903422426432371, + 0.17414818331599236, + 1.0951040238142014, + 1.9913096092641354, + 1.7759340181946754, + 1.5671377088874578, + 2.376440592110157, + 1.2113711778074503, + 2.2870977371931076, + 2.560403361916542, + 3.6594285871833563, + 1.889055747538805, + 0.7551517728716135, + 1.1760111469775438 + ], + "unique_experts": 64, + "load_cv": 0.3080265012901031, + "normalized_load_entropy": 0.9879988311299063, + "max_load_share": 0.02710027100271003 + }, + "full_input": { + "tokens": 287, + "top_k": 6, + "decisions": 1722, + "ordered_route_sha256": "143d4564d574d9b9cbd571e021709c71c9b0c421522566b883f1608812e2c59f", + "route_weight_sha256": "bcbfdf7ce40e17b16d552dc57875aec33ad1852e54eecf62d5c0001ca37f3268", + "loads": [ + 33, + 33, + 24, + 29, + 17, + 24, + 16, + 14, + 29, + 41, + 40, + 23, + 22, + 29, + 27, + 32, + 39, + 28, + 20, + 23, + 23, + 35, + 20, + 26, + 25, + 40, + 26, + 27, + 32, + 22, + 14, + 24, + 24, + 18, + 38, + 41, + 18, + 35, + 22, + 18, + 12, + 20, + 21, + 21, + 35, + 28, + 34, + 35, + 22, + 14, + 26, + 13, + 20, + 38, + 28, + 27, + 32, + 22, + 33, + 36, + 47, + 32, + 24, + 31 + ], + "weighted_loads": [ + 2.8631261326372623, + 2.97412633523345, + 1.3089985847473145, + 2.7167975530028343, + 1.0646750405430794, + 1.82496839761734, + 0.9307135958224535, + 1.0265142619609833, + 2.2183554749935865, + 3.7941484339535236, + 2.2285488341003656, + 2.196484211832285, + 1.115957897156477, + 1.4658746365457773, + 1.2189304940402508, + 2.1853346917778254, + 2.3185901269316673, + 2.691389299929142, + 1.469491032883525, + 1.829016713425517, + 1.824715357273817, + 2.991552570834756, + 2.8957363478839397, + 1.1070752032101154, + 1.4811481479555368, + 2.4998560156673193, + 2.567050736397505, + 2.7016256246715784, + 1.702442580834031, + 1.8888323437422514, + 0.8762364648282528, + 1.532577795907855, + 1.5252311248332262, + 0.9990740399807692, + 2.040871514007449, + 3.091197097674012, + 1.387687936425209, + 2.4536519907414913, + 1.6419658279046416, + 1.3113516010344028, + 0.48458052799105644, + 1.509035823866725, + 1.8763740845024586, + 1.551109153777361, + 3.8167924359440804, + 2.2084914818406105, + 2.478724382817745, + 2.1112476009875536, + 1.5856294333934784, + 0.4942658245563507, + 1.516463179141283, + 1.125887019559741, + 1.2718242853879929, + 2.1750179678201675, + 1.7759340181946754, + 1.5671377088874578, + 2.6310522221028805, + 1.4736901726573706, + 2.5036832578480244, + 2.9960046391934156, + 4.419948942027986, + 2.293504886329174, + 1.6424500867724419, + 2.236630454659462 + ], + "unique_experts": 64, + "load_cv": 0.2947564951990002, + "normalized_load_entropy": 0.9894377614779737, + "max_load_share": 0.0272938443670151 + } + }, + "s0_period": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "fdfe75091c4bfa9362e3c83323ce1bc93dd99e6a3ec19faae90d41b40728cbc0", + "route_weight_sha256": "ee27c33c5429d33341663ce24ebabc545e6df3b920274bec6b802f5dd7131cad", + "loads": [ + 29, + 21, + 21, + 32, + 17, + 21, + 16, + 13, + 20, + 38, + 29, + 23, + 19, + 25, + 22, + 31, + 38, + 28, + 20, + 18, + 22, + 22, + 19, + 24, + 20, + 40, + 26, + 23, + 28, + 21, + 13, + 21, + 23, + 19, + 29, + 22, + 17, + 35, + 19, + 17, + 11, + 18, + 11, + 19, + 33, + 28, + 26, + 27, + 19, + 13, + 25, + 5, + 20, + 34, + 25, + 22, + 28, + 17, + 30, + 27, + 35, + 28, + 17, + 17 + ], + "weighted_loads": [ + 2.3400935865938663, + 1.961826879531145, + 1.2071927711367607, + 2.1031221449375153, + 1.0518753565847874, + 1.5944648794829845, + 0.9220794998109341, + 0.9756658300757408, + 1.4191708266735077, + 3.5830789767205715, + 1.6465866398066282, + 2.158551124855876, + 1.0094668604433537, + 1.375208644196391, + 0.9252610914409161, + 2.0642462726682425, + 2.2604309860616922, + 2.784703027456999, + 1.4492143262177706, + 1.1186910923570395, + 1.5698686074465513, + 1.8154863622039557, + 2.753909844905138, + 1.0270203929394484, + 1.2646673582494259, + 2.3970739617943764, + 2.510911013931036, + 2.0185169130563736, + 1.431212967261672, + 1.8362804241478443, + 0.8283252734690905, + 1.390347370877862, + 1.4986768513917923, + 1.0421914234757423, + 1.6097540501505136, + 1.285650560632348, + 1.3834951668977737, + 2.423780433833599, + 1.6340199913829565, + 1.0648824609816074, + 0.43284251913428307, + 1.4159932751208544, + 0.7836267352104187, + 1.325529556721449, + 3.2154633942991495, + 2.2171493992209435, + 1.8147491626441479, + 1.712519746273756, + 1.4812173917889595, + 0.4590541645884514, + 1.4855955261737108, + 0.23198754712939262, + 1.158966388553381, + 2.002573760226369, + 1.6532219406217337, + 1.3888408616185188, + 2.379651114344597, + 1.2291554156690836, + 2.280961524695158, + 2.420199189335108, + 3.7062175273895264, + 1.9822961315512657, + 0.9306993130594492, + 1.1489062495529652 + ], + "unique_experts": 64, + "load_cv": 0.3028326449427903, + "normalized_load_entropy": 0.9886432460535999, + "max_load_share": 0.02710027100271003 + }, + "full_input": { + "tokens": 271, + "top_k": 6, + "decisions": 1626, + "ordered_route_sha256": "5da4dc7ce988f71270a0a773ba73d09af2ae8a487f966913135e625463bfd8c1", + "route_weight_sha256": "13b84fdaafe0a4376167fead5264f5b4afa0b683e79a9ca41731474e0ff77a8c", + "loads": [ + 30, + 31, + 21, + 34, + 18, + 21, + 16, + 14, + 25, + 38, + 32, + 23, + 19, + 26, + 27, + 32, + 38, + 28, + 20, + 22, + 25, + 31, + 19, + 24, + 23, + 40, + 26, + 25, + 31, + 21, + 13, + 21, + 23, + 20, + 34, + 36, + 17, + 35, + 23, + 17, + 11, + 18, + 17, + 19, + 33, + 28, + 30, + 32, + 21, + 13, + 25, + 11, + 20, + 34, + 25, + 22, + 28, + 23, + 38, + 30, + 48, + 31, + 23, + 27 + ], + "weighted_loads": [ + 2.6342161037027836, + 2.9052045606076717, + 1.2071927711367607, + 2.860585756599903, + 1.0750365518033504, + 1.5944648794829845, + 0.9220794998109341, + 1.022275097668171, + 1.7259032502770424, + 3.5830789767205715, + 1.7724975254386663, + 2.158551124855876, + 1.0094668604433537, + 1.3990401737391949, + 1.1227682903409004, + 2.109122859314084, + 2.2604309860616922, + 2.784703027456999, + 1.4492143262177706, + 1.8617579247802496, + 1.8303247075527906, + 2.686666963621974, + 2.753909844905138, + 1.0270203929394484, + 1.4047342576086521, + 2.3970739617943764, + 2.510911013931036, + 2.2865389212965965, + 1.6876454707235098, + 1.8362804241478443, + 0.8283252734690905, + 1.390347370877862, + 1.4986768513917923, + 1.0900880135595798, + 1.8335769083350897, + 3.2044613119214773, + 1.3834951668977737, + 2.423780433833599, + 1.7909822929650545, + 1.0648824609816074, + 0.43284251913428307, + 1.4159932751208544, + 1.4127871841192245, + 1.325529556721449, + 3.2154633942991495, + 2.2171493992209435, + 1.9461728278547525, + 1.9975422658026218, + 1.532854387536645, + 0.4590541645884514, + 1.4855955261737108, + 0.7805581539869308, + 1.158966388553381, + 2.002573760226369, + 1.6532219406217337, + 1.3888408616185188, + 2.379651114344597, + 1.5483975689858198, + 2.644646443426609, + 2.556091383099556, + 4.631173501722515, + 2.110482282936573, + 1.4533927775919437, + 1.8027431946247816 + ], + "unique_experts": 64, + "load_cv": 0.2976299372756929, + "normalized_load_entropy": 0.9893093927082488, + "max_load_share": 0.02952029520295203 + } + }, + "s1_period": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "1a725b55c32ac98c262c086c32dd6908d397a3b4ef722a8b1755f3faf2e7f963", + "route_weight_sha256": "e38d2d2ae030d0c37647d3319f44f482c4d1b8cbc2722867d1b505e255dd9c42", + "loads": [ + 29, + 21, + 23, + 28, + 16, + 23, + 16, + 11, + 19, + 40, + 31, + 21, + 21, + 27, + 18, + 31, + 37, + 28, + 20, + 17, + 20, + 23, + 19, + 27, + 20, + 40, + 26, + 24, + 27, + 22, + 13, + 22, + 23, + 18, + 29, + 23, + 18, + 34, + 17, + 15, + 11, + 20, + 12, + 20, + 31, + 28, + 26, + 27, + 20, + 13, + 25, + 4, + 19, + 35, + 29, + 26, + 28, + 16, + 30, + 27, + 35, + 26, + 13, + 18 + ], + "weighted_loads": [ + 2.3448992259800434, + 1.93137133307755, + 1.2916648350656033, + 1.9788647759705782, + 1.0337958242744207, + 1.685688680037856, + 0.9335375893861055, + 0.9146979339420795, + 1.3956751935184002, + 3.676123920828104, + 1.8067879434674978, + 2.133437030017376, + 1.0882188379764557, + 1.4301325101405382, + 0.7743754833936691, + 2.155323661863804, + 2.2515333592891693, + 2.698213526979089, + 1.4685650914907455, + 1.0946477949619293, + 1.5306339673697948, + 1.8929776977747679, + 2.856138549745083, + 1.1315167844295502, + 1.2370619885623455, + 2.484360484406352, + 2.571189470589161, + 2.037632565945387, + 1.3857603408396244, + 1.9049501046538353, + 0.8441971335560083, + 1.4925436321645975, + 1.4930264614522457, + 0.998504750430584, + 1.6712462585419416, + 1.2971695475280285, + 1.3884504586458206, + 2.412587406113744, + 1.488454082980752, + 0.9588300064206123, + 0.456489235162735, + 1.5136558040976524, + 0.7938123792409897, + 1.3691846393048763, + 3.14881195127964, + 2.2043134160339832, + 1.8224010802805424, + 1.7067912239581347, + 1.5192442666739225, + 0.45048560574650764, + 1.4892249219119549, + 0.17411062493920326, + 1.0911340601742268, + 1.9915896523743868, + 1.8014211431145668, + 1.54862305149436, + 2.373901877552271, + 1.1985212117433548, + 2.2741321083158255, + 2.5510196834802628, + 3.6429030634462833, + 1.8758127056062222, + 0.7559106573462486, + 1.1651894375681877 + ], + "unique_experts": 64, + "load_cv": 0.312382791380077, + "normalized_load_entropy": 0.9876877401191206, + "max_load_share": 0.02710027100271003 + }, + "full_input": { + "tokens": 287, + "top_k": 6, + "decisions": 1722, + "ordered_route_sha256": "d55ba7bc1d7e0a42c374e0317bc246e7aef2aabd2c4b63417731200c58bc5dc2", + "route_weight_sha256": "9c1123da65f2e5ccee117571df0aa2a1f8db97fc14e364cf100bceef67040b22", + "loads": [ + 34, + 32, + 24, + 31, + 18, + 24, + 16, + 14, + 30, + 41, + 38, + 21, + 21, + 28, + 27, + 33, + 40, + 28, + 20, + 23, + 23, + 34, + 20, + 27, + 25, + 41, + 26, + 27, + 32, + 22, + 14, + 24, + 23, + 19, + 38, + 39, + 18, + 35, + 24, + 18, + 11, + 20, + 21, + 21, + 34, + 28, + 35, + 35, + 23, + 14, + 26, + 13, + 20, + 38, + 29, + 26, + 32, + 22, + 32, + 36, + 48, + 32, + 24, + 30 + ], + "weighted_loads": [ + 3.133862093091011, + 2.9414806570857763, + 1.3170715253800154, + 2.7706099580973387, + 1.086747583001852, + 1.825832610949874, + 0.9335375893861055, + 1.0252920500934124, + 2.2574506271630526, + 3.793276611715555, + 2.112082911655307, + 2.133437030017376, + 1.0882188379764557, + 1.4543497990816832, + 1.2191676087677479, + 2.2222497910261154, + 2.348435567691922, + 2.698213526979089, + 1.4685650914907455, + 1.8637511525303125, + 1.7813623640686274, + 2.820066846907139, + 2.895143799483776, + 1.1315167844295502, + 1.4784339256584644, + 2.5346563439816236, + 2.571189470589161, + 2.696943860501051, + 1.6632329523563385, + 1.9049501046538353, + 0.878056975081563, + 1.5353234019130468, + 1.4930264614522457, + 1.0383707471191883, + 2.039097895845771, + 2.9917541183531284, + 1.3884504586458206, + 2.454203238710761, + 1.7363131204620004, + 1.313760332763195, + 0.456489235162735, + 1.5136558040976524, + 1.8808752968907356, + 1.5513909868896008, + 3.795331686735153, + 2.2043134160339832, + 2.5030321814119816, + 2.1103301644325256, + 1.6125735826790333, + 0.4937281236052513, + 1.5153458584100008, + 1.087233368307352, + 1.2678543217480183, + 2.175298010930419, + 1.8014211431145668, + 1.54862305149436, + 2.6285135075449944, + 1.460612565279007, + 2.384877586737275, + 3.0098239090293646, + 4.420979195274413, + 2.280213125050068, + 1.6477556210011244, + 2.171219414100051 + ], + "unique_experts": 64, + "load_cv": 0.2946832626333397, + "normalized_load_entropy": 0.9894228116482195, + "max_load_share": 0.027874564459930314 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 246, + "ordered_topk_exact_tokens": 198, + "set_exact_tokens": 214, + "mean_set_jaccard": 0.9610917537746807, + "mean_token_weighted_tv": 0.007747465256238129, + "aggregate_load_tv": 0.016937669376693762 + }, + "system_bos": { + "tokens": 246, + "ordered_topk_exact_tokens": 166, + "set_exact_tokens": 190, + "mean_set_jaccard": 0.9332171893147502, + "mean_token_weighted_tv": 0.01461911159453959, + "aggregate_load_tv": 0.02303523035230352 + }, + "system_x": { + "tokens": 246, + "ordered_topk_exact_tokens": 151, + "set_exact_tokens": 182, + "mean_set_jaccard": 0.923054587688734, + "mean_token_weighted_tv": 0.01686060074641089, + "aggregate_load_tv": 0.02777777777777778 + }, + "system_period": { + "tokens": 246, + "ordered_topk_exact_tokens": 159, + "set_exact_tokens": 189, + "mean_set_jaccard": 0.9303135888501741, + "mean_token_weighted_tv": 0.016118389266596093, + "aggregate_load_tv": 0.02439024390243903 + }, + "bos_at_s0": { + "tokens": 246, + "ordered_topk_exact_tokens": 128, + "set_exact_tokens": 155, + "mean_set_jaccard": 0.8899535423925666, + "mean_token_weighted_tv": 0.024059239790085854, + "aggregate_load_tv": 0.037262872628726296 + }, + "bos_at_s1": { + "tokens": 246, + "ordered_topk_exact_tokens": 121, + "set_exact_tokens": 153, + "mean_set_jaccard": 0.886759581881533, + "mean_token_weighted_tv": 0.025141732676363573, + "aggregate_load_tv": 0.034552845528455285 + }, + "x_at_s0": { + "tokens": 246, + "ordered_topk_exact_tokens": 132, + "set_exact_tokens": 162, + "mean_set_jaccard": 0.8998257839721253, + "mean_token_weighted_tv": 0.02129183686906245, + "aggregate_load_tv": 0.034552845528455285 + }, + "x_at_s1": { + "tokens": 246, + "ordered_topk_exact_tokens": 124, + "set_exact_tokens": 156, + "mean_set_jaccard": 0.8911149825783972, + "mean_token_weighted_tv": 0.024230462400530412, + "aggregate_load_tv": 0.03387533875338754 + }, + "period_at_s0": { + "tokens": 246, + "ordered_topk_exact_tokens": 138, + "set_exact_tokens": 169, + "mean_set_jaccard": 0.9055361982191249, + "mean_token_weighted_tv": 0.020512128033016514, + "aggregate_load_tv": 0.030487804878048783 + }, + "period_at_s1": { + "tokens": 246, + "ordered_topk_exact_tokens": 127, + "set_exact_tokens": 157, + "mean_set_jaccard": 0.8922764227642275, + "mean_token_weighted_tv": 0.023926118759786695, + "aggregate_load_tv": 0.034552845528455285 + } + } + }, + "layer_03": { + "layer": 3, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "9191c34d2936e5f0aa506fd943afac2c3f0c7161970532d7033b821bcc6b1e7c", + "route_weight_sha256": "e05ec2da7513ab34193ce3e05853d8fe1f3df8530b6214b1a8b9dd6a550427a4", + "loads": [ + 4, + 34, + 10, + 27, + 13, + 22, + 27, + 7, + 39, + 11, + 21, + 14, + 26, + 16, + 23, + 23, + 32, + 23, + 23, + 25, + 14, + 17, + 16, + 33, + 22, + 30, + 35, + 22, + 27, + 11, + 22, + 20, + 29, + 22, + 26, + 26, + 25, + 7, + 41, + 34, + 27, + 29, + 15, + 29, + 25, + 27, + 26, + 40, + 4, + 24, + 53, + 28, + 12, + 29, + 13, + 30, + 15, + 17, + 8, + 35, + 18, + 27, + 31, + 15 + ], + "weighted_loads": [ + 0.13361394591629505, + 2.57621618360281, + 0.6163119729608297, + 2.0801250096410513, + 0.6143925935029984, + 1.5089748688042164, + 2.42039006203413, + 0.4368407800793648, + 2.785753335803747, + 0.8447353020310402, + 1.7887893188744783, + 0.8914114590734243, + 1.8456304036080837, + 1.029503408819437, + 1.7543554492294788, + 1.3356940243393183, + 3.1728865280747414, + 2.614060526713729, + 1.3388457633554935, + 1.5428862981498241, + 0.7911250814795494, + 1.5340267196297646, + 1.014867890626192, + 2.2600259985774755, + 1.3100855145603418, + 1.4386246334761381, + 2.100263074040413, + 1.7201600894331932, + 1.6844165921211243, + 0.6549082770943642, + 2.006510827690363, + 1.6717779692262411, + 2.9248446132987738, + 1.4846635926514864, + 2.464573258534074, + 2.0213927812874317, + 1.07255532220006, + 0.25559049658477306, + 5.429715555161238, + 3.20223137922585, + 1.5038044583052397, + 1.393171126022935, + 1.284967340528965, + 2.2014515176415443, + 1.8026954531669617, + 2.400657283142209, + 1.4866248313337564, + 3.754507264122367, + 0.25904687121510506, + 1.4314546212553978, + 3.449386866763234, + 2.504998693242669, + 0.878027256578207, + 2.285716939717531, + 1.6551671884953976, + 2.5130077116191387, + 1.736557848751545, + 0.9016904924064875, + 0.3201961722224951, + 2.3225544411689043, + 0.9020858760923147, + 2.850266631692648, + 2.805284969508648, + 0.8803718574345112 + ], + "unique_experts": 64, + "load_cv": 0.41134426453417205, + "normalized_load_entropy": 0.9782705435777336, + "max_load_share": 0.03590785907859079 + }, + "full_input": { + "tokens": 271, + "top_k": 6, + "decisions": 1626, + "ordered_route_sha256": "6facd9e3b63855b60e1db4cc90f085fbc18371e4b83f5f59c3b2873d233a693b", + "route_weight_sha256": "d268107288656d6682b33cb6d92dfc34195d897bc2647d4ac3025c909ad1744b", + "loads": [ + 13, + 34, + 10, + 37, + 15, + 24, + 27, + 15, + 39, + 17, + 22, + 15, + 28, + 21, + 29, + 23, + 32, + 23, + 23, + 25, + 16, + 20, + 20, + 35, + 22, + 32, + 35, + 29, + 27, + 14, + 23, + 20, + 29, + 22, + 35, + 26, + 25, + 7, + 41, + 34, + 27, + 30, + 25, + 29, + 25, + 29, + 39, + 40, + 11, + 34, + 54, + 28, + 13, + 29, + 17, + 32, + 15, + 18, + 8, + 35, + 26, + 27, + 35, + 16 + ], + "weighted_loads": [ + 1.47785528562963, + 2.57621618360281, + 0.6163119729608297, + 2.6712241787463427, + 0.6430829091696069, + 1.5889244377613068, + 2.42039006203413, + 1.8083099462091923, + 2.785753335803747, + 1.1330753638758324, + 1.8244229536503553, + 0.8922916043666191, + 1.85768038770766, + 1.421910461038351, + 2.1440522484481335, + 1.3356940243393183, + 3.1728865280747414, + 2.614060526713729, + 1.3388457633554935, + 1.5428862981498241, + 0.8640184327960014, + 1.7443968206644058, + 1.3353610150516033, + 2.3383800387382507, + 1.3100855145603418, + 1.4523422918864526, + 2.100263074040413, + 1.980884475633502, + 1.6844165921211243, + 0.8005281500518322, + 2.0530881471931934, + 1.6717779692262411, + 2.9248446132987738, + 1.4846635926514864, + 3.4942525159567595, + 2.0213927812874317, + 1.07255532220006, + 0.25559049658477306, + 5.429715555161238, + 3.20223137922585, + 1.5038044583052397, + 1.4045820320025086, + 1.8635128661990166, + 2.2014515176415443, + 1.8026954531669617, + 2.5259724613279104, + 3.3074248302727938, + 3.754507264122367, + 1.0110408924520016, + 2.0470006205141544, + 3.482966547831893, + 2.504998693242669, + 0.8928061611950397, + 2.285716939717531, + 3.486284788697958, + 2.6503060199320316, + 1.736557848751545, + 0.9145278660580516, + 0.3201961722224951, + 2.3225544411689043, + 1.4700499046593904, + 2.850266631692648, + 3.2461075633764267, + 0.9190538786351681 + ], + "unique_experts": 64, + "load_cv": 0.3551797625719398, + "normalized_load_entropy": 0.9843023579540594, + "max_load_share": 0.033210332103321034 + } + }, + "s1_eos": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "dfc15743411869653c94357bf1feb6555b17342de997fd2ee04588b0973be3ad", + "route_weight_sha256": "f81a7b274aea0973de0c67a6eb0e572859edbe8a78bd1f737eb00b46b4ec37ef", + "loads": [ + 4, + 35, + 10, + 28, + 13, + 23, + 27, + 7, + 39, + 11, + 21, + 14, + 26, + 15, + 23, + 23, + 31, + 23, + 23, + 24, + 14, + 17, + 16, + 32, + 21, + 27, + 36, + 21, + 28, + 11, + 23, + 22, + 29, + 22, + 27, + 26, + 26, + 8, + 41, + 32, + 27, + 28, + 15, + 30, + 25, + 27, + 25, + 41, + 4, + 24, + 53, + 28, + 11, + 29, + 13, + 30, + 15, + 17, + 8, + 35, + 18, + 28, + 31, + 15 + ], + "weighted_loads": [ + 0.13199366815388203, + 2.6150927264243364, + 0.621916776522994, + 2.0823910664767027, + 0.5939565915614367, + 1.5191099010407925, + 2.4249273519963026, + 0.43963955342769623, + 2.7872558273375034, + 0.8349672853946686, + 1.7818252891302109, + 0.892688687890768, + 1.8439492676407099, + 0.9734534434974194, + 1.7504407577216625, + 1.3718797471374273, + 3.156876027584076, + 2.620048500597477, + 1.323336260393262, + 1.5318190157413483, + 0.7936050612479448, + 1.5344374366104603, + 1.0112873949110508, + 2.2353603281080723, + 1.288833713158965, + 1.341918122023344, + 2.1343990433961153, + 1.693386498838663, + 1.7495380379259586, + 0.6443693693727255, + 2.0364019069820642, + 1.744157960638404, + 2.948307815939188, + 1.4763192646205425, + 2.4912735745310783, + 2.010843016207218, + 1.0897835213690996, + 0.297829894348979, + 5.494762018322945, + 3.1310859620571136, + 1.5103598665446043, + 1.3697068616747856, + 1.31496537104249, + 2.2237398996949196, + 1.7994070313870907, + 2.423061653971672, + 1.437467074021697, + 3.8107441551983356, + 0.24769633635878563, + 1.4151459857821465, + 3.4487186651676893, + 2.516904480755329, + 0.8442273363471031, + 2.286589428782463, + 1.6641655396670103, + 2.516878232359886, + 1.746605720371008, + 0.8992748036980629, + 0.32433249428868294, + 2.3373212087899446, + 0.9027496427297592, + 2.885421898216009, + 2.788003697991371, + 0.8833589404821396 + ], + "unique_experts": 64, + "load_cv": 0.4117011948495256, + "normalized_load_entropy": 0.9782859259395871, + "max_load_share": 0.03590785907859079 + }, + "full_input": { + "tokens": 287, + "top_k": 6, + "decisions": 1722, + "ordered_route_sha256": "8911f0355bbe974058a8711a038355533d4c2f7c769fbdc05ab6bba70cbb9678", + "route_weight_sha256": "e04e078d32d04bc54a79f68da68ac139b9bbf9bd507303f1a9ac462bd39313dd", + "loads": [ + 17, + 37, + 10, + 39, + 14, + 27, + 27, + 18, + 39, + 20, + 26, + 15, + 30, + 21, + 31, + 24, + 33, + 23, + 24, + 24, + 16, + 23, + 25, + 33, + 23, + 30, + 36, + 23, + 28, + 14, + 24, + 22, + 29, + 24, + 35, + 26, + 26, + 13, + 41, + 33, + 28, + 29, + 30, + 32, + 25, + 32, + 42, + 41, + 13, + 34, + 54, + 34, + 15, + 34, + 18, + 36, + 15, + 18, + 15, + 36, + 31, + 29, + 37, + 21 + ], + "weighted_loads": [ + 1.8698913771659136, + 2.6889394111931324, + 0.621916776522994, + 2.7401070948690176, + 0.5944972726283595, + 1.7019267864525318, + 2.4249273519963026, + 1.8981839790940285, + 2.7872558273375034, + 1.3069240748300217, + 1.9246788322925568, + 0.8935688331839629, + 1.9330082274100278, + 1.4254244156181812, + 2.3210850059986115, + 1.4210830833762884, + 3.3688668459653854, + 2.620048500597477, + 1.3792723286896944, + 1.5318190157413483, + 0.8600017074495554, + 1.8336575627326965, + 1.8312139436602592, + 2.2857386209070683, + 1.3921648170799017, + 1.3993123300024308, + 2.1343990433961153, + 1.7601573672145605, + 1.7495380379259586, + 0.7817563433200121, + 2.0778126176446676, + 1.744157960638404, + 2.948307815939188, + 1.549231555312872, + 3.412420831620693, + 2.010843016207218, + 1.0897835213690996, + 0.7146964259445667, + 5.494762018322945, + 3.1817112527787685, + 1.5858839359134436, + 1.3785514812916517, + 2.0181597266346216, + 2.2976413294672966, + 1.7994070313870907, + 2.791252586990595, + 3.849944205954671, + 3.8107441551983356, + 1.307473011314869, + 1.8805856071412563, + 3.4819630440324545, + 3.2944225668907166, + 1.0570316649973392, + 3.0019764080643654, + 3.606020590290427, + 2.8848473485559225, + 1.746605720371008, + 0.908339336514473, + 0.8098800294101238, + 2.36768863722682, + 1.733998540788889, + 2.935769870877266, + 3.2581029757857323, + 1.293741635978222 + ], + "unique_experts": 64, + "load_cv": 0.32332083360226727, + "normalized_load_entropy": 0.9872274102479456, + "max_load_share": 0.0313588850174216 + } + }, + "s0_bos": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "e46fc6f48436cb74619e1b3d4989af9d5c7ec1c83127ea04deaac6c402883ab1", + "route_weight_sha256": "2415b755635b798a37a09bb5c0037d016a1c5089b70e9eda687ecc60235c03dd", + "loads": [ + 3, + 34, + 9, + 29, + 12, + 24, + 27, + 7, + 38, + 10, + 20, + 18, + 27, + 16, + 24, + 21, + 34, + 23, + 27, + 25, + 15, + 16, + 16, + 32, + 22, + 28, + 35, + 22, + 27, + 12, + 22, + 20, + 28, + 22, + 24, + 27, + 26, + 8, + 41, + 32, + 24, + 30, + 15, + 28, + 25, + 28, + 25, + 40, + 4, + 22, + 53, + 29, + 11, + 29, + 12, + 32, + 15, + 14, + 8, + 39, + 17, + 27, + 31, + 15 + ], + "weighted_loads": [ + 0.08910678513348103, + 2.6087608467787504, + 0.5701971519738436, + 2.154157657176256, + 0.5788400005549192, + 1.5893290638923645, + 2.4582226406782866, + 0.40214047208428383, + 2.80548133328557, + 0.7765622679144144, + 1.7446219883859158, + 1.0646563600748777, + 1.8915983065962791, + 1.0188221577554941, + 1.7188097219914198, + 1.1893001031130552, + 3.3377783335745335, + 2.5822842679917812, + 1.4663607105612755, + 1.5664314404129982, + 0.8137441333383322, + 1.5002354942262173, + 0.9741445928812027, + 2.312429314479232, + 1.3140602577477694, + 1.4153991229832172, + 2.0377834644168615, + 1.6755306739360094, + 1.7426755148917437, + 0.673340467736125, + 1.9899005331099033, + 1.6807315647602081, + 2.9639620892703533, + 1.4912937339395285, + 2.2748649083077908, + 2.051334973424673, + 1.074949124827981, + 0.29582115449011326, + 5.4925939701497555, + 3.123808018863201, + 1.3966560810804367, + 1.4347170107066631, + 1.2350105736404657, + 2.1761918626725674, + 1.7974337674677372, + 2.632125101983547, + 1.462847774848342, + 3.708428440615535, + 0.24464290961623192, + 1.3606616370379925, + 3.6098159048706293, + 2.505846945568919, + 0.8747899606823921, + 2.279047667980194, + 1.6710126511752605, + 2.6890879571437836, + 1.7540975343436003, + 0.7771430276334286, + 0.337092574685812, + 2.583204949274659, + 0.8323755264282227, + 2.770435471087694, + 2.8522987738251686, + 0.9136344660073519 + ], + "unique_experts": 64, + "load_cv": 0.4189863163315844, + "normalized_load_entropy": 0.9773472216494359, + "max_load_share": 0.03590785907859079 + }, + "full_input": { + "tokens": 271, + "top_k": 6, + "decisions": 1626, + "ordered_route_sha256": "78e1898c398caea5ff93bb15d3230c78c193131a3c709fd25db403a64fed076f", + "route_weight_sha256": "51a3783934fa8916dbd12ad70c2f1e25843d675c203f7bb12c1e1e3ffef2f994", + "loads": [ + 13, + 34, + 9, + 39, + 14, + 27, + 27, + 15, + 38, + 15, + 22, + 19, + 28, + 20, + 30, + 21, + 34, + 23, + 28, + 25, + 17, + 19, + 21, + 34, + 22, + 29, + 35, + 29, + 27, + 16, + 23, + 20, + 28, + 22, + 32, + 27, + 26, + 8, + 41, + 32, + 24, + 30, + 25, + 28, + 25, + 30, + 38, + 40, + 13, + 32, + 54, + 29, + 11, + 29, + 15, + 34, + 15, + 14, + 8, + 39, + 25, + 27, + 35, + 17 + ], + "weighted_loads": [ + 1.5491406042128801, + 2.6087608467787504, + 0.5701971519738436, + 2.7452568262815475, + 0.6075303162215278, + 1.7281527034938335, + 2.4582226406782866, + 1.5952333770692348, + 2.80548133328557, + 1.0477339829667471, + 1.8127777054905891, + 1.0655365053680725, + 1.8920770053809974, + 1.3829942215234041, + 2.133307782933116, + 1.1893001031130552, + 3.3377783335745335, + 2.5822842679917812, + 1.5033745355904102, + 1.5664314404129982, + 0.8856594953685999, + 1.7309675365686417, + 1.3340910635888577, + 2.3919874504208565, + 1.3140602577477694, + 1.4159297259175219, + 2.0377834644168615, + 1.9362550601363182, + 1.7426755148917437, + 0.8601418416947126, + 2.036477852612734, + 1.6807315647602081, + 2.9639620892703533, + 1.4912937339395285, + 3.267952259629965, + 2.051334973424673, + 1.074949124827981, + 0.29582115449011326, + 5.4925939701497555, + 3.123808018863201, + 1.3966560810804367, + 1.4347170107066631, + 1.9019801747053862, + 2.1761918626725674, + 1.7974337674677372, + 2.7669347301125526, + 3.482520801946521, + 3.708428440615535, + 1.1289403326809406, + 1.9762076362967491, + 3.6435823496431112, + 2.505846945568919, + 0.8747899606823921, + 2.279047667980194, + 2.8017506934702396, + 2.8450413271784782, + 1.7540975343436003, + 0.7771430276334286, + 0.337092574685812, + 2.583204949274659, + 1.3421516418457031, + 2.770435471087694, + 3.294244922697544, + 0.9857125785201788 + ], + "unique_experts": 64, + "load_cv": 0.3570829725039185, + "normalized_load_entropy": 0.9841419379188808, + "max_load_share": 0.033210332103321034 + } + }, + "s1_bos": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "1093c8681f49a30f85a50c40be95cf08fe677df2187bd86f2730957d62f43cac", + "route_weight_sha256": "d98f77933e13d3ac1e13dc9d9619dfe252fbcaa19ed4aef32591a99574390c05", + "loads": [ + 1, + 35, + 10, + 28, + 14, + 23, + 27, + 7, + 39, + 10, + 19, + 19, + 26, + 16, + 21, + 22, + 34, + 23, + 24, + 25, + 14, + 16, + 15, + 34, + 21, + 29, + 35, + 23, + 28, + 12, + 22, + 24, + 30, + 22, + 23, + 26, + 25, + 7, + 41, + 33, + 25, + 33, + 14, + 28, + 24, + 27, + 27, + 40, + 4, + 20, + 53, + 31, + 11, + 27, + 12, + 32, + 15, + 15, + 6, + 41, + 18, + 27, + 29, + 14 + ], + "weighted_loads": [ + 0.034903984516859055, + 2.610682602971792, + 0.617643054574728, + 2.076756726950407, + 0.6355448868125677, + 1.4860182628035545, + 2.4533333722501993, + 0.4142506346106529, + 2.825259517878294, + 0.764876676723361, + 1.703686349093914, + 1.109091356396675, + 1.8628365714102983, + 1.0420183930546045, + 1.6447215974330902, + 1.2906685806810856, + 3.3657669946551323, + 2.5894428603351116, + 1.3515513315796852, + 1.5463084150105715, + 0.7631837986409664, + 1.4769950285553932, + 0.9085946697741747, + 2.4014233723282814, + 1.251001913100481, + 1.4592587612569332, + 2.0407110266387463, + 1.6830843277275562, + 1.7794637978076935, + 0.6478692013770342, + 1.9849063009023666, + 1.815289419144392, + 3.071350112557411, + 1.4979078266769648, + 2.245908912271261, + 2.025434657931328, + 1.0658205095678568, + 0.24551061540842056, + 5.423975724726915, + 3.1701392140239477, + 1.4459782987833023, + 1.5475406125187874, + 1.246251419186592, + 2.1212110463529825, + 1.7281220871955156, + 2.56356418132782, + 1.500751992687583, + 3.7714242450892925, + 0.23954518511891365, + 1.2460661958903074, + 3.4583795852959156, + 2.595715869218111, + 0.8720286525785923, + 2.2506003864109516, + 1.6611568927764893, + 2.633636996150017, + 1.7401299495249987, + 0.8106519989669323, + 0.2921309061348438, + 2.646532818675041, + 0.8639145120978355, + 2.7897672951221466, + 2.6538522001355886, + 0.8962091691792011 + ], + "unique_experts": 64, + "load_cv": 0.431490443418434, + "normalized_load_entropy": 0.9755378406441232, + "max_load_share": 0.03590785907859079 + }, + "full_input": { + "tokens": 287, + "top_k": 6, + "decisions": 1722, + "ordered_route_sha256": "019024f20768ef8eface16ea1834f649640605e2538732c03565904cec19661e", + "route_weight_sha256": "517c696126b98b965a6897eae17820725eb7f0a89e3dd3ac84cb1f823d6da3c8", + "loads": [ + 14, + 37, + 10, + 39, + 16, + 27, + 27, + 18, + 39, + 19, + 24, + 20, + 29, + 22, + 29, + 23, + 36, + 23, + 26, + 25, + 16, + 22, + 25, + 35, + 23, + 31, + 35, + 25, + 28, + 15, + 23, + 24, + 30, + 24, + 31, + 26, + 25, + 12, + 41, + 34, + 26, + 33, + 30, + 30, + 24, + 32, + 45, + 40, + 14, + 30, + 53, + 37, + 14, + 32, + 16, + 38, + 15, + 15, + 13, + 42, + 31, + 28, + 35, + 21 + ], + "weighted_loads": [ + 1.7957269959151745, + 2.684529287740588, + 0.617643054574728, + 2.734472755342722, + 0.6700146103976294, + 1.6837660744786263, + 2.4533333722501993, + 1.7491924986243248, + 2.825259517878294, + 1.2489509712322615, + 1.84653989225626, + 1.10997150168987, + 1.9439569794631097, + 1.5213721711188555, + 2.239632222801447, + 1.3398719169199467, + 3.577757813036442, + 2.5894428603351116, + 1.4439506642520428, + 1.5463084150105715, + 0.8340335041284561, + 1.7880327440798283, + 1.7352438550442457, + 2.452173449099064, + 1.3543330170214176, + 1.5078169280313887, + 2.0407110266387463, + 1.7498551961034536, + 1.7794637978076935, + 0.787767531350255, + 2.02631701156497, + 1.815289419144392, + 3.071350112557411, + 1.5708201173692942, + 3.1750882528722286, + 2.025434657931328, + 1.0658205095678568, + 0.6623771470040083, + 5.423975724726915, + 3.2207645047456026, + 1.5215023681521416, + 1.5475406125187874, + 2.096837529912591, + 2.1951124761253595, + 1.7281220871955156, + 2.962195072323084, + 3.9322475735098124, + 3.7714242450892925, + 1.3632419258356094, + 1.7115058172494173, + 3.4583795852959156, + 3.3732339553534985, + 1.0744303539395332, + 2.965987365692854, + 2.8132017999887466, + 3.009333511814475, + 1.7401299495249987, + 0.8106519989669323, + 0.7776784412562847, + 2.6769002471119165, + 1.6335897892713547, + 2.8401152677834034, + 3.153852989897132, + 1.3385254815220833 + ], + "unique_experts": 64, + "load_cv": 0.3321454957307531, + "normalized_load_entropy": 0.9865331106630753, + "max_load_share": 0.03077816492450639 + } + }, + "s0_x": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "254e71c332441bc9fd312a7bf214d69be1ac0507df61e4ac2a37e461518fa267", + "route_weight_sha256": "d1b8af87665113c4e29dae3d7916c3cce3df13b6fb0f4ae826753af8635c2bdf", + "loads": [ + 3, + 35, + 10, + 28, + 12, + 22, + 27, + 7, + 39, + 12, + 19, + 18, + 26, + 16, + 21, + 21, + 34, + 22, + 27, + 25, + 15, + 16, + 16, + 32, + 22, + 29, + 34, + 25, + 28, + 13, + 22, + 22, + 29, + 22, + 24, + 26, + 26, + 8, + 41, + 33, + 25, + 33, + 14, + 29, + 25, + 28, + 25, + 40, + 4, + 24, + 52, + 29, + 12, + 28, + 12, + 31, + 15, + 14, + 6, + 37, + 14, + 27, + 30, + 15 + ], + "weighted_loads": [ + 0.09417601116001606, + 2.627424892038107, + 0.6163554601371288, + 2.129867212846875, + 0.5861744824796915, + 1.456961713731289, + 2.4247837718576193, + 0.41933999210596085, + 2.8680069148540497, + 0.8444317802786827, + 1.7204439770430326, + 1.0547702629119158, + 1.8821771740913391, + 1.0085438843816519, + 1.6421107463538647, + 1.24022052064538, + 3.3878991715610027, + 2.540578130632639, + 1.4907804410904646, + 1.5604443959891796, + 0.8256353158503771, + 1.512786015868187, + 1.0068423599004745, + 2.279463592916727, + 1.2998674772679806, + 1.449371786788106, + 1.996332447975874, + 1.774670884013176, + 1.7759189866483212, + 0.7154273223131895, + 2.008935369551182, + 1.7319281026721, + 3.006234208121896, + 1.4886639267206192, + 2.236236248165369, + 2.016320025548339, + 1.0757124535739422, + 0.2965806405991316, + 5.4524028189480305, + 3.1718007531017065, + 1.455783599987626, + 1.5205600447952747, + 1.1927638910710812, + 2.196403669193387, + 1.824862264096737, + 2.5884954519569874, + 1.4168654773384333, + 3.7269486282020807, + 0.24337581172585487, + 1.4372046142816544, + 3.511584848165512, + 2.5163233634084463, + 0.9044766947627068, + 2.234538048505783, + 1.6900226771831512, + 2.6501435190439224, + 1.739017652347684, + 0.77748579159379, + 0.27938881143927574, + 2.490134060382843, + 0.6883524805307388, + 2.773397734388709, + 2.8062000274658203, + 0.8945208601653576 + ], + "unique_experts": 64, + "load_cv": 0.41800356173372466, + "normalized_load_entropy": 0.9773381800166979, + "max_load_share": 0.03523035230352303 + }, + "full_input": { + "tokens": 271, + "top_k": 6, + "decisions": 1626, + "ordered_route_sha256": "3a653182ccc95fafee612c5fe0c17d5bf5c98e768ee115253b9ed4dadc7a3ea6", + "route_weight_sha256": "b8c107bc5cc64bf290d758e73234ebaa29ef8d19bb0a182d2135bd00be099b7e", + "loads": [ + 11, + 35, + 10, + 39, + 15, + 24, + 27, + 16, + 39, + 17, + 20, + 19, + 27, + 20, + 27, + 21, + 34, + 22, + 27, + 25, + 16, + 19, + 20, + 34, + 22, + 30, + 35, + 33, + 28, + 17, + 23, + 22, + 29, + 22, + 33, + 26, + 27, + 8, + 41, + 33, + 25, + 33, + 24, + 29, + 25, + 30, + 38, + 40, + 11, + 35, + 53, + 29, + 12, + 28, + 15, + 33, + 15, + 14, + 6, + 37, + 23, + 27, + 34, + 17 + ], + "weighted_loads": [ + 1.253421088680625, + 2.627424892038107, + 0.6163554601371288, + 2.8546059858053923, + 0.6458856890676543, + 1.5487566217780113, + 2.4247837718576193, + 1.6419590972363949, + 2.8680069148540497, + 1.1373757086112164, + 1.7560776118189096, + 1.0556504082051106, + 1.8826558728760574, + 1.3705592509359121, + 2.0194993168115616, + 1.24022052064538, + 3.3878991715610027, + 2.540578130632639, + 1.4907804410904646, + 1.5604443959891796, + 0.8524203170090914, + 1.7444980517029762, + 1.3126087598502636, + 2.3597265649586916, + 1.2998674772679806, + 1.4499023897224106, + 2.038566417992115, + 2.0828810911625624, + 1.7759189866483212, + 0.9122682567685843, + 2.0555126890540123, + 1.7319281026721, + 3.006234208121896, + 1.4886639267206192, + 3.3301037289202213, + 2.016320025548339, + 1.1243687123060226, + 0.2965806405991316, + 5.4524028189480305, + 3.1718007531017065, + 1.455783599987626, + 1.5205600447952747, + 1.8171556517481804, + 2.196403669193387, + 1.824862264096737, + 2.7293381467461586, + 3.448090510442853, + 3.7269486282020807, + 0.9802180640399456, + 2.1156754456460476, + 3.5447858273983, + 2.5163233634084463, + 0.9044766947627068, + 2.234538048505783, + 2.799273107200861, + 2.8102853298187256, + 1.739017652347684, + 0.77748579159379, + 0.27938881143927574, + 2.490134060382843, + 1.2942344583570957, + 2.773397734388709, + 3.249759428203106, + 0.9665152840316296 + ], + "unique_experts": 64, + "load_cv": 0.36099341796205175, + "normalized_load_entropy": 0.9836299729418134, + "max_load_share": 0.032595325953259535 + } + }, + "s1_x": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "fbff46864726527b9e48fab10afe22824bd718df9c5e4d51368b81b814886679", + "route_weight_sha256": "4e4a56c12de8ce5a718acf03130273f32e1293ebbd3b730664036b171aa7ce34", + "loads": [ + 1, + 35, + 11, + 27, + 14, + 21, + 27, + 7, + 38, + 12, + 19, + 19, + 25, + 15, + 22, + 23, + 35, + 22, + 24, + 25, + 15, + 17, + 14, + 32, + 21, + 29, + 35, + 22, + 28, + 13, + 22, + 24, + 30, + 22, + 24, + 27, + 23, + 8, + 41, + 33, + 24, + 37, + 15, + 28, + 24, + 27, + 26, + 41, + 4, + 20, + 53, + 30, + 11, + 27, + 12, + 31, + 15, + 15, + 6, + 39, + 16, + 28, + 29, + 16 + ], + "weighted_loads": [ + 0.03588312491774559, + 2.6218886859714985, + 0.642892375588417, + 2.038662102073431, + 0.6287713907659054, + 1.396355364471674, + 2.4476019255816936, + 0.43751028180122375, + 2.8054930362850428, + 0.8396182376891375, + 1.7159903887659311, + 1.1049126591533422, + 1.8407715931534767, + 1.0026564933359623, + 1.6971002854406834, + 1.3329069688916206, + 3.4347458630800247, + 2.552466655150056, + 1.3628708496689796, + 1.5496235713362694, + 0.8121439125388861, + 1.5172034427523613, + 0.8861245363950729, + 2.3098783269524574, + 1.2525755539536476, + 1.4590302128344774, + 2.0422462839633226, + 1.625865826383233, + 1.7974615972489119, + 0.6772933267056942, + 1.9852497577667236, + 1.8189844973385334, + 3.0655269995331764, + 1.5149142760783434, + 2.238110225647688, + 2.069619730114937, + 1.0086452085524797, + 0.289810199290514, + 5.435009069740772, + 3.1857934966683388, + 1.4120730347931385, + 1.6438441909849644, + 1.28319675847888, + 2.1138109397143126, + 1.737689157947898, + 2.55703460611403, + 1.5323296505957842, + 3.8215586468577385, + 0.238319993019104, + 1.2264356780797243, + 3.432674052193761, + 2.5737553406506777, + 0.8750209510326385, + 2.2669463492929935, + 1.6841137036681175, + 2.5976072400808334, + 1.7535230182111263, + 0.7986635901033878, + 0.2962036281824112, + 2.549463212490082, + 0.7907363288104534, + 2.8398784659802914, + 2.6264502219855785, + 0.9641480389982462 + ], + "unique_experts": 64, + "load_cv": 0.4255260355489795, + "normalized_load_entropy": 0.9763719688582448, + "max_load_share": 0.03590785907859079 + }, + "full_input": { + "tokens": 287, + "top_k": 6, + "decisions": 1722, + "ordered_route_sha256": "6414c0105fcc79e6e844aebdec6e0cf66bcccdd8fbc588077870b958536ebb68", + "route_weight_sha256": "b5b910f16b9482e93df33322d91d8236c8286a40562933b9b8649be8ee9a6845", + "loads": [ + 13, + 37, + 11, + 39, + 16, + 26, + 27, + 18, + 38, + 21, + 24, + 20, + 28, + 21, + 30, + 24, + 37, + 22, + 25, + 25, + 16, + 22, + 23, + 33, + 23, + 31, + 36, + 25, + 28, + 17, + 23, + 24, + 30, + 24, + 32, + 27, + 24, + 13, + 41, + 34, + 25, + 37, + 31, + 30, + 24, + 32, + 43, + 41, + 13, + 31, + 54, + 36, + 14, + 32, + 16, + 37, + 15, + 15, + 13, + 40, + 29, + 29, + 35, + 22 + ], + "weighted_loads": [ + 1.549202062189579, + 2.6957353707402945, + 0.642892375588417, + 2.8442611433565617, + 0.6602915002731606, + 1.6116046477109194, + 2.4476019255816936, + 1.7630645111203194, + 2.8054930362850428, + 1.3420197870000266, + 1.858843931928277, + 1.105792804446537, + 1.9218920012062881, + 1.469276785850525, + 2.2664046362042427, + 1.3821103051304817, + 3.6467366814613342, + 2.552466655150056, + 1.4188069179654121, + 1.5496235713362694, + 0.8445068392902613, + 1.7782720401883125, + 1.6885168850421906, + 2.3620444051921368, + 1.3559066578745842, + 1.5075883796089329, + 2.081368340179324, + 1.737903755158186, + 1.7974615972489119, + 0.862039215862751, + 2.026660468429327, + 1.8189844973385334, + 3.0655269995331764, + 1.5878265667706728, + 3.211742889136076, + 2.069619730114937, + 1.0488314609974623, + 0.7066767308861017, + 5.435009069740772, + 3.2364187873899937, + 1.4875971041619778, + 1.6438441909849644, + 2.0459960158914328, + 2.1877123694866896, + 1.737689157947898, + 2.9668262507766485, + 3.94275931827724, + 3.8215586468577385, + 1.2573275938630104, + 1.7514148484915495, + 3.464804233983159, + 3.351273426786065, + 1.0774226523935795, + 2.982333328574896, + 2.8167994767427444, + 2.9762499015778303, + 1.7535230182111263, + 0.7986635901033878, + 0.7817511633038521, + 2.579830640926957, + 1.6194899789988995, + 2.890226438641548, + 3.111928377300501, + 1.3745307344943285 + ], + "unique_experts": 64, + "load_cv": 0.32973243920002426, + "normalized_load_entropy": 0.9867798532170035, + "max_load_share": 0.0313588850174216 + } + }, + "s0_period": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "c684ef46caf4e96ae7d17a9ae19d0b0fd002ea7e2eb00666f49a12f5d00e1f33", + "route_weight_sha256": "389ad81e8c538fe4a0cf94496e43919d3474a3da8c2458dbd8cbed9e057e2406", + "loads": [ + 3, + 35, + 10, + 28, + 12, + 22, + 28, + 7, + 41, + 12, + 20, + 18, + 26, + 16, + 21, + 19, + 34, + 22, + 27, + 25, + 15, + 16, + 15, + 32, + 22, + 29, + 34, + 25, + 27, + 13, + 22, + 22, + 29, + 22, + 23, + 26, + 26, + 8, + 41, + 33, + 25, + 33, + 14, + 29, + 25, + 28, + 27, + 40, + 4, + 24, + 52, + 29, + 12, + 28, + 12, + 31, + 15, + 14, + 5, + 37, + 15, + 27, + 29, + 15 + ], + "weighted_loads": [ + 0.09400289133191109, + 2.6119205374270678, + 0.6085591856390238, + 2.1079197116196156, + 0.5880697034299374, + 1.4776259623467922, + 2.447345921769738, + 0.4232848733663559, + 2.9013712406158447, + 0.8444664180278778, + 1.753159236162901, + 1.0517812483012676, + 1.8773753494024277, + 1.00786361284554, + 1.635671466588974, + 1.1667001955211163, + 3.3711500465869904, + 2.5487840734422207, + 1.4875431433320045, + 1.5539087764918804, + 0.8237448278814554, + 1.508657582104206, + 0.940776776522398, + 2.2672925386577845, + 1.3152019642293453, + 1.4457696322351694, + 2.000654758885503, + 1.764756090939045, + 1.744105253368616, + 0.7122463118284941, + 2.005962621420622, + 1.7344498950988054, + 3.0097555741667747, + 1.4845304116606712, + 2.209720406681299, + 2.035630129277706, + 1.0786221753805876, + 0.29492418095469475, + 5.464158210903406, + 3.166147354990244, + 1.4533199723809958, + 1.5210344642400742, + 1.2199397552758455, + 2.23012213781476, + 1.819193996489048, + 2.5781209003180265, + 1.5128725469112396, + 3.731059692800045, + 0.24641899019479752, + 1.4275194369256496, + 3.5016766972839832, + 2.5081080961972475, + 0.8992135412991047, + 2.2358744144439697, + 1.6803414970636368, + 2.630664650350809, + 1.737707307562232, + 0.7764137145131826, + 0.2528420574963093, + 2.4857700802385807, + 0.7156215570867062, + 2.800835682079196, + 2.7420879304409027, + 0.8987046144902706 + ], + "unique_experts": 64, + "load_cv": 0.4216422468466701, + "normalized_load_entropy": 0.9769208844115536, + "max_load_share": 0.03523035230352303 + }, + "full_input": { + "tokens": 271, + "top_k": 6, + "decisions": 1626, + "ordered_route_sha256": "c83a15a40df30301ef288805e67f2f0f450726ae6d36b4c304592aa737b5619a", + "route_weight_sha256": "fd06d99340fc44f8a4e884bff987907486e26727bedf1d334c69f2cd6a745fb1", + "loads": [ + 11, + 36, + 10, + 39, + 15, + 24, + 28, + 16, + 41, + 18, + 21, + 19, + 27, + 20, + 27, + 19, + 34, + 22, + 27, + 25, + 16, + 19, + 20, + 34, + 22, + 30, + 34, + 32, + 27, + 17, + 23, + 22, + 29, + 22, + 31, + 26, + 26, + 8, + 41, + 33, + 25, + 33, + 24, + 29, + 25, + 31, + 40, + 40, + 11, + 34, + 53, + 29, + 12, + 28, + 15, + 33, + 15, + 14, + 6, + 37, + 24, + 27, + 33, + 17 + ], + "weighted_loads": [ + 1.182358305901289, + 2.7580678034573793, + 0.6085591856390238, + 2.767895206809044, + 0.6566246746806428, + 1.572497148066759, + 2.447345921769738, + 1.7023903653025627, + 2.9013712406158447, + 1.2960145137622021, + 1.788792870938778, + 1.0526613935944624, + 1.877854048187146, + 1.368900941684842, + 2.138201281428337, + 1.1667001955211163, + 3.3711500465869904, + 2.5487840734422207, + 1.4875431433320045, + 1.5539087764918804, + 0.8505298290401697, + 1.7387480661273003, + 1.3036267459392548, + 2.3476460576057434, + 1.3152019642293453, + 1.446300235169474, + 2.000654758885503, + 2.0254804771393538, + 1.744105253368616, + 0.901011249050498, + 2.0525399409234524, + 1.7344498950988054, + 3.0097555741667747, + 1.4845304116606712, + 3.2028077580034733, + 2.035630129277706, + 1.0786221753805876, + 0.29492418095469475, + 5.464158210903406, + 3.166147354990244, + 1.4533199723809958, + 1.5210344642400742, + 1.8473044913262129, + 2.23012213781476, + 1.819193996489048, + 2.771190056577325, + 3.5114238932728767, + 3.731059692800045, + 0.9752106554806232, + 2.0430654361844063, + 3.5351745299994946, + 2.5081080961972475, + 0.8992135412991047, + 2.2358744144439697, + 2.784700632095337, + 2.7877016700804234, + 1.737707307562232, + 0.7764137145131826, + 0.29224712029099464, + 2.4857700802385807, + 1.2783173471689224, + 2.800835682079196, + 3.20310727506876, + 0.9704581499099731 + ], + "unique_experts": 64, + "load_cv": 0.36233206203334406, + "normalized_load_entropy": 0.98356231417038, + "max_load_share": 0.032595325953259535 + } + }, + "s1_period": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "3c3e760fa950cc0ceef70120f18812c01b5deaf8488270bdc52cd3a30534c0c2", + "route_weight_sha256": "d4665dcc6154725731d20a2eeb07cdfc8d266565692ac2b4a02c30ec87a01526", + "loads": [ + 1, + 35, + 12, + 28, + 14, + 21, + 27, + 7, + 38, + 12, + 19, + 19, + 25, + 14, + 23, + 23, + 35, + 22, + 24, + 25, + 15, + 17, + 14, + 31, + 21, + 29, + 35, + 21, + 28, + 12, + 22, + 24, + 30, + 22, + 24, + 25, + 25, + 8, + 41, + 33, + 25, + 36, + 15, + 28, + 24, + 29, + 26, + 41, + 4, + 20, + 52, + 31, + 11, + 27, + 12, + 31, + 15, + 14, + 6, + 39, + 16, + 28, + 29, + 16 + ], + "weighted_loads": [ + 0.035839613527059555, + 2.609072143211961, + 0.6775984596461058, + 2.0754685029387474, + 0.6298498809337616, + 1.4181533008813858, + 2.4472667910158634, + 0.4414972513914108, + 2.798670630902052, + 0.8403297513723373, + 1.7116657197475433, + 1.1067578215152025, + 1.8424168359488249, + 0.9751960132271051, + 1.7212893590331078, + 1.331078365445137, + 3.440814469009638, + 2.54950282163918, + 1.3636189419776201, + 1.5475532989948988, + 0.8146965242922306, + 1.5152496919035912, + 0.8772426173090935, + 2.283041561022401, + 1.250633716583252, + 1.4579524360597134, + 2.042414393275976, + 1.5912419091910124, + 1.8038282878696918, + 0.6437376420944929, + 1.984640322625637, + 1.8174813352525234, + 3.070217166095972, + 1.5106449741870165, + 2.2384139262139797, + 2.0063443183898926, + 1.0663713719695807, + 0.28990523517131805, + 5.44783279299736, + 3.191515089944005, + 1.4568135347217321, + 1.6220230367034674, + 1.3140024095773697, + 2.1162335220724344, + 1.7369707059115171, + 2.6107578445225954, + 1.534179424867034, + 3.82671251706779, + 0.23959708958864212, + 1.2274324875324965, + 3.401459775865078, + 2.60701260343194, + 0.8723526187241077, + 2.2683623023331165, + 1.6794907078146935, + 2.586287785321474, + 1.758401120081544, + 0.7676998898386955, + 0.2984085790812969, + 2.5603615902364254, + 0.7866006307303905, + 2.838394768536091, + 2.6155747696757317, + 0.96584053337574 + ], + "unique_experts": 64, + "load_cv": 0.42448921930235983, + "normalized_load_entropy": 0.9763653966075819, + "max_load_share": 0.03523035230352303 + }, + "full_input": { + "tokens": 287, + "top_k": 6, + "decisions": 1722, + "ordered_route_sha256": "716e91123b59aa66ad52836913e3b9bafffbda5ae31ca8fe647394835f037fa5", + "route_weight_sha256": "4c1cc3df11b06664692f1a3085af196f90695f74f370272014b441c18974555a", + "loads": [ + 12, + 38, + 12, + 40, + 16, + 26, + 27, + 19, + 38, + 22, + 24, + 20, + 28, + 20, + 31, + 24, + 37, + 22, + 25, + 25, + 16, + 22, + 24, + 32, + 23, + 31, + 35, + 23, + 28, + 16, + 23, + 24, + 30, + 24, + 31, + 25, + 25, + 13, + 41, + 34, + 26, + 36, + 32, + 30, + 24, + 35, + 43, + 41, + 12, + 30, + 53, + 37, + 14, + 32, + 16, + 37, + 15, + 14, + 14, + 40, + 29, + 29, + 35, + 22 + ], + "weighted_loads": [ + 1.4481872990727425, + 2.7917588837444782, + 0.6775984596461058, + 2.7917862869799137, + 0.6673137730685994, + 1.6355420742183924, + 2.4472667910158634, + 1.8483950942754745, + 2.798670630902052, + 1.4680658690049313, + 1.8545192629098892, + 1.1076379668083973, + 1.9235372440016363, + 1.4354236144572496, + 2.370762426406145, + 1.380281701683998, + 3.6528052873909473, + 2.54950282163918, + 1.4195550102740526, + 1.5475532989948988, + 0.8470594510436058, + 1.774795763194561, + 1.7524808049201965, + 2.3352085780352354, + 1.3539648205041885, + 1.5065106028341688, + 2.042414393275976, + 1.6580127775669098, + 1.8038282878696918, + 0.8222705889493227, + 2.0260510332882404, + 1.8174813352525234, + 3.070217166095972, + 1.583557264879346, + 3.1202246360480785, + 2.0063443183898926, + 1.0663713719695807, + 0.7067717667669058, + 5.44783279299736, + 3.24214038066566, + 1.5323376040905714, + 1.6220230367034674, + 2.1672999802976847, + 2.1901349518448114, + 1.7369707059115171, + 3.082439372316003, + 3.950437130406499, + 3.82671251706779, + 1.2122670151293278, + 1.6928721088916063, + 3.4342000111937523, + 3.3845306895673275, + 1.0747543200850487, + 2.983749281615019, + 2.8034302853047848, + 2.9609469641000032, + 1.758401120081544, + 0.7676998898386955, + 0.832426380366087, + 2.5907290186733007, + 1.5721035078167915, + 2.8887427411973476, + 3.1101178377866745, + 1.3762232288718224 + ], + "unique_experts": 64, + "load_cv": 0.3309085565600087, + "normalized_load_entropy": 0.9866390378083382, + "max_load_share": 0.03077816492450639 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 246, + "ordered_topk_exact_tokens": 209, + "set_exact_tokens": 224, + "mean_set_jaccard": 0.9744483159117305, + "mean_token_weighted_tv": 0.006278113655109958, + "aggregate_load_tv": 0.009485094850948509 + }, + "system_bos": { + "tokens": 246, + "ordered_topk_exact_tokens": 174, + "set_exact_tokens": 200, + "mean_set_jaccard": 0.9465737514518001, + "mean_token_weighted_tv": 0.012991693101793043, + "aggregate_load_tv": 0.021002710027100274 + }, + "system_x": { + "tokens": 246, + "ordered_topk_exact_tokens": 175, + "set_exact_tokens": 202, + "mean_set_jaccard": 0.9488966318234612, + "mean_token_weighted_tv": 0.013512023535322368, + "aggregate_load_tv": 0.02032520325203252 + }, + "system_period": { + "tokens": 246, + "ordered_topk_exact_tokens": 173, + "set_exact_tokens": 200, + "mean_set_jaccard": 0.9465737514518002, + "mean_token_weighted_tv": 0.013575746795177703, + "aggregate_load_tv": 0.02235772357723577 + }, + "bos_at_s0": { + "tokens": 246, + "ordered_topk_exact_tokens": 141, + "set_exact_tokens": 178, + "mean_set_jaccard": 0.9210220673635308, + "mean_token_weighted_tv": 0.020271167450592043, + "aggregate_load_tv": 0.02032520325203252 + }, + "bos_at_s1": { + "tokens": 246, + "ordered_topk_exact_tokens": 130, + "set_exact_tokens": 172, + "mean_set_jaccard": 0.9140534262485481, + "mean_token_weighted_tv": 0.020988722297749143, + "aggregate_load_tv": 0.027777777777777776 + }, + "x_at_s0": { + "tokens": 246, + "ordered_topk_exact_tokens": 152, + "set_exact_tokens": 187, + "mean_set_jaccard": 0.9314750290360045, + "mean_token_weighted_tv": 0.018018867453272507, + "aggregate_load_tv": 0.022357723577235776 + }, + "x_at_s1": { + "tokens": 246, + "ordered_topk_exact_tokens": 135, + "set_exact_tokens": 175, + "mean_set_jaccard": 0.9157955865272938, + "mean_token_weighted_tv": 0.020708017384375985, + "aggregate_load_tv": 0.02913279132791328 + }, + "period_at_s0": { + "tokens": 246, + "ordered_topk_exact_tokens": 151, + "set_exact_tokens": 184, + "mean_set_jaccard": 0.9279907084785133, + "mean_token_weighted_tv": 0.018381062452113482, + "aggregate_load_tv": 0.024390243902439022 + }, + "period_at_s1": { + "tokens": 246, + "ordered_topk_exact_tokens": 134, + "set_exact_tokens": 175, + "mean_set_jaccard": 0.914924506387921, + "mean_token_weighted_tv": 0.020972200635275464, + "aggregate_load_tv": 0.029132791327913285 + } + } + }, + "layer_04": { + "layer": 4, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "8a8de65a92c704f372ef2d8535830fc069b1ec3efd8c7f9c57459fbd8421990e", + "route_weight_sha256": "cd78f9bb63c30f81808ac54fa19fa6b37434560a8584389afd7a03e7dc590990", + "loads": [ + 35, + 18, + 31, + 15, + 21, + 34, + 25, + 11, + 18, + 0, + 29, + 42, + 19, + 10, + 19, + 40, + 33, + 49, + 16, + 25, + 37, + 25, + 31, + 24, + 4, + 4, + 10, + 21, + 33, + 23, + 29, + 23, + 18, + 19, + 5, + 15, + 14, + 22, + 20, + 28, + 9, + 10, + 18, + 47, + 13, + 31, + 22, + 29, + 7, + 23, + 34, + 34, + 29, + 17, + 26, + 21, + 22, + 37, + 41, + 28, + 14, + 26, + 17, + 26 + ], + "weighted_loads": [ + 2.8990351036190987, + 0.9995093028992414, + 2.4690461233258247, + 1.1263783238828182, + 1.4892692491412163, + 2.081531498581171, + 1.6234950050711632, + 0.8800598196685314, + 1.3204029463231564, + 0.0, + 2.253351718187332, + 2.3119748421013355, + 0.9379401449114084, + 0.3347124792635441, + 2.8401065953075886, + 4.107913739979267, + 4.050998140126467, + 4.364294301718473, + 1.34516760148108, + 1.693182546645403, + 3.0421422235667706, + 1.0988671332597733, + 2.439322430640459, + 1.5000203624367714, + 0.14849737659096718, + 0.14061042852699757, + 0.9497146122157574, + 1.2326264195144176, + 2.773147914558649, + 0.9250384792685509, + 1.945497727021575, + 1.07124044559896, + 0.9242945034056902, + 1.3397425040602684, + 0.24594242870807648, + 0.626755042001605, + 0.6294752974063158, + 1.747584756463766, + 2.0268739610910416, + 2.452526953071356, + 0.3874466512352228, + 0.5315436888486147, + 1.428762350231409, + 3.196770878508687, + 0.7437412273138762, + 4.6344432681798935, + 1.3951026014983654, + 3.0511441696435213, + 0.2600407060235739, + 1.5249791536480188, + 2.9053958617150784, + 2.0230354703962803, + 2.4010910503566265, + 0.958988668397069, + 2.552175333723426, + 1.8141947332769632, + 1.4430149868130684, + 2.359388917684555, + 3.6061775721609592, + 2.123091984540224, + 0.5297655742615461, + 1.399027593433857, + 1.0148938447237015, + 1.797627268359065 + ], + "unique_experts": 63, + "load_cv": 0.457079633231377, + "normalized_load_entropy": 0.9719597853837258, + "max_load_share": 0.03319783197831978 + }, + "full_input": { + "tokens": 271, + "top_k": 6, + "decisions": 1626, + "ordered_route_sha256": "85aae520731350c943674e6a37f26c7c5916e94e20bfa80dce8801721fdaf5ba", + "route_weight_sha256": "eafafa833c8e3b76c084f91a2fc574e7fc66d5c3051f2f3d958bf43badbaa0f0", + "loads": [ + 35, + 21, + 33, + 19, + 21, + 34, + 27, + 11, + 18, + 0, + 39, + 44, + 19, + 23, + 21, + 43, + 33, + 49, + 21, + 25, + 37, + 27, + 33, + 24, + 4, + 10, + 16, + 22, + 33, + 40, + 29, + 25, + 18, + 21, + 16, + 15, + 14, + 24, + 21, + 28, + 12, + 13, + 26, + 47, + 13, + 33, + 33, + 29, + 8, + 25, + 35, + 34, + 29, + 17, + 26, + 21, + 22, + 37, + 41, + 41, + 18, + 26, + 20, + 27 + ], + "weighted_loads": [ + 2.8990351036190987, + 1.149409944191575, + 2.5911912843585014, + 1.4421817143156659, + 1.4892692491412163, + 2.081531498581171, + 1.7192311026155949, + 0.8800598196685314, + 1.3204029463231564, + 0.0, + 2.910952791571617, + 2.338572240434587, + 0.9379401449114084, + 1.2680705785751343, + 2.8860392086207867, + 4.31025380268693, + 4.050998140126467, + 4.364294301718473, + 1.688324842354632, + 1.693182546645403, + 3.0421422235667706, + 2.165204092860222, + 2.563693668693304, + 1.5000203624367714, + 0.14849737659096718, + 0.5658676642924547, + 1.508388414978981, + 1.2406021831557155, + 2.773147914558649, + 2.263238606567029, + 1.945497727021575, + 1.10213265940547, + 0.9242945034056902, + 1.3800292750820518, + 1.37247367654345, + 0.626755042001605, + 0.6294752974063158, + 1.8399247378110886, + 3.0237192660570145, + 2.452526953071356, + 0.5271221194416285, + 0.718690549954772, + 1.7878646068274975, + 3.196770878508687, + 0.7437412273138762, + 4.8323561437428, + 2.540877915918827, + 3.0511441696435213, + 0.2966714557260275, + 1.5754319224506617, + 2.952180154621601, + 2.0230354703962803, + 2.4010910503566265, + 0.958988668397069, + 2.552175333723426, + 1.8141947332769632, + 1.4430149868130684, + 2.359388917684555, + 3.6061775721609592, + 2.8531366772949696, + 0.9144356788892765, + 1.399027593433857, + 1.232019878923893, + 1.827210869640112 + ], + "unique_experts": 63, + "load_cv": 0.40671394100529007, + "normalized_load_entropy": 0.9777695943815483, + "max_load_share": 0.03013530135301353 + } + }, + "s1_eos": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "6cd491e8f79f2491ebd3993ee465d5f05369a5dadedd4de40885a8553fab928a", + "route_weight_sha256": "c348f7ee01d3bb7302f1ba2f82bbb819c3981703c9f65e8d80406a2eda56a861", + "loads": [ + 35, + 20, + 31, + 15, + 21, + 34, + 24, + 12, + 18, + 0, + 29, + 41, + 19, + 10, + 19, + 39, + 34, + 48, + 16, + 25, + 38, + 25, + 32, + 23, + 4, + 4, + 10, + 20, + 33, + 24, + 29, + 24, + 18, + 19, + 7, + 15, + 14, + 22, + 20, + 28, + 7, + 10, + 18, + 47, + 13, + 28, + 23, + 30, + 6, + 22, + 33, + 35, + 28, + 17, + 26, + 21, + 22, + 37, + 42, + 27, + 14, + 26, + 18, + 27 + ], + "weighted_loads": [ + 2.9115019496530294, + 1.078677173703909, + 2.447869010269642, + 1.118143230676651, + 1.4708672389388084, + 2.066249307245016, + 1.5968985967338085, + 0.912558676674962, + 1.3217157926410437, + 0.0, + 2.2573900669813156, + 2.2795154731720686, + 0.9319292027503252, + 0.3329452555626631, + 2.841292530298233, + 4.087653789669275, + 4.10236632078886, + 4.325519647449255, + 1.3734480179846287, + 1.6802684105932713, + 3.0771174654364586, + 1.0951952785253525, + 2.474187269806862, + 1.468229204416275, + 0.14682270027697086, + 0.13973821140825748, + 0.94282466173172, + 1.1996073201298714, + 2.7570997532457113, + 0.9910097979009151, + 1.928910929709673, + 1.0928444750607014, + 0.9262537453323603, + 1.332100061699748, + 0.32610600255429745, + 0.6159181017428637, + 0.6199855301529169, + 1.7515928894281387, + 2.0156277120113373, + 2.4630076624453068, + 0.31732300110161304, + 0.5240892637521029, + 1.405076626688242, + 3.199362313374877, + 0.7414029687643051, + 4.558923147618771, + 1.4255141448229551, + 3.06505323946476, + 0.21660463884472847, + 1.4678351823240519, + 2.85583982616663, + 2.0810211151838303, + 2.3423448372632265, + 0.9572407938539982, + 2.5360727291554213, + 1.8080501649528742, + 1.44156988337636, + 2.3620299976319075, + 3.6079169753938913, + 2.0638769306242466, + 0.5292255934327841, + 1.3993815761059523, + 1.0597054287791252, + 1.8728955462574959 + ], + "unique_experts": 63, + "load_cv": 0.45463077333384766, + "normalized_load_entropy": 0.9721906734090567, + "max_load_share": 0.032520325203252036 + }, + "full_input": { + "tokens": 287, + "top_k": 6, + "decisions": 1722, + "ordered_route_sha256": "b29f5fe889114c941d60b19dde8a7541d26b76d763dabf1f545fce7e604a09a9", + "route_weight_sha256": "b2265c0754b6a3dab4c2e21dd2aecd6eed0844ab14f6f08c192b62e25a06b461", + "loads": [ + 35, + 22, + 34, + 24, + 21, + 34, + 28, + 12, + 18, + 8, + 38, + 43, + 20, + 24, + 22, + 43, + 36, + 49, + 24, + 27, + 39, + 28, + 38, + 24, + 4, + 14, + 19, + 21, + 33, + 45, + 29, + 26, + 18, + 21, + 22, + 15, + 14, + 25, + 23, + 31, + 10, + 16, + 27, + 47, + 15, + 31, + 33, + 34, + 7, + 25, + 35, + 35, + 32, + 21, + 32, + 21, + 27, + 39, + 42, + 41, + 21, + 29, + 22, + 29 + ], + "weighted_loads": [ + 2.9115019496530294, + 1.205273199826479, + 2.617515482008457, + 1.9064400538045447, + 1.4708672389388084, + 2.066249307245016, + 1.8491236753761768, + 0.912558676674962, + 1.3217157926410437, + 1.0457605943083763, + 2.8471731822937727, + 2.306038271635771, + 1.0384952891618013, + 1.3285641428083181, + 2.9161558728665113, + 4.368008777499199, + 4.4669430032372475, + 4.36756744608283, + 2.0562864267849363, + 1.7704593539237976, + 3.126253705471754, + 2.1925360523164272, + 2.923913359642029, + 1.5615344792604446, + 0.14682270027697086, + 0.8415428195148706, + 1.7811384908854961, + 1.2079181345179677, + 2.7570997532457113, + 2.280824800953269, + 1.928910929709673, + 1.1234529055655003, + 0.9262537453323603, + 1.372788685373962, + 1.805423887039069, + 0.6159181017428637, + 0.6199855301529169, + 1.8850522972643375, + 3.20187159627676, + 2.6741676703095436, + 0.47692848183214664, + 0.7972615149774356, + 1.8305544890463352, + 3.199362313374877, + 0.8107741251587868, + 4.722365015826654, + 2.625651692971587, + 3.4043708965182304, + 0.2463375087827444, + 1.5550220925360918, + 2.9484472014009953, + 2.0810211151838303, + 2.7783861476927996, + 1.140235062688589, + 3.0904431845992804, + 1.8080501649528742, + 1.8660609982907772, + 2.4356968700885773, + 3.6079169753938913, + 2.8712410256266594, + 1.3968721497803926, + 1.6236899308860302, + 1.3456918112933636, + 1.9468927308917046 + ], + "unique_experts": 64, + "load_cv": 0.37344049824287007, + "normalized_load_entropy": 0.9819895653242063, + "max_load_share": 0.028455284552845527 + } + }, + "s0_bos": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "7ba972cc2f12bd14dfe2f2af5116a186242d106392bca025fad73ffe8b31d026", + "route_weight_sha256": "c0e347471c58e046eb107f951e9680f8aef12dcc3b3f70d9bda81158b66fde06", + "loads": [ + 34, + 20, + 33, + 15, + 21, + 34, + 24, + 11, + 18, + 0, + 29, + 43, + 20, + 12, + 19, + 43, + 33, + 48, + 16, + 25, + 35, + 28, + 32, + 21, + 4, + 2, + 10, + 26, + 33, + 18, + 28, + 23, + 17, + 17, + 4, + 11, + 15, + 22, + 20, + 28, + 9, + 14, + 18, + 46, + 14, + 28, + 22, + 29, + 5, + 26, + 37, + 31, + 29, + 20, + 26, + 21, + 23, + 37, + 40, + 26, + 13, + 27, + 18, + 25 + ], + "weighted_loads": [ + 2.826534355059266, + 1.0189737305045128, + 2.5909553207457066, + 1.1284955479204655, + 1.4708234537392855, + 2.133997231721878, + 1.6123762745410204, + 0.9089014902710915, + 1.3466030191630125, + 0.0, + 2.198354998603463, + 2.385580353438854, + 0.9846701826900244, + 0.40474382787942886, + 2.805648298934102, + 4.3427054062485695, + 4.015816234052181, + 4.376653630286455, + 1.2692333031445742, + 1.6700719706714153, + 2.9803621731698513, + 1.1628441475331783, + 2.498028378933668, + 1.370484171435237, + 0.14325558207929134, + 0.06795259937644005, + 0.9966890327632427, + 1.422385973855853, + 2.8091039955615997, + 0.6761906892061234, + 1.9585071559995413, + 1.0727923419326544, + 0.9349132459610701, + 1.278307244181633, + 0.18795912340283394, + 0.497485363855958, + 0.6610415484756231, + 1.745200026780367, + 2.0436886958777905, + 2.511738818138838, + 0.3904850725084543, + 0.6968323402106762, + 1.3854759968817234, + 3.2562983706593513, + 0.792581969872117, + 4.563271503895521, + 1.355656573548913, + 3.0893623270094395, + 0.1922503188252449, + 1.6317760031670332, + 3.0708171986043453, + 1.9354322012513876, + 2.364654188975692, + 1.089914433658123, + 2.6074818931519985, + 1.821318980306387, + 1.5185251403599977, + 2.3362291045486927, + 3.5989153143018484, + 2.022708408534527, + 0.49130383506417274, + 1.45955909229815, + 1.0909848883748055, + 1.8484603818506002 + ], + "unique_experts": 63, + "load_cv": 0.4599627376138673, + "normalized_load_entropy": 0.971013061921642, + "max_load_share": 0.032520325203252036 + }, + "full_input": { + "tokens": 271, + "top_k": 6, + "decisions": 1626, + "ordered_route_sha256": "0cfa7949442e81f6de83f25f23d09cc3ed3954767af3358a2251ced0cd71b4f3", + "route_weight_sha256": "e1bb7aa2fe8c0e5832250974db6d3452788b97f5b806ca6ca5cbf7b9031dac56", + "loads": [ + 34, + 23, + 35, + 20, + 21, + 34, + 25, + 11, + 18, + 0, + 39, + 44, + 20, + 25, + 21, + 46, + 33, + 48, + 22, + 25, + 35, + 29, + 34, + 21, + 4, + 8, + 16, + 26, + 33, + 37, + 28, + 24, + 17, + 18, + 16, + 11, + 15, + 24, + 21, + 28, + 12, + 17, + 26, + 46, + 14, + 30, + 33, + 29, + 6, + 27, + 39, + 31, + 30, + 20, + 26, + 21, + 23, + 37, + 40, + 39, + 18, + 27, + 21, + 25 + ], + "weighted_loads": [ + 2.826534355059266, + 1.1630751714110374, + 2.7131004817783833, + 1.508222390402807, + 1.4708234537392855, + 2.133997231721878, + 1.665243661031127, + 0.9089014902710915, + 1.3466030191630125, + 0.0, + 2.855956071987748, + 2.4026797860860825, + 0.9846701826900244, + 1.329623382538557, + 2.8515809122473, + 4.544608134776354, + 4.015816234052181, + 4.376653630286455, + 1.733938261619187, + 1.6700719706714153, + 2.9803621731698513, + 1.4539892636239529, + 2.6301440745592117, + 1.370484171435237, + 0.14325558207929134, + 0.4996783025562763, + 1.5646436028182507, + 1.422385973855853, + 2.8091039955615997, + 2.1680011652060784, + 1.9585071559995413, + 1.091155482456088, + 0.9349132459610701, + 1.3036564625799656, + 1.3345061362197157, + 0.497485363855958, + 0.6610415484756231, + 1.838288888335228, + 3.0405340008437634, + 2.511738818138838, + 0.53016054071486, + 0.8703613430261612, + 1.7445782534778118, + 3.2562983706593513, + 0.792581969872117, + 4.841022774577141, + 2.5014318879693747, + 3.0893623270094395, + 0.22888106852769852, + 1.6598096881061792, + 3.1521743051707745, + 1.9354322012513876, + 2.3948858119547367, + 1.089914433658123, + 2.6074818931519985, + 1.821318980306387, + 1.5185251403599977, + 2.3362291045486927, + 3.5989153143018484, + 2.7683192417025566, + 1.0907058639277238, + 1.45955909229815, + 1.3155899941921234, + 1.8484603818506002 + ], + "unique_experts": 63, + "load_cv": 0.4048048779639368, + "normalized_load_entropy": 0.9776204906088166, + "max_load_share": 0.02952029520295203 + } + }, + "s1_bos": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "8874fe7bc1021da6eae7c8329e6dc449536f219ae2e7515f9ba0e088792963bc", + "route_weight_sha256": "5709b52a5e683d69dc5b563d46cd79d26d92452276e1e872c2f423bdd2278710", + "loads": [ + 35, + 18, + 32, + 13, + 23, + 33, + 26, + 11, + 18, + 0, + 28, + 44, + 19, + 11, + 18, + 42, + 33, + 48, + 16, + 26, + 37, + 27, + 32, + 21, + 4, + 2, + 10, + 25, + 34, + 16, + 28, + 23, + 19, + 17, + 4, + 11, + 15, + 22, + 20, + 27, + 9, + 14, + 20, + 47, + 14, + 29, + 22, + 29, + 3, + 25, + 37, + 32, + 29, + 19, + 25, + 20, + 23, + 37, + 41, + 26, + 16, + 26, + 18, + 27 + ], + "weighted_loads": [ + 2.9159703589975834, + 0.9538283571600914, + 2.561434831470251, + 1.0442987531423569, + 1.589611243456602, + 2.027009081095457, + 1.6480621732771397, + 0.9347088374197483, + 1.357512205839157, + 0.0, + 2.1908417716622353, + 2.4452486597001553, + 0.9449128806591034, + 0.35939037427306175, + 2.7888946421444416, + 4.283172272145748, + 4.118908733129501, + 4.435659866780043, + 1.2197227217257023, + 1.7091682441532612, + 3.0320376101881266, + 1.1835538186132908, + 2.3797646835446358, + 1.3976990785449743, + 0.13911811262369156, + 0.06552065722644329, + 0.9651092030107975, + 1.3982296288013458, + 2.8389737755060196, + 0.5690899193286896, + 1.9596100207418203, + 1.0729247257113457, + 0.9825877211987972, + 1.274092461913824, + 0.19550119526684284, + 0.5019206292927265, + 0.6711338479071856, + 1.7275514900684357, + 2.0383387953042984, + 2.483420751988888, + 0.3779107928276062, + 0.6965657714754343, + 1.4639642182737589, + 3.265769785270095, + 0.7931346129626036, + 4.650425650179386, + 1.38093626126647, + 3.067653816193342, + 0.10900365374982357, + 1.6219591330736876, + 3.114368937909603, + 1.9649114217609167, + 2.255843125283718, + 1.0916968788951635, + 2.5843522883951664, + 1.7598947808146477, + 1.5437207072973251, + 2.326328493654728, + 3.644363334402442, + 2.064703233540058, + 0.5736670922487974, + 1.4224588349461555, + 1.0883061476051807, + 1.9970085974782705 + ], + "unique_experts": 63, + "load_cv": 0.4680037124079186, + "normalized_load_entropy": 0.9699093262029821, + "max_load_share": 0.032520325203252036 + }, + "full_input": { + "tokens": 287, + "top_k": 6, + "decisions": 1722, + "ordered_route_sha256": "693ec22475dcdd833f96a6df451f8931928f7b417aad732ac95311eb26727f4e", + "route_weight_sha256": "a47e06332186f176a0d1a8514b1b596bee0d04e9060e436ded0429b3ef24c76b", + "loads": [ + 35, + 20, + 35, + 23, + 23, + 33, + 30, + 11, + 18, + 8, + 37, + 45, + 20, + 25, + 21, + 46, + 35, + 49, + 24, + 28, + 38, + 29, + 38, + 22, + 4, + 12, + 19, + 25, + 34, + 37, + 28, + 24, + 19, + 18, + 20, + 11, + 15, + 25, + 23, + 30, + 12, + 20, + 29, + 47, + 16, + 32, + 33, + 33, + 4, + 27, + 39, + 32, + 33, + 23, + 31, + 20, + 28, + 39, + 41, + 40, + 25, + 29, + 22, + 30 + ], + "weighted_loads": [ + 2.9159703589975834, + 1.0775674767792225, + 2.7310813032090664, + 1.8949995457369369, + 1.589611243456602, + 2.027009081095457, + 1.8779538236558437, + 0.9347088374197483, + 1.357512205839157, + 1.0457605943083763, + 2.7806248869746923, + 2.4623480923473835, + 1.0514789670705795, + 1.3406276181340218, + 2.86375798471272, + 4.572396259754896, + 4.4834854155778885, + 4.477707665413618, + 1.9511854486190714, + 1.7993591874837875, + 3.081173850223422, + 1.515541985630989, + 2.8353036791086197, + 1.491004353389144, + 0.13911811262369156, + 0.7490104604512453, + 1.826880719512701, + 1.3982296288013458, + 2.8389737755060196, + 1.883119909092784, + 1.9596100207418203, + 1.0912878662347794, + 0.9825877211987972, + 1.2994416803121567, + 1.6294103502877988, + 0.5019206292927265, + 0.6711338479071856, + 1.8588255159556866, + 3.224582679569721, + 2.6945807598531246, + 0.5375162735581398, + 0.9974061598040862, + 1.8894420806318521, + 3.265769785270095, + 0.8625057693570852, + 4.81930203147931, + 2.629096072167158, + 3.406971473246813, + 0.1387365236878395, + 1.6862296555191278, + 3.2069763131439686, + 1.9649114217609167, + 2.691884435713291, + 1.2746911477297544, + 3.1387227438390255, + 1.7598947808146477, + 1.9682118222117424, + 2.3999953661113977, + 3.644363334402442, + 2.8860016129910946, + 1.6945449952036142, + 1.6467671897262335, + 1.392022766172886, + 2.1058890596032143 + ], + "unique_experts": 64, + "load_cv": 0.37517034970921465, + "normalized_load_entropy": 0.9813890788334503, + "max_load_share": 0.028455284552845527 + } + }, + "s0_x": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "dfffb470556e78ed63dc85742ff7445b3a22d1b6f532aeebd9a49daabf08817e", + "route_weight_sha256": "79e3efce7c2705fe3092d11e1eb7864e6025fdb67c395407d5bf6bc40897be08", + "loads": [ + 34, + 19, + 32, + 15, + 21, + 34, + 26, + 11, + 19, + 0, + 29, + 43, + 18, + 9, + 18, + 41, + 33, + 48, + 16, + 25, + 36, + 27, + 32, + 20, + 4, + 4, + 11, + 25, + 33, + 18, + 29, + 23, + 18, + 19, + 4, + 13, + 15, + 21, + 21, + 28, + 10, + 12, + 19, + 46, + 14, + 29, + 21, + 28, + 7, + 26, + 37, + 29, + 30, + 18, + 27, + 21, + 23, + 37, + 40, + 25, + 14, + 28, + 19, + 24 + ], + "weighted_loads": [ + 2.836755733937025, + 1.0138016752898693, + 2.513137500733137, + 1.1741540394723415, + 1.5306025445461273, + 2.087234538048506, + 1.7535265646874905, + 0.8991570770740509, + 1.3761591874063015, + 0.0, + 2.2120238691568375, + 2.4404201563447714, + 0.9121813103556633, + 0.30869277752935886, + 2.812282169237733, + 4.238685313612223, + 3.9816463701426983, + 4.368511442095041, + 1.327283788472414, + 1.6296193785965443, + 3.0383346658200026, + 1.1395437307655811, + 2.597941443324089, + 1.336406460031867, + 0.14046978205442429, + 0.1381401252001524, + 1.0433306209743023, + 1.378774693235755, + 2.765735153108835, + 0.6186208110302687, + 1.982010206207633, + 1.090611094608903, + 0.9439915269613266, + 1.3495114259421825, + 0.20648124068975449, + 0.5739456936717033, + 0.651053000241518, + 1.7133577279746532, + 2.0774790309369564, + 2.473706215620041, + 0.4526167791336775, + 0.620612995699048, + 1.4271624516695738, + 3.2409654185175896, + 0.7918101623654366, + 4.564432892948389, + 1.3256265614181757, + 3.0688984729349613, + 0.26469293236732483, + 1.6353271808475256, + 3.028004879131913, + 1.8577482663094997, + 2.4419107232242823, + 1.011058060452342, + 2.6181587520986795, + 1.7862706407904625, + 1.4949212800711393, + 2.3246588334441185, + 3.6089457273483276, + 1.9960856661200523, + 0.521163996309042, + 1.491569196805358, + 1.132438763976097, + 1.8009811118245125 + ], + "unique_experts": 63, + "load_cv": 0.45275299533520175, + "normalized_load_entropy": 0.9723306788172473, + "max_load_share": 0.032520325203252036 + }, + "full_input": { + "tokens": 271, + "top_k": 6, + "decisions": 1626, + "ordered_route_sha256": "acb630be2a36401831f7d7696108a04ddc44ecbded6043ef59058b80e5fc0455", + "route_weight_sha256": "284c41c307f9a4fd111351fa3fcdc50c00017a30621f8eddd567f24840678e28", + "loads": [ + 34, + 23, + 35, + 19, + 21, + 34, + 26, + 11, + 19, + 0, + 40, + 44, + 18, + 21, + 20, + 44, + 33, + 48, + 21, + 25, + 36, + 28, + 34, + 20, + 4, + 10, + 17, + 25, + 33, + 34, + 29, + 24, + 18, + 20, + 14, + 13, + 15, + 23, + 22, + 28, + 14, + 15, + 28, + 46, + 14, + 31, + 34, + 28, + 9, + 27, + 39, + 29, + 31, + 18, + 27, + 21, + 23, + 37, + 40, + 39, + 18, + 28, + 22, + 25 + ], + "weighted_loads": [ + 2.836755733937025, + 1.204720325767994, + 2.6664018481969833, + 1.5132330362393986, + 1.5306025445461273, + 2.087234538048506, + 1.7535265646874905, + 0.8991570770740509, + 1.3761591874063015, + 0.0, + 3.0857554972171783, + 2.4575195889919996, + 0.9121813103556633, + 1.1909192185848951, + 2.858214782550931, + 4.449969258159399, + 3.9816463701426983, + 4.368511442095041, + 1.6448701748013264, + 1.6296193785965443, + 3.0383346658200026, + 1.4306888468563557, + 2.737308509647846, + 1.336406460031867, + 0.14046978205442429, + 0.5103808362036943, + 1.655504573136568, + 1.378774693235755, + 2.765735153108835, + 1.8430414046742953, + 1.982010206207633, + 1.1089742351323366, + 0.9439915269613266, + 1.3748606443405151, + 1.1257689044286963, + 0.5739456936717033, + 0.651053000241518, + 1.8091638498008251, + 3.0743243359029293, + 2.473706215620041, + 0.6489073466509581, + 0.8019268941134214, + 1.8219703380018473, + 3.2409654185175896, + 0.7918101623654366, + 4.8152221366763115, + 2.7164338435977697, + 3.0688984729349613, + 0.34496065229177475, + 1.6633608657866716, + 3.1088592018932104, + 1.8577482663094997, + 2.4718394707888365, + 1.011058060452342, + 2.6181587520986795, + 1.7862706407904625, + 1.4949212800711393, + 2.3246588334441185, + 3.6089457273483276, + 2.825953282415867, + 0.8984554631460924, + 1.491569196805358, + 1.3468948565423489, + 1.8329008519649506 + ], + "unique_experts": 63, + "load_cv": 0.3976251385403159, + "normalized_load_entropy": 0.9786686229129382, + "max_load_share": 0.02952029520295203 + } + }, + "s1_x": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "2784ab4cfd7d37aee179e40006363133a31d5385042cb273ccd5ca6ee298acac", + "route_weight_sha256": "153aaee5a8efa2cb100461fccf7d131a099841660e7df65a8eeffe73b6f26392", + "loads": [ + 34, + 18, + 32, + 13, + 23, + 33, + 30, + 11, + 18, + 0, + 29, + 45, + 18, + 9, + 18, + 42, + 33, + 48, + 16, + 27, + 38, + 29, + 32, + 21, + 4, + 1, + 11, + 24, + 32, + 15, + 28, + 22, + 18, + 18, + 4, + 13, + 14, + 22, + 20, + 27, + 10, + 14, + 20, + 46, + 14, + 28, + 21, + 29, + 5, + 24, + 37, + 32, + 28, + 20, + 26, + 20, + 23, + 39, + 40, + 25, + 14, + 27, + 18, + 26 + ], + "weighted_loads": [ + 2.854085933417082, + 0.9542864579707384, + 2.5430241487920284, + 1.084384996443987, + 1.5998577289283276, + 2.024936903268099, + 1.8134137615561485, + 0.9188476428389549, + 1.3609124179929495, + 0.0, + 2.253520028665662, + 2.51583981141448, + 0.9151076190173626, + 0.2991544082760811, + 2.798393512144685, + 4.269947875291109, + 4.099073808640242, + 4.439832895994186, + 1.263851586729288, + 1.7326993383467197, + 3.0899739246815443, + 1.249871565029025, + 2.3875644467771053, + 1.4035343807190657, + 0.13782813027501106, + 0.03784432262182236, + 1.0108830705285072, + 1.3670094646513462, + 2.754872716963291, + 0.5082727652043104, + 1.9585492927581072, + 1.0142521411180496, + 0.9401042181998491, + 1.319143433123827, + 0.2146134413778782, + 0.5609485954046249, + 0.6272815056145191, + 1.7366714589297771, + 2.029642876237631, + 2.4554744325578213, + 0.41191220842301846, + 0.7045577503740788, + 1.4573869183659554, + 3.2448227442801, + 0.7941701058298349, + 4.620115779340267, + 1.3534717448055744, + 3.0556355342268944, + 0.15468371286988258, + 1.588111087679863, + 3.109804257750511, + 1.966275967657566, + 2.23885041475296, + 1.1048327255994081, + 2.6061064545065165, + 1.744021724909544, + 1.5299525521695614, + 2.401659317314625, + 3.6406023800373077, + 2.0418200250715017, + 0.5241133589297533, + 1.457716068252921, + 1.0779011212289333, + 1.9522722773253918 + ], + "unique_experts": 63, + "load_cv": 0.4688816806814109, + "normalized_load_entropy": 0.9698345861878687, + "max_load_share": 0.032520325203252036 + }, + "full_input": { + "tokens": 287, + "top_k": 6, + "decisions": 1722, + "ordered_route_sha256": "edd0c528c039d87cfbb780f0d3dc4e5f4a56d55cc51e7d6cb89fbd63ca7f1ec4", + "route_weight_sha256": "cc0a54e8ccd13d08e3c892b8016a6ae88ec9c218c24c7532c1f9a84b2eacb5fd", + "loads": [ + 34, + 21, + 36, + 22, + 23, + 33, + 33, + 11, + 18, + 8, + 39, + 46, + 19, + 22, + 21, + 46, + 35, + 49, + 23, + 29, + 39, + 31, + 38, + 22, + 4, + 11, + 20, + 24, + 32, + 34, + 28, + 23, + 18, + 19, + 19, + 13, + 14, + 25, + 24, + 30, + 14, + 20, + 30, + 46, + 16, + 31, + 33, + 33, + 6, + 26, + 39, + 32, + 32, + 24, + 32, + 20, + 28, + 41, + 40, + 40, + 22, + 30, + 22, + 29 + ], + "weighted_loads": [ + 2.854085933417082, + 1.1245466824620962, + 2.747554127126932, + 1.8966451517480891, + 1.5998577289283276, + 2.024936903268099, + 1.994111429899931, + 0.9188476428389549, + 1.3609124179929495, + 1.0457605943083763, + 3.032720386981964, + 2.5329392440617085, + 1.0216737054288387, + 1.2376729734241962, + 2.873256854712963, + 4.562064301222563, + 4.463650491088629, + 4.481880694627762, + 1.8512769924127497, + 1.822890281677246, + 3.13911016471684, + 1.5818597320467234, + 2.845616929233074, + 1.4968396555632353, + 0.13782813027501106, + 0.6723642498254776, + 1.9004609882831573, + 1.3670094646513462, + 2.754872716963291, + 1.6010166183114052, + 1.9585492927581072, + 1.0326152816414833, + 0.9401042181998491, + 1.3444926515221596, + 1.4496684107580222, + 0.5609485954046249, + 0.6272815056145191, + 1.8689368329942226, + 3.2684891894459724, + 2.666634440422058, + 0.6253033336251974, + 1.037963844180922, + 1.9231200516223907, + 3.2448227442801, + 0.8635412622243166, + 4.745911413512658, + 2.809123944491148, + 3.394953191280365, + 0.18441658280789852, + 1.6523816101253033, + 3.2024116329848766, + 1.966275967657566, + 2.6748917251825333, + 1.287826994433999, + 3.1604769099503756, + 1.744021724909544, + 1.9544436670839787, + 2.4753261897712946, + 3.6406023800373077, + 2.9583824817091227, + 1.4271956328302622, + 1.682024423032999, + 1.3698870576918125, + 2.0620830822736025 + ], + "unique_experts": 64, + "load_cv": 0.3741333986121843, + "normalized_load_entropy": 0.9818052008278283, + "max_load_share": 0.028455284552845527 + } + }, + "s0_period": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "386fac69c9cbdb25e4fa475d2c8e9ee2fdeef6b48b6c83cd17ebca4f09221483", + "route_weight_sha256": "c4d4f1dd3df1456a1a932b87ea098a8d0a9bc970e96ed3b4199da18c9ce6fa7a", + "loads": [ + 34, + 19, + 32, + 15, + 21, + 34, + 25, + 11, + 19, + 0, + 29, + 42, + 19, + 9, + 18, + 41, + 33, + 48, + 16, + 25, + 36, + 26, + 32, + 21, + 4, + 3, + 11, + 24, + 33, + 17, + 30, + 22, + 18, + 19, + 4, + 14, + 15, + 21, + 22, + 28, + 10, + 13, + 18, + 46, + 14, + 29, + 21, + 28, + 7, + 26, + 37, + 29, + 30, + 19, + 27, + 20, + 23, + 39, + 41, + 25, + 13, + 27, + 20, + 24 + ], + "weighted_loads": [ + 2.8522937521338463, + 1.0123326033353806, + 2.521471567451954, + 1.165255032479763, + 1.522181410342455, + 2.0777673609554768, + 1.6932142991572618, + 0.90143190510571, + 1.3793470691889524, + 0.0, + 2.1967898234725, + 2.4003057461231947, + 0.9448732398450375, + 0.3071920182555914, + 2.8056721724569798, + 4.256045579910278, + 4.015550844371319, + 4.393771521747112, + 1.336284939199686, + 1.6379197668284178, + 3.036463813856244, + 1.1052412912249565, + 2.5489608868956566, + 1.3672094214707613, + 0.1408357433974743, + 0.10390318930149078, + 1.048287283629179, + 1.3482875786721706, + 2.770984571427107, + 0.5737169850617647, + 2.011906335130334, + 1.0536759812384844, + 0.9354539047926664, + 1.3440618477761745, + 0.211063414812088, + 0.6058150064200163, + 0.6584523152559996, + 1.7217543683946133, + 2.0757066514343023, + 2.4828765466809273, + 0.46100389398634434, + 0.6518774386495352, + 1.4022416733205318, + 3.2481893207877874, + 0.7981883771717548, + 4.555276982486248, + 1.3217336665838957, + 3.068272076547146, + 0.25984177738428116, + 1.6373321432620287, + 3.028424648568034, + 1.8697667811065912, + 2.428947988897562, + 1.0471865851432085, + 2.623732127249241, + 1.7595349811017513, + 1.5052439011633396, + 2.420699831098318, + 3.666391270235181, + 1.9740524888038635, + 0.49093060567975044, + 1.4622122775763273, + 1.1795128770172596, + 1.8004318736493587 + ], + "unique_experts": 63, + "load_cv": 0.4545661514972916, + "normalized_load_entropy": 0.9720310646298297, + "max_load_share": 0.032520325203252036 + }, + "full_input": { + "tokens": 271, + "top_k": 6, + "decisions": 1626, + "ordered_route_sha256": "779043ec63b2adfc11db3d330cc86549fd64eb717521020e962c532f7cf19242", + "route_weight_sha256": "e8c872e6ac1eb7c8a3a6eacde9f496a08e41f4b2bfb9ac0825cc092fb0dd8bc8", + "loads": [ + 34, + 23, + 34, + 19, + 21, + 34, + 25, + 11, + 19, + 0, + 39, + 43, + 19, + 21, + 20, + 44, + 33, + 48, + 21, + 25, + 36, + 27, + 35, + 21, + 4, + 9, + 18, + 24, + 33, + 34, + 30, + 23, + 18, + 20, + 14, + 14, + 15, + 23, + 23, + 28, + 13, + 16, + 26, + 46, + 14, + 31, + 33, + 28, + 9, + 27, + 39, + 30, + 32, + 19, + 27, + 20, + 23, + 39, + 41, + 39, + 17, + 27, + 23, + 25 + ], + "weighted_loads": [ + 2.8522937521338463, + 1.212140142917633, + 2.6436167284846306, + 1.509276066411985, + 1.522181410342455, + 2.0777673609554768, + 1.6932142991572618, + 0.90143190510571, + 1.3793470691889524, + 0.0, + 2.854390896856785, + 2.417405178770423, + 0.9448732398450375, + 1.16605413146317, + 2.851604785770178, + 4.450493432581425, + 4.015550844371319, + 4.393771521747112, + 1.6638784946262604, + 1.6379197668284178, + 3.036463813856244, + 1.396386407315731, + 2.7203303799033165, + 1.3672094214707613, + 0.1408357433974743, + 0.45919900201261044, + 1.9255372509360313, + 1.3482875786721706, + 2.770984571427107, + 1.822101860831026, + 2.011906335130334, + 1.072039121761918, + 0.9354539047926664, + 1.3694110661745071, + 1.1216390662302729, + 0.6058150064200163, + 0.6584523152559996, + 1.8162557147443295, + 3.0725519564002752, + 2.4828765466809273, + 0.60067936219275, + 0.8260490763932467, + 1.7613439299166203, + 3.2481893207877874, + 0.7981883771717548, + 4.823823656886816, + 2.626970225945115, + 3.068272076547146, + 0.35021568834781647, + 1.6653658282011747, + 3.1081127766519785, + 1.9964509401470423, + 2.5230160169303417, + 1.0471865851432085, + 2.623732127249241, + 1.7595349811017513, + 1.5052439011633396, + 2.420699831098318, + 3.666391270235181, + 2.8052991554141045, + 0.8729596210469026, + 1.4622122775763273, + 1.394209023565054, + 1.8318940810859203 + ], + "unique_experts": 63, + "load_cv": 0.3973815493025856, + "normalized_load_entropy": 0.9786726589822577, + "max_load_share": 0.02952029520295203 + } + }, + "s1_period": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "1abc6c9272042633f14379d642a2568ea9b20c67286726bc242071f003e64773", + "route_weight_sha256": "fb7f1c5a1cfb79d2a9dff4bdde2135b5be998e4915c625538bd6456f58ff91cb", + "loads": [ + 35, + 19, + 31, + 13, + 22, + 33, + 29, + 11, + 18, + 0, + 30, + 46, + 18, + 9, + 18, + 42, + 33, + 48, + 16, + 26, + 37, + 30, + 32, + 21, + 4, + 1, + 11, + 24, + 33, + 14, + 28, + 23, + 16, + 18, + 4, + 12, + 14, + 22, + 20, + 27, + 10, + 14, + 20, + 47, + 14, + 28, + 21, + 29, + 4, + 26, + 37, + 32, + 28, + 19, + 26, + 20, + 23, + 38, + 42, + 25, + 14, + 27, + 18, + 26 + ], + "weighted_loads": [ + 2.903915472328663, + 0.9863583203405142, + 2.501611851155758, + 1.0847431123256683, + 1.561698742210865, + 2.010834064334631, + 1.7847843635827303, + 0.9189183320850134, + 1.3601464834064245, + 0.0, + 2.2753047309815884, + 2.544663416221738, + 0.917773000895977, + 0.295732906088233, + 2.7973424401134253, + 4.280343126505613, + 4.117259941995144, + 4.4484464675188065, + 1.2654934711754322, + 1.7051018215715885, + 3.047590309754014, + 1.2686039097607136, + 2.3650897070765495, + 1.404286002740264, + 0.1367226541042328, + 0.03783054277300835, + 1.016623754054308, + 1.3610222302377224, + 2.8016798198223114, + 0.4645404424518347, + 1.959877222776413, + 1.0355616137385368, + 0.8859673384577036, + 1.3179176524281502, + 0.21540674939751625, + 0.5383997298777103, + 0.6301329545676708, + 1.7395549789071083, + 1.998136267066002, + 2.4583407044410706, + 0.41819421015679836, + 0.699537917971611, + 1.4592050053179264, + 3.280570063740015, + 0.795701639726758, + 4.617538511753082, + 1.3664465360343456, + 3.0570161528885365, + 0.12618793919682503, + 1.6568874809890985, + 3.106024082750082, + 1.9708393309265375, + 2.22803570702672, + 1.0820829421281815, + 2.605114944279194, + 1.7401229068636894, + 1.5288432408124208, + 2.3771213181316853, + 3.7151010762900114, + 2.0478204749524593, + 0.5153089053928852, + 1.4550735298544168, + 1.0829515606164932, + 1.9445634558796883 + ], + "unique_experts": 63, + "load_cv": 0.47634074724661096, + "normalized_load_entropy": 0.9689375557327339, + "max_load_share": 0.032520325203252036 + }, + "full_input": { + "tokens": 287, + "top_k": 6, + "decisions": 1722, + "ordered_route_sha256": "deaf8d0a3f701beea794a139f4fe83eb39fd79014bba4885c19aa6e51d6aab74", + "route_weight_sha256": "68c6ce6423cebd72035ddb8031d78294bea85c5d83e406647968420f46b1c7c6", + "loads": [ + 35, + 22, + 34, + 22, + 22, + 33, + 32, + 11, + 18, + 8, + 39, + 47, + 19, + 22, + 21, + 46, + 35, + 49, + 23, + 28, + 38, + 32, + 39, + 22, + 4, + 11, + 21, + 24, + 33, + 33, + 28, + 24, + 16, + 19, + 18, + 12, + 14, + 26, + 24, + 30, + 13, + 20, + 29, + 47, + 16, + 31, + 32, + 33, + 5, + 28, + 39, + 33, + 33, + 23, + 32, + 20, + 28, + 40, + 42, + 40, + 22, + 30, + 22, + 30 + ], + "weighted_loads": [ + 2.903915472328663, + 1.1454549711197615, + 2.671258322894573, + 1.9036681472498458, + 1.561698742210865, + 2.010834064334631, + 1.9660676252096891, + 0.9189183320850134, + 1.3601464834064245, + 1.0457605943083763, + 2.8650878462940454, + 2.561762848868966, + 1.0243390873074532, + 1.2065892983227968, + 2.8722057826817036, + 4.579103451222181, + 4.481836624443531, + 4.490494266152382, + 1.8577421145164408, + 1.7952927649021149, + 3.0967265497893095, + 1.6005920767784119, + 2.8542440235614777, + 1.4975912775844336, + 0.1367226541042328, + 0.6430639885365963, + 2.206840682774782, + 1.3610222302377224, + 2.8016798198223114, + 1.5447401218116283, + 1.959877222776413, + 1.0539247542619705, + 0.8859673384577036, + 1.3432668708264828, + 1.3955876115360297, + 0.5383997298777103, + 0.6301329545676708, + 1.9136421978473663, + 3.243314888328314, + 2.6695007123053074, + 0.577799690887332, + 1.0447624430962605, + 1.8846828676760197, + 3.280570063740015, + 0.8650727961212397, + 4.7448253274778835, + 2.674436930567026, + 3.396333809942007, + 0.15592080913484097, + 1.7211580034345388, + 3.1986314579844475, + 2.0670489985495806, + 2.7170163206756115, + 1.2650772109627724, + 3.159485399723053, + 1.7401229068636894, + 1.9533343557268381, + 2.450788190588355, + 3.7151010762900114, + 3.0188836567103863, + 1.4237522259354591, + 1.6793818846344948, + 1.387545607984066, + 2.0863445326685905 + ], + "unique_experts": 64, + "load_cv": 0.38076643432192847, + "normalized_load_entropy": 0.981065799255839, + "max_load_share": 0.028455284552845527 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 246, + "ordered_topk_exact_tokens": 209, + "set_exact_tokens": 226, + "mean_set_jaccard": 0.9767711962833915, + "mean_token_weighted_tv": 0.006276735418847179, + "aggregate_load_tv": 0.010840108401084013 + }, + "system_bos": { + "tokens": 246, + "ordered_topk_exact_tokens": 202, + "set_exact_tokens": 216, + "mean_set_jaccard": 0.9634146341463414, + "mean_token_weighted_tv": 0.010760641327445827, + "aggregate_load_tv": 0.015582655826558267 + }, + "system_x": { + "tokens": 246, + "ordered_topk_exact_tokens": 183, + "set_exact_tokens": 208, + "mean_set_jaccard": 0.9523809523809523, + "mean_token_weighted_tv": 0.013736474062732564, + "aggregate_load_tv": 0.02032520325203252 + }, + "system_period": { + "tokens": 246, + "ordered_topk_exact_tokens": 184, + "set_exact_tokens": 205, + "mean_set_jaccard": 0.9497677119628339, + "mean_token_weighted_tv": 0.01344045261829728, + "aggregate_load_tv": 0.021680216802168025 + }, + "bos_at_s0": { + "tokens": 246, + "ordered_topk_exact_tokens": 155, + "set_exact_tokens": 183, + "mean_set_jaccard": 0.9259581881533101, + "mean_token_weighted_tv": 0.018437997547803613, + "aggregate_load_tv": 0.025745257452574524 + }, + "bos_at_s1": { + "tokens": 246, + "ordered_topk_exact_tokens": 149, + "set_exact_tokens": 183, + "mean_set_jaccard": 0.9242160278745644, + "mean_token_weighted_tv": 0.019750544093397816, + "aggregate_load_tv": 0.031165311653116534 + }, + "x_at_s0": { + "tokens": 246, + "ordered_topk_exact_tokens": 162, + "set_exact_tokens": 191, + "mean_set_jaccard": 0.9335075493612077, + "mean_token_weighted_tv": 0.016684030667250233, + "aggregate_load_tv": 0.02371273712737127 + }, + "x_at_s1": { + "tokens": 246, + "ordered_topk_exact_tokens": 146, + "set_exact_tokens": 181, + "mean_set_jaccard": 0.9201509872241579, + "mean_token_weighted_tv": 0.020048987078745435, + "aggregate_load_tv": 0.03387533875338754 + }, + "period_at_s0": { + "tokens": 246, + "ordered_topk_exact_tokens": 161, + "set_exact_tokens": 193, + "mean_set_jaccard": 0.9358304297328687, + "mean_token_weighted_tv": 0.016528655229726942, + "aggregate_load_tv": 0.024390243902439022 + }, + "period_at_s1": { + "tokens": 246, + "ordered_topk_exact_tokens": 146, + "set_exact_tokens": 179, + "mean_set_jaccard": 0.9178281068524969, + "mean_token_weighted_tv": 0.02033285456671705, + "aggregate_load_tv": 0.03319783197831979 + } + } + }, + "layer_05": { + "layer": 5, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "43454628e8086b0428640fae91ee915cd4bc27124da5a72a9c06d5eb4ad7ce35", + "route_weight_sha256": "e092cf2ad5f1ebf510ca334c57a9b210f9d9fb877a4066acd15f49f868cbfaf1", + "loads": [ + 18, + 12, + 16, + 12, + 12, + 28, + 7, + 25, + 26, + 45, + 3, + 15, + 27, + 31, + 36, + 19, + 20, + 13, + 26, + 16, + 33, + 24, + 28, + 34, + 50, + 17, + 38, + 29, + 39, + 42, + 21, + 10, + 21, + 44, + 14, + 12, + 9, + 26, + 3, + 13, + 27, + 5, + 36, + 34, + 24, + 26, + 21, + 15, + 15, + 2, + 7, + 10, + 17, + 29, + 16, + 35, + 31, + 9, + 48, + 32, + 35, + 40, + 26, + 22 + ], + "weighted_loads": [ + 1.1706199441105127, + 0.44686541333794594, + 1.4284343793988228, + 0.6350666657090187, + 0.5936367474496365, + 2.5840816982090473, + 0.36556086130440235, + 1.843662604689598, + 1.4249984323978424, + 3.1350251007825136, + 0.1645328812301159, + 0.8078270591795444, + 2.083459857851267, + 2.323701411485672, + 1.8336024433374405, + 1.5611562430858612, + 1.360168281942606, + 0.692604023963213, + 1.4656703788787127, + 0.6697094030678272, + 1.9782363064587116, + 1.6357795689255, + 2.174059931188822, + 2.1141186021268368, + 4.12718016654253, + 1.0323595702648163, + 3.0129464957863092, + 2.4498118478804827, + 2.9038720820099115, + 3.4210735745728016, + 1.449251189827919, + 0.3749057501554489, + 0.8444985281676054, + 2.5223792642354965, + 0.8092675507068634, + 0.710726534947753, + 0.5863331779837608, + 1.9388914071023464, + 0.10955492034554482, + 1.2233158200979233, + 2.875173967331648, + 0.19034379720687866, + 3.484464328736067, + 2.504749834537506, + 1.3731092400848866, + 1.9468512013554573, + 1.0684936009347439, + 1.112746026366949, + 1.344891794025898, + 0.08759142458438873, + 0.3596855439245701, + 0.7670715302228928, + 0.8862726017832756, + 1.6337655913084745, + 1.698414582759142, + 2.8135871663689613, + 2.1798943039029837, + 0.49060087464749813, + 4.229673916473985, + 2.2289526890963316, + 3.2942934222519398, + 3.472746979445219, + 1.627995565533638, + 1.8652034476399422 + ], + "unique_experts": 64, + "load_cv": 0.5095355449853027, + "normalized_load_entropy": 0.9664493468527706, + "max_load_share": 0.03387533875338753 + }, + "full_input": { + "tokens": 271, + "top_k": 6, + "decisions": 1626, + "ordered_route_sha256": "fc9cf88c8b0112be51229113fe4a3cb95dbbe729c7272e1c19116e26161052e7", + "route_weight_sha256": "3d4e2e3bd3980169d558c995d0a7b7b462957520ee16a76e553cc787f7f0b67d", + "loads": [ + 18, + 13, + 16, + 12, + 13, + 29, + 8, + 27, + 27, + 46, + 15, + 15, + 30, + 31, + 36, + 32, + 22, + 19, + 35, + 17, + 35, + 24, + 28, + 34, + 50, + 25, + 38, + 29, + 39, + 42, + 21, + 10, + 21, + 44, + 14, + 16, + 9, + 26, + 14, + 21, + 31, + 13, + 43, + 36, + 25, + 26, + 21, + 17, + 15, + 6, + 15, + 10, + 19, + 38, + 19, + 44, + 31, + 9, + 48, + 33, + 35, + 41, + 26, + 24 + ], + "weighted_loads": [ + 1.1706199441105127, + 0.4504009245429188, + 1.4284343793988228, + 0.6350666657090187, + 0.5953936353325844, + 2.620919495820999, + 0.3976427670568228, + 1.8876401914749295, + 1.4283686929848045, + 3.1395431864075363, + 0.8534222859889269, + 0.8078270591795444, + 2.2761904038488865, + 2.323701411485672, + 1.8336024433374405, + 3.735641479026526, + 1.510490383952856, + 0.9906312227249146, + 2.398052414879203, + 0.6827999027445912, + 1.9936759162228554, + 1.6357795689255, + 2.174059931188822, + 2.1141186021268368, + 4.12718016654253, + 1.9344009384512901, + 3.0129464957863092, + 2.4498118478804827, + 2.9038720820099115, + 3.4210735745728016, + 1.449251189827919, + 0.3749057501554489, + 0.8444985281676054, + 2.5223792642354965, + 0.8092675507068634, + 1.0219825450330973, + 0.5863331779837608, + 1.9388914071023464, + 1.1835907809436321, + 1.9458859376609325, + 3.051009051501751, + 1.0343439802527428, + 3.9576725997030735, + 2.605152454227209, + 1.4550185464322567, + 1.9468512013554573, + 1.0684936009347439, + 1.130715919425711, + 1.344891794025898, + 0.2703668689355254, + 1.0030107274651527, + 0.7670715302228928, + 2.515505127608776, + 2.227991731837392, + 1.715313097112812, + 3.5037496984004974, + 2.1798943039029837, + 0.49060087464749813, + 4.229673916473985, + 2.2749163154512644, + 3.2942934222519398, + 3.5100294947624207, + 1.627995565533638, + 2.8004835098981857 + ], + "unique_experts": 64, + "load_cv": 0.44026709141480486, + "normalized_load_entropy": 0.9760840942651711, + "max_load_share": 0.03075030750307503 + } + }, + "s1_eos": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "9aba5c3546a28be27c79e08aed415b077b62d476df86287717d87e80dc84edb1", + "route_weight_sha256": "5f206715ee4a6846a8904a37f444c41d1c594172bf21b851586147125f14cfff", + "loads": [ + 18, + 12, + 17, + 12, + 12, + 29, + 7, + 26, + 25, + 46, + 3, + 15, + 27, + 34, + 34, + 19, + 20, + 13, + 25, + 15, + 32, + 24, + 28, + 34, + 50, + 16, + 38, + 29, + 39, + 42, + 21, + 8, + 20, + 42, + 14, + 12, + 9, + 26, + 4, + 14, + 27, + 5, + 36, + 34, + 22, + 27, + 20, + 18, + 16, + 2, + 8, + 9, + 19, + 30, + 15, + 35, + 30, + 9, + 49, + 31, + 35, + 40, + 26, + 22 + ], + "weighted_loads": [ + 1.1714260019361973, + 0.4491537772119045, + 1.4721537977457047, + 0.628732455894351, + 0.5996866635978222, + 2.597643295302987, + 0.35804786905646324, + 1.867939617484808, + 1.3875582590699196, + 3.168713267892599, + 0.1590154767036438, + 0.8078245893120766, + 2.06954188644886, + 2.4490050300955772, + 1.7672993652522564, + 1.605317648500204, + 1.3699649684131145, + 0.6973839215934277, + 1.414211755618453, + 0.6267648823559284, + 1.9834015984088182, + 1.6345667410641909, + 2.1620996966958046, + 2.140461277216673, + 4.160746943205595, + 0.9719142746180296, + 3.056286059319973, + 2.4371543303132057, + 2.8921225499361753, + 3.419381245970726, + 1.4422530811280012, + 0.2887801881879568, + 0.8067817110568285, + 2.4676759839057922, + 0.8007447011768818, + 0.7268475443124771, + 0.5791771672666073, + 1.9498050827533007, + 0.14539871364831924, + 1.1853465177118778, + 2.9639985505491495, + 0.1953942272812128, + 3.4977500289678574, + 2.516710001975298, + 1.2675455547869205, + 1.9981358498334885, + 1.0355829671025276, + 1.204190170392394, + 1.388586137443781, + 0.0881856419146061, + 0.39082495495676994, + 0.7327329553663731, + 0.9506341591477394, + 1.666679797694087, + 1.6686713956296444, + 2.811780396848917, + 2.1499485075473785, + 0.48669155314564705, + 4.259477749466896, + 2.194917019456625, + 3.30847342684865, + 3.4488759115338326, + 1.6268521081656218, + 1.849624402821064 + ], + "unique_experts": 64, + "load_cv": 0.5083811484526122, + "normalized_load_entropy": 0.9667276100843225, + "max_load_share": 0.03387533875338753 + }, + "full_input": { + "tokens": 287, + "top_k": 6, + "decisions": 1722, + "ordered_route_sha256": "9fdbffdb73316bf97e8d0c8caf14c5785ce3cdab4f357ebfe0a9025b5beaa512", + "route_weight_sha256": "1a77d51f37ce7a79d9fe0e8efc27aff7e9861490c4b7d85956fabccba923a85b", + "loads": [ + 19, + 14, + 17, + 18, + 13, + 31, + 15, + 29, + 26, + 47, + 18, + 18, + 32, + 34, + 34, + 34, + 23, + 24, + 37, + 25, + 34, + 24, + 29, + 34, + 51, + 24, + 38, + 31, + 39, + 44, + 21, + 8, + 21, + 43, + 15, + 16, + 10, + 29, + 16, + 26, + 31, + 18, + 47, + 39, + 23, + 27, + 20, + 21, + 16, + 16, + 18, + 10, + 21, + 40, + 19, + 45, + 30, + 9, + 50, + 32, + 36, + 41, + 26, + 26 + ], + "weighted_loads": [ + 1.207936905324459, + 0.4730945834890008, + 1.4721537977457047, + 1.0359113346785307, + 0.6014580567134544, + 2.671814324334264, + 1.3519321382045746, + 1.9626182881183922, + 1.3909291510935873, + 3.1731473822146654, + 1.0445160996168852, + 1.172908402979374, + 2.4933530390262604, + 2.4490050300955772, + 1.7672993652522564, + 4.234904394019395, + 1.607313510030508, + 1.3779282458126545, + 2.6806049589067698, + 1.4603336984291673, + 1.9987589821685106, + 1.6345667410641909, + 2.200391322374344, + 2.140461277216673, + 4.236120779067278, + 1.691190481185913, + 3.056286059319973, + 2.6118243411183357, + 2.8921225499361753, + 3.5067093409597874, + 1.4422530811280012, + 0.2887801881879568, + 0.9255740735679865, + 2.5100822560489178, + 0.8354287408292294, + 1.164122574031353, + 0.6247737817466259, + 2.1014049518853426, + 1.358721099793911, + 2.3557124696671963, + 3.1223918180912733, + 1.4650133606046438, + 4.2704869620501995, + 2.8137819170951843, + 1.3290321119129658, + 1.9981358498334885, + 1.0355829671025276, + 1.2553822344634682, + 1.388586137443781, + 0.9094038372859359, + 1.4642847776412964, + 0.7808872908353806, + 2.5794588699936867, + 2.4712473284453154, + 1.7239151422400028, + 3.4291800931096077, + 2.1499485075473785, + 0.48669155314564705, + 4.326112203299999, + 2.242263726890087, + 3.354393385350704, + 3.4853775203227997, + 1.6268521081656218, + 3.027594778686762 + ], + "unique_experts": 64, + "load_cv": 0.39925002636552676, + "normalized_load_entropy": 0.9806165267244075, + "max_load_share": 0.029616724738675958 + } + }, + "s0_bos": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "082e09ef563daf3a4c2f916fbde704c4b0c5bf6d79c86ca4c61764b2417f80de", + "route_weight_sha256": "146c411557cf5ec4598777be9d7e0d306c28e2843d3a7b628e09111eac71f902", + "loads": [ + 16, + 12, + 21, + 11, + 12, + 28, + 6, + 25, + 23, + 46, + 6, + 17, + 26, + 34, + 34, + 21, + 20, + 12, + 27, + 13, + 29, + 23, + 28, + 32, + 51, + 17, + 38, + 29, + 41, + 41, + 22, + 8, + 22, + 42, + 14, + 14, + 9, + 27, + 2, + 13, + 26, + 4, + 35, + 33, + 25, + 28, + 18, + 20, + 15, + 3, + 7, + 9, + 20, + 27, + 15, + 37, + 31, + 10, + 47, + 31, + 35, + 40, + 27, + 21 + ], + "weighted_loads": [ + 1.1001177784055471, + 0.4365490674972534, + 1.6396307684481144, + 0.590930363163352, + 0.5829961821436882, + 2.5137908905744553, + 0.30720688588917255, + 1.9064054172486067, + 1.335009355098009, + 3.1567795872688293, + 0.27800923585891724, + 0.8664158433675766, + 1.977225013077259, + 2.4449917674064636, + 1.7177453972399235, + 1.8292607981711626, + 1.4029655829071999, + 0.6716288141906261, + 1.5329446010291576, + 0.5840286798775196, + 1.8198905568569899, + 1.60741794295609, + 2.1805828772485256, + 2.036016196012497, + 4.258308527991176, + 1.0071776397526264, + 2.9836019463837147, + 2.4790090695023537, + 3.053082372993231, + 3.3975995369255543, + 1.5028001684695482, + 0.28545866534113884, + 0.8873813450336456, + 2.58014789968729, + 0.8000315576791763, + 0.7882036436349154, + 0.5832458548247814, + 1.9768130537122488, + 0.07394780218601227, + 1.12770277261734, + 2.9642167314887047, + 0.15202351845800877, + 3.453328985720873, + 2.471733160316944, + 1.431225411593914, + 2.0394280832260847, + 0.9649222996085882, + 1.2603659182786942, + 1.3579497672617435, + 0.12146954610943794, + 0.36710697785019875, + 0.7608886919915676, + 0.9616798870265484, + 1.5370168685913086, + 1.6963993720710278, + 2.8939090501517057, + 2.163074992597103, + 0.5305315610021353, + 4.207828365266323, + 2.192429054528475, + 3.316647380590439, + 3.5085726752877235, + 1.6860994771122932, + 1.7990995906293392 + ], + "unique_experts": 64, + "load_cv": 0.5052511033615078, + "normalized_load_entropy": 0.9669961782331932, + "max_load_share": 0.034552845528455285 + }, + "full_input": { + "tokens": 271, + "top_k": 6, + "decisions": 1626, + "ordered_route_sha256": "98ba5cd8b785cf6ab8d165eef540aad6393734bcb10e8127aee79cf581df8554", + "route_weight_sha256": "32e580a2be80695387df63bd7c140cf5751141b345d1435ca3d2aa4d5ba24cbd", + "loads": [ + 16, + 13, + 21, + 11, + 12, + 29, + 7, + 27, + 24, + 47, + 18, + 17, + 29, + 34, + 34, + 35, + 22, + 18, + 37, + 14, + 30, + 23, + 28, + 32, + 51, + 25, + 38, + 29, + 41, + 41, + 22, + 8, + 22, + 42, + 14, + 18, + 9, + 27, + 14, + 22, + 30, + 12, + 43, + 35, + 26, + 28, + 18, + 21, + 15, + 7, + 14, + 9, + 21, + 36, + 17, + 47, + 31, + 10, + 47, + 32, + 35, + 41, + 27, + 23 + ], + "weighted_loads": [ + 1.1001177784055471, + 0.4400845787022263, + 1.6396307684481144, + 0.590930363163352, + 0.5829961821436882, + 2.550628688186407, + 0.339288791641593, + 1.952676177257672, + 1.3383796156849712, + 3.1930992640554905, + 0.992984464392066, + 0.8664158433675766, + 2.177203170955181, + 2.4449917674064636, + 1.7177453972399235, + 4.010645234491676, + 1.5510258451104164, + 0.9696560129523277, + 2.5744035243988037, + 0.5971191795542836, + 1.832455542869866, + 1.60741794295609, + 2.1805828772485256, + 2.036016196012497, + 4.258308527991176, + 1.9092190079391003, + 2.9836019463837147, + 2.4790090695023537, + 3.053082372993231, + 3.3975995369255543, + 1.5028001684695482, + 0.28545866534113884, + 0.8873813450336456, + 2.58014789968729, + 0.8000315576791763, + 1.0994596537202597, + 0.5832458548247814, + 1.9768130537122488, + 1.2900405935943127, + 1.8679096922278404, + 3.1400518156588078, + 1.002677271142602, + 3.992556009441614, + 2.574668265879154, + 1.5131347179412842, + 2.0394280832260847, + 0.9649222996085882, + 1.2759499242529273, + 1.3579497672617435, + 0.30724776443094015, + 0.9346891976892948, + 0.7608886919915676, + 1.6261505596339703, + 2.131243009120226, + 1.711405768059194, + 3.5854378137737513, + 2.163074992597103, + 0.5305315610021353, + 4.207828365266323, + 2.2383926808834076, + 3.316647380590439, + 3.545424710959196, + 1.6860994771122932, + 2.734379652887583 + ], + "unique_experts": 64, + "load_cv": 0.4425703221525526, + "normalized_load_entropy": 0.9757340190636532, + "max_load_share": 0.03136531365313653 + } + }, + "s1_bos": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "76b09eb9cb28f5757362ca73bd33e0f000d315ef45988133ea348d7730112c85", + "route_weight_sha256": "39f1a38b24818bb17614e5cef8b31656a452e4237f7ddde8ffd5ad8d9e189d26", + "loads": [ + 17, + 12, + 20, + 11, + 12, + 28, + 7, + 25, + 23, + 45, + 4, + 16, + 26, + 33, + 34, + 21, + 20, + 17, + 25, + 13, + 32, + 25, + 28, + 34, + 50, + 16, + 41, + 29, + 38, + 41, + 20, + 9, + 25, + 44, + 13, + 13, + 8, + 26, + 2, + 12, + 24, + 4, + 36, + 33, + 24, + 29, + 19, + 22, + 14, + 3, + 6, + 10, + 19, + 27, + 16, + 36, + 28, + 9, + 48, + 32, + 35, + 40, + 26, + 21 + ], + "weighted_loads": [ + 1.1328130885958672, + 0.44851225055754185, + 1.6080311182886362, + 0.5892686638981104, + 0.5789921917021275, + 2.4875095076858997, + 0.3334519360214472, + 1.8796184323728085, + 1.3256600461900234, + 3.1464696303009987, + 0.2230152115225792, + 0.8457814157009125, + 1.9767561703920364, + 2.437448963522911, + 1.6908415462821722, + 1.8810923229902983, + 1.4206712320446968, + 0.9088201932609081, + 1.42123581469059, + 0.573946125805378, + 1.9183996059000492, + 1.6860104389488697, + 2.1962049156427383, + 2.1125725619494915, + 4.283868446946144, + 0.9659972507506609, + 3.1660741716623306, + 2.462766433134675, + 2.896530006080866, + 3.3706054501235485, + 1.4531397372484207, + 0.33708757907152176, + 1.0198168084025383, + 2.6433003786951303, + 0.7735241241753101, + 0.7798684183508158, + 0.5485228709876537, + 1.961876142770052, + 0.0705883838236332, + 0.973712868988514, + 3.000799221917987, + 0.14935548789799213, + 3.4738484509289265, + 2.509171422570944, + 1.3997184708714485, + 2.105468897148967, + 1.0360965467989445, + 1.3279338013380766, + 1.3208719044923782, + 0.11678279563784599, + 0.3432637155056, + 0.794132549315691, + 0.9038969539105892, + 1.5690058954060078, + 1.7345436215400696, + 2.735851414501667, + 2.0582199711352587, + 0.5041490960866213, + 4.264299392700195, + 2.2212680727243423, + 3.321171097457409, + 3.494862115010619, + 1.660694669932127, + 1.826638374477625 + ], + "unique_experts": 64, + "load_cv": 0.5085544749849497, + "normalized_load_entropy": 0.9663908357950404, + "max_load_share": 0.03387533875338753 + }, + "full_input": { + "tokens": 287, + "top_k": 6, + "decisions": 1722, + "ordered_route_sha256": "6a34a543c8e0dc14faadcacfb249e1b3d550e7e5d3c46fe58faa10c03122bfa1", + "route_weight_sha256": "045d329abe8ecf5edcbc3fb79fafbd180f3572c8742ca5fdd2e3c4bf81c29e20", + "loads": [ + 18, + 14, + 20, + 17, + 12, + 30, + 15, + 28, + 24, + 45, + 19, + 19, + 31, + 33, + 34, + 37, + 24, + 28, + 39, + 23, + 33, + 25, + 29, + 34, + 51, + 24, + 41, + 31, + 38, + 43, + 20, + 9, + 26, + 45, + 14, + 17, + 9, + 29, + 15, + 24, + 27, + 17, + 48, + 38, + 25, + 29, + 19, + 24, + 14, + 16, + 17, + 11, + 20, + 37, + 19, + 47, + 28, + 9, + 49, + 33, + 36, + 41, + 26, + 25 + ], + "weighted_loads": [ + 1.169323991984129, + 0.4724530568346381, + 1.6080311182886362, + 0.9964475426822901, + 0.5789921917021275, + 2.5616805367171764, + 1.3273362051695585, + 1.9780265134759247, + 1.3290309382136911, + 3.1464696303009987, + 1.1176829729229212, + 1.2108652293682098, + 2.4063762575387955, + 2.437448963522911, + 1.6908415462821722, + 4.575550718698651, + 1.691334992647171, + 1.589364517480135, + 2.835174072533846, + 1.4075149418786168, + 1.9309645919129252, + 1.6860104389488697, + 2.2344965413212776, + 2.1125725619494915, + 4.359242282807827, + 1.6852734573185444, + 3.1660741716623306, + 2.637436443939805, + 2.896530006080866, + 3.45793354511261, + 1.4531397372484207, + 0.33708757907152176, + 1.1386091709136963, + 2.685706650838256, + 0.8082081638276577, + 1.2171434480696917, + 0.5941194854676723, + 2.113476011902094, + 1.4206614531576633, + 2.1075917929410934, + 3.125286215916276, + 1.4317786525934935, + 4.289040792733431, + 2.8018177524209023, + 1.4612050279974937, + 2.105468897148967, + 1.0360965467989445, + 1.3766787061467767, + 1.3208719044923782, + 0.9088221965357661, + 1.435279119759798, + 0.8422868847846985, + 1.568367626518011, + 2.373573426157236, + 1.787793766707182, + 3.375559788197279, + 2.0582199711352587, + 0.5041490960866213, + 4.3309338465332985, + 2.2686147801578045, + 3.367091055959463, + 3.5337250251322985, + 1.660694669932127, + 3.0046087503433228 + ], + "unique_experts": 64, + "load_cv": 0.40108382399318815, + "normalized_load_entropy": 0.9804265528628288, + "max_load_share": 0.029616724738675958 + } + }, + "s0_x": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "388a54a14512b7f8495ca57da6e16616b53fb9da0a2ed344a3449c86a7ea4288", + "route_weight_sha256": "68f045af1207597684953b13e81416e5a332d7a6b0298991114c9c37227ac461", + "loads": [ + 15, + 13, + 19, + 12, + 12, + 29, + 5, + 26, + 25, + 46, + 7, + 16, + 25, + 34, + 36, + 23, + 20, + 12, + 26, + 16, + 31, + 23, + 28, + 34, + 51, + 17, + 39, + 29, + 37, + 41, + 23, + 9, + 24, + 41, + 14, + 13, + 9, + 25, + 3, + 13, + 24, + 3, + 35, + 33, + 25, + 27, + 18, + 17, + 14, + 4, + 7, + 10, + 19, + 29, + 15, + 36, + 30, + 10, + 47, + 32, + 35, + 40, + 26, + 19 + ], + "weighted_loads": [ + 1.0559430960565805, + 0.4797685109078884, + 1.5734863765537739, + 0.6277408003807068, + 0.5729212202131748, + 2.57386639341712, + 0.27161020413041115, + 1.8896688185632229, + 1.398674588650465, + 3.1795249208807945, + 0.3178948927670717, + 0.8448877073824406, + 1.9590470641851425, + 2.4937335066497326, + 1.7871647961437702, + 1.897541381418705, + 1.403456024825573, + 0.6704360954463482, + 1.5453610178083181, + 0.6891204677522182, + 1.8851299621164799, + 1.6017670407891273, + 2.197317361831665, + 2.1025513112545013, + 4.3012659549713135, + 1.0688147712498903, + 3.0643533635884523, + 2.4542065616697073, + 2.8625973127782345, + 3.431107562035322, + 1.5339735802263021, + 0.3303676303476095, + 0.954455217346549, + 2.5194279477000237, + 0.8279963247478008, + 0.7409436963498592, + 0.5969591923058033, + 1.9198543652892113, + 0.10189532488584518, + 1.125825885683298, + 2.7106570210307837, + 0.11227311193943024, + 3.4210244975984097, + 2.4437156431376934, + 1.4500245563685894, + 2.020864659920335, + 0.9915878772735596, + 1.1644216887652874, + 1.306575931608677, + 0.15149023570120335, + 0.37842025235295296, + 0.7863451912999153, + 0.9221671018749475, + 1.6071865446865559, + 1.690463338047266, + 2.9054638259112835, + 2.136888550594449, + 0.5418916903436184, + 4.2238554880023, + 2.1817139498889446, + 3.3232334703207016, + 3.4365415312349796, + 1.6512230467051268, + 1.7061524391174316 + ], + "unique_experts": 64, + "load_cv": 0.5016332634439788, + "normalized_load_entropy": 0.9677038496572593, + "max_load_share": 0.034552845528455285 + }, + "full_input": { + "tokens": 271, + "top_k": 6, + "decisions": 1626, + "ordered_route_sha256": "02c8ca6cec29faea80c8ade44c209cd3b27d9dbafe66ca4cba6a2669be459359", + "route_weight_sha256": "c4b98c2c914739ab5929379fcf092421b2c37bdeddc96fd157622e94b282158e", + "loads": [ + 15, + 15, + 19, + 12, + 12, + 30, + 6, + 28, + 26, + 46, + 20, + 16, + 28, + 34, + 36, + 37, + 22, + 18, + 35, + 17, + 32, + 23, + 28, + 34, + 51, + 26, + 39, + 29, + 37, + 41, + 23, + 9, + 24, + 41, + 14, + 17, + 9, + 25, + 13, + 21, + 30, + 11, + 42, + 35, + 26, + 27, + 18, + 18, + 14, + 7, + 14, + 10, + 20, + 40, + 17, + 46, + 30, + 10, + 47, + 33, + 35, + 41, + 26, + 21 + ], + "weighted_loads": [ + 1.0559430960565805, + 0.5198163336608559, + 1.5734863765537739, + 0.6277408003807068, + 0.5729212202131748, + 2.610704191029072, + 0.3036921098828316, + 1.9354684597346932, + 1.4020448492374271, + 3.1795249208807945, + 1.1448136121034622, + 0.8448877073824406, + 2.1680919229984283, + 2.4937335066497326, + 1.7871647961437702, + 4.25897142989561, + 1.5517819076776505, + 0.9684632942080498, + 2.4651277493685484, + 0.7022109674289823, + 1.897694948129356, + 1.6017670407891273, + 2.197317361831665, + 2.1025513112545013, + 4.3012659549713135, + 2.0569589156657457, + 3.0643533635884523, + 2.4542065616697073, + 2.8625973127782345, + 3.431107562035322, + 1.5339735802263021, + 0.3303676303476095, + 0.954455217346549, + 2.5194279477000237, + 0.8279963247478008, + 1.0521997064352036, + 0.5969591923058033, + 1.9198543652892113, + 1.0023378282785416, + 1.8369512595236301, + 3.0015279594808817, + 0.9196169003844261, + 3.8544942401349545, + 2.5479607209563255, + 1.5319338627159595, + 2.020864659920335, + 0.9915878772735596, + 1.1800056947395205, + 1.306575931608677, + 0.3003609860315919, + 0.9283700622618198, + 0.7863451912999153, + 1.5866377744823694, + 2.3154809884727, + 1.7054697340354323, + 3.670788023620844, + 2.136888550594449, + 0.5418916903436184, + 4.2238554880023, + 2.2276775762438774, + 3.3232334703207016, + 3.4736194908618927, + 1.6512230467051268, + 2.641432501375675 + ], + "unique_experts": 64, + "load_cv": 0.4418039127196893, + "normalized_load_entropy": 0.9757667038093175, + "max_load_share": 0.03136531365313653 + } + }, + "s1_x": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "663305dd0e82284db191fb5644e2f3d9db650ce75e3647562d7ae21864145607", + "route_weight_sha256": "4b8c713ad55c5dfbeff4b6a973a989a93fdee27078b422065ab14e3aac696f23", + "loads": [ + 17, + 13, + 18, + 11, + 12, + 29, + 7, + 25, + 26, + 45, + 6, + 16, + 25, + 33, + 33, + 21, + 20, + 17, + 21, + 17, + 32, + 24, + 28, + 34, + 50, + 17, + 41, + 29, + 34, + 41, + 21, + 9, + 25, + 45, + 13, + 12, + 8, + 26, + 2, + 12, + 27, + 3, + 35, + 34, + 24, + 29, + 18, + 20, + 16, + 3, + 6, + 10, + 18, + 30, + 16, + 35, + 29, + 9, + 47, + 32, + 35, + 40, + 26, + 19 + ], + "weighted_loads": [ + 1.127731878310442, + 0.4836653843522072, + 1.540607599541545, + 0.5924565196037292, + 0.5804431680589914, + 2.5710165463387966, + 0.32454573176801205, + 1.8563939165323973, + 1.410876352339983, + 3.1735584996640682, + 0.2912164516746998, + 0.8421347327530384, + 1.9262527823448181, + 2.4531857073307037, + 1.6526759080588818, + 1.9029437247663736, + 1.4274081625044346, + 0.9103289470076561, + 1.2948433198034763, + 0.7149444706737995, + 1.9378431234508753, + 1.6384625844657421, + 2.2154657021164894, + 2.0961198806762695, + 4.331726482138038, + 1.0329627953469753, + 3.1730329617857933, + 2.4664678294211626, + 2.7596588358283043, + 3.36084508523345, + 1.4785970784723759, + 0.34301168471574783, + 1.0213136691600084, + 2.6760183814913034, + 0.7727821208536625, + 0.7294729854911566, + 0.5438363291323185, + 1.9642688278108835, + 0.07059307768940926, + 0.9427371881902218, + 2.9170772414654493, + 0.10954098403453827, + 3.4073755834251642, + 2.4895308911800385, + 1.4141377694904804, + 2.143221251666546, + 0.9834227673709393, + 1.2781501542776823, + 1.3841905444860458, + 0.11823666095733643, + 0.3538665510714054, + 0.7897324673831463, + 0.8690557181835175, + 1.670252125710249, + 1.743536863476038, + 2.742822539061308, + 2.087899539619684, + 0.5031673572957516, + 4.243175268173218, + 2.2192236948758364, + 3.3427716344594955, + 3.473954491317272, + 1.669820986688137, + 1.7603182028979063 + ], + "unique_experts": 64, + "load_cv": 0.5032703471251985, + "normalized_load_entropy": 0.9670818208834395, + "max_load_share": 0.03387533875338753 + }, + "full_input": { + "tokens": 287, + "top_k": 6, + "decisions": 1722, + "ordered_route_sha256": "55993aceba34160975d15dfd431b2d8b14e6a2d6f1347de8bc20cf664ab93243", + "route_weight_sha256": "d2fb01e1b38bd5f672f4d4eef7ed0712cb33511f4b02aa58217bed63fd2413b1", + "loads": [ + 18, + 15, + 18, + 17, + 12, + 31, + 15, + 28, + 27, + 45, + 22, + 19, + 30, + 33, + 33, + 37, + 24, + 28, + 35, + 27, + 33, + 24, + 29, + 34, + 51, + 26, + 41, + 31, + 34, + 43, + 21, + 9, + 26, + 47, + 14, + 17, + 9, + 29, + 12, + 24, + 31, + 15, + 46, + 39, + 25, + 29, + 18, + 22, + 16, + 16, + 15, + 11, + 19, + 42, + 19, + 46, + 29, + 9, + 48, + 33, + 36, + 41, + 26, + 23 + ], + "weighted_loads": [ + 1.1642427816987038, + 0.5076061906293035, + 1.540607599541545, + 0.9996353983879089, + 0.5804431680589914, + 2.6451875753700733, + 1.3184300009161234, + 1.9513726853765547, + 1.4142472443636507, + 3.1735584996640682, + 1.2893608715385199, + 1.2072185464203358, + 2.3691366277635098, + 2.4531857073307037, + 1.6526759080588818, + 4.78903184691444, + 1.7112364284694195, + 1.590873271226883, + 2.579132165759802, + 1.5485132867470384, + 1.9504081094637513, + 1.6384625844657421, + 2.2537573277950287, + 2.0961198806762695, + 4.407100317999721, + 1.8309423830360174, + 3.1730329617857933, + 2.6411378402262926, + 2.7596588358283043, + 3.4481731802225113, + 1.4785970784723759, + 0.34301168471574783, + 1.1401060316711664, + 2.761480001732707, + 0.8074661605060101, + 1.2125350926071405, + 0.5894329436123371, + 2.1158686969429255, + 1.0662706196308136, + 2.090057637542486, + 3.1154932249337435, + 1.3084343560039997, + 4.132271403446794, + 2.7813253104686737, + 1.4756243266165257, + 2.143221251666546, + 0.9834227673709393, + 1.3268950590863824, + 1.3841905444860458, + 0.9068054249510169, + 1.3415810652077198, + 0.8378868028521538, + 1.5335263907909393, + 2.587043758481741, + 1.7967870086431503, + 3.4545107446610928, + 2.087899539619684, + 0.5031673572957516, + 4.309809722006321, + 2.2665704023092985, + 3.3886915929615498, + 3.5112623423337936, + 1.669820986688137, + 2.938288578763604 + ], + "unique_experts": 64, + "load_cv": 0.40172904811355037, + "normalized_load_entropy": 0.9802177132840797, + "max_load_share": 0.029616724738675958 + } + }, + "s0_period": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "0ec0034e2317834fa738a2fc34c1798928b21ba21e1f9580c6f6a61310a8c918", + "route_weight_sha256": "b3cad538d6c2623b6ef1a4863bb885862a4c1c795cb3f26a3ac6f31669476b64", + "loads": [ + 15, + 13, + 20, + 12, + 12, + 28, + 5, + 26, + 24, + 47, + 7, + 17, + 26, + 34, + 35, + 21, + 20, + 12, + 26, + 15, + 31, + 23, + 28, + 34, + 51, + 17, + 39, + 29, + 37, + 41, + 22, + 9, + 24, + 42, + 14, + 13, + 9, + 24, + 3, + 13, + 24, + 3, + 34, + 33, + 24, + 28, + 20, + 17, + 14, + 4, + 7, + 10, + 20, + 30, + 16, + 36, + 30, + 10, + 47, + 31, + 35, + 40, + 27, + 18 + ], + "weighted_loads": [ + 1.0655808430165052, + 0.4760169666260481, + 1.6049624420702457, + 0.6313866227865219, + 0.580228079110384, + 2.531273763626814, + 0.270775618031621, + 1.8992392644286156, + 1.3672405034303665, + 3.2226337529718876, + 0.32650299556553364, + 0.8777537867426872, + 1.9961534924805164, + 2.4799827858805656, + 1.7556368932127953, + 1.7779777571558952, + 1.395639430731535, + 0.6690576151013374, + 1.5201853830367327, + 0.648262120783329, + 1.892069336026907, + 1.601312818005681, + 2.189789053052664, + 2.0991491116583347, + 4.307192876935005, + 1.0685251001268625, + 3.057166863232851, + 2.438705313950777, + 2.8635192029178143, + 3.433180343359709, + 1.5166084542870522, + 0.3364874627441168, + 0.9500564653426409, + 2.5599502362310886, + 0.8259703740477562, + 0.7230758294463158, + 0.5971278436481953, + 1.8706455864012241, + 0.10379684343934059, + 1.1312603428959846, + 2.7388300392776728, + 0.11419383808970451, + 3.3776002284139395, + 2.430936351418495, + 1.4100422859191895, + 2.0605463720858097, + 1.0531807485967875, + 1.1667558625340462, + 1.3002179935574532, + 0.15112894400954247, + 0.3685888200998306, + 0.7854169309139252, + 0.968561751767993, + 1.639434551820159, + 1.728039875626564, + 2.87891130335629, + 2.1409165486693382, + 0.5381555240601301, + 4.224069856107235, + 2.1597609408199787, + 3.3216744139790535, + 3.473217476159334, + 1.6800961792469025, + 1.6758170239627361 + ], + "unique_experts": 64, + "load_cv": 0.501750375130506, + "normalized_load_entropy": 0.9677539375198753, + "max_load_share": 0.034552845528455285 + }, + "full_input": { + "tokens": 271, + "top_k": 6, + "decisions": 1626, + "ordered_route_sha256": "2f99878e0eb5b624b82f056828ce518ef39076a5bdbdf044e4646ecf601189ca", + "route_weight_sha256": "802362a8c61812b20a4bff5a6fa6389700ade68a9279b139eacbccfd83b27804", + "loads": [ + 15, + 15, + 20, + 12, + 12, + 29, + 6, + 28, + 25, + 47, + 20, + 17, + 29, + 34, + 35, + 35, + 23, + 19, + 35, + 16, + 32, + 23, + 28, + 34, + 51, + 25, + 39, + 29, + 37, + 41, + 22, + 9, + 24, + 42, + 14, + 18, + 9, + 24, + 13, + 21, + 29, + 11, + 41, + 35, + 26, + 28, + 20, + 18, + 14, + 7, + 14, + 10, + 21, + 39, + 18, + 46, + 30, + 10, + 47, + 32, + 35, + 41, + 27, + 20 + ], + "weighted_loads": [ + 1.0655808430165052, + 0.5167040715459734, + 1.6049624420702457, + 0.6313866227865219, + 0.580228079110384, + 2.5681115612387657, + 0.3028575237840414, + 1.9451166375074536, + 1.3706107640173286, + 3.2226337529718876, + 1.1437380984425545, + 0.8777537867426872, + 2.198860425502062, + 2.4799827858805656, + 1.7556368932127953, + 3.9680295805446804, + 1.5808578208088875, + 1.0244136303663254, + 2.3886180389672518, + 0.661352620460093, + 1.904634322039783, + 1.601312818005681, + 2.189789053052664, + 2.0991491116583347, + 4.307192876935005, + 1.9705664683133364, + 3.057166863232851, + 2.438705313950777, + 2.8635192029178143, + 3.433180343359709, + 1.5166084542870522, + 0.3364874627441168, + 0.9500564653426409, + 2.5599502362310886, + 0.8259703740477562, + 1.0860802568495274, + 0.5971278436481953, + 1.8706455864012241, + 0.972045324742794, + 1.8344864509999752, + 2.971612362191081, + 0.9580486305058002, + 3.8185174595564604, + 2.5274370908737183, + 1.5465421862900257, + 2.0605463720858097, + 1.0531807485967875, + 1.1823398685082793, + 1.3002179935574532, + 0.29798883851617575, + 0.9376734122633934, + 0.7854169309139252, + 1.6330324243754148, + 2.2336606923490763, + 1.7430462716147304, + 3.7716814819723368, + 2.1409165486693382, + 0.5381555240601301, + 4.224069856107235, + 2.2057245671749115, + 3.3216744139790535, + 3.5104021951556206, + 1.6800961792469025, + 2.6110970862209797 + ], + "unique_experts": 64, + "load_cv": 0.4377306003038947, + "normalized_load_entropy": 0.9762188743467585, + "max_load_share": 0.03136531365313653 + } + }, + "s1_period": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "c6a0fbb7fd41dfd2de44722aa7391dd10f59fd2fb5c24abb1ebea4083cba8999", + "route_weight_sha256": "45b0e46d16b00c1b0ef846142b67dd02cb8d37f9caedbbd1c73ef0be213f8099", + "loads": [ + 17, + 12, + 19, + 12, + 12, + 28, + 7, + 25, + 25, + 46, + 6, + 17, + 25, + 33, + 33, + 22, + 21, + 17, + 23, + 16, + 34, + 24, + 28, + 34, + 50, + 18, + 41, + 29, + 34, + 41, + 21, + 9, + 25, + 44, + 14, + 10, + 8, + 25, + 2, + 12, + 26, + 3, + 34, + 33, + 24, + 29, + 18, + 18, + 16, + 3, + 6, + 10, + 18, + 31, + 16, + 36, + 28, + 9, + 47, + 32, + 35, + 40, + 26, + 19 + ], + "weighted_loads": [ + 1.123340480029583, + 0.4482265803962946, + 1.5683244317770004, + 0.6362482085824013, + 0.5801787972450256, + 2.557984009385109, + 0.3218356631696224, + 1.8620647545903921, + 1.3749796133488417, + 3.1842435766011477, + 0.30323857069015503, + 0.8860160615295172, + 1.9300146959722042, + 2.4442450180649757, + 1.6557817868888378, + 1.9190461821854115, + 1.4630147740244865, + 0.9033582229167223, + 1.3812044076621532, + 0.6805398147553205, + 1.9994481597095728, + 1.646489080041647, + 2.2070601396262646, + 2.0943291038274765, + 4.333750568330288, + 1.0697079040110111, + 3.167268892750144, + 2.4617791771888733, + 2.756763882935047, + 3.3601954728364944, + 1.4833838324993849, + 0.3487612009048462, + 1.0175118315964937, + 2.635324938222766, + 0.8135197721421719, + 0.640358205884695, + 0.542554710060358, + 1.919050233438611, + 0.07086936011910439, + 0.9500065483152866, + 2.9019180592149496, + 0.113118726760149, + 3.368248900398612, + 2.4565828386694193, + 1.412880428135395, + 2.145652014762163, + 0.9828508645296097, + 1.2114857323467731, + 1.3764846287667751, + 0.11662929877638817, + 0.3467692583799362, + 0.7884087301790714, + 0.8737911116331816, + 1.715947974473238, + 1.7357836998999119, + 2.7583689466118813, + 2.066265158355236, + 0.5046965125948191, + 4.249868720769882, + 2.202139411121607, + 3.3480633161962032, + 3.501455742865801, + 1.6687642186880112, + 1.775787115097046 + ], + "unique_experts": 64, + "load_cv": 0.5035621234474312, + "normalized_load_entropy": 0.9670194102396275, + "max_load_share": 0.03387533875338753 + }, + "full_input": { + "tokens": 287, + "top_k": 6, + "decisions": 1722, + "ordered_route_sha256": "96cd2fd38e1b9b0e002e9c6715f06566fd36b8a06da67a34f679b08bb7b825ee", + "route_weight_sha256": "bc6b85c116f7eb0915901c27bae7218a3043150410f2060cfb5370130fb63f3c", + "loads": [ + 18, + 14, + 19, + 18, + 12, + 31, + 15, + 28, + 26, + 46, + 22, + 20, + 30, + 33, + 33, + 39, + 25, + 29, + 36, + 26, + 35, + 24, + 29, + 34, + 51, + 26, + 41, + 31, + 34, + 43, + 21, + 9, + 26, + 45, + 15, + 15, + 9, + 28, + 12, + 24, + 30, + 16, + 45, + 38, + 26, + 29, + 18, + 20, + 16, + 16, + 15, + 11, + 19, + 41, + 19, + 47, + 28, + 9, + 48, + 33, + 36, + 41, + 26, + 23 + ], + "weighted_loads": [ + 1.1598513834178448, + 0.47216738667339087, + 1.5683244317770004, + 1.043427087366581, + 0.5801787972450256, + 2.676869735121727, + 1.3157199323177338, + 1.9569233977235854, + 1.3783505053725094, + 3.1842435766011477, + 1.3130181934684515, + 1.2510998751968145, + 2.371934585273266, + 2.4442450180649757, + 1.6557817868888378, + 4.679877490270883, + 1.7681771665811539, + 1.625811105594039, + 2.5848300978541374, + 1.5141086308285594, + 2.012013145722449, + 1.646489080041647, + 2.245351765304804, + 2.0943291038274765, + 4.409124404191971, + 1.7889841105788946, + 3.167268892750144, + 2.6364491879940033, + 2.756763882935047, + 3.447523567825556, + 1.4833838324993849, + 0.3487612009048462, + 1.1363041941076517, + 2.6777312103658915, + 0.8482038117945194, + 1.1572236903011799, + 0.5881513245403767, + 2.070650102570653, + 1.0289235152304173, + 2.091761212795973, + 3.077663516625762, + 1.4258716404438019, + 4.112073851749301, + 2.746166566386819, + 1.5194383524358273, + 2.145652014762163, + 0.9828508645296097, + 1.2602306371554732, + 1.3764846287667751, + 0.9022974064573646, + 1.333192802965641, + 0.8365630656480789, + 1.5382617842406034, + 2.5205155052244663, + 1.7890338450670242, + 3.556144405156374, + 2.066265158355236, + 0.5046965125948191, + 4.316503174602985, + 2.249486118555069, + 3.3939832746982574, + 3.5394715815782547, + 1.6687642186880112, + 2.9537574909627438 + ], + "unique_experts": 64, + "load_cv": 0.4011376323093697, + "normalized_load_entropy": 0.9802628264709231, + "max_load_share": 0.029616724738675958 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 246, + "ordered_topk_exact_tokens": 201, + "set_exact_tokens": 217, + "mean_set_jaccard": 0.964576074332172, + "mean_token_weighted_tv": 0.008186630870601752, + "aggregate_load_tv": 0.012872628726287264 + }, + "system_bos": { + "tokens": 246, + "ordered_topk_exact_tokens": 179, + "set_exact_tokens": 200, + "mean_set_jaccard": 0.9448315911730547, + "mean_token_weighted_tv": 0.013392232172948316, + "aggregate_load_tv": 0.021680216802168018 + }, + "system_x": { + "tokens": 246, + "ordered_topk_exact_tokens": 161, + "set_exact_tokens": 189, + "mean_set_jaccard": 0.931184668989547, + "mean_token_weighted_tv": 0.01661321485218236, + "aggregate_load_tv": 0.023035230352303523 + }, + "system_period": { + "tokens": 246, + "ordered_topk_exact_tokens": 166, + "set_exact_tokens": 192, + "mean_set_jaccard": 0.9364111498257839, + "mean_token_weighted_tv": 0.015626603919194966, + "aggregate_load_tv": 0.02235772357723577 + }, + "bos_at_s0": { + "tokens": 246, + "ordered_topk_exact_tokens": 149, + "set_exact_tokens": 181, + "mean_set_jaccard": 0.9218931475029034, + "mean_token_weighted_tv": 0.019311077169680255, + "aggregate_load_tv": 0.02777777777777778 + }, + "bos_at_s1": { + "tokens": 246, + "ordered_topk_exact_tokens": 139, + "set_exact_tokens": 171, + "mean_set_jaccard": 0.906794425087108, + "mean_token_weighted_tv": 0.022799980565451267, + "aggregate_load_tv": 0.02506775067750677 + }, + "x_at_s0": { + "tokens": 246, + "ordered_topk_exact_tokens": 148, + "set_exact_tokens": 187, + "mean_set_jaccard": 0.9288617886178862, + "mean_token_weighted_tv": 0.018394549271258397, + "aggregate_load_tv": 0.02506775067750678 + }, + "x_at_s1": { + "tokens": 246, + "ordered_topk_exact_tokens": 139, + "set_exact_tokens": 168, + "mean_set_jaccard": 0.8984707704219899, + "mean_token_weighted_tv": 0.02506713506697518, + "aggregate_load_tv": 0.025745257452574527 + }, + "period_at_s0": { + "tokens": 246, + "ordered_topk_exact_tokens": 154, + "set_exact_tokens": 186, + "mean_set_jaccard": 0.926829268292683, + "mean_token_weighted_tv": 0.018204542562153522, + "aggregate_load_tv": 0.026422764227642278 + }, + "period_at_s1": { + "tokens": 246, + "ordered_topk_exact_tokens": 140, + "set_exact_tokens": 168, + "mean_set_jaccard": 0.9002129307007355, + "mean_token_weighted_tv": 0.024381129964580382, + "aggregate_load_tv": 0.02777777777777778 + } + } + }, + "layer_06": { + "layer": 6, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "3e7ea99738dc44dd882b4fdcb4197074872edb0796f785dd33da9f061029ce72", + "route_weight_sha256": "e6c2482c06f4baadacb7af4b558c0c6cda1a929c5282a5fa32890fc147e0a034", + "loads": [ + 5, + 23, + 5, + 24, + 7, + 6, + 24, + 35, + 31, + 21, + 17, + 29, + 33, + 25, + 0, + 5, + 24, + 14, + 32, + 7, + 14, + 27, + 28, + 12, + 5, + 15, + 35, + 22, + 37, + 21, + 40, + 24, + 21, + 16, + 33, + 3, + 25, + 28, + 30, + 6, + 16, + 34, + 12, + 12, + 44, + 18, + 8, + 17, + 28, + 51, + 15, + 23, + 14, + 9, + 53, + 18, + 23, + 11, + 13, + 24, + 13, + 92, + 88, + 31 + ], + "weighted_loads": [ + 0.3405451402068138, + 1.725314013659954, + 0.1906253695487976, + 1.2338994331657887, + 0.30275529995560646, + 0.40712541341781616, + 1.6505004204809666, + 2.13360682874918, + 3.263078136369586, + 1.768430095165968, + 1.0539303049445152, + 1.876198474317789, + 2.7069729901850224, + 1.935881121084094, + 0.0, + 0.17672446370124817, + 1.744145780801773, + 0.5406725872308016, + 2.7299547754228115, + 0.5323357321321964, + 0.7162442654371262, + 1.764263678342104, + 1.9229388386011124, + 0.8676039539277554, + 0.21715582348406315, + 0.7998856194317341, + 1.6111738625913858, + 2.6673499792814255, + 2.9378805104643106, + 1.4137354642152786, + 2.7633735574781895, + 1.6735859513282776, + 1.5430010575801134, + 0.7155630253255367, + 3.054304391145706, + 0.12766261585056782, + 1.898344561457634, + 1.9414083994925022, + 1.8010682221502066, + 0.2313210815191269, + 1.1047825682908297, + 3.082286225631833, + 0.8680511508136988, + 0.6575891599059105, + 2.9083290100097656, + 0.8793899603188038, + 0.3902577795088291, + 1.4123420640826225, + 2.5425118915736675, + 4.669436117634177, + 1.0309924744069576, + 2.194919928908348, + 1.1645050030201674, + 0.42358751222491264, + 3.6260112207382917, + 1.3542759381234646, + 1.8467843495309353, + 0.8824591506272554, + 0.5490352436900139, + 1.267753666266799, + 0.7374419290572405, + 6.873732205480337, + 6.603815946727991, + 2.6424172334372997 + ], + "unique_experts": 63, + "load_cv": 0.7200670008949626, + "normalized_load_entropy": 0.9460171607896014, + "max_load_share": 0.06233062330623306 + }, + "full_input": { + "tokens": 271, + "top_k": 6, + "decisions": 1626, + "ordered_route_sha256": "dc6ecc1f02714ad00b233cdc8103403e3fce8ba329916a138817dcef67fd80ee", + "route_weight_sha256": "fa759e582bdf8907b8c463510a988ebe97b5af9c66387fe21a43aafe8400338c", + "loads": [ + 5, + 26, + 5, + 24, + 8, + 6, + 32, + 35, + 31, + 21, + 17, + 35, + 33, + 27, + 2, + 5, + 29, + 15, + 32, + 15, + 15, + 30, + 31, + 13, + 5, + 16, + 35, + 22, + 37, + 24, + 40, + 24, + 23, + 16, + 34, + 9, + 25, + 37, + 30, + 15, + 16, + 39, + 14, + 12, + 44, + 23, + 20, + 19, + 32, + 51, + 23, + 30, + 14, + 10, + 53, + 28, + 33, + 11, + 13, + 33, + 13, + 92, + 88, + 31 + ], + "weighted_loads": [ + 0.3405451402068138, + 1.7958706514909863, + 0.1906253695487976, + 1.2338994331657887, + 0.33097376115620136, + 0.40712541341781616, + 2.517413452267647, + 2.13360682874918, + 3.263078136369586, + 1.768430095165968, + 1.0539303049445152, + 2.2606813441962004, + 2.7069729901850224, + 1.9639345612376928, + 0.16021502763032913, + 0.17672446370124817, + 2.065921165049076, + 0.544708323199302, + 2.7299547754228115, + 1.0210556127130985, + 0.7605681866407394, + 1.9232179652899504, + 3.4443526174873114, + 0.9033359438180923, + 0.21715582348406315, + 0.8274578787386417, + 1.6111738625913858, + 2.6673499792814255, + 2.9378805104643106, + 1.5879754573106766, + 2.7633735574781895, + 1.6735859513282776, + 1.6032696012407541, + 0.7155630253255367, + 3.0886797308921814, + 0.6506371106952429, + 1.898344561457634, + 2.716687399893999, + 1.8010682221502066, + 0.5934338644146919, + 1.1047825682908297, + 3.480628529563546, + 0.9262359775602818, + 0.6575891599059105, + 2.9083290100097656, + 1.0138332373462617, + 1.9156065881252289, + 1.434723896207288, + 2.7379852775484324, + 4.669436117634177, + 1.5285415314137936, + 2.500318631529808, + 1.1645050030201674, + 0.46435125172138214, + 3.6260112207382917, + 2.1161885634064674, + 3.0871646851301193, + 0.8824591506272554, + 0.5490352436900139, + 2.2393914442509413, + 0.7374419290572405, + 6.873732205480337, + 6.603815946727991, + 2.6424172334372997 + ], + "unique_experts": 64, + "load_cv": 0.6418248498161807, + "normalized_load_entropy": 0.9558955244828778, + "max_load_share": 0.056580565805658053 + } + }, + "s1_eos": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "0c562499827bfbd9a14b85b758c79846e59ed59676d4c8f570d6ce42529c69ca", + "route_weight_sha256": "cb1bd6c29fbe0d382d33bbf18f4d0ecfbcec240229ce04f1dc909b477b3a325e", + "loads": [ + 5, + 23, + 7, + 24, + 6, + 6, + 25, + 35, + 31, + 21, + 17, + 28, + 33, + 25, + 1, + 4, + 24, + 15, + 32, + 7, + 14, + 27, + 28, + 12, + 5, + 14, + 33, + 22, + 37, + 21, + 40, + 23, + 22, + 17, + 33, + 2, + 25, + 29, + 31, + 7, + 16, + 34, + 12, + 13, + 45, + 17, + 9, + 20, + 28, + 51, + 16, + 23, + 12, + 8, + 53, + 19, + 22, + 11, + 14, + 24, + 13, + 90, + 84, + 31 + ], + "weighted_loads": [ + 0.34061678498983383, + 1.7273132000118494, + 0.2663835231214762, + 1.23587466776371, + 0.2654713988304138, + 0.4093987047672272, + 1.6868387907743454, + 2.1204786971211433, + 3.2563046980649233, + 1.7482886109501123, + 1.071983577683568, + 1.89768810197711, + 2.7009225226938725, + 1.9256915971636772, + 0.048278797417879105, + 0.14654957503080368, + 1.7518961764872074, + 0.5652514137327671, + 2.7112339064478874, + 0.5289706103503704, + 0.7345198579132557, + 1.7555972933769226, + 1.9295414611697197, + 0.8703014142811298, + 0.20973235554993153, + 0.7683820426464081, + 1.564730366691947, + 2.6959264129400253, + 2.9653276596218348, + 1.401525404304266, + 2.7334090396761894, + 1.6271905153989792, + 1.6047260724008083, + 0.7364076618105173, + 3.055822592228651, + 0.09772788733243942, + 1.894518457353115, + 1.9335658643394709, + 1.8449138551950455, + 0.26429575122892857, + 1.1188847161829472, + 3.085432041436434, + 0.881414158269763, + 0.6929095648229122, + 2.9524967037141323, + 0.8286210615187883, + 0.42178908735513687, + 1.5434169173240662, + 2.5187343321740627, + 4.68366265296936, + 1.07045141980052, + 2.199189495295286, + 1.0917954556643963, + 0.3764072973281145, + 3.630697414278984, + 1.3659155908972025, + 1.7272594198584557, + 0.8864809554070234, + 0.594585943967104, + 1.264349402859807, + 0.7391726616770029, + 6.799853898584843, + 6.368022946640849, + 2.6233201026916504 + ], + "unique_experts": 64, + "load_cv": 0.7025140898028842, + "normalized_load_entropy": 0.9479996736596069, + "max_load_share": 0.06097560975609756 + }, + "full_input": { + "tokens": 287, + "top_k": 6, + "decisions": 1722, + "ordered_route_sha256": "dea563733f4f45d2eea489bf35c73951928523dd86ea42537265bb027644d33a", + "route_weight_sha256": "ed9365d0cba6b2aa1e0801572fb37b4361e493b6e184fef4b6fabd69eca88e6d", + "loads": [ + 5, + 25, + 10, + 25, + 8, + 6, + 40, + 36, + 36, + 27, + 17, + 38, + 37, + 27, + 10, + 5, + 33, + 16, + 34, + 17, + 16, + 31, + 30, + 13, + 6, + 15, + 33, + 23, + 38, + 24, + 40, + 26, + 28, + 18, + 37, + 10, + 26, + 46, + 31, + 16, + 16, + 41, + 14, + 13, + 46, + 20, + 24, + 22, + 31, + 51, + 25, + 29, + 13, + 13, + 53, + 30, + 39, + 11, + 14, + 35, + 18, + 90, + 84, + 31 + ], + "weighted_loads": [ + 0.34061678498983383, + 1.7669877177104354, + 0.40772675536572933, + 1.2732775509357452, + 0.41733384132385254, + 0.4093987047672272, + 2.9581154957413673, + 2.182132810354233, + 3.597208457067609, + 2.450600625947118, + 1.071983577683568, + 2.5536801256239414, + 3.0291028283536434, + 1.9540070975199342, + 0.7386151738464832, + 0.2576928362250328, + 2.456288017332554, + 0.5693109421990812, + 2.8584091290831566, + 1.2278127260506153, + 0.8263497017323971, + 1.9961124565452337, + 3.421014182269573, + 0.9055615141987801, + 0.2423227783292532, + 0.8115108236670494, + 1.564730366691947, + 2.7227977309376, + 3.000149616971612, + 1.5959187485277653, + 2.7334090396761894, + 1.8269565664231777, + 1.787589779123664, + 0.7708413917571306, + 3.312251463532448, + 0.8537141717970371, + 1.9287854619324207, + 3.262762414291501, + 1.8449138551950455, + 0.734439043328166, + 1.1188847161829472, + 3.5534110981971025, + 0.9394193105399609, + 0.6929095648229122, + 3.0372827388346195, + 0.8966834489256144, + 2.227634269744158, + 1.565831622807309, + 2.6800563484430313, + 4.68366265296936, + 1.650835059583187, + 2.4401723220944405, + 1.1287149749696255, + 0.6199430916458368, + 3.630697414278984, + 2.38336062990129, + 3.5833854973316193, + 0.8864809554070234, + 0.594585943967104, + 2.3219080194830894, + 1.0038607250899076, + 6.799853898584843, + 6.368022946640849, + 2.6233201026916504 + ], + "unique_experts": 64, + "load_cv": 0.5933754602466424, + "normalized_load_entropy": 0.9615201028115473, + "max_load_share": 0.05226480836236934 + } + }, + "s0_bos": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "23a99b47bc61cbf938903262e4b8bdbee3763c5228bdb3be79886bfbad25fecd", + "route_weight_sha256": "91ff7950bfe5ebfcae36bb54e83a6c162ff254e34783bd9e9197828f1927aa72", + "loads": [ + 5, + 25, + 5, + 22, + 4, + 6, + 24, + 35, + 30, + 22, + 16, + 27, + 34, + 26, + 2, + 3, + 24, + 13, + 33, + 7, + 14, + 28, + 26, + 11, + 6, + 14, + 36, + 24, + 35, + 21, + 41, + 24, + 20, + 15, + 34, + 2, + 25, + 30, + 33, + 5, + 17, + 32, + 11, + 14, + 45, + 17, + 10, + 17, + 29, + 49, + 14, + 24, + 14, + 10, + 53, + 19, + 23, + 11, + 12, + 23, + 13, + 97, + 84, + 31 + ], + "weighted_loads": [ + 0.32549699768424034, + 1.7487457413226366, + 0.18698910623788834, + 1.1786976754665375, + 0.17555338516831398, + 0.4005959816277027, + 1.6480571758002043, + 2.15836438909173, + 3.2583979181945324, + 1.8393051475286484, + 1.0555158779025078, + 1.7868080865591764, + 2.745202787220478, + 1.9623287580907345, + 0.1030053161084652, + 0.11234103888273239, + 1.6979427337646484, + 0.5167760755866766, + 2.713302619755268, + 0.5364982336759567, + 0.7386059984564781, + 1.7896593771874905, + 1.8855218216776848, + 0.7990302182734013, + 0.2529321890324354, + 0.769058171659708, + 1.6267587505280972, + 2.775885932147503, + 2.8303410410881042, + 1.3867618404328823, + 2.8561377618461847, + 1.70807134360075, + 1.4957869593054056, + 0.6831257492303848, + 3.124948190525174, + 0.09489690884947777, + 1.9297635108232498, + 2.1241641137748957, + 1.949947090819478, + 0.1944748554378748, + 1.1586724240332842, + 3.0280082374811172, + 0.8051436953246593, + 0.7159381434321404, + 2.962793290615082, + 0.802300963550806, + 0.46538901701569557, + 1.425476560369134, + 2.632347524166107, + 4.677156899124384, + 0.9631783366203308, + 2.191891420632601, + 1.1502723805606365, + 0.4788892064243555, + 3.6627134680747986, + 1.431177869439125, + 1.85189139097929, + 0.8585814237594604, + 0.5393675286322832, + 1.2237315624952316, + 0.7489943541586399, + 7.29500669054687, + 6.466138642281294, + 2.5986412670463324 + ], + "unique_experts": 64, + "load_cv": 0.7277368941223066, + "normalized_load_entropy": 0.9451046172578547, + "max_load_share": 0.06571815718157181 + }, + "full_input": { + "tokens": 271, + "top_k": 6, + "decisions": 1626, + "ordered_route_sha256": "242c3bc9c3dfaa633719e12c42ffc85b721c89dca03e67823eb76569d2802c0d", + "route_weight_sha256": "42943abe02509aaf7a3ac5b5fac25a6ec21642b34afa886aac73e87657c45426", + "loads": [ + 5, + 27, + 5, + 22, + 5, + 6, + 32, + 35, + 30, + 22, + 16, + 33, + 34, + 27, + 5, + 4, + 30, + 13, + 33, + 15, + 15, + 31, + 28, + 12, + 6, + 15, + 36, + 24, + 35, + 25, + 41, + 24, + 22, + 15, + 35, + 8, + 25, + 40, + 33, + 14, + 17, + 37, + 14, + 14, + 45, + 21, + 23, + 18, + 33, + 49, + 21, + 31, + 14, + 11, + 53, + 29, + 33, + 11, + 12, + 32, + 13, + 97, + 84, + 31 + ], + "weighted_loads": [ + 0.32549699768424034, + 1.8145724795758724, + 0.18698910623788834, + 1.1786976754665375, + 0.20377184636890888, + 0.4005959816277027, + 2.6149837020784616, + 2.15836438909173, + 3.2583979181945324, + 1.8393051475286484, + 1.0555158779025078, + 2.1860358081758022, + 2.745202787220478, + 1.9854493476450443, + 0.31230568513274193, + 0.15944113209843636, + 2.0572338476777077, + 0.5167760755866766, + 2.713302619755268, + 1.0227825343608856, + 0.7829299196600914, + 1.9446376506239176, + 2.4589458387345076, + 0.8347622081637383, + 0.2529321890324354, + 0.7966304309666157, + 1.6267587505280972, + 2.775885932147503, + 2.8303410410881042, + 1.6074013337492943, + 2.8561377618461847, + 1.70807134360075, + 1.5560555029660463, + 0.6831257492303848, + 3.1593235302716494, + 0.6223134882748127, + 1.9297635108232498, + 2.9613575022667646, + 1.949947090819478, + 0.552820784971118, + 1.1586724240332842, + 3.4263505414128304, + 0.9102411139756441, + 0.7159381434321404, + 2.962793290615082, + 0.9327283520251513, + 2.1060633808374405, + 1.4446219056844711, + 2.829342907294631, + 4.677156899124384, + 1.4548023901879787, + 2.4972901232540607, + 1.1502723805606365, + 0.51689244620502, + 3.6627134680747986, + 2.193090494722128, + 3.079082652926445, + 0.8585814237594604, + 0.5393675286322832, + 2.195369340479374, + 0.7489943541586399, + 7.29500669054687, + 6.466138642281294, + 2.5986412670463324 + ], + "unique_experts": 64, + "load_cv": 0.6483168359316019, + "normalized_load_entropy": 0.9553055720971478, + "max_load_share": 0.05965559655596556 + } + }, + "s1_bos": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "bcdc75535fef21787ca8b776fb0b0a2d14e8442683f7851f699bd70b0d78ff4d", + "route_weight_sha256": "9ccbf606dbf32185fef29d2ae8c7ad860c6a22913eb187fa1a77b3f9cbc39ec4", + "loads": [ + 5, + 25, + 5, + 22, + 2, + 6, + 23, + 35, + 30, + 21, + 16, + 26, + 33, + 26, + 2, + 5, + 25, + 13, + 33, + 7, + 14, + 25, + 25, + 9, + 6, + 13, + 36, + 23, + 35, + 23, + 42, + 24, + 24, + 15, + 35, + 2, + 25, + 27, + 31, + 6, + 18, + 34, + 14, + 15, + 43, + 17, + 9, + 20, + 28, + 49, + 15, + 24, + 14, + 10, + 53, + 18, + 21, + 10, + 13, + 23, + 13, + 99, + 85, + 31 + ], + "weighted_loads": [ + 0.3216648958623409, + 1.7416223492473364, + 0.18405555561184883, + 1.1840942613780499, + 0.0788168590515852, + 0.4023698475211859, + 1.5679626613855362, + 2.112762477248907, + 3.27716832049191, + 1.794869463890791, + 1.0666059143841267, + 1.7637592628598213, + 2.710188567638397, + 1.954010996967554, + 0.0992993414402008, + 0.17518278770148754, + 1.7333471849560738, + 0.5113564301282167, + 2.7249570675194263, + 0.535202469676733, + 0.7576756253838539, + 1.6544732116162777, + 1.8715682607144117, + 0.7304833419620991, + 0.25583672896027565, + 0.7433992028236389, + 1.6175439283251762, + 2.7437027618288994, + 2.78148315474391, + 1.4646465554833412, + 2.94982242397964, + 1.6955905966460705, + 1.7069450411945581, + 0.6523148361593485, + 3.167678212746978, + 0.09024231135845184, + 1.944765593856573, + 1.9596742913126945, + 1.8553243111819029, + 0.23559398762881756, + 1.2166292984038591, + 3.0775502994656563, + 0.9524681176990271, + 0.7448516935110092, + 2.8880742639303207, + 0.8260338399559259, + 0.42465940676629543, + 1.5378962568938732, + 2.570013776421547, + 4.707311864942312, + 1.0017024837434292, + 2.208833895623684, + 1.1348849330097437, + 0.4690261110663414, + 3.6710665430873632, + 1.3719816468656063, + 1.7369731217622757, + 0.8402443155646324, + 0.5720703154802322, + 1.2120213862508535, + 0.7433526590466499, + 7.328457143157721, + 6.386569902300835, + 2.565934808924794 + ], + "unique_experts": 64, + "load_cv": 0.7326852844167386, + "normalized_load_entropy": 0.9449556741356189, + "max_load_share": 0.06707317073170732 + }, + "full_input": { + "tokens": 287, + "top_k": 6, + "decisions": 1722, + "ordered_route_sha256": "96bcb2fa9abe80866df6de403572f0c4066aa10e456682778ea415b9eb74b6ec", + "route_weight_sha256": "bd3842049ad8b28e09751c4843d0aa83eafc9985567ffcd32a7f5a7f22aa7547", + "loads": [ + 5, + 26, + 8, + 23, + 4, + 6, + 39, + 36, + 35, + 27, + 16, + 36, + 37, + 27, + 11, + 7, + 35, + 13, + 35, + 17, + 16, + 29, + 26, + 10, + 7, + 14, + 36, + 24, + 36, + 26, + 42, + 27, + 30, + 16, + 39, + 10, + 26, + 45, + 31, + 15, + 18, + 41, + 16, + 15, + 44, + 19, + 25, + 22, + 31, + 49, + 24, + 30, + 15, + 15, + 53, + 29, + 38, + 10, + 13, + 34, + 18, + 99, + 85, + 31 + ], + "weighted_loads": [ + 0.3216648958623409, + 1.7765460778027773, + 0.325398787856102, + 1.221497144550085, + 0.23067930154502392, + 0.4023698475211859, + 2.912215478718281, + 2.1744165904819965, + 3.6180720794945955, + 2.4971814788877964, + 1.0666059143841267, + 2.4479304291307926, + 3.038368873298168, + 1.977131586521864, + 0.7937332317233086, + 0.3384073469787836, + 2.4813853949308395, + 0.5113564301282167, + 2.8721322901546955, + 1.231047362089157, + 0.8495054692029953, + 1.886883059516549, + 2.416975973173976, + 0.7657434418797493, + 0.2884271517395973, + 0.7865279838442802, + 1.6175439283251762, + 2.770574079826474, + 2.816305112093687, + 1.6619888618588448, + 2.94982242397964, + 1.895356647670269, + 1.8927405700087547, + 0.6867485661059618, + 3.4241070840507746, + 0.8737166114151478, + 1.9790325984358788, + 3.3764723166823387, + 1.8553243111819029, + 0.705737279728055, + 1.2166292984038591, + 3.545529356226325, + 1.010473269969225, + 0.7448516935110092, + 2.972860299050808, + 0.8903285916894674, + 2.3638545405119658, + 1.6136341523379087, + 2.7442858293652534, + 4.707311864942312, + 1.6231529228389263, + 2.449816722422838, + 1.1718044523149729, + 0.7107576392591, + 3.6710665430873632, + 2.3894266858696938, + 3.63887719810009, + 0.8402443155646324, + 0.5720703154802322, + 2.269580002874136, + 1.0080407224595547, + 7.328457143157721, + 6.386569902300835, + 2.565934808924794 + ], + "unique_experts": 64, + "load_cv": 0.6170549280032678, + "normalized_load_entropy": 0.9593424142313818, + "max_load_share": 0.05749128919860627 + } + }, + "s0_x": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "5aed3309613b0b93772f3aa7813225b064f71df473b3009e24d043c3b0b08a3f", + "route_weight_sha256": "9dd262e0587db8fd3d91520306e54d146ca7e1d3d9fbde352517368ec0947a64", + "loads": [ + 6, + 25, + 7, + 22, + 5, + 6, + 24, + 36, + 30, + 21, + 16, + 25, + 33, + 25, + 4, + 3, + 25, + 14, + 32, + 7, + 14, + 28, + 26, + 11, + 5, + 13, + 35, + 24, + 36, + 22, + 41, + 23, + 20, + 15, + 33, + 2, + 25, + 28, + 30, + 8, + 15, + 32, + 14, + 14, + 43, + 18, + 11, + 17, + 28, + 50, + 15, + 24, + 14, + 10, + 52, + 20, + 21, + 11, + 14, + 23, + 12, + 97, + 85, + 31 + ], + "weighted_loads": [ + 0.351783050224185, + 1.76613499969244, + 0.2725093215703964, + 1.1897493451833725, + 0.2669189125299454, + 0.39098527655005455, + 1.6431327182799578, + 2.2000809144228697, + 3.2790886349976063, + 1.7751902267336845, + 1.0212711226195097, + 1.7337082736194134, + 2.665932636708021, + 1.899325467646122, + 0.2025306411087513, + 0.10918056964874268, + 1.7647336050868034, + 0.5375812388956547, + 2.6465387418866158, + 0.5136721730232239, + 0.7228760756552219, + 1.8053587637841702, + 1.8581094816327095, + 0.8080962263047695, + 0.21174629591405392, + 0.7314082309603691, + 1.5988936573266983, + 2.8463655915111303, + 2.7903688680380583, + 1.4421533942222595, + 2.8803115487098694, + 1.6509960368275642, + 1.5034707449376583, + 0.6646622084081173, + 3.0737707633525133, + 0.09494803100824356, + 1.9454696998000145, + 2.1954541206359863, + 1.8180118687450886, + 0.31039733439683914, + 1.0615707524120808, + 3.0340337492525578, + 0.9460654985159636, + 0.719695882871747, + 2.8528002686798573, + 0.846645787358284, + 0.5372169278562069, + 1.4113555122166872, + 2.5233555659651756, + 4.658489193767309, + 1.0564633682370186, + 2.2060453929007053, + 1.1632275339215994, + 0.47404743544757366, + 3.593548135831952, + 1.4857996813952923, + 1.7557840533554554, + 0.8565398789942265, + 0.6147988811135292, + 1.2210644856095314, + 0.7213383130729198, + 7.350744700059295, + 6.543933039531112, + 2.582918079569936 + ], + "unique_experts": 64, + "load_cv": 0.717614971466906, + "normalized_load_entropy": 0.9480601628236377, + "max_load_share": 0.06571815718157181 + }, + "full_input": { + "tokens": 271, + "top_k": 6, + "decisions": 1626, + "ordered_route_sha256": "96044ac0e7012d298ddcf429041735be5fb2cce43710fcec8af179b1e890348f", + "route_weight_sha256": "a7e7463bd9b96be9ef4535f84ee8669eb5190243084386948712a9705b479bb1", + "loads": [ + 6, + 27, + 7, + 22, + 6, + 6, + 34, + 36, + 30, + 21, + 16, + 30, + 33, + 26, + 7, + 4, + 30, + 14, + 32, + 16, + 15, + 31, + 28, + 12, + 5, + 14, + 35, + 24, + 36, + 25, + 41, + 23, + 22, + 15, + 34, + 8, + 25, + 38, + 30, + 16, + 15, + 39, + 17, + 14, + 43, + 22, + 24, + 18, + 32, + 50, + 20, + 32, + 14, + 10, + 52, + 31, + 30, + 11, + 14, + 33, + 12, + 97, + 85, + 31 + ], + "weighted_loads": [ + 0.351783050224185, + 1.8319617379456758, + 0.2725093215703964, + 1.1897493451833725, + 0.2951373737305403, + 0.39098527655005455, + 2.9031958263367414, + 2.2000809144228697, + 3.2790886349976063, + 1.7751902267336845, + 1.0212711226195097, + 2.0807456467300653, + 2.665932636708021, + 1.9224460572004318, + 0.4059758596122265, + 0.1529284082353115, + 2.0834538638591766, + 0.5375812388956547, + 2.6465387418866158, + 1.0658791586756706, + 0.7671999968588352, + 1.9572082813829184, + 2.4315334986895323, + 0.8438282161951065, + 0.21174629591405392, + 0.7589804902672768, + 1.5988936573266983, + 2.8463655915111303, + 2.7903688680380583, + 1.6132793873548508, + 2.8803115487098694, + 1.6509960368275642, + 1.563739288598299, + 0.6646622084081173, + 3.1081461030989885, + 0.6584628894925117, + 1.9454696998000145, + 2.9882411397993565, + 1.8180118687450886, + 0.6267084255814552, + 1.0615707524120808, + 3.571306798607111, + 1.0379114635288715, + 0.719695882871747, + 2.8528002686798573, + 0.9770731758326292, + 1.9086182117462158, + 1.4305008575320244, + 2.725828120484948, + 4.658489193767309, + 1.4226046279072762, + 2.5467223301529884, + 1.1632275339215994, + 0.47404743544757366, + 3.593548135831952, + 2.3038762360811234, + 2.809378657490015, + 0.8565398789942265, + 0.6147988811135292, + 2.268988974392414, + 0.7213383130729198, + 7.350744700059295, + 6.543933039531112, + 2.582918079569936 + ], + "unique_experts": 64, + "load_cv": 0.6425033740537339, + "normalized_load_entropy": 0.9568501072812242, + "max_load_share": 0.05965559655596556 + } + }, + "s1_x": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "d62733cfa9503658444af31a9d3b0560afb6fa972f4c3b7f5fe649a703367a45", + "route_weight_sha256": "128d0268551ce34df7d3286420196b3f4088e05065f8d360ca846fe5bfec1e99", + "loads": [ + 6, + 23, + 6, + 21, + 3, + 6, + 23, + 35, + 30, + 21, + 16, + 26, + 33, + 26, + 3, + 6, + 25, + 13, + 32, + 8, + 14, + 23, + 25, + 10, + 7, + 13, + 34, + 23, + 37, + 21, + 41, + 23, + 22, + 13, + 35, + 2, + 25, + 29, + 32, + 8, + 16, + 33, + 15, + 15, + 43, + 18, + 10, + 21, + 28, + 50, + 15, + 25, + 13, + 10, + 53, + 19, + 22, + 10, + 13, + 25, + 12, + 97, + 83, + 31 + ], + "weighted_loads": [ + 0.34917773492634296, + 1.6721957810223103, + 0.21564065851271152, + 1.1479518953710794, + 0.14690915122628212, + 0.39882872626185417, + 1.6611010413616896, + 2.151789916679263, + 3.2980553712695837, + 1.7985504791140556, + 1.100447354838252, + 1.8140102103352547, + 2.6673483960330486, + 1.9211082067340612, + 0.163374911993742, + 0.20258004032075405, + 1.7429450377821922, + 0.49301355704665184, + 2.6171061396598816, + 0.5641450919210911, + 0.7473862171173096, + 1.5660473927855492, + 1.8497443329542875, + 0.7768484111875296, + 0.3168259933590889, + 0.7374661900103092, + 1.5427558589726686, + 2.7640787716954947, + 2.7496002577245235, + 1.3900940418243408, + 2.8862570114433765, + 1.6414793245494366, + 1.6048745028674603, + 0.5660396181046963, + 3.1437601167708635, + 0.08877620846033096, + 1.9690608531236649, + 2.0303877256810665, + 1.890648726373911, + 0.29977312684059143, + 1.1156789306551218, + 3.072275310754776, + 1.0114516578614712, + 0.743689427152276, + 2.859473265707493, + 0.8628531787544489, + 0.49968084692955017, + 1.5503664668649435, + 2.51815751940012, + 4.742763817310333, + 1.028842505067587, + 2.2333725430071354, + 1.1058495342731476, + 0.469072800129652, + 3.6259749308228493, + 1.4339088313281536, + 1.7260394841432571, + 0.8453712873160839, + 0.5823096875101328, + 1.3035153541713953, + 0.7137918770313263, + 7.225485157221556, + 6.253060543909669, + 2.531446447595954 + ], + "unique_experts": 64, + "load_cv": 0.715729393290552, + "normalized_load_entropy": 0.9480245038020331, + "max_load_share": 0.06571815718157181 + }, + "full_input": { + "tokens": 287, + "top_k": 6, + "decisions": 1722, + "ordered_route_sha256": "8ffef83fedbd621a487049afbddda0074fd4e6fffba564e72c31b421406f5079", + "route_weight_sha256": "bf5fa3e80de1b381da2d08cea5ad7b8337f7648b953e8b758c731d17c76383b8", + "loads": [ + 6, + 24, + 9, + 22, + 5, + 6, + 41, + 36, + 35, + 27, + 16, + 35, + 37, + 27, + 12, + 8, + 34, + 13, + 34, + 20, + 16, + 27, + 26, + 11, + 9, + 14, + 34, + 24, + 38, + 24, + 41, + 26, + 27, + 14, + 39, + 10, + 26, + 45, + 32, + 17, + 16, + 42, + 17, + 15, + 44, + 20, + 25, + 22, + 31, + 50, + 23, + 32, + 14, + 14, + 53, + 31, + 38, + 10, + 13, + 37, + 17, + 97, + 83, + 31 + ], + "weighted_loads": [ + 0.34917773492634296, + 1.7071195095777512, + 0.3569838907569647, + 1.1853547785431147, + 0.29877159371972084, + 0.39882872626185417, + 3.352327985689044, + 2.2134440299123526, + 3.6389591302722692, + 2.500862494111061, + 1.100447354838252, + 2.453612793236971, + 2.9955287016928196, + 1.944228796288371, + 0.8491658382117748, + 0.3810918238013983, + 2.454637583345175, + 0.49301355704665184, + 2.7642813622951508, + 1.3651946745812893, + 0.839216060936451, + 1.801436511799693, + 2.3951520454138517, + 0.8121085111051798, + 0.3829839900135994, + 0.7805949710309505, + 1.5427558589726686, + 2.7909500896930695, + 2.7844222150743008, + 1.5817656926810741, + 2.8862570114433765, + 1.841245375573635, + 1.7519084084779024, + 0.6004733480513096, + 3.4001889880746603, + 0.8814941458404064, + 2.0033278577029705, + 3.2662907354533672, + 1.890648726373911, + 0.7699164189398289, + 1.1156789306551218, + 3.672655401751399, + 1.069456810131669, + 0.743689427152276, + 2.94425930082798, + 0.9271479304879904, + 2.113569125533104, + 1.5695118121802807, + 2.694690253585577, + 4.742763817310333, + 1.5707156769931316, + 2.503871265798807, + 1.1427690535783768, + 0.6725936643779278, + 3.6259749308228493, + 2.5218706354498863, + 3.4262031242251396, + 0.8453712873160839, + 0.5823096875101328, + 2.4340867698192596, + 0.978479940444231, + 7.225485157221556, + 6.253060543909669, + 2.531446447595954 + ], + "unique_experts": 64, + "load_cv": 0.6060436735198083, + "normalized_load_entropy": 0.9609504060464623, + "max_load_share": 0.056329849012775844 + } + }, + "s0_period": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "cfd688775f24b75f1584e7eeede7191571340130d0b3d296d1a9cd94e4832545", + "route_weight_sha256": "ec8bc08803169288b1ce80445ea18518c5be937040bd863dee14730735d22f50", + "loads": [ + 6, + 26, + 7, + 21, + 6, + 5, + 21, + 36, + 30, + 21, + 16, + 26, + 33, + 26, + 3, + 3, + 25, + 14, + 32, + 7, + 14, + 25, + 27, + 11, + 6, + 13, + 33, + 24, + 37, + 22, + 41, + 23, + 22, + 15, + 34, + 2, + 25, + 30, + 31, + 8, + 15, + 33, + 13, + 14, + 45, + 19, + 10, + 17, + 28, + 50, + 15, + 25, + 13, + 10, + 52, + 19, + 21, + 11, + 14, + 23, + 12, + 97, + 82, + 31 + ], + "weighted_loads": [ + 0.35293116979300976, + 1.794295534491539, + 0.2707754224538803, + 1.1536983661353588, + 0.27802151814103127, + 0.36125997826457024, + 1.5405825078487396, + 2.2004811968654394, + 3.289471635594964, + 1.7835807278752327, + 1.0426479000598192, + 1.7693476062268019, + 2.6635150499641895, + 1.956269459798932, + 0.14711172878742218, + 0.10821892321109772, + 1.7350179329514503, + 0.5351940374821424, + 2.645800966769457, + 0.5133169367909431, + 0.7124655842781067, + 1.6897058561444283, + 1.904349559918046, + 0.7955794669687748, + 0.26695444248616695, + 0.7321469523012638, + 1.542937634512782, + 2.8569229654967785, + 2.8252230044454336, + 1.430883213877678, + 2.907071264460683, + 1.6479836329817772, + 1.590613391250372, + 0.6340936496853828, + 3.115530099719763, + 0.09643972292542458, + 1.950349509716034, + 2.3381264489144087, + 1.862690957263112, + 0.31135098822414875, + 1.0696170143783092, + 3.0560654401779175, + 0.9196872469037771, + 0.714223887771368, + 2.9551211278885603, + 0.8821058832108974, + 0.5130620822310448, + 1.4133849758654833, + 2.527068819850683, + 4.6704514510929585, + 1.0642969980835915, + 2.2271443642675877, + 1.134646151214838, + 0.4722654577344656, + 3.573843775317073, + 1.4335457645356655, + 1.7419237904250622, + 0.8628612160682678, + 0.6192737054079771, + 1.2373397331684828, + 0.7158325873315334, + 7.293158870190382, + 6.464940086007118, + 2.5968034509569407 + ], + "unique_experts": 64, + "load_cv": 0.7145381019532313, + "normalized_load_entropy": 0.9479180402288034, + "max_load_share": 0.06571815718157181 + }, + "full_input": { + "tokens": 271, + "top_k": 6, + "decisions": 1626, + "ordered_route_sha256": "73ecca85ac25896d447c52fee33adb90ceb44430f9966767eb1b4d42f10c38ad", + "route_weight_sha256": "fe7df3e3ff71144aa361984e018e182e56012d50e514d8391c0a50326e4539fc", + "loads": [ + 6, + 28, + 7, + 21, + 7, + 5, + 31, + 36, + 30, + 21, + 16, + 31, + 34, + 27, + 5, + 4, + 30, + 14, + 32, + 17, + 15, + 28, + 29, + 12, + 6, + 14, + 33, + 24, + 38, + 25, + 41, + 23, + 24, + 15, + 35, + 8, + 25, + 40, + 31, + 16, + 15, + 39, + 16, + 14, + 45, + 23, + 23, + 18, + 32, + 50, + 20, + 33, + 13, + 10, + 52, + 30, + 30, + 11, + 14, + 32, + 12, + 97, + 82, + 31 + ], + "weighted_loads": [ + 0.35293116979300976, + 1.8601222727447748, + 0.2707754224538803, + 1.1536983661353588, + 0.30623997934162617, + 0.36125997826457024, + 2.6702295169234276, + 2.2004811968654394, + 3.289471635594964, + 1.7835807278752327, + 1.0426479000598192, + 2.1140011586248875, + 2.716237101703882, + 1.979390049353242, + 0.3088652342557907, + 0.1453990340232849, + 2.046625327318907, + 0.5351940374821424, + 2.645800966769457, + 1.1525711342692375, + 0.75678950548172, + 1.8414728660136461, + 2.4777735769748688, + 0.8313114568591118, + 0.26695444248616695, + 0.7597192116081715, + 1.542937634512782, + 2.8569229654967785, + 2.9284358005970716, + 1.6065772324800491, + 2.907071264460683, + 1.6479836329817772, + 1.6508819349110126, + 0.6340936496853828, + 3.149905439466238, + 0.6589001379907131, + 1.950349509716034, + 3.2169683519750834, + 1.862690957263112, + 0.6276620794087648, + 1.0696170143783092, + 3.5100719183683395, + 1.0129787884652615, + 0.714223887771368, + 2.9551211278885603, + 1.0125332716852427, + 1.8895173221826553, + 1.4325303211808205, + 2.7244309093803167, + 4.6704514510929585, + 1.426069237291813, + 2.5669155456125736, + 1.134646151214838, + 0.4722654577344656, + 3.573843775317073, + 2.3439688459038734, + 2.7870106175541878, + 0.8628612160682678, + 0.6192737054079771, + 2.208977511152625, + 0.7158325873315334, + 7.293158870190382, + 6.464940086007118, + 2.5968034509569407 + ], + "unique_experts": 64, + "load_cv": 0.6395200528342023, + "normalized_load_entropy": 0.9567821398239551, + "max_load_share": 0.05965559655596556 + } + }, + "s1_period": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "bbef5403f9f4e8a9d0b8bafbe4220dd2e6b3775576fef1f705db86a5ca08bb46", + "route_weight_sha256": "b9f0a200777bbdd00887440fc8187539977b1b1081aa9a8c2c5b26c6dcf874c5", + "loads": [ + 6, + 26, + 6, + 20, + 5, + 6, + 23, + 35, + 30, + 22, + 17, + 26, + 33, + 27, + 3, + 6, + 26, + 13, + 32, + 7, + 14, + 24, + 25, + 10, + 7, + 13, + 34, + 23, + 36, + 21, + 41, + 23, + 21, + 12, + 35, + 2, + 25, + 33, + 30, + 8, + 16, + 33, + 13, + 13, + 43, + 18, + 10, + 21, + 28, + 50, + 15, + 24, + 13, + 10, + 51, + 19, + 21, + 10, + 14, + 25, + 12, + 96, + 84, + 31 + ], + "weighted_loads": [ + 0.3471086844801903, + 1.7763381078839302, + 0.21613904647529125, + 1.1195433661341667, + 0.18360418267548084, + 0.39860840514302254, + 1.6537840478122234, + 2.1367553658783436, + 3.292612288147211, + 1.8236065097153187, + 1.1341620832681656, + 1.8215211816132069, + 2.6380909830331802, + 1.971115492284298, + 0.14741450920701027, + 0.2061148937791586, + 1.782717254012823, + 0.489783089607954, + 2.6128439642488956, + 0.5322923585772514, + 0.7456414736807346, + 1.623111817985773, + 1.843691099435091, + 0.7718034703284502, + 0.3205875549465418, + 0.7342277020215988, + 1.5445979591459036, + 2.765565138310194, + 2.7212617732584476, + 1.3782170452177525, + 2.8891166895627975, + 1.6397195234894753, + 1.5788746066391468, + 0.5128297209739685, + 3.154573939740658, + 0.08972685411572456, + 1.9507701471447945, + 2.241110799834132, + 1.8097698148339987, + 0.30119326151907444, + 1.1199249066412449, + 3.0781041011214256, + 0.9318472910672426, + 0.6655865348875523, + 2.880094740539789, + 0.8715047109872103, + 0.5052684433758259, + 1.5706455074250698, + 2.515416670590639, + 4.723052185028791, + 1.0495664551854134, + 2.171596698462963, + 1.1032851412892342, + 0.4656722955405712, + 3.4997519366443157, + 1.4363419637084007, + 1.6767507828772068, + 0.8489818349480629, + 0.6204367708414793, + 1.3235864043235779, + 0.7099497839808464, + 7.21196773648262, + 6.312604973092675, + 2.5337795838713646 + ], + "unique_experts": 64, + "load_cv": 0.7137976797325704, + "normalized_load_entropy": 0.9483070396227606, + "max_load_share": 0.06504065040650407 + }, + "full_input": { + "tokens": 287, + "top_k": 6, + "decisions": 1722, + "ordered_route_sha256": "169fcf14551a31a49fc8e7f3a3cf942651bebb57f19d85616fadb6ca38d7fbe0", + "route_weight_sha256": "2c4a8a4381ee107a877cbd78a4dd6da563cd22df45fcfda9451d1495c81031f3", + "loads": [ + 6, + 27, + 9, + 21, + 7, + 6, + 41, + 36, + 35, + 28, + 17, + 35, + 38, + 28, + 12, + 8, + 35, + 13, + 34, + 19, + 16, + 28, + 26, + 11, + 9, + 14, + 34, + 24, + 38, + 24, + 41, + 26, + 26, + 13, + 39, + 10, + 26, + 50, + 30, + 17, + 16, + 40, + 15, + 13, + 44, + 20, + 26, + 22, + 31, + 50, + 22, + 31, + 14, + 14, + 51, + 31, + 37, + 10, + 14, + 36, + 17, + 96, + 84, + 31 + ], + "weighted_loads": [ + 0.3471086844801903, + 1.811261836439371, + 0.3574822787195444, + 1.156946249306202, + 0.33546662516891956, + 0.39860840514302254, + 3.2088197469711304, + 2.198409479111433, + 3.6335160471498966, + 2.525918524712324, + 1.1341620832681656, + 2.461561232805252, + 3.03156478703022, + 1.9942360818386078, + 0.83249157294631, + 0.3705455046147108, + 2.492957666516304, + 0.489783089607954, + 2.760019186884165, + 1.430466078221798, + 0.837471317499876, + 1.857761101797223, + 2.3890988118946552, + 0.8070635702461004, + 0.38823859952390194, + 0.7773564830422401, + 1.5445979591459036, + 2.792436456307769, + 2.8792237751185894, + 1.5708581246435642, + 2.8891166895627975, + 1.8394855745136738, + 1.725908512249589, + 0.5472634509205818, + 3.4110028110444546, + 0.8948643207550049, + 1.9850371517241001, + 3.616143150255084, + 1.8097698148339987, + 0.7713365536183119, + 1.1199249066412449, + 3.5460831578820944, + 0.9898524433374405, + 0.6655865348875523, + 2.9648807756602764, + 0.9357994627207518, + 2.140639591962099, + 1.589790852740407, + 2.6611874401569366, + 4.723052185028791, + 1.5317948162555695, + 2.445052832365036, + 1.1402046605944633, + 0.669193159788847, + 3.4997519366443157, + 2.5842927284538746, + 3.367230884730816, + 0.8489818349480629, + 0.6204367708414793, + 2.3811450209468603, + 0.9746378473937511, + 7.21196773648262, + 6.312604973092675, + 2.5337795838713646 + ], + "unique_experts": 64, + "load_cv": 0.6062573144531902, + "normalized_load_entropy": 0.9610234304312543, + "max_load_share": 0.05574912891986063 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 246, + "ordered_topk_exact_tokens": 207, + "set_exact_tokens": 220, + "mean_set_jaccard": 0.968931475029036, + "mean_token_weighted_tv": 0.008187309085444464, + "aggregate_load_tv": 0.012872628726287264 + }, + "system_bos": { + "tokens": 246, + "ordered_topk_exact_tokens": 176, + "set_exact_tokens": 202, + "mean_set_jaccard": 0.9488966318234611, + "mean_token_weighted_tv": 0.013341214076229712, + "aggregate_load_tv": 0.018292682926829278 + }, + "system_x": { + "tokens": 246, + "ordered_topk_exact_tokens": 166, + "set_exact_tokens": 193, + "mean_set_jaccard": 0.9375725900116143, + "mean_token_weighted_tv": 0.016334227168917415, + "aggregate_load_tv": 0.019647696476964772 + }, + "system_period": { + "tokens": 246, + "ordered_topk_exact_tokens": 172, + "set_exact_tokens": 204, + "mean_set_jaccard": 0.9468641114982578, + "mean_token_weighted_tv": 0.014897321949039049, + "aggregate_load_tv": 0.01693766937669376 + }, + "bos_at_s0": { + "tokens": 246, + "ordered_topk_exact_tokens": 155, + "set_exact_tokens": 180, + "mean_set_jaccard": 0.9207317073170732, + "mean_token_weighted_tv": 0.019946244132621745, + "aggregate_load_tv": 0.023712737127371278 + }, + "bos_at_s1": { + "tokens": 246, + "ordered_topk_exact_tokens": 144, + "set_exact_tokens": 172, + "mean_set_jaccard": 0.9105691056910569, + "mean_token_weighted_tv": 0.022030243422926928, + "aggregate_load_tv": 0.028455284552845538 + }, + "x_at_s0": { + "tokens": 246, + "ordered_topk_exact_tokens": 150, + "set_exact_tokens": 183, + "mean_set_jaccard": 0.9224738675958187, + "mean_token_weighted_tv": 0.020727149449379707, + "aggregate_load_tv": 0.023712737127371278 + }, + "x_at_s1": { + "tokens": 246, + "ordered_topk_exact_tokens": 139, + "set_exact_tokens": 173, + "mean_set_jaccard": 0.9117305458768872, + "mean_token_weighted_tv": 0.02303237192014732, + "aggregate_load_tv": 0.02574525745257452 + }, + "period_at_s0": { + "tokens": 246, + "ordered_topk_exact_tokens": 150, + "set_exact_tokens": 175, + "mean_set_jaccard": 0.914924506387921, + "mean_token_weighted_tv": 0.0214161071964214, + "aggregate_load_tv": 0.027777777777777783 + }, + "period_at_s1": { + "tokens": 246, + "ordered_topk_exact_tokens": 142, + "set_exact_tokens": 171, + "mean_set_jaccard": 0.911149825783972, + "mean_token_weighted_tv": 0.023139805578422254, + "aggregate_load_tv": 0.02710027100271003 + } + } + }, + "layer_07": { + "layer": 7, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "8f080abc3d2e26f5d421ec53ca96efab5b99a10aeba5cba29df5ec5de18900d6", + "route_weight_sha256": "25c94640a69b06c2706eb8b584e77cd4389516127daa783de93e57da12cc8d9d", + "loads": [ + 53, + 19, + 32, + 27, + 1, + 22, + 20, + 14, + 25, + 16, + 6, + 10, + 12, + 4, + 26, + 24, + 10, + 17, + 21, + 49, + 1, + 28, + 34, + 47, + 27, + 30, + 22, + 39, + 8, + 21, + 16, + 11, + 28, + 4, + 51, + 7, + 19, + 3, + 28, + 30, + 31, + 14, + 27, + 7, + 5, + 16, + 20, + 5, + 28, + 28, + 10, + 38, + 57, + 0, + 19, + 30, + 15, + 53, + 26, + 24, + 45, + 20, + 85, + 11 + ], + "weighted_loads": [ + 4.051667369902134, + 0.720494357869029, + 1.6285098381340504, + 1.0653246473520994, + 0.03699101507663727, + 1.353420976549387, + 0.835003562271595, + 0.9499207716435194, + 1.6219933182001114, + 0.6604520995169878, + 0.26517231948673725, + 0.5735237561166286, + 0.6956652346998453, + 0.198090597987175, + 1.9333541691303253, + 1.2827695421874523, + 1.4197897091507912, + 0.8379782605916262, + 1.0652772057801485, + 4.310232646763325, + 0.047971852123737335, + 1.9400785267353058, + 2.2738147154450417, + 3.2461961209774017, + 2.715249091386795, + 2.0878512673079967, + 1.4118295684456825, + 3.0406005177646875, + 0.25053075328469276, + 1.722148647531867, + 1.1117539629340172, + 0.5530588589608669, + 2.051950726658106, + 0.17275498434901237, + 6.881855497136712, + 0.6061537377536297, + 1.5859763398766518, + 0.14719142019748688, + 2.4207885339856148, + 1.9858900867402554, + 2.433825720101595, + 0.871936097741127, + 2.1638274863362312, + 0.5856369882822037, + 0.23411498591303825, + 1.104249034076929, + 1.586121555417776, + 0.20639763958752155, + 1.525653563439846, + 1.9088204838335514, + 0.7496691048145294, + 2.144305594265461, + 5.62170585244894, + 0.0, + 1.1311035323888063, + 2.0370576065033674, + 0.8715114817023277, + 3.499776529148221, + 2.165468331426382, + 1.243697613477707, + 3.6860125064849854, + 1.0742226019501686, + 7.520375853404403, + 0.6010891161859035 + ], + "unique_experts": 63, + "load_cv": 0.6880213898719436, + "normalized_load_entropy": 0.9438350490781795, + "max_load_share": 0.05758807588075881 + }, + "full_input": { + "tokens": 271, + "top_k": 6, + "decisions": 1626, + "ordered_route_sha256": "964c66b06d582662999c4205d62f1a6cd50767330feb668726888043c2ea6634", + "route_weight_sha256": "9d3a3dcac1c68f6a08943fb4ecbf5457499deb32ce7fa810cccffb5915b46bfd", + "loads": [ + 53, + 19, + 32, + 30, + 1, + 23, + 26, + 14, + 33, + 16, + 7, + 13, + 12, + 9, + 26, + 24, + 25, + 19, + 23, + 50, + 1, + 28, + 37, + 49, + 31, + 30, + 25, + 39, + 11, + 21, + 16, + 11, + 31, + 5, + 51, + 7, + 19, + 3, + 38, + 33, + 31, + 25, + 32, + 10, + 9, + 16, + 22, + 7, + 28, + 28, + 26, + 38, + 57, + 1, + 19, + 37, + 15, + 53, + 30, + 24, + 45, + 26, + 88, + 18 + ], + "weighted_loads": [ + 4.051667369902134, + 0.720494357869029, + 1.6285098381340504, + 1.1749251540750265, + 0.03699101507663727, + 1.394994955509901, + 1.382347945123911, + 0.9499207716435194, + 2.223565485328436, + 0.6604520995169878, + 0.2980944197624922, + 1.0738693438470364, + 0.6956652346998453, + 0.4811075981706381, + 1.9333541691303253, + 1.2827695421874523, + 3.446313798427582, + 0.9533363189548254, + 1.1067749643698335, + 4.373250029981136, + 0.047971852123737335, + 1.9400785267353058, + 2.443578828126192, + 3.3887985721230507, + 2.8470255695283413, + 2.0878512673079967, + 1.6780034638941288, + 3.0406005177646875, + 0.3138414202257991, + 1.722148647531867, + 1.1117539629340172, + 0.5530588589608669, + 2.1668769903481007, + 0.2225348949432373, + 6.881855497136712, + 0.6061537377536297, + 1.5859763398766518, + 0.14719142019748688, + 3.3677832819521427, + 2.1120598167181015, + 2.433825720101595, + 1.8398095145821571, + 2.5151431299746037, + 0.6491889264434576, + 1.748080536723137, + 1.104249034076929, + 1.6714839022606611, + 0.38293670304119587, + 1.525653563439846, + 1.9088204838335514, + 1.9915930517017841, + 2.144305594265461, + 5.62170585244894, + 0.03165566176176071, + 1.1311035323888063, + 2.69838029704988, + 0.8715114817023277, + 3.499776529148221, + 2.2505728183314204, + 1.243697613477707, + 3.6860125064849854, + 1.3710786886513233, + 7.569229676388204, + 0.8689144123345613 + ], + "unique_experts": 64, + "load_cv": 0.6185861363123942, + "normalized_load_entropy": 0.9535728936409168, + "max_load_share": 0.05412054120541206 + } + }, + "s1_eos": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "b5739fa5eeed373bb6b154df7248585e4035f15aac5e91f592441d4f85a3c9ae", + "route_weight_sha256": "fa768e6e28611743b8bde3ccd021da435b39d926af9295052930d576f7e3fbc8", + "loads": [ + 53, + 19, + 32, + 26, + 1, + 22, + 24, + 13, + 23, + 15, + 5, + 11, + 11, + 5, + 26, + 21, + 10, + 19, + 21, + 49, + 1, + 28, + 33, + 45, + 26, + 30, + 24, + 42, + 8, + 22, + 16, + 11, + 28, + 4, + 51, + 7, + 19, + 3, + 28, + 31, + 31, + 14, + 27, + 7, + 6, + 16, + 20, + 5, + 28, + 29, + 9, + 38, + 60, + 0, + 20, + 29, + 15, + 52, + 27, + 21, + 46, + 19, + 84, + 10 + ], + "weighted_loads": [ + 4.092279426753521, + 0.7137065567076206, + 1.6291770339012146, + 1.0468693021684885, + 0.03638118878006935, + 1.3662518970668316, + 1.0158137530088425, + 0.9236020892858505, + 1.4634036719799042, + 0.6368320845067501, + 0.24548758566379547, + 0.6078359670937061, + 0.6763997301459312, + 0.23188619315624237, + 1.9264352694153786, + 1.1456012427806854, + 1.4278701730072498, + 0.914737556129694, + 1.0573548711836338, + 4.270313261076808, + 0.0499497652053833, + 1.9538106471300125, + 2.2307174261659384, + 3.181268882006407, + 2.6668566446751356, + 2.0908174198120832, + 1.5148124545812607, + 3.1645166259258986, + 0.25366286002099514, + 1.7698542512953281, + 1.1128479912877083, + 0.559400787577033, + 2.0547327380627394, + 0.16865700855851173, + 6.88979141227901, + 0.6029525473713875, + 1.586773606017232, + 0.14768166095018387, + 2.3010221887379885, + 2.0421008206903934, + 2.446482127532363, + 0.872071098536253, + 2.1533899046480656, + 0.6013472937047482, + 0.273550134152174, + 1.1003153640776873, + 1.5926354099065065, + 0.17882422730326653, + 1.5279740411788225, + 1.955560676753521, + 0.7514622956514359, + 2.1272055879235268, + 5.761361984536052, + 0.0, + 1.1665418148040771, + 1.981294209137559, + 0.8700458239763975, + 3.4803645219653845, + 2.2114114351570606, + 1.1235658153891563, + 3.6926752664148808, + 1.0402301158756018, + 7.405371658504009, + 0.5633357036858797 + ], + "unique_experts": 63, + "load_cv": 0.6899826923732999, + "normalized_load_entropy": 0.9435779628198471, + "max_load_share": 0.056910569105691054 + }, + "full_input": { + "tokens": 287, + "top_k": 6, + "decisions": 1722, + "ordered_route_sha256": "8c73dccf2a43ae12b32a2296192b252e9a69fbac735ca842f9007e7c0b55a0d8", + "route_weight_sha256": "39082d050035da7603e12cbfa8aaea4b6c12bd0cfc35f2a8384c15eea1986bf1", + "loads": [ + 53, + 19, + 32, + 28, + 2, + 23, + 32, + 13, + 39, + 17, + 12, + 16, + 11, + 10, + 28, + 23, + 26, + 22, + 23, + 50, + 1, + 28, + 35, + 48, + 31, + 30, + 31, + 43, + 11, + 28, + 16, + 11, + 34, + 12, + 51, + 7, + 19, + 7, + 45, + 35, + 33, + 30, + 37, + 10, + 16, + 16, + 23, + 11, + 28, + 29, + 31, + 38, + 60, + 0, + 24, + 37, + 15, + 58, + 30, + 21, + 46, + 25, + 88, + 14 + ], + "weighted_loads": [ + 4.092279426753521, + 0.7137065567076206, + 1.6291770339012146, + 1.1099892258644104, + 0.08265644684433937, + 1.4099336937069893, + 1.555331066250801, + 0.9236020892858505, + 2.7905792631208897, + 0.7378262616693974, + 0.7977530397474766, + 1.2089281268417835, + 0.6763997301459312, + 0.5311154387891293, + 1.994363073259592, + 1.243060689419508, + 3.866646435111761, + 1.0776602067053318, + 1.098452559672296, + 4.33469276688993, + 0.0499497652053833, + 1.9538106471300125, + 2.353273181244731, + 3.354261327534914, + 2.823148022405803, + 2.0908174198120832, + 2.13577825948596, + 3.1950568109750748, + 0.3173514548689127, + 2.5505708269774914, + 1.1128479912877083, + 0.559400787577033, + 2.4376642126590014, + 0.7160543128848076, + 6.88979141227901, + 0.6029525473713875, + 1.586773606017232, + 0.3737746961414814, + 4.077733421698213, + 2.214894413948059, + 2.669043293222785, + 2.3041166104376316, + 2.946816984564066, + 0.6732705123722553, + 2.328180205076933, + 1.1003153640776873, + 1.7267048321664333, + 0.5468932464718819, + 1.5279740411788225, + 1.955560676753521, + 2.401172222569585, + 2.1272055879235268, + 5.761361984536052, + 0.0, + 1.3763038776814938, + 2.717045834288001, + 0.8700458239763975, + 3.9918010737746954, + 2.2687601912766695, + 1.1235658153891563, + 3.6926752664148808, + 1.3234762456268072, + 7.48915705177933, + 0.6806980688124895 + ], + "unique_experts": 63, + "load_cv": 0.5874166737016145, + "normalized_load_entropy": 0.9579354980739649, + "max_load_share": 0.05110336817653891 + } + }, + "s0_bos": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "9411f86bed2744a1dcb3ec468e390e44926595043e742442287342b602e735d8", + "route_weight_sha256": "6953cf7d6622731a466f5b3253f1cd0a7bf72a4b9776e59e3f283d53b4eef73c", + "loads": [ + 55, + 21, + 34, + 28, + 1, + 22, + 19, + 14, + 24, + 12, + 6, + 11, + 13, + 4, + 26, + 24, + 13, + 19, + 22, + 50, + 1, + 28, + 33, + 43, + 26, + 31, + 22, + 41, + 5, + 21, + 17, + 13, + 28, + 4, + 52, + 7, + 18, + 6, + 29, + 30, + 32, + 12, + 27, + 7, + 3, + 15, + 20, + 5, + 27, + 27, + 9, + 38, + 57, + 1, + 18, + 31, + 14, + 48, + 27, + 22, + 45, + 19, + 89, + 10 + ], + "weighted_loads": [ + 4.110538920387626, + 0.8053612764924765, + 1.6902843043208122, + 1.1058091521263123, + 0.03580344468355179, + 1.3446634002029896, + 0.7832912635058165, + 0.9520083777606487, + 1.5537736006081104, + 0.5032583922147751, + 0.27115345746278763, + 0.6165416389703751, + 0.7432724647223949, + 0.17341328412294388, + 1.962940402328968, + 1.338208768516779, + 1.7916680835187435, + 0.9420099277049303, + 1.086402378976345, + 4.4092718586325645, + 0.04611244052648544, + 1.9050169177353382, + 2.2555045187473297, + 2.9764637891203165, + 2.629513991996646, + 2.176162678748369, + 1.4218625873327255, + 3.080196760594845, + 0.1657062228769064, + 1.7376287374645472, + 1.1525940969586372, + 0.625065116211772, + 2.065773230046034, + 0.1831338368356228, + 6.896606598049402, + 0.5963666588068008, + 1.5784561783075333, + 0.24636752158403397, + 2.47408527135849, + 1.9844886288046837, + 2.489194506779313, + 0.8080220967531204, + 2.1339248344302177, + 0.5460089221596718, + 0.1360643245279789, + 1.0851642042398453, + 1.5944666098803282, + 0.2344287522137165, + 1.5194350518286228, + 1.8869803249835968, + 0.7040170431137085, + 2.151786832138896, + 5.5924391485750675, + 0.04198885336518288, + 1.1031019389629364, + 2.048415679484606, + 0.831937812268734, + 3.2965695466846228, + 2.21806344948709, + 1.1579718589782715, + 3.6479618046432734, + 1.0594443511217833, + 7.5836259219795465, + 0.5632705055177212 + ], + "unique_experts": 64, + "load_cv": 0.6979411601908498, + "normalized_load_entropy": 0.9433433192165014, + "max_load_share": 0.06029810298102981 + }, + "full_input": { + "tokens": 271, + "top_k": 6, + "decisions": 1626, + "ordered_route_sha256": "b9a354de6e50c0aa6d432b35367cae0f67f1683505d6b4978e7a33f78ccc4bc5", + "route_weight_sha256": "ff041d8e61475401202699c4e1dda22464ff79ae88162273645fd9ecc49d407f", + "loads": [ + 55, + 21, + 34, + 31, + 1, + 23, + 25, + 14, + 32, + 12, + 8, + 15, + 13, + 9, + 26, + 24, + 28, + 22, + 25, + 51, + 1, + 28, + 36, + 45, + 29, + 31, + 26, + 41, + 7, + 21, + 17, + 13, + 31, + 6, + 52, + 7, + 18, + 6, + 38, + 33, + 32, + 23, + 32, + 8, + 7, + 15, + 22, + 7, + 27, + 27, + 25, + 38, + 57, + 3, + 18, + 38, + 14, + 48, + 30, + 22, + 45, + 25, + 91, + 17 + ], + "weighted_loads": [ + 4.110538920387626, + 0.8053612764924765, + 1.6902843043208122, + 1.2154096588492393, + 0.03580344468355179, + 1.3862373791635036, + 1.3635785523802042, + 0.9520083777606487, + 2.1499665156006813, + 0.5032583922147751, + 0.3354165256023407, + 1.1842145845293999, + 0.7432724647223949, + 0.456430284306407, + 1.962940402328968, + 1.338208768516779, + 3.8946218863129616, + 1.08776786737144, + 1.1695862030610442, + 4.473960019648075, + 0.04611244052648544, + 1.9050169177353382, + 2.42526863142848, + 3.1179060582071543, + 2.7541966643184423, + 2.176162678748369, + 1.7574416995048523, + 3.080196760594845, + 0.21589050069451332, + 1.7376287374645472, + 1.1525940969586372, + 0.625065116211772, + 2.1806994937360287, + 0.272279791533947, + 6.896606598049402, + 0.5963666588068008, + 1.5784561783075333, + 0.24636752158403397, + 3.379901621490717, + 2.1112715005874634, + 2.489194506779313, + 1.7485045418143272, + 2.482414025813341, + 0.5636313036084175, + 0.8234679512679577, + 1.0851642042398453, + 1.6949109602719545, + 0.407365333288908, + 1.5194350518286228, + 1.8869803249835968, + 2.0527192912995815, + 2.151786832138896, + 5.5924391485750675, + 0.11921537294983864, + 1.1031019389629364, + 2.7097383700311184, + 0.831937812268734, + 3.2965695466846228, + 2.288179123774171, + 1.1579718589782715, + 3.6479618046432734, + 1.356300437822938, + 7.626851215958595, + 0.831095801666379 + ], + "unique_experts": 64, + "load_cv": 0.6230701336037591, + "normalized_load_entropy": 0.9539712730310365, + "max_load_share": 0.055965559655596554 + } + }, + "s1_bos": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "a2d7b4dbd931e3dedeab109e919d1c8707c8d9bcb8fb3ae75b4a4fdd8c1b2736", + "route_weight_sha256": "eaa48b07b4000b8084a1fa99584f2c0615bb153e63d68639fde9f0c7f795e8cd", + "loads": [ + 54, + 17, + 32, + 28, + 1, + 22, + 22, + 14, + 23, + 14, + 5, + 11, + 14, + 4, + 26, + 23, + 13, + 19, + 23, + 50, + 2, + 28, + 34, + 43, + 29, + 30, + 21, + 41, + 8, + 21, + 17, + 11, + 29, + 4, + 50, + 8, + 19, + 6, + 28, + 31, + 33, + 11, + 27, + 7, + 2, + 16, + 20, + 5, + 29, + 27, + 10, + 38, + 57, + 0, + 18, + 30, + 14, + 48, + 27, + 22, + 44, + 19, + 87, + 10 + ], + "weighted_loads": [ + 4.164064176380634, + 0.6583714503794909, + 1.6377506069839, + 1.0983548983931541, + 0.03601805493235588, + 1.3372840955853462, + 0.9691607188433409, + 0.9679159335792065, + 1.434576589614153, + 0.5968509651720524, + 0.24286912381649017, + 0.6218022387474775, + 0.7543129473924637, + 0.16795114800333977, + 1.9671017043292522, + 1.2499485164880753, + 1.7634409368038177, + 0.9379508979618549, + 1.135353285819292, + 4.491569129750133, + 0.0874258354306221, + 1.9143108911812305, + 2.289758048951626, + 2.9943696074187756, + 2.78097827360034, + 2.1430914774537086, + 1.3467883989214897, + 3.131142122671008, + 0.2490047588944435, + 1.7413609120994806, + 1.1469489373266697, + 0.5703642815351486, + 2.104149278253317, + 0.18218683823943138, + 6.791408142074943, + 0.6306672841310501, + 1.5922362729907036, + 0.2400033324956894, + 2.344153620302677, + 1.9964059200137854, + 2.578486507758498, + 0.6880522333085537, + 2.137305051088333, + 0.5619779378175735, + 0.10253332555294037, + 1.1239599753171206, + 1.5999966766685247, + 0.1826240886002779, + 1.5874363537877798, + 1.8847275227308273, + 0.744008369743824, + 2.138298649340868, + 5.645366756245494, + 0.0, + 1.128901183605194, + 1.9893686603754759, + 0.8352797664701939, + 3.284935899078846, + 2.2172621469944715, + 1.1556586064398289, + 3.6005983483046293, + 1.051753794774413, + 7.341920651495457, + 0.5502836219966412 + ], + "unique_experts": 63, + "load_cv": 0.6868248114470382, + "normalized_load_entropy": 0.9442879580152698, + "max_load_share": 0.05894308943089431 + }, + "full_input": { + "tokens": 287, + "top_k": 6, + "decisions": 1722, + "ordered_route_sha256": "12a3ada37d890dfd7e908ac3d19b4c9d79234b5d760186044b2efd03826e8cb9", + "route_weight_sha256": "ef1db432498a10ed489797b0e587f92cc16aa37718f2528bb5112e5ac7570086", + "loads": [ + 54, + 17, + 32, + 30, + 2, + 23, + 31, + 14, + 39, + 16, + 12, + 16, + 14, + 9, + 28, + 25, + 29, + 22, + 26, + 51, + 2, + 28, + 36, + 47, + 33, + 30, + 29, + 42, + 10, + 27, + 17, + 11, + 35, + 12, + 50, + 8, + 19, + 10, + 45, + 35, + 35, + 27, + 37, + 9, + 12, + 16, + 24, + 11, + 29, + 27, + 32, + 38, + 57, + 0, + 22, + 38, + 14, + 54, + 29, + 22, + 44, + 25, + 90, + 14 + ], + "weighted_loads": [ + 4.164064176380634, + 0.6583714503794909, + 1.6377506069839, + 1.161474822089076, + 0.0822933129966259, + 1.380965892225504, + 1.6276736911386251, + 0.9679159335792065, + 2.7625121772289276, + 0.6978451423346996, + 0.7965986803174019, + 1.2553256396204233, + 0.7543129473924637, + 0.46718039363622665, + 2.0350295081734657, + 1.3474079631268978, + 4.229744106531143, + 1.0959165208041668, + 1.2136238357052207, + 4.556649474427104, + 0.0874258354306221, + 1.9143108911812305, + 2.4123138040304184, + 3.2142975963652134, + 2.9300118070095778, + 2.1430914774537086, + 2.0196802094578743, + 3.1616823077201843, + 0.29894709400832653, + 2.522077487781644, + 1.1469489373266697, + 0.5703642815351486, + 2.487080752849579, + 0.7295841425657272, + 6.791408142074943, + 0.6306672841310501, + 1.5922362729907036, + 0.4660963676869869, + 4.11033807694912, + 2.1713987942785025, + 2.8010476734489202, + 2.1169533766806126, + 2.9295613914728165, + 0.6199365891516209, + 1.321959339082241, + 1.1239599753171206, + 1.7817414812743664, + 0.5481171812862158, + 1.5874363537877798, + 1.8847275227308273, + 2.5443147849291563, + 2.138298649340868, + 5.645366756245494, + 0.0, + 1.3386632464826107, + 2.725120285525918, + 0.8352797664701939, + 3.796372450888157, + 2.25893434882164, + 1.1556586064398289, + 3.6005983483046293, + 1.3349999245256186, + 7.420150900259614, + 0.667645987123251 + ], + "unique_experts": 63, + "load_cv": 0.5826946685566263, + "normalized_load_entropy": 0.9589143924204065, + "max_load_share": 0.05226480836236934 + } + }, + "s0_x": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "ac4e0ed8442c3bee59dc3b33176d431732ce52e06df98424571b9e6aeca50064", + "route_weight_sha256": "ddc30c70dd2025431eeea7d4c0b87d98147b31752a6004db57e6401d734cff5a", + "loads": [ + 55, + 22, + 37, + 28, + 0, + 23, + 19, + 14, + 26, + 13, + 6, + 9, + 12, + 5, + 25, + 23, + 12, + 18, + 22, + 51, + 1, + 28, + 32, + 44, + 27, + 30, + 24, + 41, + 6, + 21, + 18, + 14, + 28, + 4, + 51, + 7, + 18, + 4, + 31, + 30, + 31, + 12, + 26, + 8, + 3, + 15, + 19, + 3, + 28, + 27, + 8, + 39, + 56, + 1, + 18, + 31, + 14, + 50, + 26, + 21, + 45, + 18, + 88, + 10 + ], + "weighted_loads": [ + 4.12696073576808, + 0.8818699847906828, + 1.7958049923181534, + 1.0916516371071339, + 0.0, + 1.3367401976138353, + 0.7554688937962055, + 0.9586002416908741, + 1.6748977154493332, + 0.544779097661376, + 0.26941524259746075, + 0.5573952458798885, + 0.7092520426958799, + 0.21264775469899178, + 1.9155980329960585, + 1.315315579995513, + 1.744015485048294, + 0.9055206999182701, + 1.1025840602815151, + 4.393088595941663, + 0.04496101289987564, + 1.8861610144376755, + 2.1967438720166683, + 3.024403704330325, + 2.7373296320438385, + 2.088327554985881, + 1.609228204935789, + 3.0866263024508953, + 0.19538725353777409, + 1.7252569328993559, + 1.1721521355211735, + 0.6554634906351566, + 2.067783050239086, + 0.17455823346972466, + 6.965697577223182, + 0.5958891324698925, + 1.5593615304678679, + 0.18033123202621937, + 2.6518883258104324, + 1.968329831957817, + 2.4270072020590305, + 0.8394707553088665, + 2.0904310159385204, + 0.6038935035467148, + 0.14469000697135925, + 1.0803655944764614, + 1.5703611820936203, + 0.18285301700234413, + 1.5598322805017233, + 1.9057885520160198, + 0.5742586180567741, + 2.198052290827036, + 5.61682940274477, + 0.039173707365989685, + 1.091746736317873, + 2.1108428929001093, + 0.8503960110247135, + 3.41173635981977, + 2.2252567410469055, + 1.1252934820950031, + 3.5884722154587507, + 1.0138634964823723, + 7.862275859341025, + 0.5591869652271271 + ], + "unique_experts": 63, + "load_cv": 0.7025140898028842, + "normalized_load_entropy": 0.9415597585997663, + "max_load_share": 0.05962059620596206 + }, + "full_input": { + "tokens": 271, + "top_k": 6, + "decisions": 1626, + "ordered_route_sha256": "c4585114690bec543b69d0d831af54b25de3fb353e0cd0214fcc8449e414280a", + "route_weight_sha256": "760508ece6bbbd61db8b8a62eaef6600a32c4b5223c80e9bd36b7313907b2f00", + "loads": [ + 55, + 22, + 37, + 31, + 0, + 25, + 23, + 14, + 34, + 13, + 8, + 13, + 13, + 11, + 25, + 23, + 28, + 20, + 24, + 52, + 1, + 28, + 35, + 46, + 30, + 30, + 27, + 41, + 8, + 21, + 18, + 14, + 31, + 6, + 51, + 7, + 18, + 4, + 40, + 33, + 31, + 23, + 31, + 9, + 6, + 15, + 22, + 6, + 28, + 27, + 23, + 39, + 56, + 2, + 18, + 38, + 14, + 50, + 29, + 21, + 45, + 25, + 90, + 18 + ], + "weighted_loads": [ + 4.12696073576808, + 0.8818699847906828, + 1.7958049923181534, + 1.201252143830061, + 0.0, + 1.4345874581485987, + 1.1108787581324577, + 0.9586002416908741, + 2.2652055956423283, + 0.544779097661376, + 0.33515853248536587, + 1.1149351485073566, + 0.7463926952332258, + 0.5288383681327105, + 1.9155980329960585, + 1.315315579995513, + 4.125426419079304, + 1.026389628648758, + 1.1440818188712, + 4.454854002222419, + 0.04496101289987564, + 1.8861610144376755, + 2.3665079846978188, + 3.1601563449949026, + 2.862012304365635, + 2.088327554985881, + 1.8837457671761513, + 3.0866263024508953, + 0.245571531355381, + 1.7252569328993559, + 1.1721521355211735, + 0.6554634906351566, + 2.182709313929081, + 0.2640506699681282, + 6.965697577223182, + 0.5958891324698925, + 1.5593615304678679, + 0.18033123202621937, + 3.492267068475485, + 2.089666958898306, + 2.4270072020590305, + 1.7196293324232101, + 2.440725091844797, + 0.6215158849954605, + 0.7851695455610752, + 1.0803655944764614, + 1.7016362696886063, + 0.40086618438363075, + 1.5598322805017233, + 1.9057885520160198, + 1.7192234210669994, + 2.198052290827036, + 5.61682940274477, + 0.0708293691277504, + 1.091746736317873, + 2.772165583446622, + 0.8503960110247135, + 3.41173635981977, + 2.2953724153339863, + 1.1252934820950031, + 3.5884722154587507, + 1.3641847930848598, + 7.905501153320074, + 0.9076055716723204 + ], + "unique_experts": 63, + "load_cv": 0.6265569651143887, + "normalized_load_entropy": 0.9525101937057078, + "max_load_share": 0.055350553505535055 + } + }, + "s1_x": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "28a77c2a6548a183b012c940784fd342867cad22d017dab67c9d73641faeb545", + "route_weight_sha256": "07a15a647e35449230565b205beb440830ea03f41e3abf88c2e1996c0d088753", + "loads": [ + 54, + 20, + 35, + 28, + 0, + 22, + 24, + 14, + 23, + 13, + 5, + 10, + 12, + 4, + 26, + 25, + 13, + 19, + 23, + 49, + 2, + 28, + 34, + 43, + 29, + 30, + 23, + 42, + 6, + 21, + 17, + 14, + 29, + 3, + 50, + 7, + 19, + 6, + 28, + 30, + 32, + 10, + 27, + 7, + 2, + 16, + 20, + 4, + 28, + 26, + 9, + 38, + 57, + 0, + 19, + 30, + 14, + 50, + 26, + 20, + 44, + 18, + 88, + 11 + ], + "weighted_loads": [ + 4.144780429080129, + 0.8078657686710358, + 1.709405168890953, + 1.0712603218853474, + 0.0, + 1.294691687449813, + 1.045343142002821, + 0.9571837745606899, + 1.4278226718306541, + 0.567488407716155, + 0.24286507815122604, + 0.6046057157218456, + 0.6976793240755796, + 0.16535311192274094, + 1.9443553369492292, + 1.349723968654871, + 1.8273639269173145, + 0.9505292996764183, + 1.172155361622572, + 4.416674047708511, + 0.08745821192860603, + 1.904231272637844, + 2.3030333276838064, + 2.9561206828802824, + 2.777303582057357, + 2.1246937587857246, + 1.537180069833994, + 3.1389187425374985, + 0.1872372403740883, + 1.7498936336487532, + 1.1646570935845375, + 0.6742430627346039, + 2.0930686332285404, + 0.13919683173298836, + 6.75409522652626, + 0.6030485592782497, + 1.5826668161898851, + 0.24816051684319973, + 2.3983613587915897, + 1.9275952018797398, + 2.565587619319558, + 0.62199741974473, + 2.1370581947267056, + 0.5711633488535881, + 0.10049626976251602, + 1.121189933270216, + 1.6119699254631996, + 0.18843625113368034, + 1.5639690812677145, + 1.8594211675226688, + 0.6897401697933674, + 2.166580067947507, + 5.690205730497837, + 0.0, + 1.1442227251827717, + 1.9834729842841625, + 0.8451812453567982, + 3.3883948735892773, + 2.2377781216055155, + 1.06624860689044, + 3.5553350038826466, + 1.042541867122054, + 7.501989716663957, + 0.5813796948641539 + ], + "unique_experts": 62, + "load_cv": 0.6967194541645972, + "normalized_load_entropy": 0.9418662238503885, + "max_load_share": 0.05962059620596206 + }, + "full_input": { + "tokens": 287, + "top_k": 6, + "decisions": 1722, + "ordered_route_sha256": "c6c14e99c8b41ad8c9f4d78be9d6cf6cad4f0b4d08f735669348712c4ef8e232", + "route_weight_sha256": "eb6a7801b3edf192b67862e99a44b7b707ca62d50f31934c3cce48ea147bec00", + "loads": [ + 54, + 20, + 35, + 30, + 1, + 24, + 30, + 14, + 39, + 15, + 12, + 15, + 12, + 10, + 28, + 27, + 30, + 23, + 25, + 50, + 2, + 28, + 36, + 47, + 34, + 30, + 31, + 43, + 8, + 27, + 17, + 14, + 35, + 11, + 50, + 7, + 19, + 10, + 43, + 34, + 34, + 25, + 37, + 9, + 11, + 16, + 25, + 11, + 28, + 26, + 30, + 38, + 57, + 0, + 23, + 38, + 14, + 56, + 28, + 20, + 44, + 25, + 91, + 16 + ], + "weighted_loads": [ + 4.144780429080129, + 0.8078657686710358, + 1.709405168890953, + 1.1343802455812693, + 0.04627525806427002, + 1.3926777560263872, + 1.4275631830096245, + 0.9571837745606899, + 2.762235891073942, + 0.6684825848788023, + 0.794956061989069, + 1.2524076960980892, + 0.6976793240755796, + 0.49440267495810986, + 2.0122831407934427, + 1.4471834152936935, + 4.559503331780434, + 1.1650062166154385, + 1.2132530501112342, + 4.4750723131001, + 0.08745821192860603, + 1.904231272637844, + 2.425589082762599, + 3.159601589664817, + 2.959095235913992, + 2.1246937587857246, + 2.196146983653307, + 3.1694589275866747, + 0.2371795754879713, + 2.5306102093309164, + 1.1646570935845375, + 0.6742430627346039, + 2.4760001078248024, + 0.6865941360592842, + 6.75409522652626, + 0.6030485592782497, + 1.5826668161898851, + 0.47425355203449726, + 4.005276013165712, + 2.0989514216780663, + 2.78814878500998, + 1.9260770119726658, + 2.9325427003204823, + 0.6291220001876354, + 1.2839431203901768, + 1.121189933270216, + 1.826791139319539, + 0.6131800040602684, + 1.5639690812677145, + 1.8594211675226688, + 2.2536469120532274, + 2.166580067947507, + 5.690205730497837, + 0.0, + 1.3539847880601883, + 2.7192246094346046, + 0.8451812453567982, + 3.899831425398588, + 2.279450323432684, + 1.06624860689044, + 3.5553350038826466, + 1.3787609692662954, + 7.580219965428114, + 0.7678154241293669 + ], + "unique_experts": 63, + "load_cv": 0.5876370866932067, + "normalized_load_entropy": 0.9579895155495487, + "max_load_share": 0.052845528455284556 + } + }, + "s0_period": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "eb2b58d26e3fdf0f14f0201bd6a551a4131f77c189fea8fd5aa956627196f739", + "route_weight_sha256": "4a68c4a05a81df89ae97f7a32b509d6424196f7ee9c52d4b44a25dcf915d490c", + "loads": [ + 55, + 22, + 36, + 29, + 0, + 22, + 20, + 14, + 26, + 14, + 6, + 8, + 12, + 5, + 25, + 22, + 12, + 18, + 23, + 49, + 1, + 28, + 32, + 46, + 26, + 30, + 22, + 42, + 5, + 20, + 16, + 14, + 27, + 5, + 52, + 7, + 18, + 4, + 31, + 29, + 30, + 12, + 26, + 8, + 3, + 16, + 20, + 5, + 27, + 27, + 10, + 39, + 56, + 1, + 18, + 31, + 14, + 49, + 29, + 22, + 44, + 17, + 89, + 10 + ], + "weighted_loads": [ + 4.138341465964913, + 0.8692488595843315, + 1.76207828335464, + 1.1137255001813173, + 0.0, + 1.3065747693181038, + 0.840205229818821, + 0.9592343382537365, + 1.7042566016316414, + 0.5712135415524244, + 0.2735754419118166, + 0.5254122354090214, + 0.7077683620154858, + 0.21188529953360558, + 1.8979771248996258, + 1.2559864707291126, + 1.7085550799965858, + 0.9032585937529802, + 1.1192951779812574, + 4.245138317346573, + 0.04531645402312279, + 1.8871411196887493, + 2.197717973962426, + 3.1434972155839205, + 2.6778293177485466, + 2.088400300592184, + 1.4739727340638638, + 3.1343586910516024, + 0.1630025152117014, + 1.6942910756915808, + 1.1227895114570856, + 0.6820727363228798, + 2.0455501973629, + 0.2141585499048233, + 7.002843353897333, + 0.5919420346617699, + 1.5497580859810114, + 0.18465933203697205, + 2.671998292207718, + 1.9111048765480518, + 2.3790748678147793, + 0.8658071234822273, + 2.0930197089910507, + 0.5952915996313095, + 0.1475561521947384, + 1.1181817576289177, + 1.5944066178053617, + 0.2546117901802063, + 1.5329516287893057, + 1.91404190659523, + 0.7205623649060726, + 2.1861328575760126, + 5.6065644063055515, + 0.04670972749590874, + 1.0957248117774725, + 2.139510229229927, + 0.8513580150902271, + 3.3792938217520714, + 2.360356079414487, + 1.1634677909314632, + 3.506135892122984, + 0.9858041778206825, + 7.912922164425254, + 0.560831606388092 + ], + "unique_experts": 63, + "load_cv": 0.7015097654130039, + "normalized_load_entropy": 0.9423010784510284, + "max_load_share": 0.06029810298102981 + }, + "full_input": { + "tokens": 271, + "top_k": 6, + "decisions": 1626, + "ordered_route_sha256": "766c5ac40d2765167d92bb7a4fb2a0c2eff358070da67e227f77627a1ecaa1a7", + "route_weight_sha256": "461b0ad0d4a0c01dfd63f96b2bf72ed2d6f933e6bebd06f5482a51d8b9da9000", + "loads": [ + 55, + 22, + 36, + 32, + 0, + 23, + 25, + 14, + 35, + 14, + 8, + 12, + 13, + 10, + 25, + 22, + 28, + 20, + 25, + 50, + 1, + 28, + 36, + 48, + 29, + 30, + 25, + 42, + 7, + 20, + 16, + 14, + 30, + 7, + 52, + 7, + 18, + 4, + 41, + 32, + 30, + 24, + 31, + 9, + 6, + 16, + 21, + 7, + 27, + 27, + 27, + 39, + 56, + 2, + 18, + 38, + 14, + 49, + 32, + 22, + 44, + 23, + 91, + 17 + ], + "weighted_loads": [ + 4.138341465964913, + 0.8692488595843315, + 1.76207828335464, + 1.2233260069042444, + 0.0, + 1.3481487482786179, + 1.2302874587476254, + 0.9592343382537365, + 2.375923201441765, + 0.5712135415524244, + 0.3390104342252016, + 1.0879838950932026, + 0.743826225399971, + 0.49490229971706867, + 1.8979771248996258, + 1.2559864707291126, + 4.057864673435688, + 1.0174361746758223, + 1.1607929365709424, + 4.304146267473698, + 0.04531645402312279, + 1.8871411196887493, + 2.411322111263871, + 3.278910430148244, + 2.802511990070343, + 2.088400300592184, + 1.7463125921785831, + 3.1343586910516024, + 0.21318679302930832, + 1.6942910756915808, + 1.1227895114570856, + 0.6820727363228798, + 2.1604764610528946, + 0.29928912594914436, + 7.002843353897333, + 0.5919420346617699, + 1.5497580859810114, + 0.18465933203697205, + 3.6211378276348114, + 2.033528495579958, + 2.3790748678147793, + 1.8042666725814342, + 2.440527755767107, + 0.6129139810800552, + 0.7888395301997662, + 1.1181817576289177, + 1.6493193376809359, + 0.42665155977010727, + 1.5329516287893057, + 1.91404190659523, + 2.202642187476158, + 2.1861328575760126, + 5.6065644063055515, + 0.07836538925766945, + 1.0957248117774725, + 2.8008329197764397, + 0.8513580150902271, + 3.3792938217520714, + 2.4304717537015676, + 1.1634677909314632, + 3.506135892122984, + 1.2826602645218372, + 7.956147458404303, + 0.8286569025367498 + ], + "unique_experts": 63, + "load_cv": 0.6301397551198559, + "normalized_load_entropy": 0.952199407456855, + "max_load_share": 0.055965559655596554 + } + }, + "s1_period": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "de2180324c711259550ba9c67e58e9c7e3ccedee34ddbe1345eea4ba8aa9f1c2", + "route_weight_sha256": "b993d6d9d5ca178f65ce91ed2b731a6b0def299eb28305b9571a15dc06a5452a", + "loads": [ + 54, + 20, + 37, + 27, + 1, + 22, + 24, + 14, + 22, + 12, + 5, + 11, + 13, + 4, + 26, + 25, + 12, + 18, + 23, + 49, + 2, + 28, + 34, + 43, + 29, + 30, + 24, + 42, + 7, + 21, + 17, + 13, + 29, + 4, + 49, + 7, + 18, + 6, + 27, + 29, + 32, + 11, + 27, + 7, + 2, + 16, + 20, + 4, + 29, + 27, + 10, + 38, + 56, + 0, + 19, + 30, + 14, + 51, + 28, + 19, + 44, + 18, + 85, + 11 + ], + "weighted_loads": [ + 4.155323749408126, + 0.7937810942530632, + 1.7833697982132435, + 1.0465803481638432, + 0.03532041981816292, + 1.305361906066537, + 1.065002603456378, + 0.9578591734170914, + 1.3571156114339828, + 0.531769273802638, + 0.24324101582169533, + 0.6245003119111061, + 0.7387704681605101, + 0.16905929893255234, + 1.949878154322505, + 1.317931743338704, + 1.7484896294772625, + 0.913453221321106, + 1.1644787341356277, + 4.323825115337968, + 0.0869588702917099, + 1.9098199680447578, + 2.291022513061762, + 2.997075639665127, + 2.7624807823449373, + 2.124210288748145, + 1.5908327028155327, + 3.140735389664769, + 0.22103963047266006, + 1.7482487671077251, + 1.170753464102745, + 0.6037128884345293, + 2.103828087449074, + 0.16705679893493652, + 6.7091481275856495, + 0.6007627882063389, + 1.5596586763858795, + 0.24499079957604408, + 2.38785794749856, + 1.901960264891386, + 2.55540082603693, + 0.683065053075552, + 2.135778445750475, + 0.5667275488376617, + 0.10197968780994415, + 1.1236093305051327, + 1.6151298731565475, + 0.1802845448255539, + 1.591957839205861, + 1.9039075188338757, + 0.7472774907946587, + 2.1620443519204855, + 5.657681230455637, + 0.0, + 1.1544781923294067, + 1.9912338815629482, + 0.8464082963764668, + 3.4167165141552687, + 2.3333876337856054, + 1.0377312526106834, + 3.5061791632324457, + 1.0569613687694073, + 7.37644580565393, + 0.5739286839962006 + ], + "unique_experts": 63, + "load_cv": 0.6857118332560298, + "normalized_load_entropy": 0.9437949053083182, + "max_load_share": 0.05758807588075881 + }, + "full_input": { + "tokens": 287, + "top_k": 6, + "decisions": 1722, + "ordered_route_sha256": "65448b5b4ebaab7c95f4f046db50587da65a80fbfb77ffa0f7323f750bcdb730", + "route_weight_sha256": "0313860be9d39850e5be8652f76219bbeeb7379adaafc6e6ffdaa85eb1b83a48", + "loads": [ + 54, + 20, + 37, + 29, + 2, + 23, + 31, + 14, + 39, + 14, + 12, + 16, + 13, + 9, + 28, + 27, + 29, + 22, + 25, + 50, + 2, + 28, + 37, + 46, + 33, + 30, + 32, + 43, + 9, + 27, + 17, + 13, + 36, + 12, + 49, + 7, + 18, + 10, + 44, + 33, + 34, + 27, + 37, + 9, + 11, + 16, + 23, + 10, + 29, + 27, + 33, + 38, + 56, + 0, + 23, + 38, + 14, + 57, + 30, + 19, + 44, + 24, + 88, + 15 + ], + "weighted_loads": [ + 4.155323749408126, + 0.7937810942530632, + 1.7833697982132435, + 1.109700271859765, + 0.08159567788243294, + 1.3490437027066946, + 1.4783428069204092, + 0.9578591734170914, + 2.74996904283762, + 0.6327634509652853, + 0.7954491637647152, + 1.2259816601872444, + 0.7387704681605101, + 0.4682885445654392, + 2.0178059581667185, + 1.4153911899775267, + 4.422794841229916, + 1.1162998266518116, + 1.20557642262429, + 4.38300927169621, + 0.0869588702917099, + 1.9098199680447578, + 2.446410898119211, + 3.1678297892212868, + 2.911514315754175, + 2.124210288748145, + 2.2501234263181686, + 3.1712755747139454, + 0.2709819655865431, + 2.5289653427898884, + 1.170753464102745, + 0.6037128884345293, + 2.5196961909532547, + 0.7144541032612324, + 6.7091481275856495, + 0.6007627882063389, + 1.5596586763858795, + 0.4710838347673416, + 4.115860408172011, + 2.073731068521738, + 2.777961991727352, + 2.0601943284273148, + 2.931545566767454, + 0.6246862001717091, + 1.285806491971016, + 1.1236093305051327, + 1.7491992954164743, + 0.538779329508543, + 1.591957839205861, + 1.9039075188338757, + 2.751773787662387, + 2.1620443519204855, + 5.657681230455637, + 0.0, + 1.3642402552068233, + 2.7269855067133904, + 0.8464082963764668, + 3.9281530659645796, + 2.375059835612774, + 1.0377312526106834, + 3.5061791632324457, + 1.3402074985206127, + 7.454676054418087, + 0.6912910491228104 + ], + "unique_experts": 63, + "load_cv": 0.5820275641414983, + "normalized_load_entropy": 0.9585359694129264, + "max_load_share": 0.05110336817653891 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 246, + "ordered_topk_exact_tokens": 194, + "set_exact_tokens": 218, + "mean_set_jaccard": 0.9666085946573751, + "mean_token_weighted_tv": 0.00923794571582864, + "aggregate_load_tv": 0.01558265582655827 + }, + "system_bos": { + "tokens": 246, + "ordered_topk_exact_tokens": 176, + "set_exact_tokens": 202, + "mean_set_jaccard": 0.9480255516840883, + "mean_token_weighted_tv": 0.01398365636076021, + "aggregate_load_tv": 0.01626016260162602 + }, + "system_x": { + "tokens": 246, + "ordered_topk_exact_tokens": 155, + "set_exact_tokens": 193, + "mean_set_jaccard": 0.9349593495934959, + "mean_token_weighted_tv": 0.017934879189644887, + "aggregate_load_tv": 0.02100271002710028 + }, + "system_period": { + "tokens": 246, + "ordered_topk_exact_tokens": 154, + "set_exact_tokens": 186, + "mean_set_jaccard": 0.9277003484320557, + "mean_token_weighted_tv": 0.01898071375047046, + "aggregate_load_tv": 0.027100271002710032 + }, + "bos_at_s0": { + "tokens": 246, + "ordered_topk_exact_tokens": 153, + "set_exact_tokens": 179, + "mean_set_jaccard": 0.9204413472706157, + "mean_token_weighted_tv": 0.019992495921054263, + "aggregate_load_tv": 0.023712737127371264 + }, + "bos_at_s1": { + "tokens": 246, + "ordered_topk_exact_tokens": 140, + "set_exact_tokens": 178, + "mean_set_jaccard": 0.9140534262485481, + "mean_token_weighted_tv": 0.022363072405077095, + "aggregate_load_tv": 0.023712737127371278 + }, + "x_at_s0": { + "tokens": 246, + "ordered_topk_exact_tokens": 153, + "set_exact_tokens": 184, + "mean_set_jaccard": 0.924506387921022, + "mean_token_weighted_tv": 0.020392255092842308, + "aggregate_load_tv": 0.027100271002710036 + }, + "x_at_s1": { + "tokens": 246, + "ordered_topk_exact_tokens": 133, + "set_exact_tokens": 166, + "mean_set_jaccard": 0.8968253968253967, + "mean_token_weighted_tv": 0.026433507964863042, + "aggregate_load_tv": 0.025745257452574527 + }, + "period_at_s0": { + "tokens": 246, + "ordered_topk_exact_tokens": 154, + "set_exact_tokens": 181, + "mean_set_jaccard": 0.9218931475029035, + "mean_token_weighted_tv": 0.021183710643733904, + "aggregate_load_tv": 0.027777777777777783 + }, + "period_at_s1": { + "tokens": 246, + "ordered_topk_exact_tokens": 137, + "set_exact_tokens": 171, + "mean_set_jaccard": 0.9035036778939218, + "mean_token_weighted_tv": 0.02519216729948918, + "aggregate_load_tv": 0.025745257452574527 + } + } + }, + "layer_08": { + "layer": 8, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "38dfe8f88d26ed01c2713c2766d20b7d6d69c5d64f21d54513efc678e132fb81", + "route_weight_sha256": "e06c9ac402d2bd782d12cd27ae82d966f7071886e30948043b73da2b2e876bac", + "loads": [ + 22, + 4, + 0, + 34, + 33, + 19, + 27, + 27, + 4, + 12, + 34, + 4, + 29, + 24, + 23, + 30, + 24, + 16, + 15, + 26, + 33, + 14, + 44, + 3, + 74, + 17, + 5, + 2, + 38, + 47, + 36, + 13, + 24, + 17, + 35, + 28, + 6, + 7, + 30, + 42, + 17, + 31, + 54, + 27, + 22, + 28, + 4, + 53, + 31, + 25, + 6, + 10, + 18, + 18, + 12, + 17, + 14, + 46, + 50, + 21, + 29, + 0, + 9, + 12 + ], + "weighted_loads": [ + 1.1569610424339771, + 0.1490550935268402, + 0.0, + 2.4016648456454277, + 2.6544886641204357, + 0.8836512286216021, + 1.78638581559062, + 1.4980452135205269, + 0.1563310083001852, + 0.7105722688138485, + 2.4172493517398834, + 0.14777604676783085, + 1.9894369654357433, + 1.6969972755759954, + 1.1912379432469606, + 1.8616207912564278, + 1.4628181755542755, + 0.6357224006205797, + 0.6573321595788002, + 1.4603476077318192, + 2.546567142009735, + 0.9042295962572098, + 2.813259944319725, + 0.12403523735702038, + 5.317771498113871, + 1.1975750178098679, + 0.32275770604610443, + 0.06563710793852806, + 2.226534051820636, + 3.476814968511462, + 3.4257513992488384, + 1.2720281146466732, + 1.9091750979423523, + 0.7169914338737726, + 2.4427258744835854, + 1.300033202394843, + 0.2249387577176094, + 0.3555497080087662, + 1.5975939221680164, + 2.717360720038414, + 0.6057059746235609, + 1.4300896171480417, + 3.765599559992552, + 1.242026500403881, + 0.9468621015548706, + 1.8788160867989063, + 0.21621768921613693, + 5.1049254685640335, + 1.7048150431364775, + 1.285314541310072, + 0.5163934305310249, + 0.6327955238521099, + 1.225135451182723, + 1.0506941676139832, + 0.8093021288514137, + 1.1760404910892248, + 0.7237300276756287, + 3.451179850846529, + 4.168382024392486, + 1.1280536577105522, + 1.4113969039171934, + 0.0, + 0.44746076315641403, + 1.1317604649811983 + ], + "unique_experts": 62, + "load_cv": 0.6483651343224051, + "normalized_load_entropy": 0.9462724698370578, + "max_load_share": 0.05013550135501355 + }, + "full_input": { + "tokens": 271, + "top_k": 6, + "decisions": 1626, + "ordered_route_sha256": "2088e155dd76822ce691433884f9d77e6bb5f982682b6018da1bff1f93a4c2c4", + "route_weight_sha256": "74435112ff3812b53c7570b9e31b12951e01e283fffe4699e2e17160d7fbbc50", + "loads": [ + 22, + 10, + 2, + 35, + 35, + 19, + 32, + 28, + 13, + 12, + 35, + 7, + 36, + 31, + 23, + 30, + 24, + 19, + 16, + 26, + 34, + 14, + 46, + 3, + 74, + 28, + 6, + 2, + 38, + 47, + 39, + 13, + 28, + 29, + 35, + 28, + 6, + 7, + 30, + 49, + 23, + 31, + 54, + 27, + 22, + 35, + 11, + 57, + 32, + 28, + 9, + 10, + 29, + 18, + 16, + 24, + 14, + 46, + 54, + 21, + 29, + 0, + 10, + 15 + ], + "weighted_loads": [ + 1.1569610424339771, + 0.5159323811531067, + 0.039135437458753586, + 2.4702597334980965, + 2.7183400290086865, + 0.8836512286216021, + 2.2176326103508472, + 1.5428797900676727, + 0.7730462234467268, + 0.7105722688138485, + 2.491120368242264, + 0.2582024931907654, + 2.374527484178543, + 2.165516344830394, + 1.1912379432469606, + 1.8616207912564278, + 1.4628181755542755, + 0.802070127800107, + 0.6911608725786209, + 1.4603476077318192, + 2.613606408238411, + 0.9042295962572098, + 2.886213544756174, + 0.12403523735702038, + 5.317771498113871, + 1.9641850963234901, + 0.36190254241228104, + 0.06563710793852806, + 2.226534051820636, + 3.476814968511462, + 3.4911561897024512, + 1.2720281146466732, + 2.0800837837159634, + 1.7177445888519287, + 2.4427258744835854, + 1.300033202394843, + 0.2249387577176094, + 0.3555497080087662, + 1.5975939221680164, + 2.93184822704643, + 0.9430105891078711, + 1.4300896171480417, + 3.765599559992552, + 1.242026500403881, + 0.9468621015548706, + 2.4628871306777, + 0.957200713455677, + 5.225940267555416, + 1.7442013565450907, + 1.4409859515726566, + 0.6884189620614052, + 0.6327955238521099, + 1.885497409850359, + 1.0506941676139832, + 2.3892080783843994, + 1.6442392654716969, + 0.7237300276756287, + 3.451179850846529, + 4.2829614956863225, + 1.1280536577105522, + 1.4113969039171934, + 0.0, + 0.4940897859632969, + 1.3378276880830526 + ], + "unique_experts": 63, + "load_cv": 0.5865688661412982, + "normalized_load_entropy": 0.9559147540244863, + "max_load_share": 0.04551045510455105 + } + }, + "s1_eos": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "425271c0c42b22df88e8b35538a5bdd9da2949a85b4cfc2e0ecbbc9ebe584ff3", + "route_weight_sha256": "ee6b18ebd2ebf558faa9691a18a2a7d1ff893c2285afaab7fd5716cb0986e82d", + "loads": [ + 22, + 4, + 0, + 34, + 33, + 17, + 28, + 27, + 5, + 13, + 33, + 3, + 27, + 23, + 23, + 29, + 24, + 13, + 15, + 26, + 34, + 14, + 44, + 2, + 72, + 17, + 6, + 2, + 40, + 49, + 37, + 13, + 24, + 19, + 36, + 27, + 7, + 8, + 30, + 41, + 18, + 31, + 55, + 25, + 21, + 28, + 4, + 54, + 31, + 26, + 6, + 10, + 17, + 17, + 12, + 16, + 14, + 47, + 49, + 21, + 28, + 2, + 10, + 13 + ], + "weighted_loads": [ + 1.1300939694046974, + 0.1421721987426281, + 0.0, + 2.418908938765526, + 2.60323366522789, + 0.810807354748249, + 1.7923084124922752, + 1.4979297332465649, + 0.18271316960453987, + 0.7464199475944042, + 2.3999424129724503, + 0.09324329532682896, + 1.8960600420832634, + 1.6272815223783255, + 1.189864158630371, + 1.8257196731865406, + 1.4738519042730331, + 0.5025717802345753, + 0.6639078799635172, + 1.4750010967254639, + 2.628009919077158, + 0.9050936885178089, + 2.8049992695450783, + 0.0962677039206028, + 5.2568732760846615, + 1.1885712537914515, + 0.3708634674549103, + 0.06489006616175175, + 2.314388332888484, + 3.608883859589696, + 3.4424666725099087, + 1.2787505201995373, + 1.922938697040081, + 0.7829205878078938, + 2.4705992713570595, + 1.2579818833619356, + 0.2684335857629776, + 0.38076623529195786, + 1.610407905653119, + 2.660296333953738, + 0.6442376747727394, + 1.4441015012562275, + 3.807549450546503, + 1.180565420538187, + 0.9125681947916746, + 1.858511095866561, + 0.22198251262307167, + 5.176290122792125, + 1.71095447614789, + 1.3267730344086885, + 0.5120257548987865, + 0.6408194191753864, + 1.2165254950523376, + 1.023577455431223, + 0.8015121333301067, + 1.1374035999178886, + 0.741841796785593, + 3.4537329841405153, + 4.160748343914747, + 1.1350950859487057, + 1.3691827207803726, + 0.07356885820627213, + 0.48856200091540813, + 1.1387703195214272 + ], + "unique_experts": 63, + "load_cv": 0.6463229986056486, + "normalized_load_entropy": 0.9474320725910661, + "max_load_share": 0.04878048780487805 + }, + "full_input": { + "tokens": 287, + "top_k": 6, + "decisions": 1722, + "ordered_route_sha256": "c09963d9e1aae365b578d8e47b54e63965598a1faea6c76913237e34a809b464", + "route_weight_sha256": "17eb83ac2a07b58c913575a64e7154fddf5d5fbcd6719ab0e7b240a67810e4cb", + "loads": [ + 23, + 10, + 10, + 36, + 33, + 18, + 39, + 27, + 18, + 13, + 37, + 7, + 36, + 30, + 23, + 29, + 24, + 27, + 17, + 26, + 35, + 14, + 45, + 6, + 72, + 28, + 6, + 4, + 41, + 49, + 40, + 13, + 27, + 37, + 36, + 27, + 7, + 8, + 37, + 47, + 31, + 31, + 57, + 25, + 21, + 41, + 19, + 58, + 36, + 31, + 10, + 10, + 25, + 23, + 16, + 26, + 14, + 47, + 52, + 23, + 28, + 6, + 12, + 18 + ], + "weighted_loads": [ + 1.169089861214161, + 0.4532970879226923, + 0.6181515082716942, + 2.545074589550495, + 2.60323366522789, + 0.8557440340518951, + 2.7293469235301018, + 1.4979297332465649, + 1.0363080464303493, + 0.7464199475944042, + 2.6111063323915005, + 0.21244046208448708, + 2.426218081265688, + 2.0738466884940863, + 1.189864158630371, + 1.8257196731865406, + 1.4738519042730331, + 1.5112250186502934, + 0.7604466360062361, + 1.4750010967254639, + 2.6958598606288433, + 0.9050936885178089, + 2.8460842594504356, + 0.2865945063531399, + 5.2568732760846615, + 2.282205944880843, + 0.3708634674549103, + 0.18490863405168056, + 2.356956919655204, + 3.608883859589696, + 3.5085542905144393, + 1.2787505201995373, + 2.028886452317238, + 2.066168734803796, + 2.4705992713570595, + 1.2579818833619356, + 0.2684335857629776, + 0.38076623529195786, + 2.0511007700115442, + 2.825094480998814, + 1.231839396059513, + 1.4441015012562275, + 3.974620081484318, + 1.180565420538187, + 0.9125681947916746, + 3.0164434369653463, + 1.3207516111433506, + 5.293216391466558, + 2.0990969873964787, + 1.6482845526188612, + 0.7295364737510681, + 0.6408194191753864, + 1.704538332298398, + 1.6965321339666843, + 2.387291634455323, + 1.8409582078456879, + 0.741841796785593, + 3.4537329841405153, + 4.261476464802399, + 1.2068259380757809, + 1.3691827207803726, + 0.25999167189002037, + 0.5894590448588133, + 1.4325123392045498 + ], + "unique_experts": 64, + "load_cv": 0.5374130706323322, + "normalized_load_entropy": 0.9644221793186623, + "max_load_share": 0.041811846689895474 + } + }, + "s0_bos": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "5cc4c3082ea692796efe2f776907bac98ea99d1191f2d0135d61a56342e7b7f6", + "route_weight_sha256": "c736da3cbeda380b22203702fbc9aa9914123622d34f0428d0617c5028bfb165", + "loads": [ + 21, + 4, + 1, + 36, + 32, + 17, + 28, + 28, + 3, + 12, + 36, + 5, + 28, + 24, + 23, + 29, + 24, + 13, + 14, + 27, + 34, + 14, + 44, + 2, + 73, + 20, + 7, + 2, + 38, + 46, + 37, + 13, + 25, + 17, + 36, + 26, + 6, + 9, + 28, + 39, + 14, + 33, + 56, + 30, + 19, + 28, + 3, + 54, + 31, + 26, + 5, + 11, + 16, + 17, + 12, + 16, + 16, + 45, + 51, + 22, + 29, + 0, + 10, + 11 + ], + "weighted_loads": [ + 1.0881009586155415, + 0.15141921862959862, + 0.03831233084201813, + 2.4792663529515266, + 2.5517900679260492, + 0.8222579285502434, + 1.8605811335146427, + 1.5211527235805988, + 0.13629918918013573, + 0.6995403803884983, + 2.484738852828741, + 0.1884801834821701, + 1.9649774692952633, + 1.7067003659904003, + 1.2006179671734571, + 1.794844251126051, + 1.4282094947993755, + 0.5170765481889248, + 0.6113150175660849, + 1.5148038547486067, + 2.561164792627096, + 0.9266186058521271, + 2.8675655722618103, + 0.09380248188972473, + 5.318593529984355, + 1.3789537530392408, + 0.3917673919349909, + 0.06679989211261272, + 2.2866961155086756, + 3.396988920867443, + 3.446010798215866, + 1.3193375617265701, + 1.959737565368414, + 0.7678701225668192, + 2.4708967432379723, + 1.1440286673605442, + 0.22250641137361526, + 0.43096309527754784, + 1.5180328525602818, + 2.5822455883026123, + 0.47603523544967175, + 1.509235566481948, + 3.94708969630301, + 1.3783296011388302, + 0.8218364547938108, + 1.833125676959753, + 0.13873444311320782, + 5.078643141314387, + 1.72706463560462, + 1.3617538046091795, + 0.4642796106636524, + 0.7241878248751163, + 1.171960711479187, + 1.0227537713944912, + 0.8002853989601135, + 1.099794004112482, + 0.7944601625204086, + 3.358002930879593, + 4.094595491886139, + 1.1789315324276686, + 1.420015275478363, + 0.0, + 0.4700497258454561, + 1.16800451092422 + ], + "unique_experts": 63, + "load_cv": 0.6525652971824027, + "normalized_load_entropy": 0.9459623125269494, + "max_load_share": 0.0494579945799458 + }, + "full_input": { + "tokens": 271, + "top_k": 6, + "decisions": 1626, + "ordered_route_sha256": "ed5c7987729d66acdd164e6a01bfd89c9ab6776eb7a9f5b79890a700623bf875", + "route_weight_sha256": "cd4d237ac46a98413adec59d431f8676dac3a46115fe4a90a1bc6b2bb036d837", + "loads": [ + 21, + 10, + 3, + 37, + 33, + 17, + 33, + 29, + 12, + 12, + 38, + 8, + 35, + 31, + 23, + 30, + 24, + 17, + 15, + 27, + 35, + 14, + 46, + 2, + 74, + 32, + 7, + 2, + 38, + 46, + 40, + 13, + 30, + 29, + 36, + 26, + 6, + 9, + 28, + 45, + 19, + 33, + 56, + 30, + 19, + 35, + 10, + 57, + 32, + 29, + 8, + 11, + 27, + 17, + 16, + 23, + 16, + 45, + 54, + 22, + 29, + 0, + 11, + 14 + ], + "weighted_loads": [ + 1.0881009586155415, + 0.5182965062558651, + 0.07744776830077171, + 2.5466648042201996, + 2.6128343511372805, + 0.8222579285502434, + 2.3060729019343853, + 1.5659873001277447, + 0.7734886892139912, + 0.6995403803884983, + 2.606235697865486, + 0.2961168084293604, + 2.350067988038063, + 2.177128091454506, + 1.2006179671734571, + 1.8419341929256916, + 1.4282094947993755, + 0.714611504226923, + 0.6481939386576414, + 1.5148038547486067, + 2.627560544759035, + 0.9266186058521271, + 2.9405191726982594, + 0.09380248188972473, + 5.365289544686675, + 2.2040516044944525, + 0.3917673919349909, + 0.06679989211261272, + 2.2866961155086756, + 3.396988920867443, + 3.560761483386159, + 1.3193375617265701, + 2.1884731985628605, + 1.7788091637194157, + 2.4708967432379723, + 1.1440286673605442, + 0.22250641137361526, + 0.43096309527754784, + 1.5180328525602818, + 2.809656208381057, + 0.7844635639339685, + 1.509235566481948, + 3.94708969630301, + 1.3783296011388302, + 0.8218364547938108, + 2.374324593693018, + 0.791532201692462, + 5.1902657141909, + 1.7664509490132332, + 1.515186769887805, + 0.6363051421940327, + 0.7241878248751163, + 1.832322670146823, + 1.0227537713944912, + 1.5086510516703129, + 1.5777385849505663, + 0.7944601625204086, + 3.358002930879593, + 4.206142440438271, + 1.1789315324276686, + 1.420015275478363, + 0.0, + 0.516678748652339, + 1.3740717340260744 + ], + "unique_experts": 63, + "load_cv": 0.5887931540132718, + "normalized_load_entropy": 0.9557993490595391, + "max_load_share": 0.04551045510455105 + } + }, + "s1_bos": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "336bc2f6a7cf097fe19e8bce4579508f4be086ccb59b448b8a3065ede24a3e21", + "route_weight_sha256": "1f1648262a99e7f425f9ecc4ab2b96ccd1639144ad199a6d99ce83cd0201785a", + "loads": [ + 21, + 5, + 0, + 35, + 32, + 17, + 29, + 27, + 3, + 13, + 36, + 3, + 29, + 24, + 22, + 28, + 24, + 13, + 14, + 27, + 37, + 13, + 42, + 2, + 71, + 20, + 7, + 2, + 41, + 46, + 37, + 13, + 24, + 19, + 36, + 25, + 6, + 8, + 29, + 39, + 12, + 31, + 58, + 31, + 20, + 29, + 3, + 52, + 30, + 24, + 6, + 13, + 17, + 18, + 13, + 15, + 17, + 47, + 50, + 22, + 27, + 0, + 10, + 12 + ], + "weighted_loads": [ + 1.0764902140945196, + 0.17089574597775936, + 0.0, + 2.444388035684824, + 2.5297286603599787, + 0.8208334315568209, + 1.9212281256914139, + 1.5156176500022411, + 0.12838362529873848, + 0.7528370879590511, + 2.491899624466896, + 0.09304138645529747, + 1.9781931284815073, + 1.6892252825200558, + 1.171950152143836, + 1.7058725394308567, + 1.4393782578408718, + 0.4955967850983143, + 0.6154685765504837, + 1.5134670622646809, + 2.6871578209102154, + 0.8894442357122898, + 2.73052716255188, + 0.09486933052539825, + 5.197712253779173, + 1.410746606066823, + 0.40303335152566433, + 0.06262508407235146, + 2.4158050753176212, + 3.433421518653631, + 3.40277910977602, + 1.321989182382822, + 1.9581084474921227, + 0.8271094094961882, + 2.509871132671833, + 1.1065975166857243, + 0.21615052223205566, + 0.39057279750704765, + 1.530552089214325, + 2.580599695444107, + 0.41041594184935093, + 1.4227270316332579, + 4.035001961514354, + 1.3913285750895739, + 0.8648980241268873, + 1.8608420137315989, + 0.12226098403334618, + 5.065513510257006, + 1.683336466550827, + 1.2750284560024738, + 0.48664800077676773, + 0.7960543129593134, + 1.2597885131835938, + 1.062175590544939, + 0.8407290708273649, + 1.069375678896904, + 0.8423551861196756, + 3.47258472815156, + 4.003203433007002, + 1.2031698655337095, + 1.3717485573142767, + 0.0, + 0.48424921184778214, + 1.1087182741612196 + ], + "unique_experts": 62, + "load_cv": 0.6493611744295543, + "normalized_load_entropy": 0.9456940937181104, + "max_load_share": 0.048102981029810296 + }, + "full_input": { + "tokens": 287, + "top_k": 6, + "decisions": 1722, + "ordered_route_sha256": "7f80a64a58b34720db93d6950853dc8645dbaf8f6c7169d841cc1ade84f37b0a", + "route_weight_sha256": "7161990eddabb6ba084f0932a9ea7c7f5bf189068f8b15c6f160dc51a6b39734", + "loads": [ + 22, + 11, + 10, + 37, + 33, + 18, + 40, + 27, + 17, + 13, + 39, + 6, + 38, + 31, + 22, + 28, + 24, + 28, + 16, + 27, + 38, + 13, + 43, + 6, + 71, + 31, + 7, + 4, + 42, + 46, + 40, + 13, + 27, + 39, + 36, + 25, + 6, + 8, + 36, + 44, + 24, + 31, + 60, + 31, + 20, + 43, + 18, + 55, + 35, + 30, + 10, + 13, + 25, + 24, + 16, + 25, + 17, + 47, + 52, + 23, + 27, + 4, + 12, + 18 + ], + "weighted_loads": [ + 1.1154861059039831, + 0.48202063515782356, + 0.6181515082716942, + 2.5718631856143475, + 2.577092071995139, + 0.865770110860467, + 2.8638115897774696, + 1.5156176500022411, + 1.066661972552538, + 0.7528370879590511, + 2.656491197645664, + 0.20909694395959377, + 2.508351167663932, + 2.1388833969831467, + 1.171950152143836, + 1.7058725394308567, + 1.4393782578408718, + 1.5405196733772755, + 0.7117838375270367, + 1.5134670622646809, + 2.755830015987158, + 0.8894442357122898, + 2.7716121524572372, + 0.28519613295793533, + 5.197712253779173, + 2.5043812971562147, + 0.40303335152566433, + 0.18264365196228027, + 2.458373662084341, + 3.433421518653631, + 3.510188451036811, + 1.321989182382822, + 2.0640562027692795, + 2.2624785117805004, + 2.509871132671833, + 1.1065975166857243, + 0.21615052223205566, + 0.39057279750704765, + 1.9686989486217499, + 2.748575784265995, + 0.9901410695165396, + 1.4227270316332579, + 4.2020725924521685, + 1.3913285750895739, + 0.8648980241268873, + 3.048413572832942, + 1.1756520867347717, + 5.173463989980519, + 2.0714789777994156, + 1.6377092897891998, + 0.7041587196290493, + 0.7960543129593134, + 1.7478013504296541, + 1.7351302690804005, + 1.5112143531441689, + 1.77959905564785, + 0.8423551861196756, + 3.47258472815156, + 4.1010439321398735, + 1.235689802095294, + 1.3717485573142767, + 0.18642281368374825, + 0.5851462557911873, + 1.4549906495958567 + ], + "unique_experts": 64, + "load_cv": 0.5367701086258232, + "normalized_load_entropy": 0.9641758621382585, + "max_load_share": 0.04123112659698026 + } + }, + "s0_x": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "5850249058d92f2535b5f1e5b425028518e975bc2fd4528b0e694e138aa3a2b5", + "route_weight_sha256": "c1769adfe25fd23faab5e248d1f31bab6b0f72a1e00df806c081a3f0070d8a22", + "loads": [ + 23, + 4, + 3, + 35, + 33, + 17, + 28, + 28, + 4, + 13, + 36, + 4, + 28, + 23, + 23, + 29, + 24, + 8, + 17, + 26, + 32, + 14, + 43, + 2, + 74, + 19, + 7, + 2, + 34, + 46, + 37, + 13, + 24, + 17, + 36, + 27, + 6, + 8, + 26, + 39, + 15, + 32, + 58, + 29, + 22, + 29, + 4, + 53, + 30, + 29, + 5, + 11, + 16, + 17, + 12, + 17, + 15, + 46, + 51, + 20, + 29, + 1, + 9, + 14 + ], + "weighted_loads": [ + 1.1729664094746113, + 0.16342120245099068, + 0.12783805280923843, + 2.3780585285276175, + 2.5959581192582846, + 0.7965160477906466, + 1.90600148960948, + 1.5326773896813393, + 0.1727294009178877, + 0.7433351539075375, + 2.4499600268900394, + 0.17635080590844154, + 1.982899583876133, + 1.6456020195037127, + 1.199309941381216, + 1.865363448858261, + 1.4355900883674622, + 0.2728345822542906, + 0.7205917909741402, + 1.4660216942429543, + 2.37328864634037, + 0.9204840362071991, + 2.803013451397419, + 0.09327972307801247, + 5.384521000087261, + 1.373673452064395, + 0.3812383469194174, + 0.06788908131420612, + 2.0947397258132696, + 3.3787528835237026, + 3.451809000223875, + 1.3263688161969185, + 1.9231501668691635, + 0.763814389705658, + 2.5355392433702946, + 1.2103052139282227, + 0.22309653833508492, + 0.40798425674438477, + 1.4425680078566074, + 2.547737345099449, + 0.544110294431448, + 1.4786589741706848, + 4.006107941269875, + 1.3358111716806889, + 0.9352764114737511, + 1.9821466319262981, + 0.21113446727395058, + 4.986914940178394, + 1.678446277976036, + 1.4818402417004108, + 0.4673476368188858, + 0.6910945773124695, + 1.1585749052464962, + 1.0142037384212017, + 0.7966062277555466, + 1.2076105568557978, + 0.7435272186994553, + 3.491367280483246, + 4.282829934731126, + 1.109271226450801, + 1.4236628729850054, + 0.03723447769880295, + 0.4360085092484951, + 1.2953485045582056 + ], + "unique_experts": 64, + "load_cv": 0.6494968797321131, + "normalized_load_entropy": 0.9476694043608102, + "max_load_share": 0.05013550135501355 + }, + "full_input": { + "tokens": 271, + "top_k": 6, + "decisions": 1626, + "ordered_route_sha256": "9405020de6412f79acbe33b7da82f87ab5f1ecc003b42cb54545a4532e2f3f09", + "route_weight_sha256": "6fde6c1e35bcc6093bfb2ab604c86876791c18117925874dc53fe328857b93d0", + "loads": [ + 23, + 11, + 6, + 37, + 34, + 17, + 34, + 29, + 14, + 13, + 37, + 7, + 35, + 31, + 23, + 29, + 24, + 11, + 18, + 26, + 33, + 14, + 45, + 2, + 74, + 32, + 7, + 2, + 34, + 46, + 39, + 13, + 30, + 28, + 36, + 27, + 6, + 8, + 26, + 44, + 20, + 32, + 58, + 29, + 22, + 35, + 11, + 56, + 31, + 33, + 9, + 11, + 27, + 17, + 14, + 24, + 15, + 46, + 54, + 20, + 29, + 1, + 10, + 17 + ], + "weighted_loads": [ + 1.1729664094746113, + 0.5827138647437096, + 0.20873137190937996, + 2.4938529450446367, + 2.657002402469516, + 0.7965160477906466, + 2.3845944106578827, + 1.577511966228485, + 0.8819641601294279, + 0.7433351539075375, + 2.5240199975669384, + 0.28543500788509846, + 2.3679901026189327, + 2.1996327955275774, + 1.199309941381216, + 1.865363448858261, + 1.4355900883674622, + 0.4148129913955927, + 0.7584514617919922, + 1.4660216942429543, + 2.439772330224514, + 0.9204840362071991, + 2.875967051833868, + 0.09327972307801247, + 5.384521000087261, + 2.2895187567919493, + 0.3812383469194174, + 0.06788908131420612, + 2.0947397258132696, + 3.3787528835237026, + 3.5067746993154287, + 1.3263688161969185, + 2.201644644141197, + 1.6076122540980577, + 2.5355392433702946, + 1.2103052139282227, + 0.22309653833508492, + 0.40798425674438477, + 1.4425680078566074, + 2.7158235739916563, + 0.8349429555237293, + 1.4786589741706848, + 4.006107941269875, + 1.3358111716806889, + 0.9352764114737511, + 2.4725720435380936, + 0.8712644204497337, + 5.098537513054907, + 1.7178325913846493, + 1.6898635812103748, + 0.6939470358192921, + 0.6910945773124695, + 1.8189368639141321, + 1.0142037384212017, + 1.4205262064933777, + 1.6821121908724308, + 0.7435272186994553, + 3.491367280483246, + 4.3943768832832575, + 1.109271226450801, + 1.4236628729850054, + 0.03723447769880295, + 0.48263753205537796, + 1.50141572766006 + ], + "unique_experts": 64, + "load_cv": 0.5820947927555027, + "normalized_load_entropy": 0.9575604058277548, + "max_load_share": 0.04551045510455105 + } + }, + "s1_x": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "3beb94554509e03de697b354e39e7728301ce4d01239653b450599c72fa66bef", + "route_weight_sha256": "a8fb4a74807dea57622b9c701963658e23108fd96e665eac74a3188f635c4cb4", + "loads": [ + 22, + 4, + 0, + 37, + 31, + 18, + 29, + 28, + 3, + 13, + 35, + 4, + 27, + 23, + 23, + 29, + 23, + 8, + 14, + 25, + 34, + 14, + 42, + 2, + 72, + 21, + 7, + 2, + 41, + 46, + 37, + 13, + 24, + 15, + 37, + 26, + 6, + 9, + 28, + 40, + 11, + 33, + 58, + 32, + 22, + 30, + 3, + 50, + 29, + 26, + 7, + 12, + 17, + 18, + 12, + 16, + 15, + 46, + 51, + 23, + 30, + 0, + 9, + 14 + ], + "weighted_loads": [ + 1.1238359957933426, + 0.15779387019574642, + 0.0, + 2.5218544229865074, + 2.4675320368260145, + 0.854884896427393, + 1.9403940588235855, + 1.5754486285150051, + 0.13297991268336773, + 0.743301585316658, + 2.4160210713744164, + 0.13959411345422268, + 1.9006668664515018, + 1.6328247766941786, + 1.1867195293307304, + 1.7876877188682556, + 1.4005218110978603, + 0.2965487539768219, + 0.6052821613848209, + 1.43054317869246, + 2.4781977981328964, + 0.9188533127307892, + 2.7180661968886852, + 0.09527584537863731, + 5.348584080114961, + 1.5250151734799147, + 0.41251032799482346, + 0.06424380466341972, + 2.4674571808427572, + 3.3871304728090763, + 3.402347318828106, + 1.3280324079096317, + 1.9391353353857994, + 0.6616750918328762, + 2.574036307632923, + 1.1441266927868128, + 0.2146812342107296, + 0.43888240307569504, + 1.4859603103250265, + 2.574071602895856, + 0.3897703643888235, + 1.4714178293943405, + 4.0119613371789455, + 1.408017685636878, + 0.9772022906690836, + 1.9418971817940474, + 0.1458578109741211, + 4.88981962390244, + 1.6455426309257746, + 1.3451268654316664, + 0.5211364813148975, + 0.7453949376940727, + 1.2208359614014626, + 1.051479384303093, + 0.7941216789186001, + 1.1408995185047388, + 0.7548829261213541, + 3.4411509297788143, + 4.107464516535401, + 1.2549560759216547, + 1.4695661924779415, + 0.0, + 0.44289468973875046, + 1.1800719294697046 + ], + "unique_experts": 62, + "load_cv": 0.6535998841137068, + "normalized_load_entropy": 0.9449932956303573, + "max_load_share": 0.04878048780487805 + }, + "full_input": { + "tokens": 287, + "top_k": 6, + "decisions": 1722, + "ordered_route_sha256": "edc2de7f715faab13a1e5c9d2b6cc0d53c3e2664b0807a7d36b7143c53e03441", + "route_weight_sha256": "7cd693c4555849f810b3c1fe22d2b8ff66233babf8d25f78397ff85c4affcc2f", + "loads": [ + 23, + 11, + 11, + 40, + 31, + 19, + 42, + 28, + 17, + 13, + 39, + 8, + 36, + 32, + 23, + 29, + 23, + 22, + 16, + 25, + 35, + 14, + 43, + 6, + 72, + 35, + 7, + 4, + 42, + 46, + 39, + 13, + 28, + 31, + 37, + 26, + 6, + 9, + 35, + 44, + 22, + 33, + 60, + 32, + 22, + 43, + 17, + 53, + 34, + 32, + 12, + 12, + 25, + 24, + 14, + 25, + 15, + 46, + 53, + 24, + 30, + 4, + 11, + 19 + ], + "weighted_loads": [ + 1.162831887602806, + 0.5131588615477085, + 0.654909860342741, + 2.7018200866878033, + 2.4675320368260145, + 0.899821575731039, + 2.952410776168108, + 1.5754486285150051, + 1.0705078300088644, + 0.743301585316658, + 2.638349324464798, + 0.29390205815434456, + 2.4308249056339264, + 2.2139050681144, + 1.1867195293307304, + 1.7876877188682556, + 1.4005218110978603, + 1.2971053197979927, + 0.7090274542570114, + 1.43054317869246, + 2.5428161323070526, + 0.9188533127307892, + 2.7591511867940426, + 0.2856026478111744, + 5.348584080114961, + 2.8220522571355104, + 0.41251032799482346, + 0.18426237255334854, + 2.510025767609477, + 3.3871304728090763, + 3.45887671969831, + 1.3280324079096317, + 2.0871948674321175, + 1.743376286700368, + 2.574036307632923, + 1.1441266927868128, + 0.2146812342107296, + 0.43888240307569504, + 1.9274301584810019, + 2.693385561928153, + 0.8887880947440863, + 1.4714178293943405, + 4.17903196811676, + 1.408017685636878, + 0.9772022906690836, + 3.0283256713300943, + 1.1294088140130043, + 4.997770103625953, + 2.033685142174363, + 1.72288697399199, + 0.8115882724523544, + 0.7453949376940727, + 1.708848798647523, + 1.7244340628385544, + 1.4180546421557665, + 1.7581298518925905, + 0.7548829261213541, + 3.4411509297788143, + 4.205305015668273, + 1.2874760124832392, + 1.4695661924779415, + 0.18642281368374825, + 0.5437917336821556, + 1.4738139491528273 + ], + "unique_experts": 64, + "load_cv": 0.5336650196612225, + "normalized_load_entropy": 0.9648421078979884, + "max_load_share": 0.041811846689895474 + } + }, + "s0_period": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "d9a2a09def8f248cd2f155bf49d6fdba99a889dd5efabcd023bb42feaa4edf5f", + "route_weight_sha256": "3db74735d32191a5b6ca59bdda9b6ae2d79e1f45f53f12b9298866ed5d43eed0", + "loads": [ + 23, + 4, + 3, + 36, + 34, + 17, + 28, + 28, + 3, + 13, + 35, + 5, + 29, + 23, + 23, + 29, + 24, + 7, + 16, + 25, + 32, + 14, + 43, + 2, + 75, + 19, + 7, + 2, + 31, + 46, + 37, + 13, + 25, + 16, + 36, + 27, + 6, + 9, + 26, + 39, + 14, + 32, + 57, + 29, + 23, + 29, + 4, + 53, + 29, + 29, + 5, + 11, + 16, + 17, + 12, + 17, + 16, + 46, + 54, + 20, + 30, + 0, + 9, + 14 + ], + "weighted_loads": [ + 1.1677811574190855, + 0.16635353304445744, + 0.12473541498184204, + 2.428020816296339, + 2.6830635983496904, + 0.7916117887943983, + 1.9201737269759178, + 1.519794836640358, + 0.1409728154540062, + 0.7480434291064739, + 2.422617770731449, + 0.1968299075961113, + 2.0284153558313847, + 1.6352866515517235, + 1.196751119568944, + 1.8596878871321678, + 1.4116202183067799, + 0.2360589448362589, + 0.6929327566176653, + 1.422190748155117, + 2.3524200953543186, + 0.9381556622684002, + 2.787914875894785, + 0.09234203398227692, + 5.457703694701195, + 1.3660751059651375, + 0.3826572187244892, + 0.06746764294803143, + 2.004759408533573, + 3.4042546320706606, + 3.4354070872068405, + 1.329754676669836, + 1.9709835164248943, + 0.6862172298133373, + 2.54867110401392, + 1.2082661278545856, + 0.22355865873396397, + 0.44312216714024544, + 1.4653037264943123, + 2.539090648293495, + 0.5062012281268835, + 1.4491112753748894, + 3.9835820384323597, + 1.3481606245040894, + 0.9784234073013067, + 1.9758328553289175, + 0.21173975616693497, + 5.0667355339974165, + 1.624523051083088, + 1.4702354352921247, + 0.472553763538599, + 0.6870642565190792, + 1.1610297933220863, + 1.0128199458122253, + 0.7995731867849827, + 1.2142746206372976, + 0.7746855244040489, + 3.5062148422002792, + 4.420418540015817, + 1.1067837830632925, + 1.4577065277844667, + 0.0, + 0.4409787282347679, + 1.2959091365337372 + ], + "unique_experts": 63, + "load_cv": 0.6553504509354688, + "normalized_load_entropy": 0.9464522558420378, + "max_load_share": 0.0508130081300813 + }, + "full_input": { + "tokens": 271, + "top_k": 6, + "decisions": 1626, + "ordered_route_sha256": "7d2194b13d98d7872c50dcc891aa44707f9309954ff8ef34417a551ffd002b09", + "route_weight_sha256": "123fbc9aeec9f69da0c93450e80cb2faed65100f456d620ab1a5aa13bea8dfb8", + "loads": [ + 23, + 10, + 5, + 38, + 35, + 17, + 35, + 29, + 13, + 13, + 36, + 8, + 36, + 31, + 23, + 29, + 24, + 11, + 17, + 25, + 33, + 14, + 45, + 2, + 75, + 32, + 7, + 2, + 31, + 46, + 39, + 13, + 30, + 27, + 36, + 27, + 6, + 9, + 26, + 44, + 18, + 32, + 57, + 29, + 23, + 35, + 12, + 56, + 30, + 34, + 8, + 11, + 27, + 17, + 14, + 24, + 16, + 46, + 57, + 20, + 30, + 0, + 10, + 18 + ], + "weighted_loads": [ + 1.1677811574190855, + 0.5332308206707239, + 0.16387085244059563, + 2.542085610330105, + 2.7441078815609217, + 0.7916117887943983, + 2.5025491416454315, + 1.5646294131875038, + 0.9147231951355934, + 0.7480434291064739, + 2.4954910799860954, + 0.30552765168249607, + 2.4135058745741844, + 2.143301174044609, + 1.196751119568944, + 1.8596878871321678, + 1.4116202183067799, + 0.4117933791130781, + 0.730430057272315, + 1.422190748155117, + 2.416359554976225, + 0.9381556622684002, + 2.860868476331234, + 0.09234203398227692, + 5.457703694701195, + 2.2809450551867485, + 0.3826572187244892, + 0.06746764294803143, + 2.004759408533573, + 3.4042546320706606, + 3.490361178293824, + 1.329754676669836, + 2.2149336636066437, + 1.5375951174646616, + 2.54867110401392, + 1.2082661278545856, + 0.22355865873396397, + 0.44312216714024544, + 1.4653037264943123, + 2.707110336050391, + 0.7418895866721869, + 1.4491112753748894, + 3.9835820384323597, + 1.3481606245040894, + 0.9784234073013067, + 2.4476077016443014, + 0.9308466203510761, + 5.1783581068739295, + 1.6639093644917011, + 1.7088442388921976, + 0.6445792950689793, + 0.6870642565190792, + 1.8213917519897223, + 1.0128199458122253, + 1.4234931655228138, + 1.6743781082332134, + 0.7746855244040489, + 3.5062148422002792, + 4.531965488567948, + 1.1067837830632925, + 1.4577065277844667, + 0.0, + 0.48760775104165077, + 1.627741564065218 + ], + "unique_experts": 63, + "load_cv": 0.5887109228444428, + "normalized_load_entropy": 0.9563427120420316, + "max_load_share": 0.046125461254612546 + } + }, + "s1_period": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "a8d756b9239752c4d77324e06f9b62dce9c0fe9b10d8d913e89504a190511f34", + "route_weight_sha256": "ad52309554a9feb18e2e4513192df963c4e595cb1ababf22fd736bc535185a02", + "loads": [ + 23, + 5, + 0, + 36, + 31, + 18, + 29, + 28, + 3, + 13, + 34, + 4, + 27, + 23, + 23, + 29, + 23, + 9, + 14, + 25, + 33, + 14, + 42, + 3, + 74, + 21, + 7, + 2, + 40, + 46, + 37, + 13, + 24, + 14, + 37, + 27, + 6, + 8, + 28, + 40, + 11, + 32, + 57, + 31, + 22, + 30, + 3, + 51, + 29, + 26, + 7, + 13, + 17, + 17, + 12, + 16, + 15, + 46, + 52, + 23, + 30, + 1, + 9, + 13 + ], + "weighted_loads": [ + 1.1663711462169886, + 0.1907097678631544, + 0.0, + 2.473876476287842, + 2.477638876065612, + 0.8536553718149662, + 1.9333013705909252, + 1.5642470233142376, + 0.13075373694300652, + 0.7459223605692387, + 2.381142780184746, + 0.14325032755732536, + 1.9164312686771154, + 1.6249689757823944, + 1.1955936923623085, + 1.780417587608099, + 1.3861435130238533, + 0.33342913538217545, + 0.6218807213008404, + 1.424683567136526, + 2.4263528995215893, + 0.916704747825861, + 2.7073628827929497, + 0.12267351150512695, + 5.371204515919089, + 1.5294781662523746, + 0.409342123195529, + 0.06377473659813404, + 2.4393361900001764, + 3.4009214863181114, + 3.385634809732437, + 1.333396378904581, + 1.945395115762949, + 0.5996154546737671, + 2.5787067003548145, + 1.191012967377901, + 0.21623868495225906, + 0.3908557891845703, + 1.5071883779019117, + 2.576493874192238, + 0.37793187238276005, + 1.443522172048688, + 3.980979112908244, + 1.372319057583809, + 0.9795075040310621, + 1.9445043075829744, + 0.1364922821521759, + 4.968357551842928, + 1.6414370685815811, + 1.3302440028637648, + 0.5170985795557499, + 0.7820672355592251, + 1.1963096912950277, + 1.013860672712326, + 0.7937926631420851, + 1.140050657093525, + 0.7617791574448347, + 3.432309739291668, + 4.115088492631912, + 1.2458998151123524, + 1.4750892575830221, + 0.03726150095462799, + 0.43102831952273846, + 1.150729589164257 + ], + "unique_experts": 63, + "load_cv": 0.6538245776879446, + "normalized_load_entropy": 0.9460848421182944, + "max_load_share": 0.05013550135501355 + }, + "full_input": { + "tokens": 287, + "top_k": 6, + "decisions": 1722, + "ordered_route_sha256": "02a35a74146509dadcd0395406b1690f13d8fd23d75af016811bd4d25336181f", + "route_weight_sha256": "493dc23261acda3dd20c38a9d360cbef67a7f420bbfbc43e16eaeee0cfc177dd", + "loads": [ + 24, + 11, + 10, + 39, + 31, + 19, + 43, + 28, + 17, + 13, + 38, + 7, + 36, + 30, + 23, + 29, + 23, + 24, + 16, + 25, + 34, + 14, + 43, + 7, + 74, + 35, + 7, + 4, + 41, + 46, + 39, + 13, + 27, + 30, + 37, + 27, + 6, + 8, + 35, + 44, + 22, + 32, + 59, + 31, + 22, + 42, + 19, + 54, + 34, + 34, + 11, + 13, + 25, + 23, + 14, + 26, + 15, + 46, + 54, + 24, + 30, + 5, + 11, + 19 + ], + "weighted_loads": [ + 1.205367038026452, + 0.5018346570432186, + 0.6181515082716942, + 2.6536047346889973, + 2.477638876065612, + 0.8985920511186123, + 3.050882760435343, + 1.5642470233142376, + 1.102559458464384, + 0.7459223605692387, + 2.6017225347459316, + 0.25930588506162167, + 2.44658930785954, + 2.072008766233921, + 1.1955936923623085, + 1.780417587608099, + 1.3861435130238533, + 1.3837182447314262, + 0.7268751375377178, + 1.424683567136526, + 2.490027952939272, + 0.916704747825861, + 2.748447872698307, + 0.31300031393766403, + 5.371204515919089, + 2.79630184546113, + 0.409342123195529, + 0.18379330448806286, + 2.4819047767668962, + 3.4009214863181114, + 3.442024229094386, + 1.333396378904581, + 2.051342871040106, + 1.6868106294423342, + 2.5787067003548145, + 1.191012967377901, + 0.21623868495225906, + 0.3908557891845703, + 1.9491560589522123, + 2.6961464136838913, + 0.8770602885633707, + 1.443522172048688, + 4.148049743846059, + 1.372319057583809, + 0.9795075040310621, + 2.9916783776134253, + 1.2796437442302704, + 5.076308031566441, + 2.0295795798301697, + 1.8060458358377218, + 0.7346092984080315, + 0.7820672355592251, + 1.684322528541088, + 1.6868153512477875, + 1.4177256263792515, + 1.8054465427994728, + 0.7617791574448347, + 3.432309739291668, + 4.212928991764784, + 1.2784197516739368, + 1.4750892575830221, + 0.22368431463837624, + 0.5319253634661436, + 1.5186315067112446 + ], + "unique_experts": 64, + "load_cv": 0.5353206205878085, + "normalized_load_entropy": 0.9648644169586004, + "max_load_share": 0.0429732868757259 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 246, + "ordered_topk_exact_tokens": 193, + "set_exact_tokens": 213, + "mean_set_jaccard": 0.960801393728223, + "mean_token_weighted_tv": 0.009629886616324263, + "aggregate_load_tv": 0.016260162601626018 + }, + "system_bos": { + "tokens": 246, + "ordered_topk_exact_tokens": 175, + "set_exact_tokens": 193, + "mean_set_jaccard": 0.935152922957801, + "mean_token_weighted_tv": 0.01529614234767188, + "aggregate_load_tv": 0.018970189701897018 + }, + "system_x": { + "tokens": 246, + "ordered_topk_exact_tokens": 157, + "set_exact_tokens": 185, + "mean_set_jaccard": 0.9247967479674797, + "mean_token_weighted_tv": 0.018834785509067094, + "aggregate_load_tv": 0.02303523035230353 + }, + "system_period": { + "tokens": 246, + "ordered_topk_exact_tokens": 157, + "set_exact_tokens": 190, + "mean_set_jaccard": 0.9314750290360047, + "mean_token_weighted_tv": 0.017808601801563812, + "aggregate_load_tv": 0.023035230352303523 + }, + "bos_at_s0": { + "tokens": 246, + "ordered_topk_exact_tokens": 146, + "set_exact_tokens": 178, + "mean_set_jaccard": 0.9201509872241579, + "mean_token_weighted_tv": 0.019046551953032006, + "aggregate_load_tv": 0.023712737127371278 + }, + "bos_at_s1": { + "tokens": 246, + "ordered_topk_exact_tokens": 141, + "set_exact_tokens": 173, + "mean_set_jaccard": 0.9075687185443283, + "mean_token_weighted_tv": 0.022219090953438988, + "aggregate_load_tv": 0.02574525745257452 + }, + "x_at_s0": { + "tokens": 246, + "ordered_topk_exact_tokens": 153, + "set_exact_tokens": 178, + "mean_set_jaccard": 0.9175377468060395, + "mean_token_weighted_tv": 0.02145464006599372, + "aggregate_load_tv": 0.02506775067750678 + }, + "x_at_s1": { + "tokens": 246, + "ordered_topk_exact_tokens": 137, + "set_exact_tokens": 169, + "mean_set_jaccard": 0.9006387921022067, + "mean_token_weighted_tv": 0.02508852813332304, + "aggregate_load_tv": 0.029810298102981032 + }, + "period_at_s0": { + "tokens": 246, + "ordered_topk_exact_tokens": 152, + "set_exact_tokens": 177, + "mean_set_jaccard": 0.9155052264808362, + "mean_token_weighted_tv": 0.02126688396603596, + "aggregate_load_tv": 0.030487804878048783 + }, + "period_at_s1": { + "tokens": 246, + "ordered_topk_exact_tokens": 131, + "set_exact_tokens": 170, + "mean_set_jaccard": 0.9044134727061556, + "mean_token_weighted_tv": 0.02395630747503866, + "aggregate_load_tv": 0.028455284552845527 + } + } + }, + "layer_09": { + "layer": 9, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "6b73c7d0ebb2280767234d682b6f0f1ac6c166f8797259a4ac8c9347fe13d9c1", + "route_weight_sha256": "a87a5756bd53b56e9ec7f1cac5cb789206a1bbf92e328bf733572ba5edf7f428", + "loads": [ + 48, + 30, + 15, + 44, + 36, + 29, + 13, + 22, + 27, + 18, + 24, + 5, + 19, + 31, + 3, + 25, + 19, + 33, + 12, + 15, + 19, + 35, + 17, + 8, + 4, + 18, + 4, + 14, + 29, + 20, + 40, + 12, + 44, + 22, + 9, + 28, + 56, + 24, + 16, + 7, + 7, + 15, + 12, + 80, + 23, + 22, + 15, + 20, + 33, + 16, + 4, + 9, + 7, + 15, + 23, + 38, + 15, + 62, + 33, + 23, + 26, + 12, + 34, + 38 + ], + "weighted_loads": [ + 2.72208371758461, + 1.9826336689293385, + 1.0008135084062815, + 1.9743436519056559, + 2.901943277567625, + 1.7446750290691853, + 0.5402597095817327, + 1.4158126972615719, + 2.136066883802414, + 1.029422901570797, + 2.145769467577338, + 0.21994361095130444, + 0.8329969830811024, + 2.6943998895585537, + 0.10294533334672451, + 1.511668836697936, + 1.468595515936613, + 1.3332142755389214, + 0.8017719686031342, + 0.9862179923802614, + 1.04267749004066, + 1.947797253727913, + 0.7155917845666409, + 0.31663244031369686, + 0.1688141506165266, + 0.7331479508429766, + 0.11795901879668236, + 0.8338885754346848, + 2.729785304516554, + 1.2844082806259394, + 2.1479981169104576, + 0.5388714820146561, + 4.393365059047937, + 1.689995314925909, + 0.7676887735724449, + 1.9815415926277637, + 3.8078565411269665, + 1.949614241719246, + 0.8109906688332558, + 0.35566435754299164, + 0.324677549302578, + 1.0312007740139961, + 0.5224791821092367, + 5.735477842390537, + 1.5071924552321434, + 0.91072734631598, + 0.9954389072954655, + 1.1901424452662468, + 2.561963390558958, + 1.0623709596693516, + 0.1550445333123207, + 0.468197800219059, + 0.34504942409694195, + 0.5429903380572796, + 1.1922091357409954, + 4.016272649168968, + 0.7710641846060753, + 3.909877296537161, + 2.4175812788307667, + 1.9217904321849346, + 1.6362847685813904, + 0.7071765940636396, + 2.3698814306408167, + 2.1978379134088755 + ], + "unique_experts": 64, + "load_cv": 0.6314712064518984, + "normalized_load_entropy": 0.9554789157206379, + "max_load_share": 0.05420054200542006 + }, + "full_input": { + "tokens": 271, + "top_k": 6, + "decisions": 1626, + "ordered_route_sha256": "f2e6987beb1c24256dc3a7b5aa384585c8647e377b1eb09d39b4202c753603db", + "route_weight_sha256": "d424c6fa28ae001df098169ef7c646ceb9d4d087abec6b86b8c886a24f9553f1", + "loads": [ + 54, + 32, + 15, + 44, + 38, + 29, + 13, + 22, + 29, + 18, + 35, + 5, + 22, + 36, + 3, + 25, + 20, + 35, + 12, + 25, + 19, + 35, + 22, + 11, + 8, + 19, + 4, + 15, + 29, + 20, + 41, + 18, + 46, + 22, + 18, + 35, + 56, + 24, + 19, + 7, + 7, + 25, + 12, + 80, + 27, + 30, + 27, + 20, + 36, + 16, + 8, + 10, + 7, + 19, + 23, + 43, + 19, + 62, + 35, + 27, + 26, + 12, + 36, + 39 + ], + "weighted_loads": [ + 3.156303498893976, + 2.141134560108185, + 1.0008135084062815, + 1.9743436519056559, + 3.1614960692822933, + 1.7446750290691853, + 0.5402597095817327, + 1.4158126972615719, + 2.2325355857610703, + 1.029422901570797, + 3.3171915765851736, + 0.21994361095130444, + 0.8860858450643718, + 2.846555613912642, + 0.10294533334672451, + 1.511668836697936, + 1.509370680898428, + 1.4138506688177586, + 0.8017719686031342, + 2.0640422757714987, + 1.04267749004066, + 1.947797253727913, + 2.3035775683820248, + 0.5331492628902197, + 0.3337212260812521, + 0.8100145552307367, + 0.11795901879668236, + 0.8468074332922697, + 2.729785304516554, + 1.2844082806259394, + 2.187883708626032, + 0.7272405121475458, + 4.429739053826779, + 1.689995314925909, + 1.2619035709649324, + 2.4720136001706123, + 3.8078565411269665, + 1.949614241719246, + 0.9477007053792477, + 0.35566435754299164, + 0.324677549302578, + 2.049705047160387, + 0.5224791821092367, + 5.735477842390537, + 1.7765256399288774, + 1.5276185553520918, + 1.9801833480596542, + 1.1901424452662468, + 2.7696084082126617, + 1.0623709596693516, + 0.36152952536940575, + 0.5015817917883396, + 0.34504942409694195, + 0.6968993861228228, + 1.1922091357409954, + 4.296386446803808, + 0.9745326191186905, + 3.909877296537161, + 2.56213166564703, + 2.0962049700319767, + 1.6362847685813904, + 0.7071765940636396, + 2.4258567802608013, + 2.2340752203017473 + ], + "unique_experts": 64, + "load_cv": 0.5738017267623965, + "normalized_load_entropy": 0.9618696678429753, + "max_load_share": 0.04920049200492005 + } + }, + "s1_eos": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "83d6d6c8388579e40f7d73d3dbc3963ae878dbd92cff11aade72941a4f76be65", + "route_weight_sha256": "eef6a25e5bf0d06d4d066f8b4d8f53b952936da99d89935c6de59821cc85a91c", + "loads": [ + 46, + 29, + 16, + 44, + 38, + 31, + 13, + 23, + 27, + 18, + 24, + 5, + 18, + 31, + 3, + 26, + 19, + 32, + 12, + 14, + 19, + 36, + 20, + 6, + 4, + 17, + 5, + 14, + 28, + 20, + 40, + 12, + 43, + 23, + 9, + 28, + 56, + 24, + 18, + 8, + 7, + 17, + 11, + 79, + 23, + 21, + 14, + 20, + 32, + 18, + 5, + 9, + 8, + 13, + 23, + 38, + 13, + 62, + 33, + 23, + 26, + 11, + 33, + 38 + ], + "weighted_loads": [ + 2.6247329339385033, + 1.903300192207098, + 1.0421549417078495, + 1.9463824145495892, + 2.9525272138416767, + 1.8213445954024792, + 0.5393814593553543, + 1.478345613926649, + 2.121830627322197, + 1.0249099545180798, + 2.0993472300469875, + 0.2230277694761753, + 0.7980426587164402, + 2.7049435153603554, + 0.10739441029727459, + 1.5583351626992226, + 1.4690220095217228, + 1.2944388315081596, + 0.8039262443780899, + 0.9718498140573502, + 1.03098339214921, + 2.003024261444807, + 0.8289707489311695, + 0.22551050782203674, + 0.17715744860470295, + 0.7188052032142878, + 0.14682036824524403, + 0.8387198820710182, + 2.6790465153753757, + 1.260581223294139, + 2.1584395989775658, + 0.5349107291549444, + 4.405467513948679, + 1.708999715745449, + 0.7247865423560143, + 1.9447798691689968, + 3.781680926680565, + 1.9492143876850605, + 0.8714708499610424, + 0.3983796052634716, + 0.32655830681324005, + 1.1069187745451927, + 0.49037926457822323, + 5.654278123751283, + 1.4846922643482685, + 0.8636186085641384, + 0.9114148207008839, + 1.183251615613699, + 2.503112357109785, + 1.1361994706094265, + 0.18203921988606453, + 0.46914542838931084, + 0.3789761792868376, + 0.483138307929039, + 1.1963604837656021, + 3.9778921362012625, + 0.702317988499999, + 3.8890867717564106, + 2.402095802128315, + 1.954596120864153, + 1.6313214972615242, + 0.6662281062453985, + 2.3274757228791714, + 2.2187540475279093 + ], + "unique_experts": 64, + "load_cv": 0.6259575988189041, + "normalized_load_entropy": 0.956149783747785, + "max_load_share": 0.0535230352303523 + }, + "full_input": { + "tokens": 287, + "top_k": 6, + "decisions": 1722, + "ordered_route_sha256": "166a3d46cabce2c779b6331c9da266a5dbe0b5c833311dbfaa98c3c142fd4b59", + "route_weight_sha256": "ce896ca34d70a0e46e6bfa1af7c3fced6200a62e581a023ff320291d029bcc20", + "loads": [ + 56, + 33, + 16, + 44, + 40, + 31, + 13, + 23, + 34, + 20, + 35, + 7, + 21, + 35, + 4, + 26, + 20, + 34, + 12, + 24, + 19, + 39, + 25, + 17, + 9, + 25, + 9, + 15, + 34, + 20, + 42, + 17, + 45, + 26, + 15, + 41, + 56, + 27, + 23, + 9, + 13, + 32, + 13, + 79, + 28, + 34, + 35, + 20, + 39, + 23, + 7, + 10, + 8, + 16, + 24, + 43, + 18, + 62, + 38, + 27, + 26, + 12, + 35, + 39 + ], + "weighted_loads": [ + 3.2973090298473835, + 2.149282842874527, + 1.0421549417078495, + 1.9463824145495892, + 3.2423912174999714, + 1.8213445954024792, + 0.5393814593553543, + 1.478345613926649, + 2.538237165659666, + 1.1164916157722473, + 3.1937913559377193, + 0.31962916254997253, + 0.8526086146011949, + 2.7980425429996103, + 0.14641247130930424, + 1.5583351626992226, + 1.5151612758636475, + 1.39304706081748, + 0.8039262443780899, + 2.0924211740493774, + 1.03098339214921, + 2.1293943636119366, + 2.414407232776284, + 1.0357336588203907, + 0.3686326537281275, + 1.1585959624499083, + 0.3977603781968355, + 0.8516387399286032, + 3.1034320294857025, + 1.260581223294139, + 2.2961697168648243, + 0.676958842203021, + 4.44703091098927, + 1.93065345287323, + 1.0260905232280493, + 2.809594113379717, + 3.781680926680565, + 2.0901896953582764, + 1.1286064349114895, + 0.4655533768236637, + 0.7295808419585228, + 2.614853248000145, + 0.5835351813584566, + 5.654278123751283, + 1.6692250026389956, + 1.8702767826616764, + 2.7248976044356823, + 1.183251615613699, + 2.9472820162773132, + 1.4631482549011707, + 0.3011063262820244, + 0.5020246244966984, + 0.3789761792868376, + 0.6319299340248108, + 1.236996565014124, + 4.2288723308593035, + 0.9323004689067602, + 3.8890867717564106, + 2.7023440934717655, + 2.137541364878416, + 1.6313214972615242, + 0.7045410592108965, + 2.4841777849942446, + 2.254751617088914 + ], + "unique_experts": 64, + "load_cv": 0.5362873812471795, + "normalized_load_entropy": 0.9664477036453505, + "max_load_share": 0.04587688734030197 + } + }, + "s0_bos": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "991bfb532e75cbef7e4b2418e73a5bada85eda3e7f4f0a9c0ddcdc1a4985b2f2", + "route_weight_sha256": "129994bfcdb82ad975e931a41a407b62b9e72dc72aff58c99bc73c802bf007c3", + "loads": [ + 44, + 30, + 16, + 45, + 37, + 32, + 12, + 23, + 28, + 20, + 24, + 5, + 20, + 30, + 2, + 25, + 19, + 33, + 12, + 16, + 19, + 37, + 19, + 7, + 5, + 20, + 2, + 15, + 29, + 20, + 40, + 12, + 44, + 22, + 7, + 27, + 55, + 25, + 16, + 7, + 6, + 17, + 9, + 77, + 24, + 24, + 13, + 21, + 33, + 16, + 3, + 9, + 9, + 11, + 23, + 38, + 11, + 61, + 32, + 23, + 27, + 12, + 36, + 40 + ], + "weighted_loads": [ + 2.566291145980358, + 1.967150904238224, + 1.0620387438684702, + 2.066519010812044, + 2.9686126597225666, + 1.9238760843873024, + 0.5097713805735111, + 1.4716419912874699, + 2.1696537658572197, + 1.1093671843409538, + 2.172528924420476, + 0.2229655310511589, + 0.8767996616661549, + 2.7051014211028814, + 0.07131737098097801, + 1.521111160516739, + 1.4756301008164883, + 1.3753040432929993, + 0.8048228733241558, + 1.027898397296667, + 1.054077424108982, + 2.0118621960282326, + 0.754643302410841, + 0.2881618048995733, + 0.21698426455259323, + 0.8192247375845909, + 0.06125234439969063, + 0.9325889609754086, + 2.7269385270774364, + 1.2989441398531199, + 2.1543613970279694, + 0.5462330803275108, + 4.349349116906524, + 1.690616849809885, + 0.5988111905753613, + 1.8830979764461517, + 3.6932217720896006, + 2.0243914872407913, + 0.8098284341394901, + 0.35445135831832886, + 0.2826138623058796, + 1.064783040434122, + 0.42029497772455215, + 5.608981125056744, + 1.4703039415180683, + 1.0464663207530975, + 0.902245543897152, + 1.2237779200077057, + 2.518935799598694, + 1.056579351425171, + 0.11639310419559479, + 0.4773082248866558, + 0.42311250045895576, + 0.3987716380506754, + 1.171697586774826, + 3.9548105597496033, + 0.622952114790678, + 3.845166213810444, + 2.323595769703388, + 1.8907923363149166, + 1.6759868822991848, + 0.7068459764122963, + 2.4357645474374294, + 2.2756316531449556 + ], + "unique_experts": 64, + "load_cv": 0.6299807595279874, + "normalized_load_entropy": 0.9538433930844962, + "max_load_share": 0.0521680216802168 + }, + "full_input": { + "tokens": 271, + "top_k": 6, + "decisions": 1626, + "ordered_route_sha256": "57152cc166fdb3415e6937aa9fc907ad428799845d4b0272c7465dd13828d6f9", + "route_weight_sha256": "850b7679e12b255f6349bc412f0eefa3f95210d545ed2d831986de21c90728b7", + "loads": [ + 51, + 32, + 16, + 45, + 40, + 32, + 12, + 23, + 30, + 20, + 35, + 5, + 22, + 34, + 2, + 25, + 20, + 38, + 12, + 26, + 19, + 37, + 23, + 10, + 9, + 21, + 2, + 16, + 29, + 20, + 41, + 17, + 44, + 22, + 16, + 34, + 55, + 25, + 18, + 8, + 6, + 27, + 9, + 77, + 27, + 32, + 25, + 21, + 36, + 16, + 9, + 10, + 9, + 15, + 23, + 43, + 15, + 61, + 34, + 27, + 27, + 12, + 38, + 41 + ], + "weighted_loads": [ + 3.0523967035114765, + 2.1287977918982506, + 1.0620387438684702, + 2.066519010812044, + 3.2924203164875507, + 1.9238760843873024, + 0.5097713805735111, + 1.4716419912874699, + 2.266122467815876, + 1.1093671843409538, + 3.3439510334283113, + 0.2229655310511589, + 0.9224806092679501, + 2.8706135796383023, + 0.07131737098097801, + 1.521111160516739, + 1.5164052657783031, + 1.570809181779623, + 0.8048228733241558, + 2.0790799111127853, + 1.054077424108982, + 2.0118621960282326, + 1.4098347276449203, + 0.553483946248889, + 0.3818913400173187, + 0.8960913419723511, + 0.06125234439969063, + 0.9455078188329935, + 2.7269385270774364, + 1.2989441398531199, + 2.1942469887435436, + 0.7318832408636808, + 4.349349116906524, + 1.690616849809885, + 1.0930259879678488, + 2.3660116344690323, + 3.6932217720896006, + 2.0243914872407913, + 0.9050567224621773, + 0.4000463895499706, + 0.2826138623058796, + 2.081903077661991, + 0.42029497772455215, + 5.608981125056744, + 1.731931152753532, + 1.7755225896835327, + 1.858744453638792, + 1.2237779200077057, + 2.731400791555643, + 1.056579351425171, + 0.400532353669405, + 0.5106922164559364, + 0.42311250045895576, + 0.5600251220166683, + 1.171697586774826, + 4.232961785048246, + 0.8264205493032932, + 3.845166213810444, + 2.46890239790082, + 2.0652068741619587, + 1.6759868822991848, + 0.7068459764122963, + 2.491739897057414, + 2.3118689600378275 + ], + "unique_experts": 64, + "load_cv": 0.5703319144474776, + "normalized_load_entropy": 0.9611172900176698, + "max_load_share": 0.047355473554735544 + } + }, + "s1_bos": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "debacb5d3567c1a192f41b6f8c1c3a22ab32976064a57f20e98786671eff70c9", + "route_weight_sha256": "afb26cb373043ebacc5ecaea9ccfbac5f637ab46b7eeab2b6e98cba331ad0410", + "loads": [ + 44, + 31, + 17, + 45, + 37, + 34, + 11, + 23, + 27, + 19, + 23, + 5, + 18, + 30, + 3, + 26, + 20, + 35, + 12, + 15, + 19, + 38, + 17, + 4, + 5, + 21, + 3, + 16, + 29, + 20, + 39, + 11, + 42, + 23, + 9, + 27, + 54, + 25, + 16, + 8, + 7, + 18, + 11, + 74, + 24, + 24, + 11, + 19, + 34, + 18, + 6, + 9, + 8, + 10, + 24, + 38, + 11, + 61, + 32, + 23, + 28, + 13, + 34, + 38 + ], + "weighted_loads": [ + 2.57235006429255, + 1.9504632242023945, + 1.1020644512027502, + 2.0439523980021477, + 2.910555075854063, + 2.0059607848525047, + 0.4665433559566736, + 1.506209209561348, + 2.1495517566800117, + 1.0821524374186993, + 2.049185823649168, + 0.22474700212478638, + 0.8016239628195763, + 2.69327668659389, + 0.11138146370649338, + 1.5613189060240984, + 1.5238117538392544, + 1.4391314014792442, + 0.817039031535387, + 1.0553736425936222, + 1.0438175722956657, + 2.076692944392562, + 0.6664565838873386, + 0.1762276440858841, + 0.22092847526073456, + 0.8699493147432804, + 0.08946000784635544, + 0.9499578103423119, + 2.726264152675867, + 1.2830729521811008, + 2.0915895011276007, + 0.5132869314402342, + 4.35130413249135, + 1.707021914422512, + 0.6567702051252127, + 1.8782230280339718, + 3.625545874238014, + 2.0083208680152893, + 0.8088478744029999, + 0.4019130952656269, + 0.3194136433303356, + 1.120482288300991, + 0.48932922817766666, + 5.3729121796786785, + 1.483889613300562, + 1.0459979232400656, + 0.7487498596310616, + 1.1336337327957153, + 2.5658600255846977, + 1.1456434652209282, + 0.20407761819660664, + 0.46751411631703377, + 0.3880546409636736, + 0.3706362806260586, + 1.2027409933507442, + 3.9173747822642326, + 0.6085943765938282, + 3.87808395922184, + 2.320100214332342, + 1.9136059507727623, + 1.702690728008747, + 0.7667688224464655, + 2.355769705027342, + 2.2133311722427607 + ], + "unique_experts": 64, + "load_cv": 0.6159278146045358, + "normalized_load_entropy": 0.9559516345813259, + "max_load_share": 0.05013550135501355 + }, + "full_input": { + "tokens": 287, + "top_k": 6, + "decisions": 1722, + "ordered_route_sha256": "43f1527b0327ed9172b85b9b8307230ea25afdb08cac61d34b50163a5e2218cd", + "route_weight_sha256": "dae10d618836b78412a30c6f199ab746b70e8987d4335984ffa12629db273d44", + "loads": [ + 55, + 35, + 17, + 45, + 40, + 34, + 11, + 23, + 34, + 21, + 34, + 7, + 20, + 34, + 4, + 26, + 21, + 40, + 12, + 25, + 19, + 41, + 21, + 15, + 10, + 29, + 7, + 17, + 35, + 20, + 41, + 15, + 42, + 26, + 15, + 39, + 54, + 28, + 20, + 10, + 13, + 33, + 13, + 74, + 27, + 36, + 32, + 19, + 41, + 23, + 10, + 10, + 8, + 14, + 25, + 43, + 16, + 61, + 38, + 27, + 28, + 14, + 36, + 39 + ], + "weighted_loads": [ + 3.329426785930991, + 2.1975072845816612, + 1.1020644512027502, + 2.0439523980021477, + 3.2592378817498684, + 2.0059607848525047, + 0.4665433559566736, + 1.506209209561348, + 2.565958295017481, + 1.1737340986728668, + 3.1436299495399, + 0.3213483951985836, + 0.8492434527724981, + 2.8344235429540277, + 0.15039952471852303, + 1.5613189060240984, + 1.569951020181179, + 1.65829760953784, + 0.817039031535387, + 2.1977820582687855, + 1.0438175722956657, + 2.2030630465596914, + 1.3184649366885424, + 1.001726120710373, + 0.4124036803841591, + 1.309740073978901, + 0.34040001779794693, + 0.9628766681998968, + 3.150649666786194, + 1.2830729521811008, + 2.229319619014859, + 0.65251100435853, + 4.35130413249135, + 1.928675651550293, + 0.9580741859972477, + 2.6860376708209515, + 3.625545874238014, + 2.149296175688505, + 1.018444336950779, + 0.5162683390080929, + 0.7224361784756184, + 2.645541340112686, + 0.5824851449579, + 5.3729121796786785, + 1.6139186462387443, + 2.165261285379529, + 2.5813877433538437, + 1.1336337327957153, + 3.0152831338346004, + 1.4725922495126724, + 0.39557485841214657, + 0.5003933124244213, + 0.3880546409636736, + 0.5585817061364651, + 1.243377074599266, + 4.168448828160763, + 0.8385768570005894, + 3.87808395922184, + 2.6815491653978825, + 2.0965511947870255, + 1.702690728008747, + 0.8050817754119635, + 2.512471767142415, + 2.2493287418037653 + ], + "unique_experts": 64, + "load_cv": 0.5257194565404434, + "normalized_load_entropy": 0.9671309919059551, + "max_load_share": 0.0429732868757259 + } + }, + "s0_x": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "ca65030fc1a311bf11e5cfe16a31cca5bbebb2dad5a39abf9d954815ae0f71d7", + "route_weight_sha256": "5128b07372734ae98cd4df7c77e4dbf7aab6d047e9c59ce4b953ce17f0fafc51", + "loads": [ + 44, + 30, + 16, + 44, + 37, + 29, + 13, + 22, + 29, + 19, + 25, + 5, + 20, + 31, + 1, + 23, + 18, + 32, + 11, + 15, + 19, + 37, + 16, + 4, + 5, + 20, + 3, + 17, + 29, + 20, + 39, + 11, + 43, + 22, + 11, + 27, + 55, + 24, + 17, + 7, + 7, + 17, + 11, + 78, + 25, + 21, + 14, + 21, + 34, + 16, + 3, + 9, + 9, + 13, + 22, + 43, + 12, + 64, + 31, + 25, + 26, + 11, + 34, + 40 + ], + "weighted_loads": [ + 2.661066787317395, + 2.022213600575924, + 1.0727315116673708, + 1.9991473220288754, + 2.915822185575962, + 1.7625850029289722, + 0.5438600685447454, + 1.456220455467701, + 2.224496131762862, + 1.0675571002066135, + 2.2425062377005816, + 0.22434253618121147, + 0.8763219453394413, + 2.7255767174065113, + 0.03773617744445801, + 1.4110279064625502, + 1.431979663670063, + 1.2779677491635084, + 0.7600694857537746, + 1.0307833962142467, + 1.066136870533228, + 2.040756655856967, + 0.6279517598450184, + 0.189466442912817, + 0.21905945055186749, + 0.9010521695017815, + 0.08839052356779575, + 0.9798475317656994, + 2.7607689686119556, + 1.3077008351683617, + 2.022277845069766, + 0.5053421594202518, + 4.390371536836028, + 1.7519207298755646, + 0.7819816321134567, + 1.929491437971592, + 3.7035929560661316, + 1.9704671427607536, + 0.8736382685601711, + 0.35147131606936455, + 0.3215116634964943, + 1.132395014166832, + 0.4777365177869797, + 5.7323821522295475, + 1.5646422430872917, + 0.9493313152343035, + 0.9461284503340721, + 1.2606505379080772, + 2.611331809312105, + 1.0588087476789951, + 0.11892615258693695, + 0.47209785506129265, + 0.42493991553783417, + 0.45903716795146465, + 1.1607164591550827, + 4.27043654024601, + 0.6516267322003841, + 3.959350384771824, + 2.2307350859045982, + 1.980725534260273, + 1.628737784922123, + 0.6846546102315187, + 2.3404001258313656, + 2.278666850179434 + ], + "unique_experts": 64, + "load_cv": 0.6350432588875227, + "normalized_load_entropy": 0.9536188708647092, + "max_load_share": 0.052845528455284556 + }, + "full_input": { + "tokens": 271, + "top_k": 6, + "decisions": 1626, + "ordered_route_sha256": "d6952990b184ea2cd23cee3f4903608e7697157b04a519ec5afecfbf50feb3fd", + "route_weight_sha256": "2cf9bf6f84152edcc8bf05c51e129911b477ea7a766a4316079bf15a748a0f85", + "loads": [ + 52, + 32, + 16, + 44, + 39, + 29, + 13, + 22, + 31, + 19, + 37, + 5, + 22, + 35, + 1, + 23, + 20, + 34, + 11, + 25, + 19, + 37, + 20, + 7, + 9, + 23, + 3, + 18, + 29, + 20, + 40, + 16, + 43, + 22, + 21, + 33, + 55, + 24, + 21, + 7, + 7, + 27, + 11, + 78, + 28, + 28, + 26, + 21, + 37, + 16, + 7, + 10, + 9, + 16, + 22, + 48, + 16, + 64, + 33, + 31, + 26, + 11, + 36, + 41 + ], + "weighted_loads": [ + 3.2655652221292257, + 2.1841876581311226, + 1.0727315116673708, + 1.9991473220288754, + 3.1669195517897606, + 1.7625850029289722, + 0.5438600685447454, + 1.456220455467701, + 2.3209648337215185, + 1.0675571002066135, + 3.5658973325043917, + 0.22434253618121147, + 0.9220028929412365, + 2.868887702934444, + 0.03773617744445801, + 1.4110279064625502, + 1.5096818506717682, + 1.3560824263840914, + 0.7600694857537746, + 2.1008738577365875, + 1.066136870533228, + 2.040756655856967, + 1.2838634215295315, + 0.4123980663716793, + 0.383966526016593, + 1.0488208010792732, + 0.08839052356779575, + 0.9927663896232843, + 2.7607689686119556, + 1.3077008351683617, + 2.0621634367853403, + 0.6909923199564219, + 4.390371536836028, + 1.7519207298755646, + 1.3717089984565973, + 2.373384229838848, + 3.7035929560661316, + 1.9704671427607536, + 1.0484061054885387, + 0.35147131606936455, + 0.3215116634964943, + 2.0737934447824955, + 0.4777365177869797, + 5.7323821522295475, + 1.8262694543227553, + 1.4325317274779081, + 1.879011943936348, + 1.2606505379080772, + 2.819086953997612, + 1.0588087476789951, + 0.3253609538078308, + 0.5054818466305733, + 0.42493991553783417, + 0.5770338252186775, + 1.1607164591550827, + 4.537689220160246, + 0.8550951667129993, + 3.959350384771824, + 2.374067436903715, + 2.2337583415210247, + 1.628737784922123, + 0.6846546102315187, + 2.39637547545135, + 2.3149041570723057 + ], + "unique_experts": 64, + "load_cv": 0.5779212497616083, + "normalized_load_entropy": 0.9602668105529396, + "max_load_share": 0.04797047970479705 + } + }, + "s1_x": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "5aa7d81d025218ed88e875bce37df74b902e19225290a528efca273341aae92f", + "route_weight_sha256": "8700569a09e56c804153e9218e928d87e8c93dc96962bbba5e4fd869d03f46e5", + "loads": [ + 51, + 29, + 16, + 44, + 36, + 33, + 12, + 22, + 27, + 19, + 24, + 5, + 18, + 31, + 3, + 25, + 17, + 33, + 12, + 15, + 20, + 37, + 17, + 4, + 5, + 23, + 3, + 17, + 29, + 20, + 37, + 12, + 42, + 23, + 9, + 27, + 52, + 25, + 17, + 7, + 6, + 18, + 10, + 76, + 24, + 21, + 12, + 19, + 34, + 19, + 6, + 10, + 8, + 12, + 24, + 37, + 11, + 62, + 31, + 24, + 28, + 12, + 35, + 39 + ], + "weighted_loads": [ + 3.015303475782275, + 1.8510950431227684, + 1.0837751030921936, + 1.9982283003628254, + 2.869461551308632, + 1.9572347067296505, + 0.5067735705524683, + 1.451275385916233, + 2.140949420630932, + 1.0548898316919804, + 2.168362870812416, + 0.21996773034334183, + 0.7973237633705139, + 2.6946761421859264, + 0.10974788852035999, + 1.4638480488210917, + 1.3964432999491692, + 1.3297446016222239, + 0.8162674345076084, + 1.0820633955299854, + 1.0862629488110542, + 2.0281146205961704, + 0.6467110551893711, + 0.17866123840212822, + 0.2063349485397339, + 1.024075299501419, + 0.08803875371813774, + 0.983843345195055, + 2.751143377274275, + 1.2708007637411356, + 1.9731309283524752, + 0.5498563684523106, + 4.320611434057355, + 1.713242156431079, + 0.6836841180920601, + 1.8793799467384815, + 3.534640047699213, + 2.02102267742157, + 0.8556973189115524, + 0.3677598759531975, + 0.2771274447441101, + 1.186610072851181, + 0.43991912715137005, + 5.492088785395026, + 1.4795732516795397, + 0.918877987191081, + 0.8633583560585976, + 1.163621973246336, + 2.5760515592992306, + 1.1708442717790604, + 0.20279851742088795, + 0.5188644900918007, + 0.38696191646158695, + 0.4361276812851429, + 1.2364488132297993, + 3.882381659001112, + 0.598757965490222, + 3.8988421261310577, + 2.2002251110970974, + 1.9265705831348896, + 1.6888808906078339, + 0.7292526587843895, + 2.3580410089343786, + 2.2165587060153484 + ], + "unique_experts": 64, + "load_cv": 0.6216249269554387, + "normalized_load_entropy": 0.9556154303653619, + "max_load_share": 0.051490514905149054 + }, + "full_input": { + "tokens": 287, + "top_k": 6, + "decisions": 1722, + "ordered_route_sha256": "5fc059f057cd7afe7df098c25086dea4f9f9012ed8265aed2282e76816339889", + "route_weight_sha256": "7e55ab2d9105ca64fbf362c48392d0d97e3a61ff4d57c01071678558deeb4da3", + "loads": [ + 64, + 33, + 16, + 44, + 38, + 33, + 12, + 22, + 35, + 21, + 36, + 7, + 20, + 34, + 4, + 25, + 19, + 36, + 12, + 26, + 20, + 40, + 21, + 15, + 10, + 33, + 8, + 18, + 35, + 20, + 39, + 16, + 42, + 26, + 16, + 39, + 52, + 28, + 22, + 9, + 12, + 33, + 12, + 76, + 27, + 30, + 32, + 19, + 41, + 24, + 8, + 11, + 8, + 14, + 25, + 42, + 16, + 62, + 37, + 29, + 28, + 13, + 37, + 40 + ], + "weighted_loads": [ + 3.911916421726346, + 2.0930906496942043, + 1.0837751030921936, + 1.9982283003628254, + 3.1515662372112274, + 1.9572347067296505, + 0.5067735705524683, + 1.451275385916233, + 2.598975297063589, + 1.146471492946148, + 3.4252990931272507, + 0.31656912341713905, + 0.8449432533234358, + 2.784274092875421, + 0.14876594953238964, + 1.4638480488210917, + 1.4835204742848873, + 1.4744702223688364, + 0.8162674345076084, + 2.18344958871603, + 1.0862629488110542, + 2.1544847227633, + 1.295850457623601, + 1.0109876245260239, + 0.3978101536631584, + 1.5418573655188084, + 0.38486478105187416, + 0.99676220305264, + 3.1755288913846016, + 1.2708007637411356, + 2.1108610462397337, + 0.6890804413706064, + 4.320611434057355, + 1.9348958935588598, + 1.0456954892724752, + 2.674925222992897, + 3.534640047699213, + 2.1619979850947857, + 1.117275483906269, + 0.47795097157359123, + 0.6801499798893929, + 2.5480458475649357, + 0.5330750439316034, + 5.492088785395026, + 1.609602284617722, + 1.6567204724997282, + 2.5761247724294662, + 1.163621973246336, + 3.030169762670994, + 1.4977930560708046, + 0.31801718659698963, + 0.5517436861991882, + 0.38696191646158695, + 0.5363001860678196, + 1.277084894478321, + 4.121781550347805, + 0.8287404458969831, + 3.8988421261310577, + 2.5634784027934074, + 2.162707306444645, + 1.6888808906078339, + 0.7675656117498875, + 2.514743071049452, + 2.252556275576353 + ], + "unique_experts": 64, + "load_cv": 0.53568336029639, + "normalized_load_entropy": 0.966376014920309, + "max_load_share": 0.04413472706155633 + } + }, + "s0_period": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "ea3e01a4ab32d5885d6744f7e9023ea728c04aa051ba492038f2983e174ffa55", + "route_weight_sha256": "7e23ffe541d3964f63e9dc26203e5d18c5d9a7479295bb0ef6684ab55e703d0b", + "loads": [ + 44, + 30, + 16, + 46, + 37, + 30, + 11, + 23, + 29, + 19, + 24, + 5, + 21, + 32, + 2, + 22, + 17, + 28, + 11, + 16, + 19, + 37, + 18, + 6, + 5, + 22, + 2, + 16, + 29, + 20, + 38, + 12, + 43, + 23, + 11, + 27, + 56, + 24, + 18, + 8, + 8, + 16, + 12, + 79, + 23, + 23, + 13, + 21, + 33, + 16, + 3, + 9, + 8, + 11, + 25, + 40, + 13, + 62, + 31, + 24, + 27, + 10, + 33, + 39 + ], + "weighted_loads": [ + 2.6819943506270647, + 1.9883696716278791, + 1.0797391533851624, + 2.0705071333795786, + 2.918286558240652, + 1.7991802766919136, + 0.46078335866332054, + 1.50115529820323, + 2.2176270745694637, + 1.071365363895893, + 2.217603735625744, + 0.22470290213823318, + 0.9237674102187157, + 2.7522089574486017, + 0.06867469102144241, + 1.3604762069880962, + 1.374742191284895, + 1.1267277672886848, + 0.7498977854847908, + 1.0570247042924166, + 1.0653853714466095, + 2.0756752528250217, + 0.7073286436498165, + 0.252899169921875, + 0.2098973449319601, + 0.971729215234518, + 0.06038851477205753, + 0.931811161339283, + 2.781851414591074, + 1.2997110299766064, + 1.994351513683796, + 0.5354195684194565, + 4.411984004080296, + 1.7897116746753454, + 0.7923433165997267, + 1.9355073794722557, + 3.7376746498048306, + 1.9766943044960499, + 0.9169879257678986, + 0.397351685911417, + 0.3748011104762554, + 1.072773240506649, + 0.5087850149720907, + 5.8293482810258865, + 1.4649010188877583, + 1.0310430694371462, + 0.9022234119474888, + 1.2649952620267868, + 2.5712097957730293, + 1.0621704310178757, + 0.11541785672307014, + 0.47709719836711884, + 0.39175841212272644, + 0.39987891912460327, + 1.2890243660658598, + 4.198216732591391, + 0.6744214855134487, + 3.9038148671388626, + 2.217234570533037, + 1.977546889334917, + 1.703022561967373, + 0.6527812480926514, + 2.3111233450472355, + 2.2201852779835463 + ], + "unique_experts": 64, + "load_cv": 0.6301206386880855, + "normalized_load_entropy": 0.9546450354227938, + "max_load_share": 0.0535230352303523 + }, + "full_input": { + "tokens": 271, + "top_k": 6, + "decisions": 1626, + "ordered_route_sha256": "ef1bd8b0f537ba56d41c81835acf01012b1ea48b7e05c30f422159f945f40c57", + "route_weight_sha256": "c64e4eeb4100c6a843e38a3ddf148278f15210fde719a0e5c3160910a6edfd6b", + "loads": [ + 53, + 32, + 16, + 46, + 39, + 30, + 11, + 23, + 31, + 19, + 36, + 5, + 23, + 35, + 2, + 22, + 18, + 31, + 11, + 26, + 19, + 37, + 22, + 9, + 9, + 23, + 2, + 17, + 29, + 20, + 39, + 17, + 43, + 23, + 21, + 34, + 56, + 24, + 21, + 8, + 8, + 27, + 12, + 79, + 26, + 30, + 26, + 21, + 36, + 16, + 7, + 10, + 8, + 14, + 25, + 45, + 18, + 62, + 33, + 29, + 27, + 10, + 35, + 40 + ], + "weighted_loads": [ + 3.292577577754855, + 2.13967421464622, + 1.0797391533851624, + 2.0705071333795786, + 3.1682005263864994, + 1.7991802766919136, + 0.46078335866332054, + 1.50115529820323, + 2.31409577652812, + 1.071365363895893, + 3.4852733314037323, + 0.22470290213823318, + 0.9694483578205109, + 2.858916618861258, + 0.06867469102144241, + 1.3604762069880962, + 1.4155173562467098, + 1.2559752874076366, + 0.7498977854847908, + 2.1319979336112738, + 1.0653853714466095, + 2.0756752528250217, + 1.3648451194167137, + 0.4777754433453083, + 0.3748044203966856, + 1.0485958196222782, + 0.06038851477205753, + 0.9447300191968679, + 2.781851414591074, + 1.2997110299766064, + 2.03423710539937, + 0.7210697289556265, + 4.411984004080296, + 1.7897116746753454, + 1.343545489013195, + 2.412664607167244, + 3.7376746498048306, + 1.9766943044960499, + 1.0554571859538555, + 0.397351685911417, + 0.3748011104762554, + 2.0578346848487854, + 0.5087850149720907, + 5.8293482810258865, + 1.7265282301232219, + 1.5290381144732237, + 1.9534065797924995, + 1.2649952620267868, + 2.7730878330767155, + 1.0621704310178757, + 0.32095806673169136, + 0.5104811899363995, + 0.39175841212272644, + 0.5100498255342245, + 1.2890243660658598, + 4.470397189259529, + 0.9159619137644768, + 3.9038148671388626, + 2.3593289479613304, + 2.1914542578160763, + 1.703022561967373, + 0.6527812480926514, + 2.36709869466722, + 2.256422584876418 + ], + "unique_experts": 64, + "load_cv": 0.5739282733411201, + "normalized_load_entropy": 0.9609990458690159, + "max_load_share": 0.04858548585485855 + } + }, + "s1_period": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "11a35ca1c45f164283a6df6731aa56983a5e2c4e51c6c4ddc6a499933b94ff16", + "route_weight_sha256": "2882aa78e7bbdb9624c43e93b669c344b6b7ef908f12ad1f8903f98b7e4e4543", + "loads": [ + 49, + 29, + 16, + 44, + 36, + 32, + 12, + 22, + 27, + 19, + 24, + 5, + 18, + 32, + 4, + 25, + 18, + 33, + 12, + 17, + 19, + 37, + 17, + 5, + 5, + 21, + 4, + 16, + 30, + 20, + 38, + 12, + 42, + 22, + 9, + 26, + 53, + 25, + 17, + 7, + 7, + 18, + 10, + 75, + 23, + 21, + 11, + 20, + 34, + 19, + 5, + 10, + 8, + 11, + 25, + 38, + 11, + 62, + 32, + 24, + 28, + 11, + 35, + 39 + ], + "weighted_loads": [ + 2.9139724653214216, + 1.790259052067995, + 1.08157541975379, + 1.9908754341304302, + 2.86164703220129, + 1.9217623621225357, + 0.501643581315875, + 1.4510299898684025, + 2.149502784013748, + 1.0544194467365742, + 2.168800964951515, + 0.2224679570645094, + 0.807443518191576, + 2.7454467974603176, + 0.14395171217620373, + 1.4596427213400602, + 1.4238817766308784, + 1.3259916007518768, + 0.8084044121205807, + 1.1649016067385674, + 1.044420838356018, + 2.0454838778823614, + 0.6516036745160818, + 0.20673788152635098, + 0.2060838621109724, + 0.9333524871617556, + 0.11768281646072865, + 0.9216648600995541, + 2.781461350619793, + 1.263669228181243, + 2.0111054107546806, + 0.5504899956285954, + 4.334533892571926, + 1.6903139539062977, + 0.6634972020983696, + 1.827595192939043, + 3.562968071550131, + 2.030024543404579, + 0.8523607328534126, + 0.3708468936383724, + 0.32331930845975876, + 1.1693810932338238, + 0.4427489899098873, + 5.422804839909077, + 1.43089191429317, + 0.8946817573159933, + 0.8007053062319756, + 1.2126713693141937, + 2.5587681010365486, + 1.171815499663353, + 0.16571894101798534, + 0.5176169648766518, + 0.38892149180173874, + 0.38797662034630775, + 1.2683576811105013, + 3.9409683272242546, + 0.5931129287928343, + 3.8962452113628387, + 2.258665978908539, + 1.9448275603353977, + 1.6974048614501953, + 0.7042458653450012, + 2.385197650641203, + 2.2102942690253258 + ], + "unique_experts": 64, + "load_cv": 0.6183555009315226, + "normalized_load_entropy": 0.9563030634820041, + "max_load_share": 0.0508130081300813 + }, + "full_input": { + "tokens": 287, + "top_k": 6, + "decisions": 1722, + "ordered_route_sha256": "d30e62c1f2f8d8112dffaab09e9f7bbcf58ed1084175536e105f91f02bb818e7", + "route_weight_sha256": "f6590777d09be969cefcc6704b6e4c841a1134f94c5c5b3f4738ce12fb54c25e", + "loads": [ + 61, + 33, + 16, + 44, + 38, + 32, + 12, + 22, + 34, + 21, + 36, + 7, + 20, + 36, + 5, + 25, + 19, + 37, + 12, + 27, + 19, + 40, + 21, + 16, + 10, + 31, + 8, + 17, + 36, + 20, + 40, + 16, + 42, + 25, + 15, + 39, + 53, + 28, + 22, + 8, + 13, + 34, + 12, + 75, + 26, + 30, + 33, + 20, + 41, + 24, + 7, + 11, + 8, + 14, + 26, + 43, + 17, + 62, + 38, + 28, + 28, + 12, + 37, + 40 + ], + "weighted_loads": [ + 3.7050497625023127, + 2.026829157024622, + 1.08157541975379, + 1.9908754341304302, + 3.1419873759150505, + 1.9217623621225357, + 0.501643581315875, + 1.4510299898684025, + 2.5659093223512173, + 1.1460011079907417, + 3.3319558054208755, + 0.3190693501383066, + 0.8550630081444979, + 2.869315723888576, + 0.18296977318823338, + 1.4596427213400602, + 1.4700210429728031, + 1.5170652978122234, + 0.8084044121205807, + 2.261125274002552, + 1.044420838356018, + 2.171853980049491, + 1.303001280874014, + 1.0284737143665552, + 0.39755906723439693, + 1.4511694554239511, + 0.36862282641232014, + 0.934583717957139, + 3.2058468647301197, + 1.263669228181243, + 2.148835528641939, + 0.6897140685468912, + 4.334533892571926, + 1.9119676910340786, + 0.9648011829704046, + 2.6653852313756943, + 3.562968071550131, + 2.170999851077795, + 1.1289905309677124, + 0.43802066519856453, + 0.7263418436050415, + 2.628124825656414, + 0.5359049066901207, + 5.422804839909077, + 1.5609209472313523, + 1.634933127090335, + 2.7307963371276855, + 1.2126713693141937, + 3.0101451463997364, + 1.4987642839550972, + 0.28166778944432735, + 0.5504961609840393, + 0.38892149180173874, + 0.5377089567482471, + 1.308993762359023, + 4.180683247745037, + 0.8641917239874601, + 3.8962452113628387, + 2.6219472847878933, + 2.127772804349661, + 1.6974048614501953, + 0.7425588183104992, + 2.541899712756276, + 2.2462918385863304 + ], + "unique_experts": 64, + "load_cv": 0.5334627655995974, + "normalized_load_entropy": 0.9664405506118035, + "max_load_share": 0.04355400696864112 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 246, + "ordered_topk_exact_tokens": 187, + "set_exact_tokens": 216, + "mean_set_jaccard": 0.9642857142857143, + "mean_token_weighted_tv": 0.009395987863039098, + "aggregate_load_tv": 0.014905149051490523 + }, + "system_bos": { + "tokens": 246, + "ordered_topk_exact_tokens": 165, + "set_exact_tokens": 190, + "mean_set_jaccard": 0.9349593495934959, + "mean_token_weighted_tv": 0.015502112857028237, + "aggregate_load_tv": 0.020325203252032523 + }, + "system_x": { + "tokens": 246, + "ordered_topk_exact_tokens": 144, + "set_exact_tokens": 183, + "mean_set_jaccard": 0.9233449477351915, + "mean_token_weighted_tv": 0.019162655005428363, + "aggregate_load_tv": 0.026422764227642274 + }, + "system_period": { + "tokens": 246, + "ordered_topk_exact_tokens": 145, + "set_exact_tokens": 182, + "mean_set_jaccard": 0.9230545876887339, + "mean_token_weighted_tv": 0.01946452740822139, + "aggregate_load_tv": 0.026422764227642274 + }, + "bos_at_s0": { + "tokens": 246, + "ordered_topk_exact_tokens": 152, + "set_exact_tokens": 183, + "mean_set_jaccard": 0.9259581881533101, + "mean_token_weighted_tv": 0.018329522708748897, + "aggregate_load_tv": 0.023035230352303527 + }, + "bos_at_s1": { + "tokens": 246, + "ordered_topk_exact_tokens": 149, + "set_exact_tokens": 177, + "mean_set_jaccard": 0.916376306620209, + "mean_token_weighted_tv": 0.0208208009721787, + "aggregate_load_tv": 0.025745257452574527 + }, + "x_at_s0": { + "tokens": 246, + "ordered_topk_exact_tokens": 139, + "set_exact_tokens": 178, + "mean_set_jaccard": 0.9184088269454123, + "mean_token_weighted_tv": 0.020852305101064162, + "aggregate_load_tv": 0.025067750677506776 + }, + "x_at_s1": { + "tokens": 246, + "ordered_topk_exact_tokens": 135, + "set_exact_tokens": 166, + "mean_set_jaccard": 0.9001161440185829, + "mean_token_weighted_tv": 0.02512087576030716, + "aggregate_load_tv": 0.026422764227642278 + }, + "period_at_s0": { + "tokens": 246, + "ordered_topk_exact_tokens": 141, + "set_exact_tokens": 178, + "mean_set_jaccard": 0.9184088269454121, + "mean_token_weighted_tv": 0.020795717555272385, + "aggregate_load_tv": 0.027777777777777783 + }, + "period_at_s1": { + "tokens": 246, + "ordered_topk_exact_tokens": 145, + "set_exact_tokens": 170, + "mean_set_jaccard": 0.9014711575687185, + "mean_token_weighted_tv": 0.02465967048050427, + "aggregate_load_tv": 0.023712737127371274 + } + } + }, + "layer_10": { + "layer": 10, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "5989e824a0b79ef4134d8a844267b22d6339b16ceb15af7a06692ee32409f810", + "route_weight_sha256": "0aee2e2537d4eb418c56b57327c2e0ad8edaf9584517cc214dba0291b4f6baf2", + "loads": [ + 20, + 4, + 25, + 44, + 2, + 45, + 1, + 114, + 53, + 21, + 1, + 39, + 12, + 19, + 33, + 36, + 22, + 19, + 28, + 17, + 13, + 18, + 32, + 24, + 27, + 33, + 43, + 12, + 1, + 32, + 11, + 23, + 18, + 94, + 14, + 11, + 1, + 3, + 29, + 16, + 9, + 28, + 35, + 6, + 1, + 17, + 10, + 10, + 12, + 16, + 2, + 10, + 28, + 31, + 7, + 39, + 48, + 27, + 16, + 12, + 31, + 25, + 40, + 6 + ], + "weighted_loads": [ + 1.14042254909873, + 0.2298443652689457, + 1.285324614495039, + 2.5974632166326046, + 0.08194908499717712, + 4.542163636535406, + 0.04825909808278084, + 7.285316674038768, + 4.451396580785513, + 1.8876448068767786, + 0.05154421180486679, + 2.7176684364676476, + 1.188882440328598, + 0.826972920447588, + 2.119330544024706, + 2.660636879503727, + 1.4295444674789906, + 1.26772141456604, + 2.070894982665777, + 0.6899048313498497, + 0.709030281752348, + 1.0089114382863045, + 1.7000350896269083, + 1.4913454465568066, + 1.4555679894983768, + 3.0064936876296997, + 3.3891768530011177, + 0.5297322794795036, + 0.0495075024664402, + 2.167314998805523, + 0.5526005700230598, + 1.7677465714514256, + 1.2495014555752277, + 5.126015283167362, + 0.9061930477619171, + 0.6189409866929054, + 0.0443127378821373, + 0.2309478297829628, + 1.8670251853764057, + 0.7326915562152863, + 0.401762206107378, + 1.5072961617261171, + 3.2282479517161846, + 0.22430682741105556, + 0.03151071071624756, + 0.8997487463057041, + 0.6846087388694286, + 0.587735153734684, + 0.6068725343793631, + 1.0258579775691032, + 0.0763109140098095, + 0.6941916197538376, + 1.6194691881537437, + 1.8620583601295948, + 0.2809542454779148, + 2.9108151383697987, + 3.131865505129099, + 1.968998908996582, + 0.7964555583894253, + 0.5421845763921738, + 2.284365389496088, + 1.9660286735743284, + 2.2641716115176678, + 0.31464657559990883 + ], + "unique_experts": 64, + "load_cv": 0.8534778489896101, + "normalized_load_entropy": 0.9245739740646467, + "max_load_share": 0.07723577235772358 + }, + "full_input": { + "tokens": 271, + "top_k": 6, + "decisions": 1626, + "ordered_route_sha256": "d2d7bdc7fbdd477efcabdb62266d4e046c54c881cdc627dc5aaa6756a5bdf0c7", + "route_weight_sha256": "7b9298be57ec22f270fbc912f4d43f9fd407519a783fc835dd7c197babfa973d", + "loads": [ + 20, + 4, + 27, + 44, + 2, + 45, + 1, + 118, + 53, + 23, + 3, + 41, + 13, + 22, + 35, + 36, + 22, + 22, + 35, + 19, + 17, + 21, + 33, + 24, + 27, + 35, + 43, + 20, + 2, + 33, + 13, + 24, + 18, + 102, + 15, + 12, + 1, + 3, + 29, + 16, + 9, + 38, + 39, + 8, + 5, + 20, + 15, + 13, + 12, + 18, + 4, + 17, + 28, + 33, + 7, + 48, + 48, + 33, + 16, + 23, + 36, + 37, + 40, + 6 + ], + "weighted_loads": [ + 1.14042254909873, + 0.2298443652689457, + 1.304280505515635, + 2.5974632166326046, + 0.08194908499717712, + 4.542163636535406, + 0.04825909808278084, + 7.4600295554846525, + 4.451396580785513, + 1.912094185128808, + 0.14692790061235428, + 2.8259047493338585, + 1.2215895652770996, + 2.2428040094673634, + 2.2691044211387634, + 2.660636879503727, + 1.4295444674789906, + 1.512761503458023, + 2.454789786133915, + 0.7949145138263702, + 0.8754792250692844, + 1.1243450157344341, + 1.7037656023167074, + 1.4913454465568066, + 1.4555679894983768, + 3.0704144407063723, + 3.3891768530011177, + 1.3843919821083546, + 0.09584866836667061, + 2.209948979318142, + 0.7627070769667625, + 1.781494346447289, + 1.2495014555752277, + 5.501892749220133, + 0.9360203370451927, + 0.6558720916509628, + 0.0443127378821373, + 0.2309478297829628, + 1.8670251853764057, + 0.7326915562152863, + 0.401762206107378, + 2.6986207459121943, + 3.341500213369727, + 0.3218675572425127, + 0.2406228631734848, + 1.0458064079284668, + 0.919415544718504, + 0.7136126644909382, + 0.6068725343793631, + 1.10945163667202, + 0.1725090891122818, + 1.038238126784563, + 1.6194691881537437, + 1.9814554005861282, + 0.2809542454779148, + 3.604149043560028, + 3.131865505129099, + 2.3138469643890858, + 0.7964555583894253, + 1.2793252617120743, + 2.625382252037525, + 3.0082963798195124, + 2.2641716115176678, + 0.31464657559990883 + ], + "unique_experts": 64, + "load_cv": 0.8013405056328455, + "normalized_load_entropy": 0.933128077478541, + "max_load_share": 0.07257072570725707 + } + }, + "s1_eos": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "6ba80a25e8c0a189d4d72313d91b60f8ce200a113adf39e9f6ad4b3767066f2b", + "route_weight_sha256": "0f18c3305a453fed4792db0717087ce2dd1c9abe410910dfc564dbca7f46b438", + "loads": [ + 21, + 4, + 29, + 43, + 2, + 44, + 1, + 112, + 54, + 18, + 1, + 39, + 15, + 19, + 33, + 36, + 21, + 20, + 31, + 14, + 14, + 17, + 30, + 24, + 25, + 32, + 43, + 13, + 1, + 32, + 10, + 25, + 17, + 94, + 14, + 11, + 1, + 3, + 29, + 16, + 9, + 29, + 35, + 7, + 1, + 17, + 10, + 10, + 13, + 15, + 2, + 11, + 30, + 31, + 7, + 38, + 48, + 27, + 16, + 11, + 31, + 25, + 39, + 6 + ], + "weighted_loads": [ + 1.176051139831543, + 0.21606720983982086, + 1.4516079910099506, + 2.554050039499998, + 0.081491868942976, + 4.517472766339779, + 0.0487942136824131, + 7.317997392266989, + 4.483457488939166, + 1.7775394432246685, + 0.05124077573418617, + 2.705000873655081, + 1.2893576640635729, + 0.82691290974617, + 2.1169345192611217, + 2.5651070699095726, + 1.3261614330112934, + 1.347878810018301, + 2.1895081996917725, + 0.5870361048728228, + 0.7520497404038906, + 0.9603210091590881, + 1.6194031741470098, + 1.4691382460296154, + 1.3415485695004463, + 2.947712831199169, + 3.4147876389324665, + 0.562423225492239, + 0.0481102280318737, + 2.15160596370697, + 0.5138147436082363, + 1.834011148661375, + 1.216106180101633, + 5.038310162723064, + 0.9218385480344296, + 0.618405032902956, + 0.03941860795021057, + 0.2300206646323204, + 1.849431250244379, + 0.7269618511199951, + 0.40238193795084953, + 1.5815618894994259, + 3.233050648123026, + 0.2571595013141632, + 0.03139995038509369, + 0.900790024548769, + 0.6754482537508011, + 0.5914533138275146, + 0.6438210532069206, + 0.985132671892643, + 0.07515314966440201, + 0.7274467684328556, + 1.7034863084554672, + 1.8508187159895897, + 0.28036358766257763, + 2.8329388946294785, + 3.1316410452127457, + 1.9974666945636272, + 0.7884341701865196, + 0.5059207901358604, + 2.2772928811609745, + 1.9562232550233603, + 2.2273325249552727, + 0.3183286786079407 + ], + "unique_experts": 64, + "load_cv": 0.8459756652084947, + "normalized_load_entropy": 0.9254288679868895, + "max_load_share": 0.07588075880758807 + }, + "full_input": { + "tokens": 287, + "top_k": 6, + "decisions": 1722, + "ordered_route_sha256": "96a45507fc4b78cb5a7babd8a8deb9fb2f23bf1f767678cd296b554da090c472", + "route_weight_sha256": "b439dbe517cbc9fc493ba23896b4d269ec4648490095a2f55bc3eef3fde3eedf", + "loads": [ + 21, + 4, + 32, + 43, + 6, + 44, + 1, + 113, + 54, + 20, + 4, + 43, + 18, + 21, + 37, + 36, + 21, + 25, + 37, + 15, + 15, + 18, + 31, + 24, + 26, + 35, + 45, + 34, + 1, + 35, + 18, + 26, + 22, + 111, + 16, + 13, + 3, + 5, + 30, + 16, + 10, + 45, + 39, + 9, + 5, + 23, + 17, + 13, + 21, + 18, + 5, + 26, + 31, + 34, + 7, + 51, + 49, + 33, + 16, + 27, + 43, + 35, + 39, + 7 + ], + "weighted_loads": [ + 1.176051139831543, + 0.21606720983982086, + 1.5109858326613903, + 2.554050039499998, + 0.28160641342401505, + 4.517472766339779, + 0.0487942136824131, + 7.355773340910673, + 4.483457488939166, + 1.802719034254551, + 0.1663932129740715, + 2.937391731888056, + 1.4467499461025, + 2.201778143644333, + 2.370344642549753, + 2.5651070699095726, + 1.3261614330112934, + 1.7068788446485996, + 2.557885990012437, + 0.627707039937377, + 0.7934921681880951, + 1.0080167949199677, + 1.6233189175836742, + 1.4691382460296154, + 1.3828442953526974, + 3.2722822669893503, + 3.485116582363844, + 1.9783612992614508, + 0.0481102280318737, + 2.286224815994501, + 1.183013018220663, + 1.8477589236572385, + 1.7064398415386677, + 5.89524669200182, + 1.0639318749308586, + 0.7833273634314537, + 0.122699074447155, + 0.31778687983751297, + 1.8857860006392002, + 0.7269618511199951, + 0.4444873631000519, + 3.1289865039288998, + 3.331373459659517, + 0.32434516213834286, + 0.24786217883229256, + 1.2081227637827396, + 1.0410818494856358, + 0.7084495425224304, + 1.2923154048621655, + 1.1461363155394793, + 0.252986665815115, + 1.5944447442889214, + 1.7731086239218712, + 2.0093394815921783, + 0.28036358766257763, + 3.7760762944817543, + 3.204360753297806, + 2.354316383600235, + 0.7884341701865196, + 1.6073508635163307, + 3.090922113507986, + 2.8618126567453146, + 2.2273325249552727, + 0.35468580573797226 + ], + "unique_experts": 64, + "load_cv": 0.7621800230792515, + "normalized_load_entropy": 0.9389813153879378, + "max_load_share": 0.06562137049941928 + } + }, + "s0_bos": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "66bf232d1357224d416dd7824920d5b24ff0e65565ec1b0e1894385df0ba6c85", + "route_weight_sha256": "1e44222dd581bcbbced464f0507dcfba768b15930d1e48d6c45ded7b0922358a", + "loads": [ + 22, + 4, + 27, + 44, + 2, + 43, + 2, + 117, + 53, + 21, + 2, + 39, + 12, + 17, + 29, + 37, + 23, + 21, + 27, + 20, + 11, + 16, + 30, + 27, + 28, + 32, + 43, + 11, + 1, + 31, + 10, + 25, + 19, + 83, + 14, + 12, + 1, + 3, + 29, + 17, + 10, + 26, + 36, + 7, + 1, + 17, + 9, + 11, + 13, + 16, + 2, + 10, + 30, + 30, + 10, + 39, + 48, + 26, + 16, + 11, + 32, + 24, + 40, + 7 + ], + "weighted_loads": [ + 1.2479982934892178, + 0.22428450360894203, + 1.3262676484882832, + 2.629899948835373, + 0.08200429379940033, + 4.401689741760492, + 0.08652717620134354, + 7.385536042973399, + 4.416123330593109, + 1.9072085693478584, + 0.1084602102637291, + 2.71289074793458, + 1.1657971572130919, + 0.7452917359769344, + 1.9555290639400482, + 2.7004004269838333, + 1.437424836680293, + 1.3151889890432358, + 2.014078031294048, + 0.8755212556570768, + 0.6070002131164074, + 0.9118998497724533, + 1.6976443119347095, + 1.602780431509018, + 1.4817519336938858, + 2.979948602616787, + 3.3732039220631123, + 0.5048455223441124, + 0.05308479815721512, + 2.1205123737454414, + 0.5273937545716763, + 1.8598620258271694, + 1.2972623631358147, + 4.450578197836876, + 0.941399235278368, + 0.6504114866256714, + 0.044715505093336105, + 0.22997471690177917, + 1.8824722692370415, + 0.7933434881269932, + 0.43526969105005264, + 1.3451445940881968, + 3.2309500426054, + 0.27061684615910053, + 0.029639653861522675, + 0.9121766313910484, + 0.6273296363651752, + 0.6224408447742462, + 0.6404449716210365, + 1.0124075151979923, + 0.07340629398822784, + 0.7008662521839142, + 1.6759225465357304, + 1.7699598260223866, + 0.37579519115388393, + 2.9412284456193447, + 3.1324222907423973, + 1.963668581098318, + 0.7826905250549316, + 0.53213095292449, + 2.3140630684792995, + 1.9322577938437462, + 2.3017520383000374, + 0.3621594253927469 + ], + "unique_experts": 64, + "load_cv": 0.8318988689410254, + "normalized_load_entropy": 0.9282318026307383, + "max_load_share": 0.07926829268292683 + }, + "full_input": { + "tokens": 271, + "top_k": 6, + "decisions": 1626, + "ordered_route_sha256": "0925ba668ce5e559bc28183ef3472278fd38c9a06d11aee681faca83fbfb0d02", + "route_weight_sha256": "ea856e791475d40121b46ba3eb38601407596600d4bea73b6a1946d5c24c3a6b", + "loads": [ + 22, + 5, + 28, + 44, + 2, + 43, + 2, + 121, + 53, + 22, + 4, + 41, + 13, + 20, + 32, + 37, + 23, + 24, + 33, + 22, + 16, + 19, + 30, + 27, + 28, + 34, + 43, + 19, + 2, + 32, + 13, + 26, + 19, + 91, + 15, + 13, + 1, + 3, + 29, + 17, + 10, + 36, + 40, + 9, + 4, + 20, + 14, + 14, + 13, + 19, + 4, + 16, + 30, + 32, + 10, + 48, + 48, + 32, + 16, + 23, + 37, + 36, + 40, + 7 + ], + "weighted_loads": [ + 1.2479982934892178, + 0.2612279802560806, + 1.340356077067554, + 2.629899948835373, + 0.08200429379940033, + 4.401689741760492, + 0.08652717620134354, + 7.560248924419284, + 4.416123330593109, + 1.9234709795564413, + 0.20384389907121658, + 2.8257631920278072, + 1.1985042821615934, + 1.2926793992519379, + 2.1638955138623714, + 2.7004004269838333, + 1.437424836680293, + 1.564746454358101, + 2.415695401839912, + 0.9774615969508886, + 0.8461876772344112, + 1.027333427220583, + 1.6976443119347095, + 1.602780431509018, + 1.4817519336938858, + 3.0438693556934595, + 3.3732039220631123, + 1.4071846082806587, + 0.09942596405744553, + 2.1631463542580605, + 0.77370909973979, + 1.8736098008230329, + 1.2972623631358147, + 4.8401351273059845, + 0.9712265245616436, + 0.6873425915837288, + 0.044715505093336105, + 0.22997471690177917, + 1.8824722692370415, + 0.7933434881269932, + 0.43526969105005264, + 2.64360542409122, + 3.386566188186407, + 0.36817757599055767, + 0.22673023119568825, + 1.0582342930138111, + 0.8621364422142506, + 0.749300166964531, + 0.6404449716210365, + 1.172032030299306, + 0.16960446909070015, + 0.9835622273385525, + 1.6759225465357304, + 1.890221543610096, + 0.37579519115388393, + 3.64612327888608, + 3.1324222907423973, + 2.308516636490822, + 0.7826905250549316, + 1.3001781329512596, + 2.662784554064274, + 2.97452550008893, + 2.3017520383000374, + 0.3621594253927469 + ], + "unique_experts": 64, + "load_cv": 0.7768917766692457, + "normalized_load_entropy": 0.9371429633903592, + "max_load_share": 0.07441574415744158 + } + }, + "s1_bos": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "3780dc84a6974e6c7928a05faa296420ef01c9d18e4a0f476871a9b2c7f9cac6", + "route_weight_sha256": "f4be10bbb2cd6830b5616d019de25247b7a3f1f89e2f8ea575f7910b310474b0", + "loads": [ + 24, + 6, + 27, + 46, + 2, + 43, + 1, + 116, + 54, + 21, + 1, + 39, + 14, + 19, + 31, + 36, + 22, + 20, + 28, + 16, + 11, + 18, + 28, + 25, + 27, + 33, + 43, + 11, + 1, + 33, + 11, + 25, + 18, + 82, + 13, + 11, + 1, + 3, + 29, + 17, + 9, + 28, + 36, + 7, + 1, + 16, + 9, + 11, + 14, + 16, + 2, + 12, + 29, + 30, + 9, + 37, + 48, + 25, + 16, + 12, + 31, + 24, + 40, + 8 + ], + "weighted_loads": [ + 1.3216787371784449, + 0.29104306176304817, + 1.3408278338611126, + 2.648559655994177, + 0.08060133457183838, + 4.446602646261454, + 0.04993190988898277, + 7.390402147546411, + 4.446451462805271, + 1.8552590310573578, + 0.0499538853764534, + 2.666932126507163, + 1.259244341403246, + 0.7986180335283279, + 2.003944970667362, + 2.5422764234244823, + 1.422295594587922, + 1.32418461330235, + 2.0857516452670097, + 0.6574924271553755, + 0.6154825687408447, + 0.9914474338293076, + 1.5811118185520172, + 1.520389012992382, + 1.4007784314453602, + 2.9788231812417507, + 3.3736935146152973, + 0.49652305617928505, + 0.06130081042647362, + 2.162598390132189, + 0.5663244836032391, + 1.8634734936058521, + 1.2526468262076378, + 4.48830359429121, + 0.9050660729408264, + 0.6262520365417004, + 0.037489067763090134, + 0.24263491481542587, + 1.8661671169102192, + 0.7913646660745144, + 0.3971351720392704, + 1.5250431038439274, + 3.2741419095546007, + 0.2704203128814697, + 0.03240414708852768, + 0.8552161790430546, + 0.6081156320869923, + 0.6246791295707226, + 0.6639001946896315, + 1.0327275432646275, + 0.06933619827032089, + 0.7828030772507191, + 1.6283719148486853, + 1.7383521012961864, + 0.34297969192266464, + 2.7747584134340286, + 3.0817719884216785, + 1.9188969284296036, + 0.7746934369206429, + 0.5723805092275143, + 2.259700708091259, + 1.9786009201779962, + 2.28067559376359, + 0.39606165140867233 + ], + "unique_experts": 64, + "load_cv": 0.8271533687808394, + "normalized_load_entropy": 0.928466801140348, + "max_load_share": 0.07859078590785908 + }, + "full_input": { + "tokens": 287, + "top_k": 6, + "decisions": 1722, + "ordered_route_sha256": "8c504d1716cfc6a970a58533eb9dc29aca07e6b8817ab2ed1400562875928eec", + "route_weight_sha256": "db8ac67138dcd7aa7a25b28b47388a710d33c7f11eb8b698720a3a7374e9f9b7", + "loads": [ + 24, + 6, + 29, + 46, + 6, + 43, + 1, + 117, + 54, + 22, + 4, + 43, + 17, + 21, + 36, + 36, + 22, + 24, + 33, + 18, + 13, + 19, + 28, + 25, + 28, + 36, + 45, + 33, + 1, + 36, + 19, + 26, + 23, + 100, + 15, + 13, + 3, + 5, + 30, + 17, + 10, + 45, + 38, + 9, + 4, + 22, + 16, + 14, + 22, + 20, + 5, + 26, + 30, + 34, + 9, + 50, + 49, + 31, + 16, + 29, + 43, + 34, + 40, + 9 + ], + "weighted_loads": [ + 1.3216787371784449, + 0.29104306176304817, + 1.395220368169248, + 2.648559655994177, + 0.2807158790528774, + 4.446602646261454, + 0.04993190988898277, + 7.428178096190095, + 4.446451462805271, + 1.8715214412659407, + 0.16510632261633873, + 2.904976213350892, + 1.416636623442173, + 1.3081224150955677, + 2.3244713246822357, + 2.5422764234244823, + 1.422295594587922, + 1.6315400283783674, + 2.48753859102726, + 0.7424799334257841, + 0.7101108953356743, + 1.039143219590187, + 1.5811118185520172, + 1.520389012992382, + 1.4420741572976112, + 3.303392617031932, + 3.4440224580466747, + 1.97075136564672, + 0.06130081042647362, + 2.2972172424197197, + 1.2363796420395374, + 1.8772212686017156, + 1.7429804876446724, + 5.382117334753275, + 1.0471593998372555, + 0.7911743670701981, + 0.12076953426003456, + 0.33040113002061844, + 1.9025218673050404, + 0.7913646660745144, + 0.43924059718847275, + 3.3326704166829586, + 3.3200202509760857, + 0.3376059737056494, + 0.2465469427406788, + 1.1625489182770252, + 0.9737492278218269, + 0.7429160140454769, + 1.3123945463448763, + 1.2615916728973389, + 0.24716971442103386, + 1.58131842315197, + 1.6979942303150892, + 1.9442336335778236, + 0.34297969192266464, + 3.761192638427019, + 3.1544916965067387, + 2.2757466174662113, + 0.7746934369206429, + 1.7435215264558792, + 3.0765874423086643, + 2.8841903218999505, + 2.28067559376359, + 0.4324187785387039 + ], + "unique_experts": 64, + "load_cv": 0.7411908700088012, + "normalized_load_entropy": 0.941822323083571, + "max_load_share": 0.06794425087108014 + } + }, + "s0_x": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "9850ee113feefc102b588a718a5c4661821d3305d1fb7afac3ff2aad2dd7dbc1", + "route_weight_sha256": "968329d10dd3c968e0d9005b1641cc1f5eef2ca99a3fde2cec83b47c693b8e53", + "loads": [ + 20, + 6, + 27, + 46, + 3, + 44, + 1, + 123, + 53, + 18, + 3, + 39, + 12, + 18, + 29, + 37, + 22, + 21, + 26, + 18, + 12, + 16, + 28, + 25, + 31, + 32, + 44, + 12, + 1, + 32, + 10, + 24, + 18, + 76, + 14, + 10, + 1, + 3, + 29, + 14, + 8, + 30, + 35, + 8, + 0, + 18, + 11, + 11, + 14, + 16, + 3, + 11, + 29, + 31, + 9, + 39, + 49, + 25, + 16, + 11, + 32, + 25, + 39, + 8 + ], + "weighted_loads": [ + 1.1472385413944721, + 0.28620169684290886, + 1.3479937426745892, + 2.682149615138769, + 0.11913609504699707, + 4.462572485208511, + 0.049676623195409775, + 7.94597565382719, + 4.402681864798069, + 1.7679864503443241, + 0.15523990988731384, + 2.7333511859178543, + 1.2112242467701435, + 0.7895883992314339, + 1.932035319507122, + 2.8287659361958504, + 1.4509287737309933, + 1.3655215129256248, + 1.9304099567234516, + 0.7680836878716946, + 0.6281732246279716, + 0.9216178264468908, + 1.541630707681179, + 1.5225336141884327, + 1.6531135886907578, + 2.937492214143276, + 3.468086425215006, + 0.5302740409970284, + 0.045034777373075485, + 2.157338947057724, + 0.5323700401932001, + 1.8071964979171753, + 1.2478473968803883, + 4.11089988052845, + 0.8829887695610523, + 0.565876130014658, + 0.059138257056474686, + 0.23815800249576569, + 1.9330564439296722, + 0.6796302571892738, + 0.3581411577761173, + 1.5686588063836098, + 3.217815939337015, + 0.3108985386788845, + 0.0, + 0.9496395587921143, + 0.7853410206735134, + 0.6148769184947014, + 0.6672555208206177, + 1.0099858418107033, + 0.10673315264284611, + 0.7409350946545601, + 1.6432959642261267, + 1.8209095820784569, + 0.32355106621980667, + 2.934290386736393, + 3.19818283803761, + 1.905590120702982, + 0.8013763017952442, + 0.5227207131683826, + 2.378911055624485, + 1.9843456214293838, + 2.2764117028564215, + 0.3849937357008457 + ], + "unique_experts": 63, + "load_cv": 0.8404012078246763, + "normalized_load_entropy": 0.9280269343685378, + "max_load_share": 0.08333333333333333 + }, + "full_input": { + "tokens": 271, + "top_k": 6, + "decisions": 1626, + "ordered_route_sha256": "50e207d26f66868cf52d4dbd95c5cb194bfc54a4935019f9badad0cdb5470773", + "route_weight_sha256": "7743d97e847638010b700f3d2382ab43eb2dd21baabf40a6ecaa094dfb16b8fa", + "loads": [ + 21, + 7, + 28, + 46, + 3, + 44, + 1, + 128, + 53, + 19, + 5, + 41, + 13, + 20, + 31, + 37, + 22, + 25, + 31, + 20, + 16, + 19, + 28, + 25, + 31, + 34, + 44, + 17, + 2, + 33, + 13, + 25, + 18, + 85, + 15, + 11, + 1, + 3, + 29, + 14, + 8, + 39, + 38, + 10, + 4, + 22, + 17, + 15, + 14, + 18, + 6, + 17, + 29, + 33, + 9, + 47, + 49, + 32, + 16, + 23, + 37, + 38, + 39, + 8 + ], + "weighted_loads": [ + 1.1810420639812946, + 0.3344609886407852, + 1.36208217125386, + 2.682149615138769, + 0.11913609504699707, + 4.462572485208511, + 0.049676623195409775, + 8.159508403390646, + 4.402681864798069, + 1.784248860552907, + 0.25062359869480133, + 2.8469847813248634, + 1.243931371718645, + 1.2933044508099556, + 2.0871667861938477, + 2.8287659361958504, + 1.4509287737309933, + 1.6557992100715637, + 2.26819746568799, + 0.8748245649039745, + 0.7946221679449081, + 1.0370514038950205, + 1.541630707681179, + 1.5225336141884327, + 1.6531135886907578, + 3.0014129672199488, + 3.468086425215006, + 1.1942498832941055, + 0.09137594327330589, + 2.199972927570343, + 0.7760381083935499, + 1.8209442729130387, + 1.2478473968803883, + 4.531747546046972, + 0.9128160588443279, + 0.6028072349727154, + 0.059138257056474686, + 0.23815800249576569, + 1.9330564439296722, + 0.6796302571892738, + 0.3581411577761173, + 2.568175222724676, + 3.3230247236788273, + 0.40845926851034164, + 0.21254079043865204, + 1.1650934554636478, + 1.0697055868804455, + 0.7774124257266521, + 0.6672555208206177, + 1.0967582985758781, + 0.23729476146399975, + 1.0672661773860455, + 1.6432959642261267, + 1.9427709877490997, + 0.32355106621980667, + 3.5200450383126736, + 3.19818283803761, + 2.313531994819641, + 0.8013763017952442, + 1.2997111603617668, + 2.7206788547337055, + 3.11375283729285, + 2.2764117028564215, + 0.3849937357008457 + ], + "unique_experts": 64, + "load_cv": 0.7882440520622908, + "normalized_load_entropy": 0.9368588613426476, + "max_load_share": 0.07872078720787208 + } + }, + "s1_x": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "6110af2f233b4939b859b33904b92401b4d14c45e3e14d7fd64b328d458e104c", + "route_weight_sha256": "bb126f79c316e3054a9e92de870d60fced6cd9efbfb9dbf98b1ac921c4ee98ce", + "loads": [ + 23, + 6, + 28, + 45, + 3, + 41, + 2, + 118, + 53, + 22, + 1, + 38, + 13, + 17, + 32, + 35, + 21, + 22, + 27, + 13, + 12, + 16, + 30, + 26, + 28, + 32, + 44, + 11, + 1, + 31, + 10, + 26, + 18, + 83, + 13, + 11, + 1, + 3, + 29, + 16, + 8, + 30, + 36, + 6, + 1, + 17, + 10, + 11, + 15, + 16, + 4, + 14, + 31, + 29, + 9, + 35, + 48, + 25, + 16, + 11, + 31, + 24, + 40, + 8 + ], + "weighted_loads": [ + 1.284822229295969, + 0.2795560322701931, + 1.3870345149189234, + 2.5811277329921722, + 0.11721327155828476, + 4.383094500750303, + 0.08659691736102104, + 7.359067961573601, + 4.376713167876005, + 1.8855087496340275, + 0.050993647426366806, + 2.628549737855792, + 1.224976984784007, + 0.7161271143704653, + 2.0364297069609165, + 2.541622783988714, + 1.379189670085907, + 1.50850348174572, + 2.0271638613194227, + 0.552314892411232, + 0.6758459433913231, + 0.9341626837849617, + 1.6253435034304857, + 1.5242376439273357, + 1.4415213447064161, + 2.947002975270152, + 3.494827102869749, + 0.4798874631524086, + 0.057874370366334915, + 2.0475546941161156, + 0.5377254858613014, + 1.908154034987092, + 1.2522424384951591, + 4.279732812196016, + 0.8867471106350422, + 0.6240770108997822, + 0.052148815244436264, + 0.23943763226270676, + 1.917105957865715, + 0.7579420916736126, + 0.3585340641438961, + 1.6446460764855146, + 3.250875972211361, + 0.23477337881922722, + 0.032768793404102325, + 0.8726206608116627, + 0.7143590450286865, + 0.6293221972882748, + 0.7143100313842297, + 1.0128281526267529, + 0.14563314989209175, + 0.8955318965017796, + 1.7180613931268454, + 1.6488873362541199, + 0.33829808235168457, + 2.6490542888641357, + 3.121543388813734, + 1.8840279467403889, + 0.7860606871545315, + 0.5141647309064865, + 2.2819499485194683, + 1.9632996460422873, + 2.2850349582731724, + 0.3894911892712116 + ], + "unique_experts": 64, + "load_cv": 0.8312983282607427, + "normalized_load_entropy": 0.9291545205020308, + "max_load_share": 0.07994579945799458 + }, + "full_input": { + "tokens": 287, + "top_k": 6, + "decisions": 1722, + "ordered_route_sha256": "d3cebd297bfb724f734c7ab9766ab59fb7740748c5eaa50a968d16fc34bdc5b1", + "route_weight_sha256": "3497928c655978b0f745e6778f1abc314841dfd17ba11ac231c0b822d5be3fc0", + "loads": [ + 24, + 7, + 30, + 45, + 7, + 41, + 2, + 120, + 53, + 23, + 5, + 43, + 16, + 18, + 37, + 35, + 21, + 27, + 31, + 14, + 13, + 17, + 30, + 26, + 29, + 35, + 46, + 29, + 1, + 34, + 19, + 27, + 23, + 101, + 15, + 13, + 3, + 5, + 30, + 16, + 9, + 46, + 38, + 8, + 3, + 24, + 18, + 15, + 23, + 20, + 10, + 29, + 32, + 33, + 9, + 45, + 49, + 32, + 16, + 26, + 42, + 35, + 40, + 9 + ], + "weighted_loads": [ + 1.3406735807657242, + 0.32973121851682663, + 1.4414270492270589, + 2.5811277329921722, + 0.3173278160393238, + 4.383094500750303, + 0.08659691736102104, + 7.445844262838364, + 4.376713167876005, + 1.9017711598426104, + 0.21450670436024666, + 2.924298135563731, + 1.3823692668229342, + 1.1854428816586733, + 2.3646285496652126, + 2.541622783988714, + 1.379189670085907, + 1.8440613634884357, + 2.3552948590368032, + 0.5885985679924488, + 0.7172883711755276, + 0.9818584695458412, + 1.6253435034304857, + 1.5242376439273357, + 1.4828170705586672, + 3.2715724110603333, + 3.5651560463011265, + 1.6921438816934824, + 0.057874370366334915, + 2.1821735464036465, + 1.2669422887265682, + 1.9219018099829555, + 1.7425760999321938, + 5.190711461007595, + 1.0288404375314713, + 0.7889993414282799, + 0.1354292817413807, + 0.3272038474678993, + 1.9534607082605362, + 0.7579420916736126, + 0.40063948929309845, + 3.005718620494008, + 3.296754313632846, + 0.30195903964340687, + 0.17454099282622337, + 1.2438469491899014, + 1.1460760049521923, + 0.7948616407811642, + 1.3628043830394745, + 1.2188058085739613, + 0.46264834702014923, + 1.8021763116121292, + 1.7876837085932493, + 1.843076255172491, + 0.33829808235168457, + 3.3839717730879784, + 3.194263096898794, + 2.2939950712025166, + 0.7860606871545315, + 1.5522462762892246, + 3.0480877347290516, + 2.952930278144777, + 2.2850349582731724, + 0.4258483164012432 + ], + "unique_experts": 64, + "load_cv": 0.7438650380782086, + "normalized_load_entropy": 0.9427524347332312, + "max_load_share": 0.06968641114982578 + } + }, + "s0_period": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "f22238f0f7d3553425c5dc90436e72df3c25e9c1c3f557d9cfdc32e6d2dc7e76", + "route_weight_sha256": "d650d86aa1dcb1e7ed6c8acc40cafea6cf11ff79f318712079171c5de74aedad", + "loads": [ + 21, + 6, + 31, + 46, + 3, + 45, + 1, + 119, + 54, + 19, + 2, + 38, + 12, + 17, + 29, + 39, + 23, + 21, + 27, + 17, + 14, + 16, + 28, + 26, + 31, + 32, + 44, + 12, + 1, + 31, + 10, + 24, + 19, + 73, + 13, + 11, + 1, + 3, + 29, + 15, + 8, + 31, + 35, + 8, + 0, + 16, + 11, + 11, + 14, + 16, + 2, + 11, + 29, + 31, + 9, + 38, + 49, + 25, + 16, + 10, + 32, + 24, + 38, + 9 + ], + "weighted_loads": [ + 1.1814558506011963, + 0.2806207574903965, + 1.4903042502701283, + 2.6920416951179504, + 0.11853444948792458, + 4.531546641141176, + 0.049667153507471085, + 7.701452556997538, + 4.44723791629076, + 1.8176214285194874, + 0.10900050401687622, + 2.6931025609374046, + 1.180142916738987, + 0.7648803405463696, + 1.9652138911187649, + 2.862568460404873, + 1.4915502909570932, + 1.4017336964607239, + 1.9987093368545175, + 0.7090121656656265, + 0.7191489394754171, + 0.9375042207539082, + 1.553337100893259, + 1.5635883584618568, + 1.635330930352211, + 2.936057772487402, + 3.4895746037364006, + 0.5246349051594734, + 0.045250166207551956, + 2.131931744515896, + 0.5398754887282848, + 1.8039596788585186, + 1.2882913798093796, + 3.930878719314933, + 0.8428901210427284, + 0.6069005355238914, + 0.056968823075294495, + 0.23524291068315506, + 1.953997429460287, + 0.710437785834074, + 0.3602122440934181, + 1.6381620969623327, + 3.2395709194242954, + 0.31501665338873863, + 0.0, + 0.8739287666976452, + 0.7731042429804802, + 0.614598136395216, + 0.6733710411936045, + 1.0183420814573765, + 0.07446897774934769, + 0.7432240396738052, + 1.6567078940570354, + 1.811399221420288, + 0.3426998555660248, + 2.821756787598133, + 3.1973644252866507, + 1.912331610918045, + 0.8058582544326782, + 0.4888997860252857, + 2.3506696298718452, + 1.9401900358498096, + 2.26204701513052, + 0.42595104314386845 + ], + "unique_experts": 63, + "load_cv": 0.8239864026207828, + "normalized_load_entropy": 0.9288686167581979, + "max_load_share": 0.08062330623306233 + }, + "full_input": { + "tokens": 271, + "top_k": 6, + "decisions": 1626, + "ordered_route_sha256": "f65ae485a6e91909175a5aeafba78e2543e0fd5c0c05f0aba31a238f3e6cb5b8", + "route_weight_sha256": "1e22ce3675f984e4af9ed4d48473e6523397b8ae172a33eb1f25e2d4c4272b72", + "loads": [ + 22, + 7, + 32, + 46, + 3, + 45, + 1, + 123, + 54, + 20, + 5, + 40, + 14, + 19, + 31, + 39, + 23, + 24, + 32, + 19, + 18, + 19, + 28, + 26, + 31, + 34, + 44, + 18, + 2, + 32, + 14, + 25, + 19, + 81, + 14, + 12, + 1, + 3, + 29, + 15, + 8, + 41, + 38, + 10, + 3, + 20, + 16, + 14, + 14, + 18, + 5, + 18, + 29, + 33, + 9, + 46, + 49, + 32, + 16, + 22, + 38, + 36, + 38, + 9 + ], + "weighted_loads": [ + 1.2127240970730782, + 0.31718019396066666, + 1.504392678849399, + 2.6920416951179504, + 0.11853444948792458, + 4.531546641141176, + 0.049667153507471085, + 7.876165438443422, + 4.44723791629076, + 1.8338838387280703, + 0.23664024472236633, + 2.8036362417042255, + 1.2500882558524609, + 1.2685963921248913, + 2.119688916951418, + 2.862568460404873, + 1.4915502909570932, + 1.6668072789907455, + 2.336496845819056, + 0.8151924051344395, + 0.8855978827923536, + 1.0529377982020378, + 1.553337100893259, + 1.5635883584618568, + 1.635330930352211, + 2.9999785255640745, + 3.4895746037364006, + 1.225103635340929, + 0.09159133210778236, + 2.174565725028515, + 0.8578842282295227, + 1.817707453854382, + 1.2882913798093796, + 4.308375833556056, + 0.872717410326004, + 0.6438316404819489, + 0.056968823075294495, + 0.23524291068315506, + 1.953997429460287, + 0.710437785834074, + 0.3602122440934181, + 2.7418541703373194, + 3.3447797037661076, + 0.41257738322019577, + 0.167355976998806, + 1.062411442399025, + 1.0079110488295555, + 0.7400283738970757, + 0.6733710411936045, + 1.1274344995617867, + 0.19980795867741108, + 1.141195073723793, + 1.6567078940570354, + 1.9277803413569927, + 0.3426998555660248, + 3.4245190620422363, + 3.1973644252866507, + 2.3297604583203793, + 0.8058582544326782, + 1.259701430797577, + 2.7382118590176105, + 2.9824577420949936, + 2.26204701513052, + 0.42595104314386845 + ], + "unique_experts": 64, + "load_cv": 0.7666667752029602, + "normalized_load_entropy": 0.9384727383838212, + "max_load_share": 0.07564575645756458 + } + }, + "s1_period": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "24a495da7edf411b6be2fb9c33faaf154f406b23b87a5ef9824c2e30ea1ffc40", + "route_weight_sha256": "bb4aa3f193741a02573d69a62ebe3a3e7d2249ed33aff39ad377a7a7bff1e3d3", + "loads": [ + 24, + 4, + 27, + 45, + 2, + 42, + 1, + 117, + 53, + 21, + 1, + 39, + 15, + 17, + 31, + 36, + 22, + 23, + 26, + 12, + 13, + 16, + 30, + 25, + 28, + 33, + 43, + 11, + 1, + 32, + 9, + 25, + 19, + 84, + 13, + 11, + 1, + 3, + 29, + 17, + 9, + 30, + 36, + 7, + 1, + 17, + 9, + 11, + 16, + 16, + 3, + 15, + 30, + 30, + 9, + 35, + 48, + 25, + 17, + 9, + 31, + 24, + 39, + 8 + ], + "weighted_loads": [ + 1.315992545336485, + 0.21818017959594727, + 1.35840137116611, + 2.5544728487730026, + 0.0811430774629116, + 4.47499880567193, + 0.050359051674604416, + 7.233400195837021, + 4.366506300866604, + 1.8191779926419258, + 0.05168033018708229, + 2.6649106927216053, + 1.3008181136101484, + 0.7150385696440935, + 2.00916700437665, + 2.522494427859783, + 1.4418279007077217, + 1.5839343145489693, + 1.9994661901146173, + 0.47996949404478073, + 0.7185739502310753, + 0.931094329804182, + 1.6093372646719217, + 1.4929072111845016, + 1.4369882438331842, + 2.98785013332963, + 3.454569701105356, + 0.47833240404725075, + 0.04894879087805748, + 2.0864284485578537, + 0.49444233626127243, + 1.8837154284119606, + 1.2977206110954285, + 4.315550800412893, + 0.8960404098033905, + 0.6290843896567822, + 0.05480760708451271, + 0.23509782552719116, + 1.915494967252016, + 0.7934123873710632, + 0.3936091363430023, + 1.6483261100947857, + 3.2544958405196667, + 0.273673914372921, + 0.03220881521701813, + 0.8923760131001472, + 0.6580618470907211, + 0.6288893111050129, + 0.7498944811522961, + 1.0184888057410717, + 0.10297580435872078, + 0.9359904564917088, + 1.6714371256530285, + 1.6690447740256786, + 0.3420152273029089, + 2.559040851891041, + 3.117241036146879, + 1.8763128742575645, + 0.8231345787644386, + 0.42054395005106926, + 2.23954775929451, + 1.9319849004969, + 2.2459370978176594, + 0.38102989830076694 + ], + "unique_experts": 64, + "load_cv": 0.8326753962961659, + "normalized_load_entropy": 0.9278225498020285, + "max_load_share": 0.07926829268292683 + }, + "full_input": { + "tokens": 287, + "top_k": 6, + "decisions": 1722, + "ordered_route_sha256": "eccbf7fff087801b08af2237c88a04394d1ba8b4498587cb185d413f4b73a795", + "route_weight_sha256": "d3fb2c2676afb855f879c85e3080760a11c229024331ca71b0235c9fe939f5f2", + "loads": [ + 26, + 4, + 29, + 46, + 6, + 42, + 1, + 118, + 53, + 22, + 4, + 44, + 18, + 18, + 36, + 36, + 22, + 28, + 30, + 13, + 14, + 17, + 30, + 25, + 29, + 36, + 45, + 29, + 1, + 35, + 19, + 26, + 24, + 101, + 15, + 13, + 3, + 5, + 30, + 17, + 10, + 46, + 38, + 9, + 3, + 24, + 16, + 15, + 24, + 20, + 7, + 31, + 31, + 35, + 9, + 46, + 49, + 32, + 17, + 25, + 42, + 35, + 39, + 9 + ], + "weighted_loads": [ + 1.4055174104869366, + 0.21818017959594727, + 1.4127939054742455, + 2.611781120300293, + 0.28125762194395065, + 4.47499880567193, + 0.050359051674604416, + 7.271176144480705, + 4.366506300866604, + 1.8354404028505087, + 0.16683276742696762, + 2.9544599503278732, + 1.4582103956490755, + 1.1843543369323015, + 2.319589078426361, + 2.522494427859783, + 1.4418279007077217, + 1.9754389822483063, + 2.327597187831998, + 0.5148205198347569, + 0.7600163780152798, + 0.9787901155650616, + 1.6093372646719217, + 1.4929072111845016, + 1.4782839696854353, + 3.312419569119811, + 3.5248986445367336, + 1.693841090425849, + 0.04894879087805748, + 2.2210473008453846, + 1.3309591114521027, + 1.897463203407824, + 1.788054272532463, + 5.1724873296916485, + 1.0381337366998196, + 0.7940067201852798, + 0.13808807358145714, + 0.32286404073238373, + 1.9518497176468372, + 0.7934123873710632, + 0.43571456149220467, + 3.0207461193203926, + 3.3003741819411516, + 0.34085957519710064, + 0.17398101463913918, + 1.2403217069804668, + 1.0236954428255558, + 0.7941860370337963, + 1.398388832807541, + 1.2238998040556908, + 0.34545545279979706, + 1.9274879954755306, + 1.7410594411194324, + 1.8985333144664764, + 0.3420152273029089, + 3.3518486842513084, + 3.1899607442319393, + 2.3656384758651257, + 0.8231345787644386, + 1.4653587602078915, + 3.0049839541316032, + 2.886471106670797, + 2.2459370978176594, + 0.41738702543079853 + ], + "unique_experts": 64, + "load_cv": 0.743894052309106, + "normalized_load_entropy": 0.9413855487443089, + "max_load_share": 0.06852497096399536 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 246, + "ordered_topk_exact_tokens": 180, + "set_exact_tokens": 202, + "mean_set_jaccard": 0.9488966318234611, + "mean_token_weighted_tv": 0.011882568100028164, + "aggregate_load_tv": 0.015582655826558267 + }, + "system_bos": { + "tokens": 246, + "ordered_topk_exact_tokens": 166, + "set_exact_tokens": 194, + "mean_set_jaccard": 0.933701122725513, + "mean_token_weighted_tv": 0.01662111050275162, + "aggregate_load_tv": 0.018292682926829274 + }, + "system_x": { + "tokens": 246, + "ordered_topk_exact_tokens": 134, + "set_exact_tokens": 172, + "mean_set_jaccard": 0.9088269454123112, + "mean_token_weighted_tv": 0.02171178759885876, + "aggregate_load_tv": 0.027100271002710015 + }, + "system_period": { + "tokens": 246, + "ordered_topk_exact_tokens": 134, + "set_exact_tokens": 169, + "mean_set_jaccard": 0.9053426248548199, + "mean_token_weighted_tv": 0.022455416048112197, + "aggregate_load_tv": 0.03048780487804878 + }, + "bos_at_s0": { + "tokens": 246, + "ordered_topk_exact_tokens": 142, + "set_exact_tokens": 185, + "mean_set_jaccard": 0.9239256678281069, + "mean_token_weighted_tv": 0.019293331342363138, + "aggregate_load_tv": 0.025067750677506773 + }, + "bos_at_s1": { + "tokens": 246, + "ordered_topk_exact_tokens": 154, + "set_exact_tokens": 183, + "mean_set_jaccard": 0.9198606271777003, + "mean_token_weighted_tv": 0.02047213155026661, + "aggregate_load_tv": 0.025745257452574527 + }, + "x_at_s0": { + "tokens": 246, + "ordered_topk_exact_tokens": 123, + "set_exact_tokens": 164, + "mean_set_jaccard": 0.8995354239256678, + "mean_token_weighted_tv": 0.02412314038170971, + "aggregate_load_tv": 0.031842818428184275 + }, + "x_at_s1": { + "tokens": 246, + "ordered_topk_exact_tokens": 125, + "set_exact_tokens": 165, + "mean_set_jaccard": 0.8958575300038714, + "mean_token_weighted_tv": 0.026316166141759453, + "aggregate_load_tv": 0.030487804878048783 + }, + "period_at_s0": { + "tokens": 246, + "ordered_topk_exact_tokens": 123, + "set_exact_tokens": 164, + "mean_set_jaccard": 0.8995354239256678, + "mean_token_weighted_tv": 0.023740321168736592, + "aggregate_load_tv": 0.03590785907859078 + }, + "period_at_s1": { + "tokens": 246, + "ordered_topk_exact_tokens": 137, + "set_exact_tokens": 171, + "mean_set_jaccard": 0.9054394115369725, + "mean_token_weighted_tv": 0.024601158566727507, + "aggregate_load_tv": 0.02845528455284553 + } + } + }, + "layer_11": { + "layer": 11, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "a825a0766d03e28c93010f36b20f0082474ab0a0b5f7a1d01c018f20b9a08452", + "route_weight_sha256": "ef9fde26c35dbcbca13060a058630b11ee042ec8a508ebff32a1abdef9dcac31", + "loads": [ + 32, + 53, + 13, + 31, + 32, + 24, + 14, + 25, + 30, + 15, + 17, + 30, + 21, + 29, + 30, + 22, + 25, + 32, + 3, + 21, + 15, + 30, + 38, + 20, + 14, + 26, + 23, + 21, + 6, + 22, + 2, + 31, + 68, + 53, + 27, + 16, + 28, + 4, + 5, + 16, + 51, + 34, + 25, + 11, + 46, + 18, + 28, + 13, + 11, + 40, + 38, + 16, + 32, + 3, + 3, + 2, + 19, + 26, + 15, + 31, + 38, + 9, + 3, + 0 + ], + "weighted_loads": [ + 2.07667962834239, + 2.388025801628828, + 0.7684708945453167, + 1.525042001157999, + 2.5832569152116776, + 1.0674949176609516, + 0.8623376227915287, + 1.5548433680087328, + 1.939959468320012, + 0.5539659578353167, + 0.8685955572873354, + 1.5387932043522596, + 1.1457771454006433, + 1.8707306552678347, + 1.543776448816061, + 0.9487558789551258, + 0.9118748567998409, + 1.585529962554574, + 0.14361588284373283, + 1.1358994450420141, + 0.6459980495274067, + 2.0858596079051495, + 1.8463333453983068, + 1.227886252105236, + 0.5057378839701414, + 1.4508572202175856, + 0.8327463306486607, + 1.3726297914981842, + 0.2531273812055588, + 0.9858410824090242, + 0.08661932125687599, + 2.6444391943514347, + 4.700328936800361, + 3.272491689771414, + 1.7559272721409798, + 1.1150066144764423, + 1.2744071409106255, + 0.13765865564346313, + 0.20858242362737656, + 0.6518393512815237, + 4.976114377379417, + 1.6571397129446268, + 1.4097111262381077, + 0.4823985882103443, + 3.858876548707485, + 0.8803810998797417, + 1.9786395952105522, + 0.7501906268298626, + 0.490791242569685, + 3.3264492861926556, + 1.8846954442560673, + 1.526236029341817, + 1.7015742976218462, + 0.11092568188905716, + 0.12744345143437386, + 0.09660002589225769, + 1.241455353796482, + 1.1406213212758303, + 0.56135094165802, + 2.1945435497909784, + 1.5244168378412724, + 0.46117881685495377, + 0.1916259005665779, + 0.0 + ], + "unique_experts": 63, + "load_cv": 0.6020348228984059, + "normalized_load_entropy": 0.9526978810969623, + "max_load_share": 0.04607046070460705 + }, + "full_input": { + "tokens": 271, + "top_k": 6, + "decisions": 1626, + "ordered_route_sha256": "610c1260d85d5d0a71dcbe4b5ad2540f100fabb9c7daf7ce97a2c895312b10ae", + "route_weight_sha256": "aedb7e8edb90d59b522f0b46012297853fa733f0584b5dec59556c07c5acecbd", + "loads": [ + 32, + 53, + 14, + 31, + 38, + 24, + 14, + 25, + 34, + 16, + 20, + 33, + 21, + 29, + 30, + 28, + 32, + 34, + 15, + 21, + 15, + 30, + 39, + 25, + 14, + 26, + 24, + 22, + 13, + 22, + 8, + 39, + 70, + 53, + 31, + 19, + 28, + 4, + 5, + 16, + 58, + 34, + 25, + 33, + 49, + 18, + 28, + 21, + 11, + 42, + 38, + 16, + 32, + 3, + 8, + 5, + 19, + 26, + 18, + 32, + 38, + 13, + 12, + 0 + ], + "weighted_loads": [ + 2.07667962834239, + 2.388025801628828, + 0.8273450881242752, + 1.525042001157999, + 2.8478329237550497, + 1.0674949176609516, + 0.8623376227915287, + 1.5548433680087328, + 2.1937053967267275, + 0.5849657822400331, + 0.9403523011133075, + 1.5927343741059303, + 1.1457771454006433, + 1.8707306552678347, + 1.543776448816061, + 1.1803614143282175, + 1.5494626760482788, + 1.6153678949922323, + 2.2194280549883842, + 1.1358994450420141, + 0.6459980495274067, + 2.0858596079051495, + 1.8502577100880444, + 1.4824001118540764, + 0.5057378839701414, + 1.4508572202175856, + 0.8361058856826276, + 1.385176409035921, + 0.7084185071289539, + 0.9858410824090242, + 0.3833141718059778, + 2.9990168660879135, + 4.765163915231824, + 3.272491689771414, + 1.9304579086601734, + 1.355489056557417, + 1.2744071409106255, + 0.13765865564346313, + 0.20858242362737656, + 0.6518393512815237, + 5.361844252794981, + 1.6571397129446268, + 1.4097111262381077, + 2.761003714054823, + 4.020514089614153, + 0.8803810998797417, + 1.9786395952105522, + 1.3261990323662758, + 0.490791242569685, + 3.421797815710306, + 1.8846954442560673, + 1.526236029341817, + 1.7015742976218462, + 0.11092568188905716, + 0.4275019448250532, + 0.22378939390182495, + 1.241455353796482, + 1.1406213212758303, + 0.6985002011060715, + 2.226773152127862, + 1.5244168378412724, + 0.635436100885272, + 0.7262158691883087, + 0.0 + ], + "unique_experts": 63, + "load_cv": 0.5348941522455363, + "normalized_load_entropy": 0.9639638044454298, + "max_load_share": 0.04305043050430504 + } + }, + "s1_eos": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "0ce2e61943cb02c7978c260d559fc24d05566ef6d4b5a88f139ddbebb997b203", + "route_weight_sha256": "dd089dcdfb843e9c4c0650ce479ff68c4feaed37babb84ff4bbfb0431d5cd25c", + "loads": [ + 32, + 50, + 12, + 31, + 32, + 23, + 14, + 26, + 29, + 14, + 16, + 32, + 19, + 29, + 30, + 26, + 24, + 31, + 3, + 22, + 14, + 30, + 39, + 19, + 14, + 26, + 25, + 20, + 6, + 21, + 2, + 31, + 71, + 51, + 27, + 17, + 28, + 5, + 5, + 16, + 52, + 32, + 24, + 11, + 46, + 18, + 28, + 12, + 11, + 40, + 39, + 16, + 33, + 4, + 4, + 2, + 19, + 26, + 17, + 32, + 35, + 11, + 2, + 0 + ], + "weighted_loads": [ + 2.0871861837804317, + 2.2506262101233006, + 0.7160123847424984, + 1.5065618827939034, + 2.5665661357343197, + 1.0254490375518799, + 0.8639671392738819, + 1.5851997826248407, + 1.9092002157121897, + 0.5153353977948427, + 0.846036110073328, + 1.6003494542092085, + 1.0934437029063702, + 1.871386293321848, + 1.5470760390162468, + 1.0922810472548008, + 0.8727528396993876, + 1.5666090194135904, + 0.1362607143819332, + 1.1559564359486103, + 0.6166513599455357, + 2.0418374836444855, + 1.8775292076170444, + 1.2002956308424473, + 0.5021101497113705, + 1.4329362884163857, + 0.9275587387382984, + 1.332993283867836, + 0.25917651131749153, + 0.955459725111723, + 0.07924392074346542, + 2.6918937116861343, + 4.864871250465512, + 3.163491476327181, + 1.7835172228515148, + 1.1570184789597988, + 1.2650296427309513, + 0.16896109282970428, + 0.21250547468662262, + 0.6438455674797297, + 4.989027393981814, + 1.6281082667410374, + 1.375297088176012, + 0.4765231292694807, + 3.919308250769973, + 0.877566346898675, + 1.99251713976264, + 0.7257842905819416, + 0.4899967983365059, + 3.2889412865042686, + 1.9002010636031628, + 1.5246770903468132, + 1.7495726328343153, + 0.1459689699113369, + 0.16567989438772202, + 0.09815118089318275, + 1.2158946320414543, + 1.1545598320662975, + 0.6305928025394678, + 2.232260562479496, + 1.4241430424153805, + 0.5350743196904659, + 0.1394394338130951, + 0.0 + ], + "unique_experts": 63, + "load_cv": 0.6016443269754366, + "normalized_load_entropy": 0.9531825383963543, + "max_load_share": 0.048102981029810296 + }, + "full_input": { + "tokens": 287, + "top_k": 6, + "decisions": 1722, + "ordered_route_sha256": "3681e819d51df86297ebe579aac3c7f935e0ccbff443dc0b505ab325e44ea873", + "route_weight_sha256": "ec7bb0f75081ad37e7421bbdd41ed83734fac9a76af5bd24e5403c6159ea3158", + "loads": [ + 34, + 51, + 13, + 31, + 42, + 26, + 14, + 28, + 39, + 14, + 20, + 35, + 19, + 29, + 30, + 28, + 43, + 33, + 14, + 23, + 15, + 31, + 42, + 23, + 14, + 26, + 28, + 22, + 17, + 21, + 11, + 38, + 72, + 51, + 32, + 23, + 28, + 5, + 5, + 17, + 58, + 32, + 24, + 38, + 48, + 18, + 29, + 26, + 11, + 43, + 39, + 16, + 33, + 9, + 25, + 11, + 25, + 27, + 19, + 35, + 36, + 19, + 13, + 1 + ], + "weighted_loads": [ + 2.2349486462771893, + 2.283192079514265, + 0.764154452830553, + 1.5065618827939034, + 3.1058041155338287, + 1.1271198820322752, + 0.8639671392738819, + 1.7143182773143053, + 2.531767202541232, + 0.5153353977948427, + 0.9592318586073816, + 1.653511286713183, + 1.0934437029063702, + 1.871386293321848, + 1.5470760390162468, + 1.1648655273020267, + 2.5596435125917196, + 1.59564857929945, + 2.2097458839416504, + 1.194871462881565, + 0.689990546554327, + 2.112477093935013, + 1.991155483527109, + 1.3833916895091534, + 0.5021101497113705, + 1.4329362884163857, + 1.0062310979701579, + 1.383541252464056, + 1.0231790579855442, + 0.955459725111723, + 0.5389783624559641, + 2.9996952824294567, + 4.898576406762004, + 3.163491476327181, + 2.0202636141330004, + 1.6541254818439484, + 1.2650296427309513, + 0.16896109282970428, + 0.21250547468662262, + 0.6910517495125532, + 5.307646291330457, + 1.6281082667410374, + 1.375297088176012, + 3.090287337079644, + 4.049010319635272, + 0.877566346898675, + 2.0389925725758076, + 1.7524028047919273, + 0.4899967983365059, + 3.512563481926918, + 1.9002010636031628, + 1.5246770903468132, + 1.7495726328343153, + 0.450221735984087, + 1.4358563665300608, + 0.5115653797984123, + 1.6846481151878834, + 1.1990095414221287, + 0.7339217383414507, + 2.357885427772999, + 1.4611224941909313, + 0.8842749018222094, + 0.7203030921518803, + 0.03997061401605606 + ], + "unique_experts": 64, + "load_cv": 0.4921752676053439, + "normalized_load_entropy": 0.9701907604495871, + "max_load_share": 0.041811846689895474 + } + }, + "s0_bos": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "602ae5631337dbc6cc2e06c683d565ee240bfa79c79ecb3c824a651140535285", + "route_weight_sha256": "4f89c4bcbcd31395596a1f4af0f2950bfd8b0c0924ec83e83b432dca52b62fa1", + "loads": [ + 32, + 53, + 9, + 33, + 33, + 23, + 14, + 25, + 30, + 14, + 16, + 29, + 21, + 29, + 30, + 23, + 26, + 33, + 5, + 19, + 14, + 30, + 33, + 21, + 18, + 26, + 29, + 20, + 6, + 23, + 1, + 32, + 70, + 53, + 25, + 16, + 28, + 3, + 6, + 17, + 50, + 31, + 23, + 8, + 46, + 19, + 29, + 13, + 12, + 37, + 38, + 16, + 30, + 3, + 7, + 3, + 19, + 24, + 14, + 31, + 41, + 10, + 4, + 0 + ], + "weighted_loads": [ + 2.117770928889513, + 2.336393738165498, + 0.6407437659800053, + 1.6049973592162132, + 2.6724767945706844, + 1.048897661268711, + 0.8740701340138912, + 1.5459628719836473, + 1.9516852274537086, + 0.5285323988646269, + 0.8301694802939892, + 1.465817341580987, + 1.1963044945150614, + 1.8590187206864357, + 1.5612337794154882, + 0.9930361099541187, + 0.962751679122448, + 1.5865279249846935, + 0.2070249803364277, + 1.097005708143115, + 0.6313688680529594, + 2.120825245976448, + 1.6627869103103876, + 1.262520007789135, + 0.6470631174743176, + 1.434150766581297, + 1.0687092766165733, + 1.3522495776414871, + 0.24829187244176865, + 1.0542606003582478, + 0.058718763291835785, + 2.67483988776803, + 4.769497310742736, + 3.2960518449544907, + 1.5819871425628662, + 1.1032744087278843, + 1.302456732839346, + 0.10695371776819229, + 0.24248158186674118, + 0.6827500052750111, + 4.937523901462555, + 1.57356446236372, + 1.3323844149708748, + 0.3938790336251259, + 3.913694513961673, + 0.919526856392622, + 2.027424916625023, + 0.7614613845944405, + 0.5208347123116255, + 3.191498525440693, + 1.8899256028234959, + 1.5319055262953043, + 1.6236618235707283, + 0.1106150709092617, + 0.2869292516261339, + 0.15044691786170006, + 1.2296621948480606, + 1.0618923995643854, + 0.5290540903806686, + 2.161170309409499, + 1.6717196945101023, + 0.5016389787197113, + 0.20953962579369545, + 0.0 + ], + "unique_experts": 63, + "load_cv": 0.5994920527233756, + "normalized_load_entropy": 0.9538407553878274, + "max_load_share": 0.04742547425474255 + }, + "full_input": { + "tokens": 271, + "top_k": 6, + "decisions": 1626, + "ordered_route_sha256": "98aad6a18b6592a1a27907c9ffccb09f27ca5f515df56d29cdf356bab8ba9c04", + "route_weight_sha256": "b90ebafab813c86a8e37bf405c21f166dc83c8585a800109d7f74f4f4d7b5938", + "loads": [ + 32, + 53, + 10, + 33, + 38, + 23, + 14, + 25, + 34, + 16, + 18, + 31, + 21, + 29, + 30, + 31, + 33, + 34, + 16, + 19, + 14, + 30, + 33, + 26, + 18, + 26, + 29, + 22, + 12, + 23, + 7, + 41, + 72, + 53, + 29, + 19, + 28, + 3, + 6, + 17, + 58, + 31, + 23, + 31, + 49, + 19, + 29, + 21, + 12, + 39, + 38, + 16, + 30, + 3, + 11, + 6, + 19, + 24, + 17, + 32, + 41, + 16, + 13, + 0 + ], + "weighted_loads": [ + 2.117770928889513, + 2.336393738165498, + 0.6996179595589638, + 1.6049973592162132, + 2.89668077416718, + 1.048897661268711, + 0.8740701340138912, + 1.5459628719836473, + 2.2190177775919437, + 0.5957356262952089, + 0.8968119230121374, + 1.5076652774587274, + 1.1963044945150614, + 1.8590187206864357, + 1.5612337794154882, + 1.296913081780076, + 1.6328623294830322, + 1.6013480527326465, + 1.386777639389038, + 1.097005708143115, + 0.6313688680529594, + 2.120825245976448, + 1.6627869103103876, + 1.5170338675379753, + 0.6470631174743176, + 1.434150766581297, + 1.0687092766165733, + 1.4097375571727753, + 0.6619925741106272, + 1.0542606003582478, + 0.3554136138409376, + 3.1303224191069603, + 4.834332289174199, + 3.2960518449544907, + 1.7554350197315216, + 1.355492990463972, + 1.302456732839346, + 0.10695371776819229, + 0.24248158186674118, + 0.6827500052750111, + 5.397619981318712, + 1.57356446236372, + 1.3323844149708748, + 2.7760301120579243, + 4.0753320548683405, + 0.919526856392622, + 2.027424916625023, + 1.3361576087772846, + 0.5208347123116255, + 3.2868470549583435, + 1.8899256028234959, + 1.5319055262953043, + 1.6236618235707283, + 0.1106150709092617, + 0.5451123602688313, + 0.2696658782660961, + 1.2296621948480606, + 1.0618923995643854, + 0.6662033498287201, + 2.1945200879126787, + 1.6717196945101023, + 0.7717372048646212, + 0.7695849388837814, + 0.0 + ], + "unique_experts": 63, + "load_cv": 0.5334440116092918, + "normalized_load_entropy": 0.9644660992452724, + "max_load_share": 0.04428044280442804 + } + }, + "s1_bos": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "8a9772bc02c613a15e804e818159b00a92d8df604bfca514b2b723f9e976e507", + "route_weight_sha256": "86de1773210d97bd1c737c4b64da13ee529753fe4d2eb3d17c3a47ad753be2f6", + "loads": [ + 32, + 49, + 9, + 29, + 31, + 24, + 14, + 25, + 30, + 12, + 15, + 31, + 22, + 29, + 30, + 23, + 24, + 32, + 3, + 20, + 16, + 30, + 31, + 20, + 15, + 26, + 31, + 20, + 7, + 25, + 2, + 32, + 71, + 55, + 25, + 15, + 28, + 3, + 5, + 17, + 53, + 36, + 24, + 9, + 44, + 18, + 29, + 15, + 11, + 37, + 38, + 16, + 30, + 3, + 6, + 3, + 20, + 24, + 15, + 31, + 42, + 11, + 3, + 0 + ], + "weighted_loads": [ + 2.1211527213454247, + 2.1590742617845535, + 0.6222560405731201, + 1.4300782904028893, + 2.585302710533142, + 1.0668113604187965, + 0.8812983892858028, + 1.5399722997099161, + 1.943256139755249, + 0.47097907960414886, + 0.793868163600564, + 1.5254788361489773, + 1.2403608188033104, + 1.853677786886692, + 1.5742051228880882, + 0.9870323538780212, + 0.8951461557298899, + 1.5259253401309252, + 0.13854287937283516, + 1.1126993093639612, + 0.6855521630495787, + 2.0632967688143253, + 1.5861545018851757, + 1.240237768739462, + 0.5308208782225847, + 1.4219245612621307, + 1.1659976560622454, + 1.3376488089561462, + 0.2763844970613718, + 1.1394314393401146, + 0.07949374616146088, + 2.722252633422613, + 4.850106555968523, + 3.33804171718657, + 1.6821333188563585, + 1.0639654994010925, + 1.288265148177743, + 0.10812775790691376, + 0.21613254770636559, + 0.6778012234717607, + 4.96002016030252, + 1.8110398277640343, + 1.3684680350124836, + 0.42480816692113876, + 3.915674701333046, + 0.8918294440954924, + 2.027538776397705, + 0.8228536397218704, + 0.4976743049919605, + 3.180003372952342, + 1.8961722515523434, + 1.552178654819727, + 1.6348015703260899, + 0.114004697650671, + 0.26475347205996513, + 0.15596949309110641, + 1.2394740097224712, + 1.0917937494814396, + 0.566556328907609, + 2.198018254712224, + 1.6991180162876844, + 0.5395645052194595, + 0.17580002546310425, + 0.0 + ], + "unique_experts": 63, + "load_cv": 0.6047612343614942, + "normalized_load_entropy": 0.9530412610161307, + "max_load_share": 0.048102981029810296 + }, + "full_input": { + "tokens": 287, + "top_k": 6, + "decisions": 1722, + "ordered_route_sha256": "52cbea41ceffb36f6e05bb9ab73ee4c25d93d1c0a2f4b6902c7c590519f4e8ed", + "route_weight_sha256": "0d934092c43dd72f104b08fe4004a9daae89511f2aceceaaffb0d220b61bd63d", + "loads": [ + 34, + 50, + 10, + 29, + 41, + 27, + 14, + 27, + 40, + 13, + 18, + 33, + 22, + 29, + 30, + 26, + 43, + 33, + 13, + 21, + 17, + 31, + 33, + 24, + 15, + 26, + 33, + 22, + 17, + 25, + 11, + 39, + 72, + 55, + 30, + 21, + 28, + 3, + 5, + 18, + 60, + 36, + 24, + 37, + 46, + 18, + 30, + 30, + 11, + 40, + 38, + 16, + 30, + 8, + 26, + 12, + 26, + 25, + 17, + 34, + 43, + 21, + 15, + 1 + ], + "weighted_loads": [ + 2.268915183842182, + 2.191640131175518, + 0.6703981086611748, + 1.4300782904028893, + 3.124540690332651, + 1.1684822048991919, + 0.8812983892858028, + 1.6690907943993807, + 2.567112222313881, + 0.5048960149288177, + 0.9019130803644657, + 1.5672151921316981, + 1.2403608188033104, + 1.853677786886692, + 1.5742051228880882, + 1.0911141112446785, + 2.641647594049573, + 1.5407454678788781, + 1.3138728365302086, + 1.151614336296916, + 0.75889134965837, + 2.1339363791048527, + 1.6959990337491035, + 1.423333827406168, + 0.5308208782225847, + 1.4219245612621307, + 1.2415011879056692, + 1.3881967775523663, + 0.9926121961325407, + 1.1394314393401146, + 0.5392281878739595, + 3.0300542041659355, + 4.883811712265015, + 3.33804171718657, + 1.91043384000659, + 1.5686878897249699, + 1.288265148177743, + 0.10812775790691376, + 0.21613254770636559, + 0.7250074055045843, + 5.368056004866958, + 1.8110398277640343, + 1.3684680350124836, + 3.3607658594846725, + 4.045376770198345, + 0.8918294440954924, + 2.0740142092108727, + 1.8955737203359604, + 0.4976743049919605, + 3.4036255683749914, + 1.8961722515523434, + 1.552178654819727, + 1.6348015703260899, + 0.4182574637234211, + 1.5013368111103773, + 0.562651738524437, + 1.7082274928689003, + 1.1362434588372707, + 0.6698852647095919, + 2.323643120005727, + 1.7360974680632353, + 0.9798297118395567, + 0.793366402387619, + 0.03997061401605606 + ], + "unique_experts": 64, + "load_cv": 0.49636725101093865, + "normalized_load_entropy": 0.9694361041907952, + "max_load_share": 0.041811846689895474 + } + }, + "s0_x": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "1fe6e8c1556b96e8a78acd75e329c8929ff456a7b20d5d68a6de53aaed09c05e", + "route_weight_sha256": "3502a860a4df1508c18428b89e6443aca0273f95cd6be31da4197b3440a8c830", + "loads": [ + 32, + 51, + 11, + 32, + 32, + 24, + 14, + 27, + 30, + 14, + 16, + 32, + 21, + 29, + 29, + 22, + 27, + 30, + 3, + 19, + 15, + 30, + 33, + 20, + 15, + 27, + 21, + 20, + 8, + 22, + 2, + 32, + 69, + 55, + 27, + 18, + 29, + 2, + 3, + 17, + 52, + 34, + 26, + 11, + 45, + 19, + 28, + 14, + 11, + 38, + 39, + 14, + 32, + 4, + 6, + 2, + 19, + 21, + 16, + 31, + 38, + 9, + 7, + 0 + ], + "weighted_loads": [ + 2.1386668756604195, + 2.377888122573495, + 0.6999104954302311, + 1.5754026658833027, + 2.7276605032384396, + 1.1233554780483246, + 0.8834880702197552, + 1.6444386448711157, + 1.9960311390459538, + 0.5218267869204283, + 0.8400784023106098, + 1.5605770032852888, + 1.1781626641750336, + 1.8602963481098413, + 1.5213552173227072, + 0.9374956265091896, + 0.9713118840008974, + 1.4798251278698444, + 0.14676349982619286, + 1.0991856902837753, + 0.6549640689045191, + 2.104419067502022, + 1.6744748316705227, + 1.2139836344867945, + 0.5542693380266428, + 1.4704303853213787, + 0.7856804169714451, + 1.359060063958168, + 0.31928833946585655, + 1.0127534978091717, + 0.10710277780890465, + 2.6926796175539494, + 4.711468240246177, + 3.494029739871621, + 1.6964403688907623, + 1.2053137626498938, + 1.3397256657481194, + 0.0649230144917965, + 0.13354278728365898, + 0.7069673240184784, + 5.049762636423111, + 1.7096522897481918, + 1.4711659736931324, + 0.46497978642582893, + 3.8856635838747025, + 0.9323076717555523, + 1.9807356484234333, + 0.8254064582288265, + 0.5019720047712326, + 3.2170029915869236, + 1.967229887843132, + 1.489152504131198, + 1.7062944285571575, + 0.16297004371881485, + 0.2315930388867855, + 0.1039494164288044, + 1.2253167070448399, + 0.9304649475961924, + 0.585094764828682, + 2.1859259456396103, + 1.560212915763259, + 0.46092548966407776, + 0.3976597562432289, + 0.0 + ], + "unique_experts": 63, + "load_cv": 0.5982166145524314, + "normalized_load_entropy": 0.9538546318636455, + "max_load_share": 0.046747967479674794 + }, + "full_input": { + "tokens": 271, + "top_k": 6, + "decisions": 1626, + "ordered_route_sha256": "42a2e7253f65c686ae40c267bbe3e6637f94e02d61a72127bbff3719ef4d6f2f", + "route_weight_sha256": "15db39a0b58d72533a1216651dba6bf10390a77c5302b4462b27d6980d62d088", + "loads": [ + 32, + 51, + 12, + 32, + 37, + 24, + 14, + 27, + 34, + 15, + 18, + 34, + 21, + 29, + 29, + 28, + 33, + 32, + 15, + 19, + 15, + 30, + 33, + 25, + 15, + 27, + 21, + 21, + 15, + 22, + 8, + 42, + 71, + 55, + 32, + 21, + 29, + 2, + 3, + 17, + 58, + 34, + 26, + 33, + 48, + 19, + 28, + 22, + 11, + 42, + 39, + 14, + 32, + 5, + 10, + 5, + 19, + 21, + 20, + 32, + 38, + 14, + 16, + 0 + ], + "weighted_loads": [ + 2.1386668756604195, + 2.377888122573495, + 0.7587846890091896, + 1.5754026658833027, + 2.951864482834935, + 1.1233554780483246, + 0.8834880702197552, + 1.6444386448711157, + 2.2638736069202423, + 0.5528266113251448, + 0.906720845028758, + 1.6024249391630292, + 1.1781626641750336, + 1.8602963481098413, + 1.5213552173227072, + 1.1691011618822813, + 1.55692476965487, + 1.530509422533214, + 1.417586773633957, + 1.0991856902837753, + 0.6549640689045191, + 2.104419067502022, + 1.6744748316705227, + 1.4684974942356348, + 0.5542693380266428, + 1.4704303853213787, + 0.7856804169714451, + 1.371606681495905, + 0.7976049855351448, + 1.0127534978091717, + 0.4037976283580065, + 3.210869114845991, + 4.77630321867764, + 3.494029739871621, + 1.9690463058650494, + 1.4491294529289007, + 1.3397256657481194, + 0.0649230144917965, + 0.13354278728365898, + 0.7069673240184784, + 5.356655579060316, + 1.7096522897481918, + 1.4711659736931324, + 2.541775308549404, + 4.04730112478137, + 0.9323076717555523, + 1.9807356484234333, + 1.412130031734705, + 0.5019720047712326, + 3.402666211128235, + 1.967229887843132, + 1.489152504131198, + 1.7062944285571575, + 0.2173709012567997, + 0.49115915410220623, + 0.22215105965733528, + 1.2253167070448399, + 0.9304649475961924, + 0.7826999872922897, + 2.2185538709163666, + 1.560212915763259, + 0.6921652983874083, + 0.9120247066020966, + 0.0 + ], + "unique_experts": 63, + "load_cv": 0.5349394057972748, + "normalized_load_entropy": 0.9638702982202858, + "max_load_share": 0.04366543665436654 + } + }, + "s1_x": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "18d72fb259856599ed4b0d9c4ad88e6ed806add6c9a6ab00ba3f9881deb8e127", + "route_weight_sha256": "81e0f7da34c4c851f29fe7c1a58716ef30e580ec5ca2418480f1f3fc8ed00470", + "loads": [ + 32, + 49, + 12, + 31, + 34, + 25, + 14, + 26, + 31, + 15, + 17, + 31, + 20, + 29, + 30, + 19, + 18, + 30, + 3, + 21, + 15, + 29, + 31, + 19, + 15, + 26, + 33, + 19, + 9, + 25, + 2, + 31, + 69, + 51, + 25, + 18, + 28, + 6, + 4, + 18, + 50, + 36, + 25, + 10, + 45, + 18, + 28, + 16, + 11, + 36, + 39, + 16, + 31, + 4, + 7, + 3, + 20, + 23, + 15, + 30, + 40, + 9, + 4, + 0 + ], + "weighted_loads": [ + 2.143569491803646, + 2.2118147537112236, + 0.7392911054193974, + 1.5091264620423317, + 2.717450950294733, + 1.1339863240718842, + 0.8911436051130295, + 1.6183317434042692, + 2.043803784996271, + 0.5726518630981445, + 0.8603511769324541, + 1.5136319901794195, + 1.1992798149585724, + 1.8582243751734495, + 1.5605920776724815, + 0.8186160326004028, + 0.6531709395349026, + 1.4385408107191324, + 0.16329548135399818, + 1.1584151070564985, + 0.6335156206041574, + 2.0289562679827213, + 1.575174793601036, + 1.1951323747634888, + 0.5366951413452625, + 1.4209413826465607, + 1.2373788394033909, + 1.3236804828047752, + 0.3493048492819071, + 1.1392944119870663, + 0.11744877696037292, + 2.585738342255354, + 4.82685567997396, + 3.218812992796302, + 1.6231946963816881, + 1.2623942829668522, + 1.3142446465790272, + 0.221809733659029, + 0.17196238785982132, + 0.72895098477602, + 4.859617521986365, + 1.8140097241848707, + 1.4073330201208591, + 0.4388887584209442, + 3.954641191288829, + 0.9043113123625517, + 2.004992600530386, + 0.9112343098968267, + 0.4960035942494869, + 3.1525876447558403, + 1.9590839520096779, + 1.5837917998433113, + 1.6708869636058807, + 0.1657797060906887, + 0.27848414704203606, + 0.1610768474638462, + 1.2178593892604113, + 1.058209601789713, + 0.5682943593710661, + 2.140566349029541, + 1.6406991370022297, + 0.465257178992033, + 0.23421823233366013, + 0.0 + ], + "unique_experts": 63, + "load_cv": 0.5818864271508856, + "normalized_load_entropy": 0.9565280490722446, + "max_load_share": 0.046747967479674794 + }, + "full_input": { + "tokens": 287, + "top_k": 6, + "decisions": 1722, + "ordered_route_sha256": "ca3cb648f622f19c2305dcf408c1179760ae509ba2848759f4e2c58cb09e6c69", + "route_weight_sha256": "651fca417eefa43d23ab64d062ab37e543ec4a277a56e285f31aaefbf0e75cb5", + "loads": [ + 34, + 50, + 13, + 31, + 45, + 28, + 14, + 28, + 41, + 15, + 20, + 33, + 20, + 29, + 30, + 21, + 36, + 31, + 14, + 22, + 16, + 30, + 33, + 23, + 15, + 26, + 35, + 22, + 20, + 25, + 11, + 39, + 70, + 51, + 31, + 24, + 28, + 6, + 4, + 19, + 54, + 36, + 25, + 37, + 47, + 18, + 29, + 30, + 11, + 40, + 39, + 16, + 31, + 10, + 28, + 13, + 26, + 24, + 18, + 33, + 41, + 17, + 15, + 1 + ], + "weighted_loads": [ + 2.2913319543004036, + 2.244380623102188, + 0.787433173507452, + 1.5091264620423317, + 3.292100168764591, + 1.2356571685522795, + 0.8911436051130295, + 1.7474502380937338, + 2.681910440325737, + 0.5726518630981445, + 0.9683960936963558, + 1.5553683461621404, + 1.1992798149585724, + 1.8582243751734495, + 1.5605920776724815, + 0.8912005126476288, + 2.291389785706997, + 1.4533609384670854, + 1.4168644919991493, + 1.1973301339894533, + 0.7068548072129488, + 2.0995958782732487, + 1.685019325464964, + 1.3782284334301949, + 0.5366951413452625, + 1.4209413826465607, + 1.3128823712468147, + 1.4163582995533943, + 1.1550031956285238, + 1.1392944119870663, + 0.5771832186728716, + 2.9427069313824177, + 4.8605608362704515, + 3.218812992796302, + 1.9208157509565353, + 1.7531637214124203, + 1.3142446465790272, + 0.221809733659029, + 0.17196238785982132, + 0.7761571668088436, + 5.056778343394399, + 1.8140097241848707, + 1.4073330201208591, + 2.8429152630269527, + 4.084343260154128, + 0.9043113123625517, + 2.0514680333435535, + 1.9251979943364859, + 0.4960035942494869, + 3.424830198287964, + 1.9590839520096779, + 1.5837917998433113, + 1.6708869636058807, + 0.521290946751833, + 1.544465497136116, + 0.6197796352207661, + 1.6866128724068403, + 1.102659311145544, + 0.7196439299732447, + 2.266191214323044, + 1.6776785887777805, + 0.8218492772430182, + 0.8198956213891506, + 0.03997061401605606 + ], + "unique_experts": 64, + "load_cv": 0.47138878205348117, + "normalized_load_entropy": 0.9723218134727141, + "max_load_share": 0.04065040650406504 + } + }, + "s0_period": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "042856d4c44a40689de5e7ba2e93da61fed6d52d945fd9bacc26ba86a7129e09", + "route_weight_sha256": "272db651ec20dc588265a9403b775a2a629c010cc94dbb7e0ad0296402b0ae59", + "loads": [ + 32, + 51, + 12, + 32, + 34, + 24, + 14, + 25, + 30, + 14, + 17, + 32, + 25, + 29, + 29, + 22, + 26, + 32, + 3, + 20, + 15, + 30, + 32, + 19, + 14, + 25, + 21, + 19, + 8, + 21, + 2, + 32, + 70, + 55, + 27, + 15, + 30, + 2, + 3, + 17, + 50, + 34, + 25, + 10, + 45, + 19, + 28, + 13, + 12, + 38, + 39, + 15, + 32, + 4, + 6, + 3, + 19, + 22, + 16, + 32, + 38, + 10, + 6, + 0 + ], + "weighted_loads": [ + 2.132759802043438, + 2.3591887075453997, + 0.7461205441504717, + 1.5689473636448383, + 2.817198321223259, + 1.1207863502204418, + 0.8896589688956738, + 1.5928006768226624, + 1.9904865827411413, + 0.5179612208157778, + 0.8758291341364384, + 1.580939657986164, + 1.317792821675539, + 1.8698596972972155, + 1.5159536115825176, + 0.9253668673336506, + 0.9542084559798241, + 1.5651701353490353, + 0.15597734600305557, + 1.1354367546737194, + 0.6645067129284143, + 2.1156493797898293, + 1.656155513599515, + 1.183961994946003, + 0.5185554642230272, + 1.4156144689768553, + 0.7975329849869013, + 1.329809796065092, + 0.31602591648697853, + 0.9811980426311493, + 0.11428824812173843, + 2.7105470187962055, + 4.820615962147713, + 3.494116874411702, + 1.7103561460971832, + 1.1338646970689297, + 1.3912438116967678, + 0.0646016038954258, + 0.13326751068234444, + 0.7143205367028713, + 4.984403625130653, + 1.7062469366937876, + 1.429342970252037, + 0.4326055385172367, + 3.8947585448622704, + 0.9353969283401966, + 1.9826446659862995, + 0.7921686805784702, + 0.5259930640459061, + 3.2228043228387833, + 1.9865410514175892, + 1.530763640999794, + 1.7167111597955227, + 0.16441941633820534, + 0.22873593121767044, + 0.1414896547794342, + 1.2306376211345196, + 0.982177771627903, + 0.5755227040499449, + 2.234105132520199, + 1.5262266751378775, + 0.48983967304229736, + 0.33126454427838326, + 0.0 + ], + "unique_experts": 63, + "load_cv": 0.5988056158950547, + "normalized_load_entropy": 0.9539803673589049, + "max_load_share": 0.04742547425474255 + }, + "full_input": { + "tokens": 271, + "top_k": 6, + "decisions": 1626, + "ordered_route_sha256": "dfcefabb301e60e74fe169dcfac847f30e0864e26dbee2b53ed1f46c671ed481", + "route_weight_sha256": "c0f97c1f444af65d25cc51fe9a58634eeb5c8dc72578cbfa2281d136e9f09b6a", + "loads": [ + 32, + 51, + 13, + 32, + 42, + 24, + 14, + 25, + 34, + 15, + 19, + 34, + 25, + 29, + 29, + 29, + 31, + 33, + 15, + 20, + 15, + 30, + 32, + 24, + 14, + 25, + 21, + 20, + 16, + 21, + 8, + 42, + 72, + 55, + 31, + 19, + 30, + 2, + 3, + 17, + 56, + 34, + 25, + 33, + 48, + 19, + 28, + 21, + 12, + 41, + 39, + 15, + 32, + 4, + 10, + 7, + 19, + 22, + 19, + 33, + 38, + 15, + 13, + 0 + ], + "weighted_loads": [ + 2.132759802043438, + 2.3591887075453997, + 0.8049947377294302, + 1.5689473636448383, + 3.1918475162237883, + 1.1207863502204418, + 0.8896589688956738, + 1.5928006768226624, + 2.2514526788145304, + 0.5489610452204943, + 0.9424715768545866, + 1.6227875938639045, + 1.317792821675539, + 1.8698596972972155, + 1.5159536115825176, + 1.1980907414108515, + 1.4986374750733376, + 1.5799902630969882, + 1.3776909932494164, + 1.1354367546737194, + 0.6645067129284143, + 2.1156493797898293, + 1.656155513599515, + 1.4384758546948433, + 0.5185554642230272, + 1.4156144689768553, + 0.7975329849869013, + 1.342356413602829, + 0.8397102914750576, + 0.9811980426311493, + 0.41098309867084026, + 3.2281993478536606, + 4.885450940579176, + 3.494116874411702, + 1.9059712067246437, + 1.5222498551011086, + 1.3912438116967678, + 0.0646016038954258, + 0.13326751068234444, + 0.7143205367028713, + 5.293371923267841, + 1.7062469366937876, + 1.429342970252037, + 2.594780307263136, + 4.056396085768938, + 0.9353969283401966, + 1.9826446659862995, + 1.3701161071658134, + 0.5259930640459061, + 3.36843691021204, + 1.9865410514175892, + 1.530763640999794, + 1.7167111597955227, + 0.16441941633820534, + 0.4906389210373163, + 0.30462105199694633, + 1.2306376211345196, + 0.982177771627903, + 0.7126719634979963, + 2.2649246249347925, + 1.5262266751378775, + 0.7222848664969206, + 0.7835846766829491, + 0.0 + ], + "unique_experts": 63, + "load_cv": 0.5349846555210831, + "normalized_load_entropy": 0.9640159985653298, + "max_load_share": 0.04428044280442804 + } + }, + "s1_period": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "4a10526e42233d7a5b71f60909dbdcbcc82a8dfbf8a8f334561e5337a1149216", + "route_weight_sha256": "8ff84b327828806016eb2dc3714f94e9156985c583f7b3b857c5032995524677", + "loads": [ + 32, + 49, + 10, + 31, + 34, + 26, + 14, + 27, + 30, + 15, + 16, + 32, + 19, + 29, + 30, + 23, + 15, + 31, + 3, + 21, + 15, + 31, + 31, + 19, + 17, + 24, + 32, + 20, + 9, + 24, + 2, + 32, + 70, + 52, + 25, + 16, + 29, + 5, + 5, + 18, + 51, + 34, + 25, + 9, + 45, + 18, + 29, + 15, + 11, + 38, + 39, + 15, + 32, + 4, + 8, + 3, + 20, + 21, + 15, + 30, + 40, + 8, + 3, + 0 + ], + "weighted_loads": [ + 2.1509741097688675, + 2.2092451825737953, + 0.6638128161430359, + 1.4969636239111423, + 2.7194401137530804, + 1.1708180010318756, + 0.8913815096020699, + 1.6453517116606236, + 1.9970264863222837, + 0.5721610728651285, + 0.8270154353231192, + 1.5657115243375301, + 1.1449816301465034, + 1.8635070752352476, + 1.547501977533102, + 0.9590711072087288, + 0.5431877914816141, + 1.458784369751811, + 0.16759590432047844, + 1.146182093769312, + 0.6314930561929941, + 2.104862429201603, + 1.5776176732033491, + 1.1893875002861023, + 0.6054880358278751, + 1.3410046584904194, + 1.2055481858551502, + 1.3477325402200222, + 0.3451582957059145, + 1.1036365330219269, + 0.10720628499984741, + 2.644212331622839, + 4.825339475646615, + 3.2194968797266483, + 1.6365642957389355, + 1.2202461957931519, + 1.3360255360603333, + 0.1846127063035965, + 0.2096870020031929, + 0.722771693021059, + 4.920788925141096, + 1.7469652984291315, + 1.4021084383130074, + 0.39588438346982, + 3.9867012556642294, + 0.8943132013082504, + 2.026694394648075, + 0.879704074934125, + 0.49528103694319725, + 3.212577072903514, + 1.9590999260544777, + 1.5446661375463009, + 1.712095007300377, + 0.16519420221447945, + 0.3159504719078541, + 0.16219466924667358, + 1.2250209972262383, + 0.9937769081443548, + 0.5555452909320593, + 2.143209081143141, + 1.6207419037818909, + 0.4354107715189457, + 0.19971610233187675, + 0.0 + ], + "unique_experts": 63, + "load_cv": 0.5936815242365208, + "normalized_load_entropy": 0.9548948966412635, + "max_load_share": 0.04742547425474255 + }, + "full_input": { + "tokens": 287, + "top_k": 6, + "decisions": 1722, + "ordered_route_sha256": "b6f1b2134f0694c1fdd206350e0cced7cf362ede3fb7d085bf45bd7339d97250", + "route_weight_sha256": "d2cc6ffd109850c86739ea95bbc6fd7b23efa4cb99a0db26423b4d35296ba68f", + "loads": [ + 34, + 50, + 11, + 31, + 46, + 30, + 14, + 29, + 40, + 15, + 19, + 34, + 19, + 29, + 31, + 26, + 32, + 32, + 13, + 22, + 16, + 32, + 33, + 23, + 17, + 24, + 34, + 22, + 21, + 24, + 11, + 39, + 71, + 52, + 31, + 23, + 29, + 5, + 5, + 19, + 56, + 34, + 25, + 36, + 47, + 18, + 30, + 29, + 11, + 42, + 39, + 16, + 32, + 9, + 28, + 13, + 26, + 22, + 17, + 33, + 41, + 16, + 13, + 1 + ], + "weighted_loads": [ + 2.298736572265625, + 2.24181105196476, + 0.7119548842310905, + 1.4969636239111423, + 3.362966150045395, + 1.3159881252795458, + 0.8913815096020699, + 1.7744702063500881, + 2.6270050425082445, + 0.5721610728651285, + 0.9350603520870209, + 1.607447880320251, + 1.1449816301465034, + 1.8635070752352476, + 1.5873966589570045, + 1.0641223154962063, + 2.156993141397834, + 1.473604497499764, + 1.3429258614778519, + 1.1850971207022667, + 0.7048322428017855, + 2.1755020394921303, + 1.687462205067277, + 1.3724835589528084, + 0.6054880358278751, + 1.3410046584904194, + 1.281051717698574, + 1.3982805088162422, + 1.2313171196728945, + 1.1036365330219269, + 0.5669407267123461, + 2.9520139023661613, + 4.859044631943107, + 3.2194968797266483, + 1.9183399621397257, + 1.8052837625145912, + 1.3360255360603333, + 0.1846127063035965, + 0.2096870020031929, + 0.7699778750538826, + 5.139280954375863, + 1.7469652984291315, + 1.4021084383130074, + 2.8171726167201996, + 4.116403324529529, + 0.8943132013082504, + 2.0731698274612427, + 1.9020832907408476, + 0.49528103694319725, + 3.4775255229324102, + 1.9590999260544777, + 1.5841195993125439, + 1.712095007300377, + 0.46944696828722954, + 1.5337140243500471, + 0.6160925813019276, + 1.6937744803726673, + 1.038226617500186, + 0.6588742267340422, + 2.2688339464366436, + 1.6577213555574417, + 0.7963332552462816, + 0.7256010174751282, + 0.03997061401605606 + ], + "unique_experts": 64, + "load_cv": 0.48149085481679993, + "normalized_load_entropy": 0.9712178506657952, + "max_load_share": 0.04123112659698026 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 246, + "ordered_topk_exact_tokens": 169, + "set_exact_tokens": 198, + "mean_set_jaccard": 0.9425087108013936, + "mean_token_weighted_tv": 0.011369524357037815, + "aggregate_load_tv": 0.017615176151761513 + }, + "system_bos": { + "tokens": 246, + "ordered_topk_exact_tokens": 164, + "set_exact_tokens": 190, + "mean_set_jaccard": 0.9332171893147504, + "mean_token_weighted_tv": 0.014133569568668196, + "aggregate_load_tv": 0.021680216802168025 + }, + "system_x": { + "tokens": 246, + "ordered_topk_exact_tokens": 139, + "set_exact_tokens": 160, + "mean_set_jaccard": 0.8900503290747194, + "mean_token_weighted_tv": 0.021699955762644125, + "aggregate_load_tv": 0.03048780487804878 + }, + "system_period": { + "tokens": 246, + "ordered_topk_exact_tokens": 131, + "set_exact_tokens": 156, + "mean_set_jaccard": 0.8857336430507162, + "mean_token_weighted_tv": 0.022397517060058388, + "aggregate_load_tv": 0.029810298102981032 + }, + "bos_at_s0": { + "tokens": 246, + "ordered_topk_exact_tokens": 142, + "set_exact_tokens": 180, + "mean_set_jaccard": 0.9198606271777005, + "mean_token_weighted_tv": 0.0168712779016393, + "aggregate_load_tv": 0.025745257452574527 + }, + "bos_at_s1": { + "tokens": 246, + "ordered_topk_exact_tokens": 133, + "set_exact_tokens": 166, + "mean_set_jaccard": 0.9009872241579558, + "mean_token_weighted_tv": 0.019716952726759805, + "aggregate_load_tv": 0.03252032520325203 + }, + "x_at_s0": { + "tokens": 246, + "ordered_topk_exact_tokens": 133, + "set_exact_tokens": 169, + "mean_set_jaccard": 0.9027293844367016, + "mean_token_weighted_tv": 0.020727481253869164, + "aggregate_load_tv": 0.022357723577235773 + }, + "x_at_s1": { + "tokens": 246, + "ordered_topk_exact_tokens": 123, + "set_exact_tokens": 160, + "mean_set_jaccard": 0.8853869707528244, + "mean_token_weighted_tv": 0.024866353955150137, + "aggregate_load_tv": 0.034552845528455285 + }, + "period_at_s0": { + "tokens": 246, + "ordered_topk_exact_tokens": 132, + "set_exact_tokens": 173, + "mean_set_jaccard": 0.9093108788230739, + "mean_token_weighted_tv": 0.019711432024473098, + "aggregate_load_tv": 0.02303523035230353 + }, + "period_at_s1": { + "tokens": 246, + "ordered_topk_exact_tokens": 125, + "set_exact_tokens": 161, + "mean_set_jaccard": 0.8867419843029599, + "mean_token_weighted_tv": 0.024298206751605843, + "aggregate_load_tv": 0.03387533875338753 + } + } + }, + "layer_12": { + "layer": 12, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "9f6c107f1d519fea0a6d2c8d9bfdf37b74d5684b3128deca57c929ea77ce1c29", + "route_weight_sha256": "14e1c7b879d3da8d1d7cd175d30a665bd148744e2b8931e0372a36247f13cfc9", + "loads": [ + 19, + 31, + 35, + 21, + 27, + 19, + 20, + 26, + 21, + 19, + 2, + 24, + 17, + 74, + 59, + 6, + 42, + 9, + 19, + 70, + 35, + 11, + 30, + 30, + 6, + 15, + 15, + 3, + 14, + 13, + 0, + 43, + 10, + 27, + 13, + 20, + 22, + 31, + 19, + 21, + 42, + 7, + 12, + 39, + 0, + 4, + 13, + 23, + 28, + 36, + 24, + 39, + 42, + 17, + 35, + 12, + 36, + 33, + 0, + 18, + 6, + 30, + 22, + 20 + ], + "weighted_loads": [ + 0.8663415908813477, + 2.3628599643707275, + 2.1216262988746166, + 1.1222027260810137, + 1.594392366707325, + 1.037819042801857, + 0.8092558309435844, + 1.646223608404398, + 1.0464648008346558, + 0.8190818578004837, + 0.0783064104616642, + 1.2065234519541264, + 1.0777639597654343, + 3.9072243068367243, + 2.9528159983456135, + 0.25867682322859764, + 2.99765869602561, + 0.6418748684227467, + 1.0118840336799622, + 3.2312327306717634, + 2.57595107704401, + 0.6241066157817841, + 1.9741037264466286, + 2.2221294194459915, + 0.2801799401640892, + 0.6910515874624252, + 0.7457527201622725, + 0.14777323231101036, + 1.268116146326065, + 0.4840604029595852, + 0.0, + 3.5097750779241323, + 0.3546463493257761, + 2.613757275044918, + 0.6860852017998695, + 1.5971463546156883, + 1.3042657990008593, + 2.221834447234869, + 1.3620400466024876, + 1.3865251298993826, + 2.0475437734276056, + 0.25264387391507626, + 0.4713764823973179, + 3.193486973643303, + 0.0, + 0.22223954275250435, + 0.8924720268696547, + 0.9029121622443199, + 1.4326332658529282, + 1.9313790798187256, + 1.8624511267989874, + 2.390732502564788, + 2.7607410103082657, + 1.1967784091830254, + 2.6380245611071587, + 0.5451565310359001, + 2.014468491077423, + 2.1337179858237505, + 0.0, + 0.945325180888176, + 0.28118366561830044, + 2.688012668862939, + 1.6038114354014397, + 1.218750186264515 + ], + "unique_experts": 61, + "load_cv": 0.6572304622386387, + "normalized_load_entropy": 0.9465577888667128, + "max_load_share": 0.05013550135501355 + }, + "full_input": { + "tokens": 271, + "top_k": 6, + "decisions": 1626, + "ordered_route_sha256": "2a124650f124c070394cb7837208f77d3c78321941f548a86bdb1862b425027a", + "route_weight_sha256": "e9e3092e01471a559bf03df9be9c4914a4c60e83fe6ade1922e1856843f9e827", + "loads": [ + 19, + 31, + 35, + 27, + 30, + 20, + 20, + 29, + 27, + 19, + 2, + 24, + 22, + 74, + 59, + 6, + 43, + 9, + 19, + 70, + 36, + 11, + 31, + 35, + 6, + 15, + 16, + 10, + 29, + 24, + 3, + 48, + 11, + 29, + 13, + 27, + 22, + 35, + 34, + 21, + 42, + 14, + 18, + 39, + 2, + 5, + 14, + 28, + 32, + 36, + 25, + 39, + 42, + 17, + 35, + 12, + 39, + 33, + 0, + 22, + 6, + 34, + 27, + 24 + ], + "weighted_loads": [ + 0.8663415908813477, + 2.3628599643707275, + 2.1216262988746166, + 1.2774372783023864, + 3.1824025698006153, + 1.04183588642627, + 0.8092558309435844, + 1.850105568766594, + 1.4765736311674118, + 0.8190818578004837, + 0.0783064104616642, + 1.2065234519541264, + 1.337143674492836, + 3.9072243068367243, + 2.9528159983456135, + 0.25867682322859764, + 3.0558608956635, + 0.6418748684227467, + 1.0118840336799622, + 3.2312327306717634, + 2.5782505366951227, + 0.6241066157817841, + 2.0240305699408054, + 2.677288956940174, + 0.2801799401640892, + 0.6910515874624252, + 0.7785836104303598, + 0.5501678343862295, + 3.1652959249913692, + 1.914937824010849, + 0.10643779393285513, + 3.7996208127588034, + 0.4009996745735407, + 2.70206993073225, + 0.6860852017998695, + 2.1001843735575676, + 1.3042657990008593, + 2.336062476038933, + 2.5945778749883175, + 1.3865251298993826, + 2.0475437734276056, + 0.8959007766097784, + 0.8544953428208828, + 3.193486973643303, + 0.1105625219643116, + 0.2617247588932514, + 0.952637666836381, + 1.1976207718253136, + 1.6697582937777042, + 1.9313790798187256, + 1.875420942902565, + 2.390732502564788, + 2.7607410103082657, + 1.1967784091830254, + 2.6380245611071587, + 0.5451565310359001, + 2.1203739205375314, + 2.1337179858237505, + 0.0, + 1.0823327414691448, + 0.28118366561830044, + 2.844068920239806, + 1.7971466090530157, + 1.3464249577373266 + ], + "unique_experts": 63, + "load_cv": 0.5873936585388871, + "normalized_load_entropy": 0.9564409746556849, + "max_load_share": 0.04551045510455105 + } + }, + "s1_eos": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "815b84ebce804d75b0e42f765077dc8bfc9635b0bfd679ff71cb1c0ae50976da", + "route_weight_sha256": "ff8b693cad956be6934bdfdb0f69b87fb4d79d6b192f214eb415315c5ffcdf3e", + "loads": [ + 18, + 31, + 36, + 20, + 29, + 22, + 16, + 26, + 21, + 18, + 2, + 25, + 17, + 72, + 58, + 6, + 43, + 9, + 20, + 64, + 34, + 11, + 29, + 27, + 6, + 15, + 16, + 4, + 15, + 13, + 2, + 43, + 10, + 26, + 13, + 19, + 21, + 31, + 20, + 21, + 44, + 6, + 14, + 39, + 0, + 3, + 15, + 23, + 27, + 37, + 23, + 36, + 42, + 17, + 35, + 13, + 37, + 36, + 0, + 21, + 6, + 31, + 22, + 20 + ], + "weighted_loads": [ + 0.8314630314707756, + 2.3756163716316223, + 2.1352810505777597, + 1.0738460086286068, + 1.7058118768036366, + 1.1650720443576574, + 0.6551585625857115, + 1.644505999982357, + 1.053790919482708, + 0.7833337485790253, + 0.08033044263720512, + 1.2309595122933388, + 1.130829242989421, + 3.867006501182914, + 2.8817167971283197, + 0.2668217793107033, + 2.96597408503294, + 0.6348095424473286, + 1.0336749963462353, + 2.9087941329926252, + 2.5407693162560463, + 0.6311618834733963, + 1.949862826615572, + 2.1200274974107742, + 0.27486682683229446, + 0.688058003783226, + 0.7841358836740255, + 0.18321016989648342, + 1.3152287788689137, + 0.48576144874095917, + 0.06253610737621784, + 3.4955306816846132, + 0.36530231684446335, + 2.5370807722210884, + 0.6741937696933746, + 1.548611294478178, + 1.255025703459978, + 2.242397265508771, + 1.414041180163622, + 1.3778352551162243, + 2.16249992325902, + 0.22562923654913902, + 0.5528182722628117, + 3.214459165930748, + 0.0, + 0.16922177001833916, + 0.9944381918758154, + 0.905270928516984, + 1.3681972827762365, + 1.9941526893526316, + 1.8275352008640766, + 2.2814840245991945, + 2.7468034364283085, + 1.1769213937222958, + 2.6574003119021654, + 0.5882786102592945, + 2.040979402139783, + 2.2438889034092426, + 0.0, + 1.052024794742465, + 0.2766380738466978, + 2.730701645836234, + 1.6248320937156677, + 1.224302425980568 + ], + "unique_experts": 62, + "load_cv": 0.6384573085288737, + "normalized_load_entropy": 0.9491987800128021, + "max_load_share": 0.04878048780487805 + }, + "full_input": { + "tokens": 287, + "top_k": 6, + "decisions": 1722, + "ordered_route_sha256": "4b3544553c2beaf6f87c7761f5711c376090db8ef9a73c2ae12dfd682103e42e", + "route_weight_sha256": "a16c34d1f35a22c9903149308c5b62191c3ceb4a1ff41ee671d5060eb892811f", + "loads": [ + 21, + 31, + 36, + 23, + 33, + 23, + 16, + 33, + 28, + 21, + 3, + 26, + 21, + 72, + 58, + 6, + 47, + 11, + 21, + 64, + 35, + 13, + 31, + 32, + 6, + 15, + 19, + 11, + 32, + 29, + 13, + 48, + 14, + 31, + 18, + 27, + 21, + 35, + 39, + 21, + 44, + 19, + 22, + 41, + 13, + 7, + 19, + 30, + 35, + 37, + 25, + 36, + 42, + 20, + 35, + 13, + 40, + 41, + 0, + 25, + 8, + 39, + 27, + 20 + ], + "weighted_loads": [ + 0.9961729850620031, + 2.3756163716316223, + 2.1352810505777597, + 1.1321021737530828, + 3.3319976665079594, + 1.1690160855650902, + 0.6551585625857115, + 2.038053274154663, + 1.5867914203554392, + 1.1020972058176994, + 0.12557659670710564, + 1.2576088849455118, + 1.3270031530410051, + 3.867006501182914, + 2.8817167971283197, + 0.2668217793107033, + 3.2176631316542625, + 0.7469490952789783, + 1.0688667744398117, + 2.9087941329926252, + 2.5431055955123156, + 0.7204686105251312, + 2.0381490290164948, + 2.5385863855481148, + 0.27486682683229446, + 0.688058003783226, + 0.908133240416646, + 0.5490461830049753, + 3.5322542637586594, + 2.7006493844091892, + 0.9198753880336881, + 3.7856020387262106, + 0.5428963340818882, + 2.831833817064762, + 0.9288189560174942, + 2.1586569398641586, + 1.255025703459978, + 2.4131824672222137, + 2.8786716870963573, + 1.3778352551162243, + 2.16249992325902, + 1.3744710497558117, + 1.0281953625380993, + 3.3241517543792725, + 1.225460957735777, + 0.47528112307190895, + 1.1699861977249384, + 1.3018637672066689, + 1.775806913152337, + 1.9941526893526316, + 1.8932925555855036, + 2.2814840245991945, + 2.7468034364283085, + 1.3332944810390472, + 2.6574003119021654, + 0.5882786102592945, + 2.1206362950615585, + 2.4686949737370014, + 0.0, + 1.1740009412169456, + 0.34750328212976456, + 3.1384121645241976, + 1.8524401187896729, + 1.224302425980568 + ], + "unique_experts": 63, + "load_cv": 0.5213081287568444, + "normalized_load_entropy": 0.9658162567356372, + "max_load_share": 0.041811846689895474 + } + }, + "s0_bos": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "a2cdf88302324f4cdbaf2ba6680e1837df8a4b8adb1c06450e4506c17a4c71e8", + "route_weight_sha256": "33bf635633b183e68ffda9a5b3adc89ae5eed91e90afaa3b705c79da6bd8fb75", + "loads": [ + 17, + 31, + 37, + 23, + 27, + 20, + 19, + 26, + 20, + 21, + 4, + 26, + 14, + 73, + 61, + 4, + 44, + 9, + 18, + 69, + 36, + 11, + 31, + 29, + 6, + 15, + 15, + 2, + 18, + 13, + 2, + 43, + 9, + 28, + 15, + 20, + 24, + 27, + 19, + 21, + 39, + 8, + 12, + 40, + 0, + 4, + 14, + 21, + 28, + 38, + 24, + 38, + 42, + 17, + 32, + 12, + 36, + 34, + 0, + 14, + 5, + 30, + 21, + 20 + ], + "weighted_loads": [ + 0.7988646999001503, + 2.356241326779127, + 2.182677738368511, + 1.20306115783751, + 1.5991472490131855, + 1.0710891224443913, + 0.758694389835, + 1.653820876032114, + 1.002748655155301, + 0.8906891010701656, + 0.1484423540532589, + 1.2657926455140114, + 0.9546011574566364, + 3.954773088917136, + 3.089157570153475, + 0.193700909614563, + 3.0013655088841915, + 0.6489486657083035, + 0.9600953720510006, + 3.295684428885579, + 2.5939583964645863, + 0.6142022386193275, + 2.051614247262478, + 2.0261696986854076, + 0.27764398232102394, + 0.7050581499934196, + 0.7139982059597969, + 0.11584475263953209, + 1.482050582766533, + 0.4953031577169895, + 0.09696962311863899, + 3.476263592019677, + 0.331282677128911, + 2.656778670847416, + 0.753913514316082, + 1.6988631952553988, + 1.3930538091808558, + 2.02000523917377, + 1.3475060276687145, + 1.3966162633150816, + 1.9750684574246407, + 0.2893419787287712, + 0.44790305756032467, + 3.3337620832026005, + 0.0, + 0.2173757366836071, + 0.9296284709125757, + 0.8501989729702473, + 1.4988755527883768, + 2.020295364782214, + 1.835825176909566, + 2.356756152585149, + 2.7685397639870644, + 1.1828291155397892, + 2.5698995031416416, + 0.5843832585960627, + 1.998766865581274, + 2.1621137000620365, + 0.0, + 0.8060329239815474, + 0.25060702860355377, + 2.677541086450219, + 1.5634179338812828, + 1.2477664537727833 + ], + "unique_experts": 62, + "load_cv": 0.6568727796870759, + "normalized_load_entropy": 0.9472133748272173, + "max_load_share": 0.0494579945799458 + }, + "full_input": { + "tokens": 271, + "top_k": 6, + "decisions": 1626, + "ordered_route_sha256": "913216862f44c63017a22783e0b2d95e27a37941458b3c77ad8c108b03698aec", + "route_weight_sha256": "51c850d0cb5521e7d8f3783c9a20b7c0be9b4e544e49eb158c959291dbd0579a", + "loads": [ + 18, + 31, + 37, + 28, + 29, + 20, + 19, + 29, + 26, + 21, + 4, + 26, + 20, + 73, + 61, + 4, + 47, + 9, + 18, + 69, + 36, + 11, + 32, + 35, + 6, + 15, + 17, + 9, + 34, + 24, + 4, + 49, + 10, + 30, + 15, + 27, + 24, + 31, + 34, + 21, + 39, + 15, + 17, + 40, + 2, + 5, + 15, + 25, + 33, + 38, + 25, + 38, + 42, + 17, + 32, + 12, + 38, + 34, + 0, + 18, + 5, + 34, + 25, + 24 + ], + "weighted_loads": [ + 0.8529785200953484, + 2.356241326779127, + 2.182677738368511, + 1.355222444050014, + 2.2363483905792236, + 1.0710891224443913, + 0.758694389835, + 1.864770945161581, + 1.4612814914435148, + 0.8906891010701656, + 0.1484423540532589, + 1.2657926455140114, + 1.3011407107114792, + 3.954773088917136, + 3.089157570153475, + 0.193700909614563, + 3.1085092648863792, + 0.6489486657083035, + 0.9600953720510006, + 3.295684428885579, + 2.5939583964645863, + 0.6142022386193275, + 2.1015410907566547, + 2.526801213622093, + 0.27764398232102394, + 0.7050581499934196, + 0.7901507839560509, + 0.5182393547147512, + 3.402347456663847, + 2.035822320729494, + 0.16078399028629065, + 3.819465747103095, + 0.3776360023766756, + 2.7506250143051147, + 0.753913514316082, + 2.201901214197278, + 1.3930538091808558, + 2.1342332679778337, + 2.6037196032702923, + 1.3966162633150816, + 1.9750684574246407, + 0.8834127336740494, + 0.8081417698413134, + 3.3337620832026005, + 0.11090393364429474, + 0.25686095282435417, + 0.9901497568935156, + 1.0715737827122211, + 1.7655102368444204, + 2.020295364782214, + 1.8487949930131435, + 2.356756152585149, + 2.7685397639870644, + 1.1828291155397892, + 2.5698995031416416, + 0.5843832585960627, + 2.100117888301611, + 2.1621137000620365, + 0.0, + 0.996240540407598, + 0.25060702860355377, + 2.8335973378270864, + 1.7086484897881746, + 1.375441225245595 + ], + "unique_experts": 63, + "load_cv": 0.5903533699464892, + "normalized_load_entropy": 0.95620882732392, + "max_load_share": 0.04489544895448955 + } + }, + "s1_bos": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "2b3bb60a6f208edc47c536f76355393217efe5e611a18fc5946ab750ef60c5ee", + "route_weight_sha256": "a55fdf45e50901649ef042f1a675cf1806c2dc0dc0b51b31db1cb4d2f1bc3b39", + "loads": [ + 14, + 30, + 33, + 24, + 32, + 22, + 18, + 26, + 22, + 20, + 4, + 26, + 18, + 73, + 57, + 5, + 45, + 11, + 21, + 68, + 34, + 11, + 30, + 25, + 6, + 14, + 17, + 3, + 17, + 13, + 1, + 42, + 8, + 26, + 13, + 19, + 24, + 28, + 19, + 19, + 45, + 5, + 11, + 40, + 0, + 4, + 12, + 23, + 28, + 36, + 24, + 39, + 43, + 16, + 34, + 12, + 38, + 35, + 0, + 19, + 5, + 30, + 19, + 20 + ], + "weighted_loads": [ + 0.6716651357710361, + 2.2749295942485332, + 2.05101266130805, + 1.2053650170564651, + 1.7724921759217978, + 1.1324256490916014, + 0.7320775836706161, + 1.641293939203024, + 1.0871615465730429, + 0.8402392715215683, + 0.15914988704025745, + 1.2728878669440746, + 1.1676030345261097, + 4.0032508708536625, + 2.8911619782447815, + 0.24680570140480995, + 3.0282313153147697, + 0.7185672745108604, + 1.0798015892505646, + 3.2571727447211742, + 2.479119338095188, + 0.6080436073243618, + 1.995623379945755, + 1.9458931908011436, + 0.2872273288667202, + 0.6671498902142048, + 0.8072923235595226, + 0.14667989872395992, + 1.38962846621871, + 0.4795897305011749, + 0.0520985908806324, + 3.368935203179717, + 0.30143249966204166, + 2.542570151388645, + 0.6821847632527351, + 1.6067395210266113, + 1.3986897245049477, + 2.0730625800788403, + 1.3735594674944878, + 1.3150681965053082, + 2.274500012397766, + 0.18694092333316803, + 0.42339906841516495, + 3.2847143970429897, + 0.0, + 0.2090398482978344, + 0.8859562873840332, + 0.9294069148600101, + 1.483699368312955, + 1.979679772630334, + 1.8659960180521011, + 2.3363654017448425, + 2.769507721066475, + 1.14785485714674, + 2.6672470699995756, + 0.5628454517573118, + 2.07777382992208, + 2.251557944342494, + 0.0, + 0.9806365948170424, + 0.24706994369626045, + 2.68409108184278, + 1.5163902156054974, + 1.2312564812600613 + ], + "unique_experts": 62, + "load_cv": 0.6550814374494828, + "normalized_load_entropy": 0.9469186136413288, + "max_load_share": 0.0494579945799458 + }, + "full_input": { + "tokens": 287, + "top_k": 6, + "decisions": 1722, + "ordered_route_sha256": "63cdd140833628b73a21e63a1437bd559445af606b6f9e37889dabd121b96062", + "route_weight_sha256": "5cf2ba3cdfb0f6d446e44d6c3ac914afccb999754e77b16c15346008b09dfc83", + "loads": [ + 17, + 30, + 33, + 26, + 35, + 22, + 18, + 33, + 29, + 23, + 5, + 27, + 23, + 73, + 57, + 5, + 50, + 13, + 22, + 68, + 34, + 13, + 32, + 30, + 6, + 14, + 20, + 10, + 34, + 31, + 12, + 48, + 12, + 31, + 18, + 27, + 24, + 32, + 38, + 19, + 45, + 18, + 18, + 42, + 13, + 8, + 16, + 30, + 37, + 36, + 26, + 39, + 43, + 19, + 34, + 12, + 40, + 40, + 0, + 23, + 7, + 38, + 24, + 20 + ], + "weighted_loads": [ + 0.8363750893622637, + 2.2749295942485332, + 2.05101266130805, + 1.260673209093511, + 2.448390981182456, + 1.1324256490916014, + 0.7320775836706161, + 2.03067771717906, + 1.679148718714714, + 1.1590027287602425, + 0.20439604111015797, + 1.2995372395962477, + 1.500801656395197, + 4.0032508708536625, + 2.8911619782447815, + 0.24680570140480995, + 3.3210354819893837, + 0.8307068273425102, + 1.114993367344141, + 3.2571727447211742, + 2.479119338095188, + 0.6973503343760967, + 2.083909582346678, + 2.364452078938484, + 0.2872273288667202, + 0.6671498902142048, + 0.9312896803021431, + 0.5125159118324518, + 3.732778698205948, + 2.919373493641615, + 0.9094378715381026, + 3.6857067849487066, + 0.4790265168994665, + 2.8402885869145393, + 0.9368099495768547, + 2.216785166412592, + 1.3986897245049477, + 2.243847781792283, + 2.9619955494999886, + 1.3150681965053082, + 2.274500012397766, + 1.3453044705092907, + 0.8829521350562572, + 3.394406985491514, + 1.2249246276915073, + 0.5150992013514042, + 1.0586482733488083, + 1.3125216979533434, + 1.9163856972008944, + 1.979679772630334, + 1.931753372773528, + 2.3363654017448425, + 2.769507721066475, + 1.3042279444634914, + 2.6672470699995756, + 0.5628454517573118, + 2.1377533990889788, + 2.476364014670253, + 0.0, + 1.1336582815274596, + 0.3179351519793272, + 3.0918016005307436, + 1.7439982406795025, + 1.2312564812600613 + ], + "unique_experts": 63, + "load_cv": 0.5354012506504381, + "normalized_load_entropy": 0.9645032963310519, + "max_load_share": 0.042392566782810684 + } + }, + "s0_x": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "a8fa8e662b2754629577730c44f1e370dc348092523633fc0e4e9c040b57b683", + "route_weight_sha256": "05327db8a745986c4b01e21a12732374288b660039bb09b66f48b89b0cb644e7", + "loads": [ + 17, + 31, + 34, + 20, + 27, + 21, + 17, + 26, + 19, + 20, + 4, + 24, + 14, + 73, + 61, + 4, + 44, + 9, + 19, + 65, + 34, + 11, + 31, + 27, + 6, + 15, + 15, + 2, + 20, + 11, + 2, + 43, + 8, + 27, + 12, + 22, + 24, + 30, + 23, + 21, + 42, + 7, + 12, + 40, + 0, + 6, + 15, + 26, + 30, + 40, + 25, + 38, + 40, + 18, + 32, + 13, + 33, + 32, + 0, + 16, + 6, + 30, + 21, + 21 + ], + "weighted_loads": [ + 0.7815670780837536, + 2.3349879048764706, + 2.032603282481432, + 1.1054958328604698, + 1.6690303683280945, + 1.0816549211740494, + 0.6966484393924475, + 1.635765504091978, + 0.968315364792943, + 0.8603768795728683, + 0.15167117677628994, + 1.199621770530939, + 0.9430099036544561, + 3.9195124320685863, + 3.1078368052840233, + 0.19510668143630028, + 3.1679719500243664, + 0.6545893028378487, + 1.0047370456159115, + 3.1478729359805584, + 2.4870926924049854, + 0.6147642396390438, + 2.0254904069006443, + 1.9651030711829662, + 0.27057963982224464, + 0.7039482574909925, + 0.7623748891055584, + 0.1282687485218048, + 1.5739584565162659, + 0.4499903805553913, + 0.07135416008532047, + 3.544103868305683, + 0.2850648146122694, + 2.6629402451217175, + 0.6386039033532143, + 1.7479023654013872, + 1.3856924027204514, + 2.100850308313966, + 1.542849339544773, + 1.4045093841850758, + 2.08197127841413, + 0.276218518614769, + 0.4761646557599306, + 3.3621968552470207, + 0.0, + 0.29346344247460365, + 0.9921428803354502, + 1.0472586881369352, + 1.6328023709356785, + 2.142077485099435, + 1.9122035577893257, + 2.376235656440258, + 2.7114371806383133, + 1.2353352792561054, + 2.59012733027339, + 0.6217961814254522, + 1.8708995897322893, + 2.090689918026328, + 0.0, + 0.9052551928907633, + 0.28599032759666443, + 2.697931207716465, + 1.5563828647136688, + 1.2587553039193153 + ], + "unique_experts": 62, + "load_cv": 0.6455043353652026, + "normalized_load_entropy": 0.948567141202827, + "max_load_share": 0.0494579945799458 + }, + "full_input": { + "tokens": 271, + "top_k": 6, + "decisions": 1626, + "ordered_route_sha256": "6db82245c538af8fb672c907b974884fb6cd638cdc44788c49cacce6f61f9d2d", + "route_weight_sha256": "92840e62d58f3b38ff4ee0c74f04f0e614075e97395d65d6ae6577a572b52258", + "loads": [ + 17, + 31, + 34, + 25, + 29, + 21, + 17, + 29, + 25, + 20, + 4, + 24, + 19, + 73, + 61, + 4, + 44, + 9, + 19, + 65, + 34, + 11, + 32, + 34, + 6, + 15, + 16, + 10, + 38, + 22, + 5, + 48, + 9, + 29, + 12, + 30, + 24, + 34, + 37, + 21, + 42, + 14, + 18, + 40, + 2, + 8, + 16, + 31, + 34, + 40, + 26, + 38, + 40, + 18, + 32, + 13, + 35, + 32, + 0, + 19, + 6, + 35, + 25, + 25 + ], + "weighted_loads": [ + 0.7815670780837536, + 2.3349879048764706, + 2.032603282481432, + 1.2576571190729737, + 2.3062315098941326, + 1.0816549211740494, + 0.6966484393924475, + 1.862712737172842, + 1.3867439199239016, + 0.8603768795728683, + 0.15167117677628994, + 1.199621770530939, + 1.1977624837309122, + 3.9195124320685863, + 3.1078368052840233, + 0.19510668143630028, + 3.1679719500243664, + 0.6545893028378487, + 1.0047370456159115, + 3.1478729359805584, + 2.4870926924049854, + 0.6147642396390438, + 2.075417250394821, + 2.60922871530056, + 0.27057963982224464, + 0.7039482574909925, + 0.7952057793736458, + 0.5878900717943907, + 3.78555516526103, + 1.6728740371763706, + 0.18868488539010286, + 3.846637360751629, + 0.331418139860034, + 2.755419608205557, + 0.6386039033532143, + 2.3263162840157747, + 1.3856924027204514, + 2.2150783371180296, + 2.6020182445645332, + 1.4045093841850758, + 2.08197127841413, + 0.8914492577314377, + 0.8781777303665876, + 3.3621968552470207, + 0.10428809747099876, + 0.38511229306459427, + 1.0515174511820078, + 1.2854019347578287, + 1.8731965571641922, + 2.142077485099435, + 1.9251733738929033, + 2.376235656440258, + 2.7114371806383133, + 1.2353352792561054, + 2.59012733027339, + 0.6217961814254522, + 1.9722506124526262, + 2.090689918026328, + 0.0, + 1.0346566578373313, + 0.28599032759666443, + 2.9246288426220417, + 1.7016134206205606, + 1.386430075392127 + ], + "unique_experts": 63, + "load_cv": 0.5800952394875228, + "normalized_load_entropy": 0.9576465139425361, + "max_load_share": 0.04489544895448955 + } + }, + "s1_x": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "ecb1584692f67318eb565d41cf798117d228e2af23620cc3539b6e844ea4073e", + "route_weight_sha256": "9a7f57adfbb4b4639f6ebcde568d37feb7927e0965087764ccaace709b772264", + "loads": [ + 15, + 31, + 37, + 21, + 28, + 21, + 19, + 26, + 21, + 21, + 4, + 24, + 16, + 74, + 58, + 6, + 47, + 10, + 21, + 63, + 35, + 11, + 31, + 24, + 6, + 14, + 14, + 3, + 22, + 12, + 1, + 41, + 7, + 27, + 13, + 20, + 24, + 29, + 20, + 21, + 43, + 6, + 12, + 38, + 1, + 6, + 17, + 22, + 29, + 42, + 25, + 38, + 41, + 16, + 33, + 11, + 35, + 33, + 0, + 16, + 5, + 31, + 18, + 20 + ], + "weighted_loads": [ + 0.7059513162821531, + 2.31510853394866, + 2.190048050135374, + 1.1052431911230087, + 1.6573400013148785, + 1.0787842851132154, + 0.7888056598603725, + 1.6407763212919235, + 1.0469055846333504, + 0.8877207934856415, + 0.16510435566306114, + 1.2099473513662815, + 1.0475654751062393, + 3.9975486639887094, + 2.9524303674697876, + 0.2795618511736393, + 3.167690694332123, + 0.6893861293792725, + 1.0789895802736282, + 3.0263319350779057, + 2.5393704436719418, + 0.6193178929388523, + 2.035466030240059, + 1.7903934232890606, + 0.28985804319381714, + 0.6680657844990492, + 0.6874890923500061, + 0.1636277660727501, + 1.6249846275895834, + 0.5126238334923983, + 0.04355597496032715, + 3.356373133137822, + 0.27111562341451645, + 2.6244590766727924, + 0.6693667806684971, + 1.6836348436772823, + 1.440750379115343, + 2.0349648892879486, + 1.5273828506469727, + 1.4050331339240074, + 2.1583610363304615, + 0.2704400345683098, + 0.5459060706198215, + 3.30111588165164, + 0.03293074294924736, + 0.294360414147377, + 1.0494793057441711, + 0.8850741870701313, + 1.509087910875678, + 2.2262867614626884, + 1.8994076754897833, + 2.3204656820744276, + 2.7265831027179956, + 1.163626965135336, + 2.70543877966702, + 0.5368725880980492, + 1.9429779164493084, + 2.1707822643220425, + 0.0, + 0.8597181998193264, + 0.2393362559378147, + 2.7277811616659164, + 1.4421796835958958, + 1.2274199873209 + ], + "unique_experts": 63, + "load_cv": 0.6450035296410881, + "normalized_load_entropy": 0.9489713443941943, + "max_load_share": 0.05013550135501355 + }, + "full_input": { + "tokens": 287, + "top_k": 6, + "decisions": 1722, + "ordered_route_sha256": "82a6c0c3d0ea654c955ed365c6f25ca9b564f9c1ad49a5ae94ea793375c4187a", + "route_weight_sha256": "d7223909d535d9c88c75edb24a445c12c033138e40ed0a5f7af67ba9ab64ea78", + "loads": [ + 18, + 31, + 37, + 23, + 31, + 21, + 19, + 33, + 28, + 24, + 5, + 25, + 20, + 74, + 58, + 6, + 50, + 12, + 22, + 63, + 35, + 14, + 33, + 30, + 6, + 14, + 17, + 11, + 41, + 27, + 13, + 46, + 11, + 32, + 18, + 29, + 24, + 33, + 38, + 21, + 43, + 19, + 20, + 40, + 14, + 11, + 21, + 29, + 37, + 42, + 27, + 38, + 41, + 19, + 33, + 11, + 36, + 39, + 0, + 19, + 7, + 40, + 23, + 20 + ], + "weighted_loads": [ + 0.8706612698733807, + 2.31510853394866, + 2.190048050135374, + 1.1605513831600547, + 2.3332388065755367, + 1.0787842851132154, + 0.7888056598603725, + 2.0460114553570747, + 1.553510146215558, + 1.2064842507243156, + 0.21035050973296165, + 1.2365967240184546, + 1.2266807779669762, + 3.9975486639887094, + 2.9524303674697876, + 0.2795618511736393, + 3.363298822194338, + 0.8015256822109222, + 1.1141813583672047, + 3.0263319350779057, + 2.5393704436719418, + 0.7389199268072844, + 2.1237522326409817, + 2.34023230150342, + 0.28985804319381714, + 0.6680657844990492, + 0.8114864490926266, + 0.6060879118740559, + 4.154835985973477, + 2.379162510856986, + 0.9478040253743529, + 3.656129529699683, + 0.4487096406519413, + 2.916055265814066, + 0.9239919669926167, + 2.390851840376854, + 1.440750379115343, + 2.2057500910013914, + 2.7978692539036274, + 1.4050331339240074, + 2.1583610363304615, + 1.4513660110533237, + 1.0679526589810848, + 3.4108084701001644, + 1.2432040572166443, + 0.6427809931337833, + 1.2229683436453342, + 1.2204187717288733, + 1.8948642816394567, + 2.2262867614626884, + 1.9651650302112103, + 2.3204656820744276, + 2.7265831027179956, + 1.3200000524520874, + 2.70543877966702, + 0.5368725880980492, + 1.9707712307572365, + 2.443604499101639, + 0.0, + 0.9738066988065839, + 0.31020146422088146, + 3.189845386892557, + 1.669787708669901, + 1.2274199873209 + ], + "unique_experts": 63, + "load_cv": 0.5259246884431468, + "normalized_load_entropy": 0.9657799502806291, + "max_load_share": 0.0429732868757259 + } + }, + "s0_period": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "961b44e5b4a0d03aa048ca57f78f0eb017ecd07c9770d04ad9b820d9d265153f", + "route_weight_sha256": "4a8f42c3bf8cd2f6a04923e19da13b8b481e2d597b53cd4d05463c35acfa6bc7", + "loads": [ + 18, + 31, + 34, + 21, + 27, + 21, + 15, + 26, + 19, + 20, + 4, + 25, + 15, + 72, + 58, + 5, + 46, + 10, + 20, + 66, + 35, + 12, + 31, + 29, + 6, + 15, + 15, + 3, + 20, + 11, + 3, + 42, + 9, + 27, + 12, + 20, + 23, + 29, + 22, + 21, + 42, + 7, + 14, + 39, + 0, + 6, + 17, + 23, + 30, + 39, + 25, + 39, + 40, + 17, + 33, + 11, + 32, + 31, + 0, + 17, + 6, + 30, + 20, + 20 + ], + "weighted_loads": [ + 0.8214299604296684, + 2.3512521982192993, + 2.0084614641964436, + 1.1372625604271889, + 1.653086457401514, + 1.0958774294704199, + 0.6377201192080975, + 1.6401597782969475, + 0.962801868095994, + 0.868875540792942, + 0.14948759227991104, + 1.2451702319085598, + 0.9866423662751913, + 3.9012569542974234, + 2.9799529537558556, + 0.23475456610321999, + 3.1963896341621876, + 0.6903796624392271, + 1.059387780725956, + 3.1598525028675795, + 2.5525751523673534, + 0.6506165266036987, + 2.0598064661026, + 2.054101590067148, + 0.2734171040356159, + 0.7049358282238245, + 0.7856601625680923, + 0.15622034296393394, + 1.567579798400402, + 0.4481761269271374, + 0.13234595023095608, + 3.4839923698455095, + 0.3317996896803379, + 2.6553737334907055, + 0.6445286795496941, + 1.6924644894897938, + 1.3572746124118567, + 2.0397654958069324, + 1.525462655350566, + 1.4067832492291927, + 2.1057319566607475, + 0.286013837903738, + 0.5594934672117233, + 3.3423840813338757, + 0.0, + 0.30405450612306595, + 1.0714678652584553, + 0.9438572227954865, + 1.590571379289031, + 2.0808538030833006, + 1.9121656324714422, + 2.438437333330512, + 2.714556835591793, + 1.1865883395075798, + 2.6289663277566433, + 0.5464951638132334, + 1.8266380559653044, + 2.105696439743042, + 0.0, + 0.9588344376534224, + 0.2876845858991146, + 2.6899288445711136, + 1.520346473902464, + 1.2158082835376263 + ], + "unique_experts": 62, + "load_cv": 0.6356443520825481, + "normalized_load_entropy": 0.9504959377985881, + "max_load_share": 0.04878048780487805 + }, + "full_input": { + "tokens": 271, + "top_k": 6, + "decisions": 1626, + "ordered_route_sha256": "1dc0862d444e4df63f3c3cf462019269d6d43b017e91366b316aa6785d4c1d2f", + "route_weight_sha256": "ed8a1798c8fd017a0f174cb40be63d66dc079294a386349adf8f56fb4626f472", + "loads": [ + 18, + 31, + 34, + 26, + 29, + 21, + 15, + 29, + 25, + 20, + 4, + 25, + 20, + 72, + 58, + 5, + 48, + 10, + 20, + 66, + 35, + 12, + 32, + 36, + 6, + 15, + 16, + 11, + 37, + 21, + 5, + 47, + 10, + 29, + 12, + 28, + 23, + 33, + 36, + 21, + 42, + 15, + 20, + 39, + 2, + 7, + 18, + 28, + 33, + 39, + 26, + 39, + 40, + 17, + 33, + 11, + 35, + 31, + 0, + 20, + 6, + 35, + 25, + 24 + ], + "weighted_loads": [ + 0.8214299604296684, + 2.3512521982192993, + 2.0084614641964436, + 1.2894238466396928, + 2.290287598967552, + 1.0958774294704199, + 0.6377201192080975, + 1.8562288582324982, + 1.369269946590066, + 0.868875540792942, + 0.14948759227991104, + 1.2451702319085598, + 1.254167454317212, + 3.9012569542974234, + 2.9799529537558556, + 0.23475456610321999, + 3.293219555169344, + 0.6903796624392271, + 1.059387780725956, + 3.1598525028675795, + 2.5525751523673534, + 0.6506165266036987, + 2.109733309596777, + 2.6102349758148193, + 0.2734171040356159, + 0.7049358282238245, + 0.8184910528361797, + 0.5970130953937769, + 3.7855664156377316, + 1.645990177989006, + 0.19616031739860773, + 3.7867072764784098, + 0.3781530149281025, + 2.7488951981067657, + 0.6445286795496941, + 2.244195729494095, + 1.3572746124118567, + 2.1539935246109962, + 2.59747220762074, + 1.4067832492291927, + 2.1057319566607475, + 0.9885838404297829, + 0.9517525136470795, + 3.3423840813338757, + 0.10599149018526077, + 0.343539722263813, + 1.1305024474859238, + 1.1826553642749786, + 1.7973717097193003, + 2.0808538030833006, + 1.9251354485750198, + 2.438437333330512, + 2.714556835591793, + 1.1865883395075798, + 2.6289663277566433, + 0.5464951638132334, + 1.9571689050644636, + 2.105696439743042, + 0.0, + 1.0878751454874873, + 0.2876845858991146, + 2.8993874453008175, + 1.7153832633048296, + 1.343483055010438 + ], + "unique_experts": 63, + "load_cv": 0.573210806666902, + "normalized_load_entropy": 0.9586274700089654, + "max_load_share": 0.04428044280442804 + } + }, + "s1_period": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "7bb920ca14144f03eadb020b855ad8e8206938a2aeba35b07aef7ee8c21ab3c5", + "route_weight_sha256": "4b18fd1fb3b233cb23c054a92c6dfdb5381b7c120bdad259efe82cbd18c3519f", + "loads": [ + 16, + 31, + 31, + 21, + 29, + 18, + 15, + 27, + 22, + 19, + 4, + 25, + 17, + 78, + 57, + 5, + 44, + 10, + 21, + 67, + 35, + 11, + 31, + 26, + 6, + 14, + 16, + 3, + 20, + 12, + 1, + 42, + 7, + 26, + 13, + 21, + 23, + 30, + 21, + 21, + 44, + 5, + 13, + 39, + 0, + 6, + 17, + 24, + 27, + 35, + 24, + 37, + 43, + 16, + 36, + 13, + 34, + 34, + 0, + 18, + 5, + 30, + 19, + 21 + ], + "weighted_loads": [ + 0.7507196366786957, + 2.323540013283491, + 1.9302649796009064, + 1.1175514291971922, + 1.6826157066971064, + 0.9642667435109615, + 0.6488846093416214, + 1.6790288351476192, + 1.079888617619872, + 0.819292301312089, + 0.16292278841137886, + 1.245729397982359, + 1.0811109840869904, + 4.149821314960718, + 2.8861384876072407, + 0.2553807757794857, + 3.0240110382437706, + 0.6752842627465725, + 1.0820524953305721, + 3.145662320777774, + 2.5218948796391487, + 0.6151345409452915, + 2.0355975441634655, + 1.9535112492740154, + 0.28650833293795586, + 0.6601385306566954, + 0.7747778613120317, + 0.17245718650519848, + 1.576554773375392, + 0.5187196247279644, + 0.042293481528759, + 3.407802913337946, + 0.2709381617605686, + 2.546466950327158, + 0.6618907116353512, + 1.72469100356102, + 1.3868445735424757, + 2.0555989667773247, + 1.5618756040930748, + 1.3952142298221588, + 2.202856542542577, + 0.22541964799165726, + 0.5797886662185192, + 3.3327355086803436, + 0.0, + 0.2981122173368931, + 1.0639919936656952, + 0.9600318558514118, + 1.3713489510118961, + 1.9292664937675, + 1.8909695986658335, + 2.28431748226285, + 2.796165892854333, + 1.153145931661129, + 2.825349658727646, + 0.6008726079016924, + 1.9081310406327248, + 2.2158018816262484, + 0.0, + 0.9328510668128729, + 0.23684224486351013, + 2.6905227787792683, + 1.478711649775505, + 1.2736415416002274 + ], + "unique_experts": 62, + "load_cv": 0.6552607920447973, + "normalized_load_entropy": 0.9476581460609214, + "max_load_share": 0.052845528455284556 + }, + "full_input": { + "tokens": 287, + "top_k": 6, + "decisions": 1722, + "ordered_route_sha256": "1b4dff11e754cd6802a6ce207fac78ca2597e332004f9f67fec1f8fbaf034e23", + "route_weight_sha256": "7db349c7f9c0fc812ae994f18ba5066d9da042dc411e631dd2a268bf4bfb2a28", + "loads": [ + 19, + 31, + 31, + 23, + 32, + 18, + 15, + 35, + 29, + 22, + 5, + 26, + 20, + 78, + 57, + 5, + 47, + 12, + 22, + 67, + 35, + 13, + 33, + 32, + 6, + 14, + 19, + 10, + 39, + 28, + 12, + 47, + 11, + 31, + 18, + 30, + 23, + 34, + 40, + 21, + 44, + 18, + 22, + 41, + 13, + 10, + 22, + 30, + 35, + 35, + 26, + 37, + 43, + 19, + 36, + 13, + 35, + 40, + 0, + 21, + 7, + 39, + 25, + 21 + ], + "weighted_loads": [ + 0.9154295902699232, + 2.323540013283491, + 1.9302649796009064, + 1.1728596212342381, + 2.3585145119577646, + 0.9642667435109615, + 0.6488846093416214, + 2.1135508362203836, + 1.594104327261448, + 1.1380557585507631, + 0.20816894248127937, + 1.272378770634532, + 1.209688887000084, + 4.149821314960718, + 2.8861384876072407, + 0.2553807757794857, + 3.23071700707078, + 0.7874238155782223, + 1.1172442734241486, + 3.145662320777774, + 2.5218948796391487, + 0.7044412679970264, + 2.1238837465643883, + 2.4211449027061462, + 0.28650833293795586, + 0.6601385306566954, + 0.8987752180546522, + 0.5382931996136904, + 4.131384173408151, + 2.4176898300647736, + 0.8996327621862292, + 3.6998067498207092, + 0.44853217899799347, + 2.846043899655342, + 0.9165158979594707, + 2.3916334994137287, + 1.3868445735424757, + 2.2263841684907675, + 2.8746821358799934, + 1.3952142298221588, + 2.202856542542577, + 1.4676577113568783, + 1.153801515698433, + 3.442428097128868, + 1.215542245656252, + 0.6041715703904629, + 1.2875100336968899, + 1.250813128426671, + 1.76535190269351, + 1.9292664937675, + 1.9567269533872604, + 2.28431748226285, + 2.796165892854333, + 1.3095190189778805, + 2.825349658727646, + 0.6008726079016924, + 1.9359243549406528, + 2.482435507699847, + 0.0, + 1.0469395658001304, + 0.3077074531465769, + 3.152598276734352, + 1.7417018115520477, + 1.2736415416002274 + ], + "unique_experts": 63, + "load_cv": 0.5383359831547069, + "normalized_load_entropy": 0.9645332715862693, + "max_load_share": 0.04529616724738676 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 246, + "ordered_topk_exact_tokens": 168, + "set_exact_tokens": 191, + "mean_set_jaccard": 0.9328300425861402, + "mean_token_weighted_tv": 0.013925513260187657, + "aggregate_load_tv": 0.021002710027100274 + }, + "system_bos": { + "tokens": 246, + "ordered_topk_exact_tokens": 146, + "set_exact_tokens": 175, + "mean_set_jaccard": 0.9140534262485481, + "mean_token_weighted_tv": 0.018646333514281164, + "aggregate_load_tv": 0.03048780487804878 + }, + "system_x": { + "tokens": 246, + "ordered_topk_exact_tokens": 132, + "set_exact_tokens": 168, + "mean_set_jaccard": 0.9008904374758032, + "mean_token_weighted_tv": 0.023393596340788574, + "aggregate_load_tv": 0.026422764227642268 + }, + "system_period": { + "tokens": 246, + "ordered_topk_exact_tokens": 121, + "set_exact_tokens": 162, + "mean_set_jaccard": 0.8937282229965156, + "mean_token_weighted_tv": 0.0235995422230988, + "aggregate_load_tv": 0.026422764227642268 + }, + "bos_at_s0": { + "tokens": 246, + "ordered_topk_exact_tokens": 128, + "set_exact_tokens": 168, + "mean_set_jaccard": 0.9050522648083622, + "mean_token_weighted_tv": 0.020365282370731597, + "aggregate_load_tv": 0.02303523035230353 + }, + "bos_at_s1": { + "tokens": 246, + "ordered_topk_exact_tokens": 120, + "set_exact_tokens": 157, + "mean_set_jaccard": 0.8879210220673633, + "mean_token_weighted_tv": 0.023601064272982076, + "aggregate_load_tv": 0.02913279132791328 + }, + "x_at_s0": { + "tokens": 246, + "ordered_topk_exact_tokens": 123, + "set_exact_tokens": 162, + "mean_set_jaccard": 0.8954703832752613, + "mean_token_weighted_tv": 0.024380908552102926, + "aggregate_load_tv": 0.029810298102981032 + }, + "x_at_s1": { + "tokens": 246, + "ordered_topk_exact_tokens": 104, + "set_exact_tokens": 145, + "mean_set_jaccard": 0.8694734804490902, + "mean_token_weighted_tv": 0.029090992720207064, + "aggregate_load_tv": 0.03387533875338753 + }, + "period_at_s0": { + "tokens": 246, + "ordered_topk_exact_tokens": 130, + "set_exact_tokens": 164, + "mean_set_jaccard": 0.8979868370112271, + "mean_token_weighted_tv": 0.02389089219514432, + "aggregate_load_tv": 0.02777777777777778 + }, + "period_at_s1": { + "tokens": 246, + "ordered_topk_exact_tokens": 105, + "set_exact_tokens": 144, + "mean_set_jaccard": 0.8700542005420053, + "mean_token_weighted_tv": 0.02831874715876046, + "aggregate_load_tv": 0.028455284552845527 + } + } + }, + "layer_13": { + "layer": 13, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "a0c8333903397165959c74ac7b80b80fa841cb7eec403f8e26c98ca6bc1a60f7", + "route_weight_sha256": "0f9b22e54380430dd73e281e599141282da427dd5650535662a8dd9a4ce0dd97", + "loads": [ + 25, + 13, + 22, + 19, + 1, + 75, + 25, + 35, + 22, + 22, + 20, + 6, + 11, + 13, + 16, + 33, + 24, + 11, + 65, + 0, + 17, + 25, + 66, + 14, + 16, + 16, + 18, + 14, + 70, + 2, + 11, + 27, + 45, + 20, + 20, + 37, + 16, + 4, + 27, + 11, + 10, + 1, + 16, + 30, + 8, + 29, + 14, + 33, + 41, + 19, + 72, + 22, + 50, + 19, + 31, + 0, + 8, + 4, + 17, + 22, + 19, + 37, + 27, + 13 + ], + "weighted_loads": [ + 1.984151691198349, + 0.5609595067799091, + 0.9485472999513149, + 0.8247395772486925, + 0.026068303734064102, + 5.115274230018258, + 1.0663852840662003, + 2.8223207723349333, + 0.8847262859344482, + 0.7886184919625521, + 2.0191796831786633, + 0.2096545174717903, + 0.7940814066678286, + 0.5420796275138855, + 0.8559764623641968, + 2.5620485674589872, + 1.0984883066266775, + 0.39721490629017353, + 4.149109484627843, + 0.0, + 0.8198193199932575, + 1.260351289063692, + 3.9911827202886343, + 0.5897137969732285, + 0.5738339349627495, + 0.7327970322221518, + 0.6359680630266666, + 0.7848540507256985, + 3.1193803250789642, + 0.07138172164559364, + 0.4339218493551016, + 2.3021732717752457, + 3.6546233128756285, + 1.221685642376542, + 1.0379197746515274, + 3.594692265614867, + 0.6206209193915129, + 0.1338922642171383, + 1.635088523849845, + 0.4653491731733084, + 0.43588531017303467, + 0.0327783040702343, + 0.6577657405287027, + 1.4915782827883959, + 0.30225894972682, + 2.0837375223636627, + 0.6715890355408192, + 1.1718731354922056, + 4.326694067567587, + 0.6975609920918941, + 3.3026132620871067, + 0.8210372589528561, + 1.9946715328842402, + 0.7928054984658957, + 1.9945941995829344, + 0.0, + 0.33008663915097713, + 0.12494908086955547, + 0.7201768569648266, + 1.199720585718751, + 1.0210149139165878, + 2.2879006918519735, + 1.4806884862482548, + 0.6638354640454054 + ], + "unique_experts": 62, + "load_cv": 0.748355227251684, + "normalized_load_entropy": 0.936963124664405, + "max_load_share": 0.0508130081300813 + }, + "full_input": { + "tokens": 271, + "top_k": 6, + "decisions": 1626, + "ordered_route_sha256": "434938abc75d675a395dbd035e1f2879f15c301fd617f84026a9e7c74d56ba02", + "route_weight_sha256": "fb6937d31b6372b105f992ba76dfe97d27ec5c58ecc4c6dc4698bc89d1ef0e04", + "loads": [ + 25, + 17, + 22, + 19, + 1, + 75, + 41, + 35, + 22, + 25, + 31, + 12, + 11, + 13, + 17, + 39, + 24, + 13, + 66, + 1, + 17, + 28, + 66, + 14, + 20, + 16, + 21, + 14, + 70, + 15, + 11, + 27, + 45, + 27, + 21, + 37, + 20, + 5, + 27, + 12, + 10, + 4, + 19, + 33, + 19, + 39, + 16, + 35, + 42, + 19, + 73, + 22, + 55, + 22, + 33, + 0, + 11, + 4, + 23, + 27, + 19, + 38, + 27, + 14 + ], + "weighted_loads": [ + 1.984151691198349, + 0.7643101774156094, + 0.9485472999513149, + 0.8247395772486925, + 0.026068303734064102, + 5.115274230018258, + 2.5549480598419905, + 2.8223207723349333, + 0.8847262859344482, + 0.9017452299594879, + 2.714314529672265, + 0.4693996640853584, + 0.7940814066678286, + 0.5420796275138855, + 0.9012627191841602, + 2.8702906984835863, + 1.0984883066266775, + 0.4449653998017311, + 4.191903727129102, + 0.046168673783540726, + 0.8198193199932575, + 1.3974839895963669, + 3.9911827202886343, + 0.5897137969732285, + 0.7141598742455244, + 0.7327970322221518, + 0.7583117336034775, + 0.7848540507256985, + 3.1193803250789642, + 0.901464469730854, + 0.4339218493551016, + 2.3021732717752457, + 3.6546233128756285, + 1.8995114658027887, + 1.0608124677091837, + 3.594692265614867, + 0.8844791334122419, + 0.16758958622813225, + 1.635088523849845, + 0.500443072989583, + 0.43588531017303467, + 0.16932497918605804, + 0.7963356021791697, + 1.63136419467628, + 1.1251183077692986, + 3.0410249531269073, + 0.7365250810980797, + 2.363677514716983, + 4.3587066531181335, + 0.6975609920918941, + 3.3415792025625706, + 0.8210372589528561, + 2.1725116055458784, + 0.9307248126715422, + 2.083185449242592, + 0.0, + 0.49401367269456387, + 0.12494908086955547, + 1.0090074706822634, + 1.4364915769547224, + 1.0210149139165878, + 2.316578084602952, + 1.4806884862482548, + 0.7023205850273371 + ], + "unique_experts": 63, + "load_cv": 0.6735516358014095, + "normalized_load_entropy": 0.9480542018860275, + "max_load_share": 0.046125461254612546 + } + }, + "s1_eos": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "d02f44fcc5ef6cd000f88a5eaa79423d814a7da55723435bcfa8219362ed3fb0", + "route_weight_sha256": "d1878126a5a97f9e9411a617c691ac904b13ab2224250141b22f87cfe4dfbd89", + "loads": [ + 24, + 14, + 21, + 18, + 1, + 75, + 25, + 35, + 25, + 25, + 21, + 5, + 12, + 14, + 13, + 32, + 24, + 10, + 64, + 0, + 15, + 25, + 67, + 13, + 17, + 16, + 15, + 14, + 66, + 2, + 9, + 27, + 43, + 20, + 22, + 38, + 15, + 4, + 25, + 11, + 10, + 1, + 17, + 32, + 8, + 31, + 12, + 33, + 41, + 19, + 71, + 20, + 56, + 22, + 31, + 0, + 10, + 4, + 20, + 22, + 19, + 37, + 28, + 10 + ], + "weighted_loads": [ + 1.963133830577135, + 0.6039877161383629, + 0.9110481161624193, + 0.7847165893763304, + 0.026180682703852654, + 5.169299557805061, + 1.072696764022112, + 2.8251029942184687, + 0.9832574613392353, + 0.8929924201220274, + 2.0511300675570965, + 0.18924945034086704, + 0.818862596526742, + 0.5599572695791721, + 0.7793944925069809, + 2.508829228579998, + 1.099447876214981, + 0.3699946664273739, + 4.102835493162274, + 0.0, + 0.7687747627496719, + 1.27077697776258, + 3.9794495329260826, + 0.5456157047301531, + 0.6065390091389418, + 0.7322811856865883, + 0.5274867787957191, + 0.7789681293070316, + 2.928562968969345, + 0.06792851537466049, + 0.3706567343324423, + 2.295163381844759, + 3.5785417146980762, + 1.2679635491222143, + 1.07696264795959, + 3.5932456962764263, + 0.5869237314909697, + 0.13166938349604607, + 1.555036012083292, + 0.4640396311879158, + 0.42834895104169846, + 0.030756859108805656, + 0.6966622043401003, + 1.517375212162733, + 0.32327258214354515, + 2.1542259082198143, + 0.5953489895910025, + 1.1807968318462372, + 4.325078247115016, + 0.6903474610298872, + 3.2499441914260387, + 0.76920529268682, + 2.237863840535283, + 0.8880234863609076, + 1.9835462309420109, + 0.0, + 0.40394713915884495, + 0.12786421552300453, + 0.8152609970420599, + 1.2073753625154495, + 1.0096277371048927, + 2.277348143979907, + 1.4990979358553886, + 0.5547490380704403 + ], + "unique_experts": 62, + "load_cv": 0.7500804763878068, + "normalized_load_entropy": 0.9360575900051372, + "max_load_share": 0.0508130081300813 + }, + "full_input": { + "tokens": 287, + "top_k": 6, + "decisions": 1722, + "ordered_route_sha256": "98d656a7f8e1c57c6396a0735ba94ff55993d99cbc2ea43b73d79ee003230e5e", + "route_weight_sha256": "695def43f88f7fb25cd44252b2714289f44977e5c77f4b37369d6e838b8f5770", + "loads": [ + 29, + 18, + 21, + 18, + 1, + 77, + 54, + 35, + 25, + 28, + 31, + 18, + 12, + 14, + 14, + 39, + 24, + 12, + 66, + 3, + 15, + 31, + 67, + 16, + 21, + 16, + 19, + 14, + 66, + 21, + 16, + 28, + 43, + 32, + 25, + 39, + 20, + 5, + 26, + 12, + 13, + 7, + 24, + 35, + 24, + 42, + 13, + 36, + 43, + 24, + 72, + 20, + 59, + 24, + 33, + 2, + 13, + 15, + 28, + 25, + 20, + 39, + 28, + 12 + ], + "weighted_loads": [ + 2.1630927436053753, + 0.8319904282689095, + 0.9110481161624193, + 0.7847165893763304, + 0.026180682703852654, + 5.241238720715046, + 3.5000744462013245, + 2.8251029942184687, + 0.9832574613392353, + 1.0363494493067265, + 2.694516761228442, + 0.9977271044626832, + 0.818862596526742, + 0.5599572695791721, + 0.8229835741221905, + 2.881540894508362, + 1.099447876214981, + 0.4224849073216319, + 4.169595347717404, + 0.12344702333211899, + 0.7687747627496719, + 1.571665532886982, + 3.9794495329260826, + 0.665884604677558, + 0.7626316822133958, + 0.7322811856865883, + 0.6817686054855585, + 0.7789681293070316, + 2.928562968969345, + 1.5886420998722315, + 0.7706559803336859, + 2.335666336119175, + 3.5785417146980762, + 2.424459809437394, + 1.3005139231681824, + 3.6470138169825077, + 0.9312379229813814, + 0.16508664935827255, + 1.5967853404581547, + 0.5090479589998722, + 0.5417580641806126, + 0.30484007485210896, + 1.324268827214837, + 1.6694005280733109, + 1.5737547911703587, + 3.143062498420477, + 0.6360699404031038, + 2.410369109362364, + 4.576671300455928, + 0.9400464985519648, + 3.285694118589163, + 0.76920529268682, + 2.3392159435898066, + 0.9708403628319502, + 2.053122343495488, + 0.07053549587726593, + 0.5562300439924002, + 0.8382679894566536, + 1.173274664208293, + 1.3783967196941376, + 1.0377603508532047, + 2.368799762800336, + 1.4990979358553886, + 0.6424491293728352 + ], + "unique_experts": 64, + "load_cv": 0.6306171017299818, + "normalized_load_entropy": 0.9549557769702011, + "max_load_share": 0.044715447154471545 + } + }, + "s0_bos": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "0ec1a8433d5b967c2b5352dd52cbcb675bfc74f103ea68e11b716617c8f9b142", + "route_weight_sha256": "8211edff4f6942295b3f98093e0e19fd58505dbeadb3c9a70602df1adef5aee2", + "loads": [ + 26, + 15, + 23, + 20, + 1, + 77, + 23, + 34, + 23, + 24, + 22, + 4, + 12, + 14, + 15, + 33, + 21, + 10, + 67, + 0, + 17, + 26, + 66, + 14, + 15, + 16, + 15, + 15, + 69, + 2, + 10, + 27, + 43, + 19, + 22, + 38, + 16, + 5, + 28, + 12, + 10, + 1, + 14, + 31, + 7, + 30, + 13, + 31, + 41, + 17, + 70, + 23, + 52, + 19, + 30, + 0, + 11, + 3, + 19, + 21, + 19, + 35, + 28, + 12 + ], + "weighted_loads": [ + 2.00167628377676, + 0.6466138008981943, + 1.0093718450516462, + 0.8733694218099117, + 0.02698861062526703, + 5.251686854287982, + 1.0685120467096567, + 2.8079916294664145, + 0.899621045216918, + 0.8637735247612, + 2.0673802718520164, + 0.1525510773062706, + 0.8264725059270859, + 0.5737465061247349, + 0.8393301516771317, + 2.536618374288082, + 1.003278411924839, + 0.3617757186293602, + 4.30206348747015, + 0.0, + 0.8166882041841745, + 1.2856223937124014, + 4.063036300241947, + 0.5565070416778326, + 0.5540564656257629, + 0.7506499886512756, + 0.5169414095580578, + 0.8165572118014097, + 3.145507289096713, + 0.06598492339253426, + 0.41724361293017864, + 2.3709074836224318, + 3.621929831802845, + 1.2204691469669342, + 1.110121138393879, + 3.6735850013792515, + 0.6301962863653898, + 0.15712564438581467, + 1.6511794347316027, + 0.4912779778242111, + 0.4364134408533573, + 0.03103521466255188, + 0.576296791434288, + 1.451347392052412, + 0.2573152594268322, + 2.059356579557061, + 0.6127295717597008, + 1.1179175172001123, + 4.286274680867791, + 0.6121301203966141, + 3.2012902591377497, + 0.8704486768692732, + 2.0667654760181904, + 0.7793235592544079, + 1.9390249345451593, + 0.0, + 0.4154910631477833, + 0.10145270079374313, + 0.7676007971167564, + 1.1618845146149397, + 1.029068037867546, + 2.2306433133780956, + 1.5250599198043346, + 0.6393115762621164 + ], + "unique_experts": 62, + "load_cv": 0.7516063637876083, + "normalized_load_entropy": 0.9362871320581633, + "max_load_share": 0.0521680216802168 + }, + "full_input": { + "tokens": 271, + "top_k": 6, + "decisions": 1626, + "ordered_route_sha256": "7a90177101c221d8e67b0d29ce7e16801c09fddd56dc56aa124be5c90adeda63", + "route_weight_sha256": "fa2bf89e71e9889a5d67c12faabfc6d3e3065b9a46e2ab7ef28295dc059bfec3", + "loads": [ + 26, + 20, + 24, + 20, + 2, + 77, + 39, + 34, + 23, + 29, + 31, + 8, + 12, + 14, + 15, + 39, + 21, + 11, + 68, + 1, + 17, + 29, + 66, + 14, + 18, + 16, + 18, + 15, + 69, + 15, + 10, + 27, + 43, + 24, + 23, + 38, + 19, + 6, + 28, + 13, + 10, + 4, + 17, + 35, + 18, + 41, + 15, + 32, + 42, + 17, + 71, + 23, + 57, + 23, + 33, + 0, + 15, + 3, + 26, + 26, + 19, + 36, + 28, + 13 + ], + "weighted_loads": [ + 2.00167628377676, + 0.9058375563472509, + 1.0786126013845205, + 0.8733694218099117, + 0.0776204913854599, + 5.251686854287982, + 2.5881494246423244, + 2.8079916294664145, + 0.899621045216918, + 1.0977503415197134, + 2.628590477630496, + 0.3495637644082308, + 0.8264725059270859, + 0.5737465061247349, + 0.8393301516771317, + 2.844860505312681, + 1.003278411924839, + 0.39649679884314537, + 4.344857729971409, + 0.046168673783540726, + 0.8166882041841745, + 1.427801376208663, + 4.063036300241947, + 0.5565070416778326, + 0.690504651516676, + 0.7506499886512756, + 0.6392850801348686, + 0.8165572118014097, + 3.145507289096713, + 0.8634432218968868, + 0.41724361293017864, + 2.3709074836224318, + 3.621929831802845, + 1.8239302560687065, + 1.1330138314515352, + 3.6735850013792515, + 0.8532645981758833, + 0.19082296639680862, + 1.6511794347316027, + 0.5263718776404858, + 0.4364134408533573, + 0.17738740146160126, + 0.7362512610852718, + 1.6716808080673218, + 1.0755371302366257, + 3.0540837217122316, + 0.6776656173169613, + 1.4785377476364374, + 4.318287266418338, + 0.6121301203966141, + 3.2402561996132135, + 0.8704486768692732, + 2.2446055486798286, + 0.9812899492681026, + 2.0649177357554436, + 0.0, + 0.7001508213579655, + 0.10145270079374313, + 1.0952105429023504, + 1.3986555058509111, + 1.029068037867546, + 2.259320706129074, + 1.5250599198043346, + 0.6777966972440481 + ], + "unique_experts": 63, + "load_cv": 0.6775291391289254, + "normalized_load_entropy": 0.9476093832141373, + "max_load_share": 0.047355473554735544 + } + }, + "s1_bos": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "0c7c31b455c6fd266e96968cd0a536faf7361ae96d5a86cea902fd91f1d71c40", + "route_weight_sha256": "b8ff1ed20add0f8b4ba3850d94b336809ed88f22215a2d76b39e111686d11026", + "loads": [ + 24, + 14, + 21, + 18, + 1, + 79, + 28, + 35, + 23, + 23, + 23, + 4, + 11, + 14, + 15, + 32, + 24, + 8, + 60, + 0, + 16, + 25, + 69, + 14, + 12, + 18, + 15, + 15, + 69, + 2, + 10, + 28, + 43, + 20, + 21, + 38, + 14, + 5, + 28, + 10, + 10, + 2, + 13, + 32, + 7, + 29, + 14, + 37, + 41, + 18, + 70, + 22, + 53, + 20, + 30, + 0, + 8, + 4, + 20, + 22, + 19, + 37, + 29, + 10 + ], + "weighted_loads": [ + 1.9239132329821587, + 0.6340792365372181, + 0.9345765896141529, + 0.7983999866992235, + 0.02626478113234043, + 5.300722025334835, + 1.2356879841536283, + 2.8305565118789673, + 0.9087739903479815, + 0.7810227274894714, + 2.146633554250002, + 0.14817679300904274, + 0.7986270599067211, + 0.5568318013101816, + 0.853640504181385, + 2.4488018937408924, + 1.054117763414979, + 0.30942234955728054, + 3.9978503361344337, + 0.0, + 0.7936421018093824, + 1.2691611237823963, + 4.152217645198107, + 0.5416988637298346, + 0.4601675122976303, + 0.8112853039056063, + 0.5413839425891638, + 0.8256660494953394, + 3.126722790300846, + 0.06285202875733376, + 0.39305872842669487, + 2.430703017860651, + 3.609650742262602, + 1.2818332985043526, + 1.067311953753233, + 3.620328137651086, + 0.5682152956724167, + 0.15713686123490334, + 1.622508829459548, + 0.439542505890131, + 0.4344020299613476, + 0.06952649354934692, + 0.5775999166071415, + 1.5602202657610178, + 0.27674053981900215, + 2.101411197334528, + 0.6804994884878397, + 1.3048840537667274, + 4.261525535956025, + 0.6449501235038042, + 3.23964798822999, + 0.83870087005198, + 2.133149294182658, + 0.8165107481181622, + 1.9470578394830227, + 0.0, + 0.3163455240428448, + 0.13400260172784328, + 0.8101633153855801, + 1.1890345867723227, + 1.0136711280792952, + 2.26627179980278, + 1.5415637604892254, + 0.5622183121740818 + ], + "unique_experts": 62, + "load_cv": 0.7604656681289546, + "normalized_load_entropy": 0.9347875659980003, + "max_load_share": 0.0535230352303523 + }, + "full_input": { + "tokens": 287, + "top_k": 6, + "decisions": 1722, + "ordered_route_sha256": "1f61e06a9de5c7239897cb6b2802d641aa9b671f280284a9eff4bae8efefbb08", + "route_weight_sha256": "6f40641ad76ff0fdef76395b1af747767523642d52f100c60cb8f51e8fffdfe7", + "loads": [ + 29, + 20, + 22, + 18, + 1, + 81, + 58, + 35, + 23, + 27, + 34, + 14, + 11, + 14, + 15, + 39, + 24, + 9, + 62, + 3, + 16, + 30, + 69, + 17, + 16, + 18, + 19, + 15, + 69, + 21, + 17, + 29, + 43, + 31, + 24, + 39, + 20, + 6, + 29, + 11, + 13, + 7, + 20, + 35, + 23, + 41, + 15, + 39, + 43, + 23, + 71, + 22, + 56, + 22, + 32, + 2, + 12, + 15, + 28, + 25, + 20, + 39, + 29, + 12 + ], + "weighted_loads": [ + 2.123872146010399, + 0.9526893384754658, + 0.9844848476350307, + 0.7983999866992235, + 0.02626478113234043, + 5.37266118824482, + 3.7975599970668554, + 2.8305565118789673, + 0.9087739903479815, + 0.9816022161394358, + 2.8462070878595114, + 0.8746957462280989, + 0.7986270599067211, + 0.5568318013101816, + 0.853640504181385, + 2.821513559669256, + 1.054117763414979, + 0.3482240494340658, + 4.064610190689564, + 0.12344702333211899, + 0.7936421018093824, + 1.5407605450600386, + 4.152217645198107, + 0.6619677636772394, + 0.6739857383072376, + 0.8112853039056063, + 0.6956657692790031, + 0.8256660494953394, + 3.126722790300846, + 1.6042678821831942, + 0.7930579744279385, + 2.471205972135067, + 3.609650742262602, + 2.423719484359026, + 1.2908632289618254, + 3.6740962583571672, + 0.9592526853084564, + 0.19055412709712982, + 1.6642581578344107, + 0.4845508337020874, + 0.5478111431002617, + 0.3137703277170658, + 1.225057229399681, + 1.7216202709823847, + 1.516767542809248, + 3.136455785483122, + 0.7212204392999411, + 1.7044307179749012, + 4.513118589296937, + 0.8946491610258818, + 3.275397915393114, + 0.83870087005198, + 2.2345013972371817, + 0.8993276245892048, + 2.0166339520365, + 0.07053549587726593, + 0.5066822730004787, + 0.8444063756614923, + 1.1411287989467382, + 1.3600559439510107, + 1.0418037418276072, + 2.357723418623209, + 1.5415637604892254, + 0.6499184034764767 + ], + "unique_experts": 64, + "load_cv": 0.6419465982782062, + "normalized_load_entropy": 0.9537073313350338, + "max_load_share": 0.047038327526132406 + } + }, + "s0_x": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "1eac0a064d3cd3813b277b51b65ea4979aec67761aae5fb0bc48f6e7fd71e7a1", + "route_weight_sha256": "c03e8583b757ed037545a5179ddcad325c2d474c8c28bc5f809057c5485bba31", + "loads": [ + 26, + 13, + 21, + 19, + 1, + 78, + 26, + 33, + 24, + 21, + 23, + 3, + 14, + 17, + 14, + 31, + 21, + 15, + 65, + 0, + 19, + 23, + 63, + 17, + 11, + 18, + 26, + 15, + 69, + 3, + 10, + 28, + 42, + 21, + 21, + 32, + 15, + 5, + 27, + 11, + 9, + 1, + 18, + 31, + 6, + 31, + 14, + 28, + 40, + 18, + 69, + 22, + 49, + 18, + 31, + 0, + 12, + 4, + 18, + 22, + 19, + 36, + 28, + 11 + ], + "weighted_loads": [ + 1.9998329523950815, + 0.5593939200043678, + 0.9423448387533426, + 0.8390263617038727, + 0.026267465204000473, + 5.259871557354927, + 1.1436798572540283, + 2.7237689681351185, + 0.9275622088462114, + 0.7649503871798515, + 2.1061387211084366, + 0.13091589137911797, + 0.8955610729753971, + 0.6789474152028561, + 0.8103194329887629, + 2.459403831511736, + 0.985289329662919, + 0.5740422569215298, + 4.530485367402434, + 0.0, + 0.893184581771493, + 1.203847974538803, + 3.93746280297637, + 0.6384935341775417, + 0.41568065620958805, + 0.8402988277375698, + 0.9583824165165424, + 0.8219595588743687, + 3.1994760017842054, + 0.1078864261507988, + 0.41255786269903183, + 2.3576224986463785, + 3.57898623496294, + 1.3164504580199718, + 1.0390509720891714, + 3.455145763233304, + 0.6091950461268425, + 0.16483022458851337, + 1.6197530589997768, + 0.48251198045909405, + 0.40798239782452583, + 0.032234277576208115, + 0.7116188555955887, + 1.4087630026042461, + 0.2551284432411194, + 2.084295626729727, + 0.6615835893899202, + 1.0345827918499708, + 4.27272417023778, + 0.6496473290026188, + 3.1565155517309904, + 0.8093136064708233, + 1.9860597979277372, + 0.7601288389414549, + 1.962813375517726, + 0.0, + 0.4245631843805313, + 0.13278956897556782, + 0.735905360430479, + 1.1972766686230898, + 1.0453481674194336, + 2.2184010092169046, + 1.509334236383438, + 0.5484836269170046 + ], + "unique_experts": 62, + "load_cv": 0.7310395427217453, + "normalized_load_entropy": 0.9392242992381117, + "max_load_share": 0.052845528455284556 + }, + "full_input": { + "tokens": 271, + "top_k": 6, + "decisions": 1626, + "ordered_route_sha256": "afd3fe7caf965cb655b66273e040d74d81b63b8ea41b64331997260145d9df66", + "route_weight_sha256": "6076fb5a9c271806563908c8b7678a089f0d293d90fec69a9e7b90bbaaa5a257", + "loads": [ + 26, + 16, + 21, + 19, + 1, + 78, + 43, + 33, + 24, + 23, + 34, + 8, + 14, + 17, + 14, + 38, + 21, + 16, + 66, + 1, + 19, + 25, + 63, + 17, + 17, + 18, + 29, + 15, + 69, + 16, + 10, + 28, + 42, + 28, + 22, + 32, + 18, + 6, + 27, + 12, + 9, + 4, + 21, + 33, + 19, + 43, + 17, + 29, + 41, + 18, + 70, + 22, + 54, + 21, + 33, + 0, + 15, + 4, + 24, + 27, + 19, + 37, + 28, + 12 + ], + "weighted_loads": [ + 1.9998329523950815, + 0.714596513658762, + 0.9423448387533426, + 0.8390263617038727, + 0.026267465204000473, + 5.259871557354927, + 2.6064940448850393, + 2.7237689681351185, + 0.9275622088462114, + 0.8411003034561872, + 2.699656283482909, + 0.3920696768909693, + 0.8955610729753971, + 0.6789474152028561, + 0.8103194329887629, + 2.987139381468296, + 0.985289329662919, + 0.6087633371353149, + 4.573279609903693, + 0.046168673783540726, + 0.893184581771493, + 1.3146385736763477, + 3.93746280297637, + 0.6384935341775417, + 0.6595007013529539, + 0.8402988277375698, + 1.0807260870933533, + 0.8219595588743687, + 3.1994760017842054, + 0.8828765414655209, + 0.41255786269903183, + 2.3576224986463785, + 3.57898623496294, + 2.018731042742729, + 1.0619436651468277, + 3.455145763233304, + 0.8277582451701164, + 0.19852754659950733, + 1.6197530589997768, + 0.5176058802753687, + 0.40798239782452583, + 0.1754133403301239, + 0.8460725024342537, + 1.4982599094510078, + 1.1861928962171078, + 3.2752569876611233, + 0.7561457231640816, + 1.395203022286296, + 4.304736755788326, + 0.6496473290026188, + 3.1954814922064543, + 0.8093136064708233, + 2.1638998705893755, + 0.8980481531471014, + 2.0514046251773834, + 0.0, + 0.588490217924118, + 0.13278956897556782, + 1.0216380879282951, + 1.4340476598590612, + 1.0453481674194336, + 2.247078401967883, + 1.509334236383438, + 0.5869687478989363 + ], + "unique_experts": 63, + "load_cv": 0.6613658442585756, + "normalized_load_entropy": 0.9497035272366646, + "max_load_share": 0.04797047970479705 + } + }, + "s1_x": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "b943cace748acb1a913a579ff919e188b009276e2be848f62a985f7f45525c5c", + "route_weight_sha256": "3226b6fc716f0f05137cd214befdea1fb286ff6db7d5e0d5ec61628bd5c4902d", + "loads": [ + 26, + 13, + 19, + 18, + 1, + 76, + 29, + 34, + 25, + 26, + 20, + 3, + 12, + 13, + 16, + 31, + 20, + 10, + 64, + 0, + 17, + 25, + 67, + 13, + 13, + 18, + 17, + 16, + 70, + 4, + 9, + 27, + 44, + 19, + 22, + 36, + 14, + 3, + 24, + 13, + 10, + 2, + 13, + 30, + 8, + 31, + 10, + 36, + 41, + 18, + 73, + 23, + 53, + 20, + 31, + 0, + 10, + 6, + 16, + 21, + 21, + 36, + 30, + 10 + ], + "weighted_loads": [ + 1.9902061577886343, + 0.5989963766187429, + 0.873886102810502, + 0.8034188225865364, + 0.028710655868053436, + 5.186751037836075, + 1.1895573418587446, + 2.762998456135392, + 0.979693153873086, + 0.9823148474097252, + 2.045242654159665, + 0.1362856812775135, + 0.8312776479870081, + 0.529031228274107, + 0.8981292638927698, + 2.4035843685269356, + 0.9342090953141451, + 0.3561769872903824, + 4.247082879766822, + 0.0, + 0.8263542037457228, + 1.3127908818423748, + 4.241421528160572, + 0.4946566764265299, + 0.48434607684612274, + 0.8231411054730415, + 0.6049530375748873, + 0.8685260098427534, + 3.3286024406552315, + 0.1356692872941494, + 0.3610911872237921, + 2.4123736023902893, + 3.7049158960580826, + 1.3511459864675999, + 1.0702218785881996, + 3.526367634534836, + 0.5718545988202095, + 0.09497915394604206, + 1.4633802473545074, + 0.5459437407553196, + 0.4427722096443176, + 0.09535394236445427, + 0.5590991023927927, + 1.374734228476882, + 0.39947690814733505, + 2.1007291860878468, + 0.5254916474223137, + 1.2633290905505419, + 4.244571249932051, + 0.6337277088314295, + 3.3346610721200705, + 0.867032440379262, + 2.1667479909956455, + 0.8079892136156559, + 1.9450877215713263, + 0.0, + 0.3525476101785898, + 0.21322805806994438, + 0.6957070026546717, + 1.178237484768033, + 1.0895201042294502, + 2.2518419455736876, + 1.5836612805724144, + 0.5178950689733028 + ], + "unique_experts": 62, + "load_cv": 0.759963308803037, + "normalized_load_entropy": 0.9354574525870455, + "max_load_share": 0.051490514905149054 + }, + "full_input": { + "tokens": 287, + "top_k": 6, + "decisions": 1722, + "ordered_route_sha256": "515d3dfef21fe14cd770a40b3e3ebc9b3d5b9bfeefd1779939462d8eaf1775a0", + "route_weight_sha256": "226c042f5ee94053e30ce7dfd1d172a733fc05d63b7b3c077935f6747b881a39", + "loads": [ + 31, + 17, + 19, + 18, + 1, + 78, + 56, + 34, + 25, + 27, + 29, + 13, + 12, + 13, + 16, + 39, + 20, + 11, + 66, + 3, + 17, + 32, + 67, + 16, + 18, + 18, + 22, + 16, + 70, + 23, + 16, + 28, + 44, + 32, + 25, + 37, + 20, + 4, + 25, + 14, + 13, + 9, + 20, + 31, + 26, + 43, + 12, + 38, + 43, + 23, + 74, + 23, + 56, + 22, + 33, + 3, + 13, + 19, + 22, + 24, + 22, + 39, + 30, + 12 + ], + "weighted_loads": [ + 2.1901650708168745, + 0.794640539214015, + 0.873886102810502, + 0.8034188225865364, + 0.028710655868053436, + 5.258690200746059, + 3.4000656064599752, + 2.762998456135392, + 0.979693153873086, + 1.0127534661442041, + 2.6025457307696342, + 0.866342319175601, + 0.8312776479870081, + 0.529031228274107, + 0.8981292638927698, + 2.9202038645744324, + 0.9342090953141451, + 0.39497868716716766, + 4.313842734321952, + 0.12344702333211899, + 0.8263542037457228, + 1.6516275499016047, + 4.241421528160572, + 0.6149255763739347, + 0.6977340392768383, + 0.8231411054730415, + 0.7905225940048695, + 0.8685260098427534, + 3.3286024406552315, + 1.5997244138270617, + 0.7610904332250357, + 2.4528765566647053, + 3.7049158960580826, + 2.537958402186632, + 1.293773153796792, + 3.580135755240917, + 0.9308155104517937, + 0.12839641980826855, + 1.5051295757293701, + 0.590952068567276, + 0.5561813227832317, + 0.41035832464694977, + 1.181628143414855, + 1.4162682686001062, + 1.7704066410660744, + 3.2380424812436104, + 0.6093457080423832, + 1.6628757547587156, + 4.496164303272963, + 0.883426746353507, + 3.3704109992831945, + 0.867032440379262, + 2.268100094050169, + 0.8908060900866985, + 2.0146638341248035, + 0.11164354905486107, + 0.504830515012145, + 1.0011425539851189, + 0.9212430156767368, + 1.349258841946721, + 1.1176527179777622, + 2.3784726541489363, + 1.5836612805724144, + 0.6055951602756977 + ], + "unique_experts": 64, + "load_cv": 0.6385080141177447, + "normalized_load_entropy": 0.9545917628064764, + "max_load_share": 0.04529616724738676 + } + }, + "s0_period": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "63cf0296244fa8a4804e249b87529d56e78d4bf47284b033aece5df567a0df34", + "route_weight_sha256": "5c0aecc109ca935d131975162192ae4c49662955d64e6d37fd48248cf19ea195", + "loads": [ + 24, + 17, + 19, + 20, + 1, + 78, + 23, + 34, + 20, + 22, + 24, + 5, + 11, + 15, + 14, + 32, + 21, + 13, + 66, + 0, + 18, + 23, + 66, + 14, + 14, + 17, + 16, + 16, + 66, + 2, + 11, + 28, + 43, + 20, + 24, + 36, + 14, + 6, + 27, + 16, + 9, + 3, + 18, + 34, + 6, + 31, + 14, + 28, + 41, + 19, + 68, + 24, + 48, + 17, + 33, + 1, + 10, + 4, + 18, + 21, + 19, + 36, + 28, + 10 + ], + "weighted_loads": [ + 1.9318427480757236, + 0.727232601493597, + 0.8724902588874102, + 0.8718433156609535, + 0.026363376528024673, + 5.264945592731237, + 1.0234098192304373, + 2.7825264520943165, + 0.8167024776339531, + 0.80652891471982, + 2.149044644087553, + 0.2066655457019806, + 0.7866298258304596, + 0.6091868039220572, + 0.8136426042765379, + 2.516044931486249, + 1.0007299799472094, + 0.50915308855474, + 4.453072702512145, + 0.0, + 0.8595555759966373, + 1.2058934569358826, + 4.048482669517398, + 0.5496603548526764, + 0.5042105130851269, + 0.8043301999568939, + 0.5855670161545277, + 0.857307679951191, + 3.142445979639888, + 0.07893761247396469, + 0.44280221685767174, + 2.3759053461253643, + 3.648377064615488, + 1.2764346413314342, + 1.1330103371292353, + 3.5767886452376842, + 0.5901616346091032, + 0.18993952870368958, + 1.6055363565683365, + 0.6303774304687977, + 0.4107278659939766, + 0.10184428095817566, + 0.7211117725819349, + 1.5171148106455803, + 0.2595130577683449, + 2.1123753674328327, + 0.6743022315204144, + 1.0416193511337042, + 4.267902381718159, + 0.6857048980891705, + 3.1220473777502775, + 0.8951125629246235, + 1.9333369322121143, + 0.7215976770967245, + 2.0073119048029184, + 0.02920209988951683, + 0.3629666864871979, + 0.12809346430003643, + 0.7393873278051615, + 1.1636850200593472, + 1.0373351275920868, + 2.2557577919214964, + 1.5102431811392307, + 0.52536641061306 + ], + "unique_experts": 63, + "load_cv": 0.7326451883591154, + "normalized_load_entropy": 0.9402066909217529, + "max_load_share": 0.052845528455284556 + }, + "full_input": { + "tokens": 271, + "top_k": 6, + "decisions": 1626, + "ordered_route_sha256": "7efd2a454e8926c3504cf74fc51fa9a784ae73f4faf4cba9a258155aee425cdd", + "route_weight_sha256": "8ed9b403fc33b581588cd92d401a432ef2567ea94af22607b4a2a51f3d25db36", + "loads": [ + 24, + 21, + 19, + 20, + 1, + 78, + 39, + 34, + 20, + 24, + 33, + 11, + 11, + 15, + 15, + 38, + 21, + 14, + 68, + 1, + 18, + 25, + 66, + 14, + 18, + 17, + 19, + 16, + 66, + 16, + 11, + 28, + 43, + 28, + 25, + 36, + 18, + 7, + 27, + 17, + 9, + 7, + 21, + 37, + 18, + 42, + 16, + 29, + 42, + 19, + 69, + 24, + 53, + 20, + 35, + 1, + 13, + 4, + 24, + 26, + 19, + 37, + 28, + 11 + ], + "weighted_loads": [ + 1.9318427480757236, + 1.0637803860008717, + 0.8724902588874102, + 0.8718433156609535, + 0.026363376528024673, + 5.264945592731237, + 2.5151753425598145, + 2.7825264520943165, + 0.8167024776339531, + 0.8826788309961557, + 2.7318061646074057, + 0.5175131615251303, + 0.7866298258304596, + 0.6091868039220572, + 0.8459770027548075, + 2.824287062510848, + 1.0007299799472094, + 0.5438741687685251, + 4.52412149310112, + 0.046168673783540726, + 0.8595555759966373, + 1.309663102030754, + 4.048482669517398, + 0.5496603548526764, + 0.759168840944767, + 0.8043301999568939, + 0.7079106867313385, + 0.857307679951191, + 3.142445979639888, + 0.9170193821191788, + 0.44280221685767174, + 2.3759053461253643, + 3.648377064615488, + 2.029168915003538, + 1.1559030301868916, + 3.5767886452376842, + 0.8605398144572973, + 0.22363685071468353, + 1.6055363565683365, + 0.6654713302850723, + 0.4107278659939766, + 0.2893071249127388, + 0.8473200630396605, + 1.6627529487013817, + 1.1313398145139217, + 3.1092791222035885, + 0.7392382770776749, + 1.4022395815700293, + 4.299914967268705, + 0.6857048980891705, + 3.1610133182257414, + 0.8951125629246235, + 2.1111770048737526, + 0.859516991302371, + 2.095903154462576, + 0.02920209988951683, + 0.5268937200307846, + 0.12809346430003643, + 1.0108048841357231, + 1.4004560112953186, + 1.0373351275920868, + 2.284435184672475, + 1.5102431811392307, + 0.5638515315949917 + ], + "unique_experts": 64, + "load_cv": 0.659716727375989, + "normalized_load_entropy": 0.9509512108649443, + "max_load_share": 0.04797047970479705 + } + }, + "s1_period": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "758595d2710e5a354c1754246f622a0804339a2882d32bc66ff7e22f8b7418ea", + "route_weight_sha256": "c1d83b33b8d9d182ceeb59f096dcae0fe43172eb6ad742af1615eee99d0185c7", + "loads": [ + 25, + 15, + 19, + 19, + 1, + 76, + 25, + 34, + 21, + 26, + 23, + 3, + 12, + 13, + 16, + 31, + 21, + 10, + 65, + 0, + 16, + 24, + 67, + 10, + 13, + 17, + 19, + 17, + 70, + 4, + 10, + 26, + 43, + 20, + 23, + 36, + 14, + 4, + 26, + 11, + 10, + 2, + 13, + 32, + 10, + 30, + 11, + 36, + 41, + 19, + 74, + 21, + 53, + 18, + 29, + 0, + 12, + 4, + 18, + 21, + 20, + 36, + 30, + 11 + ], + "weighted_loads": [ + 1.9657327197492123, + 0.6630775481462479, + 0.8789321277290583, + 0.8388951290398836, + 0.028014030307531357, + 5.217308163642883, + 1.036023696884513, + 2.775952886790037, + 0.8295604027807713, + 0.9593521002680063, + 2.1383365970104933, + 0.14125574007630348, + 0.8290250673890114, + 0.5235311184078455, + 0.8837428018450737, + 2.4156484827399254, + 0.9552505128085613, + 0.3583201076835394, + 4.258719405159354, + 0.0, + 0.7950232196599245, + 1.2680424004793167, + 4.180812092497945, + 0.3882286138832569, + 0.4828152768313885, + 0.7786924857646227, + 0.6729355528950691, + 0.9039553739130497, + 3.305591106414795, + 0.14952274784445763, + 0.39899494126439095, + 2.3787825033068657, + 3.6632551327347755, + 1.342277992516756, + 1.0998903904110193, + 3.5154382046312094, + 0.5685119144618511, + 0.12461886368691921, + 1.5225388947874308, + 0.4753986857831478, + 0.43803970888257027, + 0.09892302751541138, + 0.576298177242279, + 1.4482856541872025, + 0.4906612280756235, + 2.114171791821718, + 0.5560764670372009, + 1.2622785698622465, + 4.218938108533621, + 0.6777365673333406, + 3.2914055846631527, + 0.7912142630666494, + 2.1172096244990826, + 0.7404279634356499, + 1.876058291643858, + 0.0, + 0.4245476517826319, + 0.15740697644650936, + 0.7396452203392982, + 1.1742747109383345, + 1.0608971267938614, + 2.258932350203395, + 1.5748672299087048, + 0.5527658741921186 + ], + "unique_experts": 62, + "load_cv": 0.7594606171822889, + "normalized_load_entropy": 0.9359216839826469, + "max_load_share": 0.051490514905149054 + }, + "full_input": { + "tokens": 287, + "top_k": 6, + "decisions": 1722, + "ordered_route_sha256": "68b8099dffcf94262730a5e51706a518121fe55a81ce957c4637e77e33d72775", + "route_weight_sha256": "6cdabb4c2c129732938c50dae7f9dea0724c2eea865b0ebbd1298614294dc4ae", + "loads": [ + 30, + 20, + 19, + 19, + 1, + 78, + 52, + 34, + 21, + 27, + 32, + 14, + 12, + 13, + 16, + 38, + 21, + 11, + 67, + 3, + 16, + 31, + 67, + 13, + 17, + 17, + 23, + 17, + 70, + 25, + 18, + 28, + 43, + 34, + 26, + 37, + 20, + 5, + 27, + 12, + 13, + 9, + 20, + 34, + 28, + 41, + 12, + 38, + 43, + 24, + 75, + 21, + 56, + 20, + 31, + 2, + 15, + 16, + 24, + 24, + 21, + 38, + 30, + 13 + ], + "weighted_loads": [ + 2.1656916327774525, + 1.0559798330068588, + 0.8789321277290583, + 0.8388951290398836, + 0.028014030307531357, + 5.289247326552868, + 3.2025194633752108, + 2.775952886790037, + 0.8295604027807713, + 0.9897907190024853, + 2.740152094513178, + 0.9030862506479025, + 0.8290250673890114, + 0.5235311184078455, + 0.8837428018450737, + 2.788360148668289, + 0.9552505128085613, + 0.39712180756032467, + 4.325479259714484, + 0.12344702333211899, + 0.7950232196599245, + 1.5969399902969599, + 4.180812092497945, + 0.5084975138306618, + 0.77524134516716, + 0.7786924857646227, + 0.8272173795849085, + 0.9039553739130497, + 3.305591106414795, + 1.7042756211012602, + 0.8456791043281555, + 2.453765317797661, + 3.6632551327347755, + 2.578072641044855, + 1.3234416656196117, + 3.5692063253372908, + 0.9559183828532696, + 0.1580361295491457, + 1.5642882231622934, + 0.5204070135951042, + 0.5514488220214844, + 0.4242297261953354, + 1.1897876672446728, + 1.528055015951395, + 1.8281889762729406, + 3.103008382022381, + 0.5967974178493023, + 1.6618252340704203, + 4.470531161874533, + 0.9274356048554182, + 3.327155511826277, + 0.7912142630666494, + 2.218561727553606, + 0.8232448399066925, + 1.9456344041973352, + 0.07053549587726593, + 0.5768305566161871, + 0.9070233833044767, + 0.9614065755158663, + 1.3452960681170225, + 1.0890297405421734, + 2.3503839690238237, + 1.5748672299087048, + 0.6404659654945135 + ], + "unique_experts": 64, + "load_cv": 0.6367817590182674, + "normalized_load_entropy": 0.9547093909919798, + "max_load_share": 0.04529616724738676 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 246, + "ordered_topk_exact_tokens": 164, + "set_exact_tokens": 184, + "mean_set_jaccard": 0.9253774680603948, + "mean_token_weighted_tv": 0.013294631073902535, + "aggregate_load_tv": 0.02371273712737127 + }, + "system_bos": { + "tokens": 246, + "ordered_topk_exact_tokens": 133, + "set_exact_tokens": 163, + "mean_set_jaccard": 0.8992450638792102, + "mean_token_weighted_tv": 0.017964192332957332, + "aggregate_load_tv": 0.02506775067750678 + }, + "system_x": { + "tokens": 246, + "ordered_topk_exact_tokens": 111, + "set_exact_tokens": 142, + "mean_set_jaccard": 0.8622549537183682, + "mean_token_weighted_tv": 0.026355624486639247, + "aggregate_load_tv": 0.042005420054200535 + }, + "system_period": { + "tokens": 246, + "ordered_topk_exact_tokens": 110, + "set_exact_tokens": 145, + "mean_set_jaccard": 0.8689508323654663, + "mean_token_weighted_tv": 0.024054455631450426, + "aggregate_load_tv": 0.03658536585365854 + }, + "bos_at_s0": { + "tokens": 246, + "ordered_topk_exact_tokens": 130, + "set_exact_tokens": 166, + "mean_set_jaccard": 0.9011807975222608, + "mean_token_weighted_tv": 0.01885446317766498, + "aggregate_load_tv": 0.023712737127371278 + }, + "bos_at_s1": { + "tokens": 246, + "ordered_topk_exact_tokens": 119, + "set_exact_tokens": 161, + "mean_set_jaccard": 0.8938250096786683, + "mean_token_weighted_tv": 0.020306886230572696, + "aggregate_load_tv": 0.025067750677506773 + }, + "x_at_s0": { + "tokens": 246, + "ordered_topk_exact_tokens": 118, + "set_exact_tokens": 147, + "mean_set_jaccard": 0.8725319396051103, + "mean_token_weighted_tv": 0.02511943679499796, + "aggregate_load_tv": 0.035907859078590794 + }, + "x_at_s1": { + "tokens": 246, + "ordered_topk_exact_tokens": 108, + "set_exact_tokens": 141, + "mean_set_jaccard": 0.8671118854045683, + "mean_token_weighted_tv": 0.02590439199068682, + "aggregate_load_tv": 0.029132791327913278 + }, + "period_at_s0": { + "tokens": 246, + "ordered_topk_exact_tokens": 112, + "set_exact_tokens": 147, + "mean_set_jaccard": 0.8763066202090591, + "mean_token_weighted_tv": 0.02378738185814847, + "aggregate_load_tv": 0.03523035230352304 + }, + "period_at_s1": { + "tokens": 246, + "ordered_topk_exact_tokens": 110, + "set_exact_tokens": 138, + "mean_set_jaccard": 0.862756484707704, + "mean_token_weighted_tv": 0.025904411980049398, + "aggregate_load_tv": 0.030487804878048787 + } + } + }, + "layer_14": { + "layer": 14, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "2ba8f351d3431647adbbf9b97379f984b89477fa1fc8349023cd6575a5e2a0ad", + "route_weight_sha256": "7f8a88f9ad3b8a3ea36ec4c8f7b570c133611b1fa9595347165dcbd2a566a699", + "loads": [ + 32, + 16, + 14, + 25, + 29, + 13, + 34, + 18, + 24, + 9, + 82, + 2, + 2, + 41, + 34, + 37, + 20, + 2, + 42, + 39, + 37, + 29, + 3, + 33, + 34, + 21, + 15, + 15, + 9, + 46, + 25, + 28, + 23, + 3, + 12, + 24, + 10, + 33, + 22, + 25, + 2, + 36, + 17, + 0, + 39, + 24, + 34, + 27, + 26, + 22, + 6, + 14, + 21, + 5, + 42, + 9, + 27, + 32, + 10, + 31, + 6, + 23, + 19, + 42 + ], + "weighted_loads": [ + 3.3738547787070274, + 0.7128614149987698, + 0.6286216042935848, + 1.2133897561579943, + 2.2182153202593327, + 0.6515005249530077, + 2.665726862847805, + 0.7727855201810598, + 1.4732330217957497, + 0.43776891753077507, + 4.012615613639355, + 0.07008005306124687, + 0.08218613266944885, + 2.846774835139513, + 1.3193642161786556, + 1.8403873797506094, + 1.290667612105608, + 0.05147065781056881, + 2.053077533841133, + 5.229265868663788, + 2.833705246448517, + 1.5765051562339067, + 0.08197109028697014, + 1.4635759117081761, + 2.4484223183244467, + 0.9020880814641714, + 1.3419515378773212, + 0.6108706500381231, + 0.38389737717807293, + 2.741471951827407, + 1.3204406797885895, + 1.1393021754920483, + 2.220567999407649, + 0.11432274244725704, + 0.5680975876748562, + 1.347532695159316, + 0.3785858303308487, + 1.8573044706135988, + 1.4901443924754858, + 1.4409873336553574, + 0.0641556866466999, + 2.103487865999341, + 0.9638259299099445, + 0.0, + 1.756458674557507, + 1.1531627140939236, + 4.382594123482704, + 2.5873628072440624, + 1.943670591339469, + 2.134842664003372, + 0.2262379787862301, + 0.6109981704503298, + 1.378790333867073, + 0.32000987231731415, + 2.63548156991601, + 0.5636398792266846, + 2.749883595854044, + 1.6359860636293888, + 0.4345724359154701, + 1.9851244557648897, + 0.2843520361930132, + 0.9736635815352201, + 1.521802069619298, + 2.0923989079892635 + ], + "unique_experts": 63, + "load_cv": 0.6210575674697725, + "normalized_load_entropy": 0.950367326675722, + "max_load_share": 0.05555555555555555 + }, + "full_input": { + "tokens": 271, + "top_k": 6, + "decisions": 1626, + "ordered_route_sha256": "dba661767aa6381a3a92f0b53ea56c783a62f778ae039d01898d68ab82b79524", + "route_weight_sha256": "4fe9d92c7e887d1afa08acc9e545b0678007023f150095cf228246743551d1ae", + "loads": [ + 39, + 16, + 14, + 27, + 29, + 23, + 34, + 20, + 24, + 18, + 84, + 5, + 2, + 41, + 34, + 43, + 20, + 2, + 46, + 40, + 37, + 29, + 3, + 44, + 35, + 22, + 21, + 21, + 17, + 46, + 28, + 32, + 23, + 10, + 12, + 24, + 11, + 34, + 24, + 25, + 2, + 36, + 18, + 1, + 41, + 24, + 39, + 30, + 26, + 24, + 9, + 20, + 27, + 11, + 42, + 13, + 27, + 33, + 10, + 43, + 6, + 24, + 19, + 42 + ], + "weighted_loads": [ + 4.070813549682498, + 0.7128614149987698, + 0.6286216042935848, + 1.293364169076085, + 2.2182153202593327, + 1.577069541439414, + 2.665726862847805, + 0.8456768076866865, + 1.4732330217957497, + 1.1210306026041508, + 4.079483076930046, + 0.261432196944952, + 0.08218613266944885, + 2.846774835139513, + 1.3193642161786556, + 2.208519598469138, + 1.290667612105608, + 0.05147065781056881, + 2.421574167907238, + 5.269198875874281, + 2.833705246448517, + 1.5765051562339067, + 0.08197109028697014, + 1.9299849616363645, + 2.471028234809637, + 0.9333423096686602, + 1.6839685067534447, + 1.0275297267362475, + 1.548389783129096, + 2.741471951827407, + 1.5165156312286854, + 1.296090254560113, + 2.220567999407649, + 0.6502117346972227, + 0.5680975876748562, + 1.347532695159316, + 0.4320561960339546, + 1.8990560676902533, + 1.5930599253624678, + 1.4409873336553574, + 0.0641556866466999, + 2.103487865999341, + 1.0129469484090805, + 0.048626597970724106, + 1.8239721143618226, + 1.1531627140939236, + 4.671331292018294, + 2.7180027179419994, + 1.943670591339469, + 2.2017507161945105, + 0.34003017097711563, + 1.9418793115764856, + 2.12592513859272, + 0.7528797052800655, + 2.63548156991601, + 0.8960562646389008, + 2.749883595854044, + 1.6722190864384174, + 0.4345724359154701, + 2.525172268971801, + 0.2843520361930132, + 0.9786753468215466, + 1.521802069619298, + 2.0923989079892635 + ], + "unique_experts": 64, + "load_cv": 0.5656438615662397, + "normalized_load_entropy": 0.9590606467445542, + "max_load_share": 0.05166051660516605 + } + }, + "s1_eos": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "14d31f325e43964452aa12f8aac25721c70f97c6fc82f03e3c2513a3e6c914d0", + "route_weight_sha256": "aa5e029c30d7f9890f352616e1aa446b41b62874082f90bae006fc9c4dfd4fa3", + "loads": [ + 33, + 15, + 15, + 31, + 29, + 16, + 32, + 19, + 24, + 11, + 83, + 2, + 2, + 39, + 36, + 37, + 21, + 2, + 45, + 38, + 36, + 28, + 2, + 35, + 32, + 21, + 14, + 14, + 6, + 46, + 25, + 30, + 23, + 3, + 11, + 22, + 12, + 31, + 22, + 25, + 2, + 34, + 15, + 0, + 38, + 23, + 34, + 27, + 25, + 24, + 6, + 17, + 22, + 5, + 43, + 8, + 27, + 32, + 9, + 30, + 6, + 21, + 19, + 41 + ], + "weighted_loads": [ + 3.3516417872160673, + 0.6664470788091421, + 0.6563618425279856, + 1.4215410016477108, + 2.2300359793007374, + 0.760399404913187, + 2.5892946887761354, + 0.8002027217298746, + 1.4617581404745579, + 0.5100176092237234, + 4.050979997962713, + 0.06970513239502907, + 0.07923903316259384, + 2.8621150217950344, + 1.3698040582239628, + 1.8841709308326244, + 1.3171567767858505, + 0.04882509261369705, + 2.1814531814306974, + 5.166819408535957, + 2.7827565781772137, + 1.5693396404385567, + 0.051435280591249466, + 1.549973607994616, + 2.3565690517425537, + 0.911255557090044, + 1.3734480664134026, + 0.5862964950501919, + 0.2676128838211298, + 2.7851813957095146, + 1.3453235886991024, + 1.1953908521682024, + 2.2135059759020805, + 0.12069426104426384, + 0.5233923029154539, + 1.278716754168272, + 0.4440511502325535, + 1.7988180574029684, + 1.4685993772000074, + 1.438552401959896, + 0.06239759922027588, + 2.0148356445133686, + 0.8942965529859066, + 0.0, + 1.7580114556476474, + 1.0818257853388786, + 4.362278977409005, + 2.544452551752329, + 1.9072231091558933, + 2.2529219072312117, + 0.2171596959233284, + 0.7201820136979222, + 1.4313468523323536, + 0.3501226454973221, + 2.6571898125112057, + 0.5297498814761639, + 2.8020150177180767, + 1.6391331404447556, + 0.3783294800668955, + 1.9079682100564241, + 0.27999730966985226, + 0.9219922795891762, + 1.5116306990385056, + 2.0383115466684103 + ], + "unique_experts": 63, + "load_cv": 0.6245951090442455, + "normalized_load_entropy": 0.9496541978007599, + "max_load_share": 0.05623306233062331 + }, + "full_input": { + "tokens": 287, + "top_k": 6, + "decisions": 1722, + "ordered_route_sha256": "87d0bbd6953b87caf47c7a737136be9e9d6155e7b176070eb6c7b41001d783fd", + "route_weight_sha256": "b96c760e226065c4ab69f2a012f6e430c2186491d39505b322ab19062273152b", + "loads": [ + 42, + 16, + 15, + 33, + 33, + 32, + 32, + 23, + 26, + 23, + 83, + 5, + 8, + 39, + 36, + 44, + 21, + 2, + 52, + 42, + 38, + 32, + 2, + 45, + 37, + 22, + 19, + 22, + 19, + 47, + 31, + 33, + 25, + 14, + 12, + 23, + 13, + 34, + 25, + 26, + 2, + 34, + 17, + 1, + 40, + 23, + 40, + 29, + 27, + 25, + 20, + 20, + 30, + 14, + 45, + 12, + 28, + 34, + 10, + 48, + 9, + 23, + 21, + 44 + ], + "weighted_loads": [ + 4.17526994459331, + 0.7160588819533587, + 0.6563618425279856, + 1.4975681267678738, + 2.4664864744991064, + 1.8812458142638206, + 2.5892946887761354, + 0.9634879063814878, + 1.630706924945116, + 1.4924357738345861, + 4.050979997962713, + 0.2801288701593876, + 0.46899812296032906, + 2.8621150217950344, + 1.3698040582239628, + 2.311479028314352, + 1.3171567767858505, + 0.04882509261369705, + 2.722359886392951, + 5.365834433585405, + 3.011147990822792, + 1.7224243599921465, + 0.051435280591249466, + 1.9530293019488454, + 2.602021774277091, + 0.9583480842411518, + 1.7192180640995502, + 0.9013873329386115, + 1.8868150282651186, + 2.8334820568561554, + 1.634072944521904, + 1.2860452104359865, + 2.2920731343328953, + 1.1333897858858109, + 0.5723345559090376, + 1.3577996753156185, + 0.4835316017270088, + 2.1540971156209707, + 1.6640462074428797, + 1.4961519092321396, + 0.06239759922027588, + 2.0148356445133686, + 0.9901685379445553, + 0.04618395119905472, + 1.826326939277351, + 1.0818257853388786, + 4.687169684097171, + 2.6131370794028044, + 2.0369201563298702, + 2.2856013868004084, + 1.1118876226246357, + 1.9574777381494641, + 2.228367254137993, + 1.0339198596775532, + 2.740266539156437, + 0.857594758272171, + 2.8554614074528217, + 1.7215191163122654, + 0.48745485581457615, + 2.931913426145911, + 0.5303307976573706, + 0.9681205907836556, + 1.6132209636271, + 2.145771535113454 + ], + "unique_experts": 64, + "load_cv": 0.5341905218412265, + "normalized_load_entropy": 0.9631892620915999, + "max_load_share": 0.04819976771196283 + } + }, + "s0_bos": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "b858c9db221a303789df66b5f3a92f1c2afcc40d0e9f02842cdf7d166e4053f4", + "route_weight_sha256": "7836046ecbf9e5cc56f65c270513cde70d89b824ae972a8442da9301f9676764", + "loads": [ + 32, + 16, + 16, + 27, + 29, + 14, + 34, + 16, + 24, + 10, + 89, + 2, + 2, + 41, + 32, + 33, + 21, + 3, + 44, + 39, + 33, + 29, + 3, + 36, + 32, + 20, + 14, + 14, + 9, + 47, + 25, + 32, + 23, + 3, + 12, + 24, + 10, + 30, + 22, + 25, + 1, + 34, + 16, + 0, + 39, + 23, + 34, + 29, + 23, + 24, + 6, + 16, + 24, + 5, + 42, + 8, + 29, + 30, + 10, + 30, + 7, + 19, + 19, + 41 + ], + "weighted_loads": [ + 3.2825983930379152, + 0.7283467743545771, + 0.696316584944725, + 1.268778182566166, + 2.2624911218881607, + 0.7300585769116879, + 2.7004932332783937, + 0.6852451600134373, + 1.4770150296390057, + 0.4716903120279312, + 4.266874849796295, + 0.06689702346920967, + 0.08550016209483147, + 2.9877622593194246, + 1.2264145631343126, + 1.6845020949840546, + 1.3168334029614925, + 0.07396753132343292, + 2.141670549288392, + 5.227656226605177, + 2.6809907034039497, + 1.6000554412603378, + 0.08215839229524136, + 1.5894092917442322, + 2.357563942670822, + 0.8586154486984015, + 1.2670630738139153, + 0.5976876895874739, + 0.3731299377977848, + 2.82189067453146, + 1.314526416361332, + 1.2489854786545038, + 2.204416822642088, + 0.11211424507200718, + 0.5829184856265783, + 1.3397284373641014, + 0.35689017176628113, + 1.797027938067913, + 1.5038770381361246, + 1.4453663565218449, + 0.03490510210394859, + 2.0666524581611156, + 0.9381141159683466, + 0.0, + 1.793741517700255, + 1.0967698991298676, + 4.430402556434274, + 2.6724373567849398, + 1.8618797790259123, + 2.186710888519883, + 0.23017827793955803, + 0.6874421192333102, + 1.5181364752352238, + 0.3485308960080147, + 2.6444191113114357, + 0.5229320488870144, + 2.8597658835351467, + 1.6154547408223152, + 0.42464364506304264, + 1.9307501669973135, + 0.31500656343996525, + 0.8424843661487103, + 1.5089536979794502, + 2.10400309599936 + ], + "unique_experts": 63, + "load_cv": 0.6370754394588797, + "normalized_load_entropy": 0.9494747713800016, + "max_load_share": 0.06029810298102981 + }, + "full_input": { + "tokens": 271, + "top_k": 6, + "decisions": 1626, + "ordered_route_sha256": "f982723f3a5cf34258f754326b9796b2371ef6f8700026e275982ffe8e257b18", + "route_weight_sha256": "b22f79c46d6fce2e2877bce383fc53ede9c8f80fb5b2b67db0ca0327c1ffc2b8", + "loads": [ + 38, + 16, + 16, + 30, + 29, + 24, + 34, + 17, + 24, + 18, + 91, + 5, + 2, + 41, + 32, + 38, + 21, + 3, + 50, + 40, + 33, + 29, + 3, + 46, + 34, + 22, + 20, + 20, + 18, + 47, + 28, + 36, + 23, + 10, + 12, + 24, + 11, + 31, + 24, + 25, + 1, + 34, + 16, + 1, + 42, + 23, + 39, + 31, + 23, + 26, + 8, + 23, + 30, + 11, + 42, + 12, + 29, + 31, + 11, + 42, + 7, + 19, + 19, + 41 + ], + "weighted_loads": [ + 3.932227708399296, + 0.7283467743545771, + 0.696316584944725, + 1.4053672030568123, + 2.2624911218881607, + 1.6556275933980942, + 2.7004932332783937, + 0.7188211493194103, + 1.4770150296390057, + 1.1358402222394943, + 4.3337423130869865, + 0.2582491673529148, + 0.08550016209483147, + 2.9877622593194246, + 1.2264145631343126, + 2.0502521954476833, + 1.3168334029614925, + 0.07396753132343292, + 2.6297308672219515, + 5.26758923381567, + 2.6809907034039497, + 1.6000554412603378, + 0.08215839229524136, + 2.028159063309431, + 2.421529809013009, + 0.9313444960862398, + 1.6090800426900387, + 1.0674119628965855, + 1.5595199428498745, + 2.82189067453146, + 1.5147041007876396, + 1.4510104712098837, + 2.204416822642088, + 0.6521843951195478, + 0.5829184856265783, + 1.3397284373641014, + 0.41036053746938705, + 1.8387795351445675, + 1.6150125283747911, + 1.4453663565218449, + 0.03490510210394859, + 2.0666524581611156, + 0.9381141159683466, + 0.048626597970724106, + 1.9390222551301122, + 1.0967698991298676, + 4.707633152604103, + 2.7587532568722963, + 1.8618797790259123, + 2.2536189407110214, + 0.31708550453186035, + 1.2539937840774655, + 2.2652712799608707, + 0.7814007289707661, + 2.6444191113114357, + 0.8915833123028278, + 2.8597658835351467, + 1.6581037566065788, + 0.4684166740626097, + 2.4735172372311354, + 0.31500656343996525, + 0.8424843661487103, + 1.5089536979794502, + 2.10400309599936 + ], + "unique_experts": 64, + "load_cv": 0.5844603772237187, + "normalized_load_entropy": 0.9577277065353402, + "max_load_share": 0.055965559655596554 + } + }, + "s1_bos": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "ce635aac0b8ce367433d2ad15b8b82ac479dd2c0d74c3b6ac7e5e10a4b7d64e4", + "route_weight_sha256": "59edba5beb3d9ef76ace17010aabc18673367aaebb2207a23ba69abb87bab4c0", + "loads": [ + 36, + 18, + 16, + 28, + 29, + 14, + 32, + 15, + 24, + 13, + 84, + 2, + 2, + 41, + 31, + 38, + 21, + 4, + 40, + 38, + 33, + 28, + 3, + 40, + 32, + 20, + 13, + 14, + 7, + 46, + 25, + 30, + 23, + 2, + 12, + 23, + 12, + 30, + 22, + 24, + 1, + 35, + 16, + 0, + 40, + 22, + 31, + 28, + 26, + 23, + 7, + 17, + 25, + 4, + 40, + 9, + 29, + 30, + 10, + 29, + 7, + 21, + 18, + 43 + ], + "weighted_loads": [ + 3.4451669426634908, + 0.7794514335691929, + 0.7187560126185417, + 1.3582448419183493, + 2.2501603215932846, + 0.6929661855101585, + 2.596146149560809, + 0.6581716258078814, + 1.4605877548456192, + 0.590157900005579, + 4.036249071359634, + 0.06416845321655273, + 0.0827786959707737, + 2.981990722939372, + 1.2053032107651234, + 1.905855180695653, + 1.3174805622547865, + 0.09815102070569992, + 1.9700738452374935, + 5.156847849488258, + 2.6871916130185127, + 1.5898126792162657, + 0.08121733739972115, + 1.7262028763070703, + 2.3071432523429394, + 0.892812104895711, + 1.276491278782487, + 0.5887618996202946, + 0.2870495207607746, + 2.801564756780863, + 1.3198036849498749, + 1.1886309944093227, + 2.222366211935878, + 0.08689513802528381, + 0.5720545742660761, + 1.3179969806224108, + 0.4254286400973797, + 1.7878008410334587, + 1.4760839696973562, + 1.3967776149511337, + 0.03443785756826401, + 2.053687324747443, + 0.9124864153563976, + 0.0, + 1.837366295978427, + 1.025742195546627, + 4.284047331660986, + 2.614553751423955, + 1.997868625447154, + 2.1630710884928703, + 0.24244346842169762, + 0.7271152483299375, + 1.5554490871727467, + 0.3113352246582508, + 2.5717410780489445, + 0.5617652349174023, + 2.8682213202118874, + 1.6043984070420265, + 0.41976224072277546, + 1.9296315526589751, + 0.31350922025740147, + 0.9073139857500792, + 1.4774446114897728, + 2.1659659426659346 + ], + "unique_experts": 63, + "load_cv": 0.6202055550864937, + "normalized_load_entropy": 0.9508318429864266, + "max_load_share": 0.056910569105691054 + }, + "full_input": { + "tokens": 287, + "top_k": 6, + "decisions": 1722, + "ordered_route_sha256": "cdd0c829fd796eea204dd9eaa60d2882b74e107561c06b3af4600074b124d2e9", + "route_weight_sha256": "9b49dc69e8a683d664422c65501b939392c1824353fde9829684bc7eff9516c9", + "loads": [ + 45, + 19, + 16, + 31, + 33, + 30, + 32, + 18, + 26, + 25, + 85, + 5, + 8, + 41, + 31, + 45, + 21, + 4, + 47, + 42, + 35, + 31, + 3, + 49, + 37, + 22, + 18, + 22, + 21, + 47, + 30, + 33, + 25, + 13, + 13, + 24, + 12, + 33, + 25, + 25, + 1, + 35, + 17, + 1, + 42, + 23, + 37, + 31, + 28, + 24, + 21, + 20, + 33, + 13, + 42, + 13, + 30, + 33, + 11, + 47, + 10, + 22, + 20, + 46 + ], + "weighted_loads": [ + 4.279000581242144, + 0.8290632367134094, + 0.7187560126185417, + 1.4924161974340677, + 2.4866108167916536, + 1.8138125948607922, + 2.596146149560809, + 0.7840249743312597, + 1.6295365393161774, + 1.5755090191960335, + 4.0683845318853855, + 0.27459219098091125, + 0.4725377857685089, + 2.981990722939372, + 1.2053032107651234, + 2.3337894435971975, + 1.3174805622547865, + 0.09815102070569992, + 2.4445066936314106, + 5.355862874537706, + 2.915583025664091, + 1.6932396218180656, + 0.08121733739972115, + 2.1017268961295485, + 2.5525959748774767, + 0.9743149075657129, + 1.6222612764686346, + 0.9763540234416723, + 2.068504434078932, + 2.8498654179275036, + 1.5865510404109955, + 1.3262203000485897, + 2.3009333703666925, + 1.0925807170569897, + 0.6209968272596598, + 1.3970799017697573, + 0.4254286400973797, + 2.143079899251461, + 1.6816351916640997, + 1.4543771222233772, + 0.03443785756826401, + 2.053687324747443, + 0.9642231799662113, + 0.04618395119905472, + 1.9056817796081305, + 1.0663609616458416, + 4.616253484040499, + 2.7223126851022243, + 2.127565672621131, + 2.195750568062067, + 1.1378461048007011, + 1.141487100161612, + 2.352469488978386, + 0.9951324388384819, + 2.6548178046941757, + 0.9567484110593796, + 2.9216677099466324, + 1.7370630204677582, + 0.5288876164704561, + 2.95309070404619, + 0.5638427082449198, + 0.9486669655889273, + 1.5790348760783672, + 2.273425931110978 + ], + "unique_experts": 64, + "load_cv": 0.5335032225459744, + "normalized_load_entropy": 0.9639245534144171, + "max_load_share": 0.04936120789779326 + } + }, + "s0_x": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "fd3b040475173a179b08f5382cd69ca80f00ac7c0826e9f6ebc159e575809855", + "route_weight_sha256": "8c68241800ed130ffb3d87b23a783b45bb015a345d479c0a76430d5f5627a509", + "loads": [ + 30, + 15, + 15, + 26, + 29, + 13, + 38, + 19, + 25, + 8, + 80, + 2, + 2, + 41, + 32, + 34, + 20, + 0, + 43, + 37, + 36, + 27, + 4, + 34, + 32, + 21, + 13, + 14, + 10, + 46, + 25, + 32, + 22, + 2, + 12, + 26, + 13, + 31, + 21, + 25, + 1, + 35, + 15, + 0, + 42, + 22, + 33, + 27, + 23, + 22, + 6, + 15, + 24, + 6, + 43, + 8, + 29, + 33, + 10, + 34, + 9, + 18, + 19, + 47 + ], + "weighted_loads": [ + 3.186676450073719, + 0.6924288757145405, + 0.6661343816667795, + 1.2566174902021885, + 2.264228317886591, + 0.7288703173398972, + 2.8749321438372135, + 0.806882357224822, + 1.509728416800499, + 0.3895824607461691, + 3.8646925054490566, + 0.09181397780776024, + 0.08647884055972099, + 3.11586113832891, + 1.2181322406977415, + 1.7300270199775696, + 1.3129171840846539, + 0.0, + 2.103145319968462, + 5.171692943200469, + 2.7919782549142838, + 1.544029377400875, + 0.1273274440318346, + 1.4973379904404283, + 2.356672689318657, + 0.8895730320364237, + 1.1734837219119072, + 0.5649344250559807, + 0.4128224849700928, + 2.758392993360758, + 1.307783167809248, + 1.230449303984642, + 2.1910910978913307, + 0.080886235460639, + 0.5858452431857586, + 1.4156090635806322, + 0.4814849328249693, + 1.8417405001819134, + 1.4550725799053907, + 1.4363058619201183, + 0.03365802764892578, + 2.0603595841675997, + 0.9047966189682484, + 0.0, + 1.9079737812280655, + 1.025961197912693, + 4.3627572152763605, + 2.670039627701044, + 1.9022622406482697, + 2.0075283516198397, + 0.2021906729787588, + 0.653160790912807, + 1.5209365673363209, + 0.37514679320156574, + 2.596007699146867, + 0.5149541944265366, + 2.8446815088391304, + 1.7281533610075712, + 0.4131633844226599, + 1.935580151155591, + 0.3774316646158695, + 0.8319487608969212, + 1.5065991543233395, + 2.3660518806427717 + ], + "unique_experts": 62, + "load_cv": 0.6238892054009979, + "normalized_load_entropy": 0.9489980306704169, + "max_load_share": 0.05420054200542006 + }, + "full_input": { + "tokens": 271, + "top_k": 6, + "decisions": 1626, + "ordered_route_sha256": "92a4813e1dcbae71c1530993a539a69a92589262e9bde349b71645457f0ee97c", + "route_weight_sha256": "766fae6a63e4e67122c2cf3edf8f172dc192aeb4e1c46788f1a3ab7bc85d5b68", + "loads": [ + 37, + 15, + 15, + 27, + 29, + 25, + 38, + 20, + 25, + 16, + 82, + 5, + 2, + 42, + 32, + 39, + 20, + 0, + 46, + 39, + 36, + 27, + 4, + 44, + 34, + 23, + 21, + 19, + 18, + 46, + 28, + 36, + 22, + 9, + 12, + 26, + 14, + 33, + 23, + 25, + 1, + 35, + 16, + 1, + 44, + 22, + 38, + 29, + 23, + 24, + 9, + 19, + 30, + 13, + 43, + 12, + 29, + 34, + 10, + 47, + 9, + 18, + 19, + 47 + ], + "weighted_loads": [ + 3.945332696661353, + 0.6924288757145405, + 0.6661343816667795, + 1.2968248426914215, + 2.264228317886591, + 1.7901800870895386, + 2.8749321438372135, + 0.8404583465307951, + 1.509728416800499, + 0.955972334370017, + 3.931559968739748, + 0.2831661216914654, + 0.08647884055972099, + 3.1770351249724627, + 1.2181322406977415, + 2.0426787547767162, + 1.3129171840846539, + 0.0, + 2.3788109980523586, + 5.28532918728888, + 2.7919782549142838, + 1.544029377400875, + 0.1273274440318346, + 1.9360877620056272, + 2.419141346588731, + 0.9553614314645529, + 1.656822269782424, + 0.9643389079719782, + 1.3597779646515846, + 2.758392993360758, + 1.5046884790062904, + 1.4270383231341839, + 2.1910910978913307, + 0.6272683832794428, + 0.5858452431857586, + 1.4156090635806322, + 0.5349552985280752, + 1.9572906196117401, + 1.556174771860242, + 1.4363058619201183, + 0.03365802764892578, + 2.0603595841675997, + 0.9522900842130184, + 0.048626597970724106, + 1.975487221032381, + 1.025961197912693, + 4.6444452702999115, + 2.7563555277884007, + 1.9022622406482697, + 2.074436403810978, + 0.3308450784534216, + 1.0997181655839086, + 2.268071372061968, + 0.8937006201595068, + 2.596007699146867, + 0.8391108363866806, + 2.8446815088391304, + 1.7683186624199152, + 0.4131633844226599, + 2.5298203360289335, + 0.3774316646158695, + 0.8319487608969212, + 1.5065991543233395, + 2.3660518806427717 + ], + "unique_experts": 63, + "load_cv": 0.5698223647928173, + "normalized_load_entropy": 0.9578008334190258, + "max_load_share": 0.05043050430504305 + } + }, + "s1_x": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "18ab73f4ceb8f4be66d122c2b50e282a45f0635431c65be26df01ff567ad9871", + "route_weight_sha256": "e87bdec621d0bbea198ff0c9d403f350843cfab5a4f5bb59358c8c752c7740df", + "loads": [ + 32, + 21, + 17, + 28, + 29, + 15, + 35, + 12, + 28, + 15, + 89, + 2, + 2, + 41, + 31, + 37, + 20, + 3, + 37, + 37, + 34, + 28, + 3, + 33, + 32, + 22, + 14, + 13, + 9, + 46, + 26, + 25, + 23, + 2, + 13, + 24, + 12, + 32, + 22, + 25, + 1, + 35, + 15, + 0, + 40, + 18, + 32, + 28, + 26, + 24, + 6, + 14, + 23, + 5, + 43, + 9, + 30, + 32, + 10, + 29, + 7, + 19, + 19, + 42 + ], + "weighted_loads": [ + 3.3567726444453, + 0.8724223021417856, + 0.7406471408903599, + 1.332780933007598, + 2.2850936464965343, + 0.8476026300340891, + 2.7366008404642344, + 0.5479358825832605, + 1.6331110578030348, + 0.6765244770795107, + 4.300598597154021, + 0.07806766778230667, + 0.08522943779826164, + 3.0397985093295574, + 1.1717156432569027, + 1.9617016296833754, + 1.2709072194993496, + 0.07348052598536015, + 1.8472991529852152, + 5.181381735950708, + 2.7151195406913757, + 1.604130381718278, + 0.08152562566101551, + 1.4811909552663565, + 2.4115854930132627, + 0.9645251967012882, + 1.2841770444065332, + 0.5381245668977499, + 0.397781053557992, + 2.8390419092029333, + 1.3916035331785679, + 0.9902544356882572, + 2.199123755097389, + 0.10849647596478462, + 0.6166988965123892, + 1.331477403640747, + 0.42592405900359154, + 1.828784964978695, + 1.4766716603189707, + 1.4197600055485964, + 0.03401215001940727, + 2.0833754520863295, + 0.8789542093873024, + 0.0, + 1.854748586192727, + 0.8876571096479893, + 4.324004404246807, + 2.63060100376606, + 1.9860677290707827, + 2.157667489722371, + 0.22537576779723167, + 0.6019776994362473, + 1.4940671548247337, + 0.3359652981162071, + 2.632697993889451, + 0.5485815331339836, + 2.9179640151560307, + 1.6602063030004501, + 0.4048377312719822, + 1.8404740560799837, + 0.31287611089646816, + 0.8563297688961029, + 1.5249675177037716, + 2.1085145864635706 + ], + "unique_experts": 63, + "load_cv": 0.6307729979570397, + "normalized_load_entropy": 0.950227560154195, + "max_load_share": 0.06029810298102981 + }, + "full_input": { + "tokens": 287, + "top_k": 6, + "decisions": 1722, + "ordered_route_sha256": "7578289ac7eb628df5c3b116dbf52d00a724448200a4b30fb7a2c16b14360647", + "route_weight_sha256": "6da796ce03a3b08385cb47920ad8f20402ab3625f436ba28aa391b1b830de613", + "loads": [ + 41, + 22, + 17, + 30, + 34, + 34, + 35, + 15, + 30, + 25, + 89, + 6, + 8, + 41, + 31, + 42, + 20, + 3, + 43, + 41, + 36, + 31, + 3, + 43, + 37, + 24, + 20, + 20, + 21, + 47, + 32, + 27, + 25, + 13, + 14, + 25, + 13, + 36, + 25, + 26, + 1, + 35, + 17, + 1, + 42, + 18, + 38, + 30, + 28, + 25, + 20, + 16, + 31, + 15, + 45, + 13, + 31, + 34, + 11, + 49, + 10, + 21, + 21, + 45 + ], + "weighted_loads": [ + 4.216542338952422, + 0.9220341052860022, + 0.7406471408903599, + 1.4074271824210882, + 2.56245388276875, + 2.2046898435801268, + 2.7366008404642344, + 0.6737892311066389, + 1.802059842273593, + 1.463436933234334, + 4.300598597154021, + 0.3372800126671791, + 0.47498852759599686, + 3.0397985093295574, + 1.1717156432569027, + 2.274860067293048, + 1.2709072194993496, + 0.07348052598536015, + 2.2662514988332987, + 5.380396761000156, + 2.943510953336954, + 1.707557324320078, + 0.08152562566101551, + 1.9102157205343246, + 2.6570382155478, + 1.0410712398588657, + 1.7390025313943624, + 0.8314428552985191, + 1.6910877209156752, + 2.887342570349574, + 1.6742545291781425, + 1.0701078176498413, + 2.277690913528204, + 1.101350113749504, + 0.6656411495059729, + 1.4105603247880936, + 0.46288180723786354, + 2.2821491435170174, + 1.6638279389590025, + 1.4773595128208399, + 0.03401215001940727, + 2.0833754520863295, + 0.985807329416275, + 0.04618395119905472, + 1.9230640698224306, + 0.8876571096479893, + 4.656461548060179, + 2.6992855314165354, + 2.1157647762447596, + 2.190346969291568, + 1.1240902841091156, + 0.9934067288413644, + 2.291087556630373, + 1.1391253732144833, + 2.7157747205346823, + 0.8428081162273884, + 2.9714104048907757, + 1.7504244856536388, + 0.5139631070196629, + 2.9405152294784784, + 0.5632095988839865, + 0.9300966039299965, + 1.626557782292366, + 2.215974574908614 + ], + "unique_experts": 64, + "load_cv": 0.536930921308553, + "normalized_load_entropy": 0.9638136059376197, + "max_load_share": 0.05168408826945412 + } + }, + "s0_period": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "d86645b6d4b212b2d0194db89edf1cfd24842c71ef0e6989d4adb52c3058539a", + "route_weight_sha256": "5924214616e2fe74df6790e5999cea452dd0cd46de9c410c8355c449d9359cac", + "loads": [ + 30, + 18, + 16, + 27, + 29, + 13, + 37, + 22, + 28, + 9, + 79, + 2, + 2, + 41, + 34, + 34, + 20, + 1, + 43, + 37, + 36, + 29, + 4, + 35, + 32, + 20, + 14, + 15, + 9, + 44, + 26, + 28, + 22, + 1, + 12, + 25, + 13, + 30, + 21, + 26, + 1, + 35, + 15, + 0, + 39, + 22, + 32, + 27, + 22, + 20, + 6, + 15, + 24, + 6, + 43, + 8, + 30, + 31, + 11, + 32, + 7, + 20, + 19, + 47 + ], + "weighted_loads": [ + 3.2481595054268837, + 0.7937650866806507, + 0.6957733836025, + 1.2713193893432617, + 2.2774648629128933, + 0.7124034464359283, + 2.7928451411426067, + 0.9015625733882189, + 1.6074577029794455, + 0.44925015792250633, + 3.8451931830495596, + 0.09572352841496468, + 0.08687860891222954, + 3.1438133381307125, + 1.2849524226039648, + 1.7703830357640982, + 1.3074599206447601, + 0.027617894113063812, + 2.1365371719002724, + 5.16153459995985, + 2.7664330769330263, + 1.6330171003937721, + 0.1310807280242443, + 1.547372448258102, + 2.3520977180451155, + 0.8675885051488876, + 1.2419839948415756, + 0.6019764821976423, + 0.3774525821208954, + 2.707600310444832, + 1.3624359853565693, + 1.0959413331001997, + 2.180683771148324, + 0.05241874232888222, + 0.5830423161387444, + 1.388790663331747, + 0.4819703456014395, + 1.8018803875893354, + 1.4609165024012327, + 1.4810202047228813, + 0.03539443388581276, + 2.050864914432168, + 0.9103834517300129, + 0.0, + 1.7989987414330244, + 1.0382662527263165, + 4.31849249266088, + 2.645314108580351, + 1.8658387456089258, + 1.984024913981557, + 0.2054451834410429, + 0.6596983661875129, + 1.5137630887329578, + 0.3836354222148657, + 2.6479891147464514, + 0.5127514079213142, + 2.959172200411558, + 1.653130415827036, + 0.4499374497681856, + 1.9748597498983145, + 0.31809167191386223, + 0.9135354924947023, + 1.509901225566864, + 2.3333174381405115 + ], + "unique_experts": 63, + "load_cv": 0.6132510498966931, + "normalized_load_entropy": 0.9503609480898485, + "max_load_share": 0.0535230352303523 + }, + "full_input": { + "tokens": 271, + "top_k": 6, + "decisions": 1626, + "ordered_route_sha256": "aa06efe659b20988c90c8dbd5923c7e16288814288276586694029107740a338", + "route_weight_sha256": "0e4a77adac238de4e74ed582f69931d3b94820526de945fc13610a0ec23f2c2c", + "loads": [ + 37, + 18, + 16, + 28, + 29, + 24, + 37, + 24, + 28, + 17, + 81, + 5, + 2, + 42, + 34, + 39, + 20, + 1, + 47, + 38, + 36, + 29, + 4, + 45, + 34, + 23, + 21, + 21, + 17, + 44, + 29, + 32, + 22, + 8, + 12, + 25, + 15, + 32, + 22, + 26, + 1, + 35, + 15, + 1, + 41, + 22, + 36, + 30, + 22, + 23, + 10, + 19, + 30, + 13, + 43, + 12, + 30, + 32, + 11, + 43, + 7, + 20, + 19, + 47 + ], + "weighted_loads": [ + 3.9480593372136354, + 0.7937650866806507, + 0.6957733836025, + 1.3115267418324947, + 2.2774648629128933, + 1.7074111886322498, + 2.7928451411426067, + 0.9744181465357542, + 1.6074577029794455, + 1.0372784323990345, + 3.912060646340251, + 0.2870756722986698, + 0.08687860891222954, + 3.1955489963293076, + 1.2849524226039648, + 2.100576439872384, + 1.3074599206447601, + 0.027617894113063812, + 2.472950242459774, + 5.201467607170343, + 2.7664330769330263, + 1.6330171003937721, + 0.1310807280242443, + 1.9861222198233008, + 2.42484749853611, + 0.9688475523144007, + 1.6386953368782997, + 1.0340151265263557, + 1.4387421384453773, + 2.707600310444832, + 1.5590300001204014, + 1.2873005252331495, + 2.180683771148324, + 0.596835546195507, + 0.5830423161387444, + 1.388790663331747, + 0.5792332831770182, + 1.902163753286004, + 1.5197249669581652, + 1.4810202047228813, + 0.03539443388581276, + 2.050864914432168, + 0.9103834517300129, + 0.048626597970724106, + 1.86651218123734, + 1.0382662527263165, + 4.5414950884878635, + 2.801142919808626, + 1.8658387456089258, + 2.098030649125576, + 0.3769721370190382, + 1.1008907230570912, + 2.260897893458605, + 0.8989336285740137, + 2.6479891147464514, + 0.9134616032242775, + 2.959172200411558, + 1.6914010867476463, + 0.4499374497681856, + 2.471357671543956, + 0.31809167191386223, + 0.9135354924947023, + 1.509901225566864, + 2.3333174381405115 + ], + "unique_experts": 64, + "load_cv": 0.5558879981600869, + "normalized_load_entropy": 0.9597264832340371, + "max_load_share": 0.04981549815498155 + } + }, + "s1_period": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "faae94f22b1dee5f08f2c30d2dfeb8571751db34ef6fe43a2b8f070058282912", + "route_weight_sha256": "e9b0efc3b4641312a609561334e1a9da9740f2d0f6bc887c4688f176b4270091", + "loads": [ + 31, + 21, + 15, + 24, + 29, + 14, + 33, + 12, + 25, + 16, + 90, + 2, + 2, + 41, + 33, + 38, + 21, + 3, + 37, + 38, + 33, + 30, + 4, + 34, + 33, + 24, + 14, + 14, + 8, + 46, + 26, + 28, + 23, + 2, + 13, + 24, + 12, + 30, + 22, + 23, + 1, + 35, + 16, + 0, + 42, + 23, + 31, + 27, + 25, + 25, + 6, + 15, + 21, + 6, + 42, + 7, + 30, + 33, + 8, + 29, + 8, + 20, + 18, + 40 + ], + "weighted_loads": [ + 3.2844633664935827, + 0.882989214733243, + 0.683680884540081, + 1.2071046885102987, + 2.291293703019619, + 0.7800739351660013, + 2.639316702261567, + 0.5514189582318068, + 1.5390623323619366, + 0.7086934316903353, + 4.334625789895654, + 0.09609811380505562, + 0.08419262990355492, + 3.0729431994259357, + 1.2458581514656544, + 2.0373860895633698, + 1.3129459712654352, + 0.0766416173428297, + 1.8591590747237206, + 5.188592992722988, + 2.6800128258764744, + 1.674820950254798, + 0.1297457478940487, + 1.4883822742849588, + 2.4304482378065586, + 1.0330224204808474, + 1.3239165730774403, + 0.5696767717599869, + 0.3444648142904043, + 2.847003472968936, + 1.4283200800418854, + 1.082317290827632, + 2.2001314274966717, + 0.101264089345932, + 0.605532880872488, + 1.3318339511752129, + 0.42402837984263897, + 1.7663649544119835, + 1.4747726414352655, + 1.3594860434532166, + 0.03360734507441521, + 2.0598360542207956, + 0.9142159130424261, + 0.0, + 1.9007727829739451, + 1.0258810464292765, + 4.290610104799271, + 2.5820538215339184, + 1.936991399154067, + 2.2028331384062767, + 0.21300875023007393, + 0.6259354772046208, + 1.4415040016174316, + 0.36496029421687126, + 2.6346642673015594, + 0.47511355578899384, + 2.9473439007997513, + 1.6811276134103537, + 0.319670706987381, + 1.7774471156299114, + 0.33914136327803135, + 0.8919818885624409, + 1.4808860290795565, + 2.0320481210947037 + ], + "unique_experts": 63, + "load_cv": 0.6330045542926572, + "normalized_load_entropy": 0.9502050770562612, + "max_load_share": 0.06097560975609756 + }, + "full_input": { + "tokens": 287, + "top_k": 6, + "decisions": 1722, + "ordered_route_sha256": "257231ef8de0f38a2f793e897a1e1c3104c1d017d84fce71e854da8514eb9fb4", + "route_weight_sha256": "a4956087f9d7d4b708579addf7a04a12122b1debf2f99aaa20993ed5477d2b69", + "loads": [ + 40, + 22, + 15, + 26, + 34, + 31, + 33, + 15, + 27, + 28, + 90, + 5, + 8, + 41, + 33, + 43, + 21, + 3, + 43, + 42, + 35, + 33, + 4, + 43, + 40, + 26, + 20, + 20, + 21, + 47, + 34, + 31, + 25, + 13, + 14, + 25, + 12, + 34, + 25, + 24, + 1, + 35, + 17, + 1, + 44, + 23, + 36, + 30, + 27, + 27, + 20, + 17, + 29, + 16, + 44, + 11, + 31, + 35, + 9, + 48, + 11, + 21, + 20, + 43 + ], + "weighted_loads": [ + 4.123602943494916, + 0.9326010178774595, + 0.683680884540081, + 1.281056011095643, + 2.565805045887828, + 1.9606139790266752, + 2.639316702261567, + 0.6772723067551851, + 1.7080111168324947, + 1.5956493150442839, + 4.334625789895654, + 0.30652185156941414, + 0.47395171970129013, + 3.0729431994259357, + 1.2458581514656544, + 2.343609057366848, + 1.3129459712654352, + 0.0766416173428297, + 2.287011966109276, + 5.387608017772436, + 2.9084042385220528, + 1.778247892856598, + 0.1297457478940487, + 1.8639062941074371, + 2.7820132840424776, + 1.1090583894401789, + 1.7156170718371868, + 0.8197042625397444, + 1.649519531056285, + 2.8953041341155767, + 1.7882325388491154, + 1.1977387759834528, + 2.2786985859274864, + 1.094061192125082, + 0.6544751338660717, + 1.4109168723225594, + 0.42402837984263897, + 2.214935004711151, + 1.661477541550994, + 1.41708555072546, + 0.03360734507441521, + 2.0598360542207956, + 0.9659526776522398, + 0.04618395119905472, + 1.9690882666036487, + 1.0258810464292765, + 4.5846965834498405, + 2.689672200009227, + 2.066688446328044, + 2.2753075398504734, + 1.1214439198374748, + 1.0191055992618203, + 2.238524403423071, + 1.1239031180739403, + 2.7177409939467907, + 0.8488756977021694, + 3.0007902905344963, + 1.7686002869158983, + 0.42879608273506165, + 2.827321395277977, + 0.5894748512655497, + 0.933334868401289, + 1.582476293668151, + 2.1395081095397472 + ], + "unique_experts": 64, + "load_cv": 0.5390971974410033, + "normalized_load_entropy": 0.9635749506556911, + "max_load_share": 0.05226480836236934 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 246, + "ordered_topk_exact_tokens": 151, + "set_exact_tokens": 185, + "mean_set_jaccard": 0.9256678281068526, + "mean_token_weighted_tv": 0.01451355093007347, + "aggregate_load_tv": 0.02303523035230353 + }, + "system_bos": { + "tokens": 246, + "ordered_topk_exact_tokens": 143, + "set_exact_tokens": 182, + "mean_set_jaccard": 0.9223770809136661, + "mean_token_weighted_tv": 0.01671589767499789, + "aggregate_load_tv": 0.023712737127371274 + }, + "system_x": { + "tokens": 246, + "ordered_topk_exact_tokens": 121, + "set_exact_tokens": 154, + "mean_set_jaccard": 0.8843399148277196, + "mean_token_weighted_tv": 0.024524029448431562, + "aggregate_load_tv": 0.037940379403794036 + }, + "system_period": { + "tokens": 246, + "ordered_topk_exact_tokens": 109, + "set_exact_tokens": 150, + "mean_set_jaccard": 0.8772568894520112, + "mean_token_weighted_tv": 0.02470166208903964, + "aggregate_load_tv": 0.03997289972899728 + }, + "bos_at_s0": { + "tokens": 246, + "ordered_topk_exact_tokens": 134, + "set_exact_tokens": 167, + "mean_set_jaccard": 0.903019744483159, + "mean_token_weighted_tv": 0.019392975155506434, + "aggregate_load_tv": 0.02506775067750678 + }, + "bos_at_s1": { + "tokens": 246, + "ordered_topk_exact_tokens": 134, + "set_exact_tokens": 163, + "mean_set_jaccard": 0.895954316686024, + "mean_token_weighted_tv": 0.021354053720332136, + "aggregate_load_tv": 0.027777777777777776 + }, + "x_at_s0": { + "tokens": 246, + "ordered_topk_exact_tokens": 108, + "set_exact_tokens": 148, + "mean_set_jaccard": 0.8820170344560588, + "mean_token_weighted_tv": 0.025354927189920735, + "aggregate_load_tv": 0.02981029810298103 + }, + "x_at_s1": { + "tokens": 246, + "ordered_topk_exact_tokens": 108, + "set_exact_tokens": 143, + "mean_set_jaccard": 0.8663375919473479, + "mean_token_weighted_tv": 0.02813825801741786, + "aggregate_load_tv": 0.03523035230352303 + }, + "period_at_s0": { + "tokens": 246, + "ordered_topk_exact_tokens": 120, + "set_exact_tokens": 155, + "mean_set_jaccard": 0.8899535423925669, + "mean_token_weighted_tv": 0.023785776810765994, + "aggregate_load_tv": 0.029810298102981032 + }, + "period_at_s1": { + "tokens": 246, + "ordered_topk_exact_tokens": 109, + "set_exact_tokens": 144, + "mean_set_jaccard": 0.865079365079365, + "mean_token_weighted_tv": 0.028098756888487595, + "aggregate_load_tv": 0.03590785907859078 + } + } + }, + "layer_15": { + "layer": 15, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "93e620153679cd13aa82c5d0e587ece7efed395c3ec2381e817e20301a5be8f0", + "route_weight_sha256": "cff000d1a1b2ae61d0c7f0572eacff55ec495fb5c5eb45bb396072facfbb73ab", + "loads": [ + 13, + 22, + 41, + 1, + 7, + 12, + 19, + 20, + 3, + 4, + 19, + 29, + 28, + 25, + 10, + 9, + 13, + 30, + 15, + 34, + 25, + 33, + 14, + 41, + 45, + 43, + 40, + 46, + 29, + 3, + 28, + 27, + 5, + 41, + 26, + 21, + 18, + 19, + 13, + 36, + 20, + 33, + 22, + 27, + 9, + 13, + 23, + 27, + 17, + 17, + 28, + 20, + 23, + 24, + 67, + 19, + 39, + 21, + 22, + 0, + 36, + 18, + 30, + 14 + ], + "weighted_loads": [ + 0.5868231132626534, + 1.683977959677577, + 3.7811937537044287, + 0.0373225063085556, + 0.33209504559636116, + 0.5700367800891399, + 0.9137592855840921, + 0.7733672689646482, + 0.10067340917885303, + 0.1997641595080495, + 1.6564030945301056, + 2.9190659895539284, + 1.5186217799782753, + 1.2745305076241493, + 0.36769478768110275, + 0.3210269771516323, + 0.6769376900047064, + 1.1935807168483734, + 0.5708103459328413, + 2.0629333909600973, + 1.1329645700752735, + 1.79740821570158, + 0.7469856664538383, + 3.8882011342793703, + 3.473368378356099, + 3.8098379485309124, + 6.753868330270052, + 3.5032370314002037, + 1.3541635759174824, + 0.09896140545606613, + 1.1346392519772053, + 1.2720052506774664, + 0.21414391696453094, + 2.2418515030294657, + 1.6555740423500538, + 0.7430380471050739, + 1.0472819153219461, + 1.4671410396695137, + 0.4650704152882099, + 1.8394517730921507, + 0.9686423046514392, + 1.628545930609107, + 1.2286037653684616, + 2.023323144763708, + 0.5475479401648045, + 0.8002104163169861, + 1.7763720285147429, + 4.163429850712419, + 0.621280075982213, + 2.105294916778803, + 1.658415725454688, + 0.7751556988805532, + 1.7919912543147802, + 0.9609518740326166, + 3.098357416689396, + 0.9814612548798323, + 1.9968040492385626, + 1.5346934963017702, + 1.8999069072306156, + 0.0, + 1.7892645429819822, + 1.0339738503098488, + 1.803788859397173, + 0.5469441693276167 + ], + "unique_experts": 63, + "load_cv": 0.5452948959973285, + "normalized_load_entropy": 0.9613865858434334, + "max_load_share": 0.04539295392953929 + }, + "full_input": { + "tokens": 271, + "top_k": 6, + "decisions": 1626, + "ordered_route_sha256": "1ca35e8becda9800f2edaa06db829150cd35716f19f691a7f234b45fe3874ed1", + "route_weight_sha256": "e2739e7b7a6b81276f75d59eb118618885a256e47db899284f961e6c696ee954", + "loads": [ + 17, + 22, + 41, + 1, + 13, + 15, + 27, + 23, + 10, + 5, + 24, + 30, + 33, + 25, + 20, + 10, + 20, + 33, + 15, + 36, + 25, + 33, + 14, + 46, + 49, + 44, + 50, + 46, + 32, + 3, + 31, + 27, + 10, + 43, + 26, + 21, + 23, + 19, + 13, + 36, + 26, + 35, + 22, + 29, + 9, + 13, + 23, + 28, + 18, + 26, + 34, + 22, + 29, + 24, + 67, + 23, + 39, + 21, + 23, + 1, + 36, + 20, + 30, + 17 + ], + "weighted_loads": [ + 0.8477893769741058, + 1.683977959677577, + 3.7811937537044287, + 0.0373225063085556, + 0.6811978295445442, + 0.6489790920168161, + 1.5666306782513857, + 0.8688237108290195, + 0.5634286049753428, + 0.23126781824976206, + 1.8505642283707857, + 2.9492375552654266, + 1.9450958594679832, + 1.2745305076241493, + 0.7387222070246935, + 0.35248031467199326, + 1.3038118500262499, + 1.300035560503602, + 0.5708103459328413, + 2.17520041577518, + 1.1329645700752735, + 1.79740821570158, + 0.7469856664538383, + 4.158109424635768, + 3.5754140373319387, + 3.8383418023586273, + 7.414701376110315, + 3.5032370314002037, + 1.470211647450924, + 0.09896140545606613, + 1.2789474315941334, + 1.2720052506774664, + 0.6121259182691574, + 2.339797319844365, + 1.6555740423500538, + 0.7430380471050739, + 1.7979886401444674, + 1.4671410396695137, + 0.4650704152882099, + 1.8394517730921507, + 1.323576393770054, + 1.6668666331097484, + 1.2286037653684616, + 2.1054585948586464, + 0.5475479401648045, + 0.8002104163169861, + 1.7763720285147429, + 4.197804072871804, + 0.6347941001877189, + 2.959574621170759, + 2.103142475709319, + 0.8650863151997328, + 1.9703554259613156, + 0.9609518740326166, + 3.098357416689396, + 2.6519281398504972, + 1.9968040492385626, + 1.5346934963017702, + 1.9490220174193382, + 0.02886790782213211, + 1.7892645429819822, + 1.1123128570616245, + 1.803788859397173, + 0.6918448936194181 + ], + "unique_experts": 64, + "load_cv": 0.4916465484495955, + "normalized_load_entropy": 0.9687121346351701, + "max_load_share": 0.04120541205412054 + } + }, + "s1_eos": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "c937f56dff169a397809734a5f0b73bee8152870db30ab8793f85e539213b895", + "route_weight_sha256": "9375a4c270c0dd06c47c8142731d179248d6417d8b8c25dc9ecc6b09f7ad3b9e", + "loads": [ + 13, + 19, + 42, + 1, + 7, + 14, + 20, + 20, + 3, + 4, + 19, + 27, + 27, + 25, + 10, + 7, + 13, + 30, + 14, + 34, + 22, + 34, + 14, + 44, + 46, + 43, + 40, + 46, + 27, + 3, + 28, + 27, + 5, + 41, + 26, + 21, + 20, + 21, + 13, + 36, + 20, + 32, + 22, + 28, + 10, + 14, + 24, + 28, + 15, + 18, + 30, + 19, + 23, + 23, + 70, + 20, + 38, + 21, + 21, + 0, + 31, + 20, + 30, + 13 + ], + "weighted_loads": [ + 0.6004103161394596, + 1.6375881414860487, + 3.8515618443489075, + 0.03836759924888611, + 0.34153759479522705, + 0.6410967390984297, + 0.9314801376312971, + 0.7679676562547684, + 0.08967987075448036, + 0.20771789737045765, + 1.6809910163283348, + 2.8483772333711386, + 1.4887383319437504, + 1.2814859431236982, + 0.3927047196775675, + 0.2580506391823292, + 0.7026701588183641, + 1.213347777724266, + 0.5335359591990709, + 2.0870135501027107, + 1.024878617376089, + 1.8469766806811094, + 0.745018731802702, + 4.046647649258375, + 3.5090059973299503, + 3.7863498758524656, + 6.775297304615378, + 3.502388495951891, + 1.2946940548717976, + 0.10035233944654465, + 1.1173336058855057, + 1.253066960722208, + 0.20710186287760735, + 2.272747593000531, + 1.663227977231145, + 0.7183450702577829, + 1.1054863557219505, + 1.5203665476292372, + 0.43703149631619453, + 1.8562461286783218, + 0.9965241402387619, + 1.5689732264727354, + 1.223019514232874, + 2.0404621567577124, + 0.5768226999789476, + 0.826148135587573, + 1.8040321823209524, + 4.15003746189177, + 0.5559071600437164, + 2.1352813318371773, + 1.7064268104732037, + 0.746231259778142, + 1.765167061239481, + 0.90003377571702, + 3.2909334395080805, + 1.0166376736015081, + 1.9728062264621258, + 1.5352413468062878, + 1.9021745473146439, + 0.0, + 1.6162980683147907, + 1.0530544836074114, + 1.821728814393282, + 0.5204460173845291 + ], + "unique_experts": 63, + "load_cv": 0.55390063512113, + "normalized_load_entropy": 0.9607302152986406, + "max_load_share": 0.04742547425474255 + }, + "full_input": { + "tokens": 287, + "top_k": 6, + "decisions": 1722, + "ordered_route_sha256": "5a132be2ebc8369e132614f3de7a8c5a14b86bf6196ce94c9cc4d8d519abf47f", + "route_weight_sha256": "c98427bec6c6ff7d990d5fcb7d6edf3709e394239d87d2f121ddf1b250194a3a", + "loads": [ + 33, + 20, + 42, + 1, + 15, + 19, + 34, + 21, + 14, + 5, + 24, + 31, + 33, + 26, + 15, + 17, + 25, + 35, + 15, + 37, + 23, + 35, + 14, + 49, + 47, + 44, + 50, + 48, + 35, + 4, + 34, + 31, + 10, + 43, + 28, + 21, + 27, + 21, + 14, + 37, + 27, + 35, + 22, + 30, + 10, + 15, + 24, + 29, + 18, + 31, + 39, + 22, + 25, + 24, + 70, + 24, + 38, + 27, + 23, + 4, + 31, + 27, + 32, + 18 + ], + "weighted_loads": [ + 1.9830487258732319, + 1.6632995661348104, + 3.8515618443489075, + 0.03836759924888611, + 0.7816778942942619, + 0.8508959598839283, + 2.0878588408231735, + 0.8026335649192333, + 0.729163995012641, + 0.23876086808741093, + 1.902341566979885, + 3.1792181581258774, + 2.0350843872874975, + 1.3645309414714575, + 0.5727731632068753, + 0.9268704941496253, + 1.7914264220744371, + 1.407819401472807, + 0.5854320954531431, + 2.3115889206528664, + 1.054396077990532, + 1.9293888192623854, + 0.745018731802702, + 4.285298872739077, + 3.512658646563068, + 3.8148728236556053, + 7.492220273241401, + 3.6278594695031643, + 1.7823396176099777, + 0.1383727379143238, + 1.3396239075809717, + 1.6969998553395271, + 0.6090104691684246, + 2.3937569689005613, + 1.8124317433685064, + 0.7183450702577829, + 1.8368818648159504, + 1.5203665476292372, + 0.4710484631359577, + 1.892348289489746, + 1.3474481289740652, + 1.695875272154808, + 1.223019514232874, + 2.317041425034404, + 0.5768226999789476, + 0.8637526426464319, + 1.8040321823209524, + 4.184235079213977, + 0.6960265310481191, + 3.7958926148712635, + 2.2268429417163134, + 0.8471880871802568, + 1.8131934693083167, + 1.0340322144329548, + 3.2909334395080805, + 2.66656325571239, + 1.9728062264621258, + 2.1843714229762554, + 1.9828875213861465, + 0.17437300458550453, + 1.6162980683147907, + 1.4346723277121782, + 1.9382049888372421, + 0.7188085056841373 + ], + "unique_experts": 64, + "load_cv": 0.46353978498640225, + "normalized_load_entropy": 0.9723650699496135, + "max_load_share": 0.04065040650406504 + } + }, + "s0_bos": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "ddabad6e46a9c00303b8682ca57a09eb6239f2f87fb40d7616b17768b935d07b", + "route_weight_sha256": "ed26566a225efdf29acedb83e64e1447942e13d14a19134a019d7ee97688cb0d", + "loads": [ + 14, + 21, + 41, + 1, + 7, + 11, + 17, + 24, + 2, + 4, + 20, + 28, + 28, + 24, + 9, + 9, + 13, + 26, + 13, + 36, + 23, + 33, + 14, + 43, + 45, + 43, + 42, + 46, + 29, + 4, + 29, + 27, + 6, + 43, + 25, + 20, + 20, + 20, + 9, + 32, + 19, + 29, + 21, + 28, + 10, + 13, + 23, + 26, + 18, + 17, + 30, + 21, + 21, + 28, + 69, + 21, + 37, + 21, + 24, + 0, + 33, + 20, + 30, + 16 + ], + "weighted_loads": [ + 0.6011878792196512, + 1.6828366499394178, + 3.7477599196135998, + 0.035380419343709946, + 0.3306166771799326, + 0.5345175173133612, + 0.8318940550088882, + 0.8965325877070427, + 0.07309705205261707, + 0.19000333547592163, + 1.6766282692551613, + 2.8450778555125, + 1.5361693557351828, + 1.264362620189786, + 0.33227776177227497, + 0.32043516263365746, + 0.6775235738605261, + 1.0651167128235102, + 0.49758431874215603, + 2.177653795108199, + 1.0532979313284159, + 1.8083025570958853, + 0.7503229379653931, + 4.19121765717864, + 3.4372656382620335, + 3.8256304766982794, + 6.730523016303778, + 3.5658561941236258, + 1.3486852552741766, + 0.13351757638156414, + 1.1344585567712784, + 1.2347282469272614, + 0.2414885312318802, + 2.3903089370578527, + 1.6534052845090628, + 0.6588498931378126, + 1.1033267173916101, + 1.52634116448462, + 0.3383878022432327, + 1.7204885073006153, + 0.9433109005913138, + 1.5042621530592442, + 1.2165875136852264, + 2.049279546365142, + 0.5832935348153114, + 0.7965550608932972, + 1.7939776442945004, + 4.1246148236095905, + 0.6651477664709091, + 2.1447126381099224, + 1.7758690472692251, + 0.8259552344679832, + 1.7249799221754074, + 1.0836380906403065, + 3.2256832364946604, + 1.1115533281117678, + 1.9684269037097692, + 1.5414768755435944, + 1.9184846952557564, + 0.0, + 1.7005933746695518, + 1.1095561496913433, + 1.8366164062172174, + 0.6314660347998142 + ], + "unique_experts": 63, + "load_cv": 0.5506559008201946, + "normalized_load_entropy": 0.9609339825964728, + "max_load_share": 0.046747967479674794 + }, + "full_input": { + "tokens": 271, + "top_k": 6, + "decisions": 1626, + "ordered_route_sha256": "3d33de9d7fb833c6163182b81c1c04406ce4df138b862371f0a90dfebc7ed59c", + "route_weight_sha256": "852f70c92d0430053f472a2ae27d47c21d9c9bba1068f48a70eb64624385f5f6", + "loads": [ + 18, + 21, + 41, + 1, + 12, + 14, + 24, + 27, + 8, + 5, + 25, + 29, + 33, + 24, + 18, + 10, + 20, + 29, + 13, + 38, + 23, + 33, + 14, + 48, + 48, + 44, + 52, + 46, + 33, + 4, + 33, + 27, + 11, + 45, + 25, + 21, + 25, + 20, + 9, + 32, + 26, + 30, + 21, + 30, + 10, + 13, + 23, + 27, + 19, + 25, + 37, + 24, + 27, + 29, + 71, + 23, + 37, + 21, + 25, + 1, + 33, + 22, + 30, + 19 + ], + "weighted_loads": [ + 0.8573269043117762, + 1.6828366499394178, + 3.7477599196135998, + 0.035380419343709946, + 0.6093483362346888, + 0.6445118095725775, + 1.370202660560608, + 0.991989029571414, + 0.5105787497013807, + 0.2215069942176342, + 1.8707894030958414, + 2.875249421223998, + 1.9879464861005545, + 1.264362620189786, + 0.6932264976203442, + 0.3518885001540184, + 1.314259560778737, + 1.160213578492403, + 0.49758431874215603, + 2.2899208199232817, + 1.0532979313284159, + 1.8083025570958853, + 0.7503229379653931, + 4.461125947535038, + 3.5497414600104094, + 3.8541343305259943, + 7.391356062144041, + 3.5658561941236258, + 1.5321621540933847, + 0.13351757638156414, + 1.3391675129532814, + 1.2347282469272614, + 0.6394705325365067, + 2.488254753872752, + 1.6534052845090628, + 0.7550629060715437, + 1.8574439454823732, + 1.52634116448462, + 0.3383878022432327, + 1.7204885073006153, + 1.3973105726763606, + 1.5340291038155556, + 1.2165875136852264, + 2.13141499646008, + 0.5832935348153114, + 0.7965550608932972, + 1.7939776442945004, + 4.158989045768976, + 0.678661790676415, + 2.890337321907282, + 2.316133053973317, + 0.966728150844574, + 1.9033440938219428, + 1.143309373408556, + 3.3299884479492903, + 1.7562305349856615, + 1.9684269037097692, + 1.5414768755435944, + 1.967599805444479, + 0.02886790782213211, + 1.7005933746695518, + 1.187895156443119, + 1.8366164062172174, + 0.790454551577568 + ], + "unique_experts": 64, + "load_cv": 0.5043335425301466, + "normalized_load_entropy": 0.9676608716210029, + "max_load_share": 0.04366543665436654 + } + }, + "s1_bos": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "ac31150deadf28f1ff72755da73a5d8c3e60fc0f8abc0319bf16d518dd4c0c0f", + "route_weight_sha256": "364de8ba2a11ee281d328e113273521a01bcbb358370727ea9018062248bc0b3", + "loads": [ + 14, + 21, + 42, + 1, + 6, + 12, + 18, + 21, + 5, + 4, + 19, + 30, + 26, + 25, + 10, + 8, + 12, + 30, + 14, + 34, + 25, + 33, + 14, + 42, + 47, + 42, + 39, + 44, + 28, + 2, + 28, + 26, + 7, + 41, + 25, + 22, + 19, + 20, + 11, + 30, + 18, + 28, + 22, + 27, + 11, + 13, + 22, + 26, + 15, + 19, + 33, + 19, + 23, + 24, + 72, + 21, + 38, + 22, + 22, + 1, + 34, + 23, + 31, + 15 + ], + "weighted_loads": [ + 0.6493081245571375, + 1.7142533995211124, + 3.757273653522134, + 0.03683708608150482, + 0.2903345376253128, + 0.5578044522553682, + 0.88150604814291, + 0.7867357172071934, + 0.1729388479143381, + 0.20405522361397743, + 1.6489276066422462, + 2.8958230949938297, + 1.4546051379293203, + 1.3321530912071466, + 0.3664723392575979, + 0.2825140468776226, + 0.6737333983182907, + 1.2090121060609818, + 0.5251136217266321, + 2.1325637958943844, + 1.1325767543166876, + 1.8126629292964935, + 0.7581128552556038, + 4.075659299269319, + 3.4491511788219213, + 3.801845982670784, + 6.618543192744255, + 3.434450898319483, + 1.2920534722507, + 0.0679478868842125, + 1.1183861084282398, + 1.2175508849322796, + 0.2755905333906412, + 2.300993165001273, + 1.6456700544804335, + 0.7398595474660397, + 1.07430868037045, + 1.4970087129622698, + 0.3965953607112169, + 1.6380766853690147, + 0.9393017217516899, + 1.4519523810595274, + 1.2394396513700485, + 1.9854146111756563, + 0.6112886071205139, + 0.8110078051686287, + 1.7651192285120487, + 4.106079161167145, + 0.5678651500493288, + 2.177729833871126, + 1.9120787642896175, + 0.7388522811233997, + 1.7756447363644838, + 0.9261113740503788, + 3.402436526492238, + 1.1002118363976479, + 1.9884174298495054, + 1.5746681820601225, + 1.9323540944606066, + 0.02842804230749607, + 1.718237204477191, + 1.1774262860417366, + 1.8981770016252995, + 0.6081290263682604 + ], + "unique_experts": 64, + "load_cv": 0.5491065978760088, + "normalized_load_entropy": 0.9621796889594966, + "max_load_share": 0.04878048780487805 + }, + "full_input": { + "tokens": 287, + "top_k": 6, + "decisions": 1722, + "ordered_route_sha256": "5733aa00e1179a5011d3953733b302e552a693cf8602c6d0dee6351bdd862a1d", + "route_weight_sha256": "2488fef1cb2fa221b3b883baf93ca567955c92670d622fd63bdcd5a0ddef7f5f", + "loads": [ + 35, + 22, + 42, + 1, + 13, + 17, + 32, + 22, + 15, + 5, + 24, + 34, + 32, + 26, + 14, + 18, + 24, + 35, + 15, + 37, + 26, + 34, + 14, + 47, + 49, + 43, + 49, + 46, + 36, + 3, + 35, + 30, + 12, + 43, + 27, + 22, + 27, + 20, + 12, + 31, + 25, + 31, + 22, + 29, + 11, + 14, + 22, + 27, + 18, + 32, + 43, + 22, + 25, + 25, + 72, + 24, + 38, + 28, + 24, + 5, + 34, + 30, + 33, + 19 + ], + "weighted_loads": [ + 2.091043984517455, + 1.7399648241698742, + 3.757273653522134, + 0.03683708608150482, + 0.6246310397982597, + 0.7997299265116453, + 1.9584353547543287, + 0.8214016258716583, + 0.7602073028683662, + 0.2350981943309307, + 1.8702781572937965, + 3.2266640197485685, + 2.018968164920807, + 1.415198089554906, + 0.5349996909499168, + 0.9513339018449187, + 1.782409768551588, + 1.3967565149068832, + 0.5770097579807043, + 2.35713916644454, + 1.1620942149311304, + 1.8950750678777695, + 0.7581128552556038, + 4.31431052275002, + 3.5509128253906965, + 3.8303689304739237, + 7.335466161370277, + 3.559921871870756, + 1.7796990349888802, + 0.10596828535199165, + 1.3900528270751238, + 1.6614837795495987, + 0.6774991396814585, + 2.4220025409013033, + 1.794873820617795, + 0.7398595474660397, + 1.8575471807271242, + 1.4970087129622698, + 0.4306123275309801, + 1.674178846180439, + 1.4087289981544018, + 1.6052592601627111, + 1.2394396513700485, + 2.2619938794523478, + 0.6112886071205139, + 0.8486123122274876, + 1.7651192285120487, + 4.140276778489351, + 0.7079845210537314, + 3.793984994292259, + 2.478705642744899, + 0.8398091085255146, + 1.8236711444333196, + 1.0601098127663136, + 3.402436526492238, + 1.814406268298626, + 1.9884174298495054, + 2.22379825823009, + 2.0130670685321093, + 0.2028010468930006, + 1.718237204477191, + 1.5590441301465034, + 2.0146531760692596, + 0.7829067017883062 + ], + "unique_experts": 64, + "load_cv": 0.4656303368819702, + "normalized_load_entropy": 0.9722389354011594, + "max_load_share": 0.041811846689895474 + } + }, + "s0_x": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "ec0d555b601c0e2a4fa5fc5789d35f563df80d10bfa8a27be571849cf3ea45e6", + "route_weight_sha256": "544c226f80a3a4eaec66c44ee9e8aaf96d277cbf5e1547ef81a0d779ef70397d", + "loads": [ + 13, + 21, + 43, + 1, + 7, + 14, + 17, + 23, + 7, + 4, + 20, + 28, + 28, + 25, + 9, + 9, + 12, + 26, + 14, + 39, + 24, + 32, + 15, + 44, + 47, + 45, + 41, + 46, + 27, + 4, + 27, + 29, + 6, + 42, + 26, + 13, + 19, + 17, + 17, + 32, + 16, + 30, + 22, + 26, + 9, + 13, + 23, + 27, + 15, + 19, + 31, + 14, + 23, + 28, + 64, + 21, + 38, + 21, + 22, + 0, + 33, + 24, + 31, + 13 + ], + "weighted_loads": [ + 0.5695583689957857, + 1.709731100127101, + 3.7832957953214645, + 0.03578867018222809, + 0.34099397994577885, + 0.6399077977985144, + 0.8413994777947664, + 0.9316960126161575, + 0.2307459246367216, + 0.19856035336852074, + 1.687831500545144, + 2.7948237489908934, + 1.5522645954042673, + 1.2663509715348482, + 0.34313391149044037, + 0.325782036408782, + 0.67081193998456, + 1.0669774375855923, + 0.5403639730066061, + 2.3758972007781267, + 1.0837096478790045, + 1.8089546114206314, + 0.7948765065521002, + 4.14734798297286, + 3.5612719915807247, + 3.9020493775606155, + 6.5092168264091015, + 3.522535979747772, + 1.3088760171085596, + 0.146425673738122, + 1.104481115937233, + 1.3041777797043324, + 0.2317465804517269, + 2.30430188216269, + 1.6556231919676065, + 0.48166515678167343, + 1.038001086562872, + 1.3817102182656527, + 0.6522671151906252, + 1.7468122094869614, + 0.8113314909860492, + 1.5372202321887016, + 1.2230352200567722, + 1.95492497459054, + 0.5375399645417929, + 0.796491764485836, + 1.810562115162611, + 4.217930231243372, + 0.5753943026065826, + 2.2036041785031557, + 1.852500967681408, + 0.5877889171242714, + 1.7889573816210032, + 1.0980362128466368, + 2.902999171987176, + 1.1074509993195534, + 2.031971286982298, + 1.5526806451380253, + 1.888816513121128, + 0.0, + 1.730824450030923, + 1.3077232297509909, + 1.8484722692519426, + 0.527173038572073 + ], + "unique_experts": 63, + "load_cv": 0.545671880736265, + "normalized_load_entropy": 0.9619713178717351, + "max_load_share": 0.04336043360433604 + }, + "full_input": { + "tokens": 271, + "top_k": 6, + "decisions": 1626, + "ordered_route_sha256": "d2cbdc84107995ffe3330a6069f2903c406c7836a9d2e4f45e4d034a177b351c", + "route_weight_sha256": "8d59cd1782672b7cf9ce0c68df74ddd76962f30ea64d4e4722c6303b89a4654e", + "loads": [ + 15, + 21, + 43, + 1, + 13, + 15, + 25, + 26, + 14, + 5, + 26, + 29, + 33, + 25, + 18, + 11, + 19, + 29, + 14, + 42, + 24, + 32, + 15, + 50, + 49, + 46, + 53, + 46, + 30, + 4, + 31, + 29, + 11, + 44, + 26, + 13, + 24, + 17, + 17, + 32, + 21, + 31, + 22, + 29, + 9, + 13, + 23, + 28, + 16, + 27, + 37, + 16, + 30, + 29, + 64, + 24, + 38, + 21, + 23, + 1, + 33, + 27, + 31, + 16 + ], + "weighted_loads": [ + 0.7152613457292318, + 1.709731100127101, + 3.7832957953214645, + 0.03578867018222809, + 0.6827765312045813, + 0.6586453933268785, + 1.4869897086173296, + 1.0271524544805288, + 0.7350329738110304, + 0.2300640121102333, + 1.950541663914919, + 2.8249953147023916, + 1.987284267321229, + 1.2663509715348482, + 0.7040826473385096, + 0.39240830577909946, + 1.2925428859889507, + 1.1757538225501776, + 0.5403639730066061, + 2.5375104267150164, + 1.0837096478790045, + 1.8089546114206314, + 0.7948765065521002, + 4.515089236199856, + 3.615250961855054, + 3.9305532313883305, + 7.323684625327587, + 3.522535979747772, + 1.4249240886420012, + 0.146425673738122, + 1.2890955433249474, + 1.3041777797043324, + 0.6297285817563534, + 2.4022476989775896, + 1.6556231919676065, + 0.48166515678167343, + 1.7609264887869358, + 1.3817102182656527, + 0.6522671151906252, + 1.7468122094869614, + 1.1576237482950091, + 1.5727703720331192, + 1.2230352200567722, + 2.1176245361566544, + 0.5375399645417929, + 0.796491764485836, + 1.810562115162611, + 4.252304453402758, + 0.5889083268120885, + 2.8879749942570925, + 2.2832478396594524, + 0.6777195334434509, + 2.0048298398032784, + 1.133447540923953, + 2.902999171987176, + 1.80083317309618, + 2.031971286982298, + 1.5526806451380253, + 1.9379316233098507, + 0.02886790782213211, + 1.730824450030923, + 1.4528544936329126, + 1.8484722692519426, + 0.6732141338288784 + ], + "unique_experts": 64, + "load_cv": 0.49902585865989907, + "normalized_load_entropy": 0.9682282049456907, + "max_load_share": 0.03936039360393604 + } + }, + "s1_x": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "f96664edb2c05aa0c4fa6d3422aec9192e240dc1c667b87cf8cb09648dddf9c1", + "route_weight_sha256": "e0a0ca2adf225dad91301a43923b171cc0c706245ba3d973edd565b00c7f47ef", + "loads": [ + 17, + 21, + 42, + 1, + 6, + 14, + 17, + 21, + 5, + 4, + 20, + 29, + 27, + 26, + 5, + 5, + 15, + 28, + 13, + 38, + 25, + 33, + 16, + 40, + 44, + 43, + 41, + 46, + 28, + 4, + 26, + 27, + 7, + 38, + 25, + 17, + 20, + 20, + 12, + 31, + 18, + 28, + 22, + 27, + 12, + 14, + 23, + 26, + 19, + 19, + 35, + 19, + 23, + 25, + 68, + 23, + 37, + 20, + 22, + 0, + 34, + 20, + 31, + 14 + ], + "weighted_loads": [ + 0.8001956269145012, + 1.6802907455712557, + 3.734386507421732, + 0.04078038036823273, + 0.2964124474674463, + 0.6382988356053829, + 0.8732260465621948, + 0.7925294581800699, + 0.17638105154037476, + 0.2007757229730487, + 1.6580252405256033, + 2.8178516384214163, + 1.4560616370290518, + 1.3740383740514517, + 0.204419057816267, + 0.19746054708957672, + 0.8296616468578577, + 1.1665570046752691, + 0.5048346482217312, + 2.247730430215597, + 1.1393393967300653, + 1.8436799850314856, + 0.8265033531934023, + 3.925041975453496, + 3.372935799881816, + 3.815231693908572, + 6.5897700767964125, + 3.6192604955285788, + 1.2821429800242186, + 0.12683498114347458, + 1.0576613526791334, + 1.2609343435615301, + 0.26923581399023533, + 2.2131006829440594, + 1.6340100262314081, + 0.5763779152184725, + 1.1029840596020222, + 1.513564521446824, + 0.45178113877773285, + 1.7031698636710644, + 0.9037738079205155, + 1.4206860531121492, + 1.231272529810667, + 2.0045561362057924, + 0.6408719774335623, + 0.8294583987444639, + 1.8268034774810076, + 4.127408944070339, + 0.6946154832839966, + 2.1783034279942513, + 2.064073570072651, + 0.7658262010663748, + 1.7856468632817268, + 0.969250600785017, + 3.199300294741988, + 1.1706595998257399, + 1.9927637837827206, + 1.4907051865011454, + 1.8804077934473753, + 0.0, + 1.757869055494666, + 1.1636246982961893, + 1.9148008581250906, + 0.5872404165565968 + ], + "unique_experts": 63, + "load_cv": 0.5390638333882828, + "normalized_load_entropy": 0.9623049044330724, + "max_load_share": 0.04607046070460705 + }, + "full_input": { + "tokens": 287, + "top_k": 6, + "decisions": 1722, + "ordered_route_sha256": "b47b8dcb5d12083e040ef959cfebdd796f3e958baaf2b390007e2e9d24acce05", + "route_weight_sha256": "6ada2238ded8408ec127bf40a2c2351ec93f738b038703f16affd018523bdb14", + "loads": [ + 38, + 22, + 42, + 1, + 12, + 17, + 31, + 22, + 16, + 5, + 26, + 33, + 33, + 27, + 9, + 17, + 27, + 33, + 14, + 42, + 26, + 34, + 16, + 46, + 44, + 44, + 52, + 48, + 36, + 6, + 32, + 31, + 13, + 40, + 27, + 17, + 27, + 20, + 13, + 32, + 24, + 31, + 22, + 30, + 12, + 15, + 23, + 27, + 22, + 32, + 42, + 23, + 25, + 26, + 68, + 26, + 37, + 26, + 24, + 4, + 34, + 28, + 33, + 17 + ], + "weighted_loads": [ + 2.1921334490180016, + 1.7060021702200174, + 3.734386507421732, + 0.04078038036823273, + 0.599111245945096, + 0.7909106649458408, + 2.0162055622786283, + 0.8271953668445349, + 0.8809005338698626, + 0.23181869369000196, + 1.9328302163630724, + 3.148692563176155, + 1.9991586208343506, + 1.457083372399211, + 0.37294640950858593, + 0.9468077709898353, + 1.896978521719575, + 1.3588343895971775, + 0.5567307844758034, + 2.5250712633132935, + 1.1688568573445082, + 1.9260921236127615, + 0.8265033531934023, + 4.23711177892983, + 3.372935799881816, + 3.843754641711712, + 7.4322570245712996, + 3.744731469079852, + 1.7697885427623987, + 0.19318354688584805, + 1.2799516543745995, + 1.7048672381788492, + 0.7257494647055864, + 2.3341100588440895, + 1.7832137923687696, + 0.5763779152184725, + 1.7646958604454994, + 1.513564521446824, + 0.48579810559749603, + 1.7392720244824886, + 1.2377020912244916, + 1.5820391867309809, + 1.231272529810667, + 2.4095292184501886, + 0.6408719774335623, + 0.8670629058033228, + 1.8268034774810076, + 4.161606561392546, + 0.8347348542883992, + 3.693198051303625, + 2.4030708502978086, + 0.9012026395648718, + 1.8336732713505626, + 1.1032490395009518, + 3.199300294741988, + 1.8476729821413755, + 1.9927637837827206, + 2.139835262671113, + 1.961120767518878, + 0.17437300458550453, + 1.757869055494666, + 1.5975751150399446, + 2.031277032569051, + 0.7012002244591713 + ], + "unique_experts": 64, + "load_cv": 0.4567384758577114, + "normalized_load_entropy": 0.9730456721672771, + "max_load_share": 0.03948896631823461 + } + }, + "s0_period": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "de661faff791e2fc8d63708cdd749496e97431a72376b1c957b3a1c4e73e1d02", + "route_weight_sha256": "f3b3ea4feade721aa5f71541f1aecb0b92fb20063d196dcd886d038dcffb201f", + "loads": [ + 12, + 21, + 44, + 1, + 5, + 13, + 17, + 20, + 5, + 4, + 19, + 29, + 29, + 26, + 6, + 8, + 13, + 28, + 12, + 41, + 23, + 32, + 15, + 44, + 46, + 44, + 42, + 45, + 29, + 4, + 27, + 25, + 7, + 42, + 28, + 14, + 20, + 20, + 15, + 32, + 19, + 30, + 22, + 27, + 9, + 13, + 22, + 26, + 18, + 18, + 30, + 15, + 22, + 29, + 66, + 23, + 38, + 19, + 22, + 0, + 34, + 22, + 31, + 14 + ], + "weighted_loads": [ + 0.5419518612325191, + 1.7222575191408396, + 3.828442506492138, + 0.037887364625930786, + 0.26162784919142723, + 0.6126139350235462, + 0.855981258675456, + 0.78788055293262, + 0.1736837550997734, + 0.19822032004594803, + 1.6507538482546806, + 2.8413551207631826, + 1.56246324069798, + 1.31831381842494, + 0.25488289818167686, + 0.2949888054281473, + 0.6831398122012615, + 1.1645701341331005, + 0.4733446817845106, + 2.459240296855569, + 1.0308695901185274, + 1.8124146535992622, + 0.7869410440325737, + 4.18500617146492, + 3.5194101072847843, + 3.818218108266592, + 6.7153355572372675, + 3.4890026897192, + 1.3803415969014168, + 0.1381110530346632, + 1.114838358014822, + 1.200785780325532, + 0.26077986136078835, + 2.3385563138872385, + 1.7327883448451757, + 0.5325865279883146, + 1.116182455793023, + 1.5093413814902306, + 0.5750887114554644, + 1.7207337524741888, + 0.9167407946661115, + 1.5474423579871655, + 1.2395891174674034, + 2.012110948562622, + 0.5431466177105904, + 0.7968222536146641, + 1.7872035838663578, + 4.1847365740686655, + 0.6886229682713747, + 2.175549518316984, + 1.8326815851032734, + 0.6245550699532032, + 1.7487122938036919, + 1.119579179212451, + 3.0510425586253405, + 1.1524850334972143, + 2.0258508156985044, + 1.4702690578997135, + 1.8984076585620642, + 0.0, + 1.7784020211547613, + 1.219507997855544, + 1.8716966696083546, + 0.5510861724615097 + ], + "unique_experts": 63, + "load_cv": 0.5570737402642569, + "normalized_load_entropy": 0.9601565408039232, + "max_load_share": 0.044715447154471545 + }, + "full_input": { + "tokens": 271, + "top_k": 6, + "decisions": 1626, + "ordered_route_sha256": "de91d8a1c31026bba9415e50672789620c2f4b8ed76c6fce45700a7f212da176", + "route_weight_sha256": "a59422d05b0c241ff7725ab13ed304231a9867c9a628a6c8b51989ec61360218", + "loads": [ + 14, + 21, + 44, + 1, + 11, + 14, + 26, + 23, + 13, + 5, + 24, + 31, + 34, + 26, + 15, + 9, + 20, + 31, + 12, + 43, + 23, + 32, + 15, + 50, + 49, + 45, + 53, + 45, + 32, + 4, + 31, + 25, + 12, + 44, + 28, + 14, + 25, + 20, + 15, + 32, + 25, + 32, + 22, + 29, + 9, + 13, + 22, + 27, + 19, + 26, + 36, + 17, + 28, + 29, + 66, + 26, + 38, + 19, + 24, + 1, + 34, + 25, + 31, + 17 + ], + "weighted_loads": [ + 0.6868299134075642, + 1.7222575191408396, + 3.828442506492138, + 0.037887364625930786, + 0.6467671804130077, + 0.6313515305519104, + 1.4992993008345366, + 0.8833369947969913, + 0.7160220593214035, + 0.2297239787876606, + 1.8449149820953608, + 2.905631547793746, + 1.9597146827727556, + 1.31831381842494, + 0.6158316340297461, + 0.32644214294850826, + 1.3036118857562542, + 1.2767670135945082, + 0.4733446817845106, + 2.5715073216706514, + 1.0308695901185274, + 1.8124146535992622, + 0.7869410440325737, + 4.552198704332113, + 3.6168082635849714, + 3.846721962094307, + 7.418718317523599, + 3.4890026897192, + 1.4963896684348583, + 0.1381110530346632, + 1.3074808344244957, + 1.200785780325532, + 0.6587618626654148, + 2.436502130702138, + 1.7327883448451757, + 0.5325865279883146, + 1.873064311221242, + 1.5093413814902306, + 0.5750887114554644, + 1.7207337524741888, + 1.3734404752030969, + 1.6277539618313313, + 1.2395891174674034, + 2.0942463986575603, + 0.5431466177105904, + 0.7968222536146641, + 1.7872035838663578, + 4.219110796228051, + 0.7021369924768806, + 2.8941053189337254, + 2.259979549795389, + 0.7144856862723827, + 1.9270764654502273, + 1.119579179212451, + 3.0510425586253405, + 1.8568869587033987, + 2.0258508156985044, + 1.4702690578997135, + 1.9981666523963213, + 0.02886790782213211, + 1.7784020211547613, + 1.4414603728801012, + 1.8716966696083546, + 0.7011050060391426 + ], + "unique_experts": 64, + "load_cv": 0.5073961009806054, + "normalized_load_entropy": 0.967189423909135, + "max_load_share": 0.04059040590405904 + } + }, + "s1_period": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "6fa55b1a5097ee394e0a36d61d8522639de7f94c2da3c787aa83b5e2822b42bf", + "route_weight_sha256": "ff942783a50e7c2811015e3ff27df34be42816e3789d4cbbf1e2d91b63d61ac9", + "loads": [ + 17, + 21, + 42, + 1, + 6, + 16, + 15, + 22, + 4, + 4, + 20, + 27, + 27, + 26, + 7, + 5, + 14, + 29, + 11, + 37, + 27, + 33, + 15, + 39, + 42, + 43, + 41, + 46, + 26, + 3, + 27, + 26, + 8, + 40, + 24, + 15, + 20, + 20, + 13, + 30, + 17, + 29, + 22, + 27, + 11, + 14, + 23, + 26, + 16, + 20, + 35, + 22, + 22, + 27, + 73, + 24, + 37, + 20, + 22, + 0, + 35, + 19, + 31, + 15 + ], + "weighted_loads": [ + 0.78403390198946, + 1.6961164865642786, + 3.7237148508429527, + 0.03990248963236809, + 0.29196321964263916, + 0.7102645747363567, + 0.7789470795542002, + 0.8111436255276203, + 0.15992560423910618, + 0.1989695131778717, + 1.6732576340436935, + 2.756067121401429, + 1.470106665045023, + 1.3929438088089228, + 0.2551630139350891, + 0.20130851119756699, + 0.7801719754934311, + 1.2263229247182608, + 0.4399782791733742, + 2.2634855154901743, + 1.1985954865813255, + 1.8405617997050285, + 0.7769845146685839, + 3.826128895394504, + 3.275489127263427, + 3.845856625586748, + 6.785797646269202, + 3.5694996789097786, + 1.2252100948244333, + 0.10189568810164928, + 1.0976687297224998, + 1.2151119522750378, + 0.2828689534217119, + 2.280415004119277, + 1.608718641102314, + 0.5159268733114004, + 1.104640081524849, + 1.513786531984806, + 0.459210529923439, + 1.6458287071436644, + 0.9088170919567347, + 1.4554132614284754, + 1.2415333110839128, + 1.9710773956030607, + 0.6133797205984592, + 0.8307899050414562, + 1.8434302508831024, + 4.123980509117246, + 0.5735166110098362, + 2.252877827733755, + 2.1231573410332203, + 0.8708469625562429, + 1.7580241914838552, + 1.0187496673315763, + 3.3557318560779095, + 1.2258340548723936, + 1.9790541920810938, + 1.4760116878896952, + 1.8699931800365448, + 0.0, + 1.788261054083705, + 1.1500905975699425, + 1.9121793266385794, + 0.6046005357056856 + ], + "unique_experts": 63, + "load_cv": 0.5525731301925118, + "normalized_load_entropy": 0.9610919312919515, + "max_load_share": 0.0494579945799458 + }, + "full_input": { + "tokens": 287, + "top_k": 6, + "decisions": 1722, + "ordered_route_sha256": "f55df5fc86a13765f46ffdf387f57c96797d800d3a8d494a8ea0648a709ccfaf", + "route_weight_sha256": "078a2c736b7e6fe064a5dbf1ffa56f49a59feb93c0e71c16cb983ed7d68e1d17", + "loads": [ + 38, + 22, + 42, + 1, + 14, + 19, + 28, + 23, + 16, + 5, + 26, + 31, + 33, + 27, + 11, + 18, + 26, + 33, + 12, + 40, + 28, + 34, + 15, + 44, + 42, + 44, + 52, + 48, + 34, + 4, + 33, + 30, + 14, + 42, + 26, + 15, + 27, + 20, + 14, + 31, + 23, + 32, + 22, + 30, + 11, + 15, + 23, + 27, + 19, + 33, + 43, + 25, + 24, + 28, + 73, + 27, + 37, + 26, + 25, + 4, + 35, + 27, + 33, + 18 + ], + "weighted_loads": [ + 2.155604712665081, + 1.7218279112130404, + 3.7237148508429527, + 0.03990248963236809, + 0.7253535836935043, + 0.8628764040768147, + 1.9155446141958237, + 0.8458095341920853, + 0.8772790059447289, + 0.23001248389482498, + 1.9237194303423166, + 3.086908046156168, + 1.9895315449684858, + 1.475988807156682, + 0.423690365627408, + 0.98272171523422, + 1.8394883461296558, + 1.387689644470811, + 0.49187441542744637, + 2.48806088604033, + 1.2281129471957684, + 1.9229739382863045, + 0.7769845146685839, + 4.0647801188752055, + 3.275489127263427, + 3.874379573389888, + 7.554348504170775, + 3.694970652461052, + 1.7128556575626135, + 0.13991608656942844, + 1.3199590314179659, + 1.6590448468923569, + 0.7136069107800722, + 2.401424380019307, + 1.7579224072396755, + 0.5159268733114004, + 1.8894482962787151, + 1.513786531984806, + 0.4932274967432022, + 1.6819308679550886, + 1.305056830868125, + 1.6150822658091784, + 1.2415333110839128, + 2.2977792751044035, + 0.6133797205984592, + 0.8683944121003151, + 1.8434302508831024, + 4.158178126439452, + 0.7136359820142388, + 3.766382485628128, + 2.495845874771476, + 0.9718037899583578, + 1.806050599552691, + 1.152748106047511, + 3.3557318560779095, + 1.9136676546186209, + 1.9790541920810938, + 2.125141764059663, + 2.0162580013275146, + 0.17437300458550453, + 1.788261054083705, + 1.6912739351391792, + 2.0286555010825396, + 0.7185603436082602 + ], + "unique_experts": 64, + "load_cv": 0.4639586489517739, + "normalized_load_entropy": 0.9724862141524754, + "max_load_share": 0.042392566782810684 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 246, + "ordered_topk_exact_tokens": 160, + "set_exact_tokens": 187, + "mean_set_jaccard": 0.9271196283391406, + "mean_token_weighted_tv": 0.01454305713163401, + "aggregate_load_tv": 0.018292682926829274 + }, + "system_bos": { + "tokens": 246, + "ordered_topk_exact_tokens": 130, + "set_exact_tokens": 168, + "mean_set_jaccard": 0.9010840108401083, + "mean_token_weighted_tv": 0.019497945213811547, + "aggregate_load_tv": 0.02981029810298103 + }, + "system_x": { + "tokens": 246, + "ordered_topk_exact_tokens": 121, + "set_exact_tokens": 147, + "mean_set_jaccard": 0.8720480061943476, + "mean_token_weighted_tv": 0.025599392776460787, + "aggregate_load_tv": 0.03523035230352303 + }, + "system_period": { + "tokens": 246, + "ordered_topk_exact_tokens": 111, + "set_exact_tokens": 141, + "mean_set_jaccard": 0.8674990321331785, + "mean_token_weighted_tv": 0.02586804746415436, + "aggregate_load_tv": 0.03590785907859079 + }, + "bos_at_s0": { + "tokens": 246, + "ordered_topk_exact_tokens": 135, + "set_exact_tokens": 166, + "mean_set_jaccard": 0.900503290747193, + "mean_token_weighted_tv": 0.019884704716306757, + "aggregate_load_tv": 0.02710027100271003 + }, + "bos_at_s1": { + "tokens": 246, + "ordered_topk_exact_tokens": 124, + "set_exact_tokens": 154, + "mean_set_jaccard": 0.8846302748741771, + "mean_token_weighted_tv": 0.022526053825347888, + "aggregate_load_tv": 0.02642276422764228 + }, + "x_at_s0": { + "tokens": 246, + "ordered_topk_exact_tokens": 116, + "set_exact_tokens": 144, + "mean_set_jaccard": 0.8662408052651955, + "mean_token_weighted_tv": 0.02714856705113458, + "aggregate_load_tv": 0.03658536585365854 + }, + "x_at_s1": { + "tokens": 246, + "ordered_topk_exact_tokens": 116, + "set_exact_tokens": 149, + "mean_set_jaccard": 0.8701914616548762, + "mean_token_weighted_tv": 0.027384222806923514, + "aggregate_load_tv": 0.03523035230352303 + }, + "period_at_s0": { + "tokens": 246, + "ordered_topk_exact_tokens": 121, + "set_exact_tokens": 153, + "mean_set_jaccard": 0.8799845141308555, + "mean_token_weighted_tv": 0.024863107669417087, + "aggregate_load_tv": 0.03523035230352303 + }, + "period_at_s1": { + "tokens": 246, + "ordered_topk_exact_tokens": 118, + "set_exact_tokens": 150, + "mean_set_jaccard": 0.8729190863337204, + "mean_token_weighted_tv": 0.027363166461009683, + "aggregate_load_tv": 0.03929539295392953 + } + } + }, + "layer_16": { + "layer": 16, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "6dea1465d662b93a6530620b1c78c021fd7e9b5d78125ffee653cff5e50168be", + "route_weight_sha256": "157ea8706439a22f74c7e5433fe6eb6e15262f4928b4093ce6e8bf296c1c2482", + "loads": [ + 30, + 22, + 18, + 17, + 24, + 14, + 30, + 11, + 26, + 37, + 4, + 6, + 8, + 21, + 40, + 29, + 38, + 22, + 9, + 20, + 12, + 19, + 14, + 29, + 14, + 24, + 25, + 61, + 16, + 108, + 19, + 23, + 27, + 21, + 23, + 42, + 32, + 35, + 17, + 17, + 32, + 10, + 27, + 14, + 24, + 16, + 20, + 22, + 8, + 20, + 10, + 7, + 23, + 33, + 21, + 3, + 33, + 19, + 17, + 19, + 16, + 26, + 14, + 38 + ], + "weighted_loads": [ + 2.4913782235234976, + 1.156739542260766, + 0.6284830551594496, + 0.9832979440689087, + 0.9197659902274609, + 1.0025947596877813, + 1.9890375453978777, + 0.6487705279141665, + 1.602518679574132, + 3.14255927503109, + 0.30986613780260086, + 0.18775998428463936, + 0.2660168707370758, + 0.8064693454653025, + 2.95230476744473, + 2.318546854890883, + 3.1530762650072575, + 1.6748570166528225, + 0.3323709946125746, + 1.5041186437010765, + 0.4762247707694769, + 2.194851191714406, + 0.4812414087355137, + 2.150997431948781, + 0.5203307084739208, + 1.2523220162838697, + 0.9698266182094812, + 3.4751277044415474, + 0.7362927664071321, + 8.023618100211024, + 1.5760992839932442, + 0.7735021766275167, + 3.0110354237258434, + 1.0358344819396734, + 0.7811592798680067, + 4.277880107983947, + 1.9439939726144075, + 4.84715474024415, + 1.4298613891005516, + 0.6575512103736401, + 4.871305715292692, + 0.3964891228824854, + 1.178687084466219, + 0.5532286614179611, + 1.063322177156806, + 1.1147626228630543, + 0.7673800867050886, + 1.6275428645312786, + 0.27067687921226025, + 1.0708168409764767, + 0.4583647772669792, + 0.26245300844311714, + 0.9252310618758202, + 3.8232066705822945, + 0.7689513750374317, + 0.10736536048352718, + 2.3319444488734007, + 0.8815270029008389, + 0.8773774988949299, + 0.7743798177689314, + 0.6643512025475502, + 0.9116474781185389, + 0.8157261908054352, + 1.8172948863357306 + ], + "unique_experts": 64, + "load_cv": 0.6431334544800507, + "normalized_load_entropy": 0.9610968868821766, + "max_load_share": 0.07317073170731707 + }, + "full_input": { + "tokens": 271, + "top_k": 6, + "decisions": 1626, + "ordered_route_sha256": "e2fa8308c832f26329de1289e0650e1bda292a256f0d72e18895da0ee184a174", + "route_weight_sha256": "a4ab5b63a6a13ccce14b0486b977e756e2d81c3aa5dc5d2c12740823194d12f6", + "loads": [ + 30, + 22, + 18, + 17, + 24, + 22, + 35, + 11, + 26, + 40, + 7, + 6, + 8, + 22, + 40, + 37, + 48, + 27, + 14, + 21, + 23, + 21, + 16, + 29, + 21, + 24, + 30, + 61, + 16, + 109, + 20, + 23, + 28, + 29, + 23, + 42, + 32, + 45, + 18, + 17, + 35, + 18, + 28, + 14, + 26, + 17, + 20, + 22, + 8, + 21, + 10, + 9, + 23, + 44, + 21, + 13, + 33, + 19, + 17, + 19, + 19, + 29, + 14, + 45 + ], + "weighted_loads": [ + 2.4913782235234976, + 1.156739542260766, + 0.6284830551594496, + 0.9832979440689087, + 0.9197659902274609, + 1.7840985488146544, + 2.20511039160192, + 0.6487705279141665, + 1.602518679574132, + 4.534792862832546, + 0.4826544150710106, + 0.18775998428463936, + 0.2660168707370758, + 0.8256764430552721, + 2.95230476744473, + 3.107073881663382, + 3.7517736786976457, + 2.0458144564181566, + 0.9418722633272409, + 1.5065737387631088, + 1.4511058777570724, + 2.2742606978863478, + 0.6018888466060162, + 2.150997431948781, + 1.1259110011160374, + 1.2523220162838697, + 1.2475179452449083, + 3.4751277044415474, + 0.7362927664071321, + 8.054795496165752, + 1.6515995040535927, + 0.7735021766275167, + 3.0512015260756016, + 1.414074539206922, + 0.7811592798680067, + 4.277880107983947, + 1.9439939726144075, + 5.345037406310439, + 1.457160823047161, + 0.6575512103736401, + 4.9925067611038685, + 1.448694633319974, + 1.2069879174232483, + 0.5532286614179611, + 1.1517075058072805, + 1.1860771365463734, + 0.7673800867050886, + 1.6275428645312786, + 0.27067687921226025, + 1.0881583951413631, + 0.4583647772669792, + 0.3621073216199875, + 0.9252310618758202, + 4.599917786195874, + 0.7689513750374317, + 0.9287497717887163, + 2.3319444488734007, + 0.8815270029008389, + 0.8773774988949299, + 0.7743798177689314, + 0.8685420155525208, + 1.0514923406299204, + 0.8157261908054352, + 2.1969325160607696 + ], + "unique_experts": 64, + "load_cv": 0.5955787636793336, + "normalized_load_entropy": 0.9661855071946359, + "max_load_share": 0.06703567035670356 + } + }, + "s1_eos": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "8ffa872551cfef7ea8fc3decdabb9c4caa2f151aac2a2632390887c5965c0684", + "route_weight_sha256": "85397b005c52c7a8b7558463bc7761ab6ccbeca232ffd06a75ccd9c6b6295650", + "loads": [ + 29, + 22, + 19, + 18, + 24, + 14, + 30, + 12, + 26, + 38, + 4, + 6, + 7, + 16, + 38, + 28, + 39, + 24, + 10, + 19, + 13, + 22, + 15, + 30, + 12, + 24, + 25, + 61, + 14, + 108, + 19, + 23, + 29, + 23, + 22, + 41, + 33, + 32, + 17, + 18, + 33, + 10, + 28, + 14, + 24, + 15, + 23, + 24, + 7, + 20, + 9, + 8, + 21, + 33, + 22, + 4, + 32, + 20, + 18, + 17, + 13, + 24, + 14, + 39 + ], + "weighted_loads": [ + 2.4957007821649313, + 1.1378173269331455, + 0.6621694024652243, + 1.0091715175658464, + 0.9049637373536825, + 0.9875093810260296, + 2.0207651369273663, + 0.6650157943367958, + 1.6567193493247032, + 3.1833219174295664, + 0.35238582268357277, + 0.19470041058957577, + 0.23747986555099487, + 0.6446707267314196, + 2.925382761284709, + 2.309721144847572, + 3.162913290783763, + 1.72379145398736, + 0.3573910314589739, + 1.4533993564546108, + 0.5404636971652508, + 2.4060484003275633, + 0.5008037928491831, + 2.173411028459668, + 0.46473583579063416, + 1.236642962321639, + 0.9562095049768686, + 3.4615554083138704, + 0.6695946380496025, + 8.03906980715692, + 1.5799721665680408, + 0.7833350710570812, + 3.0337118562310934, + 1.0740991830825806, + 0.7693111374974251, + 4.199437703937292, + 1.9974200204014778, + 4.7050707414746284, + 1.4353624135255814, + 0.7101487517356873, + 4.918052710592747, + 0.3928164914250374, + 1.1972055546939373, + 0.5415239650756121, + 1.0666145458817482, + 1.1007302515208721, + 0.8619136568158865, + 1.67731374502182, + 0.24075664393603802, + 1.056875066831708, + 0.415168184787035, + 0.2907927427440882, + 0.8599765561521053, + 3.78105765581131, + 0.8247749377042055, + 0.14402147941291332, + 2.2932171542197466, + 0.9130807612091303, + 0.8924801405519247, + 0.7177663184702396, + 0.5742205232381821, + 0.8804989941418171, + 0.7968426905572414, + 1.834806565195322 + ], + "unique_experts": 64, + "load_cv": 0.6436357152902977, + "normalized_load_entropy": 0.9610163971733826, + "max_load_share": 0.07317073170731707 + }, + "full_input": { + "tokens": 287, + "top_k": 6, + "decisions": 1722, + "ordered_route_sha256": "b2782887a01ef5d55b94172dad8a6178097a7cea22f6b5d01c5bacd8fad6d7fa", + "route_weight_sha256": "725c3d430ab4e7c38a48a226c1e29053f0ab0171712e05565a5742af4ffb5bd2", + "loads": [ + 29, + 25, + 19, + 20, + 24, + 22, + 37, + 13, + 26, + 42, + 9, + 8, + 7, + 19, + 39, + 40, + 50, + 36, + 18, + 21, + 22, + 23, + 17, + 31, + 27, + 24, + 36, + 61, + 14, + 109, + 21, + 23, + 34, + 30, + 23, + 43, + 33, + 40, + 20, + 21, + 37, + 25, + 29, + 16, + 27, + 20, + 24, + 30, + 10, + 25, + 15, + 10, + 21, + 45, + 22, + 15, + 34, + 20, + 18, + 19, + 16, + 26, + 17, + 45 + ], + "weighted_loads": [ + 2.4957007821649313, + 1.259513646364212, + 0.6621694024652243, + 1.0991016495972872, + 0.9049637373536825, + 1.769102767109871, + 2.3666212037205696, + 0.6902699209749699, + 1.6567193493247032, + 4.581567974761128, + 0.5300437789410353, + 0.2565041221678257, + 0.23747986555099487, + 0.7366860546171665, + 2.9725901316851377, + 3.6016390500590205, + 3.6882645548321307, + 2.558726239949465, + 1.1890634428709745, + 1.4907789574936032, + 1.393359174951911, + 2.4655488412827253, + 0.583692004904151, + 2.248935768380761, + 1.6373313330113888, + 1.236642962321639, + 2.1396349500864744, + 3.4615554083138704, + 0.6695946380496025, + 8.068064535036683, + 1.68868238478899, + 0.7833350710570812, + 3.254554469138384, + 1.3747495329007506, + 0.8046016208827496, + 4.326323758810759, + 1.9974200204014778, + 5.153328282758594, + 1.5858156494796276, + 0.8865442089736462, + 5.067374289035797, + 2.5217908807098866, + 1.2341106347739697, + 0.6355949435383081, + 1.1613400038331747, + 1.3379650078713894, + 0.8921566475182772, + 1.974607229232788, + 0.36710059083998203, + 1.265511268749833, + 0.6778826974332333, + 0.37095860578119755, + 0.8599765561521053, + 4.865700477734208, + 0.8247749377042055, + 1.0898854490369558, + 2.401934428140521, + 0.9130807612091303, + 0.8924801405519247, + 0.9468126613646746, + 0.718239888548851, + 0.972270428086631, + 1.1230753883719444, + 2.16714237164706 + ], + "unique_experts": 64, + "load_cv": 0.5530882552095551, + "normalized_load_entropy": 0.9704322146791464, + "max_load_share": 0.06329849012775841 + } + }, + "s0_bos": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "9d8ad4b5c636c2694154ede85c75c6efc0c2fcdc9fc405e32170b8c3b8489f53", + "route_weight_sha256": "01ba2b8096844862704a4acd6b2abb21e7a3acd273add7d62706de433d1ae280", + "loads": [ + 28, + 22, + 19, + 17, + 23, + 15, + 26, + 12, + 23, + 37, + 5, + 5, + 5, + 15, + 40, + 25, + 39, + 24, + 7, + 22, + 14, + 20, + 13, + 30, + 15, + 26, + 27, + 63, + 13, + 109, + 19, + 21, + 31, + 19, + 27, + 42, + 31, + 34, + 17, + 18, + 33, + 11, + 29, + 13, + 23, + 16, + 21, + 26, + 7, + 18, + 9, + 8, + 27, + 35, + 16, + 4, + 32, + 21, + 20, + 19, + 14, + 23, + 13, + 40 + ], + "weighted_loads": [ + 2.4718909393996, + 1.172077789902687, + 0.6716335006058216, + 0.9515154771506786, + 0.877674825489521, + 1.0154390465468168, + 1.8990475572645664, + 0.699422026053071, + 1.5375656932592392, + 3.0942000038921833, + 0.44762836769223213, + 0.14915476366877556, + 0.16887836530804634, + 0.5672458130866289, + 2.93374065682292, + 2.224417625926435, + 3.1413560453802347, + 1.728345973417163, + 0.2580332439392805, + 1.5522316750138998, + 0.6021236442029476, + 2.2120970133692026, + 0.5050497092306614, + 2.234949680045247, + 0.579109650105238, + 1.3388113100081682, + 1.0573372356593609, + 3.618502387776971, + 0.6207873001694679, + 8.123494319617748, + 1.5804189294576645, + 0.7082726489752531, + 3.138870980590582, + 0.9738200418651104, + 0.9165403842926025, + 4.276655700057745, + 1.9370958507061005, + 4.716521156951785, + 1.462318904697895, + 0.7150786854326725, + 5.023113798350096, + 0.41470953077077866, + 1.2330595199018717, + 0.49850925616919994, + 1.0444468762725592, + 1.0998976081609726, + 0.8030925039201975, + 1.7488166317343712, + 0.24396046251058578, + 1.0062430799007416, + 0.4268769323825836, + 0.2884718608111143, + 1.0721237938851118, + 3.780079247429967, + 0.6124298721551895, + 0.16538982093334198, + 2.3247935995459557, + 0.9362398162484169, + 0.9806511998176575, + 0.792169252410531, + 0.63551982678473, + 0.8256969135254622, + 0.7907208018004894, + 1.912416648119688 + ], + "unique_experts": 64, + "load_cv": 0.6583023438331218, + "normalized_load_entropy": 0.9591155088269415, + "max_load_share": 0.07384823848238482 + }, + "full_input": { + "tokens": 271, + "top_k": 6, + "decisions": 1626, + "ordered_route_sha256": "083bede35c9ad0a0dfce5782a5217c0b3e9b43743ba05f53cdffb17e9c398152", + "route_weight_sha256": "944e5ba42463d49170269bc5e86b4eeda9f1935d1de1a61f036433478ac23768", + "loads": [ + 28, + 22, + 19, + 17, + 23, + 24, + 31, + 12, + 23, + 40, + 8, + 6, + 6, + 17, + 40, + 33, + 49, + 29, + 12, + 23, + 25, + 22, + 15, + 30, + 21, + 26, + 31, + 63, + 13, + 110, + 20, + 21, + 33, + 26, + 28, + 42, + 31, + 43, + 17, + 18, + 35, + 20, + 29, + 13, + 25, + 17, + 21, + 26, + 7, + 20, + 10, + 10, + 27, + 46, + 16, + 14, + 32, + 21, + 20, + 19, + 17, + 26, + 13, + 45 + ], + "weighted_loads": [ + 2.4718909393996, + 1.172077789902687, + 0.6716335006058216, + 0.9515154771506786, + 0.877674825489521, + 1.8377762157469988, + 2.116978693753481, + 0.699422026053071, + 1.5375656932592392, + 3.5515015088021755, + 0.6204166449606419, + 0.188748050481081, + 0.24527565017342567, + 0.6262610387057066, + 2.93374065682292, + 2.9548114566132426, + 4.179130889475346, + 2.1081560738384724, + 0.8312126863747835, + 1.5834334772080183, + 1.5770047511905432, + 2.2915065195411444, + 0.6256971471011639, + 2.234949680045247, + 1.1520354002714157, + 1.3388113100081682, + 1.267916414886713, + 3.618502387776971, + 0.6207873001694679, + 8.153696473687887, + 1.655919149518013, + 0.7082726489752531, + 3.2112382501363754, + 1.3552432395517826, + 1.0425102561712265, + 4.276655700057745, + 1.9370958507061005, + 5.188466923311353, + 1.462318904697895, + 0.7150786854326725, + 5.105535671114922, + 1.4665458593517542, + 1.2330595199018717, + 0.49850925616919994, + 1.1195985618978739, + 1.1712121218442917, + 0.8030925039201975, + 1.7488166317343712, + 0.24396046251058578, + 1.0682952627539635, + 0.4705986827611923, + 0.38812617398798466, + 1.0721237938851118, + 4.556790363043547, + 0.6124298721551895, + 0.9867742322385311, + 2.3247935995459557, + 0.9362398162484169, + 0.9806511998176575, + 0.792169252410531, + 0.806371433660388, + 0.995389373973012, + 0.7907208018004894, + 2.239396069198847 + ], + "unique_experts": 64, + "load_cv": 0.6045745066326651, + "normalized_load_entropy": 0.9650608674044743, + "max_load_share": 0.06765067650676507 + } + }, + "s1_bos": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "c28e30d24a06a320206516da655303bcc382dc867f382cf93a0351407e74b688", + "route_weight_sha256": "d3b73f99337ae2208e878c226ff648e7d96e41e46551649176c5885a5a058655", + "loads": [ + 31, + 22, + 17, + 17, + 25, + 12, + 29, + 13, + 22, + 37, + 6, + 9, + 6, + 15, + 40, + 21, + 40, + 25, + 8, + 21, + 14, + 21, + 14, + 29, + 14, + 26, + 28, + 63, + 13, + 109, + 19, + 21, + 28, + 23, + 26, + 40, + 33, + 33, + 18, + 18, + 34, + 13, + 29, + 11, + 23, + 15, + 21, + 24, + 6, + 19, + 9, + 7, + 25, + 32, + 16, + 3, + 32, + 22, + 19, + 18, + 11, + 27, + 13, + 41 + ], + "weighted_loads": [ + 2.564700247719884, + 1.153766855597496, + 0.6168767604976892, + 0.9687299653887749, + 0.9440997373312712, + 0.9414468165487051, + 2.00164776109159, + 0.7151516657322645, + 1.556720456108451, + 3.160371070727706, + 0.49877430126070976, + 0.282037103548646, + 0.2042142953723669, + 0.5746055692434311, + 3.03098595328629, + 2.0870883325114846, + 3.149187497794628, + 1.7391979806125164, + 0.30260139144957066, + 1.5156248398125172, + 0.586807943880558, + 2.269948085770011, + 0.5318967700004578, + 2.169470466673374, + 0.5563548728823662, + 1.3197379987686872, + 1.0776426754891872, + 3.5863234512507915, + 0.6063937246799469, + 8.159348234534264, + 1.6076601594686508, + 0.7156322728842497, + 3.0140090361237526, + 1.0166220925748348, + 0.890951881185174, + 4.184002052992582, + 2.026360109448433, + 4.665513018146157, + 1.50446511618793, + 0.7360455840826035, + 4.991812063381076, + 0.4916868135333061, + 1.2442457024008036, + 0.44890699349343777, + 1.0220276676118374, + 1.0977648124098778, + 0.8089513648301363, + 1.6949052009731531, + 0.21169640868902206, + 1.021470895037055, + 0.4157013427466154, + 0.261092446744442, + 0.9911314062774181, + 3.708651201799512, + 0.6326009556651115, + 0.1290550548583269, + 2.308984600007534, + 0.9704651515930891, + 0.9295652415603399, + 0.7664227746427059, + 0.5016721691936255, + 0.987284267321229, + 0.7729552239179611, + 1.946739349514246 + ], + "unique_experts": 64, + "load_cv": 0.6576326225713544, + "normalized_load_entropy": 0.9593722057469387, + "max_load_share": 0.07384823848238482 + }, + "full_input": { + "tokens": 287, + "top_k": 6, + "decisions": 1722, + "ordered_route_sha256": "ccc05fee4beab05ba8ca18f5aab03bf3b5d223dda90a9336e9b8a82f77cd6eec", + "route_weight_sha256": "664ac4e2a6f65f726a9f2161a041b31fb0d92d94aac98ef8e19bcc654ab7c929", + "loads": [ + 31, + 25, + 17, + 19, + 25, + 20, + 36, + 14, + 22, + 41, + 11, + 11, + 6, + 18, + 41, + 33, + 51, + 36, + 16, + 21, + 23, + 22, + 16, + 30, + 27, + 26, + 39, + 63, + 13, + 110, + 21, + 21, + 34, + 31, + 28, + 42, + 33, + 42, + 21, + 21, + 37, + 29, + 30, + 13, + 27, + 20, + 22, + 30, + 9, + 25, + 15, + 9, + 25, + 44, + 16, + 14, + 34, + 22, + 19, + 19, + 16, + 28, + 16, + 46 + ], + "weighted_loads": [ + 2.564700247719884, + 1.2754631750285625, + 0.6168767604976892, + 1.0586600974202156, + 0.9440997373312712, + 1.7230402026325464, + 2.3500395473092794, + 0.7404057923704386, + 1.556720456108451, + 3.656014485284686, + 0.6764322575181723, + 0.3438408151268959, + 0.2042142953723669, + 0.666620897129178, + 3.078193323686719, + 3.349527237005532, + 4.1214470490813255, + 2.550961025059223, + 1.1545220669358969, + 1.5156248398125172, + 1.4397034216672182, + 2.329448526725173, + 0.6147849820554256, + 2.244995206594467, + 1.6571277789771557, + 1.3197379987686872, + 2.256008591502905, + 3.5863234512507915, + 0.6063937246799469, + 8.188084289431572, + 1.7163703776896, + 0.7156322728842497, + 3.2650704346597195, + 1.3785906098783016, + 0.9679062906652689, + 4.310888107866049, + 2.026360109448433, + 5.154496923089027, + 1.6574286576360464, + 0.9124410413205624, + 5.100597178563476, + 2.6560638025403023, + 1.281150782480836, + 0.5429779719561338, + 1.1625281888991594, + 1.334999568760395, + 0.839194355532527, + 1.9921986851841211, + 0.3380403555929661, + 1.266895281150937, + 0.6848592553287745, + 0.34125830978155136, + 0.9911314062774181, + 4.79329402372241, + 0.6326009556651115, + 1.0749190244823694, + 2.4177018739283085, + 0.9704651515930891, + 0.9295652415603399, + 0.9711634777486324, + 0.7484963834285736, + 1.070428753271699, + 1.099187921732664, + 2.263254851102829 + ], + "unique_experts": 64, + "load_cv": 0.5643679157208678, + "normalized_load_entropy": 0.9691586255463511, + "max_load_share": 0.06387921022067364 + } + }, + "s0_x": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "3d83d48f422cc386cb81a4a24f7f17d63ec4f2c5ed75a23d4e7a79188e789ec4", + "route_weight_sha256": "dd9d947b548fd169ade8cc76901a8141fc9ad6e97c7487eceda61c3bbb0249ee", + "loads": [ + 32, + 22, + 20, + 20, + 24, + 18, + 30, + 14, + 25, + 35, + 6, + 4, + 6, + 18, + 41, + 26, + 40, + 24, + 8, + 19, + 17, + 20, + 15, + 30, + 14, + 24, + 22, + 66, + 11, + 111, + 16, + 22, + 30, + 19, + 22, + 42, + 28, + 35, + 18, + 17, + 33, + 12, + 28, + 11, + 20, + 15, + 20, + 26, + 5, + 20, + 9, + 7, + 24, + 33, + 17, + 3, + 33, + 22, + 17, + 20, + 16, + 24, + 14, + 36 + ], + "weighted_loads": [ + 2.5416262317448854, + 1.1669011488556862, + 0.6951683685183525, + 1.061165738850832, + 0.9157593660056591, + 1.0853894036263227, + 2.101952137425542, + 0.7462447136640549, + 1.5659323316067457, + 3.0057863369584084, + 0.4532119259238243, + 0.13442207500338554, + 0.20461826026439667, + 0.671233644708991, + 3.0445254500955343, + 2.2460251543670893, + 3.2623459827154875, + 1.7403351701796055, + 0.2777207922190428, + 1.4598219953477383, + 0.7165429331362247, + 2.4012210350483656, + 0.5430381614714861, + 2.177632499486208, + 0.565789133310318, + 1.22774026542902, + 0.8622899297624826, + 3.643022570759058, + 0.5664782971143723, + 8.21986614819616, + 1.4794743359088898, + 0.746154610067606, + 3.1369411405175924, + 0.9912849701941013, + 0.7752264775335789, + 4.269424062222242, + 1.7915836777538061, + 4.673010005615652, + 1.4843627605587244, + 0.6646060813218355, + 5.054676059633493, + 0.44895737804472446, + 1.213403794914484, + 0.41744122467935085, + 0.909178065136075, + 1.0546835251152515, + 0.7900965735316277, + 1.7698402144014835, + 0.16721023246645927, + 1.04200560413301, + 0.4205224737524986, + 0.2638402357697487, + 1.0172296315431595, + 3.708898738026619, + 0.6562810856848955, + 0.14530307240784168, + 2.365243509411812, + 0.9459707047790289, + 0.9001346006989479, + 0.8160990048199892, + 0.7040205132216215, + 0.8116166740655899, + 0.8330285400152206, + 1.7836480401456356 + ], + "unique_experts": 64, + "load_cv": 0.667475878767482, + "normalized_load_entropy": 0.958487266700339, + "max_load_share": 0.07520325203252033 + }, + "full_input": { + "tokens": 271, + "top_k": 6, + "decisions": 1626, + "ordered_route_sha256": "7b13c4f5d1835cb411d3c2b9db89c1cbf62a6494b826e4aba6ad969cfd98dc02", + "route_weight_sha256": "7b7ca5280f09c16f26b08250e01734bdc64937a3d02613c7f0cd062122571133", + "loads": [ + 32, + 22, + 20, + 20, + 24, + 26, + 35, + 14, + 25, + 36, + 9, + 5, + 6, + 19, + 41, + 34, + 49, + 30, + 13, + 19, + 29, + 23, + 17, + 30, + 22, + 24, + 27, + 66, + 11, + 111, + 18, + 22, + 33, + 24, + 22, + 42, + 28, + 45, + 19, + 17, + 35, + 20, + 29, + 11, + 21, + 16, + 20, + 26, + 5, + 21, + 10, + 9, + 24, + 45, + 17, + 14, + 33, + 22, + 17, + 20, + 20, + 26, + 14, + 42 + ], + "weighted_loads": [ + 2.5416262317448854, + 1.1669011488556862, + 0.6951683685183525, + 1.061165738850832, + 0.9157593660056591, + 1.8668931927531958, + 2.326770266517997, + 0.7462447136640549, + 1.5659323316067457, + 3.3826747313141823, + 0.626000203192234, + 0.1602216213941574, + 0.20461826026439667, + 0.6904407422989607, + 3.0445254500955343, + 3.0272578056901693, + 3.706379149109125, + 2.142719430848956, + 0.9337984416633844, + 1.4598219953477383, + 1.9386460613459349, + 2.5152711924165487, + 0.6636855993419886, + 2.177632499486208, + 1.2647495828568935, + 1.22774026542902, + 1.1261063497513533, + 3.643022570759058, + 0.5664782971143723, + 8.21986614819616, + 1.6015752293169498, + 0.746154610067606, + 3.2828572411090136, + 1.2829280085861683, + 0.7752264775335789, + 4.269424062222242, + 1.7915836777538061, + 5.179492882452905, + 1.5156275648623705, + 0.6646060813218355, + 5.137097932398319, + 1.3840659279376268, + 1.2440264727920294, + 0.41744122467935085, + 0.9546805415302515, + 1.1259980387985706, + 0.7900965735316277, + 1.7698402144014835, + 0.16721023246645927, + 1.0593471582978964, + 0.45728588476777077, + 0.36349454894661903, + 1.0172296315431595, + 4.619607815518975, + 0.6562810856848955, + 1.0790705066174269, + 2.365243509411812, + 0.9459707047790289, + 0.9001346006989479, + 0.8160990048199892, + 0.9389594476670027, + 0.9463371187448502, + 0.8330285400152206, + 2.1365616731345654 + ], + "unique_experts": 64, + "load_cv": 0.6121347482715958, + "normalized_load_entropy": 0.9641793704366993, + "max_load_share": 0.06826568265682657 + } + }, + "s1_x": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "583d79902c557df00d48ac6ed5e30671380bf633d6414883377479db3496c0bb", + "route_weight_sha256": "5381a943b373d7bc2b6c808b303eb4e7f00d6942157357208b31fb219c7bcb70", + "loads": [ + 28, + 22, + 16, + 19, + 27, + 17, + 31, + 12, + 24, + 37, + 6, + 4, + 7, + 14, + 41, + 21, + 41, + 25, + 7, + 23, + 19, + 20, + 10, + 28, + 15, + 25, + 26, + 71, + 12, + 110, + 18, + 18, + 26, + 18, + 26, + 40, + 31, + 34, + 19, + 18, + 33, + 10, + 27, + 13, + 22, + 17, + 22, + 24, + 6, + 18, + 9, + 6, + 27, + 33, + 20, + 3, + 32, + 21, + 19, + 20, + 12, + 22, + 13, + 41 + ], + "weighted_loads": [ + 2.468476042151451, + 1.1885594874620438, + 0.5623725522309542, + 1.0177982319146395, + 1.0034804791212082, + 1.0339879021048546, + 2.023850305005908, + 0.6852074358612299, + 1.5578258763998747, + 3.0905221216380596, + 0.4419590588659048, + 0.1390724517405033, + 0.23382845893502235, + 0.5539883431047201, + 3.03711966983974, + 2.0462832618504763, + 3.4148630797863007, + 1.7445103749632835, + 0.25488133169710636, + 1.6007256116718054, + 0.7534744571894407, + 2.3298011105507612, + 0.3937236350029707, + 2.1508634835481644, + 0.6337448954582214, + 1.2931986451148987, + 0.9709487091749907, + 4.0395608972758055, + 0.5799719784408808, + 8.28741786442697, + 1.5775535218417645, + 0.6491461917757988, + 2.9749976322054863, + 0.8967743217945099, + 0.9187727402895689, + 4.18785435706377, + 1.9368281997740269, + 4.626572375185788, + 1.5327743142843246, + 0.7377167418599129, + 4.941006163135171, + 0.44213094003498554, + 1.1818553563207388, + 0.5076113045215607, + 0.9555908124893904, + 1.10990808904171, + 0.8445493299514055, + 1.6835361067205667, + 0.20749446004629135, + 0.9756713155657053, + 0.4202088601887226, + 0.22563328593969345, + 1.0998213924467564, + 3.7432160433381796, + 0.7771302461624146, + 0.13824578002095222, + 2.3418345749378204, + 0.9110754895955324, + 0.954010296612978, + 0.8130905274301767, + 0.5177039131522179, + 0.8019642066210508, + 0.7845205515623093, + 1.9281856007874012 + ], + "unique_experts": 64, + "load_cv": 0.6796875471546008, + "normalized_load_entropy": 0.9567452326105704, + "max_load_share": 0.07452574525745258 + }, + "full_input": { + "tokens": 287, + "top_k": 6, + "decisions": 1722, + "ordered_route_sha256": "1cd8dc511f86ea9abf0ee620159081f89af9855292c3b387508987c8b860e623", + "route_weight_sha256": "7f60c022b51d142a8639172f4fa268b811c00d9b08e230cc9242314d3fdb1184", + "loads": [ + 28, + 25, + 16, + 21, + 27, + 25, + 39, + 13, + 24, + 39, + 12, + 7, + 7, + 17, + 42, + 33, + 51, + 37, + 15, + 23, + 30, + 22, + 13, + 29, + 30, + 25, + 37, + 71, + 12, + 110, + 20, + 18, + 33, + 23, + 27, + 42, + 31, + 42, + 21, + 21, + 36, + 25, + 28, + 15, + 24, + 22, + 23, + 30, + 10, + 23, + 15, + 8, + 27, + 46, + 20, + 15, + 34, + 22, + 19, + 22, + 16, + 23, + 16, + 45 + ], + "weighted_loads": [ + 2.468476042151451, + 1.3102558068931103, + 0.5623725522309542, + 1.1077283639460802, + 1.0034804791212082, + 1.815581288188696, + 2.3957520853728056, + 0.710461562499404, + 1.5578258763998747, + 3.502298317849636, + 0.6482774131000042, + 0.23013543896377087, + 0.23382845893502235, + 0.6460036709904671, + 3.0843270402401686, + 3.328586159273982, + 3.8064127042889595, + 2.5752277933061123, + 1.0685784127563238, + 1.6007256116718054, + 1.9470033571124077, + 2.426049003377557, + 0.5075712166726589, + 2.2263882234692574, + 1.9434858225286007, + 1.2931986451148987, + 2.128363559022546, + 4.0395608972758055, + 0.5799719784408808, + 8.28741786442697, + 1.6862637400627136, + 0.6491461917757988, + 3.292778465896845, + 1.1096158362925053, + 0.9540632236748934, + 4.314740411937237, + 1.9368281997740269, + 5.074829916469753, + 1.6563727259635925, + 0.9141121990978718, + 5.049791278317571, + 2.3409278746694326, + 1.2187604364007711, + 0.6016822829842567, + 1.0234340876340866, + 1.3471428453922272, + 0.8747923206537962, + 1.9808295909315348, + 0.3659767508506775, + 1.1843075174838305, + 0.6753125935792923, + 0.3057991489768028, + 1.0998213924467564, + 4.926400505006313, + 0.7771302461624146, + 1.2190971188247204, + 2.450551848858595, + 0.9676711652427912, + 0.954010296612978, + 1.0377325508743525, + 0.6918412335216999, + 0.8744607400149107, + 1.1107532493770123, + 2.178867891430855 + ], + "unique_experts": 64, + "load_cv": 0.5764383380338518, + "normalized_load_entropy": 0.9680013824748142, + "max_load_share": 0.06387921022067364 + } + }, + "s0_period": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "d1d1628b980fac26dea4f68c8a61bd10dbf8159b12b4532e68cd208a408a527c", + "route_weight_sha256": "21ee0421f532b1fb7260be0794f1db56df2123839f8a0d4b7be98d7327684972", + "loads": [ + 30, + 22, + 18, + 20, + 23, + 16, + 29, + 13, + 26, + 33, + 6, + 6, + 6, + 19, + 42, + 26, + 42, + 24, + 8, + 21, + 16, + 21, + 13, + 30, + 14, + 25, + 23, + 66, + 11, + 109, + 17, + 22, + 31, + 19, + 21, + 42, + 30, + 36, + 18, + 17, + 32, + 11, + 28, + 11, + 20, + 15, + 23, + 25, + 6, + 17, + 8, + 8, + 24, + 33, + 20, + 5, + 33, + 22, + 18, + 20, + 15, + 21, + 14, + 36 + ], + "weighted_loads": [ + 2.501061165705323, + 1.173036139458418, + 0.6409978084266186, + 1.0842224285006523, + 0.869461027905345, + 1.0450311992317438, + 2.020281370729208, + 0.7117701452225447, + 1.6107528153806925, + 2.966199267655611, + 0.47444505617022514, + 0.19579222239553928, + 0.20506861805915833, + 0.7196405827999115, + 3.0728811118751764, + 2.231255025602877, + 3.352228794246912, + 1.7528859842568636, + 0.27971299923956394, + 1.5308382771909237, + 0.7147091403603554, + 2.408373521640897, + 0.4727407079190016, + 2.2080426942557096, + 0.5809189155697823, + 1.2737280279397964, + 0.9056257326155901, + 3.6861624773591757, + 0.5648456141352654, + 8.182243866845965, + 1.5198114588856697, + 0.7484680917114019, + 3.1720215994864702, + 0.965560544282198, + 0.7580906953662634, + 4.242542043328285, + 1.8842946663498878, + 4.707295038737357, + 1.4792426843196154, + 0.6750109121203423, + 5.011270856484771, + 0.4265664089471102, + 1.2067955527454615, + 0.4299469944089651, + 0.909145787358284, + 1.0687698498368263, + 0.8851336929947138, + 1.725851122289896, + 0.19666223041713238, + 0.9574107117950916, + 0.38433014415204525, + 0.2925266642123461, + 1.0112876817584038, + 3.706390043720603, + 0.7604032810777426, + 0.23363430052995682, + 2.353772632777691, + 0.9365157950669527, + 0.9334526937454939, + 0.8075255323201418, + 0.6548086125403643, + 0.7509827148169279, + 0.825443934649229, + 1.798186270520091 + ], + "unique_experts": 64, + "load_cv": 0.6591942470908361, + "normalized_load_entropy": 0.9597337170333518, + "max_load_share": 0.07384823848238482 + }, + "full_input": { + "tokens": 271, + "top_k": 6, + "decisions": 1626, + "ordered_route_sha256": "3d7d91ad3442fdf97089a593e2d0a41d7fcf6f0724992242886ed76f29e2446c", + "route_weight_sha256": "59b285157b888c5f4990dff404c32df8d559009454cb01c73e12b8fea1aa7f01", + "loads": [ + 30, + 22, + 18, + 20, + 23, + 26, + 34, + 13, + 26, + 34, + 10, + 7, + 6, + 20, + 42, + 34, + 51, + 30, + 13, + 21, + 29, + 23, + 16, + 30, + 22, + 25, + 28, + 66, + 11, + 109, + 19, + 22, + 32, + 24, + 21, + 42, + 30, + 45, + 19, + 17, + 35, + 19, + 29, + 11, + 22, + 16, + 23, + 26, + 6, + 18, + 8, + 10, + 24, + 44, + 20, + 16, + 33, + 22, + 18, + 20, + 18, + 23, + 14, + 41 + ], + "weighted_loads": [ + 2.501061165705323, + 1.173036139458418, + 0.6409978084266186, + 1.0842224285006523, + 0.869461027905345, + 1.9036737475544214, + 2.24749768152833, + 0.7117701452225447, + 1.6107528153806925, + 3.343087662011385, + 0.7019319571554661, + 0.22265958599746227, + 0.20506861805915833, + 0.7388476803898811, + 3.0728811118751764, + 2.9936185935512185, + 3.870604360476136, + 2.2755414322018623, + 0.8775026556104422, + 1.5308382771909237, + 1.8110346365720034, + 2.4877830278128386, + 0.6334677506238222, + 2.2080426942557096, + 1.3174427710473537, + 1.2737280279397964, + 1.2037704642862082, + 3.6861624773591757, + 0.5648456141352654, + 8.182243866845965, + 1.6532339341938496, + 0.7484680917114019, + 3.2121877018362284, + 1.2484102509915829, + 0.7580906953662634, + 4.242542043328285, + 1.8842946663498878, + 5.179240805096924, + 1.5100642554461956, + 0.6750109121203423, + 5.1301952581852674, + 1.408040376380086, + 1.244082910940051, + 0.4299469944089651, + 0.9975006133317947, + 1.1400843635201454, + 0.8851336929947138, + 1.7649923376739025, + 0.19666223041713238, + 0.9747522659599781, + 0.38433014415204525, + 0.3921809773892164, + 1.0112876817584038, + 4.483101159334183, + 0.7604032810777426, + 1.12026521936059, + 2.353772632777691, + 0.9365157950669527, + 0.9334526937454939, + 0.8075255323201418, + 0.845530154183507, + 0.8860092367976904, + 0.825443934649229, + 2.1047977562993765 + ], + "unique_experts": 64, + "load_cv": 0.602368306615854, + "normalized_load_entropy": 0.9653923305369293, + "max_load_share": 0.06703567035670356 + } + }, + "s1_period": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "98dda6d46c47d22c8a79768b989e355f7dc30a825c4174c242af0f09f25dd636", + "route_weight_sha256": "2e8d55c3a1e6739c5b0070bb263962c1f5ad22d23b6543241af79df5380c892d", + "loads": [ + 28, + 22, + 16, + 18, + 26, + 16, + 32, + 12, + 26, + 37, + 5, + 6, + 6, + 14, + 42, + 22, + 40, + 25, + 7, + 22, + 17, + 21, + 8, + 29, + 14, + 27, + 26, + 68, + 13, + 110, + 18, + 18, + 27, + 18, + 28, + 40, + 31, + 31, + 17, + 17, + 33, + 11, + 28, + 14, + 21, + 16, + 20, + 24, + 6, + 20, + 9, + 8, + 30, + 33, + 18, + 3, + 32, + 22, + 19, + 19, + 13, + 24, + 13, + 40 + ], + "weighted_loads": [ + 2.4923698119819164, + 1.1806988175958395, + 0.5577091816812754, + 0.9870170000940561, + 0.9837270937860012, + 1.0164209082722664, + 2.0493724290281534, + 0.6871526278555393, + 1.637496491894126, + 3.1138564255088568, + 0.39022037386894226, + 0.19429444707930088, + 0.20339434407651424, + 0.5524255689233541, + 3.138206584379077, + 2.0878125838935375, + 3.366767143830657, + 1.7329074200242758, + 0.25576480478048325, + 1.5740394033491611, + 0.7400797847658396, + 2.3858828898519278, + 0.32828920893371105, + 2.1658252105116844, + 0.5680193789303303, + 1.3567732777446508, + 0.9730768464505672, + 3.907267903909087, + 0.6072038784623146, + 8.229012904688716, + 1.5772362612187862, + 0.6304163336753845, + 3.0169151686131954, + 0.9094033166766167, + 0.9848173800855875, + 4.158727237954736, + 1.9788429886102676, + 4.557095196098089, + 1.4774376787245274, + 0.7083206735551357, + 4.93204783834517, + 0.46367870457470417, + 1.2076933402568102, + 0.5352955851703882, + 0.9120290409773588, + 1.1049126759171486, + 0.7764259539544582, + 1.6792547423392534, + 0.2059915754944086, + 1.0388552844524384, + 0.41636136919260025, + 0.30086420103907585, + 1.1743201594799757, + 3.715374894440174, + 0.7031485363841057, + 0.15262000635266304, + 2.318070152774453, + 0.9414732325822115, + 0.9533308632671833, + 0.7751334104686975, + 0.5582794845104218, + 0.8695962745696306, + 0.7778882756829262, + 1.9098710045218468 + ], + "unique_experts": 64, + "load_cv": 0.674263238559566, + "normalized_load_entropy": 0.9573055550843976, + "max_load_share": 0.07452574525745258 + }, + "full_input": { + "tokens": 287, + "top_k": 6, + "decisions": 1722, + "ordered_route_sha256": "6bb12cde29818c56abdb76838e431a81fa0ad9f9fe0dc808611c9d9c0d502489", + "route_weight_sha256": "46b735f7a9f6421a64c5cd1fb22d470c088902c1e7ef4ccc782ee67ea73cc90b", + "loads": [ + 28, + 25, + 16, + 20, + 26, + 25, + 39, + 13, + 26, + 39, + 10, + 9, + 6, + 17, + 43, + 34, + 49, + 38, + 15, + 22, + 27, + 22, + 10, + 30, + 30, + 27, + 37, + 68, + 13, + 110, + 21, + 18, + 34, + 23, + 29, + 42, + 31, + 39, + 20, + 20, + 37, + 27, + 29, + 16, + 23, + 21, + 21, + 30, + 10, + 25, + 15, + 10, + 30, + 46, + 19, + 15, + 34, + 22, + 19, + 21, + 16, + 25, + 16, + 44 + ], + "weighted_loads": [ + 2.4923698119819164, + 1.302395137026906, + 0.5577091816812754, + 1.0769471321254969, + 0.9837270937860012, + 1.8347418271005154, + 2.395142490044236, + 0.7124067544937134, + 1.637496491894126, + 3.5256326217204332, + 0.5678783301264048, + 0.2849740590900183, + 0.20339434407651424, + 0.6444408968091011, + 3.1854139547795057, + 3.3004737310111523, + 3.7082895301282406, + 2.6631569545716047, + 1.125632781535387, + 1.5740394033491611, + 1.6471288800239563, + 2.44538333080709, + 0.41117742098867893, + 2.2413499504327774, + 1.9323400408029556, + 1.3567732777446508, + 2.1603276021778584, + 3.907267903909087, + 0.6072038784623146, + 8.229012904688716, + 1.7546351924538612, + 0.6304163336753845, + 3.302354959771037, + 1.123310662806034, + 1.020107863470912, + 4.285613292828202, + 1.9788429886102676, + 5.005352737382054, + 1.6511464715003967, + 0.8847161307930946, + 5.086766818538308, + 2.3709074165672064, + 1.2445984203368425, + 0.6293665636330843, + 0.979872316122055, + 1.3421474322676659, + 0.8066689446568489, + 1.9765482265502214, + 0.37200975976884365, + 1.2474914863705635, + 0.6636727675795555, + 0.3810300640761852, + 1.1743201594799757, + 4.86325859464705, + 0.7427191659808159, + 1.1461930498480797, + 2.4267874266952276, + 0.9414732325822115, + 0.9533308632671833, + 1.0102653577923775, + 0.7175873704254627, + 0.9463520143181086, + 1.1041209734976292, + 2.1617607064545155 + ], + "unique_experts": 64, + "load_cv": 0.5708700045207394, + "normalized_load_entropy": 0.9684094425829713, + "max_load_share": 0.06387921022067364 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 246, + "ordered_topk_exact_tokens": 163, + "set_exact_tokens": 187, + "mean_set_jaccard": 0.929732868757259, + "mean_token_weighted_tv": 0.01428739183650511, + "aggregate_load_tv": 0.022357723577235773 + }, + "system_bos": { + "tokens": 246, + "ordered_topk_exact_tokens": 134, + "set_exact_tokens": 171, + "mean_set_jaccard": 0.9061169183120403, + "mean_token_weighted_tv": 0.018643505114123105, + "aggregate_load_tv": 0.025745257452574517 + }, + "system_x": { + "tokens": 246, + "ordered_topk_exact_tokens": 104, + "set_exact_tokens": 135, + "mean_set_jaccard": 0.8561169183120401, + "mean_token_weighted_tv": 0.02817182587951846, + "aggregate_load_tv": 0.040650406504065026 + }, + "system_period": { + "tokens": 246, + "ordered_topk_exact_tokens": 103, + "set_exact_tokens": 138, + "mean_set_jaccard": 0.8627564847077043, + "mean_token_weighted_tv": 0.026516981120032024, + "aggregate_load_tv": 0.037940379403794036 + }, + "bos_at_s0": { + "tokens": 246, + "ordered_topk_exact_tokens": 131, + "set_exact_tokens": 160, + "mean_set_jaccard": 0.8915989159891599, + "mean_token_weighted_tv": 0.021090250553154364, + "aggregate_load_tv": 0.03658536585365854 + }, + "bos_at_s1": { + "tokens": 246, + "ordered_topk_exact_tokens": 122, + "set_exact_tokens": 151, + "mean_set_jaccard": 0.8809523809523809, + "mean_token_weighted_tv": 0.023019534088974076, + "aggregate_load_tv": 0.033875338753387524 + }, + "x_at_s0": { + "tokens": 246, + "ordered_topk_exact_tokens": 105, + "set_exact_tokens": 146, + "mean_set_jaccard": 0.8703058459156019, + "mean_token_weighted_tv": 0.027267419242837685, + "aggregate_load_tv": 0.03658536585365854 + }, + "x_at_s1": { + "tokens": 246, + "ordered_topk_exact_tokens": 101, + "set_exact_tokens": 132, + "mean_set_jaccard": 0.8526325977545489, + "mean_token_weighted_tv": 0.029843689294577373, + "aggregate_load_tv": 0.04471544715447153 + }, + "period_at_s0": { + "tokens": 246, + "ordered_topk_exact_tokens": 112, + "set_exact_tokens": 146, + "mean_set_jaccard": 0.8716608594657375, + "mean_token_weighted_tv": 0.026299358275529695, + "aggregate_load_tv": 0.03726287262872628 + }, + "period_at_s1": { + "tokens": 246, + "ordered_topk_exact_tokens": 99, + "set_exact_tokens": 134, + "mean_set_jaccard": 0.8554974835462641, + "mean_token_weighted_tv": 0.029061120891246975, + "aggregate_load_tv": 0.03929539295392953 + } + } + }, + "layer_17": { + "layer": 17, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "182738133f5303eb9e446a86b4eebf3e1081fff543f36414c9e259ef633e0d77", + "route_weight_sha256": "d4b204e5734be2b7f0b69506a3b704d0ab7af0c9d944a55430a866f35f6a8224", + "loads": [ + 15, + 13, + 25, + 21, + 20, + 24, + 0, + 23, + 27, + 15, + 44, + 21, + 15, + 15, + 90, + 23, + 10, + 5, + 10, + 10, + 20, + 27, + 36, + 34, + 26, + 9, + 20, + 19, + 17, + 17, + 18, + 23, + 43, + 19, + 40, + 32, + 0, + 7, + 40, + 39, + 7, + 19, + 19, + 43, + 19, + 38, + 26, + 44, + 30, + 36, + 27, + 27, + 25, + 46, + 31, + 16, + 8, + 13, + 29, + 7, + 15, + 11, + 26, + 2 + ], + "weighted_loads": [ + 0.5514317937195301, + 0.4621437806636095, + 1.0299016889184713, + 2.243646040558815, + 1.0652989465743303, + 3.2094061952084303, + 0.0, + 1.3530942872166634, + 1.6363205891102552, + 0.7166853807866573, + 5.6677167462185025, + 1.3179468549787998, + 0.6521330438554287, + 0.9690197389572859, + 6.994942668825388, + 1.2338968366384506, + 0.5253815427422523, + 0.3672821205109358, + 1.5438270810991526, + 0.38809576258063316, + 0.7731316238641739, + 1.1209190413355827, + 3.416388478130102, + 5.257470278069377, + 1.5284396819770336, + 0.6272537373006344, + 1.4479081192985177, + 0.9958978816866875, + 2.473064035177231, + 0.7478489372879267, + 1.3553259558975697, + 1.3210143372416496, + 2.3290566615760326, + 1.2029927372932434, + 2.728796102106571, + 2.707515077665448, + 0.0, + 0.7147242985665798, + 5.070667799562216, + 2.6383112147450447, + 0.3871357962489128, + 0.8952537681907415, + 2.043352000415325, + 1.7369626592844725, + 0.7512740530073643, + 3.6114470809698105, + 1.4673379231244326, + 2.8291063997894526, + 2.5430225674062967, + 1.361608225852251, + 2.004629846662283, + 2.1641637682914734, + 1.7216163538396358, + 3.8301085866987705, + 1.1833990290760994, + 1.0644318852573633, + 0.3049425110220909, + 0.9480389542877674, + 1.8480692654848099, + 0.3523493967950344, + 0.8695041239261627, + 0.5531671196222305, + 2.0770647432655096, + 0.08988616615533829 + ], + "unique_experts": 62, + "load_cv": 0.6177851388884252, + "normalized_load_entropy": 0.9556235687485144, + "max_load_share": 0.06097560975609756 + }, + "full_input": { + "tokens": 271, + "top_k": 6, + "decisions": 1626, + "ordered_route_sha256": "de4c20118bd03e546433ddb0cce3a705706c790639f16d494b6bc72dd907be6a", + "route_weight_sha256": "9c5eff30e1a85e43f6b32ffa267832fb04158e94fc2a024815730f3cdbc1c246", + "loads": [ + 22, + 15, + 27, + 28, + 20, + 24, + 2, + 23, + 27, + 18, + 51, + 22, + 17, + 23, + 90, + 25, + 10, + 12, + 13, + 10, + 23, + 27, + 36, + 40, + 33, + 16, + 30, + 22, + 21, + 19, + 18, + 23, + 53, + 19, + 40, + 32, + 0, + 7, + 44, + 39, + 15, + 24, + 21, + 45, + 19, + 42, + 26, + 44, + 30, + 37, + 28, + 27, + 27, + 46, + 31, + 21, + 9, + 16, + 29, + 7, + 15, + 12, + 32, + 2 + ], + "weighted_loads": [ + 0.7674948330968618, + 0.5410743784159422, + 1.1207640524953604, + 2.8282025307416916, + 1.0652989465743303, + 3.2094061952084303, + 0.0987420380115509, + 1.3530942872166634, + 1.6363205891102552, + 0.8209877870976925, + 6.091208220459521, + 1.3365076780319214, + 0.7169775124639273, + 1.5709564592689276, + 6.994942668825388, + 1.3233757950365543, + 0.5253815427422523, + 1.034381179139018, + 1.6633286271244287, + 0.38809576258063316, + 1.0670653358101845, + 1.1209190413355827, + 3.416388478130102, + 5.5264682695269585, + 2.067090380936861, + 1.011882457882166, + 3.2083463864400983, + 1.1356019377708435, + 2.625600215047598, + 0.7946868618018925, + 1.3553259558975697, + 1.3210143372416496, + 2.718851513694972, + 1.2029927372932434, + 2.728796102106571, + 2.707515077665448, + 0.0, + 0.7147242985665798, + 5.229379620403051, + 2.6383112147450447, + 1.302886962890625, + 1.0563195110298693, + 2.202442567795515, + 1.75905127893202, + 0.7512740530073643, + 4.416284188628197, + 1.4673379231244326, + 2.8291063997894526, + 2.5430225674062967, + 1.400994461029768, + 2.0720481164753437, + 2.1641637682914734, + 1.8798889331519604, + 3.8301085866987705, + 1.1833990290760994, + 1.3634597975760698, + 0.34495168551802635, + 1.1199900172650814, + 1.8480692654848099, + 0.3523493967950344, + 0.8695041239261627, + 0.6135399080812931, + 2.608443869277835, + 0.08988616615533829 + ], + "unique_experts": 63, + "load_cv": 0.5633281766794193, + "normalized_load_entropy": 0.9627154895496364, + "max_load_share": 0.055350553505535055 + } + }, + "s1_eos": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "3e98ed4d376f25e4c2cdf6d10fc9d03403102d54582bae594d685ebd4eb03463", + "route_weight_sha256": "35839ffd5d435f5f9c255db90a810015b9b234ef28434c830ad0680c46a29436", + "loads": [ + 15, + 15, + 25, + 20, + 20, + 25, + 0, + 24, + 26, + 17, + 44, + 20, + 20, + 15, + 92, + 23, + 11, + 5, + 9, + 10, + 20, + 26, + 35, + 32, + 27, + 8, + 20, + 21, + 17, + 17, + 17, + 24, + 43, + 18, + 40, + 31, + 0, + 10, + 40, + 38, + 8, + 16, + 20, + 42, + 21, + 36, + 25, + 45, + 30, + 35, + 26, + 28, + 25, + 47, + 29, + 16, + 8, + 13, + 28, + 5, + 15, + 11, + 25, + 2 + ], + "weighted_loads": [ + 0.5666698068380356, + 0.5047769751399755, + 1.0615802239626646, + 2.350900972262025, + 1.0499300695955753, + 3.388718931004405, + 0.0, + 1.377970840781927, + 1.5890875793993473, + 0.753140902146697, + 5.602297382429242, + 1.2660594806075096, + 0.819008145481348, + 0.9564702156931162, + 7.21621442399919, + 1.2488584611564875, + 0.5420777034014463, + 0.3728383034467697, + 1.492364801466465, + 0.3847187589854002, + 0.7619594428688288, + 1.0789219457656145, + 3.31919252127409, + 5.151332503184676, + 1.5506566632539034, + 0.6087155379354954, + 1.4390447465702891, + 1.0312350932508707, + 2.478307304903865, + 0.7380980513989925, + 1.2770944628864527, + 1.3796076625585556, + 2.3062010388821363, + 1.1570664308965206, + 2.753958720713854, + 2.7153644543141127, + 0.0, + 0.7874808320775628, + 5.006143817678094, + 2.5977781005203724, + 0.41588227078318596, + 0.7828927654772997, + 2.095326928421855, + 1.6709868274629116, + 0.8274719286710024, + 3.5793146397918463, + 1.358116988092661, + 2.86436658911407, + 2.5639157500118017, + 1.3192241806536913, + 1.9571440983563662, + 2.2080244813114405, + 1.7284506279975176, + 3.908349523320794, + 1.098639853298664, + 1.0552733838558197, + 0.30285871028900146, + 0.9638921432197094, + 1.8036600090563297, + 0.242008650675416, + 0.8683596290647984, + 0.5596571005880833, + 2.0504871737211943, + 0.08348198980093002 + ], + "unique_experts": 62, + "load_cv": 0.6171666518497525, + "normalized_load_entropy": 0.9561832929921082, + "max_load_share": 0.06233062330623306 + }, + "full_input": { + "tokens": 287, + "top_k": 6, + "decisions": 1722, + "ordered_route_sha256": "1d94a2606f6a3528b8ca0bca37a124737c8cbe4c02cf73597608c102a6c41523", + "route_weight_sha256": "d4a07d115310aadc7f8b41ca538755c8f4b3bd02b47b247ec692ffb3d0cd4fdc", + "loads": [ + 22, + 16, + 26, + 26, + 26, + 25, + 3, + 25, + 26, + 22, + 51, + 22, + 21, + 23, + 92, + 30, + 12, + 13, + 12, + 10, + 21, + 27, + 35, + 42, + 37, + 29, + 34, + 24, + 19, + 20, + 19, + 25, + 48, + 18, + 40, + 31, + 4, + 12, + 43, + 39, + 21, + 23, + 25, + 43, + 23, + 41, + 27, + 47, + 30, + 37, + 27, + 34, + 29, + 47, + 30, + 24, + 15, + 24, + 29, + 7, + 16, + 16, + 35, + 2 + ], + "weighted_loads": [ + 0.8343870537355542, + 0.5479019675403833, + 1.1101784016937017, + 2.977222876623273, + 1.4484363980591297, + 3.388718931004405, + 0.11966345459222794, + 1.432021837681532, + 1.5890875793993473, + 0.9122296720743179, + 6.081592420116067, + 1.3332118205726147, + 0.8647454082965851, + 1.567582057788968, + 7.21621442399919, + 1.5664354804903269, + 0.6776787471026182, + 1.0384154953062534, + 1.605628740042448, + 0.3847187589854002, + 0.8307255301624537, + 1.1552893612533808, + 3.31919252127409, + 5.836486987769604, + 2.18034077109769, + 1.992722863331437, + 3.32819274161011, + 1.1643159221857786, + 2.5659519601613283, + 0.8636030983179808, + 1.372622413560748, + 1.4192331917583942, + 2.4788206149823964, + 1.1570664308965206, + 2.753958720713854, + 2.7153644543141127, + 0.2255401499569416, + 0.8602640805765986, + 5.299563309177756, + 2.6310081630945206, + 2.025550916790962, + 1.1745419157668948, + 2.3069281857460737, + 1.6898438930511475, + 1.0599727649241686, + 4.785805618390441, + 1.5820291824638844, + 2.9976901095360518, + 2.5639157500118017, + 1.3968971017748117, + 2.0923498291522264, + 2.4997607991099358, + 1.9867805037647486, + 3.908349523320794, + 1.186694048345089, + 1.5545640792697668, + 0.9210998043417931, + 1.5788912437856197, + 1.827007457613945, + 0.3346658069640398, + 0.9033509083092213, + 0.8512066379189491, + 2.836517369374633, + 0.08348198980093002 + ], + "unique_experts": 64, + "load_cv": 0.5110640366869009, + "normalized_load_entropy": 0.9699466332360472, + "max_load_share": 0.053426248548199766 + } + }, + "s0_bos": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "76004af1c4a50b972b85d03d0ade3dd60476628c09e0c18e4513ffb35e137a6b", + "route_weight_sha256": "ee1c268ce7bcd8c554a5dcef6dc8d4177931de56e5b71ad652c392a6987a9946", + "loads": [ + 13, + 14, + 20, + 20, + 21, + 24, + 0, + 24, + 27, + 16, + 44, + 19, + 23, + 15, + 96, + 22, + 10, + 5, + 11, + 7, + 20, + 30, + 37, + 34, + 24, + 10, + 18, + 18, + 15, + 13, + 20, + 24, + 45, + 19, + 39, + 32, + 0, + 7, + 40, + 40, + 8, + 17, + 18, + 42, + 20, + 37, + 27, + 44, + 30, + 33, + 28, + 26, + 25, + 49, + 30, + 15, + 7, + 13, + 30, + 7, + 15, + 12, + 25, + 2 + ], + "weighted_loads": [ + 0.48895950615406036, + 0.47982080839574337, + 0.8810691852122545, + 2.160916408523917, + 1.0985123477876186, + 3.291836328804493, + 0.0, + 1.4074413757771254, + 1.641367157921195, + 0.7503913398832083, + 5.783527055755258, + 1.237711202353239, + 0.9122077412903309, + 0.953601598739624, + 7.348242988809943, + 1.1854941882193089, + 0.5113860964775085, + 0.3609383488073945, + 1.5395372081547976, + 0.29984962195158005, + 0.7534254025667906, + 1.2259674239903688, + 3.5576919466257095, + 5.17714636400342, + 1.500841647386551, + 0.6717752702534199, + 1.3349461192265153, + 0.9689840376377106, + 2.4528666473925114, + 0.578952744603157, + 1.4566166382282972, + 1.4073349423706532, + 2.4436854170635343, + 1.2062221430242062, + 2.759123658761382, + 2.709168953821063, + 0.0, + 0.7254501543939114, + 5.022629901766777, + 2.692583693191409, + 0.41391888074576855, + 0.7979398407042027, + 2.001361109316349, + 1.6644995082169771, + 0.7879281714558601, + 3.5986581705510616, + 1.531418353319168, + 2.8555820025503635, + 2.557453641667962, + 1.2437430378049612, + 2.0404473654925823, + 2.1405810490250587, + 1.7292494215071201, + 4.016554221510887, + 1.1455258466303349, + 1.036739107221365, + 0.2700319401919842, + 0.9524588622152805, + 1.9124835804104805, + 0.3296669628471136, + 0.8851450718939304, + 0.5874037705361843, + 2.065832605585456, + 0.0961923860013485 + ], + "unique_experts": 62, + "load_cv": 0.6433161401455258, + "normalized_load_entropy": 0.9533911044611952, + "max_load_share": 0.06504065040650407 + }, + "full_input": { + "tokens": 271, + "top_k": 6, + "decisions": 1626, + "ordered_route_sha256": "0f905c1d131c0c2aaf08a563d3e9da9423c811c82b4b734d0c48c4c4cd16eece", + "route_weight_sha256": "3507eeda271c4f14016f90e08e936120ccb2aca999436762507699c80663fead", + "loads": [ + 19, + 16, + 21, + 27, + 21, + 24, + 2, + 24, + 27, + 19, + 51, + 20, + 27, + 23, + 96, + 24, + 10, + 12, + 14, + 8, + 23, + 31, + 37, + 40, + 30, + 17, + 26, + 20, + 19, + 14, + 20, + 24, + 54, + 19, + 39, + 32, + 0, + 7, + 44, + 40, + 16, + 21, + 20, + 43, + 20, + 41, + 27, + 44, + 30, + 35, + 29, + 26, + 28, + 50, + 31, + 20, + 8, + 16, + 30, + 8, + 15, + 13, + 32, + 2 + ], + "weighted_loads": [ + 0.7225690875202417, + 0.5646680314093828, + 0.9340207036584616, + 2.745472898706794, + 1.0985123477876186, + 3.291836328804493, + 0.0987420380115509, + 1.4074413757771254, + 1.641367157921195, + 0.8546937461942434, + 6.207018529996276, + 1.2562720254063606, + 1.1746153552085161, + 1.5555383190512657, + 7.348242988809943, + 1.2734462097287178, + 0.5113860964775085, + 1.0280374074354768, + 1.8037196416407824, + 0.3559834696352482, + 1.0585239063948393, + 1.3062837291508913, + 3.5576919466257095, + 5.446144355461001, + 1.9901274293661118, + 1.0669537037611008, + 2.0893365079537034, + 1.0573592334985733, + 2.601604826748371, + 0.6194717399775982, + 1.4566166382282972, + 1.4073349423706532, + 2.8216695645824075, + 1.2062221430242062, + 2.759123658761382, + 2.709168953821063, + 0.0, + 0.7254501543939114, + 5.181341722607613, + 2.692583693191409, + 1.3246811013668776, + 0.9425923712551594, + 2.158551864326, + 1.683356573805213, + 0.7879281714558601, + 4.359198663383722, + 1.531418353319168, + 2.8555820025503635, + 2.557453641667962, + 1.4572475459426641, + 2.107865635305643, + 2.1405810490250587, + 1.9220686443150043, + 4.067424654960632, + 1.221155147999525, + 1.3476338908076286, + 0.3132799342274666, + 1.1293585188686848, + 1.9124835804104805, + 0.3739184718579054, + 0.8851450718939304, + 0.6414490193128586, + 2.5556229297071695, + 0.0961923860013485 + ], + "unique_experts": 63, + "load_cv": 0.5835484809701247, + "normalized_load_entropy": 0.961192824208195, + "max_load_share": 0.05904059040590406 + } + }, + "s1_bos": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "01c704f2a1e1dce542f47dee949e639fd0d9611b3775dc55041f39c4d2beb0a6", + "route_weight_sha256": "9d5b3f85c26cf4ec14f623825596f1a10f433be3eb50af23c475fa4cc74d2753", + "loads": [ + 17, + 12, + 22, + 22, + 22, + 24, + 0, + 23, + 27, + 13, + 42, + 21, + 21, + 16, + 97, + 24, + 9, + 5, + 11, + 7, + 19, + 23, + 38, + 33, + 24, + 13, + 20, + 17, + 15, + 16, + 21, + 25, + 44, + 19, + 40, + 31, + 0, + 10, + 40, + 39, + 8, + 17, + 18, + 40, + 20, + 38, + 28, + 44, + 29, + 31, + 27, + 28, + 25, + 49, + 27, + 17, + 7, + 12, + 28, + 6, + 15, + 12, + 25, + 3 + ], + "weighted_loads": [ + 0.6343552153557539, + 0.4147883653640747, + 1.0178659819066525, + 2.4036665465682745, + 1.1229581162333488, + 3.2951615415513515, + 0.0, + 1.3639381639659405, + 1.6556788366287947, + 0.6715826261788607, + 5.591797249391675, + 1.2556321453303099, + 0.8506700210273266, + 0.9865284524857998, + 7.50655285641551, + 1.295305097475648, + 0.4605649337172508, + 0.3598068617284298, + 1.4446221766993403, + 0.29519926756620407, + 0.716938953846693, + 1.0016982909291983, + 3.489593740552664, + 5.248193934559822, + 1.4442480020225048, + 0.7645035404711962, + 1.4102054005488753, + 0.9207641072571278, + 2.4803674425929785, + 0.6732563097029924, + 1.470486905425787, + 1.4361109342426062, + 2.367641125805676, + 1.21116647683084, + 2.7671960219740868, + 2.7427919562906027, + 0.0, + 0.8223308715969324, + 4.952156033366919, + 2.63864092156291, + 0.41015335358679295, + 0.7946394085884094, + 2.0071003139019012, + 1.5855358392000198, + 0.7875792682170868, + 3.6856930274516344, + 1.5180261936038733, + 2.8463977705687284, + 2.550736727192998, + 1.2043785993009806, + 1.9798526652157307, + 2.1895544789731503, + 1.7176363170146942, + 3.9996482208371162, + 1.0322784557938576, + 1.0857563223689795, + 0.27666500955820084, + 0.8979256749153137, + 1.8420179262757301, + 0.32490719854831696, + 0.889998672530055, + 0.5545526742935181, + 2.051889466121793, + 0.14006304740905762 + ], + "unique_experts": 62, + "load_cv": 0.634626783931172, + "normalized_load_entropy": 0.9551684479553464, + "max_load_share": 0.06571815718157181 + }, + "full_input": { + "tokens": 287, + "top_k": 6, + "decisions": 1722, + "ordered_route_sha256": "8fb514bfc9bbd4ee1a0af8f8cbf345f9b11c94783505176072ab8ba2c64a2b36", + "route_weight_sha256": "25386c7fbb39dfc0666113a3db3645b44853742560e255d124ad1b08205d9a5d", + "loads": [ + 23, + 16, + 23, + 28, + 28, + 24, + 3, + 24, + 27, + 19, + 49, + 23, + 23, + 24, + 97, + 30, + 10, + 13, + 14, + 7, + 20, + 24, + 38, + 43, + 33, + 34, + 32, + 20, + 15, + 18, + 23, + 26, + 48, + 19, + 40, + 31, + 4, + 12, + 43, + 40, + 22, + 23, + 23, + 41, + 22, + 43, + 30, + 46, + 29, + 34, + 29, + 34, + 30, + 49, + 28, + 24, + 15, + 23, + 29, + 8, + 16, + 17, + 36, + 3 + ], + "weighted_loads": [ + 0.8931620195508003, + 0.6119633950293064, + 1.0664641596376896, + 3.0299884509295225, + 1.5214644446969032, + 3.2951615415513515, + 0.11966345459222794, + 1.4179891608655453, + 1.6556788366287947, + 0.8889039605855942, + 6.0710922870785, + 1.322784485295415, + 0.9456393010914326, + 1.5976402945816517, + 7.50655285641551, + 1.5813199039548635, + 0.5961659774184227, + 1.0253840535879135, + 1.5628746477887034, + 0.29519926756620407, + 0.8151565603911877, + 1.0780657064169645, + 3.489593740552664, + 5.93334841914475, + 2.0754565447568893, + 2.164325948804617, + 2.366635193116963, + 1.0477453172206879, + 2.4803674425929785, + 0.7973811645060778, + 1.5660148561000824, + 1.4757364634424448, + 2.533196578733623, + 1.21116647683084, + 2.7671960219740868, + 2.7427919562906027, + 0.2255401499569416, + 0.8951141200959682, + 5.245575524866581, + 2.6718709841370583, + 2.0488379318267107, + 1.1968002207577229, + 2.2234794087707996, + 1.6043929047882557, + 1.020080104470253, + 5.014716224744916, + 1.7419383879750967, + 2.9797212909907103, + 2.550736727192998, + 1.323445113375783, + 2.1720052920281887, + 2.4812907967716455, + 2.0131741017103195, + 3.9996482208371162, + 1.1203326508402824, + 1.5629761256277561, + 0.9357686974108219, + 1.5130702443420887, + 1.8653653748333454, + 0.41756435483694077, + 0.924989951774478, + 0.8285967111587524, + 2.8904396798461676, + 0.14006304740905762 + ], + "unique_experts": 64, + "load_cv": 0.5280952430762326, + "normalized_load_entropy": 0.9686887468285977, + "max_load_share": 0.056329849012775844 + } + }, + "s0_x": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "be6cfbc9e7f73649e380fb88c8de47708b8fadd2d1c84eb3743f64d95e5041ba", + "route_weight_sha256": "00d626ce06ca0bb3ea10a974b53ed0aec0c3541cf1c9e5d368d59c1964bf33e0", + "loads": [ + 12, + 12, + 22, + 21, + 20, + 26, + 0, + 26, + 27, + 16, + 43, + 21, + 20, + 18, + 95, + 24, + 10, + 5, + 10, + 9, + 15, + 28, + 37, + 33, + 26, + 10, + 19, + 20, + 15, + 16, + 21, + 24, + 43, + 19, + 40, + 31, + 0, + 9, + 41, + 40, + 10, + 15, + 20, + 37, + 16, + 39, + 27, + 44, + 29, + 34, + 27, + 28, + 25, + 51, + 28, + 17, + 7, + 12, + 29, + 5, + 17, + 10, + 24, + 1 + ], + "weighted_loads": [ + 0.45194521732628345, + 0.42947147227823734, + 0.9145901575684547, + 2.1524383760988712, + 1.0614596474915743, + 3.788960175588727, + 0.0, + 1.4867869056761265, + 1.6041827388107777, + 0.7398352948948741, + 5.757496144622564, + 1.335401115939021, + 0.7818959672003984, + 1.000737373251468, + 7.244558360427618, + 1.2647287286818027, + 0.49680593982338905, + 0.4086660537868738, + 1.4618346709758043, + 0.3589778672903776, + 0.5778934936970472, + 1.1747239418327808, + 3.521218752488494, + 5.1233430481515825, + 1.5490022134035826, + 0.7061353698372841, + 1.3607956124469638, + 1.0200936328619719, + 2.461810601875186, + 0.6786931976675987, + 1.4318242259323597, + 1.401984166353941, + 2.3476044312119484, + 1.2092491369694471, + 2.772924406453967, + 2.6278945468366146, + 0.0, + 0.7879965007305145, + 5.08961651660502, + 2.6724485587328672, + 0.5009632483124733, + 0.7478330507874489, + 2.0795756448060274, + 1.4946890994906425, + 0.6074004098773003, + 3.5732824839651585, + 1.5022745914757252, + 2.8406710382550955, + 2.561756519600749, + 1.2320163566619158, + 1.966180121526122, + 2.1676401682198048, + 1.6916893534362316, + 4.0162202548235655, + 1.1031329222023487, + 1.1008273269981146, + 0.2640399169176817, + 0.9249405935406685, + 1.8689097296446562, + 0.24252930656075478, + 0.9594397451728582, + 0.5168641470372677, + 2.040252411738038, + 0.02947862446308136 + ], + "unique_experts": 62, + "load_cv": 0.6375363952845837, + "normalized_load_entropy": 0.9536685705079919, + "max_load_share": 0.06436314363143632 + }, + "full_input": { + "tokens": 271, + "top_k": 6, + "decisions": 1626, + "ordered_route_sha256": "de32ade8c14a0295519e440c2523ba4c2275caf222568256da03b6409905b504", + "route_weight_sha256": "6dbbaf0ed456f7905fef5eb5f7f69d91644e2bc7c4d199519f502f4b2eb5bd13", + "loads": [ + 17, + 13, + 25, + 29, + 20, + 26, + 2, + 26, + 27, + 20, + 51, + 22, + 23, + 27, + 95, + 26, + 10, + 13, + 13, + 9, + 17, + 29, + 37, + 40, + 32, + 18, + 26, + 22, + 19, + 19, + 21, + 24, + 52, + 19, + 40, + 31, + 0, + 9, + 45, + 40, + 17, + 19, + 22, + 38, + 16, + 43, + 27, + 44, + 30, + 35, + 29, + 28, + 27, + 51, + 29, + 23, + 7, + 15, + 29, + 5, + 17, + 11, + 29, + 1 + ], + "weighted_loads": [ + 0.621506679803133, + 0.4654418174177408, + 1.0462060533463955, + 2.889273587614298, + 1.0614596474915743, + 3.788960175588727, + 0.0987420380115509, + 1.4867869056761265, + 1.6041827388107777, + 0.8890853738412261, + 6.329652272164822, + 1.3539619389921427, + 0.8840384110808372, + 1.6410520789213479, + 7.244558360427618, + 1.3548305854201317, + 0.49680593982338905, + 1.122249649837613, + 1.7615373898297548, + 0.3589778672903776, + 0.7858607228845358, + 1.221046693623066, + 3.521218752488494, + 5.450753677170724, + 2.041908709332347, + 1.127389494329691, + 2.0068432120606303, + 1.1084688287228346, + 2.617746526375413, + 0.7836910430341959, + 1.4318242259323597, + 1.401984166353941, + 2.728729974478483, + 1.2092491369694471, + 2.772924406453967, + 2.6278945468366146, + 0.0, + 0.7879965007305145, + 5.248328337445855, + 2.6724485587328672, + 1.355236791074276, + 0.9166212975978851, + 2.244651513174176, + 1.5135461650788784, + 0.6074004098773003, + 4.368349064141512, + 1.5022745914757252, + 2.8406710382550955, + 2.6020926255732775, + 1.2700117398053408, + 2.0990422274917364, + 2.1676401682198048, + 1.8440860621631145, + 4.0162202548235655, + 1.1463408060371876, + 1.438107231631875, + 0.2640399169176817, + 1.0959674566984177, + 1.8689097296446562, + 0.24252930656075478, + 0.9594397451728582, + 0.5775281377136707, + 2.3991379495710135, + 0.02947862446308136 + ], + "unique_experts": 63, + "load_cv": 0.5806791537776036, + "normalized_load_entropy": 0.9607930709147977, + "max_load_share": 0.05842558425584256 + } + }, + "s1_x": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "455d2e4243e22ea5d415e7e61b1e2713d4717da94f5050d911cde7d1987383bf", + "route_weight_sha256": "7e5166c7e08496b173cde4136cde526d17a63923b3ef010ccd16bdb32dc7e5a0", + "loads": [ + 14, + 13, + 21, + 23, + 21, + 26, + 0, + 24, + 29, + 15, + 40, + 21, + 27, + 17, + 99, + 27, + 10, + 6, + 11, + 10, + 16, + 24, + 35, + 33, + 25, + 12, + 21, + 20, + 16, + 14, + 22, + 24, + 39, + 20, + 39, + 30, + 0, + 9, + 40, + 39, + 11, + 15, + 20, + 36, + 18, + 37, + 27, + 44, + 28, + 30, + 27, + 27, + 25, + 49, + 28, + 16, + 8, + 11, + 30, + 5, + 16, + 11, + 22, + 3 + ], + "weighted_loads": [ + 0.5417173653841019, + 0.4249928127974272, + 0.9332376578822732, + 2.421550517901778, + 1.0964440442621708, + 3.645403889939189, + 0.0, + 1.4519835785031319, + 1.706426439806819, + 0.7106044124811888, + 5.50329246930778, + 1.2930876221507788, + 1.0605419129133224, + 1.030438894405961, + 7.630263466387987, + 1.3778933975845575, + 0.5129856541752815, + 0.4617447108030319, + 1.318263060413301, + 0.38346068374812603, + 0.6001133657991886, + 0.9916015863418579, + 3.3486958146095276, + 5.241546202450991, + 1.5063918307423592, + 0.8177038989961147, + 1.5149949109181762, + 1.0148781184107065, + 2.4836655221879482, + 0.5744663719087839, + 1.4745100997388363, + 1.4202832337468863, + 2.1756711211055517, + 1.2445690091699362, + 2.798260947689414, + 2.631491092965007, + 0.0, + 0.7844122871756554, + 5.025882333517075, + 2.65686191432178, + 0.5489608962088823, + 0.735347006469965, + 2.0491278134286404, + 1.4589465074241161, + 0.6969286873936653, + 3.5575896706432104, + 1.4594156835228205, + 2.9042427949607372, + 2.5122557561844587, + 1.099924672394991, + 1.9805558323860168, + 2.1802177485078573, + 1.748321957886219, + 3.9625059496611357, + 1.0649078786373138, + 1.0460245218127966, + 0.30750420317053795, + 0.8593755252659321, + 1.9249678272753954, + 0.2738898377865553, + 0.9303721487522125, + 0.5160658285021782, + 2.1360031198710203, + 0.12567051500082016 + ], + "unique_experts": 62, + "load_cv": 0.6274107815031635, + "normalized_load_entropy": 0.9567183794802664, + "max_load_share": 0.06707317073170732 + }, + "full_input": { + "tokens": 287, + "top_k": 6, + "decisions": 1722, + "ordered_route_sha256": "50852c831802d525a9657f5ce9442fa7bb754b33e2ed9f281114c61b9e96d0b3", + "route_weight_sha256": "702adfac1fcbcb5c4817919d9566d5bfad8e979e803447c1f29a9fb33901fd73", + "loads": [ + 20, + 14, + 23, + 30, + 27, + 26, + 3, + 25, + 29, + 21, + 48, + 23, + 27, + 26, + 99, + 33, + 11, + 15, + 15, + 10, + 16, + 25, + 35, + 44, + 34, + 34, + 31, + 22, + 16, + 16, + 24, + 25, + 43, + 20, + 39, + 30, + 4, + 11, + 43, + 40, + 24, + 21, + 25, + 37, + 20, + 42, + 29, + 46, + 29, + 32, + 29, + 33, + 29, + 49, + 29, + 25, + 15, + 25, + 32, + 7, + 17, + 17, + 30, + 3 + ], + "weighted_loads": [ + 0.7986800130456686, + 0.46811780519783497, + 1.0342111894860864, + 3.214383674785495, + 1.4949503727257252, + 3.645403889939189, + 0.11966345459222794, + 1.5060345754027367, + 1.706426439806819, + 0.9079449065029621, + 6.122653191909194, + 1.3602399621158838, + 1.0605419129133224, + 1.7025896441191435, + 7.630263466387987, + 1.6559626515954733, + 0.6485866978764534, + 1.1790420860052109, + 1.4846807746216655, + 0.38346068374812603, + 0.6001133657991886, + 1.0679690018296242, + 3.3486958146095276, + 5.956202812492847, + 2.1439953558146954, + 2.2764768209308386, + 2.2983596520498395, + 1.09107587300241, + 2.4836655221879482, + 0.706581262871623, + 1.5700380504131317, + 1.459908762946725, + 2.3542953059077263, + 1.2445690091699362, + 2.798260947689414, + 2.631491092965007, + 0.2255401499569416, + 0.8571955356746912, + 5.319301825016737, + 2.6900919768959284, + 2.1047442499548197, + 1.0962947811931372, + 2.251224759966135, + 1.477803573012352, + 0.9294295236468315, + 4.741084976121783, + 1.683327877894044, + 3.037566315382719, + 2.550620535388589, + 1.1811456233263016, + 2.2005324214696884, + 2.4719540663063526, + 2.002766102552414, + 3.9625059496611357, + 1.1529620736837387, + 1.5884256809949875, + 0.9257452972233295, + 1.6282427124679089, + 2.000236475840211, + 0.3665469940751791, + 0.9653634279966354, + 0.8267572280019522, + 2.7489263247698545, + 0.12567051500082016 + ], + "unique_experts": 64, + "load_cv": 0.5220114848028011, + "normalized_load_entropy": 0.9697331993891269, + "max_load_share": 0.05749128919860627 + } + }, + "s0_period": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "5baae8a8ab527bd6ebae24a1eb8dfe48f5d19099afd996658f53913247b0f1ae", + "route_weight_sha256": "3d75f6da398a071305eff645dea244840d0a2f36d43dc8b4b7dc51c4b5593a11", + "loads": [ + 14, + 13, + 20, + 22, + 20, + 25, + 0, + 23, + 27, + 17, + 43, + 21, + 22, + 16, + 95, + 22, + 8, + 6, + 9, + 10, + 18, + 27, + 38, + 33, + 23, + 12, + 20, + 18, + 16, + 15, + 22, + 25, + 41, + 19, + 37, + 31, + 0, + 9, + 40, + 40, + 9, + 17, + 20, + 42, + 16, + 38, + 26, + 43, + 28, + 34, + 27, + 27, + 25, + 49, + 32, + 17, + 7, + 12, + 29, + 5, + 18, + 10, + 26, + 2 + ], + "weighted_loads": [ + 0.5292992331087589, + 0.4686469119042158, + 0.870781360194087, + 2.2056125197559595, + 1.0714689120650291, + 3.6839121617376804, + 0.0, + 1.376341549679637, + 1.6186831910163164, + 0.770022883079946, + 5.723881906829774, + 1.316318852826953, + 0.846032727509737, + 0.9664371237158775, + 7.357931587845087, + 1.2101859524846077, + 0.4373498596251011, + 0.4400707595050335, + 1.4044998697936535, + 0.3837058525532484, + 0.6692487113177776, + 1.121939430013299, + 3.555154988542199, + 5.182026643306017, + 1.469571890309453, + 0.7943624630570412, + 1.386411463841796, + 0.9728567060083151, + 2.4926282800734043, + 0.6650057788938284, + 1.465287609025836, + 1.4350692853331566, + 2.2704893071204424, + 1.2025189977139235, + 2.68633534014225, + 2.6622190289199352, + 0.0, + 0.7889392804354429, + 4.977137453854084, + 2.701936099678278, + 0.4706510715186596, + 0.8333234526216984, + 2.080449800938368, + 1.68155100569129, + 0.6141259893774986, + 3.5734406746923923, + 1.46457614377141, + 2.819019777700305, + 2.5447479393333197, + 1.2208271455019712, + 1.974338460713625, + 2.154625192284584, + 1.7058237995952368, + 3.962645623832941, + 1.255519038066268, + 1.0948625840246677, + 0.26795108057558537, + 0.9346458055078983, + 1.8584958668798208, + 0.21076666377484798, + 0.9843976441770792, + 0.5063683465123177, + 2.157740218564868, + 0.06946653872728348 + ], + "unique_experts": 62, + "load_cv": 0.6294209320276666, + "normalized_load_entropy": 0.9551386743970026, + "max_load_share": 0.06436314363143632 + }, + "full_input": { + "tokens": 271, + "top_k": 6, + "decisions": 1626, + "ordered_route_sha256": "f5a5c6ee936fcb272fbd2afac44097dfd1987b6d5251bb0f40422557b5cb13b6", + "route_weight_sha256": "542d261bd77fbb18eecd0ce6af407b1bb518131e494127c0af58ee108c2e10d0", + "loads": [ + 19, + 14, + 23, + 30, + 20, + 25, + 2, + 23, + 27, + 20, + 50, + 22, + 25, + 24, + 95, + 24, + 8, + 13, + 12, + 10, + 21, + 28, + 38, + 39, + 29, + 21, + 27, + 21, + 20, + 17, + 22, + 25, + 50, + 19, + 37, + 31, + 0, + 9, + 44, + 40, + 16, + 21, + 23, + 43, + 16, + 42, + 26, + 43, + 28, + 35, + 29, + 27, + 27, + 49, + 33, + 24, + 7, + 16, + 29, + 5, + 18, + 11, + 32, + 2 + ], + "weighted_loads": [ + 0.6988606955856085, + 0.5046172570437193, + 1.0293252784758806, + 2.8361522424966097, + 1.0714689120650291, + 3.6839121617376804, + 0.0987420380115509, + 1.376341549679637, + 1.6186831910163164, + 0.8743252893909812, + 6.147373381070793, + 1.3348796758800745, + 0.9517546985298395, + 1.5683738440275192, + 7.357931587845087, + 1.298774540424347, + 0.4373498596251011, + 1.1071698181331158, + 1.7556226514279842, + 0.3837058525532484, + 0.9253912307322025, + 1.1682946253567934, + 3.555154988542199, + 5.451024634763598, + 1.9477170202881098, + 1.2579842060804367, + 2.042374512180686, + 1.0982848275452852, + 2.64247877150774, + 0.7415597159415483, + 1.465287609025836, + 1.4350692853331566, + 2.6568330321460962, + 1.2025189977139235, + 2.68633534014225, + 2.6622190289199352, + 0.0, + 0.7889392804354429, + 5.13584927469492, + 2.701936099678278, + 1.3292306326329708, + 1.0241925865411758, + 2.2939796447753906, + 1.7004080712795258, + 0.6141259893774986, + 4.410405192524195, + 1.46457614377141, + 2.819019777700305, + 2.5447479393333197, + 1.2542837765067816, + 2.1069029606878757, + 2.154625192284584, + 1.8591780792921782, + 3.962645623832941, + 1.2992476839572191, + 1.6030362136662006, + 0.26795108057558537, + 1.1471017152071, + 1.8584958668798208, + 0.21076666377484798, + 0.9843976441770792, + 0.5620960257947445, + 2.5707953590899706, + 0.06946653872728348 + ], + "unique_experts": 63, + "load_cv": 0.5719001679168614, + "normalized_load_entropy": 0.9620441198674177, + "max_load_share": 0.05842558425584256 + } + }, + "s1_period": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "95cc5aad07535dccadaea61721b907118679b758298eaba484c5a45bb460393e", + "route_weight_sha256": "1631cfc35a7bc787062567761822dae4e39f352ea924cd7f4b65156ea3ff3b82", + "loads": [ + 15, + 11, + 22, + 23, + 22, + 27, + 0, + 26, + 27, + 14, + 43, + 19, + 27, + 17, + 99, + 26, + 10, + 6, + 11, + 10, + 19, + 24, + 34, + 33, + 24, + 13, + 21, + 20, + 16, + 14, + 20, + 24, + 43, + 18, + 42, + 31, + 0, + 9, + 40, + 39, + 8, + 15, + 20, + 33, + 18, + 38, + 24, + 44, + 29, + 28, + 27, + 27, + 25, + 50, + 28, + 17, + 8, + 11, + 29, + 6, + 17, + 10, + 22, + 3 + ], + "weighted_loads": [ + 0.5707815028727055, + 0.3676571976393461, + 0.9720263425260782, + 2.5431524608284235, + 1.133586285635829, + 3.6850012950599194, + 0.0, + 1.5210958234965801, + 1.6475620903074741, + 0.6851622350513935, + 5.598530109040439, + 1.2212725970894098, + 1.055777482688427, + 1.0310104545205832, + 7.66945681348443, + 1.3709924798458815, + 0.509447954595089, + 0.4248074069619179, + 1.3976090624928474, + 0.3796485308557749, + 0.69776233099401, + 0.9937161654233932, + 3.313605163246393, + 5.248417519032955, + 1.4403104986995459, + 0.8350337874144316, + 1.501746173016727, + 1.026692220941186, + 2.497144116088748, + 0.5951996315270662, + 1.4057109355926514, + 1.4177797604352236, + 2.242505233734846, + 1.179441973567009, + 2.856505872681737, + 2.694857293739915, + 0.0, + 0.7761594820767641, + 4.989065710455179, + 2.670223703607917, + 0.449434369802475, + 0.7327359709888697, + 2.043234210461378, + 1.3936038203537464, + 0.7037616893649101, + 3.591248221695423, + 1.3167400415986776, + 2.8652503192424774, + 2.5734043810516596, + 1.0615626852959394, + 1.9862738670781255, + 2.171353604644537, + 1.7430115938186646, + 4.041530570015311, + 1.0445091240108013, + 1.0705781299620867, + 0.3060589339584112, + 0.8592890240252018, + 1.8820830453187227, + 0.3001712132245302, + 0.9551661275327206, + 0.47862282022833824, + 2.086964711546898, + 0.13302048295736313 + ], + "unique_experts": 62, + "load_cv": 0.6361063449496307, + "normalized_load_entropy": 0.9556541975244986, + "max_load_share": 0.06707317073170732 + }, + "full_input": { + "tokens": 287, + "top_k": 6, + "decisions": 1722, + "ordered_route_sha256": "c6c49ef55d1ce08274406ae17ddb8ba3313a08314b7ef9337bd806c677960436", + "route_weight_sha256": "b96ae336723cf932d9cc63dea3ab754f8fc062abb9579cec46dc9c37e7a4a69a", + "loads": [ + 21, + 12, + 24, + 30, + 28, + 27, + 3, + 27, + 27, + 19, + 51, + 21, + 27, + 25, + 99, + 33, + 11, + 14, + 15, + 10, + 19, + 25, + 34, + 43, + 34, + 37, + 32, + 22, + 16, + 16, + 22, + 25, + 47, + 18, + 42, + 31, + 4, + 11, + 43, + 40, + 21, + 21, + 27, + 34, + 20, + 43, + 26, + 46, + 29, + 28, + 29, + 33, + 29, + 50, + 29, + 27, + 15, + 26, + 30, + 8, + 18, + 15, + 30, + 3 + ], + "weighted_loads": [ + 0.8294654358178377, + 0.4107821900397539, + 1.0639346484094858, + 3.2219703253358603, + 1.5320926140993834, + 3.6850012950599194, + 0.11966345459222794, + 1.575146820396185, + 1.6475620903074741, + 0.8442510049790144, + 6.10694479290396, + 1.2884249370545149, + 1.055777482688427, + 1.642122296616435, + 7.66945681348443, + 1.69418759457767, + 0.6450489982962608, + 1.0903845988214016, + 1.5832934454083443, + 0.3796485308557749, + 0.69776233099401, + 1.0700835809111595, + 3.313605163246393, + 5.933572003617883, + 2.124676523730159, + 2.4434672370553017, + 2.3162526665255427, + 1.1028899755328894, + 2.497144116088748, + 0.723290940746665, + 1.5012388862669468, + 1.4574052896350622, + 2.420213321223855, + 1.179441973567009, + 2.856505872681737, + 2.694857293739915, + 0.2255401499569416, + 0.8489427305757999, + 5.282485201954842, + 2.703453766182065, + 1.9836992546916008, + 1.109339026734233, + 2.326733149588108, + 1.4124608859419823, + 0.9362625256180763, + 4.965258419513702, + 1.540652235969901, + 2.9985738396644592, + 2.5734043810516596, + 1.0615626852959394, + 2.1815156461670995, + 2.4630899224430323, + 2.002317577600479, + 4.041530570015311, + 1.1325633190572262, + 1.7867572531104088, + 0.9243000280112028, + 1.696142591536045, + 1.905430493876338, + 0.39282836951315403, + 0.9901574067771435, + 0.7522189579904079, + 2.661884941160679, + 0.13302048295736313 + ], + "unique_experts": 64, + "load_cv": 0.531395377103512, + "normalized_load_entropy": 0.9687662060406923, + "max_load_share": 0.05749128919860627 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 246, + "ordered_topk_exact_tokens": 175, + "set_exact_tokens": 197, + "mean_set_jaccard": 0.9422183507549361, + "mean_token_weighted_tv": 0.013613613345092389, + "aggregate_load_tv": 0.01897018970189702 + }, + "system_bos": { + "tokens": 246, + "ordered_topk_exact_tokens": 149, + "set_exact_tokens": 181, + "mean_set_jaccard": 0.9210220673635308, + "mean_token_weighted_tv": 0.01863599991107859, + "aggregate_load_tv": 0.02506775067750677 + }, + "system_x": { + "tokens": 246, + "ordered_topk_exact_tokens": 120, + "set_exact_tokens": 148, + "mean_set_jaccard": 0.8745855770246014, + "mean_token_weighted_tv": 0.028202983353862433, + "aggregate_load_tv": 0.02777777777777777 + }, + "system_period": { + "tokens": 246, + "ordered_topk_exact_tokens": 117, + "set_exact_tokens": 156, + "mean_set_jaccard": 0.8890243902439023, + "mean_token_weighted_tv": 0.025237084428847926, + "aggregate_load_tv": 0.033875338753387524 + }, + "bos_at_s0": { + "tokens": 246, + "ordered_topk_exact_tokens": 139, + "set_exact_tokens": 172, + "mean_set_jaccard": 0.9093495934959349, + "mean_token_weighted_tv": 0.019699630598212038, + "aggregate_load_tv": 0.026422764227642285 + }, + "bos_at_s1": { + "tokens": 246, + "ordered_topk_exact_tokens": 124, + "set_exact_tokens": 155, + "mean_set_jaccard": 0.8819589624467673, + "mean_token_weighted_tv": 0.024158103552427354, + "aggregate_load_tv": 0.03252032520325202 + }, + "x_at_s0": { + "tokens": 246, + "ordered_topk_exact_tokens": 109, + "set_exact_tokens": 141, + "mean_set_jaccard": 0.8704026325977544, + "mean_token_weighted_tv": 0.027423265123194675, + "aggregate_load_tv": 0.03184281842818428 + }, + "x_at_s1": { + "tokens": 246, + "ordered_topk_exact_tokens": 106, + "set_exact_tokens": 141, + "mean_set_jaccard": 0.8616161616161615, + "mean_token_weighted_tv": 0.030245810745253673, + "aggregate_load_tv": 0.039972899728997285 + }, + "period_at_s0": { + "tokens": 246, + "ordered_topk_exact_tokens": 125, + "set_exact_tokens": 157, + "mean_set_jaccard": 0.8889856755710414, + "mean_token_weighted_tv": 0.02495662511015932, + "aggregate_load_tv": 0.02913279132791328 + }, + "period_at_s1": { + "tokens": 246, + "ordered_topk_exact_tokens": 110, + "set_exact_tokens": 140, + "mean_set_jaccard": 0.8628743884841444, + "mean_token_weighted_tv": 0.029291720911330445, + "aggregate_load_tv": 0.03861788617886178 + } + } + }, + "layer_18": { + "layer": 18, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "3030b0e9071bff0d47b6b0c458af4da50bd23be88e63d4c74c02669e80d3cd67", + "route_weight_sha256": "b5170ed05ee3d55f86a9504902f91cf71b5bf983827726d0193f800a30053ba0", + "loads": [ + 0, + 16, + 29, + 17, + 176, + 36, + 6, + 31, + 21, + 0, + 13, + 15, + 12, + 11, + 23, + 4, + 10, + 25, + 10, + 26, + 30, + 6, + 20, + 89, + 35, + 12, + 27, + 11, + 21, + 18, + 28, + 16, + 37, + 13, + 21, + 24, + 31, + 12, + 4, + 25, + 16, + 6, + 17, + 7, + 18, + 41, + 10, + 35, + 11, + 32, + 13, + 18, + 20, + 12, + 20, + 24, + 7, + 10, + 30, + 26, + 69, + 6, + 37, + 30 + ], + "weighted_loads": [ + 0.0, + 0.7899407278746367, + 3.143274776637554, + 1.0420586727559566, + 17.37841458618641, + 1.8883927948772907, + 0.25546994991600513, + 2.461148865520954, + 2.923224311321974, + 0.0, + 0.7732202336192131, + 0.7513619568198919, + 1.0827408619225025, + 0.8013622993603349, + 1.738531220704317, + 0.15681767091155052, + 0.6767462603747845, + 0.8729653228074312, + 0.7897075358778238, + 2.1742274686694145, + 1.8493933826684952, + 0.19204390048980713, + 1.4052734337747097, + 8.209570150822401, + 1.8015164993703365, + 0.653257355093956, + 1.3360090721398592, + 0.5427286177873611, + 1.1513167414814234, + 0.7833341360092163, + 2.5575597751885653, + 0.7340519670397043, + 4.972338888794184, + 0.4859137535095215, + 1.2950787618756294, + 0.9411666411906481, + 1.3073498886078596, + 0.4530324749648571, + 0.1444765217602253, + 0.989520164206624, + 0.8726742342114449, + 0.30520285479724407, + 0.7566675767302513, + 0.298012088984251, + 0.6947153024375439, + 2.5775256268680096, + 0.5213708132505417, + 2.118241675198078, + 0.39845939353108406, + 2.0651820711791515, + 0.4790578093379736, + 0.7371174283325672, + 2.656037947162986, + 0.6166345905512571, + 1.240048609673977, + 1.9191059283912182, + 0.2527438197284937, + 0.5327071379870176, + 3.538526825606823, + 2.4056100323796272, + 3.3593257926404476, + 0.18243014626204967, + 1.4837462771683931, + 2.511071177199483 + ], + "unique_experts": 62, + "load_cv": 1.0461090743677137, + "normalized_load_entropy": 0.9183147417170574, + "max_load_share": 0.11924119241192412 + }, + "full_input": { + "tokens": 271, + "top_k": 6, + "decisions": 1626, + "ordered_route_sha256": "1c6153490eda843838d51e6860ce57c8623a9d8cb0a462e347aecddeda00589e", + "route_weight_sha256": "6a5fb6d2cf5203bcd516d68a8d879f0ca56d881196907447f9c29256a15ec1c9", + "loads": [ + 6, + 17, + 41, + 17, + 177, + 38, + 6, + 31, + 29, + 0, + 14, + 19, + 13, + 11, + 28, + 8, + 10, + 25, + 28, + 26, + 30, + 7, + 20, + 89, + 35, + 12, + 27, + 11, + 21, + 18, + 36, + 16, + 38, + 13, + 21, + 27, + 32, + 15, + 4, + 28, + 23, + 6, + 20, + 7, + 18, + 41, + 18, + 35, + 14, + 44, + 15, + 20, + 29, + 21, + 20, + 24, + 9, + 11, + 31, + 30, + 69, + 8, + 37, + 32 + ], + "weighted_loads": [ + 0.3820706233382225, + 0.8605496045202017, + 4.164156213402748, + 1.0420586727559566, + 17.410517934709787, + 1.9374766610562801, + 0.25546994991600513, + 2.461148865520954, + 3.4017326310276985, + 0.0, + 0.7840409958735108, + 1.149062080308795, + 1.1155732609331608, + 0.8013622993603349, + 2.699553996324539, + 0.2860385924577713, + 0.6767462603747845, + 0.8729653228074312, + 1.867016403004527, + 2.1742274686694145, + 1.8493933826684952, + 0.21748525463044643, + 1.4052734337747097, + 8.209570150822401, + 1.8015164993703365, + 0.653257355093956, + 1.3360090721398592, + 0.5427286177873611, + 1.1513167414814234, + 0.7833341360092163, + 2.938985265791416, + 0.7340519670397043, + 5.001087320968509, + 0.4859137535095215, + 1.2950787618756294, + 1.0836398843675852, + 1.3309401869773865, + 0.5497696995735168, + 0.1444765217602253, + 1.0902215112000704, + 1.2531094253063202, + 0.30520285479724407, + 0.8403869438916445, + 0.298012088984251, + 0.6947153024375439, + 2.5775256268680096, + 2.1915926560759544, + 2.118241675198078, + 0.5434949845075607, + 2.5961340200155973, + 0.5406822673976421, + 0.8966194503009319, + 3.265096504241228, + 1.2270749192684889, + 1.240048609673977, + 1.9191059283912182, + 1.2511400822550058, + 0.5654168855398893, + 3.567284431308508, + 2.5937337297946215, + 3.3593257926404476, + 0.23686443269252777, + 1.4837462771683931, + 2.60644699819386 + ], + "unique_experts": 63, + "load_cv": 0.9461017625929004, + "normalized_load_entropy": 0.9307515014116305, + "max_load_share": 0.1088560885608856 + } + }, + "s1_eos": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "279e499623af62ec4e554f82535868a527ab3fbb88cc475162de467a27676dd7", + "route_weight_sha256": "f581a9c8544525c474ccc1e39bbb3631271044ff0d8b0ac703d7d911166f65fd", + "loads": [ + 0, + 16, + 27, + 17, + 171, + 35, + 7, + 30, + 20, + 0, + 13, + 16, + 10, + 12, + 24, + 3, + 12, + 24, + 8, + 26, + 31, + 4, + 20, + 89, + 35, + 13, + 26, + 11, + 22, + 17, + 29, + 14, + 38, + 16, + 23, + 23, + 28, + 11, + 3, + 23, + 15, + 5, + 20, + 8, + 22, + 41, + 9, + 33, + 14, + 31, + 14, + 19, + 20, + 11, + 20, + 27, + 7, + 10, + 30, + 28, + 68, + 9, + 36, + 32 + ], + "weighted_loads": [ + 0.0, + 0.7706352435052395, + 3.0851959213614464, + 1.0384740084409714, + 16.88689155690372, + 1.8873393703252077, + 0.3036898151040077, + 2.4025656282901764, + 2.833372078835964, + 0.0, + 0.78166563808918, + 0.7786172349005938, + 0.9480869751423597, + 0.8400654122233391, + 1.759755291044712, + 0.11129048094153404, + 0.7419524043798447, + 0.8365296106785536, + 0.7817555852234364, + 2.104282721877098, + 1.888709293678403, + 0.13836746849119663, + 1.4330902993679047, + 8.326694888994098, + 1.8261203970760107, + 0.6847899574786425, + 1.2878593914210796, + 0.5385148711502552, + 1.1782147753983736, + 0.7634786702692509, + 2.6122102346271276, + 0.7038341127336025, + 4.9682438634335995, + 0.574615428224206, + 1.3124507125467062, + 0.9167985841631889, + 1.2294804826378822, + 0.45416633039712906, + 0.10589110292494297, + 0.9195188488811255, + 0.8693527858704329, + 0.25881750509142876, + 0.8743160180747509, + 0.3350820243358612, + 0.8080774247646332, + 2.602609733119607, + 0.4626692347228527, + 2.087435705587268, + 0.4825119152665138, + 2.0320518668740988, + 0.5007531139999628, + 0.7922216709703207, + 2.752525679767132, + 0.5976693108677864, + 1.247384063899517, + 1.9911129493266344, + 0.273307915776968, + 0.5435864999890327, + 3.491829166188836, + 2.4553311560302973, + 3.30689337849617, + 0.2841246481984854, + 1.4509539809077978, + 2.5142444372177124 + ], + "unique_experts": 62, + "load_cv": 1.0217017817769676, + "normalized_load_entropy": 0.9201794311632611, + "max_load_share": 0.11585365853658537 + }, + "full_input": { + "tokens": 287, + "top_k": 6, + "decisions": 1722, + "ordered_route_sha256": "7d5f0f265e62f07a86e4836e0d30801a234460c16f27f914199d3d47e86045c0", + "route_weight_sha256": "37d30302d7e9878ac999510c29472462fb8d58603a3dc366976cb23072ad9b92", + "loads": [ + 7, + 19, + 40, + 17, + 172, + 38, + 7, + 32, + 30, + 1, + 14, + 20, + 10, + 13, + 33, + 6, + 12, + 35, + 30, + 27, + 31, + 4, + 20, + 89, + 35, + 13, + 26, + 11, + 22, + 18, + 42, + 16, + 40, + 17, + 27, + 38, + 29, + 17, + 4, + 26, + 22, + 5, + 23, + 13, + 22, + 41, + 27, + 36, + 18, + 45, + 15, + 21, + 29, + 24, + 22, + 28, + 10, + 16, + 32, + 32, + 68, + 11, + 36, + 38 + ], + "weighted_loads": [ + 0.3693000581115484, + 0.9095604047179222, + 4.194267185404897, + 1.0384740084409714, + 16.925512751564384, + 1.9754930306226015, + 0.3036898151040077, + 2.4713277854025364, + 3.710528064519167, + 0.03710007295012474, + 0.7934121061116457, + 1.145941125229001, + 0.9480869751423597, + 0.8816728964447975, + 2.930090105161071, + 0.19355281814932823, + 0.7419524043798447, + 1.4711763951927423, + 2.596714871004224, + 2.2401637732982635, + 1.888709293678403, + 0.13836746849119663, + 1.4330902993679047, + 8.326694888994098, + 1.8261203970760107, + 0.6847899574786425, + 1.2878593914210796, + 0.5385148711502552, + 1.1782147753983736, + 0.8002794608473778, + 3.321609942242503, + 0.9492393508553505, + 5.052609274163842, + 0.6514109466224909, + 1.7366704735904932, + 2.191319363191724, + 1.2529572769999504, + 0.7112097144126892, + 0.143633546307683, + 1.0115481968969107, + 1.2038140688091516, + 0.25881750509142876, + 0.9643795527517796, + 0.7910939604043961, + 0.8080774247646332, + 2.602609733119607, + 3.278348710387945, + 2.244206814095378, + 0.6162477191537619, + 2.6531503684818745, + 0.5270261354744434, + 0.9503500070422888, + 3.3251570519059896, + 1.4083850495517254, + 1.370147693902254, + 2.02547231502831, + 1.2855317555367947, + 0.8135473281145096, + 3.8260057773441076, + 2.7258611284196377, + 3.30689337849617, + 0.3484194688498974, + 1.4509539809077978, + 2.745936583727598 + ], + "unique_experts": 64, + "load_cv": 0.8709213947493751, + "normalized_load_entropy": 0.9380153125702784, + "max_load_share": 0.09988385598141696 + } + }, + "s0_bos": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "0b07152abcbe01c9d3bb88b78132f2df1f1a70aecdac34fb2adc0927f5dc2dc7", + "route_weight_sha256": "af24c3a78c45bfc50335232e9b8ac479bd90bf931a279db056c8cffd2c8b94d5", + "loads": [ + 0, + 13, + 29, + 18, + 175, + 36, + 6, + 32, + 23, + 0, + 12, + 15, + 10, + 12, + 24, + 4, + 12, + 20, + 12, + 25, + 32, + 4, + 17, + 89, + 37, + 12, + 26, + 11, + 22, + 16, + 31, + 15, + 37, + 15, + 22, + 22, + 28, + 10, + 4, + 33, + 15, + 6, + 13, + 7, + 18, + 41, + 10, + 34, + 12, + 32, + 13, + 17, + 19, + 12, + 22, + 24, + 6, + 10, + 32, + 25, + 72, + 6, + 37, + 32 + ], + "weighted_loads": [ + 0.0, + 0.6827373169362545, + 3.1661835946142673, + 1.090727610513568, + 17.66556983627379, + 1.9138497468084097, + 0.2287786602973938, + 2.546492511406541, + 3.062986133620143, + 0.0, + 0.7503229808062315, + 0.7532373126596212, + 0.9377757236361504, + 0.8747996240854263, + 1.8228931818157434, + 0.1634595599025488, + 0.746547270566225, + 0.7291771322488785, + 0.9897988419979811, + 2.1507557220757008, + 1.9321928173303604, + 0.1324884444475174, + 1.2533169630914927, + 8.038582671433687, + 1.8439711891114712, + 0.6584322694689035, + 1.292135450989008, + 0.5554707683622837, + 1.1913394667208195, + 0.7357518579810858, + 2.5801299195736647, + 0.7372679747641087, + 4.981210593134165, + 0.5480704382061958, + 1.3562546614557505, + 0.9108027145266533, + 1.1762643288820982, + 0.35671351850032806, + 0.15111122466623783, + 1.2382897306233644, + 0.823661694303155, + 0.3004328217357397, + 0.6440307293087244, + 0.3088127765804529, + 0.6913204304873943, + 2.619624061509967, + 0.5425817891955376, + 2.105305891484022, + 0.42912311665713787, + 2.0628029629588127, + 0.462420467287302, + 0.697077289223671, + 2.472539624199271, + 0.645901421085, + 1.3004660103470087, + 1.9325400069355965, + 0.19649461470544338, + 0.5277209226042032, + 3.6903887633234262, + 2.3520737010985613, + 3.4712664633989334, + 0.18411781452596188, + 1.479716144502163, + 2.632789606228471 + ], + "unique_experts": 62, + "load_cv": 1.0522131732878683, + "normalized_load_entropy": 0.9161927855058805, + "max_load_share": 0.11856368563685638 + }, + "full_input": { + "tokens": 271, + "top_k": 6, + "decisions": 1626, + "ordered_route_sha256": "50824f583dd9980e15bae8c1279d07a2157c31bd3e2d9285a9f5d13fb3ccc937", + "route_weight_sha256": "8c4916818acbc2f2aa9320304bb8482144c2f4e0b46521599b7a485f543dcb15", + "loads": [ + 6, + 14, + 40, + 18, + 176, + 38, + 6, + 32, + 31, + 0, + 12, + 18, + 12, + 12, + 29, + 7, + 12, + 20, + 30, + 25, + 32, + 5, + 17, + 91, + 37, + 12, + 27, + 11, + 22, + 16, + 37, + 15, + 38, + 16, + 22, + 25, + 28, + 13, + 4, + 38, + 23, + 7, + 17, + 7, + 18, + 41, + 19, + 34, + 15, + 43, + 15, + 19, + 28, + 20, + 22, + 24, + 7, + 10, + 33, + 28, + 72, + 9, + 37, + 34 + ], + "weighted_loads": [ + 0.3820706233382225, + 0.7533461935818195, + 4.16064034961164, + 1.090727610513568, + 17.69829917512834, + 1.962933612987399, + 0.2287786602973938, + 2.546492511406541, + 3.5414944533258677, + 0.0, + 0.7503229808062315, + 1.0244847442954779, + 1.2000132724642754, + 0.8747996240854263, + 2.701803119853139, + 0.2587025184184313, + 0.746547270566225, + 0.7291771322488785, + 2.0493817050009966, + 2.1507557220757008, + 1.9321928173303604, + 0.1579297985881567, + 1.2533169630914927, + 8.121194537729025, + 1.8439711891114712, + 0.6584322694689035, + 1.342189747840166, + 0.5554707683622837, + 1.1913394667208195, + 0.7357518579810858, + 2.9023414719849825, + 0.7372679747641087, + 5.021970685571432, + 0.6125389561057091, + 1.3562546614557505, + 1.053810928016901, + 1.1762643288820982, + 0.4487962406128645, + 0.15111122466623783, + 1.48125964961946, + 1.292186176404357, + 0.36640934459865093, + 0.7984678111970425, + 0.3088127765804529, + 0.6913204304873943, + 2.619624061509967, + 2.204302828758955, + 2.105305891484022, + 0.5741587076336145, + 2.551310868933797, + 0.5235585700720549, + 0.8555536344647408, + 3.0815981812775135, + 1.232893569394946, + 1.3004660103470087, + 1.9325400069355965, + 0.41929992102086544, + 0.5277209226042032, + 3.719146369025111, + 2.496830342337489, + 3.4712664633989334, + 0.2732561379671097, + 1.479716144502163, + 2.728165427222848 + ], + "unique_experts": 63, + "load_cv": 0.9552176056911014, + "normalized_load_entropy": 0.9284913295042453, + "max_load_share": 0.10824108241082411 + } + }, + "s1_bos": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "89143f029680d9bc943bc0347ea3a8c0333fa41eb705479cfb689c4795b8c3fb", + "route_weight_sha256": "b2fb2f48300e5bec9d139383dacf430ebd8d743d7f11e6a8397cbdd905dc5271", + "loads": [ + 0, + 11, + 29, + 18, + 174, + 34, + 7, + 34, + 22, + 0, + 13, + 13, + 10, + 13, + 25, + 4, + 12, + 21, + 8, + 25, + 32, + 3, + 20, + 91, + 34, + 12, + 26, + 11, + 26, + 17, + 29, + 15, + 38, + 12, + 22, + 23, + 28, + 9, + 2, + 26, + 16, + 5, + 16, + 7, + 22, + 42, + 9, + 35, + 16, + 31, + 14, + 18, + 20, + 12, + 20, + 25, + 6, + 10, + 32, + 26, + 67, + 8, + 37, + 33 + ], + "weighted_loads": [ + 0.0, + 0.6134092435240746, + 3.156237566843629, + 1.0882096253335476, + 17.426724718883634, + 1.850006541237235, + 0.30098089389503, + 2.5962645020335913, + 2.968635842204094, + 0.0, + 0.8081332929432392, + 0.6873150318861008, + 0.903374457731843, + 0.8756554573774338, + 1.8024724423885345, + 0.17351115122437477, + 0.7321383580565453, + 0.7699571270495653, + 0.935657475143671, + 2.1235721856355667, + 1.9397688806056976, + 0.10873008891940117, + 1.392756273970008, + 8.292696997523308, + 1.7326833121478558, + 0.6465583797544241, + 1.3373852893710136, + 0.5520110949873924, + 1.327550157904625, + 0.7712429109960794, + 2.52831550501287, + 0.7175255846232176, + 4.948375169187784, + 0.442557405680418, + 1.3384013045579195, + 0.9475762378424406, + 1.1895388718694448, + 0.3255156632512808, + 0.07873829081654549, + 1.0155729912221432, + 0.8777371160686016, + 0.235073359683156, + 0.7396884616464376, + 0.30504246428608894, + 0.821654412895441, + 2.6533475555479527, + 0.4916825033724308, + 2.1377716921269894, + 0.5436859522014856, + 2.071136225014925, + 0.5008531007915735, + 0.7588944137096405, + 2.598652830347419, + 0.6257592216134071, + 1.2411970924586058, + 1.9424583725631237, + 0.21394772827625275, + 0.5405423790216446, + 3.599303824827075, + 2.3734683506190777, + 3.306946886703372, + 0.2481000330299139, + 1.5199562162160873, + 2.688279442489147 + ], + "unique_experts": 62, + "load_cv": 1.0449570720830863, + "normalized_load_entropy": 0.9163952887741639, + "max_load_share": 0.11788617886178862 + }, + "full_input": { + "tokens": 287, + "top_k": 6, + "decisions": 1722, + "ordered_route_sha256": "916a08cf53d0eb01aacf741af0a66465cbcb9002fb3a39998aa6bd5f36b22ab9", + "route_weight_sha256": "4b17677058a5691889e59b888e41bf71361d262ddd216dd03d844d32a707cc87", + "loads": [ + 7, + 14, + 40, + 18, + 176, + 37, + 7, + 36, + 32, + 1, + 13, + 17, + 10, + 14, + 34, + 8, + 12, + 31, + 30, + 26, + 32, + 3, + 20, + 92, + 34, + 12, + 26, + 11, + 26, + 18, + 41, + 17, + 40, + 13, + 26, + 37, + 28, + 15, + 3, + 29, + 24, + 6, + 20, + 12, + 22, + 42, + 28, + 38, + 20, + 45, + 15, + 20, + 29, + 25, + 22, + 26, + 8, + 15, + 34, + 31, + 67, + 11, + 37, + 39 + ], + "weighted_loads": [ + 0.3693000581115484, + 0.7523344047367573, + 4.203034374862909, + 1.0882096253335476, + 17.49572497047484, + 1.9381602015346289, + 0.30098089389503, + 2.6650266591459513, + 3.8457918278872967, + 0.03710007295012474, + 0.8081332929432392, + 1.0327944904565811, + 0.903374457731843, + 0.9172629415988922, + 3.1066123750060797, + 0.28881167620420456, + 0.7321383580565453, + 1.3660195004194975, + 2.760282864794135, + 2.259453237056732, + 1.9397688806056976, + 0.10873008891940117, + 1.392756273970008, + 8.325073953717947, + 1.7326833121478558, + 0.6465583797544241, + 1.3373852893710136, + 0.5520110949873924, + 1.327550157904625, + 0.8080437015742064, + 3.241050846874714, + 0.9629308227449656, + 5.037326943129301, + 0.5193529240787029, + 1.7626210656017065, + 2.2045862805098295, + 1.1895388718694448, + 0.5783840138465166, + 0.11648073419928551, + 1.0966789312660694, + 1.2572997063398361, + 0.27716449834406376, + 0.8811915032565594, + 0.7610544003546238, + 0.821654412895441, + 2.6533475555479527, + 3.3210683576762676, + 2.2945428006350994, + 0.6774217560887337, + 2.708120098337531, + 0.5271261222660542, + 0.9149308353662491, + 3.1712842024862766, + 1.4158052615821362, + 1.3639607224613428, + 1.9768177382647991, + 0.47409822046756744, + 0.7778196446597576, + 3.9334804359823465, + 2.7552820965647697, + 3.306946886703372, + 0.35490885004401207, + 1.5199562162160873, + 2.919971588999033 + ], + "unique_experts": 64, + "load_cv": 0.8943232724314709, + "normalized_load_entropy": 0.9350585702838102, + "max_load_share": 0.10220673635307782 + } + }, + "s0_x": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "89dd93f57d0244dc81937eebcbae31a1a6a8a0312db2ce622ada033657921392", + "route_weight_sha256": "f36419d2e1be8b39782272a2dd7d5b479f471882c067043571a54e1c9bd941ef", + "loads": [ + 0, + 12, + 32, + 18, + 173, + 35, + 7, + 33, + 22, + 0, + 15, + 13, + 9, + 14, + 26, + 2, + 13, + 20, + 12, + 25, + 33, + 4, + 19, + 91, + 35, + 12, + 25, + 11, + 21, + 16, + 29, + 14, + 38, + 19, + 23, + 22, + 26, + 10, + 2, + 25, + 16, + 5, + 16, + 9, + 18, + 41, + 10, + 34, + 14, + 31, + 13, + 18, + 19, + 12, + 22, + 26, + 6, + 9, + 31, + 25, + 71, + 7, + 32, + 35 + ], + "weighted_loads": [ + 0.0, + 0.6440087426453829, + 3.4091591481119394, + 1.0837107133120298, + 17.45439617522061, + 1.8760832399129868, + 0.2973818723112345, + 2.533206358551979, + 2.931384539231658, + 0.0, + 0.8586223497986794, + 0.6830939222127199, + 0.8300489336252213, + 0.9948847591876984, + 1.8319114353507757, + 0.07960184663534164, + 0.7852795422077179, + 0.7018700577318668, + 0.9600462205708027, + 2.1538805067539215, + 1.9334154427051544, + 0.1489027589559555, + 1.4099767170846462, + 8.04988195002079, + 1.8537348434329033, + 0.6478816382586956, + 1.2587889395654202, + 0.5426937565207481, + 1.1654542721807957, + 0.7379774823784828, + 2.631736731156707, + 0.6707435343414545, + 5.033688522875309, + 0.6675504166632891, + 1.3864973094314337, + 0.9013589713722467, + 1.099876830354333, + 0.37967127561569214, + 0.09664753451943398, + 0.964874766767025, + 0.8247313071042299, + 0.2303619384765625, + 0.7428294438868761, + 0.36064587719738483, + 0.6665857210755348, + 2.531125260517001, + 0.5750541500747204, + 2.0945933181792498, + 0.4845620896667242, + 2.0640297401696444, + 0.4764646142721176, + 0.7232783958315849, + 2.4477927424013615, + 0.6432027854025364, + 1.3201912678778172, + 1.9655317608267069, + 0.2100389152765274, + 0.5078839287161827, + 3.7375186812132597, + 2.3889543656259775, + 3.401090580970049, + 0.22048992477357388, + 1.291765283793211, + 2.699935579672456 + ], + "unique_experts": 62, + "load_cv": 1.0421701583542715, + "normalized_load_entropy": 0.917021612239696, + "max_load_share": 0.11720867208672087 + }, + "full_input": { + "tokens": 271, + "top_k": 6, + "decisions": 1626, + "ordered_route_sha256": "02c72345d22d99e39c52c4bdfbd57dd417b7bcf075ca9b59c2a5b5f4e348b85d", + "route_weight_sha256": "3c84d1c961afdcff7391ac64e2a1382f9eef6d39fbe4185b5cf81c7750c5c95a", + "loads": [ + 7, + 13, + 44, + 18, + 173, + 37, + 7, + 33, + 30, + 0, + 15, + 17, + 10, + 14, + 31, + 5, + 13, + 20, + 31, + 25, + 33, + 5, + 19, + 91, + 35, + 12, + 25, + 11, + 21, + 16, + 36, + 14, + 39, + 20, + 23, + 26, + 26, + 13, + 2, + 28, + 23, + 5, + 18, + 9, + 18, + 41, + 18, + 34, + 18, + 43, + 14, + 21, + 29, + 21, + 22, + 26, + 7, + 10, + 34, + 27, + 71, + 9, + 32, + 38 + ], + "weighted_loads": [ + 0.4255799949169159, + 0.7146176192909479, + 4.569640766829252, + 1.0837107133120298, + 17.45439617522061, + 1.9251671060919762, + 0.2973818723112345, + 2.533206358551979, + 3.4098928589373827, + 0.0, + 0.8586223497986794, + 1.062896365299821, + 0.8771587274968624, + 0.9948847591876984, + 2.794450419023633, + 0.17484480515122414, + 0.7852795422077179, + 0.7018700577318668, + 2.140337435528636, + 2.1538805067539215, + 1.9334154427051544, + 0.1743441130965948, + 1.4099767170846462, + 8.04988195002079, + 1.8537348434329033, + 0.6478816382586956, + 1.2587889395654202, + 0.5426937565207481, + 1.1654542721807957, + 0.7379774823784828, + 2.9677926432341337, + 0.6707435343414545, + 5.069949068129063, + 0.7106077279895544, + 1.3864973094314337, + 1.072947258129716, + 1.099876830354333, + 0.47665903717279434, + 0.09664753451943398, + 1.047377347946167, + 1.2088162284344435, + 0.2303619384765625, + 0.7966957651078701, + 0.36064587719738483, + 0.6665857210755348, + 2.531125260517001, + 2.224742654711008, + 2.0945933181792498, + 0.670939052477479, + 2.5851332545280457, + 0.5026365164667368, + 0.9216694124042988, + 3.154530944302678, + 1.2349247448146343, + 1.3201912678778172, + 1.9655317608267069, + 0.43284422159194946, + 0.537018982693553, + 3.8675828594714403, + 2.4647963400930166, + 3.401090580970049, + 0.27492421120405197, + 1.291765283793211, + 2.874474475160241 + ], + "unique_experts": 63, + "load_cv": 0.9411764455581388, + "normalized_load_entropy": 0.9294940618980709, + "max_load_share": 0.10639606396063961 + } + }, + "s1_x": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "44a73e830dcfd93cf516f0b2f825e6c1b2e4cfaef3bcf799857c6ea3d60090c1", + "route_weight_sha256": "64d1009f8c45318a380dbd61df34717eb7f2695155d2a4e7593d0e5b6117f61e", + "loads": [ + 0, + 11, + 30, + 18, + 173, + 34, + 7, + 32, + 22, + 0, + 14, + 15, + 11, + 13, + 25, + 3, + 11, + 22, + 10, + 26, + 32, + 5, + 18, + 94, + 35, + 13, + 28, + 11, + 27, + 17, + 30, + 13, + 38, + 13, + 22, + 24, + 28, + 8, + 5, + 25, + 16, + 4, + 17, + 7, + 17, + 42, + 10, + 35, + 12, + 30, + 12, + 18, + 20, + 13, + 22, + 26, + 6, + 7, + 30, + 26, + 68, + 7, + 36, + 32 + ], + "weighted_loads": [ + 0.0, + 0.5968812499195337, + 3.2250797376036644, + 1.0929595474153757, + 17.471359200775623, + 1.868422705680132, + 0.2765431012958288, + 2.506460841745138, + 3.0347137544304132, + 0.0, + 0.8497307561337948, + 0.76915243268013, + 0.8249047715216875, + 0.8983283098787069, + 1.8135837633162737, + 0.1204071082174778, + 0.7222083434462547, + 0.7707333881407976, + 0.9214506633579731, + 2.188713386654854, + 1.9536339305341244, + 0.17037159763276577, + 1.303970681503415, + 8.39925898052752, + 1.831585394218564, + 0.6712013203650713, + 1.3950867913663387, + 0.5737453512847424, + 1.3567755818367004, + 0.776817362755537, + 2.60638746060431, + 0.6412847824394703, + 5.007075781002641, + 0.4423802625387907, + 1.338470235466957, + 1.0285342168062925, + 1.1739111747592688, + 0.2963815778493881, + 0.19873934797942638, + 0.9484341032803059, + 0.9026202261447906, + 0.19979770854115486, + 0.7896309811621904, + 0.3006803300231695, + 0.6544493474066257, + 2.6007788572460413, + 0.5182004552334547, + 2.1508227344602346, + 0.4327887296676636, + 2.044578207656741, + 0.43245102651417255, + 0.7343606427311897, + 2.6502257511019707, + 0.6702685188502073, + 1.3127655237913132, + 1.9729506894946098, + 0.23267126642167568, + 0.4430967755615711, + 3.6704994942992926, + 2.4286939781159163, + 3.3511097002774477, + 0.21507702767848969, + 1.4228084795176983, + 2.516823150217533 + ], + "unique_experts": 62, + "load_cv": 1.0470914881719036, + "normalized_load_entropy": 0.9163547500853381, + "max_load_share": 0.11720867208672087 + }, + "full_input": { + "tokens": 287, + "top_k": 6, + "decisions": 1722, + "ordered_route_sha256": "c861cff48afea963f4ff2d026f37ea0a2ea17eb32c495f70180f7abc62b4b67e", + "route_weight_sha256": "7e92be2ef59d5d414412e2fb85c5573e0b5e49a6bf7288b3772f076d60e6f6e8", + "loads": [ + 9, + 15, + 42, + 18, + 175, + 37, + 7, + 34, + 33, + 1, + 14, + 19, + 12, + 14, + 34, + 6, + 11, + 32, + 33, + 27, + 32, + 5, + 18, + 94, + 35, + 13, + 28, + 11, + 27, + 18, + 40, + 15, + 40, + 14, + 26, + 37, + 28, + 14, + 6, + 28, + 23, + 4, + 19, + 13, + 17, + 42, + 28, + 38, + 17, + 44, + 13, + 23, + 30, + 26, + 24, + 27, + 8, + 12, + 32, + 28, + 68, + 9, + 36, + 39 + ], + "weighted_loads": [ + 0.5259633343666792, + 0.7699314448982477, + 4.391875082626939, + 1.0929595474153757, + 17.5427475720644, + 1.9565763659775257, + 0.2765431012958288, + 2.575222998857498, + 3.9513097014278173, + 0.03710007295012474, + 0.8497307561337948, + 1.0820325165987015, + 0.8619219642132521, + 0.9399357941001654, + 2.886710822582245, + 0.202669445425272, + 0.7222083434462547, + 1.3667957615107298, + 2.8057455103844404, + 2.3245944380760193, + 1.9536339305341244, + 0.17037159763276577, + 1.303970681503415, + 8.39925898052752, + 1.831585394218564, + 0.6712013203650713, + 1.3950867913663387, + 0.5737453512847424, + 1.3567755818367004, + 0.8136181533336639, + 3.197641495615244, + 0.8866900205612183, + 5.096948189660907, + 0.5191757809370756, + 1.762689996510744, + 2.266799448058009, + 1.1739111747592688, + 0.5582053549587727, + 0.2364817913621664, + 1.0266901962459087, + 1.2145287804305553, + 0.19979770854115486, + 0.8442255575209856, + 0.8047165032476187, + 0.6544493474066257, + 2.6007788572460413, + 3.1457936372607946, + 2.3075938429683447, + 0.6040002461522818, + 2.6627785488963127, + 0.4587240479886532, + 1.052635919302702, + 3.3012136053293943, + 1.4104345422238111, + 1.4355291537940502, + 2.0073100551962852, + 0.4928217586129904, + 0.6803740411996841, + 4.004676105454564, + 2.6089416574686766, + 3.3511097002774477, + 0.2793718483299017, + 1.4228084795176983, + 2.816049713641405 + ], + "unique_experts": 64, + "load_cv": 0.8951675441583147, + "normalized_load_entropy": 0.9350579369652525, + "max_load_share": 0.1016260162601626 + } + }, + "s0_period": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "531b49f67d886a521f578146a131aca1c4339a5aacfb2f83a6ac37fc80a68918", + "route_weight_sha256": "958a1d0db5cdd6bf3ca567e07997b146726d294dd8e61501aa2cc318c6711594", + "loads": [ + 0, + 12, + 32, + 18, + 176, + 35, + 7, + 33, + 22, + 0, + 14, + 13, + 9, + 14, + 25, + 2, + 13, + 19, + 11, + 25, + 31, + 5, + 19, + 92, + 34, + 12, + 26, + 11, + 22, + 16, + 30, + 14, + 37, + 19, + 22, + 24, + 27, + 10, + 2, + 26, + 15, + 5, + 16, + 9, + 16, + 41, + 10, + 35, + 16, + 31, + 13, + 18, + 19, + 13, + 24, + 25, + 6, + 8, + 30, + 24, + 69, + 6, + 34, + 34 + ], + "weighted_loads": [ + 0.0, + 0.6375729460269213, + 3.3389547411352396, + 1.0764373056590557, + 17.79000641964376, + 1.8817068450152874, + 0.3176864143460989, + 2.554233018308878, + 2.9427499510347843, + 0.0, + 0.8053043279796839, + 0.679192652925849, + 0.7943672798573971, + 0.9795001279562712, + 1.8136036731302738, + 0.07742459140717983, + 0.7698719967156649, + 0.6730741988867521, + 0.9750235676765442, + 2.121335033327341, + 1.9025162477046251, + 0.17795342206954956, + 1.4051526207476854, + 8.140024200081825, + 1.8167100511491299, + 0.6451661661267281, + 1.3130650371313095, + 0.5511897876858711, + 1.1908941008150578, + 0.7385046985000372, + 2.6767746210098267, + 0.6742062121629715, + 5.010208040475845, + 0.6638346556574106, + 1.3639392498880625, + 0.9691717494279146, + 1.1215313579887152, + 0.38810477033257484, + 0.08348917961120605, + 1.018349414691329, + 0.8203924745321274, + 0.24336381442844868, + 0.739200696349144, + 0.36444648914039135, + 0.5929217971861362, + 2.5578754395246506, + 0.5786031521856785, + 2.143340840935707, + 0.563601166009903, + 2.0740963257849216, + 0.4844562541693449, + 0.7245379127562046, + 2.488808363676071, + 0.729506004601717, + 1.3596356306225061, + 1.9534418750554323, + 0.21883079037070274, + 0.4746798537671566, + 3.6441267784684896, + 2.3837347254157066, + 3.388451561331749, + 0.18058076314628124, + 1.3535844720900059, + 2.653087919577956 + ], + "unique_experts": 62, + "load_cv": 1.0543329000586679, + "normalized_load_entropy": 0.9160634929880414, + "max_load_share": 0.11924119241192412 + }, + "full_input": { + "tokens": 271, + "top_k": 6, + "decisions": 1626, + "ordered_route_sha256": "c7f32e81f5b4949b7bc49d831c6602831f7beaa8129cd72400e7aaa59d15bd70", + "route_weight_sha256": "835edeeee34e60169640807ab5fe078ac4d0a118f13daf82d018aa787a277e8d", + "loads": [ + 7, + 13, + 43, + 18, + 176, + 37, + 7, + 33, + 30, + 0, + 14, + 17, + 9, + 14, + 30, + 6, + 13, + 20, + 31, + 25, + 31, + 6, + 19, + 92, + 34, + 12, + 26, + 11, + 22, + 16, + 37, + 15, + 38, + 20, + 22, + 27, + 27, + 13, + 2, + 29, + 22, + 5, + 18, + 9, + 16, + 41, + 19, + 35, + 19, + 43, + 15, + 20, + 29, + 23, + 24, + 25, + 7, + 10, + 32, + 25, + 69, + 8, + 34, + 36 + ], + "weighted_loads": [ + 0.4302515536546707, + 0.7081818226724863, + 4.333411496132612, + 1.0764373056590557, + 17.79000641964376, + 1.9307907111942768, + 0.3176864143460989, + 2.554233018308878, + 3.421258270740509, + 0.0, + 0.8053043279796839, + 1.0369579549878836, + 0.7943672798573971, + 0.9795001279562712, + 2.8742021173238754, + 0.21532459743320942, + 0.7698719967156649, + 0.7123080100864172, + 2.2267750445753336, + 2.121335033327341, + 1.9025162477046251, + 0.20339477621018887, + 1.4051526207476854, + 8.140024200081825, + 1.8167100511491299, + 0.6451661661267281, + 1.3130650371313095, + 0.5511897876858711, + 1.1908941008150578, + 0.7385046985000372, + 3.0194201823323965, + 0.7058399952948093, + 5.041874900460243, + 0.7047356758266687, + 1.3639392498880625, + 1.100519323721528, + 1.1215313579887152, + 0.4875672943890095, + 0.08348917961120605, + 1.1060257647186518, + 1.2034122832119465, + 0.24336381442844868, + 0.793067017570138, + 0.36444648914039135, + 0.5929217971861362, + 2.5578754395246506, + 2.4132207073271275, + 2.143340840935707, + 0.7086367569863796, + 2.591872064396739, + 0.5432853810489178, + 0.8885954208672047, + 3.172092108055949, + 1.388068612664938, + 1.3596356306225061, + 1.9534418750554323, + 0.4416360966861248, + 0.5552902054041624, + 3.7131079714745283, + 2.4207165800035, + 3.388451561331749, + 0.23501504957675934, + 1.3535844720900059, + 2.7484637405723333 + ], + "unique_experts": 63, + "load_cv": 0.9500593030244607, + "normalized_load_entropy": 0.9292530387876046, + "max_load_share": 0.10824108241082411 + } + }, + "s1_period": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "872f3fa0f8eef3805050ed8955b5bc270669d48ebe54724daa2cdb057fb19112", + "route_weight_sha256": "c285c91f524d44ffbdc43cd45290e69c5fc76c6eb2c9cbc0716bedcb4da9256e", + "loads": [ + 0, + 11, + 31, + 18, + 173, + 36, + 7, + 32, + 23, + 0, + 13, + 12, + 10, + 13, + 25, + 2, + 12, + 19, + 10, + 27, + 32, + 5, + 20, + 92, + 35, + 12, + 28, + 11, + 26, + 16, + 31, + 15, + 37, + 14, + 22, + 23, + 28, + 9, + 3, + 23, + 15, + 3, + 19, + 7, + 18, + 42, + 10, + 35, + 9, + 31, + 12, + 18, + 20, + 12, + 23, + 24, + 6, + 8, + 32, + 26, + 70, + 11, + 36, + 33 + ], + "weighted_loads": [ + 0.0, + 0.599349170923233, + 3.231109192594886, + 1.095405662432313, + 17.485143274068832, + 1.932055501267314, + 0.28780578821897507, + 2.508732780814171, + 3.0918495133519173, + 0.0, + 0.8078912310302258, + 0.6492062900215387, + 0.7998406942933798, + 0.8481425512582064, + 1.803277287632227, + 0.0814848281443119, + 0.7372989300638437, + 0.6740623880177736, + 0.9587291311472654, + 2.208110673353076, + 1.9441584274172783, + 0.17373189330101013, + 1.432627310976386, + 8.378541806712747, + 1.8499775491654873, + 0.6423648465424776, + 1.4029656890779734, + 0.5676052123308182, + 1.305861297994852, + 0.7484699301421642, + 2.560606252402067, + 0.6843315400183201, + 4.962024480104446, + 0.49100263975560665, + 1.3520688880234957, + 0.9805329572409391, + 1.1886411551386118, + 0.33184559643268585, + 0.1384900137782097, + 0.8831779789179564, + 0.8858361318707466, + 0.1476171351969242, + 0.8283973783254623, + 0.30207547917962074, + 0.6832861136645079, + 2.6241415683180094, + 0.5072995834052563, + 2.197609193623066, + 0.33414712361991405, + 2.090352989733219, + 0.433752678334713, + 0.7490442842245102, + 2.86524024233222, + 0.6428138688206673, + 1.3510982859879732, + 1.9039985537528992, + 0.23565839976072311, + 0.4991105869412422, + 3.65385933034122, + 2.403901470825076, + 3.3925824649631977, + 0.3375971969217062, + 1.4319640882313251, + 2.5682114362716675 + ], + "unique_experts": 62, + "load_cv": 1.0488295052374417, + "normalized_load_entropy": 0.9151875110229397, + "max_load_share": 0.11720867208672087 + }, + "full_input": { + "tokens": 287, + "top_k": 6, + "decisions": 1722, + "ordered_route_sha256": "2c62fec9077d295d68c7d61c6ccf0b133de5a87902a04d9bd13ad2abcf7c781e", + "route_weight_sha256": "5b6311227f44943ac9603544ed4f8d127e3f634b61e9ce2471191ed46e0aa6c9", + "loads": [ + 7, + 15, + 42, + 18, + 175, + 39, + 7, + 34, + 33, + 2, + 13, + 16, + 10, + 14, + 34, + 5, + 12, + 30, + 31, + 28, + 32, + 5, + 20, + 92, + 35, + 12, + 28, + 11, + 26, + 17, + 41, + 17, + 39, + 15, + 26, + 37, + 28, + 15, + 4, + 26, + 22, + 3, + 21, + 13, + 18, + 42, + 29, + 38, + 13, + 45, + 13, + 24, + 30, + 26, + 25, + 25, + 8, + 14, + 34, + 29, + 70, + 13, + 36, + 40 + ], + "weighted_loads": [ + 0.3693000581115484, + 0.774229608476162, + 4.277906000614166, + 1.095405662432313, + 17.558844655752182, + 2.0202091615647078, + 0.28780578821897507, + 2.577494937926531, + 3.96900549903512, + 0.08277621120214462, + 0.8078912310302258, + 0.9948791433125734, + 0.7998406942933798, + 0.8897500354796648, + 3.014496872201562, + 0.1637471653521061, + 0.7372989300638437, + 1.3080153558403254, + 2.7216956317424774, + 2.3439917247742414, + 1.9441584274172783, + 0.17373189330101013, + 1.432627310976386, + 8.378541806712747, + 1.8499775491654873, + 0.6423648465424776, + 1.4029656890779734, + 0.5676052123308182, + 1.305861297994852, + 0.7852707207202911, + 3.1418159138411283, + 0.929736778140068, + 5.051795467734337, + 0.5677981581538916, + 1.7762886490672827, + 2.2350016813725233, + 1.1886411551386118, + 0.59004245698452, + 0.1762324571609497, + 0.9742359686642885, + 1.2060631848871708, + 0.1476171351969242, + 0.8829919546842575, + 0.7886509299278259, + 0.6832861136645079, + 2.6241415683180094, + 3.1936181224882603, + 2.354380302131176, + 0.4678829275071621, + 2.711284628137946, + 0.4600256998091936, + 1.1281069293618202, + 3.495944296941161, + 1.457113642245531, + 1.4738619159907103, + 1.9383579194545746, + 0.4958088919520378, + 0.8068680427968502, + 3.9880359414964914, + 2.6136891208589077, + 3.3925824649631977, + 0.4018920175731182, + 1.4319640882313251, + 2.8295320086181164 + ], + "unique_experts": 64, + "load_cv": 0.8965407992407404, + "normalized_load_entropy": 0.9343736527038586, + "max_load_share": 0.1016260162601626 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 246, + "ordered_topk_exact_tokens": 156, + "set_exact_tokens": 187, + "mean_set_jaccard": 0.9281842818428184, + "mean_token_weighted_tv": 0.016180649897598518, + "aggregate_load_tv": 0.026422764227642274 + }, + "system_bos": { + "tokens": 246, + "ordered_topk_exact_tokens": 142, + "set_exact_tokens": 175, + "mean_set_jaccard": 0.9107626790553618, + "mean_token_weighted_tv": 0.020046154650427948, + "aggregate_load_tv": 0.02777777777777778 + }, + "system_x": { + "tokens": 246, + "ordered_topk_exact_tokens": 115, + "set_exact_tokens": 156, + "mean_set_jaccard": 0.8807007355787844, + "mean_token_weighted_tv": 0.02716685679733632, + "aggregate_load_tv": 0.02777777777777778 + }, + "system_period": { + "tokens": 246, + "ordered_topk_exact_tokens": 117, + "set_exact_tokens": 160, + "mean_set_jaccard": 0.8884436701509872, + "mean_token_weighted_tv": 0.026385856527320253, + "aggregate_load_tv": 0.025067750677506773 + }, + "bos_at_s0": { + "tokens": 246, + "ordered_topk_exact_tokens": 136, + "set_exact_tokens": 172, + "mean_set_jaccard": 0.9114401858304296, + "mean_token_weighted_tv": 0.020222818238539546, + "aggregate_load_tv": 0.02642276422764228 + }, + "bos_at_s1": { + "tokens": 246, + "ordered_topk_exact_tokens": 131, + "set_exact_tokens": 164, + "mean_set_jaccard": 0.8997289972899728, + "mean_token_weighted_tv": 0.022961898456986356, + "aggregate_load_tv": 0.025067750677506776 + }, + "x_at_s0": { + "tokens": 246, + "ordered_topk_exact_tokens": 110, + "set_exact_tokens": 149, + "mean_set_jaccard": 0.8779519938056521, + "mean_token_weighted_tv": 0.027243126825452213, + "aggregate_load_tv": 0.036585365853658534 + }, + "x_at_s1": { + "tokens": 246, + "ordered_topk_exact_tokens": 112, + "set_exact_tokens": 151, + "mean_set_jaccard": 0.8751275824446556, + "mean_token_weighted_tv": 0.029800707625785496, + "aggregate_load_tv": 0.03048780487804878 + }, + "period_at_s0": { + "tokens": 246, + "ordered_topk_exact_tokens": 117, + "set_exact_tokens": 152, + "mean_set_jaccard": 0.8803716608594657, + "mean_token_weighted_tv": 0.02641909386833933, + "aggregate_load_tv": 0.03387533875338754 + }, + "period_at_s1": { + "tokens": 246, + "ordered_topk_exact_tokens": 118, + "set_exact_tokens": 148, + "mean_set_jaccard": 0.8679653679653679, + "mean_token_weighted_tv": 0.03021093774056895, + "aggregate_load_tv": 0.031842818428184275 + } + } + }, + "layer_19": { + "layer": 19, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "2ab7d387a68c93f681d6cc539197ae6c8a560bfee3093c2ce268dc07edc8f934", + "route_weight_sha256": "98a7d0418142743e90013a57fa2ebca18c6847a34a1edb966cf021e8b1b20121", + "loads": [ + 10, + 20, + 7, + 7, + 15, + 13, + 29, + 24, + 16, + 8, + 13, + 28, + 21, + 96, + 24, + 29, + 22, + 3, + 15, + 25, + 37, + 36, + 24, + 12, + 23, + 16, + 7, + 19, + 11, + 29, + 14, + 33, + 0, + 69, + 17, + 58, + 10, + 69, + 20, + 10, + 18, + 19, + 33, + 20, + 30, + 10, + 18, + 19, + 29, + 24, + 8, + 6, + 43, + 23, + 1, + 20, + 1, + 42, + 29, + 41, + 44, + 20, + 20, + 19 + ], + "weighted_loads": [ + 0.4231021013110876, + 2.574944607913494, + 0.24474640376865864, + 1.1286848299205303, + 0.8005777709186077, + 0.5250246711075306, + 2.354744113981724, + 1.7759716529399157, + 1.0341736972332, + 0.24075986072421074, + 0.49407775700092316, + 1.3851555120199919, + 0.7116158660501242, + 4.17961915768683, + 1.2863069605082273, + 1.6130367200821638, + 1.9387109633535147, + 1.523044005036354, + 0.6082336492836475, + 1.508429542183876, + 2.3172530122101307, + 2.2975941449403763, + 2.1643592696636915, + 0.4332225751131773, + 1.4183982070535421, + 1.825211687013507, + 0.2617811430245638, + 0.7832472994923592, + 0.5217530429363251, + 3.2218559999018908, + 0.6727440245449543, + 2.76432285271585, + 0.0, + 5.268157638609409, + 1.0473694149404764, + 6.261995613574982, + 0.3584814202040434, + 5.172041395679116, + 0.9266486410051584, + 0.7975196298211813, + 0.8550207316875458, + 0.9444364216178656, + 5.189535213634372, + 0.7533966712653637, + 2.388773884624243, + 0.6455661915242672, + 0.6740955030545592, + 1.5167808569967747, + 1.1683792117983103, + 1.9444209728389978, + 0.293505422770977, + 0.215753722935915, + 2.994857434183359, + 0.8025395069271326, + 0.05013611540198326, + 1.2243150435388088, + 0.03034314699470997, + 2.7972906082868576, + 4.2964987847954035, + 2.630353707820177, + 4.014973448589444, + 1.1972504146397114, + 1.1373506244271994, + 1.585906794294715 + ], + "unique_experts": 63, + "load_cv": 0.7312002659484699, + "normalized_load_entropy": 0.9433503340219138, + "max_load_share": 0.06504065040650407 + }, + "full_input": { + "tokens": 271, + "top_k": 6, + "decisions": 1626, + "ordered_route_sha256": "d84a5240b9feb9e81ac5dc094af04cfd0809e0a526663444f4e1451591e3e82c", + "route_weight_sha256": "c6a73b1edf526bda774275700da1da647eb972e021b531879c838a014c12f1a8", + "loads": [ + 12, + 22, + 9, + 7, + 20, + 14, + 41, + 24, + 16, + 12, + 13, + 28, + 29, + 97, + 29, + 29, + 25, + 4, + 15, + 31, + 37, + 36, + 29, + 21, + 32, + 16, + 7, + 21, + 11, + 33, + 22, + 33, + 0, + 69, + 17, + 59, + 12, + 76, + 21, + 11, + 20, + 24, + 41, + 21, + 31, + 10, + 18, + 24, + 30, + 24, + 9, + 6, + 43, + 25, + 8, + 20, + 1, + 42, + 35, + 41, + 44, + 24, + 26, + 19 + ], + "weighted_loads": [ + 0.46715585980564356, + 2.7104646004736423, + 0.3111714795231819, + 1.1286848299205303, + 1.5385608859360218, + 0.53824448492378, + 2.843828523531556, + 1.7759716529399157, + 1.0341736972332, + 0.4968882240355015, + 0.49407775700092316, + 1.3851555120199919, + 1.2536642048507929, + 4.218705562874675, + 1.7414577547460794, + 1.6130367200821638, + 2.0522909853607416, + 1.566914614289999, + 0.6082336492836475, + 1.813019298017025, + 2.3172530122101307, + 2.2975941449403763, + 2.345980456098914, + 0.7497907374054193, + 2.085205693729222, + 1.825211687013507, + 0.2617811430245638, + 0.8973639197647572, + 0.5217530429363251, + 3.3821388874202967, + 0.9960365481674671, + 2.76432285271585, + 0.0, + 5.268157638609409, + 1.0473694149404764, + 6.321793846786022, + 0.4013358389493078, + 5.502911178395152, + 0.9689559396356344, + 0.8453571368008852, + 0.8701972947455943, + 1.2295854445546865, + 5.776126561686397, + 0.810793548822403, + 2.39947253651917, + 0.6455661915242672, + 0.6740955030545592, + 1.8965546414256096, + 1.20610342733562, + 1.9444209728389978, + 0.33188071846961975, + 0.215753722935915, + 2.994857434183359, + 1.0079670045524836, + 1.8221822436898947, + 1.2243150435388088, + 0.03034314699470997, + 2.7972906082868576, + 4.551145680248737, + 2.630353707820177, + 4.014973448589444, + 1.4212082419544458, + 1.6497119534760714, + 1.585906794294715 + ], + "unique_experts": 63, + "load_cv": 0.6734438096723014, + "normalized_load_entropy": 0.9505631300121506, + "max_load_share": 0.05965559655596556 + } + }, + "s1_eos": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "414c8fcc631db96e87392bd0164b9230bb589a26285b0060777144f0477eeab5", + "route_weight_sha256": "601fc2ccf1d13adecd94d716bda442b254d9b67daf566b7318772869a6c67920", + "loads": [ + 9, + 19, + 7, + 6, + 16, + 13, + 28, + 23, + 16, + 6, + 13, + 27, + 20, + 100, + 24, + 31, + 21, + 3, + 14, + 23, + 37, + 34, + 25, + 10, + 25, + 16, + 5, + 21, + 9, + 30, + 14, + 36, + 0, + 70, + 16, + 57, + 14, + 70, + 21, + 11, + 18, + 22, + 33, + 20, + 29, + 10, + 19, + 19, + 28, + 24, + 9, + 5, + 42, + 24, + 1, + 21, + 1, + 40, + 29, + 40, + 43, + 20, + 21, + 18 + ], + "weighted_loads": [ + 0.3898839894682169, + 2.581358887255192, + 0.23908845335245132, + 1.1210405454039574, + 0.8187046516686678, + 0.5212802961468697, + 2.329976912587881, + 1.769116060808301, + 1.0340978913009167, + 0.18863490596413612, + 0.48205200023949146, + 1.3802561797201633, + 0.6844242960214615, + 4.441863860934973, + 1.2683398388326168, + 1.6902926620095968, + 1.8981059826910496, + 1.334367386996746, + 0.578099088743329, + 1.383851483464241, + 2.3207629807293415, + 2.2199307903647423, + 2.173755332827568, + 0.3647297080606222, + 1.499939783476293, + 1.8021573908627033, + 0.21732793003320694, + 0.831466794013977, + 0.4545540139079094, + 3.3695221599191427, + 0.6464436072856188, + 2.9947585593909025, + 0.0, + 5.312288140878081, + 1.0874887090176344, + 6.241302654147148, + 0.49398399516940117, + 5.326643815264106, + 0.9883902296423912, + 0.8203649297356606, + 0.8575969785451889, + 1.0538881700485945, + 5.029896372929215, + 0.7684729062020779, + 2.33466031961143, + 0.6577292922884226, + 0.6983971502631903, + 1.4784047678112984, + 1.1529241558164358, + 1.9485457483679056, + 0.32239218801259995, + 0.18370885401964188, + 2.97082413546741, + 0.8306389544159174, + 0.05307355150580406, + 1.2389612924307585, + 0.02920309454202652, + 2.7525134216994047, + 4.287567762658, + 2.5777890402823687, + 4.049277974292636, + 1.1744643207639456, + 1.179136655293405, + 1.5398967377841473 + ], + "unique_experts": 63, + "load_cv": 0.7456022853370058, + "normalized_load_entropy": 0.9414498986990598, + "max_load_share": 0.06775067750677506 + }, + "full_input": { + "tokens": 287, + "top_k": 6, + "decisions": 1722, + "ordered_route_sha256": "ea84c5de78c65019108333390be54f0b1ee8df9887cef1897714bfea08ced021", + "route_weight_sha256": "86fb413ee7cd3c8be5215257f2ada67823a23832dc3e9e8923967de4527795c6", + "loads": [ + 12, + 24, + 9, + 6, + 28, + 15, + 42, + 23, + 16, + 11, + 14, + 34, + 31, + 100, + 35, + 33, + 23, + 8, + 15, + 32, + 40, + 35, + 32, + 17, + 38, + 16, + 5, + 23, + 10, + 30, + 20, + 36, + 2, + 70, + 16, + 57, + 18, + 74, + 23, + 13, + 22, + 32, + 42, + 21, + 30, + 10, + 19, + 31, + 29, + 25, + 15, + 5, + 45, + 34, + 7, + 21, + 3, + 42, + 38, + 42, + 44, + 29, + 30, + 20 + ], + "weighted_loads": [ + 0.45003857649862766, + 2.87484847381711, + 0.29861356876790524, + 1.1210405454039574, + 2.2936534490436316, + 0.6132637886330485, + 2.9888435173779726, + 1.769116060808301, + 1.0340978913009167, + 0.4606911912560463, + 0.5478799659758806, + 2.101832151412964, + 1.323175884783268, + 4.441863860934973, + 2.0964002925902605, + 1.7995036821812391, + 2.2533136643469334, + 1.5550157353281975, + 0.6760309729725122, + 1.86519368365407, + 2.623468365520239, + 2.273953091353178, + 2.4453961364924908, + 0.5892208833247423, + 2.4232607632875443, + 1.8021573908627033, + 0.21732793003320694, + 0.9442030973732471, + 0.4925641193985939, + 3.3695221599191427, + 0.8715816680341959, + 2.9947585593909025, + 0.0867545772343874, + 5.312288140878081, + 1.0874887090176344, + 6.241302654147148, + 0.6243619294837117, + 5.523170033469796, + 1.0745941922068596, + 0.9250890426337719, + 0.9581878194585443, + 1.5876029524952173, + 5.750201134011149, + 0.8067303374409676, + 2.345358971506357, + 0.6577292922884226, + 0.6983971502631903, + 2.264786772429943, + 1.1896704863756895, + 1.9972680266946554, + 0.690256342291832, + 0.18370885401964188, + 3.1136250887066126, + 1.680215599015355, + 1.8007940649986267, + 1.2389612924307585, + 0.11069944500923157, + 2.8410353679209948, + 4.746024573221803, + 2.641633989289403, + 4.090923676267266, + 1.564759148284793, + 1.8892715023830533, + 1.7036871314048767 + ], + "unique_experts": 64, + "load_cv": 0.6425179065201397, + "normalized_load_entropy": 0.9543885694096241, + "max_load_share": 0.05807200929152149 + } + }, + "s0_bos": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "d7c4f76d4ce7334d7e43f34db28f50e912416e4e4be182208b44e762c4c26f5e", + "route_weight_sha256": "c04cdab662a735d56d970e1894c2cbfc122f481168449eeea2d41e8740d71118", + "loads": [ + 8, + 19, + 7, + 7, + 18, + 10, + 29, + 24, + 15, + 7, + 15, + 30, + 21, + 94, + 24, + 33, + 22, + 3, + 15, + 23, + 38, + 36, + 25, + 11, + 22, + 15, + 7, + 20, + 12, + 29, + 15, + 33, + 0, + 69, + 17, + 61, + 10, + 64, + 22, + 11, + 16, + 16, + 34, + 16, + 29, + 10, + 14, + 19, + 30, + 24, + 11, + 7, + 42, + 25, + 2, + 21, + 3, + 42, + 29, + 41, + 45, + 22, + 20, + 17 + ], + "weighted_loads": [ + 0.3521777428686619, + 2.574624117463827, + 0.25419332832098007, + 1.1484704464673996, + 0.9021074939519167, + 0.41209324449300766, + 2.307678384706378, + 1.8129822257906199, + 1.0042985118925571, + 0.22348486073315144, + 0.5937976650893688, + 1.4609845895320177, + 0.7440040614455938, + 4.054487915709615, + 1.3222262803465128, + 1.752744309604168, + 1.9383492842316628, + 1.4477112740278244, + 0.6171875204890966, + 1.4663831237703562, + 2.390009105205536, + 2.3116565756499767, + 2.2491069231182337, + 0.39699065685272217, + 1.3290793541818857, + 1.8158940933644772, + 0.26033604331314564, + 0.8179143853485584, + 0.5420865537598729, + 3.204877123236656, + 0.6764436215162277, + 2.671093389391899, + 0.0, + 5.42688375338912, + 1.0258005671203136, + 6.546275379136205, + 0.3752818889915943, + 4.862211335450411, + 0.9905260019004345, + 0.8394444361329079, + 0.7629314661026001, + 0.8108894471079111, + 5.29910721629858, + 0.6171230133622885, + 2.45333706215024, + 0.6228714063763618, + 0.5492100194096565, + 1.5255853049457073, + 1.2330570723861456, + 1.9521332085132599, + 0.3914854545146227, + 0.24820101261138916, + 3.027608932927251, + 0.8448223657906055, + 0.07625360041856766, + 1.2845737524330616, + 0.08263467252254486, + 2.852314207702875, + 4.358612323179841, + 2.6458280589431524, + 4.143890982493758, + 1.2440671119838953, + 1.1728940177708864, + 1.560584768652916 + ], + "unique_experts": 63, + "load_cv": 0.723567085786935, + "normalized_load_entropy": 0.9446156991575076, + "max_load_share": 0.06368563685636856 + }, + "full_input": { + "tokens": 271, + "top_k": 6, + "decisions": 1626, + "ordered_route_sha256": "7ddf839ac01e323b3596a16fd28186eb8ee08c1893889408554ba0b68e77851d", + "route_weight_sha256": "1eb953ba24d881eb3a91698ccbf8170eda638e4211c466e99e515b2c9098db5a", + "loads": [ + 9, + 21, + 9, + 7, + 22, + 11, + 39, + 24, + 15, + 10, + 15, + 30, + 29, + 98, + 29, + 33, + 25, + 4, + 15, + 30, + 38, + 36, + 30, + 18, + 31, + 15, + 8, + 23, + 12, + 33, + 23, + 33, + 0, + 69, + 17, + 63, + 10, + 71, + 23, + 12, + 17, + 21, + 42, + 17, + 30, + 11, + 14, + 24, + 33, + 24, + 12, + 8, + 42, + 27, + 8, + 21, + 3, + 42, + 35, + 41, + 45, + 26, + 26, + 17 + ], + "weighted_loads": [ + 0.39181672036647797, + 2.722326099872589, + 0.3226246554404497, + 1.1484704464673996, + 1.535472059622407, + 0.42531305830925703, + 2.7083876319229603, + 1.8129822257906199, + 1.0042985118925571, + 0.4245189633220434, + 0.5937976650893688, + 1.4609845895320177, + 1.3010805156081915, + 4.230915764346719, + 1.7869554180651903, + 1.752744309604168, + 2.0519293062388897, + 2.200327917933464, + 0.6171875204890966, + 1.9984099511057138, + 2.390009105205536, + 2.3116565756499767, + 2.4307281095534563, + 0.6640062062069774, + 2.0163286104798317, + 1.8158940933644772, + 0.29164948500692844, + 0.9712961576879025, + 0.5420865537598729, + 3.365160010755062, + 0.9797191731631756, + 2.671093389391899, + 0.0, + 5.42688375338912, + 1.0258005671203136, + 6.624428361654282, + 0.3752818889915943, + 5.183371484279633, + 1.0328333005309105, + 0.8872819431126118, + 0.7735579470172524, + 1.0592016410082579, + 5.885698564350605, + 0.6745198909193277, + 2.464035714045167, + 0.6483806595206261, + 0.5492100194096565, + 1.9127752855420113, + 1.3498171102255583, + 1.9521332085132599, + 0.41928989812731743, + 0.26308962889015675, + 3.027608932927251, + 1.024269636720419, + 0.9043607581406832, + 1.2845737524330616, + 0.08263467252254486, + 2.852314207702875, + 4.613259218633175, + 2.6458280589431524, + 4.143890982493758, + 1.4672592990100384, + 1.6852553468197584, + 1.560584768652916 + ], + "unique_experts": 63, + "load_cv": 0.6755612312099504, + "normalized_load_entropy": 0.9506543504664364, + "max_load_share": 0.06027060270602706 + } + }, + "s1_bos": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "d09b297a1d7c3905543c050332fd3282264b21d1e8ef2ae09f0a83a2a65a3043", + "route_weight_sha256": "f6ab0b4efaef2b8aa7814beda2d19c714a185b822b26244ab8b57fbcc599533c", + "loads": [ + 8, + 21, + 8, + 7, + 19, + 10, + 29, + 24, + 15, + 8, + 15, + 26, + 23, + 95, + 25, + 31, + 21, + 3, + 15, + 24, + 38, + 35, + 26, + 11, + 25, + 15, + 6, + 20, + 11, + 30, + 13, + 35, + 0, + 72, + 17, + 57, + 14, + 64, + 22, + 12, + 17, + 16, + 35, + 15, + 27, + 8, + 13, + 19, + 31, + 24, + 11, + 6, + 41, + 25, + 1, + 21, + 3, + 41, + 27, + 41, + 45, + 23, + 19, + 17 + ], + "weighted_loads": [ + 0.34946309216320515, + 2.7266683783382177, + 0.27510291896760464, + 1.2462350204586983, + 0.9031606093049049, + 0.4060826990753412, + 2.3269034307450056, + 1.7978959027677774, + 1.0111128017306328, + 0.248736759647727, + 0.5699485056102276, + 1.2991759981960058, + 0.80462203361094, + 4.117744041606784, + 1.3114644326269627, + 1.708605645224452, + 1.8836879804730415, + 1.443550482392311, + 0.6135409846901894, + 1.389108581468463, + 2.3972604162991047, + 2.2528951838612556, + 2.2610891442745924, + 0.40553622506558895, + 1.462361354380846, + 1.7939798459410667, + 0.24258924275636673, + 0.8086451888084412, + 0.5197521038353443, + 3.3885773718357086, + 0.6035294570028782, + 2.850852271541953, + 0.0, + 5.445572983473539, + 1.0639369301497936, + 6.358653316274285, + 0.4945322684943676, + 4.987700249999762, + 0.9953791461884975, + 0.8601405750960112, + 0.8019469194114208, + 0.8113068211823702, + 5.222875900566578, + 0.5726357493549585, + 2.3423266019672155, + 0.5639658467844129, + 0.4873325238004327, + 1.4803856052458286, + 1.2436103131622076, + 1.9662291705608368, + 0.3846265524625778, + 0.22672262229025364, + 2.996961571276188, + 0.8483747094869614, + 0.04516690596938133, + 1.2477664034813643, + 0.08490682952105999, + 2.8199667781591415, + 4.247715080156922, + 2.6015757229179144, + 4.123009545728564, + 1.2847902905195951, + 1.1246439898386598, + 1.515437237918377 + ], + "unique_experts": 63, + "load_cv": 0.7253512959507533, + "normalized_load_entropy": 0.9441858737523531, + "max_load_share": 0.06436314363143632 + }, + "full_input": { + "tokens": 287, + "top_k": 6, + "decisions": 1722, + "ordered_route_sha256": "fa7f386990b272cce40750c53302d6d34a4d36a4ea52d5a7c3b56fd8893db419", + "route_weight_sha256": "e97390b89dc40a020245452fc71b96c15b31f007c05cec34753c68d83052db47", + "loads": [ + 10, + 26, + 11, + 7, + 31, + 12, + 41, + 24, + 15, + 15, + 16, + 33, + 34, + 97, + 36, + 33, + 23, + 8, + 16, + 34, + 41, + 36, + 33, + 16, + 37, + 15, + 6, + 22, + 12, + 30, + 20, + 35, + 2, + 72, + 17, + 58, + 18, + 68, + 24, + 15, + 20, + 26, + 44, + 16, + 28, + 8, + 13, + 30, + 32, + 25, + 17, + 6, + 44, + 34, + 6, + 21, + 5, + 43, + 37, + 43, + 46, + 32, + 28, + 19 + ], + "weighted_loads": [ + 0.4052423294633627, + 3.0267022866755724, + 0.3775574415922165, + 1.2462350204586983, + 2.480227690190077, + 0.4980661915615201, + 2.923910614103079, + 1.7978959027677774, + 1.0111128017306328, + 0.6081188786774874, + 0.6357764713466167, + 2.0207519698888063, + 1.4532726127654314, + 4.196762790903449, + 2.14330561645329, + 1.8178166653960943, + 2.2388956621289253, + 1.6641988307237625, + 0.7114728689193726, + 2.089586576446891, + 2.699965801090002, + 2.3069174848496914, + 2.532729947939515, + 0.5807341085746884, + 2.4484537076205015, + 1.7939798459410667, + 0.24258924275636673, + 0.9219536818563938, + 0.5577622093260288, + 3.3885773718357086, + 0.8685307577252388, + 2.850852271541953, + 0.0867545772343874, + 5.445572983473539, + 1.0639369301497936, + 6.41451401822269, + 0.6572353392839432, + 5.186810988932848, + 1.081583108752966, + 1.0009066481143236, + 0.8923795791342854, + 1.320649927482009, + 5.943180661648512, + 0.6108931805938482, + 2.3530252538621426, + 0.5639658467844129, + 0.4873325238004327, + 2.2291230000555515, + 1.2803566437214613, + 2.0149514488875866, + 0.7514658905565739, + 0.22672262229025364, + 3.1397625245153904, + 1.599274829030037, + 0.8514182269573212, + 1.2477664034813643, + 0.16640317998826504, + 2.9084887243807316, + 4.748400816693902, + 2.6654206719249487, + 4.164655247703195, + 1.6764720659703016, + 1.834778836928308, + 1.6792276315391064 + ], + "unique_experts": 64, + "load_cv": 0.6323260537750609, + "normalized_load_entropy": 0.9556367277991874, + "max_load_share": 0.056329849012775844 + } + }, + "s0_x": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "2ee15490661eeab0442a9ff5ffa9d8348dc8384018f05cd9d17e851cff8e931d", + "route_weight_sha256": "e1dcf434ef66e36bfd439aa68dee8c9018fb225016953f748598ffd20f82485f", + "loads": [ + 10, + 19, + 8, + 7, + 16, + 12, + 29, + 24, + 15, + 7, + 14, + 31, + 25, + 99, + 24, + 30, + 21, + 3, + 14, + 25, + 37, + 37, + 22, + 11, + 24, + 15, + 7, + 19, + 11, + 31, + 15, + 35, + 0, + 71, + 16, + 60, + 11, + 66, + 20, + 11, + 16, + 17, + 35, + 18, + 29, + 10, + 16, + 21, + 24, + 22, + 9, + 7, + 42, + 21, + 1, + 22, + 1, + 42, + 29, + 40, + 49, + 20, + 16, + 17 + ], + "weighted_loads": [ + 0.4120754096657038, + 2.5968877486884594, + 0.2986083384603262, + 1.0811586827039719, + 0.8704343996942043, + 0.4777819812297821, + 2.305317621678114, + 1.7911751940846443, + 1.024795040488243, + 0.22148524411022663, + 0.5232295952737331, + 1.5161295030266047, + 0.8658462632447481, + 4.177768398076296, + 1.2942142188549042, + 1.7016062084585428, + 1.9148232005536556, + 1.3206454515457153, + 0.5879856124520302, + 1.5782676674425602, + 2.3357059471309185, + 2.3101546950638294, + 2.1128653436899185, + 0.3999026622623205, + 1.473848314024508, + 1.8713329415768385, + 0.23963345773518085, + 0.7635521795600653, + 0.5054703652858734, + 3.244938673451543, + 0.6698526460677385, + 2.782109161838889, + 0.0, + 5.474826272577047, + 1.0856108646839857, + 6.507099570706487, + 0.411915497854352, + 4.912639988586307, + 0.9314926471561193, + 0.8329922426491976, + 0.7340438105165958, + 0.8007977195084095, + 5.402742069214582, + 0.6660589799284935, + 2.4031265899538994, + 0.6308313235640526, + 0.6064631137996912, + 1.6031880900263786, + 1.0063044261187315, + 1.8763647880405188, + 0.3308637700974941, + 0.24087014235556126, + 2.944363372400403, + 0.7378105409443378, + 0.06482493132352829, + 1.2985710967332125, + 0.028699025511741638, + 2.804254114627838, + 4.471614260226488, + 2.5807047951966524, + 4.210740206763148, + 1.1750928778201342, + 1.0848932266235352, + 1.5627987459301949 + ], + "unique_experts": 63, + "load_cv": 0.7490614912717412, + "normalized_load_entropy": 0.9415157383490929, + "max_load_share": 0.06707317073170732 + }, + "full_input": { + "tokens": 271, + "top_k": 6, + "decisions": 1626, + "ordered_route_sha256": "e5a813dfc5e5e6c2e48dcab2db659d8402fb7f9b23e554bb293c933bd24aff63", + "route_weight_sha256": "59da093b92b902b606a410b0cfd37b46bcbc4443f346870a06d81dfe8b99b300", + "loads": [ + 12, + 21, + 10, + 7, + 21, + 14, + 40, + 24, + 15, + 10, + 14, + 31, + 35, + 101, + 30, + 30, + 24, + 3, + 14, + 30, + 37, + 37, + 28, + 17, + 31, + 15, + 7, + 21, + 11, + 35, + 23, + 35, + 0, + 71, + 17, + 61, + 11, + 72, + 21, + 13, + 18, + 21, + 44, + 19, + 30, + 10, + 16, + 27, + 25, + 22, + 10, + 7, + 42, + 25, + 7, + 22, + 1, + 42, + 36, + 40, + 49, + 24, + 23, + 17 + ], + "weighted_loads": [ + 0.4921067636460066, + 2.7474066466093063, + 0.35730183124542236, + 1.0811586827039719, + 1.6808193810284138, + 0.5733469380065799, + 2.7614250127226114, + 1.7911751940846443, + 1.024795040488243, + 0.4094086792320013, + 0.5232295952737331, + 1.5161295030266047, + 1.5938522759824991, + 4.260929599404335, + 1.7572090663015842, + 1.7016062084585428, + 2.0284032225608826, + 1.3206454515457153, + 0.5879856124520302, + 1.820453718304634, + 2.3357059471309185, + 2.3101546950638294, + 2.3438400216400623, + 0.6264188149943948, + 1.9622674016281962, + 1.8713329415768385, + 0.23963345773518085, + 0.8741061706095934, + 0.5054703652858734, + 3.4052215609699488, + 0.9807871002703905, + 2.782109161838889, + 0.0, + 5.474826272577047, + 1.1264059897512197, + 6.566897803917527, + 0.411915497854352, + 5.150164850056171, + 0.9737999457865953, + 0.9147228244692087, + 0.7937461035326123, + 1.0220519043505192, + 6.13143540546298, + 0.7234558574855328, + 2.4138252418488264, + 0.6308313235640526, + 0.6064631137996912, + 2.0711399242281914, + 1.0440286416560411, + 1.8763647880405188, + 0.3551231846213341, + 0.24087014235556126, + 2.944363372400403, + 0.99281932041049, + 0.8929320890456438, + 1.2985710967332125, + 0.028699025511741638, + 2.804254114627838, + 4.772700602188706, + 2.5807047951966524, + 4.210740206763148, + 1.4015357084572315, + 1.6451438292860985, + 1.5627987459301949 + ], + "unique_experts": 63, + "load_cv": 0.6933855466637937, + "normalized_load_entropy": 0.9481111825880003, + "max_load_share": 0.06211562115621156 + } + }, + "s1_x": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "b9c1af8c0c43294b2acf5ea0411e5b3f2276970a243b7a0116b2a56c5beb43ff", + "route_weight_sha256": "52ceef6fec3cb3c296e5d7b0b3eff3c98a5bf53b76c8f1d514ded52d0204f1d6", + "loads": [ + 10, + 18, + 8, + 7, + 17, + 9, + 29, + 24, + 15, + 8, + 16, + 28, + 26, + 93, + 25, + 27, + 21, + 3, + 13, + 25, + 38, + 35, + 24, + 10, + 25, + 16, + 5, + 21, + 10, + 31, + 15, + 36, + 0, + 69, + 17, + 58, + 16, + 62, + 22, + 11, + 17, + 19, + 34, + 20, + 28, + 10, + 14, + 19, + 29, + 23, + 10, + 8, + 42, + 25, + 1, + 20, + 2, + 41, + 28, + 41, + 47, + 20, + 17, + 18 + ], + "weighted_loads": [ + 0.42867335118353367, + 2.59569357894361, + 0.2927830293774605, + 1.2101614624261856, + 0.8283011950552464, + 0.3722508940845728, + 2.2983671380206943, + 1.7945142444223166, + 1.0275532566010952, + 0.25076754949986935, + 0.6195425968617201, + 1.378095991909504, + 0.9146369528025389, + 3.9211990255862474, + 1.3180671855807304, + 1.617641642689705, + 1.9373516961932182, + 1.0159944966435432, + 0.5464813485741615, + 1.5119721591472626, + 2.412602409720421, + 2.2547538429498672, + 2.2208479419350624, + 0.3721555005759001, + 1.5831896727904677, + 1.871981030330062, + 0.1956886686384678, + 0.8626216668635607, + 0.48781201243400574, + 3.3703752793371677, + 0.6936253849416971, + 2.760710623115301, + 0.0, + 5.431392734870315, + 0.986161632463336, + 6.475892877206206, + 0.5631316881626844, + 4.796133845113218, + 0.9753741603344679, + 0.8313695713877678, + 0.7901997826993465, + 0.9044559132307768, + 5.386311067268252, + 0.7713660523295403, + 2.3990164268761873, + 0.6117942100390792, + 0.5510401129722595, + 1.4639651104807854, + 1.1286855228245258, + 1.9086779337376356, + 0.3541179057210684, + 0.2909129448235035, + 3.0075975842773914, + 0.8633272424340248, + 0.07033691555261612, + 1.220335066318512, + 0.05790089815855026, + 2.829229101538658, + 4.269156418740749, + 2.61242032982409, + 4.075763266533613, + 1.166908886283636, + 1.1229791939258575, + 1.5677861217409372 + ], + "unique_experts": 63, + "load_cv": 0.712314526377885, + "normalized_load_entropy": 0.9453642969910423, + "max_load_share": 0.06300813008130081 + }, + "full_input": { + "tokens": 287, + "top_k": 6, + "decisions": 1722, + "ordered_route_sha256": "24836a306de5bdf2cad59220ed19fb0e1268558a6fb310b41155ccf42b65ccdd", + "route_weight_sha256": "ff9fc7a7effad3d88b9adfc3256a6cd4ea864feee18f14b6ee0d323a02fbedc1", + "loads": [ + 13, + 24, + 10, + 7, + 29, + 12, + 41, + 24, + 15, + 13, + 17, + 35, + 39, + 93, + 36, + 29, + 23, + 8, + 14, + 32, + 41, + 36, + 32, + 15, + 35, + 16, + 5, + 23, + 11, + 31, + 22, + 36, + 3, + 69, + 17, + 58, + 19, + 64, + 24, + 14, + 20, + 29, + 44, + 22, + 29, + 10, + 14, + 31, + 30, + 24, + 16, + 8, + 45, + 35, + 6, + 20, + 4, + 43, + 38, + 43, + 48, + 31, + 27, + 20 + ], + "weighted_loads": [ + 0.5187640096992254, + 2.942769566550851, + 0.35738485492765903, + 1.2101614624261856, + 2.2954907044768333, + 0.5065959515050054, + 2.860636723227799, + 1.7945142444223166, + 1.0275532566010952, + 0.5131559614092112, + 0.6853705625981092, + 2.0996719636023045, + 1.7133447770029306, + 3.9211990255862474, + 2.1143700797110796, + 1.7268526628613472, + 2.292559377849102, + 1.2366428449749947, + 0.6444132328033447, + 1.8859739042818546, + 2.715307794511318, + 2.308776143938303, + 2.5284530259668827, + 0.5473533840849996, + 2.3420822704210877, + 1.871981030330062, + 0.1956886686384678, + 0.9667103420943022, + 0.5258221179246902, + 3.3703752793371677, + 0.9411866050213575, + 2.760710623115301, + 0.12207937054336071, + 5.431392734870315, + 0.986161632463336, + 6.475892877206206, + 0.6895837131887674, + 4.885531465522945, + 1.0615781228989363, + 0.9703629724681377, + 0.8819527300074697, + 1.4086658041924238, + 6.291252376511693, + 0.8483312018215656, + 2.4097150787711143, + 0.6117942100390792, + 0.5510401129722595, + 2.299171831458807, + 1.1654318533837795, + 1.9574002120643854, + 0.7150017097592354, + 0.2909129448235035, + 3.150398537516594, + 1.6735137961804867, + 0.876588236540556, + 1.220335066318512, + 0.1393972486257553, + 2.917751047760248, + 4.7613986022770405, + 2.6762652788311243, + 4.117408968508244, + 1.6837204359471798, + 1.9202790092676878, + 1.7315765153616667 + ], + "unique_experts": 64, + "load_cv": 0.6128080251556308, + "normalized_load_entropy": 0.9576388320746794, + "max_load_share": 0.05400696864111498 + } + }, + "s0_period": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "10bed49610a57775b935e3090b19e09ebe807a1e3acf6466608f21ec6aecca2f", + "route_weight_sha256": "32731867b603eee2c09c23ff2f77c4adf0a57edffec2febfece2bc7826740adb", + "loads": [ + 9, + 19, + 7, + 7, + 19, + 12, + 29, + 24, + 16, + 7, + 14, + 30, + 25, + 94, + 24, + 31, + 22, + 3, + 14, + 24, + 38, + 37, + 23, + 11, + 26, + 15, + 5, + 18, + 12, + 29, + 15, + 35, + 1, + 70, + 16, + 59, + 13, + 65, + 21, + 11, + 17, + 18, + 32, + 18, + 29, + 10, + 13, + 19, + 24, + 24, + 10, + 7, + 43, + 23, + 1, + 19, + 1, + 41, + 29, + 40, + 49, + 20, + 20, + 19 + ], + "weighted_loads": [ + 0.3868478648364544, + 2.5682128220796585, + 0.25535491295158863, + 1.11255544424057, + 0.9541849680244923, + 0.48033804073929787, + 2.32463682256639, + 1.7880193274468184, + 1.0598714463412762, + 0.21696099266409874, + 0.5239001139998436, + 1.4986641686409712, + 0.8773356582969427, + 3.9574006982147694, + 1.2961327750235796, + 1.7301104553043842, + 1.957584759220481, + 1.1938703209161758, + 0.5827615782618523, + 1.5469199400395155, + 2.3825277350842953, + 2.3230125308036804, + 2.1889760605990887, + 0.39530288986861706, + 1.5527513325214386, + 1.8606993779540062, + 0.19655346125364304, + 0.7295053228735924, + 0.5569688342511654, + 3.2558561116456985, + 0.6777342986315489, + 2.8103342577815056, + 0.03392663970589638, + 5.446696422994137, + 1.0553091298788786, + 6.521872669458389, + 0.47711832635104656, + 4.917893959209323, + 0.9777289144694805, + 0.8340498059988022, + 0.7557682748883963, + 0.8449073042720556, + 5.292130745947361, + 0.6962290313094854, + 2.415065247565508, + 0.639841852709651, + 0.49230553582310677, + 1.5320526268333197, + 1.0084135942161083, + 1.9495144598186016, + 0.362172270193696, + 0.24847678653895855, + 3.0306721311062574, + 0.8118904251605272, + 0.07680784165859222, + 1.1674072481691837, + 0.028743041679263115, + 2.7927806172519922, + 4.376036426052451, + 2.6256678886711597, + 4.276572933420539, + 1.1730933245271444, + 1.2074691280722618, + 1.5974112264811993 + ], + "unique_experts": 64, + "load_cv": 0.7268886803288624, + "normalized_load_entropy": 0.9439604969483997, + "max_load_share": 0.06368563685636856 + }, + "full_input": { + "tokens": 271, + "top_k": 6, + "decisions": 1626, + "ordered_route_sha256": "33444c94010f66d7a4e920eb7f4be55e015a5532d3f25226934ae88a08ed50f0", + "route_weight_sha256": "157f453da0f3c095c0051a6fe1b0ed16baa5f1e194b68c6cbffc94409b4e95f0", + "loads": [ + 11, + 21, + 9, + 7, + 24, + 14, + 39, + 24, + 16, + 11, + 14, + 30, + 34, + 96, + 30, + 31, + 25, + 4, + 14, + 29, + 38, + 37, + 28, + 18, + 34, + 15, + 5, + 20, + 12, + 33, + 23, + 35, + 1, + 70, + 17, + 60, + 14, + 72, + 22, + 12, + 19, + 22, + 40, + 19, + 30, + 10, + 13, + 26, + 25, + 24, + 10, + 7, + 43, + 26, + 7, + 19, + 1, + 41, + 35, + 40, + 49, + 25, + 27, + 19 + ], + "weighted_loads": [ + 0.48179883509874344, + 2.7188237644732, + 0.3118559457361698, + 1.11255544424057, + 1.828113954514265, + 0.5726606464013457, + 2.7253460697829723, + 1.7880193274468184, + 1.0598714463412762, + 0.4214073047041893, + 0.5239001139998436, + 1.4986641686409712, + 1.478572202846408, + 4.04050761833787, + 1.7759190779179335, + 1.7301104553043842, + 2.071164781227708, + 1.2312954179942608, + 0.5827615782618523, + 1.7966131884604692, + 2.3825277350842953, + 2.3230125308036804, + 2.3705972470343113, + 0.6498529529199004, + 2.0890917275100946, + 1.8606993779540062, + 0.19655346125364304, + 0.8468587659299374, + 0.5569688342511654, + 3.4161389991641045, + 0.9948522541671991, + 2.8103342577815056, + 0.03392663970589638, + 5.446696422994137, + 1.124906612560153, + 6.58167090266943, + 0.5310144294053316, + 5.199799345806241, + 1.0200362130999565, + 0.8818873129785061, + 0.8105059703812003, + 1.0648300852626562, + 5.878722093999386, + 0.7536259088665247, + 2.425763899460435, + 0.639841852709651, + 0.49230553582310677, + 2.0741654951125383, + 1.046137809753418, + 1.9495144598186016, + 0.362172270193696, + 0.24847678653895855, + 3.0306721311062574, + 1.057555777952075, + 0.9049149993807077, + 1.1674072481691837, + 0.028743041679263115, + 2.7927806172519922, + 4.630683321505785, + 2.6256678886711597, + 4.276572933420539, + 1.4948923029005527, + 1.7598593942821026, + 1.5974112264811993 + ], + "unique_experts": 64, + "load_cv": 0.6729044198561079, + "normalized_load_entropy": 0.9505350992326993, + "max_load_share": 0.05904059040590406 + } + }, + "s1_period": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "c60c943322c5c93ce2d6d4f9c97bddf1859a3d8d09de7c8a9f5b6f3038a1e62c", + "route_weight_sha256": "4bd6f74286817d358dc63aaa02e80f5f55d465398d4fa9ef3094709ae8434e18", + "loads": [ + 9, + 19, + 6, + 7, + 17, + 13, + 28, + 24, + 15, + 8, + 15, + 27, + 25, + 90, + 23, + 31, + 21, + 3, + 13, + 26, + 38, + 36, + 24, + 11, + 26, + 16, + 5, + 21, + 11, + 29, + 14, + 37, + 0, + 70, + 18, + 58, + 16, + 64, + 21, + 12, + 15, + 22, + 34, + 18, + 30, + 11, + 15, + 18, + 27, + 23, + 9, + 7, + 42, + 23, + 2, + 20, + 1, + 42, + 29, + 41, + 44, + 19, + 18, + 19 + ], + "weighted_loads": [ + 0.3891487941145897, + 2.626869099214673, + 0.22861281596124172, + 1.2635556422173977, + 0.8384226113557816, + 0.4960351139307022, + 2.3017562432214618, + 1.7862442564219236, + 1.0321296453475952, + 0.2503552157431841, + 0.5768655687570572, + 1.33334244415164, + 0.8985244352370501, + 3.823200972750783, + 1.2326815277338028, + 1.7461498528718948, + 1.941870966926217, + 0.9906977564096451, + 0.5476535316556692, + 1.5366270635277033, + 2.403299782425165, + 2.2744076922535896, + 2.1990352887660265, + 0.40835725516080856, + 1.6214089635759592, + 1.8588651940226555, + 0.19804519973695278, + 0.8495690263807774, + 0.523556912317872, + 3.454019470140338, + 0.6538859475404024, + 2.8535922840237617, + 0.0, + 5.462295448407531, + 1.07485163025558, + 6.4055774714797735, + 0.5535692926496267, + 4.865724322386086, + 0.9634761363267899, + 0.8764637615531683, + 0.7173063047230244, + 1.037404052913189, + 5.253156278282404, + 0.7106231078505516, + 2.458687337115407, + 0.6625416893512011, + 0.5901088695973158, + 1.4034082032740116, + 1.078443517908454, + 1.9154054932296276, + 0.3175539895892143, + 0.2586867567151785, + 3.044865917414427, + 0.8026538398116827, + 0.10217594914138317, + 1.218788307160139, + 0.02966027334332466, + 2.8527189809828997, + 4.25122251547873, + 2.6360578518360853, + 3.968624440021813, + 1.1086378246545792, + 1.1839174181222916, + 1.591467859223485 + ], + "unique_experts": 63, + "load_cv": 0.7078879213237592, + "normalized_load_entropy": 0.945605518976134, + "max_load_share": 0.06097560975609756 + }, + "full_input": { + "tokens": 287, + "top_k": 6, + "decisions": 1722, + "ordered_route_sha256": "c18a0dee66cf742d2c5f110aa33bdd5c796dce5f13ddbe4d44f83d6568096b09", + "route_weight_sha256": "b23a375077ad5685ff2cc427506312b9954c94f4682be9b90b8bbe1385e08617", + "loads": [ + 12, + 24, + 8, + 7, + 29, + 16, + 39, + 24, + 15, + 13, + 16, + 34, + 37, + 90, + 36, + 33, + 23, + 8, + 14, + 34, + 41, + 37, + 31, + 16, + 35, + 16, + 5, + 23, + 12, + 29, + 20, + 37, + 2, + 70, + 19, + 58, + 19, + 65, + 23, + 15, + 19, + 32, + 44, + 20, + 31, + 11, + 15, + 31, + 28, + 24, + 15, + 7, + 45, + 34, + 7, + 20, + 3, + 44, + 38, + 43, + 46, + 31, + 28, + 21 + ], + "weighted_loads": [ + 0.48274459689855576, + 2.9239655416458845, + 0.28934169188141823, + 1.2635556422173977, + 2.353707630187273, + 0.6352244419977069, + 2.830440611578524, + 1.7862442564219236, + 1.0321296453475952, + 0.5066801588982344, + 0.6426935344934464, + 2.0549184158444405, + 1.595243675634265, + 3.823200972750783, + 2.0843850802630186, + 1.8553608730435371, + 2.297078648582101, + 1.2113461047410965, + 0.6455854158848524, + 1.961394576355815, + 2.7060051672160625, + 2.3284299932420254, + 2.470676092430949, + 0.583555138669908, + 2.287571631371975, + 1.8588651940226555, + 0.19804519973695278, + 0.963517390191555, + 0.5615670178085566, + 3.454019470140338, + 0.8698887433856726, + 2.8535922840237617, + 0.0867545772343874, + 5.462295448407531, + 1.1319443304091692, + 6.4055774714797735, + 0.6800213176757097, + 4.912833099253476, + 1.0496800988912582, + 1.024803875014186, + 0.8523580217733979, + 1.5697301290929317, + 6.0106348022818565, + 0.7852690778672695, + 2.469385989010334, + 0.6625416893512011, + 0.5901088695973158, + 2.3445563092827797, + 1.1151898484677076, + 1.9641277715563774, + 0.6825833320617676, + 0.2586867567151785, + 3.1876668706536293, + 1.7007700260728598, + 0.908427270129323, + 1.218788307160139, + 0.11115662381052971, + 2.9412409272044897, + 4.709679326042533, + 2.6999028008431196, + 4.057748933322728, + 1.6599845625460148, + 1.9264964181929827, + 1.7552582528442144 + ], + "unique_experts": 64, + "load_cv": 0.6078217201629132, + "normalized_load_entropy": 0.9576865546165269, + "max_load_share": 0.05226480836236934 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 246, + "ordered_topk_exact_tokens": 153, + "set_exact_tokens": 181, + "mean_set_jaccard": 0.9227642276422763, + "mean_token_weighted_tv": 0.017020590677175942, + "aggregate_load_tv": 0.02168021680216801 + }, + "system_bos": { + "tokens": 246, + "ordered_topk_exact_tokens": 150, + "set_exact_tokens": 177, + "mean_set_jaccard": 0.9155052264808363, + "mean_token_weighted_tv": 0.020085262448897932, + "aggregate_load_tv": 0.019647696476964776 + }, + "system_x": { + "tokens": 246, + "ordered_topk_exact_tokens": 129, + "set_exact_tokens": 161, + "mean_set_jaccard": 0.8860240030971738, + "mean_token_weighted_tv": 0.02792367447220637, + "aggregate_load_tv": 0.02913279132791328 + }, + "system_period": { + "tokens": 246, + "ordered_topk_exact_tokens": 125, + "set_exact_tokens": 163, + "mean_set_jaccard": 0.8897599690282616, + "mean_token_weighted_tv": 0.026466938271376538, + "aggregate_load_tv": 0.023712737127371278 + }, + "bos_at_s0": { + "tokens": 246, + "ordered_topk_exact_tokens": 136, + "set_exact_tokens": 169, + "mean_set_jaccard": 0.905536198219125, + "mean_token_weighted_tv": 0.021603683808561022, + "aggregate_load_tv": 0.025067750677506776 + }, + "bos_at_s1": { + "tokens": 246, + "ordered_topk_exact_tokens": 124, + "set_exact_tokens": 154, + "mean_set_jaccard": 0.8855013550135501, + "mean_token_weighted_tv": 0.024949895534134372, + "aggregate_load_tv": 0.033197831978319776 + }, + "x_at_s0": { + "tokens": 246, + "ordered_topk_exact_tokens": 119, + "set_exact_tokens": 154, + "mean_set_jaccard": 0.8836043360433604, + "mean_token_weighted_tv": 0.02822227815802141, + "aggregate_load_tv": 0.027100271002710025 + }, + "x_at_s1": { + "tokens": 246, + "ordered_topk_exact_tokens": 109, + "set_exact_tokens": 142, + "mean_set_jaccard": 0.8621581670362158, + "mean_token_weighted_tv": 0.033680259401538994, + "aggregate_load_tv": 0.030487804878048773 + }, + "period_at_s0": { + "tokens": 246, + "ordered_topk_exact_tokens": 124, + "set_exact_tokens": 158, + "mean_set_jaccard": 0.889469608981804, + "mean_token_weighted_tv": 0.026966568069320504, + "aggregate_load_tv": 0.025745257452574534 + }, + "period_at_s1": { + "tokens": 246, + "ordered_topk_exact_tokens": 116, + "set_exact_tokens": 146, + "mean_set_jaccard": 0.8684668989547037, + "mean_token_weighted_tv": 0.032028195794626346, + "aggregate_load_tv": 0.027100271002710022 + } + } + }, + "layer_20": { + "layer": 20, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "d3f07327129be1bfe122c2317812190b5355611808028579480e80135d80f685", + "route_weight_sha256": "ca1b456244ab2131a6a2026f671acf8176095ff5ff16d04be909b639f431ff0c", + "loads": [ + 46, + 24, + 17, + 28, + 43, + 44, + 27, + 23, + 15, + 31, + 18, + 1, + 22, + 37, + 13, + 12, + 6, + 42, + 15, + 28, + 15, + 21, + 10, + 26, + 18, + 4, + 8, + 1, + 34, + 18, + 75, + 2, + 36, + 9, + 6, + 12, + 53, + 1, + 11, + 15, + 11, + 64, + 14, + 32, + 21, + 30, + 15, + 5, + 31, + 27, + 0, + 10, + 3, + 21, + 16, + 15, + 15, + 9, + 21, + 38, + 23, + 8, + 25, + 155 + ], + "weighted_loads": [ + 2.1579736303538084, + 0.8846858888864517, + 0.668552128598094, + 1.498120291158557, + 1.8124790713191032, + 2.260520352050662, + 2.679412093013525, + 0.7965423380956054, + 0.7863277718424797, + 2.350005505606532, + 1.0427728053182364, + 0.1554778665304184, + 1.265820249915123, + 3.9598991815000772, + 0.4702932517975569, + 1.2292216084897518, + 0.20243491791188717, + 2.366640817373991, + 1.0595093443989754, + 1.576316937804222, + 0.560437873005867, + 0.8386836666613817, + 0.6251812670379877, + 1.5199771970510483, + 1.0852499660104513, + 0.1459847204387188, + 0.27421335875988007, + 0.06346428394317627, + 2.5689908154308796, + 0.8355715125799179, + 3.7498732209205627, + 0.057125894352793694, + 1.9526505339890718, + 0.2785547450184822, + 0.20849889144301414, + 0.710798816755414, + 7.378131195902824, + 0.028341468423604965, + 0.4021642357110977, + 0.8246175553649664, + 0.37327883765101433, + 5.583290915936232, + 0.7283000182360411, + 4.310819420963526, + 1.1100739073008299, + 1.9058661498129368, + 0.5434361062943935, + 0.22515176422894, + 1.0219167657196522, + 1.1029197182506323, + 0.0, + 0.4242776446044445, + 0.10017800889909267, + 0.7884280849248171, + 0.6860365513712168, + 0.5961504317820072, + 0.5872858241200447, + 0.35348270647227764, + 1.0539796613156796, + 1.9850028567016125, + 2.122594639658928, + 0.3050976675003767, + 1.747706513851881, + 16.894729241728783 + ], + "unique_experts": 63, + "load_cv": 0.9711695102349719, + "normalized_load_entropy": 0.9175123577290887, + "max_load_share": 0.10501355013550136 + }, + "full_input": { + "tokens": 271, + "top_k": 6, + "decisions": 1626, + "ordered_route_sha256": "eb5fdb0d1f5e04ea7effa4d0fea6d307ac4098f1965c999a69a7941429681eb3", + "route_weight_sha256": "cab29cb4a493a033e51173ddcc15c975e411185c59d84126984ff0712dbe2d18", + "loads": [ + 46, + 26, + 17, + 36, + 51, + 48, + 32, + 28, + 15, + 31, + 18, + 2, + 26, + 37, + 13, + 18, + 7, + 42, + 25, + 28, + 19, + 21, + 17, + 26, + 18, + 12, + 10, + 1, + 34, + 20, + 75, + 2, + 36, + 10, + 8, + 12, + 55, + 5, + 13, + 16, + 12, + 65, + 17, + 37, + 30, + 30, + 15, + 5, + 33, + 28, + 8, + 10, + 3, + 27, + 16, + 18, + 16, + 14, + 21, + 38, + 35, + 12, + 25, + 155 + ], + "weighted_loads": [ + 2.1579736303538084, + 0.9295048583298922, + 0.668552128598094, + 2.1041668523103, + 2.212160773575306, + 2.4576544165611267, + 2.830829434096813, + 1.1071662800386548, + 0.7863277718424797, + 2.350005505606532, + 1.0427728053182364, + 0.18741894140839577, + 1.398299055173993, + 3.9598991815000772, + 0.4702932517975569, + 1.5672090500593185, + 0.23816066049039364, + 2.366640817373991, + 1.951904583722353, + 1.576316937804222, + 0.6660494259558618, + 0.8386836666613817, + 1.0535430256277323, + 1.5199771970510483, + 1.0852499660104513, + 0.7709220610558987, + 0.32773076742887497, + 0.06346428394317627, + 2.5689908154308796, + 0.9016822930425406, + 3.7498732209205627, + 0.057125894352793694, + 1.9526505339890718, + 0.3016542084515095, + 0.28776415437459946, + 0.710798816755414, + 7.425351750105619, + 0.15678180567920208, + 1.7203741818666458, + 0.8920276742428541, + 0.4266677238047123, + 5.62189145386219, + 0.8991474770009518, + 4.5116016858955845, + 1.4064969308674335, + 1.9058661498129368, + 0.5434361062943935, + 0.22515176422894, + 1.0598287143511698, + 1.1477012727409601, + 0.9647277630865574, + 0.4242776446044445, + 0.10017800889909267, + 1.0757646821439266, + 0.6860365513712168, + 1.020731844007969, + 0.6472450457513332, + 0.5169466063380241, + 1.0539796613156796, + 1.9850028567016125, + 3.3712868614820763, + 0.5849513169378042, + 1.747706513851881, + 16.894729241728783 + ], + "unique_experts": 64, + "load_cv": 0.8724100151927316, + "normalized_load_entropy": 0.9324371599196432, + "max_load_share": 0.0953259532595326 + } + }, + "s1_eos": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "e1c9d78da6b0db791805ca0da413356c1d1ce58180568eaa92811e658ad9a269", + "route_weight_sha256": "84933522c4d3e9137d8870e93d1d1d8dcbc5c63d71c2f89ce7b2788a2811e517", + "loads": [ + 46, + 23, + 17, + 25, + 42, + 40, + 30, + 23, + 17, + 31, + 17, + 1, + 22, + 36, + 12, + 13, + 7, + 43, + 15, + 28, + 16, + 21, + 11, + 27, + 18, + 5, + 9, + 2, + 33, + 17, + 74, + 2, + 36, + 7, + 7, + 12, + 56, + 2, + 9, + 17, + 11, + 62, + 14, + 32, + 19, + 31, + 13, + 5, + 28, + 28, + 1, + 9, + 3, + 21, + 17, + 14, + 18, + 9, + 20, + 40, + 23, + 8, + 25, + 156 + ], + "weighted_loads": [ + 2.188236743211746, + 0.8564068116247654, + 0.6681423094123602, + 1.4143726900219917, + 1.8324031997472048, + 2.075932342559099, + 2.804193928837776, + 0.8159040613099933, + 0.8818148486316204, + 2.3397089764475822, + 0.9960549734532833, + 0.09475970268249512, + 1.3325724340975285, + 3.87402268871665, + 0.4357811324298382, + 1.2529558166861534, + 0.2354357186704874, + 2.3868166655302048, + 1.1072698421776295, + 1.5586273409426212, + 0.6014356557279825, + 0.8397987298667431, + 0.667955432087183, + 1.5374035704880953, + 1.0740426033735275, + 0.16421533934772015, + 0.2965229097753763, + 0.06042248569428921, + 2.469041682779789, + 0.799473412334919, + 3.72078213468194, + 0.058188412338495255, + 1.9370013736188412, + 0.2165716253221035, + 0.23698758520185947, + 0.714830694720149, + 7.514822056517005, + 0.059094881638884544, + 0.3289646077901125, + 0.8863364234566689, + 0.36534675396978855, + 5.542245600372553, + 0.7262185420840979, + 4.382559051737189, + 1.0178495906293392, + 1.9215782191604376, + 0.45616339333355427, + 0.21830400824546814, + 0.957432908937335, + 1.0997646935284138, + 0.02980641834437847, + 0.4077348876744509, + 0.11661334335803986, + 0.8201808203011751, + 0.7148116379976273, + 0.5746326241642237, + 0.7368870805948973, + 0.35997555032372475, + 1.0171730108559132, + 2.038979982957244, + 2.12986814789474, + 0.29567168466746807, + 1.7451020069420338, + 17.209455985575914 + ], + "unique_experts": 64, + "load_cv": 0.9693225598997188, + "normalized_load_entropy": 0.9195512963718678, + "max_load_share": 0.10569105691056911 + }, + "full_input": { + "tokens": 287, + "top_k": 6, + "decisions": 1722, + "ordered_route_sha256": "23bb192a1535670d0fbe9e7cb350c9b58ac00e91a09125c153ec50ddaa111f9e", + "route_weight_sha256": "d113798628d557805528c34256030619f5ba05d4934e2f573ba3e4d3ea1a0aa7", + "loads": [ + 51, + 25, + 17, + 36, + 50, + 47, + 32, + 32, + 19, + 33, + 19, + 1, + 24, + 37, + 13, + 27, + 12, + 43, + 25, + 29, + 21, + 22, + 21, + 29, + 19, + 19, + 10, + 4, + 33, + 22, + 74, + 3, + 37, + 8, + 10, + 14, + 59, + 7, + 12, + 22, + 15, + 64, + 17, + 40, + 31, + 32, + 13, + 5, + 30, + 33, + 13, + 9, + 3, + 29, + 18, + 25, + 19, + 16, + 22, + 42, + 36, + 10, + 26, + 156 + ], + "weighted_loads": [ + 2.4191335402429104, + 0.9007380045950413, + 0.6681423094123602, + 2.185473956167698, + 2.2240501400083303, + 2.3836204521358013, + 2.8724628686904907, + 1.3985496992245317, + 0.9354745056480169, + 2.5728459656238556, + 1.0862911008298397, + 0.09475970268249512, + 1.392842711880803, + 4.158101465553045, + 0.4954273961484432, + 2.1288882680237293, + 0.5341362226754427, + 2.3868166655302048, + 2.0779551453888416, + 1.5961807109415531, + 0.7478319853544235, + 0.8784674145281315, + 1.3242393508553505, + 1.7112717498093843, + 1.0945795774459839, + 1.1536433640867472, + 0.31396241672337055, + 0.11678020842373371, + 2.469041682779789, + 0.9628189597278833, + 3.72078213468194, + 0.08842423744499683, + 1.985935676842928, + 0.26178332418203354, + 0.39120942167937756, + 0.889773054048419, + 7.618325455114245, + 0.25914278253912926, + 1.687793591991067, + 1.1421109698712826, + 0.5444072149693966, + 5.629147119820118, + 0.8937571346759796, + 4.695943888509646, + 1.7908722795546055, + 1.991826293990016, + 0.45616339333355427, + 0.21830400824546814, + 0.9929563924670219, + 1.406729269772768, + 1.5343196298927069, + 0.4077348876744509, + 0.11661334335803986, + 1.1838302239775658, + 0.7502277679741383, + 1.608309568837285, + 0.7834333013743162, + 0.8962287418544292, + 1.093292485922575, + 2.090195322409272, + 3.5380937611917034, + 0.44563560746610165, + 1.8056218326091766, + 17.209455985575914 + ], + "unique_experts": 64, + "load_cv": 0.8184907223881555, + "normalized_load_entropy": 0.9395804699106471, + "max_load_share": 0.09059233449477352 + } + }, + "s0_bos": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "6062a2e60010701fd6b2025ce4a97cfd9d1f7c53a8eedd7f8b74d9f47c63743e", + "route_weight_sha256": "f5c7efcd12bd8de218eb9fbb6b94bd4aab5332f88b0a7dd4e681564be65d503b", + "loads": [ + 46, + 23, + 17, + 26, + 43, + 38, + 28, + 21, + 13, + 31, + 18, + 1, + 24, + 38, + 13, + 11, + 9, + 42, + 17, + 28, + 16, + 19, + 11, + 28, + 18, + 5, + 10, + 0, + 34, + 17, + 72, + 3, + 38, + 9, + 9, + 12, + 55, + 3, + 14, + 16, + 10, + 65, + 14, + 30, + 21, + 30, + 15, + 4, + 24, + 31, + 1, + 10, + 2, + 19, + 17, + 16, + 15, + 7, + 23, + 39, + 24, + 6, + 25, + 152 + ], + "weighted_loads": [ + 2.1582332849502563, + 0.8708571624010801, + 0.6662068013101816, + 1.4556298460811377, + 1.858992232941091, + 1.995701713487506, + 2.7365058474242687, + 0.7395344013348222, + 0.6966032441705465, + 2.3723313119262457, + 1.050679687410593, + 0.07943417131900787, + 1.2887262739241123, + 4.0933316964656115, + 0.4810042083263397, + 1.1422522701323032, + 0.29066851548850536, + 2.418142732232809, + 1.2045535612851381, + 1.6080850344151258, + 0.58988057076931, + 0.7782012540847063, + 0.6756776832044125, + 1.5846115704625845, + 1.0720412973314524, + 0.17748120799660683, + 0.33043549582362175, + 0.0, + 2.6117947958409786, + 0.789026016369462, + 3.700285693630576, + 0.08243619091808796, + 2.0585639402270317, + 0.2799571007490158, + 0.29718622379004955, + 0.7216897886246443, + 7.5425535552203655, + 0.10626021772623062, + 0.5106503590941429, + 0.8814416471868753, + 0.35199894569814205, + 5.71601602435112, + 0.7538645192980766, + 4.229964971542358, + 1.0913672745227814, + 1.9205832798033953, + 0.5337732043117285, + 0.17776457406580448, + 0.8254222441464663, + 1.2305351998656988, + 0.029729273170232773, + 0.4320588484406471, + 0.08841542527079582, + 0.749233802780509, + 0.7227362394332886, + 0.6406012065708637, + 0.6335370000451803, + 0.30662992410361767, + 1.1110409665852785, + 2.044017970561981, + 2.08731672167778, + 0.2556798942387104, + 1.8064190596342087, + 17.037080876529217 + ], + "unique_experts": 63, + "load_cv": 0.9517058030127459, + "normalized_load_entropy": 0.9206648233565087, + "max_load_share": 0.10298102981029811 + }, + "full_input": { + "tokens": 271, + "top_k": 6, + "decisions": 1626, + "ordered_route_sha256": "0e41668094cb26756b308e4372ad9cee2221dc55f98ae8cb356adbb176fe84a8", + "route_weight_sha256": "2b68653f00ce57cf105882914f3073f217b4c41566205f620da6bcaea41109fd", + "loads": [ + 46, + 24, + 17, + 34, + 51, + 42, + 33, + 26, + 13, + 31, + 18, + 2, + 28, + 38, + 14, + 18, + 10, + 42, + 27, + 28, + 19, + 19, + 20, + 28, + 18, + 13, + 13, + 0, + 34, + 19, + 74, + 4, + 38, + 10, + 10, + 12, + 57, + 6, + 15, + 17, + 11, + 68, + 17, + 34, + 30, + 30, + 16, + 5, + 25, + 31, + 9, + 10, + 2, + 24, + 17, + 19, + 15, + 11, + 23, + 39, + 35, + 9, + 25, + 153 + ], + "weighted_loads": [ + 2.1582332849502563, + 0.8950165454298258, + 0.6662068013101816, + 2.0616764072328806, + 2.2586739351972938, + 2.180203054100275, + 2.887923188507557, + 1.039092312566936, + 0.6966032441705465, + 2.3723313119262457, + 1.050679687410593, + 0.7982843071222305, + 1.425180433318019, + 4.0933316964656115, + 0.527219895273447, + 1.5431774891912937, + 0.32639425806701183, + 2.418142732232809, + 2.0969488006085157, + 1.6080850344151258, + 0.6923331841826439, + 0.7782012540847063, + 1.1890768110752106, + 1.5846115704625845, + 1.0720412973314524, + 0.7706482782959938, + 0.4302431717514992, + 0.0, + 2.6117947958409786, + 0.8551367968320847, + 3.8018474373966455, + 0.09325955528765917, + 2.0585639402270317, + 0.3030565641820431, + 0.34040951170027256, + 0.7216897886246443, + 7.5897741094231606, + 0.19036693684756756, + 0.8747115358710289, + 0.9242250006645918, + 0.39680379442870617, + 5.803913678973913, + 0.9250381607562304, + 4.439565936103463, + 1.3845491912215948, + 1.9205832798033953, + 0.666816433891654, + 0.18745819572359324, + 0.8616907056421041, + 1.2305351998656988, + 1.0269865654408932, + 0.4320588484406471, + 0.08841542527079582, + 1.0205377824604511, + 0.7227362394332886, + 1.0918825343251228, + 0.6335370000451803, + 0.42780719697475433, + 1.1110409665852785, + 2.044017970561981, + 3.3346263486891985, + 0.48170752823352814, + 1.8064190596342087, + 17.080802362412214 + ], + "unique_experts": 63, + "load_cv": 0.8621666785797859, + "normalized_load_entropy": 0.9338349192806267, + "max_load_share": 0.0940959409594096 + } + }, + "s1_bos": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "49e099ad02fc75818dd115d04d1d67df2d9c7fb6078de28792f83f1f99162740", + "route_weight_sha256": "7cb1fdd027be4d936c2893c950c57425c8b9f5e1dc08c27719fc91ee70967fc5", + "loads": [ + 46, + 25, + 15, + 28, + 42, + 40, + 28, + 18, + 15, + 31, + 18, + 2, + 22, + 34, + 11, + 11, + 9, + 41, + 17, + 28, + 18, + 21, + 11, + 28, + 18, + 5, + 7, + 0, + 33, + 18, + 78, + 5, + 36, + 8, + 6, + 12, + 54, + 2, + 12, + 16, + 9, + 64, + 14, + 31, + 21, + 28, + 16, + 5, + 27, + 30, + 1, + 10, + 2, + 24, + 18, + 17, + 15, + 7, + 20, + 41, + 24, + 7, + 22, + 154 + ], + "weighted_loads": [ + 2.1502717416733503, + 0.9219501093029976, + 0.5999919641762972, + 1.5215548481792212, + 1.8254413409158587, + 2.0203621983528137, + 2.7372456658631563, + 0.6567331645637751, + 0.7834988292306662, + 2.3528821412473917, + 1.0395776350051165, + 0.10257966816425323, + 1.234978949651122, + 3.858877142891288, + 0.41793859750032425, + 1.0980308689177036, + 0.31559282168745995, + 2.35591983422637, + 1.2134883385151625, + 1.5794319491833448, + 0.6675864644348621, + 0.8560069799423218, + 0.6869856752455235, + 1.6026165075600147, + 1.0822777710855007, + 0.1773493867367506, + 0.24563061632215977, + 0.0, + 2.4660475701093674, + 0.8024832848459482, + 3.8759110998362303, + 0.14394697733223438, + 1.9982735496014357, + 0.2529034689068794, + 0.20681624673306942, + 0.7262764628976583, + 7.552204418927431, + 0.07367143407464027, + 0.4548594318330288, + 0.8570655584335327, + 0.2995962742716074, + 5.747086219489574, + 0.7428470831364393, + 4.392387291416526, + 1.0876636561006308, + 1.8669700138270855, + 0.534674059599638, + 0.2133819293230772, + 0.9044462107121944, + 1.1687972862273455, + 0.029815247282385826, + 0.4517560750246048, + 0.09403849393129349, + 0.932758241891861, + 0.7432113699615002, + 0.6979439668357372, + 0.6222385372966528, + 0.29545653983950615, + 1.022370856255293, + 2.0807004012167454, + 2.208900323137641, + 0.27909728325903416, + 1.6967702247202396, + 17.389987867325544 + ], + "unique_experts": 63, + "load_cv": 0.9666214984930716, + "normalized_load_entropy": 0.9192454704051022, + "max_load_share": 0.1043360433604336 + }, + "full_input": { + "tokens": 287, + "top_k": 6, + "decisions": 1722, + "ordered_route_sha256": "30eacaab3bdb38692c11799fb354ab6d7bf410e46fefcbbdc1efe68fb6278cf3", + "route_weight_sha256": "b41ff37e419e62b23c2748e6f83ee543f2d9bf4201de58f6bf7a22832e5d9eec", + "loads": [ + 51, + 26, + 15, + 39, + 50, + 48, + 30, + 27, + 16, + 33, + 20, + 2, + 24, + 35, + 12, + 26, + 14, + 41, + 27, + 29, + 23, + 22, + 22, + 30, + 19, + 19, + 9, + 2, + 33, + 22, + 79, + 6, + 37, + 8, + 8, + 14, + 57, + 8, + 14, + 22, + 13, + 67, + 18, + 38, + 33, + 29, + 16, + 5, + 27, + 35, + 13, + 10, + 2, + 33, + 19, + 28, + 17, + 14, + 21, + 43, + 36, + 9, + 23, + 154 + ], + "weighted_loads": [ + 2.3859658744186163, + 0.9461094923317432, + 0.5999919641762972, + 2.2926561143249273, + 2.2170882811769843, + 2.393732499331236, + 2.805514605715871, + 1.2225010879337788, + 0.8118649441748857, + 2.586019130423665, + 1.1298137623816729, + 0.10257966816425323, + 1.2952492274343967, + 4.142955919727683, + 0.4775848612189293, + 2.0338736847043037, + 0.6142933256924152, + 2.35591983422637, + 2.1841736417263746, + 1.6169853191822767, + 0.8572258576750755, + 0.8946756646037102, + 1.370092984288931, + 1.7764846868813038, + 1.102814745157957, + 1.1390242967754602, + 0.31096153520047665, + 0.056357722729444504, + 2.4660475701093674, + 0.918640062212944, + 3.904531877487898, + 0.17418280243873596, + 2.0472078528255224, + 0.2529034689068794, + 0.2940786499530077, + 0.9012188222259283, + 7.6557078175246716, + 0.31520639546215534, + 0.862980742007494, + 1.1530087403953075, + 0.47578466311097145, + 5.880038622766733, + 0.9418112728744745, + 4.771887527778745, + 1.860686345025897, + 1.937218088656664, + 0.534674059599638, + 0.2133819293230772, + 0.9044462107121944, + 1.5144029278308153, + 1.607990873977542, + 0.4517560750246048, + 0.09403849393129349, + 1.3542913999408484, + 0.7786274999380112, + 1.778049025684595, + 0.7082782220095396, + 0.8317097313702106, + 1.06075968593359, + 2.1319157406687737, + 3.6152506228536367, + 0.4196465481072664, + 1.7572900503873825, + 17.389987867325544 + ], + "unique_experts": 64, + "load_cv": 0.8202818803726767, + "normalized_load_entropy": 0.9390925228478257, + "max_load_share": 0.08943089430894309 + } + }, + "s0_x": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "31d1291c0b59240b48182ca5b8b92f0feb22c2c63b25bdaaedf06484923917fb", + "route_weight_sha256": "7a69c6fd87aaddc8f49df17f80501d214cdcd34aefadef56242aac7afa884240", + "loads": [ + 45, + 23, + 18, + 27, + 45, + 41, + 28, + 21, + 13, + 31, + 17, + 1, + 24, + 35, + 11, + 11, + 7, + 43, + 18, + 29, + 11, + 21, + 12, + 29, + 18, + 3, + 8, + 0, + 34, + 16, + 75, + 2, + 38, + 8, + 5, + 12, + 53, + 6, + 13, + 14, + 11, + 68, + 14, + 32, + 25, + 30, + 15, + 4, + 27, + 29, + 1, + 9, + 2, + 20, + 18, + 16, + 16, + 7, + 19, + 37, + 25, + 6, + 26, + 153 + ], + "weighted_loads": [ + 2.0774713288992643, + 0.8777214176952839, + 0.6594080273061991, + 1.4819291085004807, + 1.9676992623135448, + 2.1769481506198645, + 2.7295716237276793, + 0.6797032933682203, + 0.6965484176762402, + 2.3640578892081976, + 1.0421558860689402, + 0.05029250681400299, + 1.3173474837094545, + 4.023303505033255, + 0.38250499963760376, + 1.1734720692038536, + 0.2219430524855852, + 2.5069551691412926, + 1.2947644777595997, + 1.6320710759609938, + 0.4357310552150011, + 0.8306548558175564, + 0.7133206184953451, + 1.602503215894103, + 1.0787256602197886, + 0.12439176626503468, + 0.27365495450794697, + 0.0, + 2.6147066727280617, + 0.7611677870154381, + 3.813652139157057, + 0.05065334402024746, + 2.1313648372888565, + 0.25691934302449226, + 0.16417351551353931, + 0.7100873477756977, + 7.622585207223892, + 0.19417532160878181, + 0.4820158500224352, + 0.8014825731515884, + 0.3913312628865242, + 5.790843034163117, + 0.7441045772284269, + 4.512885930016637, + 1.2987079937011003, + 1.9472406283020973, + 0.5410192217677832, + 0.1831046212464571, + 0.9145368728786707, + 1.1375969666987658, + 0.030178632587194443, + 0.3875525966286659, + 0.08814582228660583, + 0.7520860824733973, + 0.7514689136296511, + 0.6444153152406216, + 0.6789454706013203, + 0.29666876420378685, + 0.9655147455632687, + 1.9511801470071077, + 2.0656946804374456, + 0.2415121104568243, + 1.814129762351513, + 17.03951437957585 + ], + "unique_experts": 63, + "load_cv": 0.970231335498268, + "normalized_load_entropy": 0.9168965838790192, + "max_load_share": 0.10365853658536585 + }, + "full_input": { + "tokens": 271, + "top_k": 6, + "decisions": 1626, + "ordered_route_sha256": "0843d5dd8b1e52ecc0dfb25839dc00fd55b58254530689a30c80821bb86c23d0", + "route_weight_sha256": "36ea1bcf9da750cdc63aa89136f48c8c78b903bc7e39c30cc6abf6a84ea97124", + "loads": [ + 45, + 25, + 18, + 35, + 54, + 43, + 34, + 26, + 13, + 31, + 17, + 1, + 28, + 36, + 12, + 16, + 9, + 43, + 29, + 29, + 14, + 21, + 19, + 29, + 18, + 12, + 9, + 0, + 34, + 20, + 76, + 2, + 38, + 9, + 6, + 12, + 57, + 10, + 14, + 15, + 11, + 70, + 16, + 35, + 35, + 30, + 15, + 4, + 28, + 30, + 9, + 9, + 2, + 25, + 18, + 20, + 17, + 12, + 19, + 37, + 37, + 9, + 26, + 153 + ], + "weighted_loads": [ + 2.0774713288992643, + 0.9399805068969727, + 0.6594080273061991, + 2.0879756696522236, + 2.4918087674304843, + 2.2523263804614544, + 2.9194353576749563, + 0.97977190092206, + 0.6965484176762402, + 2.3640578892081976, + 1.0421558860689402, + 0.05029250681400299, + 1.4957714676856995, + 4.051173999905586, + 0.41949062049388885, + 1.4635498262941837, + 0.2879506777971983, + 2.5069551691412926, + 2.28617787361145, + 1.6320710759609938, + 0.538183668628335, + 0.8306548558175564, + 1.1255173329263926, + 1.602503215894103, + 1.0787256602197886, + 0.7599288839846849, + 0.2910944614559412, + 0.0, + 2.6147066727280617, + 0.8962644916027784, + 3.867338292300701, + 0.05065334402024746, + 2.1313648372888565, + 0.28001880645751953, + 0.20152143575251102, + 0.7100873477756977, + 7.7348267287015915, + 0.32060844264924526, + 0.8460770267993212, + 0.8574702925980091, + 0.3913312628865242, + 5.8610959481447935, + 0.8948676642030478, + 4.64358170516789, + 1.6437465269118547, + 1.9472406283020973, + 0.5410192217677832, + 0.1831046212464571, + 0.9508053343743086, + 1.1766363177448511, + 1.0085724592208862, + 0.3875525966286659, + 0.08814582228660583, + 1.002936601638794, + 0.7514689136296511, + 1.1150943450629711, + 0.7242153584957123, + 0.47091698460280895, + 0.9655147455632687, + 1.9511801470071077, + 3.497182436287403, + 0.47066100873053074, + 1.814129762351513, + 17.03951437957585 + ], + "unique_experts": 63, + "load_cv": 0.8795946875458711, + "normalized_load_entropy": 0.9295563919995639, + "max_load_share": 0.0940959409594096 + } + }, + "s1_x": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "dd95f98c376a3e7413467c6117b601272601588b49e1f7a4344442baad74c0ac", + "route_weight_sha256": "6b8161d1ab903afe3b9a0823b177383c674aede071ad298615ade9a2f24ecc99", + "loads": [ + 44, + 20, + 18, + 25, + 45, + 40, + 26, + 21, + 15, + 31, + 16, + 1, + 25, + 36, + 13, + 13, + 6, + 40, + 19, + 28, + 16, + 22, + 13, + 29, + 18, + 5, + 8, + 0, + 34, + 17, + 77, + 4, + 37, + 7, + 8, + 12, + 55, + 4, + 15, + 14, + 9, + 63, + 14, + 32, + 23, + 28, + 15, + 4, + 24, + 32, + 1, + 9, + 2, + 21, + 17, + 15, + 15, + 8, + 21, + 38, + 24, + 6, + 26, + 152 + ], + "weighted_loads": [ + 2.067305075004697, + 0.7904346212744713, + 0.6681780591607094, + 1.4194339662790298, + 1.9716883981600404, + 2.148244723677635, + 2.67797489464283, + 0.7239907057955861, + 0.8197229709476233, + 2.326451623812318, + 1.011959657073021, + 0.0389237254858017, + 1.2498446200042963, + 4.041574563831091, + 0.4494870752096176, + 1.1383182872086763, + 0.22281504422426224, + 2.3815009221434593, + 1.231942493468523, + 1.5635911785066128, + 0.6099004037678242, + 0.8843985125422478, + 0.7316438481211662, + 1.6127260867506266, + 1.0761578977108002, + 0.1743267197161913, + 0.2652465458959341, + 0.0, + 2.4962732829153538, + 0.7413823772221804, + 3.839466681703925, + 0.10555828548967838, + 1.9642273504287004, + 0.2232779636979103, + 0.26188772544264793, + 0.7205372434109449, + 7.627916365861893, + 0.16265203803777695, + 0.5693739876151085, + 0.8230250719934702, + 0.33354075253009796, + 5.656240677461028, + 0.7463683728128672, + 4.6867316365242, + 1.1972102858126163, + 1.8577637281268835, + 0.5482291970402002, + 0.17333567701280117, + 0.8162037879228592, + 1.2101437598466873, + 0.028543153777718544, + 0.4031734820455313, + 0.11922338232398033, + 0.8154717851430178, + 0.6923462580889463, + 0.6375542171299458, + 0.6467678267508745, + 0.3391249217092991, + 1.0358482357114553, + 1.9793207254260778, + 2.1083962991833687, + 0.24258042685687542, + 1.8116999100893736, + 17.0610000025481 + ], + "unique_experts": 63, + "load_cv": 0.9564783330659129, + "normalized_load_entropy": 0.9200145359092095, + "max_load_share": 0.10298102981029811 + }, + "full_input": { + "tokens": 287, + "top_k": 6, + "decisions": 1722, + "ordered_route_sha256": "84fc9a7fc83054d4b28a31eeac8f730b3926bad73b38ee214bfde60c53c48d51", + "route_weight_sha256": "4d8368e9fe31900aa19b0541a69630e6859ef308fe98034cf088d9ac9521d698", + "loads": [ + 49, + 21, + 18, + 37, + 55, + 48, + 29, + 30, + 15, + 33, + 18, + 1, + 28, + 37, + 14, + 27, + 13, + 40, + 30, + 29, + 19, + 24, + 23, + 31, + 19, + 20, + 9, + 3, + 34, + 22, + 77, + 5, + 38, + 7, + 9, + 14, + 58, + 10, + 17, + 19, + 12, + 64, + 17, + 37, + 37, + 29, + 15, + 4, + 24, + 36, + 13, + 9, + 2, + 29, + 18, + 26, + 17, + 16, + 23, + 40, + 37, + 8, + 27, + 152 + ], + "weighted_loads": [ + 2.2971822898834944, + 0.8145940043032169, + 0.6681780591607094, + 2.2201187685132027, + 2.5139067443087697, + 2.5068245343863964, + 2.785095516592264, + 1.2565598143264651, + 0.8197229709476233, + 2.559588612988591, + 1.1021957844495773, + 0.0389237254858017, + 1.3603273667395115, + 4.325653340667486, + 0.5091333389282227, + 2.016515566036105, + 0.6919891983270645, + 2.3815009221434593, + 2.319953914731741, + 1.6011445485055447, + 0.7206479050219059, + 0.9547652713954449, + 1.3457944951951504, + 1.7865942660719156, + 1.0966948717832565, + 1.1632320303469896, + 0.28268605284392834, + 0.09569423273205757, + 2.4962732829153538, + 0.8844130896031857, + 3.839466681703925, + 0.13579411059617996, + 2.013161653652787, + 0.2232779636979103, + 0.30137866362929344, + 0.8954796027392149, + 7.731419764459133, + 0.394473185762763, + 0.9774952977895737, + 1.0510279014706612, + 0.47213261015713215, + 5.706784652546048, + 0.9167599529027939, + 4.93121300637722, + 2.0468379333615303, + 1.928011802956462, + 0.5482291970402002, + 0.17333567701280117, + 0.8162037879228592, + 1.4485807120800018, + 1.5440920311957598, + 0.4031734820455313, + 0.11922338232398033, + 1.162341184914112, + 0.7277623880654573, + 1.7280131839215755, + 0.7310864869505167, + 0.9271400384604931, + 1.1075572613626719, + 2.030536064878106, + 3.6112971529364586, + 0.3747567217797041, + 1.8722197357565165, + 17.0610000025481 + ], + "unique_experts": 64, + "load_cv": 0.8114993466372186, + "normalized_load_entropy": 0.9394064866216353, + "max_load_share": 0.08826945412311266 + } + }, + "s0_period": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "8109f82427643872e31d7fb08daa394ba6d6e3d0347a4006f3219df59c299461", + "route_weight_sha256": "acc45fa4cc60ec4d2a16c59926b8ad71d0303de633977ac0ba5ba392a061a239", + "loads": [ + 45, + 22, + 19, + 28, + 45, + 45, + 27, + 19, + 13, + 31, + 16, + 0, + 23, + 36, + 11, + 12, + 7, + 42, + 18, + 29, + 15, + 19, + 12, + 30, + 18, + 3, + 7, + 0, + 34, + 19, + 75, + 2, + 39, + 8, + 8, + 11, + 52, + 7, + 14, + 14, + 10, + 66, + 14, + 33, + 21, + 29, + 14, + 4, + 26, + 31, + 1, + 9, + 3, + 19, + 18, + 16, + 12, + 7, + 22, + 38, + 25, + 5, + 25, + 153 + ], + "weighted_loads": [ + 2.093777485191822, + 0.8424953445792198, + 0.7434276267886162, + 1.489427087828517, + 1.9850718630477786, + 2.302717201411724, + 2.760135155171156, + 0.653899266384542, + 0.722760509699583, + 2.3682944234460592, + 1.0251848008483648, + 0.0, + 1.254043010994792, + 4.0268920212984085, + 0.38961553014814854, + 1.254719477146864, + 0.2438165247440338, + 2.4688031133264303, + 1.281523946672678, + 1.643882343545556, + 0.5498720332980156, + 0.7741996739059687, + 0.7192286923527718, + 1.6417003311216831, + 1.0950022358447313, + 0.12450730428099632, + 0.2525153812021017, + 0.0, + 2.5712343100458384, + 0.8438911866396666, + 3.789599623531103, + 0.051077527925372124, + 2.067264672368765, + 0.25189993157982826, + 0.2550062835216522, + 0.67392747849226, + 7.6040714383125305, + 0.225285854190588, + 0.5177339669317007, + 0.808722173795104, + 0.3569331746548414, + 5.7802404295653105, + 0.7470958661288023, + 4.465873129665852, + 1.1742950305342674, + 1.9012391287833452, + 0.5062823966145515, + 0.17663140781223774, + 0.8894867114722729, + 1.2119584772735834, + 0.02844015322625637, + 0.396518686786294, + 0.13579587638378143, + 0.7446923926472664, + 0.7418903894722462, + 0.6467447131872177, + 0.5182528235018253, + 0.2918063588440418, + 1.0397347304970026, + 1.984479732811451, + 2.031833751127124, + 0.2186023499816656, + 1.7841485384851694, + 17.035869535058737 + ], + "unique_experts": 62, + "load_cv": 0.9694134757964554, + "normalized_load_entropy": 0.9168211762077482, + "max_load_share": 0.10365853658536585 + }, + "full_input": { + "tokens": 271, + "top_k": 6, + "decisions": 1626, + "ordered_route_sha256": "8f6b5bf4e53c03047d5a216db7188b782b8de89df4c1670665902115a9ec9b17", + "route_weight_sha256": "6f1178a6f27174d2a3d028fade0afd670890179479580a3d1a55aab6e2b07e73", + "loads": [ + 45, + 24, + 19, + 36, + 54, + 47, + 33, + 25, + 15, + 31, + 16, + 0, + 28, + 36, + 11, + 17, + 9, + 42, + 28, + 29, + 19, + 19, + 19, + 30, + 18, + 13, + 8, + 0, + 34, + 22, + 76, + 2, + 39, + 9, + 8, + 11, + 54, + 12, + 15, + 16, + 11, + 67, + 16, + 36, + 31, + 29, + 14, + 4, + 27, + 32, + 10, + 9, + 3, + 24, + 18, + 19, + 13, + 11, + 22, + 38, + 36, + 9, + 25, + 153 + ], + "weighted_loads": [ + 2.093777485191822, + 0.9077631421387196, + 0.7434276267886162, + 2.09547364898026, + 2.4360690293833613, + 2.378095431253314, + 2.9669688418507576, + 1.1222627172246575, + 0.7928431108593941, + 2.3682944234460592, + 1.0251848008483648, + 0.0, + 1.4878115355968475, + 4.0268920212984085, + 0.38961553014814854, + 1.5550046488642693, + 0.30859436467289925, + 2.4688031133264303, + 2.1739191859960556, + 1.643882343545556, + 0.6945001482963562, + 0.7741996739059687, + 1.135574046522379, + 1.6417003311216831, + 1.0950022358447313, + 0.8388259001076221, + 0.26995488815009594, + 0.0, + 2.5712343100458384, + 0.9464963525533676, + 3.8449591137468815, + 0.051077527925372124, + 2.067264672368765, + 0.27499939501285553, + 0.2550062835216522, + 0.67392747849226, + 7.6512919925153255, + 0.3831398170441389, + 0.8817951437085867, + 0.9159307014197111, + 0.40946791507303715, + 5.818840967491269, + 0.898027366027236, + 4.592339612543583, + 1.5246114525943995, + 1.9012391287833452, + 0.5062823966145515, + 0.17663140781223774, + 0.9257551729679108, + 1.274418031796813, + 1.0424885768443346, + 0.396518686786294, + 0.13579587638378143, + 0.9758348595350981, + 0.7418903894722462, + 1.0678817816078663, + 0.5673098117113113, + 0.4129836317151785, + 1.0397347304970026, + 1.984479732811451, + 3.279143378138542, + 0.481018191203475, + 1.7841485384851694, + 17.035869535058737 + ], + "unique_experts": 62, + "load_cv": 0.8730202388894165, + "normalized_load_entropy": 0.9305037311882631, + "max_load_share": 0.0940959409594096 + } + }, + "s1_period": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "f4fb28b505d32f50f638ac95a50a96b2b467419c15418ddfdc719d035f634141", + "route_weight_sha256": "84a07adf51627b8a271898aa74f692ce4f77ef58e13484758fe8399fe3936e1a", + "loads": [ + 45, + 23, + 19, + 26, + 48, + 38, + 27, + 22, + 15, + 31, + 17, + 0, + 24, + 36, + 10, + 12, + 7, + 43, + 18, + 28, + 15, + 21, + 12, + 28, + 18, + 5, + 9, + 0, + 35, + 18, + 78, + 4, + 35, + 6, + 7, + 13, + 53, + 6, + 15, + 16, + 10, + 63, + 14, + 34, + 21, + 28, + 14, + 3, + 23, + 27, + 0, + 10, + 2, + 21, + 16, + 16, + 17, + 8, + 20, + 39, + 25, + 7, + 23, + 152 + ], + "weighted_loads": [ + 2.1228410992771387, + 0.8887457959353924, + 0.7164378520101309, + 1.446354916319251, + 2.116825087927282, + 2.004999540746212, + 2.703412041068077, + 0.7628965582698584, + 0.798043467104435, + 2.328098852187395, + 1.0200365129858255, + 0.0, + 1.2668278105556965, + 4.013978257775307, + 0.3420957624912262, + 1.127834316343069, + 0.2486691065132618, + 2.4410254526883364, + 1.1939659239724278, + 1.5686986204236746, + 0.5845739208161831, + 0.8534126318991184, + 0.6778559684753418, + 1.5990660153329372, + 1.0783728584647179, + 0.1719688531011343, + 0.3084701783955097, + 0.0, + 2.504092827439308, + 0.7799969036132097, + 3.889725102111697, + 0.11167739890515804, + 1.884126478806138, + 0.19378012977540493, + 0.22191782295703888, + 0.7466220781207085, + 7.509159378707409, + 0.24763578176498413, + 0.5721383094787598, + 0.8714124336838722, + 0.3598286993801594, + 5.650108205154538, + 0.7455947883427143, + 4.711530894041061, + 1.1076218336820602, + 1.8484072908759117, + 0.5185282006859779, + 0.14382285624742508, + 0.7716549783945084, + 1.0676236096769571, + 0.0, + 0.43855545297265053, + 0.1186479888856411, + 0.8154967278242111, + 0.6584860328584909, + 0.6758038252592087, + 0.6866319924592972, + 0.3229515962302685, + 0.9856206867843866, + 2.0131448563188314, + 2.136746793985367, + 0.27122399024665356, + 1.7210187204182148, + 16.99685418792069 + ], + "unique_experts": 61, + "load_cv": 0.9594223174554652, + "normalized_load_entropy": 0.9187425588862487, + "max_load_share": 0.10298102981029811 + }, + "full_input": { + "tokens": 287, + "top_k": 6, + "decisions": 1722, + "ordered_route_sha256": "a6f8ef7750a39d5201ce946cd039ed00825b5fc233e356261eda7f79e6be159d", + "route_weight_sha256": "5b802243b7ab4a6472e0e2723089721a9093526e8b5aea037788246ca82942a9", + "loads": [ + 50, + 24, + 19, + 37, + 56, + 46, + 30, + 32, + 15, + 33, + 19, + 0, + 28, + 37, + 11, + 25, + 13, + 43, + 28, + 29, + 19, + 22, + 22, + 30, + 19, + 20, + 10, + 2, + 35, + 23, + 78, + 5, + 36, + 6, + 8, + 15, + 56, + 14, + 17, + 22, + 14, + 64, + 18, + 39, + 34, + 29, + 14, + 3, + 23, + 32, + 12, + 10, + 2, + 29, + 17, + 28, + 18, + 15, + 22, + 41, + 38, + 10, + 24, + 152 + ], + "weighted_loads": [ + 2.3522218335419893, + 0.912905178964138, + 0.7164378520101309, + 2.2174561824649572, + 2.5084720281884074, + 2.3385460190474987, + 2.8126943968236446, + 1.3658510968089104, + 0.798043467104435, + 2.5612358413636684, + 1.110272640362382, + 0.0, + 1.436509670689702, + 4.298057034611702, + 0.40174202620983124, + 1.9841808006167412, + 0.5830757282674313, + 2.4410254526883364, + 2.16465122718364, + 1.6062519904226065, + 0.7353976555168629, + 0.8920813165605068, + 1.2951369248330593, + 1.7729341946542263, + 1.0989098325371742, + 1.1524067614227533, + 0.32590968534350395, + 0.056357722729444504, + 2.504092827439308, + 0.9240224994719028, + 3.889725102111697, + 0.14191322401165962, + 1.9330607820302248, + 0.19378012977540493, + 0.2614087611436844, + 0.9215644374489784, + 7.612662777304649, + 0.5698024835437536, + 0.980259619653225, + 1.1427291873842478, + 0.5385176595300436, + 5.700652180239558, + 0.9533839169889688, + 4.94582237303257, + 1.9241128265857697, + 1.9186553657054901, + 0.5185282006859779, + 0.14382285624742508, + 0.7716549783945084, + 1.394626909866929, + 1.4932057671248913, + 0.43855545297265053, + 0.1186479888856411, + 1.1573910024017096, + 0.693902162835002, + 1.7727525234222412, + 0.7331782132387161, + 0.859204787760973, + 1.0548158884048462, + 2.0643601957708597, + 3.585363071411848, + 0.4370176959782839, + 1.7815385460853577, + 16.99685418792069 + ], + "unique_experts": 63, + "load_cv": 0.8118981970537675, + "normalized_load_entropy": 0.9387476457753677, + "max_load_share": 0.08826945412311266 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 246, + "ordered_topk_exact_tokens": 146, + "set_exact_tokens": 177, + "mean_set_jaccard": 0.9132791327913279, + "mean_token_weighted_tv": 0.017572988278982116, + "aggregate_load_tv": 0.02100271002710027 + }, + "system_bos": { + "tokens": 246, + "ordered_topk_exact_tokens": 140, + "set_exact_tokens": 173, + "mean_set_jaccard": 0.9073751451800233, + "mean_token_weighted_tv": 0.02031870587441192, + "aggregate_load_tv": 0.027100271002710025 + }, + "system_x": { + "tokens": 246, + "ordered_topk_exact_tokens": 126, + "set_exact_tokens": 162, + "mean_set_jaccard": 0.8901471157568719, + "mean_token_weighted_tv": 0.025652087769637687, + "aggregate_load_tv": 0.02574525745257451 + }, + "system_period": { + "tokens": 246, + "ordered_topk_exact_tokens": 104, + "set_exact_tokens": 142, + "mean_set_jaccard": 0.86947348044909, + "mean_token_weighted_tv": 0.02718689151835151, + "aggregate_load_tv": 0.029132791327913278 + }, + "bos_at_s0": { + "tokens": 246, + "ordered_topk_exact_tokens": 134, + "set_exact_tokens": 169, + "mean_set_jaccard": 0.9025745257452573, + "mean_token_weighted_tv": 0.02064269666590281, + "aggregate_load_tv": 0.028455284552845524 + }, + "bos_at_s1": { + "tokens": 246, + "ordered_topk_exact_tokens": 135, + "set_exact_tokens": 169, + "mean_set_jaccard": 0.9010664132615351, + "mean_token_weighted_tv": 0.02203739571907535, + "aggregate_load_tv": 0.03048780487804879 + }, + "x_at_s0": { + "tokens": 246, + "ordered_topk_exact_tokens": 119, + "set_exact_tokens": 156, + "mean_set_jaccard": 0.8817073170731706, + "mean_token_weighted_tv": 0.02777750653733416, + "aggregate_load_tv": 0.02981029810298104 + }, + "x_at_s1": { + "tokens": 246, + "ordered_topk_exact_tokens": 115, + "set_exact_tokens": 137, + "mean_set_jaccard": 0.8608031534860803, + "mean_token_weighted_tv": 0.03098289163715047, + "aggregate_load_tv": 0.03252032520325203 + }, + "period_at_s0": { + "tokens": 246, + "ordered_topk_exact_tokens": 125, + "set_exact_tokens": 161, + "mean_set_jaccard": 0.8897986837011226, + "mean_token_weighted_tv": 0.025843985698647737, + "aggregate_load_tv": 0.03116531165311654 + }, + "period_at_s1": { + "tokens": 246, + "ordered_topk_exact_tokens": 107, + "set_exact_tokens": 141, + "mean_set_jaccard": 0.864384260725724, + "mean_token_weighted_tv": 0.029510429914571285, + "aggregate_load_tv": 0.03184281842818429 + } + } + }, + "layer_21": { + "layer": 21, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "bbc044e0baf5652d9af1d23c792534daf6f657baa30aa1036181bc482eedb0e1", + "route_weight_sha256": "cc8663e2e8d729ad25b5be16bf86995ba9c55ecb48099896cacc6b0faf9e7603", + "loads": [ + 10, + 25, + 19, + 9, + 11, + 13, + 14, + 12, + 14, + 20, + 29, + 16, + 16, + 1, + 7, + 9, + 85, + 31, + 37, + 46, + 22, + 17, + 40, + 1, + 37, + 13, + 30, + 19, + 11, + 46, + 20, + 20, + 17, + 12, + 9, + 4, + 5, + 24, + 21, + 8, + 49, + 12, + 28, + 25, + 15, + 10, + 22, + 44, + 31, + 23, + 22, + 15, + 42, + 26, + 7, + 44, + 29, + 49, + 25, + 20, + 16, + 81, + 14, + 27 + ], + "weighted_loads": [ + 0.40456072241067886, + 2.518550857901573, + 3.249104875139892, + 1.7836595997214317, + 0.48085046373307705, + 1.127114251255989, + 1.0154182463884354, + 0.8139305617660284, + 0.6686804369091988, + 1.4746161885559559, + 4.028407663106918, + 0.5951155982911587, + 0.7589726112782955, + 0.0682336762547493, + 0.30504439026117325, + 0.33064172603189945, + 3.3389609586447477, + 3.7819113302975893, + 2.1996853351593018, + 1.765615763142705, + 1.3636303544044495, + 2.221359731629491, + 2.4595883060246706, + 0.08884299546480179, + 2.856216050684452, + 0.6346598826348782, + 1.3405981753021479, + 1.6073176059871912, + 0.4618955757468939, + 3.1080642454326153, + 0.8537996616214514, + 1.0272880867123604, + 0.9400694370269775, + 0.44538620859384537, + 0.35316888242959976, + 0.1653798259794712, + 0.21585658378899097, + 1.221775570884347, + 1.5915262307971716, + 0.2524586785584688, + 1.7793039362877607, + 0.5615470316261053, + 2.013897977769375, + 1.6593105923384428, + 0.9250841103494167, + 0.46897729858756065, + 1.1778474170714617, + 3.8474401850253344, + 1.268934080377221, + 0.9938530772924423, + 1.3281654883176088, + 1.0046203695237637, + 2.699690063484013, + 0.896341597661376, + 0.27861435152590275, + 3.839276347309351, + 3.1287161288782954, + 3.4378025457262993, + 1.7683860063552856, + 1.8739130608737469, + 0.6540350131690502, + 8.127176776528358, + 0.8114756587892771, + 1.9428249690681696 + ], + "unique_experts": 64, + "load_cv": 0.7001264669989117, + "normalized_load_entropy": 0.9479104153859906, + "max_load_share": 0.05758807588075881 + }, + "full_input": { + "tokens": 271, + "top_k": 6, + "decisions": 1626, + "ordered_route_sha256": "218734bdc15054d865f1e2c757c7a3bef33d793ed25ab34b85df70fcb589feb6", + "route_weight_sha256": "b4328141d8a110794f0707818ae9551ac89280890a61e0d01ea4dd88e83a1833", + "loads": [ + 10, + 25, + 22, + 9, + 18, + 13, + 16, + 12, + 17, + 20, + 38, + 17, + 18, + 6, + 9, + 14, + 89, + 34, + 38, + 53, + 22, + 25, + 40, + 2, + 37, + 13, + 38, + 24, + 14, + 46, + 21, + 21, + 18, + 13, + 10, + 14, + 5, + 24, + 21, + 10, + 50, + 12, + 33, + 25, + 15, + 10, + 22, + 44, + 42, + 24, + 22, + 22, + 52, + 27, + 12, + 46, + 30, + 49, + 29, + 22, + 16, + 82, + 17, + 27 + ], + "weighted_loads": [ + 0.40456072241067886, + 2.518550857901573, + 3.322085654595867, + 1.7836595997214317, + 0.7375452611595392, + 1.127114251255989, + 1.2114317417144775, + 0.8139305617660284, + 0.8890497237443924, + 1.4746161885559559, + 4.498314183205366, + 0.6518748924136162, + 0.8700549639761448, + 0.3854008950293064, + 0.36535739712417126, + 0.4871413204818964, + 3.4936931151896715, + 3.8653381122276187, + 2.2492241598665714, + 3.4444969948381186, + 1.3636303544044495, + 2.684678233228624, + 2.4595883060246706, + 0.13252323120832443, + 2.856216050684452, + 0.6346598826348782, + 1.7165131773799658, + 1.9958791118115187, + 0.5224935519509017, + 3.1080642454326153, + 0.8902475368231535, + 1.060881931334734, + 0.9628647901117802, + 0.4915403760969639, + 0.40265632793307304, + 0.7476672120392323, + 0.21585658378899097, + 1.221775570884347, + 1.5915262307971716, + 0.33299640379846096, + 1.833374923095107, + 0.5615470316261053, + 2.2754541635513306, + 1.6593105923384428, + 0.9250841103494167, + 0.46897729858756065, + 1.1778474170714617, + 3.8474401850253344, + 1.8568265456706285, + 1.1169981881976128, + 1.3281654883176088, + 1.3294468931853771, + 3.329999995417893, + 0.9093602187931538, + 0.48485222086310387, + 4.059234343469143, + 3.169518447481096, + 3.4378025457262993, + 1.9358105696737766, + 1.9388142433017492, + 0.6540350131690502, + 8.179237239062786, + 0.9589938875287771, + 1.9428249690681696 + ], + "unique_experts": 64, + "load_cv": 0.6487274244267306, + "normalized_load_entropy": 0.95571138148467, + "max_load_share": 0.054735547355473556 + } + }, + "s1_eos": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "d4170af65535407d6904f10a498794f64eded518cf4151cc67644f86d4d527ff", + "route_weight_sha256": "d87f64a61dc49360b4a73dac8dd2ad441f70284892dc68cd02a133b633ccebc3", + "loads": [ + 11, + 25, + 18, + 9, + 11, + 14, + 14, + 12, + 13, + 20, + 31, + 14, + 15, + 1, + 8, + 10, + 90, + 32, + 34, + 44, + 23, + 19, + 40, + 1, + 37, + 13, + 31, + 19, + 11, + 47, + 22, + 19, + 17, + 11, + 7, + 4, + 5, + 24, + 21, + 7, + 44, + 11, + 26, + 28, + 14, + 8, + 21, + 46, + 30, + 23, + 23, + 17, + 43, + 25, + 8, + 44, + 28, + 49, + 24, + 20, + 17, + 81, + 15, + 27 + ], + "weighted_loads": [ + 0.43797661550343037, + 2.50009224191308, + 3.2111519826576114, + 1.8410328179597855, + 0.4779664408415556, + 1.2344393245875835, + 1.0182903073728085, + 0.7878946103155613, + 0.6090829446911812, + 1.493194654583931, + 4.093125810846686, + 0.5000961478799582, + 0.7431481890380383, + 0.062129706144332886, + 0.3402269594371319, + 0.3578933831304312, + 3.5070800445973873, + 3.7611327785998583, + 2.1425824724137783, + 1.7139235567301512, + 1.3871675357222557, + 2.305574292317033, + 2.4594826512038708, + 0.09732235968112946, + 2.845671683549881, + 0.6271361969411373, + 1.3729032780975103, + 1.59211827814579, + 0.4900663122534752, + 3.144448744133115, + 0.9143164167180657, + 0.9573896806687117, + 0.9275741912424564, + 0.4047002848237753, + 0.2779662534594536, + 0.15818584151566029, + 0.2189265713095665, + 1.2542492542415857, + 1.5608284827321768, + 0.23390778712928295, + 1.580841302871704, + 0.5265953671187162, + 1.9595719128847122, + 1.8133593201637268, + 0.8409528806805611, + 0.4024769179522991, + 1.116028804332018, + 3.8716513570398092, + 1.2850091457366943, + 1.0502379974350333, + 1.3622278217226267, + 1.0736294724047184, + 2.6695768870413303, + 0.8506197147071362, + 0.32945348881185055, + 3.960811736062169, + 3.062863032333553, + 3.3846512716263533, + 1.71595742367208, + 1.8636978175491095, + 0.6832259278744459, + 8.241311997175217, + 0.8242060299962759, + 1.9136506002396345 + ], + "unique_experts": 64, + "load_cv": 0.7110762021307856, + "normalized_load_entropy": 0.9468896320294815, + "max_load_share": 0.06097560975609756 + }, + "full_input": { + "tokens": 287, + "top_k": 6, + "decisions": 1722, + "ordered_route_sha256": "45c4a2f217715a0a82330c1af1324051f1f7a7ed388ba5070c170af62ee090c1", + "route_weight_sha256": "61063c5f92cef7e518caef0aae2bebba25bf05074515340824a174d4e383b87d", + "loads": [ + 19, + 26, + 21, + 9, + 11, + 16, + 19, + 13, + 17, + 23, + 42, + 15, + 20, + 10, + 15, + 13, + 94, + 40, + 37, + 52, + 24, + 26, + 41, + 6, + 38, + 16, + 39, + 29, + 14, + 48, + 28, + 19, + 18, + 15, + 7, + 20, + 6, + 25, + 22, + 8, + 45, + 14, + 33, + 29, + 15, + 9, + 21, + 46, + 41, + 26, + 25, + 27, + 53, + 26, + 20, + 53, + 32, + 49, + 27, + 23, + 18, + 83, + 18, + 28 + ], + "weighted_loads": [ + 0.9462856780737638, + 2.54892248660326, + 3.9035611310973763, + 1.8410328179597855, + 0.4779664408415556, + 1.2837373353540897, + 1.2312970291823149, + 0.8693479634821415, + 0.828810527920723, + 1.6702392883598804, + 4.656252855435014, + 0.5447655376046896, + 0.9946217946708202, + 0.5779354944825172, + 0.6075664777308702, + 0.4453580491244793, + 3.654667615890503, + 4.041265892796218, + 2.2512486148625612, + 3.403685862198472, + 1.4333543069660664, + 2.743999531492591, + 2.49002087675035, + 0.5953243598341942, + 2.8811134211719036, + 0.7235755249857903, + 1.668178191408515, + 2.46102811396122, + 0.5252504297532141, + 3.1923409160226583, + 1.1412727003917098, + 0.9573896806687117, + 0.950227677822113, + 0.9991985466331244, + 0.2779662534594536, + 1.0341110546141863, + 0.28758280724287033, + 1.295350732281804, + 1.6152213346213102, + 0.2724714931100607, + 1.6196178384125233, + 0.6922050099819899, + 2.312974750995636, + 1.856699362397194, + 0.9056202098727226, + 0.46215977147221565, + 1.116028804332018, + 3.8716513570398092, + 2.08682581782341, + 1.9618622465059161, + 1.4440334122627974, + 1.815739344805479, + 3.2410789132118225, + 0.8636383358389139, + 1.0683624669909477, + 4.553480314090848, + 3.224189412780106, + 3.3846512716263533, + 1.8546559698879719, + 2.0268158558756113, + 0.705635990947485, + 8.346429154276848, + 0.949084559455514, + 2.005893735215068 + ], + "unique_experts": 64, + "load_cv": 0.6171948224962613, + "normalized_load_entropy": 0.9601962382522036, + "max_load_share": 0.0545876887340302 + } + }, + "s0_bos": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "084c75accf81233c07c4d638ff56abad44eafae09f65c7222ea5e0ff0e0f48d1", + "route_weight_sha256": "6e00a5416b4d334fe8283295abe446522c4ff35092a8f58756a245b776bcb476", + "loads": [ + 10, + 25, + 18, + 11, + 13, + 13, + 14, + 13, + 12, + 21, + 29, + 13, + 17, + 1, + 7, + 8, + 82, + 31, + 35, + 37, + 23, + 17, + 42, + 4, + 37, + 13, + 27, + 19, + 13, + 48, + 22, + 17, + 18, + 11, + 8, + 5, + 6, + 25, + 21, + 10, + 49, + 12, + 27, + 25, + 14, + 10, + 23, + 45, + 37, + 22, + 23, + 17, + 41, + 25, + 9, + 45, + 29, + 48, + 21, + 22, + 16, + 78, + 15, + 27 + ], + "weighted_loads": [ + 0.4023830983787775, + 2.5567023027688265, + 3.2286725491285324, + 1.8078098520636559, + 0.5542109832167625, + 1.1217684410512447, + 1.0134117156267166, + 0.8295932672917843, + 0.6366640366613865, + 1.558577999472618, + 4.101124703884125, + 0.4944056421518326, + 0.7705623488873243, + 0.06808803230524063, + 0.3076064996421337, + 0.3052141647785902, + 3.192773588001728, + 3.760268582031131, + 2.156790152192116, + 1.4022342897951603, + 1.4308711886405945, + 2.160995153710246, + 2.5609449818730354, + 0.18558674678206444, + 2.8973638229072094, + 0.6329620219767094, + 1.2283848617225885, + 1.6781635452061892, + 0.5531906541436911, + 3.2436178755015135, + 0.9125145096331835, + 0.9511296525597572, + 0.9468147400766611, + 0.4111598078161478, + 0.3209423515945673, + 0.20415297523140907, + 0.2567063979804516, + 1.2577084228396416, + 1.583966264501214, + 0.3379407338798046, + 1.798662155866623, + 0.5640715900808573, + 1.9250356424599886, + 1.6658541914075613, + 0.8616694509983063, + 0.4690508935600519, + 1.281696880236268, + 3.955513745546341, + 1.6118094939738512, + 0.9671596270054579, + 1.4016857966780663, + 1.0690630599856377, + 2.7147183790802956, + 0.8713961243629456, + 0.3569812159985304, + 3.8341371919959784, + 3.134552708826959, + 3.4731499925255775, + 1.6979272440075874, + 1.9974545277655125, + 0.6384296454489231, + 8.130631014704704, + 0.8299318421632051, + 1.9772276263684034 + ], + "unique_experts": 64, + "load_cv": 0.6750905423713424, + "normalized_load_entropy": 0.9518696776926764, + "max_load_share": 0.05555555555555555 + }, + "full_input": { + "tokens": 271, + "top_k": 6, + "decisions": 1626, + "ordered_route_sha256": "ae3ba377544d1763f05ab5d3b3558cda09c97d8cdb572a74f9c8106fd49a60a7", + "route_weight_sha256": "cb83712eeae56df2c6efab694af9bdac97595254e8c8ad3f1d0e44fb22bacb3c", + "loads": [ + 10, + 26, + 20, + 12, + 18, + 13, + 15, + 13, + 16, + 21, + 36, + 14, + 20, + 6, + 9, + 12, + 86, + 33, + 37, + 41, + 23, + 24, + 42, + 5, + 37, + 13, + 36, + 24, + 15, + 48, + 23, + 21, + 19, + 11, + 9, + 15, + 6, + 25, + 21, + 14, + 53, + 12, + 31, + 25, + 14, + 12, + 23, + 45, + 48, + 24, + 23, + 24, + 51, + 26, + 14, + 47, + 30, + 48, + 23, + 24, + 16, + 79, + 18, + 27 + ], + "weighted_loads": [ + 0.4023830983787775, + 2.5979485269635916, + 3.2991320472210646, + 2.0209347531199455, + 0.743575856089592, + 1.1217684410512447, + 1.1612520068883896, + 0.8295932672917843, + 0.8917684219777584, + 1.558577999472618, + 4.472464118152857, + 0.5352498516440392, + 0.925854092463851, + 0.3531889356672764, + 0.3635322619229555, + 0.44813789799809456, + 3.3428716845810413, + 3.839685508981347, + 2.252375416457653, + 2.063044920563698, + 1.4308711886405945, + 2.621717683970928, + 2.5609449818730354, + 0.22926698252558708, + 2.8973638229072094, + 0.6329620219767094, + 1.6405784618109465, + 2.063715713098645, + 0.6093585845082998, + 3.2436178755015135, + 0.9529313649982214, + 1.2364328764379025, + 0.9696100931614637, + 0.4111598078161478, + 0.3704297970980406, + 0.7864403612911701, + 0.2567063979804516, + 1.2577084228396416, + 1.583966264501214, + 0.5009653940796852, + 2.013464968651533, + 0.5640715900808573, + 2.151080185547471, + 1.6658541914075613, + 0.8616694509983063, + 0.6260663736611605, + 1.281696880236268, + 3.955513745546341, + 2.199627349153161, + 1.1334883142262697, + 1.4016857966780663, + 1.3938895836472511, + 3.3450283110141754, + 0.8844147454947233, + 0.5190918743610382, + 4.074031023308635, + 3.1753550274297595, + 3.4731499925255775, + 1.758617214858532, + 2.062355710193515, + 0.6384296454489231, + 8.196441382169724, + 0.9765807967633009, + 1.9772276263684034 + ], + "unique_experts": 64, + "load_cv": 0.6248547228992114, + "normalized_load_entropy": 0.959146563905702, + "max_load_share": 0.05289052890528905 + } + }, + "s1_bos": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "9edc2914077d0ea3be13a95bc838a18732b20e643dbc9471956bf55fcf7261bc", + "route_weight_sha256": "234a9bc51a0379cbd6529dd94814585f6a3a59b32392f74944750f3bfa1e8a87", + "loads": [ + 12, + 25, + 20, + 11, + 13, + 14, + 14, + 12, + 13, + 21, + 31, + 18, + 14, + 1, + 9, + 9, + 84, + 31, + 35, + 43, + 22, + 19, + 42, + 3, + 38, + 10, + 25, + 19, + 11, + 48, + 25, + 16, + 18, + 9, + 9, + 4, + 6, + 23, + 21, + 11, + 46, + 12, + 26, + 27, + 14, + 9, + 21, + 46, + 34, + 22, + 21, + 18, + 43, + 19, + 8, + 46, + 26, + 46, + 23, + 22, + 17, + 81, + 13, + 27 + ], + "weighted_loads": [ + 0.4904545173048973, + 2.525811804458499, + 3.2501619439572096, + 1.9173386991024017, + 0.5380283053964376, + 1.1930438093841076, + 1.0356304869055748, + 0.8051159102469683, + 0.6444374844431877, + 1.5487982146441936, + 4.1022849678993225, + 0.6531202457845211, + 0.7059908285737038, + 0.06911098212003708, + 0.3815269507467747, + 0.31795858033001423, + 3.293230887502432, + 3.6457413900643587, + 2.1950590927153826, + 1.6193204671144485, + 1.3823990039527416, + 2.334315298125148, + 2.5522763784974813, + 0.15473001450300217, + 2.94375903904438, + 0.4968081247061491, + 1.1590252853929996, + 1.6340655069798231, + 0.476045960560441, + 3.2196499221026897, + 1.0705622620880604, + 0.8642811253666878, + 0.9664919096976519, + 0.3175992015749216, + 0.34784841910004616, + 0.16352653689682484, + 0.26116865687072277, + 1.2280800640583038, + 1.5473647601902485, + 0.3875637501478195, + 1.673008130863309, + 0.5637342259287834, + 1.87724220007658, + 1.7453475780785084, + 0.82162169739604, + 0.4443278945982456, + 1.166929218918085, + 3.891936542466283, + 1.4710780084133148, + 1.009159048087895, + 1.3546651862561703, + 1.1131274830549955, + 2.722779023461044, + 0.647640272974968, + 0.33211106434464455, + 3.9541181717067957, + 3.0148950526490808, + 3.2587168235331774, + 1.7165376115590334, + 2.0441289599984884, + 0.6903286725282669, + 8.307525127194822, + 0.7204357776790857, + 1.9288528636097908 + ], + "unique_experts": 64, + "load_cv": 0.690493420298551, + "normalized_load_entropy": 0.9501461209885868, + "max_load_share": 0.056910569105691054 + }, + "full_input": { + "tokens": 287, + "top_k": 6, + "decisions": 1722, + "ordered_route_sha256": "5cfe8404bd52afcba40b620655abfc443282b13ddf37b24ff1de9c7bd0039443", + "route_weight_sha256": "cad4d804f2a795838904ec2bf737e7282f03fe5d2ebc775076f695f7ba43198a", + "loads": [ + 20, + 27, + 22, + 11, + 16, + 16, + 18, + 14, + 17, + 24, + 40, + 20, + 19, + 9, + 15, + 12, + 88, + 38, + 39, + 50, + 23, + 25, + 43, + 8, + 39, + 13, + 33, + 30, + 13, + 49, + 31, + 18, + 19, + 14, + 9, + 20, + 7, + 24, + 22, + 12, + 47, + 15, + 33, + 28, + 15, + 10, + 21, + 46, + 44, + 26, + 23, + 28, + 53, + 20, + 20, + 55, + 30, + 46, + 24, + 25, + 18, + 83, + 17, + 28 + ], + "weighted_loads": [ + 0.9987635798752308, + 2.6098135355859995, + 3.939908789470792, + 1.9173386991024017, + 0.6506878864020109, + 1.2426747493445873, + 1.2569952178746462, + 0.9234454240649939, + 0.8751108720898628, + 1.7258428484201431, + 4.592716716229916, + 0.7406429573893547, + 0.9659977182745934, + 0.5348282381892204, + 0.6070346999913454, + 0.43918050825595856, + 3.4385080374777317, + 3.929116679355502, + 2.3570467308163643, + 2.366849523037672, + 1.4285857751965523, + 2.766369253396988, + 2.5828146040439606, + 0.6527320146560669, + 2.979200776666403, + 0.593247452750802, + 1.4543001987040043, + 2.5308623407036066, + 0.5068842265754938, + 3.2675420939922333, + 1.3091252278536558, + 0.9904594458639622, + 0.9891453962773085, + 0.9494500104337931, + 0.34784841910004616, + 1.0394517499953508, + 0.3298248928040266, + 1.2691815420985222, + 1.601757612079382, + 0.4212591014802456, + 1.7185798529535532, + 0.729343868792057, + 2.230645038187504, + 1.7886876203119755, + 0.8862890265882015, + 0.5040107481181622, + 1.166929218918085, + 3.891936542466283, + 2.234818894416094, + 2.013927781023085, + 1.436470776796341, + 1.8552373554557562, + 3.294281049631536, + 0.6606588941067457, + 1.0806097518652678, + 4.5665029007941484, + 3.176221433095634, + 3.2587168235331774, + 1.741483185440302, + 2.2072469983249903, + 0.712738735601306, + 8.429078633897007, + 0.9103066716343164, + 2.021095998585224 + ], + "unique_experts": 64, + "load_cv": 0.596061015811112, + "normalized_load_entropy": 0.963116089213463, + "max_load_share": 0.05110336817653891 + } + }, + "s0_x": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "6b972017e06a46b02fea0e243de971e74605b6c779fe4ae5f62dac521b88e6d4", + "route_weight_sha256": "4469d13bf401c778b538692c192091bcb4cf8d5a9cb4562a1778c51302f4b944", + "loads": [ + 12, + 27, + 16, + 12, + 9, + 12, + 15, + 11, + 12, + 21, + 31, + 13, + 16, + 1, + 7, + 7, + 81, + 32, + 32, + 40, + 23, + 16, + 40, + 5, + 37, + 14, + 26, + 19, + 13, + 45, + 24, + 18, + 18, + 11, + 7, + 4, + 5, + 23, + 21, + 7, + 51, + 13, + 27, + 28, + 14, + 9, + 19, + 45, + 37, + 24, + 24, + 20, + 42, + 23, + 10, + 45, + 29, + 49, + 23, + 21, + 15, + 82, + 15, + 28 + ], + "weighted_loads": [ + 0.48537575639784336, + 2.6957192085683346, + 3.1873426903039217, + 1.8366432189941406, + 0.3691168241202831, + 1.1299315840005875, + 1.0582986902445555, + 0.7994116246700287, + 0.60543317720294, + 1.4992574006319046, + 4.209047926589847, + 0.510665750131011, + 0.7241099663078785, + 0.08030103147029877, + 0.3248806707561016, + 0.2826096583157778, + 3.1647605262696743, + 3.8257646281272173, + 2.0782038792967796, + 1.5526154674589634, + 1.444186557084322, + 2.0832479391247034, + 2.470875283703208, + 0.24146351777017117, + 2.8361755833029747, + 0.6534077171236277, + 1.1084455158561468, + 1.702442642301321, + 0.5698703490197659, + 3.082532111555338, + 0.9878120645880699, + 0.9717167932540178, + 0.9580742912366986, + 0.39254510402679443, + 0.25435555912554264, + 0.18054120615124702, + 0.21762513741850853, + 1.191215954720974, + 1.603578582406044, + 0.23586132563650608, + 1.8719146065413952, + 0.59102763235569, + 1.907437851652503, + 1.6665542013943195, + 0.8154616989195347, + 0.4628087468445301, + 1.0900767017155886, + 3.87124384380877, + 1.5875454004853964, + 1.041248814202845, + 1.4354611281305552, + 1.198128653690219, + 2.7200822988525033, + 0.826969699934125, + 0.39603329449892044, + 3.74183845333755, + 3.2131006652489305, + 3.4857315849512815, + 1.771523179486394, + 1.8452048152685165, + 0.6196070797741413, + 8.22502052411437, + 0.852824317291379, + 2.0229521449655294 + ], + "unique_experts": 64, + "load_cv": 0.6898123657012923, + "normalized_load_entropy": 0.9495838181006373, + "max_load_share": 0.05555555555555555 + }, + "full_input": { + "tokens": 271, + "top_k": 6, + "decisions": 1626, + "ordered_route_sha256": "ef70f1451c5e58176c3f8526f016ca3f126cfc67702ddc4e99682dfd2c657cc2", + "route_weight_sha256": "46c742a3b4fac6332f90edc9b56c98c3a8134d0e0312280394ba9b7f4f2f5e50", + "loads": [ + 12, + 27, + 18, + 12, + 16, + 12, + 17, + 11, + 15, + 21, + 40, + 14, + 20, + 5, + 8, + 10, + 86, + 36, + 33, + 45, + 23, + 22, + 40, + 6, + 37, + 14, + 34, + 24, + 16, + 45, + 25, + 20, + 19, + 11, + 9, + 15, + 5, + 23, + 21, + 8, + 53, + 13, + 34, + 28, + 14, + 9, + 19, + 45, + 49, + 26, + 24, + 27, + 53, + 24, + 15, + 47, + 31, + 49, + 25, + 23, + 15, + 83, + 17, + 28 + ], + "weighted_loads": [ + 0.48537575639784336, + 2.6957192085683346, + 3.257802188396454, + 1.8366432189941406, + 0.6293458379805088, + 1.1299315840005875, + 1.2515996117144823, + 0.7994116246700287, + 0.8311894051730633, + 1.4992574006319046, + 4.673710776492953, + 0.5598304253071547, + 0.9174518845975399, + 0.33031387254595757, + 0.3484663348644972, + 0.3833046443760395, + 3.3591879531741142, + 3.9758230838924646, + 2.1256865449249744, + 2.245870854705572, + 1.444186557084322, + 2.502357866615057, + 2.470875283703208, + 0.2851437535136938, + 2.8361755833029747, + 0.6534077171236277, + 1.4843605179339647, + 2.0810112841427326, + 0.6696934849023819, + 3.082532111555338, + 1.0235477946698666, + 1.0677579287439585, + 0.9808696443215013, + 0.39254510402679443, + 0.3377061355859041, + 0.8563611321151257, + 0.21762513741850853, + 1.191215954720974, + 1.603578582406044, + 0.2761355582624674, + 1.9489701613783836, + 0.59102763235569, + 2.273724591359496, + 1.6665542013943195, + 0.8154616989195347, + 0.4628087468445301, + 1.0900767017155886, + 3.87124384380877, + 2.261682629585266, + 1.2269725212827325, + 1.4354611281305552, + 1.5229551773518324, + 3.5429799491539598, + 0.8399883210659027, + 0.560096139088273, + 3.9827595334500074, + 3.302377258427441, + 3.4857315849512815, + 1.8389723245054483, + 1.910105997696519, + 0.6196070797741413, + 8.264232721179724, + 0.9378016535192728, + 2.0229521449655294 + ], + "unique_experts": 64, + "load_cv": 0.646784164349493, + "normalized_load_entropy": 0.9559569054155185, + "max_load_share": 0.05289052890528905 + } + }, + "s1_x": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "6630581987eda3c944378ccc37d0ddd7976413881be9061db4487ecab7f5112f", + "route_weight_sha256": "9d5be0a700b63859792f91f8147527851af52ab8816c675cad8d84443ce7cd1b", + "loads": [ + 13, + 26, + 20, + 11, + 15, + 13, + 13, + 11, + 15, + 21, + 33, + 15, + 16, + 1, + 8, + 9, + 80, + 31, + 31, + 49, + 23, + 17, + 42, + 4, + 37, + 11, + 24, + 19, + 14, + 47, + 21, + 16, + 18, + 12, + 7, + 5, + 5, + 24, + 22, + 4, + 46, + 12, + 26, + 26, + 14, + 8, + 21, + 45, + 40, + 20, + 22, + 19, + 44, + 17, + 10, + 43, + 30, + 46, + 23, + 21, + 16, + 83, + 15, + 26 + ], + "weighted_loads": [ + 0.5403712093830109, + 2.6243060808628798, + 3.325435856357217, + 1.7841472662985325, + 0.630051514133811, + 1.1593699343502522, + 0.9815457593649626, + 0.7950816005468369, + 0.7501919902861118, + 1.5516025573015213, + 4.156907252967358, + 0.5532912481576204, + 0.7716175317764282, + 0.06595463305711746, + 0.33830200508236885, + 0.34072209149599075, + 3.111346108838916, + 3.7179658878594637, + 2.00082621909678, + 1.899706607684493, + 1.4355067051947117, + 2.1588543578982353, + 2.5801918134093285, + 0.21194041520357132, + 2.9098118506371975, + 0.551011472940445, + 1.0388571601361036, + 1.6622556298971176, + 0.5935757029801607, + 3.169474996626377, + 0.8776297373697162, + 0.9417329169809818, + 0.9435490276664495, + 0.46866816468536854, + 0.3265598528087139, + 0.21186153031885624, + 0.23151716031134129, + 1.2652325294911861, + 1.592301107943058, + 0.1419277861714363, + 1.6795213129371405, + 0.5584225859493017, + 1.8622326888144016, + 1.5836559645831585, + 0.8355162218213081, + 0.3885722290724516, + 1.1839299462735653, + 3.7765905894339085, + 1.6997667159885168, + 0.8931902628391981, + 1.3737037610262632, + 1.2001732382923365, + 2.769301594235003, + 0.5894749723374844, + 0.42487914487719536, + 3.594223950058222, + 3.222165133804083, + 3.3112222123891115, + 1.6964483130723238, + 1.9815594423562288, + 0.6420155111700296, + 8.1738165281713, + 0.80218655616045, + 1.9171741306781769 + ], + "unique_experts": 64, + "load_cv": 0.6914287750211233, + "normalized_load_entropy": 0.9495303820391513, + "max_load_share": 0.05623306233062331 + }, + "full_input": { + "tokens": 287, + "top_k": 6, + "decisions": 1722, + "ordered_route_sha256": "8e3b6aeb7c7738d1661b263243f8667886bcc2f0c9e04a23c20e86dfde49a946", + "route_weight_sha256": "df33d94439f1235a267149d8a126838182ae6abc38faff36a1d1f29f8e16a7dc", + "loads": [ + 21, + 27, + 22, + 11, + 15, + 15, + 16, + 12, + 18, + 24, + 43, + 16, + 23, + 9, + 14, + 12, + 85, + 37, + 33, + 56, + 24, + 23, + 43, + 11, + 38, + 16, + 32, + 28, + 16, + 48, + 27, + 17, + 19, + 16, + 8, + 22, + 6, + 25, + 23, + 5, + 46, + 16, + 36, + 27, + 16, + 9, + 21, + 45, + 54, + 23, + 24, + 29, + 55, + 18, + 22, + 52, + 34, + 46, + 24, + 24, + 17, + 85, + 16, + 27 + ], + "weighted_loads": [ + 1.0486802719533443, + 2.6731363255530596, + 4.015182701870799, + 1.7841472662985325, + 0.630051514133811, + 1.2137439288198948, + 1.0881012231111526, + 0.876534953713417, + 0.9447797909379005, + 1.7286471910774708, + 4.65920471586287, + 0.5887009147554636, + 1.1334505788981915, + 0.5579369589686394, + 0.5758149642497301, + 0.4510291162878275, + 3.276209607720375, + 3.959859861060977, + 2.0540479235351086, + 2.657097300514579, + 1.4816934764385223, + 2.58579689450562, + 2.6107300389558077, + 0.8100141659379005, + 2.94525358825922, + 0.7409045659005642, + 1.3341320734471083, + 2.484222151339054, + 0.6244139689952135, + 3.2173671685159206, + 1.1078497068956494, + 0.9783584512770176, + 0.9662025142461061, + 1.0631664264947176, + 0.3592381700873375, + 1.1582434345036745, + 0.3001733962446451, + 1.3063340075314045, + 1.6466939598321915, + 0.17950188741087914, + 1.6795213129371405, + 0.8046057354658842, + 2.368378896266222, + 1.6269960068166256, + 0.9317931197583675, + 0.4482550825923681, + 1.1839299462735653, + 3.7765905894339085, + 2.747731603682041, + 1.8092297185212374, + 1.455509351566434, + 1.9422831106930971, + 3.547197130508721, + 0.6024935934692621, + 1.147435637190938, + 4.2113394774496555, + 3.383491514250636, + 3.3112222123891115, + 1.7213938869535923, + 2.1446774806827307, + 0.6644255742430687, + 8.281278751790524, + 0.8389838561415672, + 2.0094172656536102 + ], + "unique_experts": 64, + "load_cv": 0.6080347363567423, + "normalized_load_entropy": 0.9611526767351312, + "max_load_share": 0.04936120789779326 + } + }, + "s0_period": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "8e210c400c8c2b49a5115ba1f2b342c0077a9de07cdb333865d7cc821a3fc671", + "route_weight_sha256": "037098b3880c2d8ab47421cf4edf879c772b5d0236c89d93f949e475fd35f1b3", + "loads": [ + 11, + 26, + 19, + 13, + 11, + 12, + 15, + 11, + 12, + 20, + 31, + 13, + 15, + 1, + 7, + 8, + 81, + 31, + 33, + 41, + 22, + 18, + 41, + 4, + 37, + 14, + 28, + 19, + 11, + 45, + 22, + 17, + 18, + 11, + 6, + 6, + 5, + 23, + 21, + 10, + 50, + 11, + 27, + 27, + 14, + 8, + 20, + 44, + 37, + 23, + 24, + 22, + 43, + 22, + 7, + 44, + 30, + 49, + 24, + 23, + 14, + 81, + 15, + 28 + ], + "weighted_loads": [ + 0.445372024551034, + 2.6506501268595457, + 3.2805720437318087, + 1.8573655299842358, + 0.43492491729557514, + 1.1296428628265858, + 1.0572789274156094, + 0.7752568311989307, + 0.58888222835958, + 1.4770296029746532, + 4.181046165525913, + 0.5260459054261446, + 0.6981738936156034, + 0.0657881572842598, + 0.32261787354946136, + 0.3125890754163265, + 3.1287098862230778, + 3.787276975810528, + 2.1152886990457773, + 1.6143891047686338, + 1.4073385931551456, + 2.1558481119573116, + 2.5035091508179903, + 0.2363499104976654, + 2.8624458983540535, + 0.6585319116711617, + 1.1846717428416014, + 1.6492723990231752, + 0.49229864217340946, + 3.104438066482544, + 0.9026072807610035, + 0.9997036121785641, + 0.959728374145925, + 0.40794081054627895, + 0.2297833301126957, + 0.25223767571151257, + 0.21686997264623642, + 1.1910356171429157, + 1.6251438856124878, + 0.3458690978586674, + 1.8240972999483347, + 0.5416549742221832, + 1.8837907239794731, + 1.6758902128785849, + 0.8246475625783205, + 0.41153475642204285, + 1.137148441746831, + 3.886760326102376, + 1.6170062012970448, + 1.0014319624751806, + 1.4267620909959078, + 1.3104187473654747, + 2.7420834358781576, + 0.7918090485036373, + 0.29622395150363445, + 3.720818504691124, + 3.203294494189322, + 3.4841617699712515, + 1.7830252218991518, + 1.9884329997003078, + 0.5992337819188833, + 8.20998826995492, + 0.8437716141343117, + 2.009581584483385 + ], + "unique_experts": 64, + "load_cv": 0.6871241514055337, + "normalized_load_entropy": 0.9497783950001357, + "max_load_share": 0.054878048780487805 + }, + "full_input": { + "tokens": 271, + "top_k": 6, + "decisions": 1626, + "ordered_route_sha256": "070c3eb998923bea26361b483bee789935b59e1d4c7770291ae5ff23f5a42262", + "route_weight_sha256": "de3d776de8a3ceed93cd86c5d540d6e919c88e6b9b61bf46844c0234c971837e", + "loads": [ + 11, + 26, + 21, + 13, + 19, + 12, + 17, + 11, + 15, + 20, + 38, + 14, + 19, + 7, + 9, + 12, + 86, + 34, + 34, + 45, + 22, + 24, + 41, + 5, + 37, + 14, + 37, + 24, + 14, + 45, + 23, + 18, + 19, + 11, + 7, + 17, + 5, + 23, + 21, + 11, + 53, + 11, + 32, + 27, + 14, + 9, + 20, + 44, + 48, + 25, + 24, + 30, + 53, + 23, + 13, + 47, + 31, + 49, + 25, + 26, + 14, + 82, + 17, + 28 + ], + "weighted_loads": [ + 0.445372024551034, + 2.6506501268595457, + 3.351031541824341, + 1.8573655299842358, + 0.7302189730107784, + 1.1296428628265858, + 1.2921961583197117, + 0.7752568311989307, + 0.8244540896266699, + 1.4770296029746532, + 4.551387883722782, + 0.5732480715960264, + 0.8940213602036238, + 0.3886534012854099, + 0.3771388754248619, + 0.46324786357581615, + 3.3196343891322613, + 3.9020440727472305, + 2.171455582603812, + 2.268826561048627, + 1.4073385931551456, + 2.574958039447665, + 2.5035091508179903, + 0.28003014624118805, + 2.8624458983540535, + 0.6585319116711617, + 1.5973147731274366, + 2.0445678550750017, + 0.5883883479982615, + 3.104438066482544, + 0.9353835880756378, + 1.0695900283753872, + 0.9825237272307277, + 0.40794081054627895, + 0.279270775616169, + 0.8969258051365614, + 0.21686997264623642, + 1.1910356171429157, + 1.6251438856124878, + 0.38427967578172684, + 1.9376374501734972, + 0.5416549742221832, + 2.167097482830286, + 1.6758902128785849, + 0.8246475625783205, + 0.4529576860368252, + 1.137148441746831, + 3.886760326102376, + 2.2394061237573624, + 1.2400153931230307, + 1.4267620909959078, + 1.6951166801154613, + 3.3723933678120375, + 0.8048276696354151, + 0.4960707314312458, + 4.0329883098602295, + 3.2440968127921224, + 3.4841617699712515, + 1.8076561745256186, + 2.14400920830667, + 0.5992337819188833, + 8.245628885924816, + 0.9362192749977112, + 2.009581584483385 + ], + "unique_experts": 64, + "load_cv": 0.641560785478406, + "normalized_load_entropy": 0.9566775865639993, + "max_load_share": 0.05289052890528905 + } + }, + "s1_period": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "9000a27e5e2c9d756e43077d422ce577b1b08671f667b95027b5da447a58ac60", + "route_weight_sha256": "4af632bb2c16522459fc2321083454c54b927dc95d4a4d90593f2cac57949ae5", + "loads": [ + 13, + 25, + 19, + 12, + 15, + 15, + 13, + 11, + 14, + 20, + 32, + 15, + 14, + 2, + 9, + 9, + 78, + 31, + 33, + 47, + 22, + 16, + 42, + 5, + 37, + 12, + 25, + 19, + 15, + 47, + 22, + 15, + 18, + 11, + 7, + 5, + 5, + 24, + 22, + 5, + 49, + 12, + 26, + 27, + 13, + 7, + 21, + 45, + 37, + 22, + 23, + 19, + 45, + 17, + 10, + 42, + 28, + 47, + 23, + 25, + 17, + 81, + 14, + 25 + ], + "weighted_loads": [ + 0.538802020251751, + 2.573476767167449, + 3.2766254376620054, + 1.9163952134549618, + 0.6213915888220072, + 1.2291746065020561, + 0.986938988789916, + 0.8251483403146267, + 0.7096351757645607, + 1.510624822229147, + 4.091688657179475, + 0.5418335311114788, + 0.7142031639814377, + 0.09319520741701126, + 0.3743215948343277, + 0.33286304771900177, + 3.0390876941382885, + 3.694506049156189, + 2.048622163012624, + 1.8153056483715773, + 1.3845499753952026, + 2.149399036541581, + 2.586888102814555, + 0.24755872040987015, + 2.9016331285238266, + 0.583248982205987, + 1.0855425037443638, + 1.6346114221960306, + 0.6300467122346163, + 3.1806960850954056, + 0.9007507376372814, + 0.8534970637410879, + 0.9509000573307276, + 0.4251848664134741, + 0.31219126656651497, + 0.19985337182879448, + 0.2300903219729662, + 1.2858845684677362, + 1.6150311194360256, + 0.17910656705498695, + 1.7344975173473358, + 0.5584976747632027, + 1.8346192445605993, + 1.6703864596784115, + 0.7946821264922619, + 0.34771926887333393, + 1.1718443166464567, + 3.802409401163459, + 1.580979760736227, + 1.0066543836146593, + 1.4099468998610973, + 1.1993785630911589, + 2.7959498930722475, + 0.5493331365287304, + 0.4129984453320503, + 3.5642680916935205, + 3.1684566298499703, + 3.3414018284529448, + 1.6852926462888718, + 2.1653238236904144, + 0.6785204652696848, + 8.118888704106212, + 0.7813785187900066, + 1.8675211742520332 + ], + "unique_experts": 64, + "load_cv": 0.6796010990330213, + "normalized_load_entropy": 0.9512505780756123, + "max_load_share": 0.054878048780487805 + }, + "full_input": { + "tokens": 287, + "top_k": 6, + "decisions": 1722, + "ordered_route_sha256": "ab03ecdf22d007112c052c63fd86cf92b21f877397b6c90ee08bec2907e96d8d", + "route_weight_sha256": "60b8b8198731399abfdb6a5804a53fec9a2e564d0517e5d9a9a224ecb2344891", + "loads": [ + 21, + 26, + 21, + 12, + 16, + 17, + 17, + 12, + 17, + 23, + 40, + 16, + 21, + 11, + 17, + 12, + 81, + 37, + 36, + 54, + 23, + 22, + 43, + 12, + 38, + 15, + 33, + 28, + 17, + 48, + 27, + 16, + 19, + 15, + 7, + 23, + 6, + 25, + 23, + 5, + 49, + 15, + 36, + 28, + 14, + 8, + 21, + 45, + 50, + 26, + 25, + 30, + 55, + 18, + 24, + 52, + 32, + 47, + 24, + 29, + 18, + 83, + 15, + 26 + ], + "weighted_loads": [ + 1.0471110828220844, + 2.622307011857629, + 3.9663722831755877, + 1.9163952134549618, + 0.6600328218191862, + 1.285060703754425, + 1.1521013788878918, + 0.9066016934812069, + 0.9033999107778072, + 1.6876694560050964, + 4.5217812936753035, + 0.5768214724957943, + 1.0837298892438412, + 0.6158810593187809, + 0.6986085828393698, + 0.44714500196278095, + 3.1356744840741158, + 3.9364000223577023, + 2.1485707871615887, + 2.5654790941625834, + 1.4307367466390133, + 2.5734390802681446, + 2.6174263283610344, + 0.8645303882658482, + 2.9370748661458492, + 0.6796883102506399, + 1.3808174170553684, + 2.440672056749463, + 0.6608849782496691, + 3.228588256984949, + 1.0975315291434526, + 0.8888910692185163, + 0.9735535439103842, + 1.0196831282228231, + 0.31219126656651497, + 1.1516314409673214, + 0.29874655790627, + 1.3269860465079546, + 1.669423971325159, + 0.17910656705498695, + 1.7344975173473358, + 0.7241073176264763, + 2.382504751905799, + 1.7137265019118786, + 0.8593494556844234, + 0.40740212239325047, + 1.1718443166464567, + 3.802409401163459, + 2.478162292391062, + 2.0487035382539034, + 1.491752490401268, + 2.010250447317958, + 3.3674519192427397, + 0.5623517576605082, + 1.2219867147505283, + 4.218146031722426, + 3.3297830102965236, + 3.3414018284529448, + 1.7102382201701403, + 2.3950718976557255, + 0.7009305283427238, + 8.219773540273309, + 0.8181758187711239, + 1.9597643092274666 + ], + "unique_experts": 64, + "load_cv": 0.5911160066393697, + "normalized_load_entropy": 0.9626491266345677, + "max_load_share": 0.04819976771196283 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 246, + "ordered_topk_exact_tokens": 146, + "set_exact_tokens": 183, + "mean_set_jaccard": 0.9226674409601239, + "mean_token_weighted_tv": 0.016623265259497897, + "aggregate_load_tv": 0.021002710027100274 + }, + "system_bos": { + "tokens": 246, + "ordered_topk_exact_tokens": 143, + "set_exact_tokens": 174, + "mean_set_jaccard": 0.9099303135888502, + "mean_token_weighted_tv": 0.020265004644927576, + "aggregate_load_tv": 0.03048780487804878 + }, + "system_x": { + "tokens": 246, + "ordered_topk_exact_tokens": 118, + "set_exact_tokens": 153, + "mean_set_jaccard": 0.8783391405342624, + "mean_token_weighted_tv": 0.026844070175647494, + "aggregate_load_tv": 0.03455284552845529 + }, + "system_period": { + "tokens": 246, + "ordered_topk_exact_tokens": 121, + "set_exact_tokens": 153, + "mean_set_jaccard": 0.8790166473093302, + "mean_token_weighted_tv": 0.027203695948909576, + "aggregate_load_tv": 0.03252032520325203 + }, + "bos_at_s0": { + "tokens": 246, + "ordered_topk_exact_tokens": 142, + "set_exact_tokens": 172, + "mean_set_jaccard": 0.9088269454123112, + "mean_token_weighted_tv": 0.02040990866432951, + "aggregate_load_tv": 0.02845528455284553 + }, + "bos_at_s1": { + "tokens": 246, + "ordered_topk_exact_tokens": 124, + "set_exact_tokens": 160, + "mean_set_jaccard": 0.8893728222996514, + "mean_token_weighted_tv": 0.0241284432396959, + "aggregate_load_tv": 0.029810298102981032 + }, + "x_at_s0": { + "tokens": 246, + "ordered_topk_exact_tokens": 122, + "set_exact_tokens": 154, + "mean_set_jaccard": 0.881145954316686, + "mean_token_weighted_tv": 0.026980798576042297, + "aggregate_load_tv": 0.03658536585365854 + }, + "x_at_s1": { + "tokens": 246, + "ordered_topk_exact_tokens": 99, + "set_exact_tokens": 130, + "mean_set_jaccard": 0.8448333509309118, + "mean_token_weighted_tv": 0.03361512971209074, + "aggregate_load_tv": 0.039295392953929545 + }, + "period_at_s0": { + "tokens": 246, + "ordered_topk_exact_tokens": 127, + "set_exact_tokens": 153, + "mean_set_jaccard": 0.878435927216415, + "mean_token_weighted_tv": 0.026717690877782984, + "aggregate_load_tv": 0.03184281842818428 + }, + "period_at_s1": { + "tokens": 246, + "ordered_topk_exact_tokens": 105, + "set_exact_tokens": 135, + "mean_set_jaccard": 0.8499630450849963, + "mean_token_weighted_tv": 0.03244150569094572, + "aggregate_load_tv": 0.03794037940379404 + } + } + }, + "layer_22": { + "layer": 22, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "9b22de4caec5afcc9620712efce321411552f873736c71e966b1a234bb0019ad", + "route_weight_sha256": "d8e35ad1683dac14b7b8b5668c74d37a5321ffc0867a710c08f79b271b5ecce8", + "loads": [ + 22, + 8, + 29, + 36, + 40, + 48, + 26, + 7, + 31, + 8, + 46, + 33, + 55, + 33, + 36, + 17, + 53, + 13, + 18, + 26, + 7, + 6, + 25, + 7, + 33, + 20, + 16, + 5, + 40, + 15, + 10, + 21, + 9, + 33, + 1, + 18, + 38, + 22, + 34, + 21, + 5, + 17, + 15, + 18, + 21, + 27, + 21, + 14, + 8, + 24, + 5, + 12, + 15, + 8, + 15, + 38, + 31, + 74, + 31, + 43, + 7, + 51, + 4, + 6 + ], + "weighted_loads": [ + 2.8909062147140503, + 0.39705779775977135, + 2.3239203048869967, + 6.180871240794659, + 3.3709681276232004, + 6.138680191710591, + 1.9161851163953543, + 1.4866076465696096, + 2.3031669538468122, + 0.4200761690735817, + 3.976037184242159, + 3.1138211749494076, + 3.286172904074192, + 2.2173964101821184, + 1.909433489665389, + 0.762061582878232, + 2.9283260256052017, + 1.0630888752639294, + 0.9562003444880247, + 1.1363088618963957, + 0.34254248440265656, + 0.41748978197574615, + 1.0861213132739067, + 0.255442900583148, + 2.0389161817729473, + 0.9631349425762892, + 0.815348707139492, + 0.15088768489658833, + 2.3776468634605408, + 0.7775751333683729, + 0.48001309856772423, + 1.321295877918601, + 0.39337252639234066, + 1.8186517376452684, + 0.0411110445857048, + 0.9011916108429432, + 2.334911284968257, + 0.9611297324299812, + 1.9630520213395357, + 1.1704299449920654, + 0.22338268719613552, + 1.252628993242979, + 0.6925138998776674, + 1.0781327057629824, + 0.9018905013799667, + 1.0480217076838017, + 1.001594889909029, + 0.9874422699213028, + 0.34503707848489285, + 3.3654034044593573, + 0.18518558843061328, + 0.9305768385529518, + 0.8376843649893999, + 0.35781657695770264, + 0.6285937540233135, + 2.3767807446420193, + 1.9970069732517004, + 6.92950527369976, + 1.3713962249457836, + 3.1592111755162477, + 0.598726823925972, + 2.6573242023587227, + 0.08838802156969905, + 0.2668431010097265 + ], + "unique_experts": 64, + "load_cv": 0.652250097172275, + "normalized_load_entropy": 0.9493774943170286, + "max_load_share": 0.05013550135501355 + }, + "full_input": { + "tokens": 271, + "top_k": 6, + "decisions": 1626, + "ordered_route_sha256": "4c8fa0af051d25f59b761bf16d430180b06c2b6cc28ba4032fc924f36614d928", + "route_weight_sha256": "99fd2b3154b6a94be0256ef11a31fb5a9e926dddd8f6c4245f50291428e95ab5", + "loads": [ + 26, + 9, + 31, + 45, + 40, + 50, + 31, + 7, + 45, + 13, + 46, + 35, + 55, + 33, + 43, + 17, + 53, + 15, + 18, + 26, + 7, + 13, + 27, + 7, + 33, + 22, + 16, + 10, + 40, + 15, + 10, + 21, + 11, + 40, + 2, + 22, + 38, + 24, + 34, + 22, + 9, + 18, + 19, + 18, + 21, + 29, + 22, + 14, + 10, + 26, + 7, + 12, + 16, + 10, + 15, + 52, + 34, + 76, + 31, + 43, + 16, + 59, + 4, + 13 + ], + "weighted_loads": [ + 3.0617587566375732, + 0.44896845519542694, + 2.4045706568285823, + 8.050730902701616, + 3.3709681276232004, + 6.215078206732869, + 2.1705732569098473, + 1.4866076465696096, + 3.520834964700043, + 0.6178241744637489, + 3.976037184242159, + 3.1432425612583756, + 3.286172904074192, + 2.2173964101821184, + 2.618327961768955, + 0.762061582878232, + 2.9283260256052017, + 1.1370524037629366, + 0.9562003444880247, + 1.1363088618963957, + 0.34254248440265656, + 0.9776569306850433, + 1.1484706327319145, + 0.255442900583148, + 2.0389161817729473, + 1.0278538838028908, + 0.815348707139492, + 0.3754465412348509, + 2.3776468634605408, + 0.7775751333683729, + 0.48001309856772423, + 1.321295877918601, + 0.43630501767620444, + 2.0633185114711523, + 0.0992823913693428, + 1.1142285615205765, + 2.334911284968257, + 1.0603748820722103, + 1.9630520213395357, + 1.2246188335120678, + 0.4268742445856333, + 1.2935045696794987, + 0.9727328140288591, + 1.0781327057629824, + 0.9018905013799667, + 1.12012486346066, + 1.0432604290544987, + 0.9874422699213028, + 0.44119970314204693, + 3.550906417891383, + 0.3047598893754184, + 0.9305768385529518, + 0.876257112249732, + 0.46381622552871704, + 0.6285937540233135, + 3.53599161375314, + 2.121517578139901, + 6.994173182174563, + 1.3713962249457836, + 3.1592111755162477, + 1.7680569998919964, + 2.935280170291662, + 0.08838802156969905, + 0.6130871307104826 + ], + "unique_experts": 64, + "load_cv": 0.612411500887617, + "normalized_load_entropy": 0.9560442048347886, + "max_load_share": 0.046740467404674045 + } + }, + "s1_eos": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "7447bddea52739e9584e4711e9552cc90dc95c38a8868da386e93814e4573bfa", + "route_weight_sha256": "437325c67024694083a3a779ba73c9d3b2c0d468e195bc7315e59296c1426dfc", + "loads": [ + 22, + 7, + 28, + 35, + 40, + 49, + 25, + 7, + 31, + 8, + 46, + 32, + 55, + 33, + 36, + 17, + 52, + 12, + 18, + 24, + 9, + 6, + 26, + 6, + 36, + 21, + 16, + 4, + 43, + 16, + 11, + 21, + 8, + 36, + 3, + 18, + 38, + 22, + 34, + 21, + 5, + 18, + 15, + 18, + 19, + 26, + 22, + 14, + 6, + 26, + 4, + 12, + 15, + 9, + 17, + 35, + 31, + 72, + 30, + 43, + 7, + 50, + 3, + 7 + ], + "weighted_loads": [ + 2.81482813321054, + 0.36634695529937744, + 2.3528983425348997, + 6.198188606649637, + 3.3678446281701326, + 6.384398307651281, + 1.9144578333944082, + 1.316710989922285, + 2.2535026762634516, + 0.4398297108709812, + 3.7444920516572893, + 3.1798754879273474, + 3.308628175407648, + 2.249494481831789, + 1.8721805959939957, + 0.7501394767314196, + 2.9032833222299814, + 1.041751753538847, + 0.9595896732062101, + 1.0647389236837626, + 0.39607568830251694, + 0.4040558747947216, + 1.1050000432878733, + 0.22159522771835327, + 2.0777867157012224, + 0.9832803197205067, + 0.8224084340035915, + 0.12387091666460037, + 2.4342235513031483, + 0.7614042051136494, + 0.507738184183836, + 1.3148398231714964, + 0.37096554413437843, + 1.852657901123166, + 0.11447063647210598, + 0.936606215313077, + 2.3325477689504623, + 0.9550268985331059, + 1.9696584269404411, + 1.1389816403388977, + 0.2255922071635723, + 1.3001748323440552, + 0.6890393327921629, + 1.0611037351191044, + 0.7807079199701548, + 0.9679477121680975, + 1.0602306798100471, + 0.9675110932439566, + 0.2900668792426586, + 3.428970407694578, + 0.17716375179588795, + 0.9307474195957184, + 0.8238171320408583, + 0.3496321691200137, + 0.6978312293067575, + 2.3112564980983734, + 2.011706618592143, + 7.036991123110056, + 1.361780323088169, + 3.160933457314968, + 0.593345396220684, + 2.6628682650625706, + 0.08071559108793736, + 0.3252466320991516 + ], + "unique_experts": 64, + "load_cv": 0.6485916413894636, + "normalized_load_entropy": 0.949651404783533, + "max_load_share": 0.04878048780487805 + }, + "full_input": { + "tokens": 287, + "top_k": 6, + "decisions": 1722, + "ordered_route_sha256": "4522047873894ed42b940481e1ed57d3a5d7072152b4f85991db6f346e15fa0f", + "route_weight_sha256": "c0ec2b8f91c7933c68d52c8eec3fc6c9ceb6242581be354a5550b09760ac8e42", + "loads": [ + 26, + 13, + 28, + 46, + 40, + 51, + 31, + 8, + 52, + 17, + 46, + 37, + 58, + 33, + 41, + 21, + 55, + 14, + 19, + 24, + 10, + 19, + 27, + 6, + 36, + 22, + 16, + 8, + 44, + 16, + 12, + 21, + 10, + 45, + 10, + 25, + 40, + 24, + 34, + 23, + 15, + 19, + 20, + 20, + 19, + 27, + 23, + 16, + 8, + 29, + 13, + 15, + 21, + 12, + 17, + 57, + 35, + 73, + 32, + 43, + 22, + 60, + 4, + 14 + ], + "weighted_loads": [ + 2.987089939415455, + 0.8609347250312567, + 2.3528983425348997, + 8.336902437731624, + 3.3678446281701326, + 6.447010174393654, + 2.2349794507026672, + 1.359476212412119, + 4.051535640843213, + 0.9152532070875168, + 3.7444920516572893, + 3.4778966060839593, + 3.4450584575533867, + 2.249494481831789, + 2.5290288664400578, + 0.981628431007266, + 3.0499381069093943, + 1.0914046745747328, + 0.9983264748007059, + 1.0647389236837626, + 0.44468558207154274, + 1.450799535959959, + 1.148162079975009, + 0.22159522771835327, + 2.0777867157012224, + 1.008876847103238, + 0.8224084340035915, + 0.3249294348061085, + 2.51900826767087, + 0.7614042051136494, + 0.5599018186330795, + 1.3148398231714964, + 0.42853483324870467, + 2.174972254782915, + 0.42336070723831654, + 1.246186027303338, + 2.4214208088815212, + 1.0401936806738377, + 1.9696584269404411, + 1.2272818759083748, + 0.8750655427575111, + 1.3254352360963821, + 1.0364268515259027, + 1.1926916614174843, + 0.7807079199701548, + 1.008503606542945, + 1.0961307883262634, + 1.0350111741572618, + 0.38727130368351936, + 3.92329965159297, + 0.6587745118886232, + 1.1398323737084866, + 1.4087027814239264, + 0.4935884987935424, + 0.6978312293067575, + 4.023015258833766, + 2.2301405426114798, + 7.068757597357035, + 1.4086877135559916, + 3.160933457314968, + 2.633747920393944, + 3.079354675486684, + 0.1100862454622984, + 0.6919504292309284 + ], + "unique_experts": 64, + "load_cv": 0.570302612018377, + "normalized_load_entropy": 0.9624302222305279, + "max_load_share": 0.042392566782810684 + } + }, + "s0_bos": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "4908ac7de4843e213dad90284c49d581b356e4b8313a13695e09da52a915d2a2", + "route_weight_sha256": "825eac9dbcfd40dd35eacebdd70e860ae4e04f3b7d789ccd1425250c8abc54d7", + "loads": [ + 23, + 8, + 27, + 38, + 40, + 47, + 24, + 9, + 31, + 8, + 52, + 31, + 56, + 35, + 31, + 18, + 52, + 15, + 16, + 22, + 6, + 6, + 28, + 6, + 32, + 19, + 16, + 6, + 41, + 14, + 11, + 20, + 7, + 36, + 2, + 15, + 39, + 19, + 32, + 22, + 5, + 17, + 14, + 16, + 19, + 28, + 24, + 15, + 7, + 26, + 5, + 11, + 15, + 10, + 19, + 38, + 32, + 77, + 29, + 43, + 7, + 51, + 3, + 5 + ], + "weighted_loads": [ + 2.951512925326824, + 0.37234991043806076, + 2.2022036695852876, + 6.259451307356358, + 3.373781381174922, + 5.991690307855606, + 1.9100862853229046, + 1.8080833330750465, + 2.1165583357214928, + 0.42094311490654945, + 4.360798830166459, + 2.9363307747989893, + 3.3762927632778883, + 2.3000846058130264, + 1.7149716392159462, + 0.8049878645688295, + 2.9315107241272926, + 1.152618246152997, + 0.8978738635778427, + 0.9902611561119556, + 0.2862015999853611, + 0.4153845049440861, + 1.1564245391637087, + 0.23480785265564919, + 1.9686006382107735, + 0.9517277609556913, + 0.8148671481758356, + 0.18351666256785393, + 2.449302766472101, + 0.7299746535718441, + 0.5114591354504228, + 1.300250317901373, + 0.32562726363539696, + 1.994147077202797, + 0.08979349955916405, + 0.7954744715243578, + 2.427556425333023, + 0.8712630644440651, + 1.9077958464622498, + 1.1436702217906713, + 0.22461058385670185, + 1.1819831430912018, + 0.6768956631422043, + 1.0212595649063587, + 0.8528771474957466, + 1.0544315660372376, + 1.0758566446602345, + 1.035290788859129, + 0.34865464828908443, + 3.5290200281888247, + 0.1778661087155342, + 0.9000524580478668, + 0.8230257630348206, + 0.40099519677460194, + 0.7321211416274309, + 2.4720163084566593, + 2.0472292974591255, + 7.299971649423242, + 1.2837120927870274, + 3.1868254393339157, + 0.6049526482820511, + 2.7487795129418373, + 0.09364327788352966, + 0.2576758340001106 + ], + "unique_experts": 64, + "load_cv": 0.6675198893752126, + "normalized_load_entropy": 0.9478402774806186, + "max_load_share": 0.0521680216802168 + }, + "full_input": { + "tokens": 271, + "top_k": 6, + "decisions": 1626, + "ordered_route_sha256": "1a5999a91f40bd44d15aa5c088581dc9c97ec6758da2e92e264c829cbb5bc85f", + "route_weight_sha256": "34da53f671a316d602ae59907ce81bc0bf99329aa392e9fa701bdc867d5599b3", + "loads": [ + 27, + 9, + 29, + 46, + 40, + 48, + 28, + 10, + 43, + 13, + 53, + 32, + 56, + 35, + 35, + 19, + 52, + 16, + 16, + 22, + 6, + 13, + 29, + 6, + 33, + 21, + 16, + 12, + 41, + 15, + 11, + 20, + 8, + 42, + 3, + 21, + 39, + 22, + 32, + 23, + 9, + 18, + 19, + 16, + 19, + 30, + 25, + 15, + 10, + 28, + 8, + 11, + 16, + 12, + 19, + 51, + 35, + 80, + 29, + 43, + 17, + 59, + 3, + 12 + ], + "weighted_loads": [ + 3.122365467250347, + 0.41845716536045074, + 2.282854021526873, + 7.23798019066453, + 3.373781381174922, + 6.004302814602852, + 2.157748181372881, + 2.7216838970780373, + 3.250108010135591, + 0.6186911202967167, + 4.382050605490804, + 2.9488015389069915, + 3.3762927632778883, + 2.3000846058130264, + 2.2812266871333122, + 0.8474305924028158, + 2.9315107241272926, + 1.178443606942892, + 0.8978738635778427, + 0.9902611561119556, + 0.2862015999853611, + 0.97472869977355, + 1.1860635560005903, + 0.23480785265564919, + 1.973116412293166, + 1.016446702182293, + 0.8148671481758356, + 0.4415286295115948, + 2.449302766472101, + 0.7757069580256939, + 0.5114591354504228, + 1.300250317901373, + 0.36205196008086205, + 2.2118792850524187, + 0.14796484634280205, + 1.0746586304157972, + 2.427556425333023, + 1.0267187021672726, + 1.9077958464622498, + 1.1902199778705835, + 0.4254209604114294, + 1.2582175508141518, + 0.8906909255310893, + 1.0212595649063587, + 0.8528771474957466, + 1.1243877401575446, + 1.1175221838057041, + 1.035290788859129, + 0.5492677185684443, + 3.658276906237006, + 0.3232714720070362, + 0.9000524580478668, + 0.8592639937996864, + 0.5022797975689173, + 0.7321211416274309, + 3.6309185223653913, + 2.1717399023473263, + 7.382830864749849, + 1.2837120927870274, + 3.1868254393339157, + 1.799535159021616, + 3.026735480874777, + 0.09364327788352966, + 0.5432282239198685 + ], + "unique_experts": 64, + "load_cv": 0.6188208873717168, + "normalized_load_entropy": 0.9558903942988074, + "max_load_share": 0.04920049200492005 + } + }, + "s1_bos": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "3b0499f18491421924ca0f9ac47078b94fe2b28f369b4dac103a25e6e249f4d0", + "route_weight_sha256": "3dba2b0d8f071cab2a019e94c3af904af3e3d03a740fa9646039bf54d27438eb", + "loads": [ + 24, + 7, + 28, + 36, + 40, + 47, + 25, + 7, + 35, + 7, + 49, + 32, + 56, + 37, + 34, + 17, + 53, + 14, + 17, + 23, + 8, + 6, + 24, + 5, + 33, + 18, + 16, + 5, + 40, + 12, + 8, + 18, + 9, + 38, + 4, + 17, + 39, + 23, + 35, + 19, + 5, + 17, + 14, + 18, + 22, + 27, + 22, + 14, + 7, + 25, + 6, + 14, + 16, + 9, + 16, + 35, + 30, + 74, + 34, + 43, + 7, + 48, + 3, + 5 + ], + "weighted_loads": [ + 2.875329215079546, + 0.36020676977932453, + 2.326959639787674, + 6.107267101295292, + 3.3669682666659355, + 6.286583485081792, + 2.027956618927419, + 1.8116537611931562, + 2.3248247001320124, + 0.40333339013159275, + 3.9818287137895823, + 3.1643240079283714, + 3.354532841593027, + 2.3996741082519293, + 1.84239511936903, + 0.731861425563693, + 2.9414130803197622, + 1.1354597974568605, + 0.9444812852889299, + 1.0250455103814602, + 0.3815523833036423, + 0.39523665234446526, + 1.004257921129465, + 0.19668853282928467, + 1.9581328947097063, + 0.9071705676615238, + 0.8068190924823284, + 0.14802509918808937, + 2.328227052465081, + 0.6166169829666615, + 0.3727698251605034, + 1.2252272330224514, + 0.3982439786195755, + 2.0890959575772285, + 0.15900285728275776, + 0.8305847961455584, + 2.3902098406106234, + 0.9598490381613374, + 2.0046478509902954, + 1.0427290350198746, + 0.2282091062515974, + 1.144386824220419, + 0.6697735749185085, + 1.0673942305147648, + 0.9167744163423777, + 0.99259839579463, + 1.023890420794487, + 0.9896873086690903, + 0.3203272596001625, + 3.4829653818160295, + 0.2521141478791833, + 1.003778686746955, + 0.8438814263790846, + 0.36529187485575676, + 0.6705608926713467, + 2.304124178364873, + 1.98747662268579, + 7.14069383777678, + 1.516499176621437, + 3.214229077100754, + 0.6184354200959206, + 2.5055217780172825, + 0.09343165345489979, + 0.25878434628248215 + ], + "unique_experts": 64, + "load_cv": 0.6600849452147252, + "normalized_load_entropy": 0.948413657044764, + "max_load_share": 0.05013550135501355 + }, + "full_input": { + "tokens": 287, + "top_k": 6, + "decisions": 1722, + "ordered_route_sha256": "8597652cce304426634b1528b3e3e0ac660b0990d3294bec8847f46fbb21ae9d", + "route_weight_sha256": "cedb5bc3ea9411188323ddcb6fe7fac1102a57da136601c5a0942dcc2385e3fd", + "loads": [ + 28, + 12, + 28, + 46, + 40, + 48, + 30, + 8, + 55, + 16, + 49, + 38, + 59, + 37, + 39, + 22, + 56, + 16, + 18, + 23, + 10, + 18, + 25, + 5, + 33, + 19, + 16, + 10, + 41, + 12, + 9, + 18, + 10, + 47, + 11, + 26, + 41, + 26, + 35, + 21, + 15, + 18, + 19, + 20, + 22, + 28, + 23, + 16, + 11, + 28, + 15, + 17, + 21, + 13, + 16, + 55, + 34, + 75, + 35, + 43, + 23, + 58, + 4, + 12 + ], + "weighted_loads": [ + 3.047591021284461, + 0.8170241937041283, + 2.326959639787674, + 7.3515957137569785, + 3.3669682666659355, + 6.299195991829038, + 2.3392023546621203, + 1.85441898368299, + 4.064996329136193, + 0.8787568863481283, + 3.9818287137895823, + 3.5282489331439137, + 3.4909631237387657, + 2.3996741082519293, + 2.5123108439147472, + 1.0067931842058897, + 3.088067864999175, + 1.1851127184927464, + 0.9832180868834257, + 1.0250455103814602, + 0.4623870588839054, + 1.4087927155196667, + 1.0474199578166008, + 0.19668853282928467, + 1.9581328947097063, + 0.9327670950442553, + 0.8068190924823284, + 0.3780437223613262, + 2.4130117688328028, + 0.6166169829666615, + 0.4081321135163307, + 1.2252272330224514, + 0.4496830329298973, + 2.4114103112369776, + 0.4678929280489683, + 1.2383705247193575, + 2.4790828805416822, + 1.0910019176080823, + 2.0046478509902954, + 1.1294981762766838, + 0.8750191163271666, + 1.169647227972746, + 1.0186298228800297, + 1.1989821568131447, + 0.9167744163423777, + 1.0309680625796318, + 1.0597905293107033, + 1.0571873895823956, + 0.5863100998103619, + 4.012711742892861, + 0.7175488537177444, + 1.212863640859723, + 1.3929987754672766, + 0.5577050261199474, + 0.6705608926713467, + 3.9838961409404874, + 2.2059105467051268, + 7.184673303738236, + 1.5583425275981426, + 3.214229077100754, + 2.7488844096660614, + 2.9220081884413958, + 0.12280230782926083, + 0.6589829362928867 + ], + "unique_experts": 64, + "load_cv": 0.5767003735525128, + "normalized_load_entropy": 0.9617329101767552, + "max_load_share": 0.04355400696864112 + } + }, + "s0_x": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "998afd590c417aa513f0ecdd13067bffc9c9e38bf6abc471a577c1332fe7d330", + "route_weight_sha256": "ed51193bddf63bd7035135bfe601021ba69e8981ff07d3cccede16857333407c", + "loads": [ + 23, + 6, + 27, + 39, + 41, + 46, + 26, + 6, + 31, + 9, + 51, + 31, + 55, + 36, + 30, + 18, + 51, + 13, + 16, + 26, + 7, + 6, + 27, + 8, + 30, + 22, + 16, + 3, + 41, + 14, + 12, + 19, + 6, + 36, + 2, + 18, + 36, + 20, + 33, + 24, + 5, + 17, + 14, + 16, + 22, + 28, + 23, + 15, + 7, + 27, + 3, + 11, + 15, + 10, + 17, + 39, + 31, + 76, + 29, + 43, + 7, + 54, + 2, + 4 + ], + "weighted_loads": [ + 2.955099979415536, + 0.3047092705965042, + 2.2213397193700075, + 6.286917554214597, + 3.3887908160686493, + 5.863936197012663, + 1.9122027102857828, + 1.1421336568892002, + 2.236729834228754, + 0.46002184972167015, + 4.401907600462437, + 3.0859222412109375, + 3.321486972272396, + 2.3302052170038223, + 1.6469327919185162, + 0.784898417070508, + 2.850073866546154, + 1.107632016763091, + 0.9011610634624958, + 1.0800453051924706, + 0.3232907559722662, + 0.38772838562726974, + 1.1247157528996468, + 0.3043900616466999, + 1.8526794891804457, + 0.9874112047255039, + 0.8241609632968903, + 0.08446662873029709, + 2.434952311217785, + 0.7265654541552067, + 0.575484816916287, + 1.2612762302160263, + 0.28522108122706413, + 2.035910315811634, + 0.07841288670897484, + 0.9251999072730541, + 2.272870996966958, + 0.8957487139850855, + 1.9091372545808554, + 1.2365325521677732, + 0.23023668304085732, + 1.1935865134000778, + 0.674795463681221, + 1.0058053098618984, + 1.001313580200076, + 1.071863274089992, + 1.0325651168823242, + 1.007721520960331, + 0.3637000545859337, + 3.5813487777486444, + 0.14861340634524822, + 0.8961570039391518, + 0.8313219491392374, + 0.4303845064714551, + 0.7184631675481796, + 2.4929560851305723, + 1.9809686932712793, + 7.142196094617248, + 1.273736453615129, + 3.12972117587924, + 0.5648429542779922, + 2.906356558203697, + 0.05699632130563259, + 0.2097621075809002 + ], + "unique_experts": 64, + "load_cv": 0.6705934543124096, + "normalized_load_entropy": 0.9459050878758855, + "max_load_share": 0.051490514905149054 + }, + "full_input": { + "tokens": 271, + "top_k": 6, + "decisions": 1626, + "ordered_route_sha256": "53a5678cf7bf95d43f5086c2e031bdb2bb1800de3a50f27dcfb723167ae12bd2", + "route_weight_sha256": "937a86967c231f3c4ef27a8cf93e4b765b1f28072c5eb34360b2712767f63d08", + "loads": [ + 27, + 7, + 29, + 48, + 41, + 47, + 31, + 6, + 44, + 15, + 51, + 32, + 55, + 36, + 35, + 18, + 51, + 15, + 16, + 26, + 7, + 15, + 28, + 8, + 30, + 24, + 16, + 7, + 41, + 14, + 13, + 19, + 7, + 44, + 3, + 22, + 36, + 21, + 33, + 25, + 9, + 18, + 19, + 16, + 22, + 30, + 24, + 15, + 8, + 29, + 7, + 11, + 16, + 12, + 17, + 54, + 34, + 78, + 29, + 43, + 16, + 63, + 2, + 11 + ], + "weighted_loads": [ + 3.125952521339059, + 0.34944503754377365, + 2.301990071311593, + 7.3510266449302435, + 3.3887908160686493, + 5.876548703759909, + 2.224039861932397, + 1.1421336568892002, + 3.424252304248512, + 0.689347367733717, + 4.401907600462437, + 3.0983930053189397, + 3.321486972272396, + 2.3302052170038223, + 2.2853452675044537, + 0.784898417070508, + 2.850073866546154, + 1.1666305884718895, + 0.9011610634624958, + 1.0800453051924706, + 0.3232907559722662, + 1.069766703993082, + 1.1543547697365284, + 0.3043900616466999, + 1.8526794891804457, + 1.0521301459521055, + 0.8241609632968903, + 0.2591025047004223, + 2.434952311217785, + 0.7265654541552067, + 0.6205888288095593, + 1.2612762302160263, + 0.3216457776725292, + 2.3393702004104853, + 0.13658423349261284, + 1.0838909186422825, + 2.272870996966958, + 0.935236843302846, + 1.9091372545808554, + 1.2765091378241777, + 0.44180044531822205, + 1.2708393260836601, + 0.98604916036129, + 1.0058053098618984, + 1.001313580200076, + 1.1409903625026345, + 1.0742306560277939, + 1.007721520960331, + 0.41639369353652, + 3.834653795696795, + 0.3798952829092741, + 0.8961570039391518, + 0.8663255218416452, + 0.5369200939312577, + 0.7184631675481796, + 3.852188399992883, + 2.10547929815948, + 7.203499346971512, + 1.273736453615129, + 3.12972117587924, + 1.7687521912157536, + 3.239654891192913, + 0.05699632130563259, + 0.47088199853897095 + ], + "unique_experts": 64, + "load_cv": 0.6285242499022213, + "normalized_load_entropy": 0.9536341796056543, + "max_load_share": 0.04797047970479705 + } + }, + "s1_x": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "a43e34a65389993c1085d745199ae2c54975f565f7acaa327e4fd27357694c01", + "route_weight_sha256": "f4217ff0644587763a9eb23371d2d5131b993dcbdccc14bca0623286c4715a16", + "loads": [ + 23, + 7, + 26, + 36, + 41, + 49, + 24, + 9, + 37, + 5, + 49, + 33, + 54, + 34, + 35, + 16, + 53, + 14, + 18, + 22, + 7, + 6, + 24, + 5, + 31, + 19, + 15, + 7, + 41, + 13, + 9, + 17, + 7, + 33, + 3, + 15, + 39, + 19, + 35, + 20, + 6, + 17, + 14, + 20, + 19, + 25, + 24, + 16, + 8, + 27, + 4, + 15, + 14, + 10, + 16, + 39, + 31, + 74, + 33, + 44, + 7, + 54, + 3, + 6 + ], + "weighted_loads": [ + 2.8653642535209656, + 0.3611596431583166, + 2.242814252153039, + 6.268356759101152, + 3.3017098251730204, + 5.931944152340293, + 1.8108719773590565, + 1.0310818199068308, + 2.2310961820185184, + 0.3244010955095291, + 4.161386268213391, + 3.3417186308652163, + 3.2957653924822807, + 2.300910321995616, + 1.8362021837383509, + 0.7127899564802647, + 2.9777204506099224, + 1.111243911087513, + 0.9683085903525352, + 0.9642584789544344, + 0.33635641634464264, + 0.36965812370181084, + 1.0167927034199238, + 0.20409079641103745, + 1.9286545552313328, + 0.9260020535439253, + 0.7578401491045952, + 0.22535737231373787, + 2.3931751400232315, + 0.6294949427247047, + 0.47139538172632456, + 1.1912531778216362, + 0.32630681805312634, + 1.912758193910122, + 0.10974526219069958, + 0.790728023275733, + 2.4093437157571316, + 0.8234160412102938, + 2.002276921644807, + 1.0941838566213846, + 0.2864139545708895, + 1.1248500794172287, + 0.646592378616333, + 1.111206654459238, + 0.838589109480381, + 0.9659771881997585, + 1.0956846997141838, + 1.0409351661801338, + 0.4001030530780554, + 3.600349662825465, + 0.18143361993134022, + 1.0369393397122622, + 0.7835013754665852, + 0.4550446346402168, + 0.689098671078682, + 2.492156285792589, + 1.953535532578826, + 6.843352103605866, + 1.4544437173753977, + 3.204301331192255, + 0.5529224872589111, + 2.879850924015045, + 0.0893076453357935, + 0.2921656221151352 + ], + "unique_experts": 64, + "load_cv": 0.6681797006326968, + "normalized_load_entropy": 0.9474762352469372, + "max_load_share": 0.05013550135501355 + }, + "full_input": { + "tokens": 287, + "top_k": 6, + "decisions": 1722, + "ordered_route_sha256": "0e3843d06885ecd10ff0c425d6faea9abc769c3746351b52f3c4a485e5f5a6eb", + "route_weight_sha256": "6ad92acceb7d971bf23340a0a8c6eafb908b22fa391bbba8f11c8f814d30590f", + "loads": [ + 27, + 12, + 26, + 47, + 41, + 50, + 30, + 10, + 59, + 15, + 49, + 38, + 57, + 34, + 40, + 20, + 56, + 16, + 19, + 22, + 8, + 20, + 25, + 5, + 31, + 20, + 15, + 10, + 42, + 13, + 9, + 17, + 8, + 42, + 10, + 21, + 41, + 20, + 35, + 22, + 18, + 19, + 19, + 22, + 19, + 25, + 25, + 18, + 10, + 30, + 14, + 18, + 19, + 14, + 16, + 63, + 35, + 74, + 34, + 44, + 22, + 66, + 4, + 12 + ], + "weighted_loads": [ + 3.0376260597258806, + 0.8179770670831203, + 2.242814252153039, + 7.564747640863061, + 3.3017098251730204, + 5.944556659087539, + 2.157663371413946, + 1.0738470423966646, + 4.0445969784632325, + 0.8458367213606834, + 4.161386268213391, + 3.6578530436381698, + 3.4321956746280193, + 2.300910321995616, + 2.501947494223714, + 0.9442789107561111, + 3.1243752352893353, + 1.1608968321233988, + 1.007045391947031, + 0.9642584789544344, + 0.38496631011366844, + 1.5170798301696777, + 1.0599547401070595, + 0.20409079641103745, + 1.9286545552313328, + 0.9515985809266567, + 0.7578401491045952, + 0.35158177092671394, + 2.477959856390953, + 0.6294949427247047, + 0.47139538172632456, + 1.1912531778216362, + 0.37774587236344814, + 2.235072547569871, + 0.41863533295691013, + 1.0613812562078238, + 2.4982167556881905, + 0.8690897952765226, + 2.002276921644807, + 1.1837472524493933, + 1.0079050306230783, + 1.1934951692819595, + 1.0397902578115463, + 1.242794580757618, + 0.838589109480381, + 0.9659771881997585, + 1.1315848082304, + 1.108435247093439, + 0.49730747751891613, + 4.142534090206027, + 0.7158113177865744, + 1.2460242938250303, + 1.3326187245547771, + 0.6234620064496994, + 0.689098671078682, + 4.514123137108982, + 2.1719694565981627, + 6.843352103605866, + 1.4962870683521032, + 3.204301331192255, + 2.6070856004953384, + 3.458992598578334, + 0.11867829971015453, + 0.5516312941908836 + ], + "unique_experts": 64, + "load_cv": 0.5989507737963489, + "normalized_load_entropy": 0.9594330285142756, + "max_load_share": 0.0429732868757259 + } + }, + "s0_period": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "5f6435237048d818d00e2692f7b5235da38554af3dc1015483faae8d2c718cd1", + "route_weight_sha256": "1ee771681701adfe9f9bc940d79f64f1c47624429ec52026b3c8c3e17aefcda2", + "loads": [ + 23, + 7, + 26, + 38, + 41, + 46, + 24, + 5, + 34, + 8, + 54, + 31, + 53, + 33, + 32, + 16, + 53, + 14, + 16, + 24, + 8, + 6, + 31, + 6, + 31, + 24, + 16, + 4, + 42, + 15, + 10, + 22, + 7, + 34, + 2, + 16, + 36, + 22, + 34, + 22, + 5, + 17, + 15, + 16, + 20, + 26, + 24, + 17, + 7, + 27, + 5, + 11, + 15, + 10, + 17, + 36, + 32, + 76, + 26, + 43, + 7, + 54, + 1, + 3 + ], + "weighted_loads": [ + 2.887148506939411, + 0.3433149065822363, + 2.2297595348209143, + 6.228975026868284, + 3.3060371689498425, + 5.895715991035104, + 1.8285853620618582, + 0.9136684946715832, + 2.3467135932296515, + 0.43523821607232094, + 4.4632304180413485, + 3.0416724663227797, + 3.232183560729027, + 2.226101802662015, + 1.7335171569138765, + 0.7378075569868088, + 2.9136904552578926, + 1.1149524515494704, + 0.9043220467865467, + 1.0866869445890188, + 0.358213035389781, + 0.40908000618219376, + 1.2572199702262878, + 0.23764026910066605, + 1.9227597676217556, + 1.0876654013991356, + 0.8201370853930712, + 0.1158068273216486, + 2.4748201593756676, + 0.7700288034975529, + 0.5033130515366793, + 1.3457032479345798, + 0.31854598224163055, + 1.9480690453201532, + 0.07775994762778282, + 0.8693110048770905, + 2.3123121112585068, + 0.9587905257940292, + 1.9594983756542206, + 1.168644918128848, + 0.2304870653897524, + 1.2010989598929882, + 0.6953833783045411, + 1.0137667655944824, + 0.9604532644152641, + 1.0166209768503904, + 1.1117019057273865, + 1.0932964254170656, + 0.3431057073175907, + 3.583522880449891, + 0.23377172648906708, + 0.8997775018215179, + 0.8403606191277504, + 0.42772258818149567, + 0.6965189659968019, + 2.3822594601660967, + 2.0093696769326925, + 7.113363083451986, + 1.2352938372641802, + 3.1444334536790848, + 0.5975472629070282, + 2.810207773000002, + 0.032525110989809036, + 0.18236419558525085 + ], + "unique_experts": 64, + "load_cv": 0.6726492531736805, + "normalized_load_entropy": 0.9456236160199804, + "max_load_share": 0.051490514905149054 + }, + "full_input": { + "tokens": 271, + "top_k": 6, + "decisions": 1626, + "ordered_route_sha256": "7936ddc4c8195840e5409c5e58dab69e73ce3581a9d35e0ad67af54ae929d1cf", + "route_weight_sha256": "00f1a79ee25603592f7da3e7fe75f894ea2a7b714664907bc438f9dbe803552d", + "loads": [ + 27, + 8, + 28, + 46, + 41, + 47, + 28, + 5, + 47, + 13, + 54, + 32, + 53, + 33, + 37, + 16, + 53, + 16, + 16, + 24, + 8, + 15, + 32, + 6, + 31, + 26, + 16, + 7, + 42, + 16, + 10, + 22, + 8, + 40, + 3, + 20, + 36, + 24, + 34, + 24, + 10, + 19, + 20, + 16, + 20, + 28, + 25, + 17, + 9, + 28, + 10, + 11, + 16, + 13, + 17, + 51, + 35, + 78, + 26, + 43, + 17, + 62, + 1, + 10 + ], + "weighted_loads": [ + 3.058001048862934, + 0.4392255749553442, + 2.3104098867625, + 7.207503910176456, + 3.3060371689498425, + 5.90832849778235, + 2.070182142779231, + 0.9136684946715832, + 3.523558055050671, + 0.6329862214624882, + 4.4632304180413485, + 3.054143230430782, + 3.232183560729027, + 2.226101802662015, + 2.358617329970002, + 0.7378075569868088, + 2.9136904552578926, + 1.1970547894015908, + 0.9043220467865467, + 1.0866869445890188, + 0.358213035389781, + 1.0991216264665127, + 1.2868589870631695, + 0.23764026910066605, + 1.9227597676217556, + 1.1523843426257372, + 0.8201370853930712, + 0.25350783951580524, + 2.4748201593756676, + 0.8220739960670471, + 0.5033130515366793, + 1.3457032479345798, + 0.35497067868709564, + 2.165801253169775, + 0.13593129441142082, + 1.0542331263422966, + 2.3123121112585068, + 1.0613245740532875, + 1.9594983756542206, + 1.2461482267826796, + 0.4992504622787237, + 1.3275195509195328, + 0.9615702861919999, + 1.0137667655944824, + 0.9604532644152641, + 1.0847290121018887, + 1.1533674448728561, + 1.0932964254170656, + 0.43598831444978714, + 3.7087109331041574, + 0.5497572533786297, + 0.8997775018215179, + 0.8821323402225971, + 0.5763837918639183, + 0.6965189659968019, + 3.6920220060274005, + 2.1338802818208933, + 7.171371655538678, + 1.2352938372641802, + 3.1444334536790848, + 1.8568048737943172, + 3.0881637409329414, + 0.032525110989809036, + 0.4639938659965992 + ], + "unique_experts": 64, + "load_cv": 0.6238078654410716, + "normalized_load_entropy": 0.9541080039160991, + "max_load_share": 0.04797047970479705 + } + }, + "s1_period": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "36d362a34ca5dd57fbeb52b36d530ed386524c66551114deea3bd1041a43a580", + "route_weight_sha256": "36d6682877a685131f8724ef9e660097222256b72988844e3ba31202559726f9", + "loads": [ + 23, + 7, + 26, + 37, + 40, + 49, + 24, + 8, + 35, + 7, + 50, + 32, + 55, + 35, + 35, + 18, + 53, + 14, + 18, + 23, + 6, + 6, + 27, + 5, + 31, + 21, + 15, + 7, + 41, + 11, + 11, + 19, + 7, + 32, + 4, + 17, + 39, + 19, + 35, + 19, + 5, + 17, + 15, + 19, + 18, + 22, + 26, + 15, + 7, + 27, + 4, + 14, + 14, + 11, + 17, + 36, + 31, + 74, + 34, + 43, + 7, + 51, + 4, + 4 + ], + "weighted_loads": [ + 2.848767787218094, + 0.350744491443038, + 2.2519205659627914, + 6.179928986355662, + 3.2698002085089684, + 5.9992323983460665, + 1.8426195438951254, + 0.9542801417410374, + 1.9761689491569996, + 0.405831815674901, + 4.174769526347518, + 3.390369229018688, + 3.3114000745117664, + 2.341382307931781, + 1.8738580364733934, + 0.8034477233886719, + 2.9682130124419928, + 1.1131218001246452, + 0.9772897344082594, + 0.9979551993310452, + 0.3042190186679363, + 0.37069233879446983, + 1.1146672517061234, + 0.19580575451254845, + 1.946432203054428, + 0.9958909843116999, + 0.7604171112179756, + 0.22271136939525604, + 2.382379900664091, + 0.5575299300253391, + 0.520987631753087, + 1.2644518688321114, + 0.3293029274791479, + 1.8513546288013458, + 0.14463919959962368, + 0.858007425442338, + 2.4254014045000076, + 0.8205213602632284, + 2.0043262653052807, + 1.084051825106144, + 0.24328112229704857, + 1.1366788670420647, + 0.6808991264551878, + 1.0882985312491655, + 0.8102555721998215, + 0.9165404383093119, + 1.1936647314578295, + 1.0022574365139008, + 0.3590040635317564, + 3.583004331216216, + 0.18873989209532738, + 1.010040668770671, + 0.7861050181090832, + 0.493038484826684, + 0.7147606834769249, + 2.4001343213021755, + 1.975555770099163, + 6.7306681871414185, + 1.5385603364557028, + 3.172753259539604, + 0.547033965587616, + 2.6600827984511852, + 0.12042561359703541, + 0.2104636561125517 + ], + "unique_experts": 64, + "load_cv": 0.6623951551777498, + "normalized_load_entropy": 0.9482423571493579, + "max_load_share": 0.05013550135501355 + }, + "full_input": { + "tokens": 287, + "top_k": 6, + "decisions": 1722, + "ordered_route_sha256": "ca41d043c19fc1ebbb704c279f69c6c077b58f486a3554a0cb9975345c59e45b", + "route_weight_sha256": "c35909d71a507cd2b086e09db304877baf31ef2c506613de09cd5d65705e6d73", + "loads": [ + 27, + 13, + 26, + 47, + 40, + 50, + 29, + 9, + 56, + 16, + 50, + 36, + 58, + 35, + 39, + 22, + 56, + 16, + 19, + 23, + 7, + 21, + 28, + 5, + 31, + 22, + 15, + 10, + 42, + 11, + 11, + 19, + 8, + 42, + 11, + 24, + 41, + 20, + 35, + 22, + 18, + 19, + 20, + 21, + 18, + 22, + 27, + 17, + 9, + 30, + 15, + 17, + 19, + 15, + 17, + 59, + 35, + 74, + 35, + 43, + 23, + 62, + 5, + 10 + ], + "weighted_loads": [ + 3.021029593423009, + 0.8567320518195629, + 2.2519205659627914, + 7.4242575988173485, + 3.2698002085089684, + 6.011844905093312, + 2.1414992306381464, + 0.9970453642308712, + 3.7452298225834966, + 0.8812553118914366, + 4.174769526347518, + 3.6709923604503274, + 3.447830356657505, + 2.341382307931781, + 2.5227452125400305, + 1.0349366776645184, + 3.1148677971214056, + 1.162774721160531, + 1.0160265360027552, + 0.9979551993310452, + 0.3528289124369621, + 1.5443963333964348, + 1.157829288393259, + 0.19580575451254845, + 1.946432203054428, + 1.0214875116944313, + 0.7604171112179756, + 0.34603870660066605, + 2.4671646170318127, + 0.5575299300253391, + 0.520987631753087, + 1.2644518688321114, + 0.3807419817894697, + 2.2100406605750322, + 0.45352927036583424, + 1.149907248094678, + 2.5142744444310665, + 0.8568133097141981, + 2.0043262653052807, + 1.2418917194008827, + 1.022933017462492, + 1.204025138169527, + 1.0599292051047087, + 1.2198864575475454, + 0.8102555721998215, + 0.9165404383093119, + 1.2295648399740458, + 1.069757517427206, + 0.45620848797261715, + 4.078894594684243, + 0.7950192019343376, + 1.219125622883439, + 1.3352223671972752, + 0.6821899171918631, + 0.7147606834769249, + 4.3481042524799705, + 2.1939896941184998, + 6.7306681871414185, + 1.5804036874324083, + 3.172753259539604, + 2.6253244131803513, + 3.1214633900672197, + 0.14979626797139645, + 0.4743891004472971 + ], + "unique_experts": 64, + "load_cv": 0.5832870097444403, + "normalized_load_entropy": 0.9610637622008439, + "max_load_share": 0.0429732868757259 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 246, + "ordered_topk_exact_tokens": 157, + "set_exact_tokens": 194, + "mean_set_jaccard": 0.9321525358110724, + "mean_token_weighted_tv": 0.01680711976619725, + "aggregate_load_tv": 0.017615176151761513 + }, + "system_bos": { + "tokens": 246, + "ordered_topk_exact_tokens": 130, + "set_exact_tokens": 163, + "mean_set_jaccard": 0.8940185830429732, + "mean_token_weighted_tv": 0.02389000775481809, + "aggregate_load_tv": 0.03319783197831978 + }, + "system_x": { + "tokens": 246, + "ordered_topk_exact_tokens": 115, + "set_exact_tokens": 153, + "mean_set_jaccard": 0.8708108964206525, + "mean_token_weighted_tv": 0.0321479742453108, + "aggregate_load_tv": 0.039295392953929545 + }, + "system_period": { + "tokens": 246, + "ordered_topk_exact_tokens": 127, + "set_exact_tokens": 157, + "mean_set_jaccard": 0.8838383838383836, + "mean_token_weighted_tv": 0.030392674009913835, + "aggregate_load_tv": 0.03455284552845528 + }, + "bos_at_s0": { + "tokens": 246, + "ordered_topk_exact_tokens": 139, + "set_exact_tokens": 173, + "mean_set_jaccard": 0.9075687185443282, + "mean_token_weighted_tv": 0.021796593311000464, + "aggregate_load_tv": 0.031165311653116527 + }, + "bos_at_s1": { + "tokens": 246, + "ordered_topk_exact_tokens": 126, + "set_exact_tokens": 161, + "mean_set_jaccard": 0.8896842994403971, + "mean_token_weighted_tv": 0.02598694404322139, + "aggregate_load_tv": 0.028455284552845524 + }, + "x_at_s0": { + "tokens": 246, + "ordered_topk_exact_tokens": 118, + "set_exact_tokens": 155, + "mean_set_jaccard": 0.8787262872628725, + "mean_token_weighted_tv": 0.029213185678614775, + "aggregate_load_tv": 0.03252032520325203 + }, + "x_at_s1": { + "tokens": 246, + "ordered_topk_exact_tokens": 110, + "set_exact_tokens": 143, + "mean_set_jaccard": 0.8614401858304297, + "mean_token_weighted_tv": 0.03599672450691583, + "aggregate_load_tv": 0.03523035230352304 + }, + "period_at_s0": { + "tokens": 246, + "ordered_topk_exact_tokens": 119, + "set_exact_tokens": 150, + "mean_set_jaccard": 0.8760162601626016, + "mean_token_weighted_tv": 0.028559095832912964, + "aggregate_load_tv": 0.03523035230352303 + }, + "period_at_s1": { + "tokens": 246, + "ordered_topk_exact_tokens": 111, + "set_exact_tokens": 145, + "mean_set_jaccard": 0.8656987998451412, + "mean_token_weighted_tv": 0.03443872756173274, + "aggregate_load_tv": 0.03116531165311653 + } + } + }, + "layer_23": { + "layer": 23, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "b605e6aabd780ef706ac69eb62e21e6f1dd6cc2ac73116c2b240257eaa55a309", + "route_weight_sha256": "af8c480169548609756816ad43d90a048e8c965ea1234adbbba5518b81108f17", + "loads": [ + 17, + 15, + 33, + 33, + 4, + 26, + 9, + 7, + 42, + 24, + 30, + 20, + 11, + 17, + 25, + 23, + 23, + 37, + 48, + 7, + 10, + 63, + 25, + 20, + 17, + 0, + 2, + 52, + 17, + 35, + 26, + 13, + 21, + 7, + 31, + 12, + 41, + 8, + 18, + 11, + 11, + 27, + 4, + 11, + 42, + 22, + 15, + 35, + 26, + 18, + 3, + 3, + 25, + 14, + 25, + 18, + 35, + 9, + 31, + 94, + 57, + 21, + 46, + 4 + ], + "weighted_loads": [ + 1.2191456397995353, + 0.7713667005300522, + 1.5478220209479332, + 5.540140639990568, + 0.22684740275144577, + 1.473570453003049, + 0.7174162492156029, + 0.26001390628516674, + 3.1750854086130857, + 1.0378590561449528, + 1.2949826251715422, + 0.8364355936646461, + 0.41193934716284275, + 0.9396617375314236, + 2.978965140879154, + 1.6604421623051167, + 1.7942624371498823, + 2.4285184796899557, + 3.320872064679861, + 0.21131510473787785, + 0.4095360357314348, + 4.46509568952024, + 3.131171379238367, + 1.6934450007975101, + 0.7365307118743658, + 0.0, + 0.0641248282045126, + 3.202805871143937, + 1.2296129614114761, + 2.152282603085041, + 1.0260545313358307, + 0.7632049079984426, + 0.9786542169749737, + 0.2915142588317394, + 1.4157783836126328, + 0.7185526788234711, + 2.3719418719410896, + 0.32896145060658455, + 1.317575179040432, + 0.5327876843512058, + 0.39600696973502636, + 1.7745134513825178, + 0.17233248986303806, + 0.6002678759396076, + 3.030292861163616, + 2.2110338620841503, + 0.8447133470326662, + 3.4385868087410927, + 2.0603920444846153, + 0.8798021823167801, + 1.4458902515470982, + 0.09991120733320713, + 1.8169042505323887, + 0.6390012335032225, + 1.8012585639953613, + 0.9966171141713858, + 2.8571028262376785, + 0.40949613600969315, + 1.3065046947449446, + 6.473720051348209, + 4.605050772428513, + 1.4144262932240963, + 4.154293268918991, + 0.15297174639999866 + ], + "unique_experts": 63, + "load_cv": 0.7182696644538361, + "normalized_load_entropy": 0.9422830207618476, + "max_load_share": 0.06368563685636856 + }, + "full_input": { + "tokens": 271, + "top_k": 6, + "decisions": 1626, + "ordered_route_sha256": "3f3e8b5d87c1b18e6c2f4d31804e3b3ff8296d24d852415290e80e70521f7de3", + "route_weight_sha256": "ba4d8cc3ec2b627948bc4bf64ff551e6bd21ce63622748909c753acd4d1458ad", + "loads": [ + 22, + 18, + 33, + 42, + 11, + 29, + 14, + 13, + 43, + 33, + 30, + 21, + 12, + 21, + 26, + 23, + 26, + 37, + 48, + 7, + 10, + 63, + 26, + 31, + 20, + 0, + 2, + 52, + 17, + 35, + 27, + 13, + 24, + 12, + 31, + 12, + 42, + 8, + 22, + 13, + 18, + 27, + 5, + 11, + 42, + 28, + 26, + 38, + 27, + 18, + 3, + 4, + 25, + 14, + 35, + 20, + 35, + 21, + 32, + 94, + 57, + 21, + 50, + 6 + ], + "weighted_loads": [ + 1.41266370867379, + 0.9442137479782104, + 1.5478220209479332, + 5.7973601224366575, + 0.5911402553319931, + 1.5693440116010606, + 1.0427029840648174, + 0.5467162523418665, + 3.1758301586960442, + 1.36166057176888, + 1.2949826251715422, + 0.8825763538479805, + 0.4221813231706619, + 1.123523786664009, + 3.0531079098582268, + 1.6604421623051167, + 1.8466068892739713, + 2.4285184796899557, + 3.320872064679861, + 0.21131510473787785, + 0.4095360357314348, + 4.46509568952024, + 3.1498605851083994, + 3.028578110039234, + 0.8379102665930986, + 0.0, + 0.0641248282045126, + 3.202805871143937, + 1.2296129614114761, + 2.152282603085041, + 1.0750821977853775, + 0.7632049079984426, + 1.1476600803434849, + 0.5837268949253485, + 1.4157783836126328, + 0.7185526788234711, + 2.417473718523979, + 0.32896145060658455, + 1.4857149804010987, + 0.5846827961504459, + 0.7427986897528172, + 1.7745134513825178, + 0.19817684032022953, + 0.6002678759396076, + 3.030292861163616, + 4.21103441528976, + 1.8057833444327116, + 3.500694309361279, + 2.0993151515722275, + 0.8798021823167801, + 1.4458902515470982, + 0.18965877778828144, + 1.8169042505323887, + 0.6390012335032225, + 2.721660941839218, + 1.0942098591476679, + 2.8571028262376785, + 1.5133673939853907, + 1.3632802981883287, + 6.473720051348209, + 4.605050772428513, + 1.4144262932240963, + 4.282815992832184, + 0.2904787827283144 + ], + "unique_experts": 63, + "load_cv": 0.6380800692568144, + "normalized_load_entropy": 0.9527316958208849, + "max_load_share": 0.05781057810578106 + } + }, + "s1_eos": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "0297ce7119ccab8c8d35a9a5ee36ea7bd5d7885e0a1a6420a10fc1922fb99573", + "route_weight_sha256": "e085bf29dffcecc01407906bcc133b15aad627ab1fd881e2be77ff5847f465d9", + "loads": [ + 16, + 18, + 32, + 33, + 6, + 27, + 8, + 8, + 41, + 21, + 30, + 23, + 9, + 16, + 24, + 23, + 23, + 36, + 48, + 6, + 11, + 62, + 25, + 20, + 14, + 0, + 0, + 55, + 18, + 35, + 26, + 13, + 23, + 7, + 30, + 13, + 42, + 8, + 18, + 11, + 10, + 28, + 4, + 11, + 43, + 22, + 14, + 34, + 26, + 17, + 2, + 3, + 25, + 14, + 25, + 17, + 36, + 9, + 30, + 95, + 57, + 21, + 48, + 6 + ], + "weighted_loads": [ + 1.1103449165821075, + 0.9032495636492968, + 1.4962300639599562, + 5.521693553775549, + 0.2568180076777935, + 1.4704966619610786, + 0.666524451225996, + 0.3009864576160908, + 3.14797549135983, + 0.9441519416868687, + 1.3227164223790169, + 0.9764127675443888, + 0.3513473607599735, + 0.8646014519035816, + 2.9394116532057524, + 1.6427930239588022, + 1.7893193680793047, + 2.3604932334274054, + 3.3271325156092644, + 0.161806283518672, + 0.4173016920685768, + 4.515637770295143, + 3.1957832239568233, + 1.707094956189394, + 0.63888587243855, + 0.0, + 0.0, + 3.320616275072098, + 1.257462464272976, + 2.157726638019085, + 1.0172397624701262, + 0.7527437582612038, + 1.0582239348441362, + 0.2880570273846388, + 1.402465246617794, + 0.7695419937372208, + 2.3493427261710167, + 0.3074409794062376, + 1.331643257290125, + 0.5272507406771183, + 0.36186072044074535, + 1.7983529102057219, + 0.17110880464315414, + 0.5867062956094742, + 3.1080158315598965, + 2.2353779580444098, + 0.8381578326225281, + 3.407563479617238, + 2.066244835034013, + 0.8265783339738846, + 1.352711021900177, + 0.10021565854549408, + 1.7948310822248459, + 0.6238649114966393, + 1.8371767420321703, + 0.9561792649328709, + 2.8710061758756638, + 0.3923194855451584, + 1.2534674052149057, + 6.403674064204097, + 4.599399426952004, + 1.4085060991346836, + 4.350404340773821, + 0.24158291332423687 + ], + "unique_experts": 62, + "load_cv": 0.7267674261171962, + "normalized_load_entropy": 0.940581964195865, + "max_load_share": 0.06436314363143632 + }, + "full_input": { + "tokens": 287, + "top_k": 6, + "decisions": 1722, + "ordered_route_sha256": "169fe2f522d538001d41673008b321164226a1b211e8d1715a33b38f1dcb13b3", + "route_weight_sha256": "1726b557758e82c02e1a601b23b2c8491a613ad92bc40df9b2853d48969bd9a6", + "loads": [ + 22, + 24, + 38, + 42, + 11, + 28, + 20, + 16, + 43, + 27, + 32, + 24, + 10, + 21, + 26, + 26, + 27, + 37, + 50, + 6, + 12, + 62, + 26, + 35, + 16, + 0, + 0, + 55, + 18, + 36, + 27, + 13, + 26, + 19, + 30, + 13, + 48, + 9, + 25, + 12, + 18, + 28, + 6, + 11, + 45, + 29, + 30, + 38, + 32, + 20, + 2, + 13, + 31, + 16, + 35, + 18, + 36, + 27, + 33, + 95, + 59, + 22, + 56, + 10 + ], + "weighted_loads": [ + 1.4481328369583935, + 1.2561470996588469, + 1.8130528535693884, + 6.013068374944851, + 0.49002587608993053, + 1.4757010187022388, + 1.350721888244152, + 0.6183583848178387, + 3.18449287005933, + 1.16561646386981, + 1.416980504989624, + 1.0125079397112131, + 0.36154405772686005, + 1.0730805713683367, + 3.0711916517466307, + 1.7620694991201162, + 1.8641780423931777, + 2.423734290525317, + 3.4182306453585625, + 0.161806283518672, + 0.4644184857606888, + 4.515637770295143, + 3.2143505215644836, + 3.6118528321385384, + 0.71798843331635, + 0.0, + 0.0, + 3.320616275072098, + 1.257462464272976, + 2.2036389894783497, + 1.0661910120397806, + 0.7527437582612038, + 1.1861038468778133, + 0.9929249996785074, + 1.402465246617794, + 0.7695419937372208, + 2.786247143521905, + 0.3562581893056631, + 1.7365383189171553, + 0.5511098094284534, + 0.7631446775048971, + 1.7983529102057219, + 0.22405471839010715, + 0.5867062956094742, + 3.210510604083538, + 4.291889606043696, + 2.446826785802841, + 3.6337736467830837, + 2.328377714380622, + 0.9789851494133472, + 1.352711021900177, + 0.7099899370223284, + 2.437672283500433, + 0.6938407048583031, + 2.805903846397996, + 0.9867589622735977, + 2.8710061758756638, + 2.0897401869297028, + 1.4053427297621965, + 6.403674064204097, + 4.673557562753558, + 1.5343295969069004, + 4.638353910297155, + 0.45472839288413525 + ], + "unique_experts": 62, + "load_cv": 0.6115387910897252, + "normalized_load_entropy": 0.95536776378934, + "max_load_share": 0.05516840882694541 + } + }, + "s0_bos": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "641eff6e466399bd9aa7787c312e9a9ee7fecfee2acf1985e4e4d222f46dbff2", + "route_weight_sha256": "e2a04050ea509da382110ad232b7081254ee83e0bd08a93edbff6e82932eb36d", + "loads": [ + 16, + 15, + 34, + 35, + 3, + 23, + 9, + 5, + 41, + 24, + 32, + 19, + 10, + 16, + 25, + 23, + 22, + 37, + 49, + 7, + 12, + 65, + 25, + 20, + 16, + 0, + 0, + 54, + 19, + 36, + 27, + 14, + 22, + 7, + 27, + 11, + 40, + 9, + 18, + 10, + 13, + 28, + 5, + 12, + 42, + 21, + 15, + 34, + 26, + 15, + 3, + 3, + 26, + 16, + 26, + 15, + 35, + 8, + 29, + 98, + 55, + 21, + 47, + 6 + ], + "weighted_loads": [ + 1.1418838240206242, + 0.7443321701139212, + 1.5636670589447021, + 5.6873421389609575, + 0.17364246398210526, + 1.3230720572173595, + 0.7121778558939695, + 0.1907554566860199, + 3.171537060290575, + 1.0421701595187187, + 1.3954843301326036, + 0.8244656436145306, + 0.39048671163618565, + 0.9393869750201702, + 3.0352260880172253, + 1.6581533029675484, + 1.8117853570729494, + 2.466253163293004, + 3.392294365912676, + 0.23875710275024176, + 0.4705584067851305, + 4.575972750782967, + 3.159670354798436, + 1.5912380274385214, + 0.629497243091464, + 0.0, + 0.0, + 3.3094001095741987, + 1.3391669243574142, + 2.2050760071724653, + 1.0620780270546675, + 0.7982141021639109, + 1.0292693879455328, + 0.29701733589172363, + 1.2674620747566223, + 0.7278600968420506, + 2.381273427978158, + 0.39023287408053875, + 1.3450157046318054, + 0.4928083959966898, + 0.4545472376048565, + 1.7936995290219784, + 0.20219304785132408, + 0.6202642759308219, + 3.048997789621353, + 2.1292036287486553, + 0.789499131962657, + 3.41164536960423, + 2.03694424033165, + 0.711940124630928, + 1.4989208430051804, + 0.08674507588148117, + 1.8649118915200233, + 0.7355407774448395, + 1.9187455140054226, + 0.8762196116149426, + 2.9007970802485943, + 0.36020373925566673, + 1.2219240982085466, + 6.754911618307233, + 4.709878163412213, + 1.4305561073124409, + 4.1381413247436285, + 0.23662957549095154 + ], + "unique_experts": 62, + "load_cv": 0.7364445665885235, + "normalized_load_entropy": 0.9397624160017068, + "max_load_share": 0.06639566395663957 + }, + "full_input": { + "tokens": 271, + "top_k": 6, + "decisions": 1626, + "ordered_route_sha256": "db93934508309ec679ef933a59e82f14f1593e91f3cebc5812966325617e01d3", + "route_weight_sha256": "3b068bb302d73823740015c4d88c10bb923371f11b2458076ee47f96a85efa10", + "loads": [ + 19, + 18, + 34, + 43, + 10, + 25, + 14, + 11, + 41, + 31, + 32, + 19, + 12, + 20, + 26, + 23, + 25, + 37, + 49, + 8, + 12, + 65, + 27, + 32, + 20, + 0, + 1, + 54, + 19, + 36, + 27, + 14, + 24, + 10, + 27, + 11, + 40, + 9, + 21, + 12, + 20, + 28, + 6, + 13, + 42, + 26, + 27, + 36, + 27, + 15, + 4, + 4, + 26, + 17, + 36, + 18, + 35, + 21, + 31, + 99, + 56, + 21, + 51, + 9 + ], + "weighted_loads": [ + 1.2681899820454419, + 0.9171792175620794, + 1.5636670589447021, + 5.94101031171158, + 0.5300719998776913, + 1.3793645459227264, + 1.0378290582448244, + 0.4574514962732792, + 3.171537060290575, + 1.2883019261062145, + 1.3954843301326036, + 0.8244656436145306, + 0.43330951035022736, + 1.1232490241527557, + 3.109368856996298, + 1.6581533029675484, + 1.8641298091970384, + 2.466253163293004, + 3.392294365912676, + 0.3999741217121482, + 0.4705584067851305, + 4.575972750782967, + 3.2202712893486023, + 3.020087683573365, + 0.773167060688138, + 0.0, + 0.1392550766468048, + 3.3094001095741987, + 1.3391669243574142, + 2.2050760071724653, + 1.0620780270546675, + 0.7982141021639109, + 1.1410448905080557, + 0.5721670836210251, + 1.2674620747566223, + 0.7278600968420506, + 2.381273427978158, + 0.39023287408053875, + 1.4790418157353997, + 0.5447035077959299, + 0.7960376441478729, + 1.7936995290219784, + 0.22803739830851555, + 0.6742798192426562, + 3.048997789621353, + 3.1526976507157087, + 1.790779547765851, + 3.469950464554131, + 2.075867347419262, + 0.711940124630928, + 1.5527860224246979, + 0.17649264633655548, + 1.8649118915200233, + 0.7749217934906483, + 2.8391478918492794, + 1.018920425325632, + 2.9007970802485943, + 1.4906271826475859, + 1.3342649396508932, + 6.988451661542058, + 4.743312476202846, + 1.4305561073124409, + 4.2701928447932005, + 0.39443066716194153 + ], + "unique_experts": 63, + "load_cv": 0.6523739882106357, + "normalized_load_entropy": 0.9521104109869077, + "max_load_share": 0.06088560885608856 + } + }, + "s1_bos": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "a86d685b5559da51b5db294164f7b64dd840a4be50b119dce1c7306ddcda1a5b", + "route_weight_sha256": "8395ad95aca3adf4bc38cc900db436328c49174c17fcf7a36b3e6c53fb562534", + "loads": [ + 16, + 16, + 36, + 34, + 7, + 23, + 9, + 4, + 41, + 23, + 32, + 24, + 8, + 15, + 25, + 22, + 22, + 37, + 48, + 7, + 13, + 68, + 26, + 20, + 11, + 0, + 0, + 55, + 19, + 36, + 23, + 13, + 23, + 8, + 29, + 13, + 42, + 8, + 18, + 9, + 14, + 28, + 4, + 11, + 42, + 22, + 13, + 35, + 26, + 10, + 2, + 3, + 25, + 15, + 26, + 14, + 35, + 7, + 29, + 100, + 57, + 21, + 48, + 6 + ], + "weighted_loads": [ + 1.109139122068882, + 0.8091115038841963, + 1.6551241502165794, + 5.541521638631821, + 0.3269125111401081, + 1.2872442677617073, + 0.7170743644237518, + 0.17119196988642216, + 3.160850364714861, + 1.0256613157689571, + 1.395751141011715, + 1.0016175638884306, + 0.3361320439726114, + 0.8788165375590324, + 2.9946845527738333, + 1.6211690045893192, + 1.8184970654547215, + 2.42050950974226, + 3.3414000496268272, + 0.23554122634232044, + 0.4701880235224962, + 4.8609831519424915, + 3.2671436350792646, + 1.5517546851187944, + 0.43363691307604313, + 0.0, + 0.0, + 3.331678107380867, + 1.3096242621541023, + 2.2004856169223785, + 0.9331750478595495, + 0.776001712307334, + 1.023956561461091, + 0.33650708198547363, + 1.3567212037742138, + 0.8301569689065218, + 2.3686385191977024, + 0.31249686889350414, + 1.3528734967112541, + 0.45061940513551235, + 0.49801862239837646, + 1.800173070281744, + 0.17252915538847446, + 0.6025590319186449, + 3.0660413578152657, + 2.1834442857652903, + 0.7723579779267311, + 3.5144888386130333, + 2.0743043702095747, + 0.5073768049478531, + 1.4419825673103333, + 0.0891642002388835, + 1.8059297688305378, + 0.6763472110033035, + 1.871420107781887, + 0.8335526399314404, + 2.8898919504135847, + 0.32273120805621147, + 1.293547609820962, + 6.765974012203515, + 4.643965397030115, + 1.4432414770126343, + 4.1966552920639515, + 0.21888526901602745 + ], + "unique_experts": 62, + "load_cv": 0.7594606171822889, + "normalized_load_entropy": 0.9365382838340128, + "max_load_share": 0.06775067750677506 + }, + "full_input": { + "tokens": 287, + "top_k": 6, + "decisions": 1722, + "ordered_route_sha256": "f897cfdd46ec3fe64f180672745e8ef92b6e4be0684aacce56ae284048132e9e", + "route_weight_sha256": "44ccd863b2e89e7330ae9bddbbf00add4145d867ee91d0e32844890c8ed12201", + "loads": [ + 20, + 22, + 42, + 42, + 13, + 24, + 20, + 12, + 42, + 29, + 34, + 25, + 9, + 20, + 26, + 25, + 26, + 38, + 50, + 7, + 14, + 68, + 28, + 36, + 14, + 0, + 0, + 55, + 19, + 37, + 25, + 13, + 25, + 19, + 29, + 13, + 48, + 10, + 24, + 10, + 24, + 28, + 6, + 11, + 44, + 27, + 29, + 38, + 32, + 13, + 2, + 13, + 31, + 19, + 36, + 17, + 35, + 26, + 31, + 100, + 59, + 22, + 56, + 10 + ], + "weighted_loads": [ + 1.4144273255951703, + 1.1620090398937464, + 1.9719469398260117, + 6.02935770759359, + 0.6194184217602015, + 1.2924486245028675, + 1.3708820901811123, + 0.5078425761312246, + 3.1966469809412956, + 1.2478386163711548, + 1.490015223622322, + 1.052924619987607, + 0.34632874093949795, + 1.0872956570237875, + 3.0890474524348974, + 1.7404454797506332, + 1.8933557397685945, + 2.483750566840172, + 3.4324981793761253, + 0.23554122634232044, + 0.5173048172146082, + 4.8609831519424915, + 3.336145715788007, + 3.5493823420256376, + 0.5516652148216963, + 0.0, + 0.0, + 3.331678107380867, + 1.3096242621541023, + 2.2463979683816433, + 1.0177366491407156, + 0.776001712307334, + 1.130894398316741, + 1.056808564811945, + 1.3567212037742138, + 0.8301569689065218, + 2.8055429365485907, + 0.40340389125049114, + 1.7062435988336802, + 0.4744784738868475, + 0.9651926588267088, + 1.800173070281744, + 0.22547506913542747, + 0.6025590319186449, + 3.1685361303389072, + 3.2293141204863787, + 2.381026931107044, + 3.7369838869199157, + 2.336437249556184, + 0.6597836203873158, + 1.4419825673103333, + 0.6989384787157178, + 2.448770970106125, + 0.8731739893555641, + 2.8401472121477127, + 0.977430909872055, + 2.8898919504135847, + 2.0041629560291767, + 1.4251835960894823, + 6.765974012203515, + 4.718123532831669, + 1.569064974784851, + 4.486038863658905, + 0.45371706783771515 + ], + "unique_experts": 62, + "load_cv": 0.6357980726859085, + "normalized_load_entropy": 0.9530773061336411, + "max_load_share": 0.05807200929152149 + } + }, + "s0_x": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "98c74fab4dd2281b4c83f2ee1816e9286e33f098d7440420cf71fefa5f7bad86", + "route_weight_sha256": "4773d50321a9d7f5589c06d9959173aa103eb275a0e51ccbb55ce6082a10a892", + "loads": [ + 16, + 14, + 34, + 33, + 8, + 19, + 9, + 4, + 39, + 20, + 32, + 19, + 10, + 16, + 25, + 23, + 22, + 36, + 48, + 6, + 12, + 68, + 24, + 21, + 15, + 0, + 1, + 55, + 19, + 33, + 27, + 15, + 21, + 9, + 27, + 13, + 40, + 9, + 18, + 12, + 10, + 28, + 3, + 10, + 42, + 23, + 15, + 35, + 25, + 15, + 3, + 2, + 24, + 16, + 28, + 19, + 35, + 9, + 31, + 100, + 56, + 21, + 49, + 5 + ], + "weighted_loads": [ + 1.1588347991928458, + 0.7090957779437304, + 1.5736474599689245, + 5.653807163238525, + 0.3740642350167036, + 1.158842045813799, + 0.7132415845990181, + 0.12363055720925331, + 3.050451088696718, + 0.8860431183129549, + 1.4380451384931803, + 0.8023577984422445, + 0.3642617519944906, + 0.9017535820603371, + 3.0949299577623606, + 1.6599689349532127, + 1.7971791792660952, + 2.3697192203253508, + 3.3269051127135754, + 0.16413344535976648, + 0.4848230257630348, + 4.422898750752211, + 3.085816375911236, + 1.5718857385218143, + 0.6599043607711792, + 0.0, + 0.027134686708450317, + 3.4246349800378084, + 1.3229235783219337, + 2.000713739544153, + 1.0493275336921215, + 0.8102801833301783, + 1.0161566697061062, + 0.37137007527053356, + 1.2431961670517921, + 0.7836041040718555, + 2.3404682222753763, + 0.3691452033817768, + 1.3385362960398197, + 0.5722773596644402, + 0.36087290570139885, + 1.797694744542241, + 0.13354228995740414, + 0.5802504755556583, + 2.9448802061378956, + 2.2182634565979242, + 0.8729008715599775, + 3.549374407157302, + 1.9640920832753181, + 0.6692547332495451, + 1.4051178880035877, + 0.051891060546040535, + 1.747441727668047, + 0.7478290535509586, + 1.99260083027184, + 0.9031548742204905, + 2.881483653560281, + 0.38228917866945267, + 1.3016787599772215, + 6.749960107728839, + 4.594554450362921, + 1.3999477606266737, + 4.355902651324868, + 0.1807423336431384 + ], + "unique_experts": 63, + "load_cv": 0.7465079432440482, + "normalized_load_entropy": 0.9394694927997537, + "max_load_share": 0.06775067750677506 + }, + "full_input": { + "tokens": 271, + "top_k": 6, + "decisions": 1626, + "ordered_route_sha256": "2d5441c810068baa5d10aadf94b70a117e08a717badd1ee608ebb733dd25c77f", + "route_weight_sha256": "69af8c3268a448d896207764fe9939c6b7b0ffc4bcfe05ec684d274a27eda844", + "loads": [ + 20, + 17, + 34, + 43, + 14, + 21, + 15, + 10, + 39, + 28, + 32, + 19, + 11, + 20, + 27, + 23, + 26, + 36, + 48, + 6, + 12, + 68, + 25, + 33, + 19, + 0, + 1, + 55, + 19, + 33, + 27, + 15, + 23, + 13, + 27, + 13, + 41, + 9, + 22, + 14, + 17, + 28, + 4, + 10, + 42, + 29, + 29, + 37, + 26, + 15, + 3, + 3, + 24, + 16, + 39, + 21, + 35, + 21, + 32, + 100, + 56, + 21, + 53, + 7 + ], + "weighted_loads": [ + 1.3544039013795555, + 0.8819428253918886, + 1.5736474599689245, + 6.049235014710575, + 0.6930329296737909, + 1.2151345345191658, + 1.0850527435541153, + 0.38420509174466133, + 3.050451088696718, + 1.150312026962638, + 1.4380451384931803, + 0.8023577984422445, + 0.3745037280023098, + 1.0856156311929226, + 3.213938010856509, + 1.6599689349532127, + 1.8787121190689504, + 2.3697192203253508, + 3.3269051127135754, + 0.16413344535976648, + 0.4848230257630348, + 4.422898750752211, + 3.104505581781268, + 2.975927099585533, + 0.802678782492876, + 0.0, + 0.027134686708450317, + 3.4246349800378084, + 1.3229235783219337, + 2.000713739544153, + 1.0493275336921215, + 0.8102801833301783, + 1.1367479115724564, + 0.6574757527559996, + 1.2431961670517921, + 0.7836041040718555, + 2.3792038653045893, + 0.3691452033817768, + 1.5332693057134748, + 0.6241724714636803, + 0.658696161583066, + 1.797694744542241, + 0.1593866404145956, + 0.5802504755556583, + 2.9448802061378956, + 3.2793702073395252, + 2.0286540258675814, + 3.607679502107203, + 2.0030151903629303, + 0.6692547332495451, + 1.4051178880035877, + 0.14163863100111485, + 1.747441727668047, + 0.7478290535509586, + 3.047837110236287, + 0.9882998894900084, + 2.881483653560281, + 1.5416526217013597, + 1.3584543634206057, + 6.749960107728839, + 4.594554450362921, + 1.3999477606266737, + 4.486184122040868, + 0.28687148448079824 + ], + "unique_experts": 63, + "load_cv": 0.6651978845578687, + "normalized_load_entropy": 0.9500179116158958, + "max_load_share": 0.06150061500615006 + } + }, + "s1_x": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "831dedb6abf2ed61781d1750a4e38981579f54472ffb6d26652d785760fa142a", + "route_weight_sha256": "d83551a2ef54d2978c0901572c6db74702a7789bf35124d917b70c6878906fd2", + "loads": [ + 15, + 15, + 35, + 35, + 5, + 21, + 8, + 7, + 40, + 23, + 34, + 20, + 8, + 14, + 25, + 23, + 24, + 37, + 48, + 5, + 11, + 64, + 28, + 21, + 10, + 0, + 1, + 55, + 20, + 36, + 28, + 14, + 25, + 7, + 28, + 11, + 41, + 8, + 18, + 11, + 12, + 28, + 6, + 10, + 42, + 22, + 13, + 36, + 25, + 14, + 2, + 2, + 25, + 14, + 30, + 15, + 33, + 9, + 30, + 101, + 54, + 20, + 48, + 6 + ], + "weighted_loads": [ + 1.1054009906947613, + 0.7501529939472675, + 1.6585140507668257, + 5.687826681882143, + 0.21890743263065815, + 1.2515905518084764, + 0.6757297404110432, + 0.2756509520113468, + 3.0952359307557344, + 1.110242784023285, + 1.548002852126956, + 0.8893805630505085, + 0.33852197974920273, + 0.8272273056209087, + 3.0135428160429, + 1.663375660777092, + 1.8570261243730783, + 2.429639011621475, + 3.373688727617264, + 0.1884803269058466, + 0.44050038047134876, + 4.332575120031834, + 3.430982057005167, + 1.5718995705246925, + 0.4361170772463083, + 0.0, + 0.03230133280158043, + 3.375962369143963, + 1.354122381657362, + 2.1768952570855618, + 1.0712964739650488, + 0.7951478734612465, + 1.1071831807494164, + 0.3187863714993, + 1.32240105047822, + 0.7019024919718504, + 2.323498683050275, + 0.3165931347757578, + 1.3263564705848694, + 0.5088751222938299, + 0.43580501340329647, + 1.8070084806531668, + 0.24796266853809357, + 0.5655372980982065, + 3.0239678993821144, + 2.1034518647938967, + 0.7684068866074085, + 3.5509504787623882, + 1.9662572592496872, + 0.6376936621963978, + 1.1827737092971802, + 0.06661631166934967, + 1.7859572619199753, + 0.6595959365367889, + 2.04111853428185, + 0.8096697106957436, + 2.7581752315163612, + 0.3839613199234009, + 1.3036990351974964, + 6.823138562962413, + 4.57754522934556, + 1.414105236530304, + 4.148909751325846, + 0.2581290379166603 + ], + "unique_experts": 63, + "load_cv": 0.7530511424622863, + "normalized_load_entropy": 0.9376209922781913, + "max_load_share": 0.06842818428184282 + }, + "full_input": { + "tokens": 287, + "top_k": 6, + "decisions": 1722, + "ordered_route_sha256": "18aee2801eed3388f8e5ffefc7561d8f994c4b07dd0b7b2a3e25a169eb7d993f", + "route_weight_sha256": "2448735feedd187562af70c45063d6d720972540c5f908bf5a463917f3932193", + "loads": [ + 20, + 21, + 41, + 44, + 9, + 22, + 20, + 13, + 41, + 27, + 36, + 20, + 9, + 19, + 26, + 26, + 29, + 38, + 50, + 6, + 12, + 64, + 29, + 38, + 12, + 0, + 1, + 55, + 20, + 37, + 28, + 14, + 27, + 17, + 28, + 11, + 47, + 9, + 27, + 12, + 20, + 28, + 8, + 10, + 44, + 27, + 32, + 39, + 32, + 17, + 2, + 14, + 31, + 17, + 43, + 17, + 33, + 27, + 32, + 101, + 56, + 21, + 57, + 9 + ], + "weighted_loads": [ + 1.440461587626487, + 1.1030505299568176, + 1.975336840376258, + 6.23902882123366, + 0.41749146953225136, + 1.2567949085496366, + 1.3818475306034088, + 0.5041786096990108, + 3.131032546982169, + 1.2629680819809437, + 1.6422669347375631, + 0.8893805630505085, + 0.34871867671608925, + 1.0357064250856638, + 3.1079057157039642, + 1.782652135938406, + 1.9709483007900417, + 2.492880068719387, + 3.464786857366562, + 0.2199182715266943, + 0.48761717416346073, + 4.332575120031834, + 3.4495493546128273, + 3.5558057241141796, + 0.5152196381241083, + 0.0, + 0.03230133280158043, + 3.375962369143963, + 1.354122381657362, + 2.2228076085448265, + 1.0712964739650488, + 0.7951478734612465, + 1.2206069119274616, + 0.9822631925344467, + 1.32240105047822, + 0.7019024919718504, + 2.760403100401163, + 0.3654103446751833, + 1.8034927621483803, + 0.5327341910451651, + 0.7742837145924568, + 1.8070084806531668, + 0.3009085822850466, + 0.5655372980982065, + 3.126462671905756, + 3.149321699514985, + 2.6629407070577145, + 3.7734455270692706, + 2.2787150032818317, + 0.7901004776358604, + 1.1827737092971802, + 0.7839993387460709, + 2.4287984631955624, + 0.7811034508049488, + 3.2531428914517164, + 0.8849825523793697, + 2.7581752315163612, + 2.0404905639588833, + 1.412815771996975, + 6.823138562962413, + 4.651703365147114, + 1.5399287343025208, + 4.467573154717684, + 0.41106072813272476 + ], + "unique_experts": 63, + "load_cv": 0.6390148487156709, + "normalized_load_entropy": 0.9526608994323427, + "max_load_share": 0.0586527293844367 + } + }, + "s0_period": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "795eda60099704be948c5005a3eb80cbcc00d81bb7d73dbd90f4a51e2471a5ad", + "route_weight_sha256": "29eca6c2d5ce657fc3b541067b23bdd5234d3763c79dfa7997a4560ec42ccd01", + "loads": [ + 16, + 13, + 34, + 34, + 8, + 21, + 9, + 6, + 41, + 18, + 31, + 17, + 9, + 16, + 26, + 24, + 24, + 37, + 48, + 5, + 12, + 64, + 25, + 20, + 11, + 0, + 1, + 54, + 19, + 34, + 28, + 16, + 25, + 8, + 28, + 12, + 40, + 9, + 18, + 11, + 9, + 29, + 5, + 10, + 42, + 21, + 18, + 34, + 25, + 17, + 2, + 2, + 24, + 17, + 26, + 22, + 36, + 8, + 32, + 97, + 55, + 21, + 47, + 5 + ], + "weighted_loads": [ + 1.1857519447803497, + 0.6737642623484135, + 1.6259948816150427, + 5.68068759329617, + 0.3727358914911747, + 1.2439018916338682, + 0.722422681748867, + 0.21495950780808926, + 3.1489715930074453, + 0.8362674545496702, + 1.3704246692359447, + 0.7657778859138489, + 0.3456494063138962, + 0.9176877588033676, + 3.084798254072666, + 1.685171203687787, + 1.8741035927087069, + 2.437886679545045, + 3.3385478891432285, + 0.14687485806643963, + 0.47979859448969364, + 4.284378385171294, + 3.1855311170220375, + 1.5650090239942074, + 0.49837250262498856, + 0.0, + 0.032241299748420715, + 3.3561169877648354, + 1.3176440335810184, + 2.0772035717964172, + 1.0657360665500164, + 0.8636870812624693, + 1.1285934867337346, + 0.34342484921216965, + 1.3046606238931417, + 0.7817043755203485, + 2.4013862144201994, + 0.3634325582534075, + 1.343143418431282, + 0.5349097084254026, + 0.3269336726516485, + 1.830875327810645, + 0.20630574971437454, + 0.5730759054422379, + 2.979272533208132, + 2.149014472961426, + 1.0158897694200277, + 3.512607494369149, + 1.974759716540575, + 0.7583479322493076, + 1.3286347389221191, + 0.04605103749781847, + 1.766659613698721, + 0.8029649946838617, + 1.86382020637393, + 1.0213009547442198, + 2.919479785487056, + 0.36374982446432114, + 1.3342043831944466, + 6.663756091147661, + 4.572234410792589, + 1.4129061475396156, + 4.264491766691208, + 0.18132611643522978 + ], + "unique_experts": 63, + "load_cv": 0.7314412845700977, + "normalized_load_entropy": 0.9404546306550668, + "max_load_share": 0.06571815718157181 + }, + "full_input": { + "tokens": 271, + "top_k": 6, + "decisions": 1626, + "ordered_route_sha256": "2a31256ec865bf026829dd29183f5712c270aea99415ed9755a67e9b8bec9f14", + "route_weight_sha256": "a5136ca16d9b207bcaeb907fd4d7a8b752a1683146231424553a02595653db6c", + "loads": [ + 21, + 16, + 35, + 42, + 14, + 23, + 16, + 11, + 41, + 27, + 31, + 19, + 10, + 20, + 27, + 24, + 27, + 37, + 48, + 5, + 12, + 64, + 26, + 32, + 14, + 0, + 1, + 54, + 19, + 34, + 29, + 16, + 27, + 12, + 28, + 12, + 40, + 9, + 23, + 13, + 16, + 29, + 7, + 10, + 42, + 27, + 29, + 36, + 26, + 17, + 2, + 3, + 24, + 17, + 37, + 24, + 36, + 21, + 33, + 97, + 55, + 21, + 51, + 7 + ], + "weighted_loads": [ + 1.423943389672786, + 0.8466113097965717, + 1.6694809887558222, + 5.934355766046792, + 0.7261310964822769, + 1.300194380339235, + 1.1692858152091503, + 0.4331141132861376, + 3.1489715930074453, + 1.1679119933396578, + 1.3704246692359447, + 0.8484220691025257, + 0.35589138232171535, + 1.1015498079359531, + 3.1589410230517387, + 1.685171203687787, + 1.9264480448327959, + 2.437886679545045, + 3.3385478891432285, + 0.14687485806643963, + 0.47979859448969364, + 4.284378385171294, + 3.20422032289207, + 2.990593757480383, + 0.5997520573437214, + 0.0, + 0.032241299748420715, + 3.3561169877648354, + 1.3176440335810184, + 2.0772035717964172, + 1.103068582713604, + 0.8636870812624693, + 1.2653507003560662, + 0.629736665636301, + 1.3046606238931417, + 0.7817043755203485, + 2.4013862144201994, + 0.3634325582534075, + 1.673028846271336, + 0.5868048202246428, + 0.6569140907377005, + 1.830875327810645, + 0.27476857602596283, + 0.5730759054422379, + 2.979272533208132, + 3.211943732574582, + 1.9769597668200731, + 3.5709125893190503, + 2.013682823628187, + 0.7583479322493076, + 1.3286347389221191, + 0.13579860795289278, + 1.766659613698721, + 0.8029649946838617, + 2.8363055922091007, + 1.1078418511897326, + 2.919479785487056, + 1.5903467554599047, + 1.3909799866378307, + 6.663756091147661, + 4.572234410792589, + 1.4129061475396156, + 4.3943609073758125, + 0.3054817719385028 + ], + "unique_experts": 63, + "load_cv": 0.6471957251900292, + "normalized_load_entropy": 0.9515025448426156, + "max_load_share": 0.05965559655596556 + } + }, + "s1_period": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "d86235844f32aa047f7f40dac4a5c8f07194040c343ec4c72c8b74c418f636a4", + "route_weight_sha256": "0e03674bb7377c7d4a3cf679416a760b3e502db7bd2ec468ec26851a30271095", + "loads": [ + 16, + 16, + 35, + 34, + 6, + 20, + 9, + 7, + 41, + 22, + 33, + 18, + 9, + 16, + 24, + 23, + 26, + 36, + 49, + 5, + 12, + 64, + 27, + 20, + 10, + 0, + 1, + 54, + 20, + 36, + 28, + 15, + 27, + 6, + 28, + 14, + 39, + 9, + 18, + 9, + 13, + 29, + 5, + 10, + 42, + 22, + 14, + 36, + 26, + 15, + 2, + 2, + 27, + 14, + 29, + 13, + 33, + 9, + 30, + 98, + 53, + 20, + 47, + 5 + ], + "weighted_loads": [ + 1.1363414414227009, + 0.7920150738209486, + 1.6585878487676382, + 5.6248983815312386, + 0.2910854294896126, + 1.2448103372007608, + 0.7058530449867249, + 0.26607977598905563, + 3.1103676334023476, + 1.0695677045732737, + 1.5099913980811834, + 0.8153695221990347, + 0.36831806786358356, + 0.9235851224511862, + 2.9736994076520205, + 1.6598504595458508, + 1.8793554287403822, + 2.4005112405866385, + 3.3758120350539684, + 0.18088514357805252, + 0.4800501074641943, + 4.305524347350001, + 3.411005539819598, + 1.5023051761090755, + 0.4339418262243271, + 0.0, + 0.034890539944171906, + 3.3417252860963345, + 1.3491248227655888, + 2.1904129534959793, + 1.0891252383589745, + 0.8314126245677471, + 1.1614959668368101, + 0.27398793771862984, + 1.3220230340957642, + 0.7981432341039181, + 2.197832979261875, + 0.3378060404211283, + 1.3398139663040638, + 0.44221558421850204, + 0.48031120374798775, + 1.8338264171034098, + 0.2070398461073637, + 0.5609827935695648, + 3.0433676466345787, + 2.082512157037854, + 0.8081073109060526, + 3.512830199673772, + 2.0185983162373304, + 0.6785588469356298, + 1.1799628734588623, + 0.05858132429420948, + 1.8651599772274494, + 0.6738163195550442, + 2.022358352318406, + 0.771768206730485, + 2.724425669759512, + 0.368623785674572, + 1.3243038188666105, + 6.737285140901804, + 4.501420427113771, + 1.4014683663845062, + 4.116366485133767, + 0.2380054108798504 + ], + "unique_experts": 63, + "load_cv": 0.7375208180009198, + "normalized_load_entropy": 0.93935033487793, + "max_load_share": 0.06639566395663957 + }, + "full_input": { + "tokens": 287, + "top_k": 6, + "decisions": 1722, + "ordered_route_sha256": "ced0838fe348bd168f4c510bb190242fe53b76572bbf4dc810926a32f5a6a92b", + "route_weight_sha256": "36d921d87bd070ea8216e3bc9df41f8acbb68a7564bca5f44b3f5328261f3300", + "loads": [ + 21, + 22, + 42, + 43, + 10, + 21, + 23, + 15, + 42, + 27, + 35, + 18, + 10, + 21, + 25, + 26, + 31, + 37, + 51, + 5, + 13, + 64, + 28, + 35, + 13, + 0, + 1, + 54, + 20, + 37, + 28, + 15, + 29, + 17, + 28, + 14, + 45, + 10, + 28, + 10, + 21, + 29, + 7, + 10, + 44, + 27, + 32, + 39, + 32, + 18, + 2, + 13, + 33, + 18, + 41, + 14, + 33, + 27, + 31, + 98, + 55, + 21, + 55, + 8 + ], + "weighted_loads": [ + 1.473110739607364, + 1.1449126098304987, + 2.013847293332219, + 6.1519736223854125, + 0.4690155144780874, + 1.250014693941921, + 1.518699336796999, + 0.5724805258214474, + 3.1461642496287823, + 1.2555338125675917, + 1.6042554806917906, + 0.8153695221990347, + 0.3785147648304701, + 1.1320642419159412, + 3.0680623073130846, + 1.7791269347071648, + 1.9847370157949626, + 2.4637522976845503, + 3.4669101648032665, + 0.18088514357805252, + 0.5271669011563063, + 4.305524347350001, + 3.4295728374272585, + 3.4131530597805977, + 0.5507444515824318, + 0.0, + 0.034890539944171906, + 3.3417252860963345, + 1.3491248227655888, + 2.236325304955244, + 1.0891252383589745, + 0.8314126245677471, + 1.2887614015489817, + 1.036094531416893, + 1.3220230340957642, + 0.7981432341039181, + 2.6347373966127634, + 0.3866232503205538, + 1.9921676591038704, + 0.4660746529698372, + 0.8367450200021267, + 1.8338264171034098, + 0.2599857598543167, + 0.5609827935695648, + 3.1458624191582203, + 3.1283819917589426, + 2.50907158665359, + 3.7353252479806542, + 2.2807311955839396, + 0.8309656623750925, + 1.1799628734588623, + 0.694827675819397, + 2.5080011785030365, + 0.8348707668483257, + 3.0903693605214357, + 0.8023479040712118, + 2.724425669759512, + 2.090704284608364, + 1.399920029565692, + 6.737285140901804, + 4.575578562915325, + 1.527291864156723, + 4.401746282353997, + 0.37659258022904396 + ], + "unique_experts": 63, + "load_cv": 0.6230766680843116, + "normalized_load_entropy": 0.954257866229724, + "max_load_share": 0.056910569105691054 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 246, + "ordered_topk_exact_tokens": 167, + "set_exact_tokens": 194, + "mean_set_jaccard": 0.9396051103368175, + "mean_token_weighted_tv": 0.014682306414015772, + "aggregate_load_tv": 0.018292682926829278 + }, + "system_bos": { + "tokens": 246, + "ordered_topk_exact_tokens": 151, + "set_exact_tokens": 177, + "mean_set_jaccard": 0.9146341463414634, + "mean_token_weighted_tv": 0.02060653139814371, + "aggregate_load_tv": 0.023035230352303523 + }, + "system_x": { + "tokens": 246, + "ordered_topk_exact_tokens": 131, + "set_exact_tokens": 163, + "mean_set_jaccard": 0.8897810861225496, + "mean_token_weighted_tv": 0.02599318522952376, + "aggregate_load_tv": 0.03048780487804878 + }, + "system_period": { + "tokens": 246, + "ordered_topk_exact_tokens": 144, + "set_exact_tokens": 172, + "mean_set_jaccard": 0.9000404744307183, + "mean_token_weighted_tv": 0.02543678683440799, + "aggregate_load_tv": 0.027100271002710022 + }, + "bos_at_s0": { + "tokens": 246, + "ordered_topk_exact_tokens": 154, + "set_exact_tokens": 181, + "mean_set_jaccard": 0.9196670538133953, + "mean_token_weighted_tv": 0.02048130620202822, + "aggregate_load_tv": 0.023712737127371278 + }, + "bos_at_s1": { + "tokens": 246, + "ordered_topk_exact_tokens": 140, + "set_exact_tokens": 172, + "mean_set_jaccard": 0.9088269454123111, + "mean_token_weighted_tv": 0.02223414364384442, + "aggregate_load_tv": 0.026422764227642274 + }, + "x_at_s0": { + "tokens": 246, + "ordered_topk_exact_tokens": 140, + "set_exact_tokens": 165, + "mean_set_jaccard": 0.893807412100095, + "mean_token_weighted_tv": 0.02704591096598443, + "aggregate_load_tv": 0.031165311653116527 + }, + "x_at_s1": { + "tokens": 246, + "ordered_topk_exact_tokens": 126, + "set_exact_tokens": 154, + "mean_set_jaccard": 0.8753017984725301, + "mean_token_weighted_tv": 0.030109689858689056, + "aggregate_load_tv": 0.03116531165311653 + }, + "period_at_s0": { + "tokens": 246, + "ordered_topk_exact_tokens": 143, + "set_exact_tokens": 168, + "mean_set_jaccard": 0.8966142258825185, + "mean_token_weighted_tv": 0.02537997175250354, + "aggregate_load_tv": 0.03319783197831978 + }, + "period_at_s1": { + "tokens": 246, + "ordered_topk_exact_tokens": 130, + "set_exact_tokens": 158, + "mean_set_jaccard": 0.8829092316897195, + "mean_token_weighted_tv": 0.028336251343835175, + "aggregate_load_tv": 0.03252032520325203 + } + } + }, + "layer_24": { + "layer": 24, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "5a54d51c27e7e7defc7d18b69fca998e09842238425bc15bc79329a9e71b652e", + "route_weight_sha256": "dd23ea9d684d43dad020a6b3c1806bb530068c3483b8184721916fc3d858fa4d", + "loads": [ + 5, + 2, + 54, + 22, + 44, + 10, + 4, + 6, + 36, + 52, + 32, + 22, + 26, + 39, + 18, + 21, + 6, + 8, + 20, + 19, + 33, + 27, + 12, + 21, + 25, + 75, + 0, + 5, + 27, + 22, + 1, + 21, + 14, + 23, + 13, + 25, + 8, + 17, + 27, + 17, + 11, + 4, + 27, + 28, + 17, + 31, + 50, + 3, + 50, + 29, + 13, + 3, + 12, + 33, + 14, + 17, + 53, + 26, + 77, + 11, + 49, + 7, + 3, + 49 + ], + "weighted_loads": [ + 0.1808311976492405, + 0.0570505615323782, + 2.0303785409778357, + 1.0544006787240505, + 2.731772404164076, + 0.39414154924452305, + 0.10284111661894713, + 0.19980142824351788, + 5.01201818883419, + 2.6926530227065086, + 5.775602206587791, + 1.2144773695617914, + 1.5594934169203043, + 1.8896482177078724, + 0.993941305205226, + 0.9787425622344017, + 0.5783126385358628, + 0.33636110462248325, + 0.7388152033090591, + 0.6989801730960608, + 1.5783504769206047, + 1.262671634554863, + 0.5797644443809986, + 1.357529852539301, + 1.2029727697372437, + 6.580058500170708, + 0.0, + 0.23110452794935554, + 1.5220494158565998, + 0.9389076009392738, + 0.00020358088659122586, + 0.7431421019136906, + 0.6085238205268979, + 2.0387309708166867, + 0.4025968313217163, + 1.4395467173308134, + 0.2765761772170663, + 0.6039717420935631, + 1.1352857258170843, + 0.6653630677610636, + 0.619688780978322, + 0.14209026843309402, + 1.0284587182104588, + 1.6871204040944576, + 0.8171600550413132, + 1.5382394455373287, + 3.3118522483855486, + 0.12740547209978104, + 6.290802905336022, + 2.135849704965949, + 1.7585928495973349, + 0.1335214115679264, + 0.324043532833457, + 3.4361636750400066, + 0.8475125525146723, + 0.8808114677667618, + 3.4723541364073753, + 1.0576514694839716, + 4.706913188099861, + 0.43842131085693836, + 2.888873264193535, + 0.37321319058537483, + 0.09526353888213634, + 1.8193412460386753 + ], + "unique_experts": 63, + "load_cv": 0.7485122324018586, + "normalized_load_entropy": 0.9339747524728871, + "max_load_share": 0.0521680216802168 + }, + "full_input": { + "tokens": 271, + "top_k": 6, + "decisions": 1626, + "ordered_route_sha256": "3cba692f6c760073286968e8beef4f37f25236e08be6ae5379e1583de1a31070", + "route_weight_sha256": "bb2b46607b6c7729b05cb425fae9fd4ac11b7d35735cb6efc5c9b6e2419a13a7", + "loads": [ + 5, + 2, + 56, + 22, + 44, + 15, + 4, + 7, + 44, + 52, + 42, + 22, + 28, + 39, + 21, + 21, + 6, + 8, + 20, + 21, + 33, + 27, + 19, + 21, + 33, + 75, + 0, + 5, + 36, + 27, + 1, + 23, + 16, + 27, + 20, + 26, + 9, + 19, + 28, + 17, + 11, + 6, + 31, + 29, + 17, + 32, + 50, + 9, + 50, + 29, + 19, + 9, + 15, + 36, + 14, + 17, + 53, + 27, + 85, + 11, + 51, + 25, + 7, + 52 + ], + "weighted_loads": [ + 0.1808311976492405, + 0.0570505615323782, + 2.0973707046359777, + 1.0544006787240505, + 2.731772404164076, + 0.5563139712903649, + 0.10284111661894713, + 0.255466153845191, + 5.3646500231698155, + 2.6926530227065086, + 6.145984522299841, + 1.2144773695617914, + 1.5963096471969038, + 1.8896482177078724, + 1.0873345024883747, + 0.9787425622344017, + 0.5783126385358628, + 0.33636110462248325, + 0.7388152033090591, + 0.7882114108651876, + 1.5783504769206047, + 1.262671634554863, + 1.1550760045647621, + 1.357529852539301, + 1.503565477207303, + 6.580058500170708, + 0.0, + 0.23110452794935554, + 1.8798655308783054, + 1.1389351785182953, + 0.00020358088659122586, + 0.809677243232727, + 0.6716056102886796, + 2.2247064143884927, + 0.6412237957119942, + 1.482124200090766, + 0.36989344004541636, + 1.5013902001082897, + 1.1807620506733656, + 0.6653630677610636, + 0.619688780978322, + 0.23431241884827614, + 1.2064105453900993, + 1.726171463727951, + 0.8171600550413132, + 1.5876466743648052, + 3.3118522483855486, + 0.47952151333447546, + 6.290802905336022, + 2.135849704965949, + 2.032438600435853, + 0.5412939637899399, + 0.40902338922023773, + 3.5709354132413864, + 0.8475125525146723, + 0.8808114677667618, + 3.4723541364073753, + 1.1174360606819391, + 4.990021776175126, + 0.43842131085693836, + 2.9608024433255196, + 1.6031151707284153, + 0.18098950921557844, + 3.8044238053262234 + ], + "unique_experts": 63, + "load_cv": 0.6883751502339136, + "normalized_load_entropy": 0.9436680751234551, + "max_load_share": 0.05227552275522755 + } + }, + "s1_eos": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "549c1823f74ae1d90561f623dbf622af4fbfc9bddefbe6097c458a8bb0069c3f", + "route_weight_sha256": "461a4f82b4f6fb28963fc66b23c2c3895dc04ca4057b7d10769dbff4f9b6844a", + "loads": [ + 7, + 1, + 54, + 25, + 47, + 9, + 3, + 5, + 34, + 54, + 31, + 20, + 29, + 38, + 18, + 22, + 6, + 8, + 19, + 20, + 31, + 27, + 11, + 22, + 21, + 74, + 0, + 4, + 29, + 22, + 0, + 20, + 14, + 24, + 18, + 28, + 8, + 14, + 26, + 17, + 11, + 4, + 29, + 32, + 16, + 32, + 47, + 6, + 50, + 29, + 9, + 2, + 8, + 34, + 15, + 15, + 54, + 22, + 81, + 11, + 49, + 7, + 3, + 50 + ], + "weighted_loads": [ + 0.26946020871400833, + 0.027912110090255737, + 2.0127316024154425, + 1.1734868437051773, + 2.8220890183001757, + 0.35876113921403885, + 0.10513638146221638, + 0.16146822646260262, + 4.947175487875938, + 2.792450524866581, + 5.752043928951025, + 1.1510319914668798, + 1.6423501269891858, + 1.8277826625853777, + 0.9830309581011534, + 1.0055981520563364, + 0.5384935877009411, + 0.3473056126385927, + 0.7083558309823275, + 0.7442784588783979, + 1.5110974255949259, + 1.2673357147723436, + 0.5253558941185474, + 1.3731393665075302, + 1.030352732166648, + 6.551670061424375, + 0.0, + 0.1403368760002195, + 1.5598728079348803, + 0.9423141442239285, + 0.0, + 0.7105962075293064, + 0.6174062648788095, + 2.195941007579677, + 0.5163189432823856, + 1.5557470917701721, + 0.2767264572903514, + 0.5258057806640863, + 1.095640143379569, + 0.6594636775553226, + 0.6557315997779369, + 0.14792485162615776, + 1.1171002332121134, + 1.8107890021055937, + 0.7671830281615257, + 1.5951657481491566, + 3.1378346793353558, + 0.22629195638000965, + 6.269581515341997, + 2.1446358300745487, + 1.3852107282727957, + 0.08259531110525131, + 0.21484228409826756, + 3.4671841021627188, + 0.8831911999732256, + 0.8122160937637091, + 3.4574869386851788, + 0.9447511285543442, + 4.8119292836636305, + 0.44209907948970795, + 2.913087109103799, + 0.35706231370568275, + 0.08971833810210228, + 1.8530586407723604 + ], + "unique_experts": 62, + "load_cv": 0.7661999573797871, + "normalized_load_entropy": 0.9303789522425752, + "max_load_share": 0.054878048780487805 + }, + "full_input": { + "tokens": 287, + "top_k": 6, + "decisions": 1722, + "ordered_route_sha256": "ac5791e1b40671c1324439b5328fb3f4c62cbf5c821c8e6b11bc96ce3bcedff1", + "route_weight_sha256": "f2d07bfc65cbcc4494fa9a0f4ccd97dc5c6b40e17e5c7bc671e38f6d8bb2a239", + "loads": [ + 7, + 1, + 54, + 26, + 49, + 16, + 3, + 6, + 44, + 57, + 40, + 22, + 32, + 38, + 22, + 22, + 7, + 8, + 20, + 24, + 36, + 27, + 23, + 23, + 32, + 74, + 0, + 4, + 49, + 27, + 0, + 25, + 14, + 30, + 24, + 30, + 15, + 17, + 27, + 17, + 12, + 10, + 34, + 35, + 18, + 33, + 47, + 14, + 50, + 29, + 15, + 16, + 14, + 38, + 17, + 17, + 54, + 25, + 96, + 11, + 53, + 27, + 10, + 55 + ], + "weighted_loads": [ + 0.26946020871400833, + 0.027912110090255737, + 2.0127316024154425, + 1.287434309720993, + 2.882594821974635, + 0.5755186846945435, + 0.10513638146221638, + 0.20214878022670746, + 5.565079188905656, + 2.9231183137744665, + 6.102033706614748, + 1.217272462323308, + 1.7039095510262996, + 1.8277826625853777, + 1.1040975786745548, + 1.0055981520563364, + 0.5669737319185515, + 0.3473056126385927, + 0.7396016996353865, + 0.8886026628315449, + 1.7304355669766665, + 1.2673357147723436, + 1.3708149790763855, + 1.3981062956154346, + 1.44062614813447, + 6.551670061424375, + 0.0, + 0.1403368760002195, + 2.5571810454130173, + 1.1653831098228693, + 0.0, + 0.9167764317244291, + 0.6174062648788095, + 2.4999205347849056, + 0.7367110093364317, + 1.6549737714231014, + 0.7896360447630286, + 1.4714016746729612, + 1.1485621761530638, + 0.6594636775553226, + 0.7695888243615627, + 0.5345661081373692, + 1.3239604365080595, + 2.069974208250642, + 0.8610726408660412, + 1.6551757529377937, + 3.1378346793353558, + 0.738793148426339, + 6.269581515341997, + 2.1446358300745487, + 1.6744655687361956, + 1.0546906292438507, + 0.3868615794926882, + 3.746764985844493, + 1.0600623730570078, + 0.9111410174518824, + 3.4574869386851788, + 1.0737008638679981, + 5.429928108060267, + 0.44209907948970795, + 3.0394920464605093, + 2.2341593713499606, + 0.43158627883531153, + 3.924753748739022 + ], + "unique_experts": 62, + "load_cv": 0.6778264828323483, + "normalized_load_entropy": 0.9450440511350848, + "max_load_share": 0.05574912891986063 + } + }, + "s0_bos": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "49c84ca52c5656dd6f2b1e023219668a3b6e9a921e090c19c4fe9f36f881fdb7", + "route_weight_sha256": "b0e9a88d8b5b1a2cb33ac485a05b9aac32f1624df9d38c42156aef6ffb817af3", + "loads": [ + 7, + 1, + 55, + 21, + 47, + 8, + 4, + 8, + 34, + 53, + 35, + 20, + 26, + 38, + 18, + 25, + 4, + 7, + 18, + 21, + 30, + 28, + 12, + 22, + 23, + 78, + 0, + 5, + 31, + 23, + 3, + 21, + 14, + 23, + 12, + 26, + 10, + 16, + 24, + 17, + 11, + 3, + 24, + 31, + 13, + 32, + 51, + 4, + 50, + 29, + 12, + 2, + 9, + 35, + 14, + 17, + 56, + 25, + 74, + 13, + 47, + 7, + 4, + 45 + ], + "weighted_loads": [ + 0.24425413273274899, + 0.028187250718474388, + 2.070391431450844, + 1.0273075886070728, + 2.864768983796239, + 0.33541956543922424, + 0.13227864541113377, + 0.27184323966503143, + 5.066882127895951, + 2.7317906953394413, + 5.781691074371338, + 1.169872235506773, + 1.5997960027307272, + 1.8294529728591442, + 1.003733916208148, + 1.1020820401608944, + 0.28685315905022435, + 0.30160848051309586, + 0.6684131193906069, + 0.7873263023793697, + 1.4229892324656248, + 1.2766048107296228, + 0.5744602158665657, + 1.4125180765986443, + 1.0846877843141556, + 6.773909682407975, + 0.0, + 0.7063084375768085, + 1.7137525100260973, + 0.9756423179060221, + 0.0883309654891491, + 0.756578840315342, + 0.6073592472821474, + 2.0015209148987196, + 0.3286111342604272, + 1.4757510479539633, + 0.3615995878353715, + 0.5703501366078854, + 1.0310736801475286, + 0.6722058188170195, + 0.6175083220005035, + 0.09794747829437256, + 0.9277546685189009, + 1.7920118793845177, + 0.6794228609651327, + 1.6249265987426043, + 3.4296352230012417, + 0.16013507172465324, + 6.243673043325543, + 2.1465390771627426, + 2.0422592163085938, + 0.08885857090353966, + 0.23842334561049938, + 3.6059654727578163, + 0.870897214859724, + 0.9098151065409184, + 3.536712199449539, + 0.9921731241047382, + 4.6601482685655355, + 0.4285598658025265, + 2.791346251964569, + 0.38931170478463173, + 0.12117431312799454, + 1.6186714765572106 + ], + "unique_experts": 63, + "load_cv": 0.7556214564969777, + "normalized_load_entropy": 0.9330457766125295, + "max_load_share": 0.052845528455284556 + }, + "full_input": { + "tokens": 271, + "top_k": 6, + "decisions": 1626, + "ordered_route_sha256": "f2dc0a9915c4772c55d6b5197230163a6cf407215ca436cd4a2e5c166e900188", + "route_weight_sha256": "6263f616b02d305bea4bcc3f3a9210be7edd8b12425d32a73dab4ba7b702771c", + "loads": [ + 7, + 1, + 58, + 21, + 47, + 12, + 5, + 9, + 41, + 53, + 43, + 20, + 27, + 38, + 20, + 25, + 4, + 7, + 18, + 23, + 30, + 28, + 20, + 22, + 31, + 79, + 1, + 5, + 41, + 29, + 4, + 25, + 16, + 27, + 18, + 26, + 11, + 17, + 24, + 17, + 11, + 5, + 29, + 31, + 14, + 34, + 52, + 8, + 50, + 29, + 20, + 8, + 12, + 38, + 14, + 17, + 56, + 27, + 81, + 13, + 49, + 25, + 6, + 47 + ], + "weighted_loads": [ + 0.24425413273274899, + 0.028187250718474388, + 2.163661764934659, + 1.0273075886070728, + 2.864768983796239, + 0.46238609799183905, + 0.19328209571540356, + 0.32750796526670456, + 5.414992207661271, + 2.7317906953394413, + 6.099181837635115, + 1.169872235506773, + 1.6025215166155249, + 1.8294529728591442, + 1.0617226250469685, + 1.1020820401608944, + 0.28685315905022435, + 0.30160848051309586, + 0.6684131193906069, + 0.8881195224821568, + 1.4229892324656248, + 1.2766048107296228, + 1.300799150019884, + 1.4125180765986443, + 1.385280491784215, + 6.813466368243098, + 0.43995389342308044, + 0.7063084375768085, + 2.1128547843545675, + 1.2216454427689314, + 0.1255410946905613, + 0.8876184355467558, + 0.6969000604003668, + 2.1874963584705256, + 0.5031211214954965, + 1.4757510479539633, + 0.45491685066372156, + 1.4344548843801022, + 1.0310736801475286, + 0.6722058188170195, + 0.6175083220005035, + 0.1967179886996746, + 1.184397069271654, + 1.7920118793845177, + 0.7172576282173395, + 1.7342793587595224, + 3.4921216145157814, + 0.5124895819462836, + 6.243673043325543, + 2.1465390771627426, + 2.390078954398632, + 0.4824456013739109, + 0.3234032019972801, + 3.740737210959196, + 0.870897214859724, + 0.9098151065409184, + 3.536712199449539, + 1.0777536928653717, + 4.94211502186954, + 0.4285598658025265, + 2.863281935453415, + 1.6245678956620395, + 0.1722217561909929, + 2.6344810646914993 + ], + "unique_experts": 64, + "load_cv": 0.6938741305727109, + "normalized_load_entropy": 0.9435483095188112, + "max_load_share": 0.04981549815498155 + } + }, + "s1_bos": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "6a10eb5a2237703464e1212880f393e7e467315c60a75b0a1c40d8a7ff34ab1a", + "route_weight_sha256": "663d2ef3e09fa5f502f912ac8055dfff42da199dbe35f6cfd4b1dc4786dd5e34", + "loads": [ + 8, + 1, + 52, + 21, + 45, + 10, + 4, + 7, + 34, + 53, + 33, + 20, + 28, + 37, + 18, + 24, + 4, + 6, + 17, + 23, + 31, + 25, + 13, + 23, + 23, + 74, + 1, + 5, + 29, + 23, + 2, + 22, + 14, + 24, + 13, + 27, + 7, + 14, + 26, + 15, + 10, + 3, + 27, + 32, + 17, + 35, + 51, + 6, + 50, + 28, + 12, + 4, + 9, + 34, + 16, + 16, + 54, + 22, + 75, + 9, + 48, + 6, + 4, + 52 + ], + "weighted_loads": [ + 0.3022885974496603, + 0.026083048433065414, + 1.9512214977294207, + 1.0503592640161514, + 2.796632058918476, + 0.39601415023207664, + 0.14218786172568798, + 0.24739728309214115, + 4.927720880135894, + 2.7447013929486275, + 5.752880983054638, + 1.1893273871392012, + 1.6638864558190107, + 1.7776994109153748, + 0.9928678814321756, + 1.0561300683766603, + 0.26057182416843716, + 0.26172944344580173, + 0.6397406533360481, + 0.8484724145382643, + 1.4850915037095547, + 1.2070355359464884, + 0.6249821037054062, + 1.3910991698503494, + 1.1030756030231714, + 6.617216119542718, + 0.025429721921682358, + 0.761296330042569, + 1.6159038990736008, + 0.9883258640766144, + 0.05680724419653416, + 0.7689556907862425, + 0.5817544180899858, + 2.133546363285859, + 0.3552488332370558, + 1.5375852137804031, + 0.25123183988034725, + 0.5075548123568296, + 1.1149387657642365, + 0.605050215497613, + 0.5713149439543486, + 0.1136016696691513, + 1.039725974202156, + 1.8209109213203192, + 0.7963622659444809, + 1.7082707062363625, + 3.3604160752147436, + 0.22131145559251308, + 6.077876361086965, + 2.1237674318253994, + 1.6770092602819204, + 0.17109528556466103, + 0.24779908172786236, + 3.559798575937748, + 0.9379060380160809, + 0.8660025503486395, + 3.478303585201502, + 0.9154441263526678, + 4.658704297617078, + 0.34002784453332424, + 2.786110557615757, + 0.35411205142736435, + 0.11335604637861252, + 1.881517195154629 + ], + "unique_experts": 64, + "load_cv": 0.7490222718525607, + "normalized_load_entropy": 0.9341994611701347, + "max_load_share": 0.0508130081300813 + }, + "full_input": { + "tokens": 287, + "top_k": 6, + "decisions": 1722, + "ordered_route_sha256": "b47e8e7f58e2ba142a25e8a7eab20f94e2e69c282c23095939eeff5b1a670d7e", + "route_weight_sha256": "efce82841832a553b02c8473683870dfac36f0526f6d9052f0fead36752e3558", + "loads": [ + 8, + 1, + 54, + 22, + 47, + 17, + 4, + 8, + 43, + 56, + 41, + 22, + 31, + 37, + 22, + 24, + 5, + 6, + 18, + 28, + 36, + 25, + 26, + 24, + 34, + 74, + 1, + 5, + 49, + 29, + 2, + 26, + 14, + 30, + 19, + 29, + 14, + 17, + 26, + 15, + 11, + 10, + 33, + 35, + 18, + 37, + 51, + 13, + 50, + 28, + 19, + 18, + 15, + 38, + 18, + 18, + 54, + 24, + 89, + 9, + 52, + 27, + 11, + 55 + ], + "weighted_loads": [ + 0.3022885974496603, + 0.026083048433065414, + 2.0166317224502563, + 1.1643067300319672, + 2.8571378625929356, + 0.617626620689407, + 0.14218786172568798, + 0.288077836856246, + 5.541288500651717, + 2.875369181856513, + 6.098306336672977, + 1.2555678579956293, + 1.7254458798561245, + 1.7776994109153748, + 1.1146541200578213, + 1.0561300683766603, + 0.2890519683860475, + 0.26172944344580173, + 0.6709865219891071, + 1.0345753002911806, + 1.7044296450912952, + 1.2070355359464884, + 1.5861273929476738, + 1.4160660989582539, + 1.5114651247859001, + 6.617216119542718, + 0.025429721921682358, + 0.761296330042569, + 2.6042241510003805, + 1.2563615050166845, + 0.05680724419653416, + 0.9462602864950895, + 0.5817544180899858, + 2.437525890491088, + 0.5648605424667039, + 1.6368118934333324, + 0.7641414273530245, + 1.4535438474267721, + 1.1149387657642365, + 0.605050215497613, + 0.6851721685379744, + 0.5443877764046192, + 1.4002168774604797, + 2.0978971924632788, + 0.8349057994782925, + 1.8117888607084751, + 3.3604160752147436, + 0.7890853495337069, + 6.077876361086965, + 2.1237674318253994, + 2.068120637908578, + 1.0911063216626644, + 0.419818377122283, + 3.839379459619522, + 1.114777211099863, + 0.9649274740368128, + 3.478303585201502, + 1.0018499810248613, + 5.286364231258631, + 0.34002784453332424, + 2.9157137237489223, + 2.253688766155392, + 0.5029430171707645, + 2.9369167247905352 + ], + "unique_experts": 64, + "load_cv": 0.6605062445361531, + "normalized_load_entropy": 0.9479411966280583, + "max_load_share": 0.05168408826945412 + } + }, + "s0_x": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "dcaf558a1e2639b3d2953ba2c763327f15fe4ed6338f09daa64bd5be29a1e8ad", + "route_weight_sha256": "dbc46370665eae611e3f3a411c00640640a21c070e48d6eccaa989e149c50ca9", + "loads": [ + 8, + 2, + 55, + 25, + 47, + 10, + 3, + 7, + 34, + 52, + 33, + 20, + 27, + 38, + 18, + 23, + 4, + 9, + 15, + 17, + 31, + 27, + 11, + 24, + 23, + 75, + 0, + 3, + 30, + 20, + 1, + 24, + 15, + 24, + 17, + 24, + 9, + 15, + 26, + 17, + 12, + 2, + 27, + 31, + 16, + 35, + 51, + 4, + 50, + 29, + 8, + 3, + 12, + 32, + 14, + 21, + 54, + 21, + 70, + 14, + 49, + 8, + 3, + 47 + ], + "weighted_loads": [ + 0.2871630974113941, + 0.05896788090467453, + 2.0328316409140825, + 1.1484211944043636, + 2.811005048453808, + 0.3960478138178587, + 0.09931047074496746, + 0.2437902595847845, + 5.067157449200749, + 2.6748134046792984, + 5.741958308964968, + 1.156703794375062, + 1.5813836986199021, + 1.7793737929314375, + 0.9963953476399183, + 1.055812131613493, + 0.5092378370463848, + 0.3776760660111904, + 0.5753740482032299, + 0.6168324593454599, + 1.488906979560852, + 1.2319422326982021, + 0.5258215442299843, + 1.4531351309269667, + 1.0573497209697962, + 6.688527602702379, + 0.0, + 0.10895173523385893, + 1.6477633602917194, + 0.875577762722969, + 0.02583109773695469, + 0.8285907339304686, + 0.6332760890945792, + 2.1482787938366528, + 0.4801266785343614, + 1.4141910299658775, + 0.33050434850156307, + 0.5509893819689751, + 1.0649117734283209, + 0.6863269619643688, + 0.6254258137196302, + 0.04709790088236332, + 0.9962183138277396, + 1.8810677397996187, + 0.7311997599899769, + 1.7614002637565136, + 3.3572729974985123, + 0.164004135876894, + 6.272864894941449, + 2.1028498131781816, + 1.3900124412029982, + 0.14392485842108727, + 0.3229697346687317, + 3.5822911504656076, + 0.8523404784500599, + 1.0603213272988796, + 3.5129524152725935, + 0.9009763821959496, + 4.227390332147479, + 0.4747916143387556, + 2.8280214928090572, + 0.4212849382311106, + 0.08929530903697014, + 1.6772266071830018 + ], + "unique_experts": 63, + "load_cv": 0.7408988087897053, + "normalized_load_entropy": 0.9339189128050677, + "max_load_share": 0.0508130081300813 + }, + "full_input": { + "tokens": 271, + "top_k": 6, + "decisions": 1626, + "ordered_route_sha256": "a491104d190172db096e1c42fb9bc8d37dcaebc67830ecde591714da1a384542", + "route_weight_sha256": "efcb02bd2360cf3ec3694faf1b9b00dcfa3779a6d3d3e2d26a9bab5affa16aa1", + "loads": [ + 8, + 2, + 58, + 25, + 47, + 16, + 3, + 9, + 42, + 52, + 42, + 20, + 29, + 38, + 21, + 23, + 4, + 9, + 15, + 19, + 31, + 27, + 18, + 24, + 31, + 75, + 0, + 3, + 40, + 25, + 1, + 25, + 17, + 28, + 25, + 25, + 11, + 17, + 27, + 17, + 13, + 3, + 30, + 31, + 16, + 37, + 51, + 9, + 50, + 29, + 14, + 9, + 15, + 36, + 14, + 21, + 54, + 22, + 78, + 14, + 51, + 26, + 5, + 49 + ], + "weighted_loads": [ + 0.2871630974113941, + 0.05896788090467453, + 2.1340287644416094, + 1.1484211944043636, + 2.811005048453808, + 0.5871602876577526, + 0.09931047074496746, + 0.3361248467117548, + 5.497340442612767, + 2.6748134046792984, + 6.113852131413296, + 1.156703794375062, + 1.6182357289362699, + 1.7793737929314375, + 1.0862684324383736, + 1.055812131613493, + 0.5092378370463848, + 0.3776760660111904, + 0.5753740482032299, + 0.6958846766501665, + 1.488906979560852, + 1.2319422326982021, + 1.0990825146436691, + 1.4531351309269667, + 1.3579424284398556, + 6.688527602702379, + 0.0, + 0.10895173523385893, + 2.0354230776429176, + 1.0756053403019905, + 0.02583109773695469, + 0.8608783278614283, + 0.7013047179207206, + 2.3342542374084587, + 0.7393924999614683, + 1.4520585723221302, + 0.46525018475949764, + 1.451142031699419, + 1.1018150392919779, + 0.6863269619643688, + 0.6591927874833345, + 0.10680714808404446, + 1.0952304200191065, + 1.8810677397996187, + 0.7311997599899769, + 1.8483630381524563, + 3.3572729974985123, + 0.5572523684240878, + 6.272864894941449, + 2.1028498131781816, + 1.6225044187158346, + 0.5783635154366493, + 0.40794959105551243, + 3.765568455681205, + 0.8523404784500599, + 1.0603213272988796, + 3.5129524152725935, + 0.945390060544014, + 4.527208369225264, + 0.4747916143387556, + 2.896315572783351, + 1.693310861941427, + 0.13365177682135254, + 2.6930361953172905 + ], + "unique_experts": 63, + "load_cv": 0.6810925863609406, + "normalized_load_entropy": 0.943305654849682, + "max_load_share": 0.04797047970479705 + } + }, + "s1_x": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "07d3a0342a57a06335696641210f6fc103827c2aeb0e66f980157be02410a0dc", + "route_weight_sha256": "869ddc53bac4a942e782b0755e766721054a4e83664aae52e40b1389afb47e1b", + "loads": [ + 8, + 1, + 55, + 24, + 47, + 9, + 4, + 5, + 35, + 54, + 33, + 21, + 28, + 38, + 17, + 23, + 4, + 9, + 14, + 19, + 32, + 25, + 11, + 23, + 21, + 75, + 0, + 5, + 31, + 20, + 3, + 23, + 15, + 25, + 12, + 28, + 6, + 16, + 26, + 15, + 12, + 3, + 28, + 30, + 18, + 34, + 53, + 4, + 48, + 30, + 9, + 5, + 6, + 34, + 16, + 15, + 54, + 26, + 74, + 9, + 48, + 7, + 3, + 50 + ], + "weighted_loads": [ + 0.2662079222500324, + 0.02751331403851509, + 2.0301041454076767, + 1.1429565697908401, + 2.839866144582629, + 0.3592563886195421, + 0.14233358204364777, + 0.18734000623226166, + 5.019923226907849, + 2.8100038915872574, + 5.73591704107821, + 1.1831288747489452, + 1.6962097212672234, + 1.8053066562861204, + 0.9424120578914881, + 1.0657981354743242, + 0.6769958063960075, + 0.34506484724806796, + 0.5321397092193365, + 0.6830685715440268, + 1.4807138983160257, + 1.1852581966668367, + 0.5509775504469872, + 1.4147012457251549, + 0.9908573031425476, + 6.604301676154137, + 0.0, + 0.6471337340772152, + 1.7716344725340605, + 0.8661240842193365, + 0.09017402864992619, + 0.8116121776401997, + 0.6232487093657255, + 2.167098258074475, + 0.36184301413595676, + 1.5174171533435583, + 0.21633839327841997, + 0.5372253438367807, + 1.0695241577923298, + 0.5951530914753675, + 0.6255974285304546, + 0.08898133784532547, + 1.0085188026801006, + 1.8459103181958199, + 0.8360173925757408, + 1.721472205594182, + 3.4080095924437046, + 0.16308225318789482, + 6.049329958856106, + 2.144906437024474, + 1.348817128688097, + 0.23632216453552246, + 0.1612822227180004, + 3.568088175728917, + 0.9265327379107475, + 0.8377776220440865, + 3.551424453034997, + 1.05465754494071, + 4.436639565974474, + 0.35125258937478065, + 2.7652359157800674, + 0.38047344982624054, + 0.08979248814284801, + 1.858981879428029 + ], + "unique_experts": 63, + "load_cv": 0.7611992892332573, + "normalized_load_entropy": 0.9313671459296979, + "max_load_share": 0.0508130081300813 + }, + "full_input": { + "tokens": 287, + "top_k": 6, + "decisions": 1722, + "ordered_route_sha256": "50423c24a67f9f9f76841d2238379d38a591fc4f9c21ffa75fa0e00f6860f189", + "route_weight_sha256": "cee102adc5aebdb6fd478744be86e5b4d0c0d98ed8567f1825af2173ef1ac8b1", + "loads": [ + 8, + 1, + 55, + 25, + 49, + 18, + 4, + 7, + 46, + 57, + 41, + 23, + 31, + 38, + 20, + 23, + 5, + 9, + 15, + 23, + 37, + 25, + 22, + 24, + 31, + 75, + 0, + 5, + 52, + 26, + 3, + 27, + 15, + 32, + 18, + 31, + 15, + 20, + 26, + 15, + 13, + 10, + 33, + 32, + 19, + 35, + 53, + 11, + 48, + 30, + 14, + 19, + 12, + 39, + 18, + 17, + 54, + 27, + 89, + 9, + 52, + 27, + 10, + 54 + ], + "weighted_loads": [ + 0.2662079222500324, + 0.02751331403851509, + 2.0301041454076767, + 1.2569040358066559, + 2.9003719482570887, + 0.6456235612276942, + 0.14233358204364777, + 0.26916632801294327, + 5.7177495341748, + 2.940671680495143, + 6.0696427777875215, + 1.2493693456053734, + 1.7577691453043371, + 1.8053066562861204, + 1.0285423919558525, + 1.0657981354743242, + 0.7054759506136179, + 0.34506484724806796, + 0.5633855778723955, + 0.8110904450777525, + 1.7000520396977663, + 1.1852581966668367, + 1.3163472414016724, + 1.4396681748330593, + 1.360858241096139, + 6.604301676154137, + 0.0, + 0.6471337340772152, + 2.8184258081018925, + 1.1320034265518188, + 0.09017402864992619, + 0.977378137409687, + 0.6232487093657255, + 2.5099115934335714, + 0.558523059822619, + 1.662806821987033, + 0.8508288310840726, + 1.5240711389019452, + 1.0695241577923298, + 0.5951530914753675, + 0.7394546531140804, + 0.5215233638882637, + 1.1596009216532366, + 2.0546425953507423, + 0.8745609261095524, + 1.7814822103828192, + 3.4080095924437046, + 0.7206754987128079, + 6.049329958856106, + 2.144906437024474, + 1.5804132893681526, + 1.2178066670894623, + 0.33330151811242104, + 3.8810065779834986, + 1.1034039109945297, + 0.9367025457322598, + 3.551424453034997, + 1.093457467854023, + 5.0944287199527025, + 0.35125258937478065, + 2.892521258443594, + 2.2592942588962615, + 0.48186721524689347, + 2.955724285915494 + ], + "unique_experts": 63, + "load_cv": 0.6703019373187749, + "normalized_load_entropy": 0.9464940122874169, + "max_load_share": 0.05168408826945412 + } + }, + "s0_period": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "af8e2eba590e247db7ef5ef43894d2f7833b379ed4b5b531d06a609cf590c43f", + "route_weight_sha256": "d202571d9d5b8f4b6adfdfd5ad7bd0faf2971643e70dfcfe5503d4b176f6e4e4", + "loads": [ + 6, + 1, + 49, + 24, + 47, + 10, + 3, + 6, + 34, + 52, + 31, + 21, + 26, + 38, + 18, + 23, + 4, + 8, + 16, + 18, + 32, + 26, + 11, + 25, + 25, + 74, + 0, + 3, + 30, + 20, + 2, + 24, + 16, + 24, + 16, + 25, + 9, + 16, + 25, + 17, + 13, + 3, + 30, + 27, + 16, + 36, + 53, + 5, + 48, + 30, + 9, + 6, + 10, + 34, + 15, + 21, + 54, + 23, + 68, + 12, + 48, + 7, + 3, + 50 + ], + "weighted_loads": [ + 0.22148823738098145, + 0.02754998952150345, + 1.8648591730743647, + 1.1152477283030748, + 2.8043011650443077, + 0.3914269916713238, + 0.09906959347426891, + 0.20645024627447128, + 5.020412812009454, + 2.6913122795522213, + 5.710558256134391, + 1.1800711061805487, + 1.5794356102123857, + 1.7858055643737316, + 0.9955160319805145, + 1.047972371801734, + 0.5717045180499554, + 0.335498234257102, + 0.6229136511683464, + 0.6740790270268917, + 1.5900157187134027, + 1.1931173913180828, + 0.5367811024188995, + 1.5095368437469006, + 1.134823027998209, + 6.611751906573772, + 0.0, + 0.14773432910442352, + 1.6685229875147343, + 0.8689022790640593, + 0.058339815586805344, + 0.8432522621005774, + 0.6512030083686113, + 2.0833291784510948, + 0.4573951671663963, + 1.4532408379018307, + 0.3598280865699053, + 0.5395792781164346, + 1.050664821639657, + 0.6821182575076818, + 0.6586089767515659, + 0.09549051150679588, + 1.08794282240342, + 1.766497328877449, + 0.7394020743668079, + 1.815885316580534, + 3.418133506551385, + 0.1919355932623148, + 6.211717231199145, + 2.149551620706916, + 1.5110277216881514, + 0.2501145638525486, + 0.2721701543778181, + 3.619340255856514, + 0.8814642652869225, + 1.0756158530712128, + 3.5002307202667, + 0.9797849711030722, + 4.210870269685984, + 0.44011453725397587, + 2.77205965295434, + 0.405494749546051, + 0.09109888225793839, + 1.7725830491617671 + ], + "unique_experts": 63, + "load_cv": 0.7298732408752108, + "normalized_load_entropy": 0.9355374090236371, + "max_load_share": 0.05013550135501355 + }, + "full_input": { + "tokens": 271, + "top_k": 6, + "decisions": 1626, + "ordered_route_sha256": "0a131a31126321fbd3d05649a550a1f80c9e97a003ea417d316fec681310bd5b", + "route_weight_sha256": "a0131273a2fa6dff006c3f06f336ea463b3a855ea23544d5950e7d5e248142e6", + "loads": [ + 7, + 1, + 53, + 24, + 47, + 16, + 3, + 8, + 41, + 52, + 39, + 21, + 27, + 38, + 21, + 23, + 5, + 8, + 16, + 19, + 32, + 26, + 18, + 25, + 33, + 74, + 0, + 3, + 40, + 25, + 2, + 26, + 18, + 29, + 23, + 25, + 10, + 18, + 25, + 17, + 14, + 6, + 34, + 27, + 16, + 37, + 53, + 10, + 48, + 30, + 15, + 13, + 13, + 37, + 15, + 21, + 54, + 24, + 75, + 12, + 50, + 26, + 6, + 52 + ], + "weighted_loads": [ + 0.2574065588414669, + 0.02754998952150345, + 2.003917610272765, + 1.1152477283030748, + 2.8043011650443077, + 0.5859126190189272, + 0.09906959347426891, + 0.2991187088191509, + 5.368522891774774, + 2.6913122795522213, + 6.028049019398168, + 1.1800711061805487, + 1.5821611240971833, + 1.7858055643737316, + 1.0875363070517778, + 1.047972371801734, + 0.6213803291320801, + 0.335498234257102, + 0.6229136511683464, + 0.7178155779838562, + 1.5900157187134027, + 1.1931173913180828, + 1.145466037094593, + 1.5095368437469006, + 1.4354157354682684, + 6.611751906573772, + 0.0, + 0.14773432910442352, + 2.0539246909320354, + 1.0689298566430807, + 0.058339815586805344, + 0.9100057054311037, + 0.7287863250821829, + 2.3053013086901046, + 0.6900683018211566, + 1.4532408379018307, + 0.45314534939825535, + 1.4349938540508447, + 1.050664821639657, + 0.6821182575076818, + 0.7039869651198387, + 0.24682581424713135, + 1.2526176553546975, + 1.766497328877449, + 0.7394020743668079, + 1.8652925454080105, + 3.418133506551385, + 0.5423748274333775, + 6.211717231199145, + 2.149551620706916, + 1.7880305219441652, + 0.7660743184387684, + 0.35715001076459885, + 3.7541119940578938, + 0.8814642652869225, + 1.0756158530712128, + 3.5002307202667, + 1.0280200596898794, + 4.4817711263895035, + 0.44011453725397587, + 2.8398088049143553, + 1.7229016940109432, + 0.16810300445649773, + 2.788392637296056 + ], + "unique_experts": 63, + "load_cv": 0.6650887040955153, + "normalized_load_entropy": 0.9457601833216049, + "max_load_share": 0.046125461254612546 + } + }, + "s1_period": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "ee9c4452b5476c309f0bc60dd0bb6449bc9fda7a5c58b2b7425d276b4f9eb3f3", + "route_weight_sha256": "185ae954a6e542c45b220d1eb2446084fa2d38ca328174861708b25e85620de6", + "loads": [ + 10, + 1, + 53, + 25, + 48, + 10, + 4, + 7, + 36, + 54, + 32, + 20, + 29, + 39, + 17, + 24, + 5, + 9, + 16, + 20, + 32, + 26, + 13, + 23, + 18, + 74, + 0, + 4, + 32, + 20, + 3, + 21, + 16, + 24, + 11, + 28, + 6, + 16, + 26, + 16, + 11, + 3, + 26, + 28, + 19, + 32, + 53, + 3, + 48, + 28, + 7, + 4, + 8, + 31, + 16, + 17, + 55, + 23, + 77, + 11, + 48, + 7, + 4, + 49 + ], + "weighted_loads": [ + 0.3477610982954502, + 0.027703575789928436, + 1.9730151779949665, + 1.2043437864631414, + 2.8955615125596523, + 0.3882033936679363, + 0.1405274122953415, + 0.252475393936038, + 5.008700644597411, + 2.8192179277539253, + 5.685724334791303, + 1.1567197926342487, + 1.7022526124492288, + 1.852616610005498, + 0.9417174328118563, + 1.089508667588234, + 0.8188466839492321, + 0.3361316882501342, + 0.5926556941121817, + 0.704459601594408, + 1.4624245949089527, + 1.2101557087153196, + 0.623970203101635, + 1.4333284739404917, + 0.7872574739158154, + 6.55602209828794, + 0.0, + 0.6323114316910505, + 1.7806537579745054, + 0.8574398085474968, + 0.08907166495919228, + 0.7192598982487652, + 0.6491385484114289, + 2.102393852012028, + 0.327369075268507, + 1.519108971580863, + 0.21680957544595003, + 0.5439658711138691, + 1.0628323629498482, + 0.6198958400636911, + 0.5908643621951342, + 0.08748798258602619, + 0.9942398741841316, + 1.7992201279848814, + 0.8961073067039251, + 1.6091955732554197, + 3.4072982855141163, + 0.12616587802767754, + 6.061289221048355, + 2.0766854509711266, + 1.2175744473934174, + 0.19060233235359192, + 0.20915476232767105, + 3.441353175789118, + 0.9394246656447649, + 0.8854984268546104, + 3.570767220109701, + 0.9338192958384752, + 4.613496355712414, + 0.41505185328423977, + 2.7607511430978775, + 0.37501486763358116, + 0.11532700061798096, + 1.8415071181952953 + ], + "unique_experts": 63, + "load_cv": 0.7574077292792837, + "normalized_load_entropy": 0.9326975453913701, + "max_load_share": 0.0521680216802168 + }, + "full_input": { + "tokens": 287, + "top_k": 6, + "decisions": 1722, + "ordered_route_sha256": "c23203c38437354cf97f6aadea011706e30be0f4aca92de50e651702d586ee80", + "route_weight_sha256": "50703f28340ce98861fa9038cb1ed0d19baa0eb0701cee5855115d2e0e8d464e", + "loads": [ + 10, + 1, + 54, + 26, + 50, + 18, + 4, + 8, + 45, + 57, + 39, + 22, + 32, + 39, + 21, + 24, + 6, + 9, + 17, + 25, + 37, + 26, + 23, + 24, + 29, + 74, + 0, + 4, + 53, + 25, + 3, + 24, + 16, + 30, + 17, + 30, + 13, + 21, + 26, + 16, + 12, + 11, + 30, + 31, + 20, + 34, + 53, + 10, + 48, + 28, + 14, + 20, + 14, + 36, + 18, + 19, + 55, + 24, + 93, + 11, + 52, + 28, + 11, + 52 + ], + "weighted_loads": [ + 0.3477610982954502, + 0.027703575789928436, + 2.0144500844180584, + 1.3182912524789572, + 2.956067316234112, + 0.6464766135904938, + 0.1405274122953415, + 0.29315594770014286, + 5.6222682651132345, + 2.949885716661811, + 5.9874216199386865, + 1.2229602634906769, + 1.7638120364863425, + 1.852616610005498, + 1.0537969395518303, + 1.089508667588234, + 0.8473268281668425, + 0.3361316882501342, + 0.6239015627652407, + 0.8925818237944441, + 1.6817627362906933, + 1.2101557087153196, + 1.3401811048388481, + 1.458295403048396, + 1.1946788411587477, + 6.55602209828794, + 0.0, + 0.6323114316910505, + 2.842848353087902, + 1.0805087741464376, + 0.08907166495919228, + 0.8586281603907082, + 0.6491385484114289, + 2.406373379217257, + 0.5279078176245093, + 1.6183356512337923, + 0.7297191629186273, + 1.5757416697624649, + 1.0628323629498482, + 0.6198958400636911, + 0.70472158677876, + 0.5764345694333315, + 1.1076390706002712, + 2.056726371869445, + 0.9346508402377367, + 1.7084938455373049, + 3.4072982855141163, + 0.6517956298775971, + 6.061289221048355, + 2.0766854509711266, + 1.563899002969265, + 1.2596893310546875, + 0.3811740577220917, + 3.761232066899538, + 1.116295838728547, + 0.9844233505427837, + 3.570767220109701, + 0.9702167455106974, + 5.296381564810872, + 0.41505185328423977, + 2.8853325247764587, + 2.2842511222697794, + 0.5080911895493045, + 2.8969066478312016 + ], + "unique_experts": 63, + "load_cv": 0.6677856876898225, + "normalized_load_entropy": 0.9477546370003656, + "max_load_share": 0.05400696864111498 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 246, + "ordered_topk_exact_tokens": 141, + "set_exact_tokens": 160, + "mean_set_jaccard": 0.8933410762679054, + "mean_token_weighted_tv": 0.018886951851017353, + "aggregate_load_tv": 0.03048780487804878 + }, + "system_bos": { + "tokens": 246, + "ordered_topk_exact_tokens": 128, + "set_exact_tokens": 164, + "mean_set_jaccard": 0.893631436314363, + "mean_token_weighted_tv": 0.021647603002932784, + "aggregate_load_tv": 0.02913279132791328 + }, + "system_x": { + "tokens": 246, + "ordered_topk_exact_tokens": 100, + "set_exact_tokens": 132, + "mean_set_jaccard": 0.8525182134938232, + "mean_token_weighted_tv": 0.03272583607876615, + "aggregate_load_tv": 0.031165311653116527 + }, + "system_period": { + "tokens": 246, + "ordered_topk_exact_tokens": 106, + "set_exact_tokens": 140, + "mean_set_jaccard": 0.8553074296976736, + "mean_token_weighted_tv": 0.03356199295865003, + "aggregate_load_tv": 0.03523035230352304 + }, + "bos_at_s0": { + "tokens": 246, + "ordered_topk_exact_tokens": 124, + "set_exact_tokens": 160, + "mean_set_jaccard": 0.8869531552458382, + "mean_token_weighted_tv": 0.02327021851306199, + "aggregate_load_tv": 0.03184281842818429 + }, + "bos_at_s1": { + "tokens": 246, + "ordered_topk_exact_tokens": 119, + "set_exact_tokens": 153, + "mean_set_jaccard": 0.8825977545489739, + "mean_token_weighted_tv": 0.024073454529297295, + "aggregate_load_tv": 0.02913279132791328 + }, + "x_at_s0": { + "tokens": 246, + "ordered_topk_exact_tokens": 111, + "set_exact_tokens": 146, + "mean_set_jaccard": 0.8660472319008904, + "mean_token_weighted_tv": 0.027602073125752035, + "aggregate_load_tv": 0.03455284552845529 + }, + "x_at_s1": { + "tokens": 246, + "ordered_topk_exact_tokens": 82, + "set_exact_tokens": 123, + "mean_set_jaccard": 0.8349206349206348, + "mean_token_weighted_tv": 0.037197881061379896, + "aggregate_load_tv": 0.030487804878048776 + }, + "period_at_s0": { + "tokens": 246, + "ordered_topk_exact_tokens": 112, + "set_exact_tokens": 143, + "mean_set_jaccard": 0.8616337591947346, + "mean_token_weighted_tv": 0.02677811295811031, + "aggregate_load_tv": 0.036585365853658534 + }, + "period_at_s1": { + "tokens": 246, + "ordered_topk_exact_tokens": 94, + "set_exact_tokens": 127, + "mean_set_jaccard": 0.8407665505226479, + "mean_token_weighted_tv": 0.036412175695668486, + "aggregate_load_tv": 0.03184281842818429 + } + } + }, + "layer_25": { + "layer": 25, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "5e1fdb4300bcd32086eaa4bf3c4de8616584dba0d69e5bb1a65c65226a7ea40a", + "route_weight_sha256": "c4b5297e58469bd9f69787d5d0477d36f5c16eec4cbd1999e541ed658d41f212", + "loads": [ + 10, + 12, + 36, + 29, + 14, + 24, + 33, + 59, + 22, + 44, + 8, + 5, + 16, + 6, + 36, + 10, + 24, + 28, + 25, + 10, + 43, + 13, + 18, + 18, + 25, + 27, + 5, + 19, + 17, + 4, + 147, + 26, + 21, + 8, + 4, + 26, + 14, + 19, + 26, + 14, + 37, + 33, + 16, + 12, + 12, + 8, + 12, + 26, + 24, + 14, + 25, + 41, + 33, + 34, + 13, + 23, + 13, + 43, + 12, + 11, + 22, + 20, + 22, + 25 + ], + "weighted_loads": [ + 0.336357893422246, + 0.8828914947807789, + 1.3573516067117453, + 2.9533162154257298, + 0.8031849656254053, + 1.6454570274800062, + 3.439274000003934, + 6.226934285834432, + 0.8896244559437037, + 1.8233592752367258, + 0.3394906334578991, + 0.16217543184757233, + 0.7532624211162329, + 0.3056825175881386, + 3.4610586185008287, + 0.4462107326835394, + 1.7577219996601343, + 1.718144627287984, + 1.124746410176158, + 0.5788642149418592, + 2.6635466907173395, + 0.46582312881946564, + 0.7696394454687834, + 0.8464256133884192, + 1.4085443653166294, + 2.1357703302055597, + 0.16457814909517765, + 1.2331708334386349, + 0.6917427983134985, + 0.148347370326519, + 10.797358326613903, + 2.2961930986493826, + 0.870144808664918, + 0.36572600714862347, + 0.16217223554849625, + 2.1129485573619604, + 0.8416891489177942, + 0.8149161972105503, + 4.893176030367613, + 2.5585505217313766, + 1.7128690890967846, + 1.8340027816593647, + 1.2883058357983828, + 0.5280624888837337, + 0.8479092754423618, + 0.4842224959284067, + 0.43714829720556736, + 2.0740770027041435, + 1.4265446159988642, + 0.5630032327026129, + 1.2914567310363054, + 2.214650122448802, + 3.864549580961466, + 1.91085484623909, + 0.7819892037659883, + 1.0630530342459679, + 0.49620193615555763, + 1.4731883462518454, + 0.5623849965631962, + 0.5174621529877186, + 1.219703672453761, + 1.1478273570537567, + 2.731168879196048, + 2.0417584124952555 + ], + "unique_experts": 64, + "load_cv": 0.8356336814078055, + "normalized_load_entropy": 0.9438673544801081, + "max_load_share": 0.09959349593495935 + }, + "full_input": { + "tokens": 271, + "top_k": 6, + "decisions": 1626, + "ordered_route_sha256": "236dd809728f49524c97f899aaa4f9ae5c3e47fc8cc8240e25622d9dc2019c99", + "route_weight_sha256": "62e3eb719753d1e8389447fd6f5424cd9bfb1d8df761630df65e0b164c053c2a", + "loads": [ + 12, + 31, + 41, + 31, + 14, + 24, + 39, + 60, + 23, + 44, + 18, + 9, + 18, + 7, + 36, + 10, + 24, + 33, + 26, + 10, + 43, + 13, + 18, + 21, + 25, + 27, + 5, + 19, + 18, + 5, + 149, + 27, + 23, + 9, + 6, + 26, + 14, + 21, + 37, + 17, + 44, + 33, + 16, + 12, + 17, + 18, + 15, + 26, + 24, + 15, + 35, + 41, + 37, + 34, + 21, + 23, + 14, + 46, + 12, + 11, + 25, + 20, + 28, + 26 + ], + "weighted_loads": [ + 0.4440068434923887, + 2.3228777453769, + 1.8164203967899084, + 3.071873899549246, + 0.8031849656254053, + 1.6454570274800062, + 3.8471956346184015, + 6.275193901732564, + 0.9226466622203588, + 1.8233592752367258, + 1.2049358300864697, + 0.8384260386228561, + 0.9028579387813807, + 0.35328004509210587, + 3.4610586185008287, + 0.4462107326835394, + 1.7577219996601343, + 1.8844851087778807, + 1.150943323969841, + 0.5788642149418592, + 2.6635466907173395, + 0.46582312881946564, + 0.7696394454687834, + 0.9765097592025995, + 1.4085443653166294, + 2.1357703302055597, + 0.16457814909517765, + 1.2331708334386349, + 0.7349536474794149, + 0.18358762189745903, + 10.874252004548907, + 2.3855277728289366, + 0.9761067312210798, + 0.42571057938039303, + 0.25734781101346016, + 2.1129485573619604, + 0.8416891489177942, + 0.9289307817816734, + 6.351721102371812, + 2.8975016959011555, + 2.00712251290679, + 1.8340027816593647, + 1.2883058357983828, + 0.5280624888837337, + 1.2516505122184753, + 1.2829819284379482, + 0.526876688352786, + 2.0740770027041435, + 1.4265446159988642, + 0.5999604780226946, + 1.8818111289292574, + 2.214650122448802, + 4.094953738618642, + 1.91085484623909, + 1.1686659345868975, + 1.0630530342459679, + 0.5398401841521263, + 1.614033391699195, + 0.5623849965631962, + 0.5174621529877186, + 1.3521488029509783, + 1.1478273570537567, + 3.174065848812461, + 2.0877337735146284 + ], + "unique_experts": 64, + "load_cv": 0.7627097896095806, + "normalized_load_entropy": 0.951840902180675, + "max_load_share": 0.09163591635916359 + } + }, + "s1_eos": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "5a6dd4f99fd86df055126e3463ccc305288da222b5fecffbbcd9b4639da0e422", + "route_weight_sha256": "3d2f6308c65eb6565504067985da72c17396dbe5b7ee120f2808295b819298cf", + "loads": [ + 9, + 12, + 31, + 28, + 13, + 26, + 32, + 58, + 22, + 45, + 11, + 5, + 15, + 7, + 35, + 11, + 23, + 29, + 25, + 9, + 44, + 13, + 18, + 18, + 24, + 27, + 5, + 23, + 17, + 4, + 147, + 26, + 24, + 10, + 5, + 26, + 13, + 19, + 26, + 14, + 37, + 32, + 16, + 12, + 12, + 8, + 15, + 25, + 22, + 14, + 25, + 39, + 32, + 37, + 12, + 25, + 14, + 42, + 12, + 9, + 20, + 20, + 24, + 23 + ], + "weighted_loads": [ + 0.3106659837067127, + 0.8866732958704233, + 1.1698011867702007, + 2.8768673595041037, + 0.801615484058857, + 1.6905877944082022, + 3.399566663429141, + 6.326127948239446, + 0.9404507745057344, + 1.8432113993912935, + 0.4360696841031313, + 0.1976119540631771, + 0.7098972219973803, + 0.34038228914141655, + 3.429480981081724, + 0.47023904137313366, + 1.7213484328240156, + 1.7210397329181433, + 1.121511772274971, + 0.5562764722853899, + 2.741809042170644, + 0.4445334691554308, + 0.7752581369131804, + 0.8028726186603308, + 1.3881041929125786, + 2.2898860163986683, + 0.16553553007543087, + 1.3664710149168968, + 0.6898641530424356, + 0.1489125695079565, + 10.738706935197115, + 2.2899875324219465, + 0.9135487228631973, + 0.43134566210210323, + 0.14717332273721695, + 2.108973268419504, + 0.8241213168948889, + 0.8110638819634914, + 4.883718863129616, + 2.521059213206172, + 1.6676172353327274, + 1.7606879640370607, + 1.2815240435302258, + 0.5366998203098774, + 0.8468335028737783, + 0.4830449093133211, + 0.524594571441412, + 2.004460070282221, + 1.4200290739536285, + 0.5991680230945349, + 1.307683240622282, + 2.1425885800272226, + 3.8293825443834066, + 2.041058622300625, + 0.7544942740350962, + 1.1302951350808144, + 0.5482359789311886, + 1.4718869663774967, + 0.5505836233496666, + 0.4762881062924862, + 1.1502423696219921, + 1.1586936134845018, + 2.6166657358407974, + 1.6256416961550713 + ], + "unique_experts": 64, + "load_cv": 0.8295295123233557, + "normalized_load_entropy": 0.9452579074361008, + "max_load_share": 0.09959349593495935 + }, + "full_input": { + "tokens": 287, + "top_k": 6, + "decisions": 1722, + "ordered_route_sha256": "d4d9a57ffc2e1c617eeb38267656188a7a0671d828e00df7d6e2e8f376535925", + "route_weight_sha256": "28b6c910334b46bcb18d790b1dd7514b5c72ee5fec25df8d6181818b9d65313e", + "loads": [ + 12, + 37, + 40, + 30, + 13, + 27, + 39, + 59, + 24, + 46, + 32, + 8, + 21, + 8, + 35, + 11, + 23, + 37, + 26, + 10, + 47, + 21, + 18, + 24, + 24, + 27, + 6, + 23, + 18, + 7, + 148, + 29, + 30, + 11, + 7, + 26, + 14, + 26, + 35, + 19, + 45, + 32, + 17, + 13, + 21, + 22, + 17, + 26, + 22, + 15, + 37, + 39, + 39, + 44, + 24, + 26, + 17, + 48, + 12, + 10, + 24, + 21, + 29, + 24 + ], + "weighted_loads": [ + 0.5793832279741764, + 2.887469967128709, + 1.7724920846521854, + 3.018126590177417, + 0.801615484058857, + 1.7317537534981966, + 3.9960521031171083, + 6.3635173086076975, + 1.0555329713970423, + 1.8712502066046, + 2.2956507820636034, + 0.8581641968339682, + 1.0400708001106977, + 0.39490941539406776, + 3.429480981081724, + 0.47023904137313366, + 1.7213484328240156, + 2.3697318341583014, + 1.1737827993929386, + 0.5803199373185635, + 2.9961857963353395, + 1.1421904060989618, + 0.7752581369131804, + 1.035247242078185, + 1.3881041929125786, + 2.2898860163986683, + 0.19883991591632366, + 1.3664710149168968, + 0.7358381990343332, + 0.25496908463537693, + 10.782298248261213, + 2.7575207706540823, + 1.1982197985053062, + 0.4780257288366556, + 0.24193044751882553, + 2.108973268419504, + 0.865878788754344, + 1.1328664757311344, + 6.5321825332939625, + 2.9784957263618708, + 2.0729914903640747, + 1.7606879640370607, + 1.3678579740226269, + 0.5665284804999828, + 1.538196450099349, + 1.7305941358208656, + 0.568483880488202, + 2.029871292412281, + 1.4200290739536285, + 0.6442689206451178, + 2.02406239323318, + 2.1425885800272226, + 4.2681222395040095, + 2.548475056886673, + 1.5263589622918516, + 1.1567888911813498, + 0.6852003205567598, + 1.732038352638483, + 0.5505836233496666, + 0.5662682540714741, + 1.3932888358831406, + 1.2036377806216478, + 3.0353373866528273, + 1.6806873008608818 + ], + "unique_experts": 64, + "load_cv": 0.7137472829711184, + "normalized_load_entropy": 0.956423342506068, + "max_load_share": 0.0859465737514518 + } + }, + "s0_bos": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "04cef37f3c8dfb3a25c19a77e07056f2ae542626f9a162d182e5271f48f5a8d5", + "route_weight_sha256": "901dc1e2b8c2b3afa06e4a555fa79a5260d316a67ba44cd5f78fd1090b48e41e", + "loads": [ + 9, + 13, + 35, + 28, + 13, + 27, + 32, + 61, + 18, + 45, + 8, + 5, + 16, + 6, + 37, + 10, + 23, + 31, + 24, + 9, + 43, + 14, + 14, + 20, + 23, + 26, + 5, + 21, + 15, + 4, + 143, + 26, + 26, + 9, + 4, + 26, + 13, + 18, + 29, + 14, + 42, + 33, + 17, + 12, + 13, + 8, + 14, + 27, + 22, + 13, + 27, + 39, + 33, + 37, + 12, + 24, + 10, + 37, + 15, + 11, + 21, + 20, + 22, + 24 + ], + "weighted_loads": [ + 0.31606494449079037, + 0.9174617324024439, + 1.360061513260007, + 2.9529242776334286, + 0.8041619025170803, + 1.7598800081759691, + 3.457053629681468, + 6.292602302506566, + 0.8124521356076002, + 1.8444703463464975, + 0.3522007893770933, + 0.18960301019251347, + 0.7814344465732574, + 0.2944342829287052, + 3.536000967025757, + 0.4368638973683119, + 1.7164725586771965, + 1.7855892665684223, + 1.1301052775233984, + 0.5688369628041983, + 2.7126066889613867, + 0.4963334687054157, + 0.6457744687795639, + 0.9089848641306162, + 1.361006522551179, + 2.0290243811905384, + 0.15881969965994358, + 1.303830910474062, + 0.6166632026433945, + 0.1477580927312374, + 10.744904408231378, + 2.422699885442853, + 0.9962835926562548, + 0.367214810103178, + 0.13723689317703247, + 2.1238533835858107, + 0.8103733267635107, + 0.7436596639454365, + 4.917272424325347, + 2.560740811750293, + 1.934816725552082, + 1.90545673109591, + 1.3141429107636213, + 0.5099111516028643, + 0.8700523115694523, + 0.4827105086296797, + 0.5150060467422009, + 2.142699273303151, + 1.4489810597151518, + 0.5321719814091921, + 1.3582676611840725, + 2.159036697819829, + 3.9396090153604746, + 2.027434501796961, + 0.6922663059085608, + 1.0850830283015966, + 0.41742983646690845, + 1.2878515552729368, + 0.6673690229654312, + 0.4676981382071972, + 1.209962846711278, + 1.160501191392541, + 2.6446458101272583, + 2.196764711290598 + ], + "unique_experts": 64, + "load_cv": 0.8238794388614865, + "normalized_load_entropy": 0.9440960904865113, + "max_load_share": 0.09688346883468835 + }, + "full_input": { + "tokens": 271, + "top_k": 6, + "decisions": 1626, + "ordered_route_sha256": "5b1d3f534f4297aa132b607ee618054de953d794dfdeacc6640f6118a4d778b4", + "route_weight_sha256": "34ca6a363ad73a15db16071adae8cb840333875a2084746c1e85208f2af89c34", + "loads": [ + 10, + 31, + 41, + 30, + 13, + 27, + 38, + 63, + 19, + 45, + 18, + 7, + 20, + 7, + 37, + 10, + 23, + 36, + 25, + 9, + 43, + 14, + 14, + 23, + 23, + 26, + 5, + 21, + 16, + 4, + 145, + 27, + 28, + 10, + 6, + 26, + 14, + 19, + 39, + 16, + 49, + 34, + 17, + 14, + 18, + 17, + 17, + 27, + 22, + 15, + 37, + 39, + 36, + 37, + 21, + 24, + 10, + 41, + 15, + 11, + 23, + 20, + 28, + 26 + ], + "weighted_loads": [ + 0.36882405169308186, + 2.3082221869844943, + 1.8395617585629225, + 3.144405744969845, + 0.8041619025170803, + 1.7598800081759691, + 3.8649752642959356, + 6.387365994974971, + 0.8454743418842554, + 1.8444703463464975, + 1.2783191818743944, + 0.8032023403793573, + 1.002074260264635, + 0.3385397456586361, + 3.536000967025757, + 0.4368638973683119, + 1.7164725586771965, + 1.951929748058319, + 1.1563021913170815, + 0.5688369628041983, + 2.7126066889613867, + 0.4963334687054157, + 0.6457744687795639, + 1.034957965835929, + 1.361006522551179, + 2.0290243811905384, + 0.15881969965994358, + 1.303830910474062, + 0.6598740518093109, + 0.1477580927312374, + 11.035700345411897, + 2.512034559622407, + 1.1061532106250525, + 0.4271993823349476, + 0.24774762988090515, + 2.1238533835858107, + 0.8697867784649134, + 0.8048346601426601, + 5.465828318148851, + 2.982349378988147, + 2.2290701493620872, + 1.9550946559756994, + 1.3141429107636213, + 0.579064691439271, + 1.269954752177, + 1.2467135582119226, + 0.6597809419035912, + 2.142699273303151, + 1.4489810597151518, + 0.6153844725340605, + 1.9486220590770245, + 2.159036697819829, + 4.1658460553735495, + 2.027434501796961, + 1.1313149074558169, + 1.0850830283015966, + 0.41742983646690845, + 1.4501565340906382, + 0.6673690229654312, + 0.4676981382071972, + 1.296529682353139, + 1.160501191392541, + 3.0875427797436714, + 2.2749234959483147 + ], + "unique_experts": 64, + "load_cv": 0.7577105394197828, + "normalized_load_entropy": 0.9509096712563463, + "max_load_share": 0.08917589175891759 + } + }, + "s1_bos": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "7a7b87170a013486bfaf47c5f79db8f6c4a8ea1b0ffcb36dab5799323fdb72b4", + "route_weight_sha256": "be3fed2789689b9c5508b669c3615fd08086c986040fb9f217c2f05a5661ce36", + "loads": [ + 11, + 13, + 31, + 28, + 13, + 29, + 32, + 59, + 20, + 40, + 11, + 5, + 15, + 6, + 37, + 11, + 25, + 31, + 22, + 11, + 43, + 16, + 17, + 18, + 24, + 29, + 6, + 23, + 13, + 4, + 145, + 26, + 24, + 6, + 5, + 26, + 13, + 19, + 28, + 16, + 36, + 32, + 15, + 11, + 12, + 8, + 16, + 27, + 21, + 14, + 27, + 37, + 32, + 37, + 14, + 26, + 14, + 38, + 14, + 9, + 21, + 20, + 21, + 23 + ], + "weighted_loads": [ + 0.39298935420811176, + 0.9310991447418928, + 1.232951881363988, + 2.9049831572920084, + 0.7715758513659239, + 1.777924733236432, + 3.4452779684215784, + 6.211190165951848, + 0.8360022436827421, + 1.6695718951523304, + 0.46155453473329544, + 0.18834882229566574, + 0.7382360715419054, + 0.29673558846116066, + 3.4690097849816084, + 0.4672178793698549, + 1.7843608744442463, + 1.8003101460635662, + 1.0590333379805088, + 0.5942073557525873, + 2.7555462568998337, + 0.5603339001536369, + 0.7352148424834013, + 0.8607027530670166, + 1.3965925611555576, + 2.3068979270756245, + 0.18467384204268456, + 1.3940197005867958, + 0.541728189215064, + 0.1516728401184082, + 10.7736851349473, + 2.3988194316625595, + 0.9331350587308407, + 0.28247322887182236, + 0.16712776571512222, + 2.1164189223200083, + 0.7947547268122435, + 0.827929899096489, + 4.855917040258646, + 2.5811789240688086, + 1.678637057542801, + 1.894877741113305, + 1.2668129578232765, + 0.47425619699060917, + 0.8170640096068382, + 0.48576578311622143, + 0.5706788301467896, + 2.1211635656654835, + 1.4014813099056482, + 0.5425514001399279, + 1.3557659890502691, + 2.080510251224041, + 3.8358891028910875, + 2.0794656611979008, + 0.7922020442783833, + 1.1826391331851482, + 0.5168610028922558, + 1.3145445436239243, + 0.6135253962129354, + 0.3976016156375408, + 1.199529280886054, + 1.1802984271198511, + 2.7592305094003677, + 2.087578948587179 + ], + "unique_experts": 64, + "load_cv": 0.815781178633142, + "normalized_load_entropy": 0.9466173064725296, + "max_load_share": 0.09823848238482384 + }, + "full_input": { + "tokens": 287, + "top_k": 6, + "decisions": 1722, + "ordered_route_sha256": "46b7cff5724e8aef4b929fd34402279a0837524b14347aba0d78afc3adca51d7", + "route_weight_sha256": "e5ddfd0ac190f6e6691a2f27352efd6feca4128bde4127911f7de86d8c57e7ed", + "loads": [ + 14, + 38, + 41, + 29, + 13, + 30, + 39, + 60, + 24, + 41, + 33, + 7, + 22, + 7, + 37, + 11, + 25, + 39, + 23, + 12, + 46, + 23, + 17, + 24, + 24, + 29, + 7, + 23, + 14, + 6, + 146, + 29, + 31, + 7, + 7, + 26, + 14, + 26, + 36, + 20, + 44, + 32, + 16, + 12, + 21, + 22, + 18, + 28, + 21, + 16, + 39, + 37, + 38, + 44, + 26, + 27, + 17, + 44, + 14, + 10, + 24, + 21, + 26, + 25 + ], + "weighted_loads": [ + 0.6410866100341082, + 2.8737676714081317, + 1.9198199603706598, + 2.980447569862008, + 0.7715758513659239, + 1.8190906923264265, + 4.041763408109546, + 6.258479239419103, + 1.039405444636941, + 1.6976107023656368, + 2.426991730928421, + 0.8401845768094063, + 1.1230717599391937, + 0.3512842394411564, + 3.4690097849816084, + 0.4672178793698549, + 1.7843608744442463, + 2.4490022473037243, + 1.1113043650984764, + 0.6182508207857609, + 3.0099230110645294, + 1.1956395767629147, + 0.7352148424834013, + 1.0910735595971346, + 1.3965925611555576, + 2.3068979270756245, + 0.21797822788357735, + 1.3940197005867958, + 0.5877022352069616, + 0.22123439237475395, + 10.81782803311944, + 2.8663526698946953, + 1.26619229093194, + 0.32915329560637474, + 0.2659848667681217, + 2.1164189223200083, + 0.8365121986716986, + 1.1555407717823982, + 5.603117652237415, + 3.0278167258948088, + 2.084011312574148, + 1.894877741113305, + 1.3531468883156776, + 0.5040848571807146, + 1.5053608380258083, + 1.6973341908305883, + 0.667107317596674, + 2.1465747877955437, + 1.4014813099056482, + 0.6341572385281324, + 2.072145141661167, + 2.080510251224041, + 4.27046268992126, + 2.586882095783949, + 1.5640667325351387, + 1.2091328892856836, + 0.6686807256191969, + 1.5963766612112522, + 0.6135253962129354, + 0.4875817634165287, + 1.3801599349826574, + 1.225242594256997, + 3.1779021602123976, + 2.182142674922943 + ], + "unique_experts": 64, + "load_cv": 0.7054437009669068, + "normalized_load_entropy": 0.9566632034355582, + "max_load_share": 0.08478513356562137 + } + }, + "s0_x": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "29418f2286adbffffd484dc3cc92f49b1bde91a12e0ffb41f2ac6521dd3abfbd", + "route_weight_sha256": "467ac61f84453a2d41da1a5bfc55a7e3f2c45c1347a48a631796fa070605a33e", + "loads": [ + 10, + 13, + 35, + 30, + 14, + 26, + 30, + 57, + 20, + 48, + 10, + 5, + 15, + 7, + 37, + 5, + 25, + 31, + 25, + 8, + 43, + 14, + 16, + 19, + 23, + 27, + 4, + 22, + 17, + 4, + 145, + 28, + 21, + 9, + 5, + 27, + 15, + 17, + 28, + 15, + 40, + 29, + 16, + 11, + 12, + 8, + 14, + 26, + 23, + 14, + 27, + 39, + 32, + 36, + 13, + 25, + 11, + 41, + 14, + 11, + 22, + 18, + 20, + 24 + ], + "weighted_loads": [ + 0.3470560982823372, + 0.9441857375204563, + 1.2939123958349228, + 2.8880660161376, + 0.861108185723424, + 1.6970522738993168, + 3.454009562730789, + 6.097078803926706, + 0.8607845213264227, + 1.97473856061697, + 0.4215958695858717, + 0.19523977115750313, + 0.6964504290372133, + 0.32928142324090004, + 3.5191212333738804, + 0.2646230645477772, + 1.780890816822648, + 1.7830151412636042, + 1.1614881698042154, + 0.5675249025225639, + 2.6284275632351637, + 0.4924985785037279, + 0.6871680710464716, + 0.8522102534770966, + 1.3663910254836082, + 2.2619985723868012, + 0.11507729068398476, + 1.3417008444666862, + 0.6982134152203798, + 0.15230931714177132, + 10.795233504846692, + 2.555634731426835, + 0.8085830453783274, + 0.37965346686542034, + 0.13446582108736038, + 2.143443640321493, + 0.8902387991547585, + 0.7215357664972544, + 4.853056566789746, + 2.4593069795519114, + 1.9229117967188358, + 1.6778735518455505, + 1.296152289956808, + 0.47175473161041737, + 0.8483713995665312, + 0.48721904680132866, + 0.5093415509909391, + 1.956461038440466, + 1.454151850193739, + 0.5862260926514864, + 1.309863205999136, + 2.1445335298776627, + 3.9434014540165663, + 1.968245379626751, + 0.7281134482473135, + 1.1544035412371159, + 0.43393235839903355, + 1.4282292984426022, + 0.6170193664729595, + 0.46298065036535263, + 1.1975668426603079, + 1.0831180103123188, + 2.514312442392111, + 1.8931688759475946 + ], + "unique_experts": 64, + "load_cv": 0.8285727816483213, + "normalized_load_entropy": 0.9439047551148383, + "max_load_share": 0.09823848238482384 + }, + "full_input": { + "tokens": 271, + "top_k": 6, + "decisions": 1626, + "ordered_route_sha256": "0287f6ff9ce78bccf70b6046c651af296ea9d8410e54441982b23420fe492392", + "route_weight_sha256": "cc24168e439470f265a366355f31f5610a366590839109fa45272ad368fa14e1", + "loads": [ + 12, + 33, + 39, + 31, + 14, + 26, + 38, + 58, + 21, + 48, + 20, + 8, + 17, + 8, + 37, + 5, + 25, + 36, + 27, + 8, + 43, + 14, + 16, + 22, + 23, + 27, + 4, + 22, + 18, + 5, + 147, + 30, + 23, + 10, + 6, + 27, + 16, + 18, + 39, + 17, + 48, + 29, + 16, + 11, + 17, + 16, + 17, + 26, + 24, + 14, + 37, + 39, + 36, + 36, + 22, + 25, + 11, + 45, + 14, + 11, + 24, + 18, + 27, + 25 + ], + "weighted_loads": [ + 0.43609463796019554, + 2.4856804602313787, + 1.6357801146805286, + 2.9223536886274815, + 0.861108185723424, + 1.6970522738993168, + 3.984083481132984, + 6.13735293596983, + 0.8938067276030779, + 1.97473856061697, + 1.3167956937104464, + 0.8709249161183834, + 0.8409568425267935, + 0.3754302188754082, + 3.5191212333738804, + 0.2646230645477772, + 1.780890816822648, + 1.949355622753501, + 1.2156582605093718, + 0.5675249025225639, + 2.6284275632351637, + 0.4924985785037279, + 0.6871680710464716, + 0.9778223223984241, + 1.3663910254836082, + 2.2619985723868012, + 0.11507729068398476, + 1.3417008444666862, + 0.7414242643862963, + 0.18361541256308556, + 10.872124830260873, + 2.739319736137986, + 0.9188547562807798, + 0.4396380390971899, + 0.18097760155797005, + 2.143443640321493, + 0.95405063778162, + 0.7976997140794992, + 5.518705487251282, + 2.864990198984742, + 2.267065767198801, + 1.6778735518455505, + 1.296152289956808, + 0.47175473161041737, + 1.2488975506275892, + 1.2350705116987228, + 0.6504043433815241, + 1.956461038440466, + 1.4951447658240795, + 0.5862260926514864, + 1.900217603892088, + 2.1445335298776627, + 4.282135063782334, + 1.968245379626751, + 1.18622986250557, + 1.1544035412371159, + 0.43393235839903355, + 1.5845241323113441, + 0.6170193664729595, + 0.46298065036535263, + 1.2841336783021688, + 1.0831180103123188, + 2.9961639046669006, + 1.9414513651281595 + ], + "unique_experts": 64, + "load_cv": 0.7630271036136239, + "normalized_load_entropy": 0.9503203490014531, + "max_load_share": 0.09040590405904059 + } + }, + "s1_x": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "6818195292bd93690227cbfe98a16e0386fe6f87fbe73f77887dfb89b5926ee1", + "route_weight_sha256": "3b8823454d1d6ddb24dc895af5209fa3a74312a8ab9a5ae421b739c84ef18f66", + "loads": [ + 10, + 12, + 34, + 29, + 14, + 27, + 33, + 58, + 21, + 44, + 12, + 4, + 16, + 7, + 36, + 13, + 23, + 30, + 26, + 8, + 44, + 12, + 17, + 18, + 23, + 28, + 3, + 22, + 16, + 4, + 146, + 27, + 23, + 8, + 4, + 26, + 9, + 17, + 28, + 16, + 37, + 32, + 15, + 13, + 12, + 8, + 14, + 27, + 21, + 16, + 27, + 39, + 33, + 37, + 9, + 26, + 13, + 41, + 13, + 10, + 23, + 19, + 22, + 21 + ], + "weighted_loads": [ + 0.3624797333031893, + 0.9067273866385221, + 1.2641031630337238, + 2.8920147456228733, + 0.7976245246827602, + 1.7266517840325832, + 3.488150678575039, + 6.054397517815232, + 1.052528541535139, + 1.811620930209756, + 0.5299852155148983, + 0.16446416825056076, + 0.7369373664259911, + 0.31163410656154156, + 3.4485485926270485, + 0.5901889055967331, + 1.7085601091384888, + 1.7784532364457846, + 1.1864490788429976, + 0.5379761960357428, + 2.7696881107985973, + 0.4647185280919075, + 0.7397445477545261, + 0.8285667821764946, + 1.3641618564724922, + 2.0972267612814903, + 0.09167375788092613, + 1.3603301122784615, + 0.6119088008999825, + 0.14798185601830482, + 10.852594211697578, + 2.4177301060408354, + 0.8927448354661465, + 0.3520669937133789, + 0.1112674605101347, + 2.1148653384298086, + 0.6252452619373798, + 0.7504810709506273, + 4.8487425446510315, + 2.452648237347603, + 1.7132416050881147, + 1.8262853119522333, + 1.2751751951873302, + 0.5668550617992878, + 0.8008432239294052, + 0.4913476128131151, + 0.5150127522647381, + 2.0359187591820955, + 1.34543064981699, + 0.7278935071080923, + 1.3254077304154634, + 2.123744308948517, + 3.9057690892368555, + 2.061042632907629, + 0.5624545644968748, + 1.1975902933627367, + 0.4967069774866104, + 1.423620443791151, + 0.5805143192410469, + 0.4250024501234293, + 1.2609353139996529, + 1.1363707911223173, + 2.380307212471962, + 1.6881607044488192 + ], + "unique_experts": 64, + "load_cv": 0.8323225191271957, + "normalized_load_entropy": 0.9433626969354696, + "max_load_share": 0.0989159891598916 + }, + "full_input": { + "tokens": 287, + "top_k": 6, + "decisions": 1722, + "ordered_route_sha256": "f678acf7b6bfec59083da29ae0d063967ec1687ecf05b59f1b5047001a8c691f", + "route_weight_sha256": "30a9208fcb726ad049885d87087da25b4fcee809961c1758a70c3b1014303665", + "loads": [ + 12, + 38, + 44, + 29, + 14, + 28, + 42, + 59, + 23, + 45, + 34, + 7, + 20, + 7, + 36, + 13, + 23, + 39, + 27, + 9, + 47, + 20, + 17, + 25, + 23, + 28, + 4, + 22, + 17, + 6, + 147, + 31, + 29, + 9, + 6, + 26, + 10, + 23, + 37, + 20, + 45, + 32, + 16, + 14, + 22, + 21, + 15, + 28, + 21, + 17, + 41, + 39, + 41, + 44, + 22, + 27, + 14, + 47, + 13, + 11, + 27, + 20, + 27, + 22 + ], + "weighted_loads": [ + 0.5599764827638865, + 2.9325328276026994, + 1.8408552408218384, + 2.8920147456228733, + 0.7976245246827602, + 1.7678177431225777, + 4.276318456977606, + 6.091533245518804, + 1.167610738426447, + 1.8396597374230623, + 2.4479449167847633, + 0.8870476260781288, + 0.9921387620270252, + 0.31163410656154156, + 3.4485485926270485, + 0.5901889055967331, + 1.7085601091384888, + 2.473196716979146, + 1.2387201059609652, + 0.5620196610689163, + 3.024064864963293, + 1.1467468366026878, + 0.7397445477545261, + 1.0969878174364567, + 1.3641618564724922, + 2.0972267612814903, + 0.12497814372181892, + 1.3603301122784615, + 0.65788284689188, + 0.21754340827465057, + 10.899375051259995, + 2.996406054124236, + 1.1749698519706726, + 0.3987470604479313, + 0.20575732178986073, + 2.1148653384298086, + 0.667002733796835, + 1.0170651283115149, + 5.661643203347921, + 2.895462028682232, + 2.118615860119462, + 1.8262853119522333, + 1.3615091256797314, + 0.5966837219893932, + 1.5170072745531797, + 1.6976043563336134, + 0.5575758442282677, + 2.0613299813121557, + 1.34543064981699, + 0.7602094877511263, + 2.1835899092257023, + 2.123744308948517, + 4.50355657748878, + 2.568459067493677, + 1.4126158768776804, + 1.224084049463272, + 0.5270250421017408, + 1.6908749863505363, + 0.5805143192410469, + 0.5149825979024172, + 1.5019418261945248, + 1.1813149582594633, + 2.798978863283992, + 1.7488409113138914 + ], + "unique_experts": 64, + "load_cv": 0.7240152066645005, + "normalized_load_entropy": 0.9536406739428498, + "max_load_share": 0.08536585365853659 + } + }, + "s0_period": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "ce50b99ff4ff831ff4772743e85bff7f4e06dbd3a1ede95c253bc1354ff15270", + "route_weight_sha256": "7d8cb64aa0317e6ea90439481ead066a95ea5f1eda1501260d4795a5c6b32fee", + "loads": [ + 11, + 12, + 34, + 30, + 14, + 27, + 32, + 58, + 19, + 49, + 12, + 5, + 16, + 6, + 38, + 7, + 24, + 31, + 23, + 7, + 43, + 14, + 16, + 18, + 22, + 27, + 5, + 22, + 17, + 4, + 144, + 28, + 21, + 10, + 4, + 26, + 13, + 17, + 28, + 16, + 41, + 28, + 16, + 10, + 12, + 8, + 16, + 26, + 23, + 15, + 27, + 40, + 32, + 36, + 11, + 24, + 12, + 42, + 13, + 10, + 22, + 19, + 21, + 22 + ], + "weighted_loads": [ + 0.392942413687706, + 0.913869583979249, + 1.272654166445136, + 2.948751386255026, + 0.8348695375025272, + 1.7312762700021267, + 3.5082662999629974, + 6.1607847679406404, + 0.7965273261070251, + 1.980475815013051, + 0.4901837669312954, + 0.1935751996934414, + 0.7339714635163546, + 0.29194778949022293, + 3.5999823566526175, + 0.3268523681908846, + 1.7568311672657728, + 1.8371037691831589, + 1.0983387138694525, + 0.5298300758004189, + 2.6688550394028425, + 0.501490069553256, + 0.6847713459283113, + 0.819812685251236, + 1.3141408134251833, + 2.240684462711215, + 0.15052049048244953, + 1.3531707748770714, + 0.6699200849980116, + 0.15250557661056519, + 10.724015792831779, + 2.5268200263381004, + 0.8135034926235676, + 0.3985768835991621, + 0.13667752593755722, + 2.115429548546672, + 0.8217477202415466, + 0.7345379218459129, + 4.810911614447832, + 2.551690313965082, + 1.9472394231706858, + 1.679609451442957, + 1.3132004961371422, + 0.46853987872600555, + 0.8544435948133469, + 0.49487148597836494, + 0.5566122513264418, + 2.0137495175004005, + 1.4243564791977406, + 0.6045777909457684, + 1.326376210898161, + 2.1758716627955437, + 3.9031994715332985, + 1.9761946965008974, + 0.6321117803454399, + 1.0985946748405695, + 0.48559656366705894, + 1.4466632790863514, + 0.5880155991762877, + 0.44904930889606476, + 1.2221593167632818, + 1.124092884361744, + 2.5752026978880167, + 1.9773830492049456 + ], + "unique_experts": 64, + "load_cv": 0.827969828503542, + "normalized_load_entropy": 0.9438069972009583, + "max_load_share": 0.0975609756097561 + }, + "full_input": { + "tokens": 271, + "top_k": 6, + "decisions": 1626, + "ordered_route_sha256": "b483602ca3a8b7f3545e497bf8106d1d1075fb45c872d150f06478c03aa7eed6", + "route_weight_sha256": "9b46f1633a9755f75aec0c250260d7eea44a02f9f80bf6d50bab5c99b2a8fd78", + "loads": [ + 13, + 32, + 39, + 31, + 14, + 27, + 38, + 59, + 20, + 49, + 23, + 8, + 20, + 7, + 38, + 8, + 24, + 36, + 24, + 7, + 43, + 15, + 16, + 21, + 22, + 27, + 5, + 22, + 18, + 5, + 145, + 29, + 23, + 11, + 6, + 26, + 14, + 18, + 38, + 18, + 48, + 28, + 16, + 10, + 17, + 18, + 18, + 26, + 23, + 15, + 37, + 40, + 36, + 36, + 20, + 24, + 12, + 45, + 13, + 10, + 25, + 19, + 27, + 24 + ], + "weighted_loads": [ + 0.4922576732933521, + 2.5023630161304027, + 1.6313826348632574, + 2.992609940469265, + 0.8348695375025272, + 1.7312762700021267, + 3.916187934577465, + 6.202998755499721, + 0.8295495323836803, + 1.980475815013051, + 1.4439906254410744, + 0.8844065479934216, + 0.9417349062860012, + 0.32905567064881325, + 3.5999823566526175, + 0.3694568704813719, + 1.7568311672657728, + 2.0034442506730556, + 1.1245356276631355, + 0.5298300758004189, + 2.6688550394028425, + 0.5444567333906889, + 0.6847713459283113, + 0.9444288536906242, + 1.3141408134251833, + 2.240684462711215, + 0.15052049048244953, + 1.3531707748770714, + 0.713130934163928, + 0.18645071610808372, + 10.76890811137855, + 2.6161547005176544, + 0.9196062162518501, + 0.45856145583093166, + 0.22708918526768684, + 2.115429548546672, + 0.9012295082211494, + 0.8190752863883972, + 5.3594675082713366, + 3.005618426948786, + 2.241492846980691, + 1.679609451442957, + 1.3132004961371422, + 0.46853987872600555, + 1.257930263876915, + 1.402043130248785, + 0.6450262423604727, + 2.0137495175004005, + 1.4243564791977406, + 0.6045777909457684, + 1.916730608791113, + 2.1758716627955437, + 4.1690234541893005, + 1.9761946965008974, + 1.0659932850394398, + 1.0985946748405695, + 0.48559656366705894, + 1.551980596035719, + 0.5880155991762877, + 0.44904930889606476, + 1.3470354434102774, + 1.124092884361744, + 3.01809966750443, + 2.148274866864085 + ], + "unique_experts": 64, + "load_cv": 0.7541881376938123, + "normalized_load_entropy": 0.9514844987403611, + "max_load_share": 0.08917589175891759 + } + }, + "s1_period": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "9a2e32c270b1727d7609928641e32fe081294c11752bc9600b3fa2f3a21c2fb3", + "route_weight_sha256": "91511f5aa9576698c58a81b35dc7399a91a211f7d5fa82215127d2221f029a6c", + "loads": [ + 10, + 12, + 34, + 28, + 13, + 28, + 32, + 58, + 21, + 42, + 11, + 4, + 15, + 6, + 38, + 13, + 23, + 28, + 22, + 8, + 44, + 15, + 18, + 17, + 24, + 30, + 6, + 23, + 14, + 4, + 146, + 26, + 20, + 7, + 4, + 26, + 9, + 17, + 29, + 18, + 37, + 32, + 14, + 13, + 12, + 8, + 15, + 27, + 20, + 17, + 27, + 39, + 32, + 38, + 12, + 25, + 11, + 41, + 14, + 9, + 24, + 20, + 22, + 24 + ], + "weighted_loads": [ + 0.3661887552589178, + 0.9101601336151361, + 1.2627127189189196, + 2.884408351033926, + 0.7673087082803249, + 1.7385939881205559, + 3.466431738808751, + 6.050617333501577, + 1.0270641073584557, + 1.6729410905390978, + 0.4806896485388279, + 0.16457352973520756, + 0.7209696993231773, + 0.28420906141400337, + 3.4904370941221714, + 0.5787782650440931, + 1.6916459705680609, + 1.6539237387478352, + 1.0705706793814898, + 0.5470285788178444, + 2.779490804299712, + 0.5552902426570654, + 0.7611460946500301, + 0.8048018887639046, + 1.4107311870902777, + 2.166215470060706, + 0.1662013716995716, + 1.3792866915464401, + 0.5479422193020582, + 0.15255033411085606, + 10.7959108594805, + 2.330449465662241, + 0.8276618253439665, + 0.3184739612042904, + 0.1113894097507, + 2.0899904537945986, + 0.6170020252466202, + 0.7478932552039623, + 4.819867022335529, + 2.5207149740308523, + 1.724174041301012, + 1.8522208277136087, + 1.2378202565014362, + 0.5872864909470081, + 0.8142152410000563, + 0.49265237525105476, + 0.552638852968812, + 2.022674011066556, + 1.3160136733204126, + 0.7062221542000771, + 1.3334222976118326, + 2.110231162980199, + 3.830143166705966, + 2.097255662083626, + 0.6550032384693623, + 1.1824120990931988, + 0.450555969029665, + 1.4029967430979013, + 0.6081421878188848, + 0.4081813208758831, + 1.307035582140088, + 1.1594495456665754, + 2.351357413455844, + 1.7378222346305847 + ], + "unique_experts": 64, + "load_cv": 0.8303082555696072, + "normalized_load_entropy": 0.9440087304657488, + "max_load_share": 0.0989159891598916 + }, + "full_input": { + "tokens": 287, + "top_k": 6, + "decisions": 1722, + "ordered_route_sha256": "8f2cee81a34b478b072b02eff0fe4d2ef46d85f5829d4fd6cff29d78055b509b", + "route_weight_sha256": "3fb9a84a25fc263232fd7c9df4648c8223994e2c8959d392e7cc371f5e751423", + "loads": [ + 13, + 38, + 43, + 28, + 13, + 29, + 39, + 59, + 23, + 43, + 33, + 7, + 20, + 6, + 38, + 14, + 23, + 36, + 23, + 9, + 47, + 23, + 18, + 23, + 24, + 30, + 7, + 23, + 15, + 6, + 147, + 29, + 26, + 8, + 7, + 26, + 10, + 24, + 37, + 22, + 45, + 32, + 15, + 14, + 22, + 23, + 16, + 28, + 20, + 17, + 39, + 39, + 39, + 45, + 25, + 26, + 13, + 47, + 14, + 10, + 29, + 21, + 27, + 27 + ], + "weighted_loads": [ + 0.6300505455583334, + 3.0009276282507926, + 1.8111916854977608, + 2.884408351033926, + 0.7673087082803249, + 1.7797599472105503, + 4.062917178496718, + 6.088485427200794, + 1.1421463042497635, + 1.7009798977524042, + 2.4041631557047367, + 0.8852807972580194, + 1.0119933187961578, + 0.28420906141400337, + 3.4904370941221714, + 0.6207754481583834, + 1.6916459705680609, + 2.3026158399879932, + 1.1228417064994574, + 0.571072043851018, + 3.033867558464408, + 1.2353446874767542, + 0.7611460946500301, + 1.0328751262277365, + 1.4107311870902777, + 2.166215470060706, + 0.1995057575404644, + 1.3792866915464401, + 0.5939162652939558, + 0.2221118863672018, + 10.841804521158338, + 2.7979827038943768, + 1.1102687995880842, + 0.3651540279388428, + 0.25043436884880066, + 2.0899904537945986, + 0.6587594971060753, + 1.0402785632759333, + 5.567067634314299, + 2.982327250763774, + 2.1295482963323593, + 1.8522208277136087, + 1.3241541869938374, + 0.6171151511371136, + 1.5661252532154322, + 1.7937584929168224, + 0.5952019449323416, + 2.048085233196616, + 1.3160136733204126, + 0.7062221542000771, + 2.0498014502227306, + 2.110231162980199, + 4.318649983033538, + 2.604672096669674, + 1.4850370942149311, + 1.2089058551937342, + 0.5403536763042212, + 1.6652909945696592, + 0.6081421878188848, + 0.498161468654871, + 1.585483467206359, + 1.2043937128037214, + 2.7700290642678738, + 2.0338554568588734 + ], + "unique_experts": 64, + "load_cv": 0.7169755684999806, + "normalized_load_entropy": 0.9549857681027513, + "max_load_share": 0.08536585365853659 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 246, + "ordered_topk_exact_tokens": 147, + "set_exact_tokens": 170, + "mean_set_jaccard": 0.9078977932636468, + "mean_token_weighted_tv": 0.01842752930412932, + "aggregate_load_tv": 0.02100271002710027 + }, + "system_bos": { + "tokens": 246, + "ordered_topk_exact_tokens": 139, + "set_exact_tokens": 168, + "mean_set_jaccard": 0.9050522648083623, + "mean_token_weighted_tv": 0.02006719778178305, + "aggregate_load_tv": 0.029810298102981025 + }, + "system_x": { + "tokens": 246, + "ordered_topk_exact_tokens": 122, + "set_exact_tokens": 153, + "mean_set_jaccard": 0.8781455671699574, + "mean_token_weighted_tv": 0.028289580155482014, + "aggregate_load_tv": 0.02845528455284553 + }, + "system_period": { + "tokens": 246, + "ordered_topk_exact_tokens": 122, + "set_exact_tokens": 154, + "mean_set_jaccard": 0.8807007355787841, + "mean_token_weighted_tv": 0.02829511327729598, + "aggregate_load_tv": 0.03184281842818429 + }, + "bos_at_s0": { + "tokens": 246, + "ordered_topk_exact_tokens": 132, + "set_exact_tokens": 157, + "mean_set_jaccard": 0.8957607433217188, + "mean_token_weighted_tv": 0.020729242206922148, + "aggregate_load_tv": 0.029810298102981025 + }, + "bos_at_s1": { + "tokens": 246, + "ordered_topk_exact_tokens": 140, + "set_exact_tokens": 170, + "mean_set_jaccard": 0.9061556329849013, + "mean_token_weighted_tv": 0.0211396170325759, + "aggregate_load_tv": 0.02439024390243903 + }, + "x_at_s0": { + "tokens": 246, + "ordered_topk_exact_tokens": 112, + "set_exact_tokens": 144, + "mean_set_jaccard": 0.8712737127371273, + "mean_token_weighted_tv": 0.027863699952291886, + "aggregate_load_tv": 0.029132791327913278 + }, + "x_at_s1": { + "tokens": 246, + "ordered_topk_exact_tokens": 135, + "set_exact_tokens": 161, + "mean_set_jaccard": 0.8869531552458381, + "mean_token_weighted_tv": 0.028555384201065796, + "aggregate_load_tv": 0.023712737127371285 + }, + "period_at_s0": { + "tokens": 246, + "ordered_topk_exact_tokens": 120, + "set_exact_tokens": 153, + "mean_set_jaccard": 0.8852109949670924, + "mean_token_weighted_tv": 0.024453872296111127, + "aggregate_load_tv": 0.031165311653116527 + }, + "period_at_s1": { + "tokens": 246, + "ordered_topk_exact_tokens": 124, + "set_exact_tokens": 147, + "mean_set_jaccard": 0.8737901664730933, + "mean_token_weighted_tv": 0.028942458960038376, + "aggregate_load_tv": 0.027100271002710036 + } + } + }, + "layer_26": { + "layer": 26, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "e52ff27bd7fe49e9e69f1d6ba1ced2debc8234bce6a43337dba80aa19856de2d", + "route_weight_sha256": "944522dcbf7bd0c837411a14c7bcfe696c4156bb7dc85bbe3b6cfeaf03954679", + "loads": [ + 24, + 22, + 52, + 7, + 39, + 13, + 45, + 24, + 14, + 13, + 5, + 31, + 20, + 16, + 7, + 2, + 16, + 20, + 4, + 42, + 23, + 30, + 7, + 42, + 17, + 15, + 10, + 42, + 43, + 45, + 12, + 30, + 45, + 18, + 17, + 19, + 16, + 32, + 37, + 13, + 34, + 4, + 5, + 29, + 7, + 10, + 21, + 17, + 10, + 30, + 20, + 53, + 18, + 37, + 26, + 26, + 21, + 35, + 37, + 28, + 14, + 18, + 26, + 21 + ], + "weighted_loads": [ + 1.004271950572729, + 2.152530260384083, + 3.592975802719593, + 0.36773702315986156, + 2.483474962413311, + 0.5034639369696379, + 4.299734989181161, + 0.9007375109940767, + 0.7159230671823025, + 0.8815392330288887, + 0.31389880552887917, + 4.438287880271673, + 1.763837456703186, + 0.7274734824895859, + 0.24628328159451485, + 0.17379764467477798, + 0.8962980676442385, + 2.76487784832716, + 0.13912434503436089, + 2.6453316658735275, + 1.5525493193417788, + 2.137859234586358, + 0.2192330863326788, + 2.315736686810851, + 1.0223375894129276, + 0.8866521567106247, + 0.626919599249959, + 2.8514980133622885, + 3.5805376898497343, + 1.8279501181095839, + 0.4753700867295265, + 1.6089173648506403, + 4.160363974049687, + 0.6668594181537628, + 1.0570759195834398, + 1.1669592540711164, + 0.9049623627215624, + 1.8200011849403381, + 2.370868094265461, + 0.9443875830620527, + 2.2919478453695774, + 0.5095947533845901, + 0.19511831738054752, + 2.6835485119372606, + 0.22352454997599125, + 0.5453776717185974, + 0.7965303771197796, + 0.778059333562851, + 0.5157976001501083, + 2.187359068542719, + 0.8350077569484711, + 5.371605446562171, + 1.1876319460570812, + 1.6819967273622751, + 1.5436378009617329, + 1.4518443681299686, + 1.5718086399137974, + 4.483842482790351, + 2.314020751044154, + 2.009113823994994, + 0.6553474310785532, + 0.9276167619973421, + 1.6935185212641954, + 2.3033886440098286 + ], + "unique_experts": 64, + "load_cv": 0.5564933587799578, + "normalized_load_entropy": 0.9613319499174231, + "max_load_share": 0.03590785907859079 + }, + "full_input": { + "tokens": 271, + "top_k": 6, + "decisions": 1626, + "ordered_route_sha256": "207657f1adb561437e506d2b1aa74b620a76e16332335c1db46b354d6709cc87", + "route_weight_sha256": "79c84381238025fd8c7569c2f0ae7ead7520a91ab3234cde2b438ac2a8983bbd", + "loads": [ + 24, + 22, + 52, + 8, + 39, + 13, + 45, + 26, + 14, + 18, + 9, + 36, + 20, + 17, + 22, + 4, + 16, + 33, + 4, + 42, + 23, + 32, + 7, + 42, + 24, + 15, + 16, + 50, + 43, + 45, + 20, + 30, + 48, + 19, + 20, + 19, + 23, + 32, + 37, + 13, + 34, + 4, + 5, + 32, + 10, + 10, + 24, + 17, + 12, + 31, + 28, + 53, + 23, + 37, + 27, + 26, + 34, + 42, + 43, + 29, + 15, + 18, + 27, + 23 + ], + "weighted_loads": [ + 1.004271950572729, + 2.152530260384083, + 3.592975802719593, + 0.40358436666429043, + 2.483474962413311, + 0.5034639369696379, + 4.299734989181161, + 1.0396573040634394, + 0.7159230671823025, + 1.2026217803359032, + 0.5972287654876709, + 4.737507089506835, + 1.763837456703186, + 0.7898084111511707, + 0.9253563582897186, + 0.27147290855646133, + 0.8962980676442385, + 3.392481851624325, + 0.13912434503436089, + 2.6453316658735275, + 1.5525493193417788, + 2.1971559524536133, + 0.2192330863326788, + 2.315736686810851, + 1.410744123160839, + 0.8866521567106247, + 1.575303116813302, + 3.1614153161644936, + 3.5805376898497343, + 1.8279501181095839, + 1.2891679517924786, + 1.6089173648506403, + 4.264538062736392, + 0.7196473926305771, + 1.3422739077359438, + 1.1669592540711164, + 1.2778307311236858, + 1.8200011849403381, + 2.370868094265461, + 0.9443875830620527, + 2.2919478453695774, + 0.5095947533845901, + 0.19511831738054752, + 2.836115872487426, + 0.36301750130951405, + 0.5453776717185974, + 0.9643790945410728, + 0.778059333562851, + 0.6389177516102791, + 3.1735546328127384, + 1.1854476183652878, + 5.371605446562171, + 1.649826467037201, + 1.6819967273622751, + 1.5907106176018715, + 1.4518443681299686, + 2.598666474223137, + 4.847215760033578, + 2.55137331597507, + 2.057909918949008, + 0.6561674948316067, + 0.9276167619973421, + 1.733428267762065, + 2.38979110494256 + ], + "unique_experts": 64, + "load_cv": 0.5026508134197525, + "normalized_load_entropy": 0.9678324651303728, + "max_load_share": 0.032595325953259535 + } + }, + "s1_eos": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "3bda88fc9433cf98aa6b7f78d5a1dbeebe45dd5dab88a63cea992a488dabcf08", + "route_weight_sha256": "78ae3247213b9d791f1b6e804cb6431bc32d441f08b26e3cb837452308f25135", + "loads": [ + 22, + 22, + 52, + 10, + 37, + 14, + 43, + 27, + 14, + 14, + 6, + 31, + 20, + 16, + 8, + 3, + 17, + 21, + 5, + 42, + 24, + 32, + 13, + 43, + 19, + 15, + 10, + 39, + 42, + 44, + 11, + 31, + 44, + 23, + 14, + 20, + 16, + 33, + 37, + 10, + 30, + 4, + 6, + 28, + 9, + 13, + 19, + 17, + 7, + 31, + 18, + 51, + 18, + 37, + 26, + 26, + 18, + 35, + 35, + 28, + 14, + 20, + 25, + 17 + ], + "weighted_loads": [ + 0.9393328037112951, + 2.159656587988138, + 3.6679380126297474, + 0.5375367738306522, + 2.440133085474372, + 0.5206675482913852, + 4.229299625381827, + 1.018040630966425, + 0.7147757075726986, + 0.9246997106820345, + 0.3472730275243521, + 4.402632365003228, + 1.7632416170090437, + 0.7323554866015911, + 0.29806188121438026, + 0.214613676071167, + 0.9420926012098789, + 2.8322680443525314, + 0.17924279533326626, + 2.6345728747546673, + 1.647640934213996, + 2.194158487021923, + 0.4117032326757908, + 2.351299498230219, + 1.064650321379304, + 0.8187288176268339, + 0.6099905055016279, + 2.7463656049221754, + 3.5608683060854673, + 1.8079636869952083, + 0.4543295409530401, + 1.6558892149478197, + 4.1510021183639765, + 0.8477606382220984, + 0.9467950919643044, + 1.1942484620958567, + 0.8967248722910881, + 1.8494634237140417, + 2.382381960749626, + 0.8647338859736919, + 2.137664869427681, + 0.2601329330354929, + 0.21766686998307705, + 2.600036531686783, + 0.2909554075449705, + 0.6587310750037432, + 0.7068400457501411, + 0.7855515964329243, + 0.4419764503836632, + 2.317752130329609, + 0.7498741745948792, + 5.2796497866511345, + 1.2102726604789495, + 1.6063768919557333, + 1.5445079077035189, + 1.38069536536932, + 1.4741946123540401, + 4.498764073476195, + 2.2324995044618845, + 1.9491861648857594, + 0.6491993162781, + 1.0132382325828075, + 1.7144370032474399, + 1.892682772129774 + ], + "unique_experts": 64, + "load_cv": 0.5332008450240794, + "normalized_load_entropy": 0.9649194778113735, + "max_load_share": 0.03523035230352303 + }, + "full_input": { + "tokens": 287, + "top_k": 6, + "decisions": 1722, + "ordered_route_sha256": "b77899cdb9c22a67a65d6316d44c2c7d6beddfa94013a4e3402cb2d41706aab8", + "route_weight_sha256": "d9ace1162240735c00697041842d997e9f3788016b9588320de2bfdc999d8ede", + "loads": [ + 22, + 22, + 52, + 11, + 40, + 14, + 43, + 29, + 14, + 22, + 13, + 38, + 20, + 17, + 22, + 8, + 17, + 28, + 6, + 42, + 24, + 39, + 20, + 43, + 27, + 17, + 22, + 50, + 42, + 48, + 21, + 32, + 49, + 24, + 21, + 20, + 30, + 38, + 40, + 11, + 31, + 4, + 8, + 32, + 11, + 14, + 22, + 18, + 9, + 34, + 25, + 51, + 27, + 39, + 29, + 28, + 36, + 45, + 45, + 32, + 17, + 20, + 28, + 19 + ], + "weighted_loads": [ + 0.9393328037112951, + 2.159656587988138, + 3.6679380126297474, + 0.5709096342325211, + 2.617607768625021, + 0.5206675482913852, + 4.229299625381827, + 1.2181231491267681, + 0.7147757075726986, + 1.4059238750487566, + 1.0984184723347425, + 5.011173551203683, + 1.7632416170090437, + 0.7871754765510559, + 1.0654413388110697, + 0.5240451395511627, + 0.9420926012098789, + 3.246181151131168, + 0.2325309831649065, + 2.6345728747546673, + 1.647640934213996, + 2.582195695489645, + 0.9189952500164509, + 2.351299498230219, + 1.4813782032579184, + 0.9227500427514315, + 2.128432175144553, + 3.1559304296970367, + 3.5608683060854673, + 1.9390468643978238, + 1.4989378992468119, + 1.735948221758008, + 4.354038085788488, + 0.8931717444211245, + 1.4065074073150754, + 1.1942484620958567, + 1.6427906155586243, + 2.1510892529040575, + 2.660446770489216, + 0.8983224183320999, + 2.1677960213273764, + 0.2601329330354929, + 0.30231319181621075, + 2.8005203679203987, + 0.38596754334867, + 0.6762541867792606, + 0.9164898805320263, + 0.8274980969727039, + 0.52954987809062, + 3.4538880921900272, + 1.0389756485819817, + 5.2796497866511345, + 2.00663841329515, + 1.7958025503903627, + 1.7583920639008284, + 1.4996220953762531, + 3.1775985918939114, + 5.270566907711327, + 2.831468405202031, + 2.13537622615695, + 0.8926859178463928, + 1.0132382325828075, + 1.8406226737424731, + 1.981047224253416 + ], + "unique_experts": 64, + "load_cv": 0.4609717909460179, + "normalized_load_entropy": 0.9733084722064949, + "max_load_share": 0.030197444831591175 + } + }, + "s0_bos": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "4dd9c716b907334f19baa1dbd9d6c194380154ed139297b07d949f493f023206", + "route_weight_sha256": "58ae93a9b89a623f5a4c309662ac121c72a87c12737560edb40f308edf1780f3", + "loads": [ + 23, + 22, + 52, + 9, + 36, + 14, + 45, + 19, + 14, + 13, + 7, + 31, + 19, + 14, + 6, + 3, + 16, + 22, + 2, + 41, + 25, + 32, + 9, + 41, + 19, + 16, + 11, + 40, + 44, + 48, + 11, + 30, + 46, + 18, + 14, + 19, + 16, + 33, + 37, + 13, + 31, + 4, + 6, + 29, + 8, + 11, + 22, + 17, + 9, + 33, + 19, + 53, + 18, + 38, + 26, + 21, + 19, + 36, + 37, + 28, + 14, + 19, + 25, + 23 + ], + "weighted_loads": [ + 0.9168372018029913, + 2.180791387334466, + 3.655030034482479, + 0.4418950839317404, + 2.419634487479925, + 0.5272401012480259, + 4.421074690297246, + 0.7049696873873472, + 0.7129907179623842, + 0.8915850482881069, + 0.39768876880407333, + 4.468588002026081, + 1.7673566080629826, + 0.6554955765604973, + 0.20336508750915527, + 0.1837831555167213, + 0.9187337290495634, + 2.821113009005785, + 0.0656554065644741, + 2.599583687260747, + 1.6400757543742657, + 2.1902185305953026, + 0.3083429131656885, + 2.290360590443015, + 1.0750691127032042, + 0.9259260669350624, + 0.6336399018764496, + 2.8450302183628082, + 3.6886425763368607, + 2.0130234137177467, + 0.42828135564923286, + 1.6019184850156307, + 4.183776067569852, + 0.7089490126818419, + 0.7851243220502511, + 1.1580428145825863, + 0.891125863417983, + 1.8414112944155931, + 2.401581173762679, + 0.969637805595994, + 2.0795427542179823, + 1.1175559163093567, + 0.19452940282644704, + 2.8463814593851566, + 0.2399198468774557, + 0.5056120939552784, + 0.8359061721712351, + 0.7852199673652649, + 0.49531663581728935, + 2.459793733432889, + 0.7545728925615549, + 5.441381726413965, + 1.1928872745484114, + 1.7432867623865604, + 1.5822281800210476, + 1.1929737068712711, + 1.5147878099232912, + 4.539711639285088, + 2.3403765875846148, + 2.0668856129050255, + 0.665757255628705, + 0.9795011822134256, + 1.665886132977903, + 2.58476497605443 + ], + "unique_experts": 64, + "load_cv": 0.5550132854843542, + "normalized_load_entropy": 0.9619893541448393, + "max_load_share": 0.03590785907859079 + }, + "full_input": { + "tokens": 271, + "top_k": 6, + "decisions": 1626, + "ordered_route_sha256": "ebc4b535b6804c0267d01897b0a24ca1891510635ad021026d43b9e2b39560ff", + "route_weight_sha256": "d7eed13dd8735aaebe5baa2ad99ab617ccb8346cc364f188abb7309a3b8f6991", + "loads": [ + 24, + 22, + 52, + 11, + 36, + 15, + 45, + 21, + 14, + 19, + 10, + 35, + 19, + 15, + 19, + 5, + 16, + 33, + 2, + 41, + 25, + 35, + 10, + 41, + 25, + 16, + 17, + 49, + 44, + 48, + 20, + 30, + 48, + 19, + 18, + 19, + 23, + 33, + 37, + 13, + 31, + 5, + 7, + 32, + 12, + 11, + 24, + 17, + 11, + 33, + 27, + 53, + 22, + 38, + 27, + 21, + 32, + 42, + 43, + 29, + 14, + 19, + 26, + 26 + ], + "weighted_loads": [ + 0.9487610770156607, + 2.180791387334466, + 3.655030034482479, + 0.5142932659364305, + 2.419634487479925, + 0.5765336640179157, + 4.421074690297246, + 0.810308312997222, + 0.7129907179623842, + 1.2539449036121368, + 0.643522247672081, + 4.765735657885671, + 1.7673566080629826, + 0.7178305052220821, + 0.797578064724803, + 0.3001106275478378, + 0.9187337290495634, + 3.3975409287959337, + 0.0656554065644741, + 2.599583687260747, + 1.6400757543742657, + 2.28741011954844, + 0.3405697923153639, + 2.290360590443015, + 1.4269730057567358, + 0.9259260669350624, + 1.6422867104411125, + 3.24861703440547, + 3.6886425763368607, + 2.0130234137177467, + 1.2888319604098797, + 1.6019184850156307, + 4.261414425447583, + 0.7599943224340677, + 1.1222245894605294, + 1.1580428145825863, + 1.2505518551915884, + 1.8414112944155931, + 2.401581173762679, + 0.969637805595994, + 2.0795427542179823, + 1.3435997068881989, + 0.26157091913046315, + 2.998948819935322, + 0.4534593094140291, + 0.5056120939552784, + 0.9608639273792505, + 0.7852199673652649, + 0.6239675842225552, + 2.459793733432889, + 1.1050127539783716, + 5.441381726413965, + 1.6311844568699598, + 1.7432867623865604, + 1.6293009966611862, + 1.1929737068712711, + 2.5421643685549498, + 4.898178413510323, + 2.5777291525155306, + 2.1156817078590393, + 0.665757255628705, + 0.9795011822134256, + 1.7057958794757724, + 2.739027813076973 + ], + "unique_experts": 64, + "load_cv": 0.49483656245267943, + "normalized_load_entropy": 0.9693760298491252, + "max_load_share": 0.032595325953259535 + } + }, + "s1_bos": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "18f5ce3a270798d36fdb2f8440af7451d76f85bf2539f52b0d9c80434cfc149e", + "route_weight_sha256": "7920cbecad1563d260fad7e0bbfae6252d7859925ab9f319079384c254531bbe", + "loads": [ + 22, + 22, + 52, + 7, + 36, + 17, + 45, + 24, + 13, + 13, + 8, + 32, + 19, + 15, + 9, + 3, + 16, + 22, + 2, + 39, + 25, + 31, + 10, + 41, + 19, + 18, + 10, + 42, + 44, + 44, + 11, + 30, + 46, + 18, + 17, + 20, + 16, + 33, + 40, + 13, + 32, + 4, + 6, + 28, + 7, + 12, + 20, + 17, + 7, + 31, + 18, + 52, + 20, + 35, + 25, + 24, + 18, + 35, + 37, + 28, + 15, + 17, + 25, + 19 + ], + "weighted_loads": [ + 0.9281672136858106, + 2.1873375214636326, + 3.6920839473605156, + 0.3457269654609263, + 2.4343614019453526, + 0.6146818045526743, + 4.357094340026379, + 0.8638791348785162, + 0.6926512885838747, + 0.8858656864613295, + 0.42726267874240875, + 4.405567958950996, + 1.752983646467328, + 0.7147507090121508, + 0.34339709021151066, + 0.17633524944540113, + 0.9323017876595259, + 2.7860970869660378, + 0.06803299859166145, + 2.5355819389224052, + 1.719676449894905, + 2.1407004706561565, + 0.30077455937862396, + 2.293042441830039, + 1.0695315469056368, + 0.9469991810619831, + 0.5816036779433489, + 2.884402446448803, + 3.658968757838011, + 1.781491613946855, + 0.43854111805558205, + 1.6078665051609278, + 4.155642217025161, + 0.7024090345948935, + 0.9570073384093121, + 1.184140158817172, + 0.8835207391530275, + 1.8673980589956045, + 2.5300164502114058, + 0.9782124422490597, + 2.150108514353633, + 1.1102400198578835, + 0.19236190360970795, + 2.7102301120758057, + 0.21494555659592152, + 0.5892081949859858, + 0.7711941208690405, + 0.7913271281868219, + 0.41349339112639427, + 2.3743124715983868, + 0.6950266491621733, + 5.485511546954513, + 1.25575122050941, + 1.626919848844409, + 1.5556513909250498, + 1.348735861480236, + 1.5113573856651783, + 4.455293495208025, + 2.3366018030792475, + 2.0395791325718164, + 0.6801031604409218, + 0.8610897623002529, + 1.713057180866599, + 2.2941024359315634 + ], + "unique_experts": 64, + "load_cv": 0.5445401435612499, + "normalized_load_entropy": 0.9631723105170612, + "max_load_share": 0.03523035230352303 + }, + "full_input": { + "tokens": 287, + "top_k": 6, + "decisions": 1722, + "ordered_route_sha256": "d5c71674d50da2f5f131039b149d308785bdbe364ba9b7aaf4f844edadbd1955", + "route_weight_sha256": "d2c97d2a0a99375f92c6e27950df650ebba6171cb308dbfd93411b77aec8fdbc", + "loads": [ + 22, + 22, + 52, + 9, + 39, + 17, + 45, + 26, + 13, + 21, + 16, + 38, + 19, + 16, + 21, + 8, + 16, + 28, + 2, + 39, + 25, + 38, + 17, + 41, + 28, + 20, + 23, + 52, + 44, + 48, + 23, + 31, + 50, + 20, + 24, + 20, + 30, + 38, + 43, + 14, + 33, + 4, + 8, + 32, + 11, + 13, + 23, + 18, + 9, + 33, + 25, + 52, + 29, + 37, + 28, + 26, + 36, + 44, + 47, + 32, + 17, + 17, + 28, + 22 + ], + "weighted_loads": [ + 0.9281672136858106, + 2.1873375214636326, + 3.6920839473605156, + 0.41089263977482915, + 2.6118360850960016, + 0.6146818045526743, + 4.357094340026379, + 1.0291376914829016, + 0.6926512885838747, + 1.3755332175642252, + 1.2489239051938057, + 5.011853709816933, + 1.752983646467328, + 0.7695706989616156, + 1.033039191737771, + 0.4984011951601133, + 0.9323017876595259, + 3.2370364107191563, + 0.06803299859166145, + 2.5355819389224052, + 1.719676449894905, + 2.530545812100172, + 0.7949565052986145, + 2.293042441830039, + 1.5292909648269415, + 1.0510204061865807, + 2.2261002343147993, + 3.2555824797600508, + 3.658968757838011, + 1.9125747913494706, + 1.6292617954313755, + 1.687925511971116, + 4.32592929713428, + 0.7877928335219622, + 1.4724977511214092, + 1.184140158817172, + 1.6294904258102179, + 2.1690238881856203, + 2.8080812599509954, + 1.0118009746074677, + 2.1802396662533283, + 1.1102400198578835, + 0.28052208689041436, + 2.9107139483094215, + 0.39647374488413334, + 0.6067313067615032, + 0.9700902532786131, + 0.8332736287266016, + 0.5108311474323273, + 2.525574781000614, + 0.9841281231492758, + 5.485511546954513, + 2.0324880462139845, + 1.8163455072790384, + 1.7695355471223593, + 1.4676625914871693, + 3.209768209606409, + 5.221817059442401, + 2.935570703819394, + 2.225769193843007, + 0.9226631969213486, + 0.8610897623002529, + 1.8392428513616323, + 2.4712945464998484 + ], + "unique_experts": 64, + "load_cv": 0.4690938867193277, + "normalized_load_entropy": 0.9719767406893576, + "max_load_share": 0.030197444831591175 + } + }, + "s0_x": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "4366260b5a8971bb354263fd750a97a53db93c27b5d56bd873d9da11943a03c0", + "route_weight_sha256": "f0f72728e68995b9afa30ca677a25c6ffac3ea5783babd9d754b331d1fa326b5", + "loads": [ + 21, + 21, + 52, + 11, + 39, + 15, + 45, + 24, + 13, + 14, + 6, + 32, + 19, + 16, + 5, + 2, + 17, + 23, + 3, + 40, + 24, + 32, + 10, + 42, + 18, + 17, + 10, + 39, + 43, + 46, + 11, + 30, + 43, + 18, + 14, + 20, + 14, + 33, + 38, + 12, + 28, + 4, + 4, + 31, + 11, + 11, + 23, + 17, + 8, + 32, + 18, + 51, + 19, + 35, + 26, + 23, + 21, + 36, + 38, + 29, + 16, + 16, + 25, + 22 + ], + "weighted_loads": [ + 0.9050969295203686, + 2.09799288213253, + 3.6464491300284863, + 0.5790636818856001, + 2.484439527615905, + 0.5647374372929335, + 4.30518239364028, + 0.8815338723361492, + 0.6636992543935776, + 0.8988397177308798, + 0.3307864386588335, + 4.530080346390605, + 1.7564383819699287, + 0.6984429378062487, + 0.1883282344788313, + 0.1948743239045143, + 0.9642308782786131, + 2.8744247406721115, + 0.09214470721781254, + 2.5839941948652267, + 1.6352298390120268, + 2.1777411103248596, + 0.3265850245952606, + 2.325483625754714, + 1.1053856499493122, + 0.900491576641798, + 0.5965990200638771, + 2.8147675152868032, + 3.7504598852247, + 1.9250870011746883, + 0.4386996366083622, + 1.5824155155569315, + 4.013000166043639, + 0.7158294748514891, + 0.8573104944080114, + 1.1400818452239037, + 0.7997635714709759, + 1.819007409736514, + 2.351438643410802, + 0.9523396510630846, + 1.9504185300320387, + 0.30967777967453003, + 0.16398028656840324, + 2.7727738935500383, + 0.33140526339411736, + 0.49918313696980476, + 0.9031547494232655, + 0.770772522315383, + 0.49056726694107056, + 2.3417300060391426, + 0.7143797073513269, + 5.289383165538311, + 1.274645697325468, + 1.5300776306539774, + 1.6008446663618088, + 1.2547743115574121, + 1.5318677891045809, + 4.514328086748719, + 2.449177859351039, + 1.9898900296539068, + 0.721984900534153, + 0.864907767623663, + 1.7238688711076975, + 2.1977738719433546 + ], + "unique_experts": 64, + "load_cv": 0.5452948959973285, + "normalized_load_entropy": 0.9626385182238247, + "max_load_share": 0.03523035230352303 + }, + "full_input": { + "tokens": 271, + "top_k": 6, + "decisions": 1626, + "ordered_route_sha256": "6b5da8cc67216fb56ed46d82a650372a1382b3428b080b5950d5796242ad6495", + "route_weight_sha256": "01ad2ecc141d381941e67ec53d1115c92d52fc5f08c69b74d4f4820aa6869f4a", + "loads": [ + 21, + 21, + 52, + 12, + 39, + 15, + 45, + 26, + 13, + 19, + 10, + 38, + 19, + 17, + 19, + 4, + 17, + 36, + 3, + 40, + 24, + 35, + 10, + 42, + 24, + 17, + 17, + 47, + 43, + 47, + 18, + 30, + 45, + 19, + 17, + 20, + 21, + 33, + 38, + 12, + 28, + 4, + 4, + 36, + 13, + 11, + 25, + 17, + 9, + 32, + 26, + 51, + 23, + 35, + 27, + 23, + 38, + 43, + 44, + 30, + 16, + 16, + 26, + 24 + ], + "weighted_loads": [ + 0.9050969295203686, + 2.09799288213253, + 3.6464491300284863, + 0.6073696538805962, + 2.484439527615905, + 0.5647374372929335, + 4.30518239364028, + 1.017032902687788, + 0.6636992543935776, + 1.2150695491582155, + 0.632350554689765, + 4.9777788035571575, + 1.7564383819699287, + 0.7607778664678335, + 0.8858509697020054, + 0.29016413912177086, + 0.9642308782786131, + 3.5480638425797224, + 0.09214470721781254, + 2.5839941948652267, + 1.6352298390120268, + 2.276190457865596, + 0.3265850245952606, + 2.325483625754714, + 1.4517818167805672, + 0.900491576641798, + 1.5238500703126192, + 3.1301253754645586, + 3.7504598852247, + 1.9732152745127678, + 1.1619205325841904, + 1.5824155155569315, + 4.076648244634271, + 0.7633406314998865, + 1.1143222134560347, + 1.1400818452239037, + 1.15862525254488, + 1.819007409736514, + 2.351438643410802, + 0.9523396510630846, + 1.9504185300320387, + 0.30967777967453003, + 0.16398028656840324, + 3.0193808618932962, + 0.4201612323522568, + 0.49918313696980476, + 1.028112504631281, + 0.770772522315383, + 0.5453755967319012, + 2.3417300060391426, + 1.0648195687681437, + 5.289383165538311, + 1.6902227438986301, + 1.5300776306539774, + 1.6479174830019474, + 1.2547743115574121, + 2.746518896892667, + 4.983323181048036, + 2.6865304242819548, + 2.0386861246079206, + 0.721984900534153, + 0.864907767623663, + 1.763778617605567, + 2.2814768236130476 + ], + "unique_experts": 64, + "load_cv": 0.49854053990477476, + "normalized_load_entropy": 0.9683575348296043, + "max_load_share": 0.03198031980319803 + } + }, + "s1_x": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "038c3e8711b5c29213efa406ddad0bff4b9d4ca6f915467913abb2c92ef18447", + "route_weight_sha256": "6b3d731e8456b12538463dd096423b6eb64caa40a7c2f40b22716597bd9c488e", + "loads": [ + 21, + 22, + 51, + 12, + 38, + 16, + 44, + 25, + 14, + 13, + 5, + 32, + 19, + 18, + 6, + 3, + 17, + 22, + 1, + 43, + 24, + 32, + 10, + 42, + 18, + 16, + 9, + 41, + 46, + 47, + 10, + 31, + 45, + 24, + 13, + 21, + 14, + 32, + 39, + 11, + 29, + 4, + 5, + 30, + 7, + 10, + 21, + 17, + 7, + 30, + 18, + 52, + 18, + 34, + 26, + 22, + 19, + 36, + 38, + 26, + 15, + 18, + 27, + 20 + ], + "weighted_loads": [ + 0.839479842223227, + 2.1084392182528973, + 3.654019732028246, + 0.5760419671423733, + 2.4770180135965347, + 0.609888406470418, + 4.332183886319399, + 0.9240281991660595, + 0.7349181026220322, + 0.8644233513623476, + 0.3203704059123993, + 4.491209428757429, + 1.7355453558266163, + 0.8290046043694019, + 0.2026063036173582, + 0.1946206644643098, + 0.9975147489458323, + 2.8162108696997166, + 0.028613783419132233, + 2.7171793803572655, + 1.564487587660551, + 2.171624880284071, + 0.3008850757032633, + 2.3304868917912245, + 1.0265143774449825, + 0.8506963215768337, + 0.5397442393004894, + 2.8885286785662174, + 3.775528334081173, + 1.8483215561136603, + 0.42054577358067036, + 1.6472119614481926, + 3.9688813518732786, + 0.9894211981445551, + 0.7526707681827247, + 1.2026942539960146, + 0.8177634067833424, + 1.7877564709633589, + 2.546154160052538, + 0.8977749701589346, + 2.008226675912738, + 1.0706014782190323, + 0.16524073272012174, + 2.665581973269582, + 0.24478868581354618, + 0.5014200620353222, + 0.8185205459594727, + 0.7624109890311956, + 0.4630623497068882, + 2.1251133158802986, + 0.7046097870916128, + 5.289268033578992, + 1.1910998839884996, + 1.422527950257063, + 1.6121958289295435, + 1.262733368203044, + 1.3632638454437256, + 4.550597712397575, + 2.4620539899915457, + 1.9120592642575502, + 0.6960087195038795, + 0.9335558582097292, + 1.6960639199241996, + 2.008207008242607 + ], + "unique_experts": 64, + "load_cv": 0.5594942671246914, + "normalized_load_entropy": 0.9605152715700169, + "max_load_share": 0.03523035230352303 + }, + "full_input": { + "tokens": 287, + "top_k": 6, + "decisions": 1722, + "ordered_route_sha256": "6da6455a40b017c91eaf6c29e26652084a6da153099b98f3f7f5ed691aa3d6f4", + "route_weight_sha256": "7176b05846ddfa0cf5fc4031b2cda8a36b4783390a96d12e78470acb014702ef", + "loads": [ + 21, + 22, + 51, + 14, + 41, + 16, + 44, + 27, + 14, + 20, + 12, + 40, + 19, + 19, + 20, + 8, + 17, + 28, + 1, + 43, + 24, + 38, + 16, + 42, + 26, + 18, + 22, + 52, + 46, + 52, + 20, + 32, + 49, + 24, + 20, + 21, + 28, + 37, + 42, + 12, + 30, + 4, + 7, + 34, + 9, + 11, + 24, + 18, + 8, + 32, + 25, + 52, + 27, + 36, + 29, + 24, + 40, + 47, + 49, + 31, + 17, + 18, + 30, + 22 + ], + "weighted_loads": [ + 0.839479842223227, + 2.1084392182528973, + 3.654019732028246, + 0.641699752304703, + 2.654492696747184, + 0.609888406470418, + 4.332183886319399, + 1.0752999410033226, + 0.7349181026220322, + 1.300266856327653, + 1.068005084991455, + 5.255325075238943, + 1.7355453558266163, + 0.8838245943188667, + 1.0422610137611628, + 0.5093169652391225, + 0.9975147489458323, + 3.25650742277503, + 0.028613783419132233, + 2.7171793803572655, + 1.564487587660551, + 2.5262017510831356, + 0.7584818843752146, + 2.3304868917912245, + 1.4316150471568108, + 0.9547175467014313, + 2.06758338958025, + 3.300649233162403, + 3.775528334081173, + 2.053812668658793, + 1.4290417227894068, + 1.727270968258381, + 4.134034411981702, + 0.9894211981445551, + 1.220325909089297, + 1.2026942539960146, + 1.5849189460277557, + 2.0893823001533747, + 2.8242189697921276, + 0.9313635025173426, + 2.0383578278124332, + 1.0706014782190323, + 0.24720057263039052, + 2.8660658095031977, + 0.31832963041961193, + 0.5189431738108397, + 1.0291841924190521, + 0.8043574895709753, + 0.4984707869589329, + 2.276375625282526, + 0.9937112610787153, + 5.289268033578992, + 1.956460552290082, + 1.6119536086916924, + 1.826079985126853, + 1.3816600982099771, + 3.165978539735079, + 5.47555491514504, + 3.12647476606071, + 2.1433776300400496, + 0.9385687559843063, + 0.9335558582097292, + 1.8222495904192328, + 2.10289216786623 + ], + "unique_experts": 64, + "load_cv": 0.48816838400030527, + "normalized_load_entropy": 0.9695922567930367, + "max_load_share": 0.030197444831591175 + } + }, + "s0_period": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "d148103d2dd4092d380683cd3fe1f4dab29de4c9d32d1e41c73aee5cb45a4399", + "route_weight_sha256": "1c53c0137703f31c94b432ffd9c44da6c38c72c55168c56f060b669c87eec73f", + "loads": [ + 21, + 22, + 52, + 11, + 38, + 13, + 45, + 21, + 13, + 16, + 7, + 32, + 19, + 16, + 6, + 2, + 17, + 24, + 2, + 39, + 24, + 31, + 10, + 42, + 19, + 15, + 10, + 40, + 43, + 50, + 11, + 29, + 43, + 21, + 14, + 17, + 14, + 33, + 38, + 12, + 30, + 4, + 4, + 30, + 10, + 11, + 24, + 16, + 10, + 30, + 17, + 53, + 18, + 37, + 25, + 23, + 22, + 35, + 38, + 29, + 16, + 18, + 25, + 19 + ], + "weighted_loads": [ + 0.9385182093828917, + 2.151405293494463, + 3.6482395753264427, + 0.5574801955372095, + 2.4740978237241507, + 0.5141255501657724, + 4.39769552461803, + 0.805570974946022, + 0.6722708269953728, + 0.9995651710778475, + 0.37391937896609306, + 4.491339176893234, + 1.758715208619833, + 0.6875699777156115, + 0.21614519134163857, + 0.19147225469350815, + 0.961516473442316, + 2.8675752487033606, + 0.06511838361620903, + 2.541987083852291, + 1.6644867472350597, + 2.1437979750335217, + 0.3082749117165804, + 2.296184040606022, + 1.1207230612635612, + 0.8603211212903261, + 0.6141739692538977, + 2.846633207052946, + 3.743968700990081, + 1.9866321878507733, + 0.4478848371654749, + 1.5429976396262646, + 4.077050365507603, + 0.8233004305511713, + 0.9117846926674247, + 1.0631724298000336, + 0.8038740139454603, + 1.8154614549130201, + 2.415829049423337, + 0.9593083467334509, + 2.0569803342223167, + 0.24070917442440987, + 0.16276315599679947, + 2.79717586748302, + 0.3019661232829094, + 0.5088508240878582, + 0.9136334452778101, + 0.7461660467088223, + 0.5253770276904106, + 2.2868139334023, + 0.6680592652410269, + 5.361952621489763, + 1.2271223850548267, + 1.555567104369402, + 1.5726113021373749, + 1.2721813973039389, + 1.593607323244214, + 4.4489894062280655, + 2.3822015188634396, + 2.064386399462819, + 0.7230181898921728, + 0.9522278811782598, + 1.6957733780145645, + 2.301594689488411 + ], + "unique_experts": 64, + "load_cv": 0.5519347937119629, + "normalized_load_entropy": 0.9621142772638785, + "max_load_share": 0.03590785907859079 + }, + "full_input": { + "tokens": 271, + "top_k": 6, + "decisions": 1626, + "ordered_route_sha256": "0fa9cb872a75306d8eb462b35fa723e87d14814ef40da52a9ba762a4a1e6e6f5", + "route_weight_sha256": "53aa9fa787f4d20a5876118fbea3f94ebee59e1c620b300d7bf29a1db1023665", + "loads": [ + 21, + 22, + 52, + 13, + 38, + 14, + 45, + 23, + 13, + 21, + 11, + 36, + 19, + 17, + 20, + 4, + 17, + 35, + 2, + 39, + 24, + 34, + 10, + 42, + 26, + 15, + 17, + 47, + 43, + 50, + 19, + 29, + 46, + 22, + 17, + 17, + 22, + 33, + 38, + 12, + 30, + 4, + 4, + 33, + 12, + 11, + 28, + 16, + 11, + 30, + 25, + 53, + 23, + 37, + 26, + 23, + 38, + 41, + 44, + 30, + 16, + 18, + 26, + 22 + ], + "weighted_loads": [ + 0.9385182093828917, + 2.151405293494463, + 3.6482395753264427, + 0.6246060132980347, + 2.4740978237241507, + 0.5549411755055189, + 4.39769552461803, + 0.9418860748410225, + 0.6722708269953728, + 1.3153327871114016, + 0.6800901181995869, + 4.788486832752824, + 1.758715208619833, + 0.7499049063771963, + 0.8499255422502756, + 0.28541622310876846, + 0.961516473442316, + 3.4404517374932766, + 0.06511838361620903, + 2.541987083852291, + 1.6644867472350597, + 2.243338445201516, + 0.3082749117165804, + 2.296184040606022, + 1.556577518582344, + 0.8603211212903261, + 1.5436327811330557, + 3.1280352883040905, + 3.743968700990081, + 1.9866321878507733, + 1.207761973142624, + 1.5429976396262646, + 4.180614411830902, + 0.8708885218948126, + 1.182598135434091, + 1.0631724298000336, + 1.2191601935774088, + 1.8154614549130201, + 2.415829049423337, + 0.9593083467334509, + 2.0569803342223167, + 0.24070917442440987, + 0.16276315599679947, + 2.949743228033185, + 0.4093409851193428, + 0.5088508240878582, + 1.1243032980710268, + 0.7461660467088223, + 0.6035290062427521, + 2.2868139334023, + 1.0184991266578436, + 5.361952621489763, + 1.7209024764597416, + 1.555567104369402, + 1.6196841187775135, + 1.2721813973039389, + 2.8376368563622236, + 4.8074561804533005, + 2.6195540837943554, + 2.113182494416833, + 0.7230181898921728, + 0.9522278811782598, + 1.735683124512434, + 2.464171513915062 + ], + "unique_experts": 64, + "load_cv": 0.49892883267527094, + "normalized_load_entropy": 0.9683346541357839, + "max_load_share": 0.032595325953259535 + } + }, + "s1_period": { + "target_content": { + "tokens": 246, + "top_k": 6, + "decisions": 1476, + "ordered_route_sha256": "3e68958fa03cb65a864ddb8c5109ebb4d2cec40a713d8041132553ed2e431c2a", + "route_weight_sha256": "b76d5ad3fd32c3e699a5e0d4b80d33095de1e08dbcea54eeadd7108692b07164", + "loads": [ + 18, + 22, + 52, + 11, + 38, + 15, + 46, + 23, + 15, + 14, + 6, + 32, + 19, + 17, + 7, + 3, + 18, + 20, + 4, + 42, + 24, + 33, + 7, + 41, + 18, + 17, + 9, + 40, + 44, + 46, + 10, + 31, + 46, + 23, + 16, + 21, + 15, + 33, + 40, + 12, + 27, + 4, + 6, + 31, + 9, + 10, + 19, + 16, + 8, + 31, + 18, + 51, + 17, + 33, + 26, + 21, + 15, + 35, + 39, + 28, + 15, + 22, + 26, + 21 + ], + "weighted_loads": [ + 0.7292234115302563, + 2.1163455173373222, + 3.70455701649189, + 0.5248402701690793, + 2.491543686017394, + 0.5937499385327101, + 4.358284989371896, + 0.898770596832037, + 0.7594831138849258, + 0.8919005021452904, + 0.33805250748991966, + 4.423600109294057, + 1.7272103521972895, + 0.7948403880000114, + 0.2424155194312334, + 0.1848185013514012, + 1.02742263302207, + 2.738448191434145, + 0.11949882097542286, + 2.6348432078957558, + 1.5815552901476622, + 2.1762905959039927, + 0.21868007816374302, + 2.2879020757973194, + 1.0322238765656948, + 0.9068922456353903, + 0.5243932139128447, + 2.7988496758043766, + 3.6647607553750277, + 1.7695430284366012, + 0.4225248768925667, + 1.6297933664172888, + 4.047785304486752, + 0.9657983351498842, + 0.874558825744316, + 1.1799388136714697, + 0.8336293064057827, + 1.8109541591256857, + 2.5784551464021206, + 0.9451257921755314, + 1.9572453256696463, + 1.0845977142453194, + 0.18933156807906926, + 2.6974797369912267, + 0.3006730265915394, + 0.5120164975523949, + 0.728923074901104, + 0.7315162625163794, + 0.5020509175956249, + 2.1563412100076675, + 0.700480567291379, + 5.251975817605853, + 1.1552147008478642, + 1.4028026461601257, + 1.5992472432553768, + 1.237557740882039, + 1.1886299774050713, + 4.454438138753176, + 2.471499014645815, + 1.9684716537594795, + 0.703215941786766, + 1.0614935252815485, + 1.610829193610698, + 2.077101854607463 + ], + "unique_experts": 64, + "load_cv": 0.551881565677631, + "normalized_load_entropy": 0.9625431618589922, + "max_load_share": 0.03523035230352303 + }, + "full_input": { + "tokens": 287, + "top_k": 6, + "decisions": 1722, + "ordered_route_sha256": "c5ee87cbc419aa834aef32454469fe270dde5474dd4fa8ed7bc88b51dc88a5b5", + "route_weight_sha256": "1b5eb3c683717e9f3afa7e419d4ad04cbaeae3e7afe1f98eec4578200178dc83", + "loads": [ + 18, + 22, + 52, + 13, + 41, + 15, + 46, + 25, + 15, + 21, + 14, + 38, + 19, + 18, + 20, + 8, + 18, + 26, + 4, + 42, + 24, + 40, + 13, + 41, + 27, + 19, + 21, + 51, + 44, + 50, + 20, + 32, + 50, + 23, + 22, + 21, + 30, + 38, + 43, + 13, + 28, + 4, + 9, + 36, + 10, + 11, + 23, + 17, + 10, + 33, + 25, + 51, + 27, + 35, + 30, + 23, + 36, + 44, + 49, + 32, + 17, + 22, + 29, + 24 + ], + "weighted_loads": [ + 0.7292234115302563, + 2.1163455173373222, + 3.70455701649189, + 0.5919503616169095, + 2.669018369168043, + 0.5937499385327101, + 4.358284989371896, + 1.05261966958642, + 0.7594831138849258, + 1.3309140354394913, + 1.1692918054759502, + 5.029885860159993, + 1.7272103521972895, + 0.8496603779494762, + 1.0322851557284594, + 0.4946635353844613, + 1.02742263302207, + 3.23470326885581, + 0.11949882097542286, + 2.6348432078957558, + 1.5815552901476622, + 2.5678243283182383, + 0.6762768868356943, + 2.2879020757973194, + 1.5107099376618862, + 1.0109134707599878, + 1.987298658117652, + 3.2010759599506855, + 3.6647607553750277, + 1.9006262058392167, + 1.4303730633109808, + 1.709852373227477, + 4.211589299142361, + 0.9657983351498842, + 1.310012724949047, + 1.1799388136714697, + 1.6586337201297283, + 2.1125799883157015, + 2.8565199561417103, + 0.9787143245339394, + 1.9873764775693417, + 1.0845977142453194, + 0.30472456593997777, + 2.926748459227383, + 0.33978310972452164, + 0.5295396093279123, + 0.979893371462822, + 0.773462763056159, + 0.5726024769246578, + 2.307603519409895, + 0.9895820412784815, + 5.251975817605853, + 1.9748790375888348, + 1.5922283045947552, + 1.8526219725608826, + 1.3564844708889723, + 3.0655078571289778, + 5.220961702987552, + 3.0704679153859615, + 2.15466171503067, + 0.9457759782671928, + 1.0614935252815485, + 1.7370148641057312, + 2.239919425919652 + ], + "unique_experts": 64, + "load_cv": 0.4743555480025599, + "normalized_load_entropy": 0.9719867002816297, + "max_load_share": 0.030197444831591175 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 246, + "ordered_topk_exact_tokens": 157, + "set_exact_tokens": 179, + "mean_set_jaccard": 0.9166085946573751, + "mean_token_weighted_tv": 0.018846646159493583, + "aggregate_load_tv": 0.02913279132791328 + }, + "system_bos": { + "tokens": 246, + "ordered_topk_exact_tokens": 148, + "set_exact_tokens": 183, + "mean_set_jaccard": 0.9219899341850561, + "mean_token_weighted_tv": 0.019651718277482286, + "aggregate_load_tv": 0.02303523035230353 + }, + "system_x": { + "tokens": 246, + "ordered_topk_exact_tokens": 143, + "set_exact_tokens": 174, + "mean_set_jaccard": 0.9027293844367015, + "mean_token_weighted_tv": 0.0302439680232144, + "aggregate_load_tv": 0.02439024390243902 + }, + "system_period": { + "tokens": 246, + "ordered_topk_exact_tokens": 123, + "set_exact_tokens": 157, + "mean_set_jaccard": 0.8831784746418893, + "mean_token_weighted_tv": 0.03226154071337551, + "aggregate_load_tv": 0.034552845528455285 + }, + "bos_at_s0": { + "tokens": 246, + "ordered_topk_exact_tokens": 148, + "set_exact_tokens": 179, + "mean_set_jaccard": 0.9164730933023615, + "mean_token_weighted_tv": 0.021783924996625723, + "aggregate_load_tv": 0.02439024390243903 + }, + "bos_at_s1": { + "tokens": 246, + "ordered_topk_exact_tokens": 150, + "set_exact_tokens": 181, + "mean_set_jaccard": 0.9198025551684088, + "mean_token_weighted_tv": 0.02287889480433707, + "aggregate_load_tv": 0.027777777777777773 + }, + "x_at_s0": { + "tokens": 246, + "ordered_topk_exact_tokens": 131, + "set_exact_tokens": 169, + "mean_set_jaccard": 0.9023809523809524, + "mean_token_weighted_tv": 0.026530168341033583, + "aggregate_load_tv": 0.029810298102981032 + }, + "x_at_s1": { + "tokens": 246, + "ordered_topk_exact_tokens": 139, + "set_exact_tokens": 167, + "mean_set_jaccard": 0.8939217963608207, + "mean_token_weighted_tv": 0.0333481638425416, + "aggregate_load_tv": 0.029132791327913278 + }, + "period_at_s0": { + "tokens": 246, + "ordered_topk_exact_tokens": 125, + "set_exact_tokens": 163, + "mean_set_jaccard": 0.8980255516840882, + "mean_token_weighted_tv": 0.02535301755462599, + "aggregate_load_tv": 0.030487804878048783 + }, + "period_at_s1": { + "tokens": 246, + "ordered_topk_exact_tokens": 129, + "set_exact_tokens": 160, + "mean_set_jaccard": 0.8847270615563297, + "mean_token_weighted_tv": 0.03358054670885705, + "aggregate_load_tv": 0.02981029810298103 + } + } + } + } + }, + { + "id": "wikitext2/raw-validation/2746", + "domain": "english", + "label": "English encyclopedia", + "within_domain_index": 3, + "selection_rank": "00c7a9a1b242b365225d7fdeec777508a5a3d90a76a7cf4cd2e93cee8f1693f4", + "source_text_sha256": "db6c8fe80331ee2c8bdb59c70bba8ad3e62d8c4bdf7a943331bd72023853a086", + "source_characters": 1358, + "source_tokens": 250, + "content_token_ids_sha256": "4882cf630c33f9a7efc5345f4d05852d4eb66b893eea6fc233870fdbe94b6fb7", + "prompt_tokens_by_condition": { + "s0_eos": 274, + "s1_eos": 290, + "s0_bos": 274, + "s1_bos": 290, + "s0_x": 274, + "s1_x": 290, + "s0_period": 274, + "s1_period": 290 + }, + "batch_prompt_tokens": 290, + "content_tokens": 249, + "boundary_crossing_tokens_by_condition": { + "s0_eos": 1, + "s1_eos": 1, + "s0_bos": 1, + "s1_bos": 1, + "s0_x": 1, + "s1_x": 1, + "s0_period": 1, + "s1_period": 1 + }, + "forward_seconds": 1.1587157440080773, + "peak_cuda_memory_allocated_bytes": 27906370560, + "hidden_stages": { + "embedding": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "eb41e5e9636545db6ead49a3c340faa4ce43b154558b9b936e895c641398b6c9", + "mean": -0.00012165336374891922, + "std": 0.09916318953037262, + "rms": 0.09916326403617859, + "max_abs": 1.6875 + }, + "full_input": { + "shape": [ + 274, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cc33097a44ababdf115ca06ad59f0978f8df320c7c25d941dfd40152f73ef22f", + "mean": -0.00018983057816512883, + "std": 0.09802839159965515, + "rms": 0.09802857786417007, + "max_abs": 2.046875 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "eb41e5e9636545db6ead49a3c340faa4ce43b154558b9b936e895c641398b6c9", + "mean": -0.00012165336374891922, + "std": 0.09916318953037262, + "rms": 0.09916326403617859, + "max_abs": 1.6875 + }, + "full_input": { + "shape": [ + 290, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ef2f1054552a9bbad15dcb381b7a2b8f51da055c7a535bbf1eae27092e0a5cb0", + "mean": -0.0003005751932505518, + "std": 0.09841260313987732, + "rms": 0.09841305762529373, + "max_abs": 2.046875 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "eb41e5e9636545db6ead49a3c340faa4ce43b154558b9b936e895c641398b6c9", + "mean": -0.00012165336374891922, + "std": 0.09916318953037262, + "rms": 0.09916326403617859, + "max_abs": 1.6875 + }, + "full_input": { + "shape": [ + 274, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2a66068620aeba1e811edf8d7d32149ada9651d03f56f331b26b9b47665c82d9", + "mean": -0.00018423500296194106, + "std": 0.0979587584733963, + "rms": 0.09795893728733063, + "max_abs": 2.046875 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "eb41e5e9636545db6ead49a3c340faa4ce43b154558b9b936e895c641398b6c9", + "mean": -0.00012165336374891922, + "std": 0.09916318953037262, + "rms": 0.09916326403617859, + "max_abs": 1.6875 + }, + "full_input": { + "shape": [ + 290, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c28992457cd302484d8b80c43446df87ca4ed1bf43ff527639270eaf836ab5e3", + "mean": -0.0002952883078251034, + "std": 0.09834707528352737, + "rms": 0.098347507417202, + "max_abs": 2.046875 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "eb41e5e9636545db6ead49a3c340faa4ce43b154558b9b936e895c641398b6c9", + "mean": -0.00012165336374891922, + "std": 0.09916318953037262, + "rms": 0.09916326403617859, + "max_abs": 1.6875 + }, + "full_input": { + "shape": [ + 274, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c6e73e65eb594d780342a950da7b06917f4d320f66a85d85b8b7bbd545cfb3bb", + "mean": -0.00019796661217696965, + "std": 0.0980057567358017, + "rms": 0.09800595045089722, + "max_abs": 2.046875 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "eb41e5e9636545db6ead49a3c340faa4ce43b154558b9b936e895c641398b6c9", + "mean": -0.00012165336374891922, + "std": 0.09916318953037262, + "rms": 0.09916326403617859, + "max_abs": 1.6875 + }, + "full_input": { + "shape": [ + 290, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "15dc6fed6a87bbca91266c02f91a89e8548558beb1ef4bc7e0c23417ae005605", + "mean": -0.00030826235888525844, + "std": 0.09839128702878952, + "rms": 0.09839176386594772, + "max_abs": 2.046875 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "eb41e5e9636545db6ead49a3c340faa4ce43b154558b9b936e895c641398b6c9", + "mean": -0.00012165336374891922, + "std": 0.09916318953037262, + "rms": 0.09916326403617859, + "max_abs": 1.6875 + }, + "full_input": { + "shape": [ + 274, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "50c0339dad8b876702cf3b7cb8c2dbf7fba83d54653361fb6ec2e229adc06886", + "mean": -0.0001982627436518669, + "std": 0.09795231372117996, + "rms": 0.09795251488685608, + "max_abs": 2.046875 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "eb41e5e9636545db6ead49a3c340faa4ce43b154558b9b936e895c641398b6c9", + "mean": -0.00012165336374891922, + "std": 0.09916318953037262, + "rms": 0.09916326403617859, + "max_abs": 1.6875 + }, + "full_input": { + "shape": [ + 290, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "82ea7f688e4d65c5211f1be3c445142ec463f9d36fa64d43777e07d6d9703f4a", + "mean": -0.000308542134007439, + "std": 0.09834098815917969, + "rms": 0.09834147244691849, + "max_abs": 2.046875 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 249, + "exact_hidden_rows": 249, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999999403953552, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "system_bos": { + "tokens": 249, + "exact_hidden_rows": 249, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999999403953552, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "system_x": { + "tokens": 249, + "exact_hidden_rows": 249, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999999403953552, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "system_period": { + "tokens": 249, + "exact_hidden_rows": 249, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999999403953552, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "bos_at_s0": { + "tokens": 249, + "exact_hidden_rows": 249, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999999403953552, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "bos_at_s1": { + "tokens": 249, + "exact_hidden_rows": 249, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999999403953552, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "x_at_s0": { + "tokens": 249, + "exact_hidden_rows": 249, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999999403953552, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "x_at_s1": { + "tokens": 249, + "exact_hidden_rows": 249, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999999403953552, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "period_at_s0": { + "tokens": 249, + "exact_hidden_rows": 249, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999999403953552, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "period_at_s1": { + "tokens": 249, + "exact_hidden_rows": 249, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999999403953552, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + } + } + }, + "layer_00": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3038dfd17bcb4aa6c0342c34e379f1c0569ad3a9f11c075ff51d7d6259910744", + "mean": -0.0007961372029967606, + "std": 0.09095858782529831, + "rms": 0.09096206724643707, + "max_abs": 2.546875 + }, + "full_input": { + "shape": [ + 274, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c721c51b48a7de2b5847aba771e9148a75745df56fa15f7a43aa429e93c638d1", + "mean": -0.0008620519074611366, + "std": 0.0908648818731308, + "rms": 0.09086897224187851, + "max_abs": 2.546875 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "566d4c3ba76834ed453ccd00075064ddd0e74f41c94c0e2fbea699e81dc6e2b9", + "mean": -0.0007907911203801632, + "std": 0.09109136462211609, + "rms": 0.09109479933977127, + "max_abs": 2.546875 + }, + "full_input": { + "shape": [ + 290, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4285ee5174a53cf979bd2324910337fde00ee874dc6437ccd89e9a00cbfc01f1", + "mean": -0.0009377786773256958, + "std": 0.09139976650476456, + "rms": 0.09140457957983017, + "max_abs": 2.546875 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "da81b4ad1361d0c303b2610eace5618597f2e055f884270fba70b87ff02d91c0", + "mean": -0.0006919677252881229, + "std": 0.09071264415979385, + "rms": 0.09071527421474457, + "max_abs": 2.46875 + }, + "full_input": { + "shape": [ + 274, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ffb1b37429a477bb14ccbd4fe1d47f729be2db8af676f3daae449d2801660718", + "mean": -0.0007565499399788678, + "std": 0.09051629900932312, + "rms": 0.09051945805549622, + "max_abs": 2.46875 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e260f1127a927b01213510db71e1ba2d1ed209197e3cddb4eb61a44eabf0be59", + "mean": -0.0007179898675531149, + "std": 0.09080899506807327, + "rms": 0.0908118337392807, + "max_abs": 2.484375 + }, + "full_input": { + "shape": [ + 290, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d5a22a7cf571989d145194ce63e96314782049a3b086815a62c82c3af900a9e2", + "mean": -0.0008658366859890521, + "std": 0.09104785323143005, + "rms": 0.09105196595191956, + "max_abs": 2.484375 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "05b29370b691b4af3484f65fc4efbcfe25ffcd9fb1fb339e732058354edc67cc", + "mean": -0.0006944857304915786, + "std": 0.09042204916477203, + "rms": 0.09042472392320633, + "max_abs": 2.484375 + }, + "full_input": { + "shape": [ + 274, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7ef2af5b68563d5a204c401eb7e28dc06886b15b33072a4b561faa9932bdc528", + "mean": -0.0007672818610444665, + "std": 0.09030575305223465, + "rms": 0.0903090164065361, + "max_abs": 2.484375 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "89eaf8ec0a55bb726ba06006a29c0908b389a6149d88934a0a070fcb0d61b4e5", + "mean": -0.0007287479238584638, + "std": 0.09057193249464035, + "rms": 0.09057486057281494, + "max_abs": 2.5 + }, + "full_input": { + "shape": [ + 290, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e2a419a2895763e30e495c1c3bf81e463cf791962e1cc8a810547e989ebc8bee", + "mean": -0.0008843939867801964, + "std": 0.09090303629636765, + "rms": 0.09090734273195267, + "max_abs": 2.5 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8115a1cb9127b387a760db76a431e90f62da521e8b77bc45616bb9df4023ef18", + "mean": -0.0006902415188960731, + "std": 0.09043692797422409, + "rms": 0.0904395654797554, + "max_abs": 2.5 + }, + "full_input": { + "shape": [ + 274, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "40230067f3397c3d2f934406bf655831213c2fb53b5de7640df2791d19270b9d", + "mean": -0.0007636933005414903, + "std": 0.09023229032754898, + "rms": 0.09023552387952805, + "max_abs": 2.5 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bdae3665da9ac4730942916971db331be80430e6afefd7d5807e461432369a11", + "mean": -0.0007262635626830161, + "std": 0.0905800387263298, + "rms": 0.0905829519033432, + "max_abs": 2.5 + }, + "full_input": { + "shape": [ + 290, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d52123f9abebe23807a739831b09398b8769316918caa30edfa0deee73a97f72", + "mean": -0.0008817908819764853, + "std": 0.09081900864839554, + "rms": 0.09082327783107758, + "max_abs": 2.5 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9999011158943176, + "min_cosine_similarity": 0.9977515935897827, + "mean_relative_l2": 0.0113316485658288, + "max_abs_delta": 0.078125 + }, + "system_bos": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9997938275337219, + "min_cosine_similarity": 0.9970130920410156, + "mean_relative_l2": 0.01739852875471115, + "max_abs_delta": 0.0859375 + }, + "system_x": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9997904896736145, + "min_cosine_similarity": 0.9969226121902466, + "mean_relative_l2": 0.017902111634612083, + "max_abs_delta": 0.1015625 + }, + "system_period": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9998033046722412, + "min_cosine_similarity": 0.9970033168792725, + "mean_relative_l2": 0.01750190369784832, + "max_abs_delta": 0.0546875 + }, + "bos_at_s0": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9921352863311768, + "min_cosine_similarity": 0.9660946726799011, + "mean_relative_l2": 0.12273190170526505, + "max_abs_delta": 0.214111328125 + }, + "bos_at_s1": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9931184649467468, + "min_cosine_similarity": 0.9696363806724548, + "mean_relative_l2": 0.11501371115446091, + "max_abs_delta": 0.21826171875 + }, + "x_at_s0": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9928175210952759, + "min_cosine_similarity": 0.9659459590911865, + "mean_relative_l2": 0.11678770184516907, + "max_abs_delta": 0.20751953125 + }, + "x_at_s1": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.993709146976471, + "min_cosine_similarity": 0.9698818922042847, + "mean_relative_l2": 0.10950110107660294, + "max_abs_delta": 0.2138671875 + }, + "period_at_s0": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9928668141365051, + "min_cosine_similarity": 0.9687226414680481, + "mean_relative_l2": 0.11652810871601105, + "max_abs_delta": 0.20703125 + }, + "period_at_s1": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9937402606010437, + "min_cosine_similarity": 0.9722691178321838, + "mean_relative_l2": 0.10933626443147659, + "max_abs_delta": 0.201904296875 + } + } + }, + "layer_01": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "15af16c78e307f59f3c96a28ea93ca4325efa80da9bf8cc2a916d0e785ccb5d4", + "mean": -0.0009234388708136976, + "std": 0.1080583855509758, + "rms": 0.10806232690811157, + "max_abs": 2.984375 + }, + "full_input": { + "shape": [ + 274, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9ae5af149b6c499361da515ee56a230fef2b3919760394cd41fb099ba87e0254", + "mean": -0.00200633704662323, + "std": 0.49304690957069397, + "rms": 0.4930509626865387, + "max_abs": 126.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "39ddeab935cb72c3f27bffe7a8d70f335807069ab9009f5484b5c624b713fa4e", + "mean": -0.0009225396788679063, + "std": 0.10829508304595947, + "rms": 0.10829900950193405, + "max_abs": 2.96875 + }, + "full_input": { + "shape": [ + 290, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b572c45c99db754f8c4bc6593eb8506d80643746b369080413958d9d489b0434", + "mean": -0.0021297484636306763, + "std": 0.49674728512763977, + "rms": 0.4967518746852875, + "max_abs": 135.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9db594e8d0fed84aaed26a92ba6f4d21ba7e991799f8aa2fe410093d495d8102", + "mean": -0.0009425593889318407, + "std": 0.10838809609413147, + "rms": 0.10839219391345978, + "max_abs": 2.96875 + }, + "full_input": { + "shape": [ + 274, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c7c60d40e2f5d96b6eb80372ea4b6754db4647c6ea910534d25849382cce2819", + "mean": -0.0009820531122386456, + "std": 0.10895147174596786, + "rms": 0.10895588994026184, + "max_abs": 4.6875 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bb0d4907b0c82d55b3301b48a9651c7ca08a3777eea9f50e6ff7520b9912a9ab", + "mean": -0.0010180127574130893, + "std": 0.10818783193826675, + "rms": 0.10819261521100998, + "max_abs": 2.96875 + }, + "full_input": { + "shape": [ + 290, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3777aad297f9044660ab92102f68303ae12b2035a85f05e70f53c95ff65a7ba1", + "mean": -0.0011759736808016896, + "std": 0.1090455949306488, + "rms": 0.10905194282531738, + "max_abs": 4.6875 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "335daeabe336b1302a2a4cd7a753ded918506cf0c2a7c4df4e50bf208f32203e", + "mean": -0.0009320562821812928, + "std": 0.10840011388063431, + "rms": 0.10840411484241486, + "max_abs": 2.984375 + }, + "full_input": { + "shape": [ + 274, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7944ba997abb0a277349ac316b13b417baa59df3667e8c26a72d21730d14a077", + "mean": -0.0009707330027595162, + "std": 0.10896430164575577, + "rms": 0.10896863043308258, + "max_abs": 4.6875 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a0e29dca50051a1e094e1b677222bc12df789551d92ecf84efbec010c36eaa76", + "mean": -0.0010215358342975378, + "std": 0.10813454538583755, + "rms": 0.10813938081264496, + "max_abs": 2.984375 + }, + "full_input": { + "shape": [ + 290, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "48dba5b6065c6f5ea649af4eab475b181e427d801d8e4ba2d95fedb35c8c50b2", + "mean": -0.0011796527542173862, + "std": 0.10902459919452667, + "rms": 0.10903098434209824, + "max_abs": 4.6875 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "78cb05001972f02b9dd0e13859d37110374dc443100a1e2b167efb848fe0f3a4", + "mean": -0.0009277825593017042, + "std": 0.10835256427526474, + "rms": 0.1083565279841423, + "max_abs": 3.0 + }, + "full_input": { + "shape": [ + 274, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8d82feeeddddd04df9c14a3ee5b7ce21c4ead17d4d4c0537b2dab3d28724d10e", + "mean": -0.0009739520610310137, + "std": 0.10879752784967422, + "rms": 0.10880188643932343, + "max_abs": 4.6875 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e3f512de526bc8cd3168a1102b15a1ac041fba78c7fdbcfd2a2472b7710c5f9b", + "mean": -0.00102340301964432, + "std": 0.10812127590179443, + "rms": 0.10812611877918243, + "max_abs": 2.984375 + }, + "full_input": { + "shape": [ + 290, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1df56403db334b3d49d64e5c3c28bb6bcce89d94d14e5b5a36fb6803d6b3714b", + "mean": -0.0011863590916618705, + "std": 0.10889683663845062, + "rms": 0.10890329629182816, + "max_abs": 4.6875 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9995394945144653, + "min_cosine_similarity": 0.9798831939697266, + "mean_relative_l2": 0.024685624986886978, + "max_abs_delta": 0.123046875 + }, + "system_bos": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9974265098571777, + "min_cosine_similarity": 0.9704318642616272, + "mean_relative_l2": 0.06451860815286636, + "max_abs_delta": 0.1875 + }, + "system_x": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9964996576309204, + "min_cosine_similarity": 0.969257116317749, + "mean_relative_l2": 0.07341021299362183, + "max_abs_delta": 0.171875 + }, + "system_period": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9966211318969727, + "min_cosine_similarity": 0.9692411422729492, + "mean_relative_l2": 0.07203713804483414, + "max_abs_delta": 0.1796875 + }, + "bos_at_s0": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9917254447937012, + "min_cosine_similarity": 0.966188907623291, + "mean_relative_l2": 0.12561267614364624, + "max_abs_delta": 0.19140625 + }, + "bos_at_s1": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9913991093635559, + "min_cosine_similarity": 0.9551259875297546, + "mean_relative_l2": 0.12654677033424377, + "max_abs_delta": 0.2333984375 + }, + "x_at_s0": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.992658257484436, + "min_cosine_similarity": 0.9599959850311279, + "mean_relative_l2": 0.11800694465637207, + "max_abs_delta": 0.2529296875 + }, + "x_at_s1": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9910269379615784, + "min_cosine_similarity": 0.9496183395385742, + "mean_relative_l2": 0.1277252435684204, + "max_abs_delta": 0.291015625 + }, + "period_at_s0": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9927815794944763, + "min_cosine_similarity": 0.9634920358657837, + "mean_relative_l2": 0.11714443564414978, + "max_abs_delta": 0.244140625 + }, + "period_at_s1": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.99103182554245, + "min_cosine_similarity": 0.9510077238082886, + "mean_relative_l2": 0.12779198586940765, + "max_abs_delta": 0.2890625 + } + } + }, + "layer_02": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ae53758f7d8f6e413a8438ab10165780bd5c74ae481e9472b382d4a8605c1076", + "mean": -0.0007945621619001031, + "std": 0.1267530918121338, + "rms": 0.12675558030605316, + "max_abs": 3.75 + }, + "full_input": { + "shape": [ + 274, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "62ef3f8f676510b748d9042214ab8a957a7157f0aae52872454eb77742d47849", + "mean": -0.004298643209040165, + "std": 1.455554723739624, + "rms": 1.4555610418319702, + "max_abs": 392.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5e030e7dd89a8b6da8594474a5318ac3a3a1013fffa5d9b586918a0f8bb2a9f4", + "mean": -0.0007353988476097584, + "std": 0.1269768476486206, + "rms": 0.12697896361351013, + "max_abs": 3.765625 + }, + "full_input": { + "shape": [ + 290, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2c333ae5ff1513e792b9d59807e67bfb10301d0e8478cebbb84c557e80f170a9", + "mean": -0.004727510269731283, + "std": 1.5644171237945557, + "rms": 1.5644240379333496, + "max_abs": 436.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "250ef6fb13dd68c0e71641f056d0a76dc95aa05e18749bb89f083e59e25493ba", + "mean": -0.0007529791328124702, + "std": 0.12818323075771332, + "rms": 0.12818543612957, + "max_abs": 3.8125 + }, + "full_input": { + "shape": [ + 274, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ecbeb4fcc0bd00ae4dd6d4468dfa8854cfcc7c5ddf6f33a574b9c1904c2f2072", + "mean": -0.0009368960163556039, + "std": 0.16134221851825714, + "rms": 0.16134493052959442, + "max_abs": 23.75 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d087c668ade568db176cb30ddfb52096f76ce29f78d6bf7b63484df66c2e0adc", + "mean": -0.0006303421687334776, + "std": 0.12823837995529175, + "rms": 0.12823991477489471, + "max_abs": 3.671875 + }, + "full_input": { + "shape": [ + 290, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b445eb37f18289269ea3f7050ba08a58d97dc76ffecbd44edc6b291fa7ef8744", + "mean": -0.0009065521298907697, + "std": 0.1600373089313507, + "rms": 0.16003987193107605, + "max_abs": 23.75 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7cb19df369aafeea6effb6d2a86336fa6c6396238d35cbabfc54770bab744091", + "mean": -0.000771536841057241, + "std": 0.12788265943527222, + "rms": 0.12788498401641846, + "max_abs": 3.90625 + }, + "full_input": { + "shape": [ + 274, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "67a5eb4579364d96692ef28913d225dc3faa654762bc2563c97b82f8f4a19cc0", + "mean": -0.0009519495069980621, + "std": 0.16113638877868652, + "rms": 0.16113919019699097, + "max_abs": 23.75 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9d2c8e7277eac0453ae94c18a178707befa93e545e595d3ace0f1238b7709bf1", + "mean": -0.0006438154960051179, + "std": 0.1280258744955063, + "rms": 0.12802748382091522, + "max_abs": 3.75 + }, + "full_input": { + "shape": [ + 290, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0a6d1834ddf86cd06653517b6f836304e60a8dbddadacc19c4ef7d7468ac78c7", + "mean": -0.0009152580751106143, + "std": 0.1599150449037552, + "rms": 0.1599176526069641, + "max_abs": 23.75 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5cd26bceca9fbfb562ecfe5a54108021d96c0daf32435b198947d40795d901ea", + "mean": -0.0007507777772843838, + "std": 0.1277887523174286, + "rms": 0.12779095768928528, + "max_abs": 3.875 + }, + "full_input": { + "shape": [ + 274, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "79c03951a13d4c5eb8935dab770a0b82aaf80313c47914d021a4af38094c8088", + "mean": -0.0009564430802129209, + "std": 0.16092069447040558, + "rms": 0.1609235256910324, + "max_abs": 23.75 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1bd9d176c46a25e91de57b45b36953fd74a1acd275115b55a0d26b1cebb40864", + "mean": -0.00063690374372527, + "std": 0.12794767320156097, + "rms": 0.12794926762580872, + "max_abs": 3.75 + }, + "full_input": { + "shape": [ + 290, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2b0e99f8651bb6a2d98efd51fa17da684dd7faffa8da6454d6797a0bac0a4c49", + "mean": -0.0009271149174310267, + "std": 0.15970635414123535, + "rms": 0.15970905125141144, + "max_abs": 23.75 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9992892742156982, + "min_cosine_similarity": 0.9773920774459839, + "mean_relative_l2": 0.031984586268663406, + "max_abs_delta": 0.2109375 + }, + "system_bos": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9969445466995239, + "min_cosine_similarity": 0.9675433039665222, + "mean_relative_l2": 0.07228418439626694, + "max_abs_delta": 0.203125 + }, + "system_x": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9958398938179016, + "min_cosine_similarity": 0.9659066200256348, + "mean_relative_l2": 0.08312254399061203, + "max_abs_delta": 0.25 + }, + "system_period": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9960011839866638, + "min_cosine_similarity": 0.9652830958366394, + "mean_relative_l2": 0.08153246343135834, + "max_abs_delta": 0.234375 + }, + "bos_at_s0": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.992777407169342, + "min_cosine_similarity": 0.9688130617141724, + "mean_relative_l2": 0.11853448301553726, + "max_abs_delta": 0.20703125 + }, + "bos_at_s1": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9911929368972778, + "min_cosine_similarity": 0.9579254984855652, + "mean_relative_l2": 0.12965524196624756, + "max_abs_delta": 0.33203125 + }, + "x_at_s0": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.993238627910614, + "min_cosine_similarity": 0.9610224366188049, + "mean_relative_l2": 0.11324179172515869, + "max_abs_delta": 0.30859375 + }, + "x_at_s1": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.990494966506958, + "min_cosine_similarity": 0.9430041909217834, + "mean_relative_l2": 0.13231642544269562, + "max_abs_delta": 0.404296875 + }, + "period_at_s0": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9932470917701721, + "min_cosine_similarity": 0.9627847671508789, + "mean_relative_l2": 0.11312633752822876, + "max_abs_delta": 0.3125 + }, + "period_at_s1": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9904080629348755, + "min_cosine_similarity": 0.9438062906265259, + "mean_relative_l2": 0.1328495442867279, + "max_abs_delta": 0.416015625 + } + } + }, + "layer_03": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a22a09bbc017af4964e0684bfd1e74e776925e2518e70c6c19e2e4323761e5ea", + "mean": -0.0018247474217787385, + "std": 0.15261158347129822, + "rms": 0.15262249112129211, + "max_abs": 4.5625 + }, + "full_input": { + "shape": [ + 274, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f0ec092e4139cc53e3841e24a8d1c457860326d83b675adaddc09c19b7025ebd", + "mean": -0.006416923366487026, + "std": 4.347276210784912, + "rms": 4.347280502319336, + "max_abs": 1136.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7617a5ae6a8b477b78087b1f91be3b8180730840e92a460759598ebebe7a99c1", + "mean": -0.0017968514002859592, + "std": 0.15286612510681152, + "rms": 0.15287667512893677, + "max_abs": 4.59375 + }, + "full_input": { + "shape": [ + 290, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1daae1cd1482af6dce8ece5682cee37c061fbb9b776c294d81883cf7136d76c1", + "mean": -0.006897957529872656, + "std": 4.363685607910156, + "rms": 4.3636908531188965, + "max_abs": 1136.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9eabb508cc083a95b05cbe058e94e7512b74120d1d3774822350eb8ab6cdef17", + "mean": -0.0018747823778539896, + "std": 0.1536673605442047, + "rms": 0.1536788046360016, + "max_abs": 4.53125 + }, + "full_input": { + "shape": [ + 274, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1fea3ff7133fddf1e1ccdada89a3635761873412a2ac95f770eceef678afcfaf", + "mean": -0.002760697854682803, + "std": 3.875969886779785, + "rms": 3.8759703636169434, + "max_abs": 1136.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ace2c44cdcfa6a7fc62d5f561cb9725e9fc8ed615914a6a70bcc46e42115d9fd", + "mean": -0.0018630987033247948, + "std": 0.1541326344013214, + "rms": 0.15414388477802277, + "max_abs": 4.5 + }, + "full_input": { + "shape": [ + 290, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "088855610c5b02fb28b52cd485c0276840f1e6362c5ab68792931178f9375dcd", + "mean": -0.00281105050817132, + "std": 3.767714262008667, + "rms": 3.7677156925201416, + "max_abs": 1136.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "42a26c6707d6199b1bad2320ab819e0a15342cda865e0fdc46a8d69586b9b1f2", + "mean": -0.0018909178907051682, + "std": 0.15326453745365143, + "rms": 0.15327619016170502, + "max_abs": 4.59375 + }, + "full_input": { + "shape": [ + 274, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c5e4bfabe0fcdbe6d5cbcd50bdb2b908e0201f7e27ebf5e6aa06ccdb2897743e", + "mean": -0.002794035477563739, + "std": 3.8759474754333496, + "rms": 3.875948667526245, + "max_abs": 1136.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "742f3e042e97c591b80497ee7765bcc2a21b7c3f9a53e53cf79e9a3fe6d607e2", + "mean": -0.0018918621353805065, + "std": 0.153833270072937, + "rms": 0.1538449078798294, + "max_abs": 4.5625 + }, + "full_input": { + "shape": [ + 290, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e01175f207d4ae260cc0a79ab7c0202f77107dec6c005951072761d07e57a5ce", + "mean": -0.002851317171007395, + "std": 3.7676987648010254, + "rms": 3.767699718475342, + "max_abs": 1136.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6d461a28ebd4cdf6ed71d5b2af0b5162cd1cd80c238d9aecfe7ff78f7b8821f6", + "mean": -0.0018838044488802552, + "std": 0.15325263142585754, + "rms": 0.15326422452926636, + "max_abs": 4.59375 + }, + "full_input": { + "shape": [ + 274, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d619f94f2bb23731fa94a95b591706b7cc2abc9e3423d57f24ef8b25b5cba3e4", + "mean": -0.002790234051644802, + "std": 3.875941514968872, + "rms": 3.8759422302246094, + "max_abs": 1136.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3a92262ddbabb5927632a0f48cfaa3f535401dd6a119963cfbdef89a78ac84b0", + "mean": -0.0018855007365345955, + "std": 0.15367066860198975, + "rms": 0.15368223190307617, + "max_abs": 4.5625 + }, + "full_input": { + "shape": [ + 290, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a644de974af624287ade001b23e567e0afe4911ade7196b2a72c30de974797b3", + "mean": -0.0028457471635192633, + "std": 3.7676877975463867, + "rms": 3.7676892280578613, + "max_abs": 1136.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9992057085037231, + "min_cosine_similarity": 0.9845360517501831, + "mean_relative_l2": 0.03429251164197922, + "max_abs_delta": 0.125 + }, + "system_bos": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9970183372497559, + "min_cosine_similarity": 0.9645400643348694, + "mean_relative_l2": 0.07099884003400803, + "max_abs_delta": 0.28125 + }, + "system_x": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9957578182220459, + "min_cosine_similarity": 0.9548783898353577, + "mean_relative_l2": 0.08344774693250656, + "max_abs_delta": 0.40625 + }, + "system_period": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9958571195602417, + "min_cosine_similarity": 0.9545773267745972, + "mean_relative_l2": 0.08228331804275513, + "max_abs_delta": 0.3125 + }, + "bos_at_s0": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9936066269874573, + "min_cosine_similarity": 0.9716494083404541, + "mean_relative_l2": 0.11024090647697449, + "max_abs_delta": 0.296875 + }, + "bos_at_s1": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.99190753698349, + "min_cosine_similarity": 0.958317756652832, + "mean_relative_l2": 0.12337470054626465, + "max_abs_delta": 0.40625 + }, + "x_at_s0": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9939361810684204, + "min_cosine_similarity": 0.9640480279922485, + "mean_relative_l2": 0.10555332154035568, + "max_abs_delta": 0.34375 + }, + "x_at_s1": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9911277294158936, + "min_cosine_similarity": 0.9410871267318726, + "mean_relative_l2": 0.1264115571975708, + "max_abs_delta": 0.515625 + }, + "period_at_s0": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9938895106315613, + "min_cosine_similarity": 0.965008020401001, + "mean_relative_l2": 0.10611558705568314, + "max_abs_delta": 0.328125 + }, + "period_at_s1": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9910187125205994, + "min_cosine_similarity": 0.9416911005973816, + "mean_relative_l2": 0.12720519304275513, + "max_abs_delta": 0.484375 + } + } + }, + "layer_04": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c840c74efbd1b4e374234d53d8fb3dbd452e626daa4a8f8f8406c0d7032ae947", + "mean": -0.001470207585953176, + "std": 0.17877310514450073, + "rms": 0.17877915501594543, + "max_abs": 5.40625 + }, + "full_input": { + "shape": [ + 274, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0a9c5f192b45c097079da05366f04f333a5b51232a34b2ccf4a143afb316a4f2", + "mean": -0.00601580273360014, + "std": 4.53739070892334, + "rms": 4.5373945236206055, + "max_abs": 1152.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d27e29130d2d2f31b24de12b6333280eb1ca2c2bb4eece889cc59d664cab3adc", + "mean": -0.0014459376689046621, + "std": 0.179100900888443, + "rms": 0.17910674214363098, + "max_abs": 5.34375 + }, + "full_input": { + "shape": [ + 290, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "db1ace969b426fe5e2b63fb6a9d77521c99d8236a5e6d58a3112a20518cf5841", + "mean": -0.00653885817155242, + "std": 4.542369365692139, + "rms": 4.542374134063721, + "max_abs": 1152.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4e694b490975edec5bf7ccdd704f131b53e3ce6190da03eea08aa5e9b54e4faf", + "mean": -0.0015439728740602732, + "std": 0.18071222305297852, + "rms": 0.1807188242673874, + "max_abs": 5.5 + }, + "full_input": { + "shape": [ + 274, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b410bcc773ce6c2a11b855ea1939408f65163cc6369fd8a024136d45b9dfcb67", + "mean": -0.0023974638897925615, + "std": 4.0667643547058105, + "rms": 4.066764831542969, + "max_abs": 1152.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c596b6a1655b93aaf997498c658250af51a23a5d4817089c8b63dc8d6d744c85", + "mean": -0.0015529379015788436, + "std": 0.18118858337402344, + "rms": 0.1811952292919159, + "max_abs": 5.4375 + }, + "full_input": { + "shape": [ + 290, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2809c82d74a8e2b480dc603451922fe208e35bfd4c02638d61b1ed68009c171a", + "mean": -0.0024933242239058018, + "std": 3.9490087032318115, + "rms": 3.949009418487549, + "max_abs": 1152.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6f68b102112958c2447091b766c65223eae02c38af0c51f7cb35057734ce15f3", + "mean": -0.001546348794363439, + "std": 0.18014462292194366, + "rms": 0.18015125393867493, + "max_abs": 5.5 + }, + "full_input": { + "shape": [ + 274, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3f1ae97528e68ad312d9ba622c32f22b830e3e1d296f2a64d54993f5a8c3164b", + "mean": -0.0023849301505833864, + "std": 4.066725254058838, + "rms": 4.066726207733154, + "max_abs": 1152.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d3da54b52ccff7dcbbb75b2decb795d28165f58cbeac06918c10f186f33ebd16", + "mean": -0.0015798027161508799, + "std": 0.18078917264938354, + "rms": 0.1807960718870163, + "max_abs": 5.5 + }, + "full_input": { + "shape": [ + 290, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "56dded23e4c1679199bfb363a76571727698e120e54513534dc5a093ed958170", + "mean": -0.0025051701813936234, + "std": 3.9489777088165283, + "rms": 3.948978900909424, + "max_abs": 1152.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "31921de26f2db5d3d82e6bbe7631823fc29a6f5f5d188f62ce99eda4c10eb8ae", + "mean": -0.0015317917568609118, + "std": 0.18022826313972473, + "rms": 0.18023477494716644, + "max_abs": 5.5 + }, + "full_input": { + "shape": [ + 274, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4a1b1b5a88db8b7a405b3c3fc43c4b5cec26543bf2fc003efe1cb878d44ed02b", + "mean": -0.002379529643803835, + "std": 4.066723823547363, + "rms": 4.0667243003845215, + "max_abs": 1152.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ab74573e69ed44db68fecb0ae3910d342d2673b36e7871a1c88d48e921bc1f47", + "mean": -0.001576820621266961, + "std": 0.18096105754375458, + "rms": 0.18096792697906494, + "max_abs": 5.5 + }, + "full_input": { + "shape": [ + 290, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4ce060e7ebb503e15e2e360702863df84e23314e63da0d5142946178901e14ca", + "mean": -0.0025041094049811363, + "std": 3.948979139328003, + "rms": 3.9489798545837402, + "max_abs": 1152.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9991738796234131, + "min_cosine_similarity": 0.98630690574646, + "mean_relative_l2": 0.03481022268533707, + "max_abs_delta": 0.169921875 + }, + "system_bos": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9971103072166443, + "min_cosine_similarity": 0.9712421298027039, + "mean_relative_l2": 0.06941518932580948, + "max_abs_delta": 0.34375 + }, + "system_x": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9958041906356812, + "min_cosine_similarity": 0.9580150842666626, + "mean_relative_l2": 0.0833834558725357, + "max_abs_delta": 0.34375 + }, + "system_period": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9957715272903442, + "min_cosine_similarity": 0.9575181007385254, + "mean_relative_l2": 0.08379644900560379, + "max_abs_delta": 0.34375 + }, + "bos_at_s0": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.994786262512207, + "min_cosine_similarity": 0.9729914665222168, + "mean_relative_l2": 0.09912265837192535, + "max_abs_delta": 0.34375 + }, + "bos_at_s1": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9930148720741272, + "min_cosine_similarity": 0.9594444036483765, + "mean_relative_l2": 0.1139436811208725, + "max_abs_delta": 0.4375 + }, + "x_at_s0": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9947572350502014, + "min_cosine_similarity": 0.9635151624679565, + "mean_relative_l2": 0.09766531735658646, + "max_abs_delta": 0.375 + }, + "x_at_s1": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9920203685760498, + "min_cosine_similarity": 0.9472498893737793, + "mean_relative_l2": 0.119126096367836, + "max_abs_delta": 0.49609375 + }, + "period_at_s0": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9946423768997192, + "min_cosine_similarity": 0.9636794924736023, + "mean_relative_l2": 0.09893015772104263, + "max_abs_delta": 0.375 + }, + "period_at_s1": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9917962551116943, + "min_cosine_similarity": 0.9484919309616089, + "mean_relative_l2": 0.12161210924386978, + "max_abs_delta": 0.5 + } + } + }, + "layer_05": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "265b9d9a40d5bb257850bdac31fd8fb907c685959cf702d42712523b814df761", + "mean": -0.0016988387797027826, + "std": 0.20093569159507751, + "rms": 0.20094285905361176, + "max_abs": 6.125 + }, + "full_input": { + "shape": [ + 274, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4917cbf416c5d28b156208addfd77e93b72ca715d2a6b27a7d1144de4de04bb6", + "mean": -0.006768229883164167, + "std": 4.676753997802734, + "rms": 4.676758766174316, + "max_abs": 1152.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f135a913d561a3ac831cd600677f947f9662b3b7d390f920facb21aa0bbab324", + "mean": -0.0017563618021085858, + "std": 0.20090612769126892, + "rms": 0.20091378688812256, + "max_abs": 6.125 + }, + "full_input": { + "shape": [ + 290, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1ae00d8dc8867c8f3c9bcd831867f0171f6915506839601f5027c376f1de9668", + "mean": -0.007274794392287731, + "std": 4.6834330558776855, + "rms": 4.683438777923584, + "max_abs": 1152.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "70f8b27dfb5bd884915a45124318b5df9e082e2266063ed147c52d384d26f994", + "mean": -0.001726103713735938, + "std": 0.20284077525138855, + "rms": 0.20284812152385712, + "max_abs": 5.9375 + }, + "full_input": { + "shape": [ + 274, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "531436b02861618982eba1be9c4c93d52eea21a1c09e3cfce31053e7dbbeacdd", + "mean": -0.002745620207861066, + "std": 4.1391143798828125, + "rms": 4.139115333557129, + "max_abs": 1152.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2e0867df3703b6590dec6f15c8665b86e73116fa6ca14f9478352e22ffbc8a6f", + "mean": -0.0018173882272094488, + "std": 0.20236387848854065, + "rms": 0.20237202942371368, + "max_abs": 5.9375 + }, + "full_input": { + "shape": [ + 290, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a4e6617373d95ace03226fc479e5e7241b8deddeb7dab2ff8ce6d9904acf5bf8", + "mean": -0.0028357496485114098, + "std": 4.01846170425415, + "rms": 4.018463134765625, + "max_abs": 1152.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c48d05bbba8647b2f91337a5326c4635d3e341e7e1e11aea1384fcc92dcfd924", + "mean": -0.001861585071310401, + "std": 0.20191690325737, + "rms": 0.20192550122737885, + "max_abs": 6.0 + }, + "full_input": { + "shape": [ + 274, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "845c9f13d04a2a9f3048070e7377e55640c0a799f4aaeabc0d9c1bee111175b3", + "mean": -0.0028403287287801504, + "std": 4.139057159423828, + "rms": 4.1390581130981445, + "max_abs": 1152.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "91dc99c66daa030567f8a7fef9030875c1fe419e418b990aabcfaa68cc947556", + "mean": -0.0020530004985630512, + "std": 0.20128464698791504, + "rms": 0.20129512250423431, + "max_abs": 6.0 + }, + "full_input": { + "shape": [ + 290, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "959a7cd5d0895122201ba5f118202cd1904e7bd82c12f5ee142fde4703ec5fd9", + "mean": -0.0030164713971316814, + "std": 4.018399715423584, + "rms": 4.0184006690979, + "max_abs": 1152.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7ee98594ef8816e365e9e29a26a13678a596cfc45c29013e21e94b8af1b5eeaf", + "mean": -0.0018841063138097525, + "std": 0.2019728422164917, + "rms": 0.20198163390159607, + "max_abs": 5.96875 + }, + "full_input": { + "shape": [ + 274, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2644c7cf9eb3d2e1a56a4d1302e241afe2552207a54e6ae174443045efdebe3c", + "mean": -0.0028637659270316362, + "std": 4.1390509605407715, + "rms": 4.139051914215088, + "max_abs": 1152.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e53dfe0026c62cb7af533e076110d805b54386e590de803c3fd675b0b92fa663", + "mean": -0.002046978799626231, + "std": 0.20157603919506073, + "rms": 0.20158644020557404, + "max_abs": 6.0 + }, + "full_input": { + "shape": [ + 290, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "322f9b7e091e4a71a298252aa1a3610dd0cada37910078cf335c55a660ba4cc5", + "mean": -0.003020472824573517, + "std": 4.018404960632324, + "rms": 4.018406391143799, + "max_abs": 1152.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9988530874252319, + "min_cosine_similarity": 0.9819109439849854, + "mean_relative_l2": 0.04173639416694641, + "max_abs_delta": 0.3515625 + }, + "system_bos": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9964219927787781, + "min_cosine_similarity": 0.9659498333930969, + "mean_relative_l2": 0.07691416144371033, + "max_abs_delta": 0.3125 + }, + "system_x": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9947801828384399, + "min_cosine_similarity": 0.9440256357192993, + "mean_relative_l2": 0.09210143983364105, + "max_abs_delta": 0.375 + }, + "system_period": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9946984052658081, + "min_cosine_similarity": 0.9448134303092957, + "mean_relative_l2": 0.09300826489925385, + "max_abs_delta": 0.375 + }, + "bos_at_s0": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9940735697746277, + "min_cosine_similarity": 0.9745358824729919, + "mean_relative_l2": 0.10492749512195587, + "max_abs_delta": 0.40625 + }, + "bos_at_s1": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9923995733261108, + "min_cosine_similarity": 0.9586087465286255, + "mean_relative_l2": 0.11714088916778564, + "max_abs_delta": 0.6640625 + }, + "x_at_s0": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9939045906066895, + "min_cosine_similarity": 0.95890212059021, + "mean_relative_l2": 0.10445190966129303, + "max_abs_delta": 0.625 + }, + "x_at_s1": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9908520579338074, + "min_cosine_similarity": 0.9430707693099976, + "mean_relative_l2": 0.12500271201133728, + "max_abs_delta": 0.7421875 + }, + "period_at_s0": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9938277006149292, + "min_cosine_similarity": 0.9626250267028809, + "mean_relative_l2": 0.10526085644960403, + "max_abs_delta": 0.515625 + }, + "period_at_s1": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9909173846244812, + "min_cosine_similarity": 0.9490917921066284, + "mean_relative_l2": 0.12559844553470612, + "max_abs_delta": 0.6953125 + } + } + }, + "layer_06": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "54ab73429bdbcc400094ecb157b502e13ffdfbf8fcce6021c844a517722f9520", + "mean": -0.003150566713884473, + "std": 0.23753893375396729, + "rms": 0.23755982518196106, + "max_abs": 7.78125 + }, + "full_input": { + "shape": [ + 274, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "592ad6c4627b53a9c4d46a954ac5effc286911bf39c2fd821e9eb6f132040570", + "mean": -0.0083185825496912, + "std": 4.763189315795898, + "rms": 4.763195991516113, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "053779dd6f322e3add62a4a1f4f3d38ef085861a0b904a4e1cab5a998b62796c", + "mean": -0.0032130598556250334, + "std": 0.23749487102031708, + "rms": 0.2375166118144989, + "max_abs": 7.75 + }, + "full_input": { + "shape": [ + 290, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "33706ffa8b3d5b0e5ff3632cca457996b49342f6b31052f2b576d4884c8ceea0", + "mean": -0.008817297406494617, + "std": 4.7697954177856445, + "rms": 4.769803524017334, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ebea6e946d2f00d3455ba3575c739ae12cd4b79ea3dd144e7b5b2df8c0685a4b", + "mean": -0.0030671819113194942, + "std": 0.2396877557039261, + "rms": 0.2397073656320572, + "max_abs": 7.59375 + }, + "full_input": { + "shape": [ + 274, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cbf46e5bc74ef8fe01081c3259df11db23b24a1ab88f61d333ff0b7f10a63063", + "mean": -0.004085524473339319, + "std": 4.207093238830566, + "rms": 4.207095146179199, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ab10986a6b66bf216d3a3efec29c247505c5b5cd48b646f4299c88439820060e", + "mean": -0.0030555252451449633, + "std": 0.2398146241903305, + "rms": 0.23983407020568848, + "max_abs": 7.6875 + }, + "full_input": { + "shape": [ + 290, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "05acb9240c131c106b2e6a8ab63e4a7610c975ee294db0028ecb7e4d4b1647f8", + "mean": -0.004078922793269157, + "std": 4.084638595581055, + "rms": 4.0846405029296875, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b20d4e266cae52042356fbc657d53a3ffd478f9c6edee65dde7959d858f49b48", + "mean": -0.0032483013346791267, + "std": 0.23826396465301514, + "rms": 0.238286092877388, + "max_abs": 7.625 + }, + "full_input": { + "shape": [ + 274, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "203b97d4492425e9c3a76158e64ece73eaf8e026823972c300421b83e659e4ff", + "mean": -0.00420940387994051, + "std": 4.206997871398926, + "rms": 4.206999778747559, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b9323584a1054f2a13ba97d43ba9964fe12270c7677059042fa43a588471ee4b", + "mean": -0.003263045335188508, + "std": 0.2381025105714798, + "rms": 0.23812486231327057, + "max_abs": 7.6875 + }, + "full_input": { + "shape": [ + 290, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a61ddeeaaae34d4f0a4723e27f2e9552dd36796946829363800bd03db819c44d", + "mean": -0.004223828203976154, + "std": 4.084531307220459, + "rms": 4.08453369140625, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "17c6719af5ca42b1f556c636b3d2adfe6a787632314cd9fcd319ecbdac6e6eec", + "mean": -0.0033058919943869114, + "std": 0.2379819005727768, + "rms": 0.2380048632621765, + "max_abs": 7.625 + }, + "full_input": { + "shape": [ + 274, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4c98cd9046df833d767f4b8c76b0c08392dc40fd80a11a0871a8673a6ea4f938", + "mean": -0.004249483346939087, + "std": 4.206978797912598, + "rms": 4.206981182098389, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f4836398c513573cd347f9553826c409707fa97dd80b27a20ea923f8d8d434bd", + "mean": -0.0033254732843488455, + "std": 0.2385779768228531, + "rms": 0.23860114812850952, + "max_abs": 7.71875 + }, + "full_input": { + "shape": [ + 290, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "84cc476f7262159305eaa0e49eeee0efe5ccb2c401eaaf91f45ad40559993d22", + "mean": -0.0042816088534891605, + "std": 4.084550857543945, + "rms": 4.084552764892578, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9986560344696045, + "min_cosine_similarity": 0.9703963994979858, + "mean_relative_l2": 0.04455221816897392, + "max_abs_delta": 0.30859375 + }, + "system_bos": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9965823888778687, + "min_cosine_similarity": 0.9622056484222412, + "mean_relative_l2": 0.074672631919384, + "max_abs_delta": 0.37890625 + }, + "system_x": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9947490692138672, + "min_cosine_similarity": 0.935785174369812, + "mean_relative_l2": 0.09205932915210724, + "max_abs_delta": 0.41796875 + }, + "system_period": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9945480227470398, + "min_cosine_similarity": 0.9344539642333984, + "mean_relative_l2": 0.09472678601741791, + "max_abs_delta": 0.4296875 + }, + "bos_at_s0": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9945851564407349, + "min_cosine_similarity": 0.9736713171005249, + "mean_relative_l2": 0.09961967915296555, + "max_abs_delta": 0.53125 + }, + "bos_at_s1": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.993007242679596, + "min_cosine_similarity": 0.9604515433311462, + "mean_relative_l2": 0.11230716109275818, + "max_abs_delta": 0.5 + }, + "x_at_s0": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9941399097442627, + "min_cosine_similarity": 0.967391848564148, + "mean_relative_l2": 0.10268799215555191, + "max_abs_delta": 0.59375 + }, + "x_at_s1": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.991248369216919, + "min_cosine_similarity": 0.9512195587158203, + "mean_relative_l2": 0.12293480336666107, + "max_abs_delta": 0.5625 + }, + "period_at_s0": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9940161108970642, + "min_cosine_similarity": 0.9686414003372192, + "mean_relative_l2": 0.1040484607219696, + "max_abs_delta": 0.5 + }, + "period_at_s1": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9912354946136475, + "min_cosine_similarity": 0.9536100029945374, + "mean_relative_l2": 0.12412899732589722, + "max_abs_delta": 0.546875 + } + } + }, + "layer_07": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4384c6fdd6ee8d32df271148b31017922c93ace869e85d847e0d06a6faf5fbb7", + "mean": -0.004134815651923418, + "std": 0.26136893033981323, + "rms": 0.26140162348747253, + "max_abs": 7.625 + }, + "full_input": { + "shape": [ + 274, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e40bb21e4a38e0a1d6f933b1a12d6a3c2623287e2ca9892b4fb7e0dece9610bc", + "mean": -0.009226061403751373, + "std": 4.778073787689209, + "rms": 4.778082847595215, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a6f5f2018a601ea9d679fa2541052f06a70100d5ba9c31866c504894eda96f16", + "mean": -0.0041217501275241375, + "std": 0.2615165710449219, + "rms": 0.26154905557632446, + "max_abs": 7.65625 + }, + "full_input": { + "shape": [ + 290, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0da8634bf667b4d0c2f83096859bbfb0bb26daaba6ff4c5bb0cc0c2bb8c5acb0", + "mean": -0.00977958645671606, + "std": 4.784885406494141, + "rms": 4.784895420074463, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3453d043b832fdd895d28391ab88c543c6b2fbb386c1198f58d0e0c0998efe44", + "mean": -0.0040886858478188515, + "std": 0.26318225264549255, + "rms": 0.26321402192115784, + "max_abs": 7.5625 + }, + "full_input": { + "shape": [ + 274, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "773a02f1dc3d753e456dcbf30a0fd04264aa020a743b123cf6cff8a202af3b0a", + "mean": -0.00500321201980114, + "std": 4.215954780578613, + "rms": 4.2159576416015625, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "39faf665d504efe464951ee5cf41fe7cc620f28aaee595cc677b5b4f324ef6e0", + "mean": -0.004078621976077557, + "std": 0.26338011026382446, + "rms": 0.2634117007255554, + "max_abs": 7.625 + }, + "full_input": { + "shape": [ + 290, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bfc1213ea5e0d99d4033db04029b1713348a4db02b14457d868332f59abc7748", + "mean": -0.00511796772480011, + "std": 4.093343257904053, + "rms": 4.093346118927002, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f31e432cb5f5623a258d07e5da22bb58acfe38ee31009ad0a8a182917bc82b46", + "mean": -0.0042161280289292336, + "std": 0.2613857686519623, + "rms": 0.26141977310180664, + "max_abs": 7.625 + }, + "full_input": { + "shape": [ + 274, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "777b084b27436f6c007c1736caa13413a136505f3dcbfff9cdb7a63a5089064c", + "mean": -0.005132381804287434, + "std": 4.215826034545898, + "rms": 4.215829372406006, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "467374005357917b1037c59c1948dfd72789758808b0c39fe99169cbd700ca48", + "mean": -0.004217113368213177, + "std": 0.26176828145980835, + "rms": 0.2618022561073303, + "max_abs": 7.625 + }, + "full_input": { + "shape": [ + 290, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1d548d387f26816e69b360bb1215d475b941a0b6dc30732374e5938fa62f1120", + "mean": -0.00523804547265172, + "std": 4.093228816986084, + "rms": 4.09323263168335, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "dbf36ca06050ad0ba83af270690df26c78d69f14239fc250555420208ec29cbf", + "mean": -0.004243781790137291, + "std": 0.2611832320690155, + "rms": 0.2612176835536957, + "max_abs": 7.625 + }, + "full_input": { + "shape": [ + 274, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "623fa7e0983b9cb30aef0f13b8294e02d0a1f6ac3b0ca0d15d3f3fc7458e259d", + "mean": -0.0051137180998921394, + "std": 4.215815544128418, + "rms": 4.215818881988525, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cfe5e0a4e0cea7ff7a30dba85074df3a92629f7e055859522c057272df6a0a41", + "mean": -0.004239012021571398, + "std": 0.26204612851142883, + "rms": 0.2620804011821747, + "max_abs": 7.625 + }, + "full_input": { + "shape": [ + 290, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4cbe8e101374d033d881dfbfc62590bd9882d45847eb7c8e43144744c5204071", + "mean": -0.005231397692114115, + "std": 4.0932464599609375, + "rms": 4.093250274658203, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.998429536819458, + "min_cosine_similarity": 0.9576574563980103, + "mean_relative_l2": 0.04754016175866127, + "max_abs_delta": 0.325927734375 + }, + "system_bos": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9962595105171204, + "min_cosine_similarity": 0.9593868255615234, + "mean_relative_l2": 0.07807150483131409, + "max_abs_delta": 0.59375 + }, + "system_x": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9941757321357727, + "min_cosine_similarity": 0.9167059063911438, + "mean_relative_l2": 0.09679900109767914, + "max_abs_delta": 0.59375 + }, + "system_period": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9940044283866882, + "min_cosine_similarity": 0.9154917001724243, + "mean_relative_l2": 0.09896925091743469, + "max_abs_delta": 0.5 + }, + "bos_at_s0": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9942215085029602, + "min_cosine_similarity": 0.9699522852897644, + "mean_relative_l2": 0.10194122791290283, + "max_abs_delta": 0.65625 + }, + "bos_at_s1": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9926321506500244, + "min_cosine_similarity": 0.9612181782722473, + "mean_relative_l2": 0.11468285322189331, + "max_abs_delta": 0.609375 + }, + "x_at_s0": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9938476085662842, + "min_cosine_similarity": 0.9677187204360962, + "mean_relative_l2": 0.10483894497156143, + "max_abs_delta": 0.796875 + }, + "x_at_s1": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9906300902366638, + "min_cosine_similarity": 0.9470888376235962, + "mean_relative_l2": 0.1268119215965271, + "max_abs_delta": 0.640625 + }, + "period_at_s0": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9936882257461548, + "min_cosine_similarity": 0.9690998792648315, + "mean_relative_l2": 0.10638798028230667, + "max_abs_delta": 0.796875 + }, + "period_at_s1": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9906915426254272, + "min_cosine_similarity": 0.949325442314148, + "mean_relative_l2": 0.12717662751674652, + "max_abs_delta": 0.625 + } + } + }, + "layer_08": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f1c8fbb71b85fc79fbd86322107679c428bec4aed73f4620fc4d85ef6bd37f0d", + "mean": -0.007093282416462898, + "std": 0.30109912157058716, + "rms": 0.30118265748023987, + "max_abs": 8.875 + }, + "full_input": { + "shape": [ + 274, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ffea3e87d35e76276b3c8e3b9460f9b6c926a57fdebfd87e2c820a0fd38e6118", + "mean": -0.012028105556964874, + "std": 4.796051979064941, + "rms": 4.796067237854004, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8cf75dbcb7ebb6cbc4cfe9c6811a08b7e4e942362d5e672dcae1a6041cd57fc1", + "mean": -0.007068915758281946, + "std": 0.3012937605381012, + "rms": 0.30137667059898376, + "max_abs": 9.0 + }, + "full_input": { + "shape": [ + 290, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "316c281f27eb9d1a0381b7bfc5bc9f28f00853144264494b0898d3c5b1a2e6a2", + "mean": -0.012331919744610786, + "std": 4.8031086921691895, + "rms": 4.80312442779541, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9b5a2c8f77e36d185259b9f5bd8a93c484532b6ed68612deaabf92408091e53d", + "mean": -0.00699174078181386, + "std": 0.3033820688724518, + "rms": 0.3034626245498657, + "max_abs": 8.9375 + }, + "full_input": { + "shape": [ + 274, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9cc0975f5138c620882bb06fcd93466bd7c6ce2ac34f105539c8d22127c18dbe", + "mean": -0.007785073947161436, + "std": 4.227108478546143, + "rms": 4.227115154266357, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3d1ef6ec33fb688819c77789ed4c2c1b1ff715c0ba75ecfd0ec593bb2ab9d801", + "mean": -0.006925423629581928, + "std": 0.3037163019180298, + "rms": 0.3037952482700348, + "max_abs": 8.75 + }, + "full_input": { + "shape": [ + 290, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f4f19cc083d21fdab6aed8c7ce2675e6f02cca51ac3c7284a738f862ae238216", + "mean": -0.007622100412845612, + "std": 4.104266166687012, + "rms": 4.104273319244385, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "905108dd8ca0ba982af61ac0393e365342bb3154bc71241116fc48b005f125d6", + "mean": -0.007268983405083418, + "std": 0.30071309208869934, + "rms": 0.3008009195327759, + "max_abs": 8.75 + }, + "full_input": { + "shape": [ + 274, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2260145f6f9d5b6593f241b12e5be81afa91448e56560873dd96cd522e25521f", + "mean": -0.008030951023101807, + "std": 4.2269158363342285, + "rms": 4.22692346572876, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "34a86e8c248f559d34b5c38d68068d210497c6d18adbe90a794e51f6331a6709", + "mean": -0.007240328472107649, + "std": 0.3013642132282257, + "rms": 0.301451176404953, + "max_abs": 8.6875 + }, + "full_input": { + "shape": [ + 290, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "25398cabd5730c636126ce5197aba2b1e52857387b4911ad5ea51ca8cf201b9f", + "mean": -0.00786577258259058, + "std": 4.104100227355957, + "rms": 4.10410737991333, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cfbfedca6e222eba77bb20519b4fabae66cf6c89fc29d230292990876aab6613", + "mean": -0.007309574633836746, + "std": 0.3004898726940155, + "rms": 0.3005787432193756, + "max_abs": 8.625 + }, + "full_input": { + "shape": [ + 274, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7d99f854dcaae9173bbf696f6c9e5134b3e64ff64ad63b07f51d05d057c340be", + "mean": -0.008061186410486698, + "std": 4.22690486907959, + "rms": 4.226912021636963, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8274fd3397eb7c59dc8d73ed362acdf044e97cf2723f7205376b5dfbb1b3c1d9", + "mean": -0.007222420535981655, + "std": 0.3016934096813202, + "rms": 0.3017798364162445, + "max_abs": 8.6875 + }, + "full_input": { + "shape": [ + 290, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f5ddbd1afb29aad43cff9d2db69aa1d1ca7dc0fbe35b207b73a16cab188a24e0", + "mean": -0.007826562039554119, + "std": 4.104119777679443, + "rms": 4.104126930236816, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9978862404823303, + "min_cosine_similarity": 0.957384467124939, + "mean_relative_l2": 0.05489545315504074, + "max_abs_delta": 0.366455078125 + }, + "system_bos": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9955363273620605, + "min_cosine_similarity": 0.962222695350647, + "mean_relative_l2": 0.08536175638437271, + "max_abs_delta": 0.5625 + }, + "system_x": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9929359555244446, + "min_cosine_similarity": 0.9177529811859131, + "mean_relative_l2": 0.10711780190467834, + "max_abs_delta": 0.625 + }, + "system_period": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.992791473865509, + "min_cosine_similarity": 0.9171023368835449, + "mean_relative_l2": 0.10893517732620239, + "max_abs_delta": 0.78125 + }, + "bos_at_s0": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9935733079910278, + "min_cosine_similarity": 0.9639580249786377, + "mean_relative_l2": 0.10649099946022034, + "max_abs_delta": 0.625 + }, + "bos_at_s1": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9918794631958008, + "min_cosine_similarity": 0.9522609710693359, + "mean_relative_l2": 0.11977019906044006, + "max_abs_delta": 0.751953125 + }, + "x_at_s0": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9930391311645508, + "min_cosine_similarity": 0.965269923210144, + "mean_relative_l2": 0.11123457551002502, + "max_abs_delta": 0.90625 + }, + "x_at_s1": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9895914196968079, + "min_cosine_similarity": 0.9420087933540344, + "mean_relative_l2": 0.13310232758522034, + "max_abs_delta": 0.6875 + }, + "period_at_s0": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9928696751594543, + "min_cosine_similarity": 0.9630310535430908, + "mean_relative_l2": 0.11283957213163376, + "max_abs_delta": 0.6875 + }, + "period_at_s1": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9897187948226929, + "min_cosine_similarity": 0.9440112113952637, + "mean_relative_l2": 0.13321536779403687, + "max_abs_delta": 0.84375 + } + } + }, + "layer_09": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "188a60b70f7a4d01ad52296b1ab477b0bebb142f2579cfee2d7999aa1c8b2eb5", + "mean": -0.008352980017662048, + "std": 0.3515746593475342, + "rms": 0.3516738712787628, + "max_abs": 12.375 + }, + "full_input": { + "shape": [ + 274, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "61fb215e465be4a34db21738d2f62916b5eb4688db8a8152cac31d3bf1ade150", + "mean": -0.013107804581522942, + "std": 4.79974889755249, + "rms": 4.799766540527344, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "29c1b23fea79576742d546bb9d3a11acea2e1532616f4db722e79cf6d86bf62f", + "mean": -0.008359130471944809, + "std": 0.3512307405471802, + "rms": 0.3513301908969879, + "max_abs": 12.4375 + }, + "full_input": { + "shape": [ + 290, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3b5ee5baf5cc780779c72f8192e2fec9b017875c4ed1bec7e5b060f2025fbf2d", + "mean": -0.013610238209366798, + "std": 4.8066864013671875, + "rms": 4.806705951690674, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c3188e75978e544519c741e0183706f9e57b9a5a2dee3e9f88969b7001aad52a", + "mean": -0.008305159397423267, + "std": 0.3531211316585541, + "rms": 0.35321879386901855, + "max_abs": 12.4375 + }, + "full_input": { + "shape": [ + 274, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f3b5eed0eda9225257bb828ace9083037b69f6fe25fd8afb7630b7f6479fffec", + "mean": -0.008947365917265415, + "std": 4.231207370758057, + "rms": 4.231216907501221, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d8c03600d919ba9154fa6d91c128dd291c33375a9c4700f6d3f00d775ed6ac8c", + "mean": -0.008287355303764343, + "std": 0.35253238677978516, + "rms": 0.35262978076934814, + "max_abs": 12.25 + }, + "full_input": { + "shape": [ + 290, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1d72a1579c31765d82c960c42fc26963d85954ac43e6b8d64c32da0f85145bcd", + "mean": -0.009006337262690067, + "std": 4.108367919921875, + "rms": 4.108377933502197, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "107cbd00fbc1ecbd0e179b9e1859c28a316aba3c7ddde992d7757f05300cab42", + "mean": -0.00850142352283001, + "std": 0.3499229848384857, + "rms": 0.3500262200832367, + "max_abs": 12.125 + }, + "full_input": { + "shape": [ + 274, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fe739dd1ecd0b6c624be3d9b38168ba9c70e38ab4f00d1974b2b7a732654ca56", + "mean": -0.009109340608119965, + "std": 4.230950832366943, + "rms": 4.230960845947266, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cb078ae6dcac5ee41ba850afff96dc8cc1e4f4f8192f34fd0a03135d48ee880f", + "mean": -0.008593919686973095, + "std": 0.34965500235557556, + "rms": 0.34976059198379517, + "max_abs": 12.125 + }, + "full_input": { + "shape": [ + 290, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1a393d2f67a7f47e382dbdccdcc94a94dac88fb503b0e9f7f3dbf600dfa163d9", + "mean": -0.009241034276783466, + "std": 4.108133316040039, + "rms": 4.1081438064575195, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b1b609f90d12fe86f2a98f40226b9ba5779d5d1206a019dece3000cf85917117", + "mean": -0.008555793203413486, + "std": 0.349684476852417, + "rms": 0.3497891128063202, + "max_abs": 12.125 + }, + "full_input": { + "shape": [ + 274, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6e71e29367169073026bbb392f7fcea94b22350245d0afa5d9ccf8fe0157c521", + "mean": -0.009118675254285336, + "std": 4.2309184074401855, + "rms": 4.230928421020508, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f9c8621a6872e45d8e0ce25d95439f01d42b5b3425ddd1448d707ceaac74361f", + "mean": -0.00861979741603136, + "std": 0.35042843222618103, + "rms": 0.3505344092845917, + "max_abs": 12.1875 + }, + "full_input": { + "shape": [ + 290, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8687e8bd6beb8ce75c2e1267587df65c008b532e5fd3b104e73ff916cff902d1", + "mean": -0.009208032861351967, + "std": 4.1081743240356445, + "rms": 4.108184814453125, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9979094862937927, + "min_cosine_similarity": 0.9592450261116028, + "mean_relative_l2": 0.05482584610581398, + "max_abs_delta": 0.75 + }, + "system_bos": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9960458874702454, + "min_cosine_similarity": 0.9631550312042236, + "mean_relative_l2": 0.08099262416362762, + "max_abs_delta": 0.5625 + }, + "system_x": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9931173920631409, + "min_cosine_similarity": 0.9194542169570923, + "mean_relative_l2": 0.10568555444478989, + "max_abs_delta": 1.265625 + }, + "system_period": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9930505752563477, + "min_cosine_similarity": 0.9208194017410278, + "mean_relative_l2": 0.10733605176210403, + "max_abs_delta": 1.25 + }, + "bos_at_s0": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9942387938499451, + "min_cosine_similarity": 0.9670029878616333, + "mean_relative_l2": 0.10022161155939102, + "max_abs_delta": 0.75 + }, + "bos_at_s1": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9925674796104431, + "min_cosine_similarity": 0.949834942817688, + "mean_relative_l2": 0.11384712904691696, + "max_abs_delta": 1.28125 + }, + "x_at_s0": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9938335418701172, + "min_cosine_similarity": 0.9665780067443848, + "mean_relative_l2": 0.10450666397809982, + "max_abs_delta": 0.875 + }, + "x_at_s1": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9903562664985657, + "min_cosine_similarity": 0.9341616630554199, + "mean_relative_l2": 0.12743017077445984, + "max_abs_delta": 1.28125 + }, + "period_at_s0": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9936934113502502, + "min_cosine_similarity": 0.9694368839263916, + "mean_relative_l2": 0.10602514445781708, + "max_abs_delta": 1.0 + }, + "period_at_s1": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9905890226364136, + "min_cosine_similarity": 0.9369370937347412, + "mean_relative_l2": 0.12708505988121033, + "max_abs_delta": 1.53125 + } + } + }, + "layer_10": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "923b992209e510d45bc96aff729d3bf0a4eda439a1d6b849a43f567075ae7357", + "mean": -0.0074011716060340405, + "std": 0.389492928981781, + "rms": 0.3895632326602936, + "max_abs": 12.125 + }, + "full_input": { + "shape": [ + 274, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "101be98f144ffa493d28eee90958e7d92c5978aeca06c32ca1d94e22034f2b3d", + "mean": -0.012425050139427185, + "std": 4.806591510772705, + "rms": 4.806607723236084, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0ae6b2056d0494ae3868e6e165152fec9e6b794af171c13669cd446f71ded8bf", + "mean": -0.007462923880666494, + "std": 0.3894435167312622, + "rms": 0.3895150125026703, + "max_abs": 12.25 + }, + "full_input": { + "shape": [ + 290, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "31881e4625f420017497faaeda2ab0c8e6206c200e416c5637c6a458cd69c08f", + "mean": -0.013093417510390282, + "std": 4.813453197479248, + "rms": 4.813470840454102, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5e7410a19aa7f78e776e35e78e54b23a319fd9383a840b0142e984a4c293c4bb", + "mean": -0.007216365542262793, + "std": 0.3911765217781067, + "rms": 0.3912430703639984, + "max_abs": 12.1875 + }, + "full_input": { + "shape": [ + 274, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bbe26275f02c973faa477b0de7c23ce91d76785569841bac0d667f0331c4bfb9", + "mean": -0.00817531906068325, + "std": 4.238753795623779, + "rms": 4.2387614250183105, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e2f32abd6bdb14e6e312f1aac65dfb52bb8746cc898218753ce22377aca890fd", + "mean": -0.007369326893240213, + "std": 0.3915805518627167, + "rms": 0.39164987206459045, + "max_abs": 12.125 + }, + "full_input": { + "shape": [ + 290, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6c027dfc0e963a58b5e2b2f95a2c981f99ef9ea09f477cb720c6bd3c5e1883ad", + "mean": -0.008484968915581703, + "std": 4.116020202636719, + "rms": 4.116028785705566, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "39434bae704b8f9f0af60f6ece06bcec1130eb4f1c8520fbe4ecc7d7a8cd8b9d", + "mean": -0.007315236609429121, + "std": 0.3883105516433716, + "rms": 0.3883794844150543, + "max_abs": 11.875 + }, + "full_input": { + "shape": [ + 274, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0c7e4c8a8648296889373dc10c785826a50e756862e204bab92561e190443fe1", + "mean": -0.008257031440734863, + "std": 4.238489627838135, + "rms": 4.238497734069824, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2329f2d74b3d6d8f5f864f21197c8a5777c75c722156a02bc1353428a305bf94", + "mean": -0.007700859569013119, + "std": 0.38972657918930054, + "rms": 0.3898026645183563, + "max_abs": 12.0 + }, + "full_input": { + "shape": [ + 290, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0e78c007eb8cd46f532c073710ecf819e803063b1d67d3a2b4f002c1fb2a3801", + "mean": -0.008759478107094765, + "std": 4.115832328796387, + "rms": 4.115841388702393, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "84d27461748a6c06acc198946213eb38e0645605f7891ce69a19b63623ec26ab", + "mean": -0.007409029174596071, + "std": 0.38839465379714966, + "rms": 0.3884652853012085, + "max_abs": 11.875 + }, + "full_input": { + "shape": [ + 274, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9b8bc29208297952e14e24a6768927681555131dfb90c07504b451ae23a5f015", + "mean": -0.008269436657428741, + "std": 4.238482475280762, + "rms": 4.238490104675293, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a6a03a5b90dc44e09ddcf179d095911a4d9d5094a68782e1e065d2adc3190d6f", + "mean": -0.007768901996314526, + "std": 0.3905792534351349, + "rms": 0.3906565010547638, + "max_abs": 12.0625 + }, + "full_input": { + "shape": [ + 290, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "82f436a8bfb489655c8113094a7a2c9ccfae56c42b7c0a7236525dfd1663f8a8", + "mean": -0.008752509951591492, + "std": 4.115888595581055, + "rms": 4.115898132324219, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9976794719696045, + "min_cosine_similarity": 0.9609860777854919, + "mean_relative_l2": 0.058896176517009735, + "max_abs_delta": 0.90625 + }, + "system_bos": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9956870079040527, + "min_cosine_similarity": 0.9682269096374512, + "mean_relative_l2": 0.08548583090305328, + "max_abs_delta": 0.625 + }, + "system_x": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9924769997596741, + "min_cosine_similarity": 0.9284569621086121, + "mean_relative_l2": 0.11224041134119034, + "max_abs_delta": 0.9375 + }, + "system_period": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9923823475837708, + "min_cosine_similarity": 0.9300252199172974, + "mean_relative_l2": 0.11431069672107697, + "max_abs_delta": 0.9375 + }, + "bos_at_s0": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9936937689781189, + "min_cosine_similarity": 0.9607806205749512, + "mean_relative_l2": 0.10526714473962784, + "max_abs_delta": 0.640625 + }, + "bos_at_s1": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9919010996818542, + "min_cosine_similarity": 0.9434212446212769, + "mean_relative_l2": 0.11923798173666, + "max_abs_delta": 1.125 + }, + "x_at_s0": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9931894540786743, + "min_cosine_similarity": 0.9684644937515259, + "mean_relative_l2": 0.11026480793952942, + "max_abs_delta": 1.125 + }, + "x_at_s1": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9892997741699219, + "min_cosine_similarity": 0.9325020909309387, + "mean_relative_l2": 0.13516762852668762, + "max_abs_delta": 1.125 + }, + "period_at_s0": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9930262565612793, + "min_cosine_similarity": 0.9642005562782288, + "mean_relative_l2": 0.11201891303062439, + "max_abs_delta": 1.0 + }, + "period_at_s1": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9895572662353516, + "min_cosine_similarity": 0.9256678819656372, + "mean_relative_l2": 0.13463594019412994, + "max_abs_delta": 1.15625 + } + } + }, + "layer_11": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8804734952ce3b7be9af95b1ea415db9cb6004ab6b1d6bd7fe679d9ed4c9f7ac", + "mean": -0.011662342585623264, + "std": 0.4869029223918915, + "rms": 0.48704254627227783, + "max_abs": 18.5 + }, + "full_input": { + "shape": [ + 274, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8405e2df3bfdbcf10b6b44dcddc50d79bbd27724c536c40552d64ec5ba581346", + "mean": -0.01620498299598694, + "std": 4.839901447296143, + "rms": 4.839929103851318, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "abf1c18139795b8facfb18a35518db4d0855b28d4911f2f5760db75e2848f60e", + "mean": -0.011684630066156387, + "std": 0.4852847158908844, + "rms": 0.48542535305023193, + "max_abs": 18.5 + }, + "full_input": { + "shape": [ + 290, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ffd8726ad022c6e6e4aa02b743c5810c13d2c23cc14b971dde3c81c71c5d307c", + "mean": -0.016610408201813698, + "std": 4.845791339874268, + "rms": 4.84581995010376, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0c9ccb89229b1463418dc7d8fc40aa7a2023d773ae0689c16ec77340ef969488", + "mean": -0.011607437394559383, + "std": 0.488137423992157, + "rms": 0.488275408744812, + "max_abs": 18.5 + }, + "full_input": { + "shape": [ + 274, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3aec4537b925a304d6ee0cac0588f382060171f2e75688b54baef5c966856137", + "mean": -0.012050261721014977, + "std": 4.268318176269531, + "rms": 4.268334865570068, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bc7a9a0d419e95bf0e96aaf9a1a953863a84960101789288f20572c394464d80", + "mean": -0.011770995333790779, + "std": 0.48648175597190857, + "rms": 0.4866241216659546, + "max_abs": 18.25 + }, + "full_input": { + "shape": [ + 290, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3a3ba1dd8389989fb8d3027450e927e63b23bff9a381a6f311fc5bb90bc3a990", + "mean": -0.012146786786615849, + "std": 4.144880294799805, + "rms": 4.144897937774658, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5c1102d069eaf0cd7d8734d325cb0267ae3342e47e1bc616928c6c7ff7e392bd", + "mean": -0.011881347745656967, + "std": 0.4850758910179138, + "rms": 0.48522138595581055, + "max_abs": 18.25 + }, + "full_input": { + "shape": [ + 274, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "73bc6d1d42292e299b694619de756703d9a6a314d7a3b2690d071244152765c5", + "mean": -0.01223371084779501, + "std": 4.26798677444458, + "rms": 4.268004417419434, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d2270b5fa78f7cdf20a97048188410ae00bc9b34af9240fdcf0a2ccc5e64748d", + "mean": -0.01227088738232851, + "std": 0.4846232533454895, + "rms": 0.48477858304977417, + "max_abs": 18.125 + }, + "full_input": { + "shape": [ + 290, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "292ac9ec7d71c4a49ff1543f4424fbde6ee56a2264654c9f5f403d9fdc2a78f3", + "mean": -0.012491587549448013, + "std": 4.144606590270996, + "rms": 4.144625186920166, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3f2597f68eada2f0a23ba8e5e4b5d8a3899e58a5791455cae5060c8b2be1e3b0", + "mean": -0.012056088075041771, + "std": 0.4843837320804596, + "rms": 0.48453375697135925, + "max_abs": 18.25 + }, + "full_input": { + "shape": [ + 274, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "49b8528f313bf56109b14d903744bdabcae399adb36bc60fe33b2dc0e0eb5445", + "mean": -0.012340174056589603, + "std": 4.267895698547363, + "rms": 4.267913818359375, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9e44a7dd4862b0dd939a2abb12d950b29dc386e29059f78b10b04177ecefbfd1", + "mean": -0.012388871982693672, + "std": 0.4856985807418823, + "rms": 0.4858565628528595, + "max_abs": 18.25 + }, + "full_input": { + "shape": [ + 290, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3ea50e35133cf013f43478c4cdd8e56546f880aa0ba04033188b29aec067047d", + "mean": -0.012531292624771595, + "std": 4.144701957702637, + "rms": 4.144721031188965, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9978988766670227, + "min_cosine_similarity": 0.9729079008102417, + "mean_relative_l2": 0.057414595037698746, + "max_abs_delta": 1.625 + }, + "system_bos": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9963511824607849, + "min_cosine_similarity": 0.9684736728668213, + "mean_relative_l2": 0.07910586148500443, + "max_abs_delta": 1.5625 + }, + "system_x": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.993293285369873, + "min_cosine_similarity": 0.9480501413345337, + "mean_relative_l2": 0.10622533410787582, + "max_abs_delta": 1.4375 + }, + "system_period": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9930416345596313, + "min_cosine_similarity": 0.9522212147712708, + "mean_relative_l2": 0.10974156111478806, + "max_abs_delta": 1.5 + }, + "bos_at_s0": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.994763195514679, + "min_cosine_similarity": 0.9626206159591675, + "mean_relative_l2": 0.0956742912530899, + "max_abs_delta": 1.375 + }, + "bos_at_s1": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.993146538734436, + "min_cosine_similarity": 0.9506675601005554, + "mean_relative_l2": 0.10940543562173843, + "max_abs_delta": 2.375 + }, + "x_at_s0": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.994339108467102, + "min_cosine_similarity": 0.9696069955825806, + "mean_relative_l2": 0.10047120600938797, + "max_abs_delta": 1.125 + }, + "x_at_s1": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9907835721969604, + "min_cosine_similarity": 0.9313024878501892, + "mean_relative_l2": 0.12533092498779297, + "max_abs_delta": 1.75 + }, + "period_at_s0": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9942328333854675, + "min_cosine_similarity": 0.9587244391441345, + "mean_relative_l2": 0.10171434283256531, + "max_abs_delta": 1.25 + }, + "period_at_s1": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9910043478012085, + "min_cosine_similarity": 0.934262752532959, + "mean_relative_l2": 0.12481766194105148, + "max_abs_delta": 1.5625 + } + } + }, + "layer_12": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c5cb3eefb994806b0d18f6e7c7b5f639e59f70e106a7a0eadcc6f9a16372792c", + "mean": -0.010525551624596119, + "std": 0.5055177807807922, + "rms": 0.5056273341178894, + "max_abs": 16.625 + }, + "full_input": { + "shape": [ + 274, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c5291266355f5c5ca1781504d0a25c11d94b12781e3f3710c86850b48a032121", + "mean": -0.01542940828949213, + "std": 4.87456750869751, + "rms": 4.874592304229736, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "90fd335463f37b993c6155f8ab3558a852d3ba0df232ea4af25c7e068febf95c", + "mean": -0.010475332848727703, + "std": 0.5037450194358826, + "rms": 0.5038539171218872, + "max_abs": 16.625 + }, + "full_input": { + "shape": [ + 290, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4acd61f3c2c7070c1ec8eb2a61349c265b98247ef98edecabba28bd55aa0a5a4", + "mean": -0.015688952058553696, + "std": 4.882175445556641, + "rms": 4.882200717926025, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "76777e3289cec113eb235fcd63ad46485765cad465891b6bf26d7abc39bf7cd0", + "mean": -0.010467088781297207, + "std": 0.5068392157554626, + "rms": 0.5069472789764404, + "max_abs": 16.75 + }, + "full_input": { + "shape": [ + 274, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "239a563378d8d983d3191950c5862f5a4cc0c9603345f612c697682d0a721164", + "mean": -0.01118524931371212, + "std": 4.277210235595703, + "rms": 4.277225017547607, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8e574ff300a7f624c2eb9fd857bd8eb9f9c7e91264499f01d2735d663eb148df", + "mean": -0.01055365800857544, + "std": 0.5051536560058594, + "rms": 0.5052639245986938, + "max_abs": 16.375 + }, + "full_input": { + "shape": [ + 290, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "419fa2ef6399afcc4e496cd440463dda5140ffd4c372f5656afd826e01336bd4", + "mean": -0.011200647801160812, + "std": 4.154007434844971, + "rms": 4.154023170471191, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1381dc234b9f0cd9da3231ee4d3c074110f56f042b699882f3a91c9573490c18", + "mean": -0.01051649171859026, + "std": 0.5054225921630859, + "rms": 0.5055320262908936, + "max_abs": 16.5 + }, + "full_input": { + "shape": [ + 274, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ca2a361f9101b219a39682001b8acc06524e460ed9a4fe9d1df3ddac437e12b8", + "mean": -0.01126899104565382, + "std": 4.277050495147705, + "rms": 4.277065277099609, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "abcb4e42bf15355331069380132233455ec61ffc898f90b3a2f74f37eb864820", + "mean": -0.010822569951415062, + "std": 0.503344714641571, + "rms": 0.5034610629081726, + "max_abs": 16.375 + }, + "full_input": { + "shape": [ + 290, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "736054d3ea0e7f31406bd6a0e9144c2394f9ee0fdf6956e7b86f6464ae50e76d", + "mean": -0.011375918053090572, + "std": 4.153686046600342, + "rms": 4.1537017822265625, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "dd0bcd6c45d6bc420c9513bdba818425d5a484bf57b2a8432db50391a1941500", + "mean": -0.010731038637459278, + "std": 0.505033016204834, + "rms": 0.5051470398902893, + "max_abs": 16.5 + }, + "full_input": { + "shape": [ + 274, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7355aa9797d47ef7d4323b9bce1d1fd952f1a94372a5c30ba03b1149e0a3d124", + "mean": -0.011368288658559322, + "std": 4.276978015899658, + "rms": 4.276993274688721, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8a733e9fb39da50de6c18e0448de1ae475a101abe162db951125d33bbdbdae2f", + "mean": -0.01085738092660904, + "std": 0.504642903804779, + "rms": 0.504759669303894, + "max_abs": 16.5 + }, + "full_input": { + "shape": [ + 290, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1f112b39601fcb82960387937858b6a1282e9deeff19f4bd1ee2e45c0d8524e9", + "mean": -0.01131004374474287, + "std": 4.15383243560791, + "rms": 4.153847694396973, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9976078867912292, + "min_cosine_similarity": 0.9728282690048218, + "mean_relative_l2": 0.06158355250954628, + "max_abs_delta": 1.125 + }, + "system_bos": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9960225820541382, + "min_cosine_similarity": 0.9609752297401428, + "mean_relative_l2": 0.0829683318734169, + "max_abs_delta": 1.9375 + }, + "system_x": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9926047921180725, + "min_cosine_similarity": 0.9315987229347229, + "mean_relative_l2": 0.11158876866102219, + "max_abs_delta": 1.75 + }, + "system_period": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9922584891319275, + "min_cosine_similarity": 0.9558099508285522, + "mean_relative_l2": 0.11593957245349884, + "max_abs_delta": 1.625 + }, + "bos_at_s0": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9941276907920837, + "min_cosine_similarity": 0.9571083784103394, + "mean_relative_l2": 0.10107269883155823, + "max_abs_delta": 1.4375 + }, + "bos_at_s1": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9924760460853577, + "min_cosine_similarity": 0.947896420955658, + "mean_relative_l2": 0.11484228819608688, + "max_abs_delta": 2.3125 + }, + "x_at_s0": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9937450885772705, + "min_cosine_similarity": 0.9650405645370483, + "mean_relative_l2": 0.10564832389354706, + "max_abs_delta": 1.625 + }, + "x_at_s1": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9897905588150024, + "min_cosine_similarity": 0.911035418510437, + "mean_relative_l2": 0.1322227567434311, + "max_abs_delta": 2.375 + }, + "period_at_s0": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9935587048530579, + "min_cosine_similarity": 0.9535317420959473, + "mean_relative_l2": 0.107456274330616, + "max_abs_delta": 1.5 + }, + "period_at_s1": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9899993538856506, + "min_cosine_similarity": 0.9362409114837646, + "mean_relative_l2": 0.1320757418870926, + "max_abs_delta": 2.0625 + } + } + }, + "layer_13": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7444a6e1de15e434fcc893d208bf4ff0c8d636f8d8765b5f39d4e9d0b58a9b8d", + "mean": -0.012661444954574108, + "std": 0.5520914793014526, + "rms": 0.5522366166114807, + "max_abs": 17.625 + }, + "full_input": { + "shape": [ + 274, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "69d9398a1ef20ff9d0ff972bee12d5b88b2d3efa027471c4970199d778b39d8e", + "mean": -0.017373092472553253, + "std": 4.882683753967285, + "rms": 4.882714748382568, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "51d38a4c7948ededc486930e090a8930d077b83b26a20f4b2b074e236b9218d7", + "mean": -0.012600300833582878, + "std": 0.5502498745918274, + "rms": 0.5503941774368286, + "max_abs": 17.75 + }, + "full_input": { + "shape": [ + 290, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b2a70765fe6f1aceeae4b0f754b3a7b74b91b555b570b250f229a24d3aa524a8", + "mean": -0.017733827233314514, + "std": 4.890369892120361, + "rms": 4.890402317047119, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9f44729f5585c608462459dbf87843ca4babaccc64ca33b8febf23a75cba2206", + "mean": -0.012505000457167625, + "std": 0.554170548915863, + "rms": 0.5543116331100464, + "max_abs": 17.75 + }, + "full_input": { + "shape": [ + 274, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5039108eb835369a1e9e10a7c522f4da880727897bf34c3e5d01987b9f80c900", + "mean": -0.013007904402911663, + "std": 4.285558700561523, + "rms": 4.285577774047852, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "217b45d90d0bf915da8b5863a0d32abf06dd1d1e21b2ad9af055f0c5dfdcc4ab", + "mean": -0.012541200034320354, + "std": 0.5518786907196045, + "rms": 0.5520212054252625, + "max_abs": 17.625 + }, + "full_input": { + "shape": [ + 290, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "34414bbf9c40e19fb96e548ea449cc2856bc10d64a7936c1af78c95a1cdca3dd", + "mean": -0.01310171652585268, + "std": 4.162533760070801, + "rms": 4.162554740905762, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0cccacbb0373180d7665837479d941fee7b6efc71f427cd15fd57c13ce1cc1ed", + "mean": -0.012543179094791412, + "std": 0.5526903867721558, + "rms": 0.5528326630592346, + "max_abs": 17.625 + }, + "full_input": { + "shape": [ + 274, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f2221aa198c958b1c534f69624a25ef260154514ea2390e62f6a2ba9d312406d", + "mean": -0.013124380260705948, + "std": 4.285421371459961, + "rms": 4.285440921783447, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bf2c4fa98290809dfe1e39bc7c747bbba0907a3c3d5b7f071f4c19dc6fc62361", + "mean": -0.012676140293478966, + "std": 0.5503308176994324, + "rms": 0.5504767298698425, + "max_abs": 17.625 + }, + "full_input": { + "shape": [ + 290, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b454469e6265c8873e8ea03427674a280ead57faf842e2617920cec4ea139b5f", + "mean": -0.013146614655852318, + "std": 4.162255764007568, + "rms": 4.162276268005371, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bd51f7286453cb7918ed2de7d2a8d4eb6efc77939a11075bd44014dea8f7a344", + "mean": -0.012723539024591446, + "std": 0.5520369410514832, + "rms": 0.5521835684776306, + "max_abs": 17.5 + }, + "full_input": { + "shape": [ + 274, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ca6453bfeab0d44e21b2b3a0f0fc6d513c5d30219e1f01736f73c0607d25f421", + "mean": -0.0131995202973485, + "std": 4.2852911949157715, + "rms": 4.285311222076416, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0db821192c130f1a0ace23693e279d03f3e7fde9e30836a14efef22f2fc8e5c4", + "mean": -0.012695671059191227, + "std": 0.5512913465499878, + "rms": 0.5514375567436218, + "max_abs": 17.75 + }, + "full_input": { + "shape": [ + 290, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "31f101ae704bd2af4601db915d21aaf26bee9066b5d89c69f0eea76d8b598f7e", + "mean": -0.013094954192638397, + "std": 4.162370204925537, + "rms": 4.16239070892334, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9975392818450928, + "min_cosine_similarity": 0.9740400910377502, + "mean_relative_l2": 0.06274838000535965, + "max_abs_delta": 0.6875 + }, + "system_bos": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9960212707519531, + "min_cosine_similarity": 0.9562970399856567, + "mean_relative_l2": 0.08317738771438599, + "max_abs_delta": 1.6875 + }, + "system_x": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9926559329032898, + "min_cosine_similarity": 0.9292728900909424, + "mean_relative_l2": 0.11149797588586807, + "max_abs_delta": 1.3125 + }, + "system_period": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.992246687412262, + "min_cosine_similarity": 0.9502153396606445, + "mean_relative_l2": 0.11624663323163986, + "max_abs_delta": 1.4375 + }, + "bos_at_s0": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9941771626472473, + "min_cosine_similarity": 0.9562724232673645, + "mean_relative_l2": 0.10075565427541733, + "max_abs_delta": 1.8125 + }, + "bos_at_s1": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9926292300224304, + "min_cosine_similarity": 0.9503605365753174, + "mean_relative_l2": 0.11402188241481781, + "max_abs_delta": 1.6875 + }, + "x_at_s0": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9938318729400635, + "min_cosine_similarity": 0.9667131304740906, + "mean_relative_l2": 0.10492994636297226, + "max_abs_delta": 1.625 + }, + "x_at_s1": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9898994565010071, + "min_cosine_similarity": 0.9097855687141418, + "mean_relative_l2": 0.1315314620733261, + "max_abs_delta": 1.5 + }, + "period_at_s0": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9935147762298584, + "min_cosine_similarity": 0.9566641449928284, + "mean_relative_l2": 0.10772617906332016, + "max_abs_delta": 1.5 + }, + "period_at_s1": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9901212453842163, + "min_cosine_similarity": 0.9372183680534363, + "mean_relative_l2": 0.13132162392139435, + "max_abs_delta": 1.5 + } + } + }, + "layer_14": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c3c95d50eb352b0febe41c1260ed70dbece260dc307c6834834c950696d86778", + "mean": -0.01245985459536314, + "std": 0.6388735175132751, + "rms": 0.6389950513839722, + "max_abs": 20.5 + }, + "full_input": { + "shape": [ + 274, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d636f15d6ac4e450c7b99702a861460c8be2b8453cc8ee3d217425909de6948d", + "mean": -0.016968702897429466, + "std": 4.901118755340576, + "rms": 4.901148319244385, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "44af2e8e9048ebe13e143a89d1f024b6d8afd6e7be6190863a089be127930640", + "mean": -0.012553242035210133, + "std": 0.6362966299057007, + "rms": 0.6364204287528992, + "max_abs": 20.375 + }, + "full_input": { + "shape": [ + 290, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b95c9928ab1ef93a7a69b30427ad2b502419b340c86632d6569d74e87eb782f6", + "mean": -0.017578760161995888, + "std": 4.907872676849365, + "rms": 4.907903671264648, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "318816166339e90b37bb07a429a92c37cafd3c5c2c9432a281568398fdb5aacf", + "mean": -0.012191304937005043, + "std": 0.6419137120246887, + "rms": 0.6420294642448425, + "max_abs": 20.625 + }, + "full_input": { + "shape": [ + 274, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9fb808ded0539c02f35c313d8716d2d72bba4fef4c763e6b182820c331b0f101", + "mean": -0.012502836063504219, + "std": 4.306138515472412, + "rms": 4.306157112121582, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2183abbd586f182e888a1bcbd7f7d11dd13b0a0f3e9a1378580e0d99e37ec300", + "mean": -0.012551219202578068, + "std": 0.6393048167228699, + "rms": 0.6394280195236206, + "max_abs": 20.25 + }, + "full_input": { + "shape": [ + 290, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f3001ec3d3e5e8a789bc7e885f8ba9c4f95a0b48a8a9f6eaa66b7636e75d791a", + "mean": -0.012963088229298592, + "std": 4.18271541595459, + "rms": 4.182735919952393, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "be310f7212a02f9282e1b68734988f06dfa7d65a2248ba20eb177d8840ce6604", + "mean": -0.01222003623843193, + "std": 0.6404221057891846, + "rms": 0.6405386924743652, + "max_abs": 20.25 + }, + "full_input": { + "shape": [ + 274, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0842a507557398b4310bade9ac712ebf857116a731e3c61f5a7b44fcfec9d75f", + "mean": -0.012617290019989014, + "std": 4.305994987487793, + "rms": 4.306013584136963, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "55ecfa2132b6769876f9eb78d42b9b4d54a9c572f5c8b58867c4db30a3820905", + "mean": -0.012746294029057026, + "std": 0.6372162699699402, + "rms": 0.6373437643051147, + "max_abs": 20.25 + }, + "full_input": { + "shape": [ + 290, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1964269ab7c1ad8e7631aedf88176d441a7ed2ed91b6dbdf12de9499e1d228cc", + "mean": -0.013080487959086895, + "std": 4.182374477386475, + "rms": 4.182394981384277, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "89ac59ce1af883a22ecfe9dc5fbffb683aaee1885466aa65e7202c0f67ba9689", + "mean": -0.012387126684188843, + "std": 0.6397489905357361, + "rms": 0.6398689150810242, + "max_abs": 20.125 + }, + "full_input": { + "shape": [ + 274, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "500a0934b5763de224548a9682b7d98e415dec2dc55b2804ce95abf299493dc6", + "mean": -0.012693862430751324, + "std": 4.3058390617370605, + "rms": 4.305857181549072, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "91bda973e9e661354f1528f6f24b4c0bba8c1c8fb3473c9b165d1c1fc2afc229", + "mean": -0.012916543520987034, + "std": 0.6377456784248352, + "rms": 0.6378764510154724, + "max_abs": 20.375 + }, + "full_input": { + "shape": [ + 290, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a8c0c99d53c06bd4caaff7b80cabbbfb6e50968c3dfa869ea37f7386a0e6a50c", + "mean": -0.013190524652600288, + "std": 4.1824164390563965, + "rms": 4.182437419891357, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9976370930671692, + "min_cosine_similarity": 0.9761722683906555, + "mean_relative_l2": 0.06202248856425285, + "max_abs_delta": 0.75 + }, + "system_bos": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9962971210479736, + "min_cosine_similarity": 0.9473355412483215, + "mean_relative_l2": 0.08013948053121567, + "max_abs_delta": 1.875 + }, + "system_x": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9930868744850159, + "min_cosine_similarity": 0.9338389039039612, + "mean_relative_l2": 0.1084618791937828, + "max_abs_delta": 2.5 + }, + "system_period": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9926193952560425, + "min_cosine_similarity": 0.9469602108001709, + "mean_relative_l2": 0.11353903263807297, + "max_abs_delta": 1.75 + }, + "bos_at_s0": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9946855306625366, + "min_cosine_similarity": 0.9504231214523315, + "mean_relative_l2": 0.09606403112411499, + "max_abs_delta": 1.4375 + }, + "bos_at_s1": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9933111071586609, + "min_cosine_similarity": 0.9510869979858398, + "mean_relative_l2": 0.10863038897514343, + "max_abs_delta": 1.875 + }, + "x_at_s0": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9943380951881409, + "min_cosine_similarity": 0.9654787182807922, + "mean_relative_l2": 0.1005082055926323, + "max_abs_delta": 2.0 + }, + "x_at_s1": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.990692138671875, + "min_cosine_similarity": 0.9149794578552246, + "mean_relative_l2": 0.12650007009506226, + "max_abs_delta": 2.5 + }, + "period_at_s0": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9940561652183533, + "min_cosine_similarity": 0.9549875259399414, + "mean_relative_l2": 0.10305364429950714, + "max_abs_delta": 1.625 + }, + "period_at_s1": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9908699989318848, + "min_cosine_similarity": 0.9387823343276978, + "mean_relative_l2": 0.12639525532722473, + "max_abs_delta": 2.0 + } + } + }, + "layer_15": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "98b7a192ea65f004c2b878fa7b2315ed18fa103672e68da90a8e561bbf52dcda", + "mean": -0.01586155965924263, + "std": 0.7060739398002625, + "rms": 0.7062521576881409, + "max_abs": 23.75 + }, + "full_input": { + "shape": [ + 274, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "01ece23393406ea46efafef78af6baf7c478350e76d165e5bc654ee2ffb589e2", + "mean": -0.01986393705010414, + "std": 4.9122490882873535, + "rms": 4.912289142608643, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5ed69cfc6a22c7e7b1494050768296a418b0f1cfffab641d19cd497fdc535d25", + "mean": -0.015913765877485275, + "std": 0.7018664479255676, + "rms": 0.702046811580658, + "max_abs": 23.625 + }, + "full_input": { + "shape": [ + 290, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "96b11163c609237e1f5b4691fa7a28c681242a354c1f9b2627daa753af328cf0", + "mean": -0.020399251952767372, + "std": 4.919013977050781, + "rms": 4.919056415557861, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5bcc26b9cb37c87f4b352a365072f047403ca1fa6d4b8ab11c196b71e062482b", + "mean": -0.015860943123698235, + "std": 0.7098289132118225, + "rms": 0.710006058216095, + "max_abs": 24.0 + }, + "full_input": { + "shape": [ + 274, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b7330a12bf1655c3347a720d731fd50a9f4025c79f45303a7e5b6ad53556f91e", + "mean": -0.015657994896173477, + "std": 4.3185834884643555, + "rms": 4.3186116218566895, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "80d477aeecc035c3681c695a01c3b670965da9c0b6f01773db2767c4bee506b1", + "mean": -0.01613217405974865, + "std": 0.7057575583457947, + "rms": 0.705941915512085, + "max_abs": 23.75 + }, + "full_input": { + "shape": [ + 290, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d2b1b7981d09d1effd3b9117f5972273ca2e6176791fc9293bc832f2f3064e3a", + "mean": -0.015992024913430214, + "std": 4.1954545974731445, + "rms": 4.1954851150512695, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "18885111e61f94e3d1d9fbc4a3b2c522af8c33c616cd76aad17acd234aba606d", + "mean": -0.015936726704239845, + "std": 0.7083099484443665, + "rms": 0.708489179611206, + "max_abs": 23.625 + }, + "full_input": { + "shape": [ + 274, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "78aa2890170eafae24f8c04ad6f98b1d1f083721a43742daa22c208d04b9ad57", + "mean": -0.01580370031297207, + "std": 4.318417549133301, + "rms": 4.318446159362793, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "19a42644262424f9926e7cce799dc8346b37e3b275ed66fbc3649e6f603f5579", + "mean": -0.01660187728703022, + "std": 0.7032713294029236, + "rms": 0.7034672498703003, + "max_abs": 23.5 + }, + "full_input": { + "shape": [ + 290, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "083a764b53d22f9e28a872d44861037a12659dc339d91e570df8a8eff09bcba2", + "mean": -0.016358807682991028, + "std": 4.195010185241699, + "rms": 4.195042133331299, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "be38700461153f52a1e6815547431aeb083aabd14061cb957a8d245baa6b03c6", + "mean": -0.016063403338193893, + "std": 0.7073201537132263, + "rms": 0.7075024843215942, + "max_abs": 23.5 + }, + "full_input": { + "shape": [ + 274, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f9b2489c7286edf57062ce46ebee79a61031dbe4b1b6b9a6ab54c815936f4536", + "mean": -0.015821944922208786, + "std": 4.318199157714844, + "rms": 4.318228244781494, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "33b2ea44bf8c3a6d89a5e035e552cb489a04c99813cf076cfd41cad18c939fe5", + "mean": -0.016854895278811455, + "std": 0.7036427855491638, + "rms": 0.7038446068763733, + "max_abs": 23.75 + }, + "full_input": { + "shape": [ + 290, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4f014507ef7e7989b222a49e582cd2964078dee9cb8b4b3d5e6ab59949ec3dfe", + "mean": -0.01649358868598938, + "std": 4.195052146911621, + "rms": 4.195084571838379, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.99759840965271, + "min_cosine_similarity": 0.9761682748794556, + "mean_relative_l2": 0.06259370595216751, + "max_abs_delta": 1.375 + }, + "system_bos": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9963371157646179, + "min_cosine_similarity": 0.9413002133369446, + "mean_relative_l2": 0.0795077532529831, + "max_abs_delta": 1.5625 + }, + "system_x": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9932400584220886, + "min_cosine_similarity": 0.9425116777420044, + "mean_relative_l2": 0.10752987861633301, + "max_abs_delta": 3.25 + }, + "system_period": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9927582144737244, + "min_cosine_similarity": 0.9443762898445129, + "mean_relative_l2": 0.11263374984264374, + "max_abs_delta": 2.25 + }, + "bos_at_s0": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9948667287826538, + "min_cosine_similarity": 0.9443693161010742, + "mean_relative_l2": 0.09411520510911942, + "max_abs_delta": 1.296875 + }, + "bos_at_s1": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9936026930809021, + "min_cosine_similarity": 0.9506816864013672, + "mean_relative_l2": 0.10609731823205948, + "max_abs_delta": 2.375 + }, + "x_at_s0": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9945463538169861, + "min_cosine_similarity": 0.9640756249427795, + "mean_relative_l2": 0.09872282296419144, + "max_abs_delta": 2.75 + }, + "x_at_s1": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9910301566123962, + "min_cosine_similarity": 0.9265419840812683, + "mean_relative_l2": 0.12435517460107803, + "max_abs_delta": 3.5 + }, + "period_at_s0": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9942305684089661, + "min_cosine_similarity": 0.9538878202438354, + "mean_relative_l2": 0.10141927003860474, + "max_abs_delta": 2.5 + }, + "period_at_s1": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9911186099052429, + "min_cosine_similarity": 0.948135495185852, + "mean_relative_l2": 0.12482541799545288, + "max_abs_delta": 2.75 + } + } + }, + "layer_16": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d7cfd7f7e7b0b4e723db0e7f57c7c26d7e04d2da768ef94ba3225ed9abea69d5", + "mean": -0.0180656798183918, + "std": 0.8098552823066711, + "rms": 0.8100568056106567, + "max_abs": 26.625 + }, + "full_input": { + "shape": [ + 274, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d79b22e9328b4eca1b18842a732b4becf95eabe081abce1c883955bc354e9ddf", + "mean": -0.021824399009346962, + "std": 4.929874420166016, + "rms": 4.929922580718994, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7a072927bc357a21fbd20bae33b41cc39a5cf1b789ee185db07e4a22a451528f", + "mean": -0.018176686018705368, + "std": 0.8074248433113098, + "rms": 0.807629406452179, + "max_abs": 26.5 + }, + "full_input": { + "shape": [ + 290, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "59cf1ca8bc103d68869bad6c38e5c3baeff7cd84f7d8d8771bb09e3d3dd02475", + "mean": -0.02219523675739765, + "std": 4.936577796936035, + "rms": 4.9366278648376465, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3936a30a621229f0b547e5ba402fecdedbc7b34b5be12922bb014d0a3251c896", + "mean": -0.018099186941981316, + "std": 0.812777042388916, + "rms": 0.8129785060882568, + "max_abs": 26.75 + }, + "full_input": { + "shape": [ + 274, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e834e489754ccf84acb71cf823ad91adeac8ae73505c28796a837d9c0bcf1ffc", + "mean": -0.01763511635363102, + "std": 4.3379340171813965, + "rms": 4.33797025680542, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ae4f138763d5ad2ee1c850a6cd52b72691bccdc19efede628e872f961eead637", + "mean": -0.01830914244055748, + "std": 0.8094304203987122, + "rms": 0.8096374869346619, + "max_abs": 26.5 + }, + "full_input": { + "shape": [ + 290, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4feabdeb9e392e861896295ca0d1fcbfc7fb86f625fb52ee75cad6109397c6c0", + "mean": -0.017664795741438866, + "std": 4.215265274047852, + "rms": 4.215301990509033, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "01710e83a12720d71bb34c123267280bfa15fed8c8b03dae8ee11c02eefb7750", + "mean": -0.01820153184235096, + "std": 0.8114740252494812, + "rms": 0.8116781115531921, + "max_abs": 26.25 + }, + "full_input": { + "shape": [ + 274, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1c073f883d905cf6fa9ec9bf5b1a45c5e2b422223755fb9d8dbfdfa6a5cf821a", + "mean": -0.017796257510781288, + "std": 4.337898254394531, + "rms": 4.337934970855713, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2eb17e04159c88106dbc24cbbd326d9bc9414af1dc48e59a3ed55d22fe9d66da", + "mean": -0.018768267706036568, + "std": 0.8076066374778748, + "rms": 0.8078246712684631, + "max_abs": 26.25 + }, + "full_input": { + "shape": [ + 290, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f7cda6f19c7ecea3aa25fd09ab5aea20eb4b1e8da0e32ebc5b2a52437f6fdf1c", + "mean": -0.018055502325296402, + "std": 4.215022087097168, + "rms": 4.215061187744141, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "97b42118407b94925b602f3806e180514864cdd77079fe459b3f019c96b7e9d0", + "mean": -0.01835763268172741, + "std": 0.8111487627029419, + "rms": 0.8113564252853394, + "max_abs": 26.25 + }, + "full_input": { + "shape": [ + 274, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fb4daa84571f8e7cc6e78eaa71ef47ca4863147333c4d70e589742cdbaef75bc", + "mean": -0.01782163418829441, + "std": 4.337687015533447, + "rms": 4.337723731994629, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0b01565c6c0ac2b36ac26c8790a40ca1728de80d80e413b05b3a2e1d8a72493b", + "mean": -0.019006943330168724, + "std": 0.8079275488853455, + "rms": 0.8081511855125427, + "max_abs": 26.5 + }, + "full_input": { + "shape": [ + 290, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "964cceab884484c96c13ff5d6a9adc041a7e07c384bae35526d5a2915377e366", + "mean": -0.018123937770724297, + "std": 4.214985370635986, + "rms": 4.215024471282959, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.997521162033081, + "min_cosine_similarity": 0.9660242199897766, + "mean_relative_l2": 0.06296878308057785, + "max_abs_delta": 1.125 + }, + "system_bos": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9963288307189941, + "min_cosine_similarity": 0.9354713559150696, + "mean_relative_l2": 0.07926123589277267, + "max_abs_delta": 2.3125 + }, + "system_x": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9932518005371094, + "min_cosine_similarity": 0.9445856809616089, + "mean_relative_l2": 0.10737530142068863, + "max_abs_delta": 2.625 + }, + "system_period": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9927995800971985, + "min_cosine_similarity": 0.9419326186180115, + "mean_relative_l2": 0.11222365498542786, + "max_abs_delta": 2.0 + }, + "bos_at_s0": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9948862195014954, + "min_cosine_similarity": 0.938148021697998, + "mean_relative_l2": 0.09333283454179764, + "max_abs_delta": 1.5 + }, + "bos_at_s1": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9936320185661316, + "min_cosine_similarity": 0.9474219083786011, + "mean_relative_l2": 0.10536044836044312, + "max_abs_delta": 2.125 + }, + "x_at_s0": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9945002198219299, + "min_cosine_similarity": 0.9571069478988647, + "mean_relative_l2": 0.09850995987653732, + "max_abs_delta": 2.375 + }, + "x_at_s1": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9910731315612793, + "min_cosine_similarity": 0.9211971759796143, + "mean_relative_l2": 0.12369149178266525, + "max_abs_delta": 3.125 + }, + "period_at_s0": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9941783547401428, + "min_cosine_similarity": 0.9450389742851257, + "mean_relative_l2": 0.10124549269676208, + "max_abs_delta": 2.125 + }, + "period_at_s1": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9911760687828064, + "min_cosine_similarity": 0.9375900030136108, + "mean_relative_l2": 0.12399322539567947, + "max_abs_delta": 2.375 + } + } + }, + "layer_17": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b9dea938cec852d5fabd162e415ff6762bd30b10aa6827971ee0c591957c5ed2", + "mean": -0.019847415387630463, + "std": 0.9391494989395142, + "rms": 0.939359188079834, + "max_abs": 27.875 + }, + "full_input": { + "shape": [ + 274, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "289aaa7fece9807e1c83050eafdb8748ca0947807c9993aa5592f384c8988cda", + "mean": -0.023628922179341316, + "std": 4.95407772064209, + "rms": 4.954133987426758, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ba70215108597e5cdb00093deda54881a28d438923a00f624ebed2a0eeed840e", + "mean": -0.01987932249903679, + "std": 0.9356738328933716, + "rms": 0.9358850121498108, + "max_abs": 27.75 + }, + "full_input": { + "shape": [ + 290, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0c6368cab6fc2192956c1601fb5bb4e09135f07c4132899c7f29912bb2b7bd9f", + "mean": -0.024116957560181618, + "std": 4.960513591766357, + "rms": 4.960572242736816, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a6af1c567e5f464f5da5cd9547641734e0534065b87a363e8e3c384375ae7778", + "mean": -0.019725965335965157, + "std": 0.9436729550361633, + "rms": 0.9438791275024414, + "max_abs": 28.0 + }, + "full_input": { + "shape": [ + 274, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8c9b4556ae04c41c2fdb2e3d7e1b9021b6f9c8ab1687605b0b7230fc048204a8", + "mean": -0.019272208213806152, + "std": 4.365400314331055, + "rms": 4.365443229675293, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6df66392f8047869650e1369af4e71127d95a644b383bc5c2dc02212ce7970c4", + "mean": -0.020034659653902054, + "std": 0.9397134780883789, + "rms": 0.9399270415306091, + "max_abs": 28.125 + }, + "full_input": { + "shape": [ + 290, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a537e1dc853b3581939ec62795872ab1cad99366282346d7328600dca6264359", + "mean": -0.01961446739733219, + "std": 4.243317127227783, + "rms": 4.2433624267578125, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9e255d728b6f0e93afabf72ed3f87c42e6026b8079b4976b81ad7038beca0b3d", + "mean": -0.01989399455487728, + "std": 0.9419384598731995, + "rms": 0.9421485066413879, + "max_abs": 27.625 + }, + "full_input": { + "shape": [ + 274, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1ba300c42eac3cead47924060dcf22f7765b47ca63b07a3c0e8968c19c5c652a", + "mean": -0.019517647102475166, + "std": 4.365320205688477, + "rms": 4.365364074707031, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fd889e754c4ad068d5e793ff94bd337270c858ef7dd8d47a2b6be5bd7f7383b3", + "mean": -0.02046685852110386, + "std": 0.937250554561615, + "rms": 0.9374739527702332, + "max_abs": 28.0 + }, + "full_input": { + "shape": [ + 290, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c4e580756264e8a609b1a6df59385750a46f7076fbc8d4a8371499fc7e3ec4f0", + "mean": -0.01999068446457386, + "std": 4.242997169494629, + "rms": 4.243044376373291, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a1b115b3a9129c4cf70e1eb2a7b3ee40e97346b4ed01868b1f4e5927b82c1830", + "mean": -0.019911015406250954, + "std": 0.9412339925765991, + "rms": 0.9414445757865906, + "max_abs": 27.625 + }, + "full_input": { + "shape": [ + 274, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f1cf30935c8d8265462b181269ab3df5bfc4ba28084728bc9fbdd3a212aa7770", + "mean": -0.019404413178563118, + "std": 4.364986896514893, + "rms": 4.365030288696289, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cdd027f62d7926c810bb6654f603f87f9bda2bf25b60a821b683a1d420af7c33", + "mean": -0.020683802664279938, + "std": 0.9372997879981995, + "rms": 0.9375278949737549, + "max_abs": 27.875 + }, + "full_input": { + "shape": [ + 290, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "76210b47fcafad542e2eefe29917c90dfdfdc36ac538aacfd6f4b7cbbf5e8a4e", + "mean": -0.020020153373479843, + "std": 4.242950916290283, + "rms": 4.242998123168945, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9976351857185364, + "min_cosine_similarity": 0.9715629816055298, + "mean_relative_l2": 0.06184014678001404, + "max_abs_delta": 1.5 + }, + "system_bos": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9965207576751709, + "min_cosine_similarity": 0.9357141256332397, + "mean_relative_l2": 0.07713058590888977, + "max_abs_delta": 2.125 + }, + "system_x": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9936981797218323, + "min_cosine_similarity": 0.9493597745895386, + "mean_relative_l2": 0.10416047275066376, + "max_abs_delta": 2.875 + }, + "system_period": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9932292103767395, + "min_cosine_similarity": 0.9458626508712769, + "mean_relative_l2": 0.1090468317270279, + "max_abs_delta": 2.375 + }, + "bos_at_s0": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9952261447906494, + "min_cosine_similarity": 0.9345440864562988, + "mean_relative_l2": 0.0901598185300827, + "max_abs_delta": 1.421875 + }, + "bos_at_s1": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9941388368606567, + "min_cosine_similarity": 0.9559016227722168, + "mean_relative_l2": 0.10137038677930832, + "max_abs_delta": 1.875 + }, + "x_at_s0": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9948095083236694, + "min_cosine_similarity": 0.9643227458000183, + "mean_relative_l2": 0.09578272700309753, + "max_abs_delta": 2.375 + }, + "x_at_s1": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9916850924491882, + "min_cosine_similarity": 0.9258583188056946, + "mean_relative_l2": 0.11968780308961868, + "max_abs_delta": 3.0 + }, + "period_at_s0": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9944837093353271, + "min_cosine_similarity": 0.9547159671783447, + "mean_relative_l2": 0.0985819548368454, + "max_abs_delta": 2.125 + }, + "period_at_s1": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.99178147315979, + "min_cosine_similarity": 0.9383777379989624, + "mean_relative_l2": 0.11979926377534866, + "max_abs_delta": 2.625 + } + } + }, + "layer_18": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "37d25832093fd5070bc03983dbf6dd0f42e2d900d26da843a38eaee3ddbd9d95", + "mean": -0.02511897124350071, + "std": 1.093851923942566, + "rms": 1.0941402912139893, + "max_abs": 32.5 + }, + "full_input": { + "shape": [ + 274, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8e8327d03bebdea3ce0946a3d7e18a602a729d46ca16ec7aed65505be0f302ce", + "mean": -0.028421906754374504, + "std": 4.988260746002197, + "rms": 4.988341808319092, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4613860134b3e1ea3ae0ae409b78a4608fe7dc596a3c2a2ecffbcc0c80403a88", + "mean": -0.025157134979963303, + "std": 1.08844792842865, + "rms": 1.0887386798858643, + "max_abs": 32.25 + }, + "full_input": { + "shape": [ + 290, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f54fe2da851c99704f3669a1d89cc2b0195d2331f09de87daa23f4db7829cf51", + "mean": -0.028595270588994026, + "std": 4.993990421295166, + "rms": 4.994071960449219, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "89daec83970bc51eec684438cb287713d67b64b5b7e97638b8301b35f74959f1", + "mean": -0.02511649578809738, + "std": 1.0982377529144287, + "rms": 1.0985249280929565, + "max_abs": 32.75 + }, + "full_input": { + "shape": [ + 274, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d12ccab642d73dc9c37e61fbc2c8c3cd6285069133e4cdab887ae0bd74d0f8fe", + "mean": -0.024144694209098816, + "std": 4.402688980102539, + "rms": 4.402755260467529, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3ea5ce33bdb75390225455ef9b642abd435bf84649a88cfd04413a7e00643d33", + "mean": -0.025534849613904953, + "std": 1.0924198627471924, + "rms": 1.092718243598938, + "max_abs": 33.0 + }, + "full_input": { + "shape": [ + 290, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d59c0bea5df61eb84d0ad0896963d2d8f625a088d1248e2fe81d31cf54ea22c7", + "mean": -0.02421564795076847, + "std": 4.280885696411133, + "rms": 4.280953884124756, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "72bf445892a423170860a7f844e84226418960720686d9a1e14e9e745678ded6", + "mean": -0.025262460112571716, + "std": 1.097378134727478, + "rms": 1.0976687669754028, + "max_abs": 33.0 + }, + "full_input": { + "shape": [ + 274, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f7fdeaa20e75f6a2a2fb48aec8a99d87d823600610c001535e35ecb2a8c15a25", + "mean": -0.024379897862672806, + "std": 4.402777194976807, + "rms": 4.4028449058532715, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1ab8a977c17ca69bc80b23fbbbd22a31332b5b18bdb1a0bb4578e3ae3044ee22", + "mean": -0.026050269603729248, + "std": 1.090334177017212, + "rms": 1.0906453132629395, + "max_abs": 32.75 + }, + "full_input": { + "shape": [ + 290, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b5e814f8a44668184a0108c71908efb00b49335fd47e2a035f55e4781b1800c5", + "mean": -0.024692820385098457, + "std": 4.280632495880127, + "rms": 4.280703544616699, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f4e093be4ffd737484d70448d61ad69eefa00690c372e35b13dd3c2c703d6b2b", + "mean": -0.02523563988506794, + "std": 1.097124457359314, + "rms": 1.0974147319793701, + "max_abs": 33.0 + }, + "full_input": { + "shape": [ + 274, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "10b0e3a8f6aeb05c3443559f59d20c73c08c61a74b25eda6686f18e72831ba59", + "mean": -0.02425158955156803, + "std": 4.40251350402832, + "rms": 4.402580738067627, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1b951423d5316c5a9d9a71a306e05c77f5dbb4330ac9b830dc467e82eca2c0d6", + "mean": -0.026231609284877777, + "std": 1.0881050825119019, + "rms": 1.0884212255477905, + "max_abs": 32.75 + }, + "full_input": { + "shape": [ + 290, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "47fac92192a1b0586ae99e80a5f9f786eb22d6edde9653f650c4ca29c23313df", + "mean": -0.024721859022974968, + "std": 4.280018329620361, + "rms": 4.280089855194092, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9977147579193115, + "min_cosine_similarity": 0.9752199649810791, + "mean_relative_l2": 0.0608670711517334, + "max_abs_delta": 2.375 + }, + "system_bos": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9967585206031799, + "min_cosine_similarity": 0.940276563167572, + "mean_relative_l2": 0.07476868480443954, + "max_abs_delta": 1.625 + }, + "system_x": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9940727949142456, + "min_cosine_similarity": 0.9590600728988647, + "mean_relative_l2": 0.10127852857112885, + "max_abs_delta": 3.3125 + }, + "system_period": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9935163259506226, + "min_cosine_similarity": 0.9523937106132507, + "mean_relative_l2": 0.107066310942173, + "max_abs_delta": 2.875 + }, + "bos_at_s0": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.995547890663147, + "min_cosine_similarity": 0.9342924356460571, + "mean_relative_l2": 0.08684125542640686, + "max_abs_delta": 1.6328125 + }, + "bos_at_s1": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9944789409637451, + "min_cosine_similarity": 0.9586367607116699, + "mean_relative_l2": 0.0984918400645256, + "max_abs_delta": 2.125 + }, + "x_at_s0": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9951462745666504, + "min_cosine_similarity": 0.9687914848327637, + "mean_relative_l2": 0.09236686676740646, + "max_abs_delta": 2.125 + }, + "x_at_s1": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9922074675559998, + "min_cosine_similarity": 0.9421635866165161, + "mean_relative_l2": 0.11620919406414032, + "max_abs_delta": 3.0625 + }, + "period_at_s0": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9948693513870239, + "min_cosine_similarity": 0.9605952501296997, + "mean_relative_l2": 0.09500382095575333, + "max_abs_delta": 1.75 + }, + "period_at_s1": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9922696352005005, + "min_cosine_similarity": 0.9521999955177307, + "mean_relative_l2": 0.11641169339418411, + "max_abs_delta": 2.875 + } + } + }, + "layer_19": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f11dcabb37ac058e47eb17f0a698594aa891c4ae3ad0e2fe62620d3784d39ace", + "mean": -0.026775484904646873, + "std": 1.2358911037445068, + "rms": 1.2361810207366943, + "max_abs": 32.5 + }, + "full_input": { + "shape": [ + 274, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "71ddb49a7a9ee50a72ddcd5a65226932f9b6565df8df5568a8cb728e6bfd1808", + "mean": -0.029741454869508743, + "std": 5.018734931945801, + "rms": 5.01882266998291, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "82fba364d3e350b42da374bee66096d278eb5fe9808f2614f3f19078fc89c35a", + "mean": -0.026665853336453438, + "std": 1.2309808731079102, + "rms": 1.2312695980072021, + "max_abs": 31.25 + }, + "full_input": { + "shape": [ + 290, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "75a008e76ad3e38d0bb353beac59c7a32577f9c7d38d732cf72ee4468da454f9", + "mean": -0.02950311452150345, + "std": 5.024332046508789, + "rms": 5.02441930770874, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "619e4bf7c1a66309ef1e2c98cbf00404a646cd394e99b5a65291627156f3b7e4", + "mean": -0.02694121189415455, + "std": 1.240110993385315, + "rms": 1.240403652191162, + "max_abs": 32.25 + }, + "full_input": { + "shape": [ + 274, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a9f3ffde0bec80494a8a00bd698222039d2201facfc15c9e197ccc59297bed4e", + "mean": -0.02567303739488125, + "std": 4.437434196472168, + "rms": 4.4375081062316895, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "55633c61dcb022ae66a531ade9230da1613aea9b6971254b2e7fcd87e47125ec", + "mean": -0.027106374502182007, + "std": 1.2351349592208862, + "rms": 1.2354323863983154, + "max_abs": 32.0 + }, + "full_input": { + "shape": [ + 290, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b2ff049d6a2e2105f18284398f6bb8454cda10b297cf1936a428ab605e5df8be", + "mean": -0.025220992043614388, + "std": 4.316317558288574, + "rms": 4.3163909912109375, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bbaafa3188779c5a85a26a2afc2661b2c23e9e4f6123a23b77b1519676bdb60d", + "mean": -0.02706403099000454, + "std": 1.239539384841919, + "rms": 1.2398349046707153, + "max_abs": 31.75 + }, + "full_input": { + "shape": [ + 274, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "108c3f6d11500256ab2824a4326096812cef69dcff88556a61bfd1a3a392663b", + "mean": -0.02592095173895359, + "std": 4.437732696533203, + "rms": 4.437808036804199, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e0c50f7269211ab925747d18fb7e6970dbffc3725f4ffb1c354b8dd8a02b7235", + "mean": -0.02728305011987686, + "std": 1.2326050996780396, + "rms": 1.2329069375991821, + "max_abs": 31.375 + }, + "full_input": { + "shape": [ + 290, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0c5070a81262c7dfd614b9926b350141401f928211fa73bc7d2851d20a8cffe2", + "mean": -0.025371136143803596, + "std": 4.315896987915039, + "rms": 4.315971374511719, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cb48a2a0e92ade080d2730a6ef9cd83194469f1fdfdf5e522ff2bcce01123cb7", + "mean": -0.02704370580613613, + "std": 1.239342212677002, + "rms": 1.2396372556686401, + "max_abs": 31.625 + }, + "full_input": { + "shape": [ + 274, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ac8cf738ff19df264ba8aabb4d9800729edde480bc18850d04a550bf0d71b42e", + "mean": -0.0258408822119236, + "std": 4.437406063079834, + "rms": 4.43748140335083, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d21cd9a5f8404cb3d4d72fdb21614b2460f9cc93168df96990b1d2c60b3ee228", + "mean": -0.027355236932635307, + "std": 1.2300034761428833, + "rms": 1.230307698249817, + "max_abs": 31.25 + }, + "full_input": { + "shape": [ + 290, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "69f17dc54de87c4a550fabeca5acfcca7bdc6e4e0e8d99ccf30d179a5dbd8533", + "mean": -0.025382040068507195, + "std": 4.315186977386475, + "rms": 4.315261363983154, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9978174567222595, + "min_cosine_similarity": 0.9755376577377319, + "mean_relative_l2": 0.05978436395525932, + "max_abs_delta": 1.5625 + }, + "system_bos": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9968401789665222, + "min_cosine_similarity": 0.9262697696685791, + "mean_relative_l2": 0.07323969900608063, + "max_abs_delta": 1.4453125 + }, + "system_x": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9942741394042969, + "min_cosine_similarity": 0.9558205008506775, + "mean_relative_l2": 0.099287249147892, + "max_abs_delta": 3.65625 + }, + "system_period": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9937025308609009, + "min_cosine_similarity": 0.9467242956161499, + "mean_relative_l2": 0.10507901757955551, + "max_abs_delta": 3.1875 + }, + "bos_at_s0": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.995657742023468, + "min_cosine_similarity": 0.9196890592575073, + "mean_relative_l2": 0.08540332317352295, + "max_abs_delta": 1.625 + }, + "bos_at_s1": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9947590231895447, + "min_cosine_similarity": 0.9586240649223328, + "mean_relative_l2": 0.09594204276800156, + "max_abs_delta": 2.125 + }, + "x_at_s0": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.995322585105896, + "min_cosine_similarity": 0.9694510698318481, + "mean_relative_l2": 0.0905534029006958, + "max_abs_delta": 2.5 + }, + "x_at_s1": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9924725890159607, + "min_cosine_similarity": 0.9388357400894165, + "mean_relative_l2": 0.11385752260684967, + "max_abs_delta": 3.75 + }, + "period_at_s0": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9950559735298157, + "min_cosine_similarity": 0.9615008234977722, + "mean_relative_l2": 0.0930163562297821, + "max_abs_delta": 2.625 + }, + "period_at_s1": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9925341010093689, + "min_cosine_similarity": 0.9477404356002808, + "mean_relative_l2": 0.1140800416469574, + "max_abs_delta": 3.375 + } + } + }, + "layer_20": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4f575c7309fd2d27420ae526c8d29e45aa6746a353b0408f54cfd92e1673031a", + "mean": -0.03490268439054489, + "std": 1.4271759986877441, + "rms": 1.4276026487350464, + "max_abs": 44.0 + }, + "full_input": { + "shape": [ + 274, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d1b53c0dfb1b2b17c9e3308020337bafa04e8cd65d89f9a4b031b584f088ee5c", + "mean": -0.0371578112244606, + "std": 5.209575176239014, + "rms": 5.209707260131836, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "920a33ecee0bb627c3734c5fa3b83894a4de3f7d151e455eca24fe4cfce13e15", + "mean": -0.03488676995038986, + "std": 1.4225974082946777, + "rms": 1.423025131225586, + "max_abs": 42.25 + }, + "full_input": { + "shape": [ + 290, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "818934ea6a2a082a6811b2338dd38c9e93b433c01c79d25bf4bc2324701e2daa", + "mean": -0.03658561035990715, + "std": 5.222019672393799, + "rms": 5.222147464752197, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9e32fe44508e238a973b72acf0623219daf04509dc70e14c5763313e15d36f80", + "mean": -0.035069022327661514, + "std": 1.430994987487793, + "rms": 1.4314244985580444, + "max_abs": 44.0 + }, + "full_input": { + "shape": [ + 274, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5b033813958eff04fcfac3945ffb42a719faab587ab801b4d842f0f01262a545", + "mean": -0.033314768224954605, + "std": 4.493063926696777, + "rms": 4.493186950683594, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1501ae57df775061351b176616b2c412707f457b5d80f0e6eb713ba54189b39f", + "mean": -0.035178620368242264, + "std": 1.4248250722885132, + "rms": 1.4252592325210571, + "max_abs": 43.25 + }, + "full_input": { + "shape": [ + 290, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "339686b0c7a14b1dbf7e9a35f043ce7b8bedd32a8e71bce10f7af6245e33dfd3", + "mean": -0.032403040677309036, + "std": 4.3726325035095215, + "rms": 4.3727521896362305, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "63696dc3059c68237d3caa0c0031806a15c38c9de7db0ae400ec28fa6a946852", + "mean": -0.035153090953826904, + "std": 1.4305598735809326, + "rms": 1.4309916496276855, + "max_abs": 42.0 + }, + "full_input": { + "shape": [ + 274, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "29d132fc348253536516480af1a20b211168f8c942043f0bd42ade6c7c8414b0", + "mean": -0.03353577479720116, + "std": 4.493551254272461, + "rms": 4.49367618560791, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "44e4588c646d59ffe865339fab8d612694720421d7713570874c912964936c3e", + "mean": -0.03536106273531914, + "std": 1.4224032163619995, + "rms": 1.4228427410125732, + "max_abs": 41.5 + }, + "full_input": { + "shape": [ + 290, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2c760eb08b862cf7762cd841979889bcd22e84724ad276c9772fd82e8bf094ed", + "mean": -0.032546598464250565, + "std": 4.372332572937012, + "rms": 4.372453212738037, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "084f6868ffaecc03d48b42c66e509ed12e9304b30cb4207027f500fc80b6bed9", + "mean": -0.03502538055181503, + "std": 1.4306836128234863, + "rms": 1.431112289428711, + "max_abs": 42.0 + }, + "full_input": { + "shape": [ + 274, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6766c8219419e4d105a20eb91b287a2fe57500bee9bdd7f70840c9a6e5ac6e7f", + "mean": -0.033324092626571655, + "std": 4.4932637214660645, + "rms": 4.493386745452881, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c9ed148634ec82bf573a8a2865a0e5cc7822613113a64c0fb8398a5d53b349ff", + "mean": -0.03556477651000023, + "std": 1.4194622039794922, + "rms": 1.4199076890945435, + "max_abs": 41.5 + }, + "full_input": { + "shape": [ + 290, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "357fe4ee889650c7628cb95afdde1025f7510a8b24932dc1389985cdd5d6fc0c", + "mean": -0.03263808786869049, + "std": 4.371316909790039, + "rms": 4.371438503265381, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9978633522987366, + "min_cosine_similarity": 0.9766040444374084, + "mean_relative_l2": 0.05926801636815071, + "max_abs_delta": 1.75 + }, + "system_bos": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9970044493675232, + "min_cosine_similarity": 0.9268008470535278, + "mean_relative_l2": 0.07142838835716248, + "max_abs_delta": 1.703125 + }, + "system_x": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9944809079170227, + "min_cosine_similarity": 0.9552724957466125, + "mean_relative_l2": 0.09782389551401138, + "max_abs_delta": 3.9375 + }, + "system_period": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.993782639503479, + "min_cosine_similarity": 0.9471134543418884, + "mean_relative_l2": 0.10459339618682861, + "max_abs_delta": 3.5 + }, + "bos_at_s0": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9959030747413635, + "min_cosine_similarity": 0.918404757976532, + "mean_relative_l2": 0.08274378627538681, + "max_abs_delta": 2.0 + }, + "bos_at_s1": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.995064377784729, + "min_cosine_similarity": 0.9576653242111206, + "mean_relative_l2": 0.09310877323150635, + "max_abs_delta": 2.4375 + }, + "x_at_s0": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9956117272377014, + "min_cosine_similarity": 0.9717373847961426, + "mean_relative_l2": 0.08771605044603348, + "max_abs_delta": 3.0 + }, + "x_at_s1": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9927475452423096, + "min_cosine_similarity": 0.943450391292572, + "mean_relative_l2": 0.11186978220939636, + "max_abs_delta": 4.75 + }, + "period_at_s0": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9953837394714355, + "min_cosine_similarity": 0.9656245112419128, + "mean_relative_l2": 0.08983900398015976, + "max_abs_delta": 3.0 + }, + "period_at_s1": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9927107095718384, + "min_cosine_similarity": 0.9521315097808838, + "mean_relative_l2": 0.11294592171907425, + "max_abs_delta": 4.75 + } + } + }, + "layer_21": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cc87d2fc93c5b0c0e52bf81e591825f6964899dad6dcb7d5ca6bc081db9abe71", + "mean": -0.0354190468788147, + "std": 1.6007418632507324, + "rms": 1.6011335849761963, + "max_abs": 56.0 + }, + "full_input": { + "shape": [ + 274, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a959d2eb8cd0f24bb149478d64f0a716bf0eefcd31c55841aac5e19533b9e17d", + "mean": -0.03737659007310867, + "std": 5.303069114685059, + "rms": 5.303200721740723, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bf2cc3092e1c9a726045258b1a11d017aec11f6883aabaf44943b264c75f82b7", + "mean": -0.03564070537686348, + "std": 1.5961260795593262, + "rms": 1.5965240001678467, + "max_abs": 53.5 + }, + "full_input": { + "shape": [ + 290, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a715af0c97a969375729ba399a87634a1f63f71c767f3aaae7beddc7edad0392", + "mean": -0.036785781383514404, + "std": 5.310610294342041, + "rms": 5.310737609863281, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "03619a271177c45188e0fb2979b86f56adcfe04d1b38661eda1e802389579a3a", + "mean": -0.03536497801542282, + "std": 1.6031025648117065, + "rms": 1.6034924983978271, + "max_abs": 56.5 + }, + "full_input": { + "shape": [ + 274, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2f010b1e76d47f86ed79d017eae17f64cf4d9a51274eec714d25a1ae8b6a14cc", + "mean": -0.033253997564315796, + "std": 4.538453578948975, + "rms": 4.538575649261475, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9fed7c6fb1164fa876de80a54c241515157d926301bd76cb97e6feebfc19896a", + "mean": -0.03560233116149902, + "std": 1.5974525213241577, + "rms": 1.5978492498397827, + "max_abs": 55.0 + }, + "full_input": { + "shape": [ + 290, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "322afda9e117479b0a521cb3326492e3c1b1eb754d0e103a434699f7586a3711", + "mean": -0.032260216772556305, + "std": 4.420597076416016, + "rms": 4.420714855194092, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c7cbaf2eccf04f70b194221dab387fddc5227cc1c1b8316790188bb0932927c2", + "mean": -0.03597322851419449, + "std": 1.606385588645935, + "rms": 1.6067882776260376, + "max_abs": 54.0 + }, + "full_input": { + "shape": [ + 274, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "64d66d99626e7d94fed05425d4cb703cfd3bc08262a39ac5008170066750abb7", + "mean": -0.03397521376609802, + "std": 4.540472507476807, + "rms": 4.540599822998047, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2588d6de395eedd075384b44aac6b89e99d6e84ee68a814081f4cb569d5a8707", + "mean": -0.03634091094136238, + "std": 1.60069739818573, + "rms": 1.6011098623275757, + "max_abs": 53.5 + }, + "full_input": { + "shape": [ + 290, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ab9a7ec96af2759e52590bd5be84d21b6ed858ea8a7601affc5d325b487333bd", + "mean": -0.03298676013946533, + "std": 4.4225568771362305, + "rms": 4.422679424285889, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fcfb35a05119fd3ddb449cc69c10a05e88008838d5e51a7345525f5ce57c6d9a", + "mean": -0.035773519426584244, + "std": 1.6059657335281372, + "rms": 1.606364130973816, + "max_abs": 53.75 + }, + "full_input": { + "shape": [ + 274, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "19cd7a3cda0c6ebd93dbfe108bd9cdfa00a88d6b13e4cda39369fbc7151c72c1", + "mean": -0.033704254776239395, + "std": 4.539735317230225, + "rms": 4.539860248565674, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "44e6efbd4a880209a0de507d65953e1e416598fb8bcbec805fe50268e1950f5b", + "mean": -0.03631867095828056, + "std": 1.5971460342407227, + "rms": 1.5975589752197266, + "max_abs": 53.0 + }, + "full_input": { + "shape": [ + 290, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ba2d6ee67f67ef40ff8479d13c6bc5883a142abf418190f631153b04ce525c99", + "mean": -0.032851193100214005, + "std": 4.42085599899292, + "rms": 4.420977592468262, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9976055026054382, + "min_cosine_similarity": 0.9670649766921997, + "mean_relative_l2": 0.06306695193052292, + "max_abs_delta": 2.5 + }, + "system_bos": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9967653751373291, + "min_cosine_similarity": 0.9254018664360046, + "mean_relative_l2": 0.07454707473516464, + "max_abs_delta": 3.25 + }, + "system_x": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.993952214717865, + "min_cosine_similarity": 0.9537651538848877, + "mean_relative_l2": 0.10285177081823349, + "max_abs_delta": 4.5 + }, + "system_period": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.993264377117157, + "min_cosine_similarity": 0.9455129504203796, + "mean_relative_l2": 0.1091061607003212, + "max_abs_delta": 4.75 + }, + "bos_at_s0": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9956478476524353, + "min_cosine_similarity": 0.9167243242263794, + "mean_relative_l2": 0.0858500525355339, + "max_abs_delta": 5.125 + }, + "bos_at_s1": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9949230551719666, + "min_cosine_similarity": 0.9515180587768555, + "mean_relative_l2": 0.09453333914279938, + "max_abs_delta": 2.75 + }, + "x_at_s0": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9953746795654297, + "min_cosine_similarity": 0.960387110710144, + "mean_relative_l2": 0.09050837904214859, + "max_abs_delta": 4.0 + }, + "x_at_s1": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9924431443214417, + "min_cosine_similarity": 0.9520570635795593, + "mean_relative_l2": 0.11480189859867096, + "max_abs_delta": 5.5 + }, + "period_at_s0": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9951451420783997, + "min_cosine_similarity": 0.9534041285514832, + "mean_relative_l2": 0.09266428649425507, + "max_abs_delta": 4.0 + }, + "period_at_s1": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9923738241195679, + "min_cosine_similarity": 0.9478656053543091, + "mean_relative_l2": 0.11617950350046158, + "max_abs_delta": 6.25 + } + } + }, + "layer_22": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1bb6329a7545ae4d28a5c1cf80d2f4a5762a7f3d674e3760c185496302b692df", + "mean": -0.04293925687670708, + "std": 1.8601243495941162, + "rms": 1.8606197834014893, + "max_abs": 70.5 + }, + "full_input": { + "shape": [ + 274, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c0178f92161822fdd2e2aad0dd06785d3168577ecdae8aaf1a24496e9f88f040", + "mean": -0.04435490444302559, + "std": 5.382787227630615, + "rms": 5.382969379425049, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c8a51b76da1bc2a9e1097686fa83db8a7d2e384dcd977faba9260994553fbf25", + "mean": -0.043062638491392136, + "std": 1.8554818630218506, + "rms": 1.8559815883636475, + "max_abs": 68.0 + }, + "full_input": { + "shape": [ + 290, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9340ad08d16584d5de34f81d5c8609a1b1104917c533106b1d0301425d17ee0d", + "mean": -0.0435079000890255, + "std": 5.391132354736328, + "rms": 5.391307353973389, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ed13a61590abd40fd23ba1227279008125669cc378190d688a06c072ba44cea5", + "mean": -0.04313454031944275, + "std": 1.8616745471954346, + "rms": 1.862174153327942, + "max_abs": 71.0 + }, + "full_input": { + "shape": [ + 274, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ebe8d346d3b7f2c5e301d6dc08a865ec6c8af0ad1bcd66e6d1f6f5fbf9740b9a", + "mean": -0.04051527753472328, + "std": 4.631458759307861, + "rms": 4.631636142730713, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "63db27b3d679cb2b3b07f9720edf2701ffe1e974f8e9117d7f6c0c4ec98bafea", + "mean": -0.043164875358343124, + "std": 1.8557559251785278, + "rms": 1.8562579154968262, + "max_abs": 69.5 + }, + "full_input": { + "shape": [ + 290, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "49dc79a6494d2848980b13b6f64ce1ede974c86e1b7c0cc9c76e869bbad88249", + "mean": -0.0390993133187294, + "std": 4.517045497894287, + "rms": 4.517214298248291, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d57507b7c0e437a6d1d7dac15fc335164e497706b59d957ae13d26a1e98646fb", + "mean": -0.04396294802427292, + "std": 1.865559697151184, + "rms": 1.8660776615142822, + "max_abs": 68.0 + }, + "full_input": { + "shape": [ + 274, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ead65dc14cf471e77a92e9e6cad1b1bf911dc4c8f575c7ca228c4becce66d590", + "mean": -0.04134833812713623, + "std": 4.63413143157959, + "rms": 4.634315490722656, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d90ed968917d7d180864a8a023adcebdb0e3b8b0a5448e168b08567daef746d3", + "mean": -0.04404985159635544, + "std": 1.8603235483169556, + "rms": 1.8608449697494507, + "max_abs": 68.0 + }, + "full_input": { + "shape": [ + 290, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bdcacba1336954f857b224a786b79b5f62836e73e12035fc93205784f41f1b4f", + "mean": -0.039803557097911835, + "std": 4.520174503326416, + "rms": 4.520349502563477, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "19623186159b2adbe53bd41098aeaa3e3d406a74d01b903ed97432206aa27465", + "mean": -0.0436907634139061, + "std": 1.865174412727356, + "rms": 1.8656859397888184, + "max_abs": 68.0 + }, + "full_input": { + "shape": [ + 274, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "acda896f6c9054aafb57471f2771fb46fd5c3aa23998804ab2282fa547bcf27d", + "mean": -0.04110164940357208, + "std": 4.633212089538574, + "rms": 4.633394241333008, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5cbb86e42f7e21385bd4ec4a769f5f0038c604253791b00fc3b3eccd682c4c5c", + "mean": -0.044076964259147644, + "std": 1.8559353351593018, + "rms": 1.8564586639404297, + "max_abs": 68.0 + }, + "full_input": { + "shape": [ + 290, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c8e20bdecb58780b292208851bd2b1e89c1aeb6b469a2fa31f3bd76d0c4237e7", + "mean": -0.03969909995794296, + "std": 4.517784595489502, + "rms": 4.517958641052246, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9977061748504639, + "min_cosine_similarity": 0.9691656827926636, + "mean_relative_l2": 0.061544399708509445, + "max_abs_delta": 3.0 + }, + "system_bos": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9968900084495544, + "min_cosine_similarity": 0.9261730909347534, + "mean_relative_l2": 0.07264985144138336, + "max_abs_delta": 4.375 + }, + "system_x": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9941832423210144, + "min_cosine_similarity": 0.9458615183830261, + "mean_relative_l2": 0.1005098894238472, + "max_abs_delta": 6.25 + }, + "system_period": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9935370087623596, + "min_cosine_similarity": 0.9430902004241943, + "mean_relative_l2": 0.1066407561302185, + "max_abs_delta": 6.25 + }, + "bos_at_s0": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9958433508872986, + "min_cosine_similarity": 0.9137294292449951, + "mean_relative_l2": 0.08336175978183746, + "max_abs_delta": 6.0 + }, + "bos_at_s1": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9951295852661133, + "min_cosine_similarity": 0.945396900177002, + "mean_relative_l2": 0.09184527397155762, + "max_abs_delta": 3.375 + }, + "x_at_s0": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9955736994743347, + "min_cosine_similarity": 0.9632205963134766, + "mean_relative_l2": 0.08790513873100281, + "max_abs_delta": 4.5 + }, + "x_at_s1": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9927616119384766, + "min_cosine_similarity": 0.9501907825469971, + "mean_relative_l2": 0.11174965649843216, + "max_abs_delta": 7.25 + }, + "period_at_s0": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9953656792640686, + "min_cosine_similarity": 0.9571258425712585, + "mean_relative_l2": 0.0900140330195427, + "max_abs_delta": 5.0 + }, + "period_at_s1": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9927194714546204, + "min_cosine_similarity": 0.9456092119216919, + "mean_relative_l2": 0.11310035735368729, + "max_abs_delta": 8.25 + } + } + }, + "layer_23": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "42c9d26ac01d723609b84cc1a673fb2fc6c7c630c95a3c601af8d33d1c6ede6b", + "mean": -0.052287545055150986, + "std": 2.3044703006744385, + "rms": 2.305063486099243, + "max_abs": 96.0 + }, + "full_input": { + "shape": [ + 274, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "25a62d9ec1f5e5fcaa9e1821d3e10672ede73749b01990539725e37bf3a2fd62", + "mean": -0.052930381149053574, + "std": 5.525460243225098, + "rms": 5.525712966918945, + "max_abs": 1160.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "49ae57f896afbdf118c2502b6dce8ee3d7a295552d5a6e0668470462941671a4", + "mean": -0.052754949778318405, + "std": 2.29996395111084, + "rms": 2.3005690574645996, + "max_abs": 96.0 + }, + "full_input": { + "shape": [ + 290, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "be1187e1f6aaee5adf611b13bd10dfbe3d42a1c3faa72e8b6f331a668ffa4c6b", + "mean": -0.0514143742620945, + "std": 5.532882213592529, + "rms": 5.533121109008789, + "max_abs": 1160.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "42ff7f99c862aca3f4df998cad454afe55d0c65125fe8a87d7ca4a884b8fb69a", + "mean": -0.05243881419301033, + "std": 2.3037257194519043, + "rms": 2.3043222427368164, + "max_abs": 96.0 + }, + "full_input": { + "shape": [ + 274, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b440f2c8cefbf4bee96c7f4274aa92fb97de96dbff126879d38310b14c13302e", + "mean": -0.04909568279981613, + "std": 4.801450252532959, + "rms": 4.801700592041016, + "max_abs": 1160.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f710275f43fa6af9f2084a074d35f11672d6eeceaa2c9e2c9e1035b29885104a", + "mean": -0.05292004719376564, + "std": 2.2989375591278076, + "rms": 2.299546480178833, + "max_abs": 96.0 + }, + "full_input": { + "shape": [ + 290, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8f81bff44d71389ad6fdbe9d5dbc7d39a4915bced0e5cc5fb0c44d47e8c9bccd", + "mean": -0.04711359366774559, + "std": 4.692527770996094, + "rms": 4.6927642822265625, + "max_abs": 1160.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c0da4ae153b955558f9f55f5f17f91216ba5afe5d8c42c28897c001b8c1a2b4c", + "mean": -0.05290588364005089, + "std": 2.3071048259735107, + "rms": 2.307711362838745, + "max_abs": 96.0 + }, + "full_input": { + "shape": [ + 274, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fca7ba7069b09a8063dbc5ec6b58efdf6e0eb81ca159313500cea9671d123672", + "mean": -0.049525052309036255, + "std": 4.805117607116699, + "rms": 4.80537223815918, + "max_abs": 1160.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b73b65d3513ce3a32835b0bb1079a008bbaab752f78402fc25a89e0576711a4f", + "mean": -0.053542207926511765, + "std": 2.3029065132141113, + "rms": 2.3035287857055664, + "max_abs": 96.5 + }, + "full_input": { + "shape": [ + 290, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8ee4cd420dea2ed53b0b0b0755ce909c8044f6ec051ef07e4a3896024a563a66", + "mean": -0.04763204604387283, + "std": 4.696628570556641, + "rms": 4.696869373321533, + "max_abs": 1160.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d31d58f9a383222abaf5d5a3ef43eecbdfe63ec5e3560274bebf33983488aab2", + "mean": -0.052782632410526276, + "std": 2.3069581985473633, + "rms": 2.3075618743896484, + "max_abs": 95.0 + }, + "full_input": { + "shape": [ + 274, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9aa05796b068696a4e49333973b06782678dd74b1a3475b5780afe88cc1fc135", + "mean": -0.04952854663133621, + "std": 4.803600788116455, + "rms": 4.803856372833252, + "max_abs": 1160.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "62160ca95b86c7da051ca3270aa45f1d4bd2022648942013980d0e680e129427", + "mean": -0.05359143391251564, + "std": 2.2982382774353027, + "rms": 2.298862934112549, + "max_abs": 96.5 + }, + "full_input": { + "shape": [ + 290, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "22deb9151a708f9b99ea0e6f0f872fe91f8d7a67ce01f8fd92959dab3ba6a4a0", + "mean": -0.047553788870573044, + "std": 4.693349361419678, + "rms": 4.69359016418457, + "max_abs": 1160.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9980041980743408, + "min_cosine_similarity": 0.9782636761665344, + "mean_relative_l2": 0.05742788687348366, + "max_abs_delta": 4.0 + }, + "system_bos": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.997357964515686, + "min_cosine_similarity": 0.9409022331237793, + "mean_relative_l2": 0.06704244762659073, + "max_abs_delta": 7.0 + }, + "system_x": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9950363636016846, + "min_cosine_similarity": 0.9571945667266846, + "mean_relative_l2": 0.09305575489997864, + "max_abs_delta": 7.5 + }, + "system_period": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.994503915309906, + "min_cosine_similarity": 0.9577396512031555, + "mean_relative_l2": 0.09855862706899643, + "max_abs_delta": 6.5 + }, + "bos_at_s0": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9964303970336914, + "min_cosine_similarity": 0.9331019520759583, + "mean_relative_l2": 0.07733675837516785, + "max_abs_delta": 8.25 + }, + "bos_at_s1": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9958493709564209, + "min_cosine_similarity": 0.9576888680458069, + "mean_relative_l2": 0.08483747392892838, + "max_abs_delta": 3.5 + }, + "x_at_s0": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9962341785430908, + "min_cosine_similarity": 0.9713665843009949, + "mean_relative_l2": 0.08103716373443604, + "max_abs_delta": 6.5 + }, + "x_at_s1": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9938560724258423, + "min_cosine_similarity": 0.958766520023346, + "mean_relative_l2": 0.1031787320971489, + "max_abs_delta": 8.0 + }, + "period_at_s0": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9960564374923706, + "min_cosine_similarity": 0.9691011905670166, + "mean_relative_l2": 0.08297060430049896, + "max_abs_delta": 5.5 + }, + "period_at_s1": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9938353300094604, + "min_cosine_similarity": 0.9596208930015564, + "mean_relative_l2": 0.10421411693096161, + "max_abs_delta": 8.0 + } + } + }, + "layer_24": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ba4e1e53dfff22eab883af03f7a88a1e51905ec7eb30f57c48d3752b8f665aa1", + "mean": -0.07019471377134323, + "std": 2.806441307067871, + "rms": 2.807319164276123, + "max_abs": 123.5 + }, + "full_input": { + "shape": [ + 274, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6456746d1a73729a5e1824f27c6bce17e53f52a9000a108a28580e25d15db55c", + "mean": -0.06993995606899261, + "std": 5.44802188873291, + "rms": 5.448470592498779, + "max_abs": 1008.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "392c2ea22667e8474e9eaf265bb31fd4f87f6d3552fb3085f9d130467bdb5e8c", + "mean": -0.07020251452922821, + "std": 2.8002562522888184, + "rms": 2.801136016845703, + "max_abs": 123.5 + }, + "full_input": { + "shape": [ + 290, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f05daee12d2a6a542aa86ea83cdcdad74f153635a2441403279c68bb10208ea5", + "mean": -0.0669657438993454, + "std": 5.58705472946167, + "rms": 5.587455749511719, + "max_abs": 1120.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "42a3faaf755dcb3773732828dc4fa95aa8a1fc4de66f44959fd8799857e14204", + "mean": -0.07046553492546082, + "std": 2.8048884868621826, + "rms": 2.8057732582092285, + "max_abs": 124.0 + }, + "full_input": { + "shape": [ + 274, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "57630d712b62cc4868461a9235b575ffbbb09d21015bd2bd12e016ef6763ab1c", + "mean": -0.06567759066820145, + "std": 3.977151870727539, + "rms": 3.977694272994995, + "max_abs": 840.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "133c7afea302c78794df29fb25c50469b32471a90a9862dcf3dd138034799990", + "mean": -0.07085010409355164, + "std": 2.799877882003784, + "rms": 2.800774097442627, + "max_abs": 124.0 + }, + "full_input": { + "shape": [ + 290, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "44501676c17c5ad3a8dfc4f319049f16e36700e120fbfe99370227f76abc9c09", + "mean": -0.062513068318367, + "std": 3.9201221466064453, + "rms": 3.9206202030181885, + "max_abs": 840.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "988028fac0437485bbfcc92484afe89065e8e70b0f4f3a1e6174bf748a0c1d75", + "mean": -0.07060492783784866, + "std": 2.8075482845306396, + "rms": 2.8084359169006348, + "max_abs": 124.0 + }, + "full_input": { + "shape": [ + 274, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "647d8b1adc9df3d9a77bd513ade5a905e8692a9f53f073fc6a79323b5cb2f67d", + "mean": -0.065914586186409, + "std": 3.9823720455169678, + "rms": 3.982917308807373, + "max_abs": 840.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ed55478ac00fd7ed969d636c966b82224f0317d5f609cd84edcf1ebad0d2887a", + "mean": -0.07025960087776184, + "std": 2.803225517272949, + "rms": 2.8041059970855713, + "max_abs": 125.0 + }, + "full_input": { + "shape": [ + 290, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2a6125de4d06deb26effae5b59f57d182fe526cf8c82e4887bcbb4bcf0a59c70", + "mean": -0.062007468193769455, + "std": 3.926097869873047, + "rms": 3.9265873432159424, + "max_abs": 840.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e5f34c71479012a3bd4dd59376605c4f16f626acd80e79c4c8d3be2a061de925", + "mean": -0.07045719027519226, + "std": 2.8073387145996094, + "rms": 2.808222770690918, + "max_abs": 123.0 + }, + "full_input": { + "shape": [ + 274, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "370df2d35c57c9f2cb1c5dbd4787856422d35520d6914edb8e4efc5d4957216e", + "mean": -0.06581909209489822, + "std": 3.9802403450012207, + "rms": 3.9807844161987305, + "max_abs": 840.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3fd3f11bf99b39b1f3ed282d930c72407cb12e86042bc66c281c140cf50ab5f5", + "mean": -0.07005154341459274, + "std": 2.7971901893615723, + "rms": 2.798067092895508, + "max_abs": 125.0 + }, + "full_input": { + "shape": [ + 290, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a1166b3cbd0b3da581e41b6670bd94d393082d6e68aef38b9a33e26d0c857c20", + "mean": -0.06165916845202446, + "std": 3.9203670024871826, + "rms": 3.920851707458496, + "max_abs": 840.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9983478784561157, + "min_cosine_similarity": 0.9828758239746094, + "mean_relative_l2": 0.05229632556438446, + "max_abs_delta": 5.0 + }, + "system_bos": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9978291392326355, + "min_cosine_similarity": 0.9524141550064087, + "mean_relative_l2": 0.06069914251565933, + "max_abs_delta": 7.25 + }, + "system_x": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9959489703178406, + "min_cosine_similarity": 0.9645540118217468, + "mean_relative_l2": 0.08410824090242386, + "max_abs_delta": 10.0 + }, + "system_period": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.995489776134491, + "min_cosine_similarity": 0.9674180150032043, + "mean_relative_l2": 0.08945196121931076, + "max_abs_delta": 8.0 + }, + "bos_at_s0": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.997068464756012, + "min_cosine_similarity": 0.9473971128463745, + "mean_relative_l2": 0.07006552070379257, + "max_abs_delta": 10.0 + }, + "bos_at_s1": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9965903759002686, + "min_cosine_similarity": 0.9659029245376587, + "mean_relative_l2": 0.07674791663885117, + "max_abs_delta": 4.0 + }, + "x_at_s0": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9968313574790955, + "min_cosine_similarity": 0.9768972396850586, + "mean_relative_l2": 0.07425886392593384, + "max_abs_delta": 8.5 + }, + "x_at_s1": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.994895339012146, + "min_cosine_similarity": 0.9668312072753906, + "mean_relative_l2": 0.09402405470609665, + "max_abs_delta": 10.5 + }, + "period_at_s0": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9965951442718506, + "min_cosine_similarity": 0.9756352305412292, + "mean_relative_l2": 0.07695000618696213, + "max_abs_delta": 7.0 + }, + "period_at_s1": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9949023127555847, + "min_cosine_similarity": 0.9678744077682495, + "mean_relative_l2": 0.0947820320725441, + "max_abs_delta": 10.0 + } + } + }, + "layer_25": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3ab85c0a77994e9fd7dd8410d63155b2ec5c3c4dc062b670f13ce2c0b5edd21f", + "mean": -0.1146836057305336, + "std": 3.735978364944458, + "rms": 3.7377378940582275, + "max_abs": 182.0 + }, + "full_input": { + "shape": [ + 274, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1bc90e5f6f81d64f71178b0cc956b2ab227e1b96ef3b650b89c8aa5ac4b030d9", + "mean": -0.1118415892124176, + "std": 5.034789562225342, + "rms": 5.036031723022461, + "max_abs": 872.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9a0ac496004c424df6ed8b94d635b358826a3da42aa69c2fd605ca2e3d4f7827", + "mean": -0.11335081607103348, + "std": 3.727010726928711, + "rms": 3.728734016418457, + "max_abs": 180.0 + }, + "full_input": { + "shape": [ + 290, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "558c1a881396e0c80bf7f0fde946a43b2a0670b5495ab71844460fa4983ece73", + "mean": -0.10600252449512482, + "std": 5.195392608642578, + "rms": 5.196474075317383, + "max_abs": 984.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b8c1d4fefcc86f30064e6145838452e5b5cce25295a1b8e19f4e16b493174d17", + "mean": -0.11710314452648163, + "std": 3.735595941543579, + "rms": 3.7374308109283447, + "max_abs": 182.0 + }, + "full_input": { + "shape": [ + 274, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "dc16bbecf22e43ddeb1ca9fb6a563988edf90ca8bf83f79fd765d309a462022a", + "mean": -0.1091952919960022, + "std": 3.7867026329040527, + "rms": 3.7882766723632812, + "max_abs": 252.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ab5095ef3f48420dcb57a7d13ab24957bf3e02333afd65a5ffe20644b00371fa", + "mean": -0.11593528091907501, + "std": 3.7272520065307617, + "rms": 3.7290544509887695, + "max_abs": 182.0 + }, + "full_input": { + "shape": [ + 290, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "26a5cbfee499740066b2cecf6ce6a7bed5f912bc4806bda7b7796961b9369ab7", + "mean": -0.10290458798408508, + "std": 3.7775142192840576, + "rms": 3.7789156436920166, + "max_abs": 252.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "11883d97cd61077b41fef38dde9de7b74139b6d88fc097903e06497bd8965cd4", + "mean": -0.11547504365444183, + "std": 3.7330284118652344, + "rms": 3.734814167022705, + "max_abs": 180.0 + }, + "full_input": { + "shape": [ + 274, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4c7d248dd6e8f8931c967edbdf38d2e7cf1c79619dba3440a45c002c6084a6b1", + "mean": -0.107976034283638, + "std": 3.7912633419036865, + "rms": 3.7928004264831543, + "max_abs": 252.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "311c91f3b91d2711b19d61e6140d2954dcc72645ab3acccc9f2505ace427e511", + "mean": -0.11243730038404465, + "std": 3.7223241329193115, + "rms": 3.7240219116210938, + "max_abs": 181.0 + }, + "full_input": { + "shape": [ + 290, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cec5dab954714f2729671f37b012119035fafb0d4337cfa70e8b60097967b98c", + "mean": -0.09972080588340759, + "std": 3.7798635959625244, + "rms": 3.7811789512634277, + "max_abs": 252.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4d7c4dfc534dc5f872eb69d2841d94294659655a9b2120a79811471598e74852", + "mean": -0.11521319299936295, + "std": 3.7360615730285645, + "rms": 3.737837791442871, + "max_abs": 181.0 + }, + "full_input": { + "shape": [ + 274, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "85b36f314ae2773250d24924ebcc688c8b6f80042ec460856b87f8e4d13694ac", + "mean": -0.10763777047395706, + "std": 3.7903642654418945, + "rms": 3.7918922901153564, + "max_abs": 252.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b694954b48f6d18683d6ac2abf69efc0a13aafd1ce342552a657186c8dbac776", + "mean": -0.1124613806605339, + "std": 3.715216875076294, + "rms": 3.716918706893921, + "max_abs": 182.0 + }, + "full_input": { + "shape": [ + 290, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8723332d603f5c13d1347ee5c4b89d848ebfb3a8d96d7c1ba14ab9c1de3115f0", + "mean": -0.09955800324678421, + "std": 3.7701244354248047, + "rms": 3.7714388370513916, + "max_abs": 252.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9987622499465942, + "min_cosine_similarity": 0.9871377348899841, + "mean_relative_l2": 0.045672085136175156, + "max_abs_delta": 7.125 + }, + "system_bos": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9983729720115662, + "min_cosine_similarity": 0.9652493000030518, + "mean_relative_l2": 0.05289135128259659, + "max_abs_delta": 7.5 + }, + "system_x": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9966772794723511, + "min_cosine_similarity": 0.9738427996635437, + "mean_relative_l2": 0.07573835551738739, + "max_abs_delta": 19.3125 + }, + "system_period": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9964689016342163, + "min_cosine_similarity": 0.9755854606628418, + "mean_relative_l2": 0.07903026044368744, + "max_abs_delta": 16.4375 + }, + "bos_at_s0": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9979260563850403, + "min_cosine_similarity": 0.9627830386161804, + "mean_relative_l2": 0.05896086245775223, + "max_abs_delta": 10.0 + }, + "bos_at_s1": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9975942373275757, + "min_cosine_similarity": 0.9747531414031982, + "mean_relative_l2": 0.06467559933662415, + "max_abs_delta": 7.0 + }, + "x_at_s0": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9977230429649353, + "min_cosine_similarity": 0.982170045375824, + "mean_relative_l2": 0.0631369948387146, + "max_abs_delta": 13.0 + }, + "x_at_s1": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9960446357727051, + "min_cosine_similarity": 0.9756827354431152, + "mean_relative_l2": 0.08289941400289536, + "max_abs_delta": 18.875 + }, + "period_at_s0": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9975578784942627, + "min_cosine_similarity": 0.9820421934127808, + "mean_relative_l2": 0.06548355519771576, + "max_abs_delta": 11.0 + }, + "period_at_s1": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9961954355239868, + "min_cosine_similarity": 0.9765942692756653, + "mean_relative_l2": 0.08231978118419647, + "max_abs_delta": 14.0625 + } + } + }, + "layer_26": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "33f5e1a6325fed085bafb407bbb5ed27d25562ad3fd6307fb8d509bd478eec34", + "mean": -0.17652705311775208, + "std": 4.357409954071045, + "rms": 4.3609843254089355, + "max_abs": 352.0 + }, + "full_input": { + "shape": [ + 274, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9157b94e491aaa234348b405827393d1c039b1cfbf0369732f1c13cb2912cc40", + "mean": -0.17170782387256622, + "std": 5.4960408210754395, + "rms": 5.498722553253174, + "max_abs": 840.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ac30bc3b6b5e9b83bf7c319365e0fe9755ef16205807c8ccb17407f5f55e672f", + "mean": -0.1718558967113495, + "std": 4.295871734619141, + "rms": 4.299307346343994, + "max_abs": 344.0 + }, + "full_input": { + "shape": [ + 290, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b20fb9eeb39e82f363352b0524bfa085f00807ae88aadad151fdee648cdb7033", + "mean": -0.15759113430976868, + "std": 5.6163649559021, + "rms": 5.618575572967529, + "max_abs": 864.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "666ee3dc97cd62b5f7aa23d5ed185e51a1f71be3e252f101f7104c56acc7cf2e", + "mean": -0.17893821001052856, + "std": 4.35991096496582, + "rms": 4.363581657409668, + "max_abs": 356.0 + }, + "full_input": { + "shape": [ + 274, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7ffd9479fce5f430be05df8d83f03589a1cc3ea2b7a3b6f41cebea5f97300554", + "mean": -0.16824209690093994, + "std": 4.571793556213379, + "rms": 4.574888229370117, + "max_abs": 780.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ed8299819afb6c1697e891467c138aed5f0ba259785786a0b63bc6b676b62f59", + "mean": -0.17482061684131622, + "std": 4.325794696807861, + "rms": 4.3293256759643555, + "max_abs": 364.0 + }, + "full_input": { + "shape": [ + 290, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c07864771ea0e707ccd02dbec06e119c118509e7b0d1f3d9a21cd340b869f219", + "mean": -0.15423819422721863, + "std": 4.596896648406982, + "rms": 4.599483966827393, + "max_abs": 780.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "50ebfc353864a39035c707855d6da77b14db0e8ca5b889380d65e4a1bec2c91d", + "mean": -0.17689041793346405, + "std": 4.378940582275391, + "rms": 4.382511615753174, + "max_abs": 366.0 + }, + "full_input": { + "shape": [ + 274, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ce3d4ad25e4afb34ae71c4879b6106802a5f3c9dc31d0c8d4d636990592468c5", + "mean": -0.16683340072631836, + "std": 4.598239898681641, + "rms": 4.6012654304504395, + "max_abs": 780.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "23cea98c95b7a37947ed84280bc1beeca2752b9904dab9e2d23338acf3f0b805", + "mean": -0.1671046018600464, + "std": 4.310775279998779, + "rms": 4.3140130043029785, + "max_abs": 336.0 + }, + "full_input": { + "shape": [ + 290, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9ff46621c4c61587691fc302fec9ee843a9436e142b726173754e9e46f77e39f", + "mean": -0.14700251817703247, + "std": 4.590507984161377, + "rms": 4.592861175537109, + "max_abs": 780.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "37c57c4e4d776d39224f8b30c8c895845b167a089949d45d8bec0d8c50b0260f", + "mean": -0.17665636539459229, + "std": 4.366827964782715, + "rms": 4.3703999519348145, + "max_abs": 364.0 + }, + "full_input": { + "shape": [ + 274, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "033671ef64aed71df8be507f44f2c953e6d18e35fa8104f3639c80bfb56d30b2", + "mean": -0.16637273132801056, + "std": 4.579871654510498, + "rms": 4.582892417907715, + "max_abs": 780.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a2befa58b39614d976bdb814b7bc43f86c22207bc50e5e278320c96535a305d0", + "mean": -0.16728487610816956, + "std": 4.275479316711426, + "rms": 4.278750419616699, + "max_abs": 338.0 + }, + "full_input": { + "shape": [ + 290, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2668490051a7fe056d19386ab705aeff90f4c7244553fa53d81ef548bc2adcf9", + "mean": -0.14697618782520294, + "std": 4.554174423217773, + "rms": 4.556545734405518, + "max_abs": 780.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.998578667640686, + "min_cosine_similarity": 0.9799951910972595, + "mean_relative_l2": 0.050841059535741806, + "max_abs_delta": 20.0 + }, + "system_bos": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.998126745223999, + "min_cosine_similarity": 0.9404644966125488, + "mean_relative_l2": 0.05667688697576523, + "max_abs_delta": 21.125 + }, + "system_x": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9942486882209778, + "min_cosine_similarity": 0.9021130800247192, + "mean_relative_l2": 0.09241084009408951, + "max_abs_delta": 51.0625 + }, + "system_period": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9948824644088745, + "min_cosine_similarity": 0.9421347975730896, + "mean_relative_l2": 0.09282969683408737, + "max_abs_delta": 43.0 + }, + "bos_at_s0": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9978599548339844, + "min_cosine_similarity": 0.9426265954971313, + "mean_relative_l2": 0.06117389351129532, + "max_abs_delta": 18.5 + }, + "bos_at_s1": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9976052641868591, + "min_cosine_similarity": 0.9526432752609253, + "mean_relative_l2": 0.06586463004350662, + "max_abs_delta": 20.0 + }, + "x_at_s0": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9977816343307495, + "min_cosine_similarity": 0.9659414887428284, + "mean_relative_l2": 0.06409329175949097, + "max_abs_delta": 32.0 + }, + "x_at_s1": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9942440986633301, + "min_cosine_similarity": 0.9170076847076416, + "mean_relative_l2": 0.09630120545625687, + "max_abs_delta": 50.5 + }, + "period_at_s0": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9976016879081726, + "min_cosine_similarity": 0.9690850377082825, + "mean_relative_l2": 0.066626638174057, + "max_abs_delta": 35.0 + }, + "period_at_s1": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9956163167953491, + "min_cosine_similarity": 0.955147385597229, + "mean_relative_l2": 0.08803367614746094, + "max_abs_delta": 35.0 + } + } + }, + "final_norm": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fab66ca9afa69516079c6bd3ab1b210a186febb88cf175c261a9bccb442eb3ad", + "mean": -0.027550116181373596, + "std": 0.6822932362556458, + "rms": 0.6828492879867554, + "max_abs": 19.0 + }, + "full_input": { + "shape": [ + 274, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "35afa5b4cc6b22554475e00471700536b0dbd0e698a634d932782fdc867e329a", + "mean": -0.02588149532675743, + "std": 0.6756417751312256, + "rms": 0.6761372685432434, + "max_abs": 19.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bf952daffd8725383515690f0ee53c483589d618038bbf40c2f86d0edfd59b03", + "mean": -0.027171695604920387, + "std": 0.682563841342926, + "rms": 0.6831044554710388, + "max_abs": 19.625 + }, + "full_input": { + "shape": [ + 290, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "63bbb0517251e426417348641b541fb4a2f1f988a628adad3c34bfaf613dc15f", + "mean": -0.023735875263810158, + "std": 0.666049599647522, + "rms": 0.6664723753929138, + "max_abs": 19.75 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c011ab0d84c1aa101f376f166bbc26a7c2fb737bfbcc4def0ea837b8362a9069", + "mean": -0.028109434992074966, + "std": 0.6903074383735657, + "rms": 0.6908794641494751, + "max_abs": 19.375 + }, + "full_input": { + "shape": [ + 274, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "409b6fb253980a26fe0d8392ef709af78783297084a8daf1c8ff1e772106bbc0", + "mean": -0.026315273717045784, + "std": 0.6835690140724182, + "rms": 0.6840753555297852, + "max_abs": 21.125 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cf7c7070fdf73676609f13e82c43ab2221223b008024629575d2d0dfad69ac68", + "mean": -0.027569318190217018, + "std": 0.6870367527008057, + "rms": 0.687589704990387, + "max_abs": 18.875 + }, + "full_input": { + "shape": [ + 290, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "356dd356a8844a8ec4233eacfac74b4a3b214520c76155245763bb5aba1a956e", + "mean": -0.02405560202896595, + "std": 0.6704999208450317, + "rms": 0.6709312796592712, + "max_abs": 21.25 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "92a24dd8cca9910cb2ad2d215e3aa393d7cbb324544c55c79779322282446ad6", + "mean": -0.027438713237643242, + "std": 0.680147111415863, + "rms": 0.6807003617286682, + "max_abs": 18.5 + }, + "full_input": { + "shape": [ + 274, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5a81df1a3fd7bdc7ba83716828edc2d4d51f8921400ace250dcef3be4929ef72", + "mean": -0.025717101991176605, + "std": 0.6731951832771301, + "rms": 0.6736862659454346, + "max_abs": 18.5 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "24a7f53f987961e7de5a0931bbbe23bf66152f506a20b403dc0435e6b607eba1", + "mean": -0.025903357192873955, + "std": 0.6642667651176453, + "rms": 0.6647716760635376, + "max_abs": 18.75 + }, + "full_input": { + "shape": [ + 290, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "52be75d7fa69285675da6a4fce1e8eab0eb9f5034cb0b9d6d4803c918340c781", + "mean": -0.022441338747739792, + "std": 0.6489211320877075, + "rms": 0.649308979511261, + "max_abs": 19.625 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "628201b7741ced1dc0ad5ecad061ef4debc12c5c3a600e8892ffc915daa2626a", + "mean": -0.027578826993703842, + "std": 0.6865448355674744, + "rms": 0.6870985627174377, + "max_abs": 18.625 + }, + "full_input": { + "shape": [ + 274, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3eb4c7403e6e74a9372a7f4a64a6917f8ec258b580dddbafc4c848d37944e86e", + "mean": -0.025862304493784904, + "std": 0.6798335909843445, + "rms": 0.6803253293037415, + "max_abs": 18.625 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 249, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9d3139bf384eac4951762ffc793746d6b4e25c864b4a6d2a880f0462106da241", + "mean": -0.026287004351615906, + "std": 0.6746476292610168, + "rms": 0.6751595139503479, + "max_abs": 18.5 + }, + "full_input": { + "shape": [ + 290, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7f9e4096de2e3011c5d0b184b7c89dd05150ded6031f03d6e6f650ebd28bbe23", + "mean": -0.022770516574382782, + "std": 0.659008800983429, + "rms": 0.6594021320343018, + "max_abs": 20.25 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.998343825340271, + "min_cosine_similarity": 0.9806872010231018, + "mean_relative_l2": 0.05177310109138489, + "max_abs_delta": 2.25 + }, + "system_bos": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.997873842716217, + "min_cosine_similarity": 0.9440408945083618, + "mean_relative_l2": 0.058012455701828, + "max_abs_delta": 3.5 + }, + "system_x": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9942566752433777, + "min_cosine_similarity": 0.9144954681396484, + "mean_relative_l2": 0.09375593066215515, + "max_abs_delta": 4.8125 + }, + "system_period": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9947546720504761, + "min_cosine_similarity": 0.9199249744415283, + "mean_relative_l2": 0.09268990159034729, + "max_abs_delta": 5.0 + }, + "bos_at_s0": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9972918033599854, + "min_cosine_similarity": 0.9536281824111938, + "mean_relative_l2": 0.06635953485965729, + "max_abs_delta": 2.7109375 + }, + "bos_at_s1": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9970009922981262, + "min_cosine_similarity": 0.9571764469146729, + "mean_relative_l2": 0.07043595612049103, + "max_abs_delta": 2.6875 + }, + "x_at_s0": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9971226453781128, + "min_cosine_similarity": 0.9762941598892212, + "mean_relative_l2": 0.06866432726383209, + "max_abs_delta": 2.71875 + }, + "x_at_s1": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9936065673828125, + "min_cosine_similarity": 0.913224458694458, + "mean_relative_l2": 0.10182765126228333, + "max_abs_delta": 4.71875 + }, + "period_at_s0": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9969500303268433, + "min_cosine_similarity": 0.9745070338249207, + "mean_relative_l2": 0.0717606395483017, + "max_abs_delta": 2.1064453125 + }, + "period_at_s1": { + "tokens": 249, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9948562979698181, + "min_cosine_similarity": 0.9438436031341553, + "mean_relative_l2": 0.09256716072559357, + "max_abs_delta": 3.375 + } + } + } + }, + "router_layers": { + "layer_01": { + "layer": 1, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "18d1d912e0c625d06d2c9af9e19b39fed0d3b87184a12515bff4a8a7ef3cdb54", + "route_weight_sha256": "13a6755e1aff655948c3f495d33d1dd1ab1c56563664d5809d18672925b06b9a", + "loads": [ + 29, + 23, + 20, + 28, + 19, + 32, + 16, + 14, + 14, + 24, + 36, + 10, + 9, + 22, + 35, + 10, + 37, + 0, + 34, + 30, + 14, + 33, + 18, + 31, + 34, + 37, + 31, + 14, + 29, + 30, + 29, + 14, + 2, + 9, + 18, + 29, + 18, + 37, + 13, + 7, + 39, + 29, + 32, + 25, + 23, + 20, + 19, + 30, + 36, + 21, + 14, + 20, + 21, + 32, + 50, + 27, + 17, + 6, + 28, + 22, + 18, + 37, + 10, + 29 + ], + "weighted_loads": [ + 2.4331507198512554, + 1.0701195113360882, + 1.413957815617323, + 1.858819391578436, + 1.1156252026557922, + 2.0947748217731714, + 0.6474250815808773, + 0.5843157339841127, + 0.6420229636132717, + 1.746345680207014, + 2.6337833646684885, + 0.36158937960863113, + 0.25778241641819477, + 1.8673149161040783, + 1.7738691698759794, + 0.2966277040541172, + 1.1512028519064188, + 0.0, + 1.9270196966826916, + 2.174796026200056, + 0.6842932645231485, + 3.085948199033737, + 0.8617775980383158, + 2.9295474588871, + 1.7409683354198933, + 2.026033814996481, + 1.1190066747367382, + 0.5351326409727335, + 1.3619478344917297, + 1.9394497238099575, + 2.636706242337823, + 1.194467518478632, + 0.07444745674729347, + 0.29256495274603367, + 1.5011490061879158, + 1.5807043872773647, + 1.3175864815711975, + 3.022696340456605, + 0.8629729691892862, + 0.4195024110376835, + 2.472726546227932, + 1.9571432545781136, + 2.7554174214601517, + 1.9776061102747917, + 1.5787758342921734, + 1.0123530626296997, + 1.7204891629517078, + 4.278805166482925, + 1.5026910584419966, + 1.0568508189171553, + 0.5129087250679731, + 1.9006607308983803, + 1.6678545642644167, + 1.518808912485838, + 3.4038476925343275, + 1.0664931051433086, + 1.2195590157061815, + 0.17904643714427948, + 1.0414141584187746, + 0.8247353322803974, + 0.6535620875656605, + 3.5413636174052954, + 0.8497124947607517, + 2.275816760957241 + ], + "unique_experts": 63, + "load_cv": 0.4364841721052443, + "normalized_load_entropy": 0.9736555185149571, + "max_load_share": 0.03346720214190094 + }, + "full_input": { + "tokens": 274, + "top_k": 6, + "decisions": 1644, + "ordered_route_sha256": "b4f35cf75a1154ba7c1578833f2287ea0e90f82800dfe6f4f1f7e8327bb64478", + "route_weight_sha256": "cfc0a79625b51117be12d4805e2fed90ef301ffd0d1c42bf47ebdceebe0677be", + "loads": [ + 29, + 23, + 22, + 28, + 23, + 33, + 17, + 16, + 31, + 24, + 38, + 12, + 9, + 22, + 36, + 19, + 37, + 1, + 34, + 30, + 17, + 33, + 19, + 31, + 34, + 41, + 44, + 14, + 29, + 30, + 29, + 19, + 3, + 11, + 18, + 29, + 18, + 37, + 13, + 10, + 40, + 39, + 32, + 31, + 24, + 31, + 20, + 30, + 36, + 21, + 18, + 21, + 25, + 32, + 53, + 31, + 20, + 14, + 30, + 33, + 19, + 41, + 11, + 29 + ], + "weighted_loads": [ + 2.4331507198512554, + 1.0701195113360882, + 1.516691479831934, + 1.858819391578436, + 1.27627376280725, + 2.1730683762580156, + 0.7091659419238567, + 0.8520410303026438, + 1.5656591560691595, + 1.746345680207014, + 2.90912745334208, + 0.41843675449490547, + 0.25778241641819477, + 1.8673149161040783, + 1.7999348025768995, + 0.9118895344436169, + 1.1512028519064188, + 0.07137833535671234, + 1.9270196966826916, + 2.174796026200056, + 1.061179393902421, + 3.085948199033737, + 0.892048804089427, + 2.9295474588871, + 1.7409683354198933, + 2.1948459297418594, + 1.93192308396101, + 0.5351326409727335, + 1.3619478344917297, + 1.9394497238099575, + 2.636706242337823, + 1.5837411221000366, + 0.13609090074896812, + 0.47713017277419567, + 1.5011490061879158, + 1.5807043872773647, + 1.3175864815711975, + 3.022696340456605, + 0.8629729691892862, + 0.6455913968384266, + 2.5239449366927147, + 2.367802493274212, + 2.7554174214601517, + 2.1367778278363403, + 2.563055168837309, + 1.829790546791628, + 1.8027201183140278, + 4.278805166482925, + 1.5026910584419966, + 1.0568508189171553, + 0.6533125303685665, + 1.9012678200379014, + 1.9462609719485044, + 1.518808912485838, + 3.4488359406823292, + 1.6085652969777584, + 1.4945792015641928, + 0.6564647555351257, + 1.0875786077231169, + 1.5411125607788563, + 0.7441877014935017, + 3.7579106669873, + 0.9086191728711128, + 2.275816760957241 + ], + "unique_experts": 64, + "load_cv": 0.39729462036887764, + "normalized_load_entropy": 0.9786415861411234, + "max_load_share": 0.03223844282238443 + } + }, + "s1_eos": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "7283f9dc44f6a91a2ba705e42a2cdca57362ba159bfe2bc5ab5b8bda9964c953", + "route_weight_sha256": "74c5a9efb9d5700ee0b8b2eae51a32c56d3c9acb6672c8dc53106e9bd1483b96", + "loads": [ + 28, + 23, + 20, + 28, + 19, + 31, + 16, + 14, + 11, + 24, + 38, + 13, + 9, + 22, + 34, + 10, + 36, + 0, + 33, + 30, + 14, + 33, + 21, + 31, + 32, + 36, + 20, + 15, + 30, + 31, + 29, + 14, + 2, + 7, + 18, + 30, + 19, + 37, + 15, + 7, + 37, + 29, + 32, + 27, + 24, + 19, + 19, + 30, + 39, + 22, + 14, + 20, + 21, + 35, + 51, + 28, + 17, + 6, + 30, + 19, + 18, + 37, + 10, + 30 + ], + "weighted_loads": [ + 2.3968280889093876, + 1.0675116870552301, + 1.4222650043666363, + 1.8947740830481052, + 1.1098093781620264, + 2.056686544790864, + 0.6325361579656601, + 0.5858407709747553, + 0.5250883810222149, + 1.7473254706710577, + 2.704643290489912, + 0.4574571456760168, + 0.24619088135659695, + 1.869844388216734, + 1.761430187150836, + 0.2996293641626835, + 1.1345723886042833, + 0.0, + 1.8925735335797071, + 2.1886048913002014, + 0.6732129734009504, + 3.094742927700281, + 0.9345500003546476, + 2.95820390060544, + 1.6509869527071714, + 1.9847912210971117, + 0.8173434995114803, + 0.5556359812617302, + 1.4037391636520624, + 1.9866297338157892, + 2.6345232017338276, + 1.1868466548621655, + 0.07281717471778393, + 0.21715090796351433, + 1.4986131135374308, + 1.6145125776529312, + 1.3359311111271381, + 3.025252802297473, + 0.9089266154915094, + 0.41384858451783657, + 2.3817697279155254, + 1.967549854889512, + 2.760200332850218, + 2.006453411653638, + 1.601627442985773, + 0.9848223552107811, + 1.710535317659378, + 4.3321070112288, + 1.5729209426790476, + 1.1091852709650993, + 0.5111018773168325, + 1.8844172582030296, + 1.6689722780138254, + 1.601559441536665, + 3.437397500500083, + 1.0856132190674543, + 1.2459569368511438, + 0.17778055183589458, + 1.1364874765276909, + 0.7496533710509539, + 0.6564159207046032, + 3.557542284950614, + 0.8428834415972233, + 2.3151719085872173 + ], + "unique_experts": 63, + "load_cv": 0.4387773565078527, + "normalized_load_entropy": 0.9734305352790718, + "max_load_share": 0.03413654618473896 + }, + "full_input": { + "tokens": 290, + "top_k": 6, + "decisions": 1740, + "ordered_route_sha256": "7dea84830a4baa7c72b1fe4817d6ffc1158471e16389b7251cbe4de94933cf3b", + "route_weight_sha256": "bb23ed3e0856600315320f1b5efb1e78ad444e8aab3f1507869489827577cec4", + "loads": [ + 30, + 23, + 23, + 28, + 26, + 34, + 17, + 17, + 34, + 24, + 43, + 16, + 9, + 23, + 35, + 22, + 36, + 5, + 34, + 31, + 17, + 35, + 25, + 32, + 34, + 41, + 39, + 16, + 30, + 33, + 30, + 21, + 3, + 9, + 18, + 30, + 20, + 38, + 15, + 12, + 38, + 41, + 35, + 34, + 26, + 30, + 20, + 33, + 41, + 22, + 23, + 25, + 26, + 35, + 56, + 32, + 26, + 18, + 34, + 30, + 20, + 42, + 11, + 34 + ], + "weighted_loads": [ + 2.5018320120871067, + 1.0675116870552301, + 1.5879660435020924, + 1.8947740830481052, + 1.5092286933213472, + 2.26433171518147, + 0.67770766466856, + 0.8232344426214695, + 1.869391556829214, + 1.7473254706710577, + 3.171457391232252, + 0.6611633822321892, + 0.24619088135659695, + 1.9096582904458046, + 1.7876926995813847, + 1.001191932708025, + 1.1345723886042833, + 0.20135273598134518, + 1.931911626830697, + 2.254689447581768, + 0.98460235260427, + 3.2993733920156956, + 1.2052008472383022, + 2.992841958999634, + 1.7228966001421213, + 2.179380713030696, + 2.1005527209490538, + 0.5977782122790813, + 1.4037391636520624, + 2.148815395310521, + 2.7204635851085186, + 1.7975354419613723, + 0.12233750335872173, + 0.3575160801410675, + 1.4986131135374308, + 1.6145125776529312, + 1.5947867520153522, + 3.0586259607225657, + 0.9089266154915094, + 0.7576609421521425, + 2.434278853237629, + 2.540818877518177, + 2.967387752607465, + 2.2543801870197058, + 2.743396896868944, + 1.7528078028990421, + 1.79282296448946, + 4.414971264719497, + 1.724302414804697, + 1.1091852709650993, + 0.9284902065992355, + 2.250170998944668, + 2.0133793484419584, + 1.601559441536665, + 3.53104079599143, + 1.6040479969233274, + 1.6791640855371952, + 0.8817433528602123, + 1.25884054787457, + 1.4211243521422148, + 0.7717862129211426, + 3.865150125697255, + 0.9020844101905823, + 2.807281468063593 + ], + "unique_experts": 64, + "load_cv": 0.3712981729031473, + "normalized_load_entropy": 0.981592342729413, + "max_load_share": 0.03218390804597701 + } + }, + "s0_bos": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "ddde9b43b5b10f4df920ccd2d441dc7175063e9ea831ac71985102f13758c3bf", + "route_weight_sha256": "e531e11fc559098155430cf936cdd49836888a0928a67f67c345d0994ac32b2f", + "loads": [ + 29, + 22, + 20, + 31, + 19, + 29, + 16, + 22, + 14, + 27, + 34, + 13, + 10, + 22, + 33, + 11, + 22, + 5, + 35, + 30, + 13, + 32, + 22, + 32, + 34, + 36, + 32, + 14, + 31, + 35, + 29, + 16, + 5, + 5, + 19, + 25, + 18, + 36, + 15, + 8, + 37, + 35, + 32, + 29, + 26, + 18, + 19, + 30, + 26, + 22, + 16, + 20, + 22, + 28, + 53, + 26, + 16, + 4, + 18, + 19, + 17, + 37, + 13, + 30 + ], + "weighted_loads": [ + 2.4816829040646553, + 1.0298977214843035, + 1.427083183079958, + 2.0252905506640673, + 1.0996218044310808, + 1.7887407466769218, + 0.6637910194694996, + 0.7935313247144222, + 0.4437237046658993, + 1.8954140655696392, + 2.474475199356675, + 0.481319734826684, + 0.2894457224756479, + 1.7364247031509876, + 1.6885280814021826, + 0.3239916246384382, + 0.7656217087060213, + 0.22640329226851463, + 1.78720829077065, + 2.113541401922703, + 0.6167384386062622, + 2.94634123519063, + 0.981337932869792, + 3.0381623059511185, + 1.6983191780745983, + 2.001677732914686, + 1.1323468405753374, + 0.5189625900238752, + 1.4655648730695248, + 2.2211415991187096, + 2.6360688284039497, + 1.2479650489985943, + 0.2041906751692295, + 0.16798502020537853, + 1.602709861472249, + 1.383633203804493, + 1.3249187301844358, + 2.7533870078623295, + 0.957186546176672, + 0.4559721890836954, + 2.2481546737253666, + 1.9887924157083035, + 2.8000990711152554, + 2.049417592585087, + 1.7417786717414856, + 0.9027072694152594, + 1.728904865682125, + 4.300129730254412, + 1.2115693856030703, + 1.1139604058116674, + 0.603230906650424, + 1.9068689048290253, + 1.6867862399667501, + 1.3458088003098965, + 3.6291811037808657, + 1.0271884389221668, + 1.281632574275136, + 0.12114918231964111, + 0.6753845326602459, + 0.749461842700839, + 0.5803607814013958, + 3.559165697544813, + 0.924243139103055, + 2.3001454137265682 + ], + "unique_experts": 64, + "load_cv": 0.4149306857793424, + "normalized_load_entropy": 0.9775867594366274, + "max_load_share": 0.03547523427041499 + }, + "full_input": { + "tokens": 274, + "top_k": 6, + "decisions": 1644, + "ordered_route_sha256": "8205e6a8026813e4b6db1980ef60766841e31f62eb9929993f78399c1bdf04dc", + "route_weight_sha256": "9c832594e847a48fe50113d4de29419bc3fa38b13ddcef771218365ff305fcb5", + "loads": [ + 30, + 22, + 22, + 31, + 23, + 30, + 17, + 24, + 30, + 27, + 36, + 16, + 10, + 22, + 34, + 20, + 22, + 7, + 35, + 30, + 16, + 32, + 23, + 32, + 34, + 40, + 45, + 14, + 31, + 35, + 29, + 20, + 6, + 7, + 19, + 25, + 19, + 36, + 15, + 11, + 38, + 45, + 33, + 34, + 26, + 28, + 21, + 31, + 26, + 22, + 20, + 20, + 26, + 28, + 55, + 30, + 20, + 13, + 18, + 29, + 19, + 41, + 14, + 30 + ], + "weighted_loads": [ + 2.5053064674139023, + 1.0298977214843035, + 1.512178249657154, + 2.0252905506640673, + 1.2635459527373314, + 1.870248131453991, + 0.725531879812479, + 1.0535995922982693, + 1.3035436794161797, + 1.8954140655696392, + 2.7430173996835947, + 0.5625939015299082, + 0.2894457224756479, + 1.7364247031509876, + 1.71554422006011, + 0.9392534550279379, + 0.7656217087060213, + 0.332429438829422, + 1.78720829077065, + 2.113541401922703, + 0.921376183629036, + 2.94634123519063, + 1.0116091389209032, + 3.0381623059511185, + 1.6983191780745983, + 2.174792155623436, + 1.9437078647315502, + 0.5189625900238752, + 1.4655648730695248, + 2.2211415991187096, + 2.6360688284039497, + 1.6561973057687283, + 0.26583411917090416, + 0.346663074567914, + 1.602709861472249, + 1.383633203804493, + 1.3479991853237152, + 2.7533870078623295, + 0.957186546176672, + 0.68730285204947, + 2.3029300533235073, + 2.399451654404402, + 2.8429209664463997, + 2.205314913764596, + 1.7417786717414856, + 1.7196444179862738, + 1.8468841034919024, + 4.321449434384704, + 1.2115693856030703, + 1.1139604058116674, + 0.7532679215073586, + 1.9068689048290253, + 1.9512989167124033, + 1.3458088003098965, + 3.673716342076659, + 1.5603946559131145, + 1.6232275944203138, + 0.6732113435864449, + 0.6753845326602459, + 1.4325005318969488, + 0.7760125659406185, + 3.7773471251130104, + 0.9805300738662481, + 2.3001454137265682 + ], + "unique_experts": 64, + "load_cv": 0.3761701964144882, + "normalized_load_entropy": 0.9822318355251388, + "max_load_share": 0.03345498783454988 + } + }, + "s1_bos": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "64fab87aeab722cf17403398bccbd0b9c25675a998a07e6d7a96e16aa53fd981", + "route_weight_sha256": "bda1076fe34e51102e65c36e7bd4dce056d9422dba91b210ecf94a1f76fdc953", + "loads": [ + 29, + 19, + 20, + 29, + 18, + 31, + 16, + 23, + 12, + 26, + 35, + 16, + 7, + 22, + 30, + 11, + 27, + 4, + 33, + 30, + 14, + 33, + 23, + 31, + 32, + 36, + 51, + 14, + 29, + 33, + 33, + 16, + 4, + 3, + 19, + 23, + 18, + 35, + 15, + 8, + 34, + 47, + 31, + 27, + 26, + 17, + 19, + 31, + 34, + 20, + 17, + 20, + 22, + 28, + 53, + 24, + 18, + 2, + 14, + 17, + 8, + 37, + 10, + 30 + ], + "weighted_loads": [ + 2.3350254520773888, + 0.9341865461319685, + 1.342488419264555, + 1.9743925146758556, + 1.0700486712157726, + 1.9365105889737606, + 0.6710318513214588, + 0.8299896605312824, + 0.38173350133001804, + 1.8378391359001398, + 2.4860423412173986, + 0.5692084021866322, + 0.20164599642157555, + 1.7014918103814125, + 1.4648803174495697, + 0.32642843574285507, + 0.9052999224513769, + 0.18776577524840832, + 1.7211272306740284, + 2.1151114217936993, + 0.6337887290865183, + 3.1038534343242645, + 0.9980988670140505, + 2.947421619668603, + 1.6409534979611635, + 1.9546146802604198, + 1.6833636164665222, + 0.5150645952671766, + 1.4180165603756905, + 2.1155458819121122, + 2.821929616853595, + 1.247952764853835, + 0.15118101239204407, + 0.10652893781661987, + 1.5852040704339743, + 1.3200794514268637, + 1.316436419263482, + 2.644842503592372, + 0.942096283659339, + 0.4480165205895901, + 2.0294685177505016, + 2.5229223743081093, + 2.685657773166895, + 1.9738178737461567, + 1.7477639485150576, + 0.8747666776180267, + 1.71225094050169, + 4.431119654327631, + 1.4272317700088024, + 1.0494415368884802, + 0.6175128240138292, + 1.924491822719574, + 1.6941890344023705, + 1.3573381081223488, + 3.661414770409465, + 0.9592821449041367, + 1.3388093039393425, + 0.07510955445468426, + 0.5457653701305389, + 0.7216263115406036, + 0.3612682670354843, + 3.5748911257833242, + 0.8402752559632063, + 2.265622179955244 + ], + "unique_experts": 64, + "load_cv": 0.4678116337568742, + "normalized_load_entropy": 0.9713811428855942, + "max_load_share": 0.03547523427041499 + }, + "full_input": { + "tokens": 290, + "top_k": 6, + "decisions": 1740, + "ordered_route_sha256": "c6dddbd308addfa6ff0eeaf00c67140ec3d016ff7b6c02baf03eef0f9871877e", + "route_weight_sha256": "71ca6d9d4be99de4e8632f48e7641932289d1a9e25bfcc2b573279b855c939b2", + "loads": [ + 32, + 19, + 23, + 30, + 25, + 34, + 17, + 26, + 34, + 26, + 40, + 20, + 7, + 23, + 31, + 23, + 27, + 9, + 34, + 31, + 17, + 35, + 27, + 32, + 34, + 41, + 70, + 15, + 29, + 35, + 34, + 22, + 5, + 5, + 19, + 23, + 20, + 36, + 15, + 13, + 35, + 59, + 35, + 34, + 27, + 27, + 21, + 34, + 36, + 20, + 26, + 24, + 27, + 28, + 57, + 28, + 28, + 15, + 16, + 27, + 11, + 42, + 11, + 34 + ], + "weighted_loads": [ + 2.4621534198522568, + 0.9341865461319685, + 1.494892068207264, + 2.006305620074272, + 1.4791509509086609, + 2.155549678951502, + 0.7162033580243587, + 1.0583731066435575, + 1.6537112761288881, + 1.8378391359001398, + 2.943282863125205, + 0.7953939065337181, + 0.20164599642157555, + 1.7413057126104832, + 1.490997925400734, + 1.0279910042881966, + 0.9052999224513769, + 0.3891185112297535, + 1.7604653239250183, + 2.181195978075266, + 0.879955368116498, + 3.308483898639679, + 1.268749713897705, + 2.9820596780627966, + 1.7128631453961134, + 2.1564845964312553, + 2.9646852165460587, + 0.5572068262845278, + 1.4180165603756905, + 2.277731543406844, + 2.907870000228286, + 1.8774227928370237, + 0.20070134103298187, + 0.24242311716079712, + 1.5852040704339743, + 1.3200794514268637, + 1.598031360656023, + 2.6782156620174646, + 0.942096283659339, + 0.7985976487398148, + 2.082122031599283, + 3.0961913969367743, + 2.929193740710616, + 2.2170645371079445, + 1.9004454631358385, + 1.64229079708457, + 1.8368025533854961, + 4.535700375214219, + 1.5786132421344519, + 1.0494415368884802, + 1.053502133116126, + 2.289938513189554, + 2.0083551444113255, + 1.3573381081223488, + 3.754638724029064, + 1.4663745015859604, + 1.8243443239480257, + 0.8496181555092335, + 0.6208973489701748, + 1.358593124896288, + 0.5786918886005878, + 3.8844970297068357, + 0.8957327213138342, + 2.7577317394316196 + ], + "unique_experts": 64, + "load_cv": 0.4322267036771878, + "normalized_load_entropy": 0.9775251192499487, + "max_load_share": 0.040229885057471264 + } + }, + "s0_x": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "57fc17282045b6319922d1e46833fb4e780c34155faf597235eae0921bc766b8", + "route_weight_sha256": "5296ce2689f5fe0c341be8e966d31ddee834ed65158761eab599b1bfe627dd6e", + "loads": [ + 29, + 22, + 20, + 29, + 18, + 30, + 16, + 21, + 17, + 24, + 36, + 10, + 9, + 22, + 33, + 9, + 19, + 5, + 35, + 30, + 13, + 32, + 19, + 32, + 36, + 37, + 46, + 14, + 29, + 34, + 28, + 16, + 4, + 6, + 19, + 25, + 18, + 37, + 15, + 8, + 36, + 36, + 32, + 29, + 24, + 17, + 19, + 29, + 31, + 21, + 14, + 20, + 21, + 29, + 54, + 27, + 15, + 6, + 20, + 17, + 14, + 37, + 13, + 31 + ], + "weighted_loads": [ + 2.4451091568917036, + 1.0290217213332653, + 1.3975061513483524, + 1.9223599378019571, + 1.0618108566850424, + 1.9561409801244736, + 0.6660489086061716, + 0.7599875498563051, + 0.5450252890586853, + 1.7888350393623114, + 2.599869731813669, + 0.38529076240956783, + 0.2577447220683098, + 1.8058327697217464, + 1.6719560474157333, + 0.26828617975115776, + 0.6933187209069729, + 0.2281283475458622, + 1.8327644914388657, + 2.1102969832718372, + 0.6212628819048405, + 3.0033694431185722, + 0.8970747850835323, + 2.9915910959243774, + 1.786747820675373, + 2.0066702477633953, + 1.5401879232376814, + 0.5206471048295498, + 1.38850655592978, + 2.1318268105387688, + 2.588791148737073, + 1.2587392404675484, + 0.18255485966801643, + 0.22640885040163994, + 1.589747490361333, + 1.3937545884400606, + 1.301095925271511, + 2.8886397536844015, + 0.9226370137184858, + 0.4518908951431513, + 2.3105212785303593, + 2.1169753540307283, + 2.8026286363601685, + 2.0800484102219343, + 1.6751605719327927, + 0.8892308156937361, + 1.7207682579755783, + 4.23860308714211, + 1.3675761204212904, + 1.080379357561469, + 0.5372880510985851, + 1.8964802771806717, + 1.6274813618510962, + 1.3817612789571285, + 3.6802118103951216, + 1.0683920364826918, + 1.2170148771256208, + 0.17010883055627346, + 0.7299352586269379, + 0.708458187058568, + 0.5174634382128716, + 3.499045751988888, + 0.9138836245983839, + 2.33221641369164 + ], + "unique_experts": 64, + "load_cv": 0.4423569142397412, + "normalized_load_entropy": 0.9752031304135462, + "max_load_share": 0.03614457831325301 + }, + "full_input": { + "tokens": 274, + "top_k": 6, + "decisions": 1644, + "ordered_route_sha256": "3b6daf28078d32c02f0e7fb96845f7cdcddde856551263beaaf32d91fb13c2a6", + "route_weight_sha256": "3fdc1615e830d08aadccf59e72158a22e0643af85723a26d26c05240dc78ef70", + "loads": [ + 29, + 22, + 22, + 29, + 22, + 31, + 17, + 24, + 33, + 25, + 38, + 12, + 9, + 22, + 34, + 19, + 19, + 6, + 35, + 30, + 16, + 32, + 21, + 32, + 36, + 41, + 60, + 14, + 29, + 34, + 28, + 20, + 5, + 8, + 19, + 25, + 19, + 37, + 15, + 11, + 37, + 47, + 32, + 34, + 24, + 28, + 20, + 29, + 31, + 21, + 18, + 20, + 25, + 29, + 56, + 31, + 18, + 14, + 21, + 28, + 15, + 41, + 14, + 31 + ], + "weighted_loads": [ + 2.4451091568917036, + 1.0290217213332653, + 1.4918441623449326, + 1.9223599378019571, + 1.2235132195055485, + 2.0474367663264275, + 0.727789768949151, + 1.0596631057560444, + 1.4076584167778492, + 1.8153399471193552, + 2.8704302944242954, + 0.4361653309315443, + 0.2577447220683098, + 1.8058327697217464, + 1.6999730300158262, + 1.0005429945886135, + 0.6933187209069729, + 0.29950668290257454, + 1.8327644914388657, + 2.1102969832718372, + 0.9202517233788967, + 3.0033694431185722, + 0.9584286399185658, + 2.9915910959243774, + 1.786747820675373, + 2.184314765036106, + 2.382561169564724, + 0.5206471048295498, + 1.38850655592978, + 2.1318268105387688, + 2.588791148737073, + 1.6792636811733246, + 0.24419830366969109, + 0.4053245335817337, + 1.589747490361333, + 1.3937545884400606, + 1.3226349726319313, + 2.8886397536844015, + 0.9226370137184858, + 0.7068928945809603, + 2.3657346814870834, + 2.583404855802655, + 2.8026286363601685, + 2.2381731383502483, + 1.6751605719327927, + 1.73997219838202, + 1.8146657347679138, + 4.23860308714211, + 1.3675761204212904, + 1.080379357561469, + 0.6870831213891506, + 1.8964802771806717, + 1.8771829027682543, + 1.3817612789571285, + 3.724747048690915, + 1.6220144536346197, + 1.4098291266709566, + 0.639744196087122, + 0.751376498490572, + 1.489280754700303, + 0.6080890521407127, + 3.714400041848421, + 0.9713811818510294, + 2.33221641369164 + ], + "unique_experts": 64, + "load_cv": 0.41695383217073645, + "normalized_load_entropy": 0.9789150554968586, + "max_load_share": 0.0364963503649635 + } + }, + "s1_x": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "36a0f8913602f7412fed4493fa8599ae815c50a8e708b6967f59ae803cc67ee2", + "route_weight_sha256": "b7c948146dfece429756d40ead72266c8e937591dd1d12a268ac9b0cc22f2484", + "loads": [ + 29, + 21, + 20, + 29, + 18, + 31, + 16, + 23, + 11, + 25, + 35, + 15, + 4, + 22, + 30, + 10, + 25, + 4, + 32, + 30, + 13, + 35, + 21, + 31, + 31, + 37, + 62, + 13, + 30, + 32, + 34, + 16, + 3, + 3, + 19, + 24, + 18, + 35, + 14, + 8, + 34, + 47, + 31, + 26, + 25, + 18, + 19, + 31, + 36, + 19, + 15, + 20, + 22, + 29, + 53, + 24, + 17, + 2, + 16, + 17, + 8, + 37, + 9, + 30 + ], + "weighted_loads": [ + 2.3030988685786724, + 0.9859922472387552, + 1.3183835726231337, + 1.9419825430959463, + 1.043635044246912, + 1.990100672468543, + 0.6657023597508669, + 0.8240998927503824, + 0.3508258629590273, + 1.7790509816259146, + 2.4873227793723345, + 0.5350536089390516, + 0.12249645031988621, + 1.7750528566539288, + 1.4363918490707874, + 0.30291273817420006, + 0.8580771367996931, + 0.18652615882456303, + 1.7001284081488848, + 2.1072937548160553, + 0.6095553059130907, + 3.183913664892316, + 0.9476635940372944, + 2.9287752993404865, + 1.613150428980589, + 1.9607509821653366, + 2.051875749602914, + 0.48190241679549217, + 1.431828610599041, + 2.0689236912876368, + 2.842358248308301, + 1.2456977721303701, + 0.12657003477215767, + 0.10499006509780884, + 1.5775406677275896, + 1.3551002126187086, + 1.3021569326519966, + 2.6742348577827215, + 0.903718750923872, + 0.4454380441457033, + 2.0612404197454453, + 2.5724572092294693, + 2.6638274900615215, + 1.947073446586728, + 1.7292460426688194, + 0.9076297990977764, + 1.7024036049842834, + 4.423321515321732, + 1.4923425819724798, + 1.0191493388265371, + 0.55918413028121, + 1.9046287462115288, + 1.689437823370099, + 1.3931535854935646, + 3.656654343008995, + 0.9595386404544115, + 1.288715673610568, + 0.07661210745573044, + 0.6010614074766636, + 0.7225149068981409, + 0.36845042556524277, + 3.540170507505536, + 0.8131349105387926, + 2.278516784310341 + ], + "unique_experts": 64, + "load_cv": 0.5004455827964158, + "normalized_load_entropy": 0.9679111472671904, + "max_load_share": 0.041499330655957165 + }, + "full_input": { + "tokens": 290, + "top_k": 6, + "decisions": 1740, + "ordered_route_sha256": "770e593d3e6c8aadda6093a55d8a1d4a9171f5313c09a735a603b1a48ee868a9", + "route_weight_sha256": "843e9e41aed5386c9d13a147a7d7f1bd0a4849ae4b35cd811d53842d8c7b4334", + "loads": [ + 31, + 21, + 23, + 29, + 25, + 34, + 17, + 27, + 32, + 26, + 40, + 18, + 4, + 23, + 31, + 23, + 25, + 9, + 33, + 31, + 16, + 37, + 25, + 32, + 33, + 42, + 83, + 14, + 30, + 34, + 35, + 22, + 4, + 5, + 19, + 24, + 19, + 36, + 14, + 13, + 35, + 60, + 34, + 33, + 26, + 29, + 21, + 33, + 38, + 19, + 24, + 24, + 27, + 29, + 57, + 28, + 26, + 14, + 20, + 28, + 10, + 42, + 10, + 34 + ], + "weighted_loads": [ + 2.4081027917563915, + 0.9859922472387552, + 1.4780813101679087, + 1.9419825430959463, + 1.4497464336454868, + 2.2107844036072493, + 0.7108738664537668, + 1.090390918776393, + 1.5824640076607466, + 1.8040118273347616, + 2.9450191128998995, + 0.7331560999155045, + 0.12249645031988621, + 1.8148667588829994, + 1.4630341734737158, + 1.1149406023323536, + 0.8580771367996931, + 0.3878788948059082, + 1.7394665013998747, + 2.173378311097622, + 0.8473693449050188, + 3.3885441292077303, + 1.218314440920949, + 2.96341335773468, + 1.6850600764155388, + 2.167160727083683, + 3.4117892365902662, + 0.5240446478128433, + 1.431828610599041, + 2.2311093527823687, + 2.928298631682992, + 1.8789826538413763, + 0.17609036341309547, + 0.2407638616859913, + 1.5775406677275896, + 1.3551002126187086, + 1.5610125735402107, + 2.707608016207814, + 0.903718750923872, + 0.8135447781533003, + 2.113789040595293, + 3.2122229170054197, + 2.8710149098187685, + 2.190138904377818, + 1.8819275572896004, + 1.7098849341273308, + 1.834439940750599, + 4.505873009562492, + 1.6437240540981293, + 1.0191493388265371, + 0.9954119175672531, + 2.270075436681509, + 1.9910386558622122, + 1.3931535854935646, + 3.7498782966285944, + 1.476959289982915, + 1.646291647106409, + 0.7683884352445602, + 0.7244672477245331, + 1.4538669791072607, + 0.48382071778178215, + 3.847944835200906, + 0.8684972953051329, + 2.7706263437867165 + ], + "unique_experts": 64, + "load_cv": 0.47134285861632486, + "normalized_load_entropy": 0.9741291766425174, + "max_load_share": 0.04770114942528736 + } + }, + "s0_period": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "2026276582762104290fcec6be6c3753ac14f651e7fbda637c55ab6c9f3333ab", + "route_weight_sha256": "f1427e8a6e0daeebf9a8f2338fd06564d66cca6a6c5208cd4b290a38854820ca", + "loads": [ + 29, + 22, + 20, + 29, + 18, + 30, + 16, + 21, + 16, + 26, + 35, + 10, + 9, + 22, + 33, + 9, + 20, + 4, + 35, + 30, + 14, + 32, + 19, + 32, + 35, + 35, + 47, + 14, + 29, + 34, + 28, + 16, + 3, + 6, + 19, + 25, + 18, + 37, + 15, + 8, + 37, + 36, + 32, + 29, + 23, + 17, + 19, + 29, + 32, + 21, + 14, + 20, + 22, + 30, + 54, + 27, + 16, + 4, + 19, + 17, + 15, + 37, + 13, + 31 + ], + "weighted_loads": [ + 2.4487311020493507, + 1.0333860907703638, + 1.3981149960309267, + 1.9239134397357702, + 1.056359924376011, + 1.9636826980859041, + 0.6849430203437805, + 0.7621378619223833, + 0.5157933104783297, + 1.850875198841095, + 2.5602585934102535, + 0.3843350075185299, + 0.2565291468054056, + 1.8083032108843327, + 1.668357403948903, + 0.26926749013364315, + 0.7154259458184242, + 0.19097211956977844, + 1.822649534791708, + 2.116524390876293, + 0.6455212328583002, + 3.0165745820850134, + 0.8967842925339937, + 2.988182235509157, + 1.7743735741823912, + 1.9474348910152912, + 1.5676600597798824, + 0.5216387175023556, + 1.3846800290048122, + 2.1197166815400124, + 2.5995543505996466, + 1.2583668436855078, + 0.14540941640734673, + 0.21978232078254223, + 1.588126813992858, + 1.3929609917104244, + 1.3031054604798555, + 2.884712314233184, + 0.9266345631331205, + 0.4524091389030218, + 2.3385639153420925, + 2.1182723101228476, + 2.8008797354996204, + 2.0843978580087423, + 1.6467770710587502, + 0.8943454511463642, + 1.7270738370716572, + 4.241788748651743, + 1.3876644279807806, + 1.072106085717678, + 0.5380085837095976, + 1.8978940173983574, + 1.6515819337219, + 1.4132608585059643, + 3.6779432594776154, + 1.0718085430562496, + 1.2434119321405888, + 0.12391707114875317, + 0.7069949489086866, + 0.708271274343133, + 0.5407098047435284, + 3.499506004154682, + 0.9131071008741856, + 2.341225428506732 + ], + "unique_experts": 64, + "load_cv": 0.44610060614541025, + "normalized_load_entropy": 0.9743065774454983, + "max_load_share": 0.03614457831325301 + }, + "full_input": { + "tokens": 274, + "top_k": 6, + "decisions": 1644, + "ordered_route_sha256": "abc9157c672cd89ba84a404f20bbd4723f8938356f0cc545e35102eafa6b2fea", + "route_weight_sha256": "1ab64a457da7fdd111463ec61ab2b6579817e42fa199e03d9f946cf190b37821", + "loads": [ + 29, + 22, + 22, + 29, + 23, + 31, + 18, + 23, + 31, + 27, + 37, + 14, + 9, + 22, + 34, + 18, + 20, + 5, + 35, + 30, + 17, + 32, + 20, + 32, + 35, + 39, + 60, + 14, + 29, + 34, + 28, + 20, + 4, + 8, + 19, + 26, + 19, + 37, + 15, + 11, + 38, + 46, + 32, + 35, + 23, + 27, + 20, + 29, + 33, + 21, + 18, + 21, + 26, + 30, + 56, + 31, + 19, + 11, + 20, + 28, + 16, + 41, + 14, + 31 + ], + "weighted_loads": [ + 2.4487311020493507, + 1.0333860907703638, + 1.4836379047483206, + 1.9239134397357702, + 1.3404379654675722, + 2.0542638171464205, + 0.7859693467617035, + 1.0137783903628588, + 1.3142841700464487, + 1.8764740824699402, + 2.8295515589416027, + 0.5959172770380974, + 0.2565291468054056, + 1.8083032108843327, + 1.6962276827543974, + 0.8845293205231428, + 0.7154259458184242, + 0.2623504549264908, + 1.822649534791708, + 2.116524390876293, + 0.941180719062686, + 3.0165745820850134, + 0.9270554985851049, + 2.988182235509157, + 1.7743735741823912, + 2.1244330294430256, + 2.380166856572032, + 0.5216387175023556, + 1.3846800290048122, + 2.1197166815400124, + 2.5995543505996466, + 1.6803671922534704, + 0.20705286040902138, + 0.39854016713798046, + 1.588126813992858, + 1.4141815137118101, + 1.324504241347313, + 2.884712314233184, + 0.9266345631331205, + 0.6875275429338217, + 2.3936369083821774, + 2.528931548818946, + 2.8008797354996204, + 2.2709236331284046, + 1.6467770710587502, + 1.7112825997173786, + 1.8171486668288708, + 4.241788748651743, + 1.4087088610976934, + 1.072106085717678, + 0.6874769236892462, + 1.9509561285376549, + 1.9146787580102682, + 1.4132608585059643, + 3.722478497773409, + 1.6280946172773838, + 1.4363089576363564, + 0.5658181551843882, + 0.7283014170825481, + 1.4213192965835333, + 0.6313354186713696, + 3.7124603986740112, + 0.9722303710877895, + 2.341225428506732 + ], + "unique_experts": 64, + "load_cv": 0.4158164376635715, + "normalized_load_entropy": 0.9787211647207384, + "max_load_share": 0.0364963503649635 + } + }, + "s1_period": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "37470fe514212cb7e4c792528bbabc15ed38fdf91a0017f4c77a1ed40395070c", + "route_weight_sha256": "d548f14a08d9e85cd52391ea8b350e9436efa2121a92af1ebabafec3fb87ad6d", + "loads": [ + 29, + 21, + 20, + 29, + 18, + 32, + 16, + 24, + 11, + 25, + 35, + 13, + 3, + 22, + 30, + 10, + 28, + 4, + 32, + 30, + 12, + 35, + 21, + 31, + 32, + 36, + 63, + 14, + 30, + 32, + 34, + 16, + 3, + 3, + 19, + 23, + 18, + 35, + 13, + 8, + 34, + 47, + 31, + 27, + 26, + 18, + 19, + 31, + 36, + 19, + 15, + 20, + 22, + 30, + 53, + 24, + 16, + 2, + 13, + 16, + 8, + 37, + 9, + 31 + ], + "weighted_loads": [ + 2.3037599250674248, + 0.990406209602952, + 1.3178630582988262, + 1.9446575567126274, + 1.0376333482563496, + 2.0220555774867535, + 0.6738821249455214, + 0.8494694642722607, + 0.3445862606167793, + 1.782523538917303, + 2.4865119382739067, + 0.48484125547111034, + 0.09706758335232735, + 1.7751362770795822, + 1.4341864511370659, + 0.3031391855329275, + 0.926364365965128, + 0.17974763177335262, + 1.6971456985920668, + 2.110443528741598, + 0.5879795234650373, + 3.1878291126340628, + 0.9462601449340582, + 2.930526874959469, + 1.6462307032197714, + 1.9275906048715115, + 2.0759528558701277, + 0.5121594239026308, + 1.430662689730525, + 2.066063482314348, + 2.8416920322924852, + 1.2485147174447775, + 0.12281712144613266, + 0.10351958684623241, + 1.5751935057342052, + 1.3273368943482637, + 1.3000475224107504, + 2.674832923337817, + 0.8831294924020767, + 0.4461785741150379, + 2.0601248033344746, + 2.5772484820336103, + 2.6643186435103416, + 1.9740752968937159, + 1.75299634039402, + 0.9104569926857948, + 1.7029472328722477, + 4.422639228403568, + 1.491144409403205, + 1.0135309603065252, + 0.5606579892337322, + 1.9026374146342278, + 1.6853019818663597, + 1.4208043850958347, + 3.6625837720930576, + 0.9620334673672915, + 1.254193576052785, + 0.07663866505026817, + 0.5249896682798862, + 0.7005622759461403, + 0.3685674499720335, + 3.5404441710561514, + 0.8116748947650194, + 2.3101333156228065 + ], + "unique_experts": 64, + "load_cv": 0.5095304314650765, + "normalized_load_entropy": 0.9666379874973585, + "max_load_share": 0.04216867469879518 + }, + "full_input": { + "tokens": 290, + "top_k": 6, + "decisions": 1740, + "ordered_route_sha256": "cb4af34626f4040b8d6d275e30a7a900016c74b4baba2af7fda43bbc59cad26f", + "route_weight_sha256": "d28b60074cdcec77636033660f5d34f3e8804a394e7848f3c61d9db7dfbc8f74", + "loads": [ + 31, + 21, + 23, + 29, + 26, + 35, + 17, + 27, + 31, + 25, + 40, + 18, + 3, + 23, + 31, + 22, + 28, + 9, + 33, + 31, + 15, + 37, + 25, + 32, + 34, + 41, + 84, + 15, + 30, + 34, + 36, + 22, + 4, + 5, + 19, + 23, + 20, + 36, + 13, + 13, + 35, + 60, + 34, + 34, + 27, + 28, + 20, + 33, + 38, + 19, + 24, + 25, + 28, + 30, + 57, + 28, + 25, + 14, + 17, + 26, + 10, + 42, + 10, + 35 + ], + "weighted_loads": [ + 2.408763848245144, + 0.990406209602952, + 1.4674662314355373, + 1.9446575567126274, + 1.5632809475064278, + 2.243833649903536, + 0.7190536316484213, + 1.0659398566931486, + 1.5352874137461185, + 1.782523538917303, + 2.943596877157688, + 0.8495577611029148, + 0.09706758335232735, + 1.8149501793086529, + 1.4608403258025646, + 1.004701754078269, + 0.926364365965128, + 0.3811003677546978, + 1.7364837918430567, + 2.1765280850231647, + 0.822980111464858, + 3.392459576949477, + 1.2169109918177128, + 2.9651649333536625, + 1.7181403506547213, + 2.1333243250846863, + 3.4260776434093714, + 0.554301654919982, + 1.430662689730525, + 2.22824914380908, + 2.94850298948586, + 1.882935767993331, + 0.17233745008707047, + 0.23916571773588657, + 1.5751935057342052, + 1.3273368943482637, + 1.5808669123798609, + 2.70820608176291, + 0.8831294924020767, + 0.7953031845390797, + 2.1128035597503185, + 3.185653295367956, + 2.8715060632675886, + 2.2190580647438765, + 1.905677855014801, + 1.677981112152338, + 1.7969312258064747, + 4.505190722644329, + 1.6425258815288544, + 1.0135309603065252, + 0.9970906972885132, + 2.3110131323337555, + 2.020749654620886, + 1.4208043850958347, + 3.755807725712657, + 1.4812145251780748, + 1.614941157400608, + 0.7686881516128778, + 0.6474048085510731, + 1.3375290893018246, + 0.4839377421885729, + 3.843517893925309, + 0.868374751880765, + 2.802242875099182 + ], + "unique_experts": 64, + "load_cv": 0.47762458868966023, + "normalized_load_entropy": 0.9733333471960007, + "max_load_share": 0.04827586206896552 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 249, + "ordered_topk_exact_tokens": 194, + "set_exact_tokens": 212, + "mean_set_jaccard": 0.95754446356856, + "mean_token_weighted_tv": 0.006241843055739221, + "aggregate_load_tv": 0.02008032128514056 + }, + "system_bos": { + "tokens": 249, + "ordered_topk_exact_tokens": 144, + "set_exact_tokens": 169, + "mean_set_jaccard": 0.9004589787722317, + "mean_token_weighted_tv": 0.01475354515195611, + "aggregate_load_tv": 0.04149933065595717 + }, + "system_x": { + "tokens": 249, + "ordered_topk_exact_tokens": 141, + "set_exact_tokens": 163, + "mean_set_jaccard": 0.8927137119908204, + "mean_token_weighted_tv": 0.016315266452580093, + "aggregate_load_tv": 0.04551539491298528 + }, + "system_period": { + "tokens": 249, + "ordered_topk_exact_tokens": 144, + "set_exact_tokens": 164, + "mean_set_jaccard": 0.8955823293172691, + "mean_token_weighted_tv": 0.01582838406404817, + "aggregate_load_tv": 0.04551539491298528 + }, + "bos_at_s0": { + "tokens": 249, + "ordered_topk_exact_tokens": 119, + "set_exact_tokens": 146, + "mean_set_jaccard": 0.8673742589405239, + "mean_token_weighted_tv": 0.02271994484221959, + "aggregate_load_tv": 0.047523427041499325 + }, + "bos_at_s1": { + "tokens": 249, + "ordered_topk_exact_tokens": 114, + "set_exact_tokens": 133, + "mean_set_jaccard": 0.8479632816982214, + "mean_token_weighted_tv": 0.024634935208652394, + "aggregate_load_tv": 0.06358768406961178 + }, + "x_at_s0": { + "tokens": 249, + "ordered_topk_exact_tokens": 123, + "set_exact_tokens": 149, + "mean_set_jaccard": 0.869095429336393, + "mean_token_weighted_tv": 0.020873032592566138, + "aggregate_load_tv": 0.046184738955823285 + }, + "x_at_s1": { + "tokens": 249, + "ordered_topk_exact_tokens": 113, + "set_exact_tokens": 134, + "mean_set_jaccard": 0.8448078026391279, + "mean_token_weighted_tv": 0.02491377437315193, + "aggregate_load_tv": 0.06559571619812583 + }, + "period_at_s0": { + "tokens": 249, + "ordered_topk_exact_tokens": 125, + "set_exact_tokens": 153, + "mean_set_jaccard": 0.8728246318607764, + "mean_token_weighted_tv": 0.020387740263408685, + "aggregate_load_tv": 0.04551539491298527 + }, + "period_at_s1": { + "tokens": 249, + "ordered_topk_exact_tokens": 108, + "set_exact_tokens": 132, + "mean_set_jaccard": 0.8442340791738382, + "mean_token_weighted_tv": 0.024835958029611045, + "aggregate_load_tv": 0.06693440428380187 + } + } + }, + "layer_02": { + "layer": 2, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "0a5192b169579c820cff45664b89848a7b0c1f2b1dc144e9eb1f4ce7f47c4966", + "route_weight_sha256": "ad154783c9fed8fa587b3f0e9b86b7ade265d030b93d2586b831ed5f767d717d", + "loads": [ + 31, + 23, + 17, + 21, + 23, + 35, + 13, + 23, + 21, + 35, + 9, + 20, + 17, + 32, + 18, + 32, + 42, + 28, + 28, + 20, + 30, + 15, + 22, + 22, + 30, + 23, + 31, + 27, + 29, + 9, + 15, + 28, + 25, + 22, + 25, + 24, + 19, + 15, + 7, + 25, + 10, + 25, + 11, + 30, + 36, + 36, + 31, + 23, + 30, + 21, + 25, + 5, + 32, + 40, + 18, + 24, + 39, + 18, + 14, + 21, + 24, + 29, + 11, + 10 + ], + "weighted_loads": [ + 2.7996329739689827, + 1.7102173063904047, + 0.9203690346330404, + 1.048890858888626, + 1.597525930032134, + 2.715342551469803, + 0.49591466411948204, + 1.9248986393213272, + 1.4624163396656513, + 2.7140300534665585, + 0.38598567247390747, + 1.6744623798877, + 0.9560283608734608, + 1.077124061062932, + 0.7518861163407564, + 2.2304025515913963, + 2.6593269370496273, + 2.134732522070408, + 2.0621339455246925, + 0.9262231308966875, + 2.830995589494705, + 0.5094454623758793, + 3.179522465914488, + 1.0633713603019714, + 2.258311415091157, + 1.8752037417143583, + 2.6536493618041277, + 2.2913595512509346, + 0.9996824245899916, + 0.3941844068467617, + 0.7839910909533501, + 1.5289360843598843, + 2.004541091620922, + 1.1401099562644958, + 2.15444403514266, + 1.1542761642485857, + 1.5225162897258997, + 1.555719843134284, + 0.32876537181437016, + 1.7954480480402708, + 0.43225322663784027, + 2.005282450467348, + 0.9001100603491068, + 2.2110889572650194, + 4.095833580940962, + 2.5564008243381977, + 2.35030023381114, + 1.047408489510417, + 2.817862406373024, + 0.9205546155571938, + 2.2182401046156883, + 0.15167956799268723, + 1.9410791397094727, + 2.6720946598798037, + 0.9243146516382694, + 1.6173824928700924, + 3.267803305760026, + 1.61215178668499, + 0.5900493413209915, + 1.9050799440592527, + 2.4539492912590504, + 2.4765811786055565, + 0.5134261194616556, + 0.7186905033886433 + ], + "unique_experts": 64, + "load_cv": 0.3597037697953492, + "normalized_load_entropy": 0.9832629830808716, + "max_load_share": 0.028112449799196786 + }, + "full_input": { + "tokens": 274, + "top_k": 6, + "decisions": 1644, + "ordered_route_sha256": "22c4ec84c96851d51de7d6739350381b9db1d15f4a8a0a42db9b460aa77bee25", + "route_weight_sha256": "96a6cb6f52aefe4f0b18f7e10864e36c0c2b06befa4df6774c8c9dcc1b66e45c", + "loads": [ + 31, + 33, + 17, + 23, + 23, + 35, + 13, + 25, + 24, + 35, + 12, + 20, + 18, + 32, + 27, + 32, + 42, + 29, + 29, + 24, + 32, + 24, + 22, + 22, + 33, + 23, + 32, + 29, + 31, + 9, + 15, + 29, + 25, + 22, + 30, + 39, + 19, + 15, + 11, + 25, + 10, + 25, + 18, + 30, + 36, + 36, + 34, + 27, + 31, + 21, + 25, + 11, + 32, + 41, + 18, + 24, + 39, + 25, + 22, + 24, + 34, + 33, + 16, + 21 + ], + "weighted_loads": [ + 2.7996329739689827, + 2.6535210963338614, + 0.9203690346330404, + 2.746279329061508, + 1.597525930032134, + 2.715342551469803, + 0.49591466411948204, + 2.155966691672802, + 1.7156570442020893, + 2.7140300534665585, + 0.5121731758117676, + 1.6744623798877, + 0.9953495562076569, + 1.077124061062932, + 1.1047902014106512, + 2.2304025515913963, + 2.6593269370496273, + 2.1354300701641478, + 2.0637214123271406, + 1.67796559818089, + 3.1439746618270874, + 1.2034074924886227, + 3.179522465914488, + 1.0633713603019714, + 2.406853938475251, + 1.8752037417143583, + 2.654497464536689, + 2.5506441965699196, + 1.2075946535915136, + 0.3941844068467617, + 0.7839910909533501, + 1.5296325935050845, + 2.004541091620922, + 1.1401099562644958, + 2.3779688999056816, + 3.118829684332013, + 1.5225162897258997, + 1.555719843134284, + 0.45883279480040073, + 1.7954480480402708, + 0.43225322663784027, + 2.005282450467348, + 1.6664731409400702, + 2.2110889572650194, + 4.095833580940962, + 2.5564008243381977, + 2.453035471960902, + 1.304483549669385, + 2.8434041123837233, + 0.9205546155571938, + 2.2182401046156883, + 0.7409455385059118, + 1.9410791397094727, + 2.673410481424071, + 0.9243146516382694, + 1.6173824928700924, + 3.267803305760026, + 1.9924164526164532, + 0.9542128853499889, + 2.0131811667233706, + 3.280396274290979, + 2.6976032815873623, + 0.907470403239131, + 1.4753674436360598 + ], + "unique_experts": 64, + "load_cv": 0.3078315652324208, + "normalized_load_entropy": 0.987892065749732, + "max_load_share": 0.025547445255474453 + } + }, + "s1_eos": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "e62d7429d029158909ca8f91461c8ca8336b0c67e81bfc455d05b86c43dea821", + "route_weight_sha256": "db099a651d7175f1491c4ddbc045f66da18633349e07c8bd8534ec05a0789d0b", + "loads": [ + 31, + 23, + 18, + 21, + 22, + 35, + 10, + 24, + 21, + 36, + 8, + 20, + 18, + 32, + 18, + 33, + 43, + 28, + 28, + 19, + 30, + 15, + 22, + 24, + 29, + 23, + 32, + 27, + 31, + 9, + 17, + 25, + 24, + 23, + 25, + 24, + 19, + 15, + 7, + 24, + 10, + 26, + 11, + 32, + 35, + 37, + 31, + 23, + 33, + 21, + 25, + 4, + 31, + 40, + 16, + 25, + 39, + 16, + 13, + 21, + 24, + 29, + 9, + 10 + ], + "weighted_loads": [ + 2.834906157106161, + 1.7119727078825235, + 0.9502582736313343, + 1.067611888051033, + 1.5805721338838339, + 2.738617928698659, + 0.40805825777351856, + 1.9789644908159971, + 1.4979826770722866, + 2.7631290275603533, + 0.360224187374115, + 1.6766473799943924, + 0.9942622296512127, + 1.08661656267941, + 0.7457336857914925, + 2.305026523768902, + 2.7216969672590494, + 2.1396583169698715, + 2.0733600798994303, + 0.8941222485154867, + 2.826340865343809, + 0.5016096364706755, + 3.223268199712038, + 1.1562572605907917, + 2.213685194030404, + 1.8647806458175182, + 2.6982506345957518, + 2.3121294900774956, + 1.0522628165781498, + 0.3999413810670376, + 0.8549982402473688, + 1.4004783872514963, + 1.964285109192133, + 1.1585400607436895, + 2.1684916466474533, + 1.1585600785911083, + 1.5409836322069168, + 1.5560611654073, + 0.3264313507825136, + 1.7531946152448654, + 0.4324909057468176, + 2.055546797811985, + 0.8919629938900471, + 2.2884332928806543, + 4.043466072529554, + 2.604289550334215, + 2.3643747456371784, + 1.0290344525128603, + 2.912399498745799, + 0.9178121592849493, + 2.2128108013421297, + 0.1184704340994358, + 1.9095164481550455, + 2.6392750274389982, + 0.8798130769282579, + 1.663045097142458, + 3.243728445842862, + 1.5660248771309853, + 0.5545684341341257, + 1.905056994408369, + 2.43909053504467, + 2.4784403555095196, + 0.44007984921336174, + 0.7416813485324383 + ], + "unique_experts": 64, + "load_cv": 0.37439015761905803, + "normalized_load_entropy": 0.9816692528251922, + "max_load_share": 0.028781793842034806 + }, + "full_input": { + "tokens": 290, + "top_k": 6, + "decisions": 1740, + "ordered_route_sha256": "ec321ef8c35a3e1265278ef17f96faa26147c9156c79e5efe1964be9f6cb3ee0", + "route_weight_sha256": "e945a89c4f7e909aa56b3bbf28f4c7f7143dcf04569781f8782176ee6a1f8536", + "loads": [ + 35, + 34, + 19, + 24, + 23, + 36, + 10, + 28, + 30, + 37, + 15, + 20, + 18, + 34, + 30, + 34, + 45, + 29, + 29, + 25, + 32, + 26, + 23, + 24, + 35, + 24, + 33, + 30, + 35, + 9, + 18, + 27, + 24, + 23, + 34, + 41, + 19, + 16, + 13, + 27, + 10, + 26, + 21, + 33, + 38, + 37, + 39, + 30, + 35, + 22, + 26, + 13, + 32, + 44, + 16, + 25, + 43, + 23, + 15, + 31, + 34, + 36, + 19, + 24 + ], + "weighted_loads": [ + 3.3557757437229156, + 2.723827300593257, + 0.9756817892193794, + 2.799105577170849, + 1.611047314479947, + 2.879054443910718, + 0.40805825777351856, + 2.2715557496994734, + 2.3005831129848957, + 2.880624817684293, + 0.6656745336949825, + 1.6766473799943924, + 0.9942622296512127, + 1.1115197993349284, + 1.320291444659233, + 2.3371671810746193, + 2.785730477422476, + 2.1402424017433077, + 2.0747374722268432, + 1.6859264951199293, + 3.1149559430778027, + 1.2947153374552727, + 3.262120246887207, + 1.1562572605907917, + 2.4887059312313795, + 1.9148830585181713, + 2.699075602926314, + 2.963263161480427, + 1.2717217020690441, + 0.3999413810670376, + 0.888523930683732, + 1.4432800058275461, + 1.964285109192133, + 1.1585400607436895, + 2.5362402610480785, + 2.904155246913433, + 1.5409836322069168, + 1.5975194592028856, + 0.5178353060036898, + 2.1087000109255314, + 0.4324909057468176, + 2.055546797811985, + 2.110739953815937, + 2.4714127127081156, + 4.6887492798268795, + 2.604289550334215, + 3.011623650789261, + 1.408149803057313, + 2.9812182523310184, + 0.9611706454306841, + 2.238948732614517, + 0.9927439857274294, + 2.0867175851017237, + 2.8241003280272707, + 0.8798130769282579, + 1.663045097142458, + 3.4987077582627535, + 1.8824249915778637, + 0.6651519481092691, + 2.323657151311636, + 3.114174119196832, + 2.972284510731697, + 1.2789143361151218, + 1.8899084851145744 + ], + "unique_experts": 64, + "load_cv": 0.31793194870256936, + "normalized_load_entropy": 0.987088584077169, + "max_load_share": 0.02586206896551724 + } + }, + "s0_bos": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "efb776d4ce8b267a8002d54ddd6ea7580c3d6ba6e87702e59c7af6745ff398e2", + "route_weight_sha256": "de57a196679635780024547fc23f26a6442eca3506d7f9475567133e37905a6f", + "loads": [ + 31, + 22, + 16, + 27, + 24, + 34, + 8, + 24, + 21, + 39, + 8, + 18, + 15, + 21, + 18, + 34, + 47, + 27, + 29, + 20, + 31, + 10, + 22, + 28, + 30, + 24, + 29, + 30, + 32, + 9, + 16, + 28, + 25, + 21, + 25, + 27, + 20, + 15, + 5, + 24, + 9, + 23, + 12, + 30, + 35, + 37, + 31, + 24, + 31, + 20, + 24, + 6, + 31, + 41, + 16, + 25, + 38, + 19, + 8, + 23, + 27, + 29, + 9, + 12 + ], + "weighted_loads": [ + 2.721447244286537, + 1.564958930015564, + 0.8916135840117931, + 1.3863501213490963, + 1.6836965885013342, + 2.710457168519497, + 0.33900463208556175, + 1.9537099115550518, + 1.4217375703155994, + 2.748074246570468, + 0.3446822911500931, + 1.5611415151506662, + 0.8695636056363583, + 0.7484083101153374, + 0.7272043526172638, + 2.28905189037323, + 2.9424097016453743, + 2.046296523883939, + 2.10418420098722, + 0.8979127872735262, + 2.948322094976902, + 0.3477714266628027, + 3.175284132361412, + 1.2052116207778454, + 2.290286937728524, + 1.9096368253231049, + 2.5969185270369053, + 2.418215721845627, + 1.1569371037185192, + 0.4055175166577101, + 0.8375044204294682, + 1.5653870534151793, + 1.9821713250130415, + 1.1311003807932138, + 2.138982417061925, + 1.2280824147164822, + 1.6106935106217861, + 1.5921600218862295, + 0.25941028632223606, + 1.7872763443738222, + 0.426131134852767, + 1.9911082051694393, + 0.9608842097222805, + 2.2462470047175884, + 4.204425025731325, + 2.666084222495556, + 2.3678996227681637, + 1.062490276992321, + 2.9086547419428825, + 0.8494690153747797, + 2.1850340701639652, + 0.18219947442412376, + 1.9783669523894787, + 2.7181412149220705, + 0.8959155529737473, + 1.669967144727707, + 3.1635030638426542, + 1.5822030361741781, + 0.393336633220315, + 1.9844756480306387, + 2.628617335110903, + 2.533084262162447, + 0.4998944215476513, + 0.8411869537085295 + ], + "unique_experts": 64, + "load_cv": 0.39394522130813014, + "normalized_load_entropy": 0.9796874234507982, + "max_load_share": 0.03145917001338688 + }, + "full_input": { + "tokens": 274, + "top_k": 6, + "decisions": 1644, + "ordered_route_sha256": "249e4af736e592b85d2867d9469b88051ee5e3939aa4520f97b094b02b490882", + "route_weight_sha256": "0b4d590cbb12ab1ebb05e10a46f344ad189e2d208c499ae8234ebfa7593a07e7", + "loads": [ + 31, + 32, + 16, + 28, + 24, + 34, + 8, + 26, + 24, + 39, + 11, + 18, + 17, + 22, + 23, + 34, + 48, + 27, + 29, + 24, + 33, + 19, + 22, + 28, + 32, + 24, + 29, + 32, + 34, + 9, + 16, + 28, + 25, + 21, + 30, + 43, + 20, + 15, + 10, + 24, + 9, + 23, + 20, + 30, + 35, + 37, + 34, + 28, + 32, + 20, + 24, + 12, + 31, + 41, + 16, + 25, + 38, + 28, + 16, + 27, + 38, + 33, + 15, + 23 + ], + "weighted_loads": [ + 2.721447244286537, + 2.5082627199590206, + 0.8916135840117931, + 2.110934104770422, + 1.6836965885013342, + 2.710457168519497, + 0.33900463208556175, + 2.140399981290102, + 1.6661482118070126, + 2.748074246570468, + 0.4708697944879532, + 1.5611415151506662, + 0.946869932115078, + 0.7719656154513359, + 0.9279979057610035, + 2.28905189037323, + 2.972279069945216, + 2.046296523883939, + 2.10418420098722, + 1.5975368935614824, + 3.2401592805981636, + 1.0526112522929907, + 3.175284132361412, + 1.2052116207778454, + 2.394704395905137, + 1.9096368253231049, + 2.5969185270369053, + 2.6830730736255646, + 1.416065450757742, + 0.4055175166577101, + 0.8375044204294682, + 1.5653870534151793, + 1.9821713250130415, + 1.1311003807932138, + 2.3625072818249464, + 3.2696469575166702, + 1.6106935106217861, + 1.5921600218862295, + 0.4737902320921421, + 1.7872763443738222, + 0.426131134852767, + 1.9911082051694393, + 1.7533040009438992, + 2.2462470047175884, + 4.204425025731325, + 2.666084222495556, + 2.473934194073081, + 1.318581972271204, + 2.934196447953582, + 0.8494690153747797, + 2.1850340701639652, + 0.8038796838372946, + 1.9783669523894787, + 2.7181412149220705, + 0.8959155529737473, + 1.669967144727707, + 3.1635030638426542, + 2.0114947240799665, + 0.7575001772493124, + 2.1434556134045124, + 3.4901674641296268, + 2.7520938590168953, + 0.9620993472635746, + 1.8154666423797607 + ], + "unique_experts": 64, + "load_cv": 0.3407629225860244, + "normalized_load_entropy": 0.9852215020543531, + "max_load_share": 0.029197080291970802 + } + }, + "s1_bos": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "182926cab923133279e6ae96c218fecf229ceb8358e5aabc1c42d7e172c126e9", + "route_weight_sha256": "70b730e014c351271c8b987d6d9d9eeed37186e8c0677cfba33711ab23c3d58d", + "loads": [ + 31, + 22, + 16, + 26, + 22, + 34, + 8, + 23, + 21, + 42, + 10, + 18, + 16, + 20, + 13, + 34, + 47, + 27, + 28, + 17, + 30, + 15, + 22, + 29, + 31, + 24, + 30, + 31, + 33, + 8, + 16, + 30, + 24, + 22, + 26, + 26, + 20, + 14, + 4, + 22, + 9, + 28, + 11, + 32, + 35, + 38, + 31, + 23, + 32, + 20, + 24, + 4, + 32, + 40, + 19, + 28, + 39, + 16, + 8, + 23, + 24, + 29, + 6, + 11 + ], + "weighted_loads": [ + 2.696675356477499, + 1.573707228526473, + 0.8898614980280399, + 1.336670035496354, + 1.658095395192504, + 2.7384027540683746, + 0.33410237543284893, + 1.957754947245121, + 1.453234888613224, + 2.912810819223523, + 0.4145139046013355, + 1.5673224534839392, + 0.9380841087549925, + 0.7067820765078068, + 0.5529359616339207, + 2.362535871565342, + 2.966851642355323, + 2.0451843682676554, + 2.0873295851051807, + 0.8031445760279894, + 2.945227213203907, + 0.4856554977595806, + 3.243048256263137, + 1.249478755518794, + 2.2886351570487022, + 1.941700555384159, + 2.6359295397996902, + 2.373400002717972, + 1.1920909378677607, + 0.37281404808163643, + 0.8487316928803921, + 1.6390963736921549, + 1.937019070610404, + 1.1522072795778513, + 2.160694597288966, + 1.2026836927980185, + 1.5767176076769829, + 1.535282352939248, + 0.2179289497435093, + 1.7027647253125906, + 0.4476214926689863, + 2.1473831366747618, + 0.9184238947927952, + 2.344310235232115, + 4.164613679051399, + 2.649970207363367, + 2.3686644546687603, + 1.0231324806809425, + 2.953530764207244, + 0.8662918638437986, + 2.1536402851343155, + 0.11493738368153572, + 1.9321146328002214, + 2.6958901565521955, + 1.0072144884616137, + 1.8859085366129875, + 3.110491104424, + 1.501850489526987, + 0.39970387518405914, + 2.025426972657442, + 2.5125177670270205, + 2.510139364749193, + 0.34375314973294735, + 0.8029270209372044 + ], + "unique_experts": 64, + "load_cv": 0.4119484967241288, + "normalized_load_entropy": 0.9775459482250988, + "max_load_share": 0.03145917001338688 + }, + "full_input": { + "tokens": 290, + "top_k": 6, + "decisions": 1740, + "ordered_route_sha256": "da9e7f23ea7715935c86bf1e440ab271ef6bf45162191ed2bf9c0534b1fd6f68", + "route_weight_sha256": "91f4ca4674e3c061abf69698063ee7b276899bf69d96a78d74716e4a2849fd41", + "loads": [ + 35, + 33, + 17, + 29, + 23, + 35, + 8, + 27, + 30, + 43, + 17, + 18, + 17, + 22, + 23, + 35, + 50, + 27, + 28, + 23, + 32, + 26, + 23, + 29, + 36, + 25, + 30, + 34, + 37, + 8, + 17, + 32, + 24, + 22, + 35, + 44, + 20, + 15, + 11, + 25, + 9, + 28, + 22, + 33, + 38, + 38, + 39, + 30, + 34, + 21, + 25, + 13, + 33, + 43, + 19, + 28, + 43, + 23, + 10, + 33, + 35, + 36, + 17, + 25 + ], + "weighted_loads": [ + 3.2175449430942535, + 2.5855618212372065, + 0.915285013616085, + 2.125240972265601, + 1.6885705757886171, + 2.8788392692804337, + 0.33410237543284893, + 2.2099781557917595, + 2.249283142387867, + 3.0303066093474627, + 0.7199642509222031, + 1.5673224534839392, + 0.9655753429979086, + 0.7555334214121103, + 1.0233420263975859, + 2.3946765288710594, + 3.0597758311778307, + 2.0451843682676554, + 2.0873295851051807, + 1.5313424114137888, + 3.220551200211048, + 1.3013218138366938, + 3.281900303438306, + 1.249478755518794, + 2.525559965521097, + 1.9918029680848122, + 2.6359295397996902, + 3.034673973917961, + 1.4595789331942797, + 0.37281404808163643, + 0.8822573833167553, + 1.6818979922682047, + 1.937019070610404, + 1.1522072795778513, + 2.5284432116895914, + 3.040495188906789, + 1.5767176076769829, + 1.5767406467348337, + 0.5106138437986374, + 2.0582701209932566, + 0.4476214926689863, + 2.1473831366747618, + 2.1606725230813026, + 2.527289655059576, + 4.809896886348724, + 2.649970207363367, + 3.0216441489756107, + 1.3976232334971428, + 3.0223495177924633, + 0.9096503499895334, + 2.179778216406703, + 1.07594458386302, + 2.1093157697468996, + 2.8796301297843456, + 1.0072144884616137, + 1.8859085366129875, + 3.365470416843891, + 1.7910065241158009, + 0.5102873891592026, + 2.4576043654233217, + 3.222894606180489, + 3.0152646228671074, + 1.2486750464886427, + 2.128429353237152 + ], + "unique_experts": 64, + "load_cv": 0.3478412370973186, + "normalized_load_entropy": 0.9844411601786197, + "max_load_share": 0.028735632183908046 + } + }, + "s0_x": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "fb83af3a412998bc80c636238565eef33a48b20fa80605648e94ba4dfbf40f82", + "route_weight_sha256": "48e4863773586680dadfb7a48e6d98c2fe8358dccc1fa58ecb28cdeaf4e61376", + "loads": [ + 31, + 22, + 17, + 27, + 24, + 35, + 8, + 23, + 21, + 39, + 5, + 20, + 15, + 21, + 16, + 35, + 46, + 27, + 29, + 20, + 30, + 10, + 22, + 28, + 31, + 24, + 30, + 29, + 33, + 9, + 16, + 29, + 25, + 21, + 26, + 27, + 20, + 16, + 6, + 23, + 9, + 24, + 11, + 32, + 35, + 37, + 31, + 21, + 30, + 21, + 24, + 6, + 32, + 40, + 17, + 25, + 38, + 21, + 9, + 23, + 24, + 29, + 8, + 11 + ], + "weighted_loads": [ + 2.758275881409645, + 1.5578978210687637, + 0.9298294149339199, + 1.3573111593723297, + 1.683041237294674, + 2.759832039475441, + 0.33308861404657364, + 1.9030124079436064, + 1.4132794365286827, + 2.7810787837952375, + 0.25187155790627, + 1.6254203878343105, + 0.8723896704614162, + 0.7470650095492601, + 0.6878996305167675, + 2.288214836269617, + 2.8837895058095455, + 2.0710686799138784, + 2.0752131026238203, + 0.8908951506018639, + 2.912724193185568, + 0.3396508377045393, + 3.106361160054803, + 1.206162566319108, + 2.307196445763111, + 1.8979304432868958, + 2.6292179599404335, + 2.3580345809459686, + 1.1862780675292015, + 0.40244445763528347, + 0.823960654437542, + 1.5983798522502184, + 2.0043835490942, + 1.112487018108368, + 2.1925351060926914, + 1.2184453159570694, + 1.6160734705626965, + 1.6187365613877773, + 0.28008705005049706, + 1.762206070125103, + 0.4117255248129368, + 1.9926689881831408, + 0.9016370605677366, + 2.31735585257411, + 4.211133198812604, + 2.62457687407732, + 2.3775536008179188, + 0.9392677955329418, + 2.856069980189204, + 0.8833286873996258, + 2.162261698395014, + 0.1818010564893484, + 2.012806674465537, + 2.6712337359786034, + 0.9088583588600159, + 1.634229701012373, + 3.152055576443672, + 1.6621996946632862, + 0.4165338296443224, + 2.011864436790347, + 2.449325228109956, + 2.568330705165863, + 0.46157184429466724, + 0.7987447418272495 + ], + "unique_experts": 64, + "load_cv": 0.3968459489570824, + "normalized_load_entropy": 0.9791864347507752, + "max_load_share": 0.030789825970548863 + }, + "full_input": { + "tokens": 274, + "top_k": 6, + "decisions": 1644, + "ordered_route_sha256": "0db8a5ccdfd1d85457d023f83276b6918bdbb5ed5026081a91d188783766b6c4", + "route_weight_sha256": "be9befdab48b56b58eb27f6c7424156def1e16759faf605f681bb76054cae56b", + "loads": [ + 31, + 32, + 17, + 28, + 24, + 35, + 9, + 25, + 24, + 39, + 10, + 21, + 17, + 22, + 21, + 35, + 47, + 27, + 29, + 24, + 32, + 20, + 22, + 28, + 33, + 24, + 30, + 31, + 35, + 9, + 16, + 29, + 25, + 21, + 31, + 42, + 20, + 16, + 10, + 23, + 9, + 24, + 18, + 32, + 35, + 37, + 34, + 26, + 31, + 21, + 24, + 12, + 32, + 40, + 17, + 25, + 38, + 28, + 18, + 26, + 36, + 33, + 13, + 21 + ], + "weighted_loads": [ + 2.758275881409645, + 2.5012016110122204, + 0.9298294149339199, + 2.0818951427936554, + 1.683041237294674, + 2.759832039475441, + 0.36814267933368683, + 2.0846639033406973, + 1.6548125371336937, + 2.7810787837952375, + 0.48716909252107143, + 1.660524956882, + 0.9432253502309322, + 0.7713637594133615, + 0.8866762388497591, + 2.288214836269617, + 2.914687292650342, + 2.0710686799138784, + 2.0752131026238203, + 1.6051583960652351, + 3.2141163013875484, + 1.3410285692662, + 3.106361160054803, + 1.206162566319108, + 2.4117046296596527, + 1.8979304432868958, + 2.6292179599404335, + 2.628006085753441, + 1.446887768805027, + 0.40244445763528347, + 0.823960654437542, + 1.5983798522502184, + 2.0043835490942, + 1.112487018108368, + 2.416059970855713, + 3.207783330231905, + 1.6160734705626965, + 1.6187365613877773, + 0.405915554612875, + 1.762206070125103, + 0.4117255248129368, + 1.9926689881831408, + 1.6190572027117014, + 2.31735585257411, + 4.211133198812604, + 2.62457687407732, + 2.4830480236560106, + 1.2297467961907387, + 2.8816116861999035, + 0.8833286873996258, + 2.162261698395014, + 0.7482738718390465, + 2.012806674465537, + 2.6712337359786034, + 0.9088583588600159, + 1.634229701012373, + 3.152055576443672, + 2.0223061088472605, + 0.9096200596541166, + 2.157579803839326, + 3.3628383995965123, + 2.790433693677187, + 0.8741605002433062, + 1.4631372783333063 + ], + "unique_experts": 64, + "load_cv": 0.3363565461944417, + "normalized_load_entropy": 0.985554247274315, + "max_load_share": 0.028588807785888078 + } + }, + "s1_x": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "967f4850007ab6e2d4e693e80ab431c1b19091aa1f768d6ff3a2cd60cd348d42", + "route_weight_sha256": "d3e00103a70afbfc7a25cdebadc58318aad365fb17542a7000148b6a40310912", + "loads": [ + 31, + 22, + 16, + 25, + 22, + 34, + 8, + 24, + 21, + 39, + 9, + 19, + 17, + 20, + 13, + 35, + 46, + 27, + 28, + 18, + 30, + 13, + 22, + 29, + 31, + 24, + 30, + 31, + 32, + 9, + 16, + 29, + 24, + 22, + 27, + 25, + 19, + 15, + 5, + 22, + 11, + 27, + 12, + 31, + 36, + 37, + 31, + 23, + 32, + 20, + 25, + 4, + 32, + 39, + 19, + 29, + 40, + 16, + 8, + 24, + 24, + 29, + 5, + 11 + ], + "weighted_loads": [ + 2.7900912016630173, + 1.5426051430404186, + 0.8929871246218681, + 1.27247310616076, + 1.6456859670579433, + 2.7592108696699142, + 0.3299080543220043, + 1.9674714803695679, + 1.4506744518876076, + 2.832836603745818, + 0.37776285223662853, + 1.6012996900826693, + 0.9962454941123724, + 0.7061563264578581, + 0.5528279766440392, + 2.3862346690148115, + 2.896015152335167, + 2.049818327650428, + 2.0585718993097544, + 0.8389553818851709, + 2.9278938807547092, + 0.43110115453600883, + 3.213195947930217, + 1.2477550450712442, + 2.272548085078597, + 1.9260546583682299, + 2.6419077292084694, + 2.3586193416267633, + 1.1533616483211517, + 0.4012364596128464, + 0.8337320070713758, + 1.588879158720374, + 1.961019579321146, + 1.141476858407259, + 2.2138527184724808, + 1.1989273689687252, + 1.5313859414309263, + 1.5711073782294989, + 0.2411520592868328, + 1.7092740777879953, + 0.4930978249758482, + 2.114259036257863, + 0.9180332515388727, + 2.3039626348763704, + 4.1493899412453175, + 2.6144884023815393, + 2.3905191011726856, + 1.0152739826589823, + 2.9478905852884054, + 0.8731363378465176, + 2.1708521097898483, + 0.11237611621618271, + 1.9330882169306278, + 2.6390408761799335, + 1.0173216424882412, + 1.924523901194334, + 3.1587067898362875, + 1.4933943394571543, + 0.39785744808614254, + 2.1053270045667887, + 2.4818431437015533, + 2.519062966108322, + 0.3164428845047951, + 0.7852993234992027 + ], + "unique_experts": 64, + "load_cv": 0.40265592454752475, + "normalized_load_entropy": 0.9784605368547663, + "max_load_share": 0.030789825970548863 + }, + "full_input": { + "tokens": 290, + "top_k": 6, + "decisions": 1740, + "ordered_route_sha256": "a3a6dcfc6f056e2cf605de1fe1875a619eb17e5848b30b5fb0cb9dd8524fd78f", + "route_weight_sha256": "3167bf22b16938366e52f89c910becfbd9fbacbc35a55b2872eac9a4247b0fa5", + "loads": [ + 35, + 33, + 17, + 27, + 23, + 35, + 8, + 28, + 30, + 40, + 18, + 20, + 18, + 22, + 22, + 36, + 49, + 27, + 28, + 24, + 32, + 25, + 23, + 29, + 36, + 25, + 30, + 34, + 36, + 9, + 17, + 31, + 24, + 22, + 36, + 43, + 19, + 16, + 11, + 25, + 11, + 27, + 22, + 32, + 39, + 37, + 39, + 31, + 34, + 21, + 26, + 12, + 33, + 42, + 19, + 29, + 44, + 23, + 11, + 34, + 36, + 36, + 15, + 24 + ], + "weighted_loads": [ + 3.310960788279772, + 2.554459735751152, + 0.9184106402099133, + 2.0284832585603, + 1.6761611476540565, + 2.8996473848819733, + 0.3299080543220043, + 2.2075998336076736, + 2.2455852925777435, + 2.9503323938697577, + 0.7973438855260611, + 1.6362023409456015, + 1.0225780252367258, + 0.7547436784952879, + 0.9965704940259457, + 2.418375326320529, + 2.993977377191186, + 2.049818327650428, + 2.0585718993097544, + 1.5756982285529375, + 3.204659078270197, + 1.5293178874999285, + 3.252047995105386, + 1.2477550450712442, + 2.5104555059224367, + 1.976157071068883, + 2.6419077292084694, + 3.029756495729089, + 1.4223134890198708, + 0.4012364596128464, + 0.8672576975077391, + 1.631680777296424, + 1.961019579321146, + 1.141476858407259, + 2.581601332873106, + 2.999974738806486, + 1.5313859414309263, + 1.6125656720250845, + 0.41926596499979496, + 2.0647794734686613, + 0.4930978249758482, + 2.114259036257863, + 2.1066747959703207, + 2.4869420547038317, + 4.794673148542643, + 2.6144884023815393, + 3.0426638275384903, + 1.4185781832784414, + 3.016709338873625, + 0.9164948239922523, + 2.196990041062236, + 1.0038389824330807, + 2.110289353877306, + 2.8227808494120836, + 1.0173216424882412, + 1.924523901194334, + 3.413686102256179, + 1.7817688826471567, + 0.6144395973533392, + 2.5408533085137606, + 3.2388306399807334, + 3.0319163501262665, + 1.1649556159973145, + 1.8488719388842583 + ], + "unique_experts": 64, + "load_cv": 0.3396624656431522, + "normalized_load_entropy": 0.9852365913627444, + "max_load_share": 0.028160919540229885 + } + }, + "s0_period": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "a9844ab57e72bc5719f60d364c8e2589a695759c6c2ff4b8e0a1f95e1da12f20", + "route_weight_sha256": "2bdc1bde2ed241b62d1cc27d91264bab223bb498a3005730e3bb7d98d5d0c4e9", + "loads": [ + 31, + 22, + 17, + 27, + 24, + 35, + 9, + 23, + 21, + 39, + 4, + 19, + 16, + 22, + 17, + 35, + 47, + 27, + 29, + 20, + 29, + 11, + 22, + 27, + 29, + 24, + 30, + 28, + 34, + 9, + 17, + 28, + 25, + 21, + 26, + 27, + 20, + 16, + 6, + 24, + 9, + 24, + 12, + 31, + 35, + 37, + 31, + 21, + 31, + 22, + 24, + 5, + 32, + 40, + 16, + 25, + 38, + 20, + 9, + 23, + 24, + 29, + 8, + 11 + ], + "weighted_loads": [ + 2.753767915070057, + 1.5603345390409231, + 0.9288888536393642, + 1.3466088641434908, + 1.6685833968222141, + 2.765280809253454, + 0.36789342761039734, + 1.9115534480661154, + 1.4055114351212978, + 2.7870264649391174, + 0.22710524126887321, + 1.5881724450737238, + 0.9153883270919323, + 0.7707614172250032, + 0.7119816448539495, + 2.292648620903492, + 2.9214003328233957, + 2.070503143593669, + 2.0759986452758312, + 0.8999805990606546, + 2.8738745152950287, + 0.3691828940063715, + 3.102925430983305, + 1.1769458819180727, + 2.2409743890166283, + 1.891212223097682, + 2.626092281192541, + 2.3064661286771297, + 1.2336960788816214, + 0.4009883850812912, + 0.8583779260516167, + 1.5612753257155418, + 2.008756073191762, + 1.1205574851483107, + 2.2000896017998457, + 1.2137643825262785, + 1.6180862225592136, + 1.6210583988577127, + 0.2794151268899441, + 1.7969142105430365, + 0.4146519284695387, + 1.9994043316692114, + 0.9207277651876211, + 2.282115623354912, + 4.191933142021298, + 2.622531520202756, + 2.358374509960413, + 0.9460310693830252, + 2.888849576935172, + 0.9208266660571098, + 2.1510993875563145, + 0.15386136062443256, + 2.007752303034067, + 2.669246584177017, + 0.8837604001164436, + 1.6495156772434711, + 3.1458546463400126, + 1.6329452134668827, + 0.41529963724315166, + 2.0098391715437174, + 2.452782740816474, + 2.5841438565403223, + 0.4680483117699623, + 0.7941165417432785 + ], + "unique_experts": 64, + "load_cv": 0.39568820967877344, + "normalized_load_entropy": 0.979236052468381, + "max_load_share": 0.03145917001338688 + }, + "full_input": { + "tokens": 274, + "top_k": 6, + "decisions": 1644, + "ordered_route_sha256": "50059c9d70f655a715fcb9a095e304312a5f2b229fe8d4e0fd881c91e21d9645", + "route_weight_sha256": "08e148e671c6a2de3ac90420d76e76f950ef5eb2b49b50226c2090e32625de06", + "loads": [ + 32, + 32, + 17, + 29, + 24, + 35, + 9, + 25, + 25, + 39, + 7, + 19, + 17, + 23, + 22, + 36, + 47, + 27, + 29, + 24, + 31, + 20, + 22, + 27, + 32, + 24, + 30, + 30, + 36, + 9, + 17, + 28, + 25, + 22, + 31, + 41, + 20, + 16, + 11, + 24, + 9, + 24, + 19, + 31, + 35, + 37, + 35, + 26, + 33, + 22, + 24, + 11, + 32, + 40, + 16, + 25, + 38, + 27, + 17, + 26, + 37, + 33, + 13, + 20 + ], + "weighted_loads": [ + 3.0464557483792305, + 2.5036383289843798, + 0.9288888536393642, + 2.103914299979806, + 1.6685833968222141, + 2.765280809253454, + 0.36789342761039734, + 2.090004814788699, + 1.6943607032299042, + 2.7870264649391174, + 0.3532927446067333, + 1.5881724450737238, + 0.9521120861172676, + 0.7950714603066444, + 0.9108748603612185, + 2.337597858160734, + 2.9214003328233957, + 2.070503143593669, + 2.0759986452758312, + 1.63816755451262, + 3.117333859205246, + 1.2408819887787104, + 3.102925430983305, + 1.1769458819180727, + 2.375786330550909, + 1.891212223097682, + 2.626092281192541, + 2.575559627264738, + 1.4645877238363028, + 0.4009883850812912, + 0.8583779260516167, + 1.5612753257155418, + 2.008756073191762, + 1.1685921531170607, + 2.423614466562867, + 3.1419425327330828, + 1.6180862225592136, + 1.6210583988577127, + 0.4653595145791769, + 1.7969142105430365, + 0.4146519284695387, + 1.9994043316692114, + 1.665422985330224, + 2.282115623354912, + 4.191933142021298, + 2.622531520202756, + 2.489941868931055, + 1.2377638835459948, + 2.9406020157039165, + 0.9208266660571098, + 2.1510993875563145, + 0.6993430349975824, + 2.007752303034067, + 2.669246584177017, + 0.8837604001164436, + 1.6495156772434711, + 3.1458546463400126, + 1.9892953615635633, + 0.7794631812721491, + 2.1514596808701754, + 3.3727150363847613, + 2.8160278853029013, + 0.8815829418599606, + 1.4116131942719221 + ], + "unique_experts": 64, + "load_cv": 0.34083240577430557, + "normalized_load_entropy": 0.9850090602372401, + "max_load_share": 0.028588807785888078 + } + }, + "s1_period": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "1b833ce914393e8f975311caa7a0f9a7984641a44a9cdc347ce504ffac2bb3a7", + "route_weight_sha256": "785a333568a27f3e0725ad750f7cc6aa70f6cf56197630f2c3bd499ed1fd6875", + "loads": [ + 31, + 23, + 16, + 24, + 22, + 34, + 8, + 23, + 21, + 39, + 10, + 19, + 19, + 19, + 13, + 35, + 46, + 27, + 28, + 17, + 30, + 14, + 22, + 27, + 31, + 24, + 30, + 31, + 32, + 9, + 16, + 29, + 24, + 22, + 27, + 27, + 19, + 15, + 6, + 22, + 11, + 27, + 11, + 32, + 36, + 37, + 31, + 23, + 32, + 20, + 25, + 4, + 32, + 39, + 19, + 27, + 40, + 16, + 8, + 24, + 24, + 29, + 5, + 11 + ], + "weighted_loads": [ + 2.782922238111496, + 1.5814684182405472, + 0.8945782966911793, + 1.2357102893292904, + 1.642482839524746, + 2.762193499132991, + 0.3302817642688751, + 1.938388578593731, + 1.4352605268359184, + 2.829733543097973, + 0.4114450719207525, + 1.606440955772996, + 1.0533012431114912, + 0.6809310857206583, + 0.5512362197041512, + 2.3917158264666796, + 2.8937200009822845, + 2.0444924626499414, + 2.050086908042431, + 0.8086938261985779, + 2.929739072918892, + 0.4535768963396549, + 3.2045773323625326, + 1.180290063843131, + 2.2697119414806366, + 1.9298699144273996, + 2.6444189306348562, + 2.35375739261508, + 1.1545026917010546, + 0.40091606602072716, + 0.8336486779153347, + 1.5893722455948591, + 1.9598111119121313, + 1.1413291692733765, + 2.2176165990531445, + 1.2705110758543015, + 1.5343497022986412, + 1.5674032308161259, + 0.26807679422199726, + 1.7098683156073093, + 0.4898524936288595, + 2.1206073705106974, + 0.8940107207745314, + 2.3387349359691143, + 4.155801963061094, + 2.6057789511978626, + 2.372757475823164, + 1.0107104182243347, + 2.952085752040148, + 0.8726457729935646, + 2.1690991166979074, + 0.11229969188570976, + 1.9301804453134537, + 2.634429359808564, + 1.020897015929222, + 1.8577933181077242, + 3.150042226538062, + 1.4905154909938574, + 0.39806571416556835, + 2.0982931163161993, + 2.4865895975381136, + 2.516066810116172, + 0.31488728523254395, + 0.7853103242814541 + ], + "unique_experts": 64, + "load_cv": 0.39994076717895743, + "normalized_load_entropy": 0.9788697265426319, + "max_load_share": 0.030789825970548863 + }, + "full_input": { + "tokens": 290, + "top_k": 6, + "decisions": 1740, + "ordered_route_sha256": "ad0f4a10def78726e8fdcb4ed3b511dbaf7145e69c4a6fca1b079e6179165807", + "route_weight_sha256": "580ef2a97742623ce45be252dee4acc40a3089bcaabcd57e19378514c166d2a6", + "loads": [ + 36, + 34, + 17, + 27, + 23, + 35, + 8, + 27, + 31, + 40, + 17, + 19, + 20, + 21, + 22, + 37, + 49, + 27, + 28, + 23, + 32, + 25, + 23, + 27, + 36, + 25, + 30, + 34, + 36, + 9, + 17, + 31, + 24, + 23, + 36, + 44, + 19, + 16, + 13, + 25, + 11, + 27, + 21, + 33, + 39, + 37, + 40, + 31, + 35, + 21, + 26, + 11, + 33, + 42, + 19, + 27, + 44, + 22, + 10, + 34, + 37, + 36, + 15, + 23 + ], + "weighted_loads": [ + 3.571952436119318, + 2.5933230109512806, + 0.9200018122792244, + 2.027351997792721, + 1.6729580201208591, + 2.90263001434505, + 0.3302817642688751, + 2.173540934920311, + 2.2747203074395657, + 2.9472293332219124, + 0.7168954182416201, + 1.606440955772996, + 1.0878875013440847, + 0.7295371778309345, + 0.9954303875565529, + 2.4586539808660746, + 2.990684801712632, + 2.0444924626499414, + 2.050086908042431, + 1.5755975618958473, + 3.1636123582720757, + 1.380734072998166, + 3.2434293795377016, + 1.180290063843131, + 2.507494132965803, + 1.9799723271280527, + 2.6444189306348562, + 3.024849247187376, + 1.3925561774522066, + 0.40091606602072716, + 0.8671743683516979, + 1.632173864170909, + 1.9598111119121313, + 1.1815099753439426, + 2.5853652134537697, + 3.0076863691210747, + 1.5343497022986412, + 1.6088615246117115, + 0.5143761914223433, + 2.0653737112879753, + 0.4898524936288595, + 2.1206073705106974, + 2.1033623199909925, + 2.5217143557965755, + 4.801085170358419, + 2.6057789511978626, + 3.0518192406743765, + 1.4177656173706055, + 3.0450764261186123, + 0.9160042591392994, + 2.195237047970295, + 0.9412883557379246, + 2.107381582260132, + 2.8181693330407143, + 1.020897015929222, + 1.8577933181077242, + 3.4050215389579535, + 1.7427794337272644, + 0.5086492281407118, + 2.536018792539835, + 3.2600766913965344, + 3.0376005228608847, + 1.1638400927186012, + 1.7922574281692505 + ], + "unique_experts": 64, + "load_cv": 0.34558537424462205, + "normalized_load_entropy": 0.98478021263834, + "max_load_share": 0.028160919540229885 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 249, + "ordered_topk_exact_tokens": 201, + "set_exact_tokens": 217, + "mean_set_jaccard": 0.9632816982214574, + "mean_token_weighted_tv": 0.007367215497067654, + "aggregate_load_tv": 0.01472556894243642 + }, + "system_bos": { + "tokens": 249, + "ordered_topk_exact_tokens": 169, + "set_exact_tokens": 193, + "mean_set_jaccard": 0.9331612162937463, + "mean_token_weighted_tv": 0.01401733519157851, + "aggregate_load_tv": 0.024765729585006686 + }, + "system_x": { + "tokens": 249, + "ordered_topk_exact_tokens": 165, + "set_exact_tokens": 195, + "mean_set_jaccard": 0.9363166953528399, + "mean_token_weighted_tv": 0.01463479636962634, + "aggregate_load_tv": 0.02409638554216867 + }, + "system_period": { + "tokens": 249, + "ordered_topk_exact_tokens": 164, + "set_exact_tokens": 195, + "mean_set_jaccard": 0.9371772805507744, + "mean_token_weighted_tv": 0.014477433438551235, + "aggregate_load_tv": 0.027443105756358763 + }, + "bos_at_s0": { + "tokens": 249, + "ordered_topk_exact_tokens": 126, + "set_exact_tokens": 159, + "mean_set_jaccard": 0.8941480206540446, + "mean_token_weighted_tv": 0.022506162812222678, + "aggregate_load_tv": 0.03614457831325301 + }, + "bos_at_s1": { + "tokens": 249, + "ordered_topk_exact_tokens": 125, + "set_exact_tokens": 159, + "mean_set_jaccard": 0.8941480206540446, + "mean_token_weighted_tv": 0.023369907270593338, + "aggregate_load_tv": 0.03614457831325302 + }, + "x_at_s0": { + "tokens": 249, + "ordered_topk_exact_tokens": 131, + "set_exact_tokens": 170, + "mean_set_jaccard": 0.9076305220883534, + "mean_token_weighted_tv": 0.01988989188070278, + "aggregate_load_tv": 0.03480589022757698 + }, + "x_at_s1": { + "tokens": 249, + "ordered_topk_exact_tokens": 131, + "set_exact_tokens": 164, + "mean_set_jaccard": 0.9007458405048766, + "mean_token_weighted_tv": 0.02204152483897037, + "aggregate_load_tv": 0.03346720214190094 + }, + "period_at_s0": { + "tokens": 249, + "ordered_topk_exact_tokens": 136, + "set_exact_tokens": 170, + "mean_set_jaccard": 0.9076305220883533, + "mean_token_weighted_tv": 0.019940840293574763, + "aggregate_load_tv": 0.034136546184738964 + }, + "period_at_s1": { + "tokens": 249, + "ordered_topk_exact_tokens": 135, + "set_exact_tokens": 167, + "mean_set_jaccard": 0.9041881812966149, + "mean_token_weighted_tv": 0.02181782864453084, + "aggregate_load_tv": 0.0321285140562249 + } + } + }, + "layer_03": { + "layer": 3, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "726440a2801c64370a09dd55d3ba995447342cfe6918ee7c198fbc4f2ddfb395", + "route_weight_sha256": "2db80dbf0d8676bef80625e56f9c2d1612f57811819684a85607c8eb126d9218", + "loads": [ + 3, + 19, + 29, + 20, + 22, + 20, + 29, + 10, + 28, + 8, + 17, + 27, + 18, + 6, + 13, + 9, + 47, + 19, + 18, + 39, + 20, + 23, + 19, + 13, + 22, + 20, + 22, + 10, + 20, + 19, + 34, + 36, + 51, + 30, + 19, + 20, + 12, + 6, + 38, + 42, + 30, + 33, + 10, + 24, + 46, + 19, + 19, + 42, + 1, + 14, + 36, + 31, + 35, + 36, + 25, + 31, + 34, + 21, + 22, + 27, + 11, + 33, + 13, + 24 + ], + "weighted_loads": [ + 0.07933868654072285, + 0.8798044044524431, + 1.9192881919443607, + 0.9153554495424032, + 1.220545258373022, + 1.0755645968019962, + 1.8255931958556175, + 0.5461058653891087, + 1.6657891888171434, + 0.45541810989379883, + 0.6070265043526888, + 1.3539393227547407, + 1.3400081936269999, + 0.30300767347216606, + 1.3405588045716286, + 0.3400776367634535, + 3.7405902706086636, + 0.6591650974005461, + 0.7388367839157581, + 2.8751145843416452, + 1.2293875347822905, + 1.6440092474222183, + 1.3887771479785442, + 0.45072693563997746, + 1.7499354910105467, + 0.9441052842885256, + 1.108365384861827, + 0.4813670292496681, + 1.3925934955477715, + 1.132415033876896, + 3.0485891103744507, + 1.6487910859286785, + 3.8379920925945044, + 1.7714150175452232, + 0.6365084126591682, + 1.2900701947510242, + 0.5355209335684776, + 0.5012889783829451, + 6.247251346707344, + 3.307012677192688, + 1.7871904112398624, + 1.4121925495564938, + 0.4285659082233906, + 2.19785712659359, + 4.011645060032606, + 1.9845962896943092, + 0.7809923570603132, + 3.4083509631454945, + 0.034907419234514236, + 0.9780227169394493, + 1.7897223718464375, + 3.289038360118866, + 3.158959750086069, + 2.9570170380175114, + 3.1030857656151056, + 2.6595602706074715, + 3.6766106598079205, + 0.8147410172969103, + 1.2481222674250603, + 1.8288747407495975, + 0.4281091056764126, + 3.2547035701572895, + 0.7082131579518318, + 1.7677309904247522 + ], + "unique_experts": 64, + "load_cv": 0.4739617557925094, + "normalized_load_entropy": 0.97110846629859, + "max_load_share": 0.03413654618473896 + }, + "full_input": { + "tokens": 274, + "top_k": 6, + "decisions": 1644, + "ordered_route_sha256": "ff24f9009fa389246cffac1b1ae3928328a9a2acd5c8a5ab15f974288445b8c6", + "route_weight_sha256": "901d3260fedc7c7962a2aa44f440d20179c6866785afc6a2919879358d553352", + "loads": [ + 12, + 19, + 29, + 30, + 25, + 21, + 30, + 18, + 28, + 13, + 19, + 28, + 20, + 10, + 20, + 9, + 47, + 19, + 18, + 39, + 22, + 26, + 23, + 15, + 22, + 22, + 22, + 16, + 20, + 22, + 35, + 36, + 51, + 30, + 28, + 20, + 12, + 6, + 38, + 42, + 30, + 34, + 20, + 24, + 47, + 21, + 31, + 42, + 8, + 24, + 37, + 31, + 36, + 36, + 29, + 33, + 34, + 22, + 23, + 27, + 19, + 33, + 16, + 25 + ], + "weighted_loads": [ + 1.3691169377416372, + 0.8798044044524431, + 1.9192881919443607, + 1.506349889561534, + 1.3043352760141715, + 1.123106274753809, + 1.8711361028254032, + 1.86428377404809, + 1.6657891888171434, + 0.7084409763920121, + 0.6795234587043524, + 1.3548208249849267, + 1.3520596238959115, + 0.6498199813067913, + 1.8721975721418858, + 0.3400776367634535, + 3.7405902706086636, + 0.6591650974005461, + 0.7388367839157581, + 2.8751145843416452, + 1.3023251220583916, + 1.8669839464128017, + 1.7032828368246555, + 0.5169808361679316, + 1.7499354910105467, + 0.9578222324489616, + 1.108365384861827, + 0.7048702333122492, + 1.3925934955477715, + 1.2775676436722279, + 3.0952529050409794, + 1.6487910859286785, + 3.8379920925945044, + 1.7714150175452232, + 1.6661383174359798, + 1.2900701947510242, + 0.5355209335684776, + 0.5012889783829451, + 6.247251346707344, + 3.307012677192688, + 1.7871904112398624, + 1.4236059105023742, + 1.009105484932661, + 2.19785712659359, + 4.058696433901787, + 2.130376100540161, + 2.380694827064872, + 3.4083509631454945, + 0.7661158740520477, + 1.5908499471843243, + 1.8219031020998955, + 3.289038360118866, + 3.173738945275545, + 2.9570170380175114, + 4.93350619263947, + 2.817193567752838, + 3.6766106598079205, + 0.8275777688249946, + 1.3341848775744438, + 1.8288747407495975, + 0.9917678497731686, + 3.2547035701572895, + 1.0330735445022583, + 1.8064077217131853 + ], + "unique_experts": 64, + "load_cv": 0.37780333706883307, + "normalized_load_entropy": 0.982421930180737, + "max_load_share": 0.03102189781021898 + } + }, + "s1_eos": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "0286d40ed91b617e139a18f167881b047c40f39a61d0a20defd547f810865ee4", + "route_weight_sha256": "78e1e06f53bcf187467de2b75bd89395b30d09fc579e90e22189bdd36c8906c4", + "loads": [ + 3, + 18, + 29, + 19, + 22, + 21, + 28, + 10, + 30, + 8, + 16, + 27, + 19, + 6, + 13, + 10, + 48, + 19, + 19, + 38, + 20, + 22, + 20, + 13, + 21, + 20, + 22, + 10, + 21, + 19, + 33, + 38, + 51, + 30, + 19, + 20, + 11, + 6, + 38, + 42, + 31, + 35, + 11, + 24, + 45, + 20, + 17, + 42, + 1, + 13, + 35, + 31, + 35, + 36, + 24, + 31, + 34, + 21, + 24, + 27, + 9, + 33, + 12, + 24 + ], + "weighted_loads": [ + 0.07721746899187565, + 0.8562412206083536, + 1.9345944747328758, + 0.8704502694308758, + 1.2210193369537592, + 1.109025551006198, + 1.7970786523073912, + 0.5507619231939316, + 1.7425382491201162, + 0.45286149717867374, + 0.5917013939470053, + 1.3488036431372166, + 1.3687473647296429, + 0.30076014064252377, + 1.3332377783954144, + 0.38074873574078083, + 3.797130063176155, + 0.6442764401435852, + 0.7669707834720612, + 2.84163380227983, + 1.2261209189891815, + 1.6048614159226418, + 1.4461002387106419, + 0.45112892985343933, + 1.7213880270719528, + 0.9434347916394472, + 1.1154116485267878, + 0.48256548680365086, + 1.430761445313692, + 1.1086554657667875, + 3.0179534777998924, + 1.7124985083937645, + 3.861589018255472, + 1.7663814183324575, + 0.6283350735902786, + 1.2925532925873995, + 0.5094865132123232, + 0.5043713040649891, + 6.277692638337612, + 3.3154901899397373, + 1.8142379559576511, + 1.471428269520402, + 0.46229696832597256, + 2.182416521012783, + 3.9835093803703785, + 2.0418401062488556, + 0.7217780034989119, + 3.4418043456971645, + 0.0347219742834568, + 0.951133631169796, + 1.7661118358373642, + 3.288113484159112, + 3.1307085566222668, + 2.9655390419065952, + 3.082367643713951, + 2.658672943711281, + 3.687426468357444, + 0.807896813377738, + 1.2768774144351482, + 1.8343262374401093, + 0.3728805296123028, + 3.2691336944699287, + 0.6335368864238262, + 1.7862807754427195 + ], + "unique_experts": 64, + "load_cv": 0.4777578789596587, + "normalized_load_entropy": 0.9706170232336422, + "max_load_share": 0.03413654618473896 + }, + "full_input": { + "tokens": 290, + "top_k": 6, + "decisions": 1740, + "ordered_route_sha256": "70d589010ecae1baf4c84b6a42072c9234f6d01e89bcde8e7ee5f6946bc13849", + "route_weight_sha256": "a181b000300543a5b0cd2cb9d21cb7f60c982e08cae3aeb281e0e3d29795b123", + "loads": [ + 16, + 20, + 29, + 30, + 24, + 24, + 28, + 21, + 30, + 16, + 20, + 28, + 23, + 11, + 22, + 11, + 50, + 19, + 20, + 38, + 22, + 28, + 29, + 14, + 23, + 23, + 22, + 13, + 21, + 22, + 34, + 38, + 51, + 32, + 27, + 20, + 11, + 11, + 38, + 43, + 32, + 36, + 27, + 26, + 46, + 25, + 33, + 42, + 10, + 23, + 36, + 37, + 39, + 41, + 29, + 37, + 34, + 22, + 32, + 28, + 22, + 34, + 17, + 30 + ], + "weighted_loads": [ + 1.7575158160179853, + 0.9302146043628454, + 1.9345944747328758, + 1.5289845392107964, + 1.2754709221189842, + 1.2574005778878927, + 1.7970786523073912, + 1.9562917053699493, + 1.7425382491201162, + 0.8914763184147887, + 0.7050569746643305, + 1.3496851453674026, + 1.4580720613885205, + 0.7112695332616568, + 2.0324615836143494, + 0.42964288406074047, + 4.010150998830795, + 0.6442764401435852, + 0.8228837698698044, + 2.84163380227983, + 1.2924535796046257, + 1.9148466140031815, + 2.2598003521561623, + 0.48869603499770164, + 1.8244392462074757, + 1.0008924733265303, + 1.1154116485267878, + 0.5785967130213976, + 1.430761445313692, + 1.2471750359982252, + 3.0594880767166615, + 1.7124985083937645, + 3.861589018255472, + 1.83962675742805, + 1.5502639263868332, + 1.2925532925873995, + 0.5094865132123232, + 0.9213237017393112, + 6.277692638337612, + 3.3659388944506645, + 1.8898321352899075, + 1.4802741715684533, + 1.213721226900816, + 2.2566133700311184, + 4.031485706567764, + 2.4375704005360603, + 2.90393596701324, + 3.4418043456971645, + 1.0778037048876286, + 1.4158485978841782, + 1.797776434570551, + 4.065305160358548, + 3.3424011850729585, + 3.6801997907459736, + 5.024704352021217, + 3.049789372831583, + 3.687426468357444, + 0.8169618956744671, + 1.8427389226853848, + 1.8647642116993666, + 1.1943775787949562, + 3.3193458393216133, + 1.0459823086857796, + 2.1956748757511377 + ], + "unique_experts": 64, + "load_cv": 0.3531486441382044, + "normalized_load_entropy": 0.9847128509718014, + "max_load_share": 0.029310344827586206 + } + }, + "s0_bos": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "4e510c36137b161a4e2d30fe90009755c475bd5041b45bbbd4614d6f23283efd", + "route_weight_sha256": "edce0592fbf475f6264dff9858d3af99af6171611f067639f7bd7ca852b93f50", + "loads": [ + 3, + 18, + 31, + 18, + 24, + 21, + 30, + 10, + 31, + 6, + 16, + 28, + 18, + 7, + 14, + 8, + 48, + 17, + 15, + 37, + 21, + 24, + 20, + 18, + 21, + 19, + 22, + 8, + 22, + 20, + 33, + 38, + 52, + 30, + 16, + 18, + 11, + 7, + 39, + 44, + 29, + 34, + 13, + 24, + 49, + 21, + 21, + 41, + 1, + 11, + 33, + 30, + 35, + 34, + 25, + 31, + 35, + 20, + 21, + 27, + 7, + 33, + 11, + 25 + ], + "weighted_loads": [ + 0.077353710308671, + 0.8365657832473516, + 2.011161223053932, + 0.865859717130661, + 1.3169562555849552, + 1.0254504326730967, + 1.877641348168254, + 0.5380999557673931, + 1.7408527713268995, + 0.3948464412242174, + 0.5939443837851286, + 1.4679701086133718, + 1.32114770822227, + 0.34601504914462566, + 1.3542905785143375, + 0.31287375651299953, + 3.764836721122265, + 0.5759822279214859, + 0.6272193025797606, + 2.7945716455578804, + 1.308593686670065, + 1.6977712884545326, + 1.4247401356697083, + 0.5959007851779461, + 1.7091534342616796, + 0.9245740920305252, + 1.086639991030097, + 0.42173703759908676, + 1.4942085668444633, + 1.1557736806571484, + 3.0058509204536676, + 1.7440625708550215, + 3.9562035240232944, + 1.76484333910048, + 0.5283787287771702, + 1.1811640914529562, + 0.5146965235471725, + 0.5591865330934525, + 6.276855267584324, + 3.3259423095732927, + 1.7733063120394945, + 1.4285415578633547, + 0.5245317053049803, + 2.2438434176146984, + 4.125480318441987, + 2.180645551532507, + 0.8429041691124439, + 3.3933482617139816, + 0.02286941185593605, + 0.8937698341906071, + 1.6657811403274536, + 3.2785517796874046, + 3.170328728854656, + 2.8223486822098494, + 3.08004579693079, + 2.7076234482228756, + 3.7009864822030067, + 0.767474640160799, + 1.2045553140342236, + 1.8767701480537653, + 0.2851186916232109, + 3.271447215229273, + 0.6568285562098026, + 1.8439992368221283 + ], + "unique_experts": 64, + "load_cv": 0.4907255120018467, + "normalized_load_entropy": 0.9690296090615043, + "max_load_share": 0.03480589022757698 + }, + "full_input": { + "tokens": 274, + "top_k": 6, + "decisions": 1644, + "ordered_route_sha256": "dfc1a8aacf9a9a0572ee15586a9133de7412276930011be81ea03f42dd78bba3", + "route_weight_sha256": "f16e7fc5e7cc3c9ab2a92d1550fa7503c13b3a0ecf7ec2213f90a772ffaca202", + "loads": [ + 13, + 18, + 31, + 28, + 27, + 23, + 31, + 18, + 31, + 11, + 19, + 29, + 19, + 11, + 21, + 8, + 48, + 17, + 16, + 37, + 23, + 27, + 24, + 20, + 21, + 20, + 22, + 14, + 22, + 24, + 34, + 38, + 52, + 30, + 24, + 18, + 11, + 7, + 39, + 44, + 29, + 34, + 25, + 24, + 49, + 23, + 33, + 41, + 9, + 21, + 34, + 30, + 35, + 34, + 28, + 33, + 35, + 20, + 22, + 27, + 15, + 33, + 14, + 26 + ], + "weighted_loads": [ + 1.4983416926115751, + 0.8365657832473516, + 2.011161223053932, + 1.4568541571497917, + 1.4048059418564662, + 1.1212099324911833, + 1.9340247195214033, + 1.803436804562807, + 1.7408527713268995, + 0.6613530592876486, + 0.6989775504916906, + 1.4688516108435579, + 1.321626876218943, + 0.7051367666572332, + 1.9145788326859474, + 0.31287375651299953, + 3.764836721122265, + 0.5759822279214859, + 0.6639801282435656, + 2.7945716455578804, + 1.3804334048181772, + 1.9415889121592045, + 1.7345169708132744, + 0.6615235470235348, + 1.7091534342616796, + 0.9251058846130036, + 1.086639991030097, + 0.6452402416616678, + 1.4942085668444633, + 1.3408168219029903, + 3.0525147151201963, + 1.7440625708550215, + 3.9562035240232944, + 1.76484333910048, + 1.5213495790958405, + 1.1811640914529562, + 0.5146965235471725, + 0.5591865330934525, + 6.276855267584324, + 3.3259423095732927, + 1.7733063120394945, + 1.4285415578633547, + 1.281972648575902, + 2.2438434176146984, + 4.125480318441987, + 2.3307806476950645, + 2.4426066391170025, + 3.3933482617139816, + 0.842499066144228, + 1.506597064435482, + 1.6971722021698952, + 3.2785517796874046, + 3.170328728854656, + 2.8223486822098494, + 4.211328759789467, + 2.878241267055273, + 3.7009864822030067, + 0.767474640160799, + 1.2775416038930416, + 1.8767701480537653, + 0.817004133015871, + 3.271447215229273, + 0.9816889427602291, + 1.8826759681105614 + ], + "unique_experts": 64, + "load_cv": 0.3874576499171703, + "normalized_load_entropy": 0.9816246427751786, + "max_load_share": 0.031630170316301706 + } + }, + "s1_bos": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "b91d2b2c0a0b92379e37fa0ce70bd3d41ea58dff032c54838c03c786f2070d1b", + "route_weight_sha256": "7da00a570f70c818609d213293febcabf3e9240a8c27317f87be97c21da9e5dc", + "loads": [ + 1, + 19, + 29, + 17, + 23, + 20, + 30, + 10, + 32, + 6, + 22, + 29, + 18, + 5, + 14, + 9, + 48, + 15, + 15, + 38, + 21, + 24, + 19, + 19, + 23, + 22, + 24, + 8, + 21, + 19, + 34, + 44, + 52, + 30, + 16, + 17, + 12, + 5, + 38, + 44, + 28, + 36, + 10, + 23, + 48, + 21, + 19, + 42, + 0, + 10, + 34, + 30, + 35, + 34, + 25, + 31, + 34, + 19, + 20, + 28, + 6, + 33, + 10, + 26 + ], + "weighted_loads": [ + 0.024617044255137444, + 0.8767377734184265, + 1.9888999704271555, + 0.8288543727248907, + 1.2695746161043644, + 0.9635038375854492, + 1.8665334153920412, + 0.5428188405930996, + 1.8307805191725492, + 0.3919317778199911, + 0.7813468184322119, + 1.5081933997571468, + 1.3082255441695452, + 0.27446606010198593, + 1.3675166927278042, + 0.34811050817370415, + 3.768158258870244, + 0.5138377472758293, + 0.6304118875414133, + 2.8287824504077435, + 1.2952267602086067, + 1.6640477813780308, + 1.3793395832180977, + 0.6304439343512058, + 1.7563174106180668, + 1.035991808399558, + 1.1616162154823542, + 0.4301557429134846, + 1.4954738672822714, + 1.1016155108809471, + 3.0567625891417265, + 1.9250454306602478, + 4.000039195641875, + 1.7486282531172037, + 0.516364011913538, + 1.1551469694823027, + 0.5397603269666433, + 0.5110080502927303, + 6.243335071951151, + 3.3050738479942083, + 1.744028128683567, + 1.5085123237222433, + 0.43766688369214535, + 2.187202386558056, + 4.089750908315182, + 2.185882903635502, + 0.8056783098727465, + 3.438768580555916, + 0.0, + 0.8510881811380386, + 1.6825535520911217, + 3.3019731026142836, + 3.1256413739174604, + 2.7899821531027555, + 3.049373148009181, + 2.663029745221138, + 3.7201902642846107, + 0.7048466373234987, + 1.154111072421074, + 1.9359693974256516, + 0.27198104932904243, + 3.241220772266388, + 0.5502728596329689, + 1.9283520113676786 + ], + "unique_experts": 63, + "load_cv": 0.5091926748463361, + "normalized_load_entropy": 0.9654038438867526, + "max_load_share": 0.03480589022757698 + }, + "full_input": { + "tokens": 290, + "top_k": 6, + "decisions": 1740, + "ordered_route_sha256": "665131d7916aa7755040775e035f2ae4840a30db066af1a2c0ace42aa586435f", + "route_weight_sha256": "d04610c2a327df3f6b0914099c92d8e0618aad6ea685c97da9b87d41226b1d03", + "loads": [ + 14, + 21, + 29, + 28, + 26, + 24, + 31, + 21, + 32, + 14, + 26, + 30, + 21, + 10, + 23, + 10, + 50, + 15, + 17, + 38, + 23, + 30, + 29, + 20, + 25, + 24, + 24, + 11, + 21, + 22, + 35, + 44, + 52, + 32, + 24, + 17, + 12, + 10, + 38, + 45, + 29, + 36, + 27, + 25, + 48, + 26, + 36, + 42, + 11, + 20, + 34, + 36, + 38, + 39, + 29, + 37, + 34, + 19, + 28, + 29, + 18, + 34, + 15, + 32 + ], + "weighted_loads": [ + 1.7454499509185553, + 0.9507111571729183, + 1.9888999704271555, + 1.4873886425048113, + 1.35481825878378, + 1.161080040037632, + 1.9193077478557825, + 1.8746355585753918, + 1.8307805191725492, + 0.8440086247283034, + 0.8947023991495371, + 1.5090749019873329, + 1.3896124071616214, + 0.7032831385731697, + 2.0948158875107765, + 0.3970046564936638, + 3.9811791945248842, + 0.5138377472758293, + 0.722819747403264, + 2.8287824504077435, + 1.3659081608057022, + 1.9800036661326885, + 2.236077755689621, + 0.6672666780650616, + 1.8593686297535896, + 1.0846148635610007, + 1.1616162154823542, + 0.5261869691312313, + 1.4954738672822714, + 1.2393640540540218, + 3.0982971880584955, + 1.9250454306602478, + 4.000039195641875, + 1.8218735922127962, + 1.4464015550911427, + 1.1551469694823027, + 0.5397603269666433, + 0.9279604479670525, + 6.243335071951151, + 3.3555225525051355, + 1.8196223080158234, + 1.5085123237222433, + 1.3439842909574509, + 2.261399235576391, + 4.089750908315182, + 2.603212669491768, + 3.0253329817205667, + 3.438768580555916, + 1.149411141872406, + 1.3158031478524208, + 1.6825535520911217, + 4.07916477881372, + 3.3269277084618807, + 3.504642901942134, + 4.201767085120082, + 3.053278546780348, + 3.7201902642846107, + 0.7048466373234987, + 1.703578494489193, + 1.9664073716849089, + 0.9889841191470623, + 3.2914329171180725, + 0.9627182818949223, + 2.337746111676097 + ], + "unique_experts": 64, + "load_cv": 0.37192390085892957, + "normalized_load_entropy": 0.9829571810055983, + "max_load_share": 0.029885057471264367 + } + }, + "s0_x": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "d4cfca63897d860046d269c3b9f9258e6e7e6862b308141e2f88c20355409e54", + "route_weight_sha256": "2f1eb3fd2a68a610b7da45bfbd0e85dccf6b85bdc8c5a20827ebcc0577a97d5c", + "loads": [ + 5, + 21, + 29, + 18, + 23, + 19, + 30, + 10, + 31, + 6, + 20, + 28, + 18, + 6, + 14, + 9, + 48, + 18, + 15, + 36, + 21, + 23, + 20, + 21, + 21, + 20, + 22, + 7, + 22, + 19, + 33, + 41, + 52, + 30, + 14, + 18, + 13, + 7, + 38, + 44, + 28, + 36, + 10, + 24, + 48, + 21, + 16, + 41, + 1, + 11, + 33, + 30, + 36, + 35, + 25, + 31, + 36, + 18, + 22, + 27, + 6, + 33, + 11, + 25 + ], + "weighted_loads": [ + 0.12863727658987045, + 0.9517227970063686, + 1.928530003875494, + 0.842171810567379, + 1.2875114604830742, + 0.9350623320788145, + 1.8477832861244678, + 0.5234016552567482, + 1.7831927370280027, + 0.3882122430950403, + 0.7206515371799469, + 1.4402939733117819, + 1.3295566029846668, + 0.3136585485190153, + 1.349913079291582, + 0.33646060526371, + 3.8212419413030148, + 0.6104960292577744, + 0.6397740617394447, + 2.779849363490939, + 1.3198192939162254, + 1.656878612935543, + 1.4458473101258278, + 0.7008959427475929, + 1.7148148659616709, + 0.9647274930030107, + 1.0907386504113674, + 0.37976859509944916, + 1.4844468478113413, + 1.144267424941063, + 2.994006674736738, + 1.8147259037941694, + 3.9567221365869045, + 1.7973189614713192, + 0.46314591355621815, + 1.177697779610753, + 0.5591292306780815, + 0.5547784510999918, + 6.227776259183884, + 3.3285686913877726, + 1.7216135952621698, + 1.4950526468455791, + 0.42738660238683224, + 2.2365259639918804, + 4.091612819582224, + 2.1443642526865005, + 0.6750762220472097, + 3.405151903629303, + 0.03647535294294357, + 0.8789895847439766, + 1.6989977229386568, + 3.3074220828711987, + 3.267804805189371, + 2.8736624494194984, + 3.0983653999865055, + 2.68620528280735, + 3.740849182009697, + 0.6942382697016001, + 1.2473734635859728, + 1.850072817876935, + 0.24522010050714016, + 3.277564477175474, + 0.6564478576183319, + 1.8463097754865885 + ], + "unique_experts": 64, + "load_cv": 0.4935222101426007, + "normalized_load_entropy": 0.968797777052842, + "max_load_share": 0.03480589022757698 + }, + "full_input": { + "tokens": 274, + "top_k": 6, + "decisions": 1644, + "ordered_route_sha256": "02e2604376abf9c04a39265075208f18a10fbef8e759a635651a7af11d579c0b", + "route_weight_sha256": "7cb7fd94fc9e77f847b9b3259ad922dacb6230501b2e3175762c9c38d232957b", + "loads": [ + 13, + 21, + 29, + 29, + 27, + 20, + 31, + 19, + 31, + 11, + 22, + 29, + 19, + 10, + 21, + 9, + 48, + 18, + 15, + 36, + 22, + 26, + 25, + 23, + 21, + 21, + 23, + 14, + 22, + 23, + 34, + 41, + 52, + 30, + 23, + 18, + 14, + 7, + 38, + 44, + 28, + 36, + 21, + 24, + 49, + 23, + 28, + 41, + 8, + 22, + 33, + 30, + 36, + 35, + 28, + 33, + 36, + 18, + 23, + 27, + 13, + 33, + 14, + 26 + ], + "weighted_loads": [ + 1.2464176677167416, + 0.9517227970063686, + 1.928530003875494, + 1.5671047866344452, + 1.3971052918350324, + 0.9826040100306273, + 1.9117097668349743, + 1.8293840661644936, + 1.7831927370280027, + 0.6785445550340228, + 0.7931484915316105, + 1.441175475541968, + 1.3300357709813397, + 0.6715095844119787, + 1.8376808315515518, + 0.33646060526371, + 3.8212419413030148, + 0.6104960292577744, + 0.6397740617394447, + 2.779849363490939, + 1.346556717529893, + 1.9027291424572468, + 1.8054134510457516, + 0.7673745676875114, + 1.7148148659616709, + 0.9652592855854891, + 1.1330994218587875, + 0.6505632493644953, + 1.4844468478113413, + 1.3389181457459927, + 3.040670469403267, + 1.8147259037941694, + 3.9567221365869045, + 1.7973189614713192, + 1.556985815986991, + 1.177697779610753, + 0.6075050495564938, + 0.5547784510999918, + 6.227776259183884, + 3.3285686913877726, + 1.7216135952621698, + 1.4950526468455791, + 1.0847255606204271, + 2.2365259639918804, + 4.1456474885344505, + 2.3001501634716988, + 2.2747786920517683, + 3.405151903629303, + 0.7413814030587673, + 1.5550400130450726, + 1.6989977229386568, + 3.3074220828711987, + 3.267804805189371, + 2.8736624494194984, + 4.2072514072060585, + 2.861861974000931, + 3.740849182009697, + 0.6942382697016001, + 1.3348416704684496, + 1.850072817876935, + 0.7635355275124311, + 3.277564477175474, + 0.9813082441687584, + 1.8849865067750216 + ], + "unique_experts": 64, + "load_cv": 0.38733539942312595, + "normalized_load_entropy": 0.9816967425450911, + "max_load_share": 0.031630170316301706 + } + }, + "s1_x": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "a36bffc8aa3feee52ba6e494e1c1da6efdd1736e5edf9829b6241a899025814a", + "route_weight_sha256": "1e79badc5ac9c9b6cfd4d4e582b820f1c29b3df8794e8d5237b12b126ff760fb", + "loads": [ + 1, + 19, + 28, + 18, + 22, + 18, + 31, + 10, + 34, + 6, + 20, + 29, + 18, + 5, + 14, + 9, + 49, + 15, + 15, + 39, + 21, + 24, + 19, + 18, + 23, + 23, + 24, + 9, + 22, + 18, + 34, + 42, + 51, + 30, + 17, + 18, + 12, + 6, + 38, + 44, + 29, + 37, + 8, + 23, + 48, + 21, + 20, + 42, + 0, + 11, + 35, + 30, + 35, + 34, + 25, + 31, + 34, + 16, + 19, + 27, + 9, + 33, + 9, + 25 + ], + "weighted_loads": [ + 0.024635925889015198, + 0.8838600497692823, + 1.9310232140123844, + 0.8399106990545988, + 1.2434127982705832, + 0.8577868100255728, + 1.902250124141574, + 0.5400681421160698, + 1.9071517884731293, + 0.39489308558404446, + 0.7196781318634748, + 1.492468049749732, + 1.318840490654111, + 0.28338309191167355, + 1.3676909618079662, + 0.34996678307652473, + 3.867466604337096, + 0.5040318910032511, + 0.6373559255152941, + 2.8681593481451273, + 1.315912637859583, + 1.660088449716568, + 1.3963163942098618, + 0.5999346692115068, + 1.7602202873677015, + 1.0622854251414537, + 1.1685966178774834, + 0.4590601399540901, + 1.5319925546646118, + 1.07245172560215, + 3.044344400987029, + 1.868939621374011, + 3.9646617472171783, + 1.7720997706055641, + 0.5480063203722239, + 1.1853048484772444, + 0.5294494722038507, + 0.5377053450793028, + 6.2351610735058784, + 3.3297749254852533, + 1.779132142663002, + 1.538874041289091, + 0.37405033595860004, + 2.1793270371854305, + 4.047544855624437, + 2.159964084625244, + 0.8344824109226465, + 3.4612050019204617, + 0.0, + 0.8723286706954241, + 1.7307578977197409, + 3.3110434096306562, + 3.170805176720023, + 2.7921080738306046, + 3.0602746829390526, + 2.6597775109112263, + 3.7410247549414635, + 0.5996915344148874, + 1.1212966162711382, + 1.8919194154441357, + 0.38852928951382637, + 3.253420937806368, + 0.5125239305198193, + 1.905400501564145 + ], + "unique_experts": 63, + "load_cv": 0.5084600991505848, + "normalized_load_entropy": 0.9657511193408863, + "max_load_share": 0.03413654618473896 + }, + "full_input": { + "tokens": 290, + "top_k": 6, + "decisions": 1740, + "ordered_route_sha256": "63481b59fb0dc1129758e9a559efad66f8f19ceff7fa9892913cae67602c2ac7", + "route_weight_sha256": "8f0727a339b0fe32bf06a2d47456f5e33759bfd8e0002d8ce0487112a4a816a0", + "loads": [ + 13, + 21, + 28, + 30, + 24, + 21, + 32, + 21, + 34, + 14, + 24, + 30, + 21, + 10, + 23, + 10, + 51, + 15, + 16, + 39, + 22, + 30, + 28, + 19, + 25, + 25, + 25, + 13, + 22, + 22, + 35, + 42, + 51, + 32, + 25, + 18, + 13, + 11, + 38, + 45, + 30, + 37, + 25, + 25, + 49, + 26, + 36, + 42, + 10, + 22, + 35, + 36, + 38, + 39, + 29, + 37, + 34, + 16, + 27, + 28, + 22, + 34, + 14, + 31 + ], + "weighted_loads": [ + 1.5034501031041145, + 0.9578334335237741, + 1.9310232140123844, + 1.6465362254530191, + 1.2749389711534604, + 1.0061618369072676, + 1.9562747199088335, + 1.8620014414191246, + 1.9071517884731293, + 0.8635387273388915, + 0.8330337125808001, + 1.493349551979918, + 1.4002273536461871, + 0.7083986159414053, + 2.0407735370099545, + 0.3988609313964844, + 4.080487539991736, + 0.5040318910032511, + 0.6932689119130373, + 2.8681593481451273, + 1.3481485843658447, + 1.9723057821393013, + 2.200945518910885, + 0.6378643345087767, + 1.8632715065032244, + 1.1109084803028964, + 1.2075203023850918, + 0.6001881249248981, + 1.5319925546646118, + 1.2554185427725315, + 3.085878999903798, + 1.868939621374011, + 3.9646617472171783, + 1.8453451097011566, + 1.5224822107702494, + 1.1853048484772444, + 0.5698004458099604, + 0.9546577427536249, + 6.2351610735058784, + 3.3802236299961805, + 1.8547263219952583, + 1.538874041289091, + 1.1878148317337036, + 2.253523886203766, + 4.095460589975119, + 2.5832413658499718, + 3.0166403744369745, + 3.4612050019204617, + 1.0415354073047638, + 1.3964569810777903, + 1.7307578977197409, + 4.088235085830092, + 3.3720915112644434, + 3.506768822669983, + 4.1931561678647995, + 3.0491088703274727, + 3.7410247549414635, + 0.5996915344148874, + 1.6746208164840937, + 1.922357389703393, + 1.2179215252399445, + 3.3036330826580524, + 0.9249693527817726, + 2.3147946018725634 + ], + "unique_experts": 64, + "load_cv": 0.3732854847316935, + "normalized_load_entropy": 0.9828902006379518, + "max_load_share": 0.029310344827586206 + } + }, + "s0_period": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "e1b3e14aa9bae7b83b49b2f284424408b253d678c049afc4aa562eaf71510a0b", + "route_weight_sha256": "19b56a2706b6afa37361010cd189568cf965abd5abd39777e3ad6f7e65ec0cc4", + "loads": [ + 5, + 21, + 30, + 18, + 24, + 20, + 29, + 10, + 31, + 6, + 19, + 29, + 18, + 9, + 14, + 9, + 49, + 17, + 15, + 36, + 21, + 25, + 20, + 19, + 21, + 20, + 22, + 8, + 21, + 19, + 33, + 41, + 52, + 30, + 15, + 18, + 12, + 6, + 38, + 45, + 28, + 35, + 10, + 24, + 48, + 20, + 17, + 41, + 0, + 11, + 33, + 30, + 35, + 35, + 25, + 31, + 34, + 18, + 22, + 27, + 6, + 33, + 11, + 25 + ], + "weighted_loads": [ + 0.12841511331498623, + 0.9593120701611042, + 1.9581276029348373, + 0.8446423504501581, + 1.3277295492589474, + 0.9650144148617983, + 1.8217408154159784, + 0.5199748799204826, + 1.777834752574563, + 0.3885001353919506, + 0.683645561337471, + 1.4776421878486872, + 1.3242108467966318, + 0.40179553255438805, + 1.3582250997424126, + 0.33703500777482986, + 3.8617825638502836, + 0.5753062106668949, + 0.6363896857947111, + 2.770024672150612, + 1.3162468206137419, + 1.721183005720377, + 1.4259475953876972, + 0.6281764209270477, + 1.7203681971877813, + 0.9609377533197403, + 1.0918494798243046, + 0.41394841857254505, + 1.4571428559720516, + 1.1434683091938496, + 2.9887174665927887, + 1.8165011182427406, + 3.9685868993401527, + 1.7974647469818592, + 0.49599246494472027, + 1.1670649703592062, + 0.5312297064810991, + 0.5263535305857658, + 6.217046044766903, + 3.3534650187939405, + 1.7279638443142176, + 1.4646462257951498, + 0.4253448601812124, + 2.2467254288494587, + 4.080766182392836, + 2.115645483136177, + 0.7066173944622278, + 3.407524336129427, + 0.0, + 0.885964460670948, + 1.6892049387097359, + 3.3079006616026163, + 3.2443889640271664, + 2.8575064446777105, + 3.092352345585823, + 2.6832049041986465, + 3.6817425936460495, + 0.691415335983038, + 1.2488254643976688, + 1.8560543116182089, + 0.24373804777860641, + 3.2755006924271584, + 0.6612862572073936, + 1.8457147553563118 + ], + "unique_experts": 63, + "load_cv": 0.49317349019611445, + "normalized_load_entropy": 0.9685614446741584, + "max_load_share": 0.03480589022757698 + }, + "full_input": { + "tokens": 274, + "top_k": 6, + "decisions": 1644, + "ordered_route_sha256": "d2387000948a0f752b3dda206154d7590e852eb36f8e4a3d0678e5645f43f331", + "route_weight_sha256": "7add5826e5c8d8e35bcf431735b7727dbbb0a1fd946a7545c6702b12bef66bae", + "loads": [ + 13, + 22, + 30, + 29, + 28, + 21, + 30, + 19, + 31, + 12, + 21, + 30, + 19, + 13, + 21, + 9, + 49, + 17, + 15, + 36, + 22, + 28, + 25, + 21, + 21, + 21, + 22, + 14, + 21, + 23, + 34, + 41, + 52, + 30, + 23, + 18, + 12, + 6, + 38, + 45, + 28, + 35, + 21, + 24, + 49, + 23, + 29, + 41, + 6, + 21, + 34, + 30, + 35, + 35, + 28, + 33, + 34, + 18, + 24, + 27, + 14, + 33, + 14, + 26 + ], + "weighted_loads": [ + 1.179914640262723, + 1.1054225154221058, + 1.9581276029348373, + 1.504812391474843, + 1.4477727882331237, + 1.012556092813611, + 1.896572271361947, + 1.8530902452766895, + 1.777834752574563, + 0.8366746140527539, + 0.7561425156891346, + 1.4785236900788732, + 1.3246900147933047, + 0.7596093900501728, + 1.9685518108308315, + 0.33703500777482986, + 3.8617825638502836, + 0.5753062106668949, + 0.6363896857947111, + 2.770024672150612, + 1.3429842442274094, + 1.9634346589446068, + 1.7897208333015442, + 0.6951537132263184, + 1.7203681971877813, + 0.9614695459022187, + 1.0918494798243046, + 0.6374516226351261, + 1.4571428559720516, + 1.3295743502676487, + 3.0353812612593174, + 1.8165011182427406, + 3.9685868993401527, + 1.7974647469818592, + 1.4889633152633905, + 1.1670649703592062, + 0.5312297064810991, + 0.5263535305857658, + 6.217046044766903, + 3.3534650187939405, + 1.7279638443142176, + 1.4646462257951498, + 1.0846074279397726, + 2.2467254288494587, + 4.140503812581301, + 2.32305671274662, + 2.3063198644667864, + 3.407524336129427, + 0.6718707196414471, + 1.498791690915823, + 1.7209473215043545, + 3.3079006616026163, + 3.2443889640271664, + 2.8575064446777105, + 4.19640551507473, + 2.856459118425846, + 3.6817425936460495, + 0.691415335983038, + 1.3693434186279774, + 1.8560543116182089, + 0.7744284644722939, + 3.2755006924271584, + 0.9861466437578201, + 1.8843914866447449 + ], + "unique_experts": 64, + "load_cv": 0.39062273377134604, + "normalized_load_entropy": 0.9812712755339402, + "max_load_share": 0.031630170316301706 + } + }, + "s1_period": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "43e0526b6c4567a61a4be6615cf1c68e83f8e69c16448ac7a834aed76f5f41a4", + "route_weight_sha256": "4824db755e568d76edb7ded5cdb46607f72b20533b761fe9135274d2372c0b7b", + "loads": [ + 1, + 17, + 28, + 18, + 22, + 19, + 30, + 10, + 33, + 6, + 20, + 29, + 18, + 5, + 15, + 9, + 49, + 14, + 16, + 39, + 21, + 24, + 19, + 18, + 23, + 23, + 24, + 9, + 21, + 18, + 34, + 42, + 51, + 30, + 16, + 18, + 11, + 5, + 38, + 44, + 30, + 37, + 8, + 23, + 49, + 21, + 20, + 42, + 0, + 11, + 35, + 30, + 35, + 34, + 25, + 31, + 35, + 16, + 20, + 27, + 9, + 33, + 10, + 26 + ], + "weighted_loads": [ + 0.024842046201229095, + 0.8137368690222502, + 1.9187371209263802, + 0.841023052111268, + 1.2457082867622375, + 0.8994099218398333, + 1.881371358409524, + 0.539018802344799, + 1.880743369460106, + 0.3972310796380043, + 0.7190976813435555, + 1.4915017075836658, + 1.3155949469655752, + 0.2831052169203758, + 1.3966593462973833, + 0.3507334813475609, + 3.878718689084053, + 0.4718939121812582, + 0.6645876672118902, + 2.8602599687874317, + 1.3132317382842302, + 1.6575922966003418, + 1.3779797777533531, + 0.5997681338340044, + 1.7587217167019844, + 1.06248714402318, + 1.1665853708982468, + 0.4583080932497978, + 1.5054341722279787, + 1.0759982280433178, + 3.042766520753503, + 1.87307770550251, + 3.957485845312476, + 1.7732354905456305, + 0.5207111835479736, + 1.1771860588341951, + 0.5128116365522146, + 0.5033631063997746, + 6.22472694888711, + 3.3185989018529654, + 1.799514526501298, + 1.5379986371845007, + 0.37537690065801144, + 2.1790051870048046, + 4.060235220938921, + 2.1530936621129513, + 0.8478087596595287, + 3.4625237360596657, + 0.0, + 0.879780912771821, + 1.7325485460460186, + 3.3101685754954815, + 3.1768885776400566, + 2.789329256862402, + 3.048793736845255, + 2.6584708839654922, + 3.7617162540555, + 0.5984560828655958, + 1.1493500657379627, + 1.8940740767866373, + 0.3942005783319473, + 3.2494730688631535, + 0.5458127185702324, + 1.9396702274680138 + ], + "unique_experts": 63, + "load_cv": 0.5110475738247648, + "normalized_load_entropy": 0.9653971401474514, + "max_load_share": 0.03413654618473896 + }, + "full_input": { + "tokens": 290, + "top_k": 6, + "decisions": 1740, + "ordered_route_sha256": "836b8a64c22bc1128f6e295cdb1b9612112ea92e326f51e2f54a7859801a40a2", + "route_weight_sha256": "f8e51748db4069fb5081f3e91b098992bb425127ead45b24e9aaee2017101a48", + "loads": [ + 12, + 20, + 28, + 30, + 24, + 22, + 31, + 22, + 33, + 15, + 24, + 30, + 21, + 10, + 24, + 10, + 51, + 14, + 17, + 39, + 22, + 30, + 29, + 19, + 25, + 25, + 24, + 12, + 21, + 22, + 35, + 42, + 51, + 32, + 23, + 18, + 11, + 10, + 38, + 45, + 31, + 37, + 26, + 25, + 50, + 27, + 36, + 42, + 9, + 21, + 35, + 36, + 38, + 39, + 29, + 37, + 35, + 16, + 29, + 28, + 22, + 34, + 15, + 32 + ], + "weighted_loads": [ + 1.404809646308422, + 0.9962363783270121, + 1.9187371209263802, + 1.5581558961421251, + 1.282969944528304, + 1.047784948721528, + 1.9443087745457888, + 1.9329655915498734, + 1.880743369460106, + 0.9914369230973534, + 0.8324532620608807, + 1.4923832098138519, + 1.3969818099576514, + 0.7064900323748589, + 2.1546061541885138, + 0.3996276296675205, + 4.091739624738693, + 0.4718939121812582, + 0.7205006536096334, + 2.8602599687874317, + 1.345467684790492, + 1.968500331044197, + 2.2537479251623154, + 0.6372740883380175, + 1.8617729358375072, + 1.1111101991846226, + 1.1665853708982468, + 0.5543393194675446, + 1.5054341722279787, + 1.2524950504302979, + 3.084301119670272, + 1.87307770550251, + 3.957485845312476, + 1.846480829641223, + 1.40333591401577, + 1.1771860588341951, + 0.5128116365522146, + 0.9203155040740967, + 6.22472694888711, + 3.3690476063638926, + 1.8751087058335543, + 1.5379986371845007, + 1.2782770097255707, + 2.25320203602314, + 4.114789851009846, + 2.6383982971310616, + 3.0299667231738567, + 3.4625237360596657, + 0.999137781560421, + 1.3444958794862032, + 1.7325485460460186, + 4.087360251694918, + 3.378174912184477, + 3.5039900057017803, + 4.172937888652086, + 3.0450336150825024, + 3.7617162540555, + 0.5984560828655958, + 1.7485169731080532, + 1.9245120510458946, + 1.179733980447054, + 3.299685213714838, + 0.9582581408321857, + 2.349064327776432 + ], + "unique_experts": 64, + "load_cv": 0.37946357058411967, + "normalized_load_entropy": 0.9821553146918061, + "max_load_share": 0.029310344827586206 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 249, + "ordered_topk_exact_tokens": 207, + "set_exact_tokens": 218, + "mean_set_jaccard": 0.9644291451520367, + "mean_token_weighted_tv": 0.007036710591859607, + "aggregate_load_tv": 0.012048192771084333 + }, + "system_bos": { + "tokens": 249, + "ordered_topk_exact_tokens": 180, + "set_exact_tokens": 196, + "mean_set_jaccard": 0.9374641422834192, + "mean_token_weighted_tv": 0.012747534401116362, + "aggregate_load_tv": 0.022088353413654616 + }, + "system_x": { + "tokens": 249, + "ordered_topk_exact_tokens": 168, + "set_exact_tokens": 190, + "mean_set_jaccard": 0.9305794606999427, + "mean_token_weighted_tv": 0.0144814107806448, + "aggregate_load_tv": 0.02409638554216867 + }, + "system_period": { + "tokens": 249, + "ordered_topk_exact_tokens": 173, + "set_exact_tokens": 193, + "mean_set_jaccard": 0.9331612162937463, + "mean_token_weighted_tv": 0.014222205201365861, + "aggregate_load_tv": 0.02476572958500669 + }, + "bos_at_s0": { + "tokens": 249, + "ordered_topk_exact_tokens": 144, + "set_exact_tokens": 169, + "mean_set_jaccard": 0.9039013195639701, + "mean_token_weighted_tv": 0.02042960102509064, + "aggregate_load_tv": 0.029451137884872823 + }, + "bos_at_s1": { + "tokens": 249, + "ordered_topk_exact_tokens": 130, + "set_exact_tokens": 154, + "mean_set_jaccard": 0.8866896156052783, + "mean_token_weighted_tv": 0.022916047190536696, + "aggregate_load_tv": 0.03480589022757698 + }, + "x_at_s0": { + "tokens": 249, + "ordered_topk_exact_tokens": 155, + "set_exact_tokens": 178, + "mean_set_jaccard": 0.9142283419391852, + "mean_token_weighted_tv": 0.018360439269059156, + "aggregate_load_tv": 0.0321285140562249 + }, + "x_at_s1": { + "tokens": 249, + "ordered_topk_exact_tokens": 132, + "set_exact_tokens": 158, + "mean_set_jaccard": 0.8912794033275959, + "mean_token_weighted_tv": 0.022361645093524313, + "aggregate_load_tv": 0.03480589022757697 + }, + "period_at_s0": { + "tokens": 249, + "ordered_topk_exact_tokens": 152, + "set_exact_tokens": 171, + "mean_set_jaccard": 0.9061962134251289, + "mean_token_weighted_tv": 0.019197458199348795, + "aggregate_load_tv": 0.030789825970548856 + }, + "period_at_s1": { + "tokens": 249, + "ordered_topk_exact_tokens": 133, + "set_exact_tokens": 159, + "mean_set_jaccard": 0.8924268502581755, + "mean_token_weighted_tv": 0.022112916504223663, + "aggregate_load_tv": 0.03413654618473895 + } + } + }, + "layer_04": { + "layer": 4, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "f5240bcf7fa83c74b7d21eafccd6859d51dedc3c1c3ad93e638211b233a3f1e1", + "route_weight_sha256": "13bd406b45cf38ccd676074b386887a4c108b31593722a243c6439f86cb46aef", + "loads": [ + 19, + 19, + 20, + 10, + 22, + 35, + 24, + 13, + 36, + 15, + 2, + 33, + 42, + 1, + 12, + 44, + 34, + 38, + 10, + 22, + 36, + 27, + 26, + 36, + 14, + 8, + 14, + 38, + 19, + 11, + 45, + 15, + 17, + 14, + 0, + 14, + 49, + 37, + 29, + 31, + 3, + 30, + 17, + 34, + 46, + 5, + 11, + 34, + 0, + 22, + 33, + 22, + 31, + 28, + 40, + 28, + 43, + 25, + 16, + 17, + 7, + 27, + 30, + 14 + ], + "weighted_loads": [ + 1.2398335002362728, + 0.9643155988305807, + 1.0982967521995306, + 0.8456833362579346, + 1.86350117623806, + 2.350246075540781, + 1.4144852012395859, + 0.6658533792942762, + 2.8891632482409477, + 0.9827528446912766, + 0.11064036190509796, + 1.8171462342143059, + 2.8461115583777428, + 0.030338400974869728, + 0.43596635572612286, + 4.481350757181644, + 3.6198749393224716, + 3.3349030911922455, + 0.7937007583677769, + 1.2346947584301233, + 2.35183129273355, + 1.2808766271919012, + 2.1624157987535, + 3.3735193200409412, + 0.9322670325636864, + 0.2888205721974373, + 0.851589422672987, + 2.749340107664466, + 0.9499851781874895, + 0.4101011548191309, + 3.505142230540514, + 0.7182641699910164, + 1.65617111697793, + 0.49052234552800655, + 0.0, + 0.543421670794487, + 3.178836740553379, + 2.1620273403823376, + 2.463652338832617, + 2.694878675043583, + 0.15680178999900818, + 1.7936019469052553, + 1.0031695440411568, + 2.2385931592434645, + 3.447614761069417, + 0.175108402967453, + 0.3692713677883148, + 2.96917986497283, + 0.0, + 0.9575734678655863, + 2.0998420380055904, + 1.0370144341140985, + 2.891391195356846, + 1.833538368344307, + 3.3217345625162125, + 2.421850088983774, + 3.1590938456356525, + 1.4226142391562462, + 0.9395955875515938, + 1.0830328445881605, + 0.2379100527614355, + 1.7325987946242094, + 1.8273085691034794, + 0.7014427911490202 + ], + "unique_experts": 62, + "load_cv": 0.5401784748619565, + "normalized_load_entropy": 0.9587206611418498, + "max_load_share": 0.03279785809906292 + }, + "full_input": { + "tokens": 274, + "top_k": 6, + "decisions": 1644, + "ordered_route_sha256": "2ac4954b7077a8a180884bbd29061da797afd591f33f88e2b5c2fbe88ba50e59", + "route_weight_sha256": "a483ed4d3565b3c4265f7ad86a8f347ec9e55b55fb7a1eabb8cc93041c24acdc", + "loads": [ + 19, + 22, + 22, + 14, + 23, + 35, + 25, + 13, + 36, + 15, + 12, + 35, + 42, + 14, + 14, + 47, + 34, + 38, + 15, + 22, + 36, + 29, + 28, + 36, + 14, + 14, + 19, + 39, + 19, + 27, + 46, + 17, + 17, + 16, + 11, + 14, + 49, + 39, + 31, + 31, + 6, + 32, + 25, + 34, + 46, + 6, + 22, + 34, + 1, + 24, + 35, + 22, + 31, + 28, + 40, + 28, + 43, + 25, + 16, + 32, + 11, + 27, + 33, + 14 + ], + "weighted_loads": [ + 1.2398335002362728, + 1.1128501165658236, + 1.2204861883074045, + 1.1750417697767261, + 1.9149624854326248, + 2.350246075540781, + 1.4726348966360092, + 0.6658533792942762, + 2.8891632482409477, + 0.9827528446912766, + 0.7688963413238525, + 1.8436772050336003, + 2.8461115583777428, + 0.9704971481114626, + 0.48262276872992516, + 4.675901133567095, + 3.6198749393224716, + 3.3349030911922455, + 1.1300488203123678, + 1.2346947584301233, + 2.35183129273355, + 2.347071995958686, + 2.2797739692032337, + 3.3735193200409412, + 0.9322670325636864, + 0.7136381268501282, + 1.3489463068544865, + 2.7573112919926643, + 0.9499851781874895, + 1.6759198586369166, + 3.5706198178231716, + 0.7491609686985612, + 1.65617111697793, + 0.5307811321690679, + 1.0364524288161192, + 0.543421670794487, + 3.178836740553379, + 2.2686193585395813, + 3.5541836582124233, + 2.694878675043583, + 0.2964806854724884, + 1.9204053450375795, + 1.3608835451304913, + 2.2385931592434645, + 3.447614761069417, + 0.2052046936005354, + 1.5176025331020355, + 2.96917986497283, + 0.03641882166266441, + 1.007956113666296, + 2.1822985485196114, + 1.0370144341140985, + 2.891391195356846, + 1.833538368344307, + 3.3217345625162125, + 2.421850088983774, + 3.1590938456356525, + 1.4226142391562462, + 0.9395955875515938, + 1.883091725409031, + 0.5968242443050258, + 1.7325987946242094, + 2.051172949373722, + 0.7014427911490202 + ], + "unique_experts": 64, + "load_cv": 0.43621579029015284, + "normalized_load_entropy": 0.9751635307492964, + "max_load_share": 0.029805352798053526 + } + }, + "s1_eos": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "5cec5298c6c1ce04dc6b516efe42d69e066d26f4d7c23a6b91e53b06b83e0a55", + "route_weight_sha256": "0c6d9b7c2c3710f70098883e202765a051984d1ca511618dddc58c9019d57feb", + "loads": [ + 19, + 17, + 17, + 10, + 21, + 35, + 24, + 12, + 36, + 14, + 2, + 35, + 43, + 1, + 14, + 44, + 34, + 39, + 10, + 22, + 37, + 27, + 26, + 36, + 15, + 10, + 14, + 38, + 19, + 11, + 45, + 15, + 17, + 13, + 0, + 13, + 49, + 37, + 30, + 30, + 3, + 29, + 17, + 34, + 44, + 6, + 12, + 34, + 0, + 22, + 32, + 22, + 31, + 28, + 40, + 28, + 44, + 24, + 16, + 16, + 7, + 27, + 31, + 16 + ], + "weighted_loads": [ + 1.245111770927906, + 0.8985792063176632, + 1.003042757511139, + 0.8300470858812332, + 1.8286451920866966, + 2.3475688975304365, + 1.415128806605935, + 0.6415533367544413, + 2.8918554335832596, + 0.9242777582257986, + 0.11231067404150963, + 1.8489260207861662, + 2.899903915822506, + 0.030393589287996292, + 0.5000049006193876, + 4.456508934497833, + 3.623144716024399, + 3.3796672001481056, + 0.8040955625474453, + 1.2293222676962614, + 2.3739362731575966, + 1.2824699766933918, + 2.111741781234741, + 3.401337567716837, + 0.9701224640011787, + 0.3412567861378193, + 0.8334764782339334, + 2.7710906229913235, + 0.9441141840070486, + 0.4073204565793276, + 3.471420593559742, + 0.7142824865877628, + 1.6550975274294615, + 0.4574773032218218, + 0.0, + 0.5078866295516491, + 3.1787680108100176, + 2.1683382876217365, + 2.5025554932653904, + 2.6464923955500126, + 0.1563943810760975, + 1.7507274579256773, + 0.986900744959712, + 2.237720811739564, + 3.374219002202153, + 0.20448354072868824, + 0.3912533186376095, + 2.969052605330944, + 0.0, + 0.9578245356678963, + 2.050595760345459, + 1.0391004774719477, + 2.8424471486359835, + 1.8307518474757671, + 3.3026806376874447, + 2.4218099154531956, + 3.1870491597801447, + 1.3885383903980255, + 0.9494775924831629, + 1.0712410770356655, + 0.2360973209142685, + 1.7287045177072287, + 1.8508783038705587, + 0.8087891582399607 + ], + "unique_experts": 62, + "load_cv": 0.5403907583271599, + "normalized_load_entropy": 0.9589658468500973, + "max_load_share": 0.03279785809906292 + }, + "full_input": { + "tokens": 290, + "top_k": 6, + "decisions": 1740, + "ordered_route_sha256": "b6b7083a037edf2066b7ae80bc27b8991be5c3031dd8202d69f250c0daef5770", + "route_weight_sha256": "1687ce63f1b3e7f9d91f4202b713fca7fac710834963a2830d2179b7e884d4e9", + "loads": [ + 19, + 19, + 20, + 19, + 22, + 35, + 27, + 12, + 36, + 22, + 11, + 37, + 44, + 15, + 17, + 48, + 36, + 41, + 18, + 24, + 38, + 30, + 32, + 37, + 15, + 20, + 22, + 39, + 19, + 31, + 46, + 17, + 17, + 15, + 16, + 13, + 49, + 40, + 34, + 33, + 6, + 34, + 26, + 34, + 46, + 8, + 22, + 38, + 1, + 25, + 34, + 22, + 35, + 32, + 46, + 28, + 49, + 26, + 16, + 32, + 14, + 29, + 35, + 17 + ], + "weighted_loads": [ + 1.245111770927906, + 1.0269804410636425, + 1.1723797656595707, + 1.6234389873279724, + 1.8888078518211842, + 2.3475688975304365, + 1.6283079627901316, + 0.6415533367544413, + 2.8918554335832596, + 1.9663850124925375, + 0.7003394011408091, + 1.8753736391663551, + 3.0076671168208122, + 1.031932394951582, + 0.5745766032487154, + 4.7284762896597385, + 3.9865083396434784, + 3.450219301506877, + 1.472490047919564, + 1.319421486929059, + 2.4231859147548676, + 2.3789994418621063, + 2.5495989099144936, + 3.4941105358302593, + 0.9701224640011787, + 1.0419832468032837, + 1.6163018066436052, + 2.7794053507968783, + 0.9441141840070486, + 1.6165751069784164, + 3.5362455770373344, + 0.7449033511802554, + 1.6550975274294615, + 0.49816114362329245, + 1.3934031097451225, + 0.5078866295516491, + 3.1787680108100176, + 2.3144950680434704, + 3.7891163267195225, + 2.8573281839489937, + 0.31612564995884895, + 1.9776832712232135, + 1.4146671798080206, + 2.237720811739564, + 3.4437326546758413, + 0.23469706214382313, + 1.5894265249371529, + 3.3083145022392273, + 0.02969897910952568, + 1.0450022649019957, + 2.142811618745327, + 1.0391004774719477, + 3.279420243576169, + 2.0139640644192696, + 3.8573612086474895, + 2.4218099154531956, + 3.6127111557871103, + 1.4616945795714855, + 0.9494775924831629, + 1.9545325450599194, + 1.0782085619866848, + 1.9239576812833548, + 2.1444040779024363, + 0.8528133239597082 + ], + "unique_experts": 64, + "load_cv": 0.4212294759036481, + "normalized_load_entropy": 0.9767846682320906, + "max_load_share": 0.028160919540229885 + } + }, + "s0_bos": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "7d1427fcab94f956482451bdd08cd42f560f13274af77da8bfc22e206ad9fcb1", + "route_weight_sha256": "59d560c35c5bc1af536d1d517fada78166c9603f494c6a8f53596dda16c670d0", + "loads": [ + 19, + 18, + 20, + 10, + 21, + 36, + 25, + 14, + 37, + 14, + 2, + 33, + 46, + 1, + 15, + 44, + 33, + 38, + 9, + 23, + 35, + 28, + 26, + 35, + 15, + 8, + 14, + 39, + 17, + 6, + 45, + 13, + 16, + 16, + 0, + 10, + 50, + 36, + 29, + 32, + 3, + 32, + 17, + 33, + 45, + 5, + 9, + 34, + 1, + 24, + 33, + 25, + 31, + 31, + 39, + 27, + 42, + 26, + 16, + 16, + 5, + 26, + 30, + 16 + ], + "weighted_loads": [ + 1.2532813176512718, + 0.9262630976736546, + 1.1648488529026508, + 0.8271333463490009, + 1.89181874319911, + 2.467201305553317, + 1.484341224655509, + 0.7236555572599173, + 2.955229625105858, + 0.9074774459004402, + 0.11260270327329636, + 1.803078468888998, + 3.0668524634093046, + 0.029962407425045967, + 0.5518872700631618, + 4.494768880307674, + 3.647825125604868, + 3.449461657553911, + 0.6876156106591225, + 1.3129258248955011, + 2.3592058662325144, + 1.2998521570116282, + 2.1268839463591576, + 3.4085032641887665, + 0.955489344894886, + 0.2754954695701599, + 0.8132592421025038, + 2.848440697416663, + 0.8949767183512449, + 0.24585861712694168, + 3.6041450686752796, + 0.651375025510788, + 1.6593332849442959, + 0.5496638510376215, + 0.0, + 0.3842431269586086, + 3.304018449038267, + 2.0834505185484886, + 2.5438866429030895, + 2.7975384183228016, + 0.1553792916238308, + 1.9247964303940535, + 1.024774707853794, + 2.2690374236553907, + 3.3757453486323357, + 0.1745915338397026, + 0.28489312157034874, + 3.0765617061406374, + 0.044210225343704224, + 1.0163960922509432, + 2.1414751932024956, + 1.16290302015841, + 2.836169769987464, + 1.9894207585602999, + 3.346043139696121, + 2.4122542031109333, + 3.183814350515604, + 1.4943670369684696, + 0.9775654561817646, + 1.0526945982128382, + 0.16489749774336815, + 1.7468691021203995, + 1.872924242168665, + 0.794606102630496 + ], + "unique_experts": 63, + "load_cv": 0.5519406269266188, + "normalized_load_entropy": 0.9571199723770889, + "max_load_share": 0.03346720214190094 + }, + "full_input": { + "tokens": 274, + "top_k": 6, + "decisions": 1644, + "ordered_route_sha256": "0c5e4d321f0fb7197dc9ea788874788d2f7b15ed109019be5dd75b55f844adce", + "route_weight_sha256": "a19790671ee218eb082d04e399e0e183ab121c6de96cd2ab2c6a1e73d8ed6bfc", + "loads": [ + 19, + 21, + 22, + 15, + 22, + 36, + 26, + 14, + 37, + 14, + 12, + 34, + 46, + 14, + 17, + 47, + 33, + 38, + 15, + 23, + 35, + 29, + 28, + 35, + 15, + 14, + 19, + 39, + 17, + 24, + 46, + 14, + 16, + 17, + 12, + 10, + 50, + 38, + 31, + 32, + 6, + 34, + 25, + 33, + 45, + 6, + 20, + 34, + 2, + 25, + 35, + 25, + 31, + 31, + 39, + 27, + 42, + 26, + 16, + 30, + 10, + 26, + 33, + 17 + ], + "weighted_loads": [ + 1.2532813176512718, + 1.0707614608108997, + 1.2870382890105247, + 1.1976237494091038, + 1.9548323936760426, + 2.467201305553317, + 1.5368904564529657, + 0.7236555572599173, + 2.955229625105858, + 0.9074774459004402, + 0.7708586826920509, + 1.82010717689991, + 3.0668524634093046, + 0.955428509041667, + 0.5985436830669641, + 4.689313922077417, + 3.647825125604868, + 3.449461657553911, + 1.1446506767824758, + 1.3129258248955011, + 2.3592058662325144, + 1.5908895377069712, + 2.249381460249424, + 3.4085032641887665, + 0.955489344894886, + 0.713007465004921, + 1.3236012142151594, + 2.848440697416663, + 0.8949767183512449, + 1.6958729139441857, + 3.677984956651926, + 0.6697452086955309, + 1.6593332849442959, + 0.574985433369875, + 1.122430728195468, + 0.3842431269586086, + 3.304018449038267, + 2.184522446244955, + 3.63946395739913, + 2.7975384183228016, + 0.295058187097311, + 2.051245963200927, + 1.3824887089431286, + 2.2690374236553907, + 3.3757453486323357, + 0.204687824472785, + 1.4332242868840694, + 3.0765617061406374, + 0.08062904700636864, + 1.044356219470501, + 2.226001162081957, + 1.16290302015841, + 2.836169769987464, + 1.9894207585602999, + 3.346043139696121, + 2.4122542031109333, + 3.183814350515604, + 1.4943670369684696, + 0.9775654561817646, + 1.7984570413827896, + 0.738956703513395, + 1.7468691021203995, + 2.0986158400774, + 0.8302153181284666 + ], + "unique_experts": 64, + "load_cv": 0.4377331143075176, + "normalized_load_entropy": 0.975267677790356, + "max_load_share": 0.030413625304136254 + } + }, + "s1_bos": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "600156c585a0d9e3171ef08e6ae4a7bf76003bedd5145a4e4580373a90e8ff3f", + "route_weight_sha256": "89346c5a10344f98e9b509643213b630df18998b1c996e0a666d3e8faac8a49c", + "loads": [ + 19, + 17, + 20, + 10, + 22, + 38, + 25, + 15, + 37, + 14, + 2, + 35, + 46, + 1, + 15, + 44, + 33, + 39, + 8, + 23, + 36, + 28, + 26, + 35, + 15, + 7, + 12, + 38, + 17, + 6, + 45, + 14, + 16, + 15, + 0, + 8, + 49, + 38, + 29, + 31, + 3, + 32, + 17, + 33, + 46, + 5, + 7, + 33, + 1, + 22, + 32, + 26, + 32, + 29, + 40, + 27, + 43, + 26, + 17, + 13, + 5, + 28, + 29, + 20 + ], + "weighted_loads": [ + 1.2463486902415752, + 0.8911625556647778, + 1.1641115434467793, + 0.7918535992503166, + 1.9323560371994972, + 2.4989307206124067, + 1.4780920464545488, + 0.7582348585128784, + 3.0083538331091404, + 0.88977325335145, + 0.11372639611363411, + 1.8860765881836414, + 3.0952186975628138, + 0.029953675344586372, + 0.5411837864667177, + 4.5183226354420185, + 3.656034391373396, + 3.5311855748295784, + 0.5930250659584999, + 1.3178747463971376, + 2.409965667873621, + 1.323783814907074, + 2.003670744597912, + 3.4897341448813677, + 0.9714627172797918, + 0.23172103613615036, + 0.7195012141019106, + 2.8243644908070564, + 0.8845640067011118, + 0.18865653313696384, + 3.658069957047701, + 0.6783932596445084, + 1.641621746122837, + 0.5206272136420012, + 0.0, + 0.316751005128026, + 3.2727758027613163, + 2.171097392216325, + 2.492149915546179, + 2.7315559536218643, + 0.15733497962355614, + 1.88334977068007, + 1.0172728337347507, + 2.28801516443491, + 3.417627438902855, + 0.1709435060620308, + 0.22110412828624249, + 3.049297697842121, + 0.04000292345881462, + 0.9556457605212927, + 2.103523761034012, + 1.2200918532907963, + 2.7953218203037977, + 1.9501703903079033, + 3.3610465712845325, + 2.410133333876729, + 3.239617897197604, + 1.4927128311246634, + 1.012511644512415, + 0.9526599105447531, + 0.1633017174899578, + 1.838808499276638, + 1.80503985658288, + 1.024951171129942 + ], + "unique_experts": 63, + "load_cv": 0.5618775467089813, + "normalized_load_entropy": 0.9555037062122472, + "max_load_share": 0.03279785809906292 + }, + "full_input": { + "tokens": 290, + "top_k": 6, + "decisions": 1740, + "ordered_route_sha256": "72ae362126b2c0a3b350398754cc492752ef517b16079382663aef61c1c6367d", + "route_weight_sha256": "ff40644aeab135df92db4d34fba09fabe970380ab0289e5a92de72323a9f2e07", + "loads": [ + 19, + 20, + 24, + 20, + 23, + 38, + 28, + 15, + 37, + 22, + 11, + 36, + 47, + 15, + 18, + 48, + 35, + 41, + 16, + 25, + 37, + 30, + 32, + 36, + 15, + 17, + 20, + 38, + 17, + 27, + 46, + 15, + 16, + 16, + 15, + 8, + 49, + 41, + 33, + 34, + 6, + 37, + 26, + 33, + 48, + 7, + 17, + 37, + 2, + 24, + 35, + 26, + 36, + 33, + 46, + 27, + 48, + 28, + 17, + 27, + 14, + 30, + 33, + 23 + ], + "weighted_loads": [ + 1.2463486902415752, + 1.0650685355067253, + 1.3698685206472874, + 1.6276642413868103, + 2.0016408264636993, + 2.4989307206124067, + 1.6727727334946394, + 0.7582348585128784, + 3.0083538331091404, + 1.9318805076181889, + 0.7017551232129335, + 1.9031052961945534, + 3.20298189856112, + 1.0098417084664106, + 0.6157554890960455, + 4.799943257123232, + 4.0193980149924755, + 3.6017376761883497, + 1.3080703410087153, + 1.4079739656299353, + 2.459215309470892, + 1.655029933899641, + 2.441119469702244, + 3.58250711299479, + 0.9714627172797918, + 0.9162845872342587, + 1.5165014583617449, + 2.8243644908070564, + 0.8845640067011118, + 1.478391394019127, + 3.7424948178231716, + 0.6967634428292513, + 1.641621746122837, + 0.5459487959742546, + 1.3529278902569786, + 0.316751005128026, + 3.2727758027613163, + 2.308020418509841, + 3.79214670881629, + 2.9423917420208454, + 0.3170662485063076, + 2.115247896814253, + 1.4450392685830593, + 2.28801516443491, + 3.487141091376543, + 0.20115702747716568, + 1.4192773345857859, + 3.3885595947504044, + 0.0697019025683403, + 1.0198659151792526, + 2.229332707822323, + 1.2200918532907963, + 3.2322949152439833, + 2.1333826072514057, + 3.9157271422445774, + 2.410133333876729, + 3.66527989320457, + 1.5658690202981234, + 1.012511644512415, + 1.750972231850028, + 1.2677141726016998, + 2.034061662852764, + 2.1141622439026833, + 1.1348046883940697 + ], + "unique_experts": 64, + "load_cv": 0.428296283469912, + "normalized_load_entropy": 0.9761268454918779, + "max_load_share": 0.028160919540229885 + } + }, + "s0_x": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "87721388fe3cd48759ebd82d8a89b47b3ca6f8ebff7e23d767958edb789549a8", + "route_weight_sha256": "c14097b598877229ec7c87edc918a997eecc6e0068d38c555bfe4a94b40f523f", + "loads": [ + 19, + 18, + 20, + 10, + 22, + 35, + 25, + 12, + 36, + 14, + 2, + 32, + 46, + 1, + 15, + 44, + 33, + 38, + 10, + 23, + 36, + 28, + 26, + 36, + 14, + 8, + 14, + 38, + 16, + 5, + 45, + 14, + 16, + 17, + 0, + 13, + 49, + 36, + 29, + 33, + 3, + 32, + 16, + 33, + 46, + 5, + 8, + 34, + 2, + 23, + 34, + 25, + 32, + 31, + 39, + 28, + 43, + 26, + 15, + 16, + 5, + 26, + 29, + 15 + ], + "weighted_loads": [ + 1.2462383471429348, + 0.9161899872124195, + 1.138696402311325, + 0.8337846919894218, + 1.925375323742628, + 2.392179789021611, + 1.5057440362870693, + 0.6599657628685236, + 2.918479211628437, + 0.8968182262033224, + 0.10864263772964478, + 1.804696213454008, + 3.047114349901676, + 0.02886384353041649, + 0.5412152521312237, + 4.465355891734362, + 3.6657135039567947, + 3.4665202759206295, + 0.738827545195818, + 1.2896273881196976, + 2.404884112998843, + 1.3027937207370996, + 2.2174446992576122, + 3.419888539239764, + 0.9080993942916393, + 0.280719768255949, + 0.8323755208402872, + 2.7699803318828344, + 0.8421175349503756, + 0.16791024804115295, + 3.593586888164282, + 0.6866367422044277, + 1.6286649219691753, + 0.5888517070561647, + 0.0, + 0.5078127346932888, + 3.2184019777923822, + 2.097598433494568, + 2.555559203028679, + 2.85151107609272, + 0.15430601313710213, + 1.9100432097911835, + 0.9880151208490133, + 2.2714592460542917, + 3.443284038454294, + 0.17585557885468006, + 0.24652483314275742, + 3.0967547707259655, + 0.08083293586969376, + 0.994786623865366, + 2.1480751261115074, + 1.1557599939405918, + 2.9290693793445826, + 1.9819800201803446, + 3.324214518070221, + 2.4605752862989902, + 3.1860833317041397, + 1.500787727534771, + 0.9468470886349678, + 1.0274942200630903, + 0.1682192124426365, + 1.7427039165049791, + 1.8202846236526966, + 0.7336406484246254 + ], + "unique_experts": 63, + "load_cv": 0.5528230732542796, + "normalized_load_entropy": 0.9572136586600661, + "max_load_share": 0.03279785809906292 + }, + "full_input": { + "tokens": 274, + "top_k": 6, + "decisions": 1644, + "ordered_route_sha256": "dff1abfaac215ef598d2bbd0a6405a868789d7ec35e7dc0286b7c2364e968614", + "route_weight_sha256": "7e46f269bd67f2dc82ec810ab25fd175d2256fba1c9970b5c04a51c29a676234", + "loads": [ + 19, + 22, + 23, + 14, + 23, + 35, + 25, + 12, + 36, + 14, + 13, + 33, + 46, + 13, + 17, + 47, + 33, + 38, + 15, + 23, + 36, + 29, + 28, + 36, + 14, + 14, + 19, + 38, + 16, + 21, + 46, + 15, + 16, + 18, + 10, + 13, + 49, + 38, + 31, + 33, + 7, + 34, + 25, + 33, + 46, + 6, + 21, + 34, + 4, + 24, + 36, + 25, + 32, + 31, + 39, + 28, + 43, + 26, + 15, + 32, + 9, + 26, + 32, + 15 + ], + "weighted_loads": [ + 1.2462383471429348, + 1.1058148927986622, + 1.2920156009495258, + 1.163469900522614, + 1.9857669696211815, + 2.392179789021611, + 1.5057440362870693, + 0.6599657628685236, + 2.918479211628437, + 0.8968182262033224, + 0.9840707182884216, + 1.82172492146492, + 3.047114349901676, + 0.912747222930193, + 0.587871665135026, + 4.669503126293421, + 3.6657135039567947, + 3.4665202759206295, + 1.0467482558742631, + 1.2896273881196976, + 2.404884112998843, + 1.5938311014324427, + 2.3438085466623306, + 3.419888539239764, + 0.9080993942916393, + 0.659363467246294, + 1.3797345627099276, + 2.7699803318828344, + 0.8421175349503756, + 1.3865031375462422, + 3.67746314778924, + 0.7050069253891706, + 1.6286649219691753, + 0.6141732893884182, + 0.9037165803893004, + 0.5078127346932888, + 3.2184019777923822, + 2.199262447655201, + 3.6408309414982796, + 2.85151107609272, + 0.35037093237042427, + 2.0376204401254654, + 1.381636144593358, + 2.2714592460542917, + 3.443284038454294, + 0.20595186948776245, + 1.6397300064563751, + 3.0967547707259655, + 0.1605970710515976, + 1.0227467510849237, + 2.230617716908455, + 1.1557599939405918, + 2.9290693793445826, + 1.9819800201803446, + 3.324214518070221, + 2.4605752862989902, + 3.1860833317041397, + 1.500787727534771, + 0.9468470886349678, + 1.8777920808643103, + 0.535831740766298, + 1.7427039165049791, + 2.0360443256795406, + 0.7336406484246254 + ], + "unique_experts": 64, + "load_cv": 0.4387597386673782, + "normalized_load_entropy": 0.9754993673613097, + "max_load_share": 0.029805352798053526 + } + }, + "s1_x": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "64344939496f726c3ebeae892c994e3c0e01740e5dc92188e86e01f75dd75ad9", + "route_weight_sha256": "7011fa29269da7192396b565d4b0bcbd2211deb0ee8b5a890d5cfb25c1725889", + "loads": [ + 19, + 17, + 19, + 10, + 23, + 37, + 25, + 12, + 37, + 14, + 2, + 35, + 46, + 1, + 13, + 44, + 33, + 39, + 10, + 24, + 37, + 32, + 26, + 36, + 15, + 9, + 12, + 37, + 17, + 4, + 46, + 15, + 16, + 15, + 0, + 10, + 49, + 36, + 29, + 30, + 3, + 32, + 18, + 33, + 45, + 5, + 7, + 33, + 1, + 23, + 32, + 26, + 32, + 29, + 40, + 27, + 43, + 27, + 15, + 14, + 5, + 28, + 27, + 18 + ], + "weighted_loads": [ + 1.237914778292179, + 0.880215372890234, + 1.1149239484220743, + 0.805299200117588, + 1.9810636453330517, + 2.4310962595045567, + 1.4894740171730518, + 0.6800574101507664, + 3.0150892436504364, + 0.8775281514972448, + 0.11179614439606667, + 1.9063566960394382, + 3.0801790170371532, + 0.02884374000132084, + 0.4595707915723324, + 4.499881338328123, + 3.6778078712522984, + 3.5553782992064953, + 0.7040450759232044, + 1.3497238047420979, + 2.439672688022256, + 1.4546798150986433, + 2.0520095229148865, + 3.5536353569477797, + 0.9678961634635925, + 0.2970640081912279, + 0.7453714273869991, + 2.7639994099736214, + 0.8750793170183897, + 0.13602005504071712, + 3.704368744045496, + 0.7064676657319069, + 1.6356122214347124, + 0.5166758634150028, + 0.0, + 0.38522827811539173, + 3.2567698042839766, + 2.1292300447821617, + 2.511163391172886, + 2.6808323077857494, + 0.15556014701724052, + 1.8593127112835646, + 1.0516996122896671, + 2.2897376902401447, + 3.4064647145569324, + 0.16899478062987328, + 0.22271784208714962, + 3.064150847494602, + 0.041484180837869644, + 0.9901709388941526, + 2.088727967813611, + 1.2114462833851576, + 2.8226149436086416, + 1.9335111659020185, + 3.3461476750671864, + 2.4103794544935226, + 3.2198018226772547, + 1.5379167683422565, + 0.9503434561192989, + 0.9740177448838949, + 0.16337236762046814, + 1.83567700907588, + 1.7088108696043491, + 0.9187091048806906 + ], + "unique_experts": 63, + "load_cv": 0.5609071129295287, + "normalized_load_entropy": 0.9556220693110002, + "max_load_share": 0.03279785809906292 + }, + "full_input": { + "tokens": 290, + "top_k": 6, + "decisions": 1740, + "ordered_route_sha256": "4164545715b2ac205a9b68190453512637ee7a27c3c326f3065ae8fc37a1f11e", + "route_weight_sha256": "a4c249e5aaf69b9bc94b49f72b20c680643c767945360e5ea84727ab9b7037bf", + "loads": [ + 19, + 20, + 24, + 19, + 24, + 37, + 27, + 12, + 37, + 23, + 12, + 36, + 47, + 14, + 16, + 48, + 35, + 41, + 17, + 26, + 38, + 34, + 32, + 37, + 15, + 19, + 20, + 37, + 18, + 23, + 47, + 16, + 16, + 16, + 14, + 10, + 49, + 39, + 33, + 33, + 7, + 37, + 28, + 33, + 47, + 7, + 19, + 37, + 2, + 25, + 34, + 26, + 36, + 33, + 46, + 27, + 48, + 29, + 15, + 29, + 13, + 30, + 31, + 21 + ], + "weighted_loads": [ + 1.237914778292179, + 1.0545911192893982, + 1.3571904767304659, + 1.602387856139103, + 2.0525232069194317, + 2.4310962595045567, + 1.6343454532325268, + 0.6800574101507664, + 3.0150892436504364, + 1.9567987490445375, + 0.8882544506341219, + 1.9233854040503502, + 3.1879422180354595, + 0.9674073476344347, + 0.5341424942016602, + 4.7856544479727745, + 4.041171494871378, + 3.6259304005652666, + 1.2608462030766532, + 1.4398230239748955, + 2.488922329619527, + 1.7859259340912104, + 2.494238503277302, + 3.646408325061202, + 0.9678961634635925, + 0.9330940674990416, + 1.55688651278615, + 2.7639994099736214, + 0.9084462430328131, + 1.2284547202289104, + 3.8005435578525066, + 0.7248378489166498, + 1.6356122214347124, + 0.5419974457472563, + 1.1688529631355777, + 0.38522827811539173, + 3.2567698042839766, + 2.268002185970545, + 3.793587736785412, + 2.8916680961847305, + 0.36935116723179817, + 2.0931242433725856, + 1.5197255611419678, + 2.2897376902401447, + 3.4759783670306206, + 0.19920830204500817, + 1.6773683074861765, + 3.4034127444028854, + 0.07118315994739532, + 1.0543910935521126, + 2.180943826213479, + 1.2114462833851576, + 3.259588038548827, + 2.116723382845521, + 3.900828246027231, + 2.4103794544935226, + 3.6454638186842203, + 1.6110729575157166, + 0.9503434561192989, + 1.8349043633788824, + 1.0385273396968842, + 2.030930172652006, + 2.005055334419012, + 1.0331509690731764 + ], + "unique_experts": 64, + "load_cv": 0.42661488984293344, + "normalized_load_entropy": 0.9763847594022549, + "max_load_share": 0.028160919540229885 + } + }, + "s0_period": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "bd8d2a20633f309e7f075b43cf7da45a3d200a58a586fc3d22470c4e3bc4a9f5", + "route_weight_sha256": "4a20069f77dfbc171f79c206602e04bcaefa3daf0eace0799714c17bf368241e", + "loads": [ + 19, + 18, + 21, + 10, + 21, + 35, + 25, + 12, + 37, + 14, + 2, + 32, + 46, + 1, + 15, + 44, + 33, + 39, + 10, + 23, + 36, + 27, + 26, + 36, + 15, + 8, + 13, + 38, + 16, + 4, + 45, + 13, + 16, + 18, + 0, + 14, + 49, + 36, + 28, + 32, + 3, + 32, + 17, + 33, + 45, + 5, + 8, + 34, + 1, + 26, + 34, + 25, + 32, + 31, + 39, + 28, + 43, + 26, + 15, + 15, + 5, + 26, + 29, + 15 + ], + "weighted_loads": [ + 1.2443476729094982, + 0.918340165168047, + 1.1808832585811615, + 0.8275364637374878, + 1.8953998014330864, + 2.3969949297606945, + 1.5019878912717104, + 0.6634310521185398, + 2.9653317220509052, + 0.9291062783449888, + 0.10758725181221962, + 1.803814109414816, + 3.0600016061216593, + 0.02838912047445774, + 0.5409485436975956, + 4.463992137461901, + 3.6508188880980015, + 3.5223383642733097, + 0.7374772429466248, + 1.2943228762596846, + 2.3905420545488596, + 1.2405868005007505, + 2.1736300997436047, + 3.4109494388103485, + 0.9450670890510082, + 0.27886945754289627, + 0.8042331878095865, + 2.7725907787680626, + 0.8419427890330553, + 0.1401188187301159, + 3.6049727089703083, + 0.6419863551855087, + 1.6355630494654179, + 0.6227425988763571, + 0.0, + 0.5288548655807972, + 3.1976646464318037, + 2.119578666985035, + 2.4663902409374714, + 2.809082681313157, + 0.15395474433898926, + 1.906249875202775, + 1.0234445054084063, + 2.269458558410406, + 3.456046674400568, + 0.16998052597045898, + 0.259920597076416, + 3.0913990437984467, + 0.049922358244657516, + 1.0747230891138315, + 2.1572951320558786, + 1.152556974440813, + 2.9295416865497828, + 1.9918553493916988, + 3.307065848261118, + 2.4595428463071585, + 3.186791615560651, + 1.5011143125593662, + 0.9457987286150455, + 0.9852126725018024, + 0.1662842556834221, + 1.740318451076746, + 1.8322268724441528, + 0.7354317475110292 + ], + "unique_experts": 63, + "load_cv": 0.5542217177678066, + "normalized_load_entropy": 0.956579650350437, + "max_load_share": 0.03279785809906292 + }, + "full_input": { + "tokens": 274, + "top_k": 6, + "decisions": 1644, + "ordered_route_sha256": "ec6dab07a94bd682949821ba7b85acb06b70895e3ff4ec2be924bb2349c99255", + "route_weight_sha256": "4583694fbebc3927019f1a5d44b24da07e638be2717d70990540907ffd743d2c", + "loads": [ + 19, + 22, + 24, + 14, + 22, + 35, + 25, + 12, + 37, + 14, + 12, + 33, + 46, + 13, + 17, + 47, + 33, + 39, + 15, + 23, + 36, + 28, + 29, + 36, + 15, + 14, + 19, + 38, + 16, + 21, + 46, + 14, + 16, + 19, + 9, + 14, + 49, + 38, + 30, + 32, + 6, + 34, + 25, + 33, + 45, + 6, + 20, + 34, + 3, + 27, + 36, + 26, + 33, + 31, + 39, + 28, + 43, + 26, + 15, + 30, + 9, + 26, + 32, + 16 + ], + "weighted_loads": [ + 1.2443476729094982, + 1.1177492290735245, + 1.3467797636985779, + 1.1592264893988613, + 1.9511673487722874, + 2.3969949297606945, + 1.5019878912717104, + 0.6634310521185398, + 2.9653317220509052, + 0.9291062783449888, + 0.7658432312309742, + 1.8208428174257278, + 3.0600016061216593, + 0.8879776168614626, + 0.5876049567013979, + 4.651398051530123, + 3.6508188880980015, + 3.5223383642733097, + 1.0496869213238824, + 1.2943228762596846, + 2.3905420545488596, + 1.5316241811960936, + 2.33294091001153, + 3.4109494388103485, + 0.9450670890510082, + 0.6397338658571243, + 1.6165080089122057, + 2.7725907787680626, + 0.8419427890330553, + 1.3757822885090718, + 3.6961278952658176, + 0.6603565383702517, + 1.6355630494654179, + 0.6480641812086105, + 0.8513034595234785, + 0.5288548655807972, + 3.1976646464318037, + 2.221967112272978, + 3.5629981346428394, + 2.809082681313157, + 0.2936336398124695, + 2.032055275514722, + 1.3811585064977407, + 2.269458558410406, + 3.456046674400568, + 0.20007681660354137, + 1.5680071413516998, + 3.0913990437984467, + 0.14053549617528915, + 1.1026832163333893, + 2.239972596988082, + 1.278993148356676, + 2.9943645242601633, + 1.9918553493916988, + 3.307065848261118, + 2.4595428463071585, + 3.186791615560651, + 1.5011143125593662, + 0.9457987286150455, + 1.8075953908264637, + 0.5314691389794461, + 1.740318451076746, + 2.0510150231420994, + 0.769649276509881 + ], + "unique_experts": 64, + "load_cv": 0.44064462762421786, + "normalized_load_entropy": 0.9749896087171815, + "max_load_share": 0.029805352798053526 + } + }, + "s1_period": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "e6c9c34422c0a1988af95b686173608a59ada2c08f100ce85cc341d0888d9866", + "route_weight_sha256": "e96351a40716bb1157cfc38e30321d8c6c02c1583645b709129ee7266f931f74", + "loads": [ + 19, + 18, + 19, + 10, + 23, + 36, + 25, + 11, + 38, + 14, + 2, + 34, + 46, + 1, + 14, + 44, + 33, + 39, + 10, + 24, + 37, + 32, + 26, + 36, + 15, + 9, + 11, + 37, + 17, + 4, + 46, + 15, + 16, + 15, + 0, + 9, + 50, + 37, + 29, + 30, + 3, + 32, + 18, + 33, + 46, + 5, + 7, + 33, + 1, + 23, + 33, + 26, + 32, + 29, + 40, + 27, + 42, + 27, + 15, + 13, + 5, + 27, + 27, + 19 + ], + "weighted_loads": [ + 1.2374109327793121, + 0.9164430052042007, + 1.12183771841228, + 0.7959876172244549, + 1.977772630751133, + 2.406988864764571, + 1.4878413323312998, + 0.6520188003778458, + 3.0536465272307396, + 0.8853102345019579, + 0.1121523380279541, + 1.853103019297123, + 3.091467322781682, + 0.028293529525399208, + 0.4975086711347103, + 4.511260654777288, + 3.68438209220767, + 3.5639191195368767, + 0.7032752446830273, + 1.3490672279149294, + 2.4428862929344177, + 1.4398086834698915, + 2.012984585016966, + 3.547758024185896, + 0.9614982325583696, + 0.293830044567585, + 0.7174939960241318, + 2.768273176625371, + 0.8800350092351437, + 0.13476580381393433, + 3.702155616134405, + 0.6950482949614525, + 1.6341185215860605, + 0.5189145226031542, + 0.0, + 0.3558522965759039, + 3.27937014400959, + 2.1751792561262846, + 2.4966846741735935, + 2.694367066025734, + 0.15460529550909996, + 1.8494047448039055, + 1.0513347666710615, + 2.2928030602633953, + 3.468558318912983, + 0.16788917034864426, + 0.22179192677140236, + 3.0596233401447535, + 0.03930933400988579, + 0.991473414003849, + 2.1247623171657324, + 1.2081074006855488, + 2.793314902111888, + 1.9414966646581888, + 3.3419606871902943, + 2.4011951461434364, + 3.1903459019958973, + 1.5407774075865746, + 0.9465991407632828, + 0.9217573069036007, + 0.16515924036502838, + 1.7938878759741783, + 1.7085719145834446, + 0.9639992918819189 + ], + "unique_experts": 63, + "load_cv": 0.5641692840224076, + "normalized_load_entropy": 0.9551608955205005, + "max_load_share": 0.03346720214190094 + }, + "full_input": { + "tokens": 290, + "top_k": 6, + "decisions": 1740, + "ordered_route_sha256": "4f1fdb6774165c1a3374395ae860c642cfb3ffe26d4461ceee1ba58ecabdd265", + "route_weight_sha256": "c848ac72cc6dceb73fd6a37018c10877cc7fe55394f2e98e817e7560699f30c1", + "loads": [ + 19, + 21, + 23, + 19, + 24, + 36, + 27, + 11, + 38, + 23, + 11, + 35, + 47, + 14, + 17, + 48, + 35, + 41, + 17, + 26, + 38, + 34, + 33, + 37, + 15, + 19, + 20, + 37, + 18, + 23, + 47, + 16, + 16, + 16, + 13, + 9, + 50, + 41, + 33, + 33, + 6, + 37, + 27, + 33, + 48, + 7, + 18, + 37, + 2, + 25, + 35, + 27, + 37, + 33, + 46, + 27, + 47, + 29, + 15, + 28, + 13, + 29, + 31, + 23 + ], + "weighted_loads": [ + 1.2374109327793121, + 1.0789147093892097, + 1.3286253158003092, + 1.5994263360335026, + 2.047303207218647, + 2.406988864764571, + 1.6327127683907747, + 0.6520188003778458, + 3.0536465272307396, + 1.964498559013009, + 0.7001810651272535, + 1.870131727308035, + 3.1992305237799883, + 0.9394007492810488, + 0.5720803737640381, + 4.803523320704699, + 4.04774571582675, + 3.634471220895648, + 1.2659458125708625, + 1.439166447147727, + 2.4921359345316887, + 1.7710548024624586, + 2.4874836951494217, + 3.6405309922993183, + 0.9614982325583696, + 0.9004741460084915, + 1.8334384858608246, + 2.768273176625371, + 0.9139735177159309, + 1.214691722765565, + 3.7953730039298534, + 0.7134184781461954, + 1.6341185215860605, + 0.5442361049354076, + 1.1201262479880825, + 0.3558522965759039, + 3.27937014400959, + 2.3555030953139067, + 3.7863007448613644, + 2.905202854424715, + 0.3143365643918514, + 2.0805981801240705, + 1.47910120151937, + 2.2928030602633953, + 3.538071971386671, + 0.19810269176377915, + 1.5289633944630623, + 3.3988852370530367, + 0.06900831311941147, + 1.055693568661809, + 2.2169781755656004, + 1.3041195161640644, + 3.2829543258994818, + 2.1247088816016912, + 3.896641258150339, + 2.4011951461434364, + 3.616007898002863, + 1.6139335967600346, + 0.9465991407632828, + 1.8402683399617672, + 1.047675121575594, + 1.9891410395503044, + 2.0168521739542484, + 1.111612455919385 + ], + "unique_experts": 64, + "load_cv": 0.43281318823745857, + "normalized_load_entropy": 0.9755684222298445, + "max_load_share": 0.028735632183908046 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 249, + "ordered_topk_exact_tokens": 206, + "set_exact_tokens": 228, + "mean_set_jaccard": 0.9759036144578314, + "mean_token_weighted_tv": 0.005744770438556212, + "aggregate_load_tv": 0.011378848728246321 + }, + "system_bos": { + "tokens": 249, + "ordered_topk_exact_tokens": 181, + "set_exact_tokens": 211, + "mean_set_jaccard": 0.9563970166379804, + "mean_token_weighted_tv": 0.011264026550254429, + "aggregate_load_tv": 0.01539491298527443 + }, + "system_x": { + "tokens": 249, + "ordered_topk_exact_tokens": 176, + "set_exact_tokens": 203, + "mean_set_jaccard": 0.9463568559954102, + "mean_token_weighted_tv": 0.013308003574729445, + "aggregate_load_tv": 0.019410977242302542 + }, + "system_period": { + "tokens": 249, + "ordered_topk_exact_tokens": 174, + "set_exact_tokens": 199, + "mean_set_jaccard": 0.942627653471027, + "mean_token_weighted_tv": 0.013663457018364385, + "aggregate_load_tv": 0.020749665327978582 + }, + "bos_at_s0": { + "tokens": 249, + "ordered_topk_exact_tokens": 154, + "set_exact_tokens": 187, + "mean_set_jaccard": 0.9288582903040733, + "mean_token_weighted_tv": 0.017316007986664772, + "aggregate_load_tv": 0.02208835341365462 + }, + "bos_at_s1": { + "tokens": 249, + "ordered_topk_exact_tokens": 146, + "set_exact_tokens": 180, + "mean_set_jaccard": 0.9199655765920826, + "mean_token_weighted_tv": 0.01985830533501494, + "aggregate_load_tv": 0.02811244979919679 + }, + "x_at_s0": { + "tokens": 249, + "ordered_topk_exact_tokens": 171, + "set_exact_tokens": 195, + "mean_set_jaccard": 0.9380378657487091, + "mean_token_weighted_tv": 0.015604417685075218, + "aggregate_load_tv": 0.020080321285140562 + }, + "x_at_s1": { + "tokens": 249, + "ordered_topk_exact_tokens": 147, + "set_exact_tokens": 177, + "mean_set_jaccard": 0.9156626506024096, + "mean_token_weighted_tv": 0.020335115069695504, + "aggregate_load_tv": 0.02677376171352075 + }, + "period_at_s0": { + "tokens": 249, + "ordered_topk_exact_tokens": 161, + "set_exact_tokens": 186, + "mean_set_jaccard": 0.9277108433734939, + "mean_token_weighted_tv": 0.01652214232173909, + "aggregate_load_tv": 0.02342704149933065 + }, + "period_at_s1": { + "tokens": 249, + "ordered_topk_exact_tokens": 139, + "set_exact_tokens": 170, + "mean_set_jaccard": 0.9076305220883533, + "mean_token_weighted_tv": 0.021199692837355368, + "aggregate_load_tv": 0.02945113788487283 + } + } + }, + "layer_05": { + "layer": 5, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "0720258d0aa62f444f72317346dccd0fa5316ae431b228b750251ba545210514", + "route_weight_sha256": "5d2e14eb8104592a57c7ffdba0d6a140590e689fbd2dba262b4a6316c4f0fb3b", + "loads": [ + 40, + 11, + 23, + 25, + 11, + 10, + 18, + 23, + 27, + 23, + 5, + 16, + 23, + 40, + 8, + 11, + 40, + 22, + 17, + 15, + 27, + 36, + 30, + 39, + 43, + 2, + 18, + 26, + 40, + 30, + 16, + 13, + 39, + 28, + 38, + 7, + 36, + 43, + 7, + 10, + 3, + 5, + 33, + 32, + 9, + 50, + 8, + 18, + 29, + 5, + 17, + 31, + 12, + 25, + 12, + 28, + 13, + 52, + 28, + 21, + 34, + 28, + 48, + 17 + ], + "weighted_loads": [ + 2.889350974932313, + 0.3907283637672663, + 1.6625150293111801, + 1.3258358128368855, + 0.6482560355216265, + 0.422424104064703, + 1.058520533144474, + 1.6093110349029303, + 2.0267414301633835, + 0.9380435813218355, + 0.17548062466084957, + 1.0202644057571888, + 1.9554640017449856, + 3.0932410079985857, + 0.39895311929285526, + 0.7916027586907148, + 3.5307647176086903, + 1.436651524156332, + 0.8412758894264698, + 0.6203411053866148, + 1.2539507579058409, + 2.8748477790504694, + 2.447890270501375, + 2.69336399063468, + 3.3872941844165325, + 0.10792916268110275, + 0.9707300197333097, + 2.5873449333012104, + 3.290312735363841, + 2.2440898958593607, + 1.1734050400555134, + 0.6406569611281157, + 2.2156705744564533, + 1.9249760247766972, + 2.8681514151394367, + 0.39333081617951393, + 2.307521617040038, + 3.230309708043933, + 0.2781183570623398, + 0.6389959193766117, + 0.15530671924352646, + 0.16589588299393654, + 2.930701944977045, + 2.5895692855119705, + 0.43728686682879925, + 3.953073661774397, + 0.5457393452525139, + 0.6557876896113157, + 2.706590062007308, + 0.1436581201851368, + 1.012978509068489, + 2.319859202951193, + 0.49616735242307186, + 1.8074167296290398, + 0.6775025762617588, + 1.7627736553549767, + 0.7843132186681032, + 3.9477322325110435, + 2.238079857081175, + 1.2034430895000696, + 2.758233033120632, + 1.7898399475961924, + 3.325775181874633, + 1.4159717075526714 + ], + "unique_experts": 64, + "load_cv": 0.5460912196494, + "normalized_load_entropy": 0.9616770032832967, + "max_load_share": 0.03480589022757698 + }, + "full_input": { + "tokens": 274, + "top_k": 6, + "decisions": 1644, + "ordered_route_sha256": "d2aea7827c6e98b3ae7c6dbd462919516bc786afaade7588d8ea89df670f3097", + "route_weight_sha256": "410f32c1e4fb489b238a5575315cfa1b627107069da0530172e184530a48fba7", + "loads": [ + 40, + 12, + 23, + 25, + 12, + 12, + 20, + 25, + 28, + 24, + 15, + 16, + 26, + 40, + 8, + 24, + 42, + 28, + 26, + 16, + 29, + 36, + 30, + 39, + 43, + 10, + 18, + 26, + 40, + 30, + 16, + 14, + 39, + 28, + 38, + 12, + 36, + 43, + 18, + 17, + 7, + 13, + 40, + 33, + 10, + 50, + 8, + 20, + 29, + 9, + 25, + 31, + 14, + 33, + 15, + 38, + 13, + 52, + 28, + 22, + 34, + 29, + 48, + 19 + ], + "weighted_loads": [ + 2.889350974932313, + 0.39422368560917675, + 1.6625150293111801, + 1.3258358128368855, + 0.6500133477384225, + 0.4905746392905712, + 1.1284447684884071, + 1.6560450063552707, + 2.030086714308709, + 0.9425622215494514, + 0.7687989119440317, + 1.0202644057571888, + 2.157373234629631, + 3.0932410079985857, + 0.39895311929285526, + 2.8162918188609183, + 3.673784602433443, + 1.736296657472849, + 1.7918593846261501, + 0.6333829807117581, + 1.2693742266856134, + 2.8748477790504694, + 2.447890270501375, + 2.69336399063468, + 3.3872941844165325, + 1.00884098559618, + 0.9707300197333097, + 2.5873449333012104, + 3.290312735363841, + 2.2440898958593607, + 1.1734050400555134, + 0.678286911919713, + 2.2156705744564533, + 1.9249760247766972, + 2.8681514151394367, + 0.827733650803566, + 2.307521617040038, + 3.230309708043933, + 1.3499579466879368, + 1.3126106448471546, + 0.33122189342975616, + 0.9742181673645973, + 3.381446737796068, + 2.6422268450260162, + 0.518327509984374, + 3.953073661774397, + 0.5457393452525139, + 0.6737699082586914, + 2.706590062007308, + 0.3176800161600113, + 1.684830792248249, + 2.319859202951193, + 2.126820793375373, + 2.3521853797137737, + 0.6943510578712448, + 2.503527455031872, + 0.7843132186681032, + 3.9477322325110435, + 2.238079857081175, + 1.2493813131004572, + 2.758233033120632, + 1.8273842427879572, + 3.325775181874633, + 2.3524451665580273 + ], + "unique_experts": 64, + "load_cv": 0.4503188888586704, + "normalized_load_entropy": 0.9748718659202609, + "max_load_share": 0.031630170316301706 + } + }, + "s1_eos": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "7f9f1c19402abc7348a974d20aa415a3ebe8ceb75909baa4932bd8bc5cdbafcd", + "route_weight_sha256": "fa2e930d40c2ba7878b1c3669c02d685f199d0f63bbd541d33cb5022042d600f", + "loads": [ + 41, + 10, + 23, + 24, + 11, + 10, + 18, + 23, + 26, + 23, + 5, + 16, + 22, + 40, + 8, + 11, + 41, + 22, + 18, + 15, + 27, + 36, + 30, + 39, + 43, + 2, + 19, + 26, + 40, + 30, + 16, + 13, + 39, + 28, + 38, + 8, + 35, + 43, + 6, + 10, + 3, + 5, + 33, + 32, + 9, + 50, + 8, + 18, + 30, + 4, + 17, + 31, + 13, + 25, + 11, + 29, + 13, + 54, + 29, + 20, + 34, + 28, + 47, + 16 + ], + "weighted_loads": [ + 2.9190117344260216, + 0.36067458987236023, + 1.6478122062981129, + 1.2854255456477404, + 0.6543025281280279, + 0.4309424441307783, + 1.07836520858109, + 1.6052168514579535, + 1.9744333438575268, + 0.9636822361499071, + 0.17559590749442577, + 1.0160582456737757, + 1.894264280796051, + 3.10074482858181, + 0.4008737523108721, + 0.8173668533563614, + 3.6068458519876003, + 1.441479854285717, + 0.8525953367352486, + 0.6167973652482033, + 1.2621715143322945, + 2.8401394225656986, + 2.4329652097076178, + 2.7181620597839355, + 3.399206316098571, + 0.10690981522202492, + 1.0237639769911766, + 2.5826182290911674, + 3.2926027812063694, + 2.2279443833976984, + 1.1782879456877708, + 0.6454078666865826, + 2.2118052300065756, + 1.920229583978653, + 2.8786744363605976, + 0.4402262382209301, + 2.2757634483277798, + 3.2491832058876753, + 0.23918955773115158, + 0.596689011901617, + 0.15457770228385925, + 0.16440867446362972, + 2.915582612156868, + 2.587354138493538, + 0.4310410376638174, + 3.946009460836649, + 0.5493087582290173, + 0.6548437383025885, + 2.719604756683111, + 0.11515717022120953, + 1.0216020327061415, + 2.3221631832420826, + 0.5305947717279196, + 1.8098892010748386, + 0.6423736065626144, + 1.7833088524639606, + 0.7830903436988592, + 4.061796659603715, + 2.2634680550545454, + 1.1900897230952978, + 2.7525079995393753, + 1.7632991466671228, + 3.3085624165832996, + 1.3930755369365215 + ], + "unique_experts": 64, + "load_cv": 0.5514728777958336, + "normalized_load_entropy": 0.9609145054858855, + "max_load_share": 0.03614457831325301 + }, + "full_input": { + "tokens": 290, + "top_k": 6, + "decisions": 1740, + "ordered_route_sha256": "71bc8b771383172e87bf099e5339b7524079c6b2699e40d80eeef6562360d443", + "route_weight_sha256": "f0b633277f07bf2557653a48ca423ad5188253726397d6cbec30a166c64c02cc", + "loads": [ + 42, + 12, + 23, + 30, + 12, + 12, + 26, + 26, + 27, + 24, + 18, + 19, + 27, + 40, + 9, + 26, + 44, + 33, + 30, + 25, + 29, + 36, + 31, + 39, + 44, + 10, + 19, + 28, + 40, + 32, + 16, + 14, + 40, + 29, + 39, + 13, + 36, + 46, + 18, + 21, + 7, + 18, + 45, + 36, + 10, + 50, + 8, + 21, + 30, + 18, + 27, + 32, + 15, + 35, + 15, + 39, + 13, + 54, + 30, + 21, + 35, + 29, + 47, + 20 + ], + "weighted_loads": [ + 2.955559942871332, + 0.3848283013794571, + 1.6478122062981129, + 1.70009552128613, + 0.6560769447823986, + 0.5053238999098539, + 2.0609042327851057, + 1.7028460600413382, + 1.9777974025346339, + 0.9681188426911831, + 0.9693980291485786, + 1.3821268547326326, + 2.3320304416120052, + 3.10074482858181, + 0.43371386639773846, + 3.322960271500051, + 3.836150210350752, + 2.119217101484537, + 2.1301481314003468, + 1.457909676246345, + 1.2775124036706984, + 2.8401394225656986, + 2.4711022060364485, + 2.7181620597839355, + 3.474932609125972, + 0.8228190988302231, + 1.0237639769911766, + 2.755445696413517, + 3.2926027812063694, + 2.3145212586969137, + 1.1782879456877708, + 0.6865450479090214, + 2.3315773587673903, + 1.9628985971212387, + 2.913303457200527, + 0.9962831623852253, + 2.3206984773278236, + 3.402323516085744, + 1.4456235356628895, + 1.7274182513356209, + 0.3158116936683655, + 1.378240367397666, + 3.7129253447055817, + 2.8393861688673496, + 0.4929891247302294, + 3.946009460836649, + 0.5493087582290173, + 0.7057982538826764, + 2.719604756683111, + 0.9292233567684889, + 2.078626388683915, + 2.3703584894537926, + 2.160815602168441, + 2.619376678019762, + 0.6970830243080854, + 2.398012073710561, + 0.7830903436988592, + 4.061796659603715, + 2.3335101436823606, + 1.2370571959763765, + 2.7982921674847603, + 1.8005730640143156, + 3.3085624165832996, + 2.569861751049757 + ], + "unique_experts": 64, + "load_cv": 0.42522522068613283, + "normalized_load_entropy": 0.9773002923893421, + "max_load_share": 0.03103448275862069 + } + }, + "s0_bos": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "a1fcabc99de9867f285860e6d39e7fc6918bb74ca1f9913aa633923b40ea1075", + "route_weight_sha256": "b9c051c7fcc5ea3251cee82b2408cf69724075f35a143017836d270a6a547518", + "loads": [ + 41, + 10, + 23, + 24, + 12, + 8, + 18, + 24, + 25, + 23, + 6, + 16, + 23, + 40, + 12, + 13, + 39, + 21, + 15, + 13, + 28, + 36, + 30, + 38, + 43, + 3, + 16, + 27, + 40, + 29, + 16, + 12, + 37, + 29, + 39, + 9, + 36, + 43, + 6, + 9, + 2, + 3, + 34, + 32, + 11, + 49, + 9, + 24, + 28, + 2, + 18, + 30, + 15, + 24, + 10, + 28, + 11, + 55, + 29, + 20, + 34, + 27, + 51, + 16 + ], + "weighted_loads": [ + 2.9896374493837357, + 0.34732159599661827, + 1.643182022497058, + 1.3202644102275372, + 0.6594833228737116, + 0.34631750360131264, + 1.0680938921868801, + 1.697937160730362, + 2.090555664151907, + 0.9498841278254986, + 0.19916228391230106, + 1.0241070725023746, + 1.9171238727867603, + 3.12724032998085, + 0.5675215758383274, + 0.9204087182879448, + 3.4609734378755093, + 1.3886431604623795, + 0.7232974991202354, + 0.5299918688833714, + 1.2916761189699173, + 2.917949393391609, + 2.483741533011198, + 2.6910917088389397, + 3.4657100439071655, + 0.1469021886587143, + 0.8901532776653767, + 2.683953830972314, + 3.334890190511942, + 2.291747720912099, + 1.2064104117453098, + 0.6144521310925484, + 2.1509072482585907, + 2.001704378053546, + 2.86171823553741, + 0.4730697888880968, + 2.3809247612953186, + 3.24021702632308, + 0.23805008456110954, + 0.562378466129303, + 0.09853056818246841, + 0.10166765190660954, + 3.0223868377506733, + 2.6277296654880047, + 0.4919532611966133, + 3.931653220206499, + 0.5950850583612919, + 0.8489214442670345, + 2.687780048698187, + 0.05752583034336567, + 1.0736897122114897, + 2.3174845594912767, + 0.6007884535938501, + 1.7181064449250698, + 0.646666819229722, + 1.731331853196025, + 0.7129533030092716, + 4.134952450171113, + 2.316715195775032, + 1.1763046253472567, + 2.834615632891655, + 1.7332115527242422, + 3.4973202105611563, + 1.4159263223409653 + ], + "unique_experts": 64, + "load_cv": 0.5549972194750611, + "normalized_load_entropy": 0.9601905066733266, + "max_load_share": 0.03681392235609103 + }, + "full_input": { + "tokens": 274, + "top_k": 6, + "decisions": 1644, + "ordered_route_sha256": "81e0683db60edc77e85efe7941a4b410311b429ec95e71b77cf8a3ba28b9cbde", + "route_weight_sha256": "157c725614042c8811d41a8f77eaee14f3e3f79902450c36d55a4fb607031cd6", + "loads": [ + 41, + 11, + 23, + 24, + 12, + 10, + 19, + 26, + 26, + 23, + 16, + 16, + 26, + 40, + 12, + 26, + 41, + 27, + 25, + 14, + 29, + 36, + 30, + 38, + 43, + 11, + 16, + 27, + 40, + 29, + 16, + 13, + 37, + 29, + 39, + 14, + 36, + 43, + 18, + 17, + 6, + 11, + 43, + 34, + 12, + 49, + 9, + 25, + 28, + 6, + 26, + 30, + 16, + 32, + 12, + 39, + 11, + 55, + 29, + 21, + 34, + 28, + 51, + 18 + ], + "weighted_loads": [ + 2.9896374493837357, + 0.35081691783852875, + 1.643182022497058, + 1.3202644102275372, + 0.6594833228737116, + 0.41446803882718086, + 1.1000324226915836, + 1.7447049056645483, + 2.0939009482972324, + 0.9498841278254986, + 0.7994416523724794, + 1.0241070725023746, + 2.1167706698179245, + 3.12724032998085, + 0.5675215758383274, + 2.953496825415641, + 3.605039667338133, + 1.6882882937788963, + 1.7870347239077091, + 0.5430337442085147, + 1.3042239667847753, + 2.917949393391609, + 2.483741533011198, + 2.6910917088389397, + 3.4657100439071655, + 1.0478140115737915, + 0.8901532776653767, + 2.683953830972314, + 3.334890190511942, + 2.291747720912099, + 1.2064104117453098, + 0.65632114559412, + 2.1509072482585907, + 2.001704378053546, + 2.86171823553741, + 0.9100834783166647, + 2.3809247612953186, + 3.24021702632308, + 1.4838397689163685, + 1.2666133306920528, + 0.2744457423686981, + 0.9461954366415739, + 3.594861064106226, + 2.715772856026888, + 0.5729939043521881, + 3.931653220206499, + 0.5950850583612919, + 0.8645165450870991, + 2.687780048698187, + 0.24490361846983433, + 1.752166984602809, + 2.3174845594912767, + 1.2666854057461023, + 2.2628750950098038, + 0.6616226055193692, + 2.4721514005213976, + 0.7129533030092716, + 4.134952450171113, + 2.316715195775032, + 1.2222428489476442, + 2.834615632891655, + 1.7718950901180506, + 3.4973202105611563, + 2.352399781346321 + ], + "unique_experts": 64, + "load_cv": 0.46256234602965335, + "normalized_load_entropy": 0.9735567002888483, + "max_load_share": 0.03345498783454988 + } + }, + "s1_bos": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "f0ce35f6fe528e4ec3fc6cdd8c3ba63b76e31f390d324fc3f0a36d08ad91e755", + "route_weight_sha256": "ac2b40477aa653a56f2ca2dfbfe44017f289af1fffe819046fac7f7ca51e8253", + "loads": [ + 42, + 9, + 24, + 24, + 12, + 11, + 17, + 25, + 24, + 26, + 6, + 17, + 23, + 40, + 12, + 11, + 40, + 22, + 12, + 18, + 27, + 36, + 31, + 38, + 42, + 2, + 18, + 26, + 40, + 29, + 17, + 11, + 35, + 29, + 37, + 9, + 36, + 44, + 5, + 9, + 2, + 3, + 33, + 32, + 11, + 48, + 10, + 23, + 29, + 3, + 18, + 30, + 14, + 25, + 11, + 25, + 12, + 56, + 30, + 19, + 34, + 25, + 50, + 15 + ], + "weighted_loads": [ + 2.988075101748109, + 0.31068760715425014, + 1.7099625281989574, + 1.3466578871011734, + 0.6685015335679054, + 0.4550284072756767, + 1.056950505822897, + 1.7158531807363033, + 1.9898350778967142, + 1.0683597512543201, + 0.2058002632111311, + 1.0644305441528559, + 1.897934626787901, + 3.18227718770504, + 0.5786949507892132, + 0.8857999052852392, + 3.5502102822065353, + 1.4574621766805649, + 0.5692779272794724, + 0.7174359448254108, + 1.2610119301825762, + 2.905204501003027, + 2.51888083294034, + 2.723086103796959, + 3.42376821488142, + 0.10529185459017754, + 0.9514313228428364, + 2.6556228064000607, + 3.3107143696397543, + 2.24036911316216, + 1.247422531247139, + 0.6075176540762186, + 2.08357310667634, + 2.005179289728403, + 2.7601298931986094, + 0.48190330527722836, + 2.3756590839475393, + 3.311930211260915, + 0.1951681300997734, + 0.4781871363520622, + 0.0934339128434658, + 0.09459327906370163, + 2.9670250415802, + 2.6676470041275024, + 0.5170089919120073, + 3.88273036852479, + 0.6433325633406639, + 0.8143451809883118, + 2.785578077659011, + 0.08964467607438564, + 1.1091275420039892, + 2.330378096550703, + 0.569151371717453, + 1.7949787639081478, + 0.6782199908047915, + 1.574749669060111, + 0.754145123064518, + 4.20251583494246, + 2.342767108231783, + 1.1655185893177986, + 2.846289176493883, + 1.6532297153025866, + 3.5046209041029215, + 1.417590718716383 + ], + "unique_experts": 64, + "load_cv": 0.5511608245082356, + "normalized_load_entropy": 0.9606592850810166, + "max_load_share": 0.03748326639892905 + }, + "full_input": { + "tokens": 290, + "top_k": 6, + "decisions": 1740, + "ordered_route_sha256": "c790205f56a24e3f1a2b474b55c85f9547bbc8b4d2c9dd69e47899ea32503ea9", + "route_weight_sha256": "647beb31176985a344a89d6235c6127796d645024d4b1ae8cd7a54efe27c6d14", + "loads": [ + 43, + 11, + 24, + 30, + 12, + 13, + 25, + 28, + 25, + 26, + 19, + 20, + 28, + 40, + 13, + 26, + 44, + 33, + 26, + 28, + 28, + 36, + 32, + 38, + 43, + 10, + 18, + 28, + 40, + 31, + 17, + 12, + 36, + 30, + 38, + 14, + 37, + 47, + 18, + 20, + 5, + 16, + 46, + 37, + 12, + 48, + 10, + 25, + 29, + 16, + 29, + 31, + 15, + 35, + 14, + 36, + 12, + 56, + 31, + 20, + 35, + 26, + 50, + 19 + ], + "weighted_loads": [ + 3.0246233101934195, + 0.33484131866134703, + 1.7099625281989574, + 1.761327862739563, + 0.6685015335679054, + 0.5294098630547523, + 2.0394895300269127, + 1.815284848678857, + 1.9931991365738213, + 1.0683597512543201, + 1.0059859938919544, + 1.4304991532117128, + 2.342902220785618, + 3.18227718770504, + 0.6115350648760796, + 3.40621589217335, + 3.815587282180786, + 2.135199423879385, + 1.984720129519701, + 1.5585482558235526, + 1.2735597779974341, + 2.905204501003027, + 2.5570178292691708, + 2.723086103796959, + 3.499494507908821, + 0.8212011381983757, + 0.9514313228428364, + 2.82845027372241, + 3.3107143696397543, + 2.3269459884613752, + 1.247422531247139, + 0.6510576587170362, + 2.2033452354371548, + 2.047848302870989, + 2.794758914038539, + 1.0424254518002272, + 2.420594112947583, + 3.4650705214589834, + 1.5873602889478207, + 1.584850799292326, + 0.22097137197852135, + 1.320271834731102, + 3.813134480267763, + 2.9543427415192127, + 0.5789570789784193, + 3.88273036852479, + 0.6433325633406639, + 0.8628503829240799, + 2.785578077659011, + 0.8748590257018805, + 2.2510556783527136, + 2.378573402762413, + 1.2350483238697052, + 2.604466240853071, + 0.730933538172394, + 2.2129125744104385, + 0.754145123064518, + 4.20251583494246, + 2.412809196859598, + 1.2124860621988773, + 2.892073344439268, + 1.694604204967618, + 3.5046209041029215, + 2.5943769328296185 + ], + "unique_experts": 64, + "load_cv": 0.4253246333461161, + "normalized_load_entropy": 0.977427690431303, + "max_load_share": 0.03218390804597701 + } + }, + "s0_x": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "24bae70628c90fb2272182eae5cc5cf865c81bf8d29062d62bf35f5ed7aaf0bf", + "route_weight_sha256": "4a36c35580bbb4e7adfa224b223a78879f2ba7b820c7e44bbab0ec26908e0636", + "loads": [ + 42, + 8, + 22, + 25, + 10, + 7, + 18, + 24, + 25, + 22, + 6, + 17, + 24, + 41, + 12, + 13, + 41, + 21, + 16, + 16, + 26, + 36, + 31, + 37, + 43, + 3, + 16, + 26, + 38, + 30, + 17, + 13, + 40, + 29, + 39, + 7, + 34, + 43, + 6, + 9, + 3, + 3, + 33, + 32, + 11, + 49, + 9, + 23, + 28, + 4, + 18, + 30, + 12, + 24, + 10, + 27, + 13, + 54, + 30, + 21, + 34, + 27, + 50, + 16 + ], + "weighted_loads": [ + 3.035074492916465, + 0.28817202523350716, + 1.5843385476619005, + 1.3781626764684916, + 0.5936842299997807, + 0.3060465659946203, + 1.0563428178429604, + 1.648734049871564, + 2.0481164697557688, + 0.9121705461293459, + 0.20218621380627155, + 1.0553027354180813, + 1.9941038750112057, + 3.2010511197149754, + 0.570309104397893, + 0.9109227042645216, + 3.5783508643507957, + 1.3779334425926208, + 0.7594956420361996, + 0.6631660293787718, + 1.2145789973437786, + 2.9016016609966755, + 2.4820854030549526, + 2.6430797949433327, + 3.4691486842930317, + 0.14761163666844368, + 0.9029755871742964, + 2.6220643408596516, + 3.218553563579917, + 2.311210887506604, + 1.2285975813865662, + 0.6645095311105251, + 2.2464842312037945, + 1.9899056497961283, + 2.8702508732676506, + 0.39419048838317394, + 2.2686494160443544, + 3.2271688580513, + 0.2286715153604746, + 0.5493419468402863, + 0.13554398715496063, + 0.10178877785801888, + 2.9742907360196114, + 2.631426177918911, + 0.5066699683666229, + 3.932673651725054, + 0.6006212718784809, + 0.8112113047391176, + 2.7056743279099464, + 0.1237251590937376, + 1.1133295819163322, + 2.30793097615242, + 0.49811794608831406, + 1.7506426945328712, + 0.6284397430717945, + 1.707212422043085, + 0.781288705766201, + 4.05201418697834, + 2.353172890841961, + 1.2144847847521305, + 2.8530128709971905, + 1.7189869359135628, + 3.468403998762369, + 1.4049762971699238 + ], + "unique_experts": 64, + "load_cv": 0.553341501945535, + "normalized_load_entropy": 0.960668359026355, + "max_load_share": 0.03614457831325301 + }, + "full_input": { + "tokens": 274, + "top_k": 6, + "decisions": 1644, + "ordered_route_sha256": "d48546c10d1d3b15cbe0a3d74c2efd90862ca823fda725f2e3b41f2ee751e91f", + "route_weight_sha256": "573769ec73a488da8393f30c9caab1ddd7ec29bb05f519faefb5e6101fdfa74e", + "loads": [ + 42, + 9, + 22, + 25, + 10, + 9, + 19, + 26, + 26, + 22, + 17, + 17, + 27, + 41, + 12, + 26, + 43, + 27, + 25, + 17, + 27, + 36, + 31, + 37, + 43, + 12, + 16, + 26, + 38, + 30, + 17, + 14, + 40, + 29, + 39, + 12, + 34, + 43, + 16, + 16, + 9, + 11, + 41, + 34, + 12, + 49, + 9, + 24, + 28, + 7, + 26, + 30, + 13, + 34, + 12, + 38, + 13, + 54, + 30, + 22, + 34, + 28, + 50, + 18 + ], + "weighted_loads": [ + 3.035074492916465, + 0.29166734707541764, + 1.5843385476619005, + 1.3781626764684916, + 0.5936842299997807, + 0.37419710122048855, + 1.0882813483476639, + 1.694190421840176, + 2.051461753901094, + 0.9121705461293459, + 0.8939458187669516, + 1.0553027354180813, + 2.2110422626137733, + 3.2010511197149754, + 0.570309104397893, + 3.128616111818701, + 3.7214532643556595, + 1.6775785759091377, + 1.6865210086107254, + 0.6762079047039151, + 1.2271268451586366, + 2.9016016609966755, + 2.4820854030549526, + 2.6430797949433327, + 3.4691486842930317, + 1.13478596881032, + 0.9029755871742964, + 2.6220643408596516, + 3.218553563579917, + 2.311210887506604, + 1.2285975813865662, + 0.7052528969943523, + 2.2464842312037945, + 1.9899056497961283, + 2.8702508732676506, + 0.8194713462144136, + 2.2686494160443544, + 3.2271688580513, + 1.1698869112879038, + 1.230403445661068, + 0.42662283033132553, + 0.9087892733514309, + 3.4329881332814693, + 2.725686192512512, + 0.5877106115221977, + 3.932673651725054, + 0.6006212718784809, + 0.8268064055591822, + 2.7056743279099464, + 0.27068970538675785, + 1.7791657373309135, + 2.30793097615242, + 1.1640148982405663, + 2.408778015524149, + 0.6433955293614417, + 2.523110307753086, + 0.781288705766201, + 4.05201418697834, + 2.353172890841961, + 1.260423008352518, + 2.8530128709971905, + 1.757588867098093, + 3.468403998762369, + 2.3414497561752796 + ], + "unique_experts": 64, + "load_cv": 0.4598411409261478, + "normalized_load_entropy": 0.9739402660999291, + "max_load_share": 0.032846715328467155 + } + }, + "s1_x": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "ea27baf45d024e1bf69a0b5c996e257e11eda3e330dcb3fd25d1aae6d02a0db3", + "route_weight_sha256": "f8331cfa22c30cbcfbd79e5bbd4e90b7c9213375accb9a60ca54c8c3981c55f4", + "loads": [ + 42, + 10, + 23, + 24, + 12, + 9, + 18, + 24, + 26, + 26, + 7, + 17, + 22, + 40, + 13, + 13, + 40, + 22, + 11, + 18, + 28, + 36, + 30, + 38, + 43, + 2, + 18, + 27, + 38, + 28, + 18, + 11, + 36, + 29, + 37, + 8, + 35, + 43, + 5, + 9, + 2, + 3, + 33, + 31, + 11, + 49, + 10, + 20, + 28, + 3, + 18, + 31, + 13, + 26, + 12, + 25, + 12, + 56, + 30, + 21, + 34, + 26, + 49, + 15 + ], + "weighted_loads": [ + 3.024562342092395, + 0.3493412844836712, + 1.632328100502491, + 1.355640135705471, + 0.6692088507115841, + 0.3941056430339813, + 1.0975448712706566, + 1.6478092912584543, + 2.0256531815975904, + 1.079696038737893, + 0.24243801645934582, + 1.0830454714596272, + 1.8602738827466965, + 3.210803486406803, + 0.6161947622895241, + 1.002806043252349, + 3.5968428924679756, + 1.4375872686505318, + 0.5263653285801411, + 0.7368280682712793, + 1.284031093120575, + 2.93045187368989, + 2.480886545032263, + 2.727390628308058, + 3.50182550214231, + 0.10519246384501457, + 0.942746814340353, + 2.6676276735961437, + 3.210660954937339, + 2.1888311989605427, + 1.251587614417076, + 0.6202657949179411, + 2.1138984095305204, + 1.9904122687876225, + 2.755325658246875, + 0.44205318950116634, + 2.347104901447892, + 3.2563932351768017, + 0.19581346586346626, + 0.4661172069609165, + 0.09322958439588547, + 0.09673121571540833, + 2.915679059922695, + 2.621696352958679, + 0.5295864604413509, + 3.9371456280350685, + 0.6461096219718456, + 0.7143464218825102, + 2.74082600325346, + 0.09178073704242706, + 1.127284960821271, + 2.3402847833931446, + 0.5227041654288769, + 1.8639682680368423, + 0.7013352364301682, + 1.5638933628797531, + 0.7465693615376949, + 4.203362246975303, + 2.361696867272258, + 1.2260117754340172, + 2.8679641485214233, + 1.669527605175972, + 3.4686621576547623, + 1.4412491768598557 + ], + "unique_experts": 64, + "load_cv": 0.5478735342380433, + "normalized_load_entropy": 0.9610937770209906, + "max_load_share": 0.03748326639892905 + }, + "full_input": { + "tokens": 290, + "top_k": 6, + "decisions": 1740, + "ordered_route_sha256": "1a7222f4ec8e344ac531fd65f5144d0f1960295b9570e26f2fb2853734d3eb91", + "route_weight_sha256": "c9234db8cbb00ba2f65c120fd495f0e4c75a5960e271bcb51293b2954da0fdbc", + "loads": [ + 43, + 12, + 23, + 30, + 12, + 11, + 26, + 27, + 27, + 26, + 21, + 20, + 27, + 40, + 14, + 28, + 44, + 33, + 24, + 28, + 29, + 36, + 31, + 38, + 44, + 11, + 18, + 29, + 38, + 30, + 18, + 12, + 37, + 31, + 38, + 14, + 36, + 46, + 16, + 20, + 6, + 15, + 45, + 36, + 12, + 49, + 10, + 22, + 28, + 16, + 27, + 32, + 14, + 38, + 15, + 36, + 12, + 56, + 31, + 22, + 35, + 27, + 49, + 19 + ], + "weighted_loads": [ + 3.0611105505377054, + 0.3734949959907681, + 1.632328100502491, + 1.7703101113438606, + 0.6692088507115841, + 0.46848709881305695, + 2.0800838954746723, + 1.7449630671180785, + 2.0290172402746975, + 1.079696038737893, + 1.132873434573412, + 1.4491140805184841, + 2.3221763484179974, + 3.210803486406803, + 0.6490348763763905, + 3.7335835518315434, + 3.8768542371690273, + 2.115324515849352, + 1.7729137539863586, + 1.577940379269421, + 1.296578940935433, + 2.93045187368989, + 2.5190235413610935, + 2.727390628308058, + 3.577551795169711, + 0.8989636898040771, + 0.942746814340353, + 2.8404551409184933, + 3.210660954937339, + 2.275408074259758, + 1.251587614417076, + 0.6676393020898104, + 2.233670538291335, + 2.0766025967895985, + 2.7899546790868044, + 1.03470522724092, + 2.392039930447936, + 3.4095335453748703, + 1.250301256775856, + 1.595185786485672, + 0.29474448412656784, + 1.2356814965605736, + 3.67265048250556, + 2.9131570234894753, + 0.5915345475077629, + 3.9371456280350685, + 0.6461096219718456, + 0.7628516238182783, + 2.74082600325346, + 0.8779590092599392, + 2.150902459397912, + 2.3884800896048546, + 1.188601117581129, + 2.7863297276198864, + 0.7540487837977707, + 2.2740009035915136, + 0.7465693615376949, + 4.203362246975303, + 2.431738955900073, + 1.272979248315096, + 2.9137483164668083, + 1.7102297693490982, + 3.4686621576547623, + 2.618035390973091 + ], + "unique_experts": 64, + "load_cv": 0.42253223767512965, + "normalized_load_entropy": 0.9778083134475677, + "max_load_share": 0.03218390804597701 + } + }, + "s0_period": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "5e00ecb04bde8c4612cdb664733b2f38d0db333b22585264d9a2ac665096d9f0", + "route_weight_sha256": "b8eddbcb6e391f6dcd8879276b1aed0cb944f8a7476316d77de6d7e56e5610f3", + "loads": [ + 43, + 8, + 23, + 25, + 10, + 7, + 18, + 23, + 24, + 24, + 6, + 17, + 22, + 41, + 11, + 13, + 41, + 21, + 14, + 16, + 26, + 36, + 31, + 37, + 43, + 3, + 17, + 26, + 38, + 30, + 17, + 13, + 38, + 28, + 39, + 7, + 34, + 43, + 5, + 9, + 3, + 4, + 32, + 32, + 11, + 49, + 9, + 22, + 27, + 5, + 19, + 30, + 16, + 25, + 10, + 27, + 13, + 55, + 31, + 20, + 34, + 27, + 50, + 16 + ], + "weighted_loads": [ + 3.0505662877112627, + 0.2846043184399605, + 1.6159249879419804, + 1.387394180521369, + 0.5946402307599783, + 0.3072134852409363, + 1.0528497733175755, + 1.6024847589433193, + 2.0047602243721485, + 0.9756101761013269, + 0.20122724026441574, + 1.0440858416259289, + 1.8982568681240082, + 3.1867626644670963, + 0.5330563820898533, + 0.9007972814142704, + 3.5854273661971092, + 1.3637052066624165, + 0.6764597296714783, + 0.6680758129805326, + 1.2107452787458897, + 2.9227171167731285, + 2.4780012667179108, + 2.639488087967038, + 3.4950136095285416, + 0.14784332364797592, + 0.9352239146828651, + 2.6204879004508257, + 3.223595757037401, + 2.3317493684589863, + 1.2352576106786728, + 0.6783684976398945, + 2.198874732479453, + 1.9636333286762238, + 2.8660606872290373, + 0.3881692737340927, + 2.2824734784662724, + 3.2327419947832823, + 0.2005426436662674, + 0.5530398488044739, + 0.135921660810709, + 0.13663575798273087, + 2.9147140197455883, + 2.6420335099101067, + 0.5043295715004206, + 3.9323555752635, + 0.5974720604717731, + 0.7765400931239128, + 2.67668342217803, + 0.16999131999909878, + 1.1147737614810467, + 2.2939982656389475, + 0.6216501370072365, + 1.78800742700696, + 0.6274279579520226, + 1.7029723599553108, + 0.7767594438046217, + 4.0586366429924965, + 2.3910964019596577, + 1.1808132901787758, + 2.8469799496233463, + 1.7287626955658197, + 3.4746386222541332, + 1.400667693465948 + ], + "unique_experts": 64, + "load_cv": 0.5517327873807533, + "normalized_load_entropy": 0.9611558973782617, + "max_load_share": 0.03681392235609103 + }, + "full_input": { + "tokens": 274, + "top_k": 6, + "decisions": 1644, + "ordered_route_sha256": "e635923bca0bf6018dca68d7e6a9a582a78dab0307afc976b0760819f929e27d", + "route_weight_sha256": "ed0e8c45cf75bb175962100f2c8f46b28f46dc8c6df4b72054a6b034169593fa", + "loads": [ + 43, + 9, + 23, + 25, + 10, + 9, + 19, + 25, + 25, + 24, + 17, + 17, + 25, + 41, + 11, + 26, + 44, + 28, + 23, + 17, + 27, + 36, + 31, + 37, + 43, + 11, + 17, + 26, + 38, + 30, + 17, + 14, + 38, + 28, + 39, + 13, + 34, + 43, + 15, + 16, + 8, + 12, + 39, + 34, + 13, + 49, + 9, + 23, + 27, + 9, + 27, + 30, + 17, + 33, + 12, + 38, + 13, + 55, + 31, + 21, + 34, + 28, + 50, + 18 + ], + "weighted_loads": [ + 3.0505662877112627, + 0.28809964028187096, + 1.6159249879419804, + 1.387394180521369, + 0.5946402307599783, + 0.3753640204668045, + 1.084788303822279, + 1.6482181882020086, + 2.008105508517474, + 0.9756101761013269, + 0.8916398473083973, + 1.0440858416259289, + 2.110789690166712, + 3.1867626644670963, + 0.5330563820898533, + 2.9520508353598416, + 3.7671040184795856, + 1.7200822532176971, + 1.5484739616513252, + 0.681117688305676, + 1.2232931265607476, + 2.9227171167731285, + 2.4780012667179108, + 2.639488087967038, + 3.4950136095285416, + 1.0487551465630531, + 0.9352239146828651, + 2.6204879004508257, + 3.223595757037401, + 2.3317493684589863, + 1.2352576106786728, + 0.7264661490917206, + 2.198874732479453, + 1.9636333286762238, + 2.8660606872290373, + 0.8690331131219864, + 2.2824734784662724, + 3.2327419947832823, + 1.1041479334235191, + 1.231081336736679, + 0.36920076608657837, + 0.9775655642151833, + 3.3448610492050648, + 2.7315295189619064, + 0.640658600255847, + 3.9323555752635, + 0.5974720604717731, + 0.7921351939439774, + 2.67668342217803, + 0.3541351240128279, + 1.7898177579045296, + 2.2939982656389475, + 1.2875470891594887, + 2.332776077091694, + 0.6423837442416698, + 2.6464262530207634, + 0.7767594438046217, + 4.0586366429924965, + 2.3910964019596577, + 1.2267515137791634, + 2.8469799496233463, + 1.7668892424553633, + 3.4746386222541332, + 2.337141152471304 + ], + "unique_experts": 64, + "load_cv": 0.45632601784698423, + "normalized_load_entropy": 0.9745303196899479, + "max_load_share": 0.03345498783454988 + } + }, + "s1_period": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "7ec7bd0224fd5cf53558c7d1051ac5a4e9b792d46bb518d992b6cc80a98fea40", + "route_weight_sha256": "7d0e8418c98257fe1f062e535889b3548680c8727fc5d6c5f0c229c984f0f764", + "loads": [ + 41, + 10, + 25, + 25, + 12, + 9, + 18, + 24, + 25, + 28, + 7, + 17, + 22, + 40, + 13, + 12, + 40, + 23, + 11, + 17, + 27, + 37, + 30, + 38, + 43, + 2, + 18, + 26, + 38, + 28, + 18, + 11, + 36, + 29, + 37, + 9, + 35, + 43, + 5, + 9, + 2, + 3, + 33, + 32, + 11, + 49, + 9, + 19, + 28, + 3, + 18, + 31, + 13, + 26, + 12, + 24, + 12, + 55, + 31, + 21, + 34, + 26, + 49, + 15 + ], + "weighted_loads": [ + 2.985870411619544, + 0.34761448949575424, + 1.711112754419446, + 1.3961390610784292, + 0.6663809474557638, + 0.39812108129262924, + 1.0871946457773447, + 1.670107489451766, + 1.991830512881279, + 1.142742995172739, + 0.24061593413352966, + 1.07631372846663, + 1.8523916713893414, + 3.2185289226472378, + 0.6166128925979137, + 0.9271405413746834, + 3.5874249041080475, + 1.4879338145256042, + 0.5235828571021557, + 0.7024980057030916, + 1.2418940719217062, + 2.991241868585348, + 2.48218534886837, + 2.7329031005501747, + 3.5143652576953173, + 0.10598034039139748, + 0.954530281946063, + 2.6181207187473774, + 3.2267286125570536, + 2.192757638171315, + 1.2649369817227125, + 0.6467105075716972, + 2.112832060083747, + 1.9976744055747986, + 2.7513789609074593, + 0.46411523781716824, + 2.356007494032383, + 3.263210278004408, + 0.19098930805921555, + 0.45892782509326935, + 0.09477963671088219, + 0.09667165391147137, + 2.925836533308029, + 2.6766518391668797, + 0.522429458796978, + 3.9332056157290936, + 0.6047893576323986, + 0.6780812535434961, + 2.7516909893602133, + 0.09039784409105778, + 1.1013303343206644, + 2.3390552904456854, + 0.5254345219582319, + 1.8712647147476673, + 0.7032912876456976, + 1.532454827800393, + 0.7463072575628757, + 4.146051621064544, + 2.397279106080532, + 1.2192627601325512, + 2.868654239922762, + 1.6776028219610453, + 3.4672045838087797, + 1.4406264312565327 + ], + "unique_experts": 64, + "load_cv": 0.5476641512252476, + "normalized_load_entropy": 0.96101587332406, + "max_load_share": 0.03681392235609103 + }, + "full_input": { + "tokens": 290, + "top_k": 6, + "decisions": 1740, + "ordered_route_sha256": "b9a2559fc898436b0324d19cad050f5200f18a86fa1fa06929656c7d82712b91", + "route_weight_sha256": "924862e7633a8e1a6cb575b94f1e257de8a286d4e851d442e09a831ddc3ef6e2", + "loads": [ + 42, + 12, + 25, + 31, + 12, + 11, + 26, + 27, + 26, + 28, + 21, + 20, + 27, + 40, + 14, + 28, + 44, + 35, + 24, + 27, + 28, + 37, + 31, + 38, + 44, + 10, + 18, + 28, + 38, + 30, + 18, + 12, + 37, + 30, + 38, + 15, + 36, + 46, + 16, + 20, + 6, + 16, + 45, + 37, + 13, + 49, + 9, + 21, + 28, + 16, + 27, + 32, + 14, + 36, + 15, + 35, + 12, + 55, + 32, + 22, + 35, + 27, + 49, + 19 + ], + "weighted_loads": [ + 3.0224186200648546, + 0.37176820100285113, + 1.711112754419446, + 1.8108090367168188, + 0.6663809474557638, + 0.47250253707170486, + 2.0697336699813604, + 1.7675914005376399, + 1.995194571558386, + 1.142742995172739, + 1.1431450974196196, + 1.442382337525487, + 2.313530921936035, + 3.2185289226472378, + 0.6494530066847801, + 3.5235247565433383, + 3.8888521268963814, + 2.2076708301901817, + 1.725258432328701, + 1.5436103167012334, + 1.2544419197365642, + 2.991241868585348, + 2.5203223451972008, + 2.7329031005501747, + 3.5900915507227182, + 0.8218896239995956, + 0.954530281946063, + 2.790948186069727, + 3.2267286125570536, + 2.2793345134705305, + 1.2649369817227125, + 0.6996500603854656, + 2.2326041888445616, + 2.0403434187173843, + 2.786007981747389, + 1.0961503516882658, + 2.400942523032427, + 3.4163505882024765, + 1.2073202691972256, + 1.5770435892045498, + 0.27360618859529495, + 1.3501188214868307, + 3.7078020684421062, + 2.9645939469337463, + 0.6300969496369362, + 3.9332056157290936, + 0.6047893576323986, + 0.7265864554792643, + 2.7516909893602133, + 0.8731554765254259, + 2.126663686707616, + 2.3872505966573954, + 1.1913314741104841, + 2.6807521916925907, + 0.7560048350133002, + 2.3263707235455513, + 0.7463072575628757, + 4.146051621064544, + 2.4673211947083473, + 1.26623023301363, + 2.914438407868147, + 1.7193074505776167, + 3.4672045838087797, + 2.617412645369768 + ], + "unique_experts": 64, + "load_cv": 0.42037548723830415, + "normalized_load_entropy": 0.9779373669391506, + "max_load_share": 0.031609195402298854 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 249, + "ordered_topk_exact_tokens": 208, + "set_exact_tokens": 232, + "mean_set_jaccard": 0.9804934021801492, + "mean_token_weighted_tv": 0.0052827059377328935, + "aggregate_load_tv": 0.007362784471218203 + }, + "system_bos": { + "tokens": 249, + "ordered_topk_exact_tokens": 168, + "set_exact_tokens": 200, + "mean_set_jaccard": 0.9429145152036719, + "mean_token_weighted_tv": 0.013166742182400331, + "aggregate_load_tv": 0.020080321285140562 + }, + "system_x": { + "tokens": 249, + "ordered_topk_exact_tokens": 169, + "set_exact_tokens": 196, + "mean_set_jaccard": 0.9391853126792885, + "mean_token_weighted_tv": 0.01449161450038234, + "aggregate_load_tv": 0.023427041499330663 + }, + "system_period": { + "tokens": 249, + "ordered_topk_exact_tokens": 168, + "set_exact_tokens": 194, + "mean_set_jaccard": 0.936029833620195, + "mean_token_weighted_tv": 0.014949421607795728, + "aggregate_load_tv": 0.02409638554216868 + }, + "bos_at_s0": { + "tokens": 249, + "ordered_topk_exact_tokens": 153, + "set_exact_tokens": 180, + "mean_set_jaccard": 0.9191049913941479, + "mean_token_weighted_tv": 0.018446108457224674, + "aggregate_load_tv": 0.02543507362784471 + }, + "bos_at_s1": { + "tokens": 249, + "ordered_topk_exact_tokens": 152, + "set_exact_tokens": 188, + "mean_set_jaccard": 0.9291451520367182, + "mean_token_weighted_tv": 0.018766603481219, + "aggregate_load_tv": 0.02811244979919679 + }, + "x_at_s0": { + "tokens": 249, + "ordered_topk_exact_tokens": 154, + "set_exact_tokens": 189, + "mean_set_jaccard": 0.9294320137693632, + "mean_token_weighted_tv": 0.017041016332655548, + "aggregate_load_tv": 0.024096385542168676 + }, + "x_at_s1": { + "tokens": 249, + "ordered_topk_exact_tokens": 149, + "set_exact_tokens": 177, + "mean_set_jaccard": 0.9139414802065404, + "mean_token_weighted_tv": 0.020835305025509322, + "aggregate_load_tv": 0.02610441767068273 + }, + "period_at_s0": { + "tokens": 249, + "ordered_topk_exact_tokens": 147, + "set_exact_tokens": 182, + "mean_set_jaccard": 0.9205393000573724, + "mean_token_weighted_tv": 0.01811231525771948, + "aggregate_load_tv": 0.026104417670682733 + }, + "period_at_s1": { + "tokens": 249, + "ordered_topk_exact_tokens": 150, + "set_exact_tokens": 177, + "mean_set_jaccard": 0.9139414802065404, + "mean_token_weighted_tv": 0.020845127411665446, + "aggregate_load_tv": 0.02677376171352075 + } + } + }, + "layer_06": { + "layer": 6, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "80a7cbd7f149ff6f2a47f188f35494c527ee02bb778994803420e0113e0c2bfa", + "route_weight_sha256": "edb5d5994ffd7c4b9c125b8d44d2376cc1b2aeb0e0ffadf8ba7b3fc757d89b6d", + "loads": [ + 37, + 15, + 23, + 45, + 1, + 34, + 5, + 40, + 30, + 37, + 28, + 16, + 28, + 22, + 1, + 12, + 23, + 5, + 37, + 13, + 28, + 38, + 15, + 7, + 7, + 23, + 31, + 44, + 13, + 6, + 38, + 31, + 7, + 1, + 36, + 5, + 36, + 16, + 39, + 2, + 39, + 23, + 5, + 44, + 34, + 18, + 5, + 20, + 9, + 37, + 21, + 0, + 43, + 25, + 33, + 16, + 17, + 26, + 21, + 12, + 47, + 8, + 91, + 25 + ], + "weighted_loads": [ + 1.7233340702950954, + 0.6368373148143291, + 1.3603184502571821, + 2.902428699657321, + 0.03732641041278839, + 2.8762741833925247, + 0.4012112729251385, + 2.1965040490031242, + 2.637138716876507, + 2.419835241511464, + 2.4467746652662754, + 0.9798619784414768, + 2.296221252530813, + 1.1346718315035105, + 0.031775955110788345, + 0.6272445879876614, + 1.7749245762825012, + 0.3040980137884617, + 3.212652377784252, + 0.9251905530691147, + 1.9837924875319004, + 3.374928206205368, + 0.6230526268482208, + 0.30159706622362137, + 0.3356761373579502, + 1.2236495222896338, + 1.3438103925436735, + 4.281993679702282, + 0.7991246376186609, + 0.2653060220181942, + 2.0318095795810223, + 1.8084197454154491, + 0.2909755650907755, + 0.030254770070314407, + 3.1494103614240885, + 0.1944611556828022, + 3.075285393744707, + 0.9858205057680607, + 3.0686907209455967, + 0.061921512708067894, + 2.714621514081955, + 1.7125046327710152, + 0.2676522694528103, + 3.0706379171460867, + 2.120777055621147, + 0.7063437569886446, + 0.21441907435655594, + 0.7505130246281624, + 0.40588073804974556, + 3.003082625567913, + 1.5416716486215591, + 0.0, + 2.872673235833645, + 1.685083068907261, + 1.8728288859128952, + 1.2079196516424417, + 1.1464313305914402, + 2.00524440780282, + 1.1351304575800896, + 0.8221877925097942, + 2.976176058873534, + 0.3354173079133034, + 7.502920266240835, + 1.6341554149985313 + ], + "unique_experts": 63, + "load_cv": 0.6827768575250642, + "normalized_load_entropy": 0.9414945776706247, + "max_load_share": 0.06091030789825971 + }, + "full_input": { + "tokens": 274, + "top_k": 6, + "decisions": 1644, + "ordered_route_sha256": "fe54d33587244850797e6b33a4ee057cb74f22c619a04e7e899ac10aa9bdaa73", + "route_weight_sha256": "d4b099ce940c80e9556194d444db3b554f1b7dcfa5df4d50713ae341ac2a54a5", + "loads": [ + 37, + 18, + 23, + 45, + 2, + 34, + 13, + 40, + 30, + 37, + 28, + 22, + 28, + 24, + 3, + 12, + 28, + 6, + 37, + 21, + 29, + 41, + 17, + 8, + 7, + 24, + 31, + 44, + 13, + 9, + 38, + 31, + 10, + 1, + 37, + 10, + 36, + 26, + 39, + 11, + 40, + 28, + 7, + 44, + 34, + 23, + 18, + 22, + 13, + 37, + 28, + 7, + 43, + 25, + 33, + 26, + 27, + 26, + 21, + 21, + 47, + 8, + 91, + 25 + ], + "weighted_loads": [ + 1.7233340702950954, + 0.7079925038851798, + 1.3603184502571821, + 2.902428699657321, + 0.06585683673620224, + 2.8762741833925247, + 1.3110795803368092, + 2.1965040490031242, + 2.637138716876507, + 2.419835241511464, + 2.4467746652662754, + 1.3853727225214243, + 2.296221252530813, + 1.1626767758280039, + 0.17967206612229347, + 0.6272445879876614, + 2.104102749377489, + 0.30812887381762266, + 3.212652377784252, + 1.4791595563292503, + 2.027582224458456, + 3.525726964697242, + 2.1173616349697113, + 0.3373545706272125, + 0.3356761373579502, + 1.2512871772050858, + 1.3438103925436735, + 4.281993679702282, + 0.7991246376186609, + 0.44480520114302635, + 2.0318095795810223, + 1.8084197454154491, + 0.3793254438787699, + 0.030254770070314407, + 3.1836537178605795, + 0.6508450470864773, + 3.075285393744707, + 1.8315051682293415, + 3.0686907209455967, + 0.42718726210296154, + 2.769078504294157, + 2.1095072105526924, + 0.3256626669317484, + 3.0706379171460867, + 2.120777055621147, + 0.8410647958517075, + 1.610225349664688, + 0.7728515935596079, + 0.5987564940005541, + 3.003082625567913, + 2.065827026963234, + 0.30541329458355904, + 2.872673235833645, + 1.685083068907261, + 1.8728288859128952, + 1.9692535977810621, + 2.29636524990201, + 2.00524440780282, + 1.1351304575800896, + 1.7823593690991402, + 2.976176058873534, + 0.3354173079133034, + 7.502920266240835, + 1.6341554149985313 + ], + "unique_experts": 64, + "load_cv": 0.5716415434025531, + "normalized_load_entropy": 0.9600232292630199, + "max_load_share": 0.05535279805352798 + } + }, + "s1_eos": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "df9c7c8904de80327021975ca301fac5a8746fac4ab9c0c41bc4dc5b147c62ee", + "route_weight_sha256": "c79c23bb48b4727c8fe7a03f9eb30ab4366ef6c1558452a2dd0c4aa4758db10f", + "loads": [ + 36, + 15, + 22, + 45, + 1, + 35, + 5, + 38, + 31, + 35, + 28, + 16, + 28, + 22, + 1, + 13, + 23, + 5, + 37, + 13, + 28, + 38, + 12, + 9, + 7, + 22, + 34, + 44, + 12, + 6, + 38, + 32, + 9, + 1, + 34, + 5, + 37, + 17, + 38, + 4, + 40, + 23, + 6, + 44, + 35, + 16, + 5, + 21, + 9, + 37, + 21, + 0, + 41, + 27, + 33, + 16, + 14, + 26, + 21, + 12, + 47, + 8, + 91, + 25 + ], + "weighted_loads": [ + 1.6877864431589842, + 0.6438059192150831, + 1.3212891928851604, + 2.9315168857574463, + 0.037557266652584076, + 2.8828112613409758, + 0.4244689866900444, + 2.1248165015131235, + 2.6695110090076923, + 2.3041710909456015, + 2.443356864154339, + 0.9825609177350998, + 2.3077490404248238, + 1.1235188767313957, + 0.03188779577612877, + 0.6725162845104933, + 1.7627547681331635, + 0.2948768585920334, + 3.210313096642494, + 0.9216726943850517, + 1.9757256545126438, + 3.3699717670679092, + 0.5140186473727226, + 0.36776338517665863, + 0.3371676318347454, + 1.1942999344319105, + 1.4622351191937923, + 4.2685721181333065, + 0.7611303832381964, + 0.2664668932557106, + 2.012264536693692, + 1.843968115746975, + 0.35606936179101467, + 0.03168954700231552, + 3.0827196650207043, + 0.191000085324049, + 3.1134452000260353, + 0.9903618395328522, + 3.019019555300474, + 0.13755368441343307, + 2.7341119907796383, + 1.7007651701569557, + 0.3063473589718342, + 3.065616510808468, + 2.142540406435728, + 0.6336724255234003, + 0.2127982433885336, + 0.7917397506535053, + 0.40043349750339985, + 3.017114393413067, + 1.5012065395712852, + 0.0, + 2.8050941564142704, + 1.7763372212648392, + 1.89438446611166, + 1.2277391217648983, + 0.9796747267246246, + 1.9980249777436256, + 1.1390853207558393, + 0.8239621222019196, + 2.9798443019390106, + 0.33345159888267517, + 7.513439720496535, + 1.632221819832921 + ], + "unique_experts": 63, + "load_cv": 0.6782262076026225, + "normalized_load_entropy": 0.9427925101743202, + "max_load_share": 0.06091030789825971 + }, + "full_input": { + "tokens": 290, + "top_k": 6, + "decisions": 1740, + "ordered_route_sha256": "167bb2ea731124a6bc138eca9cbf6914d208ed3695b6ff9d1d6629a27d5722bf", + "route_weight_sha256": "5696cf156091e97495ba66c5e8c7adc68e9e427982328173cc6ed09d776da66b", + "loads": [ + 36, + 17, + 25, + 46, + 3, + 35, + 20, + 39, + 36, + 41, + 28, + 26, + 32, + 24, + 10, + 14, + 32, + 6, + 39, + 23, + 30, + 42, + 14, + 10, + 8, + 24, + 34, + 45, + 13, + 9, + 38, + 35, + 15, + 2, + 38, + 12, + 38, + 35, + 38, + 13, + 41, + 29, + 8, + 44, + 36, + 20, + 21, + 23, + 12, + 37, + 29, + 6, + 42, + 30, + 33, + 27, + 31, + 26, + 21, + 23, + 52, + 8, + 91, + 25 + ], + "weighted_loads": [ + 1.6877864431589842, + 0.6833985550329089, + 1.4642197415232658, + 2.968743398785591, + 0.1885539200156927, + 2.8828112613409758, + 1.7547484524548054, + 2.186561832204461, + 3.0071534998714924, + 3.008934436365962, + 2.443356864154339, + 1.6646958403289318, + 2.6386641152203083, + 1.151799997780472, + 0.7107771784067154, + 0.7836340572685003, + 2.474429152905941, + 0.2989365695975721, + 3.3577449955046177, + 1.6719261147081852, + 2.0678947046399117, + 3.599290395155549, + 2.0062534138560295, + 0.4030817411839962, + 0.3698025047779083, + 1.2721052821725607, + 1.4622351191937923, + 4.2951879519969225, + 0.7974359076470137, + 0.4658438190817833, + 2.012264536693692, + 2.044745735824108, + 0.5411917120218277, + 0.06567884981632233, + 3.34087773039937, + 0.862828403711319, + 3.147682387381792, + 2.3762598372995853, + 3.019019555300474, + 0.6106384471058846, + 2.790995270013809, + 2.138780891895294, + 0.3643472623080015, + 3.065616510808468, + 2.2267383746802807, + 0.7324837434571236, + 1.907283304259181, + 0.8141200647223741, + 0.5600154493004084, + 3.017114393413067, + 2.101478610187769, + 0.23846491426229477, + 2.842247437685728, + 1.944541648030281, + 1.89438446611166, + 2.2346068285405636, + 2.70915337651968, + 1.9980249777436256, + 1.1390853207558393, + 1.8803232479840517, + 3.2446859292685986, + 0.33345159888267517, + 7.513439720496535, + 1.632221819832921 + ], + "unique_experts": 64, + "load_cv": 0.5392801629951044, + "normalized_load_entropy": 0.9644510819666883, + "max_load_share": 0.052298850574712646 + } + }, + "s0_bos": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "780054e7ad610079f8078bd989c07e6bdc7cf303adaf1b8b4f2b3ea91e3aca4a", + "route_weight_sha256": "baf7af3b2682356ba50430a1e62f50dfa9d778dc62f290b2e2248ae887f2285e", + "loads": [ + 38, + 13, + 22, + 46, + 1, + 35, + 3, + 40, + 29, + 36, + 28, + 16, + 28, + 25, + 1, + 11, + 23, + 5, + 38, + 13, + 28, + 38, + 15, + 8, + 10, + 22, + 27, + 44, + 13, + 5, + 37, + 33, + 9, + 1, + 35, + 6, + 37, + 16, + 38, + 5, + 40, + 22, + 6, + 42, + 35, + 15, + 3, + 20, + 8, + 37, + 21, + 0, + 41, + 28, + 35, + 15, + 17, + 26, + 21, + 13, + 47, + 9, + 91, + 24 + ], + "weighted_loads": [ + 1.7608955148607492, + 0.5599299054592848, + 1.3513855449855328, + 3.035253543406725, + 0.03178867697715759, + 2.9412535056471825, + 0.30071545392274857, + 2.241959258913994, + 2.661780420690775, + 2.420816332101822, + 2.488189123570919, + 0.9748359583318233, + 2.288842260837555, + 1.279421541839838, + 0.0320843830704689, + 0.5840733721852303, + 1.7727275043725967, + 0.2935272455215454, + 3.2596973590552807, + 0.9385629054158926, + 2.072219230234623, + 3.41408284381032, + 0.642743581905961, + 0.3496287986636162, + 0.4623616300523281, + 1.2099372372031212, + 1.16423630528152, + 4.320127382874489, + 0.8156043719500303, + 0.2441747523844242, + 2.029874177649617, + 1.9382822308689356, + 0.39431748539209366, + 0.02863977663218975, + 3.1637189239263535, + 0.2335442490875721, + 3.1652765050530434, + 0.9525611754506826, + 3.0198721773922443, + 0.17823348380625248, + 2.8247294016182423, + 1.6677619367837906, + 0.31005995348095894, + 2.9919277392327785, + 2.166512329131365, + 0.6050451174378395, + 0.1498260647058487, + 0.7484107054769993, + 0.3812553808093071, + 3.018022857606411, + 1.6254905797541142, + 0.0, + 2.839861735701561, + 1.8540948163717985, + 1.9707675743848085, + 1.1996195316314697, + 1.1820262409746647, + 2.070737551897764, + 1.1695072147995234, + 0.8482660762965679, + 2.992558529600501, + 0.3835854474455118, + 7.558380598202348, + 1.634120311588049 + ], + "unique_experts": 63, + "load_cv": 0.6806317309392275, + "normalized_load_entropy": 0.9421431778575807, + "max_load_share": 0.06091030789825971 + }, + "full_input": { + "tokens": 274, + "top_k": 6, + "decisions": 1644, + "ordered_route_sha256": "53785f3495133869b98af45c94199ea5fcc85cc8ffd7b1b7252536efe8541c4f", + "route_weight_sha256": "ada19863b9d4b6d966378f33460d56495052f73af62117e426ce4f76a40555dd", + "loads": [ + 38, + 15, + 22, + 46, + 2, + 35, + 11, + 40, + 29, + 36, + 28, + 22, + 28, + 26, + 4, + 12, + 29, + 5, + 38, + 21, + 29, + 41, + 16, + 9, + 10, + 23, + 27, + 44, + 13, + 9, + 37, + 33, + 12, + 1, + 36, + 11, + 37, + 27, + 38, + 14, + 41, + 27, + 8, + 42, + 35, + 19, + 17, + 21, + 12, + 37, + 28, + 7, + 41, + 28, + 35, + 25, + 27, + 26, + 21, + 22, + 47, + 9, + 91, + 24 + ], + "weighted_loads": [ + 1.7608955148607492, + 0.6263637337833643, + 1.3513855449855328, + 3.035253543406725, + 0.06031910330057144, + 2.9412535056471825, + 1.2074353694915771, + 2.241959258913994, + 2.661780420690775, + 2.420816332101822, + 2.488189123570919, + 1.39896553568542, + 2.288842260837555, + 1.3025017138570547, + 0.2246186062693596, + 0.6307653449475765, + 2.14121351018548, + 0.2935272455215454, + 3.2596973590552807, + 1.4850965272635221, + 2.1160089671611786, + 3.5668576788157225, + 1.1889476124197245, + 0.38538630306720734, + 0.4623616300523281, + 1.2375748921185732, + 1.16423630528152, + 4.320127382874489, + 0.8156043719500303, + 0.4731885977089405, + 2.029874177649617, + 1.9382822308689356, + 0.48266736418008804, + 0.02863977663218975, + 3.1979622803628445, + 0.6964192278683186, + 3.1652765050530434, + 1.8424247410148382, + 3.0198721773922443, + 0.5401450525969267, + 2.883605420589447, + 2.064764514565468, + 0.36807035095989704, + 2.9919277392327785, + 2.166512329131365, + 0.7357612028717995, + 1.7500073835253716, + 0.7675198316574097, + 0.579948453232646, + 3.018022857606411, + 2.196914717555046, + 0.30541329458355904, + 2.839861735701561, + 1.8540948163717985, + 1.9707675743848085, + 1.96095347777009, + 2.4048452116549015, + 2.070737551897764, + 1.1695072147995234, + 1.8084376528859138, + 2.992558529600501, + 0.3835854474455118, + 7.558380598202348, + 1.634120311588049 + ], + "unique_experts": 64, + "load_cv": 0.5678594432068925, + "normalized_load_entropy": 0.9610168026763832, + "max_load_share": 0.05535279805352798 + } + }, + "s1_bos": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "1169fcbe10af721cf09c681c55be656e1db1d7bf17b79882c6dca101d9070e19", + "route_weight_sha256": "a23c5afd4413e1abd69bdaff197587f085818f3a41403e5c6691c08b1305b443", + "loads": [ + 36, + 14, + 22, + 46, + 0, + 36, + 5, + 39, + 30, + 35, + 28, + 15, + 28, + 26, + 1, + 13, + 23, + 6, + 37, + 13, + 28, + 38, + 14, + 9, + 9, + 21, + 25, + 44, + 12, + 6, + 39, + 32, + 9, + 1, + 35, + 5, + 37, + 15, + 39, + 4, + 40, + 22, + 6, + 43, + 36, + 15, + 3, + 22, + 7, + 38, + 22, + 0, + 41, + 27, + 33, + 15, + 16, + 27, + 19, + 12, + 49, + 9, + 93, + 24 + ], + "weighted_loads": [ + 1.7231674287468195, + 0.5994761288166046, + 1.3232519458979368, + 3.0518037602305412, + 0.0, + 2.9464121498167515, + 0.3972602058202028, + 2.229882128536701, + 2.6914842668920755, + 2.3836232349276543, + 2.4847969822585583, + 0.9254066497087479, + 2.3147881738841534, + 1.2958379425108433, + 0.03296443819999695, + 0.6738300397992134, + 1.7822561003267765, + 0.32186026126146317, + 3.2173168919980526, + 0.9319285955280066, + 2.0596978776156902, + 3.407118234783411, + 0.5758455283939838, + 0.3612675126641989, + 0.45424680411815643, + 1.1826392337679863, + 1.083700429648161, + 4.268247090280056, + 0.7975642047822475, + 0.2759135290980339, + 2.135841915383935, + 1.9132616110146046, + 0.39427023008465767, + 0.02843567356467247, + 3.1370693184435368, + 0.1940828412771225, + 3.177966643124819, + 0.8658782113343477, + 3.0696291998028755, + 0.15159097127616405, + 2.8410965465009212, + 1.6809376366436481, + 0.305789802223444, + 2.997939720749855, + 2.191846191883087, + 0.6045678295195103, + 0.1473754122853279, + 0.8287512008100748, + 0.33523364923894405, + 3.0761268958449364, + 1.636725340038538, + 0.0, + 2.845074649900198, + 1.846639271825552, + 1.8959073908627033, + 1.189530884847045, + 1.1150098517537117, + 2.058549039065838, + 1.0864900033921003, + 0.785721380263567, + 3.0622092187404633, + 0.3879682905972004, + 7.677215596660972, + 1.615683887153864 + ], + "unique_experts": 62, + "load_cv": 0.6895465248342212, + "normalized_load_entropy": 0.9409917155335752, + "max_load_share": 0.06224899598393574 + }, + "full_input": { + "tokens": 290, + "top_k": 6, + "decisions": 1740, + "ordered_route_sha256": "153b8047101bf2168ed47d24903eccb8d45f8529daee879a9e7f684ce27629d0", + "route_weight_sha256": "ebf20f19b7d3b5003ae53d5089b70f6d660c595317ba2ae41e7090e31d2b26d1", + "loads": [ + 36, + 15, + 25, + 47, + 2, + 36, + 21, + 40, + 35, + 41, + 28, + 25, + 32, + 27, + 10, + 15, + 33, + 6, + 39, + 23, + 30, + 42, + 15, + 10, + 10, + 23, + 25, + 45, + 13, + 9, + 39, + 35, + 15, + 2, + 39, + 12, + 38, + 33, + 39, + 13, + 41, + 28, + 8, + 43, + 37, + 18, + 20, + 24, + 10, + 38, + 31, + 6, + 42, + 30, + 33, + 26, + 33, + 27, + 19, + 23, + 54, + 9, + 93, + 24 + ], + "weighted_loads": [ + 1.7231674287468195, + 0.634313877671957, + 1.4661824945360422, + 3.089030273258686, + 0.15099665336310863, + 2.9464121498167515, + 1.7810607720166445, + 2.291627459228039, + 3.0291267577558756, + 3.088386580348015, + 2.4847969822585583, + 1.6260188594460487, + 2.645703248679638, + 1.31891811452806, + 0.7100058309733868, + 0.8402487076818943, + 2.538550391793251, + 0.32186026126146317, + 3.364748790860176, + 1.6829508189111948, + 2.151866927742958, + 3.6391546856611967, + 1.1220495589077473, + 0.39658586867153645, + 0.48688167706131935, + 1.2604445815086365, + 1.083700429648161, + 4.294862924143672, + 0.8338697291910648, + 0.4760899618268013, + 2.135841915383935, + 2.1140392310917377, + 0.5844439063221216, + 0.062424976378679276, + 3.3952273838222027, + 0.8810730390250683, + 3.2122038304805756, + 2.2930021192878485, + 3.0696291998028755, + 0.6246757339686155, + 2.9015054889023304, + 2.1189533583819866, + 0.3637897055596113, + 2.997939720749855, + 2.2760441601276398, + 0.6996083445847034, + 2.0099585242569447, + 0.9040279220789671, + 0.5134726595133543, + 3.0761268958449364, + 2.3378094248473644, + 0.23846491426229477, + 2.8822279311716557, + 2.014843698590994, + 1.8959073908627033, + 2.1963985916227102, + 2.9209581427276134, + 2.058549039065838, + 1.0864900033921003, + 1.8420825060456991, + 3.327050846070051, + 0.3879682905972004, + 7.677215596660972, + 1.615683887153864 + ], + "unique_experts": 64, + "load_cv": 0.5495310820088375, + "normalized_load_entropy": 0.9634398216731165, + "max_load_share": 0.05344827586206897 + } + }, + "s0_x": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "d466bd84d18e94cd4deb9c17a8d0c839503ece51fa8232e9039d9e507ed12352", + "route_weight_sha256": "1dc131860b6a118d5ffe5b21ea262d7bd6cc72e29143147c41215cd8dd9d0629", + "loads": [ + 37, + 13, + 20, + 46, + 2, + 35, + 3, + 39, + 29, + 35, + 29, + 15, + 28, + 25, + 1, + 13, + 23, + 5, + 38, + 13, + 28, + 39, + 21, + 7, + 10, + 22, + 28, + 44, + 14, + 5, + 37, + 32, + 8, + 0, + 35, + 6, + 36, + 14, + 38, + 5, + 41, + 22, + 6, + 42, + 36, + 15, + 4, + 19, + 8, + 37, + 22, + 0, + 40, + 28, + 33, + 15, + 17, + 26, + 21, + 13, + 47, + 9, + 91, + 24 + ], + "weighted_loads": [ + 1.749728487804532, + 0.5670452192425728, + 1.258586261421442, + 3.030230665579438, + 0.06742348149418831, + 2.8962102495133877, + 0.3000307008624077, + 2.210853775963187, + 2.627570014446974, + 2.3341653160750866, + 2.499448586255312, + 0.9166219495236874, + 2.2794076055288315, + 1.2786715887486935, + 0.03321560472249985, + 0.6684682108461857, + 1.772368736565113, + 0.28653625026345253, + 3.2303393334150314, + 0.91891710460186, + 2.090663082897663, + 3.450988508760929, + 0.8421669024974108, + 0.30131031200289726, + 0.4636200163513422, + 1.2093636821955442, + 1.1885441485792398, + 4.362497262656689, + 0.8623669166117907, + 0.23880251124501228, + 1.99646064825356, + 1.8774118721485138, + 0.356856394559145, + 0.0, + 3.1577020660042763, + 0.23453433066606522, + 3.1435808427631855, + 0.8993537835776806, + 3.0134919360280037, + 0.17548462562263012, + 2.8456508852541447, + 1.6571763269603252, + 0.3042929284274578, + 3.0180928986519575, + 2.207542732357979, + 0.6019217744469643, + 0.1766978967934847, + 0.7163325417786837, + 0.37959980964660645, + 2.9930669888854027, + 1.7527937069535255, + 0.0, + 2.7982502952218056, + 1.8011760339140892, + 1.882058396935463, + 1.1818300038576126, + 1.1636918857693672, + 2.0170770213007927, + 1.1452472619712353, + 0.8620848171412945, + 2.9282996114343405, + 0.38938167318701744, + 7.604486001655459, + 1.6296661160886288 + ], + "unique_experts": 62, + "load_cv": 0.6776340710477803, + "normalized_load_entropy": 0.942448429562124, + "max_load_share": 0.06091030789825971 + }, + "full_input": { + "tokens": 274, + "top_k": 6, + "decisions": 1644, + "ordered_route_sha256": "6ac08e20942ee7a4b7b14c3977d2829489a9e170cf827b060dfda64833c2927e", + "route_weight_sha256": "d84ddfc8c99eb99ff6ea25f9954605c81de9370b79feb8d7119259e4f8ee8b2c", + "loads": [ + 37, + 15, + 20, + 46, + 3, + 35, + 13, + 39, + 29, + 35, + 29, + 20, + 28, + 26, + 4, + 14, + 28, + 5, + 38, + 22, + 29, + 42, + 22, + 8, + 10, + 23, + 28, + 44, + 14, + 8, + 37, + 32, + 11, + 0, + 36, + 11, + 36, + 25, + 38, + 13, + 42, + 29, + 8, + 42, + 36, + 19, + 17, + 20, + 12, + 37, + 27, + 8, + 40, + 28, + 33, + 26, + 26, + 26, + 21, + 23, + 47, + 9, + 91, + 24 + ], + "weighted_loads": [ + 1.749728487804532, + 0.6334790475666523, + 1.258586261421442, + 3.030230665579438, + 0.09595390781760216, + 2.8962102495133877, + 1.5016506686806679, + 2.210853775963187, + 2.627570014446974, + 2.3341653160750866, + 2.499448586255312, + 1.2749167773872614, + 2.2794076055288315, + 1.3017517607659101, + 0.21824298053979874, + 0.7120624706149101, + 2.0972426384687424, + 0.28653625026345253, + 3.2303393334150314, + 1.5397339463233948, + 2.1344528198242188, + 3.6014191266149282, + 1.3883709330111742, + 0.3370678164064884, + 0.4636200163513422, + 1.2370013371109962, + 1.1885441485792398, + 4.362497262656689, + 0.8623669166117907, + 0.41740819439291954, + 1.99646064825356, + 1.8774118721485138, + 0.44520627334713936, + 0.0, + 3.1919454224407673, + 0.7199525237083435, + 3.1435808427631855, + 1.7412674948573112, + 3.0134919360280037, + 0.49470781348645687, + 2.904707707464695, + 2.193191487342119, + 0.3623033259063959, + 3.0180928986519575, + 2.207542732357979, + 0.7326378598809242, + 1.5027182679623365, + 0.735441667959094, + 0.5839018616825342, + 2.9930669888854027, + 2.1968764923512936, + 0.3403381034731865, + 2.7982502952218056, + 1.8011760339140892, + 1.882058396935463, + 1.9994448460638523, + 2.238533530384302, + 2.0170770213007927, + 1.1452472619712353, + 1.895831249654293, + 2.9282996114343405, + 0.38938167318701744, + 7.604486001655459, + 1.6296661160886288 + ], + "unique_experts": 63, + "load_cv": 0.5643457772062753, + "normalized_load_entropy": 0.961257764707936, + "max_load_share": 0.05535279805352798 + } + }, + "s1_x": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "81f5117f51cd74c3d2e5fdecc063b9b66dc8980e8471d5dd1da67e58fdefeb1a", + "route_weight_sha256": "71effd2a71f8db5a466432d3e7c03c5fb60dc6675ff35be1f9323a4bbaeed3a8", + "loads": [ + 38, + 14, + 19, + 46, + 0, + 36, + 5, + 39, + 29, + 34, + 27, + 15, + 28, + 24, + 1, + 15, + 23, + 4, + 37, + 13, + 27, + 39, + 17, + 8, + 9, + 21, + 25, + 45, + 12, + 6, + 40, + 33, + 9, + 1, + 35, + 4, + 37, + 14, + 38, + 8, + 40, + 22, + 7, + 43, + 35, + 16, + 2, + 22, + 8, + 38, + 22, + 0, + 42, + 28, + 33, + 15, + 15, + 26, + 21, + 12, + 47, + 9, + 92, + 24 + ], + "weighted_loads": [ + 1.7757081668823957, + 0.604138283059001, + 1.228198979049921, + 3.020793452858925, + 0.0, + 2.899069380015135, + 0.4229646250605583, + 2.209749413654208, + 2.6398009601980448, + 2.318743769079447, + 2.4524305760860443, + 0.9266689494252205, + 2.2810322865843773, + 1.2155916672199965, + 0.034040533006191254, + 0.760344410315156, + 1.7936563566327095, + 0.25262774899601936, + 3.1589880511164665, + 0.9201406762003899, + 2.0190003849565983, + 3.4587913416326046, + 0.672389954328537, + 0.32664430886507034, + 0.45854274928569794, + 1.1711248084902763, + 1.0602716580033302, + 4.2867451421916485, + 0.7926563583314419, + 0.2720273584127426, + 2.132522013038397, + 1.941188506782055, + 0.3879425637423992, + 0.02681574411690235, + 3.1166612692177296, + 0.16144384071230888, + 3.1771034970879555, + 0.8548587765544653, + 3.0071187131106853, + 0.2832074351608753, + 2.827920723706484, + 1.669442243874073, + 0.3384755663573742, + 2.9872931204736233, + 2.1232338547706604, + 0.6235023327171803, + 0.1141667515039444, + 0.8306003250181675, + 0.3725349847227335, + 3.0675268471240997, + 1.6842710711061954, + 0.0, + 2.884067941457033, + 1.8401948809623718, + 1.895126136019826, + 1.1927070636302233, + 1.0196112170815468, + 1.9911572560667992, + 1.1412927880883217, + 0.7833467293530703, + 2.9203642904758453, + 0.3886709697544575, + 7.64283600077033, + 1.5771958827972412 + ], + "unique_experts": 62, + "load_cv": 0.684998988811576, + "normalized_load_entropy": 0.9414618673065072, + "max_load_share": 0.06157965194109773 + }, + "full_input": { + "tokens": 290, + "top_k": 6, + "decisions": 1740, + "ordered_route_sha256": "2dae5d731f2c2d73c8afb938e3fe65ef587e6fc616823b04743d9eeab7cf0072", + "route_weight_sha256": "4b59e29924feca52cb99f9a1605e2344894878e0fbca97e907e212306fb5b2b2", + "loads": [ + 38, + 15, + 22, + 47, + 2, + 36, + 23, + 40, + 34, + 40, + 27, + 24, + 32, + 25, + 10, + 17, + 32, + 4, + 39, + 25, + 29, + 43, + 18, + 9, + 10, + 23, + 25, + 46, + 13, + 9, + 40, + 36, + 14, + 2, + 39, + 11, + 38, + 31, + 38, + 17, + 41, + 30, + 9, + 43, + 36, + 19, + 17, + 23, + 11, + 38, + 30, + 7, + 43, + 31, + 33, + 27, + 31, + 26, + 21, + 24, + 52, + 9, + 92, + 24 + ], + "weighted_loads": [ + 1.7757081668823957, + 0.6389760319143534, + 1.3711295276880264, + 3.0580199658870697, + 0.15099665336310863, + 2.899069380015135, + 2.1202328614890575, + 2.2714947443455458, + 2.977443451061845, + 3.0235071144998074, + 2.4524305760860443, + 1.572711929678917, + 2.611947361379862, + 1.2386718392372131, + 0.7098200842738152, + 0.9383508060127497, + 2.516933351755142, + 0.25262774899601936, + 3.30641994997859, + 1.752924095839262, + 2.111169435083866, + 3.6896069031208754, + 1.2185939848423004, + 0.3619626648724079, + 0.49117762222886086, + 1.2489301562309265, + 1.0602716580033302, + 4.3133609760552645, + 0.8289618827402592, + 0.4694759473204613, + 2.132522013038397, + 2.141966126859188, + 0.5375593695789576, + 0.06080504693090916, + 3.3748193345963955, + 0.8442872762680054, + 3.2113406844437122, + 2.1469287555664778, + 3.0071187131106853, + 0.7562921978533268, + 2.89227506890893, + 2.2411476969718933, + 0.3964754696935415, + 2.9872931204736233, + 2.207431823015213, + 0.7185428477823734, + 1.6735000722110271, + 0.8497094511985779, + 0.5506307315081358, + 3.0675268471240997, + 2.3083007261157036, + 0.2675419971346855, + 2.921221222728491, + 2.0083993077278137, + 1.895126136019826, + 2.2705176416784525, + 2.6582951582968235, + 1.9911572560667992, + 1.1412927880883217, + 1.912451360374689, + 3.1852059178054333, + 0.3886709697544575, + 7.64283600077033, + 1.5771958827972412 + ], + "unique_experts": 64, + "load_cv": 0.5433803952393811, + "normalized_load_entropy": 0.9640492919501453, + "max_load_share": 0.052873563218390804 + } + }, + "s0_period": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "066b4f5148c9059938ed76707773f74d4a4ce5e34c8ae3f30526b4698f52ed99", + "route_weight_sha256": "aa5d2c7131fd39798e62c9cf32ef725d3535e6be14f6da8b793b538959690f84", + "loads": [ + 37, + 13, + 20, + 46, + 2, + 35, + 3, + 39, + 29, + 36, + 29, + 15, + 28, + 24, + 1, + 13, + 23, + 5, + 39, + 13, + 28, + 39, + 17, + 7, + 10, + 22, + 28, + 44, + 14, + 5, + 37, + 33, + 8, + 0, + 35, + 5, + 37, + 14, + 38, + 6, + 40, + 22, + 6, + 43, + 34, + 16, + 5, + 22, + 7, + 37, + 22, + 0, + 41, + 27, + 33, + 15, + 17, + 26, + 22, + 13, + 46, + 8, + 91, + 24 + ], + "weighted_loads": [ + 1.7411282919347286, + 0.5689278561621904, + 1.2586978413164616, + 3.0418341401964426, + 0.06847407668828964, + 2.883773412555456, + 0.29512762278318405, + 2.2167041953653097, + 2.6287223659455776, + 2.40625886246562, + 2.5065688136965036, + 0.9256129860877991, + 2.266941659152508, + 1.2348389327526093, + 0.03324025869369507, + 0.6701514907181263, + 1.7633696906268597, + 0.28659479692578316, + 3.252918915823102, + 0.9257887303829193, + 2.0705760307610035, + 3.4568245820701122, + 0.7221293468028307, + 0.3024021312594414, + 0.48055910505354404, + 1.2015539985150099, + 1.2032689061015844, + 4.339682709425688, + 0.8622674960643053, + 0.2413460649549961, + 2.0241073574870825, + 1.902596104890108, + 0.3571076411753893, + 0.0, + 3.1442890986800194, + 0.2002938911318779, + 3.1592637468129396, + 0.913129135966301, + 3.0053555741906166, + 0.2091999426484108, + 2.8133595399558544, + 1.6523354016244411, + 0.30598874762654305, + 3.0276623405516148, + 2.123081173747778, + 0.6328193880617619, + 0.20781546644866467, + 0.8248761538416147, + 0.3381478413939476, + 2.9839811623096466, + 1.7418597340583801, + 0.0, + 2.8339639585465193, + 1.7657777816057205, + 1.8687581606209278, + 1.1695767976343632, + 1.1692654192447662, + 2.0273269079625607, + 1.1616574302315712, + 0.8643502201884985, + 2.8701561391353607, + 0.3578529320657253, + 7.561166206374764, + 1.6269661225378513 + ], + "unique_experts": 62, + "load_cv": 0.6788178276336614, + "normalized_load_entropy": 0.9422825387656854, + "max_load_share": 0.06091030789825971 + }, + "full_input": { + "tokens": 274, + "top_k": 6, + "decisions": 1644, + "ordered_route_sha256": "913ada3cfe62c3a78c4d9cc707a889bc0d842ed7a583196406e48ac3eb9a7eec", + "route_weight_sha256": "ffb98ef0c8a77b0f331859cac8a06f5328906239efd1727a139bed52c8921931", + "loads": [ + 37, + 15, + 20, + 46, + 3, + 35, + 13, + 39, + 29, + 36, + 29, + 20, + 29, + 25, + 3, + 14, + 28, + 5, + 39, + 23, + 29, + 42, + 18, + 8, + 10, + 23, + 28, + 44, + 15, + 8, + 37, + 33, + 11, + 0, + 36, + 10, + 37, + 25, + 38, + 14, + 41, + 28, + 8, + 43, + 34, + 20, + 18, + 23, + 11, + 37, + 27, + 8, + 41, + 27, + 33, + 26, + 26, + 26, + 22, + 22, + 46, + 8, + 91, + 24 + ], + "weighted_loads": [ + 1.7411282919347286, + 0.63536168448627, + 1.2586978413164616, + 3.0418341401964426, + 0.09700450301170349, + 2.883773412555456, + 1.3718460015952587, + 2.2167041953653097, + 2.6287223659455776, + 2.40625886246562, + 2.5065688136965036, + 1.2840307261794806, + 2.3199302218854427, + 1.257919104769826, + 0.1800747588276863, + 0.7075768113136292, + 2.083756309002638, + 0.28659479692578316, + 3.252918915823102, + 1.630773775279522, + 2.114365767687559, + 3.606598673388362, + 1.2683333773165941, + 0.33815963566303253, + 0.48055910505354404, + 1.2291916534304619, + 1.2032689061015844, + 4.339682709425688, + 0.9662862215191126, + 0.42458501085639, + 2.0241073574870825, + 1.902596104890108, + 0.4454575199633837, + 0.0, + 3.1785324551165104, + 0.686336562037468, + 3.1592637468129396, + 1.8392817117273808, + 3.0053555741906166, + 0.5284231305122375, + 2.8752158507704735, + 2.106096014380455, + 0.36399914510548115, + 3.0276623405516148, + 2.123081173747778, + 0.7635354734957218, + 1.5329751949757338, + 0.8439852800220251, + 0.5373084973543882, + 2.9839811623096466, + 2.1801853142678738, + 0.33960578218102455, + 2.8339639585465193, + 1.7657777816057205, + 1.8687581606209278, + 2.078429602086544, + 2.246404618024826, + 2.0273269079625607, + 1.1616574302315712, + 1.8245217967778444, + 2.8701561391353607, + 0.3578529320657253, + 7.561166206374764, + 1.6269661225378513 + ], + "unique_experts": 63, + "load_cv": 0.566523473397368, + "normalized_load_entropy": 0.9607105436142098, + "max_load_share": 0.05535279805352798 + } + }, + "s1_period": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "27855e89fd14ca48969631baa14d2daac18a20e494b664b873ea6c857ced6680", + "route_weight_sha256": "b4576047cae6186b12c3a956050ada7473df8b93bb4c26a19fa7f97c8886be6f", + "loads": [ + 39, + 14, + 20, + 46, + 1, + 36, + 6, + 39, + 29, + 34, + 27, + 15, + 28, + 23, + 1, + 14, + 23, + 4, + 37, + 13, + 27, + 39, + 18, + 8, + 9, + 20, + 25, + 44, + 12, + 5, + 40, + 32, + 9, + 1, + 35, + 5, + 37, + 15, + 37, + 7, + 39, + 22, + 6, + 44, + 35, + 17, + 3, + 22, + 8, + 38, + 22, + 0, + 42, + 29, + 33, + 15, + 15, + 26, + 21, + 11, + 47, + 9, + 92, + 24 + ], + "weighted_loads": [ + 1.8121379017829895, + 0.6003726366907358, + 1.267031505703926, + 3.0316753312945366, + 0.03188028186559677, + 2.898423319682479, + 0.44232065975666046, + 2.2125323209911585, + 2.6507030222564936, + 2.324728149920702, + 2.4464988093823195, + 0.937672458589077, + 2.27620430290699, + 1.1812015250325203, + 0.03327704221010208, + 0.7295267656445503, + 1.7867266647517681, + 0.2522657513618469, + 3.148530274629593, + 0.9305106066167355, + 2.0078024864196777, + 3.4522608630359173, + 0.7190269529819489, + 0.32628172263503075, + 0.47440093010663986, + 1.1214800365269184, + 1.0704066716134548, + 4.252293333411217, + 0.7918897196650505, + 0.24064135551452637, + 2.1545984353870153, + 1.8909671232104301, + 0.3880406767129898, + 0.02712193690240383, + 3.1283127516508102, + 0.19316066801548004, + 3.1777588576078415, + 0.8840705864131451, + 2.9724919572472572, + 0.25158784724771976, + 2.785374630242586, + 1.673101220279932, + 0.3126309774816036, + 3.0129447896033525, + 2.1216991394758224, + 0.6547495219856501, + 0.14642572775483131, + 0.8335211835801601, + 0.36884369142353535, + 3.061758268624544, + 1.670864962041378, + 0.0, + 2.890950232744217, + 1.8639495596289635, + 1.8799944464117289, + 1.1884717214852571, + 1.0191830061376095, + 1.9933143854141235, + 1.1481341999024153, + 0.7608656696975231, + 2.900856537744403, + 0.3862590752542019, + 7.627117624506354, + 1.5675435774028301 + ], + "unique_experts": 63, + "load_cv": 0.6828188514658227, + "normalized_load_entropy": 0.9424695583512869, + "max_load_share": 0.06157965194109773 + }, + "full_input": { + "tokens": 290, + "top_k": 6, + "decisions": 1740, + "ordered_route_sha256": "a4827211481f923693fd4052eac9eb4e954c53d727ace2d38095cca340f532af", + "route_weight_sha256": "7fdd57210f399381c2e68d20c6facc492e937d78533e3f83e364028f3bfb0b45", + "loads": [ + 39, + 15, + 23, + 47, + 3, + 36, + 24, + 40, + 34, + 40, + 27, + 24, + 33, + 24, + 10, + 16, + 32, + 4, + 39, + 25, + 29, + 43, + 19, + 9, + 10, + 22, + 25, + 45, + 14, + 8, + 40, + 35, + 14, + 2, + 39, + 12, + 38, + 33, + 37, + 16, + 40, + 29, + 8, + 44, + 36, + 20, + 19, + 23, + 10, + 38, + 29, + 7, + 43, + 32, + 33, + 27, + 31, + 26, + 21, + 22, + 52, + 9, + 92, + 24 + ], + "weighted_loads": [ + 1.8121379017829895, + 0.6352103855460882, + 1.4099620543420315, + 3.0689018443226814, + 0.1828769352287054, + 2.898423319682479, + 1.9988169521093369, + 2.274277651682496, + 2.9883455131202936, + 3.0294914953410625, + 2.4464988093823195, + 1.5847447514533997, + 2.672547873109579, + 1.204281697049737, + 0.7063359133899212, + 0.8938821628689766, + 2.5078647546470165, + 0.2522657513618469, + 3.2959621734917164, + 1.863718904554844, + 2.0999715365469456, + 3.6820460092276335, + 1.2652309834957123, + 0.3616000786423683, + 0.5070358030498028, + 1.1992853842675686, + 1.0704066716134548, + 4.278909167274833, + 0.9510566145181656, + 0.4385003224015236, + 2.1545984353870153, + 2.0917447432875633, + 0.5376574825495481, + 0.06111123971641064, + 3.386470817029476, + 0.8861022777855396, + 3.2119960449635983, + 2.32039749994874, + 2.9724919572472572, + 0.7246726099401712, + 2.852273192256689, + 2.1546018198132515, + 0.37063088081777096, + 3.0129447896033525, + 2.205897107720375, + 0.7497900370508432, + 1.7407060973346233, + 0.8526303097605705, + 0.47284420393407345, + 3.061758268624544, + 2.233147621154785, + 0.27128319442272186, + 2.9281035140156746, + 2.0321539863944054, + 1.8799944464117289, + 2.324946092441678, + 2.643888797610998, + 1.9933143854141235, + 1.1481341999024153, + 1.8172267954796553, + 3.165698165073991, + 0.3862590752542019, + 7.627117624506354, + 1.5675435774028301 + ], + "unique_experts": 64, + "load_cv": 0.5428354870183434, + "normalized_load_entropy": 0.9642044129327229, + "max_load_share": 0.052873563218390804 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 249, + "ordered_topk_exact_tokens": 206, + "set_exact_tokens": 221, + "mean_set_jaccard": 0.9678714859437753, + "mean_token_weighted_tv": 0.00706791510453904, + "aggregate_load_tv": 0.014056224899598395 + }, + "system_bos": { + "tokens": 249, + "ordered_topk_exact_tokens": 193, + "set_exact_tokens": 213, + "mean_set_jaccard": 0.9578313253012049, + "mean_token_weighted_tv": 0.010854708356221756, + "aggregate_load_tv": 0.01673360107095047 + }, + "system_x": { + "tokens": 249, + "ordered_topk_exact_tokens": 182, + "set_exact_tokens": 207, + "mean_set_jaccard": 0.950946643717728, + "mean_token_weighted_tv": 0.012977514127980035, + "aggregate_load_tv": 0.02008032128514057 + }, + "system_period": { + "tokens": 249, + "ordered_topk_exact_tokens": 177, + "set_exact_tokens": 206, + "mean_set_jaccard": 0.9497991967871486, + "mean_token_weighted_tv": 0.01308073748995262, + "aggregate_load_tv": 0.01874163319946453 + }, + "bos_at_s0": { + "tokens": 249, + "ordered_topk_exact_tokens": 162, + "set_exact_tokens": 193, + "mean_set_jaccard": 0.9348823866896154, + "mean_token_weighted_tv": 0.016410767227919943, + "aggregate_load_tv": 0.02008032128514057 + }, + "bos_at_s1": { + "tokens": 249, + "ordered_topk_exact_tokens": 152, + "set_exact_tokens": 186, + "mean_set_jaccard": 0.92512908777969, + "mean_token_weighted_tv": 0.018590009318717033, + "aggregate_load_tv": 0.0180722891566265 + }, + "x_at_s0": { + "tokens": 249, + "ordered_topk_exact_tokens": 162, + "set_exact_tokens": 194, + "mean_set_jaccard": 0.9317269076305221, + "mean_token_weighted_tv": 0.016726705208271145, + "aggregate_load_tv": 0.024765729585006696 + }, + "x_at_s1": { + "tokens": 249, + "ordered_topk_exact_tokens": 159, + "set_exact_tokens": 192, + "mean_set_jaccard": 0.9320137693631669, + "mean_token_weighted_tv": 0.017929687976358407, + "aggregate_load_tv": 0.023427041499330663 + }, + "period_at_s0": { + "tokens": 249, + "ordered_topk_exact_tokens": 164, + "set_exact_tokens": 196, + "mean_set_jaccard": 0.9340218014916809, + "mean_token_weighted_tv": 0.01645504042925126, + "aggregate_load_tv": 0.02208835341365462 + }, + "period_at_s1": { + "tokens": 249, + "ordered_topk_exact_tokens": 157, + "set_exact_tokens": 189, + "mean_set_jaccard": 0.927710843373494, + "mean_token_weighted_tv": 0.01838871768589719, + "aggregate_load_tv": 0.022757697456492643 + } + } + }, + "layer_07": { + "layer": 7, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "04826d2163f76ef8a9bf8225801915df8eb142540f02f16abc6f1b2939d7e036", + "route_weight_sha256": "d48a2dea413fa4bd7424f95d07a3ded7d957d57bd0c6f2edff1b09ad4682bc43", + "loads": [ + 43, + 9, + 33, + 48, + 22, + 22, + 17, + 20, + 9, + 33, + 5, + 17, + 6, + 1, + 33, + 23, + 14, + 24, + 18, + 32, + 7, + 31, + 12, + 38, + 14, + 55, + 26, + 32, + 9, + 27, + 35, + 10, + 16, + 5, + 42, + 14, + 35, + 25, + 23, + 35, + 59, + 4, + 23, + 4, + 6, + 36, + 13, + 5, + 27, + 20, + 4, + 51, + 30, + 6, + 22, + 14, + 43, + 45, + 20, + 27, + 8, + 9, + 94, + 4 + ], + "weighted_loads": [ + 2.8124135807156563, + 0.48740632086992264, + 1.9887475445866585, + 2.1177909299731255, + 1.1827865317463875, + 1.420373497530818, + 0.7120196186006069, + 1.169198103249073, + 0.5089169181883335, + 1.7508964370936155, + 0.2889813743531704, + 1.0067226737737656, + 0.23056399449706078, + 0.03811734914779663, + 2.202445225790143, + 1.8717866465449333, + 1.305224947631359, + 1.24529729783535, + 0.6560324896126986, + 2.459422953426838, + 0.4515606574714184, + 2.403510022908449, + 0.8143059201538563, + 2.013375051319599, + 0.6029539667069912, + 4.004119746387005, + 1.6601096875965595, + 1.9649324677884579, + 0.3155639171600342, + 2.109343860298395, + 2.3288611248135567, + 0.46231919899582863, + 1.636898409575224, + 0.2668718658387661, + 5.297728884965181, + 1.0670316945761442, + 2.6170361898839474, + 1.7590508479624987, + 2.0671735517680645, + 2.347893051803112, + 5.705086775124073, + 0.22052628174424171, + 1.951287902891636, + 0.12727653421461582, + 0.2200712226331234, + 2.044000780209899, + 0.7051919996738434, + 0.25012869015336037, + 1.6055179946124554, + 1.1597176976501942, + 0.2232108674943447, + 3.543070338666439, + 2.5621034558862448, + 0.3079732842743397, + 1.3971310053020716, + 1.0418059006333351, + 2.575623221695423, + 2.7863404974341393, + 1.4889658223837614, + 1.8442150764167309, + 0.416946804150939, + 0.6459705457091331, + 7.807227533310652, + 0.1881719008088112 + ], + "unique_experts": 64, + "load_cv": 0.7142612902989374, + "normalized_load_entropy": 0.9421113015566595, + "max_load_share": 0.06291834002677377 + }, + "full_input": { + "tokens": 274, + "top_k": 6, + "decisions": 1644, + "ordered_route_sha256": "171997b7466467bc2a687a2215c2721edef4feef19eb45d09439bc2c5eee0cb5", + "route_weight_sha256": "78c2fa937a80d01ccf2250234ae47a8b735d878dda9356bf1b087a6ecbd63368", + "loads": [ + 43, + 9, + 33, + 51, + 22, + 23, + 21, + 20, + 16, + 33, + 6, + 21, + 6, + 6, + 33, + 23, + 29, + 26, + 20, + 33, + 8, + 31, + 15, + 40, + 18, + 55, + 29, + 32, + 12, + 27, + 35, + 10, + 19, + 7, + 42, + 14, + 35, + 25, + 33, + 38, + 59, + 15, + 28, + 7, + 10, + 36, + 15, + 7, + 27, + 20, + 20, + 51, + 30, + 7, + 22, + 21, + 43, + 45, + 24, + 27, + 8, + 15, + 97, + 11 + ], + "weighted_loads": [ + 2.8124135807156563, + 0.48740632086992264, + 1.9887475445866585, + 2.22867988049984, + 1.1827865317463875, + 1.4618459027260542, + 1.1244733519852161, + 1.169198103249073, + 1.0660911872982979, + 1.7508964370936155, + 0.32208263501524925, + 1.571595672518015, + 0.23056399449706078, + 0.3244990911334753, + 2.202445225790143, + 1.8717866465449333, + 3.320576950907707, + 1.365090448409319, + 0.6973649617284536, + 2.5273545309901237, + 0.5145150162279606, + 2.403510022908449, + 0.9858526103198528, + 2.150568410754204, + 0.7349203336052597, + 4.004119746387005, + 1.9369375444948673, + 1.9649324677884579, + 0.3787654433399439, + 2.109343860298395, + 2.3288611248135567, + 0.46231919899582863, + 1.7506172247231007, + 0.38434575870633125, + 5.297728884965181, + 1.0670316945761442, + 2.6170361898839474, + 1.7590508479624987, + 3.003154646605253, + 2.4774904288351536, + 5.705086775124073, + 1.1705819480121136, + 2.3194271437823772, + 0.18859556503593922, + 1.7455675415694714, + 2.044000780209899, + 0.7908179070800543, + 0.417314562946558, + 1.6055179946124554, + 1.1597176976501942, + 1.365645645186305, + 3.543070338666439, + 2.5621034558862448, + 0.339208809658885, + 1.3971310053020716, + 1.7006167471408844, + 2.575623221695423, + 2.7863404974341393, + 1.5737553155049682, + 1.8442150764167309, + 0.416946804150939, + 0.9445526152849197, + 7.856062193866819, + 0.4565917029976845 + ], + "unique_experts": 64, + "load_cv": 0.615292821207633, + "normalized_load_entropy": 0.9585232932956707, + "max_load_share": 0.05900243309002433 + } + }, + "s1_eos": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "ccdc346b1e6314f9e2305880fecb0d4deedc014da7daf4c4992d93692bef5aa7", + "route_weight_sha256": "ba7907c3093c7bc7f83e4892f0bbf81d4c14c0569ff166ad0bec895a9b51e505", + "loads": [ + 42, + 10, + 31, + 45, + 21, + 22, + 21, + 20, + 9, + 33, + 5, + 15, + 6, + 2, + 34, + 23, + 13, + 23, + 19, + 32, + 7, + 31, + 12, + 38, + 16, + 55, + 26, + 32, + 9, + 28, + 34, + 9, + 15, + 5, + 42, + 16, + 35, + 26, + 22, + 35, + 59, + 4, + 23, + 4, + 6, + 36, + 15, + 5, + 26, + 20, + 4, + 51, + 31, + 5, + 23, + 14, + 43, + 46, + 20, + 25, + 8, + 8, + 95, + 4 + ], + "weighted_loads": [ + 2.7883581146597862, + 0.5159711949527264, + 1.9028895311057568, + 2.0175004452466965, + 1.1470257081091404, + 1.4009801931679249, + 0.86371342651546, + 1.1734160259366035, + 0.4944777861237526, + 1.7413536384701729, + 0.30141544714570045, + 0.9371345583349466, + 0.2306367363780737, + 0.07716777548193932, + 2.2363267485052347, + 1.8741298206150532, + 1.2653500624001026, + 1.197863731533289, + 0.6827839892357588, + 2.4463804997503757, + 0.4424404166638851, + 2.40401778742671, + 0.8253390081226826, + 2.013277495279908, + 0.6633146852254868, + 3.990125935524702, + 1.620577484369278, + 1.962066400796175, + 0.31331498734652996, + 2.13799611851573, + 2.285194903612137, + 0.4157746136188507, + 1.601887732744217, + 0.24911530688405037, + 5.271044729277492, + 1.1467176396399736, + 2.6179107911884785, + 1.8082909397780895, + 1.994007483124733, + 2.3484490998089314, + 5.696642689406872, + 0.22074738144874573, + 1.9402120262384415, + 0.12567445822060108, + 0.21562464907765388, + 2.039347993209958, + 0.7750139273703098, + 0.24341510236263275, + 1.559870932251215, + 1.162336129695177, + 0.23165571317076683, + 3.5566021241247654, + 2.5808120872825384, + 0.2811797484755516, + 1.4278169870376587, + 1.0376553535461426, + 2.6030785646289587, + 2.82490561529994, + 1.487718589603901, + 1.77077142521739, + 0.4127441458404064, + 0.6055154167115688, + 7.804277557879686, + 0.1874469630420208 + ], + "unique_experts": 64, + "load_cv": 0.7127341822152029, + "normalized_load_entropy": 0.9426679659523828, + "max_load_share": 0.06358768406961178 + }, + "full_input": { + "tokens": 290, + "top_k": 6, + "decisions": 1740, + "ordered_route_sha256": "296cbd978127e363eb0acc666daf4d6a58c66195f745f6c71db32efb3d77e201", + "route_weight_sha256": "fcc8f45a9f499ea4b2a7976eae5b017d42863c5f76173c64805580bd439de71f", + "loads": [ + 42, + 10, + 31, + 47, + 22, + 23, + 28, + 20, + 24, + 35, + 12, + 20, + 6, + 7, + 36, + 25, + 29, + 27, + 21, + 33, + 8, + 31, + 14, + 41, + 21, + 55, + 32, + 33, + 12, + 34, + 34, + 9, + 21, + 14, + 42, + 16, + 35, + 30, + 39, + 38, + 61, + 20, + 33, + 7, + 16, + 36, + 17, + 11, + 26, + 20, + 27, + 51, + 31, + 5, + 27, + 23, + 43, + 52, + 23, + 25, + 8, + 14, + 99, + 8 + ], + "weighted_loads": [ + 2.7883581146597862, + 0.5159711949527264, + 1.9028895311057568, + 2.08082477375865, + 1.1935354247689247, + 1.445198405534029, + 1.3414819575846195, + 1.1734160259366035, + 1.7693563364446163, + 1.84318058937788, + 0.8497651666402817, + 1.5551986265927553, + 0.2306367363780737, + 0.38676433078944683, + 2.305663513019681, + 1.9719596467912197, + 3.6912338621914387, + 1.405661541968584, + 0.7236770521849394, + 2.5127113200724125, + 0.5055653639137745, + 2.40401778742671, + 0.942602626979351, + 2.182141063734889, + 0.8185172006487846, + 3.990125935524702, + 2.17899277061224, + 1.9926018249243498, + 0.37695870641618967, + 2.91309941932559, + 2.285194903612137, + 0.4157746136188507, + 1.9861081093549728, + 0.8477431572973728, + 5.271044729277492, + 1.1467176396399736, + 2.6179107911884785, + 2.036031473428011, + 3.7350400499999523, + 2.4906903132796288, + 5.9189320132136345, + 1.634044412523508, + 2.7434072047472, + 0.197735576890409, + 2.2787393778562546, + 2.039347993209958, + 0.8802740313112736, + 0.601711630821228, + 1.559870932251215, + 1.162336129695177, + 1.839252257719636, + 3.5566021241247654, + 2.5808120872825384, + 0.2811797484755516, + 1.6346889585256577, + 1.8068789299577475, + 2.6030785646289587, + 3.3602105118334293, + 1.5447857584804296, + 1.77077142521739, + 0.4127441458404064, + 0.8975391909480095, + 7.886960364878178, + 0.3038121275603771 + ], + "unique_experts": 64, + "load_cv": 0.5787216494332922, + "normalized_load_entropy": 0.9628859226116029, + "max_load_share": 0.056896551724137934 + } + }, + "s0_bos": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "310fb4522b194584148258853a5758cda57cfdc82fa30731ad9a6ee72a845b18", + "route_weight_sha256": "f05760db46948aa5b5e343daca20652a5e563c0f62acb53722a1e3ba488152bd", + "loads": [ + 44, + 10, + 31, + 45, + 22, + 23, + 18, + 19, + 10, + 32, + 5, + 14, + 6, + 3, + 33, + 24, + 15, + 24, + 17, + 31, + 6, + 31, + 11, + 37, + 15, + 54, + 26, + 31, + 4, + 29, + 37, + 8, + 18, + 6, + 42, + 16, + 33, + 25, + 23, + 34, + 60, + 3, + 23, + 6, + 6, + 38, + 14, + 6, + 27, + 20, + 4, + 51, + 30, + 6, + 20, + 15, + 45, + 48, + 19, + 26, + 7, + 10, + 94, + 4 + ], + "weighted_loads": [ + 2.9413048438727856, + 0.5212204977869987, + 1.9561746679246426, + 2.016493245959282, + 1.2086769454181194, + 1.4755375478416681, + 0.6967544239014387, + 1.1512025222182274, + 0.5586609691381454, + 1.7360453810542822, + 0.30314724147319794, + 0.9043643139302731, + 0.2284506857395172, + 0.09304811432957649, + 2.2316781859844923, + 1.9268383868038654, + 1.3692050650715828, + 1.235546950250864, + 0.6263778824359179, + 2.5072500072419643, + 0.40501129627227783, + 2.367705911397934, + 0.786998450756073, + 1.966972652822733, + 0.6291698161512613, + 4.040879461914301, + 1.6765802130103111, + 1.9541219547390938, + 0.12955784052610397, + 2.2242072597146034, + 2.4194407239556313, + 0.3740163501352072, + 1.6959457881748676, + 0.3292854316532612, + 5.218147963285446, + 1.13018112257123, + 2.53508778847754, + 1.7504669111222029, + 2.1334436759352684, + 2.322649981826544, + 5.861753184348345, + 0.17278702557086945, + 1.9550468623638153, + 0.20269199647009373, + 0.22406836040318012, + 2.153103291988373, + 0.761377964168787, + 0.2684131432324648, + 1.6452604457736015, + 1.1752259023487568, + 0.20942362770438194, + 3.6554463505744934, + 2.5596205200999975, + 0.3199329860508442, + 1.3670005202293396, + 1.0765633955597878, + 2.698368910700083, + 2.8827416636049747, + 1.4171958900988102, + 1.8325456604361534, + 0.3813083805143833, + 0.7006823867559433, + 7.912123952060938, + 0.1913028210401535 + ], + "unique_experts": 64, + "load_cv": 0.7153042752545179, + "normalized_load_entropy": 0.9422938344643805, + "max_load_share": 0.06291834002677377 + }, + "full_input": { + "tokens": 274, + "top_k": 6, + "decisions": 1644, + "ordered_route_sha256": "f25849b12d3e7ffdafdbb9c2b8fb3b34dafdc73542479bfe1e109a06c66996ab", + "route_weight_sha256": "64a8b2f654b1a9fd93990167d52337428e01369f2ad6948129e3687fc41c2d10", + "loads": [ + 44, + 10, + 31, + 48, + 22, + 24, + 24, + 19, + 17, + 32, + 6, + 18, + 6, + 8, + 33, + 24, + 29, + 27, + 20, + 32, + 7, + 31, + 14, + 39, + 18, + 54, + 30, + 31, + 6, + 29, + 37, + 8, + 21, + 8, + 42, + 16, + 33, + 25, + 33, + 37, + 60, + 14, + 28, + 8, + 10, + 38, + 16, + 8, + 27, + 20, + 20, + 51, + 30, + 8, + 20, + 22, + 45, + 48, + 22, + 26, + 7, + 16, + 96, + 11 + ], + "weighted_loads": [ + 2.9413048438727856, + 0.5212204977869987, + 1.9561746679246426, + 2.1273821964859962, + 1.2086769454181194, + 1.5170099530369043, + 1.2758456002920866, + 1.1512025222182274, + 1.1132035851478577, + 1.7360453810542822, + 0.3362485021352768, + 1.4907502494752407, + 0.2284506857395172, + 0.37942985631525517, + 2.2316781859844923, + 1.9268383868038654, + 3.3393630422651768, + 1.3932561613619328, + 0.7093714755028486, + 2.5806260518729687, + 0.46835505962371826, + 2.367705911397934, + 0.9585451409220695, + 2.1063648648560047, + 0.7540461830794811, + 4.040879461914301, + 2.0087728276848793, + 1.9541219547390938, + 0.17963847890496254, + 2.2242072597146034, + 2.4194407239556313, + 0.3740163501352072, + 1.8096646033227444, + 0.45906784757971764, + 5.218147963285446, + 1.13018112257123, + 2.53508778847754, + 1.7504669111222029, + 3.103133361786604, + 2.4539609849452972, + 5.861753184348345, + 1.1112872287631035, + 2.3209940046072006, + 0.24952011369168758, + 0.9186660330742598, + 2.153103291988373, + 0.8621460795402527, + 0.43208366073668003, + 1.6452604457736015, + 1.1752259023487568, + 1.4607838820666075, + 3.6554463505744934, + 2.5596205200999975, + 0.39737452380359173, + 1.3670005202293396, + 1.735374242067337, + 2.698368910700083, + 2.8827416636049747, + 1.4870352670550346, + 1.8325456604361534, + 0.3813083805143833, + 0.9992644563317299, + 7.955333773046732, + 0.4597226232290268 + ], + "unique_experts": 64, + "load_cv": 0.6145996960071428, + "normalized_load_entropy": 0.9583855137202743, + "max_load_share": 0.058394160583941604 + } + }, + "s1_bos": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "08226235849ee9b7f269cc32e9b538fa69663eccd92e3807e3ca6eabead16be3", + "route_weight_sha256": "149f9c9af09771d692786ff0a4aa6c81ba7e2288efcf6011859776f6d1905ef5", + "loads": [ + 44, + 11, + 31, + 48, + 22, + 22, + 21, + 20, + 9, + 31, + 6, + 15, + 7, + 3, + 33, + 24, + 15, + 23, + 16, + 31, + 7, + 31, + 11, + 37, + 15, + 55, + 26, + 31, + 6, + 29, + 36, + 9, + 15, + 6, + 42, + 15, + 36, + 27, + 21, + 35, + 60, + 3, + 24, + 4, + 5, + 37, + 15, + 6, + 26, + 21, + 3, + 50, + 31, + 5, + 19, + 14, + 47, + 44, + 18, + 23, + 6, + 9, + 98, + 4 + ], + "weighted_loads": [ + 2.954312711954117, + 0.5591854732483625, + 1.926089832559228, + 2.0915196407586336, + 1.1976247355341911, + 1.4167567379772663, + 0.7942615617066622, + 1.199491024017334, + 0.4996414966881275, + 1.683879692107439, + 0.3465162590146065, + 0.9325288012623787, + 0.28683249466121197, + 0.09324529208242893, + 2.2368290163576603, + 1.9250877872109413, + 1.3416454624384642, + 1.1774582788348198, + 0.5911192707717419, + 2.480822842568159, + 0.4481969214975834, + 2.34720341861248, + 0.784139096736908, + 1.9466995298862457, + 0.6207235846668482, + 4.1249866764992476, + 1.6449545621871948, + 1.9255087114870548, + 0.20761441066861153, + 2.215672392398119, + 2.416814263910055, + 0.39381564036011696, + 1.6003891788423061, + 0.3323402814567089, + 5.238531518727541, + 1.1072889100760221, + 2.6650580763816833, + 1.8552392292767763, + 1.975707408040762, + 2.3573334105312824, + 5.914196848869324, + 0.1651090681552887, + 2.01670615747571, + 0.13181583769619465, + 0.17600883357226849, + 2.1134050209075212, + 0.7943945713341236, + 0.27943340316414833, + 1.5919636748731136, + 1.2002616990357637, + 0.1688624732196331, + 3.6239578127861023, + 2.606934940442443, + 0.27496378868818283, + 1.3189834095537663, + 1.0304681994020939, + 2.796020956709981, + 2.7765805684030056, + 1.365228209644556, + 1.7298110611736774, + 0.3425692953169346, + 0.6562541499733925, + 7.983868896961212, + 0.18392310664057732 + ], + "unique_experts": 64, + "load_cv": 0.7301816456787741, + "normalized_load_entropy": 0.9406690063424757, + "max_load_share": 0.06559571619812583 + }, + "full_input": { + "tokens": 290, + "top_k": 6, + "decisions": 1740, + "ordered_route_sha256": "ab4942c74b76e46a762d8d6b4dea9d6322e7ff5f7b60974d9e5db7f2bbcb83f7", + "route_weight_sha256": "697d1bad3b233abcac2a2c1ea0f0c9b2292f6cf15abff6bbda04fa3942ec59dc", + "loads": [ + 44, + 11, + 31, + 50, + 23, + 23, + 29, + 20, + 24, + 33, + 13, + 20, + 7, + 8, + 35, + 26, + 30, + 27, + 19, + 32, + 8, + 31, + 13, + 41, + 19, + 55, + 34, + 32, + 8, + 35, + 36, + 9, + 21, + 15, + 42, + 15, + 36, + 31, + 38, + 38, + 62, + 19, + 34, + 6, + 14, + 37, + 18, + 12, + 26, + 21, + 26, + 50, + 31, + 6, + 23, + 23, + 47, + 50, + 20, + 23, + 6, + 15, + 101, + 8 + ], + "weighted_loads": [ + 2.954312711954117, + 0.5591854732483625, + 1.926089832559228, + 2.154843969270587, + 1.2441344521939754, + 1.4609749503433704, + 1.3995148912072182, + 1.199491024017334, + 1.7773852795362473, + 1.7857066430151463, + 0.8961462657898664, + 1.5801979713141918, + 0.28683249466121197, + 0.40284184738993645, + 2.3061657808721066, + 2.022917613387108, + 3.72403777949512, + 1.378576174378395, + 0.6723752245306969, + 2.5534297935664654, + 0.5207334198057652, + 2.34720341861248, + 0.9014027155935764, + 2.1719476506114006, + 0.768662367016077, + 4.1249866764992476, + 2.329072680324316, + 1.9560441356152296, + 0.25751218758523464, + 2.990775693207979, + 2.416814263910055, + 0.39381564036011696, + 1.984609555453062, + 0.9396738298237324, + 5.238531518727541, + 1.1072889100760221, + 2.6650580763816833, + 2.0829797629266977, + 3.7344666868448257, + 2.501620899885893, + 6.136486172676086, + 1.579334456473589, + 2.8175050877034664, + 0.18992270715534687, + 1.3689041268080473, + 2.1134050209075212, + 0.9493727423250675, + 0.6338945142924786, + 1.5919636748731136, + 1.2002616990357637, + 1.913336681202054, + 3.6239578127861023, + 2.606934940442443, + 0.30782271921634674, + 1.5258553810417652, + 1.7996917758136988, + 2.796020956709981, + 3.311885464936495, + 1.4066347982734442, + 1.7298110611736774, + 0.3425692953169346, + 0.9482779242098331, + 8.06099214963615, + 0.30028827115893364 + ], + "unique_experts": 64, + "load_cv": 0.5927603034797659, + "normalized_load_entropy": 0.9613229976837887, + "max_load_share": 0.058045977011494256 + } + }, + "s0_x": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "c633d8142d54132d06c2232fa72b050cc90f53d1b8e76cfb4bbe290202e0cd47", + "route_weight_sha256": "e45f0a9ed1f76524b4e0a37ffd85fef00b4ebcf03f5a3d6b1b5ab09f808802cc", + "loads": [ + 44, + 10, + 32, + 45, + 21, + 20, + 16, + 19, + 8, + 32, + 5, + 15, + 6, + 2, + 33, + 23, + 14, + 24, + 17, + 32, + 6, + 31, + 11, + 36, + 13, + 55, + 27, + 31, + 8, + 30, + 35, + 9, + 18, + 5, + 42, + 15, + 34, + 26, + 23, + 35, + 59, + 4, + 23, + 8, + 6, + 38, + 12, + 6, + 27, + 20, + 3, + 51, + 30, + 6, + 21, + 15, + 44, + 46, + 20, + 28, + 9, + 10, + 96, + 4 + ], + "weighted_loads": [ + 2.9299274384975433, + 0.5278443470597267, + 1.9783072620630264, + 2.0017299111932516, + 1.1714658066630363, + 1.3843870423734188, + 0.6401701532304287, + 1.1433099955320358, + 0.43893829733133316, + 1.7464309968054295, + 0.3198295831680298, + 0.9462515339255333, + 0.2274732869118452, + 0.06931130960583687, + 2.2239910289645195, + 1.8921498358249664, + 1.2863282449543476, + 1.2583041489124298, + 0.6048611346632242, + 2.5282715409994125, + 0.3942009136080742, + 2.3865773044526577, + 0.806011188775301, + 1.9465945176780224, + 0.5699417199939489, + 4.047458723187447, + 1.8243041932582855, + 1.9371466860175133, + 0.2724892683327198, + 2.221772162243724, + 2.377826541662216, + 0.41204269602894783, + 1.681387921795249, + 0.27926115319132805, + 5.336102079600096, + 1.0971821211278439, + 2.5660697370767593, + 1.8329096399247646, + 2.1382448785007, + 2.3650825433433056, + 5.724314779043198, + 0.20152853429317474, + 1.9771627821028233, + 0.2718855105340481, + 0.2256213128566742, + 2.147267419844866, + 0.6791310347616673, + 0.28842368349432945, + 1.6377234868705273, + 1.1613674312829971, + 0.16276555508375168, + 3.6565502397716045, + 2.570253936573863, + 0.30394369550049305, + 1.3685322143137455, + 1.083245389163494, + 2.672324188053608, + 2.8840248696506023, + 1.4964643232524395, + 1.9313062746077776, + 0.4647150654345751, + 0.7022454589605331, + 8.010452453047037, + 0.19071883335709572 + ], + "unique_experts": 64, + "load_cv": 0.7180249193990565, + "normalized_load_entropy": 0.9424189136277455, + "max_load_share": 0.0642570281124498 + }, + "full_input": { + "tokens": 274, + "top_k": 6, + "decisions": 1644, + "ordered_route_sha256": "bc71845c326685d35d424e89e50abcf22118542b3519a2730ffbd2f116cb2a0f", + "route_weight_sha256": "f856e314bf4513ae9df920887a3966602f3eb6d41a0396580bb34180fd6afd83", + "loads": [ + 44, + 10, + 32, + 48, + 21, + 22, + 20, + 19, + 14, + 32, + 6, + 19, + 6, + 8, + 33, + 23, + 29, + 27, + 19, + 33, + 7, + 31, + 14, + 38, + 16, + 55, + 31, + 31, + 10, + 30, + 35, + 9, + 21, + 7, + 42, + 15, + 34, + 26, + 33, + 38, + 59, + 15, + 28, + 10, + 9, + 38, + 15, + 9, + 27, + 20, + 18, + 51, + 30, + 7, + 21, + 22, + 44, + 46, + 23, + 28, + 9, + 17, + 98, + 12 + ], + "weighted_loads": [ + 2.9299274384975433, + 0.5278443470597267, + 1.9783072620630264, + 2.112618861719966, + 1.1714658066630363, + 1.4806132540106773, + 1.0012335143983364, + 1.1433099955320358, + 0.9155272617936134, + 1.7464309968054295, + 0.35293084383010864, + 1.5241952911019325, + 0.2274732869118452, + 0.39003162272274494, + 2.2239910289645195, + 1.8921498358249664, + 3.5184129998087883, + 1.4272139705717564, + 0.6461936067789793, + 2.5981254801154137, + 0.4619056209921837, + 2.3865773044526577, + 0.9775578789412975, + 2.083941612392664, + 0.6948180869221687, + 4.047458723187447, + 2.17489480227232, + 1.9371466860175133, + 0.32256990671157837, + 2.221772162243724, + 2.377826541662216, + 0.41204269602894783, + 1.7951067369431257, + 0.4167509265244007, + 5.336102079600096, + 1.0971821211278439, + 2.5660697370767593, + 1.8329096399247646, + 3.0385839492082596, + 2.4929144456982613, + 5.724314779043198, + 1.0927223861217499, + 2.341610327363014, + 0.3192974291741848, + 0.8739332668483257, + 2.147267419844866, + 0.810228243470192, + 0.49642642214894295, + 1.6377234868705273, + 1.1613674312829971, + 1.218238377943635, + 3.6565502397716045, + 2.570253936573863, + 0.3351792208850384, + 1.3685322143137455, + 1.7420562356710434, + 2.672324188053608, + 2.8840248696506023, + 1.566303700208664, + 1.9313062746077776, + 0.4647150654345751, + 1.0531590208411217, + 8.053662274032831, + 0.5405599065124989 + ], + "unique_experts": 64, + "load_cv": 0.6157160136065165, + "normalized_load_entropy": 0.9589470720287191, + "max_load_share": 0.05961070559610705 + } + }, + "s1_x": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "35fba7800f9ba6232884ea0c7ea257bd20723c9bffadd8197170c27744602cbe", + "route_weight_sha256": "5c2aa18a6924f7e5d5d520e7d7a6cecf8e78c5dc4295550ffae04eb7e7b07639", + "loads": [ + 43, + 12, + 31, + 45, + 21, + 21, + 17, + 19, + 8, + 31, + 6, + 15, + 7, + 3, + 33, + 23, + 15, + 23, + 16, + 33, + 5, + 31, + 11, + 37, + 13, + 55, + 26, + 31, + 6, + 29, + 36, + 10, + 16, + 6, + 42, + 15, + 36, + 27, + 21, + 35, + 59, + 3, + 24, + 5, + 6, + 39, + 15, + 5, + 27, + 20, + 3, + 52, + 30, + 5, + 20, + 15, + 47, + 47, + 20, + 26, + 7, + 10, + 94, + 5 + ], + "weighted_loads": [ + 2.9180593490600586, + 0.6040445193648338, + 1.9315967857837677, + 1.97997659817338, + 1.158518709242344, + 1.3860335238277912, + 0.6689596604555845, + 1.1579510420560837, + 0.44079895690083504, + 1.6827925499528646, + 0.35715555027127266, + 0.8918725196272135, + 0.2906966358423233, + 0.0909719206392765, + 2.235723650082946, + 1.881525818258524, + 1.3374999910593033, + 1.1936432514339685, + 0.5877571627497673, + 2.560818087309599, + 0.33014165610074997, + 2.357144195586443, + 0.7984908744692802, + 1.9707417972385883, + 0.5654492489993572, + 4.102372948080301, + 1.7398832589387894, + 1.9153630137443542, + 0.20587601326406002, + 2.2017037980258465, + 2.4184547252953053, + 0.4228663332760334, + 1.622970376163721, + 0.3352269120514393, + 5.240406401455402, + 1.1267887614667416, + 2.659235503524542, + 1.8490815684199333, + 1.9933013170957565, + 2.3497086875140667, + 5.7910197377204895, + 0.15667984634637833, + 2.016112983226776, + 0.1623058896511793, + 0.21626067161560059, + 2.215861039236188, + 0.7960523813962936, + 0.26029013097286224, + 1.6269482467323542, + 1.1558963470160961, + 0.1658935509622097, + 3.7279099225997925, + 2.5720639675855637, + 0.2753528133034706, + 1.3269997853785753, + 1.066892709583044, + 2.8201546501368284, + 2.9560538344085217, + 1.4613762348890305, + 1.862151900306344, + 0.3914404325187206, + 0.6788827534765005, + 7.744983866810799, + 0.22295136004686356 + ], + "unique_experts": 64, + "load_cv": 0.7192617979445501, + "normalized_load_entropy": 0.9417329045304874, + "max_load_share": 0.06291834002677377 + }, + "full_input": { + "tokens": 290, + "top_k": 6, + "decisions": 1740, + "ordered_route_sha256": "992813e26e780390b20c78b2ea3516775ace27c2adc6b4e91fb403a0d7ebff80", + "route_weight_sha256": "ccfd80ba9468ea6d130ae26da64d3f30925ced69072eabd85071499c0fe6297a", + "loads": [ + 43, + 12, + 31, + 47, + 22, + 23, + 23, + 19, + 22, + 33, + 13, + 20, + 7, + 9, + 35, + 25, + 31, + 27, + 18, + 34, + 6, + 31, + 13, + 41, + 18, + 55, + 34, + 32, + 8, + 35, + 36, + 10, + 22, + 15, + 42, + 15, + 36, + 31, + 37, + 38, + 61, + 18, + 34, + 7, + 15, + 39, + 19, + 12, + 27, + 20, + 25, + 52, + 30, + 5, + 24, + 24, + 47, + 53, + 22, + 26, + 7, + 17, + 97, + 10 + ], + "weighted_loads": [ + 2.9180593490600586, + 0.6040445193648338, + 1.9315967857837677, + 2.0433009266853333, + 1.2050284259021282, + 1.4841881953179836, + 1.058682445436716, + 1.1579510420560837, + 1.636847771704197, + 1.7846195008605719, + 0.906539786607027, + 1.5526183750480413, + 0.2906966358423233, + 0.43071276135742664, + 2.305060414597392, + 1.9793556444346905, + 3.9817434810101986, + 1.4010667521506548, + 0.6286502256989479, + 2.6283694691956043, + 0.39525483548641205, + 2.357144195586443, + 0.9157544933259487, + 2.1757688745856285, + 0.7458398994058371, + 4.102372948080301, + 2.4270827770233154, + 1.945898437872529, + 0.25577379018068314, + 2.9768070988357067, + 2.4184547252953053, + 0.4228663332760334, + 2.007190752774477, + 0.9488939680159092, + 5.240406401455402, + 1.1267887614667416, + 2.659235503524542, + 2.0768221020698547, + 3.678460258990526, + 2.488971274346113, + 6.013309061527252, + 1.4582566283643246, + 2.8118245378136635, + 0.22041275911033154, + 1.4084989912807941, + 2.215861039236188, + 0.9826572611927986, + 0.681852824985981, + 1.6269482467323542, + 1.1558963470160961, + 1.6703979764133692, + 3.7279099225997925, + 2.5720639675855637, + 0.2753528133034706, + 1.5338717568665743, + 1.836116285994649, + 2.8201546501368284, + 3.491358730942011, + 1.5027828235179186, + 1.862151900306344, + 0.3914404325187206, + 1.0251162592321634, + 7.822107119485736, + 0.4078621119260788 + ], + "unique_experts": 64, + "load_cv": 0.580508703980409, + "normalized_load_entropy": 0.9625490195244144, + "max_load_share": 0.05574712643678161 + } + }, + "s0_period": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "a2419ec0b9dd0650668a02de917c56d77bcdba3a819b91d432c3eca9c1bfcf84", + "route_weight_sha256": "b83a0fc9c2063a5961ff014498685a1b3f1b51cd53c2fe0e0cc56c81353cfa6f", + "loads": [ + 43, + 10, + 32, + 45, + 21, + 20, + 15, + 19, + 8, + 32, + 6, + 14, + 6, + 2, + 33, + 23, + 15, + 25, + 16, + 32, + 6, + 31, + 11, + 37, + 12, + 55, + 27, + 31, + 7, + 30, + 36, + 9, + 18, + 5, + 42, + 15, + 34, + 26, + 23, + 35, + 59, + 4, + 23, + 6, + 6, + 38, + 13, + 6, + 27, + 20, + 4, + 51, + 30, + 6, + 20, + 15, + 46, + 47, + 20, + 28, + 9, + 10, + 95, + 4 + ], + "weighted_loads": [ + 2.9022653996944427, + 0.5375459715723991, + 1.9836888760328293, + 2.005557667464018, + 1.1567551866173744, + 1.3774905614554882, + 0.5880810506641865, + 1.1462744660675526, + 0.4328828454017639, + 1.7430339809507132, + 0.34921223670244217, + 0.8923557121306658, + 0.2274520080536604, + 0.06738918647170067, + 2.227543655782938, + 1.8899511732161045, + 1.3376255054026842, + 1.286645220592618, + 0.581207238137722, + 2.496017921715975, + 0.3976593352854252, + 2.3876275084912777, + 0.7984576560556889, + 1.9855237752199173, + 0.5382098983973265, + 4.060746755450964, + 1.8134955614805222, + 1.9435844644904137, + 0.23342940770089626, + 2.2281445544213057, + 2.422815229743719, + 0.4107768014073372, + 1.6870513502508402, + 0.2688852623105049, + 5.346655696630478, + 1.1119662560522556, + 2.571448989212513, + 1.8161246702075005, + 2.1391073018312454, + 2.38123619556427, + 5.728676900267601, + 0.23462535440921783, + 1.9741133973002434, + 0.19960218109190464, + 0.2155260108411312, + 2.154952520504594, + 0.7123188599944115, + 0.2875592652708292, + 1.6517483703792095, + 1.167626991868019, + 0.20781921967864037, + 3.6634209379553795, + 2.575380275025964, + 0.3067722227424383, + 1.333815485239029, + 1.0845344588160515, + 2.7470393236726522, + 2.90652871504426, + 1.5016593895852566, + 1.9289163369685411, + 0.46583839505910873, + 0.6966854184865952, + 7.925955910235643, + 0.1898169256746769 + ], + "unique_experts": 64, + "load_cv": 0.7191820635220403, + "normalized_load_entropy": 0.9421009721324146, + "max_load_share": 0.06358768406961178 + }, + "full_input": { + "tokens": 274, + "top_k": 6, + "decisions": 1644, + "ordered_route_sha256": "418bbe7acabe74d79c8d4c849ad05a934338d415cc3efa22709e92364c9950ff", + "route_weight_sha256": "e61f6b2bc688f5801f903ae281828b44006cb3c92f30e8afd8b86370d7787327", + "loads": [ + 43, + 10, + 32, + 48, + 21, + 21, + 20, + 19, + 16, + 32, + 7, + 18, + 6, + 7, + 33, + 23, + 30, + 27, + 18, + 33, + 7, + 31, + 15, + 39, + 15, + 55, + 31, + 31, + 9, + 30, + 36, + 9, + 21, + 7, + 42, + 15, + 34, + 26, + 34, + 38, + 59, + 16, + 28, + 8, + 9, + 38, + 14, + 8, + 27, + 20, + 21, + 51, + 30, + 7, + 20, + 22, + 46, + 47, + 23, + 28, + 9, + 16, + 97, + 11 + ], + "weighted_loads": [ + 2.9022653996944427, + 0.5375459715723991, + 1.9836888760328293, + 2.116446617990732, + 1.1567551866173744, + 1.4189629666507244, + 0.9850883260369301, + 1.1462744660675526, + 1.0603410862386227, + 1.7430339809507132, + 0.382313497364521, + 1.4819542188197374, + 0.2274520080536604, + 0.35377092845737934, + 2.227543655782938, + 1.8899511732161045, + 3.561091525480151, + 1.4045482035726309, + 0.6225397102534771, + 2.5643920116126537, + 0.4634103737771511, + 2.3876275084912777, + 1.0149522833526134, + 2.122479259967804, + 0.6630862653255463, + 4.060746755450964, + 2.1351685747504234, + 1.9435844644904137, + 0.28351004607975483, + 2.2281445544213057, + 2.422815229743719, + 0.4107768014073372, + 1.800770165398717, + 0.4061715006828308, + 5.346655696630478, + 1.1119662560522556, + 2.571448989212513, + 1.8161246702075005, + 3.157098837196827, + 2.509043138474226, + 5.728676900267601, + 1.1821596957743168, + 2.340239617973566, + 0.24764119274914265, + 0.8616877049207687, + 2.154952520504594, + 0.7671624757349491, + 0.44974632002413273, + 1.6517483703792095, + 1.167626991868019, + 1.605164123699069, + 3.6634209379553795, + 2.575380275025964, + 0.33800774812698364, + 1.333815485239029, + 1.7433453053236008, + 2.7470393236726522, + 2.90652871504426, + 1.571498766541481, + 1.9289163369685411, + 0.46583839505910873, + 0.9952674880623817, + 7.9691657312214375, + 0.4582367278635502 + ], + "unique_experts": 64, + "load_cv": 0.6186702550506717, + "normalized_load_entropy": 0.9581505368055957, + "max_load_share": 0.05900243309002433 + } + }, + "s1_period": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "8e259d630494119e551d14b6f12974cfd6968b68ccd27e027f5d5850a950644f", + "route_weight_sha256": "25c9e25f474a8757b936252cc07d10119e0c2693326b606921259c7b25c949ff", + "loads": [ + 43, + 11, + 32, + 47, + 21, + 20, + 21, + 19, + 8, + 31, + 6, + 15, + 7, + 3, + 33, + 23, + 15, + 23, + 16, + 33, + 5, + 31, + 11, + 38, + 10, + 55, + 26, + 30, + 7, + 29, + 36, + 10, + 15, + 6, + 41, + 16, + 36, + 26, + 21, + 35, + 59, + 3, + 23, + 5, + 6, + 39, + 16, + 6, + 26, + 20, + 3, + 53, + 30, + 5, + 19, + 15, + 47, + 47, + 22, + 24, + 8, + 10, + 92, + 5 + ], + "weighted_loads": [ + 2.9274588488042355, + 0.574413888156414, + 1.9612878039479256, + 2.060368150472641, + 1.159175094217062, + 1.341717729344964, + 0.8078654762357473, + 1.1637225858867168, + 0.4398980215191841, + 1.6947752870619297, + 0.35829073935747147, + 0.8926969598978758, + 0.29023638740181923, + 0.09136273339390755, + 2.2473837696015835, + 1.8812133260071278, + 1.3567023426294327, + 1.1911605224013329, + 0.5833981093019247, + 2.5547020211815834, + 0.3319639340043068, + 2.3546285070478916, + 0.7949739396572113, + 2.0115630105137825, + 0.4671280086040497, + 4.125489443540573, + 1.7461942844092846, + 1.8670400530099869, + 0.2365642637014389, + 2.1994678638875484, + 2.4194556958973408, + 0.42634589970111847, + 1.6100654751062393, + 0.3330125957727432, + 5.204160865396261, + 1.1701833978295326, + 2.658586075529456, + 1.7873430773615837, + 2.012595985084772, + 2.371472366154194, + 5.836071249097586, + 0.1626570113003254, + 1.9646034613251686, + 0.15761246532201767, + 0.21600203402340412, + 2.2101835012435913, + 0.8305026143789291, + 0.27967075631022453, + 1.6026978679001331, + 1.1620720364153385, + 0.17712753266096115, + 3.788842026144266, + 2.574373373761773, + 0.273060891777277, + 1.2893706150352955, + 1.0735497660934925, + 2.840630764141679, + 2.9609491620212793, + 1.5357337184250355, + 1.7631272412836552, + 0.42032344825565815, + 0.6763113494962454, + 7.677008984610438, + 0.221103273332119 + ], + "unique_experts": 64, + "load_cv": 0.7151038193653241, + "normalized_load_entropy": 0.9422524543862448, + "max_load_share": 0.06157965194109773 + }, + "full_input": { + "tokens": 290, + "top_k": 6, + "decisions": 1740, + "ordered_route_sha256": "52039f0856ba0dda51be7958b46a9b387138efd5b6acb0087c20960bc34651c2", + "route_weight_sha256": "95782abbba5beb49bc7049cf8b3c6339b6d355efb1b55e6c9064a8d5eb50c270", + "loads": [ + 43, + 11, + 32, + 49, + 22, + 22, + 28, + 19, + 24, + 33, + 12, + 20, + 7, + 8, + 35, + 25, + 31, + 26, + 18, + 34, + 6, + 31, + 14, + 41, + 14, + 55, + 34, + 31, + 9, + 35, + 36, + 10, + 22, + 15, + 41, + 16, + 36, + 30, + 38, + 38, + 61, + 20, + 33, + 7, + 15, + 39, + 18, + 12, + 26, + 20, + 27, + 53, + 30, + 5, + 23, + 24, + 47, + 53, + 24, + 24, + 8, + 16, + 95, + 9 + ], + "weighted_loads": [ + 2.9274588488042355, + 0.574413888156414, + 1.9612878039479256, + 2.1236924789845943, + 1.2056848108768463, + 1.4158026706427336, + 1.2320118136703968, + 1.1637225858867168, + 1.7601998373866081, + 1.796602237969637, + 0.877921462059021, + 1.5044853817671537, + 0.29023638740181923, + 0.40095928870141506, + 2.3167205341160297, + 1.9790431521832943, + 3.9414417035877705, + 1.3486938029527664, + 0.6242911722511053, + 2.623633287847042, + 0.39124786481261253, + 2.3546285070478916, + 0.9444742426276207, + 2.1832523345947266, + 0.6150667909532785, + 4.125489443540573, + 2.403241164982319, + 1.8975754771381617, + 0.286462040618062, + 2.9745711646974087, + 2.4194556958973408, + 0.42634589970111847, + 2.027394160628319, + 0.9445273131132126, + 5.204160865396261, + 1.1701833978295326, + 2.658586075529456, + 2.015083611011505, + 3.778369165956974, + 2.510708600282669, + 6.058360572904348, + 1.5752872060984373, + 2.758996434509754, + 0.2157193347811699, + 1.408218989148736, + 2.2101835012435913, + 0.9357627183198929, + 0.6321541033685207, + 1.6026978679001331, + 1.1620720364153385, + 2.137694189324975, + 3.788842026144266, + 2.574373373761773, + 0.273060891777277, + 1.4962425865232944, + 1.8427733425050974, + 2.840630764141679, + 3.4962540585547686, + 1.5771403070539236, + 1.7631272412836552, + 0.42032344825565815, + 0.968335123732686, + 7.754132237285376, + 0.3374684378504753 + ], + "unique_experts": 64, + "load_cv": 0.578794698443436, + "normalized_load_entropy": 0.9624453708422483, + "max_load_share": 0.05459770114942529 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 249, + "ordered_topk_exact_tokens": 196, + "set_exact_tokens": 220, + "mean_set_jaccard": 0.9667240390131957, + "mean_token_weighted_tv": 0.007439328720381701, + "aggregate_load_tv": 0.013386880856760371 + }, + "system_bos": { + "tokens": 249, + "ordered_topk_exact_tokens": 173, + "set_exact_tokens": 204, + "mean_set_jaccard": 0.9475043029259896, + "mean_token_weighted_tv": 0.012458095962862414, + "aggregate_load_tv": 0.021419009370816592 + }, + "system_x": { + "tokens": 249, + "ordered_topk_exact_tokens": 165, + "set_exact_tokens": 198, + "mean_set_jaccard": 0.9397590361445783, + "mean_token_weighted_tv": 0.014376897809944719, + "aggregate_load_tv": 0.0180722891566265 + }, + "system_period": { + "tokens": 249, + "ordered_topk_exact_tokens": 166, + "set_exact_tokens": 196, + "mean_set_jaccard": 0.9391853126792886, + "mean_token_weighted_tv": 0.014772426097627625, + "aggregate_load_tv": 0.01941097724230254 + }, + "bos_at_s0": { + "tokens": 249, + "ordered_topk_exact_tokens": 159, + "set_exact_tokens": 190, + "mean_set_jaccard": 0.9323006310958118, + "mean_token_weighted_tv": 0.01636126625115972, + "aggregate_load_tv": 0.022088353413654612 + }, + "bos_at_s1": { + "tokens": 249, + "ordered_topk_exact_tokens": 148, + "set_exact_tokens": 179, + "mean_set_jaccard": 0.9170969592656338, + "mean_token_weighted_tv": 0.019075460133542978, + "aggregate_load_tv": 0.02141900937081659 + }, + "x_at_s0": { + "tokens": 249, + "ordered_topk_exact_tokens": 165, + "set_exact_tokens": 194, + "mean_set_jaccard": 0.9368904188181296, + "mean_token_weighted_tv": 0.015885987225545937, + "aggregate_load_tv": 0.01740294511378848 + }, + "x_at_s1": { + "tokens": 249, + "ordered_topk_exact_tokens": 143, + "set_exact_tokens": 179, + "mean_set_jaccard": 0.9162363740676994, + "mean_token_weighted_tv": 0.019878316184423536, + "aggregate_load_tv": 0.022757697456492632 + }, + "period_at_s0": { + "tokens": 249, + "ordered_topk_exact_tokens": 163, + "set_exact_tokens": 195, + "mean_set_jaccard": 0.9380378657487091, + "mean_token_weighted_tv": 0.015881587081704753, + "aggregate_load_tv": 0.019410977242302542 + }, + "period_at_s1": { + "tokens": 249, + "ordered_topk_exact_tokens": 144, + "set_exact_tokens": 180, + "mean_set_jaccard": 0.9199655765920826, + "mean_token_weighted_tv": 0.0195393473336316, + "aggregate_load_tv": 0.024096385542168672 + } + } + }, + "layer_08": { + "layer": 8, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "7604ca120edd6533b6af5801b9cd81aced051dff5fd4db1905a0e8c496260c3c", + "route_weight_sha256": "53f542f253dbe825dbcf6065340c40d6880f7a700c4d48d3e444e8ec2be87876", + "loads": [ + 36, + 0, + 2, + 33, + 8, + 42, + 18, + 3, + 1, + 17, + 29, + 2, + 20, + 12, + 22, + 3, + 64, + 11, + 19, + 76, + 36, + 37, + 36, + 36, + 33, + 18, + 2, + 20, + 17, + 50, + 30, + 30, + 1, + 4, + 37, + 17, + 5, + 2, + 43, + 38, + 16, + 55, + 51, + 34, + 6, + 23, + 12, + 17, + 23, + 4, + 4, + 22, + 17, + 26, + 31, + 11, + 7, + 64, + 32, + 51, + 39, + 1, + 31, + 7 + ], + "weighted_loads": [ + 1.892388727515936, + 0.0, + 0.0636989213526249, + 2.6317571215331554, + 0.4772601053118706, + 2.39865948446095, + 1.0438569262623787, + 0.11191197484731674, + 0.03919816017150879, + 0.985723901540041, + 2.204714898020029, + 0.08365574106574059, + 1.268963497132063, + 0.6757155954837799, + 1.3277327008545399, + 0.1466488502919674, + 5.393683018162847, + 0.5908188819885254, + 0.9252929612994194, + 4.791923891752958, + 3.0105105843394995, + 2.0482526794075966, + 2.0980724543333054, + 1.9108335338532925, + 2.0872959569096565, + 1.0539625957608223, + 0.08815821260213852, + 0.9546900186687708, + 0.7996606156229973, + 3.1387672312557697, + 1.890429638326168, + 3.0204312093555927, + 0.03708847239613533, + 0.17748327180743217, + 2.263415766879916, + 0.6911620870232582, + 0.22162922099232674, + 0.10613960027694702, + 2.684686630964279, + 3.154098305851221, + 0.6070587709546089, + 3.092384811490774, + 3.3363768942654133, + 1.9700699150562286, + 0.19333003275096416, + 1.6332802549004555, + 0.7777129448950291, + 1.2295007221400738, + 1.6359452977776527, + 0.1921963207423687, + 0.15730902180075645, + 1.426515769213438, + 1.232737084850669, + 1.6051515974104404, + 1.5259293131530285, + 0.7845913805067539, + 0.2933831699192524, + 5.3462534584105015, + 1.5905463341623545, + 3.6136099193245173, + 2.3719261810183525, + 0.02508915401995182, + 1.683214070275426, + 0.513192979618907 + ], + "unique_experts": 63, + "load_cv": 0.7627550561637979, + "normalized_load_entropy": 0.9251634063045578, + "max_load_share": 0.050870147255689425 + }, + "full_input": { + "tokens": 274, + "top_k": 6, + "decisions": 1644, + "ordered_route_sha256": "566ae70c9cabbe1c9d85dfd7b5fd179f9b97b3eba45932dcbd5a9c6dcdd412d9", + "route_weight_sha256": "07b7d98200d34860758fc6107d8d6fb249d8606b39af721967b340ee7c89d4cf", + "loads": [ + 36, + 6, + 4, + 35, + 10, + 42, + 23, + 4, + 9, + 17, + 30, + 4, + 26, + 19, + 22, + 3, + 64, + 14, + 20, + 76, + 37, + 37, + 38, + 36, + 33, + 29, + 2, + 20, + 17, + 50, + 33, + 30, + 5, + 18, + 37, + 17, + 5, + 2, + 43, + 45, + 23, + 55, + 51, + 34, + 6, + 29, + 19, + 21, + 23, + 7, + 7, + 22, + 29, + 26, + 35, + 18, + 7, + 64, + 36, + 51, + 39, + 1, + 33, + 10 + ], + "weighted_loads": [ + 1.892388727515936, + 0.37001389637589455, + 0.10278709419071674, + 2.7453580163419247, + 0.5405436360742897, + 2.39865948446095, + 1.4785704463720322, + 0.15708698332309723, + 0.5842981450259686, + 0.985723901540041, + 2.2793729417026043, + 0.1485988823696971, + 1.6089149415493011, + 1.15576708689332, + 1.3277327008545399, + 0.1466488502919674, + 5.393683018162847, + 0.7707848474383354, + 0.9578081220388412, + 4.791923891752958, + 3.0813457127660513, + 2.0482526794075966, + 2.1705225482583046, + 1.9108335338532925, + 2.0872959569096565, + 1.8242319151759148, + 0.08815821260213852, + 0.9546900186687708, + 0.7996606156229973, + 3.1387672312557697, + 1.9590334151871502, + 3.0204312093555927, + 0.20846029371023178, + 1.2014103922992945, + 2.263415766879916, + 0.6911620870232582, + 0.22162922099232674, + 0.10613960027694702, + 2.684686630964279, + 3.3681675447151065, + 0.9787188097834587, + 3.092384811490774, + 3.3363768942654133, + 1.9700699150562286, + 0.19333003275096416, + 2.168880894780159, + 1.5351742692291737, + 1.3513020910322666, + 1.6359452977776527, + 0.3406890891492367, + 0.32883234694600105, + 1.426515769213438, + 1.9261167384684086, + 1.6051515974104404, + 3.105347741395235, + 1.2586146462708712, + 0.2933831699192524, + 5.3462534584105015, + 1.7069167934823781, + 3.6136099193245173, + 2.3719261810183525, + 0.02508915401995182, + 1.7716082949191332, + 0.7197855357080698 + ], + "unique_experts": 64, + "load_cv": 0.6610800071323604, + "normalized_load_entropy": 0.9439961899203763, + "max_load_share": 0.046228710462287104 + } + }, + "s1_eos": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "c965523408a5f31b8a5790bd55d34fb32e0bf1bd6e49eb3f86a7030a791a7a64", + "route_weight_sha256": "100519e03caa96c0b7d06d5ce4ad2a71c6f9dfa1cb3c3e29e7c65f0bf6af9848", + "loads": [ + 37, + 0, + 2, + 33, + 7, + 43, + 18, + 2, + 1, + 16, + 29, + 4, + 20, + 12, + 23, + 3, + 65, + 11, + 20, + 77, + 36, + 37, + 36, + 36, + 33, + 19, + 2, + 20, + 16, + 50, + 29, + 30, + 1, + 4, + 38, + 17, + 6, + 2, + 44, + 38, + 15, + 53, + 50, + 33, + 8, + 23, + 11, + 17, + 22, + 4, + 5, + 21, + 17, + 25, + 31, + 11, + 6, + 63, + 31, + 53, + 40, + 1, + 30, + 7 + ], + "weighted_loads": [ + 1.925453782081604, + 0.0, + 0.0628905426710844, + 2.642807375639677, + 0.4311567693948746, + 2.4516882486641407, + 1.048437088727951, + 0.06679163873195648, + 0.039647750556468964, + 0.954527735710144, + 2.2095366679131985, + 0.16384406760334969, + 1.2779382057487965, + 0.6552911847829819, + 1.3587147500365973, + 0.1449010968208313, + 5.443991908803582, + 0.5753797888755798, + 0.9414385389536619, + 4.856354892253876, + 3.0163208413869143, + 2.064201720058918, + 2.1043361984193325, + 1.9150409158319235, + 2.092262789607048, + 1.0814026221632957, + 0.08804358169436455, + 0.9472954031080008, + 0.7699664048850536, + 3.1510549150407314, + 1.8339117765426636, + 3.0014131851494312, + 0.03607141226530075, + 0.17038950324058533, + 2.305359985679388, + 0.692265972495079, + 0.25572777539491653, + 0.10642861947417259, + 2.7165750321000814, + 3.1171792075037956, + 0.5675067137926817, + 2.996506441384554, + 3.295365497469902, + 1.9299241043627262, + 0.2700316868722439, + 1.5710964612662792, + 0.7140677869319916, + 1.225542824715376, + 1.5918490663170815, + 0.19866548478603363, + 0.19535596296191216, + 1.3936315104365349, + 1.2203289531171322, + 1.5688802190124989, + 1.4960995353758335, + 0.7881215959787369, + 0.2539425529539585, + 5.295766368508339, + 1.558641117066145, + 3.6713456381112337, + 2.3907490596175194, + 0.025418536737561226, + 1.6467238292098045, + 0.536972789093852 + ], + "unique_experts": 63, + "load_cv": 0.7643322831113317, + "normalized_load_entropy": 0.9254435996996125, + "max_load_share": 0.051539491298527446 + }, + "full_input": { + "tokens": 290, + "top_k": 6, + "decisions": 1740, + "ordered_route_sha256": "3dfb74331064bbd8c3ee95d2f12285740a94c504f6ce57c037266df1704ad158", + "route_weight_sha256": "a6aaf00cb3890812bc6cbfd67ad315e1107c8d4effb8acaadde166c6b9d5fc68", + "loads": [ + 38, + 5, + 12, + 35, + 7, + 44, + 29, + 2, + 13, + 16, + 33, + 8, + 29, + 19, + 23, + 3, + 65, + 25, + 22, + 77, + 37, + 37, + 37, + 40, + 33, + 30, + 2, + 22, + 17, + 50, + 32, + 30, + 5, + 23, + 38, + 17, + 6, + 2, + 51, + 44, + 28, + 53, + 52, + 33, + 8, + 35, + 26, + 21, + 25, + 9, + 9, + 21, + 27, + 31, + 35, + 21, + 6, + 63, + 34, + 55, + 40, + 5, + 33, + 12 + ], + "weighted_loads": [ + 1.9646484442055225, + 0.2788397390395403, + 0.6861540172249079, + 2.768626783043146, + 0.4311567693948746, + 2.496039994060993, + 1.978105828166008, + 0.06679163873195648, + 0.8348126783967018, + 0.954527735710144, + 2.43019887059927, + 0.28302208590321243, + 1.814352598041296, + 1.1060684882104397, + 1.3587147500365973, + 0.1449010968208313, + 5.443991908803582, + 1.5920922979712486, + 1.037591790780425, + 4.856354892253876, + 3.091323072090745, + 2.064201720058918, + 2.1443089693784714, + 2.1036334317177534, + 2.092262789607048, + 2.1942192390561104, + 0.08804358169436455, + 1.06604646705091, + 0.8122264705598354, + 3.1510549150407314, + 1.9005906293168664, + 3.0014131851494312, + 0.18057484552264214, + 1.42353056371212, + 2.305359985679388, + 0.692265972495079, + 0.25572777539491653, + 0.10642861947417259, + 3.155087763443589, + 3.2789957807399333, + 1.156057769432664, + 2.996506441384554, + 3.463165171444416, + 1.9299241043627262, + 0.2700316868722439, + 2.6754095517098904, + 1.8106440715491772, + 1.3395596174523234, + 1.9051916152238846, + 0.5153850950300694, + 0.4145679585635662, + 1.3936315104365349, + 1.7735878136008978, + 2.244847621768713, + 3.080372206866741, + 1.485645592212677, + 0.2539425529539585, + 5.295766368508339, + 1.6588962834794074, + 3.7432814184576273, + 2.3907490596175194, + 0.21198987029492855, + 1.7856823615729809, + 0.8247891385108232 + ], + "unique_experts": 64, + "load_cv": 0.6189631159304106, + "normalized_load_entropy": 0.9504652235886342, + "max_load_share": 0.044252873563218394 + } + }, + "s0_bos": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "17b966caa09b707c86a30a7ee864c6d76e1e470e7c5d0b1c07412d4d8b1bcda2", + "route_weight_sha256": "92d0695510081dc10a68f74d02f318533016bc20092892ac29f937bcc88bd26d", + "loads": [ + 38, + 0, + 1, + 31, + 9, + 46, + 18, + 3, + 1, + 17, + 29, + 3, + 19, + 12, + 22, + 3, + 61, + 10, + 17, + 75, + 35, + 37, + 37, + 36, + 33, + 18, + 1, + 20, + 19, + 49, + 32, + 31, + 0, + 5, + 37, + 18, + 7, + 2, + 42, + 38, + 17, + 55, + 52, + 35, + 4, + 23, + 12, + 16, + 25, + 4, + 5, + 22, + 18, + 24, + 32, + 11, + 6, + 64, + 29, + 51, + 41, + 0, + 30, + 6 + ], + "weighted_loads": [ + 1.9895435459911823, + 0.0, + 0.041426341980695724, + 2.5345780439674854, + 0.5549509599804878, + 2.5820277240127325, + 1.0750977545976639, + 0.11140849068760872, + 0.038453105837106705, + 0.999616663902998, + 2.188219252973795, + 0.10617418587207794, + 1.2441207319498062, + 0.6856664754450321, + 1.3172179441899061, + 0.14457476511597633, + 5.316610436886549, + 0.5636151898652315, + 0.8355137910693884, + 4.783025853335857, + 2.919744223356247, + 2.0532742235809565, + 2.128761902451515, + 1.945976559072733, + 2.087037529796362, + 1.0742108635604382, + 0.05457276850938797, + 0.9810357987880707, + 0.8770214486867189, + 3.144121304154396, + 2.017746962606907, + 3.1226356886327267, + 0.0, + 0.20840264111757278, + 2.2841424643993378, + 0.7165277600288391, + 0.29397520422935486, + 0.10924089699983597, + 2.6262007728219032, + 3.217440463602543, + 0.6448208466172218, + 3.122296730056405, + 3.3598654363304377, + 2.043881919234991, + 0.12445637956261635, + 1.6291731931269169, + 0.8185548968613148, + 1.1545583233237267, + 1.709829555824399, + 0.19433077424764633, + 0.1993052400648594, + 1.4240301735699177, + 1.266150590032339, + 1.5448162332177162, + 1.562219213694334, + 0.7860161177814007, + 0.25166507810354233, + 5.4345369301736355, + 1.509596087038517, + 3.555968625470996, + 2.480458166450262, + 0.0, + 1.6482316460460424, + 0.4739668183028698 + ], + "unique_experts": 61, + "load_cv": 0.7630557316905926, + "normalized_load_entropy": 0.9235173986157554, + "max_load_share": 0.050200803212851405 + }, + "full_input": { + "tokens": 274, + "top_k": 6, + "decisions": 1644, + "ordered_route_sha256": "54ec6adffb0b85288df65016fb23b45069d5d5ed2ead76470a2e305916a4fdb6", + "route_weight_sha256": "24fd30fa72cd8743df8b7a070f5b6e39cd5e77ab61954ce09dc8823feb9dbc2c", + "loads": [ + 38, + 6, + 3, + 33, + 10, + 46, + 23, + 4, + 9, + 17, + 30, + 5, + 25, + 20, + 22, + 4, + 61, + 13, + 17, + 75, + 36, + 37, + 39, + 36, + 34, + 29, + 1, + 20, + 19, + 49, + 35, + 31, + 4, + 20, + 37, + 18, + 7, + 2, + 42, + 44, + 23, + 55, + 52, + 35, + 4, + 30, + 19, + 19, + 25, + 7, + 8, + 22, + 30, + 24, + 36, + 19, + 6, + 64, + 32, + 51, + 41, + 0, + 32, + 9 + ], + "weighted_loads": [ + 1.9895435459911823, + 0.37001389637589455, + 0.08051451481878757, + 2.6468641199171543, + 0.6154307946562767, + 2.5820277240127325, + 1.5172557532787323, + 0.1565834991633892, + 0.6008064858615398, + 0.999616663902998, + 2.2629369534552097, + 0.17111732717603445, + 1.5840721763670444, + 1.2051495276391506, + 1.3172179441899061, + 0.1908511035144329, + 5.316610436886549, + 0.7505171690136194, + 0.8355137910693884, + 4.783025853335857, + 2.9885319024324417, + 2.0532742235809565, + 2.2012119963765144, + 1.945976559072733, + 2.133505240082741, + 1.8444801829755306, + 0.05457276850938797, + 0.9810357987880707, + 0.8770214486867189, + 3.144121304154396, + 2.137724831700325, + 3.1226356886327267, + 0.17137182131409645, + 1.3397148381918669, + 2.2841424643993378, + 0.7165277600288391, + 0.29397520422935486, + 0.10924089699983597, + 2.6262007728219032, + 3.4453092804178596, + 1.001031268388033, + 3.122296730056405, + 3.3598654363304377, + 2.043881919234991, + 0.12445637956261635, + 2.203836664557457, + 1.5361574925482273, + 1.2669842224568129, + 1.709829555824399, + 0.3450227826833725, + 0.370828565210104, + 1.4240301735699177, + 1.9704716335982084, + 1.5448162332177162, + 2.2698747999966145, + 1.3076843153685331, + 0.25166507810354233, + 5.4345369301736355, + 1.6229370683431625, + 3.555968625470996, + 2.480458166450262, + 0.0, + 1.7435568626970053, + 0.6805593743920326 + ], + "unique_experts": 63, + "load_cv": 0.6608292214440867, + "normalized_load_entropy": 0.9429129314005935, + "max_load_share": 0.04562043795620438 + } + }, + "s1_bos": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "dba6f0fd80b4008cc1df7c6e3e9e63a4854f01d08dd32e91324e0bdf8805a2fb", + "route_weight_sha256": "7b3950e375401fcfb0f4e311217107e155e4484abaeda4ba2ca21c37f316ea3c", + "loads": [ + 39, + 0, + 1, + 32, + 10, + 44, + 18, + 3, + 1, + 17, + 29, + 4, + 19, + 13, + 22, + 3, + 64, + 10, + 20, + 76, + 34, + 36, + 35, + 36, + 32, + 19, + 1, + 19, + 20, + 50, + 30, + 30, + 0, + 2, + 37, + 17, + 7, + 2, + 43, + 39, + 16, + 55, + 50, + 35, + 5, + 23, + 13, + 16, + 24, + 4, + 5, + 20, + 19, + 25, + 30, + 10, + 5, + 65, + 31, + 55, + 40, + 0, + 28, + 6 + ], + "weighted_loads": [ + 1.9759522341191769, + 0.0, + 0.042333170771598816, + 2.569273605942726, + 0.6087840683758259, + 2.501132659614086, + 1.0833989195525646, + 0.11185787431895733, + 0.03661751747131348, + 0.998767577111721, + 2.196867562830448, + 0.14084347523748875, + 1.2574874982237816, + 0.7208715416491032, + 1.3604764379560947, + 0.14580971002578735, + 5.424118807539344, + 0.5293476115912199, + 0.9214061629027128, + 4.894916534423828, + 2.871517399325967, + 2.049568273127079, + 2.040825167670846, + 1.975269017741084, + 2.039679542183876, + 1.0891920551657677, + 0.058367952704429626, + 0.9281445369124413, + 0.9115928933024406, + 3.2046613693237305, + 1.9231472946703434, + 3.070993598550558, + 0.0, + 0.10271881520748138, + 2.2955771815031767, + 0.681856507435441, + 0.28455688804388046, + 0.11223534867167473, + 2.642491413280368, + 3.174535134807229, + 0.6283745318651199, + 3.1443122643977404, + 3.2786805033683777, + 2.049587443470955, + 0.15653949603438377, + 1.6078490987420082, + 0.8496315162628889, + 1.1420246362686157, + 1.6737427413463593, + 0.19422999024391174, + 0.2011741604655981, + 1.3568166308104992, + 1.2595971543341875, + 1.576190808787942, + 1.4672865364700556, + 0.7386803105473518, + 0.22158139757812023, + 5.460368698462844, + 1.606371570378542, + 3.779182478785515, + 2.4355218708515167, + 0.0, + 1.5830166675150394, + 0.509251456707716 + ], + "unique_experts": 61, + "load_cv": 0.7709809074615173, + "normalized_load_entropy": 0.9225035849265341, + "max_load_share": 0.050870147255689425 + }, + "full_input": { + "tokens": 290, + "top_k": 6, + "decisions": 1740, + "ordered_route_sha256": "301a49ac0f20d6b8fb4d149f85e18564a40840f50286ffb9271cfdecdb83da43", + "route_weight_sha256": "ce2cceb631ad24bf4d40e66dda700d35206fb18b5c6648e78be5218ed196bfac", + "loads": [ + 40, + 5, + 11, + 34, + 11, + 45, + 29, + 3, + 13, + 17, + 33, + 7, + 28, + 20, + 22, + 3, + 64, + 25, + 22, + 76, + 35, + 36, + 36, + 40, + 33, + 30, + 1, + 21, + 21, + 50, + 33, + 30, + 4, + 24, + 37, + 17, + 7, + 2, + 49, + 44, + 28, + 55, + 52, + 35, + 5, + 36, + 28, + 19, + 27, + 10, + 9, + 20, + 29, + 31, + 33, + 20, + 5, + 65, + 33, + 56, + 40, + 4, + 31, + 11 + ], + "weighted_loads": [ + 2.0151468962430954, + 0.2788397390395403, + 0.6655966453254223, + 2.6917935386300087, + 0.6554768085479736, + 2.5454844050109386, + 2.01408776268363, + 0.11185787431895733, + 0.8534581772983074, + 0.998767577111721, + 2.4108174219727516, + 0.25687180552631617, + 1.7939018905162811, + 1.173723727464676, + 1.3604764379560947, + 0.14580971002578735, + 5.424118807539344, + 1.60147868655622, + 1.0137960594147444, + 4.894916534423828, + 2.9454379994422197, + 2.049568273127079, + 2.080797938629985, + 2.163861533626914, + 2.0820633098483086, + 2.2020086720585823, + 0.058367952704429626, + 1.0468956008553505, + 0.9538529589772224, + 3.2046613693237305, + 2.0338021852076054, + 3.070993598550558, + 0.14450343325734138, + 1.5621895678341389, + 2.2955771815031767, + 0.681856507435441, + 0.28455688804388046, + 0.11223534867167473, + 3.036926792934537, + 3.344021479599178, + 1.2151025794446468, + 3.1443122643977404, + 3.4464801773428917, + 2.049587443470955, + 0.15653949603438377, + 2.7607800662517548, + 1.9283255282789469, + 1.2470408845692873, + 1.9870852902531624, + 0.5589419864118099, + 0.42038615606725216, + 1.3568166308104992, + 1.8218012228608131, + 2.252158211544156, + 2.1356917936354876, + 1.4473985433578491, + 0.22158139757812023, + 5.460368698462844, + 1.7037270441651344, + 3.811758030205965, + 2.4355218708515167, + 0.18657133355736732, + 1.7288925684988499, + 0.7970678061246872 + ], + "unique_experts": 64, + "load_cv": 0.6209748174231345, + "normalized_load_entropy": 0.949732343226371, + "max_load_share": 0.04367816091954023 + } + }, + "s0_x": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "879c2bb5ca31a8af74b8355aa41dedfe1d52ccd4be8c61e895795192d28b5342", + "route_weight_sha256": "bd2854ace91953b586eec8c7c74473c12e37e3b9def54c175d76f59a89720c05", + "loads": [ + 38, + 0, + 2, + 33, + 9, + 47, + 17, + 3, + 0, + 18, + 29, + 4, + 18, + 12, + 18, + 3, + 64, + 9, + 20, + 76, + 35, + 38, + 34, + 36, + 34, + 17, + 1, + 21, + 17, + 50, + 30, + 30, + 1, + 3, + 36, + 17, + 7, + 2, + 43, + 38, + 16, + 56, + 51, + 34, + 6, + 23, + 13, + 16, + 23, + 4, + 4, + 21, + 18, + 24, + 31, + 11, + 6, + 62, + 32, + 54, + 42, + 0, + 29, + 8 + ], + "weighted_loads": [ + 1.930392349138856, + 0.0, + 0.07576248794794083, + 2.6175412014126778, + 0.5680899731814861, + 2.595839472487569, + 1.0198357366025448, + 0.1154862567782402, + 0.0, + 1.0331070348620415, + 2.177709363400936, + 0.15056640841066837, + 1.181796982884407, + 0.6656448766589165, + 1.1686371229588985, + 0.14509861916303635, + 5.475479606539011, + 0.49840804375708103, + 0.9773038662970066, + 4.782570881769061, + 2.9016230069100857, + 2.1126846447587013, + 2.0208568833768368, + 1.9283496085554361, + 2.1514784060418606, + 1.0408058688044548, + 0.05300125479698181, + 1.0446850024163723, + 0.7864411994814873, + 3.1821211595088243, + 1.9413352087140083, + 3.0825111381709576, + 0.0348464772105217, + 0.13362909108400345, + 2.241735216230154, + 0.6816963069140911, + 0.29275282472372055, + 0.1119452640414238, + 2.710730377584696, + 3.1972099877893925, + 0.6141201592981815, + 3.1557822562754154, + 3.3144442457705736, + 2.044016385450959, + 0.19654997251927853, + 1.756739318370819, + 0.8684798404574394, + 1.1615643464028835, + 1.6192569583654404, + 0.18247362226247787, + 0.1568998545408249, + 1.3951526507735252, + 1.2422502432018518, + 1.5453673135489225, + 1.5423052478581667, + 0.794201098382473, + 0.25801039673388004, + 5.316966857761145, + 1.6270657908171415, + 3.6827486865222454, + 2.4983986094594, + 0.0, + 1.6166880670934916, + 0.5307330843061209 + ], + "unique_experts": 61, + "load_cv": 0.7710552854113584, + "normalized_load_entropy": 0.9230565986441679, + "max_load_share": 0.050870147255689425 + }, + "full_input": { + "tokens": 274, + "top_k": 6, + "decisions": 1644, + "ordered_route_sha256": "9c3a223abfa8c79b39aaf993426fc8bf5db7bea3eb22ac7c74a76ee6b10a5211", + "route_weight_sha256": "772362f2193f473b3b7821b55730c05c9fca6b0101a98708a63b8db62c9eabac", + "loads": [ + 38, + 7, + 5, + 35, + 10, + 47, + 23, + 4, + 10, + 18, + 30, + 7, + 24, + 20, + 18, + 3, + 64, + 12, + 20, + 76, + 36, + 38, + 36, + 36, + 34, + 29, + 1, + 21, + 17, + 50, + 32, + 30, + 6, + 16, + 36, + 17, + 7, + 2, + 43, + 43, + 22, + 56, + 51, + 34, + 6, + 29, + 20, + 19, + 23, + 8, + 8, + 21, + 29, + 24, + 33, + 19, + 6, + 62, + 35, + 54, + 42, + 0, + 31, + 11 + ], + "weighted_loads": [ + 1.930392349138856, + 0.42329105362296104, + 0.1552999410778284, + 2.726574845612049, + 0.628569807857275, + 2.595839472487569, + 1.4932564310729504, + 0.1606612652540207, + 0.6556232571601868, + 1.0331070348620415, + 2.2471186220645905, + 0.2557367095723748, + 1.5217484273016453, + 1.2325788922607899, + 1.1686371229588985, + 0.14509861916303635, + 5.475479606539011, + 0.6709082517772913, + 0.9773038662970066, + 4.782570881769061, + 2.9703331999480724, + 2.1126846447587013, + 2.093306977301836, + 1.9283496085554361, + 2.1514784060418606, + 1.9105899035930634, + 0.05300125479698181, + 1.0446850024163723, + 0.7864411994814873, + 3.1821211595088243, + 2.0012805946171284, + 3.0825111381709576, + 0.24864092841744423, + 1.0647161956876516, + 2.241735216230154, + 0.6816963069140911, + 0.29275282472372055, + 0.1119452640414238, + 2.710730377584696, + 3.3672865023836493, + 0.9415664002299309, + 3.1557822562754154, + 3.3144442457705736, + 2.044016385450959, + 0.19654997251927853, + 2.2903520464897156, + 1.5931913815438747, + 1.2739902455359697, + 1.6192569583654404, + 0.385562963783741, + 0.3821666017174721, + 1.3951526507735252, + 1.9007931277155876, + 1.5453673135489225, + 2.165822332724929, + 1.3128534387797117, + 0.25801039673388004, + 5.316966857761145, + 1.740406772121787, + 3.6827486865222454, + 2.4983986094594, + 0.0, + 1.7070350889116526, + 0.7373256403952837 + ], + "unique_experts": 63, + "load_cv": 0.6605066427868913, + "normalized_load_entropy": 0.9444271586718376, + "max_load_share": 0.046228710462287104 + } + }, + "s1_x": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "705ef517fef31dc1a6cb7f56297bf58bba8f78a744615d1d3f39b2c9d30244b1", + "route_weight_sha256": "9ac8c2aa54562da580880f1066b87c55b2bb3b946f0916ce5ad4fac2acfcbac8", + "loads": [ + 38, + 0, + 1, + 31, + 11, + 46, + 18, + 3, + 1, + 17, + 28, + 5, + 19, + 12, + 21, + 3, + 63, + 9, + 20, + 77, + 34, + 38, + 35, + 37, + 32, + 19, + 1, + 20, + 18, + 50, + 30, + 30, + 1, + 0, + 38, + 18, + 6, + 2, + 43, + 39, + 17, + 58, + 51, + 34, + 5, + 23, + 11, + 16, + 23, + 4, + 5, + 21, + 18, + 24, + 29, + 11, + 5, + 62, + 33, + 54, + 41, + 0, + 29, + 6 + ], + "weighted_loads": [ + 1.9156828504055738, + 0.0, + 0.04202986881136894, + 2.531293425709009, + 0.6621597856283188, + 2.5684740897268057, + 1.0836942195892334, + 0.10976866818964481, + 0.03269273787736893, + 0.9905483834445477, + 2.125480629503727, + 0.17972086183726788, + 1.2465906627476215, + 0.6570901498198509, + 1.3261042479425669, + 0.14495999366044998, + 5.367177251726389, + 0.49392545968294144, + 0.9335485473275185, + 4.863564603030682, + 2.8528928738087416, + 2.1540641225874424, + 2.0741793550550938, + 1.9830887075513601, + 2.043690074235201, + 1.0714953318238258, + 0.0643598660826683, + 0.9836055748164654, + 0.8360173497349024, + 3.21049396507442, + 1.9156061634421349, + 3.076153237372637, + 0.03332434222102165, + 0.0, + 2.308871364220977, + 0.7115732245147228, + 0.24734050780534744, + 0.11265125870704651, + 2.6379932034760714, + 3.135638039559126, + 0.6595948580652475, + 3.2628669794648886, + 3.2942060232162476, + 2.03722788579762, + 0.15388434566557407, + 1.6956050507724285, + 0.7785325385630131, + 1.1465241983532906, + 1.6085678711533546, + 0.19650554284453392, + 0.19879000261425972, + 1.39816527441144, + 1.181533858180046, + 1.5469962749630213, + 1.4146332275122404, + 0.826861459761858, + 0.22621659003198147, + 5.295841868966818, + 1.696244578808546, + 3.732535256072879, + 2.4781280495226383, + 0.0, + 1.6005563121289015, + 0.4935661293566227 + ], + "unique_experts": 61, + "load_cv": 0.7752830335596013, + "normalized_load_entropy": 0.9215294922808812, + "max_load_share": 0.051539491298527446 + }, + "full_input": { + "tokens": 290, + "top_k": 6, + "decisions": 1740, + "ordered_route_sha256": "59a4a5730aa4f5ac7cc546fc1e3bdb3393499df70e639d2f2bd3ba5df784f917", + "route_weight_sha256": "a68c0cc92baa721f1b9ef7d53e3334c18c5cbb4c0e349aa71cf946aebb2c4f8a", + "loads": [ + 39, + 6, + 12, + 34, + 11, + 47, + 30, + 3, + 15, + 17, + 32, + 9, + 28, + 22, + 21, + 3, + 63, + 23, + 22, + 77, + 35, + 38, + 36, + 41, + 32, + 32, + 1, + 22, + 19, + 50, + 32, + 30, + 6, + 17, + 38, + 18, + 6, + 2, + 50, + 42, + 29, + 58, + 53, + 34, + 5, + 35, + 25, + 19, + 26, + 10, + 10, + 21, + 27, + 30, + 31, + 20, + 5, + 62, + 35, + 55, + 41, + 4, + 33, + 11 + ], + "weighted_loads": [ + 1.9548775125294924, + 0.3230284992605448, + 0.7017843127250671, + 2.7013521790504456, + 0.6621597856283188, + 2.612825835123658, + 2.0442352183163166, + 0.10976866818964481, + 0.931947872042656, + 0.9905483834445477, + 2.341676030308008, + 0.33370881620794535, + 1.783005055040121, + 1.2724118363112211, + 1.3261042479425669, + 0.14495999366044998, + 5.367177251726389, + 1.515303447842598, + 1.0293965339660645, + 4.863564603030682, + 2.9249303694814444, + 2.1540641225874424, + 2.1141521260142326, + 2.17168122343719, + 2.043690074235201, + 2.3529266491532326, + 0.0643598660826683, + 1.1023566387593746, + 0.8782774154096842, + 3.21049396507442, + 1.972691722214222, + 3.076153237372637, + 0.21994709596037865, + 1.1144759133458138, + 2.308871364220977, + 0.7115732245147228, + 0.24734050780534744, + 0.11265125870704651, + 3.074018070474267, + 3.2125172587111592, + 1.2036547306925058, + 3.2628669794648886, + 3.4620056971907616, + 2.03722788579762, + 0.15388434566557407, + 2.7711731418967247, + 1.79423139244318, + 1.2515404466539621, + 1.9219104200601578, + 0.5786263160407543, + 0.4895515404641628, + 1.39816527441144, + 1.7007668633013964, + 2.2229636777192354, + 2.038119962438941, + 1.4454353712499142, + 0.22621659003198147, + 5.295841868966818, + 1.7936000525951385, + 3.765110807493329, + 2.4781280495226383, + 0.18657133355736732, + 1.7821867857128382, + 0.7813824787735939 + ], + "unique_experts": 64, + "load_cv": 0.619202134092184, + "normalized_load_entropy": 0.9505645719516537, + "max_load_share": 0.044252873563218394 + } + }, + "s0_period": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "6aea5497b0b129592fdabd34cf1aaf7cb13c8cd26b62f59df6a8cad60ec7f5d8", + "route_weight_sha256": "2231aa695b37c2eb445e01a15e41c37bd3e5485b6d431817ddd9b0eac45cbf68", + "loads": [ + 37, + 0, + 2, + 32, + 9, + 47, + 17, + 3, + 0, + 18, + 29, + 2, + 18, + 12, + 20, + 3, + 64, + 8, + 21, + 75, + 35, + 37, + 34, + 36, + 33, + 17, + 1, + 22, + 18, + 51, + 30, + 30, + 1, + 3, + 37, + 16, + 7, + 2, + 43, + 38, + 15, + 54, + 53, + 34, + 5, + 23, + 13, + 16, + 22, + 4, + 4, + 21, + 18, + 25, + 32, + 11, + 7, + 62, + 33, + 54, + 41, + 1, + 30, + 8 + ], + "weighted_loads": [ + 1.897322166711092, + 0.0, + 0.0776795819401741, + 2.588684655725956, + 0.5707263201475143, + 2.608800968155265, + 1.0315325446426868, + 0.114896509796381, + 0.0, + 1.0328155644237995, + 2.180928099900484, + 0.08276615291833878, + 1.1905507259070873, + 0.6567974239587784, + 1.2440679464489222, + 0.14601140469312668, + 5.476432394236326, + 0.46275613456964493, + 1.0225910022854805, + 4.76723893918097, + 2.894282089546323, + 2.0862007327377796, + 2.03638007119298, + 1.922190610319376, + 2.129491660743952, + 1.0538037084043026, + 0.05011274293065071, + 1.0829685237258673, + 0.8339086007326841, + 3.2115493956953287, + 1.9393599219620228, + 3.0771070569753647, + 0.035082969814538956, + 0.1324307732284069, + 2.27445175871253, + 0.6433057114481926, + 0.29284369572997093, + 0.11039648950099945, + 2.711350664496422, + 3.1876294426620007, + 0.5811144839972258, + 3.0856221560388803, + 3.41283056512475, + 2.0468617789447308, + 0.15497872792184353, + 1.7382144033908844, + 0.835210494697094, + 1.1748733706772327, + 1.5827139727771282, + 0.18451961874961853, + 0.15738778933882713, + 1.395752515643835, + 1.2476317137479782, + 1.5837902687489986, + 1.5496853087097406, + 0.7883693464100361, + 0.2942389566451311, + 5.313279949128628, + 1.6754741333425045, + 3.6770592220127583, + 2.4692300967872143, + 0.024917908012866974, + 1.6630195528268814, + 0.521303690969944 + ], + "unique_experts": 62, + "load_cv": 0.7699761019323866, + "normalized_load_entropy": 0.9231080864047104, + "max_load_share": 0.050200803212851405 + }, + "full_input": { + "tokens": 274, + "top_k": 6, + "decisions": 1644, + "ordered_route_sha256": "ec7433203ec24b3c8956b1aa6f6077e44071ffb4a2910cbee2c339f9c0e70abd", + "route_weight_sha256": "580009d44205faae635b130c097b018fda88cb54baea2360057acf188e00f7b4", + "loads": [ + 37, + 6, + 4, + 34, + 10, + 47, + 25, + 4, + 10, + 18, + 30, + 5, + 24, + 20, + 20, + 3, + 64, + 11, + 21, + 75, + 36, + 37, + 36, + 36, + 33, + 29, + 1, + 22, + 18, + 51, + 32, + 30, + 5, + 16, + 37, + 16, + 7, + 2, + 43, + 43, + 20, + 54, + 53, + 34, + 5, + 29, + 21, + 19, + 22, + 9, + 7, + 21, + 29, + 25, + 34, + 19, + 7, + 62, + 36, + 54, + 41, + 1, + 32, + 12 + ], + "weighted_loads": [ + 1.897322166711092, + 0.37001389637589455, + 0.11676775477826595, + 2.698856897652149, + 0.6312061548233032, + 2.608800968155265, + 1.6525288112461567, + 0.16007151827216148, + 0.7220697067677975, + 1.0328155644237995, + 2.250406999140978, + 0.18751613702625036, + 1.5305021703243256, + 1.1787633448839188, + 1.2440679464489222, + 0.14601140469312668, + 5.476432394236326, + 0.6322264522314072, + 1.0225910022854805, + 4.76723893918097, + 2.960172103717923, + 2.0862007327377796, + 2.108830165117979, + 1.922190610319376, + 2.129491660743952, + 1.9148256741464138, + 0.05011274293065071, + 1.0829685237258673, + 0.8339086007326841, + 3.2115493956953287, + 1.9995341338217258, + 3.0771070569753647, + 0.2064547911286354, + 1.072200270369649, + 2.27445175871253, + 0.6433057114481926, + 0.29284369572997093, + 0.11039648950099945, + 2.711350664496422, + 3.3571244394406676, + 0.8630457278341055, + 3.0856221560388803, + 3.41283056512475, + 2.0468617789447308, + 0.15497872792184353, + 2.2546089738607407, + 1.6146453097462654, + 1.287299269810319, + 1.5827139727771282, + 0.4223615601658821, + 0.32891111448407173, + 1.395752515643835, + 1.906174598261714, + 1.5837902687489986, + 2.173202393576503, + 1.2925413455814123, + 0.2942389566451311, + 5.313279949128628, + 1.78881511464715, + 3.6770592220127583, + 2.4692300967872143, + 0.024917908012866974, + 1.7562010809779167, + 0.8534747995436192 + ], + "unique_experts": 64, + "load_cv": 0.6606858725962512, + "normalized_load_entropy": 0.9441876769228345, + "max_load_share": 0.04562043795620438 + } + }, + "s1_period": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "cfed1a2dd750297267f6417466223f0fc357497f3a7e821b43cfc1f85390c3a4", + "route_weight_sha256": "ca3d9f6cb912bdda2c498aa80ef65d56763a733052404bd9dc589de1e44745e3", + "loads": [ + 40, + 0, + 2, + 31, + 12, + 45, + 18, + 3, + 1, + 17, + 28, + 4, + 19, + 12, + 21, + 3, + 63, + 10, + 19, + 75, + 36, + 40, + 35, + 37, + 32, + 20, + 1, + 21, + 18, + 50, + 28, + 30, + 1, + 0, + 37, + 17, + 7, + 2, + 43, + 38, + 17, + 56, + 52, + 34, + 6, + 23, + 11, + 16, + 23, + 5, + 4, + 21, + 17, + 24, + 28, + 11, + 5, + 61, + 32, + 55, + 42, + 0, + 29, + 6 + ], + "weighted_loads": [ + 1.9883216582238674, + 0.0, + 0.07406564429402351, + 2.544947300106287, + 0.6869495958089828, + 2.535979574546218, + 1.0793895311653614, + 0.10883422940969467, + 0.03283150866627693, + 0.9987500049173832, + 2.142138946801424, + 0.14325623773038387, + 1.2573052607476711, + 0.651822067797184, + 1.3271672166883945, + 0.14677293598651886, + 5.4064643662422895, + 0.5356390438973904, + 0.9141933489590883, + 4.7647079434245825, + 2.9349087439477444, + 2.239110440015793, + 2.0747534781694412, + 1.9845663700252771, + 2.0398460030555725, + 1.1248644646257162, + 0.06023092940449715, + 1.0186067558825016, + 0.8414715323597193, + 3.2184175178408623, + 1.8414003998041153, + 3.0737416334450245, + 0.033930934965610504, + 0.0, + 2.271715246140957, + 0.6751698050647974, + 0.2824041545391083, + 0.11333188787102699, + 2.6439717952162027, + 3.0998507887125015, + 0.6572900041937828, + 3.1975996773689985, + 3.3433018792420626, + 2.041624389588833, + 0.20204970054328442, + 1.6939702704548836, + 0.7206951528787613, + 1.1489453613758087, + 1.6183828599750996, + 0.22723273187875748, + 0.16573160327970982, + 1.3996396474540234, + 1.1511211525648832, + 1.5462023317813873, + 1.374094670638442, + 0.8270008713006973, + 0.2260372582823038, + 5.249272119253874, + 1.6641811169683933, + 3.772608544677496, + 2.5425410605967045, + 0.0, + 1.603830000385642, + 0.5037896521389484 + ], + "unique_experts": 61, + "load_cv": 0.7686343179406386, + "normalized_load_entropy": 0.922760247911259, + "max_load_share": 0.050200803212851405 + }, + "full_input": { + "tokens": 290, + "top_k": 6, + "decisions": 1740, + "ordered_route_sha256": "efee0ca8b3c10717b27a0738cc09022379431bbfe290f43b844d572e0f97589c", + "route_weight_sha256": "7f6f6bd6056b82802f087ab9cb3300428665ed18117e1e6c3598d65efc028a9f", + "loads": [ + 41, + 5, + 12, + 34, + 12, + 46, + 31, + 3, + 15, + 17, + 32, + 7, + 28, + 19, + 21, + 3, + 63, + 25, + 21, + 75, + 37, + 40, + 36, + 41, + 32, + 33, + 1, + 23, + 19, + 50, + 30, + 30, + 5, + 18, + 37, + 17, + 7, + 2, + 50, + 41, + 29, + 56, + 54, + 34, + 6, + 34, + 27, + 19, + 26, + 13, + 8, + 21, + 26, + 30, + 30, + 21, + 5, + 61, + 34, + 56, + 42, + 4, + 33, + 12 + ], + "weighted_loads": [ + 2.027516320347786, + 0.2788397390395403, + 0.697329118847847, + 2.7135054878890514, + 0.6869495958089828, + 2.5803313199430704, + 2.1428995057940483, + 0.10883422940969467, + 0.9639514647424221, + 0.9987500049173832, + 2.354399923235178, + 0.2592845680192113, + 1.7937196530401707, + 1.0999927893280983, + 1.3271672166883945, + 0.14677293598651886, + 5.4064643662422895, + 1.6148885749280453, + 1.0144662875682116, + 4.7647079434245825, + 3.003523427993059, + 2.239110440015793, + 2.11472624912858, + 2.173158885911107, + 2.0398460030555725, + 2.3654237184673548, + 0.06023092940449715, + 1.1373578198254108, + 0.8837315980345011, + 3.2184175178408623, + 1.8993339724838734, + 3.0737416334450245, + 0.1784343682229519, + 1.1527996249496937, + 2.271715246140957, + 0.6751698050647974, + 0.2824041545391083, + 0.11333188787102699, + 3.0816091429442167, + 3.176730007864535, + 1.2062623351812363, + 3.1975996773689985, + 3.5111015532165766, + 2.041624389588833, + 0.20204970054328442, + 2.729143287986517, + 1.884634729474783, + 1.2539616096764803, + 1.9317254088819027, + 0.7125595584511757, + 0.38494359888136387, + 1.3996396474540234, + 1.6703541576862335, + 2.2221697345376015, + 1.9975814055651426, + 1.484107255935669, + 0.2260372582823038, + 5.249272119253874, + 1.7615365907549858, + 3.805184096097946, + 2.5425410605967045, + 0.18657133355736732, + 1.7817881535738707, + 0.8682914078235626 + ], + "unique_experts": 64, + "load_cv": 0.6153323503929276, + "normalized_load_entropy": 0.9507723815144044, + "max_load_share": 0.04310344827586207 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 249, + "ordered_topk_exact_tokens": 198, + "set_exact_tokens": 220, + "mean_set_jaccard": 0.9658634538152611, + "mean_token_weighted_tv": 0.007779678845980081, + "aggregate_load_tv": 0.01204819277108434 + }, + "system_bos": { + "tokens": 249, + "ordered_topk_exact_tokens": 178, + "set_exact_tokens": 198, + "mean_set_jaccard": 0.9397590361445783, + "mean_token_weighted_tv": 0.013225027838774234, + "aggregate_load_tv": 0.01874163319946453 + }, + "system_x": { + "tokens": 249, + "ordered_topk_exact_tokens": 177, + "set_exact_tokens": 201, + "mean_set_jaccard": 0.9440619621342513, + "mean_token_weighted_tv": 0.01389151293574926, + "aggregate_load_tv": 0.016064257028112452 + }, + "system_period": { + "tokens": 249, + "ordered_topk_exact_tokens": 169, + "set_exact_tokens": 198, + "mean_set_jaccard": 0.9397590361445783, + "mean_token_weighted_tv": 0.014253957810471335, + "aggregate_load_tv": 0.022088353413654623 + }, + "bos_at_s0": { + "tokens": 249, + "ordered_topk_exact_tokens": 158, + "set_exact_tokens": 194, + "mean_set_jaccard": 0.936029833620195, + "mean_token_weighted_tv": 0.014824873184313974, + "aggregate_load_tv": 0.018741633199464532 + }, + "bos_at_s1": { + "tokens": 249, + "ordered_topk_exact_tokens": 151, + "set_exact_tokens": 184, + "mean_set_jaccard": 0.9245553643144004, + "mean_token_weighted_tv": 0.017505028834903097, + "aggregate_load_tv": 0.02074966532797859 + }, + "x_at_s0": { + "tokens": 249, + "ordered_topk_exact_tokens": 157, + "set_exact_tokens": 193, + "mean_set_jaccard": 0.9348823866896155, + "mean_token_weighted_tv": 0.01537779086160971, + "aggregate_load_tv": 0.018072289156626512 + }, + "x_at_s1": { + "tokens": 249, + "ordered_topk_exact_tokens": 153, + "set_exact_tokens": 191, + "mean_set_jaccard": 0.9308663224325875, + "mean_token_weighted_tv": 0.017608600964088995, + "aggregate_load_tv": 0.022088353413654623 + }, + "period_at_s0": { + "tokens": 249, + "ordered_topk_exact_tokens": 158, + "set_exact_tokens": 196, + "mean_set_jaccard": 0.938324727481354, + "mean_token_weighted_tv": 0.015042267739772797, + "aggregate_load_tv": 0.01874163319946453 + }, + "period_at_s1": { + "tokens": 249, + "ordered_topk_exact_tokens": 153, + "set_exact_tokens": 189, + "mean_set_jaccard": 0.9294320137693632, + "mean_token_weighted_tv": 0.017692303584222812, + "aggregate_load_tv": 0.024096385542168676 + } + } + }, + "layer_09": { + "layer": 9, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "0c8640344eeff482667acb436b185c7a173f65717b464a6529a6652a146c0b5c", + "route_weight_sha256": "1f0d9429f04d2928fca283e72e3a637406c7b033c97917eff9e74bcd71cca2b2", + "loads": [ + 37, + 19, + 45, + 40, + 40, + 16, + 5, + 20, + 23, + 31, + 3, + 7, + 5, + 5, + 17, + 65, + 10, + 14, + 43, + 12, + 53, + 35, + 20, + 0, + 22, + 15, + 3, + 26, + 27, + 70, + 61, + 15, + 31, + 17, + 2, + 20, + 37, + 28, + 0, + 29, + 13, + 11, + 32, + 43, + 19, + 18, + 18, + 31, + 27, + 25, + 0, + 12, + 39, + 5, + 34, + 17, + 2, + 30, + 33, + 0, + 36, + 7, + 16, + 58 + ], + "weighted_loads": [ + 2.148904614150524, + 1.122537724673748, + 2.9710044488310814, + 1.9337073992937803, + 2.9507847353816032, + 1.1215446069836617, + 0.22617047652602196, + 1.3221797086298466, + 1.5093025732785463, + 2.024888724088669, + 0.25202881544828415, + 0.33415161818265915, + 0.21218149363994598, + 0.23522507026791573, + 0.9346494898200035, + 4.9635329488664865, + 0.862324520945549, + 0.5165478922426701, + 2.6772217378020287, + 0.567489068955183, + 3.020450359210372, + 2.180688925087452, + 0.837583577260375, + 0.0, + 1.0834950637072325, + 0.8666859567165375, + 0.11044099181890488, + 1.6444465480744839, + 1.6751812230795622, + 4.472724366933107, + 4.372629256919026, + 0.7700193244963884, + 1.842073567211628, + 1.2845057509839535, + 0.08245967328548431, + 1.4840089976787567, + 2.6326725594699383, + 2.154517000541091, + 0.0, + 1.761664841324091, + 0.5845020152628422, + 0.6001892313361168, + 1.732217999175191, + 2.7038193624466658, + 0.8546146731823683, + 0.6890239417552948, + 1.0546246655285358, + 1.8089172579348087, + 2.0473480001091957, + 1.6206139735877514, + 0.0, + 0.5847994536161423, + 2.3080869913101196, + 0.17767906747758389, + 1.7888630330562592, + 1.1407108567655087, + 0.07467500492930412, + 1.4456020537763834, + 2.410990882664919, + 0.0, + 2.085072413086891, + 0.40850166976451874, + 1.2297586500644684, + 4.617321513593197 + ], + "unique_experts": 60, + "load_cv": 0.7142612902989374, + "normalized_load_entropy": 0.9336399683341505, + "max_load_share": 0.04685408299866131 + }, + "full_input": { + "tokens": 274, + "top_k": 6, + "decisions": 1644, + "ordered_route_sha256": "7a2181f21c2895747312234835df186b41f4f64120effb88e07fcb6aef8c3dae", + "route_weight_sha256": "402215f990e0f66e728fcdf5418b9ab01c4ed9536d72b486404244c14be09a98", + "loads": [ + 44, + 22, + 45, + 40, + 42, + 16, + 5, + 20, + 25, + 31, + 14, + 7, + 8, + 11, + 17, + 65, + 11, + 16, + 44, + 21, + 53, + 35, + 25, + 4, + 25, + 17, + 3, + 27, + 27, + 70, + 62, + 21, + 32, + 17, + 11, + 27, + 37, + 28, + 3, + 29, + 13, + 20, + 32, + 43, + 23, + 25, + 30, + 31, + 30, + 25, + 4, + 13, + 39, + 7, + 34, + 22, + 7, + 30, + 35, + 4, + 36, + 7, + 18, + 59 + ], + "weighted_loads": [ + 2.626495536416769, + 1.3070834949612617, + 2.9710044488310814, + 1.9337073992937803, + 3.210918240249157, + 1.1215446069836617, + 0.22617047652602196, + 1.3221797086298466, + 1.6064088474959135, + 2.024888724088669, + 1.4285300821065903, + 0.33415161818265915, + 0.2661112081259489, + 0.43876201566308737, + 0.9346494898200035, + 4.9635329488664865, + 0.9033391401171684, + 0.5901940576732159, + 2.7271310165524483, + 1.4258468560874462, + 3.020450359210372, + 2.180688925087452, + 2.413974901661277, + 0.2542203962802887, + 1.213584890589118, + 1.0161443427205086, + 0.11044099181890488, + 1.6573392171412706, + 1.6751812230795622, + 4.472724366933107, + 4.412148552015424, + 0.9573186165653169, + 1.84580236277543, + 1.2845057509839535, + 0.5758491959422827, + 1.9920033514499664, + 2.6326725594699383, + 2.154517000541091, + 0.1358121708035469, + 1.761664841324091, + 0.5845020152628422, + 1.5158308744430542, + 1.732217999175191, + 2.7038193624466658, + 1.125109332613647, + 1.230797614902258, + 2.092666517943144, + 1.8089172579348087, + 2.2600126452744007, + 1.6206139735877514, + 0.20518864318728447, + 0.618466567248106, + 2.3080869913101196, + 0.2658797185868025, + 1.7888630330562592, + 1.4296825397759676, + 0.317221213132143, + 1.4456020537763834, + 2.5601316280663013, + 0.1715468093752861, + 2.085072413086891, + 0.40850166976451874, + 1.2856661304831505, + 4.65346210077405 + ], + "unique_experts": 64, + "load_cv": 0.6091040544804558, + "normalized_load_entropy": 0.9544634745237633, + "max_load_share": 0.04257907542579075 + } + }, + "s1_eos": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "411f7ef73536908b7c6e47f97d2fc6ef72e84217063e121401f1c331d9d8ec1f", + "route_weight_sha256": "7927b1addcad93d00e4edf344343a3df9476c3931df47f83114f9497c17ed85f", + "loads": [ + 38, + 18, + 47, + 40, + 40, + 17, + 4, + 20, + 24, + 31, + 3, + 7, + 4, + 5, + 18, + 65, + 10, + 15, + 43, + 12, + 52, + 33, + 17, + 0, + 21, + 15, + 4, + 26, + 28, + 71, + 60, + 16, + 31, + 17, + 3, + 20, + 38, + 28, + 0, + 29, + 13, + 11, + 33, + 42, + 19, + 17, + 17, + 30, + 27, + 26, + 0, + 12, + 39, + 5, + 31, + 17, + 2, + 30, + 34, + 0, + 36, + 8, + 17, + 58 + ], + "weighted_loads": [ + 2.118273079395294, + 1.079672884196043, + 3.044958231970668, + 1.9360258840024471, + 2.9503012113273144, + 1.1608797907829285, + 0.18350668624043465, + 1.3258549124002457, + 1.5430704541504383, + 2.0188363417983055, + 0.25841401889920235, + 0.32715052366256714, + 0.1652623414993286, + 0.23527055606245995, + 0.976651955395937, + 4.946537088602781, + 0.854651652276516, + 0.5490276198834181, + 2.6841599121689796, + 0.568870784714818, + 2.9871386289596558, + 2.115606416016817, + 0.737908698618412, + 0.0, + 1.041540913283825, + 0.901499267667532, + 0.14656305126845837, + 1.6293167471885681, + 1.724546866491437, + 4.525396846234798, + 4.2944811545312405, + 0.8350412622094154, + 1.8345867656171322, + 1.2736083939671516, + 0.11178327724337578, + 1.474924337118864, + 2.6688522920012474, + 2.148594168946147, + 0.0, + 1.7595313042402267, + 0.5826980341225863, + 0.5979015566408634, + 1.7710025366395712, + 2.6601960510015488, + 0.8626834787428379, + 0.664706202223897, + 1.0076307132840157, + 1.7847002856433392, + 2.021170623600483, + 1.642395505681634, + 0.0, + 0.578896626830101, + 2.3220491781830788, + 0.18492474406957626, + 1.7058749124407768, + 1.1104446053504944, + 0.07696499675512314, + 1.4619992598891258, + 2.435894649475813, + 0.0, + 2.099843831732869, + 0.44383127987384796, + 1.2449514642357826, + 4.585260536521673 + ], + "unique_experts": 60, + "load_cv": 0.7135785143551795, + "normalized_load_entropy": 0.9340052438143321, + "max_load_share": 0.04752342704149933 + }, + "full_input": { + "tokens": 290, + "top_k": 6, + "decisions": 1740, + "ordered_route_sha256": "1b7bec3550ef66c51ae21f3ef7361d2720c40a42423c6ba24edd1c7c3a7a9c06", + "route_weight_sha256": "5154a60ed506f1e0089a1b2b5e7ebcd36940a6d8fc8f4bc31be3017ce0798be0", + "loads": [ + 49, + 23, + 47, + 40, + 42, + 17, + 4, + 20, + 31, + 33, + 14, + 9, + 7, + 9, + 19, + 65, + 11, + 16, + 44, + 21, + 52, + 36, + 22, + 12, + 26, + 24, + 8, + 27, + 34, + 71, + 62, + 21, + 32, + 20, + 9, + 32, + 38, + 31, + 5, + 30, + 19, + 25, + 35, + 42, + 24, + 29, + 38, + 30, + 34, + 31, + 2, + 13, + 39, + 8, + 32, + 22, + 7, + 30, + 40, + 4, + 36, + 9, + 19, + 59 + ], + "weighted_loads": [ + 2.840907510370016, + 1.3558569736778736, + 3.044958231970668, + 1.9360258840024471, + 3.226142566651106, + 1.1608797907829285, + 0.18350668624043465, + 1.3258549124002457, + 1.9625902622938156, + 2.1096173338592052, + 1.3373821415007114, + 0.4229203537106514, + 0.21878696558997035, + 0.34332872880622745, + 1.015746045857668, + 4.946537088602781, + 0.9007337689399719, + 0.6049510221928358, + 2.7336633652448654, + 1.5254638735204935, + 2.9871386289596558, + 2.243027091026306, + 2.3122230656445026, + 0.8457166776061058, + 1.2345059029757977, + 1.4056486263871193, + 0.39927071891725063, + 1.6422094162553549, + 2.1487617772072554, + 4.525396846234798, + 4.432077832520008, + 0.9810378919355571, + 1.8382057324051857, + 1.4938585795462132, + 0.4135392475873232, + 2.304411869496107, + 2.6688522920012474, + 2.2897106166929007, + 0.2583029940724373, + 1.8269514590501785, + 0.9856174234300852, + 1.9923858009278774, + 1.8638165462762117, + 2.6601960510015488, + 1.0464505264535546, + 1.5660220254212618, + 2.840582575649023, + 1.7847002856433392, + 2.474622443318367, + 1.9687602240592241, + 0.12025531381368637, + 0.6117584146559238, + 2.3220491781830788, + 0.3334944173693657, + 1.7471825443208218, + 1.3651150297373533, + 0.30930833891034126, + 1.4619992598891258, + 2.819515474140644, + 0.18009141460061073, + 2.099843831732869, + 0.4816872254014015, + 1.4016668256372213, + 4.62128009647131 + ], + "unique_experts": 64, + "load_cv": 0.5745425035511655, + "normalized_load_entropy": 0.9587283768941871, + "max_load_share": 0.04080459770114943 + } + }, + "s0_bos": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "967aacc12c5be99eae4a3a8b9588fe8703947e5a724883224492d9c0a2eaa7f1", + "route_weight_sha256": "78fc58845ef88013f4164f942a2820d409838de729f0b94bf1181a6ab9a62316", + "loads": [ + 38, + 20, + 44, + 43, + 40, + 19, + 3, + 20, + 21, + 32, + 3, + 7, + 5, + 4, + 20, + 66, + 10, + 11, + 45, + 12, + 50, + 35, + 15, + 0, + 22, + 18, + 1, + 26, + 27, + 69, + 61, + 15, + 31, + 17, + 4, + 20, + 39, + 30, + 0, + 28, + 11, + 12, + 32, + 47, + 19, + 13, + 16, + 31, + 26, + 26, + 0, + 11, + 39, + 7, + 34, + 19, + 2, + 31, + 32, + 0, + 37, + 7, + 16, + 55 + ], + "weighted_loads": [ + 2.233331646770239, + 1.1641653515398502, + 2.9566895589232445, + 2.0432099141180515, + 2.9550938829779625, + 1.2528143748641014, + 0.12906644493341446, + 1.359560314565897, + 1.4320590775460005, + 2.0654321759939194, + 0.2500210218131542, + 0.3362589254975319, + 0.199721809476614, + 0.17462539672851562, + 1.045435717329383, + 4.9416598323732615, + 0.8418220169842243, + 0.40771741420030594, + 2.7985739521682262, + 0.539803933352232, + 2.947237726300955, + 2.1982197035104036, + 0.6431605871766806, + 0.0, + 1.0933845415711403, + 1.037317644804716, + 0.052953075617551804, + 1.6500208862125874, + 1.723665153607726, + 4.4766412153840065, + 4.358523678034544, + 0.7850025426596403, + 1.8070517275482416, + 1.293027926236391, + 0.15154948271811008, + 1.4674250595271587, + 2.7072409875690937, + 2.2450914476066828, + 0.0, + 1.7065557539463043, + 0.5221595894545317, + 0.6132742129266262, + 1.743708522990346, + 2.853853927925229, + 0.85646659322083, + 0.5131216961890459, + 1.059662215411663, + 1.8698574379086494, + 2.006087761372328, + 1.6674212124198675, + 0.0, + 0.5488450303673744, + 2.3812012635171413, + 0.24944620206952095, + 1.824903616681695, + 1.2415571697056293, + 0.07473709806799889, + 1.5089037492871284, + 2.3653817512094975, + 0.0, + 2.1594419218599796, + 0.40289784222841263, + 1.2141369301825762, + 4.49149557761848 + ], + "unique_experts": 60, + "load_cv": 0.7197798563945582, + "normalized_load_entropy": 0.9320740289496939, + "max_load_share": 0.04618473895582329 + }, + "full_input": { + "tokens": 274, + "top_k": 6, + "decisions": 1644, + "ordered_route_sha256": "55b6540935d94a097cf29cac6e27ba36c956e93f796fa44a7e08f3a90ee80d34", + "route_weight_sha256": "a4bf85b7b00100719909c44e20fbaf2264b04976b3af089de7c1560cc0354a1d", + "loads": [ + 46, + 22, + 44, + 43, + 43, + 19, + 3, + 20, + 23, + 32, + 14, + 7, + 7, + 9, + 20, + 66, + 11, + 15, + 46, + 22, + 50, + 35, + 19, + 4, + 25, + 20, + 1, + 27, + 27, + 69, + 62, + 20, + 31, + 17, + 13, + 27, + 39, + 30, + 2, + 29, + 11, + 21, + 32, + 47, + 22, + 19, + 28, + 31, + 29, + 26, + 6, + 12, + 39, + 9, + 34, + 24, + 7, + 31, + 35, + 4, + 37, + 7, + 18, + 56 + ], + "weighted_loads": [ + 2.7601559832692146, + 1.317227702587843, + 2.9566895589232445, + 2.0432099141180515, + 3.2821529656648636, + 1.2528143748641014, + 0.12906644493341446, + 1.359560314565897, + 1.5291653517633677, + 2.0654321759939194, + 1.4265222884714603, + 0.3362589254975319, + 0.24625969491899014, + 0.3847187450155616, + 1.045435717329383, + 4.9416598323732615, + 0.8828366361558437, + 0.5576226264238358, + 2.8485077060759068, + 1.4356663599610329, + 2.947237726300955, + 2.1982197035104036, + 1.2894863579422235, + 0.3075834661722183, + 1.2234743684530258, + 1.1895727179944515, + 0.052953075617551804, + 1.6629135552793741, + 1.723665153607726, + 4.4766412153840065, + 4.398042973130941, + 0.9695896860212088, + 1.8070517275482416, + 1.293027926236391, + 0.6449390053749084, + 1.9635279215872288, + 2.7072409875690937, + 2.2450914476066828, + 0.09267161414027214, + 1.751570675522089, + 0.5221595894545317, + 1.5530297197401524, + 1.743708522990346, + 2.853853927925229, + 1.1192718502134085, + 1.1412409823387861, + 2.090882323682308, + 1.8698574379086494, + 2.2220818176865578, + 1.6674212124198675, + 0.2857951559126377, + 0.5825121439993382, + 2.3812012635171413, + 0.33905724063515663, + 1.824903616681695, + 1.5352728310972452, + 0.3172833062708378, + 1.5089037492871284, + 2.5802088640630245, + 0.1715468093752861, + 2.1594419218599796, + 0.40289784222841263, + 1.2700444106012583, + 4.527636164799333 + ], + "unique_experts": 64, + "load_cv": 0.6146382234685738, + "normalized_load_entropy": 0.9528392661094007, + "max_load_share": 0.041970802919708027 + } + }, + "s1_bos": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "1e5a8fecd5d5ae86c4885af25265f3702340db14296b358b1b775e2e0c2b9f65", + "route_weight_sha256": "20370046226f90608a96d0aaa3648f329408da8fc49c1d052309095b84333d88", + "loads": [ + 41, + 20, + 45, + 42, + 39, + 19, + 5, + 20, + 21, + 31, + 3, + 7, + 5, + 5, + 20, + 65, + 9, + 12, + 44, + 9, + 51, + 35, + 15, + 0, + 21, + 19, + 1, + 26, + 27, + 71, + 63, + 15, + 32, + 16, + 3, + 20, + 40, + 29, + 0, + 28, + 11, + 11, + 32, + 44, + 18, + 16, + 17, + 31, + 26, + 27, + 1, + 10, + 40, + 6, + 34, + 16, + 1, + 29, + 32, + 0, + 37, + 8, + 16, + 57 + ], + "weighted_loads": [ + 2.2533478997647762, + 1.1706079840660095, + 3.0118648651987314, + 2.000802807509899, + 2.886931598186493, + 1.243249662220478, + 0.20623834431171417, + 1.3399622403085232, + 1.4297061022371054, + 2.03096567094326, + 0.26526181772351265, + 0.3350333943963051, + 0.1932054366916418, + 0.2178538590669632, + 1.0606385245919228, + 4.929142901673913, + 0.7883001491427422, + 0.4520720858126879, + 2.774710066616535, + 0.4744550250470638, + 3.0169145576655865, + 2.186250474303961, + 0.6464004088193178, + 0.0, + 1.0594928357750177, + 1.085988961160183, + 0.053578391671180725, + 1.622571375221014, + 1.7209486216306686, + 4.592697266489267, + 4.419149570167065, + 0.7880975566804409, + 1.8199396003037691, + 1.2542139738798141, + 0.12394881248474121, + 1.4602919146418571, + 2.7348109763115644, + 2.2018567994236946, + 0.0, + 1.7207148894667625, + 0.5257975719869137, + 0.5776110254228115, + 1.7415152471512556, + 2.8031389489769936, + 0.7945105824619532, + 0.6146636810153723, + 1.06353460252285, + 1.9085715897381306, + 1.9959190785884857, + 1.7029573488980532, + 0.030210230499505997, + 0.5087620131671429, + 2.412903033196926, + 0.22995615750551224, + 1.8373588621616364, + 1.150073740631342, + 0.04001777246594429, + 1.4461888894438744, + 2.347023792564869, + 0.0, + 2.116971656680107, + 0.4304533638060093, + 1.1823718287050724, + 4.537282224744558 + ], + "unique_experts": 61, + "load_cv": 0.7278610978155534, + "normalized_load_entropy": 0.9314920095362006, + "max_load_share": 0.04752342704149933 + }, + "full_input": { + "tokens": 290, + "top_k": 6, + "decisions": 1740, + "ordered_route_sha256": "9d8f6ad5045309af95c8be43356fd707c3e9733d29e1b1ebad7dba889fe44d9a", + "route_weight_sha256": "422b1f4e2fba8c45c46983d42e84a4fe65a99c27a06ed13e68d5d85122d5babf", + "loads": [ + 53, + 24, + 45, + 42, + 42, + 19, + 5, + 20, + 28, + 33, + 14, + 9, + 7, + 10, + 21, + 65, + 10, + 15, + 45, + 19, + 51, + 38, + 19, + 12, + 26, + 28, + 5, + 27, + 33, + 71, + 65, + 19, + 32, + 19, + 9, + 32, + 40, + 32, + 4, + 30, + 17, + 25, + 34, + 44, + 21, + 27, + 38, + 31, + 33, + 32, + 5, + 11, + 40, + 9, + 35, + 21, + 6, + 29, + 38, + 4, + 37, + 9, + 18, + 58 + ], + "weighted_loads": [ + 3.0574824512004852, + 1.4032131619751453, + 3.0118648651987314, + 2.000802807509899, + 3.231800027191639, + 1.243249662220478, + 0.20623834431171417, + 1.3399622403085232, + 1.8492259103804827, + 2.12174666300416, + 1.3442299403250217, + 0.43080322444438934, + 0.23978917486965656, + 0.4015590650960803, + 1.0997326150536537, + 4.929142901673913, + 0.8343822658061981, + 0.5938665587455034, + 2.8219665959477425, + 1.469039749354124, + 3.0169145576655865, + 2.31367114931345, + 1.2940738257020712, + 0.8707458265125751, + 1.2524578254669905, + 1.5879127494990826, + 0.306286059319973, + 1.6354640442878008, + 2.145163532346487, + 4.592697266489267, + 4.556746248155832, + 0.9312691241502762, + 1.8199396003037691, + 1.4744641594588757, + 0.4257047828286886, + 2.271317820996046, + 2.7348109763115644, + 2.3429732471704483, + 0.20752815157175064, + 1.840139713138342, + 0.9287169612944126, + 2.00261564925313, + 1.8343292567878962, + 2.8031389489769936, + 0.9244163427501917, + 1.6680455971509218, + 2.917639769613743, + 1.9085715897381306, + 2.4488764107227325, + 2.0293220672756433, + 0.22391358204185963, + 0.5416238009929657, + 2.412903033196926, + 0.3829832002520561, + 1.8786664940416813, + 1.4110453519970179, + 0.2723611146211624, + 1.4461888894438744, + 2.726652931421995, + 0.18009141460061073, + 2.116971656680107, + 0.46830930933356285, + 1.3390871901065111, + 4.573301784694195 + ], + "unique_experts": 64, + "load_cv": 0.5863781584399852, + "normalized_load_entropy": 0.9574552327323391, + "max_load_share": 0.04080459770114943 + } + }, + "s0_x": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "3507bdf8d44eb902bc31897a4bdcef422fe9e82737f9d2402c208fdea237732a", + "route_weight_sha256": "086112697af529840fb45ad8d95e79699b34361c51601277c9f88a7558c9e885", + "loads": [ + 32, + 19, + 46, + 43, + 40, + 17, + 3, + 21, + 22, + 31, + 3, + 7, + 5, + 4, + 18, + 64, + 9, + 11, + 44, + 12, + 54, + 35, + 16, + 0, + 22, + 18, + 3, + 27, + 27, + 70, + 60, + 14, + 31, + 17, + 4, + 21, + 37, + 30, + 0, + 30, + 11, + 12, + 32, + 44, + 18, + 15, + 15, + 31, + 26, + 26, + 0, + 11, + 41, + 6, + 35, + 19, + 1, + 31, + 32, + 0, + 38, + 8, + 16, + 59 + ], + "weighted_loads": [ + 1.9968234337866306, + 1.1321469321846962, + 3.046335047110915, + 2.051535975188017, + 2.972737930715084, + 1.1591401994228363, + 0.12500742077827454, + 1.3960727266967297, + 1.4678312428295612, + 2.009430453181267, + 0.2544650621712208, + 0.3423592671751976, + 0.19822249189019203, + 0.1818481609225273, + 0.9477405846118927, + 4.903744038194418, + 0.7989619374275208, + 0.40713896229863167, + 2.7623861134052277, + 0.5453571192920208, + 3.087946316227317, + 2.229291219264269, + 0.6992641352117062, + 0.0, + 1.0794351436197758, + 1.075601790100336, + 0.10433746129274368, + 1.6896623820066452, + 1.723468691110611, + 4.498467521741986, + 4.3503031097352505, + 0.7536763548851013, + 1.805436909198761, + 1.2966282069683075, + 0.15142730064690113, + 1.518547024577856, + 2.643160816282034, + 2.2445804215967655, + 0.0, + 1.7825661227107048, + 0.5145265180617571, + 0.6215749531984329, + 1.7614172417670488, + 2.802032135426998, + 0.8140379842370749, + 0.5775949005037546, + 0.9748725891113281, + 1.9008831288665533, + 2.0527314357459545, + 1.6441005356609821, + 0.0, + 0.5506298169493675, + 2.4618824142962694, + 0.21400127559900284, + 1.8756875321269035, + 1.2776386924088001, + 0.04168692231178284, + 1.508389189839363, + 2.3480619974434376, + 0.0, + 2.198416419327259, + 0.43142441660165787, + 1.1897748243063688, + 4.653214728459716 + ], + "unique_experts": 60, + "load_cv": 0.7237921407054745, + "normalized_load_entropy": 0.9318177381793387, + "max_load_share": 0.04685408299866131 + }, + "full_input": { + "tokens": 274, + "top_k": 6, + "decisions": 1644, + "ordered_route_sha256": "e192224c1edf2ff8875891ccde98d26f6b45ced5d904c4367553ac2ea4d469ff", + "route_weight_sha256": "d43f1383b1ccc22b66f41c5fef5d42aa298a49b88f719a6d2711fc6af04f9cf1", + "loads": [ + 41, + 21, + 46, + 43, + 42, + 17, + 3, + 21, + 24, + 31, + 15, + 7, + 7, + 8, + 18, + 64, + 11, + 14, + 45, + 22, + 54, + 35, + 20, + 4, + 25, + 21, + 3, + 28, + 27, + 70, + 61, + 19, + 31, + 17, + 14, + 27, + 37, + 30, + 3, + 30, + 11, + 22, + 32, + 44, + 21, + 21, + 27, + 31, + 29, + 26, + 4, + 12, + 41, + 7, + 35, + 24, + 6, + 31, + 35, + 5, + 38, + 8, + 18, + 60 + ], + "weighted_loads": [ + 2.637747809290886, + 1.2824148908257484, + 3.046335047110915, + 2.051535975188017, + 3.220092609524727, + 1.1591401994228363, + 0.12500742077827454, + 1.3960727266967297, + 1.5649375170469284, + 2.009430453181267, + 1.5795872621238232, + 0.3423592671751976, + 0.24476037733256817, + 0.3251764243468642, + 0.9477405846118927, + 4.903744038194418, + 0.8770968802273273, + 0.5239345990121365, + 2.8202672824263573, + 1.437869168817997, + 3.087946316227317, + 2.229291219264269, + 1.348861776292324, + 0.25823231041431427, + 1.2095249705016613, + 1.280493639409542, + 0.10433746129274368, + 1.702555051073432, + 1.723468691110611, + 4.498467521741986, + 4.389822404831648, + 0.9382634982466698, + 1.805436909198761, + 1.2966282069683075, + 0.7413705363869667, + 1.9754142947494984, + 2.643160816282034, + 2.2445804215967655, + 0.13680147379636765, + 1.7825661227107048, + 0.5145265180617571, + 1.5441476218402386, + 1.7614172417670488, + 2.802032135426998, + 1.0768432412296534, + 1.0045255739241838, + 1.9611611254513264, + 1.9008831288665533, + 2.2674370259046555, + 1.6441005356609821, + 0.20519014075398445, + 0.5842969305813313, + 2.4618824142962694, + 0.25910355523228645, + 1.8756875321269035, + 1.5636542979627848, + 0.28423313051462173, + 1.508389189839363, + 2.555478285998106, + 0.210532296448946, + 2.198416419327259, + 0.43142441660165787, + 1.245682304725051, + 4.689355315640569 + ], + "unique_experts": 64, + "load_cv": 0.6161773465568853, + "normalized_load_entropy": 0.9531083224186383, + "max_load_share": 0.04257907542579075 + } + }, + "s1_x": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "6e91dbd21896c920050fc4bd89db7d1bf52afd24ea50a7a01e197f58f6896bcb", + "route_weight_sha256": "9beb0a474f7c448134b620dc408bcaf5d0c476926a65572419c965b70ba1428e", + "loads": [ + 37, + 20, + 44, + 41, + 39, + 19, + 6, + 19, + 25, + 31, + 3, + 7, + 6, + 4, + 20, + 65, + 9, + 12, + 44, + 12, + 51, + 35, + 15, + 0, + 22, + 21, + 1, + 26, + 28, + 70, + 59, + 16, + 32, + 16, + 4, + 20, + 39, + 28, + 0, + 30, + 12, + 13, + 34, + 43, + 19, + 16, + 17, + 31, + 25, + 25, + 0, + 10, + 40, + 7, + 33, + 16, + 1, + 30, + 32, + 0, + 34, + 7, + 16, + 57 + ], + "weighted_loads": [ + 2.1347796730697155, + 1.1749837100505829, + 3.0204561091959476, + 1.945219986140728, + 2.882434271275997, + 1.2384163811802864, + 0.27698681503534317, + 1.2864026241004467, + 1.5629021748900414, + 2.022630926221609, + 0.2701675072312355, + 0.3390486426651478, + 0.2176335621625185, + 0.18732743710279465, + 1.043134270235896, + 4.893537346273661, + 0.8047324195504189, + 0.4511790946125984, + 2.732544407248497, + 0.5781091079115868, + 3.0129623524844646, + 2.21607687138021, + 0.6450833212584257, + 0.0, + 1.0772152971476316, + 1.2491641901433468, + 0.05216838791966438, + 1.6112439204007387, + 1.7586087454110384, + 4.470544587820768, + 4.267887879163027, + 0.8237765543162823, + 1.8584061991423368, + 1.237425047904253, + 0.15165246836841106, + 1.487308781594038, + 2.6883720755577087, + 2.171368759125471, + 0.0, + 1.8150678221136332, + 0.5544964224100113, + 0.7029226496815681, + 1.8230189271271229, + 2.7958112359046936, + 0.8172328770160675, + 0.6114766038954258, + 1.0608604587614536, + 1.9303065799176693, + 1.9673680439591408, + 1.608519285917282, + 0.0, + 0.5069177076220512, + 2.4412020444869995, + 0.26505739614367485, + 1.8296629562973976, + 1.1036478001624346, + 0.040251705795526505, + 1.494888138025999, + 2.3359597884118557, + 0.0, + 1.995779000222683, + 0.3908984586596489, + 1.1670572496950626, + 4.468698833137751 + ], + "unique_experts": 60, + "load_cv": 0.7094680599776141, + "normalized_load_entropy": 0.9338210831971018, + "max_load_share": 0.04685408299866131 + }, + "full_input": { + "tokens": 290, + "top_k": 6, + "decisions": 1740, + "ordered_route_sha256": "ee046933e12cd50558e79eab9e425090d67e554396754f67459ef867cf4736a2", + "route_weight_sha256": "cbb3671940af0c71c388c007b15673b136845507d30d3d72f89279251c5755f9", + "loads": [ + 51, + 25, + 44, + 41, + 41, + 19, + 6, + 19, + 33, + 33, + 15, + 9, + 8, + 7, + 21, + 65, + 11, + 13, + 45, + 22, + 51, + 38, + 19, + 11, + 27, + 31, + 6, + 27, + 34, + 70, + 62, + 20, + 32, + 19, + 11, + 31, + 39, + 31, + 5, + 32, + 18, + 28, + 36, + 43, + 22, + 25, + 37, + 31, + 32, + 30, + 2, + 11, + 40, + 9, + 34, + 21, + 6, + 30, + 38, + 5, + 34, + 8, + 18, + 58 + ], + "weighted_loads": [ + 3.0807134434580803, + 1.4348490424454212, + 3.0204561091959476, + 1.945219986140728, + 3.144529603421688, + 1.2384163811802864, + 0.27698681503534317, + 1.2864026241004467, + 2.023986589163542, + 2.113411918282509, + 1.5097376331686974, + 0.43481847271323204, + 0.26421730034053326, + 0.2819888209924102, + 1.082228360697627, + 4.893537346273661, + 0.8917353376746178, + 0.5071024969220161, + 2.780071098357439, + 1.5804320313036442, + 3.0129623524844646, + 2.343497546389699, + 1.2923527229577303, + 0.8338037803769112, + 1.2701802868396044, + 1.8059516102075577, + 0.35132700577378273, + 1.6241365894675255, + 2.182823656126857, + 4.470544587820768, + 4.449797600507736, + 0.9669481217861176, + 1.8584061991423368, + 1.4576752334833145, + 0.5138521380722523, + 2.2430187352001667, + 2.6883720755577087, + 2.312485206872225, + 0.25844062864780426, + 1.9254572931677103, + 0.9574158117175102, + 2.0390777960419655, + 1.9158329367637634, + 2.7958112359046936, + 0.947138637304306, + 1.3426893427968025, + 2.794772580265999, + 1.9303065799176693, + 2.4180373772978783, + 1.9348840042948723, + 0.11486740037798882, + 0.5397794954478741, + 2.4412020444869995, + 0.36512740701436996, + 1.8709705881774426, + 1.3383436985313892, + 0.27259504795074463, + 1.494888138025999, + 2.7050002068281174, + 0.2332766428589821, + 1.995779000222683, + 0.42875440418720245, + 1.3237726110965014, + 4.504718393087387 + ], + "unique_experts": 64, + "load_cv": 0.5751676359862936, + "normalized_load_entropy": 0.9584795818461052, + "max_load_share": 0.040229885057471264 + } + }, + "s0_period": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "57530f8cf64e0865d667de3c6a5f221884853967d0b93716544cc9a0d888e06f", + "route_weight_sha256": "22f8269a01e658583bfdf1951bb369af14602d5cb5e909e75c78cb8592b11d00", + "loads": [ + 32, + 19, + 46, + 42, + 40, + 17, + 3, + 21, + 20, + 31, + 3, + 7, + 5, + 3, + 18, + 63, + 9, + 10, + 44, + 12, + 55, + 35, + 16, + 0, + 22, + 17, + 2, + 27, + 27, + 71, + 62, + 15, + 32, + 18, + 4, + 21, + 38, + 31, + 0, + 29, + 12, + 11, + 33, + 44, + 19, + 14, + 15, + 32, + 26, + 26, + 0, + 11, + 39, + 6, + 34, + 19, + 1, + 31, + 33, + 0, + 38, + 8, + 17, + 58 + ], + "weighted_loads": [ + 2.0068520195782185, + 1.1326688788831234, + 3.0677276980131865, + 2.009285945445299, + 2.975629810243845, + 1.172933280467987, + 0.12476341240108013, + 1.3917064256966114, + 1.4029587805271149, + 1.99996517598629, + 0.25322530791163445, + 0.34268173947930336, + 0.20036603137850761, + 0.1378016322851181, + 0.9491403214633465, + 4.868098033592105, + 0.8041641190648079, + 0.3754166569560766, + 2.754685066640377, + 0.5394767299294472, + 3.139524858444929, + 2.240283677354455, + 0.691294739022851, + 0.0, + 1.082287099212408, + 1.0213663764297962, + 0.07920418120920658, + 1.694621730595827, + 1.728935269638896, + 4.51061175391078, + 4.426954450085759, + 0.7850698586553335, + 1.862193824723363, + 1.3392335884273052, + 0.15287389419972897, + 1.5219570212066174, + 2.677133983001113, + 2.279203763231635, + 0.0, + 1.7734980061650276, + 0.5574713423848152, + 0.5903559438884258, + 1.824475958943367, + 2.8046983256936073, + 0.8558713067322969, + 0.5303924977779388, + 0.9821664802730083, + 1.935379896312952, + 2.044685509055853, + 1.6437338683754206, + 0.0, + 0.5472778789699078, + 2.4134648963809013, + 0.21445871330797672, + 1.844795759767294, + 1.2745722196996212, + 0.041693415492773056, + 1.517495907843113, + 2.375500585883856, + 0.0, + 2.194343239068985, + 0.4318477734923363, + 1.2389375530183315, + 4.573428934440017 + ], + "unique_experts": 60, + "load_cv": 0.7281761817552741, + "normalized_load_entropy": 0.930815049044831, + "max_load_share": 0.04752342704149933 + }, + "full_input": { + "tokens": 274, + "top_k": 6, + "decisions": 1644, + "ordered_route_sha256": "b43c281afaa5bd7a40c4d0461b795de3912026a33b17396d058e1eaf4f22e447", + "route_weight_sha256": "3716b5ec50d3fb67a9cd72559535b4bf41d9ed3c45fac8957550ecef4680d967", + "loads": [ + 41, + 21, + 46, + 42, + 42, + 17, + 3, + 21, + 22, + 31, + 15, + 7, + 7, + 8, + 18, + 63, + 10, + 14, + 45, + 21, + 55, + 35, + 20, + 4, + 25, + 19, + 2, + 28, + 27, + 71, + 63, + 20, + 32, + 18, + 14, + 27, + 38, + 31, + 3, + 29, + 12, + 21, + 33, + 44, + 22, + 21, + 28, + 32, + 29, + 26, + 4, + 12, + 39, + 7, + 34, + 24, + 7, + 31, + 35, + 4, + 38, + 8, + 19, + 59 + ], + "weighted_loads": [ + 2.629210650920868, + 1.2739757634699345, + 3.0677276980131865, + 2.009285945445299, + 3.2210049517452717, + 1.172933280467987, + 0.12476341240108013, + 1.3917064256966114, + 1.500065054744482, + 1.99996517598629, + 1.5240868143737316, + 0.34268173947930336, + 0.24690391682088375, + 0.3247117465361953, + 0.9491403214633465, + 4.868098033592105, + 0.8451787382364273, + 0.5380453635007143, + 2.810618754476309, + 1.3978345170617104, + 3.139524858444929, + 2.240283677354455, + 1.3422076646238565, + 0.27278653904795647, + 1.2123769260942936, + 1.1799371428787708, + 0.07920418120920658, + 1.7075143996626139, + 1.728935269638896, + 4.51061175391078, + 4.466473745182157, + 0.969657002016902, + 1.862193824723363, + 1.3392335884273052, + 0.7034638188779354, + 1.9653047285974026, + 2.677133983001113, + 2.279203763231635, + 0.13568846508860588, + 1.7734980061650276, + 0.5574713423848152, + 1.5290645323693752, + 1.824475958943367, + 2.8046983256936073, + 1.1186765637248755, + 1.0349539890885353, + 2.0906839929521084, + 1.935379896312952, + 2.2526119351387024, + 1.6437338683754206, + 0.2044026032090187, + 0.5809449926018715, + 2.4134648963809013, + 0.25956099294126034, + 1.844795759767294, + 1.565960155799985, + 0.3223572075366974, + 1.517495907843113, + 2.5174458138644695, + 0.1715468093752861, + 2.194343239068985, + 0.4318477734923363, + 1.2948450334370136, + 4.60956952162087 + ], + "unique_experts": 64, + "load_cv": 0.6192058755502171, + "normalized_load_entropy": 0.9525339270549065, + "max_load_share": 0.04318734793187348 + } + }, + "s1_period": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "f891e96b28a5f41f4d7f82d683f82efbc89c747e08cf3aea152ff6dd43213c4d", + "route_weight_sha256": "6585427d9b58240325ab921bbcdb26618214d61592367bcd6dd8e63e92a929e4", + "loads": [ + 36, + 20, + 45, + 44, + 40, + 21, + 5, + 20, + 23, + 31, + 3, + 7, + 5, + 5, + 20, + 65, + 9, + 11, + 44, + 11, + 51, + 35, + 15, + 1, + 21, + 19, + 1, + 27, + 28, + 70, + 60, + 14, + 32, + 17, + 4, + 20, + 39, + 28, + 0, + 30, + 13, + 12, + 35, + 43, + 17, + 13, + 15, + 32, + 26, + 26, + 1, + 10, + 40, + 6, + 33, + 15, + 1, + 31, + 31, + 0, + 36, + 9, + 16, + 56 + ], + "weighted_loads": [ + 2.1233636047691107, + 1.1982865706086159, + 3.0553968027234077, + 2.0636805556714535, + 2.9338765405118465, + 1.3065438717603683, + 0.2242654338479042, + 1.3266035579144955, + 1.4936132840812206, + 2.016941025853157, + 0.27940787374973297, + 0.3396340273320675, + 0.19146252237260342, + 0.2231728844344616, + 1.0443669985979795, + 4.920984752476215, + 0.8137976005673409, + 0.41811238415539265, + 2.7362634912133217, + 0.5314876213669777, + 3.0258714705705643, + 2.2101068180054426, + 0.6455758959054947, + 0.03852224722504616, + 1.0471238140016794, + 1.1705797743052244, + 0.05256422609090805, + 1.639185531064868, + 1.758226901292801, + 4.475789126008749, + 4.311879176646471, + 0.7630720473825932, + 1.8616987485438585, + 1.2811716496944427, + 0.15068706311285496, + 1.4931506365537643, + 2.6786762941628695, + 2.1872642002999783, + 0.0, + 1.8212558813393116, + 0.5853615570813417, + 0.6529500149190426, + 1.8792501129209995, + 2.7869442123919725, + 0.7381727490574121, + 0.5077610854059458, + 0.9499395750463009, + 1.963203739374876, + 2.016712322831154, + 1.6432283781468868, + 0.02863314002752304, + 0.5055687390267849, + 2.4310086369514465, + 0.22099750116467476, + 1.81847270950675, + 1.0626021027565002, + 0.040691524744033813, + 1.5353676807135344, + 2.302650570869446, + 0.0, + 2.0616778042167425, + 0.4567344319075346, + 1.177317125722766, + 4.4405075162649155 + ], + "unique_experts": 62, + "load_cv": 0.7167459026937741, + "normalized_load_entropy": 0.933604525527952, + "max_load_share": 0.04685408299866131 + }, + "full_input": { + "tokens": 290, + "top_k": 6, + "decisions": 1740, + "ordered_route_sha256": "b15a59da1afe054ab115aeb2a676114963e0781a8ec5945a293ebc4c6c75e5a9", + "route_weight_sha256": "7344bbd12f264eab9eb6e44eb810cafc6ac1e493b226c156c35fbc124c7ead2a", + "loads": [ + 49, + 24, + 45, + 44, + 42, + 21, + 5, + 20, + 30, + 33, + 15, + 9, + 7, + 8, + 21, + 65, + 10, + 13, + 45, + 21, + 51, + 38, + 19, + 13, + 26, + 30, + 5, + 28, + 34, + 70, + 63, + 18, + 32, + 20, + 10, + 32, + 39, + 31, + 5, + 31, + 19, + 27, + 37, + 43, + 20, + 22, + 37, + 32, + 33, + 31, + 3, + 11, + 40, + 9, + 34, + 20, + 7, + 31, + 37, + 4, + 36, + 10, + 18, + 57 + ], + "weighted_loads": [ + 2.9753098729997873, + 1.417069286108017, + 3.0553968027234077, + 2.0636805556714535, + 3.1961415968835354, + 1.3065438717603683, + 0.2242654338479042, + 1.3266035579144955, + 1.913133092224598, + 2.1077220179140568, + 1.4279426038265228, + 0.43540385738015175, + 0.23804626055061817, + 0.3192829517647624, + 1.0834610890597105, + 4.920984752476215, + 0.8598797172307968, + 0.5275596957653761, + 2.7836801446974277, + 1.5252350494265556, + 3.0258714705705643, + 2.3375274930149317, + 1.2952791266143322, + 0.9072551503777504, + 1.2400888036936522, + 1.7646545637398958, + 0.3052718937397003, + 1.6520782001316547, + 2.1824418120086193, + 4.475789126008749, + 4.4937108270823956, + 0.9062436148524284, + 1.8616987485438585, + 1.5014218352735043, + 0.45244303345680237, + 2.292002350091934, + 2.6786762941628695, + 2.328380648046732, + 0.27340416237711906, + 1.8886760361492634, + 0.9882809463888407, + 2.0535452775657177, + 1.97206412255764, + 2.7869442123919725, + 0.8680785093456507, + 1.2404894959181547, + 2.8976466208696365, + 1.963203739374876, + 2.466239295899868, + 1.969593096524477, + 0.14342335239052773, + 0.5384305268526077, + 2.4310086369514465, + 0.37029819563031197, + 1.859780341386795, + 1.2970434818416834, + 0.3137774392962456, + 1.5353676807135344, + 2.6676955483853817, + 0.18009141460061073, + 2.0616778042167425, + 0.49459037743508816, + 1.3340324871242046, + 4.476527076214552 + ], + "unique_experts": 64, + "load_cv": 0.5772221074615189, + "normalized_load_entropy": 0.9582751963210452, + "max_load_share": 0.040229885057471264 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 249, + "ordered_topk_exact_tokens": 198, + "set_exact_tokens": 220, + "mean_set_jaccard": 0.9667240390131957, + "mean_token_weighted_tv": 0.007532503171618205, + "aggregate_load_tv": 0.012048192771084338 + }, + "system_bos": { + "tokens": 249, + "ordered_topk_exact_tokens": 179, + "set_exact_tokens": 203, + "mean_set_jaccard": 0.9472174411933447, + "mean_token_weighted_tv": 0.01184456485013167, + "aggregate_load_tv": 0.017402945113788492 + }, + "system_x": { + "tokens": 249, + "ordered_topk_exact_tokens": 154, + "set_exact_tokens": 189, + "mean_set_jaccard": 0.9302925989672977, + "mean_token_weighted_tv": 0.015347739475887703, + "aggregate_load_tv": 0.02476572958500669 + }, + "system_period": { + "tokens": 249, + "ordered_topk_exact_tokens": 155, + "set_exact_tokens": 189, + "mean_set_jaccard": 0.9285714285714285, + "mean_token_weighted_tv": 0.015705917355974753, + "aggregate_load_tv": 0.024096385542168676 + }, + "bos_at_s0": { + "tokens": 249, + "ordered_topk_exact_tokens": 161, + "set_exact_tokens": 183, + "mean_set_jaccard": 0.9225473321858864, + "mean_token_weighted_tv": 0.01653271539503312, + "aggregate_load_tv": 0.024096385542168676 + }, + "bos_at_s1": { + "tokens": 249, + "ordered_topk_exact_tokens": 143, + "set_exact_tokens": 171, + "mean_set_jaccard": 0.9079173838209982, + "mean_token_weighted_tv": 0.019222352616339325, + "aggregate_load_tv": 0.025435073627844702 + }, + "x_at_s0": { + "tokens": 249, + "ordered_topk_exact_tokens": 161, + "set_exact_tokens": 189, + "mean_set_jaccard": 0.929432013769363, + "mean_token_weighted_tv": 0.015840739232439352, + "aggregate_load_tv": 0.022088353413654626 + }, + "x_at_s1": { + "tokens": 249, + "ordered_topk_exact_tokens": 133, + "set_exact_tokens": 171, + "mean_set_jaccard": 0.9079173838209982, + "mean_token_weighted_tv": 0.020152768793414873, + "aggregate_load_tv": 0.024096385542168676 + }, + "period_at_s0": { + "tokens": 249, + "ordered_topk_exact_tokens": 160, + "set_exact_tokens": 191, + "mean_set_jaccard": 0.9325874928284568, + "mean_token_weighted_tv": 0.015479203466939399, + "aggregate_load_tv": 0.02342704149933066 + }, + "period_at_s1": { + "tokens": 249, + "ordered_topk_exact_tokens": 133, + "set_exact_tokens": 171, + "mean_set_jaccard": 0.9079173838209982, + "mean_token_weighted_tv": 0.01995579394919566, + "aggregate_load_tv": 0.02677376171352074 + } + } + }, + "layer_10": { + "layer": 10, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "263de474799556daca19b3e3299d2d0b0ed30af4c92f72b487cd8654f0308298", + "route_weight_sha256": "9de19d4ee92dc8e3ce36b645bcee52cdf28ebbf37314be4bc2decc30b5ea25f2", + "loads": [ + 58, + 19, + 41, + 29, + 13, + 14, + 10, + 28, + 49, + 17, + 9, + 26, + 12, + 11, + 42, + 65, + 28, + 10, + 15, + 6, + 26, + 5, + 46, + 93, + 40, + 27, + 36, + 11, + 8, + 36, + 15, + 22, + 40, + 86, + 11, + 16, + 4, + 27, + 36, + 23, + 22, + 13, + 36, + 1, + 0, + 3, + 5, + 16, + 27, + 6, + 0, + 12, + 27, + 30, + 19, + 15, + 29, + 5, + 18, + 10, + 20, + 17, + 44, + 9 + ], + "weighted_loads": [ + 3.68166839890182, + 0.8102466594427824, + 2.1798648592084646, + 1.2834657616913319, + 0.8358295932412148, + 0.7106825113296509, + 0.44133874773979187, + 1.427787471562624, + 3.4731912463903427, + 0.7477330081164837, + 0.5489909015595913, + 1.5682777911424637, + 1.0072048231959343, + 0.4895044397562742, + 3.4289211109280586, + 5.876567225903273, + 1.87869269028306, + 0.7138086296617985, + 0.9333769269287586, + 0.2712225541472435, + 1.2991292960941792, + 0.23824017867445946, + 3.546912694349885, + 5.851077433675528, + 2.4784799218177795, + 2.4104335717856884, + 2.548838209360838, + 0.42929277941584587, + 0.3161104414612055, + 2.7950984090566635, + 0.6735858265310526, + 1.4919583648443222, + 2.676654130220413, + 4.321373004466295, + 0.7856764085590839, + 0.9998281300067902, + 0.18359778821468353, + 1.7826232612133026, + 2.5548439249396324, + 1.5625775326043367, + 1.226692322641611, + 0.713603138923645, + 2.354849388822913, + 0.034041862934827805, + 0.0, + 0.14979902654886246, + 0.3015094958245754, + 0.8903462700545788, + 1.444189976900816, + 0.3829471096396446, + 0.0, + 0.7532913349568844, + 1.5175494961440563, + 2.2875860556960106, + 1.1876467131078243, + 0.9927039444446564, + 1.5996314845979214, + 0.3126704469323158, + 1.1552308313548565, + 0.4591219648718834, + 1.365522351115942, + 1.1573871988803148, + 2.5509070940315723, + 0.3920389972627163 + ], + "unique_experts": 62, + "load_cv": 0.7951480438072036, + "normalized_load_entropy": 0.9309742852202362, + "max_load_share": 0.06224899598393574 + }, + "full_input": { + "tokens": 274, + "top_k": 6, + "decisions": 1644, + "ordered_route_sha256": "45b69ba3e19aab4828ca18e872b639bef0678d9aaa6524a26e57c9d8771d2107", + "route_weight_sha256": "b1b0483a6be4dadf041a20715d744f6af35d18c41152a178e9993448378fe93f", + "loads": [ + 59, + 20, + 43, + 29, + 13, + 14, + 10, + 32, + 49, + 19, + 11, + 28, + 13, + 14, + 44, + 65, + 28, + 13, + 22, + 8, + 29, + 7, + 47, + 93, + 40, + 29, + 36, + 17, + 9, + 37, + 17, + 23, + 40, + 93, + 12, + 17, + 4, + 28, + 36, + 23, + 22, + 23, + 40, + 3, + 4, + 5, + 11, + 19, + 27, + 8, + 2, + 19, + 27, + 33, + 19, + 24, + 29, + 12, + 18, + 20, + 25, + 30, + 44, + 9 + ], + "weighted_loads": [ + 3.7367006670683622, + 0.862179147079587, + 2.1988710430450737, + 1.2834657616913319, + 0.8358295932412148, + 0.7106825113296509, + 0.44133874773979187, + 1.6042847335338593, + 3.4731912463903427, + 0.7722027041018009, + 0.6463131941854954, + 1.663211815059185, + 1.040023673325777, + 1.905063508078456, + 3.5787363909184933, + 5.876567225903273, + 1.87869269028306, + 0.9711830355226994, + 1.318945458624512, + 0.37436418607831, + 1.4124523513019085, + 0.3222977966070175, + 3.5506355590187013, + 5.851077433675528, + 2.4784799218177795, + 2.473869364708662, + 2.548838209360838, + 1.1326371021568775, + 0.3626957293599844, + 2.8366370499134064, + 0.8619387019425631, + 1.5056742280721664, + 2.676654130220413, + 4.651932593435049, + 0.8155387304723263, + 1.036722980439663, + 0.18359778821468353, + 1.8258133493363857, + 2.5548439249396324, + 1.5625775326043367, + 1.226692322641611, + 1.8191989921033382, + 2.4674198515713215, + 0.1319533884525299, + 0.2020931839942932, + 0.25662410259246826, + 0.5712575204670429, + 1.0067290998995304, + 1.444189976900816, + 0.4720296896994114, + 0.09157693758606911, + 1.1097679138183594, + 1.5175494961440563, + 2.4684801027178764, + 1.1876467131078243, + 1.6786569617688656, + 1.5996314845979214, + 0.6995036005973816, + 1.1552308313548565, + 1.1084976680576801, + 1.7367558181285858, + 2.3054040167480707, + 2.5509070940315723, + 0.3920389972627163 + ], + "unique_experts": 64, + "load_cv": 0.7082214770558867, + "normalized_load_entropy": 0.9466352507379978, + "max_load_share": 0.05656934306569343 + } + }, + "s1_eos": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "454804fc0ff0fe3ed592cfa692ef2100b821f2c416524bc80ea94adba1ec2cfc", + "route_weight_sha256": "f5aec612fc39e96fbe174894119a139171fcea8b84e8ad9a129ab967264b7d6c", + "loads": [ + 59, + 17, + 41, + 29, + 12, + 12, + 10, + 28, + 50, + 16, + 8, + 25, + 12, + 11, + 42, + 66, + 29, + 10, + 18, + 6, + 25, + 5, + 46, + 91, + 40, + 26, + 37, + 12, + 6, + 35, + 15, + 22, + 42, + 88, + 11, + 16, + 4, + 27, + 36, + 23, + 21, + 14, + 36, + 1, + 0, + 3, + 5, + 16, + 28, + 6, + 0, + 13, + 26, + 31, + 18, + 14, + 31, + 5, + 19, + 9, + 20, + 17, + 44, + 9 + ], + "weighted_loads": [ + 3.7351977210491896, + 0.7426924575120211, + 2.1974166240543127, + 1.284011097624898, + 0.8052440397441387, + 0.6167622394859791, + 0.4381291773170233, + 1.4091625958681107, + 3.5142360012978315, + 0.7336720693856478, + 0.5005565099418163, + 1.5099255852401257, + 0.9719562493264675, + 0.48197171092033386, + 3.4265734516084194, + 5.885085029527545, + 1.9085369389504194, + 0.7291859686374664, + 1.0373236071318388, + 0.26479896530508995, + 1.2815307937562466, + 0.2477005310356617, + 3.5085240136832, + 5.797754786908627, + 2.4731585420668125, + 2.352182876318693, + 2.6040355879813433, + 0.45889156125485897, + 0.2422254141420126, + 2.7313664369285107, + 0.6588399931788445, + 1.472937911748886, + 2.7294817715883255, + 4.4364780858159065, + 0.7861848026514053, + 0.9904048182070255, + 0.18315809220075607, + 1.804515689611435, + 2.542318833991885, + 1.5439082067459822, + 1.193768683820963, + 0.7868517078459263, + 2.334620214998722, + 0.03428129851818085, + 0.0, + 0.14751286059617996, + 0.29914356023073196, + 0.8856329023838043, + 1.4776416029781103, + 0.38049815222620964, + 0.0, + 0.7887667492032051, + 1.4852015227079391, + 2.319192636758089, + 1.1537508815526962, + 0.913064181804657, + 1.6684845723211765, + 0.3088277243077755, + 1.1995063908398151, + 0.44626839086413383, + 1.3535275869071484, + 1.1565341968089342, + 2.549849931150675, + 0.3997163847088814 + ], + "unique_experts": 62, + "load_cv": 0.802935025578819, + "normalized_load_entropy": 0.929514426742675, + "max_load_share": 0.06091030789825971 + }, + "full_input": { + "tokens": 290, + "top_k": 6, + "decisions": 1740, + "ordered_route_sha256": "4ecc9613090f0ccd9fddeff6b1f3988b936853063e0995a6ca10b95790cc0416", + "route_weight_sha256": "3c56b3b6746bd9014e001b652b4a458c649ed875816dcc5fcebc44efad8e8b0a", + "loads": [ + 60, + 18, + 44, + 29, + 17, + 12, + 10, + 29, + 50, + 18, + 10, + 29, + 16, + 13, + 45, + 66, + 29, + 15, + 24, + 7, + 26, + 7, + 47, + 91, + 41, + 29, + 39, + 32, + 6, + 38, + 24, + 23, + 47, + 105, + 13, + 18, + 6, + 30, + 37, + 23, + 22, + 30, + 40, + 3, + 3, + 8, + 11, + 19, + 36, + 9, + 3, + 27, + 27, + 35, + 18, + 26, + 32, + 12, + 19, + 26, + 30, + 28, + 44, + 9 + ], + "weighted_loads": [ + 3.7889540251344442, + 0.7941231969743967, + 2.256626717746258, + 1.284011097624898, + 1.0401356741786003, + 0.6167622394859791, + 0.4381291773170233, + 1.4473896324634552, + 3.5142360012978315, + 0.7588540632277727, + 0.578706655651331, + 1.7325764894485474, + 1.1718927398324013, + 1.8563178479671478, + 3.65299629047513, + 5.885085029527545, + 1.9085369389504194, + 1.0979757606983185, + 1.4026429415680468, + 0.3013893626630306, + 1.321327980607748, + 0.33225293457508087, + 3.512442983686924, + 5.797754786908627, + 2.514956444501877, + 2.6810558196157217, + 2.67447704449296, + 1.759538609534502, + 0.2422254141420126, + 2.8650582283735275, + 1.3554713390767574, + 1.4866537749767303, + 3.2190087288618088, + 5.271236889064312, + 0.927682064473629, + 1.154099516570568, + 0.26878131926059723, + 1.9321759305894375, + 2.5788306202739477, + 1.5439082067459822, + 1.2365548349916935, + 2.1879093255847692, + 2.432148275896907, + 0.1017882227897644, + 0.1779402531683445, + 0.40226832032203674, + 0.6274876222014427, + 1.0003220736980438, + 2.124886764213443, + 0.5455374978482723, + 0.17909566313028336, + 1.6267096363008022, + 1.5551660805940628, + 2.540156055241823, + 1.1537508815526962, + 1.7819772213697433, + 1.7420753575861454, + 0.7027281075716019, + 1.1995063908398151, + 1.54211051389575, + 2.1110564582049847, + 2.1540929321199656, + 2.549849931150675, + 0.3997163847088814 + ], + "unique_experts": 64, + "load_cv": 0.6969992113678304, + "normalized_load_entropy": 0.9478471241345751, + "max_load_share": 0.0603448275862069 + } + }, + "s0_bos": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "e5c4ca6d8297deb8b886acead6fb577b0945597d9854ff8e9088281b8b2b6483", + "route_weight_sha256": "2d4d67ca30c8ed69cd1ddd7c6f98ee65ebc40cda193b8244accb2503348d47b8", + "loads": [ + 57, + 16, + 41, + 29, + 13, + 15, + 10, + 28, + 49, + 13, + 9, + 26, + 13, + 12, + 42, + 67, + 29, + 10, + 17, + 7, + 25, + 6, + 44, + 90, + 39, + 27, + 38, + 11, + 8, + 35, + 14, + 22, + 39, + 85, + 10, + 16, + 3, + 28, + 38, + 21, + 21, + 15, + 35, + 1, + 0, + 3, + 5, + 16, + 27, + 6, + 0, + 13, + 26, + 31, + 19, + 17, + 33, + 5, + 20, + 10, + 21, + 17, + 40, + 11 + ], + "weighted_loads": [ + 3.6769505962729454, + 0.7058682646602392, + 2.187557166442275, + 1.2962581906467676, + 0.865889884531498, + 0.762344254180789, + 0.45133841037750244, + 1.3806911148130894, + 3.4877593629062176, + 0.6179216615855694, + 0.5493547134101391, + 1.5539374388754368, + 1.0185711979866028, + 0.5389813855290413, + 3.459764063358307, + 6.004804510623217, + 1.8970612175762653, + 0.7279749661684036, + 0.9911932311952114, + 0.31120739690959454, + 1.2934336736798286, + 0.28915321454405785, + 3.4460681825876236, + 5.707934353500605, + 2.4730240181088448, + 2.449698969721794, + 2.6376810930669308, + 0.413195226341486, + 0.3175707757472992, + 2.762423697859049, + 0.6286974549293518, + 1.498687632381916, + 2.64790515974164, + 4.175756240263581, + 0.7546093016862869, + 0.9892162103205919, + 0.15764429792761803, + 1.8522099927067757, + 2.6593064162880182, + 1.4803800098598003, + 1.197550430893898, + 0.7642209995537996, + 2.321967639029026, + 0.034134652465581894, + 0.0, + 0.14440445229411125, + 0.29176115244627, + 0.8937005698680878, + 1.4414941500872374, + 0.3885752744972706, + 0.0, + 0.7901769541203976, + 1.4933260679244995, + 2.3271213732659817, + 1.1921960227191448, + 1.0491431504487991, + 1.7718792036175728, + 0.2990964353084564, + 1.2323232479393482, + 0.4950025826692581, + 1.3904258571565151, + 1.167984338477254, + 2.4267581328749657, + 0.468074019998312 + ], + "unique_experts": 62, + "load_cv": 0.7820585548801329, + "normalized_load_entropy": 0.9326308714069086, + "max_load_share": 0.060240963855421686 + }, + "full_input": { + "tokens": 274, + "top_k": 6, + "decisions": 1644, + "ordered_route_sha256": "46e0e7f017e4add221e6a9ce35b11e4483a2f9558792d3324dbfe1a1ee9beac3", + "route_weight_sha256": "8ff3eed50844fb76c9b6d20596c5e1db92d6cbf4ff2b21475150eb128d110f81", + "loads": [ + 58, + 17, + 42, + 29, + 13, + 15, + 10, + 32, + 49, + 14, + 11, + 28, + 14, + 15, + 45, + 67, + 29, + 13, + 23, + 9, + 29, + 8, + 44, + 90, + 39, + 29, + 38, + 18, + 9, + 36, + 16, + 23, + 39, + 93, + 11, + 17, + 3, + 28, + 38, + 21, + 21, + 26, + 39, + 3, + 3, + 5, + 11, + 19, + 27, + 8, + 2, + 20, + 26, + 34, + 19, + 26, + 33, + 12, + 20, + 21, + 26, + 30, + 40, + 11 + ], + "weighted_loads": [ + 3.7139883376657963, + 0.7548852767795324, + 2.2017064671963453, + 1.2962581906467676, + 0.865889884531498, + 0.762344254180789, + 0.45133841037750244, + 1.5571883767843246, + 3.4877593629062176, + 0.634194377809763, + 0.6466770060360432, + 1.6506243608891964, + 1.0513900481164455, + 1.0848527029156685, + 3.6674053110182285, + 6.004804510623217, + 1.8970612175762653, + 0.9917221963405609, + 1.3948070779442787, + 0.41402886621654034, + 1.4787754639983177, + 0.3732108324766159, + 3.4460681825876236, + 5.707934353500605, + 2.4730240181088448, + 2.5131347626447678, + 2.6376810930669308, + 1.2432084046304226, + 0.3641560636460781, + 2.8039623387157917, + 0.818900816142559, + 1.5124034956097603, + 2.64790515974164, + 4.542333273217082, + 0.7844716235995293, + 1.0261110607534647, + 0.15764429792761803, + 1.8522099927067757, + 2.6593064162880182, + 1.4803800098598003, + 1.197550430893898, + 2.0549307595938444, + 2.4775346349924803, + 0.132046177983284, + 0.18828041851520538, + 0.25122952833771706, + 0.5615091770887375, + 1.0117520354688168, + 1.4414941500872374, + 0.5201216116547585, + 0.09157693758606911, + 1.1139752194285393, + 1.4933260679244995, + 2.5212310403585434, + 1.1921960227191448, + 1.7647246792912483, + 1.7718792036175728, + 0.6859295889735222, + 1.2323232479393482, + 1.203332494944334, + 1.7643224224448204, + 2.3487486857920885, + 2.4267581328749657, + 0.468074019998312 + ], + "unique_experts": 64, + "load_cv": 0.7000156876309392, + "normalized_load_entropy": 0.9472745248405765, + "max_load_share": 0.05656934306569343 + } + }, + "s1_bos": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "ae2ef01eeccc6eaeff745fe443aa7a0f4c8f0cd44e9ad249313741307204a51b", + "route_weight_sha256": "2bb50c4a470cde5a09dbfc9114385d0bc349439a1d0b667d22e14a62b8937803", + "loads": [ + 58, + 19, + 40, + 30, + 13, + 15, + 10, + 29, + 50, + 12, + 9, + 26, + 12, + 11, + 42, + 67, + 29, + 10, + 15, + 6, + 25, + 6, + 46, + 89, + 38, + 26, + 36, + 11, + 8, + 34, + 14, + 22, + 39, + 85, + 10, + 15, + 4, + 28, + 38, + 22, + 21, + 14, + 36, + 1, + 0, + 3, + 4, + 16, + 29, + 6, + 0, + 13, + 28, + 30, + 20, + 17, + 31, + 5, + 21, + 11, + 21, + 16, + 41, + 11 + ], + "weighted_loads": [ + 3.7570489458739758, + 0.807863300666213, + 2.1312451474368572, + 1.3244609646499157, + 0.8650988303124905, + 0.7574393674731255, + 0.4458901770412922, + 1.408632155507803, + 3.536609675735235, + 0.5746683832257986, + 0.5479201450943947, + 1.5374846793711185, + 0.9616411961615086, + 0.5024482272565365, + 3.447669565677643, + 6.044774565845728, + 1.8840320259332657, + 0.7632893957197666, + 0.9063379466533661, + 0.2640921864658594, + 1.2964882031083107, + 0.29621027410030365, + 3.4821897707879543, + 5.655862124636769, + 2.4824260659515858, + 2.370055226609111, + 2.5557167660444975, + 0.41087695211172104, + 0.313759358599782, + 2.6760154515504837, + 0.6206130124628544, + 1.4828954264521599, + 2.6304931454360485, + 4.287141075357795, + 0.7442556880414486, + 0.9507355727255344, + 0.19464753940701485, + 1.8803211562335491, + 2.665574098005891, + 1.4939336776733398, + 1.1966609489172697, + 0.7809631358832121, + 2.3116333708167076, + 0.034760136157274246, + 0.0, + 0.14631269499659538, + 0.24186189845204353, + 0.8826345875859261, + 1.5106074940413237, + 0.37780576199293137, + 0.0, + 0.8022497147321701, + 1.5692860968410969, + 2.288547832518816, + 1.2213321924209595, + 1.0323807522654533, + 1.7094639968127012, + 0.3003957197070122, + 1.275884609669447, + 0.5295215081423521, + 1.4127255082130432, + 1.1399406790733337, + 2.486622478812933, + 0.4600896965712309 + ], + "unique_experts": 62, + "load_cv": 0.7837066969216574, + "normalized_load_entropy": 0.9321147487576384, + "max_load_share": 0.059571619812583666 + }, + "full_input": { + "tokens": 290, + "top_k": 6, + "decisions": 1740, + "ordered_route_sha256": "b13ed3683dd5733c6fbc9eb731367a26b4a9c6bff33e12eb4fcd3f715f059ec3", + "route_weight_sha256": "755c5370735d7f311eb5ad92ede11eaa5cdb53461d5565a5a28259b882bf30c7", + "loads": [ + 58, + 20, + 42, + 30, + 18, + 15, + 10, + 30, + 50, + 13, + 11, + 30, + 16, + 13, + 46, + 67, + 29, + 14, + 20, + 8, + 27, + 8, + 46, + 89, + 39, + 29, + 38, + 32, + 8, + 37, + 22, + 23, + 44, + 103, + 12, + 17, + 6, + 31, + 39, + 22, + 22, + 31, + 38, + 3, + 3, + 8, + 10, + 19, + 37, + 10, + 3, + 27, + 29, + 34, + 20, + 29, + 32, + 12, + 21, + 30, + 31, + 27, + 41, + 11 + ], + "weighted_loads": [ + 3.7570489458739758, + 0.852895176038146, + 2.1854661256074905, + 1.3244609646499157, + 1.099990464746952, + 0.7574393674731255, + 0.4458901770412922, + 1.4468591921031475, + 3.536609675735235, + 0.5909410994499922, + 0.6260702908039093, + 1.759638138115406, + 1.1615776866674423, + 1.011399507522583, + 3.7466383054852486, + 6.044774565845728, + 1.8840320259332657, + 1.0708073414862156, + 1.3025776110589504, + 0.3507965076714754, + 1.3881167583167553, + 0.3807626776397228, + 3.4821897707879543, + 5.655862124636769, + 2.52422396838665, + 2.6989281699061394, + 2.626158222556114, + 1.8086472991853952, + 0.313759358599782, + 2.8097072429955006, + 1.2824106998741627, + 1.4966112896800041, + 3.120020102709532, + 5.161468671634793, + 0.8857529498636723, + 1.114430271089077, + 0.280270766466856, + 2.002767875790596, + 2.7020858842879534, + 1.4939336776733398, + 1.2394471000880003, + 2.448571238666773, + 2.357442546635866, + 0.1022670604288578, + 0.21621902287006378, + 0.40106815472245216, + 0.5702059604227543, + 0.9979648031294346, + 2.157852655276656, + 0.6105079427361488, + 0.17909566313028336, + 1.6083034835755825, + 1.6392506547272205, + 2.5216341204941273, + 1.2213321924209595, + 1.9563716724514961, + 1.78305478207767, + 0.6942961029708385, + 1.275884609669447, + 1.720311576500535, + 2.1701598837971687, + 2.1634964123368263, + 2.486622478812933, + 0.4600896965712309 + ], + "unique_experts": 64, + "load_cv": 0.6797099005823464, + "normalized_load_entropy": 0.9502141664713343, + "max_load_share": 0.05919540229885058 + } + }, + "s0_x": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "99e15cd5b1a7aa22c243476a68bd29cbd493dc85e56315012dc5efefca677136", + "route_weight_sha256": "5a629a7d1e56b839642b70ac8da9326cea473f8e2058d42a8318b5c35c0a6f00", + "loads": [ + 60, + 17, + 40, + 26, + 15, + 15, + 11, + 30, + 49, + 14, + 9, + 25, + 11, + 13, + 42, + 66, + 29, + 10, + 16, + 6, + 24, + 6, + 44, + 89, + 40, + 25, + 38, + 11, + 12, + 35, + 16, + 22, + 41, + 83, + 10, + 16, + 4, + 29, + 37, + 20, + 21, + 14, + 36, + 2, + 0, + 2, + 5, + 16, + 28, + 6, + 0, + 12, + 27, + 30, + 20, + 17, + 29, + 5, + 21, + 10, + 20, + 16, + 41, + 10 + ], + "weighted_loads": [ + 3.7619482316076756, + 0.7517721932381392, + 2.1552697475999594, + 1.1740241460502148, + 0.9411046132445335, + 0.7655665501952171, + 0.4840610697865486, + 1.478320425376296, + 3.4752546064555645, + 0.6496253740042448, + 0.5431824885308743, + 1.5061145573854446, + 0.9618896543979645, + 0.5553790647536516, + 3.43417127430439, + 6.047454906627536, + 1.9221561588346958, + 0.7408798970282078, + 0.9344956576824188, + 0.27238329499959946, + 1.2564601860940456, + 0.29447853565216064, + 3.4898761063814163, + 5.635350728407502, + 2.5352782607078552, + 2.333432875573635, + 2.6611540000885725, + 0.4292863570153713, + 0.4531212989240885, + 2.7490800730884075, + 0.705288527533412, + 1.483602223917842, + 2.695273706689477, + 4.00350377522409, + 0.7510168477892876, + 0.9672067705541849, + 0.1864124797284603, + 1.8993724435567856, + 2.673305345699191, + 1.4443041421473026, + 1.1901974864304066, + 0.75110824406147, + 2.313986785709858, + 0.07366287708282471, + 0.0, + 0.10641208663582802, + 0.29573899507522583, + 0.8785864412784576, + 1.4740764647722244, + 0.3873164691030979, + 0.0, + 0.7458735331892967, + 1.5390275828540325, + 2.293635740876198, + 1.2465462125837803, + 1.0359910391271114, + 1.6166274286806583, + 0.299822136759758, + 1.3096670769155025, + 0.49016840755939484, + 1.3849559649825096, + 1.1370751280337572, + 2.5080751441419125, + 0.443868950009346 + ], + "unique_experts": 62, + "load_cv": 0.7755049081709271, + "normalized_load_entropy": 0.933738061029647, + "max_load_share": 0.059571619812583666 + }, + "full_input": { + "tokens": 274, + "top_k": 6, + "decisions": 1644, + "ordered_route_sha256": "efd85228ee1c9d63de382092359efaca11fe36e2b3c733b8a6de763599b6a077", + "route_weight_sha256": "945654353c29df94bc411d36c969da7f340c7e623bfb4d5940654a5185c25bf8", + "loads": [ + 61, + 18, + 41, + 26, + 15, + 15, + 11, + 35, + 49, + 15, + 11, + 27, + 12, + 15, + 44, + 66, + 29, + 14, + 21, + 9, + 27, + 8, + 44, + 89, + 40, + 27, + 38, + 16, + 13, + 36, + 18, + 23, + 41, + 91, + 11, + 17, + 4, + 30, + 37, + 20, + 21, + 23, + 39, + 4, + 4, + 5, + 12, + 20, + 28, + 8, + 2, + 19, + 27, + 33, + 20, + 26, + 29, + 13, + 21, + 20, + 25, + 30, + 41, + 10 + ], + "weighted_loads": [ + 3.8162505961954594, + 0.8066535759717226, + 2.1694190483540297, + 1.1740241460502148, + 0.9411046132445335, + 0.7655665501952171, + 0.4840610697865486, + 1.693994538858533, + 3.4752546064555645, + 0.6658980902284384, + 0.6405047811567783, + 1.5980912894010544, + 0.9947085045278072, + 1.0587018001824617, + 3.5960919708013535, + 6.047454906627536, + 1.9221561588346958, + 1.0514932833611965, + 1.2738076634705067, + 0.4238159880042076, + 1.369783241301775, + 0.3785361535847187, + 3.4898761063814163, + 5.635350728407502, + 2.5352782607078552, + 2.3968686684966087, + 2.6611540000885725, + 1.0567914582788944, + 0.4997065868228674, + 2.7906187139451504, + 0.9002066906541586, + 1.4973180871456861, + 2.695273706689477, + 4.382778258994222, + 0.7808791697025299, + 1.0041016209870577, + 0.1864124797284603, + 1.953599713742733, + 2.673305345699191, + 1.4443041421473026, + 1.1901974864304066, + 1.7503263466060162, + 2.418516306206584, + 0.1715744026005268, + 0.20048486441373825, + 0.285309549421072, + 0.6147873997688293, + 1.0416249781847, + 1.4740764647722244, + 0.4769345074892044, + 0.09157693758606911, + 1.1147575937211514, + 1.5390275828540325, + 2.4878071509301662, + 1.2465462125837803, + 1.6761599816381931, + 1.6166274286806583, + 0.7498175725340843, + 1.3096670769155025, + 1.1363016664981842, + 1.7510462664067745, + 2.358246924355626, + 2.5080751441419125, + 0.443868950009346 + ], + "unique_experts": 64, + "load_cv": 0.6894494497818534, + "normalized_load_entropy": 0.9493702463578666, + "max_load_share": 0.05535279805352798 + } + }, + "s1_x": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "aa0883fd779cc9a29a52ac26a1df694db0735b4d9fd0babfa7a1975fad2e7722", + "route_weight_sha256": "abe30578ce948260c40994bd892347e644eeaa7c184dfe4ec7d179af5d504241", + "loads": [ + 58, + 16, + 40, + 30, + 14, + 15, + 10, + 29, + 49, + 11, + 8, + 26, + 12, + 10, + 42, + 68, + 29, + 11, + 17, + 7, + 24, + 6, + 46, + 88, + 39, + 25, + 37, + 10, + 9, + 35, + 14, + 22, + 40, + 88, + 10, + 16, + 5, + 29, + 38, + 22, + 22, + 13, + 35, + 1, + 0, + 3, + 4, + 16, + 29, + 6, + 0, + 13, + 27, + 30, + 19, + 17, + 30, + 5, + 19, + 10, + 21, + 15, + 43, + 11 + ], + "weighted_loads": [ + 3.7132670879364014, + 0.7325454242527485, + 2.12516282312572, + 1.3267640862613916, + 0.9226818475872278, + 0.7480867430567741, + 0.44473516196012497, + 1.3876142371445894, + 3.511799219995737, + 0.5270993653684855, + 0.5053689852356911, + 1.534948531538248, + 0.9171779602766037, + 0.42501450702548027, + 3.4347810558974743, + 6.123291244730353, + 1.8595649674534798, + 0.8483805954456329, + 0.970838688313961, + 0.3080073595046997, + 1.2662490531802177, + 0.2958047166466713, + 3.479218238964677, + 5.564014747738838, + 2.533510159701109, + 2.305992517620325, + 2.615292329341173, + 0.3769164588302374, + 0.34629610925912857, + 2.6885595358908176, + 0.628013962879777, + 1.471181746572256, + 2.651282537728548, + 4.3028320129960775, + 0.726310234516859, + 0.9724814593791962, + 0.2309793271124363, + 1.9273173324763775, + 2.674189994111657, + 1.5129592306911945, + 1.2279823925346136, + 0.7388995327055454, + 2.2528515085577965, + 0.0353250652551651, + 0.0, + 0.14667989686131477, + 0.24262847006320953, + 0.8774106912314892, + 1.5286217834800482, + 0.3831300251185894, + 0.0, + 0.7874110359698534, + 1.5447389483451843, + 2.2623206712305546, + 1.187766656279564, + 1.0373139828443527, + 1.6591057255864143, + 0.29457593709230423, + 1.2288029752671719, + 0.5254128910601139, + 1.424000646919012, + 1.104394232854247, + 2.5636486746370792, + 0.47335851565003395 + ], + "unique_experts": 62, + "load_cv": 0.7919683693075906, + "normalized_load_entropy": 0.9313010502652506, + "max_load_share": 0.058902275769745646 + }, + "full_input": { + "tokens": 290, + "top_k": 6, + "decisions": 1740, + "ordered_route_sha256": "84ee754a53640859f2585cb53a81d482e64615c5cd44019624063730ac2fe8e8", + "route_weight_sha256": "c7707bb5321b61e8a2af08c1f38ea0aee25eb9c248ab7f0194abd88b9edffa6d", + "loads": [ + 59, + 17, + 42, + 30, + 19, + 15, + 10, + 31, + 49, + 12, + 11, + 31, + 16, + 11, + 46, + 68, + 29, + 16, + 21, + 8, + 25, + 8, + 46, + 88, + 40, + 28, + 39, + 28, + 9, + 38, + 23, + 23, + 45, + 106, + 12, + 18, + 7, + 32, + 39, + 22, + 23, + 29, + 37, + 3, + 2, + 9, + 11, + 20, + 37, + 10, + 5, + 27, + 28, + 34, + 19, + 27, + 31, + 13, + 19, + 27, + 31, + 27, + 43, + 11 + ], + "weighted_loads": [ + 3.763295102864504, + 0.7923400402069092, + 2.1793838012963533, + 1.3267640862613916, + 1.1575734820216894, + 0.7480867430567741, + 0.44473516196012497, + 1.4762326795607805, + 3.511799219995737, + 0.543372081592679, + 0.631966657936573, + 1.801656298339367, + 1.1171144507825375, + 0.8937760107219219, + 3.735017102211714, + 6.123291244730353, + 1.8595649674534798, + 1.1884159296751022, + 1.296376559883356, + 0.33806194365024567, + 1.3060462400317192, + 0.38035712018609047, + 3.479218238964677, + 5.564014747738838, + 2.5753080621361732, + 2.6348654609173536, + 2.68573378585279, + 1.5623094849288464, + 0.34629610925912857, + 2.8222513273358345, + 1.3522048126906157, + 1.4848976098001003, + 3.1408094950020313, + 5.19177377410233, + 0.8678074963390827, + 1.1361761577427387, + 0.31660255417227745, + 2.0587755665183067, + 2.7107017803937197, + 1.5129592306911945, + 1.2707685437053442, + 2.060211317613721, + 2.298660684376955, + 0.10283198952674866, + 0.14372535049915314, + 0.46490151062607765, + 0.6379160955548286, + 1.0366352386772633, + 2.1758669447153807, + 0.5892229322344065, + 0.2612018287181854, + 1.6364473458379507, + 1.614703506231308, + 2.4776073060929775, + 1.187766656279564, + 1.7706658765673637, + 1.7326965108513832, + 0.7401499412953854, + 1.2288029752671719, + 1.627990335226059, + 2.1640020571649075, + 2.177471635863185, + 2.5636486746370792, + 0.47335851565003395 + ], + "unique_experts": 64, + "load_cv": 0.685593402955604, + "normalized_load_entropy": 0.9502112725983038, + "max_load_share": 0.06091954022988506 + } + }, + "s0_period": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "c5f1667c4842556435161f4b775ab6ad9f5c285d4601a5cc37e14f805d9c8571", + "route_weight_sha256": "da34325ef2e65f7573a284c8678a2bb820dc83d6e801d224c198918d27b27737", + "loads": [ + 60, + 18, + 41, + 28, + 15, + 14, + 10, + 28, + 49, + 14, + 9, + 26, + 11, + 13, + 42, + 66, + 29, + 10, + 16, + 7, + 25, + 6, + 43, + 92, + 39, + 25, + 37, + 12, + 12, + 36, + 15, + 23, + 41, + 79, + 10, + 16, + 3, + 28, + 38, + 19, + 21, + 13, + 34, + 1, + 0, + 3, + 5, + 16, + 28, + 6, + 0, + 12, + 27, + 31, + 19, + 16, + 31, + 5, + 21, + 11, + 21, + 15, + 41, + 12 + ], + "weighted_loads": [ + 3.768571550026536, + 0.7865118533372879, + 2.197468426078558, + 1.2573385182768106, + 0.9602393433451653, + 0.7357442956417799, + 0.4510260298848152, + 1.393367862328887, + 3.5037137158215046, + 0.6448261793702841, + 0.5432978831231594, + 1.553885605186224, + 0.9671887718141079, + 0.5615417528897524, + 3.4457700699567795, + 6.045281905680895, + 1.930446494370699, + 0.7328649871051311, + 0.9540055729448795, + 0.2996452562510967, + 1.2948393374681473, + 0.2958783879876137, + 3.4756071716547012, + 5.786657810211182, + 2.4990166891366243, + 2.3268909193575382, + 2.601958252489567, + 0.4571475461125374, + 0.46078843623399734, + 2.786830600351095, + 0.6552416905760765, + 1.5203700475394726, + 2.700520556420088, + 3.8698690086603165, + 0.7574911713600159, + 0.9722645729780197, + 0.14785193651914597, + 1.8689578752964735, + 2.704591592773795, + 1.4065144956111908, + 1.2049881536513567, + 0.7140181213617325, + 2.247455084696412, + 0.035003095865249634, + 0.0, + 0.14776111766695976, + 0.30004018917679787, + 0.8866467028856277, + 1.4863659497350454, + 0.3917047344148159, + 0.0, + 0.7435880936682224, + 1.5586980022490025, + 2.3253236301243305, + 1.2022487744688988, + 1.008238222450018, + 1.7045151256024837, + 0.30373160541057587, + 1.3059735354036093, + 0.5288984775543213, + 1.4132738001644611, + 1.100900825113058, + 2.508538454771042, + 0.506599698215723 + ], + "unique_experts": 62, + "load_cv": 0.7740986282610695, + "normalized_load_entropy": 0.9337882755551818, + "max_load_share": 0.06157965194109773 + }, + "full_input": { + "tokens": 274, + "top_k": 6, + "decisions": 1644, + "ordered_route_sha256": "65a10d6a0e7451a4dd87e22b5634fe5e2f236679d743c76bdb9aa8ac204716d3", + "route_weight_sha256": "55d402eabc5668dcef047ed43034a3bcb5ea7c230623a71baa397051c73cad83", + "loads": [ + 61, + 19, + 42, + 28, + 15, + 14, + 10, + 32, + 49, + 15, + 11, + 28, + 13, + 15, + 44, + 66, + 29, + 13, + 21, + 9, + 28, + 8, + 43, + 92, + 39, + 27, + 37, + 18, + 13, + 37, + 19, + 24, + 41, + 86, + 11, + 17, + 3, + 29, + 38, + 19, + 21, + 24, + 37, + 3, + 3, + 6, + 11, + 19, + 28, + 8, + 2, + 20, + 27, + 34, + 19, + 25, + 31, + 13, + 21, + 21, + 27, + 28, + 41, + 12 + ], + "weighted_loads": [ + 3.82583693228662, + 0.8302724547684193, + 2.2116177268326283, + 1.2573385182768106, + 0.9602393433451653, + 0.7357442956417799, + 0.4510260298848152, + 1.5698651243001223, + 3.5037137158215046, + 0.6610988955944777, + 0.6406201757490635, + 1.6456852219998837, + 1.0370364300906658, + 1.0648644883185625, + 3.605869837105274, + 6.045281905680895, + 1.930446494370699, + 0.9997416622936726, + 1.2933175787329674, + 0.4086495004594326, + 1.4081623926758766, + 0.37993600592017174, + 3.4756071716547012, + 5.786657810211182, + 2.4990166891366243, + 2.390326712280512, + 2.601958252489567, + 1.1204934753477573, + 0.5073737241327763, + 2.828369241207838, + 0.9634473510086536, + 1.5340859107673168, + 2.700520556420088, + 4.20042859762907, + 0.7873534932732582, + 1.0091594234108925, + 0.14785193651914597, + 1.92276500351727, + 2.704591592773795, + 1.4065144956111908, + 1.2049881536513567, + 1.8174230456352234, + 2.351984605193138, + 0.13291462138295174, + 0.15775970742106438, + 0.2971523404121399, + 0.5697882138192654, + 1.0099628269672394, + 1.4863659497350454, + 0.5030003376305103, + 0.09157693758606911, + 1.1832549013197422, + 1.5586980022490025, + 2.5151587426662445, + 1.2022487744688988, + 1.678055290132761, + 1.7045151256024837, + 0.7641232684254646, + 1.3059735354036093, + 1.1871704161167145, + 1.8315742649137974, + 2.2494584880769253, + 2.508538454771042, + 0.506599698215723 + ], + "unique_experts": 64, + "load_cv": 0.6849007963364313, + "normalized_load_entropy": 0.9493765328964827, + "max_load_share": 0.05596107055961071 + } + }, + "s1_period": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "b1d89998fa2fae3c022873eb93df0e38bb19e08ceae6091a4af2948801804222", + "route_weight_sha256": "30245c5e30b30c46b232fdd12d2e9dd8d97739b3ecb2b6c339d3345adbff3dfc", + "loads": [ + 57, + 17, + 40, + 30, + 14, + 15, + 10, + 29, + 48, + 11, + 8, + 26, + 12, + 11, + 42, + 67, + 29, + 12, + 17, + 6, + 26, + 6, + 45, + 86, + 37, + 26, + 37, + 10, + 10, + 35, + 14, + 22, + 41, + 85, + 10, + 16, + 5, + 29, + 38, + 22, + 22, + 14, + 35, + 1, + 0, + 2, + 5, + 16, + 30, + 6, + 0, + 13, + 26, + 30, + 19, + 17, + 30, + 5, + 20, + 10, + 21, + 16, + 41, + 14 + ], + "weighted_loads": [ + 3.6709913574159145, + 0.7545326352119446, + 2.1272696256637573, + 1.317529683932662, + 0.9405559524893761, + 0.7687689792364836, + 0.44485560432076454, + 1.3907976280897856, + 3.4652832485735416, + 0.5448900684714317, + 0.49624310061335564, + 1.5403309017419815, + 0.9162282794713974, + 0.45751127041876316, + 3.417670015245676, + 6.026476189494133, + 1.8799258321523666, + 0.9022615626454353, + 0.9648790583014488, + 0.2708735354244709, + 1.359922155737877, + 0.2965612858533859, + 3.432083338499069, + 5.501147601753473, + 2.4719892852008343, + 2.337368318811059, + 2.6183317359536886, + 0.37022578343749046, + 0.3842361867427826, + 2.6980416029691696, + 0.6140460465103388, + 1.4747305661439896, + 2.6979224868118763, + 4.307641858235002, + 0.7274254895746708, + 0.9778248183429241, + 0.22669554129242897, + 1.9400076735764742, + 2.6785756051540375, + 1.5037162154912949, + 1.2413655444979668, + 0.771909561008215, + 2.253398545086384, + 0.035209864377975464, + 0.0, + 0.0992426909506321, + 0.29555876180529594, + 0.8818030096590519, + 1.5692513454705477, + 0.38484935089945793, + 0.0, + 0.7912146039307117, + 1.5106812790036201, + 2.264830395579338, + 1.187278039753437, + 1.0179507583379745, + 1.6740588508546352, + 0.2989654317498207, + 1.2655513044446707, + 0.5124946087598801, + 1.4290326908230782, + 1.1358357146382332, + 2.481202393770218, + 0.5752800665795803 + ], + "unique_experts": 62, + "load_cv": 0.7712783762252197, + "normalized_load_entropy": 0.9337294906040566, + "max_load_share": 0.05756358768406961 + }, + "full_input": { + "tokens": 290, + "top_k": 6, + "decisions": 1740, + "ordered_route_sha256": "6f3ac8715053cdd8e25f9ed2bdde972c101779f13668c30eedaf767178899f8f", + "route_weight_sha256": "07fc3ca762df3df289a76452863458378e3fd5f3f210540fa22a7076baab9fb8", + "loads": [ + 59, + 18, + 42, + 31, + 19, + 15, + 10, + 30, + 48, + 12, + 10, + 31, + 16, + 12, + 46, + 67, + 29, + 17, + 21, + 7, + 27, + 8, + 45, + 86, + 38, + 29, + 39, + 28, + 10, + 38, + 24, + 23, + 46, + 102, + 12, + 18, + 7, + 32, + 39, + 22, + 23, + 31, + 37, + 3, + 2, + 8, + 11, + 20, + 38, + 9, + 4, + 28, + 27, + 34, + 19, + 28, + 31, + 13, + 20, + 27, + 31, + 28, + 41, + 14 + ], + "weighted_loads": [ + 3.755203016102314, + 0.7978808991611004, + 2.1814906038343906, + 1.3736171890050173, + 1.1754475869238377, + 0.7687689792364836, + 0.44485560432076454, + 1.4290246646851301, + 3.4652832485735416, + 0.5611627846956253, + 0.5743932463228703, + 1.8037463910877705, + 1.1161647699773312, + 0.9262727741152048, + 3.7051685079932213, + 6.026476189494133, + 1.8799258321523666, + 1.297455620020628, + 1.2904169298708439, + 0.2975277863442898, + 1.3997193425893784, + 0.3811136893928051, + 3.432083338499069, + 5.501147601753473, + 2.5137871876358986, + 2.6662412621080875, + 2.6887731924653053, + 1.5584605801850557, + 0.3842361867427826, + 2.8317333944141865, + 1.4336666595190763, + 1.4884464293718338, + 3.1874494440853596, + 5.142400661483407, + 0.8689227513968945, + 1.1415195167064667, + 0.3123187683522701, + 2.0705706421285868, + 2.7150873914361, + 1.5037162154912949, + 1.2841516956686974, + 2.1516295354813337, + 2.2992077209055424, + 0.10271678864955902, + 0.14372535049915314, + 0.39126062393188477, + 0.6239028237760067, + 1.0431058295071125, + 2.21649650670588, + 0.5496632903814316, + 0.23051749542355537, + 1.73335450142622, + 1.5806458368897438, + 2.476383190602064, + 1.187278039753437, + 1.8182777129113674, + 1.747649636119604, + 0.8253010027110577, + 1.2655513044446707, + 1.58632967248559, + 2.1687640100717545, + 2.1932961344718933, + 2.481202393770218, + 0.5752800665795803 + ], + "unique_experts": 64, + "load_cv": 0.6687363829253381, + "normalized_load_entropy": 0.9515498875813693, + "max_load_share": 0.05862068965517241 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 249, + "ordered_topk_exact_tokens": 194, + "set_exact_tokens": 217, + "mean_set_jaccard": 0.9632816982214571, + "mean_token_weighted_tv": 0.008388188379596036, + "aggregate_load_tv": 0.013386880856760375 + }, + "system_bos": { + "tokens": 249, + "ordered_topk_exact_tokens": 178, + "set_exact_tokens": 211, + "mean_set_jaccard": 0.955536431440046, + "mean_token_weighted_tv": 0.011305198499775794, + "aggregate_load_tv": 0.013386880856760373 + }, + "system_x": { + "tokens": 249, + "ordered_topk_exact_tokens": 159, + "set_exact_tokens": 191, + "mean_set_jaccard": 0.9300057372346529, + "mean_token_weighted_tv": 0.01600389172468918, + "aggregate_load_tv": 0.020749665327978582 + }, + "system_period": { + "tokens": 249, + "ordered_topk_exact_tokens": 154, + "set_exact_tokens": 192, + "mean_set_jaccard": 0.9328743545611016, + "mean_token_weighted_tv": 0.016051339793456607, + "aggregate_load_tv": 0.02342704149933066 + }, + "bos_at_s0": { + "tokens": 249, + "ordered_topk_exact_tokens": 161, + "set_exact_tokens": 187, + "mean_set_jaccard": 0.9262765347102695, + "mean_token_weighted_tv": 0.016066562260938697, + "aggregate_load_tv": 0.020080321285140562 + }, + "bos_at_s1": { + "tokens": 249, + "ordered_topk_exact_tokens": 159, + "set_exact_tokens": 190, + "mean_set_jaccard": 0.9288582903040734, + "mean_token_weighted_tv": 0.016928946146793872, + "aggregate_load_tv": 0.0214190093708166 + }, + "x_at_s0": { + "tokens": 249, + "ordered_topk_exact_tokens": 161, + "set_exact_tokens": 185, + "mean_set_jaccard": 0.9248422260470452, + "mean_token_weighted_tv": 0.016722918274890947, + "aggregate_load_tv": 0.023427041499330656 + }, + "x_at_s1": { + "tokens": 249, + "ordered_topk_exact_tokens": 146, + "set_exact_tokens": 184, + "mean_set_jaccard": 0.9228341939185313, + "mean_token_weighted_tv": 0.018432313774573994, + "aggregate_load_tv": 0.021419009370816602 + }, + "period_at_s0": { + "tokens": 249, + "ordered_topk_exact_tokens": 157, + "set_exact_tokens": 185, + "mean_set_jaccard": 0.9248422260470452, + "mean_token_weighted_tv": 0.01685841711065975, + "aggregate_load_tv": 0.023427041499330656 + }, + "period_at_s1": { + "tokens": 249, + "ordered_topk_exact_tokens": 141, + "set_exact_tokens": 179, + "mean_set_jaccard": 0.9179575444635685, + "mean_token_weighted_tv": 0.01897781511701374, + "aggregate_load_tv": 0.024765729585006693 + } + } + }, + "layer_11": { + "layer": 11, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "96fa114f4e7bf60f4794e2e31d2a1985b89623e825afae49fe64d1491abef3df", + "route_weight_sha256": "00db3f86da17b554c8edb25d471b409ad2f8c461296f4f75582a0985f29761a8", + "loads": [ + 35, + 3, + 16, + 58, + 23, + 21, + 35, + 15, + 24, + 48, + 23, + 19, + 18, + 41, + 9, + 11, + 22, + 21, + 6, + 44, + 23, + 31, + 24, + 0, + 91, + 25, + 33, + 49, + 2, + 35, + 1, + 2, + 36, + 32, + 6, + 15, + 54, + 23, + 46, + 17, + 32, + 4, + 22, + 7, + 5, + 16, + 50, + 11, + 30, + 26, + 53, + 26, + 30, + 0, + 7, + 23, + 29, + 49, + 10, + 9, + 6, + 5, + 7, + 0 + ], + "weighted_loads": [ + 2.2528451941907406, + 0.09947481751441956, + 1.1737602055072784, + 3.074258366599679, + 1.7786775585263968, + 0.9072416797280312, + 2.1406821832060814, + 1.0098091177642345, + 1.7465348355472088, + 1.9980410244315863, + 1.4851825460791588, + 1.012741956859827, + 0.8517896290868521, + 2.793714702129364, + 0.3910882230848074, + 0.4607472028583288, + 0.793523196130991, + 0.8090851362794638, + 0.2344568334519863, + 2.542537646368146, + 1.4275718070566654, + 2.138714263215661, + 1.253696883097291, + 0.0, + 3.7260307744145393, + 1.5382408387959003, + 1.3854491412639618, + 3.9441720359027386, + 0.10019044578075409, + 1.6179434265941381, + 0.0472257174551487, + 0.09319530054926872, + 1.8640559017658234, + 1.8274563401937485, + 0.44428400695323944, + 0.9893162585794926, + 3.191763900220394, + 1.076895572245121, + 2.7400089986622334, + 0.7039493713527918, + 2.042681612074375, + 0.14472724497318268, + 1.2322548627853394, + 0.26338773407042027, + 0.1865257453173399, + 1.0290594659745693, + 3.288685290142894, + 0.5784409195184708, + 1.5820631310343742, + 1.8550313841551542, + 2.936905659735203, + 2.392505068331957, + 1.567905867472291, + 0.0, + 0.24675040505826473, + 1.270196359604597, + 2.0046111904084682, + 2.2853778917342424, + 0.40186909958720207, + 0.4101582132279873, + 0.2057188842445612, + 0.20442070811986923, + 0.36249481700360775, + 0.0 + ], + "unique_experts": 61, + "load_cv": 0.7562616184305899, + "normalized_load_entropy": 0.9292226966055923, + "max_load_share": 0.06091030789825971 + }, + "full_input": { + "tokens": 274, + "top_k": 6, + "decisions": 1644, + "ordered_route_sha256": "40d59bcc4eb8bdb1eb62141e3286ccfdfa7c8b74f7490808663dfe342053684d", + "route_weight_sha256": "8f35f7192fe1aec204a338574fc3fc894aefe6f19bdbf4eeb4f8bcdd7e1c47c6", + "loads": [ + 35, + 4, + 17, + 58, + 29, + 21, + 36, + 15, + 29, + 49, + 27, + 22, + 18, + 41, + 9, + 17, + 28, + 23, + 18, + 44, + 23, + 31, + 25, + 5, + 91, + 25, + 34, + 50, + 8, + 35, + 7, + 9, + 38, + 32, + 9, + 18, + 54, + 23, + 46, + 17, + 38, + 4, + 22, + 30, + 8, + 16, + 51, + 19, + 30, + 27, + 53, + 26, + 30, + 0, + 13, + 26, + 29, + 49, + 13, + 10, + 6, + 9, + 15, + 0 + ], + "weighted_loads": [ + 2.2528451941907406, + 0.1330956593155861, + 1.233139667659998, + 3.074258366599679, + 2.0406758282333612, + 0.9072416797280312, + 2.177117343991995, + 1.0098091177642345, + 2.063875176012516, + 2.0283972024917603, + 1.7259324179030955, + 1.0665672970935702, + 0.8517896290868521, + 2.793714702129364, + 0.3910882230848074, + 0.6921484265476465, + 1.4119215607643127, + 0.8389614224433899, + 2.3071361258625984, + 2.542537646368146, + 1.4275718070566654, + 2.138714263215661, + 1.25762295210734, + 0.24643833562731743, + 3.7260307744145393, + 1.5382408387959003, + 1.3888026410713792, + 3.956764191389084, + 0.5123228989541531, + 1.6179434265941381, + 0.3393711745738983, + 0.4107646085321903, + 1.9297503251582384, + 1.8274563401937485, + 0.5698445551097393, + 1.2513597644865513, + 3.191763900220394, + 1.076895572245121, + 2.7400089986622334, + 0.7039493713527918, + 2.355054397135973, + 0.14472724497318268, + 1.2322548627853394, + 2.473915444687009, + 0.34466844610869884, + 1.0290594659745693, + 3.3233218882232904, + 1.1746791079640388, + 1.5820631310343742, + 1.9115181472152472, + 2.936905659735203, + 2.392505068331957, + 1.567905867472291, + 0.0, + 0.5652837408706546, + 1.4256232231855392, + 2.0046111904084682, + 2.2853778917342424, + 0.5363798141479492, + 0.4427724815905094, + 0.2057188842445612, + 0.3736105356365442, + 0.8527010921388865, + 0.0 + ], + "unique_experts": 62, + "load_cv": 0.6446862179057833, + "normalized_load_entropy": 0.9496730466990053, + "max_load_share": 0.05535279805352798 + } + }, + "s1_eos": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "a521507e1683650aaa0db2b4a68cb4ed7dd73b171e56e91b29ba4aa3289aa47f", + "route_weight_sha256": "4a34383ea7b8f40ea582695a160315c85a3d781bc3461825f11ab48220b2fb3f", + "loads": [ + 35, + 3, + 16, + 57, + 23, + 19, + 35, + 16, + 24, + 47, + 23, + 18, + 18, + 41, + 8, + 10, + 23, + 19, + 4, + 43, + 23, + 31, + 26, + 0, + 91, + 25, + 34, + 49, + 2, + 35, + 1, + 3, + 35, + 32, + 6, + 16, + 54, + 25, + 45, + 17, + 32, + 5, + 23, + 6, + 5, + 16, + 50, + 11, + 31, + 26, + 54, + 27, + 30, + 0, + 5, + 23, + 29, + 52, + 9, + 10, + 6, + 5, + 7, + 0 + ], + "weighted_loads": [ + 2.257699988782406, + 0.09832267090678215, + 1.1623000092804432, + 3.037466635927558, + 1.7529412545263767, + 0.8251739256083965, + 2.15160646289587, + 1.0461227931082249, + 1.7436468377709389, + 1.952689629048109, + 1.4726960211992264, + 0.9623622074723244, + 0.8431765083223581, + 2.8017196245491505, + 0.35366954654455185, + 0.4323863070458174, + 0.8215485997498035, + 0.7586514633148909, + 0.15931615605950356, + 2.510002266615629, + 1.4277348350733519, + 2.144605953246355, + 1.3186398316174746, + 0.0, + 3.7347977105528116, + 1.525168176740408, + 1.3999222442507744, + 3.9546858184039593, + 0.0976208969950676, + 1.5865186154842377, + 0.04752243682742119, + 0.12655607052147388, + 1.8693886138498783, + 1.823817539960146, + 0.47273969277739525, + 1.0268263164907694, + 3.217590479180217, + 1.13595768250525, + 2.704590577632189, + 0.7012414373457432, + 2.0265145115554333, + 0.18074976652860641, + 1.2771027088165283, + 0.23653476685285568, + 0.1881275586783886, + 1.0356667004525661, + 3.295716192573309, + 0.581852313131094, + 1.6165409870445728, + 1.814943103119731, + 2.9803042728453875, + 2.4436113201081753, + 1.5753189269453287, + 0.0, + 0.17845651507377625, + 1.2506595104932785, + 1.9803167954087257, + 2.413778815418482, + 0.3703378289937973, + 0.443958954885602, + 0.20303220860660076, + 0.2041824795305729, + 0.3799484111368656, + 0.0 + ], + "unique_experts": 61, + "load_cv": 0.7600813487955732, + "normalized_load_entropy": 0.9282969936245448, + "max_load_share": 0.06091030789825971 + }, + "full_input": { + "tokens": 290, + "top_k": 6, + "decisions": 1740, + "ordered_route_sha256": "fcc710e8f4784125a5a94bce8d5ad789bcf821e26315d58256a0aa23b563232d", + "route_weight_sha256": "399acaa5e52c72de4a0bcb594a4b0703490bc8bc134f2bbfbcd13532cc0d73bc", + "loads": [ + 37, + 4, + 17, + 57, + 34, + 22, + 36, + 18, + 34, + 47, + 28, + 21, + 18, + 41, + 8, + 11, + 41, + 21, + 15, + 44, + 24, + 32, + 29, + 4, + 91, + 25, + 38, + 51, + 12, + 35, + 9, + 10, + 36, + 32, + 10, + 22, + 54, + 25, + 45, + 18, + 36, + 5, + 23, + 33, + 7, + 16, + 52, + 24, + 31, + 29, + 54, + 27, + 30, + 5, + 25, + 34, + 35, + 53, + 11, + 14, + 7, + 13, + 18, + 2 + ], + "weighted_loads": [ + 2.4051348865032196, + 0.1308741755783558, + 1.2083924524486065, + 3.037466635927558, + 2.333364460617304, + 0.9333567842841148, + 2.190051842480898, + 1.175278965383768, + 2.3931054398417473, + 1.952689629048109, + 1.7452498758211732, + 1.0155408708378673, + 0.8431765083223581, + 2.8017196245491505, + 0.35366954654455185, + 0.47159446589648724, + 2.465847462415695, + 0.7877053748816252, + 2.2219236120581627, + 2.5493436343967915, + 1.5010899435728788, + 2.2152824513614178, + 1.4314622674137354, + 0.1778888925909996, + 3.7347977105528116, + 1.525168176740408, + 1.517442591721192, + 4.006027597934008, + 0.8098566271364689, + 1.5865186154842377, + 0.45027550868690014, + 0.42885891906917095, + 1.9027220606803894, + 1.823817539960146, + 0.6514337956905365, + 1.5467644687741995, + 3.217590479180217, + 1.13595768250525, + 2.704590577632189, + 0.748716976493597, + 2.2412422597408295, + 0.18074976652860641, + 1.2771027088165283, + 2.7086160369217396, + 0.32102303579449654, + 1.0356667004525661, + 3.3816577456891537, + 1.570916648954153, + 1.6165409870445728, + 2.0347069669514894, + 2.9803042728453875, + 2.4436113201081753, + 1.5753189269453287, + 0.30666321888566017, + 1.3855353416875005, + 1.7770987898111343, + 2.450642202049494, + 2.4564026407897472, + 0.4727236144244671, + 0.6038108710199594, + 0.2408385630697012, + 0.5557186547666788, + 0.9466107413172722, + 0.07493744418025017 + ], + "unique_experts": 64, + "load_cv": 0.6041342570612056, + "normalized_load_entropy": 0.9561002017076355, + "max_load_share": 0.052298850574712646 + } + }, + "s0_bos": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "69e0c05bdff8edff587c9fc969b8818fce054e465e17f1b6e0b92badcac49fad", + "route_weight_sha256": "900c22aeef8e1404a6e0b593099bfda30980d4558ca93e6689cbc391179c13ac", + "loads": [ + 36, + 2, + 16, + 58, + 24, + 20, + 36, + 16, + 24, + 47, + 23, + 20, + 18, + 41, + 8, + 10, + 21, + 19, + 3, + 43, + 23, + 30, + 22, + 1, + 97, + 27, + 33, + 49, + 2, + 40, + 1, + 2, + 34, + 32, + 7, + 15, + 54, + 23, + 48, + 16, + 32, + 5, + 20, + 6, + 5, + 18, + 49, + 11, + 30, + 25, + 53, + 26, + 31, + 0, + 4, + 26, + 27, + 51, + 8, + 11, + 5, + 4, + 6, + 0 + ], + "weighted_loads": [ + 2.269719459116459, + 0.06975460797548294, + 1.1859437339007854, + 3.0733799878507853, + 1.7771127317100763, + 0.8665278814733028, + 2.1762694753706455, + 1.049416672438383, + 1.735268373042345, + 1.9587763212621212, + 1.4702049791812897, + 1.0182677172124386, + 0.8753238692879677, + 2.7963852174580097, + 0.3658900037407875, + 0.4145631454885006, + 0.758572930470109, + 0.7432204000651836, + 0.11612335592508316, + 2.505639472976327, + 1.4288043063133955, + 2.133526086807251, + 1.1410445682704449, + 0.03944734111428261, + 4.06566821038723, + 1.5937885586172342, + 1.4028406832367182, + 3.9656510427594185, + 0.0851973108947277, + 1.8373905010521412, + 0.04678570479154587, + 0.08472827821969986, + 1.804956128820777, + 1.8315606340765953, + 0.5082200095057487, + 0.9866500273346901, + 3.2540982477366924, + 1.1201504617929459, + 2.8141599744558334, + 0.6701033655554056, + 2.0588893964886665, + 0.183998242020607, + 1.159116879105568, + 0.22926690988242626, + 0.18197721987962723, + 1.1077013835310936, + 3.2626120261847973, + 0.5750674977898598, + 1.5869799740612507, + 1.8334509655833244, + 2.9736580960452557, + 2.391500547528267, + 1.5911731272935867, + 0.0, + 0.14158976823091507, + 1.3640189990401268, + 1.9217476285994053, + 2.4016771279275417, + 0.342394994571805, + 0.4872065372765064, + 0.16851329803466797, + 0.1744801551103592, + 0.3704073689877987, + 0.0 + ], + "unique_experts": 62, + "load_cv": 0.7821685390611873, + "normalized_load_entropy": 0.9254244369950102, + "max_load_share": 0.06492637215528782 + }, + "full_input": { + "tokens": 274, + "top_k": 6, + "decisions": 1644, + "ordered_route_sha256": "9bda23ab732c2b18d342d81209bd82d46ea9805b389c44390f14e417584eb34b", + "route_weight_sha256": "e8154b2bbd17c61c76337c5d30d6bfc20fffa7eb333290f814b991c0a965f77c", + "loads": [ + 36, + 4, + 17, + 58, + 30, + 20, + 37, + 16, + 29, + 48, + 26, + 22, + 18, + 41, + 8, + 17, + 27, + 20, + 14, + 43, + 23, + 30, + 22, + 6, + 97, + 27, + 33, + 51, + 7, + 40, + 7, + 9, + 36, + 32, + 10, + 18, + 54, + 23, + 48, + 16, + 39, + 5, + 20, + 30, + 8, + 18, + 49, + 19, + 30, + 26, + 53, + 26, + 31, + 0, + 9, + 28, + 27, + 51, + 11, + 12, + 5, + 11, + 16, + 0 + ], + "weighted_loads": [ + 2.269719459116459, + 0.13974199071526527, + 1.245323196053505, + 3.0733799878507853, + 2.0377321261912584, + 0.8665278814733028, + 2.2132023237645626, + 1.049416672438383, + 2.055999867618084, + 1.9891324993222952, + 1.6988867232576013, + 1.0600316161289811, + 0.8753238692879677, + 2.7963852174580097, + 0.3658900037407875, + 0.6774618662893772, + 1.40780277736485, + 0.7580671282485127, + 1.2926295883953571, + 2.505639472976327, + 1.4288043063133955, + 2.133526086807251, + 1.1410445682704449, + 0.28588567674160004, + 4.06566821038723, + 1.5937885586172342, + 1.4028406832367182, + 4.024051930755377, + 0.46578818932175636, + 1.8373905010521412, + 0.3389311619102955, + 0.40229758620262146, + 1.870650552213192, + 1.8315606340765953, + 0.633572168648243, + 1.2634217441082, + 3.2540982477366924, + 1.1201504617929459, + 2.8141599744558334, + 0.6701033655554056, + 2.4608551636338234, + 0.183998242020607, + 1.159116879105568, + 2.6349867451936007, + 0.3401199206709862, + 1.1077013835310936, + 3.2626120261847973, + 1.1652816645801067, + 1.5869799740612507, + 1.8899377286434174, + 2.9736580960452557, + 2.391500547528267, + 1.5911731272935867, + 0.0, + 0.41879081819206476, + 1.4586918205022812, + 1.9217476285994053, + 2.4016771279275417, + 0.47690570913255215, + 0.5222558565437794, + 0.16851329803466797, + 0.47677204571664333, + 0.9607779644429684, + 0.0 + ], + "unique_experts": 62, + "load_cv": 0.665115320751399, + "normalized_load_entropy": 0.9477235231088063, + "max_load_share": 0.05900243309002433 + } + }, + "s1_bos": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "aa485f9920e42baa0318309a0096cd5d2643a984bef3ddd2d7d1d45d45aa2f2b", + "route_weight_sha256": "7e01077645185c6c3a337de1b0e8fde2356476183e1f61e26dbff3b5a417a5f8", + "loads": [ + 35, + 3, + 16, + 53, + 23, + 21, + 36, + 16, + 24, + 45, + 23, + 20, + 18, + 41, + 7, + 10, + 20, + 17, + 5, + 42, + 21, + 30, + 26, + 1, + 97, + 27, + 35, + 47, + 2, + 39, + 1, + 3, + 34, + 32, + 6, + 16, + 55, + 24, + 47, + 16, + 32, + 5, + 22, + 7, + 4, + 17, + 52, + 11, + 31, + 23, + 53, + 27, + 29, + 0, + 6, + 25, + 26, + 52, + 10, + 12, + 5, + 6, + 5, + 0 + ], + "weighted_loads": [ + 2.2525287121534348, + 0.0996564943343401, + 1.1766294427216053, + 2.881993606686592, + 1.7304354570806026, + 0.8973784036934376, + 2.1903670579195023, + 1.0505862142890692, + 1.7525313645601273, + 1.8847526665776968, + 1.472326060757041, + 1.0272729713469744, + 0.8694721106439829, + 2.799101486802101, + 0.32288116961717606, + 0.4174691755324602, + 0.7399629093706608, + 0.688939705491066, + 0.16868552565574646, + 2.4688548035919666, + 1.3605910055339336, + 2.144699353724718, + 1.2779774740338326, + 0.030023243278265, + 4.076858939602971, + 1.595014225691557, + 1.4831898380070925, + 3.8919631838798523, + 0.08405881002545357, + 1.7828443367034197, + 0.04616757854819298, + 0.12206415459513664, + 1.8312289472669363, + 1.8392810747027397, + 0.5041456706821918, + 1.0521434005349874, + 3.285713778808713, + 1.1462636422365904, + 2.7744925003498793, + 0.6683300416916609, + 2.0533477067947388, + 0.18955787271261215, + 1.2237774953246117, + 0.2692662049084902, + 0.149497888982296, + 1.1029279511421919, + 3.3616091813892126, + 0.5892919823527336, + 1.6187439523637295, + 1.7266458421945572, + 2.9773920495063066, + 2.440123349428177, + 1.5328713543713093, + 0.0, + 0.2133282758295536, + 1.3286616317927837, + 1.8538706041872501, + 2.457810191437602, + 0.4000811018049717, + 0.5284963026642799, + 0.16969003900885582, + 0.24016689136624336, + 0.33433846198022366, + 0.0 + ], + "unique_experts": 62, + "load_cv": 0.7708321300315465, + "normalized_load_entropy": 0.9282005514484548, + "max_load_share": 0.06492637215528782 + }, + "full_input": { + "tokens": 290, + "top_k": 6, + "decisions": 1740, + "ordered_route_sha256": "4c08845715c6c56180fb24d389d770050d3f43db2e0cb3d045fcedd7a014fb58", + "route_weight_sha256": "03da4bcf7c235884f0ce1ba1f780399d01ed98a2d92e6c56213ab431583ae321", + "loads": [ + 37, + 4, + 17, + 53, + 34, + 24, + 36, + 18, + 34, + 46, + 27, + 22, + 18, + 41, + 7, + 12, + 38, + 18, + 15, + 43, + 22, + 31, + 28, + 5, + 97, + 27, + 38, + 49, + 11, + 39, + 9, + 10, + 35, + 32, + 11, + 22, + 55, + 24, + 47, + 17, + 38, + 5, + 22, + 35, + 6, + 17, + 53, + 25, + 31, + 26, + 53, + 27, + 29, + 5, + 25, + 35, + 32, + 53, + 12, + 16, + 6, + 16, + 18, + 2 + ], + "weighted_loads": [ + 2.3999636098742485, + 0.13220799900591373, + 1.2227218858897686, + 2.881993606686592, + 2.313019774854183, + 1.0055612623691559, + 2.1903670579195023, + 1.1797423865646124, + 2.3988805189728737, + 1.91888558678329, + 1.7520726872608066, + 1.069054708816111, + 0.8694721106439829, + 2.799101486802101, + 0.32288116961717606, + 0.48843406699597836, + 2.4613701179623604, + 0.7037864336743951, + 1.3330805487930775, + 2.508196171373129, + 1.4339461140334606, + 2.215375851839781, + 1.3870110549032688, + 0.2079121358692646, + 4.076858939602971, + 1.595014225691557, + 1.597538286820054, + 3.9433049634099007, + 0.7563730664551258, + 1.7828443367034197, + 0.44892065040767193, + 0.4243670031428337, + 1.8645623940974474, + 1.8392810747027397, + 0.7153715826570988, + 1.5764384884387255, + 3.285713778808713, + 1.1462636422365904, + 2.7744925003498793, + 0.7158055808395147, + 2.3991642892360687, + 0.18955787271261215, + 1.2237774953246117, + 3.058209942653775, + 0.28239336609840393, + 1.1029279511421919, + 3.4081612434238195, + 1.6137707829475403, + 1.6187439523637295, + 1.9464097060263157, + 2.9773920495063066, + 2.440123349428177, + 1.5328713543713093, + 0.30666321888566017, + 1.3981392616406083, + 1.8019497878849506, + 2.324196010828018, + 2.5004340168088675, + 0.5024668872356415, + 0.6870583966374397, + 0.20749639347195625, + 0.6772786732763052, + 0.9857593793421984, + 0.07493744418025017 + ], + "unique_experts": 64, + "load_cv": 0.6125088808165466, + "normalized_load_entropy": 0.9557421932266452, + "max_load_share": 0.05574712643678161 + } + }, + "s0_x": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "499bb589a7684222bb661c5565971aa11fffecc235d0643ff10c4d7011aa41b9", + "route_weight_sha256": "353c9e0815bb7497215acdb9c1cc74f6c9f072a8a18c9bac9097f78bac0ad3ed", + "loads": [ + 36, + 3, + 16, + 57, + 24, + 21, + 36, + 15, + 24, + 46, + 23, + 20, + 20, + 41, + 6, + 9, + 22, + 18, + 5, + 42, + 22, + 30, + 23, + 1, + 97, + 26, + 33, + 49, + 3, + 39, + 1, + 2, + 37, + 32, + 7, + 15, + 55, + 24, + 47, + 17, + 33, + 4, + 21, + 6, + 3, + 18, + 50, + 11, + 29, + 23, + 54, + 26, + 29, + 0, + 8, + 23, + 28, + 51, + 8, + 10, + 5, + 4, + 6, + 0 + ], + "weighted_loads": [ + 2.2751773111522198, + 0.10126159153878689, + 1.1890048570930958, + 3.0719191264361143, + 1.8079286962747574, + 0.9192816652357578, + 2.1957232542335987, + 1.0119389668107033, + 1.7624069228768349, + 1.9451343528926373, + 1.4433221817016602, + 1.0199710112065077, + 0.9540942069143057, + 2.7941289618611336, + 0.2909214496612549, + 0.40045104920864105, + 0.780298613011837, + 0.7185791060328484, + 0.19818491488695145, + 2.4854623191058636, + 1.3657433278858662, + 2.115267612040043, + 1.1976042315363884, + 0.03826858475804329, + 4.055676093325019, + 1.5651942864060402, + 1.3601012211292982, + 3.9664605297148228, + 0.11249788664281368, + 1.7744060289114714, + 0.047577451914548874, + 0.09407578781247139, + 1.9169507250189781, + 1.8811149448156357, + 0.49216361343860626, + 0.984064519405365, + 3.316872512921691, + 1.1522284019738436, + 2.7724601961672306, + 0.7171070538461208, + 2.1103427447378635, + 0.14904066175222397, + 1.1912203393876553, + 0.22375082597136497, + 0.1217312440276146, + 1.1119938418269157, + 3.2743293177336454, + 0.5785020031034946, + 1.5552410334348679, + 1.7310936376452446, + 3.020392093807459, + 2.392460122704506, + 1.5473288297653198, + 0.0, + 0.3169000931084156, + 1.2664019633084536, + 1.948970951139927, + 2.3661295641213655, + 0.3408023063093424, + 0.44060024060308933, + 0.17043554596602917, + 0.1654597669839859, + 0.36668008007109165, + 0.0 + ], + "unique_experts": 62, + "load_cv": 0.780333445542316, + "normalized_load_entropy": 0.9262273729359639, + "max_load_share": 0.06492637215528782 + }, + "full_input": { + "tokens": 274, + "top_k": 6, + "decisions": 1644, + "ordered_route_sha256": "41a157de77649a7c59c1787a6b02810e2cb7549584f150d4865b710230d286b0", + "route_weight_sha256": "9a5b5e2a7b9bfeb43ba492aa1e4bbe93a6ec9e939995f70561c76d17867eace2", + "loads": [ + 36, + 4, + 17, + 57, + 30, + 21, + 37, + 15, + 29, + 47, + 26, + 22, + 20, + 41, + 6, + 15, + 26, + 20, + 17, + 42, + 22, + 30, + 23, + 6, + 97, + 26, + 33, + 50, + 9, + 39, + 7, + 10, + 39, + 32, + 11, + 18, + 55, + 24, + 47, + 17, + 38, + 4, + 21, + 29, + 6, + 18, + 51, + 19, + 29, + 26, + 54, + 26, + 29, + 1, + 13, + 26, + 28, + 51, + 12, + 11, + 5, + 9, + 15, + 0 + ], + "weighted_loads": [ + 2.2751773111522198, + 0.13488243333995342, + 1.2483843192458153, + 3.0719191264361143, + 2.073914460837841, + 0.9192816652357578, + 2.231554288417101, + 1.0119389668107033, + 2.089659933000803, + 1.9754905309528112, + 1.6560217449441552, + 1.0617349101230502, + 0.9540942069143057, + 2.7941289618611336, + 0.2909214496612549, + 0.6318522728979588, + 1.2856542244553566, + 0.7684086197987199, + 1.4674125872552395, + 2.4854623191058636, + 1.3657433278858662, + 2.115267612040043, + 1.1976042315363884, + 0.2847069203853607, + 4.055676093325019, + 1.5651942864060402, + 1.3601012211292982, + 3.979052685201168, + 0.5329894106835127, + 1.7744060289114714, + 0.3397229090332985, + 0.4602104648947716, + 1.9826451484113932, + 1.8811149448156357, + 0.698916632682085, + 1.2466988265514374, + 3.316872512921691, + 1.1522284019738436, + 2.7724601961672306, + 0.7171070538461208, + 2.387587197124958, + 0.14904066175222397, + 1.1912203393876553, + 2.3146496824920177, + 0.27987394481897354, + 1.1119938418269157, + 3.3155986983329058, + 1.174971841275692, + 1.5552410334348679, + 1.8780683800578117, + 3.020392093807459, + 2.392460122704506, + 1.5473288297653198, + 0.05360746011137962, + 0.5992207983508706, + 1.4140409734100103, + 1.948970951139927, + 2.3661295641213655, + 0.5353043172508478, + 0.47469489090144634, + 0.17043554596602917, + 0.4024572391062975, + 0.8738533686846495, + 0.0 + ], + "unique_experts": 63, + "load_cv": 0.6625827279098553, + "normalized_load_entropy": 0.9484500117655402, + "max_load_share": 0.05900243309002433 + } + }, + "s1_x": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "010d7f05818d2b5b524f805524c1373d19ca746207431786f22e82d14a7657f7", + "route_weight_sha256": "fa33784731979c1909639398f9f576f6e70726b86ba2d739a25ab4f0de4610ce", + "loads": [ + 34, + 3, + 16, + 53, + 24, + 21, + 36, + 14, + 24, + 46, + 22, + 20, + 18, + 41, + 6, + 9, + 18, + 18, + 5, + 42, + 22, + 31, + 23, + 0, + 96, + 26, + 35, + 49, + 2, + 40, + 2, + 3, + 35, + 32, + 6, + 15, + 56, + 26, + 49, + 17, + 33, + 5, + 22, + 7, + 5, + 18, + 50, + 11, + 29, + 24, + 54, + 27, + 28, + 0, + 6, + 26, + 26, + 51, + 9, + 13, + 5, + 6, + 4, + 0 + ], + "weighted_loads": [ + 2.220590304583311, + 0.10414065234363079, + 1.162371825426817, + 2.884880283847451, + 1.8002429585903883, + 0.9042928423732519, + 2.2036027535796165, + 0.977060467004776, + 1.7764712050557137, + 1.9118677601218224, + 1.3957514315843582, + 1.0312254689633846, + 0.8660075217485428, + 2.8214730955660343, + 0.2810332253575325, + 0.3974605519324541, + 0.6261802148073912, + 0.7186975460499525, + 0.19282599166035652, + 2.466349944472313, + 1.3673705160617828, + 2.160350151360035, + 1.1838245168328285, + 0.0, + 4.119416583329439, + 1.5621086098253727, + 1.4813517332077026, + 3.977240078151226, + 0.0778490025550127, + 1.7885394766926765, + 0.11611025780439377, + 0.1268569752573967, + 1.9004596825689077, + 1.8625227026641369, + 0.4890415295958519, + 1.0328152924776077, + 3.345210900530219, + 1.224273582920432, + 2.823819702491164, + 0.7067150697112083, + 2.0890810787677765, + 0.1905856989324093, + 1.2173036858439445, + 0.2631541732698679, + 0.18055653385818005, + 1.1455047465860844, + 3.294268375262618, + 0.6078306101262569, + 1.5423113983124495, + 1.7378530967980623, + 3.0368193946778774, + 2.442787941545248, + 1.4908554702997208, + 0.0, + 0.22254794277250767, + 1.326187178492546, + 1.8324549123644829, + 2.356099532917142, + 0.36670864932239056, + 0.5639667026698589, + 0.16490637883543968, + 0.23515642620623112, + 0.30565763264894485, + 0.0 + ], + "unique_experts": 61, + "load_cv": 0.7740986282610695, + "normalized_load_entropy": 0.9271635522693462, + "max_load_share": 0.0642570281124498 + }, + "full_input": { + "tokens": 290, + "top_k": 6, + "decisions": 1740, + "ordered_route_sha256": "e83b1248160f962dccdbd181496044b3bae0a2feaac3ed4aab6f1fbbafc49e82", + "route_weight_sha256": "2e134a30e2cd39bd64b66dcc7dde98639658c62326e719621c28b6d6cd40f5ec", + "loads": [ + 36, + 4, + 17, + 53, + 35, + 24, + 36, + 16, + 34, + 46, + 26, + 22, + 18, + 41, + 6, + 10, + 36, + 19, + 16, + 43, + 23, + 32, + 25, + 4, + 96, + 26, + 38, + 52, + 12, + 40, + 10, + 11, + 36, + 32, + 11, + 21, + 56, + 26, + 49, + 18, + 37, + 5, + 22, + 34, + 7, + 18, + 52, + 24, + 29, + 28, + 54, + 27, + 28, + 6, + 26, + 36, + 32, + 52, + 12, + 17, + 6, + 14, + 16, + 2 + ], + "weighted_loads": [ + 2.368025202304125, + 0.13669215701520443, + 1.2084642685949802, + 2.884880283847451, + 2.3879940789192915, + 1.0124757010489702, + 2.2036027535796165, + 1.1062166392803192, + 2.430724658071995, + 1.9118677601218224, + 1.6064471201971173, + 1.0730072064325213, + 0.8660075217485428, + 2.8214730955660343, + 0.2810332253575325, + 0.43666871078312397, + 2.2699548322707415, + 0.7335442742332816, + 1.4337274879217148, + 2.505691312253475, + 1.4407256245613098, + 2.2310266494750977, + 1.2928580977022648, + 0.1778888925909996, + 4.119416583329439, + 1.5621086098253727, + 1.5957001820206642, + 4.071451932191849, + 0.8032834101468325, + 1.7885394766926765, + 0.5188633296638727, + 0.47928325831890106, + 1.9337931293994188, + 1.8625227026641369, + 0.7340143546462059, + 1.541234627366066, + 3.345210900530219, + 1.224273582920432, + 2.823819702491164, + 0.7541906088590622, + 2.284223359078169, + 0.1905856989324093, + 1.2173036858439445, + 2.6049781423062086, + 0.313452010974288, + 1.1455047465860844, + 3.383684592321515, + 1.5732241906225681, + 1.5423113983124495, + 2.006804609671235, + 3.0368193946778774, + 2.442787941545248, + 1.4908554702997208, + 0.35781652852892876, + 1.4153807228431106, + 1.8201280869543552, + 2.302780319005251, + 2.3987233582884073, + 0.5166478287428617, + 0.7214243821799755, + 0.20271273329854012, + 0.5919773355126381, + 0.9244668856263161, + 0.07493744418025017 + ], + "unique_experts": 64, + "load_cv": 0.6136122683373776, + "normalized_load_entropy": 0.9555618031270392, + "max_load_share": 0.05517241379310345 + } + }, + "s0_period": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "8db8442d6f85b93f3503506ae18a2a1549d27473a136dd96bf9de0f2075470ee", + "route_weight_sha256": "c8dff7b3de9c7077696d44b85a43b7619f4b7e28ea503e3aac579ff60adf2215", + "loads": [ + 36, + 3, + 16, + 57, + 24, + 21, + 36, + 15, + 24, + 46, + 24, + 18, + 19, + 41, + 8, + 10, + 21, + 17, + 7, + 44, + 21, + 30, + 23, + 1, + 96, + 26, + 35, + 49, + 2, + 38, + 1, + 2, + 37, + 32, + 7, + 15, + 54, + 24, + 48, + 17, + 31, + 4, + 21, + 7, + 3, + 18, + 50, + 11, + 30, + 25, + 53, + 26, + 30, + 0, + 5, + 23, + 28, + 52, + 8, + 9, + 5, + 4, + 6, + 0 + ], + "weighted_loads": [ + 2.2804068345576525, + 0.10163926519453526, + 1.180038571357727, + 3.0691884886473417, + 1.8209085203707218, + 0.9187421947717667, + 2.2065881304442883, + 1.012378055602312, + 1.7523853331804276, + 1.9325162544846535, + 1.4951114878058434, + 0.9664761889725924, + 0.9152599908411503, + 2.8275533132255077, + 0.36896887235343456, + 0.43053516931831837, + 0.7518062274903059, + 0.693793160840869, + 0.27362515591084957, + 2.5615150909870863, + 1.3454471826553345, + 2.137040466070175, + 1.2070340439677238, + 0.038751959800720215, + 3.9912807270884514, + 1.5736659057438374, + 1.4234806504100561, + 3.9616239741444588, + 0.08689656108617783, + 1.7328170277178288, + 0.048308853060007095, + 0.10098804533481598, + 1.9292938113212585, + 1.8890098966658115, + 0.5125430524349213, + 0.9853954762220383, + 3.3001956045627594, + 1.148765031248331, + 2.8022120147943497, + 0.7226820308715105, + 2.0272494293749332, + 0.14909697324037552, + 1.184433527290821, + 0.25752074643969536, + 0.12299098074436188, + 1.1053391676396132, + 3.317193455994129, + 0.5742801912128925, + 1.5912005677819252, + 1.8029362875968218, + 3.0167526565492153, + 2.412491463124752, + 1.5823157001286745, + 0.0, + 0.20598632097244263, + 1.2597513869404793, + 1.9581826962530613, + 2.4089489858597517, + 0.3417285066097975, + 0.41673069074749947, + 0.17048483714461327, + 0.16951628774404526, + 0.3685942944139242, + 0.0 + ], + "unique_experts": 62, + "load_cv": 0.7791935171236587, + "normalized_load_entropy": 0.9261461390105274, + "max_load_share": 0.0642570281124498 + }, + "full_input": { + "tokens": 274, + "top_k": 6, + "decisions": 1644, + "ordered_route_sha256": "ff93c2640e9fb8d3e6d57c4bb4967789ebd9e1c7645f6ffc1c9bd9afdde6223a", + "route_weight_sha256": "5139a12718f3913903320d400f67ac15556d4f7edd0faec1eb7dfe015852af85", + "loads": [ + 36, + 4, + 17, + 57, + 31, + 21, + 37, + 15, + 29, + 47, + 27, + 20, + 19, + 41, + 8, + 17, + 26, + 18, + 19, + 44, + 21, + 30, + 23, + 6, + 96, + 26, + 35, + 50, + 9, + 38, + 7, + 10, + 39, + 32, + 10, + 19, + 54, + 24, + 48, + 17, + 36, + 4, + 21, + 31, + 6, + 18, + 51, + 19, + 30, + 27, + 53, + 26, + 30, + 0, + 10, + 27, + 28, + 52, + 11, + 10, + 5, + 9, + 13, + 0 + ], + "weighted_loads": [ + 2.2804068345576525, + 0.1352601069957018, + 1.2394180335104465, + 3.0691884886473417, + 2.1685517467558384, + 0.9187421947717667, + 2.241126850247383, + 1.012378055602312, + 2.0710816718637943, + 1.9628724325448275, + 1.7361933821812272, + 1.0082400878891349, + 0.9152599908411503, + 2.8275533132255077, + 0.36896887235343456, + 0.7008229661732912, + 1.3221450094133615, + 0.708639889024198, + 1.491773372516036, + 2.5615150909870863, + 1.3454471826553345, + 2.137040466070175, + 1.2070340439677238, + 0.28519029542803764, + 3.9912807270884514, + 1.5736659057438374, + 1.4234806504100561, + 3.974216129630804, + 0.5442233867943287, + 1.7328170277178288, + 0.3404543101787567, + 0.4587542973458767, + 1.9949882347136736, + 1.8890098966658115, + 0.6487154699862003, + 1.3979789167642593, + 3.3001956045627594, + 1.148765031248331, + 2.8022120147943497, + 0.7226820308715105, + 2.3041155487298965, + 0.14909697324037552, + 1.184433527290821, + 2.4561552181839943, + 0.2811336815357208, + 1.1053391676396132, + 3.357030015438795, + 1.1609045751392841, + 1.5912005677819252, + 1.9097718764096498, + 3.0167526565492153, + 2.412491463124752, + 1.5823157001286745, + 0.0, + 0.49643100891262293, + 1.4446425586938858, + 1.9581826962530613, + 2.4089489858597517, + 0.4762392211705446, + 0.44782621785998344, + 0.17048483714461327, + 0.4068110231310129, + 0.8124023880809546, + 0.0 + ], + "unique_experts": 62, + "load_cv": 0.6643316060030057, + "normalized_load_entropy": 0.9474043011865554, + "max_load_share": 0.058394160583941604 + } + }, + "s1_period": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "3fb7bf3aa9c724661fcdb2c8476d6022dc297b49d734df4b7752b8676a1c73a3", + "route_weight_sha256": "a669d4c6b922170be807ea13ed542e7eb1e8a9656332f53b38a2f4b505387f06", + "loads": [ + 34, + 3, + 16, + 53, + 23, + 21, + 36, + 16, + 24, + 44, + 23, + 18, + 17, + 41, + 7, + 11, + 16, + 20, + 6, + 42, + 21, + 32, + 25, + 0, + 97, + 26, + 37, + 48, + 3, + 38, + 2, + 3, + 34, + 32, + 6, + 16, + 56, + 24, + 48, + 17, + 33, + 5, + 21, + 6, + 5, + 18, + 50, + 11, + 30, + 24, + 54, + 27, + 28, + 0, + 4, + 26, + 26, + 50, + 9, + 14, + 7, + 5, + 5, + 0 + ], + "weighted_loads": [ + 2.229248099029064, + 0.10270508378744125, + 1.1551909819245338, + 2.88529322296381, + 1.7849938943982124, + 0.8998176790773869, + 2.233151089400053, + 1.0447114519774914, + 1.770200178027153, + 1.8555229883641005, + 1.4447367936372757, + 0.9655228685587645, + 0.8344731517136097, + 2.845218248665333, + 0.3146866224706173, + 0.45875783264636993, + 0.5621169321238995, + 0.785489758476615, + 0.218790827319026, + 2.4725040309131145, + 1.3423755522817373, + 2.1997719313949347, + 1.2511623948812485, + 0.0, + 4.09874189645052, + 1.5664877109229565, + 1.5972534734755754, + 3.9454697631299496, + 0.10595660656690598, + 1.7385617084801197, + 0.10169299691915512, + 0.13127366080880165, + 1.8809802662581205, + 1.8611075542867184, + 0.490789245814085, + 1.06347244232893, + 3.368460798636079, + 1.1528986506164074, + 2.8126019537448883, + 0.7010644488036633, + 2.0614703074097633, + 0.18890170007944107, + 1.1795620396733284, + 0.2260192520916462, + 0.18198922090232372, + 1.1440183240920305, + 3.3152339048683643, + 0.609363567084074, + 1.5831767246127129, + 1.756737468764186, + 3.066043809056282, + 2.441379677504301, + 1.4950907826423645, + 0.0, + 0.13722574710845947, + 1.3531234506517649, + 1.8483535908162594, + 2.339733285829425, + 0.37044832669198513, + 0.599992323666811, + 0.22259028628468513, + 0.2049400731921196, + 0.29987350665032864, + 0.0 + ], + "unique_experts": 61, + "load_cv": 0.7692682298042917, + "normalized_load_entropy": 0.9284903596077746, + "max_load_share": 0.06492637215528782 + }, + "full_input": { + "tokens": 290, + "top_k": 6, + "decisions": 1740, + "ordered_route_sha256": "7314e5a97c742f29b0e149c8a303eb9833dd4f47eebdda451c8d8b6a4e8cbdb5", + "route_weight_sha256": "78828fa2febf58a389c6f42ceb3eec0692e4186e104d69d77b0928f3a7df74f1", + "loads": [ + 36, + 4, + 17, + 53, + 35, + 25, + 37, + 18, + 34, + 44, + 27, + 20, + 17, + 41, + 8, + 14, + 34, + 21, + 16, + 43, + 22, + 33, + 27, + 4, + 97, + 26, + 40, + 50, + 14, + 38, + 10, + 10, + 35, + 32, + 11, + 23, + 56, + 24, + 48, + 18, + 37, + 5, + 21, + 33, + 7, + 18, + 52, + 24, + 30, + 28, + 54, + 27, + 28, + 5, + 23, + 36, + 32, + 51, + 11, + 18, + 8, + 13, + 15, + 2 + ], + "weighted_loads": [ + 2.376682996749878, + 0.1352565884590149, + 1.2012834250926971, + 2.88529322296381, + 2.43763255700469, + 1.0488395430147648, + 2.26929247379303, + 1.1738676242530346, + 2.4144264608621597, + 1.8555229883641005, + 1.6846492933109403, + 1.0073046060279012, + 0.8344731517136097, + 2.845218248665333, + 0.35385633260011673, + 0.5650767534971237, + 2.2298270240426064, + 0.8003364866599441, + 1.383185850456357, + 2.511845398694277, + 1.4157306607812643, + 2.2704484295099974, + 1.3601959757506847, + 0.1778888925909996, + 4.09874189645052, + 1.5664877109229565, + 1.711601922288537, + 3.996811542659998, + 0.8923231847584248, + 1.7385617084801197, + 0.5044460687786341, + 0.4335765093564987, + 1.9143137130886316, + 1.8611075542867184, + 0.7240477539598942, + 1.6600594893097878, + 3.368460798636079, + 1.1528986506164074, + 2.8126019537448883, + 0.7485399879515171, + 2.2461792901158333, + 0.18890170007944107, + 1.1795620396733284, + 2.61007472127676, + 0.31488469801843166, + 1.1440183240920305, + 3.4020626172423363, + 1.5835597440600395, + 1.5831767246127129, + 2.0163003634661436, + 3.066043809056282, + 2.441379677504301, + 1.4950907826423645, + 0.30666321888566017, + 1.3034137757495046, + 1.847034452483058, + 2.3186789974570274, + 2.3823571112006903, + 0.4728341121226549, + 0.757252998650074, + 0.26039664074778557, + 0.5618561450392008, + 0.8161758985370398, + 0.07493744418025017 + ], + "unique_experts": 64, + "load_cv": 0.6074144429106597, + "normalized_load_entropy": 0.9567988617684788, + "max_load_share": 0.05574712643678161 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 249, + "ordered_topk_exact_tokens": 192, + "set_exact_tokens": 217, + "mean_set_jaccard": 0.9632816982214573, + "mean_token_weighted_tv": 0.0074386295327639965, + "aggregate_load_tv": 0.012048192771084336 + }, + "system_bos": { + "tokens": 249, + "ordered_topk_exact_tokens": 165, + "set_exact_tokens": 199, + "mean_set_jaccard": 0.9417670682730924, + "mean_token_weighted_tv": 0.011132585030632565, + "aggregate_load_tv": 0.020080321285140562 + }, + "system_x": { + "tokens": 249, + "ordered_topk_exact_tokens": 164, + "set_exact_tokens": 201, + "mean_set_jaccard": 0.9414802065404476, + "mean_token_weighted_tv": 0.012918239496797922, + "aggregate_load_tv": 0.018072289156626512 + }, + "system_period": { + "tokens": 249, + "ordered_topk_exact_tokens": 151, + "set_exact_tokens": 187, + "mean_set_jaccard": 0.9245553643144004, + "mean_token_weighted_tv": 0.014881070209554878, + "aggregate_load_tv": 0.024765729585006703 + }, + "bos_at_s0": { + "tokens": 249, + "ordered_topk_exact_tokens": 159, + "set_exact_tokens": 187, + "mean_set_jaccard": 0.9262765347102695, + "mean_token_weighted_tv": 0.0145994974861303, + "aggregate_load_tv": 0.022088353413654616 + }, + "bos_at_s1": { + "tokens": 249, + "ordered_topk_exact_tokens": 137, + "set_exact_tokens": 173, + "mean_set_jaccard": 0.9110728628800917, + "mean_token_weighted_tv": 0.01682455992572997, + "aggregate_load_tv": 0.022757697456492646 + }, + "x_at_s0": { + "tokens": 249, + "ordered_topk_exact_tokens": 169, + "set_exact_tokens": 195, + "mean_set_jaccard": 0.9371772805507744, + "mean_token_weighted_tv": 0.013856364608588946, + "aggregate_load_tv": 0.021419009370816595 + }, + "x_at_s1": { + "tokens": 249, + "ordered_topk_exact_tokens": 133, + "set_exact_tokens": 174, + "mean_set_jaccard": 0.9113597246127366, + "mean_token_weighted_tv": 0.017831533141134972, + "aggregate_load_tv": 0.02610441767068274 + }, + "period_at_s0": { + "tokens": 249, + "ordered_topk_exact_tokens": 172, + "set_exact_tokens": 201, + "mean_set_jaccard": 0.9449225473321858, + "mean_token_weighted_tv": 0.012825705623441193, + "aggregate_load_tv": 0.01874163319946451 + }, + "period_at_s1": { + "tokens": 249, + "ordered_topk_exact_tokens": 132, + "set_exact_tokens": 171, + "mean_set_jaccard": 0.9079173838209982, + "mean_token_weighted_tv": 0.01802631035955795, + "aggregate_load_tv": 0.026104417670682743 + } + } + }, + "layer_12": { + "layer": 12, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "855e6b058b21e68c8b74cccb8e064f3f24d14e27284ae4188dc425c24d436b59", + "route_weight_sha256": "749bfaff049073a7842d668823ecbf3511b5c07ca5774c39765b094932e35bc9", + "loads": [ + 12, + 35, + 20, + 11, + 26, + 27, + 27, + 25, + 8, + 21, + 21, + 51, + 12, + 49, + 108, + 3, + 8, + 25, + 23, + 25, + 28, + 29, + 28, + 10, + 67, + 36, + 6, + 1, + 7, + 8, + 2, + 30, + 11, + 23, + 21, + 7, + 79, + 18, + 10, + 49, + 46, + 0, + 13, + 24, + 2, + 13, + 1, + 38, + 19, + 40, + 23, + 33, + 42, + 30, + 2, + 19, + 20, + 20, + 0, + 16, + 32, + 8, + 15, + 31 + ], + "weighted_loads": [ + 0.7066476307809353, + 2.326732438057661, + 1.3512472957372665, + 0.5107545275241137, + 1.0798209104686975, + 1.7707137688994408, + 1.2039684876799583, + 1.6854201145470142, + 0.3572586700320244, + 1.1951094269752502, + 1.231407254934311, + 3.012200180441141, + 0.8046484477818012, + 2.6078540682792664, + 5.201604096218944, + 0.10661055520176888, + 0.368802921846509, + 1.6632808223366737, + 1.3349515087902546, + 1.0069535411894321, + 1.919414035975933, + 1.870946992188692, + 1.6270161904394627, + 0.4225195609033108, + 3.4658993538469076, + 2.0323776118457317, + 0.218505147844553, + 0.05344783514738083, + 0.565846448764205, + 0.32036907598376274, + 0.05874393507838249, + 2.500418648123741, + 0.4424390681087971, + 2.154275421053171, + 1.2381789833307266, + 0.28926172852516174, + 4.5589607283473015, + 1.1487419605255127, + 0.5147667825222015, + 3.313586000353098, + 2.38559352979064, + 0.0, + 0.5849156081676483, + 1.5017914604395628, + 0.1067240908741951, + 0.8351310305297375, + 0.032683227211236954, + 1.7797937355935574, + 0.8614369593560696, + 2.272406179457903, + 1.5743127465248108, + 2.0190444830805063, + 2.584417784586549, + 1.8877517767250538, + 0.07289278320968151, + 0.9806613735854626, + 0.9022661559283733, + 1.4543370548635721, + 0.0, + 0.6234295796602964, + 1.5026709996163845, + 0.5232866555452347, + 0.8269470948725939, + 1.6419431623071432 + ], + "unique_experts": 62, + "load_cv": 0.8182867118332854, + "normalized_load_entropy": 0.9266761362591365, + "max_load_share": 0.07228915662650602 + }, + "full_input": { + "tokens": 274, + "top_k": 6, + "decisions": 1644, + "ordered_route_sha256": "385511632a4fbfb817a794c9bb8b5815c121c5a3e893e1cd18054d763c13807f", + "route_weight_sha256": "d612e7a1f39cb351c6869612ca2fa77216059262d5dd2651e119da3c483ce14c", + "loads": [ + 12, + 35, + 20, + 16, + 30, + 28, + 27, + 28, + 15, + 21, + 21, + 51, + 17, + 49, + 108, + 3, + 11, + 25, + 23, + 25, + 29, + 29, + 29, + 16, + 67, + 37, + 7, + 7, + 22, + 18, + 4, + 35, + 12, + 25, + 21, + 14, + 79, + 22, + 24, + 49, + 46, + 6, + 20, + 24, + 4, + 14, + 2, + 43, + 23, + 40, + 24, + 33, + 42, + 30, + 2, + 19, + 23, + 20, + 0, + 19, + 32, + 12, + 21, + 34 + ], + "weighted_loads": [ + 0.7066476307809353, + 2.326732438057661, + 1.3512472957372665, + 0.6375654248986393, + 2.697714516893029, + 1.7747259987518191, + 1.2039684876799583, + 1.8838086500763893, + 0.779948927462101, + 1.1951094269752502, + 1.231407254934311, + 3.012200180441141, + 1.0314714573323727, + 2.6078540682792664, + 5.201604096218944, + 0.10661055520176888, + 0.5092796627432108, + 1.6632808223366737, + 1.3349515087902546, + 1.0069535411894321, + 1.9217072955798358, + 1.870946992188692, + 1.6746737770736217, + 0.9144285470247269, + 3.4658993538469076, + 2.0795009322464466, + 0.25134994834661484, + 0.4112500976771116, + 2.4876900631934404, + 1.6202946789562702, + 0.12112621124833822, + 2.790440533310175, + 0.48880891129374504, + 2.260116647928953, + 1.2381789833307266, + 0.782139390707016, + 4.5589607283473015, + 1.2624508095905185, + 1.6871247366070747, + 3.313586000353098, + 2.38559352979064, + 0.564694881439209, + 1.0057533085346222, + 1.5017914604395628, + 0.2251986414194107, + 0.8728928901255131, + 0.09220648556947708, + 2.054280262440443, + 1.132141973823309, + 2.272406179457903, + 1.5872658779844642, + 2.0190444830805063, + 2.584417784586549, + 1.8877517767250538, + 0.07289278320968151, + 0.9806613735854626, + 1.0062080989591777, + 1.4543370548635721, + 0.0, + 0.7165881590917706, + 1.5026709996163845, + 0.6817990634590387, + 1.066656518727541, + 1.7385843582451344 + ], + "unique_experts": 63, + "load_cv": 0.703928728812177, + "normalized_load_entropy": 0.9464539715174137, + "max_load_share": 0.06569343065693431 + } + }, + "s1_eos": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "80b1c0336839d25c5ac75e0003292acd49dd2165e1b9fabc076d1dd888556f07", + "route_weight_sha256": "e794193cc8857cc4c9e72bff29b6b5a73a454f4a6d6fa029d79b88437fbd3a13", + "loads": [ + 12, + 36, + 22, + 11, + 29, + 27, + 26, + 25, + 8, + 21, + 20, + 53, + 12, + 49, + 105, + 2, + 8, + 25, + 22, + 26, + 26, + 29, + 29, + 10, + 69, + 36, + 6, + 1, + 7, + 8, + 2, + 30, + 11, + 22, + 21, + 7, + 78, + 18, + 10, + 48, + 47, + 0, + 12, + 25, + 2, + 13, + 1, + 39, + 19, + 40, + 23, + 33, + 40, + 32, + 3, + 17, + 20, + 21, + 0, + 17, + 30, + 8, + 14, + 31 + ], + "weighted_loads": [ + 0.704150851815939, + 2.34714575111866, + 1.45264395698905, + 0.5078003630042076, + 1.189776699990034, + 1.7677685003727674, + 1.160591809079051, + 1.6898560784757137, + 0.3562784492969513, + 1.2050101235508919, + 1.1919960100203753, + 3.0498183593153954, + 0.8060195334255695, + 2.63917813077569, + 5.1654344610869884, + 0.07966165244579315, + 0.37309123761951923, + 1.6472835130989552, + 1.2959885280579329, + 1.0616756454110146, + 1.8416069746017456, + 1.883161697536707, + 1.652414981275797, + 0.420046791434288, + 3.5603933073580265, + 2.0315028820186853, + 0.22064347751438618, + 0.052909016609191895, + 0.5821839701384306, + 0.3196867126971483, + 0.06478560529649258, + 2.4936127737164497, + 0.44523876905441284, + 2.091718642041087, + 1.23585844039917, + 0.2862272970378399, + 4.57834254950285, + 1.1402944326400757, + 0.5252844840288162, + 3.3099347073584795, + 2.4241513069719076, + 0.0, + 0.5416342690587044, + 1.5388440024107695, + 0.1059318296611309, + 0.8280900195240974, + 0.03241533786058426, + 1.7877147011458874, + 0.8302277121692896, + 2.283135125413537, + 1.557299591600895, + 2.0189566388726234, + 2.544037878513336, + 1.9381173625588417, + 0.10936920531094074, + 0.9062884338200092, + 0.904797550290823, + 1.4921248387545347, + 0.0, + 0.6553877424448729, + 1.4239837154746056, + 0.514463908970356, + 0.7932120207697153, + 1.6435907203704119 + ], + "unique_experts": 62, + "load_cv": 0.8134719655011879, + "normalized_load_entropy": 0.9267935776872326, + "max_load_share": 0.07028112449799197 + }, + "full_input": { + "tokens": 290, + "top_k": 6, + "decisions": 1740, + "ordered_route_sha256": "a1060096f54a370fd21933fec9aed826135ac3d0a6ee78ef9c248584d1557f94", + "route_weight_sha256": "c8353c95fcfb0d6d4396827357ba7d8a004c9951320f8e174153c2ff31e36c70", + "loads": [ + 16, + 36, + 22, + 14, + 33, + 28, + 26, + 32, + 14, + 24, + 21, + 53, + 16, + 49, + 105, + 2, + 11, + 27, + 23, + 26, + 27, + 31, + 32, + 15, + 69, + 37, + 9, + 8, + 24, + 23, + 13, + 34, + 15, + 27, + 26, + 14, + 78, + 22, + 28, + 48, + 48, + 12, + 21, + 27, + 15, + 17, + 5, + 46, + 27, + 40, + 25, + 33, + 40, + 35, + 3, + 18, + 23, + 26, + 0, + 22, + 32, + 16, + 20, + 31 + ], + "weighted_loads": [ + 0.8959356397390366, + 2.34714575111866, + 1.45264395698905, + 0.564125411445275, + 2.814631711691618, + 1.7717049974016845, + 1.160591809079051, + 2.0792244002223015, + 0.8619400262832642, + 1.521096058189869, + 1.2349007669836283, + 3.0498183593153954, + 0.9725759029388428, + 2.63917813077569, + 5.1654344610869884, + 0.07966165244579315, + 0.6051541622728109, + 1.7600195370614529, + 1.331832269206643, + 1.0616756454110146, + 1.8439423968084157, + 1.9738342948257923, + 1.7731004990637302, + 0.8442107513546944, + 3.5603933073580265, + 2.073607997968793, + 0.3417938072234392, + 0.4107553996145725, + 2.813467087224126, + 2.389273399487138, + 0.9239177452400327, + 2.7449365947395563, + 0.6227713450789452, + 2.3873613607138395, + 1.485325537621975, + 0.8577240500599146, + 4.57834254950285, + 1.3142219251021743, + 1.940416608005762, + 3.3099347073584795, + 2.4543901924043894, + 1.04824398458004, + 1.068808902055025, + 1.6481994595378637, + 1.3207562007009983, + 1.1355119235813618, + 0.2156076431274414, + 2.149608377367258, + 1.2788556851446629, + 2.283135125413537, + 1.6228286316618323, + 2.0189566388726234, + 2.544037878513336, + 2.095206893980503, + 0.10936920531094074, + 0.9376017786562443, + 0.9846831224858761, + 1.7141925115138292, + 0.0, + 0.8216399922966957, + 1.4958619438111782, + 0.9182081297039986, + 1.0598227810114622, + 1.6435907203704119 + ], + "unique_experts": 63, + "load_cv": 0.6369392725685477, + "normalized_load_entropy": 0.9561433635638549, + "max_load_share": 0.0603448275862069 + } + }, + "s0_bos": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "083ee90e11e4e05b0165955bc8107ecd9ded55e754e7dbe928f18bf34c3ea49d", + "route_weight_sha256": "3751f01e3c28f1e4c5e364c5927a6604bdccc44f4fbef0ef7c6ab57b119af03e", + "loads": [ + 10, + 36, + 19, + 13, + 25, + 27, + 26, + 25, + 8, + 21, + 19, + 58, + 12, + 51, + 111, + 2, + 8, + 25, + 22, + 30, + 28, + 29, + 28, + 7, + 71, + 35, + 6, + 1, + 9, + 8, + 3, + 30, + 9, + 24, + 22, + 6, + 80, + 17, + 10, + 50, + 44, + 1, + 14, + 24, + 3, + 13, + 1, + 32, + 19, + 37, + 23, + 33, + 41, + 28, + 2, + 20, + 20, + 22, + 0, + 16, + 29, + 8, + 13, + 30 + ], + "weighted_loads": [ + 0.637543972581625, + 2.3557096607983112, + 1.2988270558416843, + 0.5497363861650229, + 1.0295270755887032, + 1.7715312503278255, + 1.198947686702013, + 1.6854412257671356, + 0.3596082702279091, + 1.190720932558179, + 1.1850945129990578, + 3.223789010196924, + 0.8048589155077934, + 2.6828113421797752, + 5.402124706655741, + 0.08156990259885788, + 0.36030642688274384, + 1.6658220887184143, + 1.2979192920029163, + 1.2094496190547943, + 1.9348808396607637, + 1.8977623023092747, + 1.6447034440934658, + 0.3145347163081169, + 3.653573514893651, + 2.0016024354845285, + 0.21526650711894035, + 0.05451510474085808, + 0.629277553409338, + 0.3234037421643734, + 0.08774798735976219, + 2.5097724944353104, + 0.37160410918295383, + 2.2474464662373066, + 1.2688034810125828, + 0.24332213588058949, + 4.637830907478929, + 1.1243025958538055, + 0.4750658106058836, + 3.402165761217475, + 2.324723530560732, + 0.03453056514263153, + 0.6655436456203461, + 1.527322642505169, + 0.1431603543460369, + 0.8784967698156834, + 0.034176524728536606, + 1.5657131187617779, + 0.8772962596267462, + 2.0981646310538054, + 1.5802807547152042, + 2.022139884531498, + 2.597518105059862, + 1.8392278552055359, + 0.07223665155470371, + 1.0073325596749783, + 0.8908984176814556, + 1.5372898895293474, + 0.0, + 0.6055229045450687, + 1.4091719258576632, + 0.5518210977315903, + 0.7723642606288195, + 1.58948908559978 + ], + "unique_experts": 63, + "load_cv": 0.839901695782042, + "normalized_load_entropy": 0.925039167506543, + "max_load_share": 0.07429718875502007 + }, + "full_input": { + "tokens": 274, + "top_k": 6, + "decisions": 1644, + "ordered_route_sha256": "895c35608ef11e85ffb00e1b2bf246768e7ba53a2ffab53cafa7066a668031d7", + "route_weight_sha256": "c679e37f2ad3a68227e7f799734339b55a95ee639c360ab1b52c8ea6de86288d", + "loads": [ + 10, + 36, + 19, + 17, + 28, + 27, + 26, + 28, + 15, + 21, + 19, + 58, + 18, + 51, + 111, + 2, + 13, + 25, + 22, + 30, + 28, + 29, + 29, + 13, + 71, + 36, + 8, + 7, + 25, + 18, + 5, + 36, + 10, + 26, + 22, + 13, + 80, + 21, + 24, + 50, + 44, + 7, + 20, + 24, + 5, + 14, + 2, + 37, + 24, + 37, + 24, + 33, + 41, + 28, + 2, + 20, + 22, + 22, + 0, + 19, + 29, + 12, + 18, + 33 + ], + "weighted_loads": [ + 0.637543972581625, + 2.3557096607983112, + 1.2988270558416843, + 0.6734846970066428, + 1.6965182796120644, + 1.7715312503278255, + 1.198947686702013, + 1.887008909136057, + 0.8256444521248341, + 1.190720932558179, + 1.1850945129990578, + 3.223789010196924, + 1.0973869003355503, + 2.6828113421797752, + 5.402124706655741, + 0.08156990259885788, + 0.5727515630424023, + 1.6658220887184143, + 1.2979192920029163, + 1.2094496190547943, + 1.9348808396607637, + 1.8977623023092747, + 1.692361030727625, + 0.806443702429533, + 3.653573514893651, + 2.0480407383292913, + 0.2909198999404907, + 0.4123173672705889, + 2.577398009598255, + 1.736225850880146, + 0.15013026352971792, + 2.854892171919346, + 0.4179739523679018, + 2.354694042354822, + 1.2688034810125828, + 0.7361997980624437, + 4.637830907478929, + 1.2380114449188113, + 1.7351450379937887, + 3.402165761217475, + 2.324723530560732, + 0.6296925693750381, + 1.0614853911101818, + 1.527322642505169, + 0.2536283992230892, + 0.916258629411459, + 0.09456251189112663, + 1.833119973540306, + 1.2069990765303373, + 2.0981646310538054, + 1.5932338861748576, + 2.022139884531498, + 2.597518105059862, + 1.8392278552055359, + 0.07223665155470371, + 1.0073325596749783, + 0.9902858976274729, + 1.5372898895293474, + 0.0, + 0.7513134051114321, + 1.4091719258576632, + 0.7103335056453943, + 0.9675305895507336, + 1.6861302815377712 + ], + "unique_experts": 63, + "load_cv": 0.722914408144854, + "normalized_load_entropy": 0.9448661132156548, + "max_load_share": 0.06751824817518248 + } + }, + "s1_bos": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "f2dd52f56bd0eeccbfe742691200a823106bcee026133b729d2f72c941b48a12", + "route_weight_sha256": "883c49430484980bbf21cfe0f01f47fce5485f2404de84703f7799314b02160b", + "loads": [ + 11, + 36, + 19, + 13, + 31, + 26, + 25, + 25, + 8, + 20, + 21, + 55, + 13, + 49, + 110, + 2, + 9, + 26, + 22, + 27, + 28, + 29, + 27, + 8, + 67, + 35, + 4, + 1, + 8, + 9, + 2, + 30, + 10, + 23, + 23, + 6, + 80, + 17, + 10, + 50, + 47, + 1, + 15, + 24, + 2, + 13, + 1, + 31, + 19, + 40, + 24, + 34, + 42, + 31, + 2, + 19, + 18, + 23, + 0, + 16, + 29, + 7, + 12, + 29 + ], + "weighted_loads": [ + 0.662847526371479, + 2.375422976911068, + 1.3173368275165558, + 0.5589985083788633, + 1.2760593798011541, + 1.7285536210983992, + 1.1433483567088842, + 1.680788490921259, + 0.36160364001989365, + 1.1427836902439594, + 1.2651161085814238, + 3.114910949021578, + 0.839614424854517, + 2.6467266343533993, + 5.395125348120928, + 0.08243873715400696, + 0.4032118897885084, + 1.7083305642008781, + 1.2919927816838026, + 1.0955936945974827, + 1.9467456247657537, + 1.9004387520253658, + 1.5940084010362625, + 0.3641389161348343, + 3.5459201633930206, + 1.985153865069151, + 0.146436870098114, + 0.0561600960791111, + 0.5875898450613022, + 0.34997875429689884, + 0.06400026194751263, + 2.4924956522881985, + 0.40864075534045696, + 2.177315039560199, + 1.311119455844164, + 0.24533437378704548, + 4.623960580676794, + 1.084490466862917, + 0.5061604715883732, + 3.424969704821706, + 2.4103192407637835, + 0.036390312016010284, + 0.7268695682287216, + 1.5431537367403507, + 0.10830899700522423, + 0.8592606857419014, + 0.035490941256284714, + 1.5228875614702702, + 0.8610048890113831, + 2.2473899852484465, + 1.6028125267475843, + 2.0452541038393974, + 2.6160419061779976, + 1.917740298435092, + 0.07294253818690777, + 0.9778531603515148, + 0.818526566028595, + 1.5683725867420435, + 0.0, + 0.6099779177457094, + 1.4099132977426052, + 0.5204562619328499, + 0.7236792389303446, + 1.5805247761309147 + ], + "unique_experts": 63, + "load_cv": 0.8317369374960708, + "normalized_load_entropy": 0.925125546589491, + "max_load_share": 0.07362784471218206 + }, + "full_input": { + "tokens": 290, + "top_k": 6, + "decisions": 1740, + "ordered_route_sha256": "fece76d80accc4603d35e8c52aae1acba3b74f1c63bc604788da5774fa18b425", + "route_weight_sha256": "548d3a61be3f95f82eecebb258aec453eb9c0ee2bc4f13f226d0da656cd2720a", + "loads": [ + 15, + 36, + 19, + 15, + 34, + 26, + 25, + 32, + 14, + 23, + 22, + 55, + 18, + 49, + 110, + 2, + 14, + 28, + 23, + 27, + 28, + 31, + 30, + 13, + 67, + 35, + 7, + 8, + 25, + 27, + 13, + 35, + 14, + 28, + 28, + 13, + 80, + 21, + 28, + 50, + 48, + 13, + 23, + 26, + 15, + 17, + 5, + 38, + 28, + 40, + 26, + 34, + 42, + 34, + 2, + 20, + 20, + 28, + 0, + 20, + 31, + 15, + 18, + 29 + ], + "weighted_loads": [ + 0.8546323142945766, + 2.375422976911068, + 1.3173368275165558, + 0.6123795276507735, + 1.9506144728511572, + 1.7285536210983992, + 1.1433483567088842, + 2.0668360739946365, + 0.9152116924524307, + 1.4588696248829365, + 1.3080208655446768, + 3.114910949021578, + 1.0900117196142673, + 2.6467266343533993, + 5.395125348120928, + 0.08243873715400696, + 0.7018954958766699, + 1.8210665881633759, + 1.3278365228325129, + 1.0955936945974827, + 1.9467456247657537, + 1.9911113493144512, + 1.7146939188241959, + 0.7883028760552406, + 3.5459201633930206, + 1.985153865069151, + 0.26758719980716705, + 0.41400647908449173, + 2.9465981014072895, + 2.7251909021288157, + 0.9231324018910527, + 2.7722155582159758, + 0.5861733313649893, + 2.485405107960105, + 1.560586553066969, + 0.8168311268091202, + 4.623960580676794, + 1.2584179593250155, + 2.0480496995151043, + 3.424969704821706, + 2.440558126196265, + 1.1073564998805523, + 1.2302032001316547, + 1.652509193867445, + 1.3230694718658924, + 1.1666825897991657, + 0.21344341337680817, + 1.8909277878701687, + 1.351657709106803, + 2.2473899852484465, + 1.6683415668085217, + 2.0452541038393974, + 2.6160419061779976, + 2.0748298298567533, + 0.07294253818690777, + 1.0091665051877499, + 0.8785046003758907, + 1.790440259501338, + 0.0, + 0.7654197961091995, + 1.4817915260791779, + 0.9242004826664925, + 0.9918129164725542, + 1.5805247761309147 + ], + "unique_experts": 63, + "load_cv": 0.6529018935086895, + "normalized_load_entropy": 0.954532997748644, + "max_load_share": 0.06321839080459771 + } + }, + "s0_x": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "ed87b49c0fd22b1d49559e9b190483d3ffc7f37f200f01841464d77e2eebc71e", + "route_weight_sha256": "3853bf6d7987ad6e1080580bc68ee0928b1823c1138b17c81d8b68615f5ee637", + "loads": [ + 12, + 36, + 20, + 12, + 26, + 27, + 29, + 25, + 9, + 21, + 21, + 58, + 12, + 51, + 112, + 2, + 9, + 25, + 22, + 27, + 28, + 30, + 27, + 5, + 67, + 35, + 4, + 1, + 9, + 9, + 3, + 31, + 8, + 22, + 21, + 6, + 79, + 18, + 10, + 48, + 42, + 1, + 17, + 24, + 2, + 13, + 1, + 35, + 20, + 39, + 24, + 35, + 42, + 27, + 2, + 19, + 22, + 18, + 0, + 15, + 28, + 8, + 14, + 29 + ], + "weighted_loads": [ + 0.7048463374376297, + 2.34490017965436, + 1.3097871970385313, + 0.5182517394423485, + 1.066354401409626, + 1.7697759810835123, + 1.2965967413038015, + 1.676584467291832, + 0.38111332058906555, + 1.1818832829594612, + 1.250910211354494, + 3.237225955352187, + 0.8162481263279915, + 2.695781147107482, + 5.367986595258117, + 0.08281078934669495, + 0.39875718764960766, + 1.637149266898632, + 1.2699584923684597, + 1.078178072348237, + 1.9493432082235813, + 1.9272646605968475, + 1.6101782992482185, + 0.2514923121780157, + 3.519575046375394, + 2.000534873455763, + 0.1456863358616829, + 0.05434567853808403, + 0.6485932115465403, + 0.37449843622744083, + 0.08782275207340717, + 2.569974236190319, + 0.34066147170960903, + 2.14061345346272, + 1.2350784167647362, + 0.24298100732266903, + 4.569575810804963, + 1.1436010673642159, + 0.5020635183900595, + 3.3291943445801735, + 2.2252543829381466, + 0.03592418134212494, + 0.8117198348045349, + 1.4966053273528814, + 0.10949669033288956, + 0.8546608649194241, + 0.037353336811065674, + 1.6604431066662073, + 0.926668981090188, + 2.1971068754792213, + 1.586772782728076, + 2.1222038716077805, + 2.6254319325089455, + 1.785478886216879, + 0.07424127496778965, + 0.9780958164483309, + 0.9481644444167614, + 1.377654680982232, + 0.0, + 0.5848551746457815, + 1.3448225539177656, + 0.5333221778273582, + 0.7913561314344406, + 1.5624483842402697 + ], + "unique_experts": 63, + "load_cv": 0.8354175213285903, + "normalized_load_entropy": 0.9250480201416812, + "max_load_share": 0.0749665327978581 + }, + "full_input": { + "tokens": 274, + "top_k": 6, + "decisions": 1644, + "ordered_route_sha256": "f55499789f498f10838214acf5b0642501b3fbec477a115d30ebd2e781a4135b", + "route_weight_sha256": "84c7d3b907e65e62e40a65d445f8e331ddf11f6d2527063b6f7f420170c7acc2", + "loads": [ + 12, + 36, + 20, + 16, + 29, + 27, + 29, + 28, + 16, + 21, + 21, + 58, + 16, + 51, + 112, + 2, + 11, + 25, + 22, + 27, + 28, + 30, + 28, + 12, + 67, + 36, + 5, + 8, + 26, + 19, + 6, + 36, + 9, + 24, + 21, + 14, + 79, + 22, + 24, + 49, + 42, + 7, + 22, + 24, + 5, + 15, + 2, + 40, + 25, + 39, + 25, + 35, + 42, + 27, + 2, + 19, + 24, + 18, + 0, + 17, + 28, + 13, + 19, + 32 + ], + "weighted_loads": [ + 0.7048463374376297, + 2.34490017965436, + 1.3097871970385313, + 0.6420000502839684, + 1.7333456054329872, + 1.7697759810835123, + 1.2965967413038015, + 1.8897089138627052, + 0.8127538524568081, + 1.1818832829594612, + 1.250910211354494, + 3.237225955352187, + 1.0091054253280163, + 2.695781147107482, + 5.367986595258117, + 0.08281078934669495, + 0.5068436656147242, + 1.637149266898632, + 1.2699584923684597, + 1.078178072348237, + 1.9493432082235813, + 1.9272646605968475, + 1.6578358858823776, + 0.8981146905571222, + 3.519575046375394, + 2.0675840117037296, + 0.17853113636374474, + 0.4688389729708433, + 2.803809756413102, + 1.50606226362288, + 0.2018480645492673, + 2.882728163152933, + 0.387031314894557, + 2.2425864208489656, + 1.2350784167647362, + 0.8114526402205229, + 4.569575810804963, + 1.2573099164292216, + 1.6110311802476645, + 3.3726458214223385, + 2.2252543829381466, + 0.6069889105856419, + 1.175929769873619, + 1.4966053273528814, + 0.2573004737496376, + 0.9445866048336029, + 0.09486491233110428, + 1.8999829683452845, + 1.2441369276493788, + 2.1971068754792213, + 1.5997259141877294, + 2.1222038716077805, + 2.6254319325089455, + 1.785478886216879, + 0.07424127496778965, + 0.9780958164483309, + 1.0475519243627787, + 1.377654680982232, + 0.0, + 0.6696026735007763, + 1.3448225539177656, + 0.7648284155875444, + 0.9763188492506742, + 1.6590895801782608 + ], + "unique_experts": 63, + "load_cv": 0.7198945583781571, + "normalized_load_entropy": 0.9450132345335773, + "max_load_share": 0.0681265206812652 + } + }, + "s1_x": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "13f656b33ba958d00ea16388fc7f6044cd8bd6f2c9ec422a44f96c669feac680", + "route_weight_sha256": "951ac22c63a8c5ee8251d7a8d0edd37983223e2c9b5fc3bd63a096b217998eb6", + "loads": [ + 11, + 36, + 20, + 9, + 31, + 24, + 30, + 25, + 8, + 20, + 21, + 55, + 13, + 50, + 111, + 2, + 9, + 25, + 22, + 26, + 29, + 29, + 27, + 5, + 70, + 34, + 5, + 1, + 8, + 9, + 2, + 30, + 7, + 22, + 22, + 8, + 82, + 17, + 11, + 51, + 47, + 1, + 16, + 25, + 4, + 13, + 1, + 31, + 19, + 38, + 23, + 34, + 42, + 28, + 2, + 19, + 20, + 18, + 0, + 14, + 32, + 7, + 13, + 30 + ], + "weighted_loads": [ + 0.6668365634977818, + 2.3643704801797867, + 1.3595291059464216, + 0.43252316303551197, + 1.264846533536911, + 1.6633050683885813, + 1.2921775504946709, + 1.661365069448948, + 0.35676559433341026, + 1.1552473567426205, + 1.2980430014431477, + 3.113595286384225, + 0.8407385423779488, + 2.6638252530246973, + 5.491007160395384, + 0.08357209712266922, + 0.4119223281741142, + 1.6326277814805508, + 1.2740440964698792, + 1.0360715743154287, + 2.0082556437700987, + 1.8933708183467388, + 1.5732447765767574, + 0.25787919387221336, + 3.636194348335266, + 1.954529494047165, + 0.17728703655302525, + 0.055028896778821945, + 0.5969067085534334, + 0.36118874326348305, + 0.07526097819209099, + 2.5065495669841766, + 0.30798158794641495, + 2.09704402461648, + 1.293795756995678, + 0.3301464840769768, + 4.758164502680302, + 1.0652066599577665, + 0.587659440934658, + 3.490893205627799, + 2.3932131826877594, + 0.04114702343940735, + 0.7799473199993372, + 1.568527054041624, + 0.20244661159813404, + 0.8547350019216537, + 0.035970449447631836, + 1.4821592681109905, + 0.8828899003565311, + 2.2103464920073748, + 1.5681597962975502, + 2.09610054269433, + 2.6206877063959837, + 1.7843924667686224, + 0.07392203435301781, + 0.9993495680391788, + 0.9007775243371725, + 1.4011984076350927, + 0.0, + 0.5381241142749786, + 1.502002177760005, + 0.5019048154354095, + 0.7326954621821642, + 1.6057582572102547 + ], + "unique_experts": 63, + "load_cv": 0.8459904999388922, + "normalized_load_entropy": 0.923621494602262, + "max_load_share": 0.07429718875502007 + }, + "full_input": { + "tokens": 290, + "top_k": 6, + "decisions": 1740, + "ordered_route_sha256": "ba9745a36df6b6caba20bf3f9c3f7c1182b083e274816fd374cd5a14d7665906", + "route_weight_sha256": "27fc0f6be627dc934ec87b7447c6ef76ddd44ab727fed1efc94e7f5316d56000", + "loads": [ + 15, + 36, + 20, + 11, + 34, + 24, + 30, + 32, + 14, + 23, + 22, + 55, + 17, + 50, + 111, + 2, + 13, + 27, + 23, + 26, + 29, + 32, + 30, + 11, + 70, + 35, + 8, + 9, + 27, + 24, + 14, + 34, + 11, + 27, + 27, + 16, + 82, + 21, + 28, + 52, + 48, + 13, + 23, + 27, + 18, + 18, + 5, + 37, + 27, + 38, + 25, + 34, + 42, + 31, + 2, + 20, + 21, + 23, + 0, + 17, + 34, + 17, + 18, + 30 + ], + "weighted_loads": [ + 0.8586213514208794, + 2.3643704801797867, + 1.3595291059464216, + 0.48590418230742216, + 1.939401626586914, + 1.6633050683885813, + 1.2921775504946709, + 2.0543362013995647, + 0.8355662077665329, + 1.4713332913815975, + 1.3409477584064007, + 3.113595286384225, + 1.0071786418557167, + 2.6638252530246973, + 5.491007160395384, + 0.08357209712266922, + 0.6788707710802555, + 1.7453638054430485, + 1.3098878376185894, + 1.0360715743154287, + 2.0082556437700987, + 2.0145516861230135, + 1.6939302943646908, + 0.8143673874437809, + 3.636194348335266, + 2.0167158991098404, + 0.2984373662620783, + 0.4881023094058037, + 3.140309004113078, + 2.2280706204473972, + 0.9823598517104983, + 2.7691505271941423, + 0.48551416397094727, + 2.3936241045594215, + 1.543262854218483, + 0.9995346795767546, + 4.758164502680302, + 1.2391341524198651, + 1.901361171156168, + 3.5286279004067183, + 2.423452068120241, + 1.0858681946992874, + 1.2322399262338877, + 1.6778825111687183, + 1.4602065179497004, + 1.2038269862532616, + 0.22136414051055908, + 1.7700470052659512, + 1.307584634050727, + 2.2103464920073748, + 1.6336888363584876, + 2.09610054269433, + 2.6206877063959837, + 1.9414819981902838, + 0.07392203435301781, + 1.030662912875414, + 0.9284824226051569, + 1.6232660803943872, + 0.0, + 0.653131103143096, + 1.5738804060965776, + 0.9903355948626995, + 0.956055885180831, + 1.6057582572102547 + ], + "unique_experts": 63, + "load_cv": 0.6651230643363041, + "normalized_load_entropy": 0.9533640407144155, + "max_load_share": 0.06379310344827586 + } + }, + "s0_period": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "3cd73cac75ebabc0a66dbe1712e983103ba6926374b6cb5d4d61228cb3269767", + "route_weight_sha256": "54eed8fe24b920b4e45c761dba2fbf42ee259cdff54a373894d6b5cd4fdae18b", + "loads": [ + 11, + 35, + 20, + 12, + 25, + 28, + 31, + 25, + 9, + 21, + 20, + 55, + 12, + 52, + 112, + 2, + 7, + 25, + 22, + 26, + 28, + 31, + 27, + 6, + 66, + 35, + 5, + 1, + 9, + 9, + 2, + 30, + 9, + 22, + 21, + 6, + 79, + 18, + 10, + 51, + 43, + 1, + 18, + 24, + 2, + 13, + 1, + 35, + 21, + 38, + 24, + 34, + 42, + 27, + 2, + 19, + 21, + 20, + 0, + 15, + 27, + 8, + 14, + 30 + ], + "weighted_loads": [ + 0.673076931387186, + 2.2960414737462997, + 1.3123717978596687, + 0.5173863563686609, + 1.0426887944340706, + 1.7965054605156183, + 1.368355892598629, + 1.6812234427779913, + 0.38581071980297565, + 1.179942436516285, + 1.2174521274864674, + 3.1312511283904314, + 0.8276933915913105, + 2.769017230719328, + 5.368411237373948, + 0.08268224075436592, + 0.34382508881390095, + 1.6512645184993744, + 1.2818534392863512, + 1.0070500690490007, + 1.9523768480867147, + 1.9628106318414211, + 1.6143503934144974, + 0.28898113034665585, + 3.494224838912487, + 2.0200752448290586, + 0.1767043750733137, + 0.05571284890174866, + 0.6308830995112658, + 0.36890758387744427, + 0.05834314785897732, + 2.5360560342669487, + 0.37928631529212, + 2.1245109997689724, + 1.235984243452549, + 0.2504285965114832, + 4.606141917407513, + 1.1431477703154087, + 0.4997980184853077, + 3.4483324252068996, + 2.2463524155318737, + 0.03687874972820282, + 0.8136432189494371, + 1.4903836976736784, + 0.11176038533449173, + 0.8528345674276352, + 0.03632810339331627, + 1.6633835062384605, + 0.9778670016676188, + 2.1878464948385954, + 1.5903967060148716, + 2.0810435079038143, + 2.625868134200573, + 1.786735001951456, + 0.07433503493666649, + 0.979410145431757, + 0.9347674064338207, + 1.454125426709652, + 0.0, + 0.5859273914247751, + 1.324802178889513, + 0.5395927652716637, + 0.772278493270278, + 1.5880711358040571 + ], + "unique_experts": 63, + "load_cv": 0.8339747428070369, + "normalized_load_entropy": 0.9251239440874626, + "max_load_share": 0.0749665327978581 + }, + "full_input": { + "tokens": 274, + "top_k": 6, + "decisions": 1644, + "ordered_route_sha256": "7b5ceeb657f225d06f3ca83018d56f77e472b044958b658804c6cf8b00d4ad9f", + "route_weight_sha256": "3fa90a3bdaec79440b5e5e144f8cbf87e9f7b5e82be8336769a691e1b4cb583d", + "loads": [ + 11, + 35, + 20, + 16, + 28, + 28, + 31, + 28, + 16, + 21, + 20, + 55, + 16, + 52, + 112, + 2, + 11, + 25, + 22, + 26, + 28, + 31, + 28, + 13, + 66, + 36, + 6, + 8, + 25, + 18, + 4, + 35, + 10, + 24, + 21, + 14, + 79, + 22, + 24, + 52, + 43, + 8, + 24, + 24, + 5, + 14, + 2, + 41, + 25, + 38, + 25, + 34, + 42, + 27, + 2, + 19, + 23, + 20, + 0, + 17, + 27, + 13, + 19, + 33 + ], + "weighted_loads": [ + 0.673076931387186, + 2.2960414737462997, + 1.3123717978596687, + 0.6411346672102809, + 1.7096799984574318, + 1.7965054605156183, + 1.368355892598629, + 1.8849946055561304, + 0.7972659021615982, + 1.179942436516285, + 1.2174521274864674, + 3.1312511283904314, + 1.0258258022367954, + 2.769017230719328, + 5.368411237373948, + 0.08268224075436592, + 0.5482313502579927, + 1.6512645184993744, + 1.2818534392863512, + 1.0070500690490007, + 1.9523768480867147, + 1.9628106318414211, + 1.6620079800486565, + 0.842832675203681, + 3.494224838912487, + 2.084480097517371, + 0.20954917557537556, + 0.45165481232106686, + 2.799930928274989, + 1.4885961655527353, + 0.12072542402893305, + 2.850963030010462, + 0.42565615847706795, + 2.2290055863559246, + 1.235984243452549, + 0.7907501067966223, + 4.606141917407513, + 1.2568566193804145, + 1.6260684542357922, + 3.494821712374687, + 2.2463524155318737, + 0.7060396298766136, + 1.1986364554613829, + 1.4903836976736784, + 0.2692123055458069, + 0.8905964270234108, + 0.09489371627569199, + 1.9382238239049911, + 1.2543570008128881, + 2.1878464948385954, + 1.603349837474525, + 2.0810435079038143, + 2.625868134200573, + 1.786735001951456, + 0.07433503493666649, + 0.979410145431757, + 1.034154886379838, + 1.454125426709652, + 0.0, + 0.6706748902797699, + 1.324802178889513, + 0.7546777855604887, + 0.9714096710085869, + 1.6847123317420483 + ], + "unique_experts": 63, + "load_cv": 0.7188741428581154, + "normalized_load_entropy": 0.9450718971520666, + "max_load_share": 0.0681265206812652 + } + }, + "s1_period": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "ece277d494fcd1087e2e07095145401a8d57bb4c5dbb35a25fae8531f80d53ac", + "route_weight_sha256": "b6e51959927d137ef761e336a1771f6d009cf3cd16cd317a2330b7e97949b280", + "loads": [ + 11, + 36, + 20, + 9, + 30, + 25, + 28, + 25, + 8, + 20, + 21, + 57, + 13, + 54, + 109, + 2, + 8, + 25, + 22, + 26, + 26, + 29, + 26, + 5, + 67, + 33, + 5, + 1, + 8, + 9, + 2, + 30, + 8, + 23, + 23, + 7, + 81, + 17, + 11, + 51, + 45, + 1, + 16, + 25, + 3, + 13, + 1, + 32, + 21, + 37, + 25, + 33, + 41, + 29, + 2, + 19, + 22, + 18, + 0, + 17, + 30, + 7, + 15, + 31 + ], + "weighted_loads": [ + 0.6694607026875019, + 2.3890261724591255, + 1.3560814708471298, + 0.4364484157413244, + 1.2448969651013613, + 1.7036352753639221, + 1.2394005469977856, + 1.6743205189704895, + 0.3628053814172745, + 1.166699394583702, + 1.2956608720123768, + 3.1944359745830297, + 0.8373288214206696, + 2.8579145651310682, + 5.410415448248386, + 0.08305719122290611, + 0.3671593554317951, + 1.6510119959712029, + 1.2820229046046734, + 1.0430944822728634, + 1.9177458640187979, + 1.9036376476287842, + 1.540980115532875, + 0.2515261843800545, + 3.526314677670598, + 1.9340271390974522, + 0.1778719164431095, + 0.05451316386461258, + 0.5690469481050968, + 0.3588147275149822, + 0.07074517197906971, + 2.502923473715782, + 0.3443379383534193, + 2.1205891519784927, + 1.3315367214381695, + 0.28204819187521935, + 4.7359785586595535, + 1.078929765149951, + 0.5937284827232361, + 3.5370913855731487, + 2.3343210089951754, + 0.04461517184972763, + 0.7753551248461008, + 1.5520541407167912, + 0.16656411811709404, + 0.8552690632641315, + 0.036489006131887436, + 1.524121092632413, + 0.9671440087258816, + 2.1611147820949554, + 1.6273835487663746, + 2.07301427051425, + 2.6090279892086983, + 1.8342562038451433, + 0.07502727583050728, + 1.0096954442560673, + 0.970027394592762, + 1.4218543581664562, + 0.0, + 0.6383517850190401, + 1.4585409946739674, + 0.5260811075568199, + 0.7905360069125891, + 1.6599687486886978 + ], + "unique_experts": 63, + "load_cv": 0.8346620912358071, + "normalized_load_entropy": 0.924701775056929, + "max_load_share": 0.07295850066934405 + }, + "full_input": { + "tokens": 290, + "top_k": 6, + "decisions": 1740, + "ordered_route_sha256": "a71dc955c82817ab77917a412e3088ebbef1b6dcc5591b14ca18fd982f49c687", + "route_weight_sha256": "fd82d65a89a34d07c7e71df93d42a51e2108becd14ed9c80acdfea00785827f2", + "loads": [ + 15, + 36, + 20, + 11, + 33, + 25, + 28, + 33, + 14, + 23, + 22, + 57, + 16, + 54, + 109, + 2, + 12, + 27, + 23, + 26, + 26, + 31, + 29, + 11, + 67, + 34, + 8, + 8, + 27, + 23, + 14, + 34, + 12, + 28, + 28, + 15, + 81, + 21, + 29, + 52, + 46, + 14, + 25, + 27, + 17, + 17, + 5, + 38, + 29, + 37, + 27, + 33, + 41, + 32, + 2, + 20, + 23, + 23, + 0, + 20, + 32, + 16, + 21, + 31 + ], + "weighted_loads": [ + 0.8612454906105995, + 2.3890261724591255, + 1.3560814708471298, + 0.4898294350132346, + 1.9194520581513643, + 1.7036352753639221, + 1.2394005469977856, + 2.0969830602407455, + 0.8430161997675896, + 1.4827853292226791, + 1.3385656289756298, + 3.1944359745830297, + 0.9628519751131535, + 2.8579145651310682, + 5.410415448248386, + 0.08305719122290611, + 0.6456109918653965, + 1.7637480199337006, + 1.3178666457533836, + 1.0430944822728634, + 1.9177458640187979, + 1.9943102449178696, + 1.6616656333208084, + 0.7272367104887962, + 3.526314677670598, + 1.9867677837610245, + 0.29902224615216255, + 0.4123595468699932, + 3.1283722147345543, + 2.1822697408497334, + 0.9648937219753861, + 2.7684463504701853, + 0.5218705143779516, + 2.4267497584223747, + 1.5810038186609745, + 0.9092902299016714, + 4.7359785586595535, + 1.2528572576120496, + 1.9393735267221928, + 3.5845567546784878, + 2.364559894427657, + 1.2065793722867966, + 1.3212889153510332, + 1.6614095978438854, + 1.4199284948408604, + 1.1626909673213959, + 0.22844012454152107, + 1.8157516364008188, + 1.3894815165549517, + 2.1611147820949554, + 1.692912588827312, + 2.07301427051425, + 2.6090279892086983, + 1.9913457352668047, + 0.07502727583050728, + 1.0410087890923023, + 0.9977322928607464, + 1.6439220309257507, + 0.0, + 0.7533587738871574, + 1.53041922301054, + 0.9868897758424282, + 1.0502943228930235, + 1.6599687486886978 + ], + "unique_experts": 63, + "load_cv": 0.6562282277182795, + "normalized_load_entropy": 0.9540642954304194, + "max_load_share": 0.06264367816091954 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 249, + "ordered_topk_exact_tokens": 178, + "set_exact_tokens": 209, + "mean_set_jaccard": 0.9541021227768216, + "mean_token_weighted_tv": 0.00939122593052775, + "aggregate_load_tv": 0.013386880856760368 + }, + "system_bos": { + "tokens": 249, + "ordered_topk_exact_tokens": 173, + "set_exact_tokens": 194, + "mean_set_jaccard": 0.9343086632243258, + "mean_token_weighted_tv": 0.013035106794332644, + "aggregate_load_tv": 0.020080321285140562 + }, + "system_x": { + "tokens": 249, + "ordered_topk_exact_tokens": 143, + "set_exact_tokens": 177, + "mean_set_jaccard": 0.9122203098106714, + "mean_token_weighted_tv": 0.017690057967262095, + "aggregate_load_tv": 0.02409638554216868 + }, + "system_period": { + "tokens": 249, + "ordered_topk_exact_tokens": 126, + "set_exact_tokens": 164, + "mean_set_jaccard": 0.8983553260661694, + "mean_token_weighted_tv": 0.01985297074174905, + "aggregate_load_tv": 0.024096385542168676 + }, + "bos_at_s0": { + "tokens": 249, + "ordered_topk_exact_tokens": 145, + "set_exact_tokens": 182, + "mean_set_jaccard": 0.9205393000573722, + "mean_token_weighted_tv": 0.016473931806483662, + "aggregate_load_tv": 0.024765729585006693 + }, + "bos_at_s1": { + "tokens": 249, + "ordered_topk_exact_tokens": 134, + "set_exact_tokens": 171, + "mean_set_jaccard": 0.9079173838209982, + "mean_token_weighted_tv": 0.01871836868051185, + "aggregate_load_tv": 0.026104417670682736 + }, + "x_at_s0": { + "tokens": 249, + "ordered_topk_exact_tokens": 148, + "set_exact_tokens": 175, + "mean_set_jaccard": 0.9107860011474469, + "mean_token_weighted_tv": 0.01744033934840237, + "aggregate_load_tv": 0.025435073627844716 + }, + "x_at_s1": { + "tokens": 249, + "ordered_topk_exact_tokens": 134, + "set_exact_tokens": 161, + "mean_set_jaccard": 0.8897494740868235, + "mean_token_weighted_tv": 0.0219214825692725, + "aggregate_load_tv": 0.0321285140562249 + }, + "period_at_s0": { + "tokens": 249, + "ordered_topk_exact_tokens": 137, + "set_exact_tokens": 173, + "mean_set_jaccard": 0.9102122776821573, + "mean_token_weighted_tv": 0.017701123942093677, + "aggregate_load_tv": 0.024765729585006703 + }, + "period_at_s1": { + "tokens": 249, + "ordered_topk_exact_tokens": 128, + "set_exact_tokens": 157, + "mean_set_jaccard": 0.8834385159686363, + "mean_token_weighted_tv": 0.02288533248994724, + "aggregate_load_tv": 0.03078982597054887 + } + } + }, + "layer_13": { + "layer": 13, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "323ad3492e7b5fc7d9d363bc6635572eb339c31d4e5c8423f4581bde3d32768a", + "route_weight_sha256": "f73bd6dfa15f5506d8eb1419ea5a0b9aa001d232576a2a57d0c07b71be55802e", + "loads": [ + 42, + 5, + 56, + 94, + 6, + 16, + 40, + 23, + 4, + 7, + 9, + 7, + 33, + 13, + 18, + 21, + 21, + 15, + 131, + 2, + 13, + 24, + 29, + 2, + 15, + 24, + 12, + 50, + 3, + 2, + 0, + 38, + 45, + 14, + 25, + 31, + 15, + 1, + 35, + 8, + 26, + 13, + 17, + 4, + 3, + 12, + 18, + 10, + 26, + 9, + 134, + 45, + 22, + 15, + 22, + 2, + 3, + 12, + 38, + 15, + 41, + 17, + 30, + 11 + ], + "weighted_loads": [ + 3.3066183030605316, + 0.15851684287190437, + 2.674909383058548, + 4.676155837252736, + 0.2004005704075098, + 0.7445117235183716, + 1.7159311026334763, + 1.6231578756123781, + 0.15907252207398415, + 0.23247386142611504, + 0.46116479486227036, + 0.30892043374478817, + 1.5674591176211834, + 0.6457553096115589, + 0.6393530983477831, + 0.9476572312414646, + 0.927227471023798, + 0.5666344668716192, + 8.575711220502853, + 0.06067485548555851, + 0.5785128884017467, + 1.2732523027807474, + 1.7449706085026264, + 0.07504330202937126, + 0.5898835156112909, + 1.2157847471535206, + 0.3990630563348532, + 3.396188158541918, + 0.1169983334839344, + 0.062191374599933624, + 0.0, + 2.370513988658786, + 2.9760213419795036, + 0.8613806068897247, + 1.414987463504076, + 2.2422544173896313, + 0.5939469300210476, + 0.03284021094441414, + 2.1051494386047125, + 0.33199555054306984, + 1.3706441093236208, + 0.5783210434019566, + 0.709047419950366, + 0.1412107739597559, + 0.0980475302785635, + 1.067532304674387, + 0.8886541817337275, + 0.2969485968351364, + 4.124846488237381, + 0.3237653076648712, + 8.554797619581223, + 1.7430418115109205, + 0.970151986926794, + 0.7278059758245945, + 1.2909326292574406, + 0.060945916920900345, + 0.11379140615463257, + 0.5870035849511623, + 1.3526398912072182, + 0.6198547761887312, + 2.0570796243846416, + 0.9279806334525347, + 1.6227842289954424, + 0.47780888341367245 + ], + "unique_experts": 63, + "load_cv": 1.0927426391002348, + "normalized_load_entropy": 0.8955252003948354, + "max_load_share": 0.08969210174029452 + }, + "full_input": { + "tokens": 274, + "top_k": 6, + "decisions": 1644, + "ordered_route_sha256": "4386ff5bebc15428502db9567fd9598a00a4d102efa010e91a8108c96f813d35", + "route_weight_sha256": "935da778c046debeec8def4f1c09d043bd2b08dd997f174ea121a9878fe2b8f9", + "loads": [ + 42, + 9, + 56, + 94, + 6, + 17, + 58, + 23, + 4, + 9, + 19, + 13, + 33, + 13, + 19, + 27, + 21, + 17, + 132, + 3, + 13, + 27, + 29, + 3, + 19, + 24, + 15, + 51, + 3, + 15, + 0, + 38, + 45, + 20, + 26, + 31, + 20, + 2, + 35, + 9, + 26, + 16, + 20, + 6, + 13, + 22, + 20, + 12, + 27, + 9, + 135, + 45, + 25, + 18, + 24, + 2, + 6, + 13, + 43, + 20, + 42, + 18, + 30, + 12 + ], + "weighted_loads": [ + 3.3066183030605316, + 0.34843583405017853, + 2.674909383058548, + 4.676155837252736, + 0.2004005704075098, + 0.7755688764154911, + 3.228265717625618, + 1.6231578756123781, + 0.15907252207398415, + 0.3095221519470215, + 1.1469249743968248, + 0.5764960390515625, + 1.5674591176211834, + 0.6457553096115589, + 0.6847925689071417, + 1.2571650370955467, + 0.927227471023798, + 0.6142668751999736, + 8.616349257528782, + 0.10188286937773228, + 0.5785128884017467, + 1.4225317519158125, + 1.7449706085026264, + 0.11472536996006966, + 0.7261849255301058, + 1.2157847471535206, + 0.5251265373080969, + 3.4819565378129482, + 0.1169983334839344, + 0.9261546954512596, + 0.0, + 2.370513988658786, + 2.9760213419795036, + 1.5810661241412163, + 1.4377874676138163, + 2.2422544173896313, + 0.8541999235749245, + 0.06651521101593971, + 2.1051494386047125, + 0.3667684495449066, + 1.3706441093236208, + 0.7082470133900642, + 0.8460614662617445, + 0.23553348518908024, + 0.8530939090996981, + 2.0362252071499825, + 0.955184118822217, + 1.4898600727319717, + 4.156877387315035, + 0.3237653076648712, + 8.590706795454025, + 1.7430418115109205, + 1.0813046917319298, + 0.8651777356863022, + 1.3789805117994547, + 0.060945916920900345, + 0.2783227786421776, + 0.6183204427361488, + 1.581473931670189, + 0.8620571885257959, + 2.096338141709566, + 0.9573805835098028, + 1.6227842289954424, + 0.5152359958738089 + ], + "unique_experts": 63, + "load_cv": 0.981036259694819, + "normalized_load_entropy": 0.9145732022016244, + "max_load_share": 0.08211678832116788 + } + }, + "s1_eos": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "8f6de6b269094623e99297842dbd53d1d1fe71139dbd73d2ea9ef281679e9ed0", + "route_weight_sha256": "28bc8cd5b1610a9beacc5cde1070e1acb5af797e97e917a067c431c5dbd61161", + "loads": [ + 42, + 5, + 55, + 95, + 5, + 17, + 38, + 23, + 6, + 5, + 8, + 7, + 34, + 14, + 17, + 21, + 20, + 16, + 133, + 2, + 13, + 24, + 28, + 3, + 15, + 22, + 12, + 50, + 3, + 2, + 0, + 37, + 47, + 14, + 24, + 29, + 17, + 1, + 36, + 8, + 26, + 13, + 16, + 3, + 3, + 12, + 21, + 12, + 26, + 8, + 132, + 47, + 22, + 16, + 23, + 2, + 2, + 11, + 35, + 16, + 40, + 18, + 31, + 11 + ], + "weighted_loads": [ + 3.2426300141960382, + 0.15841713920235634, + 2.6483476236462593, + 4.751909738406539, + 0.17305533401668072, + 0.7717491220682859, + 1.65660616196692, + 1.6265529990196228, + 0.22527078725397587, + 0.16386318020522594, + 0.42307936400175095, + 0.305509764701128, + 1.6054253987967968, + 0.6813499163836241, + 0.6119456067681313, + 0.9321049340069294, + 0.8973044492304325, + 0.6103315893560648, + 8.665979728102684, + 0.06143560819327831, + 0.5774036757647991, + 1.2744884230196476, + 1.716125501319766, + 0.09246745705604553, + 0.5909228585660458, + 1.1532505098730326, + 0.399736737832427, + 3.369933381676674, + 0.11786368116736412, + 0.06292326375842094, + 0.0, + 2.3133924566209316, + 3.0386068504303694, + 0.8520634472370148, + 1.3620436619967222, + 2.1459739077836275, + 0.6431477181613445, + 0.04374761879444122, + 2.0871388632804155, + 0.3294417280703783, + 1.3770940117537975, + 0.59483752399683, + 0.6798350270837545, + 0.11522689089179039, + 0.09535357542335987, + 1.0824972949922085, + 0.9874064493924379, + 0.35553114861249924, + 4.041778201237321, + 0.2930745519697666, + 8.526211867108941, + 1.821700256317854, + 0.9817586503922939, + 0.7610397934913635, + 1.3340040910989046, + 0.06109779141843319, + 0.08001142367720604, + 0.5671781525015831, + 1.2746638897806406, + 0.6456083096563816, + 2.042231995612383, + 0.9503856841474771, + 1.654407911002636, + 0.4806976169347763 + ], + "unique_experts": 63, + "load_cv": 1.0935557710570372, + "normalized_load_entropy": 0.8953021525078522, + "max_load_share": 0.08902275769745649 + }, + "full_input": { + "tokens": 290, + "top_k": 6, + "decisions": 1740, + "ordered_route_sha256": "105552d057653765fad3a4203132210ee93b8c834641c48d3ed3279ca1b255aa", + "route_weight_sha256": "0129b232c0651e8ba3fa94dd46c05f857c906037a11088c23aa2c133690084e1", + "loads": [ + 47, + 8, + 55, + 95, + 5, + 18, + 67, + 23, + 6, + 7, + 19, + 20, + 34, + 14, + 18, + 28, + 20, + 19, + 135, + 5, + 13, + 29, + 28, + 6, + 19, + 22, + 16, + 51, + 3, + 22, + 8, + 38, + 47, + 25, + 27, + 30, + 23, + 2, + 37, + 9, + 28, + 19, + 24, + 4, + 19, + 23, + 22, + 15, + 28, + 12, + 133, + 47, + 25, + 18, + 25, + 4, + 5, + 23, + 42, + 20, + 42, + 20, + 31, + 13 + ], + "weighted_loads": [ + 3.4445288088172674, + 0.33861181139945984, + 2.6483476236462593, + 4.751909738406539, + 0.17305533401668072, + 0.8075099755078554, + 4.042041685432196, + 1.6265529990196228, + 0.22527078725397587, + 0.2535086013376713, + 1.1221909560263157, + 1.0951308426447213, + 1.6054253987967968, + 0.6813499163836241, + 0.6555096469819546, + 1.3041899427771568, + 0.8973044492304325, + 0.694249514490366, + 8.732725240290165, + 0.18319409899413586, + 0.5774036757647991, + 1.54506660066545, + 1.716125501319766, + 0.21378295496106148, + 0.7507376563735306, + 1.1532505098730326, + 0.5546242166310549, + 3.433458410203457, + 0.11786368116736412, + 1.6337919905781746, + 0.45521311461925507, + 2.3530687168240547, + 3.0386068504303694, + 2.025121036916971, + 1.5892864502966404, + 2.199957637116313, + 0.9974350109696388, + 0.07709760218858719, + 2.129027931019664, + 0.37105497904121876, + 1.4608872644603252, + 0.8646741770207882, + 1.335538974031806, + 0.19075829163193703, + 1.3341331500560045, + 2.0467528700828552, + 1.0278531927615404, + 1.586082722991705, + 4.296370962634683, + 0.49448876455426216, + 8.562394397333264, + 1.821700256317854, + 1.0821303389966488, + 0.8425980545580387, + 1.4041930455714464, + 0.13369986973702908, + 0.2245802879333496, + 1.3057109601795673, + 1.592679338529706, + 0.8418626822531223, + 2.10792482458055, + 1.038050564005971, + 1.654407911002636, + 0.5695599168539047 + ], + "unique_experts": 64, + "load_cv": 0.9246267363994429, + "normalized_load_entropy": 0.923977725794334, + "max_load_share": 0.07758620689655173 + } + }, + "s0_bos": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "2a6e85fe946d861b254f94bf0f7538a5fc6810a97f210b5814501a0d1590b652", + "route_weight_sha256": "e97ee1ea5c8cce608d5469d91f29d9ee598f337209050cfdf818b1d9fea91dfe", + "loads": [ + 40, + 4, + 57, + 96, + 6, + 16, + 39, + 23, + 4, + 6, + 11, + 7, + 35, + 12, + 21, + 19, + 19, + 15, + 132, + 3, + 11, + 24, + 26, + 1, + 18, + 24, + 11, + 50, + 3, + 2, + 0, + 38, + 47, + 14, + 24, + 31, + 15, + 2, + 36, + 9, + 28, + 13, + 15, + 2, + 2, + 11, + 16, + 8, + 26, + 9, + 135, + 44, + 23, + 16, + 25, + 1, + 2, + 16, + 33, + 16, + 41, + 20, + 30, + 11 + ], + "weighted_loads": [ + 3.28024110943079, + 0.1321620400995016, + 2.724891722202301, + 4.823419565334916, + 0.19418259523808956, + 0.7360701262950897, + 1.6774280052632093, + 1.6222310103476048, + 0.16114817932248116, + 0.2046052534133196, + 0.5164123512804508, + 0.31091578118503094, + 1.6706259232014418, + 0.5999535694718361, + 0.7339713666588068, + 0.8814326096326113, + 0.8621827699244022, + 0.56495201587677, + 8.603614555671811, + 0.0868669543415308, + 0.5235926397144794, + 1.2818541340529919, + 1.6312138624489307, + 0.03752576932311058, + 0.6923454292118549, + 1.2189305629581213, + 0.34879832714796066, + 3.4419819116592407, + 0.11804305389523506, + 0.05999898351728916, + 0.0, + 2.39791795052588, + 3.0469153970479965, + 0.8426896128803492, + 1.3803134709596634, + 2.2723190244287252, + 0.5918316654860973, + 0.0718616396188736, + 2.0908928215503693, + 0.36418948136270046, + 1.45657130330801, + 0.6017106380313635, + 0.6451852675527334, + 0.0709795318543911, + 0.07432811707258224, + 0.9769945032894611, + 0.798226723447442, + 0.24822210893034935, + 4.220833465456963, + 0.33048655092716217, + 8.543587576597929, + 1.7570428550243378, + 1.0084786918014288, + 0.7607898265123367, + 1.3750941418111324, + 0.02919396571815014, + 0.08398062735795975, + 0.7432990167289972, + 1.20637427829206, + 0.6470979731529951, + 2.118929885327816, + 1.0158173721283674, + 1.6066674198955297, + 0.4912002570927143 + ], + "unique_experts": 63, + "load_cv": 1.1042018368468396, + "normalized_load_entropy": 0.8928636134189473, + "max_load_share": 0.09036144578313253 + }, + "full_input": { + "tokens": 274, + "top_k": 6, + "decisions": 1644, + "ordered_route_sha256": "22a2a1654af0625d16bf3b8dae8e105802c0ff1ed828cc3f8a99c633ea66d79f", + "route_weight_sha256": "d0b4238c4638063c1aa4673ed5207e417a8de1ed35e435551dde2d816cf64b3d", + "loads": [ + 40, + 9, + 58, + 96, + 7, + 17, + 57, + 23, + 4, + 10, + 21, + 11, + 35, + 12, + 21, + 25, + 19, + 16, + 133, + 4, + 11, + 27, + 26, + 2, + 21, + 24, + 14, + 51, + 3, + 16, + 0, + 38, + 47, + 19, + 25, + 31, + 18, + 3, + 36, + 10, + 28, + 16, + 18, + 4, + 12, + 21, + 18, + 9, + 28, + 9, + 136, + 44, + 26, + 20, + 27, + 1, + 6, + 17, + 38, + 21, + 42, + 21, + 30, + 12 + ], + "weighted_loads": [ + 3.28024110943079, + 0.3929388802498579, + 2.79354128241539, + 4.823419565334916, + 0.24176555313169956, + 0.7671272791922092, + 3.226767363026738, + 1.6222310103476048, + 0.16114817932248116, + 0.3851615693420172, + 1.14403167180717, + 0.5102062877267599, + 1.6706259232014418, + 0.5999535694718361, + 0.7339713666588068, + 1.1909404154866934, + 0.8621827699244022, + 0.599582877010107, + 8.64425259269774, + 0.12807496823370457, + 0.5235926397144794, + 1.4362824596464634, + 1.6312138624489307, + 0.08226978406310081, + 0.8300336506217718, + 1.2189305629581213, + 0.4748618081212044, + 3.5088983699679375, + 0.11804305389523506, + 0.9241624306887388, + 0.0, + 2.39791795052588, + 3.0469153970479965, + 1.5162264425307512, + 1.4031134750694036, + 2.2723190244287252, + 0.7729059122502804, + 0.10553663969039917, + 2.0908928215503693, + 0.39896238036453724, + 1.45657130330801, + 0.7355641555041075, + 0.8060401398688555, + 0.1852041520178318, + 0.8368437327444553, + 1.9456874057650566, + 0.8647566605359316, + 0.6099284552037716, + 4.285331606864929, + 0.33048655092716217, + 8.579496752470732, + 1.7570428550243378, + 1.1196313966065645, + 0.9638282842934132, + 1.4631420243531466, + 0.02919396571815014, + 0.3648706376552582, + 0.7776029538363218, + 1.4378122556954622, + 0.8893003854900599, + 2.154865477234125, + 1.0452173221856356, + 1.6066674198955297, + 0.5286273695528507 + ], + "unique_experts": 63, + "load_cv": 0.9907397978858645, + "normalized_load_entropy": 0.9129887028947649, + "max_load_share": 0.0827250608272506 + } + }, + "s1_bos": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "87fe8d416371cdbc714fffe8919ccd815460ed6ee5174270a00e8e9b5f16621e", + "route_weight_sha256": "1d2105c287c09b7c8e75dbf88896ce58897f935a336502c6ee5a7dae0ea90bfa", + "loads": [ + 41, + 3, + 58, + 93, + 6, + 14, + 43, + 22, + 5, + 3, + 8, + 6, + 37, + 13, + 19, + 23, + 21, + 12, + 133, + 2, + 13, + 23, + 27, + 2, + 14, + 24, + 11, + 50, + 3, + 2, + 0, + 38, + 49, + 14, + 26, + 31, + 13, + 3, + 35, + 9, + 28, + 14, + 15, + 4, + 2, + 12, + 17, + 10, + 26, + 9, + 134, + 44, + 23, + 17, + 22, + 1, + 4, + 15, + 31, + 17, + 41, + 19, + 29, + 11 + ], + "weighted_loads": [ + 3.3132173884660006, + 0.10102837719023228, + 2.7857456933707, + 4.697861244902015, + 0.19308131746947765, + 0.6698435600847006, + 1.8236807603389025, + 1.6044003516435623, + 0.19232946448028088, + 0.11205386370420456, + 0.40697960183024406, + 0.28341889940202236, + 1.7293570507317781, + 0.6405289769172668, + 0.6686529163271189, + 1.0119657907634974, + 0.9286387804895639, + 0.46165680326521397, + 8.771255441009998, + 0.053327616304159164, + 0.5840626060962677, + 1.2464866824448109, + 1.6780858524143696, + 0.06354394741356373, + 0.555590558797121, + 1.2335680704563856, + 0.3700783085078001, + 3.4305341504514217, + 0.11944480240345001, + 0.06051568686962128, + 0.0, + 2.3330356124788523, + 3.1570492405444384, + 0.8619820065796375, + 1.465732168406248, + 2.236622706055641, + 0.5267013628035784, + 0.09834442101418972, + 2.0494471695274115, + 0.3639283161610365, + 1.4536577016115189, + 0.6432279627770185, + 0.6475866995751858, + 0.13795098662376404, + 0.07595243491232395, + 1.0413264483213425, + 0.8354678191244602, + 0.30050342343747616, + 4.094625407829881, + 0.33138057589530945, + 8.524253390729427, + 1.762588219717145, + 1.0092894863337278, + 0.7972803078591824, + 1.2701807264238596, + 0.028858929872512817, + 0.15123773366212845, + 0.7141548432409763, + 1.155034314841032, + 0.6864892933517694, + 2.129017822444439, + 0.9862818904221058, + 1.5736020058393478, + 0.5001200847327709 + ], + "unique_experts": 63, + "load_cv": 1.1030846687575204, + "normalized_load_entropy": 0.8931758974269275, + "max_load_share": 0.08969210174029452 + }, + "full_input": { + "tokens": 290, + "top_k": 6, + "decisions": 1740, + "ordered_route_sha256": "49f07671e3a187a2fd0b1da71d0549e435ee6b92780526b0498a928e80fbee60", + "route_weight_sha256": "d7dcdb744c1c1ec0ed6db2ffa6c98d9c460877f2fa991b6ebeef94b5472ae9f7", + "loads": [ + 46, + 8, + 59, + 93, + 6, + 15, + 72, + 22, + 5, + 6, + 19, + 18, + 37, + 13, + 19, + 30, + 21, + 14, + 135, + 5, + 13, + 28, + 27, + 6, + 18, + 24, + 15, + 51, + 3, + 21, + 8, + 39, + 49, + 25, + 29, + 32, + 20, + 4, + 36, + 10, + 30, + 19, + 23, + 5, + 18, + 23, + 18, + 12, + 28, + 13, + 135, + 44, + 26, + 19, + 24, + 3, + 8, + 27, + 38, + 21, + 42, + 21, + 29, + 13 + ], + "weighted_loads": [ + 3.5151161830872297, + 0.3837872054427862, + 2.8333913031965494, + 4.697861244902015, + 0.19308131746947765, + 0.7056044135242701, + 4.325188212096691, + 1.6044003516435623, + 0.19232946448028088, + 0.25333756394684315, + 1.1327325068414211, + 1.074733255431056, + 1.7293570507317781, + 0.6405289769172668, + 0.6686529163271189, + 1.3840507995337248, + 0.9286387804895639, + 0.5318913776427507, + 8.83800095319748, + 0.1750861071050167, + 0.5840626060962677, + 1.5220297407358885, + 1.6780858524143696, + 0.2273771297186613, + 0.7716161925345659, + 1.2335680704563856, + 0.524965787306428, + 3.4899379312992096, + 0.11944480240345001, + 1.5999071039259434, + 0.4509882256388664, + 2.3727118726819754, + 3.1570492405444384, + 2.0419229939579964, + 1.6929749567061663, + 2.2906064353883266, + 0.9275602288544178, + 0.13169440440833569, + 2.0913362372666597, + 0.40554156713187695, + 1.5374509543180466, + 0.880563685670495, + 1.328093484044075, + 0.21332156658172607, + 1.3163217771798372, + 2.005582023411989, + 0.8759145624935627, + 0.7011351827532053, + 4.3492181692272425, + 0.532794788479805, + 8.56043592095375, + 1.762588219717145, + 1.1096611749380827, + 0.8788385689258575, + 1.3403696808964014, + 0.1014610081911087, + 0.3380514942109585, + 1.4502554778009653, + 1.4394848309457302, + 0.8827436659485102, + 2.156810687854886, + 1.0739467702805996, + 1.5736020058393478, + 0.5889823846518993 + ], + "unique_experts": 64, + "load_cv": 0.9344961896929634, + "normalized_load_entropy": 0.9229727159524008, + "max_load_share": 0.07758620689655173 + } + }, + "s0_x": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "04ae7aae68b6afaf3c21700c67bbef48b204ab63f79aaa919ffeed713bc26cf6", + "route_weight_sha256": "ae91e32505b4431afe10bf123248c7986ed7f3ec9fabc9aaf807356399140d2d", + "loads": [ + 42, + 4, + 57, + 97, + 4, + 16, + 37, + 25, + 3, + 7, + 8, + 7, + 36, + 13, + 21, + 22, + 18, + 12, + 134, + 4, + 13, + 23, + 28, + 1, + 14, + 24, + 11, + 50, + 3, + 3, + 0, + 39, + 47, + 14, + 25, + 33, + 13, + 3, + 37, + 8, + 28, + 14, + 17, + 5, + 3, + 11, + 15, + 6, + 26, + 9, + 133, + 45, + 22, + 16, + 26, + 1, + 2, + 12, + 32, + 15, + 43, + 18, + 30, + 9 + ], + "weighted_loads": [ + 3.2886550165712833, + 0.13081916607916355, + 2.7037470545619726, + 4.768550461158156, + 0.13947641104459763, + 0.7428082879632711, + 1.6807696744799614, + 1.6922011226415634, + 0.1291041113436222, + 0.22650893032550812, + 0.4147030059248209, + 0.3206138499081135, + 1.7053770553320646, + 0.6372431479394436, + 0.7704421896487474, + 0.9473558869212866, + 0.8200295586138964, + 0.4829965140670538, + 8.760214013978839, + 0.11360709369182587, + 0.574315682053566, + 1.2541802451014519, + 1.720011580735445, + 0.04022872447967529, + 0.5458965003490448, + 1.1940723098814487, + 0.3562723007053137, + 3.3952773064374924, + 0.11339854076504707, + 0.09343920275568962, + 0.0, + 2.3998337667435408, + 3.1047690995037556, + 0.8745923042297363, + 1.4178218338638544, + 2.312765058130026, + 0.5286999344825745, + 0.0926805529743433, + 2.1412210669368505, + 0.3431158494204283, + 1.4571158196777105, + 0.5997731238603592, + 0.7184578906744719, + 0.16894022934138775, + 0.10675883665680885, + 1.0045211538672447, + 0.7636256497353315, + 0.180974954739213, + 4.110856281593442, + 0.3222924545407295, + 8.447677740827203, + 1.765356870368123, + 0.9672431852668524, + 0.7450725585222244, + 1.3785650320351124, + 0.028764288872480392, + 0.07922101020812988, + 0.5987627245485783, + 1.1892677303403616, + 0.6079400256276131, + 2.1472253054380417, + 0.9348200093954802, + 1.611482534557581, + 0.4153228420764208 + ], + "unique_experts": 63, + "load_cv": 1.1116553238946465, + "normalized_load_entropy": 0.8917763250839733, + "max_load_share": 0.08969210174029452 + }, + "full_input": { + "tokens": 274, + "top_k": 6, + "decisions": 1644, + "ordered_route_sha256": "08591c9d8219aee905ef5f3021be79531bb47d24d9d5c1fe457a5d2d7373c4e6", + "route_weight_sha256": "3dc8784dcb2fd18ce4971dec54f311eeb71dc69e407798e3da6dbec34525157f", + "loads": [ + 42, + 8, + 57, + 97, + 4, + 17, + 55, + 25, + 3, + 9, + 19, + 12, + 36, + 13, + 21, + 29, + 18, + 13, + 135, + 5, + 13, + 26, + 28, + 1, + 19, + 24, + 14, + 51, + 3, + 16, + 0, + 39, + 47, + 20, + 26, + 33, + 17, + 4, + 37, + 9, + 28, + 17, + 20, + 6, + 15, + 22, + 18, + 7, + 27, + 9, + 134, + 45, + 25, + 19, + 28, + 1, + 5, + 13, + 37, + 20, + 44, + 19, + 30, + 10 + ], + "weighted_loads": [ + 3.2886550165712833, + 0.3203389700502157, + 2.7037470545619726, + 4.768550461158156, + 0.13947641104459763, + 0.7738654408603907, + 3.100982405245304, + 1.6922011226415634, + 0.1291041113436222, + 0.30355722084641457, + 1.0224643386900425, + 0.5681683570146561, + 1.7053770553320646, + 0.6372431479394436, + 0.7704421896487474, + 1.4762877020984888, + 0.8200295586138964, + 0.5176273752003908, + 8.800852051004767, + 0.15481510758399963, + 0.574315682053566, + 1.4123495034873486, + 1.720011580735445, + 0.04022872447967529, + 0.7724584881216288, + 1.1940723098814487, + 0.4823357816785574, + 3.4680870175361633, + 0.11339854076504707, + 0.89789704605937, + 0.0, + 2.3998337667435408, + 3.1047690995037556, + 1.5905431732535362, + 1.4406218379735947, + 2.312765058130026, + 0.7594310082495213, + 0.12635555304586887, + 2.1412210669368505, + 0.37788874842226505, + 1.4571158196777105, + 0.7399759739637375, + 0.8513342309743166, + 0.21442378126084805, + 0.9824467189610004, + 2.1755375526845455, + 0.8583157826215029, + 0.5426813010126352, + 4.142887180671096, + 0.3222924545407295, + 8.483586916700006, + 1.765356870368123, + 1.078395890071988, + 0.8824443183839321, + 1.4666129145771265, + 0.028764288872480392, + 0.2437523826956749, + 0.6385157592594624, + 1.4377588238567114, + 0.8501424379646778, + 2.207949113100767, + 0.9642199594527483, + 1.611482534557581, + 0.4527499545365572 + ], + "unique_experts": 63, + "load_cv": 0.9971247017025987, + "normalized_load_entropy": 0.9109394849960366, + "max_load_share": 0.08211678832116788 + } + }, + "s1_x": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "c4fb64e1a3e4a3daa43ca3f1ef2c903952f3ee0e910fe844683c837ca6ce05f4", + "route_weight_sha256": "730294e2d6c8f0ec591e9e06e63e798b4d8f5d9661d23079228386fc953a8fef", + "loads": [ + 43, + 4, + 58, + 91, + 5, + 15, + 41, + 26, + 7, + 4, + 8, + 8, + 37, + 13, + 17, + 21, + 22, + 12, + 128, + 4, + 12, + 23, + 30, + 0, + 14, + 25, + 12, + 49, + 3, + 1, + 0, + 39, + 48, + 14, + 25, + 32, + 13, + 2, + 35, + 9, + 29, + 14, + 17, + 5, + 4, + 12, + 17, + 12, + 26, + 8, + 130, + 48, + 21, + 17, + 24, + 1, + 3, + 15, + 27, + 16, + 40, + 19, + 29, + 10 + ], + "weighted_loads": [ + 3.318432155996561, + 0.12908070720732212, + 2.748023234307766, + 4.567636853083968, + 0.16401612386107445, + 0.683715621009469, + 1.7219138853251934, + 1.7400566171854734, + 0.25888899713754654, + 0.1399574764072895, + 0.4091319777071476, + 0.3395592290908098, + 1.7276023533195257, + 0.637000510469079, + 0.6111080460250378, + 0.9535716269165277, + 0.9461423140019178, + 0.4705283045768738, + 8.574852656573057, + 0.12468677200376987, + 0.5699853617697954, + 1.2670859396457672, + 1.802935654297471, + 0.0, + 0.5303680077195168, + 1.2640472035855055, + 0.37351823784410954, + 3.377778470516205, + 0.12065206840634346, + 0.03146512061357498, + 0.0, + 2.3612955026328564, + 3.1292854249477386, + 0.9034671187400818, + 1.446392834186554, + 2.2469719983637333, + 0.524317042902112, + 0.07977559231221676, + 2.0376620199531317, + 0.37926938384771347, + 1.5008704625070095, + 0.6569802481681108, + 0.719981612637639, + 0.1615891046822071, + 0.13579366356134415, + 1.0425005462020636, + 0.8624833840876818, + 0.37111178040504456, + 3.9913303647190332, + 0.3046422880142927, + 8.355673162266612, + 1.9251000061631203, + 0.9406108371913433, + 0.784462857991457, + 1.3306087590754032, + 0.02835102006793022, + 0.12399733066558838, + 0.7346565667539835, + 0.9891917314380407, + 0.6579202972352505, + 2.1088782250881195, + 0.9693353772163391, + 1.5861337184906006, + 0.4578837864100933 + ], + "unique_experts": 62, + "load_cv": 1.0728822937909837, + "normalized_load_entropy": 0.8964639661316437, + "max_load_share": 0.08701472556894244 + }, + "full_input": { + "tokens": 290, + "top_k": 6, + "decisions": 1740, + "ordered_route_sha256": "0d3c0e54fe2ea2d8d7947bd4b8d64b6800b2bf54ff7aab1e8766ca4822d68e02", + "route_weight_sha256": "5fea32083d259b7c3370ef2191b79773d7c09f88fce74cc191940d1e24bcf6f5", + "loads": [ + 48, + 7, + 58, + 91, + 5, + 16, + 68, + 26, + 7, + 5, + 17, + 19, + 37, + 13, + 17, + 29, + 22, + 14, + 130, + 7, + 12, + 28, + 30, + 3, + 19, + 25, + 17, + 50, + 3, + 21, + 8, + 40, + 48, + 26, + 28, + 33, + 20, + 3, + 36, + 10, + 31, + 20, + 25, + 5, + 22, + 24, + 19, + 14, + 28, + 12, + 131, + 48, + 24, + 19, + 26, + 4, + 6, + 28, + 33, + 20, + 42, + 22, + 29, + 12 + ], + "weighted_loads": [ + 3.5203309506177902, + 0.29389010556042194, + 2.748023234307766, + 4.567636853083968, + 0.16401612386107445, + 0.7194764744490385, + 3.924522155895829, + 1.7400566171854734, + 0.25888899713754654, + 0.1704800333827734, + 0.9647188745439053, + 1.08553365804255, + 1.7276023533195257, + 0.637000510469079, + 0.6111080460250378, + 1.4702477287501097, + 0.9461423140019178, + 0.5407628789544106, + 8.641598168760538, + 0.24644526280462742, + 0.5699853617697954, + 1.5374511238187551, + 1.802935654297471, + 0.12131549790501595, + 0.743853347375989, + 1.2640472035855055, + 0.5601036455482244, + 3.432177484035492, + 0.12065206840634346, + 1.549968235194683, + 0.4549858495593071, + 2.4009717628359795, + 3.1292854249477386, + 2.1019906513392925, + 1.6736356224864721, + 2.3009557276964188, + 0.9151677209883928, + 0.11312557570636272, + 2.07955108769238, + 0.4208826348185539, + 1.5846637152135372, + 0.9177280012518167, + 1.3770678583532572, + 0.1615891046822071, + 1.5023918747901917, + 2.152686083689332, + 0.9450660590082407, + 0.7717435397207737, + 4.245923126116395, + 0.5060565005987883, + 8.391855692490935, + 1.9251000061631203, + 1.0409825257956982, + 0.8660211190581322, + 1.400797713547945, + 0.14227935299277306, + 0.26856619492173195, + 1.5184850934892893, + 1.212866025045514, + 0.8541746698319912, + 2.1930878665298223, + 1.0917025171220303, + 1.5861337184906006, + 0.5467460863292217 + ], + "unique_experts": 64, + "load_cv": 0.9064557587339536, + "normalized_load_entropy": 0.9252380854821206, + "max_load_share": 0.07528735632183908 + } + }, + "s0_period": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "7dcd8c3176c28901c0d7a1c7da007ee568e3e78fa7c72b2a44a21b6a00157d40", + "route_weight_sha256": "1b36c080eb809f6e3861cf4f15e7618ed8a57317038c7095008efca0e19f267e", + "loads": [ + 43, + 4, + 55, + 96, + 3, + 15, + 41, + 25, + 4, + 9, + 8, + 6, + 37, + 13, + 19, + 21, + 20, + 14, + 135, + 3, + 12, + 24, + 28, + 0, + 15, + 25, + 11, + 49, + 4, + 2, + 0, + 40, + 48, + 14, + 25, + 33, + 13, + 2, + 35, + 9, + 26, + 15, + 17, + 5, + 2, + 12, + 16, + 4, + 26, + 9, + 131, + 44, + 21, + 16, + 26, + 1, + 3, + 12, + 31, + 16, + 42, + 19, + 31, + 9 + ], + "weighted_loads": [ + 3.312331799417734, + 0.12935779057443142, + 2.6658948082476854, + 4.722764750942588, + 0.10873089358210564, + 0.7088842019438744, + 1.8010814972221851, + 1.6938098948448896, + 0.16358653083443642, + 0.29510607197880745, + 0.41420813649892807, + 0.29278830625116825, + 1.7375356666743755, + 0.6389490067958832, + 0.7031707335263491, + 0.9028990920633078, + 0.8941569421440363, + 0.551547210663557, + 8.813844235613942, + 0.08501863665878773, + 0.5332255270332098, + 1.281219121068716, + 1.7415527552366257, + 0.0, + 0.5835443045943975, + 1.2347505409270525, + 0.3477286100387573, + 3.35812271758914, + 0.14837632700800896, + 0.059869199991226196, + 0.0, + 2.457140702754259, + 3.1449962314218283, + 0.869551369920373, + 1.408583376556635, + 2.287579867988825, + 0.5304886251688004, + 0.07144495658576488, + 2.077530248090625, + 0.3705174010246992, + 1.3953188806772232, + 0.6568648740649223, + 0.721419295296073, + 0.15539403818547726, + 0.0785125344991684, + 1.049471551552415, + 0.8148149456828833, + 0.11324500106275082, + 4.077409768477082, + 0.3283999413251877, + 8.403493190184236, + 1.7462117075920105, + 0.9317404497414827, + 0.7495474629104137, + 1.3751932550221682, + 0.02908266708254814, + 0.1097182184457779, + 0.6142749506980181, + 1.1537793278694153, + 0.6431367136538029, + 2.1120726503431797, + 0.9965716674923897, + 1.643188014626503, + 0.4226956404745579 + ], + "unique_experts": 62, + "load_cv": 1.1068473537560999, + "normalized_load_entropy": 0.8912322708218606, + "max_load_share": 0.09036144578313253 + }, + "full_input": { + "tokens": 274, + "top_k": 6, + "decisions": 1644, + "ordered_route_sha256": "3fa77b64b66454b6ed44694ff13c28a29265924dcb7a0710c6060fe0672292e4", + "route_weight_sha256": "db236b51518ee6a4f82d71fab84c7a41818a10a497da0c0493bcce16ea35151c", + "loads": [ + 43, + 9, + 55, + 96, + 3, + 16, + 58, + 25, + 4, + 11, + 18, + 11, + 37, + 13, + 20, + 27, + 20, + 15, + 136, + 4, + 12, + 27, + 28, + 0, + 19, + 25, + 14, + 50, + 4, + 16, + 0, + 40, + 48, + 21, + 26, + 33, + 18, + 3, + 35, + 10, + 26, + 19, + 20, + 7, + 13, + 22, + 18, + 5, + 27, + 9, + 132, + 44, + 24, + 19, + 28, + 1, + 6, + 13, + 36, + 21, + 43, + 20, + 31, + 10 + ], + "weighted_loads": [ + 3.312331799417734, + 0.5011122431606054, + 2.6658948082476854, + 4.722764750942588, + 0.10873089358210564, + 0.7399413548409939, + 3.2336863093078136, + 1.6938098948448896, + 0.16358653083443642, + 0.3721543624997139, + 1.0468247774988413, + 0.5548009928315878, + 1.7375356666743755, + 0.6389490067958832, + 0.7364533636718988, + 1.2124068979173899, + 0.8941569421440363, + 0.5861780717968941, + 8.85448227263987, + 0.1262266505509615, + 0.5332255270332098, + 1.4349344745278358, + 1.7415527552366257, + 0.0, + 0.8493817448616028, + 1.2347505409270525, + 0.47379209101200104, + 3.444023858755827, + 0.14837632700800896, + 0.9358630441129208, + 0.0, + 2.457140702754259, + 3.1449962314218283, + 1.6352287400513887, + 1.4313833806663752, + 2.287579867988825, + 0.8105847463011742, + 0.10511995665729046, + 2.077530248090625, + 0.405290300026536, + 1.3953188806772232, + 0.8410791233181953, + 0.8477223124355078, + 0.26439023576676846, + 0.8848417103290558, + 2.0181644540280104, + 0.8813448827713728, + 0.47495134733617306, + 4.109440667554736, + 0.3283999413251877, + 8.439402366057038, + 1.7462117075920105, + 1.0428931545466185, + 0.8869192227721214, + 1.4632411375641823, + 0.02908266708254814, + 0.2742495909333229, + 0.6584860477596521, + 1.3783021122217178, + 0.8853391259908676, + 2.166625250130892, + 1.0259716175496578, + 1.643188014626503, + 0.4601227529346943 + ], + "unique_experts": 62, + "load_cv": 0.992411460167688, + "normalized_load_entropy": 0.9110854863551735, + "max_load_share": 0.0827250608272506 + } + }, + "s1_period": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "4bee9d7d6d94ef6b7dac36aaf73e8d9c03dee915bf80a25b9686d4f8b4228421", + "route_weight_sha256": "a37602143da812ebf530f30acaadbf885a7cce03d1b4cbb6da87ba072bc9c41a", + "loads": [ + 42, + 5, + 57, + 94, + 4, + 13, + 40, + 25, + 7, + 3, + 7, + 7, + 38, + 14, + 16, + 22, + 21, + 14, + 132, + 2, + 13, + 23, + 28, + 0, + 13, + 25, + 9, + 47, + 3, + 2, + 0, + 39, + 48, + 14, + 26, + 33, + 13, + 3, + 34, + 8, + 29, + 15, + 16, + 3, + 4, + 13, + 18, + 9, + 26, + 9, + 131, + 49, + 21, + 16, + 24, + 1, + 4, + 14, + 30, + 16, + 40, + 19, + 31, + 12 + ], + "weighted_loads": [ + 3.290038540959358, + 0.16855715215206146, + 2.771142017096281, + 4.692642284557223, + 0.13582057878375053, + 0.6152730397880077, + 1.6922095604240894, + 1.721235167235136, + 0.2609621826559305, + 0.10528990440070629, + 0.37309881299734116, + 0.3039586506783962, + 1.7541456669569016, + 0.6772122140973806, + 0.5664900578558445, + 0.9625298362225294, + 0.9244634602218866, + 0.5465766750276089, + 8.776342561468482, + 0.054762182757258415, + 0.5978350080549717, + 1.2654336020350456, + 1.7345094121992588, + 0.0, + 0.5070585962384939, + 1.2782070618122816, + 0.2938368283212185, + 3.342826385051012, + 0.12125534936785698, + 0.06703976169228554, + 0.0, + 2.3615440782159567, + 3.1421057134866714, + 0.9005211684852839, + 1.4803608022630215, + 2.2971117179840803, + 0.5263718292117119, + 0.0980773214250803, + 2.013902824372053, + 0.3480997830629349, + 1.5067921746522188, + 0.6905614472925663, + 0.6806011758744717, + 0.1022201869636774, + 0.1476689726114273, + 1.1136363502591848, + 0.8890134170651436, + 0.27255346812307835, + 4.0485561061650515, + 0.33159066922962666, + 8.414066530764103, + 1.972389928996563, + 0.9493153616786003, + 0.7539388760924339, + 1.3508133813738823, + 0.028440097346901894, + 0.1489098183810711, + 0.7157264221459627, + 1.0745465569198132, + 0.6621571350842714, + 2.1065804455429316, + 0.9800459519028664, + 1.6503356229513884, + 0.5342556964606047 + ], + "unique_experts": 62, + "load_cv": 1.093739297835309, + "normalized_load_entropy": 0.893461117258912, + "max_load_share": 0.08835341365461848 + }, + "full_input": { + "tokens": 290, + "top_k": 6, + "decisions": 1740, + "ordered_route_sha256": "93f06b91d37dcc96a9f2c76f8750571efa7f65702cea67b954056bba862e0d8f", + "route_weight_sha256": "9a09de94304a87fa095d26177ad1d63da59c8d1b7bc0aab5f5eee963deadd186", + "loads": [ + 47, + 9, + 57, + 94, + 4, + 14, + 67, + 25, + 7, + 4, + 17, + 19, + 39, + 14, + 16, + 29, + 21, + 16, + 134, + 5, + 13, + 28, + 28, + 3, + 17, + 25, + 13, + 48, + 3, + 23, + 8, + 41, + 48, + 27, + 29, + 34, + 19, + 4, + 35, + 9, + 31, + 21, + 24, + 4, + 22, + 25, + 19, + 11, + 28, + 13, + 132, + 49, + 24, + 18, + 26, + 3, + 7, + 27, + 35, + 20, + 42, + 21, + 31, + 14 + ], + "weighted_loads": [ + 3.4919373355805874, + 0.5066818855702877, + 2.771142017096281, + 4.692642284557223, + 0.13582057878375053, + 0.6510338932275772, + 3.870503870770335, + 1.721235167235136, + 0.2609621826559305, + 0.13581246137619019, + 1.0280309915542603, + 1.0820606276392937, + 1.7924464344978333, + 0.6772122140973806, + 0.5664900578558445, + 1.3346148449927568, + 0.9244634602218866, + 0.6168112494051456, + 8.843088073655963, + 0.17652067355811596, + 0.5978350080549717, + 1.5336036030203104, + 1.7345094121992588, + 0.12131549790501595, + 0.7955880425870419, + 1.2782070618122816, + 0.44872430711984634, + 3.4081937707960606, + 0.12125534936785698, + 1.6560869812965393, + 0.46484844386577606, + 2.4343773145228624, + 3.1421057134866714, + 2.152599399909377, + 1.7076035905629396, + 2.351095447316766, + 0.9059902429580688, + 0.13142730481922626, + 2.0557918921113014, + 0.38971303403377533, + 1.5905854273587465, + 0.9561494439840317, + 1.3271963372826576, + 0.1416787039488554, + 1.4927409179508686, + 2.1099159698933363, + 0.9294601604342461, + 0.6731852274388075, + 4.303148867562413, + 0.5330048818141222, + 8.450249060988426, + 1.972389928996563, + 1.0496870502829552, + 0.8354971371591091, + 1.421002335846424, + 0.10104217566549778, + 0.29347868263721466, + 1.5018398892134428, + 1.2539456635713577, + 0.8584115076810122, + 2.200691733509302, + 1.0677108317613602, + 1.6503356229513884, + 0.6231179963797331 + ], + "unique_experts": 64, + "load_cv": 0.9246267363994429, + "normalized_load_entropy": 0.9226460596069307, + "max_load_share": 0.07701149425287357 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 249, + "ordered_topk_exact_tokens": 162, + "set_exact_tokens": 200, + "mean_set_jaccard": 0.9420539300057371, + "mean_token_weighted_tv": 0.010608258036275705, + "aggregate_load_tv": 0.018072289156626512 + }, + "system_bos": { + "tokens": 249, + "ordered_topk_exact_tokens": 151, + "set_exact_tokens": 187, + "mean_set_jaccard": 0.9262765347102697, + "mean_token_weighted_tv": 0.013985059422302437, + "aggregate_load_tv": 0.024765729585006682 + }, + "system_x": { + "tokens": 249, + "ordered_topk_exact_tokens": 138, + "set_exact_tokens": 163, + "mean_set_jaccard": 0.89720787913559, + "mean_token_weighted_tv": 0.01937464347490704, + "aggregate_load_tv": 0.030789825970548863 + }, + "system_period": { + "tokens": 249, + "ordered_topk_exact_tokens": 118, + "set_exact_tokens": 155, + "mean_set_jaccard": 0.8843947217441191, + "mean_token_weighted_tv": 0.020746180847526555, + "aggregate_load_tv": 0.026104417670682726 + }, + "bos_at_s0": { + "tokens": 249, + "ordered_topk_exact_tokens": 129, + "set_exact_tokens": 170, + "mean_set_jaccard": 0.9067699368904186, + "mean_token_weighted_tv": 0.01726612748286451, + "aggregate_load_tv": 0.024096385542168676 + }, + "bos_at_s1": { + "tokens": 249, + "ordered_topk_exact_tokens": 116, + "set_exact_tokens": 153, + "mean_set_jaccard": 0.8855421686746988, + "mean_token_weighted_tv": 0.020702625561251218, + "aggregate_load_tv": 0.03145917001338689 + }, + "x_at_s0": { + "tokens": 249, + "ordered_topk_exact_tokens": 124, + "set_exact_tokens": 166, + "mean_set_jaccard": 0.90390131956397, + "mean_token_weighted_tv": 0.017933540610993004, + "aggregate_load_tv": 0.026773761713520753 + }, + "x_at_s1": { + "tokens": 249, + "ordered_topk_exact_tokens": 106, + "set_exact_tokens": 143, + "mean_set_jaccard": 0.867374258940524, + "mean_token_weighted_tv": 0.023775956997401024, + "aggregate_load_tv": 0.03346720214190093 + }, + "period_at_s0": { + "tokens": 249, + "ordered_topk_exact_tokens": 117, + "set_exact_tokens": 154, + "mean_set_jaccard": 0.8866896156052783, + "mean_token_weighted_tv": 0.020174542082900024, + "aggregate_load_tv": 0.028112449799196786 + }, + "period_at_s1": { + "tokens": 249, + "ordered_topk_exact_tokens": 108, + "set_exact_tokens": 141, + "mean_set_jaccard": 0.865748709122203, + "mean_token_weighted_tv": 0.02400836522455316, + "aggregate_load_tv": 0.030120481927710833 + } + } + }, + "layer_14": { + "layer": 14, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "36dc57379fbc8d6c521410c5ff80c3217242021bed10ced34a85f5c0e3371853", + "route_weight_sha256": "808c2dd9ed9e76497c5d3ff9a3f98cc790d453c2aadc977fde9c738d656f2aa6", + "loads": [ + 27, + 40, + 71, + 45, + 34, + 17, + 38, + 20, + 38, + 8, + 12, + 9, + 9, + 9, + 19, + 30, + 38, + 34, + 40, + 28, + 37, + 32, + 2, + 8, + 26, + 37, + 5, + 8, + 4, + 52, + 36, + 23, + 20, + 2, + 55, + 20, + 5, + 26, + 22, + 34, + 2, + 29, + 33, + 1, + 25, + 20, + 11, + 29, + 47, + 10, + 7, + 9, + 15, + 3, + 34, + 10, + 0, + 36, + 24, + 19, + 41, + 30, + 33, + 6 + ], + "weighted_loads": [ + 2.853456722572446, + 1.7879453506320715, + 3.5553147103637457, + 1.916865274310112, + 2.4313213489949703, + 0.6440275330096483, + 2.6448793206363916, + 0.7777623981237411, + 2.455466927960515, + 0.34652567841112614, + 0.5763850938528776, + 0.36942202411592007, + 0.3395526874810457, + 0.4679502435028553, + 0.746103061363101, + 1.5596690718084574, + 1.6859038453549147, + 1.762234354391694, + 2.3623598609119654, + 2.8314942810684443, + 2.7386869192123413, + 1.696936510503292, + 0.05846144258975983, + 0.32657469250261784, + 1.486172392964363, + 1.9814328774809837, + 0.1597967017441988, + 0.3847804758697748, + 0.14118501730263233, + 2.7587013132870197, + 2.22250060364604, + 0.8282091468572617, + 1.58332952670753, + 0.07542003504931927, + 3.1794732436537743, + 1.162445055320859, + 0.22779458574950695, + 1.2174204774200916, + 1.5220654401928186, + 2.164578892290592, + 0.062337325885891914, + 1.7981169577687979, + 2.0701340194791555, + 0.028797131031751633, + 1.0433248076587915, + 0.8333772551268339, + 0.616092823445797, + 1.989826126024127, + 4.4238466788083315, + 0.47600600123405457, + 0.21783971413969994, + 0.33525294065475464, + 0.7967817727476358, + 0.22144125401973724, + 2.2787306047976017, + 0.684227641671896, + 0.0, + 1.9923493806272745, + 0.9516304787248373, + 0.7263412289321423, + 2.5383386500179768, + 1.3461660780012608, + 2.709337428212166, + 0.2274454440921545 + ], + "unique_experts": 63, + "load_cv": 0.6568785704095166, + "normalized_load_entropy": 0.9427497819997555, + "max_load_share": 0.04752342704149933 + }, + "full_input": { + "tokens": 274, + "top_k": 6, + "decisions": 1644, + "ordered_route_sha256": "6476e831586453ed77959aec8c265e49b207927eaf14cd738ec4225d6fff0512", + "route_weight_sha256": "217db2995def29223a0f256f08643be6dc651ab402e31b2a83fd0934af98f3cb", + "loads": [ + 33, + 40, + 71, + 46, + 34, + 29, + 38, + 22, + 38, + 15, + 14, + 12, + 9, + 9, + 19, + 35, + 38, + 34, + 46, + 30, + 37, + 33, + 2, + 19, + 27, + 38, + 11, + 15, + 12, + 52, + 39, + 27, + 20, + 9, + 55, + 20, + 5, + 27, + 24, + 34, + 2, + 29, + 34, + 1, + 27, + 20, + 16, + 32, + 47, + 10, + 10, + 15, + 21, + 10, + 34, + 14, + 1, + 36, + 24, + 32, + 41, + 31, + 33, + 6 + ], + "weighted_loads": [ + 3.5175018198788166, + 1.7879453506320715, + 3.5553147103637457, + 1.9571692608296871, + 2.4313213489949703, + 1.6838777679949999, + 2.6448793206363916, + 0.8505500443279743, + 2.455466927960515, + 0.9921553265303373, + 0.6416783705353737, + 0.5563340727239847, + 0.3395526874810457, + 0.4679502435028553, + 0.746103061363101, + 1.8804539050906897, + 1.6859038453549147, + 1.762234354391694, + 2.7136877719312906, + 2.9148207027465105, + 2.7386869192123413, + 1.8096031323075294, + 0.05846144258975983, + 0.8026556614786386, + 1.5088762529194355, + 2.0169830545783043, + 0.48813720792531967, + 0.8012892445549369, + 1.2018257323652506, + 2.7587013132870197, + 2.409074168652296, + 0.9876065235584974, + 1.58332952670753, + 0.6123468894511461, + 3.1794732436537743, + 1.162445055320859, + 0.22779458574950695, + 1.2611987963318825, + 1.6421272102743387, + 2.164578892290592, + 0.062337325885891914, + 1.7981169577687979, + 2.1211301255971193, + 0.028797131031751633, + 1.1076517552137375, + 0.8333772551268339, + 0.9190730638802052, + 2.1199221294373274, + 4.4238466788083315, + 0.47600600123405457, + 0.33514704927802086, + 1.6504914946854115, + 1.5395036730915308, + 0.6938800364732742, + 2.2787306047976017, + 1.042746428400278, + 0.0400494821369648, + 1.9923493806272745, + 0.9516304787248373, + 1.32229670509696, + 2.5383386500179768, + 1.3511644266545773, + 2.709337428212166, + 0.2274454440921545 + ], + "unique_experts": 64, + "load_cv": 0.5622017662791745, + "normalized_load_entropy": 0.9579743490443364, + "max_load_share": 0.04318734793187348 + } + }, + "s1_eos": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "5e40a1e9c651cccecbcf03370936e98b59882ebfe4cbb428d7295ec44ce94a7b", + "route_weight_sha256": "5b8491db4240f600339a0c3c9322d63a7b3ac94386d9a6788b95b95334dfcabf", + "loads": [ + 26, + 40, + 75, + 47, + 34, + 16, + 37, + 20, + 38, + 9, + 12, + 9, + 9, + 9, + 17, + 30, + 42, + 33, + 35, + 27, + 38, + 32, + 3, + 9, + 26, + 38, + 4, + 8, + 4, + 52, + 37, + 23, + 20, + 1, + 53, + 21, + 5, + 26, + 22, + 34, + 2, + 30, + 33, + 1, + 28, + 17, + 11, + 29, + 46, + 11, + 5, + 9, + 15, + 3, + 38, + 10, + 0, + 34, + 22, + 18, + 40, + 33, + 32, + 6 + ], + "weighted_loads": [ + 2.7888189274817705, + 1.7686913330107927, + 3.7079155445098877, + 1.9921375047415495, + 2.427833456546068, + 0.6379333604127169, + 2.5910125989466906, + 0.7879873048514128, + 2.467883113771677, + 0.39273485727608204, + 0.5786198079586029, + 0.3675986956804991, + 0.3430491629987955, + 0.464007256552577, + 0.6722393576055765, + 1.5628018211573362, + 1.8228431306779385, + 1.7353418357670307, + 2.219149973243475, + 2.7453736253082752, + 2.7642800714820623, + 1.6591046005487442, + 0.09334440156817436, + 0.35540648736059666, + 1.4918909445405006, + 2.018553914502263, + 0.12817291915416718, + 0.39167424105107784, + 0.13845484517514706, + 2.7625002823770046, + 2.267128899693489, + 0.8402894772589207, + 1.5750248227268457, + 0.04860800877213478, + 3.122175270691514, + 1.1893689446151257, + 0.22931494563817978, + 1.23901860229671, + 1.5114795602858067, + 2.146338628605008, + 0.06100155971944332, + 1.8341784868389368, + 2.059254679828882, + 0.029265329241752625, + 1.151207597926259, + 0.730527974665165, + 0.5966329388320446, + 1.970119096338749, + 4.39583976007998, + 0.5055840127170086, + 0.15919539704918861, + 0.3188021145761013, + 0.7959813252091408, + 0.21815283223986626, + 2.4160883352160454, + 0.6840187162160873, + 0.0, + 1.9085705541074276, + 0.8704573158174753, + 0.7058862634003162, + 2.5078026242554188, + 1.4424055963754654, + 2.664872385561466, + 0.23113935440778732 + ], + "unique_experts": 63, + "load_cv": 0.66783095377873, + "normalized_load_entropy": 0.9413118473513507, + "max_load_share": 0.050200803212851405 + }, + "full_input": { + "tokens": 290, + "top_k": 6, + "decisions": 1740, + "ordered_route_sha256": "f6f2a5d3d5b9c443fff280df9dcc2ccbdb79f8f041563393dfd5ca5383723b12", + "route_weight_sha256": "d1ef31ef71ffa4bb8b2f6c28470e9687b2b7c3bbb58b9ab45ef7b7ea96d25e7d", + "loads": [ + 34, + 41, + 75, + 49, + 38, + 34, + 37, + 24, + 40, + 20, + 12, + 12, + 15, + 9, + 17, + 36, + 42, + 33, + 43, + 32, + 40, + 37, + 3, + 18, + 31, + 41, + 9, + 16, + 17, + 53, + 42, + 27, + 22, + 12, + 54, + 22, + 5, + 29, + 25, + 35, + 2, + 30, + 34, + 2, + 30, + 17, + 18, + 31, + 48, + 12, + 19, + 11, + 23, + 12, + 40, + 13, + 1, + 35, + 23, + 37, + 43, + 35, + 34, + 9 + ], + "weighted_loads": [ + 3.5591191202402115, + 1.8195646721869707, + 3.7079155445098877, + 2.072236543521285, + 2.675626628100872, + 1.8911421541124582, + 2.5910125989466906, + 0.9522472601383924, + 2.6333519630134106, + 1.3292303290218115, + 0.5786198079586029, + 0.5824488531798124, + 0.735288580879569, + 0.464007256552577, + 0.6722393576055765, + 1.9331531208008528, + 1.8228431306779385, + 1.7353418357670307, + 2.713264027610421, + 2.987774493172765, + 2.996695702895522, + 1.914923993870616, + 0.09334440156817436, + 0.7401609774678946, + 1.7334940619766712, + 2.1267291381955147, + 0.4865112975239754, + 0.6978141693398356, + 1.6977016311138868, + 2.81129103153944, + 2.50995422154665, + 0.9563175328075886, + 1.6542635913938284, + 1.0803982950747013, + 3.1699970718473196, + 1.2687503509223461, + 0.22931494563817978, + 1.5906188990920782, + 1.7156320624053478, + 2.20501602627337, + 0.06100155971944332, + 1.8341784868389368, + 2.1126059107482433, + 0.07555747032165527, + 1.2111584097146988, + 0.730527974665165, + 1.0001299735158682, + 2.0382594242691994, + 4.523342652246356, + 0.5394199565052986, + 1.0551894046366215, + 1.505895670503378, + 1.5899257883429527, + 0.9056199230253696, + 2.49965276196599, + 0.9597478434443474, + 0.05180708318948746, + 1.9470280818641186, + 0.9787434656172991, + 1.7770646996796131, + 2.7589176073670387, + 1.4883642587810755, + 2.7665150426328182, + 0.3383004106581211 + ], + "unique_experts": 64, + "load_cv": 0.5433803952393811, + "normalized_load_entropy": 0.9608308752805954, + "max_load_share": 0.04310344827586207 + } + }, + "s0_bos": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "a6ca219abea7206e288d817fd0b995e1042e2abebcd5c3ea0f6a8b81e9d875d9", + "route_weight_sha256": "3fda6958207c2cf8e1796656bd049b08b534d24f9aa2b59d8d901eccee27a7d6", + "loads": [ + 25, + 41, + 73, + 49, + 34, + 11, + 37, + 20, + 37, + 9, + 12, + 7, + 9, + 9, + 19, + 29, + 41, + 33, + 38, + 27, + 38, + 33, + 2, + 10, + 27, + 37, + 3, + 8, + 5, + 52, + 37, + 22, + 19, + 2, + 52, + 21, + 8, + 25, + 22, + 35, + 3, + 30, + 31, + 1, + 32, + 21, + 14, + 29, + 45, + 10, + 6, + 7, + 13, + 3, + 38, + 10, + 0, + 34, + 22, + 18, + 40, + 29, + 34, + 6 + ], + "weighted_loads": [ + 2.8230838403105736, + 1.8032937534153461, + 3.638540668413043, + 2.025508688762784, + 2.427884988486767, + 0.4687341619282961, + 2.5914539452642202, + 0.7844048049300909, + 2.402451928704977, + 0.39825304970145226, + 0.5676224157214165, + 0.31796687841415405, + 0.34047785215079784, + 0.43641883693635464, + 0.7251090258359909, + 1.58962831646204, + 1.7656015865504742, + 1.738768994808197, + 2.230492500588298, + 2.839879021048546, + 2.7603012155741453, + 1.7623076271265745, + 0.0598421823233366, + 0.38706303760409355, + 1.558024162426591, + 1.969326937571168, + 0.10130463540554047, + 0.38914965465664864, + 0.17344128899276257, + 2.7758279349654913, + 2.284979574382305, + 0.7798645924776793, + 1.5535581707954407, + 0.07964570075273514, + 3.05324799194932, + 1.1958658900111914, + 0.32035224325954914, + 1.2267124131321907, + 1.4919333942234516, + 2.243313318118453, + 0.08655097335577011, + 1.8436164669692516, + 2.019372083246708, + 0.027766307815909386, + 1.2843085695058107, + 0.8678001370280981, + 0.7231636848300695, + 2.0247129946947098, + 4.359013129025698, + 0.48996006697416306, + 0.19747296907007694, + 0.25890470668673515, + 0.7487287279218435, + 0.1985347457230091, + 2.442978659644723, + 0.6827312745153904, + 0.0, + 1.915778025984764, + 0.8896280825138092, + 0.6922041494399309, + 2.5492867678403854, + 1.312343304976821, + 2.7269126772880554, + 0.23323174752295017 + ], + "unique_experts": 63, + "load_cv": 0.6635667675825639, + "normalized_load_entropy": 0.9420296333971583, + "max_load_share": 0.048862115127175365 + }, + "full_input": { + "tokens": 274, + "top_k": 6, + "decisions": 1644, + "ordered_route_sha256": "61b0cc08e1b6991eab5de128eb05c07b8ad043a55b7b1f49159ecac54cc1ff4a", + "route_weight_sha256": "f9db1e8b59dcabf7ec5a7736c2e6b191cc42807515307886514299b5d3beed4e", + "loads": [ + 31, + 41, + 73, + 52, + 34, + 23, + 37, + 21, + 37, + 17, + 14, + 10, + 9, + 9, + 19, + 34, + 41, + 33, + 45, + 29, + 38, + 34, + 2, + 20, + 28, + 38, + 9, + 13, + 14, + 52, + 40, + 27, + 19, + 8, + 52, + 21, + 8, + 27, + 24, + 35, + 3, + 30, + 31, + 1, + 35, + 21, + 19, + 31, + 45, + 10, + 8, + 12, + 19, + 10, + 38, + 14, + 1, + 35, + 23, + 31, + 40, + 29, + 34, + 6 + ], + "weighted_loads": [ + 3.4871289376169443, + 1.8032937534153461, + 3.638540668413043, + 2.1453255470842123, + 2.427884988486767, + 1.4827595334500074, + 2.5914539452642202, + 0.8179519902914762, + 2.402451928704977, + 1.1069596037268639, + 0.6329156924039125, + 0.5048789270222187, + 0.34047785215079784, + 0.43641883693635464, + 0.7251090258359909, + 1.9609695449471474, + 1.7656015865504742, + 1.738768994808197, + 2.662858324125409, + 2.926968440413475, + 2.7603012155741453, + 1.8790334146469831, + 0.0598421823233366, + 0.8356034513562918, + 1.5807280223816633, + 2.0051942002028227, + 0.42964514158666134, + 0.781180726364255, + 1.3454155083745718, + 2.7758279349654913, + 2.4795306734740734, + 1.0213523041456938, + 1.5535581707954407, + 0.5916307680308819, + 3.05324799194932, + 1.1958658900111914, + 0.32035224325954914, + 1.3098358511924744, + 1.6166875883936882, + 2.243313318118453, + 0.08655097335577011, + 1.8436164669692516, + 2.019372083246708, + 0.027766307815909386, + 1.427092395722866, + 0.8678001370280981, + 1.0105759035795927, + 2.1111035272479057, + 4.359013129025698, + 0.48996006697416306, + 0.2834834661334753, + 0.732874047011137, + 1.4914506282657385, + 0.6709735281765461, + 2.442978659644723, + 1.080482054501772, + 0.0400494821369648, + 1.9604025296866894, + 0.9340192712843418, + 1.2888029981404543, + 2.5492867678403854, + 1.312343304976821, + 2.7269126772880554, + 0.23323174752295017 + ], + "unique_experts": 64, + "load_cv": 0.5701067932694447, + "normalized_load_entropy": 0.9573061352458586, + "max_load_share": 0.04440389294403893 + } + }, + "s1_bos": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "da4c96b2261e9657872e456a0e98d21f23ffa0190f8848cb3fb3971dcadf5e2d", + "route_weight_sha256": "8d5fb0ed931de7d90f4fa90fef06a4fcf2b9851f63bb8a05f7306c18c8abaf0d", + "loads": [ + 25, + 40, + 72, + 49, + 34, + 11, + 37, + 19, + 37, + 12, + 12, + 8, + 9, + 7, + 18, + 29, + 42, + 34, + 31, + 27, + 39, + 34, + 2, + 9, + 27, + 37, + 2, + 10, + 5, + 51, + 37, + 20, + 19, + 1, + 53, + 21, + 7, + 25, + 22, + 37, + 3, + 30, + 32, + 1, + 32, + 18, + 14, + 29, + 45, + 10, + 6, + 8, + 13, + 3, + 38, + 10, + 0, + 37, + 20, + 20, + 41, + 31, + 35, + 7 + ], + "weighted_loads": [ + 2.80605336278677, + 1.7900324817746878, + 3.6273515168577433, + 2.05402266792953, + 2.4304961636662483, + 0.47104574739933014, + 2.6010716650635004, + 0.7539293318986893, + 2.4112277161329985, + 0.5351314805448055, + 0.582902155816555, + 0.35148167610168457, + 0.33955568820238113, + 0.35457607731223106, + 0.6852042954415083, + 1.595360541716218, + 1.7911954317241907, + 1.7694613188505173, + 2.0025892667472363, + 2.8129424899816513, + 2.802318222820759, + 1.7753548957407475, + 0.06022867560386658, + 0.34912949800491333, + 1.5420100595802069, + 1.9776098597794771, + 0.06662891805171967, + 0.45489073917269707, + 0.17162338458001614, + 2.7769498471170664, + 2.2824054956436157, + 0.7487072572112083, + 1.5586823020130396, + 0.05036626383662224, + 3.1540067065507174, + 1.1908515747636557, + 0.2877198923379183, + 1.2394866906106472, + 1.494929015636444, + 2.3141664639115334, + 0.0894476156681776, + 1.8356173038482666, + 2.0506632793694735, + 0.029474876821041107, + 1.2935506533831358, + 0.7683227993547916, + 0.7181381601840258, + 1.9987224526703358, + 4.382137401029468, + 0.48943349719047546, + 0.18959475681185722, + 0.28789720870554447, + 0.7377579435706139, + 0.19655044004321098, + 2.4848560448735952, + 0.6804108992218971, + 0.0, + 2.0427198577672243, + 0.8358733523637056, + 0.749405087903142, + 2.555665973573923, + 1.391185600310564, + 2.7918863222002983, + 0.26508807204663754 + ], + "unique_experts": 63, + "load_cv": 0.6648618333150688, + "normalized_load_entropy": 0.9414564087383638, + "max_load_share": 0.04819277108433735 + }, + "full_input": { + "tokens": 290, + "top_k": 6, + "decisions": 1740, + "ordered_route_sha256": "7ce250daf7bbf3ecc532608aed7d54721b327f7e8aea37ecf92f4740e305fbcb", + "route_weight_sha256": "0d8f55e9a2deb6a6dc3ee119a44146163882473af353d7ff328bffe315a69b9e", + "loads": [ + 33, + 41, + 72, + 52, + 38, + 29, + 37, + 22, + 39, + 23, + 13, + 11, + 15, + 7, + 18, + 35, + 42, + 34, + 39, + 32, + 41, + 38, + 2, + 17, + 32, + 39, + 7, + 17, + 19, + 52, + 42, + 24, + 21, + 12, + 54, + 22, + 7, + 28, + 25, + 38, + 3, + 30, + 33, + 2, + 35, + 19, + 20, + 31, + 47, + 11, + 20, + 10, + 21, + 12, + 40, + 13, + 1, + 39, + 21, + 40, + 44, + 32, + 37, + 10 + ], + "weighted_loads": [ + 3.576353555545211, + 1.8409058209508657, + 3.6273515168577433, + 2.1897315364331007, + 2.6797766387462616, + 1.6984438076615334, + 2.6010716650635004, + 0.880658932030201, + 2.576696565374732, + 1.5038840770721436, + 0.6145339533686638, + 0.5663318336009979, + 0.7317951060831547, + 0.35457607731223106, + 0.6852042954415083, + 1.9807846080511808, + 1.7911954317241907, + 1.7694613188505173, + 2.4637402836233377, + 3.0574467312544584, + 3.0347338542342186, + 1.9810323882848024, + 0.06022867560386658, + 0.7062739972025156, + 1.7836131770163774, + 2.050913568586111, + 0.42496729642152786, + 0.7870720569044352, + 1.9323716890066862, + 2.825740596279502, + 2.5380167849361897, + 0.910642484202981, + 1.6379210706800222, + 1.0748507268726826, + 3.201828507706523, + 1.2702329810708761, + 0.2877198923379183, + 1.5910869874060154, + 1.7040571048855782, + 2.372843861579895, + 0.0894476156681776, + 1.8356173038482666, + 2.1040145102888346, + 0.07576701790094376, + 1.3969969153404236, + 0.8131230510771275, + 1.0827378332614899, + 2.066862780600786, + 4.509640293195844, + 0.5232694409787655, + 1.0844046734273434, + 0.6568966191262007, + 1.5317024067044258, + 0.8840175308287144, + 2.56842047162354, + 1.0411966517567635, + 0.05180708318948746, + 2.1244244668632746, + 0.9441595021635294, + 1.8440050166100264, + 2.806780956685543, + 1.4323587827384472, + 2.8935289792716503, + 0.3722491282969713 + ], + "unique_experts": 64, + "load_cv": 0.540806735310371, + "normalized_load_entropy": 0.9608870903390628, + "max_load_share": 0.041379310344827586 + } + }, + "s0_x": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "cb344f8d101ef1003b782f5fd6bd9c086bc923acfce2a6079a9eecb6f84f7b5b", + "route_weight_sha256": "8e9157d1bcce6abb9fb86721c4f69d8de174b0460c24582d46de275f15c8e39a", + "loads": [ + 25, + 44, + 75, + 48, + 35, + 12, + 36, + 17, + 36, + 10, + 11, + 9, + 9, + 8, + 17, + 31, + 38, + 36, + 36, + 27, + 39, + 33, + 3, + 9, + 27, + 36, + 2, + 7, + 5, + 53, + 37, + 20, + 19, + 1, + 54, + 20, + 7, + 26, + 21, + 37, + 2, + 30, + 31, + 1, + 33, + 18, + 13, + 29, + 47, + 10, + 5, + 9, + 16, + 3, + 37, + 10, + 0, + 34, + 22, + 20, + 40, + 31, + 33, + 4 + ], + "weighted_loads": [ + 2.7937436774373055, + 1.9635393526405096, + 3.7394994404166937, + 2.0377735141664743, + 2.4934852719306946, + 0.5294578038156033, + 2.5625190380960703, + 0.6602136380970478, + 2.3800703156739473, + 0.4231746196746826, + 0.5289851073175669, + 0.36864225938916206, + 0.34383888356387615, + 0.40775323286652565, + 0.6654418259859085, + 1.688550215214491, + 1.681039510294795, + 1.8435203060507774, + 2.187953433021903, + 2.7712360732257366, + 2.7800358701497316, + 1.7106453608721495, + 0.08828418143093586, + 0.3380453232675791, + 1.5342179220169783, + 1.9624095186591148, + 0.06580906361341476, + 0.3478356581181288, + 0.1601767260581255, + 2.839913234114647, + 2.3246140461415052, + 0.735692236572504, + 1.562298348173499, + 0.05292227491736412, + 3.12748733907938, + 1.142665145918727, + 0.2883949000388384, + 1.2353085149079561, + 1.4426454678177834, + 2.2591026332229376, + 0.06049002334475517, + 1.8450791705399752, + 2.001643940806389, + 0.02974032051861286, + 1.3234928268939257, + 0.7873072829097509, + 0.689811460673809, + 2.0052672121673822, + 4.479271732270718, + 0.4967479296028614, + 0.16169050708413124, + 0.31501357443630695, + 0.8238472156226635, + 0.19763689301908016, + 2.399187868461013, + 0.6738086380064487, + 0.0, + 1.9068471621721983, + 0.8820728939026594, + 0.7760615535080433, + 2.5199163742363453, + 1.3752174004912376, + 2.7298551723361015, + 0.16767369955778122 + ], + "unique_experts": 63, + "load_cv": 0.6786910953278914, + "normalized_load_entropy": 0.9394090941552768, + "max_load_share": 0.050200803212851405 + }, + "full_input": { + "tokens": 274, + "top_k": 6, + "decisions": 1644, + "ordered_route_sha256": "1e888be33685f81f4ac9aeda94046b613a5ea6d3e2eb96855b0103c7f3b9f6f7", + "route_weight_sha256": "73749004ff547cc0db2c23a71372ab8b826d18b86c329e2f0c90502cfe3cb19a", + "loads": [ + 32, + 44, + 75, + 49, + 35, + 26, + 36, + 19, + 36, + 17, + 13, + 12, + 9, + 8, + 17, + 36, + 38, + 36, + 40, + 30, + 39, + 34, + 3, + 19, + 28, + 37, + 9, + 11, + 13, + 53, + 40, + 24, + 19, + 8, + 54, + 20, + 7, + 28, + 22, + 37, + 2, + 30, + 32, + 1, + 35, + 18, + 19, + 31, + 47, + 10, + 8, + 13, + 22, + 11, + 37, + 14, + 1, + 35, + 22, + 34, + 40, + 31, + 34, + 4 + ], + "weighted_loads": [ + 3.5683247689157724, + 1.9635393526405096, + 3.7394994404166937, + 2.0780775006860495, + 2.4934852719306946, + 1.7463120855391026, + 2.5625190380960703, + 0.7406243942677975, + 2.3800703156739473, + 0.9827610403299332, + 0.5942783840000629, + 0.5555543079972267, + 0.34383888356387615, + 0.40775323286652565, + 0.6654418259859085, + 2.014517091214657, + 1.681039510294795, + 1.8435203060507774, + 2.4316529985517263, + 2.9264582321047783, + 2.7800358701497316, + 1.803810691460967, + 0.08828418143093586, + 0.7865857370197773, + 1.5569217819720507, + 1.9993417859077454, + 0.5052759628742933, + 0.6708890311419964, + 1.0427839886397123, + 2.839913234114647, + 2.5178451780229807, + 0.9394298195838928, + 1.562298348173499, + 0.5919427089393139, + 3.12748733907938, + 1.142665145918727, + 0.2883949000388384, + 1.347322566434741, + 1.503956627100706, + 2.2591026332229376, + 0.06049002334475517, + 1.8450791705399752, + 2.049557201564312, + 0.02974032051861286, + 1.3878197744488716, + 0.7873072829097509, + 1.0274455957114697, + 2.091657744720578, + 4.479271732270718, + 0.4967479296028614, + 0.28811492398381233, + 0.7546988930553198, + 1.5665691159665585, + 0.7569564934819937, + 2.399187868461013, + 1.0168490074574947, + 0.0400494821369648, + 1.9484253581613302, + 0.8820728939026594, + 1.4389999993145466, + 2.5199163742363453, + 1.3752174004912376, + 2.7729300409555435, + 0.16767369955778122 + ], + "unique_experts": 64, + "load_cv": 0.5814168859590046, + "normalized_load_entropy": 0.9556402446274306, + "max_load_share": 0.04562043795620438 + } + }, + "s1_x": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "c19d18fc7c88753c7cccd4a03f2f24cfbbb9ff8b7ce4dd3c69a9bd83809d7928", + "route_weight_sha256": "a1441a6ac47b6c935b3de1a1f6cda0f21cc04c5a08980155f7c13ab250fca0a5", + "loads": [ + 24, + 41, + 74, + 49, + 34, + 12, + 37, + 16, + 37, + 12, + 11, + 8, + 8, + 8, + 17, + 30, + 42, + 33, + 29, + 27, + 39, + 33, + 4, + 9, + 25, + 37, + 3, + 12, + 5, + 54, + 37, + 24, + 19, + 1, + 53, + 22, + 10, + 26, + 21, + 34, + 1, + 30, + 32, + 1, + 32, + 20, + 11, + 28, + 46, + 10, + 4, + 6, + 15, + 3, + 37, + 10, + 0, + 34, + 21, + 18, + 42, + 34, + 35, + 7 + ], + "weighted_loads": [ + 2.6998941116034985, + 1.8597180414944887, + 3.690781980752945, + 2.075294651091099, + 2.462825533002615, + 0.5782919302582741, + 2.6083494052290916, + 0.6591284424066544, + 2.446317084133625, + 0.5548382215201855, + 0.5389963630586863, + 0.34557463973760605, + 0.29310620203614235, + 0.3861649725586176, + 0.6605964843183756, + 1.6953450068831444, + 1.801772315055132, + 1.7357527446001768, + 1.9430951103568077, + 2.750673420727253, + 2.798916779458523, + 1.6802911646664143, + 0.13317197561264038, + 0.3411085829138756, + 1.4494500495493412, + 1.9820107482373714, + 0.090790631249547, + 0.5191345829516649, + 0.16222722455859184, + 2.9122459273785353, + 2.3089566249400377, + 0.8890605065971613, + 1.5488710645586252, + 0.05274840071797371, + 3.172218907624483, + 1.2133205831050873, + 0.375374510884285, + 1.2540044616907835, + 1.4480881355702877, + 2.235479859635234, + 0.031297698616981506, + 1.8557725455611944, + 2.0449065938591957, + 0.02990085817873478, + 1.318937674164772, + 0.8405944295227528, + 0.606591384857893, + 1.9272538237273693, + 4.44749672524631, + 0.486483097076416, + 0.1258987132459879, + 0.22371424362063408, + 0.778462952002883, + 0.21065634861588478, + 2.4656264539808035, + 0.6576823201030493, + 0.0, + 1.9175321720540524, + 0.8507007379084826, + 0.6867360509932041, + 2.576648971065879, + 1.4904900677502155, + 2.813187910243869, + 0.2621668204665184 + ], + "unique_experts": 63, + "load_cv": 0.6715986125742865, + "normalized_load_entropy": 0.9407741580862224, + "max_load_share": 0.049531459170013385 + }, + "full_input": { + "tokens": 290, + "top_k": 6, + "decisions": 1740, + "ordered_route_sha256": "6c02ec193fb5ed76606b15912fe6763225083289b3e7b2ad210e36752f3d6d8a", + "route_weight_sha256": "efe0c269f034415af621524f5b774341d3179e573ac61ac9099d9ce9edb963f7", + "loads": [ + 33, + 42, + 74, + 50, + 38, + 31, + 37, + 19, + 39, + 22, + 11, + 12, + 14, + 8, + 17, + 35, + 42, + 33, + 35, + 32, + 41, + 37, + 4, + 18, + 30, + 39, + 9, + 19, + 18, + 55, + 43, + 27, + 21, + 12, + 54, + 23, + 10, + 30, + 24, + 35, + 1, + 30, + 34, + 2, + 34, + 20, + 18, + 30, + 48, + 11, + 18, + 8, + 23, + 13, + 39, + 13, + 1, + 35, + 22, + 39, + 45, + 35, + 38, + 10 + ], + "weighted_loads": [ + 3.548072436824441, + 1.9105913806706667, + 3.690781980752945, + 2.118979662656784, + 2.712837103754282, + 2.0166809782385826, + 2.6083494052290916, + 0.785858042538166, + 2.6117859333753586, + 1.3443360179662704, + 0.5389963630586863, + 0.60847232863307, + 0.6853456199169159, + 0.3861649725586176, + 0.6605964843183756, + 2.000939551740885, + 1.801772315055132, + 1.7357527446001768, + 2.3222262244671583, + 2.994180226698518, + 3.0313324108719826, + 1.8779106233268976, + 0.13317197561264038, + 0.751563323661685, + 1.6910531669855118, + 2.0553144570440054, + 0.555203752592206, + 0.8102533929049969, + 1.5181509517133236, + 2.961036676540971, + 2.5823327247053385, + 0.9942491464316845, + 1.6281098332256079, + 1.0752811394631863, + 3.2200407087802887, + 1.2927019894123077, + 0.375374510884285, + 1.7036971282213926, + 1.6377357505261898, + 2.2941572573035955, + 0.031297698616981506, + 1.8557725455611944, + 2.154698181897402, + 0.07619299925863743, + 1.3788884859532118, + 0.8405944295227528, + 0.9861626457422972, + 1.9953941516578197, + 4.574999617412686, + 0.520319040864706, + 1.0164100099354982, + 0.5999569669365883, + 1.572407415136695, + 1.019322980195284, + 2.549190880730748, + 0.9091284777969122, + 0.05180708318948746, + 1.9559896998107433, + 0.9589868877083063, + 1.8549925815314054, + 2.827763954177499, + 1.5316632501780987, + 2.956532223150134, + 0.3693278767168522 + ], + "unique_experts": 64, + "load_cv": 0.541705004893434, + "normalized_load_entropy": 0.9611444199714207, + "max_load_share": 0.04252873563218391 + } + }, + "s0_period": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "e26b55901f250b300b92b7f1655073487d81a3914b9bfa31a1691136ab021d33", + "route_weight_sha256": "e7f0b87f6ecbac3a6c2917a987553f8045c541c2b97cd4fd5a7629d1c8eed347", + "loads": [ + 26, + 44, + 71, + 47, + 35, + 10, + 37, + 18, + 36, + 10, + 11, + 8, + 9, + 9, + 18, + 29, + 39, + 35, + 38, + 27, + 39, + 35, + 3, + 9, + 28, + 36, + 1, + 7, + 4, + 53, + 37, + 19, + 19, + 1, + 55, + 21, + 8, + 25, + 22, + 36, + 2, + 29, + 31, + 1, + 33, + 18, + 13, + 29, + 46, + 10, + 5, + 8, + 16, + 3, + 38, + 10, + 0, + 34, + 23, + 21, + 41, + 29, + 34, + 5 + ], + "weighted_loads": [ + 2.8327821865677834, + 1.9769051149487495, + 3.628933310508728, + 2.011145416647196, + 2.479340048506856, + 0.4941767528653145, + 2.565003424882889, + 0.7012903820723295, + 2.392753705382347, + 0.4294615909457207, + 0.5346561223268509, + 0.33983648754656315, + 0.34359406121075153, + 0.43832564912736416, + 0.696051886305213, + 1.5902800243347883, + 1.7183406259864569, + 1.8142178058624268, + 2.247174398973584, + 2.7625453267246485, + 2.7742717284709215, + 1.805426986888051, + 0.08798446878790855, + 0.33375310711562634, + 1.5424869731068611, + 1.9512469936162233, + 0.03251952305436134, + 0.3487306647002697, + 0.1386475060135126, + 2.8434131834656, + 2.3153630271553993, + 0.702397121116519, + 1.57156490534544, + 0.053347375243902206, + 3.1329393163323402, + 1.1875407956540585, + 0.316115640103817, + 1.2001552190631628, + 1.4756604712456465, + 2.2441851124167442, + 0.06130165234208107, + 1.8229382000863552, + 2.0041197277605534, + 0.030496787279844284, + 1.328763883560896, + 0.7817560900002718, + 0.6983784958720207, + 1.9901970904320478, + 4.401083556935191, + 0.49275708943605423, + 0.16550576128065586, + 0.2894828338176012, + 0.8377059493213892, + 0.20356295071542263, + 2.4481689482927322, + 0.6742833219468594, + 0.0, + 1.8944657035171986, + 0.910202007740736, + 0.8072909340262413, + 2.5464399345219135, + 1.3086460214108229, + 2.7493003346025944, + 0.19550293311476707 + ], + "unique_experts": 63, + "load_cv": 0.6735596830984338, + "normalized_load_entropy": 0.9393566398867531, + "max_load_share": 0.04752342704149933 + }, + "full_input": { + "tokens": 274, + "top_k": 6, + "decisions": 1644, + "ordered_route_sha256": "fba4d6632f8b0793f8ac96f7b29674177ce75683f2fab95ca44e2c1ee89ae713", + "route_weight_sha256": "4eb1e7eeff41fff38a10eda5cfb1f14b700fbb632793a26a88a0ccd5c6b085a4", + "loads": [ + 33, + 44, + 71, + 48, + 35, + 23, + 37, + 20, + 36, + 17, + 13, + 11, + 9, + 9, + 18, + 34, + 39, + 35, + 43, + 29, + 39, + 36, + 3, + 19, + 29, + 37, + 8, + 12, + 12, + 53, + 40, + 23, + 19, + 8, + 55, + 21, + 8, + 27, + 23, + 36, + 2, + 29, + 31, + 1, + 35, + 18, + 18, + 32, + 46, + 11, + 8, + 12, + 22, + 11, + 38, + 14, + 1, + 35, + 23, + 35, + 41, + 29, + 35, + 5 + ], + "weighted_loads": [ + 3.54541533626616, + 1.9769051149487495, + 3.628933310508728, + 2.051449403166771, + 2.479340048506856, + 1.6113441437482834, + 2.565003424882889, + 0.7812578026205301, + 2.392753705382347, + 1.0188576988875866, + 0.599949399009347, + 0.5267485361546278, + 0.34359406121075153, + 0.43832564912736416, + 0.696051886305213, + 1.9231956135481596, + 1.7183406259864569, + 1.8142178058624268, + 2.5395109821110964, + 2.840135680511594, + 2.7742717284709215, + 1.9330458212643862, + 0.08798446878790855, + 0.7822935208678246, + 1.5651908330619335, + 1.987930340692401, + 0.4151154141873121, + 0.7190172020345926, + 1.123675363138318, + 2.8434131834656, + 2.5100444816052914, + 0.9001786466687918, + 1.57156490534544, + 0.5864087231457233, + 3.1329393163323402, + 1.1875407956540585, + 0.316115640103817, + 1.2984296809881926, + 1.5369716305285692, + 2.2441851124167442, + 0.06130165234208107, + 1.8229382000863552, + 2.0041197277605534, + 0.030496787279844284, + 1.3930908311158419, + 0.7817560900002718, + 0.9735737666487694, + 2.1414734553545713, + 4.401083556935191, + 0.5401019044220448, + 0.30187774263322353, + 0.7291827965527773, + 1.5804278496652842, + 0.7623550500720739, + 2.4481689482927322, + 1.08440525457263, + 0.0400494821369648, + 1.9344862438738346, + 0.910202007740736, + 1.4569338858127594, + 2.5464399345219135, + 1.3086460214108229, + 2.787721484899521, + 0.19550293311476707 + ], + "unique_experts": 64, + "load_cv": 0.5749047295419303, + "normalized_load_entropy": 0.956378240941897, + "max_load_share": 0.04318734793187348 + } + }, + "s1_period": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "dd143c6d28ab71079ffe52a1cbe179cc2744ffb524c75b88ac805049d9d61a43", + "route_weight_sha256": "a58a618c2b67ab9921e53f3c76a8fe4070da1490b886488417b96fdee190568b", + "loads": [ + 23, + 41, + 75, + 51, + 34, + 15, + 38, + 16, + 37, + 11, + 10, + 8, + 8, + 8, + 19, + 30, + 41, + 34, + 29, + 27, + 40, + 34, + 2, + 9, + 25, + 38, + 1, + 9, + 3, + 53, + 37, + 22, + 19, + 2, + 54, + 21, + 9, + 25, + 21, + 35, + 1, + 30, + 33, + 1, + 29, + 19, + 13, + 28, + 48, + 10, + 5, + 6, + 16, + 3, + 39, + 10, + 0, + 32, + 21, + 18, + 41, + 35, + 35, + 7 + ], + "weighted_loads": [ + 2.7464827187359333, + 1.8518298380076885, + 3.7181393187493086, + 2.15219952724874, + 2.4647410176694393, + 0.669754009693861, + 2.6331886630505323, + 0.6577919349074364, + 2.456997688859701, + 0.5201622303575277, + 0.5136597361415625, + 0.3463207520544529, + 0.2934488505125046, + 0.375137522816658, + 0.7087999563664198, + 1.6920205261558294, + 1.7790787238627672, + 1.780377646908164, + 1.9653969705104828, + 2.7732679564505816, + 2.8375443294644356, + 1.7582551520317793, + 0.06322931498289108, + 0.3335495740175247, + 1.4636512286961079, + 2.0272286608815193, + 0.03386393189430237, + 0.4274447876960039, + 0.10575038194656372, + 2.886240331456065, + 2.297718685120344, + 0.8177459817379713, + 1.5704663209617138, + 0.08724852651357651, + 3.2177185099571943, + 1.1789456065744162, + 0.33499550446867943, + 1.2281718663871288, + 1.4539997931569815, + 2.278051747009158, + 0.03163302317261696, + 1.8471823930740356, + 2.083698546513915, + 0.028958497568964958, + 1.2215972281992435, + 0.8206891845911741, + 0.6767439860850573, + 1.9182527381926775, + 4.532953321933746, + 0.4847973957657814, + 0.15863441862165928, + 0.223429461941123, + 0.81805912964046, + 0.21252651885151863, + 2.55355117097497, + 0.6532903015613556, + 0.0, + 1.8663868699222803, + 0.8537822719663382, + 0.6955217868089676, + 2.552633700892329, + 1.5162279549986124, + 2.832530152052641, + 0.25839849933981895 + ], + "unique_experts": 63, + "load_cv": 0.6839517132373432, + "normalized_load_entropy": 0.9383431374241145, + "max_load_share": 0.050200803212851405 + }, + "full_input": { + "tokens": 290, + "top_k": 6, + "decisions": 1740, + "ordered_route_sha256": "0180b63d7649565f450064a5930cb86be13d5df33ce0bbfa1b2dd196578daa81", + "route_weight_sha256": "258c5d67f4e5bec4b2e71df3c2faa272b7b9def505bfc4c0b6d683d20662657f", + "loads": [ + 32, + 42, + 75, + 52, + 38, + 33, + 38, + 19, + 39, + 22, + 10, + 11, + 14, + 8, + 19, + 35, + 41, + 34, + 35, + 32, + 42, + 38, + 2, + 17, + 31, + 40, + 7, + 15, + 16, + 54, + 44, + 25, + 21, + 12, + 55, + 22, + 9, + 29, + 24, + 37, + 1, + 30, + 34, + 2, + 31, + 19, + 19, + 31, + 50, + 12, + 19, + 8, + 24, + 13, + 41, + 13, + 1, + 34, + 22, + 39, + 44, + 36, + 38, + 10 + ], + "weighted_loads": [ + 3.574165003374219, + 1.9027031771838665, + 3.7181393187493086, + 2.1958845388144255, + 2.708957653492689, + 1.9493171460926533, + 2.6331886630505323, + 0.7845215350389481, + 2.6224665381014347, + 1.39443120919168, + 0.5136597361415625, + 0.5611709095537663, + 0.6856882683932781, + 0.375137522816658, + 0.7087999563664198, + 1.988189598545432, + 1.7790787238627672, + 1.780377646908164, + 2.3456927221268415, + 3.0082996487617493, + 3.0699599608778954, + 1.9872840084135532, + 0.06322931498289108, + 0.690694073215127, + 1.743094589561224, + 2.1005323696881533, + 0.43329957872629166, + 0.6762069463729858, + 1.4373750425875187, + 2.9350310806185007, + 2.6089595779776573, + 0.9229346215724945, + 1.6497050896286964, + 1.072081632912159, + 3.265540311113, + 1.2583270128816366, + 0.33499550446867943, + 1.6772815324366093, + 1.6462289858609438, + 2.370943220332265, + 0.03163302317261696, + 1.8471823930740356, + 2.137049777433276, + 0.07525063864886761, + 1.2815480399876833, + 0.8206891845911741, + 1.0323465131223202, + 2.0273888390511274, + 4.6604562141001225, + 0.5603312961757183, + 1.0582378823310137, + 0.600010534748435, + 1.612003592774272, + 0.9791623391211033, + 2.6371155977249146, + 0.9706812724471092, + 0.05180708318948746, + 1.9528030063956976, + 0.9620684217661619, + 1.8559898640960455, + 2.803748684003949, + 1.5574011374264956, + 2.980866812169552, + 0.36555955559015274 + ], + "unique_experts": 64, + "load_cv": 0.556374083231308, + "normalized_load_entropy": 0.958821470142242, + "max_load_share": 0.04310344827586207 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 249, + "ordered_topk_exact_tokens": 166, + "set_exact_tokens": 196, + "mean_set_jaccard": 0.9366035570854847, + "mean_token_weighted_tv": 0.011279267853642085, + "aggregate_load_tv": 0.01941097724230255 + }, + "system_bos": { + "tokens": 249, + "ordered_topk_exact_tokens": 156, + "set_exact_tokens": 193, + "mean_set_jaccard": 0.9340218014916809, + "mean_token_weighted_tv": 0.012748773782009101, + "aggregate_load_tv": 0.016733601070950458 + }, + "system_x": { + "tokens": 249, + "ordered_topk_exact_tokens": 133, + "set_exact_tokens": 169, + "mean_set_jaccard": 0.9047619047619048, + "mean_token_weighted_tv": 0.017606390651360333, + "aggregate_load_tv": 0.02677376171352075 + }, + "system_period": { + "tokens": 249, + "ordered_topk_exact_tokens": 123, + "set_exact_tokens": 166, + "mean_set_jaccard": 0.9013195639701663, + "mean_token_weighted_tv": 0.018261686427496284, + "aggregate_load_tv": 0.030789825970548863 + }, + "bos_at_s0": { + "tokens": 249, + "ordered_topk_exact_tokens": 134, + "set_exact_tokens": 172, + "mean_set_jaccard": 0.9047619047619048, + "mean_token_weighted_tv": 0.01742537560906396, + "aggregate_load_tv": 0.02744310575635877 + }, + "bos_at_s1": { + "tokens": 249, + "ordered_topk_exact_tokens": 128, + "set_exact_tokens": 168, + "mean_set_jaccard": 0.9027538726333907, + "mean_token_weighted_tv": 0.0183707957818027, + "aggregate_load_tv": 0.02610441767068273 + }, + "x_at_s0": { + "tokens": 249, + "ordered_topk_exact_tokens": 129, + "set_exact_tokens": 166, + "mean_set_jaccard": 0.8995983935742969, + "mean_token_weighted_tv": 0.018157799058709758, + "aggregate_load_tv": 0.0321285140562249 + }, + "x_at_s1": { + "tokens": 249, + "ordered_topk_exact_tokens": 119, + "set_exact_tokens": 159, + "mean_set_jaccard": 0.8915662650602408, + "mean_token_weighted_tv": 0.02077831314076262, + "aggregate_load_tv": 0.02476572958500669 + }, + "period_at_s0": { + "tokens": 249, + "ordered_topk_exact_tokens": 131, + "set_exact_tokens": 168, + "mean_set_jaccard": 0.9027538726333907, + "mean_token_weighted_tv": 0.01816560223653733, + "aggregate_load_tv": 0.03078982597054886 + }, + "period_at_s1": { + "tokens": 249, + "ordered_topk_exact_tokens": 114, + "set_exact_tokens": 162, + "mean_set_jaccard": 0.8958691910499138, + "mean_token_weighted_tv": 0.020203822954411966, + "aggregate_load_tv": 0.02677376171352075 + } + } + }, + "layer_15": { + "layer": 15, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "219c1e0a90c8714b6c8ce34baddb356b8252a2dec9da5868ef174068528afc5d", + "route_weight_sha256": "5118e0f059878dd323b4c21859da04df3e4274c092513dcdfa43022e2a72a242", + "loads": [ + 19, + 33, + 37, + 11, + 9, + 20, + 18, + 1, + 10, + 2, + 5, + 32, + 36, + 31, + 19, + 21, + 12, + 33, + 4, + 1, + 59, + 52, + 67, + 32, + 28, + 29, + 4, + 40, + 26, + 13, + 41, + 15, + 8, + 5, + 25, + 24, + 23, + 13, + 7, + 18, + 32, + 24, + 19, + 40, + 34, + 36, + 39, + 17, + 21, + 25, + 26, + 23, + 14, + 18, + 8, + 25, + 31, + 25, + 0, + 2, + 65, + 12, + 41, + 34 + ], + "weighted_loads": [ + 0.7549141645431519, + 2.6261547170579433, + 3.183634677901864, + 0.48434191197156906, + 0.36382513865828514, + 0.7929143384099007, + 1.0947964526712894, + 0.043550655245780945, + 0.38583705946803093, + 0.13335472717881203, + 0.2903815023601055, + 3.10970451682806, + 2.4234150778502226, + 1.7366765309125185, + 0.7265776507556438, + 0.9556485060602427, + 0.7522053420543671, + 1.3434147126972675, + 0.12406333163380623, + 0.03623111546039581, + 3.159079022705555, + 3.103815719485283, + 3.5963087026029825, + 2.6621850095689297, + 1.281672365963459, + 2.344882059842348, + 0.1791333332657814, + 2.336583586409688, + 1.3241415861994028, + 0.47972737438976765, + 1.8427327945828438, + 0.7015903666615486, + 0.27654923498630524, + 0.2563582770526409, + 2.0724415332078934, + 0.8438181057572365, + 1.0384876243770123, + 0.8268975652754307, + 0.24869824573397636, + 0.8789330553263426, + 2.4977676700800657, + 1.0634469836950302, + 1.055914517492056, + 3.5543882437050343, + 1.9399526193737984, + 1.9971858244389296, + 3.0674332082271576, + 0.7388839274644852, + 0.9657194707542658, + 1.5436965376138687, + 1.2761063110083342, + 0.9545799717307091, + 0.9093788787722588, + 1.0974552612751722, + 0.25280686281621456, + 1.0172616485506296, + 1.4695514347404242, + 1.9434233121573925, + 0.0, + 0.06314262561500072, + 3.650348912924528, + 0.47321618162095547, + 2.703834183514118, + 1.8933239858597517 + ], + "unique_experts": 63, + "load_cv": 0.6444069578631119, + "normalized_load_entropy": 0.946627784833505, + "max_load_share": 0.04484605087014726 + }, + "full_input": { + "tokens": 274, + "top_k": 6, + "decisions": 1644, + "ordered_route_sha256": "131f753d15740fdf878d25f767b76201ad9476b8008b53adb7f5a354d33a3493", + "route_weight_sha256": "df24322fa3981bd05a35709466649610c17ad027061ebff8db5e8e4d217d94d1", + "loads": [ + 23, + 33, + 37, + 11, + 15, + 23, + 26, + 3, + 15, + 3, + 9, + 34, + 41, + 31, + 30, + 23, + 19, + 36, + 4, + 2, + 59, + 52, + 67, + 38, + 31, + 30, + 14, + 40, + 29, + 13, + 45, + 15, + 13, + 7, + 25, + 24, + 28, + 13, + 9, + 18, + 38, + 25, + 19, + 42, + 35, + 36, + 39, + 18, + 22, + 34, + 31, + 25, + 19, + 18, + 8, + 29, + 31, + 25, + 1, + 2, + 65, + 14, + 41, + 39 + ], + "weighted_loads": [ + 1.0522311609238386, + 2.6261547170579433, + 3.183634677901864, + 0.48434191197156906, + 0.7186874784529209, + 0.8658029576763511, + 1.7421829663217068, + 0.1101146936416626, + 0.7923918329179287, + 0.16480063274502754, + 0.43826249055564404, + 3.24702201038599, + 2.8832029048353434, + 1.7366765309125185, + 1.1362558118999004, + 1.0290389489382505, + 1.3954076282680035, + 1.4507834054529667, + 0.12406333163380623, + 0.11531171947717667, + 3.159079022705555, + 3.103815719485283, + 3.5963087026029825, + 2.972402900457382, + 1.3404657922219485, + 2.3733599204570055, + 0.8235443569719791, + 2.336583586409688, + 1.4383721593767405, + 0.47972737438976765, + 2.014400413259864, + 0.7015903666615486, + 0.6993627306073904, + 0.34555938467383385, + 2.0724415332078934, + 0.8438181057572365, + 1.7823188165202737, + 0.8268975652754307, + 0.30879361741244793, + 0.8789330553263426, + 2.819266387959942, + 1.0676780971698463, + 1.055914517492056, + 3.6399404108524323, + 1.9791400544345379, + 1.9971858244389296, + 3.0674332082271576, + 0.7732313275337219, + 0.9792101811617613, + 2.3054258339107037, + 1.675631219521165, + 1.0392167270183563, + 1.0568025140091777, + 1.0974552612751722, + 0.25280686281621456, + 2.6782110203057528, + 1.4695514347404242, + 1.9434233121573925, + 0.04506808519363403, + 0.06314262561500072, + 3.650348912924528, + 0.5607368480414152, + 2.703834183514118, + 2.2944407295435667 + ], + "unique_experts": 64, + "load_cv": 0.5744926926292102, + "normalized_load_entropy": 0.9571515611026441, + "max_load_share": 0.04075425790754258 + } + }, + "s1_eos": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "7858c601aa0fb679521752ec4f3110f2c170ef95f75db3d40b159bcd1af5c140", + "route_weight_sha256": "ddeeebc05841590de365b5e7f2771d9290dcdf506d4d806d21d1f235812187e4", + "loads": [ + 21, + 33, + 35, + 13, + 8, + 19, + 16, + 1, + 11, + 2, + 5, + 32, + 37, + 29, + 19, + 21, + 12, + 37, + 4, + 1, + 58, + 53, + 65, + 29, + 29, + 29, + 4, + 41, + 27, + 13, + 42, + 13, + 8, + 5, + 25, + 26, + 21, + 13, + 7, + 18, + 31, + 24, + 20, + 40, + 35, + 34, + 39, + 16, + 20, + 24, + 28, + 24, + 13, + 21, + 7, + 24, + 31, + 25, + 0, + 2, + 65, + 12, + 42, + 35 + ], + "weighted_loads": [ + 0.8387930858880281, + 2.6207551807165146, + 3.0709398463368416, + 0.5549050848931074, + 0.34001440182328224, + 0.7603142708539963, + 1.0214299447834492, + 0.0448804534971714, + 0.4288474079221487, + 0.13585002347826958, + 0.30567821115255356, + 3.0912578608840704, + 2.434909990057349, + 1.6689896751195192, + 0.7301645837724209, + 0.9329071342945099, + 0.732315007597208, + 1.467187913134694, + 0.12964689172804356, + 0.03676723316311836, + 3.1188404727727175, + 3.126064980402589, + 3.538372440263629, + 2.569158159196377, + 1.3251348659396172, + 2.3509338572621346, + 0.15904512256383896, + 2.370858745649457, + 1.3587556574493647, + 0.4733407348394394, + 1.8678083401173353, + 0.6533797960728407, + 0.2704537156969309, + 0.25805628672242165, + 2.0709301996976137, + 0.9150275588035583, + 0.9495899267494678, + 0.8205594792962074, + 0.24644139222800732, + 0.8752344250679016, + 2.4843171406537294, + 1.059867287054658, + 1.0748330168426037, + 3.545850645750761, + 1.9796732272952795, + 1.9283508863300085, + 3.066237185150385, + 0.6913784146308899, + 0.9353182278573513, + 1.4943528473377228, + 1.324284479022026, + 1.007178295403719, + 0.8789320327341557, + 1.1764548514038324, + 0.21979088708758354, + 0.9951945021748543, + 1.4733518064022064, + 1.9432449042797089, + 0.0, + 0.0632848460227251, + 3.6726216096431017, + 0.47557055950164795, + 2.719392664730549, + 1.911541784182191 + ], + "unique_experts": 63, + "load_cv": 0.6444069578631119, + "normalized_load_entropy": 0.9463522288246146, + "max_load_share": 0.04350736278447122 + }, + "full_input": { + "tokens": 290, + "top_k": 6, + "decisions": 1740, + "ordered_route_sha256": "5a7a10f64422e7923b72ffe01af974a4e1f60af02f5e46e2903e17e493e64502", + "route_weight_sha256": "f91cc2b9e5e322bd54c4bdcabea972e4dc6b314f6ba3776e099c293aed1fa7c0", + "loads": [ + 40, + 34, + 35, + 13, + 16, + 24, + 29, + 2, + 22, + 3, + 10, + 37, + 43, + 30, + 25, + 31, + 24, + 42, + 5, + 5, + 59, + 54, + 65, + 34, + 32, + 30, + 14, + 43, + 33, + 14, + 48, + 17, + 15, + 8, + 27, + 26, + 27, + 13, + 9, + 19, + 37, + 26, + 20, + 42, + 36, + 35, + 39, + 17, + 23, + 36, + 36, + 26, + 15, + 22, + 7, + 28, + 31, + 31, + 2, + 6, + 65, + 19, + 44, + 40 + ], + "weighted_loads": [ + 2.2116445135325193, + 2.64679660089314, + 3.0709398463368416, + 0.5549050848931074, + 0.7935734502971172, + 0.9713588897138834, + 2.0796374566853046, + 0.07798095047473907, + 1.0540031660348177, + 0.16689255833625793, + 0.537591926753521, + 3.5232028141617775, + 2.9679003190249205, + 1.752331392839551, + 0.9305217638611794, + 1.6096737645566463, + 1.8497754745185375, + 1.6531356442719698, + 0.182067496702075, + 0.3067735843360424, + 3.1476878244429827, + 3.2090285886079073, + 3.538372440263629, + 2.8092426136136055, + 1.3904660467524081, + 2.3794363252818584, + 0.8569528684020042, + 2.493257312104106, + 1.7720628697425127, + 0.5114510916173458, + 2.092037357389927, + 1.1011163908988237, + 0.7281733546406031, + 0.3883732743561268, + 2.219939524307847, + 0.9150275588035583, + 1.669579123146832, + 0.8205594792962074, + 0.31074470840394497, + 0.9110584817826748, + 2.742759887361899, + 1.1521171270869672, + 1.0748330168426037, + 3.821651689708233, + 2.017897503450513, + 1.965849930420518, + 3.066237185150385, + 0.7255522459745407, + 1.077459927648306, + 3.064428385347128, + 1.7814556546509266, + 1.0744801126420498, + 0.927267930470407, + 1.3099407199770212, + 0.21979088708758354, + 2.6372788175940514, + 1.4733518064022064, + 2.6001248732209206, + 0.08165626227855682, + 0.2396454643458128, + 3.6726216096431017, + 0.8600596599280834, + 2.8353616558015347, + 2.260548671707511 + ], + "unique_experts": 64, + "load_cv": 0.5406894596918874, + "normalized_load_entropy": 0.961763515342653, + "max_load_share": 0.03735632183908046 + } + }, + "s0_bos": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "619cb40d5c5e129d0d32707efc5565b9e8a229f1460397d6c54ac4886fd2c30d", + "route_weight_sha256": "6a39b0a21562056631b97a82599b9cbec42642538101451ef5d0f13294600c48", + "loads": [ + 19, + 32, + 39, + 11, + 8, + 21, + 18, + 1, + 10, + 2, + 4, + 32, + 35, + 29, + 20, + 22, + 12, + 39, + 4, + 1, + 58, + 52, + 69, + 29, + 27, + 28, + 3, + 38, + 27, + 12, + 41, + 15, + 9, + 8, + 23, + 26, + 20, + 13, + 7, + 19, + 30, + 21, + 19, + 41, + 36, + 34, + 39, + 14, + 23, + 24, + 29, + 21, + 14, + 20, + 7, + 26, + 30, + 26, + 0, + 2, + 65, + 11, + 44, + 35 + ], + "weighted_loads": [ + 0.7388414554297924, + 2.609173644334078, + 3.1975373812019825, + 0.4915122762322426, + 0.3335680104792118, + 0.7940434440970421, + 1.2127699740231037, + 0.04463183879852295, + 0.37682370841503143, + 0.1452971175312996, + 0.27082453295588493, + 3.193352375179529, + 2.3803298212587833, + 1.684368060901761, + 0.7133174370974302, + 0.9991348348557949, + 0.723419077694416, + 1.5490692723542452, + 0.12630809284746647, + 0.0377470925450325, + 3.090814197435975, + 3.1023949943482876, + 3.6562277767807245, + 2.562201639637351, + 1.2691851612180471, + 2.3361740671098232, + 0.11811132356524467, + 2.28640897013247, + 1.3378387298434973, + 0.45227245055139065, + 1.8207020200788975, + 0.6912176199257374, + 0.30386517755687237, + 0.3720853514969349, + 1.990379748865962, + 0.9114240109920502, + 0.9290235359221697, + 0.8391307033598423, + 0.24005392752587795, + 0.9145178757607937, + 2.4575683511793613, + 0.988858412951231, + 1.0684155877679586, + 3.569783402606845, + 2.053945394232869, + 1.9914893843233585, + 3.0484852455556393, + 0.6428681425750256, + 1.0428809486329556, + 1.5202039945870638, + 1.411302201449871, + 0.8605834636837244, + 0.9115099590271711, + 1.1497219931334257, + 0.21878726966679096, + 1.047072997316718, + 1.4228908717632294, + 1.9981751404702663, + 0.0, + 0.06256069988012314, + 3.63388179987669, + 0.4189153593033552, + 2.8136276192963123, + 1.8822086155414581 + ], + "unique_experts": 63, + "load_cv": 0.6524988748901497, + "normalized_load_entropy": 0.9455352447599858, + "max_load_share": 0.04618473895582329 + }, + "full_input": { + "tokens": 274, + "top_k": 6, + "decisions": 1644, + "ordered_route_sha256": "2a87f2855f7b958c9b91e677a079efc2bad36411d7957a09646bc430da488d5e", + "route_weight_sha256": "30b3e077c8c44c34d3f3f8953f3ca9c5fd3674dd96a9e1f0ab77f47e0ef1137f", + "loads": [ + 24, + 32, + 39, + 11, + 15, + 23, + 26, + 3, + 14, + 3, + 8, + 34, + 40, + 29, + 29, + 24, + 19, + 42, + 4, + 2, + 58, + 52, + 69, + 35, + 29, + 29, + 13, + 38, + 30, + 12, + 45, + 15, + 14, + 10, + 23, + 27, + 26, + 13, + 8, + 19, + 37, + 21, + 19, + 43, + 37, + 34, + 39, + 15, + 24, + 33, + 35, + 24, + 19, + 20, + 9, + 28, + 30, + 26, + 1, + 2, + 65, + 13, + 44, + 40 + ], + "weighted_loads": [ + 1.1048978101462126, + 2.609173644334078, + 3.1975373812019825, + 0.4915122762322426, + 0.6794647946953773, + 0.8647776693105698, + 1.8044772297143936, + 0.1111958771944046, + 0.723717987537384, + 0.1767430230975151, + 0.41870552115142345, + 3.328055005520582, + 2.8514142632484436, + 1.684368060901761, + 1.0804505683481693, + 1.071029506623745, + 1.3791270963847637, + 1.6600950714200735, + 0.12630809284746647, + 0.11682769656181335, + 3.090814197435975, + 3.1023949943482876, + 3.6562277767807245, + 2.8724195305258036, + 1.3243178483098745, + 2.3646519277244806, + 0.7625223472714424, + 2.28640897013247, + 1.452069303020835, + 0.45227245055139065, + 1.9923696387559175, + 0.6912176199257374, + 0.7266786731779575, + 0.4612864591181278, + 1.990379748865962, + 1.0134001150727272, + 1.7192348120734096, + 0.8391307033598423, + 0.27106997929513454, + 0.9145178757607937, + 2.8619728311896324, + 0.988858412951231, + 1.0684155877679586, + 3.655335569754243, + 2.0908423606306314, + 1.9914893843233585, + 3.0484852455556393, + 0.6772155426442623, + 1.056371659040451, + 2.290820112451911, + 1.9057744219899178, + 0.9920816663652658, + 1.05893359426409, + 1.1497219931334257, + 0.3217011410742998, + 1.685065446421504, + 1.4228908717632294, + 1.9981751404702663, + 0.04506808519363403, + 0.06256069988012314, + 3.63388179987669, + 0.506436025723815, + 2.8136276192963123, + 2.271933391690254 + ], + "unique_experts": 64, + "load_cv": 0.5806833265909143, + "normalized_load_entropy": 0.9565871040154743, + "max_load_share": 0.041970802919708027 + } + }, + "s1_bos": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "2c036838f3834073b0abe8ddbbb0273f96c6075f75b51c88a20996fea8fcd981", + "route_weight_sha256": "9e3f8369ff39a55a9285c31359ffeb38f90df51b274d692ba1f1d005e0b804c8", + "loads": [ + 19, + 33, + 38, + 12, + 7, + 19, + 17, + 2, + 14, + 2, + 4, + 32, + 36, + 29, + 17, + 21, + 11, + 38, + 7, + 1, + 59, + 51, + 67, + 28, + 27, + 29, + 3, + 40, + 26, + 13, + 39, + 16, + 6, + 7, + 26, + 24, + 20, + 14, + 8, + 20, + 30, + 24, + 17, + 41, + 35, + 36, + 39, + 13, + 23, + 24, + 30, + 24, + 15, + 18, + 8, + 21, + 30, + 26, + 0, + 2, + 69, + 12, + 42, + 33 + ], + "weighted_loads": [ + 0.7344301883131266, + 2.6429851930588484, + 3.242887808009982, + 0.5363495573401451, + 0.3066960386931896, + 0.7410313114523888, + 1.0650153998285532, + 0.08875305950641632, + 0.5219009425491095, + 0.15633615106344223, + 0.26699711196124554, + 3.162876458838582, + 2.4005700554698706, + 1.6925597228109837, + 0.6143729984760284, + 0.9351404514163733, + 0.662249069660902, + 1.5424050521105528, + 0.2170938439667225, + 0.03731805086135864, + 3.1584083512425423, + 3.100581733509898, + 3.6252786573022604, + 2.512741297483444, + 1.2804400864988565, + 2.3667816687375307, + 0.09817313961684704, + 2.3600199576467276, + 1.2973096538335085, + 0.4601716920733452, + 1.7961268872022629, + 0.7226962577551603, + 0.20545960403978825, + 0.3566674403846264, + 2.094267997890711, + 0.8493067976087332, + 0.9314951859414577, + 0.8840273432433605, + 0.27152825705707073, + 0.925982192158699, + 2.414354668930173, + 1.066636385396123, + 1.007186833769083, + 3.600154034793377, + 2.0275579802691936, + 2.066728850826621, + 3.056909726932645, + 0.5973642971366644, + 1.06302641145885, + 1.5021920446306467, + 1.5009478013962507, + 0.9728263206779957, + 0.9495893511921167, + 1.0797008089721203, + 0.24774976819753647, + 0.8781487625092268, + 1.4448410049080849, + 2.0151368379592896, + 0.0, + 0.06440877728164196, + 3.808696763589978, + 0.47256421111524105, + 2.7457395903766155, + 1.8246242832392454 + ], + "unique_experts": 63, + "load_cv": 0.6507828045255029, + "normalized_load_entropy": 0.9465475651123177, + "max_load_share": 0.04618473895582329 + }, + "full_input": { + "tokens": 290, + "top_k": 6, + "decisions": 1740, + "ordered_route_sha256": "b901deda18c4c21988a75f65c7f293f59a7d0340c7d79accb70240321b2d4d11", + "route_weight_sha256": "80e02024f92691697913599595af39a74b032d4c140f7ed482ba8fb056cf7d4b", + "loads": [ + 39, + 34, + 38, + 12, + 16, + 24, + 30, + 3, + 24, + 3, + 9, + 37, + 42, + 30, + 21, + 31, + 23, + 43, + 8, + 5, + 60, + 52, + 67, + 33, + 30, + 30, + 13, + 42, + 32, + 14, + 45, + 20, + 12, + 10, + 28, + 24, + 27, + 14, + 10, + 21, + 36, + 25, + 17, + 43, + 35, + 37, + 39, + 14, + 26, + 38, + 39, + 26, + 17, + 19, + 8, + 24, + 30, + 32, + 2, + 6, + 69, + 19, + 45, + 38 + ], + "weighted_loads": [ + 2.152777487412095, + 2.6690266132354736, + 3.242887808009982, + 0.5363495573401451, + 0.7279083281755447, + 0.9857050888240337, + 2.073185605928302, + 0.121853556483984, + 1.0918716918677092, + 0.1873786859214306, + 0.49891082756221294, + 3.6064136289060116, + 2.936671817675233, + 1.7759014405310154, + 0.7734876293689013, + 1.6159570831805468, + 1.7928720749914646, + 1.7351086642593145, + 0.26951444894075394, + 0.3073244020342827, + 3.1872557029128075, + 3.1835453417152166, + 3.6252786573022604, + 2.752825751900673, + 1.3942187409847975, + 2.3952841367572546, + 0.7960808854550123, + 2.4824185241013765, + 1.7106168661266565, + 0.4982820488512516, + 2.0203559044748545, + 1.1704328525811434, + 0.6312225330621004, + 0.4869844280183315, + 2.243277322500944, + 0.8493067976087332, + 1.68548181373626, + 0.8840273432433605, + 0.3358315732330084, + 0.9618062488734722, + 2.830388993024826, + 1.154690945520997, + 1.007186833769083, + 3.8759550787508488, + 2.0275579802691936, + 2.1042278949171305, + 3.056909726932645, + 0.6315381284803152, + 1.2051681112498045, + 3.1793210934847593, + 2.0216822046786547, + 1.0401281379163265, + 0.9979252489283681, + 1.213186677545309, + 0.24774976819753647, + 1.5864624734967947, + 1.4448410049080849, + 2.6720168069005013, + 0.08165626227855682, + 0.24076939560472965, + 3.808696763589978, + 0.8570533115416765, + 2.8918762616813183, + 2.174481524154544 + ], + "unique_experts": 64, + "load_cv": 0.5465224136114942, + "normalized_load_entropy": 0.9619470069277817, + "max_load_share": 0.039655172413793106 + } + }, + "s0_x": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "13b14c52aa830a7bbdac548c1d56fe27dd2e1ba657d2d094d4cff3b7528f4597", + "route_weight_sha256": "54ce011e53e31c7926a49e1b1d1af1139fd8415159e42dffcd5ae1809aae38e8", + "loads": [ + 18, + 33, + 38, + 14, + 7, + 23, + 20, + 1, + 12, + 2, + 4, + 32, + 36, + 30, + 18, + 22, + 12, + 37, + 4, + 2, + 59, + 54, + 69, + 30, + 22, + 28, + 3, + 39, + 25, + 10, + 43, + 16, + 6, + 6, + 25, + 26, + 19, + 14, + 8, + 18, + 29, + 20, + 18, + 40, + 35, + 36, + 39, + 14, + 21, + 26, + 30, + 23, + 15, + 19, + 8, + 23, + 29, + 27, + 0, + 2, + 68, + 12, + 43, + 32 + ], + "weighted_loads": [ + 0.6945024952292442, + 2.6221435889601707, + 3.189496314153075, + 0.5836167130619287, + 0.2936690170317888, + 0.8754768762737513, + 1.1910357475280762, + 0.03957382217049599, + 0.5003085695207119, + 0.1392313651740551, + 0.2796406280249357, + 3.125783648341894, + 2.3961451053619385, + 1.7538276240229607, + 0.6403299495577812, + 0.9746804554015398, + 0.7359400130808353, + 1.4764001239091158, + 0.12642723135650158, + 0.062035348266363144, + 3.17037489823997, + 3.2125675175338984, + 3.6550786811858416, + 2.59831584431231, + 1.0742508545517921, + 2.265076410025358, + 0.11468721553683281, + 2.3295384403318167, + 1.283202227205038, + 0.38240125216543674, + 1.8972365651279688, + 0.721176341176033, + 0.2075678501278162, + 0.31136569380760193, + 2.09010187163949, + 0.9090827591717243, + 0.9130736347287893, + 0.9039412289857864, + 0.26493487134575844, + 0.8628756329417229, + 2.4070103373378515, + 0.9507342558354139, + 1.0299783665686846, + 3.532497566193342, + 1.96919447183609, + 2.043003397062421, + 3.0452607683837414, + 0.6197050046175718, + 0.9659454207867384, + 1.6047325171530247, + 1.4917272105813026, + 0.9408536031842232, + 0.9168456289917231, + 1.1130360718816519, + 0.2461661584675312, + 0.9443321395665407, + 1.391403716057539, + 2.0514204129576683, + 0.0, + 0.06425431370735168, + 3.7828691247850657, + 0.4758509695529938, + 2.81228568777442, + 1.8331972230225801 + ], + "unique_experts": 63, + "load_cv": 0.6607954776937834, + "normalized_load_entropy": 0.9449345596588383, + "max_load_share": 0.04618473895582329 + }, + "full_input": { + "tokens": 274, + "top_k": 6, + "decisions": 1644, + "ordered_route_sha256": "819ef3e4b8cd5ee5aef3250bb8865e21910a266c6ec2d274cc82bb45b8d34cec", + "route_weight_sha256": "6ebc6802603944b62c0124c17623c46e9193d347601d0d809eb09305531ec689", + "loads": [ + 22, + 33, + 38, + 14, + 14, + 24, + 28, + 3, + 18, + 3, + 9, + 34, + 41, + 30, + 27, + 23, + 19, + 39, + 4, + 4, + 59, + 54, + 69, + 37, + 24, + 29, + 14, + 39, + 28, + 10, + 47, + 16, + 12, + 8, + 25, + 26, + 24, + 14, + 9, + 18, + 35, + 20, + 18, + 43, + 36, + 36, + 39, + 15, + 22, + 35, + 35, + 25, + 21, + 19, + 8, + 26, + 29, + 27, + 1, + 2, + 68, + 15, + 44, + 36 + ], + "weighted_loads": [ + 0.9731261562556028, + 2.6221435889601707, + 3.189496314153075, + 0.5836167130619287, + 0.6497843433171511, + 0.8942855391651392, + 1.8526604287326336, + 0.10613786056637764, + 0.9604700319468975, + 0.17067727074027061, + 0.49338243901729584, + 3.2630916945636272, + 2.833105769008398, + 1.7538276240229607, + 1.0074630808085203, + 1.0096700061112642, + 1.3768480382859707, + 1.5491074118763208, + 0.12642723135650158, + 0.19005724042654037, + 3.17037489823997, + 3.2125675175338984, + 3.6550786811858416, + 3.0078376438468695, + 1.1293835416436195, + 2.2935542706400156, + 0.873563177883625, + 2.3295384403318167, + 1.3974328003823757, + 0.38240125216543674, + 2.068904183804989, + 0.721176341176033, + 0.660343723371625, + 0.40056680142879486, + 2.09010187163949, + 0.9090827591717243, + 1.6528861476108432, + 0.9039412289857864, + 0.29595092311501503, + 0.8628756329417229, + 2.7580610010772943, + 0.9507342558354139, + 1.0299783665686846, + 3.6935363486409187, + 2.0104998387396336, + 2.043003397062421, + 3.0452607683837414, + 0.6540524046868086, + 0.9794361311942339, + 2.306831229478121, + 1.8629560023546219, + 1.0254903584718704, + 1.101916995830834, + 1.1130360718816519, + 0.2461661584675312, + 1.6319854464381933, + 1.391403716057539, + 2.0514204129576683, + 0.04506808519363403, + 0.06425431370735168, + 3.7828691247850657, + 0.6309950277209282, + 2.8449144922196865, + 2.107736414298415 + ], + "unique_experts": 64, + "load_cv": 0.5851518278183955, + "normalized_load_entropy": 0.9568059475386086, + "max_load_share": 0.041970802919708027 + } + }, + "s1_x": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "9f4950e3d9ee033b5b9e9d3e5981c001c2319dbd7689c5f169ec773dd5e7d971", + "route_weight_sha256": "6aa7abba159869f70d8b8c10bdca5bf2b4d6476a09847affb9ea1178f6078e98", + "loads": [ + 19, + 33, + 38, + 14, + 7, + 20, + 16, + 2, + 17, + 2, + 5, + 31, + 37, + 29, + 19, + 19, + 11, + 38, + 6, + 1, + 58, + 52, + 70, + 28, + 26, + 29, + 2, + 39, + 25, + 9, + 39, + 15, + 5, + 7, + 25, + 24, + 20, + 14, + 10, + 18, + 30, + 23, + 18, + 41, + 34, + 35, + 38, + 13, + 22, + 26, + 30, + 23, + 15, + 19, + 7, + 22, + 31, + 29, + 0, + 3, + 69, + 12, + 43, + 32 + ], + "weighted_loads": [ + 0.7540064752101898, + 2.6523703262209892, + 3.2009893842041492, + 0.6121870465576649, + 0.3141186572611332, + 0.7727522980421782, + 1.0015619043260813, + 0.08852400630712509, + 0.6828048676252365, + 0.14853434637188911, + 0.3070831261575222, + 3.02224356867373, + 2.418124556541443, + 1.6971436608582735, + 0.6975384335964918, + 0.8495141714811325, + 0.6769877038896084, + 1.5147143062204123, + 0.1748623587191105, + 0.03694385662674904, + 3.152458854019642, + 3.164345160126686, + 3.7282405849546194, + 2.5388999171555042, + 1.2269882410764694, + 2.3054737001657486, + 0.0680973008275032, + 2.338087484240532, + 1.279734205454588, + 0.316166702657938, + 1.7809576448053122, + 0.6871836949139833, + 0.17492684349417686, + 0.33552075549960136, + 2.0901504699140787, + 0.8467429708689451, + 0.9555576201528311, + 0.8855900783091784, + 0.32707020081579685, + 0.8440668322145939, + 2.4309535529464483, + 1.0441152155399323, + 1.0092423744499683, + 3.596175231039524, + 1.9362687449902296, + 2.0024244748055935, + 3.059916917234659, + 0.5867819394916296, + 1.0209089890122414, + 1.5824238006025553, + 1.529558151960373, + 0.965624438598752, + 0.9332107529044151, + 1.107320323586464, + 0.21134569495916367, + 0.9105962533503771, + 1.4812736306339502, + 2.116118062287569, + 0.0, + 0.12369370460510254, + 3.787352716550231, + 0.48579282499849796, + 2.798269160091877, + 1.7655681520700455 + ], + "unique_experts": 63, + "load_cv": 0.6558738301847942, + "normalized_load_entropy": 0.9460001772318236, + "max_load_share": 0.04685408299866131 + }, + "full_input": { + "tokens": 290, + "top_k": 6, + "decisions": 1740, + "ordered_route_sha256": "2ddc0b2566f1703d6a3b48d17517429b441cb5e86080f270aa0565045f92f555", + "route_weight_sha256": "a5cbb20fcede17663876086c1970cd97bb537a76c37bcf9e6f0f559faec6785f", + "loads": [ + 39, + 34, + 38, + 14, + 14, + 23, + 29, + 3, + 29, + 3, + 11, + 36, + 43, + 30, + 23, + 28, + 23, + 42, + 7, + 6, + 59, + 53, + 70, + 34, + 28, + 30, + 14, + 41, + 31, + 10, + 45, + 19, + 13, + 10, + 27, + 24, + 26, + 14, + 12, + 19, + 34, + 24, + 18, + 44, + 35, + 36, + 38, + 14, + 26, + 38, + 38, + 26, + 17, + 20, + 7, + 25, + 31, + 35, + 2, + 7, + 69, + 20, + 46, + 36 + ], + "weighted_loads": [ + 2.128597741946578, + 2.6784117463976145, + 3.2009893842041492, + 0.6121870465576649, + 0.6600160822272301, + 0.9269976671785116, + 2.0568927358835936, + 0.12162450328469276, + 1.4155354648828506, + 0.17957688122987747, + 0.5925612822175026, + 3.4691286720335484, + 2.9408479630947113, + 1.7804853785783052, + 0.8566530644893646, + 1.4946344047784805, + 1.7844919264316559, + 1.667863866314292, + 0.22728296369314194, + 0.35901211202144623, + 3.181306205689907, + 3.2473087683320045, + 3.7282405849546194, + 2.8533534221351147, + 1.2886642217636108, + 2.3339761681854725, + 0.9185124412178993, + 2.460486050695181, + 1.693041417747736, + 0.3542770594358444, + 2.0051866620779037, + 1.1349202897399664, + 0.692877072840929, + 0.4658377431333065, + 2.239159794524312, + 0.8467429708689451, + 1.6342654591426253, + 0.8855900783091784, + 0.3913735169917345, + 0.8798908889293671, + 2.659113999456167, + 1.1321697756648064, + 1.0092423744499683, + 3.9999244399368763, + 1.9688446130603552, + 2.039923518896103, + 3.059916917234659, + 0.6209557708352804, + 1.1941417250782251, + 3.051889142021537, + 1.9129144959151745, + 1.067428221926093, + 0.9815466506406665, + 1.2408061921596527, + 0.21134569495916367, + 1.5884860437363386, + 1.4812736306339502, + 2.7729980312287807, + 0.08165626227855682, + 0.30005432292819023, + 3.787352716550231, + 0.9210041556507349, + 2.962396275252104, + 1.9505656510591507 + ], + "unique_experts": 64, + "load_cv": 0.5472181899303719, + "normalized_load_entropy": 0.9622442858488837, + "max_load_share": 0.040229885057471264 + } + }, + "s0_period": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "a7c7d392ab0c36b4f24473ab5e48acfd1e1f07c2afb77ea1dfc4554154624549", + "route_weight_sha256": "ed56c82f0876b1971c42e309b148a7f16fdf8db1406f2e86cebeaf5b56f9164a", + "loads": [ + 19, + 31, + 38, + 13, + 8, + 22, + 15, + 1, + 11, + 2, + 4, + 32, + 36, + 31, + 19, + 22, + 12, + 38, + 4, + 1, + 59, + 54, + 67, + 29, + 25, + 28, + 3, + 39, + 25, + 10, + 42, + 15, + 4, + 6, + 26, + 25, + 20, + 14, + 10, + 19, + 29, + 22, + 19, + 40, + 36, + 36, + 40, + 14, + 20, + 25, + 30, + 23, + 14, + 21, + 8, + 25, + 30, + 26, + 0, + 2, + 69, + 11, + 44, + 31 + ], + "weighted_loads": [ + 0.7331232577562332, + 2.544688191264868, + 3.1607569735497236, + 0.5575073938816786, + 0.33374466747045517, + 0.8457733020186424, + 1.041310852393508, + 0.03936253488063812, + 0.45947412215173244, + 0.13977428898215294, + 0.2750559952110052, + 3.132950399070978, + 2.400746254250407, + 1.7823877036571503, + 0.6754698175936937, + 0.9839199278503656, + 0.7294483259320259, + 1.5104306004941463, + 0.12607000768184662, + 0.03847197815775871, + 3.172161305323243, + 3.21203906647861, + 3.5833891443908215, + 2.574418658390641, + 1.1622957214713097, + 2.251468848437071, + 0.10627845674753189, + 2.3212006706744432, + 1.2895586676895618, + 0.373729782178998, + 1.8861882146447897, + 0.668584180995822, + 0.15408196300268173, + 0.3134518302977085, + 2.1209361124783754, + 0.8949251286685467, + 0.9314136132597923, + 0.8908982314169407, + 0.3341506291180849, + 0.8996362574398518, + 2.437052119523287, + 1.0236747823655605, + 1.061722407117486, + 3.5462768729776144, + 2.0146960373967886, + 2.0483278408646584, + 3.089923109859228, + 0.622952226549387, + 0.9362348634749651, + 1.5977794863283634, + 1.438591942191124, + 0.9385036937892437, + 0.8879056740552187, + 1.1769456304609776, + 0.24904531426727772, + 1.0132372789084911, + 1.4239020179957151, + 2.0098643749952316, + 0.0, + 0.06359276920557022, + 3.8325243834406137, + 0.44834792986512184, + 2.8577715903520584, + 1.7827993799000978 + ], + "unique_experts": 63, + "load_cv": 0.6625288923154152, + "normalized_load_entropy": 0.9440927560606533, + "max_load_share": 0.04618473895582329 + }, + "full_input": { + "tokens": 274, + "top_k": 6, + "decisions": 1644, + "ordered_route_sha256": "8b90936b3a85e2bb4c31e2e775e67f18ec76316fc8732d31ffb6aa7b2c567885", + "route_weight_sha256": "d738461a5f4a77e078e0ab616b2276966231b472209c261cfc7a7e52908dd054", + "loads": [ + 23, + 31, + 38, + 13, + 16, + 23, + 24, + 3, + 16, + 3, + 8, + 35, + 41, + 31, + 28, + 23, + 19, + 40, + 4, + 2, + 59, + 54, + 67, + 36, + 27, + 29, + 14, + 39, + 28, + 10, + 46, + 15, + 10, + 8, + 26, + 25, + 26, + 14, + 11, + 19, + 35, + 22, + 19, + 42, + 37, + 36, + 40, + 15, + 21, + 34, + 35, + 25, + 19, + 21, + 8, + 28, + 30, + 26, + 2, + 2, + 69, + 14, + 45, + 35 + ], + "weighted_loads": [ + 1.0140493903309107, + 2.544688191264868, + 3.1607569735497236, + 0.5575073938816786, + 0.764523496851325, + 0.8645819649100304, + 1.7290446776896715, + 0.10592657327651978, + 0.8796069379895926, + 0.17122019454836845, + 0.42293698340654373, + 3.3132836036384106, + 2.814674088731408, + 1.7823877036571503, + 1.0426029488444328, + 1.01890947856009, + 1.358775332570076, + 1.5831378884613514, + 0.12607000768184662, + 0.11755258217453957, + 3.172161305323243, + 3.21203906647861, + 3.5833891443908215, + 2.9710327591747046, + 1.217428408563137, + 2.2799467090517282, + 0.7936108894646168, + 2.3212006706744432, + 1.4037892408668995, + 0.373729782178998, + 2.0578558333218098, + 0.668584180995822, + 0.6062160190194845, + 0.40265293791890144, + 2.1209361124783754, + 0.8949251286685467, + 1.7293902086094022, + 0.8908982314169407, + 0.3651666808873415, + 0.8996362574398518, + 2.870880238711834, + 1.0236747823655605, + 1.061722407117486, + 3.6318290401250124, + 2.0581497456878424, + 2.0483278408646584, + 3.089923109859228, + 0.6572996266186237, + 0.9497255738824606, + 2.3343825303018093, + 1.8115669824182987, + 1.023140449076891, + 1.0353293092921376, + 1.1769456304609776, + 0.24904531426727772, + 1.7097491472959518, + 1.4239020179957151, + 2.0098643749952316, + 0.09826940298080444, + 0.06359276920557022, + 3.8325243834406137, + 0.6800359301269054, + 2.8909215070307255, + 2.085767125710845 + ], + "unique_experts": 64, + "load_cv": 0.5851113587879465, + "normalized_load_entropy": 0.9565367102862968, + "max_load_share": 0.041970802919708027 + } + }, + "s1_period": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "50201a1e5e68d9e1538204f2cfc7bf21842ff6537f4390a2f1a6a14f706325d4", + "route_weight_sha256": "28f46e0da0e96cd40a68aba44881de03fa64d0bc0a095a37e378ad864ad341e6", + "loads": [ + 18, + 32, + 39, + 15, + 8, + 20, + 15, + 2, + 17, + 2, + 4, + 32, + 37, + 29, + 18, + 22, + 11, + 36, + 7, + 1, + 58, + 53, + 70, + 30, + 25, + 29, + 3, + 39, + 24, + 11, + 39, + 14, + 5, + 6, + 24, + 22, + 20, + 12, + 13, + 18, + 29, + 21, + 18, + 40, + 38, + 34, + 39, + 13, + 23, + 25, + 28, + 24, + 15, + 18, + 10, + 21, + 31, + 28, + 0, + 3, + 68, + 12, + 45, + 31 + ], + "weighted_loads": [ + 0.7370546292513609, + 2.637690953910351, + 3.2034767530858517, + 0.6362743936479092, + 0.3527405448257923, + 0.7692874819040298, + 0.9531321153044701, + 0.09089070558547974, + 0.6634924542158842, + 0.153978381305933, + 0.26754132099449635, + 3.080476503819227, + 2.435435092076659, + 1.702183911576867, + 0.6466453988105059, + 0.95090426877141, + 0.6451313234865665, + 1.466060534119606, + 0.20056170411407948, + 0.0381290428340435, + 3.1856260541826487, + 3.1742420736700296, + 3.7255943473428488, + 2.63003733754158, + 1.19110444560647, + 2.3266075402498245, + 0.11170410737395287, + 2.3309027329087257, + 1.2522659339010715, + 0.39107463881373405, + 1.7952318992465734, + 0.6665553636848927, + 0.17459867894649506, + 0.3018601294606924, + 2.065571751445532, + 0.7946929801255465, + 0.9596643019467592, + 0.809036411345005, + 0.4410122875124216, + 0.8492790497839451, + 2.417583730071783, + 0.986765680834651, + 1.02925774641335, + 3.57026781514287, + 2.104653799906373, + 2.0097650662064552, + 3.08607430011034, + 0.5884834378957748, + 1.0466496739536524, + 1.5693028885871172, + 1.4932843558490276, + 0.9807591196149588, + 0.9376123696565628, + 1.0840551797300577, + 0.3041403889656067, + 0.8909053355455399, + 1.472615648061037, + 2.076250499114394, + 0.0, + 0.10384233668446541, + 3.776325795799494, + 0.5025238282978535, + 2.8676988538354635, + 1.7438498232513666 + ], + "unique_experts": 63, + "load_cv": 0.6531577014109701, + "normalized_load_entropy": 0.9469149753979138, + "max_load_share": 0.04685408299866131 + }, + "full_input": { + "tokens": 290, + "top_k": 6, + "decisions": 1740, + "ordered_route_sha256": "6e515782226e2d12f14d6f57416a6cd86eee35fab52dcbee87d3a3516d10d2d1", + "route_weight_sha256": "3c9d786fb1092c445c6f329fdea44eefbe56ff408554ff76611b98bbb5943d31", + "loads": [ + 38, + 33, + 39, + 15, + 16, + 23, + 28, + 3, + 29, + 3, + 10, + 37, + 43, + 30, + 22, + 32, + 23, + 40, + 8, + 5, + 59, + 54, + 70, + 35, + 27, + 30, + 14, + 41, + 30, + 12, + 45, + 18, + 12, + 10, + 26, + 22, + 26, + 12, + 16, + 19, + 34, + 22, + 18, + 43, + 39, + 35, + 39, + 16, + 26, + 36, + 35, + 26, + 17, + 19, + 10, + 24, + 31, + 34, + 3, + 7, + 68, + 20, + 48, + 35 + ], + "weighted_loads": [ + 2.1134202238172293, + 2.663732374086976, + 3.2034767530858517, + 0.6362743936479092, + 0.7867968678474426, + 0.9235328510403633, + 2.0333369001746178, + 0.12399120256304741, + 1.3631379064172506, + 0.18502091616392136, + 0.5304075181484222, + 3.5171386059373617, + 2.94575366191566, + 1.7855256292968988, + 0.8057600297033787, + 1.6326783448457718, + 1.7369693741202354, + 1.6192100942134857, + 0.2529823090881109, + 0.30813539400696754, + 3.214473405852914, + 3.257205681875348, + 3.7255943473428488, + 2.870121791958809, + 1.2527804262936115, + 2.3551100082695484, + 0.8542503416538239, + 2.4533012993633747, + 1.6655731461942196, + 0.4291849955916405, + 2.019460916519165, + 1.1142919585108757, + 0.6343513019382954, + 0.4635756593197584, + 2.214581076055765, + 0.7946929801255465, + 1.766356292180717, + 0.809036411345005, + 0.5478204023092985, + 0.8851031064987183, + 2.751289153471589, + 1.074820240959525, + 1.02925774641335, + 3.896467324346304, + 2.1523724030703306, + 2.0472641102969646, + 3.08607430011034, + 0.6842623390257359, + 1.188791373744607, + 3.0151827838271856, + 1.8534155413508415, + 1.0480609368532896, + 0.9859482673928142, + 1.2175410483032465, + 0.3041403889656067, + 1.5765812136232853, + 1.472615648061037, + 2.733130468055606, + 0.14756887406110764, + 0.2802029550075531, + 3.776325795799494, + 1.043892741203308, + 3.0486045200377703, + 1.9288470316678286 + ], + "unique_experts": 64, + "load_cv": 0.5414708173634866, + "normalized_load_entropy": 0.9634546439751842, + "max_load_share": 0.040229885057471264 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 249, + "ordered_topk_exact_tokens": 165, + "set_exact_tokens": 198, + "mean_set_jaccard": 0.9388984509466437, + "mean_token_weighted_tv": 0.011273728795798427, + "aggregate_load_tv": 0.018072289156626505 + }, + "system_bos": { + "tokens": 249, + "ordered_topk_exact_tokens": 144, + "set_exact_tokens": 174, + "mean_set_jaccard": 0.9113597246127367, + "mean_token_weighted_tv": 0.01599004078491864, + "aggregate_load_tv": 0.02610441767068273 + }, + "system_x": { + "tokens": 249, + "ordered_topk_exact_tokens": 128, + "set_exact_tokens": 157, + "mean_set_jaccard": 0.884299101166571, + "mean_token_weighted_tv": 0.020645814910381435, + "aggregate_load_tv": 0.02342704149933066 + }, + "system_period": { + "tokens": 249, + "ordered_topk_exact_tokens": 131, + "set_exact_tokens": 158, + "mean_set_jaccard": 0.8871677184930196, + "mean_token_weighted_tv": 0.020705638973259305, + "aggregate_load_tv": 0.02677376171352075 + }, + "bos_at_s0": { + "tokens": 249, + "ordered_topk_exact_tokens": 127, + "set_exact_tokens": 168, + "mean_set_jaccard": 0.9036144578313252, + "mean_token_weighted_tv": 0.018058878003084755, + "aggregate_load_tv": 0.024765729585006696 + }, + "bos_at_s1": { + "tokens": 249, + "ordered_topk_exact_tokens": 127, + "set_exact_tokens": 158, + "mean_set_jaccard": 0.891279403327596, + "mean_token_weighted_tv": 0.020510315442510158, + "aggregate_load_tv": 0.02744310575635877 + }, + "x_at_s0": { + "tokens": 249, + "ordered_topk_exact_tokens": 137, + "set_exact_tokens": 164, + "mean_set_jaccard": 0.8981640849110728, + "mean_token_weighted_tv": 0.0187165884667611, + "aggregate_load_tv": 0.029451137884872816 + }, + "x_at_s1": { + "tokens": 249, + "ordered_topk_exact_tokens": 114, + "set_exact_tokens": 145, + "mean_set_jaccard": 0.8731114935934212, + "mean_token_weighted_tv": 0.023368222448211837, + "aggregate_load_tv": 0.03212851405622489 + }, + "period_at_s0": { + "tokens": 249, + "ordered_topk_exact_tokens": 130, + "set_exact_tokens": 159, + "mean_set_jaccard": 0.8924268502581756, + "mean_token_weighted_tv": 0.01977403396104713, + "aggregate_load_tv": 0.027443105756358766 + }, + "period_at_s1": { + "tokens": 249, + "ordered_topk_exact_tokens": 110, + "set_exact_tokens": 140, + "mean_set_jaccard": 0.8690954293363932, + "mean_token_weighted_tv": 0.023549643113281594, + "aggregate_load_tv": 0.03614457831325301 + } + } + }, + "layer_16": { + "layer": 16, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "8eb928749ea97bb16d7a616fa4afb7893e54345e91b3c3e5426c97bf36256dfa", + "route_weight_sha256": "46a861acffff8b4f463b5e055c05b4ddeced36a6a47d865e3ef3761f0d0fa12e", + "loads": [ + 35, + 45, + 17, + 27, + 45, + 7, + 26, + 25, + 18, + 37, + 4, + 13, + 59, + 6, + 0, + 18, + 21, + 21, + 5, + 15, + 11, + 1, + 3, + 36, + 5, + 11, + 26, + 130, + 20, + 99, + 18, + 23, + 12, + 29, + 3, + 33, + 43, + 21, + 21, + 14, + 22, + 18, + 27, + 24, + 40, + 21, + 7, + 28, + 14, + 15, + 10, + 29, + 0, + 23, + 21, + 3, + 52, + 27, + 22, + 21, + 8, + 16, + 34, + 9 + ], + "weighted_loads": [ + 3.1214408800005913, + 2.400049488991499, + 0.6092884000390768, + 1.814117006957531, + 2.091774106025696, + 0.231820497661829, + 1.3365023657679558, + 2.248892303556204, + 1.2286713980138302, + 2.1156187374144793, + 0.374772522598505, + 0.4469535071402788, + 2.882127797231078, + 0.2190233152359724, + 0.0, + 1.0906108301132917, + 1.579504357650876, + 1.667227953672409, + 0.2022083792835474, + 0.7195571605116129, + 0.557277599349618, + 0.05467233434319496, + 0.14232902973890305, + 2.4793139453977346, + 0.2006889246404171, + 0.5740109346807003, + 1.3784635700285435, + 9.141138045117259, + 1.1081956624984741, + 6.462657336145639, + 0.7490026708692312, + 0.9532226417213678, + 0.9450043514370918, + 1.3255287073552608, + 0.09312247857451439, + 2.6152900010347366, + 2.6258697155863047, + 2.184068214148283, + 1.4236745536327362, + 0.7413675654679537, + 1.5832402519881725, + 0.68744046241045, + 1.1788846459239721, + 1.1116380114108324, + 2.2685386147350073, + 1.2733372785151005, + 0.3489795811474323, + 1.5597797334194183, + 0.8038841038942337, + 0.7299300972372293, + 0.4828724805265665, + 1.8444507885724306, + 0.0, + 3.5709577091038227, + 0.8482396434992552, + 0.11786239966750145, + 3.359313504770398, + 1.4580716397613287, + 1.1285699903964996, + 1.1721541862934828, + 0.39125431329011917, + 0.5719565115869045, + 2.0707403421401978, + 0.354366984218359 + ], + "unique_experts": 62, + "load_cv": 0.8972116854033038, + "normalized_load_entropy": 0.9241261255780796, + "max_load_share": 0.08701472556894244 + }, + "full_input": { + "tokens": 274, + "top_k": 6, + "decisions": 1644, + "ordered_route_sha256": "a2a26ecfc36346e8e3cc6b38271996f0ddaa5682a54f7add3f9f43b4dd671293", + "route_weight_sha256": "101797cd78de7c847e969947a137685bd230ba0d88bf8249e0a514ae9d920b5a", + "loads": [ + 36, + 45, + 17, + 27, + 45, + 16, + 31, + 25, + 18, + 40, + 7, + 13, + 59, + 7, + 0, + 25, + 30, + 25, + 10, + 17, + 22, + 3, + 6, + 36, + 12, + 11, + 31, + 130, + 20, + 99, + 19, + 23, + 13, + 36, + 3, + 33, + 43, + 30, + 21, + 14, + 25, + 25, + 27, + 24, + 44, + 23, + 7, + 29, + 14, + 16, + 10, + 31, + 0, + 35, + 21, + 13, + 52, + 27, + 22, + 21, + 11, + 19, + 34, + 16 + ], + "weighted_loads": [ + 3.2196786925196648, + 2.400049488991499, + 0.6092884000390768, + 1.814117006957531, + 2.091774106025696, + 1.0457898396998644, + 1.5552088283002377, + 2.248892303556204, + 1.2286713980138302, + 3.4689975176006556, + 0.5500170029699802, + 0.4469535071402788, + 2.882127797231078, + 0.23838072270154953, + 0.0, + 1.7172179874032736, + 2.1042057797312737, + 2.003244809806347, + 0.8431056682020426, + 0.7616127843502909, + 1.5084976758807898, + 0.13508932292461395, + 0.30085439048707485, + 2.4793139453977346, + 0.8457366600632668, + 0.5740109346807003, + 1.6553145181387663, + 9.141138045117259, + 1.1081956624984741, + 6.462657336145639, + 0.8234362434595823, + 0.9532226417213678, + 0.9863371849060059, + 1.6456650318577886, + 0.09312247857451439, + 2.6152900010347366, + 2.6258697155863047, + 2.6974259093403816, + 1.4236745536327362, + 0.7413675654679537, + 1.7050512470304966, + 1.63585764169693, + 1.1788846459239721, + 1.1116380114108324, + 2.4275524634867907, + 1.4424470998346806, + 0.3489795811474323, + 1.5933531373739243, + 0.8038841038942337, + 0.7472319267690182, + 0.4828724805265665, + 1.9413347076624632, + 0.0, + 4.388052882626653, + 0.8482396434992552, + 0.9220854677259922, + 3.359313504770398, + 1.4580716397613287, + 1.1285699903964996, + 1.1721541862934828, + 0.5916611850261688, + 0.6950397557811812, + 2.0707403421401978, + 0.6804831866174936 + ], + "unique_experts": 62, + "load_cv": 0.7949579449730568, + "normalized_load_entropy": 0.9392796491634287, + "max_load_share": 0.07907542579075426 + } + }, + "s1_eos": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "c0027d8333c21593b8a3278588a354ef93b769150345d62bd417e8976f5cdb4b", + "route_weight_sha256": "965d3c043ba3d224eb80dca9a8129315e34e3100863a3cbb0d44e47714877cd3", + "loads": [ + 35, + 47, + 15, + 27, + 46, + 6, + 26, + 26, + 17, + 36, + 5, + 10, + 62, + 6, + 0, + 18, + 21, + 20, + 5, + 15, + 11, + 1, + 3, + 38, + 5, + 13, + 26, + 134, + 19, + 98, + 17, + 24, + 12, + 30, + 3, + 33, + 43, + 20, + 21, + 16, + 21, + 15, + 27, + 23, + 38, + 20, + 6, + 30, + 14, + 16, + 11, + 28, + 0, + 23, + 20, + 4, + 52, + 28, + 22, + 20, + 8, + 16, + 32, + 10 + ], + "weighted_loads": [ + 3.134108815342188, + 2.464952703565359, + 0.552226921543479, + 1.8054096009582281, + 2.137266406789422, + 0.2075211089104414, + 1.3536841161549091, + 2.2835644520819187, + 1.1850200444459915, + 2.1081067211925983, + 0.4165804088115692, + 0.3526321016252041, + 2.9597674924880266, + 0.22137940861284733, + 0.0, + 1.0754599273204803, + 1.5781280603259802, + 1.5959689561277628, + 0.19655417278409004, + 0.7358601540327072, + 0.5320467874407768, + 0.05619439855217934, + 0.13962985575199127, + 2.535009214654565, + 0.2078680694103241, + 0.6427499279379845, + 1.3354095555841923, + 9.270994562655687, + 1.0814949311316013, + 6.467139454558492, + 0.7190667241811752, + 0.9833180215209723, + 0.9351852759718895, + 1.3616248946636915, + 0.094454076141119, + 2.593793209642172, + 2.6381278168410063, + 2.1079844534397125, + 1.419164251536131, + 0.7975317966192961, + 1.5223003830760717, + 0.5772873684763908, + 1.1537734251469374, + 1.062875034287572, + 2.2050630170851946, + 1.2227017916738987, + 0.3292560651898384, + 1.6080618109554052, + 0.8000407386571169, + 0.7444821018725634, + 0.505724124610424, + 1.7985181417316198, + 0.0, + 3.5437321066856384, + 0.8238103520125151, + 0.18398615345358849, + 3.36595962010324, + 1.4780766908079386, + 1.1468058936297894, + 1.1251120772212744, + 0.39001765474677086, + 0.5864679235965014, + 1.9653285518288612, + 0.3889131285250187 + ], + "unique_experts": 62, + "load_cv": 0.9144317568136409, + "normalized_load_entropy": 0.9225244878479119, + "max_load_share": 0.08969210174029452 + }, + "full_input": { + "tokens": 290, + "top_k": 6, + "decisions": 1740, + "ordered_route_sha256": "05c3ab8be600dcceabcc1ddb0805671357fb96c3149b13118f87dfb4a55ea1b0", + "route_weight_sha256": "c33570e2f9c5a58de941f5a3faef1268860fd8483e38e864907b063f207990d4", + "loads": [ + 36, + 50, + 15, + 29, + 46, + 14, + 32, + 27, + 17, + 40, + 11, + 11, + 62, + 10, + 1, + 29, + 31, + 31, + 13, + 17, + 22, + 3, + 6, + 39, + 19, + 13, + 36, + 134, + 19, + 98, + 20, + 24, + 17, + 35, + 4, + 35, + 43, + 29, + 24, + 19, + 25, + 29, + 29, + 25, + 41, + 26, + 7, + 37, + 17, + 21, + 17, + 28, + 0, + 36, + 20, + 15, + 54, + 28, + 22, + 21, + 12, + 18, + 35, + 16 + ], + "weighted_loads": [ + 3.2311093769967556, + 2.586683228611946, + 0.552226921543479, + 1.8950704615563154, + 2.137266406789422, + 0.9889529142528772, + 1.6453051529824734, + 2.309033188968897, + 1.1850200444459915, + 3.493191124871373, + 0.6281279940158129, + 0.3826713114976883, + 2.9597674924880266, + 0.3419436514377594, + 0.04560593515634537, + 2.185282986611128, + 2.066853143274784, + 2.4034650903195143, + 1.0969986841082573, + 0.7727237439248711, + 1.4564032536000013, + 0.14493120834231377, + 0.25687507167458534, + 2.6125265154987574, + 1.352430623024702, + 0.6427499279379845, + 2.492537960410118, + 9.270994562655687, + 1.0814949311316013, + 6.467139454558492, + 0.8590545207262039, + 0.9833180215209723, + 1.154844056814909, + 1.5748884952627122, + 0.13081780076026917, + 2.721991542726755, + 2.6381278168410063, + 2.6105414777994156, + 1.5726991705596447, + 0.9748401734977961, + 1.6735965851694345, + 2.5874744281172752, + 1.217591943219304, + 1.1532761063426733, + 2.307287296280265, + 1.5605593845248222, + 0.3608122877776623, + 1.9343561921268702, + 0.9199518859386444, + 0.9554402679204941, + 0.7653968930244446, + 1.7985181417316198, + 0.0, + 4.66583664342761, + 0.8238103520125151, + 1.1761040687561035, + 3.4735083896666765, + 1.4780766908079386, + 1.1468058936297894, + 1.3266451116651297, + 0.5793337188661098, + 0.6431803132873029, + 2.292266119271517, + 0.6847254652529955 + ], + "unique_experts": 63, + "load_cv": 0.7565663581257026, + "normalized_load_entropy": 0.944931367997892, + "max_load_share": 0.07701149425287357 + } + }, + "s0_bos": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "35fdffb0b48aad5502fa2e065909a84ff646d03448336cef9e0a9906e2c75f9d", + "route_weight_sha256": "6adfe97fafe6dbb769d6e5469fbe83cdc0b2009614aed30fe3da361e6397c829", + "loads": [ + 35, + 48, + 16, + 27, + 43, + 5, + 27, + 26, + 18, + 38, + 3, + 10, + 61, + 7, + 0, + 18, + 20, + 21, + 4, + 16, + 10, + 1, + 3, + 35, + 6, + 12, + 27, + 135, + 19, + 98, + 18, + 25, + 13, + 26, + 5, + 31, + 43, + 20, + 21, + 15, + 23, + 16, + 26, + 23, + 41, + 20, + 6, + 30, + 14, + 15, + 9, + 30, + 0, + 21, + 22, + 4, + 52, + 28, + 22, + 22, + 8, + 14, + 34, + 8 + ], + "weighted_loads": [ + 3.1204613614827394, + 2.4583470672369003, + 0.5902671162039042, + 1.815745297819376, + 1.9894305057823658, + 0.1774027794599533, + 1.340742526575923, + 2.3147600479424, + 1.2344279866665602, + 2.1693398039788008, + 0.35547210089862347, + 0.34450705349445343, + 2.9471058659255505, + 0.2456053178757429, + 0.0, + 1.0672036055475473, + 1.4577459543943405, + 1.640933133661747, + 0.1775338128209114, + 0.7519537936896086, + 0.4774588271975517, + 0.05781615525484085, + 0.15063861198723316, + 2.445662558078766, + 0.24469240196049213, + 0.6101282350718975, + 1.4300481379032135, + 9.358895726501942, + 1.1029032096266747, + 6.5486105270683765, + 0.7694106437265873, + 1.0168258119374514, + 0.9798074681311846, + 1.2206654027104378, + 0.14828728698194027, + 2.565027305856347, + 2.6460162233561277, + 2.0925651248544455, + 1.4396953620016575, + 0.7634832095354795, + 1.625335918739438, + 0.6169691756367683, + 1.1423295363783836, + 1.081785848364234, + 2.2752579674124718, + 1.253578569740057, + 0.31716946698725224, + 1.6472696419805288, + 0.8043344058096409, + 0.7342928405851126, + 0.444608960300684, + 1.8866022564470768, + 0.0, + 3.548742465674877, + 0.9016775917261839, + 0.17339287884533405, + 3.3622113801538944, + 1.5104225296527147, + 1.148463424295187, + 1.2266207300126553, + 0.37141018360853195, + 0.4822385124862194, + 2.053652908653021, + 0.31703393161296844 + ], + "unique_experts": 62, + "load_cv": 0.9184053976990839, + "normalized_load_entropy": 0.9217335355824485, + "max_load_share": 0.09036144578313253 + }, + "full_input": { + "tokens": 274, + "top_k": 6, + "decisions": 1644, + "ordered_route_sha256": "b2ecf99f4525f04c392e6f95547840f47d0bc5931a32402819759f2daeb41750", + "route_weight_sha256": "2e7c2da07fb85ffb04c8375931eac032b37155a0d46474ba32342afee5eacf4b", + "loads": [ + 36, + 48, + 17, + 27, + 43, + 14, + 32, + 26, + 18, + 41, + 6, + 11, + 62, + 8, + 0, + 25, + 28, + 25, + 9, + 18, + 21, + 3, + 6, + 35, + 12, + 12, + 30, + 135, + 19, + 98, + 19, + 25, + 16, + 31, + 6, + 31, + 43, + 29, + 21, + 15, + 26, + 25, + 26, + 23, + 45, + 22, + 6, + 30, + 14, + 17, + 10, + 32, + 0, + 33, + 22, + 14, + 52, + 28, + 22, + 22, + 11, + 16, + 34, + 13 + ], + "weighted_loads": [ + 3.20888645388186, + 2.4583470672369003, + 0.6327378917485476, + 1.815745297819376, + 1.9894305057823658, + 0.9913721214979887, + 1.5592677872627974, + 2.3147600479424, + 1.2344279866665602, + 2.6113569512963295, + 0.5307165812700987, + 0.3857039585709572, + 3.0254245810210705, + 0.26496272534132004, + 0.0, + 1.677591623738408, + 2.437512746080756, + 1.9983723759651184, + 0.7764112055301666, + 0.8243604023009539, + 1.4286789037287235, + 0.13823314383625984, + 0.30916397273540497, + 2.445662558078766, + 0.8440509829670191, + 0.6101282350718975, + 1.6071651801466942, + 9.358895726501942, + 1.1029032096266747, + 6.5486105270683765, + 0.8438442163169384, + 1.0168258119374514, + 1.0825265906751156, + 1.4969164971262217, + 0.2563038747757673, + 2.565027305856347, + 2.6460162233561277, + 2.617507802322507, + 1.4396953620016575, + 0.7634832095354795, + 1.7513315882533789, + 1.6318934485316277, + 1.1423295363783836, + 1.081785848364234, + 2.4373149629682302, + 1.4226347021758556, + 0.31716946698725224, + 1.6472696419805288, + 0.8043344058096409, + 0.7969411835074425, + 0.4910461790859699, + 1.9834861755371094, + 0.0, + 4.3783245626837015, + 0.9016775917261839, + 0.9776159469038248, + 3.3622113801538944, + 1.5104225296527147, + 1.148463424295187, + 1.2266207300126553, + 0.5477677211165428, + 0.5862032920122147, + 2.053652908653021, + 0.595359006896615 + ], + "unique_experts": 62, + "load_cv": 0.8109712063030694, + "normalized_load_entropy": 0.9382806109619789, + "max_load_share": 0.08211678832116788 + } + }, + "s1_bos": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "f85814607617c052415f3f8e61e96326378f3c463a8f9acecd280f8839d17477", + "route_weight_sha256": "7ea539c03affb4fe520ebae0cd6e520594b618751caed8275f2663bc13e573a2", + "loads": [ + 35, + 49, + 16, + 26, + 45, + 5, + 26, + 29, + 18, + 37, + 3, + 13, + 61, + 7, + 0, + 18, + 24, + 21, + 5, + 15, + 12, + 1, + 3, + 35, + 7, + 11, + 27, + 136, + 20, + 98, + 18, + 27, + 13, + 27, + 4, + 31, + 43, + 20, + 21, + 15, + 23, + 15, + 25, + 23, + 37, + 19, + 6, + 30, + 13, + 14, + 10, + 30, + 0, + 21, + 22, + 4, + 52, + 25, + 22, + 21, + 6, + 13, + 34, + 7 + ], + "weighted_loads": [ + 3.153284901753068, + 2.4933243691921234, + 0.5987912956625223, + 1.8090082928538322, + 2.103586556389928, + 0.16095472127199173, + 1.2909281123429537, + 2.4151875469833612, + 1.2185703981667757, + 2.2005732096731663, + 0.36711868457496166, + 0.4283722620457411, + 2.9355612210929394, + 0.2372277919203043, + 0.0, + 1.0370180122554302, + 1.6078338287770748, + 1.6083426140248775, + 0.20324143394827843, + 0.7171905841678381, + 0.5178639069199562, + 0.0571516677737236, + 0.12532218545675278, + 2.4557372145354748, + 0.28952845372259617, + 0.579376820474863, + 1.4313939195126295, + 9.557681765407324, + 1.13069474324584, + 6.539185393601656, + 0.7577164806425571, + 1.0715939421206713, + 0.9817296303808689, + 1.2595169916749, + 0.11890507489442825, + 2.5602123215794563, + 2.646083550527692, + 2.100237490609288, + 1.4333555325865746, + 0.7705814726650715, + 1.6447562538087368, + 0.580588648095727, + 1.1083714831620455, + 1.0742680504918098, + 2.167403757572174, + 1.2036931291222572, + 0.32187304459512234, + 1.6236410103738308, + 0.7703538089990616, + 0.7009598128497601, + 0.47704877331852913, + 1.8782653268426657, + 0.0, + 3.505351796746254, + 0.8972805626690388, + 0.16786155477166176, + 3.3861602917313576, + 1.415400642901659, + 1.1517765372991562, + 1.1697957552969456, + 0.30169595405459404, + 0.46966206282377243, + 2.0329794958233833, + 0.27795266173779964 + ], + "unique_experts": 62, + "load_cv": 0.9219888015766255, + "normalized_load_entropy": 0.9214091334560908, + "max_load_share": 0.09103078982597054 + }, + "full_input": { + "tokens": 290, + "top_k": 6, + "decisions": 1740, + "ordered_route_sha256": "4aef9a06a8692a0f70febed94e15be2f0d2bb9e71a3df9f422ed605269de2cd9", + "route_weight_sha256": "5bbee3a9529d87cbdff0a9a5fb8d5a4984eb97903c66a4103b961614b0e7225d", + "loads": [ + 36, + 52, + 16, + 28, + 45, + 13, + 32, + 30, + 18, + 41, + 9, + 14, + 61, + 12, + 1, + 29, + 34, + 31, + 13, + 15, + 23, + 3, + 6, + 36, + 20, + 11, + 36, + 136, + 20, + 98, + 21, + 27, + 19, + 32, + 6, + 33, + 43, + 29, + 24, + 18, + 27, + 31, + 27, + 25, + 42, + 25, + 7, + 36, + 16, + 19, + 16, + 30, + 0, + 34, + 22, + 15, + 54, + 25, + 22, + 22, + 11, + 14, + 37, + 12 + ], + "weighted_loads": [ + 3.2197219599038363, + 2.6150548942387104, + 0.5987912956625223, + 1.8986691534519196, + 2.103586556389928, + 0.9423865266144276, + 1.606281066313386, + 2.4406562838703394, + 1.2185703981667757, + 2.6739029940217733, + 0.5786662697792053, + 0.4584114719182253, + 2.9355612210929394, + 0.3950778730213642, + 0.04560593515634537, + 2.1335240080952644, + 2.549944441765547, + 2.382949121296406, + 1.104616917669773, + 0.7171905841678381, + 1.4422203730791807, + 0.14588847756385803, + 0.24256740137934685, + 2.5332545153796673, + 1.3802907336503267, + 0.579376820474863, + 2.566528270021081, + 9.557681765407324, + 1.13069474324584, + 6.539185393601656, + 0.8977042771875858, + 1.0715939421206713, + 1.2316522561013699, + 1.5067502167075872, + 0.20097356289625168, + 2.6884106546640396, + 2.646083550527692, + 2.6052819173783064, + 1.587459648028016, + 0.9478898495435715, + 1.798970777541399, + 2.6670082081109285, + 1.1743891928344965, + 1.1646691225469112, + 2.3490403071045876, + 1.5328750796616077, + 0.3534292671829462, + 1.9191140495240688, + 0.8902649562805891, + 0.9119179788976908, + 0.7434703335165977, + 1.8782653268426657, + 0.0, + 4.638547379523516, + 0.8972805626690388, + 1.1599794700741768, + 3.493709061294794, + 1.415400642901659, + 1.1517765372991562, + 1.3713287897408009, + 0.5527066718786955, + 0.5266555100679398, + 2.359917063266039, + 0.5553449988365173 + ], + "unique_experts": 63, + "load_cv": 0.763325709114576, + "normalized_load_entropy": 0.9443472964198123, + "max_load_share": 0.07816091954022988 + } + }, + "s0_x": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "b76040c46990d43cf8dd3ab7cf5d5ee931cb2fb8ef676082142f7b08f6bad363", + "route_weight_sha256": "04accadac132cdb03bc79930997ebe471e69712888ef320dd024d67dfe4b5a91", + "loads": [ + 35, + 48, + 18, + 27, + 45, + 6, + 26, + 28, + 16, + 37, + 4, + 14, + 62, + 6, + 0, + 18, + 20, + 21, + 4, + 15, + 11, + 2, + 4, + 37, + 5, + 11, + 26, + 136, + 18, + 98, + 18, + 25, + 13, + 27, + 5, + 30, + 45, + 21, + 21, + 15, + 22, + 14, + 28, + 22, + 39, + 20, + 8, + 29, + 14, + 15, + 8, + 29, + 0, + 21, + 21, + 3, + 51, + 28, + 21, + 22, + 7, + 13, + 33, + 8 + ], + "weighted_loads": [ + 3.1232829596847296, + 2.4809414502233267, + 0.6488533541560173, + 1.790785038843751, + 2.069687057286501, + 0.20918757282197475, + 1.320718614384532, + 2.3692774325609207, + 1.1717413812875748, + 2.1099040135741234, + 0.3390136659145355, + 0.4695238210260868, + 3.0011807810515165, + 0.2129193339496851, + 0.0, + 1.0817896891385317, + 1.5133416056632996, + 1.6447257064282894, + 0.17397832497954369, + 0.7197285946458578, + 0.5183329470455647, + 0.09840721637010574, + 0.18665985018014908, + 2.530941192060709, + 0.21811949089169502, + 0.5688072554767132, + 1.4287225417792797, + 9.512446070089936, + 1.060085603967309, + 6.578308768570423, + 0.7505794763565063, + 1.0019412953406572, + 0.9894030727446079, + 1.2750772722065449, + 0.1455083005130291, + 2.506972635164857, + 2.708321625366807, + 2.1433337796479464, + 1.4343038145452738, + 0.7768681943416595, + 1.6016180720180273, + 0.5455657616257668, + 1.2120275050401688, + 1.036492820829153, + 2.2163082752376795, + 1.2416610345244408, + 0.38633424788713455, + 1.5741260629147291, + 0.8186611942946911, + 0.730510525405407, + 0.411295548081398, + 1.8432655353099108, + 0.0, + 3.502310324460268, + 0.8752377890050411, + 0.15381998755037785, + 3.3269904255867004, + 1.4902800917625427, + 1.1027051731944084, + 1.2169896457344294, + 0.33235619962215424, + 0.44603185541927814, + 2.0591529719531536, + 0.30655016377568245 + ], + "unique_experts": 62, + "load_cv": 0.9225484223866861, + "normalized_load_entropy": 0.9219100197427215, + "max_load_share": 0.09103078982597054 + }, + "full_input": { + "tokens": 274, + "top_k": 6, + "decisions": 1644, + "ordered_route_sha256": "2bdb860477adcb6021990e6ebac50d631e7eddfc09cce3ec76295401634c4fbd", + "route_weight_sha256": "bb7d9ef962484612dd19a15666de4754fd5806f4c312814a20d36c4ca36b8eea", + "loads": [ + 36, + 48, + 18, + 27, + 45, + 15, + 31, + 28, + 16, + 39, + 7, + 14, + 62, + 7, + 0, + 25, + 27, + 26, + 10, + 16, + 24, + 5, + 7, + 37, + 12, + 11, + 30, + 136, + 18, + 98, + 20, + 25, + 15, + 31, + 5, + 30, + 45, + 31, + 21, + 15, + 25, + 21, + 28, + 22, + 42, + 22, + 8, + 30, + 14, + 16, + 9, + 31, + 0, + 34, + 21, + 14, + 51, + 28, + 21, + 22, + 10, + 15, + 33, + 14 + ], + "weighted_loads": [ + 3.244188917800784, + 2.4809414502233267, + 0.6488533541560173, + 1.790785038843751, + 2.069687057286501, + 1.0231569148600101, + 1.5506330225616693, + 2.3692774325609207, + 1.1717413812875748, + 2.5125958155840635, + 0.5142581462860107, + 0.4695238210260868, + 3.0011807810515165, + 0.23227674141526222, + 0.0, + 1.6845074612647295, + 1.947361458092928, + 2.0199583657085896, + 0.8929598815739155, + 0.759328281506896, + 1.7561527118086815, + 0.21382492408156395, + 0.3451852109283209, + 2.530941192060709, + 0.9143187999725342, + 0.5688072554767132, + 1.6567370891571045, + 9.512446070089936, + 1.060085603967309, + 6.578308768570423, + 0.8694807328283787, + 1.0019412953406572, + 1.1076891832053661, + 1.49451888166368, + 0.1455083005130291, + 2.506972635164857, + 2.708321625366807, + 2.6915574204176664, + 1.4343038145452738, + 0.7768681943416595, + 1.725542152300477, + 1.437172144651413, + 1.2120275050401688, + 1.036492820829153, + 2.33533201739192, + 1.39384226500988, + 0.38633424788713455, + 1.6052354127168655, + 0.8186611942946911, + 0.7478123549371958, + 0.44581152126193047, + 1.9401494543999434, + 0.0, + 4.446900008246303, + 0.8752377890050411, + 1.0683877635747194, + 3.3269904255867004, + 1.4902800917625427, + 1.1027051731944084, + 1.2169896457344294, + 0.5356308147311211, + 0.569915009662509, + 2.0591529719531536, + 0.6398876216262579 + ], + "unique_experts": 62, + "load_cv": 0.8123424093506746, + "normalized_load_entropy": 0.9387934592813073, + "max_load_share": 0.0827250608272506 + } + }, + "s1_x": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "9db6b1d78d98ab49744b06c5a11c6c0321dbef264f260ab5e5610d8798504e1e", + "route_weight_sha256": "06effc0510cf365a5766c8c6cc3d2aca9fcd8cde8054aa58b00bc302b5daf98a", + "loads": [ + 35, + 46, + 15, + 27, + 42, + 6, + 26, + 29, + 17, + 38, + 3, + 13, + 58, + 5, + 0, + 18, + 25, + 20, + 5, + 14, + 11, + 1, + 5, + 35, + 10, + 11, + 28, + 139, + 18, + 101, + 15, + 25, + 13, + 26, + 5, + 33, + 47, + 20, + 19, + 16, + 23, + 13, + 26, + 22, + 37, + 19, + 7, + 27, + 13, + 15, + 12, + 28, + 0, + 21, + 24, + 4, + 52, + 26, + 22, + 21, + 7, + 13, + 33, + 9 + ], + "weighted_loads": [ + 3.1502345707267523, + 2.409851845353842, + 0.5536872800439596, + 1.836362712085247, + 1.999808443710208, + 0.19459781050682068, + 1.3129617720842361, + 2.39516924880445, + 1.1808831095695496, + 2.2380326222628355, + 0.33431823179125786, + 0.42710126750171185, + 2.825134126469493, + 0.17375209741294384, + 0.0, + 1.0170275215059519, + 1.649740181863308, + 1.5635378919541836, + 0.195870628580451, + 0.6722354479134083, + 0.4970697667449713, + 0.06028202176094055, + 0.2586995381861925, + 2.479322485625744, + 0.43366849049925804, + 0.5762171596288681, + 1.449738984927535, + 9.577465077862144, + 1.062257681041956, + 6.653117660433054, + 0.6572107877582312, + 1.018871819600463, + 0.9761681817471981, + 1.2273171693086624, + 0.1527678370475769, + 2.64922427944839, + 2.782983696088195, + 2.0666022300720215, + 1.3704196326434612, + 0.8149552457034588, + 1.6191041991114616, + 0.5081272721290588, + 1.1281277313828468, + 1.0253331195563078, + 2.1553603764623404, + 1.1969792395830154, + 0.36315985582768917, + 1.482522051781416, + 0.7909678276628256, + 0.7473640441894531, + 0.5500881038606167, + 1.78866695612669, + 0.0, + 3.4586663097143173, + 0.9645066950470209, + 0.18998708948493004, + 3.400087410584092, + 1.4224531166255474, + 1.1653827745467424, + 1.1935080140829086, + 0.33553386107087135, + 0.4501108191907406, + 1.974234264343977, + 0.3268869984894991 + ], + "unique_experts": 62, + "load_cv": 0.9317644132228778, + "normalized_load_entropy": 0.9220332532440629, + "max_load_share": 0.09303882195448461 + }, + "full_input": { + "tokens": 290, + "top_k": 6, + "decisions": 1740, + "ordered_route_sha256": "cb1867397a42358b6873febe08333587d9de3e0847b3cc4a40364e17eea49ba7", + "route_weight_sha256": "bec5c654e90e32118b05b388446b29bff67d5762837ce9d5757883b29cc90ef4", + "loads": [ + 36, + 49, + 15, + 29, + 42, + 14, + 32, + 30, + 17, + 40, + 11, + 14, + 58, + 9, + 1, + 29, + 34, + 31, + 14, + 14, + 26, + 4, + 9, + 36, + 25, + 11, + 38, + 139, + 18, + 101, + 18, + 25, + 19, + 29, + 6, + 35, + 47, + 29, + 22, + 19, + 27, + 27, + 27, + 24, + 40, + 25, + 8, + 33, + 16, + 20, + 17, + 28, + 0, + 35, + 24, + 16, + 54, + 27, + 22, + 22, + 11, + 13, + 36, + 13 + ], + "weighted_loads": [ + 3.2544313576072454, + 2.5315823704004288, + 0.5536872800439596, + 1.9260235726833344, + 1.999808443710208, + 0.9760296158492565, + 1.6175590008497238, + 2.420637985691428, + 1.1808831095695496, + 2.6495947521179914, + 0.6011105608195066, + 0.45714047737419605, + 2.825134126469493, + 0.2943163402378559, + 0.04560593515634537, + 2.094217600300908, + 2.081906870007515, + 2.359009675681591, + 1.0911030303686857, + 0.6722354479134083, + 1.8591812439262867, + 0.18548671528697014, + 0.40659939125180244, + 2.5568397864699364, + 1.672239538282156, + 0.5762171596288681, + 2.5796281043440104, + 9.577465077862144, + 1.062257681041956, + 6.653117660433054, + 0.7971985843032598, + 1.018871819600463, + 1.2605876177549362, + 1.366909360513091, + 0.18913156166672707, + 2.7774226125329733, + 2.782983696088195, + 2.5671814307570457, + 1.5239641349762678, + 0.9922636225819588, + 1.7692284919321537, + 2.3685175254940987, + 1.165189739316702, + 1.1157341916114092, + 2.259583992883563, + 1.5180797465145588, + 0.39471607841551304, + 1.777995090931654, + 0.9108789749443531, + 0.9583222102373838, + 0.7704735100269318, + 1.78866695612669, + 0.0, + 4.6759066469967365, + 0.9645066950470209, + 1.3168758898973465, + 3.5076361801475286, + 1.4784503541886806, + 1.1653827745467424, + 1.395041048526764, + 0.520892396569252, + 0.4501108191907406, + 2.3011718317866325, + 0.5455657243728638 + ], + "unique_experts": 63, + "load_cv": 0.7700257282344217, + "normalized_load_entropy": 0.9448853389418223, + "max_load_share": 0.07988505747126437 + } + }, + "s0_period": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "bf66643604441e729a3ed8a6d584ebe934b8f1bf17e817361479d33df9b00d22", + "route_weight_sha256": "5afa7ad15b4a1c88c52e8c061f72b4a49ced2f401a98a0487de24c057fd6d855", + "loads": [ + 36, + 49, + 17, + 26, + 44, + 7, + 26, + 29, + 16, + 37, + 4, + 12, + 64, + 6, + 0, + 18, + 21, + 21, + 5, + 15, + 12, + 2, + 4, + 37, + 5, + 11, + 26, + 135, + 19, + 99, + 15, + 25, + 13, + 24, + 6, + 30, + 43, + 21, + 21, + 15, + 22, + 14, + 27, + 22, + 40, + 21, + 9, + 29, + 14, + 14, + 10, + 29, + 0, + 21, + 20, + 3, + 51, + 27, + 22, + 22, + 8, + 12, + 33, + 8 + ], + "weighted_loads": [ + 3.147775199264288, + 2.520715719088912, + 0.6128456126898527, + 1.7836032398045063, + 2.0232243705540895, + 0.23778487369418144, + 1.3258898761123419, + 2.4036802668124437, + 1.1582354493439198, + 2.1113862730562687, + 0.36292008869349957, + 0.4102973807603121, + 3.0753885842859745, + 0.21288295462727547, + 0.0, + 1.0492083244025707, + 1.533313475549221, + 1.643171725794673, + 0.20913640968501568, + 0.7244931794703007, + 0.5474692024290562, + 0.09683096036314964, + 0.18572969734668732, + 2.5300759822130203, + 0.21888358145952225, + 0.5694963522255421, + 1.4202520791441202, + 9.390051502734423, + 1.083146708086133, + 6.621999824419618, + 0.6653434336185455, + 1.0032387915998697, + 0.9700340516865253, + 1.1562870237976313, + 0.17178667709231377, + 2.5277709402143955, + 2.637838961556554, + 2.1385249495506287, + 1.4344364926218987, + 0.7822192329913378, + 1.6190879978239536, + 0.5488548018038273, + 1.1759776789695024, + 1.0359476134181023, + 2.2455772161483765, + 1.2793879993259907, + 0.4130205661058426, + 1.5811968389898539, + 0.812162920832634, + 0.6981511414051056, + 0.47586092352867126, + 1.863027684390545, + 0.0, + 3.5067422166466713, + 0.8460674546658993, + 0.163278853520751, + 3.314792148768902, + 1.4764631632715464, + 1.1270355936139822, + 1.215347982943058, + 0.3679190594702959, + 0.4137043748050928, + 2.0449603609740734, + 0.3099861145019531 + ], + "unique_experts": 62, + "load_cv": 0.9210864751036701, + "normalized_load_entropy": 0.9227253729005073, + "max_load_share": 0.09036144578313253 + }, + "full_input": { + "tokens": 274, + "top_k": 6, + "decisions": 1644, + "ordered_route_sha256": "75065fcbb21634c55d77d4454bf50ace6f96b8c13e5a55be640dbb334389518e", + "route_weight_sha256": "f3d889b988fd00ffc59a12caa7af828546b0698eb779b5c343eaf5cc22efebbf", + "loads": [ + 37, + 49, + 17, + 26, + 44, + 17, + 31, + 29, + 16, + 39, + 8, + 12, + 64, + 7, + 0, + 25, + 28, + 26, + 11, + 16, + 24, + 4, + 8, + 37, + 13, + 11, + 30, + 135, + 19, + 99, + 17, + 25, + 14, + 28, + 6, + 30, + 43, + 30, + 21, + 15, + 25, + 21, + 27, + 22, + 44, + 23, + 9, + 31, + 14, + 15, + 10, + 31, + 0, + 34, + 20, + 14, + 51, + 27, + 22, + 22, + 11, + 14, + 33, + 13 + ], + "weighted_loads": [ + 3.265829924494028, + 2.520715719088912, + 0.6128456126898527, + 1.7836032398045063, + 2.0232243705540895, + 1.098229868337512, + 1.5525577794760466, + 2.4036802668124437, + 1.1582354493439198, + 2.5132427848875523, + 0.5887270029634237, + 0.4102973807603121, + 3.0753885842859745, + 0.2322403620928526, + 0.0, + 1.6333779394626617, + 2.0038379058241844, + 2.1367343608289957, + 0.8717200122773647, + 0.7640928663313389, + 1.5700014308094978, + 0.17724794894456863, + 0.38847686536610126, + 2.5300759822130203, + 0.9848519451916218, + 0.5694963522255421, + 1.6752969566732645, + 9.390051502734423, + 1.083146708086133, + 6.621999824419618, + 0.7978035472333431, + 1.0032387915998697, + 1.0113668851554394, + 1.3823521994054317, + 0.17178667709231377, + 2.5277709402143955, + 2.637838961556554, + 2.654497031122446, + 1.4344364926218987, + 0.7822192329913378, + 1.7410945929586887, + 1.483518298715353, + 1.1759776789695024, + 1.0359476134181023, + 2.4049038738012314, + 1.4399785287678242, + 0.4130205661058426, + 1.6525087039917707, + 0.812162920832634, + 0.7154529709368944, + 0.47586092352867126, + 1.9599116034805775, + 0.0, + 4.354790156707168, + 0.8460674546658993, + 1.0304711665958166, + 3.314792148768902, + 1.4764631632715464, + 1.1270355936139822, + 1.215347982943058, + 0.560998821631074, + 0.5435836147516966, + 2.0449603609740734, + 0.5953768882900476 + ], + "unique_experts": 62, + "load_cv": 0.8122841074381517, + "normalized_load_entropy": 0.9390493518782724, + "max_load_share": 0.08211678832116788 + } + }, + "s1_period": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "9f65f7305d304759f3eb9a759b05cf91be531729f06ee2797aea18dd755a8fd2", + "route_weight_sha256": "38120981229546e3b4f9e892cfc2c670c986b988a8d83cf5b276e4ae60dbd6c4", + "loads": [ + 35, + 45, + 17, + 27, + 44, + 5, + 26, + 27, + 16, + 43, + 3, + 13, + 62, + 6, + 0, + 19, + 24, + 20, + 5, + 15, + 12, + 2, + 4, + 35, + 11, + 11, + 28, + 136, + 18, + 100, + 15, + 24, + 13, + 26, + 4, + 30, + 45, + 19, + 19, + 16, + 23, + 13, + 25, + 22, + 37, + 21, + 7, + 28, + 13, + 16, + 12, + 30, + 0, + 22, + 20, + 5, + 52, + 25, + 24, + 21, + 5, + 13, + 33, + 7 + ], + "weighted_loads": [ + 3.151610977947712, + 2.389688929542899, + 0.622586727142334, + 1.863487096503377, + 2.0646390076726675, + 0.16649718955159187, + 1.3176864422857761, + 2.347699947655201, + 1.1335778646171093, + 2.4012177400290966, + 0.3123861104249954, + 0.43548752553761005, + 2.9744772519916296, + 0.21048828586935997, + 0.0, + 1.0296412575989962, + 1.6330514643341303, + 1.5637904852628708, + 0.19841583259403706, + 0.7039743065834045, + 0.5448879115283489, + 0.09527868032455444, + 0.20622875168919563, + 2.4762407056987286, + 0.48047358356416225, + 0.5718829743564129, + 1.4592164531350136, + 9.50012868270278, + 1.054336553439498, + 6.586756171658635, + 0.6658947337418795, + 0.9853656962513924, + 0.9635456241667271, + 1.2054165173321962, + 0.12234990298748016, + 2.535039771348238, + 2.6922366712242365, + 2.0344134885817766, + 1.3563890755176544, + 0.8216428756713867, + 1.6275963503867388, + 0.506677595898509, + 1.080366162583232, + 1.0366278029978275, + 2.1841076500713825, + 1.2717417515814304, + 0.36145132407546043, + 1.5289529897272587, + 0.7848864607512951, + 0.7531356401741505, + 0.5605469718575478, + 1.8534657396376133, + 0.0, + 3.5368524827063084, + 0.8425122909247875, + 0.21652488224208355, + 3.3774512223899364, + 1.3828074559569359, + 1.216654097661376, + 1.2058439943939447, + 0.26494789496064186, + 0.4504576977342367, + 2.006777312606573, + 0.269640589132905 + ], + "unique_experts": 62, + "load_cv": 0.924597467462564, + "normalized_load_entropy": 0.9222376680501688, + "max_load_share": 0.09103078982597054 + }, + "full_input": { + "tokens": 290, + "top_k": 6, + "decisions": 1740, + "ordered_route_sha256": "ee8f25784aa2a78bf484cf1590adaf665ef1397def6f79b39d79cf37333530c2", + "route_weight_sha256": "e44b15c571de76cf3a443f5b20ff89972b64561fb645aef0a4d385ca05dd9428", + "loads": [ + 36, + 48, + 17, + 29, + 44, + 14, + 32, + 28, + 16, + 45, + 9, + 14, + 62, + 10, + 1, + 30, + 32, + 32, + 14, + 15, + 25, + 4, + 9, + 36, + 26, + 11, + 38, + 136, + 18, + 100, + 19, + 24, + 19, + 29, + 5, + 32, + 46, + 28, + 22, + 19, + 27, + 28, + 26, + 24, + 40, + 27, + 8, + 34, + 16, + 21, + 17, + 30, + 0, + 36, + 21, + 17, + 54, + 25, + 24, + 22, + 9, + 13, + 36, + 11 + ], + "weighted_loads": [ + 3.2523752376437187, + 2.511419454589486, + 0.622586727142334, + 1.9531479571014643, + 2.0646390076726675, + 0.9837659262120724, + 1.618442751467228, + 2.373168684542179, + 1.1335778646171093, + 2.8127798698842525, + 0.5239336956292391, + 0.46552673541009426, + 2.9744772519916296, + 0.33105252869427204, + 0.04560593515634537, + 2.089075544849038, + 2.0039650928229094, + 2.457769177854061, + 1.13103449344635, + 0.7039743065834045, + 1.5789015013724566, + 0.18401549011468887, + 0.38082239404320717, + 2.553758006542921, + 1.76380773819983, + 0.5718829743564129, + 2.614837594330311, + 9.50012868270278, + 1.054336553439498, + 6.586756171658635, + 0.876417862251401, + 0.9853656962513924, + 1.2188407965004444, + 1.345008708536625, + 0.15871362760663033, + 2.6632381044328213, + 2.7292901407927275, + 2.5206377636641264, + 1.5317628644406796, + 0.9989512525498867, + 1.7857613917440176, + 2.3963392917066813, + 1.117428170517087, + 1.127028875052929, + 2.2792306896299124, + 1.614488497376442, + 0.3930075466632843, + 1.8244260288774967, + 0.9047976080328226, + 0.9640938062220812, + 0.7809323780238628, + 1.8534657396376133, + 0.0, + 4.709404293447733, + 0.8799397349357605, + 1.258210575208068, + 3.484999991953373, + 1.3828074559569359, + 1.216654097661376, + 1.4073770288378, + 0.48043809086084366, + 0.4504576977342367, + 2.3337148800492287, + 0.4930455721914768 + ], + "unique_experts": 63, + "load_cv": 0.7657864288026056, + "normalized_load_entropy": 0.9444869063504604, + "max_load_share": 0.07816091954022988 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 249, + "ordered_topk_exact_tokens": 172, + "set_exact_tokens": 206, + "mean_set_jaccard": 0.9506597819850833, + "mean_token_weighted_tv": 0.01039857205272798, + "aggregate_load_tv": 0.018072289156626516 + }, + "system_bos": { + "tokens": 249, + "ordered_topk_exact_tokens": 164, + "set_exact_tokens": 195, + "mean_set_jaccard": 0.9380378657487092, + "mean_token_weighted_tv": 0.013264581561088562, + "aggregate_load_tv": 0.015394912985274425 + }, + "system_x": { + "tokens": 249, + "ordered_topk_exact_tokens": 132, + "set_exact_tokens": 168, + "mean_set_jaccard": 0.9027538726333907, + "mean_token_weighted_tv": 0.019443103089838862, + "aggregate_load_tv": 0.02744310575635877 + }, + "system_period": { + "tokens": 249, + "ordered_topk_exact_tokens": 126, + "set_exact_tokens": 162, + "mean_set_jaccard": 0.897590361445783, + "mean_token_weighted_tv": 0.019846682567673034, + "aggregate_load_tv": 0.026773761713520743 + }, + "bos_at_s0": { + "tokens": 249, + "ordered_topk_exact_tokens": 159, + "set_exact_tokens": 194, + "mean_set_jaccard": 0.9351692484222603, + "mean_token_weighted_tv": 0.015046718436850601, + "aggregate_load_tv": 0.022088353413654623 + }, + "bos_at_s1": { + "tokens": 249, + "ordered_topk_exact_tokens": 139, + "set_exact_tokens": 175, + "mean_set_jaccard": 0.9133677567412507, + "mean_token_weighted_tv": 0.018077540323587066, + "aggregate_load_tv": 0.025435073627844706 + }, + "x_at_s0": { + "tokens": 249, + "ordered_topk_exact_tokens": 153, + "set_exact_tokens": 184, + "mean_set_jaccard": 0.9221648498756931, + "mean_token_weighted_tv": 0.016954609574413443, + "aggregate_load_tv": 0.02208835341365462 + }, + "x_at_s1": { + "tokens": 249, + "ordered_topk_exact_tokens": 123, + "set_exact_tokens": 160, + "mean_set_jaccard": 0.8894626123541786, + "mean_token_weighted_tv": 0.022651194392826902, + "aggregate_load_tv": 0.03145917001338688 + }, + "period_at_s0": { + "tokens": 249, + "ordered_topk_exact_tokens": 154, + "set_exact_tokens": 179, + "mean_set_jaccard": 0.917096959265634, + "mean_token_weighted_tv": 0.017465364969668377, + "aggregate_load_tv": 0.022757697456492636 + }, + "period_at_s1": { + "tokens": 249, + "ordered_topk_exact_tokens": 122, + "set_exact_tokens": 161, + "mean_set_jaccard": 0.8895582329317268, + "mean_token_weighted_tv": 0.022345294540067274, + "aggregate_load_tv": 0.0321285140562249 + } + } + }, + "layer_17": { + "layer": 17, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "fc7b36b6446349e2b33f065406ab88e2426c0aa048b34dd0fc7f1f7f4599c431", + "route_weight_sha256": "08585884c5c2a16e55097c1c5704aca6b0c767519b586cc8e45aeafe4440f92c", + "loads": [ + 13, + 13, + 15, + 1, + 22, + 6, + 0, + 24, + 45, + 10, + 25, + 34, + 2, + 0, + 72, + 4, + 18, + 5, + 8, + 37, + 19, + 18, + 36, + 22, + 20, + 9, + 32, + 14, + 26, + 20, + 28, + 36, + 50, + 55, + 47, + 21, + 3, + 27, + 30, + 39, + 11, + 6, + 23, + 30, + 24, + 8, + 26, + 43, + 36, + 24, + 19, + 38, + 33, + 62, + 19, + 18, + 9, + 4, + 30, + 23, + 55, + 11, + 16, + 20 + ], + "weighted_loads": [ + 0.45241501182317734, + 0.4440673850476742, + 0.8917753603309393, + 0.03517664596438408, + 1.6088731791824102, + 0.22898850589990616, + 0.0, + 1.4213169626891613, + 2.756608771160245, + 0.41951278038322926, + 2.5317851323634386, + 2.1894620321691036, + 0.0674810204654932, + 0.0, + 4.541183343157172, + 0.2229371815919876, + 0.9814078044146299, + 0.19377054832875729, + 0.7707362584769726, + 1.9111297875642776, + 0.789353596046567, + 0.6571647804230452, + 3.2148811779916286, + 4.006026750430465, + 1.0829538404941559, + 0.5349400155246258, + 1.606658685952425, + 0.625739898532629, + 1.100104695186019, + 0.9530154522508383, + 2.0447760224342346, + 2.7256532851606607, + 2.4388527255505323, + 4.464795511215925, + 3.417330676689744, + 1.6943394970148802, + 0.16206393018364906, + 1.327318713068962, + 5.101623669266701, + 2.7489906512200832, + 0.6109000407159328, + 0.2529904730618, + 2.210968781262636, + 1.7004044596105814, + 1.4657780565321445, + 0.4222235456109047, + 1.4020261224359274, + 2.8429663125425577, + 3.922040030360222, + 0.9005981180816889, + 1.4520880710333586, + 3.4185719713568687, + 2.516747187823057, + 3.795589430257678, + 0.7444423772394657, + 1.3538458682596684, + 0.47447510436177254, + 0.39010947942733765, + 1.8440491557121277, + 0.9046126548200846, + 3.5631599836051464, + 0.6177042312920094, + 1.051306027919054, + 0.9340503308922052 + ], + "unique_experts": 62, + "load_cv": 0.6710860864807628, + "normalized_load_entropy": 0.9431867485336387, + "max_load_share": 0.04819277108433735 + }, + "full_input": { + "tokens": 274, + "top_k": 6, + "decisions": 1644, + "ordered_route_sha256": "668c602fb8b76668439a396725cb2b6322b2b0b6852f88b27c2cdd3a719242d7", + "route_weight_sha256": "78a0322e526f9e31e3418ff5e1badcd9f2b11c81f2f675865c40c26fa50d4bc1", + "loads": [ + 21, + 14, + 17, + 8, + 22, + 6, + 2, + 24, + 46, + 13, + 32, + 35, + 6, + 8, + 72, + 5, + 18, + 12, + 10, + 37, + 22, + 18, + 36, + 29, + 26, + 16, + 42, + 18, + 30, + 23, + 28, + 36, + 57, + 56, + 47, + 21, + 3, + 27, + 34, + 39, + 18, + 11, + 25, + 32, + 24, + 12, + 26, + 43, + 36, + 24, + 20, + 38, + 35, + 62, + 19, + 23, + 10, + 7, + 31, + 23, + 55, + 13, + 21, + 20 + ], + "weighted_loads": [ + 0.7049035653471947, + 0.4800053983926773, + 0.9874062333256006, + 0.6223587431013584, + 1.6088731791824102, + 0.22898850589990616, + 0.09646670147776604, + 1.4213169626891613, + 2.8150503169745207, + 0.5276701617985964, + 2.962697209790349, + 2.208072068169713, + 0.194270184263587, + 0.599620882421732, + 4.541183343157172, + 0.27133724838495255, + 0.9814078044146299, + 0.8798039238899946, + 0.8267082255333662, + 1.9111297875642776, + 1.0718371290713549, + 0.6571647804230452, + 3.2148811779916286, + 4.327000144869089, + 1.578849647194147, + 0.9361146725714207, + 3.3090920113027096, + 0.8099349364638329, + 1.2512652277946472, + 1.0441112611442804, + 2.0447760224342346, + 2.7256532851606607, + 2.708525243215263, + 4.567419599741697, + 3.417330676689744, + 1.6943394970148802, + 0.16206393018364906, + 1.327318713068962, + 5.315503973513842, + 2.7489906512200832, + 1.5083804093301296, + 0.4264477835968137, + 2.365153092890978, + 1.7225296227261424, + 1.4657780565321445, + 1.216996856033802, + 1.4020261224359274, + 2.8429663125425577, + 3.922040030360222, + 0.9005981180816889, + 1.520940763875842, + 3.4185719713568687, + 2.6700886078178883, + 3.795589430257678, + 0.7444423772394657, + 1.642548929899931, + 0.5291665308177471, + 0.5671077743172646, + 1.8735183123499155, + 0.9046126548200846, + 3.5631599836051464, + 0.7261336632072926, + 1.4631458669900894, + 0.9340503308922052 + ], + "unique_experts": 64, + "load_cv": 0.5809279493017033, + "normalized_load_entropy": 0.959591794547746, + "max_load_share": 0.043795620437956206 + } + }, + "s1_eos": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "71990561eaf8d4ea3e77b0f30fc3a1e573d89fc6e1e39b930f8eef13e2f2fc67", + "route_weight_sha256": "09e1df7b33ecac2740210bccd44ba8b7f225b9ec1ae840f6fa52caedbe8112c4", + "loads": [ + 12, + 13, + 15, + 1, + 21, + 5, + 0, + 25, + 45, + 9, + 27, + 33, + 3, + 0, + 71, + 4, + 17, + 5, + 8, + 40, + 19, + 16, + 36, + 22, + 21, + 9, + 33, + 14, + 25, + 20, + 27, + 32, + 54, + 55, + 49, + 22, + 4, + 26, + 29, + 39, + 9, + 8, + 23, + 31, + 24, + 7, + 27, + 43, + 36, + 26, + 19, + 38, + 33, + 62, + 19, + 18, + 9, + 4, + 30, + 26, + 51, + 11, + 15, + 19 + ], + "weighted_loads": [ + 0.4136903677135706, + 0.44274836778640747, + 0.9022984430193901, + 0.034112006425857544, + 1.5744686760008335, + 0.18900588899850845, + 0.0, + 1.4572476875036955, + 2.7420102674514055, + 0.38200688548386097, + 2.5540954936295748, + 2.129997819662094, + 0.09735613875091076, + 0.0, + 4.5989166628569365, + 0.22175541520118713, + 0.9501326885074377, + 0.18648142367601395, + 0.7253260277211666, + 2.0105973184108734, + 0.7838727049529552, + 0.5951319634914398, + 3.201388521119952, + 4.015074895694852, + 1.115373644977808, + 0.5404171645641327, + 1.6675474923104048, + 0.6480634063482285, + 1.0521164052188396, + 0.9605225287377834, + 1.9757018499076366, + 2.5960228741168976, + 2.5658933985978365, + 4.457512900233269, + 3.4838804323226213, + 1.7577701527625322, + 0.18862701207399368, + 1.2934124041348696, + 5.013750886544585, + 2.749781098216772, + 0.5329744853079319, + 0.31039678305387497, + 2.200217742472887, + 1.7279215827584267, + 1.4549985490739346, + 0.39583851769566536, + 1.428214155137539, + 2.8625283762812614, + 3.885893076658249, + 0.9683469869196415, + 1.449869565665722, + 3.4190475828945637, + 2.4991089906543493, + 3.7850335501134396, + 0.7550071645528078, + 1.329299382865429, + 0.47491900995373726, + 0.3854582980275154, + 1.8537523970007896, + 1.0097389072179794, + 3.4278714302927256, + 0.6307294350117445, + 1.0081057883799076, + 0.9020923133939505 + ], + "unique_experts": 62, + "load_cv": 0.673048650360449, + "normalized_load_entropy": 0.9429983482267058, + "max_load_share": 0.04752342704149933 + }, + "full_input": { + "tokens": 290, + "top_k": 6, + "decisions": 1740, + "ordered_route_sha256": "659fed60663cde438bfcca09a9743cc4e0dfc897cf38bcc3c3c688f0dda78d86", + "route_weight_sha256": "0d655967c9b681088000a7ab4614a9735f381e4606c24e4fa4d0c5bfda3efc0d", + "loads": [ + 19, + 14, + 16, + 8, + 27, + 5, + 3, + 26, + 46, + 14, + 35, + 35, + 3, + 8, + 71, + 9, + 19, + 13, + 10, + 40, + 20, + 17, + 36, + 32, + 31, + 30, + 47, + 16, + 27, + 24, + 29, + 33, + 59, + 56, + 49, + 22, + 8, + 28, + 33, + 40, + 21, + 15, + 27, + 32, + 26, + 12, + 29, + 45, + 36, + 27, + 20, + 44, + 37, + 62, + 20, + 26, + 17, + 15, + 31, + 28, + 52, + 17, + 24, + 19 + ], + "weighted_loads": [ + 0.6813548430800438, + 0.4857448488473892, + 0.9494276121258736, + 0.6990343667566776, + 1.9746799897402525, + 0.18900588899850845, + 0.11830376833677292, + 1.5118087623268366, + 2.7980680260807276, + 0.5422718673944473, + 3.0954876113682985, + 2.197931008413434, + 0.09735613875091076, + 0.606941357254982, + 4.5989166628569365, + 0.46656608954072, + 1.1178607549518347, + 0.8392785750329494, + 0.7920149769634008, + 2.0105973184108734, + 0.8531442768871784, + 0.672066293656826, + 3.201388521119952, + 4.724488506093621, + 1.7183190607465804, + 1.9259420204907656, + 3.5390628073364496, + 0.7464582771062851, + 1.1464345529675484, + 1.1307231858372688, + 2.0698057264089584, + 2.6357754208147526, + 2.7233499879948795, + 4.560786806046963, + 3.4838804323226213, + 1.7577701527625322, + 0.41514259949326515, + 1.3664518389850855, + 5.385964760556817, + 2.7838201448321342, + 2.0816438980400562, + 0.6867090254090726, + 2.370062045753002, + 1.7468230240046978, + 1.6892739795148373, + 1.58891237154603, + 1.6419865936040878, + 2.995095744729042, + 3.885893076658249, + 1.0034585893154144, + 1.5840322747826576, + 3.7103746626526117, + 2.765862299129367, + 3.7850335501134396, + 0.8440258447080851, + 1.821163672953844, + 1.1466109231114388, + 1.0043047219514847, + 1.8773831278085709, + 1.0994124449789524, + 3.463950911536813, + 0.9710072483867407, + 1.7277518585324287, + 0.9020923133939505 + ], + "unique_experts": 64, + "load_cv": 0.5391233470673952, + "normalized_load_entropy": 0.9647887223639251, + "max_load_share": 0.04080459770114943 + } + }, + "s0_bos": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "5090c5789051620d9cf621f16c373519dcecd788465444b0853c151bed15d5c5", + "route_weight_sha256": "5c63d39bf1b6d663fc7e4e80b7f7767d00e198d6d8e78ebb97fb3e500bf0b957", + "loads": [ + 13, + 12, + 19, + 1, + 22, + 6, + 0, + 24, + 45, + 10, + 26, + 34, + 2, + 1, + 73, + 4, + 18, + 6, + 9, + 41, + 23, + 17, + 34, + 21, + 20, + 9, + 30, + 13, + 23, + 20, + 27, + 34, + 53, + 55, + 47, + 22, + 2, + 25, + 29, + 39, + 10, + 7, + 23, + 30, + 23, + 7, + 27, + 43, + 36, + 26, + 17, + 37, + 33, + 63, + 20, + 18, + 9, + 4, + 29, + 23, + 52, + 12, + 16, + 20 + ], + "weighted_loads": [ + 0.4433682728558779, + 0.3982394263148308, + 0.9788662604987621, + 0.03528478369116783, + 1.6239944025874138, + 0.23205067962408066, + 0.0, + 1.4414940103888512, + 2.7810540571808815, + 0.3701590932905674, + 2.563493959605694, + 2.1680728420615196, + 0.07053759694099426, + 0.04138491302728653, + 4.599475517868996, + 0.2265106476843357, + 0.9947747122496367, + 0.21863074600696564, + 0.8147418275475502, + 2.045995317399502, + 0.9068513996899128, + 0.6320314109325409, + 3.1331484355032444, + 4.180390136316419, + 1.0854120068252087, + 0.5520558468997478, + 1.5093051865696907, + 0.6028108764439821, + 0.979668490588665, + 0.9745136275887489, + 2.0372359231114388, + 2.6413698568940163, + 2.5082839354872704, + 4.469732096418738, + 3.402947299182415, + 1.7564446218311787, + 0.12885349616408348, + 1.2567749433219433, + 5.155720451846719, + 2.7183814607560635, + 0.5774707868695259, + 0.2911175210028887, + 2.20188364200294, + 1.7351056467741728, + 1.402447460219264, + 0.423393789678812, + 1.4886675905436277, + 2.8507119193673134, + 3.910130776464939, + 0.9580398462712765, + 1.378060009330511, + 3.3349413499236107, + 2.510859163478017, + 3.8893100060522556, + 0.7884028386324644, + 1.3668292500078678, + 0.49380903504788876, + 0.35662391036748886, + 1.8004984483122826, + 0.9066663533449173, + 3.4700121711939573, + 0.6459103543311357, + 0.9705619663000107, + 0.9276684392243624 + ], + "unique_experts": 63, + "load_cv": 0.6717693677095735, + "normalized_load_entropy": 0.9437621748992928, + "max_load_share": 0.048862115127175365 + }, + "full_input": { + "tokens": 274, + "top_k": 6, + "decisions": 1644, + "ordered_route_sha256": "98dac9f16d2569deb39984a757a1ca57f9c3a960146be4879ef226cf17f862c8", + "route_weight_sha256": "00ea016e3fdb6277378ec018cdf7cafa8a8dc61ba8c93142732a04da276a6145", + "loads": [ + 20, + 14, + 20, + 8, + 22, + 6, + 2, + 24, + 46, + 13, + 33, + 35, + 7, + 9, + 73, + 6, + 18, + 13, + 11, + 42, + 26, + 17, + 34, + 28, + 26, + 16, + 39, + 16, + 27, + 21, + 27, + 34, + 59, + 56, + 47, + 22, + 2, + 25, + 33, + 39, + 18, + 11, + 25, + 31, + 23, + 11, + 27, + 43, + 36, + 27, + 18, + 37, + 35, + 64, + 20, + 23, + 10, + 7, + 30, + 24, + 52, + 14, + 22, + 20 + ], + "weighted_loads": [ + 0.7094529122114182, + 0.4834017977118492, + 1.0315414406359196, + 0.6224668808281422, + 1.6239944025874138, + 0.23205067962408066, + 0.09646670147776604, + 1.4414940103888512, + 2.850605458021164, + 0.4783164747059345, + 2.9961796291172504, + 2.186682878062129, + 0.34678319096565247, + 0.6410057954490185, + 4.599475517868996, + 0.3054701089859009, + 0.9947747122496367, + 0.904664121568203, + 0.8707137946039438, + 2.107147518545389, + 1.2111934088170528, + 0.6320314109325409, + 3.1331484355032444, + 4.50873476266861, + 1.5870627388358116, + 0.9810249172151089, + 2.2958895191550255, + 0.7348632868379354, + 1.1279971729964018, + 1.0143894702196121, + 2.0372359231114388, + 2.6413698568940163, + 2.7737842313945293, + 4.565964167937636, + 3.402947299182415, + 1.7564446218311787, + 0.12885349616408348, + 1.2567749433219433, + 5.368658302351832, + 2.7183814607560635, + 1.5222348310053349, + 0.44988019950687885, + 2.360036915168166, + 1.754007088020444, + 1.402447460219264, + 1.1749408543109894, + 1.4886675905436277, + 2.8507119193673134, + 3.910130776464939, + 1.1214467100799084, + 1.4469127021729946, + 3.3349413499236107, + 2.6675749886780977, + 3.941072165966034, + 0.7884028386324644, + 1.6708691641688347, + 0.5525264572352171, + 0.530117679387331, + 1.8299676049500704, + 0.9511857070028782, + 3.4700121711939573, + 0.7457571681588888, + 1.4540007077157497, + 0.9276684392243624 + ], + "unique_experts": 64, + "load_cv": 0.5810094673178281, + "normalized_load_entropy": 0.9599084511250902, + "max_load_share": 0.04440389294403893 + } + }, + "s1_bos": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "3ebe4664e88e8c60426cfe5cf10f5edb12c786135d393292da024e7fc7e362ab", + "route_weight_sha256": "f72ae0f6fe0e2f1381fb2a7a5d5014669dcdb6ea429972caa04fd5fcb1eb1064", + "loads": [ + 13, + 13, + 17, + 1, + 22, + 8, + 0, + 26, + 46, + 11, + 25, + 32, + 2, + 1, + 73, + 5, + 19, + 8, + 10, + 38, + 20, + 14, + 37, + 22, + 19, + 9, + 31, + 13, + 23, + 21, + 26, + 32, + 55, + 56, + 50, + 21, + 3, + 27, + 29, + 38, + 9, + 6, + 23, + 31, + 23, + 7, + 25, + 44, + 36, + 26, + 18, + 37, + 32, + 65, + 17, + 18, + 9, + 5, + 28, + 24, + 51, + 10, + 13, + 21 + ], + "weighted_loads": [ + 0.44957502000033855, + 0.42482978850603104, + 0.9751721508800983, + 0.03758411854505539, + 1.6328979283571243, + 0.2840837463736534, + 0.0, + 1.5051430147141218, + 2.838915850967169, + 0.41305441968142986, + 2.51364940777421, + 2.091926207765937, + 0.07050159946084023, + 0.036529216915369034, + 4.661834483966231, + 0.26220553927123547, + 1.0260059256106615, + 0.2919456996023655, + 0.8132082838565111, + 1.966749619692564, + 0.802844638004899, + 0.5389921590685844, + 3.28036455437541, + 4.214741026982665, + 1.0242034420371056, + 0.5411770008504391, + 1.5580273866653442, + 0.5985396280884743, + 1.0067994762212038, + 0.9803004916757345, + 1.9585558287799358, + 2.6081192903220654, + 2.5910663176327944, + 4.531372487545013, + 3.540448972955346, + 1.7496745325624943, + 0.16784166917204857, + 1.327081685885787, + 5.050768993794918, + 2.704396141692996, + 0.526774637401104, + 0.2521369233727455, + 2.186984047293663, + 1.7764788791537285, + 1.3990085907280445, + 0.4220905601978302, + 1.3877425398677588, + 2.897304520010948, + 3.8769667968153954, + 0.9770273435860872, + 1.414228394627571, + 3.398550473153591, + 2.4874180629849434, + 3.9676215536892414, + 0.679087832570076, + 1.3363692946732044, + 0.4807353485375643, + 0.379432562738657, + 1.76652367785573, + 0.9588752295821905, + 3.4128512628376484, + 0.5729808993637562, + 0.8815903812646866, + 0.9847872816026211 + ], + "unique_experts": 63, + "load_cv": 0.6785220820991454, + "normalized_load_entropy": 0.9438408674715949, + "max_load_share": 0.048862115127175365 + }, + "full_input": { + "tokens": 290, + "top_k": 6, + "decisions": 1740, + "ordered_route_sha256": "e2d55310fea3947921ea2828704f5429fee7ce62fcae38e9370b3537e5e8dd1f", + "route_weight_sha256": "a53d16b9fee4199ec65be0f8af388b99d29a6a04a22b3a50ad0f3819652dc7e1", + "loads": [ + 19, + 16, + 18, + 8, + 28, + 8, + 3, + 27, + 47, + 17, + 32, + 34, + 4, + 9, + 73, + 11, + 21, + 16, + 12, + 38, + 21, + 15, + 37, + 32, + 28, + 30, + 43, + 15, + 24, + 23, + 28, + 33, + 59, + 57, + 50, + 21, + 7, + 29, + 33, + 39, + 22, + 12, + 27, + 32, + 26, + 12, + 27, + 46, + 36, + 27, + 20, + 43, + 37, + 65, + 18, + 26, + 17, + 16, + 29, + 26, + 52, + 15, + 23, + 21 + ], + "weighted_loads": [ + 0.7089749220758677, + 0.5707990974187851, + 1.0223013199865818, + 0.7025064788758755, + 2.0331092420965433, + 0.2840837463736534, + 0.11830376833677292, + 1.559704089537263, + 2.902011062949896, + 0.6355758346617222, + 3.0135787911713123, + 2.1598593965172768, + 0.17320217937231064, + 0.643470574170351, + 4.661834483966231, + 0.5453758966177702, + 1.1937339920550585, + 0.944742850959301, + 0.8798972330987453, + 1.966749619692564, + 0.9005744401365519, + 0.6159264892339706, + 3.28036455437541, + 4.9286390747874975, + 1.6349069848656654, + 1.919767988845706, + 2.493028324097395, + 0.6885732002556324, + 1.047015367075801, + 1.1097935903817415, + 2.0526597052812576, + 2.6478718370199203, + 2.7407899145036936, + 4.615606300532818, + 3.540448972955346, + 1.7496745325624943, + 0.39435725659132004, + 1.400121120736003, + 5.415032554417849, + 2.738435188308358, + 2.1129443645477295, + 0.6479696966707706, + 2.361559394747019, + 1.7953803203999996, + 1.670551460236311, + 1.7003039866685867, + 1.6015149783343077, + 3.029871888458729, + 3.8769667968153954, + 1.0203740391880274, + 1.60320408269763, + 3.689877552911639, + 2.784654837101698, + 3.9676215536892414, + 0.7681065127253532, + 1.8480952084064484, + 1.1562845762819052, + 0.995100274682045, + 1.7901544086635113, + 1.0485487673431635, + 3.4489307440817356, + 0.8609134294092655, + 1.6514267064630985, + 0.9847872816026211 + ], + "unique_experts": 64, + "load_cv": 0.5368837432677361, + "normalized_load_entropy": 0.9661192737375377, + "max_load_share": 0.04195402298850575 + } + }, + "s0_x": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "3664072a624a3221e3f41c4c71f5448b5e7a70619f74ccb549e2e6e0a23330cf", + "route_weight_sha256": "b66938eea9348774a3576372ba6f74179a7d6c7132e8f8abe0d5b2cebdd828f7", + "loads": [ + 9, + 17, + 16, + 1, + 22, + 7, + 0, + 26, + 45, + 11, + 24, + 34, + 2, + 0, + 75, + 5, + 19, + 7, + 9, + 35, + 23, + 12, + 36, + 20, + 20, + 9, + 31, + 11, + 23, + 22, + 27, + 36, + 57, + 56, + 50, + 23, + 3, + 25, + 29, + 39, + 10, + 6, + 23, + 29, + 23, + 7, + 25, + 43, + 36, + 23, + 18, + 38, + 32, + 63, + 19, + 18, + 9, + 4, + 29, + 25, + 49, + 12, + 16, + 21 + ], + "weighted_loads": [ + 0.3166202027350664, + 0.5736704617738724, + 0.8775999918580055, + 0.03877498209476471, + 1.6287075243890285, + 0.2541804499924183, + 0.0, + 1.4845498967915773, + 2.7812148574739695, + 0.4284163825213909, + 2.4372126162052155, + 2.1744477041065693, + 0.07011109218001366, + 0.0, + 4.683565437793732, + 0.239741001278162, + 1.0078202243894339, + 0.24998393841087818, + 0.8084650225937366, + 1.8432594016194344, + 0.8983255457133055, + 0.471479669213295, + 3.2182076014578342, + 4.0576609671115875, + 1.0511486288160086, + 0.5418248362839222, + 1.5691638011485338, + 0.529451958835125, + 1.0054981540888548, + 1.004148120060563, + 1.9992701709270477, + 2.7384461127221584, + 2.692014440894127, + 4.531619807705283, + 3.529757706448436, + 1.7435896694660187, + 0.17562272027134895, + 1.2472448591142893, + 5.025335349142551, + 2.7426673714071512, + 0.5753489136695862, + 0.2522391080856323, + 2.233048316091299, + 1.6645489260554314, + 1.4096103552728891, + 0.41857777908444405, + 1.3699552044272423, + 2.8337759766727686, + 3.8921507708728313, + 0.8628689646720886, + 1.4003303423523903, + 3.401147874072194, + 2.506685946136713, + 3.867059588432312, + 0.7686130832880735, + 1.3462361507117748, + 0.48240778408944607, + 0.3718467131257057, + 1.7904144674539566, + 0.9691564757376909, + 3.3740150909870863, + 0.617955818772316, + 1.012492323294282, + 0.961123414337635 + ], + "unique_experts": 62, + "load_cv": 0.6820205244392142, + "normalized_load_entropy": 0.9424939267957311, + "max_load_share": 0.050200803212851405 + }, + "full_input": { + "tokens": 274, + "top_k": 6, + "decisions": 1644, + "ordered_route_sha256": "545bbb325663460c9a923385e4616cc3a552a875ffb4cff4c5ff33e5712fe98c", + "route_weight_sha256": "c6c935c6b1674ff4f702a4585ed9d6c59f9c5ae493fd468ecbe4d0949015e82f", + "loads": [ + 15, + 18, + 18, + 9, + 22, + 7, + 2, + 26, + 46, + 15, + 32, + 35, + 5, + 9, + 75, + 7, + 19, + 15, + 11, + 35, + 25, + 12, + 36, + 28, + 26, + 17, + 38, + 14, + 27, + 24, + 27, + 36, + 64, + 57, + 50, + 23, + 3, + 25, + 33, + 39, + 17, + 10, + 26, + 30, + 23, + 11, + 25, + 43, + 37, + 23, + 20, + 38, + 34, + 63, + 19, + 24, + 9, + 7, + 30, + 25, + 49, + 14, + 21, + 21 + ], + "weighted_loads": [ + 0.5233315154910088, + 0.6096084751188755, + 0.9780908301472664, + 0.7765985354781151, + 1.6287075243890285, + 0.2541804499924183, + 0.09646670147776604, + 1.4845498967915773, + 2.839477142319083, + 0.5815600454807281, + 3.0359308682382107, + 2.1930577401071787, + 0.16248488053679466, + 0.6374308280646801, + 4.683565437793732, + 0.3267606608569622, + 1.0078202243894339, + 0.980309022590518, + 0.8644369896501303, + 1.8432594016194344, + 1.0996318813413382, + 0.471479669213295, + 3.2182076014578342, + 4.425958955660462, + 1.552224898710847, + 0.9879068024456501, + 2.23862630315125, + 0.6615043692290783, + 1.159962311387062, + 1.0968279782682657, + 1.9992701709270477, + 2.7384461127221584, + 3.00727916136384, + 4.627382470294833, + 3.529757706448436, + 1.7435896694660187, + 0.17562272027134895, + 1.2472448591142893, + 5.246027331799269, + 2.7426673714071512, + 1.4622463285923004, + 0.43336544185876846, + 2.4253318198025227, + 1.6834503673017025, + 1.4096103552728891, + 1.2270663864910603, + 1.3699552044272423, + 2.8337759766727686, + 3.932034879922867, + 0.8628689646720886, + 1.531519990414381, + 3.401147874072194, + 2.6635718308389187, + 3.867059588432312, + 0.7686130832880735, + 1.6806657202541828, + 0.48240778408944607, + 0.5430058389902115, + 1.8198836240917444, + 0.9691564757376909, + 3.3740150909870863, + 0.716425497084856, + 1.4234016258269548, + 0.961123414337635 + ], + "unique_experts": 64, + "load_cv": 0.589345434290057, + "normalized_load_entropy": 0.9593727935865196, + "max_load_share": 0.04562043795620438 + } + }, + "s1_x": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "c3d85fdff3fd7e7d0e515d2aa3bdddacc2f6883bff912e3953149d9940977833", + "route_weight_sha256": "81595ac64685fa478ffa19bc27b336318b64d80c7e4fbe1220a355fe9a393cd9", + "loads": [ + 14, + 17, + 19, + 1, + 22, + 6, + 0, + 26, + 46, + 10, + 25, + 31, + 2, + 2, + 71, + 6, + 19, + 8, + 11, + 39, + 21, + 13, + 37, + 20, + 18, + 9, + 31, + 12, + 24, + 18, + 27, + 35, + 56, + 54, + 51, + 21, + 3, + 23, + 29, + 38, + 10, + 5, + 24, + 30, + 23, + 7, + 25, + 44, + 36, + 27, + 19, + 36, + 33, + 63, + 17, + 18, + 10, + 5, + 27, + 24, + 51, + 10, + 13, + 22 + ], + "weighted_loads": [ + 0.4597335886210203, + 0.5694016125053167, + 0.9797928277403116, + 0.03498801216483116, + 1.6295788995921612, + 0.22601502761244774, + 0.0, + 1.5546906478703022, + 2.820298757404089, + 0.3758428990840912, + 2.476222340017557, + 2.0464959759265184, + 0.06948490999639034, + 0.0789383240044117, + 4.5486207734793425, + 0.2778948284685612, + 1.0121337585151196, + 0.2799500450491905, + 0.8155630342662334, + 2.010341364890337, + 0.8430057894438505, + 0.4831097926944494, + 3.275784019380808, + 4.054961221292615, + 0.9999411441385746, + 0.5738593488931656, + 1.5952864028513432, + 0.5664185155183077, + 1.0299807954579592, + 0.902880260720849, + 1.9658715650439262, + 2.693867452442646, + 2.6466672401875257, + 4.480641793459654, + 3.591447561979294, + 1.7234773021191359, + 0.1774071492254734, + 1.2130203731358051, + 5.0389237981289625, + 2.6934523452073336, + 0.5722338482737541, + 0.2235492616891861, + 2.254559960216284, + 1.7263638824224472, + 1.3876799456775188, + 0.4071492850780487, + 1.37330362200737, + 2.905431879684329, + 3.854259468615055, + 0.9986627791076899, + 1.4524675477296114, + 3.3634384013712406, + 2.5124067533761263, + 3.9135861732065678, + 0.7084416225552559, + 1.336072888225317, + 0.5158033240586519, + 0.3702034130692482, + 1.7203647941350937, + 0.9507017266005278, + 3.369040610268712, + 0.5501662790775299, + 0.9009706862270832, + 1.020247895270586 + ], + "unique_experts": 63, + "load_cv": 0.6700598582072982, + "normalized_load_entropy": 0.9449505274547592, + "max_load_share": 0.04752342704149933 + }, + "full_input": { + "tokens": 290, + "top_k": 6, + "decisions": 1740, + "ordered_route_sha256": "a414c142bc9b1a2528d6db525a34dbb6d43573610c7e70837d917aabcbe96e2b", + "route_weight_sha256": "13325938fdf313dec18fac1d09c0ab59b19c20bc6c3df2b7094565425a660be9", + "loads": [ + 19, + 18, + 21, + 9, + 28, + 6, + 3, + 27, + 47, + 16, + 34, + 33, + 2, + 11, + 71, + 12, + 21, + 17, + 13, + 39, + 21, + 14, + 37, + 31, + 27, + 31, + 42, + 13, + 24, + 21, + 29, + 36, + 60, + 55, + 51, + 21, + 7, + 25, + 34, + 39, + 22, + 11, + 28, + 31, + 25, + 12, + 27, + 46, + 37, + 27, + 21, + 42, + 37, + 63, + 18, + 27, + 17, + 17, + 29, + 26, + 52, + 17, + 21, + 22 + ], + "weighted_loads": [ + 0.6733795944601297, + 0.6123980935662985, + 1.0775779094547033, + 0.862200602889061, + 2.02979021333158, + 0.22601502761244774, + 0.11830376833677292, + 1.6092517226934433, + 2.8842724226415157, + 0.5732294786721468, + 3.163543649017811, + 2.1144291646778584, + 0.06948490999639034, + 0.7474742345511913, + 4.5486207734793425, + 0.5769428312778473, + 1.1798618249595165, + 0.9838590025901794, + 0.8822519835084677, + 2.010341364890337, + 0.8430057894438505, + 0.5600441228598356, + 3.275784019380808, + 4.784569106996059, + 1.649078469723463, + 1.9845354985445738, + 2.447970639914274, + 0.6077689435333014, + 1.0299807954579592, + 1.074248654767871, + 2.059975441545248, + 2.733619999140501, + 2.818289866670966, + 4.584393259137869, + 3.591447561979294, + 1.7234773021191359, + 0.4039227366447449, + 1.286059807986021, + 5.438489751890302, + 2.7274913918226957, + 2.0782109275460243, + 0.5733965747058392, + 2.429014313966036, + 1.7452653236687183, + 1.6219553761184216, + 1.5718991830945015, + 1.587076060473919, + 3.0379992481321096, + 3.8945649191737175, + 0.9986627791076899, + 1.6748008448630571, + 3.6547654811292887, + 2.78530197031796, + 3.9135861732065678, + 0.7974603027105331, + 1.8623754121363163, + 1.1351926047354937, + 1.0308200307190418, + 1.7956668138504028, + 1.0403752643615007, + 3.4051200915127993, + 0.9148368667811155, + 1.5451755672693253, + 1.020247895270586 + ], + "unique_experts": 64, + "load_cv": 0.5308652763215077, + "normalized_load_entropy": 0.9662443238819477, + "max_load_share": 0.04080459770114943 + } + }, + "s0_period": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "08a3abd5ab7074f79caaed72c146603212866e66ac13fd5a14e7fb0bda10aefe", + "route_weight_sha256": "0b044ab7bd8a3751faab778f18e553f6519df0df234447f8347666513411d655", + "loads": [ + 11, + 20, + 17, + 1, + 22, + 6, + 0, + 25, + 45, + 12, + 25, + 33, + 2, + 0, + 73, + 4, + 19, + 8, + 10, + 36, + 20, + 12, + 36, + 21, + 20, + 9, + 31, + 11, + 25, + 22, + 27, + 34, + 59, + 56, + 51, + 23, + 4, + 24, + 29, + 39, + 10, + 6, + 23, + 30, + 23, + 7, + 24, + 43, + 36, + 23, + 17, + 37, + 33, + 63, + 18, + 18, + 9, + 4, + 29, + 22, + 49, + 10, + 16, + 22 + ], + "weighted_loads": [ + 0.37733468413352966, + 0.6662500165402889, + 0.9280507080256939, + 0.03880006819963455, + 1.6224052123725414, + 0.22515074163675308, + 0.0, + 1.4630916807800531, + 2.7941970601677895, + 0.4611784089356661, + 2.4855894315987825, + 2.1344654448330402, + 0.0712863877415657, + 0.0, + 4.566807325929403, + 0.21726079657673836, + 1.0093249510973692, + 0.29048585891723633, + 0.8632792457938194, + 1.8919857703149319, + 0.7972572725266218, + 0.46387552469968796, + 3.199314806610346, + 4.089210396632552, + 1.0533596687018871, + 0.5394056066870689, + 1.579308109357953, + 0.5312236919999123, + 1.0544692873954773, + 1.0449131578207016, + 2.0031632594764233, + 2.6610924936830997, + 2.7488893792033195, + 4.5503543466329575, + 3.562667367979884, + 1.7572451680898666, + 0.20586306974291801, + 1.2077844627201557, + 5.049482773989439, + 2.76017614454031, + 0.5803459733724594, + 0.2548619881272316, + 2.2304245680570602, + 1.7159283068031073, + 1.4010607041418552, + 0.4201895035803318, + 1.3197217993438244, + 2.811960995197296, + 3.883632142096758, + 0.8527214620262384, + 1.3570502661168575, + 3.341494295746088, + 2.5402054265141487, + 3.878726514056325, + 0.7388311848044395, + 1.3435157723724842, + 0.49377969838678837, + 0.3671022802591324, + 1.7916538305580616, + 0.8754799216985703, + 3.3673358894884586, + 0.5583768486976624, + 1.0068846084177494, + 0.9862309414893389 + ], + "unique_experts": 62, + "load_cv": 0.6792823104657006, + "normalized_load_entropy": 0.9429566004458078, + "max_load_share": 0.048862115127175365 + }, + "full_input": { + "tokens": 274, + "top_k": 6, + "decisions": 1644, + "ordered_route_sha256": "75a04727b80ab0091fd36b8ba59f3379c8ac96688767e3e1b7eec7eadafca6ce", + "route_weight_sha256": "fb2bd07045bc6919f8f96ef80bbfbd9eab194e4f2fd9b778ac1d0707526d51c5", + "loads": [ + 17, + 21, + 20, + 9, + 22, + 6, + 2, + 25, + 46, + 15, + 32, + 34, + 5, + 8, + 73, + 6, + 19, + 15, + 12, + 36, + 23, + 12, + 36, + 28, + 26, + 17, + 39, + 15, + 29, + 24, + 27, + 34, + 66, + 57, + 51, + 23, + 4, + 24, + 33, + 39, + 18, + 10, + 26, + 31, + 23, + 11, + 24, + 43, + 36, + 23, + 19, + 37, + 35, + 63, + 18, + 25, + 9, + 7, + 30, + 22, + 49, + 12, + 21, + 22 + ], + "weighted_loads": [ + 0.5890751834958792, + 0.702188029885292, + 1.0731602720916271, + 0.6725550703704357, + 1.6224052123725414, + 0.22515074163675308, + 0.09646670147776604, + 1.4630916807800531, + 2.8577888160943985, + 0.5693357903510332, + 2.927943455055356, + 2.1530754808336496, + 0.1636601760983467, + 0.599620882421732, + 4.566807325929403, + 0.3045976534485817, + 1.0093249510973692, + 0.9765192344784737, + 0.919251212850213, + 1.8919857703149319, + 1.0539955589920282, + 0.46387552469968796, + 3.199314806610346, + 4.400031719356775, + 1.5457610338926315, + 0.992723073810339, + 2.276000401005149, + 0.7001628465950489, + 1.2134617920964956, + 1.129033226519823, + 2.0031632594764233, + 2.6610924936830997, + 3.062489427626133, + 4.651299223303795, + 3.562667367979884, + 1.7572451680898666, + 0.20586306974291801, + 1.2077844627201557, + 5.277340963482857, + 2.76017614454031, + 1.5033149756491184, + 0.4412367194890976, + 2.4375145696103573, + 1.7348297480493784, + 1.4010607041418552, + 1.2868928797543049, + 1.3197217993438244, + 2.811960995197296, + 3.883632142096758, + 0.8527214620262384, + 1.488399799913168, + 3.341494295746088, + 2.6998703852295876, + 3.878726514056325, + 0.7388311848044395, + 1.8414729088544846, + 0.49377969838678837, + 0.5388261117041111, + 1.8211229871958494, + 0.8754799216985703, + 3.3673358894884586, + 0.6599165797233582, + 1.4323904924094677, + 0.9862309414893389 + ], + "unique_experts": 64, + "load_cv": 0.5890239091805017, + "normalized_load_entropy": 0.959356834187142, + "max_load_share": 0.04440389294403893 + } + }, + "s1_period": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "0ff15d22952947b9000f36b03e5b70882a4a20d2e55db7c66ff4a548ec852925", + "route_weight_sha256": "2ce78dc21b9d354ef04e09a96c85f5e9bfde3de5e39ff3c3c56c2ccbe87af7f7", + "loads": [ + 11, + 18, + 19, + 1, + 22, + 6, + 0, + 27, + 45, + 8, + 28, + 30, + 2, + 2, + 73, + 6, + 19, + 8, + 12, + 41, + 18, + 13, + 37, + 20, + 18, + 9, + 31, + 12, + 23, + 18, + 27, + 34, + 55, + 56, + 51, + 22, + 5, + 24, + 28, + 37, + 10, + 5, + 24, + 31, + 23, + 7, + 25, + 43, + 36, + 26, + 20, + 37, + 32, + 63, + 17, + 18, + 10, + 5, + 28, + 24, + 50, + 9, + 14, + 21 + ], + "weighted_loads": [ + 0.37690371461212635, + 0.5913491528481245, + 1.0071212742477655, + 0.03902410343289375, + 1.6532781943678856, + 0.22163112461566925, + 0.0, + 1.5955730676651, + 2.8092863857746124, + 0.3135338369756937, + 2.5886175353080034, + 2.030185367912054, + 0.06929556280374527, + 0.07820389047265053, + 4.64746823720634, + 0.27263499423861504, + 1.0090637039393187, + 0.2776345834136009, + 0.8647979516535997, + 2.0624962598085403, + 0.7393308412283659, + 0.48228683322668076, + 3.2908996287733316, + 4.079524617642164, + 1.0027394890785217, + 0.590852003544569, + 1.5614781398326159, + 0.5703914910554886, + 1.017704388126731, + 0.9199832417070866, + 1.9644288681447506, + 2.7045614141970873, + 2.5874680038541555, + 4.570331720635295, + 3.6019857097417116, + 1.7407111320644617, + 0.2423402275890112, + 1.2459120638668537, + 5.04524496383965, + 2.6727640237659216, + 0.5526664443314075, + 0.22508567571640015, + 2.270232394337654, + 1.7600034326314926, + 1.388408588245511, + 0.4094637706875801, + 1.380395943298936, + 2.8568732757121325, + 3.8900217041373253, + 0.9830391593277454, + 1.4823321420699358, + 3.3840233497321606, + 2.466768726706505, + 3.9012110624462366, + 0.701351061463356, + 1.3306791223585606, + 0.5176664087921381, + 0.37971730530261993, + 1.7578270696103573, + 0.9479447714984417, + 3.3231288883835077, + 0.5164717994630337, + 0.9282431658357382, + 0.9881564006209373 + ], + "unique_experts": 63, + "load_cv": 0.6741553983540517, + "normalized_load_entropy": 0.9446816873876696, + "max_load_share": 0.048862115127175365 + }, + "full_input": { + "tokens": 290, + "top_k": 6, + "decisions": 1740, + "ordered_route_sha256": "c6fafd8cdfd9cce496973c703b5c1e96adb42ae94c9220794ddb50ff9cab40df", + "route_weight_sha256": "d6537c67e9f13871c4fc7216c615b3a7554f73b297e31c26a451085db5b21715", + "loads": [ + 16, + 19, + 21, + 9, + 28, + 6, + 3, + 28, + 46, + 13, + 37, + 32, + 2, + 10, + 73, + 12, + 21, + 16, + 14, + 41, + 18, + 14, + 37, + 30, + 27, + 32, + 42, + 13, + 24, + 20, + 29, + 35, + 59, + 57, + 51, + 22, + 9, + 26, + 33, + 38, + 23, + 11, + 30, + 32, + 25, + 12, + 27, + 45, + 36, + 26, + 22, + 43, + 37, + 63, + 18, + 28, + 17, + 19, + 29, + 26, + 51, + 15, + 21, + 21 + ], + "weighted_loads": [ + 0.5905497204512358, + 0.6343456339091063, + 1.0987703260034323, + 0.7598665878176689, + 2.0534895081073046, + 0.22163112461566925, + 0.11830376833677292, + 1.6501341424882412, + 2.877457857131958, + 0.47379881888628006, + 3.1702602468430996, + 2.098118556663394, + 0.06929556280374527, + 0.6851452477276325, + 4.64746823720634, + 0.570050697773695, + 1.1767917703837156, + 0.9304317347705364, + 0.931486900895834, + 2.0624962598085403, + 0.7393308412283659, + 0.559221163392067, + 3.2908996287733316, + 4.773304656147957, + 1.6320448592305183, + 2.096169302240014, + 2.413888046517968, + 0.6117419190704823, + 1.0495147872716188, + 1.0575788505375385, + 2.0585327446460724, + 2.7443139608949423, + 2.7531867269426584, + 4.666189638897777, + 3.6019857097417116, + 1.7407111320644617, + 0.46885581500828266, + 1.3189514987170696, + 5.440239502117038, + 2.7068030703812838, + 2.08721711486578, + 0.5932593308389187, + 2.5168129429221153, + 1.7789048738777637, + 1.6226840186864138, + 1.7625439912080765, + 1.5941683817654848, + 2.989440644159913, + 3.8900217041373253, + 0.9830391593277454, + 1.6780739892274141, + 3.6753504294902086, + 2.781163454055786, + 3.9012110624462366, + 0.7903697416186333, + 2.0115624964237213, + 1.1370556894689798, + 1.134740263223648, + 1.7814578004181385, + 1.0376183092594147, + 3.359208369627595, + 0.8531481698155403, + 1.4876924697309732, + 0.9881564006209373 + ], + "unique_experts": 64, + "load_cv": 0.5365686648430241, + "normalized_load_entropy": 0.9656697044921625, + "max_load_share": 0.04195402298850575 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 249, + "ordered_topk_exact_tokens": 173, + "set_exact_tokens": 201, + "mean_set_jaccard": 0.9423407917383821, + "mean_token_weighted_tv": 0.011639733701555365, + "aggregate_load_tv": 0.01740294511378849 + }, + "system_bos": { + "tokens": 249, + "ordered_topk_exact_tokens": 156, + "set_exact_tokens": 188, + "mean_set_jaccard": 0.9257028112449799, + "mean_token_weighted_tv": 0.014744902661735993, + "aggregate_load_tv": 0.023427041499330656 + }, + "system_x": { + "tokens": 249, + "ordered_topk_exact_tokens": 136, + "set_exact_tokens": 164, + "mean_set_jaccard": 0.8990246701090074, + "mean_token_weighted_tv": 0.01991487095828157, + "aggregate_load_tv": 0.02610441767068273 + }, + "system_period": { + "tokens": 249, + "ordered_topk_exact_tokens": 131, + "set_exact_tokens": 164, + "mean_set_jaccard": 0.8990246701090073, + "mean_token_weighted_tv": 0.02019661629430381, + "aggregate_load_tv": 0.024096385542168672 + }, + "bos_at_s0": { + "tokens": 249, + "ordered_topk_exact_tokens": 144, + "set_exact_tokens": 185, + "mean_set_jaccard": 0.9239816408491109, + "mean_token_weighted_tv": 0.016852291080218004, + "aggregate_load_tv": 0.018741633199464522 + }, + "bos_at_s1": { + "tokens": 249, + "ordered_topk_exact_tokens": 140, + "set_exact_tokens": 180, + "mean_set_jaccard": 0.9148020654044751, + "mean_token_weighted_tv": 0.018156027926289172, + "aggregate_load_tv": 0.024096385542168666 + }, + "x_at_s0": { + "tokens": 249, + "ordered_topk_exact_tokens": 131, + "set_exact_tokens": 176, + "mean_set_jaccard": 0.9110728628800917, + "mean_token_weighted_tv": 0.017988885726674973, + "aggregate_load_tv": 0.027443105756358766 + }, + "x_at_s1": { + "tokens": 249, + "ordered_topk_exact_tokens": 123, + "set_exact_tokens": 164, + "mean_set_jaccard": 0.8947217441193345, + "mean_token_weighted_tv": 0.02209304437699567, + "aggregate_load_tv": 0.031459170013386877 + }, + "period_at_s0": { + "tokens": 249, + "ordered_topk_exact_tokens": 135, + "set_exact_tokens": 173, + "mean_set_jaccard": 0.9059093516924842, + "mean_token_weighted_tv": 0.019195484607125144, + "aggregate_load_tv": 0.028112449799196783 + }, + "period_at_s1": { + "tokens": 249, + "ordered_topk_exact_tokens": 118, + "set_exact_tokens": 155, + "mean_set_jaccard": 0.8852553069420539, + "mean_token_weighted_tv": 0.023259097048227328, + "aggregate_load_tv": 0.030789825970548856 + } + } + }, + "layer_18": { + "layer": 18, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "9aa4b299b19da02fd2d4105d626832439d3bf8dfc6c92b85906f24190a93e4cf", + "route_weight_sha256": "d3dea2cb3fdcd704b9d2536be2532a7aa10f3e1f0bdeb63149a1fe7783581cad", + "loads": [ + 3, + 13, + 26, + 23, + 112, + 25, + 5, + 31, + 6, + 6, + 28, + 30, + 8, + 24, + 26, + 12, + 23, + 13, + 12, + 27, + 48, + 7, + 13, + 67, + 10, + 30, + 47, + 33, + 24, + 39, + 34, + 27, + 37, + 15, + 37, + 28, + 33, + 6, + 29, + 55, + 18, + 13, + 6, + 16, + 20, + 45, + 11, + 16, + 15, + 23, + 3, + 24, + 2, + 7, + 41, + 24, + 16, + 11, + 26, + 22, + 10, + 2, + 44, + 7 + ], + "weighted_loads": [ + 0.10681825131177902, + 0.5635921247303486, + 1.2878835406154394, + 1.4298718068748713, + 6.372412342578173, + 1.489535117521882, + 0.15177815593779087, + 2.5063092801719904, + 0.2415818404406309, + 0.1894980687648058, + 2.038130111992359, + 1.7611880768090487, + 0.294790904968977, + 1.4731490351259708, + 1.2741288896650076, + 0.5315687544643879, + 1.0949307885020971, + 0.44804857298731804, + 0.8419892191886902, + 2.2523394990712404, + 2.863607857376337, + 0.2530408836901188, + 0.4675282035022974, + 4.227970404550433, + 0.4948627892881632, + 1.4217325169593096, + 2.6866747196763754, + 1.7191323284059763, + 2.09859368018806, + 3.126708898693323, + 2.7928643226623535, + 1.489263292402029, + 4.124387811869383, + 0.6753570083528757, + 2.4099297244101763, + 1.1530956719070673, + 1.4178969468921423, + 0.20074830949306488, + 1.5118707921355963, + 1.8840003218501806, + 0.7732029296457767, + 0.5344670806080103, + 0.23113817162811756, + 0.6759824622422457, + 0.7104515917599201, + 3.1298654712736607, + 0.5618909858167171, + 0.9184561967849731, + 0.5641006417572498, + 1.355503000319004, + 0.09267173334956169, + 1.2169205211102962, + 0.08508232235908508, + 0.2828148081898689, + 2.9688594173640013, + 1.8751855213195086, + 0.7639748677611351, + 0.6486408449709415, + 4.626066721975803, + 2.0709191728383303, + 0.3534638360142708, + 0.05177637003362179, + 2.654286053031683, + 0.2592141479253769 + ], + "unique_experts": 64, + "load_cv": 0.7636942741280854, + "normalized_load_entropy": 0.939744356597127, + "max_load_share": 0.0749665327978581 + }, + "full_input": { + "tokens": 274, + "top_k": 6, + "decisions": 1644, + "ordered_route_sha256": "f9bea9b9d81715f22848d6778dc22a5046c19836b21e90c46ba6208cbf2f2da5", + "route_weight_sha256": "892156ec311367b0a3fbf98f2e7587f342182bfc21e709714910ebb2834deced", + "loads": [ + 10, + 14, + 39, + 23, + 112, + 27, + 5, + 31, + 14, + 6, + 29, + 34, + 9, + 24, + 31, + 16, + 23, + 14, + 30, + 27, + 48, + 8, + 13, + 67, + 10, + 31, + 47, + 33, + 24, + 39, + 42, + 27, + 38, + 15, + 37, + 31, + 34, + 8, + 29, + 58, + 24, + 13, + 9, + 16, + 20, + 46, + 18, + 16, + 18, + 35, + 6, + 26, + 11, + 15, + 41, + 24, + 18, + 11, + 28, + 25, + 10, + 4, + 44, + 9 + ], + "weighted_loads": [ + 0.5990122631192207, + 0.6359322927892208, + 2.3771162051707506, + 1.4298718068748713, + 6.372412342578173, + 1.5366706810891628, + 0.15177815593779087, + 2.5063092801719904, + 0.7421733494848013, + 0.1894980687648058, + 2.0490060904994607, + 2.145105728879571, + 0.33061086013913155, + 1.4731490351259708, + 2.245195385068655, + 0.6707182824611664, + 1.0949307885020971, + 0.47934073582291603, + 1.9471021927893162, + 2.2523394990712404, + 2.863607857376337, + 0.2767919432371855, + 0.4675282035022974, + 4.227970404550433, + 0.4948627892881632, + 1.4638200085610151, + 2.6866747196763754, + 1.7191323284059763, + 2.09859368018806, + 3.126708898693323, + 3.1960803885012865, + 1.489263292402029, + 4.152498699724674, + 0.6753570083528757, + 2.4099297244101763, + 1.2937322575598955, + 1.441451285034418, + 0.2632394153624773, + 1.5118707921355963, + 1.9633031766861677, + 1.0955738946795464, + 0.5344670806080103, + 0.3182303048670292, + 0.6759824622422457, + 0.7104515917599201, + 3.180678352713585, + 2.101659771054983, + 0.9184561967849731, + 0.7095493115484715, + 1.901897355914116, + 0.2055737804621458, + 1.3669306449592113, + 0.682286424562335, + 0.7873195856809616, + 2.9688594173640013, + 1.8751855213195086, + 1.7624141201376915, + 0.6486408449709415, + 4.726494075730443, + 2.175593066960573, + 0.3534638360142708, + 0.10584914870560169, + 2.654286053031683, + 0.3530781455338001 + ], + "unique_experts": 64, + "load_cv": 0.6753260407210587, + "normalized_load_entropy": 0.9531391998699977, + "max_load_share": 0.0681265206812652 + } + }, + "s1_eos": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "9da71835c5c864bd386ce6f6a414a56e362221dd00104283ceef2edd7fc006c2", + "route_weight_sha256": "aafc565cbd2fd26d2a1056b5e53a1f420e1c6a6a9a53119d79e49141e99148fb", + "loads": [ + 3, + 14, + 26, + 23, + 111, + 26, + 5, + 33, + 6, + 7, + 29, + 30, + 9, + 24, + 26, + 8, + 22, + 13, + 12, + 27, + 49, + 8, + 11, + 67, + 10, + 31, + 50, + 32, + 24, + 39, + 33, + 26, + 36, + 16, + 37, + 31, + 37, + 6, + 28, + 49, + 16, + 10, + 7, + 16, + 19, + 44, + 11, + 18, + 16, + 23, + 4, + 23, + 3, + 7, + 41, + 24, + 15, + 12, + 25, + 24, + 10, + 2, + 44, + 6 + ], + "weighted_loads": [ + 0.10388352163136005, + 0.5924694426357746, + 1.2743239011615515, + 1.4393099192529917, + 6.373082363978028, + 1.5065201688557863, + 0.14895262941718102, + 2.5697159096598625, + 0.2548426892608404, + 0.21892833895981312, + 2.0644908491522074, + 1.7662838846445084, + 0.3214830569922924, + 1.4734505861997604, + 1.2749827299267054, + 0.4100426137447357, + 1.0715855434536934, + 0.46089070849120617, + 0.8741359692066908, + 2.2529933396726847, + 2.9141439888626337, + 0.2741280421614647, + 0.40937614813447, + 4.260413622483611, + 0.5089728645980358, + 1.4417848624289036, + 2.7478312961757183, + 1.6626765374094248, + 2.098270956426859, + 3.1500445883721113, + 2.717735543847084, + 1.4375775270164013, + 4.02547999471426, + 0.7003020532429218, + 2.44236783310771, + 1.2434218134731054, + 1.5282828323543072, + 0.20594338327646255, + 1.4769385736435652, + 1.6976930722594261, + 0.7054445333778858, + 0.43569679744541645, + 0.2687335815280676, + 0.6921616960316896, + 0.6977133676409721, + 3.0734462421387434, + 0.5680124312639236, + 0.990360951051116, + 0.5711947530508041, + 1.3459804989397526, + 0.12245080433785915, + 1.1919086296111345, + 0.10956654883921146, + 0.2734187562018633, + 2.971072455868125, + 1.8549255467951298, + 0.7371559273451567, + 0.6667510885745287, + 4.579252202063799, + 2.1590941417962313, + 0.3504751455038786, + 0.05273960530757904, + 2.6312663592398167, + 0.24701224826276302 + ], + "unique_experts": 64, + "load_cv": 0.7588354328784903, + "normalized_load_entropy": 0.9404374018932562, + "max_load_share": 0.07429718875502007 + }, + "full_input": { + "tokens": 290, + "top_k": 6, + "decisions": 1740, + "ordered_route_sha256": "d3e15c0c513f023795b3398378aaca97d58a0e60b141644edd8ded8794950f5b", + "route_weight_sha256": "2a1657a0fc201b2a438a52006b19c3a696cb0b7619fd8ba659ad929a5df1663a", + "loads": [ + 11, + 17, + 40, + 23, + 112, + 28, + 6, + 35, + 16, + 8, + 30, + 34, + 9, + 25, + 35, + 10, + 22, + 22, + 35, + 28, + 49, + 9, + 11, + 67, + 10, + 32, + 50, + 32, + 24, + 40, + 44, + 28, + 38, + 17, + 41, + 46, + 38, + 13, + 29, + 52, + 22, + 10, + 9, + 21, + 19, + 45, + 28, + 21, + 19, + 37, + 7, + 26, + 12, + 19, + 43, + 25, + 18, + 17, + 28, + 28, + 10, + 4, + 44, + 12 + ], + "weighted_loads": [ + 0.5857083294540644, + 0.7316685207188129, + 2.3958285339176655, + 1.4393099192529917, + 6.412049354985356, + 1.5640746764838696, + 0.17799971252679825, + 2.63942233286798, + 1.1184123028069735, + 0.25602046586573124, + 2.0762236081063747, + 2.1383089050650597, + 0.3214830569922924, + 1.5165594816207886, + 2.39177667722106, + 0.46920489333570004, + 1.0715855434536934, + 1.0225601475685835, + 2.713842475786805, + 2.3877778742462397, + 2.9141439888626337, + 0.2986862026154995, + 0.40937614813447, + 4.260413622483611, + 0.5089728645980358, + 1.490588378161192, + 2.7478312961757183, + 1.6626765374094248, + 2.098270956426859, + 3.1866103801876307, + 3.3651363737881184, + 1.6835637986660004, + 4.111816754564643, + 0.777624998241663, + 2.859674349427223, + 2.534046098589897, + 1.5517925675958395, + 0.48502701707184315, + 1.514895310625434, + 1.7734773121774197, + 0.9880486335605383, + 0.43569679744541645, + 0.32583278231322765, + 1.1481571774929762, + 0.6977133676409721, + 3.1201837714761496, + 3.240224789828062, + 1.1455463450402021, + 0.6673394646495581, + 1.9812245778739452, + 0.21903966553509235, + 1.3913949560374022, + 0.697220841422677, + 0.9670299328863621, + 3.0896037835627794, + 1.8894906379282475, + 1.7491375859826803, + 0.9004179574549198, + 4.977646138519049, + 2.4092136193066835, + 0.3504751455038786, + 0.11670123785734177, + 2.6312663592398167, + 0.4757117070257664 + ], + "unique_experts": 64, + "load_cv": 0.6347117694315959, + "normalized_load_entropy": 0.9574921940516676, + "max_load_share": 0.06436781609195402 + } + }, + "s0_bos": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "65281791519bde2f39c0d9e9259985e5985487c3ea291a4a33a1ca71df92a99d", + "route_weight_sha256": "6fcf4c90052453b2e3a97ed1c91bdc3175fe8f4268aa282880df9c4c23f47618", + "loads": [ + 2, + 15, + 25, + 24, + 112, + 27, + 5, + 32, + 6, + 6, + 24, + 29, + 7, + 25, + 27, + 12, + 22, + 12, + 11, + 27, + 48, + 10, + 12, + 68, + 11, + 30, + 49, + 32, + 23, + 40, + 31, + 30, + 36, + 16, + 39, + 29, + 34, + 6, + 26, + 53, + 17, + 12, + 5, + 16, + 19, + 46, + 11, + 16, + 18, + 25, + 4, + 24, + 1, + 6, + 42, + 24, + 14, + 15, + 26, + 23, + 10, + 2, + 42, + 3 + ], + "weighted_loads": [ + 0.07643989473581314, + 0.6368720140308142, + 1.2611035853624344, + 1.4604587275534868, + 6.32780191861093, + 1.5145933981984854, + 0.1511374767869711, + 2.543590657413006, + 0.24505126476287842, + 0.1891924012452364, + 1.8799378667026758, + 1.7290041260421276, + 0.2525858748704195, + 1.5205706600099802, + 1.3019534219056368, + 0.5365934260189533, + 1.0765583273023367, + 0.4323310889303684, + 0.8201722912490368, + 2.283646209165454, + 2.8778956532478333, + 0.3498327787965536, + 0.4444960653781891, + 4.253744788467884, + 0.555123083293438, + 1.4232215229421854, + 2.7235782332718372, + 1.6722373720258474, + 2.0950836315751076, + 3.1510970033705235, + 2.533164830878377, + 1.5510174054652452, + 4.047850484028459, + 0.7008651699870825, + 2.4858256988227367, + 1.1814707107841969, + 1.4260291457176208, + 0.18992180936038494, + 1.408661937341094, + 1.7768144644796848, + 0.7346745915710926, + 0.5006881766021252, + 0.19724211283028126, + 0.6938390284776688, + 0.6633189711719751, + 3.1868312302976847, + 0.5718890130519867, + 0.9431688785552979, + 0.6607634145766497, + 1.4188179168850183, + 0.12380154617130756, + 1.2320405635982752, + 0.044085487723350525, + 0.2337940540164709, + 3.0126214902848005, + 1.8681772947311401, + 0.668736657127738, + 0.7426237743347883, + 4.7086836732923985, + 2.0937261804938316, + 0.34907798655331135, + 0.053780000656843185, + 2.592902047559619, + 0.13153217732906342 + ], + "unique_experts": 64, + "load_cv": 0.7681492088306325, + "normalized_load_entropy": 0.9381770184103784, + "max_load_share": 0.0749665327978581 + }, + "full_input": { + "tokens": 274, + "top_k": 6, + "decisions": 1644, + "ordered_route_sha256": "ceeff1aad92eb7242e52e5fbde05b2e0e03e275b18f343bdf5efe5a97faeaa74", + "route_weight_sha256": "c6c6da07837dd4c31a7cad49ad2996bd6be23e552ba887792fb8c707456a1a1c", + "loads": [ + 9, + 17, + 37, + 24, + 112, + 29, + 5, + 32, + 14, + 6, + 24, + 32, + 8, + 25, + 32, + 15, + 22, + 13, + 30, + 27, + 48, + 11, + 12, + 70, + 11, + 31, + 50, + 32, + 23, + 40, + 37, + 30, + 37, + 16, + 39, + 33, + 34, + 8, + 26, + 56, + 24, + 13, + 8, + 16, + 19, + 47, + 19, + 16, + 21, + 36, + 6, + 26, + 10, + 14, + 42, + 24, + 15, + 15, + 28, + 26, + 10, + 5, + 42, + 5 + ], + "weighted_loads": [ + 0.5288608893752098, + 0.7362366206943989, + 2.3257656451314688, + 1.4604587275534868, + 6.32780191861093, + 1.5617289617657661, + 0.1511374767869711, + 2.543590657413006, + 0.7456427738070488, + 0.1891924012452364, + 1.8799378667026758, + 1.99012016877532, + 0.4253446478396654, + 1.5205706600099802, + 2.2063652090728283, + 0.6370451785624027, + 1.0765583273023367, + 0.4666754864156246, + 1.9494339153170586, + 2.283646209165454, + 2.8778956532478333, + 0.3735838383436203, + 0.4444960653781891, + 4.326238412410021, + 0.555123083293438, + 1.461665766313672, + 2.771597757935524, + 1.6722373720258474, + 2.0950836315751076, + 3.1510970033705235, + 2.933034224435687, + 1.5510174054652452, + 4.074392283335328, + 0.7008651699870825, + 2.4858256988227367, + 1.3657998703420162, + 1.4260291457176208, + 0.25241291522979736, + 1.408661937341094, + 1.9285017028450966, + 1.1107635460793972, + 0.5635056011378765, + 0.3101085014641285, + 0.6938390284776688, + 0.6633189711719751, + 3.2466645818203688, + 2.156836375594139, + 0.9431688785552979, + 0.8062120843678713, + 1.9170218463987112, + 0.20413792878389359, + 1.3826394844800234, + 0.6412895899266005, + 0.729685029014945, + 3.0126214902848005, + 1.8681772947311401, + 0.8918939437717199, + 0.7426237743347883, + 4.818367129191756, + 2.251453425735235, + 0.34907798655331135, + 0.14478150382637978, + 2.592902047559619, + 0.22539617493748665 + ], + "unique_experts": 64, + "load_cv": 0.679032664478206, + "normalized_load_entropy": 0.9525989565025732, + "max_load_share": 0.0681265206812652 + } + }, + "s1_bos": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "1e58f74a9c8b30fee41f9b400cee3e66651812253ba10ffd104889fcad157e61", + "route_weight_sha256": "70f875d437e44dcb7c1d91c1fcd726fd8991d351026ecd472ade982d3b47a774", + "loads": [ + 3, + 11, + 25, + 25, + 114, + 27, + 4, + 32, + 6, + 7, + 25, + 29, + 8, + 25, + 25, + 11, + 22, + 11, + 13, + 27, + 48, + 11, + 11, + 69, + 11, + 30, + 50, + 34, + 24, + 41, + 30, + 29, + 36, + 12, + 38, + 33, + 35, + 6, + 25, + 44, + 18, + 12, + 6, + 17, + 22, + 47, + 11, + 16, + 17, + 25, + 3, + 23, + 1, + 6, + 41, + 24, + 14, + 12, + 26, + 24, + 11, + 2, + 43, + 6 + ], + "weighted_loads": [ + 0.11096756346523762, + 0.4878660049289465, + 1.2610724344849586, + 1.517864365130663, + 6.563131416216493, + 1.5112734232097864, + 0.12692298181355, + 2.5338611006736755, + 0.2554520405828953, + 0.22877082973718643, + 1.937927097082138, + 1.7328950222581625, + 0.28003342263400555, + 1.5320886634290218, + 1.2076826002448797, + 0.5100210290402174, + 1.0891054328531027, + 0.39620716124773026, + 0.9279099777340889, + 2.2721102945506573, + 2.949033662676811, + 0.3934070598334074, + 0.4182483181357384, + 4.388552771881223, + 0.5551088228821754, + 1.4131817482411861, + 2.7552874721586704, + 1.735291413962841, + 2.1316152960062027, + 3.2074420619755983, + 2.517770528793335, + 1.5408660154789686, + 4.064117077738047, + 0.553426131606102, + 2.477575059980154, + 1.2885269112884998, + 1.4539407175034285, + 0.20695199817419052, + 1.3689762018620968, + 1.5251378789544106, + 0.7523404099047184, + 0.4946849215775728, + 0.23973216861486435, + 0.7240220084786415, + 0.7423155903816223, + 3.21687301248312, + 0.5889675654470921, + 0.9357751943171024, + 0.6111405044794083, + 1.4299925584346056, + 0.10051881894469261, + 1.2046218980103731, + 0.037163060158491135, + 0.22020423784852028, + 2.9656526278704405, + 1.8600294161587954, + 0.674270374700427, + 0.6486192513257265, + 4.691200794652104, + 2.166768793016672, + 0.3714103139936924, + 0.054676683619618416, + 2.602006506174803, + 0.23676389269530773 + ], + "unique_experts": 64, + "load_cv": 0.7712783762252197, + "normalized_load_entropy": 0.9385537834248726, + "max_load_share": 0.07630522088353414 + }, + "full_input": { + "tokens": 290, + "top_k": 6, + "decisions": 1740, + "ordered_route_sha256": "8375bcc9fba335044b77494453f35d2d802fabb8117554f15d4a5d495c1f7f39", + "route_weight_sha256": "bcdd0eba96da3cde2af3200844d7c521b3064e65ee13f055b558d34348acc919", + "loads": [ + 11, + 14, + 37, + 25, + 115, + 29, + 5, + 34, + 16, + 8, + 25, + 33, + 8, + 26, + 34, + 14, + 22, + 20, + 37, + 28, + 48, + 12, + 11, + 70, + 11, + 31, + 50, + 34, + 24, + 42, + 40, + 31, + 38, + 13, + 42, + 47, + 35, + 11, + 26, + 47, + 25, + 13, + 9, + 22, + 22, + 48, + 29, + 19, + 20, + 39, + 6, + 27, + 10, + 18, + 43, + 25, + 16, + 17, + 29, + 28, + 11, + 5, + 43, + 12 + ], + "weighted_loads": [ + 0.5502582658082247, + 0.6270650830119848, + 2.3211502265185118, + 1.517864365130663, + 6.602098407223821, + 1.5688279308378696, + 0.15597006492316723, + 2.603567523881793, + 1.1190216541290283, + 0.26586295664310455, + 1.937927097082138, + 2.0660274382680655, + 0.28003342263400555, + 1.57519755885005, + 2.5056126713752747, + 0.6021347306668758, + 1.0891054328531027, + 0.9578766003251076, + 2.820282619446516, + 2.4068948291242123, + 2.949033662676811, + 0.4179652202874422, + 0.4182483181357384, + 4.422719879075885, + 0.5551088228821754, + 1.452709797769785, + 2.7552874721586704, + 1.735291413962841, + 2.1316152960062027, + 3.2440078537911177, + 3.1512129977345467, + 1.7868522871285677, + 4.1522904727607965, + 0.6307490766048431, + 2.8948815762996674, + 2.556926114484668, + 1.4539407175034285, + 0.42519744113087654, + 1.4069329388439655, + 1.5940615087747574, + 1.0811026897281408, + 0.54883130826056, + 0.3521960936486721, + 1.180017489939928, + 0.7423155903816223, + 3.2683245725929737, + 3.3219905123114586, + 1.0909605883061886, + 0.7072852160781622, + 2.0653409343212843, + 0.2024197168648243, + 1.427086977288127, + 0.6248173527419567, + 0.9071787130087614, + 3.084183955565095, + 1.894594507291913, + 0.9341844078153372, + 0.8822861202061176, + 5.100566895678639, + 2.4834486953914165, + 0.3714103139936924, + 0.161165127530694, + 2.602006506174803, + 0.4654633514583111 + ], + "unique_experts": 64, + "load_cv": 0.6433784195365329, + "normalized_load_entropy": 0.9570265437794915, + "max_load_share": 0.06609195402298851 + } + }, + "s0_x": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "b8c8941f1d66979fa8821558199753bfef883830f755b0696f8e70a6d079df85", + "route_weight_sha256": "691ccf56107b7d00c9ad17d6b58033e1b231eaaafd8fc849753e9e8540463299", + "loads": [ + 4, + 13, + 26, + 25, + 112, + 27, + 4, + 32, + 5, + 6, + 25, + 28, + 6, + 26, + 27, + 12, + 23, + 12, + 12, + 26, + 49, + 7, + 11, + 68, + 11, + 31, + 47, + 33, + 23, + 40, + 37, + 28, + 35, + 16, + 40, + 28, + 30, + 6, + 27, + 51, + 17, + 11, + 5, + 18, + 20, + 45, + 11, + 17, + 16, + 25, + 3, + 24, + 2, + 8, + 43, + 24, + 13, + 13, + 25, + 24, + 8, + 1, + 45, + 7 + ], + "weighted_loads": [ + 0.15527965873479843, + 0.5594933144748211, + 1.2980228886008263, + 1.4850727282464504, + 6.445741273462772, + 1.5362546537071466, + 0.12597195245325565, + 2.5429716128855944, + 0.20314928516745567, + 0.18262321315705776, + 1.9278047364205122, + 1.6866709478199482, + 0.22798726707696915, + 1.5252699423581362, + 1.2582721523940563, + 0.5498345550149679, + 1.1102054622024298, + 0.4283056352287531, + 0.8569105118513107, + 2.2106806319206953, + 2.910165363922715, + 0.2557669635862112, + 0.4089865889400244, + 4.277048738673329, + 0.5219225138425827, + 1.4588589444756508, + 2.660108530893922, + 1.739359937608242, + 2.0779833272099495, + 3.153718426823616, + 2.931790642440319, + 1.5078369434922934, + 3.985036503523588, + 0.7034714668989182, + 2.5322679299861193, + 1.119454562664032, + 1.3217405024915934, + 0.18670382909476757, + 1.4516493529081345, + 1.715594382956624, + 0.7424891367554665, + 0.462924687191844, + 0.1936140228062868, + 0.7345064841210842, + 0.6895857006311417, + 3.148467868566513, + 0.5624922513961792, + 0.9548826403915882, + 0.5943288095295429, + 1.40984620526433, + 0.09600759297609329, + 1.2286253944039345, + 0.06761894933879375, + 0.31752870604395866, + 3.0111586581915617, + 1.8752620592713356, + 0.6529876310378313, + 0.685924107208848, + 4.658103263005614, + 2.1438451278954744, + 0.2886065188795328, + 0.024026455357670784, + 2.701054574921727, + 0.2600612882524729 + ], + "unique_experts": 64, + "load_cv": 0.7702367329361258, + "normalized_load_entropy": 0.9379066954165193, + "max_load_share": 0.0749665327978581 + }, + "full_input": { + "tokens": 274, + "top_k": 6, + "decisions": 1644, + "ordered_route_sha256": "0f83201b8eba3e4d673b38152147306a767f92b9b83f707e7a1e824851f06560", + "route_weight_sha256": "5891a25d5d877238ab3d0be882adfbc1855362ad7ff0673807556f1f19644815", + "loads": [ + 12, + 15, + 38, + 25, + 112, + 29, + 4, + 32, + 13, + 6, + 25, + 32, + 6, + 26, + 32, + 16, + 23, + 13, + 30, + 26, + 49, + 8, + 11, + 68, + 11, + 32, + 47, + 33, + 23, + 40, + 45, + 28, + 36, + 16, + 40, + 32, + 30, + 8, + 27, + 53, + 23, + 11, + 7, + 18, + 20, + 46, + 18, + 17, + 20, + 37, + 5, + 27, + 12, + 16, + 43, + 24, + 14, + 13, + 29, + 26, + 8, + 3, + 45, + 10 + ], + "weighted_loads": [ + 0.7218968644738197, + 0.6589160468429327, + 2.500849051401019, + 1.4850727282464504, + 6.445741273462772, + 1.5833902172744274, + 0.12597195245325565, + 2.5429716128855944, + 0.703740794211626, + 0.18262321315705776, + 1.9278047364205122, + 2.047944951802492, + 0.22798726707696915, + 1.5252699423581362, + 2.22578270919621, + 0.6851497907191515, + 1.1102054622024298, + 0.4595597106963396, + 1.9536886028945446, + 2.2106806319206953, + 2.910165363922715, + 0.2795180231332779, + 0.4089865889400244, + 4.277048738673329, + 0.5219225138425827, + 1.5043494366109371, + 2.660108530893922, + 1.739359937608242, + 2.0779833272099495, + 3.153718426823616, + 3.351674733683467, + 1.5078369434922934, + 4.014716312289238, + 0.7034714668989182, + 2.5322679299861193, + 1.2908702827990055, + 1.3217405024915934, + 0.24919493496418, + 1.4516493529081345, + 1.7633430194109678, + 1.0708468668162823, + 0.462924687191844, + 0.24904387071728706, + 0.7345064841210842, + 0.6895857006311417, + 3.1989528611302376, + 2.081168994307518, + 0.9548826403915882, + 0.7777315527200699, + 1.9627269729971886, + 0.16903658024966717, + 1.4198722541332245, + 0.7612370885908604, + 0.8058807365596294, + 3.0111586581915617, + 1.8752620592713356, + 0.8761449176818132, + 0.685924107208848, + 4.871037818491459, + 2.2390208709985018, + 0.2886065188795328, + 0.07809923402965069, + 2.701054574921727, + 0.438387056812644 + ], + "unique_experts": 64, + "load_cv": 0.6812956197591109, + "normalized_load_entropy": 0.9514213206808803, + "max_load_share": 0.0681265206812652 + } + }, + "s1_x": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "46903f576cf66f9ed0592fde88796cb606233a5d06a7e70e2345aa25cf7991b9", + "route_weight_sha256": "4c2ec0b1a9c4662b14fb5c54284ca33eab070ad98d0555c5612c013494c7a364", + "loads": [ + 5, + 13, + 26, + 23, + 114, + 26, + 4, + 32, + 6, + 7, + 28, + 30, + 8, + 25, + 25, + 9, + 23, + 13, + 14, + 26, + 50, + 11, + 9, + 69, + 11, + 33, + 48, + 36, + 23, + 39, + 34, + 28, + 35, + 13, + 39, + 28, + 35, + 6, + 27, + 38, + 16, + 10, + 6, + 17, + 20, + 46, + 11, + 16, + 18, + 22, + 3, + 24, + 2, + 7, + 43, + 24, + 15, + 11, + 25, + 25, + 10, + 2, + 44, + 8 + ], + "weighted_loads": [ + 0.16936019994318485, + 0.5528180878609419, + 1.3018471971154213, + 1.458357721567154, + 6.599576303735375, + 1.4840778205543756, + 0.1258127000182867, + 2.5107527561485767, + 0.2599611282348633, + 0.21751014329493046, + 2.041609873995185, + 1.7603911999613047, + 0.28250870667397976, + 1.5275691710412502, + 1.193620866164565, + 0.43096429854631424, + 1.1258776187896729, + 0.4371560588479042, + 0.9921866580843925, + 2.216853914782405, + 2.9969717003405094, + 0.37358122132718563, + 0.35778013803064823, + 4.452142760157585, + 0.5428660549223423, + 1.5144051499664783, + 2.6554966997355223, + 1.8440009113401175, + 2.1125025544315577, + 3.1214827224612236, + 2.7348148599267006, + 1.5267130583524704, + 4.04596977494657, + 0.5730950515717268, + 2.546564966440201, + 1.154114918783307, + 1.4570626486092806, + 0.20948049798607826, + 1.4048312958329916, + 1.3057128954678774, + 0.6722486764192581, + 0.4272640813142061, + 0.23860042728483677, + 0.7210192084312439, + 0.7031958233565092, + 3.1307156663388014, + 0.604769479483366, + 0.9365019835531712, + 0.6522945631295443, + 1.3177010174840689, + 0.09912580251693726, + 1.2460660450160503, + 0.06443242356181145, + 0.26626697182655334, + 2.993185516446829, + 1.8406858872622252, + 0.7119545787572861, + 0.6283801309764385, + 4.578211447224021, + 2.2222470864653587, + 0.3453977685421705, + 0.054432185366749763, + 2.660601122304797, + 0.30766555666923523 + ], + "unique_experts": 64, + "load_cv": 0.7668790111137554, + "normalized_load_entropy": 0.9399483536721133, + "max_load_share": 0.07630522088353414 + }, + "full_input": { + "tokens": 290, + "top_k": 6, + "decisions": 1740, + "ordered_route_sha256": "ec0a4fe1e32e5c1edadddb6fd09ca9324ad08aa8eb5cbfd303a434afb439c085", + "route_weight_sha256": "226b3ebce4e75c923d27d3b09d138d483038f3118497f15d44656286478a5419", + "loads": [ + 15, + 16, + 39, + 23, + 115, + 28, + 5, + 34, + 17, + 8, + 28, + 34, + 8, + 26, + 34, + 11, + 23, + 22, + 39, + 27, + 50, + 12, + 9, + 69, + 11, + 34, + 48, + 36, + 23, + 40, + 44, + 30, + 37, + 14, + 43, + 41, + 35, + 12, + 28, + 40, + 22, + 10, + 7, + 23, + 20, + 47, + 28, + 19, + 22, + 36, + 6, + 29, + 12, + 19, + 45, + 25, + 17, + 16, + 28, + 28, + 10, + 4, + 44, + 15 + ], + "weighted_loads": [ + 0.8231832627207041, + 0.6920171659439802, + 2.4777838457375765, + 1.458357721567154, + 6.638543294742703, + 1.5416323281824589, + 0.15485978312790394, + 2.580459179356694, + 1.1657335571944714, + 0.2546022702008486, + 2.041609873995185, + 2.0554974917322397, + 0.28250870667397976, + 1.5706780664622784, + 2.2289693504571915, + 0.49012657813727856, + 1.1258776187896729, + 0.9988254979252815, + 2.9404978156089783, + 2.35163844935596, + 2.9969717003405094, + 0.39813938178122044, + 0.35778013803064823, + 4.452142760157585, + 0.5428660549223423, + 1.557535246014595, + 2.6554966997355223, + 1.8440009113401175, + 2.1125025544315577, + 3.158048514276743, + 3.3582585155963898, + 1.7726993300020695, + 4.141788961365819, + 0.650417996570468, + 2.963871482759714, + 2.4149142242968082, + 1.4570626486092806, + 0.45781164802610874, + 1.4427880328148603, + 1.3535740580409765, + 0.9520591776818037, + 0.4272640813142061, + 0.2617048230022192, + 1.228753712028265, + 0.7031958233565092, + 3.1932627987116575, + 3.1429687663912773, + 1.0916873775422573, + 0.7853949330747128, + 1.9321388769894838, + 0.18805576860904694, + 1.5384572744369507, + 0.7298186607658863, + 0.9297895487397909, + 3.1117168441414833, + 1.8752509783953428, + 0.9718686118721962, + 0.8620469998568296, + 4.985556846484542, + 2.461474735289812, + 0.3453977685421705, + 0.11839381791651249, + 2.660601122304797, + 0.5997752156108618 + ], + "unique_experts": 64, + "load_cv": 0.6384309938963638, + "normalized_load_entropy": 0.957346375438307, + "max_load_share": 0.06609195402298851 + } + }, + "s0_period": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "4f63d3c999e94a4510fa25dfd5352cfe7d7e9a9ec9e594a2e9223c1447f81a89", + "route_weight_sha256": "4f5e43bab349ece785fe7d656402a9b41f612c0197b34984aab25df0af8c0665", + "loads": [ + 2, + 13, + 26, + 24, + 112, + 27, + 4, + 32, + 5, + 6, + 24, + 29, + 6, + 24, + 26, + 12, + 22, + 13, + 13, + 26, + 49, + 7, + 10, + 67, + 11, + 32, + 47, + 35, + 23, + 41, + 34, + 26, + 36, + 15, + 41, + 28, + 32, + 6, + 27, + 48, + 17, + 11, + 5, + 16, + 21, + 46, + 11, + 17, + 18, + 25, + 4, + 24, + 3, + 9, + 45, + 24, + 13, + 13, + 24, + 24, + 10, + 2, + 44, + 7 + ], + "weighted_loads": [ + 0.08380075171589851, + 0.5605900250375271, + 1.2911840118467808, + 1.4482773561030626, + 6.4561021737754345, + 1.5496147889643908, + 0.1272246055305004, + 2.533110735937953, + 0.20387890748679638, + 0.18449430353939533, + 1.900761254131794, + 1.7223478220403194, + 0.22211910597980022, + 1.4633593279868364, + 1.2342820651829243, + 0.5631053037941456, + 1.0704528018832207, + 0.44459785521030426, + 0.9068831112235785, + 2.2176553606987, + 2.9101654570549726, + 0.2550604958087206, + 0.38479211926460266, + 4.231146648526192, + 0.5392139069736004, + 1.5141338501125574, + 2.6708367820829153, + 1.7980160936713219, + 2.0812574196606874, + 3.19930262491107, + 2.791086232289672, + 1.4300747327506542, + 4.031293902546167, + 0.6711319573223591, + 2.5454215686768293, + 1.1534370630979538, + 1.3852770905941725, + 0.1891690008342266, + 1.456631574779749, + 1.630066491663456, + 0.7322589941322803, + 0.469914086163044, + 0.18888352066278458, + 0.68573491089046, + 0.7200005296617746, + 3.1827521845698357, + 0.5874709784984589, + 0.956180039793253, + 0.6526790168136358, + 1.397679639980197, + 0.12119107693433762, + 1.2341036405414343, + 0.0989897008985281, + 0.3415482770651579, + 3.090103890746832, + 1.8658329024910927, + 0.6550475396215916, + 0.6787432506680489, + 4.600281748920679, + 2.156278731301427, + 0.3549204748123884, + 0.052051424980163574, + 2.668198700994253, + 0.2615796606987715 + ], + "unique_experts": 64, + "load_cv": 0.7662805424659804, + "normalized_load_entropy": 0.9389467130967389, + "max_load_share": 0.0749665327978581 + }, + "full_input": { + "tokens": 274, + "top_k": 6, + "decisions": 1644, + "ordered_route_sha256": "428c3de8f88f2e768bfeff8786cb954714f570540637e8339709f22bb514a733", + "route_weight_sha256": "7091df6f75be47b94a6c27632f24f0befae9e21f90dbc7bd0a98ac9a3ea3984d", + "loads": [ + 10, + 14, + 38, + 24, + 112, + 29, + 4, + 32, + 13, + 6, + 24, + 33, + 6, + 24, + 31, + 15, + 22, + 14, + 32, + 26, + 49, + 9, + 10, + 67, + 11, + 33, + 47, + 35, + 23, + 41, + 40, + 27, + 37, + 15, + 41, + 31, + 32, + 9, + 27, + 51, + 23, + 11, + 7, + 16, + 21, + 47, + 19, + 17, + 21, + 36, + 7, + 26, + 13, + 18, + 45, + 24, + 14, + 14, + 27, + 26, + 10, + 5, + 44, + 9 + ], + "weighted_loads": [ + 0.6761090457439423, + 0.6329301930963993, + 2.3546972703188658, + 1.4482773561030626, + 6.4561021737754345, + 1.5967503525316715, + 0.1272246055305004, + 2.533110735937953, + 0.7044704165309668, + 0.18449430353939533, + 1.900761254131794, + 2.073480162769556, + 0.22211910597980022, + 1.4633593279868364, + 2.3043468985706568, + 0.663557056337595, + 1.0704528018832207, + 0.4784085564315319, + 2.0356017146259546, + 2.2176553606987, + 2.9101654570549726, + 0.31126078590750694, + 0.38479211926460266, + 4.231146648526192, + 0.5392139069736004, + 1.5610704850405455, + 2.6708367820829153, + 1.7980160936713219, + 2.0812574196606874, + 3.19930262491107, + 3.1561824288219213, + 1.4612099379301071, + 4.058903034776449, + 0.6711319573223591, + 2.5454215686768293, + 1.2872902676463127, + 1.3852770905941725, + 0.2793409004807472, + 1.456631574779749, + 1.7073691356927156, + 1.0506932586431503, + 0.469914086163044, + 0.24431336857378483, + 0.68573491089046, + 0.7200005296617746, + 3.235300436615944, + 2.2499664425849915, + 0.956180039793253, + 0.7981276866048574, + 1.9066656399518251, + 0.23026126809418201, + 1.3879303317517042, + 0.757886428385973, + 0.8854432832449675, + 3.090103890746832, + 1.8658329024910927, + 0.8782048262655735, + 0.7352542988955975, + 4.748933060094714, + 2.2438079807907343, + 0.3549204748123884, + 0.13488035090267658, + 2.668198700994253, + 0.3554436583071947 + ], + "unique_experts": 64, + "load_cv": 0.6748700533147587, + "normalized_load_entropy": 0.9528932493955848, + "max_load_share": 0.0681265206812652 + } + }, + "s1_period": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "53d13c8d7482642f77986af8df04a9c448b73aa20b6392641ed2c06add8bbd97", + "route_weight_sha256": "d5f6537bd8b21cee8f539c3e09b2ef07c622b64ebe34673e35b30a1400214b49", + "loads": [ + 5, + 12, + 27, + 24, + 113, + 25, + 4, + 32, + 6, + 6, + 27, + 30, + 7, + 25, + 25, + 8, + 22, + 12, + 14, + 27, + 49, + 9, + 11, + 68, + 12, + 30, + 50, + 37, + 25, + 43, + 33, + 29, + 35, + 13, + 42, + 25, + 37, + 7, + 25, + 37, + 17, + 10, + 6, + 17, + 18, + 46, + 11, + 17, + 18, + 23, + 3, + 24, + 2, + 8, + 42, + 24, + 14, + 11, + 24, + 25, + 12, + 3, + 43, + 8 + ], + "weighted_loads": [ + 0.16892150230705738, + 0.5221795924007893, + 1.3432346228510141, + 1.4956077747046947, + 6.466892089694738, + 1.4563985001295805, + 0.12595646642148495, + 2.5318171195685863, + 0.2599065601825714, + 0.19193487614393234, + 1.9894201159477234, + 1.7518183905631304, + 0.25494449585676193, + 1.5321090519428253, + 1.1959515009075403, + 0.4014576505869627, + 1.0828069671988487, + 0.41606575436890125, + 0.960806593298912, + 2.2555828448385, + 2.980988897383213, + 0.3092972841113806, + 0.40066315047442913, + 4.385984379798174, + 0.5810204297304153, + 1.4269100409001112, + 2.7242079712450504, + 1.875667430460453, + 2.204864425584674, + 3.2824982292950153, + 2.6135800275951624, + 1.5460408087819815, + 4.0642330180853605, + 0.5758883692324162, + 2.6697895005345345, + 1.0540401563048363, + 1.532118322327733, + 0.24726101011037827, + 1.341173330321908, + 1.2818466033786535, + 0.7261533662676811, + 0.42540938779711723, + 0.23312907293438911, + 0.732054116204381, + 0.6477027162909508, + 3.1455839667469263, + 0.617509376257658, + 0.9691040758043528, + 0.6538137421011925, + 1.356000144034624, + 0.10060743615031242, + 1.2503740265965462, + 0.06296687945723534, + 0.3085545711219311, + 2.938829906284809, + 1.8388746809214354, + 0.6805318370461464, + 0.6428282000124454, + 4.561204973608255, + 2.2297750171273947, + 0.41348006948828697, + 0.07997322641313076, + 2.5962454471737146, + 0.29729731008410454 + ], + "unique_experts": 64, + "load_cv": 0.7644823254905206, + "normalized_load_entropy": 0.9402775896022851, + "max_load_share": 0.07563587684069611 + }, + "full_input": { + "tokens": 290, + "top_k": 6, + "decisions": 1740, + "ordered_route_sha256": "a887df03e17da5360f8ddc2d7ddb15400adecf66a23329718af907b92b7e9a5d", + "route_weight_sha256": "c3ae1906768a543d5698b6a603cf71294400e4c0e62719ad682b25c34ef2d330", + "loads": [ + 13, + 15, + 39, + 24, + 114, + 27, + 5, + 34, + 16, + 8, + 27, + 34, + 7, + 26, + 34, + 10, + 22, + 21, + 38, + 28, + 49, + 10, + 11, + 68, + 12, + 31, + 50, + 37, + 25, + 44, + 42, + 31, + 37, + 14, + 46, + 39, + 37, + 13, + 26, + 39, + 23, + 10, + 7, + 23, + 18, + 47, + 29, + 20, + 21, + 37, + 6, + 30, + 12, + 21, + 44, + 25, + 16, + 17, + 27, + 28, + 12, + 6, + 43, + 15 + ], + "weighted_loads": [ + 0.6419167835265398, + 0.6613786704838276, + 2.4028290435671806, + 1.4956077747046947, + 6.505859080702066, + 1.5139530077576637, + 0.15500354953110218, + 2.601523542776704, + 1.1234761737287045, + 0.2735309973359108, + 1.9894201159477234, + 2.0886692348867655, + 0.25494449585676193, + 1.5752179473638535, + 2.3891684599220753, + 0.460619930177927, + 1.0828069671988487, + 0.9777351934462786, + 2.8553275167942047, + 2.390367379412055, + 2.980988897383213, + 0.3338554445654154, + 0.40066315047442913, + 4.385984379798174, + 0.5810204297304153, + 1.4764156844466925, + 2.7242079712450504, + 1.875667430460453, + 2.204864425584674, + 3.3190640211105347, + 3.1957916114479303, + 1.7920270804315805, + 4.163213578984141, + 0.6532113142311573, + 3.0870960168540478, + 2.3360651191323996, + 1.532118322327733, + 0.4940792806446552, + 1.3791300673037767, + 1.3297077659517527, + 0.9964289385825396, + 0.42540938779711723, + 0.25623346865177155, + 1.2172177731990814, + 0.6477027162909508, + 3.2081132773309946, + 3.202702008187771, + 1.124289469793439, + 0.7499584536999464, + 1.973260261118412, + 0.19331498071551323, + 1.606167446821928, + 0.7117746695876122, + 1.0143751334398985, + 3.0573612339794636, + 1.873439772054553, + 0.9404458701610565, + 0.9469427894800901, + 4.959230620414019, + 2.466548601165414, + 0.41348006948828697, + 0.17312034778296947, + 2.5962454471737146, + 0.5568559132516384 + ], + "unique_experts": 64, + "load_cv": 0.6347117694315959, + "normalized_load_entropy": 0.9578515693887092, + "max_load_share": 0.06551724137931035 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 249, + "ordered_topk_exact_tokens": 181, + "set_exact_tokens": 200, + "mean_set_jaccard": 0.9437751004016064, + "mean_token_weighted_tv": 0.010542062773223383, + "aggregate_load_tv": 0.020080321285140566 + }, + "system_bos": { + "tokens": 249, + "ordered_topk_exact_tokens": 164, + "set_exact_tokens": 188, + "mean_set_jaccard": 0.9291451520367182, + "mean_token_weighted_tv": 0.01385696421201569, + "aggregate_load_tv": 0.022757697456492643 + }, + "system_x": { + "tokens": 249, + "ordered_topk_exact_tokens": 142, + "set_exact_tokens": 174, + "mean_set_jaccard": 0.9113597246127365, + "mean_token_weighted_tv": 0.01806221185364278, + "aggregate_load_tv": 0.02878179384203481 + }, + "system_period": { + "tokens": 249, + "ordered_topk_exact_tokens": 130, + "set_exact_tokens": 169, + "mean_set_jaccard": 0.9030407343660355, + "mean_token_weighted_tv": 0.01920887865275743, + "aggregate_load_tv": 0.03078982597054885 + }, + "bos_at_s0": { + "tokens": 249, + "ordered_topk_exact_tokens": 149, + "set_exact_tokens": 174, + "mean_set_jaccard": 0.9115509657678332, + "mean_token_weighted_tv": 0.017366989942110448, + "aggregate_load_tv": 0.024765729585006686 + }, + "bos_at_s1": { + "tokens": 249, + "ordered_topk_exact_tokens": 133, + "set_exact_tokens": 164, + "mean_set_jaccard": 0.8938611589213998, + "mean_token_weighted_tv": 0.0196734409195831, + "aggregate_load_tv": 0.028781793842034817 + }, + "x_at_s0": { + "tokens": 249, + "ordered_topk_exact_tokens": 141, + "set_exact_tokens": 168, + "mean_set_jaccard": 0.9027538726333907, + "mean_token_weighted_tv": 0.018277681529910928, + "aggregate_load_tv": 0.024096385542168672 + }, + "x_at_s1": { + "tokens": 249, + "ordered_topk_exact_tokens": 129, + "set_exact_tokens": 167, + "mean_set_jaccard": 0.899885255306942, + "mean_token_weighted_tv": 0.020449207340138983, + "aggregate_load_tv": 0.026773761713520753 + }, + "period_at_s0": { + "tokens": 249, + "ordered_topk_exact_tokens": 137, + "set_exact_tokens": 170, + "mean_set_jaccard": 0.9041881812966149, + "mean_token_weighted_tv": 0.018382719343894696, + "aggregate_load_tv": 0.024765729585006696 + }, + "period_at_s1": { + "tokens": 249, + "ordered_topk_exact_tokens": 130, + "set_exact_tokens": 166, + "mean_set_jaccard": 0.8978772231784279, + "mean_token_weighted_tv": 0.020503871393461066, + "aggregate_load_tv": 0.031459170013386877 + } + } + }, + "layer_19": { + "layer": 19, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "3a13c1670b97f199a07cc479245ff7bd8bee592bef5d3f8a6d2d0343b3170777", + "route_weight_sha256": "7fea311c592e9b5acd001d0663337da0210934d2e64d52b3d080223060934f80", + "loads": [ + 16, + 14, + 22, + 0, + 13, + 17, + 20, + 41, + 32, + 3, + 14, + 24, + 21, + 11, + 25, + 45, + 27, + 1, + 26, + 39, + 41, + 44, + 20, + 21, + 30, + 30, + 32, + 15, + 23, + 3, + 27, + 13, + 0, + 89, + 4, + 43, + 17, + 15, + 20, + 13, + 25, + 27, + 16, + 4, + 27, + 22, + 48, + 25, + 28, + 40, + 17, + 23, + 35, + 20, + 11, + 24, + 7, + 40, + 32, + 22, + 35, + 20, + 2, + 33 + ], + "weighted_loads": [ + 0.7649330925196409, + 1.7330059260129929, + 0.7316788714379072, + 0.0, + 0.5532614439725876, + 0.6198626011610031, + 1.0359967052936554, + 2.7529515884816647, + 2.393040169030428, + 0.11126936599612236, + 0.5726881697773933, + 1.4129376262426376, + 0.8259121719747782, + 0.37411605939269066, + 1.7943669110536575, + 2.068086536601186, + 2.1463651545345783, + 0.03122025355696678, + 0.9713908284902573, + 2.0027550272643566, + 2.6718510687351227, + 2.8953614309430122, + 0.8606705013662577, + 0.8663284331560135, + 1.734406592324376, + 3.9988729283213615, + 1.2638141177594662, + 0.6707949452102184, + 1.4372120033949614, + 0.1172504872083664, + 1.1093891877681017, + 0.6172305308282375, + 0.0, + 5.739633709192276, + 0.15207186341285706, + 3.295273467898369, + 0.7698226179927588, + 0.5032347459346056, + 1.7208070643246174, + 0.9181982912123203, + 1.2003876473754644, + 1.0636409251019359, + 0.6468315087258816, + 0.12860451824963093, + 1.6248331032693386, + 1.1160170789808035, + 1.936977757140994, + 1.827868590131402, + 0.9653286524116993, + 3.313722612336278, + 0.5533281359821558, + 1.0614987835288048, + 2.4639488868415356, + 0.7071021609008312, + 0.37511328235268593, + 1.1947769448161125, + 0.25909838639199734, + 2.560143070295453, + 4.346492327749729, + 1.4836882911622524, + 2.6562069673091173, + 1.148176807910204, + 0.09293513745069504, + 2.4700696486979723 + ], + "unique_experts": 62, + "load_cv": 0.6226828162048177, + "normalized_load_entropy": 0.9518406841936601, + "max_load_share": 0.059571619812583666 + }, + "full_input": { + "tokens": 274, + "top_k": 6, + "decisions": 1644, + "ordered_route_sha256": "820c3f8a93217e90d47c8366f7056d30a3bead18f6828ac877df5e3faa41906d", + "route_weight_sha256": "4e57f7d6c961495512ece4d3a47a9360a368bb6000fd60f5e484342892871b0f", + "loads": [ + 18, + 15, + 23, + 0, + 18, + 19, + 32, + 41, + 32, + 8, + 14, + 25, + 30, + 12, + 30, + 45, + 29, + 2, + 26, + 45, + 41, + 44, + 25, + 30, + 37, + 30, + 32, + 17, + 24, + 7, + 34, + 13, + 0, + 89, + 4, + 45, + 19, + 21, + 23, + 14, + 28, + 31, + 24, + 5, + 28, + 22, + 48, + 30, + 29, + 41, + 17, + 23, + 35, + 23, + 16, + 24, + 7, + 40, + 38, + 22, + 35, + 24, + 8, + 33 + ], + "weighted_loads": [ + 0.809028466232121, + 1.81966083496809, + 0.7560813277959824, + 0.0, + 1.3894861601293087, + 0.663193161599338, + 1.5722410082817078, + 2.7529515884816647, + 2.393040169030428, + 0.35025429353117943, + 0.5726881697773933, + 1.443475453183055, + 1.4205239061266184, + 0.41348953545093536, + 2.212607555091381, + 2.068086536601186, + 2.2307354882359505, + 0.08743415400385857, + 0.9713908284902573, + 2.3216716311872005, + 2.6718510687351227, + 2.8953614309430122, + 1.040996277704835, + 1.1815899536013603, + 2.314238745253533, + 3.9988729283213615, + 1.2638141177594662, + 0.7592501826584339, + 1.5753404777497053, + 0.279489666223526, + 1.3864906951785088, + 0.6172305308282375, + 0.0, + 5.739633709192276, + 0.15207186341285706, + 3.385219369083643, + 0.8128702763933688, + 0.7800365332514048, + 1.9819577299058437, + 0.9518812783062458, + 1.2661058870144188, + 1.348424787633121, + 1.2264366373419762, + 0.18610870651900768, + 1.6355185210704803, + 1.1160170789808035, + 1.936977757140994, + 2.1576032917946577, + 1.002518616616726, + 3.3576574455946684, + 0.5533281359821558, + 1.0614987835288048, + 2.4639488868415356, + 0.9850368313491344, + 2.075034663081169, + 1.1947769448161125, + 0.25909838639199734, + 2.560143070295453, + 4.633845442906022, + 1.4836882911622524, + 2.6562069673091173, + 1.3701059482991695, + 0.6091573275625706, + 2.4700696486979723 + ], + "unique_experts": 62, + "load_cv": 0.5569544490866888, + "normalized_load_entropy": 0.9605397368797086, + "max_load_share": 0.054136253041362534 + } + }, + "s1_eos": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "303862bfd479a609184bdd33df4e0b92fdcc5af03b9b45dfc6af2d65d6dfada7", + "route_weight_sha256": "7ee6f7995c9d3a1bb7f12248158ab3d6d0b07491d4ad59c1b9317e3322448dbe", + "loads": [ + 16, + 16, + 23, + 0, + 14, + 16, + 21, + 41, + 32, + 6, + 14, + 25, + 17, + 10, + 25, + 46, + 26, + 1, + 25, + 40, + 41, + 43, + 20, + 17, + 28, + 28, + 35, + 13, + 22, + 3, + 24, + 13, + 0, + 90, + 4, + 41, + 18, + 13, + 20, + 14, + 26, + 28, + 17, + 4, + 26, + 22, + 48, + 26, + 31, + 40, + 17, + 25, + 35, + 21, + 11, + 24, + 8, + 39, + 29, + 22, + 35, + 22, + 3, + 34 + ], + "weighted_loads": [ + 0.7475743722170591, + 1.7721034549176693, + 0.772817512974143, + 0.0, + 0.5711893327534199, + 0.5992446132004261, + 1.0651489552110434, + 2.7467012591660023, + 2.3841676339507103, + 0.18714050948619843, + 0.5701044164597988, + 1.435030434280634, + 0.7054426409304142, + 0.35716176219284534, + 1.766398135572672, + 2.0921862237155437, + 2.075582943856716, + 0.03108883835375309, + 0.9590031821280718, + 1.9984988030046225, + 2.680937960743904, + 2.8755635023117065, + 0.8595402538776398, + 0.745079455897212, + 1.6793236713856459, + 3.9388279281556606, + 1.3329533822834492, + 0.608578072860837, + 1.373838346451521, + 0.1228796411305666, + 0.995534673333168, + 0.6049047745764256, + 0.0, + 5.787875195965171, + 0.15559818595647812, + 3.1919152420014143, + 0.8097262755036354, + 0.42859806306660175, + 1.7263587936758995, + 0.9494513981044292, + 1.2512667924165726, + 1.1042821062728763, + 0.6566102113574743, + 0.1319434903562069, + 1.587276503443718, + 1.1175724491477013, + 1.931090071797371, + 1.8060615081340075, + 1.0752358119934797, + 3.303274715319276, + 0.5507497936487198, + 1.1474356669932604, + 2.47280097194016, + 0.7439680751413107, + 0.37007211335003376, + 1.1822519339621067, + 0.2811937350779772, + 2.5281826443970203, + 4.206016935408115, + 1.4661336112767458, + 2.6459398567676544, + 1.2118000909686089, + 0.13189002871513367, + 2.5052049458026886 + ], + "unique_experts": 62, + "load_cv": 0.6218072864127585, + "normalized_load_entropy": 0.9528186464786161, + "max_load_share": 0.060240963855421686 + }, + "full_input": { + "tokens": 290, + "top_k": 6, + "decisions": 1740, + "ordered_route_sha256": "21275fe5a79ce3a1fdb8e2a2a3e631d51e875aeeca88533f38c7d0bf5bc9fe02", + "route_weight_sha256": "da4efef16f3374fb7c7df507ea8e62cbfec38c9a4bd7860fcd19768611a0f030", + "loads": [ + 18, + 21, + 26, + 0, + 26, + 18, + 34, + 41, + 32, + 12, + 15, + 32, + 29, + 10, + 36, + 48, + 29, + 6, + 26, + 48, + 45, + 44, + 27, + 23, + 40, + 28, + 35, + 15, + 24, + 4, + 30, + 13, + 2, + 90, + 4, + 41, + 21, + 16, + 22, + 16, + 30, + 37, + 27, + 5, + 27, + 22, + 48, + 38, + 32, + 42, + 23, + 25, + 38, + 31, + 16, + 24, + 10, + 41, + 39, + 23, + 36, + 31, + 12, + 36 + ], + "weighted_loads": [ + 0.7734592254273593, + 2.054123941808939, + 0.8725754432380199, + 0.0, + 2.081059794872999, + 0.6889036102220416, + 1.7272963058203459, + 2.7467012591660023, + 2.3841676339507103, + 0.4550856053829193, + 0.6372217796742916, + 2.158177215605974, + 1.413673024624586, + 0.35716176219284534, + 2.5723000578582287, + 2.2016060166060925, + 2.474736899137497, + 0.25802719593048096, + 1.0570101831108332, + 2.437488229945302, + 3.013202413916588, + 2.92949328571558, + 1.1333895232528448, + 0.9322528867051005, + 2.5714935353025794, + 3.9388279281556606, + 1.3329533822834492, + 0.7062488552182913, + 1.542693305760622, + 0.1590124499052763, + 1.2077100276947021, + 0.6049047745764256, + 0.08742644637823105, + 5.787875195965171, + 0.15559818595647812, + 3.1919152420014143, + 0.8954841862432659, + 0.5705397818237543, + 1.9468078128993511, + 1.0508097745478153, + 1.3556481371633708, + 1.609619970433414, + 1.3916516806930304, + 0.1698429062962532, + 1.5979619212448597, + 1.1175724491477013, + 1.931090071797371, + 2.5659227203577757, + 1.1088792253285646, + 3.3983149137347937, + 0.9264390282332897, + 1.1474356669932604, + 2.617268245667219, + 1.5853398498147726, + 2.081763045862317, + 1.1822519339621067, + 0.3643742371350527, + 2.6152863577008247, + 4.710674729198217, + 1.5009024050086737, + 2.6866402961313725, + 1.6171299759298563, + 0.8692886047065258, + 2.6701014526188374 + ], + "unique_experts": 63, + "load_cv": 0.5328128653459248, + "normalized_load_entropy": 0.9640208639287315, + "max_load_share": 0.05172413793103448 + } + }, + "s0_bos": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "e0666304077164ad3189785a0efb97c29f9dc4789e12f03d485edd32f5e60c66", + "route_weight_sha256": "3537ae5a4f586687f63bfd4f7730ef077b3f07022191f1bce1750e6bd697cfaa", + "loads": [ + 17, + 17, + 23, + 0, + 15, + 17, + 20, + 39, + 33, + 3, + 14, + 22, + 20, + 14, + 25, + 48, + 26, + 1, + 25, + 40, + 40, + 42, + 17, + 15, + 30, + 28, + 34, + 15, + 22, + 2, + 25, + 13, + 0, + 89, + 3, + 40, + 15, + 17, + 20, + 15, + 23, + 27, + 17, + 4, + 27, + 21, + 51, + 26, + 37, + 40, + 18, + 23, + 35, + 21, + 13, + 25, + 6, + 40, + 30, + 22, + 30, + 20, + 2, + 35 + ], + "weighted_loads": [ + 0.7749341893941164, + 1.9224941283464432, + 0.7552661001682281, + 0.0, + 0.603295961394906, + 0.6271458342671394, + 1.0496492721140385, + 2.68119721673429, + 2.4210215844213963, + 0.10777378268539906, + 0.5783157274127007, + 1.3251775484532118, + 0.780075628310442, + 0.48472031205892563, + 1.7696945033967495, + 2.1558221951127052, + 2.1980073507875204, + 0.030128804966807365, + 0.9663170520216227, + 2.0051314122974873, + 2.657219335436821, + 2.841857573017478, + 0.7866901773959398, + 0.6554165203124285, + 1.6851022616028786, + 3.972208619117737, + 1.3237764313817024, + 0.6579198110848665, + 1.395156268030405, + 0.08980990201234818, + 1.0374157652258873, + 0.6233833953738213, + 0.0, + 5.719999987632036, + 0.12494463473558426, + 3.1557482574135065, + 0.7209607120603323, + 0.554536571726203, + 1.7203296199440956, + 0.9885352458804846, + 1.1667035780847073, + 1.0687565309926867, + 0.6794994622468948, + 0.12671987898647785, + 1.6362059731036425, + 1.0905158799141645, + 2.0569019746035337, + 1.8000835310667753, + 1.2384872250258923, + 3.3495480455458164, + 0.5748322699218988, + 1.0668653883039951, + 2.4689795300364494, + 0.7308258078992367, + 0.43097023665905, + 1.2073159255087376, + 0.22484412230551243, + 2.560861088335514, + 4.218472810462117, + 1.4691796377301216, + 2.530381254851818, + 1.1224972531199455, + 0.07962172105908394, + 2.565405832603574 + ], + "unique_experts": 62, + "load_cv": 0.6246138430258372, + "normalized_load_entropy": 0.9514637229163995, + "max_load_share": 0.059571619812583666 + }, + "full_input": { + "tokens": 274, + "top_k": 6, + "decisions": 1644, + "ordered_route_sha256": "497ace15efad4d291211c558079e09918a3ce9938ed026b1f82aa1c7cf63ee1c", + "route_weight_sha256": "6ba75f662722d8fd67a7e65180344bd9d9cb1a43c57538b8735a3814f81558f1", + "loads": [ + 18, + 18, + 24, + 0, + 19, + 19, + 31, + 39, + 33, + 7, + 14, + 23, + 29, + 17, + 30, + 48, + 28, + 2, + 25, + 47, + 40, + 42, + 22, + 21, + 37, + 28, + 35, + 17, + 23, + 6, + 34, + 13, + 0, + 89, + 3, + 43, + 15, + 23, + 23, + 16, + 25, + 32, + 25, + 5, + 28, + 22, + 51, + 31, + 39, + 41, + 18, + 24, + 35, + 24, + 17, + 25, + 6, + 40, + 36, + 22, + 30, + 24, + 8, + 35 + ], + "weighted_loads": [ + 0.8146012518554926, + 2.0091490373015404, + 0.7796685565263033, + 0.0, + 1.2694239374250174, + 0.6704763947054744, + 1.5320727564394474, + 2.68119721673429, + 2.4210215844213963, + 0.3279617615044117, + 0.5783157274127007, + 1.355715375393629, + 1.3708500638604164, + 0.6037486866116524, + 2.1933299750089645, + 2.1558221951127052, + 2.2823776844888926, + 0.7684175651520491, + 0.9663170520216227, + 2.551596913486719, + 2.657219335436821, + 2.841857573017478, + 0.9670159537345171, + 0.8852379387244582, + 2.370490713045001, + 3.972208619117737, + 1.3586234785616398, + 0.7382110562175512, + 1.532809603959322, + 0.2520490810275078, + 1.3876672070473433, + 0.6233833953738213, + 0.0, + 5.719999987632036, + 0.12494463473558426, + 3.2764778900891542, + 0.7209607120603323, + 0.8250580076128244, + 1.968723177909851, + 1.0234054569154978, + 1.2278382163494825, + 1.3682392491027713, + 1.2591045908629894, + 0.1842240672558546, + 1.6468913909047842, + 1.1170901786535978, + 2.0569019746035337, + 2.1369332280009985, + 1.3115146085619926, + 3.401273339986801, + 0.5748322699218988, + 1.0809986451640725, + 2.4689795300364494, + 0.9873789735138416, + 1.1871918998658657, + 1.2073159255087376, + 0.22484412230551243, + 2.560861088335514, + 4.5160808973014355, + 1.4691796377301216, + 2.530381254851818, + 1.3425452187657356, + 0.5958439111709595, + 2.565405832603574 + ], + "unique_experts": 62, + "load_cv": 0.5613587424070136, + "normalized_load_entropy": 0.9598594485640808, + "max_load_share": 0.054136253041362534 + } + }, + "s1_bos": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "ee3805cafbabb07d71cf6fed91b8868456b7814fb8705c7202d9fbc0cfd8c19a", + "route_weight_sha256": "5ae039cbfd9e091326c16253d7a991fde0e0d99d297f7d9dac21a11385d76933", + "loads": [ + 15, + 17, + 20, + 0, + 13, + 17, + 20, + 39, + 32, + 2, + 13, + 22, + 19, + 13, + 25, + 48, + 25, + 1, + 25, + 40, + 41, + 43, + 18, + 19, + 29, + 27, + 33, + 16, + 24, + 2, + 25, + 13, + 0, + 89, + 2, + 39, + 18, + 16, + 22, + 15, + 24, + 26, + 18, + 3, + 26, + 21, + 50, + 25, + 35, + 40, + 19, + 22, + 36, + 19, + 12, + 25, + 10, + 40, + 31, + 23, + 33, + 20, + 4, + 35 + ], + "weighted_loads": [ + 0.7036762721836567, + 1.8295298237353563, + 0.6756926998496056, + 0.0, + 0.5532695017755032, + 0.6330489739775658, + 1.0177545389160514, + 2.691294990479946, + 2.3863080982118845, + 0.08268927037715912, + 0.5500178225338459, + 1.3020131196826696, + 0.7831519041210413, + 0.45420241355895996, + 1.7250908017158508, + 2.1919464468955994, + 2.1358364522457123, + 0.029122138395905495, + 0.9488683976233006, + 2.040427964180708, + 2.692932453006506, + 2.868309114128351, + 0.8098626770079136, + 0.7855296637862921, + 1.6590908970683813, + 3.9323242865502834, + 1.3014826886355877, + 0.6793683655560017, + 1.435383951291442, + 0.08879305422306061, + 0.9832600932568312, + 0.6124228835105896, + 0.0, + 5.797431766986847, + 0.09187855571508408, + 3.1813485454767942, + 0.8133537992835045, + 0.5318191517144442, + 1.7975419647991657, + 0.9875243306159973, + 1.2099000457674265, + 1.0597708569839597, + 0.6763868741691113, + 0.09545761160552502, + 1.590104067698121, + 1.1001436151564121, + 2.0106304176151752, + 1.728308081626892, + 1.1830948758870363, + 3.3448849730193615, + 0.6041291616857052, + 1.0744016617536545, + 2.508069010451436, + 0.668228879570961, + 0.39581800624728203, + 1.2212414555251598, + 0.3319317679852247, + 2.557196956127882, + 4.258122477680445, + 1.5008818283677101, + 2.695899488404393, + 1.08966613560915, + 0.1421755738556385, + 2.5420638788491488 + ], + "unique_experts": 62, + "load_cv": 0.6219456098984126, + "normalized_load_entropy": 0.9518216711116836, + "max_load_share": 0.059571619812583666 + }, + "full_input": { + "tokens": 290, + "top_k": 6, + "decisions": 1740, + "ordered_route_sha256": "d5e743df32395688dfd73e5fbfb8ebc4f9af7cbe9548ddc6cc3c3959c2e2ba5e", + "route_weight_sha256": "f7695da88e247b2ce80f329494d83bd5d989bec04d462e29cec8d789f53b8171", + "loads": [ + 16, + 21, + 23, + 0, + 25, + 19, + 31, + 39, + 32, + 12, + 14, + 29, + 31, + 15, + 36, + 50, + 28, + 6, + 26, + 49, + 45, + 44, + 25, + 24, + 40, + 27, + 33, + 18, + 26, + 3, + 32, + 13, + 2, + 89, + 2, + 41, + 21, + 19, + 24, + 19, + 27, + 35, + 27, + 4, + 27, + 21, + 50, + 35, + 36, + 42, + 24, + 22, + 39, + 29, + 16, + 25, + 12, + 42, + 41, + 24, + 34, + 29, + 13, + 37 + ], + "weighted_loads": [ + 0.7251875065267086, + 2.0800641756504774, + 0.7744939047843218, + 0.0, + 2.094372157007456, + 0.7227079709991813, + 1.5838894052430987, + 2.691294990479946, + 2.3863080982118845, + 0.5204320251941681, + 0.6171351857483387, + 2.02515990100801, + 1.48593639023602, + 0.5337524265050888, + 2.516706161201, + 2.301366239786148, + 2.534990407526493, + 0.25606049597263336, + 1.046875398606062, + 2.7337087392807007, + 3.0251969061791897, + 2.9222388975322247, + 1.0837119463831186, + 0.9626262532547116, + 2.585524059832096, + 3.9323242865502834, + 1.3014826886355877, + 0.7770642340183258, + 1.6176206152886152, + 0.12492586299777031, + 1.2327605709433556, + 0.6124228835105896, + 0.08742644637823105, + 5.797431766986847, + 0.09187855571508408, + 3.2812099996954203, + 0.9314531646668911, + 0.6620539892464876, + 2.0011463090777397, + 1.1660240925848484, + 1.3049034588038921, + 1.5527806477621198, + 1.3746525160968304, + 0.13335702754557133, + 1.6007894854992628, + 1.1001436151564121, + 2.0106304176151752, + 2.404527883976698, + 1.2167382892221212, + 3.43838519603014, + 0.9407340586185455, + 1.0744016617536545, + 2.6525362841784954, + 1.4697507321834564, + 1.1659992150962353, + 1.2212414555251598, + 0.4151122700423002, + 2.6443006694316864, + 4.77459604293108, + 1.535650622099638, + 2.7365999277681112, + 1.4841473940759897, + 0.8795741498470306, + 2.7069603856652975 + ], + "unique_experts": 63, + "load_cv": 0.5294298291388878, + "normalized_load_entropy": 0.9641294935278041, + "max_load_share": 0.051149425287356325 + } + }, + "s0_x": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "dadd9fb7716427cd3170379256fe64e893283a231bd190ce9d9a58c85b27dd69", + "route_weight_sha256": "130b14c6ee223417118548947337dd1a44195acc40f7c0423326eedf02b89b44", + "loads": [ + 18, + 14, + 23, + 1, + 15, + 17, + 20, + 40, + 31, + 4, + 16, + 22, + 19, + 12, + 25, + 43, + 24, + 1, + 23, + 41, + 42, + 43, + 19, + 18, + 30, + 30, + 32, + 14, + 22, + 2, + 24, + 12, + 0, + 89, + 3, + 40, + 17, + 19, + 20, + 15, + 24, + 28, + 17, + 4, + 29, + 21, + 51, + 25, + 35, + 41, + 16, + 22, + 35, + 17, + 13, + 25, + 8, + 40, + 32, + 21, + 32, + 22, + 3, + 33 + ], + "weighted_loads": [ + 0.8086632881313562, + 1.7654706723988056, + 0.7734660636633635, + 0.024136850610375404, + 0.6350024472922087, + 0.6209120042622089, + 1.0396660398691893, + 2.6987584996968508, + 2.3057238161563873, + 0.13677473925054073, + 0.6338745057582855, + 1.3317083735018969, + 0.7398136276751757, + 0.4139453135430813, + 1.7669915482401848, + 2.018266836181283, + 2.1213961802423, + 0.02767987549304962, + 0.8783193472772837, + 1.9980177991092205, + 2.7342332396656275, + 2.8875452373176813, + 0.8354472108185291, + 0.741543797776103, + 1.7466183602809906, + 4.018299506045878, + 1.2570665050297976, + 0.630246426910162, + 1.3819528985768557, + 0.09313596040010452, + 0.9935845881700516, + 0.5950217712670565, + 0.0, + 5.762652341276407, + 0.11568386293947697, + 3.2284188885241747, + 0.7618955634534359, + 0.6011193990707397, + 1.7155048325657845, + 0.986818227916956, + 1.1913375072181225, + 1.1370486272498965, + 0.6960731185972691, + 0.13257559947669506, + 1.6887521855533123, + 1.1029892656952143, + 2.0350171104073524, + 1.7904063202440739, + 1.1747700087726116, + 3.3476772513240576, + 0.5081500057131052, + 1.0240644700825214, + 2.452284449711442, + 0.613776670768857, + 0.4249653611332178, + 1.1771799977868795, + 0.32762700878083706, + 2.568444434553385, + 4.294498406350613, + 1.4469453785568476, + 2.582893770188093, + 1.2195074800401926, + 0.12859364598989487, + 2.4955045338720083 + ], + "unique_experts": 63, + "load_cv": 0.6190343259608427, + "normalized_load_entropy": 0.9532041211938883, + "max_load_share": 0.059571619812583666 + }, + "full_input": { + "tokens": 274, + "top_k": 6, + "decisions": 1644, + "ordered_route_sha256": "aa2e37a93440be7b3affa6ac7994968f5dc3a978f8a6d64c9d2580e3de78e7e3", + "route_weight_sha256": "ac56298a493ad945cf854a50546647b8e98728ff3fff9564a7ab75b550edaaab", + "loads": [ + 19, + 15, + 25, + 1, + 20, + 20, + 32, + 40, + 31, + 8, + 16, + 23, + 30, + 13, + 31, + 43, + 26, + 1, + 23, + 47, + 42, + 43, + 25, + 25, + 36, + 30, + 32, + 16, + 23, + 6, + 31, + 12, + 0, + 89, + 3, + 42, + 17, + 24, + 23, + 16, + 27, + 32, + 26, + 5, + 30, + 21, + 51, + 31, + 36, + 42, + 16, + 22, + 35, + 20, + 17, + 25, + 8, + 40, + 39, + 21, + 32, + 26, + 10, + 33 + ], + "weighted_loads": [ + 0.8483303505927324, + 1.8521255813539028, + 0.8307924754917622, + 0.024136850610375404, + 1.3661558870226145, + 0.7535062720999122, + 1.5933373663574457, + 2.6987584996968508, + 2.3057238161563873, + 0.3439958728849888, + 0.6338745057582855, + 1.3622462004423141, + 1.5186320561915636, + 0.453318789601326, + 2.2070987708866596, + 2.018266836181283, + 2.205766513943672, + 0.02767987549304962, + 0.8783193472772837, + 2.301993664354086, + 2.7342332396656275, + 2.8875452373176813, + 1.0664711818099022, + 1.0089873587712646, + 2.2822222020477057, + 4.018299506045878, + 1.2570665050297976, + 0.7284465208649635, + 1.5197083670645952, + 0.25537513941526413, + 1.2681930493563414, + 0.5950217712670565, + 0.0, + 5.762652341276407, + 0.11568386293947697, + 3.320180417969823, + 0.7618955634534359, + 0.8026001416146755, + 1.9643601328134537, + 1.0190156660974026, + 1.3053731452673674, + 1.4245647741481662, + 1.4284285604953766, + 0.19007978774607182, + 1.699437603354454, + 1.1029892656952143, + 2.0350171104073524, + 2.2146834395825863, + 1.2119599729776382, + 3.3920669462531805, + 0.5081500057131052, + 1.0240644700825214, + 2.452284449711442, + 0.8570957500487566, + 1.1811870243400335, + 1.1771799977868795, + 0.32762700878083706, + 2.568444434553385, + 4.628750206902623, + 1.4469453785568476, + 2.582893770188093, + 1.440877402201295, + 0.6926167272031307, + 2.4955045338720083 + ], + "unique_experts": 63, + "load_cv": 0.556401461125455, + "normalized_load_entropy": 0.9608664826202253, + "max_load_share": 0.054136253041362534 + } + }, + "s1_x": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "9ad6c1f538c8006140b960b2dade6e811f958d0d9f9d76b6785ce47bd475791f", + "route_weight_sha256": "9b27cacda48c7ea823326aee98f067526fa6f9c8cff249d60f1083e205f6601a", + "loads": [ + 15, + 18, + 26, + 0, + 14, + 15, + 21, + 40, + 32, + 6, + 17, + 24, + 20, + 10, + 24, + 45, + 25, + 2, + 24, + 39, + 42, + 43, + 20, + 17, + 28, + 29, + 29, + 13, + 25, + 4, + 20, + 13, + 1, + 88, + 3, + 41, + 19, + 18, + 20, + 15, + 24, + 26, + 18, + 3, + 27, + 22, + 43, + 26, + 37, + 40, + 16, + 20, + 36, + 17, + 12, + 22, + 14, + 40, + 31, + 22, + 35, + 20, + 3, + 35 + ], + "weighted_loads": [ + 0.6950490195304155, + 1.840885715559125, + 0.8556778207421303, + 0.0, + 0.5788845550268888, + 0.564445985481143, + 1.072332751005888, + 2.728802375495434, + 2.363758994266391, + 0.19373755902051926, + 0.6636802330613136, + 1.3770135808736086, + 0.8164924904704094, + 0.35052656196057796, + 1.6619513407349586, + 2.0890661645680666, + 2.0862205512821674, + 0.06987965665757656, + 0.8845530599355698, + 1.8901652414351702, + 2.748018302023411, + 2.868846481665969, + 0.8625908307731152, + 0.7219309732317924, + 1.6667286343872547, + 3.968160832300782, + 1.1509779319167137, + 0.603003116324544, + 1.4220171868801117, + 0.14341605454683304, + 0.8174998313188553, + 0.6087629664689302, + 0.043148964643478394, + 5.738339310511947, + 0.11478313058614731, + 3.2821775507181883, + 0.8230369500815868, + 0.5922719780355692, + 1.6901613175868988, + 0.990519467741251, + 1.21680199354887, + 1.1007510051131248, + 0.6824425291270018, + 0.09702188149094582, + 1.6466336864978075, + 1.1349012106657028, + 1.7810130771249533, + 1.7586322408169508, + 1.243451425805688, + 3.3149464204907417, + 0.519756181165576, + 1.0191360525786877, + 2.497163550928235, + 0.5965296253561974, + 0.3985663950443268, + 1.1023313738405704, + 0.47812771797180176, + 2.561292424798012, + 4.299227714538574, + 1.4359974805265665, + 2.794201383367181, + 1.1104099191725254, + 0.1370886154472828, + 2.592047717422247 + ], + "unique_experts": 63, + "load_cv": 0.6038403358831672, + "normalized_load_entropy": 0.9557835793611045, + "max_load_share": 0.058902275769745646 + }, + "full_input": { + "tokens": 290, + "top_k": 6, + "decisions": 1740, + "ordered_route_sha256": "630699649e2f0fab5b4e885d27b28163fe3ef592184826f7b5fa4360403fedf3", + "route_weight_sha256": "36c93925c622a203ece8120bedbbc177d2a6c8e742aac71b74d350ecf0c9ed7f", + "loads": [ + 17, + 23, + 29, + 0, + 26, + 18, + 33, + 40, + 32, + 11, + 18, + 31, + 34, + 10, + 36, + 47, + 28, + 7, + 25, + 46, + 46, + 44, + 28, + 22, + 38, + 29, + 29, + 15, + 27, + 5, + 26, + 13, + 4, + 88, + 3, + 41, + 21, + 20, + 22, + 18, + 26, + 35, + 29, + 5, + 28, + 22, + 43, + 38, + 38, + 42, + 21, + 20, + 39, + 27, + 16, + 22, + 16, + 42, + 42, + 23, + 36, + 30, + 13, + 37 + ], + "weighted_loads": [ + 0.7478763218969107, + 2.138566656038165, + 0.9548622984439135, + 0.0, + 2.0861372854560614, + 0.6963733555749059, + 1.668681487441063, + 2.728802375495434, + 2.363758994266391, + 0.4284665808081627, + 0.7307975962758064, + 2.100160362198949, + 1.6918175518512726, + 0.35052656196057796, + 2.487583078444004, + 2.1984859574586153, + 2.4853745065629482, + 0.29681801423430443, + 0.9825600609183311, + 2.26166376657784, + 3.0802827551960945, + 2.9227762650698423, + 1.1717807110399008, + 0.899027562700212, + 2.479554696008563, + 3.968160832300782, + 1.1509779319167137, + 0.6940128412097692, + 1.5978397652506828, + 0.17954886332154274, + 1.0227229911834002, + 0.6087629664689302, + 0.1670355424284935, + 5.738339310511947, + 0.11478313058614731, + 3.2821775507181883, + 0.9048576839268208, + 0.6575678009539843, + 1.8845227845013142, + 1.127226673066616, + 1.2701097037643194, + 1.5881517976522446, + 1.5995171759277582, + 0.1721348986029625, + 1.6573191042989492, + 1.1349012106657028, + 1.7810130771249533, + 2.571870120242238, + 1.2770948391407728, + 3.4324662052094936, + 0.8563610780984163, + 1.0191360525786877, + 2.6416308246552944, + 1.388374648988247, + 1.16874760389328, + 1.1023313738405704, + 0.5613082200288773, + 2.648396138101816, + 4.8319648541510105, + 1.4707662742584944, + 2.834901822730899, + 1.5749678183346987, + 0.9633394479751587, + 2.7569442242383957 + ], + "unique_experts": 63, + "load_cv": 0.5158807134951026, + "normalized_load_entropy": 0.966426055251288, + "max_load_share": 0.05057471264367816 + } + }, + "s0_period": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "87a2f05221e7878e94d0a6338010780836a264f7482bf744632ca41659a4ff5a", + "route_weight_sha256": "eabbcdc76757bca8fe4abf78ffa6cbe4b98134c45afca3c36a1d492775b9b977", + "loads": [ + 18, + 15, + 27, + 1, + 14, + 17, + 19, + 40, + 31, + 3, + 14, + 23, + 21, + 12, + 25, + 46, + 25, + 2, + 23, + 41, + 42, + 43, + 19, + 18, + 30, + 30, + 34, + 15, + 22, + 3, + 27, + 12, + 0, + 88, + 3, + 40, + 18, + 17, + 21, + 14, + 23, + 28, + 16, + 4, + 27, + 21, + 47, + 25, + 31, + 40, + 17, + 23, + 33, + 16, + 12, + 25, + 9, + 40, + 31, + 23, + 32, + 21, + 3, + 34 + ], + "weighted_loads": [ + 0.8262209519743919, + 1.788287566974759, + 0.8957050573080778, + 0.024698762223124504, + 0.6023442968726158, + 0.6281435545533895, + 1.017901061102748, + 2.720442034304142, + 2.292659465223551, + 0.11139239184558392, + 0.5696119591593742, + 1.3750910721719265, + 0.8059805929660797, + 0.4089841488748789, + 1.780495721846819, + 2.0991445798426867, + 2.139318313449621, + 0.05165145359933376, + 0.8711554668843746, + 2.0032144524157047, + 2.7191807236522436, + 2.8744740672409534, + 0.825530668720603, + 0.7519566770642996, + 1.732605155557394, + 4.018024502322078, + 1.3158248830586672, + 0.656870050355792, + 1.3886815775185823, + 0.12365794368088245, + 1.0749723985791206, + 0.5924132000654936, + 0.0, + 5.707678057253361, + 0.12062955088913441, + 3.2214745078235865, + 0.7923051659017801, + 0.5569512844085693, + 1.744569342583418, + 0.9688145481050014, + 1.1465845368802547, + 1.129830477759242, + 0.6567990779876709, + 0.125188322737813, + 1.6007157508283854, + 1.099214842543006, + 1.909983841702342, + 1.792072918266058, + 1.0300326067954302, + 3.321498731151223, + 0.572044575586915, + 1.0623516347259283, + 2.4089976344257593, + 0.5762928016483784, + 0.39715148881077766, + 1.188593314960599, + 0.3424758482724428, + 2.5800574086606503, + 4.263762973248959, + 1.505950527265668, + 2.5902422722429037, + 1.1918497420847416, + 0.1209818385541439, + 2.5188281051814556 + ], + "unique_experts": 63, + "load_cv": 0.6114845247253977, + "normalized_load_entropy": 0.9542465595870044, + "max_load_share": 0.058902275769745646 + }, + "full_input": { + "tokens": 274, + "top_k": 6, + "decisions": 1644, + "ordered_route_sha256": "172cffdad9c4003cdf9aa1bccda6aefc97d9e306dbc998ca1d3b6c4f097dd50c", + "route_weight_sha256": "f9e26b296acfe7938c5b8a936f6d9750039f4f4d52e7404e3cdc15c21daf8236", + "loads": [ + 19, + 17, + 29, + 1, + 19, + 20, + 30, + 40, + 31, + 7, + 14, + 24, + 31, + 13, + 31, + 46, + 27, + 2, + 23, + 46, + 42, + 43, + 24, + 26, + 36, + 30, + 34, + 17, + 23, + 7, + 34, + 12, + 0, + 88, + 4, + 42, + 19, + 23, + 24, + 15, + 26, + 32, + 24, + 5, + 28, + 21, + 47, + 32, + 32, + 41, + 17, + 23, + 33, + 19, + 16, + 25, + 9, + 40, + 37, + 23, + 32, + 26, + 9, + 34 + ], + "weighted_loads": [ + 0.8658880144357681, + 1.9161164853721857, + 0.9519583024084568, + 0.024698762223124504, + 1.3949547745287418, + 0.7473642537370324, + 1.5226625557988882, + 2.720442034304142, + 2.292659465223551, + 0.3221772573888302, + 0.5696119591593742, + 1.4056288991123438, + 1.4735685251653194, + 0.4483576249331236, + 2.251229617744684, + 2.0991445798426867, + 2.2236886471509933, + 0.05165145359933376, + 0.8711554668843746, + 2.279176164418459, + 2.7191807236522436, + 2.8744740672409534, + 1.0058564450591803, + 1.0467506488785148, + 2.2695520240813494, + 4.018024502322078, + 1.3158248830586672, + 0.7532136607915163, + 1.5242496002465487, + 0.28589712269604206, + 1.3451093267649412, + 0.5924132000654936, + 0.0, + 5.707678057253361, + 0.17815419472754002, + 3.311269737780094, + 0.8476318288594484, + 0.7930478639900684, + 1.9967300482094288, + 0.9975680094212294, + 1.257039027288556, + 1.4126238282769918, + 1.2364042066037655, + 0.18269251100718975, + 1.611401168629527, + 1.099214842543006, + 1.909983841702342, + 2.2728406339883804, + 1.0672225710004568, + 3.364963421598077, + 0.572044575586915, + 1.0623516347259283, + 2.4089976344257593, + 0.8577051945030689, + 1.1533731520175934, + 1.188593314960599, + 0.3424758482724428, + 2.5800574086606503, + 4.561157172545791, + 1.505950527265668, + 2.5902422722429037, + 1.4927615076303482, + 0.6372040286660194, + 2.5188281051814556 + ], + "unique_experts": 63, + "load_cv": 0.5466119638036181, + "normalized_load_entropy": 0.9622998349719617, + "max_load_share": 0.0535279805352798 + } + }, + "s1_period": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "2daf2e6605cd7c48116f19839aa2ac7b3f4beb25099d46c8d16d296b2335a213", + "route_weight_sha256": "3c9de4b9f492bfd201367d7084b0b49492d5e28b77043d0f9f4bbcfc08b39efa", + "loads": [ + 17, + 18, + 21, + 1, + 14, + 18, + 21, + 40, + 31, + 3, + 17, + 21, + 20, + 10, + 24, + 45, + 25, + 2, + 24, + 41, + 42, + 42, + 20, + 17, + 28, + 30, + 31, + 12, + 24, + 4, + 19, + 12, + 1, + 87, + 3, + 41, + 19, + 14, + 19, + 15, + 25, + 27, + 19, + 3, + 29, + 21, + 46, + 26, + 36, + 40, + 16, + 22, + 36, + 23, + 12, + 21, + 15, + 39, + 33, + 20, + 33, + 21, + 3, + 35 + ], + "weighted_loads": [ + 0.7686085402965546, + 1.7746748086065054, + 0.710925942286849, + 0.025584161281585693, + 0.5770031716674566, + 0.6600529532879591, + 1.0694631338119507, + 2.717984603717923, + 2.3062681797891855, + 0.10597172193229198, + 0.6683652848005295, + 1.2662164513021708, + 0.8193618003278971, + 0.35443208552896976, + 1.6581454202532768, + 2.0743592772632837, + 2.1242746636271477, + 0.06712118349969387, + 0.9011324271559715, + 1.9980420488864183, + 2.744032807648182, + 2.8259090688079596, + 0.8583847843110561, + 0.7200058195739985, + 1.6500632390379906, + 4.024167165160179, + 1.223157785832882, + 0.5788047276437283, + 1.4137394987046719, + 0.14503840170800686, + 0.7816004548221827, + 0.5759654883295298, + 0.038042135536670685, + 5.750478271394968, + 0.11644864082336426, + 3.2755661252886057, + 0.8104773908853531, + 0.4792330842465162, + 1.660604678094387, + 0.9853228032588959, + 1.2580871805548668, + 1.1495767887681723, + 0.7257573343813419, + 0.09504733420908451, + 1.6893384475260973, + 1.1016303543001413, + 1.8849311787635088, + 1.7518069427460432, + 1.2142869513481855, + 3.3082540091127157, + 0.5195237565785646, + 1.073984183371067, + 2.506750488653779, + 0.7906486298888922, + 0.38403941318392754, + 1.088807214051485, + 0.5053423140197992, + 2.5390325002372265, + 4.364220101386309, + 1.3799936771392822, + 2.721697624772787, + 1.1394884772598743, + 0.16200806945562363, + 2.5740799475461245 + ], + "unique_experts": 64, + "load_cv": 0.6052632101809905, + "normalized_load_entropy": 0.9555321000415858, + "max_load_share": 0.05823293172690763 + }, + "full_input": { + "tokens": 290, + "top_k": 6, + "decisions": 1740, + "ordered_route_sha256": "ec8d6a013f601d227aa62d72b365fbd6a909bee5cdedbfd94055a39acb73bc3e", + "route_weight_sha256": "cbe69b112e78f3dc322845c0ce71e45ce51db559191d4326b08c4466ad6d2927", + "loads": [ + 19, + 23, + 24, + 1, + 26, + 21, + 32, + 40, + 31, + 8, + 18, + 28, + 33, + 10, + 37, + 47, + 28, + 7, + 25, + 49, + 46, + 43, + 27, + 22, + 36, + 30, + 31, + 14, + 26, + 5, + 25, + 12, + 3, + 87, + 4, + 42, + 21, + 15, + 21, + 18, + 28, + 36, + 29, + 5, + 30, + 21, + 46, + 39, + 37, + 42, + 21, + 22, + 39, + 34, + 16, + 21, + 17, + 41, + 43, + 21, + 35, + 32, + 13, + 37 + ], + "weighted_loads": [ + 0.822069875895977, + 2.058382885530591, + 0.8045092485845089, + 0.025584161281585693, + 2.1913302522152662, + 0.791590959765017, + 1.624483022838831, + 2.717984603717923, + 2.3062681797891855, + 0.34336445294320583, + 0.7354826480150223, + 1.989363232627511, + 1.6000598091632128, + 0.35443208552896976, + 2.52523560076952, + 2.1837790701538324, + 2.5234286189079285, + 0.29405954107642174, + 0.9991394281387329, + 2.4058341588824987, + 3.0762972608208656, + 2.879838852211833, + 1.1322340536862612, + 0.897102409042418, + 2.356145864352584, + 4.024167165160179, + 1.223157785832882, + 0.6692855209112167, + 1.5948539413511753, + 0.18117121048271656, + 0.9783742800354958, + 0.5759654883295298, + 0.12546858191490173, + 5.750478271394968, + 0.17731712386012077, + 3.3056281600147486, + 0.892298124730587, + 0.5086119938641787, + 1.8802597783505917, + 1.1311209984123707, + 1.3522937130182981, + 1.6457740347832441, + 1.4589863196015358, + 0.16559484042227268, + 1.700023865327239, + 1.1016303543001413, + 1.8849311787635088, + 2.658800745382905, + 1.2479303646832705, + 3.4270319137722254, + 0.856128653511405, + 1.073984183371067, + 2.6512177623808384, + 1.6401890497654676, + 1.1542206220328808, + 1.088807214051485, + 0.5885228160768747, + 2.626136213541031, + 4.8543945252895355, + 1.41476247087121, + 2.811238117516041, + 1.6396126095205545, + 0.9395421370863914, + 2.738976454362273 + ], + "unique_experts": 64, + "load_cv": 0.5212615164225197, + "normalized_load_entropy": 0.9659673073648712, + "max_load_share": 0.05 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 249, + "ordered_topk_exact_tokens": 161, + "set_exact_tokens": 197, + "mean_set_jaccard": 0.9386115892139988, + "mean_token_weighted_tv": 0.010814407799228367, + "aggregate_load_tv": 0.021419009370816602 + }, + "system_bos": { + "tokens": 249, + "ordered_topk_exact_tokens": 144, + "set_exact_tokens": 185, + "mean_set_jaccard": 0.9239816408491106, + "mean_token_weighted_tv": 0.013811437097045192, + "aggregate_load_tv": 0.020080321285140566 + }, + "system_x": { + "tokens": 249, + "ordered_topk_exact_tokens": 116, + "set_exact_tokens": 157, + "mean_set_jaccard": 0.884968445209409, + "mean_token_weighted_tv": 0.01967023695299185, + "aggregate_load_tv": 0.03279785809906292 + }, + "system_period": { + "tokens": 249, + "ordered_topk_exact_tokens": 120, + "set_exact_tokens": 155, + "mean_set_jaccard": 0.8843947217441194, + "mean_token_weighted_tv": 0.020144700532756656, + "aggregate_load_tv": 0.03413654618473896 + }, + "bos_at_s0": { + "tokens": 249, + "ordered_topk_exact_tokens": 129, + "set_exact_tokens": 169, + "mean_set_jaccard": 0.9039013195639701, + "mean_token_weighted_tv": 0.01681764749249062, + "aggregate_load_tv": 0.02811244979919679 + }, + "bos_at_s1": { + "tokens": 249, + "ordered_topk_exact_tokens": 125, + "set_exact_tokens": 164, + "mean_set_jaccard": 0.8964429145152036, + "mean_token_weighted_tv": 0.01806996830264069, + "aggregate_load_tv": 0.029451137884872837 + }, + "x_at_s0": { + "tokens": 249, + "ordered_topk_exact_tokens": 133, + "set_exact_tokens": 172, + "mean_set_jaccard": 0.9083954867087397, + "mean_token_weighted_tv": 0.016631319829034638, + "aggregate_load_tv": 0.02744310575635877 + }, + "x_at_s1": { + "tokens": 249, + "ordered_topk_exact_tokens": 106, + "set_exact_tokens": 141, + "mean_set_jaccard": 0.8652706062344616, + "mean_token_weighted_tv": 0.023049517237323236, + "aggregate_load_tv": 0.030789825970548863 + }, + "period_at_s0": { + "tokens": 249, + "ordered_topk_exact_tokens": 134, + "set_exact_tokens": 171, + "mean_set_jaccard": 0.9072480397781603, + "mean_token_weighted_tv": 0.017114014374129623, + "aggregate_load_tv": 0.02342704149933065 + }, + "period_at_s1": { + "tokens": 249, + "ordered_topk_exact_tokens": 105, + "set_exact_tokens": 139, + "mean_set_jaccard": 0.8636450564161408, + "mean_token_weighted_tv": 0.0232532735424019, + "aggregate_load_tv": 0.03346720214190094 + } + } + }, + "layer_20": { + "layer": 20, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "9e52c0be671ed50d1f4c0d42ec992bade3e182c8cf59c3fd021c9290e9046948", + "route_weight_sha256": "381c974d33d268ef793def8e85d6138f963ff9bc1bc1077719ad82f0c15a1dfc", + "loads": [ + 18, + 11, + 14, + 31, + 43, + 25, + 9, + 11, + 3, + 29, + 10, + 1, + 5, + 30, + 21, + 6, + 3, + 46, + 16, + 14, + 17, + 31, + 18, + 27, + 32, + 6, + 12, + 11, + 42, + 2, + 47, + 38, + 10, + 9, + 12, + 38, + 34, + 2, + 22, + 39, + 10, + 19, + 31, + 21, + 21, + 54, + 11, + 17, + 32, + 18, + 10, + 12, + 71, + 10, + 28, + 18, + 52, + 20, + 22, + 54, + 19, + 15, + 18, + 116 + ], + "weighted_loads": [ + 0.8201509527862072, + 0.46343767270445824, + 0.5053173545747995, + 1.8673576656728983, + 1.69152557477355, + 1.1164946481585503, + 0.5971441864967346, + 0.39038647897541523, + 0.11798892542719841, + 2.5378760788589716, + 0.5782257001847029, + 0.03467454016208649, + 0.3956504538655281, + 3.220556154847145, + 0.7680007610470057, + 0.21418281272053719, + 0.13907039538025856, + 3.175535337999463, + 0.639547947794199, + 0.5697144288569689, + 0.6426144912838936, + 1.6842417381703854, + 1.1218391545116901, + 1.420182291418314, + 2.1204559840261936, + 0.18679669313132763, + 0.4142944309860468, + 0.5260473564267159, + 3.533854428678751, + 0.05885534547269344, + 2.0307384971529245, + 1.312814174219966, + 0.35358764231204987, + 0.3073122613132, + 0.39367880672216415, + 1.9814610853791237, + 1.9549418147653341, + 0.06627914495766163, + 0.8935393746942282, + 1.4527280572801828, + 0.3282455448061228, + 1.0167230889201164, + 2.111577346920967, + 2.245917174965143, + 0.9554055575281382, + 3.636784717440605, + 0.5079113095998764, + 0.6275143679231405, + 1.1484924256801605, + 0.666834594681859, + 0.3256999533623457, + 0.6858179457485676, + 3.8367012310773134, + 0.3768177144229412, + 1.5673477593809366, + 0.6251112520694733, + 1.9142202846705914, + 1.0610659718513489, + 0.778495104983449, + 3.3833566196262836, + 1.6676928792148829, + 0.631259573623538, + 1.0482549220323563, + 7.368476461619139 + ], + "unique_experts": 64, + "load_cv": 0.8060002949114536, + "normalized_load_entropy": 0.9346739937248362, + "max_load_share": 0.07764390896921017 + }, + "full_input": { + "tokens": 274, + "top_k": 6, + "decisions": 1644, + "ordered_route_sha256": "606696f405c5a29e735ec5206fbb015e980507be5071321967553d6faf5e597c", + "route_weight_sha256": "b59fdabdf479c8fb9121a8c6bff9aafcd0cd38806ca32d288fea4c0273a5bad4", + "loads": [ + 18, + 14, + 14, + 39, + 51, + 29, + 13, + 17, + 4, + 29, + 10, + 2, + 7, + 30, + 21, + 10, + 5, + 46, + 26, + 14, + 21, + 31, + 25, + 27, + 33, + 13, + 14, + 11, + 42, + 5, + 47, + 38, + 10, + 10, + 13, + 38, + 37, + 3, + 24, + 40, + 11, + 21, + 33, + 25, + 31, + 54, + 11, + 18, + 34, + 19, + 18, + 12, + 71, + 16, + 28, + 21, + 52, + 26, + 23, + 54, + 32, + 19, + 18, + 116 + ], + "weighted_loads": [ + 0.8201509527862072, + 0.537286227568984, + 0.5053173545747995, + 2.467466911301017, + 2.0916957408189774, + 1.2737674340605736, + 0.7098310776054859, + 0.9689990058541298, + 0.14498579874634743, + 2.5378760788589716, + 0.5782257001847029, + 0.07295902818441391, + 0.4489163849502802, + 3.220556154847145, + 0.7680007610470057, + 0.41607391461730003, + 0.20160788670182228, + 3.175535337999463, + 1.5173970311880112, + 0.5697144288569689, + 0.7547152631450444, + 1.6842417381703854, + 1.5524267591536045, + 1.420182291418314, + 2.186239566653967, + 0.6805880460888147, + 0.4672460313886404, + 0.5260473564267159, + 3.533854428678751, + 0.15462684072554111, + 2.0307384971529245, + 1.312814174219966, + 0.35358764231204987, + 0.33041647262871265, + 0.43707991391420364, + 1.9814610853791237, + 2.1099747139960527, + 0.09675360284745693, + 2.2113922890275717, + 1.4904716294258833, + 0.38533872924745083, + 1.104500513523817, + 2.262703165411949, + 2.4396311377640814, + 1.2701002266258001, + 3.636784717440605, + 0.5079113095998764, + 0.6580805964767933, + 1.1852019706275314, + 0.7169471699744463, + 1.288809897378087, + 0.6858179457485676, + 3.8367012310773134, + 0.659659244120121, + 1.5673477593809366, + 1.0409833155572414, + 1.9142202846705914, + 1.2489538230001926, + 0.8158106524497271, + 3.3833566196262836, + 3.006097024655901, + 0.8870201725512743, + 1.0482549220323563, + 7.368476461619139 + ], + "unique_experts": 64, + "load_cv": 0.7152746723238587, + "normalized_load_entropy": 0.9475046436809593, + "max_load_share": 0.0705596107055961 + } + }, + "s1_eos": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "3568936398bd989bbe01f594b2523610e4a7d602ac24dabf91ccb8ef47afed90", + "route_weight_sha256": "e6066f171c674eada2fcb765881cae1525e45bfc9475faf35f624d6527bea088", + "loads": [ + 16, + 11, + 12, + 31, + 42, + 25, + 9, + 8, + 4, + 29, + 10, + 1, + 5, + 30, + 21, + 9, + 3, + 44, + 16, + 14, + 18, + 31, + 17, + 27, + 32, + 4, + 15, + 12, + 41, + 2, + 43, + 39, + 10, + 9, + 13, + 40, + 35, + 2, + 22, + 39, + 13, + 19, + 31, + 22, + 20, + 51, + 11, + 18, + 35, + 20, + 9, + 10, + 67, + 9, + 28, + 19, + 54, + 18, + 22, + 55, + 18, + 14, + 18, + 122 + ], + "weighted_loads": [ + 0.7646468225866556, + 0.4498409107327461, + 0.4561810549348593, + 1.8792572543025017, + 1.7513237707316875, + 1.0874061305075884, + 0.5978329591453075, + 0.2719620354473591, + 0.14816553331911564, + 2.5200511142611504, + 0.5718189869076014, + 0.029099905863404274, + 0.3707135487347841, + 3.163453735411167, + 0.757870452478528, + 0.3076923992484808, + 0.14787335693836212, + 3.094949584454298, + 0.6706491596996784, + 0.595869280397892, + 0.6730100344866514, + 1.679296962916851, + 1.0646558310836554, + 1.425951775163412, + 2.102205352857709, + 0.1327641811221838, + 0.517934687435627, + 0.5579371880739927, + 3.4760605562478304, + 0.05692862905561924, + 1.8729970268905163, + 1.3627076353877783, + 0.3534951936453581, + 0.3054155074059963, + 0.41542453318834305, + 2.0592527966946363, + 1.9726120214909315, + 0.06985713914036751, + 0.9043294880539179, + 1.4604991376399994, + 0.4153067898005247, + 1.0079757198691368, + 2.0982951391488314, + 2.31337776966393, + 0.9010824058204889, + 3.5306612495332956, + 0.5043145883828402, + 0.6478884872049093, + 1.2442877050489187, + 0.7271006889641285, + 0.2906725946813822, + 0.6344368774443865, + 3.6833202373236418, + 0.3572272900491953, + 1.5668875761330128, + 0.67923185788095, + 1.967295365408063, + 0.9948260802775621, + 0.7872683946043253, + 3.4125781133770943, + 1.6326158586889505, + 0.5997914280742407, + 1.0482684578746557, + 7.640342717990279 + ], + "unique_experts": 64, + "load_cv": 0.8175855966544803, + "normalized_load_entropy": 0.9340147469961344, + "max_load_share": 0.08165997322623829 + }, + "full_input": { + "tokens": 290, + "top_k": 6, + "decisions": 1740, + "ordered_route_sha256": "b1c806f74e6e40eeb85b897987b1c4aba9fc55ae9363659271c1240c0132b165", + "route_weight_sha256": "36e42420321ffb9895632323b58dead81439d8bb52ccc72e80a02cc8ca5e2c7b", + "loads": [ + 21, + 14, + 12, + 42, + 50, + 30, + 11, + 16, + 5, + 31, + 12, + 1, + 7, + 31, + 22, + 22, + 8, + 44, + 26, + 15, + 23, + 32, + 27, + 29, + 34, + 17, + 16, + 14, + 41, + 8, + 44, + 40, + 11, + 9, + 17, + 42, + 39, + 7, + 25, + 43, + 16, + 21, + 33, + 29, + 32, + 52, + 11, + 19, + 37, + 25, + 21, + 10, + 67, + 17, + 30, + 30, + 56, + 26, + 24, + 57, + 32, + 16, + 19, + 122 + ], + "weighted_loads": [ + 0.9951940681785345, + 0.5264641661196947, + 0.4561810549348593, + 2.6332943625748158, + 2.170979179441929, + 1.2921401280909777, + 0.6664556935429573, + 0.9416374564170837, + 0.17893439903855324, + 2.754868358373642, + 0.6614776477217674, + 0.029099905863404274, + 0.4349332619458437, + 3.4470253959298134, + 0.817408723756671, + 1.0838400851935148, + 0.44266973435878754, + 3.094949584454298, + 1.6770215444266796, + 0.6338319070637226, + 0.8171265262644738, + 1.7125533632934093, + 1.7119607087224722, + 1.5988407395780087, + 2.1989245992153883, + 0.9632192794233561, + 0.5354175791144371, + 0.6129947323352098, + 3.4760605562478304, + 0.24940318800508976, + 1.8995218761265278, + 1.3928380068391562, + 0.4034480880945921, + 0.3054155074059963, + 0.6052887178957462, + 2.2375013884156942, + 2.1978233624249697, + 0.25236674025654793, + 2.262275567278266, + 1.6572956815361977, + 0.5582393985241652, + 1.0947368554770947, + 2.2611640710383654, + 2.639435759279877, + 1.6810663137584925, + 3.603550212457776, + 0.5043145883828402, + 0.6777978427708149, + 1.2782482827315107, + 1.0352547876536846, + 1.7721577193588018, + 0.6344368774443865, + 3.6833202373236418, + 0.6779818758368492, + 1.6298769656568766, + 1.7612252850085497, + 2.0437570437788963, + 1.575995421037078, + 0.867674021050334, + 3.463758358731866, + 3.0480360196670517, + 0.7288965377956629, + 1.1067941132932901, + 7.640342717990279 + ], + "unique_experts": 64, + "load_cv": 0.6778725278090644, + "normalized_load_entropy": 0.9531150178069772, + "max_load_share": 0.07011494252873564 + } + }, + "s0_bos": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "f19c1e582f8612a6b3e3ff3f13b1c4b77ae5f3252fec60aa529a958ccbf08177", + "route_weight_sha256": "a566d12f810b8944caf19ff92a6b40a8c1b220c7ea357778be9a5b9a9ddab1e2", + "loads": [ + 17, + 11, + 16, + 34, + 39, + 25, + 10, + 9, + 3, + 30, + 9, + 1, + 6, + 30, + 24, + 8, + 3, + 46, + 18, + 13, + 19, + 30, + 18, + 27, + 32, + 6, + 11, + 12, + 40, + 3, + 48, + 41, + 10, + 9, + 11, + 38, + 33, + 2, + 25, + 39, + 13, + 20, + 31, + 22, + 18, + 52, + 12, + 16, + 32, + 20, + 7, + 10, + 71, + 9, + 28, + 15, + 47, + 19, + 22, + 54, + 18, + 16, + 18, + 118 + ], + "weighted_loads": [ + 0.7999381497502327, + 0.45789335668087006, + 0.5997813604772091, + 1.9748606123030186, + 1.5899537838995457, + 1.1092013344168663, + 0.6226916741579771, + 0.30677914060652256, + 0.11741203628480434, + 2.5622049514204264, + 0.5334989428520203, + 0.030677130445837975, + 0.353005263954401, + 3.267263989895582, + 0.8632749132812023, + 0.2751153018325567, + 0.14901353418827057, + 3.1716855503618717, + 0.7101480215787888, + 0.5563263297080994, + 0.708024812862277, + 1.6528205685317516, + 1.0968727804720402, + 1.4132246151566505, + 2.125506840646267, + 0.19535635225474834, + 0.36206139996647835, + 0.5547201372683048, + 3.514154026284814, + 0.08745844289660454, + 2.0118582006543875, + 1.4278770424425602, + 0.3495221883058548, + 0.32133407704532146, + 0.3604557868093252, + 1.9725422263145447, + 1.8919127639383078, + 0.06707595847547054, + 1.01126560382545, + 1.4543868117034435, + 0.4039457328617573, + 1.0719326380640268, + 2.1027328334748745, + 2.21935523673892, + 0.8643805626779795, + 3.589019848033786, + 0.5191616266965866, + 0.5789263434708118, + 1.1508995052427053, + 0.7200472168624401, + 0.23939506709575653, + 0.6174963489174843, + 3.8886116929352283, + 0.3573598824441433, + 1.5547100566327572, + 0.5297961942851543, + 1.7490535043179989, + 1.0215950701385736, + 0.7748227659612894, + 3.3753463346511126, + 1.6270916517823935, + 0.6552178952842951, + 1.032345136627555, + 7.502737740054727 + ], + "unique_experts": 64, + "load_cv": 0.8053596923002102, + "normalized_load_entropy": 0.9352834449681547, + "max_load_share": 0.07898259705488621 + }, + "full_input": { + "tokens": 274, + "top_k": 6, + "decisions": 1644, + "ordered_route_sha256": "db7e638281d4c4e8e8ee24a25cac992ec00ad06fdf3d3ce5a0d21d8bdc33ae85", + "route_weight_sha256": "914b8c16306994495f30bc5495e4872421aa182272797ee584b76e179d924f28", + "loads": [ + 17, + 12, + 16, + 42, + 47, + 29, + 14, + 15, + 3, + 30, + 9, + 2, + 8, + 31, + 24, + 14, + 5, + 46, + 28, + 13, + 23, + 30, + 26, + 27, + 33, + 13, + 14, + 12, + 40, + 6, + 49, + 42, + 10, + 10, + 12, + 38, + 36, + 3, + 26, + 39, + 14, + 23, + 34, + 26, + 28, + 52, + 13, + 17, + 33, + 20, + 15, + 10, + 71, + 14, + 29, + 18, + 47, + 25, + 22, + 54, + 30, + 19, + 18, + 118 + ], + "weighted_loads": [ + 0.7999381497502327, + 0.48204275593161583, + 0.5997813604772091, + 2.574969857931137, + 1.990123949944973, + 1.2816913276910782, + 0.7353785652667284, + 0.8399000614881516, + 0.11741203628480434, + 2.5622049514204264, + 0.5334989428520203, + 0.6967607643455267, + 0.4062711950391531, + 3.2978989854454994, + 0.8632749132812023, + 0.5983522217720747, + 0.2115510255098343, + 3.1716855503618717, + 1.587997104972601, + 0.5563263297080994, + 0.8521373756229877, + 1.6528205685317516, + 1.5784484036266804, + 1.4132246151566505, + 2.1932180672883987, + 0.6839855369180441, + 0.4637475535273552, + 0.5547201372683048, + 3.514154026284814, + 0.18366488628089428, + 2.050467675551772, + 1.4408164834603667, + 0.3495221883058548, + 0.3444382883608341, + 0.40092010237276554, + 1.9725422263145447, + 2.047309758141637, + 0.09755041636526585, + 1.374815372750163, + 1.4543868117034435, + 0.4473155364394188, + 1.1957518607378006, + 2.2851652316749096, + 2.479701690375805, + 1.1785520240664482, + 3.589019848033786, + 0.6584030389785767, + 0.5919496826827526, + 1.1859710309654474, + 0.7200472168624401, + 1.2327890247106552, + 0.6174963489174843, + 3.8886116929352283, + 0.6460393369197845, + 1.585973296314478, + 0.9541507139801979, + 1.7490535043179989, + 1.2105313520878553, + 0.7748227659612894, + 3.3753463346511126, + 2.9769647922366858, + 0.8591261301189661, + 1.032345136627555, + 7.502737740054727 + ], + "unique_experts": 64, + "load_cv": 0.7145791132693647, + "normalized_load_entropy": 0.9479379118935892, + "max_load_share": 0.07177615571776155 + } + }, + "s1_bos": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "c074f83639225f4ac4a495d7c160ca76b01fb621bb8580d9f1df7ec7848bc237", + "route_weight_sha256": "f7c2fab672fffeec33dd74cc07d10711f6cf153ddb2a921ba3dc9ff99f7ce706", + "loads": [ + 18, + 12, + 14, + 33, + 41, + 26, + 9, + 7, + 2, + 30, + 9, + 1, + 5, + 29, + 23, + 6, + 4, + 48, + 16, + 11, + 17, + 31, + 15, + 27, + 32, + 7, + 12, + 11, + 41, + 2, + 52, + 39, + 11, + 9, + 11, + 40, + 34, + 2, + 24, + 36, + 15, + 20, + 31, + 21, + 16, + 53, + 12, + 17, + 31, + 18, + 6, + 9, + 66, + 9, + 29, + 21, + 54, + 18, + 22, + 55, + 20, + 16, + 18, + 120 + ], + "weighted_loads": [ + 0.846378019079566, + 0.4852222017943859, + 0.5477396193891764, + 1.9583108946681023, + 1.6971700061112642, + 1.1285919938236475, + 0.5809518154710531, + 0.2562788166105747, + 0.09487519413232803, + 2.530290910974145, + 0.5391275212168694, + 0.03422641009092331, + 0.33093672059476376, + 3.1609019562602043, + 0.8056791294366121, + 0.21394478529691696, + 0.19317500665783882, + 3.235190073028207, + 0.6165196355432272, + 0.5034026242792606, + 0.6583492122590542, + 1.681844474747777, + 0.9799052588641644, + 1.4166311360895634, + 2.107895325869322, + 0.2288255114108324, + 0.3755714911967516, + 0.5399759579449892, + 3.5292539801448584, + 0.05249367840588093, + 2.1714227329939604, + 1.3841378297656775, + 0.3730747811496258, + 0.321092177182436, + 0.36508528888225555, + 2.017841726541519, + 1.9240366965532303, + 0.06353350728750229, + 0.979969684034586, + 1.3741462416946888, + 0.4788264464586973, + 1.0700724236667156, + 2.098420660942793, + 2.2195849902927876, + 0.7597949877381325, + 3.605601731687784, + 0.5152218975126743, + 0.6224280372262001, + 1.116349870339036, + 0.665595930069685, + 0.1985185109078884, + 0.5845796037465334, + 3.751491006463766, + 0.3654328677803278, + 1.581371083855629, + 0.7291591539978981, + 1.9910699669271708, + 0.9828789681196213, + 0.7731313519179821, + 3.436862740665674, + 1.6316743344068527, + 0.6592049859464169, + 1.0323754902929068, + 7.674410888925195 + ], + "unique_experts": 64, + "load_cv": 0.8236653091757918, + "normalized_load_entropy": 0.9319835575709622, + "max_load_share": 0.08032128514056225 + }, + "full_input": { + "tokens": 290, + "top_k": 6, + "decisions": 1740, + "ordered_route_sha256": "ef45c7160db9317d4f1986a011c119544a2e90d741f58316c29e16c022ca6f72", + "route_weight_sha256": "3ab3dde932fa6cf3bc493da066651ec42e2cef835bfce38c711616cbacca7be8", + "loads": [ + 22, + 14, + 14, + 44, + 49, + 32, + 11, + 15, + 2, + 32, + 11, + 1, + 7, + 30, + 24, + 21, + 9, + 48, + 26, + 12, + 22, + 32, + 26, + 29, + 34, + 20, + 15, + 13, + 41, + 7, + 53, + 40, + 12, + 9, + 14, + 42, + 38, + 8, + 26, + 41, + 18, + 23, + 33, + 28, + 28, + 54, + 12, + 18, + 31, + 23, + 18, + 9, + 66, + 19, + 30, + 32, + 55, + 26, + 23, + 57, + 33, + 18, + 19, + 121 + ], + "weighted_loads": [ + 1.04132111184299, + 0.5441956259310246, + 0.5477396193891764, + 2.7123480029404163, + 2.1168254148215055, + 1.3950956631451845, + 0.6495745498687029, + 0.9368354007601738, + 0.09487519413232803, + 2.7651081550866365, + 0.6287861820310354, + 0.03422641009092331, + 0.3951564338058233, + 3.4444736167788506, + 0.8652174007147551, + 1.096845619380474, + 0.48797138407826424, + 3.235190073028207, + 1.6228920202702284, + 0.5413652509450912, + 0.8430411461740732, + 1.7151008751243353, + 1.6549597382545471, + 1.58952010050416, + 2.2034750431776047, + 1.064147325232625, + 0.4789461921900511, + 0.5950335022062063, + 3.5292539801448584, + 0.19956479035317898, + 2.1978177037090063, + 1.4142682012170553, + 0.4230276755988598, + 0.321092177182436, + 0.4842473715543747, + 2.196090318262577, + 2.1332352869212627, + 0.2878074198961258, + 1.3871728628873825, + 1.626556720584631, + 0.619690490886569, + 1.2206725105643272, + 2.260339606553316, + 2.605287067592144, + 1.539778895676136, + 3.6784906946122646, + 0.5152218975126743, + 0.6551941856741905, + 1.116349870339036, + 0.993481982499361, + 1.7532640397548676, + 0.5845796037465334, + 3.751491006463766, + 0.7952619381248951, + 1.6115100551396608, + 1.8471348024904728, + 2.038864703848958, + 1.5736930444836617, + 0.8114185743033886, + 3.488042986020446, + 3.049928667023778, + 0.7888117507100105, + 1.0909011457115412, + 7.703880786895752 + ], + "unique_experts": 64, + "load_cv": 0.6832770198077286, + "normalized_load_entropy": 0.9516891040081752, + "max_load_share": 0.06954022988505747 + } + }, + "s0_x": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "65bc5743130f63c614b97ebfaec5b70cdebfa0782d4796f743097150b716765b", + "route_weight_sha256": "3cf837ea9aea8958c72b09a3365c6c24e48710275f406ceae4005d52e7eb3d9c", + "loads": [ + 17, + 11, + 15, + 32, + 41, + 26, + 9, + 12, + 3, + 29, + 11, + 0, + 5, + 30, + 23, + 6, + 3, + 46, + 19, + 11, + 18, + 30, + 17, + 26, + 31, + 6, + 12, + 12, + 41, + 2, + 47, + 39, + 11, + 9, + 12, + 39, + 34, + 3, + 24, + 39, + 14, + 19, + 31, + 21, + 21, + 53, + 12, + 17, + 34, + 18, + 7, + 11, + 67, + 8, + 28, + 16, + 55, + 20, + 20, + 53, + 18, + 15, + 18, + 117 + ], + "weighted_loads": [ + 0.790568683296442, + 0.4497219994664192, + 0.567196087911725, + 1.8949823528528214, + 1.6479216907173395, + 1.1166012436151505, + 0.5798101611435413, + 0.4140688627958298, + 0.1185456421226263, + 2.5573863349854946, + 0.5861522443592548, + 0.0, + 0.35116492211818695, + 3.2244804967194796, + 0.8325900826603174, + 0.21075135096907616, + 0.15033167228102684, + 3.1649676505476236, + 0.7490321267396212, + 0.5060733500868082, + 0.6898966692388058, + 1.6573510617017746, + 1.078246109187603, + 1.3806543126702309, + 2.11232778057456, + 0.19357480108737946, + 0.40244282968342304, + 0.5619158130139112, + 3.5725789442658424, + 0.051619673147797585, + 2.035329271107912, + 1.3439395669847727, + 0.38082605227828026, + 0.30703981034457684, + 0.3908940702676773, + 2.005554700270295, + 1.934040755033493, + 0.1005549319088459, + 0.978286862373352, + 1.4374670777469873, + 0.43975421227514744, + 1.0227808840572834, + 2.102479912340641, + 2.222841737791896, + 0.9559606891125441, + 3.614340068772435, + 0.5204859189689159, + 0.614060128107667, + 1.1871427223086357, + 0.6427177898585796, + 0.24495652318000793, + 0.6592948697507381, + 3.7368203047662973, + 0.32862420193850994, + 1.5292531419545412, + 0.5708800051361322, + 2.00696537271142, + 1.0879373531788588, + 0.710180377587676, + 3.376245690509677, + 1.5769757330417633, + 0.6127322800457478, + 1.0251648612320423, + 7.501151939854026 + ], + "unique_experts": 63, + "load_cv": 0.8037916254779842, + "normalized_load_entropy": 0.9345668881767972, + "max_load_share": 0.0783132530120482 + }, + "full_input": { + "tokens": 274, + "top_k": 6, + "decisions": 1644, + "ordered_route_sha256": "0f90a55e192c2ba9a34a538bddc5202bb41b110cd5e2361a186fcfc013cd73cc", + "route_weight_sha256": "f547d09c0c7fd4ff319e286fbe306ee8d95c71d7f8857f4c4881794b9feb15af", + "loads": [ + 17, + 13, + 15, + 40, + 50, + 29, + 14, + 18, + 4, + 29, + 11, + 0, + 7, + 31, + 23, + 10, + 5, + 46, + 30, + 11, + 21, + 30, + 24, + 26, + 32, + 14, + 13, + 12, + 41, + 7, + 47, + 39, + 11, + 10, + 13, + 39, + 38, + 4, + 25, + 40, + 15, + 21, + 33, + 24, + 32, + 53, + 12, + 17, + 35, + 19, + 15, + 11, + 67, + 13, + 29, + 20, + 55, + 27, + 20, + 53, + 31, + 18, + 18, + 117 + ], + "weighted_loads": [ + 0.790568683296442, + 0.514371819794178, + 0.567196087911725, + 2.49509159848094, + 2.1690260078758, + 1.2253236025571823, + 0.7284198887646198, + 0.8421129193156958, + 0.14576843939721584, + 2.5573863349854946, + 0.5861522443592548, + 0.0, + 0.40443085320293903, + 3.252376241609454, + 0.8325900826603174, + 0.4143017493188381, + 0.21286916360259056, + 3.1649676505476236, + 1.7281818967312574, + 0.5060733500868082, + 0.7988491598516703, + 1.6573510617017746, + 1.494853287935257, + 1.3806543126702309, + 2.1890457905828953, + 0.7224131971597672, + 0.41992572136223316, + 0.5619158130139112, + 3.5725789442658424, + 0.21416215598583221, + 2.035329271107912, + 1.3439395669847727, + 0.38082605227828026, + 0.3301440216600895, + 0.42875976860523224, + 2.005554700270295, + 2.1511499620974064, + 0.1310293897986412, + 1.3418366312980652, + 1.4720436166971922, + 0.47451922483742237, + 1.1123480126261711, + 2.255314752459526, + 2.407130552455783, + 1.3201026301831007, + 3.614340068772435, + 0.5204859189689159, + 0.614060128107667, + 1.2222142480313778, + 0.6809052973985672, + 1.2052886299788952, + 0.6592948697507381, + 3.7368203047662973, + 0.5737634915858507, + 1.560144865885377, + 1.0447122436016798, + 2.00696537271142, + 1.3317399825900793, + 0.710180377587676, + 3.376245690509677, + 3.11764108389616, + 0.8224570713937283, + 1.0251648612320423, + 7.501151939854026 + ], + "unique_experts": 63, + "load_cv": 0.7145791132693647, + "normalized_load_entropy": 0.9472153856222606, + "max_load_share": 0.07116788321167883 + } + }, + "s1_x": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "cac7eb1da9806c195ac81780c8d53344e25a6ab9bb1599950daa458d671b1750", + "route_weight_sha256": "11c3c3d63e2742978aafa11626760a39515a50aab9f265f26b9fd63075b9326f", + "loads": [ + 17, + 10, + 13, + 30, + 51, + 27, + 9, + 5, + 3, + 29, + 11, + 0, + 5, + 27, + 23, + 5, + 4, + 48, + 17, + 14, + 18, + 31, + 16, + 27, + 33, + 7, + 9, + 15, + 41, + 2, + 52, + 41, + 12, + 10, + 11, + 38, + 36, + 5, + 24, + 36, + 15, + 18, + 31, + 21, + 19, + 55, + 11, + 16, + 32, + 19, + 7, + 9, + 62, + 9, + 29, + 22, + 50, + 20, + 16, + 55, + 18, + 13, + 17, + 118 + ], + "weighted_loads": [ + 0.7967261467128992, + 0.4173990786075592, + 0.5058002229779959, + 1.819497587159276, + 2.245127459987998, + 1.149044219404459, + 0.5769389979541302, + 0.1949741430580616, + 0.12133437395095825, + 2.5338366869837046, + 0.5975354537367821, + 0.0, + 0.3253149315714836, + 3.088976200670004, + 0.791610661894083, + 0.17323147878050804, + 0.19334293901920319, + 3.2213901299983263, + 0.6774099543690681, + 0.5887221656739712, + 0.6726340129971504, + 1.6647394727915525, + 0.9770077932626009, + 1.4073908627033234, + 2.1451397109776735, + 0.23050708882510662, + 0.3128143660724163, + 0.7009337116032839, + 3.547539569437504, + 0.0532523337751627, + 2.158251043409109, + 1.447891330346465, + 0.41388608515262604, + 0.3489206340163946, + 0.3700056355446577, + 1.9802040103822947, + 1.9971483144909143, + 0.15895037166774273, + 0.9546205177903175, + 1.363381253555417, + 0.47116405330598354, + 1.0051976013928652, + 2.0917749032378197, + 2.207553857937455, + 0.9336783811450005, + 3.6319128926843405, + 0.4860257189720869, + 0.5953346975147724, + 1.1200883463025093, + 0.7038851678371429, + 0.2403052318841219, + 0.5879070796072483, + 3.571769656613469, + 0.36121303774416447, + 1.5516901332885027, + 0.7701127324253321, + 1.8348991498351097, + 1.0785592291504145, + 0.5919680520892143, + 3.426762716844678, + 1.5886038541793823, + 0.5466020721942186, + 0.9751920234411955, + 7.494296733289957 + ], + "unique_experts": 63, + "load_cv": 0.816567910368185, + "normalized_load_entropy": 0.9325450851484095, + "max_load_share": 0.07898259705488621 + }, + "full_input": { + "tokens": 290, + "top_k": 6, + "decisions": 1740, + "ordered_route_sha256": "12c3b0cb23210acc1e5f481c1dec84e2a6a7ec3ad1813793b006016d724b4ff4", + "route_weight_sha256": "54e46829b4fcb19b966c7141c7a906ce280754ade7248c2dafa3c4b8e7bef852", + "loads": [ + 21, + 11, + 13, + 42, + 61, + 34, + 12, + 13, + 3, + 31, + 13, + 0, + 7, + 28, + 24, + 19, + 11, + 48, + 28, + 15, + 22, + 33, + 26, + 29, + 35, + 21, + 10, + 18, + 41, + 7, + 52, + 42, + 13, + 10, + 13, + 40, + 40, + 11, + 26, + 40, + 17, + 19, + 33, + 26, + 34, + 56, + 11, + 16, + 32, + 23, + 19, + 9, + 62, + 18, + 31, + 33, + 53, + 28, + 17, + 57, + 32, + 15, + 18, + 118 + ], + "weighted_loads": [ + 0.9916692394763231, + 0.441548477858305, + 0.5058002229779959, + 2.6049820873886347, + 2.810592709109187, + 1.437465500086546, + 0.683876283466816, + 0.7168366797268391, + 0.12133437395095825, + 2.768653931096196, + 0.6871941145509481, + 0.0, + 0.3895346447825432, + 3.37254786118865, + 0.851148933172226, + 0.9797284081578255, + 0.6547016575932503, + 3.2213901299983263, + 1.7976040095090866, + 0.6266847923398018, + 0.8138723913580179, + 1.7310758139938116, + 1.5888099577277899, + 1.58027982711792, + 2.2487388234585524, + 1.0883604679256678, + 0.3302972577512264, + 0.7959349062293768, + 3.547539569437504, + 0.20112349279224873, + 2.158251043409109, + 1.478021701797843, + 0.46383897960186005, + 0.3489206340163946, + 0.4415422733873129, + 2.1584526021033525, + 2.2278898563236, + 0.38416177593171597, + 1.361823696643114, + 1.5601777974516153, + 0.574370888993144, + 1.0588929671794176, + 2.26781515032053, + 2.5022131260484457, + 1.822273675352335, + 3.704801855608821, + 0.4860257189720869, + 0.5953346975147724, + 1.1200883463025093, + 0.9408060908317566, + 1.7148639094084501, + 0.5879070796072483, + 3.571769656613469, + 0.7124816495925188, + 1.62223419547081, + 1.9099191036075354, + 1.940088490024209, + 1.66972897015512, + 0.6302552744746208, + 3.4779429621994495, + 3.1178611386567354, + 0.6839452963322401, + 1.03371767885983, + 7.494296733289957 + ], + "unique_experts": 63, + "load_cv": 0.6828747143839682, + "normalized_load_entropy": 0.9510030935456092, + "max_load_share": 0.067816091954023 + } + }, + "s0_period": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "b4a9af14b77e97afb20183275403a2b33c8d591ad420f4c20fc8bc485c38cf55", + "route_weight_sha256": "dddf3c6cf328622e776bcf0d097229cb437e0d0445c1353861232658a75e82fa", + "loads": [ + 17, + 11, + 16, + 33, + 42, + 28, + 9, + 9, + 3, + 29, + 9, + 0, + 4, + 30, + 24, + 6, + 3, + 47, + 20, + 12, + 18, + 30, + 18, + 26, + 33, + 7, + 9, + 12, + 41, + 2, + 45, + 40, + 10, + 10, + 11, + 41, + 33, + 3, + 22, + 38, + 14, + 19, + 31, + 22, + 21, + 52, + 12, + 18, + 33, + 17, + 7, + 10, + 67, + 9, + 28, + 16, + 52, + 23, + 22, + 53, + 18, + 14, + 18, + 117 + ], + "weighted_loads": [ + 0.7867898885160685, + 0.4603597428649664, + 0.5972565580159426, + 1.9139080438762903, + 1.6819978095591068, + 1.2058451380580664, + 0.5887574069201946, + 0.3226366862654686, + 0.11900225467979908, + 2.5590173192322254, + 0.5209074225276709, + 0.0, + 0.3068007789552212, + 3.2026782166212797, + 0.8607692625373602, + 0.21295306831598282, + 0.14940984919667244, + 3.1917690504342318, + 0.7866668850183487, + 0.5375614408403635, + 0.674730658531189, + 1.6586201917380095, + 1.097363106906414, + 1.3758521974086761, + 2.177840355783701, + 0.22286615520715714, + 0.30757330916821957, + 0.5768489129841328, + 3.56491931155324, + 0.05313843674957752, + 1.9854228757321835, + 1.389209058135748, + 0.35526701621711254, + 0.3383188359439373, + 0.35621072351932526, + 2.0585966669023037, + 1.9105687979608774, + 0.10075631365180016, + 0.9113911706954241, + 1.4401644598692656, + 0.4338316470384598, + 1.0268611069768667, + 2.091944057494402, + 2.263532957062125, + 0.9737327639013529, + 3.5652324203401804, + 0.5153497010469437, + 0.6431815978139639, + 1.1801461819559336, + 0.6239846181124449, + 0.24241827242076397, + 0.6145367361605167, + 3.757565423846245, + 0.360559681430459, + 1.5332021247595549, + 0.582318352535367, + 1.9211645368486643, + 1.1863847151398659, + 0.7815172392874956, + 3.38878027535975, + 1.591212633997202, + 0.586406446993351, + 1.0225885268300772, + 7.450487153604627 + ], + "unique_experts": 63, + "load_cv": 0.8040412952116723, + "normalized_load_entropy": 0.9339386501435247, + "max_load_share": 0.0783132530120482 + }, + "full_input": { + "tokens": 274, + "top_k": 6, + "decisions": 1644, + "ordered_route_sha256": "938d7fcb95120211b17b54ce0864e3db42331a8598d70dcc1570eecdfb185032", + "route_weight_sha256": "b1774e1a74656e21615e7b01e253112ab3ec8f048120c4d5b146eb13b49132c4", + "loads": [ + 17, + 13, + 16, + 41, + 51, + 32, + 14, + 16, + 4, + 29, + 9, + 0, + 6, + 30, + 24, + 10, + 5, + 47, + 30, + 12, + 22, + 30, + 25, + 26, + 34, + 15, + 10, + 12, + 41, + 6, + 45, + 40, + 10, + 11, + 12, + 41, + 36, + 4, + 23, + 40, + 15, + 21, + 33, + 25, + 33, + 52, + 12, + 18, + 34, + 18, + 16, + 10, + 67, + 14, + 29, + 19, + 52, + 29, + 22, + 53, + 30, + 18, + 18, + 117 + ], + "weighted_loads": [ + 0.7867898885160685, + 0.531246105208993, + 0.5972565580159426, + 2.514017289504409, + 2.122816100716591, + 1.3499377463012934, + 0.7498244345188141, + 1.0161139611154795, + 0.14798178523778915, + 2.5590173192322254, + 0.5209074225276709, + 0.0, + 0.36006671003997326, + 3.2026782166212797, + 0.8607692625373602, + 0.41497594118118286, + 0.21194734051823616, + 3.1917690504342318, + 1.6645159684121609, + 0.5375614408403635, + 0.8361073937267065, + 1.6586201917380095, + 1.5123353078961372, + 1.3758521974086761, + 2.252139989286661, + 0.8072924315929413, + 0.3250562008470297, + 0.5768489129841328, + 3.56491931155324, + 0.18630020692944527, + 1.9854228757321835, + 1.389209058135748, + 0.35526701621711254, + 0.36142304725944996, + 0.3929919973015785, + 2.0585966669023037, + 2.08135830424726, + 0.13123077154159546, + 1.2749409396201372, + 1.5267392713576555, + 0.4958830960094929, + 1.1149859484285116, + 2.246031705290079, + 2.4435460921376944, + 1.3831804227083921, + 3.5652324203401804, + 0.5153497010469437, + 0.6431815978139639, + 1.2152177076786757, + 0.6888776253908873, + 1.2396904584020376, + 0.6145367361605167, + 3.757565423846245, + 0.5999994110316038, + 1.55964045971632, + 1.0057879816740751, + 1.9211645368486643, + 1.3652239441871643, + 0.7815172392874956, + 3.38878027535975, + 2.9314843751490116, + 0.8376844972372055, + 1.0225885268300772, + 7.450487153604627 + ], + "unique_experts": 63, + "load_cv": 0.7159695556482658, + "normalized_load_entropy": 0.9464728358796048, + "max_load_share": 0.07116788321167883 + } + }, + "s1_period": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "d64e0c413e66fc83821320df89d1d327999a0b51725cea0f871c83927426b733", + "route_weight_sha256": "50ac0c418879132990f0c1a2d5d560ecab411191ab70c0a69190aff9ba8fee53", + "loads": [ + 17, + 11, + 14, + 29, + 52, + 30, + 7, + 6, + 3, + 29, + 11, + 0, + 5, + 30, + 21, + 4, + 4, + 51, + 18, + 12, + 17, + 31, + 15, + 27, + 33, + 9, + 10, + 15, + 41, + 3, + 51, + 40, + 11, + 10, + 12, + 38, + 33, + 5, + 24, + 35, + 14, + 21, + 32, + 19, + 19, + 53, + 12, + 16, + 29, + 20, + 5, + 10, + 66, + 9, + 27, + 21, + 51, + 20, + 15, + 55, + 17, + 12, + 17, + 120 + ], + "weighted_loads": [ + 0.8035821281373501, + 0.4384823255240917, + 0.5365256927907467, + 1.7757287435233593, + 2.2824716847389936, + 1.2676673829555511, + 0.5200863946229219, + 0.22414708510041237, + 0.12333645671606064, + 2.534722838550806, + 0.5809542220085859, + 0.0, + 0.32675261050462723, + 3.1929452400654554, + 0.7267830930650234, + 0.1450694166123867, + 0.18540656752884388, + 3.3247063644230366, + 0.7429370284080505, + 0.5230879932641983, + 0.642735430970788, + 1.6661713253706694, + 0.9442097786813974, + 1.3999824225902557, + 2.139983020722866, + 0.2864669281989336, + 0.3553756345063448, + 0.678618373349309, + 3.5363226514309645, + 0.08759579062461853, + 2.094918966293335, + 1.4047921672463417, + 0.3784914184361696, + 0.3428662493824959, + 0.3976423256099224, + 1.9685128703713417, + 1.9019116535782814, + 0.16819906048476696, + 0.9641310628503561, + 1.3356625586748123, + 0.4497964736074209, + 1.095946405082941, + 2.1047756504267454, + 2.1936975345015526, + 0.9200659673660994, + 3.5400950647890568, + 0.5202000048011541, + 0.5949127078056335, + 1.0306866504251957, + 0.7287812642753124, + 0.1713229212909937, + 0.625607879832387, + 3.679184978827834, + 0.3568902537226677, + 1.4895623940974474, + 0.746332410722971, + 1.8683406002819538, + 1.0869395099580288, + 0.5521240476518869, + 3.4496838375926018, + 1.5797242876142263, + 0.5286729149520397, + 0.9913264326751232, + 7.592184133827686 + ], + "unique_experts": 63, + "load_cv": 0.8286976647780808, + "normalized_load_entropy": 0.9314831837572075, + "max_load_share": 0.08032128514056225 + }, + "full_input": { + "tokens": 290, + "top_k": 6, + "decisions": 1740, + "ordered_route_sha256": "c202b1eb81fb6484444e0ec6f3c89faa1d98b90a50b3a7e23cc8d64fbc68eb70", + "route_weight_sha256": "2f0186bda984aacdab8fff0a46e49c9577ad00d412d3b1416bca807c89f7a43c", + "loads": [ + 22, + 12, + 14, + 40, + 60, + 36, + 10, + 16, + 4, + 31, + 13, + 0, + 9, + 31, + 22, + 17, + 10, + 51, + 28, + 13, + 22, + 32, + 25, + 29, + 35, + 23, + 11, + 17, + 41, + 8, + 51, + 41, + 12, + 10, + 14, + 40, + 37, + 12, + 26, + 41, + 17, + 22, + 34, + 24, + 33, + 54, + 12, + 16, + 29, + 25, + 17, + 10, + 66, + 17, + 29, + 33, + 52, + 27, + 16, + 57, + 31, + 15, + 18, + 120 + ], + "weighted_loads": [ + 1.0280193611979485, + 0.4626317247748375, + 0.5365256927907467, + 2.5297658517956734, + 2.702127093449235, + 1.503916509449482, + 0.6310828793793917, + 0.859638286754489, + 0.15210765041410923, + 2.7695400826632977, + 0.670612882822752, + 0.0, + 0.4661938324570656, + 3.4765169005841017, + 0.7863213643431664, + 0.9165457598865032, + 0.5092271640896797, + 3.3247063644230366, + 1.7493094131350517, + 0.5610506199300289, + 0.8328209407627583, + 1.6994277257472277, + 1.5599954258650541, + 1.5728713870048523, + 2.272399690002203, + 1.1606197971850634, + 0.3728585261851549, + 0.7336759176105261, + 3.5363226514309645, + 0.2298663891851902, + 2.094918966293335, + 1.4349225386977196, + 0.42844431288540363, + 0.3428662493824959, + 0.4691789634525776, + 2.1467614620923996, + 2.1099046282470226, + 0.42869282327592373, + 1.3713342417031527, + 1.606760310009122, + 0.5911241266876459, + 1.1496417708694935, + 2.274448012933135, + 2.4866954050958157, + 1.771056242287159, + 3.612984027713537, + 0.5202000048011541, + 0.5949127078056335, + 1.0306866504251957, + 1.056399580091238, + 1.640205206349492, + 0.625607879832387, + 3.679184978827834, + 0.6771168131381273, + 1.5711478888988495, + 1.8598032854497433, + 1.916135337203741, + 1.6284264959394932, + 0.5904112700372934, + 3.5008640829473734, + 3.0463413558900356, + 0.7178010642528534, + 1.0498520880937576, + 7.592184133827686 + ], + "unique_experts": 63, + "load_cv": 0.6857783756043626, + "normalized_load_entropy": 0.9515985247896119, + "max_load_share": 0.06896551724137931 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 249, + "ordered_topk_exact_tokens": 140, + "set_exact_tokens": 178, + "mean_set_jaccard": 0.9142283419391853, + "mean_token_weighted_tv": 0.013528490513862377, + "aggregate_load_tv": 0.022757697456492643 + }, + "system_bos": { + "tokens": 249, + "ordered_topk_exact_tokens": 137, + "set_exact_tokens": 172, + "mean_set_jaccard": 0.9099254159495123, + "mean_token_weighted_tv": 0.015255873749803108, + "aggregate_load_tv": 0.028781793842034803 + }, + "system_x": { + "tokens": 249, + "ordered_topk_exact_tokens": 110, + "set_exact_tokens": 141, + "mean_set_jaccard": 0.8669917766303309, + "mean_token_weighted_tv": 0.021809457142998177, + "aggregate_load_tv": 0.03547523427041499 + }, + "system_period": { + "tokens": 249, + "ordered_topk_exact_tokens": 94, + "set_exact_tokens": 130, + "mean_set_jaccard": 0.8509275196022184, + "mean_token_weighted_tv": 0.024211672157138944, + "aggregate_load_tv": 0.038821954484605084 + }, + "bos_at_s0": { + "tokens": 249, + "ordered_topk_exact_tokens": 127, + "set_exact_tokens": 160, + "mean_set_jaccard": 0.8884107860011475, + "mean_token_weighted_tv": 0.01844795843788299, + "aggregate_load_tv": 0.02476572958500669 + }, + "bos_at_s1": { + "tokens": 249, + "ordered_topk_exact_tokens": 116, + "set_exact_tokens": 155, + "mean_set_jaccard": 0.8843947217441193, + "mean_token_weighted_tv": 0.01929019753593039, + "aggregate_load_tv": 0.029451137884872827 + }, + "x_at_s0": { + "tokens": 249, + "ordered_topk_exact_tokens": 117, + "set_exact_tokens": 157, + "mean_set_jaccard": 0.8886020271562439, + "mean_token_weighted_tv": 0.018384265189758504, + "aggregate_load_tv": 0.019410977242302542 + }, + "x_at_s1": { + "tokens": 249, + "ordered_topk_exact_tokens": 105, + "set_exact_tokens": 140, + "mean_set_jaccard": 0.8601453432778734, + "mean_token_weighted_tv": 0.0239712753030191, + "aggregate_load_tv": 0.040829986613119144 + }, + "period_at_s0": { + "tokens": 249, + "ordered_topk_exact_tokens": 110, + "set_exact_tokens": 157, + "mean_set_jaccard": 0.8875502008032128, + "mean_token_weighted_tv": 0.01884335303028305, + "aggregate_load_tv": 0.025435073627844713 + }, + "period_at_s1": { + "tokens": 249, + "ordered_topk_exact_tokens": 98, + "set_exact_tokens": 132, + "mean_set_jaccard": 0.851118760757315, + "mean_token_weighted_tv": 0.02464788857413583, + "aggregate_load_tv": 0.044176706827309245 + } + } + }, + "layer_21": { + "layer": 21, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "e42d5c2daf4a854b1c558c149651dcc0b87e2510c637615885c0a7a237699ff8", + "route_weight_sha256": "9b42483fba0c7912431f505894d305904bea271ab9c19b246de3713b18f061bd", + "loads": [ + 16, + 23, + 25, + 16, + 1, + 20, + 5, + 15, + 21, + 41, + 6, + 12, + 6, + 5, + 21, + 10, + 124, + 15, + 32, + 9, + 45, + 10, + 34, + 20, + 40, + 16, + 22, + 24, + 20, + 28, + 12, + 17, + 23, + 14, + 11, + 1, + 59, + 16, + 31, + 24, + 9, + 14, + 28, + 50, + 21, + 6, + 14, + 25, + 13, + 31, + 19, + 19, + 18, + 43, + 12, + 9, + 23, + 42, + 37, + 12, + 29, + 88, + 15, + 27 + ], + "weighted_loads": [ + 0.6302762534469366, + 4.778745993971825, + 2.974639656022191, + 0.5011767670512199, + 0.028130263090133667, + 1.2479491010308266, + 0.17940129525959492, + 0.531438896432519, + 0.8730210140347481, + 3.4096879344433546, + 0.26011382788419724, + 0.47117038257420063, + 0.27313883788883686, + 0.17525362223386765, + 0.9471855331212282, + 0.3261715117841959, + 5.554872428998351, + 1.1240371875464916, + 1.7531627975404263, + 0.30530235916376114, + 2.4791754577308893, + 0.3331119418144226, + 1.9941780064255, + 1.5142621137201786, + 3.209548946470022, + 0.5497018415480852, + 1.2539626155048609, + 2.213543998077512, + 0.6532533243298531, + 1.6609002333134413, + 0.5404730439186096, + 0.5808312129229307, + 1.411333829164505, + 0.6301031280308962, + 0.4901203140616417, + 0.03633926808834076, + 3.375270562246442, + 0.8866906650364399, + 1.9434516206383705, + 0.7317539379000664, + 0.30683152563869953, + 0.5749358162283897, + 2.1788058169186115, + 2.9334616009145975, + 1.1394805889576674, + 0.20115967094898224, + 0.555582707747817, + 2.1221888437867165, + 0.5993642024695873, + 1.2302215062081814, + 1.0763617120683193, + 1.0393246002495289, + 0.9068437684327364, + 1.4865609742701054, + 0.4957658164203167, + 0.3699516747146845, + 1.8677593674510717, + 3.193733423948288, + 1.4091530684381723, + 1.1245086174458265, + 1.4630126617848873, + 6.117276730015874, + 0.9417399242520332, + 1.6658440381288528 + ], + "unique_experts": 64, + "load_cv": 0.8267924459118853, + "normalized_load_entropy": 0.9378723158670029, + "max_load_share": 0.08299866131191433 + }, + "full_input": { + "tokens": 274, + "top_k": 6, + "decisions": 1644, + "ordered_route_sha256": "707157fbabaab8b55536da440111ce366e08124f0c69f0d221a3efd94274940c", + "route_weight_sha256": "2da18ea0c1940a4bda4a06e13261124cd72ea4ee09d21a24cb3d279f5ead3fa2", + "loads": [ + 16, + 23, + 28, + 16, + 7, + 20, + 8, + 16, + 23, + 41, + 14, + 14, + 8, + 9, + 24, + 16, + 127, + 18, + 33, + 14, + 45, + 18, + 34, + 20, + 40, + 17, + 32, + 28, + 23, + 28, + 13, + 17, + 24, + 15, + 12, + 10, + 59, + 16, + 31, + 27, + 11, + 14, + 32, + 50, + 21, + 6, + 14, + 25, + 25, + 33, + 19, + 26, + 28, + 44, + 17, + 12, + 25, + 42, + 40, + 13, + 30, + 88, + 18, + 27 + ], + "weighted_loads": [ + 0.6302762534469366, + 4.778745993971825, + 3.0507807589601725, + 0.5011767670512199, + 0.25438424199819565, + 1.2479491010308266, + 0.4392921272665262, + 0.5637582670897245, + 1.0182416066527367, + 3.4096879344433546, + 0.8177886977791786, + 0.539848180487752, + 0.3983993995934725, + 0.4488402307033539, + 1.0378770846873522, + 0.5383285880088806, + 5.6439377842471, + 1.2081867125816643, + 1.799251265823841, + 1.9147151075303555, + 2.4791754577308893, + 0.8182145510800183, + 1.9941780064255, + 1.5142621137201786, + 3.209548946470022, + 0.5844140145927668, + 1.724263271316886, + 2.5709409844130278, + 0.7119598998688161, + 1.6609002333134413, + 0.5633787401020527, + 0.5808312129229307, + 1.434178413823247, + 0.6583477463573217, + 0.5375476479530334, + 0.5908696465194225, + 3.375270562246442, + 0.8866906650364399, + 1.9434516206383705, + 0.8436326831579208, + 0.397741237655282, + 0.5749358162283897, + 2.4027167335152626, + 2.9334616009145975, + 1.1394805889576674, + 0.20115967094898224, + 0.555582707747817, + 2.1221888437867165, + 1.2310568615794182, + 1.3849713541567326, + 1.0763617120683193, + 1.3730399198830128, + 1.5261994767934084, + 1.4993999749422073, + 0.648300121538341, + 0.6525268498808146, + 2.114398093894124, + 3.193733423948288, + 1.544314194470644, + 1.1678555738180876, + 1.485259871929884, + 6.117276730015874, + 1.0680470913648605, + 1.6658440381288528 + ], + "unique_experts": 64, + "load_cv": 0.7286891368955535, + "normalized_load_entropy": 0.9533620893502495, + "max_load_share": 0.07725060827250609 + } + }, + "s1_eos": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "5673fadab690e480493c5f2e29e417edd3721929cec7c73f13b478479514e6cb", + "route_weight_sha256": "a5ea9938281f24bbe88378f28edf6418212c36895b909ec172f2eb5cb1f9176f", + "loads": [ + 15, + 24, + 26, + 16, + 3, + 20, + 5, + 15, + 19, + 39, + 5, + 9, + 6, + 5, + 21, + 9, + 126, + 16, + 33, + 10, + 48, + 8, + 34, + 22, + 39, + 17, + 20, + 21, + 20, + 28, + 11, + 17, + 24, + 12, + 13, + 1, + 60, + 17, + 30, + 26, + 9, + 12, + 28, + 54, + 22, + 5, + 13, + 25, + 15, + 31, + 17, + 19, + 19, + 44, + 13, + 10, + 22, + 41, + 35, + 11, + 30, + 87, + 15, + 27 + ], + "weighted_loads": [ + 0.5944543536752462, + 4.746133150532842, + 3.041891325265169, + 0.4868220277130604, + 0.08361135050654411, + 1.2897434383630753, + 0.18840180151164532, + 0.5323012303560972, + 0.8096738886088133, + 3.347656887024641, + 0.2363020721822977, + 0.38751297630369663, + 0.2680963408201933, + 0.17304724641144276, + 0.9485241584479809, + 0.3057318441569805, + 5.605886470526457, + 1.1534971483051777, + 1.786572290584445, + 0.32630101032555103, + 2.6110995039343834, + 0.2671595439314842, + 1.9798926636576653, + 1.5635419748723507, + 3.1815391648560762, + 0.6014658734202385, + 1.1823627445846796, + 2.0846218690276146, + 0.6772208418697119, + 1.6645299829542637, + 0.505796255543828, + 0.5684088282287121, + 1.4477601014077663, + 0.5748583897948265, + 0.5466216877102852, + 0.035464659333229065, + 3.409178538247943, + 0.9249263647943735, + 1.9044185727834702, + 0.7915424294769764, + 0.30323998257517815, + 0.5109468102455139, + 2.204756386578083, + 3.1063426341861486, + 1.1568163260817528, + 0.16396432369947433, + 0.5415372215211391, + 2.1101195327937603, + 0.6710753589868546, + 1.2265362460166216, + 0.997668607160449, + 1.0535154975950718, + 0.9534180909395218, + 1.4812742657959461, + 0.5154066048562527, + 0.40171076729893684, + 1.823486415669322, + 3.130266711115837, + 1.3370896875858307, + 1.1573192663490772, + 1.4724730160087347, + 6.034566571936011, + 0.9287292957305908, + 1.634640933945775 + ], + "unique_experts": 64, + "load_cv": 0.8395260832036205, + "normalized_load_entropy": 0.9364303531287632, + "max_load_share": 0.08433734939759036 + }, + "full_input": { + "tokens": 290, + "top_k": 6, + "decisions": 1740, + "ordered_route_sha256": "551885faafb1c172b9a2cf39120778f0aa8f928433a6f13f5d7a003886adfdfd", + "route_weight_sha256": "7ea5bb367cac918c4e96ce5142a9844635234a0dbf7e53599c15465d2a427e39", + "loads": [ + 23, + 25, + 29, + 16, + 4, + 21, + 10, + 17, + 23, + 41, + 16, + 9, + 10, + 15, + 27, + 13, + 130, + 24, + 35, + 18, + 49, + 16, + 35, + 27, + 40, + 20, + 29, + 29, + 23, + 29, + 15, + 17, + 25, + 16, + 13, + 18, + 61, + 18, + 31, + 29, + 9, + 14, + 36, + 55, + 23, + 6, + 13, + 25, + 27, + 35, + 19, + 29, + 29, + 45, + 26, + 18, + 27, + 41, + 38, + 14, + 31, + 88, + 18, + 28 + ], + "weighted_loads": [ + 1.1007778514176607, + 4.794663222506642, + 3.7347828093916178, + 0.4868220277130604, + 0.11737387999892235, + 1.3052029926329851, + 0.4190513715147972, + 0.646286753937602, + 1.0170267689973116, + 3.493093954399228, + 0.9474208373576403, + 0.38751297630369663, + 0.4738708268851042, + 0.7115314323455095, + 1.1783159580081701, + 0.43924405798316, + 5.718439248390496, + 1.432866485323757, + 1.8387467786669731, + 2.0146232899278402, + 2.6579459607601166, + 0.7439172635786235, + 2.0105017982423306, + 2.0617159344255924, + 3.2173996176570654, + 0.7001333218067884, + 1.5311961509287357, + 2.8264635130763054, + 0.7125774738378823, + 1.7134151197969913, + 0.6656621918082237, + 0.5684088282287121, + 1.4705112278461456, + 1.1658843532204628, + 0.5466216877102852, + 0.9796479530632496, + 3.4800731446594, + 0.9659858699887991, + 1.9584826938807964, + 0.9087779149413109, + 0.30323998257517815, + 0.6334795169532299, + 2.605691261589527, + 3.1498487051576376, + 1.2220635786652565, + 0.2223832570016384, + 0.5415372215211391, + 2.1101195327937603, + 1.5247184708714485, + 2.1727909464389086, + 1.077152295038104, + 1.7899075485765934, + 1.5326218605041504, + 1.494113266468048, + 1.2571608712896705, + 0.9524384569376707, + 2.1730454675853252, + 3.130266711115837, + 1.474592575803399, + 1.3140868861228228, + 1.4949112944304943, + 6.09412476234138, + 1.0444260835647583, + 1.726113872602582 + ], + "unique_experts": 64, + "load_cv": 0.6946295697228178, + "normalized_load_entropy": 0.9567300774548309, + "max_load_share": 0.07471264367816093 + } + }, + "s0_bos": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "b725ec21e017b102907519937ad257fa6a94b6a08583537c0c3e32c55f3d69ed", + "route_weight_sha256": "683fd2d4db888a4f56988ca4949c8d8d5fb1ca61bf7494eb53491ab495b00a01", + "loads": [ + 13, + 24, + 26, + 14, + 2, + 20, + 4, + 16, + 24, + 40, + 6, + 13, + 7, + 4, + 21, + 8, + 122, + 15, + 31, + 12, + 45, + 8, + 34, + 22, + 40, + 19, + 23, + 21, + 17, + 27, + 14, + 16, + 25, + 12, + 13, + 1, + 59, + 16, + 32, + 20, + 10, + 14, + 28, + 52, + 22, + 7, + 14, + 25, + 15, + 28, + 20, + 20, + 17, + 43, + 15, + 10, + 22, + 39, + 36, + 14, + 26, + 89, + 15, + 27 + ], + "weighted_loads": [ + 0.5068189203739166, + 4.860611891373992, + 3.0926310531795025, + 0.44210713542997837, + 0.057753149420022964, + 1.2466524839401245, + 0.16651687398552895, + 0.5738849006593227, + 0.9613223355263472, + 3.3880976382642984, + 0.233440225943923, + 0.518700884655118, + 0.3231556285172701, + 0.14304010942578316, + 0.9403576403856277, + 0.2785581797361374, + 5.457757657393813, + 1.1040520817041397, + 1.7043606489896774, + 0.38319223560392857, + 2.5059373266994953, + 0.23720953799784184, + 1.974998164921999, + 1.5918204579502344, + 3.2308487724512815, + 0.6750436704605818, + 1.2719993982464075, + 2.065539389848709, + 0.5740716643631458, + 1.6465478036552668, + 0.6040595695376396, + 0.5275245625525713, + 1.5177400521934032, + 0.5694768168032169, + 0.54289286211133, + 0.03430961072444916, + 3.3715157452970743, + 0.9053181204944849, + 1.9649775568395853, + 0.609654325991869, + 0.331897497177124, + 0.5715851075947285, + 2.1635832265019417, + 2.963353993371129, + 1.1594998985528946, + 0.21811139024794102, + 0.5540488995611668, + 2.1145365219563246, + 0.6144757252186537, + 1.164203803986311, + 1.1406961716711521, + 1.035461686551571, + 0.8797832187265158, + 1.5004091206938028, + 0.5635504573583603, + 0.3941320590674877, + 1.8014348670840263, + 3.0977965593338013, + 1.3760552480816841, + 1.1817085091024637, + 1.3280116897076368, + 6.156301157549024, + 0.9529159031808376, + 1.6536830700933933 + ], + "unique_experts": 64, + "load_cv": 0.8168487780522729, + "normalized_load_entropy": 0.9395675072894575, + "max_load_share": 0.08165997322623829 + }, + "full_input": { + "tokens": 274, + "top_k": 6, + "decisions": 1644, + "ordered_route_sha256": "ecbf9c40d87a6c4273af87fc54b8f387178dae5ecd9ef56380cc787efc3e6a16", + "route_weight_sha256": "4bc9bfa083774b424d9ecbc0af0e4b76aae72d3dffe7585f7525f5046886c7b1", + "loads": [ + 13, + 25, + 28, + 15, + 7, + 20, + 6, + 17, + 27, + 40, + 13, + 14, + 10, + 8, + 23, + 13, + 125, + 19, + 33, + 15, + 45, + 15, + 34, + 22, + 40, + 20, + 33, + 25, + 19, + 27, + 16, + 18, + 26, + 12, + 14, + 10, + 59, + 16, + 32, + 25, + 13, + 14, + 32, + 52, + 22, + 8, + 14, + 25, + 27, + 29, + 20, + 27, + 27, + 44, + 20, + 13, + 24, + 39, + 38, + 15, + 27, + 89, + 19, + 27 + ], + "weighted_loads": [ + 0.5068189203739166, + 4.903349230065942, + 3.1662619449198246, + 0.6184664312750101, + 0.2495732456445694, + 1.2466524839401245, + 0.3863234519958496, + 0.6081691421568394, + 1.1328862365335226, + 3.3880976382642984, + 0.7373216692358255, + 0.5454343352466822, + 0.4842525701969862, + 0.4058916047215462, + 1.0057063288986683, + 0.4732022825628519, + 5.547957903705537, + 1.242892999202013, + 1.8051128312945366, + 1.008338337764144, + 2.5059373266994953, + 0.7184244254603982, + 1.974998164921999, + 1.5918204579502344, + 3.2308487724512815, + 0.7097558435052633, + 1.7511804196983576, + 2.4208150394260883, + 0.6283645024523139, + 1.6465478036552668, + 0.6593517102301121, + 0.6789919156581163, + 1.5405846368521452, + 0.5694768168032169, + 0.5903201960027218, + 0.5888399891555309, + 3.3715157452970743, + 0.9053181204944849, + 1.9649775568395853, + 0.8016481585800648, + 0.499674741178751, + 0.5715851075947285, + 2.3853770196437836, + 2.963353993371129, + 1.1594998985528946, + 0.33681571669876575, + 0.5540488995611668, + 2.1145365219563246, + 1.2363179065287113, + 1.2844006456434727, + 1.1406961716711521, + 1.3691770061850548, + 1.4991389270871878, + 1.5132481213659048, + 0.7154806097969413, + 0.6862463541328907, + 2.0459232963621616, + 3.0977965593338013, + 1.4400809649378061, + 1.2250554654747248, + 1.3502588998526335, + 6.156301157549024, + 1.135777834802866, + 1.6536830700933933 + ], + "unique_experts": 64, + "load_cv": 0.7197958717114775, + "normalized_load_entropy": 0.9545279379201311, + "max_load_share": 0.07603406326034064 + } + }, + "s1_bos": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "c68390f7e0f687adebfe49a8bc279c31521affc79d14590d1afb2ca4e4a2c891", + "route_weight_sha256": "0626af5addf78e7129bedb06f801afaccf5b932dbaac69ad70221799f23a96e5", + "loads": [ + 13, + 24, + 26, + 15, + 2, + 20, + 6, + 15, + 20, + 40, + 5, + 11, + 8, + 4, + 20, + 9, + 123, + 16, + 31, + 10, + 47, + 9, + 34, + 22, + 39, + 18, + 21, + 21, + 16, + 28, + 14, + 15, + 23, + 13, + 11, + 1, + 59, + 16, + 32, + 28, + 10, + 15, + 28, + 57, + 22, + 7, + 12, + 25, + 15, + 29, + 19, + 19, + 17, + 40, + 16, + 9, + 22, + 41, + 36, + 13, + 26, + 89, + 15, + 27 + ], + "weighted_loads": [ + 0.5040974244475365, + 4.762009687721729, + 3.0353199020028114, + 0.46908598206937313, + 0.05869719572365284, + 1.286591712385416, + 0.21773234009742737, + 0.5378302838653326, + 0.8398634195327759, + 3.361887553706765, + 0.21214517019689083, + 0.4556925129145384, + 0.40306163392961025, + 0.1450291071087122, + 0.9079556465148926, + 0.29015147127211094, + 5.519519444555044, + 1.1409464851021767, + 1.7656768411397934, + 0.33060550317168236, + 2.576215783134103, + 0.2519824653863907, + 1.9663632344454527, + 1.5768551714718342, + 3.2050858791917562, + 0.6338346637785435, + 1.2214139085263014, + 2.0592802483588457, + 0.5593739785254002, + 1.676055060699582, + 0.6042716447263956, + 0.49833761528134346, + 1.451124981045723, + 0.5907307043671608, + 0.47538807429373264, + 0.035972703248262405, + 3.3883937131613493, + 0.9144150819629431, + 1.9342694990336895, + 0.8495753984898329, + 0.3345511630177498, + 0.6040012910962105, + 2.13836776278913, + 3.246267154812813, + 1.150017799809575, + 0.21853998117148876, + 0.5027650706470013, + 2.1281448919326067, + 0.6357604339718819, + 1.1915777437388897, + 1.0775016508996487, + 0.9892714098095894, + 0.8918406590819359, + 1.4174211714416742, + 0.5808261651545763, + 0.38365562818944454, + 1.798357842490077, + 3.1259384620934725, + 1.3948019985109568, + 1.1768023055046797, + 1.3416927363723516, + 6.212375408038497, + 0.9594178032130003, + 1.6249926891177893 + ], + "unique_experts": 64, + "load_cv": 0.8282823544329576, + "normalized_load_entropy": 0.9382136017002949, + "max_load_share": 0.0823293172690763 + }, + "full_input": { + "tokens": 290, + "top_k": 6, + "decisions": 1740, + "ordered_route_sha256": "8658364d0f037dbb54f4852344a90e7c2f95cff8edcdf5ff3461a675fe2a7df7", + "route_weight_sha256": "37c77b80529da231e139640ae519badd5c61c4d1873999980953d7c142cea4fb", + "loads": [ + 21, + 25, + 29, + 15, + 5, + 21, + 12, + 17, + 24, + 42, + 14, + 13, + 13, + 13, + 26, + 13, + 126, + 22, + 34, + 15, + 48, + 16, + 35, + 27, + 40, + 21, + 30, + 30, + 18, + 29, + 18, + 17, + 24, + 17, + 11, + 18, + 60, + 17, + 33, + 31, + 12, + 17, + 36, + 58, + 23, + 8, + 12, + 25, + 26, + 33, + 21, + 29, + 27, + 41, + 28, + 18, + 27, + 41, + 37, + 16, + 27, + 91, + 19, + 28 + ], + "weighted_loads": [ + 1.010420922189951, + 4.81053975969553, + 3.760449258610606, + 0.46908598206937313, + 0.1728577222675085, + 1.302051266655326, + 0.5070609021931887, + 0.6542642842978239, + 1.047446385025978, + 3.5073246210813522, + 0.8224814515560865, + 0.5303954686969519, + 0.6437418330460787, + 0.6229662355035543, + 1.1401103492826223, + 0.468631224706769, + 5.60513097140938, + 1.381896536797285, + 1.8725413884967566, + 1.0021086111664772, + 2.623062239959836, + 0.7223070235922933, + 1.996972369030118, + 2.075029131025076, + 3.2409463319927454, + 0.7325021121650934, + 1.5721633918583393, + 2.8216618578881025, + 0.590375660918653, + 1.7249401975423098, + 0.7656779363751411, + 0.6364674009382725, + 1.4738761074841022, + 1.181756667792797, + 0.47538807429373264, + 0.9801559969782829, + 3.4592883195728064, + 0.9554745871573687, + 1.9883336201310158, + 0.9597347136586905, + 0.41023505851626396, + 0.7265339978039265, + 2.5331983733922243, + 3.2897732257843018, + 1.2152650523930788, + 0.27695891447365284, + 0.5027650706470013, + 2.1281448919326067, + 1.4542703703045845, + 2.1958090029656887, + 1.1569853387773037, + 1.725663460791111, + 1.4710444286465645, + 1.4302601721137762, + 1.2970310831442475, + 0.9784697517752647, + 2.1334042213857174, + 3.1259384620934725, + 1.4196896851062775, + 1.3335699252784252, + 1.3641310147941113, + 6.31425485573709, + 1.1410803254693747, + 1.7164656277745962 + ], + "unique_experts": 64, + "load_cv": 0.6811079547157055, + "normalized_load_entropy": 0.9589172696948849, + "max_load_share": 0.07241379310344828 + } + }, + "s0_x": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "24f0ee10c9c71124d11f8c8ac97a332b0d709235cef85154bfeb1f718509562e", + "route_weight_sha256": "ff3ad8d16023aa3153b6d742a4cde3d98ebf2ecf9b1dfb050ba126020053bb96", + "loads": [ + 15, + 25, + 28, + 15, + 3, + 22, + 5, + 18, + 23, + 40, + 5, + 13, + 6, + 4, + 20, + 9, + 122, + 14, + 30, + 8, + 47, + 10, + 34, + 23, + 39, + 19, + 22, + 22, + 14, + 28, + 13, + 16, + 25, + 13, + 12, + 1, + 61, + 16, + 31, + 26, + 8, + 12, + 29, + 54, + 21, + 6, + 12, + 25, + 15, + 28, + 20, + 19, + 17, + 44, + 15, + 9, + 21, + 40, + 35, + 11, + 25, + 89, + 14, + 28 + ], + "weighted_loads": [ + 0.5800918433815241, + 4.750505210831761, + 3.1227890141308308, + 0.4745576288551092, + 0.08523910120129585, + 1.320951834321022, + 0.18844450823962688, + 0.6168040372431278, + 0.9289545305073261, + 3.4254244435578585, + 0.22900722362101078, + 0.5129308756440878, + 0.3023710045963526, + 0.14628242142498493, + 0.9228972382843494, + 0.30063946172595024, + 5.444240676239133, + 1.067445047199726, + 1.7168975565582514, + 0.26834812574088573, + 2.5614540111273527, + 0.3066155221313238, + 1.981254557147622, + 1.5808102432638407, + 3.1935900915414095, + 0.6871811617165804, + 1.217191992327571, + 2.10781810618937, + 0.49459637328982353, + 1.7013394311070442, + 0.5510224495083094, + 0.5420538894832134, + 1.5059746783226728, + 0.5877916719764471, + 0.5086004827171564, + 0.03572903946042061, + 3.435983955860138, + 0.919221468269825, + 1.910902377218008, + 0.7903027348220348, + 0.2705469951033592, + 0.5039385240525007, + 2.2510061394423246, + 3.1012627873569727, + 1.1315136160701513, + 0.1967981420457363, + 0.522879384458065, + 2.088627891615033, + 0.6443836148828268, + 1.1492704302072525, + 1.1389247179031372, + 0.984782163053751, + 0.8929873593151569, + 1.5015597008168697, + 0.5660796035081148, + 0.3620859570801258, + 1.8125117756426334, + 3.140265364199877, + 1.3291244711726904, + 1.0557322837412357, + 1.2827303819358349, + 6.249478412792087, + 0.9161176923662424, + 1.6977068576961756 + ], + "unique_experts": 64, + "load_cv": 0.8287322645788251, + "normalized_load_entropy": 0.9373765434589191, + "max_load_share": 0.08165997322623829 + }, + "full_input": { + "tokens": 274, + "top_k": 6, + "decisions": 1644, + "ordered_route_sha256": "416e78296960bda34ea4ad7c2769454eb6d45020f0eafe7edcf879d9b31a68ad", + "route_weight_sha256": "dd3bfc47804bb589993e5982cc2d237a7852520646082ea2f788c8ed6f655146", + "loads": [ + 15, + 25, + 30, + 16, + 8, + 22, + 8, + 18, + 25, + 40, + 14, + 14, + 10, + 7, + 22, + 14, + 126, + 19, + 31, + 12, + 47, + 16, + 34, + 23, + 39, + 20, + 32, + 26, + 17, + 28, + 14, + 16, + 26, + 14, + 13, + 11, + 61, + 16, + 31, + 28, + 8, + 12, + 35, + 54, + 21, + 6, + 12, + 25, + 28, + 30, + 20, + 26, + 28, + 45, + 20, + 12, + 24, + 40, + 37, + 12, + 26, + 90, + 17, + 28 + ], + "weighted_loads": [ + 0.5800918433815241, + 4.750505210831761, + 3.196419905871153, + 0.5058436524122953, + 0.2770591974258423, + 1.320951834321022, + 0.44420270808041096, + 0.6168040372431278, + 1.096839014440775, + 3.4254244435578585, + 0.849320450797677, + 0.5491585973650217, + 0.49484275467693806, + 0.3599648904055357, + 0.9799891635775566, + 0.48200794868171215, + 5.5637255338951945, + 1.2477395106106997, + 1.7652540747076273, + 0.93218176625669, + 2.5614540111273527, + 0.7492714682593942, + 1.981254557147622, + 1.5808102432638407, + 3.1935900915414095, + 0.7218933347612619, + 1.6894203815609217, + 2.453920727595687, + 0.5945947645232081, + 1.7013394311070442, + 0.5739281456917524, + 0.5420538894832134, + 1.5288192629814148, + 0.6180042419582605, + 0.5560278166085482, + 0.6864174604415894, + 3.435983955860138, + 0.919221468269825, + 1.910902377218008, + 0.8614312037825584, + 0.2705469951033592, + 0.5039385240525007, + 2.563689822331071, + 3.1012627873569727, + 1.1315136160701513, + 0.1967981420457363, + 0.522879384458065, + 2.088627891615033, + 1.3654225077480078, + 1.3302272073924541, + 1.1389247179031372, + 1.3184974826872349, + 1.706013921648264, + 1.5143987014889717, + 0.7187715033069253, + 0.6441681943833828, + 2.097386009991169, + 3.140265364199877, + 1.3936943411827087, + 1.0990792401134968, + 1.3049775920808315, + 6.279801456257701, + 1.0351456459611654, + 1.6977068576961756 + ], + "unique_experts": 64, + "load_cv": 0.7368005644535811, + "normalized_load_entropy": 0.9519951491665989, + "max_load_share": 0.07664233576642336 + } + }, + "s1_x": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "3c9f81b821d7b2f542e48bfef14ac6d7c4cb42b8462baafc1eafaf455dfb8307", + "route_weight_sha256": "d928e93ea6ec4d7bed45358b3544924ccc0d7871feebf140cec6577d7b305ebf", + "loads": [ + 17, + 23, + 26, + 18, + 4, + 19, + 5, + 14, + 16, + 40, + 5, + 12, + 9, + 3, + 19, + 8, + 124, + 15, + 31, + 13, + 49, + 7, + 34, + 23, + 39, + 20, + 21, + 21, + 17, + 29, + 12, + 13, + 24, + 10, + 12, + 2, + 59, + 16, + 28, + 23, + 9, + 14, + 29, + 58, + 21, + 6, + 12, + 25, + 18, + 27, + 19, + 20, + 17, + 54, + 18, + 8, + 21, + 40, + 36, + 11, + 23, + 86, + 14, + 28 + ], + "weighted_loads": [ + 0.6421377491205931, + 4.636675804853439, + 3.040967918932438, + 0.5658645443618298, + 0.11589084938168526, + 1.2220394164323807, + 0.18365504778921604, + 0.5051488429307938, + 0.7123880386352539, + 3.406167220324278, + 0.2384112160652876, + 0.48911434039473534, + 0.44711518101394176, + 0.112407635897398, + 0.8563625440001488, + 0.25869313441216946, + 5.526385230943561, + 1.1078808940947056, + 1.7724170740693808, + 0.4291068445891142, + 2.6609569638967514, + 0.19331102073192596, + 1.9644059762358665, + 1.5831531696021557, + 3.208822578191757, + 0.7505448386073112, + 1.1622815243899822, + 2.0438568349927664, + 0.591737998649478, + 1.7337771449238062, + 0.5063161086291075, + 0.4414454996585846, + 1.4701770432293415, + 0.4814862310886383, + 0.4829071443527937, + 0.0743814967572689, + 3.417226718738675, + 0.9135184772312641, + 1.7490456588566303, + 0.6995482463389635, + 0.3014197517186403, + 0.5746253971010447, + 2.1913449726998806, + 3.347419947385788, + 1.1118735056370497, + 0.1752035841345787, + 0.5223373658955097, + 2.080467550083995, + 0.7905328720808029, + 1.1014934331178665, + 1.0658883675932884, + 1.110411249101162, + 0.9207870848476887, + 1.9355209115892649, + 0.6520076803863049, + 0.33181894570589066, + 1.796962633728981, + 3.068073594942689, + 1.3960253093391657, + 1.0710339080542326, + 1.2175397966057062, + 6.10109025426209, + 0.910042954608798, + 1.6478536892682314 + ], + "unique_experts": 64, + "load_cv": 0.8392528048310505, + "normalized_load_entropy": 0.9366552388184497, + "max_load_share": 0.08299866131191433 + }, + "full_input": { + "tokens": 290, + "top_k": 6, + "decisions": 1740, + "ordered_route_sha256": "b2be8473dd56acbcbf0fa515795b8c2bbf085b077ff2402cd7509fac4cac13d5", + "route_weight_sha256": "6edd6d9da2992f3d83c98889b4124d1b4b13023ba95ed95d605f199ad97ac351", + "loads": [ + 26, + 24, + 28, + 18, + 5, + 21, + 9, + 15, + 19, + 42, + 16, + 12, + 16, + 12, + 24, + 12, + 128, + 22, + 33, + 19, + 50, + 13, + 35, + 29, + 40, + 25, + 30, + 29, + 20, + 30, + 17, + 13, + 25, + 14, + 12, + 20, + 60, + 17, + 29, + 25, + 9, + 17, + 39, + 59, + 22, + 7, + 12, + 25, + 32, + 30, + 21, + 30, + 28, + 55, + 29, + 17, + 26, + 40, + 37, + 14, + 24, + 88, + 16, + 29 + ], + "weighted_loads": [ + 1.181679779663682, + 4.68520587682724, + 3.7311865631490946, + 0.5658645443618298, + 0.14619365148246288, + 1.272457467392087, + 0.3345998153090477, + 0.58533526211977, + 0.8936857469379902, + 3.551604287698865, + 0.9076815042644739, + 0.48911434039473534, + 0.7848041746765375, + 0.6059654578566551, + 1.0412368010729551, + 0.4112564157694578, + 5.640514782629907, + 1.3810757994651794, + 1.8245915621519089, + 1.1388365682214499, + 2.7078034207224846, + 0.6246165120974183, + 1.9950151108205318, + 2.128966521471739, + 3.2446830309927464, + 0.9424585420638323, + 1.5183756705373526, + 2.7843964304775, + 0.653989833779633, + 1.7826622817665339, + 0.7004568763077259, + 0.4414454996585846, + 1.4929281696677208, + 1.0725121945142746, + 0.4829071443527937, + 1.08821090310812, + 3.488121325150132, + 0.9545779824256897, + 1.8031097799539566, + 0.7757227513939142, + 0.3014197517186403, + 0.7789541240781546, + 2.697089120745659, + 3.390926018357277, + 1.1771207582205534, + 0.23362251743674278, + 0.5223373658955097, + 2.080467550083995, + 1.8613469153642654, + 2.017026551067829, + 1.1453720554709435, + 1.8468033000826836, + 1.7021125443279743, + 1.9483599122613668, + 1.3339707916602492, + 0.923166835680604, + 2.1459714602679014, + 3.068073594942689, + 1.4209129959344864, + 1.2278015278279781, + 1.2399780750274658, + 6.194601943716407, + 0.9795522782951593, + 1.7393266279250383 + ], + "unique_experts": 64, + "load_cv": 0.6988467936981807, + "normalized_load_entropy": 0.9560805381614677, + "max_load_share": 0.0735632183908046 + } + }, + "s0_period": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "f70faec05ce277693ffc76f6a4412b9ec080303c6ff7b70bc7a8230613186d86", + "route_weight_sha256": "445429136123dbe2af19080253a4417391793b7619a72204d7fd91c7ff92b883", + "loads": [ + 15, + 24, + 28, + 15, + 3, + 23, + 6, + 18, + 20, + 40, + 5, + 13, + 8, + 5, + 20, + 8, + 124, + 14, + 30, + 9, + 49, + 8, + 34, + 21, + 39, + 20, + 22, + 22, + 18, + 28, + 12, + 14, + 23, + 13, + 12, + 1, + 59, + 16, + 30, + 26, + 8, + 11, + 29, + 54, + 21, + 6, + 13, + 25, + 15, + 30, + 20, + 19, + 17, + 41, + 15, + 9, + 21, + 41, + 35, + 13, + 25, + 88, + 15, + 28 + ], + "weighted_loads": [ + 0.573052279651165, + 4.7665122505277395, + 3.093273811042309, + 0.4811609163880348, + 0.08499086275696754, + 1.3594068698585033, + 0.21047026850283146, + 0.6264689657837152, + 0.8346490636467934, + 3.4231149815022945, + 0.21973758935928345, + 0.5143362246453762, + 0.35108545795083046, + 0.17015167884528637, + 0.922765776515007, + 0.26537807658314705, + 5.532443918287754, + 1.0733275897800922, + 1.7113301940262318, + 0.3067483827471733, + 2.645615827292204, + 0.25192592293024063, + 1.9676716700196266, + 1.5304944925010204, + 3.2076635845005512, + 0.7173429932445288, + 1.218290051445365, + 2.1260046157985926, + 0.6016935762017965, + 1.7073359917849302, + 0.5353427119553089, + 0.4696037881076336, + 1.4184461329132318, + 0.5906627047806978, + 0.5089856050908566, + 0.03626369312405586, + 3.372689874842763, + 0.9223767351359129, + 1.8592233676463366, + 0.8036512304097414, + 0.26962622068822384, + 0.47682199254631996, + 2.234246961772442, + 3.10728801228106, + 1.1402512658387423, + 0.19708123058080673, + 0.5421147849410772, + 2.085825575515628, + 0.6590142957866192, + 1.2102543078362942, + 1.1252916753292084, + 0.994381433352828, + 0.9017473980784416, + 1.376556295901537, + 0.5748116951435804, + 0.3752678968012333, + 1.7797181829810143, + 3.165052901953459, + 1.3416194040328264, + 1.1279833298176527, + 1.2876823395490646, + 6.202110145241022, + 0.9538611471652985, + 1.6947651952505112 + ], + "unique_experts": 64, + "load_cv": 0.8288014598470218, + "normalized_load_entropy": 0.9381529142788885, + "max_load_share": 0.08299866131191433 + }, + "full_input": { + "tokens": 274, + "top_k": 6, + "decisions": 1644, + "ordered_route_sha256": "3e2c1c5325e67ef12548c1d8e7db0225e5cf78ebcce54b9c6390ee4ed480f43d", + "route_weight_sha256": "ce0c7b2c800d41523b1f78f7233272a748920cc0919778bc9f1ec8036313c9c4", + "loads": [ + 15, + 24, + 30, + 15, + 9, + 23, + 9, + 18, + 23, + 40, + 12, + 14, + 12, + 9, + 23, + 13, + 127, + 17, + 31, + 13, + 49, + 15, + 34, + 21, + 39, + 21, + 32, + 26, + 21, + 28, + 13, + 14, + 24, + 14, + 13, + 11, + 59, + 16, + 30, + 29, + 10, + 11, + 34, + 54, + 21, + 6, + 13, + 25, + 27, + 32, + 20, + 27, + 27, + 42, + 21, + 13, + 23, + 41, + 36, + 15, + 26, + 88, + 18, + 28 + ], + "weighted_loads": [ + 0.573052279651165, + 4.7665122505277395, + 3.166904702782631, + 0.4811609163880348, + 0.3167627938091755, + 1.3594068698585033, + 0.5075480956584215, + 0.6264689657837152, + 1.0361988451331854, + 3.4231149815022945, + 0.7476255930960178, + 0.555460013449192, + 0.549503717571497, + 0.41773674450814724, + 1.0152966976165771, + 0.46674015931785107, + 5.625211854465306, + 1.189982008188963, + 1.762488342821598, + 0.9642563611268997, + 2.645615827292204, + 0.7259630216285586, + 1.9676716700196266, + 1.5304944925010204, + 3.2076635845005512, + 0.7520551662892103, + 1.6912711877375841, + 2.481799190863967, + 0.6977771939709783, + 1.7073359917849302, + 0.558248408138752, + 0.4696037881076336, + 1.4412907175719738, + 0.6204474400728941, + 0.5564129389822483, + 0.6405064240098, + 3.372689874842763, + 0.9223767351359129, + 1.8592233676463366, + 0.901036461815238, + 0.33663569390773773, + 0.47682199254631996, + 2.5024567805230618, + 3.10728801228106, + 1.1402512658387423, + 0.19708123058080673, + 0.5421147849410772, + 2.085825575515628, + 1.3205666802823544, + 1.4384822063148022, + 1.1252916753292084, + 1.4031335394829512, + 1.5211031064391136, + 1.389395296573639, + 0.756868495605886, + 0.7343696840107441, + 2.040635336190462, + 3.165052901953459, + 1.3662651516497135, + 1.253607815131545, + 1.3099295496940613, + 6.202110145241022, + 1.0871752388775349, + 1.6947651952505112 + ], + "unique_experts": 64, + "load_cv": 0.7295010922835458, + "normalized_load_entropy": 0.9535711407786154, + "max_load_share": 0.07725060827250609 + } + }, + "s1_period": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "3e553b3dc00878f26e7e5d8376df90c1bd4764408cf30bd65e4986bf223ce007", + "route_weight_sha256": "0e91c715cf77d6d66900a29edecc244b57ce5c7a108eb6fd755f581b131595b2", + "loads": [ + 15, + 22, + 26, + 15, + 3, + 20, + 6, + 13, + 17, + 41, + 5, + 11, + 9, + 3, + 19, + 7, + 129, + 15, + 32, + 13, + 48, + 6, + 34, + 23, + 40, + 21, + 20, + 21, + 20, + 29, + 13, + 11, + 24, + 12, + 12, + 2, + 58, + 16, + 27, + 21, + 9, + 14, + 28, + 57, + 22, + 6, + 11, + 25, + 17, + 29, + 20, + 19, + 17, + 51, + 15, + 9, + 20, + 42, + 36, + 13, + 28, + 86, + 14, + 27 + ], + "weighted_loads": [ + 0.5736289247870445, + 4.613424023613334, + 3.0756936371326447, + 0.48104741238057613, + 0.09078575670719147, + 1.2660309560596943, + 0.2130081206560135, + 0.46379106119275093, + 0.7273484952747822, + 3.404356971383095, + 0.23455446772277355, + 0.44457046687602997, + 0.3943918328732252, + 0.109529510140419, + 0.8639710918068886, + 0.23704664036631584, + 5.714393651112914, + 1.1148555353283882, + 1.823152992874384, + 0.41650896705687046, + 2.6476439274847507, + 0.17301281169056892, + 1.9552627131342888, + 1.5909170284867287, + 3.2228740844875574, + 0.7630755696445704, + 1.1418948732316494, + 2.0418411884456873, + 0.6882467903196812, + 1.730073094367981, + 0.5399831347167492, + 0.3698826562613249, + 1.4689856693148613, + 0.5620767828077078, + 0.48246466368436813, + 0.07355776056647301, + 3.4216151796281338, + 0.9225431941449642, + 1.7143823355436325, + 0.6326694712042809, + 0.3041822649538517, + 0.5795907713472843, + 2.181617796421051, + 3.2498365193605423, + 1.1400906033813953, + 0.1769505012780428, + 0.5026806220412254, + 2.073138726875186, + 0.7405408620834351, + 1.1734342109411955, + 1.1023234967142344, + 1.068521311506629, + 0.9340350180864334, + 1.7894817367196083, + 0.5644114781171083, + 0.3597498666495085, + 1.748368063941598, + 3.1236137859523296, + 1.4001015685498714, + 1.1451467424631119, + 1.373176360502839, + 6.064912546426058, + 0.9351336639374495, + 1.606277721002698 + ], + "unique_experts": 64, + "load_cv": 0.855360930357004, + "normalized_load_entropy": 0.9350391722860052, + "max_load_share": 0.08634538152610442 + }, + "full_input": { + "tokens": 290, + "top_k": 6, + "decisions": 1740, + "ordered_route_sha256": "6f88c37709aeff28ebcafe9ffca34d6a20015e84312d3496505977863a43fd96", + "route_weight_sha256": "8c72bc05f6a5c117813eb208cbf7a4958d863e2db73969e6e830175fd5d00b87", + "loads": [ + 23, + 23, + 28, + 15, + 4, + 21, + 11, + 14, + 20, + 43, + 14, + 11, + 15, + 13, + 25, + 11, + 132, + 21, + 35, + 19, + 49, + 12, + 35, + 29, + 41, + 24, + 29, + 29, + 22, + 30, + 18, + 11, + 25, + 16, + 12, + 21, + 59, + 17, + 28, + 23, + 9, + 16, + 38, + 58, + 23, + 7, + 11, + 25, + 31, + 33, + 22, + 30, + 27, + 52, + 29, + 19, + 25, + 42, + 37, + 17, + 29, + 88, + 16, + 28 + ], + "weighted_loads": [ + 1.079952422529459, + 4.661954095587134, + 3.7659122813493013, + 0.48104741238057613, + 0.13125048205256462, + 1.2814905103296041, + 0.4232847224920988, + 0.5439774803817272, + 0.9048829153180122, + 3.549794038757682, + 0.8148649651557207, + 0.44457046687602997, + 0.7071340885013342, + 0.6739230416715145, + 1.0931529495865107, + 0.39578233659267426, + 5.79740562941879, + 1.3485933560878038, + 1.9178540129214525, + 1.1289534028619528, + 2.694490384310484, + 0.6043183030560613, + 1.985871847718954, + 2.1494609341025352, + 3.2587345372885466, + 0.8617430180311203, + 1.5062766950577497, + 2.7806637678295374, + 0.719248472712934, + 1.7789582312107086, + 0.7365835029631853, + 0.3698826562613249, + 1.4917367957532406, + 1.153102746233344, + 0.48246466368436813, + 1.096883699297905, + 3.492509786039591, + 0.9636026993393898, + 1.7684464566409588, + 0.7018440328538418, + 0.3041822649538517, + 0.7021234780550003, + 2.7177441231906414, + 3.2933425903320312, + 1.205337855964899, + 0.23536943458020687, + 0.5026806220412254, + 2.073138726875186, + 1.691445130854845, + 2.219283366575837, + 1.1818071845918894, + 1.873894615098834, + 1.513238787651062, + 1.8023207373917103, + 1.3418337469920516, + 0.9917445555329323, + 2.070297159254551, + 3.1236137859523296, + 1.4249892551451921, + 1.3690896984189749, + 1.3956146389245987, + 6.155802443623543, + 1.0071798283606768, + 1.697750659659505 + ], + "unique_experts": 64, + "load_cv": 0.7097419604449008, + "normalized_load_entropy": 0.9550410657805959, + "max_load_share": 0.07586206896551724 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 249, + "ordered_topk_exact_tokens": 147, + "set_exact_tokens": 181, + "mean_set_jaccard": 0.916140753490151, + "mean_token_weighted_tv": 0.013871657871547712, + "aggregate_load_tv": 0.02275769745649263 + }, + "system_bos": { + "tokens": 249, + "ordered_topk_exact_tokens": 148, + "set_exact_tokens": 181, + "mean_set_jaccard": 0.9202524383247274, + "mean_token_weighted_tv": 0.01411856099379709, + "aggregate_load_tv": 0.020080321285140562 + }, + "system_x": { + "tokens": 249, + "ordered_topk_exact_tokens": 122, + "set_exact_tokens": 162, + "mean_set_jaccard": 0.8910881621724994, + "mean_token_weighted_tv": 0.019776581221794987, + "aggregate_load_tv": 0.03413654618473896 + }, + "system_period": { + "tokens": 249, + "ordered_topk_exact_tokens": 122, + "set_exact_tokens": 156, + "mean_set_jaccard": 0.8857334098297953, + "mean_token_weighted_tv": 0.020300211601827038, + "aggregate_load_tv": 0.032797858099062924 + }, + "bos_at_s0": { + "tokens": 249, + "ordered_topk_exact_tokens": 135, + "set_exact_tokens": 168, + "mean_set_jaccard": 0.8995027729967489, + "mean_token_weighted_tv": 0.017494373131977266, + "aggregate_load_tv": 0.02744310575635877 + }, + "bos_at_s1": { + "tokens": 249, + "ordered_topk_exact_tokens": 126, + "set_exact_tokens": 159, + "mean_set_jaccard": 0.8924268502581755, + "mean_token_weighted_tv": 0.018484253784170353, + "aggregate_load_tv": 0.024765729585006693 + }, + "x_at_s0": { + "tokens": 249, + "ordered_topk_exact_tokens": 130, + "set_exact_tokens": 161, + "mean_set_jaccard": 0.8914706444826926, + "mean_token_weighted_tv": 0.018652892802434273, + "aggregate_load_tv": 0.03012048192771085 + }, + "x_at_s1": { + "tokens": 249, + "ordered_topk_exact_tokens": 116, + "set_exact_tokens": 155, + "mean_set_jaccard": 0.8830560336584433, + "mean_token_weighted_tv": 0.021738237282448267, + "aggregate_load_tv": 0.03681392235609103 + }, + "period_at_s0": { + "tokens": 249, + "ordered_topk_exact_tokens": 126, + "set_exact_tokens": 162, + "mean_set_jaccard": 0.8924268502581756, + "mean_token_weighted_tv": 0.018701364054348336, + "aggregate_load_tv": 0.02744310575635877 + }, + "period_at_s1": { + "tokens": 249, + "ordered_topk_exact_tokens": 114, + "set_exact_tokens": 155, + "mean_set_jaccard": 0.8854465480971505, + "mean_token_weighted_tv": 0.021117457386899186, + "aggregate_load_tv": 0.03212851405622492 + } + } + }, + "layer_22": { + "layer": 22, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "d5f3692dc47e2558627bcaf5dd3e32f8173bc3f9358a2151b0e255a68e2b26c8", + "route_weight_sha256": "9af709780f08e49f4bcc779a6f110071b25605a6797f9633c3f2c7c3f510af56", + "loads": [ + 21, + 13, + 2, + 27, + 24, + 6, + 17, + 34, + 61, + 5, + 13, + 20, + 50, + 59, + 15, + 18, + 45, + 33, + 34, + 23, + 15, + 10, + 17, + 18, + 16, + 45, + 30, + 17, + 30, + 18, + 18, + 27, + 13, + 1, + 3, + 8, + 40, + 12, + 41, + 0, + 19, + 21, + 14, + 24, + 7, + 12, + 16, + 15, + 33, + 21, + 9, + 28, + 10, + 47, + 9, + 33, + 37, + 87, + 29, + 54, + 10, + 46, + 5, + 9 + ], + "weighted_loads": [ + 2.124510081484914, + 0.47148508951067924, + 0.11088447272777557, + 2.6093292478471994, + 1.8275552168488503, + 0.2019041981548071, + 2.1082552168518305, + 2.677073396742344, + 2.492198146879673, + 0.20172004774212837, + 0.6600913219153881, + 1.4314090441912413, + 2.60510840266943, + 3.639658533036709, + 0.6133892573416233, + 0.62926434725523, + 2.6443148143589497, + 1.8396074771881104, + 1.8226985596120358, + 0.8552737571299076, + 0.7122545093297958, + 0.6513659134507179, + 0.5917524937540293, + 0.8827307913452387, + 0.7066354416310787, + 2.8790548108518124, + 1.2618203163146973, + 0.5080423355102539, + 1.933963619172573, + 0.7761735673993826, + 0.6286622025072575, + 1.5527015142142773, + 0.5455426555126905, + 0.028547000139951706, + 0.13689368218183517, + 0.33249750547111034, + 2.5574252605438232, + 0.4038273636251688, + 3.133777003735304, + 0.0, + 0.8784254379570484, + 1.4023088403046131, + 0.7769788503646851, + 1.419439721852541, + 0.27375978603959084, + 0.43465051986277103, + 0.9217085056006908, + 0.8049108665436506, + 1.856066083535552, + 2.532440260052681, + 0.4956079088151455, + 2.2174337804317474, + 0.5213693901896477, + 1.7829598300158978, + 0.34317895770072937, + 1.811070255935192, + 2.636858932673931, + 6.902476271614432, + 1.4828810282051563, + 4.123832376673818, + 0.8322925008833408, + 2.004723235964775, + 0.14243876747787, + 0.3201111163944006 + ], + "unique_experts": 63, + "load_cv": 0.7116068476549948, + "normalized_load_entropy": 0.9422793395522663, + "max_load_share": 0.05823293172690763 + }, + "full_input": { + "tokens": 274, + "top_k": 6, + "decisions": 1644, + "ordered_route_sha256": "cf1f8173fad7612879653e951d58b4105b2ea04f2416b5e4503740a572973fed", + "route_weight_sha256": "9f3c9a1b8b0492ab3d2bad8d29f28d30b1789607e19b4e3a7dc5b1c5eb5adeef", + "loads": [ + 25, + 14, + 4, + 37, + 24, + 8, + 21, + 35, + 75, + 10, + 13, + 23, + 50, + 59, + 20, + 18, + 45, + 35, + 34, + 23, + 15, + 17, + 18, + 18, + 16, + 47, + 30, + 23, + 30, + 18, + 18, + 27, + 16, + 6, + 4, + 12, + 40, + 13, + 41, + 0, + 23, + 22, + 20, + 24, + 7, + 13, + 16, + 15, + 35, + 23, + 14, + 28, + 10, + 50, + 9, + 47, + 42, + 89, + 29, + 54, + 18, + 54, + 5, + 15 + ], + "weighted_loads": [ + 2.298046847805381, + 0.521780114620924, + 0.1863911859691143, + 4.558572230860591, + 1.8275552168488503, + 0.27366145979613066, + 2.344118993729353, + 2.7477272376418114, + 3.7625412736088037, + 0.3899371139705181, + 0.6600913219153881, + 1.5233442690223455, + 2.60510840266943, + 3.639658533036709, + 1.223071372602135, + 0.62926434725523, + 2.6443148143589497, + 1.90277442894876, + 1.8226985596120358, + 0.8552737571299076, + 0.7122545093297958, + 1.2234019059687853, + 0.6225160378962755, + 0.8827307913452387, + 0.7066354416310787, + 2.938784673810005, + 1.2618203163146973, + 0.7748673260211945, + 1.933963619172573, + 0.7761735673993826, + 0.6286622025072575, + 1.5527015142142773, + 0.6193935857154429, + 0.20270692184567451, + 0.20259448140859604, + 0.4843736831098795, + 2.5574252605438232, + 0.4477401655167341, + 3.133777003735304, + 0.0, + 1.077197827398777, + 1.4439518749713898, + 1.2266140170395374, + 1.419439721852541, + 0.27375978603959084, + 0.46758694387972355, + 0.9217085056006908, + 0.8049108665436506, + 1.9531342294067144, + 2.716887041926384, + 0.7274452969431877, + 2.2174337804317474, + 0.5213693901896477, + 1.922100257128477, + 0.34317895770072937, + 2.9691826747730374, + 2.8542578648775816, + 6.97420958429575, + 1.4828810282051563, + 4.123832376673818, + 1.8546212278306484, + 2.286727424710989, + 0.14243876747787, + 0.5405320525169373 + ], + "unique_experts": 63, + "load_cv": 0.6676383066241838, + "normalized_load_entropy": 0.9501778571922355, + "max_load_share": 0.054136253041362534 + } + }, + "s1_eos": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "379350c06437186f2e638bede03e321c036284a8c7759d62344e4d28b8b57141", + "route_weight_sha256": "31306d44cd951120a8f8ad7835744c6a424e0741bdc033b85172412322a6a590", + "loads": [ + 21, + 14, + 3, + 26, + 24, + 7, + 17, + 34, + 62, + 6, + 13, + 19, + 49, + 59, + 14, + 16, + 45, + 32, + 34, + 24, + 13, + 10, + 16, + 18, + 16, + 45, + 28, + 15, + 30, + 16, + 18, + 27, + 14, + 1, + 4, + 9, + 42, + 14, + 42, + 1, + 19, + 21, + 13, + 23, + 7, + 11, + 17, + 16, + 33, + 21, + 10, + 28, + 12, + 45, + 11, + 34, + 38, + 86, + 27, + 54, + 10, + 48, + 4, + 8 + ], + "weighted_loads": [ + 2.113036595284939, + 0.4993492476642132, + 0.12987341172993183, + 2.563787743449211, + 1.838796280324459, + 0.22429652139544487, + 2.0990061070770025, + 2.648846600204706, + 2.5207920018583536, + 0.23469647765159607, + 0.6583181116729975, + 1.3999116998165846, + 2.563299186527729, + 3.6382506545633078, + 0.5712099764496088, + 0.5657633189111948, + 2.624923273921013, + 1.810011737048626, + 1.811503341421485, + 0.8890365045517683, + 0.6631891373544931, + 0.6267787851393223, + 0.5546627342700958, + 0.9083820730447769, + 0.7106975875794888, + 2.8973608128726482, + 1.218596251681447, + 0.4558839425444603, + 1.9177749045193195, + 0.7039057351648808, + 0.6499652285128832, + 1.5520073156803846, + 0.5735145974904299, + 0.028817707672715187, + 0.17699816077947617, + 0.3729721140116453, + 2.610973844304681, + 0.44521852023899555, + 3.1576016694307327, + 0.03550732880830765, + 0.89258998259902, + 1.399503830820322, + 0.7546324320137501, + 1.3929184358567, + 0.2613260746002197, + 0.393950741738081, + 0.9368089959025383, + 0.8553863391280174, + 1.8575982823967934, + 2.533439241349697, + 0.5341795068234205, + 2.2255064472556114, + 0.578403901308775, + 1.7086782082915306, + 0.4264638163149357, + 1.8658743649721146, + 2.6435428112745285, + 6.905511388555169, + 1.428122280165553, + 4.105927621945739, + 0.819156389683485, + 2.0426680706441402, + 0.11061783507466316, + 0.2889332380145788 + ], + "unique_experts": 64, + "load_cv": 0.7074038762389745, + "normalized_load_entropy": 0.9440428600682162, + "max_load_share": 0.05756358768406961 + }, + "full_input": { + "tokens": 290, + "top_k": 6, + "decisions": 1740, + "ordered_route_sha256": "a9f75450c71d7621b329247e0360627dd52c60df58d4b35bb2024e416fdaff48", + "route_weight_sha256": "04bb2dd5ec9a5c4d43902e7911dd9b6af2d71702c263655e20b1c662629a3f11", + "loads": [ + 24, + 20, + 3, + 38, + 24, + 9, + 23, + 35, + 83, + 15, + 13, + 25, + 52, + 59, + 19, + 20, + 48, + 36, + 35, + 24, + 14, + 22, + 17, + 18, + 16, + 46, + 28, + 20, + 31, + 16, + 19, + 27, + 16, + 10, + 10, + 16, + 44, + 15, + 42, + 2, + 30, + 23, + 19, + 25, + 7, + 11, + 18, + 18, + 35, + 24, + 22, + 31, + 18, + 47, + 11, + 55, + 43, + 87, + 29, + 54, + 24, + 58, + 5, + 12 + ], + "weighted_loads": [ + 2.264637853950262, + 0.9946993999183178, + 0.12987341172993183, + 4.768970252946019, + 1.838796280324459, + 0.29145336616784334, + 2.4134760973975062, + 2.691185675561428, + 4.344522811472416, + 0.7095734104514122, + 0.6583181116729975, + 1.7615326270461082, + 2.7029771469533443, + 3.6382506545633078, + 1.1420268137007952, + 0.7996130492538214, + 2.767700307071209, + 1.9347987473011017, + 1.8512815218418837, + 0.8890365045517683, + 0.7123246397823095, + 1.6313227489590645, + 0.5979436784982681, + 0.9083820730447769, + 0.7106975875794888, + 2.922907631844282, + 1.218596251681447, + 0.6674517672508955, + 2.0008066855371, + 0.7039057351648808, + 0.710632799193263, + 1.5520073156803846, + 0.6287699150852859, + 0.3515471275895834, + 0.4627363719046116, + 0.663059888407588, + 2.700625853613019, + 0.4906873609870672, + 3.1576016694307327, + 0.08212419599294662, + 1.582450743764639, + 1.471443122252822, + 1.2573590017855167, + 1.5264022070914507, + 0.2613260746002197, + 0.393950741738081, + 0.9727082997560501, + 0.9262197054922581, + 1.95339023321867, + 3.0256222411990166, + 1.0937380511313677, + 2.4286349304020405, + 1.1707917526364326, + 1.8013932593166828, + 0.4264638163149357, + 3.607254782691598, + 2.9210100695490837, + 6.94661926291883, + 1.4788836101070046, + 4.105927621945739, + 2.6494365222752094, + 2.469939475879073, + 0.13870751671493053, + 0.47404018230736256 + ], + "unique_experts": 64, + "load_cv": 0.6342120028659223, + "normalized_load_entropy": 0.9558458183174838, + "max_load_share": 0.05 + } + }, + "s0_bos": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "99ae3b8bc81f5d352b6ff73c2430109365b02afdf90c1835f59f43ca85ece40e", + "route_weight_sha256": "c1cce96c0af2c65760c55a603d769440cc56a32aa6467784eadd57375cd44eeb", + "loads": [ + 21, + 16, + 2, + 27, + 25, + 6, + 17, + 35, + 68, + 6, + 14, + 19, + 50, + 61, + 13, + 19, + 46, + 29, + 33, + 27, + 14, + 11, + 12, + 19, + 16, + 44, + 27, + 16, + 30, + 18, + 15, + 24, + 11, + 1, + 3, + 10, + 41, + 13, + 42, + 1, + 19, + 21, + 14, + 27, + 8, + 16, + 15, + 16, + 31, + 20, + 10, + 29, + 9, + 46, + 11, + 25, + 39, + 87, + 28, + 54, + 10, + 45, + 4, + 8 + ], + "weighted_loads": [ + 2.173167360946536, + 0.5495569929480553, + 0.11508279666304588, + 2.6375043466687202, + 1.8589197769761086, + 0.19618291221559048, + 2.1104534082114697, + 2.6327307298779488, + 2.7972000874578953, + 0.22922200709581375, + 0.6985744778066874, + 1.3500637579709291, + 2.604379065334797, + 3.7195401825010777, + 0.5611677095293999, + 0.6653502713888884, + 2.646935548633337, + 1.7443850561976433, + 1.808930441737175, + 0.9810627847909927, + 0.6656865701079369, + 0.6683850213885307, + 0.42423029989004135, + 0.9242527615278959, + 0.6807668153196573, + 2.8196605667471886, + 1.1800169050693512, + 0.49794809706509113, + 1.920061057433486, + 0.7462739888578653, + 0.5259409714490175, + 1.4573090374469757, + 0.45878864265978336, + 0.02732989564538002, + 0.1410933881998062, + 0.4046872090548277, + 2.59363828971982, + 0.4187751431018114, + 3.176065865904093, + 0.030126845464110374, + 0.8813622687011957, + 1.4037119876593351, + 0.7809283565729856, + 1.5334572326391935, + 0.3064339905977249, + 0.568662017583847, + 0.8929755929857492, + 0.8465190622955561, + 1.7365873716771603, + 2.4804174415767193, + 0.541200514882803, + 2.2451083697378635, + 0.4920153673738241, + 1.7417440582066774, + 0.4008982330560684, + 1.39525474794209, + 2.6695642601698637, + 6.8932644464075565, + 1.4689331222325563, + 4.126809272915125, + 0.8444364927709103, + 2.0814952831715345, + 0.11344170197844505, + 0.2868307791650295 + ], + "unique_experts": 64, + "load_cv": 0.7206159332978573, + "normalized_load_entropy": 0.9423805435845455, + "max_load_share": 0.05823293172690763 + }, + "full_input": { + "tokens": 274, + "top_k": 6, + "decisions": 1644, + "ordered_route_sha256": "6756c1927b677568ada974f7d955b6aadb159c9663a63ed1cffe40aaa5402c5e", + "route_weight_sha256": "d7aa2acd3277d90af32d398b174504218a61cd5d2eb7709c0257bacea57dbc87", + "loads": [ + 25, + 16, + 4, + 36, + 25, + 7, + 21, + 36, + 82, + 11, + 15, + 22, + 50, + 61, + 15, + 20, + 46, + 31, + 33, + 27, + 14, + 18, + 13, + 19, + 17, + 46, + 27, + 23, + 30, + 18, + 15, + 24, + 13, + 8, + 4, + 13, + 41, + 15, + 42, + 1, + 23, + 22, + 20, + 27, + 8, + 17, + 15, + 16, + 34, + 22, + 13, + 29, + 9, + 48, + 11, + 38, + 44, + 90, + 28, + 54, + 19, + 53, + 4, + 16 + ], + "weighted_loads": [ + 2.346704127267003, + 0.5495569929480553, + 0.1905895099043846, + 3.698659148067236, + 1.8589197769761086, + 0.20874958392232656, + 2.380066394805908, + 3.5568205192685127, + 4.056247567757964, + 0.4174390733242035, + 0.7126958481967449, + 1.4591136518865824, + 2.604379065334797, + 3.7195401825010777, + 1.0334522500634193, + 0.709533991292119, + 2.646935548633337, + 1.8200011271983385, + 1.808930441737175, + 0.9810627847909927, + 0.6656865701079369, + 1.24785272218287, + 0.4549938440322876, + 0.9242527615278959, + 0.6849984033033252, + 2.8793904297053814, + 1.1800169050693512, + 0.7670548316091299, + 1.920061057433486, + 0.7462739888578653, + 0.5259409714490175, + 1.4573090374469757, + 0.5261044558137655, + 0.2647640388458967, + 0.20679418742656708, + 0.5371054355055094, + 2.59363828971982, + 0.5103111211210489, + 3.176065865904093, + 0.030126845464110374, + 1.0809594448655844, + 1.4381938111037016, + 1.1577214836142957, + 1.5334572326391935, + 0.3064339905977249, + 0.6015984416007996, + 0.8929755929857492, + 0.8465190622955561, + 1.933358859270811, + 2.615992515347898, + 0.6922042556107044, + 2.2451083697378635, + 0.4920153673738241, + 1.8245093580335379, + 0.4008982330560684, + 2.5345427244901657, + 2.8964155055582523, + 6.982844696845859, + 1.4689331222325563, + 4.126809272915125, + 1.9596679918467999, + 2.3634994719177485, + 0.11344170197844505, + 0.613086337223649 + ], + "unique_experts": 64, + "load_cv": 0.6751506973952712, + "normalized_load_entropy": 0.9505814865090971, + "max_load_share": 0.05474452554744526 + } + }, + "s1_bos": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "dd90c5980583a677cd2428f516fc9a09e96970639d60bf900c3440de4379f4d6", + "route_weight_sha256": "b67847295774016c12c96d184064f3b0f7012ab8892e4b97551d4bd155acef84", + "loads": [ + 21, + 12, + 2, + 27, + 26, + 7, + 16, + 35, + 66, + 5, + 13, + 19, + 48, + 61, + 15, + 18, + 44, + 29, + 35, + 28, + 11, + 11, + 12, + 19, + 16, + 44, + 26, + 15, + 30, + 16, + 17, + 24, + 11, + 1, + 3, + 7, + 43, + 12, + 42, + 1, + 19, + 20, + 14, + 25, + 8, + 15, + 13, + 15, + 35, + 21, + 10, + 29, + 9, + 45, + 12, + 35, + 40, + 87, + 29, + 54, + 10, + 47, + 5, + 9 + ], + "weighted_loads": [ + 2.0988505631685257, + 0.4242579974234104, + 0.10726726800203323, + 2.5820409171283245, + 1.8882559817284346, + 0.2301391251385212, + 2.093937996774912, + 2.640834040939808, + 2.76266398280859, + 0.18301058001816273, + 0.661777637898922, + 1.370386341586709, + 2.5027218386530876, + 3.754470119252801, + 0.6261740494519472, + 0.6334532182663679, + 2.56899574957788, + 1.7278906591236591, + 1.8394952453672886, + 1.0016564149409533, + 0.566444268450141, + 0.6349164843559265, + 0.42557048238813877, + 0.9392704758793116, + 0.6995401121675968, + 2.827894862741232, + 1.1664540451020002, + 0.4631833992898464, + 1.919758865609765, + 0.6757354456931353, + 0.5874134637415409, + 1.4720541182905436, + 0.4688064269721508, + 0.030727170407772064, + 0.14766604453325272, + 0.31333649903535843, + 2.652873456478119, + 0.39650274626910686, + 3.173629144206643, + 0.03487524762749672, + 0.8941129092127085, + 1.3718112856149673, + 0.767987446859479, + 1.4672816470265388, + 0.30065764114260674, + 0.5302443560212851, + 0.7933644093573093, + 0.8177699856460094, + 1.816216530278325, + 2.4884664937853813, + 0.5709296371787786, + 2.2759787663817406, + 0.4840714540332556, + 1.730457728728652, + 0.4605495724827051, + 1.7751311268657446, + 2.693045200780034, + 7.0310624577105045, + 1.5158124044537544, + 4.100740861147642, + 0.8373606204986572, + 2.1148072499781847, + 0.14328354597091675, + 0.3325477372854948 + ], + "unique_experts": 64, + "load_cv": 0.7264809988070191, + "normalized_load_entropy": 0.9409581557813315, + "max_load_share": 0.05823293172690763 + }, + "full_input": { + "tokens": 290, + "top_k": 6, + "decisions": 1740, + "ordered_route_sha256": "5ceffb957eec414127b0a35c8666ecf9ae2af252dac98618e8f0873a4012becf", + "route_weight_sha256": "8f5bb0a8d414f7d893b5547b03c9633bc75cbbf04577745a485ac5298662eac4", + "loads": [ + 24, + 17, + 2, + 38, + 26, + 8, + 21, + 36, + 88, + 14, + 13, + 25, + 51, + 61, + 19, + 23, + 47, + 33, + 36, + 28, + 12, + 23, + 13, + 19, + 16, + 45, + 26, + 22, + 31, + 16, + 17, + 24, + 12, + 10, + 9, + 15, + 45, + 14, + 42, + 2, + 30, + 22, + 20, + 27, + 8, + 15, + 14, + 17, + 39, + 24, + 20, + 32, + 14, + 49, + 12, + 55, + 45, + 88, + 30, + 54, + 25, + 57, + 6, + 14 + ], + "weighted_loads": [ + 2.250451821833849, + 0.8797277957201004, + 0.10726726800203323, + 3.8851898666471243, + 1.8882559817284346, + 0.24270579684525728, + 2.416818540543318, + 2.6831731162965298, + 4.613537138327956, + 0.6578875128179789, + 0.661777637898922, + 1.7457696795463562, + 2.642399799078703, + 3.754470119252801, + 1.1506451610475779, + 0.9106569644063711, + 2.711772782728076, + 1.8640036322176456, + 1.8792734257876873, + 1.0016564149409533, + 0.6155797708779573, + 1.6382224522531033, + 0.4688514266163111, + 0.9392704758793116, + 0.6995401121675968, + 2.853441681712866, + 1.1664540451020002, + 0.7673401478677988, + 2.0027906466275454, + 0.6757354456931353, + 0.5874134637415409, + 1.4720541182905436, + 0.5179831124842167, + 0.3534565903246403, + 0.43340425565838814, + 0.6566291972994804, + 2.742525465786457, + 0.48726717568933964, + 3.173629144206643, + 0.0814921148121357, + 1.5905260052531958, + 1.4375040102750063, + 1.2551260758191347, + 1.6007654182612896, + 0.30065764114260674, + 0.5302443560212851, + 0.8292637132108212, + 0.8886033520102501, + 2.0822485517710447, + 3.0293656289577484, + 1.0561033338308334, + 2.4791072495281696, + 1.0335595663636923, + 1.9010870773345232, + 0.4605495724827051, + 3.4991308245807886, + 2.974046902731061, + 7.092393461614847, + 1.5615120008587837, + 4.100740861147642, + 2.784821830689907, + 2.5420786552131176, + 0.17137322761118412, + 0.5846169088035822 + ], + "unique_experts": 64, + "load_cv": 0.655680383841894, + "normalized_load_entropy": 0.9530802770668629, + "max_load_share": 0.05057471264367816 + } + }, + "s0_x": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "791c8d5c4ac89fa7aa0c9777275208213f3301e6c8722f09465c60efdf3e93c5", + "route_weight_sha256": "15171961ce64f6c4ca0746ba7418cc09b4bdfe3a93c10e94f8db8b89605b56a8", + "loads": [ + 23, + 14, + 2, + 27, + 26, + 6, + 17, + 36, + 59, + 7, + 14, + 20, + 50, + 60, + 16, + 18, + 45, + 31, + 33, + 24, + 12, + 10, + 16, + 19, + 16, + 44, + 28, + 21, + 30, + 18, + 16, + 24, + 13, + 1, + 3, + 9, + 41, + 13, + 44, + 0, + 19, + 21, + 12, + 27, + 8, + 12, + 13, + 15, + 33, + 22, + 10, + 27, + 9, + 43, + 10, + 28, + 39, + 85, + 29, + 54, + 10, + 48, + 4, + 10 + ], + "weighted_loads": [ + 2.199260324239731, + 0.4925015289336443, + 0.10740610957145691, + 2.618227882310748, + 1.878967149183154, + 0.19988800212740898, + 2.109425475820899, + 2.7332940194755793, + 2.422516144812107, + 0.2707727365195751, + 0.7138243056833744, + 1.382141187787056, + 2.5847743786871433, + 3.674956386908889, + 0.6330551188439131, + 0.6109745800495148, + 2.6255579255521297, + 1.8080729991197586, + 1.8038912620395422, + 0.8605705872178078, + 0.6076242998242378, + 0.6205397844314575, + 0.5633413102477789, + 0.92334627173841, + 0.6891682744026184, + 2.838649535551667, + 1.2196060381829739, + 0.6350743472576141, + 1.9400359094142914, + 0.7469654064625502, + 0.5305799636989832, + 1.4475237764418125, + 0.5375933907926083, + 0.02782917208969593, + 0.144541684538126, + 0.3870386704802513, + 2.5924182292073965, + 0.42263516783714294, + 3.252950696274638, + 0.0, + 0.8834338244050741, + 1.4223084319382906, + 0.7255331035703421, + 1.5549337696284056, + 0.294227397069335, + 0.41283384896814823, + 0.8299271408468485, + 0.8262727595865726, + 1.806462423875928, + 2.5490918830037117, + 0.5413301885128021, + 2.1809044927358627, + 0.4823747742921114, + 1.643674535676837, + 0.40688939206302166, + 1.5781041271984577, + 2.689945340156555, + 6.953293971717358, + 1.498764805495739, + 4.123769177123904, + 0.8176894523203373, + 2.1346161123365164, + 0.11150339990854263, + 0.3837227374315262 + ], + "unique_experts": 63, + "load_cv": 0.7029310792208248, + "normalized_load_entropy": 0.9434472625886624, + "max_load_share": 0.05689424364123159 + }, + "full_input": { + "tokens": 274, + "top_k": 6, + "decisions": 1644, + "ordered_route_sha256": "80bc689de5888d806f80def2b274a6d047b765666e81b4b184db2f052c518ed4", + "route_weight_sha256": "696f50a44b421c270a05dda237afa4205a7aecf297b119c363aa4a062a58c4ed", + "loads": [ + 27, + 15, + 4, + 37, + 26, + 8, + 22, + 36, + 72, + 13, + 14, + 22, + 50, + 60, + 19, + 18, + 45, + 34, + 33, + 24, + 12, + 18, + 17, + 19, + 16, + 46, + 28, + 25, + 30, + 18, + 17, + 24, + 15, + 8, + 4, + 12, + 41, + 14, + 44, + 0, + 23, + 22, + 18, + 27, + 8, + 13, + 13, + 15, + 34, + 24, + 15, + 27, + 9, + 45, + 10, + 43, + 44, + 87, + 29, + 54, + 18, + 57, + 4, + 18 + ], + "weighted_loads": [ + 2.372797090560198, + 0.5349249038845301, + 0.18291282281279564, + 3.7735903058201075, + 1.878967149183154, + 0.24721300695091486, + 2.442090755328536, + 2.7332940194755793, + 3.646563222631812, + 0.49031131714582443, + 0.7138243056833744, + 1.4499522596597672, + 2.5847743786871433, + 3.674956386908889, + 1.1819377597421408, + 0.6109745800495148, + 2.6255579255521297, + 1.9051743987947702, + 1.8038912620395422, + 0.8605705872178078, + 0.6076242998242378, + 1.2683806661516428, + 0.5941048543900251, + 0.92334627173841, + 0.6891682744026184, + 2.89837939850986, + 1.2196060381829739, + 0.7954328209161758, + 1.9400359094142914, + 0.7469654064625502, + 0.5722986217588186, + 1.4475237764418125, + 0.6049092039465904, + 0.2874176111072302, + 0.21024248376488686, + 0.5013480000197887, + 2.5924182292073965, + 0.46351858600974083, + 3.252950696274638, + 0.0, + 1.0885342080146074, + 1.4601318631321192, + 1.1966235768049955, + 1.5549337696284056, + 0.294227397069335, + 0.44577027298510075, + 0.8299271408468485, + 0.8262727595865726, + 1.8591747973114252, + 2.800284929573536, + 0.7871827445924282, + 2.1809044927358627, + 0.4823747742921114, + 1.7228199038654566, + 0.40688939206302166, + 2.9218873362988234, + 2.9178842436522245, + 7.0302311312407255, + 1.498764805495739, + 4.123769177123904, + 1.8725746907293797, + 2.4723852556198835, + 0.11150339990854263, + 0.6691270042210817 + ], + "unique_experts": 63, + "load_cv": 0.6556128007576267, + "normalized_load_entropy": 0.9516096590033977, + "max_load_share": 0.05291970802919708 + } + }, + "s1_x": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "0b7aec7f0da4430984b7ab17f0c1de5d3deb7c936aabe3c668984d61cd06c4f1", + "route_weight_sha256": "0cf6eb5833efd2273186be434885c8a9e625457147e006cf95a7f7cbdfe39595", + "loads": [ + 22, + 11, + 2, + 27, + 25, + 6, + 16, + 35, + 69, + 5, + 14, + 19, + 49, + 60, + 14, + 15, + 45, + 30, + 33, + 27, + 10, + 10, + 11, + 19, + 16, + 46, + 24, + 15, + 31, + 16, + 17, + 24, + 13, + 1, + 5, + 9, + 43, + 13, + 43, + 1, + 19, + 21, + 14, + 24, + 7, + 8, + 13, + 14, + 33, + 20, + 9, + 29, + 8, + 47, + 8, + 39, + 38, + 89, + 27, + 54, + 10, + 57, + 6, + 9 + ], + "weighted_loads": [ + 2.1684216372668743, + 0.38761583156883717, + 0.11094145104289055, + 2.5783852338790894, + 1.8403664082288742, + 0.19801214337348938, + 2.0681912638247013, + 2.5895525068044662, + 2.8993238359689713, + 0.19159268960356712, + 0.6918422225862741, + 1.348807878792286, + 2.5435307696461678, + 3.693350378423929, + 0.5535056293010712, + 0.5279236547648907, + 2.603175852447748, + 1.7531672809273005, + 1.7802898697555065, + 0.9651852250099182, + 0.5103195495903492, + 0.5648925863206387, + 0.4012030642479658, + 0.928642001003027, + 0.7240747176110744, + 2.947704005986452, + 1.087964816018939, + 0.43843010626733303, + 1.9406519178301096, + 0.6515720188617706, + 0.5812392309308052, + 1.4454401526600122, + 0.5328224450349808, + 0.02810419350862503, + 0.23458439111709595, + 0.3944605179131031, + 2.6264351420104504, + 0.4162645898759365, + 3.200626887381077, + 0.04016512259840965, + 0.9136563874781132, + 1.3771913591772318, + 0.7691158447414637, + 1.4305626172572374, + 0.2590811252593994, + 0.2789118103682995, + 0.7672397084534168, + 0.7903661523014307, + 1.7229279596358538, + 2.4771770127117634, + 0.5182336308062077, + 2.2780398577451706, + 0.45313306152820587, + 1.7500948067754507, + 0.3222889192402363, + 2.0531613882631063, + 2.602597301825881, + 7.19303192012012, + 1.4523357842117548, + 4.081962516531348, + 0.7661948502063751, + 2.699924360960722, + 0.1671962682157755, + 0.33778620697557926 + ], + "unique_experts": 64, + "load_cv": 0.7570952806007509, + "normalized_load_entropy": 0.9369942342407965, + "max_load_share": 0.059571619812583666 + }, + "full_input": { + "tokens": 290, + "top_k": 6, + "decisions": 1740, + "ordered_route_sha256": "246f60a82a2a1c34c0d5b97aa295eb45655fc3c369a7168ec4a10252e4818235", + "route_weight_sha256": "33bc57761daf6147e113b308a3a0dbffd78f4d4a5f95086aec80aa8e7e0989a0", + "loads": [ + 25, + 16, + 2, + 39, + 25, + 7, + 23, + 36, + 91, + 15, + 14, + 24, + 52, + 60, + 18, + 19, + 48, + 34, + 34, + 27, + 11, + 23, + 12, + 19, + 16, + 47, + 24, + 18, + 32, + 16, + 17, + 24, + 15, + 10, + 11, + 15, + 45, + 14, + 43, + 2, + 31, + 23, + 20, + 26, + 7, + 8, + 14, + 16, + 35, + 23, + 20, + 32, + 13, + 50, + 8, + 63, + 43, + 90, + 28, + 54, + 24, + 69, + 7, + 13 + ], + "weighted_loads": [ + 2.3200228959321976, + 0.8430856298655272, + 0.11094145104289055, + 3.9622121583670378, + 1.8403664082288742, + 0.21057881508022547, + 2.448474459350109, + 2.631891582161188, + 4.74176880158484, + 0.711863785982132, + 0.6918422225862741, + 1.6908090095967054, + 2.683208730071783, + 3.693350378423929, + 1.208730436861515, + 0.7617733851075172, + 2.7459528855979443, + 1.8872674908488989, + 1.8200680501759052, + 0.9651852250099182, + 0.5594550520181656, + 1.6562400236725807, + 0.4444840084761381, + 0.928642001003027, + 0.7240747176110744, + 2.973250824958086, + 1.087964816018939, + 0.5466097109019756, + 2.02368369884789, + 0.6515720188617706, + 0.5812392309308052, + 1.4454401526600122, + 0.61002460680902, + 0.35083361342549324, + 0.5203226022422314, + 0.6285483408719301, + 2.7160871513187885, + 0.4532705657184124, + 3.200626887381077, + 0.08678198978304863, + 1.6503889821469784, + 1.4428961612284184, + 1.324429353699088, + 1.5640463884919882, + 0.2590811252593994, + 0.2789118103682995, + 0.8031390123069286, + 0.8611995186656713, + 1.8187199104577303, + 3.015640649944544, + 1.0650853533297777, + 2.4811683408915997, + 1.0026211738586426, + 1.8800766337662935, + 0.3222889192402363, + 4.12263492308557, + 2.8913448583334684, + 7.245226057246327, + 1.498035380616784, + 4.081962516531348, + 2.6387472301721573, + 3.2881356198340654, + 0.19528594985604286, + 0.517607131972909 + ], + "unique_experts": 64, + "load_cv": 0.6947817122606935, + "normalized_load_entropy": 0.9482245361020555, + "max_load_share": 0.052298850574712646 + } + }, + "s0_period": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "95a87c500c000ae8fe9930c9c9ab01391a3c0291067e1f1a3a091aa5d8e39caa", + "route_weight_sha256": "fc86630a179a6ff3cdd98c61d55c42a01ce14c94c7d73450e32dcc95e8e36af6", + "loads": [ + 22, + 15, + 3, + 27, + 28, + 6, + 17, + 36, + 60, + 5, + 14, + 20, + 50, + 58, + 14, + 18, + 45, + 29, + 33, + 23, + 13, + 11, + 17, + 20, + 15, + 45, + 27, + 20, + 30, + 18, + 17, + 24, + 11, + 1, + 4, + 9, + 41, + 13, + 44, + 0, + 19, + 20, + 12, + 27, + 8, + 14, + 14, + 15, + 32, + 22, + 9, + 30, + 9, + 45, + 10, + 28, + 40, + 85, + 29, + 54, + 10, + 44, + 6, + 9 + ], + "weighted_loads": [ + 2.1518358532339334, + 0.5148031041026115, + 0.14406588673591614, + 2.6297192964702845, + 1.9341192934662104, + 0.20436791330575943, + 2.104301979765296, + 2.7345397118479013, + 2.4333993680775166, + 0.19779374077916145, + 0.7129075713455677, + 1.3915001042187214, + 2.5915487613528967, + 3.5677667297422886, + 0.5675560925155878, + 0.6347210332751274, + 2.632632087916136, + 1.7548066414892673, + 1.7913161255419254, + 0.82906742580235, + 0.6454143486917019, + 0.672124270349741, + 0.590329147875309, + 0.9498881418257952, + 0.6674785669893026, + 2.8656330909579992, + 1.185412134975195, + 0.6003358718007803, + 1.9389443304389715, + 0.7514655329287052, + 0.5677350107580423, + 1.4441747404634953, + 0.4651469998061657, + 0.027787962928414345, + 0.19191817939281464, + 0.3941173907369375, + 2.6063534393906593, + 0.4264635182917118, + 3.2453238274902105, + 0.0, + 0.8838361892849207, + 1.3911650460213423, + 0.7241081893444061, + 1.5614354815334082, + 0.29333547316491604, + 0.4962046016007662, + 0.8429040089249611, + 0.8255341704934835, + 1.7729125916957855, + 2.541756000369787, + 0.5066507067531347, + 2.2936782613396645, + 0.47805434837937355, + 1.7004133109003305, + 0.40279784612357616, + 1.5612438190728426, + 2.7145653441548347, + 6.942202998325229, + 1.5007256418466568, + 4.122498603537679, + 0.8451556749641895, + 1.9415855258703232, + 0.1700256373733282, + 0.3443717025220394 + ], + "unique_experts": 63, + "load_cv": 0.699127209326985, + "normalized_load_entropy": 0.944346619096357, + "max_load_share": 0.05689424364123159 + }, + "full_input": { + "tokens": 274, + "top_k": 6, + "decisions": 1644, + "ordered_route_sha256": "c005e1553392a3f0c0e414a68b95198d245750d77e02e02576673ab3d1c7b0f1", + "route_weight_sha256": "ea1524f8340e48a8ee89e05916f5af587d72e1e20178c1fe406ed71ecc8b9b45", + "loads": [ + 26, + 16, + 6, + 36, + 28, + 7, + 21, + 36, + 73, + 10, + 14, + 22, + 50, + 58, + 18, + 18, + 45, + 31, + 33, + 23, + 13, + 19, + 18, + 20, + 15, + 47, + 27, + 26, + 30, + 19, + 17, + 24, + 13, + 6, + 5, + 13, + 41, + 14, + 44, + 0, + 24, + 21, + 18, + 27, + 8, + 15, + 14, + 15, + 34, + 23, + 15, + 30, + 9, + 49, + 10, + 42, + 45, + 87, + 29, + 54, + 19, + 52, + 6, + 16 + ], + "weighted_loads": [ + 2.3253726195544004, + 0.6102675870060921, + 0.24722697027027607, + 3.6970885898917913, + 1.9341192934662104, + 0.21693458501249552, + 2.365030264481902, + 2.7345397118479013, + 3.6664374861866236, + 0.3860108070075512, + 0.7129075713455677, + 1.4573564492166042, + 2.5915487613528967, + 3.5677667297422886, + 1.1485181394964457, + 0.6347210332751274, + 2.632632087916136, + 1.8363392110913992, + 1.7913161255419254, + 0.82906742580235, + 0.6454143486917019, + 1.3241032790392637, + 0.6210926920175552, + 0.9498881418257952, + 0.6674785669893026, + 2.925362953916192, + 1.185412134975195, + 0.8397184703499079, + 1.9389443304389715, + 0.7986934967339039, + 0.5677350107580423, + 1.4441747404634953, + 0.5324628129601479, + 0.20194788463413715, + 0.2576189786195755, + 0.5504151228815317, + 2.6063534393906593, + 0.4684484973549843, + 3.2453238274902105, + 0.0, + 1.1442436072975397, + 1.4282200429588556, + 1.1465518176555634, + 1.5614354815334082, + 0.29333547316491604, + 0.5291410256177187, + 0.8429040089249611, + 0.8255341704934835, + 1.8672056794166565, + 2.67319081351161, + 0.8285157550126314, + 2.2936782613396645, + 0.47805434837937355, + 1.88012888841331, + 0.40279784612357616, + 2.817276533693075, + 2.9439049046486616, + 7.018090911209583, + 1.5007256418466568, + 4.122498603537679, + 1.9455047734081745, + 2.223589714616537, + 0.1700256373733282, + 0.6097082030028105 + ], + "unique_experts": 63, + "load_cv": 0.6511187118086017, + "normalized_load_entropy": 0.9525268129897406, + "max_load_share": 0.05291970802919708 + } + }, + "s1_period": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "efb79c947da11a47fc2633e68dc5b3feda80c748a2f2a78381591a2cf5962c85", + "route_weight_sha256": "f705c778a2ecd9c59746dc83f7ea415c31bda92954aa96e46fa4df2906b40c3e", + "loads": [ + 23, + 13, + 2, + 28, + 25, + 5, + 18, + 34, + 63, + 4, + 12, + 19, + 47, + 60, + 15, + 17, + 45, + 29, + 34, + 25, + 12, + 10, + 11, + 20, + 17, + 45, + 24, + 15, + 30, + 14, + 19, + 24, + 11, + 1, + 6, + 9, + 42, + 13, + 42, + 1, + 19, + 20, + 14, + 23, + 7, + 9, + 14, + 15, + 32, + 20, + 11, + 29, + 9, + 51, + 11, + 35, + 39, + 88, + 30, + 54, + 10, + 55, + 5, + 10 + ], + "weighted_loads": [ + 2.179666005074978, + 0.45861627347767353, + 0.10546329617500305, + 2.644863622263074, + 1.82372853346169, + 0.17089455761015415, + 2.1661978401243687, + 2.579893823713064, + 2.628765657544136, + 0.16659007221460342, + 0.624284053221345, + 1.3568608555942774, + 2.4659120868891478, + 3.7347885202616453, + 0.5898960940539837, + 0.5805218741297722, + 2.5816992856562138, + 1.712528306990862, + 1.8067022748291492, + 0.9072249606251717, + 0.5857016108930111, + 0.5753334909677505, + 0.40450933016836643, + 0.949447376653552, + 0.7429139129817486, + 2.8966630212962627, + 1.0679682437330484, + 0.4380768071860075, + 1.9218361228704453, + 0.6061176247894764, + 0.6489734780043364, + 1.451170327141881, + 0.46674043871462345, + 0.028432415798306465, + 0.2571339700371027, + 0.37997808679938316, + 2.6071121115237474, + 0.41739280335605145, + 3.165893716737628, + 0.040707066655159, + 0.9357024282217026, + 1.3430566266179085, + 0.7629888616502285, + 1.4052723739296198, + 0.2702543642371893, + 0.30593406595289707, + 0.7778216041624546, + 0.81652807071805, + 1.6955177672207355, + 2.481086488813162, + 0.5571126770228148, + 2.293377608060837, + 0.47420080937445164, + 1.8902299106121063, + 0.41609602235257626, + 1.879967749118805, + 2.6216385308653116, + 7.109396658837795, + 1.560572151094675, + 4.07222655788064, + 0.7594995982944965, + 2.520472377538681, + 0.13737983256578445, + 0.3691687658429146 + ], + "unique_experts": 64, + "load_cv": 0.7348397773509993, + "normalized_load_entropy": 0.9400283675580832, + "max_load_share": 0.058902275769745646 + }, + "full_input": { + "tokens": 290, + "top_k": 6, + "decisions": 1740, + "ordered_route_sha256": "a797610571b9a3912def607c510251dedcadaa805ea9bb78c62700bb1407abc3", + "route_weight_sha256": "a0e8909f467c6f323760dee1da492978af936efe501d6144e40df6c4858baea5", + "loads": [ + 26, + 19, + 2, + 39, + 25, + 6, + 23, + 35, + 84, + 13, + 12, + 24, + 50, + 60, + 19, + 21, + 48, + 33, + 35, + 25, + 13, + 24, + 12, + 20, + 17, + 46, + 24, + 18, + 31, + 14, + 20, + 24, + 13, + 11, + 12, + 15, + 44, + 14, + 42, + 3, + 31, + 22, + 20, + 25, + 7, + 9, + 15, + 17, + 34, + 22, + 23, + 32, + 14, + 55, + 11, + 58, + 44, + 89, + 31, + 54, + 25, + 66, + 6, + 14 + ], + "weighted_loads": [ + 2.331267263740301, + 0.9640436377376318, + 0.10546329617500305, + 3.959240358322859, + 1.82372853346169, + 0.18346122931689024, + 2.469799667596817, + 2.622232899069786, + 4.427000036463141, + 0.6414670050144196, + 0.624284053221345, + 1.7073093131184578, + 2.605590047314763, + 3.7347885202616453, + 1.244643498212099, + 0.8143716044723988, + 2.72447631880641, + 1.8353561088442802, + 1.846480455249548, + 0.9072249606251717, + 0.6348371133208275, + 1.688149482011795, + 0.44779027439653873, + 0.949447376653552, + 0.7429139129817486, + 2.9222098402678967, + 1.0679682437330484, + 0.5360368080437183, + 2.0048679038882256, + 0.6061176247894764, + 0.6911055464297533, + 1.451170327141881, + 0.5538163278251886, + 0.3889868650585413, + 0.5428721811622381, + 0.6222318150103092, + 2.6967641208320856, + 0.4552160259336233, + 3.165893716737628, + 0.12836825847625732, + 1.688704278320074, + 1.4105553794652224, + 1.269851490855217, + 1.5387561451643705, + 0.2702543642371893, + 0.30593406595289707, + 0.8137209080159664, + 0.8873614370822906, + 1.791309718042612, + 2.933794680982828, + 1.179185252636671, + 2.496506091207266, + 1.0236889217048883, + 2.0808961130678654, + 0.41609602235257626, + 3.87259279191494, + 2.9139228258281946, + 7.1580228842794895, + 1.6062717474997044, + 4.07222655788064, + 2.662806276232004, + 2.9891400653868914, + 0.16546951420605183, + 0.553248193114996 + ], + "unique_experts": 64, + "load_cv": 0.6664565661799027, + "normalized_load_entropy": 0.9516472693235761, + "max_load_share": 0.051149425287356325 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 249, + "ordered_topk_exact_tokens": 157, + "set_exact_tokens": 189, + "mean_set_jaccard": 0.9294320137693632, + "mean_token_weighted_tv": 0.012715582129915795, + "aggregate_load_tv": 0.01740294511378848 + }, + "system_bos": { + "tokens": 249, + "ordered_topk_exact_tokens": 146, + "set_exact_tokens": 178, + "mean_set_jaccard": 0.9159495123350543, + "mean_token_weighted_tv": 0.014919164063162115, + "aggregate_load_tv": 0.02208835341365462 + }, + "system_x": { + "tokens": 249, + "ordered_topk_exact_tokens": 127, + "set_exact_tokens": 151, + "mean_set_jaccard": 0.8823866896156052, + "mean_token_weighted_tv": 0.021271033122776502, + "aggregate_load_tv": 0.03748326639892906 + }, + "system_period": { + "tokens": 249, + "ordered_topk_exact_tokens": 127, + "set_exact_tokens": 154, + "mean_set_jaccard": 0.8832472748135398, + "mean_token_weighted_tv": 0.02118063808220577, + "aggregate_load_tv": 0.03614457831325302 + }, + "bos_at_s0": { + "tokens": 249, + "ordered_topk_exact_tokens": 127, + "set_exact_tokens": 166, + "mean_set_jaccard": 0.9021801491681009, + "mean_token_weighted_tv": 0.018117084003326643, + "aggregate_load_tv": 0.03012048192771084 + }, + "bos_at_s1": { + "tokens": 249, + "ordered_topk_exact_tokens": 128, + "set_exact_tokens": 167, + "mean_set_jaccard": 0.8983553260661694, + "mean_token_weighted_tv": 0.018843895602357913, + "aggregate_load_tv": 0.02744310575635877 + }, + "x_at_s0": { + "tokens": 249, + "ordered_topk_exact_tokens": 137, + "set_exact_tokens": 164, + "mean_set_jaccard": 0.8990246701090073, + "mean_token_weighted_tv": 0.018240564577580696, + "aggregate_load_tv": 0.024096385542168676 + }, + "x_at_s1": { + "tokens": 249, + "ordered_topk_exact_tokens": 109, + "set_exact_tokens": 146, + "mean_set_jaccard": 0.8735895964811627, + "mean_token_weighted_tv": 0.023394566717516465, + "aggregate_load_tv": 0.03145917001338688 + }, + "period_at_s0": { + "tokens": 249, + "ordered_topk_exact_tokens": 136, + "set_exact_tokens": 166, + "mean_set_jaccard": 0.8997896347293938, + "mean_token_weighted_tv": 0.01821071377031535, + "aggregate_load_tv": 0.025435073627844723 + }, + "period_at_s1": { + "tokens": 249, + "ordered_topk_exact_tokens": 119, + "set_exact_tokens": 154, + "mean_set_jaccard": 0.8815261044176707, + "mean_token_weighted_tv": 0.02203828596835395, + "aggregate_load_tv": 0.028781793842034806 + } + } + }, + "layer_23": { + "layer": 23, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "aff904101d3fd5b28dc97cc7376f976809444f34874d685bb56dd08f31594548", + "route_weight_sha256": "50194b61a62873c1af1aa9b885d44a289b0485a46c146f6eb3da9dc339ce9c0c", + "loads": [ + 11, + 41, + 32, + 24, + 4, + 19, + 17, + 7, + 28, + 20, + 31, + 14, + 28, + 25, + 23, + 46, + 12, + 40, + 45, + 18, + 15, + 31, + 20, + 14, + 15, + 0, + 0, + 36, + 32, + 34, + 13, + 30, + 4, + 13, + 22, + 4, + 37, + 25, + 19, + 32, + 18, + 47, + 8, + 20, + 38, + 15, + 3, + 24, + 45, + 8, + 0, + 1, + 40, + 14, + 11, + 10, + 64, + 10, + 17, + 55, + 100, + 39, + 10, + 16 + ], + "weighted_loads": [ + 0.8034563660621643, + 3.115021076053381, + 1.6263537742197514, + 3.2909259032458067, + 0.1725999042391777, + 1.1949151083827019, + 1.241825994104147, + 0.25900906696915627, + 1.743049792945385, + 0.7361082825809717, + 1.544968143105507, + 0.6102159339934587, + 1.081734186038375, + 1.2562188412994146, + 2.1128147803246975, + 3.1303137745708227, + 1.377087939530611, + 2.486022349447012, + 2.5747162457555532, + 1.3437701910734177, + 0.5171168688684702, + 1.1065738629549742, + 1.6882940642535686, + 0.8835627101361752, + 0.5010172016918659, + 0.0, + 0.0, + 2.0361127573996782, + 2.239375237375498, + 2.1363149862736464, + 0.6262515112757683, + 1.6109765954315662, + 0.14020375907421112, + 0.42489086277782917, + 0.9208556339144707, + 0.1749999038875103, + 2.5000458024442196, + 0.9422623496502638, + 1.2394354082643986, + 1.7918854095041752, + 0.694397060200572, + 3.1457811146974564, + 0.3246246390044689, + 0.9388130083680153, + 2.9981333892792463, + 1.552339682355523, + 0.11562808230519295, + 2.81139019690454, + 3.064286358654499, + 0.2906988523900509, + 0.0, + 0.056403748691082, + 3.0421881526708603, + 0.6014428213238716, + 0.5913035180419683, + 0.43870193883776665, + 4.947981916368008, + 0.41781382262706757, + 0.6175038926303387, + 3.2613066025078297, + 8.022489983588457, + 2.867244653403759, + 0.47318981401622295, + 0.5555858556181192 + ], + "unique_experts": 61, + "load_cv": 0.7398562215196975, + "normalized_load_entropy": 0.9367073507728818, + "max_load_share": 0.06693440428380187 + }, + "full_input": { + "tokens": 274, + "top_k": 6, + "decisions": 1644, + "ordered_route_sha256": "8e13f24a6e1ae69c8a0896a09bfde05c006a642f422619ad66dce107441f0b3f", + "route_weight_sha256": "930a24914bc789e2b89b30559c90f659fe07f4de0cd9d8ac7ee0601ee64da5ee", + "loads": [ + 17, + 46, + 32, + 32, + 10, + 21, + 23, + 11, + 30, + 28, + 31, + 14, + 29, + 29, + 24, + 46, + 15, + 40, + 45, + 18, + 15, + 31, + 21, + 24, + 18, + 0, + 0, + 36, + 32, + 34, + 13, + 30, + 8, + 17, + 22, + 4, + 38, + 25, + 23, + 34, + 25, + 47, + 11, + 20, + 38, + 22, + 15, + 28, + 47, + 8, + 1, + 2, + 40, + 15, + 21, + 11, + 64, + 19, + 18, + 55, + 100, + 39, + 14, + 18 + ], + "weighted_loads": [ + 1.219679347006604, + 3.4381457567214966, + 1.6263537742197514, + 3.5338656012900174, + 0.44928557239472866, + 1.2473936048336327, + 1.6031925175338984, + 0.4250490255653858, + 1.7758963604574092, + 1.0141578111797571, + 1.544968143105507, + 0.6102159339934587, + 1.0918848365545273, + 1.4322432447224855, + 2.1861624009907246, + 3.1303137745708227, + 1.426543881651014, + 2.486022349447012, + 2.5747162457555532, + 1.3437701910734177, + 0.5171168688684702, + 1.1065738629549742, + 1.7069458849728107, + 2.16628685221076, + 0.6035343892872334, + 0.0, + 0.0, + 2.0361127573996782, + 2.239375237375498, + 2.1363149862736464, + 0.6262515112757683, + 1.6109765954315662, + 0.3548252135515213, + 0.7008890780853108, + 0.9208556339144707, + 0.1749999038875103, + 2.538919050246477, + 0.9422623496502638, + 1.398659243248403, + 1.8422814942896366, + 1.0155546553432941, + 3.1457811146974564, + 0.4050229713320732, + 0.9388130083680153, + 2.9981333892792463, + 3.61603762768209, + 1.1253608912229538, + 2.9528044641483575, + 3.1574423536658287, + 0.2906988523900509, + 0.0593707375228405, + 0.14988460391759872, + 3.0421881526708603, + 0.6358785033226013, + 1.5133161079138517, + 0.4732890762388706, + 4.947981916368008, + 1.389299064874649, + 0.6695120744407177, + 3.2613066025078297, + 8.022489983588457, + 2.867244653403759, + 0.5942475497722626, + 0.6728787403553724 + ], + "unique_experts": 62, + "load_cv": 0.6397823982878152, + "normalized_load_entropy": 0.9519019351472738, + "max_load_share": 0.06082725060827251 + } + }, + "s1_eos": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "f2f2773b3a03fe2f2c0554575c7465b812ce313f359bbacce26d88a1496a2a15", + "route_weight_sha256": "5a12b565e93c989e91b9ef6a8818f7da37e97ec49bbc2c848eaf46c4a99f11ca", + "loads": [ + 10, + 40, + 32, + 26, + 4, + 16, + 18, + 5, + 28, + 21, + 34, + 17, + 32, + 23, + 21, + 48, + 12, + 39, + 46, + 17, + 13, + 26, + 20, + 14, + 15, + 0, + 0, + 36, + 33, + 34, + 11, + 33, + 3, + 14, + 22, + 4, + 36, + 22, + 20, + 34, + 18, + 47, + 8, + 23, + 38, + 15, + 3, + 25, + 45, + 7, + 0, + 1, + 40, + 14, + 12, + 11, + 65, + 9, + 20, + 53, + 98, + 39, + 10, + 14 + ], + "weighted_loads": [ + 0.7485430128872395, + 3.0572619810700417, + 1.6457997430115938, + 3.344486927613616, + 0.16929065436124802, + 1.0716735515743494, + 1.2734778858721256, + 0.1814296841621399, + 1.731026280671358, + 0.7872616741806269, + 1.6783674657344818, + 0.7282746266573668, + 1.2101964969187975, + 1.19517776183784, + 2.0782575607299805, + 3.2153981756418943, + 1.4013646468520164, + 2.4453368559479713, + 2.621429543942213, + 1.2944641951471567, + 0.4659052863717079, + 0.9781663287431002, + 1.6533881723880768, + 0.9023054987192154, + 0.4993183743208647, + 0.0, + 0.0, + 2.0327383168041706, + 2.267816483974457, + 2.1359019577503204, + 0.5324704479426146, + 1.6953893136233091, + 0.1113128773868084, + 0.4831852540373802, + 0.9267782121896744, + 0.1655939370393753, + 2.4245985336601734, + 0.8390991631895304, + 1.2494786940515041, + 1.8204820416867733, + 0.6943558920174837, + 3.158426456153393, + 0.31428108736872673, + 1.0365187041461468, + 3.0228422954678535, + 1.541977321729064, + 0.12295519933104515, + 2.797425413504243, + 3.0658163502812386, + 0.26280444487929344, + 0.0, + 0.06673398613929749, + 3.04067400470376, + 0.6017618849873543, + 0.624803651124239, + 0.49301000870764256, + 4.9342484176158905, + 0.3645515814423561, + 0.7247911095619202, + 3.1595238279551268, + 7.875817621126771, + 2.8458428271114826, + 0.48691433668136597, + 0.49969380535185337 + ], + "unique_experts": 61, + "load_cv": 0.7408631748840617, + "normalized_load_entropy": 0.9355533251971402, + "max_load_share": 0.06559571619812583 + }, + "full_input": { + "tokens": 290, + "top_k": 6, + "decisions": 1740, + "ordered_route_sha256": "4353aa6fdb89671b195e7632d775880b9e485faba9d07bd7e5890234d2bf643c", + "route_weight_sha256": "0d7b9ca104d184f87ace594c86ee7166cfddb4af8cd62d4891917feee3d7170a", + "loads": [ + 17, + 47, + 39, + 35, + 8, + 17, + 30, + 12, + 30, + 25, + 36, + 19, + 33, + 28, + 23, + 51, + 17, + 40, + 48, + 17, + 14, + 26, + 21, + 28, + 17, + 0, + 0, + 36, + 33, + 35, + 11, + 33, + 6, + 26, + 22, + 4, + 42, + 23, + 28, + 35, + 26, + 47, + 11, + 23, + 40, + 25, + 20, + 30, + 52, + 10, + 0, + 10, + 46, + 16, + 22, + 12, + 65, + 25, + 21, + 53, + 100, + 40, + 16, + 18 + ], + "weighted_loads": [ + 1.3194277298171073, + 3.5195974074304104, + 2.0001498963683844, + 3.8347979963291436, + 0.33491829968988895, + 1.0768628702498972, + 1.9648407958447933, + 0.41104170866310596, + 1.7684140664641745, + 0.9414675794541836, + 1.772748813033104, + 0.7828004118055105, + 1.2204135181382298, + 1.4095845371484756, + 2.2111712135374546, + 3.3353721369057894, + 1.5214759171940386, + 2.504655808210373, + 2.7107155434787273, + 1.2944641951471567, + 0.5134615190327168, + 0.9781663287431002, + 1.6718921214342117, + 2.7484116554260254, + 0.5815187152475119, + 0.0, + 0.0, + 2.0327383168041706, + 2.267816483974457, + 2.1816971004009247, + 0.5324704479426146, + 1.6953893136233091, + 0.2727612741291523, + 1.2978365360759199, + 0.9267782121896744, + 0.1655939370393753, + 2.856452653184533, + 0.8859950993210077, + 1.672824420966208, + 1.8489306289702654, + 1.0305592119693756, + 3.158426456153393, + 0.3947236444801092, + 1.0365187041461468, + 3.1258325949311256, + 3.708874361589551, + 1.7923228703439236, + 3.0948325984645635, + 3.3827925082296133, + 0.41426170617341995, + 0.0, + 0.6481526494026184, + 3.6799617744982243, + 0.6719619296491146, + 1.59948243573308, + 0.5237525198608637, + 4.9342484176158905, + 1.9431839976459742, + 0.8080731481313705, + 3.1595238279551268, + 7.951747979968786, + 2.9729986675083637, + 0.7188127990812063, + 0.6790449153631926 + ], + "unique_experts": 61, + "load_cv": 0.6162591984356044, + "normalized_load_entropy": 0.9540022909825107, + "max_load_share": 0.05747126436781609 + } + }, + "s0_bos": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "04d21df715ccac415c4cc69c26c7df9b981e4242610a5e09d0a77457b3231fab", + "route_weight_sha256": "e9546ba3c414a3378d81037134dcfc530a9a05126aa0ebfae9f1a6d3210cddb0", + "loads": [ + 10, + 41, + 32, + 25, + 5, + 17, + 18, + 6, + 28, + 21, + 32, + 16, + 30, + 25, + 22, + 48, + 11, + 39, + 46, + 17, + 14, + 28, + 20, + 14, + 16, + 0, + 0, + 35, + 32, + 34, + 14, + 33, + 3, + 12, + 23, + 4, + 38, + 25, + 20, + 33, + 18, + 47, + 7, + 21, + 38, + 15, + 3, + 25, + 47, + 7, + 0, + 1, + 41, + 14, + 10, + 9, + 63, + 10, + 15, + 51, + 101, + 39, + 10, + 15 + ], + "weighted_loads": [ + 0.7345746196806431, + 3.0811204873025417, + 1.638517789542675, + 3.3450631499290466, + 0.2167246975004673, + 1.11538802459836, + 1.2860895805060863, + 0.22022103145718575, + 1.74434370175004, + 0.766952695325017, + 1.5667990446090698, + 0.6717359833419323, + 1.170023586601019, + 1.285440031439066, + 2.0662301257252693, + 3.2018034625798464, + 1.3534248303622007, + 2.45398329757154, + 2.625474574044347, + 1.2911131381988525, + 0.47486951760947704, + 1.0306025501340628, + 1.665923722088337, + 0.8791508376598358, + 0.5310252066701651, + 0.0, + 0.0, + 2.0172662287950516, + 2.238911245018244, + 2.145384704694152, + 0.6201582103967667, + 1.6950283218175173, + 0.11094466969370842, + 0.3927541524171829, + 0.9442660510540009, + 0.17066868767142296, + 2.4961404148489237, + 0.9340599905699492, + 1.2743541672825813, + 1.8063630424439907, + 0.6878488231450319, + 3.1273803636431694, + 0.2880101911723614, + 0.9703426547348499, + 3.0283145904541016, + 1.5534828286617994, + 0.11390857771039009, + 2.8050691168755293, + 3.165870441123843, + 0.28081244975328445, + 0.0, + 0.0671820193529129, + 3.119114788249135, + 0.6277981549501419, + 0.5206951275467873, + 0.4181795585900545, + 4.827278923243284, + 0.4108338765799999, + 0.5673971064388752, + 3.1138374879956245, + 8.134893916547298, + 2.8765031844377518, + 0.4931970965117216, + 0.5265723187476397 + ], + "unique_experts": 61, + "load_cv": 0.7469147762040356, + "normalized_load_entropy": 0.9351692332500837, + "max_load_share": 0.06760374832663989 + }, + "full_input": { + "tokens": 274, + "top_k": 6, + "decisions": 1644, + "ordered_route_sha256": "f76827e7eff521ef155356b43fb82b2d9e440362700fd428b121a681807dc37e", + "route_weight_sha256": "3e7ce0aac5cc0e09932db1b66498b452a1c11e18e177fc3e08e2d9c857d4bc0f", + "loads": [ + 14, + 46, + 32, + 32, + 12, + 19, + 24, + 10, + 29, + 28, + 32, + 16, + 32, + 29, + 23, + 48, + 14, + 39, + 46, + 18, + 14, + 28, + 22, + 25, + 19, + 0, + 1, + 35, + 32, + 34, + 14, + 33, + 6, + 15, + 23, + 4, + 38, + 25, + 23, + 35, + 26, + 47, + 9, + 22, + 38, + 21, + 15, + 28, + 49, + 7, + 1, + 2, + 41, + 14, + 20, + 11, + 63, + 20, + 17, + 52, + 102, + 39, + 14, + 17 + ], + "weighted_loads": [ + 1.0603923094458878, + 3.4118264093995094, + 1.638517789542675, + 3.584451270289719, + 0.5520245786756277, + 1.167866521049291, + 1.6512751299887896, + 0.39406673051416874, + 1.7933929786086082, + 1.0029080752283335, + 1.5667990446090698, + 0.6717359833419323, + 1.2167042288929224, + 1.4614644348621368, + 2.1395777463912964, + 3.2018034625798464, + 1.4028807724826038, + 2.45398329757154, + 2.625474574044347, + 1.422726258635521, + 0.47486951760947704, + 1.0306025501340628, + 1.731873955577612, + 2.231025777757168, + 0.6335423942655325, + 0.0, + 0.12784048914909363, + 2.0172662287950516, + 2.238911245018244, + 2.145384704694152, + 0.6201582103967667, + 1.6950283218175173, + 0.26986920833587646, + 0.7033658474683762, + 0.9442660510540009, + 0.17066868767142296, + 2.4961404148489237, + 0.9340599905699492, + 1.3922410486266017, + 1.8567591272294521, + 1.0668637808412313, + 3.1273803636431694, + 0.3399509321898222, + 1.0358110554516315, + 3.0283145904541016, + 2.643069079145789, + 1.1236167699098587, + 2.95975230447948, + 3.2686032485216856, + 0.28081244975328445, + 0.06430349498987198, + 0.16066287457942963, + 3.119114788249135, + 0.6277981549501419, + 1.4427077174186707, + 0.5012475941330194, + 4.827278923243284, + 1.407220270484686, + 0.6758283786475658, + 3.358550690114498, + 8.163840567693114, + 2.8765031844377518, + 0.6142548322677612, + 0.6352718565613031 + ], + "unique_experts": 63, + "load_cv": 0.6494071791182243, + "normalized_load_entropy": 0.950895971803646, + "max_load_share": 0.06204379562043796 + } + }, + "s1_bos": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "b186362a81d0abadd0bebed3d7360bdb2a3f91b1846abb28e941969637d8684d", + "route_weight_sha256": "80fcb924c8af10d77712ee214fde6d9a07ca341fc9f84688109e3d21a56bc32c", + "loads": [ + 10, + 41, + 33, + 25, + 5, + 17, + 18, + 6, + 28, + 18, + 35, + 16, + 34, + 25, + 22, + 46, + 10, + 39, + 45, + 16, + 10, + 31, + 20, + 13, + 15, + 0, + 0, + 36, + 32, + 33, + 14, + 33, + 4, + 13, + 24, + 3, + 36, + 25, + 19, + 33, + 19, + 47, + 5, + 22, + 38, + 14, + 3, + 24, + 46, + 8, + 0, + 1, + 40, + 15, + 12, + 8, + 65, + 10, + 16, + 52, + 102, + 39, + 11, + 14 + ], + "weighted_loads": [ + 0.7438376545906067, + 3.0537896417081356, + 1.6833306439220905, + 3.3118496760725975, + 0.22224996238946915, + 1.117958040907979, + 1.2804090976715088, + 0.20679639466106892, + 1.7562328577041626, + 0.6906472612172365, + 1.6818746756762266, + 0.66553058847785, + 1.3027670793235302, + 1.2947137877345085, + 2.0649998262524605, + 3.122836910188198, + 1.3462369181215763, + 2.4616200756281614, + 2.591871101409197, + 1.2766582109034061, + 0.35403251834213734, + 1.166289396584034, + 1.6797359269112349, + 0.8541440367698669, + 0.498603580519557, + 0.0, + 0.0, + 2.0407261289656162, + 2.250328818336129, + 2.100337717682123, + 0.6369941998273134, + 1.7099452707916498, + 0.14673537760972977, + 0.4424309562891722, + 0.9921192489564419, + 0.1404779851436615, + 2.4221117570996284, + 0.9398760292679071, + 1.217133678495884, + 1.8043191209435463, + 0.7124973814934492, + 3.1478480771183968, + 0.20516703464090824, + 1.007802752777934, + 2.9982228334993124, + 1.5000383239239454, + 0.12137103080749512, + 2.7473485488444567, + 3.10028881020844, + 0.31696970388293266, + 0.0, + 0.08859710395336151, + 3.1197116300463676, + 0.6596693005412817, + 0.5813464093953371, + 0.3735481183975935, + 4.873980609700084, + 0.41052109748125076, + 0.6128687225282192, + 3.1743617355823517, + 8.182765383273363, + 2.8677648045122623, + 0.5533034186810255, + 0.4756433144211769 + ], + "unique_experts": 61, + "load_cv": 0.7553890787993146, + "normalized_load_entropy": 0.9338224658691475, + "max_load_share": 0.06827309236947791 + }, + "full_input": { + "tokens": 290, + "top_k": 6, + "decisions": 1740, + "ordered_route_sha256": "49fd376ef07835c06f5042e3aec66d4b6f2d6617a3fcdfb7a81af6a701ad5e46", + "route_weight_sha256": "61cc57227929e5e5c855b5ff1988030cb54607b90438fb6650e8c7632261ea20", + "loads": [ + 15, + 48, + 39, + 33, + 11, + 18, + 29, + 13, + 30, + 22, + 37, + 16, + 35, + 30, + 23, + 49, + 15, + 40, + 47, + 16, + 11, + 31, + 22, + 28, + 17, + 0, + 0, + 36, + 32, + 34, + 15, + 33, + 7, + 24, + 24, + 3, + 42, + 27, + 26, + 33, + 29, + 47, + 7, + 22, + 40, + 22, + 20, + 28, + 53, + 11, + 0, + 10, + 46, + 19, + 22, + 10, + 65, + 27, + 18, + 52, + 105, + 40, + 17, + 19 + ], + "weighted_loads": [ + 1.245736286509782, + 3.5205062329769135, + 1.9997236467897892, + 3.798631395213306, + 0.4721319433301687, + 1.1231473595835268, + 1.932825941592455, + 0.4562959372997284, + 1.8395587094128132, + 0.8499870300292969, + 1.7762560229748487, + 0.66553058847785, + 1.3129841005429626, + 1.509120563045144, + 2.158234305679798, + 3.242810871452093, + 1.4663481884635985, + 2.520939027890563, + 2.681157100945711, + 1.2766582109034061, + 0.40158875100314617, + 1.166289396584034, + 1.7476283553987741, + 2.78875420242548, + 0.5808039214462042, + 0.0, + 0.0, + 2.0407261289656162, + 2.250328818336129, + 2.1461328603327274, + 0.6858952809125185, + 1.7099452707916498, + 0.30372682958841324, + 1.2610786743462086, + 0.9921192489564419, + 0.1404779851436615, + 2.853965876623988, + 1.038249285891652, + 1.5833738939836621, + 1.8043191209435463, + 1.1417363453656435, + 3.1478480771183968, + 0.2576103154569864, + 1.007802752777934, + 3.1012131329625845, + 2.657588394358754, + 1.7961770743131638, + 3.0553449150174856, + 3.4225735999643803, + 0.4684269651770592, + 0.0, + 0.6700157672166824, + 3.7589993998408318, + 0.8477047551423311, + 1.556025194004178, + 0.4526959713548422, + 4.873980609700084, + 2.0090517792850733, + 0.7512625567615032, + 3.1743617355823517, + 8.294057497754693, + 2.9949206449091434, + 0.7852018810808659, + 0.7190963979810476 + ], + "unique_experts": 61, + "load_cv": 0.6293604661717884, + "normalized_load_entropy": 0.9527667019196834, + "max_load_share": 0.0603448275862069 + } + }, + "s0_x": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "22a7c50063516150b366e73e0ded188047688f625305d2701424f26e71783fa1", + "route_weight_sha256": "368ae321b0a8660969fdbd32795547478fe95601774202f20a3e3690cf603a15", + "loads": [ + 10, + 41, + 32, + 25, + 3, + 17, + 18, + 6, + 27, + 17, + 33, + 16, + 30, + 25, + 22, + 47, + 10, + 39, + 45, + 17, + 12, + 29, + 19, + 14, + 14, + 0, + 0, + 36, + 32, + 33, + 15, + 35, + 3, + 16, + 23, + 5, + 36, + 23, + 19, + 32, + 18, + 47, + 6, + 20, + 38, + 15, + 3, + 24, + 45, + 7, + 0, + 1, + 40, + 15, + 13, + 8, + 68, + 10, + 20, + 54, + 101, + 40, + 10, + 15 + ], + "weighted_loads": [ + 0.7406330928206444, + 3.0974184051156044, + 1.6656719669699669, + 3.352652793750167, + 0.13437111675739288, + 1.1106981374323368, + 1.287246234714985, + 0.21241498179733753, + 1.7046544961631298, + 0.6513599473983049, + 1.6062812488526106, + 0.6845413967967033, + 1.149114929139614, + 1.2729829344898462, + 2.067366659641266, + 3.146103935316205, + 1.2920871041715145, + 2.4604201056063175, + 2.5959440544247627, + 1.3395821694284678, + 0.420667203143239, + 1.0476536732167006, + 1.6465476267039776, + 0.8528506942093372, + 0.4636336024850607, + 0.0, + 0.0, + 2.0201374385505915, + 2.2537532933056355, + 2.1058262567967176, + 0.6351621188223362, + 1.7473275940865278, + 0.10170610249042511, + 0.528128694742918, + 0.9406533185392618, + 0.20518442057073116, + 2.414663251489401, + 0.8907012399286032, + 1.2533063627779484, + 1.8121220339089632, + 0.7044528052210808, + 3.1162592694163322, + 0.23311288468539715, + 0.9340403098613024, + 2.9861942660063505, + 1.5472250003367662, + 0.12348712608218193, + 2.7726911939680576, + 3.074974939227104, + 0.2643540594726801, + 0.0, + 0.05603392422199249, + 3.023308562114835, + 0.6420962605625391, + 0.6532925199717283, + 0.4024431202560663, + 5.081113221123815, + 0.42125220224261284, + 0.7584165576845407, + 3.239909753203392, + 8.098928784951568, + 2.8920824509114027, + 0.47699944488704205, + 0.5121059697121382 + ], + "unique_experts": 61, + "load_cv": 0.7549334403943413, + "normalized_load_entropy": 0.9341360870814804, + "max_load_share": 0.06760374832663989 + }, + "full_input": { + "tokens": 274, + "top_k": 6, + "decisions": 1644, + "ordered_route_sha256": "896bc3e757ba82c419c0842118d7739b08177e06cf799eba7ebb5a71ac1be1fa", + "route_weight_sha256": "7d8439749ada5892c736b063249ef083b8675791defbc378f8cb7b7e04c6a82e", + "loads": [ + 15, + 46, + 32, + 34, + 8, + 19, + 24, + 10, + 27, + 24, + 33, + 18, + 31, + 29, + 24, + 47, + 14, + 39, + 45, + 17, + 12, + 29, + 20, + 25, + 17, + 0, + 0, + 36, + 32, + 33, + 15, + 35, + 6, + 20, + 23, + 5, + 37, + 23, + 23, + 34, + 25, + 47, + 8, + 20, + 38, + 22, + 18, + 27, + 47, + 7, + 0, + 2, + 40, + 15, + 24, + 9, + 68, + 19, + 21, + 54, + 102, + 40, + 14, + 16 + ], + "weighted_loads": [ + 1.1749915559776127, + 3.439446721225977, + 1.6656719669699669, + 3.7357580130919814, + 0.3746455628424883, + 1.1631766338832676, + 1.665761498734355, + 0.36274883709847927, + 1.7046544961631298, + 0.8732702452689409, + 1.6062812488526106, + 0.7514902502298355, + 1.1592655796557665, + 1.4490073379129171, + 2.187518734484911, + 3.146103935316205, + 1.3716839379630983, + 2.4604201056063175, + 2.5959440544247627, + 1.3395821694284678, + 0.420667203143239, + 1.0476536732167006, + 1.6651994474232197, + 2.159677170217037, + 0.5661507900804281, + 0.0, + 0.0, + 2.0201374385505915, + 2.2537532933056355, + 2.1058262567967176, + 0.6351621188223362, + 1.7473275940865278, + 0.25455908104777336, + 0.8692999519407749, + 0.9406533185392618, + 0.20518442057073116, + 2.456185258924961, + 0.8907012399286032, + 1.4395294738933444, + 1.8625181186944246, + 1.0060426220297813, + 3.1162592694163322, + 0.28505362570285797, + 0.9340403098613024, + 2.9861942660063505, + 2.657960945740342, + 1.325354253873229, + 2.9006405286490917, + 3.169062126427889, + 0.2643540594726801, + 0.0, + 0.14951477944850922, + 3.023308562114835, + 0.6420962605625391, + 1.7101343926042318, + 0.4370302576571703, + 5.081113221123815, + 1.3832410015165806, + 0.8104247394949198, + 3.239909753203392, + 8.129706036299467, + 2.8920824509114027, + 0.5980571806430817, + 0.5798199232667685 + ], + "unique_experts": 61, + "load_cv": 0.6579203197768759, + "normalized_load_entropy": 0.9488892241710886, + "max_load_share": 0.06204379562043796 + } + }, + "s1_x": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "af4a32733230a2d2036e7b94bd8e2e034913eaffc8e3ad15c6dbec98c47392f1", + "route_weight_sha256": "ab5a3b6d94bc1692375bdba7e381415374ba3213272cf6dac9d0d98ad3aaa9d5", + "loads": [ + 10, + 40, + 32, + 24, + 4, + 16, + 18, + 5, + 27, + 18, + 39, + 16, + 38, + 22, + 21, + 45, + 12, + 38, + 46, + 17, + 11, + 27, + 20, + 13, + 13, + 0, + 0, + 36, + 31, + 34, + 15, + 33, + 4, + 14, + 24, + 3, + 37, + 23, + 19, + 33, + 18, + 47, + 5, + 22, + 38, + 14, + 5, + 24, + 45, + 6, + 0, + 2, + 39, + 15, + 16, + 10, + 64, + 9, + 19, + 51, + 101, + 39, + 11, + 16 + ], + "weighted_loads": [ + 0.7341262027621269, + 3.006766140460968, + 1.639664564281702, + 3.2634822092950344, + 0.1762240044772625, + 1.069479463621974, + 1.247012447565794, + 0.18824391812086105, + 1.6981169655919075, + 0.694870937615633, + 1.8774653784930706, + 0.6757196597754955, + 1.4695373997092247, + 1.1272068861871958, + 2.0547353141009808, + 3.058797460049391, + 1.419718537479639, + 2.4039481095969677, + 2.6266863998025656, + 1.3004986364394426, + 0.3832664415240288, + 1.0385890509933233, + 1.6169275753200054, + 0.9073283709585667, + 0.4383334796875715, + 0.0, + 0.0, + 1.991145921871066, + 2.2044550217688084, + 2.1158431135118008, + 0.634357426315546, + 1.7057812418788671, + 0.14294244721531868, + 0.47666875645518303, + 0.9742694552987814, + 0.14739400148391724, + 2.382394567131996, + 0.8587152846157551, + 1.2251777984201908, + 1.80541080981493, + 0.6829097792506218, + 3.1188682205975056, + 0.18869245238602161, + 1.0247069504112005, + 2.994030252099037, + 1.4628869891166687, + 0.22450291737914085, + 2.747150568291545, + 3.0573711954057217, + 0.23892183601856232, + 0.0, + 0.1307072713971138, + 2.981417117640376, + 0.6461278665810823, + 0.7821329776197672, + 0.43331572972238064, + 4.856738490983844, + 0.3674456626176834, + 0.7172424681484699, + 3.1453712452203035, + 8.075610779225826, + 2.8781732954084873, + 0.5421703942120075, + 0.5432237535715103 + ], + "unique_experts": 61, + "load_cv": 0.7460313048190046, + "normalized_load_entropy": 0.935518924501702, + "max_load_share": 0.06760374832663989 + }, + "full_input": { + "tokens": 290, + "top_k": 6, + "decisions": 1740, + "ordered_route_sha256": "2bcad1d2e7eca3f717938c654ce4a21609d2b83a7f641d8d4775b2946fce3c40", + "route_weight_sha256": "08a9086576476e38a9e6f50ed35d20f050421deb00d9435f56c04fd96e0e6ddc", + "loads": [ + 16, + 47, + 38, + 34, + 9, + 17, + 30, + 11, + 28, + 21, + 41, + 16, + 39, + 27, + 22, + 48, + 18, + 39, + 48, + 18, + 12, + 27, + 21, + 29, + 15, + 0, + 0, + 36, + 31, + 35, + 15, + 33, + 7, + 24, + 24, + 3, + 43, + 24, + 27, + 33, + 26, + 47, + 7, + 22, + 40, + 22, + 23, + 28, + 53, + 9, + 0, + 12, + 45, + 17, + 29, + 11, + 64, + 25, + 21, + 51, + 104, + 40, + 18, + 20 + ], + "weighted_loads": [ + 1.3198661399073899, + 3.4726874195039272, + 1.9560575671494007, + 3.838207700289786, + 0.367360332980752, + 1.0746687822975218, + 1.956963438540697, + 0.3721152599900961, + 1.734787579625845, + 0.810552129521966, + 1.9718467257916927, + 0.6757196597754955, + 1.479754420928657, + 1.3416136614978313, + 2.1479697935283184, + 3.178771421313286, + 1.5791946747340262, + 2.4632670618593693, + 2.71597239933908, + 1.3321011867374182, + 0.4308226741850376, + 1.0385890509933233, + 1.6354315243661404, + 2.815416391938925, + 0.5205338206142187, + 0.0, + 0.0, + 1.991145921871066, + 2.2044550217688084, + 2.161638256162405, + 0.634357426315546, + 1.7057812418788671, + 0.2957194596529007, + 1.1757364887744188, + 0.9742694552987814, + 0.14739400148391724, + 2.814248686656356, + 0.9056112207472324, + 1.6693791570141912, + 1.80541080981493, + 0.997654540464282, + 3.1188682205975056, + 0.2411357332020998, + 1.0247069504112005, + 3.0970205515623093, + 2.623372383415699, + 2.100053433328867, + 3.0374142918735743, + 3.4455275256186724, + 0.3903790973126888, + 0.0, + 0.7977727055549622, + 3.62070488743484, + 0.7163279112428427, + 1.9956011604517698, + 0.46405824087560177, + 4.856738490983844, + 1.901988072320819, + 0.8414636477828026, + 3.1453712452203035, + 8.180996801704168, + 3.0053291358053684, + 0.8072510231286287, + 0.6967192832380533 + ], + "unique_experts": 61, + "load_cv": 0.6250126171272377, + "normalized_load_entropy": 0.953093228190517, + "max_load_share": 0.059770114942528735 + } + }, + "s0_period": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "510adad00f953360cc92d8c9375939e0a4ef85ece2efa07a3a6fafb50e5a2e52", + "route_weight_sha256": "a4d1f057c27c877ca0098750af475e7263743626bbf496ee8c0bbf434326d617", + "loads": [ + 10, + 40, + 33, + 25, + 5, + 17, + 18, + 6, + 28, + 20, + 33, + 17, + 29, + 24, + 22, + 47, + 10, + 39, + 45, + 18, + 15, + 30, + 20, + 14, + 13, + 0, + 0, + 36, + 31, + 33, + 12, + 36, + 3, + 14, + 23, + 4, + 34, + 23, + 20, + 31, + 19, + 47, + 6, + 20, + 38, + 15, + 3, + 23, + 46, + 8, + 0, + 1, + 40, + 17, + 12, + 9, + 66, + 10, + 17, + 55, + 101, + 39, + 10, + 14 + ], + "weighted_loads": [ + 0.7374607250094414, + 3.040698878467083, + 1.6906000413000584, + 3.3620918821543455, + 0.2191516049206257, + 1.1076745688915253, + 1.2880416214466095, + 0.2130741011351347, + 1.75702553242445, + 0.7490875143557787, + 1.578154033049941, + 0.7284462489187717, + 1.1270704045891762, + 1.244096901267767, + 2.080270189791918, + 3.1485744528472424, + 1.29456671141088, + 2.4540014937520027, + 2.613450149074197, + 1.3650867603719234, + 0.5155578516423702, + 1.0952302608639002, + 1.6732232384383678, + 0.8788721896708012, + 0.4341074600815773, + 0.0, + 0.0, + 2.013056244701147, + 2.1903654895722866, + 2.11017750762403, + 0.5641941986978054, + 1.782533697783947, + 0.10754445567727089, + 0.44585805758833885, + 0.952524745836854, + 0.17849427461624146, + 2.362956177443266, + 0.8760798797011375, + 1.2724272664636374, + 1.767909137532115, + 0.7083657514303923, + 3.094846600666642, + 0.24779560789465904, + 0.9366026017814875, + 3.0290936939418316, + 1.5492510255426168, + 0.11901413649320602, + 2.746676366776228, + 3.1279995180666447, + 0.30077927000820637, + 0.0, + 0.05726136639714241, + 3.042464129626751, + 0.7176922671496868, + 0.6043800786137581, + 0.42064752988517284, + 5.005562577396631, + 0.4310152567923069, + 0.6455945316702127, + 3.281492231413722, + 8.156611271202564, + 2.8631873689591885, + 0.5060274600982666, + 0.4723219871520996 + ], + "unique_experts": 61, + "load_cv": 0.7500943025860853, + "normalized_load_entropy": 0.9350563749068849, + "max_load_share": 0.06760374832663989 + }, + "full_input": { + "tokens": 274, + "top_k": 6, + "decisions": 1644, + "ordered_route_sha256": "c6eb5c6e7c2e02173966240563890dc9fa77b78b6f247c8550f0e5a33db0ef55", + "route_weight_sha256": "e694cc903a1e95ee80469cc051c49338350c578060f4afa4233d9131984be459", + "loads": [ + 15, + 45, + 34, + 32, + 11, + 19, + 25, + 10, + 29, + 28, + 33, + 18, + 30, + 28, + 23, + 47, + 13, + 39, + 45, + 18, + 15, + 30, + 21, + 24, + 16, + 0, + 0, + 36, + 31, + 33, + 12, + 36, + 5, + 18, + 23, + 4, + 34, + 23, + 25, + 33, + 27, + 47, + 8, + 20, + 38, + 21, + 16, + 26, + 48, + 8, + 0, + 2, + 40, + 18, + 23, + 10, + 66, + 20, + 18, + 55, + 102, + 39, + 14, + 17 + ], + "weighted_loads": [ + 1.171304874587804, + 3.3716471679508686, + 1.743281040340662, + 3.601480002515018, + 0.5162655618041754, + 1.160153065342456, + 1.7388451788574457, + 0.3746399525552988, + 1.7841057647019625, + 1.0325680207461119, + 1.578154033049941, + 0.7702884487807751, + 1.1372210551053286, + 1.4201213046908379, + 2.153617810457945, + 3.1485744528472424, + 1.3440226535312831, + 2.4540014937520027, + 2.613450149074197, + 1.3650867603719234, + 0.5155578516423702, + 1.0952302608639002, + 1.69187505915761, + 2.1454237438738346, + 0.5366246476769447, + 0.0, + 0.0, + 2.013056244701147, + 2.1903654895722866, + 2.11017750762403, + 0.5641941986978054, + 1.782533697783947, + 0.23763375356793404, + 0.7798585966229439, + 0.952524745836854, + 0.17849427461624146, + 2.362956177443266, + 0.8760798797011375, + 1.58033084589988, + 1.8183052223175764, + 1.086548449471593, + 3.094846600666642, + 0.29973634891211987, + 0.9366026017814875, + 3.0290936939418316, + 2.61916664801538, + 1.1717025488615036, + 2.884420771151781, + 3.224462017416954, + 0.30077927000820637, + 0.0, + 0.15074222162365913, + 3.042464129626751, + 0.7657941058278084, + 1.5653246007859707, + 0.4552346672862768, + 5.005562577396631, + 1.4329721331596375, + 0.6976027134805918, + 3.281492231413722, + 8.183504354208708, + 2.8631873689591885, + 0.6270851958543062, + 0.6114032808691263 + ], + "unique_experts": 61, + "load_cv": 0.6536232681048006, + "normalized_load_entropy": 0.9494196877252529, + "max_load_share": 0.06204379562043796 + } + }, + "s1_period": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "bbf7c6f6debcea1de6b0c2bab4da8867578fa8f299e32cd7444e6d69a28f30ec", + "route_weight_sha256": "c20cb072723eaa5fd79f1602f1a9707937e8dfdaaec8c51af9d14539907f937a", + "loads": [ + 10, + 40, + 31, + 25, + 3, + 15, + 18, + 5, + 27, + 19, + 39, + 18, + 39, + 21, + 22, + 46, + 12, + 39, + 45, + 17, + 11, + 26, + 19, + 14, + 13, + 0, + 0, + 36, + 31, + 33, + 14, + 33, + 4, + 13, + 22, + 3, + 37, + 23, + 20, + 34, + 19, + 47, + 4, + 22, + 38, + 14, + 5, + 24, + 46, + 7, + 0, + 2, + 39, + 15, + 15, + 8, + 65, + 10, + 20, + 51, + 101, + 39, + 10, + 16 + ], + "weighted_loads": [ + 0.7396678030490875, + 3.0030811578035355, + 1.614874528720975, + 3.2858979161828756, + 0.13029978796839714, + 1.0404551699757576, + 1.2363796792924404, + 0.17734314501285553, + 1.7007463946938515, + 0.7350946217775345, + 1.8883172776550055, + 0.7594685778021812, + 1.493575632572174, + 1.0980526357889175, + 2.0648543518036604, + 3.0750583950430155, + 1.3933054991066456, + 2.4406212214380503, + 2.587925462052226, + 1.2994046825915575, + 0.3870681431144476, + 0.984436871483922, + 1.605363531038165, + 0.8726914972066879, + 0.43740701116621494, + 0.0, + 0.0, + 1.9814661610871553, + 2.1974548622965813, + 2.0976376067847013, + 0.6202828735113144, + 1.72591301985085, + 0.142297875136137, + 0.45634674467146397, + 0.9296443238854408, + 0.14518573507666588, + 2.4051446206867695, + 0.8622953090816736, + 1.263196874409914, + 1.7937079388648272, + 0.7357204835861921, + 3.1162724271416664, + 0.1648177821189165, + 1.0234884154051542, + 3.018950816243887, + 1.472712080925703, + 0.22447492368519306, + 2.7681178245693445, + 3.0978747215121984, + 0.27437903732061386, + 0.0, + 0.11971084401011467, + 2.9914387576282024, + 0.6431690286844969, + 0.7344872206449509, + 0.3783003482967615, + 4.909153373911977, + 0.41096997633576393, + 0.7381556555628777, + 3.1356392949819565, + 8.088293032720685, + 2.8614504858851433, + 0.49980001151561737, + 0.5476491097360849 + ], + "unique_experts": 61, + "load_cv": 0.7510875302852484, + "normalized_load_entropy": 0.9344838359615375, + "max_load_share": 0.06760374832663989 + }, + "full_input": { + "tokens": 290, + "top_k": 6, + "decisions": 1740, + "ordered_route_sha256": "8bed26a84ca86c30cefa4836dd1855feba320b378e524ebc1b58f53b068e032b", + "route_weight_sha256": "854fe4f43fe4e9b0d7cfcaa928080d9b63200adb58b773deeb5c7a6633c5ee4b", + "loads": [ + 16, + 47, + 37, + 35, + 7, + 16, + 31, + 12, + 28, + 24, + 41, + 18, + 40, + 26, + 23, + 49, + 18, + 40, + 47, + 17, + 12, + 26, + 20, + 28, + 15, + 0, + 0, + 36, + 31, + 34, + 14, + 33, + 8, + 24, + 22, + 3, + 43, + 24, + 29, + 34, + 27, + 47, + 7, + 22, + 40, + 21, + 23, + 28, + 53, + 10, + 0, + 11, + 45, + 19, + 27, + 9, + 65, + 26, + 22, + 51, + 104, + 40, + 16, + 19 + ], + "weighted_loads": [ + 1.2892095115967095, + 3.464329894632101, + 1.9312675315886736, + 3.8387595070526004, + 0.29129102267324924, + 1.0456444886513054, + 2.0177517272531986, + 0.39365234039723873, + 1.737417008727789, + 0.9261439200490713, + 1.9826986249536276, + 0.7594685778021812, + 1.5037926537916064, + 1.312459411099553, + 2.158088831230998, + 3.1950323563069105, + 1.546055665705353, + 2.499940173700452, + 2.6772114615887403, + 1.2994046825915575, + 0.43462437577545643, + 0.984436871483922, + 1.6238674800843, + 2.6964936926960945, + 0.5196073520928621, + 0.0, + 0.0, + 1.9814661610871553, + 2.1974548622965813, + 2.1434327494353056, + 0.6202828735113144, + 1.72591301985085, + 0.3450581319630146, + 1.2440794333815575, + 0.9296443238854408, + 0.14518573507666588, + 2.836998740211129, + 0.909191245213151, + 1.8720796154811978, + 1.7937079388648272, + 1.065940536558628, + 3.1162724271416664, + 0.24395688250660896, + 1.0234884154051542, + 3.121941115707159, + 2.57277974113822, + 1.9351325388997793, + 3.0435334723442793, + 3.4324969798326492, + 0.42583629861474037, + 0.0, + 0.7011295072734356, + 3.6307265274226665, + 0.7980323750525713, + 1.8179677315056324, + 0.40904285944998264, + 4.909153373911977, + 1.9567154329270124, + 0.8608213849365711, + 3.1356392949819565, + 8.190750608220696, + 2.9886063262820244, + 0.7316984739154577, + 0.6828082781285048 + ], + "unique_experts": 61, + "load_cv": 0.6288564468177044, + "normalized_load_entropy": 0.9524579222859237, + "max_load_share": 0.059770114942528735 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 249, + "ordered_topk_exact_tokens": 167, + "set_exact_tokens": 192, + "mean_set_jaccard": 0.9328743545611017, + "mean_token_weighted_tv": 0.012280974683003971, + "aggregate_load_tv": 0.02342704149933066 + }, + "system_bos": { + "tokens": 249, + "ordered_topk_exact_tokens": 181, + "set_exact_tokens": 206, + "mean_set_jaccard": 0.9489386115892141, + "mean_token_weighted_tv": 0.01100448162545521, + "aggregate_load_tv": 0.01807228915662651 + }, + "system_x": { + "tokens": 249, + "ordered_topk_exact_tokens": 153, + "set_exact_tokens": 179, + "mean_set_jaccard": 0.9153757888697648, + "mean_token_weighted_tv": 0.01680482463185567, + "aggregate_load_tv": 0.024765729585006686 + }, + "system_period": { + "tokens": 249, + "ordered_topk_exact_tokens": 144, + "set_exact_tokens": 177, + "mean_set_jaccard": 0.9130808950086058, + "mean_token_weighted_tv": 0.017378479152558798, + "aggregate_load_tv": 0.028112449799196786 + }, + "bos_at_s0": { + "tokens": 249, + "ordered_topk_exact_tokens": 155, + "set_exact_tokens": 190, + "mean_set_jaccard": 0.929718875502008, + "mean_token_weighted_tv": 0.014563059501619223, + "aggregate_load_tv": 0.01807228915662651 + }, + "bos_at_s1": { + "tokens": 249, + "ordered_topk_exact_tokens": 159, + "set_exact_tokens": 183, + "mean_set_jaccard": 0.9182444061962135, + "mean_token_weighted_tv": 0.016351357566185266, + "aggregate_load_tv": 0.023427041499330656 + }, + "x_at_s0": { + "tokens": 249, + "ordered_topk_exact_tokens": 156, + "set_exact_tokens": 185, + "mean_set_jaccard": 0.9239816408491106, + "mean_token_weighted_tv": 0.014886237247042867, + "aggregate_load_tv": 0.022088353413654623 + }, + "x_at_s1": { + "tokens": 249, + "ordered_topk_exact_tokens": 151, + "set_exact_tokens": 182, + "mean_set_jaccard": 0.917096959265634, + "mean_token_weighted_tv": 0.01735519642855628, + "aggregate_load_tv": 0.023427041499330652 + }, + "period_at_s0": { + "tokens": 249, + "ordered_topk_exact_tokens": 149, + "set_exact_tokens": 182, + "mean_set_jaccard": 0.9196787148594378, + "mean_token_weighted_tv": 0.015797664366482972, + "aggregate_load_tv": 0.019410977242302542 + }, + "period_at_s1": { + "tokens": 249, + "ordered_topk_exact_tokens": 145, + "set_exact_tokens": 182, + "mean_set_jaccard": 0.9179575444635686, + "mean_token_weighted_tv": 0.017144548074607868, + "aggregate_load_tv": 0.023427041499330656 + } + } + }, + "layer_24": { + "layer": 24, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "c1cfc8460e327fd939e0c2e7f67c0552c482df47e40e7b6cbea80bbf457934b4", + "route_weight_sha256": "508b5d9434bf5a375acd4211903f06fa0c5719239571edc08a9610356a03c2ae", + "loads": [ + 33, + 16, + 65, + 24, + 35, + 28, + 34, + 9, + 22, + 49, + 24, + 68, + 30, + 53, + 20, + 24, + 1, + 15, + 21, + 23, + 23, + 13, + 7, + 16, + 36, + 30, + 2, + 28, + 19, + 17, + 20, + 8, + 18, + 4, + 8, + 30, + 12, + 14, + 22, + 40, + 12, + 20, + 10, + 48, + 24, + 6, + 17, + 7, + 36, + 44, + 15, + 15, + 24, + 28, + 35, + 30, + 49, + 14, + 21, + 9, + 39, + 7, + 2, + 21 + ], + "weighted_loads": [ + 1.4276601001620293, + 0.4887038730084896, + 2.254302391782403, + 1.0221808515489101, + 2.0018711406737566, + 1.0584253817796707, + 1.3330431338399649, + 0.3340154029428959, + 2.795247510075569, + 2.730413319543004, + 2.2708890698850155, + 4.112663172185421, + 1.651551140472293, + 2.9393086954951286, + 1.1722104046493769, + 2.103245770558715, + 0.02778315544128418, + 0.9471654500812292, + 0.892931105569005, + 0.720442296937108, + 0.817333959043026, + 0.6465117316693068, + 0.27508511394262314, + 0.9099339134991169, + 1.1279198043048382, + 1.2044335566461086, + 0.0693868026137352, + 1.0206312704831362, + 0.627899868413806, + 0.7531151957809925, + 1.5044430512934923, + 0.236776290461421, + 0.7784634847193956, + 0.1111321970820427, + 0.23393097147345543, + 2.0330125372856855, + 0.4375723507255316, + 0.5113345719873905, + 0.6946367248892784, + 1.5821487698704004, + 0.6179324984550476, + 0.6187702193856239, + 0.333901958540082, + 2.4241460412740707, + 0.9757466092705727, + 0.2986985370516777, + 0.7346156872808933, + 0.2245511543005705, + 3.3145920000970364, + 3.47254572622478, + 0.7775932550430298, + 0.7512144409120083, + 0.6769325919449329, + 2.963110039010644, + 2.12684827670455, + 1.6913964319974184, + 2.6854255944490433, + 0.46743292920291424, + 0.760774152353406, + 0.2713312655687332, + 1.5765565317124128, + 0.27851512283086777, + 0.1377035640180111, + 0.7351949457079172 + ], + "unique_experts": 64, + "load_cv": 0.6224064661657545, + "normalized_load_entropy": 0.953783273991992, + "max_load_share": 0.04551539491298527 + }, + "full_input": { + "tokens": 274, + "top_k": 6, + "decisions": 1644, + "ordered_route_sha256": "a665438e2c41bf476e736e0f084f9b96931185de901f056be90dd2143093aa72", + "route_weight_sha256": "54e0605be23de8243d773a7c5576393ebf05cf9609d14343af2965199efec369", + "loads": [ + 33, + 16, + 67, + 24, + 35, + 33, + 34, + 10, + 31, + 49, + 34, + 68, + 31, + 53, + 22, + 24, + 2, + 15, + 21, + 24, + 24, + 13, + 15, + 16, + 45, + 30, + 2, + 28, + 28, + 24, + 20, + 10, + 19, + 7, + 16, + 31, + 13, + 16, + 23, + 40, + 13, + 22, + 13, + 48, + 24, + 8, + 17, + 12, + 36, + 45, + 19, + 21, + 27, + 31, + 35, + 30, + 49, + 16, + 30, + 9, + 42, + 22, + 5, + 24 + ], + "weighted_loads": [ + 1.4276601001620293, + 0.4887038730084896, + 2.319786174222827, + 1.0221808515489101, + 2.0018711406737566, + 1.215873884386383, + 1.3330431338399649, + 0.3897302784025669, + 3.2132983482442796, + 2.730413319543004, + 2.6605252255685627, + 4.112663172185421, + 1.65428679715842, + 2.9393086954951286, + 1.2434133905917406, + 2.103245770558715, + 0.06534053012728691, + 0.9471654500812292, + 0.892931105569005, + 0.7774617467075586, + 0.8512048721313477, + 0.6465117316693068, + 0.8900373503565788, + 0.9099339134991169, + 1.4725769164506346, + 1.2044335566461086, + 0.0693868026137352, + 1.0206312704831362, + 0.9819538611918688, + 1.1583711095154285, + 1.5044430512934923, + 0.30310780741274357, + 0.8075030855834484, + 0.2656538002192974, + 0.49650623369961977, + 2.072994375601411, + 0.5335638131946325, + 1.4078078344464302, + 0.7378581203520298, + 1.5821487698704004, + 0.6536893099546432, + 0.7162554524838924, + 0.409363049082458, + 2.4241460412740707, + 0.9757466092705727, + 0.3953838311135769, + 0.7346156872808933, + 0.5711934951832518, + 3.3145920000970364, + 3.5311624128371477, + 0.9543405957520008, + 1.1834152229130268, + 0.7611112482845783, + 3.107439896091819, + 2.12684827670455, + 1.6913964319974184, + 2.6854255944490433, + 0.5583225656300783, + 1.033061503781937, + 0.2713312655687332, + 1.669035593047738, + 1.3932347940281034, + 0.17850066348910332, + 2.7171184327453375 + ], + "unique_experts": 64, + "load_cv": 0.5456146739165032, + "normalized_load_entropy": 0.9643174846371986, + "max_load_share": 0.0413625304136253 + } + }, + "s1_eos": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "bc0dc96724c84b413f33b797753a0f6df4fa84331c9f69cade8f496ec8b3c421", + "route_weight_sha256": "08a7c4c50ae5b77369d24185b2b8917d7c027ec663f03d642cbc95a15481ec2d", + "loads": [ + 33, + 15, + 59, + 26, + 37, + 27, + 34, + 8, + 22, + 50, + 24, + 68, + 29, + 53, + 20, + 21, + 1, + 15, + 22, + 22, + 22, + 12, + 8, + 16, + 36, + 31, + 2, + 27, + 22, + 17, + 20, + 8, + 19, + 5, + 9, + 30, + 11, + 15, + 21, + 41, + 11, + 20, + 9, + 51, + 24, + 5, + 18, + 6, + 35, + 44, + 13, + 15, + 21, + 28, + 37, + 31, + 49, + 11, + 22, + 11, + 43, + 6, + 2, + 24 + ], + "weighted_loads": [ + 1.4251330271363258, + 0.4660772290080786, + 2.1041283681988716, + 1.0835648477077484, + 2.0480524245649576, + 1.0134942401200533, + 1.3195513430982828, + 0.3004814628511667, + 2.806941833347082, + 2.7775004785507917, + 2.2808657940477133, + 4.121804056689143, + 1.6307702474296093, + 2.9398257359862328, + 1.1511018201708794, + 1.974561732262373, + 0.027391240000724792, + 0.9470806550234556, + 0.9116543270647526, + 0.7107088547199965, + 0.7864754684269428, + 0.604137483984232, + 0.3060873132199049, + 0.9068372249603271, + 1.1406902205199003, + 1.2258121874183416, + 0.08089130371809006, + 0.9830054063349962, + 0.7331442125141621, + 0.755211129784584, + 1.4805651269853115, + 0.24189661256968975, + 0.8183846119791269, + 0.1372788678854704, + 0.2526954524219036, + 2.0334607884287834, + 0.4609872065484524, + 0.544992458075285, + 0.661440571770072, + 1.619015533477068, + 0.5742654018104076, + 0.6087339147925377, + 0.30964559130370617, + 2.5000304132699966, + 0.9551236052066088, + 0.26316186413168907, + 0.7607743982225657, + 0.1991699654608965, + 3.2649520579725504, + 3.4901975616812706, + 0.6971755605190992, + 0.7547940202057362, + 0.5965237822383642, + 2.9493865109980106, + 2.1769932340830564, + 1.7128271386027336, + 2.6600106954574585, + 0.3925920445472002, + 0.7853361442685127, + 0.3353456035256386, + 1.7042555306106806, + 0.23548510298132896, + 0.13806120306253433, + 0.8486889060586691 + ], + "unique_experts": 64, + "load_cv": 0.6258062545847504, + "normalized_load_entropy": 0.9528392425254288, + "max_load_share": 0.04551539491298527 + }, + "full_input": { + "tokens": 290, + "top_k": 6, + "decisions": 1740, + "ordered_route_sha256": "01ea99a6eb327a666b742e1939759d3f9c4c9299d41a47b63811f844ba4fc020", + "route_weight_sha256": "2d4db94d23e3cceab835b66d7e5e97876a8d341ec4bbff469950c9f1819bd979", + "loads": [ + 33, + 15, + 59, + 27, + 39, + 36, + 34, + 9, + 32, + 53, + 32, + 70, + 31, + 53, + 24, + 21, + 2, + 15, + 23, + 27, + 27, + 12, + 18, + 17, + 46, + 31, + 2, + 27, + 44, + 23, + 20, + 12, + 19, + 11, + 15, + 32, + 19, + 18, + 22, + 41, + 12, + 28, + 13, + 53, + 26, + 6, + 18, + 14, + 35, + 45, + 18, + 29, + 28, + 32, + 39, + 33, + 49, + 14, + 35, + 11, + 47, + 25, + 10, + 29 + ], + "weighted_loads": [ + 1.4251330271363258, + 0.4660772290080786, + 2.1041283681988716, + 1.1973548457026482, + 2.109167067334056, + 1.2894105113809928, + 1.3195513430982828, + 0.33644176460802555, + 3.4384242394007742, + 2.9076533932238817, + 2.6171640907414258, + 4.1884137485176325, + 1.6637081129010767, + 2.9398257359862328, + 1.2821656316518784, + 1.974561732262373, + 0.056059230118989944, + 0.9470806550234556, + 0.9430818520486355, + 0.8830342125147581, + 1.0122962594032288, + 0.604137483984232, + 1.0784768275916576, + 0.9322510808706284, + 1.5138324631843716, + 1.2258121874183416, + 0.08089130371809006, + 0.9830054063349962, + 1.7886387407779694, + 1.1476063337177038, + 1.4805651269853115, + 0.4087980445474386, + 0.8183846119791269, + 0.4379463717341423, + 0.47491261223331094, + 2.1340379528701305, + 1.0203437432646751, + 1.4896380752325058, + 0.7137691099196672, + 1.619015533477068, + 0.6869007237255573, + 1.064644230529666, + 0.4180367956869304, + 2.7070354521274567, + 1.0505988877266645, + 0.3221432790160179, + 0.7607743982225657, + 0.7525827856734395, + 3.2649520579725504, + 3.54155058786273, + 0.913378769531846, + 1.7412186674773693, + 0.798546502366662, + 3.230288665741682, + 2.3532299865037203, + 1.8119891062378883, + 2.6600106954574585, + 0.5216903854161501, + 1.3191483551054262, + 0.3353456035256386, + 1.8335552643984556, + 2.024636354763061, + 0.5318036366952583, + 2.921409809961915 + ], + "unique_experts": 64, + "load_cv": 0.5217479286434504, + "normalized_load_entropy": 0.9665166315614576, + "max_load_share": 0.040229885057471264 + } + }, + "s0_bos": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "f55aa443baeb737911192a4ad42d51ac0f2f0cfe4be420aba5f2d87e2ab99cea", + "route_weight_sha256": "4a8e5b22d47bd3211c439ebfda7648bd32e75b12eb70fd471c0e315a15558651", + "loads": [ + 33, + 18, + 65, + 23, + 38, + 28, + 34, + 9, + 21, + 48, + 22, + 69, + 28, + 53, + 19, + 23, + 0, + 16, + 23, + 22, + 21, + 13, + 9, + 16, + 41, + 30, + 2, + 27, + 14, + 17, + 20, + 7, + 16, + 3, + 7, + 31, + 13, + 14, + 24, + 40, + 14, + 21, + 9, + 47, + 26, + 5, + 17, + 6, + 35, + 44, + 16, + 15, + 21, + 26, + 38, + 30, + 49, + 12, + 22, + 11, + 42, + 7, + 2, + 22 + ], + "weighted_loads": [ + 1.4015082800760865, + 0.5567755959928036, + 2.2909151948988438, + 0.9844864401966333, + 2.0814451798796654, + 1.0329860225319862, + 1.3631781078875065, + 0.33343490958213806, + 2.800108814612031, + 2.700213300064206, + 2.2034238427877426, + 4.184242341667414, + 1.5878337230533361, + 2.9376757703721523, + 1.1270353570580482, + 2.0451836362481117, + 0.0, + 0.9746077377349138, + 0.9566646087914705, + 0.7178237605839968, + 0.7402941603213549, + 0.6502577066421509, + 0.35060922242701054, + 0.9115129038691521, + 1.2684699408710003, + 1.1802426856011152, + 0.0682930164039135, + 0.9830345716327429, + 0.47495709732174873, + 0.7588228117674589, + 1.4690345227718353, + 0.2095506340265274, + 0.683521818369627, + 0.09122567065060139, + 0.19716768339276314, + 2.086975743994117, + 0.48929793667048216, + 0.5026358999311924, + 0.7503856346011162, + 1.5755140539258718, + 0.6869186647236347, + 0.6352189667522907, + 0.30071969889104366, + 2.3588615134358406, + 1.0243836212903261, + 0.2648084629327059, + 0.7453512530773878, + 0.20129649341106415, + 3.290194172412157, + 3.4901154544204473, + 0.7678799480199814, + 0.7507697381079197, + 0.5995364803820848, + 2.843657249584794, + 2.1827753856778145, + 1.6728955935686827, + 2.670052772387862, + 0.4050744231790304, + 0.8055247478187084, + 0.3279899228364229, + 1.6600607596337795, + 0.27717259898781776, + 0.13687608763575554, + 0.7520312462002039 + ], + "unique_experts": 63, + "load_cv": 0.6339546795210999, + "normalized_load_entropy": 0.951517186740638, + "max_load_share": 0.04618473895582329 + }, + "full_input": { + "tokens": 274, + "top_k": 6, + "decisions": 1644, + "ordered_route_sha256": "b2d1360754be98729e2ef600af4e844813460fdb2d949d3f9ff85927621b7fbc", + "route_weight_sha256": "69b57f7b058d4c4c0986020bed25a111caffc8b00200bec5fd5ccc938a226055", + "loads": [ + 33, + 18, + 67, + 23, + 38, + 33, + 35, + 10, + 29, + 48, + 31, + 69, + 29, + 53, + 21, + 23, + 0, + 16, + 23, + 24, + 22, + 13, + 17, + 16, + 51, + 30, + 3, + 28, + 23, + 25, + 21, + 10, + 17, + 6, + 13, + 31, + 14, + 15, + 24, + 40, + 15, + 24, + 13, + 47, + 26, + 7, + 18, + 10, + 35, + 45, + 21, + 21, + 24, + 29, + 38, + 30, + 49, + 14, + 30, + 11, + 45, + 23, + 3, + 24 + ], + "weighted_loads": [ + 1.4015082800760865, + 0.5567755959928036, + 2.3563989773392677, + 0.9844864401966333, + 2.0814451798796654, + 1.1900045595830306, + 1.4523504488170147, + 0.3891497850418091, + 3.2325959224253893, + 2.700213300064206, + 2.5923710870556533, + 4.184242341667414, + 1.5905693797394633, + 2.9376757703721523, + 1.1994217112660408, + 2.0451836362481117, + 0.0, + 0.9746077377349138, + 0.9566646087914705, + 0.8111330289393663, + 0.7741650734096766, + 0.6502577066421509, + 1.072148246690631, + 0.9115129038691521, + 1.6366081705782562, + 1.1802426856011152, + 0.44209257885813713, + 1.0225961972028017, + 0.8377509973943233, + 1.1961810532957315, + 1.5107478126883507, + 0.30187129229307175, + 0.7125614192336798, + 0.2457472737878561, + 0.3739111674949527, + 2.086975743994117, + 0.5852893991395831, + 1.3668597973883152, + 0.7503856346011162, + 1.5755140539258718, + 0.720109187066555, + 0.7661338411271572, + 0.48045176919549704, + 2.3588615134358406, + 1.0243836212903261, + 0.38631569780409336, + 0.8124276157468557, + 0.5428590048104525, + 3.290194172412157, + 3.542937846854329, + 1.019461240619421, + 1.1558831594884396, + 0.6837151367217302, + 2.987987106665969, + 2.1827753856778145, + 1.6728955935686827, + 2.670052772387862, + 0.49536406993865967, + 1.077012699097395, + 0.3279899228364229, + 1.7531404364854097, + 1.4278196999803185, + 0.138572079828009, + 1.7646146472543478 + ], + "unique_experts": 63, + "load_cv": 0.5574644126362156, + "normalized_load_entropy": 0.9621262554246359, + "max_load_share": 0.041970802919708027 + } + }, + "s1_bos": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "33d0c815239a5d6e5644034bd20469955af3566bada9866accc090605f95529e", + "route_weight_sha256": "35b73c1f43b0738a2ad7d45d035314a195f2de2932f09a2950fa8aec96369c07", + "loads": [ + 34, + 19, + 65, + 24, + 37, + 24, + 34, + 6, + 22, + 48, + 22, + 70, + 27, + 53, + 19, + 24, + 0, + 16, + 24, + 22, + 19, + 13, + 10, + 15, + 35, + 29, + 2, + 27, + 16, + 18, + 20, + 7, + 18, + 5, + 6, + 30, + 12, + 13, + 23, + 41, + 12, + 21, + 9, + 47, + 29, + 8, + 18, + 6, + 35, + 43, + 15, + 15, + 22, + 27, + 39, + 31, + 49, + 14, + 22, + 8, + 41, + 9, + 2, + 23 + ], + "weighted_loads": [ + 1.4424602882936597, + 0.5962596666067839, + 2.272604001685977, + 1.0102205239236355, + 2.064286148175597, + 0.9039290621876717, + 1.3953416012227535, + 0.24297242984175682, + 2.7796972896903753, + 2.688677318394184, + 2.221975365653634, + 4.22208116017282, + 1.583413116633892, + 2.9528171978890896, + 1.1156008429825306, + 2.076743248850107, + 0.0, + 0.9686639048159122, + 0.9827812667936087, + 0.7289841156452894, + 0.68436049669981, + 0.6494015846401453, + 0.37639037147164345, + 0.8708758316934109, + 1.103878140449524, + 1.1868677716702223, + 0.07655538618564606, + 0.9886279795318842, + 0.5216053929179907, + 0.7879256624728441, + 1.4727707151323557, + 0.20590748824179173, + 0.7568813990801573, + 0.13549115229398012, + 0.1708789486438036, + 2.057058162987232, + 0.4799764510244131, + 0.48231620714068413, + 0.7283086180686951, + 1.6012531034648418, + 0.5951117016375065, + 0.6338490452617407, + 0.2998060081154108, + 2.3716996535658836, + 1.1270433701574802, + 0.3486867807805538, + 0.7810735665261745, + 0.1950407214462757, + 3.293916005641222, + 3.486898485571146, + 0.7952424939721823, + 0.7529850043356419, + 0.6196559332311153, + 2.828952645882964, + 2.231749938800931, + 1.7123813219368458, + 2.685183757916093, + 0.4611948076635599, + 0.7860817089676857, + 0.24385958909988403, + 1.6370592191815376, + 0.3519763946533203, + 0.1374998539686203, + 0.8003785684704781 + ], + "unique_experts": 63, + "load_cv": 0.6297798306700433, + "normalized_load_entropy": 0.9524109754945654, + "max_load_share": 0.04685408299866131 + }, + "full_input": { + "tokens": 290, + "top_k": 6, + "decisions": 1740, + "ordered_route_sha256": "a9c119b200b0d1a299ce889615b7f6be3e5ce646b0783078c4c2f7a09cf41c63", + "route_weight_sha256": "97bd620268d77fe3c9969107e2a4730015ca6a586aea193a7a06288c67f65dae", + "loads": [ + 34, + 19, + 65, + 25, + 39, + 32, + 34, + 7, + 31, + 51, + 29, + 72, + 29, + 53, + 23, + 24, + 1, + 16, + 25, + 27, + 24, + 13, + 21, + 16, + 45, + 29, + 2, + 27, + 38, + 25, + 20, + 11, + 18, + 11, + 13, + 32, + 19, + 16, + 24, + 41, + 14, + 28, + 14, + 50, + 30, + 10, + 18, + 13, + 35, + 44, + 21, + 29, + 29, + 31, + 41, + 33, + 49, + 17, + 34, + 8, + 47, + 29, + 9, + 26 + ], + "weighted_loads": [ + 1.4424602882936597, + 0.5962596666067839, + 2.272604001685977, + 1.1240105219185352, + 2.1254007909446955, + 1.1520591381704435, + 1.3953416012227535, + 0.27893273159861565, + 3.4254252929240465, + 2.818830233067274, + 2.564395801629871, + 4.288690852001309, + 1.6163509821053594, + 2.9528171978890896, + 1.244758017361164, + 2.076743248850107, + 0.028667990118265152, + 0.9686639048159122, + 1.0142087917774916, + 0.899967024102807, + 0.910181287676096, + 0.6494015846401453, + 1.2834456730633974, + 0.8962896876037121, + 1.4681226874236017, + 1.1868677716702223, + 0.07655538618564606, + 0.9886279795318842, + 1.577831456437707, + 1.2325865551829338, + 1.4727707151323557, + 0.38171778805553913, + 0.7568813990801573, + 0.43615865614265203, + 0.40932510094717145, + 2.1576353274285793, + 0.9981372375041246, + 1.4253968708217144, + 0.77153230458498, + 1.6012531034648418, + 0.751625906676054, + 1.0518083982169628, + 0.5459621655754745, + 2.6575883477926254, + 1.1664390377700329, + 0.45067282021045685, + 0.7810735665261745, + 0.7889057323336601, + 3.293916005641222, + 3.5386760160326958, + 1.124195335432887, + 1.689452424645424, + 0.8216786533594131, + 3.1098548006266356, + 2.407986691221595, + 1.8115432895720005, + 2.685183757916093, + 0.6045577581971884, + 1.3191262260079384, + 0.24385958909988403, + 1.8240663763135672, + 2.15937088849023, + 0.5214456336107105, + 1.858089417219162 + ], + "unique_experts": 64, + "load_cv": 0.520327955364279, + "normalized_load_entropy": 0.9667382490118991, + "max_load_share": 0.041379310344827586 + } + }, + "s0_x": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "1f5863690d1b877b56d084181b4ae1a05452ddc8bf3734a1efee6c681f9ce07b", + "route_weight_sha256": "a945d91888f12a435634c1c590811ce6e225d1226e601a4627a00a1d939009f7", + "loads": [ + 33, + 17, + 68, + 25, + 35, + 28, + 33, + 9, + 21, + 49, + 22, + 70, + 28, + 54, + 20, + 23, + 0, + 17, + 22, + 19, + 20, + 12, + 10, + 17, + 33, + 30, + 2, + 28, + 24, + 17, + 19, + 8, + 17, + 5, + 6, + 31, + 13, + 14, + 21, + 40, + 11, + 17, + 9, + 46, + 27, + 5, + 19, + 6, + 38, + 43, + 14, + 15, + 26, + 27, + 39, + 31, + 49, + 14, + 20, + 9, + 38, + 7, + 2, + 22 + ], + "weighted_loads": [ + 1.4002875676378608, + 0.5146553423255682, + 2.3688735142350197, + 1.055582107976079, + 1.9892408829182386, + 1.0160520765930414, + 1.2982126493006945, + 0.32699429243803024, + 2.7603054344654083, + 2.7275874856859446, + 2.212640481069684, + 4.202162645757198, + 1.6098756361752748, + 2.94758827239275, + 1.1630234830081463, + 2.0410103611648083, + 0.0, + 1.0046295057982206, + 0.9187018498778343, + 0.6215208563953638, + 0.7125245034694672, + 0.6146953999996185, + 0.379013754427433, + 0.9105552714318037, + 1.0500423163175583, + 1.2517154049128294, + 0.05919471196830273, + 1.0030415039509535, + 0.7894370071589947, + 0.7511278986930847, + 1.4609192665666342, + 0.24263438023626804, + 0.7253944780677557, + 0.132976483553648, + 0.1764393299818039, + 2.089240588247776, + 0.5220468435436487, + 0.5104740541428328, + 0.6715976875275373, + 1.5685521606355906, + 0.5694558564573526, + 0.5185047574341297, + 0.29480291716754436, + 2.3513047620654106, + 1.0544462315738201, + 0.2606737446039915, + 0.812744565308094, + 0.1973092034459114, + 3.3881888929754496, + 3.4710013195872307, + 0.7276751287281513, + 0.7441270761191845, + 0.7537533715367317, + 2.8460027389228344, + 2.2229686323553324, + 1.7087120469659567, + 2.6816549133509398, + 0.44953903555870056, + 0.7271126415580511, + 0.27843219973146915, + 1.5245892480015755, + 0.28363700211048126, + 0.1352226659655571, + 0.7558663971722126 + ], + "unique_experts": 63, + "load_cv": 0.6348134559439212, + "normalized_load_entropy": 0.951929462906564, + "max_load_share": 0.04685408299866131 + }, + "full_input": { + "tokens": 274, + "top_k": 6, + "decisions": 1644, + "ordered_route_sha256": "99badc765c059efa365535afab398d3b3f819d74c242ad3deccda63e0dc4750f", + "route_weight_sha256": "2c19cc4af57e289fe6207163b5d6d3f5a02884abd4bd855032f04417ef07eb8a", + "loads": [ + 33, + 17, + 71, + 25, + 35, + 34, + 33, + 11, + 30, + 49, + 32, + 70, + 29, + 54, + 22, + 23, + 0, + 17, + 22, + 20, + 22, + 12, + 17, + 17, + 41, + 31, + 2, + 28, + 33, + 24, + 19, + 9, + 18, + 8, + 14, + 32, + 16, + 16, + 22, + 40, + 11, + 18, + 11, + 46, + 27, + 7, + 19, + 11, + 38, + 44, + 18, + 21, + 29, + 31, + 39, + 31, + 49, + 16, + 29, + 9, + 41, + 22, + 4, + 25 + ], + "weighted_loads": [ + 1.4002875676378608, + 0.5146553423255682, + 2.467623718082905, + 1.055582107976079, + 1.9892408829182386, + 1.2021747570252046, + 1.2982126493006945, + 0.41559097170829773, + 3.2541330941021442, + 2.7275874856859446, + 2.6321104927919805, + 4.202162645757198, + 1.612611292861402, + 2.94758827239275, + 1.2361210100352764, + 2.0410103611648083, + 0.0, + 1.0046295057982206, + 0.9187018498778343, + 0.6601596642285585, + 0.7829548977315426, + 0.6146953999996185, + 0.9462162014096975, + 0.9105552714318037, + 1.35146276303567, + 1.2866242285817862, + 0.05919471196830273, + 1.0030415039509535, + 1.1449750922620296, + 1.1351145803928375, + 1.4609192665666342, + 0.2747609820216894, + 0.7544340789318085, + 0.2874980866909027, + 0.43493116553872824, + 2.1241557523608208, + 0.7014018874615431, + 1.4069390092045069, + 0.7091264072805643, + 1.5685521606355906, + 0.5694558564573526, + 0.5762344375252724, + 0.3355682594701648, + 2.3513047620654106, + 1.0544462315738201, + 0.35334847308695316, + 0.812744565308094, + 0.6188573557883501, + 3.3881888929754496, + 3.5462386459112167, + 0.903426256030798, + 1.1790965236723423, + 0.8379320278763771, + 3.038822464644909, + 2.2229686323553324, + 1.7087120469659567, + 2.6816549133509398, + 0.5290458016097546, + 1.0269977506250143, + 0.27843219973146915, + 1.6172850783914328, + 1.4040326895192266, + 0.18498373194597661, + 1.8041004166007042 + ], + "unique_experts": 63, + "load_cv": 0.5606834106804588, + "normalized_load_entropy": 0.9618161853417115, + "max_load_share": 0.04318734793187348 + } + }, + "s1_x": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "e1801af93c05024f7159dcf768ce8467b55d04694eea1beb610746e42242086c", + "route_weight_sha256": "654c85344188d7c584e1cb7c6a08ce3579e672092edc934d152c4f132faaec25", + "loads": [ + 32, + 16, + 65, + 27, + 38, + 24, + 29, + 8, + 21, + 50, + 23, + 69, + 29, + 54, + 20, + 22, + 0, + 16, + 23, + 20, + 24, + 11, + 7, + 16, + 38, + 31, + 2, + 27, + 27, + 16, + 19, + 8, + 19, + 4, + 8, + 31, + 14, + 14, + 22, + 40, + 9, + 16, + 10, + 45, + 24, + 6, + 18, + 5, + 36, + 42, + 14, + 15, + 20, + 26, + 40, + 32, + 52, + 15, + 23, + 6, + 38, + 9, + 3, + 26 + ], + "weighted_loads": [ + 1.3641774160787463, + 0.49552165158092976, + 2.2930673267692327, + 1.0881391577422619, + 2.0770180728286505, + 0.871779503300786, + 1.185797069221735, + 0.32661657594144344, + 2.7402058243751526, + 2.7758211456239223, + 2.2277826759964228, + 4.14030984416604, + 1.6273800591006875, + 2.926380595192313, + 1.1120922360569239, + 1.9251873083412647, + 0.0, + 0.9639111738651991, + 0.9348918031901121, + 0.6507477927953005, + 0.833517000079155, + 0.5886167734861374, + 0.26343837939202785, + 0.8556777238845825, + 1.1933184303343296, + 1.2879550363868475, + 0.05737633630633354, + 0.9825412649661303, + 0.9335777517408133, + 0.7160749044269323, + 1.4271253198385239, + 0.23534402810037136, + 0.7996708285063505, + 0.1298625785857439, + 0.2291224915534258, + 2.0926326997578144, + 0.5584439616650343, + 0.5093725770711899, + 0.6930658463388681, + 1.564076516777277, + 0.45953159406781197, + 0.5005020275712013, + 0.3355675656348467, + 2.267321478575468, + 0.9543896801769733, + 0.2833778113126755, + 0.7684675790369511, + 0.16566438600420952, + 3.3056320045143366, + 3.4394740629941225, + 0.7499067354947329, + 0.7595526836812496, + 0.558153759688139, + 2.8428586460649967, + 2.257226135581732, + 1.6934941709041595, + 2.7795881256461143, + 0.47253341786563396, + 0.7933059316128492, + 0.1859743520617485, + 1.5147495940327644, + 0.36330239102244377, + 0.16271019540727139, + 0.9094149302691221 + ], + "unique_experts": 63, + "load_cv": 0.6353101117138008, + "normalized_load_entropy": 0.9514326373119366, + "max_load_share": 0.04618473895582329 + }, + "full_input": { + "tokens": 290, + "top_k": 6, + "decisions": 1740, + "ordered_route_sha256": "deb154cab08c44ea7d5c5797b954e06ff1f864d1ff895b2ab9df510100ff8283", + "route_weight_sha256": "f2a64fd2a2ef777ae9dc79934e3959188f286c86fa15b52e173cdafeeb5803dc", + "loads": [ + 32, + 16, + 65, + 28, + 40, + 33, + 29, + 9, + 31, + 53, + 30, + 71, + 31, + 54, + 24, + 22, + 1, + 16, + 24, + 23, + 30, + 11, + 17, + 17, + 47, + 31, + 2, + 27, + 50, + 22, + 19, + 12, + 19, + 11, + 14, + 34, + 24, + 17, + 22, + 40, + 11, + 24, + 13, + 47, + 25, + 7, + 18, + 12, + 36, + 43, + 18, + 29, + 27, + 32, + 42, + 34, + 52, + 17, + 36, + 6, + 44, + 29, + 10, + 30 + ], + "weighted_loads": [ + 1.3641774160787463, + 0.49552165158092976, + 2.2930673267692327, + 1.2019291557371616, + 2.1381327155977488, + 1.1488581098383293, + 1.185797069221735, + 0.36257687769830227, + 3.4334864653646946, + 2.9059740602970123, + 2.552180693950504, + 4.20691953599453, + 1.6603179245721549, + 2.926380595192313, + 1.2480779979377985, + 1.9251873083412647, + 0.028667990118265152, + 0.9639111738651991, + 0.966319328173995, + 0.7665617633610964, + 1.0926374271512032, + 0.5886167734861374, + 1.0012692976742983, + 0.8810915797948837, + 1.5227100292686373, + 1.2879550363868475, + 0.05737633630633354, + 0.9825412649661303, + 2.0349455531686544, + 1.074188943952322, + 1.4271253198385239, + 0.3997002523392439, + 0.7996708285063505, + 0.4684257283806801, + 0.42948022531345487, + 2.2404577620327473, + 1.2740445900708437, + 1.454321637749672, + 0.6930658463388681, + 1.564076516777277, + 0.6095370501279831, + 0.9598170686513186, + 0.40688596991822124, + 2.474326517432928, + 0.993785347789526, + 0.3423592261970043, + 0.7684675790369511, + 0.7411135919392109, + 3.3056320045143366, + 3.5070508290082216, + 0.9417372960597277, + 1.7345727682113647, + 0.7601764798164368, + 3.1860284879803658, + 2.4334628880023956, + 1.7926561385393143, + 2.7795881256461143, + 0.5600258763879538, + 1.3724338244646788, + 0.1859743520617485, + 1.7132974602282047, + 2.1844877605326474, + 0.549751885002479, + 2.000625217333436 + ], + "unique_experts": 64, + "load_cv": 0.5377492570362057, + "normalized_load_entropy": 0.9643946450865343, + "max_load_share": 0.04080459770114943 + } + }, + "s0_period": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "bf21b9b1e292858226267ffc8b4657e35e627ff35c956398b6f7ef297cd63944", + "route_weight_sha256": "09c713819419641f937fff1051258914205203b9265fb19efedd301796a9c9c8", + "loads": [ + 33, + 16, + 67, + 24, + 35, + 27, + 36, + 8, + 22, + 49, + 22, + 68, + 27, + 54, + 20, + 22, + 0, + 16, + 22, + 22, + 21, + 13, + 9, + 17, + 32, + 29, + 2, + 27, + 21, + 17, + 19, + 9, + 17, + 4, + 7, + 29, + 17, + 13, + 22, + 40, + 11, + 18, + 11, + 44, + 28, + 5, + 20, + 6, + 37, + 44, + 14, + 15, + 26, + 27, + 37, + 31, + 52, + 14, + 19, + 10, + 40, + 7, + 2, + 21 + ], + "weighted_loads": [ + 1.4064706237986684, + 0.4932877328246832, + 2.3343899827450514, + 1.0326246321201324, + 1.98961759544909, + 1.001368310302496, + 1.3898859061300755, + 0.3041085973381996, + 2.7708075921982527, + 2.730986077338457, + 2.2256404887884855, + 4.140682885423303, + 1.5413143299520016, + 2.9564771205186844, + 1.151996050029993, + 1.9944625198841095, + 0.0, + 0.9967388659715652, + 0.9314249586313963, + 0.7231225874274969, + 0.7505214512348175, + 0.6368568278849125, + 0.34603619761765003, + 0.9124539811164141, + 1.0087308045476675, + 1.2096141744405031, + 0.06520658545196056, + 0.9857717454433441, + 0.7050284687429667, + 0.7535951472818851, + 1.4516325537115335, + 0.26956109143793583, + 0.7354169581085443, + 0.10678249504417181, + 0.19671049900352955, + 2.0200803745537996, + 0.6585313510149717, + 0.4722811747342348, + 0.7035575266927481, + 1.574010744690895, + 0.5685561299324036, + 0.551946122199297, + 0.3551151268184185, + 2.2795002572238445, + 1.0993136018514633, + 0.274572366848588, + 0.8561625685542822, + 0.19777585938572884, + 3.3452163469046354, + 3.496289426460862, + 0.7115725707262754, + 0.7359837256371975, + 0.7468551322817802, + 2.9165848959237337, + 2.184894585981965, + 1.6936477832496166, + 2.7753758784383535, + 0.45675182715058327, + 0.6907076351344585, + 0.30262238532304764, + 1.5879436004906893, + 0.2896757423877716, + 0.13674204051494598, + 0.7436514683067799 + ], + "unique_experts": 63, + "load_cv": 0.6277733494864521, + "normalized_load_entropy": 0.952820341568517, + "max_load_share": 0.04551539491298527 + }, + "full_input": { + "tokens": 274, + "top_k": 6, + "decisions": 1644, + "ordered_route_sha256": "a9f0ed027c8a2042b2f8bc35d355d8ccf3c523b471d297207afbb7fef21749ff", + "route_weight_sha256": "9b79e06e941f37f7e5e4dedb38c5174e9eba125a62352271757ed43b16b6bda2", + "loads": [ + 34, + 16, + 70, + 24, + 35, + 32, + 36, + 10, + 30, + 49, + 31, + 68, + 28, + 54, + 23, + 22, + 0, + 16, + 22, + 23, + 22, + 13, + 16, + 17, + 41, + 29, + 2, + 27, + 30, + 24, + 19, + 11, + 18, + 7, + 14, + 29, + 19, + 15, + 22, + 40, + 11, + 21, + 14, + 45, + 28, + 6, + 20, + 11, + 37, + 45, + 19, + 22, + 30, + 30, + 37, + 31, + 52, + 16, + 27, + 10, + 43, + 23, + 4, + 24 + ], + "weighted_loads": [ + 1.4427817510440946, + 0.4932877328246832, + 2.4313565399497747, + 1.0326246321201324, + 1.98961759544909, + 1.1612142234807834, + 1.3898859061300755, + 0.399047426879406, + 3.1815418992191553, + 2.730986077338457, + 2.5922842449508607, + 4.140682885423303, + 1.5440499866381288, + 2.9564771205186844, + 1.25834671407938, + 1.9944625198841095, + 0.0, + 0.9967388659715652, + 0.9314249586313963, + 0.7632208447903395, + 0.7843923643231392, + 0.6368568278849125, + 0.9290246162563562, + 0.9124539811164141, + 1.347993495175615, + 1.2096141744405031, + 0.06520658545196056, + 0.9857717454433441, + 1.0615811254829168, + 1.1431324668228626, + 1.4516325537115335, + 0.33368388004601, + 0.7644565589725971, + 0.2613040981814265, + 0.4283821592107415, + 2.0200803745537996, + 0.7940082717686892, + 1.367969235405326, + 0.7035575266927481, + 1.574010744690895, + 0.5685561299324036, + 0.706573374569416, + 0.4322332078590989, + 2.316731110215187, + 1.0993136018514633, + 0.3318972084671259, + 0.8561625685542822, + 0.5965294372290373, + 3.3452163469046354, + 3.560734311118722, + 0.9699023459106684, + 1.2517983615398407, + 0.8607796411961317, + 3.0609147530049086, + 2.184894585981965, + 1.6936477832496166, + 2.7753758784383535, + 0.5433933436870575, + 0.9621955864131451, + 0.30262238532304764, + 1.6799306124448776, + 1.489405737258494, + 0.1831739970948547, + 1.793767772614956 + ], + "unique_experts": 63, + "load_cv": 0.5529862861048022, + "normalized_load_entropy": 0.9627283902538373, + "max_load_share": 0.04257907542579075 + } + }, + "s1_period": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "ddb715ca64cb381a94b0acd9fb3305bb9cf51a6123cff71855dd54dedeb60f4a", + "route_weight_sha256": "0076954aa0ffa686f0e31a90b26749abce8f874290409ac0168696a72ffe7ac2", + "loads": [ + 32, + 18, + 67, + 25, + 39, + 23, + 30, + 8, + 21, + 50, + 21, + 70, + 28, + 53, + 19, + 22, + 0, + 17, + 24, + 25, + 24, + 11, + 7, + 16, + 32, + 33, + 2, + 26, + 30, + 15, + 19, + 6, + 17, + 6, + 6, + 29, + 14, + 16, + 24, + 40, + 11, + 18, + 10, + 47, + 26, + 5, + 17, + 5, + 37, + 44, + 14, + 15, + 18, + 25, + 39, + 32, + 51, + 14, + 21, + 7, + 37, + 7, + 2, + 27 + ], + "weighted_loads": [ + 1.3668926572427154, + 0.5500911343842745, + 2.3350325655192137, + 1.0323152802884579, + 2.1018581315875053, + 0.8419492784887552, + 1.2428231481462717, + 0.3211796972900629, + 2.75158404558897, + 2.754129795357585, + 2.168103337287903, + 4.173989223316312, + 1.5911401603370905, + 2.9019355215132236, + 1.086052905768156, + 1.9388777948915958, + 0.0, + 0.990665452554822, + 0.9759697746485472, + 0.815343052148819, + 0.8967203982174397, + 0.5839453935623169, + 0.2669756058603525, + 0.8582524005323648, + 1.0349291320890188, + 1.315107325091958, + 0.07487920671701431, + 0.9588505551218987, + 1.009566681459546, + 0.6920195855200291, + 1.427801813930273, + 0.17081161960959435, + 0.7376564238220453, + 0.1740731606259942, + 0.16845711134374142, + 2.0332470536231995, + 0.5302770640701056, + 0.5737725589424372, + 0.7360720746219158, + 1.5670833736658096, + 0.5397768318653107, + 0.5593869965523481, + 0.3301780838519335, + 2.3657322954386473, + 1.0238430425524712, + 0.2596622724086046, + 0.7474671453237534, + 0.16373942606151104, + 3.3149327859282494, + 3.4874571077525616, + 0.7399760540574789, + 0.7806099317967892, + 0.5101814400404692, + 2.8239954728633165, + 2.2403506841510534, + 1.7054066136479378, + 2.7407502196729183, + 0.44070157781243324, + 0.7359235938638449, + 0.21411511860787868, + 1.4713399969041348, + 0.2755245193839073, + 0.13601625710725784, + 0.9472433310002089 + ], + "unique_experts": 63, + "load_cv": 0.6422229650382524, + "normalized_load_entropy": 0.950364594679052, + "max_load_share": 0.04685408299866131 + }, + "full_input": { + "tokens": 290, + "top_k": 6, + "decisions": 1740, + "ordered_route_sha256": "ca9dacaadb6225b21d7ccab67137875352d2e022b90802942b3dfb6895a6b6ba", + "route_weight_sha256": "5b60b19bd2f5c467f7c7d867e00f5c29288637b036214d4e194874e577c2cb87", + "loads": [ + 32, + 18, + 67, + 26, + 41, + 32, + 30, + 11, + 30, + 53, + 28, + 72, + 30, + 53, + 25, + 22, + 1, + 17, + 25, + 28, + 29, + 11, + 16, + 17, + 41, + 33, + 2, + 26, + 53, + 21, + 19, + 9, + 17, + 12, + 12, + 31, + 22, + 20, + 25, + 40, + 13, + 27, + 13, + 50, + 27, + 6, + 17, + 12, + 37, + 45, + 20, + 29, + 25, + 30, + 41, + 34, + 51, + 15, + 35, + 7, + 42, + 27, + 9, + 31 + ], + "weighted_loads": [ + 1.3668926572427154, + 0.5500911343842745, + 2.3350325655192137, + 1.1461052782833576, + 2.1629727743566036, + 1.1171184260165319, + 1.2428231481462717, + 0.44080338813364506, + 3.3898095600306988, + 2.884282710030675, + 2.482750433962792, + 4.240598915144801, + 1.6240780258085579, + 2.9019355215132236, + 1.2727915849536657, + 1.9388777948915958, + 0.028667990118265152, + 0.990665452554822, + 1.00739729963243, + 0.9387974701821804, + 1.1225411891937256, + 0.5839453935623169, + 0.9501233100891113, + 0.883666256442666, + 1.3643207310233265, + 1.315107325091958, + 0.07487920671701431, + 0.9588505551218987, + 2.134628316387534, + 1.055339002981782, + 1.427801813930273, + 0.3090420924127102, + 0.7376564238220453, + 0.4747406644746661, + 0.37233997927978635, + 2.1338242180645466, + 1.0999347548931837, + 1.5542247612029314, + 0.7728298231959343, + 1.5670833736658096, + 0.6852433942258358, + 1.078507736325264, + 0.401496488135308, + 2.6136490385979414, + 1.0632387101650238, + 0.31864368729293346, + 0.7474671453237534, + 0.7565189246088266, + 3.3149327859282494, + 3.555875960737467, + 1.0429239738732576, + 1.7741516157984734, + 0.712204160168767, + 3.148693235591054, + 2.4165874365717173, + 1.8045685812830925, + 2.7407502196729183, + 0.4887920878827572, + 1.33674112893641, + 0.21411511860787868, + 1.6374524235725403, + 2.0892607015557587, + 0.5270150394644588, + 2.0391776356846094 + ], + "unique_experts": 64, + "load_cv": 0.5404939437804192, + "normalized_load_entropy": 0.9642378747146788, + "max_load_share": 0.041379310344827586 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 249, + "ordered_topk_exact_tokens": 149, + "set_exact_tokens": 183, + "mean_set_jaccard": 0.9234079173838211, + "mean_token_weighted_tv": 0.011434338818562317, + "aggregate_load_tv": 0.022088353413654626 + }, + "system_bos": { + "tokens": 249, + "ordered_topk_exact_tokens": 140, + "set_exact_tokens": 175, + "mean_set_jaccard": 0.9107860011474469, + "mean_token_weighted_tv": 0.0135452340779654, + "aggregate_load_tv": 0.021419009370816595 + }, + "system_x": { + "tokens": 249, + "ordered_topk_exact_tokens": 119, + "set_exact_tokens": 154, + "mean_set_jaccard": 0.8841078600114743, + "mean_token_weighted_tv": 0.017974529484563684, + "aggregate_load_tv": 0.03145917001338689 + }, + "system_period": { + "tokens": 249, + "ordered_topk_exact_tokens": 103, + "set_exact_tokens": 143, + "mean_set_jaccard": 0.872346528973035, + "mean_token_weighted_tv": 0.019683788205126684, + "aggregate_load_tv": 0.03614457831325301 + }, + "bos_at_s0": { + "tokens": 249, + "ordered_topk_exact_tokens": 138, + "set_exact_tokens": 171, + "mean_set_jaccard": 0.9079173838209982, + "mean_token_weighted_tv": 0.014690724635369566, + "aggregate_load_tv": 0.024096385542168676 + }, + "bos_at_s1": { + "tokens": 249, + "ordered_topk_exact_tokens": 123, + "set_exact_tokens": 159, + "mean_set_jaccard": 0.8907056798623062, + "mean_token_weighted_tv": 0.01696426082537117, + "aggregate_load_tv": 0.03145917001338688 + }, + "x_at_s0": { + "tokens": 249, + "ordered_topk_exact_tokens": 132, + "set_exact_tokens": 158, + "mean_set_jaccard": 0.891279403327596, + "mean_token_weighted_tv": 0.01648438536939791, + "aggregate_load_tv": 0.02543507362784471 + }, + "x_at_s1": { + "tokens": 249, + "ordered_topk_exact_tokens": 112, + "set_exact_tokens": 148, + "mean_set_jaccard": 0.8758844903423216, + "mean_token_weighted_tv": 0.019631715046324164, + "aggregate_load_tv": 0.033467202141900944 + }, + "period_at_s0": { + "tokens": 249, + "ordered_topk_exact_tokens": 127, + "set_exact_tokens": 162, + "mean_set_jaccard": 0.8932874354561101, + "mean_token_weighted_tv": 0.016663579692892044, + "aggregate_load_tv": 0.024765729585006703 + }, + "period_at_s1": { + "tokens": 249, + "ordered_topk_exact_tokens": 124, + "set_exact_tokens": 151, + "mean_set_jaccard": 0.8765538343851595, + "mean_token_weighted_tv": 0.01973852302774368, + "aggregate_load_tv": 0.040829986613119144 + } + } + }, + "layer_25": { + "layer": 25, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "250bab571791b85bdbd775567de3426e987de30f310fe8109c7e8586b78bf7ae", + "route_weight_sha256": "6c8170a7781b1cd2859234f1eb2ab69f2ab4d2a05833ae05c0e1dc90ce021846", + "loads": [ + 11, + 11, + 12, + 10, + 15, + 45, + 4, + 20, + 9, + 34, + 21, + 24, + 13, + 18, + 48, + 16, + 38, + 19, + 13, + 20, + 36, + 10, + 28, + 4, + 47, + 4, + 7, + 47, + 35, + 2, + 149, + 19, + 7, + 9, + 22, + 42, + 18, + 8, + 22, + 5, + 38, + 1, + 23, + 24, + 17, + 9, + 13, + 22, + 27, + 8, + 29, + 70, + 23, + 46, + 4, + 37, + 29, + 30, + 13, + 14, + 33, + 31, + 13, + 18 + ], + "weighted_loads": [ + 0.5838122088462114, + 0.952188553288579, + 0.3704784456640482, + 0.7329589631408453, + 0.826682809740305, + 2.742044886574149, + 0.1918568667024374, + 1.1226436644792557, + 0.2797206398099661, + 1.2307562939822674, + 0.9565628226846457, + 1.2613462843000889, + 0.5203065890818834, + 0.577588627114892, + 3.3986601252108812, + 0.5623349063098431, + 2.706984279677272, + 1.0716304630041122, + 0.5042561423033476, + 0.9935501348227262, + 1.9980585761368275, + 0.30230044573545456, + 1.0338921155780554, + 0.12995151430368423, + 2.6661229748278856, + 0.11063758842647076, + 0.21486568078398705, + 2.898191299289465, + 1.3360801599919796, + 0.06377428211271763, + 9.379419980570674, + 1.4218394123017788, + 0.21744919382035732, + 0.3401546124368906, + 0.6078047659248114, + 3.1776266284286976, + 0.6247002650052309, + 0.2701715752482414, + 3.166590169072151, + 0.5828455202281475, + 1.717102363705635, + 0.048551108688116074, + 1.3965249210596085, + 0.9083022382110357, + 1.3090311251580715, + 0.6786630302667618, + 0.44993186369538307, + 1.952515022829175, + 2.4105308167636395, + 0.2819750998169184, + 1.5847284384071827, + 3.895791184157133, + 2.1940352264791727, + 2.5877040699124336, + 0.16846412606537342, + 2.2767886128276587, + 1.188366124406457, + 0.914990670979023, + 0.5997606571763754, + 0.6415258925408125, + 1.484461596235633, + 2.7136689722537994, + 0.3927405923604965, + 0.5880667101591825 + ], + "unique_experts": 64, + "load_cv": 0.9038028461462372, + "normalized_load_entropy": 0.9287338812474095, + "max_load_share": 0.0997322623828648 + }, + "full_input": { + "tokens": 274, + "top_k": 6, + "decisions": 1644, + "ordered_route_sha256": "29421d5ab2520a980101dcae6fb33e3696549e12b8f2e3bff51b0f7f161744b7", + "route_weight_sha256": "c0b0ea2a60c58763c101f12c3ac16e580da2193a8c515c52231d6d6c1a46d935", + "loads": [ + 14, + 29, + 17, + 12, + 15, + 45, + 10, + 21, + 9, + 34, + 30, + 28, + 15, + 18, + 48, + 16, + 38, + 23, + 13, + 20, + 36, + 11, + 28, + 8, + 47, + 4, + 7, + 47, + 36, + 4, + 150, + 20, + 8, + 10, + 24, + 42, + 18, + 10, + 34, + 7, + 44, + 1, + 23, + 25, + 22, + 19, + 17, + 22, + 27, + 9, + 40, + 70, + 30, + 46, + 12, + 37, + 30, + 32, + 13, + 15, + 35, + 32, + 18, + 19 + ], + "weighted_loads": [ + 0.8735267985612154, + 2.3656926739495248, + 0.6939489860087633, + 0.8272731471806765, + 0.826682809740305, + 2.742044886574149, + 0.6015820968896151, + 1.1567640751600266, + 0.2797206398099661, + 1.2307562939822674, + 1.8734693843871355, + 1.9072345858439803, + 0.6806298214942217, + 0.577588627114892, + 3.3986601252108812, + 0.5623349063098431, + 2.706984279677272, + 1.201488958671689, + 0.5042561423033476, + 0.9935501348227262, + 1.9980585761368275, + 0.36191532015800476, + 1.0338921155780554, + 0.27845973521471024, + 2.6661229748278856, + 0.11063758842647076, + 0.21486568078398705, + 2.898191299289465, + 1.3772374093532562, + 0.13315466977655888, + 9.418056590482593, + 1.5214880593121052, + 0.2698913346976042, + 0.4039469752460718, + 0.7066553439944983, + 3.1776266284286976, + 0.6247002650052309, + 0.40515270829200745, + 4.669510094448924, + 0.7829276733100414, + 1.975190319120884, + 0.048551108688116074, + 1.3965249210596085, + 0.9414101596921682, + 1.7027407214045525, + 1.5127451121807098, + 0.589818790787831, + 1.952515022829175, + 2.4105308167636395, + 0.3094920925796032, + 2.237658493220806, + 3.895791184157133, + 2.579914394300431, + 2.5877040699124336, + 0.5588037185370922, + 2.2767886128276587, + 1.237967537716031, + 0.9853758290410042, + 0.5997606571763754, + 0.7698586713522673, + 1.5807356853038073, + 2.754353515803814, + 0.7970582209527493, + 0.642659256234765 + ], + "unique_experts": 64, + "load_cv": 0.8069023104160187, + "normalized_load_entropy": 0.9422083279829645, + "max_load_share": 0.09124087591240876 + } + }, + "s1_eos": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "442748fee7751ae2e5b4211b3fe0954e6466736c4233cc079956ea139537a3de", + "route_weight_sha256": "0f96876e767b047d7626bb027a5586ccaa6d959dbb39415f04a855d53fa2f665", + "loads": [ + 12, + 11, + 12, + 9, + 14, + 46, + 6, + 21, + 8, + 28, + 21, + 24, + 12, + 17, + 48, + 16, + 38, + 19, + 14, + 19, + 36, + 10, + 26, + 4, + 49, + 4, + 8, + 47, + 34, + 2, + 150, + 19, + 9, + 9, + 25, + 42, + 18, + 9, + 22, + 4, + 36, + 1, + 20, + 24, + 17, + 9, + 13, + 22, + 27, + 8, + 30, + 70, + 22, + 45, + 6, + 38, + 28, + 33, + 15, + 14, + 34, + 31, + 11, + 18 + ], + "weighted_loads": [ + 0.6076573524624109, + 0.9551840201020241, + 0.38326263055205345, + 0.6777528412640095, + 0.7893435079604387, + 2.768644016236067, + 0.24971774965524673, + 1.1560921762138605, + 0.24736367166042328, + 1.0531498901546001, + 0.9227893836796284, + 1.2700548619031906, + 0.4996785558760166, + 0.5554630570113659, + 3.392624393105507, + 0.5543487165123224, + 2.6984665635973215, + 1.0717152319848537, + 0.5187763478606939, + 0.9553238656371832, + 2.0062749329954386, + 0.3258614260703325, + 0.980743732303381, + 0.12496853061020374, + 2.7548369020223618, + 0.108945706859231, + 0.23312097787857056, + 2.8975462522357702, + 1.2905583456158638, + 0.06436993554234505, + 9.45317886210978, + 1.4336112812161446, + 0.27506816200912, + 0.3405839093029499, + 0.6955052930861712, + 3.164989709854126, + 0.6233185939490795, + 0.3008490428328514, + 3.1789970714598894, + 0.5033818129450083, + 1.6453442722558975, + 0.04671492427587509, + 1.2987860217690468, + 0.8941783644258976, + 1.3115984797477722, + 0.68819759786129, + 0.43969120271503925, + 1.9427256751805544, + 2.395806571468711, + 0.2841329015791416, + 1.6380031425505877, + 3.9081596340984106, + 2.1402716524899006, + 2.586626596748829, + 0.219215901568532, + 2.3014315459877253, + 1.1666473541408777, + 1.0120989847928286, + 0.6632742527872324, + 0.6350439190864563, + 1.5316322688013315, + 2.7203425131738186, + 0.33814012072980404, + 0.5911482088267803 + ], + "unique_experts": 64, + "load_cv": 0.9057676760134739, + "normalized_load_entropy": 0.9294352855719916, + "max_load_share": 0.10040160642570281 + }, + "full_input": { + "tokens": 290, + "top_k": 6, + "decisions": 1740, + "ordered_route_sha256": "3fe976c60d006a2ef0911d3804abf8ba7014f950c36110a6985119758e972853", + "route_weight_sha256": "1ec0c71ad511cf915d3fd7af2ff90416c0d151c657e1e8bbe925bc60836d4e49", + "loads": [ + 16, + 35, + 20, + 10, + 14, + 47, + 14, + 22, + 10, + 29, + 44, + 28, + 16, + 17, + 48, + 17, + 38, + 27, + 15, + 20, + 39, + 18, + 26, + 10, + 49, + 4, + 9, + 47, + 35, + 5, + 151, + 22, + 14, + 10, + 27, + 42, + 19, + 16, + 31, + 8, + 44, + 1, + 21, + 25, + 26, + 24, + 16, + 22, + 27, + 9, + 43, + 70, + 30, + 51, + 18, + 39, + 31, + 37, + 15, + 16, + 38, + 33, + 16, + 19 + ], + "weighted_loads": [ + 1.030632534995675, + 2.904494196875021, + 0.8326701391488314, + 0.7434004805982113, + 0.7893435079604387, + 2.807709965854883, + 0.8722086735069752, + 1.1886471901088953, + 0.362201564013958, + 1.0817337650805712, + 2.895841419696808, + 1.9711459018290043, + 0.786558486521244, + 0.5554630570113659, + 3.392624393105507, + 0.596999192610383, + 2.6984665635973215, + 1.713954847306013, + 0.5716972555965185, + 0.9792944584041834, + 2.264901803806424, + 1.0218750275671482, + 0.980743732303381, + 0.349222831428051, + 2.7548369020223618, + 0.108945706859231, + 0.2663162909448147, + 2.8975462522357702, + 1.3375917188823223, + 0.17243896424770355, + 9.496796602383256, + 1.900100477039814, + 0.5044541079550982, + 0.3922487683594227, + 0.8061022590845823, + 3.164989709854126, + 0.6668764390051365, + 0.6290672514587641, + 4.831911100074649, + 0.8867083583027124, + 2.042088359594345, + 0.04671492427587509, + 1.3852400705218315, + 0.924097528681159, + 2.0077739134430885, + 1.9905772153288126, + 0.535699815955013, + 1.9427256751805544, + 2.395806571468711, + 0.31225791946053505, + 2.3864021599292755, + 3.9081596340984106, + 2.6314175785519183, + 3.0566520541906357, + 1.0035048201680183, + 2.3281305264681578, + 1.2857252787798643, + 1.1617702823132277, + 0.6632742527872324, + 0.8655681908130646, + 1.7762239668518305, + 2.8050798773765564, + 0.7613442782312632, + 0.6526175402104855 + ], + "unique_experts": 64, + "load_cv": 0.7626053485850857, + "normalized_load_entropy": 0.9477421770726328, + "max_load_share": 0.0867816091954023 + } + }, + "s0_bos": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "61fb6ac78ed29ccd462f6620dbbd9bf4d652ff407edd404d4649501d9af0f9b6", + "route_weight_sha256": "fe9aaa5fea923b0659da1be0ea2ed58d83e3a46a9472e0787d767942785c19e1", + "loads": [ + 14, + 11, + 10, + 11, + 16, + 45, + 6, + 20, + 8, + 28, + 22, + 24, + 13, + 20, + 48, + 17, + 38, + 20, + 14, + 19, + 37, + 7, + 27, + 5, + 48, + 3, + 7, + 49, + 35, + 3, + 147, + 17, + 8, + 9, + 23, + 40, + 18, + 9, + 20, + 5, + 35, + 1, + 20, + 24, + 17, + 9, + 12, + 21, + 29, + 10, + 30, + 70, + 23, + 46, + 5, + 38, + 32, + 28, + 15, + 12, + 33, + 32, + 11, + 20 + ], + "weighted_loads": [ + 0.666236212477088, + 0.9402440339326859, + 0.3278719838708639, + 0.7983718626201153, + 0.8396750092506409, + 2.7794160079210997, + 0.26924760825932026, + 1.1330499555915594, + 0.2638352382928133, + 1.0406320579349995, + 0.9759234972298145, + 1.253426069393754, + 0.528996754437685, + 0.6285113766789436, + 3.3797930851578712, + 0.5963879786431789, + 2.672537460923195, + 1.0903950240463018, + 0.5251547414809465, + 0.9670733939856291, + 2.0570714846253395, + 0.2109091393649578, + 1.0078795105218887, + 0.17737594805657864, + 2.728614343330264, + 0.08529535308480263, + 0.21456989087164402, + 2.992211490869522, + 1.3432376123964787, + 0.0839209258556366, + 9.271557310596108, + 1.3295154981315136, + 0.2443678267300129, + 0.3367075491696596, + 0.6218811627477407, + 3.119287556037307, + 0.6134676542133093, + 0.2987424060702324, + 3.0851789843291044, + 0.525867085903883, + 1.6186483092606068, + 0.04842290282249451, + 1.300665657967329, + 0.8937223851680756, + 1.2551408149302006, + 0.6784222573041916, + 0.420296149328351, + 1.9106181971728802, + 2.4801656659692526, + 0.3271671440452337, + 1.635514311492443, + 3.8936743661761284, + 2.1654359754174948, + 2.5916035156697035, + 0.19788319803774357, + 2.272754045203328, + 1.2913325764238834, + 0.8551507499068975, + 0.6568028815090656, + 0.5754839330911636, + 1.4954902548342943, + 2.761278750374913, + 0.3382899072021246, + 0.6297771781682968 + ], + "unique_experts": 64, + "load_cv": 0.8935289210284952, + "normalized_load_entropy": 0.9304497756809478, + "max_load_share": 0.09839357429718876 + }, + "full_input": { + "tokens": 274, + "top_k": 6, + "decisions": 1644, + "ordered_route_sha256": "96b46c073bd77cf0bc6aef52598c42ebf5cb3c6cb617dbca3b5982897fe08020", + "route_weight_sha256": "6d3a30f1e79cd36d070b0524cff9b280933a2f1b6702deb9b753715d6a03a086", + "loads": [ + 16, + 29, + 16, + 13, + 16, + 45, + 12, + 22, + 8, + 28, + 32, + 26, + 16, + 21, + 48, + 17, + 38, + 24, + 14, + 19, + 37, + 8, + 27, + 9, + 48, + 3, + 7, + 49, + 36, + 5, + 149, + 18, + 9, + 10, + 25, + 40, + 18, + 10, + 31, + 6, + 41, + 2, + 20, + 25, + 22, + 18, + 15, + 21, + 29, + 12, + 41, + 70, + 29, + 46, + 14, + 38, + 32, + 31, + 15, + 13, + 34, + 33, + 16, + 22 + ], + "weighted_loads": [ + 0.8880963269621134, + 2.319095355225727, + 0.7703166026622057, + 0.9781725369393826, + 0.8396750092506409, + 2.7794160079210997, + 0.6789728384464979, + 1.217863118276, + 0.2638352382928133, + 1.0406320579349995, + 1.962538193911314, + 1.847253119572997, + 0.7358614094555378, + 0.6736000068485737, + 3.3797930851578712, + 0.5963879786431789, + 2.672537460923195, + 1.2202535197138786, + 0.5251547414809465, + 0.9670733939856291, + 2.0570714846253395, + 0.26950910314917564, + 1.0078795105218887, + 0.3279299717396498, + 2.728614343330264, + 0.08529535308480263, + 0.21456989087164402, + 2.992211490869522, + 1.3843948617577553, + 0.1533997878432274, + 9.554036198183894, + 1.42916414514184, + 0.29680996760725975, + 0.40049991197884083, + 0.7305430043488741, + 3.119287556037307, + 0.6134676542133093, + 0.38700278103351593, + 3.6832016445696354, + 0.6811720244586468, + 1.8767362646758556, + 0.0969298928976059, + 1.300665657967329, + 0.9268303066492081, + 1.6448455341160297, + 1.4708774667233229, + 0.5744456518441439, + 1.9106181971728802, + 2.4801656659692526, + 0.3965117558836937, + 2.2896477729082108, + 3.8936743661761284, + 2.5586475413292646, + 2.5916035156697035, + 0.6491119414567947, + 2.272754045203328, + 1.2913325764238834, + 0.9715650696307421, + 0.6568028815090656, + 0.7034913152456284, + 1.5483064372092485, + 2.8021918181329966, + 0.7426075357943773, + 0.710050668567419 + ], + "unique_experts": 64, + "load_cv": 0.7996801119850186, + "normalized_load_entropy": 0.9435689666513714, + "max_load_share": 0.09063260340632603 + } + }, + "s1_bos": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "6c3540e7710deea042fe4b4b2a42343765b7a7dd102326598e670f63d0ec28e2", + "route_weight_sha256": "2257ab5f371babcfbc480711990808433d539b32cc4927b4ec9dde7f004508bb", + "loads": [ + 12, + 12, + 11, + 11, + 16, + 46, + 5, + 20, + 8, + 27, + 23, + 23, + 14, + 20, + 49, + 16, + 37, + 19, + 14, + 19, + 39, + 8, + 28, + 5, + 47, + 3, + 8, + 49, + 35, + 2, + 149, + 18, + 9, + 9, + 19, + 41, + 18, + 8, + 22, + 4, + 36, + 1, + 20, + 24, + 17, + 9, + 10, + 21, + 28, + 10, + 29, + 68, + 23, + 45, + 6, + 37, + 30, + 32, + 15, + 13, + 34, + 31, + 9, + 23 + ], + "weighted_loads": [ + 0.6053251214325428, + 0.9780754949897528, + 0.3653495442122221, + 0.7783494163304567, + 0.8445149194449186, + 2.824193576350808, + 0.2347869984805584, + 1.1484383307397366, + 0.2733226381242275, + 1.0039229895919561, + 1.0206827390938997, + 1.2273792047053576, + 0.5616400707513094, + 0.6304290220141411, + 3.4674413446336985, + 0.5411843210458755, + 2.6586576625704765, + 1.066813986748457, + 0.528262035921216, + 0.9641715288162231, + 2.0967680253088474, + 0.24915501847863197, + 1.0442578829824924, + 0.1915662046521902, + 2.6697513218969107, + 0.08269294165074825, + 0.2389871347695589, + 2.9723175019025803, + 1.32575230486691, + 0.05700593627989292, + 9.401056786999106, + 1.374180682003498, + 0.27898827008903027, + 0.34214059822261333, + 0.5226765479892492, + 3.147288730368018, + 0.607732716947794, + 0.26738644391298294, + 3.149548005312681, + 0.4685287978500128, + 1.6615120824426413, + 0.04880068823695183, + 1.2969886809587479, + 0.9080055989325047, + 1.288843497633934, + 0.6780243217945099, + 0.3525187522172928, + 1.933222722262144, + 2.447145963087678, + 0.3183984328061342, + 1.5813033673912287, + 3.828410241752863, + 2.160549033433199, + 2.5754988715052605, + 0.2384541891515255, + 2.234826784580946, + 1.2563122138381004, + 0.9482049457728863, + 0.6548603642731905, + 0.5970695726573467, + 1.5479360446333885, + 2.7331175543367863, + 0.288583280518651, + 0.7093121483922005 + ], + "unique_experts": 64, + "load_cv": 0.9008475661224953, + "normalized_load_entropy": 0.9294706382530633, + "max_load_share": 0.0997322623828648 + }, + "full_input": { + "tokens": 290, + "top_k": 6, + "decisions": 1740, + "ordered_route_sha256": "d5cb2b9cefd2649fea0b2ac11e935bf5179ac291f31e0c5fd74dfed1ef7420b4", + "route_weight_sha256": "475fa57ede68eb6a16ab52f4e5efb449f23498137b49a20eac7fc6ef1a435922", + "loads": [ + 16, + 37, + 20, + 12, + 16, + 47, + 13, + 21, + 10, + 28, + 47, + 26, + 19, + 21, + 49, + 17, + 37, + 27, + 15, + 20, + 42, + 16, + 28, + 11, + 47, + 3, + 9, + 49, + 36, + 4, + 150, + 21, + 15, + 10, + 22, + 41, + 19, + 15, + 30, + 7, + 44, + 1, + 21, + 26, + 26, + 24, + 12, + 21, + 28, + 11, + 42, + 68, + 30, + 51, + 18, + 38, + 32, + 36, + 15, + 15, + 37, + 33, + 14, + 24 + ], + "weighted_loads": [ + 1.0214996226131916, + 2.9023252080660313, + 0.9272069782018661, + 0.8157268296927214, + 0.8445149194449186, + 2.8632595259696245, + 0.8572779223322868, + 1.180795319378376, + 0.3881605304777622, + 1.0325068645179272, + 3.0991696175187826, + 1.9081636313349009, + 0.9149545859545469, + 0.6739914752542973, + 3.4674413446336985, + 0.5708075985312462, + 2.6586576625704765, + 1.7090536020696163, + 0.5811829436570406, + 0.9881421215832233, + 2.355394896119833, + 0.9469592403620481, + 1.0442578829824924, + 0.4180540684610605, + 2.6697513218969107, + 0.08269294165074825, + 0.27218244783580303, + 2.9723175019025803, + 1.3727856781333685, + 0.1282284278422594, + 9.445855358615518, + 1.8406698778271675, + 0.5550900045782328, + 0.3938054572790861, + 0.6747657787054777, + 3.147288730368018, + 0.6512905620038509, + 0.6079712901264429, + 3.906744610518217, + 0.8007956985384226, + 2.058256169781089, + 0.04880068823695183, + 1.3834427297115326, + 0.9750543516129255, + 1.9837188422679901, + 1.9462605491280556, + 0.47812600433826447, + 1.933222722262144, + 2.447145963087678, + 0.36304949782788754, + 2.3279289938509464, + 3.828410241752863, + 2.653385426849127, + 3.0455243289470673, + 1.0227431077510118, + 2.2615257650613785, + 1.3485306948423386, + 1.1174780167639256, + 0.6548603642731905, + 0.8339959494769573, + 1.728739619255066, + 2.8193722553551197, + 0.7117874380201101, + 0.7733147889375687 + ], + "unique_experts": 64, + "load_cv": 0.7593552695671995, + "normalized_load_entropy": 0.9476300562209983, + "max_load_share": 0.08620689655172414 + } + }, + "s0_x": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "8fb74d3c38d0c23572b426410c86e3e46761cde3d772aa365f1291c1de4c1035", + "route_weight_sha256": "80c26a92ffc247e10fac222ab04f8b21d0e4c7971e56ae95b4695b5f42c7d0e3", + "loads": [ + 11, + 11, + 9, + 11, + 14, + 46, + 6, + 20, + 6, + 36, + 23, + 26, + 13, + 24, + 47, + 14, + 39, + 20, + 13, + 18, + 34, + 7, + 23, + 5, + 47, + 3, + 7, + 49, + 32, + 2, + 150, + 19, + 8, + 9, + 23, + 41, + 17, + 9, + 20, + 5, + 38, + 1, + 21, + 26, + 17, + 9, + 12, + 22, + 30, + 9, + 29, + 70, + 23, + 45, + 5, + 40, + 29, + 31, + 15, + 14, + 32, + 31, + 9, + 19 + ], + "weighted_loads": [ + 0.5773302093148232, + 0.9490527212619781, + 0.2902880199253559, + 0.7681935913860798, + 0.773924246430397, + 2.807814121246338, + 0.26067156717181206, + 1.1284373458474874, + 0.20388088002800941, + 1.291434470564127, + 1.034173484891653, + 1.3177160359919071, + 0.5145833659917116, + 0.7370434477925301, + 3.3736239690333605, + 0.48286785930395126, + 2.7413542587310076, + 1.1357145048677921, + 0.4991239830851555, + 0.9262538868933916, + 1.9480518754571676, + 0.21972319297492504, + 0.884480370208621, + 0.17007114179432392, + 2.7146079652011395, + 0.08940326049923897, + 0.2156153805553913, + 2.9585656616836786, + 1.2574151400476694, + 0.060408249497413635, + 9.448459377512336, + 1.3896581046283245, + 0.24505542404949665, + 0.33234111219644547, + 0.606246231123805, + 3.13539644703269, + 0.5918883346021175, + 0.2888323236256838, + 3.0838533211499453, + 0.5277629252523184, + 1.751395307481289, + 0.04974837973713875, + 1.348175536841154, + 0.9547714907675982, + 1.2764826640486717, + 0.6867034882307053, + 0.425306785851717, + 1.943060640245676, + 2.5074660386890173, + 0.29099390655755997, + 1.6068728975951672, + 3.89314866065979, + 2.2008688542991877, + 2.549408009275794, + 0.20142350532114506, + 2.3421695753932, + 1.1854647025465965, + 0.937944557517767, + 0.649867907166481, + 0.637716880068183, + 1.4780995678156614, + 2.7181099578738213, + 0.2939598634839058, + 0.5990187451243401 + ], + "unique_experts": 64, + "load_cv": 0.9117940070343723, + "normalized_load_entropy": 0.9275204650003167, + "max_load_share": 0.10040160642570281 + }, + "full_input": { + "tokens": 274, + "top_k": 6, + "decisions": 1644, + "ordered_route_sha256": "f5ed08aeae47925f7959232c37bf97b13762376259afa20f84ebebd4f08f31b1", + "route_weight_sha256": "147de9df731ecf43c361c2a335dce9f2f7e8d61318978a8a82b82fea54b52fb9", + "loads": [ + 14, + 30, + 14, + 12, + 14, + 46, + 14, + 21, + 6, + 36, + 32, + 29, + 15, + 25, + 47, + 14, + 39, + 24, + 13, + 18, + 34, + 8, + 23, + 9, + 47, + 3, + 7, + 49, + 33, + 4, + 151, + 21, + 9, + 10, + 24, + 41, + 17, + 10, + 32, + 6, + 45, + 1, + 21, + 27, + 22, + 18, + 15, + 22, + 31, + 10, + 40, + 70, + 30, + 45, + 14, + 40, + 29, + 33, + 15, + 15, + 33, + 32, + 15, + 20 + ], + "weighted_loads": [ + 0.8458572961390018, + 2.4046246490906924, + 0.6210470795631409, + 0.8033924922347069, + 0.773924246430397, + 2.807814121246338, + 0.7939990535378456, + 1.1616570893675089, + 0.20388088002800941, + 1.291434470564127, + 1.9475314170122147, + 1.9567691907286644, + 0.6724017504602671, + 0.7758553549647331, + 3.3736239690333605, + 0.48286785930395126, + 2.7413542587310076, + 1.265573000535369, + 0.4991239830851555, + 0.9262538868933916, + 1.9480518754571676, + 0.2756341602653265, + 0.884480370208621, + 0.3202547561377287, + 2.7146079652011395, + 0.08940326049923897, + 0.2156153805553913, + 2.9585656616836786, + 1.298572389408946, + 0.12561262398958206, + 9.488882513716817, + 1.5847557671368122, + 0.2974975649267435, + 0.3961334750056267, + 0.6554870773106813, + 3.13539644703269, + 0.5918883346021175, + 0.3585049007087946, + 3.788320831954479, + 0.6830678638070822, + 2.056930899620056, + 0.04974837973713875, + 1.348175536841154, + 0.9878794122487307, + 1.6647422388195992, + 1.5013247523456812, + 0.5751335285604, + 1.943060640245676, + 2.549438262358308, + 0.3172639664262533, + 2.259462181478739, + 3.89314866065979, + 2.703405300155282, + 2.549408009275794, + 0.6627803407609463, + 2.3421695753932, + 1.1854647025465965, + 1.0020221248269081, + 0.649867907166481, + 0.7994955535978079, + 1.5309157501906157, + 2.7529780082404613, + 0.7356538809835911, + 0.6541838832199574 + ], + "unique_experts": 64, + "load_cv": 0.8148745052263826, + "normalized_load_entropy": 0.9407674234671054, + "max_load_share": 0.09184914841849148 + } + }, + "s1_x": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "c63333937e8ae1351a11503ed2e8f111e28395116764f67e7fdf0a01d48e89cf", + "route_weight_sha256": "371345a4966c9b2a52f3393b7d08317f91eddcc71a6bc2360ba95d56be31ac47", + "loads": [ + 11, + 12, + 7, + 12, + 16, + 46, + 4, + 18, + 7, + 39, + 25, + 25, + 14, + 20, + 47, + 15, + 37, + 20, + 14, + 18, + 37, + 8, + 26, + 4, + 45, + 4, + 10, + 49, + 35, + 3, + 150, + 21, + 6, + 9, + 20, + 41, + 15, + 7, + 20, + 4, + 36, + 1, + 20, + 28, + 17, + 9, + 11, + 23, + 28, + 9, + 28, + 69, + 23, + 45, + 6, + 39, + 27, + 32, + 16, + 12, + 33, + 31, + 8, + 22 + ], + "weighted_loads": [ + 0.5697170179337263, + 0.9920950271189213, + 0.2538404315710068, + 0.7748734373599291, + 0.819861264899373, + 2.79310361482203, + 0.20694255642592907, + 1.0838227309286594, + 0.2242850624024868, + 1.456398094072938, + 1.1650997828692198, + 1.279889328405261, + 0.5551108177751303, + 0.6297621112316847, + 3.344662109389901, + 0.5087713785469532, + 2.6379453223198652, + 1.1398871801793575, + 0.49223860539495945, + 0.9008255712687969, + 2.058593465015292, + 0.25516030937433243, + 0.9576921872794628, + 0.15146779268980026, + 2.6374374516308308, + 0.11874337680637836, + 0.29676133021712303, + 2.9672922771424055, + 1.348033657297492, + 0.08171383664011955, + 9.369338100776076, + 1.4478945285081863, + 0.18745528161525726, + 0.310993030667305, + 0.5391380693763494, + 3.0745323467999697, + 0.5150088835507631, + 0.22480959258973598, + 3.0809466652572155, + 0.43897420540452003, + 1.6821897402405739, + 0.04753204062581062, + 1.2765958234667778, + 1.0091332737356424, + 1.3042956441640854, + 0.686772957444191, + 0.3670188020914793, + 1.9602707456797361, + 2.4079739172011614, + 0.28488488122820854, + 1.541653960943222, + 3.8239706605672836, + 2.1621895525604486, + 2.5870282277464867, + 0.23625309579074383, + 2.304157756268978, + 1.1361532602459192, + 0.9618249647319317, + 0.6835142634809017, + 0.5602068714797497, + 1.539265925064683, + 2.7097142301499844, + 0.27257485315203667, + 0.6865856871008873 + ], + "unique_experts": 64, + "load_cv": 0.9108815815735866, + "normalized_load_entropy": 0.9274180028189465, + "max_load_share": 0.10040160642570281 + }, + "full_input": { + "tokens": 290, + "top_k": 6, + "decisions": 1740, + "ordered_route_sha256": "9dc219ac940ffe3e8354eb999f92934823883b521c4ad575a5a0e45d58278192", + "route_weight_sha256": "b46b5ba798b2c93fdc74d012b2596108c81a6e162ad1dbfba86aa239666e3812", + "loads": [ + 14, + 37, + 15, + 12, + 16, + 47, + 14, + 19, + 9, + 40, + 48, + 28, + 18, + 20, + 47, + 17, + 37, + 29, + 15, + 19, + 40, + 16, + 26, + 11, + 45, + 4, + 11, + 49, + 36, + 5, + 151, + 25, + 11, + 10, + 22, + 41, + 16, + 13, + 29, + 7, + 44, + 1, + 21, + 29, + 27, + 23, + 12, + 23, + 28, + 9, + 43, + 69, + 32, + 51, + 19, + 40, + 29, + 36, + 16, + 14, + 36, + 33, + 13, + 23 + ], + "weighted_loads": [ + 0.9483420681208372, + 2.9563870436977595, + 0.7267620842903852, + 0.7748734373599291, + 0.819861264899373, + 2.8321695644408464, + 1.0186867956072092, + 1.1134169604629278, + 0.3391229547560215, + 1.484981968998909, + 3.141729800030589, + 1.9914201479405165, + 0.8278538677841425, + 0.6297621112316847, + 3.344662109389901, + 0.5828655250370502, + 2.6379453223198652, + 1.8304813131690025, + 0.545159513130784, + 0.9247961640357971, + 2.3172203358262777, + 0.9446845147758722, + 0.9576921872794628, + 0.4155790600925684, + 2.6374374516308308, + 0.11874337680637836, + 0.32995664328336716, + 2.9672922771424055, + 1.3950670305639505, + 0.15293632820248604, + 9.421516930684447, + 2.017866589128971, + 0.41684122756123543, + 0.36265788972377777, + 0.6432794909924269, + 3.0745323467999697, + 0.5585667286068201, + 0.5092628598213196, + 3.912058398127556, + 0.7712411060929298, + 2.0789338275790215, + 0.04753204062581062, + 1.3630498722195625, + 1.0390524379909039, + 2.0342676024883986, + 1.9481692798435688, + 0.40993129275739193, + 1.9602707456797361, + 2.4079739172011614, + 0.28488488122820854, + 2.43688396923244, + 3.8239706605672836, + 2.8261932749301195, + 3.0570536851882935, + 1.1129858829081059, + 2.3308567367494106, + 1.210928762331605, + 1.105149656534195, + 0.6835142634809017, + 0.7569348104298115, + 1.7200694996863604, + 2.794821560382843, + 0.6957790106534958, + 0.7501518651843071 + ], + "unique_experts": 64, + "load_cv": 0.7691192740116641, + "normalized_load_entropy": 0.9462067242818094, + "max_load_share": 0.0867816091954023 + } + }, + "s0_period": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "fdaac7fffb73196fb9f82c758daf027203147be50da03a435fb121d2dd54ce23", + "route_weight_sha256": "ae800797cd15ccbf5babb0aa8e2423e5ae9ac531408a6a98a1193d238e0688e3", + "loads": [ + 10, + 11, + 10, + 11, + 14, + 44, + 6, + 19, + 7, + 31, + 24, + 25, + 12, + 24, + 51, + 14, + 38, + 20, + 13, + 17, + 36, + 6, + 25, + 5, + 47, + 3, + 7, + 48, + 32, + 2, + 150, + 21, + 8, + 8, + 19, + 40, + 17, + 9, + 21, + 5, + 39, + 1, + 21, + 27, + 17, + 9, + 14, + 22, + 28, + 11, + 29, + 71, + 23, + 45, + 5, + 38, + 29, + 34, + 16, + 14, + 31, + 31, + 10, + 19 + ], + "weighted_loads": [ + 0.5439867861568928, + 0.9525316338986158, + 0.33036109432578087, + 0.7572179604321718, + 0.771974042057991, + 2.750572394579649, + 0.26185439713299274, + 1.1068056654185057, + 0.24491510540246964, + 1.1279090344905853, + 1.1018994823098183, + 1.2931668888777494, + 0.4846590179949999, + 0.7437520381063223, + 3.5074634850025177, + 0.4818213935941458, + 2.7302522007375956, + 1.0978030990809202, + 0.495948726311326, + 0.906453175470233, + 1.991590742021799, + 0.18542227521538734, + 0.9402516894042492, + 0.1664429996162653, + 2.7064828760921955, + 0.08535140752792358, + 0.21467620693147182, + 2.920839061960578, + 1.2336014192551374, + 0.061973582953214645, + 9.418172897771, + 1.4547872636467218, + 0.24885558150708675, + 0.29642499424517155, + 0.5100440066307783, + 3.100425139069557, + 0.6002684161067009, + 0.2914380691945553, + 3.154712887480855, + 0.5600735414773226, + 1.7981650587171316, + 0.04779873788356781, + 1.3316315151751041, + 0.9792581778019667, + 1.3070352040231228, + 0.6762530580163002, + 0.48869645968079567, + 1.9567729867994785, + 2.48897010833025, + 0.3508261665701866, + 1.6095967888832092, + 3.9307443406432867, + 2.187561372295022, + 2.569232476875186, + 0.20300132781267166, + 2.2916173096746206, + 1.2016379367560148, + 1.0393976401537657, + 0.6862016879022121, + 0.636828001588583, + 1.4463083408772945, + 2.735174862667918, + 0.3058036882430315, + 0.5976152643561363 + ], + "unique_experts": 64, + "load_cv": 0.9111963142501358, + "normalized_load_entropy": 0.9279021644987214, + "max_load_share": 0.10040160642570281 + }, + "full_input": { + "tokens": 274, + "top_k": 6, + "decisions": 1644, + "ordered_route_sha256": "ebc7a6299bf4051bdfc1f9f2dc44930f96226d527a48f0f32fe72a09e468bec0", + "route_weight_sha256": "f39aa3317cf7a4bb715d69f909cf219c087cda5b819e18f2fac4c63889459eaa", + "loads": [ + 13, + 30, + 15, + 11, + 14, + 44, + 12, + 20, + 8, + 31, + 34, + 28, + 15, + 25, + 51, + 15, + 38, + 24, + 13, + 17, + 36, + 7, + 25, + 9, + 47, + 3, + 7, + 48, + 33, + 4, + 151, + 22, + 9, + 9, + 21, + 40, + 17, + 10, + 32, + 6, + 45, + 1, + 21, + 28, + 22, + 19, + 17, + 22, + 28, + 11, + 40, + 71, + 30, + 45, + 13, + 38, + 30, + 36, + 16, + 15, + 33, + 32, + 15, + 22 + ], + "weighted_loads": [ + 0.8281632773578167, + 2.4796826641540974, + 0.6587570384144783, + 0.7572179604321718, + 0.771974042057991, + 2.750572394579649, + 0.6715796273201704, + 1.1411644537001848, + 0.28165897354483604, + 1.1279090344905853, + 2.0637954249978065, + 1.9297666009515524, + 0.6791176479309797, + 0.784259045496583, + 3.5074634850025177, + 0.5294491332024336, + 2.7302522007375956, + 1.227661594748497, + 0.495948726311326, + 0.906453175470233, + 1.991590742021799, + 0.24617060646414757, + 0.9402516894042492, + 0.3151810001581907, + 2.7064828760921955, + 0.08535140752792358, + 0.21467620693147182, + 2.920839061960578, + 1.274758668616414, + 0.12766970694065094, + 9.455772968009114, + 1.5544359106570482, + 0.3012977223843336, + 0.36021735705435276, + 0.6026933919638395, + 3.100425139069557, + 0.6002684161067009, + 0.3669023923575878, + 3.7420489564538, + 0.7153784800320864, + 2.0562530141323805, + 0.04779873788356781, + 1.3316315151751041, + 1.0123660992830992, + 1.697250410914421, + 1.6103191394358873, + 0.632958434522152, + 1.9567729867994785, + 2.48897010833025, + 0.3508261665701866, + 2.265387535095215, + 3.9307443406432867, + 2.597942402586341, + 2.569232476875186, + 0.5933409202843904, + 2.2916173096746206, + 1.2391018401831388, + 1.106365842744708, + 0.6862016879022121, + 0.7756304852664471, + 1.5412189960479736, + 2.7768341172486544, + 0.7101213168352842, + 0.8283471148461103 + ], + "unique_experts": 64, + "load_cv": 0.8156587298094132, + "normalized_load_entropy": 0.9407594887785095, + "max_load_share": 0.09184914841849148 + } + }, + "s1_period": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "9b54cf55ba4c3187593e68287073215c61c89bdb55692596b8161515fd5df568", + "route_weight_sha256": "530947da774617fe62e88160dd9074dabb0b330028308c056bd30fdc0d152627", + "loads": [ + 12, + 13, + 9, + 11, + 16, + 46, + 5, + 19, + 7, + 34, + 25, + 23, + 13, + 18, + 49, + 16, + 36, + 19, + 14, + 20, + 36, + 8, + 27, + 3, + 47, + 6, + 9, + 49, + 32, + 2, + 151, + 21, + 6, + 9, + 19, + 41, + 14, + 8, + 21, + 4, + 36, + 1, + 20, + 26, + 17, + 9, + 11, + 23, + 27, + 7, + 28, + 70, + 24, + 44, + 6, + 39, + 28, + 38, + 17, + 14, + 32, + 30, + 9, + 20 + ], + "weighted_loads": [ + 0.602608872577548, + 1.0287162121385336, + 0.3174319230020046, + 0.7502493560314178, + 0.8228909242898226, + 2.8016171529889107, + 0.23861812055110931, + 1.1053676195442677, + 0.23330029472708702, + 1.220287537202239, + 1.0928510762751102, + 1.206992194056511, + 0.5199928376823664, + 0.5852526519447565, + 3.425440302118659, + 0.5407461132854223, + 2.611576808616519, + 1.074775043874979, + 0.4953882787376642, + 0.9686075337231159, + 2.0035372246056795, + 0.25015304796397686, + 0.9909558314830065, + 0.10544878989458084, + 2.6901293098926544, + 0.1647617369890213, + 0.26954203471541405, + 2.94592522457242, + 1.2615926954895258, + 0.05257841385900974, + 9.447473905980587, + 1.491548988968134, + 0.18372423015534878, + 0.31300914846360683, + 0.5223327595740557, + 3.0872836895287037, + 0.483955979347229, + 0.25862262584269047, + 3.1401280630379915, + 0.44925228133797646, + 1.6899039149284363, + 0.048816289752721786, + 1.282805409282446, + 0.9509991277009249, + 1.3467390201985836, + 0.6833575814962387, + 0.37606846541166306, + 1.9508029110729694, + 2.3816082198172808, + 0.2397635616362095, + 1.5302893053740263, + 3.874232478439808, + 2.197303391993046, + 2.575852181762457, + 0.23469381965696812, + 2.2845029048621655, + 1.1796789485961199, + 1.1485969852656126, + 0.7038839440792799, + 0.6101810038089752, + 1.5078045893460512, + 2.685331529006362, + 0.293374290689826, + 0.646418783813715 + ], + "unique_experts": 64, + "load_cv": 0.9145885258386958, + "normalized_load_entropy": 0.9275237887618184, + "max_load_share": 0.10107095046854082 + }, + "full_input": { + "tokens": 290, + "top_k": 6, + "decisions": 1740, + "ordered_route_sha256": "ec0c29008ba67b22d6f1495a02da4191894f3b853d183d5a332c1e7d629b1f7f", + "route_weight_sha256": "36a800407e210896732abe9a26e514c793ef574785bce22657af89504c16beb5", + "loads": [ + 16, + 38, + 16, + 11, + 16, + 47, + 13, + 20, + 9, + 35, + 48, + 26, + 18, + 18, + 49, + 18, + 36, + 27, + 15, + 21, + 39, + 16, + 27, + 9, + 47, + 6, + 10, + 49, + 33, + 4, + 152, + 24, + 11, + 10, + 22, + 41, + 15, + 15, + 29, + 7, + 44, + 1, + 21, + 27, + 28, + 24, + 12, + 23, + 28, + 7, + 41, + 70, + 32, + 50, + 18, + 40, + 31, + 42, + 17, + 16, + 37, + 32, + 14, + 22 + ], + "weighted_loads": [ + 1.0553339924663305, + 3.036441760836169, + 0.7470018211752176, + 0.7502493560314178, + 0.8228909242898226, + 2.840683102607727, + 0.8611090444028378, + 1.1383396685123444, + 0.3481381870806217, + 1.24887141212821, + 3.0546928830444813, + 1.9215817600488663, + 0.8321274872869253, + 0.5852526519447565, + 3.425440302118659, + 0.6192024294286966, + 2.611576808616519, + 1.7170146591961384, + 0.5483091864734888, + 0.9925781264901161, + 2.262164095416665, + 0.9520044587552547, + 0.9909558314830065, + 0.3300447352230549, + 2.6901293098926544, + 0.1647617369890213, + 0.3027373477816582, + 2.94592522457242, + 1.3086260687559843, + 0.12380090542137623, + 9.49185797944665, + 1.9580381847918034, + 0.41311017610132694, + 0.3646740075200796, + 0.6745535973459482, + 3.0872836895287037, + 0.527513824403286, + 0.5673470534384251, + 3.9010853450745344, + 0.7815191820263863, + 2.086648002266884, + 0.048816289752721786, + 1.3692594580352306, + 0.9809182919561863, + 2.1224814895540476, + 1.991067886352539, + 0.4189809560775757, + 1.9508029110729694, + 2.4236279521137476, + 0.2397635616362095, + 2.283332161605358, + 3.874232478439808, + 2.7469222992658615, + 3.0458776392042637, + 1.0189827382564545, + 2.311201885342598, + 1.3059528078883886, + 1.2972426321357489, + 0.7038839440792799, + 0.7886899560689926, + 1.7939396556466818, + 2.771875998005271, + 0.7165784481912851, + 0.9303023256361485 + ], + "unique_experts": 64, + "load_cv": 0.7740506739003739, + "normalized_load_entropy": 0.9457414987326135, + "max_load_share": 0.08735632183908046 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 249, + "ordered_topk_exact_tokens": 167, + "set_exact_tokens": 198, + "mean_set_jaccard": 0.9388984509466437, + "mean_token_weighted_tv": 0.010342261357509706, + "aggregate_load_tv": 0.017402945113788485 + }, + "system_bos": { + "tokens": 249, + "ordered_topk_exact_tokens": 167, + "set_exact_tokens": 192, + "mean_set_jaccard": 0.9304838401223944, + "mean_token_weighted_tv": 0.011527785406743428, + "aggregate_load_tv": 0.01941097724230255 + }, + "system_x": { + "tokens": 249, + "ordered_topk_exact_tokens": 132, + "set_exact_tokens": 170, + "mean_set_jaccard": 0.9026582520558423, + "mean_token_weighted_tv": 0.01617126783213941, + "aggregate_load_tv": 0.026773761713520743 + }, + "system_period": { + "tokens": 249, + "ordered_topk_exact_tokens": 127, + "set_exact_tokens": 163, + "mean_set_jaccard": 0.8927137119908204, + "mean_token_weighted_tv": 0.017506711435575324, + "aggregate_load_tv": 0.028781793842034803 + }, + "bos_at_s0": { + "tokens": 249, + "ordered_topk_exact_tokens": 150, + "set_exact_tokens": 189, + "mean_set_jaccard": 0.9242685025817554, + "mean_token_weighted_tv": 0.013477001107301578, + "aggregate_load_tv": 0.02476572958500669 + }, + "bos_at_s1": { + "tokens": 249, + "ordered_topk_exact_tokens": 150, + "set_exact_tokens": 183, + "mean_set_jaccard": 0.9184356473513098, + "mean_token_weighted_tv": 0.014504885181305877, + "aggregate_load_tv": 0.022088353413654616 + }, + "x_at_s0": { + "tokens": 249, + "ordered_topk_exact_tokens": 149, + "set_exact_tokens": 182, + "mean_set_jaccard": 0.9162363740676993, + "mean_token_weighted_tv": 0.01408812263045445, + "aggregate_load_tv": 0.02610441767068273 + }, + "x_at_s1": { + "tokens": 249, + "ordered_topk_exact_tokens": 126, + "set_exact_tokens": 166, + "mean_set_jaccard": 0.8932874354561101, + "mean_token_weighted_tv": 0.018300423746457302, + "aggregate_load_tv": 0.03413654618473895 + }, + "period_at_s0": { + "tokens": 249, + "ordered_topk_exact_tokens": 144, + "set_exact_tokens": 180, + "mean_set_jaccard": 0.9148020654044751, + "mean_token_weighted_tv": 0.014741392413445985, + "aggregate_load_tv": 0.029451137884872823 + }, + "period_at_s1": { + "tokens": 249, + "ordered_topk_exact_tokens": 126, + "set_exact_tokens": 164, + "mean_set_jaccard": 0.894912985274431, + "mean_token_weighted_tv": 0.01769320450229458, + "aggregate_load_tv": 0.029451137884872813 + } + } + }, + "layer_26": { + "layer": 26, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "26febd6798ff4364bae8f574c203cfb9fd41d03dc5adc426a2dee8f5429918c5", + "route_weight_sha256": "a42a05444453e84ca3bd5a3759292224ea2d993edf9683d112a0a4ed0c4ef147", + "loads": [ + 19, + 25, + 56, + 24, + 37, + 11, + 39, + 11, + 25, + 25, + 16, + 26, + 27, + 18, + 8, + 23, + 22, + 11, + 8, + 49, + 17, + 32, + 8, + 85, + 19, + 16, + 16, + 6, + 43, + 26, + 12, + 26, + 25, + 25, + 17, + 14, + 11, + 34, + 26, + 24, + 33, + 21, + 15, + 6, + 7, + 6, + 25, + 38, + 4, + 27, + 63, + 22, + 9, + 32, + 22, + 27, + 17, + 25, + 34, + 22, + 33, + 13, + 14, + 17 + ], + "weighted_loads": [ + 0.801635267212987, + 2.083260454237461, + 3.9080203510820866, + 0.892843134701252, + 2.734399627894163, + 0.5852102227509022, + 3.080488136038184, + 0.3783303741365671, + 1.7949478887021542, + 1.3375730365514755, + 0.5778699740767479, + 2.8099620770663023, + 1.7773171681910753, + 0.6392263788729906, + 0.4569829571992159, + 1.9608543999493122, + 1.4604116808623075, + 0.39935542084276676, + 0.23139197379350662, + 2.653187772259116, + 1.0490968748927116, + 2.1375088840723038, + 0.24999821558594704, + 4.855269750580192, + 1.1266391072422266, + 0.7142478749155998, + 0.6940651815384626, + 0.3946061171591282, + 3.5970160216093063, + 0.9995631072670221, + 0.42029308900237083, + 1.2333734557032585, + 1.2377755958586931, + 0.7983845453709364, + 0.6908170115202665, + 0.5292300581932068, + 0.7237348835915327, + 1.4713297244161367, + 1.4393759816884995, + 2.0720272324979305, + 2.313980031758547, + 1.9707606174051762, + 0.7172053549438715, + 0.3006151132285595, + 0.27328326739370823, + 0.19440538994967937, + 0.8851994443684816, + 1.8516680765897036, + 0.1310599483549595, + 1.6981045249849558, + 3.1060640197247267, + 1.4091359283775091, + 0.6445089839398861, + 1.3743487875908613, + 1.3451755847781897, + 1.3331904225051403, + 1.3743416033685207, + 4.225375559180975, + 2.100551774725318, + 1.0021818298846483, + 1.6526244934648275, + 0.43508167937397957, + 0.5538574866950512, + 0.6232401225715876 + ], + "unique_experts": 64, + "load_cv": 0.604172639612735, + "normalized_load_entropy": 0.9612702455683952, + "max_load_share": 0.05689424364123159 + }, + "full_input": { + "tokens": 274, + "top_k": 6, + "decisions": 1644, + "ordered_route_sha256": "148ae953bcf0f048264e1155cbac83b75da23269da0a0d8ca2c634cde75705ff", + "route_weight_sha256": "cf717ee26ad4003de91f8867291693911e11ac89e2f2d6ee194997f7835efe9f", + "loads": [ + 19, + 25, + 56, + 24, + 37, + 11, + 39, + 12, + 25, + 30, + 20, + 32, + 27, + 19, + 24, + 25, + 22, + 25, + 8, + 49, + 18, + 33, + 8, + 85, + 26, + 17, + 22, + 13, + 43, + 27, + 19, + 26, + 27, + 25, + 21, + 14, + 17, + 34, + 26, + 24, + 34, + 21, + 16, + 9, + 8, + 6, + 29, + 38, + 6, + 28, + 70, + 22, + 13, + 32, + 23, + 27, + 32, + 33, + 40, + 23, + 34, + 13, + 15, + 18 + ], + "weighted_loads": [ + 0.801635267212987, + 2.083260454237461, + 3.9080203510820866, + 0.892843134701252, + 2.734399627894163, + 0.5852102227509022, + 3.080488136038184, + 0.45552959479391575, + 1.7949478887021542, + 1.6570746637880802, + 0.8809503093361855, + 3.1688144598156214, + 1.7773171681910753, + 0.6950935665518045, + 1.3168074340210296, + 2.0583851262927055, + 1.4604116808623075, + 1.100416299304925, + 0.23139197379350662, + 2.653187772259116, + 1.1776935383677483, + 2.1682740934193134, + 0.24999821558594704, + 4.855269750580192, + 1.5430062543600798, + 0.7555589862167835, + 1.5832796674221754, + 0.6790479626506567, + 3.5970160216093063, + 1.0403960924595594, + 1.071061048656702, + 1.2333734557032585, + 1.31119822897017, + 0.7983845453709364, + 0.9178517963737249, + 0.5292300581932068, + 1.029531491920352, + 1.4713297244161367, + 1.4393759816884995, + 2.0720272324979305, + 2.3477596193552017, + 1.9707606174051762, + 0.7638549972325563, + 0.44426045194268227, + 0.3082746732980013, + 0.19440538994967937, + 1.0920062195509672, + 1.8516680765897036, + 0.23794374614953995, + 2.684406066313386, + 3.414260370656848, + 1.4091359283775091, + 1.0928427390754223, + 1.3743487875908613, + 1.3920060861855745, + 1.3331904225051403, + 2.523801773786545, + 4.652838787995279, + 2.3383084516972303, + 1.0511800851672888, + 1.6534384909900837, + 0.43508167937397957, + 0.5945885740220547, + 0.6704580578953028 + ], + "unique_experts": 64, + "load_cv": 0.5363790968193696, + "normalized_load_entropy": 0.9693285278460815, + "max_load_share": 0.05170316301703163 + } + }, + "s1_eos": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "8e3a572d2cc9d87d20ea3f6de2e481290db235ed98763c8a4b4cd8f9f43c9efe", + "route_weight_sha256": "6a8ca754ba9a9cd0567182f511a956e844961125b5046372db9508ce4ce73d73", + "loads": [ + 21, + 26, + 56, + 27, + 34, + 10, + 40, + 12, + 25, + 24, + 13, + 25, + 26, + 16, + 7, + 22, + 21, + 11, + 8, + 49, + 17, + 32, + 7, + 85, + 19, + 16, + 19, + 8, + 44, + 31, + 13, + 26, + 24, + 25, + 17, + 14, + 10, + 31, + 26, + 25, + 34, + 21, + 16, + 7, + 5, + 7, + 23, + 39, + 2, + 27, + 62, + 24, + 9, + 36, + 21, + 25, + 17, + 26, + 36, + 22, + 32, + 12, + 12, + 17 + ], + "weighted_loads": [ + 0.860546737909317, + 2.1072469390928745, + 3.913330251350999, + 0.9669438246637583, + 2.6292236410081387, + 0.564690638333559, + 3.086803436279297, + 0.4078556261956692, + 1.8041890803724527, + 1.3204481173306704, + 0.5028795208781958, + 2.735516095533967, + 1.7464764565229416, + 0.5942223202437162, + 0.4392450787127018, + 1.91776292771101, + 1.4173118565231562, + 0.4005986675620079, + 0.23244204930961132, + 2.6318943928927183, + 1.0683616567403078, + 2.1238571628928185, + 0.22075950168073177, + 4.843965280801058, + 1.118128104135394, + 0.7049581669270992, + 0.79921187274158, + 0.44640327244997025, + 3.60726254619658, + 1.162910345941782, + 0.45483170822262764, + 1.2421438042074442, + 1.20439332164824, + 0.7961896788328886, + 0.6933749988675117, + 0.5382294971495867, + 0.7024306003004313, + 1.3854192104190588, + 1.4772102162241936, + 2.1134169939905405, + 2.344663618132472, + 1.9551093876361847, + 0.7372183836996555, + 0.32363320514559746, + 0.2121549304574728, + 0.22650551050901413, + 0.8198710698634386, + 1.885610667988658, + 0.07274888455867767, + 1.7079274225980043, + 3.0519954934716225, + 1.4618300255388021, + 0.6322936229407787, + 1.4650226142257452, + 1.318345395848155, + 1.2533044945448637, + 1.3326578382402658, + 4.177566897124052, + 2.1595309544354677, + 1.0163964722305536, + 1.6207878272980452, + 0.38663898408412933, + 0.4965819660574198, + 0.6549766529351473 + ], + "unique_experts": 64, + "load_cv": 0.6100761605074762, + "normalized_load_entropy": 0.9598962273949948, + "max_load_share": 0.05689424364123159 + }, + "full_input": { + "tokens": 290, + "top_k": 6, + "decisions": 1740, + "ordered_route_sha256": "50db338191e60188dad780c3ca3ffa13ae92918b3b380ed9cb13d34d6c1c1439", + "route_weight_sha256": "556226a47490acd5363c47c281da49e8c4b0216eb7f1dda70d47f0b8b208a194", + "loads": [ + 22, + 26, + 56, + 27, + 36, + 10, + 40, + 13, + 25, + 31, + 21, + 33, + 26, + 17, + 23, + 27, + 21, + 19, + 9, + 49, + 18, + 38, + 15, + 85, + 29, + 19, + 30, + 19, + 44, + 33, + 22, + 27, + 28, + 25, + 24, + 14, + 22, + 36, + 29, + 26, + 35, + 21, + 18, + 11, + 5, + 8, + 27, + 40, + 4, + 30, + 69, + 24, + 18, + 38, + 24, + 27, + 36, + 37, + 46, + 27, + 35, + 12, + 15, + 19 + ], + "weighted_loads": [ + 0.9017632193863392, + 2.1072469390928745, + 3.913330251350999, + 0.9669438246637583, + 2.782499674707651, + 0.564690638333559, + 3.086803436279297, + 0.49660372361540794, + 1.8041890803724527, + 1.758659539744258, + 1.2731032259762287, + 3.3862529639154673, + 1.7464764565229416, + 0.6509115751832724, + 1.4159684913465753, + 2.2185762748122215, + 1.4173118565231562, + 0.9191449047066271, + 0.2789531070739031, + 2.6318943928927183, + 1.1792299691587687, + 2.479641940444708, + 0.7587992083281279, + 4.843965280801058, + 1.641967425122857, + 0.8489090837538242, + 2.181601708754897, + 0.8716832585632801, + 3.60726254619658, + 1.2334375455975533, + 1.3568261079490185, + 1.3218650165945292, + 1.3771371450275183, + 0.7961896788328886, + 1.0705954432487488, + 0.5382294971495867, + 1.3514620047062635, + 1.6884117890149355, + 1.7605265341699123, + 2.1477011870592833, + 2.3745331782847643, + 1.9551093876361847, + 0.827960915863514, + 0.5204384326934814, + 0.2121549304574728, + 0.24393485486507416, + 1.0805283207446337, + 1.926834525540471, + 0.15945546329021454, + 2.8434862289577723, + 3.336456522345543, + 1.4618300255388021, + 1.4313500374555588, + 1.6548181157559156, + 1.5290370229631662, + 1.3682849798351526, + 3.1282650511711836, + 4.9920172449201345, + 2.731952430680394, + 1.2412019334733486, + 1.8601508171414025, + 0.38663898408412933, + 0.6237844284623861, + 0.7387210484594107 + ], + "unique_experts": 64, + "load_cv": 0.5083267544716351, + "normalized_load_entropy": 0.9713648667832868, + "max_load_share": 0.04885057471264368 + } + }, + "s0_bos": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "5792749af158a272ce87ebc4b7630c8aeb589a23014211185e1e2fd651522442", + "route_weight_sha256": "d52dc291ebc39d0995de243f791e6421c997eb869e3ed7c728db18844b55e23d", + "loads": [ + 23, + 26, + 56, + 25, + 36, + 11, + 39, + 11, + 26, + 24, + 16, + 26, + 25, + 19, + 7, + 22, + 22, + 10, + 8, + 51, + 17, + 32, + 9, + 86, + 20, + 16, + 18, + 7, + 39, + 27, + 11, + 26, + 25, + 23, + 20, + 14, + 10, + 30, + 25, + 25, + 33, + 22, + 15, + 7, + 7, + 6, + 21, + 37, + 3, + 28, + 62, + 24, + 10, + 33, + 21, + 27, + 16, + 26, + 34, + 23, + 33, + 11, + 15, + 17 + ], + "weighted_loads": [ + 0.9640718009322882, + 2.1117113307118416, + 3.911002418026328, + 0.91175826638937, + 2.6860794872045517, + 0.5790795870125294, + 3.090998651459813, + 0.3807931076735258, + 1.8675770089030266, + 1.3161915894597769, + 0.577052503824234, + 2.8044317793101072, + 1.7041181363165379, + 0.6719256285578012, + 0.4349233992397785, + 1.9393257573246956, + 1.4670001808553934, + 0.3653615042567253, + 0.23068189062178135, + 2.7075214087963104, + 1.067270215600729, + 2.12840361520648, + 0.2879973091185093, + 4.874624896794558, + 1.1547780316323042, + 0.7070129923522472, + 0.7249627113342285, + 0.4129526261240244, + 3.48319055698812, + 1.0551491733640432, + 0.3798998389393091, + 1.2488355487585068, + 1.2719676606357098, + 0.7540217638015747, + 0.7717724833637476, + 0.5361445304006338, + 0.6939872745424509, + 1.3753020446747541, + 1.4580778367817402, + 2.1167317163199186, + 2.2727277893573046, + 2.013470910489559, + 0.7193234898149967, + 0.33927999809384346, + 0.2668342161923647, + 0.19107875041663647, + 0.7516763601452112, + 1.848223078995943, + 0.1056671217083931, + 1.7268066722899675, + 3.0004209391772747, + 1.4856577944010496, + 0.6635514553636312, + 1.3862024638801813, + 1.3259729743003845, + 1.3456673063337803, + 1.393097760155797, + 4.2578180599957705, + 2.107907358556986, + 1.0458570960909128, + 1.66203024238348, + 0.3473179116845131, + 0.6079371906816959, + 0.6283160597085953 + ], + "unique_experts": 64, + "load_cv": 0.6016044000921509, + "normalized_load_entropy": 0.9616056460798899, + "max_load_share": 0.05756358768406961 + }, + "full_input": { + "tokens": 274, + "top_k": 6, + "decisions": 1644, + "ordered_route_sha256": "59f4a1ac207ff2dc8a3a81bf4b4c31678c4f34fadd30b0794d4c1738bc220947", + "route_weight_sha256": "1639ae7e720a6084f97ea6bfe38550a48cc0a75b2a19756d125c5d1fb36d301d", + "loads": [ + 24, + 26, + 56, + 25, + 36, + 11, + 39, + 12, + 26, + 30, + 19, + 31, + 25, + 20, + 21, + 24, + 22, + 22, + 8, + 51, + 18, + 33, + 10, + 86, + 27, + 17, + 24, + 16, + 39, + 28, + 19, + 26, + 26, + 23, + 25, + 14, + 16, + 30, + 25, + 25, + 34, + 23, + 17, + 10, + 9, + 6, + 24, + 37, + 5, + 28, + 69, + 24, + 14, + 33, + 22, + 27, + 31, + 33, + 40, + 24, + 33, + 11, + 16, + 19 + ], + "weighted_loads": [ + 0.9900420010089874, + 2.1117113307118416, + 3.911002418026328, + 0.91175826638937, + 2.6860794872045517, + 0.5790795870125294, + 3.090998651459813, + 0.45246890746057034, + 1.8675770089030266, + 1.6697178836911917, + 0.8293143659830093, + 3.1767888199537992, + 1.7041181363165379, + 0.7277928162366152, + 1.2042803838849068, + 2.054601427167654, + 1.4670001808553934, + 1.0131020620465279, + 0.23068189062178135, + 2.7075214087963104, + 1.1764869429171085, + 2.1591688245534897, + 0.3219968155026436, + 4.874624896794558, + 1.5602984074503183, + 0.7512680515646935, + 1.7121385112404823, + 0.8170283511281013, + 3.48319055698812, + 1.0959821585565805, + 1.148368464782834, + 1.2488355487585068, + 1.3098029121756554, + 0.7540217638015747, + 1.0815779361873865, + 0.5361445304006338, + 1.0049718469381332, + 1.3753020446747541, + 1.4580778367817402, + 2.1167317163199186, + 2.3065073769539595, + 2.368939571082592, + 0.8190911822021008, + 0.48292533680796623, + 0.37598065100610256, + 0.19107875041663647, + 0.914900055155158, + 1.848223078995943, + 0.23394577950239182, + 1.7268066722899675, + 3.308617290109396, + 1.4856577944010496, + 1.105490392073989, + 1.3862024638801813, + 1.3728034757077694, + 1.3456673063337803, + 2.544772582128644, + 4.690913332626224, + 2.3456640355288982, + 1.0948553513735533, + 1.66203024238348, + 0.3473179116845131, + 0.6486682780086994, + 0.7597746625542641 + ], + "unique_experts": 64, + "load_cv": 0.5286864443549963, + "normalized_load_entropy": 0.970516156905904, + "max_load_share": 0.052311435523114354 + } + }, + "s1_bos": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "382ce58c71b9f9077780138c0e9bf0ada516c28e019e91d99693d1876f3e7308", + "route_weight_sha256": "090ba176fc45b2d3243cff1500a3a877487db7a282d1d4e6e8261a3772b78693", + "loads": [ + 23, + 26, + 57, + 23, + 37, + 10, + 39, + 13, + 28, + 24, + 15, + 26, + 26, + 18, + 7, + 22, + 21, + 9, + 9, + 48, + 16, + 32, + 10, + 87, + 17, + 18, + 18, + 7, + 42, + 27, + 11, + 26, + 26, + 22, + 18, + 16, + 10, + 32, + 28, + 25, + 33, + 20, + 14, + 8, + 7, + 5, + 20, + 38, + 4, + 29, + 62, + 23, + 10, + 33, + 21, + 27, + 16, + 25, + 36, + 22, + 33, + 8, + 15, + 16 + ], + "weighted_loads": [ + 0.9637524709105492, + 2.121971372514963, + 3.915513675659895, + 0.8411058392375708, + 2.74592680670321, + 0.5496303401887417, + 3.132601819932461, + 0.43641658686101437, + 1.927436115220189, + 1.3749964497983456, + 0.5638226047158241, + 2.746931964531541, + 1.7461131680756807, + 0.6351152658462524, + 0.44123851135373116, + 1.939519576728344, + 1.428711274638772, + 0.3229448813945055, + 0.2590417359024286, + 2.6105389334261417, + 1.0484891198575497, + 2.1095329876989126, + 0.3181072436273098, + 4.9170143604278564, + 1.0529505498707294, + 0.7623656131327152, + 0.770692428573966, + 0.41539210081100464, + 3.627649798989296, + 1.045145807787776, + 0.37272969260811806, + 1.235677456483245, + 1.323631251230836, + 0.7190497890114784, + 0.7389262169599533, + 0.6007600724697113, + 0.6899399664252996, + 1.4239767268300056, + 1.5767978336662054, + 2.1429367139935493, + 2.281705854460597, + 1.9566584210842848, + 0.6929009687155485, + 0.36199502646923065, + 0.2632121779024601, + 0.16712157428264618, + 0.7242054659873247, + 1.8436976578086615, + 0.13037525117397308, + 1.7936772983521223, + 2.9671781845390797, + 1.4843271784484386, + 0.6566741410642862, + 1.3782912753522396, + 1.3362395595759153, + 1.3409123737365007, + 1.3484559636563063, + 4.13906879350543, + 2.1864717323333025, + 0.9978389795869589, + 1.6631126906722784, + 0.2693589795380831, + 0.6297685261815786, + 0.6027434468269348 + ], + "unique_experts": 64, + "load_cv": 0.6109215686444577, + "normalized_load_entropy": 0.9605975896201436, + "max_load_share": 0.05823293172690763 + }, + "full_input": { + "tokens": 290, + "top_k": 6, + "decisions": 1740, + "ordered_route_sha256": "f8f23671030fe32d538038f2394e17f6a3618eec18a7367bf57787f8ef85ad9f", + "route_weight_sha256": "6cf72187cabb4265fdd9725c153ae18149361e4d3df93c5e52099383d8aa749d", + "loads": [ + 23, + 26, + 57, + 23, + 39, + 10, + 39, + 15, + 28, + 32, + 24, + 33, + 26, + 19, + 21, + 27, + 21, + 16, + 10, + 48, + 17, + 38, + 17, + 87, + 27, + 21, + 30, + 17, + 42, + 29, + 22, + 27, + 29, + 23, + 26, + 16, + 22, + 37, + 31, + 26, + 34, + 20, + 17, + 12, + 8, + 6, + 24, + 39, + 6, + 31, + 69, + 23, + 19, + 35, + 24, + 29, + 35, + 35, + 46, + 27, + 35, + 8, + 18, + 19 + ], + "weighted_loads": [ + 0.9637524709105492, + 2.121971372514963, + 3.915513675659895, + 0.8411058392375708, + 2.8992028404027224, + 0.5496303401887417, + 3.132601819932461, + 0.5696257334202528, + 1.927436115220189, + 1.8629944883286953, + 1.398972837254405, + 3.405416527763009, + 1.7461131680756807, + 0.6918045207858086, + 1.3320815600454807, + 2.2532121650874615, + 1.428711274638772, + 0.8638222012668848, + 0.30110595934093, + 2.6105389334261417, + 1.1643781028687954, + 2.465317765250802, + 0.8092880062758923, + 4.9170143604278564, + 1.5706628784537315, + 0.9054507724940777, + 2.333273796364665, + 0.8041686154901981, + 3.627649798989296, + 1.1156730074435472, + 1.4208222404122353, + 1.3153986688703299, + 1.4560793284326792, + 0.763489130884409, + 1.1931863576173782, + 0.6007600724697113, + 1.336357356980443, + 1.7269693054258823, + 1.8601141516119242, + 2.177220907062292, + 2.3115754146128893, + 1.9566584210842848, + 0.8253445085138083, + 0.5588002540171146, + 0.2989065907895565, + 0.1845509186387062, + 0.9659285340458155, + 1.8849215153604746, + 0.21795204654335976, + 1.9443384315818548, + 3.251639213413, + 1.4843271784484386, + 1.4372079502791166, + 1.56808677688241, + 1.5469311866909266, + 1.4558928590267897, + 3.1648242380470037, + 4.956518296152353, + 2.758893208578229, + 1.2226444408297539, + 1.9015488382428885, + 0.2693589795380831, + 0.756970988586545, + 0.7729844972491264 + ], + "unique_experts": 64, + "load_cv": 0.5063684793318793, + "normalized_load_entropy": 0.9722004235203573, + "max_load_share": 0.05 + } + }, + "s0_x": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "c4f01814a9ace7e28c7fb175112453175f368e846d4512ffc31d9687383e150d", + "route_weight_sha256": "cc5e3ce167d683d81a181af86dca85b7bb0a28679124ba6bfa347e749e167394", + "loads": [ + 19, + 26, + 57, + 26, + 35, + 10, + 39, + 10, + 25, + 22, + 15, + 26, + 27, + 18, + 7, + 23, + 21, + 10, + 7, + 51, + 17, + 32, + 9, + 86, + 19, + 17, + 21, + 7, + 40, + 28, + 13, + 26, + 23, + 23, + 20, + 14, + 10, + 29, + 27, + 24, + 33, + 22, + 16, + 7, + 8, + 5, + 24, + 38, + 4, + 29, + 62, + 22, + 10, + 35, + 21, + 27, + 17, + 25, + 35, + 25, + 33, + 8, + 13, + 16 + ], + "weighted_loads": [ + 0.7796343360096216, + 2.1188323609530926, + 3.881444353610277, + 0.9298009630292654, + 2.6579122114926577, + 0.547525480389595, + 3.0873924270272255, + 0.3440148960798979, + 1.8157437313348055, + 1.2358502876013517, + 0.5391580611467361, + 2.7890260983258486, + 1.77060267329216, + 0.6480162367224693, + 0.4246835317462683, + 1.9724671188741922, + 1.421511111781001, + 0.36416230723261833, + 0.1985072623938322, + 2.6871821358799934, + 1.0905582774430513, + 2.116829451173544, + 0.2862929757684469, + 4.81761334836483, + 1.1289521027356386, + 0.7413996309041977, + 0.8256667125970125, + 0.41450414061546326, + 3.5252179633826017, + 1.082269025966525, + 0.4554926473647356, + 1.218979500234127, + 1.1687241103500128, + 0.740554753690958, + 0.7614754941314459, + 0.5336125213652849, + 0.6933993250131607, + 1.3342176619917154, + 1.5039239451289177, + 2.093081148341298, + 2.245009507983923, + 2.0589399933815002, + 0.7254770640283823, + 0.3357778172940016, + 0.2876762431114912, + 0.15762867964804173, + 0.8740409109741449, + 1.8671120647341013, + 0.12822280637919903, + 1.78173809312284, + 3.0173202082514763, + 1.410266125574708, + 0.6493752896785736, + 1.4312163069844246, + 1.3395905401557684, + 1.3493328280746937, + 1.3667336776852608, + 4.187282983213663, + 2.1589928790926933, + 1.1395199932157993, + 1.6909138727933168, + 0.26923890970647335, + 0.5531755052506924, + 0.6063866689801216 + ], + "unique_experts": 64, + "load_cv": 0.6089471239214964, + "normalized_load_entropy": 0.9605561642338154, + "max_load_share": 0.05756358768406961 + }, + "full_input": { + "tokens": 274, + "top_k": 6, + "decisions": 1644, + "ordered_route_sha256": "734dfd9e72ebada40e1c1a0d75d95d6a43422f3a66d4332f194114abef68d8a7", + "route_weight_sha256": "766b12c4b1c957a4eefc3020c7a5795faf22a4347a1615a8f3841b53fcc0a6ca", + "loads": [ + 19, + 26, + 57, + 27, + 35, + 10, + 39, + 11, + 25, + 27, + 19, + 33, + 27, + 19, + 23, + 25, + 21, + 24, + 7, + 51, + 18, + 33, + 9, + 86, + 26, + 18, + 27, + 15, + 40, + 30, + 19, + 26, + 24, + 23, + 24, + 14, + 15, + 29, + 27, + 24, + 34, + 22, + 16, + 12, + 8, + 5, + 27, + 38, + 5, + 29, + 69, + 22, + 14, + 35, + 22, + 27, + 35, + 33, + 41, + 26, + 33, + 8, + 14, + 17 + ], + "weighted_loads": [ + 0.7796343360096216, + 2.1188323609530926, + 3.881444353610277, + 0.9607582222670317, + 2.6579122114926577, + 0.547525480389595, + 3.0873924270272255, + 0.3980476576834917, + 1.8157437313348055, + 1.5533663425594568, + 0.8606825657188892, + 3.2973599787801504, + 1.77060267329216, + 0.7038834244012833, + 1.3479636255651712, + 2.0674394387751818, + 1.421511111781001, + 1.1445984914898872, + 0.1985072623938322, + 2.6871821358799934, + 1.219260485842824, + 2.1475946605205536, + 0.2862929757684469, + 4.81761334836483, + 1.5434238146990538, + 0.7772947512567043, + 1.701771194115281, + 0.7304619085043669, + 3.5252179633826017, + 1.1725468318909407, + 1.0849113520234823, + 1.218979500234127, + 1.2065593618899584, + 0.740554753690958, + 0.9930874276906252, + 0.5336125213652849, + 0.9666792899370193, + 1.3342176619917154, + 1.5039239451289177, + 2.093081148341298, + 2.278789095580578, + 2.0589399933815002, + 0.7254770640283823, + 0.5797298271209002, + 0.2876762431114912, + 0.15762867964804173, + 1.038045471534133, + 1.8671120647341013, + 0.17841734178364277, + 1.78173809312284, + 3.3255165591835976, + 1.410266125574708, + 1.076647162437439, + 1.4312163069844246, + 1.3864210415631533, + 1.3493328280746937, + 2.6717389561235905, + 4.726112294942141, + 2.3967495560646057, + 1.1885182484984398, + 1.6909138727933168, + 0.26923890970647335, + 0.5939065925776958, + 0.6536046043038368 + ], + "unique_experts": 64, + "load_cv": 0.5430044266864615, + "normalized_load_entropy": 0.9682372568085681, + "max_load_share": 0.052311435523114354 + } + }, + "s1_x": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "6962eb74b4c3b7e411837ea7526435edb03750c745d6b86198806bffcbdab942", + "route_weight_sha256": "c8017e3a0fbecd3754b7f817ce6429b9ca1043fc9a544560b0015007950b6bb8", + "loads": [ + 22, + 25, + 55, + 27, + 35, + 11, + 41, + 12, + 26, + 24, + 14, + 25, + 26, + 15, + 9, + 23, + 22, + 10, + 8, + 49, + 17, + 31, + 8, + 88, + 17, + 15, + 19, + 7, + 42, + 27, + 13, + 25, + 24, + 24, + 19, + 15, + 11, + 28, + 27, + 25, + 33, + 20, + 14, + 8, + 7, + 4, + 25, + 40, + 3, + 30, + 62, + 22, + 10, + 33, + 20, + 27, + 17, + 25, + 37, + 23, + 35, + 8, + 15, + 15 + ], + "weighted_loads": [ + 0.9102415796369314, + 2.0428776144981384, + 3.834733609110117, + 0.9790250603109598, + 2.6697540190070868, + 0.592435110360384, + 3.081773616373539, + 0.4020288437604904, + 1.8427253384143114, + 1.351281188428402, + 0.4988076910376549, + 2.709872229024768, + 1.7266089841723442, + 0.5476076621562243, + 0.5009221136569977, + 1.9591318350285292, + 1.448168970644474, + 0.3555767238140106, + 0.22873923182487488, + 2.6402594037353992, + 1.0927983429282904, + 2.0639590825885534, + 0.25562940165400505, + 4.9245108887553215, + 1.0531995855271816, + 0.6817213818430901, + 0.8077522553503513, + 0.4273572061210871, + 3.585317214950919, + 1.08910964243114, + 0.44594203121960163, + 1.1636239979416132, + 1.186117697507143, + 0.7624468728899956, + 0.7272698860615492, + 0.5792276356369257, + 0.719861276447773, + 1.2996130101382732, + 1.5866393391042948, + 2.1195698343217373, + 2.1961618177592754, + 1.931616622954607, + 0.680232260376215, + 0.346737515181303, + 0.2543837819248438, + 0.13051762804389, + 0.8898355606943369, + 1.9441839344799519, + 0.08840192295610905, + 1.796712463721633, + 2.9529222398996353, + 1.3995829429477453, + 0.65301170386374, + 1.316966762766242, + 1.3082518130540848, + 1.3399143237620592, + 1.2867851983755827, + 4.127915687859058, + 2.3189370837062597, + 1.028584998100996, + 1.7440585549920797, + 0.2670271210372448, + 0.6281095165759325, + 0.555425688624382 + ], + "unique_experts": 64, + "load_cv": 0.6152710056131527, + "normalized_load_entropy": 0.9599131774629278, + "max_load_share": 0.058902275769745646 + }, + "full_input": { + "tokens": 290, + "top_k": 6, + "decisions": 1740, + "ordered_route_sha256": "8381a8ea3c9211288c190362d9216237ca79ee1ac4c0123267bc1513ea876f33", + "route_weight_sha256": "5fca91ae290a72364af9c9edcc9c5af3c608b5577a9e26f99e81b1f78a8a97e4", + "loads": [ + 22, + 25, + 55, + 29, + 37, + 11, + 41, + 14, + 26, + 31, + 22, + 34, + 26, + 16, + 25, + 28, + 22, + 17, + 8, + 49, + 18, + 37, + 14, + 88, + 27, + 17, + 31, + 18, + 42, + 30, + 21, + 26, + 27, + 24, + 26, + 15, + 23, + 33, + 30, + 26, + 34, + 20, + 16, + 12, + 8, + 5, + 28, + 41, + 4, + 32, + 69, + 22, + 19, + 35, + 23, + 29, + 38, + 37, + 48, + 29, + 37, + 8, + 18, + 17 + ], + "weighted_loads": [ + 0.9102415796369314, + 2.0428776144981384, + 3.834733609110117, + 1.0425958652049303, + 2.8230300527065992, + 0.592435110360384, + 3.081773616373539, + 0.5564796924591064, + 1.8427253384143114, + 1.7845885269343853, + 1.2784455623477697, + 3.527102267369628, + 1.7266089841723442, + 0.6042969170957804, + 1.550203125923872, + 2.2665538024157286, + 1.448168970644474, + 0.8696366809308529, + 0.22873923182487488, + 2.6402594037353992, + 1.1932164188474417, + 2.419743860140443, + 0.7106993608176708, + 4.9245108887553215, + 1.5560558252036572, + 0.7851366996765137, + 2.22869661077857, + 0.8606880623847246, + 3.585317214950919, + 1.2342804316431284, + 1.3246054518967867, + 1.2433452103286982, + 1.3185657747089863, + 0.7624468728899956, + 1.1075159292668104, + 0.5792276356369257, + 1.3731281086802483, + 1.60260558873415, + 1.8699556570500135, + 2.15385402739048, + 2.2260313779115677, + 1.931616622954607, + 0.765325054526329, + 0.543542742729187, + 0.2962689306586981, + 0.14794697239995003, + 1.1154841985553503, + 1.985407792031765, + 0.12381972186267376, + 1.9473735969513655, + 3.2373832687735558, + 1.3995829429477453, + 1.4213317837566137, + 1.5067622642964125, + 1.518943440169096, + 1.4548948090523481, + 3.156046399846673, + 5.103966061025858, + 2.95606723241508, + 1.2998263407498598, + 1.9824947025626898, + 0.2670271210372448, + 0.7553119789808989, + 0.6399926878511906 + ], + "unique_experts": 64, + "load_cv": 0.5194334138999497, + "normalized_load_entropy": 0.9701836213258512, + "max_load_share": 0.05057471264367816 + } + }, + "s0_period": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "6251f10c739117540e09b541a0227b5112155e1d163b085867a061303bc4fabb", + "route_weight_sha256": "0617a0131d12858c07b9a3a5e399aaeb73481ad7db368ca0786db89f0d647b7a", + "loads": [ + 19, + 26, + 57, + 27, + 34, + 10, + 38, + 12, + 25, + 23, + 15, + 26, + 25, + 18, + 7, + 23, + 22, + 10, + 8, + 50, + 17, + 33, + 9, + 86, + 20, + 16, + 20, + 5, + 42, + 27, + 11, + 27, + 22, + 22, + 20, + 14, + 10, + 29, + 26, + 25, + 35, + 21, + 16, + 7, + 6, + 7, + 24, + 39, + 4, + 29, + 62, + 24, + 9, + 32, + 21, + 27, + 17, + 25, + 35, + 25, + 33, + 9, + 12, + 19 + ], + "weighted_loads": [ + 0.7703862711787224, + 2.121352307498455, + 3.9144912101328373, + 0.9624279569834471, + 2.6272381860762835, + 0.5327234454452991, + 3.054007600992918, + 0.4048112090677023, + 1.8087978307157755, + 1.2736927941441536, + 0.5369677413254976, + 2.7900762017816305, + 1.715938039124012, + 0.6482838299125433, + 0.4228129554539919, + 1.9843997098505497, + 1.4443210549652576, + 0.3672219906002283, + 0.2272728607058525, + 2.6704370547086, + 1.0895946249365807, + 2.163481689989567, + 0.2842014264315367, + 4.822827590629458, + 1.1405268032103777, + 0.7059099953621626, + 0.8282059635967016, + 0.3529241420328617, + 3.568499380722642, + 1.0298599358648062, + 0.3927090298384428, + 1.2573509197682142, + 1.1670829951763153, + 0.7224391885101795, + 0.7862804885953665, + 0.5307775381952524, + 0.6950831562280655, + 1.3279049415141344, + 1.4612107798457146, + 2.1265593618154526, + 2.3325507007539272, + 2.023342050611973, + 0.7285272777080536, + 0.3327927924692631, + 0.23486614972352982, + 0.21876290254294872, + 0.8702852837741375, + 1.889108993113041, + 0.13179656490683556, + 1.78165496699512, + 3.011421140283346, + 1.4606697987765074, + 0.6062619313597679, + 1.32877448014915, + 1.327554538846016, + 1.3493787478655577, + 1.3748828303068876, + 4.20444068312645, + 2.14872120693326, + 1.1449515242129564, + 1.6774355545639992, + 0.29983776062726974, + 0.5154628492891788, + 0.6970522850751877 + ], + "unique_experts": 64, + "load_cv": 0.6091825124367732, + "normalized_load_entropy": 0.9604250825702645, + "max_load_share": 0.05756358768406961 + }, + "full_input": { + "tokens": 274, + "top_k": 6, + "decisions": 1644, + "ordered_route_sha256": "f53e7103e3c69b5ebf33d36e111e0b117c3a1da1b920ed9d1511732f54a710b8", + "route_weight_sha256": "76367cb539695fd1a142874f19dd10a3e0ee8fa9d68d71a8d52ac2b42e4f49ed", + "loads": [ + 19, + 26, + 57, + 27, + 34, + 10, + 38, + 13, + 25, + 27, + 19, + 31, + 25, + 19, + 22, + 24, + 22, + 23, + 8, + 50, + 18, + 34, + 9, + 86, + 28, + 17, + 26, + 12, + 42, + 28, + 18, + 27, + 24, + 23, + 25, + 14, + 17, + 29, + 26, + 25, + 36, + 21, + 16, + 10, + 8, + 8, + 27, + 39, + 6, + 29, + 69, + 24, + 14, + 32, + 22, + 27, + 33, + 32, + 41, + 26, + 33, + 9, + 13, + 22 + ], + "weighted_loads": [ + 0.7703862711787224, + 2.121352307498455, + 3.9144912101328373, + 0.9624279569834471, + 2.6272381860762835, + 0.5327234454452991, + 3.054007600992918, + 0.46621417067945004, + 1.8087978307157755, + 1.5519702099263668, + 0.8601009231060743, + 3.1453145314007998, + 1.715938039124012, + 0.7041510175913572, + 1.238365849480033, + 2.0415786392986774, + 1.4443210549652576, + 1.0837897155433893, + 0.2272728607058525, + 2.6704370547086, + 1.2381996735930443, + 2.1942468993365765, + 0.2842014264315367, + 4.822827590629458, + 1.6419136617332697, + 0.7437762003391981, + 1.7007858213037252, + 0.6373659875243902, + 3.568499380722642, + 1.0706929210573435, + 1.0458974409848452, + 1.2573509197682142, + 1.2415162734687328, + 0.7636728808283806, + 1.0517208948731422, + 0.5307775381952524, + 1.0587147325277328, + 1.3279049415141344, + 1.4612107798457146, + 2.1265593618154526, + 2.366330288350582, + 2.023342050611973, + 0.7285272777080536, + 0.47643813118338585, + 0.32001345977187157, + 0.24770500510931015, + 1.0271081998944283, + 1.889108993113041, + 0.23404348269104958, + 1.78165496699512, + 3.3196174912154675, + 1.4606697987765074, + 1.1092732958495617, + 1.32877448014915, + 1.3743850402534008, + 1.3493787478655577, + 2.6861260067671537, + 4.62265782058239, + 2.3864778839051723, + 1.1939497794955969, + 1.6774355545639992, + 0.29983776062726974, + 0.5561939366161823, + 0.871513556689024 + ], + "unique_experts": 64, + "load_cv": 0.5368644978824866, + "normalized_load_entropy": 0.9694558278184149, + "max_load_share": 0.052311435523114354 + } + }, + "s1_period": { + "target_content": { + "tokens": 249, + "top_k": 6, + "decisions": 1494, + "ordered_route_sha256": "cbad0a175958eb9482ac9edcdabccf95e5b2f649bbb04da44a2d11990ab6bd86", + "route_weight_sha256": "15616fd436e2918e806035645e2d4c0e21d8cc4972b94f273e5ddc5a2c73ac9a", + "loads": [ + 20, + 25, + 54, + 26, + 35, + 10, + 41, + 12, + 25, + 25, + 16, + 25, + 26, + 16, + 9, + 23, + 21, + 12, + 7, + 50, + 16, + 31, + 9, + 88, + 17, + 18, + 19, + 7, + 40, + 28, + 13, + 25, + 23, + 18, + 19, + 16, + 11, + 29, + 27, + 25, + 32, + 21, + 14, + 8, + 7, + 6, + 23, + 40, + 2, + 28, + 64, + 22, + 10, + 34, + 21, + 28, + 17, + 25, + 37, + 24, + 34, + 7, + 14, + 19 + ], + "weighted_loads": [ + 0.8516048286110163, + 2.0466996617615223, + 3.8017898816615343, + 0.9463449195027351, + 2.6880027055740356, + 0.5584747642278671, + 3.0865175295621157, + 0.40704267658293247, + 1.8245985358953476, + 1.392824862152338, + 0.558387378230691, + 2.7304295487701893, + 1.7327525150030851, + 0.5712296199053526, + 0.5101654957979918, + 1.9573701545596123, + 1.4085392858833075, + 0.4271937273442745, + 0.20248844847083092, + 2.6783441826701164, + 1.0834719277918339, + 2.086975883692503, + 0.28653337992727757, + 4.926967995241284, + 1.0301208682358265, + 0.7762892842292786, + 0.7707510888576508, + 0.4230173174291849, + 3.4961381275206804, + 1.0880894493311644, + 0.4491284731775522, + 1.1730996072292328, + 1.1459135804325342, + 0.5926824901252985, + 0.7408327274024487, + 0.6004569567739964, + 0.7277164254337549, + 1.3354927971959114, + 1.5517414305359125, + 2.13620775192976, + 2.1888464633375406, + 1.9471513908356428, + 0.6761016007512808, + 0.35525962337851524, + 0.2557454723864794, + 0.18699569068849087, + 0.8304731734097004, + 1.9375581629574299, + 0.057667581364512444, + 1.7279513366520405, + 3.0486530605703592, + 1.3941879887133837, + 0.6339845042675734, + 1.3523103725165129, + 1.339316252619028, + 1.3556064423173666, + 1.2432682141661644, + 4.179237294942141, + 2.28972858004272, + 1.0638471823185682, + 1.720843007788062, + 0.24088320136070251, + 0.595078282058239, + 0.6690477170050144 + ], + "unique_experts": 64, + "load_cv": 0.6137311852539419, + "normalized_load_entropy": 0.9603221599306909, + "max_load_share": 0.058902275769745646 + }, + "full_input": { + "tokens": 290, + "top_k": 6, + "decisions": 1740, + "ordered_route_sha256": "74dc84b054737ada6e76fddd24118b787d57741b660b6af6998088bc5cf18056", + "route_weight_sha256": "356ac71e954a03513e3ce5433e0ce03cd0b85ca8903b923e5397b98ee2c3d321", + "loads": [ + 20, + 25, + 54, + 27, + 37, + 11, + 41, + 14, + 25, + 32, + 25, + 32, + 26, + 17, + 24, + 28, + 21, + 19, + 7, + 50, + 17, + 37, + 16, + 88, + 28, + 21, + 30, + 18, + 40, + 30, + 21, + 26, + 26, + 18, + 26, + 16, + 23, + 35, + 30, + 26, + 33, + 21, + 17, + 12, + 7, + 7, + 27, + 41, + 3, + 30, + 71, + 22, + 20, + 36, + 25, + 30, + 38, + 35, + 47, + 29, + 36, + 7, + 17, + 22 + ], + "weighted_loads": [ + 0.8516048286110163, + 2.0466996617615223, + 3.8017898816615343, + 0.9797785021364689, + 2.841278739273548, + 0.5968055613338947, + 3.0865175295621157, + 0.5652652997523546, + 1.8245985358953476, + 1.8290382698178291, + 1.3990301936864853, + 3.3817348778247833, + 1.7327525150030851, + 0.6279188748449087, + 1.504885358735919, + 2.2570284083485603, + 1.4085392858833075, + 0.9831449054181576, + 0.20248844847083092, + 2.6783441826701164, + 1.184726107865572, + 2.4427606612443924, + 0.7708044350147247, + 4.926967995241284, + 1.6034013777971268, + 0.9151973351836205, + 2.1317488476634026, + 0.8469230141490698, + 3.4961381275206804, + 1.1586166489869356, + 1.310664700344205, + 1.2528208196163177, + 1.2783616576343775, + 0.5926824901252985, + 1.120476122945547, + 0.6004569567739964, + 1.4019141253083944, + 1.671991266310215, + 1.8350577484816313, + 2.1704919449985027, + 2.218716023489833, + 1.9471513908356428, + 0.7944454792886972, + 0.5520648509263992, + 0.2557454723864794, + 0.2044250350445509, + 1.101992167532444, + 1.978782020509243, + 0.09308538027107716, + 1.878612469881773, + 3.3331140894442797, + 1.3941879887133837, + 1.456807604059577, + 1.5421058740466833, + 1.5907957777380943, + 1.4705869276076555, + 3.1890576146543026, + 4.9928767047822475, + 2.8621500562876463, + 1.2886526435613632, + 1.9592791553586721, + 0.24088320136070251, + 0.7222807444632053, + 0.8432832695543766 + ], + "unique_experts": 64, + "load_cv": 0.5171902912190246, + "normalized_load_entropy": 0.9704934498537391, + "max_load_share": 0.05057471264367816 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 249, + "ordered_topk_exact_tokens": 169, + "set_exact_tokens": 194, + "mean_set_jaccard": 0.9334480780263912, + "mean_token_weighted_tv": 0.011343892057796559, + "aggregate_load_tv": 0.023427041499330656 + }, + "system_bos": { + "tokens": 249, + "ordered_topk_exact_tokens": 163, + "set_exact_tokens": 196, + "mean_set_jaccard": 0.9383247274813539, + "mean_token_weighted_tv": 0.011302318824193325, + "aggregate_load_tv": 0.01941097724230255 + }, + "system_x": { + "tokens": 249, + "ordered_topk_exact_tokens": 137, + "set_exact_tokens": 179, + "mean_set_jaccard": 0.9170969592656338, + "mean_token_weighted_tv": 0.015249021964738646, + "aggregate_load_tv": 0.02409638554216867 + }, + "system_period": { + "tokens": 249, + "ordered_topk_exact_tokens": 144, + "set_exact_tokens": 179, + "mean_set_jaccard": 0.9145152036718303, + "mean_token_weighted_tv": 0.015866819238028372, + "aggregate_load_tv": 0.027443105756358763 + }, + "bos_at_s0": { + "tokens": 249, + "ordered_topk_exact_tokens": 145, + "set_exact_tokens": 181, + "mean_set_jaccard": 0.9185312679288583, + "mean_token_weighted_tv": 0.014554258103082219, + "aggregate_load_tv": 0.020749665327978586 + }, + "bos_at_s1": { + "tokens": 249, + "ordered_topk_exact_tokens": 147, + "set_exact_tokens": 179, + "mean_set_jaccard": 0.9119334480780263, + "mean_token_weighted_tv": 0.016035297900498152, + "aggregate_load_tv": 0.030120481927710847 + }, + "x_at_s0": { + "tokens": 249, + "ordered_topk_exact_tokens": 136, + "set_exact_tokens": 176, + "mean_set_jaccard": 0.9136546184738956, + "mean_token_weighted_tv": 0.015311921763432074, + "aggregate_load_tv": 0.02409638554216868 + }, + "x_at_s1": { + "tokens": 249, + "ordered_topk_exact_tokens": 143, + "set_exact_tokens": 174, + "mean_set_jaccard": 0.9079173838209982, + "mean_token_weighted_tv": 0.017680604399806524, + "aggregate_load_tv": 0.026773761713520753 + }, + "period_at_s0": { + "tokens": 249, + "ordered_topk_exact_tokens": 133, + "set_exact_tokens": 178, + "mean_set_jaccard": 0.9142283419391853, + "mean_token_weighted_tv": 0.015452379824586183, + "aggregate_load_tv": 0.024765729585006696 + }, + "period_at_s1": { + "tokens": 249, + "ordered_topk_exact_tokens": 138, + "set_exact_tokens": 169, + "mean_set_jaccard": 0.903231975521132, + "mean_token_weighted_tv": 0.017765817879493457, + "aggregate_load_tv": 0.029451137884872827 + } + } + } + } + }, + { + "id": "tnews/test/4855", + "domain": "chinese", + "label": "中文新闻", + "within_domain_index": 0, + "selection_rank": "000b4d139c925918017352dc899d44353839fb496e1a607335490e402857bf46", + "source_text_sha256": "deb4147668bb781cb7212a520a58f28e45808e316b8cfa57e936c373f8512807", + "source_characters": 30, + "source_tokens": 23, + "content_token_ids_sha256": "f6727c5b619c00c37bbef16c2b28820c61713b846f0fc7ea5b00cf2cdbc1dc2a", + "prompt_tokens_by_condition": { + "s0_eos": 48, + "s1_eos": 64, + "s0_bos": 48, + "s1_bos": 64, + "s0_x": 48, + "s1_x": 64, + "s0_period": 48, + "s1_period": 64 + }, + "batch_prompt_tokens": 64, + "content_tokens": 23, + "boundary_crossing_tokens_by_condition": { + "s0_eos": 0, + "s1_eos": 0, + "s0_bos": 0, + "s1_bos": 0, + "s0_x": 0, + "s1_x": 0, + "s0_period": 0, + "s1_period": 0 + }, + "forward_seconds": 0.6299118699971586, + "peak_cuda_memory_allocated_bytes": 27592979456, + "hidden_stages": { + "embedding": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6131f203fa8740bfb2e4669ab8ffafdc58b5519951c99190fe11c5633038b898", + "mean": -0.0013041805941611528, + "std": 0.11127576231956482, + "rms": 0.11128340661525726, + "max_abs": 2.015625 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8ef44ef67c0ef553c73ac87e9dbfd62f6d12636f43df0c9ba15f11b3c8cc2c5c", + "mean": -0.001113120117224753, + "std": 0.09857547283172607, + "rms": 0.09858175367116928, + "max_abs": 2.046875 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6131f203fa8740bfb2e4669ab8ffafdc58b5519951c99190fe11c5633038b898", + "mean": -0.0013041805941611528, + "std": 0.11127576231956482, + "rms": 0.11128340661525726, + "max_abs": 2.015625 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "dadd82b279be3a44686dcec70f6aabe1b046029da42be788c0c73ca9043f25bb", + "mean": -0.0013841092586517334, + "std": 0.10015734285116196, + "rms": 0.10016690194606781, + "max_abs": 2.046875 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6131f203fa8740bfb2e4669ab8ffafdc58b5519951c99190fe11c5633038b898", + "mean": -0.0013041805941611528, + "std": 0.11127576231956482, + "rms": 0.11128340661525726, + "max_abs": 2.015625 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9c6bde7062b88a07b74feeaa46dd0c44c7fde7a9cd49e5e257abc773f9e010f2", + "mean": -0.0010811785468831658, + "std": 0.09817982465028763, + "rms": 0.09818577766418457, + "max_abs": 2.046875 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6131f203fa8740bfb2e4669ab8ffafdc58b5519951c99190fe11c5633038b898", + "mean": -0.0013041805941611528, + "std": 0.11127576231956482, + "rms": 0.11128340661525726, + "max_abs": 2.015625 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "36e81515de0ad1b5eeeab885db19464436478d16725225b67d55a8680974cf9c", + "mean": -0.001360153080895543, + "std": 0.09986551851034164, + "rms": 0.09987477958202362, + "max_abs": 2.046875 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6131f203fa8740bfb2e4669ab8ffafdc58b5519951c99190fe11c5633038b898", + "mean": -0.0013041805941611528, + "std": 0.11127576231956482, + "rms": 0.11128340661525726, + "max_abs": 2.015625 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "66d13f253b329c39a312df200c545a5716e3b2d0ad7ec42582eebc090697190d", + "mean": -0.0011595631949603558, + "std": 0.09844643622636795, + "rms": 0.09845326840877533, + "max_abs": 2.046875 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6131f203fa8740bfb2e4669ab8ffafdc58b5519951c99190fe11c5633038b898", + "mean": -0.0013041805941611528, + "std": 0.11127576231956482, + "rms": 0.11128340661525726, + "max_abs": 2.015625 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "818c97022ebe6dbfd54e21ec866b399e6c30aabf42a597d1e70bbf850679090f", + "mean": -0.001418941537849605, + "std": 0.10006202012300491, + "rms": 0.10007207840681076, + "max_abs": 2.046875 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6131f203fa8740bfb2e4669ab8ffafdc58b5519951c99190fe11c5633038b898", + "mean": -0.0013041805941611528, + "std": 0.11127576231956482, + "rms": 0.11128340661525726, + "max_abs": 2.015625 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "aa558159dbad510c777bcced1be325a9c3f62c20bc97e7b4bf297f55e047aed8", + "mean": -0.0011612535454332829, + "std": 0.0981423407793045, + "rms": 0.09814921021461487, + "max_abs": 2.046875 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6131f203fa8740bfb2e4669ab8ffafdc58b5519951c99190fe11c5633038b898", + "mean": -0.0013041805941611528, + "std": 0.11127576231956482, + "rms": 0.11128340661525726, + "max_abs": 2.015625 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a551a0392d4c385d788fea5a7ce4d3e4fbf6923382e72f71afceb6736f23ea4e", + "mean": -0.0014202093007043004, + "std": 0.09983772039413452, + "rms": 0.09984782338142395, + "max_abs": 2.046875 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "exact_hidden_rows": 23, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999998211860657, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "system_bos": { + "tokens": 23, + "exact_hidden_rows": 23, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999998211860657, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "system_x": { + "tokens": 23, + "exact_hidden_rows": 23, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999998211860657, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "system_period": { + "tokens": 23, + "exact_hidden_rows": 23, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999998211860657, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "bos_at_s0": { + "tokens": 23, + "exact_hidden_rows": 23, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999998211860657, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "bos_at_s1": { + "tokens": 23, + "exact_hidden_rows": 23, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999998211860657, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "x_at_s0": { + "tokens": 23, + "exact_hidden_rows": 23, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999998211860657, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "x_at_s1": { + "tokens": 23, + "exact_hidden_rows": 23, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999998211860657, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "period_at_s0": { + "tokens": 23, + "exact_hidden_rows": 23, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999998211860657, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "period_at_s1": { + "tokens": 23, + "exact_hidden_rows": 23, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999998211860657, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + } + } + }, + "layer_00": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b7ef62087d913c2d9a1a63ccb9e3110c6521881079ee85ec28b513c6071b13b0", + "mean": -0.0019739801064133644, + "std": 0.10446448624134064, + "rms": 0.10448314249515533, + "max_abs": 2.484375 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "479dc0d5e6d48b4132b26c6546f0fd8287e2dfcf3eefdc9aa737b4c3c2f0a348", + "mean": -0.001754326862283051, + "std": 0.09691625833511353, + "rms": 0.09693213552236557, + "max_abs": 2.484375 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0eb0e9fcfecbb23bc351435ca8fcae2d990d56010eda6873a108f57e8fea7259", + "mean": -0.0019738026894629, + "std": 0.10446838289499283, + "rms": 0.10448702424764633, + "max_abs": 2.515625 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2c9b4ea02411dd61fe77d4f8330c772ca9826178acc5c188a0a68da63f191c0d", + "mean": -0.00189383199904114, + "std": 0.0972166359424591, + "rms": 0.09723508358001709, + "max_abs": 2.515625 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b43836004f6676e811aa778c33433d6a2d16877d471f5078771a45df987459c4", + "mean": -0.001943552982993424, + "std": 0.10223494470119476, + "rms": 0.10225341469049454, + "max_abs": 2.359375 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a73319e82816ef4594e8956372ffbb799efec4f22fdf9e195eb163165ed7b798", + "mean": -0.0016920628258958459, + "std": 0.09516999870538712, + "rms": 0.09518503397703171, + "max_abs": 2.4375 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0111fef3cc7f392246ebdf74ce61ce411635e3140eb4b0e2663cfd833a5744cb", + "mean": -0.001955712214112282, + "std": 0.10221771150827408, + "rms": 0.10223641246557236, + "max_abs": 2.390625 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8829256e91a2a5bca9ce20eaab2727f8bc713fa8d58ead3547438d7ad78cd94c", + "mean": -0.001851374632678926, + "std": 0.09589194506406784, + "rms": 0.09590981900691986, + "max_abs": 2.4375 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5dd90864831d6d223a1ab542b2ea5a030c0308ee53fd7df707d928cc316cdedf", + "mean": -0.001935943029820919, + "std": 0.1019064337015152, + "rms": 0.1019248217344284, + "max_abs": 2.359375 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d54e542b1ed46892506d3bc67ec16f72c2a7f89490cfafa805e8093beb38a825", + "mean": -0.001733708195388317, + "std": 0.09527389705181122, + "rms": 0.09528966248035431, + "max_abs": 2.4375 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c58d9ee61b02ba87795f6558c84a0bacb73a8b70a1611c9dd9fcb38f4196719a", + "mean": -0.0019568607676774263, + "std": 0.10197316110134125, + "rms": 0.1019919365644455, + "max_abs": 2.40625 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0ed0ad3c0379ce3b2f2e9a8dc5bdc2b2e201235ca701b57fdff10caa6caa1174", + "mean": -0.0018932834500446916, + "std": 0.09604513645172119, + "rms": 0.09606379270553589, + "max_abs": 2.4375 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d8fc2a083210eab19a07bb0e078dff4e79ad15a25e9f99a1cc2246d8ec7851d4", + "mean": -0.0019394791452214122, + "std": 0.10201609879732132, + "rms": 0.1020345389842987, + "max_abs": 2.375 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2d22d4fc98b11da312523cadd709f06e8091883fce2d8ecb341315145b52bbfe", + "mean": -0.0017348158871755004, + "std": 0.09485828876495361, + "rms": 0.09487415105104446, + "max_abs": 2.4375 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bfcfbfe25259ab791fb5898628a59b44a9f2fb0cb0560f243e4d4d861c241093", + "mean": -0.001961284317076206, + "std": 0.10209859907627106, + "rms": 0.10211742669343948, + "max_abs": 2.40625 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "96dd7d344243680a4deb4105873527a44f5c17ecf539dfeca65b38d4b565a4c3", + "mean": -0.0018907077610492706, + "std": 0.09570757299661636, + "rms": 0.09572625160217285, + "max_abs": 2.4375 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9997454881668091, + "min_cosine_similarity": 0.9986011385917664, + "mean_relative_l2": 0.02010003849864006, + "max_abs_delta": 0.078125 + }, + "system_bos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9995680451393127, + "min_cosine_similarity": 0.9988576173782349, + "mean_relative_l2": 0.027715452015399933, + "max_abs_delta": 0.09375 + }, + "system_x": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9995983839035034, + "min_cosine_similarity": 0.9989045262336731, + "mean_relative_l2": 0.026905369013547897, + "max_abs_delta": 0.09375 + }, + "system_period": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9996473789215088, + "min_cosine_similarity": 0.9989703893661499, + "mean_relative_l2": 0.0251851137727499, + "max_abs_delta": 0.0703125 + }, + "bos_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9852129817008972, + "min_cosine_similarity": 0.9771109819412231, + "mean_relative_l2": 0.17025598883628845, + "max_abs_delta": 0.25244140625 + }, + "bos_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9866507053375244, + "min_cosine_similarity": 0.9795020818710327, + "mean_relative_l2": 0.16206979751586914, + "max_abs_delta": 0.2421875 + }, + "x_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9853930473327637, + "min_cosine_similarity": 0.978178083896637, + "mean_relative_l2": 0.16936171054840088, + "max_abs_delta": 0.25048828125 + }, + "x_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9868424534797668, + "min_cosine_similarity": 0.9793598651885986, + "mean_relative_l2": 0.16098155081272125, + "max_abs_delta": 0.2421875 + }, + "period_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9857376217842102, + "min_cosine_similarity": 0.978829026222229, + "mean_relative_l2": 0.16739177703857422, + "max_abs_delta": 0.265625 + }, + "period_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9871396422386169, + "min_cosine_similarity": 0.9796642065048218, + "mean_relative_l2": 0.15918798744678497, + "max_abs_delta": 0.25 + } + } + }, + "layer_01": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6619bcd08c17700fbef82081f93dd43fd49cf1b0ce4a73ac559186f397459826", + "mean": -0.002482388634234667, + "std": 0.11761102825403214, + "rms": 0.11763722449541092, + "max_abs": 2.875 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8ad990783ce424e0d79f1ae3672a9eaaf1970c674ec02a36e77d3de47e60186e", + "mean": -0.007867041043937206, + "std": 1.154313325881958, + "rms": 1.154340147972107, + "max_abs": 126.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d9ae7cbd015158a481311cf61a9dcfea393688fe5c2750996acf684cb676904f", + "mean": -0.0024607721716165543, + "std": 0.11748752743005753, + "rms": 0.11751329898834229, + "max_abs": 2.859375 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cc149cb53d4c13551dc73d0c0d2ad4cf45b7c51b044b0598bb539b5acd253682", + "mean": -0.006937483325600624, + "std": 1.0358202457427979, + "rms": 1.0358434915542603, + "max_abs": 135.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "efccf1ca6ed1af0fe4626d921e01cce036f2496908fd01d0511a5c026571915f", + "mean": -0.002661635633558035, + "std": 0.11496595293283463, + "rms": 0.1149967610836029, + "max_abs": 2.828125 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c85ff2d14bb1e55bb87e667439107e472d66ed183b6c67c39e4c0d5438d5b02a", + "mean": -0.002033679746091366, + "std": 0.1146402582526207, + "rms": 0.11465829610824585, + "max_abs": 4.6875 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "49e379382fadf6672d787a0df8d558c7c846da8e3441be43f749d2c55a2b5b63", + "mean": -0.0027737757191061974, + "std": 0.11502844840288162, + "rms": 0.11506188660860062, + "max_abs": 2.8125 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1c3fc48054474537d235882124b232ed72491c7e51c779b5fbf320f4ac7df4d7", + "mean": -0.0023935558274388313, + "std": 0.11431015282869339, + "rms": 0.11433520168066025, + "max_abs": 4.6875 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b1c3300d88bb68333a1d3785f5f2b968736e854d669f65f9936cf0c595059099", + "mean": -0.002581552369520068, + "std": 0.115144744515419, + "rms": 0.11517368257045746, + "max_abs": 2.78125 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3b5bb6a5d5fcda2eaec96eaafaf7fa68229ca37e981f713831785bbb2b943bb3", + "mean": -0.0019949718844145536, + "std": 0.11489132046699524, + "rms": 0.11490864306688309, + "max_abs": 4.6875 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "acaffa20bc38fcdeeefa5bd8390ac633060a769742f7ecfd8bb08d656465bdb9", + "mean": -0.0027400332037359476, + "std": 0.1149948313832283, + "rms": 0.11502747237682343, + "max_abs": 2.78125 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "56c82ae31cfc9685c5ba9348ecc27f5f78a6501057e0aaff93bee2b89c7e75b1", + "mean": -0.002392732072621584, + "std": 0.11440826207399368, + "rms": 0.11443327367305756, + "max_abs": 4.6875 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bbbdfaec651245bd5a106cd825f6af75c38d7e288277c17ae65228d578f3f5c4", + "mean": -0.002594259800389409, + "std": 0.11498653888702393, + "rms": 0.11501579731702805, + "max_abs": 2.75 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "297a11e1f0feedd3b775c912683202abc7170bd4624b7864ff5e7950908bea08", + "mean": -0.0020400125067681074, + "std": 0.11415214091539383, + "rms": 0.1141703650355339, + "max_abs": 4.6875 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c9a5843d5f59bd832483401827b9125f4ba8374d8c93e3379103543f8d896fc5", + "mean": -0.002753135049715638, + "std": 0.11496302485466003, + "rms": 0.11499598622322083, + "max_abs": 2.75 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c8015469121d65460542f6b633b8df22dc56f2e8f49cfd85404917d00dce9df5", + "mean": -0.0024225206580013037, + "std": 0.1139068529009819, + "rms": 0.11393260955810547, + "max_abs": 4.6875 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9989041090011597, + "min_cosine_similarity": 0.9963462948799133, + "mean_relative_l2": 0.044399410486221313, + "max_abs_delta": 0.0625 + }, + "system_bos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9965267777442932, + "min_cosine_similarity": 0.991642415523529, + "mean_relative_l2": 0.08164683729410172, + "max_abs_delta": 0.09375 + }, + "system_x": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9947412610054016, + "min_cosine_similarity": 0.9872044324874878, + "mean_relative_l2": 0.09983272850513458, + "max_abs_delta": 0.1015625 + }, + "system_period": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9950743913650513, + "min_cosine_similarity": 0.9869435429573059, + "mean_relative_l2": 0.09643316268920898, + "max_abs_delta": 0.109375 + }, + "bos_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9842036962509155, + "min_cosine_similarity": 0.9624834656715393, + "mean_relative_l2": 0.17475971579551697, + "max_abs_delta": 0.21875 + }, + "bos_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.984399139881134, + "min_cosine_similarity": 0.9666893482208252, + "mean_relative_l2": 0.17321360111236572, + "max_abs_delta": 0.234375 + }, + "x_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9859660863876343, + "min_cosine_similarity": 0.9645609259605408, + "mean_relative_l2": 0.16459313035011292, + "max_abs_delta": 0.2783203125 + }, + "x_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9826960563659668, + "min_cosine_similarity": 0.9631816148757935, + "mean_relative_l2": 0.1815011203289032, + "max_abs_delta": 0.294921875 + }, + "period_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9861570596694946, + "min_cosine_similarity": 0.9648560285568237, + "mean_relative_l2": 0.16366927325725555, + "max_abs_delta": 0.25 + }, + "period_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9831608533859253, + "min_cosine_similarity": 0.9653186798095703, + "mean_relative_l2": 0.1793922483921051, + "max_abs_delta": 0.294921875 + } + } + }, + "layer_02": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a37280a1e4934958233d6ed7f3693317ea532483233a119f95d4e36ca738bbb6", + "mean": -0.001991121331229806, + "std": 0.13904155790805817, + "rms": 0.13905581831932068, + "max_abs": 3.15625 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "96748429c82ba74a719c38bd5c55ce5d8f4f942fa070307d86739e72af0330c6", + "mean": -0.02143874205648899, + "std": 3.465128183364868, + "rms": 3.4651944637298584, + "max_abs": 392.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c35c0e1a50495628eb82adc268befc76bd94e8daf2cd6dc480d47e9c8dd0e986", + "mean": -0.0018582188058644533, + "std": 0.13849607110023499, + "rms": 0.13850852847099304, + "max_abs": 3.125 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c5b28c5dafe17d5e7cb0ea18356aaf073a8afc0780be294f501fc63dbafbe1cf", + "mean": -0.019196288660168648, + "std": 3.3241984844207764, + "rms": 3.324253797531128, + "max_abs": 436.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6847ac848ca4f4b870cd072aa5cba8bb3d6d2b112ae3bd9e6e0cb27f0403ee87", + "mean": -0.0021432763896882534, + "std": 0.13700105249881744, + "rms": 0.13701781630516052, + "max_abs": 3.171875 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bd0a54833ed9daedbb08955d2e1390fd1c122b96ecc7eaf60b8ae821a1d91c06", + "mean": -0.0025249116588383913, + "std": 0.2694056034088135, + "rms": 0.2694174349308014, + "max_abs": 23.75 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "09f01c0b00a8a31560c9682bc489e0d130a340428c8370bef865e610c27f90d5", + "mean": -0.001923379022628069, + "std": 0.13653524219989777, + "rms": 0.13654878735542297, + "max_abs": 3.125 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f72e38efe2c5f97114e05170a63dfb8ad7f3a8ea76bde312d6dfbfb322a50dac", + "mean": -0.002393826376646757, + "std": 0.2424994260072708, + "rms": 0.24251124262809753, + "max_abs": 23.75 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "65d4600e904a18e64036b7b00809740c300ac76508037fce449ff7e2b113d10b", + "mean": -0.002016215119510889, + "std": 0.13652880489826202, + "rms": 0.13654369115829468, + "max_abs": 3.1875 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d18ca844e183a55663d513a6521a010d71fe3c21ae4abe50f0366c255c74eb10", + "mean": -0.0024544033221900463, + "std": 0.2695099413394928, + "rms": 0.26952114701271057, + "max_abs": 23.75 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fd4c3699cb3d3193a3e3af71ea993f8dc1ed9a88dda8e3672792522835052d19", + "mean": -0.0018170038238167763, + "std": 0.13549277186393738, + "rms": 0.13550496101379395, + "max_abs": 3.125 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b11b317129311e62a6e459fa5c171f948b5dd29fc2963dc7e688e77198de3c0a", + "mean": -0.002361967461183667, + "std": 0.24237661063671112, + "rms": 0.24238811433315277, + "max_abs": 23.75 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5c97f8949b02f66050708ea38a7c064235c6c93a2e3670044f8d082c3812fbbc", + "mean": -0.002007841831073165, + "std": 0.13603131473064423, + "rms": 0.1360461413860321, + "max_abs": 3.1875 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0e81a57ffa108ef9e8d166f69acce9f024201bee5694715ce286e8b62c4578fb", + "mean": -0.0025683699641376734, + "std": 0.2687988579273224, + "rms": 0.26881110668182373, + "max_abs": 23.75 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b04539464ea1100970e911f9302be49f813a561c613489ee65cef78a12358163", + "mean": -0.0018266616389155388, + "std": 0.13537311553955078, + "rms": 0.1353854387998581, + "max_abs": 3.09375 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2acf888e892c50460f5da303accb344c7454484ee5cf589f7444b76b0d4c7ad2", + "mean": -0.0024336143396794796, + "std": 0.24188584089279175, + "rms": 0.2418980896472931, + "max_abs": 23.75 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.998278021812439, + "min_cosine_similarity": 0.9942852258682251, + "mean_relative_l2": 0.05634090676903725, + "max_abs_delta": 0.09375 + }, + "system_bos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9944888353347778, + "min_cosine_similarity": 0.9843660593032837, + "mean_relative_l2": 0.10265032202005386, + "max_abs_delta": 0.12109375 + }, + "system_x": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9928478598594666, + "min_cosine_similarity": 0.9777247905731201, + "mean_relative_l2": 0.11614783108234406, + "max_abs_delta": 0.140625 + }, + "system_period": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9930605888366699, + "min_cosine_similarity": 0.975597083568573, + "mean_relative_l2": 0.11397268623113632, + "max_abs_delta": 0.140625 + }, + "bos_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9853609204292297, + "min_cosine_similarity": 0.9709770679473877, + "mean_relative_l2": 0.16946548223495483, + "max_abs_delta": 0.28125 + }, + "bos_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9825354218482971, + "min_cosine_similarity": 0.9679908752441406, + "mean_relative_l2": 0.1840258538722992, + "max_abs_delta": 0.37890625 + }, + "x_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9842504262924194, + "min_cosine_similarity": 0.9631236791610718, + "mean_relative_l2": 0.1739681214094162, + "max_abs_delta": 0.3369140625 + }, + "x_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9776814579963684, + "min_cosine_similarity": 0.951835036277771, + "mean_relative_l2": 0.20559491217136383, + "max_abs_delta": 0.458984375 + }, + "period_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9843562841415405, + "min_cosine_similarity": 0.9628318548202515, + "mean_relative_l2": 0.17359915375709534, + "max_abs_delta": 0.34375 + }, + "period_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9780557751655579, + "min_cosine_similarity": 0.9538074731826782, + "mean_relative_l2": 0.20390230417251587, + "max_abs_delta": 0.462890625 + } + } + }, + "layer_03": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "df8de4e7d4d1260f9c85e06c59a6518be878dcedfdfdb2a857f771fd0b9a8a70", + "mean": -0.0020450325682759285, + "std": 0.1658955067396164, + "rms": 0.1659080982208252, + "max_abs": 3.78125 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8752178fffb03c3e6d880eb24c7bb1bba570dfd95ec6a25b39130f4a665a5f57", + "mean": -0.028270287439227104, + "std": 10.389381408691406, + "rms": 10.389419555664062, + "max_abs": 1136.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "aec08f80c67a7d1e7a25b7b66cc9a928dcc404839ec318625226e337b366246d", + "mean": -0.001937886350788176, + "std": 0.16597004234790802, + "rms": 0.16598135232925415, + "max_abs": 3.75 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bda7f58027336af1b915e640defd459764723f672a0335919969ff12fcda46c6", + "mean": -0.024906061589717865, + "std": 9.292015075683594, + "rms": 9.292047500610352, + "max_abs": 1136.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f50003049b44a6e147aea6e606ddbd38ac78061055b8300483181a0b41a6315d", + "mean": -0.0023095004726201296, + "std": 0.16624513268470764, + "rms": 0.16626116633415222, + "max_abs": 3.8125 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b8f1fb41b678f54e8e36436a13bc31744d7026cf37f3b8c4f967616c909abdd6", + "mean": -0.007231568917632103, + "std": 9.261480331420898, + "rms": 9.261482238769531, + "max_abs": 1136.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "07f25037480dbb63b7b2f32cee681f1c0323034465bba3d5f2b7364f75ab4e70", + "mean": -0.0022180569358170033, + "std": 0.1672428995370865, + "rms": 0.16725759208202362, + "max_abs": 3.8125 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7d1285ebc8d9ba4c6d6155dc82dce1a722a31cddc5ae49611564878ed698c049", + "mean": -0.00632179481908679, + "std": 8.021040916442871, + "rms": 8.02104377746582, + "max_abs": 1136.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "add103aca5db385c633dda6cb199a54bffadfd2013b349843b888f887d508fe0", + "mean": -0.002350191818550229, + "std": 0.16490864753723145, + "rms": 0.16492538154125214, + "max_abs": 3.8125 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "aea3eefb3f61b612a6beece66411ee87a7cefa74698eaa1cd939268fb8f2b3b7", + "mean": -0.007331494241952896, + "std": 9.261454582214355, + "rms": 9.261457443237305, + "max_abs": 1136.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e47adcb1eb476b793410c0c1128df6f9e02d190ad7b46b97baec152feb813ba7", + "mean": -0.0023389754351228476, + "std": 0.16571329534053802, + "rms": 0.1657298058271408, + "max_abs": 3.765625 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9d0851551cb0d019cc0b2761fc94e5f398f263e354782ee310d2e20de76739f6", + "mean": -0.006460496224462986, + "std": 8.021018981933594, + "rms": 8.021021842956543, + "max_abs": 1136.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cadd12cfe1745dc12da069d4dd14c26c3e8362ecf8e7bc5ab2a74aec298a99cc", + "mean": -0.0023686394561082125, + "std": 0.16439023613929749, + "rms": 0.16440731287002563, + "max_abs": 3.78125 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d27dc1ec223f752353ba259ece3ad04999ec51defa9d7e6cb8ab405f5dd5e7e0", + "mean": -0.007349178194999695, + "std": 9.261439323425293, + "rms": 9.261441230773926, + "max_abs": 1136.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e185ecf60f81c222dcb627278a1a26088e7c6a91f2e597c45ecb299f5337e907", + "mean": -0.002305185655131936, + "std": 0.16571734845638275, + "rms": 0.16573336720466614, + "max_abs": 3.78125 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "364d35fef7cf758d7fd5a6d344f50ba7a2c47012a6839b903ed814eb0971ecc1", + "mean": -0.006443801335990429, + "std": 8.021007537841797, + "rms": 8.021010398864746, + "max_abs": 1136.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9982519745826721, + "min_cosine_similarity": 0.9935152530670166, + "mean_relative_l2": 0.05665694177150726, + "max_abs_delta": 0.203125 + }, + "system_bos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9945566654205322, + "min_cosine_similarity": 0.986998438835144, + "mean_relative_l2": 0.10338301211595535, + "max_abs_delta": 0.28125 + }, + "system_x": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9926035404205322, + "min_cosine_similarity": 0.9789166450500488, + "mean_relative_l2": 0.11917021870613098, + "max_abs_delta": 0.171875 + }, + "system_period": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9924659729003906, + "min_cosine_similarity": 0.9757165908813477, + "mean_relative_l2": 0.12007642537355423, + "max_abs_delta": 0.21875 + }, + "bos_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9867748022079468, + "min_cosine_similarity": 0.9789139628410339, + "mean_relative_l2": 0.16224287450313568, + "max_abs_delta": 0.359375 + }, + "bos_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9840227365493774, + "min_cosine_similarity": 0.972393810749054, + "mean_relative_l2": 0.17792430520057678, + "max_abs_delta": 0.46875 + }, + "x_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9858384132385254, + "min_cosine_similarity": 0.9737833738327026, + "mean_relative_l2": 0.16641457378864288, + "max_abs_delta": 0.30859375 + }, + "x_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9792351126670837, + "min_cosine_similarity": 0.9587982296943665, + "mean_relative_l2": 0.1994030624628067, + "max_abs_delta": 0.46875 + }, + "period_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9862668514251709, + "min_cosine_similarity": 0.9746779203414917, + "mean_relative_l2": 0.163752943277359, + "max_abs_delta": 0.30859375 + }, + "period_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9795163869857788, + "min_cosine_similarity": 0.9578590393066406, + "mean_relative_l2": 0.19815534353256226, + "max_abs_delta": 0.47265625 + } + } + }, + "layer_04": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1874257d257479b761eb906be444de0a6bf4d965a3f7d810b743ad0e6a1ada51", + "mean": -0.0026567818131297827, + "std": 0.20140515267848969, + "rms": 0.20142266154289246, + "max_abs": 5.5625 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3ca15eb496b0db52d32b64428cb222617e3661927ed13e254ecd565360eaf7eb", + "mean": -0.02831266075372696, + "std": 10.844250679016113, + "rms": 10.844287872314453, + "max_abs": 1152.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "81188e7e6a71d3d06677e98467c966bf20ac058b967656ff99d97c718b04ab10", + "mean": -0.002690061926841736, + "std": 0.20209483802318573, + "rms": 0.20211273431777954, + "max_abs": 5.53125 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8c9c02e8319fcc4265decbdf833ccbfae9c56841c04c9648d5ad5eb2ed938e59", + "mean": -0.02505638636648655, + "std": 9.670823097229004, + "rms": 9.670855522155762, + "max_abs": 1152.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7fd686c34d0adfca775d365baabbac39babcd9297c0fdd2ac60c834c2f1d38b7", + "mean": -0.003070756560191512, + "std": 0.2025836855173111, + "rms": 0.2026069462299347, + "max_abs": 5.6875 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ee2c3ad002d4b45eaf3bf9dac87c000bc9b4f5289404d3590b6655b4fc9820c4", + "mean": -0.007333592977374792, + "std": 9.717960357666016, + "rms": 9.717963218688965, + "max_abs": 1152.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "35c0d327d74ac9040eff6f9da89bcdde941ae4a7c70ee77a76de21554048edc5", + "mean": -0.0030126734636723995, + "std": 0.20446395874023438, + "rms": 0.2044861614704132, + "max_abs": 5.59375 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "73b3e6a94b119ee7318db01ced21cdd78858cfba0dfbf4f8b8abac7ef0edfef2", + "mean": -0.006476394832134247, + "std": 8.40512466430664, + "rms": 8.40512752532959, + "max_abs": 1152.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "54ad88e366d449b037f72abdd5576a973b614a50302364c652c9f22f7aad7e60", + "mean": -0.002692209556698799, + "std": 0.19987162947654724, + "rms": 0.19988976418972015, + "max_abs": 5.5625 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "54b1baf449117e5fb95859573174df110caee9936a326425d606705e24c34725", + "mean": -0.007103146519511938, + "std": 9.717900276184082, + "rms": 9.717903137207031, + "max_abs": 1152.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e2cc3bc2a839688ece5d5ec20316a59977cf5c4eea784f1e6392520b7baf1a0c", + "mean": -0.002782050985842943, + "std": 0.20118626952171326, + "rms": 0.20120550692081451, + "max_abs": 5.40625 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "03793157d987d8e905608eefaf32ba2e6efa86afe594353be1fb7c693306a131", + "mean": -0.0063655786216259, + "std": 8.405061721801758, + "rms": 8.405064582824707, + "max_abs": 1152.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ba595cf5ce99fe6656c6807ddd069f7ed44092ea49737ba00e9d122e0019c067", + "mean": -0.0026946754660457373, + "std": 0.19906829297542572, + "rms": 0.199086531996727, + "max_abs": 5.53125 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "807e74afe80303d7f1675db55dd8ddd80db795b5fe1745bbd86cd72534c06577", + "mean": -0.0071105267852544785, + "std": 9.717879295349121, + "rms": 9.717883110046387, + "max_abs": 1152.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d2e08d7c459725ba545ac843e9fccd225298b2551a407afbca2970a65af1e36d", + "mean": -0.0027799003291875124, + "std": 0.20108628273010254, + "rms": 0.2011054903268814, + "max_abs": 5.40625 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "128b6268ff046cb5aad7355d7926681cfb9e6102c94caa7984abe94bb6ddca93", + "mean": -0.0063619110733270645, + "std": 8.405047416687012, + "rms": 8.405050277709961, + "max_abs": 1152.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9983493089675903, + "min_cosine_similarity": 0.9941012859344482, + "mean_relative_l2": 0.05518539622426033, + "max_abs_delta": 0.21875 + }, + "system_bos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9947391152381897, + "min_cosine_similarity": 0.9886678457260132, + "mean_relative_l2": 0.1029403954744339, + "max_abs_delta": 0.2265625 + }, + "system_x": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9924773573875427, + "min_cosine_similarity": 0.9778090715408325, + "mean_relative_l2": 0.12229625880718231, + "max_abs_delta": 0.265625 + }, + "system_period": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9926024675369263, + "min_cosine_similarity": 0.9782159328460693, + "mean_relative_l2": 0.12126688659191132, + "max_abs_delta": 0.3125 + }, + "bos_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9901548624038696, + "min_cosine_similarity": 0.9839790463447571, + "mean_relative_l2": 0.14075036346912384, + "max_abs_delta": 0.3125 + }, + "bos_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9879652857780457, + "min_cosine_similarity": 0.9787405729293823, + "mean_relative_l2": 0.15601249039173126, + "max_abs_delta": 0.34375 + }, + "x_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9880385994911194, + "min_cosine_similarity": 0.976788341999054, + "mean_relative_l2": 0.1535804718732834, + "max_abs_delta": 0.37255859375 + }, + "x_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9819841980934143, + "min_cosine_similarity": 0.9652224183082581, + "mean_relative_l2": 0.18800297379493713, + "max_abs_delta": 0.541015625 + }, + "period_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9887306094169617, + "min_cosine_similarity": 0.9783805012702942, + "mean_relative_l2": 0.14897777140140533, + "max_abs_delta": 0.3125 + }, + "period_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9822667241096497, + "min_cosine_similarity": 0.9607294201850891, + "mean_relative_l2": 0.18569473922252655, + "max_abs_delta": 0.4921875 + } + } + }, + "layer_05": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6e381b2e0f57beb755ca09bde7c2acf6aa5014ad55b47e74ef2c45fd47e04d5f", + "mean": -0.0012904830509796739, + "std": 0.22307559847831726, + "rms": 0.2230793535709381, + "max_abs": 5.0625 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6caa148df8ce2b1a4a6a52be2b63678953d726df196d034cf5140a6f5d1af1f6", + "mean": -0.030875710770487785, + "std": 11.173591613769531, + "rms": 11.173635482788086, + "max_abs": 1152.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "52be7254c9332b1e4476e787d30f9ce4ca3abc3fa983daf9aad1c351a9c27bea", + "mean": -0.001246691681444645, + "std": 0.22322766482830048, + "rms": 0.22323113679885864, + "max_abs": 5.15625 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5b7cbaa042e2d9c42081921bc03fc88ed9c96bf5ff044555621b794344931400", + "mean": -0.026724737137556076, + "std": 9.969710350036621, + "rms": 9.969745635986328, + "max_abs": 1152.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9a7f02c0a831bc8e033af37a869cec5003b5c0c7f516ce9382724da8cb1c3785", + "mean": -0.001476881792768836, + "std": 0.22422896325588226, + "rms": 0.22423382103443146, + "max_abs": 5.1875 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "502155c6de671f71950d0f8382e41aca2cc799b719ebf44f8525111d79867a61", + "mean": -0.007698590401560068, + "std": 9.887016296386719, + "rms": 9.887020111083984, + "max_abs": 1152.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "12a8faebb594621d653a9463aebf9b0b4aa298a774f1f34c8350195f4d9f0cea", + "mean": -0.0014144667657092214, + "std": 0.2248784899711609, + "rms": 0.22488293051719666, + "max_abs": 5.3125 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c4474e8bce21998b49e85f3b7d29b9ba4aa60f5232dd840774747e6088b749fe", + "mean": -0.006470271851867437, + "std": 8.55126667022705, + "rms": 8.551268577575684, + "max_abs": 1152.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a8f72f41aaff47ab55e3eebb8f98767e125620729039227e17db23cee544d181", + "mean": -0.0014264314668253064, + "std": 0.22242286801338196, + "rms": 0.22242745757102966, + "max_abs": 5.3125 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0377635f46369329ae33dbdef09b821802435f44045346e164be472d5132de8c", + "mean": -0.007526729255914688, + "std": 9.886959075927734, + "rms": 9.886963844299316, + "max_abs": 1152.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0089d3c8bcf7e22b3d3655e827066df5bc87cdc3d01d15174eeab6b855619d07", + "mean": -0.0014862290117889643, + "std": 0.2216222733259201, + "rms": 0.22162725031375885, + "max_abs": 5.4375 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "29deb3a10cb8400baeaba3ea7da412ac02e4fe830ea23272d601987c9231d90c", + "mean": -0.0064111677929759026, + "std": 8.551198959350586, + "rms": 8.551201820373535, + "max_abs": 1152.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e5234b7b08ce1fb6a3dd1699dfa58caa4a7283eefa223776926092faa331ba8b", + "mean": -0.0014490911271423101, + "std": 0.2225116640329361, + "rms": 0.22251637279987335, + "max_abs": 5.25 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d795dc6155b380ae3e807b6f4c69c33aad98f30c00d6471910129bed2a5fa39c", + "mean": -0.007523247506469488, + "std": 9.886938095092773, + "rms": 9.886941909790039, + "max_abs": 1152.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2f8acd9ef06451804b9788d7deb998b631a54a3dd7e2a8ceb5ca1f3e5f5329ef", + "mean": -0.0015790818724781275, + "std": 0.22128960490226746, + "rms": 0.22129525244235992, + "max_abs": 5.40625 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6d14a2f7a405c4a3dad052e86f0392a0ca44fe01624cdad5b8202b8057085d7c", + "mean": -0.006463195197284222, + "std": 8.551177024841309, + "rms": 8.551179885864258, + "max_abs": 1152.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9974326491355896, + "min_cosine_similarity": 0.9903242588043213, + "mean_relative_l2": 0.06787631660699844, + "max_abs_delta": 0.22265625 + }, + "system_bos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9942084550857544, + "min_cosine_similarity": 0.9866775274276733, + "mean_relative_l2": 0.10723341256380081, + "max_abs_delta": 0.2890625 + }, + "system_x": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.99062180519104, + "min_cosine_similarity": 0.9700310826301575, + "mean_relative_l2": 0.1346479058265686, + "max_abs_delta": 0.384765625 + }, + "system_period": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9903750419616699, + "min_cosine_similarity": 0.9696764349937439, + "mean_relative_l2": 0.13578882813453674, + "max_abs_delta": 0.3681640625 + }, + "bos_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9900662899017334, + "min_cosine_similarity": 0.982130765914917, + "mean_relative_l2": 0.1407606154680252, + "max_abs_delta": 0.3125 + }, + "bos_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9880374670028687, + "min_cosine_similarity": 0.9826335906982422, + "mean_relative_l2": 0.15500672161579132, + "max_abs_delta": 0.40625 + }, + "x_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9868910312652588, + "min_cosine_similarity": 0.9676306843757629, + "mean_relative_l2": 0.16033391654491425, + "max_abs_delta": 0.3125 + }, + "x_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9812386631965637, + "min_cosine_similarity": 0.9608349800109863, + "mean_relative_l2": 0.19158706068992615, + "max_abs_delta": 0.515625 + }, + "period_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9879661202430725, + "min_cosine_similarity": 0.972690224647522, + "mean_relative_l2": 0.1536446213722229, + "max_abs_delta": 0.328125 + }, + "period_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9814113974571228, + "min_cosine_similarity": 0.9620420932769775, + "mean_relative_l2": 0.19023694097995758, + "max_abs_delta": 0.4921875 + } + } + }, + "layer_06": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d3c0a003ad961684a8653de7648bccb2274a1b813a97db57bfcc8f3da30f95d3", + "mean": -0.0032305740751326084, + "std": 0.2605465352535248, + "rms": 0.2605665624141693, + "max_abs": 6.28125 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "986a9d8e6e2d2e2f5bfbce3a80fd575d89a852403655b7dcfd1fa18d30a66dcb", + "mean": -0.03340640291571617, + "std": 11.377252578735352, + "rms": 11.377301216125488, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b73eda3d6ed1f1f9754dc423791d180c6997f6b1622342ad5c2bb5cc74f12da5", + "mean": -0.003294228110462427, + "std": 0.26021093130111694, + "rms": 0.26023176312446594, + "max_abs": 6.25 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1e53cfc1e463428d2ba6d7ed8ec15a1c04ca463582d8a2a33fceb266bfab5f39", + "mean": -0.029031025245785713, + "std": 10.149249076843262, + "rms": 10.149290084838867, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8b39788988a9e7a9ee79bc45a29245ce9898253444a89b2eb809c7e420a9f81f", + "mean": -0.003282850841060281, + "std": 0.26175951957702637, + "rms": 0.2617800831794739, + "max_abs": 6.3125 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "767bb51bc388bfdec554ac592e31d8b2af614ef27cc7ec7615a099f54db6e1d0", + "mean": -0.009480985812842846, + "std": 10.045774459838867, + "rms": 10.04577922821045, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6a355dbf01049ff6af141b05de09450c54d523d7b4a047111cdd7b5a8aa9ab6d", + "mean": -0.0032890138681977987, + "std": 0.26342448592185974, + "rms": 0.26344501972198486, + "max_abs": 6.3125 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f56f0c8194496d184021eb522875c15c1a141867489b252b7367563cd04bcbf7", + "mean": -0.008115483447909355, + "std": 8.686964988708496, + "rms": 8.686967849731445, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "18caee03296e50a50fd91871980251630268abe2e5a25059dcfd16a465b9ebef", + "mean": -0.0030812486074864864, + "std": 0.2622106373310089, + "rms": 0.26222872734069824, + "max_abs": 6.375 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1d31a99a7dcc9ae2d8ed23a9308ed69ef7e8ff5ba9b4755b5ff0f0418625da0c", + "mean": -0.009084970690310001, + "std": 10.045735359191895, + "rms": 10.04573917388916, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "900163ec99b94c5bf8f657f94b09de8cfa6fe8a02f9db9202a7b7fba6bd7525a", + "mean": -0.0031369535718113184, + "std": 0.26072975993156433, + "rms": 0.26074862480163574, + "max_abs": 6.40625 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5986dfc4335139214362d00870f8400222aaaceb33257680c5a3c63165f66249", + "mean": -0.007823089137673378, + "std": 8.686882019042969, + "rms": 8.686884880065918, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b3c04b6f919d021ccacc332e19e41d446d6c48f744180a402e73f3f4da88b391", + "mean": -0.0030590330716222525, + "std": 0.26041457056999207, + "rms": 0.26043254137039185, + "max_abs": 6.25 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0ba2488e9ad1db527a95372d9ec08596309bba649c3b05c0aadb00cb0d9fb32c", + "mean": -0.009062292985618114, + "std": 10.045702934265137, + "rms": 10.045706748962402, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3f19e7dc8a83c1979fad12794cc0fafbe98db5b157dcadd8ada51920034e6101", + "mean": -0.003239707089960575, + "std": 0.2597924768924713, + "rms": 0.25981268286705017, + "max_abs": 6.28125 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b82985d5b8b5f4e272e0e52b9e50054fe337d3dcfd801c4ab26ad08d4ac054c6", + "mean": -0.00789311807602644, + "std": 8.686858177185059, + "rms": 8.686861991882324, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9973180294036865, + "min_cosine_similarity": 0.9923868179321289, + "mean_relative_l2": 0.07054858654737473, + "max_abs_delta": 0.375 + }, + "system_bos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9949936270713806, + "min_cosine_similarity": 0.9913793802261353, + "mean_relative_l2": 0.10005926340818405, + "max_abs_delta": 0.328125 + }, + "system_x": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9910083413124084, + "min_cosine_similarity": 0.9791812896728516, + "mean_relative_l2": 0.13276080787181854, + "max_abs_delta": 0.5 + }, + "system_period": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9905382394790649, + "min_cosine_similarity": 0.9766983985900879, + "mean_relative_l2": 0.13624067604541779, + "max_abs_delta": 0.46875 + }, + "bos_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9913527369499207, + "min_cosine_similarity": 0.9868934154510498, + "mean_relative_l2": 0.13150951266288757, + "max_abs_delta": 0.34375 + }, + "bos_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9897266626358032, + "min_cosine_similarity": 0.9825254678726196, + "mean_relative_l2": 0.1445637345314026, + "max_abs_delta": 0.5 + }, + "x_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9877077341079712, + "min_cosine_similarity": 0.9753389358520508, + "mean_relative_l2": 0.15646342933177948, + "max_abs_delta": 0.5 + }, + "x_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9824019074440002, + "min_cosine_similarity": 0.9679689407348633, + "mean_relative_l2": 0.18681611120700836, + "max_abs_delta": 0.59375 + }, + "period_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9885432124137878, + "min_cosine_similarity": 0.9778453707695007, + "mean_relative_l2": 0.15006856620311737, + "max_abs_delta": 0.40625 + }, + "period_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9822036027908325, + "min_cosine_similarity": 0.9686487913131714, + "mean_relative_l2": 0.18716800212860107, + "max_abs_delta": 0.546875 + } + } + }, + "layer_07": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "dc7098e059b4942734ece8ca892583d4935ab100f608ef63739c0efbaa93f1a5", + "mean": -0.0033634344581514597, + "std": 0.2850069999694824, + "rms": 0.2850268483161926, + "max_abs": 6.3125 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "59439d205801d922a4087830497e7d94b529f2c7e4bcab6ae017245d4561c964", + "mean": -0.03323521837592125, + "std": 11.409729957580566, + "rms": 11.40977954864502, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "49e1fc59bcebbef2fc05c6bf73679de64835be34e9bb74b4f41cc7ca2672accb", + "mean": -0.0032432014122605324, + "std": 0.28610464930534363, + "rms": 0.28612303733825684, + "max_abs": 6.5625 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "899f33ca9e0f90b36d1e3f3c1a191e1eb4e602de1f626e39a0027bc681a456f3", + "mean": -0.029628224670886993, + "std": 10.17935848236084, + "rms": 10.179401397705078, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0a4357bd7579a6198e012dc0803682faf87b1c417482bb9a2af561462ae79e30", + "mean": -0.0031798547133803368, + "std": 0.2845705449581146, + "rms": 0.2845883071422577, + "max_abs": 6.34375 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "24b35f6270a751b3fd01cb720f603abc173b067ed234c69060b4c3db368c50d0", + "mean": -0.009185015223920345, + "std": 10.064224243164062, + "rms": 10.064229011535645, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "43e61fa54644eae0e979946b225980094b17500fa58bc4955c77b674094623bc", + "mean": -0.0031814640387892723, + "std": 0.2870151996612549, + "rms": 0.287032812833786, + "max_abs": 6.5625 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7335b07126b0db3db2536c08a9eebb39584a8aed848435a16d096de6f14c1746", + "mean": -0.008632533252239227, + "std": 8.703119277954102, + "rms": 8.703124046325684, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ee6d7531ec89f27ecec78cd48d7dffc80e62d08fd09a0e20b0bb3cc6df2d2e4b", + "mean": -0.0027678217738866806, + "std": 0.28287115693092346, + "rms": 0.28288471698760986, + "max_abs": 6.40625 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cbe5541c2dfbc717b2cd3ab28f42d86cc9419512f12666187d45c1eeea811487", + "mean": -0.008984151296317577, + "std": 10.064139366149902, + "rms": 10.064143180847168, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "afe11b34be5c521bc22f288426322e2fd0e9e20f90b3b6415407ec56b0447025", + "mean": -0.002740144031122327, + "std": 0.2844012677669525, + "rms": 0.28441449999809265, + "max_abs": 6.5625 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2e23ca510209be898dd6880ed3ef51a7616ad3ee3fef17261d9b5caa394144c9", + "mean": -0.008412809111177921, + "std": 8.703023910522461, + "rms": 8.703027725219727, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c3644a75d0a33279780b7aa5659e8fac737fbbdab852bd76595a24540744e566", + "mean": -0.0029320337343961, + "std": 0.2820100784301758, + "rms": 0.2820253372192383, + "max_abs": 6.3125 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "38201ae61bd35ef675e0b7080538f4fa7b8637126bee6e058f6d2977c30c381d", + "mean": -0.008829494006931782, + "std": 10.064126968383789, + "rms": 10.064130783081055, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "030df5568bcd4cbe7d56cea9617a16d3af0162954ca3cfad63cdeda08ebeec7d", + "mean": -0.00287035689689219, + "std": 0.28420373797416687, + "rms": 0.2842182219028473, + "max_abs": 6.5 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c1eb10823adba4a167a72ff85ff62718f146c2f3c840d972e688e9132e8804d6", + "mean": -0.00838154461234808, + "std": 8.703022003173828, + "rms": 8.703025817871094, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9967098832130432, + "min_cosine_similarity": 0.9901145100593567, + "mean_relative_l2": 0.07668391615152359, + "max_abs_delta": 0.34375 + }, + "system_bos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9946895837783813, + "min_cosine_similarity": 0.9889655709266663, + "mean_relative_l2": 0.10254443436861038, + "max_abs_delta": 0.328125 + }, + "system_x": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9908286929130554, + "min_cosine_similarity": 0.9809948205947876, + "mean_relative_l2": 0.1350991576910019, + "max_abs_delta": 0.46875 + }, + "system_period": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9902713894844055, + "min_cosine_similarity": 0.9788917899131775, + "mean_relative_l2": 0.13932308554649353, + "max_abs_delta": 0.4453125 + }, + "bos_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9905866384506226, + "min_cosine_similarity": 0.9830712676048279, + "mean_relative_l2": 0.13576121628284454, + "max_abs_delta": 0.34375 + }, + "bos_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9900815486907959, + "min_cosine_similarity": 0.9812045097351074, + "mean_relative_l2": 0.14050407707691193, + "max_abs_delta": 0.375 + }, + "x_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9866588711738586, + "min_cosine_similarity": 0.9778090715408325, + "mean_relative_l2": 0.16165904700756073, + "max_abs_delta": 0.375 + }, + "x_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9821775555610657, + "min_cosine_similarity": 0.9704375863075256, + "mean_relative_l2": 0.18722878396511078, + "max_abs_delta": 0.609375 + }, + "period_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9872767329216003, + "min_cosine_similarity": 0.977946937084198, + "mean_relative_l2": 0.15711475908756256, + "max_abs_delta": 0.5 + }, + "period_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9819099307060242, + "min_cosine_similarity": 0.9705208539962769, + "mean_relative_l2": 0.18839183449745178, + "max_abs_delta": 0.6171875 + } + } + }, + "layer_08": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2fc17ff7ea89f9ce50114306c9cffff7be7929d571f3ab3dd6c8edf7fcf849e4", + "mean": -0.002636307617649436, + "std": 0.3270837068557739, + "rms": 0.32709431648254395, + "max_abs": 7.5625 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "68d7c906e43103f6dcf21d5ed60a5876172b8747065b288f42b271b22e5ff54c", + "mean": -0.033190496265888214, + "std": 11.448265075683594, + "rms": 11.448312759399414, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "104f3f9d7cd5de957230f2da88891796d60da2f5948cd1d08eff0c520e414d75", + "mean": -0.0024595949798822403, + "std": 0.3282715678215027, + "rms": 0.3282807767391205, + "max_abs": 7.8125 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f2300fa13e366cf8697e1327b775a53f5d7d835c5f5e877bcd9200be9d5ab7a9", + "mean": -0.02919078804552555, + "std": 10.214314460754395, + "rms": 10.214356422424316, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "dd58d1d719fe70521b23b0f84c648911d4603be7568785bf526b51aaf5fa929f", + "mean": -0.002520173555240035, + "std": 0.3267499506473541, + "rms": 0.3267596662044525, + "max_abs": 7.5625 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e2bc75035ab58eeca25ea861d474376bce2d561b6446df4a8255457fa09951e4", + "mean": -0.009313706308603287, + "std": 10.085658073425293, + "rms": 10.085661888122559, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9918817169a8ef44f288c7c90be879252acd6e0a1192924cfcf604a843b074f0", + "mean": -0.002295679645612836, + "std": 0.3286920487880707, + "rms": 0.32870006561279297, + "max_abs": 7.71875 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c7c2372806379bb4317ef82e706d72939620a21d7eeaaf891dfc45d3b7b28795", + "mean": -0.008360311388969421, + "std": 8.72179126739502, + "rms": 8.721795082092285, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2e7816128f5dd16cf246f3c5edc9910196a4edbaa892c3615844c0b67192de45", + "mean": -0.001873431378044188, + "std": 0.3239874243736267, + "rms": 0.32399284839630127, + "max_abs": 7.6875 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4e015b060383c375b6e57cb2675248274da36d923299a22c0d5f7f51a8590b4d", + "mean": -0.008946123532950878, + "std": 10.085585594177246, + "rms": 10.085589408874512, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "30facd5f298bd116ecb3394078b867f5fe2c6cb417274c92916422c05b4710f8", + "mean": -0.0013866255758330226, + "std": 0.32372376322746277, + "rms": 0.32372674345970154, + "max_abs": 7.96875 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "67d4b2a95a63746d1f1461fbf1eb2396169d81af25f9f3ca9da1cdf1bc13da57", + "mean": -0.007938745431602001, + "std": 8.721685409545898, + "rms": 8.721689224243164, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b0594de4c4d629bf1ca3f4c9bd2b302eca64723180cf35d4be8012065d4be01a", + "mean": -0.002238118788227439, + "std": 0.3225373923778534, + "rms": 0.3225451409816742, + "max_abs": 7.53125 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e94d42cef49c40d6827e39d6b56756be407987bf6e920242527d58069dfe43de", + "mean": -0.009127098135650158, + "std": 10.085564613342285, + "rms": 10.08556842803955, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e441c2cbdca844026d97b00ecccabc2cc9a982f09d1540951df66415c5293be8", + "mean": -0.0016274394001811743, + "std": 0.32325178384780884, + "rms": 0.32325589656829834, + "max_abs": 7.875 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "24e928e7d8de12211cea9887365af7bd841ac1a22f404656f2bf5a1f2e8270a3", + "mean": -0.008025663904845715, + "std": 8.721672058105469, + "rms": 8.721674919128418, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9967278838157654, + "min_cosine_similarity": 0.9896607398986816, + "mean_relative_l2": 0.0777311772108078, + "max_abs_delta": 0.34375 + }, + "system_bos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9944532513618469, + "min_cosine_similarity": 0.9895474910736084, + "mean_relative_l2": 0.1048416867852211, + "max_abs_delta": 0.375 + }, + "system_x": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9896517992019653, + "min_cosine_similarity": 0.9812695980072021, + "mean_relative_l2": 0.14313645660877228, + "max_abs_delta": 0.5625 + }, + "system_period": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9885512590408325, + "min_cosine_similarity": 0.9790409803390503, + "mean_relative_l2": 0.15031777322292328, + "max_abs_delta": 0.53125 + }, + "bos_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9904329776763916, + "min_cosine_similarity": 0.9815874099731445, + "mean_relative_l2": 0.13674214482307434, + "max_abs_delta": 0.4375 + }, + "bos_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.990475594997406, + "min_cosine_similarity": 0.9841386079788208, + "mean_relative_l2": 0.13756586611270905, + "max_abs_delta": 0.40625 + }, + "x_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.985198974609375, + "min_cosine_similarity": 0.9748479723930359, + "mean_relative_l2": 0.17067444324493408, + "max_abs_delta": 0.5625 + }, + "x_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.980987548828125, + "min_cosine_similarity": 0.963208794593811, + "mean_relative_l2": 0.19197650253772736, + "max_abs_delta": 0.6875 + }, + "period_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9857406616210938, + "min_cosine_similarity": 0.9743456840515137, + "mean_relative_l2": 0.16621427237987518, + "max_abs_delta": 0.59375 + }, + "period_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9809848070144653, + "min_cosine_similarity": 0.9675701856613159, + "mean_relative_l2": 0.19261974096298218, + "max_abs_delta": 0.6875 + } + } + }, + "layer_09": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5dd01773ac569b228c121e7596f1124d99e0c17cc45a1d6650c0e23ce3bddb15", + "mean": -0.00474544195458293, + "std": 0.3804362416267395, + "rms": 0.3804658353328705, + "max_abs": 11.0 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fc31e36dc0d3ed8d8af5daa52d4b56a4b3480003b9ef3db74ba4fce55a31be5a", + "mean": -0.033453840762376785, + "std": 11.450496673583984, + "rms": 11.450546264648438, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "99bea8f7541bc95645108f50694772babee604da3672ecf7be3f432e9b85b387", + "mean": -0.00464436924085021, + "std": 0.3811839818954468, + "rms": 0.3812122642993927, + "max_abs": 11.0625 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e74492f3009f01275ba442b9566aecaea24c06c0a7a1402f1a062c568dc0a5af", + "mean": -0.030459187924861908, + "std": 10.216428756713867, + "rms": 10.216474533081055, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "57fcc82b0129aac092649727883a901921b0ba010b4a0bd83f665caef25307c5", + "mean": -0.004686910193413496, + "std": 0.37914323806762695, + "rms": 0.3791722059249878, + "max_abs": 10.875 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ad901e31a2ff6ad49e2ab91fc78a436bf2c84c9e90e82032933dd8d4f0ec2a5c", + "mean": -0.009858551435172558, + "std": 10.087993621826172, + "rms": 10.087998390197754, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "09cc7ce9035dbf4ebb3d5a37b2741023eadccacc635691c10a6e5d2e16312818", + "mean": -0.00452360138297081, + "std": 0.38247331976890564, + "rms": 0.3825000524520874, + "max_abs": 10.8125 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "17668eec3099a220f219a283929c03ec8622a2a2d28b7ee9e85867c380db1c09", + "mean": -0.00991231668740511, + "std": 8.724237442016602, + "rms": 8.7242431640625, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d2f7c52e6383bdf59ae5c0719e5e9d4d562975c47f9a77d4dccd49ba46c72ddd", + "mean": -0.004067076835781336, + "std": 0.3743182122707367, + "rms": 0.37434032559394836, + "max_abs": 10.875 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c62e4d9a53d16fc7115198cf9861e2f997c70442f0c3fc62708123547bef790c", + "mean": -0.009325872175395489, + "std": 10.087869644165039, + "rms": 10.087873458862305, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a73a1adc14657fb1b5e5e985da0f1187f5768ca3d8de18cbbd6389e34460357b", + "mean": -0.003776163561269641, + "std": 0.3733448386192322, + "rms": 0.3733639121055603, + "max_abs": 10.875 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c829ac8d0f10518608afec58cd01fb629ee6c3ed0b2f420a4c4432dcea4b9fc7", + "mean": -0.009530847892165184, + "std": 8.724029541015625, + "rms": 8.724034309387207, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c871ba3c87a6aefe487f23a515b52f973c661853238ea2bf374de64d0729e264", + "mean": -0.004437016323208809, + "std": 0.37337568402290344, + "rms": 0.37340202927589417, + "max_abs": 10.8125 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4317b9741240d51d341870128c452e8f595fba60709ce647bae4aa4af50c38e9", + "mean": -0.00933940801769495, + "std": 10.08781909942627, + "rms": 10.087823867797852, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "32e732da5559cb72e6c83d55a7058d01c19c0ac86a72b137eb4337f7528d2257", + "mean": -0.004169033374637365, + "std": 0.3740883469581604, + "rms": 0.3741115629673004, + "max_abs": 10.9375 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1a6fcf3d2e6d65d4a37fd537e7513efa38421b20151884a7d1d5842155379152", + "mean": -0.009515621699392796, + "std": 8.72399616241455, + "rms": 8.724000930786133, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9971423745155334, + "min_cosine_similarity": 0.992641270160675, + "mean_relative_l2": 0.07371427863836288, + "max_abs_delta": 0.3125 + }, + "system_bos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9953581094741821, + "min_cosine_similarity": 0.9913352727890015, + "mean_relative_l2": 0.09692040830850601, + "max_abs_delta": 0.5625 + }, + "system_x": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9908276200294495, + "min_cosine_similarity": 0.9832656383514404, + "mean_relative_l2": 0.13467811048030853, + "max_abs_delta": 0.6875 + }, + "system_period": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.990166962146759, + "min_cosine_similarity": 0.9834131002426147, + "mean_relative_l2": 0.13985516130924225, + "max_abs_delta": 0.625 + }, + "bos_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9922782778739929, + "min_cosine_similarity": 0.985840916633606, + "mean_relative_l2": 0.12320319563150406, + "max_abs_delta": 0.5 + }, + "bos_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9922252297401428, + "min_cosine_similarity": 0.9866524934768677, + "mean_relative_l2": 0.12436497956514359, + "max_abs_delta": 0.5625 + }, + "x_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9879847168922424, + "min_cosine_similarity": 0.980000376701355, + "mean_relative_l2": 0.1536191999912262, + "max_abs_delta": 0.625 + }, + "x_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9831341505050659, + "min_cosine_similarity": 0.9666178226470947, + "mean_relative_l2": 0.18028004467487335, + "max_abs_delta": 1.09375 + }, + "period_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9884010553359985, + "min_cosine_similarity": 0.9797129034996033, + "mean_relative_l2": 0.15051394701004028, + "max_abs_delta": 0.90625 + }, + "period_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9838752746582031, + "min_cosine_similarity": 0.9753262996673584, + "mean_relative_l2": 0.17746767401695251, + "max_abs_delta": 1.0 + } + } + }, + "layer_10": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1507ad3014771bc5145e8f4d7b98af9fb14d3aa87a0e1d47f4b41e02d8538a3a", + "mean": -0.0036098561249673367, + "std": 0.4325639009475708, + "rms": 0.4325789213180542, + "max_abs": 12.1875 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "42f41f45fe3c764dbcbe3deb00d87ad4484b24530274fcc127b0e32fd3d172c0", + "mean": -0.03373352065682411, + "std": 11.461380004882812, + "rms": 11.461429595947266, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cae1ae138c1859e16c75434be8e48c66fdf057d4178cd5892bcb038b026d3cbc", + "mean": -0.0035879744682461023, + "std": 0.43460479378700256, + "rms": 0.43461957573890686, + "max_abs": 12.3125 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d490e4d0acaaa61423520787cf055c0c8ac1a30a58771944b6ec1e6950835afb", + "mean": -0.030963756144046783, + "std": 10.22624397277832, + "rms": 10.226290702819824, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9353ec6eca8f145300f11a0e2a081369646c845f7cefa2b08bcead76a007886c", + "mean": -0.0037600097712129354, + "std": 0.4317587614059448, + "rms": 0.43177512288093567, + "max_abs": 12.25 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bc553890e73e5b35e6dc81a9a0cf583796bfb858fd761ba28ec258bffc00bf6d", + "mean": -0.010403861291706562, + "std": 10.09980583190918, + "rms": 10.099810600280762, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7e0d10c80402153b2732329acc0d8308d05391458036bc310f4d32f66cccc1b9", + "mean": -0.003325723810121417, + "std": 0.43569061160087585, + "rms": 0.435703307390213, + "max_abs": 12.0625 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1406bc814adfedea1c8261ce1d2fc4157056b6b21c6b749621789af75106aa25", + "mean": -0.010398613288998604, + "std": 8.734984397888184, + "rms": 8.734990119934082, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "190b7590f02c00afcb7755406025c658ad12919bf5bf5cea1033f349df7b1f99", + "mean": -0.0032168321777135134, + "std": 0.42807987332344055, + "rms": 0.42809194326400757, + "max_abs": 12.125 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "299a282cd620871f00d19a94bf245e3ea03f97a21bf513b257964c9db362ac39", + "mean": -0.00999637320637703, + "std": 10.099686622619629, + "rms": 10.099692344665527, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "90514099591150e675def4452081d4487734f1619fe85676520d4a2ce4e8a218", + "mean": -0.0026849936693906784, + "std": 0.42693087458610535, + "rms": 0.42693933844566345, + "max_abs": 12.25 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4ae6376b5963e322b4c0c76260afacc5cda6115b60e7ac152a12be5f64db91eb", + "mean": -0.010278252884745598, + "std": 8.734723091125488, + "rms": 8.73472785949707, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "927230b51d90cb3fa340be2f80eb4c65f85b3ee84b6bcf3888c36ae86a45f844", + "mean": -0.003602691926062107, + "std": 0.4275414049625397, + "rms": 0.4275566041469574, + "max_abs": 12.0 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ecdce4612d612f6192104475b2cb0c56b20fe5f236a3dd3e9d7fbb320f25ef2f", + "mean": -0.00982272531837225, + "std": 10.09964656829834, + "rms": 10.099651336669922, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "df370c6e438812eac8843ab17dcc74efac338dc3565d095994d2cc8aa8f9ce09", + "mean": -0.0029399232007563114, + "std": 0.4282051920890808, + "rms": 0.42821526527404785, + "max_abs": 12.1875 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b84fab87b46d618b13d18186c109bbb8096d88fda8a7f7e3cf6871e71249f2c5", + "mean": -0.01015813834965229, + "std": 8.734711647033691, + "rms": 8.73471736907959, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9968057870864868, + "min_cosine_similarity": 0.9912369847297668, + "mean_relative_l2": 0.07754812389612198, + "max_abs_delta": 0.375 + }, + "system_bos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9947355389595032, + "min_cosine_similarity": 0.990345299243927, + "mean_relative_l2": 0.10254047065973282, + "max_abs_delta": 0.5 + }, + "system_x": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9905190467834473, + "min_cosine_similarity": 0.9818210005760193, + "mean_relative_l2": 0.13643330335617065, + "max_abs_delta": 0.75 + }, + "system_period": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.989454448223114, + "min_cosine_similarity": 0.9787460565567017, + "mean_relative_l2": 0.14338426291942596, + "max_abs_delta": 0.671875 + }, + "bos_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9920276999473572, + "min_cosine_similarity": 0.9858022928237915, + "mean_relative_l2": 0.12494926899671555, + "max_abs_delta": 0.5 + }, + "bos_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9920240640640259, + "min_cosine_similarity": 0.9856342077255249, + "mean_relative_l2": 0.12591104209423065, + "max_abs_delta": 0.4375 + }, + "x_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9875596761703491, + "min_cosine_similarity": 0.9802709817886353, + "mean_relative_l2": 0.155986949801445, + "max_abs_delta": 0.8125 + }, + "x_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.982363224029541, + "min_cosine_similarity": 0.96400386095047, + "mean_relative_l2": 0.18390236794948578, + "max_abs_delta": 1.375 + }, + "period_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9878436923027039, + "min_cosine_similarity": 0.9805610775947571, + "mean_relative_l2": 0.15372076630592346, + "max_abs_delta": 0.9375 + }, + "period_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9823076725006104, + "min_cosine_similarity": 0.9691655039787292, + "mean_relative_l2": 0.18473310768604279, + "max_abs_delta": 1.125 + } + } + }, + "layer_11": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "019e81ff8291e5a7a2a8bbbb1692fb8baa74e1f3e88f395e99de251b8d38b779", + "mean": -0.004086168482899666, + "std": 0.5369618535041809, + "rms": 0.5369774103164673, + "max_abs": 17.625 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d2e119ef48c8e6bf57995b37b424668f76bc32ec046718609fdb59eb12bdaac9", + "mean": -0.03338427469134331, + "std": 11.524271965026855, + "rms": 11.524319648742676, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3fc0d8df379880fd90de0f0e244f731a4fc6b8ceb50cc9be94e35e2aadda1d81", + "mean": -0.0034774683881551027, + "std": 0.5378182530403137, + "rms": 0.5378295183181763, + "max_abs": 17.875 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1ebb03c9f96abc8e25445237194a4c9f6f4da76534711f9b5f2af4e5970237fc", + "mean": -0.03057974763214588, + "std": 10.281282424926758, + "rms": 10.281327247619629, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fde0bb7494a66888430e70af90ac1c3d1265e488ec01893cd197f94b070b95d0", + "mean": -0.004150043241679668, + "std": 0.5372318029403687, + "rms": 0.5372478365898132, + "max_abs": 17.375 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ff1432d3b805713349cdfc0a1cf2bf2569b04d70f4f7414bb38150717965d793", + "mean": -0.009893766604363918, + "std": 10.151453018188477, + "rms": 10.151457786560059, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "80701b89783eb3e35aac1b3db9424fb5a27ad658aa41c771f150e61a66c6cfdb", + "mean": -0.0037044144701212645, + "std": 0.5412229299545288, + "rms": 0.5412355661392212, + "max_abs": 17.625 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "56745b02ba903d3c856680e83e98fb74a1c361a152b04aedde9be35f592d7de1", + "mean": -0.010039038024842739, + "std": 8.780296325683594, + "rms": 8.780302047729492, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e136bf6871eb6be81d2de448f5890cd657de8e223e84a9efc0fa63226caf56c7", + "mean": -0.003570238593965769, + "std": 0.5321331024169922, + "rms": 0.532145082950592, + "max_abs": 17.5 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c9ee74231397265eb09ea7f98a804d7eec6b4e0ceadf934080a27a3ccdc45abd", + "mean": -0.009237706661224365, + "std": 10.151385307312012, + "rms": 10.151389122009277, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d17ae97b251f23fcace1a973b54e41c94386b7ad5b8bab47db9852b3de7d3eb8", + "mean": -0.0025581957306712866, + "std": 0.5301214456558228, + "rms": 0.5301276445388794, + "max_abs": 17.75 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "aa5817f0457211fce7a838c25d188a4dcc1f69d56d0a7e0f6a4d460c0172eede", + "mean": -0.00948265753686428, + "std": 8.779930114746094, + "rms": 8.779935836791992, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "add75f51bf2d9e5d8663ee5053370967976caada70cef4f3d8fe6bc0dd72a57e", + "mean": -0.00374686811119318, + "std": 0.530434787273407, + "rms": 0.5304480791091919, + "max_abs": 17.625 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b7b4ff1ec5535afad99677655060e65a6fcfe11358503307f2c4cd77154baa61", + "mean": -0.00910284835845232, + "std": 10.151272773742676, + "rms": 10.151277542114258, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b055116d933fcc9486a9fc9476521c26185a61f77f1f6b5dfb70b095b0ec076a", + "mean": -0.0025725080631673336, + "std": 0.5311137437820435, + "rms": 0.5311199426651001, + "max_abs": 17.875 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "13915bae87449592df27a75f3fd5d1a327cbfea129927aee0453753ec23487ab", + "mean": -0.0093653853982687, + "std": 8.779918670654297, + "rms": 8.779924392700195, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9973659515380859, + "min_cosine_similarity": 0.9937348961830139, + "mean_relative_l2": 0.07031351327896118, + "max_abs_delta": 0.4375 + }, + "system_bos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9956477880477905, + "min_cosine_similarity": 0.9921031594276428, + "mean_relative_l2": 0.09315875172615051, + "max_abs_delta": 0.625 + }, + "system_x": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9923648238182068, + "min_cosine_similarity": 0.9835233688354492, + "mean_relative_l2": 0.12255466729402542, + "max_abs_delta": 1.125 + }, + "system_period": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9913750290870667, + "min_cosine_similarity": 0.9797580242156982, + "mean_relative_l2": 0.1299571543931961, + "max_abs_delta": 0.96875 + }, + "bos_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9939089417457581, + "min_cosine_similarity": 0.9889470338821411, + "mean_relative_l2": 0.10960361361503601, + "max_abs_delta": 0.625 + }, + "bos_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9939041137695312, + "min_cosine_similarity": 0.9891819953918457, + "mean_relative_l2": 0.11087004095315933, + "max_abs_delta": 0.65625 + }, + "x_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9906352758407593, + "min_cosine_similarity": 0.9859942197799683, + "mean_relative_l2": 0.1361410915851593, + "max_abs_delta": 0.8125 + }, + "x_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9864636063575745, + "min_cosine_similarity": 0.9724700450897217, + "mean_relative_l2": 0.16208912432193756, + "max_abs_delta": 1.625 + }, + "period_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9909129738807678, + "min_cosine_similarity": 0.9863036274909973, + "mean_relative_l2": 0.13390162587165833, + "max_abs_delta": 0.875 + }, + "period_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9865188002586365, + "min_cosine_similarity": 0.9758135676383972, + "mean_relative_l2": 0.16233058273792267, + "max_abs_delta": 1.375 + } + } + }, + "layer_12": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6932b6231a1445f6cfd226be4de8fa8cef24a9080921f627433133b479b24f60", + "mean": -0.003513037459924817, + "std": 0.5871198773384094, + "rms": 0.5871303677558899, + "max_abs": 15.875 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c3f8ef227b5b638240a0d95f144157d266ba40d94dd3d1f5d81f6832d4c979ff", + "mean": -0.03404617682099342, + "std": 11.604842185974121, + "rms": 11.604891777038574, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8e0c84dba936c58990250d1e427f956dfbfc01ad13b57a1bf0cddddd881362ef", + "mean": -0.0032877791672945023, + "std": 0.5900298357009888, + "rms": 0.5900390148162842, + "max_abs": 16.125 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "130859e4e82de939dde19eb6db8762718b57cd9023fc004b256eb4c6c65f4a89", + "mean": -0.030782809481024742, + "std": 10.356571197509766, + "rms": 10.35661792755127, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a205b4acd6d8c717cc7cc1c60802e5e09ce0a5ad2a304726835095c6308d8e6e", + "mean": -0.004034474492073059, + "std": 0.5888636112213135, + "rms": 0.5888774394989014, + "max_abs": 15.75 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d6ee19a391598bfa52e9c76e88e07f2d1c02fc5dea03bd34b3872d2873a09e1f", + "mean": -0.01048921700567007, + "std": 10.169707298278809, + "rms": 10.16971206665039, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8223cdcaebb5306d9a4ffea727d8dde2397d31086f855460b6c6314ba42dbb2e", + "mean": -0.0035754109267145395, + "std": 0.5934025049209595, + "rms": 0.593413233757019, + "max_abs": 16.0 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a42237ab54670fa072c12d94930dc1811b459dd5d6eff8979a776d1b91f4b455", + "mean": -0.01030642632395029, + "std": 8.797130584716797, + "rms": 8.797137260437012, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "934cd1b058d7b73abebd05796b69bc17c81987526a764cc84ab86468d3891492", + "mean": -0.0034174639731645584, + "std": 0.5857639312744141, + "rms": 0.5857739448547363, + "max_abs": 15.875 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9db81bcacd50a5291057cfb6901c8abf5481cad9b9cb3be5ea794728eb3ee49a", + "mean": -0.01053602620959282, + "std": 10.169663429260254, + "rms": 10.169669151306152, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "dbd63f0034890a82bb43788767b52cc6a9dd7547f630967ec2772a9ba8c002c3", + "mean": -0.0025634332560002804, + "std": 0.5847028493881226, + "rms": 0.5847084522247314, + "max_abs": 16.25 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "998d4a6ea3ce640d3809838c9a518d25a6293aa29900877414457e0591196166", + "mean": -0.01000532228499651, + "std": 8.796639442443848, + "rms": 8.796645164489746, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "17fde47e77b22780c7696d51a6742624f4e0f5336931c790fa87a3e4b829cc20", + "mean": -0.003475386183708906, + "std": 0.5859867334365845, + "rms": 0.5859969854354858, + "max_abs": 15.875 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "807288fc30bb9d9921c5f891bc6c872f3349619fbbc1aa74de98fb6dd543d173", + "mean": -0.009877157397568226, + "std": 10.169589042663574, + "rms": 10.169593811035156, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6ab6d88d05d358fa867dc5cc9c7402137bcd99066a9d63fc6e23a7fc949d1ff3", + "mean": -0.002710159169510007, + "std": 0.5859327912330627, + "rms": 0.5859390497207642, + "max_abs": 16.25 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "91aeb7f499c2038257765457c652c6465f0df5a5585fb3b979a9df4112a28827", + "mean": -0.009792663156986237, + "std": 8.7966890335083, + "rms": 8.7966947555542, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9972525238990784, + "min_cosine_similarity": 0.9942570924758911, + "mean_relative_l2": 0.07206140458583832, + "max_abs_delta": 0.5 + }, + "system_bos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9952945709228516, + "min_cosine_similarity": 0.9920470118522644, + "mean_relative_l2": 0.09688983857631683, + "max_abs_delta": 0.8125 + }, + "system_x": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9921919107437134, + "min_cosine_similarity": 0.9830844402313232, + "mean_relative_l2": 0.12300381809473038, + "max_abs_delta": 1.0 + }, + "system_period": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9912452697753906, + "min_cosine_similarity": 0.9796172976493835, + "mean_relative_l2": 0.13052786886692047, + "max_abs_delta": 0.953125 + }, + "bos_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9934641122817993, + "min_cosine_similarity": 0.9884212017059326, + "mean_relative_l2": 0.1135232001543045, + "max_abs_delta": 0.5625 + }, + "bos_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9937529563903809, + "min_cosine_similarity": 0.9888092875480652, + "mean_relative_l2": 0.11203630268573761, + "max_abs_delta": 0.84375 + }, + "x_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9904443621635437, + "min_cosine_similarity": 0.9857101440429688, + "mean_relative_l2": 0.13810238242149353, + "max_abs_delta": 0.9375 + }, + "x_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9860197901725769, + "min_cosine_similarity": 0.9689592719078064, + "mean_relative_l2": 0.1643524169921875, + "max_abs_delta": 1.375 + }, + "period_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.990900456905365, + "min_cosine_similarity": 0.9860442876815796, + "mean_relative_l2": 0.13463124632835388, + "max_abs_delta": 0.9375 + }, + "period_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9859897494316101, + "min_cosine_similarity": 0.973120391368866, + "mean_relative_l2": 0.16548097133636475, + "max_abs_delta": 1.25 + } + } + }, + "layer_13": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3732a47ba9f6664c7c879d7896f638717c4f391c635721f0c6a0e246e1ceec46", + "mean": -0.002072803908959031, + "std": 0.6450483202934265, + "rms": 0.6450516581535339, + "max_abs": 18.5 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "972f5a4ce89a960386e12266bb5048e35d1d3bbeb61b3bd99b4da6c1f0492c22", + "mean": -0.033093634992837906, + "std": 11.614691734313965, + "rms": 11.614738464355469, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e38662834582eb69bfe21c9f97129d284a146782a39bb303570d3872dfbdfe1a", + "mean": -0.0020043421536684036, + "std": 0.6473622918128967, + "rms": 0.647365391254425, + "max_abs": 18.625 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "27271ec8db8c6556482e60ab555a71fa92329cf24cb054797a1cd70980718849", + "mean": -0.031172895804047585, + "std": 10.366060256958008, + "rms": 10.366106986999512, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "be1fb34317d629fe8f59ff564fb68becc1823be5c26d97eb2245354de791ecbf", + "mean": -0.002914092503488064, + "std": 0.6475038528442383, + "rms": 0.6475104689598083, + "max_abs": 18.5 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b6432df4b46ed360eabc88b2f4ca17f1d0ff5a20927e1de208533109c4985877", + "mean": -0.009552715346217155, + "std": 10.178577423095703, + "rms": 10.178581237792969, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "851661b9446b58495d025c6df49457d1b6f140ecadfa9ccbaa57230d8937d9fd", + "mean": -0.002505010226741433, + "std": 0.6520639061927795, + "rms": 0.6520687341690063, + "max_abs": 19.125 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0b0ce9cc10313b83bec5b863c2c30f34a5debe6d6750f02dc07fbac8f171eb0c", + "mean": -0.010594721883535385, + "std": 8.805893898010254, + "rms": 8.805900573730469, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "052aedc918ac7d24bfd1d41ebfd1e37333f4e26673a907bdceeb5691f57f905e", + "mean": -0.003102414309978485, + "std": 0.6459372639656067, + "rms": 0.6459447741508484, + "max_abs": 17.5 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e82cfb434e6e7651f02bb7a9e7da3db309b044f9957f9cdddf6f6a3d8f051f80", + "mean": -0.010051238350570202, + "std": 10.17866039276123, + "rms": 10.178665161132812, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e0ade287cb5b36071856e31b9bd8d1f5cad0e8e0df0f0d744f38c30fac22eae2", + "mean": -0.002344936365261674, + "std": 0.642641007900238, + "rms": 0.6426452398300171, + "max_abs": 17.0 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "794c46af9951d7b4a136ced956f7e00de420a41bd0dff896ce0f5b26c937c89f", + "mean": -0.010739943012595177, + "std": 8.805438041687012, + "rms": 8.805444717407227, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "068252c8611e0849d74fa2f22cad8edd3bfe79f7feb037aae9dbaf4ade63f52e", + "mean": -0.003129950724542141, + "std": 0.6460850238800049, + "rms": 0.6460925936698914, + "max_abs": 17.875 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "35152014e706c65948c5487f263340813fb46765e836b924aa07acb2c1f52b20", + "mean": -0.009385482408106327, + "std": 10.178536415100098, + "rms": 10.17854118347168, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a6a2722881166c741083618162989f263e3160cbc2d2f9d129352b4deaf2f569", + "mean": -0.0022220443934202194, + "std": 0.6427692770957947, + "rms": 0.6427730917930603, + "max_abs": 17.125 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "651a3d97ed546fc350708737e3bc6af07258f09fb1141ea0d77168a19dc4c1c6", + "mean": -0.01045244000852108, + "std": 8.805447578430176, + "rms": 8.80545425415039, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9972643852233887, + "min_cosine_similarity": 0.9946876168251038, + "mean_relative_l2": 0.07227516919374466, + "max_abs_delta": 0.53125 + }, + "system_bos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9954673051834106, + "min_cosine_similarity": 0.9924737215042114, + "mean_relative_l2": 0.09503840655088425, + "max_abs_delta": 0.875 + }, + "system_x": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9923337697982788, + "min_cosine_similarity": 0.9834017753601074, + "mean_relative_l2": 0.12192937731742859, + "max_abs_delta": 1.09375 + }, + "system_period": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9912639856338501, + "min_cosine_similarity": 0.9798787832260132, + "mean_relative_l2": 0.12973904609680176, + "max_abs_delta": 1.125 + }, + "bos_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9935033917427063, + "min_cosine_similarity": 0.9864981174468994, + "mean_relative_l2": 0.11299002915620804, + "max_abs_delta": 0.6875 + }, + "bos_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9940361380577087, + "min_cosine_similarity": 0.9892942905426025, + "mean_relative_l2": 0.10952241718769073, + "max_abs_delta": 1.0625 + }, + "x_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9908163547515869, + "min_cosine_similarity": 0.9837884902954102, + "mean_relative_l2": 0.13598158955574036, + "max_abs_delta": 1.0625 + }, + "x_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9862149953842163, + "min_cosine_similarity": 0.960465669631958, + "mean_relative_l2": 0.16271436214447021, + "max_abs_delta": 1.625 + }, + "period_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9914094805717468, + "min_cosine_similarity": 0.9854028224945068, + "mean_relative_l2": 0.13166795670986176, + "max_abs_delta": 0.9375 + }, + "period_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9862664341926575, + "min_cosine_similarity": 0.9649931788444519, + "mean_relative_l2": 0.16288918256759644, + "max_abs_delta": 1.625 + } + } + }, + "layer_14": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6bc69d96a7f65ebf4193cfd93e640beebf9c40695f2e78c3fce0094ae445bc1b", + "mean": 0.000956082483753562, + "std": 0.7305133938789368, + "rms": 0.7305140495300293, + "max_abs": 21.5 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bc5095e01079148ecca1ea2161cac5b3816ede206f5453ec210af7ac7369beb8", + "mean": -0.030181067064404488, + "std": 11.6382417678833, + "rms": 11.638279914855957, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4e4de29ca76226a1948ed06a1ddd505867ac079304663224fbd331e1e8fb6fae", + "mean": 0.0009194249869324267, + "std": 0.7332203388214111, + "rms": 0.7332208752632141, + "max_abs": 21.625 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ddd05c9deed093e54380cc6947dcc83fcbeb36184ce8667d979a6010eb2b03ee", + "mean": -0.029418954625725746, + "std": 10.386560440063477, + "rms": 10.386602401733398, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8dc6e53e3dc740c780e7ae8d1fbf91168aba4f9a3a8de65a0ad594f820b3c85a", + "mean": 0.00015791019541211426, + "std": 0.7336735129356384, + "rms": 0.7336735129356384, + "max_abs": 21.5 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "10189a04a8bc209200c7d906147ba7e63bd5f8ce397a45cb868d4cd7b59671ab", + "mean": -0.006565389689058065, + "std": 10.20409107208252, + "rms": 10.204093933105469, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8619986908cf83a461ab9b66940bcd73c1a258580e5d4c96ef7773d900c8fe36", + "mean": 0.0002617233549244702, + "std": 0.7398046851158142, + "rms": 0.7398046851158142, + "max_abs": 22.25 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5e1f7f846fd6c9622459e5ebf7d7179274e7351435d01d14e7f196369b795f06", + "mean": -0.008709710091352463, + "std": 8.82879638671875, + "rms": 8.828800201416016, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1049c482edb9506bb23af9aa4f9e4ab349e08371c79af408cfbbda315c54c99e", + "mean": 0.00010890902194660157, + "std": 0.7304804921150208, + "rms": 0.7304804921150208, + "max_abs": 20.375 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b8c700f38094d529ddce221c1a39eade80ff22d52941a22f37137943ff140d05", + "mean": -0.0069350250996649265, + "std": 10.204144477844238, + "rms": 10.204146385192871, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e5e0a3b0ec7098a6cdfe6e58d8ee741a387cd7f86e60c04b37f48239f5171f1f", + "mean": 0.0006418571574613452, + "std": 0.7276594042778015, + "rms": 0.7276597023010254, + "max_abs": 20.25 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "782b1d10464153356f2e7efb7fd44ca262d4f99e1409ac29773ab65defc5dd92", + "mean": -0.008786452934145927, + "std": 8.828286170959473, + "rms": 8.828290939331055, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1bd308855c944513340db562a8e8501c9e574303fd51f020cd20bb923be7b9a9", + "mean": -0.0002638062578625977, + "std": 0.7303206324577332, + "rms": 0.7303206920623779, + "max_abs": 20.75 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e89c142590ed05584e1282c5ea386a388b46c3430001dab0db4830980d181abe", + "mean": -0.006453390698879957, + "std": 10.204000473022461, + "rms": 10.204002380371094, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "231b442a151c779e8ba181c969450b8d84ceb05caa936a699b1a2a9902f061cf", + "mean": 0.0008029348100535572, + "std": 0.7281448841094971, + "rms": 0.7281453013420105, + "max_abs": 20.25 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d1b5c30fe04f8be30b7748f9d21b1a26db9c0fc58269b0548cf62c8fb6aba0db", + "mean": -0.00872020423412323, + "std": 8.82825756072998, + "rms": 8.828262329101562, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9970119595527649, + "min_cosine_similarity": 0.9944784641265869, + "mean_relative_l2": 0.07561543583869934, + "max_abs_delta": 0.625 + }, + "system_bos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9954212307929993, + "min_cosine_similarity": 0.992842435836792, + "mean_relative_l2": 0.09547024965286255, + "max_abs_delta": 1.25 + }, + "system_x": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9920452237129211, + "min_cosine_similarity": 0.9830856919288635, + "mean_relative_l2": 0.12412317842245102, + "max_abs_delta": 1.15625 + }, + "system_period": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9904903173446655, + "min_cosine_similarity": 0.9747830629348755, + "mean_relative_l2": 0.13465213775634766, + "max_abs_delta": 1.125 + }, + "bos_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9931917786598206, + "min_cosine_similarity": 0.9856026768684387, + "mean_relative_l2": 0.11515766382217407, + "max_abs_delta": 0.8125 + }, + "bos_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.993858277797699, + "min_cosine_similarity": 0.9883358478546143, + "mean_relative_l2": 0.1107807382941246, + "max_abs_delta": 1.09375 + }, + "x_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9906811714172363, + "min_cosine_similarity": 0.9840036034584045, + "mean_relative_l2": 0.1361469030380249, + "max_abs_delta": 1.125 + }, + "x_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9862408638000488, + "min_cosine_similarity": 0.9598315954208374, + "mean_relative_l2": 0.16165776550769806, + "max_abs_delta": 1.875 + }, + "period_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.991594672203064, + "min_cosine_similarity": 0.9849733710289001, + "mean_relative_l2": 0.12962302565574646, + "max_abs_delta": 0.875 + }, + "period_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9857692718505859, + "min_cosine_similarity": 0.9619577527046204, + "mean_relative_l2": 0.1642286330461502, + "max_abs_delta": 1.75 + } + } + }, + "layer_15": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1a38a99810f8232785ca485757ce41dd5c49f0568918161bd8bb3943cba4be57", + "mean": -0.0005294129950925708, + "std": 0.8373008370399475, + "rms": 0.8373009562492371, + "max_abs": 23.5 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a33809d5aad65a4b69be0ade689b6ac4b8969576799b00d70482b033d5fc5b6a", + "mean": -0.029774578288197517, + "std": 11.648444175720215, + "rms": 11.648482322692871, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2eb75c59ee4e6814fbb0393ffb13b67ef5d9694871fad615573df54a27454d12", + "mean": -0.0005449976888485253, + "std": 0.8392142653465271, + "rms": 0.8392144441604614, + "max_abs": 23.625 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4b4ee2a58938b00ec76e98f709fdd8b5959c6f84a9a11108e48b2d38985acbaf", + "mean": -0.029759913682937622, + "std": 10.39700698852539, + "rms": 10.397049903869629, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7fe0775d8a1ad0aca18b1ef94b58aaa20c137b66e703472b69ebb68f53a29304", + "mean": -0.0014058086089789867, + "std": 0.8397130370140076, + "rms": 0.8397141695022583, + "max_abs": 23.625 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a29297bcd4d4517e25432f7d6bcb37b312ba54443b3235716b5028bbf2018493", + "mean": -0.006427752319723368, + "std": 10.214754104614258, + "rms": 10.21475601196289, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "874b40b2df286749c64ef0b034bf8eb3b4eaa03f66e296c961403203c416ed72", + "mean": -0.0010274661472067237, + "std": 0.8478186726570129, + "rms": 0.8478192090988159, + "max_abs": 24.25 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9629caaa96490216ebc252f712bd1fa10d8bdc7ee02c78e69ed0e2dfc9fb99fc", + "mean": -0.00919004064053297, + "std": 8.839972496032715, + "rms": 8.839977264404297, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6c83b6d6a1fe5dbefa03ff19510f01caaa5009e03e66ff99b1781e9a21d00b66", + "mean": -0.0011906176805496216, + "std": 0.8361828923225403, + "rms": 0.8361837267875671, + "max_abs": 22.625 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ae9d4c4f4541e6fa5ba39f09ddd740368ccbee8ba752c17bce390fa3d6c8dd8e", + "mean": -0.006605792790651321, + "std": 10.214720726013184, + "rms": 10.214722633361816, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d0ee84f116fb1eaa12e56be8cf16229397dc029b7c682583b4d15e3ece55a34e", + "mean": -0.0008626515627838671, + "std": 0.8286526799201965, + "rms": 0.8286531567573547, + "max_abs": 22.25 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d02461370997d40895e4f4ac9526a906df40b4425c7db184a194a590e5791994", + "mean": -0.009294014424085617, + "std": 8.839077949523926, + "rms": 8.839082717895508, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "291834c8edd5d2cc49bf2e9056f132460839287986b7b368da94cd4864b10037", + "mean": -0.0019088705303147435, + "std": 0.8361860513687134, + "rms": 0.8361882567405701, + "max_abs": 22.75 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4a6d5bf21204ea63dbc27aed2104efff76afe6093f493f879a5b07f6967b7aea", + "mean": -0.006392244249582291, + "std": 10.214598655700684, + "rms": 10.214600563049316, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "454818741003a6f2b377bac98824aeae413a801c2775d4b98eb74d78ccda2897", + "mean": -0.0012698954669758677, + "std": 0.8312164545059204, + "rms": 0.831217348575592, + "max_abs": 22.75 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7276fd6d36105ba12bcc8dc9e4e5ee1efc19a9d7eb559daa815edd505ce57309", + "mean": -0.009264405816793442, + "std": 8.83918285369873, + "rms": 8.839187622070312, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9971758723258972, + "min_cosine_similarity": 0.9952602386474609, + "mean_relative_l2": 0.07436887174844742, + "max_abs_delta": 0.53125 + }, + "system_bos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9954620599746704, + "min_cosine_similarity": 0.9930528998374939, + "mean_relative_l2": 0.09549228101968765, + "max_abs_delta": 1.375 + }, + "system_x": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9920149445533752, + "min_cosine_similarity": 0.9847460389137268, + "mean_relative_l2": 0.12464737147092819, + "max_abs_delta": 2.25 + }, + "system_period": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9904208779335022, + "min_cosine_similarity": 0.976425290107727, + "mean_relative_l2": 0.13529108464717865, + "max_abs_delta": 1.75 + }, + "bos_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9936163425445557, + "min_cosine_similarity": 0.987388014793396, + "mean_relative_l2": 0.11148214340209961, + "max_abs_delta": 1.0 + }, + "bos_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9941646456718445, + "min_cosine_similarity": 0.9892970323562622, + "mean_relative_l2": 0.10812930762767792, + "max_abs_delta": 1.1875 + }, + "x_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9913339018821716, + "min_cosine_similarity": 0.9856604337692261, + "mean_relative_l2": 0.13133689761161804, + "max_abs_delta": 1.25 + }, + "x_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9869381189346313, + "min_cosine_similarity": 0.9654276371002197, + "mean_relative_l2": 0.15743893384933472, + "max_abs_delta": 2.625 + }, + "period_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9922646880149841, + "min_cosine_similarity": 0.9872301816940308, + "mean_relative_l2": 0.12439149618148804, + "max_abs_delta": 0.9375 + }, + "period_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9861755967140198, + "min_cosine_similarity": 0.9629268646240234, + "mean_relative_l2": 0.1615140587091446, + "max_abs_delta": 2.0 + } + } + }, + "layer_16": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "92576d0500f34bfd6177c3a98693234c976ab3bff7983957f7f4e283833d6963", + "mean": 0.0027508605271577835, + "std": 0.9345710277557373, + "rms": 0.9345750212669373, + "max_abs": 26.125 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "59dd13e4d91e3c720e66f69e01d0bea8e803ee58ba566e4d8a0b4e2b7d3d9ec2", + "mean": -0.02761700190603733, + "std": 11.659506797790527, + "rms": 11.659539222717285, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8017a09bb20573f9b31b77e170313c213c0e7c6f331960ecdd69a6e1624a2ff3", + "mean": 0.003000263823196292, + "std": 0.9373154640197754, + "rms": 0.9373202323913574, + "max_abs": 26.5 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5ee2c548178ac005046260c4247bcbfeddfc339f80ef5f2b0b9f2ab1e5eaac00", + "mean": -0.027507584542036057, + "std": 10.40795612335205, + "rms": 10.407992362976074, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a8e1d3be7db436141f9dec9e9f032fcf3da02adc76c14cb8e1d4dc08bd54b807", + "mean": 0.0017622255254536867, + "std": 0.9334911108016968, + "rms": 0.9334927201271057, + "max_abs": 26.25 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0489d438b127651a76ec5813478fba051e076e2c1368001a3b7bb64d2475c3a4", + "mean": -0.004274705890566111, + "std": 10.225743293762207, + "rms": 10.225743293762207, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "40a04beb3e7d4dd03a19cfbc3ac463a6ef2a0c221b4c145379b02314da520252", + "mean": 0.0025233859196305275, + "std": 0.9413723945617676, + "rms": 0.9413758516311646, + "max_abs": 27.125 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5d5e754c8530080fc122baed6c9e16017377b6143ba71c7000f69b91f5d10bd0", + "mean": -0.006673820316791534, + "std": 8.851576805114746, + "rms": 8.851578712463379, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "da4eee696ca023b2c6b165f2a7353619ee4ca9b217e87b4368be0fb8c8832a3a", + "mean": 0.0017749167745932937, + "std": 0.9295502305030823, + "rms": 0.929551899433136, + "max_abs": 26.75 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "10697424ca81d3ae26806c33ab9b66bef5d6706538a436e9f34302b9c95e6073", + "mean": -0.004628580529242754, + "std": 10.225934028625488, + "rms": 10.225934028625488, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "36992f2424056acf42ccf685bf608d9d963084fd82cc1036ae6ce48fa1144b68", + "mean": 0.0025803588796406984, + "std": 0.9229490160942078, + "rms": 0.9229525923728943, + "max_abs": 26.75 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5aebcbb32121ee343aa1cada2711fbe08e002299a296187d348140b7ed42659a", + "mean": -0.007042464800179005, + "std": 8.850890159606934, + "rms": 8.850892066955566, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "773dd56294f30d9a6f5d3e62143dee803048a20010a273596d8709b9454c4be2", + "mean": 0.0011575176613405347, + "std": 0.9294427037239075, + "rms": 0.9294434189796448, + "max_abs": 26.0 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a1c53446bf7ee2aba7c3a2fc908e11875b937c951226bdbc17ba105ee2320024", + "mean": -0.004275364335626364, + "std": 10.225569725036621, + "rms": 10.225570678710938, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d612146d9aff537c4e566094b07f759aca0f2c71cac8e1c1f334e216e79fbe32", + "mean": 0.0023184255696833134, + "std": 0.9236592650413513, + "rms": 0.9236621856689453, + "max_abs": 27.25 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5188a4ff8ac0e59aecd2209ab2b6073961edadd6565c7ac9ae065e4846a1af9d", + "mean": -0.006762088742107153, + "std": 8.850735664367676, + "rms": 8.850738525390625, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.99708092212677, + "min_cosine_similarity": 0.9952775239944458, + "mean_relative_l2": 0.07552774995565414, + "max_abs_delta": 0.75 + }, + "system_bos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9952930212020874, + "min_cosine_similarity": 0.9928934574127197, + "mean_relative_l2": 0.09699170291423798, + "max_abs_delta": 1.25 + }, + "system_x": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9920368194580078, + "min_cosine_similarity": 0.9852737784385681, + "mean_relative_l2": 0.12430144101381302, + "max_abs_delta": 2.0 + }, + "system_period": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.99027019739151, + "min_cosine_similarity": 0.9760832786560059, + "mean_relative_l2": 0.13614363968372345, + "max_abs_delta": 1.875 + }, + "bos_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.993428111076355, + "min_cosine_similarity": 0.9876065254211426, + "mean_relative_l2": 0.11225209385156631, + "max_abs_delta": 1.25 + }, + "bos_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9940730929374695, + "min_cosine_similarity": 0.988878607749939, + "mean_relative_l2": 0.1079568862915039, + "max_abs_delta": 1.25 + }, + "x_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9910797476768494, + "min_cosine_similarity": 0.9831398129463196, + "mean_relative_l2": 0.1322764903306961, + "max_abs_delta": 1.25 + }, + "x_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9867905974388123, + "min_cosine_similarity": 0.9636334180831909, + "mean_relative_l2": 0.15728527307510376, + "max_abs_delta": 2.125 + }, + "period_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9921016693115234, + "min_cosine_similarity": 0.9876646399497986, + "mean_relative_l2": 0.12549635767936707, + "max_abs_delta": 0.9375 + }, + "period_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.985630214214325, + "min_cosine_similarity": 0.958098292350769, + "mean_relative_l2": 0.16321755945682526, + "max_abs_delta": 2.125 + } + } + }, + "layer_17": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b237a548888c0133bc9f1ba23d598cf7ee8de0a5ebc7b5bb11bac06125de3f86", + "mean": 0.005132889840751886, + "std": 1.0943912267684937, + "rms": 1.0944032669067383, + "max_abs": 30.125 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d6018f39e8ea4e593a0e7d6a8566abc8d2e608cc3bec5241cd7b31790d5ed4ff", + "mean": -0.0270405113697052, + "std": 11.674234390258789, + "rms": 11.67426586151123, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1e05ff6d91595815fb8907c3e58c37265cfea4357d663649ca2bbed10c9ac71d", + "mean": 0.005175424739718437, + "std": 1.097143530845642, + "rms": 1.0971556901931763, + "max_abs": 29.875 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "57ddb32d6dd5784271cc6281c470735f9c6f3fc45b55a0ef1f82c4e5bd4d3b91", + "mean": -0.028456123545765877, + "std": 10.42324447631836, + "rms": 10.423283576965332, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a16b33303b67c08b54c57f60f347b12ef5b6ce908a18236947fd606cfeab6c5d", + "mean": 0.004111424554139376, + "std": 1.0921016931533813, + "rms": 1.0921093225479126, + "max_abs": 29.5 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5cfac4ecb5fd4013cb35f7a7bc32c21e68d4773490016c5480120c114e39b59e", + "mean": -0.003733572317287326, + "std": 10.241523742675781, + "rms": 10.241524696350098, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "67a17eb381570069b52e0d311b6f6f5349e158ed793726bc87169e8b47962b60", + "mean": 0.004504621494561434, + "std": 1.1001471281051636, + "rms": 1.100156307220459, + "max_abs": 30.125 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fbc200a9148ec0767d4fa009e58494bddaed99bdb1ad42c6981121648b2fd54b", + "mean": -0.007942114025354385, + "std": 8.868691444396973, + "rms": 8.868695259094238, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0d511cfb402f6951b565d56344feb710c4d7296aaa27aa95368d418b154bac24", + "mean": 0.004234123043715954, + "std": 1.0880186557769775, + "rms": 1.0880268812179565, + "max_abs": 30.125 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8bb837082bee6f85e8648db3797b51abda6743a15955caba19ad36364a66b6a1", + "mean": -0.004080993589013815, + "std": 10.241851806640625, + "rms": 10.241853713989258, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "abf8e27ced7b580c46e59f2046697da09ef595794599dadf2e051816d1d9de1f", + "mean": 0.005117424298077822, + "std": 1.07932448387146, + "rms": 1.0793365240097046, + "max_abs": 30.25 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f5eef2713ba5c594de3b686083d8e25a5aad8121c191557f2ffd411f9c926df3", + "mean": -0.008171622641384602, + "std": 8.867975234985352, + "rms": 8.867979049682617, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "289a786c10b07bb9be663dcc425a8437d76ad1b26bcdb23f3f959d465af1ce2a", + "mean": 0.003924429416656494, + "std": 1.08594810962677, + "rms": 1.085955262184143, + "max_abs": 29.25 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b258c79f2298f045bc9185fd92377500dcd7dcaafec6fb589965b8eefa79c6d1", + "mean": -0.0036687094252556562, + "std": 10.241267204284668, + "rms": 10.241268157958984, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5d466f3efd017c004d418ef75956007bd7f77ebe5884ec274183295deb250ae5", + "mean": 0.005247086752206087, + "std": 1.0783101320266724, + "rms": 1.0783228874206543, + "max_abs": 31.0 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d2e0efd723fbee58c11cbf502aec2242ad78fccac57d8f5179e1a27327fe60a1", + "mean": -0.0076267654076218605, + "std": 8.86778736114502, + "rms": 8.867790222167969, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9972569942474365, + "min_cosine_similarity": 0.9955495595932007, + "mean_relative_l2": 0.0734148621559143, + "max_abs_delta": 0.875 + }, + "system_bos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9953455924987793, + "min_cosine_similarity": 0.9919561147689819, + "mean_relative_l2": 0.09653117507696152, + "max_abs_delta": 1.25 + }, + "system_x": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9922281503677368, + "min_cosine_similarity": 0.9840126037597656, + "mean_relative_l2": 0.12250199168920517, + "max_abs_delta": 2.0 + }, + "system_period": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9906682372093201, + "min_cosine_similarity": 0.979304313659668, + "mean_relative_l2": 0.13345883786678314, + "max_abs_delta": 1.875 + }, + "bos_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9936469793319702, + "min_cosine_similarity": 0.988055944442749, + "mean_relative_l2": 0.11042062938213348, + "max_abs_delta": 1.375 + }, + "bos_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9941808581352234, + "min_cosine_similarity": 0.9884032011032104, + "mean_relative_l2": 0.10627324879169464, + "max_abs_delta": 1.25 + }, + "x_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9912724494934082, + "min_cosine_similarity": 0.9832178950309753, + "mean_relative_l2": 0.13101817667484283, + "max_abs_delta": 1.3125 + }, + "x_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9873794317245483, + "min_cosine_similarity": 0.9655646085739136, + "mean_relative_l2": 0.15462042391300201, + "max_abs_delta": 2.125 + }, + "period_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9923036694526672, + "min_cosine_similarity": 0.9881914258003235, + "mean_relative_l2": 0.12361697852611542, + "max_abs_delta": 1.125 + }, + "period_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9862895011901855, + "min_cosine_similarity": 0.9586235284805298, + "mean_relative_l2": 0.15975162386894226, + "max_abs_delta": 2.125 + } + } + }, + "layer_18": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9dafb8f983da673607d7f92ba832230ffc1493bdad3aadc57bd034c01d492449", + "mean": 0.013475892134010792, + "std": 1.2175278663635254, + "rms": 1.2176024913787842, + "max_abs": 32.25 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "dcf4cc4face09acbf686ccd3f6602b550e4b09c335582d39d55d4a10c0b43505", + "mean": -0.022687328979372978, + "std": 11.693565368652344, + "rms": 11.693587303161621, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "93622855aaa8342fbf0297babfe79875dab2ffbd628317e5cef52da2b3829575", + "mean": 0.013283001258969307, + "std": 1.219252347946167, + "rms": 1.2193245887756348, + "max_abs": 32.75 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "af81d45f4ad6e14f06cc3cce08465d4b59d31bdaeee3bff502f85ec9c40b84e8", + "mean": -0.024973392486572266, + "std": 10.442923545837402, + "rms": 10.442953109741211, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9cec582a958d4bcebd9ceae0d5df6c7da57d2f875496c261464bfaf4b0610af2", + "mean": 0.012182884849607944, + "std": 1.2139946222305298, + "rms": 1.2140557765960693, + "max_abs": 32.0 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "538bbeec25f7ee3c06bb1794b03a16f719c9f84ae5e88b59a18075ad27c74d8a", + "mean": 0.0007032484863884747, + "std": 10.259431838989258, + "rms": 10.259431838989258, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fc08d9c58cc2a3c54f029bfc83d3fe790e016b6f68ba118996c38eb0b7a7725c", + "mean": 0.012494818307459354, + "std": 1.2224459648132324, + "rms": 1.222509741783142, + "max_abs": 33.0 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "481b542d294351cd8fb5ec58835c01ca1ae6b521c224b466b1deb9d0cd23c427", + "mean": -0.004455916583538055, + "std": 8.888185501098633, + "rms": 8.88818645477295, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "509cbbc647902535a539726afa425417cf69a55a0dfd79f9ebb9567f0337756f", + "mean": 0.012846231460571289, + "std": 1.2093538045883179, + "rms": 1.209421992301941, + "max_abs": 33.0 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0eaf8114f0b9b2f6a70f1be76083fcc339a73c27bb760b729b377be8cd89c688", + "mean": 0.0006352427299134433, + "std": 10.259859085083008, + "rms": 10.259859085083008, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fb9c0fdc53d9ec084c322d399d0da9eced23070a2f11a1fa5e51c16e53c49634", + "mean": 0.013414905406534672, + "std": 1.1981147527694702, + "rms": 1.1981897354125977, + "max_abs": 33.0 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "522df96d14ece1b7abd8fea33703beae4c479f432f6b08d78a36411db28b2cbe", + "mean": -0.004290482960641384, + "std": 8.88739013671875, + "rms": 8.887391090393066, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b24d3ff108837f46d8e1a95a814d964b212c5302edc515607f6b0fa1691a03bb", + "mean": 0.01235863845795393, + "std": 1.208029866218567, + "rms": 1.2080930471420288, + "max_abs": 32.0 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e176f81afc1f65bd7b5dc39e7373e46a723d824b9500bad3b55df1fc219818be", + "mean": 0.0010081293294206262, + "std": 10.25934886932373, + "rms": 10.25934886932373, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "783bc9c6103b678343df7979f06b498a89fb49992b68a1d98fa4a852353f393d", + "mean": 0.012709910050034523, + "std": 1.1967711448669434, + "rms": 1.196838617324829, + "max_abs": 34.0 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a4fc5952d92362377fcc3c22fd256be4d709839d709569f33a170074cb380f09", + "mean": -0.004122252110391855, + "std": 8.887029647827148, + "rms": 8.887030601501465, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9972128868103027, + "min_cosine_similarity": 0.9952888488769531, + "mean_relative_l2": 0.07376120239496231, + "max_abs_delta": 1.375 + }, + "system_bos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9954047799110413, + "min_cosine_similarity": 0.9912011027336121, + "mean_relative_l2": 0.09539132565259933, + "max_abs_delta": 1.5 + }, + "system_x": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9917563796043396, + "min_cosine_similarity": 0.9824529886245728, + "mean_relative_l2": 0.12595908343791962, + "max_abs_delta": 2.75 + }, + "system_period": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9903544783592224, + "min_cosine_similarity": 0.9791994690895081, + "mean_relative_l2": 0.13545967638492584, + "max_abs_delta": 2.125 + }, + "bos_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9937201142311096, + "min_cosine_similarity": 0.9879026412963867, + "mean_relative_l2": 0.10941635072231293, + "max_abs_delta": 1.875 + }, + "bos_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9940211176872253, + "min_cosine_similarity": 0.9869481325149536, + "mean_relative_l2": 0.1072889193892479, + "max_abs_delta": 1.625 + }, + "x_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9913279414176941, + "min_cosine_similarity": 0.9841296672821045, + "mean_relative_l2": 0.12991204857826233, + "max_abs_delta": 1.5 + }, + "x_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9872117042541504, + "min_cosine_similarity": 0.9681030511856079, + "mean_relative_l2": 0.15590806305408478, + "max_abs_delta": 2.75 + }, + "period_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9922733306884766, + "min_cosine_similarity": 0.9872184991836548, + "mean_relative_l2": 0.12339604645967484, + "max_abs_delta": 1.6875 + }, + "period_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9862217903137207, + "min_cosine_similarity": 0.9598293304443359, + "mean_relative_l2": 0.16018347442150116, + "max_abs_delta": 3.0 + } + } + }, + "layer_19": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5ef8936e96d5bb998d15c5259832bb253cb04fe51867a4a842cec67bc1f21bdf", + "mean": 0.02029445953667164, + "std": 1.3187408447265625, + "rms": 1.318897008895874, + "max_abs": 36.5 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3525bab26153a9fd3e042c2b656f07bcf9aec1ff9f431f2aa1250412da251a74", + "mean": -0.018273258581757545, + "std": 11.69951057434082, + "rms": 11.699524879455566, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7efaca73a21a76b4b9c9af3771c099e1d3905e5c0095b81ae02017e81d6f7b96", + "mean": 0.02060413546860218, + "std": 1.3224726915359497, + "rms": 1.322633147239685, + "max_abs": 37.25 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "77d9633a44475dadc032d9bb47733d3f5713f9b5ab16ae32035760369db7a7a9", + "mean": -0.020387616008520126, + "std": 10.451553344726562, + "rms": 10.451573371887207, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e5c205f1df8c92a4e626205c58a3e1117bc77633e7ab7532e780897dc4d27e1b", + "mean": 0.018516089767217636, + "std": 1.3146814107894897, + "rms": 1.3148117065429688, + "max_abs": 36.0 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a99f0d5f14362563c6095f23ff9ff619f180901bd5f9a8ab65356946a42fb5f2", + "mean": 0.00426550442352891, + "std": 10.266521453857422, + "rms": 10.266522407531738, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "701f37d0176ec75d7386fb31b82e152fd153b1da6a7e0d606949b91c3c751beb", + "mean": 0.01918073371052742, + "std": 1.3255325555801392, + "rms": 1.3256713151931763, + "max_abs": 37.5 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e2ae7bdfd3b9b6f20f1446beb8b15a0c7a91e2be3bc05f77cc927b01a78931d6", + "mean": -0.00028714071959257126, + "std": 8.898086547851562, + "rms": 8.898086547851562, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "01060e4b36ec75de860e7d22fa8c33d7b3f153c15aa595fb1192c85c98e91077", + "mean": 0.018552446737885475, + "std": 1.3087238073349, + "rms": 1.3088552951812744, + "max_abs": 37.0 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3e5b30074fb6f44691f14d2d428449aba745dbe6f4f08f636b8e5ace5e63b987", + "mean": 0.00408932426944375, + "std": 10.26717758178711, + "rms": 10.267178535461426, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9cfc6eedf5a5372e5f1c913af4921a8b3355d758c722f87afe658db5649f987a", + "mean": 0.019416775554418564, + "std": 1.2998054027557373, + "rms": 1.299950361251831, + "max_abs": 36.5 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0d25bd5cee42782ffcf2393462058f368ca827a8b001ee72da605a96db214a8a", + "mean": -0.0003089611418545246, + "std": 8.897209167480469, + "rms": 8.897209167480469, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3cdac0ff53c3e055436823db485730152906b022624359f7e1f0986ac9ac79a1", + "mean": 0.018518127501010895, + "std": 1.3078579902648926, + "rms": 1.3079890012741089, + "max_abs": 36.25 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "20ef85301dfc195f7deaa31731c3ca883117d1f94f0164e5f09eaa7048503129", + "mean": 0.004239160567522049, + "std": 10.266562461853027, + "rms": 10.266563415527344, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "443d5041465e820c1204a22a75cbe0c680f3a8b1b5ff2597c481ecacee35438c", + "mean": 0.01921973191201687, + "std": 1.2968330383300781, + "rms": 1.2969754934310913, + "max_abs": 37.5 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "67a3b0903f3ecf1ffcb9b102b8dea59983b129497c3d6167aae18e17ff290730", + "mean": -0.00043992651626467705, + "std": 8.896836280822754, + "rms": 8.896836280822754, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9970554113388062, + "min_cosine_similarity": 0.9948514103889465, + "mean_relative_l2": 0.0757073238492012, + "max_abs_delta": 1.75 + }, + "system_bos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9951705932617188, + "min_cosine_similarity": 0.9912880659103394, + "mean_relative_l2": 0.09792380779981613, + "max_abs_delta": 1.5 + }, + "system_x": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9915242195129395, + "min_cosine_similarity": 0.9823552370071411, + "mean_relative_l2": 0.1273229569196701, + "max_abs_delta": 2.125 + }, + "system_period": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9900749325752258, + "min_cosine_similarity": 0.9781761169433594, + "mean_relative_l2": 0.13720983266830444, + "max_abs_delta": 2.03125 + }, + "bos_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9934161901473999, + "min_cosine_similarity": 0.986140787601471, + "mean_relative_l2": 0.11204121261835098, + "max_abs_delta": 2.25 + }, + "bos_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.993898868560791, + "min_cosine_similarity": 0.9867200255393982, + "mean_relative_l2": 0.10839425772428513, + "max_abs_delta": 1.625 + }, + "x_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9910144209861755, + "min_cosine_similarity": 0.9830390810966492, + "mean_relative_l2": 0.1322641521692276, + "max_abs_delta": 1.875 + }, + "x_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9868345856666565, + "min_cosine_similarity": 0.967246949672699, + "mean_relative_l2": 0.15832333266735077, + "max_abs_delta": 3.25 + }, + "period_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9919155240058899, + "min_cosine_similarity": 0.9865056276321411, + "mean_relative_l2": 0.1261049509048462, + "max_abs_delta": 2.125 + }, + "period_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.985653817653656, + "min_cosine_similarity": 0.9566230773925781, + "mean_relative_l2": 0.16329070925712585, + "max_abs_delta": 3.125 + } + } + }, + "layer_20": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3960520842aecc14681a75a8640db42096e8176e94e359be4dd9ab0330d3dc92", + "mean": 0.03497776389122009, + "std": 1.5344257354736328, + "rms": 1.5348243713378906, + "max_abs": 39.0 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "df6bc5eaffcb0ce1061bc1e5d4132cd48de98833159814b49dfc18399635cd62", + "mean": -0.010984069667756557, + "std": 12.068557739257812, + "rms": 12.068562507629395, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "054b819f8e1672dde0b78a0e7c7d209af97114111bfc4a0b0a985403d0595748", + "mean": 0.03542174771428108, + "std": 1.537656545639038, + "rms": 1.5380644798278809, + "max_abs": 38.75 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2d8f1295bcc1456ebec34da5282487ae908f3cfa50aab65bf76f1fcf2a772d15", + "mean": -0.014774879440665245, + "std": 10.800405502319336, + "rms": 10.8004150390625, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "83804317a29727533dec689e63bc4f06cd7a3b3122692f0ea4bee5d53268a7f6", + "mean": 0.03278278931975365, + "std": 1.5288029909133911, + "rms": 1.5291544198989868, + "max_abs": 38.5 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e8ead7029b54080cc0811cc0a5d10f08e26c422d731ec92b067af4016568a5e0", + "mean": 0.010239300318062305, + "std": 10.290327072143555, + "rms": 10.290331840515137, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "34166a1dcbc24996978d5ca2f708e3ed0ea5d8e5755fac0e75af4ced709e9814", + "mean": 0.0339408703148365, + "std": 1.5374534130096436, + "rms": 1.537827968597412, + "max_abs": 39.0 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d31f5f6aa07e1f48d7682158d4ec819fe9aaeb88b330f282ca25c32ccc2602a0", + "mean": 0.004547512158751488, + "std": 8.92458438873291, + "rms": 8.924585342407227, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f3c98a8592b266f4bb6c74752503c50d130762d475b34103c887dbc370285b35", + "mean": 0.03300671651959419, + "std": 1.519824743270874, + "rms": 1.5201830863952637, + "max_abs": 38.5 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4167ee04614b7f396ed391656aedc9d6c1eeb3aba1d45659a5169855f6bdaaac", + "mean": 0.009632919915020466, + "std": 10.29086971282959, + "rms": 10.290873527526855, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "49500db93c022788d46dd2fecab4a063c65ea1bdf956d1838e7208bb3a460b01", + "mean": 0.03439706191420555, + "std": 1.506331443786621, + "rms": 1.5067241191864014, + "max_abs": 38.0 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "45288ce791037f30d63981ea3be980bdb703d721d32a7819fc24a7693975bb29", + "mean": 0.004367741756141186, + "std": 8.923282623291016, + "rms": 8.923283576965332, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1df2761bf1d9b6a23d6a70384467b2b29ec5dc5c4e574d4692bb9e76af8d0278", + "mean": 0.032418690621852875, + "std": 1.5207157135009766, + "rms": 1.5210613012313843, + "max_abs": 38.25 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6983c9f91371ca09662b08b059c45b3a864577d66dcd4cac95a35d4fe5f6325b", + "mean": 0.009637715294957161, + "std": 10.29034423828125, + "rms": 10.290348052978516, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2e2411288ae2fbcdfdc8319377a6dd2b1a1df0214b41e700e625070725f4775a", + "mean": 0.03386702388525009, + "std": 1.5031120777130127, + "rms": 1.5034935474395752, + "max_abs": 38.25 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d95912267a46be2a26e8941a8c1303edf72ce371d51b696f35eaf8973650c196", + "mean": 0.004249285440891981, + "std": 8.922725677490234, + "rms": 8.92272663116455, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9966676235198975, + "min_cosine_similarity": 0.9924359321594238, + "mean_relative_l2": 0.08051998168230057, + "max_abs_delta": 1.75 + }, + "system_bos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9949090480804443, + "min_cosine_similarity": 0.991478681564331, + "mean_relative_l2": 0.09983386099338531, + "max_abs_delta": 1.875 + }, + "system_x": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9905573129653931, + "min_cosine_similarity": 0.9782745838165283, + "mean_relative_l2": 0.1344129890203476, + "max_abs_delta": 2.25 + }, + "system_period": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9882766008377075, + "min_cosine_similarity": 0.9762969017028809, + "mean_relative_l2": 0.14880923926830292, + "max_abs_delta": 2.25 + }, + "bos_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9931156039237976, + "min_cosine_similarity": 0.9834882616996765, + "mean_relative_l2": 0.11390673369169235, + "max_abs_delta": 2.375 + }, + "bos_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9935715794563293, + "min_cosine_similarity": 0.9863126277923584, + "mean_relative_l2": 0.11068865656852722, + "max_abs_delta": 2.125 + }, + "x_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9906302690505981, + "min_cosine_similarity": 0.9826437830924988, + "mean_relative_l2": 0.13452813029289246, + "max_abs_delta": 2.328125 + }, + "x_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9854744672775269, + "min_cosine_similarity": 0.9637470245361328, + "mean_relative_l2": 0.1655615270137787, + "max_abs_delta": 4.0 + }, + "period_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.991773247718811, + "min_cosine_similarity": 0.9853573441505432, + "mean_relative_l2": 0.12678009271621704, + "max_abs_delta": 2.75 + }, + "period_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.983874499797821, + "min_cosine_similarity": 0.9549247026443481, + "mean_relative_l2": 0.17204296588897705, + "max_abs_delta": 4.0 + } + } + }, + "layer_21": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cf7002afba7c1436a235e4500b57478f20289ea0a6977d28908beb5db36cd21f", + "mean": 0.04022333025932312, + "std": 1.7295044660568237, + "rms": 1.729972004890442, + "max_abs": 50.75 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "208488eb66084af210a93d210361461adbb6d2709938ea79c925ef9142b28935", + "mean": -0.006321776658296585, + "std": 12.197281837463379, + "rms": 12.197282791137695, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "59117cc8eb55e27228f6ec743ede4171dad824aba3848547892443c386ba9bbd", + "mean": 0.04012816771864891, + "std": 1.7328166961669922, + "rms": 1.7332813739776611, + "max_abs": 50.25 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9488f783c490b567f642c399ae502d3f18ec9b027f573efcbc7955c14fc5e3ad", + "mean": -0.010631132870912552, + "std": 10.913912773132324, + "rms": 10.913917541503906, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f163f13c67e925d91ed4b297c511d230ec622e55b269f656317a7e7ba2b1421d", + "mean": 0.03549693897366524, + "std": 1.7191840410232544, + "rms": 1.719550371170044, + "max_abs": 49.75 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5ebfea3d280cd0ecf1cb6c6d8850e7204a68ab400d2b4c2bda8e5fca385aac9c", + "mean": 0.013822130858898163, + "std": 10.28675651550293, + "rms": 10.286765098571777, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ffe328cfec6f6a80eecf803aa36682f324a0ea0d496379fb947c5376adc42b31", + "mean": 0.037849996238946915, + "std": 1.7308952808380127, + "rms": 1.731308937072754, + "max_abs": 50.5 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "718ff31c9f5007e486353b216decc2635aa50a707e43d9db2aed920cb1eecc63", + "mean": 0.008592200465500355, + "std": 8.930658340454102, + "rms": 8.930662155151367, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c322f23250a31feb7d6ac52ee92a53a1e590b4f2a646cec33af2f3d31e89da8a", + "mean": 0.037141263484954834, + "std": 1.714984655380249, + "rms": 1.7153867483139038, + "max_abs": 50.5 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "492890ed4af83992fc97c2262ad92581ae5a415f2db1b55ec93afb0b6ca8ea75", + "mean": 0.014047332108020782, + "std": 10.288339614868164, + "rms": 10.288349151611328, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c0950586704ac765b0d07f9beb84248997f6dde6ea803102bd84b58ec3984a71", + "mean": 0.03876320272684097, + "std": 1.6993359327316284, + "rms": 1.6997779607772827, + "max_abs": 50.0 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "65462ce351245640834a986008c0181ed99251641cfb8eea94c90780fd2be4e2", + "mean": 0.00807725265622139, + "std": 8.930118560791016, + "rms": 8.930122375488281, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "16b9726fbff75a5bcb738062bfd3634de8edb6e70014de8f968a4add5e264fb5", + "mean": 0.03714390844106674, + "std": 1.7142375707626343, + "rms": 1.7146400213241577, + "max_abs": 50.0 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d1043ca54f3ba0d8fd78ce9418dc07a67f8f95875d030a75945b3da36a7582da", + "mean": 0.01424272358417511, + "std": 10.286946296691895, + "rms": 10.286955833435059, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0a5f207cdb16436ca8ae258f7dc1dd1ef9423837fd2f37610f16d9c8e8d9a4d1", + "mean": 0.03805037587881088, + "std": 1.6975834369659424, + "rms": 1.698009729385376, + "max_abs": 49.5 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1cd25c310dba507bcc4a9bd51191c8058041cce809bc7ecf524109bff6b83428", + "mean": 0.008124735206365585, + "std": 8.928869247436523, + "rms": 8.928873062133789, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9960225820541382, + "min_cosine_similarity": 0.9928758144378662, + "mean_relative_l2": 0.08852583169937134, + "max_abs_delta": 1.625 + }, + "system_bos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9944297671318054, + "min_cosine_similarity": 0.989153265953064, + "mean_relative_l2": 0.10463423281908035, + "max_abs_delta": 2.375 + }, + "system_x": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9891670346260071, + "min_cosine_similarity": 0.9720828533172607, + "mean_relative_l2": 0.14325757324695587, + "max_abs_delta": 2.5 + }, + "system_period": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9862198233604431, + "min_cosine_similarity": 0.9739589691162109, + "mean_relative_l2": 0.16138149797916412, + "max_abs_delta": 2.75 + }, + "bos_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9923204183578491, + "min_cosine_similarity": 0.9817982912063599, + "mean_relative_l2": 0.11969520896673203, + "max_abs_delta": 3.25 + }, + "bos_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9929676055908203, + "min_cosine_similarity": 0.9839237928390503, + "mean_relative_l2": 0.11519695073366165, + "max_abs_delta": 3.5 + }, + "x_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9901303052902222, + "min_cosine_similarity": 0.9817081689834595, + "mean_relative_l2": 0.13775254786014557, + "max_abs_delta": 3.125 + }, + "x_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9842424988746643, + "min_cosine_similarity": 0.9625999927520752, + "mean_relative_l2": 0.17242707312107086, + "max_abs_delta": 5.0 + }, + "period_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9913327693939209, + "min_cosine_similarity": 0.9832791686058044, + "mean_relative_l2": 0.12964944541454315, + "max_abs_delta": 3.75 + }, + "period_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9828724265098572, + "min_cosine_similarity": 0.9550250768661499, + "mean_relative_l2": 0.17732033133506775, + "max_abs_delta": 5.25 + } + } + }, + "layer_22": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6448931b24c2f6893e261179a7fffcf06dff17eb94479d53967acc2cc3a5dac9", + "mean": 0.0466059073805809, + "std": 1.996484637260437, + "rms": 1.9970285892486572, + "max_abs": 65.5 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "555599afd2a6b8415acb819610205676786447a804cb4ab5ad19c1f6b2587c9b", + "mean": -0.0036484573502093554, + "std": 12.225255966186523, + "rms": 12.225255966186523, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7a103f9803cd0e1803996c0f54588e0690b86f4f4e3ca92a77c3090b280bf094", + "mean": 0.04648762196302414, + "std": 2.0010688304901123, + "rms": 2.0016086101531982, + "max_abs": 65.0 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e7494220ad26938ee4afe8e46f7d3f2d390e7afe18252cc0955424f2c130b142", + "mean": -0.009272506460547447, + "std": 10.949708938598633, + "rms": 10.949712753295898, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1d4abf14292cdf6f21dbaf8e64483bdbcccdc3bcf847e95bf00ec22e0b91fb94", + "mean": 0.03909711539745331, + "std": 1.9738337993621826, + "rms": 1.974220871925354, + "max_abs": 64.0 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5763bad9e4900a68c7da071aaff85465d71db3d9d4e30d64a8df609f2ef41493", + "mean": 0.015105657279491425, + "std": 10.319217681884766, + "rms": 10.319228172302246, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6a9e601f9a106a39c33553d92995c01f22c1d7a25638d76008cf581680d2a231", + "mean": 0.04287046566605568, + "std": 1.9909162521362305, + "rms": 1.991377830505371, + "max_abs": 65.5 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ef05708e79e79a15d9055676dca28c1684314af2c378ac22f49c1a3f227983c8", + "mean": 0.009328101761639118, + "std": 8.9744291305542, + "rms": 8.974433898925781, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "29d0544bd28372712baa5a6b7b10b7b02d6b84c3e3e78b8815337b74bc1d361f", + "mean": 0.04243148863315582, + "std": 1.9768342971801758, + "rms": 1.9772896766662598, + "max_abs": 65.0 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "09b50c48eb4bd2b8eecac8c31d073ca872e6a50f5b1cd89249ec09e8b39fd02d", + "mean": 0.016256146132946014, + "std": 10.321992874145508, + "rms": 10.322005271911621, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "43702c31ce5505c99eb4d2eeaac93aab18a9e0779de73f66225dce7b1b193764", + "mean": 0.045711226761341095, + "std": 1.963536024093628, + "rms": 1.964068055152893, + "max_abs": 65.5 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ac891753f41e18763dab109de917e301951adf0cb041364beaef4bec38054f6d", + "mean": 0.010058729909360409, + "std": 8.97478199005127, + "rms": 8.974787712097168, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3be4f47a0e9012c4e2bc08a53e795f57f83e63d4f9de342af646efc535fcec95", + "mean": 0.04196497052907944, + "std": 1.9723412990570068, + "rms": 1.9727877378463745, + "max_abs": 64.0 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4a2ba69a2893e6565a2fe8a82709572d1d211af11403cf8eb5fadea8de903642", + "mean": 0.016055328771471977, + "std": 10.319988250732422, + "rms": 10.319999694824219, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c399ef963c11469dd12cac51de5993f2d1fbaf25cada1b7f51369085877ba483", + "mean": 0.04484831914305687, + "std": 1.9636071920394897, + "rms": 1.9641191959381104, + "max_abs": 65.0 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8996b7a97d3619c186566f8375854fd1584144d066cf36400de914054a2d8c3b", + "mean": 0.010214650072157383, + "std": 8.973319053649902, + "rms": 8.973325729370117, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9958347678184509, + "min_cosine_similarity": 0.9911156296730042, + "mean_relative_l2": 0.09021693468093872, + "max_abs_delta": 2.25 + }, + "system_bos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9942465424537659, + "min_cosine_similarity": 0.9891085624694824, + "mean_relative_l2": 0.106330506503582, + "max_abs_delta": 3.5 + }, + "system_x": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9881023168563843, + "min_cosine_similarity": 0.968288779258728, + "mean_relative_l2": 0.14947929978370667, + "max_abs_delta": 4.0 + }, + "system_period": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9843736886978149, + "min_cosine_similarity": 0.9671317934989929, + "mean_relative_l2": 0.17077526450157166, + "max_abs_delta": 5.0 + }, + "bos_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9918155670166016, + "min_cosine_similarity": 0.9797759056091309, + "mean_relative_l2": 0.12289971113204956, + "max_abs_delta": 5.25 + }, + "bos_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9924837946891785, + "min_cosine_similarity": 0.9832395315170288, + "mean_relative_l2": 0.11856209486722946, + "max_abs_delta": 5.75 + }, + "x_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9896703958511353, + "min_cosine_similarity": 0.9815346598625183, + "mean_relative_l2": 0.1401268094778061, + "max_abs_delta": 4.25 + }, + "x_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9834967255592346, + "min_cosine_similarity": 0.9623997211456299, + "mean_relative_l2": 0.17567183077335358, + "max_abs_delta": 6.5 + }, + "period_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9909903407096863, + "min_cosine_similarity": 0.9815959930419922, + "mean_relative_l2": 0.13168717920780182, + "max_abs_delta": 4.75 + }, + "period_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9817665219306946, + "min_cosine_similarity": 0.9540702700614929, + "mean_relative_l2": 0.18206650018692017, + "max_abs_delta": 7.25 + } + } + }, + "layer_23": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a27a99b5cd95bc32c2aa02b2d314a584f95d87a44193a915822ab6cbbefb6adb", + "mean": 0.06326579302549362, + "std": 2.319610357284546, + "rms": 2.3204729557037354, + "max_abs": 83.5 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "80f0d16fd73a5a2128d33d86ad13c32b57bbf9e298ffd6e85f0d572606a75808", + "mean": 0.004355207085609436, + "std": 12.223340034484863, + "rms": 12.22334098815918, + "max_abs": 1160.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5e5d9bf40b05cbc79bfc6cd5ed603a1d022f1d03b1c2c6f470b6501c91612c5a", + "mean": 0.06269017606973648, + "std": 2.3189444541931152, + "rms": 2.319791793823242, + "max_abs": 83.0 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d23aec20d9395782f90a61adeee0403471041eb7adc95b8c3de0e17a968a8c69", + "mean": -0.001510845497250557, + "std": 10.963882446289062, + "rms": 10.963882446289062, + "max_abs": 1160.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a3d9c05f083e208c17e9604951a1e798d895caa382f62e01bd8d71b02f5ce4a5", + "mean": 0.05486554279923439, + "std": 2.285590171813965, + "rms": 2.2862486839294434, + "max_abs": 81.5 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9dd49e49af7edd1cb173f283f7280e3a7734475281402f722788f4b8ef9096c1", + "mean": 0.022638676688075066, + "std": 10.3305082321167, + "rms": 10.330533027648926, + "max_abs": 1160.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "74fc91c254a0e32251446fa0887d94e01a832d46377afb0a9740ce1a9864d2b0", + "mean": 0.05844486132264137, + "std": 2.3084022998809814, + "rms": 2.3091421127319336, + "max_abs": 83.0 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "89c506593045ccbc429d03739d028640747a2139ee6bf09dce6f14e6684c3efa", + "mean": 0.01708604395389557, + "std": 9.009896278381348, + "rms": 9.009912490844727, + "max_abs": 1160.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "96ab7b8afb2d675fa1a9c1a34f8297f6de64220a0fa123eac1bfb4b1c7507057", + "mean": 0.058399226516485214, + "std": 2.295806407928467, + "rms": 2.296549081802368, + "max_abs": 82.0 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "28c61a76765f10f09a4fdbf3457f419d79331893de0a374df86012219b7b1a7f", + "mean": 0.02443394623696804, + "std": 10.336858749389648, + "rms": 10.336888313293457, + "max_abs": 1160.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "12a9d0f11a0ee8932c273e8fe38765490ffbcbd1be47a79a699ac6362af09d45", + "mean": 0.06012005731463432, + "std": 2.2796120643615723, + "rms": 2.280404567718506, + "max_abs": 82.0 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ebfd2412df7b322827523361bc648854558c5a0c678c9a868684511ca85b8ff0", + "mean": 0.017487715929746628, + "std": 9.012358665466309, + "rms": 9.012375831604004, + "max_abs": 1160.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a63450afd773b137240189995eceae10f2866ec9ea4ab040717c36b4941bf66f", + "mean": 0.05762730911374092, + "std": 2.288212537765503, + "rms": 2.288938045501709, + "max_abs": 81.5 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5272bd4462c0c08ad033d2c26af3f3ad2ddf3093b9d3dfe4cc34a9402913dd02", + "mean": 0.023888463154435158, + "std": 10.332433700561523, + "rms": 10.3324613571167, + "max_abs": 1160.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b7206460b7ada8570a4ac237d6529dff6515f8c56b7a8e8e918ab3a925291315", + "mean": 0.05953739956021309, + "std": 2.281301736831665, + "rms": 2.282078504562378, + "max_abs": 81.0 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b15db8247c71d7b928c132f046507fa9ea2814c6428a1b806ffe6a64d8588bc2", + "mean": 0.017617536708712578, + "std": 9.009660720825195, + "rms": 9.00967788696289, + "max_abs": 1160.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9961616396903992, + "min_cosine_similarity": 0.9913564920425415, + "mean_relative_l2": 0.08613313734531403, + "max_abs_delta": 2.0 + }, + "system_bos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9944663047790527, + "min_cosine_similarity": 0.989844024181366, + "mean_relative_l2": 0.10432647913694382, + "max_abs_delta": 4.5 + }, + "system_x": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9893996119499207, + "min_cosine_similarity": 0.9744319319725037, + "mean_relative_l2": 0.14226214587688446, + "max_abs_delta": 4.5 + }, + "system_period": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9857856631278992, + "min_cosine_similarity": 0.9692121744155884, + "mean_relative_l2": 0.16372902691364288, + "max_abs_delta": 6.0 + }, + "bos_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9920908808708191, + "min_cosine_similarity": 0.9799109697341919, + "mean_relative_l2": 0.12064012140035629, + "max_abs_delta": 7.75 + }, + "bos_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9928779602050781, + "min_cosine_similarity": 0.9831530451774597, + "mean_relative_l2": 0.11553094536066055, + "max_abs_delta": 6.5 + }, + "x_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.99015873670578, + "min_cosine_similarity": 0.9802325367927551, + "mean_relative_l2": 0.13594113290309906, + "max_abs_delta": 5.5 + }, + "x_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9848719239234924, + "min_cosine_similarity": 0.9601048231124878, + "mean_relative_l2": 0.1679547280073166, + "max_abs_delta": 6.5 + }, + "period_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9914419054985046, + "min_cosine_similarity": 0.9821977019309998, + "mean_relative_l2": 0.1278647482395172, + "max_abs_delta": 6.75 + }, + "period_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9831512570381165, + "min_cosine_similarity": 0.9516585469245911, + "mean_relative_l2": 0.17439265549182892, + "max_abs_delta": 7.0 + } + } + }, + "layer_24": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "af381fced0a004c79c08a212b4bd2f29c3c0b1cc05f4f4545434a891b77529d9", + "mean": 0.07868446409702301, + "std": 2.813070774078369, + "rms": 2.814171075820923, + "max_abs": 108.5 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "288a09fd8ecdf5f4cbefb53588587a74dc145690a78551053b5722e341d28487", + "mean": 0.008507556281983852, + "std": 11.504470825195312, + "rms": 11.504473686218262, + "max_abs": 1008.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b1062b8a623d8be94abd712dd7a78a90c9f95d9c352d941d3b22030cf887f7f0", + "mean": 0.07820092886686325, + "std": 2.8078815937042236, + "rms": 2.8089704513549805, + "max_abs": 108.0 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8119cda90bbf7a20cb3efed9e91054508c0e756b9ca71d3019d328a675af8a2e", + "mean": 0.0027266573160886765, + "std": 10.679299354553223, + "rms": 10.679299354553223, + "max_abs": 1120.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "36bfcb79b75c45bf170bd7c4913057739951c6ab324f73802ef245aff05ffd04", + "mean": 0.06966539472341537, + "std": 2.7749321460723877, + "rms": 2.775806427001953, + "max_abs": 106.0 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7f3f54f6c168d9f6765af9c6940c122d6ad615d7dc699dc12ae15bd4dfc63e10", + "mean": 0.030255595222115517, + "std": 7.291965007781982, + "rms": 7.292027950286865, + "max_abs": 840.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "82de41010d9680ed4288b91ac0b6af170c33687199dd642ae41f58d073b2e604", + "mean": 0.07351301610469818, + "std": 2.79765248298645, + "rms": 2.7986180782318115, + "max_abs": 107.5 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ccdc791f76681cb9987b37f630efac56640316ee1cd1d083a3ea2ba226de60ef", + "mean": 0.02404690533876419, + "std": 6.477175235748291, + "rms": 6.477219581604004, + "max_abs": 840.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "608e0901a063f4570df69761aaa7b184bb54f618c82664a005bcd74002b0a1af", + "mean": 0.07442112267017365, + "std": 2.785381317138672, + "rms": 2.7863755226135254, + "max_abs": 106.0 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6ec1cca55a73e1a3b59d6fecc8ea3ef953829ee16739fb40f0cc88f2517af937", + "mean": 0.032190561294555664, + "std": 7.304041385650635, + "rms": 7.304112911224365, + "max_abs": 840.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "396fb53cf5bc548fa3fe461ff8277b9f0a990eb0bce4b99917c86ea8fa4b1428", + "mean": 0.07659076899290085, + "std": 2.7553820610046387, + "rms": 2.756446361541748, + "max_abs": 105.0 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4c9b3febb40554874822a81d023d0276b985e8e05a89d27f2b6d421ba6399098", + "mean": 0.024324722588062286, + "std": 6.481118679046631, + "rms": 6.48116397857666, + "max_abs": 840.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "23aaf438aa013453f57d1444c4d5287a6859642ee9054c6432f9dc643847dde3", + "mean": 0.07381882518529892, + "std": 2.7746827602386475, + "rms": 2.7756645679473877, + "max_abs": 106.0 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f72c1dc8517c84bc21e57edcb1b44370641007ec0cef7162265b1b9e37dc864d", + "mean": 0.032283440232276917, + "std": 7.295571804046631, + "rms": 7.295643329620361, + "max_abs": 840.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ea1415a51e83ca429412fff6881be20cb02d651df23b85bdd206032b1267937d", + "mean": 0.07662135362625122, + "std": 2.752227306365967, + "rms": 2.753293752670288, + "max_abs": 104.0 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "90b50f76ea802b332395c3b50c3b9b523faffb1a3a555ea74252ed7a31d41c7a", + "mean": 0.025043055415153503, + "std": 6.475063323974609, + "rms": 6.475111484527588, + "max_abs": 840.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9966691732406616, + "min_cosine_similarity": 0.9909791946411133, + "mean_relative_l2": 0.07992488145828247, + "max_abs_delta": 2.5 + }, + "system_bos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9950052499771118, + "min_cosine_similarity": 0.9880845546722412, + "mean_relative_l2": 0.09812145680189133, + "max_abs_delta": 4.5 + }, + "system_x": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9907481074333191, + "min_cosine_similarity": 0.9811115264892578, + "mean_relative_l2": 0.13323602080345154, + "max_abs_delta": 5.0 + }, + "system_period": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9873334765434265, + "min_cosine_similarity": 0.9738748073577881, + "mean_relative_l2": 0.15406088531017303, + "max_abs_delta": 6.0 + }, + "bos_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9934126734733582, + "min_cosine_similarity": 0.9832726120948792, + "mean_relative_l2": 0.11032581329345703, + "max_abs_delta": 8.0 + }, + "bos_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9937871694564819, + "min_cosine_similarity": 0.9824232459068298, + "mean_relative_l2": 0.10734324157238007, + "max_abs_delta": 6.0 + }, + "x_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9914207458496094, + "min_cosine_similarity": 0.9786072373390198, + "mean_relative_l2": 0.12619169056415558, + "max_abs_delta": 6.0 + }, + "x_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9864417314529419, + "min_cosine_similarity": 0.9573867321014404, + "mean_relative_l2": 0.15859711170196533, + "max_abs_delta": 9.0 + }, + "period_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9926263689994812, + "min_cosine_similarity": 0.9830111861228943, + "mean_relative_l2": 0.11837059259414673, + "max_abs_delta": 7.0 + }, + "period_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9846369624137878, + "min_cosine_similarity": 0.9472237825393677, + "mean_relative_l2": 0.16538691520690918, + "max_abs_delta": 9.5 + } + } + }, + "layer_25": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f71481339617d0d31be8a24341e0e0a1f7fe66b986b3b63e5512b9db148028fb", + "mean": 0.10842899978160858, + "std": 3.5937459468841553, + "rms": 3.595381498336792, + "max_abs": 147.0 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f8711c7dbeee315dc6f751a2575ab6021da9505c311182ce84b4d638180e275b", + "mean": 0.017862441018223763, + "std": 8.839518547058105, + "rms": 8.839536666870117, + "max_abs": 872.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "790fa1313cdcd6058601d0f7adca4132acf90b17af2af11ecd901e9ab8558f8a", + "mean": 0.10807036608457565, + "std": 3.5810954570770264, + "rms": 3.582725763320923, + "max_abs": 147.0 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8ceb034a075de1befa176883c32276ebdb4430869a573d77fcbc08d0ed2d2f8d", + "mean": 0.006177172064781189, + "std": 8.540708541870117, + "rms": 8.54071044921875, + "max_abs": 984.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "193f7cabf8b10585b45b6b033c18383df4db6491671112ec085861a5b2b9a339", + "mean": 0.09510491043329239, + "std": 3.5223567485809326, + "rms": 3.5236403942108154, + "max_abs": 145.0 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f901d5f4a02c401347001a9086fa04376d17e5deccc6fa5a658d05ad14a1e07e", + "mean": 0.03859474137425423, + "std": 3.8910000324249268, + "rms": 3.891191244125366, + "max_abs": 248.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3177ab8e1f3bf982ceab03269d6289bd109049f7f3774546136cadbc629b06ce", + "mean": 0.09937082976102829, + "std": 3.550933361053467, + "rms": 3.552323579788208, + "max_abs": 148.0 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6ff6084a9a62168cacd7b68d13ac6c3e1440c201aec949dc38c7fb63a302c346", + "mean": 0.027694763615727425, + "std": 3.8663413524627686, + "rms": 3.866440534591675, + "max_abs": 248.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "16419ef7547f04db1255bac3606dd44b79e79b809582a93db60ef32f74076b1a", + "mean": 0.10147623717784882, + "std": 3.547741651535034, + "rms": 3.549192428588867, + "max_abs": 145.0 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "df7ab5b0f34b2ce10ee8b43ee0871cd154268afaa053c1f0f60030b12ba9067a", + "mean": 0.04054330661892891, + "std": 3.9429643154144287, + "rms": 3.9431726932525635, + "max_abs": 248.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d63f9fa4806507c72e5951b8a9399f99275ee7d95ea56fc677b9876123c55df5", + "mean": 0.10289688408374786, + "std": 3.518503427505493, + "rms": 3.520007848739624, + "max_abs": 150.0 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0765317524e3887df5a2f27cfdd041605c2e4366e54f66b782001aec7c5e66cd", + "mean": 0.02872658707201481, + "std": 3.891432285308838, + "rms": 3.891538381576538, + "max_abs": 248.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "08a49444a0555cdadb2b122d66dca1a134c9500aadb626bea5d193fb79fccc60", + "mean": 0.10199131071567535, + "std": 3.5304176807403564, + "rms": 3.531890630722046, + "max_abs": 146.0 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cc2fba4616e2a0e3d8de09882da808b1d2288c2d1cee44c309b5ab95918d44ac", + "mean": 0.04212144389748573, + "std": 3.9121925830841064, + "rms": 3.912419080734253, + "max_abs": 248.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b6531c9ef1ec3d0d75edc0793aa5c894487baac0fa768a10f39bc9ddb4b6cfd7", + "mean": 0.101040318608284, + "std": 3.5102181434631348, + "rms": 3.511672019958496, + "max_abs": 152.0 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "40bd3b739b06f36f771a0b6635c92b73971ab0d64e15ffebe03b269d1cd3b158", + "mean": 0.028965115547180176, + "std": 3.8718063831329346, + "rms": 3.8719146251678467, + "max_abs": 248.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9973155856132507, + "min_cosine_similarity": 0.9914612770080566, + "mean_relative_l2": 0.07194426655769348, + "max_abs_delta": 4.0 + }, + "system_bos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9959854483604431, + "min_cosine_similarity": 0.9892661571502686, + "mean_relative_l2": 0.08781331777572632, + "max_abs_delta": 7.0 + }, + "system_x": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9926044344902039, + "min_cosine_similarity": 0.9863939881324768, + "mean_relative_l2": 0.12039817124605179, + "max_abs_delta": 8.0 + }, + "system_period": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9899334907531738, + "min_cosine_similarity": 0.9787654876708984, + "mean_relative_l2": 0.1385127305984497, + "max_abs_delta": 8.0 + }, + "bos_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9945421814918518, + "min_cosine_similarity": 0.9852721691131592, + "mean_relative_l2": 0.10050223022699356, + "max_abs_delta": 12.0 + }, + "bos_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9949783086776733, + "min_cosine_similarity": 0.9848533868789673, + "mean_relative_l2": 0.09610892087221146, + "max_abs_delta": 9.0 + }, + "x_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9929496645927429, + "min_cosine_similarity": 0.9811704158782959, + "mean_relative_l2": 0.11404920369386673, + "max_abs_delta": 10.5 + }, + "x_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9890050292015076, + "min_cosine_similarity": 0.9630868434906006, + "mean_relative_l2": 0.1433756947517395, + "max_abs_delta": 10.0 + }, + "period_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.993983805179596, + "min_cosine_similarity": 0.9847689867019653, + "mean_relative_l2": 0.10720048099756241, + "max_abs_delta": 11.0 + }, + "period_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9874224662780762, + "min_cosine_similarity": 0.9533721208572388, + "mean_relative_l2": 0.1500839740037918, + "max_abs_delta": 11.0 + } + } + }, + "layer_26": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "948e4fc0e5ac95dfa2e6195b170e8a20659be55ce538e9e88d5e25b20b432dfd", + "mean": 0.1488114446401596, + "std": 5.164894104003906, + "rms": 5.167037487030029, + "max_abs": 274.0 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "eab2d01316200ed322259d268b9e70ec9daa668ef866cd17dacd6fa32aba0b5c", + "mean": 0.022248661145567894, + "std": 9.310159683227539, + "rms": 9.310186386108398, + "max_abs": 840.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8397ea4155a66bcfb3caff2414f266ff34e0bff2af9a748b2acf09a83b8800a8", + "mean": 0.14487363398075104, + "std": 5.040539264678955, + "rms": 5.04262113571167, + "max_abs": 272.0 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d8b50635c55fa3ae80f6dacf9f138f09b6fc057662a1e9af9be4806893597f6f", + "mean": 0.015734542161226273, + "std": 8.977317810058594, + "rms": 8.977331161499023, + "max_abs": 868.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f47dbd9a72396d6a43af7ecc20f6feabaf2cf94778527894905d01b3abd46c0c", + "mean": 0.13323874771595, + "std": 4.979413986206055, + "rms": 4.98119592666626, + "max_abs": 278.0 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ca5a26020399e64d3bcdac37ef0d452cc860a179f65ea7c58aa1aaf9a5e89dee", + "mean": 0.04593272879719734, + "std": 5.67481803894043, + "rms": 5.675004005432129, + "max_abs": 776.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d6ffee8d3daec04c90d2963e29a2c2f7860a4a914fcbd49edd2abcc2b66ad5c5", + "mean": 0.13501936197280884, + "std": 4.946074485778809, + "rms": 4.947917461395264, + "max_abs": 272.0 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a568b90b3b1fdfedde2be178e2b7e4efafaa65e4ac81fdb1eed7203a1d62356c", + "mean": 0.03992321342229843, + "std": 5.6348876953125, + "rms": 5.635029315948486, + "max_abs": 776.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5690ca6de9b28dcc0c8061dc6d9ef02750c0542d7c416d90154b794855cf54e0", + "mean": 0.13980717957019806, + "std": 5.089174747467041, + "rms": 5.091094493865967, + "max_abs": 262.0 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f7ccb48ebf8554b6e2cce0c3fe4ed17c00a3a71e4db11490e5a3d0294e1c3096", + "mean": 0.04722347855567932, + "std": 5.773507118225098, + "rms": 5.77370023727417, + "max_abs": 776.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "98175a3c85284ea930460fffef54aa1d5ecd38a42f6a1746a98eeee8badd802a", + "mean": 0.13248029351234436, + "std": 4.799844741821289, + "rms": 4.80167293548584, + "max_abs": 278.0 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6b3cd13e744dc22d0075f85f5d4bf5921b62f0c57aad43dc2eae594bf1f51181", + "mean": 0.03895750641822815, + "std": 5.612283706665039, + "rms": 5.612419128417969, + "max_abs": 776.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e2ce2f9384399b179d6bef5a34958f8653cb6734c7c543685fe00b6112f51e05", + "mean": 0.1405285745859146, + "std": 5.061767578125, + "rms": 5.063717365264893, + "max_abs": 268.0 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c2bac4dbecf928ac0560a894186d6f416cc72e5fdea1a850c8744664ac2a92c0", + "mean": 0.04895820841193199, + "std": 5.721367359161377, + "rms": 5.721576690673828, + "max_abs": 776.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7b1cb0b2fe00dced485bebab189c5c378801b76215f7300b22ef8e7096fec073", + "mean": 0.13017337024211884, + "std": 4.758577823638916, + "rms": 4.760357856750488, + "max_abs": 282.0 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0935f22506638da8f4b6fcdaa4471c76b98108cf3cdae78c6a833f8f97d68903", + "mean": 0.03895305097103119, + "std": 5.554635524749756, + "rms": 5.55477237701416, + "max_abs": 776.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.998113214969635, + "min_cosine_similarity": 0.9928798675537109, + "mean_relative_l2": 0.06594599038362503, + "max_abs_delta": 13.0 + }, + "system_bos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9970670938491821, + "min_cosine_similarity": 0.9918198585510254, + "mean_relative_l2": 0.07481376826763153, + "max_abs_delta": 12.0 + }, + "system_x": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.994189977645874, + "min_cosine_similarity": 0.9860725998878479, + "mean_relative_l2": 0.12623250484466553, + "max_abs_delta": 38.0 + }, + "system_period": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9924314618110657, + "min_cosine_similarity": 0.9843604564666748, + "mean_relative_l2": 0.14055167138576508, + "max_abs_delta": 46.0 + }, + "bos_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9949672818183899, + "min_cosine_similarity": 0.9767559766769409, + "mean_relative_l2": 0.09819457679986954, + "max_abs_delta": 41.5 + }, + "bos_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9959821105003357, + "min_cosine_similarity": 0.9873395562171936, + "mean_relative_l2": 0.08722768723964691, + "max_abs_delta": 22.5 + }, + "x_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9950974583625793, + "min_cosine_similarity": 0.9808326363563538, + "mean_relative_l2": 0.09792603552341461, + "max_abs_delta": 24.0 + }, + "x_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9909417629241943, + "min_cosine_similarity": 0.9635029435157776, + "mean_relative_l2": 0.14290103316307068, + "max_abs_delta": 44.0 + }, + "period_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9956784248352051, + "min_cosine_similarity": 0.9870830774307251, + "mean_relative_l2": 0.09408389031887054, + "max_abs_delta": 25.0 + }, + "period_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9894741773605347, + "min_cosine_similarity": 0.9542130827903748, + "mean_relative_l2": 0.1531226933002472, + "max_abs_delta": 52.0 + } + } + }, + "final_norm": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7bc9f6ff68a219f3067a4d3ea3655232b08be9cb005c06a5cb8f762b1a2d021e", + "mean": 0.014563215896487236, + "std": 0.48364949226379395, + "rms": 0.48386871814727783, + "max_abs": 15.375 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "532f57e134a98b98ddd4517663e27a8cdce0fb88303765807c3033d8f19ff796", + "mean": 0.004977220203727484, + "std": 0.5475049614906311, + "rms": 0.5475276112556458, + "max_abs": 21.625 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4f1085833a2ca38203ce5b12052992a1738c1f93ee14c6299b7b32d3f9908bf1", + "mean": 0.014476033858954906, + "std": 0.48828616738319397, + "rms": 0.488500714302063, + "max_abs": 15.3125 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "41ed0599392265dd83c471b899b222ee57fb3782468148f63390b2af0ee68886", + "mean": 0.00491546792909503, + "std": 0.5333795547485352, + "rms": 0.5334022045135498, + "max_abs": 21.625 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "32af2c46e1969b932fadb20e607b4804f563378254120bed8bd1923623487c40", + "mean": 0.013492629863321781, + "std": 0.495296835899353, + "rms": 0.49548059701919556, + "max_abs": 15.3125 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ad1059337deb53fa83b5e4f0eedec5334fd62bf88c029875d4e0eec8d4645dd0", + "mean": 0.004822771530598402, + "std": 0.5535456538200378, + "rms": 0.5535666942596436, + "max_abs": 21.125 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "eb0cb0ae42fc6d9dd34d0fbea4c9abd3760a0bb9c1c8c6848e1e50e23d5845f6", + "mean": 0.013677476905286312, + "std": 0.49474987387657166, + "rms": 0.4949389100074768, + "max_abs": 15.3125 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bd30750b12c161a677f21c70166d923cc2e6ca12b5661313ca1dcb83b9850f76", + "mean": 0.004922050982713699, + "std": 0.5356888771057129, + "rms": 0.5357115268707275, + "max_abs": 21.125 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1e0ecc6a7bfa36ed750bdb5d739a8dc895136885fc5029f28b3734eb93221dc9", + "mean": 0.013644007034599781, + "std": 0.48611021041870117, + "rms": 0.48630163073539734, + "max_abs": 15.5 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f375772a5ce81002f91325d95e111e1cb2816fc29acc8880e17ea414c6a283c0", + "mean": 0.005022706929594278, + "std": 0.5426032543182373, + "rms": 0.5426265001296997, + "max_abs": 19.125 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "00cd7f0e11aad02f57b2da6c4e177a98b88e5c40cf87d37a11dc91c20e61ad2f", + "mean": 0.013634609058499336, + "std": 0.49502548575401306, + "rms": 0.49521321058273315, + "max_abs": 15.375 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fab3449681cabbca1e3014faf4d4879808d1783a27d315ed47eed842865b7c46", + "mean": 0.005089199636131525, + "std": 0.5279036164283752, + "rms": 0.5279281139373779, + "max_abs": 18.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "09f7c368605ae7b96cc2d655babfc3a52f114ed43b5154e4131b8870f24719c1", + "mean": 0.013892137445509434, + "std": 0.48905545473098755, + "rms": 0.4892527163028717, + "max_abs": 15.375 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2010118383570d6f1585c1a3457ab8765b3cef06615949f04bfaeb2029857eaa", + "mean": 0.00530238589271903, + "std": 0.5491392016410828, + "rms": 0.5491647720336914, + "max_abs": 20.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "972f6d6edf57a9f8b9559055808b0c5060c88ade5755a4b4a8c665b4f3bb30f0", + "mean": 0.013521187007427216, + "std": 0.4981464743614197, + "rms": 0.49832993745803833, + "max_abs": 15.375 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3f7dc81d8c1c080bdfc954b1b5e5f4c4f52653f12bd1ac5b5cf5682aef9b1982", + "mean": 0.005256518255919218, + "std": 0.534885823726654, + "rms": 0.5349116921424866, + "max_abs": 17.75 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9957336783409119, + "min_cosine_similarity": 0.9852227568626404, + "mean_relative_l2": 0.08986309170722961, + "max_abs_delta": 1.1982421875 + }, + "system_bos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9940709471702576, + "min_cosine_similarity": 0.9834251999855042, + "mean_relative_l2": 0.1046670451760292, + "max_abs_delta": 1.1171875 + }, + "system_x": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9879520535469055, + "min_cosine_similarity": 0.9734809994697571, + "mean_relative_l2": 0.153976708650589, + "max_abs_delta": 1.564453125 + }, + "system_period": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.984012246131897, + "min_cosine_similarity": 0.9695640802383423, + "mean_relative_l2": 0.1768570840358734, + "max_abs_delta": 1.6015625 + }, + "bos_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9912934303283691, + "min_cosine_similarity": 0.9722977876663208, + "mean_relative_l2": 0.12670104205608368, + "max_abs_delta": 1.9375 + }, + "bos_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9923290610313416, + "min_cosine_similarity": 0.9774512648582458, + "mean_relative_l2": 0.11917562037706375, + "max_abs_delta": 1.302734375 + }, + "x_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9898666739463806, + "min_cosine_similarity": 0.9686286449432373, + "mean_relative_l2": 0.13654938340187073, + "max_abs_delta": 1.3076171875 + }, + "x_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9818091988563538, + "min_cosine_similarity": 0.9369802474975586, + "mean_relative_l2": 0.18632008135318756, + "max_abs_delta": 1.84765625 + }, + "period_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9910736680030823, + "min_cosine_similarity": 0.9757596254348755, + "mean_relative_l2": 0.1300564557313919, + "max_abs_delta": 1.3779296875 + }, + "period_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9793423414230347, + "min_cosine_similarity": 0.919306218624115, + "mean_relative_l2": 0.19624844193458557, + "max_abs_delta": 2.30078125 + } + } + } + }, + "router_layers": { + "layer_01": { + "layer": 1, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "eea10beaa14a5c99aa22fde8657e6e1e9bcb0d33a22a3454f395040565e4cd82", + "route_weight_sha256": "1fcb860070ef9a61b91ecb3a7e225707dd81c452a7f18d6e81aaf5683965cfaf", + "loads": [ + 3, + 3, + 2, + 1, + 3, + 4, + 4, + 0, + 10, + 2, + 4, + 0, + 2, + 2, + 2, + 2, + 2, + 1, + 2, + 2, + 4, + 1, + 1, + 1, + 2, + 2, + 2, + 1, + 2, + 2, + 3, + 3, + 0, + 5, + 2, + 2, + 2, + 3, + 3, + 0, + 5, + 3, + 1, + 2, + 1, + 1, + 3, + 4, + 1, + 1, + 1, + 2, + 3, + 1, + 1, + 2, + 1, + 1, + 2, + 1, + 2, + 2, + 3, + 2 + ], + "weighted_loads": [ + 0.2979959771037102, + 0.15557493828237057, + 0.13492226600646973, + 0.024200495332479477, + 0.22554074600338936, + 0.23004959896206856, + 0.1483771689236164, + 0.0, + 0.5079406462609768, + 0.10609042271971703, + 0.3135751970112324, + 0.0, + 0.04533928260207176, + 0.20357614010572433, + 0.08417574316263199, + 0.1417282670736313, + 0.11933112516999245, + 0.03309403732419014, + 0.1728161722421646, + 0.15698686987161636, + 0.15559103339910507, + 0.11828285455703735, + 0.05798571556806564, + 0.03195548057556152, + 0.07406619749963284, + 0.11343370005488396, + 0.07759777829051018, + 0.04321213811635971, + 0.11238794401288033, + 0.08290695585310459, + 0.2445613630115986, + 0.23168598115444183, + 0.0, + 0.22102092951536179, + 0.24728954583406448, + 0.1336858794093132, + 0.12759312987327576, + 0.31806687265634537, + 0.1923508606851101, + 0.0, + 0.314100056886673, + 0.22690750658512115, + 0.10069340467453003, + 0.043405456468462944, + 0.03339026868343353, + 0.09422323852777481, + 0.16223379969596863, + 0.3234846293926239, + 0.05869852751493454, + 0.15233400464057922, + 0.03192126005887985, + 0.21912775933742523, + 0.19857297092676163, + 0.10273477435112, + 0.021514926105737686, + 0.12564443796873093, + 0.03014560602605343, + 0.04148473963141441, + 0.15301793068647385, + 0.03676077723503113, + 0.1046636663377285, + 0.1347665749490261, + 0.206058319658041, + 0.2238178327679634 + ], + "unique_experts": 60, + "load_cv": 0.6967081357519951, + "normalized_load_entropy": 0.9471425732051233, + "max_load_share": 0.07246376811594203 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "ca0eeae0d839aa121111d06d52e022afae9ffdae77e625f67b92859b428fd981", + "route_weight_sha256": "aac23926ab2b565484de361328a70f9e15b796167f61d65dfd2a2f80bddaf193", + "loads": [ + 4, + 3, + 4, + 1, + 5, + 4, + 5, + 2, + 31, + 2, + 6, + 0, + 2, + 2, + 2, + 11, + 2, + 2, + 3, + 2, + 8, + 1, + 2, + 1, + 2, + 6, + 17, + 2, + 2, + 2, + 3, + 8, + 2, + 7, + 2, + 2, + 2, + 3, + 3, + 2, + 6, + 13, + 1, + 7, + 2, + 12, + 3, + 4, + 1, + 1, + 4, + 3, + 7, + 1, + 4, + 6, + 5, + 10, + 2, + 12, + 3, + 6, + 3, + 2 + ], + "weighted_loads": [ + 0.3738093674182892, + 0.15557493828237057, + 0.2378508597612381, + 0.024200495332479477, + 0.27723558619618416, + 0.23004959896206856, + 0.21047450229525566, + 0.26814376562833786, + 1.8356180600821972, + 0.10609042271971703, + 0.5129492841660976, + 0.0, + 0.04533928260207176, + 0.20357614010572433, + 0.08417574316263199, + 0.7585919722914696, + 0.11933112516999245, + 0.10427046939730644, + 0.1928738746792078, + 0.15698686987161636, + 0.5744633469730616, + 0.11828285455703735, + 0.08824355341494083, + 0.03195548057556152, + 0.07406619749963284, + 0.2654388379305601, + 1.037681931629777, + 0.11550687253475189, + 0.11238794401288033, + 0.08290695585310459, + 0.2445613630115986, + 0.6367827993817627, + 0.10603492334485054, + 0.4469711184501648, + 0.24728954583406448, + 0.1336858794093132, + 0.12759312987327576, + 0.31806687265634537, + 0.1923508606851101, + 0.17727938294410706, + 0.35870568454265594, + 0.6391010172665119, + 0.10069340467453003, + 0.15275026290328242, + 1.0177776664495468, + 0.9136728434823453, + 0.16223379969596863, + 0.3234846293926239, + 0.05869852751493454, + 0.15233400464057922, + 0.18939966149628162, + 0.21973244339460507, + 0.47724754735827446, + 0.10273477435112, + 0.06702870386652648, + 0.6189608797430992, + 0.34559219144284725, + 0.564814979210496, + 0.15301793068647385, + 0.7538646906614304, + 0.19557441398501396, + 0.3248923234641552, + 0.206058319658041, + 0.2238178327679634 + ], + "unique_experts": 63, + "load_cv": 1.050426133399391, + "normalized_load_entropy": 0.9099116690147485, + "max_load_share": 0.1076388888888889 + } + }, + "s1_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "a67e9612f03b69a26b6c29a4fad0e00ceefda357ff0a34e174166e08862f2239", + "route_weight_sha256": "3c83e3cfa9b65a399f4640d2c805e6d5e89f23e45c2c99ba9db03110bc3955fb", + "loads": [ + 3, + 4, + 2, + 2, + 3, + 4, + 4, + 1, + 10, + 2, + 4, + 0, + 1, + 2, + 3, + 2, + 2, + 0, + 2, + 2, + 4, + 1, + 1, + 1, + 1, + 2, + 2, + 1, + 3, + 2, + 3, + 3, + 0, + 5, + 2, + 2, + 1, + 3, + 3, + 0, + 5, + 2, + 1, + 2, + 1, + 1, + 3, + 4, + 1, + 2, + 1, + 2, + 3, + 1, + 1, + 2, + 1, + 1, + 2, + 0, + 2, + 2, + 3, + 2 + ], + "weighted_loads": [ + 0.29596756398677826, + 0.20110279135406017, + 0.13473472371697426, + 0.04784930311143398, + 0.23047039285302162, + 0.2276538610458374, + 0.13864172995090485, + 0.03650257736444473, + 0.4675389174371958, + 0.1066528744995594, + 0.31587373465299606, + 0.0, + 0.02267496846616268, + 0.20340149104595184, + 0.11130918934941292, + 0.15055552870035172, + 0.12364616617560387, + 0.0, + 0.1701192408800125, + 0.1582905352115631, + 0.15847613848745823, + 0.1189151182770729, + 0.0604509674012661, + 0.03218900039792061, + 0.047239914536476135, + 0.11370884627103806, + 0.07069385796785355, + 0.043327342718839645, + 0.13950115628540516, + 0.08429347909986973, + 0.24661671556532383, + 0.23071131855249405, + 0.0, + 0.20434311777353287, + 0.25234319269657135, + 0.13488735631108284, + 0.10106725245714188, + 0.31944507732987404, + 0.18975909054279327, + 0.0, + 0.326923131942749, + 0.18537787348031998, + 0.09948568791151047, + 0.04282308369874954, + 0.03500868007540703, + 0.09479659050703049, + 0.16278822720050812, + 0.3279935512691736, + 0.059316493570804596, + 0.18267730250954628, + 0.03329557925462723, + 0.21685051172971725, + 0.20480450987815857, + 0.09993934631347656, + 0.021394869312644005, + 0.11807239055633545, + 0.031827494502067566, + 0.04054945334792137, + 0.15432647615671158, + 0.0, + 0.1061617024242878, + 0.13471631705760956, + 0.2033192552626133, + 0.2301497608423233 + ], + "unique_experts": 59, + "load_cv": 0.7157425057893185, + "normalized_load_entropy": 0.942311655330727, + "max_load_share": 0.07246376811594203 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "1b1f11675d15fc900d4e044b550355c9ca70a747bfc238c247ea623b381a2a5d", + "route_weight_sha256": "bbb0c552ac97290df5cde628ff0967af51e01aa0545b24ed4011f5a8f7ce6dd7", + "loads": [ + 6, + 4, + 5, + 2, + 8, + 6, + 5, + 4, + 37, + 2, + 9, + 1, + 1, + 3, + 3, + 14, + 2, + 5, + 4, + 3, + 8, + 3, + 6, + 2, + 3, + 7, + 23, + 3, + 3, + 4, + 4, + 10, + 2, + 7, + 2, + 2, + 2, + 4, + 3, + 4, + 6, + 14, + 4, + 8, + 3, + 12, + 3, + 7, + 3, + 2, + 9, + 6, + 8, + 1, + 6, + 6, + 11, + 14, + 4, + 11, + 4, + 7, + 3, + 6 + ], + "weighted_loads": [ + 0.4896056093275547, + 0.20110279135406017, + 0.30007729679346085, + 0.04784930311143398, + 0.5207518246024847, + 0.36458035558462143, + 0.18403888121247292, + 0.27383674308657646, + 2.16045581176877, + 0.1066528744995594, + 0.7077740244567394, + 0.14657524228096008, + 0.02267496846616268, + 0.24318649992346764, + 0.11130918934941292, + 0.855876985937357, + 0.12364616617560387, + 0.20131995156407356, + 0.22977179661393166, + 0.22423139214515686, + 0.5345734283328056, + 0.32456671446561813, + 0.3318192391307093, + 0.06669260933995247, + 0.11873984336853027, + 0.2927731368690729, + 1.4868590384721756, + 0.1382264792919159, + 0.13950115628540516, + 0.24606569297611713, + 0.3324528429657221, + 0.8552183963474818, + 0.09280725196003914, + 0.38421814888715744, + 0.25234319269657135, + 0.13488735631108284, + 0.35967422276735306, + 0.35350746288895607, + 0.18975909054279327, + 0.2956593446433544, + 0.3715621717274189, + 0.7603033632040024, + 0.3072022832930088, + 0.24085724540054798, + 1.177197989076376, + 0.8659853034769185, + 0.16278822720050812, + 0.41039559233468026, + 0.20998482033610344, + 0.18267730250954628, + 0.4713469631969929, + 0.5809658542275429, + 0.5473008565604687, + 0.09993934631347656, + 0.11527101718820632, + 0.5927439033985138, + 0.5025231391191483, + 0.7981783356517553, + 0.22932710498571396, + 0.6704141497612, + 0.22207043133676052, + 0.41699739545583725, + 0.2033192552626133, + 0.7212076708674431 + ], + "unique_experts": 64, + "load_cv": 0.9204467514322717, + "normalized_load_entropy": 0.9296650642959688, + "max_load_share": 0.09635416666666667 + } + }, + "s0_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "235732267fe7c8aa6dfb1dcdff85f363f7682d96427c24e537db1beb08533b51", + "route_weight_sha256": "3017c2d8f8af2f9625cbeb0fe39944d505f4a4f6afb50e2ea5100f75ffb9d869", + "loads": [ + 3, + 3, + 2, + 1, + 3, + 3, + 4, + 1, + 6, + 2, + 3, + 0, + 0, + 2, + 4, + 2, + 2, + 5, + 3, + 2, + 4, + 1, + 1, + 1, + 1, + 2, + 1, + 1, + 3, + 1, + 2, + 3, + 1, + 6, + 2, + 2, + 1, + 3, + 3, + 0, + 4, + 2, + 1, + 2, + 2, + 1, + 3, + 4, + 1, + 1, + 1, + 2, + 4, + 1, + 1, + 2, + 1, + 1, + 2, + 1, + 2, + 4, + 3, + 2 + ], + "weighted_loads": [ + 0.2909499257802963, + 0.13968266919255257, + 0.1405412070453167, + 0.025667764246463776, + 0.23242026939988136, + 0.167372802272439, + 0.16623474285006523, + 0.03825721889734268, + 0.22093709371984005, + 0.1123686246573925, + 0.24942240491509438, + 0.0, + 0.0, + 0.2016826570034027, + 0.14397738128900528, + 0.13208220899105072, + 0.11823053285479546, + 0.2188732922077179, + 0.19272120110690594, + 0.159227192401886, + 0.1509846281260252, + 0.11305012553930283, + 0.06405610591173172, + 0.03263775631785393, + 0.049653612077236176, + 0.12477845326066017, + 0.02954927273094654, + 0.043458227068185806, + 0.14552255906164646, + 0.0640006735920906, + 0.2204459086060524, + 0.23016900569200516, + 0.036368586122989655, + 0.28936726599931717, + 0.2580748349428177, + 0.13078756630420685, + 0.09815485030412674, + 0.2862715758383274, + 0.20154527947306633, + 0.0, + 0.19735794514417648, + 0.1595701277256012, + 0.1035592257976532, + 0.05301911570131779, + 0.06069481745362282, + 0.08938433229923248, + 0.16347018629312515, + 0.3280987236648798, + 0.05964633822441101, + 0.15132632851600647, + 0.02930273488163948, + 0.23411395400762558, + 0.2113241534680128, + 0.099579818546772, + 0.023292450234293938, + 0.13360797986388206, + 0.0345173142850399, + 0.035707272589206696, + 0.13358527421951294, + 0.03751834109425545, + 0.1004721187055111, + 0.18686786480247974, + 0.20008837059140205, + 0.20409580320119858 + ], + "unique_experts": 61, + "load_cv": 0.6147046394332897, + "normalized_load_entropy": 0.953247022374801, + "max_load_share": 0.043478260869565216 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "b963b8c528547b657676f17d952092f89362199f1c6dd86a51b266539ae6733b", + "route_weight_sha256": "fc71a72558f7932ee610e95d3a2e9a55877668370c02490aaa8cbd6cf6d0d740", + "loads": [ + 5, + 3, + 4, + 1, + 5, + 3, + 5, + 3, + 24, + 2, + 5, + 2, + 0, + 2, + 5, + 11, + 2, + 7, + 5, + 2, + 7, + 1, + 2, + 1, + 1, + 6, + 14, + 2, + 3, + 1, + 2, + 7, + 3, + 8, + 2, + 2, + 1, + 3, + 3, + 3, + 4, + 12, + 2, + 7, + 2, + 11, + 4, + 4, + 1, + 1, + 5, + 2, + 8, + 1, + 4, + 6, + 5, + 11, + 2, + 11, + 4, + 8, + 3, + 2 + ], + "weighted_loads": [ + 0.40676611103117466, + 0.13968266919255257, + 0.22572460025548935, + 0.025667764246463776, + 0.28411510959267616, + 0.167372802272439, + 0.22833207622170448, + 0.29833386093378067, + 1.2448691856116056, + 0.1123686246573925, + 0.4516426511108875, + 0.05196681246161461, + 0.0, + 0.2016826570034027, + 0.16191044077277184, + 0.748945914208889, + 0.11823053285479546, + 0.3247632347047329, + 0.23915387503802776, + 0.159227192401886, + 0.4849314372986555, + 0.11305012553930283, + 0.09431394375860691, + 0.03263775631785393, + 0.049653612077236176, + 0.2865985482931137, + 0.884658332914114, + 0.10596978291869164, + 0.14552255906164646, + 0.0640006735920906, + 0.2204459086060524, + 0.6722579896450043, + 0.14955708384513855, + 0.5302015990018845, + 0.2580748349428177, + 0.13078756630420685, + 0.09815485030412674, + 0.2862715758383274, + 0.20154527947306633, + 0.22645403817296028, + 0.19735794514417648, + 0.571763638406992, + 0.14634183794260025, + 0.18750395439565182, + 0.06069481745362282, + 0.9083297103643417, + 0.18960732966661453, + 0.3280987236648798, + 0.05964633822441101, + 0.15132632851600647, + 0.2074774894863367, + 0.23411395400762558, + 0.475530656054616, + 0.099579818546772, + 0.09187762811779976, + 0.6444404684007168, + 0.3756205290555954, + 0.6312955226749182, + 0.13358527421951294, + 0.7212293483316898, + 0.2962605096399784, + 0.38443768583238125, + 0.20008837059140205, + 0.20409580320119858 + ], + "unique_experts": 63, + "load_cv": 0.8827915878928169, + "normalized_load_entropy": 0.9253849485644354, + "max_load_share": 0.08333333333333333 + } + }, + "s1_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "1754082161e187beccb14b5b394882816560597e30e755a8fb39059434bad1a3", + "route_weight_sha256": "d878d506865b7cee3844c562293f708f83e6304081e4dbe1e718193be604d93f", + "loads": [ + 3, + 3, + 2, + 2, + 3, + 3, + 3, + 1, + 3, + 3, + 3, + 0, + 0, + 2, + 2, + 2, + 2, + 4, + 3, + 2, + 4, + 1, + 1, + 1, + 1, + 2, + 1, + 1, + 4, + 2, + 3, + 3, + 1, + 6, + 2, + 2, + 1, + 3, + 3, + 0, + 4, + 2, + 1, + 2, + 2, + 1, + 3, + 4, + 1, + 1, + 2, + 2, + 4, + 1, + 1, + 3, + 1, + 1, + 2, + 1, + 2, + 4, + 3, + 2 + ], + "weighted_loads": [ + 0.2762818858027458, + 0.14536866545677185, + 0.13266007602214813, + 0.05040893144905567, + 0.23288648203015327, + 0.1938416324555874, + 0.11473918706178665, + 0.03751828894019127, + 0.09171053022146225, + 0.13665500283241272, + 0.239922933280468, + 0.0, + 0.0, + 0.19990123063325882, + 0.0851978100836277, + 0.1455548070371151, + 0.1297014355659485, + 0.17808479443192482, + 0.1875387281179428, + 0.1583579182624817, + 0.15289075300097466, + 0.12365052849054337, + 0.0684402734041214, + 0.03213067725300789, + 0.04757498577237129, + 0.12496501952409744, + 0.029665427282452583, + 0.044512469321489334, + 0.17502718046307564, + 0.092789426445961, + 0.25829774513840675, + 0.23502948880195618, + 0.03418755903840065, + 0.26697174087166786, + 0.25869913399219513, + 0.1289547234773636, + 0.09920930862426758, + 0.2713688910007477, + 0.1990354023873806, + 0.0, + 0.2098754495382309, + 0.18109332025051117, + 0.09855247288942337, + 0.05187628045678139, + 0.06458296626806259, + 0.09059322625398636, + 0.16696888953447342, + 0.33714268915355206, + 0.06059696525335312, + 0.15111249685287476, + 0.0599357970058918, + 0.23516593873500824, + 0.2040615063160658, + 0.10015205293893814, + 0.02364550530910492, + 0.1581773590296507, + 0.036124087870121, + 0.033600546419620514, + 0.12814506515860558, + 0.03742879256606102, + 0.10540971904993057, + 0.18193918652832508, + 0.2039210945367813, + 0.20559096336364746 + ], + "unique_experts": 61, + "load_cv": 0.5451664601102616, + "normalized_load_entropy": 0.9606140096575424, + "max_load_share": 0.043478260869565216 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "46b295fc56e19fdb552cb07bccb6c4f7d66c0f152e2dd9001dd24db0ab81e7a6", + "route_weight_sha256": "9369f3daa6f244eb0fd37f693c179de610848ee71b3af38f99d7567adf86b260", + "loads": [ + 7, + 3, + 5, + 3, + 8, + 5, + 4, + 4, + 27, + 3, + 8, + 1, + 0, + 4, + 2, + 14, + 2, + 9, + 6, + 3, + 7, + 3, + 5, + 2, + 3, + 7, + 20, + 3, + 4, + 4, + 4, + 9, + 3, + 8, + 3, + 2, + 2, + 4, + 3, + 5, + 4, + 14, + 5, + 8, + 3, + 11, + 4, + 6, + 3, + 1, + 11, + 6, + 9, + 1, + 7, + 7, + 11, + 16, + 4, + 11, + 5, + 9, + 3, + 6 + ], + "weighted_loads": [ + 0.5081619769334793, + 0.14536866545677185, + 0.284330315887928, + 0.08213713206350803, + 0.5231679137796164, + 0.3307681269943714, + 0.16013633832335472, + 0.26589421182870865, + 1.4724878277629614, + 0.13665500283241272, + 0.6332924105226994, + 0.14657524228096008, + 0.0, + 0.26395322754979134, + 0.0851978100836277, + 0.8508762642741203, + 0.1297014355659485, + 0.3794047459959984, + 0.274411728605628, + 0.22429877519607544, + 0.4491337947547436, + 0.3293021246790886, + 0.3394964002072811, + 0.06663428619503975, + 0.11907491460442543, + 0.31683734245598316, + 1.344299292191863, + 0.13616374135017395, + 0.17502718046307564, + 0.2545616403222084, + 0.344133872538805, + 0.8932983353734016, + 0.1339513286948204, + 0.4623810462653637, + 0.2816854827105999, + 0.1289547234773636, + 0.35781627893447876, + 0.3054312765598297, + 0.1990354023873806, + 0.34874268248677254, + 0.2098754495382309, + 0.7560188099741936, + 0.3427104316651821, + 0.24991044215857983, + 0.21779430657625198, + 0.8613131642341614, + 0.19713637605309486, + 0.4192281384021044, + 0.21126529201865196, + 0.15111249685287476, + 0.5252270307391882, + 0.5992812812328339, + 0.5189679060131311, + 0.10015205293893814, + 0.16355512849986553, + 0.6499559413641691, + 0.5215867534279823, + 0.880584329366684, + 0.20314569398760796, + 0.673196267336607, + 0.3235130477696657, + 0.4710203502327204, + 0.2039210945367813, + 0.6966488733887672 + ], + "unique_experts": 63, + "load_cv": 0.7728015412913086, + "normalized_load_entropy": 0.9405811389180191, + "max_load_share": 0.0703125 + } + }, + "s0_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "8c19b448db52344c4fc052bd3a869578eb7988173dd69f84e81c3eea540c9b6c", + "route_weight_sha256": "261e62521b0c228bf1c67a12de9f93ef07c520ee6988b76e900edc62332ba787", + "loads": [ + 3, + 3, + 2, + 1, + 3, + 3, + 4, + 1, + 7, + 2, + 3, + 0, + 0, + 2, + 4, + 2, + 2, + 4, + 3, + 2, + 4, + 1, + 1, + 1, + 1, + 2, + 2, + 1, + 3, + 1, + 2, + 3, + 1, + 6, + 2, + 2, + 1, + 3, + 3, + 0, + 4, + 2, + 1, + 1, + 2, + 1, + 3, + 4, + 1, + 1, + 1, + 2, + 4, + 1, + 2, + 3, + 1, + 1, + 2, + 1, + 2, + 2, + 3, + 2 + ], + "weighted_loads": [ + 0.29496732354164124, + 0.1577284373342991, + 0.1368522085249424, + 0.024538297206163406, + 0.23824862018227577, + 0.19471224397420883, + 0.16979305818676949, + 0.03771839663386345, + 0.23427146300673485, + 0.10832637175917625, + 0.25847428664565086, + 0.0, + 0.0, + 0.21648511290550232, + 0.1477458570152521, + 0.12184003368020058, + 0.12633111327886581, + 0.16036495752632618, + 0.1967590767890215, + 0.16057449206709862, + 0.15517105907201767, + 0.1199076771736145, + 0.06282387673854828, + 0.03308122605085373, + 0.05090118572115898, + 0.12284210324287415, + 0.06228877976536751, + 0.0415719598531723, + 0.14572336338460445, + 0.06100715696811676, + 0.2269073650240898, + 0.23618687689304352, + 0.03555801138281822, + 0.26586698554456234, + 0.25172991305589676, + 0.1319851130247116, + 0.09197663515806198, + 0.30885885655879974, + 0.1921292170882225, + 0.0, + 0.24469738826155663, + 0.1797255389392376, + 0.10747666656970978, + 0.027349427342414856, + 0.06032844819128513, + 0.090790756046772, + 0.16503414884209633, + 0.32218904979526997, + 0.059224341064691544, + 0.15041084587574005, + 0.029316822066903114, + 0.23983356356620789, + 0.21210740506649017, + 0.09540010988712311, + 0.055124612525105476, + 0.15981926769018173, + 0.032612863928079605, + 0.03763965517282486, + 0.14103688299655914, + 0.03775133937597275, + 0.10468168184161186, + 0.130523469299078, + 0.20659540966153145, + 0.21076301485300064 + ], + "unique_experts": 61, + "load_cv": 0.6147046394332897, + "normalized_load_entropy": 0.9541081860489521, + "max_load_share": 0.050724637681159424 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "be50bce08b7fc3ea61830151c76769e8f3b61c4b47a3a16a46d529f052cdda8c", + "route_weight_sha256": "abaf953658d2fd01c05b1c841c111d2e041cabf71e6a1bcf9ab45665926d2147", + "loads": [ + 4, + 3, + 4, + 1, + 5, + 3, + 5, + 4, + 26, + 3, + 5, + 1, + 0, + 2, + 6, + 12, + 2, + 5, + 5, + 2, + 7, + 1, + 3, + 1, + 1, + 6, + 16, + 2, + 3, + 1, + 2, + 7, + 3, + 8, + 2, + 2, + 1, + 3, + 3, + 3, + 4, + 13, + 1, + 6, + 2, + 12, + 3, + 4, + 1, + 1, + 4, + 2, + 8, + 1, + 4, + 7, + 4, + 10, + 2, + 12, + 3, + 6, + 3, + 2 + ], + "weighted_loads": [ + 0.38803835213184357, + 0.1577284373342991, + 0.23149535059928894, + 0.024538297206163406, + 0.28994346037507057, + 0.19471224397420883, + 0.23189039155840874, + 0.33740149438381195, + 1.2947541419416666, + 0.13477206602692604, + 0.45941807702183723, + 0.023533372208476067, + 0.0, + 0.21648511290550232, + 0.18963394314050674, + 0.8556027300655842, + 0.12633111327886581, + 0.23154138959944248, + 0.2408298086374998, + 0.16057449206709862, + 0.48482371121644974, + 0.1199076771736145, + 0.12389161996543407, + 0.03308122605085373, + 0.05090118572115898, + 0.2876347675919533, + 0.9688778351992369, + 0.10814877599477768, + 0.14572336338460445, + 0.06100715696811676, + 0.2269073650240898, + 0.6860631629824638, + 0.14881496503949165, + 0.5086426343768835, + 0.25172991305589676, + 0.1319851130247116, + 0.09197663515806198, + 0.30885885655879974, + 0.1921292170882225, + 0.2485549859702587, + 0.24469738826155663, + 0.647754143923521, + 0.10747666656970978, + 0.16587634198367596, + 0.06032844819128513, + 0.9432785026729107, + 0.16503414884209633, + 0.32218904979526997, + 0.059224341064691544, + 0.15041084587574005, + 0.20473673567175865, + 0.23983356356620789, + 0.4534875638782978, + 0.09540010988712311, + 0.10018892586231232, + 0.6840097829699516, + 0.22539975866675377, + 0.5535306613892317, + 0.14103688299655914, + 0.8200352936983109, + 0.19559242948889732, + 0.3222075551748276, + 0.20659540966153145, + 0.21076301485300064 + ], + "unique_experts": 63, + "load_cv": 0.950957931590205, + "normalized_load_entropy": 0.9179646496842506, + "max_load_share": 0.09027777777777778 + } + }, + "s1_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "4f16a6e153ee3bc0b2edbcbbc7553cd5129896c6f94d512d55bc7f6f66c3bf23", + "route_weight_sha256": "4135b2dd40f715fe0278abb2d9b3e8d9092841d281817a2b7817db5cc518b675", + "loads": [ + 3, + 4, + 2, + 1, + 3, + 3, + 3, + 1, + 2, + 3, + 3, + 0, + 0, + 2, + 2, + 2, + 2, + 4, + 3, + 2, + 4, + 1, + 1, + 1, + 1, + 2, + 1, + 1, + 4, + 2, + 3, + 3, + 1, + 6, + 2, + 2, + 1, + 3, + 3, + 0, + 4, + 2, + 1, + 4, + 3, + 1, + 3, + 4, + 1, + 1, + 1, + 2, + 3, + 1, + 1, + 3, + 1, + 1, + 2, + 1, + 2, + 4, + 3, + 2 + ], + "weighted_loads": [ + 0.2707468718290329, + 0.1790644098073244, + 0.1276337094604969, + 0.024612106382846832, + 0.23475956171751022, + 0.20361283794045448, + 0.11907599121332169, + 0.03711450472474098, + 0.05879359319806099, + 0.13226506859064102, + 0.2421276457607746, + 0.0, + 0.0, + 0.2106381058692932, + 0.083531579002738, + 0.13924338296055794, + 0.13563760370016098, + 0.16953440010547638, + 0.1851941365748644, + 0.15645908936858177, + 0.15513955801725388, + 0.12780505418777466, + 0.06614881008863449, + 0.03167028725147247, + 0.048504509031772614, + 0.12341616302728653, + 0.03090166300535202, + 0.04421226307749748, + 0.17723657935857773, + 0.09087064862251282, + 0.2692312076687813, + 0.23987314850091934, + 0.03425220027565956, + 0.2574703861027956, + 0.2569075748324394, + 0.1316034533083439, + 0.09470465034246445, + 0.27365674264729023, + 0.19433654472231865, + 0.0, + 0.23821240290999413, + 0.19173001870512962, + 0.10037513822317123, + 0.10026934556663036, + 0.0915058683604002, + 0.09073904156684875, + 0.16908570006489754, + 0.3304510358721018, + 0.060453593730926514, + 0.15246914327144623, + 0.03195076435804367, + 0.2366374060511589, + 0.173830084502697, + 0.10064752399921417, + 0.024267910048365593, + 0.159646300598979, + 0.03598461672663689, + 0.03364939987659454, + 0.12607651203870773, + 0.03736869990825653, + 0.11073946952819824, + 0.1816591713577509, + 0.206984531134367, + 0.20215094089508057 + ], + "unique_experts": 61, + "load_cv": 0.5633562819007771, + "normalized_load_entropy": 0.9581985507203443, + "max_load_share": 0.043478260869565216 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "7b01b01b531e6b566b07449298c341acf4e8d703bc9b2c5f8120223232cbd75a", + "route_weight_sha256": "452d0600464e680727d9e51e75cc9b5628d957db2da75dbe7f8538333ce34e38", + "loads": [ + 6, + 4, + 5, + 1, + 8, + 5, + 4, + 5, + 25, + 4, + 8, + 1, + 0, + 4, + 3, + 15, + 2, + 9, + 6, + 3, + 7, + 3, + 5, + 2, + 3, + 7, + 21, + 3, + 4, + 4, + 4, + 9, + 3, + 8, + 2, + 2, + 2, + 4, + 3, + 5, + 4, + 15, + 4, + 10, + 4, + 12, + 4, + 6, + 4, + 1, + 10, + 6, + 8, + 1, + 7, + 7, + 10, + 14, + 4, + 12, + 4, + 9, + 3, + 6 + ], + "weighted_loads": [ + 0.4772872067987919, + 0.1790644098073244, + 0.28662770241498947, + 0.024612106382846832, + 0.5250409934669733, + 0.3405393324792385, + 0.16447314247488976, + 0.3031876627355814, + 1.405940605327487, + 0.15707884542644024, + 0.632002979516983, + 0.14657524228096008, + 0.0, + 0.2763469070196152, + 0.10557074099779129, + 0.9551622569561005, + 0.13563760370016098, + 0.37085435166954994, + 0.26922503486275673, + 0.22239994630217552, + 0.44964395463466644, + 0.3334566503763199, + 0.3372049368917942, + 0.06617389619350433, + 0.12000443786382675, + 0.3195854928344488, + 1.387514628469944, + 0.1376972794532776, + 0.17723657935857773, + 0.2526428624987602, + 0.35506733506917953, + 0.9058261588215828, + 0.1347687691450119, + 0.4535686541348696, + 0.2569075748324394, + 0.1316034533083439, + 0.35331162065267563, + 0.30771912820637226, + 0.19433654472231865, + 0.36663370952010155, + 0.23821240290999413, + 0.8329025842249393, + 0.30809173360466957, + 0.2983035072684288, + 0.2447172086685896, + 0.8959871344268322, + 0.20287181809544563, + 0.4125364851206541, + 0.23271141573786736, + 0.15246914327144623, + 0.5153604783117771, + 0.6007527485489845, + 0.46830103918910027, + 0.10064752399921417, + 0.16313312016427517, + 0.6634186711162329, + 0.3926902338862419, + 0.7742835022509098, + 0.2010771408677101, + 0.7675866931676865, + 0.22664819844067097, + 0.46770387701690197, + 0.206984531134367, + 0.6932088509202003 + ], + "unique_experts": 63, + "load_cv": 0.7603453162872774, + "normalized_load_entropy": 0.9410823827020528, + "max_load_share": 0.06510416666666667 + } + }, + "s0_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "2d8cd9908fc464dc20cd5f3e8c7b1db3070e43c5b0647c5983b812d1b562f242", + "route_weight_sha256": "5c81bb4018153c25a00c68db144af7d4816e2a02fe1a4315025341fad74075d5", + "loads": [ + 3, + 3, + 2, + 1, + 3, + 3, + 4, + 1, + 5, + 3, + 3, + 0, + 0, + 2, + 4, + 2, + 2, + 4, + 3, + 2, + 4, + 1, + 1, + 1, + 1, + 2, + 2, + 1, + 2, + 1, + 2, + 3, + 1, + 6, + 2, + 2, + 1, + 3, + 3, + 0, + 4, + 2, + 1, + 3, + 2, + 1, + 3, + 4, + 1, + 1, + 1, + 2, + 3, + 1, + 2, + 3, + 1, + 1, + 2, + 1, + 2, + 3, + 3, + 2 + ], + "weighted_loads": [ + 0.29529543966054916, + 0.15745901316404343, + 0.1364898830652237, + 0.024389032274484634, + 0.23585115373134613, + 0.1960897035896778, + 0.17028780281543732, + 0.03765729442238808, + 0.1743161603808403, + 0.1350201591849327, + 0.258579783141613, + 0.0, + 0.0, + 0.2158903330564499, + 0.14675084128975868, + 0.1216420978307724, + 0.12741302698850632, + 0.15337443724274635, + 0.19856811873614788, + 0.1595245786011219, + 0.1558385230600834, + 0.1207239106297493, + 0.06432051956653595, + 0.033042315393686295, + 0.05104147270321846, + 0.12276661396026611, + 0.06206359900534153, + 0.041675664484500885, + 0.11227216944098473, + 0.060969844460487366, + 0.22570428252220154, + 0.23641595989465714, + 0.03522690013051033, + 0.26086425222456455, + 0.2459016963839531, + 0.1337258741259575, + 0.09266212582588196, + 0.3083489388227463, + 0.1949099712073803, + 0.0, + 0.252041220664978, + 0.17929135635495186, + 0.10788815468549728, + 0.07890700548887253, + 0.05990685522556305, + 0.09070315212011337, + 0.16530032083392143, + 0.3085902500897646, + 0.059382494539022446, + 0.15129299461841583, + 0.028917096555233, + 0.2398679256439209, + 0.18659396842122078, + 0.09476588666439056, + 0.056029295548796654, + 0.16330616176128387, + 0.03386770933866501, + 0.03725912794470787, + 0.14220259338617325, + 0.03778563812375069, + 0.10535016655921936, + 0.1596736554056406, + 0.20666122809052467, + 0.2135528326034546 + ], + "unique_experts": 61, + "load_cv": 0.5633562819007771, + "normalized_load_entropy": 0.9586699994227154, + "max_load_share": 0.043478260869565216 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "76d94937e16a91b28ef07acb60d6f60dae5dab869fac68fedb7b3b9d22e0944c", + "route_weight_sha256": "4b78a7f93444c13c36c807af3edd3add17a20380e6dec47733cc62aa793ae4f4", + "loads": [ + 4, + 3, + 4, + 1, + 6, + 3, + 5, + 3, + 24, + 3, + 5, + 2, + 0, + 3, + 6, + 11, + 2, + 5, + 5, + 2, + 7, + 1, + 2, + 1, + 1, + 6, + 15, + 2, + 2, + 1, + 2, + 7, + 3, + 8, + 2, + 3, + 1, + 3, + 3, + 3, + 4, + 12, + 1, + 9, + 2, + 11, + 3, + 4, + 2, + 1, + 4, + 3, + 7, + 1, + 4, + 7, + 4, + 10, + 2, + 12, + 3, + 7, + 3, + 2 + ], + "weighted_loads": [ + 0.38893086463212967, + 0.15745901316404343, + 0.2221425659954548, + 0.024389032274484634, + 0.40927986800670624, + 0.1960897035896778, + 0.23238513618707657, + 0.28984271362423897, + 1.2104553319513798, + 0.1350201591849327, + 0.4597017392516136, + 0.15987105295062065, + 0.0, + 0.23974904604256153, + 0.18828460201621056, + 0.7385058030486107, + 0.12741302698850632, + 0.22455086931586266, + 0.24310746602714062, + 0.1595245786011219, + 0.4874671511352062, + 0.1207239106297493, + 0.09457835741341114, + 0.033042315393686295, + 0.05104147270321846, + 0.2871107943356037, + 0.9375146590173244, + 0.1071515828371048, + 0.11227216944098473, + 0.060969844460487366, + 0.22570428252220154, + 0.6887423247098923, + 0.14750099554657936, + 0.5025139544159174, + 0.2459016963839531, + 0.15512707456946373, + 0.09266212582588196, + 0.3083489388227463, + 0.1949099712073803, + 0.22797281295061111, + 0.252041220664978, + 0.5914848670363426, + 0.10788815468549728, + 0.24194119311869144, + 0.05990685522556305, + 0.9096485301852226, + 0.16530032083392143, + 0.3085902500897646, + 0.08054368011653423, + 0.15129299461841583, + 0.20340492017567158, + 0.292782548815012, + 0.44272658601403236, + 0.09476588666439056, + 0.1010936088860035, + 0.6911284923553467, + 0.22676857188344002, + 0.5490629710257053, + 0.14220259338617325, + 0.7514955326914787, + 0.19626091420650482, + 0.34857633151113987, + 0.20666122809052467, + 0.2135528326034546 + ], + "unique_experts": 63, + "load_cv": 0.8906233078822999, + "normalized_load_entropy": 0.9251197949431337, + "max_load_share": 0.08333333333333333 + } + }, + "s1_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "72866217798b454b8b49c265370c0216ecc9662a5e5a2cd03ea5170b15350612", + "route_weight_sha256": "c79a1a11ce904ce4ff3db64e9ae00f3edd11a91ad6659f87055ae1bcf0e79ab2", + "loads": [ + 3, + 4, + 2, + 1, + 3, + 3, + 3, + 1, + 2, + 3, + 3, + 0, + 0, + 2, + 2, + 2, + 2, + 4, + 3, + 2, + 4, + 1, + 1, + 1, + 1, + 2, + 1, + 1, + 4, + 2, + 3, + 3, + 1, + 6, + 2, + 2, + 1, + 3, + 3, + 0, + 4, + 2, + 1, + 4, + 3, + 1, + 3, + 4, + 1, + 1, + 2, + 2, + 3, + 1, + 1, + 3, + 1, + 1, + 2, + 1, + 2, + 3, + 3, + 2 + ], + "weighted_loads": [ + 0.2709576487541199, + 0.17936706729233265, + 0.12713735550642014, + 0.024570981040596962, + 0.23135558515787125, + 0.20355940237641335, + 0.11819412186741829, + 0.037241075187921524, + 0.057637769728899, + 0.13229089602828026, + 0.244628444314003, + 0.0, + 0.0, + 0.2097003385424614, + 0.08382155559957027, + 0.139210756868124, + 0.1366175040602684, + 0.16346454992890358, + 0.1880816537886858, + 0.15621502697467804, + 0.15514781884849072, + 0.12910468876361847, + 0.06781678646802902, + 0.03169141337275505, + 0.04831459000706673, + 0.12319920212030411, + 0.03075767122209072, + 0.044104836881160736, + 0.17241943441331387, + 0.09084099344909191, + 0.2693139873445034, + 0.23933853209018707, + 0.03379764407873154, + 0.25197677314281464, + 0.25306493788957596, + 0.13248971477150917, + 0.09456152468919754, + 0.27499477565288544, + 0.19540372118353844, + 0.0, + 0.24320749938488007, + 0.19158661365509033, + 0.10042787343263626, + 0.10041696950793266, + 0.09075837023556232, + 0.09135763347148895, + 0.16927629336714745, + 0.31735832430422306, + 0.060510993003845215, + 0.1516810655593872, + 0.05957537330687046, + 0.23528924584388733, + 0.1743030771613121, + 0.09998064488172531, + 0.02546687051653862, + 0.16345863975584507, + 0.036179132759571075, + 0.033620692789554596, + 0.12582170218229294, + 0.03742564469575882, + 0.1111098937690258, + 0.15395701117813587, + 0.20685994625091553, + 0.20320414006710052 + ], + "unique_experts": 61, + "load_cv": 0.5512964232350792, + "normalized_load_entropy": 0.9597023097757023, + "max_load_share": 0.043478260869565216 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "db6bf1c7ed4144c0f5ffdbc599502998d6ed579ee6fd77a044f1b9f53d0ddb33", + "route_weight_sha256": "d37c44bba885dcc83e789f9dca6789180c637be9b878afcc78e0fd8be869eb4b", + "loads": [ + 6, + 4, + 5, + 1, + 9, + 5, + 4, + 4, + 24, + 3, + 8, + 4, + 0, + 4, + 3, + 14, + 2, + 9, + 6, + 3, + 7, + 3, + 5, + 2, + 3, + 7, + 21, + 3, + 4, + 4, + 5, + 9, + 3, + 8, + 2, + 2, + 3, + 4, + 3, + 5, + 4, + 15, + 4, + 10, + 4, + 11, + 3, + 6, + 3, + 1, + 11, + 7, + 9, + 1, + 7, + 7, + 10, + 14, + 4, + 11, + 4, + 8, + 3, + 6 + ], + "weighted_loads": [ + 0.4777338244020939, + 0.17936706729233265, + 0.2756897546350956, + 0.024570981040596962, + 0.6418850664049387, + 0.3404858969151974, + 0.16359127312898636, + 0.2529785931110382, + 1.3647964373230934, + 0.13229089602828026, + 0.6348716728389263, + 0.3384453263133764, + 0.0, + 0.2768809627741575, + 0.10569275543093681, + 0.8445322141051292, + 0.1366175040602684, + 0.36478450149297714, + 0.27338046208024025, + 0.2221558839082718, + 0.44722346775233746, + 0.3347562849521637, + 0.33887291327118874, + 0.06619502231478691, + 0.11981451883912086, + 0.3187310229986906, + 1.3768454995006323, + 0.13655844703316689, + 0.17241943441331387, + 0.2526132073253393, + 0.3759744893759489, + 0.9059685319662094, + 0.13313018903136253, + 0.44654274731874466, + 0.25306493788957596, + 0.13248971477150917, + 0.3750163521617651, + 0.30905716121196747, + 0.19540372118353844, + 0.3474445007741451, + 0.24320749938488007, + 0.801870658993721, + 0.3081444688141346, + 0.2984511312097311, + 0.24396971054375172, + 0.862077571451664, + 0.16927629336714745, + 0.3994437735527754, + 0.21117931976914406, + 0.1516810655593872, + 0.5431540869176388, + 0.6423239819705486, + 0.5028615482151508, + 0.09998064488172531, + 0.16582360118627548, + 0.6681301165372133, + 0.3974849805235863, + 0.772163949906826, + 0.20082233101129532, + 0.6731931194663048, + 0.22701862268149853, + 0.4353096019476652, + 0.20685994625091553, + 0.6942620500922203 + ], + "unique_experts": 63, + "load_cv": 0.738922827123675, + "normalized_load_entropy": 0.9440182541568363, + "max_load_share": 0.0625 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.9254658385093167, + "mean_token_weighted_tv": 0.012480085918112942, + "aggregate_load_tv": 0.043478260869565216 + }, + "system_bos": { + "tokens": 23, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.9037267080745341, + "mean_token_weighted_tv": 0.01808329853836609, + "aggregate_load_tv": 0.05072463768115942 + }, + "system_x": { + "tokens": 23, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8695652173913043, + "mean_token_weighted_tv": 0.022374204076502636, + "aggregate_load_tv": 0.07971014492753623 + }, + "system_period": { + "tokens": 23, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.8944099378881988, + "mean_token_weighted_tv": 0.020149786470700867, + "aggregate_load_tv": 0.05797101449275363 + }, + "bos_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 3, + "set_exact_tokens": 9, + "mean_set_jaccard": 0.8074534161490684, + "mean_token_weighted_tv": 0.03909885300242383, + "aggregate_load_tv": 0.10869565217391304 + }, + "bos_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 6, + "set_exact_tokens": 9, + "mean_set_jaccard": 0.7981366459627331, + "mean_token_weighted_tv": 0.040376890612685165, + "aggregate_load_tv": 0.11594202898550725 + }, + "x_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 3, + "set_exact_tokens": 8, + "mean_set_jaccard": 0.8043478260869565, + "mean_token_weighted_tv": 0.03523019709340904, + "aggregate_load_tv": 0.10144927536231885 + }, + "x_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 6, + "set_exact_tokens": 8, + "mean_set_jaccard": 0.7857142857142858, + "mean_token_weighted_tv": 0.04143369493439146, + "aggregate_load_tv": 0.12318840579710144 + }, + "period_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 3, + "set_exact_tokens": 8, + "mean_set_jaccard": 0.7950310559006212, + "mean_token_weighted_tv": 0.036508466683976025, + "aggregate_load_tv": 0.10869565217391303 + }, + "period_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 5, + "set_exact_tokens": 8, + "mean_set_jaccard": 0.7857142857142858, + "mean_token_weighted_tv": 0.04103877593803665, + "aggregate_load_tv": 0.12318840579710144 + } + } + }, + "layer_02": { + "layer": 2, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "3acb21da55ba1b9b1ce6a4210e61cdb3535a1e01dc6363db2c2e9eaade9e615e", + "route_weight_sha256": "56f86ae10d8e883af6bba4d3b0eab5cc0008e773762d60ac3d5f8a4a4152b3fa", + "loads": [ + 3, + 2, + 1, + 4, + 3, + 2, + 4, + 2, + 3, + 3, + 1, + 2, + 2, + 1, + 5, + 5, + 2, + 2, + 0, + 3, + 0, + 1, + 5, + 2, + 0, + 3, + 2, + 2, + 0, + 1, + 0, + 4, + 1, + 2, + 2, + 2, + 1, + 0, + 1, + 4, + 0, + 2, + 3, + 0, + 4, + 4, + 3, + 4, + 3, + 2, + 3, + 0, + 5, + 2, + 2, + 1, + 1, + 1, + 2, + 2, + 3, + 3, + 1, + 4 + ], + "weighted_loads": [ + 0.23039095103740692, + 0.1080981008708477, + 0.023259053006768227, + 0.34124474972486496, + 0.1798817403614521, + 0.10709791630506516, + 0.13053492456674576, + 0.10904501751065254, + 0.28403136134147644, + 0.32030026614665985, + 0.07020584493875504, + 0.24558264017105103, + 0.11367389932274818, + 0.08956774324178696, + 0.3239308279007673, + 0.3618002999573946, + 0.2100118175148964, + 0.2135351374745369, + 0.0, + 0.32838109135627747, + 0.0, + 0.04086267203092575, + 0.554459773004055, + 0.20309706777334213, + 0.0, + 0.2165076918900013, + 0.24892556108534336, + 0.08387935534119606, + 0.0, + 0.07751472294330597, + 0.0, + 0.3036428391933441, + 0.03481978178024292, + 0.0822022333741188, + 0.09326907992362976, + 0.10839952155947685, + 0.032896410673856735, + 0.0, + 0.1203753799200058, + 0.19147781282663345, + 0.0, + 0.15213895589113235, + 0.2507806457579136, + 0.0, + 0.30678874626755714, + 0.2837270274758339, + 0.23689421266317368, + 0.2084449604153633, + 0.4550236202776432, + 0.19465989619493484, + 0.32341688871383667, + 0.0, + 0.5608753934502602, + 0.22538718953728676, + 0.07074335217475891, + 0.058363255113363266, + 0.16504187881946564, + 0.03579473868012428, + 0.4391655772924423, + 0.11879802122712135, + 0.1810528077185154, + 0.2398076057434082, + 0.03395539149641991, + 0.2581307291984558 + ], + "unique_experts": 55, + "load_cv": 0.6518517722912759, + "normalized_load_entropy": 0.9365690375744912, + "max_load_share": 0.036231884057971016 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "e47c62753ff7087314b66cf5c9b01e1c045f50c44751722285de9155e27b306d", + "route_weight_sha256": "2faad384c57998258e93b4563a8a3e2a5146719ceeaad209ac43de54530246de", + "loads": [ + 3, + 12, + 1, + 6, + 3, + 2, + 4, + 3, + 6, + 3, + 4, + 2, + 2, + 2, + 13, + 5, + 2, + 3, + 1, + 7, + 2, + 10, + 5, + 2, + 3, + 3, + 3, + 4, + 3, + 1, + 0, + 5, + 1, + 2, + 7, + 17, + 1, + 0, + 4, + 4, + 0, + 2, + 9, + 0, + 4, + 4, + 6, + 8, + 4, + 2, + 3, + 6, + 5, + 3, + 2, + 1, + 1, + 9, + 10, + 7, + 14, + 5, + 7, + 15 + ], + "weighted_loads": [ + 0.23039095103740692, + 1.057629220187664, + 0.023259053006768227, + 2.0386328622698784, + 0.1798817403614521, + 0.10709791630506516, + 0.13053492456674576, + 0.15589142963290215, + 0.49676502123475075, + 0.32030026614665985, + 0.1952732615172863, + 0.24558264017105103, + 0.11367389932274818, + 0.1174136009067297, + 0.6236945949494839, + 0.3618002999573946, + 0.2100118175148964, + 0.21423358074389398, + 0.0015876434044912457, + 1.1556615233421326, + 0.31117744743824005, + 0.7344586923718452, + 0.554459773004055, + 0.20309706777334213, + 0.13810970075428486, + 0.2165076918900013, + 0.2497705351561308, + 0.40512576326727867, + 0.24645938724279404, + 0.07751472294330597, + 0.0, + 0.30433753214310855, + 0.03481978178024292, + 0.0822022333741188, + 0.31695546209812164, + 2.3351604184135795, + 0.032896410673856735, + 0.0, + 0.22442988865077496, + 0.19147781282663345, + 0.0, + 0.15213895589113235, + 0.8381164744496346, + 0.0, + 0.30678874626755714, + 0.2837270274758339, + 0.33063119649887085, + 0.48287855088710785, + 0.4806631226092577, + 0.19465989619493484, + 0.32341688871383667, + 0.6684192903339863, + 0.5608753934502602, + 0.22669805388431996, + 0.07074335217475891, + 0.058363255113363266, + 0.16504187881946564, + 0.454543674364686, + 0.80410485714674, + 0.35175713896751404, + 1.0955026587471366, + 0.3255640119314194, + 0.5335137825459242, + 0.8400118667632341 + ], + "unique_experts": 60, + "load_cv": 0.8314794192830981, + "normalized_load_entropy": 0.9235681268935743, + "max_load_share": 0.059027777777777776 + } + }, + "s1_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "bfa78cc5b90d4b4da515b484f6e44c9210f71faa35d0f44891bb9174a6be7b02", + "route_weight_sha256": "e840a474312df55a1d9d308c76b179cff9fd1276800274816b19f89ec0928ee5", + "loads": [ + 3, + 2, + 1, + 4, + 3, + 2, + 3, + 2, + 3, + 3, + 1, + 2, + 2, + 1, + 5, + 4, + 2, + 2, + 0, + 3, + 0, + 1, + 5, + 2, + 0, + 3, + 2, + 2, + 0, + 1, + 0, + 4, + 1, + 2, + 2, + 2, + 1, + 0, + 1, + 4, + 0, + 2, + 3, + 1, + 4, + 3, + 3, + 4, + 3, + 2, + 3, + 0, + 5, + 2, + 2, + 1, + 1, + 1, + 2, + 2, + 3, + 3, + 2, + 5 + ], + "weighted_loads": [ + 0.23368898779153824, + 0.11187796294689178, + 0.02318173088133335, + 0.3541659153997898, + 0.1813526675105095, + 0.10515746474266052, + 0.09174344129860401, + 0.11126112937927246, + 0.28746699541807175, + 0.31654443964362144, + 0.07193207740783691, + 0.2469712719321251, + 0.11496945843100548, + 0.09243807941675186, + 0.3352080471813679, + 0.34837959706783295, + 0.2204641029238701, + 0.20965714007616043, + 0.0, + 0.3263060487806797, + 0.0, + 0.04077173396945, + 0.5669316872954369, + 0.2064119055867195, + 0.0, + 0.2112865187227726, + 0.24908454157412052, + 0.08589062839746475, + 0.0, + 0.08115161210298538, + 0.0, + 0.29869766905903816, + 0.03576144948601723, + 0.08132809400558472, + 0.09268027544021606, + 0.10284963995218277, + 0.033089350908994675, + 0.0, + 0.12396833300590515, + 0.18681901320815086, + 0.0, + 0.15483983233571053, + 0.2483748346567154, + 0.026278799399733543, + 0.30253544449806213, + 0.24988821521401405, + 0.23960697650909424, + 0.20364701561629772, + 0.46084268763661385, + 0.1859411597251892, + 0.3271682932972908, + 0.0, + 0.552108395844698, + 0.22006963938474655, + 0.07348433136940002, + 0.05971652269363403, + 0.1616189032793045, + 0.030748188495635986, + 0.4336538016796112, + 0.12102290987968445, + 0.17805330082774162, + 0.25136538967490196, + 0.05651272460818291, + 0.2943975031375885 + ], + "unique_experts": 56, + "load_cv": 0.6255432421712243, + "normalized_load_entropy": 0.9419920146224052, + "max_load_share": 0.036231884057971016 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "e6d1240f4d7cdff6dc3002b556059c3d8b9ba5b48d143f7be569c59d7fa7213c", + "route_weight_sha256": "1ad70822e7d93a583d3f7275ace6d385c760b07126b15115030fc0a83c7cc5d9", + "loads": [ + 7, + 13, + 2, + 7, + 4, + 3, + 3, + 5, + 12, + 4, + 8, + 2, + 2, + 4, + 17, + 5, + 4, + 3, + 1, + 9, + 2, + 12, + 6, + 2, + 6, + 4, + 3, + 5, + 5, + 1, + 1, + 6, + 1, + 2, + 11, + 19, + 1, + 1, + 7, + 7, + 0, + 2, + 12, + 2, + 7, + 3, + 11, + 11, + 5, + 3, + 4, + 9, + 6, + 6, + 2, + 1, + 5, + 8, + 4, + 13, + 14, + 8, + 12, + 19 + ], + "weighted_loads": [ + 0.7542999163269997, + 1.1174427270889282, + 0.048653895035386086, + 2.0861158035695553, + 0.21165605634450912, + 0.2460729032754898, + 0.09174344129860401, + 0.22184811532497406, + 1.03467739187181, + 0.43363795056939125, + 0.3764166198670864, + 0.2469712719321251, + 0.11496945843100548, + 0.1445384647231549, + 0.8858240656554699, + 0.38064419105648994, + 0.28441666811704636, + 0.210244822781533, + 0.0013836058788001537, + 1.1864518206566572, + 0.28810155391693115, + 0.831894813105464, + 0.6054800748825073, + 0.2064119055867195, + 0.2627546526491642, + 0.2614734098315239, + 0.2499124332680367, + 0.7929407730698586, + 0.2536238133907318, + 0.08115161210298538, + 0.033937420696020126, + 0.34163745306432247, + 0.03576144948601723, + 0.08132809400558472, + 0.4612287972122431, + 2.1004363065585494, + 0.033089350908994675, + 0.041833169758319855, + 0.32501765713095665, + 0.5414345525205135, + 0.0, + 0.15483983233571053, + 1.2862540818750858, + 0.2079236414283514, + 0.9529592096805573, + 0.24988821521401405, + 0.875736789777875, + 0.6016452442854643, + 0.5295298360288143, + 0.2289164811372757, + 0.3536345064640045, + 0.9801644273102283, + 0.7276846207678318, + 0.4043884768616408, + 0.07348433136940002, + 0.05971652269363403, + 0.4148321636021137, + 0.3579823561012745, + 0.5445284955203533, + 0.6508554797619581, + 0.9364235056564212, + 0.6144448332488537, + 0.9678012505173683, + 1.284014230594039 + ], + "unique_experts": 63, + "load_cv": 0.7563389525279728, + "normalized_load_entropy": 0.9344234054928285, + "max_load_share": 0.049479166666666664 + } + }, + "s0_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "8568bbe1a391951a4f4ae05a7783f62504fd577700ee7a87e8300aedacf1c6e2", + "route_weight_sha256": "ae1eaf568f27808e6670b20f3d50fc04c621d1f457aad14bf219006633b9425d", + "loads": [ + 3, + 2, + 1, + 4, + 3, + 2, + 3, + 2, + 3, + 3, + 1, + 2, + 2, + 1, + 5, + 4, + 2, + 2, + 1, + 3, + 0, + 1, + 5, + 2, + 0, + 3, + 3, + 2, + 0, + 1, + 0, + 4, + 0, + 2, + 2, + 2, + 0, + 0, + 1, + 3, + 0, + 2, + 3, + 0, + 4, + 4, + 3, + 4, + 3, + 2, + 3, + 0, + 5, + 2, + 2, + 2, + 2, + 1, + 2, + 2, + 3, + 3, + 2, + 4 + ], + "weighted_loads": [ + 0.2456585094332695, + 0.1205410361289978, + 0.022192036733031273, + 0.3274257779121399, + 0.18158164247870445, + 0.10073352232575417, + 0.11371679976582527, + 0.10961718484759331, + 0.2893380969762802, + 0.3014889024198055, + 0.06799691915512085, + 0.24515626579523087, + 0.12583468109369278, + 0.08606019616127014, + 0.2920725792646408, + 0.3432181626558304, + 0.23630409687757492, + 0.2349807806313038, + 0.035161737352609634, + 0.31673654168844223, + 0.0, + 0.037068407982587814, + 0.5654929652810097, + 0.18289761245250702, + 0.0, + 0.22387908026576042, + 0.3094727098941803, + 0.07851890474557877, + 0.0, + 0.06462083011865616, + 0.0, + 0.31660082563757896, + 0.0, + 0.06884657964110374, + 0.0903325006365776, + 0.10078100115060806, + 0.0, + 0.0, + 0.09793411940336227, + 0.1481429822742939, + 0.0, + 0.15330574475228786, + 0.2979024536907673, + 0.0, + 0.32305648550391197, + 0.3065863214433193, + 0.24379991739988327, + 0.19831403903663158, + 0.4859614707529545, + 0.17918584123253822, + 0.31415632739663124, + 0.0, + 0.5720578469336033, + 0.2112060859799385, + 0.08292365819215775, + 0.08665179274976254, + 0.19523907825350761, + 0.04311944916844368, + 0.4379580169916153, + 0.10820174962282181, + 0.16560861468315125, + 0.2499389946460724, + 0.054215021431446075, + 0.24651901796460152 + ], + "unique_experts": 54, + "load_cv": 0.6255432421712243, + "normalized_load_entropy": 0.9381934071009964, + "max_load_share": 0.036231884057971016 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "c0d629e330cb1481105ef4432ca6358080e809fe3b3c9ce2175a3c3b1ed80cfa", + "route_weight_sha256": "6b02e63a83f89167e02c2ba74a153af32321d899656c5d13cbe80b3ad68db148", + "loads": [ + 3, + 12, + 1, + 5, + 3, + 2, + 3, + 3, + 7, + 3, + 4, + 2, + 3, + 2, + 10, + 4, + 3, + 2, + 1, + 7, + 2, + 10, + 5, + 2, + 2, + 3, + 3, + 4, + 3, + 1, + 0, + 4, + 0, + 2, + 7, + 18, + 0, + 0, + 5, + 3, + 0, + 2, + 10, + 0, + 4, + 4, + 6, + 8, + 4, + 2, + 3, + 7, + 5, + 2, + 2, + 2, + 2, + 10, + 10, + 7, + 14, + 5, + 9, + 16 + ], + "weighted_loads": [ + 0.2456585094332695, + 1.0700721554458141, + 0.022192036733031273, + 1.0520060062408447, + 0.18158164247870445, + 0.10073352232575417, + 0.11371679976582527, + 0.1564635969698429, + 0.5068930871784687, + 0.3014889024198055, + 0.19306433573365211, + 0.24515626579523087, + 0.15749168023467064, + 0.11167677864432335, + 0.4937700815498829, + 0.3432181626558304, + 0.26659420505166054, + 0.2349807806313038, + 0.035161737352609634, + 1.0594301894307137, + 0.2908031791448593, + 0.7417076490819454, + 0.5654929652810097, + 0.18289761245250702, + 0.09958060458302498, + 0.22387908026576042, + 0.3094727098941803, + 0.3667154610157013, + 0.28648983873426914, + 0.06462083011865616, + 0.0, + 0.31660082563757896, + 0.0, + 0.06884657964110374, + 0.3140188828110695, + 2.298735464923084, + 0.0, + 0.0, + 0.29362296499311924, + 0.1481429822742939, + 0.0, + 0.15330574475228786, + 0.9603494815528393, + 0.0, + 0.32305648550391197, + 0.3065863214433193, + 0.333485284820199, + 0.465667312964797, + 0.511600973084569, + 0.17918584123253822, + 0.31415632739663124, + 0.6350779552012682, + 0.5720578469336033, + 0.2112060859799385, + 0.08292365819215775, + 0.08665179274976254, + 0.19523907825350761, + 0.4804000146687031, + 0.8028972968459129, + 0.2886773254722357, + 1.0629571257159114, + 0.33569540083408356, + 0.7257006075233221, + 1.087531989440322 + ], + "unique_experts": 58, + "load_cv": 0.8579691784155834, + "normalized_load_entropy": 0.9178573217824805, + "max_load_share": 0.0625 + } + }, + "s1_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "66c7a1dea6572db6f2f6d590e343005aac0c28945c61bc002dc7f40c9b94e6cd", + "route_weight_sha256": "4721ff57b8fb1a334ccd40fb4737490b5a0deedec372ec708401ce6916365508", + "loads": [ + 3, + 3, + 1, + 4, + 3, + 1, + 2, + 2, + 3, + 3, + 1, + 3, + 2, + 1, + 4, + 4, + 2, + 2, + 1, + 3, + 0, + 1, + 6, + 2, + 0, + 3, + 2, + 1, + 0, + 1, + 0, + 5, + 0, + 2, + 2, + 2, + 1, + 0, + 1, + 4, + 0, + 2, + 3, + 0, + 4, + 4, + 3, + 4, + 4, + 2, + 3, + 0, + 5, + 2, + 2, + 2, + 1, + 1, + 2, + 3, + 2, + 3, + 1, + 4 + ], + "weighted_loads": [ + 0.25095051527023315, + 0.15868308581411839, + 0.02497478388249874, + 0.3519997000694275, + 0.18049101904034615, + 0.05934305489063263, + 0.08692053705453873, + 0.10512755438685417, + 0.3083002045750618, + 0.2937576584517956, + 0.06913775205612183, + 0.2861688956618309, + 0.12960899248719215, + 0.08764458447694778, + 0.28071465715765953, + 0.35393425077199936, + 0.23372594267129898, + 0.23734135925769806, + 0.03465043380856514, + 0.3162102475762367, + 0.0, + 0.03606870770454407, + 0.6362305320799351, + 0.18480484187602997, + 0.0, + 0.206970002502203, + 0.2686937563121319, + 0.04300509765744209, + 0.0, + 0.07285670191049576, + 0.0, + 0.3541945107281208, + 0.0, + 0.07449226453900337, + 0.0885583758354187, + 0.09758305549621582, + 0.03129217401146889, + 0.0, + 0.10482976585626602, + 0.17662127315998077, + 0.0, + 0.15187540277838707, + 0.30114683136343956, + 0.0, + 0.31433213129639626, + 0.30238003842532635, + 0.251067154109478, + 0.18088899366557598, + 0.5222113337367773, + 0.17099471390247345, + 0.32685500755906105, + 0.0, + 0.5530827790498734, + 0.2063295766711235, + 0.09327005594968796, + 0.09118638001382351, + 0.16142551600933075, + 0.030964013189077377, + 0.42030754685401917, + 0.14406344667077065, + 0.11713375896215439, + 0.2758074440062046, + 0.022391945123672485, + 0.22499161213636398 + ], + "unique_experts": 55, + "load_cv": 0.6620825380000244, + "normalized_load_entropy": 0.9353064994614274, + "max_load_share": 0.043478260869565216 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "cb491dff08f0047cb639e916a4d03a705628ee3e163949d41236610b025be5b4", + "route_weight_sha256": "9a23b1e5f17b6c699f93ecaa4b6ee2410a552537f9f47aa96acf2f135cd3bc30", + "loads": [ + 7, + 14, + 2, + 7, + 5, + 2, + 2, + 5, + 13, + 4, + 8, + 3, + 3, + 3, + 15, + 5, + 5, + 2, + 1, + 9, + 2, + 12, + 7, + 2, + 5, + 4, + 2, + 4, + 5, + 1, + 1, + 7, + 0, + 2, + 11, + 20, + 1, + 1, + 7, + 7, + 0, + 2, + 13, + 1, + 7, + 4, + 10, + 11, + 6, + 3, + 4, + 9, + 6, + 5, + 2, + 2, + 5, + 8, + 4, + 14, + 13, + 8, + 13, + 18 + ], + "weighted_loads": [ + 0.7715614438056946, + 1.1642478499561548, + 0.050446948036551476, + 1.1412044279277325, + 0.23393601924180984, + 0.20025849342346191, + 0.08692053705453873, + 0.21571454033255577, + 1.0877549070864916, + 0.4108511693775654, + 0.3736222945153713, + 0.2861688956618309, + 0.15737471915781498, + 0.1374155841767788, + 0.7833700627088547, + 0.38619884476065636, + 0.32636028341948986, + 0.23734135925769806, + 0.03465043380856514, + 1.0752232391387224, + 0.2749953120946884, + 0.8498581480234861, + 0.6747789196670055, + 0.18480484187602997, + 0.22909095510840416, + 0.2571568936109543, + 0.2686937563121319, + 0.7319497056305408, + 0.3109481707215309, + 0.07285670191049576, + 0.033937420696020126, + 0.3971342947334051, + 0.0, + 0.07449226453900337, + 0.4571068976074457, + 2.0878672963008285, + 0.03129217401146889, + 0.041833169758319855, + 0.38575807586312294, + 0.5312368124723434, + 0.0, + 0.15187540277838707, + 1.4047538172453642, + 0.18164484202861786, + 0.9647558964788914, + 0.30238003842532635, + 0.862319391220808, + 0.5744147431105375, + 0.5908984821289778, + 0.21397003531455994, + 0.35332122072577477, + 0.9908505417406559, + 0.7286590039730072, + 0.38955513574182987, + 0.09327005594968796, + 0.09118638001382351, + 0.41463877633213997, + 0.33104470558464527, + 0.5311822406947613, + 0.624247532337904, + 0.8582699587568641, + 0.6388868875801563, + 1.0593940168619156, + 1.3784533012658358 + ], + "unique_experts": 62, + "load_cv": 0.7654655446197433, + "normalized_load_entropy": 0.931256351853734, + "max_load_share": 0.052083333333333336 + } + }, + "s0_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "5b0a464864c6b3d141ba4f31629edb0e888eddc59e038cfcd3c83e0a142bf721", + "route_weight_sha256": "6bbdc8df8550fb26725de4b96bf74cd2901b6038763a43cc95a7cbaba4993b13", + "loads": [ + 3, + 2, + 1, + 4, + 3, + 2, + 2, + 2, + 3, + 3, + 1, + 3, + 2, + 1, + 4, + 4, + 2, + 2, + 1, + 3, + 0, + 1, + 5, + 2, + 0, + 3, + 2, + 1, + 0, + 1, + 0, + 5, + 0, + 2, + 2, + 2, + 2, + 0, + 1, + 3, + 0, + 2, + 3, + 0, + 4, + 4, + 3, + 4, + 3, + 2, + 3, + 0, + 5, + 2, + 2, + 2, + 2, + 1, + 2, + 3, + 3, + 3, + 3, + 2 + ], + "weighted_loads": [ + 0.25769776850938797, + 0.11260224506258965, + 0.022192373871803284, + 0.3487345576286316, + 0.17835179716348648, + 0.10576317086815834, + 0.07895717024803162, + 0.10898987948894501, + 0.30181264132261276, + 0.3072839416563511, + 0.06612887233495712, + 0.26893286034464836, + 0.11849966645240784, + 0.08278069645166397, + 0.2801649458706379, + 0.31829238682985306, + 0.22969194501638412, + 0.23558979481458664, + 0.03292720764875412, + 0.31028856709599495, + 0.0, + 0.0381256528198719, + 0.5476197600364685, + 0.18029437959194183, + 0.0, + 0.2236105427145958, + 0.26219049096107483, + 0.039346784353256226, + 0.0, + 0.0659407526254654, + 0.0, + 0.35644304752349854, + 0.0, + 0.07125558704137802, + 0.09031601995229721, + 0.1048634722828865, + 0.06390278972685337, + 0.0, + 0.09167666733264923, + 0.14883874356746674, + 0.0, + 0.15050246380269527, + 0.30784523859620094, + 0.0, + 0.32146846503019333, + 0.3076138496398926, + 0.2563484460115433, + 0.1781066097319126, + 0.4849713332951069, + 0.17328282818198204, + 0.3122871294617653, + 0.0, + 0.5580042451620102, + 0.21759017556905746, + 0.07655615359544754, + 0.08087750151753426, + 0.19428157061338425, + 0.04477902874350548, + 0.43804048001766205, + 0.15389010310173035, + 0.17157245054841042, + 0.2585790082812309, + 0.07733999006450176, + 0.1409146562218666 + ], + "unique_experts": 55, + "load_cv": 0.6092130306372088, + "normalized_load_entropy": 0.9421126250935525, + "max_load_share": 0.036231884057971016 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "f66d5858023f1465228604c2d0b3315eed7dd42be4079b34cd957a4289df36d4", + "route_weight_sha256": "e36847b2d05875ecb0395049fb008bc2972cccca28b1a0ee753658c7a6d08d4f", + "loads": [ + 3, + 12, + 1, + 5, + 3, + 2, + 3, + 3, + 7, + 3, + 6, + 4, + 3, + 2, + 8, + 4, + 3, + 2, + 1, + 7, + 2, + 11, + 5, + 2, + 2, + 3, + 2, + 3, + 3, + 1, + 0, + 5, + 0, + 2, + 7, + 17, + 2, + 0, + 4, + 3, + 0, + 2, + 9, + 0, + 4, + 4, + 6, + 9, + 4, + 2, + 4, + 6, + 5, + 2, + 2, + 2, + 2, + 8, + 11, + 8, + 15, + 5, + 9, + 13 + ], + "weighted_loads": [ + 0.25769776850938797, + 1.062133364379406, + 0.022192373871803284, + 1.0733147859573364, + 0.17835179716348648, + 0.10576317086815834, + 0.11384133249521255, + 0.1558362916111946, + 0.5359394811093807, + 0.3072839416563511, + 0.30074556916952133, + 0.3042697310447693, + 0.14806129969656467, + 0.10962701588869095, + 0.4570023659616709, + 0.31829238682985306, + 0.2606544550508261, + 0.23558979481458664, + 0.03292720764875412, + 1.0741734690964222, + 0.30084089934825897, + 1.0402950160205364, + 0.5476197600364685, + 0.18029437959194183, + 0.09673673287034035, + 0.2236105427145958, + 0.26219049096107483, + 0.32380806654691696, + 0.28710925951600075, + 0.0659407526254654, + 0.0, + 0.35644304752349854, + 0.0, + 0.07125558704137802, + 0.3140024021267891, + 2.3113644188269973, + 0.06390278972685337, + 0.0, + 0.19617503695189953, + 0.14883874356746674, + 0.0, + 0.15050246380269527, + 0.8822041451931, + 0.0, + 0.32146846503019333, + 0.3076138496398926, + 0.34648886136710644, + 0.47680193558335304, + 0.5106108356267214, + 0.17328282818198204, + 0.32953920774161816, + 0.5440194122493267, + 0.5580042451620102, + 0.21759017556905746, + 0.07655615359544754, + 0.08087750151753426, + 0.19428157061338425, + 0.4027758873999119, + 0.9325296953320503, + 0.3339912500232458, + 1.1283989464864135, + 0.3443354144692421, + 0.7154122665524483, + 0.6485965810716152 + ], + "unique_experts": 59, + "load_cv": 0.8155510142168443, + "normalized_load_entropy": 0.9248794519180431, + "max_load_share": 0.059027777777777776 + } + }, + "s1_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "06e52312e12974fde5f4b728e678e0630b097fc175f13ef9cce6919a8f7d7b68", + "route_weight_sha256": "bcbc48e9bd900dfc06fccf561a0d50a6365caa7c4fd00d9424522b51d4386de9", + "loads": [ + 3, + 3, + 1, + 4, + 3, + 2, + 2, + 2, + 3, + 3, + 1, + 3, + 2, + 1, + 4, + 4, + 2, + 2, + 1, + 3, + 0, + 1, + 5, + 2, + 0, + 3, + 2, + 1, + 0, + 1, + 0, + 5, + 0, + 2, + 2, + 2, + 1, + 0, + 1, + 3, + 0, + 2, + 3, + 1, + 4, + 3, + 3, + 4, + 4, + 2, + 3, + 0, + 5, + 2, + 2, + 2, + 2, + 0, + 2, + 3, + 3, + 3, + 2, + 3 + ], + "weighted_loads": [ + 0.2705954313278198, + 0.15099230408668518, + 0.02489030547440052, + 0.36924172192811966, + 0.18000105023384094, + 0.09910424798727036, + 0.08464790135622025, + 0.10311788320541382, + 0.31751780211925507, + 0.2935525178909302, + 0.06879054754972458, + 0.28298652172088623, + 0.12807868793606758, + 0.08550844341516495, + 0.286032821983099, + 0.34775039553642273, + 0.23186776041984558, + 0.23758936673402786, + 0.033961232751607895, + 0.31077832356095314, + 0.0, + 0.0348118357360363, + 0.5843888632953167, + 0.18311597406864166, + 0.0, + 0.20041493326425552, + 0.25827835500240326, + 0.04011475667357445, + 0.0, + 0.06918508559465408, + 0.0, + 0.354545421898365, + 0.0, + 0.07623857259750366, + 0.0921417586505413, + 0.10208959877490997, + 0.03261170908808708, + 0.0, + 0.09802588075399399, + 0.1454724818468094, + 0.0, + 0.15024623647332191, + 0.3034563586115837, + 0.026336174458265305, + 0.3193646930158138, + 0.26253461092710495, + 0.2594200521707535, + 0.1616107039153576, + 0.5274961944669485, + 0.16123388335108757, + 0.32872410118579865, + 0.0, + 0.5413404069840908, + 0.21114397794008255, + 0.0890982635319233, + 0.08778820931911469, + 0.19076398760080338, + 0.0, + 0.41816186904907227, + 0.15042348206043243, + 0.15834014117717743, + 0.2656230814754963, + 0.048048293218016624, + 0.16260644793510437 + ], + "unique_experts": 55, + "load_cv": 0.6147046394332897, + "normalized_load_entropy": 0.9412009252117126, + "max_load_share": 0.036231884057971016 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "17227cfa9cb87157aa77a4457a1a53b464d8a3a4f5077686a50dd59af2e8555e", + "route_weight_sha256": "a01c5852b3777773ab28bc917628ac29b86f748a5a63aa25731b56e6fbcee0ac", + "loads": [ + 7, + 14, + 2, + 6, + 5, + 3, + 2, + 5, + 13, + 4, + 10, + 4, + 3, + 3, + 12, + 5, + 5, + 2, + 1, + 9, + 2, + 13, + 6, + 2, + 5, + 4, + 2, + 4, + 5, + 1, + 1, + 7, + 1, + 2, + 11, + 20, + 1, + 1, + 6, + 6, + 0, + 2, + 12, + 2, + 7, + 3, + 10, + 12, + 6, + 3, + 5, + 8, + 6, + 5, + 2, + 2, + 6, + 7, + 5, + 14, + 15, + 8, + 13, + 16 + ], + "weighted_loads": [ + 0.7912063598632812, + 1.1565570682287216, + 0.050362469628453255, + 1.1258246004581451, + 0.23324916698038578, + 0.24001968652009964, + 0.08464790135622025, + 0.21370486915111542, + 1.1123624127358198, + 0.4106460288167, + 0.4871299937367439, + 0.3180810697376728, + 0.1544861663132906, + 0.13729756884276867, + 0.7135489154607058, + 0.3800149895250797, + 0.33029182255268097, + 0.23758936673402786, + 0.033961232751607895, + 1.0823758374899626, + 0.27535566687583923, + 1.1308715511113405, + 0.6229372508823872, + 0.18311597406864166, + 0.22868118435144424, + 0.2506018243730068, + 0.25827835500240326, + 0.7235320620238781, + 0.3164256252348423, + 0.06918508559465408, + 0.033937420696020126, + 0.39748520590364933, + 0.029791558161377907, + 0.07623857259750366, + 0.4606902804225683, + 2.0726733012124896, + 0.03261170908808708, + 0.041833169758319855, + 0.2609245404601097, + 0.5000880211591721, + 0.0, + 0.15024623647332191, + 1.348777774721384, + 0.20798101648688316, + 0.969788458198309, + 0.26253461092710495, + 0.8706722892820835, + 0.5833736639469862, + 0.596183342859149, + 0.20420920476317406, + 0.3729817122220993, + 0.8966268561780453, + 0.7169166319072247, + 0.3943695370107889, + 0.0890982635319233, + 0.08778820931911469, + 0.4439772479236126, + 0.2983883246779442, + 0.6349096782505512, + 0.634178876876831, + 0.9454494332894683, + 0.628702525049448, + 1.0330791864544153, + 1.0435882825404406 + ], + "unique_experts": 63, + "load_cv": 0.7424387367168942, + "normalized_load_entropy": 0.9362607392576316, + "max_load_share": 0.052083333333333336 + } + }, + "s0_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "e8d8f5f96d56d7be7d48d4ef1a04ac791bca48560fcbe7b3ef845c2ce9f84e85", + "route_weight_sha256": "2ba87580e8cf628818343ae6e77a8f21e4663eb1a4fc7864707a3482966850c7", + "loads": [ + 3, + 2, + 1, + 4, + 3, + 2, + 2, + 2, + 3, + 3, + 1, + 3, + 2, + 1, + 4, + 4, + 2, + 2, + 1, + 3, + 0, + 1, + 5, + 2, + 0, + 3, + 2, + 2, + 0, + 1, + 0, + 5, + 0, + 2, + 2, + 2, + 2, + 0, + 1, + 3, + 0, + 2, + 3, + 0, + 4, + 4, + 3, + 4, + 3, + 2, + 3, + 0, + 5, + 2, + 2, + 2, + 2, + 1, + 2, + 2, + 3, + 3, + 3, + 2 + ], + "weighted_loads": [ + 0.2604915723204613, + 0.112172931432724, + 0.02230938710272312, + 0.34543173387646675, + 0.1773848757147789, + 0.10577540472149849, + 0.08117788285017014, + 0.10817452892661095, + 0.29914896935224533, + 0.3019981384277344, + 0.06699474900960922, + 0.2674674950540066, + 0.11907985433936119, + 0.08388537913560867, + 0.2730711102485657, + 0.3213573321700096, + 0.22569267451763153, + 0.23545818030834198, + 0.03518213331699371, + 0.30976320058107376, + 0.0, + 0.03813562169671059, + 0.546175342053175, + 0.18310316652059555, + 0.0, + 0.2158976048231125, + 0.26561712846159935, + 0.07828015834093094, + 0.0, + 0.06591667979955673, + 0.0, + 0.3527654893696308, + 0.0, + 0.07121548056602478, + 0.09244045987725258, + 0.1020607240498066, + 0.06291513703763485, + 0.0, + 0.09030507504940033, + 0.1502343900501728, + 0.0, + 0.1537166703492403, + 0.3106575012207031, + 0.0, + 0.32879840582609177, + 0.3095115050673485, + 0.25312769412994385, + 0.1715774815529585, + 0.49063771218061447, + 0.17756403237581253, + 0.3155680187046528, + 0.0, + 0.5533752515912056, + 0.2161589302122593, + 0.07669276371598244, + 0.08039810881018639, + 0.19474675506353378, + 0.04034746438264847, + 0.43658988177776337, + 0.11553231999278069, + 0.16861766949295998, + 0.26425620540976524, + 0.07746928930282593, + 0.13817299157381058 + ], + "unique_experts": 55, + "load_cv": 0.603671466656769, + "normalized_load_entropy": 0.9430243249753925, + "max_load_share": 0.036231884057971016 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "9b8ee15f6417635b95d9ec06875ed8649832969219153c10d09ada44a6ea77bd", + "route_weight_sha256": "c6750c82edca7a8e7d1874bd667ed8fec8f01415b71f0c5b6d50a6b8c5678151", + "loads": [ + 4, + 12, + 1, + 6, + 3, + 2, + 2, + 3, + 8, + 3, + 4, + 3, + 2, + 2, + 8, + 5, + 2, + 2, + 1, + 7, + 2, + 10, + 5, + 2, + 3, + 3, + 2, + 4, + 3, + 1, + 0, + 5, + 0, + 3, + 7, + 16, + 2, + 0, + 5, + 3, + 0, + 2, + 9, + 0, + 4, + 4, + 7, + 9, + 5, + 2, + 4, + 6, + 5, + 2, + 2, + 2, + 2, + 8, + 10, + 7, + 16, + 5, + 9, + 12 + ], + "weighted_loads": [ + 0.5555873736739159, + 1.0617040507495403, + 0.02230938710272312, + 1.1027925051748753, + 0.1773848757147789, + 0.10577540472149849, + 0.08117788285017014, + 0.15502094104886055, + 0.5844758488237858, + 0.3019981384277344, + 0.1920621655881405, + 0.2674674950540066, + 0.11907985433936119, + 0.10965337976813316, + 0.44982496835291386, + 0.36799221113324165, + 0.22569267451763153, + 0.23545818030834198, + 0.03518213331699371, + 1.101596973836422, + 0.24312760680913925, + 0.9110273979604244, + 0.546175342053175, + 0.18310316652059555, + 0.1255759745836258, + 0.2158976048231125, + 0.26561712846159935, + 0.3658084124326706, + 0.2576146125793457, + 0.06591667979955673, + 0.0, + 0.3527654893696308, + 0.0, + 0.1195804812014103, + 0.31612684205174446, + 2.244860759936273, + 0.06291513703763485, + 0.0, + 0.2544459905475378, + 0.1502343900501728, + 0.0, + 0.1537166703492403, + 0.8915380574762821, + 0.0, + 0.32879840582609177, + 0.3095115050673485, + 0.36907880939543247, + 0.46918814815580845, + 0.5424901433289051, + 0.17756403237581253, + 0.33311888575553894, + 0.5276691429316998, + 0.5533752515912056, + 0.2161589302122593, + 0.07669276371598244, + 0.08039810881018639, + 0.19474675506353378, + 0.3965182490646839, + 0.801529161632061, + 0.2972422707825899, + 1.130379625596106, + 0.3500126115977764, + 0.7101660165935755, + 0.598026379942894 + ], + "unique_experts": 59, + "load_cv": 0.7983393257333286, + "normalized_load_entropy": 0.9266121555524266, + "max_load_share": 0.05555555555555555 + } + }, + "s1_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "11134b7ed767a9e3fb25ac2b33a4c033042bba786620fc6b335b71cabebba560", + "route_weight_sha256": "0fc99372e3efb357869187bf222ebfc9e65526fef66709a325424c10f73c7d46", + "loads": [ + 3, + 3, + 1, + 4, + 3, + 2, + 2, + 2, + 3, + 3, + 1, + 3, + 2, + 1, + 4, + 4, + 2, + 2, + 1, + 3, + 0, + 1, + 6, + 2, + 0, + 3, + 2, + 1, + 0, + 1, + 0, + 5, + 0, + 2, + 2, + 2, + 1, + 0, + 1, + 4, + 0, + 2, + 3, + 1, + 4, + 3, + 3, + 4, + 3, + 2, + 3, + 0, + 5, + 2, + 3, + 2, + 1, + 0, + 2, + 3, + 2, + 3, + 2, + 3 + ], + "weighted_loads": [ + 0.2684966176748276, + 0.15158767998218536, + 0.025498196482658386, + 0.36739446967840195, + 0.17972147837281227, + 0.09994253516197205, + 0.08642219379544258, + 0.10330541804432869, + 0.31663987785577774, + 0.2909991033375263, + 0.06944619864225388, + 0.28384293615818024, + 0.12757675349712372, + 0.08801738172769547, + 0.2770630791783333, + 0.34288761019706726, + 0.23311986774206161, + 0.23889057338237762, + 0.034298352897167206, + 0.31208645924925804, + 0.0, + 0.034940969198942184, + 0.6195862777531147, + 0.18423466384410858, + 0.0, + 0.2011527568101883, + 0.25681615248322487, + 0.03991835191845894, + 0.0, + 0.06998766958713531, + 0.0, + 0.35167666524648666, + 0.0, + 0.07628795504570007, + 0.0914759524166584, + 0.09928324073553085, + 0.032565295696258545, + 0.0, + 0.09781448543071747, + 0.17887594923377037, + 0.0, + 0.15259645506739616, + 0.3041841350495815, + 0.0262610986828804, + 0.32417987287044525, + 0.26238757371902466, + 0.2556503042578697, + 0.1597989983856678, + 0.5083587653934956, + 0.16389186680316925, + 0.3308879993855953, + 0.0, + 0.5391260981559753, + 0.21038946136832237, + 0.11109056323766708, + 0.08919835463166237, + 0.1581258922815323, + 0.0, + 0.4168556332588196, + 0.15212231129407883, + 0.11714053153991699, + 0.2675721235573292, + 0.04877716861665249, + 0.1583552360534668 + ], + "unique_experts": 55, + "load_cv": 0.636197219352115, + "normalized_load_entropy": 0.9389060767456617, + "max_load_share": 0.043478260869565216 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "794c9322635ad42ab55bbb771e8be47b83d343ff8316d9f91ed0110848cb7aa3", + "route_weight_sha256": "8ff34a10fa1097e1d9e9ee402935253d37a7d39285d76a8bc38b3359b957abc0", + "loads": [ + 8, + 14, + 2, + 7, + 5, + 3, + 2, + 5, + 14, + 4, + 8, + 3, + 2, + 3, + 12, + 6, + 5, + 2, + 1, + 9, + 2, + 12, + 7, + 2, + 5, + 4, + 2, + 4, + 5, + 1, + 1, + 7, + 0, + 3, + 11, + 18, + 1, + 1, + 8, + 7, + 0, + 2, + 12, + 2, + 7, + 3, + 11, + 12, + 6, + 3, + 5, + 8, + 6, + 5, + 3, + 2, + 5, + 7, + 4, + 14, + 15, + 8, + 13, + 15 + ], + "weighted_loads": [ + 1.0583205670118332, + 1.1571524441242218, + 0.05097036063671112, + 1.1590506434440613, + 0.23280546069145203, + 0.24085797369480133, + 0.08642219379544258, + 0.2138924039900303, + 1.15774348936975, + 0.4080926142632961, + 0.37393074110150337, + 0.28384293615818024, + 0.12757675349712372, + 0.13910049758851528, + 0.7043026592582464, + 0.41024598851799965, + 0.330108642578125, + 0.23889057338237762, + 0.034298352897167206, + 1.1116270329803228, + 0.23303192108869553, + 0.9582917261868715, + 0.6581346653401852, + 0.18423466384410858, + 0.22872857749462128, + 0.2513396479189396, + 0.25681615248322487, + 0.7243892587721348, + 0.2792350947856903, + 0.06998766958713531, + 0.033937420696020126, + 0.394616449251771, + 0.0, + 0.11561158671975136, + 0.4600244741886854, + 1.9696470191702247, + 0.032565295696258545, + 0.041833169758319855, + 0.35336892679333687, + 0.533491488546133, + 0.0, + 0.15259645506739616, + 1.3548590056598186, + 0.20790594071149826, + 0.9746036380529404, + 0.26238757371902466, + 0.8933353032916784, + 0.5851354598999023, + 0.6015215627849102, + 0.20686718821525574, + 0.3754458501935005, + 0.85847332701087, + 0.7147023230791092, + 0.39361502043902874, + 0.11109056323766708, + 0.08919835463166237, + 0.4113391526043415, + 0.2953181453049183, + 0.5277303270995617, + 0.6610180549323559, + 0.9192686388269067, + 0.6306515671312809, + 1.0396134313195944, + 0.9823023360222578 + ], + "unique_experts": 62, + "load_cv": 0.7276770498572075, + "normalized_load_entropy": 0.9362113804743045, + "max_load_share": 0.046875 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "ordered_topk_exact_tokens": 19, + "set_exact_tokens": 20, + "mean_set_jaccard": 0.9627329192546583, + "mean_token_weighted_tv": 0.009779704532221607, + "aggregate_load_tv": 0.02173913043478261 + }, + "system_bos": { + "tokens": 23, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 13, + "mean_set_jaccard": 0.875776397515528, + "mean_token_weighted_tv": 0.02518971207673135, + "aggregate_load_tv": 0.05797101449275362 + }, + "system_x": { + "tokens": 23, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.9503105590062112, + "mean_token_weighted_tv": 0.01828793695439463, + "aggregate_load_tv": 0.02898550724637681 + }, + "system_period": { + "tokens": 23, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.9161490683229815, + "mean_token_weighted_tv": 0.022270528397158436, + "aggregate_load_tv": 0.050724637681159424 + }, + "bos_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.9130434782608695, + "mean_token_weighted_tv": 0.026835248765090237, + "aggregate_load_tv": 0.036231884057971016 + }, + "bos_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8788819875776398, + "mean_token_weighted_tv": 0.03303666165827409, + "aggregate_load_tv": 0.06521739130434782 + }, + "x_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8881987577639753, + "mean_token_weighted_tv": 0.029447243305975975, + "aggregate_load_tv": 0.06521739130434784 + }, + "x_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.8913043478260869, + "mean_token_weighted_tv": 0.03379916067680587, + "aggregate_load_tv": 0.05797101449275363 + }, + "period_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.9006211180124224, + "mean_token_weighted_tv": 0.02853485423585643, + "aggregate_load_tv": 0.057971014492753624 + }, + "period_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.8944099378881987, + "mean_token_weighted_tv": 0.03408830693882445, + "aggregate_load_tv": 0.05797101449275362 + } + } + }, + "layer_03": { + "layer": 3, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "5ed5f5338ad1bf262bcd2792bd24a82104ca9d614e36406dea64af3fb71014f8", + "route_weight_sha256": "d1b2e57d039d74cc0b4e8fd1b31240bc3a62fb2a4ae85941fd9d5b5737982126", + "loads": [ + 1, + 4, + 2, + 3, + 1, + 0, + 2, + 0, + 2, + 3, + 2, + 2, + 5, + 1, + 4, + 4, + 2, + 4, + 0, + 1, + 2, + 2, + 3, + 0, + 2, + 3, + 1, + 3, + 1, + 0, + 2, + 0, + 1, + 6, + 1, + 1, + 1, + 2, + 3, + 2, + 0, + 2, + 5, + 3, + 1, + 2, + 0, + 0, + 1, + 2, + 9, + 3, + 0, + 3, + 2, + 3, + 0, + 3, + 4, + 1, + 6, + 4, + 4, + 1 + ], + "weighted_loads": [ + 0.0429801419377327, + 0.2184106819331646, + 0.12048136815428734, + 0.18088864907622337, + 0.17515484988689423, + 0.0, + 0.25161097943782806, + 0.0, + 0.2334124594926834, + 0.2641893997788429, + 0.18749515525996685, + 0.10363629460334778, + 0.3893388994038105, + 0.060613151639699936, + 0.5210277400910854, + 0.13206272013485432, + 0.12247015908360481, + 0.6975597813725471, + 0.0, + 0.033137161284685135, + 0.11367158591747284, + 0.2127067670226097, + 0.19805283099412918, + 0.0, + 0.12290110252797604, + 0.28631511330604553, + 0.07854710519313812, + 0.26569193974137306, + 0.16691841185092926, + 0.0, + 0.11689378321170807, + 0.0, + 0.10794408619403839, + 0.5729026757180691, + 0.08293183892965317, + 0.16476811468601227, + 0.040365416556596756, + 0.1721622794866562, + 0.20072123408317566, + 0.1393415480852127, + 0.0, + 0.39777157083153725, + 0.15126712806522846, + 0.3151017725467682, + 0.09932086616754532, + 0.24679197371006012, + 0.0, + 0.0, + 0.06175079941749573, + 0.17253369092941284, + 0.8913676477968693, + 0.8832870870828629, + 0.0, + 0.18977287039160728, + 0.07515184581279755, + 0.27674055099487305, + 0.0, + 0.09937079809606075, + 0.191336365416646, + 0.05387301743030548, + 0.34556006640195847, + 0.26119815185666084, + 0.43805187568068504, + 0.0499546118080616 + ], + "unique_experts": 53, + "load_cv": 0.8083527401382227, + "normalized_load_entropy": 0.9153435465471992, + "max_load_share": 0.06521739130434782 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "b7dc515274052bd1cbdbd8c1dac094883e36d2f7f40117fab7dd2552e7269718", + "route_weight_sha256": "2cd60ac6de577db66b9388b599e4570f0d02d444a567e2b114e93db24e1ca4a1", + "loads": [ + 10, + 4, + 2, + 14, + 3, + 3, + 2, + 8, + 2, + 9, + 3, + 3, + 7, + 6, + 10, + 4, + 2, + 4, + 0, + 1, + 4, + 5, + 8, + 1, + 2, + 5, + 1, + 10, + 1, + 3, + 3, + 0, + 1, + 6, + 10, + 1, + 1, + 2, + 3, + 2, + 0, + 3, + 14, + 3, + 1, + 2, + 17, + 0, + 9, + 12, + 9, + 3, + 1, + 3, + 6, + 3, + 0, + 4, + 4, + 1, + 13, + 4, + 8, + 2 + ], + "weighted_loads": [ + 1.2911956831812859, + 0.2184106819331646, + 0.12048136815428734, + 0.8181101568043232, + 0.2038179711671546, + 0.13117358461022377, + 0.25161097943782806, + 1.287053395062685, + 0.2334124594926834, + 0.5521806554170325, + 0.2229848261922598, + 0.10451576643390581, + 0.4013555512065068, + 0.4341549016535282, + 0.9190147817134857, + 0.13206272013485432, + 0.12247015908360481, + 0.6975597813725471, + 0.0, + 0.033137161284685135, + 0.18689117953181267, + 0.5028949603438377, + 0.6042224280536175, + 0.027490869164466858, + 0.12290110252797604, + 0.29995283723110333, + 0.07854710519313812, + 0.5283980742096901, + 0.16691841185092926, + 0.1579284369945526, + 0.16322101652622223, + 0.0, + 0.10794408619403839, + 0.5729026757180691, + 1.1155645996332169, + 0.16476811468601227, + 0.040365416556596756, + 0.1721622794866562, + 0.20072123408317566, + 0.1393415480852127, + 0.0, + 0.4091206770390272, + 0.6950659994035959, + 0.3151017725467682, + 0.09932086616754532, + 0.24679197371006012, + 2.136458847671747, + 0.0, + 0.993369322270155, + 0.7902400232851505, + 0.8913676477968693, + 0.8832870870828629, + 0.014660544693470001, + 0.18977287039160728, + 1.9086988866329193, + 0.27674055099487305, + 0.0, + 0.1121341185644269, + 0.191336365416646, + 0.05387301743030548, + 0.8727998025715351, + 0.26119815185666084, + 0.8800302930176258, + 0.08817411586642265 + ], + "unique_experts": 59, + "load_cv": 0.8810417515085391, + "normalized_load_entropy": 0.9113405605760261, + "max_load_share": 0.059027777777777776 + } + }, + "s1_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "c5b52adb69d989cbcabc2893f8114b6a31e2cff06272ba632ef22573f12b8bb7", + "route_weight_sha256": "9889ef9915f33ad02705ef385c2c9cf2e1a4675d8f7e351182c1cacd7f5139db", + "loads": [ + 2, + 4, + 2, + 3, + 1, + 0, + 2, + 0, + 2, + 3, + 2, + 1, + 5, + 1, + 3, + 4, + 2, + 4, + 0, + 1, + 2, + 2, + 3, + 0, + 2, + 3, + 2, + 3, + 1, + 0, + 2, + 0, + 1, + 6, + 1, + 1, + 1, + 2, + 3, + 2, + 0, + 2, + 5, + 3, + 1, + 2, + 0, + 0, + 1, + 2, + 9, + 3, + 0, + 3, + 2, + 3, + 0, + 3, + 4, + 1, + 6, + 4, + 4, + 1 + ], + "weighted_loads": [ + 0.07886578142642975, + 0.21619725041091442, + 0.11664914712309837, + 0.1724209189414978, + 0.17234063148498535, + 0.0, + 0.2530919834971428, + 0.0, + 0.23537295684218407, + 0.2581056281924248, + 0.19323183596134186, + 0.06668918579816818, + 0.4019290376454592, + 0.05983447656035423, + 0.4691408947110176, + 0.13185937702655792, + 0.12216070666909218, + 0.6984855942428112, + 0.0, + 0.03333389759063721, + 0.11347018927335739, + 0.19911178201436996, + 0.2003060281276703, + 0.0, + 0.12510284967720509, + 0.28575489670038223, + 0.11700648814439774, + 0.2631530500948429, + 0.170160710811615, + 0.0, + 0.11443669348955154, + 0.0, + 0.10878255218267441, + 0.5793986767530441, + 0.0858190506696701, + 0.16503924131393433, + 0.03957487642765045, + 0.17622102051973343, + 0.20672247558832169, + 0.14238321781158447, + 0.0, + 0.3963048383593559, + 0.1506640613079071, + 0.31861061602830887, + 0.10005873441696167, + 0.2505365237593651, + 0.0, + 0.0, + 0.06355809420347214, + 0.17551273852586746, + 0.8709901683032513, + 0.8946201205253601, + 0.0, + 0.19354763068258762, + 0.07808973640203476, + 0.27460744976997375, + 0.0, + 0.09850768186151981, + 0.19323763065040112, + 0.05108674615621567, + 0.3340751454234123, + 0.2625400759279728, + 0.4461860954761505, + 0.049890484660863876 + ], + "unique_experts": 53, + "load_cv": 0.7999947489850773, + "normalized_load_entropy": 0.9168473056025573, + "max_load_share": 0.06521739130434782 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "9ab7e820e071af4c364762e7c4e8583974218b9512ef8a45d09b84b6831e6508", + "route_weight_sha256": "6f98b5f19a07837bc6286de92abbfb11a600d2ac4691551ef9d77949b197621e", + "loads": [ + 15, + 6, + 2, + 15, + 2, + 6, + 2, + 11, + 2, + 12, + 5, + 2, + 9, + 7, + 11, + 5, + 4, + 4, + 1, + 1, + 4, + 8, + 13, + 0, + 4, + 6, + 2, + 6, + 1, + 3, + 3, + 0, + 1, + 8, + 9, + 1, + 1, + 7, + 3, + 3, + 1, + 3, + 19, + 5, + 1, + 5, + 21, + 0, + 11, + 12, + 9, + 9, + 4, + 8, + 6, + 7, + 0, + 4, + 11, + 2, + 19, + 5, + 10, + 7 + ], + "weighted_loads": [ + 1.7039705589413643, + 0.2911515887826681, + 0.11664914712309837, + 0.8759419322013855, + 0.1728810240747407, + 0.27322080731391907, + 0.2530919834971428, + 1.3636435475200415, + 0.23537295684218407, + 0.7254888304742053, + 0.27804810367524624, + 0.06756865762872621, + 0.49088077212218195, + 0.49359212443232536, + 1.0439066588878632, + 0.1806229129433632, + 0.3369911275804043, + 0.6984855942428112, + 0.055603545159101486, + 0.03333389759063721, + 0.18003998696804047, + 0.5718583017587662, + 1.1168928556144238, + 0.0, + 0.2289062086492777, + 0.34262633934849873, + 0.11700648814439774, + 0.3596584666520357, + 0.170160710811615, + 0.14709337055683136, + 0.15603045746684074, + 0.0, + 0.10878255218267441, + 0.6520991437137127, + 0.9990269057452679, + 0.16503924131393433, + 0.03957487642765045, + 0.5923189874738455, + 0.20672247558832169, + 0.19249608367681503, + 0.07550901174545288, + 0.4051028834655881, + 0.8177351653575897, + 0.3929542787373066, + 0.10005873441696167, + 0.49185630306601524, + 2.7013246156275272, + 0.0, + 1.299548901617527, + 0.6446978338062763, + 0.8709901683032513, + 1.674403753131628, + 0.2108014151453972, + 0.9111193139106035, + 1.9798849634826183, + 0.5070367902517319, + 0.0, + 0.10753546096384525, + 0.6809561606496572, + 0.08157637901604176, + 1.1499040964990854, + 0.31258969008922577, + 0.91550088301301, + 0.4592835120856762 + ], + "unique_experts": 60, + "load_cv": 0.8186201126828542, + "normalized_load_entropy": 0.9201758375534849, + "max_load_share": 0.0546875 + } + }, + "s0_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "8df6ba7374bfc2899cde9c066b381ec730ce372510e9bbe569daa90d6af236f7", + "route_weight_sha256": "314e9570bf5c7086a146ac068a16a70d2773ac361ce3d5a13537b3a5315fe236", + "loads": [ + 1, + 4, + 2, + 3, + 1, + 0, + 2, + 0, + 2, + 3, + 2, + 1, + 5, + 1, + 4, + 2, + 2, + 4, + 0, + 1, + 2, + 2, + 3, + 0, + 2, + 3, + 2, + 3, + 1, + 0, + 2, + 0, + 1, + 7, + 1, + 1, + 0, + 2, + 3, + 2, + 1, + 2, + 5, + 3, + 1, + 2, + 0, + 0, + 1, + 2, + 9, + 3, + 0, + 4, + 1, + 3, + 0, + 3, + 4, + 2, + 6, + 4, + 4, + 1 + ], + "weighted_loads": [ + 0.048829223960638046, + 0.21758643724024296, + 0.11113202199339867, + 0.17193898186087608, + 0.18620899319648743, + 0.0, + 0.2498985007405281, + 0.0, + 0.25165750458836555, + 0.24855481833219528, + 0.15820522978901863, + 0.06636666506528854, + 0.4135899245738983, + 0.05774175375699997, + 0.4928666539490223, + 0.06198582798242569, + 0.12386685609817505, + 0.6815209686756134, + 0.0, + 0.029313839972019196, + 0.12309586629271507, + 0.22238093614578247, + 0.1990341581404209, + 0.0, + 0.12220711633563042, + 0.28373827785253525, + 0.11345600709319115, + 0.2354077510535717, + 0.12974435091018677, + 0.0, + 0.10301915928721428, + 0.0, + 0.1081804558634758, + 0.6335062123835087, + 0.07533655315637589, + 0.15350422263145447, + 0.0, + 0.19714386761188507, + 0.2028234861791134, + 0.14015549793839455, + 0.02952900528907776, + 0.3782578743994236, + 0.13567722961306572, + 0.28921278938651085, + 0.09326852113008499, + 0.2481832504272461, + 0.0, + 0.0, + 0.05767316743731499, + 0.19695180654525757, + 0.99367256462574, + 0.8800281435251236, + 0.0, + 0.2344456948339939, + 0.039394788444042206, + 0.2588508054614067, + 0.0, + 0.1007913127541542, + 0.1995769925415516, + 0.09736663475632668, + 0.350827157497406, + 0.2684900090098381, + 0.3861851580440998, + 0.06809380650520325 + ], + "unique_experts": 53, + "load_cv": 0.8248146826163592, + "normalized_load_entropy": 0.9136686408130051, + "max_load_share": 0.06521739130434782 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "5d03b57f9cdede56c931af00afb6a37a6fda29b805a7d5fceadf6596f4360030", + "route_weight_sha256": "c66dd8810e366c517cc1cb6f3d3dc637a9e743221178d8d94453af4507223ff8", + "loads": [ + 11, + 4, + 2, + 14, + 3, + 4, + 2, + 8, + 2, + 8, + 4, + 2, + 6, + 5, + 10, + 2, + 2, + 4, + 1, + 1, + 4, + 5, + 9, + 1, + 2, + 4, + 2, + 10, + 1, + 4, + 3, + 0, + 1, + 7, + 9, + 1, + 0, + 2, + 3, + 2, + 1, + 2, + 15, + 3, + 1, + 2, + 16, + 0, + 11, + 12, + 9, + 3, + 0, + 4, + 4, + 3, + 0, + 3, + 4, + 2, + 13, + 4, + 8, + 3 + ], + "weighted_loads": [ + 1.4387139230966568, + 0.21758643724024296, + 0.11113202199339867, + 0.8024248592555523, + 0.2148721144767478, + 0.17409922927618027, + 0.2498985007405281, + 1.1246728524565697, + 0.25165750458836555, + 0.5143398904474452, + 0.226031094789505, + 0.06724613689584658, + 0.4140686836326495, + 0.4174170643091202, + 0.9068471342325211, + 0.06198582798242569, + 0.12386685609817505, + 0.6815209686756134, + 0.03706119582056999, + 0.029313839972019196, + 0.19486499950289726, + 0.51488196849823, + 0.622145488858223, + 0.027490869164466858, + 0.12220711633563042, + 0.2842701855697669, + 0.11345600709319115, + 0.49811388552188873, + 0.12974435091018677, + 0.2088557966053486, + 0.14934639260172844, + 0.0, + 0.1081804558634758, + 0.6335062123835087, + 1.0717872753739357, + 0.15350422263145447, + 0.0, + 0.19714386761188507, + 0.2028234861791134, + 0.14015549793839455, + 0.02952900528907776, + 0.3782578743994236, + 0.7999696396291256, + 0.28921278938651085, + 0.09326852113008499, + 0.2481832504272461, + 2.2859128415584564, + 0.0, + 1.099479891359806, + 0.8146581389009953, + 0.99367256462574, + 0.8800281435251236, + 0.0, + 0.2344456948339939, + 1.1710948944091797, + 0.2588508054614067, + 0.0, + 0.1007913127541542, + 0.1995769925415516, + 0.09736663475632668, + 0.867504745721817, + 0.2684900090098381, + 0.8288560546934605, + 0.1378963328897953 + ], + "unique_experts": 59, + "load_cv": 0.8845379626717033, + "normalized_load_entropy": 0.9116626928566794, + "max_load_share": 0.05555555555555555 + } + }, + "s1_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "457691bfa021e2163f06659bcef909a09cd44cf17fc74ee3337ca4ea395a6c75", + "route_weight_sha256": "7dfad82db9ad8f5386b142d6185f4ca8a7164af6bd745d6cd88f5fa6b5fe183b", + "loads": [ + 1, + 4, + 2, + 3, + 1, + 0, + 2, + 0, + 2, + 3, + 2, + 2, + 5, + 1, + 4, + 2, + 2, + 4, + 0, + 1, + 2, + 2, + 3, + 0, + 2, + 3, + 1, + 3, + 1, + 0, + 2, + 0, + 1, + 7, + 1, + 1, + 0, + 2, + 3, + 2, + 1, + 2, + 4, + 3, + 1, + 2, + 0, + 0, + 1, + 2, + 9, + 3, + 0, + 4, + 1, + 3, + 0, + 4, + 4, + 2, + 6, + 4, + 4, + 1 + ], + "weighted_loads": [ + 0.047110848128795624, + 0.21196075715124607, + 0.11930378898978233, + 0.16325366869568825, + 0.16878929734230042, + 0.0, + 0.24944716691970825, + 0.0, + 0.2623964473605156, + 0.2234180010855198, + 0.1751239076256752, + 0.10753558576107025, + 0.4211930185556412, + 0.061314620077610016, + 0.5067408457398415, + 0.06808461248874664, + 0.1146896630525589, + 0.6886995770037174, + 0.0, + 0.029345709830522537, + 0.11345157027244568, + 0.2173137068748474, + 0.19137006998062134, + 0.0, + 0.12891490943729877, + 0.29302146285772324, + 0.07439496368169785, + 0.23968089744448662, + 0.14343374967575073, + 0.0, + 0.10576973482966423, + 0.0, + 0.11551520973443985, + 0.6618442721664906, + 0.0879816859960556, + 0.15713883936405182, + 0.0, + 0.19363020360469818, + 0.19955911114811897, + 0.1349293850362301, + 0.030559878796339035, + 0.37058475241065025, + 0.11163918487727642, + 0.2842973470687866, + 0.09220820665359497, + 0.2574509382247925, + 0.0, + 0.0, + 0.05732368305325508, + 0.18914110213518143, + 0.9201973676681519, + 0.872320368885994, + 0.0, + 0.25179383531212807, + 0.03829282894730568, + 0.25262341648340225, + 0.0, + 0.12354623153805733, + 0.21202106401324272, + 0.08797036111354828, + 0.37140030413866043, + 0.25751320645213127, + 0.41158416494727135, + 0.07183279097080231 + ], + "unique_experts": 53, + "load_cv": 0.8207301527401605, + "normalized_load_entropy": 0.9141088919924739, + "max_load_share": 0.06521739130434782 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "5658999f5b9b6650e7138b240dc8bec47a7f71a045816a4538c325e952913381", + "route_weight_sha256": "22306f66841400d38500df0da0cec16c63bbf171b3eb1be0186cdc2d16f77a58", + "loads": [ + 15, + 6, + 2, + 15, + 2, + 5, + 2, + 11, + 2, + 12, + 5, + 3, + 8, + 7, + 12, + 3, + 4, + 4, + 2, + 1, + 4, + 8, + 14, + 0, + 4, + 5, + 1, + 6, + 1, + 3, + 3, + 0, + 1, + 9, + 9, + 1, + 0, + 7, + 3, + 3, + 2, + 2, + 19, + 5, + 1, + 6, + 21, + 0, + 12, + 12, + 9, + 9, + 3, + 9, + 4, + 7, + 0, + 4, + 11, + 3, + 19, + 5, + 10, + 8 + ], + "weighted_loads": [ + 1.7777982763946056, + 0.28691509552299976, + 0.11930378898978233, + 0.8629853576421738, + 0.16932968993205577, + 0.23798801004886627, + 0.24944716691970825, + 1.2667946945875883, + 0.2623964473605156, + 0.6979630180867389, + 0.2599401753395796, + 0.10841505759162828, + 0.5022405643248931, + 0.5291409157216549, + 1.0970614030957222, + 0.11684814840555191, + 0.329520083963871, + 0.6886995770037174, + 0.09217758104205132, + 0.029345709830522537, + 0.18422342091798782, + 0.5893449038267136, + 1.1077940333634615, + 0.0, + 0.23271826840937138, + 0.34107375849271193, + 0.07439496368169785, + 0.3361863140016794, + 0.14343374967575073, + 0.15548640862107277, + 0.14736349880695343, + 0.0, + 0.11551520973443985, + 0.7345447391271591, + 1.0092880800366402, + 0.15713883936405182, + 0.0, + 0.6097281705588102, + 0.19955911114811897, + 0.18504225090146065, + 0.10606889054179192, + 0.37058475241065025, + 0.924599913880229, + 0.35864100977778435, + 0.09220820665359497, + 0.5437922142446041, + 2.659901689738035, + 0.0, + 1.3230928741395473, + 0.6583261974155903, + 0.9201973676681519, + 1.6521040014922619, + 0.20043475553393364, + 0.969365518540144, + 1.150683969259262, + 0.48505275696516037, + 0.0, + 0.12354623153805733, + 0.6997395940124989, + 0.11845999397337437, + 1.1829572189599276, + 0.30756282061338425, + 0.9133927039802074, + 0.5131870619952679 + ], + "unique_experts": 59, + "load_cv": 0.8338540040078959, + "normalized_load_entropy": 0.917028350558401, + "max_load_share": 0.0546875 + } + }, + "s0_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "e92ac3485904c2e43650973b27d7b71f25408161a26dacaa252e2819b7872799", + "route_weight_sha256": "e6f5d04829820203a52b3ccb47ec6f586e7bf8a634883c4d29cf2edcb2c1c6db", + "loads": [ + 1, + 4, + 2, + 3, + 1, + 0, + 2, + 0, + 2, + 3, + 2, + 1, + 5, + 1, + 4, + 2, + 2, + 4, + 0, + 1, + 2, + 2, + 3, + 0, + 2, + 3, + 2, + 3, + 1, + 0, + 2, + 0, + 1, + 6, + 1, + 1, + 0, + 2, + 3, + 2, + 1, + 2, + 5, + 3, + 1, + 2, + 1, + 0, + 1, + 2, + 9, + 3, + 0, + 3, + 2, + 3, + 0, + 3, + 4, + 2, + 6, + 4, + 4, + 1 + ], + "weighted_loads": [ + 0.04608495533466339, + 0.20453167334198952, + 0.11011180281639099, + 0.16628000885248184, + 0.1811864823102951, + 0.0, + 0.2490464374423027, + 0.0, + 0.2483898475766182, + 0.2267780378460884, + 0.17225553467869759, + 0.0669260025024414, + 0.40712533704936504, + 0.05807338282465935, + 0.4950129874050617, + 0.06367158703505993, + 0.11984904855489731, + 0.6637399196624756, + 0.0, + 0.03172110766172409, + 0.11658810079097748, + 0.21834298968315125, + 0.2015283890068531, + 0.0, + 0.11962704546749592, + 0.2871824689209461, + 0.11255114153027534, + 0.24893846735358238, + 0.1492621898651123, + 0.0, + 0.10398586466908455, + 0.0, + 0.10937925428152084, + 0.5862921848893166, + 0.07469965517520905, + 0.1612623780965805, + 0.0, + 0.18866539001464844, + 0.20286645740270615, + 0.13818123936653137, + 0.028319882228970528, + 0.37237702682614326, + 0.13728160224854946, + 0.2965839169919491, + 0.09659111499786377, + 0.25107528269290924, + 0.033167872577905655, + 0.0, + 0.05661551281809807, + 0.1845979541540146, + 0.894358430057764, + 0.8657691031694412, + 0.0, + 0.21262655034661293, + 0.07117551937699318, + 0.2665022537112236, + 0.0, + 0.09254148229956627, + 0.20912517607212067, + 0.09100992232561111, + 0.35314954817295074, + 0.27161138877272606, + 0.397556871175766, + 0.06541825085878372 + ], + "unique_experts": 54, + "load_cv": 0.7915485104012391, + "normalized_load_entropy": 0.9201744644215955, + "max_load_share": 0.06521739130434782 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "ad129e2c0054f659f34cc1592141815b1dfffde049c31ea7a1cc76e3d7d6299d", + "route_weight_sha256": "32879ace525ce39a933564abcd156f74b46fd79678e7685f59602c030cbe17b4", + "loads": [ + 9, + 4, + 2, + 15, + 4, + 2, + 2, + 9, + 2, + 8, + 3, + 2, + 6, + 5, + 10, + 2, + 2, + 4, + 0, + 1, + 3, + 5, + 8, + 1, + 2, + 4, + 3, + 11, + 1, + 4, + 3, + 0, + 1, + 6, + 10, + 1, + 1, + 2, + 3, + 2, + 1, + 2, + 15, + 3, + 1, + 3, + 18, + 0, + 9, + 13, + 9, + 3, + 0, + 3, + 5, + 3, + 0, + 3, + 4, + 2, + 14, + 4, + 8, + 2 + ], + "weighted_loads": [ + 1.13217256590724, + 0.20453167334198952, + 0.11011180281639099, + 0.9358366169035435, + 0.24103519704658538, + 0.09182603657245636, + 0.2490464374423027, + 1.1539049819111824, + 0.2483898475766182, + 0.5149308667751029, + 0.20774520561099052, + 0.06780547433299944, + 0.4076040961081162, + 0.4112183302640915, + 0.8724489994347095, + 0.06367158703505993, + 0.11984904855489731, + 0.6637399196624756, + 0.0, + 0.03172110766172409, + 0.14340675994753838, + 0.5185577049851418, + 0.5920887775719166, + 0.027490869164466858, + 0.11962704546749592, + 0.2877143766381778, + 0.15494617447257042, + 0.5588178187608719, + 0.1492621898651123, + 0.21350229158997536, + 0.1503130979835987, + 0.0, + 0.10937925428152084, + 0.5862921848893166, + 1.1733934953808784, + 0.1612623780965805, + 0.047898076474666595, + 0.18866539001464844, + 0.20286645740270615, + 0.13818123936653137, + 0.028319882228970528, + 0.37237702682614326, + 0.7599840294569731, + 0.2965839169919491, + 0.09659111499786377, + 0.2954893410205841, + 2.3792038932442665, + 0.0, + 0.9369817562401295, + 0.8655144162476063, + 0.894358430057764, + 0.8657691031694412, + 0.0, + 0.21262655034661293, + 1.1811777465045452, + 0.2665022537112236, + 0.0, + 0.09254148229956627, + 0.20912517607212067, + 0.09100992232561111, + 0.9342782981693745, + 0.27161138877272606, + 0.8409131765365601, + 0.10363775491714478 + ], + "unique_experts": 59, + "load_cv": 0.9204467514322717, + "normalized_load_entropy": 0.9076982080822251, + "max_load_share": 0.0625 + } + }, + "s1_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "cb8d1f379dfecbf42cee8cf65cf1e4200fcf9a811b5246f427bbf5b456f697a7", + "route_weight_sha256": "c498d765e57d934f98585c1ef2fd520f3e51fec56a34e57232bb45d9bed5878c", + "loads": [ + 1, + 4, + 2, + 3, + 1, + 0, + 2, + 0, + 2, + 3, + 2, + 1, + 4, + 1, + 4, + 2, + 2, + 4, + 0, + 1, + 2, + 2, + 3, + 0, + 2, + 3, + 2, + 4, + 1, + 0, + 2, + 0, + 1, + 6, + 1, + 1, + 1, + 2, + 3, + 2, + 1, + 2, + 4, + 3, + 1, + 2, + 0, + 0, + 1, + 2, + 9, + 3, + 0, + 4, + 2, + 3, + 0, + 2, + 4, + 2, + 7, + 4, + 4, + 1 + ], + "weighted_loads": [ + 0.043625157326459885, + 0.19547190889716148, + 0.11291304975748062, + 0.1570872962474823, + 0.15537188947200775, + 0.0, + 0.25440288335084915, + 0.0, + 0.2602160982787609, + 0.2056705541908741, + 0.17395276576280594, + 0.06835165619850159, + 0.4008864611387253, + 0.0611407533288002, + 0.4948843829333782, + 0.06931553408503532, + 0.11125896871089935, + 0.6763302385807037, + 0.0, + 0.030645830556750298, + 0.10672396421432495, + 0.21197470277547836, + 0.19636821746826172, + 0.0, + 0.13117276318371296, + 0.2950846590101719, + 0.11037355661392212, + 0.2625286988914013, + 0.15624092519283295, + 0.0, + 0.10704001039266586, + 0.0, + 0.11224767565727234, + 0.6108961254358292, + 0.08032448589801788, + 0.1599474847316742, + 0.01778540574014187, + 0.1917048990726471, + 0.19621801748871803, + 0.1334955245256424, + 0.029978640377521515, + 0.3746444843709469, + 0.11834678053855896, + 0.2922057844698429, + 0.09238789230585098, + 0.25641873478889465, + 0.0, + 0.0, + 0.0523306243121624, + 0.179876446723938, + 0.8736370094120502, + 0.8532138168811798, + 0.0, + 0.25169120356440544, + 0.0698920339345932, + 0.2552868276834488, + 0.0, + 0.08376786671578884, + 0.21648088470101357, + 0.0862499363720417, + 0.4055228289216757, + 0.2571147158741951, + 0.40768619254231453, + 0.06931284070014954 + ], + "unique_experts": 54, + "load_cv": 0.7999947489850773, + "normalized_load_entropy": 0.919380061046339, + "max_load_share": 0.06521739130434782 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "6d706f627878670df51b4b5c38a0c238a471bcac54991695b3a7c8c2d633a6b6", + "route_weight_sha256": "27efa12b5da497031f3edebb083abb0cc7e7c0d1488ecf28587df4debdbc82fa", + "loads": [ + 13, + 6, + 2, + 16, + 3, + 4, + 2, + 11, + 2, + 12, + 5, + 2, + 7, + 7, + 12, + 3, + 4, + 4, + 1, + 1, + 3, + 8, + 13, + 1, + 4, + 5, + 3, + 8, + 1, + 4, + 3, + 0, + 1, + 8, + 9, + 1, + 2, + 7, + 3, + 3, + 2, + 2, + 19, + 5, + 1, + 6, + 20, + 0, + 11, + 13, + 9, + 9, + 3, + 9, + 5, + 7, + 0, + 2, + 11, + 3, + 20, + 5, + 10, + 8 + ], + "weighted_loads": [ + 1.4835738688707352, + 0.2704262472689152, + 0.11291304975748062, + 1.005096696317196, + 0.18662465561646968, + 0.1885167695581913, + 0.25440288335084915, + 1.2612234484404325, + 0.2602160982787609, + 0.698643829789944, + 0.2587690334767103, + 0.06923112802905962, + 0.48193400690797716, + 0.5186911411583424, + 1.0614608973264694, + 0.11807907000184059, + 0.32608938962221146, + 0.6763302385807037, + 0.055603545159101486, + 0.030645830556750298, + 0.13906044140458107, + 0.5898501947522163, + 1.088090181350708, + 0.020437562838196754, + 0.23497612215578556, + 0.3431369546451606, + 0.14966728165745735, + 0.4035350587219, + 0.15624092519283295, + 0.19582020118832588, + 0.14863377436995506, + 0.0, + 0.11224767565727234, + 0.6835965923964977, + 1.0456255674362183, + 0.1599474847316742, + 0.058597663417458534, + 0.6078028660267591, + 0.19621801748871803, + 0.18360839039087296, + 0.1054876521229744, + 0.3746444843709469, + 0.8459118902683258, + 0.36654944717884064, + 0.09238789230585098, + 0.5588425323367119, + 2.6372518949210644, + 0.0, + 1.1820175014436245, + 0.7077394612133503, + 0.8736370094120502, + 1.6329974494874477, + 0.20043475553393364, + 0.9692628867924213, + 1.1616356559097767, + 0.4877161681652069, + 0.0, + 0.08376786671578884, + 0.7041994147002697, + 0.11673956923186779, + 1.2655834555625916, + 0.3071643300354481, + 0.8943408243358135, + 0.5104940719902515 + ], + "unique_experts": 61, + "load_cv": 0.8186201126828542, + "normalized_load_entropy": 0.9221858084060076, + "max_load_share": 0.052083333333333336 + } + }, + "s0_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "ec09dc981710b5dbf853db5628c85c8ba58170bf0f618902ae752fd3d8785bf2", + "route_weight_sha256": "72edef60680f104af419eadd757d9b4483478a2c5cd2ee3fc6332892ae3f9bf3", + "loads": [ + 1, + 4, + 2, + 3, + 1, + 0, + 2, + 0, + 2, + 3, + 2, + 1, + 5, + 1, + 4, + 3, + 2, + 4, + 0, + 1, + 2, + 2, + 3, + 0, + 2, + 3, + 2, + 3, + 1, + 0, + 2, + 0, + 1, + 6, + 1, + 1, + 0, + 2, + 3, + 2, + 0, + 2, + 5, + 3, + 1, + 2, + 1, + 0, + 1, + 2, + 9, + 3, + 0, + 3, + 2, + 3, + 0, + 3, + 4, + 2, + 6, + 4, + 4, + 1 + ], + "weighted_loads": [ + 0.04459873214364052, + 0.2090183012187481, + 0.11193850636482239, + 0.16330201923847198, + 0.17917205393314362, + 0.0, + 0.2511792629957199, + 0.0, + 0.24402792751789093, + 0.21547355130314827, + 0.1742583066225052, + 0.06721183657646179, + 0.41582166589796543, + 0.056927964091300964, + 0.4927295185625553, + 0.09509365819394588, + 0.12106535583734512, + 0.6631361804902554, + 0.0, + 0.03161703795194626, + 0.11387493833899498, + 0.22183386981487274, + 0.1969062238931656, + 0.0, + 0.12367703206837177, + 0.2846776619553566, + 0.1118026077747345, + 0.25138603895902634, + 0.1519053429365158, + 0.0, + 0.10490046069025993, + 0.0, + 0.10953692346811295, + 0.5902697220444679, + 0.07459558546543121, + 0.15964427590370178, + 0.0, + 0.1816849410533905, + 0.20332352258265018, + 0.13707086816430092, + 0.0, + 0.38171301782131195, + 0.14037396758794785, + 0.29748012870550156, + 0.09752186387777328, + 0.25512127578258514, + 0.035356517881155014, + 0.0, + 0.053517308086156845, + 0.18519899249076843, + 0.8860281705856323, + 0.8506623804569244, + 0.0, + 0.208345428109169, + 0.07109475880861282, + 0.26779045164585114, + 0.0, + 0.09269161708652973, + 0.20348112657666206, + 0.09011260420084, + 0.35091834887862206, + 0.2741483077406883, + 0.4028245247900486, + 0.06349720805883408 + ], + "unique_experts": 53, + "load_cv": 0.7999947489850773, + "normalized_load_entropy": 0.9168473056025573, + "max_load_share": 0.06521739130434782 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "28117e939653bbf7b8fa59a0375229b3127ffdcf788f739801fd8d27093782fb", + "route_weight_sha256": "cb2dbcaf4130f2464dad6a565805455b574cd27bf5478126e332b1df7335e35c", + "loads": [ + 8, + 5, + 2, + 15, + 4, + 2, + 2, + 9, + 2, + 9, + 3, + 2, + 6, + 5, + 10, + 3, + 2, + 4, + 0, + 1, + 3, + 5, + 9, + 1, + 2, + 4, + 2, + 10, + 1, + 4, + 3, + 0, + 1, + 6, + 9, + 1, + 0, + 2, + 3, + 2, + 0, + 2, + 15, + 3, + 1, + 5, + 18, + 0, + 9, + 12, + 9, + 3, + 0, + 3, + 5, + 3, + 0, + 3, + 5, + 2, + 14, + 4, + 8, + 2 + ], + "weighted_loads": [ + 1.0255194827914238, + 0.3554934822022915, + 0.11193850636482239, + 0.867021519690752, + 0.24659894045908004, + 0.09487484022974968, + 0.2511792629957199, + 1.2132552936673164, + 0.24402792751789093, + 0.6587328278692439, + 0.20974797755479813, + 0.06809130840701982, + 0.4163004249567166, + 0.40649817138910294, + 0.9947898909449577, + 0.09509365819394588, + 0.12106535583734512, + 0.6631361804902554, + 0.0, + 0.03161703795194626, + 0.14069359749555588, + 0.5168099850416183, + 0.6433944553136826, + 0.027490869164466858, + 0.12367703206837177, + 0.28520956967258826, + 0.1118026077747345, + 0.5140921734273434, + 0.1519053429365158, + 0.20415866747498512, + 0.1512276940047741, + 0.0, + 0.10953692346811295, + 0.5902697220444679, + 1.071046307682991, + 0.15964427590370178, + 0.0, + 0.1816849410533905, + 0.20332352258265018, + 0.13707086816430092, + 0.0, + 0.38171301782131195, + 0.7665973603725433, + 0.29748012870550156, + 0.09752186387777328, + 0.38579633086919785, + 2.345935668796301, + 0.0, + 0.91468570753932, + 0.8029053248465061, + 0.8860281705856323, + 0.8506623804569244, + 0.0, + 0.208345428109169, + 1.179287038743496, + 0.26779045164585114, + 0.0, + 0.09269161708652973, + 0.2427828423678875, + 0.09011260420084, + 0.8900406621396542, + 0.2741483077406883, + 0.8631425835192204, + 0.10171671211719513 + ], + "unique_experts": 57, + "load_cv": 0.9137157890776959, + "normalized_load_entropy": 0.9053875774022957, + "max_load_share": 0.0625 + } + }, + "s1_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "35edfbb901ee7967ef76af82b82a2e481e5c612d1a3885bac6647a87a1a5eba5", + "route_weight_sha256": "ae12d6187ac449efdf4ceee7c1423c1e0257e4ece4946d16113910137028c733", + "loads": [ + 1, + 4, + 2, + 3, + 1, + 0, + 2, + 0, + 2, + 3, + 2, + 2, + 4, + 1, + 4, + 2, + 2, + 4, + 0, + 1, + 2, + 2, + 3, + 0, + 2, + 3, + 1, + 4, + 1, + 0, + 2, + 0, + 1, + 6, + 1, + 1, + 1, + 2, + 3, + 2, + 1, + 2, + 3, + 3, + 1, + 2, + 0, + 0, + 1, + 2, + 9, + 3, + 0, + 4, + 2, + 3, + 0, + 3, + 4, + 2, + 7, + 4, + 4, + 1 + ], + "weighted_loads": [ + 0.04335303232073784, + 0.19675366394221783, + 0.118648000061512, + 0.15359333902597427, + 0.1531352698802948, + 0.0, + 0.25541558861732483, + 0.0, + 0.257409181445837, + 0.20263619720935822, + 0.17698846384882927, + 0.10738567635416985, + 0.4057258442044258, + 0.06003102287650108, + 0.505977176129818, + 0.06836777552962303, + 0.11142253875732422, + 0.6737852394580841, + 0.0, + 0.030643008649349213, + 0.1054646447300911, + 0.21807056665420532, + 0.18886468186974525, + 0.0, + 0.13291521929204464, + 0.2942767105996609, + 0.07327007502317429, + 0.2662176117300987, + 0.15816746652126312, + 0.0, + 0.10630164667963982, + 0.0, + 0.11353924125432968, + 0.612960334867239, + 0.08011927455663681, + 0.1592189222574234, + 0.017871327698230743, + 0.18252790719270706, + 0.19805162400007248, + 0.13349780812859535, + 0.030992573127150536, + 0.3757742680609226, + 0.09712009690701962, + 0.29323364421725273, + 0.09318674355745316, + 0.2582954466342926, + 0.0, + 0.0, + 0.05110358074307442, + 0.18183310329914093, + 0.8714505564421415, + 0.8556997030973434, + 0.0, + 0.2548014856874943, + 0.06786134839057922, + 0.2589135095477104, + 0.0, + 0.10540984570980072, + 0.21372169256210327, + 0.08611638471484184, + 0.4037952944636345, + 0.25884008407592773, + 0.4131249040365219, + 0.07162970304489136 + ], + "unique_experts": 54, + "load_cv": 0.7957828355531795, + "normalized_load_entropy": 0.9199721202198572, + "max_load_share": 0.06521739130434782 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "12c6d49ab1f7a1cd1119b44144f4fd0db52977f356df2177eaf231bd8144a06d", + "route_weight_sha256": "8359e85f319a78196cbbc4725e2433e8179e68edff82e7430a842f5dcfdbfa64", + "loads": [ + 11, + 7, + 2, + 16, + 3, + 5, + 2, + 12, + 2, + 13, + 5, + 3, + 7, + 7, + 12, + 3, + 4, + 4, + 1, + 1, + 3, + 8, + 14, + 0, + 4, + 5, + 1, + 7, + 1, + 4, + 3, + 0, + 1, + 8, + 8, + 1, + 1, + 7, + 3, + 3, + 2, + 2, + 19, + 5, + 1, + 8, + 20, + 0, + 10, + 12, + 9, + 9, + 3, + 9, + 5, + 7, + 0, + 3, + 12, + 3, + 20, + 5, + 10, + 8 + ], + "weighted_loads": [ + 1.3444232158362865, + 0.38024370186030865, + 0.118648000061512, + 0.9119724482297897, + 0.190569615107961, + 0.2099942397326231, + 0.25541558861732483, + 1.3424590211361647, + 0.257409181445837, + 0.8198805899592116, + 0.26180473156273365, + 0.10826514818472788, + 0.4867733899736777, + 0.5094282850623131, + 1.151821419596672, + 0.1171313114464283, + 0.3262529596686363, + 0.6737852394580841, + 0.055603545159101486, + 0.030643008649349213, + 0.1378011219203472, + 0.5841305553913116, + 1.1493416875600815, + 0.0, + 0.23671857826411724, + 0.34232900623464957, + 0.07327007502317429, + 0.3627230282872915, + 0.15816746652126312, + 0.1881173774600029, + 0.14789541065692902, + 0.0, + 0.11353924125432968, + 0.6856608018279076, + 0.9541096910834312, + 0.1592189222574234, + 0.017871327698230743, + 0.5986258741468191, + 0.19805162400007248, + 0.1836106739938259, + 0.10650158487260342, + 0.3757742680609226, + 0.9155287835747004, + 0.36757730692625046, + 0.09318674355745316, + 0.6597929447889328, + 2.64070837572217, + 0.0, + 1.1333229131996632, + 0.6510181985795498, + 0.8714505564421415, + 1.6354833357036114, + 0.20043475553393364, + 0.9723731689155102, + 1.151754468679428, + 0.49134285002946854, + 0.0, + 0.10540984570980072, + 0.7495614886283875, + 0.11660601757466793, + 1.2236413788050413, + 0.3088896982371807, + 0.910985179245472, + 0.5132009349763393 + ], + "unique_experts": 60, + "load_cv": 0.8239049972202163, + "normalized_load_entropy": 0.9194249388499871, + "max_load_share": 0.052083333333333336 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "ordered_topk_exact_tokens": 19, + "set_exact_tokens": 21, + "mean_set_jaccard": 0.9751552795031057, + "mean_token_weighted_tv": 0.00892229224352733, + "aggregate_load_tv": 0.014492753623188408 + }, + "system_bos": { + "tokens": 23, + "ordered_topk_exact_tokens": 17, + "set_exact_tokens": 21, + "mean_set_jaccard": 0.9751552795031057, + "mean_token_weighted_tv": 0.015939375466626625, + "aggregate_load_tv": 0.014492753623188408 + }, + "system_x": { + "tokens": 23, + "ordered_topk_exact_tokens": 17, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.9503105590062112, + "mean_token_weighted_tv": 0.01656754622640817, + "aggregate_load_tv": 0.028985507246376815 + }, + "system_period": { + "tokens": 23, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.9161490683229815, + "mean_token_weighted_tv": 0.019884281994208046, + "aggregate_load_tv": 0.04347826086956522 + }, + "bos_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 18, + "mean_set_jaccard": 0.9378881987577641, + "mean_token_weighted_tv": 0.027019149137903816, + "aggregate_load_tv": 0.036231884057971016 + }, + "bos_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.9161490683229815, + "mean_token_weighted_tv": 0.029545194550376873, + "aggregate_load_tv": 0.05072463768115943 + }, + "x_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.9503105590062112, + "mean_token_weighted_tv": 0.021600540281961792, + "aggregate_load_tv": 0.028985507246376812 + }, + "x_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.9161490683229815, + "mean_token_weighted_tv": 0.028512848662617413, + "aggregate_load_tv": 0.04347826086956522 + }, + "period_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 20, + "mean_set_jaccard": 0.9627329192546583, + "mean_token_weighted_tv": 0.020922374992590885, + "aggregate_load_tv": 0.021739130434782608 + }, + "period_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.8944099378881988, + "mean_token_weighted_tv": 0.031008266762870808, + "aggregate_load_tv": 0.050724637681159424 + } + } + }, + "layer_04": { + "layer": 4, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "a44d2aebd9e5ab732af96af32101aaa1f25c2cba88ef8b6aea0410d80398c67c", + "route_weight_sha256": "73494be7de40404aab919f3efad4cd2391ff642fbc7cbb4513b4e105d307c4b2", + "loads": [ + 1, + 7, + 1, + 2, + 2, + 0, + 0, + 0, + 2, + 3, + 2, + 2, + 4, + 0, + 3, + 0, + 3, + 1, + 0, + 0, + 5, + 2, + 3, + 1, + 2, + 0, + 0, + 3, + 4, + 10, + 2, + 2, + 5, + 4, + 2, + 0, + 2, + 3, + 1, + 3, + 1, + 1, + 2, + 7, + 1, + 2, + 2, + 3, + 0, + 7, + 4, + 1, + 3, + 1, + 3, + 2, + 3, + 2, + 1, + 1, + 0, + 3, + 1, + 0 + ], + "weighted_loads": [ + 0.04719240218400955, + 0.3519810140132904, + 0.06765640527009964, + 0.09237397834658623, + 0.1356218047440052, + 0.0, + 0.0, + 0.0, + 0.11631355807185173, + 0.1946941390633583, + 0.6969427764415741, + 0.12533428892493248, + 0.24236472323536873, + 0.0, + 0.16817419230937958, + 0.0, + 0.23253116011619568, + 0.07171980291604996, + 0.0, + 0.0, + 0.3752657175064087, + 0.20153455436229706, + 0.19204549118876457, + 0.09554300457239151, + 0.17535775154829025, + 0.0, + 0.0, + 0.2607201784849167, + 0.4023209884762764, + 1.024672668427229, + 0.12752831354737282, + 0.26676879823207855, + 0.28079619631171227, + 0.3759835585951805, + 0.14938969165086746, + 0.0, + 0.11133471876382828, + 0.28886665403842926, + 0.052255529910326004, + 0.33801665902137756, + 0.03968482092022896, + 0.030639996752142906, + 0.16591722704470158, + 0.6172391697764397, + 0.04609401896595955, + 0.07001053169369698, + 0.07818441279232502, + 0.3249947503209114, + 0.0, + 0.6243631392717361, + 0.27959679812192917, + 0.04894391819834709, + 0.31995241343975067, + 0.06012348458170891, + 0.2190585769712925, + 0.1329914554953575, + 0.19008509069681168, + 0.10401902347803116, + 0.03805793076753616, + 0.0366666279733181, + 0.0, + 0.2070525698363781, + 0.04926333203911781, + 0.0 + ], + "unique_experts": 51, + "load_cv": 0.9137333487622095, + "normalized_load_entropy": 0.8991844320633682, + "max_load_share": 0.07246376811594203 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "f5179ac028de35d0eeda40aa9e07844c9ee8ed418e68e6cd6d4bb53395529377", + "route_weight_sha256": "c342988b44df24585eee28804662200fe93d725dea6857fafd7b30407af55bee", + "loads": [ + 1, + 10, + 3, + 6, + 2, + 0, + 1, + 0, + 2, + 3, + 12, + 4, + 4, + 14, + 5, + 3, + 3, + 1, + 4, + 0, + 5, + 4, + 4, + 1, + 2, + 6, + 6, + 4, + 5, + 29, + 2, + 4, + 5, + 6, + 14, + 0, + 2, + 4, + 2, + 3, + 4, + 4, + 10, + 7, + 1, + 4, + 13, + 3, + 1, + 9, + 5, + 1, + 3, + 1, + 3, + 2, + 3, + 2, + 1, + 14, + 4, + 3, + 4, + 0 + ], + "weighted_loads": [ + 0.04719240218400955, + 0.5288001783192158, + 0.1898295059800148, + 0.38287867527105846, + 0.1356218047440052, + 0.0, + 0.05826026201248169, + 0.0, + 0.11631355807185173, + 0.1946941390633583, + 1.354424437507987, + 0.15189533215016127, + 0.24236472323536873, + 0.9584155976772308, + 0.21406679786741734, + 0.19463163241744041, + 0.23253116011619568, + 0.07171980291604996, + 0.20822938848868944, + 0.0, + 0.3752657175064087, + 1.2673842459917068, + 0.21805233508348465, + 0.09554300457239151, + 0.17535775154829025, + 0.45764829590916634, + 0.5287207551300526, + 0.2687394265085459, + 0.4502224735915661, + 2.6948965485498775, + 0.12752831354737282, + 0.2976859621703625, + 0.28079619631171227, + 0.4162615640088916, + 1.5102639496617485, + 0.0, + 0.11133471876382828, + 0.32939063385128975, + 1.0490502901375294, + 0.33801665902137756, + 0.1803830936551094, + 0.1969366166740656, + 0.5275979321449995, + 0.6172391697764397, + 0.04609401896595955, + 0.2668343745172024, + 1.2258668560534716, + 0.3249947503209114, + 0.036817941814661026, + 0.6747640799731016, + 0.3262830041348934, + 0.04894391819834709, + 0.31995241343975067, + 0.06012348458170891, + 0.2190585769712925, + 0.1329914554953575, + 0.19008509069681168, + 0.10401902347803116, + 0.03805793076753616, + 0.7921490464359522, + 0.5021769450977445, + 0.2070525698363781, + 0.26310284435749054, + 0.0 + ], + "unique_experts": 59, + "load_cv": 1.0333930687632376, + "normalized_load_entropy": 0.9020643690448619, + "max_load_share": 0.10069444444444445 + } + }, + "s1_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "4fcd1dc7e30bfc7bb4e8d7a4ddb4338dbfaee0531093b3148f31f8a819a2f5cf", + "route_weight_sha256": "a4a320e1f3b9d85f7b05d4fabd97052e524d419c5ff44f09004ae142fbe7eb7a", + "loads": [ + 1, + 8, + 1, + 2, + 2, + 0, + 0, + 0, + 2, + 3, + 2, + 2, + 3, + 0, + 4, + 0, + 3, + 1, + 0, + 0, + 5, + 2, + 3, + 1, + 2, + 0, + 0, + 3, + 4, + 10, + 2, + 2, + 5, + 4, + 2, + 0, + 2, + 3, + 1, + 3, + 1, + 1, + 2, + 7, + 1, + 2, + 1, + 3, + 0, + 7, + 4, + 1, + 3, + 1, + 3, + 2, + 3, + 2, + 1, + 1, + 0, + 3, + 1, + 0 + ], + "weighted_loads": [ + 0.04759281873703003, + 0.40278902277350426, + 0.06618401408195496, + 0.09296925738453865, + 0.13470306247472763, + 0.0, + 0.0, + 0.0, + 0.11594299599528313, + 0.19258737936615944, + 0.6961458623409271, + 0.12457014620304108, + 0.19080257788300514, + 0.0, + 0.19963647425174713, + 0.0, + 0.23898038268089294, + 0.0707489624619484, + 0.0, + 0.0, + 0.36723172292113304, + 0.19687769562005997, + 0.19601276889443398, + 0.09405788779258728, + 0.16676832735538483, + 0.0, + 0.0, + 0.27113600820302963, + 0.40028687566518784, + 1.0299028977751732, + 0.12691688165068626, + 0.2596088945865631, + 0.27314337342977524, + 0.36808159202337265, + 0.1510334350168705, + 0.0, + 0.11671335622668266, + 0.28362544625997543, + 0.05203968659043312, + 0.33141743391752243, + 0.039890460669994354, + 0.030193505808711052, + 0.17089905589818954, + 0.6129005774855614, + 0.0457589365541935, + 0.07245176658034325, + 0.0500720851123333, + 0.33253612369298935, + 0.0, + 0.6147388592362404, + 0.2771894447505474, + 0.050203654915094376, + 0.3227219358086586, + 0.05672488361597061, + 0.21115664020180702, + 0.131441630423069, + 0.18878259882330894, + 0.10237043723464012, + 0.03782976046204567, + 0.03664528951048851, + 0.0, + 0.20352431759238243, + 0.05022060126066208, + 0.0 + ], + "unique_experts": 51, + "load_cv": 0.9355406431021744, + "normalized_load_entropy": 0.8963480606314881, + "max_load_share": 0.07246376811594203 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "38f4f91a690f397012e06e4e1e87aed3f18d785a9376e08a48af62b93abe1937", + "route_weight_sha256": "0b32f6ba5f467e9012c9356c681ef4abd2b8302787e188c1f5bf19fd331514d5", + "loads": [ + 1, + 10, + 4, + 11, + 2, + 0, + 3, + 0, + 2, + 12, + 11, + 4, + 4, + 15, + 7, + 4, + 5, + 3, + 7, + 2, + 6, + 5, + 8, + 2, + 2, + 10, + 9, + 4, + 5, + 33, + 2, + 4, + 5, + 6, + 18, + 0, + 2, + 5, + 4, + 6, + 4, + 7, + 11, + 7, + 2, + 5, + 11, + 7, + 1, + 10, + 6, + 1, + 7, + 5, + 9, + 2, + 8, + 4, + 1, + 15, + 7, + 5, + 5, + 1 + ], + "weighted_loads": [ + 0.04759281873703003, + 0.5539663024246693, + 0.23597798496484756, + 0.8520091998507269, + 0.13470306247472763, + 0.0, + 0.21306375786662102, + 0.0, + 0.11594299599528313, + 1.273623488843441, + 1.2871883809566498, + 0.151046983897686, + 0.2980274669826031, + 1.0191113632172346, + 0.2746143415570259, + 0.2762858457863331, + 0.6032938063144684, + 0.14084193855524063, + 0.5539608031976968, + 0.09061743319034576, + 0.41599032655358315, + 1.2949788495898247, + 0.5450110901147127, + 0.18703141808509827, + 0.16676832735538483, + 0.7314742170274258, + 0.8089523650705814, + 0.27943590842187405, + 0.4477423019707203, + 2.6385384667664766, + 0.12691688165068626, + 0.29017412196844816, + 0.27314337342977524, + 0.40874437987804413, + 1.8759008269989863, + 0.0, + 0.11671335622668266, + 0.36628472059965134, + 1.2409149408340454, + 0.5437068603932858, + 0.19882094860076904, + 0.2805783809890272, + 0.6010938324034214, + 0.6129005774855614, + 0.08357926830649376, + 0.2358817158965394, + 1.2483084350824356, + 0.6700933128595352, + 0.02982325665652752, + 0.7012140229344368, + 0.369433481246233, + 0.050203654915094376, + 0.7616820484399796, + 0.24000690504908562, + 0.7605409137904644, + 0.131441630423069, + 0.6132513470947742, + 0.17639480903744698, + 0.03782976046204567, + 0.8613257855176926, + 0.9801153689622879, + 0.40057482942938805, + 0.3398769982159138, + 0.044050849974155426 + ], + "unique_experts": 61, + "load_cv": 0.8569568250501306, + "normalized_load_entropy": 0.9263663897006127, + "max_load_share": 0.0859375 + } + }, + "s0_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "e370334974a9de7c981be2584588bbdfe1a412966dbaebfb53b07e4bfd1eacb2", + "route_weight_sha256": "394320a84967be3481933ddfb0f64a28814848d09380e5831960cc7a84fa03a7", + "loads": [ + 2, + 8, + 1, + 2, + 2, + 0, + 0, + 0, + 2, + 3, + 2, + 2, + 4, + 0, + 2, + 0, + 3, + 1, + 0, + 0, + 5, + 2, + 3, + 1, + 2, + 0, + 0, + 3, + 4, + 9, + 2, + 2, + 5, + 4, + 2, + 0, + 2, + 3, + 1, + 3, + 1, + 1, + 2, + 7, + 1, + 1, + 2, + 3, + 0, + 7, + 4, + 1, + 3, + 1, + 3, + 2, + 3, + 2, + 1, + 1, + 0, + 3, + 2, + 0 + ], + "weighted_loads": [ + 0.0974215716123581, + 0.41042064875364304, + 0.06413083523511887, + 0.0976121574640274, + 0.13108867779374123, + 0.0, + 0.0, + 0.0, + 0.11659424006938934, + 0.19482681527733803, + 0.7145386040210724, + 0.12350583076477051, + 0.23883889243006706, + 0.0, + 0.12903683632612228, + 0.0, + 0.23373860865831375, + 0.0721893310546875, + 0.0, + 0.0, + 0.38540303334593773, + 0.20958495885133743, + 0.19643324986100197, + 0.08409692347049713, + 0.1643521599471569, + 0.0, + 0.0, + 0.26677660644054413, + 0.39842866361141205, + 0.8917382918298244, + 0.13328571617603302, + 0.2615256756544113, + 0.29281139746308327, + 0.35736410319805145, + 0.13481821864843369, + 0.0, + 0.12175821885466576, + 0.28405874222517014, + 0.05188312754034996, + 0.3323642238974571, + 0.03858323022723198, + 0.031105557456612587, + 0.16952988877892494, + 0.6103828176856041, + 0.053870320320129395, + 0.04227370023727417, + 0.07120626419782639, + 0.3122587502002716, + 0.0, + 0.6114772595465183, + 0.29144133254885674, + 0.054108284413814545, + 0.31444520503282547, + 0.0682254359126091, + 0.2111348658800125, + 0.13288822770118713, + 0.19257331266999245, + 0.09614741057157516, + 0.03665082901716232, + 0.031939223408699036, + 0.0, + 0.2079714834690094, + 0.08695841580629349, + 0.0 + ], + "unique_experts": 51, + "load_cv": 0.9026321518272475, + "normalized_load_entropy": 0.9005084995663387, + "max_load_share": 0.06521739130434782 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "0e05f3aaa504526895d50da78f149a65f58359ea31ebba55e0708a8c8ce109fd", + "route_weight_sha256": "155e4d219919f73947d7994d040ef84b695f29d143bc32545ecf92b4cf4e1253", + "loads": [ + 2, + 11, + 3, + 7, + 2, + 0, + 1, + 0, + 2, + 3, + 12, + 3, + 4, + 14, + 4, + 3, + 3, + 1, + 5, + 0, + 5, + 3, + 4, + 1, + 2, + 6, + 6, + 3, + 5, + 30, + 2, + 3, + 5, + 5, + 14, + 0, + 2, + 5, + 2, + 3, + 4, + 4, + 10, + 7, + 1, + 3, + 13, + 3, + 1, + 8, + 5, + 1, + 3, + 1, + 3, + 2, + 3, + 2, + 1, + 14, + 5, + 3, + 5, + 0 + ], + "weighted_loads": [ + 0.0974215716123581, + 0.5919728465378284, + 0.18630393594503403, + 0.4530323810467962, + 0.13108867779374123, + 0.0, + 0.052698805928230286, + 0.0, + 0.11659424006938934, + 0.19482681527733803, + 1.3720202650874853, + 0.1406135018914938, + 0.23883889243006706, + 0.9647900089621544, + 0.17492944188416004, + 0.18430282548069954, + 0.23373860865831375, + 0.0721893310546875, + 0.3650540517701302, + 0.0, + 0.38540303334593773, + 0.5008101239800453, + 0.2256594691425562, + 0.08409692347049713, + 0.1643521599471569, + 0.46747761219739914, + 0.54206782579422, + 0.26677660644054413, + 0.4441547393798828, + 2.6715344409749378, + 0.13328571617603302, + 0.2798911761492491, + 0.29281139746308327, + 0.382715480402112, + 1.4656857215159107, + 0.0, + 0.12175821885466576, + 0.36615853384137154, + 1.0486778877675533, + 0.3323642238974571, + 0.17928150296211243, + 0.19202804006636143, + 0.5312105938792229, + 0.6103828176856041, + 0.053870320320129395, + 0.31748195737600327, + 1.218888707458973, + 0.3122587502002716, + 0.036817941814661026, + 0.6395120080560446, + 0.338127538561821, + 0.054108284413814545, + 0.31444520503282547, + 0.0682254359126091, + 0.2111348658800125, + 0.13288822770118713, + 0.19257331266999245, + 0.09614741057157516, + 0.03665082901716232, + 0.7888958621770144, + 0.6880604596808553, + 0.2079714834690094, + 0.30841588601469994, + 0.0 + ], + "unique_experts": 59, + "load_cv": 1.0555555555555556, + "normalized_load_entropy": 0.900053174191259, + "max_load_share": 0.10416666666666667 + } + }, + "s1_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "37aea419212ad484553ac3d6e3ac6e9565b41fd65a16efea070bdb3c24c46dc7", + "route_weight_sha256": "d2902c673da5b7e0ebd8a334aaf9f6338f1d9d82bf8356a77bc4ff8d8382d803", + "loads": [ + 3, + 6, + 1, + 2, + 1, + 0, + 0, + 0, + 2, + 3, + 2, + 2, + 4, + 0, + 4, + 0, + 3, + 1, + 0, + 0, + 5, + 2, + 3, + 1, + 2, + 0, + 0, + 3, + 4, + 8, + 2, + 3, + 6, + 4, + 2, + 0, + 2, + 3, + 1, + 3, + 1, + 1, + 2, + 7, + 1, + 1, + 1, + 3, + 0, + 7, + 4, + 1, + 3, + 1, + 3, + 2, + 4, + 2, + 0, + 1, + 0, + 3, + 2, + 0 + ], + "weighted_loads": [ + 0.15237882733345032, + 0.29155396297574043, + 0.06921254843473434, + 0.10078998655080795, + 0.10383691638708115, + 0.0, + 0.0, + 0.0, + 0.12149733677506447, + 0.20412596687674522, + 0.7109067440032959, + 0.12250108271837234, + 0.24377410858869553, + 0.0, + 0.19668728858232498, + 0.0, + 0.23815608769655228, + 0.06909096986055374, + 0.0, + 0.0, + 0.40462280437350273, + 0.22071963548660278, + 0.20008831098675728, + 0.08368530869483948, + 0.16075846180319786, + 0.0, + 0.0, + 0.29224591702222824, + 0.40281992405653, + 0.7283767275512218, + 0.13825634121894836, + 0.3037959672510624, + 0.3329878933727741, + 0.3493862561881542, + 0.12417414039373398, + 0.0, + 0.12605061382055283, + 0.2806846499443054, + 0.05190892517566681, + 0.3454730436205864, + 0.03957776352763176, + 0.03243638575077057, + 0.1767391748726368, + 0.6071968227624893, + 0.05463339015841484, + 0.03978206217288971, + 0.04710700735449791, + 0.32643918693065643, + 0.0, + 0.5946703441441059, + 0.2882967069745064, + 0.05454187095165253, + 0.32306133210659027, + 0.06871718913316727, + 0.21592126041650772, + 0.13966599106788635, + 0.23863929510116577, + 0.09417355433106422, + 0.0, + 0.03058832325041294, + 0.0, + 0.2216186858713627, + 0.09050547704100609, + 0.0 + ], + "unique_experts": 50, + "load_cv": 0.8800097381600154, + "normalized_load_entropy": 0.8985332918086095, + "max_load_share": 0.057971014492753624 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "e6bc73888a0e831f7211592ef246360b469ff2151bc777f85ca42f2acd12d96a", + "route_weight_sha256": "b67c7eed9845ddc324a3fb884c63d4864ea15bfe017d839f50bb608595517672", + "loads": [ + 3, + 8, + 4, + 12, + 1, + 0, + 3, + 0, + 2, + 12, + 11, + 3, + 5, + 15, + 7, + 4, + 5, + 3, + 8, + 2, + 6, + 4, + 8, + 2, + 2, + 10, + 9, + 3, + 5, + 32, + 2, + 4, + 6, + 5, + 18, + 0, + 2, + 6, + 4, + 6, + 4, + 7, + 11, + 7, + 2, + 4, + 12, + 7, + 1, + 9, + 6, + 1, + 7, + 5, + 9, + 2, + 9, + 4, + 0, + 15, + 8, + 5, + 6, + 1 + ], + "weighted_loads": [ + 0.15237882733345032, + 0.4509270079433918, + 0.23900651931762695, + 0.9290671127964742, + 0.10383691638708115, + 0.0, + 0.19479619711637497, + 0.0, + 0.12149733677506447, + 1.2851620763540268, + 1.3019492626190186, + 0.13960875384509563, + 0.35099899768829346, + 1.023770209401846, + 0.27166515588760376, + 0.27783308550715446, + 0.6024695113301277, + 0.13918394595384598, + 0.6982870206702501, + 0.09061743319034576, + 0.45338140800595284, + 0.5527338534593582, + 0.5542302895337343, + 0.17665883898735046, + 0.16075846180319786, + 0.7069974206387997, + 0.8348015807569027, + 0.29224591702222824, + 0.4493975527584553, + 2.2968901600688696, + 0.13825634121894836, + 0.32216146774590015, + 0.3329878933727741, + 0.3747376333922148, + 1.709853231557645, + 0.0, + 0.12605061382055283, + 0.40492432564496994, + 1.240784179419279, + 0.5577624700963497, + 0.19850825145840645, + 0.31804598549206275, + 0.6069339513778687, + 0.6071968227624893, + 0.0924537219107151, + 0.20967601600568742, + 1.2934719622135162, + 0.6639963760972023, + 0.02982325665652752, + 0.6582556571811438, + 0.38054074347019196, + 0.05454187095165253, + 0.7620214447379112, + 0.2519992105662823, + 0.7653055340051651, + 0.13966599106788635, + 0.6631080433726311, + 0.16819792613387108, + 0.0, + 0.8562266994267702, + 1.158733919262886, + 0.4186691977083683, + 0.4009474068880081, + 0.044050849974155426 + ], + "unique_experts": 60, + "load_cv": 0.8508574106942558, + "normalized_load_entropy": 0.9249605699177569, + "max_load_share": 0.08333333333333333 + } + }, + "s0_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "dfb30ccb33ab0bb8e973a7fd549d968b6a254e7f6cb625d39bc44de64d7b443d", + "route_weight_sha256": "a4b7eff797b2515a395d918f1b3e9f561f6acd94d145ef14f71b4cf094ff1e36", + "loads": [ + 1, + 7, + 1, + 2, + 1, + 0, + 0, + 0, + 2, + 3, + 2, + 2, + 4, + 0, + 4, + 0, + 3, + 1, + 0, + 0, + 5, + 2, + 3, + 1, + 2, + 0, + 0, + 3, + 4, + 8, + 2, + 3, + 5, + 4, + 2, + 0, + 2, + 3, + 1, + 3, + 1, + 1, + 2, + 7, + 1, + 2, + 1, + 3, + 1, + 7, + 4, + 1, + 3, + 1, + 3, + 2, + 4, + 2, + 0, + 1, + 0, + 3, + 2, + 0 + ], + "weighted_loads": [ + 0.05551004409790039, + 0.35234009101986885, + 0.07157290726900101, + 0.10639054700732231, + 0.09832371771335602, + 0.0, + 0.0, + 0.0, + 0.11096636205911636, + 0.20194599032402039, + 0.7038522362709045, + 0.12247556447982788, + 0.23068850487470627, + 0.0, + 0.194450993090868, + 0.0, + 0.23866578191518784, + 0.06967779994010925, + 0.0, + 0.0, + 0.38558774068951607, + 0.2003457471728325, + 0.2107752002775669, + 0.08026368916034698, + 0.15823106467723846, + 0.0, + 0.0, + 0.2589212507009506, + 0.3840104006230831, + 0.7430770136415958, + 0.13775310665369034, + 0.3193676769733429, + 0.29009315371513367, + 0.37763451412320137, + 0.13668668270111084, + 0.0, + 0.1204734593629837, + 0.2846301645040512, + 0.052566200494766235, + 0.32638413459062576, + 0.037806883454322815, + 0.03398086875677109, + 0.17607847228646278, + 0.6123117096722126, + 0.056493207812309265, + 0.07839104533195496, + 0.046008408069610596, + 0.3114975392818451, + 0.037441156804561615, + 0.5935354977846146, + 0.28393468260765076, + 0.052740678191185, + 0.3308097943663597, + 0.059030480682849884, + 0.2085258662700653, + 0.13167691603302956, + 0.22781124711036682, + 0.09859290719032288, + 0.0, + 0.03872532770037651, + 0.0, + 0.21182888373732567, + 0.08922073245048523, + 0.0 + ], + "unique_experts": 51, + "load_cv": 0.8761825507357589, + "normalized_load_entropy": 0.9015686934776641, + "max_load_share": 0.057971014492753624 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "43bf02028bd49fda8e5a9d5219c32f86c00f53ba8f732a85dbf60cc6c8bfd1f6", + "route_weight_sha256": "9bbde17650d131c7c3d2dfddc827617fb9722ceccc414aa74422e3a1b44431a0", + "loads": [ + 1, + 11, + 4, + 6, + 1, + 0, + 0, + 0, + 2, + 3, + 13, + 3, + 4, + 12, + 6, + 3, + 3, + 1, + 4, + 0, + 5, + 3, + 5, + 1, + 2, + 6, + 6, + 3, + 5, + 27, + 2, + 4, + 5, + 5, + 12, + 0, + 2, + 5, + 2, + 3, + 5, + 4, + 11, + 7, + 1, + 4, + 14, + 3, + 3, + 8, + 5, + 1, + 3, + 1, + 3, + 2, + 4, + 2, + 0, + 15, + 4, + 3, + 5, + 0 + ], + "weighted_loads": [ + 0.05551004409790039, + 0.5733206756412983, + 0.22485487908124924, + 0.43879754762747325, + 0.09832371771335602, + 0.0, + 0.0, + 0.0, + 0.11096636205911636, + 0.20194599032402039, + 1.5780360903590918, + 0.13958323560655117, + 0.23068850487470627, + 0.9037983603775501, + 0.24034359864890575, + 0.19858058542013168, + 0.23866578191518784, + 0.06967779994010925, + 0.23215031196014024, + 0.0, + 0.38558774068951607, + 0.4915709123015404, + 0.2850443869829178, + 0.08026368916034698, + 0.15823106467723846, + 0.3989921994507313, + 0.5829502455890179, + 0.2589212507009506, + 0.4335225261747837, + 2.1795678730413783, + 0.13775310665369034, + 0.33773317746818066, + 0.29009315371513367, + 0.4029858913272619, + 1.22577061879565, + 0.0, + 0.1204734593629837, + 0.3644688352942467, + 1.0493609607219696, + 0.32638413459062576, + 0.23519394546747208, + 0.19952942058444023, + 0.5734486132860184, + 0.6123117096722126, + 0.056493207812309265, + 0.3296588584780693, + 1.4395142123103142, + 0.3114975392818451, + 0.11753573268651962, + 0.6215702462941408, + 0.330620888620615, + 0.052740678191185, + 0.3308097943663597, + 0.059030480682849884, + 0.2085258662700653, + 0.13167691603302956, + 0.22781124711036682, + 0.09859290719032288, + 0.0, + 0.8880197536200285, + 0.47673497069627047, + 0.21182888373732567, + 0.3020658306777477, + 0.0 + ], + "unique_experts": 57, + "load_cv": 1.0038506110884806, + "normalized_load_entropy": 0.9011353005111526, + "max_load_share": 0.09375 + } + }, + "s1_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "0825a8de8f5af8f51789d6bfa872f90b39daf9374d3a6527e5161aec37037ce1", + "route_weight_sha256": "3bb35324e45696b56939917bda0b0f890248ce11d6e52d80d897ec2f64b3fbed", + "loads": [ + 1, + 5, + 1, + 2, + 1, + 0, + 0, + 0, + 2, + 4, + 2, + 2, + 4, + 0, + 4, + 0, + 3, + 1, + 0, + 0, + 5, + 2, + 3, + 1, + 2, + 0, + 0, + 3, + 4, + 6, + 2, + 3, + 7, + 4, + 2, + 0, + 2, + 3, + 1, + 3, + 1, + 1, + 2, + 7, + 1, + 2, + 1, + 3, + 0, + 7, + 4, + 1, + 3, + 1, + 3, + 2, + 4, + 2, + 2, + 1, + 0, + 3, + 2, + 0 + ], + "weighted_loads": [ + 0.05778686702251434, + 0.25099508464336395, + 0.07435084879398346, + 0.11166810989379883, + 0.10156268626451492, + 0.0, + 0.0, + 0.0, + 0.1204235628247261, + 0.24982408434152603, + 0.6836375296115875, + 0.11798486858606339, + 0.24954036250710487, + 0.0, + 0.1976459138095379, + 0.0, + 0.2305486537516117, + 0.06944844871759415, + 0.0, + 0.0, + 0.398459542542696, + 0.21857833117246628, + 0.21212876588106155, + 0.08680719882249832, + 0.15913458913564682, + 0.0, + 0.0, + 0.295761302113533, + 0.39104916527867317, + 0.5582773312926292, + 0.14615296199917793, + 0.30755727365612984, + 0.38542234897613525, + 0.36234889551997185, + 0.12305154651403427, + 0.0, + 0.12527942657470703, + 0.2840333357453346, + 0.05251862108707428, + 0.3361991420388222, + 0.039029810577631, + 0.035661887377500534, + 0.1752561815083027, + 0.5979659594595432, + 0.060859229415655136, + 0.06894997134804726, + 0.04668392986059189, + 0.318128801882267, + 0.0, + 0.5523891113698483, + 0.2918938957154751, + 0.0534292533993721, + 0.34755975008010864, + 0.06650018692016602, + 0.2271844707429409, + 0.13981400430202484, + 0.24512970075011253, + 0.0938090905547142, + 0.0733984000980854, + 0.03634393960237503, + 0.0, + 0.22115030884742737, + 0.08854954317212105, + 0.0 + ], + "unique_experts": 51, + "load_cv": 0.8409544392118266, + "normalized_load_entropy": 0.9054879114702203, + "max_load_share": 0.050724637681159424 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "2430143b15d672095982ab6a74b56683fd8d51e5b6d42f6839a5c2871c2ce1ae", + "route_weight_sha256": "499e7f9e4ea6fb2f4e5ec95a0d4e82e5c11a33919913d051fe9e48ea00a17170", + "loads": [ + 1, + 8, + 5, + 11, + 1, + 0, + 2, + 0, + 2, + 13, + 12, + 3, + 5, + 14, + 7, + 4, + 5, + 3, + 7, + 2, + 6, + 4, + 8, + 2, + 2, + 10, + 9, + 3, + 5, + 28, + 2, + 4, + 7, + 5, + 17, + 0, + 2, + 6, + 5, + 6, + 5, + 7, + 12, + 7, + 2, + 5, + 13, + 7, + 1, + 9, + 6, + 1, + 7, + 5, + 9, + 2, + 9, + 4, + 2, + 16, + 7, + 5, + 6, + 1 + ], + "weighted_loads": [ + 0.05778686702251434, + 0.4536394886672497, + 0.27860698103904724, + 0.9220603670109995, + 0.10156268626451492, + 0.0, + 0.14489996060729027, + 0.0, + 0.1204235628247261, + 1.3308601938188076, + 1.462903380393982, + 0.13509253971278667, + 0.3567652516067028, + 0.9946330189704895, + 0.27262378111481667, + 0.28039465099573135, + 0.5948620773851871, + 0.13954142481088638, + 0.5640239000786096, + 0.09061743319034576, + 0.4472181461751461, + 0.5505925491452217, + 0.5771382711827755, + 0.1797807291150093, + 0.15913458913564682, + 0.6532495468854904, + 0.8696936741471291, + 0.295761302113533, + 0.43864527344703674, + 1.8000713493674994, + 0.14615296199917793, + 0.3259227741509676, + 0.38542234897613525, + 0.3877002727240324, + 1.4757589210057631, + 0.0, + 0.12527942657470703, + 0.4089312180876732, + 1.293038520962, + 0.5484885685145855, + 0.2515283152461052, + 0.3556144615431549, + 0.6458462364971638, + 0.5979659594595432, + 0.0986795611679554, + 0.19791217136662453, + 1.5006085075438023, + 0.6556859910488129, + 0.02982325665652752, + 0.6159744244068861, + 0.38413793221116066, + 0.0534292533993721, + 0.7865198627114296, + 0.24978220835328102, + 0.7765687443315983, + 0.13981400430202484, + 0.6695984490215778, + 0.16783346235752106, + 0.0733984000980854, + 0.9566501043736935, + 0.9250461608171463, + 0.418200820684433, + 0.386210348457098, + 0.044050849974155426 + ], + "unique_experts": 61, + "load_cv": 0.800932616114212, + "normalized_load_entropy": 0.9298902542737616, + "max_load_share": 0.07291666666666667 + } + }, + "s0_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "49a157badf0948a8144f299ad531c33cbda15d2641dcb3d3623ceaa7b637c614", + "route_weight_sha256": "fa572f6a5f546cf4234fc23457e355457247866d32a2beb56b35f426688a09ba", + "loads": [ + 1, + 7, + 1, + 2, + 1, + 0, + 0, + 0, + 2, + 3, + 2, + 2, + 4, + 0, + 4, + 0, + 3, + 1, + 0, + 0, + 5, + 2, + 3, + 1, + 2, + 0, + 0, + 3, + 4, + 9, + 2, + 3, + 6, + 4, + 2, + 0, + 2, + 3, + 1, + 3, + 1, + 1, + 2, + 7, + 1, + 2, + 1, + 3, + 0, + 7, + 3, + 1, + 3, + 1, + 3, + 2, + 4, + 2, + 1, + 1, + 0, + 3, + 1, + 0 + ], + "weighted_loads": [ + 0.05497113987803459, + 0.35248370096087456, + 0.07264629751443863, + 0.10993574187159538, + 0.10229946672916412, + 0.0, + 0.0, + 0.0, + 0.11419222876429558, + 0.20309798419475555, + 0.6937833428382874, + 0.12027255445718765, + 0.23807939514517784, + 0.0, + 0.19426214881241322, + 0.0, + 0.23939615115523338, + 0.07074454426765442, + 0.0, + 0.0, + 0.3884243480861187, + 0.19827315211296082, + 0.21309875324368477, + 0.08250892162322998, + 0.16004468500614166, + 0.0, + 0.0, + 0.26494646072387695, + 0.3933822996914387, + 0.7724182941019535, + 0.13994699344038963, + 0.3139948919415474, + 0.3317559100687504, + 0.38078464940190315, + 0.1406465508043766, + 0.0, + 0.1169981062412262, + 0.2889232113957405, + 0.05448358878493309, + 0.3392852917313576, + 0.03787798807024956, + 0.03423551842570305, + 0.17772478610277176, + 0.6062421686947346, + 0.05620429664850235, + 0.07902119308710098, + 0.04629484564065933, + 0.3136427700519562, + 0.0, + 0.604566503316164, + 0.23633484914898872, + 0.051785342395305634, + 0.34270693361759186, + 0.05927403271198273, + 0.21927352622151375, + 0.1333758383989334, + 0.23113683611154556, + 0.09797407314181328, + 0.037217628210783005, + 0.03878433257341385, + 0.0, + 0.21757714077830315, + 0.04726120084524155, + 0.0 + ], + "unique_experts": 51, + "load_cv": 0.9100479963153392, + "normalized_load_entropy": 0.8977228637131299, + "max_load_share": 0.06521739130434782 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "ad52fa8a6034a10d6d6bef4a71e7b246cea50360292bd4a8d80b145051d894cb", + "route_weight_sha256": "a346d812fb738af5da2ce4f6dfd4fc26bc3fdc0aba2f79f44577822c43210d0f", + "loads": [ + 1, + 11, + 3, + 6, + 1, + 0, + 0, + 0, + 2, + 3, + 12, + 3, + 4, + 12, + 6, + 3, + 3, + 1, + 4, + 0, + 5, + 3, + 6, + 1, + 2, + 6, + 7, + 3, + 5, + 29, + 2, + 4, + 6, + 5, + 12, + 0, + 2, + 5, + 2, + 3, + 4, + 4, + 10, + 7, + 1, + 4, + 13, + 3, + 2, + 8, + 4, + 2, + 4, + 1, + 3, + 2, + 4, + 2, + 1, + 15, + 4, + 3, + 4, + 0 + ], + "weighted_loads": [ + 0.05497113987803459, + 0.5828443728387356, + 0.1948193982243538, + 0.43413897525169887, + 0.10229946672916412, + 0.0, + 0.0, + 0.0, + 0.11419222876429558, + 0.20309798419475555, + 1.3512650039047003, + 0.13738022558391094, + 0.23807939514517784, + 0.8827977441251278, + 0.24015475437045097, + 0.18360726535320282, + 0.23939615115523338, + 0.07074454426765442, + 0.2472464175953064, + 0.0, + 0.3884243480861187, + 0.4894983172416687, + 0.32732443884015083, + 0.08250892162322998, + 0.16004468500614166, + 0.3776233419775963, + 0.8546655885875225, + 0.26494646072387695, + 0.4441819339990616, + 2.238850891153561, + 0.13994699344038963, + 0.33236039243638515, + 0.3317559100687504, + 0.4061360266059637, + 1.2236797437362839, + 0.0, + 0.1169981062412262, + 0.3694513514637947, + 1.0512783490121365, + 0.3392852917313576, + 0.17857626080513, + 0.1929926835000515, + 0.5394054912030697, + 0.6062421686947346, + 0.05620429664850235, + 0.354883074760437, + 1.3554891720414162, + 0.3136427700519562, + 0.0910494439303875, + 0.6326012518256903, + 0.283021055161953, + 0.17880109697580338, + 0.40739232301712036, + 0.05927403271198273, + 0.21927352622151375, + 0.1333758383989334, + 0.23113683611154556, + 0.09797407314181328, + 0.037217628210783005, + 0.8871158231049776, + 0.47228084970265627, + 0.21757714077830315, + 0.26053738221526146, + 0.0 + ], + "unique_experts": 58, + "load_cv": 1.0213764617139018, + "normalized_load_entropy": 0.9024433039090812, + "max_load_share": 0.10069444444444445 + } + }, + "s1_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "f7fb0bc1730c8f344968ae516b8d9860256b356d6bdc8e5fc4d0fd875d6e3122", + "route_weight_sha256": "9e9cfb9c1d82051f87796a49f2ba2510a165a24b449b911fa954811d8fd49a59", + "loads": [ + 2, + 6, + 1, + 2, + 1, + 0, + 0, + 0, + 2, + 4, + 2, + 2, + 4, + 0, + 4, + 0, + 3, + 1, + 0, + 0, + 5, + 2, + 3, + 1, + 2, + 0, + 0, + 3, + 4, + 6, + 2, + 3, + 6, + 4, + 2, + 0, + 2, + 3, + 1, + 3, + 1, + 1, + 2, + 7, + 1, + 2, + 1, + 3, + 0, + 7, + 4, + 1, + 3, + 1, + 3, + 2, + 4, + 2, + 1, + 1, + 0, + 3, + 2, + 0 + ], + "weighted_loads": [ + 0.0962873138487339, + 0.2887214906513691, + 0.07507786899805069, + 0.11583561822772026, + 0.1039617583155632, + 0.0, + 0.0, + 0.0, + 0.12155220285058022, + 0.25491174310445786, + 0.6841490864753723, + 0.11609632894396782, + 0.25134149193763733, + 0.0, + 0.19986790232360363, + 0.0, + 0.2335936576128006, + 0.07015682756900787, + 0.0, + 0.0, + 0.40568437427282333, + 0.21445376425981522, + 0.21129406243562698, + 0.0863388255238533, + 0.15966153889894485, + 0.0, + 0.0, + 0.29888471215963364, + 0.39928119629621506, + 0.5289429351687431, + 0.14657827466726303, + 0.3041820824146271, + 0.33888643980026245, + 0.36606116965413094, + 0.1213173046708107, + 0.0, + 0.11974010989069939, + 0.288032203912735, + 0.0526183657348156, + 0.34748053550720215, + 0.038290202617645264, + 0.03557306528091431, + 0.17620103619992733, + 0.6040775924921036, + 0.06031394749879837, + 0.07136433944106102, + 0.047461435198783875, + 0.3214026838541031, + 0.0, + 0.5801833309233189, + 0.28453942760825157, + 0.05337711423635483, + 0.348814457654953, + 0.06641644239425659, + 0.22429954633116722, + 0.13962814211845398, + 0.25279704853892326, + 0.0923209935426712, + 0.03361507132649422, + 0.036362066864967346, + 0.0, + 0.22673165053129196, + 0.08752134814858437, + 0.0 + ], + "unique_experts": 51, + "load_cv": 0.8369486793032412, + "normalized_load_entropy": 0.9057796686202038, + "max_load_share": 0.050724637681159424 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "f792f2b53677e524199db7e9c9287180ae57fc5c4c18ea687ab9d65721279e76", + "route_weight_sha256": "86eef54d38d966f0eeb4a747ee68532b9cb1b47971ca7188e42e017f17f366cd", + "loads": [ + 2, + 9, + 4, + 11, + 1, + 0, + 2, + 0, + 2, + 13, + 11, + 3, + 5, + 14, + 7, + 4, + 5, + 3, + 7, + 2, + 6, + 4, + 9, + 2, + 2, + 10, + 10, + 3, + 5, + 28, + 2, + 4, + 6, + 5, + 16, + 0, + 2, + 7, + 5, + 6, + 4, + 7, + 11, + 7, + 2, + 5, + 12, + 7, + 1, + 9, + 6, + 2, + 8, + 5, + 9, + 2, + 9, + 4, + 1, + 16, + 7, + 5, + 6, + 2 + ], + "weighted_loads": [ + 0.0962873138487339, + 0.4784841984510422, + 0.2448718398809433, + 0.92037984757917, + 0.1039617583155632, + 0.0, + 0.14489996060729027, + 0.0, + 0.12155220285058022, + 1.3359478525817394, + 1.275191605091095, + 0.1332040000706911, + 0.35856638103723526, + 0.9667147323489189, + 0.2748457696288824, + 0.28933655470609665, + 0.597907081246376, + 0.1402498036623001, + 0.567215669201687, + 0.09061743319034576, + 0.45444297790527344, + 0.5464679822325706, + 0.6162177883088589, + 0.1793123558163643, + 0.15966153889894485, + 0.6192620694637299, + 1.170645646750927, + 0.29888471215963364, + 0.4485211446881294, + 1.7534138914197683, + 0.14657827466726303, + 0.32254758290946484, + 0.33888643980026245, + 0.3914125468581915, + 1.4110573265934363, + 0.0, + 0.11974010989069939, + 0.45672664791345596, + 1.3012806549668312, + 0.5597699619829655, + 0.19722069054841995, + 0.36525647396047134, + 0.6063958127051592, + 0.6040775924921036, + 0.09813427925109863, + 0.19872078287880868, + 1.3544199727475643, + 0.658959873020649, + 0.02982325665652752, + 0.6437686439603567, + 0.37678346410393715, + 0.15010587871074677, + 0.8407818712294102, + 0.2496984638273716, + 0.7736838199198246, + 0.13962814211845398, + 0.6772657968103886, + 0.16634536534547806, + 0.03361507132649422, + 1.013736568391323, + 0.9142714068293571, + 0.4237821623682976, + 0.3970012702047825, + 0.07453523203730583 + ], + "unique_experts": 61, + "load_cv": 0.7878196000495432, + "normalized_load_entropy": 0.9323324411128006, + "max_load_share": 0.07291666666666667 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "ordered_topk_exact_tokens": 19, + "set_exact_tokens": 21, + "mean_set_jaccard": 0.9751552795031057, + "mean_token_weighted_tv": 0.00901200662812461, + "aggregate_load_tv": 0.014492753623188406 + }, + "system_bos": { + "tokens": 23, + "ordered_topk_exact_tokens": 16, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.9254658385093167, + "mean_token_weighted_tv": 0.021523696410915127, + "aggregate_load_tv": 0.043478260869565216 + }, + "system_x": { + "tokens": 23, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 18, + "mean_set_jaccard": 0.9378881987577641, + "mean_token_weighted_tv": 0.02228431622295276, + "aggregate_load_tv": 0.036231884057971016 + }, + "system_period": { + "tokens": 23, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 18, + "mean_set_jaccard": 0.9378881987577641, + "mean_token_weighted_tv": 0.02117974792971559, + "aggregate_load_tv": 0.028985507246376815 + }, + "bos_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.9254658385093169, + "mean_token_weighted_tv": 0.02370419450428175, + "aggregate_load_tv": 0.021739130434782608 + }, + "bos_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.9037267080745343, + "mean_token_weighted_tv": 0.03331131245131078, + "aggregate_load_tv": 0.050724637681159424 + }, + "x_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.9254658385093167, + "mean_token_weighted_tv": 0.025497723816205627, + "aggregate_load_tv": 0.03623188405797102 + }, + "x_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.9006211180124224, + "mean_token_weighted_tv": 0.03750405027328626, + "aggregate_load_tv": 0.05797101449275363 + }, + "period_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.9503105590062112, + "mean_token_weighted_tv": 0.02198740281164646, + "aggregate_load_tv": 0.028985507246376812 + }, + "period_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.9006211180124224, + "mean_token_weighted_tv": 0.03901252948233615, + "aggregate_load_tv": 0.050724637681159424 + } + } + }, + "layer_05": { + "layer": 5, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "9f751eecaf07c9d3fd4388022acab01be8683acdd404cef9cf18ce2e851a2e78", + "route_weight_sha256": "140cc9f1148e7fd38e2c601205cc9a61af42d2dc4d7664c75d0ea704c716fcee", + "loads": [ + 0, + 2, + 0, + 0, + 3, + 0, + 1, + 1, + 6, + 6, + 1, + 2, + 3, + 1, + 0, + 0, + 1, + 4, + 2, + 0, + 4, + 2, + 2, + 0, + 1, + 0, + 2, + 3, + 6, + 1, + 4, + 2, + 7, + 6, + 1, + 5, + 2, + 3, + 2, + 0, + 1, + 0, + 2, + 3, + 5, + 0, + 1, + 3, + 0, + 0, + 0, + 1, + 2, + 2, + 3, + 3, + 3, + 1, + 4, + 0, + 1, + 7, + 5, + 5 + ], + "weighted_loads": [ + 0.0, + 0.27809253334999084, + 0.0, + 0.0, + 0.22664662823081017, + 0.0, + 0.07473825663328171, + 0.05849453806877136, + 0.6388550736010075, + 0.3675047680735588, + 0.05249806493520737, + 0.08040746487677097, + 0.2643924951553345, + 0.04485142230987549, + 0.0, + 0.0, + 0.04059584066271782, + 0.34864524006843567, + 0.13885584101080894, + 0.0, + 0.4208461716771126, + 0.18968725949525833, + 0.10068970918655396, + 0.0, + 0.09713365882635117, + 0.0, + 0.09470491111278534, + 0.1684659644961357, + 0.5184344165027142, + 0.04772124066948891, + 0.16206949949264526, + 0.11242533102631569, + 0.6231211200356483, + 0.40274881199002266, + 0.050608180463314056, + 0.31514739990234375, + 0.08950745314359665, + 0.2437661737203598, + 0.08848398551344872, + 0.0, + 0.2956089973449707, + 0.0, + 0.28868139535188675, + 0.3017772510647774, + 0.2998148538172245, + 0.0, + 0.04777824506163597, + 0.16350603476166725, + 0.0, + 0.0, + 0.0, + 0.03815126791596413, + 0.22425121068954468, + 0.14654218405485153, + 0.2891091853380203, + 0.2604546658694744, + 0.2314695045351982, + 0.04771524667739868, + 0.33292384445667267, + 0.0, + 0.039364662021398544, + 0.5769626796245575, + 0.31472640112042427, + 0.40206000953912735 + ], + "unique_experts": 48, + "load_cv": 0.91740389670136, + "normalized_load_entropy": 0.8869586433478922, + "max_load_share": 0.050724637681159424 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "1948d2ac755c2f7fb0588d7d0d9450d431d5f94ca56718ecb62f8ec48d362a97", + "route_weight_sha256": "0870e0eaf6865542e40404f55ca8619e42c5b898ddb8caf7d35b5530566df3d6", + "loads": [ + 0, + 3, + 0, + 0, + 4, + 2, + 2, + 2, + 8, + 8, + 12, + 2, + 5, + 1, + 0, + 13, + 3, + 10, + 11, + 1, + 6, + 2, + 2, + 0, + 1, + 8, + 2, + 3, + 6, + 2, + 4, + 2, + 7, + 6, + 1, + 9, + 2, + 3, + 14, + 8, + 5, + 8, + 9, + 4, + 6, + 0, + 1, + 5, + 0, + 4, + 8, + 1, + 4, + 10, + 6, + 13, + 3, + 1, + 4, + 1, + 1, + 7, + 5, + 7 + ], + "weighted_loads": [ + 0.0, + 0.2816131964791566, + 0.0, + 0.0, + 0.22841492015868425, + 0.06773566827178001, + 0.10648554936051369, + 0.06155947200022638, + 0.6784621272236109, + 0.41868044110015035, + 0.7104411832988262, + 0.08040746487677097, + 0.39297257363796234, + 0.04485142230987549, + 0.0, + 2.1809718175791204, + 0.1802012138068676, + 0.6458325535058975, + 1.0253256931900978, + 0.013061463832855225, + 0.4363020828459412, + 0.18968725949525833, + 0.10068970918655396, + 0.0, + 0.09713365882635117, + 0.9019144475460052, + 0.09470491111278534, + 0.1684659644961357, + 0.5184344165027142, + 0.1358056180179119, + 0.16206949949264526, + 0.11242533102631569, + 0.6231211200356483, + 0.40274881199002266, + 0.050608180463314056, + 0.6281196549534798, + 0.08950745314359665, + 0.2437661737203598, + 1.2286716401576996, + 0.587898526340723, + 0.47048405930399895, + 0.8850078023970127, + 1.0301674529910088, + 0.34173019602894783, + 0.38170747086405754, + 0.0, + 0.04777824506163597, + 0.1814785455353558, + 0.0, + 0.24719146639108658, + 0.8103769309818745, + 0.03815126791596413, + 1.8535980582237244, + 0.6859532073140144, + 0.30599625315517187, + 0.9979056492447853, + 0.2314695045351982, + 0.04771524667739868, + 0.33292384445667267, + 0.04566708207130432, + 0.039364662021398544, + 0.5769626796245575, + 0.31472640112042427, + 1.3375116847455502 + ], + "unique_experts": 57, + "load_cv": 0.8174410538645644, + "normalized_load_entropy": 0.9144312276065562, + "max_load_share": 0.04861111111111111 + } + }, + "s1_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "fc996deb8fe5c4c7546da4d9074a73afd746b7c1a6e0969570969115da016152", + "route_weight_sha256": "c50288a1022dd0dc4ba493e10f7c8708f3f7df67136984ae711dcbec0a565f14", + "loads": [ + 0, + 2, + 0, + 0, + 3, + 0, + 1, + 1, + 5, + 6, + 1, + 2, + 3, + 2, + 0, + 0, + 1, + 4, + 2, + 0, + 4, + 2, + 2, + 0, + 1, + 0, + 2, + 3, + 7, + 1, + 4, + 2, + 7, + 6, + 1, + 4, + 2, + 3, + 2, + 0, + 1, + 0, + 3, + 3, + 5, + 0, + 1, + 2, + 0, + 0, + 0, + 1, + 2, + 2, + 3, + 3, + 3, + 1, + 4, + 0, + 1, + 7, + 5, + 5 + ], + "weighted_loads": [ + 0.0, + 0.26153896749019623, + 0.0, + 0.0, + 0.23481160029768944, + 0.0, + 0.08875597268342972, + 0.057895269244909286, + 0.5886396951973438, + 0.3721529617905617, + 0.05525919422507286, + 0.08295171335339546, + 0.26394135504961014, + 0.09158091619610786, + 0.0, + 0.0, + 0.03740592673420906, + 0.344600073993206, + 0.13564668595790863, + 0.0, + 0.4311761260032654, + 0.18644214421510696, + 0.10047387704253197, + 0.0, + 0.09638430923223495, + 0.0, + 0.09595126658678055, + 0.17157277837395668, + 0.5545037016272545, + 0.05004017427563667, + 0.1634780466556549, + 0.10756510123610497, + 0.6092777326703072, + 0.393088199198246, + 0.05092262849211693, + 0.26436201855540276, + 0.08441829681396484, + 0.24496424198150635, + 0.0882236547768116, + 0.0, + 0.30062136054039, + 0.0, + 0.3474268764257431, + 0.30009830743074417, + 0.2966633252799511, + 0.0, + 0.046521011739969254, + 0.12789826467633247, + 0.0, + 0.0, + 0.0, + 0.03741937875747681, + 0.2166452333331108, + 0.15038910508155823, + 0.2963969334959984, + 0.2668960876762867, + 0.23214927688241005, + 0.04613521322607994, + 0.33404095470905304, + 0.0, + 0.03895730897784233, + 0.5634302571415901, + 0.3084379620850086, + 0.3999379649758339 + ], + "unique_experts": 48, + "load_cv": 0.9100479963153392, + "normalized_load_entropy": 0.8886108964327359, + "max_load_share": 0.050724637681159424 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "1c6c9f93e1cd5f643f69db8d05454c87d59ff0ad708319a56ca50522afefc5e2", + "route_weight_sha256": "1f10d4db936a629da0e3522e56396bb7cdcd6f9737cef6f83612236f88220001", + "loads": [ + 1, + 4, + 0, + 6, + 4, + 2, + 9, + 3, + 7, + 8, + 15, + 5, + 7, + 2, + 1, + 15, + 4, + 15, + 14, + 10, + 6, + 2, + 3, + 0, + 2, + 8, + 2, + 5, + 7, + 4, + 4, + 2, + 8, + 7, + 2, + 8, + 3, + 6, + 15, + 12, + 5, + 13, + 14, + 7, + 6, + 0, + 1, + 5, + 0, + 14, + 10, + 2, + 4, + 12, + 7, + 13, + 3, + 1, + 5, + 1, + 2, + 7, + 5, + 9 + ], + "weighted_loads": [ + 0.03667677193880081, + 0.28564164019189775, + 0.0, + 0.41302134841680527, + 0.23658668843563646, + 0.07258510962128639, + 1.0619712099432945, + 0.11247337958775461, + 0.6276649271603674, + 0.42539839539676905, + 0.9015325997024775, + 0.45234448835253716, + 0.6212681867182255, + 0.09158091619610786, + 0.033525049686431885, + 2.6408810992725194, + 0.2614080645143986, + 1.0246081426739693, + 1.3554068319499493, + 0.8553846627473831, + 0.44651495036669075, + 0.18644214421510696, + 0.13785230740904808, + 0.0, + 0.1739431917667389, + 0.7196703087538481, + 0.09595126658678055, + 0.3449261896312237, + 0.5545037016272545, + 0.22152568027377129, + 0.1634780466556549, + 0.10756510123610497, + 0.7290524765849113, + 0.43600963056087494, + 0.08581969141960144, + 0.6982233338057995, + 0.12971343100070953, + 0.39707498997449875, + 1.3725694045424461, + 1.0502404756844044, + 0.462700929492712, + 1.3197764419019222, + 1.385872207581997, + 0.5386950857937336, + 0.3587105721235275, + 0.0, + 0.046521011739969254, + 0.1788540177512914, + 0.0, + 0.8869969695806503, + 1.2741812616586685, + 0.0857338234782219, + 1.8458774015307426, + 0.9643123485147953, + 0.35101824440062046, + 0.8838104419410229, + 0.23214927688241005, + 0.04613521322607994, + 0.4037574976682663, + 0.04692578688263893, + 0.08432525023818016, + 0.5634302571415901, + 0.3084379620850086, + 1.5769508220255375 + ], + "unique_experts": 60, + "load_cv": 0.7330255035732992, + "normalized_load_entropy": 0.9315445439009999, + "max_load_share": 0.0390625 + } + }, + "s0_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "2205cc8caa6e2c6b7f26ae1d788ae51d8aefa2df96cee0501b535c9ea593aa31", + "route_weight_sha256": "2db20e6a89048599b0bc8475294da8f82b569c6825fa015593bba1ea2f2bf264", + "loads": [ + 0, + 2, + 0, + 0, + 3, + 0, + 2, + 1, + 5, + 5, + 1, + 2, + 3, + 2, + 0, + 0, + 1, + 4, + 2, + 0, + 4, + 2, + 2, + 0, + 1, + 0, + 2, + 3, + 6, + 1, + 4, + 2, + 7, + 6, + 1, + 4, + 2, + 3, + 1, + 0, + 1, + 0, + 3, + 3, + 5, + 0, + 1, + 3, + 0, + 0, + 0, + 1, + 2, + 2, + 3, + 3, + 3, + 1, + 4, + 0, + 1, + 8, + 5, + 5 + ], + "weighted_loads": [ + 0.0, + 0.2620956599712372, + 0.0, + 0.0, + 0.23191269114613533, + 0.0, + 0.12617527320981026, + 0.05521736666560173, + 0.5288922749459743, + 0.33820008113980293, + 0.050279513001441956, + 0.08322018757462502, + 0.2521546706557274, + 0.10176388919353485, + 0.0, + 0.0, + 0.038626160472631454, + 0.34890950843691826, + 0.12645269185304642, + 0.0, + 0.45838140323758125, + 0.18880770727992058, + 0.09255852922797203, + 0.0, + 0.09945076704025269, + 0.0, + 0.09507856145501137, + 0.17105207964777946, + 0.5112267062067986, + 0.05235930532217026, + 0.18478558585047722, + 0.1229563057422638, + 0.6568814814090729, + 0.4176623523235321, + 0.051020391285419464, + 0.2855675630271435, + 0.08110557496547699, + 0.24075375497341156, + 0.04721993952989578, + 0.0, + 0.2862665355205536, + 0.0, + 0.3425218500196934, + 0.31667840480804443, + 0.2985556460916996, + 0.0, + 0.04884772375226021, + 0.1726568043231964, + 0.0, + 0.0, + 0.0, + 0.036636561155319214, + 0.21925733983516693, + 0.15576688945293427, + 0.28706301748752594, + 0.26763900369405746, + 0.24220313876867294, + 0.04678778350353241, + 0.339460089802742, + 0.0, + 0.04066850617527962, + 0.644945815205574, + 0.2918711192905903, + 0.40322667360305786 + ], + "unique_experts": 48, + "load_cv": 0.9026321518272475, + "normalized_load_entropy": 0.8897442792011009, + "max_load_share": 0.057971014492753624 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "b2018c85b7b5987a8df9aa26bcdbd9bd7ae8fa6f999987d8c92d2a76b5ff8d75", + "route_weight_sha256": "801962e4583d868723372bc80045c886c7077819667b734cc4582af2a65315ca", + "loads": [ + 0, + 3, + 0, + 0, + 3, + 2, + 4, + 2, + 6, + 7, + 12, + 2, + 6, + 2, + 0, + 14, + 3, + 10, + 12, + 1, + 5, + 2, + 2, + 0, + 1, + 8, + 2, + 3, + 6, + 2, + 4, + 2, + 7, + 6, + 1, + 8, + 2, + 3, + 13, + 9, + 5, + 8, + 11, + 4, + 6, + 0, + 1, + 4, + 0, + 4, + 7, + 1, + 3, + 10, + 5, + 14, + 3, + 1, + 4, + 1, + 1, + 8, + 5, + 7 + ], + "weighted_loads": [ + 0.0, + 0.26561632310040295, + 0.0, + 0.0, + 0.23191269114613533, + 0.06773566827178001, + 0.19469978660345078, + 0.058282300597056746, + 0.5322592314332724, + 0.419625461101532, + 0.7345562279224396, + 0.08322018757462502, + 0.4167827107012272, + 0.10176388919353485, + 0.0, + 2.18728863960132, + 0.176623847335577, + 0.6460968218743801, + 1.1280614882707596, + 0.013061463832855225, + 0.47093354538083076, + 0.18880770727992058, + 0.09255852922797203, + 0.0, + 0.09945076704025269, + 0.9019144475460052, + 0.09507856145501137, + 0.17105207964777946, + 0.5112267062067986, + 0.09785778447985649, + 0.18478558585047722, + 0.1229563057422638, + 0.6568814814090729, + 0.4176623523235321, + 0.051020391285419464, + 0.5985398180782795, + 0.08110557496547699, + 0.24075375497341156, + 1.2802354916930199, + 0.6304973848164082, + 0.46114159747958183, + 0.8833509869873524, + 1.1039844863116741, + 0.3583269752562046, + 0.38044826313853264, + 0.0, + 0.04884772375226021, + 0.1882185861468315, + 0.0, + 0.271678626537323, + 0.7383344061672688, + 0.036636561155319214, + 0.8841461390256882, + 0.6951779127120972, + 0.3020404458511621, + 1.0064679235219955, + 0.24220313876867294, + 0.04678778350353241, + 0.339460089802742, + 0.04566708207130432, + 0.04066850617527962, + 0.644945815205574, + 0.2918711192905903, + 1.3386783488094807 + ], + "unique_experts": 57, + "load_cv": 0.8305509104292252, + "normalized_load_entropy": 0.9139400603453436, + "max_load_share": 0.04861111111111111 + } + }, + "s1_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "818934f293d872d50d6f768fc0ff1ce7e493ec4904cbb4c06d6620b58f2b242c", + "route_weight_sha256": "a653a8a2d6f8c9f9c1fd80fb84469e3269a57a046cde258cb48cc69f162adba6", + "loads": [ + 0, + 2, + 0, + 0, + 3, + 0, + 2, + 1, + 5, + 5, + 1, + 2, + 3, + 2, + 0, + 0, + 1, + 4, + 2, + 0, + 4, + 2, + 2, + 0, + 1, + 0, + 2, + 3, + 6, + 1, + 4, + 2, + 7, + 6, + 1, + 4, + 2, + 3, + 1, + 0, + 3, + 0, + 3, + 3, + 4, + 0, + 1, + 3, + 0, + 0, + 0, + 1, + 2, + 2, + 3, + 2, + 3, + 1, + 4, + 0, + 1, + 8, + 5, + 5 + ], + "weighted_loads": [ + 0.0, + 0.2779563069343567, + 0.0, + 0.0, + 0.23873839899897575, + 0.0, + 0.13398733362555504, + 0.06267379969358444, + 0.551081757992506, + 0.34164202958345413, + 0.05033806338906288, + 0.08821652457118034, + 0.25250614434480667, + 0.09818898513913155, + 0.0, + 0.0, + 0.039691176265478134, + 0.3526337146759033, + 0.11382606253027916, + 0.0, + 0.43810784444212914, + 0.18645189329981804, + 0.10103589296340942, + 0.0, + 0.09933526813983917, + 0.0, + 0.09529054164886475, + 0.1882440596818924, + 0.5372915081679821, + 0.059804461896419525, + 0.17876356467604637, + 0.1304868645966053, + 0.6691430918872356, + 0.41427773609757423, + 0.04999485984444618, + 0.275896567851305, + 0.07600840553641319, + 0.23644935339689255, + 0.037817928940057755, + 0.0, + 0.36056819558143616, + 0.0, + 0.34724149107933044, + 0.31782418489456177, + 0.2571581341326237, + 0.0, + 0.04601943492889404, + 0.166367806494236, + 0.0, + 0.0, + 0.0, + 0.036498844623565674, + 0.21457038447260857, + 0.15869684517383575, + 0.2880135178565979, + 0.21949118748307228, + 0.249192513525486, + 0.04495437443256378, + 0.34344836324453354, + 0.0, + 0.0382770374417305, + 0.643225010484457, + 0.30431005731225014, + 0.40078847110271454 + ], + "unique_experts": 48, + "load_cv": 0.891392713894596, + "normalized_load_entropy": 0.891688289435928, + "max_load_share": 0.057971014492753624 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "1282a8a8555907886a0c5c30a297d7f8a3a251a5415c0d438ec5dcfbbfe91b91", + "route_weight_sha256": "4b5f3e8cdb26a648471f4bec2bd16c01fff91a55e43c4725efc207ba74184a7c", + "loads": [ + 1, + 4, + 0, + 6, + 3, + 2, + 11, + 3, + 6, + 6, + 15, + 5, + 8, + 2, + 1, + 16, + 5, + 15, + 16, + 10, + 5, + 2, + 3, + 0, + 2, + 8, + 2, + 5, + 6, + 4, + 4, + 2, + 8, + 7, + 2, + 8, + 3, + 6, + 14, + 12, + 6, + 13, + 15, + 7, + 5, + 0, + 1, + 5, + 0, + 13, + 11, + 2, + 3, + 12, + 6, + 13, + 3, + 1, + 5, + 1, + 2, + 8, + 5, + 9 + ], + "weighted_loads": [ + 0.03667677193880081, + 0.3020589796360582, + 0.0, + 0.41302134841680527, + 0.23873839899897575, + 0.07258510962128639, + 1.1443578526377678, + 0.11725191003642976, + 0.5544506867881864, + 0.38782038912177086, + 0.9113668370991945, + 0.45760929957032204, + 0.6563708856701851, + 0.09818898513913155, + 0.033525049686431885, + 2.710429147351533, + 0.29865294322371483, + 1.0326417833566666, + 1.4960290007293224, + 0.8553846627473831, + 0.45065998658537865, + 0.18645189329981804, + 0.13841432332992554, + 0.0, + 0.1768941506743431, + 0.7196703087538481, + 0.09529054164886475, + 0.3615974709391594, + 0.5372915081679821, + 0.17953309044241905, + 0.17876356467604637, + 0.1304868645966053, + 0.7889178358018398, + 0.45719916746020317, + 0.0848919227719307, + 0.7097578831017017, + 0.12130353972315788, + 0.38856010138988495, + 1.4045194424688816, + 1.0519037619233131, + 0.48883315175771713, + 1.3172876201570034, + 1.4050651155412197, + 0.5627443753182888, + 0.3192053809762001, + 0.0, + 0.04601943492889404, + 0.21487894654273987, + 0.0, + 0.8596781380474567, + 1.222435224801302, + 0.08481328934431076, + 0.8794591836631298, + 0.9726200886070728, + 0.3406380536034703, + 0.8580380342900753, + 0.249192513525486, + 0.04495437443256378, + 0.4131649062037468, + 0.04692578688263893, + 0.08364497870206833, + 0.643225010484457, + 0.30431005731225014, + 1.5778013281524181 + ], + "unique_experts": 60, + "load_cv": 0.7540400446189107, + "normalized_load_entropy": 0.9288291498357112, + "max_load_share": 0.041666666666666664 + } + }, + "s0_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "6a12e139e4c7a479141c2a6cc97bd9fdbc3d372858e0e9f51462294137321d43", + "route_weight_sha256": "cc63bf1aa57c6fb01fc0d7718d587720b7570d69accef9b1ff9ca84429b8a1c9", + "loads": [ + 0, + 2, + 0, + 0, + 3, + 0, + 2, + 1, + 5, + 4, + 1, + 2, + 3, + 2, + 0, + 0, + 1, + 4, + 2, + 0, + 4, + 2, + 2, + 0, + 1, + 0, + 2, + 3, + 6, + 1, + 4, + 2, + 7, + 6, + 1, + 4, + 2, + 3, + 1, + 0, + 2, + 0, + 3, + 3, + 4, + 0, + 1, + 2, + 0, + 0, + 0, + 1, + 2, + 2, + 3, + 4, + 3, + 1, + 4, + 0, + 1, + 9, + 5, + 5 + ], + "weighted_loads": [ + 0.0, + 0.26272185146808624, + 0.0, + 0.0, + 0.24277108535170555, + 0.0, + 0.10834676027297974, + 0.05784865841269493, + 0.5376123413443565, + 0.27634526044130325, + 0.04703384265303612, + 0.07883452624082565, + 0.25690697133541107, + 0.09218809008598328, + 0.0, + 0.0, + 0.04223974421620369, + 0.353473212569952, + 0.12302663549780846, + 0.0, + 0.44083932787179947, + 0.18405210599303246, + 0.09867927804589272, + 0.0, + 0.09930036216974258, + 0.0, + 0.09285531938076019, + 0.18059801682829857, + 0.5143270120024681, + 0.05042172968387604, + 0.18252559751272202, + 0.11959512904286385, + 0.6445465348660946, + 0.3923262879252434, + 0.050095029175281525, + 0.2875107489526272, + 0.08662034757435322, + 0.22589033842086792, + 0.042924851179122925, + 0.0, + 0.29804229736328125, + 0.0, + 0.32942546159029007, + 0.3061439320445061, + 0.25190800428390503, + 0.0, + 0.04842734709382057, + 0.129866573959589, + 0.0, + 0.0, + 0.0, + 0.03503144532442093, + 0.21499517187476158, + 0.14751334488391876, + 0.2895907685160637, + 0.31939391419291496, + 0.23674628511071205, + 0.046403899788856506, + 0.3423502892255783, + 0.0, + 0.04007689654827118, + 0.6581674963235855, + 0.28791480138897896, + 0.39710533618927 + ], + "unique_experts": 48, + "load_cv": 0.9100479963153392, + "normalized_load_entropy": 0.8899855001433954, + "max_load_share": 0.06521739130434782 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "352f0ee2950ff50b66145368e123e395ce6a79d07183085fffd65116b7359be1", + "route_weight_sha256": "f09880e5c813e5556a35044e1f45a8a6586a08415c34934230d12f29e32caa8f", + "loads": [ + 0, + 4, + 0, + 0, + 3, + 2, + 3, + 2, + 6, + 5, + 13, + 2, + 6, + 2, + 0, + 14, + 3, + 10, + 11, + 2, + 5, + 2, + 2, + 0, + 1, + 9, + 2, + 3, + 6, + 1, + 4, + 2, + 7, + 6, + 1, + 8, + 2, + 3, + 11, + 8, + 8, + 9, + 10, + 4, + 5, + 0, + 1, + 3, + 0, + 3, + 7, + 1, + 3, + 12, + 5, + 15, + 3, + 1, + 4, + 1, + 1, + 9, + 5, + 7 + ], + "weighted_loads": [ + 0.0, + 0.30361964856274426, + 0.0, + 0.0, + 0.24277108535170555, + 0.06773566827178001, + 0.14009405300021172, + 0.06091359234414995, + 0.5409792978316545, + 0.3169205076992512, + 0.8503194227814674, + 0.07883452624082565, + 0.4346625432372093, + 0.09218809008598328, + 0.0, + 2.3641609414480627, + 0.1795811466872692, + 0.6506605260074139, + 0.9976580962538719, + 0.05066561698913574, + 0.453391470015049, + 0.18405210599303246, + 0.09867927804589272, + 0.0, + 0.09930036216974258, + 0.9876842498779297, + 0.09285531938076019, + 0.18059801682829857, + 0.5143270120024681, + 0.05042172968387604, + 0.18252559751272202, + 0.11959512904286385, + 0.6445465348660946, + 0.3923262879252434, + 0.050095029175281525, + 0.6004830040037632, + 0.08662034757435322, + 0.22589033842086792, + 0.9550141468644142, + 0.629792895168066, + 0.58878193795681, + 0.8619238436222076, + 0.9343543015420437, + 0.3420836441218853, + 0.33380062133073807, + 0.0, + 0.04842734709382057, + 0.1454283557832241, + 0.0, + 0.22507518902420998, + 0.6882628500461578, + 0.03503144532442093, + 0.8798839710652828, + 0.7994777522981167, + 0.3045681968796998, + 1.1339341588318348, + 0.23674628511071205, + 0.046403899788856506, + 0.3423502892255783, + 0.04566708207130432, + 0.04007689654827118, + 0.6581674963235855, + 0.28791480138897896, + 1.3325570113956928 + ], + "unique_experts": 57, + "load_cv": 0.8443713418650369, + "normalized_load_entropy": 0.9120005963015514, + "max_load_share": 0.052083333333333336 + } + }, + "s1_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "79b4942c56b3906cacdd32917aae092582a8bbf1e384e8489363a8009b14e8aa", + "route_weight_sha256": "c86fd821e776fa788519338ff1e46723e920b16ee8871fa8f3961d37afb249ce", + "loads": [ + 0, + 2, + 0, + 0, + 3, + 0, + 2, + 2, + 5, + 5, + 1, + 2, + 3, + 2, + 0, + 0, + 1, + 4, + 2, + 0, + 4, + 2, + 3, + 0, + 1, + 0, + 2, + 3, + 5, + 1, + 4, + 2, + 7, + 6, + 1, + 4, + 2, + 3, + 0, + 0, + 1, + 0, + 3, + 3, + 4, + 0, + 1, + 2, + 0, + 0, + 0, + 1, + 2, + 2, + 3, + 3, + 3, + 1, + 4, + 0, + 1, + 10, + 5, + 5 + ], + "weighted_loads": [ + 0.0, + 0.2750888019800186, + 0.0, + 0.0, + 0.23991502821445465, + 0.0, + 0.13249406591057777, + 0.08566971682012081, + 0.5469544045627117, + 0.33476319909095764, + 0.051787760108709335, + 0.08653755486011505, + 0.2506009712815285, + 0.09065256640315056, + 0.0, + 0.0, + 0.042908042669296265, + 0.3585858941078186, + 0.10171980783343315, + 0.0, + 0.44762449711561203, + 0.1857016198337078, + 0.1311882622539997, + 0.0, + 0.10008160024881363, + 0.0, + 0.0925699956715107, + 0.20024028420448303, + 0.4761289767920971, + 0.06000837683677673, + 0.17611438781023026, + 0.1353001669049263, + 0.6509190015494823, + 0.40750057995319366, + 0.050153736025094986, + 0.2724921964108944, + 0.07464995235204697, + 0.2337767481803894, + 0.0, + 0.0, + 0.2700099050998688, + 0.0, + 0.32927776873111725, + 0.3129812702536583, + 0.2548134811222553, + 0.0, + 0.047221727669239044, + 0.12786798924207687, + 0.0, + 0.0, + 0.0, + 0.0357651486992836, + 0.21111450344324112, + 0.1614280790090561, + 0.29135651886463165, + 0.26206571981310844, + 0.23260904848575592, + 0.04427897557616234, + 0.35647836327552795, + 0.0, + 0.0404454730451107, + 0.711850680410862, + 0.2892890051007271, + 0.4169793985784054 + ], + "unique_experts": 47, + "load_cv": 0.9355406431021744, + "normalized_load_entropy": 0.8852641995579286, + "max_load_share": 0.07246376811594203 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "5a5ef275d76445e0c489b746d5d64e832334d0302a4b9f4e90805f485871b663", + "route_weight_sha256": "eaa62ca883d21c25196c7d5679088ccf038f2ca673ad7c9ac3ce30991f6aab08", + "loads": [ + 1, + 4, + 0, + 6, + 3, + 3, + 10, + 4, + 6, + 6, + 16, + 5, + 8, + 2, + 1, + 16, + 5, + 15, + 16, + 10, + 5, + 2, + 4, + 0, + 2, + 9, + 2, + 5, + 5, + 3, + 4, + 2, + 8, + 8, + 2, + 9, + 3, + 6, + 10, + 12, + 5, + 12, + 14, + 7, + 5, + 0, + 1, + 4, + 0, + 13, + 9, + 2, + 3, + 14, + 6, + 14, + 3, + 1, + 5, + 1, + 2, + 11, + 5, + 9 + ], + "weighted_loads": [ + 0.03667677193880081, + 0.29919147468172014, + 0.0, + 0.41302134841680527, + 0.23991502821445465, + 0.10473809763789177, + 1.1057093031704426, + 0.14024782716296613, + 0.5503233333583921, + 0.37812191247940063, + 1.0183482225984335, + 0.45593032985925674, + 0.6766885630786419, + 0.09065256640315056, + 0.033525049686431885, + 2.8960434873588383, + 0.3115226738154888, + 1.0385939627885818, + 1.3399291597306728, + 0.8553846627473831, + 0.46017663925886154, + 0.1857016198337078, + 0.16856669262051582, + 0.0, + 0.17764048278331757, + 0.797258211299777, + 0.0925699956715107, + 0.37359369546175003, + 0.4761289767920971, + 0.14663763344287872, + 0.17611438781023026, + 0.1353001669049263, + 0.7706937454640865, + 0.4941246025264263, + 0.0850507989525795, + 0.7517983876168728, + 0.11994508653879166, + 0.3858874961733818, + 0.9995790086686611, + 1.0931618250906467, + 0.47222014516592026, + 1.2153862677514553, + 1.2561028376221657, + 0.5544147789478302, + 0.31686072796583176, + 0.0, + 0.047221727669239044, + 0.17637912929058075, + 0.0, + 0.8453336767852306, + 1.050467487424612, + 0.08407959342002869, + 0.8760033026337624, + 1.0875795409083366, + 0.3439810546115041, + 0.9732195138931274, + 0.23260904848575592, + 0.04427897557616234, + 0.4261949062347412, + 0.04692578688263893, + 0.08581341430544853, + 0.7486194334924221, + 0.2892890051007271, + 1.593992255628109 + ], + "unique_experts": 60, + "load_cv": 0.75, + "normalized_load_entropy": 0.9296541574655949, + "max_load_share": 0.041666666666666664 + } + }, + "s0_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "d2de6ca493ea30d1886214cdef8dd242dc3c222ee6acf7749677ebe7d8bc947c", + "route_weight_sha256": "540b48d2291c06494e1ce76de3f6199b866848c6f538ac8146486dad8cc79a16", + "loads": [ + 0, + 2, + 0, + 0, + 3, + 0, + 2, + 1, + 5, + 5, + 1, + 2, + 3, + 2, + 0, + 0, + 1, + 4, + 2, + 0, + 4, + 2, + 2, + 0, + 1, + 0, + 2, + 3, + 6, + 1, + 4, + 2, + 7, + 6, + 1, + 4, + 2, + 3, + 1, + 0, + 2, + 0, + 3, + 3, + 4, + 0, + 1, + 2, + 0, + 0, + 0, + 1, + 2, + 2, + 3, + 3, + 3, + 1, + 4, + 0, + 1, + 9, + 5, + 5 + ], + "weighted_loads": [ + 0.0, + 0.26318254321813583, + 0.0, + 0.0, + 0.23999523743987083, + 0.0, + 0.10782875493168831, + 0.05855294317007065, + 0.5595942959189415, + 0.3246856816112995, + 0.04656948149204254, + 0.07931105047464371, + 0.2549750506877899, + 0.09251434355974197, + 0.0, + 0.0, + 0.04341791570186615, + 0.3473908416926861, + 0.1314777284860611, + 0.0, + 0.44604409858584404, + 0.18622153624892235, + 0.0978824608027935, + 0.0, + 0.10080048441886902, + 0.0, + 0.08560871332883835, + 0.17861029878258705, + 0.5084709376096725, + 0.053099002689123154, + 0.1720082312822342, + 0.1247098334133625, + 0.6445561908185482, + 0.3991212472319603, + 0.05218145251274109, + 0.2810968607664108, + 0.08936011604964733, + 0.22697655856609344, + 0.04518105834722519, + 0.0, + 0.2955326847732067, + 0.0, + 0.3286774717271328, + 0.30643121898174286, + 0.25020552426576614, + 0.0, + 0.04731960967183113, + 0.13026981800794601, + 0.0, + 0.0, + 0.0, + 0.03564374893903732, + 0.22894831746816635, + 0.14698376506567, + 0.29789984971284866, + 0.2665040045976639, + 0.2421344630420208, + 0.045061126351356506, + 0.3427077382802963, + 0.0, + 0.040017928928136826, + 0.6568928509950638, + 0.29480696097016335, + 0.3988841623067856 + ], + "unique_experts": 48, + "load_cv": 0.9137333487622095, + "normalized_load_entropy": 0.8895452489639263, + "max_load_share": 0.06521739130434782 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "e65655da20b8602f1ef3586adc54fdb58bb8ffafc4e90b9d08d8fa95f98e7a6b", + "route_weight_sha256": "93c5415ae948b9354919063d4beff4ff6049bfb997ac9dabe96a491f45d38fc7", + "loads": [ + 0, + 4, + 0, + 0, + 3, + 2, + 3, + 2, + 6, + 6, + 13, + 2, + 6, + 2, + 0, + 14, + 4, + 11, + 11, + 1, + 5, + 2, + 2, + 0, + 1, + 8, + 2, + 3, + 6, + 1, + 4, + 2, + 7, + 6, + 1, + 9, + 2, + 3, + 11, + 8, + 7, + 9, + 10, + 4, + 6, + 0, + 1, + 3, + 0, + 3, + 7, + 1, + 3, + 10, + 5, + 14, + 3, + 1, + 4, + 1, + 1, + 10, + 5, + 7 + ], + "weighted_loads": [ + 0.0, + 0.304003442870453, + 0.0, + 0.0, + 0.23999523743987083, + 0.06773566827178001, + 0.1395760476589203, + 0.061617877101525664, + 0.5629612524062395, + 0.36698290705680847, + 0.8380581215023994, + 0.07931105047464371, + 0.4336624853312969, + 0.09251434355974197, + 0.0, + 2.193473362829536, + 0.21971232816576958, + 0.7010624743998051, + 0.9407175816595554, + 0.013061463832855225, + 0.45859624072909355, + 0.18622153624892235, + 0.0978824608027935, + 0.0, + 0.10080048441886902, + 0.9019144475460052, + 0.08560871332883835, + 0.17861029878258705, + 0.5084709376096725, + 0.053099002689123154, + 0.1720082312822342, + 0.1247098334133625, + 0.6445561908185482, + 0.3991212472319603, + 0.05218145251274109, + 0.6459486968815327, + 0.08936011604964733, + 0.22697655856609344, + 0.9296284727752209, + 0.6409102715551853, + 0.5279778651893139, + 0.9071067683398724, + 0.9460537731647491, + 0.34142301231622696, + 0.38723598048090935, + 0.0, + 0.04731960967183113, + 0.14583159983158112, + 0.0, + 0.21105489507317543, + 0.7207907661795616, + 0.03564374893903732, + 0.8938371166586876, + 0.6863947883248329, + 0.3128772780764848, + 1.2092721946537495, + 0.2421344630420208, + 0.045061126351356506, + 0.3427077382802963, + 0.04566708207130432, + 0.040017928928136826, + 0.6933395490050316, + 0.29480696097016335, + 1.3343358375132084 + ], + "unique_experts": 57, + "load_cv": 0.8342587454267337, + "normalized_load_entropy": 0.9125094911401231, + "max_load_share": 0.04861111111111111 + } + }, + "s1_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "ac1729a99bc0179a9d4e5bf2af789cd2df6de65babda1bb2b53d59739567e4e1", + "route_weight_sha256": "2d9c0ce09d6684d2b28e1fe14e733841f05cfc364848891f24fda78e12ccdefc", + "loads": [ + 1, + 2, + 0, + 0, + 3, + 0, + 2, + 1, + 5, + 5, + 1, + 2, + 3, + 2, + 0, + 0, + 1, + 4, + 2, + 0, + 4, + 2, + 3, + 0, + 1, + 0, + 1, + 3, + 5, + 1, + 3, + 4, + 7, + 6, + 1, + 4, + 2, + 3, + 0, + 0, + 2, + 0, + 3, + 3, + 4, + 0, + 1, + 2, + 0, + 0, + 0, + 1, + 2, + 2, + 3, + 2, + 3, + 1, + 4, + 0, + 1, + 10, + 5, + 5 + ], + "weighted_loads": [ + 0.03443598002195358, + 0.27216891199350357, + 0.0, + 0.0, + 0.24354152753949165, + 0.0, + 0.1330619491636753, + 0.06077570095658302, + 0.5552406646311283, + 0.3353848457336426, + 0.05030471831560135, + 0.08571493998169899, + 0.25518883764743805, + 0.09130680561065674, + 0.0, + 0.0, + 0.043852634727954865, + 0.34672997891902924, + 0.1031215600669384, + 0.0, + 0.4406503848731518, + 0.18805472180247307, + 0.13197444006800652, + 0.0, + 0.10081423074007034, + 0.0, + 0.05484837666153908, + 0.19945872947573662, + 0.4803430438041687, + 0.06065455451607704, + 0.13660608604550362, + 0.20450171642005444, + 0.6497884802520275, + 0.40773480385541916, + 0.050867266952991486, + 0.2697186544537544, + 0.07804000191390514, + 0.2340896800160408, + 0.0, + 0.0, + 0.31449637562036514, + 0.0, + 0.32888051494956017, + 0.314083069562912, + 0.2563560903072357, + 0.0, + 0.04667949676513672, + 0.12672105431556702, + 0.0, + 0.0, + 0.0, + 0.03653508424758911, + 0.21070469543337822, + 0.16049250215291977, + 0.28697363287210464, + 0.220970768481493, + 0.23798073083162308, + 0.04390762001276016, + 0.34669651091098785, + 0.0, + 0.039787519723176956, + 0.7185964547097683, + 0.3006801977753639, + 0.41206811368465424 + ], + "unique_experts": 48, + "load_cv": 0.9319415313491465, + "normalized_load_entropy": 0.8876796584951266, + "max_load_share": 0.07246376811594203 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "a128c70db58e73b3974ba64ffccb3798a5f0436941bf3a961f8e50edbdd8f07b", + "route_weight_sha256": "299537dc96ba12cb6a3872bc7b7e55f1695d853c0a376482832f6d4fded0e5ae", + "loads": [ + 2, + 4, + 0, + 6, + 3, + 3, + 10, + 3, + 7, + 6, + 16, + 5, + 8, + 2, + 1, + 17, + 5, + 16, + 15, + 10, + 5, + 2, + 4, + 0, + 2, + 8, + 1, + 5, + 5, + 3, + 3, + 4, + 8, + 7, + 2, + 9, + 3, + 6, + 10, + 12, + 6, + 14, + 14, + 7, + 6, + 0, + 1, + 4, + 0, + 13, + 9, + 2, + 3, + 12, + 6, + 13, + 3, + 1, + 5, + 1, + 2, + 10, + 5, + 9 + ], + "weighted_loads": [ + 0.0711127519607544, + 0.2962715846952051, + 0.0, + 0.41302134841680527, + 0.24354152753949165, + 0.11724108085036278, + 1.1062771864235401, + 0.11535381129942834, + 0.5977700164075941, + 0.37993379309773445, + 1.0248689036816359, + 0.4551077149808407, + 0.6876318529248238, + 0.09130680561065674, + 0.033525049686431885, + 2.778509241063148, + 0.3351021558046341, + 1.0687156841158867, + 1.2532536201179028, + 0.8553846627473831, + 0.4532025270164013, + 0.18805472180247307, + 0.16935287043452263, + 0.0, + 0.17837311327457428, + 0.7196703087538481, + 0.05484837666153908, + 0.3728121407330036, + 0.4803430438041687, + 0.14728381112217903, + 0.13660608604550362, + 0.20450171642005444, + 0.7695632241666317, + 0.4506562352180481, + 0.085764329880476, + 0.784897156059742, + 0.12333513610064983, + 0.3862004280090332, + 0.9666109532117844, + 1.1061957366764545, + 0.49305295944213867, + 1.3606998845934868, + 1.2579910270869732, + 0.55500727891922, + 0.36393946409225464, + 0.0, + 0.04667949676513672, + 0.1752321943640709, + 0.0, + 0.8272542990744114, + 1.0600724704563618, + 0.0848495289683342, + 0.8755934946238995, + 0.9744157455861568, + 0.33959816861897707, + 1.0216441042721272, + 0.23798073083162308, + 0.04390762001276016, + 0.4164130538702011, + 0.04692578688263893, + 0.08515546098351479, + 0.7185964547097683, + 0.3006801977753639, + 1.5890809707343578 + ], + "unique_experts": 60, + "load_cv": 0.7459380745820066, + "normalized_load_entropy": 0.9305095993806327, + "max_load_share": 0.044270833333333336 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "ordered_topk_exact_tokens": 16, + "set_exact_tokens": 20, + "mean_set_jaccard": 0.9627329192546585, + "mean_token_weighted_tv": 0.01180525686915802, + "aggregate_load_tv": 0.02173913043478261 + }, + "system_bos": { + "tokens": 23, + "ordered_topk_exact_tokens": 17, + "set_exact_tokens": 21, + "mean_set_jaccard": 0.9751552795031057, + "mean_token_weighted_tv": 0.013234190318895422, + "aggregate_load_tv": 0.014492753623188404 + }, + "system_x": { + "tokens": 23, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.9503105590062112, + "mean_token_weighted_tv": 0.01862547773381938, + "aggregate_load_tv": 0.028985507246376812 + }, + "system_period": { + "tokens": 23, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.9254658385093167, + "mean_token_weighted_tv": 0.021539647739542568, + "aggregate_load_tv": 0.036231884057971016 + }, + "bos_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.9503105590062112, + "mean_token_weighted_tv": 0.021500347870523514, + "aggregate_load_tv": 0.02898550724637681 + }, + "bos_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 18, + "mean_set_jaccard": 0.9378881987577641, + "mean_token_weighted_tv": 0.02328404557445775, + "aggregate_load_tv": 0.036231884057971016 + }, + "x_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.9130434782608695, + "mean_token_weighted_tv": 0.02580205156751301, + "aggregate_load_tv": 0.05072463768115942 + }, + "x_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.9254658385093167, + "mean_token_weighted_tv": 0.026457133055057213, + "aggregate_load_tv": 0.043478260869565216 + }, + "period_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.9254658385093167, + "mean_token_weighted_tv": 0.02226043298192646, + "aggregate_load_tv": 0.04347826086956521 + }, + "period_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 7, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8881987577639753, + "mean_token_weighted_tv": 0.030362139415481815, + "aggregate_load_tv": 0.06521739130434782 + } + } + }, + "layer_06": { + "layer": 6, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "34c314d46a8cc364a34330321eaa81ec963022c37d8e098946041bc746f620c0", + "route_weight_sha256": "a1d4d2eebcdabc489f8309b0f13b3437970e047072d8620e88cb0ce1fff50d28", + "loads": [ + 0, + 3, + 2, + 2, + 0, + 2, + 3, + 2, + 3, + 1, + 0, + 1, + 3, + 4, + 1, + 0, + 3, + 0, + 3, + 3, + 0, + 1, + 4, + 0, + 0, + 0, + 6, + 1, + 0, + 1, + 3, + 6, + 4, + 7, + 2, + 0, + 3, + 0, + 6, + 2, + 1, + 2, + 1, + 2, + 5, + 9, + 0, + 5, + 1, + 1, + 1, + 1, + 1, + 1, + 3, + 1, + 5, + 3, + 2, + 0, + 2, + 5, + 4, + 0 + ], + "weighted_loads": [ + 0.0, + 0.34465399011969566, + 0.1971171572804451, + 0.1202603317797184, + 0.0, + 0.11227431148290634, + 0.16210024803876877, + 0.10516774281859398, + 0.2283046543598175, + 0.047133784741163254, + 0.0, + 0.05494144931435585, + 0.27208616584539413, + 0.3980328142642975, + 0.04407334327697754, + 0.0, + 0.2961253374814987, + 0.0, + 0.24521024525165558, + 0.16170179098844528, + 0.0, + 0.05350648984313011, + 0.6790689826011658, + 0.0, + 0.0, + 0.0, + 0.4211858808994293, + 0.096566341817379, + 0.0, + 0.034165460616350174, + 0.1640402488410473, + 0.29004194773733616, + 0.2981859929859638, + 0.7031804323196411, + 0.15271122008562088, + 0.0, + 0.1928485408425331, + 0.0, + 0.4680429585278034, + 0.13080310821533203, + 0.04693405702710152, + 0.15463722124695778, + 0.16708920896053314, + 0.09440890327095985, + 0.3124968186020851, + 0.7018486969172955, + 0.0, + 0.4268895164132118, + 0.06664174050092697, + 0.038991693407297134, + 0.03591766953468323, + 0.08668994158506393, + 0.06569541245698929, + 0.04233217239379883, + 0.19968153163790703, + 0.09951405972242355, + 0.4086868651211262, + 0.10941354930400848, + 0.09076566621661186, + 0.0, + 0.11189312487840652, + 0.2728351131081581, + 0.1912415437400341, + 0.0 + ], + "unique_experts": 49, + "load_cv": 0.9319415313491465, + "normalized_load_entropy": 0.8883139083737648, + "max_load_share": 0.06521739130434782 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "c599c5232f840e9f2c109ac82bb08a59e2c5217ed4597bb89463287c3b7d2887", + "route_weight_sha256": "5b4fda7237407331cb4db90522ed9f5ad6acd410abad13277bf0aa12b5cd3032", + "loads": [ + 0, + 6, + 2, + 2, + 1, + 2, + 11, + 2, + 3, + 1, + 0, + 7, + 3, + 7, + 2, + 0, + 8, + 1, + 3, + 11, + 1, + 4, + 7, + 1, + 0, + 1, + 6, + 1, + 0, + 4, + 3, + 6, + 7, + 7, + 3, + 6, + 3, + 8, + 6, + 11, + 1, + 7, + 3, + 2, + 5, + 14, + 13, + 7, + 5, + 1, + 9, + 8, + 1, + 1, + 3, + 11, + 15, + 3, + 2, + 9, + 2, + 5, + 4, + 0 + ], + "weighted_loads": [ + 0.0, + 0.41512768156826496, + 0.1971171572804451, + 0.1202603317797184, + 0.0286709051579237, + 0.11227431148290634, + 1.0293195843696594, + 0.10516774281859398, + 0.2283046543598175, + 0.047133784741163254, + 0.0, + 0.4072383139282465, + 0.27208616584539413, + 0.4695076746866107, + 0.12187425792217255, + 0.0, + 0.6113954335451126, + 0.004064245615154505, + 0.24521024525165558, + 0.6547447927296162, + 0.04336344450712204, + 0.24347314797341824, + 2.2000198531895876, + 0.035709455609321594, + 0.0, + 0.02751920372247696, + 0.4211858808994293, + 0.096566341817379, + 0.0, + 0.21167699247598648, + 0.1640402488410473, + 0.29004194773733616, + 0.430661179125309, + 0.7031804323196411, + 0.1870146505534649, + 0.549049373716116, + 0.1928485408425331, + 0.6953616626560688, + 0.4680429585278034, + 0.4940901156514883, + 0.04693405702710152, + 0.5510418936610222, + 0.22517569363117218, + 0.09440890327095985, + 0.3124968186020851, + 0.836834208574146, + 1.6792857982218266, + 0.44928741501644254, + 0.2740591410547495, + 0.038991693407297134, + 0.5342686511576176, + 0.39154618605971336, + 0.06569541245698929, + 0.04233217239379883, + 0.19968153163790703, + 0.855914730578661, + 1.8398120440542698, + 0.10941354930400848, + 0.09076566621661186, + 0.9613983072340488, + 0.11189312487840652, + 0.2728351131081581, + 0.1912415437400341, + 0.0 + ], + "unique_experts": 58, + "load_cv": 0.8342587454267337, + "normalized_load_entropy": 0.9137271642623703, + "max_load_share": 0.052083333333333336 + } + }, + "s1_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "b26a883419d6d66a89abb41fd58ea07bbd6d2d18971b35fa19c79320b076fe5b", + "route_weight_sha256": "38ae4aafa5afaab2067ad01cae64b0b791a606db62622c7a0dcd9d1c6febcee7", + "loads": [ + 0, + 3, + 2, + 2, + 0, + 2, + 3, + 2, + 3, + 1, + 0, + 1, + 3, + 4, + 2, + 0, + 3, + 0, + 3, + 3, + 0, + 1, + 4, + 0, + 0, + 0, + 6, + 1, + 0, + 1, + 3, + 5, + 4, + 7, + 2, + 0, + 3, + 0, + 6, + 2, + 2, + 2, + 1, + 2, + 5, + 9, + 0, + 6, + 1, + 0, + 1, + 1, + 1, + 1, + 3, + 1, + 5, + 3, + 2, + 0, + 2, + 5, + 3, + 0 + ], + "weighted_loads": [ + 0.0, + 0.35197722911834717, + 0.19468311220407486, + 0.12531853094696999, + 0.0, + 0.1143033616244793, + 0.15407902374863625, + 0.1069868914783001, + 0.22705557197332382, + 0.047510478645563126, + 0.0, + 0.05516933277249336, + 0.27372849732637405, + 0.3975470960140228, + 0.08828547224402428, + 0.0, + 0.2966509535908699, + 0.0, + 0.24302484095096588, + 0.16066092252731323, + 0.0, + 0.049486346542835236, + 0.7051966264843941, + 0.0, + 0.0, + 0.0, + 0.4123806431889534, + 0.10045155137777328, + 0.0, + 0.034700680524110794, + 0.16496579349040985, + 0.2496098279953003, + 0.29800890386104584, + 0.6678641252219677, + 0.15204108878970146, + 0.0, + 0.19537897780537605, + 0.0, + 0.4599955715239048, + 0.13760683685541153, + 0.0885353609919548, + 0.15947669371962547, + 0.15709073841571808, + 0.09671741351485252, + 0.3129258416593075, + 0.679420817643404, + 0.0, + 0.46293408796191216, + 0.06473542749881744, + 0.0, + 0.03647421672940254, + 0.08712274581193924, + 0.06608652323484421, + 0.047181982547044754, + 0.20036455616354942, + 0.09822362661361694, + 0.3958162032067776, + 0.11461656913161278, + 0.08919135853648186, + 0.0, + 0.10355721414089203, + 0.26974644511938095, + 0.1529761590063572, + 0.0 + ], + "unique_experts": 48, + "load_cv": 0.9283284660133794, + "normalized_load_entropy": 0.8874022084919249, + "max_load_share": 0.06521739130434782 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "f2d216a1544e4b58230a10b55cd9dd100188636b0e735a332be98d466c21703d", + "route_weight_sha256": "dd59b7886f3b2f95ea38a8918cabbcd47e7104f69599f87435b670ac3503b701", + "loads": [ + 0, + 5, + 5, + 3, + 2, + 2, + 17, + 3, + 8, + 7, + 0, + 11, + 7, + 7, + 10, + 1, + 13, + 1, + 5, + 13, + 2, + 5, + 6, + 1, + 1, + 1, + 6, + 2, + 1, + 4, + 3, + 8, + 11, + 8, + 6, + 8, + 4, + 16, + 6, + 11, + 2, + 7, + 3, + 2, + 6, + 13, + 17, + 8, + 4, + 0, + 10, + 7, + 2, + 4, + 3, + 12, + 22, + 3, + 2, + 11, + 8, + 5, + 3, + 0 + ], + "weighted_loads": [ + 0.0, + 0.3916772869415581, + 0.33554037287831306, + 0.16270536556839943, + 0.1503087915480137, + 0.1143033616244793, + 1.385596053674817, + 0.1684100702404976, + 0.5692052319645882, + 0.7559803165495396, + 0.0, + 0.6812149807810783, + 0.6030670255422592, + 0.4696894399821758, + 0.7017719745635986, + 0.11254264414310455, + 1.0378388166427612, + 0.004065376240760088, + 0.3923712410032749, + 0.8629863858222961, + 0.09186676144599915, + 0.3182895127683878, + 2.196551389992237, + 0.03530333563685417, + 0.03236652910709381, + 0.0353744812309742, + 0.4123806431889534, + 0.12684177048504353, + 0.035971272736787796, + 0.23767834156751633, + 0.16496579349040985, + 0.4480810798704624, + 0.5564527716487646, + 0.701575256884098, + 0.41262630373239517, + 0.7678648270666599, + 0.22934892028570175, + 1.266828753054142, + 0.4599955715239048, + 0.6152032986283302, + 0.0885353609919548, + 0.5705525651574135, + 0.2150583490729332, + 0.09671741351485252, + 0.39712345227599144, + 0.7789856905583292, + 2.025128722190857, + 0.4853587120305747, + 0.2358890026807785, + 0.0, + 0.6369648762047291, + 0.3247777633368969, + 0.10322587937116623, + 0.21571318805217743, + 0.20036455616354942, + 1.1058689951896667, + 2.445683255791664, + 0.11461656913161278, + 0.08919135853648186, + 1.0591862387955189, + 0.40883444994688034, + 0.26974644511938095, + 0.1529761590063572, + 0.0 + ], + "unique_experts": 60, + "load_cv": 0.7927623996016853, + "normalized_load_entropy": 0.9246594634329288, + "max_load_share": 0.057291666666666664 + } + }, + "s0_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "348b9e030a04cb427a6d9d45df1d025f8641543fe17d086b12485f78dd2b9b3e", + "route_weight_sha256": "3258eb28944e54fe1ead30b4c7016da7779a1b4244d8b7173a1e07568b6560c6", + "loads": [ + 0, + 3, + 2, + 2, + 0, + 2, + 3, + 2, + 3, + 1, + 0, + 1, + 3, + 4, + 0, + 0, + 3, + 0, + 3, + 3, + 0, + 1, + 4, + 0, + 0, + 0, + 6, + 1, + 0, + 1, + 3, + 6, + 4, + 8, + 2, + 0, + 3, + 0, + 7, + 1, + 1, + 2, + 1, + 2, + 5, + 8, + 0, + 5, + 1, + 1, + 1, + 1, + 1, + 1, + 4, + 1, + 4, + 3, + 4, + 0, + 2, + 5, + 3, + 0 + ], + "weighted_loads": [ + 0.0, + 0.3851314075291157, + 0.1860184744000435, + 0.12020233273506165, + 0.0, + 0.1108255684375763, + 0.16291068494319916, + 0.10266120359301567, + 0.23932712525129318, + 0.04262431338429451, + 0.0, + 0.05533742904663086, + 0.2670971676707268, + 0.4034816473722458, + 0.0, + 0.0, + 0.30335237085819244, + 0.0, + 0.2384566366672516, + 0.16703608632087708, + 0.0, + 0.049949005246162415, + 0.7178974747657776, + 0.0, + 0.0, + 0.0, + 0.44819730892777443, + 0.08718511462211609, + 0.0, + 0.034850988537073135, + 0.14752713963389397, + 0.3031907118856907, + 0.3100714087486267, + 0.7523262910544872, + 0.15994496271014214, + 0.0, + 0.19933290407061577, + 0.0, + 0.5373468399047852, + 0.06496468186378479, + 0.04272958263754845, + 0.16247062385082245, + 0.15757130086421967, + 0.09667018055915833, + 0.2955511622130871, + 0.6452351585030556, + 0.0, + 0.43558333441615105, + 0.06739712506532669, + 0.04463031515479088, + 0.03633030131459236, + 0.07225240767002106, + 0.06589722633361816, + 0.042677298188209534, + 0.2528694197535515, + 0.0999046266078949, + 0.36495135724544525, + 0.12301567941904068, + 0.17224802821874619, + 0.0, + 0.1280505135655403, + 0.27503594383597374, + 0.14319851621985435, + 0.0 + ], + "unique_experts": 48, + "load_cv": 0.9498007175542577, + "normalized_load_entropy": 0.8830587640401228, + "max_load_share": 0.057971014492753624 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "36ed01836019f9e257f90e781124ecd72d223d70d5b4010d54aa4089c26d3702", + "route_weight_sha256": "2f13663d4a69b8be9cef783d6048ba837a489d29f231a93bdcfa0ea3e8284da6", + "loads": [ + 0, + 6, + 2, + 2, + 1, + 2, + 11, + 2, + 3, + 1, + 0, + 7, + 3, + 5, + 3, + 1, + 9, + 0, + 3, + 11, + 1, + 4, + 6, + 1, + 0, + 1, + 6, + 1, + 0, + 5, + 3, + 6, + 7, + 8, + 3, + 6, + 3, + 9, + 7, + 10, + 1, + 7, + 4, + 2, + 5, + 12, + 13, + 6, + 5, + 1, + 8, + 8, + 1, + 1, + 4, + 11, + 14, + 3, + 4, + 9, + 2, + 5, + 3, + 0 + ], + "weighted_loads": [ + 0.0, + 0.4953512270003557, + 0.1860184744000435, + 0.12020233273506165, + 0.0286709051579237, + 0.1108255684375763, + 1.1286383531987667, + 0.10266120359301567, + 0.23932712525129318, + 0.04262431338429451, + 0.0, + 0.4219738934189081, + 0.2670971676707268, + 0.42659963853657246, + 0.1812305524945259, + 0.04745270311832428, + 0.656314805150032, + 0.0, + 0.2384566366672516, + 0.6565190963447094, + 0.04336344450712204, + 0.22719831205904484, + 1.2912693191319704, + 0.035709455609321594, + 0.0, + 0.02751920372247696, + 0.44819730892777443, + 0.08718511462211609, + 0.0, + 0.2568518668413162, + 0.14752713963389397, + 0.3031907118856907, + 0.44628095999360085, + 0.7523262910544872, + 0.19424839317798615, + 0.5530477054417133, + 0.19933290407061577, + 0.7125398479402065, + 0.5373468399047852, + 0.4241069983690977, + 0.04272958263754845, + 0.5588752962648869, + 0.26318852975964546, + 0.09667018055915833, + 0.2955511622130871, + 0.776184443384409, + 1.741332646459341, + 0.4547218047082424, + 0.2720526847988367, + 0.04463031515479088, + 0.5333421714603901, + 0.3771086521446705, + 0.06589722633361816, + 0.042677298188209534, + 0.2528694197535515, + 0.8563052974641323, + 1.7992035821080208, + 0.12301567941904068, + 0.17224802821874619, + 0.9613983072340488, + 0.1280505135655403, + 0.27503594383597374, + 0.14319851621985435, + 0.0 + ], + "unique_experts": 58, + "load_cv": 0.7993052538854533, + "normalized_load_entropy": 0.9184229676064901, + "max_load_share": 0.04861111111111111 + } + }, + "s1_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "c389b3a424835aefb7e8f179259109563d387eda0ab5e1bd3fa28ec0c0682139", + "route_weight_sha256": "bae9ae7eb04233367023209d33163bdaa0a1b34b44e03672536e262f54fe8065", + "loads": [ + 0, + 3, + 2, + 2, + 0, + 2, + 3, + 2, + 3, + 1, + 0, + 1, + 3, + 4, + 0, + 0, + 3, + 0, + 3, + 3, + 0, + 1, + 4, + 0, + 0, + 0, + 6, + 1, + 0, + 1, + 3, + 5, + 4, + 9, + 2, + 0, + 3, + 0, + 6, + 1, + 1, + 2, + 1, + 2, + 5, + 9, + 0, + 4, + 1, + 1, + 1, + 1, + 2, + 1, + 4, + 1, + 3, + 4, + 4, + 0, + 2, + 5, + 3, + 0 + ], + "weighted_loads": [ + 0.0, + 0.39468343555927277, + 0.1894037202000618, + 0.12921007350087166, + 0.0, + 0.11216732114553452, + 0.16168342158198357, + 0.1099783144891262, + 0.24521047621965408, + 0.044577810913324356, + 0.0, + 0.0507446750998497, + 0.2803904488682747, + 0.41314760595560074, + 0.0, + 0.0, + 0.302379347383976, + 0.0, + 0.24889840185642242, + 0.165214654058218, + 0.0, + 0.05300462245941162, + 0.6990822330117226, + 0.0, + 0.0, + 0.0, + 0.42892247810959816, + 0.07846265286207199, + 0.0, + 0.03503548353910446, + 0.155197162181139, + 0.26974355801939964, + 0.3039044328033924, + 0.7902918122708797, + 0.16073869168758392, + 0.0, + 0.19968446716666222, + 0.0, + 0.48268746212124825, + 0.06420988589525223, + 0.04527120664715767, + 0.15478654950857162, + 0.18196770548820496, + 0.09687982127070427, + 0.3003219813108444, + 0.678695771843195, + 0.0, + 0.4043796509504318, + 0.06413350999355316, + 0.04289376363158226, + 0.0341082327067852, + 0.07340238243341446, + 0.098079614341259, + 0.04658907651901245, + 0.261044155806303, + 0.10201626271009445, + 0.31194963306188583, + 0.15294479951262474, + 0.1770080141723156, + 0.0, + 0.11605923995375633, + 0.2782664969563484, + 0.14168108999729156, + 0.0 + ], + "unique_experts": 48, + "load_cv": 0.9568510632025544, + "normalized_load_entropy": 0.8837747476493517, + "max_load_share": 0.06521739130434782 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "591f354cd5cfecff5977e36b864cb8a74125d5b690585f5e93fa709d059199fb", + "route_weight_sha256": "ef81eb6ecc1c053da8e333af600f1b05d27481b8219819e900a1cf2f49c021a6", + "loads": [ + 0, + 4, + 5, + 3, + 2, + 2, + 18, + 3, + 8, + 7, + 0, + 11, + 7, + 6, + 9, + 2, + 14, + 0, + 5, + 13, + 2, + 5, + 5, + 1, + 1, + 1, + 6, + 2, + 1, + 4, + 3, + 8, + 11, + 10, + 6, + 8, + 4, + 17, + 6, + 10, + 1, + 7, + 3, + 2, + 6, + 12, + 17, + 6, + 4, + 1, + 10, + 7, + 3, + 4, + 4, + 12, + 20, + 4, + 4, + 11, + 8, + 5, + 3, + 0 + ], + "weighted_loads": [ + 0.0, + 0.42962123081088066, + 0.3302609808743, + 0.1665969081223011, + 0.1503087915480137, + 0.11216732114553452, + 1.4664318393915892, + 0.1714014932513237, + 0.5873601362109184, + 0.7530476488173008, + 0.0, + 0.6935338787734509, + 0.6097289770841599, + 0.47879612632095814, + 0.6715803071856499, + 0.16559594124555588, + 1.0820272751152515, + 0.0, + 0.39824480190873146, + 0.8639483079314232, + 0.09186676144599915, + 0.30775335617363453, + 1.2445817962288857, + 0.03530333563685417, + 0.03236652910709381, + 0.0353744812309742, + 0.42892247810959816, + 0.10485287196934223, + 0.035971272736787796, + 0.23633136972784996, + 0.155197162181139, + 0.46821480989456177, + 0.5740395803004503, + 0.8240029439330101, + 0.42132390663027763, + 0.7914606593549252, + 0.23365440964698792, + 1.3312715515494347, + 0.48268746212124825, + 0.5418063476681709, + 0.04527120664715767, + 0.5658624209463596, + 0.23993531614542007, + 0.09687982127070427, + 0.3845195919275284, + 0.774487279355526, + 2.0998375080525875, + 0.4790899232029915, + 0.24293236061930656, + 0.04289376363158226, + 0.6701084263622761, + 0.3110573999583721, + 0.13521897047758102, + 0.21512028202414513, + 0.261044155806303, + 1.1096616312861443, + 2.3860866725444794, + 0.15294479951262474, + 0.1770080141723156, + 1.0591862387955189, + 0.42133647575974464, + 0.2782664969563484, + 0.14168108999729156, + 0.0 + ], + "unique_experts": 60, + "load_cv": 0.7795119555779045, + "normalized_load_entropy": 0.927133828118656, + "max_load_share": 0.052083333333333336 + } + }, + "s0_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "03149d0c2b79c103d2bde784f811dbe70576b278fc1d1a205d0e5bf0f4be159d", + "route_weight_sha256": "85b1efe0e8a63eff6671d699edffd381eeab85f595104a501db409fa35b718e8", + "loads": [ + 0, + 3, + 2, + 2, + 0, + 2, + 3, + 2, + 3, + 1, + 0, + 1, + 3, + 4, + 2, + 0, + 3, + 0, + 3, + 3, + 0, + 1, + 4, + 0, + 0, + 0, + 6, + 1, + 0, + 1, + 3, + 5, + 4, + 8, + 2, + 0, + 3, + 0, + 7, + 1, + 2, + 2, + 1, + 2, + 5, + 8, + 0, + 5, + 1, + 1, + 1, + 1, + 1, + 0, + 3, + 1, + 4, + 3, + 4, + 0, + 2, + 5, + 3, + 0 + ], + "weighted_loads": [ + 0.0, + 0.38511785864830017, + 0.1772110015153885, + 0.11599268391728401, + 0.0, + 0.09595023095607758, + 0.20490214601159096, + 0.10329751670360565, + 0.24680814519524574, + 0.043442364782094955, + 0.0, + 0.059996046125888824, + 0.2562650740146637, + 0.4097379185259342, + 0.08053542673587799, + 0.0, + 0.3123870864510536, + 0.0, + 0.22938595712184906, + 0.16662205010652542, + 0.0, + 0.051778435707092285, + 0.6794403120875359, + 0.0, + 0.0, + 0.0, + 0.4462040439248085, + 0.08282694220542908, + 0.0, + 0.03319093585014343, + 0.14244255051016808, + 0.2416976448148489, + 0.3046000637114048, + 0.7507089357823133, + 0.1592964045703411, + 0.0, + 0.19580825418233871, + 0.0, + 0.5273447483778, + 0.06254977732896805, + 0.0876854658126831, + 0.16173344105482101, + 0.1417323797941208, + 0.09921430796384811, + 0.2927403822541237, + 0.6699474155902863, + 0.0, + 0.4102974496781826, + 0.06540278345346451, + 0.042480893433094025, + 0.03933335468173027, + 0.0737394243478775, + 0.06555061042308807, + 0.0, + 0.2151242271065712, + 0.10349447280168533, + 0.3579514604061842, + 0.12113092467188835, + 0.17302173376083374, + 0.0, + 0.12079140916466713, + 0.26888200640678406, + 0.13896392658352852, + 0.0 + ], + "unique_experts": 48, + "load_cv": 0.9283284660133794, + "normalized_load_entropy": 0.8868573715615318, + "max_load_share": 0.057971014492753624 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "31c44fbe9dbd0bf48ded731bf3e06e77bf63ec8565fbc1fd357f00040bad883e", + "route_weight_sha256": "d762a2702a803511f6fb696fdbca58ab2b4d35fe88c7a7700447f6ae9fc1174a", + "loads": [ + 0, + 5, + 2, + 2, + 1, + 2, + 13, + 2, + 3, + 1, + 0, + 6, + 3, + 6, + 5, + 1, + 8, + 0, + 3, + 12, + 1, + 4, + 6, + 1, + 0, + 1, + 6, + 1, + 0, + 4, + 3, + 5, + 7, + 8, + 3, + 6, + 3, + 9, + 7, + 9, + 2, + 9, + 4, + 2, + 5, + 12, + 12, + 6, + 5, + 1, + 6, + 9, + 1, + 0, + 3, + 12, + 13, + 3, + 4, + 10, + 2, + 5, + 3, + 0 + ], + "weighted_loads": [ + 0.0, + 0.4508297014981508, + 0.1772110015153885, + 0.11599268391728401, + 0.0286709051579237, + 0.09595023095607758, + 1.4687228426337242, + 0.10329751670360565, + 0.24680814519524574, + 0.043442364782094955, + 0.0, + 0.3743013199418783, + 0.2562650740146637, + 0.4724793080240488, + 0.26128173619508743, + 0.04413587972521782, + 0.6233431287109852, + 0.0, + 0.22938595712184906, + 0.7223939076066017, + 0.04336344450712204, + 0.2188547272235155, + 1.2528121564537287, + 0.035709455609321594, + 0.0, + 0.02751920372247696, + 0.4462040439248085, + 0.08282694220542908, + 0.0, + 0.21404818072915077, + 0.14244255051016808, + 0.2416976448148489, + 0.43352799117565155, + 0.7507089357823133, + 0.19359983503818512, + 0.5954462178051472, + 0.19580825418233871, + 0.6630673110485077, + 0.5273447483778, + 0.37955708615481853, + 0.0876854658126831, + 0.6976513564586639, + 0.23326843604445457, + 0.09921430796384811, + 0.2927403822541237, + 0.8008967004716396, + 1.4274534918367863, + 0.42943591997027397, + 0.27836072258651257, + 0.042480893433094025, + 0.4078179635107517, + 0.413381427526474, + 0.06555061042308807, + 0.0, + 0.2151242271065712, + 0.9160622470080853, + 1.5484435949474573, + 0.12113092467188835, + 0.17302173376083374, + 1.035417314618826, + 0.12079140916466713, + 0.26888200640678406, + 0.13896392658352852, + 0.0 + ], + "unique_experts": 57, + "load_cv": 0.8108066399625791, + "normalized_load_entropy": 0.9160815754647675, + "max_load_share": 0.04513888888888889 + } + }, + "s1_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "476f6441d7af76409a9a6ba4ab10acbb9b7a7fc82e8980dba7b3fb359ac6dc9b", + "route_weight_sha256": "1256cddb40689fd14891996fbaccc7f27028e31d5b26e1cc1b1376385a666795", + "loads": [ + 0, + 3, + 2, + 2, + 0, + 2, + 3, + 2, + 3, + 1, + 0, + 1, + 3, + 4, + 1, + 0, + 3, + 0, + 3, + 3, + 0, + 1, + 4, + 0, + 0, + 0, + 6, + 1, + 0, + 1, + 3, + 5, + 4, + 8, + 2, + 0, + 3, + 0, + 7, + 1, + 3, + 2, + 1, + 2, + 5, + 8, + 0, + 5, + 1, + 1, + 1, + 1, + 2, + 0, + 4, + 1, + 3, + 2, + 4, + 0, + 2, + 5, + 3, + 0 + ], + "weighted_loads": [ + 0.0, + 0.3929139971733093, + 0.17926818132400513, + 0.12114623188972473, + 0.0, + 0.11265907064080238, + 0.20687101036310196, + 0.11173645034432411, + 0.25539015606045723, + 0.04702378809452057, + 0.0, + 0.05462375655770302, + 0.2752297595143318, + 0.40960343182086945, + 0.03908525034785271, + 0.0, + 0.31152644753456116, + 0.0, + 0.24246608465909958, + 0.1625862754881382, + 0.0, + 0.05304369702935219, + 0.6872161254286766, + 0.0, + 0.0, + 0.0, + 0.43611134588718414, + 0.07787877321243286, + 0.0, + 0.03180410712957382, + 0.14914162456989288, + 0.24528948217630386, + 0.2828802205622196, + 0.7394158095121384, + 0.15964049100875854, + 0.0, + 0.19812802597880363, + 0.0, + 0.5145078413188457, + 0.06639513373374939, + 0.12250452116131783, + 0.1515585519373417, + 0.14895331859588623, + 0.09434843063354492, + 0.2929106131196022, + 0.6744993440806866, + 0.0, + 0.4392240084707737, + 0.06175706908106804, + 0.043825965374708176, + 0.03474796190857887, + 0.07365275174379349, + 0.09861737303435802, + 0.0, + 0.26219717040657997, + 0.10823754221200943, + 0.29095135629177094, + 0.0814354345202446, + 0.1804579719901085, + 0.0, + 0.11905933916568756, + 0.2736992798745632, + 0.1440548337996006, + 0.0 + ], + "unique_experts": 48, + "load_cv": 0.9283284660133794, + "normalized_load_entropy": 0.8868573715615318, + "max_load_share": 0.057971014492753624 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "0ea18b2905b408555835fafcd229089ea52262fc63d3050007a0e48a645a7519", + "route_weight_sha256": "5d0bf67367be9eccd52db72a6006b0e639fba8cf37d6149ce58a7e4c42840f30", + "loads": [ + 0, + 4, + 5, + 3, + 2, + 2, + 21, + 3, + 8, + 7, + 0, + 10, + 7, + 6, + 10, + 2, + 12, + 0, + 5, + 15, + 2, + 5, + 5, + 1, + 2, + 1, + 6, + 2, + 1, + 4, + 3, + 8, + 10, + 9, + 6, + 8, + 4, + 15, + 7, + 10, + 3, + 9, + 3, + 2, + 6, + 11, + 15, + 6, + 4, + 1, + 9, + 8, + 3, + 3, + 4, + 13, + 19, + 2, + 4, + 12, + 8, + 5, + 3, + 0 + ], + "weighted_loads": [ + 0.0, + 0.4278517924249172, + 0.32012544199824333, + 0.15853306651115417, + 0.1503087915480137, + 0.11265907064080238, + 1.8993026819080114, + 0.1731596291065216, + 0.5975398160517216, + 0.755493625998497, + 0.0, + 0.652263455092907, + 0.604568287730217, + 0.4765039924532175, + 0.7118722498416901, + 0.18016210943460464, + 1.0125816613435745, + 0.0, + 0.3918124847114086, + 0.9654282294213772, + 0.09186676144599915, + 0.3004447501152754, + 1.2327156886458397, + 0.03530333563685417, + 0.06629723310470581, + 0.0353744812309742, + 0.43611134588718414, + 0.1042689923197031, + 0.035971272736787796, + 0.23225676640868187, + 0.14914162456989288, + 0.443760734051466, + 0.5102677624672651, + 0.7731269411742687, + 0.42022570595145226, + 0.795796412974596, + 0.23209796845912933, + 1.143485713750124, + 0.5145078413188457, + 0.5439915955066681, + 0.12250452116131783, + 0.6940650343894958, + 0.20692092925310135, + 0.09434843063354492, + 0.37710822373628616, + 0.7702908515930176, + 1.7060119546949863, + 0.45836247876286507, + 0.23950519040226936, + 0.043825965374708176, + 0.5779725797474384, + 0.34058806486427784, + 0.13575672917068005, + 0.16853120550513268, + 0.26219717040657997, + 1.186813086271286, + 2.065212167799473, + 0.0814354345202446, + 0.1804579719901085, + 1.1310047842562199, + 0.4243365749716759, + 0.2736992798745632, + 0.1440548337996006, + 0.0 + ], + "unique_experts": 60, + "load_cv": 0.7711148134717395, + "normalized_load_entropy": 0.9290850438688512, + "max_load_share": 0.0546875 + } + }, + "s0_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "649c30497bb51cebf44d70d055101992b33a85986a959354eea3e0b2ccb54bc8", + "route_weight_sha256": "6e7d043ff87968d6b0ed1bf8dadb1f75ec00220cd2e3295232833046920f3b2b", + "loads": [ + 0, + 3, + 2, + 2, + 0, + 2, + 3, + 2, + 3, + 1, + 0, + 1, + 3, + 4, + 0, + 0, + 3, + 0, + 3, + 3, + 0, + 1, + 4, + 0, + 0, + 0, + 6, + 1, + 0, + 1, + 3, + 5, + 4, + 8, + 2, + 0, + 3, + 0, + 7, + 1, + 2, + 2, + 1, + 2, + 5, + 8, + 1, + 5, + 1, + 1, + 1, + 1, + 2, + 0, + 4, + 1, + 3, + 3, + 4, + 0, + 2, + 5, + 3, + 0 + ], + "weighted_loads": [ + 0.0, + 0.3675072118639946, + 0.18322528153657913, + 0.11828074604272842, + 0.0, + 0.09597864001989365, + 0.19798266142606735, + 0.10535385459661484, + 0.24952317401766777, + 0.04554784670472145, + 0.0, + 0.05818048492074013, + 0.2558779790997505, + 0.4087872765958309, + 0.0, + 0.0, + 0.31504493206739426, + 0.0, + 0.2321036010980606, + 0.17264487594366074, + 0.0, + 0.05461440235376358, + 0.6981823220849037, + 0.0, + 0.0, + 0.0, + 0.4432707726955414, + 0.07996252924203873, + 0.0, + 0.033079128712415695, + 0.15339702740311623, + 0.249198816716671, + 0.3096354566514492, + 0.7327933255583048, + 0.16148360073566437, + 0.0, + 0.19732778146862984, + 0.0, + 0.5126503668725491, + 0.06182381138205528, + 0.08918073400855064, + 0.16211733222007751, + 0.14732712507247925, + 0.09567667916417122, + 0.29197316616773605, + 0.6507293917238712, + 0.03707275539636612, + 0.4246574901044369, + 0.0657244548201561, + 0.04215862229466438, + 0.039410416036844254, + 0.07532718777656555, + 0.09297347441315651, + 0.0, + 0.25997747853398323, + 0.10515274107456207, + 0.3397917151451111, + 0.11623802781105042, + 0.17683107033371925, + 0.0, + 0.11640447750687599, + 0.26589079201221466, + 0.13898928463459015, + 0.0 + ], + "unique_experts": 48, + "load_cv": 0.9283284660133794, + "normalized_load_entropy": 0.8868573715615318, + "max_load_share": 0.057971014492753624 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "c64d3e4c82f4683c9e44ffd1d46a0e9f2e84e6646a32ada0aa874e057eb9ea79", + "route_weight_sha256": "d54fbdff1197bb63a4601ba950dec4138c1681ee8b0ebc3b064ec664a0532037", + "loads": [ + 0, + 5, + 2, + 2, + 1, + 2, + 13, + 2, + 3, + 1, + 0, + 6, + 4, + 6, + 2, + 1, + 8, + 0, + 3, + 13, + 1, + 4, + 6, + 1, + 0, + 1, + 6, + 1, + 1, + 4, + 3, + 5, + 7, + 8, + 3, + 6, + 3, + 9, + 7, + 9, + 2, + 8, + 4, + 2, + 5, + 12, + 13, + 6, + 5, + 1, + 6, + 9, + 2, + 0, + 4, + 12, + 12, + 3, + 4, + 9, + 2, + 5, + 3, + 0 + ], + "weighted_loads": [ + 0.0, + 0.43321905471384525, + 0.18322528153657913, + 0.11828074604272842, + 0.0286709051579237, + 0.09597864001989365, + 1.3295276761054993, + 0.10535385459661484, + 0.24952317401766777, + 0.04554784670472145, + 0.0, + 0.3679922316223383, + 0.3087266683578491, + 0.4744009245187044, + 0.13276297226548195, + 0.03735201805830002, + 0.6130271926522255, + 0.0, + 0.2321036010980606, + 0.8168557398021221, + 0.04336344450712204, + 0.22670346684753895, + 1.2715541664510965, + 0.035709455609321594, + 0.0, + 0.02751920372247696, + 0.4432707726955414, + 0.07996252924203873, + 0.10543877631425858, + 0.21182171255350113, + 0.15339702740311623, + 0.249198816716671, + 0.44498495012521744, + 0.7327933255583048, + 0.19578703120350838, + 0.5902134887874126, + 0.19732778146862984, + 0.7596795484423637, + 0.5126503668725491, + 0.37883112020790577, + 0.08918073400855064, + 0.6147074289619923, + 0.24189915508031845, + 0.09567667916417122, + 0.29197316616773605, + 0.7816786766052246, + 1.5028982497751713, + 0.44379596039652824, + 0.2716501150280237, + 0.04215862229466438, + 0.4077109880745411, + 0.41407132148742676, + 0.09297347441315651, + 0.0, + 0.25997747853398323, + 1.0099889002740383, + 1.5203497111797333, + 0.11623802781105042, + 0.17683107033371925, + 0.9613983072340488, + 0.11640447750687599, + 0.26589079201221466, + 0.13898928463459015, + 0.0 + ], + "unique_experts": 58, + "load_cv": 0.8041174903405627, + "normalized_load_entropy": 0.9191212340877171, + "max_load_share": 0.04513888888888889 + } + }, + "s1_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "e2416e4263acf47a0657ddfe07217cac0b02f235295e6d6fbd7b018b253cd6c2", + "route_weight_sha256": "8d5b1a09648c207398757508ec157e19a212ce3544d9499cdcee84a968498ded", + "loads": [ + 0, + 3, + 2, + 2, + 0, + 2, + 3, + 2, + 3, + 1, + 0, + 1, + 3, + 4, + 0, + 0, + 3, + 0, + 3, + 3, + 0, + 1, + 4, + 0, + 0, + 0, + 6, + 1, + 0, + 1, + 3, + 6, + 4, + 8, + 2, + 0, + 3, + 0, + 7, + 1, + 2, + 2, + 1, + 2, + 5, + 8, + 0, + 5, + 1, + 1, + 1, + 1, + 2, + 1, + 4, + 1, + 3, + 2, + 4, + 0, + 2, + 5, + 3, + 0 + ], + "weighted_loads": [ + 0.0, + 0.38734228163957596, + 0.18053924292325974, + 0.12290683388710022, + 0.0, + 0.11369385197758675, + 0.20865900069475174, + 0.11133838817477226, + 0.2539636604487896, + 0.04738367721438408, + 0.0, + 0.05265717953443527, + 0.27086449414491653, + 0.412963192909956, + 0.0, + 0.0, + 0.31139951199293137, + 0.0, + 0.24452614784240723, + 0.16400078684091568, + 0.0, + 0.05579201504588127, + 0.6862605437636375, + 0.0, + 0.0, + 0.0, + 0.4296210929751396, + 0.07110923528671265, + 0.0, + 0.031369972974061966, + 0.15276658907532692, + 0.2897332198917866, + 0.2942262440919876, + 0.7360075283795595, + 0.1604657992720604, + 0.0, + 0.19673331081867218, + 0.0, + 0.512021005153656, + 0.06564179062843323, + 0.08738524094223976, + 0.15419696271419525, + 0.1565210372209549, + 0.09206266328692436, + 0.28694866225123405, + 0.6513673737645149, + 0.0, + 0.4389732927083969, + 0.06323198974132538, + 0.04212170094251633, + 0.03524765372276306, + 0.07278046011924744, + 0.10039006173610687, + 0.03933059051632881, + 0.26395364850759506, + 0.10791859030723572, + 0.3037784770131111, + 0.08103026822209358, + 0.18257244303822517, + 0.0, + 0.11704575270414352, + 0.26730215549468994, + 0.14500229060649872, + 0.0 + ], + "unique_experts": 48, + "load_cv": 0.9391259616998502, + "normalized_load_entropy": 0.8854742229773209, + "max_load_share": 0.057971014492753624 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "21e80bd5cf00301876672533f3289692d533851ce9b9e9348e2805d0b0c39831", + "route_weight_sha256": "b386f36802245ef1a76cbf780172db674579b24e70ad3d59cafa2aa2916c5959", + "loads": [ + 0, + 4, + 5, + 3, + 2, + 2, + 21, + 3, + 8, + 7, + 0, + 10, + 8, + 5, + 9, + 2, + 12, + 0, + 5, + 15, + 2, + 5, + 5, + 1, + 2, + 1, + 6, + 2, + 2, + 4, + 3, + 9, + 10, + 9, + 6, + 8, + 4, + 16, + 7, + 10, + 2, + 8, + 3, + 2, + 6, + 11, + 16, + 7, + 3, + 1, + 8, + 8, + 3, + 4, + 4, + 13, + 19, + 2, + 4, + 11, + 8, + 5, + 3, + 0 + ], + "weighted_loads": [ + 0.0, + 0.42228007689118385, + 0.32139650359749794, + 0.16029366850852966, + 0.1503087915480137, + 0.11369385197758675, + 1.7646347004920244, + 0.17276156693696976, + 0.5961133204400539, + 0.7558535151183605, + 0.0, + 0.6527602858841419, + 0.6659247130155563, + 0.43608118407428265, + 0.6732426322996616, + 0.16597576811909676, + 1.0087315179407597, + 0.0, + 0.39387254789471626, + 1.0631316751241684, + 0.09186676144599915, + 0.30011085979640484, + 1.2317601069808006, + 0.03530333563685417, + 0.06725407764315605, + 0.0353744812309742, + 0.4296210929751396, + 0.09749945439398289, + 0.15845051780343056, + 0.23383259773254395, + 0.15276658907532692, + 0.4882044717669487, + 0.5178256202489138, + 0.7697186600416899, + 0.4210510142147541, + 0.8089298941195011, + 0.23070325329899788, + 1.2910106889903545, + 0.512021005153656, + 0.5432382524013519, + 0.08738524094223976, + 0.6086161769926548, + 0.21448864787817, + 0.09206266328692436, + 0.371146272867918, + 0.7471588812768459, + 1.7484488300979137, + 0.500469509512186, + 0.1668020896613598, + 0.04212170094251633, + 0.5274419710040092, + 0.3436359278857708, + 0.1375294178724289, + 0.2078617960214615, + 0.26395364850759506, + 1.2457113415002823, + 2.081115387380123, + 0.08103026822209358, + 0.18257244303822517, + 1.0591862387955189, + 0.42232298851013184, + 0.26730215549468994, + 0.14500229060649872, + 0.0 + ], + "unique_experts": 60, + "load_cv": 0.7761640004248815, + "normalized_load_entropy": 0.9288925951089352, + "max_load_share": 0.0546875 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "ordered_topk_exact_tokens": 20, + "set_exact_tokens": 20, + "mean_set_jaccard": 0.9627329192546585, + "mean_token_weighted_tv": 0.011552945953672346, + "aggregate_load_tv": 0.021739130434782608 + }, + "system_bos": { + "tokens": 23, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.9503105590062112, + "mean_token_weighted_tv": 0.01512784494653992, + "aggregate_load_tv": 0.02898550724637681 + }, + "system_x": { + "tokens": 23, + "ordered_topk_exact_tokens": 16, + "set_exact_tokens": 20, + "mean_set_jaccard": 0.9627329192546583, + "mean_token_weighted_tv": 0.01592035146187181, + "aggregate_load_tv": 0.021739130434782608 + }, + "system_period": { + "tokens": 23, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.9503105590062112, + "mean_token_weighted_tv": 0.01737281987848489, + "aggregate_load_tv": 0.014492753623188404 + }, + "bos_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 18, + "mean_set_jaccard": 0.9378881987577641, + "mean_token_weighted_tv": 0.022657591080212074, + "aggregate_load_tv": 0.036231884057971016 + }, + "bos_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8881987577639753, + "mean_token_weighted_tv": 0.028853793102114098, + "aggregate_load_tv": 0.057971014492753624 + }, + "x_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 16, + "set_exact_tokens": 18, + "mean_set_jaccard": 0.9285714285714286, + "mean_token_weighted_tv": 0.025365962768378464, + "aggregate_load_tv": 0.043478260869565216 + }, + "x_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8881987577639753, + "mean_token_weighted_tv": 0.030595220908846543, + "aggregate_load_tv": 0.057971014492753624 + }, + "period_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.9006211180124224, + "mean_token_weighted_tv": 0.026553387551204018, + "aggregate_load_tv": 0.057971014492753624 + }, + "period_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8881987577639753, + "mean_token_weighted_tv": 0.030869897819407608, + "aggregate_load_tv": 0.057971014492753624 + } + } + }, + "layer_07": { + "layer": 7, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "462e7d9ddb6361517588fdcfb56781f02b09e74629fef7875fb6934e84d11491", + "route_weight_sha256": "24b1d80cd1046c29e14024aefe9309c0101f5ad6d44ac15d5f42a366881df708", + "loads": [ + 6, + 2, + 3, + 2, + 0, + 0, + 1, + 0, + 3, + 3, + 4, + 3, + 0, + 3, + 3, + 4, + 0, + 1, + 0, + 3, + 0, + 2, + 1, + 2, + 3, + 2, + 3, + 6, + 2, + 5, + 2, + 2, + 2, + 5, + 4, + 2, + 1, + 2, + 1, + 0, + 1, + 1, + 3, + 4, + 0, + 0, + 6, + 0, + 0, + 3, + 0, + 1, + 5, + 0, + 0, + 1, + 0, + 2, + 5, + 4, + 0, + 2, + 10, + 2 + ], + "weighted_loads": [ + 0.4693000018596649, + 0.11002535745501518, + 0.1414078138768673, + 0.10451240837574005, + 0.0, + 0.0, + 0.07169126719236374, + 0.0, + 0.20373734831809998, + 0.20857518911361694, + 0.20683863945305347, + 0.15051862597465515, + 0.0, + 0.2884196937084198, + 0.2816387377679348, + 0.2561231888830662, + 0.0, + 0.062069352716207504, + 0.0, + 0.3919209837913513, + 0.0, + 0.13346905633807182, + 0.039638619869947433, + 0.11872601881623268, + 0.43832333385944366, + 0.1300983652472496, + 0.21078113093972206, + 0.531256940215826, + 0.10333333909511566, + 0.4240554980933666, + 0.11727611348032951, + 0.08257875218987465, + 0.11773892119526863, + 0.27454082295298576, + 0.2742413468658924, + 0.17334453761577606, + 0.048867400735616684, + 0.09324293956160545, + 0.046938952058553696, + 0.0, + 0.04962916672229767, + 0.057644497603178024, + 0.3269655928015709, + 0.1545212473720312, + 0.0, + 0.0, + 0.44994786381721497, + 0.0, + 0.0, + 0.17947502061724663, + 0.0, + 0.046495530754327774, + 0.2944924086332321, + 0.0, + 0.0, + 0.07425489276647568, + 0.0, + 0.15138328075408936, + 0.8181728571653366, + 0.3027886897325516, + 0.0, + 0.08999092876911163, + 0.6618592888116837, + 0.10263651981949806 + ], + "unique_experts": 47, + "load_cv": 0.9247012835332911, + "normalized_load_entropy": 0.88705971576327, + "max_load_share": 0.07246376811594203 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "321454c72a1b6381b2a85125e6fb5fd74369bca56068f9459dd3474eb6e1ba4e", + "route_weight_sha256": "4e5098f8c23f63bdffd51a0000ecfd0855d172d7b224af978b45ad9ce9bad3ac", + "loads": [ + 6, + 2, + 3, + 5, + 0, + 1, + 8, + 0, + 10, + 3, + 5, + 6, + 0, + 8, + 3, + 4, + 15, + 3, + 2, + 4, + 0, + 2, + 4, + 4, + 7, + 2, + 8, + 6, + 5, + 5, + 2, + 2, + 5, + 6, + 4, + 2, + 1, + 2, + 11, + 3, + 1, + 12, + 7, + 6, + 4, + 0, + 9, + 2, + 0, + 3, + 15, + 1, + 5, + 1, + 0, + 8, + 0, + 2, + 9, + 4, + 0, + 8, + 13, + 9 + ], + "weighted_loads": [ + 0.4693000018596649, + 0.11002535745501518, + 0.1414078138768673, + 0.2145128697156906, + 0.0, + 0.041239287704229355, + 0.8013174757361412, + 0.0, + 0.7151051871478558, + 0.20857518911361694, + 0.24007144756615162, + 0.626630112528801, + 0.0, + 0.5740000158548355, + 0.2816387377679348, + 0.2561231888830662, + 2.011244297027588, + 0.1816606968641281, + 0.04148694407194853, + 0.47960299253463745, + 0.0, + 0.13346905633807182, + 0.21319815516471863, + 0.3358045555651188, + 0.5699369870126247, + 0.1300983652472496, + 0.5900066122412682, + 0.531256940215826, + 0.16666378267109394, + 0.4240554980933666, + 0.11727611348032951, + 0.08257875218987465, + 0.2313171736896038, + 0.3243975527584553, + 0.2742413468658924, + 0.17334453761577606, + 0.048867400735616684, + 0.09324293956160545, + 0.9437451809644699, + 0.14815430715680122, + 0.04962916672229767, + 1.1654142253100872, + 0.6894337981939316, + 0.18654380831867456, + 1.5441904850304127, + 0.0, + 0.582935843616724, + 0.1365242563188076, + 0.0, + 0.17947502061724663, + 1.1937478184700012, + 0.046495530754327774, + 0.2944924086332321, + 0.03133116289973259, + 0.0, + 0.7328004390001297, + 0.0, + 0.15138328075408936, + 0.9036301421001554, + 0.3027886897325516, + 0.0, + 0.38876773416996, + 0.7105602179653943, + 0.3733724616467953 + ], + "unique_experts": 55, + "load_cv": 0.828690771676461, + "normalized_load_entropy": 0.9124458336919985, + "max_load_share": 0.052083333333333336 + } + }, + "s1_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "a38999fb7a1d9bf902a50fa7bcefa37670a4b9b5f069aa31127d84cb604c34fa", + "route_weight_sha256": "ffd03ccd6c8b7bafd569fc0a449aff0b617e5ffaaa74d765f206c7fbbb085089", + "loads": [ + 6, + 2, + 2, + 3, + 0, + 0, + 1, + 1, + 3, + 3, + 3, + 2, + 0, + 3, + 2, + 4, + 0, + 1, + 0, + 3, + 0, + 2, + 1, + 2, + 3, + 2, + 3, + 7, + 2, + 4, + 2, + 2, + 2, + 5, + 4, + 2, + 1, + 2, + 1, + 0, + 1, + 1, + 3, + 4, + 0, + 0, + 6, + 1, + 0, + 3, + 1, + 2, + 5, + 0, + 0, + 1, + 0, + 2, + 5, + 4, + 0, + 2, + 10, + 1 + ], + "weighted_loads": [ + 0.4659108519554138, + 0.1136716790497303, + 0.10359165072441101, + 0.1445658691227436, + 0.0, + 0.0, + 0.07073867321014404, + 0.04529479891061783, + 0.19565436989068985, + 0.2032814770936966, + 0.18139398843050003, + 0.1162295863032341, + 0.0, + 0.2860339283943176, + 0.24250086396932602, + 0.2583766169846058, + 0.0, + 0.05990729108452797, + 0.0, + 0.39454490691423416, + 0.0, + 0.1350499987602234, + 0.03840634226799011, + 0.1183885708451271, + 0.44378622621297836, + 0.12788443267345428, + 0.2016017623245716, + 0.5642197653651237, + 0.08501213788986206, + 0.3903506323695183, + 0.11878801137208939, + 0.08165476098656654, + 0.11710004135966301, + 0.2607945054769516, + 0.2774532809853554, + 0.16710275784134865, + 0.049213290214538574, + 0.09327354282140732, + 0.04275550693273544, + 0.0, + 0.05405360087752342, + 0.05553776025772095, + 0.3182060196995735, + 0.1541835404932499, + 0.0, + 0.0, + 0.44261037930846214, + 0.027336793020367622, + 0.0, + 0.17608381062746048, + 0.03789293020963669, + 0.08861668035387993, + 0.29539939016103745, + 0.0, + 0.0, + 0.07411735504865646, + 0.0, + 0.15297012776136398, + 0.8357699662446976, + 0.31304869428277016, + 0.0, + 0.09292186796665192, + 0.6614127457141876, + 0.07672398537397385 + ], + "unique_experts": 50, + "load_cv": 0.9063476587683809, + "normalized_load_entropy": 0.896990656012695, + "max_load_share": 0.07246376811594203 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "5e226492705423b1c4e950b7428ae6fa35180509edf07d3e63f8a2ef8862b456", + "route_weight_sha256": "7c3a93bed052a5d116690f0fe5f1d28e7ea1befbd6a9f35f435cd470cbc6ce1b", + "loads": [ + 6, + 2, + 2, + 5, + 1, + 1, + 10, + 1, + 18, + 5, + 9, + 7, + 0, + 8, + 4, + 6, + 16, + 4, + 2, + 4, + 0, + 2, + 3, + 5, + 8, + 2, + 12, + 7, + 5, + 10, + 2, + 2, + 8, + 13, + 4, + 2, + 1, + 6, + 18, + 3, + 3, + 17, + 12, + 7, + 11, + 0, + 9, + 7, + 0, + 3, + 23, + 2, + 5, + 0, + 4, + 10, + 0, + 8, + 8, + 4, + 0, + 8, + 14, + 5 + ], + "weighted_loads": [ + 0.4659108519554138, + 0.1136716790497303, + 0.10359165072441101, + 0.2082444690167904, + 0.046353425830602646, + 0.044498711824417114, + 0.7960643377155066, + 0.04529479891061783, + 1.4441451840102673, + 0.30551284924149513, + 0.7011999748647213, + 0.7095207087695599, + 0.0, + 0.5931682754307985, + 0.30969027802348137, + 0.3556103743612766, + 2.418127443641424, + 0.2230432815849781, + 0.04108001943677664, + 0.48977312445640564, + 0.0, + 0.1350499987602234, + 0.16019600629806519, + 0.36704162135720253, + 0.5990715636871755, + 0.12788443267345428, + 0.9536551237106323, + 0.5642197653651237, + 0.14867276512086391, + 1.1744573935866356, + 0.11878801137208939, + 0.08165476098656654, + 0.5030583925545216, + 0.8009526319801807, + 0.2774532809853554, + 0.16710275784134865, + 0.049213290214538574, + 0.32144899666309357, + 1.8117559850215912, + 0.16095451638102531, + 0.277091596275568, + 1.6301336959004402, + 1.1155319772660732, + 0.22676957026124, + 2.1142269894480705, + 0.0, + 0.592322338372469, + 0.3605033550411463, + 0.0, + 0.17608381062746048, + 1.6767875887453556, + 0.08861668035387993, + 0.29539939016103745, + 0.0, + 0.20657256990671158, + 0.847833039239049, + 0.0, + 0.6944771893322468, + 0.8928904319182038, + 0.31304869428277016, + 0.0, + 0.38545900769531727, + 0.7455086624249816, + 0.19337229244410992 + ], + "unique_experts": 57, + "load_cv": 0.8498365855987974, + "normalized_load_entropy": 0.912738205429264, + "max_load_share": 0.059895833333333336 + } + }, + "s0_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "83febbe67de1a652eac4537ee920c70780ea213340dbd8d1546f3ebcef0f1aae", + "route_weight_sha256": "811009483e5dbec70383dba059f526aa861e888c1841edca83e0a6ab353a7771", + "loads": [ + 5, + 2, + 2, + 3, + 0, + 0, + 1, + 0, + 3, + 3, + 4, + 3, + 0, + 3, + 3, + 3, + 0, + 2, + 2, + 3, + 0, + 2, + 1, + 1, + 3, + 1, + 3, + 6, + 2, + 4, + 2, + 2, + 2, + 5, + 4, + 2, + 1, + 3, + 0, + 0, + 1, + 1, + 3, + 4, + 1, + 0, + 5, + 0, + 1, + 4, + 1, + 3, + 5, + 0, + 0, + 1, + 0, + 2, + 5, + 5, + 0, + 2, + 7, + 1 + ], + "weighted_loads": [ + 0.43330197781324387, + 0.11633970215916634, + 0.10293838754296303, + 0.15480370819568634, + 0.0, + 0.0, + 0.07470738887786865, + 0.0, + 0.20323272421956062, + 0.19526991620659828, + 0.2064512874931097, + 0.1486685499548912, + 0.0, + 0.27035047113895416, + 0.27748117968440056, + 0.22986765950918198, + 0.0, + 0.12039103731513023, + 0.06764914654195309, + 0.40496543794870377, + 0.0, + 0.13064123690128326, + 0.04063098877668381, + 0.07856839150190353, + 0.45256374031305313, + 0.09856532514095306, + 0.2224554419517517, + 0.5369255915284157, + 0.09716898947954178, + 0.41422171890735626, + 0.1250656433403492, + 0.0796150453388691, + 0.11827023327350616, + 0.2846824899315834, + 0.25899387896060944, + 0.15835845470428467, + 0.0444139689207077, + 0.1374417319893837, + 0.0, + 0.0, + 0.04916534945368767, + 0.058069393038749695, + 0.33527108281850815, + 0.15383578836917877, + 0.038058578968048096, + 0.0, + 0.4143408052623272, + 0.0, + 0.03773320093750954, + 0.24235057458281517, + 0.0468483529984951, + 0.11889837682247162, + 0.3046048544347286, + 0.0, + 0.0, + 0.07871956378221512, + 0.0, + 0.14788643270730972, + 0.8730223923921585, + 0.33760857954621315, + 0.0, + 0.0891350507736206, + 0.5198679640889168, + 0.08150245249271393 + ], + "unique_experts": 50, + "load_cv": 0.8083527401382227, + "normalized_load_entropy": 0.9062122405820184, + "max_load_share": 0.050724637681159424 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "327fd745a732a6d92806db3129002686558853574a6cb976b6e02893d2c46483", + "route_weight_sha256": "acbe6871d11d4336377ff23a2e97c0f4532d44b8c5c051e071ede74c6d3becc1", + "loads": [ + 5, + 2, + 2, + 6, + 0, + 1, + 10, + 0, + 10, + 3, + 5, + 7, + 0, + 8, + 3, + 3, + 15, + 4, + 5, + 4, + 0, + 2, + 4, + 3, + 6, + 1, + 8, + 6, + 4, + 4, + 2, + 2, + 5, + 7, + 4, + 2, + 1, + 3, + 9, + 3, + 1, + 12, + 7, + 5, + 5, + 0, + 8, + 2, + 1, + 4, + 16, + 3, + 5, + 2, + 0, + 8, + 0, + 2, + 8, + 5, + 0, + 8, + 9, + 8 + ], + "weighted_loads": [ + 0.43330197781324387, + 0.11633970215916634, + 0.10293838754296303, + 0.2648041695356369, + 0.0, + 0.041239287704229355, + 0.9323323406279087, + 0.0, + 0.7098380848765373, + 0.19526991620659828, + 0.23968409560620785, + 0.6722831726074219, + 0.0, + 0.5559307932853699, + 0.27748117968440056, + 0.22986765950918198, + 2.086080238223076, + 0.23373660817742348, + 0.1504058362916112, + 0.4894462749361992, + 0.0, + 0.13064123690128326, + 0.214190524071455, + 0.2852419391274452, + 0.5770951192826033, + 0.09856532514095306, + 0.6074915267527103, + 0.5369255915284157, + 0.14737518317997456, + 0.41422171890735626, + 0.1250656433403492, + 0.0796150453388691, + 0.23184848576784134, + 0.372767087072134, + 0.25899387896060944, + 0.15835845470428467, + 0.0444139689207077, + 0.1374417319893837, + 0.8343290500342846, + 0.15293258056044579, + 0.04916534945368767, + 1.0951323918998241, + 0.6880529150366783, + 0.17146690748631954, + 0.7619774267077446, + 0.0, + 0.5532781332731247, + 0.13805517554283142, + 0.03773320093750954, + 0.24235057458281517, + 1.3441207110881805, + 0.11889837682247162, + 0.3046048544347286, + 0.07715168967843056, + 0.0, + 0.7372651100158691, + 0.0, + 0.14788643270730972, + 0.9434735421091318, + 0.33760857954621315, + 0.0, + 0.387911856174469, + 0.5629526879638433, + 0.35223839432001114 + ], + "unique_experts": 56, + "load_cv": 0.7905694150420949, + "normalized_load_entropy": 0.920239100035918, + "max_load_share": 0.05555555555555555 + } + }, + "s1_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "86fb6dbcab5acd909acbf7c557a4d4375bbb14f962e71cbba49212c6552d1865", + "route_weight_sha256": "9b0d13702a6c578e0500db649f22b6e4eda7618424a68511a1a7a2464f350a48", + "loads": [ + 6, + 2, + 2, + 3, + 0, + 0, + 1, + 1, + 3, + 3, + 3, + 3, + 0, + 3, + 3, + 3, + 0, + 2, + 2, + 3, + 0, + 2, + 1, + 1, + 4, + 2, + 3, + 7, + 2, + 4, + 2, + 2, + 2, + 5, + 3, + 2, + 1, + 2, + 0, + 0, + 1, + 1, + 3, + 4, + 0, + 0, + 5, + 0, + 1, + 3, + 1, + 2, + 5, + 0, + 0, + 1, + 0, + 2, + 5, + 5, + 0, + 2, + 8, + 1 + ], + "weighted_loads": [ + 0.4814094640314579, + 0.12365652993321419, + 0.10258593037724495, + 0.15181496739387512, + 0.0, + 0.0, + 0.06736065447330475, + 0.041040509939193726, + 0.18929897248744965, + 0.1974962279200554, + 0.1862526722252369, + 0.15264135599136353, + 0.0, + 0.27724963054060936, + 0.2784673050045967, + 0.2368970736861229, + 0.0, + 0.11623460799455643, + 0.06385849602520466, + 0.4088711142539978, + 0.0, + 0.1382461003959179, + 0.04119236022233963, + 0.08176746964454651, + 0.4732657242566347, + 0.13186047226190567, + 0.2067163921892643, + 0.577104777097702, + 0.10094893351197243, + 0.40921103209257126, + 0.12481538951396942, + 0.07575804740190506, + 0.11840054765343666, + 0.28424234315752983, + 0.21979378163814545, + 0.15884672477841377, + 0.04674438387155533, + 0.09696539491415024, + 0.0, + 0.0, + 0.05058613419532776, + 0.05259547010064125, + 0.3305738791823387, + 0.15730083733797073, + 0.0, + 0.0, + 0.4131907522678375, + 0.0, + 0.039339642971754074, + 0.18538134172558784, + 0.041410867124795914, + 0.08745243772864342, + 0.29916471615433693, + 0.0, + 0.0, + 0.07790504395961761, + 0.0, + 0.15778008103370667, + 0.873168908059597, + 0.3471965678036213, + 0.0, + 0.09605846181511879, + 0.5746478661894798, + 0.07797093689441681 + ], + "unique_experts": 50, + "load_cv": 0.8449412085303426, + "normalized_load_entropy": 0.9033253329424494, + "max_load_share": 0.057971014492753624 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "d35af9cd5829d1958db248b67eca543064d8325603dbf1c2bc7f8f69b4efe8c2", + "route_weight_sha256": "df18a2aec4e8abada80104646c4517dc89d0927518688a23b2362c1374f65aee", + "loads": [ + 6, + 2, + 2, + 5, + 1, + 1, + 12, + 1, + 18, + 5, + 9, + 8, + 0, + 8, + 5, + 5, + 16, + 5, + 5, + 4, + 0, + 2, + 3, + 5, + 8, + 2, + 12, + 7, + 4, + 10, + 2, + 2, + 8, + 13, + 3, + 2, + 1, + 6, + 17, + 3, + 3, + 17, + 12, + 7, + 11, + 0, + 8, + 6, + 1, + 3, + 23, + 2, + 5, + 0, + 4, + 10, + 0, + 8, + 7, + 5, + 0, + 8, + 11, + 5 + ], + "weighted_loads": [ + 0.4814094640314579, + 0.12365652993321419, + 0.10258593037724495, + 0.2154935672879219, + 0.046353425830602646, + 0.044498711824417114, + 0.9647172633558512, + 0.041040509939193726, + 1.4426077865064144, + 0.2997276000678539, + 0.7060586586594582, + 0.7582576498389244, + 0.0, + 0.5843839775770903, + 0.34565671905875206, + 0.33413083106279373, + 2.447267547249794, + 0.27466054260730743, + 0.14175597671419382, + 0.49128788709640503, + 0.0, + 0.1382461003959179, + 0.1629820242524147, + 0.3646170645952225, + 0.6213995665311813, + 0.13186047226190567, + 0.9695258848369122, + 0.577104777097702, + 0.15089786797761917, + 1.1933177933096886, + 0.12481538951396942, + 0.07575804740190506, + 0.5043588988482952, + 0.824400469660759, + 0.21979378163814545, + 0.15884672477841377, + 0.04674438387155533, + 0.3251408487558365, + 1.7069743908941746, + 0.16354291886091232, + 0.27362412959337234, + 1.5682973749935627, + 1.1093273349106312, + 0.2568176854401827, + 1.2882225438952446, + 0.0, + 0.5661057159304619, + 0.33531923219561577, + 0.039339642971754074, + 0.18538134172558784, + 1.8202549293637276, + 0.08745243772864342, + 0.29916471615433693, + 0.0, + 0.20657256990671158, + 0.8516207281500101, + 0.0, + 0.6992871426045895, + 0.9149194750934839, + 0.3471965678036213, + 0.0, + 0.38859560154378414, + 0.6532181836664677, + 0.19461924396455288 + ], + "unique_experts": 58, + "load_cv": 0.8307250848907035, + "normalized_load_entropy": 0.9170819961567791, + "max_load_share": 0.059895833333333336 + } + }, + "s0_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "a8ef19147ae27bbd312ecb367fe2843de440620af15224a1de7472b8000e769e", + "route_weight_sha256": "3e6ceb180d40e6a61aa5103354f646317d585e291326f16a08162317647afe09", + "loads": [ + 5, + 2, + 2, + 3, + 0, + 0, + 1, + 1, + 3, + 3, + 4, + 2, + 0, + 3, + 3, + 3, + 0, + 1, + 2, + 3, + 0, + 1, + 1, + 1, + 3, + 2, + 3, + 7, + 2, + 4, + 2, + 2, + 2, + 5, + 4, + 2, + 1, + 3, + 2, + 0, + 1, + 1, + 3, + 4, + 0, + 0, + 6, + 0, + 0, + 4, + 1, + 2, + 5, + 0, + 0, + 1, + 0, + 2, + 5, + 4, + 0, + 2, + 8, + 1 + ], + "weighted_loads": [ + 0.41116273403167725, + 0.11079514026641846, + 0.10716254264116287, + 0.1470290794968605, + 0.0, + 0.0, + 0.06935415416955948, + 0.03972291201353073, + 0.21018211171030998, + 0.1894804760813713, + 0.21270926110446453, + 0.1048835776746273, + 0.0, + 0.282166562974453, + 0.2789985314011574, + 0.23236925154924393, + 0.0, + 0.07246498763561249, + 0.06760910153388977, + 0.43268983066082, + 0.0, + 0.0708271712064743, + 0.040822938084602356, + 0.08403541147708893, + 0.4244259148836136, + 0.13294338434934616, + 0.23650992661714554, + 0.5401006750762463, + 0.0898151732981205, + 0.41863834857940674, + 0.12583495676517487, + 0.08029722049832344, + 0.12138200923800468, + 0.3095835708081722, + 0.2513083256781101, + 0.14684544876217842, + 0.04682813957333565, + 0.1283484324812889, + 0.11707927659153938, + 0.0, + 0.05057644844055176, + 0.060015421360731125, + 0.33553269505500793, + 0.15596794337034225, + 0.0, + 0.0, + 0.4801773875951767, + 0.0, + 0.0, + 0.2286197431385517, + 0.043843526393175125, + 0.08647966012358665, + 0.30158423259854317, + 0.0, + 0.0, + 0.07469643652439117, + 0.0, + 0.1351807788014412, + 0.8956188559532166, + 0.2959773801267147, + 0.0, + 0.09231659770011902, + 0.5440792180597782, + 0.07408338040113449 + ], + "unique_experts": 50, + "load_cv": 0.8489092548178243, + "normalized_load_entropy": 0.9022618250665603, + "max_load_share": 0.057971014492753624 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "ed27044cbaec65836b7c7a213150e98203b74e5bddfa5a9b33701ed3356a0cc5", + "route_weight_sha256": "42f7c7ccd34c813505b2f83a1a69cc9f05ec4a6b1e5610a3ec896f8e076e7d38", + "loads": [ + 5, + 2, + 2, + 6, + 0, + 2, + 5, + 1, + 10, + 3, + 5, + 6, + 1, + 9, + 3, + 3, + 16, + 4, + 4, + 4, + 0, + 1, + 4, + 3, + 6, + 2, + 7, + 7, + 4, + 4, + 2, + 2, + 5, + 7, + 4, + 2, + 1, + 3, + 11, + 3, + 1, + 12, + 8, + 5, + 3, + 0, + 10, + 3, + 0, + 4, + 15, + 2, + 5, + 1, + 0, + 8, + 0, + 2, + 8, + 4, + 0, + 9, + 10, + 9 + ], + "weighted_loads": [ + 0.41116273403167725, + 0.11079514026641846, + 0.10716254264116287, + 0.25702954083681107, + 0.0, + 0.09581402689218521, + 0.5185684412717819, + 0.03972291201353073, + 0.7238837741315365, + 0.1894804760813713, + 0.24594206921756268, + 0.6477385722100735, + 0.03786856681108475, + 0.602018341422081, + 0.2789985314011574, + 0.23236925154924393, + 2.358370754867792, + 0.27323249727487564, + 0.1090960456058383, + 0.49724022299051285, + 0.0, + 0.0708271712064743, + 0.21438247337937355, + 0.28480999171733856, + 0.5489572938531637, + 0.13294338434934616, + 0.5741192251443863, + 0.5401006750762463, + 0.14002136699855328, + 0.41863834857940674, + 0.12583495676517487, + 0.08029722049832344, + 0.23496026173233986, + 0.3989201672375202, + 0.2513083256781101, + 0.14684544876217842, + 0.04682813957333565, + 0.1283484324812889, + 0.8708955198526382, + 0.14746755361557007, + 0.05057644844055176, + 1.0112126544117928, + 0.7174404449760914, + 0.17359906248748302, + 0.6780114881694317, + 0.0, + 0.6476559787988663, + 0.18774332478642464, + 0.0, + 0.2286197431385517, + 1.1375480964779854, + 0.08647966012358665, + 0.30158423259854317, + 0.03133116289973259, + 0.0, + 0.7332419827580452, + 0.0, + 0.1351807788014412, + 0.9660700056701899, + 0.2959773801267147, + 0.0, + 0.44364409893751144, + 0.5871639419347048, + 0.4263109564781189 + ], + "unique_experts": 57, + "load_cv": 0.8089010988089465, + "normalized_load_entropy": 0.9194648174432358, + "max_load_share": 0.05555555555555555 + } + }, + "s1_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "619a5e6e8800ce56ac9b9a08e224b81445c144f44330a9e28b7c500cd9d86c01", + "route_weight_sha256": "947c6379a07d7d1f985365ad685ce1ec044db0cd40ddd8e719f8b6be92f6e311", + "loads": [ + 6, + 2, + 3, + 3, + 0, + 0, + 1, + 1, + 3, + 3, + 3, + 2, + 0, + 3, + 3, + 3, + 0, + 1, + 2, + 3, + 0, + 1, + 1, + 1, + 4, + 2, + 3, + 7, + 1, + 5, + 2, + 2, + 2, + 6, + 4, + 2, + 1, + 2, + 2, + 0, + 1, + 1, + 3, + 4, + 0, + 0, + 6, + 0, + 1, + 3, + 0, + 2, + 4, + 0, + 0, + 1, + 0, + 2, + 5, + 4, + 0, + 2, + 8, + 1 + ], + "weighted_loads": [ + 0.4701690450310707, + 0.11673390492796898, + 0.16610782966017723, + 0.14807426556944847, + 0.0, + 0.0, + 0.06041247770190239, + 0.04226009175181389, + 0.197012260556221, + 0.20255017653107643, + 0.1892658732831478, + 0.1196490079164505, + 0.0, + 0.2855139449238777, + 0.2889363318681717, + 0.21859708800911903, + 0.0, + 0.07266784459352493, + 0.06658788397908211, + 0.43753379583358765, + 0.0, + 0.07349605858325958, + 0.041236940771341324, + 0.08944807201623917, + 0.4481485150754452, + 0.1388246826827526, + 0.21839500218629837, + 0.5626040063798428, + 0.05513937771320343, + 0.4464884400367737, + 0.12556983157992363, + 0.08160417899489403, + 0.11525764688849449, + 0.34375960379838943, + 0.24264703318476677, + 0.1496327705681324, + 0.049083463847637177, + 0.08815484493970871, + 0.10970444604754448, + 0.0, + 0.05445775389671326, + 0.05352534353733063, + 0.3332396671175957, + 0.15815170109272003, + 0.0, + 0.0, + 0.47376690804958344, + 0.0, + 0.038184937089681625, + 0.18418609723448753, + 0.0, + 0.08726413175463676, + 0.2549668215215206, + 0.0, + 0.0, + 0.07501012086868286, + 0.0, + 0.14060456305742264, + 0.8783878311514854, + 0.30679135397076607, + 0.0, + 0.10016253963112831, + 0.56297891959548, + 0.08141504228115082 + ], + "unique_experts": 50, + "load_cv": 0.8723385725572282, + "normalized_load_entropy": 0.8991758871898167, + "max_load_share": 0.057971014492753624 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "c04234399664eac3da223ee6c3cffc013dacb975a6eec8cb33f0bb31840dce19", + "route_weight_sha256": "2ed020b16812bc7c4a7fa555b1720be612fd2732ccf41c6851cfddfe1f1afb27", + "loads": [ + 6, + 2, + 3, + 5, + 1, + 2, + 7, + 1, + 18, + 5, + 9, + 7, + 0, + 9, + 5, + 5, + 17, + 6, + 4, + 4, + 0, + 1, + 3, + 5, + 9, + 2, + 12, + 7, + 3, + 11, + 2, + 2, + 8, + 14, + 4, + 2, + 1, + 6, + 17, + 3, + 3, + 16, + 13, + 7, + 10, + 0, + 10, + 7, + 1, + 3, + 21, + 2, + 4, + 0, + 4, + 10, + 0, + 8, + 7, + 4, + 0, + 9, + 11, + 6 + ], + "weighted_loads": [ + 0.4701690450310707, + 0.11673390492796898, + 0.16610782966017723, + 0.21175286546349525, + 0.046353425830602646, + 0.09798849001526833, + 0.5184614155441523, + 0.04226009175181389, + 1.4789369814097881, + 0.30478154867887497, + 0.7090718597173691, + 0.7602216638624668, + 0.0, + 0.6227750517427921, + 0.35612574592232704, + 0.31583084538578987, + 2.710949383676052, + 0.3503993824124336, + 0.10766790341585875, + 0.5069827437400818, + 0.0, + 0.07349605858325958, + 0.1630266048014164, + 0.3421977013349533, + 0.6287131439894438, + 0.1388246826827526, + 0.9871985130012035, + 0.5626040063798428, + 0.10508831217885017, + 1.230595201253891, + 0.12556983157992363, + 0.08160417899489403, + 0.501215998083353, + 0.8839177303016186, + 0.24264703318476677, + 0.1496327705681324, + 0.049083463847637177, + 0.31633029878139496, + 1.6852220483124256, + 0.15983255952596664, + 0.27749574929475784, + 1.4001036509871483, + 1.1368161514401436, + 0.2610140610486269, + 1.2506593391299248, + 0.0, + 0.6601702086627483, + 0.4032452963292599, + 0.038184937089681625, + 0.18418609723448753, + 1.5330826453864574, + 0.08726413175463676, + 0.2549668215215206, + 0.0, + 0.20657256990671158, + 0.8487258050590754, + 0.0, + 0.6821116246283054, + 0.9201383981853724, + 0.30679135397076607, + 0.0, + 0.44675819762051105, + 0.6415492370724678, + 0.26727296970784664 + ], + "unique_experts": 58, + "load_cv": 0.8186201126828542, + "normalized_load_entropy": 0.9181936371004106, + "max_load_share": 0.0546875 + } + }, + "s0_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "6051f2f5022e1eae233229ba29508e173e5b984f114f1c148260dbba72994c07", + "route_weight_sha256": "3b9ba4673f852a01603aeb4f3fa6918fb5a263184ff79ca8a90daf1a0d48e22d", + "loads": [ + 5, + 2, + 2, + 3, + 0, + 0, + 1, + 0, + 3, + 3, + 4, + 2, + 0, + 3, + 3, + 3, + 0, + 1, + 2, + 3, + 0, + 1, + 1, + 1, + 3, + 2, + 3, + 6, + 2, + 4, + 2, + 2, + 2, + 5, + 4, + 2, + 1, + 3, + 2, + 0, + 1, + 1, + 3, + 4, + 1, + 0, + 6, + 0, + 1, + 4, + 1, + 2, + 5, + 0, + 0, + 1, + 0, + 2, + 5, + 5, + 0, + 2, + 7, + 1 + ], + "weighted_loads": [ + 0.41819848120212555, + 0.11077829450368881, + 0.1053595319390297, + 0.1483772099018097, + 0.0, + 0.0, + 0.07070465385913849, + 0.0, + 0.21278414502739906, + 0.19811448082327843, + 0.21800178661942482, + 0.10601050406694412, + 0.0, + 0.2848282605409622, + 0.2856106758117676, + 0.23333290964365005, + 0.0, + 0.07270047068595886, + 0.06648223660886288, + 0.41835685074329376, + 0.0, + 0.07282806187868118, + 0.038425762206315994, + 0.08478005230426788, + 0.41998016089200974, + 0.12758618965744972, + 0.2500876560807228, + 0.515400618314743, + 0.0995325893163681, + 0.4139874652028084, + 0.12312017008662224, + 0.08424759656190872, + 0.1206643357872963, + 0.31959299370646477, + 0.2597925215959549, + 0.15159215778112411, + 0.046290382742881775, + 0.1272583268582821, + 0.11808434128761292, + 0.0, + 0.049931056797504425, + 0.05993776395916939, + 0.3409097120165825, + 0.1549459584057331, + 0.03724177926778793, + 0.0, + 0.46659159660339355, + 0.0, + 0.036652520298957825, + 0.22628363966941833, + 0.04606956988573074, + 0.08560093864798546, + 0.2981962189078331, + 0.0, + 0.0, + 0.07583662867546082, + 0.0, + 0.14389999955892563, + 0.8687951043248177, + 0.3368440456688404, + 0.0, + 0.09454723820090294, + 0.5051373578608036, + 0.07930198311805725 + ], + "unique_experts": 51, + "load_cv": 0.8124994950962191, + "normalized_load_entropy": 0.9081562508168456, + "max_load_share": 0.050724637681159424 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "6e550ee19d58f066264ca3f9f34e0293f8ccd8b3357ae0ddabe2910651dff94b", + "route_weight_sha256": "b42054ef99fdf43cd2deddbb5abed9240da74f3cb32f3027fab2b8c0220fbf4b", + "loads": [ + 5, + 2, + 2, + 6, + 0, + 1, + 6, + 0, + 11, + 3, + 5, + 6, + 1, + 8, + 3, + 3, + 16, + 4, + 4, + 4, + 0, + 1, + 5, + 3, + 6, + 2, + 7, + 6, + 4, + 4, + 2, + 2, + 5, + 7, + 4, + 2, + 1, + 3, + 12, + 3, + 1, + 13, + 8, + 5, + 4, + 0, + 8, + 2, + 1, + 4, + 17, + 2, + 5, + 1, + 0, + 8, + 0, + 2, + 8, + 5, + 0, + 8, + 9, + 8 + ], + "weighted_loads": [ + 0.41819848120212555, + 0.11077829450368881, + 0.1053595319390297, + 0.25837767124176025, + 0.0, + 0.041239287704229355, + 0.5600321553647518, + 0.0, + 0.8035122007131577, + 0.19811448082327843, + 0.25123459473252296, + 0.6517282500863075, + 0.03673533722758293, + 0.5704085826873779, + 0.2856106758117676, + 0.23333290964365005, + 2.3320959843695164, + 0.2686231806874275, + 0.1079691806808114, + 0.4783949553966522, + 0.0, + 0.07282806187868118, + 0.25638803467154503, + 0.28340598940849304, + 0.5445115398615599, + 0.12758618965744972, + 0.5902658924460411, + 0.515400618314743, + 0.14973878301680088, + 0.4139874652028084, + 0.12312017008662224, + 0.08424759656190872, + 0.23424258828163147, + 0.4053001180291176, + 0.2597925215959549, + 0.15159215778112411, + 0.046290382742881775, + 0.1272583268582821, + 0.9823156148195267, + 0.15169013291597366, + 0.049931056797504425, + 1.074535071849823, + 0.7170989476144314, + 0.17257707752287388, + 0.705811645835638, + 0.0, + 0.5579214207828045, + 0.13900698348879814, + 0.036652520298957825, + 0.22628363966941833, + 1.4734734110534191, + 0.08560093864798546, + 0.2981962189078331, + 0.03133116289973259, + 0.0, + 0.7343821749091148, + 0.0, + 0.14389999955892563, + 0.939246254041791, + 0.3368440456688404, + 0.0, + 0.3933240436017513, + 0.5482220817357302, + 0.35003792494535446 + ], + "unique_experts": 57, + "load_cv": 0.828690771676461, + "normalized_load_entropy": 0.9173000814161872, + "max_load_share": 0.059027777777777776 + } + }, + "s1_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "47ff4b88acb30df4360d414a3985aa2d740f043f0343e139a1fe20e17f7d765d", + "route_weight_sha256": "54bed674d49944560ca64b99a533860b14e1a434c43108f22c199a8fa8a041bb", + "loads": [ + 6, + 3, + 3, + 3, + 0, + 0, + 1, + 0, + 3, + 3, + 3, + 2, + 0, + 3, + 3, + 3, + 0, + 1, + 2, + 3, + 0, + 1, + 1, + 1, + 3, + 2, + 3, + 7, + 1, + 5, + 2, + 2, + 2, + 6, + 4, + 2, + 1, + 2, + 2, + 0, + 1, + 1, + 3, + 4, + 0, + 0, + 6, + 1, + 1, + 3, + 0, + 2, + 4, + 0, + 0, + 1, + 0, + 2, + 5, + 4, + 0, + 2, + 8, + 1 + ], + "weighted_loads": [ + 0.46658018603920937, + 0.1609782688319683, + 0.16562237590551376, + 0.14823691174387932, + 0.0, + 0.0, + 0.06123820319771767, + 0.0, + 0.19304411858320236, + 0.20548614114522934, + 0.18360335379838943, + 0.11865521967411041, + 0.0, + 0.29063770920038223, + 0.2837957851588726, + 0.22042794525623322, + 0.0, + 0.07112165540456772, + 0.06570977717638016, + 0.4302317947149277, + 0.0, + 0.07542654126882553, + 0.04130302742123604, + 0.08684296160936356, + 0.4013621583580971, + 0.13418076187372208, + 0.22386939823627472, + 0.5595555640757084, + 0.06346970796585083, + 0.4413973204791546, + 0.12413337454199791, + 0.0807375330477953, + 0.11357532814145088, + 0.34557878226041794, + 0.24917792901396751, + 0.15077810734510422, + 0.046390801668167114, + 0.0888901948928833, + 0.1139884926378727, + 0.0, + 0.053105343133211136, + 0.05352731794118881, + 0.335364393889904, + 0.1553630828857422, + 0.0, + 0.0, + 0.46299178153276443, + 0.028342878445982933, + 0.03761809319257736, + 0.18219701573252678, + 0.0, + 0.09035304188728333, + 0.24504004791378975, + 0.0, + 0.0, + 0.07473911345005035, + 0.0, + 0.14536750316619873, + 0.8820741921663284, + 0.3134680725634098, + 0.0, + 0.09837270900607109, + 0.5496811605989933, + 0.07828133553266525 + ], + "unique_experts": 50, + "load_cv": 0.8684775806712252, + "normalized_load_entropy": 0.8997679463633347, + "max_load_share": 0.057971014492753624 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "62002ecb4c6592eb3f4b61609fcbd72fcf9af16334275021d5e47fd3da6a2fee", + "route_weight_sha256": "131d84c867ab76fa01d7e70ceedcfc40a3054671b74556e46289921f490e4237", + "loads": [ + 6, + 3, + 3, + 5, + 1, + 1, + 8, + 0, + 19, + 5, + 9, + 7, + 0, + 8, + 5, + 5, + 17, + 6, + 4, + 4, + 0, + 1, + 4, + 4, + 7, + 2, + 12, + 7, + 3, + 11, + 2, + 2, + 9, + 14, + 4, + 2, + 1, + 6, + 18, + 3, + 3, + 18, + 13, + 7, + 10, + 0, + 8, + 7, + 1, + 3, + 23, + 2, + 4, + 0, + 4, + 10, + 0, + 8, + 7, + 4, + 0, + 8, + 11, + 5 + ], + "weighted_loads": [ + 0.46658018603920937, + 0.1609782688319683, + 0.16562237590551376, + 0.2119155116379261, + 0.046353425830602646, + 0.044498711824417114, + 0.5561360474675894, + 0.0, + 1.5354697704315186, + 0.3077175132930279, + 0.7034093402326107, + 0.7087421268224716, + 0.0, + 0.5977720562368631, + 0.35098519921302795, + 0.31766170263290405, + 2.6570224165916443, + 0.33595065772533417, + 0.1067897966131568, + 0.4957643449306488, + 0.0, + 0.07542654126882553, + 0.19553539901971817, + 0.29871145263314247, + 0.5494960006326437, + 0.13418076187372208, + 0.9999018013477325, + 0.5595555640757084, + 0.11341864243149757, + 1.225504081696272, + 0.12413337454199791, + 0.0807375330477953, + 0.5328820273280144, + 0.8857369087636471, + 0.24917792901396751, + 0.15077810734510422, + 0.046390801668167114, + 0.31706564873456955, + 1.775870706886053, + 0.16308145597577095, + 0.2761433385312557, + 1.4995545856654644, + 1.1441630721092224, + 0.2556264642626047, + 1.2485431358218193, + 0.0, + 0.568407692015171, + 0.369999160990119, + 0.03761809319257736, + 0.18219701573252678, + 1.9666099809110165, + 0.09035304188728333, + 0.24504004791378975, + 0.0, + 0.20657256990671158, + 0.8484547976404428, + 0.0, + 0.6868745647370815, + 0.9238247592002153, + 0.3134680725634098, + 0.0, + 0.39090984873473644, + 0.6282514780759811, + 0.19492964260280132 + ], + "unique_experts": 57, + "load_cv": 0.8564501996289361, + "normalized_load_entropy": 0.9128559818868995, + "max_load_share": 0.059895833333333336 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.9006211180124224, + "mean_token_weighted_tv": 0.019718492930026157, + "aggregate_load_tv": 0.043478260869565216 + }, + "system_bos": { + "tokens": 23, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.9130434782608695, + "mean_token_weighted_tv": 0.02065379277843496, + "aggregate_load_tv": 0.043478260869565216 + }, + "system_x": { + "tokens": 23, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.9006211180124224, + "mean_token_weighted_tv": 0.02596816173552171, + "aggregate_load_tv": 0.043478260869565216 + }, + "system_period": { + "tokens": 23, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8881987577639753, + "mean_token_weighted_tv": 0.027760280012760475, + "aggregate_load_tv": 0.05797101449275362 + }, + "bos_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 11, + "mean_set_jaccard": 0.8509316770186336, + "mean_token_weighted_tv": 0.033776714507004486, + "aggregate_load_tv": 0.08695652173913043 + }, + "bos_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.8913043478260869, + "mean_token_weighted_tv": 0.026518264501962974, + "aggregate_load_tv": 0.05797101449275362 + }, + "x_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 12, + "mean_set_jaccard": 0.8633540372670808, + "mean_token_weighted_tv": 0.03626347758361827, + "aggregate_load_tv": 0.07246376811594203 + }, + "x_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8881987577639753, + "mean_token_weighted_tv": 0.03311073452072299, + "aggregate_load_tv": 0.06521739130434784 + }, + "period_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 12, + "mean_set_jaccard": 0.8633540372670808, + "mean_token_weighted_tv": 0.034306959168094654, + "aggregate_load_tv": 0.07971014492753624 + }, + "period_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8881987577639753, + "mean_token_weighted_tv": 0.032593290402513485, + "aggregate_load_tv": 0.06521739130434784 + } + } + }, + "layer_08": { + "layer": 8, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "59d6760f6631ce37c82b730bc8958b3a8e78bc421024defb3d58377d7c576087", + "route_weight_sha256": "f9bd7a862712253cd30459c53d060e07be6a1772a818ee9cd0860e7ed77bf3dd", + "loads": [ + 1, + 0, + 1, + 3, + 1, + 0, + 3, + 0, + 1, + 1, + 3, + 1, + 1, + 1, + 4, + 2, + 0, + 7, + 1, + 0, + 3, + 0, + 4, + 2, + 13, + 0, + 0, + 0, + 2, + 5, + 6, + 1, + 2, + 7, + 0, + 0, + 0, + 0, + 5, + 5, + 5, + 1, + 1, + 3, + 6, + 3, + 1, + 4, + 0, + 0, + 1, + 6, + 1, + 2, + 5, + 0, + 0, + 4, + 2, + 1, + 3, + 0, + 0, + 3 + ], + "weighted_loads": [ + 0.0518861748278141, + 0.0, + 0.039632752537727356, + 0.2891170233488083, + 0.09464923292398453, + 0.0, + 0.1996542252600193, + 0.0, + 0.0545252226293087, + 0.06290454417467117, + 0.2428799569606781, + 0.03794267028570175, + 0.0680435374379158, + 0.0550752729177475, + 0.18816673755645752, + 0.11475429311394691, + 0.0, + 0.71832724660635, + 0.03355490043759346, + 0.0, + 0.20776959136128426, + 0.0, + 0.30211341381073, + 0.08023195713758469, + 1.2237202413380146, + 0.0, + 0.0, + 0.0, + 0.0997675359249115, + 0.3958772346377373, + 0.5446714274585247, + 0.04271119460463524, + 0.14839737117290497, + 0.3841164670884609, + 0.0, + 0.0, + 0.0, + 0.0, + 0.5211213231086731, + 0.37205637246370316, + 0.387874074280262, + 0.030245451256632805, + 0.08751837909221649, + 0.11946265771985054, + 0.4107442535459995, + 0.2510324642062187, + 0.04928255453705788, + 0.36929257586598396, + 0.0, + 0.0, + 0.052957840263843536, + 0.42712533846497536, + 0.06303532421588898, + 0.10063642635941505, + 0.3905734121799469, + 0.0, + 0.0, + 0.1913345716893673, + 0.0960761047899723, + 0.04019495099782944, + 0.16556265577673912, + 0.0, + 0.0, + 0.15869880840182304 + ], + "unique_experts": 45, + "load_cv": 1.1277373986933654, + "normalized_load_entropy": 0.8538056309037126, + "max_load_share": 0.09420289855072464 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "f27c43f5d16e51f1615d2ddc4ca4f7ce3ee134302218f9b207d2dbf3eb767195", + "route_weight_sha256": "efa7328c5ed55a6540c26dc442b0152fd22e9adf2e43fd188a0d36e5e5dcb10d", + "loads": [ + 1, + 6, + 2, + 5, + 4, + 0, + 8, + 1, + 10, + 1, + 3, + 4, + 7, + 8, + 4, + 2, + 0, + 10, + 1, + 0, + 3, + 0, + 6, + 2, + 13, + 11, + 0, + 0, + 2, + 5, + 9, + 1, + 6, + 20, + 0, + 0, + 0, + 0, + 5, + 12, + 13, + 1, + 1, + 3, + 6, + 10, + 9, + 8, + 1, + 2, + 4, + 6, + 12, + 2, + 9, + 7, + 0, + 4, + 7, + 1, + 3, + 0, + 1, + 6 + ], + "weighted_loads": [ + 0.0518861748278141, + 0.3688052464276552, + 0.05182809196412563, + 0.39158793166279793, + 0.2593375709839165, + 0.0, + 0.6325048990547657, + 0.045780301094055176, + 0.6605421453714371, + 0.06290454417467117, + 0.2428799569606781, + 0.12964154966175556, + 0.40748417004942894, + 0.5846880972385406, + 0.18816673755645752, + 0.11475429311394691, + 0.0, + 0.8840212188661098, + 0.03355490043759346, + 0.0, + 0.20776959136128426, + 0.0, + 0.37516189739108086, + 0.08023195713758469, + 1.2237202413380146, + 0.7666409462690353, + 0.0, + 0.0, + 0.0997675359249115, + 0.3958772346377373, + 0.6283765290863812, + 0.04271119460463524, + 0.3200092986226082, + 1.579623568803072, + 0.0, + 0.0, + 0.0, + 0.0, + 0.5211213231086731, + 0.6018371637910604, + 0.836476594209671, + 0.030245451256632805, + 0.08751837909221649, + 0.11946265771985054, + 0.4107442535459995, + 0.9133057445287704, + 0.9318092353641987, + 0.49200422316789627, + 0.038599833846092224, + 0.09011975675821304, + 0.22238866612315178, + 0.42712533846497536, + 0.72461680136621, + 0.10063642635941505, + 1.9703076612204313, + 0.3629655931144953, + 0.0, + 0.1913345716893673, + 0.25437434390187263, + 0.04019495099782944, + 0.16556265577673912, + 0.0, + 0.046803586184978485, + 0.364407978951931 + ], + "unique_experts": 52, + "load_cv": 0.9517689832784342, + "normalized_load_entropy": 0.8860463919658296, + "max_load_share": 0.06944444444444445 + } + }, + "s1_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "0c82de464642fab4b008285a1906acef03fa2822085a4e78f10d8a61c7300b27", + "route_weight_sha256": "3d53ba82718cc14ffad1c014b91dd32cbb1cc374b17b91754df8e1c89eb7b32f", + "loads": [ + 1, + 0, + 1, + 3, + 1, + 0, + 3, + 0, + 1, + 1, + 3, + 1, + 1, + 1, + 4, + 2, + 0, + 7, + 1, + 0, + 3, + 0, + 4, + 2, + 13, + 0, + 0, + 0, + 2, + 5, + 6, + 1, + 2, + 7, + 0, + 0, + 0, + 0, + 5, + 5, + 5, + 1, + 1, + 3, + 6, + 3, + 1, + 4, + 0, + 0, + 1, + 6, + 1, + 2, + 5, + 0, + 0, + 4, + 2, + 1, + 3, + 0, + 0, + 3 + ], + "weighted_loads": [ + 0.04944627359509468, + 0.0, + 0.037891630083322525, + 0.2851029187440872, + 0.09096752107143402, + 0.0, + 0.19672533124685287, + 0.0, + 0.05175730213522911, + 0.0646793469786644, + 0.24208231270313263, + 0.03534868732094765, + 0.07097533345222473, + 0.05379408597946167, + 0.18162261694669724, + 0.11208180710673332, + 0.0, + 0.700824286788702, + 0.03298924118280411, + 0.0, + 0.21031669527292252, + 0.0, + 0.3015870489180088, + 0.0784432403743267, + 1.2380909733474255, + 0.0, + 0.0, + 0.0, + 0.10196711868047714, + 0.38724809885025024, + 0.5519619360566139, + 0.048108335584402084, + 0.14448555558919907, + 0.38646233081817627, + 0.0, + 0.0, + 0.0, + 0.0, + 0.5216900855302811, + 0.3720169849693775, + 0.3704841770231724, + 0.03083815984427929, + 0.08792674541473389, + 0.11967289447784424, + 0.4252581484615803, + 0.24684056639671326, + 0.04851547256112099, + 0.36995403841137886, + 0.0, + 0.0, + 0.046341851353645325, + 0.42465461045503616, + 0.06450675427913666, + 0.09729599207639694, + 0.3912152238190174, + 0.0, + 0.0, + 0.1878308802843094, + 0.09799673408269882, + 0.040448788553476334, + 0.16792802512645721, + 0.0, + 0.0, + 0.15926045924425125 + ], + "unique_experts": 45, + "load_cv": 1.1277373986933654, + "normalized_load_entropy": 0.8538056309037126, + "max_load_share": 0.09420289855072464 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "9908d6512558b5fa780ed98e32b84cf4310c76a4a237de86303b1b412fd7a475", + "route_weight_sha256": "58cca400d50b492e76acaeec80360f12a39a241d1bc531185fa45e6ef689f128", + "loads": [ + 2, + 5, + 11, + 5, + 3, + 1, + 14, + 0, + 15, + 1, + 5, + 5, + 10, + 8, + 4, + 2, + 0, + 21, + 2, + 0, + 3, + 0, + 5, + 6, + 13, + 11, + 0, + 2, + 3, + 5, + 9, + 1, + 6, + 26, + 0, + 0, + 0, + 0, + 11, + 10, + 19, + 1, + 3, + 3, + 6, + 16, + 17, + 8, + 4, + 4, + 5, + 6, + 10, + 8, + 9, + 10, + 0, + 4, + 6, + 3, + 3, + 4, + 2, + 8 + ], + "weighted_loads": [ + 0.08833999559283257, + 0.2825122084468603, + 0.6579294819384813, + 0.39748283103108406, + 0.2394983060657978, + 0.04455362260341644, + 1.1394184902310371, + 0.0, + 0.9619992524385452, + 0.0646793469786644, + 0.32998667657375336, + 0.1544023840688169, + 0.6059225611388683, + 0.5477727465331554, + 0.18162261694669724, + 0.11208180710673332, + 0.0, + 1.699960045516491, + 0.07967931777238846, + 0.0, + 0.21031669527292252, + 0.0, + 0.34154175221920013, + 0.26857112161815166, + 1.2380909733474255, + 1.1065079048275948, + 0.0, + 0.12170308083295822, + 0.14314082637429237, + 0.38724809885025024, + 0.6360171022824943, + 0.048108335584402084, + 0.2891053706407547, + 1.9092750176787376, + 0.0, + 0.0, + 0.0, + 0.0, + 0.9176943674683571, + 0.5178616400808096, + 1.03530665487051, + 0.03083815984427929, + 0.25609372183680534, + 0.11967289447784424, + 0.4252581484615803, + 1.4777115434408188, + 1.2988365553319454, + 0.48462401144206524, + 0.35092422366142273, + 0.2603931725025177, + 0.2641076259315014, + 0.42465461045503616, + 0.5868102815002203, + 0.7736235111951828, + 1.975391685962677, + 0.6018112506717443, + 0.0, + 0.1878308802843094, + 0.24550470639951527, + 0.1120174340903759, + 0.16792802512645721, + 0.18952183797955513, + 0.09865516796708107, + 0.4468616843223572 + ], + "unique_experts": 54, + "load_cv": 0.9344858955002419, + "normalized_load_entropy": 0.896600858679308, + "max_load_share": 0.06770833333333333 + } + }, + "s0_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "1d2ccbe767fe1fe68f60450424cebf4708ca9fd86a1d51752f3bbacffea5c535", + "route_weight_sha256": "24a9fca18da9fa209c32584755f96dcda6059474381f30e6df49f9fefc568ba9", + "loads": [ + 1, + 1, + 0, + 3, + 1, + 0, + 3, + 0, + 1, + 1, + 3, + 2, + 1, + 1, + 4, + 3, + 0, + 7, + 1, + 0, + 2, + 0, + 3, + 1, + 13, + 0, + 0, + 0, + 1, + 5, + 6, + 1, + 2, + 9, + 0, + 0, + 0, + 0, + 5, + 5, + 4, + 2, + 1, + 3, + 6, + 3, + 1, + 3, + 0, + 0, + 1, + 6, + 1, + 2, + 5, + 0, + 0, + 4, + 3, + 1, + 3, + 0, + 0, + 3 + ], + "weighted_loads": [ + 0.050374362617731094, + 0.0364212729036808, + 0.0, + 0.28098100423812866, + 0.10026323795318604, + 0.0, + 0.20199354737997055, + 0.0, + 0.05788545310497284, + 0.06009960547089577, + 0.23889512568712234, + 0.07551931962370872, + 0.06597133725881577, + 0.050602879375219345, + 0.18915990367531776, + 0.15119919553399086, + 0.0, + 0.7286926321685314, + 0.0340285561978817, + 0.0, + 0.15266576409339905, + 0.0, + 0.26660411059856415, + 0.04991330951452255, + 1.269943729043007, + 0.0, + 0.0, + 0.0, + 0.06271898001432419, + 0.3787078484892845, + 0.5512460246682167, + 0.04647386446595192, + 0.13877440243959427, + 0.49517086520791054, + 0.0, + 0.0, + 0.0, + 0.0, + 0.4914037585258484, + 0.365308053791523, + 0.39044180884957314, + 0.06625154428184032, + 0.08898354321718216, + 0.11855069920420647, + 0.42565325647592545, + 0.26366985589265823, + 0.05223207175731659, + 0.3124549947679043, + 0.0, + 0.0, + 0.05737289413809776, + 0.4157351925969124, + 0.05338684841990471, + 0.11117535084486008, + 0.4171680733561516, + 0.0, + 0.0, + 0.18896885216236115, + 0.12931860610842705, + 0.0382075272500515, + 0.16688231378793716, + 0.0, + 0.0, + 0.1670488864183426 + ], + "unique_experts": 45, + "load_cv": 1.1484078455453641, + "normalized_load_entropy": 0.8519543475816944, + "max_load_share": 0.09420289855072464 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "9572d2f2b3b384b419f6118f3f7a02465ec4c2d96c179d569120cc63fd589d6a", + "route_weight_sha256": "48da1a774a35c67123261a12721ef54a76904a5538157c7d924a914b4b787cff", + "loads": [ + 1, + 7, + 1, + 5, + 3, + 0, + 8, + 1, + 10, + 1, + 3, + 5, + 7, + 8, + 4, + 4, + 0, + 10, + 1, + 0, + 2, + 0, + 5, + 1, + 14, + 12, + 0, + 0, + 1, + 5, + 9, + 1, + 7, + 23, + 0, + 0, + 0, + 0, + 5, + 11, + 11, + 2, + 1, + 3, + 6, + 10, + 9, + 6, + 1, + 2, + 4, + 6, + 12, + 2, + 10, + 7, + 0, + 4, + 6, + 1, + 3, + 0, + 1, + 6 + ], + "weighted_loads": [ + 0.050374362617731094, + 0.405226519331336, + 0.012195339426398277, + 0.38397085666656494, + 0.25590067729353905, + 0.0, + 0.6398649364709854, + 0.045780301094055176, + 0.6807864531874657, + 0.06009960547089577, + 0.23889512568712234, + 0.16721819899976254, + 0.4054119698703289, + 0.5751363225281239, + 0.18915990367531776, + 0.19782885164022446, + 0.0, + 0.8796098455786705, + 0.0340285561978817, + 0.0, + 0.15266576409339905, + 0.0, + 0.339652594178915, + 0.04991330951452255, + 1.316568087786436, + 0.8243723176419735, + 0.0, + 0.0, + 0.06271898001432419, + 0.3787078484892845, + 0.6791721824556589, + 0.04647386446595192, + 0.36827170103788376, + 1.745741117745638, + 0.0, + 0.0, + 0.0, + 0.0, + 0.4914037585258484, + 0.6079473700374365, + 0.814133532345295, + 0.06625154428184032, + 0.08898354321718216, + 0.11855069920420647, + 0.42565325647592545, + 0.9033468589186668, + 0.8545019254088402, + 0.4257623516023159, + 0.038599833846092224, + 0.09011975675821304, + 0.226803719997406, + 0.4157351925969124, + 0.7149683255702257, + 0.11117535084486008, + 1.1711281146854162, + 0.3820824045687914, + 0.0, + 0.18896885216236115, + 0.24315976351499557, + 0.0382075272500515, + 0.16688231378793716, + 0.0, + 0.046803586184978485, + 0.37275805696845055 + ], + "unique_experts": 52, + "load_cv": 0.9930312739844154, + "normalized_load_entropy": 0.8809540346344898, + "max_load_share": 0.0798611111111111 + } + }, + "s1_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "1a33834fdabf3f62a9b280f547c9c6f887e634b2386b0e96424caa05af2c3a1f", + "route_weight_sha256": "d1946ae6a0aa0e4aa865424e272c5dfe713849b4739f955996f593efe2d3885c", + "loads": [ + 1, + 0, + 1, + 3, + 2, + 0, + 3, + 0, + 1, + 1, + 3, + 1, + 1, + 1, + 4, + 3, + 0, + 7, + 1, + 0, + 3, + 0, + 3, + 1, + 13, + 0, + 0, + 0, + 1, + 5, + 6, + 1, + 2, + 8, + 0, + 0, + 0, + 0, + 5, + 5, + 4, + 2, + 1, + 3, + 6, + 3, + 1, + 3, + 0, + 0, + 1, + 6, + 1, + 2, + 5, + 0, + 0, + 4, + 3, + 1, + 3, + 0, + 0, + 3 + ], + "weighted_loads": [ + 0.04826585203409195, + 0.0, + 0.03446078673005104, + 0.28184330463409424, + 0.1353083737194538, + 0.0, + 0.19895454868674278, + 0.0, + 0.053096991032361984, + 0.061969093978405, + 0.2441626414656639, + 0.03621416166424751, + 0.06884435564279556, + 0.05113041773438454, + 0.17707736045122147, + 0.15103595703840256, + 0.0, + 0.7219896502792835, + 0.03556056320667267, + 0.0, + 0.20602447167038918, + 0.0, + 0.26629748940467834, + 0.05251314491033554, + 1.2651598155498505, + 0.0, + 0.0, + 0.0, + 0.06532730907201767, + 0.37919890880584717, + 0.5598526261746883, + 0.047569792717695236, + 0.12854526937007904, + 0.4548353813588619, + 0.0, + 0.0, + 0.0, + 0.0, + 0.489037349820137, + 0.3794986642897129, + 0.37387219071388245, + 0.0673196092247963, + 0.09183578938245773, + 0.12229839712381363, + 0.43560420721769333, + 0.25879017263650894, + 0.0517580471932888, + 0.3287217952311039, + 0.0, + 0.0, + 0.055630531162023544, + 0.4306756965816021, + 0.059259407222270966, + 0.10849537327885628, + 0.4120865724980831, + 0.0, + 0.0, + 0.18876631930470467, + 0.13449495285749435, + 0.04059875011444092, + 0.17428544536232948, + 0.0, + 0.0, + 0.16555801033973694 + ], + "unique_experts": 45, + "load_cv": 1.1307134550602624, + "normalized_load_entropy": 0.8540973880536961, + "max_load_share": 0.09420289855072464 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "efb3d08c7431d0849b084230ed16f1f2b2c209f5545c7d43bf6ae2dd86b39f68", + "route_weight_sha256": "acbeaa20beb61136f42042a3d745e0e3dece57980ca35262d7f6efd08d729907", + "loads": [ + 2, + 5, + 11, + 5, + 5, + 1, + 14, + 0, + 14, + 1, + 5, + 4, + 10, + 8, + 4, + 3, + 0, + 22, + 2, + 0, + 3, + 0, + 4, + 5, + 13, + 11, + 0, + 2, + 2, + 5, + 9, + 1, + 6, + 29, + 0, + 0, + 0, + 0, + 11, + 9, + 18, + 2, + 3, + 3, + 6, + 17, + 17, + 6, + 4, + 5, + 5, + 6, + 10, + 8, + 9, + 10, + 0, + 4, + 5, + 2, + 3, + 4, + 2, + 9 + ], + "weighted_loads": [ + 0.08715957403182983, + 0.2825122084468603, + 0.6544986385852098, + 0.39807991310954094, + 0.33195196837186813, + 0.04455362260341644, + 1.1402076743543148, + 0.0, + 0.9412411116063595, + 0.061969093978405, + 0.33206700533628464, + 0.15209303423762321, + 0.6037915833294392, + 0.535355381667614, + 0.17707736045122147, + 0.15103595703840256, + 0.0, + 1.7581577375531197, + 0.08225063979625702, + 0.0, + 0.20602447167038918, + 0.0, + 0.3062521927058697, + 0.2426410261541605, + 1.2651598155498505, + 1.1065079048275948, + 0.0, + 0.12170308083295822, + 0.1065010167658329, + 0.37919890880584717, + 0.6810964439064264, + 0.047569792717695236, + 0.2731650844216347, + 2.122817639261484, + 0.0, + 0.0, + 0.0, + 0.0, + 0.885041631758213, + 0.5303531866520643, + 1.0732560940086842, + 0.0673196092247963, + 0.2600027658045292, + 0.12229839712381363, + 0.43560420721769333, + 1.5423704646527767, + 1.241002969443798, + 0.4343729093670845, + 0.35092422366142273, + 0.30220675095915794, + 0.2733963057398796, + 0.4306756965816021, + 0.5815629344433546, + 0.7848228923976421, + 1.1323012635111809, + 0.6170000582933426, + 0.0, + 0.18876631930470467, + 0.2336006909608841, + 0.07363586872816086, + 0.17428544536232948, + 0.18952183797955513, + 0.09865516796708107, + 0.5054061226546764 + ], + "unique_experts": 54, + "load_cv": 0.9637527921850314, + "normalized_load_entropy": 0.8943819127233734, + "max_load_share": 0.07552083333333333 + } + }, + "s0_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "590030722b6822821b684f7f451bf0d55dd9540677a36f6bb11ccd369706b6d1", + "route_weight_sha256": "5fe6081178d72ec9bc24eeda47c39b183c097becbba4d2377be0aa519d97fe4a", + "loads": [ + 1, + 1, + 0, + 3, + 1, + 0, + 3, + 0, + 1, + 1, + 3, + 2, + 1, + 1, + 5, + 3, + 0, + 7, + 1, + 0, + 2, + 0, + 3, + 1, + 13, + 0, + 0, + 0, + 1, + 5, + 6, + 0, + 2, + 10, + 0, + 0, + 1, + 0, + 5, + 5, + 4, + 2, + 1, + 3, + 5, + 3, + 1, + 3, + 0, + 0, + 1, + 6, + 1, + 2, + 4, + 0, + 0, + 4, + 3, + 1, + 3, + 0, + 0, + 3 + ], + "weighted_loads": [ + 0.0579766109585762, + 0.04070095717906952, + 0.0, + 0.30001839995384216, + 0.10201187431812286, + 0.0, + 0.20095768570899963, + 0.0, + 0.057897455990314484, + 0.053741537034511566, + 0.24359197542071342, + 0.07594609633088112, + 0.06197041645646095, + 0.05089111253619194, + 0.23420098796486855, + 0.157540924847126, + 0.0, + 0.6827395297586918, + 0.03647138923406601, + 0.0, + 0.1545560583472252, + 0.0, + 0.26540639996528625, + 0.04795434698462486, + 1.2711779028177261, + 0.0, + 0.0, + 0.0, + 0.061149828135967255, + 0.3561086244881153, + 0.5552875883877277, + 0.0, + 0.1462557688355446, + 0.534392986446619, + 0.0, + 0.0, + 0.036835893988609314, + 0.0, + 0.5113278105854988, + 0.3541453592479229, + 0.38743241131305695, + 0.06852674670517445, + 0.08754602819681168, + 0.12159135937690735, + 0.36859555169939995, + 0.26359714567661285, + 0.0499248243868351, + 0.3304514102637768, + 0.0, + 0.0, + 0.05921802297234535, + 0.42117488384246826, + 0.051944248378276825, + 0.1152295246720314, + 0.3702292926609516, + 0.0, + 0.0, + 0.17332031205296516, + 0.13264362886548042, + 0.038938216865062714, + 0.16334383562207222, + 0.0, + 0.0, + 0.15722743421792984 + ], + "unique_experts": 45, + "load_cv": 1.1600541745456103, + "normalized_load_entropy": 0.8510004569947345, + "max_load_share": 0.09420289855072464 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "192915d60dc5541c20ceb1f2d48816b3ea517ac76d3db0caee0615b4671190d8", + "route_weight_sha256": "3df2c05a0df2b9afb9d2ad272159eb291e92ef4c16f9cc70c841c1e82b9b42fe", + "loads": [ + 1, + 8, + 2, + 5, + 3, + 0, + 9, + 1, + 11, + 1, + 3, + 5, + 7, + 9, + 5, + 3, + 0, + 10, + 1, + 0, + 2, + 0, + 5, + 1, + 13, + 13, + 0, + 0, + 1, + 5, + 8, + 0, + 8, + 23, + 0, + 0, + 1, + 0, + 5, + 10, + 9, + 2, + 1, + 3, + 5, + 9, + 9, + 6, + 1, + 3, + 5, + 6, + 12, + 2, + 7, + 8, + 0, + 4, + 6, + 1, + 3, + 0, + 1, + 6 + ], + "weighted_loads": [ + 0.0579766109585762, + 0.4621721673756838, + 0.05347456969320774, + 0.4014231376349926, + 0.246340099722147, + 0.0, + 0.6962547339498997, + 0.045780301094055176, + 0.7699525393545628, + 0.053741537034511566, + 0.24359197542071342, + 0.16764497570693493, + 0.4014110490679741, + 0.6652918942272663, + 0.23420098796486855, + 0.157540924847126, + 0.0, + 0.8239355683326721, + 0.03647138923406601, + 0.0, + 0.1545560583472252, + 0.0, + 0.33845488354563713, + 0.04795434698462486, + 1.2711779028177261, + 0.9168521091341972, + 0.0, + 0.0, + 0.061149828135967255, + 0.3561086244881153, + 0.6259207334369421, + 0.0, + 0.42444124445319176, + 1.5402631647884846, + 0.0, + 0.0, + 0.036835893988609314, + 0.0, + 0.5113278105854988, + 0.5422727148979902, + 0.6874519772827625, + 0.06852674670517445, + 0.08754602819681168, + 0.12159135937690735, + 0.36859555169939995, + 0.8491754978895187, + 0.8236472494900227, + 0.4437587670981884, + 0.038599833846092224, + 0.1407836154103279, + 0.281829159706831, + 0.42117488384246826, + 0.7135257255285978, + 0.1152295246720314, + 1.0403454210609198, + 0.4382516276091337, + 0.0, + 0.17332031205296516, + 0.24648478627204895, + 0.038938216865062714, + 0.16334383562207222, + 0.0, + 0.046803586184978485, + 0.3629366047680378 + ], + "unique_experts": 52, + "load_cv": 0.976577546180386, + "normalized_load_entropy": 0.8841308103261004, + "max_load_share": 0.0798611111111111 + } + }, + "s1_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "ddcd7ced8be44d7d8fa812c76773553a57cc0b0c9796c5affa8ea2eb7d76be95", + "route_weight_sha256": "752edde246bcbd96c2cbd2b969d50800b984038e0d4daeb7cf7eebd5d214388c", + "loads": [ + 1, + 1, + 0, + 3, + 1, + 0, + 3, + 0, + 1, + 1, + 3, + 3, + 1, + 1, + 5, + 2, + 0, + 7, + 1, + 0, + 3, + 0, + 3, + 1, + 13, + 0, + 0, + 0, + 1, + 5, + 6, + 0, + 2, + 8, + 0, + 0, + 1, + 0, + 5, + 5, + 4, + 2, + 1, + 3, + 6, + 3, + 1, + 3, + 0, + 0, + 1, + 6, + 1, + 2, + 4, + 0, + 0, + 4, + 3, + 1, + 3, + 0, + 0, + 3 + ], + "weighted_loads": [ + 0.04804347828030586, + 0.03456293046474457, + 0.0, + 0.29987821727991104, + 0.09797413647174835, + 0.0, + 0.2019381746649742, + 0.0, + 0.05196792632341385, + 0.05571897700428963, + 0.2526758015155792, + 0.10468989610671997, + 0.06459727138280869, + 0.05168738588690758, + 0.22423383966088295, + 0.11322946473956108, + 0.0, + 0.69699577242136, + 0.03983365744352341, + 0.0, + 0.20949025079607964, + 0.0, + 0.266400545835495, + 0.0453299805521965, + 1.2376255840063095, + 0.0, + 0.0, + 0.0, + 0.06363708525896072, + 0.3651170879602432, + 0.5521652512252331, + 0.0, + 0.1374604031443596, + 0.43806205689907074, + 0.0, + 0.0, + 0.03448987752199173, + 0.0, + 0.5194386765360832, + 0.36598703637719154, + 0.3739628717303276, + 0.07167539745569229, + 0.08854812383651733, + 0.13009824976325035, + 0.41183723509311676, + 0.2515581250190735, + 0.05440567061305046, + 0.3475860208272934, + 0.0, + 0.0, + 0.057232603430747986, + 0.4245828427374363, + 0.05680494382977486, + 0.12178028747439384, + 0.3538072481751442, + 0.0, + 0.0, + 0.18366235494613647, + 0.14010194689035416, + 0.04077450931072235, + 0.1734449453651905, + 0.0, + 0.0, + 0.15898767486214638 + ], + "unique_experts": 45, + "load_cv": 1.1307134550602624, + "normalized_load_entropy": 0.8540973880536958, + "max_load_share": 0.09420289855072464 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "c6a028c05708257de7911b8b5d223b27c0b61e60bd75a7e07f23061015e7cbfb", + "route_weight_sha256": "4eb110282730b379695b304968f36d53191a17f6fc51f5efedd942b076b6ac40", + "loads": [ + 2, + 7, + 11, + 6, + 3, + 1, + 16, + 0, + 15, + 1, + 5, + 7, + 10, + 10, + 5, + 2, + 0, + 21, + 2, + 0, + 3, + 0, + 4, + 5, + 13, + 14, + 0, + 2, + 2, + 5, + 8, + 0, + 7, + 26, + 0, + 0, + 1, + 0, + 11, + 8, + 15, + 2, + 3, + 3, + 6, + 16, + 16, + 6, + 4, + 5, + 6, + 6, + 10, + 8, + 7, + 10, + 0, + 4, + 5, + 2, + 3, + 4, + 2, + 8 + ], + "weighted_loads": [ + 0.08693720027804375, + 0.3614006992429495, + 0.656417852267623, + 0.4669078700244427, + 0.243507232517004, + 0.04455362260341644, + 1.2358577996492386, + 0.0, + 1.0039648190140724, + 0.05571897700428963, + 0.34058016538619995, + 0.2591518647968769, + 0.5995444990694523, + 0.6730222478508949, + 0.22423383966088295, + 0.11322946473956108, + 0.0, + 1.6906651072204113, + 0.08652373403310776, + 0.0, + 0.20949025079607964, + 0.0, + 0.3063552491366863, + 0.23545786179602146, + 1.2376255840063095, + 1.3121744878590107, + 0.0, + 0.12170308083295822, + 0.10481079295277596, + 0.3651170879602432, + 0.6228817943483591, + 0.0, + 0.3240041583776474, + 1.6694304645061493, + 0.0, + 0.0, + 0.03448987752199173, + 0.0, + 0.9154429584741592, + 0.47306800074875355, + 0.8805300816893578, + 0.07167539745569229, + 0.2567151002585888, + 0.13009824976325035, + 0.41183723509311676, + 1.366042584180832, + 1.124701626598835, + 0.453237134963274, + 0.35092422366142273, + 0.3119250200688839, + 0.3471840061247349, + 0.4245828427374363, + 0.5791084710508585, + 0.7981078065931797, + 1.0279290042817593, + 0.5905410125851631, + 0.0, + 0.18366235494613647, + 0.2392076849937439, + 0.07381162792444229, + 0.1734449453651905, + 0.18952183797955513, + 0.09865516796708107, + 0.4465888999402523 + ], + "unique_experts": 54, + "load_cv": 0.9232716585900141, + "normalized_load_entropy": 0.8979984314287346, + "max_load_share": 0.06770833333333333 + } + }, + "s0_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "feb096d1c5b55ce096bf50ae1d952b331342279b8e61502b5ad436688b0512f1", + "route_weight_sha256": "d7eeec4d8b82e12d813b721d10a921069113c2e067781edd86c193c4c4e04b53", + "loads": [ + 1, + 1, + 0, + 3, + 1, + 0, + 3, + 0, + 1, + 1, + 3, + 2, + 1, + 1, + 5, + 2, + 0, + 7, + 1, + 0, + 2, + 0, + 4, + 1, + 13, + 0, + 0, + 0, + 1, + 5, + 6, + 0, + 2, + 9, + 0, + 0, + 1, + 0, + 5, + 5, + 4, + 2, + 1, + 3, + 6, + 3, + 0, + 3, + 0, + 0, + 1, + 7, + 1, + 2, + 4, + 0, + 0, + 4, + 4, + 1, + 3, + 0, + 0, + 2 + ], + "weighted_loads": [ + 0.061393409967422485, + 0.04070766642689705, + 0.0, + 0.3005855306982994, + 0.09884753078222275, + 0.0, + 0.2044849544763565, + 0.0, + 0.05768027529120445, + 0.05228177458047867, + 0.2439464032649994, + 0.07599589973688126, + 0.06461311876773834, + 0.05267707258462906, + 0.23482047021389008, + 0.11904691159725189, + 0.0, + 0.6708995029330254, + 0.03415989503264427, + 0.0, + 0.15674515068531036, + 0.0, + 0.30494221672415733, + 0.04490262642502785, + 1.261382583528757, + 0.0, + 0.0, + 0.0, + 0.05988220497965813, + 0.3515985757112503, + 0.5513467080891132, + 0.0, + 0.14571809768676758, + 0.5233568549156189, + 0.0, + 0.0, + 0.03489344194531441, + 0.0, + 0.5070023089647293, + 0.35998133197426796, + 0.38438113033771515, + 0.06668663769960403, + 0.08599748462438583, + 0.12492816895246506, + 0.4141564145684242, + 0.26425234973430634, + 0.0, + 0.33173181489109993, + 0.0, + 0.0, + 0.05990935117006302, + 0.47263945639133453, + 0.05151454731822014, + 0.10981763526797295, + 0.36300941556692123, + 0.0, + 0.0, + 0.17349446937441826, + 0.1593445986509323, + 0.03969038650393486, + 0.17204414680600166, + 0.0, + 0.0, + 0.10874713212251663 + ], + "unique_experts": 44, + "load_cv": 1.171584737034095, + "normalized_load_entropy": 0.8457681646814259, + "max_load_share": 0.09420289855072464 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "e2b26ef73388d1e94470666a401623e8a9a9ae835deaab402989d3fff9df14ab", + "route_weight_sha256": "ac8e2cd2b041e608fbfac86af3434d5da78bb03a00842b41ef49c71cbaebfcb6", + "loads": [ + 1, + 7, + 1, + 5, + 3, + 0, + 11, + 1, + 11, + 1, + 3, + 5, + 7, + 9, + 5, + 2, + 0, + 10, + 1, + 0, + 2, + 0, + 6, + 1, + 13, + 13, + 0, + 0, + 1, + 5, + 8, + 0, + 7, + 22, + 0, + 0, + 1, + 0, + 5, + 10, + 8, + 2, + 1, + 3, + 6, + 9, + 9, + 6, + 1, + 4, + 4, + 7, + 12, + 2, + 7, + 8, + 0, + 4, + 7, + 1, + 3, + 0, + 1, + 6 + ], + "weighted_loads": [ + 0.061393409967422485, + 0.40951291285455227, + 0.012195339426398277, + 0.3993605822324753, + 0.24487623944878578, + 0.0, + 0.8540060631930828, + 0.045780301094055176, + 0.8259281106293201, + 0.05228177458047867, + 0.2439464032649994, + 0.16769477911293507, + 0.4040537513792515, + 0.6273329965770245, + 0.23482047021389008, + 0.11904691159725189, + 0.0, + 0.8015641942620277, + 0.03415989503264427, + 0.0, + 0.15674515068531036, + 0.0, + 0.3779907003045082, + 0.04490262642502785, + 1.261382583528757, + 0.9161869511008263, + 0.0, + 0.0, + 0.05988220497965813, + 0.3515985757112503, + 0.6245869044214487, + 0.0, + 0.3922465667128563, + 1.5473687462508678, + 0.0, + 0.0, + 0.03489344194531441, + 0.0, + 0.5070023089647293, + 0.5524314027279615, + 0.6356757320463657, + 0.06668663769960403, + 0.08599748462438583, + 0.12492816895246506, + 0.4141564145684242, + 0.8390368148684502, + 0.8441619537770748, + 0.44503917172551155, + 0.038599833846092224, + 0.1722102276980877, + 0.22934017702937126, + 0.47263945639133453, + 0.7130960244685411, + 0.10981763526797295, + 1.034704128280282, + 0.4326539374887943, + 0.0, + 0.17349446937441826, + 0.27318575605750084, + 0.03969038650393486, + 0.17204414680600166, + 0.0, + 0.046803586184978485, + 0.43844036385416985 + ], + "unique_experts": 52, + "load_cv": 0.9710310162749186, + "normalized_load_entropy": 0.8833623440125973, + "max_load_share": 0.0763888888888889 + } + }, + "s1_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "4c09c29519529a8e6fd6b97c0c153fe602e3795709c7d30746356d8a86200c63", + "route_weight_sha256": "8eb39fd8920b38f65e65636370af5e1bbb157b7e7e15ed7578a92f2fb218240e", + "loads": [ + 1, + 1, + 0, + 3, + 1, + 0, + 3, + 0, + 1, + 1, + 3, + 3, + 1, + 1, + 4, + 2, + 0, + 8, + 1, + 0, + 3, + 0, + 4, + 1, + 13, + 0, + 0, + 0, + 1, + 5, + 6, + 1, + 2, + 7, + 0, + 0, + 1, + 0, + 5, + 5, + 5, + 2, + 1, + 3, + 6, + 3, + 1, + 3, + 0, + 0, + 1, + 6, + 1, + 2, + 3, + 0, + 0, + 4, + 2, + 1, + 3, + 0, + 0, + 3 + ], + "weighted_loads": [ + 0.05172301083803177, + 0.03525795042514801, + 0.0, + 0.30154532939195633, + 0.09632184356451035, + 0.0, + 0.19737236201763153, + 0.0, + 0.052124250680208206, + 0.055935949087142944, + 0.25537846982479095, + 0.10442510433495045, + 0.06575936824083328, + 0.05261088162660599, + 0.17424601688981056, + 0.10535504296422005, + 0.0, + 0.7215910963714123, + 0.0368405282497406, + 0.0, + 0.21496804058551788, + 0.0, + 0.3073900640010834, + 0.04133382439613342, + 1.2197400741279125, + 0.0, + 0.0, + 0.0, + 0.06441660225391388, + 0.3647898957133293, + 0.5536521710455418, + 0.050774939358234406, + 0.13369344919919968, + 0.38644368201494217, + 0.0, + 0.0, + 0.032629285007715225, + 0.0, + 0.5311092883348465, + 0.3766593299806118, + 0.3942889980971813, + 0.06888335943222046, + 0.08710416406393051, + 0.1286483220756054, + 0.41327644884586334, + 0.25351155549287796, + 0.048063091933727264, + 0.34761617332696915, + 0.0, + 0.0, + 0.05664375051856041, + 0.42939841374754906, + 0.055303193628787994, + 0.12471634149551392, + 0.310725636780262, + 0.0, + 0.0, + 0.1841467171907425, + 0.10196046531200409, + 0.039902135729789734, + 0.17448854818940163, + 0.0, + 0.0, + 0.16067323833703995 + ], + "unique_experts": 46, + "load_cv": 1.124753467818188, + "normalized_load_entropy": 0.857424546872734, + "max_load_share": 0.09420289855072464 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "28955233413554770515ec74cc382f3ac08e28ae892e429d30f8cdf4783f8f30", + "route_weight_sha256": "30a37978d9efa10fe838c046a4b387c9fd45e194ba9e16b16f6791713d20bb34", + "loads": [ + 2, + 6, + 10, + 6, + 3, + 1, + 17, + 0, + 15, + 1, + 5, + 6, + 10, + 8, + 4, + 2, + 0, + 23, + 2, + 0, + 3, + 0, + 5, + 5, + 13, + 14, + 0, + 2, + 2, + 5, + 8, + 1, + 6, + 25, + 0, + 0, + 1, + 0, + 11, + 8, + 16, + 2, + 3, + 3, + 6, + 15, + 18, + 6, + 4, + 7, + 5, + 6, + 10, + 8, + 6, + 11, + 0, + 4, + 4, + 2, + 3, + 4, + 2, + 9 + ], + "weighted_loads": [ + 0.09061673283576965, + 0.3177701588720083, + 0.6200378518551588, + 0.4663437679409981, + 0.23984668031334877, + 0.04455362260341644, + 1.3525034710764885, + 0.0, + 1.0312829315662384, + 0.055935949087142944, + 0.3432828336954117, + 0.22030397690832615, + 0.6007065959274769, + 0.5404546223580837, + 0.17424601688981056, + 0.10535504296422005, + 0.0, + 1.7613736391067505, + 0.08353060483932495, + 0.0, + 0.21496804058551788, + 0.0, + 0.3473447673022747, + 0.23146170563995838, + 1.2197400741279125, + 1.283573042601347, + 0.0, + 0.12170308083295822, + 0.10559030994772911, + 0.3647898957133293, + 0.6197381746023893, + 0.050774939358234406, + 0.2783132642507553, + 1.6182392723858356, + 0.0, + 0.0, + 0.032629285007715225, + 0.0, + 0.9271135702729225, + 0.48117426969110966, + 0.9047169387340546, + 0.06888335943222046, + 0.25527114048600197, + 0.1286483220756054, + 0.41327644884586334, + 1.3260766342282295, + 1.2709414400160313, + 0.45326728746294975, + 0.35092422366142273, + 0.4124293699860573, + 0.2744095250964165, + 0.42939841374754906, + 0.5776067208498716, + 0.8010438606142998, + 0.9792663939297199, + 0.6322701945900917, + 0.0, + 0.1841467171907425, + 0.20106620341539383, + 0.07293925434350967, + 0.17448854818940163, + 0.18952183797955513, + 0.09865516796708107, + 0.524510033428669 + ], + "unique_experts": 55, + "load_cv": 0.9400428477232065, + "normalized_load_entropy": 0.8973434727697436, + "max_load_share": 0.06510416666666667 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "ordered_topk_exact_tokens": 18, + "set_exact_tokens": 23, + "mean_set_jaccard": 1.0, + "mean_token_weighted_tv": 0.006997563349811927, + "aggregate_load_tv": 0.0 + }, + "system_bos": { + "tokens": 23, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 20, + "mean_set_jaccard": 0.9627329192546585, + "mean_token_weighted_tv": 0.014537619872261648, + "aggregate_load_tv": 0.021739130434782605 + }, + "system_x": { + "tokens": 23, + "ordered_topk_exact_tokens": 16, + "set_exact_tokens": 20, + "mean_set_jaccard": 0.9627329192546585, + "mean_token_weighted_tv": 0.017473606109295204, + "aggregate_load_tv": 0.021739130434782608 + }, + "system_period": { + "tokens": 23, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.9130434782608695, + "mean_token_weighted_tv": 0.024964722237833168, + "aggregate_load_tv": 0.05072463768115942 + }, + "bos_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.9130434782608695, + "mean_token_weighted_tv": 0.02341229662947033, + "aggregate_load_tv": 0.05072463768115942 + }, + "bos_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 16, + "set_exact_tokens": 18, + "mean_set_jaccard": 0.9378881987577641, + "mean_token_weighted_tv": 0.019386045108346836, + "aggregate_load_tv": 0.036231884057971016 + }, + "x_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.8819875776397516, + "mean_token_weighted_tv": 0.031708181714234146, + "aggregate_load_tv": 0.07246376811594203 + }, + "x_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.9037267080745341, + "mean_token_weighted_tv": 0.02794892458326143, + "aggregate_load_tv": 0.05797101449275363 + }, + "period_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8788819875776398, + "mean_token_weighted_tv": 0.032050050349663135, + "aggregate_load_tv": 0.07246376811594203 + }, + "period_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.9161490683229815, + "mean_token_weighted_tv": 0.026485147440563076, + "aggregate_load_tv": 0.04347826086956522 + } + } + }, + "layer_09": { + "layer": 9, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "72bd7a68a65bd98269e10b2444b666adf2ba7d8c5a6b707b02d428e703654477", + "route_weight_sha256": "90dffc924cd876bce4237734e7c9918f089fd42a1a3ad04259797313a0889e82", + "loads": [ + 7, + 2, + 0, + 0, + 1, + 2, + 0, + 3, + 1, + 2, + 2, + 0, + 0, + 7, + 2, + 2, + 3, + 4, + 0, + 0, + 2, + 1, + 8, + 1, + 4, + 4, + 0, + 5, + 1, + 0, + 0, + 2, + 4, + 2, + 1, + 3, + 6, + 4, + 0, + 0, + 0, + 3, + 1, + 9, + 1, + 2, + 5, + 1, + 3, + 4, + 2, + 0, + 0, + 1, + 0, + 2, + 0, + 1, + 3, + 1, + 4, + 1, + 4, + 4 + ], + "weighted_loads": [ + 0.39373327419161797, + 0.09742392227053642, + 0.0, + 0.0, + 0.08307328820228577, + 0.07899301499128342, + 0.0, + 0.2347363941371441, + 0.10389664024114609, + 0.10646060481667519, + 0.1773630753159523, + 0.0, + 0.0, + 0.4790884479880333, + 0.14823003858327866, + 0.14371836185455322, + 0.19880983978509903, + 0.21364636346697807, + 0.0, + 0.0, + 0.09767444059252739, + 0.029366744682192802, + 0.5427750162780285, + 0.03817254677414894, + 0.21229782328009605, + 0.2101408690214157, + 0.0, + 0.38353871554136276, + 0.06400313228368759, + 0.0, + 0.0, + 0.09985669702291489, + 0.45433543622493744, + 0.23678766191005707, + 0.0698854997754097, + 0.22495625540614128, + 0.460092157125473, + 0.27435972169041634, + 0.0, + 0.0, + 0.0, + 0.19281385838985443, + 0.04867986589670181, + 0.7359848842024803, + 0.04527246206998825, + 0.10940328612923622, + 0.25536223500967026, + 0.04729057848453522, + 0.22553206235170364, + 0.40754250809550285, + 0.10855981148779392, + 0.0, + 0.0, + 0.09574846178293228, + 0.0, + 0.1055360697209835, + 0.0, + 0.036988016217947006, + 0.25411685556173325, + 0.052455835044384, + 0.2458295002579689, + 0.05011427029967308, + 0.39545898139476776, + 0.19766290672123432 + ], + "unique_experts": 47, + "load_cv": 0.9879551865016964, + "normalized_load_entropy": 0.8766735509026797, + "max_load_share": 0.06521739130434782 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "1b57b555bbd91af505e50b1375aadbccdd08d6c14968690b08186090f07eb1dc", + "route_weight_sha256": "0d1b8162d1555ce73856b6f76c80993cfe37d213f82c8928fdb1563e9ac82f27", + "loads": [ + 13, + 2, + 0, + 0, + 3, + 2, + 0, + 3, + 3, + 2, + 13, + 0, + 3, + 12, + 2, + 2, + 4, + 7, + 0, + 12, + 2, + 1, + 13, + 3, + 7, + 5, + 0, + 6, + 1, + 0, + 1, + 8, + 6, + 2, + 10, + 10, + 6, + 4, + 2, + 0, + 0, + 13, + 1, + 9, + 6, + 11, + 17, + 1, + 5, + 4, + 7, + 1, + 0, + 4, + 0, + 7, + 5, + 1, + 5, + 5, + 4, + 1, + 6, + 5 + ], + "weighted_loads": [ + 0.8326996341347694, + 0.09742392227053642, + 0.0, + 0.0, + 0.3731730580329895, + 0.07899301499128342, + 0.0, + 0.2347363941371441, + 0.20061451569199562, + 0.10646060481667519, + 1.3572789058089256, + 0.0, + 0.05235138488933444, + 0.6351985225919634, + 0.14823003858327866, + 0.14371836185455322, + 0.23972787708044052, + 0.3232118170708418, + 0.0, + 1.2026403732597828, + 0.09767444059252739, + 0.029366744682192802, + 2.146270353347063, + 0.21110494807362556, + 0.3417271040380001, + 0.28671372681856155, + 0.0, + 0.3964583268389106, + 0.06400313228368759, + 0.0, + 0.03952590748667717, + 0.28957177279517055, + 0.4916959311813116, + 0.23678766191005707, + 0.565718712285161, + 0.6867104880511761, + 0.460092157125473, + 0.27435972169041634, + 0.08508895337581635, + 0.0, + 0.0, + 1.240547750145197, + 0.04867986589670181, + 0.7359848842024803, + 0.3475702181458473, + 0.9350400567054749, + 1.2434000559151173, + 0.04729057848453522, + 0.348177045583725, + 0.40754250809550285, + 0.44309346936643124, + 0.033672723919153214, + 0.0, + 0.2188115082681179, + 0.0, + 0.43158910796046257, + 0.24088618531823158, + 0.036988016217947006, + 0.3753591924905777, + 0.22748005017638206, + 0.2458295002579689, + 0.05011427029967308, + 0.45115681923925877, + 0.23388374410569668 + ], + "unique_experts": 53, + "load_cv": 0.927128848237702, + "normalized_load_entropy": 0.8925815039589475, + "max_load_share": 0.059027777777777776 + } + }, + "s1_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "bac12d1ebdc61ef8b00426b8ab49b32f08998df4de8030748138f8d7da8cb0e9", + "route_weight_sha256": "ab8d97c43fdc48edecd16616391f5f23ed707a4438d64a9676e93e65cb3360eb", + "loads": [ + 6, + 2, + 0, + 0, + 1, + 4, + 0, + 3, + 1, + 2, + 2, + 0, + 0, + 7, + 2, + 2, + 3, + 4, + 0, + 0, + 2, + 2, + 8, + 1, + 4, + 3, + 0, + 5, + 1, + 1, + 0, + 1, + 4, + 2, + 1, + 3, + 6, + 4, + 0, + 0, + 0, + 3, + 1, + 9, + 1, + 2, + 5, + 1, + 3, + 4, + 1, + 0, + 0, + 1, + 0, + 2, + 0, + 1, + 3, + 1, + 4, + 1, + 3, + 5 + ], + "weighted_loads": [ + 0.32904191315174103, + 0.09773366898298264, + 0.0, + 0.0, + 0.0839213952422142, + 0.13403310999274254, + 0.0, + 0.2324807345867157, + 0.10423697531223297, + 0.10767059400677681, + 0.17666569352149963, + 0.0, + 0.0, + 0.48310495540499687, + 0.14651881158351898, + 0.14197765290737152, + 0.20371776819229126, + 0.2133926972746849, + 0.0, + 0.0, + 0.0969272330403328, + 0.0758505929261446, + 0.5340397451072931, + 0.03622711822390556, + 0.20220544934272766, + 0.18209409713745117, + 0.0, + 0.3773878291249275, + 0.0650104284286499, + 0.03582954779267311, + 0.0, + 0.054846666753292084, + 0.4615178070962429, + 0.2282300665974617, + 0.0703241303563118, + 0.22206507250666618, + 0.4602305591106415, + 0.2798801399767399, + 0.0, + 0.0, + 0.0, + 0.1899072676897049, + 0.04784967005252838, + 0.7200751826167107, + 0.045946188271045685, + 0.10819467157125473, + 0.24307840317487717, + 0.055899448692798615, + 0.22308573126792908, + 0.4002130813896656, + 0.08504509925842285, + 0.0, + 0.0, + 0.09454203397035599, + 0.0, + 0.10976475104689598, + 0.0, + 0.03306024521589279, + 0.2489505484700203, + 0.054250333458185196, + 0.23974360898137093, + 0.04793968051671982, + 0.3553623557090759, + 0.2448513377457857 + ], + "unique_experts": 48, + "load_cv": 0.9742537361309165, + "normalized_load_entropy": 0.880323664394603, + "max_load_share": 0.06521739130434782 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "2ddafd3633e5a538842211660b790934f590a477d95df668341cdc0ad58a0c65", + "route_weight_sha256": "29ca498face45fefb7c60c0bfec5da7604a5616bc8ed1f1dd5e0fa20976723c4", + "loads": [ + 16, + 4, + 0, + 0, + 3, + 4, + 0, + 3, + 8, + 4, + 13, + 2, + 3, + 11, + 3, + 2, + 4, + 6, + 0, + 12, + 2, + 5, + 13, + 11, + 9, + 11, + 4, + 6, + 7, + 1, + 2, + 6, + 6, + 5, + 8, + 16, + 6, + 7, + 4, + 1, + 6, + 18, + 3, + 9, + 7, + 16, + 26, + 1, + 9, + 9, + 4, + 1, + 0, + 4, + 1, + 6, + 5, + 1, + 8, + 5, + 4, + 2, + 5, + 6 + ], + "weighted_loads": [ + 0.9985952600836754, + 0.18644320964813232, + 0.0, + 0.0, + 0.3878376856446266, + 0.13403310999274254, + 0.0, + 0.2324807345867157, + 0.5236812420189381, + 0.19904226064682007, + 1.2606380097568035, + 0.09691542014479637, + 0.053888285998255014, + 0.5809551149141043, + 0.18576129525899887, + 0.14197765290737152, + 0.24952328950166702, + 0.3062947914004326, + 0.0, + 1.2467065565288067, + 0.0969272330403328, + 0.20218459703028202, + 2.1389961559325457, + 0.7992659471929073, + 0.39310353621840477, + 0.6158573441207409, + 0.25511933118104935, + 0.39030744042247534, + 0.4896833784878254, + 0.03582954779267311, + 0.1399914063513279, + 0.2037585584912449, + 0.5029577231034636, + 0.4514589495956898, + 0.40960948914289474, + 1.0524659752845764, + 0.4602305591106415, + 0.4229026772081852, + 0.19689489528536797, + 0.06727427244186401, + 0.40114112198352814, + 1.7486959174275398, + 0.13973387703299522, + 0.7200751826167107, + 0.2714281203225255, + 1.3748054578900337, + 2.063833236694336, + 0.055899448692798615, + 0.5849760957062244, + 0.729204174131155, + 0.33739151433110237, + 0.03255666419863701, + 0.0, + 0.24441302940249443, + 0.040865931659936905, + 0.37045983597636223, + 0.23300982639193535, + 0.03306024521589279, + 0.533172857016325, + 0.23442448675632477, + 0.23974360898137093, + 0.08650047332048416, + 0.518641235306859, + 0.2809446770697832 + ], + "unique_experts": 59, + "load_cv": 0.8333333333333334, + "normalized_load_entropy": 0.9205688794058989, + "max_load_share": 0.06770833333333333 + } + }, + "s0_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "5735218577145c450b3faec886947d137083a546ef4938a5a2456652a29c936d", + "route_weight_sha256": "1cc2c354acff7b2c719977d6c61ff9f2fab3ff02c515d85e7a023397ad10501d", + "loads": [ + 7, + 1, + 0, + 1, + 1, + 2, + 0, + 3, + 1, + 2, + 2, + 0, + 0, + 8, + 2, + 3, + 3, + 4, + 0, + 0, + 1, + 1, + 8, + 1, + 4, + 4, + 0, + 5, + 1, + 0, + 0, + 1, + 4, + 2, + 1, + 3, + 6, + 4, + 0, + 0, + 0, + 3, + 1, + 9, + 2, + 2, + 4, + 1, + 3, + 4, + 1, + 0, + 0, + 1, + 0, + 2, + 0, + 1, + 3, + 1, + 5, + 1, + 4, + 4 + ], + "weighted_loads": [ + 0.39090315997600555, + 0.04605710878968239, + 0.0, + 0.05211051180958748, + 0.08099682629108429, + 0.07925517857074738, + 0.0, + 0.22653811797499657, + 0.10116641223430634, + 0.10946153104305267, + 0.18067146837711334, + 0.0, + 0.0, + 0.5268574953079224, + 0.14681605994701385, + 0.1801808848977089, + 0.2018088810145855, + 0.20861345529556274, + 0.0, + 0.0, + 0.05231912434101105, + 0.0273220743983984, + 0.5676810592412949, + 0.04423040896654129, + 0.2010042816400528, + 0.20535817369818687, + 0.0, + 0.37202633917331696, + 0.0589895136654377, + 0.0, + 0.0, + 0.05162692070007324, + 0.4309121146798134, + 0.25234728306531906, + 0.06256470084190369, + 0.22458411008119583, + 0.47161513566970825, + 0.2721421979367733, + 0.0, + 0.0, + 0.0, + 0.19555149599909782, + 0.05052680894732475, + 0.6971493400633335, + 0.08220339566469193, + 0.11395945772528648, + 0.2232157252728939, + 0.04653777927160263, + 0.2264682948589325, + 0.4142984077334404, + 0.07939150184392929, + 0.0, + 0.0, + 0.0940002053976059, + 0.0, + 0.10823587328195572, + 0.0, + 0.0316469632089138, + 0.25617117434740067, + 0.05027132108807564, + 0.27861034497618675, + 0.051145944744348526, + 0.38552287220954895, + 0.21443505957722664 + ], + "unique_experts": 48, + "load_cv": 1.0081582776486193, + "normalized_load_entropy": 0.8753409385261577, + "max_load_share": 0.06521739130434782 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "53bf038286720c318c5e3089401861926e9fdd9b5ec350c640f17ef3fed6c5ea", + "route_weight_sha256": "fc2ad190d57c588a3158e2c4b8767905cc6315f2ce2f435661f3d387993b391d", + "loads": [ + 14, + 1, + 0, + 1, + 4, + 2, + 0, + 3, + 3, + 2, + 13, + 0, + 2, + 12, + 2, + 3, + 4, + 10, + 0, + 12, + 1, + 1, + 12, + 3, + 7, + 5, + 0, + 6, + 1, + 0, + 1, + 6, + 4, + 2, + 10, + 10, + 6, + 4, + 1, + 1, + 0, + 13, + 1, + 9, + 6, + 11, + 16, + 1, + 5, + 4, + 8, + 1, + 0, + 4, + 0, + 7, + 5, + 1, + 5, + 5, + 5, + 1, + 6, + 5 + ], + "weighted_loads": [ + 0.8804494291543961, + 0.04605710878968239, + 0.0, + 0.05211051180958748, + 0.4488968104124069, + 0.07925517857074738, + 0.0, + 0.22653811797499657, + 0.19788428768515587, + 0.10946153104305267, + 1.3605872988700867, + 0.0, + 0.04498877748847008, + 0.6955242194235325, + 0.14681605994701385, + 0.1801808848977089, + 0.242726918309927, + 0.4346932601183653, + 0.0, + 1.1775819547474384, + 0.05231912434101105, + 0.0273220743983984, + 1.2418780401349068, + 0.26972855627536774, + 0.33043356239795685, + 0.2819310314953327, + 0.0, + 0.3849459504708648, + 0.0589895136654377, + 0.0, + 0.03952590748667717, + 0.2386224465444684, + 0.4309121146798134, + 0.25234728306531906, + 0.558397913351655, + 0.6548253409564495, + 0.47161513566970825, + 0.2721421979367733, + 0.04382992163300514, + 0.04468784108757973, + 0.0, + 1.2324002981185913, + 0.05052680894732475, + 0.6971493400633335, + 0.372684882953763, + 1.0174538902938366, + 1.2174449265003204, + 0.04653777927160263, + 0.3425169512629509, + 0.4142984077334404, + 0.4834769368171692, + 0.033672723919153214, + 0.0, + 0.22393523529171944, + 0.0, + 0.4570218101143837, + 0.24088618531823158, + 0.0316469632089138, + 0.3728470951318741, + 0.2252955362200737, + 0.27861034497618675, + 0.051145944744348526, + 0.44122071005403996, + 0.250655896961689 + ], + "unique_experts": 55, + "load_cv": 0.9254628471643157, + "normalized_load_entropy": 0.8940888633589034, + "max_load_share": 0.05555555555555555 + } + }, + "s1_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "c1d34df9390edf60619145afd284f708495a1856828f15e74c09707ba4cbbf25", + "route_weight_sha256": "7cd88688e68b075998c09dbef320ee1566d4873cd25fe632bd986df7946300ba", + "loads": [ + 6, + 2, + 0, + 0, + 1, + 2, + 0, + 3, + 1, + 2, + 2, + 0, + 0, + 8, + 2, + 3, + 3, + 4, + 0, + 0, + 1, + 1, + 8, + 1, + 4, + 5, + 0, + 5, + 1, + 0, + 0, + 1, + 4, + 2, + 1, + 3, + 6, + 4, + 0, + 0, + 0, + 3, + 1, + 9, + 1, + 2, + 4, + 1, + 3, + 4, + 2, + 0, + 0, + 1, + 0, + 2, + 0, + 1, + 3, + 1, + 4, + 1, + 4, + 5 + ], + "weighted_loads": [ + 0.34329671412706375, + 0.0969257652759552, + 0.0, + 0.0, + 0.08017974346876144, + 0.07536963745951653, + 0.0, + 0.22884422913193703, + 0.10540850460529327, + 0.11117582395672798, + 0.1833861619234085, + 0.0, + 0.0, + 0.5256299786269665, + 0.1459478661417961, + 0.1763937585055828, + 0.20813318714499474, + 0.21180928871035576, + 0.0, + 0.0, + 0.05261262133717537, + 0.025418445467948914, + 0.56233942322433, + 0.0418105311691761, + 0.20272191241383553, + 0.23375363275408745, + 0.0, + 0.3785286247730255, + 0.06129913032054901, + 0.0, + 0.0, + 0.05461057648062706, + 0.4485061578452587, + 0.25321805477142334, + 0.06745490431785583, + 0.22478240728378296, + 0.4742887057363987, + 0.27484192699193954, + 0.0, + 0.0, + 0.0, + 0.19878101721405983, + 0.05010049417614937, + 0.7009589076042175, + 0.049481991678476334, + 0.1111985631287098, + 0.21653839945793152, + 0.052040260285139084, + 0.22430060058832169, + 0.41126422211527824, + 0.11658434011042118, + 0.0, + 0.0, + 0.09298495203256607, + 0.0, + 0.11112659424543381, + 0.0, + 0.031016547232866287, + 0.25018077343702316, + 0.05032739043235779, + 0.24082715809345245, + 0.05194510519504547, + 0.37799712270498276, + 0.24650892242789268 + ], + "unique_experts": 47, + "load_cv": 1.0048193050239391, + "normalized_load_entropy": 0.8735680749701666, + "max_load_share": 0.06521739130434782 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "367c94dd21e98069203f9b4f6e625ed11781fa57e380ab31e5832f8ec530e9ad", + "route_weight_sha256": "11d98c6de78d9644cf44f9d9be836e8853d8c7aafade06469b7e3ecf85f57c1c", + "loads": [ + 17, + 4, + 0, + 0, + 4, + 2, + 0, + 3, + 8, + 4, + 13, + 2, + 2, + 12, + 3, + 3, + 4, + 9, + 0, + 12, + 1, + 4, + 12, + 11, + 9, + 13, + 4, + 6, + 7, + 0, + 2, + 5, + 4, + 5, + 8, + 15, + 6, + 7, + 3, + 2, + 6, + 18, + 3, + 9, + 5, + 16, + 25, + 1, + 9, + 9, + 7, + 1, + 0, + 5, + 1, + 6, + 5, + 1, + 8, + 5, + 4, + 2, + 6, + 6 + ], + "weighted_loads": [ + 1.0974000841379166, + 0.1856353059411049, + 0.0, + 0.0, + 0.46073732525110245, + 0.07536963745951653, + 0.0, + 0.22884422913193703, + 0.5248527713119984, + 0.20254749059677124, + 1.2673584781587124, + 0.09691542014479637, + 0.046957677230238914, + 0.6719821915030479, + 0.185190349817276, + 0.1763937585055828, + 0.2539387084543705, + 0.4361158534884453, + 0.0, + 1.2645444981753826, + 0.05261262133717537, + 0.15175244957208633, + 1.2464071493595839, + 0.8186745680868626, + 0.39361999928951263, + 0.6675168797373772, + 0.25511933118104935, + 0.39144823607057333, + 0.4859720803797245, + 0.0, + 0.1399914063513279, + 0.20069895405322313, + 0.4485061578452587, + 0.4764469377696514, + 0.4067402631044388, + 0.9831981882452965, + 0.4742887057363987, + 0.41786446422338486, + 0.15052666887640953, + 0.11460905149579048, + 0.40114112198352814, + 1.7632584609091282, + 0.1419847011566162, + 0.7009589076042175, + 0.22356353886425495, + 1.4624962247908115, + 2.0530080795288086, + 0.052040260285139084, + 0.5824079029262066, + 0.7402553148567677, + 0.4366725217550993, + 0.03255666419863701, + 0.0, + 0.2821028381586075, + 0.040865931659936905, + 0.4019986614584923, + 0.23300982639193535, + 0.031016547232866287, + 0.5350926034152508, + 0.23050154373049736, + 0.24082715809345245, + 0.09050589799880981, + 0.5412760023027658, + 0.2826022617518902 + ], + "unique_experts": 58, + "load_cv": 0.8380077233799486, + "normalized_load_entropy": 0.9175193051028893, + "max_load_share": 0.06510416666666667 + } + }, + "s0_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "95c64262c00a719e780eb6070efec1dd218cbbb638e2d18a918716ce16d0b730", + "route_weight_sha256": "a0934ce534964f97a5d6957bd24354f43c137cdf9af04712919daf2db14ef175", + "loads": [ + 6, + 2, + 0, + 0, + 1, + 2, + 0, + 3, + 1, + 2, + 2, + 0, + 1, + 7, + 2, + 2, + 3, + 4, + 0, + 0, + 2, + 1, + 8, + 1, + 4, + 6, + 0, + 5, + 1, + 0, + 0, + 2, + 3, + 2, + 1, + 3, + 6, + 4, + 0, + 0, + 0, + 3, + 1, + 9, + 1, + 2, + 5, + 1, + 3, + 5, + 2, + 0, + 0, + 1, + 0, + 2, + 0, + 1, + 3, + 1, + 4, + 1, + 3, + 3 + ], + "weighted_loads": [ + 0.4118337631225586, + 0.10265340283513069, + 0.0, + 0.0, + 0.0799596905708313, + 0.07931786775588989, + 0.0, + 0.22300243750214577, + 0.09550675004720688, + 0.10458118841052055, + 0.1771964654326439, + 0.0, + 0.05425368621945381, + 0.480021208524704, + 0.13277630135416985, + 0.12618351727724075, + 0.18959008157253265, + 0.21114589646458626, + 0.0, + 0.0, + 0.09742653369903564, + 0.027889186516404152, + 0.5553251057863235, + 0.04189595952630043, + 0.20450012758374214, + 0.3212471567094326, + 0.0, + 0.40097520500421524, + 0.06756523251533508, + 0.0, + 0.0, + 0.09066420421004295, + 0.38138579577207565, + 0.2557756379246712, + 0.06320790201425552, + 0.22272389382123947, + 0.4589800499379635, + 0.26680368930101395, + 0.0, + 0.0, + 0.0, + 0.20173455029726028, + 0.04728936031460762, + 0.665094293653965, + 0.05298417806625366, + 0.10467503219842911, + 0.27093522995710373, + 0.04819019138813019, + 0.23690122365951538, + 0.4287460148334503, + 0.10608547367155552, + 0.0, + 0.0, + 0.09999878704547882, + 0.0, + 0.10478873178362846, + 0.0, + 0.03291168808937073, + 0.25537721812725067, + 0.05254106968641281, + 0.2523685470223427, + 0.05420847237110138, + 0.3464439660310745, + 0.1411616150289774 + ], + "unique_experts": 48, + "load_cv": 0.9811283791891484, + "normalized_load_entropy": 0.8800040236862813, + "max_load_share": 0.06521739130434782 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "f2a2a9934226775d7dbbef148f344b85e76a3bee5a849d4b9f11dd60d1c74d61", + "route_weight_sha256": "a3a551d0c17ac6df4a389fdc03832614a3e4351916072e9d656ec40cf63e5cb7", + "loads": [ + 14, + 2, + 0, + 0, + 3, + 2, + 0, + 3, + 3, + 2, + 14, + 0, + 3, + 11, + 2, + 2, + 5, + 7, + 0, + 11, + 2, + 1, + 12, + 3, + 7, + 9, + 0, + 6, + 1, + 0, + 1, + 7, + 3, + 2, + 11, + 9, + 6, + 4, + 4, + 0, + 0, + 13, + 1, + 9, + 5, + 10, + 17, + 1, + 6, + 5, + 7, + 1, + 0, + 2, + 0, + 7, + 5, + 1, + 5, + 7, + 4, + 1, + 5, + 4 + ], + "weighted_loads": [ + 1.019119817763567, + 0.10265340283513069, + 0.0, + 0.0, + 0.38294634222984314, + 0.07931786775588989, + 0.0, + 0.22300243750214577, + 0.1922246254980564, + 0.10458118841052055, + 1.5074476972222328, + 0.0, + 0.09924246370792389, + 0.6230196356773376, + 0.13277630135416985, + 0.12618351727724075, + 0.267346628010273, + 0.3269756194204092, + 0.0, + 1.114042278379202, + 0.09742653369903564, + 0.027889186516404152, + 1.2341661676764488, + 0.22340749576687813, + 0.3339294083416462, + 0.469818614423275, + 0.0, + 0.41389481630176306, + 0.06756523251533508, + 0.0, + 0.03952590748667717, + 0.2776597300544381, + 0.38138579577207565, + 0.2557756379246712, + 0.6540844161063433, + 0.6344719305634499, + 0.4589800499379635, + 0.26680368930101395, + 0.1692741960287094, + 0.0, + 0.0, + 1.2165843732655048, + 0.04728936031460762, + 0.665094293653965, + 0.34449527226388454, + 0.725754626095295, + 1.2267720699310303, + 0.04819019138813019, + 0.4025339037179947, + 0.4287460148334503, + 0.41717064566910267, + 0.033672723919153214, + 0.0, + 0.14494429901242256, + 0.0, + 0.4557166211307049, + 0.24088618531823158, + 0.03291168808937073, + 0.35797880962491035, + 0.30474256351590157, + 0.2523685470223427, + 0.05420847237110138, + 0.40214180387556553, + 0.17738245241343975 + ], + "unique_experts": 53, + "load_cv": 0.927128848237702, + "normalized_load_entropy": 0.892434276012836, + "max_load_share": 0.059027777777777776 + } + }, + "s1_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "cffa5e6e00066fa2618041602314610d69ee308760e4f4424071b8720c96800c", + "route_weight_sha256": "098e87564ed7606379865887b85a906d078bccc73b0c9b9139a49ddb4d4069eb", + "loads": [ + 7, + 2, + 0, + 0, + 1, + 2, + 0, + 3, + 1, + 2, + 2, + 0, + 0, + 7, + 2, + 2, + 3, + 4, + 0, + 0, + 2, + 1, + 8, + 1, + 4, + 7, + 0, + 5, + 1, + 0, + 0, + 2, + 3, + 2, + 1, + 3, + 6, + 4, + 0, + 0, + 0, + 3, + 1, + 8, + 1, + 2, + 5, + 1, + 3, + 4, + 2, + 0, + 0, + 1, + 0, + 2, + 0, + 1, + 3, + 1, + 4, + 1, + 3, + 4 + ], + "weighted_loads": [ + 0.4535592459142208, + 0.10225098207592964, + 0.0, + 0.0, + 0.07445172220468521, + 0.08034608885645866, + 0.0, + 0.22819781675934792, + 0.09837738424539566, + 0.1089463010430336, + 0.17595697939395905, + 0.0, + 0.0, + 0.48329704254865646, + 0.1383361965417862, + 0.12608110904693604, + 0.1988002136349678, + 0.20555980876088142, + 0.0, + 0.0, + 0.09291616454720497, + 0.02678588405251503, + 0.5482198428362608, + 0.04070236533880234, + 0.20633793622255325, + 0.37857960164546967, + 0.0, + 0.4086109958589077, + 0.06693845242261887, + 0.0, + 0.0, + 0.09890606254339218, + 0.3782544210553169, + 0.25249744206666946, + 0.06923173367977142, + 0.22086399793624878, + 0.4655659794807434, + 0.25730664283037186, + 0.0, + 0.0, + 0.0, + 0.1937081590294838, + 0.05079861357808113, + 0.6210036277770996, + 0.05172065645456314, + 0.10101881623268127, + 0.280314389616251, + 0.05939684808254242, + 0.22828415781259537, + 0.3540879338979721, + 0.11411650851368904, + 0.0, + 0.0, + 0.09075219929218292, + 0.0, + 0.11161432042717934, + 0.0, + 0.03261905536055565, + 0.25218284130096436, + 0.049650438129901886, + 0.24113008752465248, + 0.055368728935718536, + 0.3557550981640816, + 0.18968544900417328 + ], + "unique_experts": 47, + "load_cv": 0.9913509608500108, + "normalized_load_entropy": 0.8759103450503254, + "max_load_share": 0.057971014492753624 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "ff827d594437f22f5bcc00fc014163e4c2ff92254df0594d6bb51b313274bd53", + "route_weight_sha256": "fe2205ea2ec734fc806176e78ed98750c5df27c3ec99daec8f6281d0f2936663", + "loads": [ + 20, + 4, + 0, + 0, + 3, + 2, + 0, + 3, + 9, + 4, + 14, + 2, + 2, + 10, + 3, + 2, + 5, + 7, + 0, + 12, + 2, + 4, + 12, + 11, + 9, + 17, + 5, + 6, + 7, + 0, + 2, + 6, + 3, + 5, + 9, + 15, + 6, + 7, + 5, + 2, + 6, + 18, + 3, + 8, + 5, + 13, + 25, + 1, + 9, + 9, + 5, + 1, + 0, + 3, + 1, + 6, + 5, + 1, + 8, + 6, + 4, + 2, + 5, + 5 + ], + "weighted_loads": [ + 1.3469352796673775, + 0.19096052274107933, + 0.0, + 0.0, + 0.3893279507756233, + 0.08034608885645866, + 0.0, + 0.22819781675934792, + 0.5603852160274982, + 0.20031796768307686, + 1.4206775836646557, + 0.09691542014479637, + 0.046957677230238914, + 0.5742043256759644, + 0.17757868021726608, + 0.12608110904693604, + 0.2850496545433998, + 0.3567451946437359, + 0.0, + 1.1648121774196625, + 0.09291616454720497, + 0.15311988815665245, + 1.2357455398887396, + 0.8263492658734322, + 0.39723602309823036, + 0.8917770981788635, + 0.3022793233394623, + 0.4215306071564555, + 0.49161140248179436, + 0.0, + 0.1399914063513279, + 0.24499444011598825, + 0.3782544210553169, + 0.47572632506489754, + 0.468564972281456, + 0.9761074036359787, + 0.4655659794807434, + 0.40032918006181717, + 0.2569485455751419, + 0.11053511500358582, + 0.40114112198352814, + 1.60767412930727, + 0.14268282055854797, + 0.6210036277770996, + 0.22065856494009495, + 1.0070275142788887, + 2.0219829827547073, + 0.05939684808254242, + 0.5845489390194416, + 0.6830790266394615, + 0.33156897500157356, + 0.03255666419863701, + 0.0, + 0.19164592772722244, + 0.040865931659936905, + 0.3962387330830097, + 0.23300982639193535, + 0.03261905536055565, + 0.5217511355876923, + 0.2817694768309593, + 0.24113008752465248, + 0.09392952173948288, + 0.5190339777618647, + 0.22577878832817078 + ], + "unique_experts": 58, + "load_cv": 0.8609990966571593, + "normalized_load_entropy": 0.9151671547832656, + "max_load_share": 0.06510416666666667 + } + }, + "s0_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "b3870ed92e65a2933c34a36d63ad189841752e7f38ddb03e9cf62f6dda707255", + "route_weight_sha256": "165b935594599a5c47560085b4cfb5381be38e7b873583f599481b5ed36578ca", + "loads": [ + 6, + 2, + 0, + 0, + 1, + 2, + 0, + 3, + 1, + 2, + 2, + 0, + 1, + 7, + 2, + 2, + 3, + 4, + 0, + 0, + 2, + 1, + 8, + 1, + 4, + 5, + 0, + 5, + 1, + 0, + 0, + 2, + 4, + 2, + 1, + 3, + 6, + 4, + 0, + 0, + 0, + 3, + 1, + 9, + 1, + 2, + 5, + 1, + 3, + 5, + 2, + 0, + 0, + 1, + 0, + 2, + 0, + 1, + 3, + 1, + 4, + 1, + 3, + 3 + ], + "weighted_loads": [ + 0.43322279304265976, + 0.10372577235102654, + 0.0, + 0.0, + 0.08068415522575378, + 0.07832710444927216, + 0.0, + 0.22291027382016182, + 0.10070107877254486, + 0.10886012390255928, + 0.17613974958658218, + 0.0, + 0.05402369424700737, + 0.4735802337527275, + 0.1336917020380497, + 0.12833156436681747, + 0.1909189149737358, + 0.20245376601815224, + 0.0, + 0.0, + 0.09657739475369453, + 0.02727198787033558, + 0.5523210652172565, + 0.040200747549533844, + 0.2066780924797058, + 0.2771104723215103, + 0.0, + 0.3905896805226803, + 0.06450790166854858, + 0.0, + 0.0, + 0.09513828530907631, + 0.4198145866394043, + 0.2557739391922951, + 0.06814175099134445, + 0.22364487498998642, + 0.455110389739275, + 0.26672743633389473, + 0.0, + 0.0, + 0.0, + 0.20625365898013115, + 0.05009173974394798, + 0.6596818752586842, + 0.05183090269565582, + 0.10466808825731277, + 0.27000392228364944, + 0.04614461585879326, + 0.23652227967977524, + 0.43601546064019203, + 0.10479756444692612, + 0.0, + 0.0, + 0.09859748184680939, + 0.0, + 0.10951759666204453, + 0.0, + 0.03217971697449684, + 0.2512081190943718, + 0.05382093787193298, + 0.25358106195926666, + 0.054948825389146805, + 0.3407653868198395, + 0.13780548050999641 + ], + "unique_experts": 48, + "load_cv": 0.9742537361309165, + "normalized_load_entropy": 0.880795113096974, + "max_load_share": 0.06521739130434782 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "ce46622a1a2c806446a3d676b1dc0b6b5010e3f1f644b7f1d67ee6a96acd27ba", + "route_weight_sha256": "d36bf7f10c35b8d0b0570419207bad4ede4fbf4d8d0e29a317980a740e6b47e8", + "loads": [ + 15, + 2, + 0, + 0, + 3, + 2, + 0, + 3, + 3, + 2, + 14, + 0, + 3, + 10, + 2, + 2, + 4, + 8, + 0, + 11, + 2, + 1, + 12, + 3, + 7, + 6, + 0, + 6, + 1, + 0, + 1, + 7, + 4, + 2, + 11, + 10, + 6, + 4, + 3, + 0, + 0, + 14, + 1, + 9, + 5, + 10, + 18, + 1, + 5, + 5, + 7, + 1, + 0, + 3, + 0, + 7, + 6, + 1, + 5, + 6, + 4, + 1, + 5, + 4 + ], + "weighted_loads": [ + 1.047753855586052, + 0.10372577235102654, + 0.0, + 0.0, + 0.3808322697877884, + 0.07832710444927216, + 0.0, + 0.22291027382016182, + 0.1974189542233944, + 0.10886012390255928, + 1.4509771019220352, + 0.0, + 0.09901247173547745, + 0.5798990465700626, + 0.1336917020380497, + 0.12833156436681747, + 0.2318369522690773, + 0.3697416242212057, + 0.0, + 1.1313683800399303, + 0.09657739475369453, + 0.02727198787033558, + 1.2349911965429783, + 0.22356496006250381, + 0.33610737323760986, + 0.35368333011865616, + 0.0, + 0.4035092918202281, + 0.06450790166854858, + 0.0, + 0.03952590748667717, + 0.28213381115347147, + 0.4198145866394043, + 0.2557739391922951, + 0.6207702700048685, + 0.663810521364212, + 0.455110389739275, + 0.26672743633389473, + 0.13352736085653305, + 0.0, + 0.0, + 1.2718398571014404, + 0.05009173974394798, + 0.6596818752586842, + 0.342428395524621, + 0.758907325565815, + 1.3430989868938923, + 0.04614461585879326, + 0.35308998078107834, + 0.43601546064019203, + 0.412092424929142, + 0.033672723919153214, + 0.0, + 0.17777694016695023, + 0.0, + 0.47618158906698227, + 0.27872712910175323, + 0.03217971697449684, + 0.35255999490618706, + 0.2694109007716179, + 0.25358106195926666, + 0.054948825389146805, + 0.3964632246643305, + 0.17402631789445877 + ], + "unique_experts": 53, + "load_cv": 0.9444444444444444, + "normalized_load_entropy": 0.8911279007134443, + "max_load_share": 0.0625 + } + }, + "s1_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "bfb39cf5bdecbbaf16cad605b4ed64c48c1e06356e12d225957b0231498d0cdf", + "route_weight_sha256": "cd8a55e72b535120f6dd27c23f1358fe65127143d9908bbb9ce3ffec583ecdf4", + "loads": [ + 7, + 2, + 0, + 0, + 1, + 2, + 0, + 3, + 1, + 2, + 2, + 0, + 0, + 7, + 2, + 2, + 3, + 4, + 0, + 0, + 2, + 1, + 7, + 1, + 4, + 6, + 0, + 5, + 1, + 0, + 0, + 1, + 4, + 2, + 1, + 3, + 6, + 4, + 0, + 0, + 0, + 3, + 1, + 8, + 1, + 2, + 5, + 1, + 3, + 4, + 2, + 1, + 0, + 1, + 0, + 2, + 0, + 1, + 3, + 1, + 4, + 1, + 3, + 5 + ], + "weighted_loads": [ + 0.46611231565475464, + 0.10268279910087585, + 0.0, + 0.0, + 0.07449997961521149, + 0.07908151298761368, + 0.0, + 0.2267521657049656, + 0.10038773715496063, + 0.11449473723769188, + 0.17168520390987396, + 0.0, + 0.0, + 0.48020007088780403, + 0.138427272439003, + 0.1274450235068798, + 0.19035355746746063, + 0.19683274254202843, + 0.0, + 0.0, + 0.09541698172688484, + 0.027046898379921913, + 0.507824370637536, + 0.03908079117536545, + 0.20660848170518875, + 0.323249276727438, + 0.0, + 0.40115490928292274, + 0.06668080389499664, + 0.0, + 0.0, + 0.05040793493390083, + 0.4157245233654976, + 0.25265495479106903, + 0.06686699390411377, + 0.22851907461881638, + 0.4562442936003208, + 0.27253078296780586, + 0.0, + 0.0, + 0.0, + 0.19576221704483032, + 0.049259722232818604, + 0.6085560098290443, + 0.05196459963917732, + 0.09890903159976006, + 0.2634412422776222, + 0.056210730224847794, + 0.22987599670886993, + 0.3732144683599472, + 0.10735606960952282, + 0.04198653623461723, + 0.0, + 0.09129796177148819, + 0.0, + 0.11363208293914795, + 0.0, + 0.03060113452374935, + 0.2487398162484169, + 0.05271008238196373, + 0.24572599679231644, + 0.05538121610879898, + 0.35817965865135193, + 0.23998541943728924 + ], + "unique_experts": 48, + "load_cv": 0.9673302374472603, + "normalized_load_entropy": 0.8803010117452527, + "max_load_share": 0.057971014492753624 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "bc89368d294f381e03f6983c98af7e79a5d7585de98feeb564580b79aa378dd7", + "route_weight_sha256": "22eb20f28356eba48ca281e23dacc36b275e1e0ea0bed6b23f5227b9bcb6d0ab", + "loads": [ + 19, + 4, + 0, + 0, + 3, + 2, + 0, + 3, + 8, + 4, + 14, + 2, + 2, + 11, + 3, + 2, + 4, + 8, + 0, + 11, + 2, + 4, + 11, + 11, + 9, + 16, + 4, + 6, + 7, + 0, + 2, + 5, + 4, + 5, + 8, + 16, + 6, + 7, + 5, + 1, + 6, + 19, + 3, + 8, + 5, + 13, + 27, + 1, + 9, + 9, + 5, + 2, + 0, + 4, + 1, + 6, + 6, + 1, + 8, + 5, + 4, + 2, + 5, + 6 + ], + "weighted_loads": [ + 1.2548858411610126, + 0.19139233976602554, + 0.0, + 0.0, + 0.3841264545917511, + 0.07908151298761368, + 0.0, + 0.2267521657049656, + 0.5198320038616657, + 0.20586640387773514, + 1.3250606842339039, + 0.09691542014479637, + 0.046957677230238914, + 0.6022635698318481, + 0.17766975611448288, + 0.1274450235068798, + 0.2361590787768364, + 0.3927859365940094, + 0.0, + 1.1574556455016136, + 0.09541698172688484, + 0.15338090248405933, + 1.196654574945569, + 0.807894840836525, + 0.39750656858086586, + 0.8347261734306812, + 0.25511933118104935, + 0.41407452058047056, + 0.49135375395417213, + 0.0, + 0.1399914063513279, + 0.1964963125064969, + 0.4157245233654976, + 0.4758838377892971, + 0.4061523526906967, + 1.0247367359697819, + 0.4562442936003208, + 0.4155533201992512, + 0.2688138373196125, + 0.06727427244186401, + 0.40114112198352814, + 1.7169844396412373, + 0.14114392921328545, + 0.6085560098290443, + 0.21634707786142826, + 0.9915148839354515, + 2.24046428874135, + 0.056210730224847794, + 0.5862547643482685, + 0.7022055611014366, + 0.3158742170780897, + 0.07454320043325424, + 0.0, + 0.24161388725042343, + 0.040865931659936905, + 0.4001345634460449, + 0.2743874378502369, + 0.03060113452374935, + 0.5207861363887787, + 0.2328842356801033, + 0.24572599679231644, + 0.09394200891256332, + 0.521458538249135, + 0.27607875876128674 + ], + "unique_experts": 58, + "load_cv": 0.8740073734751262, + "normalized_load_entropy": 0.9144800731074438, + "max_load_share": 0.0703125 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 18, + "mean_set_jaccard": 0.9378881987577639, + "mean_token_weighted_tv": 0.013571295968216398, + "aggregate_load_tv": 0.03623188405797102 + }, + "system_bos": { + "tokens": 23, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.9254658385093167, + "mean_token_weighted_tv": 0.016047229868886265, + "aggregate_load_tv": 0.028985507246376815 + }, + "system_x": { + "tokens": 23, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 20, + "mean_set_jaccard": 0.9627329192546585, + "mean_token_weighted_tv": 0.015079722861232965, + "aggregate_load_tv": 0.021739130434782615 + }, + "system_period": { + "tokens": 23, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 18, + "mean_set_jaccard": 0.9378881987577639, + "mean_token_weighted_tv": 0.01938959405474041, + "aggregate_load_tv": 0.036231884057971016 + }, + "bos_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.9254658385093167, + "mean_token_weighted_tv": 0.02025680972830109, + "aggregate_load_tv": 0.036231884057971016 + }, + "bos_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.9130434782608695, + "mean_token_weighted_tv": 0.02015946858117114, + "aggregate_load_tv": 0.04347826086956522 + }, + "x_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.9503105590062113, + "mean_token_weighted_tv": 0.022156683485145153, + "aggregate_load_tv": 0.028985507246376815 + }, + "x_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.9130434782608695, + "mean_token_weighted_tv": 0.027280211934576862, + "aggregate_load_tv": 0.050724637681159424 + }, + "period_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 20, + "mean_set_jaccard": 0.9627329192546585, + "mean_token_weighted_tv": 0.02097641992504182, + "aggregate_load_tv": 0.021739130434782615 + }, + "period_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.9254658385093167, + "mean_token_weighted_tv": 0.025525160538761513, + "aggregate_load_tv": 0.043478260869565216 + } + } + }, + "layer_10": { + "layer": 10, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "e6b037510e87a1916828d62258ddde637f5b13f3671a60b071ca277173354bb8", + "route_weight_sha256": "c1310f453d1f97acf9fe873cb5736009c0e3e3cf3ecd2d29e8c61233448777c3", + "loads": [ + 1, + 0, + 2, + 2, + 4, + 5, + 0, + 11, + 3, + 2, + 1, + 0, + 1, + 2, + 0, + 2, + 3, + 0, + 1, + 6, + 1, + 0, + 8, + 0, + 4, + 3, + 1, + 1, + 0, + 3, + 1, + 4, + 4, + 23, + 2, + 1, + 0, + 0, + 3, + 1, + 0, + 3, + 3, + 0, + 0, + 0, + 0, + 0, + 0, + 2, + 0, + 1, + 1, + 3, + 1, + 3, + 4, + 2, + 3, + 2, + 3, + 0, + 1, + 0 + ], + "weighted_loads": [ + 0.052958790212869644, + 0.0, + 0.13800081983208656, + 0.12449145689606667, + 0.2749965786933899, + 0.2949291840195656, + 0.0, + 0.8639280032366514, + 0.16958880424499512, + 0.09250196814537048, + 0.05531354993581772, + 0.0, + 0.13521219789981842, + 0.16814759373664856, + 0.0, + 0.08482503518462181, + 0.22127941250801086, + 0.0, + 0.15505169332027435, + 0.30516768246889114, + 0.04510237276554108, + 0.0, + 0.9496222026646137, + 0.0, + 0.2066817209124565, + 0.20758850872516632, + 0.03824339807033539, + 0.03792060539126396, + 0.0, + 0.18231366574764252, + 0.058640021830797195, + 0.3033868372440338, + 0.20910341292619705, + 3.1795159429311752, + 0.11890286765992641, + 0.04973806068301201, + 0.0, + 0.0, + 0.18951822817325592, + 0.06190376728773117, + 0.0, + 0.1669658161699772, + 0.33906906098127365, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.10148272663354874, + 0.0, + 0.03544890508055687, + 0.06714745610952377, + 0.16661684215068817, + 0.10484539717435837, + 0.3141184002161026, + 0.2149089276790619, + 0.15455644205212593, + 0.135260459035635, + 0.07424227893352509, + 0.20502010732889175, + 0.0, + 0.041266292333602905, + 0.0 + ], + "unique_experts": 44, + "load_cv": 1.5408053333904081, + "normalized_load_entropy": 0.8181854157469854, + "max_load_share": 0.16666666666666666 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "226684a4c17ef24449d82c272e9ff019e075e32056aba0c29468abb12c5b7cbd", + "route_weight_sha256": "20b0918de17e819eef25b5c33b65890a9563d6daf6fadaf22af43f9135d586ee", + "loads": [ + 1, + 0, + 4, + 2, + 4, + 5, + 0, + 15, + 3, + 4, + 3, + 1, + 2, + 5, + 2, + 2, + 3, + 2, + 8, + 7, + 5, + 2, + 9, + 0, + 4, + 5, + 1, + 10, + 1, + 4, + 3, + 5, + 4, + 32, + 3, + 2, + 0, + 0, + 3, + 1, + 0, + 13, + 8, + 2, + 4, + 2, + 6, + 3, + 0, + 4, + 2, + 8, + 1, + 4, + 1, + 12, + 4, + 9, + 3, + 14, + 8, + 12, + 1, + 0 + ], + "weighted_loads": [ + 0.052958790212869644, + 0.0, + 0.15696877473965287, + 0.12449145689606667, + 0.2749965786933899, + 0.2949291840195656, + 0.0, + 1.0386195722967386, + 0.16958880424499512, + 0.11699235811829567, + 0.15269796550273895, + 0.04508715495467186, + 0.16794485598802567, + 1.5844182781875134, + 0.14959192648530006, + 0.08482503518462181, + 0.22127941250801086, + 0.11908509582281113, + 0.5370084545575082, + 0.37031369656324387, + 0.21273257955908775, + 0.0848299153149128, + 0.9533524983562529, + 0.0, + 0.2066817209124565, + 0.27135802432894707, + 0.03824339807033539, + 1.0006795711815357, + 0.04606078192591667, + 0.2241005264222622, + 0.2562568821012974, + 0.3171287765726447, + 0.20910341292619705, + 3.594963636249304, + 0.1487781275063753, + 0.08677415549755096, + 0.0, + 0.0, + 0.18951822817325592, + 0.06190376728773117, + 0.0, + 1.5289221853017807, + 0.4912093747407198, + 0.0964493677020073, + 0.2009788639843464, + 0.10616698488593102, + 0.2691478170454502, + 0.11158508621156216, + 0.0, + 0.19286125525832176, + 0.09166012704372406, + 0.3832945041358471, + 0.06714745610952377, + 0.24460549652576447, + 0.10484539717435837, + 1.1544631123542786, + 0.2149089276790619, + 0.5446541532874107, + 0.135260459035635, + 0.8481943048536777, + 0.5366833619773388, + 1.0406240709125996, + 0.041266292333602905, + 0.0 + ], + "unique_experts": 56, + "load_cv": 1.115961634811148, + "normalized_load_entropy": 0.8850467380765351, + "max_load_share": 0.1111111111111111 + } + }, + "s1_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "fda95c8f9f67de76f814a28a28ca628d04fada047bc8edb2460274120ab71e31", + "route_weight_sha256": "2ede06c74916b534609a3a5c42d16aa67086ab49e0680b197e7bb00a9151574b", + "loads": [ + 1, + 0, + 3, + 2, + 4, + 5, + 0, + 12, + 3, + 2, + 1, + 0, + 1, + 2, + 0, + 2, + 3, + 0, + 1, + 5, + 0, + 0, + 8, + 0, + 4, + 4, + 0, + 1, + 0, + 3, + 1, + 4, + 3, + 23, + 2, + 1, + 0, + 0, + 3, + 1, + 0, + 4, + 3, + 0, + 0, + 0, + 0, + 0, + 0, + 2, + 0, + 1, + 1, + 3, + 1, + 3, + 3, + 2, + 3, + 3, + 3, + 0, + 1, + 0 + ], + "weighted_loads": [ + 0.05066155269742012, + 0.0, + 0.18283066898584366, + 0.1260751374065876, + 0.2612300142645836, + 0.2887064591050148, + 0.0, + 0.9259306192398071, + 0.17135580629110336, + 0.09244528785347939, + 0.05276254937052727, + 0.0, + 0.13410940766334534, + 0.16657141596078873, + 0.0, + 0.08521376177668571, + 0.22638219967484474, + 0.0, + 0.16014569997787476, + 0.26506301015615463, + 0.0, + 0.0, + 0.9355962872505188, + 0.0, + 0.20695167779922485, + 0.24178225919604301, + 0.0, + 0.039553262293338776, + 0.0, + 0.18429971113801003, + 0.05997326225042343, + 0.304153211414814, + 0.16853520646691322, + 3.2088787481188774, + 0.11336957290768623, + 0.04929690062999725, + 0.0, + 0.0, + 0.19089245051145554, + 0.058710772544145584, + 0.0, + 0.21180376783013344, + 0.3312121629714966, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.09961414337158203, + 0.0, + 0.037804558873176575, + 0.06476704776287079, + 0.16705508157610893, + 0.10686444491147995, + 0.31410086899995804, + 0.16833053529262543, + 0.14859825000166893, + 0.13516121357679367, + 0.10968951135873795, + 0.20468103885650635, + 0.0, + 0.04486560821533203, + 0.0 + ], + "unique_experts": 42, + "load_cv": 1.5624640302518031, + "normalized_load_entropy": 0.8102440598555839, + "max_load_share": 0.16666666666666666 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "5dfd5e259dc80077f381bfc940a921b5e569aa86dd1f7bc129735cc2a7e6f69a", + "route_weight_sha256": "ec371f9049394fda4b816459fd50a5568cebfb74c9070fb06bbb353349bf4035", + "loads": [ + 1, + 0, + 5, + 2, + 8, + 5, + 0, + 13, + 3, + 4, + 3, + 3, + 5, + 4, + 3, + 2, + 3, + 5, + 7, + 5, + 1, + 2, + 9, + 0, + 5, + 7, + 2, + 24, + 0, + 6, + 9, + 5, + 8, + 41, + 4, + 3, + 2, + 2, + 4, + 1, + 1, + 20, + 8, + 2, + 3, + 5, + 6, + 3, + 8, + 5, + 3, + 14, + 2, + 5, + 1, + 17, + 4, + 9, + 3, + 22, + 15, + 10, + 1, + 1 + ], + "weighted_loads": [ + 0.05066155269742012, + 0.0, + 0.20193666173145175, + 0.1260751374065876, + 0.4615533649921417, + 0.2887064591050148, + 0.0, + 0.9628075659275055, + 0.17135580629110336, + 0.11765222437679768, + 0.1301679015159607, + 0.17257045954465866, + 0.3340020477771759, + 1.5412913337349892, + 0.22126486152410507, + 0.08521376177668571, + 0.22638219967484474, + 0.2722689285874367, + 0.5256909723393619, + 0.26506301015615463, + 0.04083188995718956, + 0.0882425345480442, + 0.9395260009914637, + 0.0, + 0.24827566742897034, + 0.5645513981580734, + 0.0703179333359003, + 1.6085233837366104, + 0.0, + 0.3173418417572975, + 0.706976093351841, + 0.3178951507434249, + 0.6621454395353794, + 4.090917780995369, + 0.2558381836861372, + 0.21375124901533127, + 0.08494311943650246, + 0.0863197073340416, + 0.2285429649055004, + 0.058710772544145584, + 0.04269063100218773, + 1.939167071133852, + 0.4677695771679282, + 0.06852002255618572, + 0.17574870586395264, + 0.2592535577714443, + 0.3274328075349331, + 0.10657772608101368, + 0.6497659832239151, + 0.2678017430007458, + 0.17931021004915237, + 0.8080612979829311, + 0.13434000313282013, + 0.2900433875620365, + 0.10686444491147995, + 1.4721633270382881, + 0.2413446083664894, + 0.543148897588253, + 0.13516121357679367, + 1.3279342986643314, + 1.0113793462514877, + 0.903436329215765, + 0.04486560821533203, + 0.03539826720952988 + ], + "unique_experts": 60, + "load_cv": 1.130388330520878, + "normalized_load_entropy": 0.8889352618972237, + "max_load_share": 0.10677083333333333 + } + }, + "s0_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "da30b4c48ff9fbf3352462a99b2ea60cd9aa76d0faab520b75623001d7f53de7", + "route_weight_sha256": "3e843765e5ba2fc6c01b464580200d5afd08a050754f7ea6a5f6ef77250865fb", + "loads": [ + 1, + 0, + 2, + 2, + 4, + 5, + 0, + 11, + 3, + 2, + 1, + 0, + 1, + 2, + 0, + 2, + 3, + 0, + 1, + 6, + 0, + 0, + 8, + 0, + 5, + 5, + 1, + 0, + 0, + 3, + 1, + 5, + 3, + 23, + 2, + 1, + 0, + 0, + 3, + 1, + 0, + 4, + 3, + 0, + 0, + 0, + 0, + 0, + 0, + 2, + 0, + 0, + 1, + 3, + 1, + 3, + 3, + 2, + 3, + 3, + 3, + 0, + 0, + 0 + ], + "weighted_loads": [ + 0.05152781680226326, + 0.0, + 0.13936033472418785, + 0.12423065677285194, + 0.25708044320344925, + 0.2946000471711159, + 0.0, + 0.861382270231843, + 0.16620495915412903, + 0.09958845004439354, + 0.05126728117465973, + 0.0, + 0.14046666026115417, + 0.15195553377270699, + 0.0, + 0.09523820132017136, + 0.21830370277166367, + 0.0, + 0.15382102131843567, + 0.3295306898653507, + 0.0, + 0.0, + 0.9010716900229454, + 0.0, + 0.25565730780363083, + 0.26284484565258026, + 0.04156868904829025, + 0.0, + 0.0, + 0.17895185947418213, + 0.05922704190015793, + 0.33541231229901314, + 0.18373919650912285, + 3.198585756123066, + 0.13123210333287716, + 0.04848300665616989, + 0.0, + 0.0, + 0.1972370520234108, + 0.05565951392054558, + 0.0, + 0.21719888225197792, + 0.3389967828989029, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.09903062880039215, + 0.0, + 0.0, + 0.06715166568756104, + 0.16548476368188858, + 0.10916436463594437, + 0.3268139958381653, + 0.1768147125840187, + 0.15305163711309433, + 0.13647031411528587, + 0.11893640458583832, + 0.20617388933897018, + 0.0, + 0.0, + 0.0 + ], + "unique_experts": 40, + "load_cv": 1.571043905815894, + "normalized_load_entropy": 0.8017798494118721, + "max_load_share": 0.16666666666666666 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "a3908168d81b23d31998bc9313937e833224120534f66bf8d32b166fbedd1f03", + "route_weight_sha256": "d9f6c4c4338eb4dea8cde93329c33a43db8ef6305c7151488fa8aea5dd122c55", + "loads": [ + 1, + 1, + 3, + 2, + 4, + 5, + 0, + 15, + 3, + 3, + 3, + 1, + 2, + 5, + 3, + 2, + 3, + 3, + 7, + 8, + 5, + 2, + 8, + 0, + 5, + 7, + 1, + 10, + 1, + 4, + 3, + 6, + 3, + 31, + 3, + 2, + 0, + 0, + 3, + 1, + 0, + 14, + 8, + 2, + 3, + 2, + 6, + 3, + 0, + 5, + 2, + 6, + 1, + 4, + 1, + 12, + 3, + 9, + 3, + 15, + 8, + 12, + 0, + 0 + ], + "weighted_loads": [ + 0.05152781680226326, + 0.037122197449207306, + 0.15345182735472918, + 0.12423065677285194, + 0.25708044320344925, + 0.2946000471711159, + 0.0, + 1.0360738392919302, + 0.16620495915412903, + 0.11586073040962219, + 0.14865169674158096, + 0.04508715495467186, + 0.17319931834936142, + 0.6988621428608894, + 0.2058514915406704, + 0.09523820132017136, + 0.21830370277166367, + 0.1610398218035698, + 0.5532888695597649, + 0.4359457455575466, + 0.23940956965088844, + 0.0848299153149128, + 0.9010716900229454, + 0.0, + 0.25565730780363083, + 0.326614361256361, + 0.04156868904829025, + 1.040371149778366, + 0.04606078192591667, + 0.2207387201488018, + 0.27269279956817627, + 0.34915425162762403, + 0.18373919650912285, + 3.5872018970549107, + 0.16110736317932606, + 0.08551910147070885, + 0.0, + 0.0, + 0.1972370520234108, + 0.05565951392054558, + 0.0, + 1.6371912248432636, + 0.5384289715439081, + 0.0964493677020073, + 0.18812472745776176, + 0.10616698488593102, + 0.2691478170454502, + 0.11307596229016781, + 0.0, + 0.2632668726146221, + 0.09166012704372406, + 0.2839881032705307, + 0.06715166568756104, + 0.238392673432827, + 0.10916436463594437, + 1.15283477678895, + 0.1768147125840187, + 0.5431493483483791, + 0.13647031411528587, + 0.9052373990416527, + 0.5286071188747883, + 1.0406240709125996, + 0.0, + 0.0 + ], + "unique_experts": 56, + "load_cv": 1.107633446520938, + "normalized_load_entropy": 0.8853339775525148, + "max_load_share": 0.1076388888888889 + } + }, + "s1_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "fab8f1760d09b08598ba5b428cde36255f6847afe4733dcd427df85c6146f65a", + "route_weight_sha256": "16f3dec31a50780a2e6b9f9585b5222ed2cb1153d564a0a35a495f760b62802a", + "loads": [ + 1, + 0, + 2, + 2, + 3, + 5, + 0, + 12, + 3, + 2, + 1, + 0, + 1, + 2, + 0, + 2, + 3, + 0, + 1, + 4, + 0, + 0, + 8, + 0, + 5, + 4, + 1, + 0, + 0, + 3, + 1, + 5, + 3, + 23, + 1, + 1, + 0, + 0, + 4, + 1, + 0, + 5, + 3, + 0, + 0, + 0, + 0, + 0, + 1, + 2, + 0, + 0, + 1, + 3, + 1, + 3, + 3, + 2, + 3, + 3, + 3, + 0, + 1, + 0 + ], + "weighted_loads": [ + 0.05235384404659271, + 0.0, + 0.14167959243059158, + 0.12311732023954391, + 0.22007044777274132, + 0.2940417751669884, + 0.0, + 0.9170290343463421, + 0.1689988188445568, + 0.09853554889559746, + 0.05161727964878082, + 0.0, + 0.1470360904932022, + 0.16035595536231995, + 0.0, + 0.08517046272754669, + 0.22103576734662056, + 0.0, + 0.1565840095281601, + 0.22487235069274902, + 0.0, + 0.0, + 0.9277484342455864, + 0.0, + 0.2627835012972355, + 0.22391122579574585, + 0.0397685170173645, + 0.0, + 0.0, + 0.18148131296038628, + 0.060643766075372696, + 0.33814113587141037, + 0.1801179014146328, + 3.246658980846405, + 0.1020139828324318, + 0.04737783223390579, + 0.0, + 0.0, + 0.23321367055177689, + 0.05450515076518059, + 0.0, + 0.2566760405898094, + 0.3459157571196556, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.02993021160364151, + 0.09984474256634712, + 0.0, + 0.0, + 0.0660560354590416, + 0.1680762954056263, + 0.11247957497835159, + 0.3258395195007324, + 0.1700204610824585, + 0.144326351583004, + 0.13495031371712685, + 0.11530230939388275, + 0.20481745153665543, + 0.0, + 0.03892935812473297, + 0.0 + ], + "unique_experts": 42, + "load_cv": 1.5731815632799344, + "normalized_load_entropy": 0.8072677392677697, + "max_load_share": 0.16666666666666666 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "a339f8ab00a6fb2863a930ccc378e15ab55ad14c10f80dc77acb1c1b53c8f3e0", + "route_weight_sha256": "265457a215292a20b3b31b41485660944f0a6258f317b9448db1b7d7b70df13a", + "loads": [ + 1, + 0, + 3, + 2, + 7, + 6, + 0, + 13, + 3, + 3, + 3, + 3, + 5, + 4, + 4, + 2, + 3, + 4, + 6, + 5, + 2, + 2, + 8, + 0, + 6, + 7, + 3, + 24, + 0, + 6, + 9, + 6, + 8, + 41, + 3, + 3, + 2, + 2, + 5, + 1, + 1, + 22, + 6, + 2, + 3, + 5, + 6, + 3, + 9, + 5, + 3, + 13, + 2, + 6, + 1, + 17, + 4, + 9, + 3, + 22, + 15, + 10, + 1, + 1 + ], + "weighted_loads": [ + 0.05235384404659271, + 0.0, + 0.1557710850611329, + 0.12311732023954391, + 0.42039379850029945, + 0.3293841630220413, + 0.0, + 0.9539059810340405, + 0.1689988188445568, + 0.11480782926082611, + 0.12902263179421425, + 0.17257045954465866, + 0.3469287306070328, + 0.6693052798509598, + 0.28567301109433174, + 0.08517046272754669, + 0.22103576734662056, + 0.21080181375145912, + 0.5569112077355385, + 0.2708120606839657, + 0.09381027519702911, + 0.0882425345480442, + 0.9277484342455864, + 0.0, + 0.304107490926981, + 0.5466803647577763, + 0.11008645035326481, + 1.6018546558916569, + 0.0, + 0.31452344357967377, + 0.7216447852551937, + 0.35188307520002127, + 0.673728134483099, + 4.126193407922983, + 0.24448259361088276, + 0.2118321806192398, + 0.08494311943650246, + 0.0863197073340416, + 0.27086418494582176, + 0.05450515076518059, + 0.04269063100218773, + 2.202923782169819, + 0.4393046423792839, + 0.06852002255618572, + 0.21444298699498177, + 0.2592535577714443, + 0.3274328075349331, + 0.10981710813939571, + 0.6796961948275566, + 0.30066298320889473, + 0.17931021004915237, + 0.7415795437991619, + 0.13562899082899094, + 0.32804884389042854, + 0.11247957497835159, + 1.4617568403482437, + 0.24303453415632248, + 0.5388769991695881, + 0.13495031371712685, + 1.367465402930975, + 0.9955256544053555, + 0.903436329215765, + 0.03892935812473297, + 0.03539826720952988 + ], + "unique_experts": 60, + "load_cv": 1.1361331837029984, + "normalized_load_entropy": 0.8890451615067858, + "max_load_share": 0.10677083333333333 + } + }, + "s0_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "b528689a79bbc15d179d205512952f58686f24b50ed4e264bc69af8f0e39d736", + "route_weight_sha256": "df0bcb8fc7e6b34884faf685b6698895379c370665b4de06a910f5dacc9845f1", + "loads": [ + 1, + 0, + 2, + 2, + 5, + 4, + 0, + 11, + 3, + 2, + 1, + 0, + 1, + 2, + 0, + 2, + 2, + 0, + 1, + 6, + 0, + 0, + 8, + 0, + 5, + 4, + 1, + 0, + 0, + 3, + 1, + 4, + 3, + 23, + 1, + 1, + 0, + 0, + 3, + 1, + 0, + 4, + 3, + 0, + 1, + 0, + 0, + 0, + 1, + 2, + 0, + 0, + 1, + 3, + 1, + 3, + 4, + 2, + 3, + 3, + 3, + 0, + 1, + 0 + ], + "weighted_loads": [ + 0.0626584067940712, + 0.0, + 0.144693985581398, + 0.1213010847568512, + 0.3052029237151146, + 0.260948047041893, + 0.0, + 0.8737560864537954, + 0.16062277555465698, + 0.09605352953076363, + 0.052508123219013214, + 0.0, + 0.14626939594745636, + 0.16566641628742218, + 0.0, + 0.08985824882984161, + 0.1718868464231491, + 0.0, + 0.15093116462230682, + 0.30123962834477425, + 0.0, + 0.0, + 0.9345674961805344, + 0.0, + 0.261077705770731, + 0.21791637130081654, + 0.03984896093606949, + 0.0, + 0.0, + 0.17656514421105385, + 0.06233329325914383, + 0.290106400847435, + 0.17779477313160896, + 3.054028943181038, + 0.09767955541610718, + 0.04579237848520279, + 0.0, + 0.0, + 0.19605504721403122, + 0.06482609361410141, + 0.0, + 0.21576308459043503, + 0.32267390936613083, + 0.0, + 0.04166129603981972, + 0.0, + 0.0, + 0.0, + 0.029701776802539825, + 0.09837685897946358, + 0.0, + 0.0, + 0.06335894018411636, + 0.17090855911374092, + 0.11531047523021698, + 0.3260152265429497, + 0.21992233023047447, + 0.16025234013795853, + 0.1388801448047161, + 0.1299099549651146, + 0.21357956528663635, + 0.0, + 0.03890319541096687, + 0.0 + ], + "unique_experts": 43, + "load_cv": 1.553836779607226, + "normalized_load_entropy": 0.8123221875196022, + "max_load_share": 0.16666666666666666 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "2ff5417f7fbf2338c1256f5a14be3d5788b522ffe2f1ad5158e10a6937344d4f", + "route_weight_sha256": "58958b5816a1fca6d5ccfa1fcee98ec3a647fc93029b76e133074c5b02f18c30", + "loads": [ + 1, + 1, + 3, + 2, + 5, + 4, + 0, + 16, + 3, + 3, + 3, + 1, + 2, + 4, + 2, + 2, + 2, + 4, + 6, + 7, + 4, + 2, + 8, + 0, + 5, + 6, + 1, + 7, + 1, + 4, + 3, + 5, + 3, + 32, + 2, + 2, + 0, + 0, + 3, + 1, + 0, + 13, + 7, + 2, + 5, + 3, + 7, + 3, + 1, + 5, + 3, + 8, + 1, + 4, + 1, + 11, + 4, + 10, + 3, + 15, + 8, + 13, + 1, + 0 + ], + "weighted_loads": [ + 0.0626584067940712, + 0.04674512892961502, + 0.15878547821193933, + 0.1213010847568512, + 0.3052029237151146, + 0.260948047041893, + 0.0, + 1.0870816316455603, + 0.16062277555465698, + 0.11232580989599228, + 0.14989253878593445, + 0.04508715495467186, + 0.1790020540356636, + 0.6699968837201595, + 0.14246830344200134, + 0.08985824882984161, + 0.1718868464231491, + 0.21245017275214195, + 0.48630569875240326, + 0.36638564243912697, + 0.16763020679354668, + 0.0848299153149128, + 0.9345674961805344, + 0.0, + 0.261077705770731, + 0.2816858869045973, + 0.03984896093606949, + 0.8153410889208317, + 0.04606078192591667, + 0.21835200488567352, + 0.27185405790805817, + 0.3038483401760459, + 0.17779477313160896, + 3.474858693778515, + 0.12755481526255608, + 0.08282847329974174, + 0.0, + 0.0, + 0.19605504721403122, + 0.06482609361410141, + 0.0, + 1.3682119399309158, + 0.46658394299447536, + 0.0964493677020073, + 0.24155491217970848, + 0.17820358648896217, + 0.31894415244460106, + 0.11443097330629826, + 0.029701776802539825, + 0.2231350690126419, + 0.12625712528824806, + 0.3953225687146187, + 0.06335894018411636, + 0.2416822351515293, + 0.11531047523021698, + 1.0611800216138363, + 0.21992233023047447, + 0.6123851723968983, + 0.1388801448047161, + 0.9304535277187824, + 0.5441021136939526, + 1.1277737729251385, + 0.03890319541096687, + 0.0 + ], + "unique_experts": 58, + "load_cv": 1.1145779248743821, + "normalized_load_entropy": 0.8893941709105654, + "max_load_share": 0.1111111111111111 + } + }, + "s1_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "e43360b04f48e815bf83df49db36bf9203443cfdec3fff9c4f21a483f7fd8c67", + "route_weight_sha256": "d53f271d5be7c3d2101225c2665583e7aea2721165a2797eea6bf2e98c342d28", + "loads": [ + 1, + 0, + 3, + 2, + 5, + 5, + 0, + 10, + 3, + 2, + 1, + 0, + 1, + 2, + 0, + 1, + 3, + 0, + 1, + 5, + 1, + 0, + 8, + 0, + 5, + 4, + 1, + 0, + 0, + 3, + 1, + 2, + 3, + 23, + 1, + 1, + 0, + 0, + 4, + 1, + 0, + 5, + 3, + 0, + 0, + 0, + 0, + 0, + 1, + 2, + 0, + 1, + 1, + 3, + 1, + 3, + 3, + 2, + 3, + 3, + 3, + 0, + 1, + 0 + ], + "weighted_loads": [ + 0.06136004999279976, + 0.0, + 0.192648034542799, + 0.1254163794219494, + 0.30864136293530464, + 0.28805040940642357, + 0.0, + 0.8086397778242826, + 0.1645849496126175, + 0.09546567872166634, + 0.05342662334442139, + 0.0, + 0.15386807918548584, + 0.16565977036952972, + 0.0, + 0.04712015017867088, + 0.21321607753634453, + 0.0, + 0.148527130484581, + 0.25294462218880653, + 0.04406273737549782, + 0.0, + 0.9290582351386547, + 0.0, + 0.27576756477355957, + 0.2344953827559948, + 0.04102634638547897, + 0.0, + 0.0, + 0.18900241330266, + 0.06335202604532242, + 0.19363552331924438, + 0.1756235659122467, + 2.9590882062911987, + 0.09265431761741638, + 0.046009551733732224, + 0.0, + 0.0, + 0.25628188624978065, + 0.06475378572940826, + 0.0, + 0.25230715423822403, + 0.3216883912682533, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.03073747828602791, + 0.09569792076945305, + 0.0, + 0.0357012040913105, + 0.06420251727104187, + 0.17266583442687988, + 0.10755555331707001, + 0.3050495386123657, + 0.15923969447612762, + 0.1483045481145382, + 0.14098982140421867, + 0.12891916930675507, + 0.21339626610279083, + 0.0, + 0.039333194494247437, + 0.0 + ], + "unique_experts": 44, + "load_cv": 1.5342481038855524, + "normalized_load_entropy": 0.8171598027766387, + "max_load_share": 0.16666666666666666 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "999e40bd914fab31b83d7e46346c76ec79734b3c6909aba1f6935d863cf3f015", + "route_weight_sha256": "fbfd5bb3b218da058e05d93a111bbd78fad239ca42774f95ec73e0193abbb66c", + "loads": [ + 2, + 1, + 4, + 2, + 9, + 6, + 0, + 12, + 3, + 3, + 4, + 3, + 5, + 3, + 4, + 1, + 3, + 5, + 5, + 5, + 2, + 2, + 8, + 0, + 6, + 7, + 3, + 20, + 0, + 6, + 10, + 3, + 8, + 41, + 3, + 3, + 2, + 2, + 5, + 1, + 1, + 21, + 6, + 2, + 2, + 6, + 7, + 4, + 9, + 5, + 5, + 15, + 2, + 5, + 1, + 15, + 4, + 10, + 3, + 22, + 14, + 11, + 1, + 1 + ], + "weighted_loads": [ + 0.11586152389645576, + 0.04984336718916893, + 0.20673952717334032, + 0.1254163794219494, + 0.5089647136628628, + 0.31691044569015503, + 0.0, + 0.8945052903145552, + 0.1645849496126175, + 0.11173795908689499, + 0.17956315353512764, + 0.17257045954465866, + 0.3537607192993164, + 0.6350642889738083, + 0.2793458327651024, + 0.04712015017867088, + 0.21321607753634453, + 0.2631976045668125, + 0.47391972690820694, + 0.25294462218880653, + 0.08489462733268738, + 0.0882425345480442, + 0.9290582351386547, + 0.0, + 0.31709155440330505, + 0.5572645217180252, + 0.11134427972137928, + 1.3369119726121426, + 0.0, + 0.3220445439219475, + 0.8070345558226109, + 0.20737746264785528, + 0.6692337989807129, + 3.8563577383756638, + 0.23512292839586735, + 0.21046390011906624, + 0.08494311943650246, + 0.0863197073340416, + 0.29393240064382553, + 0.06475378572940826, + 0.04269063100218773, + 1.7349961549043655, + 0.4062786400318146, + 0.06852002255618572, + 0.14175746217370033, + 0.32356711104512215, + 0.39406101778149605, + 0.15229842998087406, + 0.680503461509943, + 0.27253175526857376, + 0.25956089422106743, + 0.8836235553026199, + 0.1337754726409912, + 0.2770894952118397, + 0.10755555331707001, + 1.253721009939909, + 0.2322537675499916, + 0.5945009849965572, + 0.14098982140421867, + 1.3353805020451546, + 0.9674086607992649, + 0.9885977618396282, + 0.039333194494247437, + 0.03539826720952988 + ], + "unique_experts": 61, + "load_cv": 1.1012146072002091, + "normalized_load_entropy": 0.8948885440275415, + "max_load_share": 0.10677083333333333 + } + }, + "s0_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "c3a76c4a574a63bb8d050da12321ad5fd9af85e4ee0c0df80cd2fa307dbae98d", + "route_weight_sha256": "43cf37df4e690fb2b43569ba6b3f0d1f57cdbec9960d06786b02af4453210752", + "loads": [ + 1, + 0, + 2, + 2, + 3, + 5, + 0, + 11, + 3, + 2, + 1, + 0, + 1, + 2, + 0, + 2, + 2, + 0, + 1, + 6, + 0, + 0, + 8, + 0, + 5, + 4, + 1, + 0, + 0, + 3, + 1, + 4, + 3, + 23, + 1, + 1, + 0, + 0, + 3, + 1, + 0, + 5, + 3, + 0, + 1, + 0, + 0, + 0, + 1, + 2, + 0, + 1, + 1, + 3, + 1, + 3, + 4, + 2, + 3, + 3, + 3, + 0, + 0, + 0 + ], + "weighted_loads": [ + 0.06160121038556099, + 0.0, + 0.14017226919531822, + 0.12454531341791153, + 0.22118575870990753, + 0.2797101177275181, + 0.0, + 0.8682487644255161, + 0.16110419481992722, + 0.09886500984430313, + 0.05228719860315323, + 0.0, + 0.14629673957824707, + 0.1670498624444008, + 0.0, + 0.09190597757697105, + 0.17161397635936737, + 0.0, + 0.15196095407009125, + 0.3064094390720129, + 0.0, + 0.0, + 0.9453830346465111, + 0.0, + 0.26098548993468285, + 0.2336171790957451, + 0.040315017104148865, + 0.0, + 0.0, + 0.17536715045571327, + 0.059639763087034225, + 0.2908238023519516, + 0.17637236788868904, + 3.0740173533558846, + 0.09807714074850082, + 0.04571424424648285, + 0.0, + 0.0, + 0.19724833220243454, + 0.061698444187641144, + 0.0, + 0.2645949684083462, + 0.32130956649780273, + 0.0, + 0.04100172221660614, + 0.0, + 0.0, + 0.0, + 0.0287560373544693, + 0.10001496225595474, + 0.0, + 0.03487986698746681, + 0.06428465992212296, + 0.17278137058019638, + 0.112825408577919, + 0.32377205044031143, + 0.2097705639898777, + 0.16074257344007492, + 0.14057298004627228, + 0.12951860949397087, + 0.21429493278265, + 0.0, + 0.0, + 0.0 + ], + "unique_experts": 43, + "load_cv": 1.5559980767027937, + "normalized_load_entropy": 0.8118819363401332, + "max_load_share": 0.16666666666666666 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "34da85d43fd44250e4b9bd639e677e1f1ccbb0122d3dc7452232db1b5dca2914", + "route_weight_sha256": "47924a57f91b479619999d014f9a8dd3af8c8ced94a4c477ea3203b7a70509fe", + "loads": [ + 2, + 1, + 3, + 2, + 3, + 5, + 0, + 15, + 3, + 3, + 3, + 1, + 3, + 4, + 2, + 2, + 2, + 3, + 6, + 7, + 4, + 2, + 8, + 0, + 5, + 6, + 1, + 8, + 1, + 4, + 4, + 5, + 3, + 31, + 2, + 2, + 0, + 0, + 3, + 1, + 0, + 15, + 7, + 2, + 4, + 3, + 6, + 3, + 1, + 5, + 3, + 8, + 1, + 4, + 1, + 11, + 4, + 10, + 3, + 16, + 9, + 12, + 0, + 0 + ], + "weighted_loads": [ + 0.09353473037481308, + 0.03738785907626152, + 0.15426376182585955, + 0.12454531341791153, + 0.22118575870990753, + 0.2797101177275181, + 0.0, + 1.0429403334856033, + 0.16110419481992722, + 0.11513729020953178, + 0.14967161417007446, + 0.04508715495467186, + 0.21547375991940498, + 0.6713803298771381, + 0.14479674026370049, + 0.09190597757697105, + 0.17161397635936737, + 0.18562602996826172, + 0.4873354882001877, + 0.3715554531663656, + 0.16763020679354668, + 0.0848299153149128, + 0.9453830346465111, + 0.0, + 0.26098548993468285, + 0.29738669469952583, + 0.040315017104148865, + 0.8470957055687904, + 0.04606078192591667, + 0.21715401113033295, + 0.34650251641869545, + 0.3045657416805625, + 0.17637236788868904, + 3.4501647166907787, + 0.12795240059494972, + 0.0827503390610218, + 0.0, + 0.0, + 0.19724833220243454, + 0.061698444187641144, + 0.0, + 1.5052645616233349, + 0.4649862553924322, + 0.0964493677020073, + 0.19954510405659676, + 0.14970597252249718, + 0.2691478170454502, + 0.11327551864087582, + 0.0287560373544693, + 0.24224677123129368, + 0.12175473943352699, + 0.43299372866749763, + 0.06428465992212296, + 0.24392642080783844, + 0.112825408577919, + 1.0944508388638496, + 0.2097705639898777, + 0.624873910099268, + 0.14057298004627228, + 0.980770405381918, + 0.5949835367500782, + 1.0406240709125996, + 0.0, + 0.0 + ], + "unique_experts": 57, + "load_cv": 1.1069366025095153, + "normalized_load_entropy": 0.8884521410890968, + "max_load_share": 0.1076388888888889 + } + }, + "s1_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "80966b54fd6c615fa8aa285b356e3f63c8013952a34b1e3404494180159aeb19", + "route_weight_sha256": "4601bd0e33d31d6ba134c9828d61aaf79f105d0c44b2450ace6232f0a4160990", + "loads": [ + 1, + 0, + 3, + 2, + 4, + 4, + 0, + 11, + 3, + 2, + 1, + 0, + 1, + 2, + 0, + 1, + 3, + 0, + 1, + 8, + 0, + 0, + 7, + 0, + 5, + 4, + 1, + 0, + 0, + 3, + 1, + 3, + 3, + 23, + 1, + 1, + 0, + 0, + 4, + 1, + 0, + 4, + 3, + 0, + 0, + 0, + 0, + 1, + 1, + 2, + 0, + 1, + 1, + 3, + 1, + 3, + 2, + 2, + 3, + 3, + 3, + 0, + 1, + 0 + ], + "weighted_loads": [ + 0.06003188714385033, + 0.0, + 0.1913934163749218, + 0.12594963610172272, + 0.2516229674220085, + 0.239948071539402, + 0.0, + 0.8474830090999603, + 0.16174474358558655, + 0.097238440066576, + 0.054364390671253204, + 0.0, + 0.1550266146659851, + 0.16961700469255447, + 0.0, + 0.04691196233034134, + 0.21635304763913155, + 0.0, + 0.14882364869117737, + 0.4092045780271292, + 0.0, + 0.0, + 0.8876024857163429, + 0.0, + 0.27242232859134674, + 0.22987446561455727, + 0.040430814027786255, + 0.0, + 0.0, + 0.182963065803051, + 0.060560520738363266, + 0.23773925006389618, + 0.166383296251297, + 2.9600278213620186, + 0.09640582650899887, + 0.046174630522727966, + 0.0, + 0.0, + 0.24514509364962578, + 0.06217190995812416, + 0.0, + 0.2091957964003086, + 0.31608062610030174, + 0.0, + 0.0, + 0.0, + 0.0, + 0.03360491245985031, + 0.03158725053071976, + 0.09696875512599945, + 0.0, + 0.04007955268025398, + 0.061151888221502304, + 0.17515884339809418, + 0.10457730293273926, + 0.2995166480541229, + 0.1126885935664177, + 0.1491660736501217, + 0.14238090813159943, + 0.1208265833556652, + 0.2139464095234871, + 0.0, + 0.03956175222992897, + 0.0 + ], + "unique_experts": 44, + "load_cv": 1.553836779607226, + "normalized_load_entropy": 0.8146871102491112, + "max_load_share": 0.16666666666666666 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "823458728d6052e1d2a4de35428fe5affa53f229a269f9eb43dc9069f1d183d5", + "route_weight_sha256": "bfa3bdf814099cdbf316ce2be002231da62cda6ca3d49a3ba622150594ef9bd9", + "loads": [ + 2, + 0, + 4, + 3, + 8, + 4, + 0, + 12, + 3, + 3, + 3, + 3, + 5, + 3, + 4, + 1, + 3, + 5, + 5, + 8, + 1, + 2, + 7, + 0, + 6, + 7, + 3, + 20, + 0, + 6, + 11, + 4, + 8, + 40, + 3, + 3, + 2, + 2, + 5, + 1, + 1, + 21, + 6, + 2, + 2, + 6, + 6, + 4, + 9, + 6, + 3, + 16, + 2, + 6, + 1, + 16, + 3, + 10, + 3, + 23, + 15, + 11, + 1, + 1 + ], + "weighted_loads": [ + 0.11207177489995956, + 0.0, + 0.20548490900546312, + 0.18331169337034225, + 0.45194631814956665, + 0.239948071539402, + 0.0, + 0.8843599557876587, + 0.16174474358558655, + 0.11351072043180466, + 0.13176974281668663, + 0.17257045954465866, + 0.3549192547798157, + 0.639021523296833, + 0.25822870433330536, + 0.04691196233034134, + 0.21635304763913155, + 0.3155890293419361, + 0.4742162451148033, + 0.4092045780271292, + 0.04083188995718956, + 0.0882425345480442, + 0.8876024857163429, + 0.0, + 0.3137463182210922, + 0.5526436045765877, + 0.11074874736368656, + 1.352153453975916, + 0.0, + 0.3160051964223385, + 0.9115662984549999, + 0.2514811893925071, + 0.6599935293197632, + 3.8025075048208237, + 0.23887443728744984, + 0.21062897890806198, + 0.08494311943650246, + 0.0863197073340416, + 0.28279560804367065, + 0.06217190995812416, + 0.04269063100218773, + 1.7406660616397858, + 0.39657463878393173, + 0.06852002255618572, + 0.14175746217370033, + 0.29567600786685944, + 0.3274328075349331, + 0.1416120994836092, + 0.6813532337546349, + 0.30154706351459026, + 0.17931021004915237, + 0.9627578221261501, + 0.13072484359145164, + 0.31959301978349686, + 0.10457730293273926, + 1.2973716482520103, + 0.18570266664028168, + 0.6766609326004982, + 0.14238090813159943, + 1.3604609072208405, + 1.0057069025933743, + 0.9526755213737488, + 0.03956175222992897, + 0.03539826720952988 + ], + "unique_experts": 60, + "load_cv": 1.1110243021644486, + "normalized_load_entropy": 0.8903762238873234, + "max_load_share": 0.10416666666666667 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "ordered_topk_exact_tokens": 17, + "set_exact_tokens": 18, + "mean_set_jaccard": 0.9378881987577641, + "mean_token_weighted_tv": 0.015155013407702032, + "aggregate_load_tv": 0.036231884057971016 + }, + "system_bos": { + "tokens": 23, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.9254658385093167, + "mean_token_weighted_tv": 0.019752263455935146, + "aggregate_load_tv": 0.036231884057971016 + }, + "system_x": { + "tokens": 23, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 13, + "mean_set_jaccard": 0.8664596273291925, + "mean_token_weighted_tv": 0.030579765003336513, + "aggregate_load_tv": 0.05072463768115941 + }, + "system_period": { + "tokens": 23, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.8913043478260869, + "mean_token_weighted_tv": 0.02923134892531063, + "aggregate_load_tv": 0.05797101449275363 + }, + "bos_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.9006211180124224, + "mean_token_weighted_tv": 0.024523377418518066, + "aggregate_load_tv": 0.043478260869565216 + }, + "bos_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8881987577639753, + "mean_token_weighted_tv": 0.026386784227645916, + "aggregate_load_tv": 0.04347826086956522 + }, + "x_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 13, + "mean_set_jaccard": 0.8664596273291925, + "mean_token_weighted_tv": 0.03372505266705285, + "aggregate_load_tv": 0.050724637681159424 + }, + "x_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8881987577639753, + "mean_token_weighted_tv": 0.03511071387354447, + "aggregate_load_tv": 0.050724637681159424 + }, + "period_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8788819875776398, + "mean_token_weighted_tv": 0.03288560955906692, + "aggregate_load_tv": 0.05072463768115942 + }, + "period_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 13, + "mean_set_jaccard": 0.875776397515528, + "mean_token_weighted_tv": 0.036642537533265095, + "aggregate_load_tv": 0.05797101449275363 + } + } + }, + "layer_11": { + "layer": 11, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "8aeaa5ebb55ff4169f5ee4e71cdc13390cdb68ac683069616ec4915b73f8b151", + "route_weight_sha256": "6bfbccd89810e1c10a350ce77dfefbf208199be62f829948bd6660bd6d8b6630", + "loads": [ + 2, + 2, + 0, + 5, + 0, + 0, + 0, + 1, + 3, + 0, + 2, + 2, + 0, + 2, + 0, + 1, + 8, + 3, + 1, + 0, + 1, + 2, + 2, + 2, + 0, + 1, + 9, + 0, + 0, + 3, + 0, + 1, + 5, + 6, + 0, + 1, + 0, + 0, + 2, + 0, + 8, + 10, + 4, + 0, + 1, + 0, + 1, + 1, + 0, + 4, + 0, + 1, + 3, + 0, + 6, + 4, + 5, + 6, + 0, + 9, + 1, + 3, + 3, + 1 + ], + "weighted_loads": [ + 0.1133204996585846, + 0.08240669220685959, + 0.0, + 0.3444647379219532, + 0.0, + 0.0, + 0.0, + 0.04788200184702873, + 0.17501261085271835, + 0.0, + 0.07996924221515656, + 0.14615349099040031, + 0.0, + 0.12564469873905182, + 0.0, + 0.08855508267879486, + 0.3951490670442581, + 0.34874046966433525, + 0.08353803306818008, + 0.0, + 0.04954950138926506, + 0.1450720950961113, + 0.17039308324456215, + 0.15874015167355537, + 0.0, + 0.050665631890296936, + 0.5897918827831745, + 0.0, + 0.0, + 0.13990234211087227, + 0.0, + 0.08125409483909607, + 0.23985471576452255, + 0.37354690954089165, + 0.0, + 0.03911524638533592, + 0.0, + 0.0, + 0.08110152930021286, + 0.0, + 0.5472066625952721, + 0.6500491052865982, + 0.22295402735471725, + 0.0, + 0.08898699283599854, + 0.0, + 0.10390414297580719, + 0.033107906579971313, + 0.0, + 0.16305002942681313, + 0.0, + 0.032726116478443146, + 0.16042612865567207, + 0.0, + 0.29230349510908127, + 0.1816498152911663, + 0.27051104977726936, + 0.5677418075501919, + 0.0, + 0.8043105751276016, + 0.03756985813379288, + 0.2833179607987404, + 0.11629360541701317, + 0.0454709418118 + ], + "unique_experts": 42, + "load_cv": 1.197122503938086, + "normalized_load_entropy": 0.8343126480812563, + "max_load_share": 0.07246376811594203 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "0ccf59c740598a904c1fa8fe81d0e9438df83557f51f9725749f48745a5b032b", + "route_weight_sha256": "6c0b5d49565b9156888dc71d9f89a097f6c506e6766f076467776622c2782e54", + "loads": [ + 2, + 4, + 1, + 5, + 6, + 0, + 0, + 1, + 8, + 1, + 5, + 5, + 0, + 2, + 0, + 7, + 14, + 5, + 13, + 0, + 1, + 2, + 3, + 8, + 0, + 1, + 10, + 1, + 7, + 3, + 6, + 8, + 6, + 6, + 4, + 3, + 0, + 0, + 2, + 0, + 17, + 10, + 4, + 23, + 4, + 0, + 1, + 9, + 0, + 5, + 0, + 1, + 3, + 0, + 11, + 6, + 5, + 6, + 3, + 9, + 1, + 7, + 12, + 1 + ], + "weighted_loads": [ + 0.1133204996585846, + 0.16765370592474937, + 0.059370964765548706, + 0.3444647379219532, + 0.2644323818385601, + 0.0, + 0.0, + 0.04788200184702873, + 0.4198787175118923, + 0.030617941170930862, + 0.15209769690409303, + 0.20008875709027052, + 0.0, + 0.12564469873905182, + 0.0, + 0.3213922716677189, + 0.9905038513243198, + 0.3785909013822675, + 2.160585641860962, + 0.0, + 0.04954950138926506, + 0.1450720950961113, + 0.17433110205456614, + 0.43822373263537884, + 0.0, + 0.050665631890296936, + 0.5931502333842218, + 0.012540847063064575, + 0.4883144535124302, + 0.13990234211087227, + 0.29461032152175903, + 0.40136972442269325, + 0.2745206244289875, + 0.37354690954089165, + 0.1760234497487545, + 0.17887183651328087, + 0.0, + 0.0, + 0.08110152930021286, + 0.0, + 1.090304397046566, + 0.6500491052865982, + 0.22295402735471725, + 2.4071820862591267, + 0.24774492904543877, + 0.0, + 0.10390414297580719, + 0.6192291602492332, + 0.0, + 0.21941400319337845, + 0.0, + 0.032726116478443146, + 0.16042612865567207, + 0.0, + 0.5842111324891448, + 0.28059937059879303, + 0.27051104977726936, + 0.5677418075501919, + 0.13448286429047585, + 0.8043105751276016, + 0.03756985813379288, + 0.46063748747110367, + 0.6364186108112335, + 0.0454709418118 + ], + "unique_experts": 51, + "load_cv": 1.022131638498561, + "normalized_load_entropy": 0.8773061506922429, + "max_load_share": 0.0798611111111111 + } + }, + "s1_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "0d9afd230f73bde4dd3f391f1db5b46feb5c5a62453f97c1770fa8e3210ba100", + "route_weight_sha256": "343b19bee6bdcf6d2431306131e60b96bdaf0ef901fe8564207f268ec4787251", + "loads": [ + 2, + 1, + 0, + 4, + 0, + 0, + 0, + 1, + 3, + 0, + 2, + 2, + 0, + 2, + 0, + 1, + 8, + 3, + 1, + 0, + 1, + 2, + 2, + 2, + 0, + 1, + 9, + 0, + 0, + 3, + 0, + 1, + 6, + 6, + 0, + 1, + 0, + 0, + 2, + 0, + 8, + 10, + 4, + 0, + 1, + 0, + 1, + 1, + 0, + 4, + 0, + 2, + 3, + 0, + 6, + 3, + 6, + 7, + 0, + 9, + 1, + 3, + 3, + 0 + ], + "weighted_loads": [ + 0.11364682763814926, + 0.04403352364897728, + 0.0, + 0.29859379678964615, + 0.0, + 0.0, + 0.0, + 0.04687908664345741, + 0.17577167227864265, + 0.0, + 0.08324398472905159, + 0.14101780578494072, + 0.0, + 0.12489696219563484, + 0.0, + 0.08392488956451416, + 0.3917854577302933, + 0.3441987782716751, + 0.08511099964380264, + 0.0, + 0.04886521399021149, + 0.1386343017220497, + 0.16899314522743225, + 0.1620064526796341, + 0.0, + 0.04930760711431503, + 0.5811812505126, + 0.0, + 0.0, + 0.14028549566864967, + 0.0, + 0.0783250480890274, + 0.28757015243172646, + 0.37312933802604675, + 0.0, + 0.03824587166309357, + 0.0, + 0.0, + 0.08153800666332245, + 0.0, + 0.5442817062139511, + 0.6162511557340622, + 0.22698470205068588, + 0.0, + 0.08825302869081497, + 0.0, + 0.10387758910655975, + 0.033809155225753784, + 0.0, + 0.1667441390454769, + 0.0, + 0.07456148788332939, + 0.16515888273715973, + 0.0, + 0.28709588944911957, + 0.13697705417871475, + 0.32823551446199417, + 0.582449845969677, + 0.0, + 0.7887823805212975, + 0.03703680634498596, + 0.2779654674232006, + 0.11064542643725872, + 0.0 + ], + "unique_experts": 41, + "load_cv": 1.222126745807789, + "normalized_load_entropy": 0.8281686558861074, + "max_load_share": 0.07246376811594203 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "f84a6956095b7af1c7cb0b9c8734f7983d7822437c351ae59b92f4e31563b024", + "route_weight_sha256": "2f892067b36d4b19ae313b864391f10657ae83551bbd42c592fc4e5823bacf1e", + "loads": [ + 4, + 3, + 1, + 4, + 10, + 4, + 0, + 3, + 12, + 0, + 6, + 5, + 0, + 2, + 0, + 2, + 27, + 5, + 12, + 1, + 2, + 3, + 5, + 7, + 0, + 1, + 12, + 2, + 11, + 3, + 9, + 7, + 7, + 6, + 4, + 5, + 0, + 0, + 2, + 1, + 17, + 10, + 4, + 27, + 3, + 0, + 2, + 15, + 0, + 7, + 0, + 2, + 3, + 5, + 27, + 11, + 12, + 8, + 2, + 13, + 2, + 11, + 14, + 1 + ], + "weighted_loads": [ + 0.26093707978725433, + 0.13096317648887634, + 0.045626554638147354, + 0.29859379678964615, + 0.5498219504952431, + 0.14104371890425682, + 0.0, + 0.17643963918089867, + 0.6881282702088356, + 0.0, + 0.19800131721422076, + 0.19427100103348494, + 0.0, + 0.12489696219563484, + 0.0, + 0.12410541996359825, + 2.0861514024436474, + 0.3731775190681219, + 2.1646678596735, + 0.03820555657148361, + 0.12189573049545288, + 0.2090560719370842, + 0.28490587836131454, + 0.3821639083325863, + 0.0, + 0.04930760711431503, + 0.6616900940425694, + 0.05121370404958725, + 0.8109111227095127, + 0.14028549566864967, + 0.4580333363264799, + 0.3499465025961399, + 0.3207097016274929, + 0.37312933802604675, + 0.20460116118192673, + 0.3849864490330219, + 0.0, + 0.0, + 0.08153800666332245, + 0.046665798872709274, + 1.058331735432148, + 0.6162511557340622, + 0.22698470205068588, + 2.6948860362172127, + 0.2217346392571926, + 0.0, + 0.14952582493424416, + 1.0826940387487411, + 0.0, + 0.38533859327435493, + 0.0, + 0.07456148788332939, + 0.16515888273715973, + 0.3037366718053818, + 1.5766520043835044, + 0.5166635289788246, + 0.8001401163637638, + 0.6262057051062584, + 0.10422240197658539, + 0.943253131583333, + 0.07425867021083832, + 0.6320837624371052, + 0.6676727030426264, + 0.03274724632501602 + ], + "unique_experts": 54, + "load_cv": 1.0651519192636847, + "normalized_load_entropy": 0.8778517597872626, + "max_load_share": 0.0703125 + } + }, + "s0_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "db0af593cabe56440cd47803259bd6e9ab170f4810da80c0d8dece71d83ceaeb", + "route_weight_sha256": "e1dc261111f281e36838ca57289f5b8f842e4206157d786c9133fbc604badff3", + "loads": [ + 3, + 1, + 0, + 5, + 0, + 0, + 0, + 1, + 3, + 0, + 1, + 2, + 0, + 2, + 0, + 1, + 7, + 3, + 1, + 0, + 1, + 2, + 2, + 2, + 0, + 1, + 9, + 0, + 0, + 4, + 0, + 1, + 4, + 8, + 0, + 0, + 0, + 0, + 2, + 0, + 8, + 10, + 4, + 0, + 1, + 0, + 1, + 1, + 0, + 3, + 0, + 1, + 3, + 0, + 6, + 3, + 5, + 7, + 0, + 9, + 1, + 4, + 4, + 1 + ], + "weighted_loads": [ + 0.14929420873522758, + 0.047075897455215454, + 0.0, + 0.33485567197203636, + 0.0, + 0.0, + 0.0, + 0.044165655970573425, + 0.17084284871816635, + 0.0, + 0.049092844128608704, + 0.141388401389122, + 0.0, + 0.12566256895661354, + 0.0, + 0.08655329793691635, + 0.3644287660717964, + 0.3601794168353081, + 0.09081839770078659, + 0.0, + 0.04968344047665596, + 0.1434401050209999, + 0.1613631211221218, + 0.1572084128856659, + 0.0, + 0.05025014653801918, + 0.600650068372488, + 0.0, + 0.0, + 0.18326107412576675, + 0.0, + 0.07922235131263733, + 0.1856229603290558, + 0.45180582627654076, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0810835100710392, + 0.0, + 0.5657808631658554, + 0.6630128175020218, + 0.22986170276999474, + 0.0, + 0.0869048610329628, + 0.0, + 0.10009045153856277, + 0.036769408732652664, + 0.0, + 0.13053391873836517, + 0.0, + 0.031982190907001495, + 0.15359308570623398, + 0.0, + 0.2960233502089977, + 0.14018593728542328, + 0.27359510213136673, + 0.5918262824416161, + 0.0, + 0.8425347693264484, + 0.036315351724624634, + 0.319054514169693, + 0.14971295185387135, + 0.0456693060696125 + ], + "unique_experts": 41, + "load_cv": 1.2276140830505375, + "normalized_load_entropy": 0.8262525292096188, + "max_load_share": 0.07246376811594203 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "c9462c09ef57f0fe0c22a9957ad1692a3ee43a68ac6e8ef95f91703e59394c33", + "route_weight_sha256": "fda7dbc539eda7445a9989fe3a35b0ec9384f6dd793c5e9c889ac9c943ff5c1b", + "loads": [ + 3, + 4, + 1, + 5, + 5, + 0, + 0, + 1, + 7, + 1, + 3, + 4, + 0, + 2, + 0, + 9, + 14, + 4, + 12, + 0, + 1, + 2, + 2, + 8, + 0, + 1, + 9, + 2, + 4, + 4, + 6, + 9, + 5, + 8, + 4, + 2, + 0, + 0, + 2, + 0, + 18, + 10, + 4, + 24, + 4, + 0, + 1, + 9, + 0, + 4, + 0, + 1, + 3, + 0, + 10, + 6, + 5, + 7, + 3, + 9, + 1, + 11, + 13, + 1 + ], + "weighted_loads": [ + 0.14929420873522758, + 0.16207490488886833, + 0.059370964765548706, + 0.33485567197203636, + 0.22382423654198647, + 0.0, + 0.0, + 0.044165655970573425, + 0.367309994995594, + 0.030617941170930862, + 0.11610490456223488, + 0.18325105402618647, + 0.0, + 0.12566256895661354, + 0.0, + 0.39342012628912926, + 1.0517596937716007, + 0.37499671056866646, + 1.271864965558052, + 0.0, + 0.04968344047665596, + 0.1434401050209999, + 0.1613631211221218, + 0.43669199384748936, + 0.0, + 0.05025014653801918, + 0.600650068372488, + 0.05937791243195534, + 0.347451850771904, + 0.18326107412576675, + 0.29461032152175903, + 0.5007209666073322, + 0.22028886899352074, + 0.45180582627654076, + 0.16983188688755035, + 0.1411493830382824, + 0.0, + 0.0, + 0.0810835100710392, + 0.0, + 1.2031907364726067, + 0.6630128175020218, + 0.22986170276999474, + 2.4810464717447758, + 0.24566279724240303, + 0.0, + 0.10009045153856277, + 0.5860601626336575, + 0.0, + 0.1868978925049305, + 0.0, + 0.031982190907001495, + 0.15359308570623398, + 0.0, + 0.5552669940516353, + 0.2716543823480606, + 0.27359510213136673, + 0.5918262824416161, + 0.13448286429047585, + 0.8425347693264484, + 0.036315351724624634, + 0.6252146009355783, + 0.6911545675247908, + 0.0456693060696125 + ], + "unique_experts": 51, + "load_cv": 1.0577462647033207, + "normalized_load_entropy": 0.8729703990320019, + "max_load_share": 0.08333333333333333 + } + }, + "s1_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "922f4e38f17c45e630d82d90826e2d5320fa07136c8cca8e363731fb266eb276", + "route_weight_sha256": "744a92225b3e67ddfad37c1cecc0a543a4c5724d6ec2f756b8a93ab8b199b6cc", + "loads": [ + 2, + 1, + 0, + 5, + 0, + 0, + 1, + 1, + 3, + 0, + 1, + 2, + 0, + 2, + 0, + 1, + 7, + 3, + 1, + 0, + 1, + 2, + 3, + 2, + 0, + 1, + 9, + 0, + 0, + 4, + 0, + 1, + 4, + 7, + 0, + 1, + 0, + 0, + 2, + 0, + 8, + 10, + 5, + 0, + 1, + 0, + 1, + 1, + 0, + 4, + 0, + 1, + 3, + 0, + 6, + 3, + 6, + 7, + 0, + 9, + 1, + 3, + 2, + 0 + ], + "weighted_loads": [ + 0.11704253405332565, + 0.044187452644109726, + 0.0, + 0.3258810117840767, + 0.0, + 0.0, + 0.034898869693279266, + 0.045086272060871124, + 0.17290282621979713, + 0.0, + 0.05268016457557678, + 0.14132120460271835, + 0.0, + 0.12354829907417297, + 0.0, + 0.08246327191591263, + 0.346300695091486, + 0.3666473478078842, + 0.09345609694719315, + 0.0, + 0.04940725490450859, + 0.1438094973564148, + 0.19007042422890663, + 0.162737175822258, + 0.0, + 0.05000779405236244, + 0.5728551410138607, + 0.0, + 0.0, + 0.18468733131885529, + 0.0, + 0.0736706480383873, + 0.19405018165707588, + 0.4185039550065994, + 0.0, + 0.03960036113858223, + 0.0, + 0.0, + 0.08124637976288795, + 0.0, + 0.5604518316686153, + 0.6414916887879372, + 0.26122307404875755, + 0.0, + 0.0779755711555481, + 0.0, + 0.10505501925945282, + 0.03549151495099068, + 0.0, + 0.1620664745569229, + 0.0, + 0.040010273456573486, + 0.16751056537032127, + 0.0, + 0.28861255571246147, + 0.13381768390536308, + 0.3480389639735222, + 0.5858863368630409, + 0.0, + 0.806806206703186, + 0.03618955984711647, + 0.28771957755088806, + 0.08469458296895027, + 0.0 + ], + "unique_experts": 42, + "load_cv": 1.2193738170782975, + "normalized_load_entropy": 0.829680959815017, + "max_load_share": 0.07246376811594203 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "7de9bac01caa96660c48adb449d710a0d37f3a5488c829d058d7b7c1fe153ed4", + "route_weight_sha256": "377423c53f58a39046b8404c5f16719780fc998b3565f7ff796b30301505b7cb", + "loads": [ + 4, + 3, + 1, + 5, + 10, + 4, + 1, + 3, + 11, + 1, + 4, + 4, + 0, + 2, + 0, + 2, + 27, + 4, + 11, + 1, + 2, + 3, + 5, + 7, + 0, + 1, + 11, + 2, + 10, + 4, + 9, + 7, + 5, + 7, + 4, + 5, + 0, + 0, + 2, + 1, + 18, + 10, + 5, + 28, + 3, + 0, + 2, + 16, + 0, + 7, + 0, + 1, + 3, + 5, + 26, + 12, + 12, + 8, + 2, + 13, + 2, + 13, + 14, + 1 + ], + "weighted_loads": [ + 0.2643327862024307, + 0.1285337693989277, + 0.045626554638147354, + 0.3258810117840767, + 0.5498219504952431, + 0.14104371890425682, + 0.034898869693279266, + 0.17464682459831238, + 0.6351486966013908, + 0.033418335020542145, + 0.16230566427111626, + 0.18319135252386332, + 0.0, + 0.12354829907417297, + 0.0, + 0.12264380231499672, + 2.158849846571684, + 0.3814646415412426, + 1.2747055143117905, + 0.03820555657148361, + 0.12243777140974998, + 0.21423126757144928, + 0.3022151552140713, + 0.3828946314752102, + 0.0, + 0.05000779405236244, + 0.6501968950033188, + 0.05121370404958725, + 0.7132245972752571, + 0.18468733131885529, + 0.4580333363264799, + 0.3452921025454998, + 0.22718973085284233, + 0.4185039550065994, + 0.19479265436530113, + 0.3902306817471981, + 0.0, + 0.0, + 0.08124637976288795, + 0.046665798872709274, + 1.150704838335514, + 0.6414916887879372, + 0.26122307404875755, + 2.9498427771031857, + 0.21145718172192574, + 0.0, + 0.15070325508713722, + 1.0805036239326, + 0.0, + 0.38066092878580093, + 0.0, + 0.040010273456573486, + 0.16751056537032127, + 0.3037366718053818, + 1.5568101918324828, + 0.553039439022541, + 0.8199435658752918, + 0.6296421959996223, + 0.10422240197658539, + 0.9612769577652216, + 0.07341142371296883, + 0.7325983382761478, + 0.6745471060276031, + 0.03274724632501602 + ], + "unique_experts": 56, + "load_cv": 1.0700305031996882, + "normalized_load_entropy": 0.8795258186440109, + "max_load_share": 0.07291666666666667 + } + }, + "s0_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "1a2d4fef2f3af9cbadbb493f9d697ff8cab62ebf85ed348819f5a7fd9a847c15", + "route_weight_sha256": "a3ac94913065c7e7ae231a2f7fbc1939b5dcab38665128e7ea9f7e53c75c9f56", + "loads": [ + 2, + 1, + 0, + 4, + 0, + 0, + 0, + 1, + 3, + 0, + 1, + 2, + 0, + 2, + 0, + 1, + 8, + 3, + 1, + 0, + 1, + 2, + 2, + 2, + 0, + 1, + 10, + 0, + 0, + 4, + 1, + 1, + 4, + 7, + 0, + 1, + 0, + 0, + 1, + 0, + 8, + 10, + 4, + 0, + 1, + 0, + 1, + 1, + 0, + 3, + 0, + 1, + 3, + 0, + 6, + 4, + 6, + 7, + 0, + 9, + 1, + 3, + 3, + 1 + ], + "weighted_loads": [ + 0.11477608233690262, + 0.04745951294898987, + 0.0, + 0.29257770255208015, + 0.0, + 0.0, + 0.0, + 0.0461847260594368, + 0.17353753745555878, + 0.0, + 0.0487355999648571, + 0.14185144752264023, + 0.0, + 0.12511758506298065, + 0.0, + 0.08859526365995407, + 0.3981948345899582, + 0.3566329926252365, + 0.08949609845876694, + 0.0, + 0.05305028706789017, + 0.1442142240703106, + 0.16756946593523026, + 0.16158618032932281, + 0.0, + 0.05268734320998192, + 0.6281899698078632, + 0.0, + 0.0, + 0.18548839539289474, + 0.03942335769534111, + 0.07793866842985153, + 0.1758698746562004, + 0.40597059205174446, + 0.0, + 0.04377642273902893, + 0.0, + 0.0, + 0.03476651385426521, + 0.0, + 0.5592117644846439, + 0.6605905257165432, + 0.23443595319986343, + 0.0, + 0.09085258096456528, + 0.0, + 0.09736733883619308, + 0.037628624588251114, + 0.0, + 0.12479433789849281, + 0.0, + 0.03556683287024498, + 0.1458144672214985, + 0.0, + 0.3047330528497696, + 0.17286176979541779, + 0.3229103200137615, + 0.5814930200576782, + 0.0, + 0.8041415326297283, + 0.0408029705286026, + 0.26405109465122223, + 0.11853491514921188, + 0.04822733998298645 + ], + "unique_experts": 43, + "load_cv": 1.2385158235059268, + "normalized_load_entropy": 0.8298993287369786, + "max_load_share": 0.07246376811594203 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "f649aced39b7946421d1f0f906f8dec24ffdd2334d21258e9c88762ffbc3060f", + "route_weight_sha256": "f8b5fdc6af999aa682ebd4a89f837e75ba84a6364cb23d714b7a7b50f349c6f4", + "loads": [ + 2, + 2, + 2, + 4, + 6, + 0, + 0, + 1, + 8, + 1, + 3, + 4, + 0, + 2, + 0, + 7, + 12, + 4, + 13, + 0, + 1, + 2, + 2, + 8, + 0, + 1, + 10, + 1, + 7, + 4, + 7, + 10, + 5, + 7, + 5, + 3, + 0, + 0, + 1, + 0, + 16, + 10, + 4, + 23, + 4, + 0, + 1, + 9, + 0, + 6, + 0, + 1, + 3, + 1, + 10, + 6, + 6, + 7, + 4, + 10, + 1, + 8, + 12, + 1 + ], + "weighted_loads": [ + 0.11477608233690262, + 0.08134808391332626, + 0.0940215140581131, + 0.29257770255208015, + 0.2621515244245529, + 0.0, + 0.0, + 0.0461847260594368, + 0.42425035685300827, + 0.030617941170930862, + 0.11574766039848328, + 0.18371410015970469, + 0.0, + 0.12511758506298065, + 0.0, + 0.3214324526488781, + 0.8942588157951832, + 0.3714502863585949, + 1.3626371994614601, + 0.0, + 0.05305028706789017, + 0.1442142240703106, + 0.16756946593523026, + 0.4410697612911463, + 0.0, + 0.05268734320998192, + 0.6281899698078632, + 0.012540847063064575, + 0.4988953024148941, + 0.18548839539289474, + 0.33403367921710014, + 0.5554580576717854, + 0.21053578332066536, + 0.40597059205174446, + 0.2846266143023968, + 0.18523231893777847, + 0.0, + 0.0, + 0.03476651385426521, + 0.0, + 1.0373529195785522, + 0.6605905257165432, + 0.23443595319986343, + 2.17672186717391, + 0.2496105171740055, + 0.0, + 0.09736733883619308, + 0.6067400276660919, + 0.0, + 0.27245059236884117, + 0.0, + 0.03556683287024498, + 0.1458144672214985, + 0.05507826432585716, + 0.5583147769793868, + 0.255567517131567, + 0.3229103200137615, + 0.5814930200576782, + 0.1942969299852848, + 0.848974421620369, + 0.0408029705286026, + 0.4961983785033226, + 0.618031308054924, + 0.04822733998298645 + ], + "unique_experts": 52, + "load_cv": 1.0137937550497034, + "normalized_load_entropy": 0.8786721432701944, + "max_load_share": 0.0798611111111111 + } + }, + "s1_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "cf1855a3e90add14f81066c8f6d1656fd5f812cf8b3ebc5cf3ebd74575516d5a", + "route_weight_sha256": "d003ee8569e67e90ca0bfa25da13808a4b151067c0e7af797bd4a9bd3b505c4f", + "loads": [ + 2, + 1, + 0, + 5, + 0, + 0, + 1, + 1, + 3, + 0, + 1, + 2, + 0, + 2, + 0, + 1, + 7, + 3, + 1, + 0, + 1, + 2, + 2, + 2, + 0, + 1, + 10, + 0, + 0, + 4, + 0, + 1, + 5, + 7, + 0, + 1, + 0, + 0, + 2, + 0, + 7, + 10, + 4, + 0, + 1, + 0, + 1, + 1, + 0, + 3, + 0, + 1, + 3, + 0, + 7, + 3, + 6, + 7, + 0, + 10, + 0, + 3, + 3, + 0 + ], + "weighted_loads": [ + 0.12128646671772003, + 0.04251302406191826, + 0.0, + 0.32962236925959587, + 0.0, + 0.0, + 0.036547593772411346, + 0.04767831414937973, + 0.17566272616386414, + 0.0, + 0.05479460954666138, + 0.14123530313372612, + 0.0, + 0.12112906202673912, + 0.0, + 0.08184783905744553, + 0.317973542958498, + 0.3556785061955452, + 0.10208093374967575, + 0.0, + 0.05332636460661888, + 0.139155101031065, + 0.16005398333072662, + 0.15804129093885422, + 0.0, + 0.04846259579062462, + 0.6445956490933895, + 0.0, + 0.0, + 0.18524803966283798, + 0.0, + 0.0745546817779541, + 0.2308914214372635, + 0.40764550119638443, + 0.0, + 0.05122702196240425, + 0.0, + 0.0, + 0.07692701742053032, + 0.0, + 0.5190461724996567, + 0.6245058141648769, + 0.22382492572069168, + 0.0, + 0.08316060900688171, + 0.0, + 0.10714298486709595, + 0.035136956721544266, + 0.0, + 0.1240004263818264, + 0.0, + 0.04171612113714218, + 0.15403108671307564, + 0.0, + 0.3355324976146221, + 0.12700378894805908, + 0.337373960763216, + 0.5782872028648853, + 0.0, + 0.824709702283144, + 0.0, + 0.26292264461517334, + 0.1183264721184969, + 0.0 + ], + "unique_experts": 41, + "load_cv": 1.2573664479271869, + "normalized_load_entropy": 0.8225215476430019, + "max_load_share": 0.07246376811594203 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "53032cb98ec2cbf055265dbfd361610bb4631ebf84cf1e2b3f3ce22c6cdda026", + "route_weight_sha256": "1ffffe26fc1dbab2ddad9f978c8a6e096618e374f7e81a73195d0f23dc978374", + "loads": [ + 4, + 3, + 1, + 5, + 10, + 4, + 1, + 3, + 12, + 0, + 4, + 4, + 0, + 2, + 0, + 2, + 26, + 4, + 12, + 1, + 2, + 3, + 4, + 7, + 0, + 1, + 12, + 3, + 11, + 4, + 9, + 8, + 6, + 7, + 5, + 5, + 0, + 0, + 2, + 1, + 14, + 10, + 4, + 27, + 3, + 0, + 2, + 15, + 0, + 7, + 0, + 1, + 3, + 6, + 28, + 12, + 12, + 8, + 3, + 14, + 1, + 11, + 14, + 1 + ], + "weighted_loads": [ + 0.2685767188668251, + 0.11774840578436852, + 0.045626554638147354, + 0.32962236925959587, + 0.5498219504952431, + 0.14104371890425682, + 0.036547593772411346, + 0.17723886668682098, + 0.6916909478604794, + 0.0, + 0.16442010924220085, + 0.18310545105487108, + 0.0, + 0.12112906202673912, + 0.0, + 0.12202836945652962, + 2.0266719609498978, + 0.3704957999289036, + 1.3616969287395477, + 0.03820555657148361, + 0.12635688111186028, + 0.20957687124609947, + 0.27219871431589127, + 0.3781987465918064, + 0.0, + 0.04846259579062462, + 0.7219374030828476, + 0.09393206611275673, + 0.8132111057639122, + 0.18524803966283798, + 0.4580333363264799, + 0.3944494090974331, + 0.26403097063302994, + 0.40764550119638443, + 0.26186662912368774, + 0.40029994398355484, + 0.0, + 0.0, + 0.07692701742053032, + 0.046665798872709274, + 0.9117686524987221, + 0.6245058141648769, + 0.22382492572069168, + 2.4120686762034893, + 0.21664221957325935, + 0.0, + 0.15279122069478035, + 1.02786223590374, + 0.0, + 0.39166898652911186, + 0.0, + 0.04171612113714218, + 0.15403108671307564, + 0.35467347502708435, + 1.640032378025353, + 0.5516758672893047, + 0.8092785626649857, + 0.6220430620014668, + 0.1517365351319313, + 0.9791804533451796, + 0.037221863865852356, + 0.6212341263890266, + 0.6934250947088003, + 0.03274724632501602 + ], + "unique_experts": 55, + "load_cv": 1.0586121679927085, + "normalized_load_entropy": 0.8796240154923375, + "max_load_share": 0.07291666666666667 + } + }, + "s0_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "9fc7e407de93f7a25b2fc6970df8ad1232ebda75b97838f6484c73f044012835", + "route_weight_sha256": "0698eda8adacb56cc78f2fee2e56adac336575f7cc66ac751dc8a4245c33c6e0", + "loads": [ + 2, + 1, + 0, + 4, + 1, + 0, + 0, + 1, + 3, + 0, + 1, + 2, + 0, + 2, + 0, + 1, + 7, + 3, + 1, + 0, + 1, + 2, + 2, + 2, + 0, + 1, + 9, + 0, + 0, + 4, + 0, + 1, + 4, + 7, + 0, + 1, + 0, + 0, + 2, + 0, + 8, + 10, + 4, + 1, + 1, + 0, + 1, + 1, + 0, + 4, + 0, + 2, + 3, + 0, + 6, + 3, + 6, + 7, + 0, + 9, + 1, + 2, + 3, + 1 + ], + "weighted_loads": [ + 0.11416009068489075, + 0.04234164580702782, + 0.0, + 0.2862880676984787, + 0.03275888040661812, + 0.0, + 0.0, + 0.04934978857636452, + 0.17653656378388405, + 0.0, + 0.05037308111786842, + 0.14314807206392288, + 0.0, + 0.12562303617596626, + 0.0, + 0.08630096167325974, + 0.35853202641010284, + 0.3523576781153679, + 0.08986155688762665, + 0.0, + 0.053410593420267105, + 0.14603829756379128, + 0.16239356249570847, + 0.158839613199234, + 0.0, + 0.05373752489686012, + 0.6122492253780365, + 0.0, + 0.0, + 0.18706220015883446, + 0.0, + 0.08137773722410202, + 0.17371006682515144, + 0.3989679552614689, + 0.0, + 0.045827217400074005, + 0.0, + 0.0, + 0.07638812065124512, + 0.0, + 0.5554672069847584, + 0.6440880112349987, + 0.23249703273177147, + 0.03751423954963684, + 0.09538556635379791, + 0.0, + 0.10733653604984283, + 0.03708093240857124, + 0.0, + 0.16195641458034515, + 0.0, + 0.07509053498506546, + 0.1454557664692402, + 0.0, + 0.3027012534439564, + 0.1286051608622074, + 0.33314400538802147, + 0.5759454518556595, + 0.0, + 0.8319085165858269, + 0.03938426449894905, + 0.23259910941123962, + 0.1138175930827856, + 0.04748079553246498 + ], + "unique_experts": 44, + "load_cv": 1.194311940990441, + "normalized_load_entropy": 0.8393115980409073, + "max_load_share": 0.07246376811594203 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "6cacded747a916b4be6f4e80f9fedd1d11f36dce3f50cb2563245fa2791c1d70", + "route_weight_sha256": "477619cfc61841e0bcdf35a527c8ae218dc7ce773ff284dd53ce80972d741b2c", + "loads": [ + 2, + 2, + 1, + 4, + 8, + 0, + 0, + 1, + 8, + 1, + 3, + 4, + 0, + 2, + 0, + 8, + 13, + 4, + 13, + 0, + 1, + 2, + 2, + 8, + 0, + 1, + 9, + 1, + 8, + 4, + 6, + 10, + 5, + 7, + 4, + 4, + 0, + 0, + 2, + 0, + 16, + 10, + 4, + 25, + 4, + 0, + 1, + 9, + 0, + 6, + 0, + 2, + 3, + 0, + 10, + 5, + 6, + 7, + 3, + 10, + 1, + 7, + 10, + 1 + ], + "weighted_loads": [ + 0.11416009068489075, + 0.07623021677136421, + 0.059370964765548706, + 0.2862880676984787, + 0.3724013417959213, + 0.0, + 0.0, + 0.04934978857636452, + 0.4199049547314644, + 0.030617941170930862, + 0.1173851415514946, + 0.18501072470098734, + 0.0, + 0.12562303617596626, + 0.0, + 0.3565509505569935, + 0.950062058866024, + 0.3671749718487263, + 1.3125964887440205, + 0.0, + 0.053410593420267105, + 0.14603829756379128, + 0.16239356249570847, + 0.43832319416105747, + 0.0, + 0.05373752489686012, + 0.6122492253780365, + 0.012540847063064575, + 0.5379859544336796, + 0.18706220015883446, + 0.29461032152175903, + 0.5652995072305202, + 0.2083759754896164, + 0.3989679552614689, + 0.19640736654400826, + 0.3370841220021248, + 0.0, + 0.0, + 0.07638812065124512, + 0.0, + 1.0337108373641968, + 0.6440880112349987, + 0.23249703273177147, + 2.3282716535031796, + 0.25414350256323814, + 0.0, + 0.10733653604984283, + 0.6027857400476933, + 0.0, + 0.2686449848115444, + 0.0, + 0.07509053498506546, + 0.1454557664692402, + 0.0, + 0.5598711846396327, + 0.21040137484669685, + 0.33314400538802147, + 0.5759454518556595, + 0.13448286429047585, + 0.8735526166856289, + 0.03938426449894905, + 0.46510275453329086, + 0.5453197378665209, + 0.04748079553246498 + ], + "unique_experts": 51, + "load_cv": 1.0400914014916143, + "normalized_load_entropy": 0.8752938578689035, + "max_load_share": 0.08680555555555555 + } + }, + "s1_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "b5dd7177343a98c37e8fb7c3390baab4cd6c2dba5c78e79f8b4fccb9b768e718", + "route_weight_sha256": "2b4db89297abdd9455ab42a2439ef1a792ebac17deee72e135128eefada13203", + "loads": [ + 2, + 1, + 0, + 5, + 0, + 0, + 1, + 1, + 3, + 0, + 1, + 2, + 0, + 2, + 0, + 1, + 7, + 3, + 1, + 0, + 1, + 2, + 2, + 2, + 0, + 1, + 10, + 0, + 0, + 5, + 1, + 1, + 5, + 7, + 0, + 1, + 0, + 0, + 1, + 0, + 8, + 9, + 4, + 0, + 1, + 0, + 1, + 1, + 0, + 4, + 0, + 1, + 3, + 0, + 7, + 3, + 6, + 7, + 0, + 9, + 0, + 2, + 3, + 0 + ], + "weighted_loads": [ + 0.11830998212099075, + 0.03730515018105507, + 0.0, + 0.3270247094333172, + 0.0, + 0.0, + 0.0349593348801136, + 0.04817628487944603, + 0.17679817974567413, + 0.0, + 0.055185284465551376, + 0.14619750156998634, + 0.0, + 0.12283080071210861, + 0.0, + 0.08143343031406403, + 0.3236306235194206, + 0.3691990301012993, + 0.10101952403783798, + 0.0, + 0.05333878844976425, + 0.14065445959568024, + 0.1586253046989441, + 0.15692410618066788, + 0.0, + 0.04820441082119942, + 0.6498862151056528, + 0.0, + 0.0, + 0.22268003411591053, + 0.035589806735515594, + 0.07407788932323456, + 0.2287478931248188, + 0.39983489736914635, + 0.0, + 0.0521218404173851, + 0.0, + 0.0, + 0.03615105524659157, + 0.0, + 0.54625653475523, + 0.5718607567250729, + 0.22152666375041008, + 0.0, + 0.08351851254701614, + 0.0, + 0.11000651121139526, + 0.03642348200082779, + 0.0, + 0.15944861620664597, + 0.0, + 0.040669605135917664, + 0.15255093947052956, + 0.0, + 0.3453284129500389, + 0.12213332578539848, + 0.33486882597208023, + 0.5564097687602043, + 0.0, + 0.7974493093788624, + 0.0, + 0.22529742866754532, + 0.11138019897043705, + 0.0 + ], + "unique_experts": 42, + "load_cv": 1.2385158235059268, + "normalized_load_entropy": 0.8260620438459958, + "max_load_share": 0.07246376811594203 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "e47e7ff5280c95474692bb8094c2e755543cab575b1c5ed33e360810b0cdbb97", + "route_weight_sha256": "202f8acd4bad1d1da19d0832cca142eca20da7c03207dadae3c1408786193bd4", + "loads": [ + 4, + 2, + 1, + 5, + 11, + 6, + 1, + 3, + 12, + 0, + 4, + 4, + 0, + 2, + 1, + 3, + 26, + 4, + 11, + 1, + 2, + 3, + 4, + 7, + 0, + 1, + 12, + 2, + 11, + 5, + 10, + 8, + 6, + 7, + 5, + 6, + 0, + 0, + 1, + 1, + 14, + 9, + 4, + 27, + 3, + 0, + 2, + 15, + 0, + 8, + 0, + 1, + 3, + 5, + 27, + 12, + 12, + 8, + 2, + 14, + 1, + 10, + 14, + 1 + ], + "weighted_loads": [ + 0.2656002342700958, + 0.06999258697032928, + 0.045626554638147354, + 0.3270247094333172, + 0.6165101826190948, + 0.2130062971264124, + 0.0349593348801136, + 0.17773683741688728, + 0.6928358897566795, + 0.0, + 0.16481078416109085, + 0.1880676494911313, + 0.0, + 0.12283080071210861, + 0.04007318243384361, + 0.15465721860527992, + 2.055519837886095, + 0.38401632383465767, + 1.2822689414024353, + 0.03820555657148361, + 0.12636930495500565, + 0.21107622981071472, + 0.27077003568410873, + 0.37708156183362007, + 0.0, + 0.04820441082119942, + 0.7272279690951109, + 0.05121370404958725, + 0.8510139659047127, + 0.22268003411591053, + 0.4936231430619955, + 0.3844693601131439, + 0.26188744232058525, + 0.39983489736914635, + 0.24937573820352554, + 0.4943346455693245, + 0.0, + 0.0, + 0.03615105524659157, + 0.046665798872709274, + 0.8720832988619804, + 0.5718607567250729, + 0.22152666375041008, + 2.4531617760658264, + 0.21700012311339378, + 0.0, + 0.15565474703907967, + 1.040179681032896, + 0.0, + 0.41813505068421364, + 0.0, + 0.040669605135917664, + 0.15255093947052956, + 0.3037366718053818, + 1.6163616431877017, + 0.5431842543184757, + 0.8067734278738499, + 0.6001656278967857, + 0.10422240197658539, + 0.9927531573921442, + 0.037221863865852356, + 0.5791398212313652, + 0.6786282826215029, + 0.03274724632501602 + ], + "unique_experts": 56, + "load_cv": 1.0491398593345143, + "normalized_load_entropy": 0.8810266289657791, + "max_load_share": 0.0703125 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "ordered_topk_exact_tokens": 17, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.9503105590062112, + "mean_token_weighted_tv": 0.013260980379646238, + "aggregate_load_tv": 0.028985507246376815 + }, + "system_bos": { + "tokens": 23, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.9130434782608697, + "mean_token_weighted_tv": 0.018968813323780247, + "aggregate_load_tv": 0.04347826086956521 + }, + "system_x": { + "tokens": 23, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8881987577639753, + "mean_token_weighted_tv": 0.025005540810525417, + "aggregate_load_tv": 0.04347826086956522 + }, + "system_period": { + "tokens": 23, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.9006211180124223, + "mean_token_weighted_tv": 0.023285605418293373, + "aggregate_load_tv": 0.05072463768115943 + }, + "bos_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.9006211180124224, + "mean_token_weighted_tv": 0.02151411071257747, + "aggregate_load_tv": 0.05072463768115944 + }, + "bos_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.9254658385093167, + "mean_token_weighted_tv": 0.018626067665931972, + "aggregate_load_tv": 0.043478260869565216 + }, + "x_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8881987577639753, + "mean_token_weighted_tv": 0.025775870389264564, + "aggregate_load_tv": 0.04347826086956522 + }, + "x_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.9037267080745341, + "mean_token_weighted_tv": 0.026321063789984455, + "aggregate_load_tv": 0.05072463768115944 + }, + "period_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8881987577639753, + "mean_token_weighted_tv": 0.026009422160037186, + "aggregate_load_tv": 0.05072463768115943 + }, + "period_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.9037267080745341, + "mean_token_weighted_tv": 0.02624821338964545, + "aggregate_load_tv": 0.05797101449275363 + } + } + }, + "layer_12": { + "layer": 12, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "1243bee5b9b07d0186c4f2350b32d5758266f9d437b28e59526f03247af1d37d", + "route_weight_sha256": "06738cab33f132638f66a769edc3aacefa249826a7bf4be84a6ee5dd320dc5e8", + "loads": [ + 3, + 2, + 1, + 5, + 1, + 6, + 0, + 3, + 1, + 0, + 0, + 0, + 4, + 7, + 2, + 0, + 6, + 1, + 2, + 0, + 1, + 2, + 2, + 3, + 1, + 0, + 4, + 0, + 1, + 0, + 2, + 6, + 1, + 3, + 3, + 1, + 1, + 3, + 2, + 0, + 5, + 1, + 0, + 3, + 4, + 0, + 0, + 2, + 4, + 3, + 0, + 4, + 4, + 3, + 0, + 1, + 4, + 9, + 0, + 4, + 0, + 4, + 1, + 2 + ], + "weighted_loads": [ + 0.17737053334712982, + 0.09554314613342285, + 0.0473317988216877, + 0.9416995085775852, + 0.1416700780391693, + 0.6956821978092194, + 0.0, + 0.1288865990936756, + 0.040971655398607254, + 0.0, + 0.0, + 0.0, + 0.3508804701268673, + 0.4998726435005665, + 0.08723783493041992, + 0.0, + 0.3025369606912136, + 0.06688101589679718, + 0.1054779477417469, + 0.0, + 0.02769756317138672, + 0.06512481160461903, + 0.24376961588859558, + 0.7108741104602814, + 0.049310702830553055, + 0.0, + 0.33236757293343544, + 0.0, + 0.06269783526659012, + 0.0, + 0.08577831462025642, + 0.47125297598540783, + 0.051003966480493546, + 0.17686643078923225, + 0.10480552539229393, + 0.027909692376852036, + 0.05336225405335426, + 0.2729193978011608, + 0.09010563790798187, + 0.0, + 0.3476547449827194, + 0.04830480366945267, + 0.0, + 0.11269981414079666, + 0.15337774902582169, + 0.0, + 0.0, + 0.09946847334504128, + 0.3078956641256809, + 0.1459004357457161, + 0.0, + 0.2489650994539261, + 0.20802604407072067, + 0.23293384909629822, + 0.0, + 0.051234617829322815, + 0.2828909866511822, + 0.6318761892616749, + 0.0, + 0.40163254737854004, + 0.0, + 0.19346507266163826, + 0.027236567810177803, + 0.10561760514974594 + ], + "unique_experts": 47, + "load_cv": 0.9426976445188068, + "normalized_load_entropy": 0.8819480339211084, + "max_load_share": 0.06521739130434782 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "e98f88f0d14655a8d2aef9e749b3172e06ed85ffd7f2292f0ce612639c55087b", + "route_weight_sha256": "a1ec2d3d20febe1b5850e83d486df93b526e87f1128385d788b3fe744343b90a", + "loads": [ + 3, + 2, + 1, + 10, + 5, + 7, + 0, + 5, + 7, + 0, + 0, + 0, + 9, + 7, + 2, + 0, + 10, + 1, + 2, + 0, + 2, + 2, + 3, + 10, + 1, + 0, + 5, + 7, + 16, + 11, + 4, + 11, + 2, + 5, + 3, + 8, + 1, + 7, + 18, + 0, + 5, + 6, + 5, + 5, + 5, + 1, + 1, + 8, + 7, + 3, + 1, + 4, + 4, + 3, + 0, + 1, + 7, + 10, + 0, + 7, + 0, + 8, + 5, + 5 + ], + "weighted_loads": [ + 0.17737053334712982, + 0.09554314613342285, + 0.0473317988216877, + 1.0689859807025641, + 1.7623634245246649, + 0.6997547815553844, + 0.0, + 0.23637774214148521, + 0.4338218681514263, + 0.0, + 0.0, + 0.0, + 0.61687021702528, + 0.4998726435005665, + 0.08723783493041992, + 0.0, + 0.5520252920687199, + 0.06688101589679718, + 0.1054779477417469, + 0.0, + 0.030010699527338147, + 0.06512481160461903, + 0.2914804667234421, + 1.2360126003623009, + 0.049310702830553055, + 0.0, + 0.3651331663131714, + 0.3976475317031145, + 1.9550955183804035, + 1.6377289220690727, + 0.1481976294890046, + 0.8261744994670153, + 0.09729554131627083, + 0.257785402238369, + 0.10480552539229393, + 0.5222843587398529, + 0.05336225405335426, + 0.3862147852778435, + 1.609827145934105, + 0.0, + 0.3476547449827194, + 0.6122756525874138, + 0.3186364024877548, + 0.269264280796051, + 0.2025371603667736, + 0.03696048632264137, + 0.049444813281297684, + 0.45211490616202354, + 0.5095834471285343, + 0.1459004357457161, + 0.012954654172062874, + 0.2489650994539261, + 0.20802604407072067, + 0.23293384909629822, + 0.0, + 0.051234617829322815, + 0.3899120632559061, + 0.6615113653242588, + 0.0, + 0.4951032642275095, + 0.0, + 0.352822856977582, + 0.19328688643872738, + 0.20514936745166779 + ], + "unique_experts": 53, + "load_cv": 0.8792884328524674, + "normalized_load_entropy": 0.9003317784005731, + "max_load_share": 0.0625 + } + }, + "s1_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "aef47840bc8fc6ddf6c23c2b195cb7bb6dcc233f243653c9edf0a51adf462d15", + "route_weight_sha256": "64138cc352eff3deab6fec8ba2c0f2d7dbbc904bb3d4f89d78d9f7253142f163", + "loads": [ + 3, + 1, + 1, + 5, + 1, + 6, + 0, + 3, + 1, + 0, + 0, + 0, + 4, + 7, + 2, + 0, + 7, + 1, + 2, + 0, + 1, + 2, + 2, + 3, + 1, + 0, + 4, + 0, + 1, + 0, + 1, + 5, + 1, + 3, + 3, + 1, + 1, + 3, + 2, + 0, + 6, + 1, + 0, + 2, + 4, + 0, + 0, + 2, + 5, + 3, + 0, + 4, + 4, + 3, + 0, + 1, + 4, + 9, + 0, + 4, + 0, + 5, + 1, + 2 + ], + "weighted_loads": [ + 0.1744694486260414, + 0.05602316930890083, + 0.045398812741041183, + 0.9308069013059139, + 0.14509929716587067, + 0.7109033614397049, + 0.0, + 0.12882717326283455, + 0.04075798764824867, + 0.0, + 0.0, + 0.0, + 0.35297316312789917, + 0.5156722962856293, + 0.09408623352646828, + 0.0, + 0.3210841305553913, + 0.06780242919921875, + 0.1041112132370472, + 0.0, + 0.027736874297261238, + 0.06820252351462841, + 0.25469131022691727, + 0.7203919924795628, + 0.04672076553106308, + 0.0, + 0.32478588819503784, + 0.0, + 0.06315864622592926, + 0.0, + 0.04464999958872795, + 0.4426215961575508, + 0.0495133139193058, + 0.18061046674847603, + 0.10813557915389538, + 0.029280001297593117, + 0.05004160851240158, + 0.2716374434530735, + 0.08600553125143051, + 0.0, + 0.392823301255703, + 0.05048235505819321, + 0.0, + 0.07538184523582458, + 0.14897193759679794, + 0.0, + 0.0, + 0.09930495917797089, + 0.3422236181795597, + 0.14960523694753647, + 0.0, + 0.2485523857176304, + 0.2070455215871334, + 0.23441675677895546, + 0.0, + 0.04766887426376343, + 0.2780851759016514, + 0.6273641660809517, + 0.0, + 0.39374393224716187, + 0.0, + 0.23294219374656677, + 0.027113493531942368, + 0.10483988747000694 + ], + "unique_experts": 47, + "load_cv": 0.9776971000303147, + "normalized_load_entropy": 0.87638510771726, + "max_load_share": 0.06521739130434782 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "56537ffef3d7e45315699888bba77fc6479cc26829965996630630990ad5de90", + "route_weight_sha256": "b516ccb72fc2387fd6a77a0c0425524bd5fc94301c38c9e51c9ae1e7516cc0e7", + "loads": [ + 7, + 1, + 1, + 8, + 5, + 7, + 0, + 8, + 7, + 3, + 1, + 0, + 8, + 7, + 2, + 0, + 12, + 3, + 3, + 0, + 2, + 4, + 5, + 9, + 1, + 0, + 7, + 7, + 18, + 17, + 12, + 9, + 5, + 7, + 8, + 8, + 1, + 7, + 22, + 0, + 7, + 14, + 7, + 7, + 16, + 4, + 4, + 9, + 11, + 3, + 2, + 4, + 4, + 6, + 0, + 2, + 7, + 14, + 0, + 8, + 2, + 13, + 6, + 2 + ], + "weighted_loads": [ + 0.36684065498411655, + 0.05602316930890083, + 0.045398812741041183, + 0.9882954224012792, + 1.7687640525400639, + 0.714845780748874, + 0.0, + 0.3880209010094404, + 0.5344721972942352, + 0.31960856169462204, + 0.04405001550912857, + 0.0, + 0.5488793291151524, + 0.5156722962856293, + 0.09408623352646828, + 0.0, + 0.6549796126782894, + 0.18174193054437637, + 0.13971228525042534, + 0.0, + 0.03007887816056609, + 0.15891935117542744, + 0.37725408002734184, + 1.173639938235283, + 0.04672076553106308, + 0.0, + 0.4459478333592415, + 0.3722468428313732, + 2.281629841774702, + 2.584037370979786, + 0.905379687435925, + 0.744610421359539, + 0.22655821964144707, + 0.4226125404238701, + 0.3626720290631056, + 0.6040906347334385, + 0.05004160851240158, + 0.44430409371852875, + 1.8409819155931473, + 0.0, + 0.4223810713738203, + 1.1787855494767427, + 0.4127436429262161, + 0.3557388223707676, + 1.3050962127745152, + 0.3105485215783119, + 0.17910757660865784, + 0.4977041855454445, + 0.7040934562683105, + 0.14960523694753647, + 0.06547838635742664, + 0.2485523857176304, + 0.2070455215871334, + 0.3933923691511154, + 0.0, + 0.07898750528693199, + 0.35703781712800264, + 0.8489910140633583, + 0.0, + 0.5132057126611471, + 0.07014894858002663, + 0.6326663047075272, + 0.24735287576913834, + 0.10483988747000694 + ], + "unique_experts": 56, + "load_cv": 0.8138343743593587, + "normalized_load_entropy": 0.9153186954997925, + "max_load_share": 0.057291666666666664 + } + }, + "s0_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "4581b93c42fd3f2189d2f0aa6c398758486bbc8fabd95d833db84d2881713761", + "route_weight_sha256": "1f5e14eb50e85abdd4c34be77cab748af33498030faf12beabae95a9510f89cc", + "loads": [ + 3, + 2, + 1, + 6, + 2, + 6, + 0, + 2, + 1, + 0, + 0, + 0, + 4, + 7, + 1, + 1, + 9, + 1, + 2, + 0, + 1, + 2, + 2, + 3, + 0, + 0, + 4, + 0, + 1, + 0, + 1, + 5, + 1, + 3, + 3, + 1, + 1, + 3, + 2, + 0, + 5, + 1, + 0, + 3, + 3, + 0, + 0, + 2, + 5, + 3, + 0, + 3, + 4, + 4, + 0, + 1, + 4, + 9, + 0, + 4, + 0, + 4, + 0, + 2 + ], + "weighted_loads": [ + 0.1580628976225853, + 0.09618403017520905, + 0.04024336859583855, + 1.014778945595026, + 0.1658629309386015, + 0.6958109736442566, + 0.0, + 0.08794543519616127, + 0.04335636645555496, + 0.0, + 0.0, + 0.0, + 0.3882627785205841, + 0.4908016212284565, + 0.05003279075026512, + 0.040987029671669006, + 0.43378059938549995, + 0.059502147138118744, + 0.10848614200949669, + 0.0, + 0.028487440198659897, + 0.05756206810474396, + 0.24992014467716217, + 0.6752328835427761, + 0.0, + 0.0, + 0.3315877802670002, + 0.0, + 0.060928452759981155, + 0.0, + 0.040179722011089325, + 0.4620033800601959, + 0.04979507252573967, + 0.18255461007356644, + 0.10104109905660152, + 0.026973461732268333, + 0.0511891134083271, + 0.26080285385251045, + 0.09120598435401917, + 0.0, + 0.34437209367752075, + 0.04914524778723717, + 0.0, + 0.1168062835931778, + 0.11272673308849335, + 0.0, + 0.0, + 0.09745429828763008, + 0.3276950567960739, + 0.14507398381829262, + 0.0, + 0.19700903818011284, + 0.20696117728948593, + 0.28278468176722527, + 0.0, + 0.0527997650206089, + 0.2977805621922016, + 0.6553599163889885, + 0.0, + 0.4074892923235893, + 0.0, + 0.19392697140574455, + 0.0, + 0.10143113136291504 + ], + "unique_experts": 46, + "load_cv": 1.0081582776486193, + "normalized_load_entropy": 0.8715263062845253, + "max_load_share": 0.06521739130434782 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "4040c53c916c1b9cbbb0d986f0c38f226c7798f97934f170f27ca403c49e0531", + "route_weight_sha256": "49d5588bb65e499cde3a80df3508bc62b6b8c080053b086ea4a6e988b29bfe9f", + "loads": [ + 4, + 2, + 1, + 10, + 5, + 6, + 0, + 3, + 7, + 0, + 0, + 0, + 10, + 7, + 1, + 1, + 14, + 1, + 2, + 0, + 1, + 2, + 3, + 11, + 0, + 0, + 6, + 7, + 17, + 12, + 3, + 11, + 2, + 4, + 3, + 8, + 1, + 7, + 18, + 0, + 5, + 6, + 4, + 6, + 4, + 1, + 0, + 7, + 9, + 3, + 1, + 3, + 4, + 4, + 0, + 1, + 6, + 11, + 0, + 7, + 0, + 8, + 3, + 5 + ], + "weighted_loads": [ + 0.2142561860382557, + 0.09618403017520905, + 0.04024336859583855, + 1.1389610012993217, + 0.8361970521509647, + 0.6958109736442566, + 0.0, + 0.16333256289362907, + 0.47660138830542564, + 0.0, + 0.0, + 0.0, + 0.735393337905407, + 0.4908016212284565, + 0.05003279075026512, + 0.040987029671669006, + 0.7268702164292336, + 0.059502147138118744, + 0.10848614200949669, + 0.0, + 0.028487440198659897, + 0.05756206810474396, + 0.29763099551200867, + 1.2426572553813457, + 0.0, + 0.0, + 0.40705613419413567, + 0.3976475317031145, + 1.9529047943651676, + 1.6185556389391422, + 0.10259903687983751, + 0.8727016896009445, + 0.09608664736151695, + 0.2242925502359867, + 0.10104109905660152, + 0.5213481280952692, + 0.0511891134083271, + 0.3740982413291931, + 1.618681538850069, + 0.0, + 0.34437209367752075, + 0.5506250262260437, + 0.2748106122016907, + 0.3259297348558903, + 0.16188614442944527, + 0.03696048632264137, + 0.0, + 0.3688732422888279, + 0.568016767501831, + 0.14507398381829262, + 0.012954654172062874, + 0.19700903818011284, + 0.20696117728948593, + 0.28278468176722527, + 0.0, + 0.0527997650206089, + 0.4002184998244047, + 0.7283916436135769, + 0.0, + 0.5511986147612333, + 0.0, + 0.35328475572168827, + 0.11813478171825409, + 0.20096289366483688 + ], + "unique_experts": 52, + "load_cv": 0.9468922527255172, + "normalized_load_entropy": 0.8885244890963198, + "max_load_share": 0.0625 + } + }, + "s1_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "ba7b22983a32aa9969cba20c2c7df0174e5189122eed370890c7283a4927675f", + "route_weight_sha256": "ccd59d2d5c931028aae221ec7b4f9a8698a1ed6f939085b700b6aada5cc51379", + "loads": [ + 3, + 2, + 1, + 5, + 2, + 6, + 0, + 3, + 1, + 0, + 0, + 0, + 4, + 7, + 2, + 0, + 7, + 1, + 2, + 0, + 1, + 1, + 2, + 3, + 1, + 0, + 4, + 0, + 1, + 0, + 1, + 5, + 1, + 3, + 3, + 2, + 1, + 3, + 2, + 0, + 6, + 1, + 0, + 2, + 4, + 0, + 0, + 2, + 4, + 3, + 0, + 2, + 4, + 4, + 0, + 1, + 4, + 10, + 0, + 4, + 0, + 5, + 0, + 2 + ], + "weighted_loads": [ + 0.16892537474632263, + 0.09452328085899353, + 0.03857190161943436, + 0.9628201834857464, + 0.18103131838142872, + 0.7236554473638535, + 0.0, + 0.12975292280316353, + 0.04287495091557503, + 0.0, + 0.0, + 0.0, + 0.4031512476503849, + 0.49736202508211136, + 0.09054955467581749, + 0.0, + 0.34078571014106274, + 0.06073135510087013, + 0.10534373298287392, + 0.0, + 0.03146635740995407, + 0.02410413697361946, + 0.25576765835285187, + 0.6958537921309471, + 0.04591301083564758, + 0.0, + 0.32543071918189526, + 0.0, + 0.058857932686805725, + 0.0, + 0.041955944150686264, + 0.45572033524513245, + 0.052266642451286316, + 0.17510635033249855, + 0.10705521702766418, + 0.0627765953540802, + 0.04785402864217758, + 0.25352237932384014, + 0.09153052791953087, + 0.0, + 0.3911733590066433, + 0.050403039902448654, + 0.0, + 0.08025781810283661, + 0.14521266892552376, + 0.0, + 0.0, + 0.09943670406937599, + 0.30320296064019203, + 0.1367521546781063, + 0.0, + 0.1472751572728157, + 0.2069668211042881, + 0.28637780249118805, + 0.0, + 0.0565236359834671, + 0.28153612464666367, + 0.7088104411959648, + 0.0, + 0.40481235831975937, + 0.0, + 0.22841790691018105, + 0.0, + 0.09927735850214958 + ], + "unique_experts": 46, + "load_cv": 0.9947351429505635, + "normalized_load_entropy": 0.8735766198437183, + "max_load_share": 0.07246376811594203 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "8f4080d2609be53a1d310af9515891f38e0a684bfa81bf571fec8c1b08815f0b", + "route_weight_sha256": "4e6502a6051c7780dc8f00096dbbe98b44cf9d68db19b0ba176f61760d0a675f", + "loads": [ + 7, + 2, + 1, + 7, + 5, + 6, + 0, + 8, + 7, + 3, + 1, + 0, + 9, + 7, + 2, + 0, + 13, + 3, + 3, + 0, + 1, + 3, + 5, + 9, + 1, + 0, + 7, + 7, + 18, + 19, + 12, + 10, + 5, + 7, + 8, + 9, + 1, + 7, + 22, + 0, + 7, + 12, + 6, + 8, + 16, + 4, + 2, + 10, + 11, + 3, + 2, + 2, + 4, + 7, + 0, + 2, + 6, + 17, + 0, + 8, + 2, + 13, + 5, + 2 + ], + "weighted_loads": [ + 0.3612965811043978, + 0.09452328085899353, + 0.03857190161943436, + 1.0173620535060763, + 0.8544474150985479, + 0.7236554473638535, + 0.0, + 0.3889466505497694, + 0.6017337329685688, + 0.31960856169462204, + 0.04405001550912857, + 0.0, + 0.7378242760896683, + 0.49736202508211136, + 0.09054955467581749, + 0.0, + 0.7237128335982561, + 0.17467085644602776, + 0.14094480499625206, + 0.0, + 0.03146635740995407, + 0.11482096463441849, + 0.37833042815327644, + 1.1491017378866673, + 0.04591301083564758, + 0.0, + 0.4465926643460989, + 0.3722468428313732, + 2.3892055936157703, + 2.583335217088461, + 0.9026856319978833, + 0.7878946214914322, + 0.22931154817342758, + 0.4171084240078926, + 0.3615916669368744, + 0.6375872287899256, + 0.04785402864217758, + 0.4261890295892954, + 1.9345327951014042, + 0.0, + 0.4207311291247606, + 1.0825608931481838, + 0.3703899160027504, + 0.3970123566687107, + 1.301336944103241, + 0.3105485215783119, + 0.08733611181378365, + 0.5435016229748726, + 0.7156179361045361, + 0.1367521546781063, + 0.06547838635742664, + 0.1472751572728157, + 0.2069668211042881, + 0.445353414863348, + 0.0, + 0.08784226700663567, + 0.34067058376967907, + 1.004393219947815, + 0.0, + 0.5561286266893148, + 0.07014894858002663, + 0.6281420178711414, + 0.22023938223719597, + 0.09927735850214958 + ], + "unique_experts": 56, + "load_cv": 0.8508574106942558, + "normalized_load_entropy": 0.9095807192656269, + "max_load_share": 0.057291666666666664 + } + }, + "s0_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "a4c82b50d47adfc15264f36b5dc1f001edc5ac4add5e9a2f073b10aa1846423a", + "route_weight_sha256": "a7b0c5d4ec8c1a08c3914cf9840d9674460cc0b8d534f6fafac7f40040f48986", + "loads": [ + 3, + 2, + 1, + 5, + 2, + 6, + 0, + 3, + 1, + 0, + 0, + 0, + 4, + 7, + 2, + 1, + 6, + 1, + 2, + 0, + 1, + 1, + 2, + 3, + 1, + 0, + 4, + 0, + 1, + 0, + 1, + 6, + 1, + 3, + 3, + 1, + 1, + 4, + 2, + 0, + 5, + 2, + 0, + 2, + 4, + 0, + 0, + 2, + 4, + 3, + 0, + 4, + 4, + 3, + 0, + 1, + 4, + 8, + 1, + 4, + 0, + 4, + 0, + 2 + ], + "weighted_loads": [ + 0.16651185229420662, + 0.09991942346096039, + 0.04085996001958847, + 1.0001590326428413, + 0.17074132524430752, + 0.7359180226922035, + 0.0, + 0.1282106302678585, + 0.043639376759529114, + 0.0, + 0.0, + 0.0, + 0.37755321711301804, + 0.46435270085930824, + 0.0858873650431633, + 0.04608282446861267, + 0.32764707878232, + 0.062488675117492676, + 0.10856182500720024, + 0.0, + 0.030349839478731155, + 0.032791558653116226, + 0.2399366870522499, + 0.7152082026004791, + 0.047161392867565155, + 0.0, + 0.3193751312792301, + 0.0, + 0.058416564017534256, + 0.0, + 0.04350057244300842, + 0.4757751189172268, + 0.04777500405907631, + 0.17047134786844254, + 0.10078063793480396, + 0.02721196599304676, + 0.05187654867768288, + 0.2887756787240505, + 0.10043371841311455, + 0.0, + 0.3400341644883156, + 0.08808155730366707, + 0.0, + 0.08214592561125755, + 0.14524870365858078, + 0.0, + 0.0, + 0.09671063348650932, + 0.2911793813109398, + 0.16087355464696884, + 0.0, + 0.2489398680627346, + 0.2034154012799263, + 0.2455860823392868, + 0.0, + 0.041629988700151443, + 0.28889599815011024, + 0.636087566614151, + 0.04306582733988762, + 0.3967939093708992, + 0.0, + 0.2118869051337242, + 0.0, + 0.10303523391485214 + ], + "unique_experts": 48, + "load_cv": 0.91740389670136, + "normalized_load_entropy": 0.8868261740386298, + "max_load_share": 0.057971014492753624 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "7fcea4c99213aea8b3ee1ad0d2d23d6aeb05751c65b23c178c22c9c90f159247", + "route_weight_sha256": "5a15b41f919bd710d36e21d2c1a7843e3b1b627b99dd4916ef8fe74b049183eb", + "loads": [ + 3, + 2, + 1, + 9, + 5, + 6, + 0, + 6, + 7, + 0, + 0, + 0, + 9, + 7, + 2, + 1, + 9, + 1, + 2, + 0, + 1, + 1, + 3, + 12, + 1, + 0, + 5, + 8, + 19, + 10, + 4, + 11, + 2, + 5, + 3, + 9, + 1, + 8, + 17, + 0, + 5, + 7, + 5, + 3, + 5, + 2, + 1, + 7, + 8, + 3, + 1, + 4, + 4, + 3, + 0, + 1, + 6, + 9, + 1, + 6, + 0, + 9, + 3, + 5 + ], + "weighted_loads": [ + 0.16651185229420662, + 0.09991942346096039, + 0.04085996001958847, + 1.124341088347137, + 0.8410754464566708, + 0.7359180226922035, + 0.0, + 0.2979862205684185, + 0.42262276634573936, + 0.0, + 0.0, + 0.0, + 0.651161577552557, + 0.46435270085930824, + 0.0858873650431633, + 0.04608282446861267, + 0.5310556814074516, + 0.062488675117492676, + 0.10856182500720024, + 0.0, + 0.030349839478731155, + 0.032791558653116226, + 0.2876475378870964, + 1.4317534305155277, + 0.047161392867565155, + 0.0, + 0.35214072465896606, + 0.4539652857929468, + 2.2234811186790466, + 1.199397262185812, + 0.1515819625928998, + 0.8790344297885895, + 0.09406657889485359, + 0.2513653412461281, + 0.10078063793480396, + 0.5965929832309484, + 0.05187654867768288, + 0.4020710662007332, + 1.444169469177723, + 0.0, + 0.3400341644883156, + 0.6035627909004688, + 0.33762386441230774, + 0.17578047141432762, + 0.1944081149995327, + 0.08926327154040337, + 0.05348530039191246, + 0.36643723025918007, + 0.5532434172928333, + 0.16087355464696884, + 0.012954654172062874, + 0.2489398680627346, + 0.2034154012799263, + 0.2455860823392868, + 0.0, + 0.041629988700151443, + 0.39133393578231335, + 0.6762770935893059, + 0.04306582733988762, + 0.48181398026645184, + 0.0, + 0.44403435103595257, + 0.11813478171825409, + 0.202566996216774 + ], + "unique_experts": 55, + "load_cv": 0.9018157267082181, + "normalized_load_entropy": 0.9005067400735862, + "max_load_share": 0.06597222222222222 + } + }, + "s1_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "324d27f64f1236b41ec42d9b8c3b2cf78b4e3ae93b4c4617d268559940720247", + "route_weight_sha256": "d751014174e02676b05f53d0c1712c41c35fe5a02aa5922f8973f7889a89e93c", + "loads": [ + 3, + 2, + 1, + 6, + 2, + 6, + 0, + 3, + 1, + 0, + 0, + 0, + 4, + 7, + 1, + 1, + 6, + 1, + 2, + 0, + 1, + 2, + 2, + 3, + 1, + 0, + 4, + 0, + 1, + 0, + 1, + 6, + 1, + 3, + 3, + 1, + 1, + 3, + 2, + 0, + 5, + 2, + 0, + 2, + 4, + 0, + 0, + 2, + 4, + 3, + 0, + 3, + 4, + 4, + 0, + 1, + 4, + 8, + 0, + 4, + 0, + 5, + 0, + 2 + ], + "weighted_loads": [ + 0.17626777291297913, + 0.09222116321325302, + 0.03598049655556679, + 1.0135700851678848, + 0.17065183445811272, + 0.7574212998151779, + 0.0, + 0.13259079679846764, + 0.04147082194685936, + 0.0, + 0.0, + 0.0, + 0.3379126526415348, + 0.5357520580291748, + 0.049426570534706116, + 0.04450688138604164, + 0.29784964956343174, + 0.06579883396625519, + 0.10234731808304787, + 0.0, + 0.03092345781624317, + 0.0635255966335535, + 0.2522863671183586, + 0.688484214246273, + 0.04776608571410179, + 0.0, + 0.3279542066156864, + 0.0, + 0.05728099122643471, + 0.0, + 0.046900659799575806, + 0.47356131114065647, + 0.048494186252355576, + 0.1522684097290039, + 0.10517013818025589, + 0.02562941052019596, + 0.04820826277136803, + 0.25512468814849854, + 0.10124151036143303, + 0.0, + 0.3681629076600075, + 0.09863417223095894, + 0.0, + 0.08538982644677162, + 0.14203310944139957, + 0.0, + 0.0, + 0.09829118847846985, + 0.27540988102555275, + 0.15535561367869377, + 0.0, + 0.1806853637099266, + 0.2063462845981121, + 0.2966332696378231, + 0.0, + 0.041544023901224136, + 0.2876746840775013, + 0.603622805327177, + 0.0, + 0.3791235089302063, + 0.0, + 0.25911693274974823, + 0.0, + 0.10024329274892807 + ], + "unique_experts": 47, + "load_cv": 0.9391259616998502, + "normalized_load_entropy": 0.8816756154559119, + "max_load_share": 0.057971014492753624 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "c125bbb5b72b6df20b930cdc84a3cebfab7db648141c50e5c2c0c6df9a0ebb02", + "route_weight_sha256": "41b3f05a74456a7de9022c130fb1945cccc6d337f2e2f6c01bff52620b7f0405", + "loads": [ + 7, + 2, + 1, + 8, + 5, + 6, + 0, + 9, + 7, + 3, + 1, + 0, + 8, + 7, + 1, + 1, + 10, + 3, + 3, + 0, + 1, + 5, + 5, + 10, + 1, + 0, + 8, + 8, + 20, + 15, + 13, + 10, + 5, + 7, + 8, + 9, + 1, + 7, + 21, + 0, + 6, + 13, + 7, + 6, + 16, + 5, + 3, + 9, + 11, + 3, + 2, + 3, + 4, + 7, + 0, + 2, + 5, + 16, + 0, + 7, + 2, + 14, + 5, + 2 + ], + "weighted_loads": [ + 0.36863897927105427, + 0.09222116321325302, + 0.03598049655556679, + 1.0681119551882148, + 0.8440679311752319, + 0.7574212998151779, + 0.0, + 0.4482007008045912, + 0.5089745745062828, + 0.31960856169462204, + 0.04405001550912857, + 0.0, + 0.5141204446554184, + 0.5357520580291748, + 0.049426570534706116, + 0.04450688138604164, + 0.5837512705475092, + 0.1797383353114128, + 0.137948390096426, + 0.0, + 0.03092345781624317, + 0.18518813140690327, + 0.3748491369187832, + 1.2730942852795124, + 0.04776608571410179, + 0.0, + 0.48185108229517937, + 0.4482506550848484, + 2.567705176770687, + 1.8993999175727367, + 0.9550083288922906, + 0.8115452770143747, + 0.22553909197449684, + 0.39427048340439796, + 0.3597065880894661, + 0.6994872055947781, + 0.04820826277136803, + 0.4277913384139538, + 1.607896190136671, + 0.0, + 0.3977206777781248, + 1.1943927146494389, + 0.4658784419298172, + 0.2861827202141285, + 1.2981573846191168, + 0.35174690559506416, + 0.14496587589383125, + 0.435318261384964, + 0.6894536167383194, + 0.15535561367869377, + 0.06547838635742664, + 0.1806853637099266, + 0.2063462845981121, + 0.45560888200998306, + 0.0, + 0.0728626549243927, + 0.3152916934341192, + 0.9625403024256229, + 0.0, + 0.4907281640917063, + 0.07014894858002663, + 0.7120066173374653, + 0.22023938223719597, + 0.10024329274892807 + ], + "unique_experts": 57, + "load_cv": 0.8239049972202163, + "normalized_load_entropy": 0.9144935057783861, + "max_load_share": 0.0546875 + } + }, + "s0_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "552e3b759087dc9abed9beb3c8149b3cd3d9c15ef3dca1ff52000793ab1475b5", + "route_weight_sha256": "7c8379a519a0f1d65bf6b9c1a44122138ead4f4301146fcc021a78b41cad2167", + "loads": [ + 3, + 2, + 1, + 6, + 2, + 6, + 0, + 3, + 1, + 0, + 0, + 0, + 4, + 7, + 1, + 1, + 6, + 1, + 2, + 0, + 1, + 2, + 2, + 3, + 1, + 0, + 4, + 0, + 1, + 0, + 1, + 6, + 1, + 3, + 3, + 1, + 1, + 3, + 2, + 0, + 5, + 2, + 0, + 2, + 4, + 0, + 0, + 2, + 4, + 3, + 0, + 4, + 4, + 3, + 0, + 1, + 4, + 8, + 1, + 4, + 0, + 4, + 0, + 2 + ], + "weighted_loads": [ + 0.16167156398296356, + 0.09724314883351326, + 0.0397670716047287, + 1.0342780835926533, + 0.1579706072807312, + 0.7313317134976387, + 0.0, + 0.12938721477985382, + 0.041045911610126495, + 0.0, + 0.0, + 0.0, + 0.38795626908540726, + 0.48464488238096237, + 0.04923969879746437, + 0.04526056721806526, + 0.3235705681145191, + 0.06169545650482178, + 0.11043308675289154, + 0.0, + 0.031682271510362625, + 0.05766081064939499, + 0.23901744186878204, + 0.7089431546628475, + 0.04701320454478264, + 0.0, + 0.32188090309500694, + 0.0, + 0.06284240633249283, + 0.0, + 0.042105525732040405, + 0.46654487773776054, + 0.04887114465236664, + 0.16234607249498367, + 0.10283416509628296, + 0.026638470590114594, + 0.052050285041332245, + 0.25861399061977863, + 0.11015753075480461, + 0.0, + 0.33507006242871284, + 0.09608400613069534, + 0.0, + 0.08766709640622139, + 0.14265869557857513, + 0.0, + 0.0, + 0.09565924853086472, + 0.29483989626169205, + 0.14873743802309036, + 0.0, + 0.24449555948376656, + 0.20601676404476166, + 0.2343565598130226, + 0.0, + 0.04188069701194763, + 0.29222287610173225, + 0.621707133948803, + 0.043020304292440414, + 0.39088810980319977, + 0.0, + 0.21542267873883247, + 0.0, + 0.10132618993520737 + ], + "unique_experts": 48, + "load_cv": 0.9247012835332911, + "normalized_load_entropy": 0.8860350846279371, + "max_load_share": 0.057971014492753624 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "5e0d88279a6061a56fdbc2219ac5e279cfeb0ea82ad2b9b88c5116d1c3ef84dd", + "route_weight_sha256": "261df27dcafcb3f8a85ccfc5fbb038835ed90341ab5e0ba51ff7816872bcd4e7", + "loads": [ + 3, + 2, + 1, + 10, + 5, + 6, + 0, + 6, + 7, + 0, + 0, + 0, + 9, + 7, + 1, + 1, + 10, + 1, + 2, + 0, + 1, + 2, + 3, + 12, + 1, + 0, + 5, + 8, + 18, + 10, + 3, + 11, + 2, + 5, + 3, + 9, + 1, + 7, + 17, + 0, + 5, + 8, + 5, + 3, + 5, + 1, + 2, + 7, + 7, + 3, + 1, + 4, + 4, + 3, + 0, + 1, + 7, + 8, + 1, + 6, + 0, + 9, + 4, + 5 + ], + "weighted_loads": [ + 0.16167156398296356, + 0.09724314883351326, + 0.0397670716047287, + 1.158460139296949, + 0.8283047284930944, + 0.7313317134976387, + 0.0, + 0.28753067553043365, + 0.4198247417807579, + 0.0, + 0.0, + 0.0, + 0.6662969812750816, + 0.48464488238096237, + 0.04923969879746437, + 0.04526056721806526, + 0.5728825144469738, + 0.06169545650482178, + 0.11043308675289154, + 0.0, + 0.031682271510362625, + 0.05766081064939499, + 0.28672829270362854, + 1.3383164443075657, + 0.04701320454478264, + 0.0, + 0.3546464964747429, + 0.4359850976616144, + 2.246441040188074, + 1.319131638854742, + 0.1045248406007886, + 0.8656030595302582, + 0.09516271948814392, + 0.24085461348295212, + 0.10283416509628296, + 0.5686942338943481, + 0.052050285041332245, + 0.3719093780964613, + 1.5024398155510426, + 0.0, + 0.33507006242871284, + 0.7144971638917923, + 0.320875845849514, + 0.18380461260676384, + 0.19181810691952705, + 0.03696048632264137, + 0.10105713084340096, + 0.3622462749481201, + 0.5044039189815521, + 0.14873743802309036, + 0.012954654172062874, + 0.24449555948376656, + 0.20601676404476166, + 0.2343565598130226, + 0.0, + 0.04188069701194763, + 0.42382737435400486, + 0.621707133948803, + 0.043020304292440414, + 0.4759081806987524, + 0.0, + 0.431312819942832, + 0.1676100641489029, + 0.2008579522371292 + ], + "unique_experts": 55, + "load_cv": 0.8940820521906157, + "normalized_load_entropy": 0.90109018449846, + "max_load_share": 0.0625 + } + }, + "s1_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "7e8b09edea4abfe6095bb5d72766754961e1eb211156ab74631f3d07e55e21c9", + "route_weight_sha256": "3def75fb110fa50ebc9ee8ebcd5b84ec10081a7759e7ac96fbfcd8364af28596", + "loads": [ + 3, + 2, + 1, + 6, + 2, + 6, + 0, + 3, + 2, + 0, + 0, + 0, + 4, + 8, + 1, + 1, + 7, + 1, + 2, + 0, + 1, + 2, + 2, + 3, + 1, + 0, + 4, + 0, + 1, + 0, + 1, + 6, + 1, + 3, + 3, + 1, + 1, + 2, + 2, + 0, + 5, + 2, + 0, + 2, + 2, + 0, + 0, + 2, + 4, + 3, + 0, + 3, + 4, + 4, + 0, + 1, + 4, + 8, + 0, + 4, + 0, + 5, + 0, + 2 + ], + "weighted_loads": [ + 0.1772470958530903, + 0.09517400711774826, + 0.03691418841481209, + 1.0316211730241776, + 0.17410061322152615, + 0.7547478079795837, + 0.0, + 0.13280954584479332, + 0.0804717019200325, + 0.0, + 0.0, + 0.0, + 0.34951914846897125, + 0.5953292325139046, + 0.048984188586473465, + 0.043879300355911255, + 0.32610406540334225, + 0.06264002621173859, + 0.10200108960270882, + 0.0, + 0.03130722790956497, + 0.06682379730045795, + 0.24928368628025055, + 0.6820230707526207, + 0.04590274766087532, + 0.0, + 0.31843882612884045, + 0.0, + 0.060957033187150955, + 0.0, + 0.04729299247264862, + 0.45543170161545277, + 0.049703437834978104, + 0.1615174114704132, + 0.1034916341304779, + 0.028242863714694977, + 0.047383733093738556, + 0.23519092798233032, + 0.10916953161358833, + 0.0, + 0.35285813361406326, + 0.10090694949030876, + 0.0, + 0.09122441709041595, + 0.06537232920527458, + 0.0, + 0.0, + 0.09729436039924622, + 0.26640039309859276, + 0.13771484047174454, + 0.0, + 0.180930957198143, + 0.20843670144677162, + 0.2877649776637554, + 0.0, + 0.04274355247616768, + 0.28635120019316673, + 0.5989822298288345, + 0.0, + 0.3713229224085808, + 0.0, + 0.2636561542749405, + 0.0, + 0.10030974820256233 + ], + "unique_experts": 47, + "load_cv": 0.9638498385314669, + "normalized_load_entropy": 0.8795797972270356, + "max_load_share": 0.057971014492753624 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "b5e2ad62b2c113819735225f43e630782efc8be88c087d6a1cd801757541672e", + "route_weight_sha256": "2fa8423fccee1b9d8e0ac61a65aab0504dcca808cfe4dfda6d10fce3964d30ff", + "loads": [ + 7, + 2, + 1, + 8, + 5, + 6, + 0, + 11, + 8, + 3, + 1, + 0, + 7, + 8, + 1, + 1, + 11, + 3, + 3, + 0, + 1, + 4, + 5, + 10, + 1, + 0, + 8, + 7, + 20, + 15, + 12, + 10, + 5, + 7, + 8, + 9, + 1, + 6, + 22, + 0, + 6, + 14, + 8, + 6, + 14, + 4, + 4, + 9, + 11, + 3, + 2, + 3, + 4, + 7, + 0, + 2, + 5, + 14, + 0, + 7, + 2, + 14, + 6, + 2 + ], + "weighted_loads": [ + 0.36961830221116543, + 0.09517400711774826, + 0.03691418841481209, + 1.0861630430445075, + 0.8475167099386454, + 0.7547478079795837, + 0.0, + 0.5240063760429621, + 0.5482997223734856, + 0.31960856169462204, + 0.04405001550912857, + 0.0, + 0.47350579500198364, + 0.5953292325139046, + 0.048984188586473465, + 0.043879300355911255, + 0.6323258075863123, + 0.1765795275568962, + 0.13760216161608696, + 0.0, + 0.03130722790956497, + 0.15754062496125698, + 0.3718464560806751, + 1.1857442893087864, + 0.04590274766087532, + 0.0, + 0.4723312798887491, + 0.3722468428313732, + 2.6279702112078667, + 1.9281716123223305, + 0.9080226803198457, + 0.800588907673955, + 0.22674834355711937, + 0.40351948514580727, + 0.3580280840396881, + 0.6577834505587816, + 0.047383733093738556, + 0.40785757824778557, + 1.6570405326783657, + 0.0, + 0.3824159037321806, + 1.2806791178882122, + 0.5158507376909256, + 0.28862638771533966, + 1.2214966043829918, + 0.3105485215783119, + 0.2047317773103714, + 0.4313310869038105, + 0.676508154720068, + 0.13771484047174454, + 0.06547838635742664, + 0.180930957198143, + 0.20843670144677162, + 0.4467405900359154, + 0.0, + 0.07406218349933624, + 0.31396820954978466, + 0.862439040094614, + 0.0, + 0.48292757757008076, + 0.07014894858002663, + 0.7171653211116791, + 0.25688452273607254, + 0.10030974820256233 + ], + "unique_experts": 57, + "load_cv": 0.8207381501496753, + "normalized_load_entropy": 0.914893889624909, + "max_load_share": 0.057291666666666664 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "ordered_topk_exact_tokens": 19, + "set_exact_tokens": 20, + "mean_set_jaccard": 0.9534161490683231, + "mean_token_weighted_tv": 0.01285028971893632, + "aggregate_load_tv": 0.028985507246376812 + }, + "system_bos": { + "tokens": 23, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.9037267080745341, + "mean_token_weighted_tv": 0.0231421093011032, + "aggregate_load_tv": 0.05797101449275363 + }, + "system_x": { + "tokens": 23, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.9503105590062113, + "mean_token_weighted_tv": 0.01973556585447944, + "aggregate_load_tv": 0.028985507246376815 + }, + "system_period": { + "tokens": 23, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 18, + "mean_set_jaccard": 0.9378881987577639, + "mean_token_weighted_tv": 0.02211921289563179, + "aggregate_load_tv": 0.036231884057971016 + }, + "bos_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.9006211180124223, + "mean_token_weighted_tv": 0.024488086771705875, + "aggregate_load_tv": 0.057971014492753624 + }, + "bos_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 18, + "mean_set_jaccard": 0.9378881987577639, + "mean_token_weighted_tv": 0.020092403516173363, + "aggregate_load_tv": 0.03623188405797102 + }, + "x_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.9409937888198759, + "mean_token_weighted_tv": 0.022084388153060623, + "aggregate_load_tv": 0.036231884057971016 + }, + "x_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.9130434782608695, + "mean_token_weighted_tv": 0.027408705214443413, + "aggregate_load_tv": 0.050724637681159424 + }, + "period_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.9409937888198759, + "mean_token_weighted_tv": 0.022820983082056046, + "aggregate_load_tv": 0.036231884057971016 + }, + "period_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.888198757763975, + "mean_token_weighted_tv": 0.031206967349609604, + "aggregate_load_tv": 0.06521739130434782 + } + } + }, + "layer_13": { + "layer": 13, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "347a54b7f7d612cf25249e4c683369df030332c2462c9c5a200d9d45148f2df5", + "route_weight_sha256": "48ecd5773e5950b34ebfa3f291258189c565a86541acd46c104e4a9ba0dd68fb", + "loads": [ + 3, + 1, + 0, + 0, + 0, + 4, + 14, + 0, + 0, + 1, + 3, + 0, + 0, + 2, + 8, + 3, + 1, + 1, + 1, + 1, + 0, + 3, + 5, + 0, + 0, + 0, + 9, + 2, + 3, + 0, + 0, + 1, + 1, + 2, + 1, + 4, + 0, + 1, + 1, + 0, + 0, + 3, + 4, + 0, + 0, + 2, + 2, + 7, + 0, + 0, + 8, + 0, + 2, + 2, + 2, + 0, + 0, + 3, + 9, + 1, + 1, + 4, + 3, + 9 + ], + "weighted_loads": [ + 0.10762865282595158, + 0.03764505311846733, + 0.0, + 0.0, + 0.0, + 0.2181466482579708, + 1.079337041825056, + 0.0, + 0.0, + 0.02943781204521656, + 0.10739862732589245, + 0.0, + 0.0, + 0.24118024110794067, + 0.8939077444374561, + 0.11086684837937355, + 0.044653233140707016, + 0.031041420996189117, + 0.02638055384159088, + 0.029853608459234238, + 0.0, + 0.13161875680088997, + 0.3316824361681938, + 0.0, + 0.0, + 0.0, + 0.5015861950814724, + 0.14229194819927216, + 0.09808221645653248, + 0.0, + 0.0, + 0.04433194547891617, + 0.02431575581431389, + 0.08117084950208664, + 0.19805699586868286, + 0.3198679983615875, + 0.0, + 0.031857773661613464, + 0.03649063780903816, + 0.0, + 0.0, + 0.20517623052001, + 0.3082461580634117, + 0.0, + 0.0, + 0.1724480465054512, + 0.08503275737166405, + 0.24350639432668686, + 0.0, + 0.0, + 0.4815439432859421, + 0.0, + 0.10065338388085365, + 0.07938964292407036, + 0.07876026257872581, + 0.0, + 0.0, + 0.1341780610382557, + 1.2729994878172874, + 0.029219187796115875, + 0.05277027189731598, + 0.21371963247656822, + 0.18317805230617523, + 0.5409268401563168 + ], + "unique_experts": 41, + "load_cv": 1.327571039351288, + "normalized_load_entropy": 0.8173734373689502, + "max_load_share": 0.10144927536231885 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "ee3c699e7364abf4312037d0883a98894d7ef451ea6f540e27436a5d85985bd8", + "route_weight_sha256": "c5a27e30d5417c5d9e87bc0262b6c620e4510eca115194d259864f04a9359885", + "loads": [ + 3, + 7, + 0, + 0, + 0, + 5, + 33, + 0, + 0, + 4, + 14, + 6, + 0, + 2, + 9, + 9, + 1, + 3, + 2, + 2, + 0, + 4, + 5, + 0, + 4, + 0, + 12, + 2, + 3, + 14, + 0, + 1, + 1, + 9, + 2, + 4, + 4, + 2, + 1, + 1, + 0, + 5, + 6, + 2, + 10, + 12, + 4, + 9, + 1, + 0, + 9, + 0, + 6, + 5, + 4, + 0, + 3, + 3, + 15, + 6, + 1, + 5, + 3, + 10 + ], + "weighted_loads": [ + 0.10762865282595158, + 0.33423376455903053, + 0.0, + 0.0, + 0.0, + 0.24920915625989437, + 2.839528188109398, + 0.0, + 0.0, + 0.1422628853470087, + 0.8617876097559929, + 0.2705205441452563, + 0.0, + 0.24118024110794067, + 0.9393086954951286, + 0.42302563786506653, + 0.044653233140707016, + 0.0792785631492734, + 0.067670539021492, + 0.07165060564875603, + 0.0, + 0.16406575217843056, + 0.3316824361681938, + 0.0, + 0.1351856729015708, + 0.0, + 0.6286388896405697, + 0.14229194819927216, + 0.09808221645653248, + 0.9879368096590042, + 0.0, + 0.04433194547891617, + 0.02431575581431389, + 0.6882221288979053, + 0.22092837281525135, + 0.3198679983615875, + 0.19767536781728268, + 0.0655343234539032, + 0.03649063780903816, + 0.03561369329690933, + 0.0, + 0.29967112094163895, + 0.4107743799686432, + 0.09470513835549355, + 0.9070617072284222, + 1.1392522417008877, + 0.15215302258729935, + 1.4353336915373802, + 0.03200826048851013, + 0.0, + 0.518225759267807, + 0.0, + 0.2417331300675869, + 0.22111764550209045, + 0.1669634934514761, + 0.0, + 0.168011624366045, + 0.1341780610382557, + 1.5511530973017216, + 0.2720947563648224, + 0.05277027189731598, + 0.24339192733168602, + 0.18317805230617523, + 0.5786673091351986 + ], + "unique_experts": 50, + "load_cv": 1.1856914428007248, + "normalized_load_entropy": 0.8610368627823967, + "max_load_share": 0.11458333333333333 + } + }, + "s1_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "b0c57fbb3190b2bfd7bccaa22c4cb38aa82f7c9a9e66f84e54fca54417389be2", + "route_weight_sha256": "9703ed71bd7ee62d442e32c716d7fad32c72d106e9051e1e1cfc11ac755990fa", + "loads": [ + 3, + 2, + 0, + 0, + 0, + 4, + 14, + 0, + 0, + 1, + 3, + 0, + 0, + 2, + 8, + 3, + 1, + 0, + 1, + 0, + 0, + 3, + 6, + 0, + 0, + 0, + 9, + 2, + 1, + 0, + 0, + 1, + 0, + 2, + 1, + 6, + 1, + 1, + 1, + 0, + 0, + 3, + 4, + 0, + 0, + 2, + 2, + 7, + 0, + 0, + 8, + 0, + 2, + 2, + 2, + 0, + 0, + 3, + 9, + 1, + 1, + 3, + 4, + 9 + ], + "weighted_loads": [ + 0.10639042779803276, + 0.06715260073542595, + 0.0, + 0.0, + 0.0, + 0.21849378943443298, + 1.046197883784771, + 0.0, + 0.0, + 0.029737595468759537, + 0.10882280208170414, + 0.0, + 0.0, + 0.23725884407758713, + 0.891242727637291, + 0.10891512036323547, + 0.0424816757440567, + 0.0, + 0.027806008234620094, + 0.0, + 0.0, + 0.13209808245301247, + 0.3628485705703497, + 0.0, + 0.0, + 0.0, + 0.4889045227319002, + 0.14213211461901665, + 0.03672946244478226, + 0.0, + 0.0, + 0.0434560626745224, + 0.0, + 0.08038507029414177, + 0.20403552055358887, + 0.38356004282832146, + 0.02526222914457321, + 0.03145534172654152, + 0.03364944085478783, + 0.0, + 0.0, + 0.20462001487612724, + 0.3215077668428421, + 0.0, + 0.0, + 0.17900285869836807, + 0.08240818604826927, + 0.24892190843820572, + 0.0, + 0.0, + 0.4683682285249233, + 0.0, + 0.10261645913124084, + 0.07914796657860279, + 0.07768275961279869, + 0.0, + 0.0, + 0.12505783885717392, + 1.2764235585927963, + 0.03145831078290939, + 0.05062674731016159, + 0.1767597608268261, + 0.22164836898446083, + 0.5285563245415688 + ], + "unique_experts": 39, + "load_cv": 1.3576082605213908, + "normalized_load_entropy": 0.8069205122094651, + "max_load_share": 0.10144927536231885 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "de5330567c4f92aec7f747d8b666e0d95e8ad4e044a41cc631603bfdbabec09a", + "route_weight_sha256": "6113c9203ae357c87547b2b8b44ba9d6d4a7a4f07648ab6205870e698a86029e", + "loads": [ + 8, + 8, + 0, + 0, + 0, + 5, + 44, + 0, + 0, + 4, + 14, + 12, + 0, + 2, + 9, + 10, + 1, + 2, + 3, + 3, + 0, + 7, + 6, + 3, + 4, + 0, + 13, + 2, + 1, + 19, + 7, + 2, + 0, + 14, + 4, + 7, + 6, + 2, + 2, + 1, + 2, + 8, + 12, + 2, + 16, + 13, + 3, + 10, + 2, + 5, + 9, + 0, + 5, + 4, + 4, + 2, + 3, + 14, + 17, + 5, + 2, + 5, + 4, + 12 + ], + "weighted_loads": [ + 0.3082686923444271, + 0.3874041363596916, + 0.0, + 0.0, + 0.0, + 0.25468312948942184, + 3.6555321719497442, + 0.0, + 0.0, + 0.1724429875612259, + 0.8313901592046022, + 0.7780139478854835, + 0.0, + 0.23725884407758713, + 0.9348619468510151, + 0.47667016088962555, + 0.0424816757440567, + 0.05292109679430723, + 0.0963260568678379, + 0.12280135601758957, + 0.0, + 0.32476277090609074, + 0.3628485705703497, + 0.12172871828079224, + 0.156082050409168, + 0.0, + 0.6464884895831347, + 0.14213211461901665, + 0.03672946244478226, + 1.6611144058406353, + 0.39069513976573944, + 0.08325839415192604, + 0.0, + 1.208255559206009, + 0.4292806703597307, + 0.4345775246620178, + 0.3174432534724474, + 0.0648152232170105, + 0.07561490684747696, + 0.04302026703953743, + 0.08159289509057999, + 0.42644723132252693, + 0.9865793474018574, + 0.11164906993508339, + 1.3913220688700676, + 1.1409285739064217, + 0.12443449720740318, + 1.4777874536812305, + 0.25383568555116653, + 0.24627847969532013, + 0.5031712874770164, + 0.0, + 0.20714770630002022, + 0.16182280518114567, + 0.1479109488427639, + 0.07155315577983856, + 0.155318982899189, + 0.8328640349209309, + 1.6301598362624645, + 0.22676437720656395, + 0.07927880994975567, + 0.2638652678579092, + 0.22164836898446083, + 0.645381473004818 + ], + "unique_experts": 54, + "load_cv": 1.1376602451230038, + "normalized_load_entropy": 0.8766233825510312, + "max_load_share": 0.11458333333333333 + } + }, + "s0_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "c08fdd2b365f7f647969ab990404a0882c0bfa0e4f06fd6e65d5c6814840da3a", + "route_weight_sha256": "3fbbf751ef679a89b914dedcbd4f0d186fbefaa01f529d411d20c7760191f1fe", + "loads": [ + 3, + 1, + 0, + 0, + 0, + 4, + 14, + 0, + 0, + 0, + 3, + 1, + 0, + 2, + 8, + 3, + 1, + 1, + 1, + 1, + 0, + 3, + 6, + 0, + 0, + 0, + 9, + 2, + 1, + 0, + 0, + 1, + 0, + 2, + 1, + 5, + 0, + 1, + 1, + 0, + 0, + 4, + 4, + 0, + 0, + 2, + 2, + 6, + 0, + 0, + 8, + 0, + 2, + 2, + 3, + 0, + 0, + 3, + 9, + 1, + 1, + 3, + 4, + 9 + ], + "weighted_loads": [ + 0.10475825890898705, + 0.03991730511188507, + 0.0, + 0.0, + 0.0, + 0.21474717184901237, + 1.0130997505038977, + 0.0, + 0.0, + 0.0, + 0.10591588169336319, + 0.0235760360956192, + 0.0, + 0.235576793551445, + 0.8582163266837597, + 0.10917918756604195, + 0.04502927139401436, + 0.0307710412889719, + 0.024885354563593864, + 0.02997143380343914, + 0.0, + 0.13053162768483162, + 0.36109356582164764, + 0.0, + 0.0, + 0.0, + 0.5169082209467888, + 0.14455927908420563, + 0.037829309701919556, + 0.0, + 0.0, + 0.04311726242303848, + 0.0, + 0.08074945583939552, + 0.19728076457977295, + 0.3518297038972378, + 0.0, + 0.031296256929636, + 0.03269743174314499, + 0.0, + 0.0, + 0.23939995095133781, + 0.32416723296046257, + 0.0, + 0.0, + 0.18302127718925476, + 0.08657865598797798, + 0.2173697054386139, + 0.0, + 0.0, + 0.4516556151211262, + 0.0, + 0.10422837734222412, + 0.0807034857571125, + 0.0975797176361084, + 0.0, + 0.0, + 0.12580625712871552, + 1.3224833495914936, + 0.03001592308282852, + 0.04690397530794144, + 0.17870868369936943, + 0.22196362912654877, + 0.5851098448038101 + ], + "unique_experts": 40, + "load_cv": 1.3401683661904016, + "normalized_load_entropy": 0.8118019662915502, + "max_load_share": 0.10144927536231885 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "9b51f44a70af4d701608c40fb839d73b5ce75d84637d0945292eb3124270f258", + "route_weight_sha256": "7c7df16e373f80f5c1a25856b9752b5adebae60a32e82a12cbf1e01ec3922da8", + "loads": [ + 3, + 6, + 1, + 0, + 1, + 6, + 33, + 0, + 0, + 5, + 13, + 5, + 0, + 2, + 8, + 9, + 1, + 2, + 2, + 2, + 0, + 5, + 6, + 0, + 3, + 0, + 12, + 2, + 1, + 14, + 0, + 1, + 0, + 7, + 2, + 5, + 3, + 2, + 1, + 1, + 0, + 6, + 6, + 3, + 10, + 13, + 4, + 7, + 1, + 0, + 9, + 0, + 6, + 6, + 6, + 0, + 4, + 3, + 15, + 6, + 1, + 4, + 4, + 10 + ], + "weighted_loads": [ + 0.10475825890898705, + 0.305685892701149, + 0.06857357919216156, + 0.0, + 0.047575633972883224, + 0.2958314996212721, + 2.7599066067487, + 0.0, + 0.0, + 0.23377524316310883, + 0.7354861814528704, + 0.25811322405934334, + 0.0, + 0.235576793551445, + 0.8582163266837597, + 0.4213379770517349, + 0.04502927139401436, + 0.065974535420537, + 0.06617533974349499, + 0.07176843099296093, + 0.0, + 0.21216583997011185, + 0.36109356582164764, + 0.0, + 0.13939638063311577, + 0.0, + 0.6439609155058861, + 0.14455927908420563, + 0.037829309701919556, + 0.8981127701699734, + 0.0, + 0.04311726242303848, + 0.0, + 0.5865962319076061, + 0.22015214152634144, + 0.3518297038972378, + 0.15274706669151783, + 0.06497280672192574, + 0.03269743174314499, + 0.03561369329690933, + 0.0, + 0.33890780806541443, + 0.45060084760189056, + 0.17822496220469475, + 0.8482858054339886, + 1.1873957812786102, + 0.15369892120361328, + 0.5781069695949554, + 0.03200826048851013, + 0.0, + 0.4883374311029911, + 0.0, + 0.24530812352895737, + 0.2875402048230171, + 0.22310134954750538, + 0.0, + 0.284402821213007, + 0.12580625712871552, + 1.5985737834125757, + 0.27289149165153503, + 0.04690397530794144, + 0.20838097855448723, + 0.22196362912654877, + 0.622850313782692 + ], + "unique_experts": 51, + "load_cv": 1.1752331000725655, + "normalized_load_entropy": 0.86385123187111, + "max_load_share": 0.11458333333333333 + } + }, + "s1_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "a5d576db3bef3949fa1b9f0e99fd4653f366bb61739e8e1e3f76366ae58a31f4", + "route_weight_sha256": "3be5ba92645590083924a033434692b7b39051efc1a0a9fdcfa63c5906483911", + "loads": [ + 3, + 2, + 0, + 0, + 0, + 4, + 14, + 0, + 0, + 0, + 3, + 1, + 0, + 2, + 9, + 3, + 1, + 1, + 1, + 0, + 0, + 3, + 6, + 0, + 0, + 0, + 7, + 2, + 1, + 0, + 0, + 1, + 1, + 1, + 1, + 6, + 0, + 1, + 1, + 0, + 1, + 4, + 4, + 0, + 0, + 3, + 1, + 6, + 0, + 0, + 8, + 0, + 2, + 2, + 2, + 0, + 0, + 3, + 9, + 1, + 1, + 3, + 4, + 9 + ], + "weighted_loads": [ + 0.10513738915324211, + 0.07457319274544716, + 0.0, + 0.0, + 0.0, + 0.22451551631093025, + 0.9563186168670654, + 0.0, + 0.0, + 0.0, + 0.10754873603582382, + 0.02366844192147255, + 0.0, + 0.24475394189357758, + 0.9091021306812763, + 0.10562663152813911, + 0.044515207409858704, + 0.031210437417030334, + 0.030205821618437767, + 0.0, + 0.0, + 0.13413629308342934, + 0.36814339086413383, + 0.0, + 0.0, + 0.0, + 0.43131942860782146, + 0.14448769390583038, + 0.03669644892215729, + 0.0, + 0.0, + 0.045023027807474136, + 0.024901043623685837, + 0.045000143349170685, + 0.1886974424123764, + 0.3922571837902069, + 0.0, + 0.033120047301054, + 0.03119935281574726, + 0.0, + 0.03326923027634621, + 0.2365914061665535, + 0.3448999673128128, + 0.0, + 0.0, + 0.22541508823633194, + 0.046887341886758804, + 0.22463046573102474, + 0.0, + 0.0, + 0.4520421512424946, + 0.0, + 0.0975685827434063, + 0.07944191992282867, + 0.07457239925861359, + 0.0, + 0.0, + 0.1274009607732296, + 1.3313499055802822, + 0.030924830585718155, + 0.04601503536105156, + 0.17651624977588654, + 0.2237619273364544, + 0.5494064763188362 + ], + "unique_experts": 41, + "load_cv": 1.3326242601009242, + "normalized_load_entropy": 0.8147589481945776, + "max_load_share": 0.10144927536231885 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "42427655e7bb1384db8f33bb0ca9683829a1f0f9854964a5bc91e75b2b4cd7fc", + "route_weight_sha256": "24e8d43e70c5891d6ffe8f84ac65347a50f75ae104d344fd4e1ee7c921420001", + "loads": [ + 8, + 9, + 1, + 0, + 0, + 5, + 44, + 0, + 0, + 4, + 16, + 11, + 0, + 2, + 9, + 10, + 1, + 2, + 3, + 3, + 0, + 6, + 6, + 3, + 4, + 0, + 11, + 2, + 1, + 19, + 7, + 2, + 1, + 12, + 4, + 7, + 6, + 2, + 2, + 1, + 3, + 8, + 12, + 2, + 16, + 15, + 2, + 8, + 2, + 5, + 9, + 0, + 5, + 4, + 4, + 2, + 4, + 14, + 17, + 5, + 2, + 5, + 4, + 12 + ], + "weighted_loads": [ + 0.30701565369963646, + 0.44549626111984253, + 0.048413053154945374, + 0.0, + 0.0, + 0.2607048563659191, + 3.621496492996812, + 0.0, + 0.0, + 0.19922002404928207, + 0.9109264127910137, + 0.7702641300857067, + 0.0, + 0.24475394189357758, + 0.9091021306812763, + 0.4733816720545292, + 0.044515207409858704, + 0.07045422866940498, + 0.09872587025165558, + 0.12280135601758957, + 0.0, + 0.2982895113527775, + 0.36814339086413383, + 0.12172871828079224, + 0.21293218433856964, + 0.0, + 0.5889033954590559, + 0.14448769390583038, + 0.03669644892215729, + 1.5927298478782177, + 0.39069513976573944, + 0.08482535928487778, + 0.024901043623685837, + 1.0952606536448002, + 0.41394259221851826, + 0.4432746656239033, + 0.34137928299605846, + 0.06647992879152298, + 0.0731648188084364, + 0.04302026703953743, + 0.1148621253669262, + 0.4233275130391121, + 1.0288642905652523, + 0.11239949241280556, + 1.3051084280014038, + 1.2331521734595299, + 0.08891365304589272, + 0.6238107997924089, + 0.25383568555116653, + 0.24627847969532013, + 0.4868452101945877, + 0.0, + 0.20209982991218567, + 0.16211675852537155, + 0.1448005884885788, + 0.07155315577983856, + 0.1940416470170021, + 0.8352071568369865, + 1.6646347548812628, + 0.2262308970093727, + 0.07466709800064564, + 0.26362175680696964, + 0.2237619273364544, + 0.6662316247820854 + ], + "unique_experts": 56, + "load_cv": 1.131923142267177, + "normalized_load_entropy": 0.8808304436765805, + "max_load_share": 0.11458333333333333 + } + }, + "s0_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "a7fb01590a190dbd6d2bd06b5cc077702c1a58d54b48a6dacb5ec945bf5eefcb", + "route_weight_sha256": "0b2df712ca2de6a96209d7742307c56296bf19e0bd01bf7e16d344127dee9e41", + "loads": [ + 3, + 2, + 0, + 0, + 0, + 4, + 15, + 0, + 0, + 0, + 3, + 1, + 0, + 2, + 8, + 3, + 1, + 1, + 0, + 1, + 0, + 3, + 5, + 0, + 0, + 0, + 9, + 2, + 1, + 0, + 0, + 1, + 1, + 2, + 1, + 5, + 0, + 1, + 1, + 0, + 0, + 4, + 4, + 0, + 0, + 2, + 3, + 6, + 0, + 0, + 8, + 0, + 2, + 2, + 2, + 0, + 0, + 3, + 9, + 1, + 1, + 3, + 4, + 8 + ], + "weighted_loads": [ + 0.10922008380293846, + 0.07337813824415207, + 0.0, + 0.0, + 0.0, + 0.21070873737335205, + 1.1926155351102352, + 0.0, + 0.0, + 0.0, + 0.10838187299668789, + 0.025220997631549835, + 0.0, + 0.24428004771471024, + 0.8917889893054962, + 0.10972271114587784, + 0.04711915925145149, + 0.03232109919190407, + 0.0, + 0.03240149840712547, + 0.0, + 0.13234597817063332, + 0.3198775462806225, + 0.0, + 0.0, + 0.0, + 0.5136286281049252, + 0.15136565268039703, + 0.03766537457704544, + 0.0, + 0.0, + 0.04203144088387489, + 0.027622094377875328, + 0.08172538876533508, + 0.20693036913871765, + 0.3374963216483593, + 0.0, + 0.03162510320544243, + 0.0339820459485054, + 0.0, + 0.0, + 0.24245865270495415, + 0.2881644181907177, + 0.0, + 0.0, + 0.1887395679950714, + 0.11602229997515678, + 0.22201619111001492, + 0.0, + 0.0, + 0.43168481066823006, + 0.0, + 0.09503277018666267, + 0.07796010002493858, + 0.06631985120475292, + 0.0, + 0.0, + 0.13320139795541763, + 1.300601091235876, + 0.030440909788012505, + 0.050834253430366516, + 0.16689686849713326, + 0.22386032715439796, + 0.5288165807723999 + ], + "unique_experts": 40, + "load_cv": 1.3451742652246683, + "normalized_load_entropy": 0.8131655768199918, + "max_load_share": 0.10869565217391304 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "d60936b2eff04fbcdbc028578fe2f44c45dc4e19c5257ad2282b82cfe22e28b3", + "route_weight_sha256": "3e926d1d93eaef84cd544bbdd46238b6d9906e25ad4f2dd7d6276022b828f5c2", + "loads": [ + 3, + 7, + 0, + 0, + 0, + 6, + 33, + 0, + 0, + 2, + 13, + 6, + 0, + 2, + 8, + 10, + 1, + 2, + 2, + 2, + 0, + 5, + 5, + 0, + 5, + 0, + 12, + 2, + 1, + 15, + 0, + 1, + 1, + 9, + 2, + 5, + 3, + 2, + 1, + 1, + 0, + 6, + 5, + 1, + 12, + 14, + 6, + 7, + 1, + 0, + 9, + 0, + 6, + 5, + 4, + 0, + 4, + 3, + 14, + 6, + 1, + 4, + 4, + 9 + ], + "weighted_loads": [ + 0.10922008380293846, + 0.3265717886388302, + 0.0, + 0.0, + 0.0, + 0.29729357548058033, + 2.7958599403500557, + 0.0, + 0.0, + 0.07670933380723, + 0.6773307174444199, + 0.3112154006958008, + 0.0, + 0.24428004771471024, + 0.8917889893054962, + 0.6412321664392948, + 0.04711915925145149, + 0.06752459332346916, + 0.08669323846697807, + 0.07419849559664726, + 0.0, + 0.21580908074975014, + 0.3198775462806225, + 0.0, + 0.22941865026950836, + 0.0, + 0.6406813226640224, + 0.15136565268039703, + 0.03766537457704544, + 0.9724357612431049, + 0.0, + 0.04203144088387489, + 0.027622094377875328, + 0.728842917829752, + 0.22980174608528614, + 0.3374963216483593, + 0.15828399918973446, + 0.06530165299773216, + 0.0339820459485054, + 0.03561369329690933, + 0.0, + 0.34561488404870033, + 0.3404918387532234, + 0.04552072659134865, + 0.9859677106142044, + 1.3925708755850792, + 0.21150623261928558, + 0.5827534552663565, + 0.03200826048851013, + 0.0, + 0.468366626650095, + 0.0, + 0.23611251637339592, + 0.21968810260295868, + 0.1545230820775032, + 0.0, + 0.199457548558712, + 0.13320139795541763, + 1.534253604710102, + 0.273316478356719, + 0.050834253430366516, + 0.19656916335225105, + 0.22386032715439796, + 0.5665570497512817 + ], + "unique_experts": 50, + "load_cv": 1.2012082394688697, + "normalized_load_entropy": 0.8564976279490619, + "max_load_share": 0.11458333333333333 + } + }, + "s1_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "c88ef6ebd5b15db8d32946b9d42a8fe285db60814e7e3172f7de58c127617838", + "route_weight_sha256": "a45f9998f07bdb9d4d1e5ad6ca26177bf69aad84baee39763d021facfd6302d4", + "loads": [ + 3, + 2, + 0, + 0, + 0, + 4, + 15, + 0, + 0, + 0, + 3, + 1, + 0, + 2, + 9, + 1, + 1, + 1, + 0, + 0, + 0, + 3, + 5, + 0, + 0, + 0, + 7, + 2, + 3, + 0, + 0, + 1, + 1, + 2, + 1, + 5, + 0, + 1, + 1, + 0, + 0, + 5, + 4, + 0, + 0, + 2, + 3, + 6, + 0, + 0, + 8, + 0, + 2, + 1, + 1, + 0, + 0, + 3, + 9, + 1, + 2, + 3, + 5, + 9 + ], + "weighted_loads": [ + 0.10744188912212849, + 0.07018701732158661, + 0.0, + 0.0, + 0.0, + 0.21207239851355553, + 1.1011833995580673, + 0.0, + 0.0, + 0.0, + 0.10792372934520245, + 0.023015063256025314, + 0.0, + 0.24688025563955307, + 0.9038846641778946, + 0.034815456718206406, + 0.04734712094068527, + 0.029371630400419235, + 0.0, + 0.0, + 0.0, + 0.13717766478657722, + 0.3082821685820818, + 0.0, + 0.0, + 0.0, + 0.4098238069564104, + 0.14859211444854736, + 0.10375641658902168, + 0.0, + 0.0, + 0.038657501339912415, + 0.025287281721830368, + 0.0832035280764103, + 0.18795421719551086, + 0.34909315034747124, + 0.0, + 0.03193366155028343, + 0.030417587608098984, + 0.0, + 0.0, + 0.264211006462574, + 0.25330163538455963, + 0.0, + 0.0, + 0.16968367993831635, + 0.11711033247411251, + 0.22972160391509533, + 0.0, + 0.0, + 0.4405509252101183, + 0.0, + 0.10195691511034966, + 0.04382464662194252, + 0.0402151495218277, + 0.0, + 0.0, + 0.13339877873659134, + 1.2636970281600952, + 0.02935750037431717, + 0.0815390832722187, + 0.17513857409358025, + 0.2542464341968298, + 0.5978992022573948 + ], + "unique_experts": 39, + "load_cv": 1.3650142930254727, + "normalized_load_entropy": 0.806643728491178, + "max_load_share": 0.10869565217391304 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "ba3b7461e52b8f80fe2ab46e595eb673648f8a967dab4ea2efa6aebe50978184", + "route_weight_sha256": "072d08fcc07270d6d32fa2c2312ab58e86b9923558099f03d92886339f528c45", + "loads": [ + 8, + 8, + 0, + 0, + 0, + 6, + 44, + 0, + 0, + 1, + 12, + 11, + 0, + 2, + 9, + 9, + 1, + 2, + 3, + 3, + 0, + 8, + 5, + 3, + 5, + 0, + 12, + 2, + 3, + 19, + 7, + 2, + 1, + 15, + 4, + 6, + 6, + 2, + 2, + 1, + 2, + 10, + 12, + 0, + 18, + 14, + 5, + 8, + 2, + 5, + 9, + 0, + 5, + 3, + 3, + 3, + 3, + 15, + 14, + 5, + 3, + 6, + 5, + 12 + ], + "weighted_loads": [ + 0.30932015366852283, + 0.3370003141462803, + 0.0, + 0.0, + 0.0, + 0.29831164330244064, + 3.4947172421962023, + 0.0, + 0.0, + 0.030571382492780685, + 0.6852895338088274, + 0.7804206274449825, + 0.0, + 0.24688025563955307, + 0.9038846641778946, + 0.5450571142137051, + 0.04734712094068527, + 0.06861542165279388, + 0.10768722929060459, + 0.12280135601758957, + 0.0, + 0.3861619047820568, + 0.3082821685820818, + 0.12172871828079224, + 0.23863076977431774, + 0.0, + 0.6000097561627626, + 0.14859211444854736, + 0.10375641658902168, + 1.501402910798788, + 0.39069513976573944, + 0.07845983281731606, + 0.025287281721830368, + 1.2921166382730007, + 0.4131993670016527, + 0.4001106321811676, + 0.32633555121719837, + 0.06529354304075241, + 0.07238305360078812, + 0.04302026703953743, + 0.08159289509057999, + 0.49542946368455887, + 0.9146612174808979, + 0.0, + 1.4683881141245365, + 1.2787397503852844, + 0.20242160744965076, + 0.6289019379764795, + 0.25383568555116653, + 0.24627847969532013, + 0.4753539841622114, + 0.0, + 0.20648816227912903, + 0.1264994852244854, + 0.11044333875179291, + 0.11388832703232765, + 0.155318982899189, + 0.8738009333610535, + 1.439209097996354, + 0.22466356679797173, + 0.11019114591181278, + 0.2970429491251707, + 0.2542464341968298, + 0.714724350720644 + ], + "unique_experts": 54, + "load_cv": 1.1326897682556822, + "normalized_load_entropy": 0.8776638113932045, + "max_load_share": 0.11458333333333333 + } + }, + "s0_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "b2ddd411531628b797e4c69af699196cadc0d3d509b550dc8094233ae51b5c28", + "route_weight_sha256": "edf2966be001c7f2efc62c2737234eff66d1f9e4700b47ba9d34df98bc11b4a2", + "loads": [ + 3, + 2, + 0, + 0, + 0, + 4, + 15, + 0, + 0, + 0, + 3, + 1, + 0, + 2, + 8, + 3, + 1, + 1, + 0, + 1, + 0, + 3, + 5, + 0, + 0, + 0, + 8, + 2, + 1, + 0, + 0, + 1, + 1, + 2, + 1, + 5, + 0, + 1, + 1, + 0, + 0, + 5, + 4, + 0, + 0, + 2, + 3, + 6, + 0, + 0, + 8, + 0, + 2, + 2, + 3, + 0, + 0, + 3, + 9, + 1, + 1, + 3, + 3, + 8 + ], + "weighted_loads": [ + 0.11073939502239227, + 0.07138402760028839, + 0.0, + 0.0, + 0.0, + 0.20658284425735474, + 1.1813872940838337, + 0.0, + 0.0, + 0.0, + 0.1099873036146164, + 0.024279462173581123, + 0.0, + 0.2369653806090355, + 0.8911163955926895, + 0.11075284332036972, + 0.046009134501218796, + 0.03453703597187996, + 0.0, + 0.03160861134529114, + 0.0, + 0.13372160866856575, + 0.313862569630146, + 0.0, + 0.0, + 0.0, + 0.46850073523819447, + 0.1506551429629326, + 0.03904467821121216, + 0.0, + 0.0, + 0.03985267132520676, + 0.02591570094227791, + 0.08610860630869865, + 0.212870791554451, + 0.34767841175198555, + 0.0, + 0.031224515289068222, + 0.03197406604886055, + 0.0, + 0.0, + 0.27733371406793594, + 0.29805978015065193, + 0.0, + 0.0, + 0.1795147955417633, + 0.11150142922997475, + 0.22960536554455757, + 0.0, + 0.0, + 0.4243461526930332, + 0.0, + 0.10015415027737617, + 0.07856259495019913, + 0.09860292077064514, + 0.0, + 0.0, + 0.12593435123562813, + 1.2931163124740124, + 0.03140248358249664, + 0.05274131894111633, + 0.16844362020492554, + 0.18987278267741203, + 0.5254261493682861 + ], + "unique_experts": 40, + "load_cv": 1.3326242601009242, + "normalized_load_entropy": 0.8148683661125244, + "max_load_share": 0.10869565217391304 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "5d2929926c63dff28068743a5ef078b5f55704d9ec527f898d2fd332a3f358c2", + "route_weight_sha256": "b0a5880a6c6c5386234db3eb4a6421156675a882e4d52b43fe883788c01103bd", + "loads": [ + 3, + 8, + 0, + 0, + 0, + 6, + 32, + 0, + 0, + 3, + 14, + 6, + 0, + 2, + 9, + 9, + 1, + 2, + 2, + 2, + 0, + 3, + 5, + 0, + 4, + 0, + 11, + 2, + 1, + 15, + 0, + 1, + 1, + 9, + 2, + 5, + 4, + 2, + 1, + 1, + 0, + 9, + 6, + 2, + 11, + 13, + 5, + 7, + 1, + 0, + 9, + 0, + 6, + 5, + 5, + 0, + 3, + 3, + 14, + 6, + 1, + 4, + 3, + 9 + ], + "weighted_loads": [ + 0.11073939502239227, + 0.5015875324606895, + 0.0, + 0.0, + 0.0, + 0.2900117505341768, + 2.826485298573971, + 0.0, + 0.0, + 0.12325336411595345, + 0.7733265291899443, + 0.33663455583155155, + 0.0, + 0.2369653806090355, + 0.9241092093288898, + 0.4229116328060627, + 0.046009134501218796, + 0.06974053010344505, + 0.08734507113695145, + 0.07340560853481293, + 0.0, + 0.13372160866856575, + 0.313862569630146, + 0.0, + 0.26502302661538124, + 0.0, + 0.5955534297972918, + 0.1506551429629326, + 0.03904467821121216, + 1.042745005339384, + 0.0, + 0.03985267132520676, + 0.02591570094227791, + 0.717084638774395, + 0.23574216850101948, + 0.34767841175198555, + 0.21880974806845188, + 0.06490106508135796, + 0.03197406604886055, + 0.03561369329690933, + 0.0, + 0.44852485693991184, + 0.3891889527440071, + 0.10741507634520531, + 0.9545349553227425, + 1.1860730238258839, + 0.17862169444561005, + 0.5903426297008991, + 0.03200826048851013, + 0.0, + 0.46102796867489815, + 0.0, + 0.24123389646410942, + 0.22029059752821922, + 0.18680615164339542, + 0.0, + 0.168011624366045, + 0.12593435123562813, + 1.513163996860385, + 0.27427805215120316, + 0.05274131894111633, + 0.19811591506004333, + 0.18987278267741203, + 0.563166618347168 + ], + "unique_experts": 50, + "load_cv": 1.179165848710618, + "normalized_load_entropy": 0.859121559478416, + "max_load_share": 0.1111111111111111 + } + }, + "s1_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "98ab7eef236221b71f180bece28fd82ec630137fdc76eb85d8b6b5f7bed1fee8", + "route_weight_sha256": "cfc689b3bcb8c6b760cae8c1cd6866e1c8d02c8c65962d20e1d351ac49bed60a", + "loads": [ + 3, + 2, + 0, + 0, + 0, + 4, + 15, + 0, + 0, + 0, + 3, + 1, + 0, + 2, + 8, + 1, + 1, + 2, + 0, + 0, + 0, + 3, + 5, + 0, + 0, + 0, + 9, + 2, + 1, + 0, + 0, + 1, + 1, + 2, + 1, + 6, + 1, + 1, + 1, + 0, + 0, + 4, + 4, + 0, + 0, + 2, + 2, + 7, + 0, + 0, + 7, + 0, + 2, + 1, + 1, + 0, + 0, + 3, + 9, + 1, + 2, + 3, + 4, + 10 + ], + "weighted_loads": [ + 0.10731530748307705, + 0.07200843840837479, + 0.0, + 0.0, + 0.0, + 0.21184556186199188, + 1.1297775991261005, + 0.0, + 0.0, + 0.0, + 0.10818403773009777, + 0.023654283955693245, + 0.0, + 0.24005934596061707, + 0.871531143784523, + 0.03152765706181526, + 0.04738081246614456, + 0.06345275416970253, + 0.0, + 0.0, + 0.0, + 0.13904783502221107, + 0.3068888708949089, + 0.0, + 0.0, + 0.0, + 0.46733617410063744, + 0.14186804369091988, + 0.037137266248464584, + 0.0, + 0.0, + 0.03711811453104019, + 0.02366677112877369, + 0.0830184854567051, + 0.19292952120304108, + 0.37494609504938126, + 0.023432767018675804, + 0.03178994730114937, + 0.030793853104114532, + 0.0, + 0.0, + 0.23401997983455658, + 0.2688099071383476, + 0.0, + 0.0, + 0.1606166958808899, + 0.08252504840493202, + 0.27068158239126205, + 0.0, + 0.0, + 0.39121487736701965, + 0.0, + 0.10249447450041771, + 0.04202475771307945, + 0.03823423013091087, + 0.0, + 0.0, + 0.12238464131951332, + 1.2441073395311832, + 0.030446087941527367, + 0.0804581455886364, + 0.1735907718539238, + 0.22288433089852333, + 0.6151554696261883 + ], + "unique_experts": 40, + "load_cv": 1.3845700547480204, + "normalized_load_entropy": 0.8066404145266145, + "max_load_share": 0.10869565217391304 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "26ff5169f1bace7b5a002cce6af7772c3def72c0dee9d95140877c901c19de33", + "route_weight_sha256": "4deb9fcad2b1f7d444c8494bef8800d11297a37d01b6f7e4ab1e64552f0c7b72", + "loads": [ + 8, + 8, + 0, + 0, + 0, + 5, + 44, + 0, + 0, + 1, + 12, + 12, + 0, + 2, + 8, + 8, + 1, + 3, + 3, + 3, + 0, + 9, + 5, + 3, + 4, + 0, + 13, + 2, + 1, + 21, + 8, + 3, + 1, + 16, + 4, + 7, + 7, + 2, + 2, + 1, + 2, + 9, + 12, + 1, + 18, + 13, + 3, + 9, + 2, + 5, + 8, + 0, + 5, + 3, + 3, + 2, + 3, + 14, + 15, + 5, + 3, + 5, + 4, + 13 + ], + "weighted_loads": [ + 0.3091935720294714, + 0.4762402717024088, + 0.0, + 0.0, + 0.0, + 0.24803490191698074, + 3.4728231746703386, + 0.0, + 0.0, + 0.030571382492780685, + 0.7191802393645048, + 0.8308733385056257, + 0.0, + 0.24005934596061707, + 0.871531143784523, + 0.39928269758820534, + 0.04738081246614456, + 0.10269654542207718, + 0.10155953653156757, + 0.12280135601758957, + 0.0, + 0.4174080602824688, + 0.3068888708949089, + 0.12172871828079224, + 0.32759881019592285, + 0.0, + 0.6249201409518719, + 0.14186804369091988, + 0.037137266248464584, + 1.6127966865897179, + 0.43361368775367737, + 0.11161824688315392, + 0.02366677112877369, + 1.3315445557236671, + 0.41817467100918293, + 0.4259635768830776, + 0.38965706527233124, + 0.06514982879161835, + 0.07275931909680367, + 0.04302026703953743, + 0.08159289509057999, + 0.46888528764247894, + 0.920229148119688, + 0.034819185733795166, + 1.4120734110474586, + 1.1225424110889435, + 0.12455135956406593, + 0.6698619164526463, + 0.25383568555116653, + 0.24627847969532013, + 0.4260179363191128, + 0.0, + 0.20702572166919708, + 0.12469959631562233, + 0.10846241936087608, + 0.07155315577983856, + 0.155318982899189, + 0.8301908373832703, + 1.4664281029254198, + 0.22575215436518192, + 0.10911020822823048, + 0.2606962788850069, + 0.22288433089852333, + 0.7319806180894375 + ], + "unique_experts": 55, + "load_cv": 1.1524430571616109, + "normalized_load_entropy": 0.8748843335330575, + "max_load_share": 0.11458333333333333 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "ordered_topk_exact_tokens": 16, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.9254658385093169, + "mean_token_weighted_tv": 0.014201002074000628, + "aggregate_load_tv": 0.043478260869565216 + }, + "system_bos": { + "tokens": 23, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.9254658385093167, + "mean_token_weighted_tv": 0.0173192387851684, + "aggregate_load_tv": 0.04347826086956521 + }, + "system_x": { + "tokens": 23, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.9130434782608695, + "mean_token_weighted_tv": 0.021362859634277614, + "aggregate_load_tv": 0.05072463768115941 + }, + "system_period": { + "tokens": 23, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.8913043478260869, + "mean_token_weighted_tv": 0.024675959478253903, + "aggregate_load_tv": 0.06521739130434782 + }, + "bos_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.9254658385093169, + "mean_token_weighted_tv": 0.018553174141308536, + "aggregate_load_tv": 0.043478260869565216 + }, + "bos_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.9006211180124224, + "mean_token_weighted_tv": 0.02154274880076232, + "aggregate_load_tv": 0.050724637681159424 + }, + "x_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8881987577639753, + "mean_token_weighted_tv": 0.024986072362441082, + "aggregate_load_tv": 0.05072463768115942 + }, + "x_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 4, + "set_exact_tokens": 9, + "mean_set_jaccard": 0.8167701863354039, + "mean_token_weighted_tv": 0.03588204008891531, + "aggregate_load_tv": 0.08695652173913043 + }, + "period_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.9006211180124224, + "mean_token_weighted_tv": 0.02384558927429759, + "aggregate_load_tv": 0.057971014492753624 + }, + "period_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 6, + "set_exact_tokens": 13, + "mean_set_jaccard": 0.8664596273291927, + "mean_token_weighted_tv": 0.030100252843745377, + "aggregate_load_tv": 0.057971014492753624 + } + } + }, + "layer_14": { + "layer": 14, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "459ffc9a5dd15171c98db9e40c5328a5fa23adb6d4cba7de6772e3280fd72c14", + "route_weight_sha256": "f10d76b8390eceb06fb5a3fc7ede14c94d3943c84e157f8de481ec77bc37bc8d", + "loads": [ + 0, + 0, + 0, + 0, + 2, + 7, + 2, + 3, + 4, + 3, + 9, + 1, + 0, + 0, + 1, + 0, + 0, + 0, + 2, + 0, + 5, + 1, + 0, + 7, + 5, + 2, + 2, + 6, + 5, + 1, + 2, + 3, + 1, + 0, + 0, + 5, + 0, + 0, + 0, + 0, + 0, + 0, + 1, + 1, + 1, + 0, + 7, + 1, + 4, + 3, + 0, + 10, + 1, + 0, + 3, + 2, + 1, + 1, + 6, + 11, + 0, + 2, + 0, + 4 + ], + "weighted_loads": [ + 0.0, + 0.0, + 0.0, + 0.0, + 0.12675676494836807, + 0.36167837493121624, + 0.14053720608353615, + 0.5187927410006523, + 0.17637599259614944, + 0.12708961963653564, + 0.6158529818058014, + 0.03311498835682869, + 0.0, + 0.0, + 0.07722166180610657, + 0.0, + 0.0, + 0.0, + 0.09380874037742615, + 0.0, + 0.3747989200055599, + 0.050903674215078354, + 0.0, + 0.7418362982571125, + 0.5037103481590748, + 0.07926717959344387, + 0.31287806853652, + 1.1585076786577702, + 0.32006482034921646, + 0.03910680487751961, + 0.08736100420355797, + 0.16598380915820599, + 0.036837827414274216, + 0.0, + 0.0, + 0.3021726757287979, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.089141845703125, + 0.03616539388895035, + 0.06818182021379471, + 0.0, + 0.33548406697809696, + 0.05097633972764015, + 0.16775187104940414, + 0.12558847665786743, + 0.0, + 0.8753795400261879, + 0.044398099184036255, + 0.0, + 0.20505328103899956, + 0.12045881897211075, + 0.06273272633552551, + 0.0662546381354332, + 0.4769812859594822, + 1.0002874433994293, + 0.0, + 0.45735715329647064, + 0.0, + 0.16692227870225906 + ], + "unique_experts": 40, + "load_cv": 1.2439308659084878, + "normalized_load_entropy": 0.8224480899614668, + "max_load_share": 0.07971014492753623 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "838b681584130ced73039ec0773e2a20e059af621c39c1c8697400e6bd4cd299", + "route_weight_sha256": "b50193f6f6ce94339aab7ef250436c2fa4c74afb09b649ea1a776675432650a3", + "loads": [ + 8, + 0, + 0, + 2, + 2, + 17, + 2, + 6, + 4, + 11, + 11, + 4, + 0, + 0, + 1, + 5, + 0, + 0, + 6, + 1, + 5, + 1, + 0, + 17, + 6, + 2, + 8, + 12, + 13, + 1, + 4, + 8, + 1, + 7, + 0, + 5, + 2, + 1, + 2, + 0, + 0, + 0, + 2, + 1, + 3, + 0, + 13, + 4, + 5, + 3, + 2, + 16, + 7, + 7, + 3, + 6, + 2, + 2, + 6, + 24, + 0, + 3, + 0, + 4 + ], + "weighted_loads": [ + 0.7505126856267452, + 0.0, + 0.0, + 0.07914513349533081, + 0.12675676494836807, + 1.2747186813503504, + 0.14053720608353615, + 0.6402638256549835, + 0.17637599259614944, + 0.7489447891712189, + 0.6800620295107365, + 0.2237306535243988, + 0.0, + 0.0, + 0.07722166180610657, + 0.2291027195751667, + 0.0, + 0.0, + 0.3333191890269518, + 0.03977340832352638, + 0.3747989200055599, + 0.050903674215078354, + 0.0, + 1.1821312308311462, + 0.5263044238090515, + 0.07926717959344387, + 0.6490354537963867, + 1.5429057506844401, + 1.7725033983588219, + 0.03910680487751961, + 0.2382766641676426, + 0.35081176552921534, + 0.036837827414274216, + 0.7082952484488487, + 0.0, + 0.3021726757287979, + 0.09685255214571953, + 0.043454498052597046, + 0.1341659277677536, + 0.0, + 0.0, + 0.0, + 0.14007246121764183, + 0.03616539388895035, + 0.12912880070507526, + 0.0, + 0.6803378257900476, + 0.18080292828381062, + 0.19398172199726105, + 0.12558847665786743, + 0.07613230869174004, + 2.217919047921896, + 0.8048978447914124, + 0.4789120443165302, + 0.20505328103899956, + 0.4583008475601673, + 0.10248075425624847, + 0.10197697207331657, + 0.4769812859594822, + 1.596640769392252, + 0.0, + 0.4623729563318193, + 0.0, + 0.16692227870225906 + ], + "unique_experts": 50, + "load_cv": 1.118033988749895, + "normalized_load_entropy": 0.8626305817210523, + "max_load_share": 0.08333333333333333 + } + }, + "s1_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "fd5ca059e7531d375f29a1b25e36c38d9998a9a863cf96132b9e0934fa6497eb", + "route_weight_sha256": "1651db3eab7fd27e8882f87a4ec08644b44a30963f6cf10c255fe576a9850830", + "loads": [ + 0, + 0, + 0, + 0, + 2, + 6, + 2, + 4, + 3, + 3, + 10, + 0, + 0, + 0, + 2, + 0, + 0, + 0, + 2, + 0, + 5, + 1, + 0, + 6, + 5, + 1, + 2, + 6, + 5, + 1, + 2, + 2, + 1, + 0, + 0, + 5, + 0, + 0, + 0, + 0, + 0, + 0, + 1, + 1, + 1, + 0, + 7, + 2, + 4, + 3, + 0, + 10, + 1, + 0, + 4, + 2, + 1, + 1, + 6, + 13, + 0, + 2, + 0, + 3 + ], + "weighted_loads": [ + 0.0, + 0.0, + 0.0, + 0.0, + 0.12564248219132423, + 0.31949786841869354, + 0.13882266730070114, + 0.5255316086113453, + 0.13798648491501808, + 0.1274024285376072, + 0.6297849342226982, + 0.0, + 0.0, + 0.0, + 0.10875266045331955, + 0.0, + 0.0, + 0.0, + 0.09409556910395622, + 0.0, + 0.36434196680784225, + 0.049452412873506546, + 0.0, + 0.739370696246624, + 0.5059262625873089, + 0.0504351481795311, + 0.3017197847366333, + 1.1651922054588795, + 0.31368331238627434, + 0.037953998893499374, + 0.0884881429374218, + 0.14934246242046356, + 0.03792889788746834, + 0.0, + 0.0, + 0.30444496870040894, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.08505523949861526, + 0.03419128805398941, + 0.06920614093542099, + 0.0, + 0.3344035614281893, + 0.07808501645922661, + 0.1711751502007246, + 0.12296753749251366, + 0.0, + 0.8573657274246216, + 0.04796427860856056, + 0.0, + 0.24376698955893517, + 0.11127019301056862, + 0.06453106552362442, + 0.06960296630859375, + 0.4650107007473707, + 1.0817805994302034, + 0.0, + 0.4524935185909271, + 0.0, + 0.13762780651450157 + ], + "unique_experts": 39, + "load_cv": 1.294244282571866, + "normalized_load_entropy": 0.8155596623474564, + "max_load_share": 0.09420289855072464 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "1c0952f9c2e1834f934faa920cdad02fc3d3cf82f6a394f66d06b091102fb50f", + "route_weight_sha256": "cab4de36231b8ff0e8bf6e5097621342574e2f4646944149dcf77b2b58b74400", + "loads": [ + 11, + 1, + 0, + 3, + 6, + 22, + 2, + 9, + 5, + 15, + 10, + 3, + 6, + 0, + 2, + 6, + 0, + 0, + 8, + 3, + 7, + 5, + 0, + 15, + 10, + 2, + 7, + 13, + 18, + 2, + 6, + 5, + 3, + 11, + 1, + 6, + 1, + 3, + 3, + 1, + 0, + 0, + 3, + 2, + 3, + 0, + 13, + 4, + 7, + 5, + 13, + 14, + 9, + 9, + 6, + 5, + 2, + 3, + 7, + 33, + 3, + 4, + 2, + 6 + ], + "weighted_loads": [ + 0.8827830627560616, + 0.05172812193632126, + 0.0, + 0.1159074567258358, + 0.3613610863685608, + 1.462227489799261, + 0.13882266730070114, + 0.7424656189978123, + 0.3040682338178158, + 1.0847406946122646, + 0.6297849342226982, + 0.21446195244789124, + 0.39333631098270416, + 0.0, + 0.10875266045331955, + 0.30087344348430634, + 0.0, + 0.0, + 0.47642136365175247, + 0.17517539486289024, + 0.5920886471867561, + 0.1994878426194191, + 0.0, + 1.1192850302904844, + 0.7488214820623398, + 0.09816470742225647, + 0.6683927662670612, + 1.4279422983527184, + 2.220625054091215, + 0.08641432225704193, + 0.31171688064932823, + 0.23750915843993425, + 0.11951103806495667, + 1.1916394010186195, + 0.04847671464085579, + 0.38476748764514923, + 0.04455575719475746, + 0.3564930334687233, + 0.21146699041128159, + 0.058142803609371185, + 0.0, + 0.0, + 0.1839020699262619, + 0.08076877892017365, + 0.13008112832903862, + 0.0, + 0.703004740178585, + 0.1467185728251934, + 0.3214509878307581, + 0.17954045347869396, + 0.8494720086455345, + 2.1353647485375404, + 0.8528833612799644, + 0.69690116122365, + 0.32683370634913445, + 0.37938520684838295, + 0.11635243147611618, + 0.15059183165431023, + 0.5739848371595144, + 2.182014899328351, + 0.2523827850818634, + 0.49852528190240264, + 0.10266362503170967, + 0.24421703070402145 + ], + "unique_experts": 56, + "load_cv": 0.982043645782723, + "normalized_load_entropy": 0.8972491927643742, + "max_load_share": 0.0859375 + } + }, + "s0_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "4ea96db61b0efcedfc75120d5439368c44c6be52d3b35f86ce5dfe62b2ebed38", + "route_weight_sha256": "10da9d0e7a31052c51f129e7d3d03f092b50edffc29619dbb6a36c73496826d2", + "loads": [ + 0, + 0, + 0, + 0, + 2, + 7, + 2, + 3, + 3, + 2, + 12, + 0, + 0, + 0, + 1, + 0, + 0, + 0, + 3, + 0, + 5, + 1, + 0, + 6, + 5, + 1, + 2, + 7, + 5, + 1, + 1, + 4, + 1, + 0, + 0, + 5, + 1, + 0, + 0, + 0, + 0, + 0, + 1, + 1, + 1, + 0, + 6, + 1, + 4, + 3, + 0, + 10, + 0, + 0, + 4, + 2, + 1, + 1, + 5, + 11, + 0, + 2, + 0, + 5 + ], + "weighted_loads": [ + 0.0, + 0.0, + 0.0, + 0.0, + 0.12158146873116493, + 0.34470390155911446, + 0.15066201239824295, + 0.5241743624210358, + 0.14200443029403687, + 0.09236671030521393, + 0.7062089368700981, + 0.0, + 0.0, + 0.0, + 0.07806581258773804, + 0.0, + 0.0, + 0.0, + 0.14319640770554543, + 0.0, + 0.37300219386816025, + 0.04889442026615143, + 0.0, + 0.7717630937695503, + 0.46844005584716797, + 0.04715763404965401, + 0.2873019240796566, + 1.2021741550415754, + 0.32147832587361336, + 0.0422806516289711, + 0.05181204527616501, + 0.201121985912323, + 0.03629308566451073, + 0.0, + 0.0, + 0.3325367234647274, + 0.033974409103393555, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.09368564933538437, + 0.03583040460944176, + 0.06612323224544525, + 0.0, + 0.28142387606203556, + 0.04900183901190758, + 0.17002038843929768, + 0.11709301173686981, + 0.0, + 0.8510645255446434, + 0.0, + 0.0, + 0.23205726966261864, + 0.11821510642766953, + 0.06160878390073776, + 0.05900634080171585, + 0.45184357836842537, + 1.019717462360859, + 0.0, + 0.4468940645456314, + 0.0, + 0.20549006201326847 + ], + "unique_experts": 39, + "load_cv": 1.3071628238988267, + "normalized_load_entropy": 0.8112124208938583, + "max_load_share": 0.08695652173913043 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "93dbb2053aebcf8d4719e997570afedea7978521cd48c0d579962c9c07980343", + "route_weight_sha256": "f76dc27fba4a97f536c13a17bf47f7d3a338a8819fd7ffcf7054d9e63b71de97", + "loads": [ + 6, + 0, + 0, + 3, + 2, + 17, + 2, + 5, + 3, + 10, + 14, + 3, + 0, + 0, + 1, + 5, + 0, + 0, + 9, + 1, + 5, + 1, + 0, + 15, + 7, + 2, + 8, + 12, + 14, + 1, + 3, + 9, + 1, + 6, + 0, + 5, + 3, + 1, + 2, + 0, + 0, + 0, + 1, + 1, + 4, + 0, + 12, + 3, + 5, + 3, + 2, + 17, + 6, + 7, + 4, + 6, + 2, + 2, + 6, + 24, + 0, + 2, + 0, + 5 + ], + "weighted_loads": [ + 0.6656411439180374, + 0.0, + 0.0, + 0.13592608273029327, + 0.12158146873116493, + 1.2577442079782486, + 0.15066201239824295, + 0.6029493808746338, + 0.14200443029403687, + 0.6826281324028969, + 0.7704179845750332, + 0.19061566516757011, + 0.0, + 0.0, + 0.07806581258773804, + 0.22146733105182648, + 0.0, + 0.0, + 0.5354465674608946, + 0.03977340832352638, + 0.37300219386816025, + 0.04889442026615143, + 0.0, + 1.1845082081854343, + 0.5361344665288925, + 0.08745332434773445, + 0.6234593093395233, + 1.5964660216122866, + 1.8052146844565868, + 0.0422806516289711, + 0.20890311151742935, + 0.43174030631780624, + 0.03629308566451073, + 0.662861529737711, + 0.0, + 0.3325367234647274, + 0.12774449214339256, + 0.043454498052597046, + 0.12952974438667297, + 0.0, + 0.0, + 0.0, + 0.09368564933538437, + 0.03583040460944176, + 0.20446972735226154, + 0.0, + 0.6120605450123549, + 0.13435866869986057, + 0.2015115711838007, + 0.11709301173686981, + 0.07513734698295593, + 1.4167006630450487, + 0.7604997456073761, + 0.4789120443165302, + 0.23205726966261864, + 0.4880952574312687, + 0.10135681182146072, + 0.10368507355451584, + 0.49655235186219215, + 1.6206863224506378, + 0.0, + 0.4468940645456314, + 0.0, + 0.20549006201326847 + ], + "unique_experts": 50, + "load_cv": 1.1290223018278653, + "normalized_load_entropy": 0.860304014328401, + "max_load_share": 0.08333333333333333 + } + }, + "s1_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "acf71d31e86c3246cb5fa9652ad5b579f8aec9bda712a5c0da0ff8b1905d6667", + "route_weight_sha256": "0ce815e9a52a3c2bf279769fc055fb780fa685382352363847b5d8b9f8e0f178", + "loads": [ + 0, + 0, + 0, + 0, + 2, + 8, + 2, + 4, + 3, + 4, + 10, + 0, + 0, + 0, + 1, + 0, + 0, + 0, + 3, + 0, + 5, + 1, + 0, + 6, + 5, + 1, + 2, + 6, + 5, + 1, + 2, + 4, + 1, + 0, + 0, + 4, + 1, + 0, + 0, + 0, + 0, + 0, + 1, + 1, + 1, + 0, + 6, + 1, + 4, + 3, + 0, + 10, + 1, + 0, + 4, + 2, + 1, + 1, + 5, + 11, + 0, + 2, + 0, + 3 + ], + "weighted_loads": [ + 0.0, + 0.0, + 0.0, + 0.0, + 0.12532661110162735, + 0.35438182577490807, + 0.1465141884982586, + 0.5535154026001692, + 0.13966745138168335, + 0.16074874065816402, + 0.6344853863120079, + 0.0, + 0.0, + 0.0, + 0.07078918069601059, + 0.0, + 0.0, + 0.0, + 0.1329079121351242, + 0.0, + 0.35982055962085724, + 0.05028965696692467, + 0.0, + 0.7969667017459869, + 0.46513550728559494, + 0.04966949298977852, + 0.27151451259851456, + 1.1743611842393875, + 0.308746337890625, + 0.04087826982140541, + 0.08969033509492874, + 0.19937117025256157, + 0.039434999227523804, + 0.0, + 0.0, + 0.2765479162335396, + 0.03249182179570198, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0902741476893425, + 0.03544756397604942, + 0.06679769605398178, + 0.0, + 0.2926701381802559, + 0.04739531874656677, + 0.16515897773206234, + 0.10724835842847824, + 0.0, + 0.8452147096395493, + 0.04049144685268402, + 0.0, + 0.240219134837389, + 0.11099287495017052, + 0.059628892689943314, + 0.060062166303396225, + 0.4455288015305996, + 1.0462259240448475, + 0.0, + 0.4635094255208969, + 0.0, + 0.14309865981340408 + ], + "unique_experts": 40, + "load_cv": 1.2493224376617578, + "normalized_load_entropy": 0.8218558314169662, + "max_load_share": 0.07971014492753623 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "5e061796578dabd859559cb692306d392b61ada07433a7c24f8bde9a2037ae94", + "route_weight_sha256": "c972f94d88e67ddf39b627eeaf8473f6155b0ce3eb7a42ddd508a60d37f5a366", + "loads": [ + 10, + 1, + 0, + 3, + 6, + 24, + 2, + 8, + 5, + 16, + 11, + 3, + 6, + 0, + 1, + 7, + 0, + 0, + 10, + 3, + 7, + 4, + 0, + 14, + 10, + 2, + 7, + 13, + 19, + 2, + 6, + 7, + 3, + 12, + 1, + 5, + 2, + 3, + 3, + 1, + 0, + 0, + 2, + 2, + 3, + 1, + 12, + 4, + 7, + 5, + 12, + 14, + 9, + 9, + 6, + 5, + 2, + 4, + 6, + 30, + 3, + 3, + 2, + 6 + ], + "weighted_loads": [ + 0.8533674329519272, + 0.05172812193632126, + 0.0, + 0.13376782462000847, + 0.3610452152788639, + 1.4971114471554756, + 0.1465141884982586, + 0.7305890899151564, + 0.30574920028448105, + 1.086401043459773, + 0.6662926413118839, + 0.21446195244789124, + 0.39333631098270416, + 0.0, + 0.07078918069601059, + 0.30072828382253647, + 0.0, + 0.0, + 0.5367666371166706, + 0.17517539486289024, + 0.5875672399997711, + 0.15173501521348953, + 0.0, + 1.1493108104914427, + 0.7080307267606258, + 0.09739905223250389, + 0.6381874941289425, + 1.5084656476974487, + 2.295279897749424, + 0.08933859318494797, + 0.30349861085414886, + 0.3352954536676407, + 0.12101713940501213, + 1.203510094434023, + 0.04847671464085579, + 0.3568704351782799, + 0.07278862223029137, + 0.3564930334687233, + 0.20420589298009872, + 0.058142803609371185, + 0.0, + 0.0, + 0.14378849416971207, + 0.08202505484223366, + 0.1276726834475994, + 0.04187091812491417, + 0.6580245476216078, + 0.1558164730668068, + 0.3270720485597849, + 0.16382127441465855, + 0.8103308491408825, + 1.2959789633750916, + 0.8454105295240879, + 0.69690116122365, + 0.32328585162758827, + 0.43197884038090706, + 0.11145025864243507, + 0.1908579356968403, + 0.5545029379427433, + 2.103275526314974, + 0.2523827850818634, + 0.5047685317695141, + 0.10266362503170967, + 0.24968788400292397 + ], + "unique_experts": 57, + "load_cv": 0.9673488971869917, + "normalized_load_entropy": 0.8991232608783573, + "max_load_share": 0.078125 + } + }, + "s0_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "8f170071d66ee86f918adbcd48d6ea0609d2978d3dc3cc70ff4b04b7acefe288", + "route_weight_sha256": "22637d6bb9a699a5cccfeae5568fec5282f7d15f0a6a572fe488fac4b0e57dc7", + "loads": [ + 0, + 0, + 0, + 0, + 2, + 6, + 2, + 3, + 4, + 3, + 9, + 0, + 0, + 0, + 2, + 0, + 0, + 0, + 2, + 0, + 5, + 1, + 0, + 6, + 5, + 1, + 2, + 7, + 5, + 1, + 1, + 5, + 1, + 0, + 0, + 5, + 0, + 0, + 0, + 0, + 0, + 0, + 1, + 1, + 1, + 0, + 7, + 2, + 4, + 3, + 0, + 10, + 0, + 0, + 4, + 2, + 1, + 1, + 6, + 11, + 0, + 2, + 0, + 4 + ], + "weighted_loads": [ + 0.0, + 0.0, + 0.0, + 0.0, + 0.1261712796986103, + 0.4060342572629452, + 0.14593243226408958, + 0.5000997930765152, + 0.18295839056372643, + 0.13394498825073242, + 0.5961321517825127, + 0.0, + 0.0, + 0.0, + 0.12250695005059242, + 0.0, + 0.0, + 0.0, + 0.10736065730452538, + 0.0, + 0.3731836676597595, + 0.05009397491812706, + 0.0, + 0.7853982858359814, + 0.4708361402153969, + 0.05141448974609375, + 0.31263134256005287, + 1.2001974247395992, + 0.33685852214694023, + 0.03964531049132347, + 0.05029651150107384, + 0.22598453983664513, + 0.03226101025938988, + 0.0, + 0.0, + 0.3218745067715645, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.09750249981880188, + 0.03687657415866852, + 0.06971430778503418, + 0.0, + 0.3222180847078562, + 0.07762020640075207, + 0.1830468513071537, + 0.11947274208068848, + 0.0, + 0.858154084533453, + 0.0, + 0.0, + 0.24393587559461594, + 0.11176907271146774, + 0.060880426317453384, + 0.05816299840807915, + 0.45278553664684296, + 0.9789096005260944, + 0.0, + 0.4660712331533432, + 0.0, + 0.1695275455713272 + ], + "unique_experts": 38, + "load_cv": 1.2546908413351843, + "normalized_load_entropy": 0.8152522493575616, + "max_load_share": 0.07971014492753623 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "e47a0d87d8f2ceea1ddb00b35b0b86e2c7f8187aed90799ffdee1e4e989cebb5", + "route_weight_sha256": "dafdded476c5ea7e9acc8f03b93a575ca6d6ffaeb5eb2b029baa88b0580b7316", + "loads": [ + 7, + 0, + 0, + 1, + 2, + 18, + 2, + 4, + 4, + 11, + 11, + 3, + 0, + 1, + 2, + 4, + 0, + 0, + 6, + 2, + 5, + 1, + 0, + 15, + 7, + 2, + 9, + 11, + 13, + 1, + 4, + 10, + 1, + 7, + 0, + 5, + 3, + 3, + 2, + 0, + 0, + 0, + 2, + 1, + 3, + 0, + 13, + 4, + 4, + 3, + 2, + 14, + 6, + 8, + 4, + 6, + 2, + 2, + 6, + 25, + 0, + 2, + 0, + 4 + ], + "weighted_loads": [ + 0.7782409824430943, + 0.0, + 0.0, + 0.04007919505238533, + 0.1261712796986103, + 1.4491084702312946, + 0.14593243226408958, + 0.5336735509335995, + 0.18295839056372643, + 0.681916069239378, + 0.6603411994874477, + 0.19061566516757011, + 0.0, + 0.0590742751955986, + 0.12250695005059242, + 0.1751353107392788, + 0.0, + 0.0, + 0.29155895859003067, + 0.11521466448903084, + 0.3731836676597595, + 0.05009397491812706, + 0.0, + 1.1981434002518654, + 0.5340607240796089, + 0.08239759504795074, + 0.7605679556727409, + 1.52827088534832, + 1.456941645592451, + 0.03964531049132347, + 0.23489007912576199, + 0.45652352273464203, + 0.03226101025938988, + 0.7261537909507751, + 0.0, + 0.3218745067715645, + 0.1297842040657997, + 0.16214009374380112, + 0.11636633798480034, + 0.0, + 0.0, + 0.0, + 0.145358607172966, + 0.03687657415866852, + 0.13066128827631474, + 0.0, + 0.6782406400889158, + 0.16297703608870506, + 0.1830468513071537, + 0.11947274208068848, + 0.08311712741851807, + 1.3137148786336184, + 0.7604997456073761, + 0.5653107725083828, + 0.24393587559461594, + 0.43557559326291084, + 0.10062845423817635, + 0.1002771258354187, + 0.45278553664684296, + 1.6661898605525494, + 0.0, + 0.4660712331533432, + 0.0, + 0.1695275455713272 + ], + "unique_experts": 51, + "load_cv": 1.1055415967851332, + "normalized_load_entropy": 0.867921564764676, + "max_load_share": 0.08680555555555555 + } + }, + "s1_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "ec0b146bc38b08f53312eeeeed97f35929c0050ba9fe727d12ff7b62cdb1bb22", + "route_weight_sha256": "c0d58ff5c312089f32765bd0600e060cd49dab937e1b9db7364f23bdb116056c", + "loads": [ + 0, + 0, + 0, + 0, + 2, + 7, + 2, + 4, + 3, + 3, + 8, + 0, + 0, + 0, + 1, + 0, + 0, + 0, + 3, + 0, + 5, + 1, + 0, + 6, + 5, + 1, + 2, + 6, + 5, + 1, + 1, + 3, + 1, + 0, + 0, + 6, + 0, + 0, + 0, + 0, + 0, + 0, + 1, + 1, + 1, + 0, + 8, + 2, + 5, + 3, + 0, + 10, + 1, + 0, + 3, + 2, + 1, + 1, + 5, + 12, + 0, + 2, + 0, + 4 + ], + "weighted_loads": [ + 0.0, + 0.0, + 0.0, + 0.0, + 0.1264314092695713, + 0.46853469870984554, + 0.1419723555445671, + 0.5157946012914181, + 0.1435861885547638, + 0.13078740797936916, + 0.5304584205150604, + 0.0, + 0.0, + 0.0, + 0.07211312651634216, + 0.0, + 0.0, + 0.0, + 0.14101031050086021, + 0.0, + 0.3640788905322552, + 0.0484122708439827, + 0.0, + 0.789443351328373, + 0.45245125889778137, + 0.056327447295188904, + 0.2654232457280159, + 1.1790734753012657, + 0.2854655906558037, + 0.040191762149333954, + 0.051883164793252945, + 0.16703357733786106, + 0.03628455102443695, + 0.0, + 0.0, + 0.3464717008173466, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.09837208688259125, + 0.03517242893576622, + 0.06261318922042847, + 0.0, + 0.3512567728757858, + 0.07449334487318993, + 0.22152810916304588, + 0.10904881730675697, + 0.0, + 0.8322652727365494, + 0.0413445308804512, + 0.0, + 0.21655021235346794, + 0.11579569056630135, + 0.054990123957395554, + 0.063625767827034, + 0.34983759745955467, + 1.0553488582372665, + 0.0, + 0.4607904553413391, + 0.0, + 0.17906636744737625 + ], + "unique_experts": 39, + "load_cv": 1.2680124181346109, + "normalized_load_entropy": 0.8164000087262209, + "max_load_share": 0.08695652173913043 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "7c109b9109ded96708fdad13f65c89672e4fcd4dc7373c98189aa5056be8b43e", + "route_weight_sha256": "ecf2aef88ce277f6238e338e12de519ac1ba36607c7b0670b478a1c5c35ed9d2", + "loads": [ + 10, + 1, + 0, + 2, + 6, + 26, + 2, + 8, + 5, + 13, + 8, + 4, + 6, + 0, + 1, + 4, + 0, + 0, + 9, + 3, + 7, + 4, + 0, + 15, + 10, + 2, + 8, + 13, + 17, + 2, + 7, + 5, + 3, + 11, + 1, + 7, + 2, + 4, + 3, + 1, + 0, + 0, + 3, + 2, + 3, + 0, + 14, + 4, + 7, + 5, + 13, + 13, + 9, + 10, + 5, + 5, + 2, + 3, + 6, + 34, + 3, + 3, + 2, + 8 + ], + "weighted_loads": [ + 0.8894870821386576, + 0.05172812193632126, + 0.0, + 0.07504644989967346, + 0.36215001344680786, + 1.848458981141448, + 0.1419723555445671, + 0.6926677189767361, + 0.3096679374575615, + 0.84958023019135, + 0.5304584205150604, + 0.26172273233532906, + 0.39333631098270416, + 0.0, + 0.07211312651634216, + 0.15684528462588787, + 0.0, + 0.0, + 0.5115908831357956, + 0.17517539486289024, + 0.591825570911169, + 0.14985762909054756, + 0.0, + 1.195982525125146, + 0.6953464783728123, + 0.10405700653791428, + 0.7388003878295422, + 1.4710057824850082, + 1.6869579926133156, + 0.08865208551287651, + 0.3394712544977665, + 0.2443817462772131, + 0.11786669120192528, + 1.1325905062258244, + 0.04847671464085579, + 0.42679421976208687, + 0.09199558570981026, + 0.45401928573846817, + 0.18655582889914513, + 0.058142803609371185, + 0.0, + 0.0, + 0.208406750112772, + 0.08174991980195045, + 0.1234881766140461, + 0.0, + 0.7332788798958063, + 0.14312690123915672, + 0.34935933351516724, + 0.16562173329293728, + 0.8458282202482224, + 1.2517541237175465, + 0.8462636135518551, + 0.8161424584686756, + 0.2996169291436672, + 0.35824228450655937, + 0.10681148990988731, + 0.15391269326210022, + 0.4588117338716984, + 2.2412452325224876, + 0.2523827850818634, + 0.5020495615899563, + 0.10266362503170967, + 0.34061844646930695 + ], + "unique_experts": 56, + "load_cv": 1.0142217870531738, + "normalized_load_entropy": 0.8939373105978903, + "max_load_share": 0.08854166666666667 + } + }, + "s0_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "e52a84f784e94fccc389e61385cd7d6e31cabb3104ebafa1802c15fa2157a8fe", + "route_weight_sha256": "49a7bb0cbcbffa3a90f39bb08ae7c608b0551ae05236ad1bdee8e5546ff75b5b", + "loads": [ + 0, + 0, + 0, + 0, + 2, + 7, + 2, + 3, + 4, + 4, + 8, + 0, + 0, + 0, + 1, + 0, + 0, + 0, + 2, + 0, + 5, + 1, + 0, + 7, + 5, + 2, + 2, + 7, + 5, + 1, + 2, + 5, + 1, + 0, + 0, + 5, + 0, + 0, + 0, + 0, + 0, + 0, + 1, + 1, + 1, + 0, + 6, + 2, + 4, + 3, + 0, + 10, + 0, + 0, + 3, + 2, + 1, + 1, + 6, + 11, + 0, + 2, + 0, + 3 + ], + "weighted_loads": [ + 0.0, + 0.0, + 0.0, + 0.0, + 0.1280820146203041, + 0.41644207388162613, + 0.14150675386190414, + 0.4986192062497139, + 0.1848481334745884, + 0.16125947050750256, + 0.5486112870275974, + 0.0, + 0.0, + 0.0, + 0.08534425497055054, + 0.0, + 0.0, + 0.0, + 0.10165521875023842, + 0.0, + 0.3694593347609043, + 0.050872474908828735, + 0.0, + 0.8076188042759895, + 0.47651276364922523, + 0.08606050536036491, + 0.2948574982583523, + 1.2084857821464539, + 0.33485808968544006, + 0.041223395615816116, + 0.08598454296588898, + 0.22881131805479527, + 0.034215714782476425, + 0.0, + 0.0, + 0.319790069013834, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.09498634189367294, + 0.03679101541638374, + 0.07155652344226837, + 0.0, + 0.2871077749878168, + 0.07377946935594082, + 0.17891150526702404, + 0.11884425207972527, + 0.0, + 0.8578467331826687, + 0.0, + 0.0, + 0.21940799616277218, + 0.1139020323753357, + 0.06282655894756317, + 0.06143404170870781, + 0.4626821279525757, + 0.972453236579895, + 0.0, + 0.453778013586998, + 0.0, + 0.13035020604729652 + ], + "unique_experts": 38, + "load_cv": 1.2439308659084878, + "normalized_load_entropy": 0.817224143150727, + "max_load_share": 0.07971014492753623 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "23a82af8bc6f6f1ede06c35fe285444f311c53b9d36d3dd7e0401dc2efe150e4", + "route_weight_sha256": "1ebbd6a9c371a319f8714cf91c89fb806af88ecf0ae2045f263b3a12617f2ea8", + "loads": [ + 6, + 0, + 0, + 1, + 2, + 18, + 2, + 4, + 4, + 12, + 10, + 3, + 0, + 1, + 1, + 5, + 0, + 0, + 6, + 1, + 5, + 1, + 0, + 16, + 7, + 3, + 9, + 12, + 13, + 1, + 4, + 10, + 1, + 7, + 0, + 5, + 4, + 3, + 2, + 0, + 0, + 0, + 1, + 1, + 3, + 0, + 11, + 5, + 4, + 4, + 2, + 14, + 6, + 8, + 3, + 6, + 2, + 2, + 6, + 25, + 0, + 3, + 0, + 3 + ], + "weighted_loads": [ + 0.6858795024454594, + 0.0, + 0.0, + 0.04007919505238533, + 0.1280820146203041, + 1.3987517766654491, + 0.14150675386190414, + 0.5321929641067982, + 0.1848481334745884, + 0.7098061982542276, + 0.6128203347325325, + 0.19061566516757011, + 0.0, + 0.05189058557152748, + 0.08534425497055054, + 0.2152123562991619, + 0.0, + 0.0, + 0.3005709405988455, + 0.03977340832352638, + 0.3694593347609043, + 0.050872474908828735, + 0.0, + 1.2203639186918736, + 0.5479750446975231, + 0.12059914320707321, + 0.6863267756998539, + 1.5827423445880413, + 1.6619985103607178, + 0.041223395615816116, + 0.2415427416563034, + 0.44976099021732807, + 0.034215714782476425, + 0.7461618557572365, + 0.0, + 0.319790069013834, + 0.16332772560417652, + 0.14396366477012634, + 0.11623524501919746, + 0.0, + 0.0, + 0.0, + 0.09498634189367294, + 0.03679101541638374, + 0.13250350393354893, + 0.0, + 0.5878029186278582, + 0.22896172478795052, + 0.17891150526702404, + 0.1657603159546852, + 0.09593572467565536, + 1.305899953469634, + 0.7604997456073761, + 0.563599769026041, + 0.21940799616277218, + 0.5135846100747585, + 0.10257458686828613, + 0.10193677619099617, + 0.4626821279525757, + 1.6294015198946, + 0.0, + 0.48762981593608856, + 0.0, + 0.13035020604729652 + ], + "unique_experts": 51, + "load_cv": 1.110416449517038, + "normalized_load_entropy": 0.8661685806273363, + "max_load_share": 0.08680555555555555 + } + }, + "s1_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "30da39614ff850b3f89846325fbdb38e55777811adaa222c387014eb9bbf82e2", + "route_weight_sha256": "788360e92498005223b8b022836cbd8bb02019c22dcf99709fca56c202308dcf", + "loads": [ + 0, + 0, + 0, + 0, + 3, + 6, + 2, + 4, + 3, + 3, + 8, + 0, + 0, + 0, + 1, + 0, + 0, + 0, + 2, + 0, + 5, + 1, + 0, + 7, + 5, + 2, + 2, + 7, + 5, + 1, + 2, + 2, + 1, + 0, + 0, + 6, + 1, + 0, + 0, + 0, + 0, + 0, + 1, + 1, + 1, + 0, + 7, + 0, + 5, + 3, + 0, + 10, + 1, + 0, + 4, + 2, + 1, + 1, + 5, + 12, + 0, + 2, + 0, + 3 + ], + "weighted_loads": [ + 0.0, + 0.0, + 0.0, + 0.0, + 0.1673233024775982, + 0.44673947617411613, + 0.137596033513546, + 0.5321646817028522, + 0.14724794775247574, + 0.1373080238699913, + 0.5157805606722832, + 0.0, + 0.0, + 0.0, + 0.0723051205277443, + 0.0, + 0.0, + 0.0, + 0.10826987400650978, + 0.0, + 0.3648323342204094, + 0.048075877130031586, + 0.0, + 0.8234721831977367, + 0.46884966269135475, + 0.0932747833430767, + 0.2550412490963936, + 1.1655199024826288, + 0.2847335897386074, + 0.03926454111933708, + 0.08881807327270508, + 0.13693154603242874, + 0.03529977425932884, + 0.0, + 0.0, + 0.34739328920841217, + 0.03286515176296234, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.10201393067836761, + 0.03597625717520714, + 0.0597691647708416, + 0.0, + 0.29750631749629974, + 0.0, + 0.2084547746926546, + 0.11311592161655426, + 0.0, + 0.8290929384529591, + 0.042633309960365295, + 0.0, + 0.23606025613844395, + 0.1134534627199173, + 0.057156406342983246, + 0.07405204325914383, + 0.33599095046520233, + 1.013014417141676, + 0.0, + 0.46354976296424866, + 0.0, + 0.1502055525779724 + ], + "unique_experts": 39, + "load_cv": 1.2627006527512001, + "normalized_load_entropy": 0.8175614744239069, + "max_load_share": 0.08695652173913043 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "6c185af791937423003a6faf4b206afc8845d96fa74feb7507a128b788d9f393", + "route_weight_sha256": "4bed481fee8afa408594990e8edf05452bbd358ef4244f89af1815193f18b6bd", + "loads": [ + 10, + 1, + 0, + 2, + 7, + 23, + 2, + 8, + 5, + 15, + 8, + 3, + 6, + 0, + 1, + 4, + 0, + 0, + 8, + 3, + 7, + 4, + 0, + 15, + 12, + 3, + 8, + 13, + 18, + 2, + 9, + 5, + 3, + 10, + 1, + 7, + 3, + 4, + 2, + 1, + 0, + 0, + 2, + 2, + 3, + 0, + 12, + 3, + 7, + 6, + 13, + 13, + 9, + 11, + 6, + 5, + 2, + 3, + 6, + 33, + 3, + 3, + 2, + 7 + ], + "weighted_loads": [ + 0.8664036225527525, + 0.05172812193632126, + 0.0, + 0.07645266130566597, + 0.40304190665483475, + 1.651550643146038, + 0.137596033513546, + 0.7041442021727562, + 0.31332969665527344, + 0.977016843855381, + 0.5157805606722832, + 0.21446195244789124, + 0.39333631098270416, + 0.0, + 0.0723051205277443, + 0.15882380679249763, + 0.0, + 0.0, + 0.4740496948361397, + 0.17517539486289024, + 0.5925790145993233, + 0.14952123537659645, + 0.0, + 1.1758162919431925, + 0.8149238340556622, + 0.14100434258580208, + 0.6632004380226135, + 1.415833892300725, + 1.6905528418719769, + 0.08772486448287964, + 0.41610414907336235, + 0.24845901876688004, + 0.11688191443681717, + 1.08174854144454, + 0.04847671464085579, + 0.42771580815315247, + 0.11898114904761314, + 0.4500342532992363, + 0.14007753133773804, + 0.058142803609371185, + 0.0, + 0.0, + 0.15552827715873718, + 0.08255374804139137, + 0.12064415216445923, + 0.0, + 0.6566004138439894, + 0.10923608765006065, + 0.33628599904477596, + 0.2121505755931139, + 0.8559042662382126, + 1.2473243810236454, + 0.8475523926317692, + 0.808987233787775, + 0.3191269729286432, + 0.4721907824277878, + 0.108977772295475, + 0.15982813015580177, + 0.44496508687734604, + 2.165761161595583, + 0.2523827850818634, + 0.5048088692128658, + 0.10266362503170967, + 0.3049241416156292 + ], + "unique_experts": 56, + "load_cv": 0.9904053603337261, + "normalized_load_entropy": 0.8955172630064098, + "max_load_share": 0.0859375 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 13, + "mean_set_jaccard": 0.875776397515528, + "mean_token_weighted_tv": 0.02298081658132698, + "aggregate_load_tv": 0.05072463768115944 + }, + "system_bos": { + "tokens": 23, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.9130434782608697, + "mean_token_weighted_tv": 0.020525092623479988, + "aggregate_load_tv": 0.043478260869565216 + }, + "system_x": { + "tokens": 23, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.9006211180124224, + "mean_token_weighted_tv": 0.02731570143900488, + "aggregate_load_tv": 0.05797101449275363 + }, + "system_period": { + "tokens": 23, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8788819875776398, + "mean_token_weighted_tv": 0.034211219045455044, + "aggregate_load_tv": 0.06521739130434784 + }, + "bos_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 8, + "set_exact_tokens": 12, + "mean_set_jaccard": 0.8540372670807455, + "mean_token_weighted_tv": 0.031179275282699127, + "aggregate_load_tv": 0.06521739130434784 + }, + "bos_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 13, + "mean_set_jaccard": 0.875776397515528, + "mean_token_weighted_tv": 0.02659608533039041, + "aggregate_load_tv": 0.05072463768115943 + }, + "x_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 7, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8695652173913043, + "mean_token_weighted_tv": 0.03273134929654391, + "aggregate_load_tv": 0.04347826086956523 + }, + "x_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8788819875776398, + "mean_token_weighted_tv": 0.03600261429243762, + "aggregate_load_tv": 0.050724637681159424 + }, + "period_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.9006211180124224, + "mean_token_weighted_tv": 0.026079443971747936, + "aggregate_load_tv": 0.03623188405797102 + }, + "period_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 12, + "mean_set_jaccard": 0.8633540372670809, + "mean_token_weighted_tv": 0.03927230928093195, + "aggregate_load_tv": 0.050724637681159424 + } + } + }, + "layer_15": { + "layer": 15, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "a1edc901f25ae5b776878e228619bdb5e0b7fb5e8c459d33da96ef8e65f29581", + "route_weight_sha256": "ec905b6c81075fc538a50afda0e06fe53d72c150b7610f6093bdcb3c36cbd25f", + "loads": [ + 0, + 4, + 0, + 3, + 3, + 6, + 0, + 0, + 5, + 1, + 2, + 2, + 1, + 0, + 5, + 1, + 0, + 2, + 0, + 1, + 6, + 0, + 1, + 0, + 8, + 5, + 3, + 4, + 7, + 0, + 1, + 2, + 1, + 5, + 1, + 0, + 1, + 4, + 0, + 3, + 8, + 4, + 0, + 1, + 3, + 0, + 1, + 2, + 3, + 2, + 0, + 1, + 4, + 1, + 4, + 5, + 6, + 0, + 2, + 0, + 1, + 1, + 0, + 1 + ], + "weighted_loads": [ + 0.0, + 0.1543765813112259, + 0.0, + 0.09894685633480549, + 0.16160064190626144, + 0.4606301747262478, + 0.0, + 0.0, + 0.19988926500082016, + 0.030704379081726074, + 0.4461369067430496, + 0.06272907508537173, + 0.05942538380622864, + 0.0, + 0.6330121047794819, + 0.03304824233055115, + 0.0, + 0.3526555374264717, + 0.0, + 0.03169557824730873, + 0.28136491775512695, + 0.0, + 0.02786959894001484, + 0.0, + 0.6293771862983704, + 0.2018626630306244, + 0.4983362630009651, + 0.221134714782238, + 0.5162832774221897, + 0.0, + 0.03253293037414551, + 0.37202636152505875, + 0.02019812911748886, + 0.21332812309265137, + 0.08291885256767273, + 0.0, + 0.052746668457984924, + 0.25189922004938126, + 0.0, + 0.1287860944867134, + 0.7731854617595673, + 0.5612729415297508, + 0.0, + 0.04510941728949547, + 0.17750731855630875, + 0.0, + 0.1207985058426857, + 0.06365263741463423, + 0.10260018147528172, + 0.08722136542201042, + 0.0, + 0.06723548471927643, + 0.09773697704076767, + 0.04982355237007141, + 0.19156990200281143, + 1.4226724319159985, + 0.5513971745967865, + 0.0, + 0.16277757659554482, + 0.0, + 0.032535962760448456, + 0.0283519197255373, + 0.0, + 0.04776528477668762 + ], + "unique_experts": 46, + "load_cv": 1.0148032651094037, + "normalized_load_entropy": 0.8674130895928001, + "max_load_share": 0.057971014492753624 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "499c7c8221df8047198bd07085b92ef2378a7979a5ca9b3c5361889d709abb0e", + "route_weight_sha256": "9bd08b2767549e88d370ac7de5e57728749977c12135213a301819adfab05645", + "loads": [ + 5, + 4, + 0, + 3, + 9, + 9, + 9, + 2, + 10, + 2, + 6, + 3, + 5, + 0, + 15, + 2, + 7, + 4, + 0, + 2, + 6, + 0, + 1, + 5, + 13, + 7, + 12, + 4, + 11, + 0, + 5, + 2, + 7, + 7, + 1, + 0, + 6, + 4, + 3, + 3, + 14, + 5, + 0, + 3, + 3, + 0, + 1, + 3, + 4, + 12, + 5, + 3, + 9, + 1, + 4, + 9, + 6, + 0, + 3, + 0, + 1, + 3, + 0, + 5 + ], + "weighted_loads": [ + 0.2668056320399046, + 0.1543765813112259, + 0.0, + 0.09894685633480549, + 0.5134789161384106, + 0.5330828232690692, + 0.6902018524706364, + 0.06800157949328423, + 0.5784921981394291, + 0.06211717426776886, + 0.5954420547932386, + 0.09287751419469714, + 0.3740432821214199, + 0.0, + 1.0119832949712873, + 0.07271076366305351, + 0.6038910262286663, + 0.4254666529595852, + 0.0, + 0.11057483032345772, + 0.28136491775512695, + 0.0, + 0.02786959894001484, + 0.2793641611933708, + 0.7663820988964289, + 0.25926378555595875, + 1.1095310375094414, + 0.221134714782238, + 0.6617793068289757, + 0.0, + 0.20232836343348026, + 0.37202636152505875, + 0.47471256367862225, + 0.3019496910274029, + 0.08291885256767273, + 0.0, + 0.7608398320153356, + 0.25189922004938126, + 0.08142245374619961, + 0.1287860944867134, + 1.336635746061802, + 0.5655624023638666, + 0.0, + 0.13171550258994102, + 0.17750731855630875, + 0.0, + 0.1207985058426857, + 0.09804708417505026, + 0.11611081194132566, + 1.816831685602665, + 0.30777060613036156, + 0.1488942801952362, + 0.25200332421809435, + 0.04982355237007141, + 0.19156990200281143, + 3.0884132869541645, + 0.5513971745967865, + 0.0, + 0.20805853605270386, + 0.0, + 0.032535962760448456, + 0.11581634916365147, + 0.0, + 0.22314877808094025 + ], + "unique_experts": 53, + "load_cv": 0.8489281549964515, + "normalized_load_entropy": 0.9059642397123315, + "max_load_share": 0.052083333333333336 + } + }, + "s1_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "fab5e471fa62bd6c82cf5f47e442ff6c4f8fccbfbd9dc884da7860e2e38c20df", + "route_weight_sha256": "1cd609479b7b6255802c87a7047439d85948efea85d5d1e4d570dfa5f23868a1", + "loads": [ + 0, + 4, + 0, + 2, + 3, + 6, + 0, + 0, + 5, + 1, + 2, + 2, + 1, + 0, + 5, + 1, + 0, + 2, + 0, + 1, + 6, + 0, + 1, + 0, + 8, + 5, + 3, + 4, + 7, + 0, + 1, + 2, + 1, + 4, + 1, + 0, + 1, + 4, + 0, + 3, + 9, + 4, + 0, + 1, + 3, + 0, + 2, + 2, + 3, + 2, + 0, + 1, + 3, + 2, + 4, + 5, + 6, + 0, + 2, + 0, + 1, + 1, + 0, + 1 + ], + "weighted_loads": [ + 0.0, + 0.15056252852082253, + 0.0, + 0.0700000561773777, + 0.14841308444738388, + 0.47105878219008446, + 0.0, + 0.0, + 0.19897845946252346, + 0.030315257608890533, + 0.447423979640007, + 0.058537247590720654, + 0.05916938930749893, + 0.0, + 0.6319994404911995, + 0.03681878745555878, + 0.0, + 0.3440629690885544, + 0.0, + 0.03389611095190048, + 0.2738714851438999, + 0.0, + 0.02656456083059311, + 0.0, + 0.6313758324831724, + 0.19992252439260483, + 0.48998551443219185, + 0.22352291643619537, + 0.5142823215574026, + 0.0, + 0.031477190554142, + 0.34373175352811813, + 0.018428606912493706, + 0.18558228760957718, + 0.08106767386198044, + 0.0, + 0.05222466215491295, + 0.24808959662914276, + 0.0, + 0.1343085616827011, + 0.8122166376560926, + 0.5512868855148554, + 0.0, + 0.04474726319313049, + 0.17792833596467972, + 0.0, + 0.14809185452759266, + 0.06267497222870588, + 0.1011971440166235, + 0.08755720779299736, + 0.0, + 0.06660553067922592, + 0.07568032667040825, + 0.07739811204373837, + 0.18230202049016953, + 1.403303999453783, + 0.538018312305212, + 0.0, + 0.17063511908054352, + 0.0, + 0.03509478271007538, + 0.03034270741045475, + 0.0, + 0.047923650592565536 + ], + "unique_experts": 46, + "load_cv": 1.018109495054115, + "normalized_load_entropy": 0.8687178184109837, + "max_load_share": 0.06521739130434782 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "57fed0a90555c952e02fda250ed29a1ba4a627e5b2c05e1747d5c37e86ced630", + "route_weight_sha256": "0e31113e95f888afa50d082a3f4d050cf25e783643832623744cbe72fd2e2136", + "loads": [ + 20, + 5, + 0, + 2, + 13, + 12, + 14, + 1, + 15, + 2, + 7, + 6, + 6, + 1, + 11, + 11, + 12, + 5, + 1, + 5, + 7, + 1, + 1, + 5, + 12, + 6, + 13, + 6, + 13, + 1, + 7, + 6, + 7, + 6, + 3, + 0, + 7, + 4, + 2, + 4, + 15, + 6, + 0, + 3, + 3, + 1, + 2, + 4, + 6, + 16, + 8, + 3, + 4, + 3, + 4, + 9, + 6, + 6, + 4, + 4, + 1, + 8, + 2, + 6 + ], + "weighted_loads": [ + 1.3282770477235317, + 0.1766553558409214, + 0.0, + 0.0700000561773777, + 0.6561215743422508, + 0.7064119055867195, + 1.1696565318852663, + 0.033466704189777374, + 0.7896605953574181, + 0.061450645327568054, + 0.6808344796299934, + 0.39177371840924025, + 0.4842614158987999, + 0.08141332864761353, + 0.8341049989685416, + 0.7041070442646742, + 1.0994097590446472, + 0.4585530199110508, + 0.05279861018061638, + 0.3032469004392624, + 0.3027512412518263, + 0.08194843679666519, + 0.02656456083059311, + 0.255330890417099, + 0.7213360816240311, + 0.2282501794397831, + 1.1802129112184048, + 0.34776705875992775, + 0.943721579387784, + 0.03784303739666939, + 0.2542140930891037, + 0.7878355570137501, + 0.4374123550951481, + 0.30255991965532303, + 0.23051442578434944, + 0.0, + 0.7172843078151345, + 0.24808959662914276, + 0.05801291577517986, + 0.17035944759845734, + 1.293678133515641, + 0.6428517363965511, + 0.0, + 0.31850429624319077, + 0.17792833596467972, + 0.03965635970234871, + 0.14809185452759266, + 0.12599042896181345, + 0.24434014316648245, + 2.6342364475131035, + 0.39344505220651627, + 0.1371046081185341, + 0.08957717288285494, + 0.21150191687047482, + 0.18230202049016953, + 3.0511003397405148, + 0.538018312305212, + 0.6625599414110184, + 0.25144951045513153, + 0.17298150435090065, + 0.03509478271007538, + 0.4086249116808176, + 0.11951877921819687, + 0.2565489783883095 + ], + "unique_experts": 61, + "load_cv": 0.7551903733496608, + "normalized_load_entropy": 0.9308102366395279, + "max_load_share": 0.052083333333333336 + } + }, + "s0_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "def22a8ca6198d3310202dbc56867dc4c69315304a19b6df8dea79a6cce6a37f", + "route_weight_sha256": "3b33b5b4df29b8ed4d479abd14866d8fcf7ef55e8373aad2b9557343514e6081", + "loads": [ + 1, + 4, + 0, + 3, + 3, + 5, + 0, + 0, + 4, + 1, + 3, + 2, + 1, + 0, + 5, + 1, + 0, + 2, + 0, + 1, + 6, + 0, + 1, + 0, + 7, + 4, + 3, + 4, + 8, + 0, + 1, + 2, + 1, + 5, + 1, + 0, + 2, + 4, + 1, + 3, + 8, + 4, + 0, + 1, + 3, + 0, + 2, + 2, + 3, + 2, + 1, + 1, + 2, + 1, + 4, + 4, + 6, + 0, + 2, + 0, + 1, + 1, + 0, + 1 + ], + "weighted_loads": [ + 0.040639884769916534, + 0.14143321104347706, + 0.0, + 0.10669281333684921, + 0.1608307920396328, + 0.4324801992624998, + 0.0, + 0.0, + 0.1634772177785635, + 0.03108268976211548, + 0.4778802990913391, + 0.062429682817310095, + 0.060832273215055466, + 0.0, + 0.6190252602100372, + 0.033259376883506775, + 0.0, + 0.3435092568397522, + 0.0, + 0.033653248101472855, + 0.2754876147955656, + 0.0, + 0.028835177421569824, + 0.0, + 0.6316270083189011, + 0.16741226613521576, + 0.5045841000974178, + 0.2150660865008831, + 0.5502589549869299, + 0.0, + 0.03264051675796509, + 0.3552071042358875, + 0.019798606634140015, + 0.22331055998802185, + 0.07384871691465378, + 0.0, + 0.08104240708053112, + 0.27084682509303093, + 0.03545030951499939, + 0.15328441187739372, + 0.7659526709467173, + 0.560405608266592, + 0.0, + 0.04949791356921196, + 0.20117086172103882, + 0.0, + 0.14468838833272457, + 0.06361169368028641, + 0.09257572889328003, + 0.08976641297340393, + 0.033067088574171066, + 0.06514978408813477, + 0.03996418183669448, + 0.05040622130036354, + 0.19066854752600193, + 1.3916414938867092, + 0.5595001466572285, + 0.0, + 0.16143998131155968, + 0.0, + 0.03796132281422615, + 0.028998635709285736, + 0.0, + 0.04829658195376396 + ], + "unique_experts": 49, + "load_cv": 0.9533324079822425, + "normalized_load_entropy": 0.8842901046302846, + "max_load_share": 0.057971014492753624 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "af373dd60a5f39aa76b1f54871668e15c8aca6e50c7e9c763148eacc41def603", + "route_weight_sha256": "4394e1187889952dd6170088523da7cc7ccb0a240c74ad8e419d78cddbd60f07", + "loads": [ + 6, + 4, + 0, + 3, + 10, + 8, + 8, + 2, + 8, + 2, + 7, + 3, + 5, + 0, + 14, + 2, + 7, + 4, + 0, + 2, + 6, + 0, + 1, + 5, + 11, + 5, + 12, + 4, + 13, + 0, + 6, + 2, + 7, + 7, + 1, + 1, + 8, + 4, + 2, + 3, + 15, + 4, + 0, + 3, + 3, + 0, + 2, + 3, + 4, + 11, + 7, + 4, + 7, + 2, + 6, + 6, + 6, + 0, + 3, + 0, + 1, + 3, + 0, + 5 + ], + "weighted_loads": [ + 0.31195355020463467, + 0.14143321104347706, + 0.0, + 0.10669281333684921, + 0.49691831320524216, + 0.5401759389787912, + 0.5288807265460491, + 0.06800157949328423, + 0.5089440774172544, + 0.062495484948158264, + 0.6271854471415281, + 0.0925781219266355, + 0.3797892928123474, + 0.0, + 0.9878823310136795, + 0.07292189821600914, + 0.5943608582019806, + 0.4163203723728657, + 0.0, + 0.11253250017762184, + 0.2754876147955656, + 0.0, + 0.028835177421569824, + 0.2793641611933708, + 0.7809278499335051, + 0.19579549692571163, + 1.115778874605894, + 0.2150660865008831, + 0.7654653880745173, + 0.0, + 0.25970990397036076, + 0.3552071042358875, + 0.48103819228708744, + 0.31193212792277336, + 0.07384871691465378, + 0.10323166102170944, + 0.8225550977513194, + 0.27084682509303093, + 0.06630004197359085, + 0.15328441187739372, + 1.370865186676383, + 0.560405608266592, + 0.0, + 0.13610399886965752, + 0.20117086172103882, + 0.0, + 0.14468838833272457, + 0.09800614044070244, + 0.10608635935932398, + 1.6270526424050331, + 0.41490568220615387, + 0.19516068324446678, + 0.19423052901402116, + 0.11627192422747612, + 0.2921715248376131, + 2.0361452288925648, + 0.5595001466572285, + 0.0, + 0.20672094076871872, + 0.0, + 0.03796132281422615, + 0.1164630651473999, + 0.0, + 0.24078474938869476 + ], + "unique_experts": 54, + "load_cv": 0.8174410538645644, + "normalized_load_entropy": 0.912693756366686, + "max_load_share": 0.052083333333333336 + } + }, + "s1_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "2b6c1fc4df49536e380bd459b0244b06dea4b9a95e5beef4d10a82a583cdca63", + "route_weight_sha256": "9c645270e9e04b6872be2104f55a31a432a3d6bd42061595a0dc1cfcbe150cb2", + "loads": [ + 0, + 4, + 0, + 3, + 3, + 5, + 0, + 0, + 5, + 1, + 2, + 2, + 1, + 1, + 5, + 1, + 0, + 2, + 0, + 1, + 6, + 1, + 0, + 0, + 8, + 5, + 3, + 4, + 6, + 0, + 0, + 2, + 1, + 4, + 1, + 0, + 2, + 4, + 1, + 3, + 8, + 4, + 0, + 1, + 3, + 0, + 2, + 3, + 3, + 2, + 1, + 1, + 2, + 2, + 4, + 4, + 6, + 0, + 2, + 0, + 1, + 1, + 0, + 1 + ], + "weighted_loads": [ + 0.0, + 0.1529211848974228, + 0.0, + 0.09822404012084007, + 0.15777023509144783, + 0.45040296763181686, + 0.0, + 0.0, + 0.2076582033187151, + 0.031877271831035614, + 0.39665861427783966, + 0.05576480785384774, + 0.05933046340942383, + 0.03093653917312622, + 0.5830871053040028, + 0.03758372738957405, + 0.0, + 0.345103420317173, + 0.0, + 0.03320705145597458, + 0.2758778650313616, + 0.027848215773701668, + 0.0, + 0.0, + 0.6364873815327883, + 0.19579780846834183, + 0.5179352425038815, + 0.21930275857448578, + 0.5059951096773148, + 0.0, + 0.0, + 0.3488469794392586, + 0.017730459570884705, + 0.19107893481850624, + 0.07260703295469284, + 0.0, + 0.08014337904751301, + 0.25249622389674187, + 0.03557760268449783, + 0.14498330652713776, + 0.7662841137498617, + 0.5398747641593218, + 0.0, + 0.048968348652124405, + 0.1950141154229641, + 0.0, + 0.1442843470722437, + 0.08979417756199837, + 0.09370598196983337, + 0.09095945954322815, + 0.03824625536799431, + 0.061929959803819656, + 0.03996426658704877, + 0.07777864299714565, + 0.18681739643216133, + 1.4099890477955341, + 0.5511312708258629, + 0.0, + 0.16460717469453812, + 0.0, + 0.034159302711486816, + 0.028540901839733124, + 0.0, + 0.04857618734240532 + ], + "unique_experts": 48, + "load_cv": 0.9498007175542577, + "normalized_load_entropy": 0.8825172410742936, + "max_load_share": 0.057971014492753624 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "84b81efec78080fb436f26704da1fd25c53ccb86fafed2b4f2b0a25798dfee8c", + "route_weight_sha256": "ea1c00ee33beb78b08114e2caf0c25e259766f27d453c8753c18c9ff19b7d26b", + "loads": [ + 21, + 5, + 0, + 3, + 14, + 11, + 14, + 1, + 14, + 2, + 7, + 6, + 6, + 2, + 10, + 11, + 12, + 5, + 1, + 5, + 7, + 2, + 0, + 5, + 13, + 6, + 13, + 6, + 12, + 1, + 7, + 6, + 7, + 6, + 3, + 0, + 9, + 4, + 2, + 4, + 14, + 5, + 0, + 3, + 3, + 1, + 2, + 5, + 6, + 16, + 10, + 3, + 3, + 3, + 4, + 7, + 6, + 6, + 4, + 4, + 1, + 8, + 2, + 5 + ], + "weighted_loads": [ + 1.4213694967329502, + 0.17901401221752167, + 0.0, + 0.09822404012084007, + 0.6428347211331129, + 0.7399786002933979, + 1.0592275578528643, + 0.033466704189777374, + 0.7451315000653267, + 0.06301265954971313, + 0.6300691142678261, + 0.38900127867236733, + 0.47670362517237663, + 0.11234986782073975, + 0.773653082549572, + 0.7048719841986895, + 1.0773167200386524, + 0.4595934711396694, + 0.05279861018061638, + 0.3025578409433365, + 0.30475762113928795, + 0.10979665257036686, + 0.0, + 0.255330890417099, + 0.8254662472754717, + 0.2241254635155201, + 1.2081626392900944, + 0.34354690089821815, + 0.9354343675076962, + 0.03784303739666939, + 0.2727034166455269, + 0.7929507829248905, + 0.4367142077535391, + 0.3080565668642521, + 0.22205378487706184, + 0.0, + 0.7745565427467227, + 0.25249622389674187, + 0.06777667999267578, + 0.18103419244289398, + 1.3240780755877495, + 0.6272436399012804, + 0.0, + 0.3227253817021847, + 0.1950141154229641, + 0.03965635970234871, + 0.1442843470722437, + 0.16213738918304443, + 0.23684898111969233, + 2.5169838815927505, + 0.46392589807510376, + 0.13242903724312782, + 0.05386111279949546, + 0.2118824478238821, + 0.18681739643216133, + 2.119394462555647, + 0.5511312708258629, + 0.6625599414110184, + 0.24542156606912613, + 0.17298150435090065, + 0.034159302711486816, + 0.406823106110096, + 0.11951877921819687, + 0.2302187867462635 + ], + "unique_experts": 60, + "load_cv": 0.7528879583163605, + "normalized_load_entropy": 0.9311857857666922, + "max_load_share": 0.0546875 + } + }, + "s0_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "4b797aed200c8aacf80204f023076a95b275292d4832b2583afe16a32455f850", + "route_weight_sha256": "030ecf08a274fe79b5901fc6b7fed4d3af03a21c4d795c96a146a40e22ecf8d1", + "loads": [ + 0, + 4, + 0, + 2, + 3, + 6, + 0, + 0, + 5, + 1, + 2, + 2, + 1, + 0, + 5, + 1, + 0, + 2, + 0, + 1, + 6, + 0, + 1, + 0, + 7, + 4, + 3, + 4, + 7, + 0, + 1, + 2, + 1, + 4, + 1, + 0, + 2, + 4, + 1, + 3, + 8, + 4, + 0, + 1, + 3, + 0, + 2, + 2, + 3, + 2, + 1, + 1, + 3, + 2, + 4, + 4, + 6, + 0, + 2, + 0, + 1, + 1, + 1, + 1 + ], + "weighted_loads": [ + 0.0, + 0.14445634558796883, + 0.0, + 0.06275689601898193, + 0.17168856412172318, + 0.4443649295717478, + 0.0, + 0.0, + 0.22606924921274185, + 0.03302205353975296, + 0.47266314923763275, + 0.06552426097914577, + 0.06504552066326141, + 0.0, + 0.5600828751921654, + 0.03474980965256691, + 0.0, + 0.36980318278074265, + 0.0, + 0.03293423727154732, + 0.3031922895461321, + 0.0, + 0.029307303950190544, + 0.0, + 0.6290347035974264, + 0.1523977555334568, + 0.508565042167902, + 0.2199089266359806, + 0.523754209280014, + 0.0, + 0.034314464777708054, + 0.3509332910180092, + 0.018314924091100693, + 0.18184850364923477, + 0.06801368296146393, + 0.0, + 0.08251052163541317, + 0.27014346793293953, + 0.03615255281329155, + 0.14375194162130356, + 0.7609903421252966, + 0.5720480717718601, + 0.0, + 0.04940054938197136, + 0.1975337713956833, + 0.0, + 0.14706320315599442, + 0.06111070606857538, + 0.09690629318356514, + 0.08788154274225235, + 0.03809436038136482, + 0.06879125535488129, + 0.06555100297555327, + 0.08098754659295082, + 0.20462510362267494, + 1.3920910842716694, + 0.5416180677711964, + 0.0, + 0.1666327752172947, + 0.0, + 0.03377397358417511, + 0.03377746790647507, + 0.03907687962055206, + 0.04452956095337868 + ], + "unique_experts": 49, + "load_cv": 0.9426976445188068, + "normalized_load_entropy": 0.8857433274779538, + "max_load_share": 0.057971014492753624 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "85002faf3e06740a8138af0adff31e2776f9000b0eda907eb7d153f5bc3537a0", + "route_weight_sha256": "292d87049b00e8c175074bb985a654ab36e5fb6c81aad87a94c8905f127e6901", + "loads": [ + 4, + 4, + 0, + 2, + 10, + 8, + 9, + 2, + 10, + 2, + 7, + 3, + 5, + 0, + 14, + 2, + 7, + 4, + 0, + 3, + 6, + 0, + 1, + 6, + 11, + 6, + 13, + 4, + 11, + 0, + 6, + 2, + 6, + 6, + 1, + 0, + 7, + 4, + 3, + 3, + 14, + 4, + 0, + 4, + 3, + 0, + 2, + 4, + 4, + 10, + 6, + 3, + 9, + 3, + 4, + 7, + 6, + 0, + 3, + 0, + 1, + 4, + 1, + 4 + ], + "weighted_loads": [ + 0.2660387400537729, + 0.14445634558796883, + 0.0, + 0.06275689601898193, + 0.5369030684232712, + 0.49994909577071667, + 0.6817395463585854, + 0.06800157949328423, + 0.6280135661363602, + 0.06443484872579575, + 0.688266983255744, + 0.09567270008847117, + 0.3832944370806217, + 0.0, + 0.9289399459958076, + 0.07441233098506927, + 0.6052850298583508, + 0.4426142983138561, + 0.0, + 0.16037093102931976, + 0.3031922895461321, + 0.0, + 0.029307303950190544, + 0.37817542254924774, + 0.7523435652256012, + 0.219373332336545, + 1.2323295436799526, + 0.2199089266359806, + 0.6692502386868, + 0.0, + 0.2490359041839838, + 0.3509332910180092, + 0.4440337736159563, + 0.2704700715839863, + 0.06801368296146393, + 0.0, + 0.7492274222895503, + 0.27014346793293953, + 0.11737444996833801, + 0.14375194162130356, + 1.274336813017726, + 0.5720480717718601, + 0.0, + 0.21376367285847664, + 0.1975337713956833, + 0.0, + 0.14706320315599442, + 0.14699640963226557, + 0.11041692364960909, + 1.3729507699608803, + 0.34337645024061203, + 0.15045005083084106, + 0.2572887004353106, + 0.116022489964962, + 0.20462510362267494, + 2.0882790237665176, + 0.5416180677711964, + 0.0, + 0.21191373467445374, + 0.0, + 0.03377397358417511, + 0.18928994983434677, + 0.03907687962055206, + 0.17781761288642883 + ], + "unique_experts": 54, + "load_cv": 0.8021960598996473, + "normalized_load_entropy": 0.9149709950436128, + "max_load_share": 0.04861111111111111 + } + }, + "s1_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "194e97ddcefd5b37bb265e96e625ea6321d422452d368fd602157f144ad2cc71", + "route_weight_sha256": "4df84490679d1b8cb8666c1f87d72b9797c3ac53ee7ae9d1064c15227c867b60", + "loads": [ + 0, + 3, + 0, + 1, + 3, + 4, + 0, + 0, + 5, + 1, + 3, + 2, + 2, + 0, + 7, + 1, + 0, + 2, + 0, + 0, + 6, + 1, + 1, + 0, + 8, + 5, + 3, + 4, + 7, + 0, + 1, + 2, + 0, + 4, + 1, + 0, + 1, + 4, + 1, + 3, + 8, + 4, + 0, + 1, + 3, + 0, + 3, + 2, + 2, + 2, + 1, + 3, + 2, + 2, + 4, + 4, + 6, + 0, + 2, + 0, + 1, + 1, + 0, + 1 + ], + "weighted_loads": [ + 0.0, + 0.11052372120320797, + 0.0, + 0.04081936180591583, + 0.1556187942624092, + 0.3703279681503773, + 0.0, + 0.0, + 0.25051576271653175, + 0.03236899897456169, + 0.43285633996129036, + 0.053843215107917786, + 0.09289603866636753, + 0.0, + 0.6128663830459118, + 0.03850029408931732, + 0.0, + 0.3480725362896919, + 0.0, + 0.0, + 0.3314920775592327, + 0.02716020867228508, + 0.026973916217684746, + 0.0, + 0.664463222026825, + 0.19247587211430073, + 0.46993622928857803, + 0.22693556919693947, + 0.48644905537366867, + 0.0, + 0.03324798494577408, + 0.35448452085256577, + 0.0, + 0.17202896252274513, + 0.06903574615716934, + 0.0, + 0.05564279109239578, + 0.25711629912257195, + 0.03976580873131752, + 0.13921723142266273, + 0.7442843168973923, + 0.5567856207489967, + 0.0, + 0.04855776205658913, + 0.18861082941293716, + 0.0, + 0.1798863299190998, + 0.05645408108830452, + 0.07144122198224068, + 0.0744537003338337, + 0.03736886754631996, + 0.11617005243897438, + 0.040623839013278484, + 0.07921300642192364, + 0.18571743741631508, + 1.3379720114171505, + 0.5335994549095631, + 0.0, + 0.1633422151207924, + 0.0, + 0.03472033143043518, + 0.028798630461096764, + 0.0, + 0.04335803911089897 + ], + "unique_experts": 47, + "load_cv": 0.9845476999581908, + "normalized_load_entropy": 0.8760814917291616, + "max_load_share": 0.057971014492753624 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "aee0a3ad4259dd9542e5833dc7617331b8283151d054d0bc4e6cc63a54e39585", + "route_weight_sha256": "f1cf5026caa4afe50b2bd421d44fdffa059a6b3a5f840ea94837edb144b8615a", + "loads": [ + 21, + 4, + 0, + 1, + 13, + 8, + 14, + 1, + 16, + 2, + 9, + 6, + 7, + 1, + 12, + 12, + 12, + 5, + 1, + 5, + 7, + 2, + 1, + 6, + 11, + 6, + 14, + 6, + 13, + 2, + 7, + 6, + 7, + 6, + 3, + 0, + 7, + 4, + 3, + 4, + 12, + 5, + 0, + 4, + 3, + 1, + 3, + 4, + 5, + 16, + 7, + 6, + 3, + 3, + 4, + 7, + 6, + 6, + 4, + 4, + 1, + 9, + 2, + 4 + ], + "weighted_loads": [ + 1.4282884411513805, + 0.13661654852330685, + 0.0, + 0.04081936180591583, + 0.6130759157240391, + 0.5804312378168106, + 1.1834575776010752, + 0.033466704189777374, + 0.9346303548663855, + 0.06350438669323921, + 0.7189303338527679, + 0.3870796859264374, + 0.5363766495138407, + 0.08141332864761353, + 0.803432360291481, + 0.7407297026365995, + 1.0563126802444458, + 0.46256258711218834, + 0.05279861018061638, + 0.32167817279696465, + 0.3603718336671591, + 0.10910864546895027, + 0.026973916217684746, + 0.32786131650209427, + 0.7507515735924244, + 0.220803527161479, + 1.2860785722732544, + 0.35117971152067184, + 0.9158883132040501, + 0.0659666433930397, + 0.2559848874807358, + 0.7985883243381977, + 0.4729198757559061, + 0.289006594568491, + 0.21848249807953835, + 0.0, + 0.6244229832664132, + 0.25711629912257195, + 0.11809030920267105, + 0.17526811733841896, + 1.111562306061387, + 0.6441544964909554, + 0.0, + 0.45153262838721275, + 0.18861082941293716, + 0.03965635970234871, + 0.1798863299190998, + 0.15443960949778557, + 0.21458422113209963, + 2.0698931477963924, + 0.27145102992653847, + 0.22165299206972122, + 0.054520685225725174, + 0.2133168112486601, + 0.18571743741631508, + 2.013965029269457, + 0.5335994549095631, + 0.6625599414110184, + 0.2441566064953804, + 0.17298150435090065, + 0.03472033143043518, + 0.45818877778947353, + 0.11951877921819687, + 0.1681700311601162 + ], + "unique_experts": 61, + "load_cv": 0.7482618748361655, + "normalized_load_entropy": 0.9332737469241354, + "max_load_share": 0.0546875 + } + }, + "s0_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "0edc6fbdacd50ce0ad155d65b0ecb98f8235da80f33b8d8a11d5dc8c4f430097", + "route_weight_sha256": "bb6adff60af0e411f581aff4161b718c1267f55cceb4c1072a84fb267ef24eca", + "loads": [ + 0, + 4, + 0, + 3, + 3, + 6, + 0, + 0, + 5, + 1, + 2, + 2, + 1, + 0, + 5, + 1, + 0, + 2, + 0, + 1, + 5, + 0, + 1, + 0, + 7, + 5, + 3, + 4, + 7, + 0, + 1, + 2, + 1, + 5, + 1, + 0, + 2, + 4, + 1, + 3, + 8, + 4, + 0, + 1, + 3, + 0, + 2, + 3, + 3, + 2, + 1, + 1, + 2, + 1, + 4, + 4, + 6, + 0, + 2, + 0, + 1, + 1, + 0, + 1 + ], + "weighted_loads": [ + 0.0, + 0.14186445623636246, + 0.0, + 0.09679223597049713, + 0.18295657634735107, + 0.4380423538386822, + 0.0, + 0.0, + 0.21879499219357967, + 0.033215101808309555, + 0.4421393573284149, + 0.0638732765801251, + 0.06089409813284874, + 0.0, + 0.5581882484257221, + 0.03609379008412361, + 0.0, + 0.3518333286046982, + 0.0, + 0.03619563579559326, + 0.26696428656578064, + 0.0, + 0.029560798779129982, + 0.0, + 0.6314903907477856, + 0.19011233001947403, + 0.4926690421998501, + 0.21611302345991135, + 0.5232909210026264, + 0.0, + 0.03407371789216995, + 0.35066407173871994, + 0.01922040991485119, + 0.20817014016211033, + 0.07044447958469391, + 0.0, + 0.08143270574510098, + 0.2686487250030041, + 0.037732139229774475, + 0.1392141878604889, + 0.7637831531465054, + 0.5603392384946346, + 0.0, + 0.04918853938579559, + 0.19417300820350647, + 0.0, + 0.14738759025931358, + 0.08700442686676979, + 0.09645913541316986, + 0.09458834305405617, + 0.04176240414381027, + 0.06554659456014633, + 0.03954634862020612, + 0.051013119518756866, + 0.205436609685421, + 1.3978664837777615, + 0.5653257928788662, + 0.0, + 0.17173627391457558, + 0.0, + 0.033060457557439804, + 0.03387214243412018, + 0.0, + 0.04510215297341347 + ], + "unique_experts": 48, + "load_cv": 0.9568510632025544, + "normalized_load_entropy": 0.8808229966553125, + "max_load_share": 0.057971014492753624 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "9e2e1a9c67759d02a63c75c086ea98cada5e006a4c83586005ef075d0197a733", + "route_weight_sha256": "ede126bee1227ecd199c797ece420d328c358f38e675e20172dd0434c48cf1b2", + "loads": [ + 4, + 4, + 0, + 3, + 9, + 8, + 10, + 2, + 10, + 2, + 6, + 4, + 5, + 0, + 14, + 2, + 7, + 4, + 0, + 2, + 5, + 0, + 1, + 6, + 11, + 7, + 13, + 4, + 11, + 0, + 6, + 2, + 7, + 7, + 1, + 0, + 8, + 4, + 3, + 3, + 14, + 4, + 0, + 3, + 3, + 0, + 2, + 5, + 4, + 10, + 6, + 3, + 7, + 2, + 4, + 7, + 6, + 0, + 4, + 0, + 1, + 4, + 0, + 4 + ], + "weighted_loads": [ + 0.2611934933811426, + 0.14186445623636246, + 0.0, + 0.09679223597049713, + 0.5587965771555901, + 0.48439136520028114, + 0.6507478505373001, + 0.06800157949328423, + 0.6100626867264509, + 0.06462789699435234, + 0.5914445053786039, + 0.12809706898406148, + 0.3559470474720001, + 0.0, + 0.9270453192293644, + 0.07575631141662598, + 0.6269105561077595, + 0.42464444413781166, + 0.0, + 0.11507488787174225, + 0.26696428656578064, + 0.0, + 0.029560798779129982, + 0.36367955058813095, + 0.7660455424338579, + 0.25489882938563824, + 1.1471420340240002, + 0.21611302345991135, + 0.6687869504094124, + 0.0, + 0.25045121647417545, + 0.35066407173871994, + 0.48172519356012344, + 0.29679170809686184, + 0.07044447958469391, + 0.0, + 0.8033585054799914, + 0.2686487250030041, + 0.12767865508794785, + 0.1392141878604889, + 1.4174888469278812, + 0.5603392384946346, + 0.0, + 0.13579462468624115, + 0.19417300820350647, + 0.0, + 0.14738759025931358, + 0.16843902692198753, + 0.10996976587921381, + 1.4286975599825382, + 0.35760609433054924, + 0.1472053900361061, + 0.1938126957975328, + 0.09243734553456306, + 0.205436609685421, + 2.1049975119531155, + 0.5653257928788662, + 0.0, + 0.27028924599289894, + 0.0, + 0.033060457557439804, + 0.26143892854452133, + 0.0, + 0.17839020490646362 + ], + "unique_experts": 53, + "load_cv": 0.8060343404748282, + "normalized_load_entropy": 0.9126829019722057, + "max_load_share": 0.04861111111111111 + } + }, + "s1_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "3ad41b2b0c4d1614d270bb58327d04881b90524b5c37e9093b3b364024ffb059", + "route_weight_sha256": "93b74b79ebd7600f658ad27e25b554b46a0009759e9947a1d75b7ae7b06b3697", + "loads": [ + 0, + 4, + 0, + 1, + 3, + 6, + 0, + 0, + 5, + 1, + 2, + 2, + 2, + 0, + 7, + 1, + 0, + 2, + 0, + 0, + 6, + 0, + 0, + 0, + 7, + 4, + 3, + 4, + 7, + 0, + 1, + 2, + 2, + 5, + 1, + 0, + 1, + 4, + 1, + 3, + 7, + 4, + 0, + 1, + 3, + 0, + 2, + 3, + 3, + 2, + 1, + 1, + 3, + 2, + 4, + 4, + 5, + 0, + 2, + 0, + 1, + 1, + 1, + 1 + ], + "weighted_loads": [ + 0.0, + 0.1428360566496849, + 0.0, + 0.04780910909175873, + 0.14568836614489555, + 0.4179459400475025, + 0.0, + 0.0, + 0.2230224832892418, + 0.032317154109478, + 0.4063909649848938, + 0.05146948527544737, + 0.09312132187187672, + 0.0, + 0.5616969652473927, + 0.039134424179792404, + 0.0, + 0.3475709855556488, + 0.0, + 0.0, + 0.3319020550698042, + 0.0, + 0.0, + 0.0, + 0.6137692872434855, + 0.16115960851311684, + 0.45017213746905327, + 0.2302130162715912, + 0.48273965157568455, + 0.0, + 0.03329750522971153, + 0.3622312769293785, + 0.04385931417346001, + 0.20468952506780624, + 0.07653825730085373, + 0.0, + 0.05231565609574318, + 0.25887786224484444, + 0.04178018122911453, + 0.13715600967407227, + 0.7292343750596046, + 0.5630680210888386, + 0.0, + 0.04948331043124199, + 0.1889500804245472, + 0.0, + 0.15566976368427277, + 0.08412256557494402, + 0.09908519312739372, + 0.08389871567487717, + 0.04241026192903519, + 0.06225147098302841, + 0.06156390439718962, + 0.07746533676981926, + 0.1878522913902998, + 1.3499114364385605, + 0.486691378057003, + 0.0, + 0.17086870968341827, + 0.0, + 0.03462979942560196, + 0.029400182887911797, + 0.038107894361019135, + 0.05034293606877327 + ], + "unique_experts": 47, + "load_cv": 0.9603568264944531, + "normalized_load_entropy": 0.8783064653027365, + "max_load_share": 0.050724637681159424 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "3e6149a4cbaa51e6ca4c5aff80731c4f6d93268298fa05547d53848780b71551", + "route_weight_sha256": "df6b14a38773a4e6e4315d1cf6604d19a48a4c7b50379e26eaba54b596b6fe96", + "loads": [ + 21, + 5, + 0, + 1, + 13, + 10, + 14, + 1, + 16, + 2, + 8, + 6, + 7, + 1, + 12, + 13, + 12, + 5, + 1, + 4, + 7, + 1, + 0, + 5, + 10, + 5, + 14, + 6, + 13, + 1, + 7, + 6, + 8, + 8, + 3, + 0, + 7, + 4, + 3, + 4, + 12, + 5, + 0, + 4, + 3, + 1, + 2, + 5, + 6, + 15, + 8, + 3, + 4, + 3, + 4, + 7, + 5, + 6, + 5, + 4, + 1, + 10, + 3, + 4 + ], + "weighted_loads": [ + 1.383414376527071, + 0.16892888396978378, + 0.0, + 0.04780910909175873, + 0.6547056138515472, + 0.6144292764365673, + 1.2128172684460878, + 0.033466704189777374, + 0.8869396056979895, + 0.06345254182815552, + 0.6698973439633846, + 0.38470595609396696, + 0.510372007265687, + 0.08141332864761353, + 0.7522629424929619, + 0.7782935630530119, + 1.0395577400922775, + 0.4620610363781452, + 0.05279861018061638, + 0.2693507894873619, + 0.36078181117773056, + 0.08194843679666519, + 0.0, + 0.255330890417099, + 0.7000576388090849, + 0.1894872635602951, + 1.1890662834048271, + 0.35445715859532356, + 0.9121789094060659, + 0.03784303739666939, + 0.25603440776467323, + 0.8063350804150105, + 0.4628430623561144, + 0.352631576359272, + 0.22598500922322273, + 0.0, + 0.769309357739985, + 0.25887786224484444, + 0.1238897293806076, + 0.1732068955898285, + 1.2855662871152163, + 0.6504368968307972, + 0.0, + 0.372665211558342, + 0.1889500804245472, + 0.03965635970234871, + 0.15566976368427277, + 0.16823282558470964, + 0.24222819227725267, + 2.0139798037707806, + 0.32003530487418175, + 0.13275054842233658, + 0.0754607506096363, + 0.2115691415965557, + 0.1878522913902998, + 2.039191998541355, + 0.486691378057003, + 0.6625599414110184, + 0.31601137667894363, + 0.17298150435090065, + 0.03462979942560196, + 0.586212020367384, + 0.157626673579216, + 0.1751549281179905 + ], + "unique_experts": 60, + "load_cv": 0.759202798262025, + "normalized_load_entropy": 0.929223632666935, + "max_load_share": 0.0546875 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "ordered_topk_exact_tokens": 19, + "set_exact_tokens": 21, + "mean_set_jaccard": 0.9658385093167702, + "mean_token_weighted_tv": 0.011203310482770852, + "aggregate_load_tv": 0.021739130434782608 + }, + "system_bos": { + "tokens": 23, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.9037267080745343, + "mean_token_weighted_tv": 0.022143803536891937, + "aggregate_load_tv": 0.050724637681159424 + }, + "system_x": { + "tokens": 23, + "ordered_topk_exact_tokens": 7, + "set_exact_tokens": 11, + "mean_set_jaccard": 0.8509316770186336, + "mean_token_weighted_tv": 0.030932787542595812, + "aggregate_load_tv": 0.07246376811594202 + }, + "system_period": { + "tokens": 23, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8881987577639753, + "mean_token_weighted_tv": 0.02861423800577936, + "aggregate_load_tv": 0.057971014492753624 + }, + "bos_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.9161490683229815, + "mean_token_weighted_tv": 0.02086899942799431, + "aggregate_load_tv": 0.050724637681159424 + }, + "bos_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.9006211180124224, + "mean_token_weighted_tv": 0.022560839521010286, + "aggregate_load_tv": 0.050724637681159424 + }, + "x_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.9006211180124224, + "mean_token_weighted_tv": 0.025473020657006164, + "aggregate_load_tv": 0.043478260869565216 + }, + "x_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 12, + "mean_set_jaccard": 0.8633540372670808, + "mean_token_weighted_tv": 0.0326461935132418, + "aggregate_load_tv": 0.07246376811594202 + }, + "period_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.9130434782608695, + "mean_token_weighted_tv": 0.02349192040729458, + "aggregate_load_tv": 0.03623188405797101 + }, + "period_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 11, + "mean_set_jaccard": 0.8509316770186336, + "mean_token_weighted_tv": 0.0351031167311189, + "aggregate_load_tv": 0.06521739130434781 + } + } + }, + "layer_16": { + "layer": 16, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "4458301826bb13a6cd1e3febe7109046e7c6fb48d17771a0c34d95d55f688e42", + "route_weight_sha256": "fed683aaaed6b0a78678d1a34a3153576ffd3d8fa6f000246daea8d8a4ca4214", + "loads": [ + 0, + 3, + 3, + 4, + 3, + 0, + 3, + 1, + 4, + 2, + 0, + 0, + 3, + 6, + 1, + 2, + 2, + 3, + 0, + 5, + 0, + 1, + 0, + 2, + 2, + 3, + 0, + 0, + 0, + 8, + 5, + 2, + 1, + 9, + 0, + 0, + 4, + 1, + 2, + 0, + 7, + 1, + 1, + 0, + 0, + 1, + 0, + 1, + 0, + 3, + 0, + 5, + 0, + 0, + 2, + 0, + 4, + 0, + 0, + 0, + 6, + 15, + 0, + 7 + ], + "weighted_loads": [ + 0.0, + 0.1629912219941616, + 0.16353411227464676, + 0.2954328693449497, + 0.10744282230734825, + 0.0, + 0.09203970246016979, + 0.0492459200322628, + 0.29116951301693916, + 0.3159036412835121, + 0.0, + 0.0, + 0.15795692428946495, + 0.24014604836702347, + 0.06707434356212616, + 0.1434193179011345, + 0.12056884169578552, + 0.24504781514406204, + 0.0, + 0.2065516710281372, + 0.0, + 0.041090093553066254, + 0.0, + 0.10012908279895782, + 0.07277380302548409, + 0.22629784792661667, + 0.0, + 0.0, + 0.0, + 0.33085743710398674, + 0.20146437548100948, + 0.11902280896902084, + 0.02956181950867176, + 1.3419049549847841, + 0.0, + 0.0, + 0.24214209988713264, + 0.03947100788354874, + 0.10053590312600136, + 0.0, + 0.5004616994410753, + 0.03517023101449013, + 0.03552977368235588, + 0.0, + 0.0, + 0.031866274774074554, + 0.0, + 0.04841386154294014, + 0.0, + 0.5054375268518925, + 0.0, + 0.3615327514708042, + 0.0, + 0.0, + 0.12881683930754662, + 0.0, + 0.1874317228794098, + 0.0, + 0.0, + 0.0, + 0.22362811025232077, + 2.3021429404616356, + 0.0, + 0.8675266448408365 + ], + "unique_experts": 39, + "load_cv": 1.2890406156846603, + "normalized_load_entropy": 0.8196294090944448, + "max_load_share": 0.10869565217391304 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "b7a92c03f9bc007b2130080dedc8830a7704fb6eb49a97e37946c33d7871994c", + "route_weight_sha256": "92bec606efc15b12b761bd586dcf7e591c7e95822bb71462399f924d20a03a50", + "loads": [ + 0, + 3, + 3, + 4, + 3, + 9, + 8, + 1, + 4, + 6, + 5, + 1, + 3, + 7, + 1, + 10, + 11, + 7, + 5, + 6, + 10, + 3, + 2, + 2, + 9, + 3, + 5, + 0, + 0, + 8, + 7, + 2, + 2, + 16, + 0, + 0, + 4, + 10, + 2, + 0, + 10, + 9, + 1, + 0, + 3, + 2, + 0, + 1, + 0, + 4, + 1, + 7, + 0, + 11, + 2, + 10, + 4, + 0, + 0, + 0, + 9, + 18, + 0, + 14 + ], + "weighted_loads": [ + 0.0, + 0.1629912219941616, + 0.16353411227464676, + 0.2954328693449497, + 0.10744282230734825, + 0.8029461838304996, + 0.2968390639871359, + 0.0492459200322628, + 0.29116951301693916, + 1.7457502894103527, + 0.2311544455587864, + 0.025099975988268852, + 0.15795692428946495, + 0.2593513894826174, + 0.06707434356212616, + 1.0121147446334362, + 0.6598306410014629, + 0.48113002628088, + 0.5427812058478594, + 0.20902114221826196, + 0.913681885227561, + 0.12202819809317589, + 0.13612262904644012, + 0.10012908279895782, + 0.6624488271772861, + 0.22629784792661667, + 0.28406642749905586, + 0.0, + 0.0, + 0.33085743710398674, + 0.33276081643998623, + 0.11902280896902084, + 0.0700263362377882, + 1.6509663248434663, + 0.0, + 0.0, + 0.24214209988713264, + 0.5304889604449272, + 0.10053590312600136, + 0.0, + 0.6398330386728048, + 1.476773377507925, + 0.03552977368235588, + 0.0, + 0.11795005202293396, + 0.09896257519721985, + 0.0, + 0.04841386154294014, + 0.0, + 0.5227844007313251, + 0.028868479654192924, + 0.46557094156742096, + 0.0, + 0.7813945338129997, + 0.12881683930754662, + 0.7886503152549267, + 0.1874317228794098, + 0.0, + 0.0, + 0.0, + 0.42468592431396246, + 2.4962829696014524, + 0.0, + 1.2856816202402115 + ], + "unique_experts": 50, + "load_cv": 0.9598418079539441, + "normalized_load_entropy": 0.8822436107115652, + "max_load_share": 0.0625 + } + }, + "s1_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "6273c47fb61c2387b38d2e2ef6f3240fdf85436484e45445cd8ffe2cf6ddf6cb", + "route_weight_sha256": "fef04972cb265e4c74dd52eededa77dc8fe691eae1b1d2a33655d4395126a899", + "loads": [ + 0, + 3, + 3, + 4, + 2, + 0, + 3, + 1, + 4, + 2, + 0, + 0, + 3, + 5, + 1, + 2, + 2, + 3, + 0, + 6, + 0, + 1, + 0, + 2, + 2, + 3, + 0, + 1, + 0, + 8, + 5, + 2, + 1, + 7, + 1, + 0, + 4, + 1, + 2, + 0, + 8, + 1, + 1, + 0, + 0, + 1, + 0, + 1, + 1, + 3, + 0, + 5, + 0, + 0, + 2, + 0, + 4, + 0, + 0, + 0, + 6, + 15, + 0, + 6 + ], + "weighted_loads": [ + 0.0, + 0.16300281137228012, + 0.16578559577465057, + 0.2906370311975479, + 0.08090933039784431, + 0.0, + 0.0948146190494299, + 0.04945444315671921, + 0.284189410507679, + 0.31868939846754074, + 0.0, + 0.0, + 0.1596236750483513, + 0.20279423147439957, + 0.0702497735619545, + 0.13414661213755608, + 0.11907912604510784, + 0.24633556604385376, + 0.0, + 0.2396902870386839, + 0.0, + 0.04138991981744766, + 0.0, + 0.0982687883079052, + 0.07222329452633858, + 0.2265075519680977, + 0.0, + 0.031273216009140015, + 0.0, + 0.3368411771953106, + 0.202804297208786, + 0.11747438833117485, + 0.029397068545222282, + 1.2688989602029324, + 0.03676670789718628, + 0.0, + 0.23497562110424042, + 0.0373099148273468, + 0.1045692227780819, + 0.0, + 0.5187246911227703, + 0.033488865941762924, + 0.03260016813874245, + 0.0, + 0.0, + 0.03096260130405426, + 0.0, + 0.04590339586138725, + 0.03254101425409317, + 0.49725209549069405, + 0.0, + 0.34965553507208824, + 0.0, + 0.0, + 0.12868301942944527, + 0.0, + 0.1897227019071579, + 0.0, + 0.0, + 0.0, + 0.22430343739688396, + 2.3069348838180304, + 0.0, + 0.8372775390744209 + ], + "unique_experts": 42, + "load_cv": 1.2466295665523415, + "normalized_load_entropy": 0.8334288317577547, + "max_load_share": 0.10869565217391304 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "174515e2a4083f9b53cb24b64e7ef6dba738d4401948e93908e83c4571d43ac4", + "route_weight_sha256": "733e0e2329e6b572cb108c790d771f0dc8f596ef83938c550e3609593a38335c", + "loads": [ + 0, + 6, + 3, + 6, + 2, + 9, + 7, + 2, + 4, + 7, + 6, + 1, + 3, + 8, + 2, + 14, + 14, + 15, + 8, + 8, + 11, + 3, + 2, + 3, + 17, + 3, + 10, + 1, + 0, + 8, + 9, + 2, + 6, + 13, + 2, + 2, + 4, + 10, + 4, + 3, + 12, + 16, + 2, + 2, + 3, + 5, + 1, + 7, + 4, + 7, + 6, + 6, + 0, + 12, + 2, + 11, + 6, + 0, + 0, + 2, + 9, + 17, + 3, + 13 + ], + "weighted_loads": [ + 0.0, + 0.2848658226430416, + 0.16578559577465057, + 0.3816419690847397, + 0.08090933039784431, + 0.829493522644043, + 0.2979948315769434, + 0.07463862374424934, + 0.284189410507679, + 1.7595637626945972, + 0.20916790142655373, + 0.03198684751987457, + 0.1596236750483513, + 0.29176160879433155, + 0.11588173732161522, + 1.5259570889174938, + 0.653001822065562, + 1.0055944882333279, + 0.7938837539404631, + 0.2774636500980705, + 0.9177114646881819, + 0.1378806307911873, + 0.08523889258503914, + 0.17458800598978996, + 1.2480459231883287, + 0.2265075519680977, + 1.1583326943218708, + 0.031273216009140015, + 0.0, + 0.3368411771953106, + 0.3971911817789078, + 0.11747438833117485, + 0.24702089093625546, + 1.501133230049163, + 0.0719415508210659, + 0.12775136530399323, + 0.23497562110424042, + 0.5135124120861292, + 0.2310393899679184, + 0.17863808572292328, + 0.6776775922626257, + 2.5072729885578156, + 0.06917691603302956, + 0.09281762316823006, + 0.09496956132352352, + 0.22429485246539116, + 0.03151534125208855, + 0.3409749008715153, + 0.1556719858199358, + 0.6761699058115482, + 0.2622460052371025, + 0.39182956144213676, + 0.0, + 1.0931896530091763, + 0.12868301942944527, + 0.9809082075953484, + 0.2971760295331478, + 0.0, + 0.0, + 0.21580725349485874, + 0.37538094259798527, + 2.4389190258225426, + 0.32862983271479607, + 1.2498903358355165 + ], + "unique_experts": 59, + "load_cv": 0.7711148134717395, + "normalized_load_entropy": 0.925015146852144, + "max_load_share": 0.044270833333333336 + } + }, + "s0_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "6a134d5fc9c9f9f0c99ed2704bea5abf74d9686fdd51666b99da35cd6c474177", + "route_weight_sha256": "31c0019a73b2f67c93a1eed58a24026aab2359b66859a9af9ae65105fe2a55ac", + "loads": [ + 0, + 3, + 3, + 4, + 2, + 0, + 3, + 1, + 4, + 2, + 0, + 0, + 3, + 4, + 2, + 2, + 2, + 3, + 0, + 5, + 0, + 1, + 0, + 2, + 1, + 4, + 0, + 0, + 0, + 7, + 5, + 2, + 1, + 10, + 0, + 0, + 4, + 1, + 2, + 0, + 7, + 2, + 1, + 0, + 0, + 1, + 0, + 1, + 1, + 3, + 0, + 5, + 0, + 0, + 2, + 0, + 4, + 0, + 1, + 0, + 6, + 15, + 0, + 6 + ], + "weighted_loads": [ + 0.0, + 0.1620546318590641, + 0.16506997495889664, + 0.2823422886431217, + 0.08522026613354683, + 0.0, + 0.10048223100602627, + 0.0484142042696476, + 0.28989651799201965, + 0.32169387489557266, + 0.0, + 0.0, + 0.15504108369350433, + 0.17483998835086823, + 0.1058167889714241, + 0.13823026418685913, + 0.12063125241547823, + 0.260323241353035, + 0.0, + 0.21666947193443775, + 0.0, + 0.043659698218107224, + 0.0, + 0.09115498140454292, + 0.03723766654729843, + 0.2621310390532017, + 0.0, + 0.0, + 0.0, + 0.29799505323171616, + 0.19642571359872818, + 0.12023656815290451, + 0.027957862243056297, + 1.401262380182743, + 0.0, + 0.0, + 0.2619800679385662, + 0.040882330387830734, + 0.09946919605135918, + 0.0, + 0.5003070719540119, + 0.06701371259987354, + 0.039014458656311035, + 0.0, + 0.0, + 0.028476357460021973, + 0.0, + 0.044884175062179565, + 0.029225684702396393, + 0.5189176052808762, + 0.0, + 0.3786441199481487, + 0.0, + 0.0, + 0.13873367756605148, + 0.0, + 0.18508096411824226, + 0.0, + 0.032512035220861435, + 0.0, + 0.2134279329329729, + 2.289126293733716, + 0.0, + 0.8152651600539684 + ], + "unique_experts": 41, + "load_cv": 1.2600363730526467, + "normalized_load_entropy": 0.8302813644911045, + "max_load_share": 0.10869565217391304 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "acbf6f6509fd6b18cc265e4f168c2db3357fac2784f9a2613bb54634d2193384", + "route_weight_sha256": "7934409aa5514bd91836eedab0393be83d2f077486abf7b76f14b7926d5683d3", + "loads": [ + 0, + 3, + 4, + 4, + 2, + 10, + 8, + 1, + 4, + 6, + 4, + 1, + 4, + 5, + 2, + 10, + 10, + 7, + 6, + 6, + 10, + 3, + 2, + 2, + 7, + 4, + 3, + 0, + 0, + 7, + 6, + 2, + 2, + 17, + 1, + 0, + 4, + 10, + 2, + 0, + 10, + 11, + 1, + 0, + 4, + 2, + 0, + 1, + 1, + 5, + 2, + 7, + 0, + 11, + 2, + 10, + 4, + 0, + 1, + 0, + 8, + 18, + 0, + 11 + ], + "weighted_loads": [ + 0.0, + 0.1620546318590641, + 0.2083093263208866, + 0.2823422886431217, + 0.08522026613354683, + 0.8456817492842674, + 0.30528159253299236, + 0.0484142042696476, + 0.28989651799201965, + 0.8142342530190945, + 0.20444065146148205, + 0.04107673093676567, + 0.23325013369321823, + 0.19404532946646214, + 0.1058167889714241, + 0.9023000970482826, + 1.0578952925279737, + 0.4896626006811857, + 0.5055591370910406, + 0.24995497800409794, + 0.913681885227561, + 0.12459780275821686, + 0.13612262904644012, + 0.09115498140454292, + 0.580037321895361, + 0.2621310390532017, + 0.1692885011434555, + 0.0, + 0.0, + 0.29799505323171616, + 0.2723211422562599, + 0.12023656815290451, + 0.06842237897217274, + 1.769229294732213, + 0.10821296274662018, + 0.0, + 0.2619800679385662, + 0.5319002829492092, + 0.09946919605135918, + 0.0, + 0.6426447220146656, + 1.5592817831784487, + 0.039014458656311035, + 0.0, + 0.14823210425674915, + 0.09557265788316727, + 0.0, + 0.044884175062179565, + 0.029225684702396393, + 0.5816120803356171, + 0.07279394380748272, + 0.4826823100447655, + 0.0, + 0.7813945338129997, + 0.13873367756605148, + 0.7886503152549267, + 0.18508096411824226, + 0.0, + 0.032512035220861435, + 0.0, + 0.34516346640884876, + 2.4920775834470987, + 0.0, + 1.2044127900153399 + ], + "unique_experts": 53, + "load_cv": 0.9279607271383371, + "normalized_load_entropy": 0.8932683395490381, + "max_load_share": 0.0625 + } + }, + "s1_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "cfa1eb1aae20f3412561306709b19d85805250600c22c3de376887fff6d71c71", + "route_weight_sha256": "cdfc6e756918008b6e2f2a4c90eb60153e1434b424c791499be9da6d624c9449", + "loads": [ + 0, + 3, + 3, + 4, + 3, + 0, + 2, + 1, + 4, + 2, + 0, + 0, + 3, + 5, + 2, + 2, + 2, + 3, + 0, + 5, + 0, + 1, + 0, + 2, + 2, + 3, + 0, + 1, + 0, + 7, + 5, + 2, + 1, + 9, + 0, + 0, + 4, + 2, + 2, + 0, + 6, + 2, + 1, + 0, + 0, + 1, + 0, + 1, + 0, + 3, + 0, + 5, + 0, + 0, + 2, + 0, + 4, + 0, + 1, + 0, + 6, + 15, + 0, + 6 + ], + "weighted_loads": [ + 0.0, + 0.16369547322392464, + 0.1634741723537445, + 0.29172634705901146, + 0.11281454004347324, + 0.0, + 0.0781962238252163, + 0.0495268739759922, + 0.2866000272333622, + 0.3323289304971695, + 0.0, + 0.0, + 0.15298600867390633, + 0.19797298684716225, + 0.10707981511950493, + 0.12594618275761604, + 0.11315469816327095, + 0.24896756187081337, + 0.0, + 0.21786584332585335, + 0.0, + 0.038717735558748245, + 0.0, + 0.09557810798287392, + 0.07889002561569214, + 0.2297934629023075, + 0.0, + 0.03304065763950348, + 0.0, + 0.3127631973475218, + 0.20332852192223072, + 0.11360901966691017, + 0.02989945001900196, + 1.3871709555387497, + 0.0, + 0.0, + 0.24474917724728584, + 0.0561237558722496, + 0.10377167537808418, + 0.0, + 0.4996381998062134, + 0.06647232174873352, + 0.03603733703494072, + 0.0, + 0.0, + 0.027392642572522163, + 0.0, + 0.043340906500816345, + 0.0, + 0.5086920745670795, + 0.0, + 0.3570296876132488, + 0.0, + 0.0, + 0.12885026633739471, + 0.0, + 0.19125087186694145, + 0.0, + 0.03377867117524147, + 0.0, + 0.2197741251438856, + 2.221392970532179, + 0.0, + 0.810545789077878 + ], + "unique_experts": 41, + "load_cv": 1.2276140830505375, + "normalized_load_entropy": 0.8356764579806802, + "max_load_share": 0.10869565217391304 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "73fa514d247e3ae2b0f090e86b85d9c5df1bd915df4dd0756c8af98324d73167", + "route_weight_sha256": "b8297dc3962f497e3748c068c02fe3fbd86854a316194d08eaf588bb0378a26e", + "loads": [ + 0, + 6, + 3, + 6, + 3, + 9, + 6, + 2, + 4, + 7, + 5, + 1, + 3, + 9, + 3, + 14, + 14, + 14, + 9, + 5, + 11, + 3, + 2, + 3, + 15, + 3, + 10, + 1, + 0, + 7, + 8, + 2, + 6, + 17, + 2, + 2, + 4, + 12, + 4, + 3, + 10, + 18, + 2, + 2, + 5, + 5, + 1, + 7, + 3, + 7, + 6, + 6, + 0, + 12, + 2, + 11, + 6, + 0, + 1, + 1, + 10, + 16, + 3, + 12 + ], + "weighted_loads": [ + 0.0, + 0.2855584844946861, + 0.1634741723537445, + 0.38273128494620323, + 0.11281454004347324, + 0.8439271040260792, + 0.2813764363527298, + 0.07471105456352234, + 0.2866000272333622, + 0.8660140335559845, + 0.1822780929505825, + 0.03198684751987457, + 0.15298600867390633, + 0.32399880327284336, + 0.15271177887916565, + 1.4269627146422863, + 1.0820788405835629, + 0.9495598487555981, + 0.8033876568078995, + 0.21786584332585335, + 0.9177114646881819, + 0.13520844653248787, + 0.08523889258503914, + 0.17189732566475868, + 1.141926795244217, + 0.2297934629023075, + 1.1499561667442322, + 0.03304065763950348, + 0.0, + 0.3127631973475218, + 0.34312460757791996, + 0.11360901966691017, + 0.24752327241003513, + 1.7423986066132784, + 0.07641565799713135, + 0.12775136530399323, + 0.24474917724728584, + 0.5721055697649717, + 0.23024184256792068, + 0.17863808572292328, + 0.6570663917809725, + 2.6242463141679764, + 0.07261408492922783, + 0.09281762316823006, + 0.17594038508832455, + 0.22072489373385906, + 0.03151534125208855, + 0.33841241151094437, + 0.12313097156584263, + 0.6876098848879337, + 0.2703014127910137, + 0.39920371398329735, + 0.0, + 1.0931896530091763, + 0.12885026633739471, + 0.9809082075953484, + 0.29870419949293137, + 0.0, + 0.03377867117524147, + 0.19234897196292877, + 0.43000875413417816, + 2.319614853709936, + 0.32862983271479607, + 1.2169276773929596 + ], + "unique_experts": 60, + "load_cv": 0.7744845956433793, + "normalized_load_entropy": 0.9262126966147269, + "max_load_share": 0.046875 + } + }, + "s0_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "32ccffd25e2b1fb33f5772137e3c4d883aae25e288278553aecd92b5afc3ee49", + "route_weight_sha256": "b495ac61a1e9fde420284e139ca20cd9b2ad6bed85d61e6430a0f168393a3d79", + "loads": [ + 0, + 4, + 3, + 4, + 2, + 0, + 3, + 1, + 4, + 2, + 0, + 0, + 3, + 3, + 1, + 2, + 2, + 3, + 0, + 6, + 1, + 1, + 0, + 2, + 1, + 4, + 0, + 0, + 0, + 5, + 6, + 2, + 1, + 9, + 0, + 0, + 5, + 1, + 2, + 0, + 6, + 2, + 1, + 0, + 0, + 0, + 0, + 1, + 1, + 3, + 0, + 5, + 0, + 0, + 2, + 0, + 4, + 0, + 0, + 0, + 6, + 16, + 1, + 7 + ], + "weighted_loads": [ + 0.0, + 0.21017050743103027, + 0.16518275067210197, + 0.3105161525309086, + 0.08571828901767731, + 0.0, + 0.09339712373912334, + 0.05063445121049881, + 0.28392431512475014, + 0.31233733892440796, + 0.0, + 0.0, + 0.13617223873734474, + 0.13433100283145905, + 0.07094678282737732, + 0.14664164558053017, + 0.11996603105217218, + 0.2454952858388424, + 0.0, + 0.22217394784092903, + 0.03853261098265648, + 0.04322204738855362, + 0.0, + 0.1029750406742096, + 0.046169742941856384, + 0.25082895159721375, + 0.0, + 0.0, + 0.0, + 0.2361265793442726, + 0.23828655295073986, + 0.1171402782201767, + 0.029754942283034325, + 1.3035966362804174, + 0.0, + 0.0, + 0.29335703887045383, + 0.03752689063549042, + 0.10050416365265846, + 0.0, + 0.4882910493761301, + 0.07214220985770226, + 0.03948856145143509, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0435461588203907, + 0.030077239498496056, + 0.5156863145530224, + 0.0, + 0.35961679369211197, + 0.0, + 0.0, + 0.13336285576224327, + 0.0, + 0.1982337236404419, + 0.0, + 0.0, + 0.0, + 0.2228935081511736, + 2.246705736964941, + 0.03158409520983696, + 0.8936007097363472 + ], + "unique_experts": 41, + "load_cv": 1.281195487721048, + "normalized_load_entropy": 0.8277756269497637, + "max_load_share": 0.11594202898550725 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "32cf1f49ac7081bd9785b8b7efcd9d78056eb0b70fd117d9640049bcf7bc5b7d", + "route_weight_sha256": "1877c4a23eeaa18e0aed6269cd878d3df2bdc748f691c970116abab9fd4c6d96", + "loads": [ + 0, + 4, + 3, + 4, + 2, + 11, + 8, + 1, + 4, + 4, + 4, + 0, + 3, + 4, + 1, + 10, + 9, + 8, + 6, + 6, + 12, + 4, + 2, + 2, + 9, + 4, + 4, + 0, + 0, + 5, + 8, + 2, + 4, + 14, + 0, + 0, + 5, + 11, + 2, + 0, + 9, + 10, + 2, + 0, + 2, + 1, + 0, + 1, + 1, + 4, + 1, + 7, + 0, + 12, + 2, + 11, + 4, + 0, + 0, + 0, + 9, + 18, + 1, + 13 + ], + "weighted_loads": [ + 0.0, + 0.21017050743103027, + 0.16518275067210197, + 0.3105161525309086, + 0.08571828901767731, + 0.8809235133230686, + 0.29819648526608944, + 0.05063445121049881, + 0.28392431512475014, + 0.7213377319276333, + 0.20444065146148205, + 0.0, + 0.13617223873734474, + 0.15353634394705296, + 0.07094678282737732, + 1.050641868263483, + 0.48594089690595865, + 0.5211168304085732, + 0.5915531981736422, + 0.22217394784092903, + 1.1950955111533403, + 0.1579221487045288, + 0.13612262904644012, + 0.1029750406742096, + 0.7589638885110617, + 0.25082895159721375, + 0.22025316953659058, + 0.0, + 0.0, + 0.2361265793442726, + 0.3588018622249365, + 0.1171402782201767, + 0.1673438847064972, + 1.565153755247593, + 0.0, + 0.0, + 0.29335703887045383, + 0.5631146617233753, + 0.10050416365265846, + 0.0, + 0.6601713467389345, + 1.4507614336907864, + 0.0674670934677124, + 0.0, + 0.08267949894070625, + 0.0670963004231453, + 0.0, + 0.0435461588203907, + 0.030077239498496056, + 0.5330331884324551, + 0.0344940721988678, + 0.4636549837887287, + 0.0, + 0.9141235128045082, + 0.13336285576224327, + 0.9006932191550732, + 0.1982337236404419, + 0.0, + 0.0, + 0.0, + 0.426720941439271, + 2.407256815582514, + 0.03158409520983696, + 1.3457045014947653 + ], + "unique_experts": 51, + "load_cv": 0.9541980020732037, + "normalized_load_entropy": 0.8844414174459011, + "max_load_share": 0.0625 + } + }, + "s1_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "86a669d69ea06b791a023e3bb11024c73e16d99df640c125b28c7b19f0fecdee", + "route_weight_sha256": "2cf6280639fe3a7260ec3f95196f1cb6649a3122d4aef4a9795d5ac81865f231", + "loads": [ + 0, + 3, + 3, + 4, + 3, + 0, + 2, + 1, + 4, + 2, + 0, + 0, + 3, + 3, + 1, + 2, + 2, + 3, + 0, + 5, + 2, + 2, + 0, + 2, + 3, + 3, + 0, + 0, + 0, + 6, + 5, + 2, + 1, + 9, + 0, + 0, + 4, + 1, + 2, + 0, + 7, + 1, + 1, + 0, + 0, + 1, + 0, + 2, + 1, + 3, + 0, + 6, + 0, + 0, + 2, + 0, + 4, + 0, + 0, + 0, + 4, + 15, + 1, + 7 + ], + "weighted_loads": [ + 0.0, + 0.1842038668692112, + 0.15900856256484985, + 0.3041085749864578, + 0.11522361263632774, + 0.0, + 0.07488203421235085, + 0.05161320045590401, + 0.2887240946292877, + 0.30377764254808426, + 0.0, + 0.0, + 0.1407916322350502, + 0.12856352515518665, + 0.07734686136245728, + 0.12398571148514748, + 0.11836690548807383, + 0.2319183088839054, + 0.0, + 0.21740351431071758, + 0.09293770790100098, + 0.059136081486940384, + 0.0, + 0.09870246052742004, + 0.11399812810122967, + 0.23227964341640472, + 0.0, + 0.0, + 0.0, + 0.2927769795060158, + 0.19668421894311905, + 0.11078790575265884, + 0.030332127586007118, + 1.2681091856211424, + 0.0, + 0.0, + 0.24906916171312332, + 0.031472098082304, + 0.10553472116589546, + 0.0, + 0.483633229508996, + 0.04247986525297165, + 0.035077355802059174, + 0.0, + 0.0, + 0.03263084217905998, + 0.0, + 0.06754493527114391, + 0.03365674614906311, + 0.5147272944450378, + 0.0, + 0.3681499268859625, + 0.0, + 0.0, + 0.12056002020835876, + 0.0, + 0.2022889070212841, + 0.0, + 0.0, + 0.0, + 0.1771637387573719, + 2.179606258869171, + 0.03620542585849762, + 0.8709503691643476 + ], + "unique_experts": 42, + "load_cv": 1.2193738170782975, + "normalized_load_entropy": 0.8399853909450166, + "max_load_share": 0.10869565217391304 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "f30c7b9c2218a74412d62312d2006f10abe458d46c0cd03b19b48657b763e932", + "route_weight_sha256": "45e7edbb7439d16ca46429be495a099d73e0dc4855ee810820f7e85b5d8db6a7", + "loads": [ + 0, + 6, + 3, + 6, + 3, + 10, + 7, + 2, + 4, + 4, + 5, + 1, + 3, + 6, + 2, + 14, + 10, + 15, + 9, + 5, + 16, + 5, + 3, + 3, + 18, + 3, + 10, + 0, + 0, + 8, + 8, + 2, + 7, + 14, + 1, + 2, + 4, + 10, + 5, + 3, + 11, + 16, + 2, + 2, + 2, + 5, + 1, + 8, + 5, + 7, + 6, + 7, + 0, + 13, + 2, + 12, + 6, + 1, + 0, + 2, + 7, + 16, + 4, + 12 + ], + "weighted_loads": [ + 0.0, + 0.3060668781399727, + 0.15900856256484985, + 0.3951135128736496, + 0.11522361263632774, + 0.8868453241884708, + 0.3050774745643139, + 0.07679738104343414, + 0.2887240946292877, + 0.7185837179422379, + 0.1822780929505825, + 0.03198684751987457, + 0.1407916322350502, + 0.21753090247511864, + 0.122978825122118, + 1.4539835304021835, + 0.41688471753150225, + 0.9941053483635187, + 0.8006271291524172, + 0.21740351431071758, + 1.3888016305863857, + 0.19172491878271103, + 0.11777594685554504, + 0.1750216782093048, + 1.4623354095965624, + 0.23227964341640472, + 1.1267745718359947, + 0.0, + 0.0, + 0.34306545928120613, + 0.3364803045988083, + 0.11078790575265884, + 0.3142473194748163, + 1.4828158225864172, + 0.03517484292387962, + 0.12775136530399323, + 0.24906916171312332, + 0.5076745953410864, + 0.25919790379703045, + 0.17863808572292328, + 0.6711577698588371, + 2.3153476268053055, + 0.07165410369634628, + 0.09281762316823006, + 0.06883650831878185, + 0.22596309334039688, + 0.03151534125208855, + 0.36261644028127193, + 0.18843122385442257, + 0.693645104765892, + 0.25742224231362343, + 0.410323953256011, + 0.0, + 1.1924019791185856, + 0.12056002020835876, + 1.1149587109684944, + 0.309742234647274, + 0.05689127370715141, + 0.0, + 0.211210198700428, + 0.31068235635757446, + 2.2737861424684525, + 0.3648352585732937, + 1.2284076027572155 + ], + "unique_experts": 59, + "load_cv": 0.7789549623266633, + "normalized_load_entropy": 0.9244810277244698, + "max_load_share": 0.046875 + } + }, + "s0_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "6a625094397f106b194da3811d77d2417a794157c2a9129238ffa96fb512edf8", + "route_weight_sha256": "e0119a5d1ce0fdc1fd405ad32bcb53d3b1071a46f8e7de80654a82afdd978609", + "loads": [ + 0, + 3, + 3, + 4, + 2, + 0, + 3, + 1, + 4, + 2, + 0, + 0, + 3, + 3, + 1, + 2, + 2, + 3, + 0, + 5, + 0, + 1, + 0, + 2, + 1, + 3, + 0, + 1, + 0, + 6, + 5, + 2, + 1, + 10, + 0, + 0, + 4, + 1, + 2, + 0, + 7, + 2, + 1, + 0, + 0, + 1, + 0, + 1, + 1, + 3, + 0, + 5, + 0, + 0, + 2, + 0, + 4, + 0, + 1, + 0, + 6, + 16, + 1, + 7 + ], + "weighted_loads": [ + 0.0, + 0.17021848261356354, + 0.15741798654198647, + 0.32264135405421257, + 0.08756836131215096, + 0.0, + 0.09513914212584496, + 0.05304943770170212, + 0.2857252396643162, + 0.30799152702093124, + 0.0, + 0.0, + 0.14924557134509087, + 0.13508035987615585, + 0.07125641405582428, + 0.1578099988400936, + 0.12829065322875977, + 0.2538043223321438, + 0.0, + 0.1972027588635683, + 0.0, + 0.04012422636151314, + 0.0, + 0.10034274682402611, + 0.04486380144953728, + 0.22844590619206429, + 0.0, + 0.03870471566915512, + 0.0, + 0.2775709368288517, + 0.20180130191147327, + 0.11968978121876717, + 0.030480803921818733, + 1.3251992128789425, + 0.0, + 0.0, + 0.25842275097966194, + 0.036681439727544785, + 0.09969670325517654, + 0.0, + 0.49587044306099415, + 0.07394063845276833, + 0.038905542343854904, + 0.0, + 0.0, + 0.02881273627281189, + 0.0, + 0.04020044952630997, + 0.03035181760787964, + 0.513301957398653, + 0.0, + 0.36559390276670456, + 0.0, + 0.0, + 0.1334252431988716, + 0.0, + 0.20077017322182655, + 0.0, + 0.03050927072763443, + 0.0, + 0.2161303237080574, + 2.2215697495266795, + 0.03059767372906208, + 0.9131064303219318 + ], + "unique_experts": 43, + "load_cv": 1.281195487721048, + "normalized_load_entropy": 0.8340175769667094, + "max_load_share": 0.11594202898550725 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "b70c6a6cf7277d2784aafd1acff13b8241bad1823244bb6964bcb86e9c5f2aad", + "route_weight_sha256": "2b4cbb77ada01e4d2ef506bedfb262e788137147ef37743ff2b29487cf2162c7", + "loads": [ + 0, + 3, + 3, + 4, + 2, + 13, + 8, + 1, + 4, + 4, + 5, + 1, + 3, + 4, + 1, + 10, + 10, + 8, + 5, + 5, + 11, + 3, + 3, + 2, + 9, + 3, + 4, + 1, + 0, + 6, + 7, + 2, + 2, + 15, + 0, + 0, + 4, + 10, + 2, + 0, + 10, + 10, + 1, + 0, + 2, + 2, + 0, + 2, + 1, + 4, + 1, + 7, + 0, + 11, + 3, + 11, + 4, + 0, + 1, + 0, + 9, + 18, + 1, + 12 + ], + "weighted_loads": [ + 0.0, + 0.17021848261356354, + 0.15741798654198647, + 0.32264135405421257, + 0.08756836131215096, + 0.9620593953877687, + 0.29993850365281105, + 0.05304943770170212, + 0.2857252396643162, + 0.7153718490153551, + 0.25292797572910786, + 0.02772892452776432, + 0.14924557134509087, + 0.15428570099174976, + 0.07125641405582428, + 1.0469520911574364, + 0.5959985293447971, + 0.6584097146987915, + 0.5170771796256304, + 0.1972027588635683, + 0.9838002156466246, + 0.12106233090162277, + 0.17925916984677315, + 0.10034274682402611, + 0.7767779994755983, + 0.22844590619206429, + 0.2568592503666878, + 0.03870471566915512, + 0.0, + 0.2775709368288517, + 0.331899156793952, + 0.11968978121876717, + 0.07094532065093517, + 1.5790339577943087, + 0.0, + 0.0, + 0.25842275097966194, + 0.5276993922889233, + 0.09969670325517654, + 0.0, + 0.6738808024674654, + 1.4983351565897465, + 0.038905542343854904, + 0.0, + 0.07746167667210102, + 0.09590903669595718, + 0.0, + 0.0794685073196888, + 0.03035181760787964, + 0.5306488312780857, + 0.04223737120628357, + 0.4696320928633213, + 0.0, + 0.7813945338129997, + 0.17231884226202965, + 0.8506590314209461, + 0.20077017322182655, + 0.0, + 0.03050927072763443, + 0.0, + 0.4119836166501045, + 2.3727766377851367, + 0.03059767372906208, + 1.3317054901272058 + ], + "unique_experts": 54, + "load_cv": 0.9460770203292446, + "normalized_load_entropy": 0.8911510121955208, + "max_load_share": 0.0625 + } + }, + "s1_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "ce06638c193c15bdf615850ac6228e1657f08cc4b898de622058f59ceb778472", + "route_weight_sha256": "9ca5e4a30b2e8014307d23089521437b5f007e55ddf207719097cad2ab567cf4", + "loads": [ + 0, + 4, + 3, + 4, + 3, + 0, + 2, + 1, + 4, + 2, + 0, + 0, + 2, + 4, + 1, + 2, + 2, + 3, + 0, + 5, + 2, + 2, + 0, + 3, + 2, + 3, + 0, + 0, + 0, + 6, + 5, + 1, + 1, + 8, + 0, + 0, + 4, + 0, + 3, + 0, + 7, + 2, + 1, + 0, + 0, + 1, + 0, + 1, + 1, + 3, + 0, + 6, + 0, + 0, + 2, + 0, + 4, + 0, + 1, + 0, + 4, + 15, + 1, + 7 + ], + "weighted_loads": [ + 0.0, + 0.21048318967223167, + 0.1595449522137642, + 0.2959790267050266, + 0.11030754446983337, + 0.0, + 0.0744154304265976, + 0.05378192663192749, + 0.2792012542486191, + 0.3176986500620842, + 0.0, + 0.0, + 0.08663012832403183, + 0.169298704713583, + 0.08158372342586517, + 0.12642841413617134, + 0.1288943998515606, + 0.23859713971614838, + 0.0, + 0.2139761671423912, + 0.10173177346587181, + 0.061946798115968704, + 0.0, + 0.134522195905447, + 0.08182547241449356, + 0.21902978420257568, + 0.0, + 0.0, + 0.0, + 0.2957303076982498, + 0.2013890314847231, + 0.07312387973070145, + 0.02864549309015274, + 1.1733426991850138, + 0.0, + 0.0, + 0.2463531643152237, + 0.0, + 0.1336919106543064, + 0.0, + 0.46102067455649376, + 0.0753251165151596, + 0.034914590418338776, + 0.0, + 0.0, + 0.03517482429742813, + 0.0, + 0.03767130523920059, + 0.03458187356591225, + 0.5164535567164421, + 0.0, + 0.37455059960484505, + 0.0, + 0.0, + 0.12818533182144165, + 0.0, + 0.20576165616512299, + 0.0, + 0.03130912780761719, + 0.0, + 0.17342766374349594, + 2.0975380577147007, + 0.03497985377907753, + 0.8734447676688433 + ], + "unique_experts": 42, + "load_cv": 1.2110774849893724, + "normalized_load_entropy": 0.8400326131881418, + "max_load_share": 0.10869565217391304 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "6893344d64d21528da9eee2cb752cd75803a0b4b592ddacb6bee72bc30843c3d", + "route_weight_sha256": "ed7dfa2ecac0bc472a4c6e0ce6f0ed5d86879c5586fc06ab1a9a826092a468c8", + "loads": [ + 0, + 7, + 3, + 6, + 3, + 11, + 6, + 2, + 4, + 4, + 6, + 1, + 2, + 7, + 2, + 14, + 9, + 15, + 8, + 5, + 14, + 4, + 2, + 4, + 18, + 3, + 10, + 0, + 0, + 7, + 10, + 1, + 8, + 13, + 1, + 2, + 4, + 9, + 7, + 3, + 11, + 18, + 2, + 2, + 2, + 5, + 1, + 7, + 5, + 7, + 6, + 7, + 0, + 13, + 3, + 12, + 6, + 0, + 1, + 2, + 7, + 16, + 4, + 12 + ], + "weighted_loads": [ + 0.0, + 0.33234620094299316, + 0.1595449522137642, + 0.3869839645922184, + 0.11030754446983337, + 0.9463363457471132, + 0.2775956429541111, + 0.07896610721945763, + 0.2792012542486191, + 0.7325047254562378, + 0.21715711802244186, + 0.03198684751987457, + 0.08663012832403183, + 0.258266082033515, + 0.1272156871855259, + 1.374092549085617, + 0.38669403642416, + 1.0746915377676487, + 0.8130255993455648, + 0.2139761671423912, + 1.069508509710431, + 0.15843750908970833, + 0.08523889258503914, + 0.21084141358733177, + 1.485723003745079, + 0.21902978420257568, + 1.1531072556972504, + 0.0, + 0.0, + 0.321960112079978, + 0.4338930416852236, + 0.07312387973070145, + 0.30565703473985195, + 1.3842339906841516, + 0.03517484292387962, + 0.12775136530399323, + 0.2463531643152237, + 0.4762024972587824, + 0.3324100896716118, + 0.17863808572292328, + 0.6381323803216219, + 2.2828085720539093, + 0.07149133831262589, + 0.09281762316823006, + 0.06883650831878185, + 0.22850707545876503, + 0.03151534125208855, + 0.3327428102493286, + 0.19620601646602154, + 0.6953713670372963, + 0.2508263476192951, + 0.41672462597489357, + 0.0, + 1.1549794897437096, + 0.16807370632886887, + 1.0275020860135555, + 0.3132149837911129, + 0.0, + 0.03130912780761719, + 0.2226344645023346, + 0.3390236012637615, + 2.2126226015388966, + 0.3636096864938736, + 1.239900216460228 + ], + "unique_experts": 59, + "load_cv": 0.7806247497997997, + "normalized_load_entropy": 0.9236456830119645, + "max_load_share": 0.046875 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 18, + "mean_set_jaccard": 0.9378881987577641, + "mean_token_weighted_tv": 0.01457449083175996, + "aggregate_load_tv": 0.03623188405797101 + }, + "system_bos": { + "tokens": 23, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.9130434782608695, + "mean_token_weighted_tv": 0.021815021907019873, + "aggregate_load_tv": 0.03623188405797102 + }, + "system_x": { + "tokens": 23, + "ordered_topk_exact_tokens": 8, + "set_exact_tokens": 11, + "mean_set_jaccard": 0.8509316770186336, + "mean_token_weighted_tv": 0.029081924818456173, + "aggregate_load_tv": 0.07246376811594202 + }, + "system_period": { + "tokens": 23, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8695652173913045, + "mean_token_weighted_tv": 0.03140948739145761, + "aggregate_load_tv": 0.07246376811594203 + }, + "bos_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.9130434782608695, + "mean_token_weighted_tv": 0.022056805698767952, + "aggregate_load_tv": 0.043478260869565216 + }, + "bos_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.9006211180124224, + "mean_token_weighted_tv": 0.020907570769929367, + "aggregate_load_tv": 0.050724637681159424 + }, + "x_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 12, + "mean_set_jaccard": 0.8540372670807453, + "mean_token_weighted_tv": 0.030867578056843384, + "aggregate_load_tv": 0.07246376811594205 + }, + "x_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 11, + "mean_set_jaccard": 0.8509316770186335, + "mean_token_weighted_tv": 0.03221888979896903, + "aggregate_load_tv": 0.07971014492753623 + }, + "period_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.9006211180124224, + "mean_token_weighted_tv": 0.02621203025236078, + "aggregate_load_tv": 0.050724637681159424 + }, + "period_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 12, + "mean_set_jaccard": 0.8354037267080746, + "mean_token_weighted_tv": 0.03907417258976594, + "aggregate_load_tv": 0.09420289855072463 + } + } + }, + "layer_17": { + "layer": 17, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "e5a02c6dde29d4e075310a3ec08a3919102c7ea0930d38fdcce4c65f1cac093b", + "route_weight_sha256": "925a92461a4c621fa9e84e2d3147bd101e372739d10ab516325f79bc6106f4da", + "loads": [ + 10, + 1, + 0, + 3, + 0, + 1, + 0, + 4, + 0, + 2, + 1, + 6, + 9, + 3, + 3, + 1, + 2, + 0, + 0, + 0, + 1, + 4, + 1, + 3, + 0, + 0, + 3, + 4, + 1, + 9, + 1, + 0, + 10, + 0, + 0, + 0, + 0, + 3, + 2, + 3, + 1, + 7, + 3, + 4, + 0, + 6, + 5, + 0, + 2, + 0, + 0, + 0, + 1, + 1, + 4, + 3, + 0, + 0, + 3, + 1, + 2, + 2, + 1, + 1 + ], + "weighted_loads": [ + 1.0818128734827042, + 0.03348425775766373, + 0.0, + 1.313636278733611, + 0.0, + 0.02779538929462433, + 0.0, + 0.27719978243112564, + 0.0, + 0.10307001695036888, + 0.04482456296682358, + 0.47500544786453247, + 0.5942054260522127, + 0.08050930872559547, + 0.08463805727660656, + 0.03523034229874611, + 0.2751859650015831, + 0.0, + 0.0, + 0.0, + 0.07684832811355591, + 0.33717789500951767, + 0.07378028333187103, + 0.07933864183723927, + 0.0, + 0.0, + 0.7877788320183754, + 0.21786629036068916, + 0.0489838607609272, + 0.9797977842390537, + 0.03736063465476036, + 0.0, + 1.0668194014579058, + 0.0, + 0.0, + 0.0, + 0.0, + 0.22882797569036484, + 0.09785497188568115, + 0.15604088827967644, + 0.03637852892279625, + 0.5170734524726868, + 0.2274622619152069, + 0.2303429041057825, + 0.0, + 0.26346322894096375, + 0.3996910806745291, + 0.0, + 0.08863365277647972, + 0.0, + 0.0, + 0.0, + 0.038251835852861404, + 0.04256633296608925, + 0.45039086043834686, + 0.19534381106495857, + 0.0, + 0.0, + 0.14802231267094612, + 0.03629736229777336, + 0.061668891459703445, + 0.13881806284189224, + 0.04190618544816971, + 0.02750454843044281 + ], + "unique_experts": 43, + "load_cv": 1.1858402848885006, + "normalized_load_entropy": 0.8401565376238527, + "max_load_share": 0.07246376811594203 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "65fcf8f4645519ae6e6f07fdd2d7431505eb55ee27228524939485f192447f49", + "route_weight_sha256": "7a07c3711a524e2e8df67a19e0cf4f856e39a2f4c1bc6b41844c8cc2735b8a50", + "loads": [ + 18, + 3, + 3, + 10, + 0, + 1, + 2, + 4, + 0, + 5, + 8, + 7, + 12, + 11, + 3, + 3, + 2, + 7, + 3, + 0, + 4, + 4, + 1, + 9, + 6, + 6, + 12, + 8, + 5, + 11, + 1, + 0, + 19, + 0, + 0, + 0, + 0, + 3, + 8, + 3, + 9, + 10, + 6, + 7, + 0, + 11, + 5, + 0, + 2, + 1, + 1, + 0, + 3, + 1, + 4, + 5, + 0, + 3, + 4, + 1, + 2, + 3, + 7, + 1 + ], + "weighted_loads": [ + 1.3867176119238138, + 0.11221088469028473, + 0.14443210512399673, + 1.9029402565211058, + 0.0, + 0.02779538929462433, + 0.09620825946331024, + 0.27719978243112564, + 0.0, + 0.19129693694412708, + 0.48133762925863266, + 0.49356014281511307, + 0.6929518952965736, + 0.6842351704835892, + 0.08463805727660656, + 0.1214277520775795, + 0.2751859650015831, + 0.6848468966782093, + 0.12157266214489937, + 0.0, + 0.3611758351325989, + 0.33717789500951767, + 0.07378028333187103, + 0.34966943599283695, + 0.507694449275732, + 0.34320880845189095, + 2.4790116511285305, + 0.39578862115740776, + 0.20417135208845139, + 1.0151043692603707, + 0.03736063465476036, + 0.0, + 1.435331404209137, + 0.0, + 0.0, + 0.0, + 0.0, + 0.22882797569036484, + 0.3610118068754673, + 0.15604088827967644, + 1.1231997944414616, + 0.6043043518438935, + 0.46267513930797577, + 0.2870872695930302, + 0.0, + 1.138039417564869, + 0.3996910806745291, + 0.0, + 0.08863365277647972, + 0.04053742066025734, + 0.06711398810148239, + 0.0, + 0.16706882417201996, + 0.04256633296608925, + 0.45039086043834686, + 0.3030488584190607, + 0.0, + 0.16334261000156403, + 0.17788519524037838, + 0.03629736229777336, + 0.061668891459703445, + 0.1887849047780037, + 0.6471393778920174, + 0.02750454843044281 + ], + "unique_experts": 52, + "load_cv": 0.9590375834240038, + "normalized_load_entropy": 0.8879333753055402, + "max_load_share": 0.06597222222222222 + } + }, + "s1_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "94d03686db874003b30910e404eead510d02b3d328c3783b8f722de159f50831", + "route_weight_sha256": "8c54fc0c72bf1bd843d5ec26f768471a0762fee2f2fac8ac95b9245a64f99b7d", + "loads": [ + 11, + 1, + 0, + 3, + 0, + 1, + 0, + 4, + 0, + 2, + 1, + 6, + 9, + 3, + 3, + 1, + 2, + 0, + 0, + 0, + 1, + 4, + 1, + 3, + 0, + 0, + 3, + 4, + 1, + 9, + 1, + 0, + 10, + 0, + 0, + 0, + 0, + 3, + 2, + 3, + 1, + 7, + 3, + 3, + 0, + 6, + 5, + 0, + 2, + 0, + 0, + 0, + 1, + 1, + 4, + 3, + 0, + 0, + 3, + 1, + 2, + 2, + 1, + 1 + ], + "weighted_loads": [ + 1.092153389006853, + 0.03380884975194931, + 0.0, + 1.302453612908721, + 0.0, + 0.03179128095507622, + 0.0, + 0.28617045655846596, + 0.0, + 0.09923175349831581, + 0.04725274071097374, + 0.4857376329600811, + 0.5901496354490519, + 0.08914889767765999, + 0.08852352574467659, + 0.03734993562102318, + 0.274344727396965, + 0.0, + 0.0, + 0.0, + 0.0763961598277092, + 0.32980447076261044, + 0.0667116641998291, + 0.07776517048478127, + 0.0, + 0.0, + 0.7999935857951641, + 0.2225538957864046, + 0.04845717176795006, + 0.9765030760318041, + 0.03786562755703926, + 0.0, + 1.096661927178502, + 0.0, + 0.0, + 0.0, + 0.0, + 0.22194932028651237, + 0.0939430333673954, + 0.1582372896373272, + 0.03660241514444351, + 0.5251766089349985, + 0.22109125554561615, + 0.19926518574357033, + 0.0, + 0.26542800292372704, + 0.37711415626108646, + 0.0, + 0.08409928157925606, + 0.0, + 0.0, + 0.0, + 0.037864502519369125, + 0.04547133669257164, + 0.447396706789732, + 0.18898658454418182, + 0.0, + 0.0, + 0.14981354773044586, + 0.03636475279927254, + 0.05706217885017395, + 0.12904884666204453, + 0.039404504001140594, + 0.028660660609602928 + ], + "unique_experts": 43, + "load_cv": 1.2055148777857978, + "normalized_load_entropy": 0.8382370275292873, + "max_load_share": 0.07971014492753623 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "5a5f95d63d75253626ff7d4ceec358532049d3f6a52d2ccdc18ccca1ebfcc302", + "route_weight_sha256": "78ce37d3280295279c7a1299276e9ff7cf7de94eaf419b99caec99c831ccee75", + "loads": [ + 19, + 2, + 2, + 10, + 6, + 1, + 3, + 5, + 0, + 7, + 9, + 8, + 9, + 11, + 3, + 9, + 3, + 6, + 3, + 0, + 2, + 5, + 1, + 11, + 10, + 22, + 16, + 7, + 2, + 11, + 3, + 1, + 16, + 0, + 0, + 0, + 5, + 5, + 8, + 4, + 14, + 13, + 8, + 4, + 2, + 11, + 7, + 2, + 2, + 1, + 1, + 6, + 5, + 1, + 5, + 10, + 7, + 11, + 4, + 3, + 3, + 7, + 11, + 1 + ], + "weighted_loads": [ + 1.442606007680297, + 0.07676642015576363, + 0.08536479622125626, + 1.975603660568595, + 0.39815616980195045, + 0.03179128095507622, + 0.12019393593072891, + 0.3410907872021198, + 0.0, + 0.2567343935370445, + 0.5803861226886511, + 0.5534744784235954, + 0.5901496354490519, + 0.6936255544424057, + 0.08852352574467659, + 0.3939743675291538, + 0.4124118983745575, + 0.5819249823689461, + 0.10982703790068626, + 0.0, + 0.14386022090911865, + 0.4066155534237623, + 0.0667116641998291, + 0.7020452953875065, + 0.6071843607351184, + 1.4120013248175383, + 2.634752405807376, + 0.3569584023207426, + 0.0997137762606144, + 1.0601937444880605, + 0.13324694707989693, + 0.03886930271983147, + 1.29920070245862, + 0.0, + 0.0, + 0.0, + 0.2609727755188942, + 0.29581217654049397, + 0.5349320992827415, + 0.19196325540542603, + 1.807505376636982, + 0.8635388584807515, + 0.4738844968378544, + 0.2181243598461151, + 0.24103425815701485, + 1.5538808219134808, + 0.5957680214196444, + 0.13138698786497116, + 0.08409928157925606, + 0.04238586127758026, + 0.13346314430236816, + 0.29486059956252575, + 0.2644365280866623, + 0.04547133669257164, + 0.5333877541124821, + 0.588165795430541, + 0.6186338327825069, + 0.5883237309753895, + 0.1742655672132969, + 0.12865979224443436, + 0.08927277475595474, + 0.4057130552828312, + 0.938421068713069, + 0.028660660609602928 + ], + "unique_experts": 59, + "load_cv": 0.814367511903836, + "normalized_load_entropy": 0.9188809415383887, + "max_load_share": 0.057291666666666664 + } + }, + "s0_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "ef05d825a81d3a55b90a569ca54d960c666cbb0cf774499e40998e7903a1eead", + "route_weight_sha256": "6b1e5ad00af2ae503fe0b0fe42c1bc5d49ba1960ab17aa8aa26eb9d4791b40c9", + "loads": [ + 11, + 2, + 0, + 2, + 1, + 1, + 0, + 4, + 0, + 2, + 1, + 6, + 10, + 3, + 3, + 1, + 2, + 0, + 0, + 0, + 1, + 4, + 1, + 3, + 0, + 1, + 3, + 4, + 2, + 9, + 0, + 0, + 10, + 0, + 0, + 0, + 0, + 3, + 1, + 3, + 1, + 6, + 3, + 4, + 0, + 6, + 5, + 0, + 2, + 0, + 0, + 0, + 1, + 1, + 4, + 3, + 0, + 0, + 3, + 1, + 0, + 3, + 1, + 0 + ], + "weighted_loads": [ + 1.1020091269165277, + 0.06381616555154324, + 0.0, + 1.2990344166755676, + 0.03567802906036377, + 0.024720212444663048, + 0.0, + 0.28619077429175377, + 0.0, + 0.0960194580256939, + 0.04126228392124176, + 0.49314094707369804, + 0.6221816670149565, + 0.08287441171705723, + 0.09486604295670986, + 0.03955557942390442, + 0.2777926027774811, + 0.0, + 0.0, + 0.0, + 0.07162696868181229, + 0.3414443898946047, + 0.07462551444768906, + 0.0770405400544405, + 0.0, + 0.03196758031845093, + 0.7701426781713963, + 0.236100222915411, + 0.09055639803409576, + 1.0001703687012196, + 0.0, + 0.0, + 1.0958660375326872, + 0.0, + 0.0, + 0.0, + 0.0, + 0.22717346623539925, + 0.046288859099149704, + 0.1487267129123211, + 0.03832362964749336, + 0.4979073293507099, + 0.2293071448802948, + 0.22989244386553764, + 0.0, + 0.25915140844881535, + 0.37869058921933174, + 0.0, + 0.0958956778049469, + 0.0, + 0.0, + 0.0, + 0.039022576063871384, + 0.043591391295194626, + 0.45500029996037483, + 0.19678881764411926, + 0.0, + 0.0, + 0.14528032764792442, + 0.041699521243572235, + 0.0, + 0.1620008945465088, + 0.04039059951901436, + 0.0 + ], + "unique_experts": 42, + "load_cv": 1.222126745807789, + "normalized_load_entropy": 0.8336556760997546, + "max_load_share": 0.07971014492753623 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "3b61dbc75957a0a15d954aea3c3bb2d5abd9f24e488021a591cb21957f4a9a59", + "route_weight_sha256": "46d71bc2f3e3b31b43c516e9b07c6024102eec31439b0992a813d1e9c4039bdc", + "loads": [ + 18, + 4, + 1, + 9, + 2, + 1, + 2, + 4, + 0, + 5, + 8, + 7, + 14, + 11, + 3, + 2, + 2, + 7, + 3, + 1, + 4, + 5, + 1, + 9, + 6, + 7, + 11, + 7, + 6, + 10, + 0, + 0, + 18, + 0, + 0, + 0, + 0, + 3, + 7, + 3, + 9, + 8, + 5, + 6, + 0, + 11, + 5, + 0, + 2, + 3, + 1, + 0, + 3, + 2, + 5, + 6, + 0, + 3, + 4, + 2, + 0, + 4, + 8, + 0 + ], + "weighted_loads": [ + 1.4627004340291023, + 0.14816159196197987, + 0.05171235278248787, + 1.8883383944630623, + 0.07483713701367378, + 0.024720212444663048, + 0.09620825946331024, + 0.28619077429175377, + 0.0, + 0.1842463780194521, + 0.4764944203197956, + 0.5116956420242786, + 0.872073657810688, + 0.6866002734750509, + 0.09486604295670986, + 0.08681290969252586, + 0.2777926027774811, + 0.6848468966782093, + 0.2578115351498127, + 0.059632547199726105, + 0.37767911702394485, + 0.41843064315617085, + 0.07462551444768906, + 0.3473713342100382, + 0.506588201969862, + 0.36249490827322006, + 1.490131925791502, + 0.361129242926836, + 0.23594775795936584, + 1.0301410015672445, + 0.0, + 0.0, + 1.4559962581843138, + 0.0, + 0.0, + 0.0, + 0.0, + 0.22717346623539925, + 0.3249718062579632, + 0.1487267129123211, + 1.0531987473368645, + 0.5686926022171974, + 0.420580118894577, + 0.2834167815744877, + 0.0, + 1.0580961871892214, + 0.37869058921933174, + 0.0, + 0.0958956778049469, + 0.252546489238739, + 0.06711398810148239, + 0.0, + 0.1703643910586834, + 0.09476319700479507, + 0.5293060652911663, + 0.342611713334918, + 0.0, + 0.16052477434277534, + 0.17514321021735668, + 0.08925525099039078, + 0.0, + 0.2057182379066944, + 0.5731150805950165, + 0.0 + ], + "unique_experts": 51, + "load_cv": 0.9362388636862621, + "normalized_load_entropy": 0.8905791058305309, + "max_load_share": 0.0625 + } + }, + "s1_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "6dec73fd27fe668bdb5e3935470d76b8cb67e5ff75b3b906926ccb24805ec097", + "route_weight_sha256": "61a6546a0917911179119328ff562a88e932fa59cabccec5f82ac6e7f0396461", + "loads": [ + 11, + 1, + 0, + 3, + 0, + 1, + 0, + 4, + 0, + 2, + 1, + 6, + 9, + 3, + 3, + 2, + 2, + 0, + 0, + 0, + 1, + 4, + 1, + 3, + 0, + 0, + 3, + 4, + 2, + 8, + 0, + 0, + 10, + 0, + 2, + 0, + 0, + 3, + 1, + 3, + 1, + 7, + 4, + 3, + 0, + 6, + 5, + 0, + 2, + 0, + 0, + 0, + 1, + 1, + 4, + 3, + 0, + 0, + 3, + 1, + 1, + 2, + 1, + 0 + ], + "weighted_loads": [ + 1.0944323129951954, + 0.03412943333387375, + 0.0, + 1.3174553997814655, + 0.0, + 0.027185959741473198, + 0.0, + 0.2908843755722046, + 0.0, + 0.09528102725744247, + 0.04533830285072327, + 0.4547920264303684, + 0.592463007196784, + 0.08381938189268112, + 0.094276063144207, + 0.07379942014813423, + 0.27781642600893974, + 0.0, + 0.0, + 0.0, + 0.0740504339337349, + 0.3233535662293434, + 0.06793051958084106, + 0.07742691971361637, + 0.0, + 0.0, + 0.7987900078296661, + 0.2347126267850399, + 0.09238187223672867, + 0.9621760658919811, + 0.0, + 0.0, + 1.0650327447801828, + 0.0, + 0.06624085828661919, + 0.0, + 0.0, + 0.2317052036523819, + 0.04203607887029648, + 0.15600896626710892, + 0.0364781953394413, + 0.5153126809746027, + 0.26249004155397415, + 0.1948573850095272, + 0.0, + 0.25911738350987434, + 0.3764467928558588, + 0.0, + 0.08967828750610352, + 0.0, + 0.0, + 0.0, + 0.04065592586994171, + 0.05016500875353813, + 0.450497280806303, + 0.19157267734408379, + 0.0, + 0.0, + 0.14655404910445213, + 0.037757061421871185, + 0.028489110991358757, + 0.13879219815135002, + 0.03986264392733574, + 0.0 + ], + "unique_experts": 42, + "load_cv": 1.194311940990441, + "normalized_load_entropy": 0.8373725498905726, + "max_load_share": 0.07971014492753623 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "d321b35092410dd4616c52249493a5cfe584b979555b00dddb2a12275e19d807", + "route_weight_sha256": "8039b8bf863c9306099153d58f2a67f06af09537e8fce9ce13fa9776d874b7f8", + "loads": [ + 18, + 5, + 1, + 10, + 7, + 1, + 3, + 5, + 0, + 8, + 8, + 8, + 11, + 11, + 3, + 8, + 3, + 6, + 3, + 0, + 2, + 5, + 1, + 11, + 9, + 20, + 15, + 7, + 4, + 9, + 2, + 1, + 15, + 0, + 2, + 0, + 5, + 5, + 7, + 4, + 15, + 12, + 10, + 4, + 2, + 12, + 7, + 2, + 2, + 2, + 2, + 6, + 5, + 1, + 5, + 10, + 7, + 10, + 4, + 3, + 2, + 6, + 12, + 0 + ], + "weighted_loads": [ + 1.4509337805211544, + 0.23319167643785477, + 0.04564720019698143, + 1.9906054474413395, + 0.4255127739161253, + 0.027185959741473198, + 0.12019393593072891, + 0.34580470621585846, + 0.0, + 0.31236862391233444, + 0.5314914640039206, + 0.5225288718938828, + 0.689203655347228, + 0.6882960386574268, + 0.094276063144207, + 0.35235488787293434, + 0.4158835969865322, + 0.5819249823689461, + 0.11575990915298462, + 0.0, + 0.16828707605600357, + 0.4001646488904953, + 0.06793051958084106, + 0.7017070446163416, + 0.6095632314682007, + 1.306769410148263, + 1.7404002789407969, + 0.36152469739317894, + 0.18120570853352547, + 1.0406670905649662, + 0.09538131952285767, + 0.03886930271983147, + 1.2592236697673798, + 0.0, + 0.06624085828661919, + 0.0, + 0.2609727755188942, + 0.3055680599063635, + 0.5128055028617382, + 0.18973493203520775, + 1.8071910813450813, + 0.8620514813810587, + 0.5510891601443291, + 0.213716559112072, + 0.24103425815701485, + 1.6416258439421654, + 0.5951006580144167, + 0.13138698786497116, + 0.08967828750610352, + 0.07870583608746529, + 0.18999474123120308, + 0.29486059956252575, + 0.2642597034573555, + 0.05016500875353813, + 0.5364883281290531, + 0.594096826389432, + 0.6186338327825069, + 0.5425558052957058, + 0.17100606858730316, + 0.130052100867033, + 0.06069970689713955, + 0.3649364970624447, + 0.944681653752923, + 0.0 + ], + "unique_experts": 59, + "load_cv": 0.7756046028744286, + "normalized_load_entropy": 0.9246241216022185, + "max_load_share": 0.052083333333333336 + } + }, + "s0_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "4439445668c01c9c42f8678542b0c45f89c0e93be3cbb97d5fdbdf0d5719e00c", + "route_weight_sha256": "2f6446b8d50d1281625e86fac0b14f0d25e535944d91261f60945571a23d4185", + "loads": [ + 11, + 1, + 0, + 2, + 0, + 1, + 0, + 4, + 0, + 2, + 1, + 6, + 8, + 3, + 3, + 2, + 2, + 0, + 0, + 0, + 1, + 4, + 1, + 3, + 0, + 0, + 3, + 5, + 2, + 8, + 0, + 0, + 10, + 0, + 1, + 0, + 0, + 3, + 1, + 3, + 1, + 7, + 3, + 3, + 0, + 6, + 5, + 0, + 2, + 0, + 0, + 0, + 1, + 1, + 4, + 3, + 0, + 0, + 3, + 1, + 2, + 4, + 1, + 0 + ], + "weighted_loads": [ + 1.1401886437088251, + 0.03526750206947327, + 0.0, + 1.3443447947502136, + 0.0, + 0.02571599744260311, + 0.0, + 0.3020014762878418, + 0.0, + 0.09780221804976463, + 0.04606878012418747, + 0.4740404635667801, + 0.5437337923794985, + 0.08122539892792702, + 0.10252591222524643, + 0.06840590015053749, + 0.24552342295646667, + 0.0, + 0.0, + 0.0, + 0.07777547836303711, + 0.3559303507208824, + 0.07023806124925613, + 0.07622923143208027, + 0.0, + 0.0, + 0.738875899463892, + 0.24854756146669388, + 0.09553991630673409, + 0.9846293330192566, + 0.0, + 0.0, + 1.1309579703956842, + 0.0, + 0.04085876792669296, + 0.0, + 0.0, + 0.21826796978712082, + 0.04276946559548378, + 0.1570049338042736, + 0.0366353765130043, + 0.5049297958612442, + 0.23778722621500492, + 0.20807112008333206, + 0.0, + 0.2557865660637617, + 0.36976663768291473, + 0.0, + 0.0880952700972557, + 0.0, + 0.0, + 0.0, + 0.041408173739910126, + 0.03519974276423454, + 0.4565320983529091, + 0.19454042240977287, + 0.0, + 0.0, + 0.1455287951976061, + 0.037784021347761154, + 0.06497258879244328, + 0.1882652249187231, + 0.03776294365525246, + 0.0 + ], + "unique_experts": 42, + "load_cv": 1.1830029180952184, + "normalized_load_entropy": 0.838483280009587, + "max_load_share": 0.07971014492753623 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "44dbfad64034757b8787240e3ed1b78e0c586fd88d633af97a1c970fe01d9fc3", + "route_weight_sha256": "6942cb10ddf7845826ab99fba96acd31da3df0cf184a76363d595159e141c121", + "loads": [ + 17, + 2, + 3, + 10, + 0, + 1, + 2, + 4, + 0, + 6, + 8, + 7, + 10, + 12, + 3, + 4, + 2, + 8, + 3, + 0, + 3, + 5, + 1, + 10, + 6, + 8, + 9, + 8, + 6, + 9, + 0, + 0, + 18, + 0, + 1, + 0, + 0, + 3, + 7, + 3, + 9, + 9, + 7, + 5, + 0, + 11, + 5, + 0, + 3, + 0, + 2, + 0, + 3, + 1, + 5, + 7, + 0, + 3, + 4, + 1, + 2, + 5, + 7, + 0 + ], + "weighted_loads": [ + 1.426820531487465, + 0.07114971429109573, + 0.13082556053996086, + 2.0830078050494194, + 0.0, + 0.02571599744260311, + 0.09620825946331024, + 0.3020014762878418, + 0.0, + 0.2321398053318262, + 0.5903487280011177, + 0.4925951585173607, + 0.6063891053199768, + 0.7226568087935448, + 0.10252591222524643, + 0.16145560517907143, + 0.24552342295646667, + 0.7280150912702084, + 0.31561728194355965, + 0.0, + 0.28094058483839035, + 0.396162286400795, + 0.07023806124925613, + 0.4054234270006418, + 0.4895518459379673, + 0.4258807096630335, + 1.3133172281086445, + 0.3735765814781189, + 0.25405656918883324, + 1.0145999658852816, + 0.0, + 0.0, + 1.5073113460093737, + 0.0, + 0.04085876792669296, + 0.0, + 0.0, + 0.21826796978712082, + 0.3199918195605278, + 0.1570049338042736, + 1.0458210706710815, + 0.5823986455798149, + 0.5178787801414728, + 0.2615954577922821, + 0.0, + 1.1321553979068995, + 0.36976663768291473, + 0.0, + 0.12794771417975426, + 0.0, + 0.1323164403438568, + 0.0, + 0.1858781948685646, + 0.03519974276423454, + 0.4978858530521393, + 0.3847644720226526, + 0.0, + 0.16612348705530167, + 0.17539167776703835, + 0.037784021347761154, + 0.06497258879244328, + 0.22271147556602955, + 0.47939490526914597, + 0.0 + ], + "unique_experts": 50, + "load_cv": 0.9187686338078459, + "normalized_load_entropy": 0.8899973982634884, + "max_load_share": 0.0625 + } + }, + "s1_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "6056fbeb252d75e7ee600366efa5132d8955e02140a0373094b6c41569a199c7", + "route_weight_sha256": "cf6a7fe1ffbfb3db5335a6cf74212d2e57fd1740c7104463bfd880ad49312e64", + "loads": [ + 9, + 1, + 0, + 3, + 0, + 1, + 0, + 4, + 0, + 2, + 1, + 6, + 10, + 3, + 3, + 3, + 2, + 0, + 0, + 0, + 1, + 4, + 1, + 2, + 0, + 0, + 3, + 5, + 2, + 8, + 0, + 0, + 10, + 0, + 1, + 0, + 0, + 3, + 0, + 3, + 2, + 8, + 4, + 3, + 0, + 6, + 5, + 0, + 2, + 0, + 0, + 1, + 1, + 0, + 4, + 3, + 0, + 0, + 3, + 1, + 1, + 2, + 1, + 0 + ], + "weighted_loads": [ + 1.0335760600864887, + 0.03643127903342247, + 0.0, + 1.2679282687604427, + 0.0, + 0.02848547138273716, + 0.0, + 0.3160289227962494, + 0.0, + 0.091236911714077, + 0.044896189123392105, + 0.4607941284775734, + 0.6210565399378538, + 0.08109229616820812, + 0.09975093230605125, + 0.09955966472625732, + 0.2394747994840145, + 0.0, + 0.0, + 0.0, + 0.08194062113761902, + 0.32489150017499924, + 0.05680406466126442, + 0.0577289704233408, + 0.0, + 0.0, + 0.7397903241217136, + 0.27775654569268227, + 0.09566866979002953, + 0.9802255742251873, + 0.0, + 0.0, + 1.1421768981963396, + 0.0, + 0.04372053220868111, + 0.0, + 0.0, + 0.20761992409825325, + 0.0, + 0.1639474742114544, + 0.08029776066541672, + 0.5452352818101645, + 0.2664216049015522, + 0.20081860572099686, + 0.0, + 0.25251780822873116, + 0.37253986299037933, + 0.0, + 0.0798637866973877, + 0.0, + 0.0, + 0.03060467541217804, + 0.04064507037401199, + 0.0, + 0.46961353346705437, + 0.18806597217917442, + 0.0, + 0.0, + 0.14855597913265228, + 0.03958069533109665, + 0.03168365731835365, + 0.13980856910347939, + 0.03056216612458229, + 0.0 + ], + "unique_experts": 41, + "load_cv": 1.197122503938086, + "normalized_load_entropy": 0.8335999784365908, + "max_load_share": 0.07246376811594203 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "a4f232cc58641bd335f0e90778b3b346877a991e1bcd241663be4dae9eec2d08", + "route_weight_sha256": "4a73517aa7b2e775f60f6490aec38727132ce6c037b80605e1f158725df102df", + "loads": [ + 15, + 2, + 2, + 11, + 6, + 1, + 3, + 5, + 0, + 8, + 10, + 8, + 10, + 12, + 3, + 9, + 3, + 8, + 4, + 0, + 1, + 5, + 1, + 11, + 9, + 23, + 12, + 7, + 2, + 9, + 2, + 1, + 15, + 0, + 1, + 0, + 5, + 5, + 5, + 4, + 15, + 13, + 10, + 4, + 2, + 11, + 7, + 2, + 3, + 1, + 2, + 7, + 5, + 1, + 5, + 11, + 7, + 14, + 5, + 3, + 2, + 7, + 9, + 0 + ], + "weighted_loads": [ + 1.3347352221608162, + 0.07938884943723679, + 0.09882887080311775, + 2.1062743328511715, + 0.39815616980195045, + 0.02848547138273716, + 0.12019393593072891, + 0.37094925343990326, + 0.0, + 0.2878320850431919, + 0.7141142655164003, + 0.5285309739410877, + 0.6210565399378538, + 0.7464830446988344, + 0.09975093230605125, + 0.39183181151747704, + 0.377541970461607, + 0.6599230412393808, + 0.15270822867751122, + 0.0, + 0.08194062113761902, + 0.4017025828361511, + 0.05680406466126442, + 0.7115077078342438, + 0.6245886012911797, + 1.4726368319243193, + 1.4667387325316668, + 0.35636699572205544, + 0.09566866979002953, + 1.0587165988981724, + 0.09538131952285767, + 0.03886930271983147, + 1.355622798204422, + 0.0, + 0.04372053220868111, + 0.0, + 0.2609727755188942, + 0.28148278035223484, + 0.3795614540576935, + 0.19767343997955322, + 1.7577265724539757, + 0.847716199234128, + 0.5570414625108242, + 0.21967777982354164, + 0.24103425815701485, + 1.4870807118713856, + 0.5911937281489372, + 0.13138698786497116, + 0.11747792363166809, + 0.039456807076931, + 0.21961960941553116, + 0.3254652749747038, + 0.292531281709671, + 0.033046867698431015, + 0.5556045807898045, + 0.6341689471155405, + 0.6186338327825069, + 0.754429541528225, + 0.22337747737765312, + 0.13187573477625847, + 0.06389425322413445, + 0.4109755642712116, + 0.6356045883148909, + 0.0 + ], + "unique_experts": 59, + "load_cv": 0.7976745716281936, + "normalized_load_entropy": 0.920536857865469, + "max_load_share": 0.059895833333333336 + } + }, + "s0_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "ba997caaf32a9138af51a53b3f449be4f4b50d1a831fe434281c6019532f0c53", + "route_weight_sha256": "e6b821c7d7ee9532e7b8d96ca1e3323454f273ab3359fa1e8257ee15c2e66c72", + "loads": [ + 11, + 1, + 0, + 2, + 0, + 1, + 0, + 4, + 0, + 2, + 1, + 6, + 9, + 3, + 3, + 1, + 2, + 0, + 0, + 0, + 1, + 4, + 1, + 3, + 0, + 1, + 3, + 4, + 2, + 8, + 0, + 0, + 10, + 0, + 1, + 0, + 0, + 3, + 1, + 3, + 1, + 6, + 4, + 3, + 0, + 6, + 5, + 0, + 2, + 0, + 0, + 0, + 1, + 1, + 4, + 3, + 0, + 0, + 3, + 1, + 2, + 3, + 1, + 1 + ], + "weighted_loads": [ + 1.1231883484870195, + 0.03557366505265236, + 0.0, + 1.3032772541046143, + 0.0, + 0.026535095646977425, + 0.0, + 0.30167724192142487, + 0.0, + 0.09525524079799652, + 0.04363170266151428, + 0.47466012090444565, + 0.5682368278503418, + 0.08131064102053642, + 0.0990230068564415, + 0.03725489601492882, + 0.25396472588181496, + 0.0, + 0.0, + 0.0, + 0.08105520159006119, + 0.3609948307275772, + 0.06715790182352066, + 0.0757615976035595, + 0.0, + 0.031018467620015144, + 0.7484034113585949, + 0.23140317387878895, + 0.09026827290654182, + 0.9637984558939934, + 0.0, + 0.0, + 1.08663378842175, + 0.0, + 0.04140149801969528, + 0.0, + 0.0, + 0.22385163232684135, + 0.04210612177848816, + 0.1595543846487999, + 0.03879643976688385, + 0.48625246435403824, + 0.27683732099831104, + 0.2087714746594429, + 0.0, + 0.25643893890082836, + 0.38215411454439163, + 0.0, + 0.08520019054412842, + 0.0, + 0.0, + 0.0, + 0.03907753899693489, + 0.03959843888878822, + 0.448794461786747, + 0.19613754749298096, + 0.0, + 0.0, + 0.1463867463171482, + 0.040439050644636154, + 0.06177202798426151, + 0.1516806185245514, + 0.04197784140706062, + 0.02670014090836048 + ], + "unique_experts": 44, + "load_cv": 1.1744496894690244, + "normalized_load_entropy": 0.844790073381003, + "max_load_share": 0.07971014492753623 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "81fc0157ac5722815afcb2a9a44dda6890eb0afc345ab231feb9ee1b73da7d13", + "route_weight_sha256": "677ed175db1ea0214cb3563b20b812f58bb2e22abf9a586fce544b9570acb130", + "loads": [ + 17, + 2, + 2, + 10, + 0, + 1, + 2, + 4, + 0, + 5, + 7, + 7, + 11, + 11, + 3, + 3, + 2, + 7, + 3, + 0, + 4, + 5, + 1, + 9, + 6, + 10, + 10, + 8, + 7, + 10, + 0, + 0, + 18, + 0, + 1, + 0, + 0, + 3, + 6, + 3, + 9, + 8, + 8, + 5, + 0, + 11, + 5, + 0, + 2, + 1, + 2, + 0, + 3, + 2, + 5, + 8, + 0, + 2, + 4, + 1, + 2, + 4, + 7, + 1 + ], + "weighted_loads": [ + 1.4151945933699608, + 0.07145587727427483, + 0.1094893179833889, + 1.9403184168040752, + 0.0, + 0.026535095646977425, + 0.09620825946331024, + 0.30167724192142487, + 0.0, + 0.18348216079175472, + 0.4312729835510254, + 0.49321481585502625, + 0.6308921407908201, + 0.6850365027785301, + 0.0990230068564415, + 0.12365052849054337, + 0.25396472588181496, + 0.6848468966782093, + 0.345120657235384, + 0.0, + 0.3385390341281891, + 0.40775131806731224, + 0.06715790182352066, + 0.3460923917591572, + 0.49063269421458244, + 0.48512074165046215, + 1.3606765568256378, + 0.39275998435914516, + 0.2902289628982544, + 1.0314361285418272, + 0.0, + 0.0, + 1.4556286353617907, + 0.0, + 0.04140149801969528, + 0.0, + 0.0, + 0.22385163232684135, + 0.2691991738975048, + 0.1595543846487999, + 1.08498977124691, + 0.583794541656971, + 0.5707987230271101, + 0.26229581236839294, + 0.0, + 1.1804050523787737, + 0.38215411454439163, + 0.0, + 0.08520019054412842, + 0.03430863469839096, + 0.1311824470758438, + 0.0, + 0.17879503592848778, + 0.07579019293189049, + 0.4917602986097336, + 0.5486443135887384, + 0.0, + 0.12181093171238899, + 0.17624962888658047, + 0.040439050644636154, + 0.06177202798426151, + 0.1913202702999115, + 0.5140872225165367, + 0.02670014090836048 + ], + "unique_experts": 52, + "load_cv": 0.9212846639876111, + "normalized_load_entropy": 0.8926165307788467, + "max_load_share": 0.0625 + } + }, + "s1_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "49d168c623f03c69ab53139a1bd52308e8d8fe922a9e85de06b44c4a1811895d", + "route_weight_sha256": "24fc9ed817d381c03bfe695d5b5a1bbf9f2d061886a1113c9488badc58eff5e6", + "loads": [ + 10, + 1, + 0, + 3, + 0, + 1, + 0, + 4, + 0, + 2, + 1, + 6, + 9, + 3, + 3, + 2, + 2, + 0, + 0, + 0, + 1, + 4, + 1, + 2, + 0, + 1, + 3, + 5, + 1, + 8, + 0, + 0, + 10, + 0, + 2, + 0, + 0, + 3, + 1, + 3, + 2, + 7, + 4, + 3, + 0, + 6, + 5, + 0, + 2, + 0, + 0, + 0, + 1, + 0, + 4, + 3, + 0, + 0, + 4, + 1, + 1, + 2, + 1, + 0 + ], + "weighted_loads": [ + 1.049277450889349, + 0.03669294714927673, + 0.0, + 1.247984992340207, + 0.0, + 0.02940080128610134, + 0.0, + 0.32363395765423775, + 0.0, + 0.08701840415596962, + 0.04433039575815201, + 0.45264946296811104, + 0.594394763931632, + 0.08277537859976292, + 0.09760048054158688, + 0.07001729309558868, + 0.2306046448647976, + 0.0, + 0.0, + 0.0, + 0.07655523717403412, + 0.33444682136178017, + 0.053650494664907455, + 0.05801912397146225, + 0.0, + 0.030690742656588554, + 0.732951071113348, + 0.2794281765818596, + 0.05157722532749176, + 0.9672669507563114, + 0.0, + 0.0, + 1.10808240249753, + 0.0, + 0.07502389512956142, + 0.0, + 0.0, + 0.20726353302598, + 0.046568773686885834, + 0.15644364058971405, + 0.0788826234638691, + 0.5308591052889824, + 0.27718695253133774, + 0.200671274214983, + 0.0, + 0.261320972815156, + 0.3516948018223047, + 0.0, + 0.08068414032459259, + 0.0, + 0.0, + 0.0, + 0.038691453635692596, + 0.0, + 0.45418740436434746, + 0.19398656859993935, + 0.0, + 0.0, + 0.1732944566756487, + 0.03857610374689102, + 0.03032137267291546, + 0.13219129666686058, + 0.034074511379003525, + 0.0 + ], + "unique_experts": 42, + "load_cv": 1.180158729654263, + "normalized_load_entropy": 0.8382597496321507, + "max_load_share": 0.07246376811594203 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "2bfc4e7f6ccd170f846a5a0c1ed1fae4ac60e8924704326898a9991989b30009", + "route_weight_sha256": "7f291249a5b2dfb4fd4323bae8c036037e3aa44d489931d567e134d915d63d02", + "loads": [ + 16, + 3, + 2, + 11, + 6, + 1, + 3, + 5, + 0, + 7, + 9, + 8, + 9, + 11, + 3, + 9, + 3, + 6, + 3, + 0, + 1, + 5, + 1, + 10, + 10, + 24, + 13, + 7, + 3, + 9, + 2, + 1, + 15, + 0, + 2, + 0, + 5, + 5, + 5, + 4, + 15, + 12, + 11, + 4, + 2, + 12, + 7, + 2, + 2, + 0, + 2, + 6, + 5, + 1, + 5, + 13, + 7, + 15, + 5, + 3, + 2, + 7, + 9, + 0 + ], + "weighted_loads": [ + 1.3378725722432137, + 0.11300161853432655, + 0.09285250306129456, + 1.974369777366519, + 0.39815616980195045, + 0.02940080128610134, + 0.12019393593072891, + 0.3785542882978916, + 0.0, + 0.24452104419469833, + 0.5769793931394815, + 0.5203863084316254, + 0.594394763931632, + 0.6872520353645086, + 0.09760048054158688, + 0.4207288511097431, + 0.36867181584239006, + 0.5819249823689461, + 0.14026598632335663, + 0.0, + 0.07655523717403412, + 0.41125790402293205, + 0.053650494664907455, + 0.6822992488741875, + 0.6145703364163637, + 1.57066535577178, + 1.4892138820141554, + 0.35803862661123276, + 0.1201140508055687, + 1.0457579754292965, + 0.09538131952285767, + 0.03886930271983147, + 1.3154961671680212, + 0.0, + 0.07502389512956142, + 0.0, + 0.2609727755188942, + 0.2811263892799616, + 0.4019763693213463, + 0.19016960635781288, + 1.6633762530982494, + 0.8474535830318928, + 0.6003595180809498, + 0.21953044831752777, + 0.24103425815701485, + 1.7162458505481482, + 0.5703486669808626, + 0.13138698786497116, + 0.08068414032459259, + 0.0, + 0.19936644285917282, + 0.29486059956252575, + 0.2935318201780319, + 0.03332336246967316, + 0.5401784516870975, + 0.8575275335460901, + 0.6186338327825069, + 0.8287499360740185, + 0.19774647615849972, + 0.13087114319205284, + 0.06253196857869625, + 0.43555978313088417, + 0.6383277308195829, + 0.0 + ], + "unique_experts": 58, + "load_cv": 0.8191501354723959, + "normalized_load_entropy": 0.9176785489561368, + "max_load_share": 0.0625 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "ordered_topk_exact_tokens": 19, + "set_exact_tokens": 22, + "mean_set_jaccard": 0.9875776397515529, + "mean_token_weighted_tv": 0.009278475995297018, + "aggregate_load_tv": 0.007246376811594199 + }, + "system_bos": { + "tokens": 23, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.9006211180124224, + "mean_token_weighted_tv": 0.02047793563131405, + "aggregate_load_tv": 0.050724637681159424 + }, + "system_x": { + "tokens": 23, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.9037267080745343, + "mean_token_weighted_tv": 0.02497722143712251, + "aggregate_load_tv": 0.05797101449275362 + }, + "system_period": { + "tokens": 23, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8881987577639753, + "mean_token_weighted_tv": 0.027631083098442658, + "aggregate_load_tv": 0.050724637681159424 + }, + "bos_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.9130434782608695, + "mean_token_weighted_tv": 0.019951738862563736, + "aggregate_load_tv": 0.05072463768115942 + }, + "bos_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.9254658385093167, + "mean_token_weighted_tv": 0.019446137482705322, + "aggregate_load_tv": 0.036231884057971016 + }, + "x_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 12, + "mean_set_jaccard": 0.8540372670807455, + "mean_token_weighted_tv": 0.0313355122976329, + "aggregate_load_tv": 0.05072463768115941 + }, + "x_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.8726708074534162, + "mean_token_weighted_tv": 0.03149298517762319, + "aggregate_load_tv": 0.07246376811594203 + }, + "period_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.888198757763975, + "mean_token_weighted_tv": 0.0257122161919656, + "aggregate_load_tv": 0.043478260869565216 + }, + "period_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.8975155279503105, + "mean_token_weighted_tv": 0.030009570086131924, + "aggregate_load_tv": 0.057971014492753624 + } + } + }, + "layer_18": { + "layer": 18, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "0f5f436dfc6fe12a98069c49099f26d30d31d17135bea8936deebe0968c01c76", + "route_weight_sha256": "6263401811b34b129ef432aab4079c1341361fa0418d34c8fc199de96ef59ba6", + "loads": [ + 0, + 4, + 5, + 3, + 17, + 7, + 1, + 3, + 1, + 0, + 1, + 1, + 5, + 2, + 2, + 4, + 0, + 1, + 3, + 0, + 1, + 0, + 2, + 0, + 2, + 1, + 0, + 2, + 0, + 1, + 1, + 0, + 1, + 5, + 1, + 5, + 4, + 0, + 1, + 0, + 1, + 0, + 8, + 0, + 2, + 0, + 0, + 12, + 0, + 3, + 1, + 3, + 2, + 0, + 3, + 0, + 6, + 2, + 0, + 2, + 0, + 0, + 3, + 3 + ], + "weighted_loads": [ + 0.0, + 0.5644678175449371, + 0.3753540776669979, + 0.20474477484822273, + 1.1010428369045258, + 0.4973016381263733, + 0.03916788101196289, + 0.18495695292949677, + 0.034846533089876175, + 0.0, + 0.0329100601375103, + 0.08132912963628769, + 0.1765800081193447, + 0.7753971852362156, + 0.10043814033269882, + 0.32720497623085976, + 0.0, + 0.10343299806118011, + 0.1496418509632349, + 0.0, + 0.04908871278166771, + 0.0, + 0.10275046154856682, + 0.0, + 0.07975109294056892, + 0.03764525428414345, + 0.0, + 0.10314927250146866, + 0.0, + 0.05165797099471092, + 0.06670749932527542, + 0.0, + 0.07186209410429001, + 0.3935096114873886, + 0.03698955848813057, + 0.23120078444480896, + 0.16414948552846909, + 0.0, + 0.0402483195066452, + 0.0, + 0.07155769318342209, + 0.0, + 0.41555388644337654, + 0.0, + 0.10234734043478966, + 0.0, + 0.0, + 1.0231778137385845, + 0.0, + 0.3791125789284706, + 0.028287509456276894, + 0.18651330471038818, + 0.21611637622117996, + 0.0, + 0.1445007622241974, + 0.0, + 0.6506415903568268, + 0.10184590891003609, + 0.0, + 0.2978537157177925, + 0.0, + 0.0, + 0.25835250690579414, + 0.23543977178633213 + ], + "unique_experts": 43, + "load_cv": 1.3650142930254727, + "normalized_load_entropy": 0.8246751634682278, + "max_load_share": 0.12318840579710146 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "f02d3f0410c0646598f4754b17eb4bd372da123a833dea29de75338743c4c60b", + "route_weight_sha256": "a65dc20de811583edb10fc3dc0c1c7882e5ad3a5d8f208aee34614288a9c834d", + "loads": [ + 6, + 5, + 17, + 3, + 17, + 9, + 1, + 3, + 10, + 0, + 2, + 5, + 6, + 2, + 7, + 8, + 0, + 1, + 23, + 0, + 1, + 2, + 2, + 0, + 2, + 1, + 0, + 2, + 0, + 1, + 10, + 0, + 1, + 5, + 1, + 10, + 5, + 4, + 1, + 2, + 6, + 0, + 11, + 0, + 2, + 0, + 8, + 12, + 3, + 15, + 3, + 5, + 11, + 6, + 3, + 0, + 8, + 3, + 1, + 5, + 0, + 3, + 3, + 5 + ], + "weighted_loads": [ + 0.39034682884812355, + 0.6362060159444809, + 1.4275193437933922, + 0.20474477484822273, + 1.1010428369045258, + 0.5439025349915028, + 0.03916788101196289, + 0.18495695292949677, + 0.6462096273899078, + 0.0, + 0.043865573592484, + 0.4656950980424881, + 0.2131936140358448, + 0.7753971852362156, + 1.0400673169642687, + 0.46900610625743866, + 0.0, + 0.10343299806118011, + 1.878762235864997, + 0.0, + 0.04908871278166771, + 0.05993678234517574, + 0.10275046154856682, + 0.0, + 0.07975109294056892, + 0.03764525428414345, + 0.0, + 0.10314927250146866, + 0.0, + 0.05165797099471092, + 0.7241037795320153, + 0.0, + 0.07186209410429001, + 0.3935096114873886, + 0.03698955848813057, + 0.4777798131108284, + 0.18776500411331654, + 0.14872009307146072, + 0.0402483195066452, + 0.0476519949734211, + 0.3093567118048668, + 0.0, + 0.5061718914657831, + 0.0, + 0.10234734043478966, + 0.0, + 1.5199420675635338, + 1.0231778137385845, + 0.14926400408148766, + 0.9065937455743551, + 0.08947608061134815, + 0.34360797703266144, + 0.8168590571731329, + 0.4018949158489704, + 0.1445007622241974, + 0.0, + 1.6480983793735504, + 0.12564070150256157, + 0.029346847906708717, + 0.4487322364002466, + 0.0, + 0.08813760802149773, + 0.25835250690579414, + 0.33000791259109974 + ], + "unique_experts": 52, + "load_cv": 1.072955995323776, + "normalized_load_entropy": 0.8721111103015526, + "max_load_share": 0.0798611111111111 + } + }, + "s1_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "c7a2f4014daf5e098a681e7b8e8a786294992349363ca50d8042c246e39b00ab", + "route_weight_sha256": "55dcc8090ac5b47053773a1abf13171a32be6895d8f4406aab4bee29ed3cd7d5", + "loads": [ + 0, + 4, + 5, + 3, + 16, + 7, + 0, + 3, + 1, + 0, + 1, + 1, + 4, + 2, + 2, + 4, + 0, + 2, + 3, + 0, + 1, + 1, + 2, + 0, + 2, + 1, + 0, + 2, + 0, + 1, + 1, + 0, + 1, + 5, + 1, + 5, + 4, + 0, + 1, + 0, + 1, + 0, + 8, + 0, + 2, + 0, + 0, + 12, + 0, + 3, + 2, + 3, + 2, + 0, + 3, + 0, + 5, + 2, + 0, + 2, + 0, + 0, + 3, + 4 + ], + "weighted_loads": [ + 0.0, + 0.539628379046917, + 0.3824406675994396, + 0.19345415756106377, + 1.0662419684231281, + 0.4951578564941883, + 0.0, + 0.18039166554808617, + 0.03365179896354675, + 0.0, + 0.03163642808794975, + 0.08000759035348892, + 0.1539717148989439, + 0.8036693558096886, + 0.10585450008511543, + 0.3171251192688942, + 0.0, + 0.13394291326403618, + 0.14896069280803204, + 0.0, + 0.0527750663459301, + 0.03945161774754524, + 0.09668220579624176, + 0.0, + 0.07779796421527863, + 0.03562653809785843, + 0.0, + 0.10136960074305534, + 0.0, + 0.051534175872802734, + 0.0622430182993412, + 0.0, + 0.0689876601099968, + 0.3874773941934109, + 0.03964170441031456, + 0.22413350455462933, + 0.16001734137535095, + 0.0, + 0.03922291845083237, + 0.0, + 0.06265801191329956, + 0.0, + 0.4380228463560343, + 0.0, + 0.10910511389374733, + 0.0, + 0.0, + 1.0211546793580055, + 0.0, + 0.37631309032440186, + 0.06387794949114323, + 0.18215421587228775, + 0.20761995017528534, + 0.0, + 0.14269006252288818, + 0.0, + 0.6126145757734776, + 0.10804254934191704, + 0.0, + 0.3049519881606102, + 0.0, + 0.0, + 0.25716162100434303, + 0.26447767578065395 + ], + "unique_experts": 43, + "load_cv": 1.3148530257451094, + "normalized_load_entropy": 0.831621456714298, + "max_load_share": 0.11594202898550725 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "322019597d5a28be5ef4cc44054eace6301c943c0bd616824775ad77c2f2874b", + "route_weight_sha256": "549113535e5ed2e2ddf71a03bd2f13aab7f42af1c009c984e22de15c6c5d1fde", + "loads": [ + 8, + 7, + 18, + 3, + 17, + 9, + 1, + 5, + 12, + 2, + 2, + 5, + 4, + 3, + 11, + 5, + 0, + 12, + 28, + 1, + 1, + 3, + 3, + 0, + 2, + 1, + 0, + 2, + 0, + 2, + 13, + 2, + 2, + 6, + 5, + 22, + 5, + 7, + 2, + 2, + 6, + 0, + 10, + 5, + 2, + 0, + 18, + 16, + 2, + 17, + 3, + 5, + 10, + 11, + 5, + 1, + 8, + 8, + 3, + 6, + 0, + 3, + 3, + 9 + ], + "weighted_loads": [ + 0.41062733717262745, + 0.6817743182182312, + 1.4386618193238974, + 0.19345415756106377, + 1.1054614074528217, + 0.5522115658968687, + 0.029560163617134094, + 0.2487628534436226, + 0.9768779799342155, + 0.0614237766712904, + 0.04337526299059391, + 0.43939023464918137, + 0.1539717148989439, + 0.8401775695383549, + 1.1930485423654318, + 0.35025128722190857, + 0.0, + 0.7320151478052139, + 2.5557839293032885, + 0.13707377016544342, + 0.0527750663459301, + 0.09900548122823238, + 0.1319340094923973, + 0.0, + 0.07779796421527863, + 0.03562653809785843, + 0.0, + 0.10136960074305534, + 0.0, + 0.08829944208264351, + 0.9411851251497865, + 0.24286023154854774, + 0.12460392713546753, + 0.46410126611590385, + 0.4589099809527397, + 1.6341813560575247, + 0.18342122808098793, + 0.30035340040922165, + 0.0796489305794239, + 0.04781225137412548, + 0.2698948532342911, + 0.0, + 0.4962714612483978, + 0.4543166011571884, + 0.10910511389374733, + 0.0, + 2.733769878745079, + 1.1992745362222195, + 0.07264812849462032, + 0.9807555247098207, + 0.09013582952320576, + 0.3620453029870987, + 0.7726434096693993, + 0.6230351123958826, + 0.2638698033988476, + 0.03481612727046013, + 1.623607162386179, + 0.37717523612082005, + 0.3692931495606899, + 0.5783270224928856, + 0.0, + 0.10322022438049316, + 0.25716162100434303, + 0.45053770020604134 + ], + "unique_experts": 57, + "load_cv": 0.9864533834793096, + "normalized_load_entropy": 0.8933693960822028, + "max_load_share": 0.07291666666666667 + } + }, + "s0_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "e2e93c4a4f2bd255af99d6f467f9854d3abe8e62e77db3ca5f3c8d2a7b9b8648", + "route_weight_sha256": "2f5b5d704bb225f0246059536069031ba8dceffce278a07cdaa40c066d6312ec", + "loads": [ + 0, + 4, + 5, + 3, + 17, + 8, + 1, + 3, + 1, + 0, + 1, + 1, + 5, + 2, + 2, + 4, + 0, + 2, + 3, + 0, + 1, + 0, + 2, + 0, + 2, + 1, + 0, + 2, + 0, + 1, + 1, + 0, + 1, + 5, + 1, + 6, + 4, + 0, + 1, + 0, + 1, + 0, + 7, + 0, + 1, + 0, + 0, + 11, + 0, + 3, + 0, + 3, + 2, + 0, + 2, + 0, + 6, + 2, + 0, + 2, + 0, + 0, + 5, + 3 + ], + "weighted_loads": [ + 0.0, + 0.6080430708825588, + 0.39155329018831253, + 0.20890652388334274, + 1.0718847000971437, + 0.5963609889149666, + 0.03750012442469597, + 0.17775139212608337, + 0.03657444566488266, + 0.0, + 0.03294263780117035, + 0.0852511003613472, + 0.18615875951945782, + 0.8092326112091541, + 0.10260755568742752, + 0.3299563340842724, + 0.0, + 0.13124223798513412, + 0.14880107901990414, + 0.0, + 0.04776420816779137, + 0.0, + 0.09483382850885391, + 0.0, + 0.08543946593999863, + 0.03576003387570381, + 0.0, + 0.10642486065626144, + 0.0, + 0.053415391594171524, + 0.05459349974989891, + 0.0, + 0.07526673376560211, + 0.3986959233880043, + 0.03739757463335991, + 0.24744204059243202, + 0.1606761161237955, + 0.0, + 0.038898758590221405, + 0.0, + 0.08140978217124939, + 0.0, + 0.40131538547575474, + 0.0, + 0.06425350904464722, + 0.0, + 0.0, + 0.9647357445210218, + 0.0, + 0.36083999276161194, + 0.0, + 0.19013745337724686, + 0.21020351722836494, + 0.0, + 0.11635833978652954, + 0.0, + 0.6587237883359194, + 0.10226583480834961, + 0.0, + 0.27805523946881294, + 0.0, + 0.0, + 0.3311532251536846, + 0.22815041989088058 + ], + "unique_experts": 42, + "load_cv": 1.362550088298112, + "normalized_load_entropy": 0.8210106733760099, + "max_load_share": 0.12318840579710146 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "750521fc9b9d2aa5528757db7e253db162f6a5033d4d44db82c54423fab01301", + "route_weight_sha256": "2aa1f8b60fca9b4e8b5951b604de85fc1669dcdd1c6d39e731284c444503e99e", + "loads": [ + 6, + 5, + 16, + 3, + 17, + 10, + 1, + 3, + 10, + 0, + 1, + 4, + 7, + 2, + 7, + 7, + 0, + 2, + 23, + 0, + 1, + 2, + 2, + 1, + 2, + 1, + 1, + 2, + 0, + 1, + 8, + 0, + 1, + 6, + 1, + 12, + 4, + 4, + 1, + 4, + 7, + 1, + 11, + 0, + 1, + 0, + 9, + 11, + 3, + 14, + 1, + 5, + 11, + 5, + 2, + 0, + 7, + 3, + 1, + 4, + 0, + 4, + 5, + 5 + ], + "weighted_loads": [ + 0.39034682884812355, + 0.6797812692821026, + 1.417198108509183, + 0.20890652388334274, + 1.0718847000971437, + 0.642961885780096, + 0.03750012442469597, + 0.17775139212608337, + 0.6539254076778889, + 0.0, + 0.03294263780117035, + 0.34381815791130066, + 0.44372417591512203, + 0.8092326112091541, + 0.8449644725769758, + 0.43284180015325546, + 0.0, + 0.13124223798513412, + 1.8169088792055845, + 0.0, + 0.04776420816779137, + 0.056177543476223946, + 0.09483382850885391, + 0.04817856848239899, + 0.08543946593999863, + 0.03576003387570381, + 0.04721388965845108, + 0.10642486065626144, + 0.0, + 0.053415391594171524, + 0.6598162688314915, + 0.0, + 0.07526673376560211, + 0.46232912689447403, + 0.03739757463335991, + 0.5475597269833088, + 0.1606761161237955, + 0.1527482382953167, + 0.038898758590221405, + 0.2137206867337227, + 0.41865912452340126, + 0.06369853764772415, + 0.5623438730835915, + 0.0, + 0.06425350904464722, + 0.0, + 1.4750849641859531, + 0.9647357445210218, + 0.14926400408148766, + 0.8489318657666445, + 0.02634524554014206, + 0.3412047475576401, + 0.8109461981803179, + 0.3446546159684658, + 0.11635833978652954, + 0.0, + 0.8815362621098757, + 0.12244861759245396, + 0.029346847906708717, + 0.38359303027391434, + 0.0, + 0.13336365297436714, + 0.3311532251536846, + 0.3227185606956482 + ], + "unique_experts": 55, + "load_cv": 1.0548243081137514, + "normalized_load_entropy": 0.8782483988542198, + "max_load_share": 0.0798611111111111 + } + }, + "s1_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "41968898a4d54c0cef19dd7461cce69426c260976669749c5ced1f8672c1bbcc", + "route_weight_sha256": "319f299b381ca074a38c58ac3f005acd9251f4abedcdab36f00102654e5c1690", + "loads": [ + 0, + 4, + 5, + 3, + 17, + 5, + 0, + 3, + 1, + 0, + 1, + 1, + 5, + 2, + 2, + 4, + 0, + 2, + 3, + 0, + 1, + 1, + 2, + 1, + 2, + 1, + 0, + 2, + 0, + 1, + 1, + 0, + 1, + 5, + 1, + 6, + 4, + 0, + 1, + 0, + 1, + 0, + 7, + 0, + 2, + 0, + 0, + 12, + 0, + 3, + 0, + 3, + 2, + 0, + 2, + 0, + 6, + 2, + 0, + 2, + 0, + 0, + 4, + 4 + ], + "weighted_loads": [ + 0.0, + 0.5894693993031979, + 0.3718784786760807, + 0.20052680745720863, + 1.1339820297434926, + 0.43058517947793007, + 0.0, + 0.1759839579463005, + 0.03407464921474457, + 0.0, + 0.030168114230036736, + 0.07926379889249802, + 0.1915620844811201, + 0.8337357118725777, + 0.10515810549259186, + 0.32351308688521385, + 0.0, + 0.13141575828194618, + 0.1575204897671938, + 0.0, + 0.05079912766814232, + 0.039615072309970856, + 0.08512646704912186, + 0.0402831956744194, + 0.0822564996778965, + 0.034647390246391296, + 0.0, + 0.10482458770275116, + 0.0, + 0.05227279290556908, + 0.06093231588602066, + 0.0, + 0.06948041170835495, + 0.39465582370758057, + 0.0357009619474411, + 0.24853382632136345, + 0.15926447603851557, + 0.0, + 0.040260396897792816, + 0.0, + 0.06986524164676666, + 0.0, + 0.39614049531519413, + 0.0, + 0.0982288345694542, + 0.0, + 0.0, + 0.9874934069812298, + 0.0, + 0.3734674006700516, + 0.0, + 0.1928713209927082, + 0.1801639124751091, + 0.0, + 0.11282527819275856, + 0.0, + 0.6699117980897427, + 0.11188270151615143, + 0.0, + 0.30748213827610016, + 0.0, + 0.0, + 0.2758955582976341, + 0.2792074829339981 + ], + "unique_experts": 43, + "load_cv": 1.3451742652246683, + "normalized_load_entropy": 0.8280023222872659, + "max_load_share": 0.12318840579710146 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "1834086b3f264b2aa1986e6e31a6a9c370dbeb8009db9904946cb9cd0a60e2ba", + "route_weight_sha256": "d194dafb243dfcb3d9d474b30754d3992f7e664c52b9383287a8cc3ee5a69c1a", + "loads": [ + 8, + 7, + 16, + 3, + 18, + 7, + 1, + 5, + 12, + 2, + 1, + 5, + 5, + 3, + 11, + 6, + 0, + 12, + 28, + 1, + 1, + 2, + 3, + 1, + 2, + 1, + 0, + 2, + 0, + 2, + 12, + 2, + 3, + 6, + 5, + 23, + 4, + 7, + 2, + 2, + 7, + 1, + 10, + 5, + 2, + 0, + 19, + 16, + 2, + 17, + 1, + 5, + 10, + 11, + 4, + 1, + 8, + 8, + 3, + 6, + 0, + 4, + 4, + 9 + ], + "weighted_loads": [ + 0.41062733717262745, + 0.7316153384745121, + 1.3676306549459696, + 0.20052680745720863, + 1.1732014687731862, + 0.48763888888061047, + 0.029560163617134094, + 0.24435514584183693, + 1.0075629279017448, + 0.0614237766712904, + 0.030168114230036736, + 0.4072772338986397, + 0.1915620844811201, + 0.870243925601244, + 1.2205939833074808, + 0.39117691293358803, + 0.0, + 0.7294879928231239, + 2.577954275533557, + 0.13707377016544342, + 0.05079912766814232, + 0.06458666361868382, + 0.1203782707452774, + 0.0402831956744194, + 0.0822564996778965, + 0.034647390246391296, + 0.0, + 0.10482458770275116, + 0.0, + 0.08903805911540985, + 0.867176340892911, + 0.24286023154854774, + 0.16821271181106567, + 0.47127969563007355, + 0.45496923848986626, + 1.6793966200202703, + 0.15926447603851557, + 0.3168160319328308, + 0.08068640902638435, + 0.04781225137412548, + 0.3301723375916481, + 0.045542359352111816, + 0.5076556652784348, + 0.4543166011571884, + 0.0982288345694542, + 0.0, + 2.694032348692417, + 1.1656132638454437, + 0.07264812849462032, + 0.9944157097488642, + 0.02625788003206253, + 0.35844455286860466, + 0.745187371969223, + 0.6085110548883677, + 0.23400501906871796, + 0.03481612727046013, + 0.9287977777421474, + 0.3769104368984699, + 0.3692931495606899, + 0.6543466448783875, + 0.0, + 0.14655666798353195, + 0.2758955582976341, + 0.4652675073593855 + ], + "unique_experts": 59, + "load_cv": 0.9890897892057683, + "normalized_load_entropy": 0.8949739672971408, + "max_load_share": 0.07291666666666667 + } + }, + "s0_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "afd042aab78c7d81ba5120423d4df5a8c401de8e5541edec95f35226d16747d0", + "route_weight_sha256": "4faa9d66d46377ac3be9e75f9c26e73d12e621e5c7e022a85ce2220592c2c305", + "loads": [ + 0, + 4, + 5, + 3, + 17, + 7, + 1, + 3, + 1, + 0, + 1, + 1, + 4, + 1, + 2, + 5, + 0, + 2, + 4, + 0, + 2, + 1, + 2, + 0, + 2, + 1, + 0, + 2, + 0, + 1, + 1, + 0, + 1, + 5, + 1, + 4, + 4, + 0, + 2, + 0, + 1, + 0, + 9, + 0, + 1, + 0, + 0, + 11, + 0, + 3, + 0, + 3, + 2, + 0, + 2, + 0, + 6, + 2, + 0, + 2, + 0, + 0, + 4, + 2 + ], + "weighted_loads": [ + 0.0, + 0.56769248098135, + 0.42567000165581703, + 0.19940711557865143, + 1.072007299400866, + 0.5550079308450222, + 0.03609094023704529, + 0.18101217225193977, + 0.04182087257504463, + 0.0, + 0.03635187819600105, + 0.08673423528671265, + 0.15604564361274242, + 0.7748926281929016, + 0.10222412273287773, + 0.34920452535152435, + 0.0, + 0.13176583126187325, + 0.17450327426195145, + 0.0, + 0.08259951323270798, + 0.037208300083875656, + 0.10043323040008545, + 0.0, + 0.07981941103935242, + 0.03954785689711571, + 0.0, + 0.11220825091004372, + 0.0, + 0.044713687151670456, + 0.052199508994817734, + 0.0, + 0.06764785945415497, + 0.39947639033198357, + 0.03327827528119087, + 0.1954917348921299, + 0.15552547201514244, + 0.0, + 0.08570022135972977, + 0.0, + 0.0813320055603981, + 0.0, + 0.46276212111115456, + 0.0, + 0.061804842203855515, + 0.0, + 0.0, + 1.0692003089934587, + 0.0, + 0.36735469847917557, + 0.0, + 0.19084692373871803, + 0.2074059098958969, + 0.0, + 0.10774386115372181, + 0.0, + 0.668040931224823, + 0.103302501142025, + 0.0, + 0.2544211596250534, + 0.0, + 0.0, + 0.29909326136112213, + 0.19001564010977745 + ], + "unique_experts": 43, + "load_cv": 1.355130588538713, + "normalized_load_entropy": 0.8259622017215532, + "max_load_share": 0.12318840579710146 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "d861ce717884b5ab4790b1a580b5df1352bff9b7e1984f683a2bf3d82bf7c09c", + "route_weight_sha256": "236423a792165c37de03dbe720efe06194f373d76ea5b8a7b4320e16be3d267f", + "loads": [ + 7, + 5, + 17, + 3, + 17, + 9, + 1, + 3, + 10, + 0, + 1, + 5, + 5, + 2, + 7, + 8, + 0, + 2, + 23, + 0, + 2, + 2, + 2, + 0, + 2, + 1, + 0, + 2, + 0, + 1, + 9, + 0, + 1, + 6, + 1, + 10, + 4, + 4, + 2, + 2, + 6, + 0, + 11, + 0, + 1, + 0, + 8, + 11, + 4, + 15, + 1, + 6, + 12, + 7, + 2, + 0, + 7, + 3, + 3, + 3, + 0, + 3, + 4, + 5 + ], + "weighted_loads": [ + 0.4326080121099949, + 0.6394306793808937, + 1.6227675508707762, + 0.19940711557865143, + 1.072007299400866, + 0.6016088277101517, + 0.03609094023704529, + 0.18101217225193977, + 0.6337671875953674, + 0.0, + 0.03635187819600105, + 0.4724736213684082, + 0.20209241099655628, + 0.8083258382976055, + 1.0591989662498236, + 0.45208999142050743, + 0.0, + 0.13176583126187325, + 1.9755732379853725, + 0.0, + 0.08259951323270798, + 0.062382979318499565, + 0.10043323040008545, + 0.0, + 0.07981941103935242, + 0.03954785689711571, + 0.0, + 0.11220825091004372, + 0.0, + 0.044713687151670456, + 0.555281849578023, + 0.0, + 0.06764785945415497, + 0.4438427910208702, + 0.03327827528119087, + 0.4625752903521061, + 0.15552547201514244, + 0.13365188986063004, + 0.08570022135972977, + 0.0476519949734211, + 0.3275865465402603, + 0.0, + 0.5219302978366613, + 0.0, + 0.061804842203855515, + 0.0, + 1.4518321752548218, + 1.0692003089934587, + 0.1888740248978138, + 0.8930949289351702, + 0.02634524554014206, + 0.39186717942357063, + 0.9037477876991034, + 0.3943627905100584, + 0.10774386115372181, + 0.0, + 0.8908534049987793, + 0.13602343201637268, + 0.13166497088968754, + 0.29143214598298073, + 0.0, + 0.0938386581838131, + 0.29909326136112213, + 0.36681336537003517 + ], + "unique_experts": 52, + "load_cv": 1.0693542530511198, + "normalized_load_entropy": 0.8730277619246125, + "max_load_share": 0.0798611111111111 + } + }, + "s1_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "3af9d1481ce110d0e4a7365f6cf65ede41c4891f1f14cd5fb8132938009be24f", + "route_weight_sha256": "ab4ffcf72ec4efb0d87541b642a23972c56af7980efefb4f12de9e045b0fcc45", + "loads": [ + 0, + 4, + 4, + 3, + 17, + 7, + 0, + 2, + 1, + 0, + 1, + 1, + 4, + 2, + 2, + 4, + 0, + 1, + 3, + 0, + 2, + 1, + 2, + 1, + 2, + 1, + 0, + 2, + 0, + 1, + 1, + 0, + 1, + 5, + 1, + 6, + 5, + 0, + 2, + 0, + 1, + 0, + 7, + 0, + 1, + 0, + 0, + 11, + 0, + 3, + 0, + 3, + 2, + 0, + 3, + 0, + 5, + 2, + 0, + 2, + 0, + 0, + 5, + 4 + ], + "weighted_loads": [ + 0.0, + 0.5313077569007874, + 0.4213368594646454, + 0.1900898441672325, + 1.1046679029241204, + 0.5024450980126858, + 0.0, + 0.14613346755504608, + 0.034303780645132065, + 0.0, + 0.03079131618142128, + 0.08007693290710449, + 0.16194617375731468, + 0.8102420195937157, + 0.11063684150576591, + 0.30538225173950195, + 0.0, + 0.08654209971427917, + 0.1311730593442917, + 0.0, + 0.08796652778983116, + 0.036055754870176315, + 0.08684186264872551, + 0.03450321778655052, + 0.08160026744008064, + 0.037228234112262726, + 0.0, + 0.13425510004162788, + 0.0, + 0.04244699329137802, + 0.04313889145851135, + 0.0, + 0.06728121638298035, + 0.4075729101896286, + 0.03641616180539131, + 0.2530195973813534, + 0.20039647072553635, + 0.0, + 0.10783157497644424, + 0.0, + 0.0693846195936203, + 0.0, + 0.38832470029592514, + 0.0, + 0.07064376771450043, + 0.0, + 0.0, + 1.0602970384061337, + 0.0, + 0.3882935345172882, + 0.0, + 0.1877189315855503, + 0.17063601687550545, + 0.0, + 0.1429424174129963, + 0.0, + 0.628419591113925, + 0.12515839189291, + 0.0, + 0.23920134082436562, + 0.0, + 0.0, + 0.345319963991642, + 0.2556947432458401 + ], + "unique_experts": 43, + "load_cv": 1.3326242601009242, + "normalized_load_entropy": 0.8289976033906078, + "max_load_share": 0.12318840579710146 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "446f0768a1ed4730427aa41148e12f585b84d59d32dd0fa96cc119892e14e55b", + "route_weight_sha256": "7da6005b4151d70cb3f300828b8a708fc2b3b55e26ca63b08fa90a4b16042cd3", + "loads": [ + 10, + 7, + 16, + 3, + 18, + 9, + 1, + 4, + 13, + 2, + 1, + 5, + 5, + 4, + 11, + 5, + 0, + 11, + 29, + 1, + 2, + 2, + 3, + 1, + 2, + 1, + 0, + 2, + 0, + 2, + 10, + 2, + 2, + 6, + 5, + 22, + 5, + 7, + 3, + 2, + 7, + 0, + 8, + 6, + 1, + 0, + 18, + 15, + 3, + 17, + 1, + 7, + 11, + 11, + 5, + 1, + 7, + 8, + 3, + 4, + 0, + 2, + 5, + 10 + ], + "weighted_loads": [ + 0.573024133220315, + 0.6734536960721016, + 1.5390574615448713, + 0.1900898441672325, + 1.143887341953814, + 0.5594988074153662, + 0.029560163617134094, + 0.2145046554505825, + 1.051850639283657, + 0.0614237766712904, + 0.03079131618142128, + 0.3791613057255745, + 0.19878730922937393, + 0.8793167918920517, + 1.1569318603724241, + 0.3385084196925163, + 0.0, + 0.6846143342554569, + 2.4684659466147423, + 0.13707377016544342, + 0.08796652778983116, + 0.061027346178889275, + 0.12209366634488106, + 0.03450321778655052, + 0.08160026744008064, + 0.037228234112262726, + 0.0, + 0.13425510004162788, + 0.0, + 0.0792122595012188, + 0.6241431441158056, + 0.24286023154854774, + 0.12289748340845108, + 0.4841967821121216, + 0.45568443834781647, + 1.6053578052669764, + 0.20039647072553635, + 0.28599775582551956, + 0.14825758710503578, + 0.04781225137412548, + 0.27825926057994366, + 0.0, + 0.4115323144942522, + 0.5072022527456284, + 0.07064376771450043, + 0.0, + 2.5307511389255524, + 1.2384168952703476, + 0.1109184306114912, + 0.977762820199132, + 0.02625788003206253, + 0.4838881157338619, + 0.8122712932527065, + 0.6041186358779669, + 0.2641221582889557, + 0.03481612727046013, + 0.8873055707663298, + 0.40038554929196835, + 0.3692931495606899, + 0.42099718376994133, + 0.0, + 0.06459084525704384, + 0.345319963991642, + 0.5068896878510714 + ], + "unique_experts": 58, + "load_cv": 0.9846918581747062, + "normalized_load_entropy": 0.894358663191352, + "max_load_share": 0.07552083333333333 + } + }, + "s0_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "d1f016f85ffd41c2e07318deeb7cdd5bcb1501b046e20e28f38f440ad9cf0bbb", + "route_weight_sha256": "42a26253aa9ac6f043f5fa007be1c1630e3e920c5d03156c815b91f37ac85fba", + "loads": [ + 0, + 4, + 4, + 3, + 18, + 7, + 1, + 3, + 1, + 0, + 1, + 1, + 4, + 1, + 2, + 4, + 0, + 2, + 4, + 0, + 2, + 1, + 2, + 3, + 2, + 1, + 0, + 2, + 0, + 1, + 1, + 0, + 1, + 5, + 1, + 4, + 4, + 0, + 1, + 0, + 1, + 0, + 7, + 0, + 1, + 0, + 0, + 11, + 0, + 3, + 0, + 3, + 2, + 0, + 2, + 0, + 5, + 2, + 0, + 2, + 0, + 0, + 5, + 3 + ], + "weighted_loads": [ + 0.0, + 0.5869408287107944, + 0.37979577854275703, + 0.20980309322476387, + 1.1159557420760393, + 0.5389006845653057, + 0.03639503940939903, + 0.17972372099757195, + 0.03841584175825119, + 0.0, + 0.0364622063934803, + 0.08246465772390366, + 0.15567390993237495, + 0.7650066018104553, + 0.10447013005614281, + 0.3212881088256836, + 0.0, + 0.13334713131189346, + 0.19051174074411392, + 0.0, + 0.08260852843523026, + 0.03903976082801819, + 0.09465019777417183, + 0.10235932655632496, + 0.07548705860972404, + 0.04031059518456459, + 0.0, + 0.11389719322323799, + 0.0, + 0.046053871512413025, + 0.05044551566243172, + 0.0, + 0.0671614408493042, + 0.3938281163573265, + 0.03557484596967697, + 0.1949108950793743, + 0.16174713522195816, + 0.0, + 0.044604573398828506, + 0.0, + 0.08036800473928452, + 0.0, + 0.4014696963131428, + 0.0, + 0.06639432907104492, + 0.0, + 0.0, + 1.07713558152318, + 0.0, + 0.3782644271850586, + 0.0, + 0.1936129443347454, + 0.20177574083209038, + 0.0, + 0.11240728199481964, + 0.0, + 0.6412061769515276, + 0.10113987326622009, + 0.0, + 0.2577834650874138, + 0.0, + 0.0, + 0.3212472200393677, + 0.23464392125606537 + ], + "unique_experts": 44, + "load_cv": 1.3476702418861093, + "normalized_load_entropy": 0.8323704853373404, + "max_load_share": 0.13043478260869565 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "9666e0132ea515ec4808bd64a796f7e8736a771501082ce35a057116099c1ca1", + "route_weight_sha256": "8cf51b011d1ea8f742b8d02c8bbccc1b7fcf465cc9533bf234c952bb6925611b", + "loads": [ + 7, + 5, + 15, + 3, + 18, + 9, + 1, + 3, + 10, + 0, + 1, + 5, + 4, + 2, + 7, + 8, + 0, + 2, + 24, + 0, + 2, + 3, + 2, + 3, + 2, + 1, + 0, + 2, + 0, + 1, + 8, + 1, + 1, + 6, + 1, + 9, + 4, + 4, + 1, + 2, + 6, + 0, + 9, + 0, + 1, + 0, + 9, + 11, + 3, + 15, + 2, + 5, + 12, + 8, + 2, + 0, + 6, + 4, + 2, + 3, + 0, + 3, + 5, + 5 + ], + "weighted_loads": [ + 0.4380132518708706, + 0.6586790271103382, + 1.4054405968636274, + 0.20980309322476387, + 1.1159557420760393, + 0.5855015814304352, + 0.03639503940939903, + 0.17972372099757195, + 0.6581132300198078, + 0.0, + 0.0364622063934803, + 0.4540915936231613, + 0.15567390993237495, + 0.7961615659296513, + 1.1820668336004019, + 0.46541759744286537, + 0.0, + 0.13334713131189346, + 2.098527178168297, + 0.0, + 0.08260852843523026, + 0.09692851640284061, + 0.09465019777417183, + 0.10235932655632496, + 0.07548705860972404, + 0.04031059518456459, + 0.0, + 0.11389719322323799, + 0.0, + 0.046053871512413025, + 0.49666164815425873, + 0.030092932283878326, + 0.0671614408493042, + 0.43294408544898033, + 0.03557484596967697, + 0.41805681958794594, + 0.16174713522195816, + 0.13654544204473495, + 0.044604573398828506, + 0.0476519949734211, + 0.33342402428388596, + 0.0, + 0.46063787303864956, + 0.0, + 0.06639432907104492, + 0.0, + 1.6602565050125122, + 1.07713558152318, + 0.14926400408148766, + 0.8946981132030487, + 0.06317169219255447, + 0.35186607763171196, + 0.8630978148430586, + 0.4719792138785124, + 0.11240728199481964, + 0.0, + 0.8640186507254839, + 0.1877741515636444, + 0.07124682329595089, + 0.2947944514453411, + 0.0, + 0.08852982893586159, + 0.3212472200393677, + 0.329212062060833 + ], + "unique_experts": 54, + "load_cv": 1.0548243081137514, + "normalized_load_entropy": 0.8802426764353499, + "max_load_share": 0.08333333333333333 + } + }, + "s1_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "328cfb703fefd821937161c8c4551f98da96c00ba228792d9a0ad1206b47c6fa", + "route_weight_sha256": "3d526b30b0ccc47189267a7511442c19229b59d7657edcedca87548bf0b4e6ea", + "loads": [ + 0, + 4, + 5, + 3, + 17, + 6, + 0, + 3, + 1, + 0, + 1, + 1, + 4, + 2, + 2, + 4, + 0, + 1, + 3, + 0, + 1, + 1, + 2, + 1, + 2, + 1, + 0, + 2, + 0, + 1, + 1, + 0, + 1, + 5, + 1, + 6, + 5, + 0, + 2, + 0, + 1, + 0, + 7, + 0, + 2, + 0, + 0, + 12, + 0, + 3, + 0, + 3, + 2, + 0, + 3, + 0, + 5, + 2, + 0, + 2, + 0, + 0, + 4, + 3 + ], + "weighted_loads": [ + 0.0, + 0.5323934070765972, + 0.4653342738747597, + 0.1892932988703251, + 1.112093973904848, + 0.47367413341999054, + 0.0, + 0.18085504323244095, + 0.03376662731170654, + 0.0, + 0.029523193836212158, + 0.08134842664003372, + 0.15694374963641167, + 0.8016438521444798, + 0.10769586637616158, + 0.3080163523554802, + 0.0, + 0.08893121033906937, + 0.1334344893693924, + 0.0, + 0.05246666818857193, + 0.03878090903162956, + 0.08867395296692848, + 0.03632510453462601, + 0.08010149747133255, + 0.037193961441516876, + 0.0, + 0.1397237926721573, + 0.0, + 0.04289921000599861, + 0.044128116220235825, + 0.0, + 0.06585157662630081, + 0.4027271419763565, + 0.03477403521537781, + 0.24940373562276363, + 0.19325199536979198, + 0.0, + 0.12035393714904785, + 0.0, + 0.07191988080739975, + 0.0, + 0.3772294968366623, + 0.0, + 0.1032535620033741, + 0.0, + 0.0, + 1.1057402938604355, + 0.0, + 0.38044219464063644, + 0.0, + 0.1871890425682068, + 0.18352879583835602, + 0.0, + 0.13964708149433136, + 0.0, + 0.6320262402296066, + 0.12063634395599365, + 0.0, + 0.23058651015162468, + 0.0, + 0.0, + 0.3107609637081623, + 0.2175781149417162 + ], + "unique_experts": 43, + "load_cv": 1.3426736486503665, + "normalized_load_entropy": 0.828594381460784, + "max_load_share": 0.12318840579710146 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "c8e3af468275ccd5433947007de595ec89e9f9fd992be768f4a535bc65c757cb", + "route_weight_sha256": "d3b184497c5ec89a7d6e7c89056fc47eb31e743f5425f7f6088d165d3eb6d49f", + "loads": [ + 8, + 8, + 16, + 3, + 19, + 8, + 1, + 5, + 12, + 3, + 1, + 5, + 4, + 3, + 11, + 5, + 0, + 11, + 28, + 1, + 1, + 2, + 3, + 1, + 2, + 1, + 0, + 2, + 0, + 2, + 9, + 2, + 2, + 6, + 5, + 23, + 5, + 7, + 3, + 2, + 7, + 0, + 8, + 6, + 2, + 0, + 19, + 16, + 2, + 17, + 1, + 8, + 11, + 12, + 5, + 1, + 7, + 8, + 3, + 6, + 0, + 2, + 4, + 9 + ], + "weighted_loads": [ + 0.41062733717262745, + 0.708805751055479, + 1.4610864501446486, + 0.1892932988703251, + 1.18999944627285, + 0.5307278428226709, + 0.029560163617134094, + 0.24922623112797737, + 1.006592571735382, + 0.11329465545713902, + 0.029523193836212158, + 0.42433683574199677, + 0.15694374963641167, + 0.8381520658731461, + 1.3021100293844938, + 0.34114252030849457, + 0.0, + 0.6870034448802471, + 2.423042956739664, + 0.13707377016544342, + 0.05246666818857193, + 0.06375250034034252, + 0.12392575666308403, + 0.03632510453462601, + 0.08010149747133255, + 0.037193961441516876, + 0.0, + 0.1397237926721573, + 0.0, + 0.07966447621583939, + 0.5764986388385296, + 0.24286023154854774, + 0.12146784365177155, + 0.4793510138988495, + 0.45404231175780296, + 1.6579956207424402, + 0.19325199536979198, + 0.28862566873431206, + 0.1607799492776394, + 0.04781225137412548, + 0.2886162232607603, + 0.0, + 0.40043711103498936, + 0.48301118798553944, + 0.1032535620033741, + 0.0, + 2.5733099058270454, + 1.2838601507246494, + 0.07264812849462032, + 0.9829461816698313, + 0.02625788003206253, + 0.5462034605443478, + 0.8095918484032154, + 0.6760740671306849, + 0.26082682237029076, + 0.03481612727046013, + 0.8909122198820114, + 0.42779007740318775, + 0.3692931495606899, + 0.47806885093450546, + 0.0, + 0.06459084525704384, + 0.3107609637081623, + 0.4401940181851387 + ], + "unique_experts": 58, + "load_cv": 0.9921567416492215, + "normalized_load_entropy": 0.893289793387064, + "max_load_share": 0.07291666666666667 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.9409937888198759, + "mean_token_weighted_tv": 0.016494377354240936, + "aggregate_load_tv": 0.028985507246376815 + }, + "system_bos": { + "tokens": 23, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 18, + "mean_set_jaccard": 0.9378881987577641, + "mean_token_weighted_tv": 0.020286342432803434, + "aggregate_load_tv": 0.03623188405797102 + }, + "system_x": { + "tokens": 23, + "ordered_topk_exact_tokens": 8, + "set_exact_tokens": 12, + "mean_set_jaccard": 0.8633540372670808, + "mean_token_weighted_tv": 0.03304102903474932, + "aggregate_load_tv": 0.06521739130434782 + }, + "system_period": { + "tokens": 23, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 13, + "mean_set_jaccard": 0.8664596273291927, + "mean_token_weighted_tv": 0.03343850244646487, + "aggregate_load_tv": 0.06521739130434782 + }, + "bos_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.9254658385093167, + "mean_token_weighted_tv": 0.021603979433522276, + "aggregate_load_tv": 0.03623188405797101 + }, + "bos_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.9130434782608695, + "mean_token_weighted_tv": 0.02242204340417748, + "aggregate_load_tv": 0.043478260869565216 + }, + "x_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8788819875776398, + "mean_token_weighted_tv": 0.0331139028193834, + "aggregate_load_tv": 0.057971014492753624 + }, + "x_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.8913043478260869, + "mean_token_weighted_tv": 0.033126290624394365, + "aggregate_load_tv": 0.057971014492753624 + }, + "period_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 12, + "mean_set_jaccard": 0.8540372670807453, + "mean_token_weighted_tv": 0.0346791780675235, + "aggregate_load_tv": 0.07246376811594203 + }, + "period_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 17, + "set_exact_tokens": 18, + "mean_set_jaccard": 0.9192546583850933, + "mean_token_weighted_tv": 0.03136019841970309, + "aggregate_load_tv": 0.04347826086956522 + } + } + }, + "layer_19": { + "layer": 19, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "84094aad2365e498cbef332b12c3e8a1850923b97ae7cbf47e62e07e0af0298b", + "route_weight_sha256": "2822430db14bf74e752aa5029bcf489466ad3e6634ec58058979174afa0b1434", + "loads": [ + 3, + 1, + 6, + 2, + 2, + 5, + 0, + 0, + 0, + 9, + 1, + 4, + 3, + 3, + 0, + 0, + 4, + 0, + 3, + 2, + 0, + 1, + 2, + 8, + 3, + 1, + 1, + 1, + 0, + 1, + 3, + 3, + 0, + 0, + 2, + 0, + 4, + 9, + 4, + 0, + 4, + 0, + 4, + 7, + 0, + 0, + 0, + 2, + 10, + 2, + 0, + 1, + 0, + 5, + 1, + 0, + 2, + 2, + 4, + 0, + 0, + 1, + 2, + 0 + ], + "weighted_loads": [ + 0.6175926961004734, + 0.03338310867547989, + 0.8555183932185173, + 0.12020143121480942, + 0.07321794331073761, + 0.2933505289256573, + 0.0, + 0.0, + 0.0, + 0.45194762758910656, + 0.045200735330581665, + 0.39712413772940636, + 0.10372544080018997, + 0.10418709367513657, + 0.0, + 0.0, + 0.36330922320485115, + 0.0, + 0.314800750464201, + 0.07730801776051521, + 0.0, + 0.06391553580760956, + 0.23987267911434174, + 0.7276089526712894, + 0.24541679956018925, + 0.0364924855530262, + 0.030919546261429787, + 0.037822578102350235, + 0.0, + 0.06040054187178612, + 0.1199828889220953, + 0.5118397995829582, + 0.0, + 0.0, + 0.11074827238917351, + 0.0, + 0.21642085537314415, + 0.5338504482060671, + 0.14903966151177883, + 0.0, + 0.49683117866516113, + 0.0, + 0.29704576544463634, + 0.3266473561525345, + 0.0, + 0.0, + 0.0, + 0.08646589517593384, + 0.5393690001219511, + 0.08660413697361946, + 0.0, + 0.020604168996214867, + 0.0, + 0.3359125889837742, + 0.0185481496155262, + 0.0, + 0.0542348176240921, + 0.0786137543618679, + 0.14394952356815338, + 0.0, + 0.0, + 0.03597915545105934, + 0.2631174176931381, + 0.0 + ], + "unique_experts": 42, + "load_cv": 1.14254016368129, + "normalized_load_entropy": 0.8442435883306812, + "max_load_share": 0.07246376811594203 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "14ab6241fc7f433c34d4d6388dc0c304ffd25f646c8b529b41a498b6c4abbaa5", + "route_weight_sha256": "6989b8846a0ebb507fd54a9432428e3a208907d37cd7e2b6da8eab1f28b6e955", + "loads": [ + 5, + 4, + 7, + 2, + 7, + 7, + 10, + 0, + 0, + 13, + 1, + 4, + 12, + 5, + 5, + 0, + 7, + 1, + 3, + 9, + 0, + 1, + 8, + 17, + 13, + 1, + 1, + 2, + 0, + 5, + 9, + 3, + 0, + 0, + 2, + 2, + 6, + 16, + 6, + 0, + 7, + 4, + 12, + 9, + 1, + 0, + 0, + 5, + 11, + 2, + 0, + 1, + 0, + 9, + 6, + 0, + 2, + 2, + 9, + 0, + 1, + 4, + 9, + 0 + ], + "weighted_loads": [ + 0.6616780790500343, + 0.21656397357583046, + 0.8800305780023336, + 0.12020143121480942, + 0.9194670785218477, + 0.33594026509672403, + 0.4143004696816206, + 0.0, + 0.0, + 0.6816885862499475, + 0.045200735330581665, + 0.39712413772940636, + 0.6963131278753281, + 0.19204401224851608, + 0.47631116211414337, + 0.0, + 0.480654701590538, + 0.060089994221925735, + 0.314800750464201, + 0.459980521351099, + 0.0, + 0.06391553580760956, + 0.47291838377714157, + 1.0375522738322616, + 1.3466903697699308, + 0.0364924855530262, + 0.030919546261429787, + 0.07506390288472176, + 0.0, + 0.2230932153761387, + 0.3531316425651312, + 0.5118397995829582, + 0.0, + 0.0, + 0.11074827238917351, + 0.11699176207184792, + 0.2598981070332229, + 0.8851539809256792, + 0.2229191418737173, + 0.0, + 0.5595764997415245, + 0.23491492494940758, + 0.8852672930806875, + 0.41342901811003685, + 0.010698859579861164, + 0.0, + 0.0, + 0.32568035274744034, + 0.5787818003445864, + 0.08660413697361946, + 0.0, + 0.020604168996214867, + 0.0, + 0.623563788831234, + 1.718445971608162, + 0.0, + 0.0542348176240921, + 0.0786137543618679, + 0.3784656301140785, + 0.0, + 0.04416662082076073, + 0.2175145149230957, + 0.8124218191951513, + 0.0 + ], + "unique_experts": 49, + "load_cv": 0.9789450103725608, + "normalized_load_entropy": 0.8752357036642809, + "max_load_share": 0.059027777777777776 + } + }, + "s1_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "b8f4cadc4b17a0036b8a4ac6d321f6e23f3c13d52c42d0176c244895ba5cf63c", + "route_weight_sha256": "03a6a81dd4f0f0fc77cd98fd5172b3a051d73016e95c1f0884a2eed90240a094", + "loads": [ + 4, + 1, + 6, + 2, + 2, + 4, + 0, + 0, + 0, + 8, + 1, + 3, + 3, + 3, + 0, + 0, + 4, + 0, + 3, + 2, + 0, + 1, + 2, + 8, + 3, + 1, + 1, + 1, + 0, + 1, + 2, + 3, + 0, + 0, + 2, + 1, + 4, + 8, + 4, + 0, + 4, + 0, + 4, + 7, + 0, + 0, + 0, + 2, + 11, + 2, + 0, + 1, + 0, + 6, + 1, + 0, + 2, + 2, + 3, + 0, + 0, + 2, + 2, + 1 + ], + "weighted_loads": [ + 0.6587041057646275, + 0.03402615338563919, + 0.8795119933784008, + 0.12084685638546944, + 0.07062732428312302, + 0.25610051676630974, + 0.0, + 0.0, + 0.0, + 0.4087498262524605, + 0.04404301568865776, + 0.3655739203095436, + 0.10940605401992798, + 0.10607654601335526, + 0.0, + 0.0, + 0.3518891856074333, + 0.0, + 0.3065220043063164, + 0.077216025441885, + 0.0, + 0.063129723072052, + 0.24712420627474785, + 0.7026169970631599, + 0.2336104642599821, + 0.03628971055150032, + 0.03210681676864624, + 0.039302270859479904, + 0.0, + 0.058769341558218, + 0.07907300442457199, + 0.526682011783123, + 0.0, + 0.0, + 0.10744349658489227, + 0.031126834452152252, + 0.212745800614357, + 0.5248695388436317, + 0.15719124674797058, + 0.0, + 0.4851516783237457, + 0.0, + 0.29505435936152935, + 0.323236171156168, + 0.0, + 0.0, + 0.0, + 0.08396457880735397, + 0.602970203384757, + 0.08655250072479248, + 0.0, + 0.022121433168649673, + 0.0, + 0.3826858885586262, + 0.018908098340034485, + 0.0, + 0.05743681453168392, + 0.08288122341036797, + 0.11875307559967041, + 0.0, + 0.0, + 0.06721284985542297, + 0.2507050782442093, + 0.029150601476430893 + ], + "unique_experts": 44, + "load_cv": 1.1157537955306833, + "normalized_load_entropy": 0.8538253384688114, + "max_load_share": 0.07971014492753623 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "19150c446fd2e8f9d943eb7e32b26660728fca6b7b084ad4730ab3000b8c92d2", + "route_weight_sha256": "74e67e68116752c649f055be3a1fcd743ef090aea2ce2fd2feaac18af2208629", + "loads": [ + 6, + 7, + 8, + 2, + 14, + 6, + 13, + 0, + 0, + 13, + 2, + 10, + 16, + 3, + 11, + 2, + 7, + 5, + 4, + 12, + 3, + 2, + 9, + 14, + 18, + 1, + 1, + 2, + 1, + 2, + 6, + 4, + 2, + 0, + 2, + 2, + 7, + 12, + 5, + 2, + 8, + 9, + 13, + 9, + 1, + 0, + 0, + 12, + 12, + 3, + 5, + 1, + 3, + 17, + 6, + 0, + 4, + 4, + 13, + 2, + 2, + 10, + 11, + 3 + ], + "weighted_loads": [ + 0.6844277707859874, + 0.3800745513290167, + 0.9393401611596346, + 0.12084685638546944, + 1.5989125035703182, + 0.34646136593073606, + 0.6180587355047464, + 0.0, + 0.0, + 0.6810807660222054, + 0.11129295453429222, + 1.0904664918780327, + 0.829903582111001, + 0.10607654601335526, + 0.8242838401347399, + 0.10909751802682877, + 0.7407601475715637, + 0.22963744588196278, + 0.4056851789355278, + 0.6195323131978512, + 0.30281495302915573, + 0.1181044951081276, + 0.5197015888988972, + 0.8968285489827394, + 1.6311981305480003, + 0.03628971055150032, + 0.03210681676864624, + 0.09211746603250504, + 0.037839457392692566, + 0.09262870997190475, + 0.22543152421712875, + 0.572459202259779, + 0.08712287619709969, + 0.0, + 0.10744349658489227, + 0.09501035511493683, + 0.2975338543765247, + 0.7110203225165606, + 0.2018304504454136, + 0.10391071438789368, + 0.5857243379577994, + 0.5060016959905624, + 0.9884489141404629, + 0.39299966767430305, + 0.010698859579861164, + 0.0, + 0.0, + 0.7501357458531857, + 0.6368332114070654, + 0.1281174123287201, + 0.33654822781682014, + 0.022121433168649673, + 0.14570153132081032, + 1.2770630531013012, + 1.726111862808466, + 0.0, + 0.13810979016125202, + 0.1707298755645752, + 0.611197791993618, + 0.06596613861620426, + 0.0975300744175911, + 0.43051553145051, + 0.9764638170599937, + 0.19443507120013237 + ], + "unique_experts": 58, + "load_cv": 0.8202091535428969, + "normalized_load_entropy": 0.9137335650576329, + "max_load_share": 0.046875 + } + }, + "s0_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "bc7a1ab686a5a4dd3db40e0f06d24812559d860d2a8fe2848eb23b3c609fea92", + "route_weight_sha256": "5260fb0474ca08c89b7860594ee4515474e2a138fb43fd029536f1469f067fe1", + "loads": [ + 3, + 2, + 6, + 2, + 2, + 5, + 0, + 0, + 0, + 9, + 1, + 4, + 1, + 2, + 0, + 0, + 4, + 0, + 3, + 4, + 0, + 1, + 2, + 8, + 3, + 1, + 1, + 2, + 0, + 1, + 2, + 3, + 0, + 0, + 2, + 0, + 5, + 8, + 3, + 0, + 4, + 0, + 4, + 7, + 0, + 0, + 0, + 2, + 11, + 2, + 0, + 1, + 0, + 5, + 1, + 0, + 1, + 2, + 4, + 0, + 0, + 2, + 2, + 0 + ], + "weighted_loads": [ + 0.6051038354635239, + 0.061883678659796715, + 0.8987884595990181, + 0.1226525790989399, + 0.07531701400876045, + 0.3057856373488903, + 0.0, + 0.0, + 0.0, + 0.4467372000217438, + 0.04043756052851677, + 0.41332845389842987, + 0.038882240653038025, + 0.07829601690173149, + 0.0, + 0.0, + 0.36281854286789894, + 0.0, + 0.3292570449411869, + 0.14448197931051254, + 0.0, + 0.05990444868803024, + 0.2537076659500599, + 0.7030132934451103, + 0.2269587330520153, + 0.03757975250482559, + 0.03145705536007881, + 0.08103147149085999, + 0.0, + 0.05191725119948387, + 0.09600698575377464, + 0.5341947674751282, + 0.0, + 0.0, + 0.09873934835195541, + 0.0, + 0.23788496479392052, + 0.5153224393725395, + 0.12288413569331169, + 0.0, + 0.5036722794175148, + 0.0, + 0.3081339821219444, + 0.3340011052787304, + 0.0, + 0.0, + 0.0, + 0.08902617171406746, + 0.6033029668033123, + 0.08407589793205261, + 0.0, + 0.024722103029489517, + 0.0, + 0.3461950719356537, + 0.0181931983679533, + 0.0, + 0.024289604276418686, + 0.08112015575170517, + 0.14133375883102417, + 0.0, + 0.0, + 0.0645104181021452, + 0.2471235692501068, + 0.0 + ], + "unique_experts": 42, + "load_cv": 1.151330472432995, + "normalized_load_entropy": 0.8437544490634522, + "max_load_share": 0.07971014492753623 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "6c0646630e43193bebb7823a79537f31ff34aba3f5e3aaa7026333360df78ba8", + "route_weight_sha256": "5660774bac1b78919081f3fb1558b8bd54db247370b99bd2c47e366fbc552875", + "loads": [ + 4, + 4, + 7, + 2, + 6, + 7, + 9, + 0, + 0, + 12, + 1, + 4, + 10, + 6, + 5, + 0, + 7, + 1, + 3, + 11, + 0, + 1, + 8, + 15, + 13, + 1, + 2, + 4, + 0, + 5, + 8, + 3, + 0, + 0, + 2, + 4, + 6, + 15, + 5, + 0, + 6, + 4, + 12, + 8, + 1, + 1, + 0, + 5, + 14, + 2, + 0, + 2, + 0, + 9, + 5, + 0, + 2, + 2, + 9, + 0, + 1, + 5, + 9, + 0 + ], + "weighted_loads": [ + 0.6447587087750435, + 0.21233120001852512, + 0.9233006443828344, + 0.1226525790989399, + 0.6490850057452917, + 0.34837537351995707, + 0.3739784490317106, + 0.0, + 0.0, + 0.6398271061480045, + 0.04043756052851677, + 0.41332845389842987, + 0.6269713640213013, + 0.2505421116948128, + 0.4464610479772091, + 0.0, + 0.4801640212535858, + 0.7346652150154114, + 0.3292570449411869, + 0.7123915813863277, + 0.0, + 0.05990444868803024, + 0.476729366928339, + 0.9678505826741457, + 1.3226262349635363, + 0.03757975250482559, + 0.06919891759753227, + 0.16893108189105988, + 0.0, + 0.21460992470383644, + 0.32184695079922676, + 0.5341947674751282, + 0.0, + 0.0, + 0.09873934835195541, + 0.2078607678413391, + 0.27346711605787277, + 0.8409666381776333, + 0.19676361605525017, + 0.0, + 0.5618610791862011, + 0.20119856670498848, + 0.8963555097579956, + 0.3907991833984852, + 0.010698859579861164, + 0.027725186198949814, + 0.0, + 0.32511482015252113, + 0.7238005883991718, + 0.08407589793205261, + 0.0, + 0.038917627185583115, + 0.0, + 0.6346309147775173, + 0.7742900345474482, + 0.0, + 0.04821726493537426, + 0.08112015575170517, + 0.3758498653769493, + 0.0, + 0.06529590487480164, + 0.24604577757418156, + 0.79642797075212, + 0.0 + ], + "unique_experts": 50, + "load_cv": 0.9354143466934853, + "normalized_load_entropy": 0.8846831002592069, + "max_load_share": 0.052083333333333336 + } + }, + "s1_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "4dbf16a0a4ddf06d6b36945e44ff8bde478ecac9fdb5f10e142d45843a879d1d", + "route_weight_sha256": "585415e67a0e320ce574d3b7f9e8aad87ed34d19ee77a4b8b518046d3e4176e8", + "loads": [ + 3, + 2, + 6, + 2, + 2, + 4, + 0, + 0, + 0, + 9, + 1, + 4, + 2, + 1, + 0, + 0, + 4, + 0, + 3, + 3, + 0, + 1, + 2, + 8, + 3, + 1, + 1, + 1, + 0, + 1, + 2, + 3, + 0, + 0, + 2, + 1, + 4, + 9, + 3, + 0, + 4, + 1, + 4, + 7, + 0, + 0, + 0, + 2, + 9, + 2, + 0, + 1, + 0, + 6, + 1, + 0, + 4, + 2, + 3, + 0, + 0, + 2, + 2, + 0 + ], + "weighted_loads": [ + 0.6144108548760414, + 0.062105750665068626, + 0.8910941183567047, + 0.13332891464233398, + 0.0737970806658268, + 0.2617810033261776, + 0.0, + 0.0, + 0.0, + 0.4313758332282305, + 0.03964348882436752, + 0.4079281613230705, + 0.07391911000013351, + 0.0414501391351223, + 0.0, + 0.0, + 0.35717592015862465, + 0.0, + 0.3277605511248112, + 0.11006233096122742, + 0.0, + 0.062278252094984055, + 0.24481341615319252, + 0.701940905302763, + 0.247888321056962, + 0.036815885454416275, + 0.03433815389871597, + 0.039676398038864136, + 0.0, + 0.0493665374815464, + 0.08376059681177139, + 0.5186027102172375, + 0.0, + 0.0, + 0.09083367139101028, + 0.03251950070261955, + 0.21111249923706055, + 0.5548931639641523, + 0.11922405660152435, + 0.0, + 0.5125422142446041, + 0.0330730676651001, + 0.27662408724427223, + 0.32913822308182716, + 0.0, + 0.0, + 0.0, + 0.08954323828220367, + 0.5416253581643105, + 0.08261658065021038, + 0.0, + 0.02175481803715229, + 0.0, + 0.39233944937586784, + 0.02195240557193756, + 0.0, + 0.1191549189388752, + 0.08200370520353317, + 0.11053233593702316, + 0.0, + 0.0, + 0.06919736787676811, + 0.25553031265735626, + 0.0 + ], + "unique_experts": 44, + "load_cv": 1.106680939165942, + "normalized_load_entropy": 0.8543878659640624, + "max_load_share": 0.06521739130434782 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "cf7bb16cfccb8a0714e28a8f736135b0befd9b95981be1a8d6a261a30aeed8ed", + "route_weight_sha256": "6b5b906168a5df5c131074d168f98a05a77974c49b9f5b18a2f3acc788557dc2", + "loads": [ + 4, + 7, + 9, + 2, + 14, + 6, + 11, + 0, + 0, + 16, + 2, + 11, + 15, + 3, + 11, + 2, + 7, + 5, + 4, + 14, + 3, + 2, + 8, + 12, + 17, + 1, + 1, + 2, + 1, + 2, + 7, + 4, + 2, + 0, + 2, + 3, + 7, + 13, + 4, + 3, + 7, + 10, + 13, + 10, + 1, + 0, + 0, + 11, + 10, + 3, + 5, + 1, + 3, + 17, + 5, + 0, + 6, + 4, + 13, + 2, + 3, + 10, + 11, + 2 + ], + "weighted_loads": [ + 0.635764030739665, + 0.3749669808894396, + 0.987288786098361, + 0.13332891464233398, + 1.5640708729624748, + 0.3521418524906039, + 0.555755378678441, + 0.0, + 0.0, + 0.7583762463182211, + 0.10689342767000198, + 1.1328207328915596, + 0.8047948610037565, + 0.1211177334189415, + 0.8244481738656759, + 0.10909751802682877, + 0.746046882122755, + 0.22963744588196278, + 0.4269237257540226, + 0.9076575934886932, + 0.30281495302915573, + 0.11725302413105965, + 0.4793288856744766, + 0.8469912465661764, + 1.617544511333108, + 0.036815885454416275, + 0.03433815389871597, + 0.09249159321188927, + 0.037839457392692566, + 0.08322590589523315, + 0.2766817808151245, + 0.5643799006938934, + 0.08712287619709969, + 0.0, + 0.09083367139101028, + 0.18910961225628853, + 0.3278980180621147, + 0.7496931441128254, + 0.16386326029896736, + 0.14122385904192924, + 0.6031871102750301, + 0.5197908878326416, + 0.9700186420232058, + 0.43131518363952637, + 0.010698859579861164, + 0.0, + 0.0, + 0.6983315795660019, + 0.5754883661866188, + 0.12418149225413799, + 0.33654822781682014, + 0.02175481803715229, + 0.14570153132081032, + 1.218342136591673, + 0.7876596190035343, + 0.0, + 0.1998278945684433, + 0.1698523573577404, + 0.6062993854284286, + 0.06596613861620426, + 0.13836617022752762, + 0.43250004947185516, + 0.9812890514731407, + 0.16528446972370148 + ], + "unique_experts": 58, + "load_cv": 0.814367511903836, + "normalized_load_entropy": 0.914948165735184, + "max_load_share": 0.044270833333333336 + } + }, + "s0_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "72915e6078a7ca932ad253a8d274d6713ed407ce0f74b8dcad29853f02379386", + "route_weight_sha256": "b474f7d7f6013e946c2e2e3888f1619295cc600cff7fcc3a3d1b46b80b6066ea", + "loads": [ + 3, + 1, + 6, + 2, + 2, + 4, + 0, + 1, + 0, + 9, + 1, + 4, + 1, + 1, + 0, + 0, + 4, + 0, + 3, + 3, + 0, + 1, + 2, + 8, + 3, + 1, + 1, + 3, + 0, + 1, + 2, + 3, + 0, + 0, + 2, + 0, + 4, + 9, + 2, + 0, + 4, + 1, + 4, + 7, + 1, + 0, + 0, + 2, + 11, + 1, + 0, + 1, + 0, + 5, + 1, + 0, + 4, + 2, + 4, + 0, + 0, + 1, + 2, + 0 + ], + "weighted_loads": [ + 0.6133749969303608, + 0.031107766553759575, + 0.8834726326167583, + 0.1352321095764637, + 0.07293512299656868, + 0.25154589489102364, + 0.0, + 0.047769419848918915, + 0.0, + 0.4549630433320999, + 0.04431411251425743, + 0.3852194119244814, + 0.03770051896572113, + 0.04244692996144295, + 0.0, + 0.0, + 0.3649686463177204, + 0.0, + 0.33396684005856514, + 0.11131475120782852, + 0.0, + 0.07039155811071396, + 0.26369910687208176, + 0.7003198899328709, + 0.21696674451231956, + 0.03435967117547989, + 0.031674087047576904, + 0.10536610707640648, + 0.0, + 0.05307186767458916, + 0.0917912907898426, + 0.5710277669131756, + 0.0, + 0.0, + 0.10271556675434113, + 0.0, + 0.20467808097600937, + 0.5174182672053576, + 0.0802199337631464, + 0.0, + 0.4590310715138912, + 0.03267207741737366, + 0.2961467355489731, + 0.3298250772058964, + 0.030666302889585495, + 0.0, + 0.0, + 0.09170486405491829, + 0.6098438426852226, + 0.05381297692656517, + 0.0, + 0.022283362224698067, + 0.0, + 0.34787189215421677, + 0.019344769418239594, + 0.0, + 0.11925291642546654, + 0.08393282443284988, + 0.14488647133111954, + 0.0, + 0.0, + 0.036906708031892776, + 0.26401618123054504, + 0.0 + ], + "unique_experts": 45, + "load_cv": 1.1484078455453641, + "normalized_load_entropy": 0.8509224061090189, + "max_load_share": 0.07971014492753623 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "053f78410e1d54a277635dfece83ed990d6631b09584aa93da601faf9cb26123", + "route_weight_sha256": "dd7d587a802521ffc8dc9d9e689b90e9bd767c0a8a4aa3f88311faa381947c54", + "loads": [ + 5, + 2, + 7, + 2, + 7, + 7, + 10, + 1, + 0, + 12, + 1, + 4, + 12, + 3, + 6, + 0, + 7, + 0, + 3, + 9, + 0, + 1, + 8, + 15, + 12, + 1, + 1, + 4, + 0, + 5, + 7, + 3, + 0, + 0, + 3, + 2, + 4, + 15, + 4, + 0, + 7, + 5, + 13, + 9, + 2, + 0, + 0, + 6, + 12, + 1, + 0, + 1, + 0, + 10, + 5, + 0, + 4, + 2, + 11, + 0, + 2, + 5, + 10, + 0 + ], + "weighted_loads": [ + 0.6983919739723206, + 0.1204617377370596, + 0.9079848174005747, + 0.1352321095764637, + 0.8112519886344671, + 0.3899381095543504, + 0.43083389662206173, + 0.047769419848918915, + 0.0, + 0.6358977295458317, + 0.04431411251425743, + 0.3852194119244814, + 0.8115314617753029, + 0.12655017897486687, + 0.5124606117606163, + 0.0, + 0.4823141247034073, + 0.0, + 0.33396684005856514, + 0.4736666865646839, + 0.0, + 0.07039155811071396, + 0.49350185319781303, + 0.9595171827822924, + 1.0681251790374517, + 0.03435967117547989, + 0.031674087047576904, + 0.142607431858778, + 0.0, + 0.21576454117894173, + 0.2779315672814846, + 0.5710277669131756, + 0.0, + 0.0, + 0.14843594282865524, + 0.15030799433588982, + 0.20467808097600937, + 0.7636211793869734, + 0.15409941412508488, + 0.0, + 0.5659589804708958, + 0.26581884548068047, + 1.0367702022194862, + 0.43164490535855293, + 0.04136516246944666, + 0.0, + 0.0, + 0.4131983853876591, + 0.6492566429078579, + 0.05381297692656517, + 0.0, + 0.022283362224698067, + 0.0, + 0.6308614909648895, + 0.7754416055977345, + 0.0, + 0.11925291642546654, + 0.08393282443284988, + 0.47670161724090576, + 0.0, + 0.11078616604208946, + 0.24709532782435417, + 0.8610307369381189, + 0.0 + ], + "unique_experts": 49, + "load_cv": 0.9558139185602919, + "normalized_load_entropy": 0.878924372906931, + "max_load_share": 0.052083333333333336 + } + }, + "s1_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "eb99dfad916ca63d87eb192225b880b0ce5e2d288185e547e67124cd0eb81cb7", + "route_weight_sha256": "ec355a95f585bc82e607dd4813d89c7da759096a0d44ccc0c3072c9275cfd932", + "loads": [ + 3, + 1, + 6, + 2, + 2, + 3, + 0, + 1, + 0, + 9, + 1, + 3, + 2, + 1, + 0, + 0, + 4, + 0, + 3, + 4, + 0, + 1, + 2, + 8, + 3, + 1, + 1, + 2, + 0, + 1, + 2, + 3, + 0, + 0, + 2, + 1, + 4, + 8, + 2, + 0, + 5, + 1, + 4, + 7, + 0, + 0, + 0, + 2, + 10, + 2, + 0, + 1, + 0, + 5, + 1, + 0, + 4, + 3, + 4, + 0, + 0, + 1, + 2, + 0 + ], + "weighted_loads": [ + 0.6326430663466454, + 0.03134315088391304, + 0.8919882066547871, + 0.12666676193475723, + 0.06551829725503922, + 0.2198614403605461, + 0.0, + 0.05289694666862488, + 0.0, + 0.4347359500825405, + 0.03684726357460022, + 0.3507115915417671, + 0.0776890367269516, + 0.0395258329808712, + 0.0, + 0.0, + 0.3393794633448124, + 0.0, + 0.3175617456436157, + 0.15067562460899353, + 0.0, + 0.07136181741952896, + 0.2555161193013191, + 0.7379993312060833, + 0.19990910217165947, + 0.035215020179748535, + 0.03093658573925495, + 0.06627878732979298, + 0.0, + 0.055079422891139984, + 0.07644962146878242, + 0.5300653241574764, + 0.0, + 0.0, + 0.09881719201803207, + 0.03661973029375076, + 0.20107705518603325, + 0.5054773632436991, + 0.08701702579855919, + 0.0, + 0.48567733727395535, + 0.0355818048119545, + 0.28055921010673046, + 0.3328012749552727, + 0.0, + 0.0, + 0.0, + 0.08882647007703781, + 0.5845638643950224, + 0.08345122635364532, + 0.0, + 0.0211509820073843, + 0.0, + 0.37142159417271614, + 0.020105969160795212, + 0.0, + 0.13082259520888329, + 0.12002714537084103, + 0.15497082099318504, + 0.0, + 0.0, + 0.03525669500231743, + 0.24646250158548355, + 0.0 + ], + "unique_experts": 45, + "load_cv": 1.103640079043242, + "normalized_load_entropy": 0.8569601644333151, + "max_load_share": 0.07246376811594203 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "e63cd4729620666f9a1ffebadde91f1eb3bd1b8433586db5e9e42816ac51139b", + "route_weight_sha256": "3875b5965ba124bfdc3559514aaa087d27768536cf32d2dfb26396345a41ed92", + "loads": [ + 4, + 7, + 8, + 2, + 14, + 6, + 11, + 1, + 0, + 14, + 2, + 10, + 17, + 1, + 12, + 2, + 7, + 6, + 4, + 11, + 3, + 2, + 9, + 12, + 15, + 1, + 1, + 3, + 1, + 2, + 7, + 4, + 3, + 0, + 2, + 2, + 6, + 11, + 3, + 2, + 7, + 11, + 14, + 9, + 1, + 0, + 0, + 13, + 11, + 3, + 5, + 1, + 3, + 15, + 5, + 0, + 7, + 5, + 16, + 2, + 3, + 11, + 12, + 2 + ], + "weighted_loads": [ + 0.653996242210269, + 0.3651170991361141, + 0.9518163744360209, + 0.12666676193475723, + 1.514225285500288, + 0.3515909155830741, + 0.5216857511550188, + 0.05289694666862488, + 0.0, + 0.6869630850851536, + 0.10409720242023468, + 1.0756041631102562, + 0.9382433351129293, + 0.0395258329808712, + 0.8819666411727667, + 0.10909751802682877, + 0.7282504253089428, + 0.2650835905224085, + 0.41672492027282715, + 0.5208819359540939, + 0.30281495302915573, + 0.12633658945560455, + 0.5256709195673466, + 0.8830496724694967, + 1.122458167374134, + 0.035215020179748535, + 0.03093658573925495, + 0.11909398250281811, + 0.037839457392692566, + 0.08893879130482674, + 0.24874141067266464, + 0.5758425146341324, + 0.12405594438314438, + 0.0, + 0.09881719201803207, + 0.1313646286725998, + 0.2819298319518566, + 0.6228577755391598, + 0.1316562294960022, + 0.10391071438789368, + 0.5389082487672567, + 0.6208491101861, + 1.1622583232820034, + 0.41172271594405174, + 0.010698859579861164, + 0.0, + 0.0, + 0.8282277546823025, + 0.6184268724173307, + 0.12501613795757294, + 0.33654822781682014, + 0.0211509820073843, + 0.14570153132081032, + 1.185015108436346, + 0.785813182592392, + 0.0, + 0.26000766828656197, + 0.20787579752504826, + 0.7375849708914757, + 0.06596613861620426, + 0.14551981166005135, + 0.5051090568304062, + 1.0599238872528076, + 0.16528446972370148 + ], + "unique_experts": 59, + "load_cv": 0.8116983224490899, + "normalized_load_entropy": 0.9155201571140837, + "max_load_share": 0.044270833333333336 + } + }, + "s0_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "a238dbdfdbc325497c11cf2ea9c8566f72bc72e2be748973a422efbee06c200a", + "route_weight_sha256": "8f50c44291c271054d096ff9a7531afd6f0b52bc8086282b9804c3fb87d39f66", + "loads": [ + 3, + 1, + 6, + 2, + 2, + 4, + 0, + 1, + 0, + 9, + 1, + 3, + 1, + 2, + 0, + 0, + 4, + 0, + 3, + 3, + 0, + 1, + 2, + 9, + 3, + 1, + 1, + 3, + 0, + 1, + 2, + 3, + 0, + 0, + 2, + 0, + 4, + 9, + 2, + 0, + 4, + 1, + 4, + 7, + 0, + 0, + 0, + 2, + 11, + 1, + 0, + 1, + 0, + 5, + 1, + 0, + 3, + 3, + 4, + 0, + 0, + 1, + 2, + 0 + ], + "weighted_loads": [ + 0.6182322278618813, + 0.03157169744372368, + 0.8799734376370907, + 0.12748434394598007, + 0.07579077780246735, + 0.24579168111085892, + 0.0, + 0.045993149280548096, + 0.0, + 0.4513077363371849, + 0.04508436843752861, + 0.34997719526290894, + 0.03735068067908287, + 0.07264857366681099, + 0.0, + 0.0, + 0.3707733117043972, + 0.0, + 0.32181979715824127, + 0.11061498895287514, + 0.0, + 0.0725758820772171, + 0.26502589508891106, + 0.7435443587601185, + 0.21355674788355827, + 0.034830257296562195, + 0.03125777840614319, + 0.10781454481184483, + 0.0, + 0.054690077900886536, + 0.09326599165797234, + 0.550864627584815, + 0.0, + 0.0, + 0.09996026009321213, + 0.0, + 0.21090930327773094, + 0.5379456114023924, + 0.08052652142941952, + 0.0, + 0.4616791531443596, + 0.033093322068452835, + 0.3104517385363579, + 0.31698233634233475, + 0.0, + 0.0, + 0.0, + 0.09259431809186935, + 0.6213510781526566, + 0.05394071713089943, + 0.0, + 0.021527977660298347, + 0.0, + 0.3486927002668381, + 0.016279833391308784, + 0.0, + 0.08859358169138432, + 0.11222041584551334, + 0.1422015205025673, + 0.0, + 0.0, + 0.03536351025104523, + 0.26025518774986267, + 0.0 + ], + "unique_experts": 44, + "load_cv": 1.1629475331773722, + "normalized_load_entropy": 0.8475480250468557, + "max_load_share": 0.07971014492753623 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "a31a027abfffa576e3e08d0b007e9845eb00335cdf9bd958b0f9dae08a29dd6b", + "route_weight_sha256": "7529ec9691fdf1585ca1917d0d3fc6b377e0cf7b400f643c5e198cb88554e13f", + "loads": [ + 5, + 3, + 7, + 2, + 7, + 7, + 9, + 1, + 0, + 12, + 1, + 3, + 11, + 4, + 6, + 0, + 7, + 0, + 4, + 9, + 0, + 1, + 8, + 17, + 13, + 1, + 1, + 4, + 0, + 5, + 8, + 3, + 0, + 0, + 3, + 2, + 5, + 16, + 4, + 0, + 7, + 5, + 12, + 8, + 1, + 0, + 0, + 7, + 12, + 1, + 0, + 1, + 0, + 8, + 5, + 0, + 3, + 3, + 9, + 0, + 2, + 6, + 9, + 0 + ], + "weighted_loads": [ + 0.7096449360251427, + 0.16308299452066422, + 0.904485622420907, + 0.12748434394598007, + 0.9718666542321444, + 0.3625274794176221, + 0.3739784490317106, + 0.045993149280548096, + 0.0, + 0.632177647203207, + 0.04508436843752861, + 0.34997719526290894, + 0.6980543993413448, + 0.1570047326385975, + 0.5420284904539585, + 0.0, + 0.4881187900900841, + 0.0, + 0.3630540557205677, + 0.49653350561857224, + 0.0, + 0.0725758820772171, + 0.48364848271012306, + 1.0297822132706642, + 1.1071187946945429, + 0.034830257296562195, + 0.03125777840614319, + 0.14505586959421635, + 0.0, + 0.2173827514052391, + 0.3274209462106228, + 0.550864627584815, + 0.0, + 0.0, + 0.15571549162268639, + 0.13296235725283623, + 0.26006679981946945, + 0.837385157123208, + 0.154406001791358, + 0.0, + 0.5670675709843636, + 0.25501393154263496, + 0.8986732661724091, + 0.37378041446208954, + 0.010698859579861164, + 0.0, + 0.0, + 0.4872001186013222, + 0.6607638783752918, + 0.05394071713089943, + 0.0, + 0.021527977660298347, + 0.0, + 0.5964952483773232, + 0.7723766695708036, + 0.0, + 0.08859358169138432, + 0.11222041584551334, + 0.37671762704849243, + 0.0, + 0.10372477024793625, + 0.3275263961404562, + 0.8095595892518759, + 0.0 + ], + "unique_experts": 49, + "load_cv": 0.9541980020732037, + "normalized_load_entropy": 0.8799827163050711, + "max_load_share": 0.059027777777777776 + } + }, + "s1_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "bfa01c1dc92ad4b42d44d81d94e321035d83d873228a3af1179f24feb4060eec", + "route_weight_sha256": "41aea2ee0f39beecc1e1b39c8b6cac4816f29903eaf1feffd34f02c5d59e546b", + "loads": [ + 3, + 1, + 6, + 2, + 2, + 3, + 0, + 2, + 0, + 8, + 1, + 3, + 5, + 1, + 0, + 0, + 3, + 0, + 3, + 5, + 0, + 1, + 2, + 8, + 3, + 1, + 1, + 2, + 0, + 1, + 1, + 2, + 0, + 0, + 2, + 1, + 4, + 8, + 3, + 0, + 4, + 1, + 4, + 7, + 0, + 0, + 0, + 2, + 10, + 1, + 0, + 1, + 0, + 5, + 1, + 0, + 3, + 3, + 4, + 0, + 1, + 1, + 2, + 0 + ], + "weighted_loads": [ + 0.6371214985847473, + 0.03208102285861969, + 0.8593041114509106, + 0.12446238100528717, + 0.0661827102303505, + 0.22080225124955177, + 0.0, + 0.09551145136356354, + 0.0, + 0.3954213708639145, + 0.03747217357158661, + 0.33363645523786545, + 0.18428926169872284, + 0.03659279644489288, + 0.0, + 0.0, + 0.2906476780772209, + 0.0, + 0.3209196999669075, + 0.19171461835503578, + 0.0, + 0.07250427454710007, + 0.2557253874838352, + 0.7361804489046335, + 0.19451066851615906, + 0.03304395079612732, + 0.031124083325266838, + 0.07012498751282692, + 0.0, + 0.0536126047372818, + 0.03864268213510513, + 0.49788743257522583, + 0.0, + 0.0, + 0.09889642521739006, + 0.03530140593647957, + 0.20578504726290703, + 0.5103027913719416, + 0.1144106574356556, + 0.0, + 0.4504630118608475, + 0.036462511867284775, + 0.28406017646193504, + 0.3262147158384323, + 0.0, + 0.0, + 0.0, + 0.08937940374016762, + 0.5783348809927702, + 0.0567166805267334, + 0.0, + 0.020405784249305725, + 0.0, + 0.36705026775598526, + 0.01844264194369316, + 0.0, + 0.10093751363456249, + 0.12362335249781609, + 0.1542002446949482, + 0.0, + 0.030670544132590294, + 0.035372376441955566, + 0.24884210526943207, + 0.0 + ], + "unique_experts": 46, + "load_cv": 1.0852159977694509, + "normalized_load_entropy": 0.8610784126630459, + "max_load_share": 0.07246376811594203 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "717962f5412a161a1c4ff06c8465ec1dc6e4e622dba3dcf257e074b728b7d1c8", + "route_weight_sha256": "0e67e4bdd62e9352fce893fe8b379bba72270d39004493ffc584fd77adfafda3", + "loads": [ + 4, + 5, + 8, + 2, + 14, + 6, + 10, + 2, + 0, + 13, + 2, + 10, + 19, + 1, + 13, + 2, + 6, + 5, + 4, + 14, + 3, + 2, + 8, + 12, + 15, + 1, + 1, + 3, + 1, + 2, + 5, + 3, + 2, + 0, + 3, + 2, + 6, + 10, + 4, + 3, + 7, + 11, + 14, + 10, + 1, + 0, + 0, + 14, + 11, + 2, + 5, + 1, + 3, + 16, + 5, + 0, + 6, + 5, + 14, + 2, + 5, + 12, + 12, + 2 + ], + "weighted_loads": [ + 0.6584746744483709, + 0.27714939042925835, + 0.9191322792321444, + 0.12446238100528717, + 1.5908092968165874, + 0.3572180299088359, + 0.48777581192553043, + 0.09551145136356354, + 0.0, + 0.6688849925994873, + 0.10472211241722107, + 1.0585290268063545, + 0.9451977144926786, + 0.03659279644489288, + 0.8555651511996984, + 0.10909751802682877, + 0.6795186400413513, + 0.22963744588196278, + 0.4200828745961189, + 0.6418798752129078, + 0.30281495302915573, + 0.12747904658317566, + 0.4902408570051193, + 0.881230790168047, + 1.1514040157198906, + 0.03304395079612732, + 0.031124083325266838, + 0.12294018268585205, + 0.037839457392692566, + 0.08747197315096855, + 0.18013301491737366, + 0.5436646230518818, + 0.08712287619709969, + 0.0, + 0.15650631859898567, + 0.12156214937567711, + 0.2866378240287304, + 0.5852296203374863, + 0.1590498611330986, + 0.14932414516806602, + 0.5504860877990723, + 0.6219414919614792, + 1.0147965867072344, + 0.44369130581617355, + 0.010698859579861164, + 0.0, + 0.0, + 0.9342226311564445, + 0.6121978890150785, + 0.09828159213066101, + 0.33654822781682014, + 0.020405784249305725, + 0.14570153132081032, + 1.2487399280071259, + 0.7841498553752899, + 0.0, + 0.23011370934545994, + 0.21147200465202332, + 0.6551486290991306, + 0.06596613861620426, + 0.21465525962412357, + 0.5396800115704536, + 1.017473865300417, + 0.16528446972370148 + ], + "unique_experts": 59, + "load_cv": 0.8275843360850502, + "normalized_load_entropy": 0.9145202600409903, + "max_load_share": 0.049479166666666664 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.9254658385093167, + "mean_token_weighted_tv": 0.01672587960796512, + "aggregate_load_tv": 0.04347826086956521 + }, + "system_bos": { + "tokens": 23, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.9037267080745341, + "mean_token_weighted_tv": 0.020861808089134487, + "aggregate_load_tv": 0.057971014492753624 + }, + "system_x": { + "tokens": 23, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.9037267080745341, + "mean_token_weighted_tv": 0.02356729862968559, + "aggregate_load_tv": 0.043478260869565216 + }, + "system_period": { + "tokens": 23, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8788819875776398, + "mean_token_weighted_tv": 0.028745769887514736, + "aggregate_load_tv": 0.07246376811594202 + }, + "bos_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.9161490683229815, + "mean_token_weighted_tv": 0.02329295355340709, + "aggregate_load_tv": 0.05072463768115941 + }, + "bos_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.9037267080745341, + "mean_token_weighted_tv": 0.021335482030459072, + "aggregate_load_tv": 0.057971014492753624 + }, + "x_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.8913043478260869, + "mean_token_weighted_tv": 0.02939772889341997, + "aggregate_load_tv": 0.06521739130434782 + }, + "x_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 7, + "set_exact_tokens": 9, + "mean_set_jaccard": 0.8167701863354037, + "mean_token_weighted_tv": 0.037863729926555054, + "aggregate_load_tv": 0.07971014492753623 + }, + "period_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8881987577639753, + "mean_token_weighted_tv": 0.027123155274792858, + "aggregate_load_tv": 0.06521739130434781 + }, + "period_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 10, + "mean_set_jaccard": 0.8012422360248448, + "mean_token_weighted_tv": 0.04215998971915763, + "aggregate_load_tv": 0.09420289855072464 + } + } + }, + "layer_20": { + "layer": 20, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "e1890ef93331975dea0054a600434d76bbbb10a33d32306a2f5e6508c93cd7ed", + "route_weight_sha256": "ea3f0bc9d8162277aa63189b1ee8a6e249dc1a5f973b128464bd125235e8f255", + "loads": [ + 0, + 5, + 3, + 1, + 2, + 14, + 2, + 0, + 1, + 0, + 1, + 0, + 1, + 0, + 4, + 6, + 0, + 0, + 4, + 0, + 6, + 0, + 2, + 4, + 0, + 0, + 1, + 0, + 0, + 0, + 17, + 0, + 0, + 0, + 0, + 0, + 0, + 5, + 2, + 0, + 1, + 2, + 0, + 3, + 5, + 1, + 0, + 7, + 4, + 0, + 0, + 4, + 3, + 0, + 3, + 0, + 6, + 5, + 3, + 0, + 1, + 3, + 0, + 6 + ], + "weighted_loads": [ + 0.0, + 0.20858711004257202, + 0.14038385078310966, + 0.028584882616996765, + 0.06805029883980751, + 1.4599665813148022, + 0.32756859064102173, + 0.0, + 0.04660215601325035, + 0.0, + 0.039592597633600235, + 0.0, + 0.06144486740231514, + 0.0, + 0.3746849223971367, + 0.3360743448138237, + 0.0, + 0.0, + 0.32086509838700294, + 0.0, + 0.9045646674931049, + 0.0, + 0.07738704979419708, + 0.1737684179097414, + 0.0, + 0.0, + 0.03275316581130028, + 0.0, + 0.0, + 0.0, + 2.175302118062973, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.2625024989247322, + 0.7500719949603081, + 0.0, + 0.035766664892435074, + 0.10204468294978142, + 0.0, + 0.2880872040987015, + 0.2957311552017927, + 0.03849370777606964, + 0.0, + 0.6454856470227242, + 0.29855071753263474, + 0.0, + 0.0, + 0.25269750133156776, + 0.2711656019091606, + 0.0, + 0.13597098737955093, + 0.0, + 0.537693552672863, + 0.20750741474330425, + 0.13122425507754087, + 0.0, + 0.05446961522102356, + 0.21828200295567513, + 0.0, + 0.23057729378342628 + ], + "unique_experts": 35, + "load_cv": 1.4693536708498427, + "normalized_load_entropy": 0.7868696454624229, + "max_load_share": 0.12318840579710146 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "e0e2d50f48cf6c38efe16ee21fd2582b76fb267818ecf71a47de8ddc4ab3dd5d", + "route_weight_sha256": "d26379a5cacf3549ed9e923daf2180647dfcaa96526c3f538fc5090d8c65e133", + "loads": [ + 0, + 7, + 3, + 9, + 10, + 19, + 5, + 4, + 1, + 0, + 1, + 1, + 5, + 0, + 4, + 13, + 2, + 0, + 15, + 0, + 10, + 0, + 9, + 4, + 0, + 8, + 2, + 0, + 0, + 3, + 17, + 0, + 0, + 1, + 1, + 0, + 2, + 6, + 4, + 0, + 3, + 5, + 2, + 8, + 14, + 1, + 0, + 7, + 5, + 1, + 8, + 4, + 4, + 6, + 3, + 3, + 7, + 11, + 4, + 0, + 13, + 7, + 0, + 6 + ], + "weighted_loads": [ + 0.0, + 0.25339520908892155, + 0.14038385078310966, + 0.6307384930551052, + 0.4584187865257263, + 1.690124211832881, + 0.4122746717184782, + 0.2700131740421057, + 0.04660215601325035, + 0.0, + 0.039592597633600235, + 0.04104446992278099, + 0.1887125801295042, + 0.0, + 0.3746849223971367, + 0.7862918265163898, + 0.0633844118565321, + 0.0, + 1.2427891492843628, + 0.0, + 1.011521807871759, + 0.0, + 0.6691279038786888, + 0.1737684179097414, + 0.0, + 0.5976992771029472, + 0.05019340291619301, + 0.0, + 0.0, + 0.09337917156517506, + 2.175302118062973, + 0.0, + 0.0, + 0.023133913055062294, + 0.04430808871984482, + 0.0, + 0.04675983265042305, + 0.2963939532637596, + 2.068491391837597, + 0.0, + 0.11819710396230221, + 0.22430724650621414, + 0.16114728152751923, + 0.46109520306345075, + 0.6859824433922768, + 0.03849370777606964, + 0.0, + 0.6454856470227242, + 0.30019023921340704, + 0.04783610627055168, + 1.1783824004232883, + 0.25269750133156776, + 0.2991575803607702, + 0.29945426620543003, + 0.13597098737955093, + 0.47351210936903954, + 0.5982501544058323, + 0.39254978112876415, + 0.16970061790198088, + 0.0, + 1.356449052109383, + 0.4556705430150032, + 0.0, + 0.23057729378342628 + ], + "unique_experts": 48, + "load_cv": 1.0289032876362298, + "normalized_load_entropy": 0.8690531984237396, + "max_load_share": 0.06597222222222222 + } + }, + "s1_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "e11362a3b8df17c05d7848a69319eec437340f828fdf886df67eb3a908cf7016", + "route_weight_sha256": "3bc9d5fa43c72a24b21eea302c2a60dd6c96beabd904e4b6ba42b7eb43d253d9", + "loads": [ + 0, + 4, + 3, + 0, + 2, + 14, + 2, + 0, + 1, + 0, + 1, + 0, + 2, + 0, + 5, + 6, + 0, + 0, + 4, + 0, + 6, + 0, + 2, + 3, + 0, + 0, + 1, + 0, + 0, + 2, + 17, + 0, + 0, + 0, + 1, + 1, + 1, + 5, + 2, + 0, + 1, + 2, + 0, + 3, + 4, + 0, + 0, + 6, + 3, + 0, + 0, + 4, + 3, + 0, + 3, + 0, + 6, + 5, + 3, + 0, + 1, + 3, + 0, + 6 + ], + "weighted_loads": [ + 0.0, + 0.18249304220080376, + 0.13751644268631935, + 0.0, + 0.07205755263566971, + 1.4133851937949657, + 0.31844741106033325, + 0.0, + 0.037433281540870667, + 0.0, + 0.04000650718808174, + 0.0, + 0.08769451268017292, + 0.0, + 0.38956727646291256, + 0.36200692132115364, + 0.0, + 0.0, + 0.3131832629442215, + 0.0, + 0.8719008378684521, + 0.0, + 0.07325059920549393, + 0.14158659055829048, + 0.0, + 0.0, + 0.03314695134758949, + 0.0, + 0.0, + 0.06580585055053234, + 2.1540024019777775, + 0.0, + 0.0, + 0.0, + 0.028346674516797066, + 0.04628683626651764, + 0.039856307208538055, + 0.2589807063341141, + 0.746713750064373, + 0.0, + 0.037742454558610916, + 0.10589349269866943, + 0.0, + 0.2910141050815582, + 0.28449397534132004, + 0.0, + 0.0, + 0.6095287278294563, + 0.25811684131622314, + 0.0, + 0.0, + 0.260416429489851, + 0.2677256762981415, + 0.0, + 0.1362108178436756, + 0.0, + 0.5494678542017937, + 0.2041906639933586, + 0.13337111845612526, + 0.0, + 0.05924372747540474, + 0.2110660970211029, + 0.0, + 0.2271754089742899 + ], + "unique_experts": 37, + "load_cv": 1.4369768026808833, + "normalized_load_entropy": 0.7992386972983965, + "max_load_share": 0.12318840579710146 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "99896af2288054b97e07818f0f5884c7be1b83c57d9ac8b0d3a2bafbbc4e060c", + "route_weight_sha256": "40079edddcc8803bac6441a33f90ae7ef46ea77566f0ba103acf5374ceccf9b9", + "loads": [ + 5, + 6, + 3, + 11, + 10, + 21, + 4, + 9, + 1, + 2, + 3, + 0, + 3, + 1, + 6, + 19, + 5, + 0, + 14, + 1, + 12, + 1, + 12, + 5, + 1, + 14, + 2, + 2, + 0, + 8, + 17, + 0, + 1, + 1, + 5, + 3, + 4, + 9, + 5, + 4, + 6, + 4, + 2, + 11, + 18, + 1, + 0, + 6, + 5, + 5, + 13, + 4, + 3, + 9, + 4, + 10, + 8, + 12, + 5, + 2, + 14, + 5, + 1, + 6 + ], + "weighted_loads": [ + 0.2298794686794281, + 0.2267652042210102, + 0.13751644268631935, + 0.7635049037635326, + 0.49360860139131546, + 1.7150270491838455, + 0.39134123735129833, + 0.5908589251339436, + 0.037433281540870667, + 0.23566818982362747, + 0.1338542364537716, + 0.0, + 0.12776503153145313, + 0.2830076515674591, + 0.44832772947847843, + 1.2601510062813759, + 0.3002009764313698, + 0.0, + 1.2990237958729267, + 0.03974062204360962, + 1.0648618168197572, + 0.03480032458901405, + 0.8487626053392887, + 0.3124847002327442, + 0.01978174038231373, + 0.9256335683166981, + 0.050587188452482224, + 0.06125393509864807, + 0.0, + 0.2506658900529146, + 2.1540024019777775, + 0.0, + 0.04738996550440788, + 0.043310489505529404, + 0.21446917578577995, + 0.2240176908671856, + 0.14188593439757824, + 0.41792039945721626, + 2.1045240946114063, + 0.19981792569160461, + 0.24325821176171303, + 0.20033157244324684, + 0.14747050032019615, + 0.5999918424058706, + 1.1572078615427017, + 0.07283078879117966, + 0.0, + 0.6095287278294563, + 0.2933774795383215, + 0.3030273802578449, + 1.725354589521885, + 0.260416429489851, + 0.2677256762981415, + 0.3906014710664749, + 0.16233728639781475, + 1.048930585384369, + 0.6356063634157181, + 0.7434733659029007, + 0.20908261463046074, + 0.052520327270030975, + 1.479031590395607, + 0.3537936955690384, + 0.060637082904577255, + 0.2271754089742899 + ], + "unique_experts": 59, + "load_cv": 0.8559432743405891, + "normalized_load_entropy": 0.9123756123605103, + "max_load_share": 0.0546875 + } + }, + "s0_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "3c9a8800a95cb2ea4d1784c6f03916fc0c5b220883287308f783c444c1ccb5d4", + "route_weight_sha256": "cd1359026d5106a3f85d8ec32aa94149bd66b1ae2c09aa983cac62d56e401cd4", + "loads": [ + 0, + 5, + 3, + 0, + 2, + 14, + 2, + 1, + 2, + 0, + 1, + 0, + 1, + 0, + 5, + 6, + 0, + 1, + 3, + 0, + 6, + 0, + 2, + 4, + 0, + 0, + 1, + 0, + 0, + 0, + 17, + 0, + 0, + 0, + 1, + 0, + 1, + 5, + 2, + 0, + 1, + 2, + 0, + 3, + 5, + 0, + 0, + 6, + 4, + 0, + 0, + 3, + 3, + 0, + 4, + 0, + 6, + 3, + 3, + 0, + 1, + 4, + 0, + 5 + ], + "weighted_loads": [ + 0.0, + 0.23073218762874603, + 0.13468516618013382, + 0.0, + 0.07085716538131237, + 1.513420943170786, + 0.3160025179386139, + 0.025890599936246872, + 0.08727091550827026, + 0.0, + 0.03590361773967743, + 0.0, + 0.07405436038970947, + 0.0, + 0.3957118093967438, + 0.3420919291675091, + 0.0, + 0.04087061062455177, + 0.27383696287870407, + 0.0, + 0.9326566122472286, + 0.0, + 0.08315156400203705, + 0.1852096188813448, + 0.0, + 0.0, + 0.03176812082529068, + 0.0, + 0.0, + 0.0, + 2.1788967810571194, + 0.0, + 0.0, + 0.0, + 0.029101477935910225, + 0.0, + 0.029187703505158424, + 0.28254522010684013, + 0.7604492232203484, + 0.0, + 0.03988944739103317, + 0.10173705220222473, + 0.0, + 0.27166426181793213, + 0.2989754807204008, + 0.0, + 0.0, + 0.6228780467063189, + 0.3037472777068615, + 0.0, + 0.0, + 0.23548190295696259, + 0.27169063687324524, + 0.0, + 0.19211741909384727, + 0.0, + 0.5393859092146158, + 0.14424286782741547, + 0.13380030076950788, + 0.0, + 0.06053275614976883, + 0.25511427223682404, + 0.0, + 0.17693866789340973 + ], + "unique_experts": 37, + "load_cv": 1.4393135893493163, + "normalized_load_entropy": 0.7980857764742624, + "max_load_share": 0.12318840579710146 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "98b3ece84d53b49cc113262e488efa0947341aaf24b1cecfe9781dea16d2962a", + "route_weight_sha256": "87caf2d608b493ac90e3720c417e1b9ccb47648cf8c84ce4f233a68d2b0ab00f", + "loads": [ + 0, + 6, + 3, + 8, + 10, + 19, + 5, + 5, + 2, + 0, + 1, + 1, + 5, + 0, + 6, + 13, + 2, + 1, + 14, + 0, + 9, + 0, + 11, + 4, + 0, + 8, + 4, + 0, + 0, + 3, + 19, + 1, + 0, + 1, + 2, + 0, + 3, + 6, + 3, + 0, + 3, + 5, + 2, + 7, + 15, + 0, + 1, + 7, + 4, + 0, + 8, + 3, + 4, + 5, + 4, + 3, + 6, + 8, + 4, + 0, + 12, + 7, + 0, + 5 + ], + "weighted_loads": [ + 0.0, + 0.25487801991403103, + 0.13468516618013382, + 0.6021536104381084, + 0.4612256530672312, + 1.7293786834925413, + 0.40070859901607037, + 0.2831131611019373, + 0.08727091550827026, + 0.0, + 0.03590361773967743, + 0.6835088729858398, + 0.20737509243190289, + 0.0, + 0.44434433430433273, + 0.765731256455183, + 0.0633844118565321, + 0.04087061062455177, + 1.190318502485752, + 0.0, + 1.0364671181887388, + 0.0, + 0.7370033264160156, + 0.1852096188813448, + 0.0, + 0.5526524819433689, + 0.13037036545574665, + 0.0, + 0.0, + 0.09337917156517506, + 2.278524585068226, + 0.01211369875818491, + 0.0, + 0.023133913055062294, + 0.07131733931601048, + 0.0, + 0.07594753615558147, + 0.31643667444586754, + 1.1247448846697807, + 0.0, + 0.11212551034986973, + 0.22750248853117228, + 0.16345136612653732, + 0.4640767350792885, + 0.7024999260902405, + 0.0, + 0.14474675059318542, + 0.6337255584076047, + 0.3037472777068615, + 0.0, + 1.284110650420189, + 0.23548190295696259, + 0.29968261532485485, + 0.27268010936677456, + 0.19211741909384727, + 0.4012622945010662, + 0.5393859092146158, + 0.29356755688786507, + 0.1722766635939479, + 0.0, + 1.3611298389732838, + 0.4533330798149109, + 0.0, + 0.17693866789340973 + ], + "unique_experts": 49, + "load_cv": 1.0168336232068402, + "normalized_load_entropy": 0.8754326378518289, + "max_load_share": 0.06597222222222222 + } + }, + "s1_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "feb8eea6d1dfdef2680d91f01d8002ad2a7d383355902901b59c9fd0857cddfd", + "route_weight_sha256": "4f797b69fa29063450432637358a8ca59bd49da5038728659da902269cace695", + "loads": [ + 0, + 6, + 3, + 0, + 2, + 14, + 2, + 0, + 2, + 0, + 1, + 0, + 2, + 0, + 4, + 6, + 0, + 0, + 3, + 0, + 6, + 0, + 2, + 4, + 0, + 0, + 1, + 0, + 0, + 1, + 17, + 0, + 0, + 0, + 1, + 1, + 0, + 5, + 2, + 0, + 1, + 1, + 0, + 3, + 4, + 0, + 0, + 6, + 4, + 0, + 0, + 3, + 3, + 0, + 5, + 0, + 6, + 4, + 3, + 0, + 1, + 4, + 0, + 5 + ], + "weighted_loads": [ + 0.0, + 0.2531659547239542, + 0.12541348859667778, + 0.0, + 0.0659146886318922, + 1.4452650770545006, + 0.30468250811100006, + 0.0, + 0.08778999373316765, + 0.0, + 0.035768233239650726, + 0.0, + 0.0937822237610817, + 0.0, + 0.36600473150610924, + 0.3684917315840721, + 0.0, + 0.0, + 0.27264201641082764, + 0.0, + 0.9336665794253349, + 0.0, + 0.07730400189757347, + 0.17328335903584957, + 0.0, + 0.0, + 0.030428284779191017, + 0.0, + 0.0, + 0.03658253327012062, + 2.178526185452938, + 0.0, + 0.0, + 0.0, + 0.030702311545610428, + 0.043481502681970596, + 0.0, + 0.2451530359685421, + 0.7609709426760674, + 0.0, + 0.04095596447587013, + 0.06547291576862335, + 0.0, + 0.30144138634204865, + 0.27626292780041695, + 0.0, + 0.0, + 0.6188666559755802, + 0.29492656886577606, + 0.0, + 0.0, + 0.23536404222249985, + 0.2650832161307335, + 0.0, + 0.21545322611927986, + 0.0, + 0.5495571047067642, + 0.1747900675982237, + 0.1174305658787489, + 0.0, + 0.07845195382833481, + 0.25273461267352104, + 0.0, + 0.18811677955091 + ], + "unique_experts": 36, + "load_cv": 1.4486230416005967, + "normalized_load_entropy": 0.7938157202504821, + "max_load_share": 0.12318840579710146 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "fff6cfdf73eca5c554512bd1be9cb8f0bde5db33bfa74e6f197a47d646082ad7", + "route_weight_sha256": "bf68caa929c49c5e1ffe6d31949647af1297ba0eaa1455137db7fb862de790e0", + "loads": [ + 5, + 7, + 3, + 11, + 10, + 22, + 4, + 9, + 2, + 2, + 3, + 0, + 3, + 1, + 5, + 20, + 5, + 0, + 13, + 1, + 12, + 1, + 13, + 6, + 1, + 14, + 3, + 2, + 0, + 6, + 17, + 0, + 1, + 0, + 4, + 3, + 3, + 10, + 4, + 5, + 6, + 4, + 2, + 11, + 19, + 1, + 0, + 6, + 4, + 5, + 13, + 3, + 3, + 10, + 6, + 10, + 8, + 11, + 4, + 2, + 13, + 6, + 1, + 5 + ], + "weighted_loads": [ + 0.23126060143113136, + 0.2773117870092392, + 0.12541348859667778, + 0.7635049037635326, + 0.48746573738753796, + 1.8151815049350262, + 0.37757633440196514, + 0.5734930448234081, + 0.08778999373316765, + 0.23566818982362747, + 0.12961596250534058, + 0.0, + 0.1338527426123619, + 0.2830076515674591, + 0.4247651845216751, + 1.2944612614810467, + 0.3002009764313698, + 0.0, + 1.2584825493395329, + 0.03974062204360962, + 1.1536956634372473, + 0.03480032458901405, + 0.8878346979618073, + 0.3441814687103033, + 0.01978174038231373, + 0.9347563944756985, + 0.0955685805529356, + 0.06125393509864807, + 0.0, + 0.1717689409852028, + 2.178526185452938, + 0.0, + 0.04738996550440788, + 0.0, + 0.15081295557320118, + 0.22121235728263855, + 0.10202962718904018, + 0.4486616738140583, + 1.168089348822832, + 0.25834227353334427, + 0.2442325484007597, + 0.21370290964841843, + 0.15661747008562088, + 0.7029338367283344, + 1.2109637781977654, + 0.07283078879117966, + 0.0, + 0.6188666559755802, + 0.29492656886577606, + 0.3393111489713192, + 1.7505220547318459, + 0.23536404222249985, + 0.2650832161307335, + 0.43391950614750385, + 0.241579694673419, + 1.0090551376342773, + 0.6351005993783474, + 0.7140727695077658, + 0.15466981567442417, + 0.052520327270030975, + 1.4963566828519106, + 0.3971823565661907, + 0.060637082904577255, + 0.18811677955091 + ], + "unique_experts": 58, + "load_cv": 0.875, + "normalized_load_entropy": 0.90935846262321, + "max_load_share": 0.057291666666666664 + } + }, + "s0_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "c6db5a4a955ecb4a206bada3031046fe6d3c91460effbdb50dd7c3a72d8365e2", + "route_weight_sha256": "9989b85e09688f31f260f81185410fcbe8df0775cab5d66288bdc58293431dae", + "loads": [ + 0, + 5, + 3, + 0, + 2, + 14, + 2, + 0, + 2, + 0, + 1, + 1, + 1, + 0, + 4, + 6, + 0, + 0, + 3, + 0, + 6, + 0, + 2, + 3, + 0, + 0, + 1, + 0, + 0, + 1, + 17, + 0, + 0, + 0, + 1, + 0, + 0, + 5, + 2, + 0, + 1, + 1, + 0, + 3, + 5, + 1, + 0, + 7, + 4, + 0, + 0, + 3, + 3, + 0, + 4, + 0, + 6, + 5, + 3, + 0, + 1, + 4, + 0, + 5 + ], + "weighted_loads": [ + 0.0, + 0.2275551287457347, + 0.1253323033452034, + 0.0, + 0.07384242862462997, + 1.441357098519802, + 0.3429247885942459, + 0.0, + 0.0905575379729271, + 0.0, + 0.030786575749516487, + 0.019672153517603874, + 0.06671323627233505, + 0.0, + 0.3764010891318321, + 0.32495012134313583, + 0.0, + 0.0, + 0.28014707565307617, + 0.0, + 0.9132511951029301, + 0.0, + 0.0812436081469059, + 0.1592169888317585, + 0.0, + 0.0, + 0.032207123935222626, + 0.0, + 0.0, + 0.025424588471651077, + 2.280112896114588, + 0.0, + 0.0, + 0.0, + 0.02907336689531803, + 0.0, + 0.0, + 0.2987632527947426, + 0.7314227148890495, + 0.0, + 0.040573883801698685, + 0.05853171646595001, + 0.0, + 0.2660706229507923, + 0.30502938851714134, + 0.038654062896966934, + 0.0, + 0.6531299352645874, + 0.2985641621053219, + 0.0, + 0.0, + 0.23433875292539597, + 0.27968017011880875, + 0.0, + 0.1780770756304264, + 0.0, + 0.5168434605002403, + 0.2420606128871441, + 0.1261859480291605, + 0.0, + 0.058940622955560684, + 0.23927012085914612, + 0.0, + 0.17478730529546738 + ], + "unique_experts": 37, + "load_cv": 1.4509410717526756, + "normalized_load_entropy": 0.7954991708582281, + "max_load_share": 0.12318840579710146 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "d362566f3b2a759d8114776d4245a3498d50bb495a85972de4eccda11bf17318", + "route_weight_sha256": "aea4a9c13e35ccb8cc83dc24e1ba9130aa4bc7f14cc783718001cbeaf44d67b6", + "loads": [ + 0, + 7, + 3, + 8, + 11, + 17, + 6, + 4, + 5, + 0, + 1, + 1, + 5, + 1, + 4, + 11, + 2, + 0, + 14, + 0, + 9, + 0, + 9, + 3, + 0, + 9, + 2, + 0, + 0, + 6, + 18, + 0, + 0, + 1, + 2, + 0, + 4, + 6, + 3, + 0, + 2, + 3, + 2, + 5, + 16, + 1, + 0, + 7, + 4, + 1, + 8, + 3, + 4, + 5, + 4, + 4, + 7, + 11, + 4, + 0, + 13, + 7, + 0, + 5 + ], + "weighted_loads": [ + 0.0, + 0.2913723336532712, + 0.1253323033452034, + 0.6021536104381084, + 0.5854808948934078, + 1.550522243604064, + 0.4628672692924738, + 0.24928675405681133, + 0.1960300002247095, + 0.0, + 0.030786575749516487, + 0.019672153517603874, + 0.24315065704286098, + 0.028185952454805374, + 0.3764010891318321, + 0.6870095133781433, + 0.0633844118565321, + 0.0, + 1.2604246139526367, + 0.0, + 1.0170617010444403, + 0.0, + 0.6165863536298275, + 0.1592169888317585, + 0.0, + 0.6385261230170727, + 0.049647361040115356, + 0.0, + 0.0, + 0.19000703655183315, + 2.3332304917275906, + 0.0, + 0.0, + 0.023133913055062294, + 0.06556330062448978, + 0.0, + 0.11546114087104797, + 0.33265470713377, + 1.095718376338482, + 0.0, + 0.07429002597928047, + 0.1737206131219864, + 0.16317176818847656, + 0.34774767234921455, + 0.7422224227339029, + 0.038654062896966934, + 0.0, + 0.6531299352645874, + 0.2985641621053219, + 0.03687930852174759, + 1.1369995586574078, + 0.23433875292539597, + 0.30767214857041836, + 0.2733140420168638, + 0.1780770756304264, + 0.4335261136293411, + 0.5596902705729008, + 0.44360219687223434, + 0.1646623108536005, + 0.0, + 1.551193431019783, + 0.430254265666008, + 0.0, + 0.17478730529546738 + ], + "unique_experts": 49, + "load_cv": 1.0015420209622192, + "normalized_load_entropy": 0.8763177521272916, + "max_load_share": 0.0625 + } + }, + "s1_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "52df5532cfebd78a03a5e7d0184a6ec0fb46ae3eb48ae3cf80695b55d9053dfa", + "route_weight_sha256": "c2bddacc7193c7b50632244b0a32163eb0ca2f754fb97cef702395f67524e87c", + "loads": [ + 0, + 5, + 3, + 0, + 4, + 14, + 2, + 0, + 1, + 0, + 1, + 0, + 1, + 0, + 5, + 6, + 0, + 1, + 3, + 0, + 6, + 0, + 2, + 3, + 0, + 0, + 1, + 0, + 0, + 1, + 17, + 0, + 0, + 0, + 1, + 0, + 0, + 5, + 2, + 0, + 1, + 1, + 0, + 3, + 5, + 1, + 0, + 7, + 4, + 0, + 0, + 3, + 3, + 0, + 4, + 0, + 7, + 4, + 3, + 0, + 1, + 4, + 0, + 3 + ], + "weighted_loads": [ + 0.0, + 0.23374169878661633, + 0.10163422673940659, + 0.0, + 0.14989127404987812, + 1.4181743375957012, + 0.3146236091852188, + 0.0, + 0.05194397270679474, + 0.0, + 0.03256816044449806, + 0.0, + 0.059969447553157806, + 0.0, + 0.3927879184484482, + 0.31500662863254547, + 0.0, + 0.02613450214266777, + 0.27168531715869904, + 0.0, + 0.8793676607310772, + 0.0, + 0.07025333121418953, + 0.1400511935353279, + 0.0, + 0.0, + 0.030523400753736496, + 0.0, + 0.0, + 0.02505895495414734, + 2.1318268831819296, + 0.0, + 0.0, + 0.0, + 0.031163565814495087, + 0.0, + 0.0, + 0.32344456389546394, + 0.7105900272727013, + 0.0, + 0.047637566924095154, + 0.06205790489912033, + 0.0, + 0.2614705376327038, + 0.3130186665803194, + 0.036344386637210846, + 0.0, + 0.660200759768486, + 0.3226957581937313, + 0.0, + 0.0, + 0.23864319175481796, + 0.25433383136987686, + 0.0, + 0.17192822694778442, + 0.0, + 0.5640401132404804, + 0.20661155506968498, + 0.11908018589019775, + 0.0, + 0.0624084435403347, + 0.23218651115894318, + 0.0, + 0.11937446147203445 + ], + "unique_experts": 37, + "load_cv": 1.4578730482544484, + "normalized_load_entropy": 0.7939448755951809, + "max_load_share": 0.12318840579710146 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "a4da1b5cb16882dafb9eb4d94167a66eddde36badd99443d58a9a9f2fbf6f7ce", + "route_weight_sha256": "336724ddeaf31b70a1fc31578ed7697b5baf0de94bb171a4b64482b3a036b4a7", + "loads": [ + 4, + 6, + 3, + 12, + 14, + 22, + 5, + 9, + 1, + 2, + 3, + 0, + 3, + 1, + 6, + 19, + 7, + 1, + 14, + 1, + 9, + 2, + 12, + 5, + 1, + 15, + 2, + 3, + 0, + 8, + 17, + 0, + 1, + 0, + 3, + 2, + 3, + 10, + 4, + 4, + 4, + 3, + 2, + 8, + 22, + 2, + 0, + 7, + 4, + 4, + 13, + 3, + 3, + 9, + 5, + 10, + 9, + 12, + 4, + 2, + 14, + 6, + 1, + 3 + ], + "weighted_loads": [ + 0.19503278657794, + 0.2578875310719013, + 0.10163422673940659, + 0.7949813157320023, + 0.7191116157919168, + 1.7730381451547146, + 0.4257556479424238, + 0.5436163432896137, + 0.05194397270679474, + 0.23566818982362747, + 0.1264158897101879, + 0.0, + 0.14507047832012177, + 0.2830076515674591, + 0.45154837146401405, + 1.2380495443940163, + 0.4630993641912937, + 0.02613450214266777, + 1.373207237571478, + 0.03974062204360962, + 0.989095376804471, + 0.067483339458704, + 0.7233904302120209, + 0.31094930320978165, + 0.01978174038231373, + 0.9556611701846123, + 0.04796363785862923, + 0.0937192365527153, + 0.0, + 0.2299508024007082, + 2.1318268831819296, + 0.0, + 0.04738996550440788, + 0.0, + 0.10073376633226871, + 0.17773085460066795, + 0.10202962718904018, + 0.5247918292880058, + 1.117708433419466, + 0.19981792569160461, + 0.18610588274896145, + 0.16221883893013, + 0.14368900284171104, + 0.5235755406320095, + 1.28658296354115, + 0.1091751754283905, + 0.0, + 0.660200759768486, + 0.3226957581937313, + 0.23592375591397285, + 1.446957666426897, + 0.23864319175481796, + 0.25433383136987686, + 0.3661509659141302, + 0.19805469550192356, + 1.0338851511478424, + 0.6501073613762856, + 0.7916017174720764, + 0.15631943568587303, + 0.052520327270030975, + 1.5747641306370497, + 0.37348975241184235, + 0.060637082904577255, + 0.11937446147203445 + ], + "unique_experts": 59, + "load_cv": 0.9076258712829985, + "normalized_load_entropy": 0.9061504052350058, + "max_load_share": 0.057291666666666664 + } + }, + "s0_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "b103aa00eacb7ca3138aabef13e70199fdf7696669a2ce45389fac7f770c5f34", + "route_weight_sha256": "16885ce0700722cac8fd2fd3f28b81fe3b78d3343efaadcc5bb33c5e3c06c52f", + "loads": [ + 0, + 5, + 3, + 0, + 2, + 14, + 2, + 0, + 2, + 0, + 0, + 1, + 1, + 0, + 4, + 6, + 0, + 0, + 3, + 0, + 6, + 0, + 2, + 3, + 0, + 0, + 1, + 0, + 0, + 1, + 17, + 0, + 0, + 0, + 1, + 1, + 0, + 5, + 2, + 0, + 1, + 2, + 0, + 3, + 5, + 0, + 0, + 7, + 4, + 0, + 0, + 3, + 3, + 0, + 4, + 0, + 6, + 5, + 3, + 0, + 1, + 4, + 0, + 5 + ], + "weighted_loads": [ + 0.0, + 0.2375467885285616, + 0.12345133349299431, + 0.0, + 0.06922799721360207, + 1.4605494812130928, + 0.32793566584587097, + 0.0, + 0.09095559269189835, + 0.0, + 0.0, + 0.020017048344016075, + 0.06780935078859329, + 0.0, + 0.37432512640953064, + 0.3283979967236519, + 0.0, + 0.0, + 0.2682834193110466, + 0.0, + 0.9160195589065552, + 0.0, + 0.08814886584877968, + 0.1653367541730404, + 0.0, + 0.0, + 0.031066063791513443, + 0.0, + 0.0, + 0.025299662724137306, + 2.245929107069969, + 0.0, + 0.0, + 0.0, + 0.03053060919046402, + 0.03055388852953911, + 0.0, + 0.2665779311209917, + 0.7378817498683929, + 0.0, + 0.04187236726284027, + 0.09767424687743187, + 0.0, + 0.25779639184474945, + 0.3054759167134762, + 0.0, + 0.0, + 0.6648523155599833, + 0.31035924702882767, + 0.0, + 0.0, + 0.23877978697419167, + 0.27179689705371857, + 0.0, + 0.18278168141841888, + 0.0, + 0.5397973544895649, + 0.22038313187658787, + 0.1182334665209055, + 0.0, + 0.05360255762934685, + 0.2485353648662567, + 0.0, + 0.18052447959780693 + ], + "unique_experts": 36, + "load_cv": 1.4532554045113477, + "normalized_load_entropy": 0.79308371192103, + "max_load_share": 0.12318840579710146 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "cb164508967335fa5a48f729a25e373f5c5d8af17030b6bc5d5c2922ad746abd", + "route_weight_sha256": "383681231a9f7c551af011b4d711f2214b5b8331669f82fa795d5651437374f7", + "loads": [ + 0, + 7, + 3, + 8, + 11, + 17, + 6, + 5, + 4, + 0, + 0, + 1, + 5, + 0, + 4, + 11, + 2, + 0, + 13, + 0, + 10, + 0, + 9, + 3, + 0, + 9, + 2, + 0, + 0, + 6, + 18, + 0, + 0, + 1, + 2, + 1, + 2, + 6, + 3, + 1, + 3, + 4, + 2, + 5, + 18, + 0, + 0, + 7, + 4, + 1, + 9, + 3, + 4, + 5, + 4, + 3, + 7, + 10, + 4, + 0, + 12, + 8, + 0, + 5 + ], + "weighted_loads": [ + 0.0, + 0.3031240180134773, + 0.12345133349299431, + 0.6021536104381084, + 0.497951403260231, + 1.5697146262973547, + 0.46009777300059795, + 0.407705320045352, + 0.1715448461472988, + 0.0, + 0.0, + 0.020017048344016075, + 0.24469479732215405, + 0.0, + 0.37432512640953064, + 0.6574711874127388, + 0.0633844118565321, + 0.0, + 1.1492387726902962, + 0.0, + 1.0647218208760023, + 0.0, + 0.6353626362979412, + 0.1653367541730404, + 0.0, + 0.6973086670041084, + 0.048506300896406174, + 0.0, + 0.0, + 0.19300051033496857, + 2.3015110790729523, + 0.0, + 0.0, + 0.023133913055062294, + 0.0707492046058178, + 0.03055388852953911, + 0.04675983265042305, + 0.3004693854600191, + 1.1021774113178253, + 0.04562459886074066, + 0.12141017057001591, + 0.20044312626123428, + 0.16100656241178513, + 0.3436429761350155, + 0.8598798010498285, + 0.0, + 0.0, + 0.6648523155599833, + 0.31035924702882767, + 0.06682904809713364, + 1.2209827974438667, + 0.23877978697419167, + 0.2997888755053282, + 0.2589643504470587, + 0.18278168141841888, + 0.4257442466914654, + 0.5910723954439163, + 0.36970782093703747, + 0.1567098293453455, + 0.0, + 1.3541996404528618, + 0.4740304499864578, + 0.0, + 0.18052447959780693 + ], + "unique_experts": 48, + "load_cv": 1.0160745087873269, + "normalized_load_entropy": 0.8726930714176236, + "max_load_share": 0.0625 + } + }, + "s1_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "3bc67ebbd95dbe3ec135cfa657dcd8fab242d28ffc100ee1a56e8efff508369b", + "route_weight_sha256": "0dca2a440abcd933e317c8351ab7e0c906f9d433689e7c451075782f14b41bc4", + "loads": [ + 0, + 5, + 2, + 0, + 4, + 14, + 2, + 0, + 1, + 0, + 1, + 0, + 1, + 0, + 5, + 6, + 0, + 0, + 5, + 0, + 6, + 0, + 2, + 3, + 0, + 0, + 1, + 0, + 0, + 1, + 17, + 0, + 0, + 0, + 1, + 0, + 0, + 5, + 2, + 0, + 1, + 1, + 0, + 3, + 5, + 1, + 0, + 7, + 4, + 0, + 0, + 3, + 3, + 0, + 3, + 0, + 7, + 5, + 3, + 0, + 1, + 4, + 0, + 3 + ], + "weighted_loads": [ + 0.0, + 0.2453862801194191, + 0.07198883220553398, + 0.0, + 0.15708115510642529, + 1.3901902176439762, + 0.316725492477417, + 0.0, + 0.0511581189930439, + 0.0, + 0.03248205780982971, + 0.0, + 0.06430725008249283, + 0.0, + 0.3857081364840269, + 0.30280299484729767, + 0.0, + 0.0, + 0.33932069689035416, + 0.0, + 0.8851718604564667, + 0.0, + 0.07297810167074203, + 0.13680201396346092, + 0.0, + 0.0, + 0.028200000524520874, + 0.0, + 0.0, + 0.0257270447909832, + 2.0791720375418663, + 0.0, + 0.0, + 0.0, + 0.03200370445847511, + 0.0, + 0.0, + 0.3342254124581814, + 0.698766864836216, + 0.0, + 0.04713549092411995, + 0.05844332277774811, + 0.0, + 0.281954750418663, + 0.3251546658575535, + 0.03785087913274765, + 0.0, + 0.6654451340436935, + 0.32576098293066025, + 0.0, + 0.0, + 0.23086732253432274, + 0.24162904173135757, + 0.0, + 0.11998742073774338, + 0.0, + 0.5452127233147621, + 0.24097670800983906, + 0.1188467126339674, + 0.0, + 0.06676701456308365, + 0.22380291670560837, + 0.0, + 0.11652334220707417 + ], + "unique_experts": 36, + "load_cv": 1.4716390478247532, + "normalized_load_entropy": 0.7885530960701687, + "max_load_share": 0.12318840579710146 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "5a7ce3aa83be94564a6436fb2634bb8c1842c99c96684548c28a452219c40130", + "route_weight_sha256": "c862dee9af581886da4bab8528dc931268e6206c300dbfdcb725bf6044af40aa", + "loads": [ + 4, + 6, + 2, + 11, + 12, + 21, + 5, + 10, + 1, + 2, + 3, + 0, + 5, + 1, + 6, + 19, + 6, + 0, + 15, + 1, + 10, + 1, + 12, + 5, + 1, + 15, + 2, + 2, + 0, + 6, + 18, + 0, + 1, + 0, + 3, + 2, + 3, + 13, + 4, + 5, + 5, + 3, + 2, + 8, + 21, + 2, + 0, + 7, + 4, + 5, + 13, + 3, + 3, + 9, + 4, + 11, + 8, + 12, + 4, + 2, + 14, + 7, + 1, + 3 + ], + "weighted_loads": [ + 0.19503278657794, + 0.2695321124047041, + 0.07198883220553398, + 0.7635049037635326, + 0.578632203862071, + 1.680460549890995, + 0.4348080325871706, + 0.6178187131881714, + 0.0511581189930439, + 0.23566818982362747, + 0.12632978707551956, + 0.0, + 0.24199623614549637, + 0.2830076515674591, + 0.4444685894995928, + 1.2589903511106968, + 0.32773798145353794, + 0.0, + 1.3251612298190594, + 0.03974062204360962, + 1.0432003494352102, + 0.03480032458901405, + 0.717936996370554, + 0.30770012363791466, + 0.01978174038231373, + 0.9721525348722935, + 0.045640237629413605, + 0.06125393509864807, + 0.0, + 0.16091345250606537, + 2.1247506327927113, + 0.0, + 0.04738996550440788, + 0.0, + 0.10157390497624874, + 0.17773085460066795, + 0.10202962718904018, + 0.6539518162608147, + 1.1058852709829807, + 0.24640849232673645, + 0.22062388993799686, + 0.15525617077946663, + 0.14180441200733185, + 0.540150873363018, + 1.2705338336527348, + 0.11068166792392731, + 0.0, + 0.6654451340436935, + 0.32576098293066025, + 0.321865763515234, + 1.4764625951647758, + 0.23086732253432274, + 0.24162904173135757, + 0.3546988796442747, + 0.14611388929188251, + 1.0900491699576378, + 0.5922255590558052, + 0.7802594099193811, + 0.15608596242964268, + 0.052520327270030975, + 1.527282813563943, + 0.4064638838171959, + 0.060637082904577255, + 0.11652334220707417 + ], + "unique_experts": 58, + "load_cv": 0.9090593428863095, + "normalized_load_entropy": 0.9033158504581192, + "max_load_share": 0.0546875 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "ordered_topk_exact_tokens": 17, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.9161490683229813, + "mean_token_weighted_tv": 0.01871303349490399, + "aggregate_load_tv": 0.05072463768115943 + }, + "system_bos": { + "tokens": 23, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.9254658385093167, + "mean_token_weighted_tv": 0.02124058307431962, + "aggregate_load_tv": 0.04347826086956522 + }, + "system_x": { + "tokens": 23, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 18, + "mean_set_jaccard": 0.9378881987577641, + "mean_token_weighted_tv": 0.023998285380556532, + "aggregate_load_tv": 0.036231884057971016 + }, + "system_period": { + "tokens": 23, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.9006211180124224, + "mean_token_weighted_tv": 0.0315611223163812, + "aggregate_load_tv": 0.057971014492753624 + }, + "bos_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8881987577639753, + "mean_token_weighted_tv": 0.02626926071293976, + "aggregate_load_tv": 0.05797101449275364 + }, + "bos_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.9006211180124224, + "mean_token_weighted_tv": 0.024332178999548374, + "aggregate_load_tv": 0.057971014492753624 + }, + "x_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.9130434782608695, + "mean_token_weighted_tv": 0.02724759361666182, + "aggregate_load_tv": 0.043478260869565216 + }, + "x_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8695652173913043, + "mean_token_weighted_tv": 0.03629782030601864, + "aggregate_load_tv": 0.07971014492753624 + }, + "period_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.9006211180124224, + "mean_token_weighted_tv": 0.026718328200766573, + "aggregate_load_tv": 0.050724637681159424 + }, + "period_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.8819875776397516, + "mean_token_weighted_tv": 0.036820952902021614, + "aggregate_load_tv": 0.07246376811594203 + } + } + }, + "layer_21": { + "layer": 21, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "059c3703c86e3a3766697a14046e1efd1cfbc4645977a0c7df6ecb4e6de9bbdf", + "route_weight_sha256": "e1f00c1c46d3ebec11ee100489cc4310d463aa7183265d869e9bbd97e1953e3e", + "loads": [ + 4, + 1, + 1, + 1, + 0, + 3, + 5, + 1, + 6, + 0, + 1, + 1, + 0, + 1, + 0, + 4, + 17, + 1, + 1, + 5, + 0, + 0, + 0, + 2, + 0, + 4, + 8, + 1, + 6, + 1, + 0, + 0, + 0, + 1, + 5, + 2, + 0, + 1, + 1, + 3, + 2, + 0, + 2, + 2, + 0, + 1, + 2, + 0, + 0, + 1, + 3, + 6, + 3, + 2, + 3, + 0, + 1, + 3, + 6, + 1, + 5, + 5, + 2, + 0 + ], + "weighted_loads": [ + 0.11632712744176388, + 0.045556388795375824, + 0.02153577096760273, + 0.05465409532189369, + 0.0, + 0.31497955322265625, + 0.4351334385573864, + 0.1620151549577713, + 0.316276241093874, + 0.0, + 0.07661160081624985, + 0.07731843739748001, + 0.0, + 0.03327427804470062, + 0.0, + 0.6716310828924179, + 2.1779279932379723, + 0.035194747149944305, + 0.032901037484407425, + 0.24962647445499897, + 0.0, + 0.0, + 0.0, + 0.07267576456069946, + 0.0, + 0.15673308447003365, + 0.5158662628382444, + 0.03788549825549126, + 0.7194672860205173, + 0.04101918265223503, + 0.0, + 0.0, + 0.0, + 0.04928075149655342, + 0.2847591135650873, + 0.07821907289326191, + 0.0, + 0.05495218560099602, + 0.031934019178152084, + 0.07864630036056042, + 0.11363157629966736, + 0.0, + 0.0641296487301588, + 0.25482213497161865, + 0.0, + 0.08994614332914352, + 0.08710072748363018, + 0.0, + 0.0, + 0.03819521144032478, + 0.10010872781276703, + 0.5381687358021736, + 0.2583457715809345, + 0.06163272447884083, + 0.1210951916873455, + 0.0, + 0.04046778380870819, + 0.20088811591267586, + 0.28966210409998894, + 0.03427085652947426, + 0.44673001021146774, + 0.16263528168201447, + 0.12421146035194397, + 0.0 + ], + "unique_experts": 46, + "load_cv": 1.265359322683065, + "normalized_load_entropy": 0.8440493711735013, + "max_load_share": 0.12318840579710146 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "1250ba1f84c52e77efa3ba2cb1511bdf73d560ca875711a7c4031677c81cbf11", + "route_weight_sha256": "f2e5dc4640d977606c6a735bb267915dea15b6333582c0ae33ec2910a65b68bd", + "loads": [ + 4, + 1, + 4, + 1, + 7, + 3, + 8, + 1, + 8, + 0, + 9, + 1, + 2, + 7, + 2, + 9, + 19, + 5, + 1, + 9, + 0, + 8, + 0, + 2, + 0, + 5, + 18, + 6, + 9, + 1, + 3, + 0, + 1, + 1, + 6, + 12, + 0, + 1, + 1, + 4, + 3, + 0, + 7, + 2, + 0, + 1, + 2, + 0, + 11, + 2, + 3, + 12, + 13, + 3, + 9, + 4, + 3, + 3, + 10, + 3, + 5, + 7, + 6, + 0 + ], + "weighted_loads": [ + 0.11632712744176388, + 0.045556388795375824, + 0.09436709946021438, + 0.05465409532189369, + 0.2590996325016022, + 0.31497955322265625, + 0.6802460476756096, + 0.1620151549577713, + 0.44347066804766655, + 0.0, + 0.5834851339459419, + 0.07731843739748001, + 0.12528500705957413, + 0.5404738560318947, + 0.0867365188896656, + 0.8295150762423873, + 2.218157242052257, + 0.15724179847165942, + 0.032901037484407425, + 1.8116585779935122, + 0.0, + 0.4801187366247177, + 0.0, + 0.07267576456069946, + 0.0, + 0.19188295304775238, + 0.9596980232745409, + 0.75586261972785, + 0.7830382850952446, + 0.04101918265223503, + 0.10944612324237823, + 0.0, + 0.022871434688568115, + 0.04928075149655342, + 0.33283392898738384, + 0.6521510276943445, + 0.0, + 0.05495218560099602, + 0.031934019178152084, + 0.1187866423279047, + 0.17354319989681244, + 0.0, + 0.3475663010030985, + 0.25482213497161865, + 0.0, + 0.08994614332914352, + 0.08710072748363018, + 0.0, + 0.6176433004438877, + 0.15934431180357933, + 0.10010872781276703, + 0.8298384994268417, + 0.8723251298069954, + 0.074645621702075, + 0.36377525981515646, + 0.3187056165188551, + 0.1110303346067667, + 0.20088811591267586, + 0.4570349399000406, + 0.1379696950316429, + 0.44673001021146774, + 0.24887797608971596, + 0.3303978852927685, + 0.0 + ], + "unique_experts": 54, + "load_cv": 0.9678472994546858, + "normalized_load_entropy": 0.8883688502261889, + "max_load_share": 0.06597222222222222 + } + }, + "s1_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "2a0456072acd068fbe4c6d24a3a3cac445d745071121944e9aab91c70beae53b", + "route_weight_sha256": "ceb570a5865e667fc8fa512fee5e165949e6cd7b514a8e1a2cc33a6895ab81c4", + "loads": [ + 5, + 3, + 1, + 1, + 0, + 3, + 5, + 1, + 6, + 0, + 1, + 1, + 0, + 2, + 0, + 4, + 17, + 2, + 0, + 4, + 0, + 1, + 0, + 2, + 0, + 4, + 8, + 1, + 6, + 0, + 0, + 0, + 0, + 1, + 5, + 1, + 0, + 1, + 1, + 4, + 3, + 0, + 1, + 2, + 0, + 1, + 1, + 0, + 0, + 1, + 2, + 6, + 3, + 2, + 3, + 0, + 2, + 3, + 6, + 1, + 4, + 4, + 2, + 0 + ], + "weighted_loads": [ + 0.1480236928910017, + 0.12020476162433624, + 0.022526223212480545, + 0.0602903738617897, + 0.0, + 0.310810849070549, + 0.43219172209501266, + 0.1455211639404297, + 0.33044290356338024, + 0.0, + 0.08042865991592407, + 0.07438144087791443, + 0.0, + 0.05364673025906086, + 0.0, + 0.6725563704967499, + 2.152914971113205, + 0.04995034635066986, + 0.0, + 0.23087723925709724, + 0.0, + 0.06436070054769516, + 0.0, + 0.07586975023150444, + 0.0, + 0.14520061761140823, + 0.5298938620835543, + 0.03229992836713791, + 0.7084526382386684, + 0.0, + 0.0, + 0.0, + 0.0, + 0.057439327239990234, + 0.2730733174830675, + 0.05239993706345558, + 0.0, + 0.06448591500520706, + 0.029579302296042442, + 0.10125694796442986, + 0.14990262687206268, + 0.0, + 0.03870350494980812, + 0.26418736949563026, + 0.0, + 0.08650092780590057, + 0.06474904716014862, + 0.0, + 0.0, + 0.038104623556137085, + 0.06853558495640755, + 0.5569538082927465, + 0.2622007057070732, + 0.059238675981760025, + 0.12551473826169968, + 0.0, + 0.0826822817325592, + 0.19934815168380737, + 0.280152577906847, + 0.04207119345664978, + 0.36322101578116417, + 0.1383258644491434, + 0.12297447398304939, + 0.0 + ], + "unique_experts": 45, + "load_cv": 1.2600363730526467, + "normalized_load_entropy": 0.8431064737687594, + "max_load_share": 0.12318840579710146 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "6c064c8733166d071b6f2d61fbfb0ef82299bb1c9d6fa9043e40e071d3144222", + "route_weight_sha256": "9f11054ee42a286395af9bd69ce04f24d11db62e1f1423876d7e542b639285ec", + "loads": [ + 13, + 5, + 4, + 1, + 1, + 4, + 11, + 2, + 10, + 3, + 12, + 1, + 4, + 12, + 6, + 7, + 19, + 11, + 2, + 8, + 1, + 9, + 1, + 7, + 1, + 7, + 16, + 11, + 9, + 1, + 6, + 0, + 1, + 5, + 5, + 18, + 1, + 2, + 2, + 5, + 3, + 2, + 10, + 3, + 1, + 2, + 1, + 0, + 11, + 5, + 3, + 16, + 13, + 3, + 16, + 9, + 6, + 3, + 9, + 6, + 4, + 7, + 6, + 1 + ], + "weighted_loads": [ + 0.6585770398378372, + 0.2040729895234108, + 0.716818327549845, + 0.0602903738617897, + 0.02982361800968647, + 0.3260897845029831, + 0.6851827539503574, + 0.22521885484457016, + 0.49137433245778084, + 0.1762995906174183, + 0.6462576538324356, + 0.07438144087791443, + 0.21587104722857475, + 0.7664057221263647, + 0.2386880125850439, + 0.7600054303184152, + 2.211462247185409, + 0.3644752139225602, + 0.054021913558244705, + 1.7641804330050945, + 0.04726748540997505, + 0.5426165917888284, + 0.030741719529032707, + 0.5760142151266336, + 0.03550385683774948, + 0.24150430969893932, + 0.8231101967394352, + 1.161403615027666, + 0.7437460962682962, + 0.04878450557589531, + 0.25382988527417183, + 0.0, + 0.022810837253928185, + 0.6503004431724548, + 0.2730733174830675, + 0.9719462618231773, + 0.07117611169815063, + 0.10482069849967957, + 0.08403524197638035, + 0.13908902928233147, + 0.14990262687206268, + 0.12920241430401802, + 0.5216433554887772, + 0.3126922585070133, + 0.06788554042577744, + 0.14503181353211403, + 0.06474904716014862, + 0.0, + 0.823096077889204, + 0.9637154117226601, + 0.11999788880348206, + 1.288020571693778, + 0.8384085521101952, + 0.0722515732049942, + 0.9006073968484998, + 0.587842158973217, + 0.2364690639078617, + 0.19934815168380737, + 0.4182320311665535, + 0.2968674786388874, + 0.36322101578116417, + 0.29491117037832737, + 0.30295053496956825, + 0.09215760976076126 + ], + "unique_experts": 62, + "load_cv": 0.8074092656281708, + "normalized_load_entropy": 0.9214855040852579, + "max_load_share": 0.049479166666666664 + } + }, + "s0_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "a4692ddc168e10668160d1ed90729fdaa8d089cb1f280b6b36d663a6a89c418a", + "route_weight_sha256": "7d4da9b5f50af99b312e56ba7cfa02289d0590e0a0d796a296e8af2ee7594e6f", + "loads": [ + 3, + 1, + 1, + 1, + 0, + 3, + 5, + 1, + 7, + 0, + 1, + 1, + 0, + 2, + 0, + 4, + 17, + 3, + 1, + 5, + 0, + 1, + 0, + 1, + 0, + 3, + 8, + 2, + 6, + 2, + 0, + 0, + 0, + 1, + 5, + 2, + 0, + 1, + 1, + 2, + 3, + 0, + 1, + 2, + 0, + 1, + 2, + 0, + 0, + 1, + 2, + 6, + 3, + 2, + 2, + 0, + 1, + 3, + 6, + 0, + 4, + 6, + 2, + 0 + ], + "weighted_loads": [ + 0.08438731357455254, + 0.050288330763578415, + 0.02310638502240181, + 0.06447888165712357, + 0.0, + 0.30455735325813293, + 0.4477539584040642, + 0.12790562212467194, + 0.3340523224323988, + 0.0, + 0.07589808106422424, + 0.07592900842428207, + 0.0, + 0.06283547356724739, + 0.0, + 0.6938785277307034, + 2.293060339987278, + 0.08611709624528885, + 0.03648059442639351, + 0.2426085714250803, + 0.0, + 0.06836617738008499, + 0.0, + 0.03976650908589363, + 0.0, + 0.11522539332509041, + 0.5153410602360964, + 0.07295214757323265, + 0.7485730536282063, + 0.0766238197684288, + 0.0, + 0.0, + 0.0, + 0.06177163124084473, + 0.2830566167831421, + 0.07700086198747158, + 0.0, + 0.04894528165459633, + 0.03055376000702381, + 0.05196535401046276, + 0.15670166537165642, + 0.0, + 0.034909822046756744, + 0.2746221013367176, + 0.0, + 0.08826605975627899, + 0.08478028699755669, + 0.0, + 0.0, + 0.0374547615647316, + 0.0785570740699768, + 0.5409599747508764, + 0.2871916629374027, + 0.06026894226670265, + 0.10428444668650627, + 0.0, + 0.04008527845144272, + 0.19935910403728485, + 0.300151102244854, + 0.0, + 0.3854069299995899, + 0.1964087374508381, + 0.1277211382985115, + 0.0 + ], + "unique_experts": 46, + "load_cv": 1.2680124181346109, + "normalized_load_entropy": 0.8450311453187994, + "max_load_share": 0.12318840579710146 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "daa6c9911bcee37a10ff9ad91060cb7b76154ea9e4a84a544054d2bba578c2c0", + "route_weight_sha256": "03c4466d06cf5b746e62b6a25150c0c76614e9332f2a900ba6a26e2756a5c606", + "loads": [ + 3, + 3, + 3, + 2, + 6, + 3, + 7, + 1, + 10, + 0, + 7, + 1, + 2, + 8, + 2, + 9, + 18, + 5, + 2, + 7, + 0, + 8, + 0, + 1, + 0, + 4, + 18, + 7, + 8, + 2, + 2, + 3, + 1, + 1, + 6, + 12, + 0, + 1, + 1, + 5, + 6, + 0, + 6, + 2, + 0, + 3, + 2, + 0, + 12, + 3, + 2, + 12, + 13, + 3, + 7, + 3, + 3, + 3, + 9, + 2, + 4, + 8, + 6, + 0 + ], + "weighted_loads": [ + 0.08438731357455254, + 0.13338495790958405, + 0.09343884326517582, + 0.2564831003546715, + 0.22705943509936333, + 0.30455735325813293, + 0.6318453401327133, + 0.12790562212467194, + 0.4833191428333521, + 0.0, + 0.4823242761194706, + 0.07592900842428207, + 0.12528500705957413, + 0.4998466297984123, + 0.06888753920793533, + 0.8786556124687195, + 2.3063597856089473, + 0.16640742868185043, + 0.08921584114432335, + 0.8218527194112539, + 0.0, + 0.5447535421699286, + 0.0, + 0.03976650908589363, + 0.0, + 0.15037526190280914, + 0.9591728206723928, + 0.739585604518652, + 0.8077379409223795, + 0.0766238197684288, + 0.08546502515673637, + 0.2433544583618641, + 0.022871434688568115, + 0.06177163124084473, + 0.3311314322054386, + 0.6509328167885542, + 0.0, + 0.04894528165459633, + 0.03055376000702381, + 0.17564173229038715, + 0.3426815904676914, + 0.0, + 0.32117144763469696, + 0.2746221013367176, + 0.0, + 0.2493470050394535, + 0.08478028699755669, + 0.0, + 0.6697758994996548, + 0.20070885121822357, + 0.0785570740699768, + 0.8326297383755445, + 0.9011710211634636, + 0.07328183948993683, + 0.26319611351937056, + 0.29087795689702034, + 0.12035107985138893, + 0.19935910403728485, + 0.3984269741922617, + 0.08235926181077957, + 0.3854069299995899, + 0.31010929122567177, + 0.33055512979626656, + 0.0 + ], + "unique_experts": 55, + "load_cv": 0.931280811902234, + "normalized_load_entropy": 0.8981767721414983, + "max_load_share": 0.0625 + } + }, + "s1_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "0b4cb950549d147f39fc3bd6c6bfaeda8b020969b855371fdf869fc3e433a774", + "route_weight_sha256": "897db59fa1edf3a5539c56f7153219ddf41dcd2f1a415d04cf0b77aaf9b644ac", + "loads": [ + 5, + 1, + 1, + 1, + 0, + 3, + 5, + 1, + 5, + 0, + 1, + 1, + 0, + 2, + 0, + 4, + 17, + 2, + 0, + 4, + 0, + 1, + 0, + 1, + 0, + 4, + 7, + 2, + 5, + 2, + 0, + 0, + 0, + 1, + 5, + 1, + 0, + 1, + 1, + 4, + 3, + 0, + 1, + 2, + 0, + 1, + 2, + 0, + 0, + 1, + 3, + 6, + 3, + 3, + 2, + 0, + 1, + 3, + 8, + 0, + 4, + 5, + 2, + 0 + ], + "weighted_loads": [ + 0.14547552168369293, + 0.05075044929981232, + 0.021734047681093216, + 0.07512837648391724, + 0.0, + 0.2800416573882103, + 0.44657282903790474, + 0.11620918661355972, + 0.28629007935523987, + 0.0, + 0.06788626313209534, + 0.07387751340866089, + 0.0, + 0.06778774596750736, + 0.0, + 0.7015147358179092, + 2.1930001750588417, + 0.057683611288666725, + 0.0, + 0.22558197379112244, + 0.0, + 0.06445755064487457, + 0.0, + 0.03867124393582344, + 0.0, + 0.14516820199787617, + 0.4596465080976486, + 0.07219618000090122, + 0.7104114964604378, + 0.07969891279935837, + 0.0, + 0.0, + 0.0, + 0.06548091769218445, + 0.27664644084870815, + 0.05022505298256874, + 0.0, + 0.05953020229935646, + 0.028862906619906425, + 0.10282430797815323, + 0.1359695941209793, + 0.0, + 0.03702382370829582, + 0.3258805423974991, + 0.0, + 0.09201604872941971, + 0.08458684012293816, + 0.0, + 0.0, + 0.0393708199262619, + 0.09650375880300999, + 0.5337182767689228, + 0.29390374943614006, + 0.09863195195794106, + 0.10732278227806091, + 0.0, + 0.03559047356247902, + 0.19770875200629234, + 0.3360584583133459, + 0.0, + 0.37382639572024345, + 0.17828777432441711, + 0.12155704200267792, + 0.0 + ], + "unique_experts": 45, + "load_cv": 1.2600363730526467, + "normalized_load_entropy": 0.8431655548499997, + "max_load_share": 0.12318840579710146 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "b5ac3a8aa4ba64ff7860159e2dd8065ff4762cbd3bc23d0385e81a281ddc470e", + "route_weight_sha256": "71e7d11bec25f0a248d59eb7c35edd6c5077e27b3e7f515340a32dbfe5ffaaa6", + "loads": [ + 13, + 4, + 3, + 1, + 5, + 4, + 11, + 3, + 9, + 3, + 10, + 2, + 4, + 12, + 5, + 8, + 18, + 8, + 3, + 7, + 1, + 8, + 1, + 6, + 1, + 7, + 15, + 13, + 7, + 3, + 6, + 1, + 1, + 6, + 5, + 18, + 1, + 2, + 2, + 5, + 4, + 2, + 10, + 3, + 1, + 2, + 2, + 0, + 11, + 5, + 4, + 16, + 13, + 4, + 14, + 9, + 5, + 3, + 10, + 4, + 4, + 8, + 7, + 1 + ], + "weighted_loads": [ + 0.6560288686305285, + 0.1866876222193241, + 0.7133566122502089, + 0.07512837648391724, + 0.20112236589193344, + 0.2953205928206444, + 0.744613990187645, + 0.2323922961950302, + 0.4550038259476423, + 0.1762995906174183, + 0.5663679465651512, + 0.12144973501563072, + 0.21587104722857475, + 0.7515861410647631, + 0.19605118967592716, + 0.8669469244778156, + 2.206299620680511, + 0.309052424505353, + 0.11603429168462753, + 0.8188745006918907, + 0.04726748540997505, + 0.5365915279835463, + 0.030741719529032707, + 0.5388157088309526, + 0.03550385683774948, + 0.24147189408540726, + 0.7528628427535295, + 1.2240538243204355, + 0.7413576953113079, + 0.12848341837525368, + 0.25606438145041466, + 0.09350644052028656, + 0.022810837253928185, + 0.6959480494260788, + 0.27664644084870815, + 0.9697713777422905, + 0.07117611169815063, + 0.09986498579382896, + 0.08331884630024433, + 0.1356954425573349, + 0.18222613260149956, + 0.12920241430401802, + 0.5057156346738338, + 0.37438543140888214, + 0.06788554042577744, + 0.15054693445563316, + 0.08458684012293816, + 0.0, + 0.8492716141045094, + 1.0173912048339844, + 0.1479660626500845, + 1.2647850401699543, + 0.870111595839262, + 0.11164484918117523, + 0.8578703822568059, + 0.588558953255415, + 0.18937725573778152, + 0.19770875200629234, + 0.39396865852177143, + 0.20396332815289497, + 0.37382639572024345, + 0.34832504019141197, + 0.36522191390395164, + 0.09215760976076126 + ], + "unique_experts": 63, + "load_cv": 0.7540400446189107, + "normalized_load_entropy": 0.9333176938762796, + "max_load_share": 0.046875 + } + }, + "s0_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "02a79e0ec45367d31525f15a8bc66ea302222e677f36224417a6f9175957c7e3", + "route_weight_sha256": "c4ba3fb3ab3cd6f825acd0788dc735403f8b6cabfd6259b8376dd65c8adcff9e", + "loads": [ + 4, + 1, + 1, + 1, + 0, + 3, + 5, + 1, + 5, + 0, + 1, + 1, + 0, + 2, + 0, + 4, + 17, + 3, + 1, + 5, + 0, + 1, + 0, + 1, + 0, + 4, + 8, + 2, + 5, + 2, + 0, + 1, + 0, + 1, + 5, + 2, + 0, + 1, + 1, + 2, + 2, + 0, + 1, + 2, + 0, + 1, + 1, + 0, + 0, + 1, + 2, + 6, + 3, + 3, + 4, + 0, + 1, + 3, + 6, + 0, + 5, + 4, + 2, + 0 + ], + "weighted_loads": [ + 0.11327066645026207, + 0.046116430312395096, + 0.024429358541965485, + 0.05759507045149803, + 0.0, + 0.2921473830938339, + 0.44284458830952644, + 0.13011740148067474, + 0.2635412570089102, + 0.0, + 0.07108726352453232, + 0.07940331101417542, + 0.0, + 0.06372005864977837, + 0.0, + 0.6516740508377552, + 2.244186021387577, + 0.08089901693165302, + 0.036782629787921906, + 0.2773714028298855, + 0.0, + 0.06318242102861404, + 0.0, + 0.039570603519678116, + 0.0, + 0.1663848552852869, + 0.46978992968797684, + 0.06767783686518669, + 0.6527312137186527, + 0.07834521308541298, + 0.0, + 0.027301790192723274, + 0.0, + 0.062284570187330246, + 0.27048905193805695, + 0.08175498060882092, + 0.0, + 0.04734772443771362, + 0.028656085953116417, + 0.0539209321141243, + 0.10504330322146416, + 0.0, + 0.03687141090631485, + 0.29673227295279503, + 0.0, + 0.09370338916778564, + 0.06100798770785332, + 0.0, + 0.0, + 0.03552107885479927, + 0.0761717613786459, + 0.5820615962147713, + 0.2894166260957718, + 0.08127722702920437, + 0.15747565031051636, + 0.0, + 0.03575228899717331, + 0.20100734010338783, + 0.2824128419160843, + 0.0, + 0.4288541227579117, + 0.14393836073577404, + 0.1305714137852192, + 0.0 + ], + "unique_experts": 47, + "load_cv": 1.2385158235059268, + "normalized_load_entropy": 0.85149477822227, + "max_load_share": 0.12318840579710146 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "2b658412f3dd7e8100ddb2635c44dbb1211289723f6f28bdb73e9c62cab26e14", + "route_weight_sha256": "81eff931dd27b0f04cb0c2de9ae06bc233ac10cc5bd63bbb8c0c35521c72d298", + "loads": [ + 4, + 2, + 4, + 1, + 7, + 3, + 7, + 1, + 7, + 0, + 10, + 1, + 3, + 7, + 2, + 8, + 21, + 7, + 1, + 7, + 0, + 7, + 0, + 1, + 0, + 6, + 18, + 7, + 8, + 2, + 1, + 2, + 1, + 1, + 6, + 13, + 0, + 1, + 1, + 2, + 3, + 0, + 8, + 2, + 0, + 1, + 1, + 0, + 14, + 3, + 2, + 12, + 14, + 4, + 9, + 3, + 4, + 3, + 7, + 1, + 5, + 6, + 6, + 0 + ], + "weighted_loads": [ + 0.11327066645026207, + 0.0853506550192833, + 0.1447624508291483, + 0.05759507045149803, + 0.27863094583153725, + 0.2921473830938339, + 0.6402678042650223, + 0.13011740148067474, + 0.38441150821745396, + 0.0, + 0.632160134613514, + 0.07940331101417542, + 0.15753313526511192, + 0.4218064770102501, + 0.07297582179307938, + 0.7837382815778255, + 2.384718588553369, + 0.22818065993487835, + 0.036782629787921906, + 0.8566155508160591, + 0.0, + 0.5008932519704103, + 0.0, + 0.039570603519678116, + 0.0, + 0.2422186527401209, + 0.9136216901242733, + 0.761714693158865, + 0.7545088734477758, + 0.07834521308541298, + 0.03229473531246185, + 0.09152022935450077, + 0.022871434688568115, + 0.062284570187330246, + 0.31856386736035347, + 0.7501702662557364, + 0.0, + 0.04734772443771362, + 0.028656085953116417, + 0.0539209321141243, + 0.14796316623687744, + 0.0, + 0.40800612419843674, + 0.29673227295279503, + 0.0, + 0.09370338916778564, + 0.06100798770785332, + 0.0, + 0.7810185439884663, + 0.21587250754237175, + 0.0761717613786459, + 0.8737313598394394, + 1.0946505852043629, + 0.09429012425243855, + 0.3221325119957328, + 0.31356069818139076, + 0.18334055319428444, + 0.20100734010338783, + 0.306955398991704, + 0.04285867139697075, + 0.4288541227579117, + 0.23199204541742802, + 0.30510663613677025, + 0.0 + ], + "unique_experts": 55, + "load_cv": 1.0076865081787252, + "normalized_load_entropy": 0.8849073199032179, + "max_load_share": 0.07291666666666667 + } + }, + "s1_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "af3ecb45a9c31c088f5d6c4d5ef6afebd91109c64237932a368a1653741224ff", + "route_weight_sha256": "ccb65ce274c66ea037b6a0f6b758551106b1043c1d6de1f8d8cde01b67778460", + "loads": [ + 6, + 1, + 1, + 1, + 0, + 3, + 5, + 1, + 5, + 0, + 1, + 1, + 0, + 2, + 0, + 4, + 17, + 0, + 1, + 8, + 0, + 0, + 0, + 1, + 0, + 3, + 7, + 1, + 6, + 2, + 0, + 0, + 0, + 1, + 6, + 2, + 0, + 1, + 0, + 2, + 3, + 0, + 1, + 2, + 0, + 1, + 1, + 0, + 1, + 1, + 2, + 6, + 5, + 1, + 2, + 0, + 1, + 3, + 6, + 1, + 5, + 5, + 2, + 0 + ], + "weighted_loads": [ + 0.1982622817158699, + 0.04851962625980377, + 0.024199049919843674, + 0.0676860511302948, + 0.0, + 0.2822934165596962, + 0.420632092282176, + 0.09441032260656357, + 0.27839956246316433, + 0.0, + 0.06761473417282104, + 0.0754685029387474, + 0.0, + 0.06625902466475964, + 0.0, + 0.6528007499873638, + 2.1468550488352776, + 0.0, + 0.03941056504845619, + 0.3736604917794466, + 0.0, + 0.0, + 0.0, + 0.04127230867743492, + 0.0, + 0.12841008976101875, + 0.4136245884001255, + 0.022846607491374016, + 0.7263122946023941, + 0.07823838293552399, + 0.0, + 0.0, + 0.0, + 0.0647326186299324, + 0.2814635504037142, + 0.07343537174165249, + 0.0, + 0.05118666589260101, + 0.0, + 0.05595304071903229, + 0.16341836750507355, + 0.0, + 0.03841663897037506, + 0.2938191890716553, + 0.0, + 0.09498719871044159, + 0.06154464930295944, + 0.0, + 0.029867637902498245, + 0.03583827242255211, + 0.07280582748353481, + 0.6125977374613285, + 0.35012310184538364, + 0.025492684915661812, + 0.0917883887887001, + 0.0, + 0.02991083264350891, + 0.19465965777635574, + 0.29155214317142963, + 0.034222088754177094, + 0.42188478261232376, + 0.17500845715403557, + 0.11543207988142967, + 0.0 + ], + "unique_experts": 45, + "load_cv": 1.3122946324162235, + "normalized_load_entropy": 0.8323929889821928, + "max_load_share": 0.12318840579710146 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "a48de5ebc20e68bd1422909882e30583ee2833364748979fba53196fb940e7eb", + "route_weight_sha256": "3dad7196a663c7df5ff32c63b0fd07c2f8958e3a385908207aaad86d68bcd953", + "loads": [ + 15, + 3, + 4, + 1, + 2, + 4, + 8, + 2, + 8, + 3, + 11, + 1, + 7, + 12, + 6, + 7, + 19, + 5, + 4, + 11, + 1, + 6, + 1, + 8, + 1, + 8, + 15, + 11, + 8, + 3, + 6, + 0, + 1, + 5, + 6, + 20, + 1, + 2, + 1, + 2, + 3, + 3, + 13, + 3, + 1, + 2, + 1, + 0, + 15, + 5, + 3, + 16, + 16, + 2, + 15, + 9, + 5, + 3, + 8, + 4, + 5, + 8, + 4, + 1 + ], + "weighted_loads": [ + 0.7434702683240175, + 0.14783188328146935, + 0.7451196927577257, + 0.0676860511302948, + 0.1106446124613285, + 0.2975723519921303, + 0.5279606748372316, + 0.17410801351070404, + 0.4036303348839283, + 0.1762995906174183, + 0.6063103526830673, + 0.0754685029387474, + 0.3315825127065182, + 0.733018210157752, + 0.23151110112667084, + 0.7722646705806255, + 2.2087226836010814, + 0.20985083281993866, + 0.14485466480255127, + 0.9669530186802149, + 0.04726748540997505, + 0.43462502025067806, + 0.030741719529032707, + 0.6508627440780401, + 0.03550385683774948, + 0.321514243260026, + 0.7068409230560064, + 1.1024242397397757, + 0.7572584934532642, + 0.1270228885114193, + 0.23488782718777657, + 0.0, + 0.022810837253928185, + 0.657593734562397, + 0.2814635504037142, + 1.0634759683161974, + 0.07117611169815063, + 0.09152144938707352, + 0.054455939680337906, + 0.05595304071903229, + 0.16341836750507355, + 0.21004555746912956, + 0.6498036310076714, + 0.34232407808303833, + 0.06788554042577744, + 0.15351808443665504, + 0.06154464930295944, + 0.0, + 1.1073251850903034, + 0.9687860272824764, + 0.12426813133060932, + 1.34366450086236, + 1.1243651453405619, + 0.03850558213889599, + 0.860015076585114, + 0.6137208268046379, + 0.18369761481881142, + 0.19465965777635574, + 0.35325303114950657, + 0.20158230140805244, + 0.42188478261232376, + 0.32818615064024925, + 0.1815888099372387, + 0.09215760976076126 + ], + "unique_experts": 62, + "load_cv": 0.840593375076334, + "normalized_load_entropy": 0.9183236865447622, + "max_load_share": 0.052083333333333336 + } + }, + "s0_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "02967516f46ef1b873cd334c8335431c0a92c089b84f7cb7bebfabd54c130603", + "route_weight_sha256": "9164cf202bdc3c241c98ff6ca91945ffed35bc98f37cd070514e3e3a629c731c", + "loads": [ + 3, + 1, + 1, + 1, + 0, + 3, + 5, + 1, + 5, + 0, + 1, + 1, + 0, + 2, + 0, + 4, + 17, + 1, + 1, + 7, + 0, + 1, + 0, + 1, + 0, + 4, + 8, + 1, + 5, + 2, + 0, + 1, + 0, + 1, + 5, + 2, + 0, + 1, + 1, + 3, + 2, + 0, + 2, + 2, + 0, + 1, + 1, + 0, + 0, + 1, + 3, + 6, + 3, + 2, + 4, + 0, + 1, + 3, + 6, + 1, + 5, + 3, + 2, + 0 + ], + "weighted_loads": [ + 0.08345069736242294, + 0.046966928988695145, + 0.022919941693544388, + 0.05687535181641579, + 0.0, + 0.28936246782541275, + 0.45303336158394814, + 0.12031231820583344, + 0.27583965100347996, + 0.0, + 0.07132253795862198, + 0.07924391329288483, + 0.0, + 0.062180208042263985, + 0.0, + 0.6794897057116032, + 2.244586031883955, + 0.031947530806064606, + 0.03493902459740639, + 0.3592518549412489, + 0.0, + 0.06303867697715759, + 0.0, + 0.04165519028902054, + 0.0, + 0.15084097534418106, + 0.4882761389017105, + 0.03338871896266937, + 0.6521900855004787, + 0.0793076865375042, + 0.0, + 0.025331322103738785, + 0.0, + 0.05427578091621399, + 0.2727976217865944, + 0.08025355823338032, + 0.0, + 0.05091269314289093, + 0.02970360964536667, + 0.08232237957417965, + 0.10984599962830544, + 0.0, + 0.06494101695716381, + 0.2472245693206787, + 0.0, + 0.09438086301088333, + 0.06259511411190033, + 0.0, + 0.0, + 0.034808866679668427, + 0.10643953830003738, + 0.5836134105920792, + 0.30120810493826866, + 0.05164122022688389, + 0.16096732579171658, + 0.0, + 0.035906609147787094, + 0.20012926310300827, + 0.2894445136189461, + 0.035229962319135666, + 0.4322974272072315, + 0.11828915402293205, + 0.13737376779317856, + 0.0 + ], + "unique_experts": 48, + "load_cv": 1.2493224376617578, + "normalized_load_entropy": 0.8520363011880994, + "max_load_share": 0.12318840579710146 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "38924450be168feecd79d0671d355c277b22006f9566446cdb023af5b8bf6735", + "route_weight_sha256": "2cf7545b6cc0f03dd8ce4b21ca8bac7b89b1a1181f4bcb482ccfd81773112d78", + "loads": [ + 3, + 2, + 4, + 1, + 6, + 3, + 9, + 1, + 7, + 0, + 8, + 1, + 3, + 9, + 2, + 8, + 18, + 5, + 1, + 9, + 0, + 9, + 0, + 1, + 0, + 6, + 18, + 6, + 8, + 2, + 1, + 2, + 1, + 1, + 6, + 13, + 0, + 1, + 1, + 3, + 4, + 0, + 7, + 2, + 0, + 2, + 1, + 0, + 13, + 3, + 3, + 13, + 13, + 3, + 9, + 4, + 3, + 3, + 7, + 3, + 5, + 5, + 6, + 0 + ], + "weighted_loads": [ + 0.08345069736242294, + 0.08367269858717918, + 0.14272108115255833, + 0.05687535181641579, + 0.2282540425658226, + 0.28936246782541275, + 0.7679734118282795, + 0.12031231820583344, + 0.40071408636868, + 0.0, + 0.5415028147399426, + 0.07924391329288483, + 0.16326060891151428, + 0.47146456129848957, + 0.07749957963824272, + 0.8282836899161339, + 2.2578854775056243, + 0.1993064098060131, + 0.03493902459740639, + 0.9384960029274225, + 0.0, + 0.5837801415473223, + 0.0, + 0.04165519028902054, + 0.0, + 0.22810877114534378, + 0.932107899338007, + 0.7220251858234406, + 0.7487973440438509, + 0.0793076865375042, + 0.029087642207741737, + 0.09711195155978203, + 0.022871434688568115, + 0.05427578091621399, + 0.3208724372088909, + 0.7041043359786272, + 0.0, + 0.05091269314289093, + 0.02970360964536667, + 0.08232237957417965, + 0.19253400340676308, + 0.0, + 0.3562262784689665, + 0.2472245693206787, + 0.0, + 0.13684750348329544, + 0.06259511411190033, + 0.0, + 0.7441411949694157, + 0.26635707169771194, + 0.10643953830003738, + 0.9463994204998016, + 0.9151874631643295, + 0.06465411745011806, + 0.32722014654427767, + 0.38269440457224846, + 0.12459307163953781, + 0.20012926310300827, + 0.3139870706945658, + 0.158347487449646, + 0.4322974272072315, + 0.20633875206112862, + 0.3134695999324322, + 0.0 + ], + "unique_experts": 55, + "load_cv": 0.9622504486493764, + "normalized_load_entropy": 0.8917074566698105, + "max_load_share": 0.0625 + } + }, + "s1_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "18209c5e375ead89b523ec247f753184d5b65a886a20e5dad38c12ad8222697f", + "route_weight_sha256": "6bffc1c0f96ffc640f86a1a2e71b2f6c9f898aa7e06daadf7ecaf63241557fc5", + "loads": [ + 6, + 1, + 1, + 1, + 0, + 3, + 5, + 1, + 6, + 0, + 1, + 1, + 0, + 2, + 0, + 4, + 17, + 0, + 1, + 8, + 0, + 1, + 0, + 1, + 0, + 3, + 7, + 1, + 6, + 2, + 0, + 0, + 1, + 1, + 4, + 3, + 0, + 1, + 1, + 1, + 3, + 0, + 1, + 2, + 0, + 1, + 2, + 0, + 0, + 0, + 2, + 6, + 4, + 1, + 2, + 0, + 1, + 3, + 6, + 1, + 4, + 5, + 3, + 0 + ], + "weighted_loads": [ + 0.2023160643875599, + 0.048783015459775925, + 0.022547177970409393, + 0.06785009056329727, + 0.0, + 0.29175327718257904, + 0.43564241379499435, + 0.09547916799783707, + 0.31321756541728973, + 0.0, + 0.06890875846147537, + 0.07505645602941513, + 0.0, + 0.06382249109447002, + 0.0, + 0.664520762860775, + 2.115424569696188, + 0.0, + 0.040983155369758606, + 0.4054099041968584, + 0.0, + 0.06100950017571449, + 0.0, + 0.042356327176094055, + 0.0, + 0.12443732470273972, + 0.4346869997680187, + 0.025918660685420036, + 0.698887050151825, + 0.0793721117079258, + 0.0, + 0.0, + 0.024443410336971283, + 0.05717255920171738, + 0.20732047595083714, + 0.11430137418210506, + 0.0, + 0.054731085896492004, + 0.02740444801747799, + 0.03160874918103218, + 0.17626068368554115, + 0.0, + 0.039090171456336975, + 0.29437730833888054, + 0.0, + 0.08668461441993713, + 0.09518121927976608, + 0.0, + 0.0, + 0.0, + 0.07037682086229324, + 0.6190032325685024, + 0.28316996060311794, + 0.025195369496941566, + 0.09719756618142128, + 0.0, + 0.031185336410999298, + 0.188098955899477, + 0.2900713961571455, + 0.036092426627874374, + 0.35921356827020645, + 0.1887172870337963, + 0.15156850591301918, + 0.0 + ], + "unique_experts": 46, + "load_cv": 1.2916450696407764, + "normalized_load_entropy": 0.8388170788601923, + "max_load_share": 0.12318840579710146 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "89ba768d963018e59e68e43ab135e7db3aa582a21d172d1a9b307dc3132ed527", + "route_weight_sha256": "3bc4eb099fd447e430d7520f747a8336e2a75190369e06193202a35a1917f5ba", + "loads": [ + 14, + 3, + 4, + 1, + 3, + 4, + 9, + 2, + 9, + 3, + 9, + 1, + 6, + 14, + 6, + 7, + 20, + 5, + 5, + 12, + 1, + 7, + 1, + 8, + 1, + 6, + 15, + 11, + 8, + 3, + 5, + 0, + 2, + 6, + 4, + 22, + 1, + 2, + 2, + 1, + 3, + 2, + 13, + 3, + 1, + 2, + 2, + 0, + 13, + 4, + 3, + 17, + 14, + 2, + 15, + 10, + 5, + 3, + 7, + 5, + 4, + 8, + 4, + 1 + ], + "weighted_loads": [ + 0.7128694113343954, + 0.14968827366828918, + 0.7512005586177111, + 0.06785009056329727, + 0.12238015979528427, + 0.3070322126150131, + 0.6120990328490734, + 0.17517685890197754, + 0.4384483378380537, + 0.1762995906174183, + 0.5454713255167007, + 0.07505645602941513, + 0.30827686563134193, + 0.7967671044170856, + 0.2464999295771122, + 0.7838683724403381, + 2.2243815762922168, + 0.20985083281993866, + 0.18648239597678185, + 1.0278657488524914, + 0.04726748540997505, + 0.49563452042639256, + 0.030741719529032707, + 0.6505449991673231, + 0.03550385683774948, + 0.2207410167902708, + 0.7279033344238997, + 1.0763663705438375, + 0.7298332490026951, + 0.1281566172838211, + 0.2100885771214962, + 0.0, + 0.04725424759089947, + 0.6773801557719707, + 0.20732047595083714, + 1.120508810505271, + 0.07117611169815063, + 0.09506586939096451, + 0.0818603876978159, + 0.03160874918103218, + 0.17626068368554115, + 0.12920241430401802, + 0.6992085836827755, + 0.3428821973502636, + 0.06788554042577744, + 0.1452155001461506, + 0.09518121927976608, + 0.0, + 0.9453201182186604, + 1.035982072353363, + 0.12183912470936775, + 1.4153332971036434, + 0.8593778070062399, + 0.03820826672017574, + 0.8955380143597722, + 0.6498093232512474, + 0.1849721185863018, + 0.188098955899477, + 0.31493830867111683, + 0.27240994572639465, + 0.35921356827020645, + 0.33296414464712143, + 0.18816499412059784, + 0.09215760976076126 + ], + "unique_experts": 62, + "load_cv": 0.8513673642376062, + "normalized_load_entropy": 0.9185348123394391, + "max_load_share": 0.057291666666666664 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 12, + "mean_set_jaccard": 0.8540372670807455, + "mean_token_weighted_tv": 0.025736050356341446, + "aggregate_load_tv": 0.06521739130434784 + }, + "system_bos": { + "tokens": 23, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8881987577639753, + "mean_token_weighted_tv": 0.024069292592289654, + "aggregate_load_tv": 0.06521739130434782 + }, + "system_x": { + "tokens": 23, + "ordered_topk_exact_tokens": 8, + "set_exact_tokens": 11, + "mean_set_jaccard": 0.8322981366459629, + "mean_token_weighted_tv": 0.0336620767965265, + "aggregate_load_tv": 0.09420289855072464 + }, + "system_period": { + "tokens": 23, + "ordered_topk_exact_tokens": 8, + "set_exact_tokens": 12, + "mean_set_jaccard": 0.8354037267080746, + "mean_token_weighted_tv": 0.03733010594125675, + "aggregate_load_tv": 0.10144927536231883 + }, + "bos_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 11, + "mean_set_jaccard": 0.8509316770186335, + "mean_token_weighted_tv": 0.029709107728432053, + "aggregate_load_tv": 0.06521739130434782 + }, + "bos_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 12, + "mean_set_jaccard": 0.8633540372670808, + "mean_token_weighted_tv": 0.03163905125921187, + "aggregate_load_tv": 0.06521739130434781 + }, + "x_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 12, + "mean_set_jaccard": 0.8633540372670809, + "mean_token_weighted_tv": 0.03122036300761544, + "aggregate_load_tv": 0.06521739130434781 + }, + "x_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 3, + "set_exact_tokens": 9, + "mean_set_jaccard": 0.7981366459627329, + "mean_token_weighted_tv": 0.04575045759101277, + "aggregate_load_tv": 0.10869565217391304 + }, + "period_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8881987577639753, + "mean_token_weighted_tv": 0.027270972971682964, + "aggregate_load_tv": 0.05072463768115942 + }, + "period_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 4, + "set_exact_tokens": 10, + "mean_set_jaccard": 0.8198757763975155, + "mean_token_weighted_tv": 0.04158066030915664, + "aggregate_load_tv": 0.10869565217391303 + } + } + }, + "layer_22": { + "layer": 22, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "851b40d4fbc77da293646a00cff4a4f8fb8fe03d9db13ff68459af2876602a44", + "route_weight_sha256": "4dcd8d6d7d1f35bd25a6d3c86043b729a27a3128aa4aa9945b1ce11e84174dfa", + "loads": [ + 1, + 0, + 2, + 1, + 1, + 2, + 0, + 0, + 22, + 0, + 4, + 2, + 0, + 0, + 11, + 4, + 1, + 0, + 2, + 1, + 4, + 0, + 1, + 0, + 1, + 0, + 0, + 0, + 1, + 4, + 0, + 4, + 4, + 2, + 1, + 8, + 0, + 3, + 0, + 5, + 1, + 0, + 0, + 5, + 1, + 2, + 0, + 1, + 1, + 2, + 0, + 0, + 0, + 1, + 4, + 0, + 3, + 2, + 4, + 1, + 2, + 9, + 0, + 7 + ], + "weighted_loads": [ + 0.02771659754216671, + 0.0, + 0.3378155082464218, + 0.02135366201400757, + 0.036629583686590195, + 0.072383351624012, + 0.0, + 0.0, + 3.4553859159350395, + 0.0, + 0.16912253573536873, + 0.08473793044686317, + 0.0, + 0.0, + 0.9305396843701601, + 0.23632558807730675, + 0.021829815581440926, + 0.0, + 0.1273995265364647, + 0.04633726552128792, + 0.2438524179160595, + 0.0, + 0.0705978274345398, + 0.0, + 0.035384662449359894, + 0.0, + 0.0, + 0.0, + 0.03485722839832306, + 0.2616062220185995, + 0.0, + 0.3167508579790592, + 0.23445207253098488, + 0.051557447761297226, + 0.033082813024520874, + 0.4790922701358795, + 0.0, + 0.14734119176864624, + 0.0, + 0.3471774682402611, + 0.032593026757240295, + 0.0, + 0.0, + 0.18664653785526752, + 0.06404957920312881, + 0.23715515434741974, + 0.0, + 0.03044843301177025, + 0.051797669380903244, + 0.10385183058679104, + 0.0, + 0.0, + 0.0, + 0.03227957710623741, + 0.6358037814497948, + 0.0, + 0.08362370170652866, + 0.06859338283538818, + 0.5462688654661179, + 0.0468011312186718, + 0.09411431103944778, + 0.44855863973498344, + 0.0, + 0.47863863222301006 + ], + "unique_experts": 41, + "load_cv": 1.5859470020463253, + "normalized_load_entropy": 0.7945715775359565, + "max_load_share": 0.15942028985507245 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "a19d641f2b66fbb8f67b306a4a897f0a2930ed501afba02ffe3dc6211847453f", + "route_weight_sha256": "a5b3c86359206bb63100fde35444ee08ea1cd2c8cbba6ce243a94f7fb43f1deb", + "loads": [ + 5, + 1, + 5, + 10, + 1, + 4, + 4, + 1, + 37, + 5, + 4, + 6, + 0, + 0, + 16, + 4, + 1, + 2, + 2, + 1, + 4, + 7, + 2, + 1, + 1, + 1, + 0, + 4, + 1, + 4, + 0, + 4, + 7, + 7, + 3, + 11, + 0, + 5, + 0, + 5, + 4, + 1, + 5, + 5, + 1, + 3, + 0, + 1, + 3, + 5, + 4, + 0, + 0, + 2, + 4, + 15, + 7, + 4, + 4, + 1, + 11, + 16, + 0, + 16 + ], + "weighted_loads": [ + 0.20174530614167452, + 0.04782187566161156, + 0.4420550875365734, + 1.897215485572815, + 0.036629583686590195, + 0.14612472709268332, + 0.23070279974490404, + 0.07952167838811874, + 4.863271849229932, + 0.18824944831430912, + 0.16912253573536873, + 0.2405331889167428, + 0.0, + 0.0, + 1.351780727505684, + 0.23632558807730675, + 0.021829815581440926, + 0.06537546217441559, + 0.1273995265364647, + 0.04633726552128792, + 0.2438524179160595, + 0.6502199321985245, + 0.09900654666125774, + 0.03360389918088913, + 0.035384662449359894, + 0.026248497888445854, + 0.0, + 0.17731526866555214, + 0.03485722839832306, + 0.2616062220185995, + 0.0, + 0.3167508579790592, + 0.30968298576772213, + 0.22570418566465378, + 0.12735652923583984, + 0.6392569094896317, + 0.0, + 0.22201144322752953, + 0.0, + 0.3471774682402611, + 0.1677837986499071, + 0.04125182703137398, + 0.3099103681743145, + 0.18664653785526752, + 0.06404957920312881, + 0.26975222304463387, + 0.0, + 0.03044843301177025, + 0.14763979613780975, + 0.3376896549016237, + 0.19258377514779568, + 0.0, + 0.0, + 0.07200274616479874, + 0.6358037814497948, + 1.196579939685762, + 0.24621871672570705, + 0.1327157635241747, + 0.5462688654661179, + 0.0468011312186718, + 1.4634885042905807, + 0.6989934388548136, + 0.0, + 0.918777834624052 + ], + "unique_experts": 54, + "load_cv": 1.2741494379088572, + "normalized_load_entropy": 0.8605329810591251, + "max_load_share": 0.1284722222222222 + } + }, + "s1_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "101132b94eaaacdabb0ba88c363fbf4381a289cce9da26eb4e170d53aa13e0a7", + "route_weight_sha256": "ca2ccfce85c8a091e2761c5fb0f077c6b98cc1fb20e531b85f952ca84893ad38", + "loads": [ + 1, + 0, + 2, + 1, + 1, + 2, + 0, + 0, + 22, + 0, + 4, + 2, + 0, + 0, + 11, + 4, + 0, + 0, + 2, + 1, + 4, + 0, + 1, + 0, + 1, + 0, + 0, + 1, + 1, + 4, + 0, + 4, + 4, + 2, + 1, + 8, + 0, + 3, + 0, + 5, + 1, + 0, + 0, + 5, + 2, + 2, + 0, + 0, + 1, + 1, + 0, + 0, + 0, + 1, + 4, + 1, + 3, + 2, + 4, + 1, + 2, + 9, + 0, + 7 + ], + "weighted_loads": [ + 0.029353218153119087, + 0.0, + 0.3316684514284134, + 0.022237097844481468, + 0.038232602179050446, + 0.07508970610797405, + 0.0, + 0.0, + 3.470626825466752, + 0.0, + 0.17075065523386002, + 0.08162172883749008, + 0.0, + 0.0, + 0.9217360280454159, + 0.22557376697659492, + 0.0, + 0.0, + 0.12268264964222908, + 0.045267678797245026, + 0.23710625618696213, + 0.0, + 0.07481076568365097, + 0.0, + 0.03649419918656349, + 0.0, + 0.0, + 0.029141634702682495, + 0.03313665837049484, + 0.25313002057373524, + 0.0, + 0.3033904992043972, + 0.2394518032670021, + 0.05000223033130169, + 0.032454002648591995, + 0.47083164751529694, + 0.0, + 0.13621803745627403, + 0.0, + 0.3399930689483881, + 0.029957396909594536, + 0.0, + 0.0, + 0.19076036289334297, + 0.09512185491621494, + 0.2259945049881935, + 0.0, + 0.0, + 0.0499187633395195, + 0.07669463753700256, + 0.0, + 0.0, + 0.0, + 0.030596952885389328, + 0.6551348343491554, + 0.023137694224715233, + 0.0981801301240921, + 0.07213806174695492, + 0.5263720992952585, + 0.04936981573700905, + 0.09332342818379402, + 0.46059953421354294, + 0.0, + 0.4884590692818165 + ], + "unique_experts": 41, + "load_cv": 1.5859470020463253, + "normalized_load_entropy": 0.7945715775359565, + "max_load_share": 0.15942028985507245 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "0446e5e001334c1697650094e9e033872bb416392c6688fc6015f09c767d5539", + "route_weight_sha256": "ffa679da854ad9047df6c80a0044bab66bab681149ea18d8005a2279fbb9a879", + "loads": [ + 3, + 4, + 2, + 12, + 1, + 4, + 5, + 1, + 44, + 9, + 4, + 9, + 3, + 0, + 16, + 8, + 3, + 3, + 3, + 1, + 5, + 14, + 2, + 2, + 1, + 1, + 0, + 4, + 2, + 4, + 1, + 4, + 6, + 12, + 9, + 14, + 2, + 5, + 0, + 6, + 11, + 1, + 4, + 7, + 2, + 3, + 1, + 2, + 4, + 5, + 10, + 3, + 5, + 3, + 4, + 22, + 7, + 4, + 7, + 1, + 17, + 19, + 1, + 12 + ], + "weighted_loads": [ + 0.15760695468634367, + 0.4306946210563183, + 0.3316684514284134, + 2.167156247422099, + 0.038232602179050446, + 0.135892772115767, + 0.2852696431800723, + 0.04178010672330856, + 5.377966571599245, + 0.4687822423875332, + 0.17075065523386002, + 0.4986554952338338, + 0.14009735733270645, + 0.0, + 1.3766657337546349, + 0.45995841175317764, + 0.1471867747604847, + 0.09639943391084671, + 0.1608121134340763, + 0.045267678797245026, + 0.28587428107857704, + 1.1652618050575256, + 0.11857869103550911, + 0.09060174413025379, + 0.03649419918656349, + 0.025535497814416885, + 0.0, + 0.16874894499778748, + 0.11705753952264786, + 0.25313002057373524, + 0.053172964602708817, + 0.3033904992043972, + 0.29477688018232584, + 0.39794163405895233, + 0.38408825173974037, + 0.7357404865324497, + 0.08945801109075546, + 0.20751742646098137, + 0.0, + 0.38894459791481495, + 0.6562998257577419, + 0.025383980944752693, + 0.31600136682391167, + 0.3294572941958904, + 0.09512185491621494, + 0.26259011402726173, + 0.033966828137636185, + 0.06637953221797943, + 0.1779811941087246, + 0.6163292117416859, + 0.493806017562747, + 0.20989754423499107, + 0.5453501455485821, + 0.11985380947589874, + 0.6551348343491554, + 1.7569050826132298, + 0.3088567554950714, + 0.14324664138257504, + 0.5998578378930688, + 0.04936981573700905, + 2.2654460705816746, + 0.8895717151463032, + 0.030640659853816032, + 0.8254706263542175 + ], + "unique_experts": 61, + "load_cv": 1.1388041973930374, + "normalized_load_entropy": 0.88868000216685, + "max_load_share": 0.11458333333333333 + } + }, + "s0_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "38b8f4d8b969c148aa8e9fbeeaaec3a74d2dc0bec6f6f59da13c03ca8e18fec0", + "route_weight_sha256": "83c748a45bd316cbe8a44f8044fa2b7c6d435eba0a16e6c006b061ccc7a9d6af", + "loads": [ + 1, + 0, + 2, + 0, + 1, + 2, + 1, + 0, + 22, + 0, + 3, + 2, + 0, + 0, + 8, + 4, + 1, + 0, + 2, + 1, + 4, + 0, + 1, + 0, + 2, + 0, + 0, + 1, + 1, + 4, + 1, + 3, + 4, + 2, + 1, + 7, + 0, + 3, + 0, + 5, + 1, + 0, + 0, + 5, + 2, + 2, + 0, + 1, + 1, + 2, + 0, + 0, + 0, + 1, + 4, + 1, + 4, + 3, + 5, + 1, + 2, + 9, + 0, + 5 + ], + "weighted_loads": [ + 0.026871584355831146, + 0.0, + 0.3593590557575226, + 0.0, + 0.03742227330803871, + 0.06803257018327713, + 0.03336385637521744, + 0.0, + 3.371022617444396, + 0.0, + 0.14219960197806358, + 0.08013249933719635, + 0.0, + 0.0, + 0.8140971139073372, + 0.2440503127872944, + 0.02734909951686859, + 0.0, + 0.13168548420071602, + 0.04674574360251427, + 0.2643807530403137, + 0.0, + 0.07526671141386032, + 0.0, + 0.07005173340439796, + 0.0, + 0.0, + 0.029102180153131485, + 0.035906706005334854, + 0.274599339812994, + 0.025681745260953903, + 0.27330270037055016, + 0.2557900436222553, + 0.051671648398041725, + 0.029797738417983055, + 0.4676668122410774, + 0.0, + 0.15204324573278427, + 0.0, + 0.39154503494501114, + 0.03193139657378197, + 0.0, + 0.0, + 0.19685715436935425, + 0.08551616780459881, + 0.22600439935922623, + 0.0, + 0.02882506512105465, + 0.05196508765220642, + 0.09573661163449287, + 0.0, + 0.0, + 0.0, + 0.030552860349416733, + 0.6672345288097858, + 0.02525198459625244, + 0.1215619184076786, + 0.10067740455269814, + 0.5978136323392391, + 0.05181683227419853, + 0.10952429100871086, + 0.4426501579582691, + 0.0, + 0.43561094254255295 + ], + "unique_experts": 44, + "load_cv": 1.4987917839360487, + "normalized_load_entropy": 0.8179105773569827, + "max_load_share": 0.15942028985507245 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "69fd6e586a7f0ca833ea4a9ac8d632a922305b33b829bee6468aa1b479d3b242", + "route_weight_sha256": "bfc629d21e4c4c523c289d6b5628609e74401e3ed20de9f008f8fc3de1397050", + "loads": [ + 6, + 1, + 5, + 8, + 1, + 3, + 4, + 1, + 35, + 5, + 4, + 6, + 0, + 0, + 11, + 5, + 1, + 1, + 2, + 1, + 4, + 7, + 2, + 0, + 4, + 1, + 0, + 5, + 1, + 5, + 1, + 3, + 6, + 8, + 3, + 11, + 0, + 5, + 0, + 5, + 5, + 1, + 5, + 5, + 2, + 3, + 0, + 1, + 4, + 5, + 3, + 0, + 0, + 2, + 4, + 15, + 8, + 6, + 5, + 1, + 12, + 16, + 0, + 14 + ], + "weighted_loads": [ + 0.23416307475417852, + 0.04555397480726242, + 0.4635986350476742, + 0.9850540161132812, + 0.03742227330803871, + 0.08063848596066236, + 0.25294043868780136, + 0.9181379675865173, + 4.631742957979441, + 0.18824944831430912, + 0.15832146257162094, + 0.25613059382885695, + 0.0, + 0.0, + 1.1614776216447353, + 0.2863953933119774, + 0.02734909951686859, + 0.025755219161510468, + 0.13168548420071602, + 0.04674574360251427, + 0.2643807530403137, + 0.6390606313943863, + 0.10367543064057827, + 0.0, + 0.09962353063747287, + 0.026248497888445854, + 0.0, + 0.21373188123106956, + 0.035906706005334854, + 0.3185627795755863, + 0.025681745260953903, + 0.27330270037055016, + 0.32447531446814537, + 0.2655233684927225, + 0.12151391245424747, + 0.6648804806172848, + 0.0, + 0.2635618522763252, + 0.0, + 0.39154503494501114, + 0.20434975624084473, + 0.07362374663352966, + 0.21194221265614033, + 0.19685715436935425, + 0.08551616780459881, + 0.25860146805644035, + 0.0, + 0.02882506512105465, + 0.24798034131526947, + 0.28521567350253463, + 0.14723502844572067, + 0.0, + 0.0, + 0.07027602940797806, + 0.6672345288097858, + 1.1974042234942317, + 0.284156933426857, + 0.17909768410027027, + 0.5978136323392391, + 0.05181683227419853, + 1.53466210141778, + 0.6930849570780993, + 0.0, + 0.8056175913661718 + ], + "unique_experts": 54, + "load_cv": 1.1934750588300465, + "normalized_load_entropy": 0.8712959569935957, + "max_load_share": 0.12152777777777778 + } + }, + "s1_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "996caebc895946dd77b1abdabb74c063095bcdfbcbcb7d598328fe0c204b1011", + "route_weight_sha256": "833854c2f2a9c83a679e0fca3f829a518be4ba5bbcf513b97a116d1b78fd9ae5", + "loads": [ + 1, + 0, + 2, + 0, + 1, + 2, + 1, + 0, + 22, + 0, + 4, + 1, + 0, + 0, + 9, + 4, + 1, + 0, + 2, + 1, + 4, + 0, + 1, + 0, + 2, + 0, + 0, + 1, + 1, + 4, + 0, + 3, + 4, + 2, + 1, + 7, + 0, + 3, + 0, + 4, + 1, + 0, + 0, + 5, + 2, + 2, + 0, + 0, + 1, + 2, + 0, + 0, + 0, + 1, + 4, + 1, + 4, + 2, + 5, + 1, + 2, + 9, + 0, + 8 + ], + "weighted_loads": [ + 0.026433240622282028, + 0.0, + 0.35534997284412384, + 0.0, + 0.041649892926216125, + 0.06753415055572987, + 0.03497365117073059, + 0.0, + 3.340958772227168, + 0.0, + 0.1720952857285738, + 0.05672992765903473, + 0.0, + 0.0, + 0.8048953860998154, + 0.2330089993774891, + 0.023841792717576027, + 0.0, + 0.12653402611613274, + 0.04547804221510887, + 0.23681355267763138, + 0.0, + 0.08172731846570969, + 0.0, + 0.06934083253145218, + 0.0, + 0.0, + 0.030404219403862953, + 0.033520374447107315, + 0.2730733323842287, + 0.0, + 0.27039456367492676, + 0.25480829924345016, + 0.050735775381326675, + 0.03088831529021263, + 0.48917000740766525, + 0.0, + 0.14556441828608513, + 0.0, + 0.3484264276921749, + 0.029157867655158043, + 0.0, + 0.0, + 0.19230343028903008, + 0.07978397235274315, + 0.22216949611902237, + 0.0, + 0.0, + 0.05959007516503334, + 0.09537198767066002, + 0.0, + 0.0, + 0.0, + 0.031789444386959076, + 0.6600774079561234, + 0.023040946573019028, + 0.12642256915569305, + 0.06902683340013027, + 0.6320780124515295, + 0.05376459285616875, + 0.10409166291356087, + 0.44219426810741425, + 0.0, + 0.532257804647088 + ], + "unique_experts": 42, + "load_cv": 1.5473347751964477, + "normalized_load_entropy": 0.8036590446760886, + "max_load_share": 0.15942028985507245 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "0f857eae477f14da0c1e68e1c7fca764849b703a8701bd3814247f8d0f961c85", + "route_weight_sha256": "7448b4d3e2b7249bb525e39b19e191a00fbbf5a43bb004b3ed850fbdf1d5058e", + "loads": [ + 5, + 4, + 2, + 10, + 1, + 3, + 5, + 1, + 44, + 9, + 4, + 9, + 3, + 0, + 13, + 9, + 4, + 3, + 3, + 1, + 5, + 12, + 2, + 0, + 2, + 1, + 0, + 5, + 2, + 4, + 0, + 3, + 5, + 11, + 9, + 14, + 2, + 5, + 0, + 5, + 12, + 1, + 4, + 7, + 2, + 2, + 1, + 2, + 7, + 5, + 10, + 3, + 5, + 4, + 4, + 21, + 8, + 4, + 8, + 1, + 18, + 19, + 1, + 15 + ], + "weighted_loads": [ + 0.2189578553661704, + 0.4306946210563183, + 0.35534997284412384, + 1.2498438879847527, + 0.041649892926216125, + 0.0801400663331151, + 0.31036556512117386, + 0.04178010672330856, + 5.185996986925602, + 0.4687822423875332, + 0.1720952857285738, + 0.5386709766462445, + 0.14009735733270645, + 0.0, + 1.3226285614073277, + 0.5084980018436909, + 0.17102856747806072, + 0.08705583587288857, + 0.16466348990797997, + 0.04547804221510887, + 0.2855815775692463, + 1.0499352850019932, + 0.12549524381756783, + 0.0, + 0.06934083253145218, + 0.025535497814416885, + 0.0, + 0.22138247825205326, + 0.11744125559926033, + 0.2730733323842287, + 0.0, + 0.27039456367492676, + 0.30409956723451614, + 0.37034716829657555, + 0.38435176759958267, + 0.8090939968824387, + 0.08945801109075546, + 0.23160604387521744, + 0.0, + 0.39737795665860176, + 0.6909690015017986, + 0.025383980944752693, + 0.30029255524277687, + 0.33100036159157753, + 0.07978397235274315, + 0.22216949611902237, + 0.033966828137636185, + 0.06637953221797943, + 0.3839505761861801, + 0.6255129687488079, + 0.4800651166588068, + 0.20989754423499107, + 0.5453501455485821, + 0.1724126674234867, + 0.6600774079561234, + 1.728473343886435, + 0.33709919452667236, + 0.1422573011368513, + 0.7387632373720407, + 0.05376459285616875, + 2.4062148965895176, + 0.8711664490401745, + 0.030640659853816032, + 0.9571177083998919 + ], + "unique_experts": 59, + "load_cv": 1.1323065201417661, + "normalized_load_entropy": 0.8869022822285867, + "max_load_share": 0.11458333333333333 + } + }, + "s0_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "1d4eb2766f60f386e2b9cbc56f2cd02f33a605e29a4574af3eb5f1c81eacb80c", + "route_weight_sha256": "f65fd53ed21f3a594ca40db778d00847e9506c73238c02a137aa9a88527d2adf", + "loads": [ + 0, + 0, + 2, + 0, + 1, + 0, + 1, + 0, + 22, + 0, + 5, + 1, + 0, + 0, + 8, + 4, + 1, + 0, + 2, + 1, + 4, + 0, + 1, + 0, + 1, + 0, + 0, + 1, + 1, + 4, + 0, + 3, + 4, + 2, + 1, + 9, + 0, + 3, + 0, + 6, + 1, + 0, + 0, + 4, + 1, + 2, + 0, + 1, + 1, + 1, + 1, + 0, + 0, + 1, + 4, + 1, + 4, + 2, + 4, + 1, + 2, + 11, + 0, + 8 + ], + "weighted_loads": [ + 0.0, + 0.0, + 0.37357833981513977, + 0.0, + 0.035778868943452835, + 0.0, + 0.03821595013141632, + 0.0, + 3.469931736588478, + 0.0, + 0.1929089669138193, + 0.051345448940992355, + 0.0, + 0.0, + 0.793788293376565, + 0.23325122892856598, + 0.023419609293341637, + 0.0, + 0.1341027393937111, + 0.047850653529167175, + 0.2421741709113121, + 0.0, + 0.06832432001829147, + 0.0, + 0.031070170924067497, + 0.0, + 0.0, + 0.02787673845887184, + 0.03853481262922287, + 0.24792836979031563, + 0.0, + 0.28492144495248795, + 0.22775998711585999, + 0.05228300206363201, + 0.03436595946550369, + 0.5040552876889706, + 0.0, + 0.1546926014125347, + 0.0, + 0.41038371436297894, + 0.032720763236284256, + 0.0, + 0.0, + 0.17393514141440392, + 0.06053955852985382, + 0.22176045924425125, + 0.0, + 0.026658009737730026, + 0.038318779319524765, + 0.06357929855585098, + 0.03212006762623787, + 0.0, + 0.0, + 0.02181864343583584, + 0.6483965404331684, + 0.028189176693558693, + 0.12206292152404785, + 0.06880582496523857, + 0.5228586625307798, + 0.049013901501894, + 0.10454690828919411, + 0.5576796140521765, + 0.0, + 0.4534659627825022 + ], + "unique_experts": 42, + "load_cv": 1.6049047905353981, + "normalized_load_entropy": 0.7918558165752235, + "max_load_share": 0.15942028985507245 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "cb3daa54775dc07d744fc1b3a3da7f77614eb9b7ee793fe9d8081ab9eae854e2", + "route_weight_sha256": "0cd9bf5c7a738769e835159916bec5e613fd00d991f78d017cd50b26e7f24475", + "loads": [ + 4, + 1, + 5, + 9, + 1, + 2, + 5, + 0, + 36, + 6, + 5, + 4, + 0, + 0, + 11, + 4, + 1, + 2, + 2, + 1, + 4, + 8, + 2, + 0, + 1, + 1, + 0, + 4, + 1, + 4, + 1, + 3, + 6, + 9, + 2, + 11, + 0, + 5, + 0, + 6, + 5, + 1, + 5, + 4, + 1, + 3, + 0, + 2, + 3, + 4, + 4, + 0, + 0, + 2, + 4, + 18, + 8, + 3, + 4, + 1, + 11, + 19, + 0, + 19 + ], + "weighted_loads": [ + 0.1740287085995078, + 0.040210798382759094, + 0.47781791910529137, + 1.0724176615476608, + 0.035778868943452835, + 0.06248565297573805, + 0.3280557319521904, + 0.0, + 4.8026794623583555, + 0.2187318466603756, + 0.1929089669138193, + 0.1781878238543868, + 0.0, + 0.0, + 1.1479499507695436, + 0.23325122892856598, + 0.023419609293341637, + 0.06462948396801949, + 0.1341027393937111, + 0.047850653529167175, + 0.2421741709113121, + 0.7128796651959419, + 0.09673303924500942, + 0.0, + 0.031070170924067497, + 0.026248497888445854, + 0.0, + 0.17874310538172722, + 0.03853481262922287, + 0.24792836979031563, + 0.043721847236156464, + 0.28492144495248795, + 0.29644525796175003, + 0.3128816280514002, + 0.09106037765741348, + 0.5984810441732407, + 0.0, + 0.22558336332440376, + 0.0, + 0.41038371436297894, + 0.2173420749604702, + 0.07610935717821121, + 0.3253736011683941, + 0.17393514141440392, + 0.06053955852985382, + 0.2543575279414654, + 0.0, + 0.05383187346160412, + 0.11531272903084755, + 0.39208365976810455, + 0.20491262525320053, + 0.0, + 0.0, + 0.06154181249439716, + 0.6483965404331684, + 1.4308975646272302, + 0.28465793654322624, + 0.09447630308568478, + 0.5228586625307798, + 0.049013901501894, + 1.4988612718880177, + 0.8619935363531113, + 0.0, + 0.8749617338180542 + ], + "unique_experts": 53, + "load_cv": 1.3052600138300812, + "normalized_load_entropy": 0.8529598342114566, + "max_load_share": 0.125 + } + }, + "s1_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "c2a67055e0d0426c5c7899f0917a8c921bbb54bc4de405d3b324ae1813fb15e6", + "route_weight_sha256": "655dda02e7dceebb8c092aa6ec0f927ba1fa584cb43e740edc4b1335cd739e06", + "loads": [ + 1, + 1, + 2, + 1, + 1, + 0, + 0, + 0, + 22, + 0, + 4, + 1, + 0, + 0, + 6, + 4, + 1, + 0, + 2, + 1, + 4, + 0, + 1, + 0, + 1, + 0, + 0, + 1, + 1, + 4, + 0, + 4, + 4, + 2, + 0, + 8, + 0, + 3, + 0, + 5, + 1, + 0, + 0, + 4, + 1, + 2, + 0, + 1, + 1, + 1, + 0, + 1, + 0, + 1, + 4, + 1, + 4, + 3, + 3, + 1, + 2, + 14, + 0, + 8 + ], + "weighted_loads": [ + 0.03741636872291565, + 0.02470337599515915, + 0.35850411653518677, + 0.022303394973278046, + 0.038144733756780624, + 0.0, + 0.0, + 0.0, + 3.284994602203369, + 0.0, + 0.16212761402130127, + 0.047018975019454956, + 0.0, + 0.0, + 0.7960830740630627, + 0.21568184345960617, + 0.02153218537569046, + 0.0, + 0.13585073128342628, + 0.046462852507829666, + 0.23235905170440674, + 0.0, + 0.07750876992940903, + 0.0, + 0.03595062717795372, + 0.0, + 0.0, + 0.027314655482769012, + 0.03833063319325447, + 0.22620856575667858, + 0.0, + 0.3117196261882782, + 0.23426049202680588, + 0.04770033620297909, + 0.0, + 0.4877378884702921, + 0.0, + 0.13530947640538216, + 0.0, + 0.37971336767077446, + 0.031698912382125854, + 0.0, + 0.0, + 0.1726268883794546, + 0.05886690691113472, + 0.2236165851354599, + 0.0, + 0.032323334366083145, + 0.02792111039161682, + 0.057766128331422806, + 0.0, + 0.024733353406190872, + 0.0, + 0.02095094695687294, + 0.6487734280526638, + 0.031088562682271004, + 0.11388618126511574, + 0.09228689968585968, + 0.4725678451359272, + 0.050991240888834, + 0.0960160568356514, + 0.7542547937482595, + 0.0, + 0.4630136154592037 + ], + "unique_experts": 43, + "load_cv": 1.6215701042583928, + "normalized_load_entropy": 0.7949055948445728, + "max_load_share": 0.15942028985507245 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "15586f24fa94acf1cfe79716be4352569c3b7ead3bde2929f0fae6e8dd7b9a05", + "route_weight_sha256": "fa3b461ea0281c193d858fcc30b0b0c6927c57a7a4fab89083e2551b8c8361cb", + "loads": [ + 3, + 5, + 2, + 12, + 1, + 1, + 6, + 1, + 44, + 10, + 4, + 6, + 3, + 0, + 10, + 8, + 4, + 2, + 3, + 1, + 5, + 14, + 2, + 0, + 1, + 1, + 0, + 3, + 2, + 4, + 0, + 4, + 5, + 11, + 8, + 14, + 2, + 6, + 0, + 6, + 13, + 1, + 4, + 6, + 1, + 2, + 1, + 3, + 4, + 5, + 11, + 4, + 5, + 5, + 4, + 26, + 8, + 5, + 5, + 1, + 17, + 26, + 1, + 12 + ], + "weighted_loads": [ + 0.16567010525614023, + 0.45539799705147743, + 0.35850411653518677, + 1.3225255087018013, + 0.038144733756780624, + 0.012605915777385235, + 0.36154792457818985, + 0.04178010672330856, + 5.12652082927525, + 0.5134791918098927, + 0.16212761402130127, + 0.390922368504107, + 0.14009735733270645, + 0.0, + 1.1787203177809715, + 0.4500664882361889, + 0.16871896013617516, + 0.050170935690402985, + 0.1739801950752735, + 0.046462852507829666, + 0.28112707659602165, + 1.1859455816447735, + 0.12127669528126717, + 0.0, + 0.03595062717795372, + 0.025535497814416885, + 0.0, + 0.1485552415251732, + 0.12225151434540749, + 0.22620856575667858, + 0.0, + 0.3117196261882782, + 0.28355176001787186, + 0.36731172911822796, + 0.3498340342193842, + 0.7609181646257639, + 0.08945801109075546, + 0.26462163403630257, + 0.0, + 0.4286648966372013, + 0.741388464346528, + 0.025383980944752693, + 0.3562872000038624, + 0.31132381968200207, + 0.05886690691113472, + 0.2236165851354599, + 0.033966828137636185, + 0.09870286658406258, + 0.15598354116082191, + 0.6244447231292725, + 0.5253144595772028, + 0.23463089764118195, + 0.5453501455485821, + 0.1909557729959488, + 0.6487734280526638, + 2.1120031913742423, + 0.32456280663609505, + 0.15242040157318115, + 0.5410229898989201, + 0.050991240888834, + 2.2235387042164803, + 1.3472179342061281, + 0.030640659853816032, + 0.7027462385594845 + ], + "unique_experts": 59, + "load_cv": 1.2047360245667467, + "normalized_load_entropy": 0.8754356021726655, + "max_load_share": 0.11458333333333333 + } + }, + "s0_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "88a81a1d016fbc70354d914846950c2a2b6e19f71657b5bbf196cf915cd845ca", + "route_weight_sha256": "5dd64bbbfc7c96e5c1b659bff72efb62c1bf6908b3f3bdf6944e1afc035e09e4", + "loads": [ + 1, + 0, + 2, + 0, + 1, + 0, + 0, + 0, + 22, + 0, + 5, + 1, + 0, + 0, + 8, + 4, + 1, + 0, + 2, + 1, + 4, + 0, + 1, + 0, + 1, + 0, + 0, + 1, + 1, + 4, + 0, + 4, + 4, + 2, + 1, + 8, + 0, + 3, + 0, + 6, + 1, + 0, + 0, + 5, + 2, + 2, + 0, + 1, + 1, + 2, + 0, + 0, + 0, + 1, + 4, + 1, + 5, + 2, + 4, + 1, + 2, + 9, + 0, + 7 + ], + "weighted_loads": [ + 0.02861967124044895, + 0.0, + 0.3519470989704132, + 0.0, + 0.03322290629148483, + 0.0, + 0.0, + 0.0, + 3.4625982977449894, + 0.0, + 0.18574851378798485, + 0.047388266772031784, + 0.0, + 0.0, + 0.8369135055691004, + 0.22950222715735435, + 0.022911790758371353, + 0.0, + 0.13676057755947113, + 0.04727734625339508, + 0.24599259346723557, + 0.0, + 0.067975252866745, + 0.0, + 0.029999900609254837, + 0.0, + 0.0, + 0.02990945428609848, + 0.040739934891462326, + 0.2605221029371023, + 0.0, + 0.31055402383208275, + 0.24158329144120216, + 0.0494530126452446, + 0.03223853558301926, + 0.5071262679994106, + 0.0, + 0.15604184195399284, + 0.0, + 0.41484042443335056, + 0.02948894537985325, + 0.0, + 0.0, + 0.19627478532493114, + 0.08439120464026928, + 0.21833888441324234, + 0.0, + 0.02822134830057621, + 0.037927113473415375, + 0.08932176232337952, + 0.0, + 0.0, + 0.0, + 0.03014550171792507, + 0.6543969139456749, + 0.023157792165875435, + 0.16057586297392845, + 0.06786961480975151, + 0.5220904368907213, + 0.050329167395830154, + 0.12299678847193718, + 0.45178290642797947, + 0.0, + 0.4549952708184719 + ], + "unique_experts": 41, + "load_cv": 1.5603116896274505, + "normalized_load_entropy": 0.7966116981016691, + "max_load_share": 0.15942028985507245 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "b8b0c1c208294c6705e39b73a01b647341210add653119c67710246fb0edc261", + "route_weight_sha256": "26e5cd0de0ebe29f370ec89b12effb3e4b5fe6ed1a6bb40f40feb2738b9df906", + "loads": [ + 5, + 1, + 6, + 8, + 1, + 2, + 3, + 0, + 36, + 5, + 5, + 4, + 0, + 0, + 12, + 4, + 1, + 3, + 2, + 1, + 4, + 8, + 2, + 0, + 1, + 1, + 0, + 5, + 1, + 4, + 0, + 4, + 6, + 7, + 2, + 10, + 0, + 5, + 0, + 6, + 7, + 1, + 5, + 5, + 2, + 3, + 0, + 1, + 4, + 5, + 4, + 0, + 0, + 3, + 4, + 16, + 9, + 4, + 4, + 1, + 12, + 16, + 0, + 17 + ], + "weighted_loads": [ + 0.20264837983995676, + 0.09348878264427185, + 0.48453071899712086, + 0.9850540161132812, + 0.03322290629148483, + 0.06946740206331015, + 0.21957658231258392, + 0.0, + 4.775934034958482, + 0.18824944831430912, + 0.18574851378798485, + 0.17091458197683096, + 0.0, + 0.0, + 1.226939482614398, + 0.22950222715735435, + 0.022911790758371353, + 0.13732649758458138, + 0.13676057755947113, + 0.04727734625339508, + 0.24599259346723557, + 0.7389607131481171, + 0.09638397209346294, + 0.0, + 0.029999900609254837, + 0.026248497888445854, + 0.0, + 0.18820134177803993, + 0.040739934891462326, + 0.2605221029371023, + 0.0, + 0.31055402383208275, + 0.3102685622870922, + 0.22359975054860115, + 0.08893295377492905, + 0.6117933616042137, + 0.0, + 0.2544570714235306, + 0.0, + 0.41484042443335056, + 0.28533922508358955, + 0.09308652579784393, + 0.2856586314737797, + 0.19627478532493114, + 0.08439120464026928, + 0.25093595311045647, + 0.0, + 0.02822134830057621, + 0.15918414667248726, + 0.3518988825380802, + 0.24613568931818008, + 0.0, + 0.0, + 0.12635616771876812, + 0.6543969139456749, + 1.3150365659967065, + 0.32317087799310684, + 0.1195103470236063, + 0.5220904368907213, + 0.050329167395830154, + 1.6176533363759518, + 0.7022177055478096, + 0.0, + 0.8323205877095461 + ], + "unique_experts": 52, + "load_cv": 1.2515422584520899, + "normalized_load_entropy": 0.859848124049253, + "max_load_share": 0.125 + } + }, + "s1_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "cacdead97ed0d03d142da952d3818e54a225d2df45637fff7f4344efd0e4abf0", + "route_weight_sha256": "bfd2e9e6901afa131742842050f451bea8f6dbb855090be3bf47aa564c561b22", + "loads": [ + 1, + 0, + 2, + 1, + 1, + 1, + 1, + 0, + 22, + 0, + 5, + 1, + 0, + 0, + 6, + 4, + 2, + 0, + 2, + 1, + 4, + 0, + 1, + 0, + 1, + 0, + 0, + 0, + 1, + 4, + 0, + 4, + 4, + 1, + 0, + 8, + 0, + 3, + 0, + 5, + 1, + 0, + 0, + 4, + 2, + 2, + 0, + 1, + 1, + 1, + 0, + 1, + 0, + 0, + 4, + 1, + 4, + 2, + 5, + 1, + 2, + 12, + 0, + 8 + ], + "weighted_loads": [ + 0.03941696509718895, + 0.0, + 0.36049996316432953, + 0.022431643679738045, + 0.037931445986032486, + 0.02390974760055542, + 0.03291727602481842, + 0.0, + 3.3040659055113792, + 0.0, + 0.19191009923815727, + 0.050315674394369125, + 0.0, + 0.0, + 0.8059787321835756, + 0.20833732187747955, + 0.0438736155629158, + 0.0, + 0.13463404402136803, + 0.045705150812864304, + 0.2336631938815117, + 0.0, + 0.07675231248140335, + 0.0, + 0.03699859604239464, + 0.0, + 0.0, + 0.0, + 0.03665909916162491, + 0.2230045199394226, + 0.0, + 0.3034328334033489, + 0.23811547830700874, + 0.024926654994487762, + 0.0, + 0.47717494517564774, + 0.0, + 0.1346878446638584, + 0.0, + 0.3771573193371296, + 0.02773110568523407, + 0.0, + 0.0, + 0.1777607835829258, + 0.08202514424920082, + 0.2085348144173622, + 0.0, + 0.026069292798638344, + 0.026716062799096107, + 0.05247757211327553, + 0.0, + 0.025577623397111893, + 0.0, + 0.0, + 0.6562799140810966, + 0.029350843280553818, + 0.12498894147574902, + 0.06787739135324955, + 0.5386604480445385, + 0.051459379494190216, + 0.09477660432457924, + 0.6672463454306126, + 0.0, + 0.451614685356617 + ], + "unique_experts": 42, + "load_cv": 1.5901793758519833, + "normalized_load_entropy": 0.7955987264334687, + "max_load_share": 0.15942028985507245 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "bcae09c4a70866b53b7ef315749a433531d93600f6c59efc19c66d773727c581", + "route_weight_sha256": "758e12ef4fdc3a41610baf157829fd4a8faa405db079094c75d20204398d39a2", + "loads": [ + 3, + 5, + 2, + 11, + 1, + 2, + 6, + 1, + 43, + 9, + 5, + 6, + 3, + 0, + 10, + 8, + 5, + 2, + 3, + 1, + 5, + 15, + 2, + 0, + 1, + 1, + 0, + 2, + 2, + 4, + 1, + 4, + 5, + 11, + 7, + 15, + 2, + 4, + 0, + 8, + 13, + 1, + 4, + 6, + 2, + 2, + 1, + 4, + 4, + 4, + 12, + 4, + 5, + 3, + 4, + 25, + 8, + 4, + 7, + 1, + 18, + 23, + 1, + 13 + ], + "weighted_loads": [ + 0.16767070163041353, + 0.48264239355921745, + 0.36049996316432953, + 1.2722755316644907, + 0.037931445986032486, + 0.036515663377940655, + 0.3493286147713661, + 0.04178010672330856, + 5.103434601798654, + 0.4687822423875332, + 0.19191009923815727, + 0.40390506107360125, + 0.14009735733270645, + 0.0, + 1.197454022243619, + 0.44272196665406227, + 0.1910603903234005, + 0.050170935690402985, + 0.17276350781321526, + 0.045705150812864304, + 0.2824312187731266, + 1.2394299283623695, + 0.12052023783326149, + 0.0, + 0.03699859604239464, + 0.025535497814416885, + 0.0, + 0.1038770005106926, + 0.12057998031377792, + 0.2230045199394226, + 0.040907494723796844, + 0.3034328334033489, + 0.2874067462980747, + 0.3822576068341732, + 0.3214608058333397, + 0.7792196460068226, + 0.08945801109075546, + 0.17941666021943092, + 0.0, + 0.5300849750638008, + 0.7495320420712233, + 0.025383980944752693, + 0.33553242310881615, + 0.31645771488547325, + 0.08202514424920082, + 0.2085348144173622, + 0.033966828137636185, + 0.12396484054625034, + 0.1547784935683012, + 0.5410075336694717, + 0.6152255516499281, + 0.23547516763210297, + 0.5453501455485821, + 0.1484210193157196, + 0.6562799140810966, + 2.039867968298495, + 0.3356655668467283, + 0.1264101956039667, + 0.6071155928075314, + 0.051459379494190216, + 2.3260970637202263, + 1.135966345667839, + 0.030640659853816032, + 0.7043476868420839 + ], + "unique_experts": 60, + "load_cv": 1.1726039399558574, + "normalized_load_entropy": 0.8807707235970392, + "max_load_share": 0.11197916666666667 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "ordered_topk_exact_tokens": 17, + "set_exact_tokens": 20, + "mean_set_jaccard": 0.9627329192546585, + "mean_token_weighted_tv": 0.012590399983784428, + "aggregate_load_tv": 0.021739130434782608 + }, + "system_bos": { + "tokens": 23, + "ordered_topk_exact_tokens": 17, + "set_exact_tokens": 18, + "mean_set_jaccard": 0.9378881987577641, + "mean_token_weighted_tv": 0.01864226927737827, + "aggregate_load_tv": 0.03623188405797101 + }, + "system_x": { + "tokens": 23, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 10, + "mean_set_jaccard": 0.829192546583851, + "mean_token_weighted_tv": 0.03526697352366603, + "aggregate_load_tv": 0.06521739130434782 + }, + "system_period": { + "tokens": 23, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 12, + "mean_set_jaccard": 0.8633540372670808, + "mean_token_weighted_tv": 0.034609949621169464, + "aggregate_load_tv": 0.07246376811594203 + }, + "bos_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8881987577639753, + "mean_token_weighted_tv": 0.025221619795521965, + "aggregate_load_tv": 0.06521739130434782 + }, + "bos_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.9006211180124224, + "mean_token_weighted_tv": 0.025512071164405865, + "aggregate_load_tv": 0.050724637681159424 + }, + "x_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 10, + "mean_set_jaccard": 0.8012422360248448, + "mean_token_weighted_tv": 0.03765059485221687, + "aggregate_load_tv": 0.07971014492753623 + }, + "x_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 7, + "set_exact_tokens": 9, + "mean_set_jaccard": 0.8002070393374742, + "mean_token_weighted_tv": 0.04494651698547861, + "aggregate_load_tv": 0.08695652173913043 + }, + "period_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 12, + "mean_set_jaccard": 0.8540372670807455, + "mean_token_weighted_tv": 0.029632446396610012, + "aggregate_load_tv": 0.050724637681159424 + }, + "period_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 10, + "mean_set_jaccard": 0.8105590062111803, + "mean_token_weighted_tv": 0.04367862900962, + "aggregate_load_tv": 0.08695652173913043 + } + } + }, + "layer_23": { + "layer": 23, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "780b5c281dfb6ae9267dd5cda0c2c658e4706ac5f4ad56655354d13c04b4a23e", + "route_weight_sha256": "8fa5f497e14cdde4dde1a4aa00a04d4ba4783b47232742ab995080627d5c3838", + "loads": [ + 1, + 3, + 1, + 2, + 2, + 2, + 0, + 2, + 2, + 2, + 2, + 4, + 0, + 3, + 1, + 3, + 1, + 0, + 1, + 0, + 4, + 0, + 2, + 1, + 3, + 0, + 1, + 2, + 2, + 2, + 0, + 2, + 12, + 1, + 0, + 2, + 10, + 1, + 3, + 4, + 2, + 3, + 3, + 0, + 0, + 2, + 7, + 2, + 1, + 4, + 0, + 0, + 4, + 0, + 2, + 0, + 0, + 4, + 13, + 1, + 0, + 2, + 1, + 3 + ], + "weighted_loads": [ + 0.12649211287498474, + 0.12492961436510086, + 0.03938833251595497, + 0.09267961233854294, + 0.06976230815052986, + 0.10376280173659325, + 0.0, + 0.12888691946864128, + 0.13455278798937798, + 0.19852079451084137, + 0.07945281639695168, + 0.23787033930420876, + 0.0, + 0.2594403140246868, + 0.02819816768169403, + 0.12540837936103344, + 0.026554744690656662, + 0.0, + 0.038535844534635544, + 0.0, + 0.5953220911324024, + 0.0, + 0.22330868989229202, + 0.049393847584724426, + 0.16271625459194183, + 0.0, + 0.0347161628305912, + 0.09796310216188431, + 0.09333217516541481, + 0.08375589549541473, + 0.0, + 0.06838750839233398, + 0.5583144798874855, + 0.04497251287102699, + 0.0, + 0.22945193201303482, + 0.6873043738305569, + 0.05510321632027626, + 0.17585337907075882, + 0.16126720048487186, + 0.07302919402718544, + 0.34584030508995056, + 0.2343139722943306, + 0.0, + 0.0, + 0.10260634496808052, + 0.35346559435129166, + 0.07547570765018463, + 0.04506285861134529, + 0.1957307644188404, + 0.0, + 0.0, + 0.23928011395037174, + 0.0, + 0.2653120756149292, + 0.0, + 0.0, + 0.1592793669551611, + 1.5866084769368172, + 0.04424336925148964, + 0.0, + 0.11164161190390587, + 0.03339022025465965, + 0.1398206576704979 + ], + "unique_experts": 48, + "load_cv": 1.1830029180952184, + "normalized_load_entropy": 0.8634556078143898, + "max_load_share": 0.09420289855072464 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "a4333707071d61ec10798cecbb7cff383850e080bee9071eeef48e8f41c09e8a", + "route_weight_sha256": "0c68ffd4ae450c2118d0007e37dee69ac36dbe3db07fea9206af5c7dce4a5fa5", + "loads": [ + 6, + 7, + 1, + 11, + 7, + 4, + 4, + 8, + 3, + 10, + 2, + 6, + 2, + 7, + 3, + 3, + 6, + 0, + 1, + 0, + 4, + 0, + 5, + 12, + 6, + 0, + 1, + 2, + 2, + 2, + 0, + 2, + 15, + 5, + 0, + 2, + 11, + 1, + 7, + 4, + 8, + 3, + 5, + 0, + 0, + 7, + 19, + 5, + 2, + 4, + 1, + 2, + 4, + 0, + 12, + 2, + 0, + 13, + 15, + 1, + 1, + 2, + 6, + 4 + ], + "weighted_loads": [ + 0.3201765378471464, + 0.33837464824318886, + 0.03938833251595497, + 0.3643208236899227, + 0.26632287725806236, + 0.1574482531286776, + 0.19658459350466728, + 0.43723149970173836, + 0.13529814081266522, + 0.4817438367754221, + 0.07945281639695168, + 0.3213980235159397, + 0.08782933838665485, + 0.4333060346543789, + 0.13759197294712067, + 0.12540837936103344, + 0.18430141545832157, + 0.0, + 0.038535844534635544, + 0.0, + 0.5953220911324024, + 0.0, + 0.3638552315533161, + 1.503232404589653, + 0.26576762832701206, + 0.0, + 0.0347161628305912, + 0.09796310216188431, + 0.09333217516541481, + 0.08375589549541473, + 0.0, + 0.06838750839233398, + 0.7205469012260437, + 0.5512054354185238, + 0.0, + 0.22945193201303482, + 0.7268018051981926, + 0.05510321632027626, + 0.3531247694045305, + 0.16126720048487186, + 0.40328535437583923, + 0.34584030508995056, + 0.28578193113207817, + 0.0, + 0.0, + 2.0730574168264866, + 1.3850932829082012, + 0.13835643860511482, + 0.08356419578194618, + 0.1957307644188404, + 0.05848977714776993, + 0.11352765560150146, + 0.23928011395037174, + 0.0, + 1.187048800289631, + 0.09918307512998581, + 0.0, + 0.9617174454033375, + 1.6884451322257519, + 0.04424336925148964, + 0.04624869301915169, + 0.11164161190390587, + 0.2588643878698349, + 0.17038948461413383 + ], + "unique_experts": 54, + "load_cv": 0.9485206154979929, + "normalized_load_entropy": 0.8936834824534804, + "max_load_share": 0.06597222222222222 + } + }, + "s1_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "2f5405eb8eb4458bf85543475ba4541fbcdd3b062863c068d4e7329f5201ca87", + "route_weight_sha256": "b36664889b2972bdf6114660d467c4ee91857f28b364e74b1096f957922a5adf", + "loads": [ + 1, + 4, + 1, + 2, + 2, + 2, + 0, + 2, + 2, + 2, + 2, + 4, + 0, + 3, + 1, + 3, + 1, + 0, + 1, + 0, + 4, + 0, + 2, + 2, + 4, + 0, + 1, + 2, + 1, + 2, + 0, + 2, + 12, + 1, + 0, + 2, + 7, + 1, + 3, + 4, + 2, + 4, + 3, + 0, + 0, + 2, + 8, + 1, + 1, + 4, + 0, + 0, + 4, + 0, + 2, + 0, + 0, + 4, + 13, + 1, + 0, + 2, + 1, + 3 + ], + "weighted_loads": [ + 0.12209519743919373, + 0.15687020868062973, + 0.03779720142483711, + 0.09729502722620964, + 0.07283684238791466, + 0.10227971524000168, + 0.0, + 0.12207962200045586, + 0.12592850252985954, + 0.19609985128045082, + 0.07611942663788795, + 0.23700185120105743, + 0.0, + 0.24622894451022148, + 0.0274739321321249, + 0.12498598359525204, + 0.025248656049370766, + 0.0, + 0.03718256205320358, + 0.0, + 0.5735327936708927, + 0.0, + 0.23033222556114197, + 0.08499442040920258, + 0.20359964296221733, + 0.0, + 0.03616869077086449, + 0.09755672514438629, + 0.0587431974709034, + 0.08368535712361336, + 0.0, + 0.0738257896155119, + 0.5459619890898466, + 0.041801899671554565, + 0.0, + 0.2301386520266533, + 0.5239962581545115, + 0.05222971737384796, + 0.17558715119957924, + 0.16699611023068428, + 0.07254910469055176, + 0.36188493482768536, + 0.2308618277311325, + 0.0, + 0.0, + 0.10128165781497955, + 0.4055943824350834, + 0.04358726739883423, + 0.048196177929639816, + 0.19329125061631203, + 0.0, + 0.0, + 0.23765827529132366, + 0.0, + 0.2576321214437485, + 0.0, + 0.0, + 0.15118182823061943, + 1.5706235580146313, + 0.044248491525650024, + 0.0, + 0.10242041200399399, + 0.03440304100513458, + 0.14671073481440544 + ], + "unique_experts": 48, + "load_cv": 1.1571535813529936, + "normalized_load_entropy": 0.8652478100551676, + "max_load_share": 0.09420289855072464 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "27921f3c2449977d0f1523550cae009ff1475cbb310c1f8460112c52737e8be9", + "route_weight_sha256": "eca8b4864881711e3369373c064b8b6dd6fbadff3eb7f94103be897aa6f9d603", + "loads": [ + 6, + 10, + 7, + 11, + 5, + 4, + 12, + 10, + 4, + 6, + 4, + 6, + 2, + 8, + 3, + 6, + 7, + 1, + 3, + 0, + 5, + 0, + 4, + 17, + 6, + 0, + 1, + 2, + 1, + 3, + 0, + 2, + 14, + 13, + 0, + 2, + 13, + 2, + 10, + 5, + 12, + 4, + 5, + 0, + 2, + 10, + 25, + 5, + 7, + 7, + 1, + 10, + 10, + 1, + 12, + 0, + 0, + 19, + 17, + 1, + 3, + 3, + 9, + 6 + ], + "weighted_loads": [ + 0.4252513339743018, + 0.5090208910405636, + 0.3501310236752033, + 0.5944001644384116, + 0.17183976620435715, + 0.14609897369518876, + 0.6095879431813955, + 0.43875931575894356, + 0.1628728958312422, + 0.3498420733958483, + 0.17063717916607857, + 0.30295214243233204, + 0.12297309283167124, + 0.45868225023150444, + 0.1612399984151125, + 0.24744782224297523, + 0.21540735568851233, + 0.05849078670144081, + 0.1285519041121006, + 0.0, + 0.6204934269189835, + 0.0, + 0.3299689944833517, + 2.060509003698826, + 0.2837494295090437, + 0.0, + 0.03616869077086449, + 0.09755672514438629, + 0.0587431974709034, + 0.12959757447242737, + 0.0, + 0.0738257896155119, + 0.6613450627774, + 0.9977823165245354, + 0.0, + 0.2301386520266533, + 0.9605285283178091, + 0.10002843663096428, + 0.5900520794093609, + 0.19129712879657745, + 0.5441802944988012, + 0.36188493482768536, + 0.28519255109131336, + 0.0, + 0.10345114395022392, + 2.1952329482883215, + 2.0747320912778378, + 0.2714003419969231, + 0.3087827395647764, + 0.34259815886616707, + 0.027663428336381912, + 0.6158577743917704, + 0.8824724573642015, + 0.03126540780067444, + 1.2263610437512398, + 0.0, + 0.0, + 1.493420835584402, + 1.7898933105170727, + 0.044248491525650024, + 0.11211563274264336, + 0.22818415611982346, + 0.3762736953794956, + 0.2552849017083645 + ], + "unique_experts": 56, + "load_cv": 0.8799463367476198, + "normalized_load_entropy": 0.9057664055253346, + "max_load_share": 0.06510416666666667 + } + }, + "s0_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "af7ca4bbcf71ca61e8c04c3eae28354d82c273da1f64c2c68e23ea77c79e74b6", + "route_weight_sha256": "c82b126f272203d5974076eb453980e808f5691ded28fd937f5b14120f5a192e", + "loads": [ + 1, + 2, + 1, + 1, + 2, + 3, + 1, + 3, + 2, + 2, + 2, + 4, + 0, + 3, + 2, + 3, + 1, + 0, + 2, + 0, + 4, + 0, + 2, + 1, + 4, + 0, + 1, + 2, + 2, + 2, + 0, + 2, + 11, + 1, + 0, + 2, + 7, + 1, + 3, + 4, + 2, + 3, + 4, + 0, + 0, + 2, + 7, + 2, + 1, + 3, + 0, + 0, + 4, + 0, + 2, + 0, + 0, + 4, + 14, + 1, + 0, + 2, + 1, + 2 + ], + "weighted_loads": [ + 0.09785176813602448, + 0.09777161106467247, + 0.043435126543045044, + 0.06214054673910141, + 0.06986693479120731, + 0.1403318364173174, + 0.03027149848639965, + 0.17961853370070457, + 0.1365063302218914, + 0.18394196033477783, + 0.07564250007271767, + 0.2542463317513466, + 0.0, + 0.27893083542585373, + 0.06253715604543686, + 0.12055004388093948, + 0.021160513162612915, + 0.0, + 0.08527880534529686, + 0.0, + 0.5876970067620277, + 0.0, + 0.2290525734424591, + 0.049219630658626556, + 0.2100999765098095, + 0.0, + 0.03460555896162987, + 0.10808223858475685, + 0.0913443323224783, + 0.07879015803337097, + 0.0, + 0.06565895117819309, + 0.5174605511128902, + 0.046987731009721756, + 0.0, + 0.24560534209012985, + 0.6336280182003975, + 0.055855102837085724, + 0.17969824001193047, + 0.16751944087445736, + 0.08052771911025047, + 0.3356231488287449, + 0.26806147769093513, + 0.0, + 0.0, + 0.10561518743634224, + 0.35254843905568123, + 0.07739447429776192, + 0.05035797134041786, + 0.1603599451482296, + 0.0, + 0.0, + 0.24731283262372017, + 0.0, + 0.25774943828582764, + 0.0, + 0.0, + 0.16939351707696915, + 1.6465740837156773, + 0.04376776143908501, + 0.0, + 0.1053185872733593, + 0.03279411792755127, + 0.10324898734688759 + ], + "unique_experts": 49, + "load_cv": 1.1307134550602624, + "normalized_load_entropy": 0.8732276291034057, + "max_load_share": 0.10144927536231885 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "d4bc89cf7db04c38ed1bf21cbfe8ccad90740b71eef6939c004eaa9295b6b9f7", + "route_weight_sha256": "cba93912c6207bce0df16303985db90a805ab08b249196aa154de791d7728f7f", + "loads": [ + 4, + 6, + 1, + 9, + 8, + 5, + 4, + 9, + 2, + 10, + 2, + 5, + 3, + 7, + 4, + 3, + 7, + 0, + 2, + 1, + 4, + 0, + 5, + 13, + 7, + 0, + 2, + 2, + 2, + 2, + 0, + 2, + 14, + 4, + 0, + 2, + 7, + 1, + 6, + 4, + 9, + 3, + 6, + 1, + 0, + 7, + 19, + 4, + 2, + 3, + 1, + 2, + 4, + 0, + 12, + 3, + 0, + 14, + 17, + 2, + 0, + 2, + 5, + 3 + ], + "weighted_loads": [ + 0.22466158866882324, + 0.31121664494276047, + 0.043435126543045044, + 0.33022267930209637, + 0.3301533777266741, + 0.19401728780940175, + 0.19326972402632236, + 0.44408775493502617, + 0.1365063302218914, + 0.45626326464116573, + 0.07564250007271767, + 0.29081325605511665, + 0.08058820478618145, + 0.4527965560555458, + 0.17087826132774353, + 0.12055004388093948, + 0.22388938628137112, + 0.0, + 0.08527880534529686, + 0.14278998970985413, + 0.5876970067620277, + 0.0, + 0.38874900713562965, + 1.6459086053073406, + 0.3131513502448797, + 0.0, + 0.16050123795866966, + 0.10808223858475685, + 0.0913443323224783, + 0.07879015803337097, + 0.0, + 0.06565895117819309, + 0.6581563763320446, + 0.4910351298749447, + 0.0, + 0.24560534209012985, + 0.6336280182003975, + 0.055855102837085724, + 0.3152958657592535, + 0.16751944087445736, + 0.4291255548596382, + 0.3356231488287449, + 0.3195294365286827, + 0.0603937953710556, + 0.0, + 1.1347291469573975, + 1.366028320044279, + 0.13645731192082167, + 0.08885930851101875, + 0.1603599451482296, + 0.05048755928874016, + 0.11352765560150146, + 0.24731283262372017, + 0.0, + 1.1794861629605293, + 0.14319460466504097, + 0.0, + 1.0150815472006798, + 1.8137255050241947, + 0.29486168548464775, + 0.0, + 0.1053185872733593, + 0.1905074156820774, + 0.1444280818104744 + ], + "unique_experts": 55, + "load_cv": 0.9452610848429752, + "normalized_load_entropy": 0.89840730035478, + "max_load_share": 0.06597222222222222 + } + }, + "s1_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "7c4b91400e7f5634135f25a58bd0db9be55e977b9d9d4feb998768b26bfe009e", + "route_weight_sha256": "ea148a2b9e96a9774f35bce28f9bb3423969e8baee8d41a1d1dde85c7b50ae79", + "loads": [ + 1, + 2, + 0, + 1, + 2, + 2, + 0, + 3, + 2, + 2, + 2, + 4, + 0, + 3, + 1, + 3, + 1, + 0, + 1, + 0, + 5, + 0, + 2, + 2, + 4, + 0, + 1, + 2, + 3, + 2, + 0, + 2, + 11, + 2, + 0, + 2, + 9, + 1, + 3, + 3, + 4, + 3, + 3, + 0, + 0, + 2, + 7, + 2, + 1, + 3, + 0, + 0, + 3, + 0, + 2, + 0, + 0, + 4, + 14, + 1, + 0, + 2, + 0, + 3 + ], + "weighted_loads": [ + 0.10085204243659973, + 0.09696011245250702, + 0.0, + 0.060922324657440186, + 0.0715548787266016, + 0.10693573206663132, + 0.0, + 0.17502319812774658, + 0.1412360519170761, + 0.18541482463479042, + 0.07640284858644009, + 0.2655455693602562, + 0.0, + 0.25991981476545334, + 0.029588907957077026, + 0.12361262366175652, + 0.02207593061029911, + 0.0, + 0.04096708819270134, + 0.0, + 0.5808405186980963, + 0.0, + 0.26191745698451996, + 0.08484116569161415, + 0.20632889494299889, + 0.0, + 0.03512173146009445, + 0.10201364755630493, + 0.12606064975261688, + 0.0805954560637474, + 0.0, + 0.06849467568099499, + 0.5088199190795422, + 0.08338835090398788, + 0.0, + 0.23310070484876633, + 0.6405164208263159, + 0.05244840681552887, + 0.17558055743575096, + 0.1416923776268959, + 0.1383359469473362, + 0.35278142243623734, + 0.23644717037677765, + 0.0, + 0.0, + 0.10317854955792427, + 0.3744017779827118, + 0.07205308973789215, + 0.04954914748668671, + 0.15815836563706398, + 0.0, + 0.0, + 0.2207152582705021, + 0.0, + 0.25038859248161316, + 0.0, + 0.0, + 0.16607722267508507, + 1.6095734685659409, + 0.04348374530673027, + 0.0, + 0.10094566270709038, + 0.0, + 0.13719496876001358 + ], + "unique_experts": 46, + "load_cv": 1.180158729654263, + "normalized_load_entropy": 0.8593302486182992, + "max_load_share": 0.10144927536231885 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "403ff544d3a20807f1b7ba52e2d4497d979905f310ea26d10c604fc0d89f4899", + "route_weight_sha256": "a98b3c7101b8181438a0636ca20408108983806a5d42ce3137b4365dca679632", + "loads": [ + 5, + 8, + 6, + 9, + 6, + 4, + 9, + 11, + 3, + 6, + 4, + 7, + 3, + 9, + 2, + 6, + 9, + 1, + 3, + 0, + 6, + 0, + 5, + 18, + 6, + 0, + 1, + 2, + 3, + 3, + 1, + 2, + 14, + 13, + 0, + 2, + 15, + 2, + 9, + 4, + 15, + 3, + 5, + 0, + 2, + 8, + 23, + 5, + 7, + 6, + 1, + 10, + 9, + 3, + 12, + 2, + 0, + 20, + 18, + 1, + 2, + 3, + 7, + 5 + ], + "weighted_loads": [ + 0.4114573523402214, + 0.44911079481244087, + 0.3123338222503662, + 0.5544955674558878, + 0.21483292989432812, + 0.1507549905218184, + 0.5004424694925547, + 0.512812752276659, + 0.17746391519904137, + 0.3450486343353987, + 0.1709206011146307, + 0.37675792537629604, + 0.07983934972435236, + 0.5037594549357891, + 0.12836364656686783, + 0.2460744623094797, + 0.29716773610562086, + 0.05849078670144081, + 0.13233643025159836, + 0.0, + 0.627801151946187, + 0.0, + 0.43093774653971195, + 2.2819124311208725, + 0.28647868148982525, + 0.0, + 0.03512173146009445, + 0.10201364755630493, + 0.12606064975261688, + 0.12650767341256142, + 0.05030902475118637, + 0.06849467568099499, + 0.6467606723308563, + 1.0215579085052013, + 0.0, + 0.23310070484876633, + 1.0770486909896135, + 0.10024712607264519, + 0.5336427018046379, + 0.16599339619278908, + 0.6589312423020601, + 0.35278142243623734, + 0.2907778937369585, + 0.0, + 0.10345114395022392, + 1.1906348150223494, + 1.9909842684864998, + 0.2961618220433593, + 0.3101357091218233, + 0.307465273886919, + 0.027663428336381912, + 0.6158577743917704, + 0.86552944034338, + 0.15283237770199776, + 1.2191175147891045, + 0.11279186606407166, + 0.0, + 1.5231850519776344, + 1.8642881996929646, + 0.04348374530673027, + 0.07552387565374374, + 0.22670940682291985, + 0.26843850314617157, + 0.2250874973833561 + ], + "unique_experts": 58, + "load_cv": 0.871022706681953, + "normalized_load_entropy": 0.9116031686639035, + "max_load_share": 0.059895833333333336 + } + }, + "s0_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "150e6c16e1f80cce1d0ea01b91db976e875b6101c09b5b7fac5b04099d3ee716", + "route_weight_sha256": "dba06404c8c5a0f02e7d49298eb502ffb235e1b75c3ccf40886054447d7c0063", + "loads": [ + 1, + 2, + 1, + 1, + 2, + 2, + 1, + 3, + 2, + 2, + 4, + 4, + 0, + 3, + 1, + 2, + 1, + 0, + 1, + 0, + 4, + 0, + 2, + 2, + 4, + 0, + 1, + 1, + 2, + 2, + 0, + 1, + 12, + 1, + 0, + 2, + 10, + 2, + 3, + 4, + 3, + 3, + 4, + 0, + 0, + 2, + 7, + 1, + 1, + 3, + 0, + 0, + 2, + 0, + 2, + 0, + 0, + 4, + 13, + 1, + 0, + 2, + 1, + 3 + ], + "weighted_loads": [ + 0.10185486078262329, + 0.10028045624494553, + 0.04823886975646019, + 0.0615093968808651, + 0.06915380619466305, + 0.10933388769626617, + 0.0293054711073637, + 0.17470044642686844, + 0.13889079168438911, + 0.20531389489769936, + 0.15625395812094212, + 0.22910871356725693, + 0.0, + 0.2804388180375099, + 0.028442349284887314, + 0.09755076467990875, + 0.021920274943113327, + 0.0, + 0.03738878294825554, + 0.0, + 0.5738275907933712, + 0.0, + 0.2263166308403015, + 0.08247418329119682, + 0.19844865426421165, + 0.0, + 0.032674383372068405, + 0.0700385719537735, + 0.09157590195536613, + 0.0777047649025917, + 0.0, + 0.035987794399261475, + 0.5634643733501434, + 0.04939314350485802, + 0.0, + 0.26452096551656723, + 0.7288922779262066, + 0.09471909329295158, + 0.17818228900432587, + 0.1681554801762104, + 0.10916683822870255, + 0.2600858174264431, + 0.2763521634042263, + 0.0, + 0.0, + 0.11874816194176674, + 0.35679876804351807, + 0.03833029046654701, + 0.05112599581480026, + 0.15602217614650726, + 0.0, + 0.0, + 0.16906458139419556, + 0.0, + 0.2652662396430969, + 0.0, + 0.0, + 0.1702746730297804, + 1.5442453660070896, + 0.04190647974610329, + 0.0, + 0.11211418733000755, + 0.03843687102198601, + 0.14564917609095573 + ], + "unique_experts": 49, + "load_cv": 1.1858402848885006, + "normalized_load_entropy": 0.8643673076962297, + "max_load_share": 0.09420289855072464 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "a0879aa7a42d885f9bb3be0fe9b347d7e54c9a446def284136842ef15efddfd5", + "route_weight_sha256": "47472b549c371dd9f3322ced7af420b7b5edc3e664c2ae7dc700429214eecc82", + "loads": [ + 6, + 6, + 1, + 11, + 6, + 4, + 6, + 9, + 2, + 9, + 4, + 6, + 3, + 7, + 3, + 2, + 7, + 0, + 1, + 0, + 4, + 0, + 4, + 14, + 7, + 0, + 1, + 1, + 2, + 2, + 0, + 1, + 14, + 5, + 0, + 2, + 11, + 2, + 7, + 4, + 10, + 3, + 6, + 0, + 0, + 7, + 21, + 4, + 2, + 3, + 0, + 2, + 2, + 0, + 13, + 2, + 0, + 13, + 15, + 1, + 0, + 2, + 5, + 3 + ], + "weighted_loads": [ + 0.33691204711794853, + 0.3137254901230335, + 0.04823886975646019, + 0.4732867833226919, + 0.2294477168470621, + 0.16301933908835053, + 0.2835203055292368, + 0.47869861498475075, + 0.13889079168438911, + 0.42837467417120934, + 0.15625395812094212, + 0.3136809691786766, + 0.08537771925330162, + 0.454304538667202, + 0.14822804927825928, + 0.09755076467990875, + 0.2043172661215067, + 0.0, + 0.03738878294825554, + 0.0, + 0.5738275907933712, + 0.0, + 0.3174973241984844, + 1.62832972407341, + 0.3015000279992819, + 0.0, + 0.032674383372068405, + 0.0700385719537735, + 0.09157590195536613, + 0.0777047649025917, + 0.0, + 0.035987794399261475, + 0.663418848067522, + 0.520027868449688, + 0.0, + 0.26452096551656723, + 0.7662256918847561, + 0.09471909329295158, + 0.38061621598899364, + 0.1681554801762104, + 0.4181937612593174, + 0.2600858174264431, + 0.3278201222419739, + 0.0, + 0.0, + 1.1528856121003628, + 1.5305198952555656, + 0.12216885108500719, + 0.08962733298540115, + 0.15602217614650726, + 0.0, + 0.11352765560150146, + 0.16906458139419556, + 0.0, + 1.32176061719656, + 0.08483978360891342, + 0.0, + 1.0411383379250765, + 1.660372793674469, + 0.04190647974610329, + 0.0, + 0.11211418733000755, + 0.1789666935801506, + 0.14564917609095573 + ], + "unique_experts": 52, + "load_cv": 1.0038506110884806, + "normalized_load_entropy": 0.8822822845897561, + "max_load_share": 0.07291666666666667 + } + }, + "s1_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "564fba91f545ce5cc78af38003fba474223a51cdd2a3f1dee8bf2a583f18600e", + "route_weight_sha256": "c66445371a64eafd73b5dbdcaabe31743a22a61fd09879ceb15821cd70765706", + "loads": [ + 1, + 2, + 1, + 1, + 3, + 2, + 0, + 3, + 2, + 2, + 4, + 4, + 0, + 3, + 1, + 2, + 1, + 0, + 1, + 0, + 5, + 0, + 3, + 2, + 3, + 0, + 0, + 2, + 1, + 1, + 0, + 1, + 11, + 2, + 0, + 2, + 10, + 2, + 3, + 3, + 3, + 3, + 4, + 0, + 0, + 2, + 7, + 1, + 1, + 3, + 0, + 0, + 2, + 0, + 2, + 0, + 0, + 4, + 15, + 1, + 0, + 2, + 1, + 3 + ], + "weighted_loads": [ + 0.10112383216619492, + 0.08955565467476845, + 0.03755931183695793, + 0.0674799457192421, + 0.09615418128669262, + 0.09702730178833008, + 0.0, + 0.16099246591329575, + 0.1380155198276043, + 0.20160295069217682, + 0.16640444099903107, + 0.21729888580739498, + 0.0, + 0.267088171094656, + 0.026535626500844955, + 0.09340417012572289, + 0.022505605593323708, + 0.0, + 0.03415784612298012, + 0.0, + 0.5968645401299, + 0.0, + 0.2466951124370098, + 0.08369746431708336, + 0.1629970222711563, + 0.0, + 0.0, + 0.10129199177026749, + 0.05921267345547676, + 0.042493630200624466, + 0.0, + 0.04202800616621971, + 0.500659579411149, + 0.0826963558793068, + 0.0, + 0.261835440993309, + 0.686086991801858, + 0.08570069447159767, + 0.16260843351483345, + 0.13938894122838974, + 0.11719751730561256, + 0.24076978862285614, + 0.264402873814106, + 0.0, + 0.0, + 0.12245066463947296, + 0.3715355917811394, + 0.04141305014491081, + 0.04780668020248413, + 0.14459733478724957, + 0.0, + 0.0, + 0.17730432748794556, + 0.0, + 0.2501194104552269, + 0.0, + 0.0, + 0.1631765253841877, + 1.56413359567523, + 0.04099883511662483, + 0.0, + 0.09572187811136246, + 0.035236865282058716, + 0.13463068380951881 + ], + "unique_experts": 47, + "load_cv": 1.2357994044471483, + "normalized_load_entropy": 0.8545109902110357, + "max_load_share": 0.10869565217391304 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "678a31e6a758a7342c8e226b2fb3fa99d57d1723a3373f2538013cc0d6b49efa", + "route_weight_sha256": "78db8f6a69e912f31a3bea408f0b72a4bc48df49a712f6492d5643097f3b73c0", + "loads": [ + 5, + 8, + 7, + 10, + 6, + 5, + 11, + 10, + 3, + 5, + 6, + 7, + 2, + 8, + 3, + 5, + 10, + 1, + 3, + 1, + 6, + 0, + 5, + 19, + 5, + 0, + 1, + 2, + 1, + 2, + 0, + 1, + 13, + 12, + 0, + 2, + 16, + 3, + 11, + 4, + 12, + 3, + 6, + 0, + 2, + 8, + 25, + 4, + 8, + 6, + 1, + 11, + 8, + 1, + 15, + 0, + 0, + 19, + 18, + 1, + 2, + 3, + 8, + 4 + ], + "weighted_loads": [ + 0.39807653799653053, + 0.4417063370347023, + 0.34989313408732414, + 0.6224797833710909, + 0.1951571051031351, + 0.16640700632706285, + 0.6002264823764563, + 0.46836594119668007, + 0.17424338310956955, + 0.31752158887684345, + 0.2609221935272217, + 0.3199232779443264, + 0.05098095629364252, + 0.47954147681593895, + 0.16781625896692276, + 0.21586600877344608, + 0.30138314235955477, + 0.05849078670144081, + 0.12552718818187714, + 0.033156976103782654, + 0.6438251733779907, + 0.0, + 0.3455484751611948, + 2.14827873185277, + 0.24314680881798267, + 0.0, + 0.06055690348148346, + 0.10129199177026749, + 0.05921267345547676, + 0.08840584754943848, + 0.0, + 0.04202800616621971, + 0.6113192606717348, + 0.9985223561525345, + 0.0, + 0.261835440993309, + 1.1226192619651556, + 0.133499413728714, + 0.6290489844977856, + 0.1636899597942829, + 0.4563909452408552, + 0.24076978862285614, + 0.31873359717428684, + 0.0, + 0.10345114395022392, + 1.2038609739392996, + 2.2344023510813713, + 0.26552178245037794, + 0.35602075792849064, + 0.2939042430371046, + 0.027663428336381912, + 0.6954089719802141, + 0.8221185095608234, + 0.03126540780067444, + 1.4549180641770363, + 0.0, + 0.0, + 1.5070786625146866, + 1.7454874478280544, + 0.04099883511662483, + 0.07552387565374374, + 0.22148562222719193, + 0.2946392819285393, + 0.17469745874404907 + ], + "unique_experts": 57, + "load_cv": 0.9114434522594732, + "normalized_load_entropy": 0.9021020080975581, + "max_load_share": 0.06510416666666667 + } + }, + "s0_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "51fdbbcad245341d96c26d4a7b4fd1850fe2960dc1ff5ef2e9078b5741391b6b", + "route_weight_sha256": "230874060b98ac639020509a44ef7fb6118eddb369f46e3dd6c531a96223770c", + "loads": [ + 1, + 2, + 1, + 1, + 3, + 2, + 1, + 3, + 2, + 2, + 4, + 4, + 0, + 3, + 1, + 3, + 1, + 0, + 1, + 0, + 4, + 0, + 3, + 2, + 4, + 0, + 1, + 1, + 2, + 0, + 0, + 1, + 11, + 1, + 0, + 2, + 8, + 2, + 3, + 4, + 3, + 4, + 4, + 0, + 0, + 2, + 8, + 1, + 1, + 3, + 0, + 0, + 2, + 0, + 2, + 0, + 0, + 4, + 13, + 1, + 0, + 2, + 1, + 3 + ], + "weighted_loads": [ + 0.10322216898202896, + 0.10062423720955849, + 0.04083023592829704, + 0.06344261020421982, + 0.09542549401521683, + 0.10868252441287041, + 0.03094823658466339, + 0.18017854541540146, + 0.1361985057592392, + 0.20533537864685059, + 0.1679413579404354, + 0.23842508904635906, + 0.0, + 0.2838129810988903, + 0.02835185080766678, + 0.1241945531219244, + 0.021537432447075844, + 0.0, + 0.03986041992902756, + 0.0, + 0.5860807746648788, + 0.0, + 0.24848518893122673, + 0.09189724549651146, + 0.20816010236740112, + 0.0, + 0.031935468316078186, + 0.07318010926246643, + 0.09370959922671318, + 0.0, + 0.0, + 0.04074447974562645, + 0.5216302908957005, + 0.047610823065042496, + 0.0, + 0.25332027673721313, + 0.6517044957727194, + 0.09428929165005684, + 0.1824846714735031, + 0.16334536112844944, + 0.11017445847392082, + 0.308231171220541, + 0.26999324932694435, + 0.0, + 0.0, + 0.11842874437570572, + 0.40957136265933514, + 0.03964180499315262, + 0.052077941596508026, + 0.16365009173750877, + 0.0, + 0.0, + 0.18114639073610306, + 0.0, + 0.2572205811738968, + 0.0, + 0.0, + 0.17438976280391216, + 1.5856039226055145, + 0.044098787009716034, + 0.0, + 0.10862017795443535, + 0.03213035315275192, + 0.1395268440246582 + ], + "unique_experts": 48, + "load_cv": 1.1484078455453641, + "normalized_load_entropy": 0.864761984752502, + "max_load_share": 0.09420289855072464 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "7ee664624fe4f4980253dc079ac75b84aa6372bcfbc733785f1621abd3d57a36", + "route_weight_sha256": "4182a68115fa72133b9bb212f1e71020fff10b35e5f3b1b916828b2833539fdf", + "loads": [ + 6, + 6, + 2, + 9, + 8, + 4, + 7, + 9, + 2, + 10, + 4, + 5, + 2, + 7, + 2, + 3, + 6, + 0, + 1, + 0, + 4, + 0, + 5, + 13, + 7, + 0, + 1, + 1, + 2, + 0, + 0, + 1, + 14, + 6, + 0, + 2, + 8, + 2, + 8, + 4, + 10, + 4, + 7, + 0, + 0, + 7, + 21, + 3, + 2, + 3, + 0, + 2, + 2, + 1, + 13, + 2, + 0, + 14, + 15, + 1, + 0, + 2, + 5, + 3 + ], + "weighted_loads": [ + 0.34280091151595116, + 0.3140692710876465, + 0.08423365280032158, + 0.3315247427672148, + 0.3108375743031502, + 0.16236797580495477, + 0.35684606805443764, + 0.4807243198156357, + 0.1361985057592392, + 0.48830204643309116, + 0.1679413579404354, + 0.27700122632086277, + 0.059147270396351814, + 0.4576787017285824, + 0.10013644397258759, + 0.1241945531219244, + 0.17505985870957375, + 0.0, + 0.03986041992902756, + 0.0, + 0.5860807746648788, + 0.0, + 0.34008002281188965, + 1.6221180371940136, + 0.31121147610247135, + 0.0, + 0.031935468316078186, + 0.07318010926246643, + 0.09370959922671318, + 0.0, + 0.0, + 0.04074447974562645, + 0.6421631425619125, + 0.5044263917952776, + 0.0, + 0.25332027673721313, + 0.6517044957727194, + 0.09428929165005684, + 0.5076931733638048, + 0.16334536112844944, + 0.45068106055259705, + 0.308231171220541, + 0.36785901710391045, + 0.0, + 0.0, + 1.1595290638506413, + 1.4924908448010683, + 0.09870464261621237, + 0.09057927876710892, + 0.16365009173750877, + 0.0, + 0.11352765560150146, + 0.18114639073610306, + 0.043898988515138626, + 1.2185341157019138, + 0.08899644017219543, + 0.0, + 1.0916818287223577, + 1.6908221133053303, + 0.044098787009716034, + 0.0, + 0.10862017795443535, + 0.17543233558535576, + 0.1395268440246582 + ], + "unique_experts": 52, + "load_cv": 0.996908802495909, + "normalized_load_entropy": 0.8828916663591586, + "max_load_share": 0.07291666666666667 + } + }, + "s1_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "3ba55ca5b4f46be7741a0875f5e43cc6f28e58ea3cae70c41a58fcd5e7703062", + "route_weight_sha256": "dfd2d66e9e1ba86f69deb9bf8d8eeede28802742d7b6ca1a027baa714e0c5f3a", + "loads": [ + 1, + 2, + 1, + 1, + 3, + 2, + 0, + 3, + 2, + 2, + 5, + 3, + 0, + 3, + 0, + 2, + 1, + 0, + 1, + 0, + 4, + 0, + 3, + 2, + 4, + 0, + 0, + 2, + 2, + 0, + 0, + 1, + 11, + 2, + 0, + 2, + 10, + 1, + 3, + 4, + 3, + 4, + 4, + 0, + 0, + 2, + 7, + 1, + 1, + 4, + 0, + 0, + 2, + 0, + 2, + 0, + 0, + 4, + 14, + 1, + 0, + 2, + 1, + 3 + ], + "weighted_loads": [ + 0.09852717071771622, + 0.09092758223414421, + 0.03811956197023392, + 0.0660322830080986, + 0.09121331013739109, + 0.09415236487984657, + 0.0, + 0.16232003271579742, + 0.13657567650079727, + 0.2028176262974739, + 0.20734083652496338, + 0.18679291009902954, + 0.0, + 0.26760659366846085, + 0.0, + 0.09324213117361069, + 0.02407434768974781, + 0.0, + 0.0367153063416481, + 0.0, + 0.5621241144835949, + 0.0, + 0.25477663055062294, + 0.08013639971613884, + 0.1889837384223938, + 0.0, + 0.0, + 0.1027998998761177, + 0.09123453125357628, + 0.0, + 0.0, + 0.039479851722717285, + 0.49727149680256844, + 0.07650100439786911, + 0.0, + 0.24997729808092117, + 0.6304191518574953, + 0.047278113663196564, + 0.16752326115965843, + 0.15572880022227764, + 0.11237979307770729, + 0.26147669553756714, + 0.26448631659150124, + 0.0, + 0.0, + 0.12839467823505402, + 0.40681028366088867, + 0.04283618554472923, + 0.045817576348781586, + 0.18012062460184097, + 0.0, + 0.0, + 0.18527358770370483, + 0.0, + 0.2556680366396904, + 0.0, + 0.0, + 0.1736140102148056, + 1.5430961810052395, + 0.039743151515722275, + 0.0, + 0.0954790823161602, + 0.03407728672027588, + 0.13051381334662437 + ], + "unique_experts": 45, + "load_cv": 1.222126745807789, + "normalized_load_entropy": 0.8491547734620161, + "max_load_share": 0.10144927536231885 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "dc7663882537291f12352457ea87be10e0e6bdde9ea9ffcd6087f6ca2e58b1d4", + "route_weight_sha256": "529c3efdd4ac8b76fe9411533116a610e91fffda31f91fd3a2558d8d4c47b4e1", + "loads": [ + 5, + 8, + 8, + 10, + 6, + 5, + 13, + 11, + 3, + 6, + 7, + 5, + 2, + 9, + 3, + 5, + 8, + 1, + 3, + 0, + 5, + 0, + 5, + 17, + 6, + 0, + 1, + 2, + 2, + 1, + 0, + 1, + 13, + 13, + 0, + 2, + 16, + 2, + 12, + 5, + 12, + 4, + 6, + 0, + 2, + 8, + 25, + 4, + 7, + 7, + 1, + 10, + 8, + 2, + 14, + 0, + 0, + 19, + 16, + 1, + 2, + 3, + 8, + 4 + ], + "weighted_loads": [ + 0.3794807903468609, + 0.44307826459407806, + 0.386886652559042, + 0.5956011470407248, + 0.19021623395383358, + 0.16457367734983563, + 0.7005045227706432, + 0.49299878627061844, + 0.17280353978276253, + 0.3529525715857744, + 0.301858589053154, + 0.24150997027754784, + 0.07294472400099039, + 0.5066043306142092, + 0.16268019191920757, + 0.21570396982133389, + 0.20757055561989546, + 0.05849078670144081, + 0.12808464840054512, + 0.0, + 0.6090847477316856, + 0.0, + 0.3543261755257845, + 2.0676917769014835, + 0.26913352496922016, + 0.0, + 0.06219291687011719, + 0.1027998998761177, + 0.09123453125357628, + 0.04591221734881401, + 0.0, + 0.039479851722717285, + 0.6114625744521618, + 1.079225480556488, + 0.0, + 0.24997729808092117, + 1.066951422020793, + 0.09507683292031288, + 0.7989346422255039, + 0.18002981878817081, + 0.45291011966764927, + 0.26147669553756714, + 0.3188170399516821, + 0.0, + 0.10345114395022392, + 1.2088553737848997, + 2.106477029621601, + 0.26694491785019636, + 0.3064041379839182, + 0.329427532851696, + 0.027663428336381912, + 0.6158577743917704, + 0.8300877697765827, + 0.07441505417227745, + 1.338398713618517, + 0.0, + 0.0, + 1.5725744739174843, + 1.688340600579977, + 0.039743151515722275, + 0.07552387565374374, + 0.22124282643198967, + 0.3026740774512291, + 0.17058058828115463 + ], + "unique_experts": 56, + "load_cv": 0.8955910525085282, + "normalized_load_entropy": 0.9029384831233889, + "max_load_share": 0.06510416666666667 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "ordered_topk_exact_tokens": 17, + "set_exact_tokens": 18, + "mean_set_jaccard": 0.9378881987577641, + "mean_token_weighted_tv": 0.016828174500361733, + "aggregate_load_tv": 0.036231884057971016 + }, + "system_bos": { + "tokens": 23, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8788819875776398, + "mean_token_weighted_tv": 0.024391286561022633, + "aggregate_load_tv": 0.06521739130434782 + }, + "system_x": { + "tokens": 23, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8788819875776398, + "mean_token_weighted_tv": 0.027599767255394356, + "aggregate_load_tv": 0.050724637681159424 + }, + "system_period": { + "tokens": 23, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8881987577639753, + "mean_token_weighted_tv": 0.030148345126729946, + "aggregate_load_tv": 0.05072463768115943 + }, + "bos_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 16, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.9037267080745343, + "mean_token_weighted_tv": 0.023926271530597107, + "aggregate_load_tv": 0.057971014492753624 + }, + "bos_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8716356107660456, + "mean_token_weighted_tv": 0.027283972210210304, + "aggregate_load_tv": 0.07971014492753624 + }, + "x_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 13, + "mean_set_jaccard": 0.8534161490683231, + "mean_token_weighted_tv": 0.03396313677987327, + "aggregate_load_tv": 0.06521739130434784 + }, + "x_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 7, + "set_exact_tokens": 10, + "mean_set_jaccard": 0.8126293995859213, + "mean_token_weighted_tv": 0.0401500402747289, + "aggregate_load_tv": 0.10869565217391303 + }, + "period_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 12, + "mean_set_jaccard": 0.8467908902691513, + "mean_token_weighted_tv": 0.033275169644342815, + "aggregate_load_tv": 0.09420289855072464 + }, + "period_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 11, + "mean_set_jaccard": 0.8064182194616977, + "mean_token_weighted_tv": 0.04318894867015922, + "aggregate_load_tv": 0.10144927536231885 + } + } + }, + "layer_24": { + "layer": 24, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "9d00ddf179d18c8320a828883c6fc84c9cb324ea57cc7f67a489496672680ad9", + "route_weight_sha256": "d25f213a496b91bcbb61b525af63662261cc5ce8d921707f8f8305996e624a2f", + "loads": [ + 1, + 2, + 4, + 0, + 2, + 0, + 0, + 6, + 1, + 0, + 0, + 0, + 0, + 1, + 0, + 11, + 0, + 4, + 3, + 0, + 15, + 1, + 2, + 2, + 23, + 4, + 1, + 1, + 4, + 9, + 1, + 0, + 0, + 2, + 1, + 2, + 1, + 3, + 0, + 0, + 2, + 1, + 7, + 1, + 0, + 0, + 0, + 6, + 0, + 0, + 3, + 0, + 0, + 2, + 1, + 0, + 1, + 0, + 0, + 2, + 0, + 0, + 2, + 3 + ], + "weighted_loads": [ + 0.04049321264028549, + 0.0826195478439331, + 0.18986952304840088, + 0.0, + 0.05601312220096588, + 0.0, + 0.0, + 0.46426019817590714, + 0.05002646893262863, + 0.0, + 0.0, + 0.0, + 0.0, + 0.05470989644527435, + 0.0, + 0.9478633105754852, + 0.0, + 0.18085461296141148, + 0.1390601545572281, + 0.0, + 0.8765874709933996, + 0.06569641083478928, + 0.09461500495672226, + 0.30604055896401405, + 2.0829942002892494, + 0.23307849653065205, + 0.026240281760692596, + 0.032230839133262634, + 0.1384588275104761, + 0.4584132581949234, + 0.042653072625398636, + 0.0, + 0.0, + 0.34281767904758453, + 0.019904468208551407, + 0.06346726603806019, + 0.030711939558386803, + 0.1478409729897976, + 0.0, + 0.0, + 0.09777053818106651, + 0.03491789475083351, + 0.40963566675782204, + 0.04339350759983063, + 0.0, + 0.0, + 0.0, + 0.6666800081729889, + 0.0, + 0.0, + 0.1294453013688326, + 0.0, + 0.0, + 0.06629867292940617, + 0.03553943336009979, + 0.0, + 0.03475681319832802, + 0.0, + 0.0, + 0.11533968150615692, + 0.0, + 0.0, + 0.3558628782629967, + 0.4074913561344147 + ], + "unique_experts": 38, + "load_cv": 1.7701935999269776, + "normalized_load_entropy": 0.7609389297370125, + "max_load_share": 0.16666666666666666 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "8010cabfa92b8a01964fd1f4a990c15cbd57f03c402343daa574ca0b428a60df", + "route_weight_sha256": "425b67fefc7c16372bd7c6d002f398cb290d79ba1414e02df2add9fbe0c7714c", + "loads": [ + 1, + 3, + 6, + 0, + 2, + 3, + 1, + 7, + 9, + 0, + 10, + 0, + 1, + 1, + 2, + 11, + 1, + 4, + 3, + 1, + 16, + 1, + 6, + 2, + 32, + 4, + 3, + 2, + 11, + 16, + 2, + 2, + 2, + 5, + 8, + 3, + 3, + 5, + 1, + 0, + 2, + 2, + 11, + 1, + 0, + 2, + 0, + 11, + 0, + 0, + 11, + 5, + 3, + 6, + 1, + 0, + 1, + 0, + 9, + 2, + 2, + 17, + 6, + 6 + ], + "weighted_loads": [ + 0.04049321264028549, + 0.13280727341771126, + 0.25504245236516, + 0.0, + 0.05601312220096588, + 0.08817653928417712, + 0.05554276332259178, + 0.5188222005963326, + 0.41308617778122425, + 0.0, + 0.3760391485411674, + 0.0, + 0.0027125454507768154, + 0.05470989644527435, + 0.05499502830207348, + 0.9478633105754852, + 0.03711399808526039, + 0.18085461296141148, + 0.1390601545572281, + 0.036627549678087234, + 0.9117265325039625, + 0.06569641083478928, + 0.3406161218881607, + 0.30604055896401405, + 2.4317175429314375, + 0.23307849653065205, + 0.16290826350450516, + 0.09352366253733635, + 0.42442438565194607, + 0.7237437590956688, + 0.08636637404561043, + 0.06610789895057678, + 0.06418723426759243, + 0.4947873391211033, + 0.23933300375938416, + 0.10488913021981716, + 0.3509464170783758, + 1.0464142747223377, + 0.042161889374256134, + 0.0, + 0.09777053818106651, + 0.09263384714722633, + 0.5976010402664542, + 0.04339350759983063, + 0.0, + 0.08611200749874115, + 0.0, + 1.030241153552197, + 0.0, + 0.0, + 0.49599536694586277, + 0.3767065815627575, + 0.08607985824346542, + 0.24663900397717953, + 0.03553943336009979, + 0.0, + 0.03475681319832802, + 0.0, + 0.3085766551666893, + 0.11533968150615692, + 0.0862632617354393, + 1.381402898579836, + 0.43374798563309014, + 2.389152944087982 + ], + "unique_experts": 54, + "load_cv": 1.2165271355810106, + "normalized_load_entropy": 0.8597172272568004, + "max_load_share": 0.1111111111111111 + } + }, + "s1_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "9d54583ad426a179391cbf3adc2ee1fc0326db1968ff8c7b70d02bafe40abdaf", + "route_weight_sha256": "8499976f2d74ca268e3649ca34ff4de887c5b899584eff2ba7746d24b16b862f", + "loads": [ + 1, + 2, + 4, + 0, + 1, + 0, + 0, + 7, + 2, + 0, + 0, + 0, + 0, + 1, + 0, + 11, + 0, + 5, + 3, + 0, + 13, + 1, + 2, + 2, + 23, + 4, + 1, + 1, + 4, + 9, + 1, + 0, + 0, + 2, + 1, + 2, + 1, + 3, + 0, + 0, + 2, + 1, + 7, + 1, + 0, + 0, + 0, + 6, + 0, + 0, + 2, + 0, + 0, + 2, + 1, + 0, + 1, + 0, + 0, + 2, + 0, + 1, + 2, + 3 + ], + "weighted_loads": [ + 0.04325961694121361, + 0.0831657312810421, + 0.19309940189123154, + 0.0, + 0.02611524425446987, + 0.0, + 0.0, + 0.48867677710950375, + 0.06987199373543262, + 0.0, + 0.0, + 0.0, + 0.0, + 0.04318717494606972, + 0.0, + 0.9325893186032772, + 0.0, + 0.24365502782166004, + 0.14335979893803596, + 0.0, + 0.7909110318869352, + 0.060234639793634415, + 0.09180271625518799, + 0.30900974944233894, + 2.0977501310408115, + 0.23090293630957603, + 0.025935010984539986, + 0.031093424186110497, + 0.144090935587883, + 0.46290462277829647, + 0.04826207458972931, + 0.0, + 0.0, + 0.346014603972435, + 0.019088637083768845, + 0.06053462065756321, + 0.03488936275243759, + 0.1441153660416603, + 0.0, + 0.0, + 0.09474483504891396, + 0.036071956157684326, + 0.4267877973616123, + 0.04348374158143997, + 0.0, + 0.0, + 0.0, + 0.6652055084705353, + 0.0, + 0.0, + 0.10196532309055328, + 0.0, + 0.0, + 0.06465825065970421, + 0.03285291790962219, + 0.0, + 0.037277862429618835, + 0.0, + 0.0, + 0.1100531779229641, + 0.0, + 0.029210004955530167, + 0.34421495348215103, + 0.40759529173374176 + ], + "unique_experts": 39, + "load_cv": 1.7337477086970607, + "normalized_load_entropy": 0.7675828671475727, + "max_load_share": 0.16666666666666666 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "4001b9e7ae4ca24407641af40b2e7c0c5f35981e002cde57d7989ed0220bf982", + "route_weight_sha256": "ae34f6bad05090139ae7e5a563eaeb10778f4fd480dda84415dad9d014ad5617", + "loads": [ + 1, + 2, + 4, + 1, + 3, + 8, + 1, + 8, + 11, + 3, + 8, + 2, + 3, + 1, + 2, + 11, + 0, + 5, + 4, + 1, + 18, + 1, + 11, + 3, + 34, + 4, + 4, + 2, + 23, + 14, + 2, + 3, + 0, + 8, + 7, + 4, + 9, + 5, + 1, + 0, + 3, + 8, + 12, + 3, + 2, + 1, + 0, + 14, + 0, + 0, + 10, + 14, + 6, + 7, + 4, + 2, + 1, + 1, + 15, + 2, + 7, + 22, + 10, + 8 + ], + "weighted_loads": [ + 0.04325961694121361, + 0.0831657312810421, + 0.19309940189123154, + 0.1133539080619812, + 0.08702133037149906, + 0.25162072118837386, + 0.06776673346757889, + 0.526000240817666, + 0.6642002407461405, + 0.1313423104584217, + 0.32878198311664164, + 0.06508811563253403, + 0.06101670581847429, + 0.04318717494606972, + 0.0607377365231514, + 0.9325893186032772, + 0.0, + 0.24365502782166004, + 0.17608771100640297, + 0.030036892741918564, + 1.0161503609269857, + 0.060234639793634415, + 0.5938435066491365, + 0.3333300109952688, + 2.5035210009664297, + 0.23090293630957603, + 0.1756152343004942, + 0.0788076426833868, + 1.10032095387578, + 0.6851211208850145, + 0.08907603099942207, + 0.1394544616341591, + 0.0, + 0.6565685458481312, + 0.23442219803109765, + 0.1581335086375475, + 0.7236217372119427, + 1.051173485815525, + 0.052647143602371216, + 0.0, + 0.20834004506468773, + 0.44915817491710186, + 0.6283239023759961, + 0.25473130494356155, + 0.09289269521832466, + 0.0583321712911129, + 0.0, + 1.2580090973060578, + 0.0, + 0.0, + 0.47413807548582554, + 0.9520017486065626, + 0.16997162625193596, + 0.39492496475577354, + 0.23835085704922676, + 0.09597144275903702, + 0.037277862429618835, + 0.042600151151418686, + 0.6271416990784928, + 0.1100531779229641, + 0.23161710985004902, + 2.097373377997428, + 0.7397587185259908, + 2.4759166911244392 + ], + "unique_experts": 58, + "load_cv": 1.0639287779003086, + "normalized_load_entropy": 0.8840343425445333, + "max_load_share": 0.08854166666666667 + } + }, + "s0_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "799ee752ab640564ca7eff244661089f55c978161aca5215077bb0e4c78e7405", + "route_weight_sha256": "604df8f041b7d440f8e8c6deca27ce176c65888f42f00fe8ac387b63c4004103", + "loads": [ + 1, + 2, + 4, + 0, + 1, + 0, + 0, + 6, + 1, + 0, + 0, + 0, + 0, + 1, + 0, + 11, + 0, + 4, + 3, + 0, + 15, + 1, + 2, + 2, + 23, + 4, + 1, + 1, + 4, + 9, + 1, + 0, + 0, + 2, + 1, + 2, + 2, + 3, + 0, + 0, + 2, + 1, + 7, + 1, + 0, + 0, + 0, + 6, + 0, + 0, + 3, + 0, + 0, + 3, + 1, + 0, + 0, + 0, + 0, + 2, + 0, + 0, + 2, + 3 + ], + "weighted_loads": [ + 0.04282716289162636, + 0.08086241036653519, + 0.1931508667767048, + 0.0, + 0.02642235718667507, + 0.0, + 0.0, + 0.46608058363199234, + 0.049257002770900726, + 0.0, + 0.0, + 0.0, + 0.0, + 0.03930576145648956, + 0.0, + 0.9591630361974239, + 0.0, + 0.19065934233367443, + 0.14355099573731422, + 0.0, + 0.8975136484950781, + 0.08272484689950943, + 0.09825226664543152, + 0.29601961746811867, + 2.073457457125187, + 0.22680657356977463, + 0.024612803012132645, + 0.0313534252345562, + 0.15192515216767788, + 0.4602528288960457, + 0.04346739128232002, + 0.0, + 0.0, + 0.3508433923125267, + 0.018686123192310333, + 0.060481674037873745, + 0.06438342481851578, + 0.16145793348550797, + 0.0, + 0.0, + 0.10324804857373238, + 0.03767123445868492, + 0.4424295350909233, + 0.040735527873039246, + 0.0, + 0.0, + 0.0, + 0.6827260851860046, + 0.0, + 0.0, + 0.12482423149049282, + 0.0, + 0.0, + 0.09782788902521133, + 0.034063905477523804, + 0.0, + 0.0, + 0.0, + 0.0, + 0.1161603070795536, + 0.0, + 0.0, + 0.3753838986158371, + 0.4366653934121132 + ], + "unique_experts": 37, + "load_cv": 1.7739864529662308, + "normalized_load_entropy": 0.7576117709179744, + "max_load_share": 0.16666666666666666 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "5ca182aab45bcfbdfbd18ee5f089ab40eb5d54f5d6930762c5aed218a3e4f22c", + "route_weight_sha256": "e3d4f0b470909dc5bbfe6c57f691947eaa1cb2d62e4a82090d3706de2fe33391", + "loads": [ + 1, + 3, + 7, + 0, + 1, + 5, + 1, + 8, + 8, + 0, + 8, + 0, + 1, + 1, + 2, + 11, + 0, + 4, + 3, + 1, + 16, + 1, + 8, + 2, + 33, + 4, + 5, + 2, + 11, + 16, + 2, + 3, + 2, + 5, + 7, + 2, + 4, + 4, + 0, + 0, + 2, + 2, + 12, + 1, + 0, + 2, + 1, + 10, + 0, + 0, + 11, + 6, + 3, + 7, + 1, + 0, + 0, + 0, + 8, + 2, + 2, + 17, + 4, + 5 + ], + "weighted_loads": [ + 0.04282716289162636, + 0.13249247521162033, + 0.2945164293050766, + 0.0, + 0.02642235718667507, + 0.1659356077434495, + 0.09454122185707092, + 0.5637443624436855, + 0.407824769616127, + 0.0, + 0.32365267374552786, + 0.0, + 0.0027125454507768154, + 0.03930576145648956, + 0.05499502830207348, + 0.9591630361974239, + 0.0, + 0.19065934233367443, + 0.14355099573731422, + 0.03335191309452057, + 0.932652710005641, + 0.08272484689950943, + 0.5300104431807995, + 0.29601961746811867, + 2.4393700566142797, + 0.22680657356977463, + 0.5319847129285336, + 0.06720266118645668, + 0.43789071030914783, + 0.7344325445592403, + 0.08594558760523796, + 0.09236230701208115, + 0.09063904918730259, + 0.5028130523860455, + 0.19858043640851974, + 0.060481674037873745, + 0.26770303398370743, + 1.0263626351952553, + 0.0, + 0.0, + 0.10324804857373238, + 0.09538718685507774, + 0.7053197426721454, + 0.040735527873039246, + 0.0, + 0.11271686106920242, + 0.06045151501893997, + 1.0977929222863168, + 0.0, + 0.0, + 0.5125312339514494, + 0.3830752819776535, + 0.08607985824346542, + 0.28491364419460297, + 0.034063905477523804, + 0.0, + 0.0, + 0.0, + 0.31147108040750027, + 0.1161603070795536, + 0.08875034749507904, + 1.384310893714428, + 0.4205900769447908, + 1.448934145271778 + ], + "unique_experts": 52, + "load_cv": 1.2341588828623924, + "normalized_load_entropy": 0.8545509904680587, + "max_load_share": 0.11458333333333333 + } + }, + "s1_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "414994e94fa80209adad55b336139fe2d1f9bfc5811766ceb8fd4d02cd11cae0", + "route_weight_sha256": "cebe635151a428b78655102c01341ab0205739ca640aa859d492185a399871c0", + "loads": [ + 1, + 2, + 4, + 0, + 1, + 0, + 0, + 6, + 1, + 0, + 0, + 0, + 0, + 1, + 0, + 10, + 0, + 5, + 3, + 0, + 12, + 1, + 2, + 2, + 23, + 4, + 1, + 1, + 5, + 9, + 1, + 0, + 0, + 2, + 1, + 2, + 1, + 3, + 0, + 0, + 2, + 1, + 7, + 1, + 0, + 0, + 0, + 7, + 0, + 0, + 3, + 0, + 1, + 2, + 1, + 0, + 0, + 0, + 0, + 3, + 0, + 1, + 2, + 3 + ], + "weighted_loads": [ + 0.041588179767131805, + 0.09176531806588173, + 0.1924077905714512, + 0.0, + 0.030800217762589455, + 0.0, + 0.0, + 0.45030803233385086, + 0.045445993542671204, + 0.0, + 0.0, + 0.0, + 0.0, + 0.03999781236052513, + 0.0, + 0.8973589800298214, + 0.0, + 0.23663034290075302, + 0.1430835761129856, + 0.0, + 0.8024947047233582, + 0.06823824346065521, + 0.09423409402370453, + 0.29542945325374603, + 2.0675120130181313, + 0.2192063331604004, + 0.026811927556991577, + 0.030782373622059822, + 0.1859091967344284, + 0.4732936881482601, + 0.04344873130321503, + 0.0, + 0.0, + 0.3347638249397278, + 0.0172909926623106, + 0.0607520155608654, + 0.03436574712395668, + 0.15541263669729233, + 0.0, + 0.0, + 0.09784668311476707, + 0.039306640625, + 0.45937858894467354, + 0.043518707156181335, + 0.0, + 0.0, + 0.0, + 0.7013101261109114, + 0.0, + 0.0, + 0.1302859280258417, + 0.0, + 0.02343234047293663, + 0.0638766661286354, + 0.03467905893921852, + 0.0, + 0.0, + 0.0, + 0.0, + 0.15834903344511986, + 0.0, + 0.02899368852376938, + 0.38757649809122086, + 0.4195559024810791 + ], + "unique_experts": 39, + "load_cv": 1.7044242317488731, + "normalized_load_entropy": 0.7709659803173229, + "max_load_share": 0.16666666666666666 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "314d4ae657541f3afa394704a778079f3cdf1c8f4f4828d7f040ec4874cd2f4a", + "route_weight_sha256": "c12c9f548ae27bd209c9c0a71c692658e63966fd244090db8878b451abac3998", + "loads": [ + 1, + 3, + 6, + 1, + 3, + 8, + 1, + 8, + 9, + 3, + 7, + 2, + 3, + 1, + 2, + 10, + 0, + 5, + 4, + 2, + 17, + 1, + 13, + 3, + 33, + 4, + 4, + 1, + 24, + 15, + 1, + 4, + 0, + 8, + 7, + 4, + 9, + 6, + 1, + 0, + 3, + 8, + 13, + 4, + 1, + 2, + 0, + 14, + 0, + 0, + 12, + 14, + 7, + 7, + 4, + 2, + 0, + 0, + 14, + 3, + 5, + 22, + 9, + 6 + ], + "weighted_loads": [ + 0.041588179767131805, + 0.14327098801732063, + 0.25502297282218933, + 0.1133539080619812, + 0.09170630387961864, + 0.24561926175374538, + 0.04021750018000603, + 0.5328315235674381, + 0.6353946663439274, + 0.1313423104584217, + 0.3232247943524271, + 0.06508811563253403, + 0.06101670581847429, + 0.03999781236052513, + 0.0607377365231514, + 0.8973589800298214, + 0.0, + 0.23663034290075302, + 0.17581148818135262, + 0.06029936857521534, + 1.0277340337634087, + 0.06823824346065521, + 0.7865376397967339, + 0.3197497148066759, + 2.434956042096019, + 0.2192063331604004, + 0.1454721838235855, + 0.030782373622059822, + 1.1421392150223255, + 0.7347063012421131, + 0.04344873130321503, + 0.17530625313520432, + 0.0, + 0.645317766815424, + 0.24734187172725797, + 0.15835090354084969, + 0.6305720806121826, + 1.0992945842444897, + 0.044178713113069534, + 0.0, + 0.21144189313054085, + 0.45239285938441753, + 0.8201188975945115, + 0.3279249295592308, + 0.0391542986035347, + 0.10027847066521645, + 0.0, + 1.3529007758479565, + 0.0, + 0.0, + 0.6452627945691347, + 0.9081724788993597, + 0.1934039667248726, + 0.3857103977352381, + 0.2401769980788231, + 0.09597144275903702, + 0.0, + 0.0, + 0.628411864861846, + 0.15834903344511986, + 0.1698321159929037, + 2.048673760611564, + 0.7930959820514545, + 1.4709193259477615 + ], + "unique_experts": 56, + "load_cv": 1.0594318445909268, + "normalized_load_entropy": 0.8820910893169331, + "max_load_share": 0.0859375 + } + }, + "s0_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "e90771244a6ac81e4290f583cb4463412920706704c5ed4a034396d6c0a48886", + "route_weight_sha256": "7f6d8fb6c727d407803dd1f64421a4ff73a01f63c3441b47959c01276b7186af", + "loads": [ + 1, + 2, + 4, + 0, + 1, + 0, + 0, + 7, + 1, + 0, + 0, + 0, + 0, + 1, + 0, + 11, + 0, + 5, + 3, + 0, + 13, + 1, + 2, + 2, + 23, + 4, + 1, + 1, + 4, + 9, + 1, + 0, + 0, + 2, + 1, + 2, + 2, + 3, + 0, + 0, + 2, + 1, + 6, + 1, + 0, + 1, + 0, + 6, + 0, + 0, + 2, + 0, + 1, + 3, + 1, + 0, + 0, + 0, + 0, + 2, + 0, + 0, + 2, + 3 + ], + "weighted_loads": [ + 0.04315977916121483, + 0.08345689997076988, + 0.22949575632810593, + 0.0, + 0.02795647643506527, + 0.0, + 0.0, + 0.5253224726766348, + 0.044028811156749725, + 0.0, + 0.0, + 0.0, + 0.0, + 0.045202575623989105, + 0.0, + 0.9285597801208496, + 0.0, + 0.22859123535454273, + 0.134369395673275, + 0.0, + 0.79890719614923, + 0.07674422115087509, + 0.09691738709807396, + 0.29906508326530457, + 2.0692454800009727, + 0.21633593551814556, + 0.024690216407179832, + 0.031876396387815475, + 0.15090913884341717, + 0.4570316355675459, + 0.04506296291947365, + 0.0, + 0.0, + 0.3681081607937813, + 0.02401942014694214, + 0.062086446210742, + 0.06932831928133965, + 0.15735134109854698, + 0.0, + 0.0, + 0.10232570022344589, + 0.03879883140325546, + 0.3821808993816376, + 0.04529028758406639, + 0.0, + 0.03146255016326904, + 0.0, + 0.6701047196984291, + 0.0, + 0.0, + 0.10401510074734688, + 0.0, + 0.024416906759142876, + 0.09441611357033253, + 0.032292913645505905, + 0.0, + 0.0, + 0.0, + 0.0, + 0.11219517514109612, + 0.0, + 0.0, + 0.3074216917157173, + 0.41513026505708694 + ], + "unique_experts": 39, + "load_cv": 1.7259768275506353, + "normalized_load_entropy": 0.7692577728817669, + "max_load_share": 0.16666666666666666 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "dfdb4d10a31175138ec29ee9cbcd1b79ce138118fd6f05e538ae6207cf02d410", + "route_weight_sha256": "0a0f61241230be71e3b8290d098022b44815baf7d31bb55039c0a35c91de4f33", + "loads": [ + 1, + 3, + 6, + 0, + 1, + 4, + 1, + 9, + 9, + 0, + 9, + 0, + 2, + 1, + 2, + 11, + 0, + 5, + 3, + 0, + 14, + 1, + 6, + 2, + 31, + 4, + 2, + 1, + 12, + 16, + 1, + 2, + 2, + 5, + 9, + 3, + 5, + 6, + 1, + 0, + 3, + 2, + 10, + 1, + 0, + 4, + 0, + 11, + 0, + 0, + 9, + 6, + 4, + 8, + 1, + 0, + 0, + 0, + 9, + 2, + 2, + 17, + 4, + 5 + ], + "weighted_loads": [ + 0.04315977916121483, + 0.13161378353834152, + 0.29466868564486504, + 0.0, + 0.02795647643506527, + 0.11889178876299411, + 0.03217513859272003, + 0.6158298011869192, + 0.48582229763269424, + 0.0, + 0.37919079908169806, + 0.0, + 0.03529150178655982, + 0.045202575623989105, + 0.05499502830207348, + 0.9285597801208496, + 0.0, + 0.22859123535454273, + 0.134369395673275, + 0.0, + 0.8340462576597929, + 0.07674422115087509, + 0.35155095532536507, + 0.29906508326530457, + 2.373532010242343, + 0.21633593551814556, + 0.06614169664680958, + 0.031876396387815475, + 0.4722123648971319, + 0.7376039680093527, + 0.04506296291947365, + 0.05787960812449455, + 0.06760147400200367, + 0.5200778208673, + 0.2790182791650295, + 0.09755116142332554, + 0.351454958319664, + 1.0975020192563534, + 0.03756461665034294, + 0.0, + 0.1377159245312214, + 0.09651478379964828, + 0.5308747394010425, + 0.04529028758406639, + 0.0, + 0.14931748062372208, + 0.0, + 1.091948765097186, + 0.0, + 0.0, + 0.4013478122651577, + 0.4095587842166424, + 0.1104967650026083, + 0.32835577242076397, + 0.032292913645505905, + 0.0, + 0.0, + 0.0, + 0.3395045828074217, + 0.11219517514109612, + 0.08464371785521507, + 1.3461551330983639, + 0.34997826104518026, + 1.4273990169167519 + ], + "unique_experts": 51, + "load_cv": 1.1941214033447043, + "normalized_load_entropy": 0.8562204797535816, + "max_load_share": 0.1076388888888889 + } + }, + "s1_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "8fbabffbc57a5d33205fac10cc964265b65a4531fe2f93045c787c2c6e42d574", + "route_weight_sha256": "ff12bc28c0bb10ed7550aa3165aa4d9371a1c90e071493d4b5c6d831c1b68e3e", + "loads": [ + 1, + 2, + 4, + 0, + 1, + 0, + 0, + 7, + 2, + 0, + 0, + 0, + 0, + 1, + 0, + 9, + 0, + 6, + 3, + 0, + 15, + 1, + 2, + 2, + 23, + 3, + 0, + 1, + 6, + 7, + 1, + 0, + 0, + 2, + 1, + 1, + 1, + 3, + 0, + 0, + 2, + 1, + 7, + 1, + 0, + 2, + 0, + 6, + 0, + 0, + 2, + 0, + 1, + 2, + 2, + 0, + 0, + 0, + 0, + 2, + 0, + 0, + 2, + 3 + ], + "weighted_loads": [ + 0.038173697888851166, + 0.09804732725024223, + 0.23710792139172554, + 0.0, + 0.029102426022291183, + 0.0, + 0.0, + 0.49281503818929195, + 0.064718684181571, + 0.0, + 0.0, + 0.0, + 0.0, + 0.036855507642030716, + 0.0, + 0.8013245314359665, + 0.0, + 0.29889369010925293, + 0.13283754512667656, + 0.0, + 0.8917459100484848, + 0.0679636299610138, + 0.09103558957576752, + 0.27357644587755203, + 2.0063295625150204, + 0.17382602021098137, + 0.0, + 0.03357023373246193, + 0.2560326121747494, + 0.3896644152700901, + 0.051812127232551575, + 0.0, + 0.0, + 0.3581566661596298, + 0.02264290116727352, + 0.04457077756524086, + 0.035030197352170944, + 0.14792543649673462, + 0.0, + 0.0, + 0.09836624935269356, + 0.03411512076854706, + 0.40530042722821236, + 0.0448441244661808, + 0.0, + 0.06442595086991787, + 0.0, + 0.6894677951931953, + 0.0, + 0.0, + 0.10412171110510826, + 0.0, + 0.022998975589871407, + 0.057680683210492134, + 0.06316192075610161, + 0.0, + 0.0, + 0.0, + 0.0, + 0.09489116072654724, + 0.0, + 0.0, + 0.2833159863948822, + 0.4001448079943657 + ], + "unique_experts": 38, + "load_cv": 1.7434126025199828, + "normalized_load_entropy": 0.7648531856450762, + "max_load_share": 0.16666666666666666 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "ffaeb3104f99c0f66a2e27f4fff13e56dde07b2f2166e37fcef49b9a1a5b40c5", + "route_weight_sha256": "999a206439b959735014e0d7dffa1df72a1436138288f7ea0725ff14876fa1d4", + "loads": [ + 1, + 3, + 4, + 1, + 3, + 8, + 1, + 9, + 12, + 3, + 6, + 2, + 4, + 1, + 2, + 9, + 0, + 6, + 4, + 2, + 21, + 1, + 11, + 3, + 32, + 5, + 0, + 1, + 26, + 12, + 2, + 3, + 0, + 9, + 7, + 4, + 11, + 7, + 0, + 0, + 3, + 8, + 12, + 3, + 1, + 3, + 0, + 13, + 0, + 0, + 9, + 14, + 7, + 9, + 5, + 2, + 0, + 0, + 16, + 2, + 5, + 21, + 9, + 6 + ], + "weighted_loads": [ + 0.038173697888851166, + 0.1325448788702488, + 0.23710792139172554, + 0.1133539080619812, + 0.09000851213932037, + 0.24526818853337318, + 0.038749247789382935, + 0.6139351520687342, + 0.7421247195452452, + 0.1313423104584217, + 0.27959036850370467, + 0.06508811563253403, + 0.09119873214513063, + 0.036855507642030716, + 0.0607377365231514, + 0.8013245314359665, + 0.0, + 0.29889369010925293, + 0.16556545719504356, + 0.07728377357125282, + 1.1493485532701015, + 0.0679636299610138, + 0.586427703499794, + 0.2978967074304819, + 2.3351815175265074, + 0.2491067722439766, + 0.0, + 0.03357023373246193, + 1.2530944496393204, + 0.6118809133768082, + 0.09628044068813324, + 0.1394544616341591, + 0.0, + 0.7064950577914715, + 0.23133091675117612, + 0.18843065947294235, + 0.7402914762496948, + 1.1242004670202732, + 0.0, + 0.0, + 0.21196145936846733, + 0.4472013395279646, + 0.5549339214339852, + 0.2560916878283024, + 0.0391542986035347, + 0.12275812216103077, + 0.0, + 1.2521994307171553, + 0.0, + 0.0, + 0.43127451837062836, + 0.941268676891923, + 0.19297060184180737, + 0.4735971800982952, + 0.2686598598957062, + 0.09597144275903702, + 0.0, + 0.0, + 0.6983745861798525, + 0.09489116072654724, + 0.16493095271289349, + 2.0078607951290905, + 0.6750840902095661, + 1.4515082314610481 + ], + "unique_experts": 54, + "load_cv": 1.0793194872490515, + "normalized_load_entropy": 0.8757961176533123, + "max_load_share": 0.08333333333333333 + } + }, + "s0_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "a86a4e9c60cfa2b5c54c3abd36787c5d31f637b43ba57ce2b633ac2c8f61869f", + "route_weight_sha256": "9bedfba900ba808557afe9126790a8dca02279f9e1d69bd8c4706d391ef3c791", + "loads": [ + 1, + 2, + 4, + 0, + 1, + 0, + 0, + 6, + 1, + 0, + 0, + 0, + 0, + 1, + 0, + 10, + 0, + 5, + 3, + 0, + 13, + 1, + 2, + 2, + 23, + 4, + 0, + 1, + 4, + 9, + 1, + 0, + 0, + 2, + 1, + 2, + 2, + 3, + 0, + 0, + 2, + 1, + 6, + 1, + 0, + 2, + 0, + 7, + 0, + 0, + 3, + 0, + 1, + 3, + 1, + 0, + 0, + 0, + 0, + 2, + 0, + 0, + 2, + 3 + ], + "weighted_loads": [ + 0.039512623101472855, + 0.0835166871547699, + 0.21103094145655632, + 0.0, + 0.025336571037769318, + 0.0, + 0.0, + 0.4748467952013016, + 0.04232907295227051, + 0.0, + 0.0, + 0.0, + 0.0, + 0.045260291546583176, + 0.0, + 0.885402012616396, + 0.0, + 0.22951052151620388, + 0.13597312942147255, + 0.0, + 0.8125291150063276, + 0.0727018490433693, + 0.09966301918029785, + 0.2956686429679394, + 2.0923528522253036, + 0.2259929832071066, + 0.0, + 0.032746292650699615, + 0.15390315279364586, + 0.45582412742078304, + 0.045171353965997696, + 0.0, + 0.0, + 0.36647405475378036, + 0.023672273382544518, + 0.06042379327118397, + 0.06162921525537968, + 0.16262542456388474, + 0.0, + 0.0, + 0.10361484438180923, + 0.03782434016466141, + 0.40352388471364975, + 0.04604767635464668, + 0.0, + 0.06566268764436245, + 0.0, + 0.7246260195970535, + 0.0, + 0.0, + 0.13375786319375038, + 0.0, + 0.02341546304523945, + 0.09229527972638607, + 0.033932458609342575, + 0.0, + 0.0, + 0.0, + 0.0, + 0.11149576678872108, + 0.0, + 0.0, + 0.31722576916217804, + 0.40957218408584595 + ], + "unique_experts": 38, + "load_cv": 1.7122929276100187, + "normalized_load_entropy": 0.7693538832126524, + "max_load_share": 0.16666666666666666 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "2c561e914f183b6527a85d8c3a7c0bd28a34a2620d7e1706413a51ef44bac16d", + "route_weight_sha256": "222936f7a62ea213d29f87b12f06dbd65cacee7b967cc0e43d2f94c9b50a37f2", + "loads": [ + 2, + 3, + 7, + 0, + 1, + 4, + 0, + 8, + 9, + 0, + 8, + 0, + 1, + 1, + 3, + 10, + 0, + 6, + 3, + 1, + 14, + 1, + 7, + 2, + 32, + 4, + 1, + 2, + 11, + 16, + 2, + 1, + 2, + 5, + 8, + 2, + 4, + 6, + 0, + 0, + 3, + 3, + 11, + 2, + 0, + 3, + 0, + 12, + 0, + 0, + 11, + 6, + 5, + 6, + 1, + 0, + 0, + 0, + 8, + 2, + 2, + 17, + 4, + 5 + ], + "weighted_loads": [ + 0.07627790793776512, + 0.141981303691864, + 0.3152051270008087, + 0.0, + 0.025336571037769318, + 0.12127555732149631, + 0.0, + 0.5663520134985447, + 0.4326103441417217, + 0.0, + 0.32365267374552786, + 0.0, + 0.0027125454507768154, + 0.045260291546583176, + 0.08784442581236362, + 0.885402012616396, + 0.0, + 0.2634927649050951, + 0.13597312942147255, + 0.041023898869752884, + 0.8476681765168905, + 0.0727018490433693, + 0.4019507169723511, + 0.2956686429679394, + 2.4384145941585302, + 0.2259929832071066, + 0.041212841868400574, + 0.06306552141904831, + 0.4398687109351158, + 0.737157778814435, + 0.07663033902645111, + 0.03214442357420921, + 0.08115765266120434, + 0.5184437148272991, + 0.2493692021816969, + 0.06042379327118397, + 0.29401283897459507, + 1.1055174712091684, + 0.0, + 0.0, + 0.15096861124038696, + 0.16020069271326065, + 0.6213003871962428, + 0.08235564082860947, + 0.0, + 0.11322741024196148, + 0.0, + 1.0990122619550675, + 0.0, + 0.0, + 0.5258197672665119, + 0.46110157668590546, + 0.13895627111196518, + 0.23474262841045856, + 0.033932458609342575, + 0.0, + 0.0, + 0.0, + 0.3051651809364557, + 0.11149576678872108, + 0.0892815813422203, + 1.362333882600069, + 0.3602582219755277, + 1.4218409359455109 + ], + "unique_experts": 50, + "load_cv": 1.208253509496197, + "normalized_load_entropy": 0.8544669261906129, + "max_load_share": 0.1111111111111111 + } + }, + "s1_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "414bcf283bd585e46087960310f12e1c69fa6ccda9fcfbe8c409e4fbd19760a9", + "route_weight_sha256": "6e8cafb200b1403fc25d6ffbfb285a0debb22908abed5ab93ec1f491946f0197", + "loads": [ + 1, + 2, + 5, + 0, + 1, + 0, + 0, + 7, + 2, + 0, + 0, + 0, + 0, + 1, + 0, + 10, + 0, + 6, + 3, + 0, + 14, + 1, + 2, + 2, + 23, + 3, + 0, + 1, + 6, + 6, + 1, + 0, + 0, + 2, + 1, + 2, + 1, + 3, + 0, + 0, + 2, + 1, + 6, + 1, + 0, + 1, + 0, + 7, + 0, + 0, + 2, + 0, + 1, + 2, + 1, + 0, + 0, + 0, + 0, + 2, + 1, + 0, + 2, + 3 + ], + "weighted_loads": [ + 0.03888993337750435, + 0.09279734268784523, + 0.28288019448518753, + 0.0, + 0.027422131970524788, + 0.0, + 0.0, + 0.49494024366140366, + 0.06203432008624077, + 0.0, + 0.0, + 0.0, + 0.0, + 0.03535114601254463, + 0.0, + 0.8396667316555977, + 0.0, + 0.30684424191713333, + 0.1298825852572918, + 0.0, + 0.8274276927113533, + 0.06615588814020157, + 0.08913467451930046, + 0.27539418637752533, + 1.9832810387015343, + 0.17746858671307564, + 0.0, + 0.034226495772600174, + 0.27556566148996353, + 0.3350987434387207, + 0.05030826851725578, + 0.0, + 0.0, + 0.35784394294023514, + 0.02329370565712452, + 0.06196705251932144, + 0.03235221654176712, + 0.14961741492152214, + 0.0, + 0.0, + 0.0970003679394722, + 0.035713355988264084, + 0.3627043403685093, + 0.045003168284893036, + 0.0, + 0.03195298835635185, + 0.0, + 0.7421575747430325, + 0.0, + 0.0, + 0.10863875597715378, + 0.0, + 0.022969836369156837, + 0.05653844587504864, + 0.03425747901201248, + 0.0, + 0.0, + 0.0, + 0.0, + 0.08908366784453392, + 0.030999360606074333, + 0.0, + 0.27761422097682953, + 0.41567154973745346 + ], + "unique_experts": 39, + "load_cv": 1.7279228241690638, + "normalized_load_entropy": 0.7686484792019217, + "max_load_share": 0.16666666666666666 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "049c63ea13d94c8e97045f60de8af2e157749c92a2c1ceb742d8f7bbd2ce7566", + "route_weight_sha256": "6b7e79df44f68e6b1fa886ff1945526b2776e2b0be00b843e0c5ca06886b8a39", + "loads": [ + 1, + 2, + 6, + 1, + 3, + 8, + 1, + 9, + 11, + 3, + 6, + 2, + 3, + 1, + 2, + 10, + 0, + 6, + 4, + 3, + 19, + 1, + 9, + 3, + 33, + 4, + 0, + 1, + 26, + 11, + 2, + 3, + 0, + 8, + 7, + 5, + 9, + 8, + 1, + 0, + 3, + 9, + 10, + 4, + 1, + 2, + 0, + 14, + 0, + 0, + 11, + 15, + 8, + 9, + 4, + 2, + 0, + 0, + 17, + 2, + 6, + 21, + 8, + 6 + ], + "weighted_loads": [ + 0.03888993337750435, + 0.09279734268784523, + 0.3177065886557102, + 0.1133539080619812, + 0.08832821808755398, + 0.24546461750287563, + 0.0407370962202549, + 0.5860367976129055, + 0.6927611418068409, + 0.1313423104584217, + 0.27959036850370467, + 0.06508811563253403, + 0.06101670581847429, + 0.03535114601254463, + 0.0607377365231514, + 0.8396667316555977, + 0.0, + 0.30684424191713333, + 0.1626104973256588, + 0.10856911540031433, + 1.0526670217514038, + 0.06615588814020157, + 0.5178312510251999, + 0.2997144479304552, + 2.354374947026372, + 0.2322881817817688, + 0.0, + 0.034226495772600174, + 1.2875476703047752, + 0.5573152415454388, + 0.09932779148221016, + 0.1394544616341591, + 0.0, + 0.6683978848159313, + 0.22651675762608647, + 0.19948765262961388, + 0.629209216684103, + 1.170723658055067, + 0.039922893047332764, + 0.0, + 0.21059557795524597, + 0.4973066318780184, + 0.4748110482469201, + 0.29900702461600304, + 0.0391542986035347, + 0.09028515964746475, + 0.0, + 1.3028269379865378, + 0.0, + 0.0, + 0.5503436475992203, + 0.9914293680340052, + 0.2187552060931921, + 0.48366263322532177, + 0.23975541815161705, + 0.09597144275903702, + 0.0, + 0.0, + 0.7342081144452095, + 0.08908366784453392, + 0.19316953420639038, + 1.9811842744238675, + 0.6263008959358558, + 1.467034973204136 + ], + "unique_experts": 55, + "load_cv": 1.078112419411301, + "normalized_load_entropy": 0.877719632832098, + "max_load_share": 0.0859375 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.9503105590062113, + "mean_token_weighted_tv": 0.01349202871484601, + "aggregate_load_tv": 0.028985507246376812 + }, + "system_bos": { + "tokens": 23, + "ordered_topk_exact_tokens": 16, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.9254658385093167, + "mean_token_weighted_tv": 0.019595922598534304, + "aggregate_load_tv": 0.043478260869565216 + }, + "system_x": { + "tokens": 23, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 13, + "mean_set_jaccard": 0.8757763975155279, + "mean_token_weighted_tv": 0.029289788080622322, + "aggregate_load_tv": 0.06521739130434782 + }, + "system_period": { + "tokens": 23, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 13, + "mean_set_jaccard": 0.8757763975155279, + "mean_token_weighted_tv": 0.03273690601243921, + "aggregate_load_tv": 0.057971014492753624 + }, + "bos_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 17, + "set_exact_tokens": 21, + "mean_set_jaccard": 0.9751552795031057, + "mean_token_weighted_tv": 0.01507683420229865, + "aggregate_load_tv": 0.014492753623188404 + }, + "bos_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 18, + "mean_set_jaccard": 0.9378881987577639, + "mean_token_weighted_tv": 0.020102497028267902, + "aggregate_load_tv": 0.036231884057971016 + }, + "x_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.9130434782608695, + "mean_token_weighted_tv": 0.023208557385141434, + "aggregate_load_tv": 0.043478260869565216 + }, + "x_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 8, + "set_exact_tokens": 11, + "mean_set_jaccard": 0.8322981366459629, + "mean_token_weighted_tv": 0.038862313710800976, + "aggregate_load_tv": 0.06521739130434781 + }, + "period_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.9130434782608695, + "mean_token_weighted_tv": 0.021904711166153782, + "aggregate_load_tv": 0.05072463768115942 + }, + "period_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 12, + "mean_set_jaccard": 0.8354037267080746, + "mean_token_weighted_tv": 0.04039532699338768, + "aggregate_load_tv": 0.06521739130434784 + } + } + }, + "layer_25": { + "layer": 25, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "389538997b1ffb9b8b55bc5f528ac3651d2740b93eaa5b509f8fda8d5c651aa8", + "route_weight_sha256": "2b09514b99b55122e06e33aff6f3cfef5b83492f6abd6d53c935ff8133c6d0c6", + "loads": [ + 1, + 0, + 4, + 0, + 0, + 0, + 4, + 4, + 1, + 7, + 1, + 4, + 2, + 1, + 0, + 0, + 0, + 6, + 1, + 2, + 1, + 0, + 5, + 0, + 0, + 4, + 2, + 1, + 3, + 3, + 2, + 1, + 4, + 4, + 1, + 3, + 4, + 6, + 1, + 1, + 2, + 3, + 2, + 0, + 0, + 0, + 9, + 0, + 4, + 6, + 1, + 0, + 1, + 0, + 4, + 3, + 9, + 3, + 0, + 2, + 1, + 0, + 2, + 2 + ], + "weighted_loads": [ + 0.05526982620358467, + 0.0, + 0.16418527625501156, + 0.0, + 0.0, + 0.0, + 0.2896426357328892, + 0.16736623272299767, + 0.03770855814218521, + 0.39687016792595387, + 0.040715064853429794, + 0.33357420563697815, + 0.15049544721841812, + 0.028572769835591316, + 0.0, + 0.0, + 0.0, + 0.5669883154332638, + 0.035195376724004745, + 0.3177458196878433, + 0.02678120881319046, + 0.0, + 0.41804379038512707, + 0.0, + 0.0, + 0.3857413977384567, + 0.1297977827489376, + 0.05258127674460411, + 0.19759481400251389, + 0.10881050117313862, + 0.0868292786180973, + 0.04766009375452995, + 0.3907049670815468, + 0.3207909166812897, + 0.031064284965395927, + 0.11124922335147858, + 0.29336271807551384, + 0.47965760715305805, + 0.02212202362716198, + 0.03289776295423508, + 0.12946447730064392, + 0.12633197754621506, + 0.10654238983988762, + 0.0, + 0.0, + 0.0, + 0.5845275577157736, + 0.0, + 0.17952099069952965, + 0.42691968753933907, + 0.05048589035868645, + 0.0, + 0.039626285433769226, + 0.0, + 0.32162170857191086, + 0.14489341527223587, + 0.8037785738706589, + 0.2580668330192566, + 0.0, + 0.0827530026435852, + 0.07919678092002869, + 0.0, + 0.4588264971971512, + 0.07127473130822182 + ], + "unique_experts": 46, + "load_cv": 1.0214050229766756, + "normalized_load_entropy": 0.8690796498244252, + "max_load_share": 0.06521739130434782 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "e70106f265c53c2cc555656dae0d89caf198cd15538b7595f5b0cf4bd184e3cd", + "route_weight_sha256": "9bd3e36f89109de4bc480d5a3ffd7b26d0956e8ce6ffcb653abe1da8fafcec18", + "loads": [ + 3, + 17, + 11, + 1, + 0, + 0, + 10, + 4, + 1, + 7, + 12, + 8, + 6, + 1, + 0, + 0, + 0, + 10, + 2, + 2, + 1, + 0, + 5, + 3, + 0, + 4, + 2, + 2, + 4, + 6, + 3, + 2, + 5, + 5, + 3, + 3, + 4, + 7, + 12, + 4, + 8, + 3, + 2, + 1, + 4, + 9, + 13, + 0, + 4, + 8, + 11, + 0, + 8, + 0, + 13, + 3, + 10, + 7, + 0, + 2, + 3, + 0, + 6, + 3 + ], + "weighted_loads": [ + 0.17533447220921516, + 1.2415189212188125, + 0.6564384307712317, + 0.04914705082774162, + 0.0, + 0.0, + 0.6998179480433464, + 0.16736623272299767, + 0.03770855814218521, + 0.39687016792595387, + 1.0601735673844814, + 0.9787540826946497, + 0.47058189287781715, + 0.028572769835591316, + 0.0, + 0.0, + 0.0, + 0.6977655775845051, + 0.08064251765608788, + 0.3177458196878433, + 0.02678120881319046, + 0.0, + 0.41804379038512707, + 0.12052246369421482, + 0.0, + 0.3857413977384567, + 0.1297977827489376, + 0.10868826881051064, + 0.23962002992630005, + 0.23714247532188892, + 0.13540533557534218, + 0.13372879102826118, + 0.44316215440630913, + 0.383837528526783, + 0.12629068829119205, + 0.11124922335147858, + 0.29336271807551384, + 0.5182454008609056, + 1.4866160843521357, + 0.3773740753531456, + 0.38372132182121277, + 0.12633197754621506, + 0.10654238983988762, + 0.032854460179805756, + 0.32366038486361504, + 0.8112677186727524, + 0.7166718047810718, + 0.0, + 0.17952099069952965, + 0.5160847753286362, + 0.6610435992479324, + 0.0, + 0.3876461172476411, + 0.0, + 0.814715416636318, + 0.14489341527223587, + 0.8500395826995373, + 0.4354054629802704, + 0.0, + 0.0827530026435852, + 0.17824248224496841, + 0.0, + 0.8317728191614151, + 0.13509142771363258 + ], + "unique_experts": 52, + "load_cv": 0.9018157267082181, + "normalized_load_entropy": 0.8957173892572684, + "max_load_share": 0.059027777777777776 + } + }, + "s1_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "4107370143f00ee90390ad1ede5b49beb6478b512896ee1e5b3bae344c10ca22", + "route_weight_sha256": "aa450cb7ad58f89c1f3093fa4c3090181f50f01a0d6ae076b72b10f30b62b815", + "loads": [ + 1, + 0, + 2, + 0, + 0, + 0, + 4, + 4, + 1, + 8, + 1, + 4, + 2, + 1, + 0, + 0, + 0, + 6, + 1, + 3, + 0, + 0, + 4, + 0, + 0, + 4, + 2, + 1, + 4, + 5, + 1, + 1, + 4, + 4, + 1, + 3, + 4, + 5, + 1, + 1, + 2, + 3, + 2, + 0, + 0, + 0, + 9, + 0, + 4, + 7, + 1, + 0, + 1, + 0, + 4, + 3, + 9, + 3, + 0, + 2, + 1, + 0, + 2, + 2 + ], + "weighted_loads": [ + 0.05328376218676567, + 0.0, + 0.09917818754911423, + 0.0, + 0.0, + 0.0, + 0.2952189967036247, + 0.19002756848931313, + 0.03808817267417908, + 0.42853406071662903, + 0.04274217039346695, + 0.32575473934412, + 0.148624949157238, + 0.02906704880297184, + 0.0, + 0.0, + 0.0, + 0.5734962485730648, + 0.03308004140853882, + 0.3600066155195236, + 0.0, + 0.0, + 0.40488579496741295, + 0.0, + 0.0, + 0.3743624687194824, + 0.13627973943948746, + 0.05069484934210777, + 0.23489618115127087, + 0.170690244063735, + 0.05119941756129265, + 0.04388057067990303, + 0.39095211774110794, + 0.3210603669285774, + 0.030074816197156906, + 0.10867615230381489, + 0.28221000358462334, + 0.42319824174046516, + 0.023545272648334503, + 0.037277981638908386, + 0.11742154136300087, + 0.1250193826854229, + 0.10443438962101936, + 0.0, + 0.0, + 0.0, + 0.5820172857493162, + 0.0, + 0.1708096656948328, + 0.47836539149284363, + 0.05292379483580589, + 0.0, + 0.0392431877553463, + 0.0, + 0.3094068095088005, + 0.13047252967953682, + 0.8028495907783508, + 0.24542170763015747, + 0.0, + 0.08334055915474892, + 0.07590252161026001, + 0.0, + 0.4665798395872116, + 0.0732803326100111 + ], + "unique_experts": 45, + "load_cv": 1.0537936189730719, + "normalized_load_entropy": 0.8620323032500058, + "max_load_share": 0.06521739130434782 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "8ff2c6bf81a131f98cb4d447ac16371428ccd451e69838ab579128aa6f28183f", + "route_weight_sha256": "ccc19bda79de297785dd6924823bac266dfdc8c3d0eb5da5f3379a2761c99855", + "loads": [ + 4, + 23, + 13, + 1, + 0, + 1, + 10, + 4, + 3, + 9, + 24, + 7, + 10, + 1, + 0, + 0, + 0, + 14, + 3, + 4, + 3, + 7, + 4, + 5, + 0, + 4, + 3, + 2, + 6, + 9, + 3, + 4, + 9, + 5, + 4, + 3, + 4, + 11, + 11, + 6, + 9, + 3, + 3, + 1, + 9, + 14, + 12, + 0, + 4, + 8, + 13, + 0, + 8, + 6, + 16, + 4, + 11, + 9, + 0, + 3, + 5, + 1, + 7, + 4 + ], + "weighted_loads": [ + 0.3231430910527706, + 1.8092125905677676, + 0.7391897272318602, + 0.0717872902750969, + 0.0, + 0.038430385291576385, + 0.8436572812497616, + 0.19002756848931313, + 0.15136175230145454, + 0.4570283181965351, + 2.0260490477085114, + 0.9804381402209401, + 0.6507437005639076, + 0.02906704880297184, + 0.0, + 0.0, + 0.0, + 1.2213704958558083, + 0.12574470788240433, + 0.38437263667583466, + 0.25809165090322495, + 0.6457192189991474, + 0.40488579496741295, + 0.19667045027017593, + 0.0, + 0.3743624687194824, + 0.1693570762872696, + 0.10550932213664055, + 0.31220151111483574, + 0.32030236534774303, + 0.13738444820046425, + 0.5150994695723057, + 0.6222255527973175, + 0.36802545189857483, + 0.18617931008338928, + 0.10867615230381489, + 0.28221000358462334, + 0.6841871831566095, + 1.7135601788759232, + 0.48794378340244293, + 0.46356163173913956, + 0.1250193826854229, + 0.19046831503510475, + 0.030014201998710632, + 0.6582885831594467, + 1.2885913494974375, + 0.6688288734294474, + 0.0, + 0.1708096656948328, + 0.5222360156476498, + 0.7585482150316238, + 0.0, + 0.4787345970980823, + 0.4774506092071533, + 1.1563017605803907, + 0.1567306313663721, + 0.8843942452222109, + 0.5058395937085152, + 0.0, + 0.17263570055365562, + 0.32033319771289825, + 0.043069347739219666, + 0.9026417601853609, + 0.13560917414724827 + ], + "unique_experts": 56, + "load_cv": 0.8599903100229289, + "normalized_load_entropy": 0.9113824705133399, + "max_load_share": 0.0625 + } + }, + "s0_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "d64b3d01317201b357a92df4ab1322b0eb600e70c2229e591155cacf3e254101", + "route_weight_sha256": "0d00b30326c0639f56734486e99eb2c945562594f064013b21c65c89ebbe88c4", + "loads": [ + 1, + 0, + 3, + 0, + 0, + 0, + 4, + 3, + 1, + 7, + 1, + 4, + 2, + 0, + 0, + 0, + 0, + 7, + 1, + 3, + 1, + 1, + 3, + 0, + 0, + 4, + 2, + 1, + 3, + 4, + 1, + 1, + 4, + 4, + 1, + 3, + 4, + 6, + 1, + 0, + 2, + 2, + 2, + 0, + 1, + 0, + 9, + 0, + 3, + 7, + 1, + 0, + 1, + 0, + 4, + 3, + 9, + 4, + 0, + 2, + 1, + 0, + 3, + 3 + ], + "weighted_loads": [ + 0.05625203996896744, + 0.0, + 0.12463287264108658, + 0.0, + 0.0, + 0.0, + 0.28567225113511086, + 0.13915527611970901, + 0.03918570652604103, + 0.3471217639744282, + 0.0372081957757473, + 0.3365658074617386, + 0.16886860132217407, + 0.0, + 0.0, + 0.0, + 0.0, + 0.6272532865405083, + 0.034665558487176895, + 0.37719040364027023, + 0.026607206091284752, + 0.028644507750868797, + 0.36339543387293816, + 0.0, + 0.0, + 0.38584550470113754, + 0.1232757493853569, + 0.03941477835178375, + 0.18273993209004402, + 0.1330601405352354, + 0.04726216942071915, + 0.0442473329603672, + 0.4179196283221245, + 0.35325663164258003, + 0.02928520366549492, + 0.10663503408432007, + 0.3300372026860714, + 0.5012414082884789, + 0.02254546247422695, + 0.0, + 0.13711660355329514, + 0.09002389013767242, + 0.10845374688506126, + 0.0, + 0.028577188029885292, + 0.0, + 0.5985380709171295, + 0.0, + 0.16778282448649406, + 0.4850691370666027, + 0.05411284416913986, + 0.0, + 0.03761112317442894, + 0.0, + 0.3084561116993427, + 0.16902055218815804, + 0.8159806691110134, + 0.29591648653149605, + 0.0, + 0.08730820193886757, + 0.08091681450605392, + 0.0, + 0.4934186413884163, + 0.10103727132081985 + ], + "unique_experts": 46, + "load_cv": 1.0377256892720608, + "normalized_load_entropy": 0.8670345671742203, + "max_load_share": 0.06521739130434782 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "46ac00885d871ce94c7ee3c705b2a7cbf2020a67a5bbbc9c8cb31e11b89501e2", + "route_weight_sha256": "9ad29e8720376e11302299be7efce30fba7cbfacf3ee63cf45f2a2ed32090375", + "loads": [ + 2, + 17, + 10, + 1, + 0, + 0, + 11, + 4, + 1, + 7, + 12, + 7, + 6, + 0, + 0, + 0, + 0, + 11, + 2, + 3, + 1, + 1, + 3, + 3, + 0, + 4, + 2, + 1, + 4, + 7, + 3, + 2, + 5, + 5, + 3, + 4, + 5, + 6, + 11, + 2, + 8, + 3, + 2, + 2, + 6, + 8, + 11, + 0, + 3, + 10, + 11, + 0, + 7, + 0, + 14, + 3, + 9, + 8, + 0, + 2, + 3, + 0, + 7, + 5 + ], + "weighted_loads": [ + 0.116150613874197, + 1.209831672720611, + 0.6149801500141621, + 0.14756383001804352, + 0.0, + 0.0, + 0.7330294698476791, + 0.18759768083691597, + 0.03918570652604103, + 0.3471217639744282, + 1.1858125142753124, + 0.9701986014842987, + 0.5215436592698097, + 0.0, + 0.0, + 0.0, + 0.0, + 0.7580305486917496, + 0.07652484998106956, + 0.37719040364027023, + 0.026607206091284752, + 0.028644507750868797, + 0.36339543387293816, + 0.12052246369421482, + 0.0, + 0.38584550470113754, + 0.1232757493853569, + 0.03941477835178375, + 0.22476514801383018, + 0.24895036406815052, + 0.3217363879084587, + 0.13031603023409843, + 0.4703768156468868, + 0.41630324348807335, + 0.14237255230545998, + 0.14753296226263046, + 0.3905395083129406, + 0.5012414082884789, + 0.5775829721242189, + 0.4208241403102875, + 0.391373448073864, + 0.13931692019104958, + 0.10845374688506126, + 0.06411116197705269, + 0.3717357534915209, + 0.7523280791938305, + 0.6859303638339043, + 0.0, + 0.16778282448649406, + 0.5999153703451157, + 0.6646705530583858, + 0.0, + 0.38143809139728546, + 0.0, + 0.8298430345021188, + 0.16902055218815804, + 0.8159806691110134, + 0.4611631706357002, + 0.0, + 0.08730820193886757, + 0.17235179990530014, + 0.0, + 0.8663649633526802, + 0.18800944834947586 + ], + "unique_experts": 52, + "load_cv": 0.898386757155346, + "normalized_load_entropy": 0.8957598903696037, + "max_load_share": 0.059027777777777776 + } + }, + "s1_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "3724f02221d05bdaf378860606dd8fdf1834f59463bf113b32b864303625eaea", + "route_weight_sha256": "5a3634ec6c5d2964bb451f4af2fe122d3b93986e6acd026602d01b26477ba7b4", + "loads": [ + 1, + 0, + 2, + 0, + 0, + 0, + 4, + 4, + 1, + 8, + 2, + 4, + 2, + 1, + 0, + 0, + 0, + 7, + 1, + 3, + 1, + 0, + 4, + 0, + 0, + 4, + 2, + 1, + 3, + 4, + 1, + 1, + 4, + 4, + 1, + 3, + 4, + 5, + 1, + 1, + 2, + 2, + 1, + 0, + 0, + 0, + 10, + 0, + 3, + 7, + 1, + 0, + 1, + 0, + 4, + 3, + 9, + 4, + 0, + 2, + 1, + 0, + 2, + 2 + ], + "weighted_loads": [ + 0.052661966532468796, + 0.0, + 0.1008710116147995, + 0.0, + 0.0, + 0.0, + 0.2896995507180691, + 0.16950079426169395, + 0.040155813097953796, + 0.3691001832485199, + 0.07043582014739513, + 0.333211250603199, + 0.16561484336853027, + 0.028522668406367302, + 0.0, + 0.0, + 0.0, + 0.609655138105154, + 0.03267999738454819, + 0.38063014298677444, + 0.02740159071981907, + 0.0, + 0.4009396266192198, + 0.0, + 0.0, + 0.37477994337677956, + 0.1367882527410984, + 0.044484347105026245, + 0.19357706978917122, + 0.13432379439473152, + 0.048423781991004944, + 0.043569184839725494, + 0.3984140567481518, + 0.3311220034956932, + 0.028561823070049286, + 0.11287650838494301, + 0.3087274394929409, + 0.4674026556313038, + 0.026943389326334, + 0.03650080785155296, + 0.1321895606815815, + 0.09058557078242302, + 0.07402041554450989, + 0.0, + 0.0, + 0.0, + 0.601835461333394, + 0.0, + 0.16096176207065582, + 0.4913316071033478, + 0.0521855354309082, + 0.0, + 0.03573323413729668, + 0.0, + 0.29834606498479843, + 0.16187867894768715, + 0.7830416820943356, + 0.2867661416530609, + 0.0, + 0.08732127398252487, + 0.07427630573511124, + 0.0, + 0.44728878140449524, + 0.07354292459785938 + ], + "unique_experts": 46, + "load_cv": 1.072757499924467, + "normalized_load_entropy": 0.862971886690184, + "max_load_share": 0.07246376811594203 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "1295e527c4a82c80e53dc426372aff9df8b3d82e1e997d5b37fef8a9c53e918f", + "route_weight_sha256": "4915102d813909108cf8e6b19dc04b51c1957aef560b5935755a79f33bc91792", + "loads": [ + 4, + 23, + 13, + 0, + 0, + 1, + 10, + 4, + 4, + 9, + 25, + 6, + 10, + 2, + 0, + 0, + 0, + 15, + 3, + 4, + 4, + 7, + 4, + 5, + 0, + 4, + 3, + 1, + 5, + 7, + 2, + 4, + 10, + 5, + 4, + 4, + 4, + 11, + 10, + 5, + 9, + 2, + 2, + 2, + 9, + 13, + 12, + 0, + 4, + 10, + 13, + 0, + 7, + 6, + 15, + 4, + 11, + 10, + 0, + 3, + 5, + 1, + 7, + 7 + ], + "weighted_loads": [ + 0.2963489070534706, + 1.753691821359098, + 0.8118921685963869, + 0.0, + 0.0, + 0.038430385291576385, + 0.8381378352642059, + 0.16950079426169395, + 0.20408053323626518, + 0.397594440728426, + 2.212660489603877, + 0.9791700467467308, + 0.7224278710782528, + 0.07931370474398136, + 0.0, + 0.0, + 0.0, + 1.2575293853878975, + 0.12462170794606209, + 0.4049961641430855, + 0.285493241623044, + 0.6457192189991474, + 0.4009396266192198, + 0.19667045027017593, + 0.0, + 0.37477994337677956, + 0.16986558958888054, + 0.044484347105026245, + 0.2708823997527361, + 0.23635638132691383, + 0.09864263981580734, + 0.5147880837321281, + 0.6811198368668556, + 0.3780870884656906, + 0.20720358192920685, + 0.15325669199228287, + 0.3087274394929409, + 0.7332060877233744, + 0.8156304471194744, + 0.4739351384341717, + 0.4783296510577202, + 0.09058557078242302, + 0.16005434095859528, + 0.06727778539061546, + 0.6480987146496773, + 1.1856605149805546, + 0.6905242521315813, + 0.0, + 0.21389617398381233, + 0.6247912310063839, + 0.7578099556267262, + 0.0, + 0.47103070840239525, + 0.4774506092071533, + 1.0551865040324628, + 0.18813678063452244, + 0.8820103574544191, + 0.5649576634168625, + 0.0, + 0.17661641538143158, + 0.2976495623588562, + 0.043069347739219666, + 0.8833507020026445, + 0.3023259434849024 + ], + "unique_experts": 55, + "load_cv": 0.8680277773333192, + "normalized_load_entropy": 0.9094370052765987, + "max_load_share": 0.06510416666666667 + } + }, + "s0_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "514981f765410dae68ce3d10ba945eebdd898308ed23d6588001bc4ebd1fec56", + "route_weight_sha256": "2abf729a7e685735956ee8ec944de01c06ebcd45ce957ca75f30fa0632f7a1be", + "loads": [ + 1, + 0, + 3, + 0, + 0, + 0, + 4, + 3, + 1, + 7, + 2, + 6, + 2, + 1, + 0, + 0, + 0, + 6, + 1, + 3, + 0, + 0, + 3, + 0, + 0, + 4, + 2, + 1, + 3, + 4, + 2, + 1, + 4, + 4, + 2, + 2, + 4, + 6, + 1, + 1, + 2, + 2, + 2, + 0, + 0, + 0, + 9, + 0, + 3, + 8, + 1, + 0, + 1, + 0, + 4, + 3, + 9, + 4, + 0, + 2, + 1, + 0, + 2, + 1 + ], + "weighted_loads": [ + 0.05398688465356827, + 0.0, + 0.10925178043544292, + 0.0, + 0.0, + 0.0, + 0.27073390409350395, + 0.10901244357228279, + 0.0404803566634655, + 0.38424403592944145, + 0.07548712939023972, + 0.41134065575897694, + 0.1528361365199089, + 0.031135182827711105, + 0.0, + 0.0, + 0.0, + 0.588874951004982, + 0.030513400211930275, + 0.33524636551737785, + 0.0, + 0.0, + 0.3652956597507, + 0.0, + 0.0, + 0.41359980776906013, + 0.10952529311180115, + 0.04235339164733887, + 0.17310235649347305, + 0.11662185750901699, + 0.08022109791636467, + 0.04819204658269882, + 0.3806967083364725, + 0.3623497933149338, + 0.07248901948332787, + 0.0738477073609829, + 0.2981259822845459, + 0.45226304419338703, + 0.02329012006521225, + 0.028782624751329422, + 0.13752738758921623, + 0.08736009523272514, + 0.10656602680683136, + 0.0, + 0.0, + 0.0, + 0.5953268595039845, + 0.0, + 0.18129196017980576, + 0.5158237405121326, + 0.05126010999083519, + 0.0, + 0.04392295330762863, + 0.0, + 0.2955334633588791, + 0.15504775941371918, + 0.7960148900747299, + 0.29789651185274124, + 0.0, + 0.08488181233406067, + 0.08647777140140533, + 0.0, + 0.4726669490337372, + 0.037847988307476044 + ], + "unique_experts": 45, + "load_cv": 1.0569778940124537, + "normalized_load_entropy": 0.8628655833658183, + "max_load_share": 0.06521739130434782 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "3bfc52c86c38cb6b67b2d218059d03c3dadb49d1d154ca1ca0efcc644ab3a469", + "route_weight_sha256": "35ede2da2a03d14f3ee7046ff8ddfd97bbb881fda3c7df4ce3f45158199131f4", + "loads": [ + 3, + 19, + 9, + 1, + 0, + 0, + 13, + 3, + 1, + 7, + 13, + 8, + 5, + 1, + 0, + 0, + 0, + 10, + 2, + 3, + 0, + 0, + 3, + 3, + 0, + 4, + 2, + 1, + 4, + 7, + 3, + 3, + 5, + 5, + 3, + 3, + 5, + 6, + 12, + 3, + 9, + 2, + 2, + 1, + 4, + 8, + 12, + 0, + 4, + 9, + 11, + 0, + 8, + 0, + 14, + 3, + 9, + 8, + 0, + 2, + 2, + 0, + 7, + 3 + ], + "weighted_loads": [ + 0.1535765901207924, + 1.37457041349262, + 0.47105148434638977, + 0.03524397686123848, + 0.0, + 0.0, + 0.8799676708877087, + 0.10901244357228279, + 0.0404803566634655, + 0.38424403592944145, + 1.2064069099724293, + 1.0074787568300962, + 0.4538711793720722, + 0.031135182827711105, + 0.0, + 0.0, + 0.0, + 0.7196522131562233, + 0.06819348968565464, + 0.33524636551737785, + 0.0, + 0.0, + 0.3652956597507, + 0.12052246369421482, + 0.0, + 0.41359980776906013, + 0.10952529311180115, + 0.04235339164733887, + 0.21512757241725922, + 0.2251327559351921, + 0.12757740169763565, + 0.2309318333864212, + 0.43315389566123486, + 0.4253964051604271, + 0.11524668335914612, + 0.11003617569804192, + 0.36208799481391907, + 0.45226304419338703, + 0.6930284164845943, + 0.4295271672308445, + 0.44012385979294777, + 0.08736009523272514, + 0.10656602680683136, + 0.032854460179805756, + 0.32922807708382607, + 0.7300357148051262, + 0.7364796437323093, + 0.0, + 0.22162212431430817, + 0.5832615830004215, + 0.6618178188800812, + 0.0, + 0.5014321841299534, + 0.0, + 0.8461189209483564, + 0.15504775941371918, + 0.7960148900747299, + 0.46344064734876156, + 0.0, + 0.08488181233406067, + 0.14056621491909027, + 0.0, + 0.8832635469734669, + 0.1250111572444439 + ], + "unique_experts": 51, + "load_cv": 0.950957931590205, + "normalized_load_entropy": 0.8873394137529644, + "max_load_share": 0.06597222222222222 + } + }, + "s1_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "18b28d6e88aea0cc92be9606f35748c35bcfea3a53fed5a877f53ce1eb59fb60", + "route_weight_sha256": "4aaedd9f0c27e02957ee3881896123636e23203e889f2558cc44c34849e7185f", + "loads": [ + 1, + 0, + 1, + 0, + 0, + 0, + 4, + 4, + 1, + 6, + 2, + 6, + 2, + 1, + 0, + 0, + 0, + 7, + 1, + 3, + 0, + 0, + 4, + 0, + 0, + 4, + 2, + 1, + 4, + 6, + 2, + 1, + 4, + 4, + 1, + 2, + 4, + 5, + 1, + 1, + 2, + 2, + 1, + 0, + 0, + 0, + 9, + 0, + 2, + 7, + 1, + 0, + 1, + 0, + 4, + 3, + 9, + 4, + 0, + 2, + 1, + 0, + 2, + 3 + ], + "weighted_loads": [ + 0.05824154242873192, + 0.0, + 0.03269684687256813, + 0.0, + 0.0, + 0.0, + 0.2648964710533619, + 0.18001341074705124, + 0.03800389543175697, + 0.29959364980459213, + 0.08479522913694382, + 0.39341543428599834, + 0.1467452570796013, + 0.032724201679229736, + 0.0, + 0.0, + 0.0, + 0.5912769977003336, + 0.028986752033233643, + 0.31684210151433945, + 0.0, + 0.0, + 0.41148882173001766, + 0.0, + 0.0, + 0.40079111233353615, + 0.1142868660390377, + 0.039767201989889145, + 0.22649545595049858, + 0.18497410602867603, + 0.08049319311976433, + 0.045443058013916016, + 0.37119434401392937, + 0.3782051131129265, + 0.027865402400493622, + 0.07018085941672325, + 0.2723755743354559, + 0.43066174536943436, + 0.023164911195635796, + 0.031737931072711945, + 0.13860537484288216, + 0.08718925714492798, + 0.07239416986703873, + 0.0, + 0.0, + 0.0, + 0.59157176874578, + 0.0, + 0.1175546795129776, + 0.4802911765873432, + 0.04971366003155708, + 0.0, + 0.047149743884801865, + 0.0, + 0.2577783465385437, + 0.12748003378510475, + 0.7954548709094524, + 0.2821726016700268, + 0.0, + 0.08575859665870667, + 0.0731048732995987, + 0.0, + 0.48386040329933167, + 0.11431467533111572 + ], + "unique_experts": 45, + "load_cv": 1.06331783701595, + "normalized_load_entropy": 0.8601583672786368, + "max_load_share": 0.06521739130434782 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "b52039fa1c437bb22f9d87f240c083fabc20f1629584d7831ad3970eae913dc5", + "route_weight_sha256": "3d957c7335be3eead748fc7713722b9e62908271aba51810c4d21494968534b3", + "loads": [ + 3, + 24, + 11, + 0, + 0, + 1, + 12, + 4, + 3, + 7, + 25, + 9, + 8, + 2, + 0, + 0, + 0, + 16, + 3, + 4, + 3, + 8, + 4, + 6, + 0, + 4, + 3, + 1, + 6, + 8, + 3, + 5, + 9, + 5, + 3, + 2, + 4, + 10, + 11, + 5, + 9, + 2, + 2, + 1, + 11, + 13, + 11, + 0, + 2, + 9, + 15, + 0, + 9, + 6, + 16, + 4, + 10, + 11, + 0, + 3, + 4, + 1, + 7, + 6 + ], + "weighted_loads": [ + 0.2557053528726101, + 1.8752986742183566, + 0.5684978067874908, + 0.0, + 0.0, + 0.038430385291576385, + 1.0037082806229591, + 0.18001341074705124, + 0.15127747505903244, + 0.3280879072844982, + 2.075981479138136, + 1.088294392451644, + 0.5307642184197903, + 0.10107679665088654, + 0.0, + 0.0, + 0.0, + 1.288302531465888, + 0.12124928832054138, + 0.3412081226706505, + 0.25809165090322495, + 0.6915133036673069, + 0.41148882173001766, + 0.23537766188383102, + 0.0, + 0.40079111233353615, + 0.14736420288681984, + 0.039767201989889145, + 0.30380078591406345, + 0.25414049439132214, + 0.11752608045935631, + 0.6196136325597763, + 0.6024677790701389, + 0.4251701980829239, + 0.13496983796358109, + 0.07018085941672325, + 0.2723755743354559, + 0.6426874045282602, + 0.8735455144196749, + 0.4663212075829506, + 0.48474546521902084, + 0.08718925714492798, + 0.15842809528112411, + 0.030014201998710632, + 0.7051611691713333, + 1.1835184544324875, + 0.748512776568532, + 0.0, + 0.1175546795129776, + 0.5710160955786705, + 0.8955297023057938, + 0.0, + 0.6355058439075947, + 0.4774506092071533, + 1.1088849022053182, + 0.15373813547194004, + 0.8245261032134295, + 0.5964850895106792, + 0.0, + 0.17505373805761337, + 0.25321708619594574, + 0.043069347739219666, + 0.919922323897481, + 0.30567264556884766 + ], + "unique_experts": 55, + "load_cv": 0.9018692009130568, + "normalized_load_entropy": 0.9032975060252593, + "max_load_share": 0.06510416666666667 + } + }, + "s0_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "63185c9f3fec222012697a548ab3de8c5a63e1f42a4684142c2aef67da95b61d", + "route_weight_sha256": "28a08a387c724d07914d721112a3fcf63d46700f41d4a89295fbe312d2e1e356", + "loads": [ + 1, + 0, + 3, + 0, + 0, + 0, + 4, + 4, + 1, + 7, + 2, + 4, + 2, + 1, + 0, + 0, + 0, + 6, + 1, + 3, + 0, + 0, + 4, + 0, + 0, + 4, + 2, + 1, + 3, + 4, + 1, + 1, + 4, + 4, + 2, + 3, + 4, + 5, + 1, + 1, + 2, + 2, + 2, + 0, + 0, + 0, + 9, + 0, + 3, + 8, + 1, + 0, + 1, + 0, + 4, + 3, + 9, + 4, + 0, + 2, + 1, + 0, + 3, + 1 + ], + "weighted_loads": [ + 0.05656467378139496, + 0.0, + 0.1074677798897028, + 0.0, + 0.0, + 0.0, + 0.3013906963169575, + 0.1642130147665739, + 0.040988318622112274, + 0.4104323647916317, + 0.08170201256871223, + 0.33350151032209396, + 0.1660107895731926, + 0.030108902603387833, + 0.0, + 0.0, + 0.0, + 0.5948354452848434, + 0.029139390215277672, + 0.3533788248896599, + 0.0, + 0.0, + 0.3922167643904686, + 0.0, + 0.0, + 0.40382347255945206, + 0.12044916674494743, + 0.04254794865846634, + 0.18696869909763336, + 0.13079257495701313, + 0.048386070877313614, + 0.04683208465576172, + 0.3900316134095192, + 0.3442709445953369, + 0.05505181849002838, + 0.10162106901407242, + 0.31889819353818893, + 0.42214278131723404, + 0.022337360307574272, + 0.031246928498148918, + 0.14128581061959267, + 0.08898043259978294, + 0.111226387321949, + 0.0, + 0.0, + 0.0, + 0.5994088761508465, + 0.0, + 0.1560768149793148, + 0.5154985822737217, + 0.05272005498409271, + 0.0, + 0.044995687901973724, + 0.0, + 0.27967776358127594, + 0.16991187632083893, + 0.8104229457676411, + 0.29871807992458344, + 0.0, + 0.08713259547948837, + 0.07769593596458435, + 0.0, + 0.49946976639330387, + 0.04193469136953354 + ], + "unique_experts": 45, + "load_cv": 1.0409591169771326, + "normalized_load_entropy": 0.8645683726583508, + "max_load_share": 0.06521739130434782 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "790ebddfd6a721170f2bb2a9c07f96df69dce90861f6461ea7b95e117a9f8ed9", + "route_weight_sha256": "f1488a2a36f5e30a82965ddbb94d05490a9d3e8e294544c71ee8588b1617caa6", + "loads": [ + 3, + 19, + 9, + 0, + 0, + 0, + 11, + 4, + 1, + 7, + 13, + 6, + 6, + 2, + 0, + 1, + 0, + 10, + 3, + 3, + 0, + 0, + 4, + 3, + 0, + 4, + 2, + 1, + 4, + 7, + 2, + 2, + 5, + 5, + 4, + 4, + 5, + 5, + 11, + 3, + 8, + 2, + 2, + 1, + 4, + 9, + 11, + 0, + 4, + 9, + 11, + 0, + 8, + 0, + 14, + 3, + 9, + 8, + 0, + 2, + 3, + 0, + 7, + 4 + ], + "weighted_loads": [ + 0.16173118352890015, + 1.4091013027355075, + 0.48838386312127113, + 0.0, + 0.0, + 0.0, + 0.7755460813641548, + 0.1642130147665739, + 0.040988318622112274, + 0.4104323647916317, + 1.1974424496293068, + 0.9296396113932133, + 0.5106161348521709, + 0.06871064752340317, + 0.0, + 0.04690041393041611, + 0.0, + 0.7256127074360847, + 0.11449581943452358, + 0.3533788248896599, + 0.0, + 0.0, + 0.3922167643904686, + 0.12052246369421482, + 0.0, + 0.40382347255945206, + 0.12044916674494743, + 0.04254794865846634, + 0.22899391502141953, + 0.2362500187009573, + 0.09422723948955536, + 0.13290078192949295, + 0.44248880073428154, + 0.40731755644083023, + 0.13820743188261986, + 0.1412082202732563, + 0.3941042721271515, + 0.42214278131723404, + 0.5773748699575663, + 0.48821854405105114, + 0.3955426551401615, + 0.08898043259978294, + 0.111226387321949, + 0.032854460179805756, + 0.3102150224149227, + 0.8499097675085068, + 0.6868011690676212, + 0.0, + 0.1980670765042305, + 0.5819857008755207, + 0.6632777638733387, + 0.0, + 0.425283458083868, + 0.0, + 0.8054679832421243, + 0.16991187632083893, + 0.8104229457676411, + 0.4554487578570843, + 0.0, + 0.08713259547948837, + 0.17313407734036446, + 0.0, + 0.8724160883575678, + 0.3024166151881218 + ], + "unique_experts": 51, + "load_cv": 0.9162456945817024, + "normalized_load_entropy": 0.893270105561183, + "max_load_share": 0.06597222222222222 + } + }, + "s1_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "51d3bcb7db8493e79b3f33aef8263ad3028903289fcf7c2c33f6275d6c7d9b0c", + "route_weight_sha256": "1761c087401431a5012aeb4cdd6c12913bbba55610e90e0611bb2f318f8406a9", + "loads": [ + 1, + 0, + 1, + 0, + 0, + 0, + 5, + 4, + 1, + 6, + 2, + 6, + 2, + 1, + 0, + 0, + 0, + 8, + 1, + 3, + 0, + 0, + 4, + 0, + 0, + 4, + 1, + 1, + 4, + 4, + 2, + 1, + 4, + 4, + 1, + 2, + 4, + 5, + 1, + 1, + 2, + 2, + 1, + 0, + 0, + 0, + 9, + 0, + 2, + 7, + 1, + 0, + 1, + 0, + 4, + 3, + 9, + 4, + 0, + 2, + 1, + 0, + 2, + 4 + ], + "weighted_loads": [ + 0.06201609596610069, + 0.0, + 0.03441273793578148, + 0.0, + 0.0, + 0.0, + 0.3099955879151821, + 0.18572016805410385, + 0.03601045534014702, + 0.32180697098374367, + 0.0856616422533989, + 0.4193146154284477, + 0.1553957387804985, + 0.032669153064489365, + 0.0, + 0.0, + 0.0, + 0.6362284012138844, + 0.02907821163535118, + 0.32832159847021103, + 0.0, + 0.0, + 0.409083716571331, + 0.0, + 0.0, + 0.39259563758969307, + 0.07169996201992035, + 0.04112205281853676, + 0.2307165488600731, + 0.12004052475094795, + 0.07395089417695999, + 0.04383496940135956, + 0.356915008276701, + 0.3904038853943348, + 0.02775680646300316, + 0.06835367530584335, + 0.2638307586312294, + 0.4335990287363529, + 0.022728795185685158, + 0.03455145284533501, + 0.13981890678405762, + 0.09162496030330658, + 0.07014486938714981, + 0.0, + 0.0, + 0.0, + 0.5567492470145226, + 0.0, + 0.12208947911858559, + 0.4730307534337044, + 0.048418715596199036, + 0.0, + 0.04665926471352577, + 0.0, + 0.23791907727718353, + 0.12037266418337822, + 0.7811764590442181, + 0.2733384259045124, + 0.0, + 0.08574783056974411, + 0.07382771372795105, + 0.0, + 0.47056376934051514, + 0.14093680307269096 + ], + "unique_experts": 45, + "load_cv": 1.0758856494473892, + "normalized_load_entropy": 0.8581130852574494, + "max_load_share": 0.06521739130434782 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "6142658492e3c7c6c38b16e9a2a4d7660b8ec0a51510a1db079f2a4912947619", + "route_weight_sha256": "82f03f81932029164d2698da8f5255fc74287a9de7aa8f87e9a3f31fd2206f0f", + "loads": [ + 4, + 25, + 10, + 1, + 0, + 1, + 11, + 4, + 3, + 7, + 25, + 8, + 9, + 2, + 0, + 1, + 0, + 16, + 4, + 4, + 3, + 7, + 4, + 5, + 0, + 4, + 2, + 1, + 6, + 7, + 3, + 4, + 9, + 5, + 4, + 2, + 4, + 11, + 10, + 5, + 9, + 2, + 2, + 1, + 10, + 15, + 11, + 0, + 2, + 9, + 13, + 0, + 8, + 6, + 16, + 4, + 11, + 10, + 0, + 3, + 5, + 1, + 7, + 8 + ], + "weighted_loads": [ + 0.3198881484568119, + 1.9691041698679328, + 0.5488964971154928, + 0.04824350029230118, + 0.0, + 0.038430385291576385, + 0.858433872461319, + 0.18572016805410385, + 0.14928403496742249, + 0.35030122846364975, + 2.0986615233123302, + 1.0652734115719795, + 0.5752986408770084, + 0.09919760003685951, + 0.0, + 0.044144559651613235, + 0.0, + 1.2841026484966278, + 0.15369967371225357, + 0.35268761962652206, + 0.25809165090322495, + 0.6457192189991474, + 0.409083716571331, + 0.19667045027017593, + 0.0, + 0.39259563758969307, + 0.10477729886770248, + 0.04112205281853676, + 0.30802187882363796, + 0.24554037675261497, + 0.10800744965672493, + 0.5150538682937622, + 0.5881884433329105, + 0.4373689703643322, + 0.1787578985095024, + 0.06835367530584335, + 0.2638307586312294, + 0.669879324734211, + 0.8114158529788256, + 0.49139827862381935, + 0.4859589971601963, + 0.09162496030330658, + 0.1561787948012352, + 0.030014201998710632, + 0.6884297877550125, + 1.27142976783216, + 0.6904537789523602, + 0.0, + 0.12208947911858559, + 0.5508744269609451, + 0.754043135792017, + 0.0, + 0.5396866202354431, + 0.4774506092071533, + 1.0412064171396196, + 0.1466307658702135, + 0.8711003344506025, + 0.5563374795019627, + 0.0, + 0.17504297196865082, + 0.3001542240381241, + 0.043069347739219666, + 0.9066256899386644, + 0.5105903074145317 + ], + "unique_experts": 57, + "load_cv": 0.8951062941225348, + "normalized_load_entropy": 0.9077390194088971, + "max_load_share": 0.06510416666666667 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "ordered_topk_exact_tokens": 17, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.9254658385093169, + "mean_token_weighted_tv": 0.016976153639995533, + "aggregate_load_tv": 0.04347826086956522 + }, + "system_bos": { + "tokens": 23, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.9161490683229815, + "mean_token_weighted_tv": 0.019070680415176827, + "aggregate_load_tv": 0.05072463768115942 + }, + "system_x": { + "tokens": 23, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.8913043478260871, + "mean_token_weighted_tv": 0.027886730375821175, + "aggregate_load_tv": 0.057971014492753624 + }, + "system_period": { + "tokens": 23, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 11, + "mean_set_jaccard": 0.8322981366459627, + "mean_token_weighted_tv": 0.03847994477204655, + "aggregate_load_tv": 0.07246376811594203 + }, + "bos_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8788819875776398, + "mean_token_weighted_tv": 0.026618663383566814, + "aggregate_load_tv": 0.06521739130434782 + }, + "bos_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.9409937888198757, + "mean_token_weighted_tv": 0.020172720248608486, + "aggregate_load_tv": 0.03623188405797102 + }, + "x_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 12, + "mean_set_jaccard": 0.8633540372670809, + "mean_token_weighted_tv": 0.03308262696246738, + "aggregate_load_tv": 0.06521739130434782 + }, + "x_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.89648033126294, + "mean_token_weighted_tv": 0.031248707810173863, + "aggregate_load_tv": 0.05797101449275363 + }, + "period_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8788819875776398, + "mean_token_weighted_tv": 0.027793724575768345, + "aggregate_load_tv": 0.057971014492753624 + }, + "period_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.8840579710144929, + "mean_token_weighted_tv": 0.03648788522443046, + "aggregate_load_tv": 0.07246376811594203 + } + } + }, + "layer_26": { + "layer": 26, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "036fb1811de9dfb4dcf968fcb1ff7728e6ab0a0b8a685a619df5437170810f6b", + "route_weight_sha256": "f52a6fe2a02428867d158795ed1f6555deb1064fd781df607524e79a15d18f31", + "loads": [ + 0, + 0, + 2, + 6, + 3, + 0, + 0, + 4, + 4, + 7, + 3, + 0, + 0, + 6, + 5, + 1, + 2, + 2, + 0, + 1, + 1, + 1, + 0, + 0, + 2, + 3, + 0, + 1, + 1, + 1, + 3, + 2, + 1, + 0, + 2, + 5, + 5, + 1, + 3, + 0, + 4, + 0, + 0, + 0, + 11, + 8, + 2, + 2, + 1, + 1, + 2, + 0, + 0, + 0, + 2, + 0, + 9, + 0, + 4, + 3, + 0, + 4, + 7, + 0 + ], + "weighted_loads": [ + 0.0, + 0.0, + 0.11781198531389236, + 0.41958360001444817, + 0.15505913272500038, + 0.0, + 0.0, + 0.22163014858961105, + 0.3325033336877823, + 0.6091941371560097, + 0.18641360104084015, + 0.0, + 0.0, + 0.9065579771995544, + 0.36830486729741096, + 0.0878475084900856, + 0.13615598902106285, + 0.25784406810998917, + 0.0, + 0.036568429321050644, + 0.061254747211933136, + 0.06033254414796829, + 0.0, + 0.0, + 0.09270977601408958, + 0.20404816046357155, + 0.0, + 0.07054387778043747, + 0.036175262182950974, + 0.03489299491047859, + 0.14137794077396393, + 0.14766821265220642, + 0.040706370025873184, + 0.0, + 0.10942195355892181, + 0.32802674174308777, + 0.3157366141676903, + 0.03334738314151764, + 0.23008719831705093, + 0.0, + 0.24748720601201057, + 0.0, + 0.0, + 0.0, + 1.003138568252325, + 0.7169914580881596, + 0.13574715331196785, + 0.1284448765218258, + 0.04741247743368149, + 0.2008155733346939, + 0.07958009093999863, + 0.0, + 0.0, + 0.0, + 0.10144893452525139, + 0.0, + 0.7284379675984383, + 0.0, + 0.2327717561274767, + 0.1856836900115013, + 0.0, + 0.4277048073709011, + 0.5378427878022194, + 0.0 + ], + "unique_experts": 42, + "load_cv": 1.1571535813529936, + "normalized_load_entropy": 0.8414402619126145, + "max_load_share": 0.07971014492753623 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "4ec06582877b6e6057170763a2ccac0ac1bec66127aa0733a223de0a736ec621", + "route_weight_sha256": "6c96e98eb2991b7fe7bb59b180524d42ad5f33d9cdcc6e9cf7514e781ba20b4d", + "loads": [ + 0, + 1, + 2, + 8, + 3, + 0, + 1, + 5, + 4, + 10, + 7, + 5, + 1, + 7, + 20, + 3, + 2, + 14, + 0, + 2, + 1, + 2, + 0, + 0, + 6, + 3, + 6, + 8, + 1, + 1, + 10, + 2, + 4, + 1, + 6, + 5, + 11, + 1, + 3, + 0, + 4, + 1, + 1, + 4, + 13, + 8, + 6, + 2, + 2, + 2, + 11, + 1, + 3, + 0, + 3, + 0, + 24, + 8, + 10, + 4, + 1, + 4, + 8, + 2 + ], + "weighted_loads": [ + 0.0, + 0.04918302595615387, + 0.11781198531389236, + 0.5135890319943428, + 0.15505913272500038, + 0.0, + 0.035588156431913376, + 0.25589071959257126, + 0.3325033336877823, + 0.7945416159927845, + 0.6297670416533947, + 0.3139609273057431, + 0.20421215891838074, + 0.9639458619058132, + 1.0744426330784336, + 0.1849154718220234, + 0.13615598902106285, + 0.9327899012714624, + 0.0, + 0.08319544047117233, + 0.061254747211933136, + 0.09141439571976662, + 0.0, + 0.0, + 0.3066141828894615, + 0.20404816046357155, + 0.8077644668519497, + 0.3499761428683996, + 0.036175262182950974, + 0.03489299491047859, + 0.9398474618792534, + 0.14766821265220642, + 0.16748493537306786, + 0.03056168369948864, + 0.4830688461661339, + 0.32802674174308777, + 0.6059201899915934, + 0.03334738314151764, + 0.23008719831705093, + 0.0, + 0.24748720601201057, + 0.04722775146365166, + 0.03530311957001686, + 0.1964203268289566, + 1.0836963206529617, + 0.7169914580881596, + 0.354466263204813, + 0.1284448765218258, + 0.08921640738844872, + 1.1869949847459793, + 0.4858209006488323, + 0.08002369105815887, + 0.35836804658174515, + 0.0, + 0.14809680357575417, + 0.0, + 1.83746144361794, + 0.40468821534886956, + 0.4750314000993967, + 0.23367581143975258, + 0.0008212571265175939, + 0.4277048073709011, + 0.5784031115472317, + 0.416331198066473 + ], + "unique_experts": 56, + "load_cv": 1.0474837574980447, + "normalized_load_entropy": 0.8845986107850948, + "max_load_share": 0.08333333333333333 + } + }, + "s1_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "199ba42f4157b439c6b281fbf21f5710f8a61bb364de921a0d125ece1e4ce67e", + "route_weight_sha256": "40d31838313374f4bb8e751515e488577735caae1e5b504e8c460271a8ead4bf", + "loads": [ + 0, + 0, + 2, + 6, + 3, + 0, + 0, + 4, + 4, + 7, + 3, + 0, + 0, + 6, + 5, + 1, + 2, + 2, + 0, + 1, + 1, + 1, + 0, + 0, + 2, + 3, + 0, + 1, + 1, + 1, + 3, + 2, + 1, + 0, + 2, + 6, + 5, + 1, + 3, + 0, + 4, + 0, + 0, + 0, + 11, + 8, + 2, + 1, + 1, + 1, + 2, + 0, + 0, + 0, + 2, + 0, + 8, + 0, + 4, + 4, + 0, + 4, + 7, + 0 + ], + "weighted_loads": [ + 0.0, + 0.0, + 0.11778424307703972, + 0.41345902904868126, + 0.1497744843363762, + 0.0, + 0.0, + 0.23698321357369423, + 0.3450487554073334, + 0.6217797473073006, + 0.17337962612509727, + 0.0, + 0.0, + 0.9093940779566765, + 0.3791903518140316, + 0.08638931065797806, + 0.13755062967538834, + 0.2371152862906456, + 0.0, + 0.03610213100910187, + 0.06294728070497513, + 0.058814626187086105, + 0.0, + 0.0, + 0.0891561284661293, + 0.17408952489495277, + 0.0, + 0.07450852543115616, + 0.033726125955581665, + 0.036222632974386215, + 0.1433739773929119, + 0.142011396586895, + 0.04461650177836418, + 0.0, + 0.10236486420035362, + 0.3948129042983055, + 0.3009058013558388, + 0.0315336138010025, + 0.23315341025590897, + 0.0, + 0.23746463283896446, + 0.0, + 0.0, + 0.0, + 1.0120477341115475, + 0.7226803675293922, + 0.13210001960396767, + 0.09442157298326492, + 0.048120561987161636, + 0.21041887998580933, + 0.0653570182621479, + 0.0, + 0.0, + 0.0, + 0.10428134724497795, + 0.0, + 0.7293831408023834, + 0.0, + 0.23062347434461117, + 0.21113986894488335, + 0.0, + 0.4193061962723732, + 0.5289916787296534, + 0.0 + ], + "unique_experts": 42, + "load_cv": 1.1542456990586627, + "normalized_load_entropy": 0.840696394745047, + "max_load_share": 0.07971014492753623 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "5e65e2cc6216eb3669ec7b60e75dc379d876af62df7e36d139a290278540d53e", + "route_weight_sha256": "c42afd0f38cccbd31135a2f03c70628ee6f57db4edd1023edead5ee803f7d5b9", + "loads": [ + 1, + 1, + 2, + 8, + 6, + 0, + 0, + 5, + 4, + 13, + 10, + 7, + 1, + 7, + 20, + 6, + 2, + 10, + 1, + 2, + 1, + 7, + 7, + 0, + 9, + 5, + 12, + 12, + 1, + 3, + 12, + 3, + 6, + 1, + 9, + 6, + 16, + 6, + 6, + 1, + 5, + 1, + 2, + 5, + 12, + 8, + 6, + 2, + 2, + 4, + 10, + 1, + 8, + 2, + 5, + 2, + 27, + 9, + 14, + 10, + 3, + 4, + 10, + 3 + ], + "weighted_loads": [ + 0.046306394040584564, + 0.05426559969782829, + 0.11778424307703972, + 0.49169987812638283, + 0.3309561498463154, + 0.0, + 0.0, + 0.3251815475523472, + 0.3450487554073334, + 0.974522203207016, + 1.0265803895890713, + 0.6139423199929297, + 0.17123718559741974, + 0.9624568596482277, + 1.1961912958649918, + 0.3967996761202812, + 0.13755062967538834, + 0.7722896406194195, + 0.05195746198296547, + 0.08033741265535355, + 0.06294728070497513, + 0.4106223043054342, + 0.5000483468174934, + 0.0, + 0.4135159682482481, + 0.28000928834080696, + 1.3519244827330112, + 0.5004232805222273, + 0.033726125955581665, + 0.10595864057540894, + 1.2167939729988575, + 0.22212250530719757, + 0.270845502614975, + 0.03565734252333641, + 0.5988590568304062, + 0.3948129042983055, + 0.9228229559957981, + 0.33008577302098274, + 0.52374417334795, + 0.03533352166414261, + 0.26762259379029274, + 0.05942336842417717, + 0.08661839365959167, + 0.23401478677988052, + 1.0623371675610542, + 0.7226803675293922, + 0.40083251148462296, + 0.13625865429639816, + 0.08206115663051605, + 1.3502711690962315, + 0.3952708728611469, + 0.08496378362178802, + 0.7112002931535244, + 0.18885773047804832, + 0.3156922422349453, + 0.1171250194311142, + 2.4571996293962, + 0.7482852302491665, + 0.7983816508203745, + 0.4582683015614748, + 0.24044470122316852, + 0.4193061962723732, + 0.656372033059597, + 0.2913524843752384 + ], + "unique_experts": 61, + "load_cv": 0.8477912478906585, + "normalized_load_entropy": 0.9185727845179935, + "max_load_share": 0.0703125 + } + }, + "s0_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "acb8ec3a0853b4a953e0f06ffa3720de7a1abe42bb2dab445c5d26fb2e64fb03", + "route_weight_sha256": "f754fce9b8fd0a3eefb35dfc86dd9f322e2cb6d0adac44bdc165fab775ea3bcd", + "loads": [ + 0, + 0, + 2, + 6, + 2, + 0, + 0, + 3, + 4, + 7, + 4, + 0, + 0, + 6, + 5, + 1, + 2, + 2, + 0, + 0, + 2, + 1, + 0, + 0, + 2, + 3, + 0, + 1, + 1, + 1, + 3, + 2, + 1, + 0, + 2, + 6, + 4, + 1, + 4, + 0, + 4, + 0, + 0, + 0, + 11, + 9, + 2, + 2, + 1, + 1, + 1, + 0, + 0, + 1, + 2, + 0, + 7, + 0, + 4, + 4, + 0, + 4, + 7, + 0 + ], + "weighted_loads": [ + 0.0, + 0.0, + 0.11443821340799332, + 0.42646197602152824, + 0.09186633676290512, + 0.0, + 0.0, + 0.169125746935606, + 0.3652961924672127, + 0.6124444045126438, + 0.23974332213401794, + 0.0, + 0.0, + 0.9426510855555534, + 0.3766220323741436, + 0.08917319774627686, + 0.13108719140291214, + 0.2614881172776222, + 0.0, + 0.0, + 0.1147979386150837, + 0.05721185728907585, + 0.0, + 0.0, + 0.09394581243395805, + 0.19806179776787758, + 0.0, + 0.0639648288488388, + 0.029726700857281685, + 0.03719145804643631, + 0.16124668717384338, + 0.15660261362791061, + 0.044223833829164505, + 0.0, + 0.10465603321790695, + 0.3841344714164734, + 0.2723335772752762, + 0.03401388227939606, + 0.3210498169064522, + 0.0, + 0.2432295884937048, + 0.0, + 0.0, + 0.0, + 1.044130615890026, + 0.7734715640544891, + 0.14425582066178322, + 0.12153893895447254, + 0.04750285670161247, + 0.22144164144992828, + 0.03475198149681091, + 0.0, + 0.0, + 0.05406215786933899, + 0.10075583308935165, + 0.0, + 0.6182568371295929, + 0.0, + 0.25614868104457855, + 0.23352274671196938, + 0.0, + 0.4441216215491295, + 0.5273601599037647, + 0.0 + ], + "unique_experts": 42, + "load_cv": 1.151330472432995, + "normalized_load_entropy": 0.8418299768843945, + "max_load_share": 0.07971014492753623 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "4703ec378e0004d25e90e34d16bc5a7e25f23f053e024c5d64b71ef5f1c756fb", + "route_weight_sha256": "6f519c74dba07e159b8ac1f17980eac97fd2d209307d04299a9e0dd9498d190b", + "loads": [ + 1, + 1, + 2, + 8, + 2, + 1, + 0, + 4, + 4, + 12, + 7, + 5, + 1, + 8, + 18, + 3, + 2, + 12, + 0, + 0, + 2, + 2, + 1, + 0, + 6, + 3, + 6, + 10, + 1, + 1, + 11, + 2, + 3, + 0, + 7, + 6, + 9, + 1, + 4, + 0, + 4, + 2, + 2, + 4, + 14, + 9, + 5, + 2, + 2, + 1, + 10, + 1, + 3, + 1, + 3, + 0, + 22, + 7, + 10, + 5, + 0, + 4, + 8, + 3 + ], + "weighted_loads": [ + 0.02728513441979885, + 0.04710664972662926, + 0.11443821340799332, + 0.4999387376010418, + 0.09186633676290512, + 0.049510397017002106, + 0.0, + 0.2033863179385662, + 0.3652961924672127, + 0.8654355425387621, + 0.6029327735304832, + 0.3332354612648487, + 0.19870902597904205, + 1.02480573579669, + 0.9916224852204323, + 0.2040940336883068, + 0.13108719140291214, + 0.9001297671347857, + 0.0, + 0.0, + 0.1147979386150837, + 0.08829370886087418, + 0.032889872789382935, + 0.0, + 0.30396004393696785, + 0.19806179776787758, + 0.9474168866872787, + 0.4621724095195532, + 0.029726700857281685, + 0.03719145804643631, + 1.0741527415812016, + 0.15660261362791061, + 0.13293979689478874, + 0.0, + 0.5520225837826729, + 0.3841344714164734, + 0.5271984152495861, + 0.03401388227939606, + 0.3210498169064522, + 0.0, + 0.2432295884937048, + 0.368113761767745, + 0.09392638504505157, + 0.19669370725750923, + 1.1951940543949604, + 0.7734715640544891, + 0.3243934214115143, + 0.12153893895447254, + 0.11367372795939445, + 0.22144164144992828, + 0.4396378919482231, + 0.07915212213993073, + 0.34919798374176025, + 0.05406215786933899, + 0.14740370213985443, + 0.0, + 1.9173899088054895, + 0.3997773826122284, + 0.49840832501649857, + 0.28151486814022064, + 0.0, + 0.4441216215491295, + 0.567920483648777, + 0.38388625904917717 + ], + "unique_experts": 56, + "load_cv": 1.0023121418149286, + "normalized_load_entropy": 0.8893622224324162, + "max_load_share": 0.0763888888888889 + } + }, + "s1_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "3549d86b86bf6fdee8d61bcc76ac41699ec82d514c65b81258cbfdce35fb1ee8", + "route_weight_sha256": "ca38650bfeebd49bc0bd323b16d33e71d315fa4fb487249219ecc48557a338e9", + "loads": [ + 0, + 0, + 2, + 6, + 3, + 0, + 0, + 4, + 4, + 7, + 4, + 0, + 0, + 6, + 5, + 1, + 2, + 2, + 0, + 1, + 1, + 1, + 0, + 0, + 2, + 3, + 0, + 1, + 1, + 1, + 3, + 2, + 1, + 0, + 2, + 6, + 4, + 1, + 4, + 0, + 4, + 0, + 0, + 0, + 12, + 7, + 2, + 2, + 1, + 1, + 1, + 0, + 0, + 0, + 2, + 0, + 7, + 0, + 4, + 4, + 0, + 4, + 7, + 0 + ], + "weighted_loads": [ + 0.0, + 0.0, + 0.10874062031507492, + 0.4267948120832443, + 0.1401773802936077, + 0.0, + 0.0, + 0.2180657610297203, + 0.33866680413484573, + 0.6210028156638145, + 0.2204006053507328, + 0.0, + 0.0, + 0.9441413506865501, + 0.3622668422758579, + 0.08883393555879593, + 0.13986898958683014, + 0.2392486184835434, + 0.0, + 0.031154446303844452, + 0.05978097766637802, + 0.05179775506258011, + 0.0, + 0.0, + 0.09340361505746841, + 0.20838917791843414, + 0.0, + 0.06160274147987366, + 0.035943761467933655, + 0.03803136944770813, + 0.1520947404205799, + 0.15084151923656464, + 0.04606650024652481, + 0.0, + 0.10219455137848854, + 0.3890599422156811, + 0.2632906176149845, + 0.03196060284972191, + 0.30845584720373154, + 0.0, + 0.24750915355980396, + 0.0, + 0.0, + 0.0, + 1.0894906781613827, + 0.6950999647378922, + 0.13197244331240654, + 0.11954152770340443, + 0.0476050041615963, + 0.2448936253786087, + 0.03500565141439438, + 0.0, + 0.0, + 0.0, + 0.10287743806838989, + 0.0, + 0.6400768347084522, + 0.0, + 0.24227661080658436, + 0.2275169249624014, + 0.0, + 0.43148117512464523, + 0.5004801694303751, + 0.0 + ], + "unique_experts": 42, + "load_cv": 1.151330472432995, + "normalized_load_entropy": 0.8417237430135418, + "max_load_share": 0.08695652173913043 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "52457c99d6ad185c9c7775b5a6205e9b0436924501a11b075af6be51b7603034", + "route_weight_sha256": "062d1c4c09687c777030d3ce265086f975ece0bc4c48b396f4a331783a7b960a", + "loads": [ + 0, + 1, + 2, + 7, + 6, + 0, + 0, + 5, + 4, + 15, + 12, + 7, + 1, + 7, + 18, + 7, + 2, + 9, + 0, + 1, + 1, + 7, + 7, + 0, + 9, + 5, + 13, + 11, + 1, + 3, + 14, + 3, + 5, + 2, + 10, + 6, + 15, + 6, + 8, + 1, + 5, + 1, + 3, + 4, + 15, + 7, + 6, + 3, + 2, + 3, + 9, + 1, + 8, + 2, + 5, + 2, + 26, + 8, + 14, + 10, + 2, + 4, + 10, + 3 + ], + "weighted_loads": [ + 0.0, + 0.05213572829961777, + 0.10874062031507492, + 0.46418536454439163, + 0.3213590458035469, + 0.0, + 0.0, + 0.30626409500837326, + 0.33866680413484573, + 1.0520717073231936, + 1.1453803814947605, + 0.6342108175158501, + 0.19227458536624908, + 0.9972041323781013, + 1.0970007739961147, + 0.44132306426763535, + 0.13986898958683014, + 0.7450144458562136, + 0.0, + 0.031154446303844452, + 0.05978097766637802, + 0.40360543318092823, + 0.4818040132522583, + 0.0, + 0.4175953362137079, + 0.31430894136428833, + 1.5730315744876862, + 0.4494877438992262, + 0.035943761467933655, + 0.10776737704873085, + 1.4366539306938648, + 0.23095262795686722, + 0.23214557766914368, + 0.08149251341819763, + 0.7203423231840134, + 0.3890599422156811, + 0.8802414052188396, + 0.33051276206970215, + 0.6378547996282578, + 0.03533352166414261, + 0.27766711451113224, + 0.029812222346663475, + 0.1454843208193779, + 0.1951761543750763, + 1.219627633690834, + 0.6950999647378922, + 0.39854642376303673, + 0.16137860901653767, + 0.08154559880495071, + 0.3999726362526417, + 0.3688168004155159, + 0.08243384957313538, + 0.6935357786715031, + 0.18885773047804832, + 0.31428833305835724, + 0.1171250194311142, + 2.5881019346415997, + 0.742957703769207, + 0.8100347872823477, + 0.47464535757899284, + 0.23951289802789688, + 0.43148117512464523, + 0.6278605237603188, + 0.24013475701212883 + ], + "unique_experts": 59, + "load_cv": 0.8544206939337449, + "normalized_load_entropy": 0.9142090504952001, + "max_load_share": 0.06770833333333333 + } + }, + "s0_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "bf1491470f412069a3b91beee98ea2c5496169d9b7eedf46b4e0e20eae10ed18", + "route_weight_sha256": "fb07f9cbe5d8f872073f7ccfeefb52264985ee07bbfb5b81d7851efb8f7e181b", + "loads": [ + 0, + 0, + 2, + 6, + 3, + 0, + 0, + 3, + 4, + 7, + 4, + 0, + 1, + 6, + 5, + 1, + 2, + 2, + 0, + 1, + 1, + 1, + 1, + 0, + 2, + 3, + 0, + 1, + 1, + 1, + 3, + 2, + 0, + 0, + 3, + 5, + 4, + 0, + 3, + 0, + 4, + 0, + 0, + 0, + 11, + 7, + 2, + 2, + 1, + 1, + 2, + 0, + 0, + 1, + 1, + 0, + 9, + 0, + 4, + 3, + 0, + 4, + 8, + 0 + ], + "weighted_loads": [ + 0.0, + 0.0, + 0.11463504657149315, + 0.424707118421793, + 0.16483492031693459, + 0.0, + 0.0, + 0.17772776633501053, + 0.34476038068532944, + 0.5925535894930363, + 0.21809720247983932, + 0.0, + 0.031392693519592285, + 0.8892844468355179, + 0.3950943276286125, + 0.09001786261796951, + 0.13232388719916344, + 0.25162220746278763, + 0.0, + 0.03191792964935303, + 0.061755429953336716, + 0.05881596729159355, + 0.037060197442770004, + 0.0, + 0.08969619870185852, + 0.2107764258980751, + 0.0, + 0.06003744900226593, + 0.03248712420463562, + 0.040267955511808395, + 0.15478110313415527, + 0.15211617201566696, + 0.0, + 0.0, + 0.1439608633518219, + 0.3577457293868065, + 0.28847645223140717, + 0.0, + 0.25064973533153534, + 0.0, + 0.23819346353411674, + 0.0, + 0.0, + 0.0, + 1.056717500090599, + 0.672952227294445, + 0.12621545791625977, + 0.1277771256864071, + 0.04912719503045082, + 0.2174432873725891, + 0.08340558782219887, + 0.0, + 0.0, + 0.04674680903553963, + 0.06777908653020859, + 0.0, + 0.7021953351795673, + 0.0, + 0.24220896884799004, + 0.17153296247124672, + 0.0, + 0.41301166266202927, + 0.5949882604181767, + 0.0 + ], + "unique_experts": 43, + "load_cv": 1.1484078455453641, + "normalized_load_entropy": 0.8448880312027996, + "max_load_share": 0.07971014492753623 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "207be138a76b4115438153748d85e4cee43381f4e7d2b222e148954eacfe9075", + "route_weight_sha256": "39ed60c75552908a74071d204c9b1207bc9f11782ef9e6e1ee045dbda1d63ad2", + "loads": [ + 0, + 1, + 2, + 7, + 3, + 0, + 0, + 4, + 4, + 10, + 8, + 6, + 2, + 7, + 19, + 3, + 2, + 14, + 0, + 1, + 1, + 2, + 1, + 0, + 6, + 3, + 6, + 11, + 2, + 2, + 9, + 2, + 2, + 0, + 8, + 5, + 9, + 0, + 3, + 0, + 4, + 0, + 1, + 6, + 13, + 7, + 5, + 2, + 1, + 1, + 11, + 1, + 3, + 1, + 2, + 0, + 28, + 8, + 10, + 4, + 0, + 4, + 9, + 2 + ], + "weighted_loads": [ + 0.0, + 0.04607955366373062, + 0.11463504657149315, + 0.49158739671111107, + 0.16483492031693459, + 0.0, + 0.0, + 0.21198833733797073, + 0.34476038068532944, + 0.7779010683298111, + 0.6117100082337856, + 0.4628806672990322, + 0.20639482140541077, + 0.9466723315417767, + 1.119082186371088, + 0.18481113389134407, + 0.13232388719916344, + 1.0668915417045355, + 0.0, + 0.03191792964935303, + 0.061755429953336716, + 0.08989781886339188, + 0.037060197442770004, + 0.0, + 0.3025304600596428, + 0.2107764258980751, + 0.8407963626086712, + 0.4361464809626341, + 0.0462564155459404, + 0.08939512073993683, + 0.9374192282557487, + 0.15211617201566696, + 0.08962366729974747, + 0.0, + 0.5349492970854044, + 0.3577457293868065, + 0.5377719886600971, + 0.0, + 0.25064973533153534, + 0.0, + 0.23819346353411674, + 0.0, + 0.028873391449451447, + 0.33292582631111145, + 1.1268210336565971, + 0.672952227294445, + 0.29282189905643463, + 0.1277771256864071, + 0.04912719503045082, + 0.2174432873725891, + 0.4862109608948231, + 0.0744984820485115, + 0.3378583639860153, + 0.04674680903553963, + 0.11442695558071136, + 0.0, + 2.2918664049357176, + 0.5111272260546684, + 0.48446861281991005, + 0.21952508389949799, + 0.0, + 0.41301166266202927, + 0.6355485841631889, + 0.1305592618882656 + ], + "unique_experts": 53, + "load_cv": 1.1145779248743821, + "normalized_load_entropy": 0.8715809318349454, + "max_load_share": 0.09722222222222222 + } + }, + "s1_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "07433414faae612fa34e0abf1fa06d5be8b115c8357c7f8d2ae7b18cfb7aef63", + "route_weight_sha256": "678615cc81944219107343b27cca69e667e5b5b0b614bafbb251bc4f7ca3ccaa", + "loads": [ + 0, + 0, + 2, + 6, + 3, + 0, + 0, + 4, + 5, + 7, + 4, + 0, + 1, + 6, + 5, + 1, + 2, + 2, + 0, + 1, + 1, + 1, + 0, + 0, + 2, + 3, + 0, + 1, + 1, + 1, + 3, + 2, + 0, + 0, + 2, + 5, + 5, + 0, + 3, + 0, + 3, + 0, + 1, + 0, + 11, + 8, + 2, + 1, + 1, + 1, + 2, + 0, + 0, + 0, + 1, + 0, + 9, + 0, + 4, + 4, + 0, + 4, + 7, + 0 + ], + "weighted_loads": [ + 0.0, + 0.0, + 0.11324074119329453, + 0.42867401614785194, + 0.17224467545747757, + 0.0, + 0.0, + 0.22430389747023582, + 0.37666260823607445, + 0.6074295043945312, + 0.17270490154623985, + 0.0, + 0.02929285541176796, + 0.9003398418426514, + 0.43931739032268524, + 0.08862326294183731, + 0.14305441826581955, + 0.23897580802440643, + 0.0, + 0.029816560447216034, + 0.062300704419612885, + 0.05760186165571213, + 0.0, + 0.0, + 0.07527865096926689, + 0.19437416270375252, + 0.0, + 0.06311934441328049, + 0.03183348476886749, + 0.04584171995520592, + 0.14646058529615402, + 0.14762769639492035, + 0.0, + 0.0, + 0.09995216131210327, + 0.3760016895830631, + 0.3321717865765095, + 0.0, + 0.23732534050941467, + 0.0, + 0.21192316338419914, + 0.0, + 0.02907632663846016, + 0.0, + 0.9294583946466446, + 0.7077870704233646, + 0.1269783154129982, + 0.08526626229286194, + 0.04623256251215935, + 0.2058422714471817, + 0.07669728621840477, + 0.0, + 0.0, + 0.0, + 0.06509609520435333, + 0.0, + 0.7171319834887981, + 0.0, + 0.23370064049959183, + 0.1973152607679367, + 0.0, + 0.3828479014337063, + 0.5497576631605625, + 0.0 + ], + "unique_experts": 42, + "load_cv": 1.171584737034095, + "normalized_load_entropy": 0.8379924926224293, + "max_load_share": 0.07971014492753623 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "f55a4b9d8121685d9957002ba7789e9e85c5b72c9378cd49250d96fd21d7e508", + "route_weight_sha256": "bb69b935fb2e6d0b1ef5bc8621ea8aacdf32129f79e9c7bb717b7043e2bc5de5", + "loads": [ + 0, + 1, + 2, + 8, + 6, + 1, + 0, + 5, + 5, + 13, + 12, + 8, + 2, + 7, + 20, + 6, + 2, + 9, + 0, + 1, + 1, + 7, + 6, + 0, + 9, + 5, + 12, + 12, + 2, + 4, + 12, + 3, + 4, + 1, + 9, + 5, + 17, + 5, + 6, + 1, + 4, + 0, + 2, + 4, + 13, + 8, + 5, + 2, + 2, + 3, + 10, + 2, + 8, + 2, + 4, + 2, + 30, + 10, + 15, + 11, + 2, + 4, + 10, + 2 + ], + "weighted_loads": [ + 0.0, + 0.04682905972003937, + 0.11324074119329453, + 0.5523464754223824, + 0.35342634096741676, + 0.06099775433540344, + 0.0, + 0.3125022314488888, + 0.37666260823607445, + 0.9601719602942467, + 0.9551581591367722, + 0.7621561475098133, + 0.13813797757029533, + 0.9534026235342026, + 1.3252010010182858, + 0.40028099343180656, + 0.14305441826581955, + 0.735974932089448, + 0.0, + 0.029816560447216034, + 0.062300704419612885, + 0.40940953977406025, + 0.44725213944911957, + 0.0, + 0.3934298660606146, + 0.3002939261496067, + 1.3652251102030277, + 0.4989272262901068, + 0.07345301285386086, + 0.19478721916675568, + 1.1770473644137383, + 0.22773880511522293, + 0.17816833779215813, + 0.06666607409715652, + 0.6206502579152584, + 0.3760016895830631, + 1.000920295715332, + 0.29855215921998024, + 0.5279161036014557, + 0.03533352166414261, + 0.24208112433552742, + 0.0, + 0.07321993261575699, + 0.1951761543750763, + 1.00499496050179, + 0.7077870704233646, + 0.3491210900247097, + 0.12710334360599518, + 0.08017315715551376, + 0.3609212823212147, + 0.4031611233949661, + 0.10556010156869888, + 0.6771924905478954, + 0.18885773047804832, + 0.2765069901943207, + 0.1171250194311142, + 2.5632111839950085, + 0.8929585590958595, + 0.8669719956815243, + 0.4900727216154337, + 0.23951289802789688, + 0.3828479014337063, + 0.6771380174905062, + 0.11963049694895744 + ], + "unique_experts": 59, + "load_cv": 0.9090593428863095, + "normalized_load_entropy": 0.9091975729607717, + "max_load_share": 0.078125 + } + }, + "s0_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "5da7047fac1fd0da2201a13358de968261827e536f43f69c05add31c396bfa15", + "route_weight_sha256": "042d22ed3d81c2fa7c151d80eb5814f1f272654dd53ee8fd554ae4bb3b46ac1d", + "loads": [ + 0, + 0, + 2, + 6, + 3, + 0, + 0, + 3, + 4, + 7, + 3, + 0, + 1, + 6, + 5, + 1, + 2, + 2, + 0, + 1, + 1, + 1, + 0, + 0, + 2, + 3, + 0, + 1, + 1, + 1, + 3, + 2, + 1, + 0, + 3, + 5, + 5, + 1, + 3, + 0, + 3, + 0, + 0, + 0, + 11, + 9, + 2, + 1, + 1, + 1, + 3, + 0, + 0, + 1, + 1, + 0, + 8, + 0, + 4, + 3, + 0, + 4, + 7, + 0 + ], + "weighted_loads": [ + 0.0, + 0.0, + 0.1162015050649643, + 0.4263996034860611, + 0.1693989671766758, + 0.0, + 0.0, + 0.1686820201575756, + 0.3612635023891926, + 0.6018548756837845, + 0.18195458501577377, + 0.0, + 0.038744810968637466, + 0.8873014897108078, + 0.3950520344078541, + 0.0908023864030838, + 0.12958861887454987, + 0.25839653611183167, + 0.0, + 0.033476267009973526, + 0.06326202303171158, + 0.057991959154605865, + 0.0, + 0.0, + 0.09313499182462692, + 0.21534373611211777, + 0.0, + 0.05928114801645279, + 0.033248111605644226, + 0.03902655839920044, + 0.16908233612775803, + 0.15674381703138351, + 0.04015292972326279, + 0.0, + 0.14940368756651878, + 0.3569410853087902, + 0.3178894817829132, + 0.03227528929710388, + 0.2568807750940323, + 0.0, + 0.20162048190832138, + 0.0, + 0.0, + 0.0, + 1.0090523771941662, + 0.7668905146420002, + 0.13591089099645615, + 0.0976363867521286, + 0.047239478677511215, + 0.1980617493391037, + 0.10882525891065598, + 0.0, + 0.0, + 0.052258364856243134, + 0.073092021048069, + 0.0, + 0.6616032924503088, + 0.0, + 0.2607078589498997, + 0.1842864565551281, + 0.0, + 0.42471419274806976, + 0.497375026345253, + 0.0 + ], + "unique_experts": 44, + "load_cv": 1.1454777617516225, + "normalized_load_entropy": 0.847455298134047, + "max_load_share": 0.07971014492753623 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "6744ed733610b7b90c2ce30c84b17101c4df7ee3a83f0e1b8ed09d13662f6fbc", + "route_weight_sha256": "e52775a301103852069da3d9c825782031966adef410a41663f6e94edee347cb", + "loads": [ + 0, + 1, + 2, + 8, + 3, + 1, + 0, + 4, + 4, + 11, + 7, + 5, + 2, + 7, + 19, + 2, + 2, + 13, + 0, + 1, + 1, + 2, + 0, + 0, + 7, + 3, + 5, + 10, + 1, + 1, + 11, + 2, + 4, + 0, + 8, + 5, + 11, + 1, + 3, + 0, + 3, + 0, + 1, + 4, + 13, + 9, + 6, + 1, + 2, + 1, + 12, + 1, + 4, + 1, + 2, + 0, + 25, + 7, + 10, + 4, + 0, + 4, + 8, + 3 + ], + "weighted_loads": [ + 0.0, + 0.05021526291966438, + 0.1162015050649643, + 0.5273215472698212, + 0.1693989671766758, + 0.0471627414226532, + 0.0, + 0.2029425911605358, + 0.3612635023891926, + 0.8189543262124062, + 0.6013404205441475, + 0.3297003470361233, + 0.22248566523194313, + 0.9446893744170666, + 1.0485392063856125, + 0.14795229956507683, + 0.12958861887454987, + 1.0152026880532503, + 0.0, + 0.033476267009973526, + 0.06326202303171158, + 0.08907381072640419, + 0.0, + 0.0, + 0.39873843267560005, + 0.21534373611211777, + 0.7727180644869804, + 0.39625836722552776, + 0.033248111605644226, + 0.03902655839920044, + 1.049629494547844, + 0.15674381703138351, + 0.16420454159379005, + 0.0, + 0.5949501376599073, + 0.3569410853087902, + 0.6192617826163769, + 0.03227528929710388, + 0.2568807750940323, + 0.0, + 0.20162048190832138, + 0.0, + 0.02813170850276947, + 0.2473835125565529, + 1.0900354199111462, + 0.7668905146420002, + 0.3471074067056179, + 0.0976363867521286, + 0.08942325785756111, + 0.1980617493391037, + 0.5134117156267166, + 0.07559452950954437, + 0.4224780425429344, + 0.052258364856243134, + 0.11973989009857178, + 0.0, + 2.2185931093990803, + 0.3997773826122284, + 0.5029675029218197, + 0.23227857798337936, + 0.0, + 0.42471419274806976, + 0.5379353500902653, + 0.22271167114377022 + ], + "unique_experts": 54, + "load_cv": 1.081551240773988, + "normalized_load_entropy": 0.8744514977739821, + "max_load_share": 0.08680555555555555 + } + }, + "s1_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "da32035453f1ebef6636f78d92a1b9ebc5ef89db173d74a5c9d41725c77666f2", + "route_weight_sha256": "14375219146be7aa59574cca2cd75e5cc1a85d7cee0606c618290901bb02134b", + "loads": [ + 0, + 0, + 2, + 6, + 3, + 0, + 0, + 4, + 5, + 7, + 3, + 0, + 1, + 6, + 5, + 1, + 2, + 2, + 0, + 1, + 1, + 1, + 1, + 0, + 2, + 4, + 0, + 1, + 1, + 1, + 3, + 2, + 0, + 0, + 2, + 5, + 4, + 0, + 3, + 0, + 3, + 0, + 1, + 0, + 10, + 8, + 1, + 1, + 1, + 1, + 3, + 0, + 0, + 0, + 1, + 0, + 8, + 0, + 4, + 5, + 0, + 4, + 8, + 0 + ], + "weighted_loads": [ + 0.0, + 0.0, + 0.11301335319876671, + 0.41521023213863373, + 0.17694124951958656, + 0.0, + 0.0, + 0.22508233785629272, + 0.3702910989522934, + 0.6158067286014557, + 0.14833879098296165, + 0.0, + 0.029121829196810722, + 0.9000282734632492, + 0.44394059479236603, + 0.08521608263254166, + 0.1441529542207718, + 0.24268323183059692, + 0.0, + 0.03038007579743862, + 0.06725158542394638, + 0.06115446984767914, + 0.03394768014550209, + 0.0, + 0.0723361074924469, + 0.2159794382750988, + 0.0, + 0.053677547723054886, + 0.03260580450296402, + 0.04669748991727829, + 0.15736500918865204, + 0.14612913131713867, + 0.0, + 0.0, + 0.10377420857548714, + 0.3664719685912132, + 0.2793470062315464, + 0.0, + 0.2354912906885147, + 0.0, + 0.24313649162650108, + 0.0, + 0.030864102765917778, + 0.0, + 0.8606131970882416, + 0.7281223945319653, + 0.06975439935922623, + 0.09118051826953888, + 0.04778466746211052, + 0.20451371371746063, + 0.10590782389044762, + 0.0, + 0.0, + 0.0, + 0.06477347016334534, + 0.0, + 0.6932041570544243, + 0.0, + 0.25065308436751366, + 0.25220903381705284, + 0.0, + 0.3783930614590645, + 0.561955027282238, + 0.0 + ], + "unique_experts": 43, + "load_cv": 1.14254016368129, + "normalized_load_entropy": 0.8431378897496722, + "max_load_share": 0.07246376811594203 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "6ead0e330b708ea1743cb0523ab4ef7c0a5de43a29cf6a51bb8c837f81d7aec8", + "route_weight_sha256": "8eb723dddf2f444b95d694c8a08f248355c4f3faf91b6474bcaa4f14d4758fb5", + "loads": [ + 0, + 1, + 2, + 8, + 6, + 0, + 0, + 5, + 5, + 13, + 11, + 6, + 2, + 7, + 19, + 6, + 2, + 9, + 0, + 1, + 1, + 7, + 7, + 0, + 10, + 6, + 12, + 12, + 2, + 3, + 12, + 3, + 4, + 1, + 9, + 5, + 16, + 6, + 6, + 1, + 4, + 0, + 4, + 4, + 11, + 8, + 5, + 2, + 3, + 3, + 11, + 2, + 9, + 2, + 5, + 2, + 30, + 8, + 14, + 11, + 2, + 4, + 11, + 3 + ], + "weighted_loads": [ + 0.0, + 0.045970022678375244, + 0.11301335319876671, + 0.517559252679348, + 0.35812291502952576, + 0.0, + 0.0, + 0.3132806718349457, + 0.3702910989522934, + 0.9685491845011711, + 0.9663870297372341, + 0.6116689927875996, + 0.12867414765059948, + 0.9530910551548004, + 1.2821995988488197, + 0.3870989456772804, + 0.1441529542207718, + 0.8262565676122904, + 0.0, + 0.03038007579743862, + 0.06725158542394638, + 0.41296214796602726, + 0.48119981959462166, + 0.0, + 0.46011502854526043, + 0.321899201720953, + 1.335892591625452, + 0.48141537606716156, + 0.08281021192669868, + 0.11643349751830101, + 1.1842374354600906, + 0.22624024003744125, + 0.17618044093251228, + 0.07010232657194138, + 0.6506092697381973, + 0.3664719685912132, + 0.9637433812022209, + 0.3278367258608341, + 0.5260820537805557, + 0.03533352166414261, + 0.27329445257782936, + 0.0, + 0.15648510120809078, + 0.1951761543750763, + 0.9019729234278202, + 0.7281223945319653, + 0.3295445293188095, + 0.13301759958267212, + 0.11542654410004616, + 0.3595927245914936, + 0.42766669765114784, + 0.10393188893795013, + 0.7320907674729824, + 0.18885773047804832, + 0.31414780765771866, + 0.1171250194311142, + 2.6311221066862345, + 0.742957703769207, + 0.818411260843277, + 0.4993374664336443, + 0.23951289802789688, + 0.3783930614590645, + 0.6893353816121817, + 0.202519703656435 + ], + "unique_experts": 58, + "load_cv": 0.8848650242331376, + "normalized_load_entropy": 0.9120352370215269, + "max_load_share": 0.078125 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "ordered_topk_exact_tokens": 17, + "set_exact_tokens": 20, + "mean_set_jaccard": 0.9627329192546585, + "mean_token_weighted_tv": 0.01600770680638759, + "aggregate_load_tv": 0.014492753623188404 + }, + "system_bos": { + "tokens": 23, + "ordered_topk_exact_tokens": 19, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.9503105590062112, + "mean_token_weighted_tv": 0.021271534992948822, + "aggregate_load_tv": 0.028985507246376812 + }, + "system_x": { + "tokens": 23, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.9006211180124224, + "mean_token_weighted_tv": 0.030446028579836307, + "aggregate_load_tv": 0.043478260869565216 + }, + "system_period": { + "tokens": 23, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 11, + "mean_set_jaccard": 0.8509316770186336, + "mean_token_weighted_tv": 0.039515298993691154, + "aggregate_load_tv": 0.05797101449275362 + }, + "bos_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 16, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.9161490683229813, + "mean_token_weighted_tv": 0.028629923401319462, + "aggregate_load_tv": 0.05072463768115942 + }, + "bos_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 16, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.9409937888198759, + "mean_token_weighted_tv": 0.023697768580978332, + "aggregate_load_tv": 0.028985507246376812 + }, + "x_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.9130434782608695, + "mean_token_weighted_tv": 0.026639129521082276, + "aggregate_load_tv": 0.043478260869565216 + }, + "x_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.9037267080745343, + "mean_token_weighted_tv": 0.03206789242508619, + "aggregate_load_tv": 0.03623188405797101 + }, + "period_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 18, + "mean_set_jaccard": 0.9378881987577641, + "mean_token_weighted_tv": 0.022301962518173714, + "aggregate_load_tv": 0.03623188405797101 + }, + "period_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8788819875776398, + "mean_token_weighted_tv": 0.03702340279098438, + "aggregate_load_tv": 0.057971014492753624 + } + } + } + } + }, + { + "id": "tnews/test/8935", + "domain": "chinese", + "label": "中文新闻", + "within_domain_index": 1, + "selection_rank": "000c9943109217e6b0473de9c090009fae3ee782aa8e3c63f08abe82cb8c487e", + "source_text_sha256": "de6e53450cf0a33beb5377fd6de72a7347cc9e39e769282a942cdc9659b1955c", + "source_characters": 30, + "source_tokens": 23, + "content_token_ids_sha256": "5c79fb63483889b5fe78559027c887b8b30e81a2d4a9a85fce68fd7db2724bdb", + "prompt_tokens_by_condition": { + "s0_eos": 48, + "s1_eos": 64, + "s0_bos": 48, + "s1_bos": 64, + "s0_x": 48, + "s1_x": 64, + "s0_period": 48, + "s1_period": 64 + }, + "batch_prompt_tokens": 64, + "content_tokens": 23, + "boundary_crossing_tokens_by_condition": { + "s0_eos": 0, + "s1_eos": 0, + "s0_bos": 0, + "s1_bos": 0, + "s0_x": 0, + "s1_x": 0, + "s0_period": 0, + "s1_period": 0 + }, + "forward_seconds": 0.6156532169843558, + "peak_cuda_memory_allocated_bytes": 27585573888, + "hidden_stages": { + "embedding": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "960a7761a73bc748fa3e7a51e6e1b72f1cf70c247190327c19c740a436e710ec", + "mean": 4.171523323748261e-05, + "std": 0.11484204977750778, + "rms": 0.11484206467866898, + "max_abs": 2.015625 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f178da23b736ed68a10a671e7939f61dcd7eab1ccfbc2728a00cb8ba4d5b2682", + "mean": -0.0004682116268668324, + "std": 0.10051731020212173, + "rms": 0.10051840543746948, + "max_abs": 2.046875 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "960a7761a73bc748fa3e7a51e6e1b72f1cf70c247190327c19c740a436e710ec", + "mean": 4.171523323748261e-05, + "std": 0.11484204977750778, + "rms": 0.11484206467866898, + "max_abs": 2.015625 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e255dac7afb85d4f7ca5a1ef497ea3551b35fd3cde8688c4354df8e471bcdf5c", + "mean": -0.0009004279272630811, + "std": 0.10159619897603989, + "rms": 0.10160019248723984, + "max_abs": 2.046875 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "960a7761a73bc748fa3e7a51e6e1b72f1cf70c247190327c19c740a436e710ec", + "mean": 4.171523323748261e-05, + "std": 0.11484204977750778, + "rms": 0.11484206467866898, + "max_abs": 2.015625 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e1cba988c0f5dbf0ec86eff1502b4091fb064adf500fe8d479884c9730af55ac", + "mean": -0.0004362701438367367, + "std": 0.100129134953022, + "rms": 0.10013008117675781, + "max_abs": 2.046875 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "960a7761a73bc748fa3e7a51e6e1b72f1cf70c247190327c19c740a436e710ec", + "mean": 4.171523323748261e-05, + "std": 0.11484204977750778, + "rms": 0.11484206467866898, + "max_abs": 2.015625 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e4eb42495a2e5b154021e4a974c477277dc35d3060bab960f0e76602142e57aa", + "mean": -0.0008764717495068908, + "std": 0.1013084128499031, + "rms": 0.10131219774484634, + "max_abs": 2.046875 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "960a7761a73bc748fa3e7a51e6e1b72f1cf70c247190327c19c740a436e710ec", + "mean": 4.171523323748261e-05, + "std": 0.11484204977750778, + "rms": 0.11484206467866898, + "max_abs": 2.015625 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2507e1f8bdd614f1613f139e5340e1238d6e439d4b6e445117dad01be8c4ef2f", + "mean": -0.0005146548501215875, + "std": 0.10039107501506805, + "rms": 0.10039239376783371, + "max_abs": 2.046875 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "960a7761a73bc748fa3e7a51e6e1b72f1cf70c247190327c19c740a436e710ec", + "mean": 4.171523323748261e-05, + "std": 0.11484204977750778, + "rms": 0.11484206467866898, + "max_abs": 2.015625 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3ac695622e55e38c8a5883a07adb0cf3acc233c2d11bd3f6d8109db50ae6c90a", + "mean": -0.0009352603228762746, + "std": 0.10150239616632462, + "rms": 0.10150670260190964, + "max_abs": 2.046875 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "960a7761a73bc748fa3e7a51e6e1b72f1cf70c247190327c19c740a436e710ec", + "mean": 4.171523323748261e-05, + "std": 0.11484204977750778, + "rms": 0.11484206467866898, + "max_abs": 2.015625 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b7cd4164cf74893b085fa2ba01cf0b2c887c9fd8494e356761db1801ff044333", + "mean": -0.0005163452005945146, + "std": 0.10009289532899857, + "rms": 0.10009422898292542, + "max_abs": 2.046875 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "960a7761a73bc748fa3e7a51e6e1b72f1cf70c247190327c19c740a436e710ec", + "mean": 4.171523323748261e-05, + "std": 0.11484204977750778, + "rms": 0.11484206467866898, + "max_abs": 2.015625 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6f8c59b701b3d09fbd3c13fc3d5f13aa83ce4c455ee16c203416b0980dd601a3", + "mean": -0.0009365280857309699, + "std": 0.1012812927365303, + "rms": 0.10128562152385712, + "max_abs": 2.046875 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "exact_hidden_rows": 23, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999998211860657, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "system_bos": { + "tokens": 23, + "exact_hidden_rows": 23, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999998211860657, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "system_x": { + "tokens": 23, + "exact_hidden_rows": 23, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999998211860657, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "system_period": { + "tokens": 23, + "exact_hidden_rows": 23, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999998211860657, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "bos_at_s0": { + "tokens": 23, + "exact_hidden_rows": 23, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999998211860657, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "bos_at_s1": { + "tokens": 23, + "exact_hidden_rows": 23, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999998211860657, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "x_at_s0": { + "tokens": 23, + "exact_hidden_rows": 23, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999998211860657, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "x_at_s1": { + "tokens": 23, + "exact_hidden_rows": 23, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999998211860657, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "period_at_s0": { + "tokens": 23, + "exact_hidden_rows": 23, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999998211860657, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "period_at_s1": { + "tokens": 23, + "exact_hidden_rows": 23, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999998211860657, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + } + } + }, + "layer_00": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "372f889ca98beef73cd1cd97a40ed7e17254b2e98ac4b09d644ecb73a8c6ba5b", + "mean": -0.0013515487080439925, + "std": 0.10731279104948044, + "rms": 0.10732129961252213, + "max_abs": 2.328125 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5c76a434945c2b594bcce48b1315710dcd427760ae7e7669292d0f4dc4f6bcf3", + "mean": -0.0014524265425279737, + "std": 0.09845525771379471, + "rms": 0.09846597164869308, + "max_abs": 2.4375 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "65de4a6173cd405026140a995fe75f0f34f0216bb91a734b5e7aee8bc0a5ba7f", + "mean": -0.0013564482796937227, + "std": 0.10750380158424377, + "rms": 0.10751235485076904, + "max_abs": 2.34375 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d8bae6c777a65d32fa366f75e1fdbbd831568bafe59ecc8a70c8bbe603f9bdfa", + "mean": -0.0016697361133992672, + "std": 0.09843312203884125, + "rms": 0.0984472781419754, + "max_abs": 2.4375 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "38b7f28983b3a17463e65971665f90e99056f7396142cf9575ba68b9af6a49c3", + "mean": -0.0013643328566104174, + "std": 0.1055242195725441, + "rms": 0.10553303360939026, + "max_abs": 2.28125 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "30672fc248103d700eed4a05082f0fccb42de58ee4d96e83dddc4b5526857923", + "mean": -0.0014109043404459953, + "std": 0.09694179147481918, + "rms": 0.09695205837488174, + "max_abs": 2.4375 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a2ce754bd971b5b8b641fc06063909f21c93f00038cd388aa6fabac21e28abe2", + "mean": -0.0013677622191607952, + "std": 0.10553940385580063, + "rms": 0.10554826259613037, + "max_abs": 2.3125 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "37d92d5fbd2ca55887d842beb2f94914c577034e512a41823fb2b09884639017", + "mean": -0.0016379071166738868, + "std": 0.09721646457910538, + "rms": 0.09723025560379028, + "max_abs": 2.4375 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f7775c89dcd861443c00f5bc1a66e1ccee1aa0b717d3146114279391771da8e8", + "mean": -0.0013506946852430701, + "std": 0.10516846925020218, + "rms": 0.105177141726017, + "max_abs": 2.296875 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8306d217bc60f0c260c0ec411e563f6e437f1c042a6612c7137a61b73b7d5835", + "mean": -0.0014492684276774526, + "std": 0.09702633321285248, + "rms": 0.09703715145587921, + "max_abs": 2.4375 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1d86ad6cfdbd44b88b480d7bb347c115705a6cb79d6f70bcef01235b0477b32a", + "mean": -0.0013615468051284552, + "std": 0.10529468208551407, + "rms": 0.10530348122119904, + "max_abs": 2.3125 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "040cee992fa107b73efd9a9fb5525016eae3cbde5d4839eb25a483391da8697b", + "mean": -0.0016766912303864956, + "std": 0.09736441820859909, + "rms": 0.09737885743379593, + "max_abs": 2.4375 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9f102a27fd6ccf677c504d26daa774952437576bd1ccc1a0ef701511089e419e", + "mean": -0.0013538631610572338, + "std": 0.10535958409309387, + "rms": 0.10536827892065048, + "max_abs": 2.296875 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ac1dcd7a9b48f7588fc31143dac363269b4bcfbbbfc985258a4bbf49c53ebdb9", + "mean": -0.0014503980055451393, + "std": 0.09666026383638382, + "rms": 0.09667114913463593, + "max_abs": 2.4375 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "896d46e65a79fc7ff135701555e6f6265d3f06c7b47d8c0b91afc0e6513ab31a", + "mean": -0.001362724113278091, + "std": 0.10541336983442307, + "rms": 0.10542217642068863, + "max_abs": 2.3125 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cccd4181e32f8a9491a11ad1eabdbfa86fdc9a6a4156191978d6917fb0febef1", + "mean": -0.0016723901499062777, + "std": 0.09702672809362411, + "rms": 0.09704114496707916, + "max_abs": 2.4375 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9997029304504395, + "min_cosine_similarity": 0.9989104270935059, + "mean_relative_l2": 0.023109005764126778, + "max_abs_delta": 0.1171875 + }, + "system_bos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9995405673980713, + "min_cosine_similarity": 0.9988268613815308, + "mean_relative_l2": 0.02889288030564785, + "max_abs_delta": 0.1171875 + }, + "system_x": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9995525479316711, + "min_cosine_similarity": 0.998889684677124, + "mean_relative_l2": 0.028872275725007057, + "max_abs_delta": 0.1171875 + }, + "system_period": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9995996356010437, + "min_cosine_similarity": 0.998956561088562, + "mean_relative_l2": 0.02712060511112213, + "max_abs_delta": 0.109375 + }, + "bos_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9851688742637634, + "min_cosine_similarity": 0.9702108502388, + "mean_relative_l2": 0.1697130650281906, + "max_abs_delta": 0.265625 + }, + "bos_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9868666529655457, + "min_cosine_similarity": 0.9747523665428162, + "mean_relative_l2": 0.16016995906829834, + "max_abs_delta": 0.265625 + }, + "x_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9853894710540771, + "min_cosine_similarity": 0.9702966809272766, + "mean_relative_l2": 0.1685451716184616, + "max_abs_delta": 0.265625 + }, + "x_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9871076345443726, + "min_cosine_similarity": 0.9750195741653442, + "mean_relative_l2": 0.15873147547245026, + "max_abs_delta": 0.265625 + }, + "period_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9857111573219299, + "min_cosine_similarity": 0.9712550044059753, + "mean_relative_l2": 0.16678079962730408, + "max_abs_delta": 0.2578125 + }, + "period_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9873540997505188, + "min_cosine_similarity": 0.9756629467010498, + "mean_relative_l2": 0.15727606415748596, + "max_abs_delta": 0.2578125 + } + } + }, + "layer_01": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ca8d98378812aadf7d7eb43adfe4d5905ab53d2c90bda18a6003eee4ac3b637d", + "mean": -0.0016594979679211974, + "std": 0.12096434086561203, + "rms": 0.12097572535276413, + "max_abs": 2.8125 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ec44cb54f728e46a1a19fb6c4193ca22dcd2f56f82d3336f7089249c2a6000d2", + "mean": -0.0074837286956608295, + "std": 1.1544831991195679, + "rms": 1.1545073986053467, + "max_abs": 126.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7ea6e51592c08fee2eaeb3cd4b79802e4b9716c4986c496b9a3893e4d83fecdd", + "mean": -0.0016102269291877747, + "std": 0.12138921022415161, + "rms": 0.1213998943567276, + "max_abs": 2.84375 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f21d42aaed535a3b57e6741ab946f4e8977acfb33ea5dc643f0ef11380666aca", + "mean": -0.006639644969254732, + "std": 1.0359822511672974, + "rms": 1.0360034704208374, + "max_abs": 135.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "229cc9e4365cccd17ed33ecbbbdce82e3f638796c31719df0a63a35d33ca4862", + "mean": -0.001982280984520912, + "std": 0.1184653639793396, + "rms": 0.11848194897174835, + "max_abs": 2.8125 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2d587a79884aaafc4eb14c8bf4d8ff32b64884c9a5a7e7a12edfc23ce45b6c0b", + "mean": -0.0016995673067867756, + "std": 0.1163194477558136, + "rms": 0.11633186042308807, + "max_abs": 4.6875 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "355723561f16c866221c53d0ec8715659b3d4ab8379c58dd701130d1aa62d786", + "mean": -0.0020792512223124504, + "std": 0.11869887262582779, + "rms": 0.11871708929538727, + "max_abs": 2.84375 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5514a8d94b827801948e2abd920685eec58e5a0ab11e014817ac32c6b54b259c", + "mean": -0.0021429252810776234, + "std": 0.1156480684876442, + "rms": 0.1156679168343544, + "max_abs": 4.6875 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d0ea7eaaba7679ba8e37a2cab9276f436d2cb1c01f5a924d087e8f0c500918d7", + "mean": -0.0018699340289458632, + "std": 0.1189584732055664, + "rms": 0.11897316575050354, + "max_abs": 2.828125 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "78cee1ecb55cf3cf864e1de87950ddb3623207baaf58b64c467a5ce58abfde26", + "mean": -0.0016466700471937656, + "std": 0.11673236638307571, + "rms": 0.11674397438764572, + "max_abs": 4.6875 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a5fce6111bda20e091694dbef361907fa6043de67dd4ad41d3ee7d6d901ee6aa", + "mean": -0.0020298997405916452, + "std": 0.11850950866937637, + "rms": 0.118526890873909, + "max_abs": 2.84375 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a62bdcd9f8ebd6adc322b0a97668c2d8c42f36c7c30382269e21ee0eb6b00fa2", + "mean": -0.002134838839992881, + "std": 0.11570057272911072, + "rms": 0.11572026461362839, + "max_abs": 4.6875 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "edc2a537ffaa9f32c72eb28069722b17997d9d121d984ef2b802aebb68efbbf0", + "mean": -0.0018834170186892152, + "std": 0.11899770051240921, + "rms": 0.11901260167360306, + "max_abs": 2.84375 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "58c89a1a95c372a0e38cb0407cf6d4be58ad7e2f4f7a45e97c78dce224cec7ee", + "mean": -0.0016929693520069122, + "std": 0.11610066145658493, + "rms": 0.11611300706863403, + "max_abs": 4.6875 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "add798345aeeae939fc4b3aba62aea7f3374e52b8777f6df5f2161cddd791fbe", + "mean": -0.002025769092142582, + "std": 0.11864608526229858, + "rms": 0.11866337060928345, + "max_abs": 2.84375 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "116be63810521e81052f40a7ee21fd6f3fea609623eaccee1b3e84f5c33c7ef6", + "mean": -0.002158239483833313, + "std": 0.11526352167129517, + "rms": 0.11528372764587402, + "max_abs": 4.6875 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9988807439804077, + "min_cosine_similarity": 0.9962954521179199, + "mean_relative_l2": 0.04530765861272812, + "max_abs_delta": 0.078125 + }, + "system_bos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9968711137771606, + "min_cosine_similarity": 0.9939830303192139, + "mean_relative_l2": 0.07660883665084839, + "max_abs_delta": 0.125 + }, + "system_x": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9953774809837341, + "min_cosine_similarity": 0.9890743494033813, + "mean_relative_l2": 0.09027872234582901, + "max_abs_delta": 0.109375 + }, + "system_period": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9954150915145874, + "min_cosine_similarity": 0.9881255030632019, + "mean_relative_l2": 0.09007327258586884, + "max_abs_delta": 0.0859375 + }, + "bos_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.985012948513031, + "min_cosine_similarity": 0.9674997329711914, + "mean_relative_l2": 0.16935893893241882, + "max_abs_delta": 0.215576171875 + }, + "bos_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9846619367599487, + "min_cosine_similarity": 0.9657574892044067, + "mean_relative_l2": 0.17125600576400757, + "max_abs_delta": 0.24609375 + }, + "x_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9859790205955505, + "min_cosine_similarity": 0.9686113595962524, + "mean_relative_l2": 0.1628551036119461, + "max_abs_delta": 0.293701171875 + }, + "x_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9830483794212341, + "min_cosine_similarity": 0.9638249278068542, + "mean_relative_l2": 0.17927449941635132, + "max_abs_delta": 0.302734375 + }, + "period_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.986361563205719, + "min_cosine_similarity": 0.96860671043396, + "mean_relative_l2": 0.16041317582130432, + "max_abs_delta": 0.263671875 + }, + "period_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9833594560623169, + "min_cosine_similarity": 0.9633426666259766, + "mean_relative_l2": 0.17718634009361267, + "max_abs_delta": 0.3046875 + } + } + }, + "layer_02": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4f8f6d24cb9572862ec4670b2790c1d59bd32cdc90fba6cf4aeb5e6aa05eab88", + "mean": -0.0024638401810079813, + "std": 0.14341233670711517, + "rms": 0.14343351125717163, + "max_abs": 3.125 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9aa6eaacc0767269bbb90a361653f825c235f42726a70d3fdb7832c88937a81c", + "mean": -0.021665597334504128, + "std": 3.465214252471924, + "rms": 3.4652819633483887, + "max_abs": 392.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0aff46b076e012ee2518bf88f51a42081cb190927ac4b8a714bcde32e5c7f13e", + "mean": -0.0022488099057227373, + "std": 0.14298449456691742, + "rms": 0.14300216734409332, + "max_abs": 3.109375 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9d03196b89a5333da3b1e1a489cd2ed4a22b4ef0c9b359cbd8fac21b037cb6a6", + "mean": -0.019342925399541855, + "std": 3.324270009994507, + "rms": 3.324326276779175, + "max_abs": 436.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9775e2a5f3045eeff6253c04a5db1dd8aed74fce25dd28e71c0d406e9d58f781", + "mean": -0.002741923090070486, + "std": 0.14032039046287537, + "rms": 0.1403471678495407, + "max_abs": 3.03125 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "66de31279bfef656a04302672452bcd938b3280bede4d4cb2f9aa4053b867fd4", + "mean": -0.002808604622259736, + "std": 0.2702838182449341, + "rms": 0.27029839158058167, + "max_abs": 23.75 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7c784efb314137f3887fbd6bdebb92e64a6be71781fa6a0ea0142d4263146f42", + "mean": -0.0025363683234900236, + "std": 0.14070379734039307, + "rms": 0.14072665572166443, + "max_abs": 3.046875 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "887d697f705c6c22a0f47c3460bced61479cdda993e932920a3d0b7809d9f75c", + "mean": -0.002621257212013006, + "std": 0.24337974190711975, + "rms": 0.24339385330677032, + "max_abs": 23.75 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "dc34563f70d0d868c486613f84ec434d87a039e99e96323978736060da4f0eb0", + "mean": -0.0024968069046735764, + "std": 0.13953793048858643, + "rms": 0.139560267329216, + "max_abs": 3.09375 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f37cfa351b708ec4944c9512721c91ff3050c2c455906a67261ab2d4de7e6176", + "mean": -0.002683498663827777, + "std": 0.27027034759521484, + "rms": 0.27028363943099976, + "max_abs": 23.75 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9cbc0cb004ae1e9fe542f272fb9f3d7190b464c1a92d5814155e5f6ebb00bbf5", + "mean": -0.0022929622791707516, + "std": 0.13903264701366425, + "rms": 0.13905154168605804, + "max_abs": 3.046875 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "454d3464cabb60567ee62d475a037a391730ed2cf26cc9238ceba2a707e8f44e", + "mean": -0.0025336393155157566, + "std": 0.2431163340806961, + "rms": 0.24312953650951385, + "max_abs": 23.75 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6dd68098482d191bafc44f2f346644c28b675c0400bba8e4faf37a7defb12c24", + "mean": -0.002417377196252346, + "std": 0.13934685289859772, + "rms": 0.13936781883239746, + "max_abs": 3.078125 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2e7871c71b59f482cf3b085c825c364e4f6f8927ef71cae156408b20552f27d9", + "mean": -0.0027674788143485785, + "std": 0.2696423828601837, + "rms": 0.26965653896331787, + "max_abs": 23.75 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "85f1cc288fb402299e55ee33872a28e4cc4f8ef467e2e08c405532d0109c0a9c", + "mean": -0.0022783728782087564, + "std": 0.13896289467811584, + "rms": 0.13898156583309174, + "max_abs": 3.0625 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "861cfbcaa5a01c733552958c399cab87d402f40c1c944ba5a2655b05f2647e79", + "mean": -0.002595919417217374, + "std": 0.24263447523117065, + "rms": 0.24264834821224213, + "max_abs": 23.75 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9983335733413696, + "min_cosine_similarity": 0.9956457614898682, + "mean_relative_l2": 0.05595938488841057, + "max_abs_delta": 0.203125 + }, + "system_bos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9955596923828125, + "min_cosine_similarity": 0.9870103597640991, + "mean_relative_l2": 0.09145154803991318, + "max_abs_delta": 0.1328125 + }, + "system_x": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9937626123428345, + "min_cosine_similarity": 0.9811534881591797, + "mean_relative_l2": 0.10618970543146133, + "max_abs_delta": 0.203125 + }, + "system_period": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9937583804130554, + "min_cosine_similarity": 0.9811834096908569, + "mean_relative_l2": 0.10659939050674438, + "max_abs_delta": 0.171875 + }, + "bos_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9860027432441711, + "min_cosine_similarity": 0.974608302116394, + "mean_relative_l2": 0.16472110152244568, + "max_abs_delta": 0.259765625 + }, + "bos_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9832358956336975, + "min_cosine_similarity": 0.9678140878677368, + "mean_relative_l2": 0.18044371902942657, + "max_abs_delta": 0.328125 + }, + "x_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9838820695877075, + "min_cosine_similarity": 0.9665526151657104, + "mean_relative_l2": 0.17524847388267517, + "max_abs_delta": 0.4111328125 + }, + "x_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9783310294151306, + "min_cosine_similarity": 0.9540305137634277, + "mean_relative_l2": 0.20263120532035828, + "max_abs_delta": 0.4501953125 + }, + "period_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9840713143348694, + "min_cosine_similarity": 0.9650851488113403, + "mean_relative_l2": 0.1743340939283371, + "max_abs_delta": 0.34912109375 + }, + "period_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.97831791639328, + "min_cosine_similarity": 0.9505975246429443, + "mean_relative_l2": 0.20216064155101776, + "max_abs_delta": 0.419921875 + } + } + }, + "layer_03": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "93b93fa81621d253a7417d56c166081bbf870edf44f6f77581ec781f1d15506e", + "mean": -0.0029525423888117075, + "std": 0.16096024215221405, + "rms": 0.16098731756210327, + "max_abs": 3.65625 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "86ae338e53cb18b662c2fd53ce589d0d56238a58c6842f01c24833a05a543059", + "mean": -0.028668537735939026, + "std": 10.395384788513184, + "rms": 10.39542293548584, + "max_abs": 1136.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "58a34b1d04d1c0be8bac9a5e382eba738202fd4a33deb05f4ee7dd3ad793fedd", + "mean": -0.002890099538490176, + "std": 0.16096988320350647, + "rms": 0.16099582612514496, + "max_abs": 3.671875 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0afa4a4a52e5e5176f7d22a26ef56bd9752bdeb42eed5568691a2eb807e23f04", + "mean": -0.02522975206375122, + "std": 9.297039985656738, + "rms": 9.297074317932129, + "max_abs": 1136.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d76f9ea31963e1732656b26b5fefd99b3ab0d1def8ed29ff975a19c79da983ea", + "mean": -0.003249394940212369, + "std": 0.16052445769309998, + "rms": 0.160557359457016, + "max_abs": 3.6875 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4ac0252fb756cd3bc4fd766790ffca3c96cf4a2bff46dc1a1e9601833e07a1d2", + "mean": -0.007642653305083513, + "std": 9.26821517944336, + "rms": 9.268218040466309, + "max_abs": 1136.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "91021cf3da4fac0244cca77a516248a38ff6d6210782319eafb84010c6e952c6", + "mean": -0.003400026820600033, + "std": 0.1612040400505066, + "rms": 0.161239892244339, + "max_abs": 3.75 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c435b556389e5f2fcc6914f35ab439e2891f817d8b613062fafbf553d0eb3b19", + "mean": -0.006733239628374577, + "std": 8.026871681213379, + "rms": 8.026874542236328, + "max_abs": 1136.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6bf70fe58d64d3530285258754eb6065df9ab70953425ef1cfa1349a92ea3176", + "mean": -0.0031574731692671776, + "std": 0.1589938998222351, + "rms": 0.15902523696422577, + "max_abs": 3.6875 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "06587db0834b8853d8ed13c4ac9765cedf647392c8ebaabda164f81e3ca1e7a1", + "mean": -0.007694929838180542, + "std": 9.2681884765625, + "rms": 9.26819133758545, + "max_abs": 1136.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "810da8467ff021b7b0e1f2310cd8d50be804847965feec27c5c8d8b0cfd9899a", + "mean": -0.0034026477951556444, + "std": 0.1595742255449295, + "rms": 0.15961050987243652, + "max_abs": 3.78125 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "231556a28ad07f19d96897a5f96e3fc8ca4629afce9f424529f6924a3ea885cc", + "mean": -0.006826960016041994, + "std": 8.026849746704102, + "rms": 8.02685260772705, + "max_abs": 1136.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "185663ad31ac558cd313fa75e3f96f899837a75951c802fb9d2e3732113f54af", + "mean": -0.0031204463448375463, + "std": 0.15901990234851837, + "rms": 0.15905050933361053, + "max_abs": 3.65625 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "544f8bd5ff01dc9fb58efbccf69d65b4bd5c8898bce2c6a4f08e996a227c1fef", + "mean": -0.007689118385314941, + "std": 9.268177032470703, + "rms": 9.268180847167969, + "max_abs": 1136.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f74e06b369d9c747eefde342346bb268f9726791fc2e2ddbdaaf007721ffb3b2", + "mean": -0.003391880774870515, + "std": 0.1595325618982315, + "rms": 0.15956860780715942, + "max_abs": 3.78125 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "979d348cd2fb61b6500ef9f27392f387992283cf06ab3544bff44de326134eca", + "mean": -0.006825223099440336, + "std": 8.026837348937988, + "rms": 8.026840209960938, + "max_abs": 1136.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9981470704078674, + "min_cosine_similarity": 0.9953881502151489, + "mean_relative_l2": 0.05854631960391998, + "max_abs_delta": 0.203125 + }, + "system_bos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9954996705055237, + "min_cosine_similarity": 0.9870167374610901, + "mean_relative_l2": 0.09178908169269562, + "max_abs_delta": 0.171875 + }, + "system_x": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9928935766220093, + "min_cosine_similarity": 0.9806643724441528, + "mean_relative_l2": 0.11406813561916351, + "max_abs_delta": 0.16796875 + }, + "system_period": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9928413033485413, + "min_cosine_similarity": 0.9806122779846191, + "mean_relative_l2": 0.11437138170003891, + "max_abs_delta": 0.16796875 + }, + "bos_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9865065813064575, + "min_cosine_similarity": 0.967528760433197, + "mean_relative_l2": 0.16105078160762787, + "max_abs_delta": 0.359375 + }, + "bos_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9833678603172302, + "min_cosine_similarity": 0.9592846035957336, + "mean_relative_l2": 0.17966245114803314, + "max_abs_delta": 0.328125 + }, + "x_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9843213558197021, + "min_cosine_similarity": 0.9602675437927246, + "mean_relative_l2": 0.1719532161951065, + "max_abs_delta": 0.33349609375 + }, + "x_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9780452847480774, + "min_cosine_similarity": 0.9419258236885071, + "mean_relative_l2": 0.20350968837738037, + "max_abs_delta": 0.419921875 + }, + "period_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9845708012580872, + "min_cosine_similarity": 0.9576432704925537, + "mean_relative_l2": 0.1703779697418213, + "max_abs_delta": 0.3046875 + }, + "period_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9780839681625366, + "min_cosine_similarity": 0.9405862092971802, + "mean_relative_l2": 0.2026454210281372, + "max_abs_delta": 0.42578125 + } + } + }, + "layer_04": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ec7545b9591e7f9e699aa2a0871017307c45d5246ca694b0e2c0232631930263", + "mean": -0.003164891619235277, + "std": 0.19032123684883118, + "rms": 0.1903475522994995, + "max_abs": 4.875 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b5988ef2597c28a73748b4ed865bdf9fe632ddf193827feb162317a4177bf20e", + "mean": -0.02850702404975891, + "std": 10.84494686126709, + "rms": 10.844985008239746, + "max_abs": 1152.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4c35434c2d9b7ad1cb11e0b714f6d3b94fa17615d1780ed3a8932b13b88aa11a", + "mean": -0.003087516175583005, + "std": 0.19124187529087067, + "rms": 0.19126679003238678, + "max_abs": 4.84375 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b2e01068fe90387ecb67b864207dfe01c57edfe2a0111d7efbb865226f77206d", + "mean": -0.025182830169796944, + "std": 9.675588607788086, + "rms": 9.67562198638916, + "max_abs": 1152.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "44499856eeee65b51e5b18e22b2d292b8255cc9d0d76f0d00d14b482ca7452b0", + "mean": -0.0031426679342985153, + "std": 0.19180722534656525, + "rms": 0.19183297455310822, + "max_abs": 5.0625 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "60fbabfe68c9ef8d1f1b0978aa0c419b74850a5c2f19ee05924422a540223cae", + "mean": -0.007295698393136263, + "std": 9.718761444091797, + "rms": 9.718765258789062, + "max_abs": 1152.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bf2d1790243ef4f86e0bfd32e1d735a1c286d18e93cd2e393086f6f94238390c", + "mean": -0.0032133404165506363, + "std": 0.19292093813419342, + "rms": 0.19294771552085876, + "max_abs": 5.03125 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7c3aee292de06a694b8e2c2313669d5f2650f4ac8ac1ce65bd08167aebc5ee02", + "mean": -0.006510121747851372, + "std": 8.41061019897461, + "rms": 8.410612106323242, + "max_abs": 1152.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3d215645c6e8e9d755e9fde79d2459a22d94555bf3d685d07887728afe644196", + "mean": -0.002825828967615962, + "std": 0.18867875635623932, + "rms": 0.1886999011039734, + "max_abs": 4.8125 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0e8453b1b0eb47c3ceaca5c7da79facc346e0f9fa917ac4b53fdf738019f9c5c", + "mean": -0.0070988480001688, + "std": 9.718696594238281, + "rms": 9.71869945526123, + "max_abs": 1152.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b0bbb5f0a26d7c556f02c37c21401488e288a4fc5401a1a261016ccffaad3f49", + "mean": -0.003105863928794861, + "std": 0.18985958397388458, + "rms": 0.1898849904537201, + "max_abs": 4.875 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6619e2cf59288c7f816dedf94edd0e5268c478b36cf2ce397a041a2032c26609", + "mean": -0.006443883758038282, + "std": 8.410550117492676, + "rms": 8.410552024841309, + "max_abs": 1152.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "63046eb222259c0b0906cafef23d2ef1f077ce7d946ffeae9783a751dd767f9b", + "mean": -0.002787642180919647, + "std": 0.1882009506225586, + "rms": 0.18822158873081207, + "max_abs": 4.6875 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6303126d44199b60fb4480f70ecf557a8bd12201563c46952e7773d22058adb3", + "mean": -0.007079719100147486, + "std": 9.718680381774902, + "rms": 9.718683242797852, + "max_abs": 1152.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b3d5d3354a9d986d986d29a2ae804b5c202757e74f69f501a7829992d20f3af9", + "mean": -0.003109010634943843, + "std": 0.1895701140165329, + "rms": 0.18959559500217438, + "max_abs": 4.8125 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9439aa20e593e2424b41b01d2cb1118cea3832516741c8d2917419959e32ee86", + "mean": -0.006434342358261347, + "std": 8.41053581237793, + "rms": 8.410537719726562, + "max_abs": 1152.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9981487393379211, + "min_cosine_similarity": 0.9957621693611145, + "mean_relative_l2": 0.05877695977687836, + "max_abs_delta": 0.125 + }, + "system_bos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9955514669418335, + "min_cosine_similarity": 0.9870444536209106, + "mean_relative_l2": 0.09212825447320938, + "max_abs_delta": 0.234375 + }, + "system_x": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.992168664932251, + "min_cosine_similarity": 0.9802967309951782, + "mean_relative_l2": 0.12144399434328079, + "max_abs_delta": 0.21484375 + }, + "system_period": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.992271900177002, + "min_cosine_similarity": 0.9814403057098389, + "mean_relative_l2": 0.12092794477939606, + "max_abs_delta": 0.25 + }, + "bos_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9897094368934631, + "min_cosine_similarity": 0.9776473045349121, + "mean_relative_l2": 0.141845241189003, + "max_abs_delta": 0.28125 + }, + "bos_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.986477792263031, + "min_cosine_similarity": 0.971991777420044, + "mean_relative_l2": 0.16391463577747345, + "max_abs_delta": 0.3515625 + }, + "x_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9868993163108826, + "min_cosine_similarity": 0.9710458517074585, + "mean_relative_l2": 0.15815113484859467, + "max_abs_delta": 0.5 + }, + "x_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9804977774620056, + "min_cosine_similarity": 0.9547888040542603, + "mean_relative_l2": 0.19379504024982452, + "max_abs_delta": 0.5390625 + }, + "period_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9863063097000122, + "min_cosine_similarity": 0.9681119918823242, + "mean_relative_l2": 0.16158762574195862, + "max_abs_delta": 0.53125 + }, + "period_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9803444147109985, + "min_cosine_similarity": 0.9511228799819946, + "mean_relative_l2": 0.19365990161895752, + "max_abs_delta": 0.53125 + } + } + }, + "layer_05": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3e42d92aa6411757da8da5610d9872cd00b508c28b1ed2d2834cb93669854319", + "mean": -0.0022176066413521767, + "std": 0.21739329397678375, + "rms": 0.21740460395812988, + "max_abs": 5.0625 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5d116dd49ac7cff9bf507ae14b2173e746bd2a6026f01ad4c18dde4f35769f00", + "mean": -0.03114512749016285, + "std": 11.176207542419434, + "rms": 11.176251411437988, + "max_abs": 1152.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8bb19230d6a3f77b40b7855cff84e8ca8ad8e6729bc447873035483c56e7adcc", + "mean": -0.002252902602776885, + "std": 0.21861375868320465, + "rms": 0.21862535178661346, + "max_abs": 5.15625 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "765a1958373e760a780550ab735280d6cdb311d7c711065d9e0a5dc57bf2f00d", + "mean": -0.027009153738617897, + "std": 9.97436809539795, + "rms": 9.974405288696289, + "max_abs": 1152.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0e63d209e8c59fd444e672cd0776a8712ca2f08a2b2484525138dec25f67027e", + "mean": -0.00203211628831923, + "std": 0.22054696083068848, + "rms": 0.2205563187599182, + "max_abs": 5.25 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f86fc87318a82db694a9e6bae91715a8f79b0307e3ae89b508e2e9c00ff7230a", + "mean": -0.007743341848254204, + "std": 9.89000415802002, + "rms": 9.890007972717285, + "max_abs": 1152.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c927a375ea065a9fd9499db1328824f0c96b77dfe5706e398ba45126a9be4255", + "mean": -0.0022153393365442753, + "std": 0.22127652168273926, + "rms": 0.22128762304782867, + "max_abs": 5.21875 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e4287c801575a3853a6c574ad20659f603bd16e814b34da900478856964f8834", + "mean": -0.00669419951736927, + "std": 8.556732177734375, + "rms": 8.556735038757324, + "max_abs": 1152.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0b765ae673ee4e6427a1accfc1f8483dfde85874b6de83d8401f8e0d67514e36", + "mean": -0.001788407564163208, + "std": 0.21813112497329712, + "rms": 0.2181384563446045, + "max_abs": 5.1875 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8ca5ace7b7096e27adbe1ceebdac34c24224f48f203d2eabea3f392ce22545cf", + "mean": -0.007492137607187033, + "std": 9.889942169189453, + "rms": 9.889945983886719, + "max_abs": 1152.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b85475eda3af9c468ab627d8c3522b69ed92b5c2046a091e58c12dbb4c724525", + "mean": -0.002191865351051092, + "std": 0.21845397353172302, + "rms": 0.21846497058868408, + "max_abs": 5.21875 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9599aa9997ad728ca8f1aaae4b7c2671a69a8d65070ea80dd4666e2a5a2261d9", + "mean": -0.0065947650000452995, + "std": 8.556672096252441, + "rms": 8.55667495727539, + "max_abs": 1152.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5371d7e59d59a7777301cfe985df9835e10fc18016a8f475ac4050ed24df9e8c", + "mean": -0.0018331045284867287, + "std": 0.21821381151676178, + "rms": 0.218221515417099, + "max_abs": 5.28125 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "893ebc5b2cbd08fe9c5fff640591891357569e10f28324ffba6fbbda546f8c1f", + "mean": -0.007495798170566559, + "std": 9.889921188354492, + "rms": 9.889925003051758, + "max_abs": 1152.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a5abfc3a2bb12c66d5d31942b4bc269495c8524d72594d8c24ffae8c1c2bfab4", + "mean": -0.002307406859472394, + "std": 0.21839377284049988, + "rms": 0.21840596199035645, + "max_abs": 5.28125 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "79649b372eb5ac154d4cd3d2bad62afdebf918c61a2586bb9cc6bb8e9be2a135", + "mean": -0.0066602639853954315, + "std": 8.55665397644043, + "rms": 8.556656837463379, + "max_abs": 1152.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9975094199180603, + "min_cosine_similarity": 0.9928596019744873, + "mean_relative_l2": 0.06779055297374725, + "max_abs_delta": 0.1640625 + }, + "system_bos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9949045777320862, + "min_cosine_similarity": 0.983177900314331, + "mean_relative_l2": 0.0967593789100647, + "max_abs_delta": 0.296875 + }, + "system_x": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9901871681213379, + "min_cosine_similarity": 0.9669253826141357, + "mean_relative_l2": 0.13467898964881897, + "max_abs_delta": 0.375 + }, + "system_period": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9902482032775879, + "min_cosine_similarity": 0.9686071872711182, + "mean_relative_l2": 0.13459520041942596, + "max_abs_delta": 0.34375 + }, + "bos_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9891262054443359, + "min_cosine_similarity": 0.977559506893158, + "mean_relative_l2": 0.14738817512989044, + "max_abs_delta": 0.375 + }, + "bos_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9856346249580383, + "min_cosine_similarity": 0.9687246084213257, + "mean_relative_l2": 0.16936686635017395, + "max_abs_delta": 0.40625 + }, + "x_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9852378964424133, + "min_cosine_similarity": 0.9636934399604797, + "mean_relative_l2": 0.1674724817276001, + "max_abs_delta": 0.71875 + }, + "x_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9793859720230103, + "min_cosine_similarity": 0.9503123760223389, + "mean_relative_l2": 0.19890961050987244, + "max_abs_delta": 0.47265625 + }, + "period_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.984480082988739, + "min_cosine_similarity": 0.9625133275985718, + "mean_relative_l2": 0.17239442467689514, + "max_abs_delta": 0.671875 + }, + "period_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9789493680000305, + "min_cosine_similarity": 0.9459686279296875, + "mean_relative_l2": 0.20041552186012268, + "max_abs_delta": 0.44921875 + } + } + }, + "layer_06": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1196111c6d391ec4ddfabf6d786de07c79be89a8e53dc7df1a25201e0014df81", + "mean": -0.0036756170447915792, + "std": 0.25852492451667786, + "rms": 0.2585510313510895, + "max_abs": 7.46875 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3e68927384ff6017bd859709f3edf8262d32597cf85aa240d933b7eb07e6015b", + "mean": -0.033360835164785385, + "std": 11.37994384765625, + "rms": 11.379992485046387, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "664ec8641b90a087cf921d6277a50b63b3f32fdce1ddb6a2d50ee26e08d505ca", + "mean": -0.00392207270488143, + "std": 0.26012447476387024, + "rms": 0.26015403866767883, + "max_abs": 7.5625 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e0e3b54b924fddbd6b086cf328b03bc0e0f98e778443ec158d24ea76c9c80ddf", + "mean": -0.029141295701265335, + "std": 10.153966903686523, + "rms": 10.154008865356445, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e73ef3f8e877b89e9dc397d97ae8aac4b3c937ef6ce9c667846f342226a27159", + "mean": -0.003357249079272151, + "std": 0.2610980272293091, + "rms": 0.2611196041107178, + "max_abs": 7.5625 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e239b42f893282c7a990ea3f9c9a656c2318830a5f713d15d98762b9c295aed2", + "mean": -0.009346467442810535, + "std": 10.048863410949707, + "rms": 10.048867225646973, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b9ce655a91bd9fff9334163c9774ac9571f6f96156ef622a8af3ae8f7d68f5db", + "mean": -0.0034713491331785917, + "std": 0.2616495192050934, + "rms": 0.2616725564002991, + "max_abs": 7.6875 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3a73d77d0d5152510035a27c08f3d3ef36b1bff5424b1e9b4d770459a502642c", + "mean": -0.008169109001755714, + "std": 8.692498207092285, + "rms": 8.69250202178955, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5cf8a4819ebf2a0f45c3d76f2580394dce6aad73bfbdc8fa8a9928c0c3e4700c", + "mean": -0.0030988692305982113, + "std": 0.26061978936195374, + "rms": 0.2606382369995117, + "max_abs": 7.75 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6b143dbea25f33cd6e6884b8d6cf2ac95b4d8a3cbaf8748d6ec378519f82d8c5", + "mean": -0.008982976898550987, + "std": 10.048815727233887, + "rms": 10.048819541931152, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "17cbdac74894cc402ef5f831427b08a09d322cd99d6586bd913294ec179a6dde", + "mean": -0.0031259150709956884, + "std": 0.2593604028224945, + "rms": 0.25937923789024353, + "max_abs": 7.84375 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "344b3615ea9806fb1fcc3bb83c932d800aedbdb99c9d7d9a9cb02db1ac4e08da", + "mean": -0.007798006758093834, + "std": 8.692421913146973, + "rms": 8.692425727844238, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f46591cd5faefbbada93c3e406c81e5e40660f6800c92443860f9fc6792422c7", + "mean": -0.00312390667386353, + "std": 0.25946786999702454, + "rms": 0.2594866454601288, + "max_abs": 7.625 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3b2f3467a29c42b9977a8a3f2cccf2955a6a5e2117c4a2e0e86487eb4862a99c", + "mean": -0.008975018747150898, + "std": 10.048789978027344, + "rms": 10.04879379272461, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "be725fbe619767afcee4135eb8822ee52b792080124964863c64c4cb43c52a64", + "mean": -0.0031234067864716053, + "std": 0.2583695650100708, + "rms": 0.2583884298801422, + "max_abs": 7.78125 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fa55448e7463f87d2d32f94419e9d6aedd8c8d5720d6fcb1ee8d6736a3bcdbce", + "mean": -0.007827047258615494, + "std": 8.692399024963379, + "rms": 8.692402839660645, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9975546002388, + "min_cosine_similarity": 0.9941294193267822, + "mean_relative_l2": 0.06702231615781784, + "max_abs_delta": 0.234375 + }, + "system_bos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9950097799301147, + "min_cosine_similarity": 0.9878371953964233, + "mean_relative_l2": 0.09647218137979507, + "max_abs_delta": 0.40625 + }, + "system_x": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9908077120780945, + "min_cosine_similarity": 0.9770675897598267, + "mean_relative_l2": 0.13097815215587616, + "max_abs_delta": 0.515625 + }, + "system_period": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9907355904579163, + "min_cosine_similarity": 0.9749117493629456, + "mean_relative_l2": 0.13113412261009216, + "max_abs_delta": 0.4296875 + }, + "bos_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9903571009635925, + "min_cosine_similarity": 0.979593813419342, + "mean_relative_l2": 0.13859879970550537, + "max_abs_delta": 0.5 + }, + "bos_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9877628087997437, + "min_cosine_similarity": 0.974276602268219, + "mean_relative_l2": 0.15560990571975708, + "max_abs_delta": 0.5 + }, + "x_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9864648580551147, + "min_cosine_similarity": 0.9716724157333374, + "mean_relative_l2": 0.16119606792926788, + "max_abs_delta": 0.578125 + }, + "x_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.981865406036377, + "min_cosine_similarity": 0.9632518291473389, + "mean_relative_l2": 0.1867324411869049, + "max_abs_delta": 0.5625 + }, + "period_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9859945774078369, + "min_cosine_similarity": 0.9686880111694336, + "mean_relative_l2": 0.16421476006507874, + "max_abs_delta": 0.515625 + }, + "period_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9810764193534851, + "min_cosine_similarity": 0.9581743478775024, + "mean_relative_l2": 0.19025564193725586, + "max_abs_delta": 0.75 + } + } + }, + "layer_07": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3899fd192c45f5f3adbef2b9f7573bdcb54694d8802b7c90473240767fd8db0c", + "mean": -0.003287732833996415, + "std": 0.2783800959587097, + "rms": 0.2783995270729065, + "max_abs": 7.21875 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "01463b3b08e9f16972b06938db730d92f87b38745e99608ae1a969200040002d", + "mean": -0.033062905073165894, + "std": 11.412327766418457, + "rms": 11.412374496459961, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "238e5f0b5d161cb71f294a6cd0ac005bd814bc84082c2120542e14314942e8d8", + "mean": -0.0034439130686223507, + "std": 0.28016331791877747, + "rms": 0.28018447756767273, + "max_abs": 7.3125 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c7926e8dcc918cf45576f347beda2cbb9ff064509914831e0f95024205a5b8b2", + "mean": -0.02968342788517475, + "std": 10.184017181396484, + "rms": 10.184061050415039, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5cab2b9190746ccf205646171f765400a1ea4f6ce08f66b87f8cb426c5cabec3", + "mean": -0.0030795768834650517, + "std": 0.280004620552063, + "rms": 0.2800215482711792, + "max_abs": 7.125 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "237668873778144cc4c916efb7bff699633851bd12f5c3f9162f3bfae27bec40", + "mean": -0.009053830057382584, + "std": 10.067214012145996, + "rms": 10.067217826843262, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4da0852938bed9eb593e99c0d99e8ed230f5b1bb544b05d3458a5d1a92f638d8", + "mean": -0.003174158511683345, + "std": 0.28070294857025146, + "rms": 0.28072088956832886, + "max_abs": 7.25 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0e1783d4c10aa801ff81dc40d314634ccc5cd166860e1beccc8033f9ffe491eb", + "mean": -0.008693831041455269, + "std": 8.70859146118164, + "rms": 8.708595275878906, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f8883579c58fe4457b5401c31932604e1ab4d3cdec68587c57ab1175d57dd3d1", + "mean": -0.002842110116034746, + "std": 0.2795535922050476, + "rms": 0.27956801652908325, + "max_abs": 7.4375 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "82d4b1ac5a541587292654f90f1d9c3e5ec73b565b73796603d272bb71d2bbc4", + "mean": -0.009003921411931515, + "std": 10.067152976989746, + "rms": 10.067155838012695, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ce5a3b64f2bea4e7d31c9228d07b165068d361465c1a491e05d6b519b0ba3b9b", + "mean": -0.00272011780180037, + "std": 0.27862074971199036, + "rms": 0.2786340117454529, + "max_abs": 7.5 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0084eb2282f09ef610e0d32230be85dc80e12c4ddfa56009aac8f0a4c4be5767", + "mean": -0.008491208776831627, + "std": 8.708511352539062, + "rms": 8.708515167236328, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c484290aa1a1bf2c6aa4aee7b5a7ae7644daa78d8031bfb1d23483aeb6694aa6", + "mean": -0.002896662103012204, + "std": 0.27926138043403625, + "rms": 0.27927640080451965, + "max_abs": 7.3125 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6ea12cf530795ad39e9b90965b5f8c39d40480f23b610cb6d16418ea46cedbdd", + "mean": -0.00878963340073824, + "std": 10.067148208618164, + "rms": 10.06715202331543, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d7d42b1e327da51f0dabbf01387ef4e67a7c113670c93f7fb1ce40cb2993ff69", + "mean": -0.002796933753415942, + "std": 0.27833473682403564, + "rms": 0.27834877371788025, + "max_abs": 7.40625 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f6e20b47e484d2c9eedae928fe5a929829ad104a0fa0514b096b836321c75622", + "mean": -0.008428419008851051, + "std": 8.70850944519043, + "rms": 8.708513259887695, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9973587989807129, + "min_cosine_similarity": 0.9936268329620361, + "mean_relative_l2": 0.06940606236457825, + "max_abs_delta": 0.40625 + }, + "system_bos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9946799278259277, + "min_cosine_similarity": 0.9866917729377747, + "mean_relative_l2": 0.09970620274543762, + "max_abs_delta": 0.328125 + }, + "system_x": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9905164837837219, + "min_cosine_similarity": 0.9769920706748962, + "mean_relative_l2": 0.1329883486032486, + "max_abs_delta": 0.5078125 + }, + "system_period": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9904817342758179, + "min_cosine_similarity": 0.971642017364502, + "mean_relative_l2": 0.13271735608577728, + "max_abs_delta": 0.421875 + }, + "bos_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9904490113258362, + "min_cosine_similarity": 0.9797070026397705, + "mean_relative_l2": 0.13772927224636078, + "max_abs_delta": 0.46875 + }, + "bos_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.987948477268219, + "min_cosine_similarity": 0.973728597164154, + "mean_relative_l2": 0.15462689101696014, + "max_abs_delta": 0.59375 + }, + "x_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9865866899490356, + "min_cosine_similarity": 0.9688682556152344, + "mean_relative_l2": 0.16016101837158203, + "max_abs_delta": 0.78125 + }, + "x_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9825223088264465, + "min_cosine_similarity": 0.9592369794845581, + "mean_relative_l2": 0.18386681377887726, + "max_abs_delta": 0.78125 + }, + "period_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9863978028297424, + "min_cosine_similarity": 0.9689093828201294, + "mean_relative_l2": 0.16206808388233185, + "max_abs_delta": 0.6875 + }, + "period_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9819679856300354, + "min_cosine_similarity": 0.9569116234779358, + "mean_relative_l2": 0.18618176877498627, + "max_abs_delta": 0.75 + } + } + }, + "layer_08": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "dd96d776ae25704b5710f79a667d4e30c84379981b000f7fd821fe9bc867f378", + "mean": -0.00409812293946743, + "std": 0.32104212045669556, + "rms": 0.32106825709342957, + "max_abs": 8.4375 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e254fbc07ab680f24497dad63eda4389d75968f033608ba826bb0b5aaae0b6cb", + "mean": -0.03388562425971031, + "std": 11.450807571411133, + "rms": 11.450858116149902, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "69abba467ea46aebff063cc6d74d619e26d70b4866dae5ae66f99834998b40b5", + "mean": -0.0038982382975518703, + "std": 0.32330483198165894, + "rms": 0.32332831621170044, + "max_abs": 8.625 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "823d230b822bf7becefbb8677412d29ea6061372180d35c5c2831793aa624673", + "mean": -0.029777992516756058, + "std": 10.218986511230469, + "rms": 10.219029426574707, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e69543461d145c346f7c7e981e691ee37f281d8af1b0bc61506f6f8ac980fcd3", + "mean": -0.00416944595053792, + "std": 0.3225204348564148, + "rms": 0.32254737615585327, + "max_abs": 8.4375 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "840c52c5ce2dd95433b88c3a29bf9dcc2daa27560049ff12552d09d76499c238", + "mean": -0.010160485282540321, + "std": 10.088587760925293, + "rms": 10.088593482971191, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bc818709db2e388432b1d346d05d7ae87f0241cab04ab5e4a5cc6affdf90cc59", + "mean": -0.004236825276166201, + "std": 0.32371121644973755, + "rms": 0.3237389326095581, + "max_abs": 8.625 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7e96a84e02e631b4ff6f44cece91ccffbdc33d5957373d55a98ce7e0ba94390e", + "mean": -0.009207147173583508, + "std": 8.727263450622559, + "rms": 8.72726821899414, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0d9db3063c91c305603a020224721cc45672e23a9905ba8d22e81d350bc418ba", + "mean": -0.0037756990641355515, + "std": 0.3217919170856476, + "rms": 0.32181409001350403, + "max_abs": 8.6875 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a0e10fc4230ce98eb633ef5cd19273b5bb7a0c2e969f5381a8aff2bb0c156529", + "mean": -0.01001721527427435, + "std": 10.088546752929688, + "rms": 10.08855152130127, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1e01b986f16f6da995e79b7e9ae313c7b673b52a687705e2dff8a4b0c415b46f", + "mean": -0.0031403726898133755, + "std": 0.32205384969711304, + "rms": 0.3220691680908203, + "max_abs": 8.875 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "618fb8f3cff0aa79da19d30e9e666e0a0f0aff9542e3a89726839fba887b51b6", + "mean": -0.008708221837878227, + "std": 8.727205276489258, + "rms": 8.72721004486084, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5c642299ac40f95425e3136b44710829413e7adb2ee3178200acca0571422901", + "mean": -0.003999126143753529, + "std": 0.3218075633049011, + "rms": 0.32183241844177246, + "max_abs": 8.625 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "35fe3db1c6eb3ae983498531a45034d1eabd3d36d096077f8a9ca8a1558087b2", + "mean": -0.010121132247149944, + "std": 10.088549613952637, + "rms": 10.088554382324219, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "47836f92a8884519b603c73bc3e5a192bb7fed86ef8fce8f89b676342f784816", + "mean": -0.003608857747167349, + "std": 0.32155555486679077, + "rms": 0.3215758204460144, + "max_abs": 8.875 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "58a02fa7570b284e9794a235b0860100f7eb9b5b977205c1ba9da535301e5a37", + "mean": -0.008847079239785671, + "std": 8.727193832397461, + "rms": 8.727198600769043, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.996365487575531, + "min_cosine_similarity": 0.986310601234436, + "mean_relative_l2": 0.08094818145036697, + "max_abs_delta": 0.40625 + }, + "system_bos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9941336512565613, + "min_cosine_similarity": 0.9877333641052246, + "mean_relative_l2": 0.10527780652046204, + "max_abs_delta": 0.53125 + }, + "system_x": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.988908588886261, + "min_cosine_similarity": 0.9669632911682129, + "mean_relative_l2": 0.1421147584915161, + "max_abs_delta": 0.5625 + }, + "system_period": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9893336296081543, + "min_cosine_similarity": 0.9665963649749756, + "mean_relative_l2": 0.14070221781730652, + "max_abs_delta": 0.65625 + }, + "bos_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9899565577507019, + "min_cosine_similarity": 0.9724036455154419, + "mean_relative_l2": 0.13989989459514618, + "max_abs_delta": 0.5625 + }, + "bos_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9880209565162659, + "min_cosine_similarity": 0.9766693115234375, + "mean_relative_l2": 0.15426793694496155, + "max_abs_delta": 0.5 + }, + "x_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9854283332824707, + "min_cosine_similarity": 0.9697425365447998, + "mean_relative_l2": 0.1665516346693039, + "max_abs_delta": 0.8125 + }, + "x_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9811564087867737, + "min_cosine_similarity": 0.9614678621292114, + "mean_relative_l2": 0.19058144092559814, + "max_abs_delta": 0.65625 + }, + "period_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.985562801361084, + "min_cosine_similarity": 0.9654233455657959, + "mean_relative_l2": 0.16689808666706085, + "max_abs_delta": 0.78125 + }, + "period_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9818223118782043, + "min_cosine_similarity": 0.9576548337936401, + "mean_relative_l2": 0.18666347861289978, + "max_abs_delta": 0.6875 + } + } + }, + "layer_09": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fb63eb260e1bae6c6abd42bb639a7e31852680d54d43436283e4a9b82497ab2c", + "mean": -0.004631086252629757, + "std": 0.3666049838066101, + "rms": 0.36663421988487244, + "max_abs": 11.5 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "832f911d52a03f396a8166e59043c6748dd13c3637f41a13e4111d98e05a94fd", + "mean": -0.033483196049928665, + "std": 11.452896118164062, + "rms": 11.452945709228516, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "61d4b6519b662ec6241af0d0c581cad0de8d7a9358f4ad1ca83411bcd32379ee", + "mean": -0.004519918467849493, + "std": 0.36731499433517456, + "rms": 0.3673427999019623, + "max_abs": 11.625 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "be37269bb04b3482db94b63f947c837f81555054ddc18e0313244275b671f1e2", + "mean": -0.030569272115826607, + "std": 10.22096061706543, + "rms": 10.221006393432617, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bc7926c5a542f20f7bd81166d3c730598c23a4c59fb1f6c41543b4f59a583636", + "mean": -0.004856354556977749, + "std": 0.3678131103515625, + "rms": 0.36784517765045166, + "max_abs": 11.3125 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ee584ad4d6f7bec63c2e828ad1ca171125df3720824ba43fbd0187e7b68a666a", + "mean": -0.010046497918665409, + "std": 10.090775489807129, + "rms": 10.090780258178711, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1617951ec87e2ad32549b21bac2f432b931604dc71f8ee2f8a6b0801a34a029d", + "mean": -0.004854578524827957, + "std": 0.3671391010284424, + "rms": 0.36717119812965393, + "max_abs": 11.5 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a954cac501cf733d782be6ba13041dd8c158587afca26e3363fcdcff9d2e5c73", + "mean": -0.010248875245451927, + "std": 8.729524612426758, + "rms": 8.729530334472656, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "13bc87a40cfd881fe285abd87acaafa17fe12d693b228981114c84cca5393576", + "mean": -0.004374557640403509, + "std": 0.3679913878440857, + "rms": 0.36801740527153015, + "max_abs": 11.625 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b3a3024ea85dd067c5ab35c02a4659c3a69f8f7438919fd31f74905cffcd25ee", + "mean": -0.009775803424417973, + "std": 10.09073257446289, + "rms": 10.090737342834473, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "be471a65c0056bffda95834336a84321a33355289c714e712798ee8f82a70319", + "mean": -0.004183680284768343, + "std": 0.3649095296859741, + "rms": 0.36493349075317383, + "max_abs": 11.75 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1211e71d2529fea00f345fa68915a0dc7ab1cc123da448941fc4b618f70796f6", + "mean": -0.009954748675227165, + "std": 8.729423522949219, + "rms": 8.729429244995117, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c4cba243e3468171ad5473a094ea51002284f1e4adf88a2c8b8c7230a166bcfd", + "mean": -0.004567633382976055, + "std": 0.3658408224582672, + "rms": 0.36586931347846985, + "max_abs": 11.625 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "12648407351f2f0454cefeaf140272e4c69d7effb00ebf7fd05b43084c444c5e", + "mean": -0.009628097526729107, + "std": 10.090669631958008, + "rms": 10.090675354003906, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ee19ffcad57178dfb323c56c6dabf17e8e19e243910f02c830490ee276f3ee88", + "mean": -0.004498347640037537, + "std": 0.3636936545372009, + "rms": 0.36372148990631104, + "max_abs": 11.75 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f7bb04afd233fe5e02aebf19d049cd5c897014eacfb92c6ffbdcca0bdcaaf3fe", + "mean": -0.009861179627478123, + "std": 8.729365348815918, + "rms": 8.7293701171875, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9966763854026794, + "min_cosine_similarity": 0.990285336971283, + "mean_relative_l2": 0.07811649888753891, + "max_abs_delta": 0.375 + }, + "system_bos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9941185116767883, + "min_cosine_similarity": 0.9894990921020508, + "mean_relative_l2": 0.10574396699666977, + "max_abs_delta": 0.625 + }, + "system_x": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9895555973052979, + "min_cosine_similarity": 0.9737199544906616, + "mean_relative_l2": 0.13826869428157806, + "max_abs_delta": 0.8125 + }, + "system_period": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9897632598876953, + "min_cosine_similarity": 0.9674173593521118, + "mean_relative_l2": 0.13776592910289764, + "max_abs_delta": 0.75 + }, + "bos_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9914926290512085, + "min_cosine_similarity": 0.9795792102813721, + "mean_relative_l2": 0.12925614416599274, + "max_abs_delta": 0.625 + }, + "bos_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9898791313171387, + "min_cosine_similarity": 0.9799107313156128, + "mean_relative_l2": 0.14099478721618652, + "max_abs_delta": 0.46875 + }, + "x_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9877285361289978, + "min_cosine_similarity": 0.9739363193511963, + "mean_relative_l2": 0.15325672924518585, + "max_abs_delta": 1.375 + }, + "x_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9837495684623718, + "min_cosine_similarity": 0.9642409086227417, + "mean_relative_l2": 0.17599232494831085, + "max_abs_delta": 0.75 + }, + "period_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9879937171936035, + "min_cosine_similarity": 0.9715076684951782, + "mean_relative_l2": 0.15182217955589294, + "max_abs_delta": 0.9375 + }, + "period_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9840065240859985, + "min_cosine_similarity": 0.9549477100372314, + "mean_relative_l2": 0.17352136969566345, + "max_abs_delta": 0.75 + } + } + }, + "layer_10": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "97e8d5c8ec6833e68728b6f2b4182a7db22c18b848ebb73a047d91a188685856", + "mean": -0.004463586490601301, + "std": 0.4204738438129425, + "rms": 0.4204975366592407, + "max_abs": 12.125 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b5b64d4e41c337c4741a977aeacfe8c81b3ce64b54cae8fadcf23b1587760acf", + "mean": -0.03436536714434624, + "std": 11.463796615600586, + "rms": 11.463848114013672, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cb46caa6cf1b61f74f43801a3c7039740510bf00fef1b73c1f2b118477e8edd0", + "mean": -0.004335804842412472, + "std": 0.4216710031032562, + "rms": 0.4216932952404022, + "max_abs": 12.125 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4cf6787a11bb6de99235a7b8e29e1253c41fb2226ca8d6b0af397b445dabe0d5", + "mean": -0.03144893795251846, + "std": 10.230768203735352, + "rms": 10.230815887451172, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4f18fb3045464bf801b1f8740f6a0a47266bfae385098059dbdc42293aae13d4", + "mean": -0.004746586084365845, + "std": 0.42387911677360535, + "rms": 0.42390570044517517, + "max_abs": 11.9375 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "836be1a1c932304f16c156f10a8587fe0676b157f88f085ce6ddbb4300dac245", + "mean": -0.011113760061562061, + "std": 10.102624893188477, + "rms": 10.102630615234375, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "61c1a1c9eea070279f51b9f505df2b766266b80f5d2731a2a116ac64174e4e0e", + "mean": -0.004479501396417618, + "std": 0.4240535497665405, + "rms": 0.42407724261283875, + "max_abs": 12.1875 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9e6951299c7100ec511a2c3a0271544e41efa7152afce53fe83c07edd0860e4d", + "mean": -0.011157206259667873, + "std": 8.740328788757324, + "rms": 8.740335464477539, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0f7a18c4787eadec6a635fcbb3bf2a26713728660e9775b896ba08774bd11512", + "mean": -0.004129618406295776, + "std": 0.4239848256111145, + "rms": 0.4240049123764038, + "max_abs": 12.375 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3a267fe0493c9a423f249877de99caab0ebb9117822192f1e85168817b33732f", + "mean": -0.010769088752567768, + "std": 10.10256576538086, + "rms": 10.102571487426758, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2d0c9e68a3c250cd43b20e4dc30a007a4eb3c68b44b4989cae1e05c24504d0f4", + "mean": -0.0036121534649282694, + "std": 0.42220762372016907, + "rms": 0.4222230911254883, + "max_abs": 12.5625 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5aa0a2d0abdd35610391692472b63f0cb9990b0517af30703876b9b686bbfff0", + "mean": -0.010922416113317013, + "std": 8.740180969238281, + "rms": 8.74018669128418, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "01d77788f49f6381b710517fac1bb05e96ff45fdcced2377b224aecbd339f562", + "mean": -0.004129770211875439, + "std": 0.42270323634147644, + "rms": 0.4227234125137329, + "max_abs": 12.25 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "03aad621c1d40ff078bc583104aea101357005bd2a52b45781a4430e9e8e8b76", + "mean": -0.010354720056056976, + "std": 10.102517127990723, + "rms": 10.102521896362305, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4827f697a6f396d0f3a622069b82381deef648285af37cca0d97b34b21660b5e", + "mean": -0.003757565515115857, + "std": 0.4210054576396942, + "rms": 0.4210222363471985, + "max_abs": 12.5 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5e8086681ce291d9e96670f29b867573b4b9d6c7e08f804a09cb0bb8ed4ff864", + "mean": -0.010676775127649307, + "std": 8.740114212036133, + "rms": 8.740119934082031, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9967488050460815, + "min_cosine_similarity": 0.9914268255233765, + "mean_relative_l2": 0.07720748335123062, + "max_abs_delta": 0.28125 + }, + "system_bos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9939312934875488, + "min_cosine_similarity": 0.9882993698120117, + "mean_relative_l2": 0.10755032300949097, + "max_abs_delta": 0.5625 + }, + "system_x": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9898359775543213, + "min_cosine_similarity": 0.9753673076629639, + "mean_relative_l2": 0.13713793456554413, + "max_abs_delta": 0.6875 + }, + "system_period": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9899243116378784, + "min_cosine_similarity": 0.9716179370880127, + "mean_relative_l2": 0.13722823560237885, + "max_abs_delta": 0.625 + }, + "bos_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.99156653881073, + "min_cosine_similarity": 0.9796364307403564, + "mean_relative_l2": 0.1292070895433426, + "max_abs_delta": 0.625 + }, + "bos_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9895952343940735, + "min_cosine_similarity": 0.9788633584976196, + "mean_relative_l2": 0.1431671679019928, + "max_abs_delta": 0.46875 + }, + "x_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9883163571357727, + "min_cosine_similarity": 0.9775129556655884, + "mean_relative_l2": 0.15038654208183289, + "max_abs_delta": 0.875 + }, + "x_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9843506217002869, + "min_cosine_similarity": 0.9674265384674072, + "mean_relative_l2": 0.17351923882961273, + "max_abs_delta": 0.6875 + }, + "period_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9885370135307312, + "min_cosine_similarity": 0.9747883677482605, + "mean_relative_l2": 0.14902111887931824, + "max_abs_delta": 0.640625 + }, + "period_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9842694997787476, + "min_cosine_similarity": 0.9569655656814575, + "mean_relative_l2": 0.17284348607063293, + "max_abs_delta": 0.6875 + } + } + }, + "layer_11": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "aacfd271803bc0e43b1bdb08d97a423acaa48f1c3d207b868b4315d2fe776780", + "mean": -0.006982269696891308, + "std": 0.5412312150001526, + "rms": 0.541276216506958, + "max_abs": 17.75 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ed71f52da0e8087960300650e007ccec8343d3e00fdc0bc12344575ea4ea4320", + "mean": -0.03504280373454094, + "std": 11.526665687561035, + "rms": 11.526718139648438, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7ec6b14e75f18d5246d9b42df3af7679052ef81f4b5f19b0719c4d0e404284d2", + "mean": -0.006713085807859898, + "std": 0.5421252250671387, + "rms": 0.5421668291091919, + "max_abs": 18.0 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "560015ab44ebc31573d9e92b10bac8e85e5996aab68c3b66c89b13558e8ff129", + "mean": -0.0319729708135128, + "std": 10.286075592041016, + "rms": 10.286125183105469, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f1ec2fcd87638670cabcb58e6f210eaaee4db7e2fc4c6023453d68bdc121c51b", + "mean": -0.00688363891094923, + "std": 0.543691873550415, + "rms": 0.5437354445457458, + "max_abs": 17.625 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "015057bcf4936131b89a2f6ea71e59b11f879af9c4fe12f02a39a7f098fc5cfa", + "mean": -0.011495375074446201, + "std": 10.154207229614258, + "rms": 10.154213905334473, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "97bc8449fa75cd605a294fb7e06e0a1075e6a43524c6e42b5328c9c4a2cea661", + "mean": -0.007134628016501665, + "std": 0.5416943430900574, + "rms": 0.5417413115501404, + "max_abs": 17.5 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "87302a050258a1a4aad81cc64c3eff3c0bab99f595e2cd5e94514a31db1864de", + "mean": -0.011668829247355461, + "std": 8.785859107971191, + "rms": 8.785866737365723, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b9393c2e02443610a1b9b713cdafa14009649c2112cb1691732b02e4c36dcfaa", + "mean": -0.006799987982958555, + "std": 0.5441619157791138, + "rms": 0.5442043542861938, + "max_abs": 18.0 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "398551d0673d3e13f8c55f112bd89106826727dc7979e2802f04d8b91c30147d", + "mean": -0.011099816299974918, + "std": 10.154228210449219, + "rms": 10.154233932495117, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "992a4d86b70c719622bb21a9c59b4211d7e4a71b5c3f4ca90d0e969a9522429d", + "mean": -0.006017842795699835, + "std": 0.5365240573883057, + "rms": 0.5365577936172485, + "max_abs": 17.75 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "640a85c68063c9765ce7d0bf62d23bcd877b8b8b642f1c319a133ca0ab4636e1", + "mean": -0.011013244278728962, + "std": 8.785560607910156, + "rms": 8.785568237304688, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b40f84042abce9f74be8e14a1f22f4aa77001606143caa1d4316e59bb606712d", + "mean": -0.0067167459055781364, + "std": 0.5393306612968445, + "rms": 0.5393725037574768, + "max_abs": 17.75 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "783c3d3c4987b731964d21d5ab62fee4f04980d323bfea5ad0c24da96d2c75ab", + "mean": -0.010808850638568401, + "std": 10.154056549072266, + "rms": 10.154062271118164, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "53f5241a461463576fc950e91f1db88097babbbef6a3412bc950d7fd0ae6d2f4", + "mean": -0.005853899288922548, + "std": 0.5346423983573914, + "rms": 0.5346744656562805, + "max_abs": 17.5 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7d595b224877a56a6fc5a9866a5dcbf3639cedeff27c83f85715328fcc2f9266", + "mean": -0.010858140885829926, + "std": 8.785465240478516, + "rms": 8.78547191619873, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9973358511924744, + "min_cosine_similarity": 0.9935876131057739, + "mean_relative_l2": 0.07008440792560577, + "max_abs_delta": 0.390625 + }, + "system_bos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9950296878814697, + "min_cosine_similarity": 0.9895968437194824, + "mean_relative_l2": 0.09778973460197449, + "max_abs_delta": 0.6875 + }, + "system_x": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9912676811218262, + "min_cosine_similarity": 0.9731521606445312, + "mean_relative_l2": 0.1262105256319046, + "max_abs_delta": 1.0625 + }, + "system_period": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9912347197532654, + "min_cosine_similarity": 0.9742265939712524, + "mean_relative_l2": 0.12705154716968536, + "max_abs_delta": 0.921875 + }, + "bos_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9938839077949524, + "min_cosine_similarity": 0.9852335453033447, + "mean_relative_l2": 0.10997655242681503, + "max_abs_delta": 0.75 + }, + "bos_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9922499656677246, + "min_cosine_similarity": 0.9822840690612793, + "mean_relative_l2": 0.12322092056274414, + "max_abs_delta": 0.625 + }, + "x_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9911529421806335, + "min_cosine_similarity": 0.9813309907913208, + "mean_relative_l2": 0.1308506429195404, + "max_abs_delta": 1.0 + }, + "x_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9872899055480957, + "min_cosine_similarity": 0.9681355953216553, + "mean_relative_l2": 0.1552131325006485, + "max_abs_delta": 0.828125 + }, + "period_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9912262558937073, + "min_cosine_similarity": 0.9810242652893066, + "mean_relative_l2": 0.1300058811903, + "max_abs_delta": 0.7265625 + }, + "period_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9870550632476807, + "min_cosine_similarity": 0.9655361771583557, + "mean_relative_l2": 0.15552011132240295, + "max_abs_delta": 0.953125 + } + } + }, + "layer_12": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "da3ca7cfe26b6259697571d342d34c5b6ccfcf11176f9a87f9229bab78a76623", + "mean": -0.00694333715364337, + "std": 0.5544053912162781, + "rms": 0.5544488430023193, + "max_abs": 15.4375 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "41b83822ead3b8220fbefb5cd810676399c6bbfbea59b9f7ffb8616b839670da", + "mean": -0.0360344722867012, + "std": 11.606159210205078, + "rms": 11.606215476989746, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d27c82ce8d8f046dd34cb4b810827711bd09166e3bba9bc2cae5d5e50a5943d2", + "mean": -0.006609730888158083, + "std": 0.556632399559021, + "rms": 0.5566716194152832, + "max_abs": 15.3125 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2d3000d1f33c11a275a58f855708b144dabd40d68029eaa7b0f6ea82a4739c96", + "mean": -0.032103750854730606, + "std": 10.360575675964355, + "rms": 10.360626220703125, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "78e97e1a1dde8dcbe65eb86b0e95d91895b5cb82d8b191f9c4bb849b6d9b08c8", + "mean": -0.0069953082129359245, + "std": 0.5574163794517517, + "rms": 0.5574603080749512, + "max_abs": 15.375 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8c06b0d63ea1780dafcaa5811f0e83a017ed8bee88fd6206dc013d5f52b85d03", + "mean": -0.012228491716086864, + "std": 10.171178817749023, + "rms": 10.171186447143555, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2198df4a43f0a5aa4214c0f8d4bfe3fcdfd8c5451342510a319e824d70925514", + "mean": -0.007265025284141302, + "std": 0.5583368539810181, + "rms": 0.558384120464325, + "max_abs": 15.75 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d852689550bae38466663dcb55aca5a313d7b1db95d8cf3aa410cedb98f92ea5", + "mean": -0.011868267320096493, + "std": 8.80180549621582, + "rms": 8.801814079284668, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ba724483a9e70680a06d56f50c5d8c43826bdfce73fd0b2575f4dbb002f40920", + "mean": -0.0070648337714374065, + "std": 0.5575413703918457, + "rms": 0.557586133480072, + "max_abs": 15.6875 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "80d643fae0b07769a81c09b1a6f2625e2474c086a59267cfa6b30c1331b29c58", + "mean": -0.012523428536951542, + "std": 10.171196937561035, + "rms": 10.171204566955566, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "780b478113183a0e5679a5aed1841da4492e16a0fae224f0d280abe1bc008906", + "mean": -0.0062646581791341305, + "std": 0.5521455407142639, + "rms": 0.55218106508255, + "max_abs": 15.8125 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9979a2b897678b4f5b7268fadec569858e9f9fdb60daf47978c65bfa113911f6", + "mean": -0.011439748108386993, + "std": 8.801369667053223, + "rms": 8.801376342773438, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "74998be817a9935e5b16cf20fb405c6981617b52bae43197282ccec2199b3886", + "mean": -0.00694581214338541, + "std": 0.5530179142951965, + "rms": 0.5530615448951721, + "max_abs": 15.625 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "994df2368dbac240e29e5487815d76827e22f21a77d478190edeed4a8c84be03", + "mean": -0.011876847594976425, + "std": 10.171012878417969, + "rms": 10.171019554138184, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5a1a9b2efe5a225f4882e67edb57c295ea11ecb2e48b87c33df10f14de21467e", + "mean": -0.0062358202412724495, + "std": 0.551529586315155, + "rms": 0.5515648722648621, + "max_abs": 15.8125 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b92552693828d1452e0a42f6aeb0772fbb930602660f979867c8b1cb73294aa9", + "mean": -0.011175218969583511, + "std": 8.801351547241211, + "rms": 8.801358222961426, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9967507123947144, + "min_cosine_similarity": 0.9900888204574585, + "mean_relative_l2": 0.07757630199193954, + "max_abs_delta": 0.5 + }, + "system_bos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9941294193267822, + "min_cosine_similarity": 0.9856908321380615, + "mean_relative_l2": 0.10625611990690231, + "max_abs_delta": 0.5625 + }, + "system_x": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9905101656913757, + "min_cosine_similarity": 0.9720742702484131, + "mean_relative_l2": 0.13152717053890228, + "max_abs_delta": 1.0 + }, + "system_period": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9901369214057922, + "min_cosine_similarity": 0.9719486832618713, + "mean_relative_l2": 0.13482792675495148, + "max_abs_delta": 1.046875 + }, + "bos_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9931663870811462, + "min_cosine_similarity": 0.9854234457015991, + "mean_relative_l2": 0.11629220843315125, + "max_abs_delta": 0.5625 + }, + "bos_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9914520978927612, + "min_cosine_similarity": 0.9815722703933716, + "mean_relative_l2": 0.1291656345129013, + "max_abs_delta": 0.625 + }, + "x_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9901540875434875, + "min_cosine_similarity": 0.9805343747138977, + "mean_relative_l2": 0.13812798261642456, + "max_abs_delta": 0.9375 + }, + "x_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9863192439079285, + "min_cosine_similarity": 0.9656262397766113, + "mean_relative_l2": 0.16116414964199066, + "max_abs_delta": 0.96875 + }, + "period_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9902032613754272, + "min_cosine_similarity": 0.9813814163208008, + "mean_relative_l2": 0.1375880092382431, + "max_abs_delta": 0.671875 + }, + "period_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9857761263847351, + "min_cosine_similarity": 0.9618473052978516, + "mean_relative_l2": 0.16333360970020294, + "max_abs_delta": 0.96875 + } + } + }, + "layer_13": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "61fbd1b5632a38406981ee598236de17ecda0ee6cc8b1119906e33bd3962f3bc", + "mean": -0.007859531790018082, + "std": 0.6124550104141235, + "rms": 0.6125054359436035, + "max_abs": 16.625 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b5136c57f3055c83f5a54253f11225539d6bad7554b7ca11be93448878a85807", + "mean": -0.03608980029821396, + "std": 11.615910530090332, + "rms": 11.615964889526367, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "386689a7007645560db40aa7fc517c3b53d4bcfef50fa382ef95d59a36128e5d", + "mean": -0.0075656818225979805, + "std": 0.6139377355575562, + "rms": 0.6139843463897705, + "max_abs": 16.75 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a286efd6e1d75ecab7d654729dc0155950b7d8347d856d807061e59a0030d8ea", + "mean": -0.033217694610357285, + "std": 10.36996841430664, + "rms": 10.37002182006836, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "27c44737bb0788148b66ac27e094cd80e72651e45b76f6da20bafdc3d775361a", + "mean": -0.008157538250088692, + "std": 0.618026614189148, + "rms": 0.6180804371833801, + "max_abs": 16.75 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "988cbd58dcd2c4de65acfa0e7567e3506d0a17aaf1fa83bfedf45e1082300b4a", + "mean": -0.0124295549467206, + "std": 10.17995834350586, + "rms": 10.179965019226074, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c2edf48354e4c0986db08a392d490b0aa37c5780f7eaf270165caaca81237895", + "mean": -0.008522707968950272, + "std": 0.6167408227920532, + "rms": 0.6167997121810913, + "max_abs": 16.375 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "44079be187d8f3d27f083290cd87026999269d95aa314c0925782b79b6187031", + "mean": -0.013060221448540688, + "std": 8.810473442077637, + "rms": 8.810483932495117, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2b7d992884e79087ef691ae644f127493bcba34261ba9c6046bdf5f0b2bee2f2", + "mean": -0.008471698500216007, + "std": 0.6176313161849976, + "rms": 0.6176894307136536, + "max_abs": 17.0 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ecf67f5d402f0dc96bd54bbfb6fe1835b38374e4f9d065c42a4a4d2bfda014b1", + "mean": -0.012844111770391464, + "std": 10.180083274841309, + "rms": 10.18009090423584, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "da603f0428fb7cfea7686b1b35b94d98cdef4102b80bcce8ec44519c9fcc5991", + "mean": -0.007771195378154516, + "std": 0.6089707016944885, + "rms": 0.6090202927589417, + "max_abs": 16.25 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "082e59e54a5d5bb579d89aa82c5473e33c8a1a2dd9e8352fb9c9482e679c5d04", + "mean": -0.012746250256896019, + "std": 8.810113906860352, + "rms": 8.810123443603516, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "605c51efdc7cf6b42da526501a82ba954d1bf2c8476eb7cc9efd685f16c77198", + "mean": -0.008030115626752377, + "std": 0.6126409769058228, + "rms": 0.6126936078071594, + "max_abs": 16.875 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "18acaf0eee085f3e17342ddb7c3cc5f87c7247972f1196c90a0801b6b39f50ba", + "mean": -0.012041434645652771, + "std": 10.179835319519043, + "rms": 10.179841995239258, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "afb06804ff75eb67b0025c9fe58d0a6592cdff7dbdf48ee62c191cab60272560", + "mean": -0.007520450744777918, + "std": 0.6096829771995544, + "rms": 0.6097293496131897, + "max_abs": 16.25 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "02241eb1208ab918670181a658d6946bf4f1e08a20014b7704cb360494373b54", + "mean": -0.012481817975640297, + "std": 8.810104370117188, + "rms": 8.810112953186035, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9965544939041138, + "min_cosine_similarity": 0.9869171380996704, + "mean_relative_l2": 0.07898128032684326, + "max_abs_delta": 0.625 + }, + "system_bos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9943814277648926, + "min_cosine_similarity": 0.9846892356872559, + "mean_relative_l2": 0.10354672372341156, + "max_abs_delta": 0.625 + }, + "system_x": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9904054403305054, + "min_cosine_similarity": 0.9671977758407593, + "mean_relative_l2": 0.13137483596801758, + "max_abs_delta": 1.1875 + }, + "system_period": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9901629090309143, + "min_cosine_similarity": 0.9687593579292297, + "mean_relative_l2": 0.1340336948633194, + "max_abs_delta": 1.15625 + }, + "bos_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9933115243911743, + "min_cosine_similarity": 0.9878397583961487, + "mean_relative_l2": 0.11548123508691788, + "max_abs_delta": 0.625 + }, + "bos_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9919090867042542, + "min_cosine_similarity": 0.9822105765342712, + "mean_relative_l2": 0.125593900680542, + "max_abs_delta": 0.8125 + }, + "x_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9906900525093079, + "min_cosine_similarity": 0.981698751449585, + "mean_relative_l2": 0.13460703194141388, + "max_abs_delta": 1.125 + }, + "x_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9866508841514587, + "min_cosine_similarity": 0.9616386294364929, + "mean_relative_l2": 0.1582644283771515, + "max_abs_delta": 1.1875 + }, + "period_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9910208582878113, + "min_cosine_similarity": 0.9827168583869934, + "mean_relative_l2": 0.1319863200187683, + "max_abs_delta": 0.875 + }, + "period_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.985858142375946, + "min_cosine_similarity": 0.9569728970527649, + "mean_relative_l2": 0.16183139383792877, + "max_abs_delta": 1.0 + } + } + }, + "layer_14": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e278563ccfd68d8bd5f391eb1b5272918b2a5a24208002b118230e28569fc6cf", + "mean": -0.005719305481761694, + "std": 0.7034009099006653, + "rms": 0.7034241557121277, + "max_abs": 22.125 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ba878847328e5eb30b914ffff9a9c24f0732047e727b850c3f43e014dc553b96", + "mean": -0.03377581760287285, + "std": 11.639276504516602, + "rms": 11.639326095581055, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "eb93048e217398cea1a60bb3575a12a17e0ba0f1959723a229bf96ec41e00d8f", + "mean": -0.005565554369240999, + "std": 0.7056318521499634, + "rms": 0.7056537866592407, + "max_abs": 22.375 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d25bc99308d836c33947da0a66e14c3456d3626b90d568ad325019cb0b87a31d", + "mean": -0.031842585653066635, + "std": 10.39052963256836, + "rms": 10.390578269958496, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ad53ef81d6afabd6d3ecaa127ce06f309a5a90ae8b9e61d0bce329d0f49a6eac", + "mean": -0.005851674824953079, + "std": 0.7063049077987671, + "rms": 0.7063291072845459, + "max_abs": 22.25 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ae836cdd05794f00b2fa7487b936a51a708c984f684a240fd122eb76e7d890aa", + "mean": -0.009957891888916492, + "std": 10.20523452758789, + "rms": 10.205240249633789, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d4b3d76b51653a8258438522ddef25a1046b725e2ca07a70716b863f2678d4a4", + "mean": -0.006648736074566841, + "std": 0.7050386071205139, + "rms": 0.7050699591636658, + "max_abs": 21.5 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "20d90d131978251dad9fda6a69c05d08050ee801d6704e9dec6513886d04f4b0", + "mean": -0.011548144742846489, + "std": 8.833271026611328, + "rms": 8.83327865600586, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "704bd871c5afb0ce91dffddd3c5ff8581da9d0fe2e95338ed36bfc4e9ee75608", + "mean": -0.006068684626370668, + "std": 0.7071772217750549, + "rms": 0.7072032690048218, + "max_abs": 21.75 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a1ffbb2c1f2df43e97601d9c6b49ab5d0acf5acf7be747bbbe284a24fca3a723", + "mean": -0.010337205603718758, + "std": 10.205463409423828, + "rms": 10.20546817779541, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "34b31569484b38b940dcab25f46b50b05bd10f0e7f28db6e3caf63a6c0a8573e", + "mean": -0.005690791644155979, + "std": 0.6983164548873901, + "rms": 0.6983396410942078, + "max_abs": 21.125 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "28f5061a3f78f3893e6ee8558aabab38423bc89c26314131b6c8f7b524425407", + "mean": -0.011268407106399536, + "std": 8.832982063293457, + "rms": 8.832989692687988, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "984fdbd798ca3b5af9f5ffb26f7e5925b9807b67f517f09be77a988eb45912aa", + "mean": -0.005858660209923983, + "std": 0.7016370892524719, + "rms": 0.7016615271568298, + "max_abs": 21.75 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f99e0356cb81a47e76d1422cf9bc92d32deb34d85600399aa459ec3bba376811", + "mean": -0.009691539220511913, + "std": 10.205151557922363, + "rms": 10.205156326293945, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2d1500cf8f935fa3979c7f49889f49bda673be765b729b56b161448772870e72", + "mean": -0.005423377733677626, + "std": 0.6971390843391418, + "rms": 0.6971602439880371, + "max_abs": 21.25 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8a17ccbef4f96ad18111527a9b2878e1e4653da3d2a7b4d8e0d3355b3f0839fa", + "mean": -0.011157418601214886, + "std": 8.83286190032959, + "rms": 8.832869529724121, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9964604377746582, + "min_cosine_similarity": 0.9841629266738892, + "mean_relative_l2": 0.07983571290969849, + "max_abs_delta": 0.625 + }, + "system_bos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9943334460258484, + "min_cosine_similarity": 0.985284149646759, + "mean_relative_l2": 0.10419532656669617, + "max_abs_delta": 0.75 + }, + "system_x": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9905393719673157, + "min_cosine_similarity": 0.966727077960968, + "mean_relative_l2": 0.13064394891262054, + "max_abs_delta": 1.375 + }, + "system_period": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9899535775184631, + "min_cosine_similarity": 0.9673629999160767, + "mean_relative_l2": 0.1355293095111847, + "max_abs_delta": 1.3125 + }, + "bos_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9936152100563049, + "min_cosine_similarity": 0.9887769818305969, + "mean_relative_l2": 0.11191929876804352, + "max_abs_delta": 0.625 + }, + "bos_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9923099279403687, + "min_cosine_similarity": 0.9836507439613342, + "mean_relative_l2": 0.12239761650562286, + "max_abs_delta": 1.125 + }, + "x_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9914395809173584, + "min_cosine_similarity": 0.9811639785766602, + "mean_relative_l2": 0.1282498687505722, + "max_abs_delta": 1.125 + }, + "x_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9868276715278625, + "min_cosine_similarity": 0.9576453566551208, + "mean_relative_l2": 0.15639878809452057, + "max_abs_delta": 1.75 + }, + "period_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9916349649429321, + "min_cosine_similarity": 0.9835114479064941, + "mean_relative_l2": 0.12666691839694977, + "max_abs_delta": 0.875 + }, + "period_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9858283996582031, + "min_cosine_similarity": 0.9541420936584473, + "mean_relative_l2": 0.16129203140735626, + "max_abs_delta": 1.203125 + } + } + }, + "layer_15": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "abd290144efa88a8fe41f4a1f2bdfaad5c862266239705584cbef5b17996480e", + "mean": -0.004827621392905712, + "std": 0.7995967864990234, + "rms": 0.7996113896369934, + "max_abs": 26.0 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "166f2b8a288865e5a66d6ac59ca2d46ee26ba5fc84f3dcc65b56fde0585290c0", + "mean": -0.03223888948559761, + "std": 11.648842811584473, + "rms": 11.648887634277344, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e856e84086722f20a9770345f194a5b47de21a1daba3ab174dc26c67c92e94c5", + "mean": -0.0050627076998353004, + "std": 0.8007034063339233, + "rms": 0.8007194399833679, + "max_abs": 26.125 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c48990fbdcc9fb531250915722dddf4bd414713e26b4f6d96a82bbc629f5897b", + "mean": -0.03146161139011383, + "std": 10.400617599487305, + "rms": 10.400665283203125, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cb56e91d543ce3f87bd2bf16e21094c23db63bedc78fcb80a11553e628403d3f", + "mean": -0.004952066577970982, + "std": 0.8003724217414856, + "rms": 0.8003877401351929, + "max_abs": 26.25 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "09a6e1a0b51be34ba02c0ce157937f7f88131a7accb5a2ce2d0fb059cb5b56ea", + "mean": -0.008588847704231739, + "std": 10.21517276763916, + "rms": 10.215176582336426, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bef3f68b1ebac09456bc279c106d4063873b8902f50895e60e55d9d387e13d21", + "mean": -0.00589577155187726, + "std": 0.7996183633804321, + "rms": 0.7996400594711304, + "max_abs": 25.25 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "117577609ebd0df1374f459efb05c2237db390dd8bc35148c3ffe736fcc80777", + "mean": -0.011179495602846146, + "std": 8.843852996826172, + "rms": 8.843859672546387, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "39d3ada0374d34d6ea5bc2235fbf157f695332e3949e732b4d67aaeec9c1fb30", + "mean": -0.0051449257880449295, + "std": 0.8012247085571289, + "rms": 0.8012412190437317, + "max_abs": 25.5 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a7d45f04686882cf93d27b14fa97461e1ae319e44b2fc924ea7d6e6f51cfa126", + "mean": -0.008765594102442265, + "std": 10.215420722961426, + "rms": 10.215424537658691, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b86dd0f04ad6f8139b5e48b888b281f339f93e6701792dac247fad2eaf8bc199", + "mean": -0.005229647271335125, + "std": 0.7905499339103699, + "rms": 0.7905672192573547, + "max_abs": 25.0 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5216c6dd7dfbd0880d5744eccdc1ae9944dda2f8a580d9ac3b86e23ba7f00dbf", + "mean": -0.011059137061238289, + "std": 8.84339427947998, + "rms": 8.843400955200195, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e1350c5ecff488e491414257800a187406d4ed9ea800c1aa05a72e40dfe20e82", + "mean": -0.005182548891752958, + "std": 0.794816255569458, + "rms": 0.7948331832885742, + "max_abs": 25.5 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "601b65079cf9d2a57d3c31f9b4c075a9ea359bf9949a3d6c2e00e72250f59cd1", + "mean": -0.008379189297556877, + "std": 10.215034484863281, + "rms": 10.215038299560547, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "50c69c60079445d2f3cc1d14477bcc9b3fbafbbdc65ee509b30e1ad1135ef9c1", + "mean": -0.004974496550858021, + "std": 0.7909233570098877, + "rms": 0.7909390330314636, + "max_abs": 24.75 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "51bff73df159fa9236010c63d886dd607fdec6caee94222f4c12d8944a2dde6a", + "mean": -0.01075803767889738, + "std": 8.843371391296387, + "rms": 8.843378067016602, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9965090751647949, + "min_cosine_similarity": 0.9826277494430542, + "mean_relative_l2": 0.07847239822149277, + "max_abs_delta": 0.625 + }, + "system_bos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9947846531867981, + "min_cosine_similarity": 0.9861426949501038, + "mean_relative_l2": 0.09999213367700577, + "max_abs_delta": 1.0 + }, + "system_x": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9908062219619751, + "min_cosine_similarity": 0.9682838320732117, + "mean_relative_l2": 0.12910042703151703, + "max_abs_delta": 1.75 + }, + "system_period": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9901665449142456, + "min_cosine_similarity": 0.9687449932098389, + "mean_relative_l2": 0.13451692461967468, + "max_abs_delta": 1.875 + }, + "bos_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9940031170845032, + "min_cosine_similarity": 0.9873559474945068, + "mean_relative_l2": 0.10813093185424805, + "max_abs_delta": 1.0 + }, + "bos_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9930543303489685, + "min_cosine_similarity": 0.9861007928848267, + "mean_relative_l2": 0.11658979207277298, + "max_abs_delta": 1.375 + }, + "x_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9921032190322876, + "min_cosine_similarity": 0.980430543422699, + "mean_relative_l2": 0.12229646742343903, + "max_abs_delta": 1.5 + }, + "x_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9874126315116882, + "min_cosine_similarity": 0.9579513072967529, + "mean_relative_l2": 0.15255995094776154, + "max_abs_delta": 1.75 + }, + "period_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9923011064529419, + "min_cosine_similarity": 0.9842774868011475, + "mean_relative_l2": 0.12111688405275345, + "max_abs_delta": 0.875 + }, + "period_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9864380955696106, + "min_cosine_similarity": 0.9550102949142456, + "mean_relative_l2": 0.15752990543842316, + "max_abs_delta": 1.75 + } + } + }, + "layer_16": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7172b34496e86478ab715e7bb10b87d7f156a40ec6f94bf8a4ec127b21d13925", + "mean": -0.0013305532047525048, + "std": 0.9054014682769775, + "rms": 0.905402421951294, + "max_abs": 26.625 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "95f901301d320404762e6466db8c6a30bed02c6cac1387918641fae42be36f63", + "mean": -0.02981698513031006, + "std": 11.660013198852539, + "rms": 11.660050392150879, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e170bd22de5d745a836f9f5970390fb49008a92a4e11b4c7cb6d83cdefbb22ae", + "mean": -0.00124928739387542, + "std": 0.9090218544006348, + "rms": 0.9090227484703064, + "max_abs": 26.75 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ad961b9dcc4f966cc43fd50f9399a47318a020d5e39326bd5b9dbf6c9fa2e6b8", + "mean": -0.028942594304680824, + "std": 10.411717414855957, + "rms": 10.411758422851562, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2c2b56d81b0e6e711053afd80673636cb5c1f918f4b886811cc00dab0ee3c404", + "mean": -0.000984314363449812, + "std": 0.9055389761924744, + "rms": 0.9055395126342773, + "max_abs": 26.75 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2afa4830b4e442262d824d5099975eaa45713e824556e2b20e07dd1ba1953924", + "mean": -0.005702858325093985, + "std": 10.226383209228516, + "rms": 10.226385116577148, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "357d3a2462f2a8040096b00e6b9cb99f46a1d5a3313b7e54ae8267ae82c84b79", + "mean": -0.002116486430168152, + "std": 0.9067221283912659, + "rms": 0.9067245721817017, + "max_abs": 26.375 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4fb1043751938a05d647726355e07efa049a5f3d2baa3606a7bd756c3fda33ef", + "mean": -0.008383230306208134, + "std": 8.855643272399902, + "rms": 8.855647087097168, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4eea49ba63e290879c9f97815921d948abf2a744fcd620f11dacd1bdcb7690ff", + "mean": -0.0014796386240050197, + "std": 0.9072288274765015, + "rms": 0.907230019569397, + "max_abs": 27.5 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "58da01ef38b2d9e52e528fa3dbf488e8b485e4e1fc49dd2621d9435ec6bab8e5", + "mean": -0.006248394027352333, + "std": 10.22694206237793, + "rms": 10.226943016052246, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f46025cca2619e787fe7b5ab15ee7850617f34fb3cdbb137534abb6dfc971283", + "mean": -0.0010370768141001463, + "std": 0.9007279872894287, + "rms": 0.9007285833358765, + "max_abs": 27.0 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b870e00f25266821a894cbe9b932d9e1057718e6b190e4e10dc803daa9562ae2", + "mean": -0.00847130361944437, + "std": 8.85550594329834, + "rms": 8.855510711669922, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1e16d95272891286c9c9e505f04496dbc10d846e412b3893e74ab4b367adcb28", + "mean": -0.0012500195298343897, + "std": 0.9018582701683044, + "rms": 0.9018591046333313, + "max_abs": 27.0 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7598da91e8f1207f7d16dd6b13f529bb9409133ad5ea2394e7d94708ea37329f", + "mean": -0.005584684666246176, + "std": 10.226374626159668, + "rms": 10.226375579833984, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "458f74b1d1fc06d51a5b8deedeb4ca14598bfe022b244cb3ccf5281de97da079", + "mean": -0.0006418594275601208, + "std": 0.9031073451042175, + "rms": 0.9031075239181519, + "max_abs": 26.75 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b7c60712b18cf241a03512aa4b000d854d25a44dcdb24c37beea7a7ad58d2576", + "mean": -0.007936770096421242, + "std": 8.85539436340332, + "rms": 8.855398178100586, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9965259432792664, + "min_cosine_similarity": 0.9832726716995239, + "mean_relative_l2": 0.07875633984804153, + "max_abs_delta": 0.875 + }, + "system_bos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9948064684867859, + "min_cosine_similarity": 0.9866347312927246, + "mean_relative_l2": 0.09989780187606812, + "max_abs_delta": 0.75 + }, + "system_x": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9910790920257568, + "min_cosine_similarity": 0.9679185152053833, + "mean_relative_l2": 0.12739166617393494, + "max_abs_delta": 1.5 + }, + "system_period": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9902949333190918, + "min_cosine_similarity": 0.9678921103477478, + "mean_relative_l2": 0.1338910609483719, + "max_abs_delta": 1.28125 + }, + "bos_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9940948486328125, + "min_cosine_similarity": 0.9879327416419983, + "mean_relative_l2": 0.10732144862413406, + "max_abs_delta": 1.375 + }, + "bos_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9930965304374695, + "min_cosine_similarity": 0.9860086441040039, + "mean_relative_l2": 0.1159687340259552, + "max_abs_delta": 1.5 + }, + "x_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9923112988471985, + "min_cosine_similarity": 0.9817991256713867, + "mean_relative_l2": 0.12048888206481934, + "max_abs_delta": 1.25 + }, + "x_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9875732064247131, + "min_cosine_similarity": 0.954919695854187, + "mean_relative_l2": 0.1510462611913681, + "max_abs_delta": 2.0 + }, + "period_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9925848841667175, + "min_cosine_similarity": 0.9851506352424622, + "mean_relative_l2": 0.11906446516513824, + "max_abs_delta": 0.875 + }, + "period_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9865285754203796, + "min_cosine_similarity": 0.9521104097366333, + "mean_relative_l2": 0.15629374980926514, + "max_abs_delta": 1.78515625 + } + } + }, + "layer_17": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c81932d5f3261dd05f9bd62f2d43c31fa2604600005209e0b65de71b267c57cc", + "mean": -0.0009024279424920678, + "std": 1.0417420864105225, + "rms": 1.0417425632476807, + "max_abs": 32.0 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ff4c17ac74666ec6addf34ef4db3f0531ca0a2cc6901b4878ec169aa28c0d892", + "mean": -0.030326129868626595, + "std": 11.673483848571777, + "rms": 11.67352294921875, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "458518ec9578632b2aef708c8e04caf3b65560726594baf5e5865befe7a73f01", + "mean": -0.0009326727595180273, + "std": 1.0439115762710571, + "rms": 1.0439119338989258, + "max_abs": 32.5 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ceb6c66864e1ffcda8f1516b5171459d322021400616be3af45aaeb20d5784c3", + "mean": -0.0306381992995739, + "std": 10.425899505615234, + "rms": 10.425945281982422, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c306a980dcd1369eabcd096380aa63dba87a978a00ee169adf7d31665cb5ce13", + "mean": -0.0007002444472163916, + "std": 1.042693018913269, + "rms": 1.0426932573318481, + "max_abs": 31.75 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0b0a6ac6914d6ff7427f786141810b9124bfa7394904d82782a0a424fd16ae56", + "mean": -0.006000659894198179, + "std": 10.24084186553955, + "rms": 10.240842819213867, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0074362980ec48841c9944ee3bb5648ba6241750862b9ef76f78193a1585a54d", + "mean": -0.0010868823155760765, + "std": 1.0437538623809814, + "rms": 1.0437544584274292, + "max_abs": 32.0 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7457ff6cdffb7bad42bb40c1f83e836644f42971d9451da5c0fe4f07c48f6f7b", + "mean": -0.009819937869906425, + "std": 8.871597290039062, + "rms": 8.871603012084961, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "25fbcd42671edd5a62e3ee01b80dac38c18186d4438312414172b8dde7511646", + "mean": -0.0015177117893472314, + "std": 1.0401279926300049, + "rms": 1.0401290655136108, + "max_abs": 32.25 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fbebe08939f83cdd66b7829b3d832c457dce1d4ac25e45af05b7dcef516f7d20", + "mean": -0.006917823106050491, + "std": 10.241375923156738, + "rms": 10.241377830505371, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "398b5d1558977bf306162984e55f777aebf3f0ec00b9e3f12c2ae0d2d70ddf0c", + "mean": 0.00011906027793884277, + "std": 1.0341778993606567, + "rms": 1.0341778993606567, + "max_abs": 31.875 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "09266a6cb56515498d82452c55c4b7cb8d1a9c276c161f88455e7a7d210d0a0e", + "mean": -0.009963128715753555, + "std": 8.871471405029297, + "rms": 8.871477127075195, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c37171728cfbc7483a63524f703f2ad8a09d48b118c80b6b172ce2f43879d674", + "mean": -0.0010934744495898485, + "std": 1.0361227989196777, + "rms": 1.036123275756836, + "max_abs": 31.75 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c75fb3e7ba11be651b4b8f6e24dad9d90d816c3e9e88c7ce4b50fe0344c2a3c6", + "mean": -0.005980886984616518, + "std": 10.240734100341797, + "rms": 10.240735054016113, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b3a24b6914ab58338095f3f1a65811fd7cef6e76ca917bdad6f5a460c5117733", + "mean": 0.0008388317073695362, + "std": 1.0355840921401978, + "rms": 1.0355844497680664, + "max_abs": 31.5 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "95ae553875c524e48a74e624d565556e8898bee720afee2377b7e15affe553b3", + "mean": -0.009275015443563461, + "std": 8.871394157409668, + "rms": 8.871399879455566, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9966961145401001, + "min_cosine_similarity": 0.9842362999916077, + "mean_relative_l2": 0.07653337717056274, + "max_abs_delta": 1.0 + }, + "system_bos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9949622750282288, + "min_cosine_similarity": 0.9868856072425842, + "mean_relative_l2": 0.09813791513442993, + "max_abs_delta": 0.75 + }, + "system_x": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9914548397064209, + "min_cosine_similarity": 0.970861554145813, + "mean_relative_l2": 0.12505829334259033, + "max_abs_delta": 1.5 + }, + "system_period": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9904905557632446, + "min_cosine_similarity": 0.97004234790802, + "mean_relative_l2": 0.132633775472641, + "max_abs_delta": 1.7109375 + }, + "bos_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9944615364074707, + "min_cosine_similarity": 0.9882891178131104, + "mean_relative_l2": 0.10395394265651703, + "max_abs_delta": 1.25 + }, + "bos_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9934386610984802, + "min_cosine_similarity": 0.986795961856842, + "mean_relative_l2": 0.1129467561841011, + "max_abs_delta": 1.375 + }, + "x_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9927393198013306, + "min_cosine_similarity": 0.9829832315444946, + "mean_relative_l2": 0.11684863269329071, + "max_abs_delta": 1.25 + }, + "x_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9880449175834656, + "min_cosine_similarity": 0.9562491178512573, + "mean_relative_l2": 0.1485297530889511, + "max_abs_delta": 2.3515625 + }, + "period_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9929878115653992, + "min_cosine_similarity": 0.983654260635376, + "mean_relative_l2": 0.11577341705560684, + "max_abs_delta": 1.0 + }, + "period_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9869971871376038, + "min_cosine_similarity": 0.954211950302124, + "mean_relative_l2": 0.1541265994310379, + "max_abs_delta": 2.4921875 + } + } + }, + "layer_18": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8760e55835423a721e29bc270a24739457f00e093b70f299e38bcd208c6676fa", + "mean": 0.006269271019846201, + "std": 1.1793605089187622, + "rms": 1.1793771982192993, + "max_abs": 33.75 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8804687ccb5c0f9e28e5285540bc9cf60e71737e82979d474dfc82e1f77ee7d6", + "mean": -0.025728709995746613, + "std": 11.693342208862305, + "rms": 11.69336986541748, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9d3de022fefa00daa5efbc7d12c61b79efcef1976c2a7ce24919edae8d8c1102", + "mean": 0.005903188139200211, + "std": 1.1811140775680542, + "rms": 1.1811288595199585, + "max_abs": 34.25 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c62dbf6ad5d357e1ee76e417ecea21155475fb8050bb5176605871d3bb3907d6", + "mean": -0.027228213846683502, + "std": 10.446075439453125, + "rms": 10.446110725402832, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6c86972487a14907525f3365a0c02b7dbb1e22c513bafe5c51baab00afcbe636", + "mean": 0.006304558366537094, + "std": 1.1791507005691528, + "rms": 1.1791675090789795, + "max_abs": 33.25 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c54c1844f0af4340db83452e11c74eb13f801d0417e8ce42ca98ddafaccb653d", + "mean": -0.0012222336372360587, + "std": 10.259084701538086, + "rms": 10.259084701538086, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "915cc97234d3537503709bcc8857e66898c401d8b2d64e81a83b990f33c285eb", + "mean": 0.005575032904744148, + "std": 1.1779954433441162, + "rms": 1.1780086755752563, + "max_abs": 33.5 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6a51b86c30a489fd0f64999b5060656000bc854c1c38c935f77c69695434a05b", + "mean": -0.006286323070526123, + "std": 8.891283988952637, + "rms": 8.89128589630127, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0181e5e74a7ea39979e5648dc888b827b313202ebd9a588bb9f1325291d610a7", + "mean": 0.005432264879345894, + "std": 1.1774979829788208, + "rms": 1.1775104999542236, + "max_abs": 33.75 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "276d8be30dbb8f1404d15ee87668b689d6cdf78bb9323a7c730eb5c530329fdb", + "mean": -0.002584875328466296, + "std": 10.259849548339844, + "rms": 10.25985050201416, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2651350d0297ffa624f88cfdea8ec0934c1c66757a2f09f3f633e126280a6b18", + "mean": 0.007053923327475786, + "std": 1.1679924726486206, + "rms": 1.1680138111114502, + "max_abs": 33.0 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e5af12de8a5b166fd3c29a596cd4e5a890eba2c8a41a84d42ac6d5cfc22aa9ab", + "mean": -0.006548131350427866, + "std": 8.891362190246582, + "rms": 8.891365051269531, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d02e6895f9a78170e8aa7b5d9c28b32aedc6b38f2421c5f3ec809427bcb4dccb", + "mean": 0.0058504375629127026, + "std": 1.1751033067703247, + "rms": 1.17511785030365, + "max_abs": 33.5 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bcaff99217e91a30bce813fbd4595be0b65b296fdb4245ae046976a5e0f97afc", + "mean": -0.0016147742280736566, + "std": 10.259298324584961, + "rms": 10.259298324584961, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ca48954d6c7e1160dd52f712311d0a1260b3ed24d433f13b8ea62d6851ff48a6", + "mean": 0.007309486158192158, + "std": 1.168333649635315, + "rms": 1.1683565378189087, + "max_abs": 32.75 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d8c0937de32fba5e2e19a7913b6c6d5d765a1c008fe341cb0b48e5a84920dc27", + "mean": -0.00607377290725708, + "std": 8.891083717346191, + "rms": 8.891085624694824, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9967582821846008, + "min_cosine_similarity": 0.983817458152771, + "mean_relative_l2": 0.07569699734449387, + "max_abs_delta": 1.09375 + }, + "system_bos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9952704310417175, + "min_cosine_similarity": 0.9893698692321777, + "mean_relative_l2": 0.0955951139330864, + "max_abs_delta": 1.0 + }, + "system_x": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9915359616279602, + "min_cosine_similarity": 0.9710637331008911, + "mean_relative_l2": 0.12506727874279022, + "max_abs_delta": 2.0 + }, + "system_period": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9904395937919617, + "min_cosine_similarity": 0.9715724587440491, + "mean_relative_l2": 0.13322465121746063, + "max_abs_delta": 2.609375 + }, + "bos_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9946495294570923, + "min_cosine_similarity": 0.9880751371383667, + "mean_relative_l2": 0.10233382880687714, + "max_abs_delta": 1.5 + }, + "bos_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9936316013336182, + "min_cosine_similarity": 0.9883381128311157, + "mean_relative_l2": 0.1113872304558754, + "max_abs_delta": 1.625 + }, + "x_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9930599331855774, + "min_cosine_similarity": 0.9833084344863892, + "mean_relative_l2": 0.11484095454216003, + "max_abs_delta": 1.5 + }, + "x_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9881324768066406, + "min_cosine_similarity": 0.9567136764526367, + "mean_relative_l2": 0.14805968105793, + "max_abs_delta": 3.25 + }, + "period_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9933103322982788, + "min_cosine_similarity": 0.986238956451416, + "mean_relative_l2": 0.11395860463380814, + "max_abs_delta": 1.1953125 + }, + "period_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.986833393573761, + "min_cosine_similarity": 0.9562422037124634, + "mean_relative_l2": 0.1549675315618515, + "max_abs_delta": 3.765625 + } + } + }, + "layer_19": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cdf8c82ab37edd4c4389ac9b1361090182dde9ccf62dd8b8acdc4a1d88a0dc39", + "mean": 0.004884566180408001, + "std": 1.278659701347351, + "rms": 1.278668999671936, + "max_abs": 31.25 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2fe6c4dffd8e88458df7a51a6470e2a030fc645634bab95ec33702ba37f74e49", + "mean": -0.025668293237686157, + "std": 11.698992729187012, + "rms": 11.699020385742188, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2b30e6acaff5157cdc524404045b06e1ecf42f5a4c380653cb939415476cf500", + "mean": 0.004539945628494024, + "std": 1.2816952466964722, + "rms": 1.281703233718872, + "max_abs": 31.125 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3447af5def8297953a63c3639c69ad836d1142e4bcd6bbf298fb76d406cd7607", + "mean": -0.02614888921380043, + "std": 10.454276084899902, + "rms": 10.454307556152344, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7e57025aa86c17eef93d23ebdc36b31c26db4a18040866d38c6e7ce2aefb30a2", + "mean": 0.004506862722337246, + "std": 1.277817726135254, + "rms": 1.2778255939483643, + "max_abs": 31.0 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8eedbe18e7dc1cfb7364ddba605e95ba181314477ceafbc5d51eb9685bee3099", + "mean": -0.0020392846781760454, + "std": 10.265865325927734, + "rms": 10.265865325927734, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a7d6b0220ae32d43fa2f241dc4d5b64f93045731f583baed6da6dab95b9d37a9", + "mean": 0.003960192669183016, + "std": 1.2769761085510254, + "rms": 1.276982307434082, + "max_abs": 30.75 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0b2306ad4011f08ae2d4ba98506fa1df69e425ee0e2c46c001569dc8c81af46c", + "mean": -0.005472157616168261, + "std": 8.900747299194336, + "rms": 8.900748252868652, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b8abdbb14417a75342c4031ebb5bc00cdd8cee545a4877ef7246b8cd0692f1ca", + "mean": 0.0036568085197359324, + "std": 1.2759159803390503, + "rms": 1.275921106338501, + "max_abs": 32.0 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "97e570624c8892932b34e59bc20ad749bf3fed3f2df44a9396870d31e52423e6", + "mean": -0.0028966523241251707, + "std": 10.267004013061523, + "rms": 10.267004013061523, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9f05480765847f0a8b9a589684fc3317bebdb8127fdf6e28fcdb0e33fcf4e5e9", + "mean": 0.005160841159522533, + "std": 1.2678507566452026, + "rms": 1.2678611278533936, + "max_abs": 31.5 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "50baca7642244de37eb3bbf3dfa6829f213302d343628772b5c72691954e004f", + "mean": -0.005545526277273893, + "std": 8.900955200195312, + "rms": 8.900956153869629, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f4cd82563f6a68d655a0ab610ba202dfb93d4d7973b7919035d2900b46aeb284", + "mean": 0.0039406572468578815, + "std": 1.273550033569336, + "rms": 1.273556113243103, + "max_abs": 31.75 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "807514e50b5b627d57a148a1f805922ac5f4ab6dd7259f6d910d1cd04c5809f9", + "mean": -0.0024629347026348114, + "std": 10.266260147094727, + "rms": 10.266261100769043, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a7084b739b5b1463186f457594fe86e23b022999486e6020e0c1728d0946773f", + "mean": 0.005075429566204548, + "std": 1.268519639968872, + "rms": 1.2685297727584839, + "max_abs": 31.125 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a8a690679215f1d0364772db9b40883d3afb20ca9e8913953483e2803c097ad9", + "mean": -0.005685541778802872, + "std": 8.9008207321167, + "rms": 8.900821685791016, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9965932965278625, + "min_cosine_similarity": 0.9837935566902161, + "mean_relative_l2": 0.07782993465662003, + "max_abs_delta": 1.21875 + }, + "system_bos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9949241280555725, + "min_cosine_similarity": 0.9884229898452759, + "mean_relative_l2": 0.0988764837384224, + "max_abs_delta": 1.125 + }, + "system_x": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9912264347076416, + "min_cosine_similarity": 0.9694937467575073, + "mean_relative_l2": 0.12721854448318481, + "max_abs_delta": 1.921875 + }, + "system_period": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9901043176651001, + "min_cosine_similarity": 0.9705699682235718, + "mean_relative_l2": 0.13539381325244904, + "max_abs_delta": 3.109375 + }, + "bos_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9941586256027222, + "min_cosine_similarity": 0.9878485798835754, + "mean_relative_l2": 0.10663262754678726, + "max_abs_delta": 1.875 + }, + "bos_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9933881163597107, + "min_cosine_similarity": 0.9879586696624756, + "mean_relative_l2": 0.11321119964122772, + "max_abs_delta": 2.0 + }, + "x_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9927664399147034, + "min_cosine_similarity": 0.9837307333946228, + "mean_relative_l2": 0.11704090237617493, + "max_abs_delta": 1.578125 + }, + "x_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9877917170524597, + "min_cosine_similarity": 0.9568799734115601, + "mean_relative_l2": 0.1500144898891449, + "max_abs_delta": 3.421875 + }, + "period_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9929636120796204, + "min_cosine_similarity": 0.9855884313583374, + "mean_relative_l2": 0.11636540293693542, + "max_abs_delta": 1.203125 + }, + "period_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9865207672119141, + "min_cosine_similarity": 0.9551361799240112, + "mean_relative_l2": 0.15621814131736755, + "max_abs_delta": 4.234375 + } + } + }, + "layer_20": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a0c4d2c9296e0e9d7c9f81b6c293f078dcd8cbd565d93ec67acb585f94901bd9", + "mean": 0.015864374116063118, + "std": 1.4602570533752441, + "rms": 1.4603432416915894, + "max_abs": 38.0 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5c8d1d40e99fb7dd2ee16cf729100721aa3d6a6b6b64f4b34b3f13f5911f32fa", + "mean": -0.020552361384034157, + "std": 12.06677532196045, + "rms": 12.066791534423828, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ca321674c8fe07736552d3ec97694cba56560815b72c220580ab8ccb14764064", + "mean": 0.015261142514646053, + "std": 1.4647034406661987, + "rms": 1.4647828340530396, + "max_abs": 38.0 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f6575003c50d18b9c4caf94c6f906489ea56c1abfb505f3a5a1a9567bc8c7ff9", + "mean": -0.022101357579231262, + "std": 10.800926208496094, + "rms": 10.800948143005371, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "12c53ecdafa49eeecf8aa351603cbb76fbd7080add17e3d3fdd160c4f629c00a", + "mean": 0.015002486295998096, + "std": 1.456263542175293, + "rms": 1.4563407897949219, + "max_abs": 38.0 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fc1c1a27b7f4d92030429b9ca5e2a4acb6cdb02853aa95002293517825f72163", + "mean": 0.0016455836594104767, + "std": 10.286273956298828, + "rms": 10.286273956298828, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b942ab947af17da57a84572c2fb71ee8ad434e9afc1000583cff259f72db69d9", + "mean": 0.015140358358621597, + "std": 1.4553197622299194, + "rms": 1.4553985595703125, + "max_abs": 37.5 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "89fc11148772d3cd7dfab069d97a1cff1b0f5f0dc0bf8ce26e8a40f4e346c709", + "mean": -0.0020895889028906822, + "std": 8.924606323242188, + "rms": 8.924606323242188, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "29310ca5a1e91f938a6a46c5cdbbde3d2db741ad8b6d6f27a636bd778ad1c66c", + "mean": 0.014176527969539165, + "std": 1.4559910297393799, + "rms": 1.4560600519180298, + "max_abs": 38.25 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "dafb690f70dca7ea26bbacabe963d477ded874fd1514b50ddfa06a4bedc2fef8", + "mean": 0.0005069461767561734, + "std": 10.287917137145996, + "rms": 10.287917137145996, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f786d08a72be3323852a42ff0370fd8a2aa57a94dc4bac46aedd7f784a816615", + "mean": 0.016881020739674568, + "std": 1.4526854753494263, + "rms": 1.452783465385437, + "max_abs": 37.5 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "25a72c4fab04edbdc8a4002e8f6fa5b71bebc2601acd967221c412cd4aefb055", + "mean": -0.0018755397759377956, + "std": 8.925568580627441, + "rms": 8.925568580627441, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "99e386d18d78e786908bbd6988786bc1fa5d805c4e38d629e78c2a2926d2fabb", + "mean": 0.01487679686397314, + "std": 1.4525883197784424, + "rms": 1.4526644945144653, + "max_abs": 38.25 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1cf34c5966dffa7aa5c28a0bcdbccc179a75a70e410a8fbc85d4e0f306f5fac1", + "mean": 0.0013326741755008698, + "std": 10.28697681427002, + "rms": 10.28697681427002, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "579a272fc0efd428f758e56d1b158ea734fdcbb0314a7c954a6315b937a42e83", + "mean": 0.015531443059444427, + "std": 1.4529132843017578, + "rms": 1.4529962539672852, + "max_abs": 37.5 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "941c689ec487dfa8eb652bf59cec4ba29419947b2ddec53cb48333b4981ed5e0", + "mean": -0.0022135120816528797, + "std": 8.925163269042969, + "rms": 8.925164222717285, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9963683485984802, + "min_cosine_similarity": 0.984535276889801, + "mean_relative_l2": 0.08059024810791016, + "max_abs_delta": 2.0 + }, + "system_bos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9946662187576294, + "min_cosine_similarity": 0.9866840839385986, + "mean_relative_l2": 0.10105487704277039, + "max_abs_delta": 1.5 + }, + "system_x": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9904928803443909, + "min_cosine_similarity": 0.9651623964309692, + "mean_relative_l2": 0.1318548619747162, + "max_abs_delta": 2.25 + }, + "system_period": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9888865351676941, + "min_cosine_similarity": 0.9621235132217407, + "mean_relative_l2": 0.1430099457502365, + "max_abs_delta": 3.8125 + }, + "bos_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9942262768745422, + "min_cosine_similarity": 0.9883444309234619, + "mean_relative_l2": 0.1056593805551529, + "max_abs_delta": 2.625 + }, + "bos_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9929288029670715, + "min_cosine_similarity": 0.9866142868995667, + "mean_relative_l2": 0.11610422283411026, + "max_abs_delta": 2.625 + }, + "x_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9927108883857727, + "min_cosine_similarity": 0.9836350679397583, + "mean_relative_l2": 0.11720804870128632, + "max_abs_delta": 1.90625 + }, + "x_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9868212938308716, + "min_cosine_similarity": 0.952269971370697, + "mean_relative_l2": 0.1547330766916275, + "max_abs_delta": 4.375 + }, + "period_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.993034839630127, + "min_cosine_similarity": 0.986496090888977, + "mean_relative_l2": 0.11587207019329071, + "max_abs_delta": 1.625 + }, + "period_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9851364493370056, + "min_cosine_similarity": 0.9467138051986694, + "mean_relative_l2": 0.16328948736190796, + "max_abs_delta": 5.625 + } + } + }, + "layer_21": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e12cc34e1b4c254187522e63ceaa00df3d7aaac3b6526d5d128a531c64aa98cc", + "mean": 0.023792115971446037, + "std": 1.6455410718917847, + "rms": 1.645712971687317, + "max_abs": 50.0 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e2cd06b3ebf0434654ca501305f30593518781d3cbf7b7053427d91a4e703c26", + "mean": -0.014884334988892078, + "std": 12.194429397583008, + "rms": 12.194438934326172, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f62235da53c17fe13c6aa143b799618fac3e5a223732bd960522f84975eb6c71", + "mean": 0.023380767554044724, + "std": 1.6534669399261475, + "rms": 1.6536321640014648, + "max_abs": 50.5 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f7ecd1235e67c6cdb9db885e6dfae3b7c73ed87c719bc82219806aa69aab1e7f", + "mean": -0.016894876956939697, + "std": 10.913851737976074, + "rms": 10.913865089416504, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cc8b12d66106de6d930c8008601fd7d731f7e8f9de4c0681d47ca93bb9de5990", + "mean": 0.02164994180202484, + "std": 1.6363826990127563, + "rms": 1.6365258693695068, + "max_abs": 49.5 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "674443dd3095159b502fcf0d54ee07561be05ea98bb9619d3a67c0411749a093", + "mean": 0.006994816940277815, + "std": 10.28140640258789, + "rms": 10.28140926361084, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e3670306c0662257ed0fb89f45eddd5720d03d4d1a514ebb26c881179fc38f4b", + "mean": 0.022486573085188866, + "std": 1.6366362571716309, + "rms": 1.6367907524108887, + "max_abs": 49.5 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e6bfb414061c2179e81263b4f4b14d7953b42fcc2dc3dabcd63e7c5a66969a71", + "mean": 0.003021390177309513, + "std": 8.92943286895752, + "rms": 8.92943286895752, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d39e9ef83b063eb9b15e89e7c302ff929a4cbb860bb8e58d3f993da9e8440afd", + "mean": 0.021343614906072617, + "std": 1.6398190259933472, + "rms": 1.6399579048156738, + "max_abs": 49.5 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bb88015154117b7cf08f9c8537125d1f3ddd95e1c605e479227e56aa84246a2c", + "mean": 0.006130880210548639, + "std": 10.284013748168945, + "rms": 10.284015655517578, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5d9d88119d91cee4ef8e9671cbf1094a72abed2808ae90e444c65066bd28d3a4", + "mean": 0.02404157817363739, + "std": 1.6423250436782837, + "rms": 1.642500877380371, + "max_abs": 49.25 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a1651f672000f2edc9a32dccd96924254b079cd5c17406044e4466eb13b91fec", + "mean": 0.002540812361985445, + "std": 8.931971549987793, + "rms": 8.931970596313477, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fffd9c3e558e36de2d9742d0ae9ec60940b474d1eee6c372fff07fab83f03ef0", + "mean": 0.021637307479977608, + "std": 1.636104702949524, + "rms": 1.6362477540969849, + "max_abs": 50.25 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5aeb16ed76cd9e3fde6bdd5f0e44327317bb65a442c2db5afec260ee594786a9", + "mean": 0.006852233782410622, + "std": 10.282276153564453, + "rms": 10.282278060913086, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ff596580446d48bbffef8b80767c6f0fb85308e7ffacdb10be735bef2f4bd437", + "mean": 0.02241809479892254, + "std": 1.642898440361023, + "rms": 1.6430513858795166, + "max_abs": 50.25 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "654e1b3acde3040add63af639b6989eedb4c74da80db8a8c9a75e0cdbf31b042", + "mean": 0.00230576703324914, + "std": 8.930743217468262, + "rms": 8.930742263793945, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9958885908126831, + "min_cosine_similarity": 0.9836219549179077, + "mean_relative_l2": 0.08637555688619614, + "max_abs_delta": 1.875 + }, + "system_bos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9942092299461365, + "min_cosine_similarity": 0.9841549396514893, + "mean_relative_l2": 0.10515668243169785, + "max_abs_delta": 1.5 + }, + "system_x": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9890302419662476, + "min_cosine_similarity": 0.9602181911468506, + "mean_relative_l2": 0.14002825319766998, + "max_abs_delta": 2.8359375 + }, + "system_period": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9872254729270935, + "min_cosine_similarity": 0.9561111927032471, + "mean_relative_l2": 0.1527993530035019, + "max_abs_delta": 3.9375 + }, + "bos_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.993927001953125, + "min_cosine_similarity": 0.9873583316802979, + "mean_relative_l2": 0.10845905542373657, + "max_abs_delta": 3.25 + }, + "bos_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9925575256347656, + "min_cosine_similarity": 0.9853520393371582, + "mean_relative_l2": 0.1193050742149353, + "max_abs_delta": 3.0 + }, + "x_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.992444634437561, + "min_cosine_similarity": 0.9831590056419373, + "mean_relative_l2": 0.1191471591591835, + "max_abs_delta": 2.21875 + }, + "x_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9849876165390015, + "min_cosine_similarity": 0.9445942640304565, + "mean_relative_l2": 0.16297173500061035, + "max_abs_delta": 4.875 + }, + "period_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9928835034370422, + "min_cosine_similarity": 0.9861910343170166, + "mean_relative_l2": 0.11698651313781738, + "max_abs_delta": 2.0 + }, + "period_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9835559725761414, + "min_cosine_similarity": 0.9414061307907104, + "mean_relative_l2": 0.171382337808609, + "max_abs_delta": 6.125 + } + } + }, + "layer_22": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "86642818621084d79571a9e7acaaaada908c81da90aed452ef52a5d59e533530", + "mean": 0.024196412414312363, + "std": 1.921998143196106, + "rms": 1.9221504926681519, + "max_abs": 65.0 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "babe424bf62af1f68764bd6646e2d2649388504cce562cfbce457069797339ad", + "mean": -0.015639448538422585, + "std": 12.222116470336914, + "rms": 12.222126960754395, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "adbc65bce17a32506a2376607b55e14cad67c5b2bd1025896eaaee9794323374", + "mean": 0.024587014690041542, + "std": 1.9316526651382446, + "rms": 1.9318090677261353, + "max_abs": 66.0 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e99a42e6bba290fb0f711ebd0ac301ed6ae69187a087910311956f22aa7f69e9", + "mean": -0.017769522964954376, + "std": 10.94935131072998, + "rms": 10.949365615844727, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "801bb2d5bef68b79b1a1f694d346597ba46adcae1ab2651bdb8ed53c66c86e0e", + "mean": 0.020891675725579262, + "std": 1.9024207592010498, + "rms": 1.902535319328308, + "max_abs": 64.0 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "800967cb25eac991fd39c1298769d3139c199eeb23692e338ec16e92eae65462", + "mean": 0.006004673894494772, + "std": 10.313594818115234, + "rms": 10.313596725463867, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c12855b83eed02972a7f0e494e8121fa0cc1c25eb818ffa795ae34b7aaec09ba", + "mean": 0.023623593151569366, + "std": 1.904802680015564, + "rms": 1.9049491882324219, + "max_abs": 63.75 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d65f7a14affcb43df1a18edc6e0fd7bc7a7e7c2242791ca0665b8b6c79cd3ada", + "mean": 0.002379882149398327, + "std": 8.972557067871094, + "rms": 8.97255802154541, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e768179432e284d164ce6d19bcbc189c594826cfb9d385bd8989e61f66f7d94e", + "mean": 0.02130262553691864, + "std": 1.9160939455032349, + "rms": 1.9162124395370483, + "max_abs": 65.0 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "be1d7c774d7c120d95f31e1ada69fd98ba0b60cc59b98026e5d04783f418b0ad", + "mean": 0.005569140892475843, + "std": 10.31787109375, + "rms": 10.317872047424316, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "59558f7bcd8f49554a8aa590212af928626ca6c24d4d974902f37de9c772d977", + "mean": 0.025893235579133034, + "std": 1.9231504201889038, + "rms": 1.9233248233795166, + "max_abs": 65.5 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "50ea815fc6064163f9f059683c963edb30bd137c5c4ba0352f1a2ba47e67cb0d", + "mean": 0.0026393989101052284, + "std": 8.977215766906738, + "rms": 8.977215766906738, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a8c214b76643c396765962a1575488fbf1cb7f98e766df12c91d2afd04275167", + "mean": 0.021783284842967987, + "std": 1.9071954488754272, + "rms": 1.9073197841644287, + "max_abs": 65.0 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "45e49f131cb8973927c66afd2aec73301f22123cb1b927df953864ff74d18c8f", + "mean": 0.006074938457459211, + "std": 10.315313339233398, + "rms": 10.315314292907715, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f824425bc59eed4e7a68e9d8e6f569e069ed42aa8030e213c205d4ed7548933a", + "mean": 0.024884510785341263, + "std": 1.9248939752578735, + "rms": 1.9250547885894775, + "max_abs": 65.5 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "09a00efcb2f839f41f6b4875961bfe934c35c31fc156ae33e5f12e92ed8700f5", + "mean": 0.0028677592054009438, + "std": 8.975571632385254, + "rms": 8.97557258605957, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9958057999610901, + "min_cosine_similarity": 0.9828494191169739, + "mean_relative_l2": 0.08642954379320145, + "max_abs_delta": 2.0 + }, + "system_bos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.993806779384613, + "min_cosine_similarity": 0.9811782240867615, + "mean_relative_l2": 0.1080833226442337, + "max_abs_delta": 1.5 + }, + "system_x": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9875036478042603, + "min_cosine_similarity": 0.9474272727966309, + "mean_relative_l2": 0.14676420390605927, + "max_abs_delta": 5.09375 + }, + "system_period": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9861589670181274, + "min_cosine_similarity": 0.9488306641578674, + "mean_relative_l2": 0.15857534110546112, + "max_abs_delta": 4.75 + }, + "bos_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9938265681266785, + "min_cosine_similarity": 0.9867896437644958, + "mean_relative_l2": 0.10928165167570114, + "max_abs_delta": 4.75 + }, + "bos_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9926502108573914, + "min_cosine_similarity": 0.9831812381744385, + "mean_relative_l2": 0.11851082742214203, + "max_abs_delta": 3.75 + }, + "x_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9924648404121399, + "min_cosine_similarity": 0.9829153418540955, + "mean_relative_l2": 0.11789186298847198, + "max_abs_delta": 2.25 + }, + "x_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9839159846305847, + "min_cosine_similarity": 0.9349337816238403, + "mean_relative_l2": 0.165729820728302, + "max_abs_delta": 6.109375 + }, + "period_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9929430484771729, + "min_cosine_similarity": 0.9850740432739258, + "mean_relative_l2": 0.11580567061901093, + "max_abs_delta": 3.0 + }, + "period_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.983214259147644, + "min_cosine_similarity": 0.9340561032295227, + "mean_relative_l2": 0.17163868248462677, + "max_abs_delta": 6.1875 + } + } + }, + "layer_23": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9dc91da451429596241ad3121f7cd8cbaf01280722873589a8b74f7b0d2cb259", + "mean": 0.0313643254339695, + "std": 2.2612414360046387, + "rms": 2.2614588737487793, + "max_abs": 85.0 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fa5b937585f1e287eeadf75a315bd14a5346d3dda4938a667e1f4dafeaa15252", + "mean": -0.011697976849973202, + "std": 12.219572067260742, + "rms": 12.21957778930664, + "max_abs": 1160.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "92a8918b23ac1f5fb2128d0a25c8eb08b055a1fc6d29ac1264cf98931ce7fb54", + "mean": 0.03167140111327171, + "std": 2.276296377182007, + "rms": 2.2765166759490967, + "max_abs": 85.0 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fdb0c07f9fecf66ca3229b5f2baa4336fec39d36d580ba7d15ab810c1165f97a", + "mean": -0.012727977707982063, + "std": 10.964569091796875, + "rms": 10.96457576751709, + "max_abs": 1160.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9da68bf6864090eacb18ae2cddde432d0f1f9f8e336cc3d2cb4a34b496451723", + "mean": 0.02846476063132286, + "std": 2.2400217056274414, + "rms": 2.2402026653289795, + "max_abs": 84.0 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2ac43eb4537dd0af5108eb194b0d4234d9e8875b6a32f81584d59cbd8ee6ed55", + "mean": 0.009749569930136204, + "std": 10.325387001037598, + "rms": 10.32539176940918, + "max_abs": 1160.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a6492e61110aeff8c5d8778973200d54daf842fbc98e2b43ba5fe42d4fb5e5f2", + "mean": 0.030651362612843513, + "std": 2.2444818019866943, + "rms": 2.2446911334991455, + "max_abs": 84.0 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e7837969825f2fb3343d9086dcc1f090819cd687cb931a0e6e5cf62a6bc2010a", + "mean": 0.0074124522507190704, + "std": 9.008536338806152, + "rms": 9.008539199829102, + "max_abs": 1160.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d20c562f9a7510b2ec81175dd3bdb0baf416bd271ce18c4aca8552b392ab91bf", + "mean": 0.028328387066721916, + "std": 2.2566661834716797, + "rms": 2.2568440437316895, + "max_abs": 84.0 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "91354ab708f9b396a52ad9d7cbdb24293c23586e8a00e6652640fc7bdf45e32b", + "mean": 0.009662899188697338, + "std": 10.33246898651123, + "rms": 10.332473754882812, + "max_abs": 1160.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5b838fb1f032f234e12c59dbc3efd491c92e9cd0a6d238496fbc893ecc5a2c9f", + "mean": 0.030653052031993866, + "std": 2.2631657123565674, + "rms": 2.263373374938965, + "max_abs": 83.0 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4e4653c4919e6a693abdbf6ee4799669f9b651a242102f7b9f048172c39447f0", + "mean": 0.007009008899331093, + "std": 9.016783714294434, + "rms": 9.016786575317383, + "max_abs": 1160.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0a3c36efc9220eb7cb1a24d0d9dbde5f50bd9426da79113f3ebe19d23a438fc9", + "mean": 0.028562769293785095, + "std": 2.247494697570801, + "rms": 2.247676372528076, + "max_abs": 84.5 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "32bd974ed265994445c0b50c17a704e079bf1bf28f21b138c002d9077ccf9b49", + "mean": 0.009284410625696182, + "std": 10.328076362609863, + "rms": 10.328081130981445, + "max_abs": 1160.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6b261694837b069e7b2f1ef93fb1aefa43af9575f0d604d379c1f39cdff7bf2a", + "mean": 0.030015449970960617, + "std": 2.2678892612457275, + "rms": 2.268087863922119, + "max_abs": 85.0 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e57dbc57a1e386bbcd78563ea85f576426111fe092899fb885ff969a7456671f", + "mean": 0.00725087895989418, + "std": 9.013880729675293, + "rms": 9.013883590698242, + "max_abs": 1160.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9962804913520813, + "min_cosine_similarity": 0.9847632050514221, + "mean_relative_l2": 0.08219555020332336, + "max_abs_delta": 1.75 + }, + "system_bos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9945877194404602, + "min_cosine_similarity": 0.9853527545928955, + "mean_relative_l2": 0.10168713331222534, + "max_abs_delta": 2.0 + }, + "system_x": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9885433912277222, + "min_cosine_similarity": 0.9497576951980591, + "mean_relative_l2": 0.14129775762557983, + "max_abs_delta": 6.90625 + }, + "system_period": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9874275922775269, + "min_cosine_similarity": 0.9588392376899719, + "mean_relative_l2": 0.15277579426765442, + "max_abs_delta": 5.0625 + }, + "bos_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9945876002311707, + "min_cosine_similarity": 0.9877151250839233, + "mean_relative_l2": 0.10248755663633347, + "max_abs_delta": 5.5 + }, + "bos_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9937042593955994, + "min_cosine_similarity": 0.9860748052597046, + "mean_relative_l2": 0.10985366255044937, + "max_abs_delta": 4.0 + }, + "x_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9933804273605347, + "min_cosine_similarity": 0.9843934178352356, + "mean_relative_l2": 0.11117345094680786, + "max_abs_delta": 3.25 + }, + "x_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.985598623752594, + "min_cosine_similarity": 0.9452633857727051, + "mean_relative_l2": 0.15737470984458923, + "max_abs_delta": 8.5 + }, + "period_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9938305020332336, + "min_cosine_similarity": 0.9881864786148071, + "mean_relative_l2": 0.1086544543504715, + "max_abs_delta": 4.0 + }, + "period_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9851126670837402, + "min_cosine_similarity": 0.9478158354759216, + "mean_relative_l2": 0.1630931794643402, + "max_abs_delta": 6.75 + } + } + }, + "layer_24": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "aeda87271109eb7f173f719c7d6c04582d324309003d0a0211e883f058464652", + "mean": 0.04400085285305977, + "std": 2.7821805477142334, + "rms": 2.7825284004211426, + "max_abs": 109.5 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f38b7eca9b70022e38cb43beaa4756ff02c49d28a34a169115a5715b900d22a9", + "mean": -0.008732843212783337, + "std": 11.511177062988281, + "rms": 11.51117992401123, + "max_abs": 1008.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8539f3b9cd58a47a29c45c6b18b5644b80fdae100a38436faaa8f91b344adff7", + "mean": 0.04408012330532074, + "std": 2.7949233055114746, + "rms": 2.795271158218384, + "max_abs": 109.5 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "adc1ccb0d96f1550bbc183bd79d66fa2912cef63d8cc8312c1de9c75d526c5b8", + "mean": -0.009700094349682331, + "std": 10.680423736572266, + "rms": 10.680428504943848, + "max_abs": 1120.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "41d213d55e05c67fa44a4c79c489866de878c285086f20cd192ece2207e73ad5", + "mean": 0.040446918457746506, + "std": 2.7605979442596436, + "rms": 2.7608940601348877, + "max_abs": 109.0 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3c739cae2beab37e1363de22568ab57910e7721d2c4fd087e9eca1db1a94d60c", + "mean": 0.01580703631043434, + "std": 7.293244361877441, + "rms": 7.293262004852295, + "max_abs": 840.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3f57eb392bc6248f2271b4bad0a26d2c74a81ad2c9c1054ae1dbeebb5deea31c", + "mean": 0.042914774268865585, + "std": 2.7639896869659424, + "rms": 2.7643227577209473, + "max_abs": 109.0 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "aec3afd03e9f1b29b792c522a2df49d654ecd6d61baa7dc7421ce58d3aae6822", + "mean": 0.013139263726770878, + "std": 6.475987911224365, + "rms": 6.476001262664795, + "max_abs": 840.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f55158f9fe8a00eea9a30ad1ad43139274d200e889df4ecbcaa23907b42225bf", + "mean": 0.04154730215668678, + "std": 2.768303871154785, + "rms": 2.76861572265625, + "max_abs": 108.5 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "23491953b033e56d5434697a45f50ba04bfcb0c4734582fea0ed301eef94c34b", + "mean": 0.015913499519228935, + "std": 7.304422378540039, + "rms": 7.304440021514893, + "max_abs": 840.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "02103d21ff57bdf408814f564b22b7d339591c378275876fe1b9ee494f0725b5", + "mean": 0.04340391606092453, + "std": 2.770984649658203, + "rms": 2.771324634552002, + "max_abs": 109.0 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a6028d6c6f486e6d1c4326c2261c6048f933c7b5cdbdb59481afef305fca908e", + "mean": 0.012184926308691502, + "std": 6.489821434020996, + "rms": 6.489832878112793, + "max_abs": 840.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9ad1082327414e69c835bc08103afc66ba6115add1f74780a18bfa41ba1fced7", + "mean": 0.04132107272744179, + "std": 2.7607343196868896, + "rms": 2.7610435485839844, + "max_abs": 109.0 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bd9a4f500e6c7f2a2593edd7b6ee5281f274717f358b33142ab878224b29b5d2", + "mean": 0.01583440601825714, + "std": 7.297187805175781, + "rms": 7.297204971313477, + "max_abs": 840.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "584eae2ed956bdf017f960261620f22c5a94b3039a177395b53ec8a11a958ed6", + "mean": 0.04181341081857681, + "std": 2.76908540725708, + "rms": 2.7694010734558105, + "max_abs": 108.5 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3e4e21423626ecdd801c6fd537713e58ade831d0fc09b4c448110f4f23cade48", + "mean": 0.012446675449609756, + "std": 6.483186721801758, + "rms": 6.483199119567871, + "max_abs": 840.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9969654083251953, + "min_cosine_similarity": 0.9870638847351074, + "mean_relative_l2": 0.07432503998279572, + "max_abs_delta": 2.1875 + }, + "system_bos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9953428506851196, + "min_cosine_similarity": 0.987389326095581, + "mean_relative_l2": 0.09411390125751495, + "max_abs_delta": 2.0 + }, + "system_x": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9901095628738403, + "min_cosine_similarity": 0.9569725394248962, + "mean_relative_l2": 0.1316339075565338, + "max_abs_delta": 9.5 + }, + "system_period": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9892281293869019, + "min_cosine_similarity": 0.9670544266700745, + "mean_relative_l2": 0.14144392311573029, + "max_abs_delta": 6.875 + }, + "bos_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9955539107322693, + "min_cosine_similarity": 0.990178108215332, + "mean_relative_l2": 0.09324650466442108, + "max_abs_delta": 5.0 + }, + "bos_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9946509599685669, + "min_cosine_similarity": 0.9860451221466064, + "mean_relative_l2": 0.10077051818370819, + "max_abs_delta": 5.0 + }, + "x_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9945225119590759, + "min_cosine_similarity": 0.9867492914199829, + "mean_relative_l2": 0.10118307173252106, + "max_abs_delta": 3.0 + }, + "x_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9876123666763306, + "min_cosine_similarity": 0.9511909484863281, + "mean_relative_l2": 0.14581307768821716, + "max_abs_delta": 11.625 + }, + "period_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9948537945747375, + "min_cosine_similarity": 0.9896106719970703, + "mean_relative_l2": 0.09932544082403183, + "max_abs_delta": 5.0 + }, + "period_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9871495366096497, + "min_cosine_similarity": 0.9559930562973022, + "mean_relative_l2": 0.15159934759140015, + "max_abs_delta": 8.4375 + } + } + }, + "layer_25": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8783ee6ee7f85dd0ca7f7b2cd27268528b2c2d12c75ed99eddce41b5140b07fb", + "mean": 0.06955074518918991, + "std": 3.6574132442474365, + "rms": 3.6580746173858643, + "max_abs": 156.0 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e8de00450a2a6aa1c219fa2e0d58b0002daefcca1cbee234671fbc8108f81162", + "mean": -0.0011630182852968574, + "std": 8.853028297424316, + "rms": 8.853028297424316, + "max_abs": 872.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "029ad416d55e25acb04205bdd2195473879ac7d9d991636d2e127522c3b23f45", + "mean": 0.07045155763626099, + "std": 3.6763978004455566, + "rms": 3.677072763442993, + "max_abs": 157.0 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7edaf1ac726a6cec75f06ced2c9376d56d62b33f057fa6df21092c18d8172354", + "mean": -0.00717546883970499, + "std": 8.55418586730957, + "rms": 8.554187774658203, + "max_abs": 984.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0f2b6c730b960b5a8973440b60b9d1099daf5a468c03b7b879c4d0dfeb631d25", + "mean": 0.06429924815893173, + "std": 3.6166751384735107, + "rms": 3.617246627807617, + "max_abs": 158.0 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a2067eefb310c7fe60d656b453d0fd5ac073da8ed6f10fe6b0edd2442f1a6bcd", + "mean": 0.024087274447083473, + "std": 3.930788993835449, + "rms": 3.9308624267578125, + "max_abs": 248.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "03d6dd79240642b85578545a06b3f5623ed09e2ab65d74918cacc9bd12abf5a6", + "mean": 0.06702609360218048, + "std": 3.616093158721924, + "rms": 3.6167140007019043, + "max_abs": 156.0 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9e7f6f1505c445a08958e516d2fc14c04248f9514d84457b9dacf0a180c1bc0d", + "mean": 0.016846012324094772, + "std": 3.8899221420288086, + "rms": 3.889958620071411, + "max_abs": 248.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e7c86d0d5e3d115966f7b739712dfae4d62d467db6413accd8ee1e2ad5650554", + "mean": 0.06439998000860214, + "std": 3.628528594970703, + "rms": 3.6291000843048096, + "max_abs": 155.0 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "45441ede2b7b6544922fb64f232517366f02f7b8de953c37c18c6d4f41006c59", + "mean": 0.022476786747574806, + "std": 3.973752975463867, + "rms": 3.9738166332244873, + "max_abs": 248.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ece563f8c831ccf9930a625b6054286985223c6da2bba75b1f04d0e8530271c6", + "mean": 0.06476704031229019, + "std": 3.631957530975342, + "rms": 3.632534980773926, + "max_abs": 157.0 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "22c1c927222e8aad80d58766e94d490e12c11ee067493d707df6e7411170a923", + "mean": 0.014939291402697563, + "std": 3.9338912963867188, + "rms": 3.933919668197632, + "max_abs": 248.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8ed74962dcebcf87f63354ab7b2edb56af3725a99d797beaacd9fe27d015dcbe", + "mean": 0.0650387555360794, + "std": 3.620115041732788, + "rms": 3.620698928833008, + "max_abs": 155.0 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2be30b23c4103930ab4b4665c6b8852914011fb57f287b0e8673240d9d4b20f5", + "mean": 0.023822128772735596, + "std": 3.9473414421081543, + "rms": 3.947413206100464, + "max_abs": 248.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "40abc98e968b414a438ca5aa7e378ee60e6f104f721b33daadb7a60b7e2d5e6d", + "mean": 0.06281330436468124, + "std": 3.6248042583465576, + "rms": 3.6253483295440674, + "max_abs": 156.0 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "763abe3a514336adce810e7da21ad3c337757ae832f0880dab9984f031b766ca", + "mean": 0.015318743884563446, + "std": 3.9115169048309326, + "rms": 3.9115471839904785, + "max_abs": 248.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9977721571922302, + "min_cosine_similarity": 0.9906963109970093, + "mean_relative_l2": 0.06441503018140793, + "max_abs_delta": 3.0 + }, + "system_bos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9966180324554443, + "min_cosine_similarity": 0.9916992783546448, + "mean_relative_l2": 0.08072862774133682, + "max_abs_delta": 4.0 + }, + "system_x": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9926460981369019, + "min_cosine_similarity": 0.9672124981880188, + "mean_relative_l2": 0.11495321989059448, + "max_abs_delta": 13.78125 + }, + "system_period": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9920728802680969, + "min_cosine_similarity": 0.9782775640487671, + "mean_relative_l2": 0.12259449809789658, + "max_abs_delta": 10.4375 + }, + "bos_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9967475533485413, + "min_cosine_similarity": 0.9920996427536011, + "mean_relative_l2": 0.08068165928125381, + "max_abs_delta": 9.5 + }, + "bos_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.99607914686203, + "min_cosine_similarity": 0.9890164732933044, + "mean_relative_l2": 0.08758086711168289, + "max_abs_delta": 8.0 + }, + "x_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9959995150566101, + "min_cosine_similarity": 0.9903802871704102, + "mean_relative_l2": 0.08735201507806778, + "max_abs_delta": 5.0 + }, + "x_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9907159209251404, + "min_cosine_similarity": 0.9610894322395325, + "mean_relative_l2": 0.1270739585161209, + "max_abs_delta": 17.375 + }, + "period_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9962617754936218, + "min_cosine_similarity": 0.9923008680343628, + "mean_relative_l2": 0.08522310853004456, + "max_abs_delta": 7.0 + }, + "period_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9905380010604858, + "min_cosine_similarity": 0.9702848792076111, + "mean_relative_l2": 0.13135720789432526, + "max_abs_delta": 11.125 + } + } + }, + "layer_26": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "627d361b54676fad14cadbabf36489510bac4e47ae49cd75d919e9b8f35c0091", + "mean": 0.1130107194185257, + "std": 5.471853256225586, + "rms": 5.473020076751709, + "max_abs": 288.0 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0b5c4bbc6e3eb1a25ef94735041514d92fc2bc5738966efea60ac57552145d34", + "mean": 0.005378350615501404, + "std": 9.381560325622559, + "rms": 9.381562232971191, + "max_abs": 840.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c2bf8093a2427df8b953bf68f7118b1891fa62189816ecc00af2509e315bd1e8", + "mean": 0.11275100708007812, + "std": 5.440300941467285, + "rms": 5.441469192504883, + "max_abs": 288.0 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "97ea5d62c07ecd27ce6f0f3af793d0bc67ebb216b59154c39342e66afd78f323", + "mean": 0.00422183983027935, + "std": 9.05623722076416, + "rms": 9.056238174438477, + "max_abs": 868.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "116c7ebd4c377aa5450fc6c12959a23fd576a30b726d0d0a4160b8b285b2a7d9", + "mean": 0.10606784373521805, + "std": 5.357783794403076, + "rms": 5.358833312988281, + "max_abs": 280.0 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "08210ab274fbbe149c8cb44874dbbd31c04390f876076f6cfac39cce2f94596e", + "mean": 0.033420298248529434, + "std": 5.824936389923096, + "rms": 5.825032711029053, + "max_abs": 768.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9d13b84ce670a2e2efadc304167e76a296607871dee474115d316378ec145eee", + "mean": 0.10866879671812057, + "std": 5.269357681274414, + "rms": 5.270478248596191, + "max_abs": 278.0 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4e907067cf40b4ae2d0fb289758c11d1c0cf147183411ad9cebaa407db3674e2", + "mean": 0.031157108023762703, + "std": 5.740190505981445, + "rms": 5.740274906158447, + "max_abs": 768.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5e82d98b84fa821c409190be62c613c1697eaa0ee13a71eccb5b7a9c4889db14", + "mean": 0.10355669260025024, + "std": 5.4045491218566895, + "rms": 5.405540943145752, + "max_abs": 290.0 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0e79f37a26c2fc871e3704a64b1563d06eb9ac591811b4b5cf94c0190f008c89", + "mean": 0.02986634336411953, + "std": 5.897899150848389, + "rms": 5.897974967956543, + "max_abs": 768.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7e9908fcfe00727e299402c26a5a4e0c4493c7263df0eb50c153b502afb6d3ff", + "mean": 0.09653831273317337, + "std": 5.139354228973389, + "rms": 5.140260219573975, + "max_abs": 272.0 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "43965001748bb42ca565ee9a59f34f1ed73518be75144376a8a235bc7df1bebf", + "mean": 0.025751883164048195, + "std": 5.728518486022949, + "rms": 5.72857666015625, + "max_abs": 768.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d5d5032996fd8dd55f343ecf0bbc792de4296cda4e023ccd0cac78879622fda0", + "mean": 0.10558684170246124, + "std": 5.391852378845215, + "rms": 5.392886161804199, + "max_abs": 290.0 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6fb75e0f537b0ebbb614be618f0dd48712e52db2d2629ea573837e9f595497d9", + "mean": 0.03223250061273575, + "std": 5.852149486541748, + "rms": 5.852238178253174, + "max_abs": 768.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1d1e05125fab5c2e7b7c3d3b4a0faff46df072aaecd3b2049e6517cd7ea2cf26", + "mean": 0.09470083564519882, + "std": 5.096309185028076, + "rms": 5.097188949584961, + "max_abs": 280.0 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fd24ebc05dca26a7fb4b2cd3725d8de84d3f2730d819c25befb5e3902a221d31", + "mean": 0.02588643692433834, + "std": 5.662508010864258, + "rms": 5.662567138671875, + "max_abs": 768.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.998633086681366, + "min_cosine_similarity": 0.9930298328399658, + "mean_relative_l2": 0.051636241376399994, + "max_abs_delta": 8.0 + }, + "system_bos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9979479312896729, + "min_cosine_similarity": 0.9946970343589783, + "mean_relative_l2": 0.06581229716539383, + "max_abs_delta": 15.0 + }, + "system_x": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.995050847530365, + "min_cosine_similarity": 0.9753198623657227, + "mean_relative_l2": 0.10580552369356155, + "max_abs_delta": 38.0 + }, + "system_period": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9947282671928406, + "min_cosine_similarity": 0.9889129996299744, + "mean_relative_l2": 0.11337504535913467, + "max_abs_delta": 39.0 + }, + "bos_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9980042576789856, + "min_cosine_similarity": 0.9935212731361389, + "mean_relative_l2": 0.06891627609729767, + "max_abs_delta": 24.0 + }, + "bos_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9975277185440063, + "min_cosine_similarity": 0.9905849695205688, + "mean_relative_l2": 0.07634720206260681, + "max_abs_delta": 24.0 + }, + "x_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9974607229232788, + "min_cosine_similarity": 0.9928246736526489, + "mean_relative_l2": 0.07303421944379807, + "max_abs_delta": 14.0 + }, + "x_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9934728145599365, + "min_cosine_similarity": 0.9702041149139404, + "mean_relative_l2": 0.11914754658937454, + "max_abs_delta": 35.0 + }, + "period_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9976851344108582, + "min_cosine_similarity": 0.994174599647522, + "mean_relative_l2": 0.07028674334287643, + "max_abs_delta": 15.0 + }, + "period_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9934111833572388, + "min_cosine_similarity": 0.978962779045105, + "mean_relative_l2": 0.12578707933425903, + "max_abs_delta": 44.0 + } + } + }, + "final_norm": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ef53f0651afd009c5039fe583e102ac6108c6cc75c65afce2fc69525b9db978e", + "mean": 0.007462242152541876, + "std": 0.45857658982276917, + "rms": 0.4586372971534729, + "max_abs": 15.9375 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5cab333b1db8978d75fde8f9a6bbda3ea9c17f7c538f4e78ed77478e9f2c5307", + "mean": 0.0015558841405436397, + "std": 0.5348668098449707, + "rms": 0.5348690748214722, + "max_abs": 21.75 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c9b96240a5c72fea7914b5d974a81cca237fa99ac7530f466cf23e86a70f5981", + "mean": 0.007385430857539177, + "std": 0.46004313230514526, + "rms": 0.4601024091243744, + "max_abs": 15.9375 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "87ec6da3d03fdebf14e2bc1c6b8ff1af88a9210e50c2e29d94d4fcad451c44b7", + "mean": 0.002263942500576377, + "std": 0.5237900614738464, + "rms": 0.5237950086593628, + "max_abs": 21.625 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "369aaf3a985fc72c7410a33a3fb22756121847a2356c56ff510fd3306f0a1204", + "mean": 0.006771194748580456, + "std": 0.4617672264575958, + "rms": 0.4618168771266937, + "max_abs": 15.9375 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c4e814cbbd1a1ee88cf35027a43a3ed4bc139dd7caba2ea2e2e908673732fc55", + "mean": 0.0017152201617136598, + "std": 0.5366156697273254, + "rms": 0.5366184115409851, + "max_abs": 21.375 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6e01a3d7ee54f1253e574f0c2aa4dc1cc8c914fb075149b8182ca9fca1c1cac8", + "mean": 0.007278452627360821, + "std": 0.4640219807624817, + "rms": 0.4640790820121765, + "max_abs": 15.9375 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "48b61bab0870166d2c7a6ed6e1f495ff5c658dcd68406cb07127632c0e275241", + "mean": 0.0027536973357200623, + "std": 0.5234227180480957, + "rms": 0.5234299302101135, + "max_abs": 22.375 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f3dd0a66dd6f3c7ffe5fa663cefbd8b712a718c9d6a4deb870f3e28e7b68458e", + "mean": 0.006522531155496836, + "std": 0.4609347879886627, + "rms": 0.46098095178604126, + "max_abs": 16.0 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "505bd87dde5b3f6c62890430a9751cd43d45074c03b91526e8a5c5fb4e9f20aa", + "mean": 0.0014811625005677342, + "std": 0.5300421714782715, + "rms": 0.5300442576408386, + "max_abs": 19.75 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b6c78302495a7b655cef8cf059ce24b017de94347f45cb499a5da04f383927cd", + "mean": 0.006314275786280632, + "std": 0.47081458568573, + "rms": 0.4708569645881653, + "max_abs": 15.75 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "19eee6741f859488e7746eaa25154f072de448f192bb5ac03ad300c21fa9ef83", + "mean": 0.0023288477677851915, + "std": 0.5195135474205017, + "rms": 0.5195187330245972, + "max_abs": 17.5 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0d650d6311d9326da6310f0cf178804fa73a23cfb0aa62f6df43550fedc33ec3", + "mean": 0.006858923938125372, + "std": 0.4608153998851776, + "rms": 0.46086642146110535, + "max_abs": 16.0 + }, + "full_input": { + "shape": [ + 48, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e6068d43b82be44156ecdfdfe5b8724201ab3e397dcb4ef6b5ac06ead144b04f", + "mean": 0.0016236299416050315, + "std": 0.5357980132102966, + "rms": 0.5358004570007324, + "max_abs": 19.625 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 23, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "98ae8b9c9e79b6dab4ec898729372dc6b6410becf787deb69efa12320135d96d", + "mean": 0.006082025356590748, + "std": 0.4720832407474518, + "rms": 0.4721224009990692, + "max_abs": 15.75 + }, + "full_input": { + "shape": [ + 64, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d35437323bdc4ebe9a13ecfd63d3f3235aaa592f1c76993174fa03a2ed1978f3", + "mean": 0.002356641460210085, + "std": 0.5256547331809998, + "rms": 0.52565997838974, + "max_abs": 17.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9966275691986084, + "min_cosine_similarity": 0.9850592613220215, + "mean_relative_l2": 0.07857654243707657, + "max_abs_delta": 0.640625 + }, + "system_bos": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9949823617935181, + "min_cosine_similarity": 0.9891087412834167, + "mean_relative_l2": 0.0984264463186264, + "max_abs_delta": 0.8125 + }, + "system_x": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9884371757507324, + "min_cosine_similarity": 0.953206479549408, + "mean_relative_l2": 0.14642536640167236, + "max_abs_delta": 1.90625 + }, + "system_period": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9874804019927979, + "min_cosine_similarity": 0.9683674573898315, + "mean_relative_l2": 0.15697523951530457, + "max_abs_delta": 2.21875 + }, + "bos_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9953013062477112, + "min_cosine_similarity": 0.9873205423355103, + "mean_relative_l2": 0.09505096822977066, + "max_abs_delta": 0.69921875 + }, + "bos_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9940099120140076, + "min_cosine_similarity": 0.9811449646949768, + "mean_relative_l2": 0.10733434557914734, + "max_abs_delta": 1.1328125 + }, + "x_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9937101602554321, + "min_cosine_similarity": 0.9848225712776184, + "mean_relative_l2": 0.10861997306346893, + "max_abs_delta": 0.921875 + }, + "x_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9845002293586731, + "min_cosine_similarity": 0.9418976902961731, + "mean_relative_l2": 0.16818590462207794, + "max_abs_delta": 1.953125 + }, + "period_at_s0": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9942628741264343, + "min_cosine_similarity": 0.9874402284622192, + "mean_relative_l2": 0.10486739873886108, + "max_abs_delta": 0.765625 + }, + "period_at_s1": { + "tokens": 23, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9846042990684509, + "min_cosine_similarity": 0.9567512273788452, + "mean_relative_l2": 0.17140750586986542, + "max_abs_delta": 2.1875 + } + } + } + }, + "router_layers": { + "layer_01": { + "layer": 1, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "71a22404aacaefb1a3d9928b776bbff989ca223c74bcd982fad3d756d69530b5", + "route_weight_sha256": "753bb6face43fcdf5718c617944ea1b86be97079277cbe4b86c9742a3a2318bf", + "loads": [ + 2, + 3, + 1, + 1, + 3, + 2, + 3, + 2, + 11, + 2, + 2, + 0, + 4, + 1, + 1, + 0, + 4, + 1, + 3, + 2, + 2, + 3, + 3, + 2, + 1, + 2, + 0, + 1, + 1, + 3, + 2, + 2, + 0, + 1, + 3, + 4, + 2, + 2, + 4, + 1, + 3, + 0, + 1, + 5, + 2, + 0, + 2, + 0, + 3, + 1, + 2, + 2, + 3, + 5, + 3, + 3, + 0, + 1, + 4, + 0, + 3, + 3, + 3, + 2 + ], + "weighted_loads": [ + 0.09433590434491634, + 0.2546806298196316, + 0.07825610041618347, + 0.026308150961995125, + 0.1759638898074627, + 0.08868807554244995, + 0.09533102065324783, + 0.10141986981034279, + 0.6854586824774742, + 0.10749574564397335, + 0.2134908065199852, + 0.0, + 0.09523964114487171, + 0.03740852698683739, + 0.026112904772162437, + 0.0, + 0.2791384197771549, + 0.0325232669711113, + 0.19137278944253922, + 0.19150415062904358, + 0.14529858529567719, + 0.24774659052491188, + 0.25104475021362305, + 0.12248501926660538, + 0.12002387642860413, + 0.16786619275808334, + 0.0, + 0.055629339069128036, + 0.027309555560350418, + 0.16294223442673683, + 0.189100444316864, + 0.17986617982387543, + 0.0, + 0.024377087131142616, + 0.31756654381752014, + 0.3166407160460949, + 0.07938827574253082, + 0.11488250643014908, + 0.1489551030099392, + 0.08079886436462402, + 0.16808103397488594, + 0.0, + 0.054304949939250946, + 0.364258598536253, + 0.20178265869617462, + 0.0, + 0.12513539008796215, + 0.0, + 0.2418638840317726, + 0.05610273778438568, + 0.11745006591081619, + 0.2916058152914047, + 0.14165556989610195, + 0.2706458494067192, + 0.07425162009894848, + 0.22227578982710838, + 0.0, + 0.02538008987903595, + 0.29755232855677605, + 0.0, + 0.21314799413084984, + 0.23885449394583702, + 0.15560892969369888, + 0.2612123638391495 + ], + "unique_experts": 55, + "load_cv": 0.7830111686515999, + "normalized_load_entropy": 0.9270835099600097, + "max_load_share": 0.07971014492753623 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "26f300fa34116d5ff897a85d8d46afe5f31d431e43fad005c19de662b43ab0d8", + "route_weight_sha256": "b4d5020e96440977c8233af141ca8560824f3bf40385bc5b7efb079d24ccfd0d", + "loads": [ + 3, + 3, + 3, + 1, + 5, + 2, + 4, + 4, + 32, + 2, + 4, + 0, + 4, + 1, + 1, + 9, + 4, + 2, + 3, + 2, + 6, + 3, + 4, + 2, + 1, + 6, + 15, + 2, + 1, + 3, + 2, + 7, + 1, + 3, + 3, + 4, + 2, + 2, + 4, + 4, + 4, + 10, + 1, + 10, + 3, + 11, + 2, + 0, + 3, + 1, + 5, + 3, + 7, + 5, + 7, + 7, + 4, + 10, + 4, + 11, + 4, + 7, + 3, + 2 + ], + "weighted_loads": [ + 0.17014929465949535, + 0.2546806298196316, + 0.18118469417095184, + 0.026308150961995125, + 0.2276587300002575, + 0.08868807554244995, + 0.15742835402488708, + 0.36956363543868065, + 2.038323387503624, + 0.10749574564397335, + 0.41031303256750107, + 0.0, + 0.09523964114487171, + 0.03740852698683739, + 0.026112904772162437, + 0.6168637052178383, + 0.2791384197771549, + 0.1036996990442276, + 0.19137278944253922, + 0.19150415062904358, + 0.5647720526903868, + 0.24774659052491188, + 0.28130258806049824, + 0.12248501926660538, + 0.12002387642860413, + 0.3197630774229765, + 0.9809153415262699, + 0.12792407348752022, + 0.027309555560350418, + 0.16294223442673683, + 0.189100444316864, + 0.5827240464277565, + 0.061951857060194016, + 0.22123355604708195, + 0.31756654381752014, + 0.3166407160460949, + 0.07938827574253082, + 0.11488250643014908, + 0.1489551030099392, + 0.29948268458247185, + 0.20993399620056152, + 0.41219351068139076, + 0.054304949939250946, + 0.47360340497107245, + 1.186170056462288, + 0.8194496049545705, + 0.12513539008796215, + 0.0, + 0.2418638840317726, + 0.05610273778438568, + 0.28455821983516216, + 0.29221049934858456, + 0.41210112906992435, + 0.2706458494067192, + 0.13980419258587062, + 0.717837754637003, + 0.3154465854167938, + 0.5467890743166208, + 0.29755232855677605, + 0.7171039134263992, + 0.3040587417781353, + 0.43115557730197906, + 0.15560892969369888, + 0.2612123638391495 + ], + "unique_experts": 62, + "load_cv": 1.0153148268053926, + "normalized_load_entropy": 0.9160161078019062, + "max_load_share": 0.1111111111111111 + } + }, + "s1_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "4e659b35f36c7366dea5cbc0cf9c4191b8b57db2ba8702d48ea57d36b4bbc1e3", + "route_weight_sha256": "4277a3485a7ec371fc765269476b2bf5ad9735adcf7204e906af1b91bc9d6f72", + "loads": [ + 2, + 3, + 1, + 1, + 3, + 2, + 1, + 2, + 12, + 2, + 2, + 0, + 4, + 1, + 1, + 0, + 4, + 0, + 3, + 2, + 2, + 3, + 3, + 2, + 1, + 2, + 0, + 1, + 0, + 3, + 3, + 2, + 0, + 1, + 3, + 4, + 2, + 2, + 4, + 1, + 3, + 0, + 1, + 5, + 2, + 0, + 2, + 2, + 3, + 1, + 2, + 2, + 3, + 5, + 2, + 3, + 0, + 1, + 4, + 0, + 3, + 3, + 3, + 3 + ], + "weighted_loads": [ + 0.09286493994295597, + 0.2705555483698845, + 0.07930056005716324, + 0.026825720444321632, + 0.1740708127617836, + 0.08602986484766006, + 0.03940999507904053, + 0.1029872726649046, + 0.6805675644427538, + 0.1074866522103548, + 0.21413037925958633, + 0.0, + 0.09466711059212685, + 0.03842180222272873, + 0.02721100114285946, + 0.0, + 0.2814406789839268, + 0.0, + 0.18320581875741482, + 0.19501687586307526, + 0.14758488908410072, + 0.24069003760814667, + 0.25443974882364273, + 0.12369125336408615, + 0.11162097007036209, + 0.16926566883921623, + 0.0, + 0.05560743436217308, + 0.0, + 0.16749276593327522, + 0.221845380961895, + 0.17598162591457367, + 0.0, + 0.02272041328251362, + 0.32193778455257416, + 0.31814053282141685, + 0.08109158277511597, + 0.1172918863594532, + 0.14772124215960503, + 0.07854285836219788, + 0.1718565821647644, + 0.0, + 0.05426666513085365, + 0.36963099613785744, + 0.2045566886663437, + 0.0, + 0.12614803947508335, + 0.05315581522881985, + 0.2437148243188858, + 0.057935234159231186, + 0.11898557841777802, + 0.2827530801296234, + 0.14944525249302387, + 0.2658267691731453, + 0.05367644689977169, + 0.21837996318936348, + 0.0, + 0.025337252765893936, + 0.3046653997153044, + 0.0, + 0.21293867751955986, + 0.2377024032175541, + 0.15584716945886612, + 0.2846197709441185 + ], + "unique_experts": 54, + "load_cv": 0.828879085091525, + "normalized_load_entropy": 0.9210861643034354, + "max_load_share": 0.08695652173913043 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "734140e611f4e578680f2f7629c4c325027893c2f00ac37325012d18ae3cfcb2", + "route_weight_sha256": "b82fa52005cca8e7e451c579edc807a0efcda5b5c52b6211ece59d0bfce22cd1", + "loads": [ + 5, + 3, + 4, + 2, + 8, + 4, + 2, + 5, + 39, + 2, + 7, + 1, + 4, + 2, + 1, + 12, + 4, + 5, + 4, + 3, + 5, + 5, + 8, + 3, + 3, + 7, + 21, + 3, + 0, + 5, + 4, + 9, + 1, + 3, + 3, + 4, + 3, + 3, + 4, + 6, + 4, + 12, + 4, + 11, + 4, + 11, + 2, + 5, + 5, + 1, + 11, + 6, + 8, + 5, + 8, + 7, + 10, + 13, + 6, + 11, + 5, + 8, + 3, + 7 + ], + "weighted_loads": [ + 0.2865029852837324, + 0.2705555483698845, + 0.24464313313364983, + 0.04540368914604187, + 0.4643522445112467, + 0.2229563593864441, + 0.0848071463406086, + 0.3403214383870363, + 2.3968724571168423, + 0.1074866522103548, + 0.6057947613298893, + 0.14657524228096008, + 0.09466711059212685, + 0.07820681110024452, + 0.02721100114285946, + 0.7053214572370052, + 0.2814406789839268, + 0.20131995156407356, + 0.22287842072546482, + 0.260957732796669, + 0.5060816816985607, + 0.4463416337966919, + 0.525808020553086, + 0.158194862306118, + 0.18312089890241623, + 0.3484345842152834, + 1.435406630858779, + 0.15050657093524933, + 0.0, + 0.32926497980952263, + 0.30768150836229324, + 0.7972816087421961, + 0.04952254146337509, + 0.17241075821220875, + 0.32193778455257416, + 0.31814053282141685, + 0.33969855308532715, + 0.15135427191853523, + 0.14772124215960503, + 0.41685042902827263, + 0.21426275745034218, + 0.5749254897236824, + 0.261983260512352, + 0.5676651578396559, + 1.3467459976673126, + 0.771188712969888, + 0.12614803947508335, + 0.13555785629432648, + 0.39438315108418465, + 0.057935234159231186, + 0.592282097786665, + 0.646868422627449, + 0.4850053321570158, + 0.2658267691731453, + 0.16804014914669096, + 0.6940876431763172, + 0.4706956446170807, + 0.7533374167978764, + 0.37966602854430676, + 0.6704141497612, + 0.3288474064320326, + 0.522229265421629, + 0.15584716945886612, + 0.7756776809692383 + ], + "unique_experts": 63, + "load_cv": 0.9185586535436917, + "normalized_load_entropy": 0.9302809425917139, + "max_load_share": 0.1015625 + } + }, + "s0_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "5e6588bd90c1bfbcd921933e8dd44615adbc90b678cc6746b7fe9d4f09f9a069", + "route_weight_sha256": "42f68b25a56cd6f31e0c43fe3488a77b5d64b230dce2484e24f15bc8a6a29319", + "loads": [ + 2, + 2, + 1, + 1, + 3, + 2, + 2, + 1, + 8, + 2, + 2, + 1, + 2, + 1, + 0, + 0, + 4, + 3, + 4, + 2, + 2, + 3, + 3, + 2, + 1, + 2, + 0, + 1, + 1, + 2, + 4, + 2, + 0, + 2, + 3, + 4, + 2, + 2, + 4, + 2, + 3, + 0, + 1, + 5, + 2, + 0, + 2, + 0, + 3, + 1, + 2, + 2, + 3, + 5, + 3, + 4, + 1, + 0, + 3, + 0, + 3, + 5, + 3, + 2 + ], + "weighted_loads": [ + 0.1075575090944767, + 0.19783476367592812, + 0.0900469496846199, + 0.029978018254041672, + 0.19088846817612648, + 0.08657288178801537, + 0.062056850641965866, + 0.08269906044006348, + 0.34272334910929203, + 0.12413271516561508, + 0.205854170024395, + 0.039488598704338074, + 0.05329235829412937, + 0.03814376890659332, + 0.0, + 0.0, + 0.272690586745739, + 0.09626801870763302, + 0.21255218051373959, + 0.19357116520404816, + 0.144700787961483, + 0.24010781943798065, + 0.24548720568418503, + 0.123350128531456, + 0.11230133473873138, + 0.1800428107380867, + 0.0, + 0.06576992571353912, + 0.028246048837900162, + 0.11350968480110168, + 0.2369874306023121, + 0.1756828874349594, + 0.0, + 0.062115978449583054, + 0.32540521025657654, + 0.2952378988265991, + 0.07851377129554749, + 0.11117279529571533, + 0.15186394937336445, + 0.10458793118596077, + 0.12472405284643173, + 0.0, + 0.055296462029218674, + 0.3701018802821636, + 0.20672797411680222, + 0.0, + 0.12499263510107994, + 0.0, + 0.241045281291008, + 0.05804118514060974, + 0.12262174114584923, + 0.31265440583229065, + 0.13295306637883186, + 0.27807723730802536, + 0.08799737133085728, + 0.2546478994190693, + 0.027405457571148872, + 0.0, + 0.25157878547906876, + 0.0, + 0.18823914229869843, + 0.2771160714328289, + 0.16624785959720612, + 0.2560385465621948 + ], + "unique_experts": 55, + "load_cv": 0.6967081357519951, + "normalized_load_entropy": 0.9336821299349222, + "max_load_share": 0.057971014492753624 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "ed90d6297d9123142a707c59bf571f0a3a4fe026d160d52e15ae31d438941fe6", + "route_weight_sha256": "292c9831f3cc572f4274c5dae070919604190dbb827c5a4532f99b49ceabf4d0", + "loads": [ + 4, + 2, + 3, + 1, + 5, + 2, + 4, + 3, + 26, + 2, + 4, + 3, + 2, + 1, + 0, + 9, + 4, + 5, + 6, + 2, + 5, + 3, + 4, + 2, + 1, + 6, + 13, + 2, + 1, + 2, + 4, + 6, + 1, + 4, + 3, + 4, + 2, + 2, + 4, + 5, + 3, + 10, + 2, + 10, + 2, + 10, + 3, + 0, + 3, + 1, + 6, + 2, + 7, + 5, + 6, + 8, + 5, + 10, + 3, + 11, + 5, + 9, + 3, + 2 + ], + "weighted_loads": [ + 0.22337369434535503, + 0.19783476367592812, + 0.17523034289479256, + 0.029978018254041672, + 0.24258330836892128, + 0.08657288178801537, + 0.16690856963396072, + 0.34277570247650146, + 1.3813239205628633, + 0.12413271516561508, + 0.3970671445131302, + 0.09145541116595268, + 0.05329235829412937, + 0.03814376890659332, + 0.0, + 0.6168637052178383, + 0.272690586745739, + 0.20215796120464802, + 0.25937285274267197, + 0.19357116520404816, + 0.4786475971341133, + 0.24010781943798065, + 0.2757450435310602, + 0.123350128531456, + 0.11230133473873138, + 0.34229138121008873, + 0.8615994993597269, + 0.12828148156404495, + 0.028246048837900162, + 0.11350968480110168, + 0.2369874306023121, + 0.612709753215313, + 0.061951857060194016, + 0.27914540097117424, + 0.32540521025657654, + 0.2952378988265991, + 0.07851377129554749, + 0.11117279529571533, + 0.15186394937336445, + 0.33270353078842163, + 0.12472405284643173, + 0.41219351068139076, + 0.09807907417416573, + 0.5045867189764977, + 0.20672797411680222, + 0.8189453780651093, + 0.15112977847456932, + 0.0, + 0.241045281291008, + 0.05804118514060974, + 0.3115877714008093, + 0.31265440583229065, + 0.3902895897626877, + 0.27807723730802536, + 0.157827228307724, + 0.7671247906982899, + 0.36850867234170437, + 0.5917304828763008, + 0.25157878547906876, + 0.7025034092366695, + 0.38402753323316574, + 0.4786189906299114, + 0.16624785959720612, + 0.2560385465621948 + ], + "unique_experts": 62, + "load_cv": 0.8766518798921944, + "normalized_load_entropy": 0.9285966504413699, + "max_load_share": 0.09027777777777778 + } + }, + "s1_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "7c6ecf3535f6d22840c8a5f79cbe92873ed55891d304699a6bc740ccbee3569a", + "route_weight_sha256": "b0e3e6f53b43c8ddbd8cd568dc5eeef0b05ecfe8f0e9802addde9064c9eae198", + "loads": [ + 2, + 3, + 1, + 1, + 3, + 2, + 1, + 2, + 6, + 2, + 2, + 1, + 2, + 1, + 0, + 0, + 4, + 3, + 3, + 2, + 2, + 3, + 3, + 2, + 1, + 2, + 0, + 1, + 1, + 2, + 4, + 2, + 0, + 2, + 3, + 4, + 2, + 2, + 4, + 2, + 3, + 0, + 1, + 6, + 2, + 0, + 2, + 0, + 3, + 1, + 2, + 2, + 3, + 5, + 3, + 4, + 0, + 0, + 3, + 0, + 4, + 5, + 3, + 3 + ], + "weighted_loads": [ + 0.09935312531888485, + 0.2308239694684744, + 0.0886809378862381, + 0.029875831678509712, + 0.18407994881272316, + 0.09603888913989067, + 0.03449026495218277, + 0.10359744913876057, + 0.21154941618442535, + 0.1213006041944027, + 0.1994539201259613, + 0.0391293466091156, + 0.05266907997429371, + 0.037233565002679825, + 0.0, + 0.0, + 0.2852003239095211, + 0.09205244667828083, + 0.18860898353159428, + 0.1902443692088127, + 0.14572251588106155, + 0.25176042690873146, + 0.2549409940838814, + 0.12069838494062424, + 0.10502369701862335, + 0.1835903413593769, + 0.0, + 0.06973736733198166, + 0.028480714187026024, + 0.1184241846203804, + 0.24295484647154808, + 0.17762859910726547, + 0.0, + 0.05511602759361267, + 0.3270460441708565, + 0.29497305676341057, + 0.08019087091088295, + 0.10490773618221283, + 0.15364099107682705, + 0.10466975905001163, + 0.12270615249872208, + 0.0, + 0.05341552942991257, + 0.40089418552815914, + 0.21074844151735306, + 0.0, + 0.13100357726216316, + 0.0, + 0.24905355274677277, + 0.059330299496650696, + 0.12381047382950783, + 0.3171430677175522, + 0.13602663949131966, + 0.28085245564579964, + 0.08901514858007431, + 0.2675881516188383, + 0.0, + 0.0, + 0.24051625654101372, + 0.0, + 0.2216679658740759, + 0.276383213698864, + 0.16928959637880325, + 0.2729894518852234 + ], + "unique_experts": 54, + "load_cv": 0.6771389209405023, + "normalized_load_entropy": 0.9325713998159074, + "max_load_share": 0.043478260869565216 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "87a4b974007e6867ab9a8edc62ec286be79777fd4c98a068eed2366afdf6177f", + "route_weight_sha256": "33d54929b1967a1996da3e590842126231aab1abf8746117c6f0d43cf4293e3a", + "loads": [ + 6, + 3, + 4, + 2, + 8, + 4, + 2, + 5, + 30, + 2, + 7, + 2, + 2, + 3, + 0, + 12, + 4, + 8, + 6, + 3, + 5, + 5, + 7, + 3, + 3, + 7, + 19, + 3, + 1, + 4, + 5, + 8, + 2, + 4, + 4, + 4, + 3, + 3, + 4, + 7, + 3, + 12, + 5, + 12, + 3, + 10, + 3, + 2, + 5, + 1, + 11, + 6, + 8, + 5, + 9, + 8, + 10, + 15, + 5, + 10, + 7, + 10, + 3, + 7 + ], + "weighted_loads": [ + 0.33123321644961834, + 0.2308239694684744, + 0.24035117775201797, + 0.061604032292962074, + 0.47436138056218624, + 0.2329653836786747, + 0.07988741621375084, + 0.33197337202727795, + 1.599878452718258, + 0.1213006041944027, + 0.5830733589828014, + 0.18570458889007568, + 0.05266907997429371, + 0.10128556191921234, + 0.0, + 0.7053214572370052, + 0.2852003239095211, + 0.2933723982423544, + 0.27443612180650234, + 0.25618522614240646, + 0.4419655576348305, + 0.4574120230972767, + 0.5259971208870411, + 0.1552019938826561, + 0.1765236258506775, + 0.3758783955127001, + 1.318859588354826, + 0.16138863936066628, + 0.028480714187026024, + 0.2801963984966278, + 0.32879097387194633, + 0.8335800841450691, + 0.0906713530421257, + 0.22711680829524994, + 0.35003239288926125, + 0.29497305676341057, + 0.33879784122109413, + 0.13897012174129486, + 0.15364099107682705, + 0.45520267076790333, + 0.12270615249872208, + 0.5749254897236824, + 0.2975734882056713, + 0.5989283472299576, + 0.36395978182554245, + 0.770719937980175, + 0.1611710637807846, + 0.08208544924855232, + 0.3997218795120716, + 0.059330299496650696, + 0.5996787920594215, + 0.6812584102153778, + 0.44627371430397034, + 0.28085245564579964, + 0.2300474215298891, + 0.762418432161212, + 0.48546266555786133, + 0.8446597252041101, + 0.3155168853700161, + 0.635767474770546, + 0.43977129459381104, + 0.5697019249200821, + 0.16928959637880325, + 0.7640473619103432 + ], + "unique_experts": 63, + "load_cv": 0.7806247497997997, + "normalized_load_entropy": 0.9414982849473997, + "max_load_share": 0.078125 + } + }, + "s0_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "17472912527b384d21130d0f953ec3134510329161beb6f758ed3e0b4fc298c0", + "route_weight_sha256": "abd784ada15588360495a607a8201ad7dde06d1fddabb0cabb1f1b0a841292a3", + "loads": [ + 2, + 3, + 1, + 1, + 3, + 2, + 2, + 1, + 8, + 2, + 2, + 1, + 2, + 1, + 2, + 0, + 4, + 3, + 3, + 2, + 2, + 3, + 3, + 2, + 1, + 2, + 0, + 1, + 1, + 2, + 3, + 2, + 0, + 1, + 3, + 4, + 2, + 2, + 4, + 2, + 3, + 0, + 1, + 6, + 2, + 0, + 2, + 0, + 3, + 1, + 2, + 2, + 3, + 5, + 3, + 4, + 0, + 0, + 3, + 0, + 3, + 4, + 3, + 3 + ], + "weighted_loads": [ + 0.10495874844491482, + 0.24341630190610886, + 0.08702323585748672, + 0.029141386970877647, + 0.195013128221035, + 0.09546880051493645, + 0.07542979717254639, + 0.08115527033805847, + 0.32897730730473995, + 0.12310050800442696, + 0.20932455360889435, + 0.03730691596865654, + 0.053344851359725, + 0.04072437807917595, + 0.04846452176570892, + 0.0, + 0.2852502763271332, + 0.08917580172419548, + 0.18457291275262833, + 0.19024565815925598, + 0.1482144333422184, + 0.24425189569592476, + 0.24570278078317642, + 0.12154888734221458, + 0.12716004252433777, + 0.1779998280107975, + 0.0, + 0.06394649296998978, + 0.02804066613316536, + 0.10777206346392632, + 0.2044699788093567, + 0.17527975142002106, + 0.0, + 0.027362028136849403, + 0.3198421150445938, + 0.2972472347319126, + 0.07623928040266037, + 0.11794205009937286, + 0.1467891540378332, + 0.10390935093164444, + 0.14685989171266556, + 0.0, + 0.054726507514715195, + 0.39712776243686676, + 0.20605278760194778, + 0.0, + 0.12434577569365501, + 0.0, + 0.24372003972530365, + 0.054855022579431534, + 0.12092287093400955, + 0.3202894628047943, + 0.129772637039423, + 0.26503853499889374, + 0.09076490066945553, + 0.2574380002915859, + 0.0, + 0.0, + 0.2559031769633293, + 0.0, + 0.18979602307081223, + 0.25190475955605507, + 0.17087222635746002, + 0.2833874486386776 + ], + "unique_experts": 55, + "load_cv": 0.6918677253495659, + "normalized_load_entropy": 0.9345154100507345, + "max_load_share": 0.057971014492753624 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "97f2b7a1e2588ed59ce44294b3342f2b193429de95b14943707babdac22e36e8", + "route_weight_sha256": "e0d60052c6f46c9e219c0bf6f13f6013817ee6e78427ff3a2a4eca56ec2daef7", + "loads": [ + 3, + 3, + 3, + 1, + 5, + 2, + 4, + 4, + 27, + 3, + 4, + 2, + 2, + 1, + 2, + 10, + 4, + 4, + 5, + 2, + 5, + 3, + 5, + 2, + 1, + 6, + 15, + 2, + 1, + 2, + 3, + 6, + 1, + 3, + 3, + 4, + 2, + 2, + 4, + 5, + 3, + 11, + 1, + 11, + 2, + 11, + 2, + 0, + 3, + 1, + 6, + 2, + 7, + 5, + 6, + 8, + 3, + 8, + 3, + 11, + 4, + 8, + 3, + 3 + ], + "weighted_loads": [ + 0.19802977703511715, + 0.24341630190610886, + 0.18166637793183327, + 0.029141386970877647, + 0.2467079684138298, + 0.09546880051493645, + 0.18147002533078194, + 0.380838368088007, + 1.404638271778822, + 0.14954620227217674, + 0.39659400284290314, + 0.060840288177132607, + 0.053344851359725, + 0.04072437807917595, + 0.04846452176570892, + 0.7337626963853836, + 0.2852502763271332, + 0.16035223379731178, + 0.22866167314350605, + 0.19024565815925598, + 0.47786708548665047, + 0.24425189569592476, + 0.3067705240100622, + 0.12154888734221458, + 0.12716004252433777, + 0.3428518697619438, + 0.9379722308367491, + 0.13052330911159515, + 0.02804066613316536, + 0.10777206346392632, + 0.2044699788093567, + 0.6228737011551857, + 0.061951857060194016, + 0.24426071532070637, + 0.3198421150445938, + 0.2972472347319126, + 0.07623928040266037, + 0.11794205009937286, + 0.1467891540378332, + 0.3541005738079548, + 0.14685989171266556, + 0.46802860498428345, + 0.054726507514715195, + 0.5356546770781279, + 0.20605278760194778, + 0.8524877466261387, + 0.12434577569365501, + 0.0, + 0.24372003972530365, + 0.054855022579431534, + 0.328749580308795, + 0.3202894628047943, + 0.36324477940797806, + 0.26503853499889374, + 0.15996095538139343, + 0.7830824293196201, + 0.19278689473867416, + 0.48871649242937565, + 0.2559031769633293, + 0.7822839543223381, + 0.2807067707180977, + 0.44698256254196167, + 0.17087222635746002, + 0.2833874486386776 + ], + "unique_experts": 63, + "load_cv": 0.9170874455121765, + "normalized_load_entropy": 0.9262742791697393, + "max_load_share": 0.09375 + } + }, + "s1_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "a43e00be971b6b4dbe9712588e5747b357dda6ec7ec5c8a2f41cd42488d0369b", + "route_weight_sha256": "1bddc2171817a7092de09d3f661298631acd0b883d67ffb75cbf38836f8bfbfd", + "loads": [ + 2, + 3, + 1, + 1, + 3, + 2, + 1, + 2, + 6, + 2, + 2, + 1, + 2, + 1, + 0, + 0, + 4, + 3, + 3, + 2, + 2, + 3, + 3, + 2, + 1, + 2, + 0, + 1, + 1, + 2, + 4, + 2, + 0, + 2, + 3, + 4, + 2, + 2, + 4, + 2, + 3, + 0, + 1, + 6, + 2, + 0, + 2, + 0, + 3, + 1, + 2, + 2, + 3, + 5, + 3, + 4, + 0, + 0, + 3, + 0, + 4, + 5, + 3, + 3 + ], + "weighted_loads": [ + 0.09631487727165222, + 0.23271305114030838, + 0.08472474664449692, + 0.028774676844477654, + 0.1856527216732502, + 0.10040689259767532, + 0.037662915885448456, + 0.10301557183265686, + 0.18458281084895134, + 0.11943063512444496, + 0.19663111865520477, + 0.037890903651714325, + 0.05406524986028671, + 0.039315491914749146, + 0.0, + 0.0, + 0.2909115329384804, + 0.09036887250840664, + 0.18261247128248215, + 0.1856316402554512, + 0.14593715220689774, + 0.2544373869895935, + 0.2556144967675209, + 0.11764112114906311, + 0.10977200418710709, + 0.18289094045758247, + 0.0, + 0.06883484870195389, + 0.028645435348153114, + 0.11421775445342064, + 0.24617798067629337, + 0.1787339374423027, + 0.0, + 0.054162897169589996, + 0.3237444646656513, + 0.299819890409708, + 0.07962390035390854, + 0.10251416079699993, + 0.15181515738368034, + 0.10490051656961441, + 0.12951134145259857, + 0.0, + 0.051599979400634766, + 0.39695608988404274, + 0.21264634281396866, + 0.0, + 0.13046124204993248, + 0.0, + 0.24858631193637848, + 0.05665327608585358, + 0.12336748838424683, + 0.32189272344112396, + 0.13063553534448147, + 0.2827596813440323, + 0.08903898485004902, + 0.274679034948349, + 0.0, + 0.0, + 0.23206429556012154, + 0.0, + 0.22828924655914307, + 0.27286761440336704, + 0.17129255458712578, + 0.2691990826278925 + ], + "unique_experts": 54, + "load_cv": 0.6771389209405023, + "normalized_load_entropy": 0.9325713998159074, + "max_load_share": 0.043478260869565216 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "166af395957d003eaf7d6c0ad8fb4a4d9e0c2efb4b289d6d799d46ceee8ddc8a", + "route_weight_sha256": "be88e083c25473eeda3affe47623a840902d60d9a029cda3c201a4537453164a", + "loads": [ + 5, + 3, + 4, + 1, + 8, + 4, + 2, + 6, + 30, + 3, + 7, + 2, + 2, + 3, + 0, + 13, + 4, + 8, + 6, + 3, + 5, + 5, + 7, + 3, + 3, + 7, + 20, + 3, + 1, + 4, + 5, + 8, + 2, + 4, + 3, + 4, + 3, + 3, + 4, + 7, + 3, + 13, + 4, + 12, + 3, + 11, + 3, + 2, + 6, + 1, + 11, + 6, + 8, + 5, + 9, + 8, + 9, + 13, + 5, + 11, + 6, + 10, + 3, + 7 + ], + "weighted_loads": [ + 0.3028552122414112, + 0.23271305114030838, + 0.2437187395989895, + 0.028774676844477654, + 0.4759341534227133, + 0.23733338713645935, + 0.08306006714701653, + 0.3690887298434973, + 1.5609160382300615, + 0.14424441196024418, + 0.5780882649123669, + 0.1844661459326744, + 0.05406524986028671, + 0.1050242930650711, + 0.0, + 0.8159188739955425, + 0.2909115329384804, + 0.2916888240724802, + 0.26636582612991333, + 0.25157249718904495, + 0.4404415488243103, + 0.46008898317813873, + 0.5266706235706806, + 0.15214473009109497, + 0.18127193301916122, + 0.37967641837894917, + 1.3609535545110703, + 0.162319865077734, + 0.028645435348153114, + 0.27598996832966805, + 0.3320141080766916, + 0.8418347388505936, + 0.09160471335053444, + 0.22772598266601562, + 0.3237444646656513, + 0.299819890409708, + 0.3382308706641197, + 0.13657654635608196, + 0.15181515738368034, + 0.47364135831594467, + 0.12951134145259857, + 0.6411725655198097, + 0.2593165747821331, + 0.5949902515858412, + 0.36585768312215805, + 0.8052480928599834, + 0.16424736008048058, + 0.08208544924855232, + 0.4208441339433193, + 0.05665327608585358, + 0.6183310505002737, + 0.6860080659389496, + 0.4199918005615473, + 0.2827596813440323, + 0.22903151251375675, + 0.7806792259216309, + 0.356705617159605, + 0.7376284711062908, + 0.3070649243891239, + 0.7302179932594299, + 0.3441979754716158, + 0.5622258055955172, + 0.17129255458712578, + 0.7602569926530123 + ], + "unique_experts": 63, + "load_cv": 0.7916666666666666, + "normalized_load_entropy": 0.93974474042289, + "max_load_share": 0.078125 + } + }, + "s0_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "8f643c4b90ab6e1bedeb7ef35b331b109bce43498b778189b9fd160dda8e572b", + "route_weight_sha256": "799a9870553efcbcea98200632eef1d0f5ba74972403339454faf0e832e8990c", + "loads": [ + 2, + 3, + 1, + 1, + 3, + 2, + 2, + 1, + 8, + 2, + 2, + 0, + 2, + 1, + 1, + 0, + 4, + 3, + 3, + 2, + 2, + 3, + 3, + 2, + 1, + 2, + 0, + 1, + 1, + 3, + 3, + 2, + 0, + 1, + 3, + 4, + 2, + 2, + 4, + 2, + 3, + 0, + 1, + 6, + 2, + 0, + 2, + 0, + 3, + 1, + 2, + 2, + 3, + 5, + 3, + 4, + 0, + 0, + 3, + 0, + 3, + 5, + 3, + 3 + ], + "weighted_loads": [ + 0.10441972874104977, + 0.24715398624539375, + 0.08710036426782608, + 0.02929193526506424, + 0.1925809010863304, + 0.09631122276186943, + 0.0768396407365799, + 0.0809747651219368, + 0.31388866528868675, + 0.12360064312815666, + 0.20876850932836533, + 0.0, + 0.052816376090049744, + 0.04149536043405533, + 0.027033230289816856, + 0.0, + 0.284992765635252, + 0.08719443157315254, + 0.18537115305662155, + 0.18964103609323502, + 0.1484307125210762, + 0.24708650261163712, + 0.24639444053173065, + 0.12229738011956215, + 0.1281377524137497, + 0.17992428317666054, + 0.0, + 0.06497916579246521, + 0.02807743102312088, + 0.1459839753806591, + 0.20648501068353653, + 0.17628860473632812, + 0.0, + 0.027594851329922676, + 0.3184323236346245, + 0.29685742408037186, + 0.07643131539225578, + 0.11838208511471748, + 0.14749016240239143, + 0.10437270812690258, + 0.14802424609661102, + 0.0, + 0.05464324355125427, + 0.3979101739823818, + 0.20386557281017303, + 0.0, + 0.12533836998045444, + 0.0, + 0.24284544587135315, + 0.05465281754732132, + 0.1210307702422142, + 0.31882672011852264, + 0.1313373651355505, + 0.26290805265307426, + 0.09177215211093426, + 0.25841087847948074, + 0.0, + 0.0, + 0.2568187192082405, + 0.0, + 0.19232289120554924, + 0.274109598249197, + 0.17162103950977325, + 0.2838499005883932 + ], + "unique_experts": 54, + "load_cv": 0.7157425057893185, + "normalized_load_entropy": 0.9292442409968694, + "max_load_share": 0.057971014492753624 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "bf83d806d951d019b8325156ac76ce9ddc6c0aa2238fdd69c288121e219ef891", + "route_weight_sha256": "96ffd82af05d75daecf6d5cfc5a9d9d1e7dcc2df6b796bbcd4b885f9869e99e6", + "loads": [ + 3, + 3, + 3, + 1, + 6, + 2, + 4, + 3, + 27, + 2, + 4, + 2, + 2, + 2, + 1, + 9, + 4, + 4, + 5, + 2, + 5, + 3, + 4, + 2, + 1, + 6, + 14, + 2, + 1, + 3, + 3, + 6, + 1, + 3, + 3, + 5, + 2, + 2, + 4, + 5, + 3, + 10, + 1, + 12, + 2, + 10, + 2, + 0, + 4, + 1, + 6, + 3, + 7, + 5, + 6, + 8, + 3, + 8, + 3, + 11, + 4, + 9, + 3, + 3 + ], + "weighted_loads": [ + 0.19805515371263027, + 0.24715398624539375, + 0.17275304719805717, + 0.02929193526506424, + 0.3660096153616905, + 0.09631122276186943, + 0.1821116879582405, + 0.3331601843237877, + 1.3658734131604433, + 0.12360064312815666, + 0.3973720818758011, + 0.15987105295062065, + 0.052816376090049744, + 0.06535407342016697, + 0.027033230289816856, + 0.6168637052178383, + 0.284992765635252, + 0.15837086364626884, + 0.23016502149403095, + 0.18964103609323502, + 0.48005934059619904, + 0.24708650261163712, + 0.27665227837860584, + 0.12229738011956215, + 0.1281377524137497, + 0.344362985342741, + 0.9069452472031116, + 0.13045508414506912, + 0.02807743102312088, + 0.1459839753806591, + 0.20648501068353653, + 0.6271084174513817, + 0.061951857060194016, + 0.24302701838314533, + 0.3184323236346245, + 0.3182586245238781, + 0.07643131539225578, + 0.11838208511471748, + 0.14749016240239143, + 0.3341358061879873, + 0.14802424609661102, + 0.41219351068139076, + 0.05464324355125427, + 0.5609443616122007, + 0.20386557281017303, + 0.8189453780651093, + 0.12533836998045444, + 0.0, + 0.26400663144886494, + 0.05465281754732132, + 0.32956049777567387, + 0.3717413432896137, + 0.3790030311793089, + 0.26290805265307426, + 0.16153978370130062, + 0.7879963517189026, + 0.192900862544775, + 0.48521050810813904, + 0.2568187192082405, + 0.713709894567728, + 0.2832336388528347, + 0.46658601984381676, + 0.17162103950977325, + 0.2838499005883932 + ], + "unique_experts": 63, + "load_cv": 0.9026709338484401, + "normalized_load_entropy": 0.928305025943356, + "max_load_share": 0.09375 + } + }, + "s1_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "db8dfb2d9ba6d938a5c8fd5135d840f348985a1075cdf3049e7ce89ad789bf82", + "route_weight_sha256": "5bf9c44d995a1ab19fc2d89064a1f41d5a51720c72366c749780d60b464ab6bf", + "loads": [ + 2, + 3, + 1, + 1, + 3, + 2, + 1, + 2, + 5, + 2, + 2, + 1, + 2, + 1, + 0, + 0, + 4, + 3, + 3, + 2, + 2, + 3, + 3, + 2, + 1, + 2, + 0, + 1, + 1, + 2, + 4, + 2, + 0, + 2, + 3, + 4, + 2, + 2, + 4, + 2, + 3, + 0, + 1, + 6, + 2, + 0, + 2, + 0, + 3, + 1, + 2, + 2, + 3, + 5, + 3, + 4, + 1, + 0, + 3, + 0, + 4, + 5, + 3, + 3 + ], + "weighted_loads": [ + 0.09620674885809422, + 0.23650886863470078, + 0.08501255512237549, + 0.029177218675613403, + 0.182501669973135, + 0.10041558369994164, + 0.0375569611787796, + 0.10413840040564537, + 0.14788532257080078, + 0.12001753598451614, + 0.1965966373682022, + 0.03781822696328163, + 0.05339278094470501, + 0.0399458147585392, + 0.0, + 0.0, + 0.2930082678794861, + 0.08870798535645008, + 0.1854885146021843, + 0.18597543239593506, + 0.14527393132448196, + 0.25618838146328926, + 0.25630930066108704, + 0.11865267157554626, + 0.10818768292665482, + 0.18382717669010162, + 0.0, + 0.06913989782333374, + 0.02851603552699089, + 0.11397657543420792, + 0.24743351712822914, + 0.17907457798719406, + 0.0, + 0.0528050996363163, + 0.3226824961602688, + 0.29912570118904114, + 0.07959581911563873, + 0.10398681834340096, + 0.15205078572034836, + 0.10485867410898209, + 0.13106348738074303, + 0.0, + 0.05177312344312668, + 0.40009329840540886, + 0.21209925413131714, + 0.0, + 0.130355978384614, + 0.0, + 0.24852313101291656, + 0.057075366377830505, + 0.12320812791585922, + 0.3184167444705963, + 0.13116656430065632, + 0.28035788983106613, + 0.09060253761708736, + 0.27300626039505005, + 0.03225265070796013, + 0.0, + 0.2340632863342762, + 0.0, + 0.2286564875394106, + 0.27413681149482727, + 0.17195948585867882, + 0.2698552794754505 + ], + "unique_experts": 55, + "load_cv": 0.6518517722912759, + "normalized_load_entropy": 0.9372817072191564, + "max_load_share": 0.043478260869565216 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "430b66cf36f2c968d5bfe7e13a530ec5bb390e40b03ab865350a1a5aa31b89e6", + "route_weight_sha256": "2c9aa2869b3a2bffb7eb25eb414205c2ea461613033038cf17938d51a6e92b56", + "loads": [ + 5, + 3, + 4, + 1, + 9, + 4, + 2, + 5, + 28, + 2, + 7, + 5, + 2, + 3, + 0, + 12, + 4, + 8, + 6, + 3, + 5, + 5, + 7, + 3, + 3, + 7, + 20, + 3, + 1, + 4, + 6, + 8, + 2, + 4, + 3, + 4, + 4, + 3, + 4, + 7, + 3, + 13, + 4, + 12, + 3, + 10, + 2, + 2, + 5, + 1, + 11, + 7, + 9, + 5, + 9, + 8, + 10, + 13, + 5, + 10, + 6, + 10, + 3, + 7 + ], + "weighted_loads": [ + 0.30298292450606823, + 0.23650886863470078, + 0.23356495425105095, + 0.029177218675613403, + 0.5930311512202024, + 0.23734207823872566, + 0.08295411244034767, + 0.31987591832876205, + 1.4833467155694962, + 0.12001753598451614, + 0.5788043178617954, + 0.37626355327665806, + 0.05339278094470501, + 0.10712643899023533, + 0.0, + 0.7053214572370052, + 0.2930082678794861, + 0.29002793692052364, + 0.27032970264554024, + 0.2519162893295288, + 0.4373495802283287, + 0.4618399776518345, + 0.5273654274642467, + 0.15315628051757812, + 0.17968761175870895, + 0.379831338301301, + 1.3503284752368927, + 0.1615935079753399, + 0.02851603552699089, + 0.2757487893104553, + 0.35409401915967464, + 0.8438981100916862, + 0.09078089892864227, + 0.2251795493066311, + 0.3226824961602688, + 0.29912570118904114, + 0.3600506465882063, + 0.138049203902483, + 0.15205078572034836, + 0.45427850261330605, + 0.13106348738074303, + 0.6102840453386307, + 0.259489718824625, + 0.5981274601072073, + 0.36531059443950653, + 0.770719937980175, + 0.130355978384614, + 0.08208544924855232, + 0.3991914577782154, + 0.057075366377830505, + 0.6179652959108353, + 0.7254514805972576, + 0.4555461313575506, + 0.28035788983106613, + 0.2321463841944933, + 0.7812400460243225, + 0.3935584984719753, + 0.7359460480511189, + 0.3090639151632786, + 0.635767474770546, + 0.3445652164518833, + 0.5586879178881645, + 0.17195948585867882, + 0.7609131895005703 + ], + "unique_experts": 63, + "load_cv": 0.7609159319895697, + "normalized_load_entropy": 0.942357900683354, + "max_load_share": 0.07291666666666667 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "ordered_topk_exact_tokens": 16, + "set_exact_tokens": 18, + "mean_set_jaccard": 0.9378881987577641, + "mean_token_weighted_tv": 0.01058616594451925, + "aggregate_load_tv": 0.036231884057971016 + }, + "system_bos": { + "tokens": 23, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 18, + "mean_set_jaccard": 0.9378881987577641, + "mean_token_weighted_tv": 0.012478836771586666, + "aggregate_load_tv": 0.036231884057971016 + }, + "system_x": { + "tokens": 23, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 18, + "mean_set_jaccard": 0.9285714285714286, + "mean_token_weighted_tv": 0.0160363144038812, + "aggregate_load_tv": 0.03623188405797102 + }, + "system_period": { + "tokens": 23, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.9130434782608695, + "mean_token_weighted_tv": 0.01764189229225335, + "aggregate_load_tv": 0.043478260869565216 + }, + "bos_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8602484472049691, + "mean_token_weighted_tv": 0.030744535443575485, + "aggregate_load_tv": 0.08695652173913042 + }, + "bos_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 7, + "set_exact_tokens": 12, + "mean_set_jaccard": 0.8354037267080746, + "mean_token_weighted_tv": 0.035183226365758026, + "aggregate_load_tv": 0.10144927536231883 + }, + "x_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8788819875776398, + "mean_token_weighted_tv": 0.02762719130386477, + "aggregate_load_tv": 0.07246376811594202 + }, + "x_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 6, + "set_exact_tokens": 12, + "mean_set_jaccard": 0.8354037267080746, + "mean_token_weighted_tv": 0.03648237754469332, + "aggregate_load_tv": 0.10144927536231883 + }, + "period_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.8913043478260869, + "mean_token_weighted_tv": 0.02594265685943158, + "aggregate_load_tv": 0.06521739130434781 + }, + "period_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 6, + "set_exact_tokens": 11, + "mean_set_jaccard": 0.8229813664596274, + "mean_token_weighted_tv": 0.03758039365967979, + "aggregate_load_tv": 0.10869565217391304 + } + } + }, + "layer_02": { + "layer": 2, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "3d69c3ae9173c6d5486f9734c40c7617730f89cde52c3dfbae5f9552926244d3", + "route_weight_sha256": "12fb1d26faba9137913c3f21b9140fcb75f1721be0f19000c4dc65bdf2d74870", + "loads": [ + 3, + 0, + 2, + 2, + 0, + 4, + 2, + 2, + 3, + 1, + 0, + 1, + 4, + 2, + 2, + 6, + 2, + 0, + 3, + 2, + 3, + 0, + 2, + 1, + 2, + 3, + 2, + 4, + 1, + 2, + 2, + 3, + 1, + 1, + 1, + 3, + 2, + 2, + 2, + 1, + 2, + 1, + 4, + 1, + 2, + 2, + 4, + 6, + 6, + 3, + 1, + 1, + 5, + 2, + 0, + 0, + 3, + 1, + 2, + 3, + 2, + 3, + 2, + 3 + ], + "weighted_loads": [ + 0.23073622584342957, + 0.0, + 0.14095040410757065, + 0.22029751539230347, + 0.0, + 0.2795795798301697, + 0.06653910130262375, + 0.09582838788628578, + 0.283243291079998, + 0.10675837844610214, + 0.0, + 0.029529664665460587, + 0.4482449144124985, + 0.1712517961859703, + 0.14856990799307823, + 0.47379017248749733, + 0.11802126467227936, + 0.0, + 0.4751478508114815, + 0.23763713985681534, + 0.35587508603930473, + 0.0, + 0.29242249205708504, + 0.08022606372833252, + 0.2592540308833122, + 0.15020783618092537, + 0.0978513304144144, + 0.2663048319518566, + 0.14004145562648773, + 0.2080759033560753, + 0.06690968573093414, + 0.30274523422122, + 0.025442251935601234, + 0.2728852331638336, + 0.4190136194229126, + 0.22718532755970955, + 0.06423407420516014, + 0.1957784853875637, + 0.21953267976641655, + 0.07016128301620483, + 0.0992816872894764, + 0.12845632433891296, + 0.38893674686551094, + 0.09765873849391937, + 0.08445190452039242, + 0.08395547606050968, + 0.2771626338362694, + 0.4135221801698208, + 0.5617691595107317, + 0.5148676410317421, + 0.02293269895017147, + 0.02879534661769867, + 0.6778564453125, + 0.08149740286171436, + 0.0, + 0.0, + 0.32724033668637276, + 0.03433401882648468, + 0.20713577419519424, + 0.3934087045490742, + 0.09595200419425964, + 0.2648603990674019, + 0.12259733863174915, + 0.2249544132500887 + ], + "unique_experts": 57, + "load_cv": 0.6569870699503267, + "normalized_load_entropy": 0.9417617868623287, + "max_load_share": 0.043478260869565216 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "8ff4b8f95d0a3e3e0e6ee4c243e8fc7a1caee106cf8f32f84605e116276095b5", + "route_weight_sha256": "7807f4860767209c0b1166ee562eb72a90bb78a060b524c59e882b57307a2866", + "loads": [ + 3, + 10, + 2, + 4, + 0, + 4, + 2, + 3, + 6, + 1, + 3, + 1, + 4, + 3, + 9, + 6, + 2, + 1, + 4, + 6, + 5, + 9, + 2, + 1, + 5, + 3, + 3, + 6, + 4, + 2, + 2, + 4, + 1, + 1, + 6, + 18, + 3, + 2, + 5, + 1, + 2, + 1, + 10, + 1, + 2, + 2, + 7, + 11, + 7, + 3, + 1, + 7, + 5, + 3, + 0, + 0, + 3, + 9, + 10, + 7, + 13, + 5, + 8, + 14 + ], + "weighted_loads": [ + 0.23073622584342957, + 0.9491828717291355, + 0.14095040410757065, + 1.9178969860076904, + 0.0, + 0.2795795798301697, + 0.06653910130262375, + 0.142599917948246, + 0.5013845413923264, + 0.10675837844610214, + 0.12500830367207527, + 0.029529664665460587, + 0.4482449144124985, + 0.19602873921394348, + 0.43235836923122406, + 0.47379017248749733, + 0.11802126467227936, + 0.0006983499624766409, + 0.47673523775301874, + 1.0673553869128227, + 0.6673769913613796, + 0.6933429203927517, + 0.29242249205708504, + 0.08022606372833252, + 0.39855319261550903, + 0.15020783618092537, + 0.0986962485476397, + 0.5795185081660748, + 0.38580573350191116, + 0.2080759033560753, + 0.06690968573093414, + 0.30344001634512097, + 0.025442251935601234, + 0.2728852331638336, + 0.6426927968859673, + 2.429094868712127, + 0.0840530227869749, + 0.1957784853875637, + 0.32249990198761225, + 0.07016128301620483, + 0.0992816872894764, + 0.12845632433891296, + 0.9811841249465942, + 0.09765873849391937, + 0.08445190452039242, + 0.08395547606050968, + 0.3688964284956455, + 0.7258300557732582, + 0.5874462835490704, + 0.5148676410317421, + 0.02293269895017147, + 0.6829418800771236, + 0.6778564453125, + 0.08280826359987259, + 0.0, + 0.0, + 0.32724033668637276, + 0.4571661427617073, + 0.5719744637608528, + 0.5994564332067966, + 1.0077169751748443, + 0.35073819756507874, + 0.6265196073800325, + 0.8008248452097178 + ], + "unique_experts": 61, + "load_cv": 0.8136565842153783, + "normalized_load_entropy": 0.9255900516326063, + "max_load_share": 0.0625 + } + }, + "s1_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "e2426e645678c61056ab6f3bb8f1c4f0614111308d27cbe348ad7c57a2b96a9a", + "route_weight_sha256": "2245b5ec765ee71e3212c7e64e8b3ed8823ae46837f6cc68135dbd41223ab94e", + "loads": [ + 3, + 0, + 2, + 2, + 0, + 4, + 2, + 2, + 3, + 1, + 0, + 1, + 4, + 2, + 2, + 6, + 2, + 0, + 3, + 2, + 3, + 0, + 2, + 1, + 2, + 3, + 2, + 4, + 1, + 2, + 2, + 3, + 1, + 1, + 1, + 3, + 1, + 2, + 2, + 1, + 2, + 2, + 4, + 1, + 2, + 2, + 4, + 6, + 6, + 3, + 1, + 1, + 5, + 2, + 0, + 0, + 3, + 1, + 2, + 3, + 2, + 3, + 2, + 3 + ], + "weighted_loads": [ + 0.23131756484508514, + 0.0, + 0.14417657628655434, + 0.23304735124111176, + 0.0, + 0.28360680863261223, + 0.06906518898904324, + 0.0999782606959343, + 0.28011202067136765, + 0.11006416380405426, + 0.0, + 0.03148554638028145, + 0.4471009261906147, + 0.17127716168761253, + 0.14982909336686134, + 0.47298337519168854, + 0.12391001917421818, + 0.0, + 0.4630269855260849, + 0.23906569182872772, + 0.3523555062711239, + 0.0, + 0.2975301221013069, + 0.08443799614906311, + 0.2534797117114067, + 0.1523420475423336, + 0.1010148748755455, + 0.27093803882598877, + 0.13927538692951202, + 0.21213604509830475, + 0.06505394354462624, + 0.3047214709222317, + 0.026896031573414803, + 0.2827370762825012, + 0.39566919207572937, + 0.21569907665252686, + 0.04241716116666794, + 0.20114464312791824, + 0.22035421431064606, + 0.06899966299533844, + 0.10042525827884674, + 0.15691343694925308, + 0.39750849455595016, + 0.09926389157772064, + 0.08360595628619194, + 0.08509224466979504, + 0.27618274837732315, + 0.4095109701156616, + 0.5644421987235546, + 0.50947605073452, + 0.023151099681854248, + 0.02898353897035122, + 0.670974887907505, + 0.08026654459536076, + 0.0, + 0.0, + 0.3262876980006695, + 0.03412189334630966, + 0.21186073124408722, + 0.402695219963789, + 0.09221815690398216, + 0.2686242386698723, + 0.1266731284558773, + 0.22691000252962112 + ], + "unique_experts": 57, + "load_cv": 0.6569870699503267, + "normalized_load_entropy": 0.9417617868623287, + "max_load_share": 0.043478260869565216 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "de0e7aa9b8e9fbbc59f9b46bb5a3553c092fab1d07bca64581201e31a5b41e75", + "route_weight_sha256": "b6039eca279dc4c1dd2e822d4ef9f876b3682eba6b8fd7b43d49b351e3b3aa60", + "loads": [ + 7, + 11, + 3, + 5, + 1, + 5, + 2, + 5, + 12, + 2, + 7, + 1, + 4, + 5, + 13, + 7, + 4, + 1, + 4, + 8, + 5, + 11, + 3, + 1, + 9, + 4, + 3, + 7, + 6, + 2, + 3, + 5, + 1, + 1, + 10, + 20, + 2, + 3, + 8, + 4, + 2, + 2, + 13, + 2, + 5, + 2, + 10, + 14, + 8, + 4, + 2, + 10, + 6, + 6, + 0, + 0, + 7, + 9, + 4, + 13, + 13, + 8, + 12, + 17 + ], + "weighted_loads": [ + 0.7516924999654293, + 1.0051259212195873, + 0.169652309268713, + 1.9654103182256222, + 0.03022768907248974, + 0.4241453818976879, + 0.06906518898904324, + 0.2105528675019741, + 1.0288916416466236, + 0.22713612765073776, + 0.30430085211992264, + 0.03148554638028145, + 0.4471009261906147, + 0.22011529561132193, + 0.6765050403773785, + 0.505326010286808, + 0.18781443126499653, + 0.0005876642535440624, + 0.46441042399965227, + 1.1029224283993244, + 0.6403993181884289, + 0.790943743661046, + 0.3362076133489609, + 0.08443799614906311, + 0.5514956470578909, + 0.20242326706647873, + 0.10184267873410136, + 0.9720049649477005, + 0.3931639287620783, + 0.21213604509830475, + 0.09920619800686836, + 0.347651619464159, + 0.026896031573414803, + 0.2827370762825012, + 0.7643602155148983, + 2.1799137284979224, + 0.062008537352085114, + 0.24282603338360786, + 0.4192697433754802, + 0.4241674765944481, + 0.10042525827884674, + 0.15691343694925308, + 1.4409324526786804, + 0.2798837721347809, + 0.7368445806205273, + 0.08509224466979504, + 0.8525250069797039, + 0.8435150682926178, + 0.6332053411751986, + 0.5523631200194359, + 0.04945364035665989, + 0.9949922915548086, + 0.8470610603690147, + 0.26445476908702403, + 0.0, + 0.0, + 0.5794983059167862, + 0.38954691775143147, + 0.32279637828469276, + 0.9103702995926142, + 0.8471406912431121, + 0.6321706734597683, + 1.0399130657315254, + 1.2139338478446007 + ], + "unique_experts": 62, + "load_cv": 0.7312470322826768, + "normalized_load_entropy": 0.9358865361150153, + "max_load_share": 0.052083333333333336 + } + }, + "s0_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "0898ceaa846c89ba21c7e0f0349069b97318c4df8ff6f8612b0a7949b107f2ff", + "route_weight_sha256": "0e93cb51815654c2f6519efe7bf8d6ce7ebeafd8526eb3daad1f990e1b47e727", + "loads": [ + 3, + 0, + 2, + 2, + 0, + 4, + 2, + 1, + 3, + 1, + 0, + 0, + 4, + 2, + 2, + 6, + 2, + 0, + 3, + 2, + 3, + 0, + 2, + 1, + 2, + 3, + 4, + 3, + 2, + 2, + 2, + 3, + 1, + 1, + 1, + 3, + 2, + 1, + 2, + 1, + 2, + 1, + 4, + 1, + 3, + 2, + 4, + 6, + 5, + 3, + 1, + 0, + 5, + 2, + 0, + 0, + 3, + 2, + 2, + 4, + 2, + 3, + 2, + 3 + ], + "weighted_loads": [ + 0.2332501858472824, + 0.0, + 0.14324109815061092, + 0.2085750624537468, + 0.0, + 0.2885834090411663, + 0.0651242583990097, + 0.04966220632195473, + 0.2825769707560539, + 0.11567065119743347, + 0.0, + 0.0, + 0.4346582293510437, + 0.18039346486330032, + 0.11038069427013397, + 0.4797973744571209, + 0.12812909670174122, + 0.0, + 0.48330578953027725, + 0.21058917790651321, + 0.3712170869112015, + 0.0, + 0.263855405151844, + 0.07814925163984299, + 0.25288932025432587, + 0.1503886915743351, + 0.1849973388016224, + 0.21978602185845375, + 0.19057072699069977, + 0.2026183232665062, + 0.07508486695587635, + 0.28161366283893585, + 0.02584291808307171, + 0.310835063457489, + 0.40091079473495483, + 0.1975996419787407, + 0.07042616978287697, + 0.18750783801078796, + 0.24569383636116982, + 0.08105065673589706, + 0.09627814963459969, + 0.1357651948928833, + 0.4077347666025162, + 0.10885921865701675, + 0.11893255822360516, + 0.08205394074320793, + 0.2765057384967804, + 0.37944619357585907, + 0.5134331323206425, + 0.5026044249534607, + 0.023834604769945145, + 0.0, + 0.659020870923996, + 0.08306087553501129, + 0.0, + 0.0, + 0.31928160041570663, + 0.07559900917112827, + 0.19278759509325027, + 0.4478066898882389, + 0.09139282628893852, + 0.2731681764125824, + 0.11421228013932705, + 0.21669966541230679 + ], + "unique_experts": 55, + "load_cv": 0.6671390890715307, + "normalized_load_entropy": 0.9358985586349455, + "max_load_share": 0.043478260869565216 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "af1c02f41b0f11b1ae9643afb033cbe924630d9df5fe09db046010d3134ff33e", + "route_weight_sha256": "d3bfb967dccd94f0385a4c3d40229b885870d02fa9128ccb539343b9de414cc0", + "loads": [ + 3, + 10, + 2, + 3, + 0, + 4, + 2, + 2, + 7, + 1, + 3, + 0, + 5, + 3, + 6, + 6, + 3, + 0, + 3, + 6, + 5, + 9, + 2, + 1, + 4, + 3, + 4, + 5, + 5, + 2, + 2, + 3, + 1, + 1, + 6, + 19, + 2, + 2, + 6, + 1, + 2, + 1, + 11, + 1, + 3, + 2, + 6, + 11, + 6, + 3, + 1, + 7, + 5, + 2, + 0, + 0, + 3, + 11, + 10, + 9, + 13, + 5, + 9, + 15 + ], + "weighted_loads": [ + 0.2332501858472824, + 0.9491828717291355, + 0.14324109815061092, + 0.9333651587367058, + 0.0, + 0.2885834090411663, + 0.0651242583990097, + 0.09643373638391495, + 0.4962432458996773, + 0.11567065119743347, + 0.12500830367207527, + 0.0, + 0.4663485363125801, + 0.20550315082073212, + 0.294181153178215, + 0.4797973744571209, + 0.15831457264721394, + 0.0, + 0.48330578953027725, + 0.9616827592253685, + 0.6621626317501068, + 0.7043829336762428, + 0.263855405151844, + 0.07814925163984299, + 0.351557195186615, + 0.1503886915743351, + 0.1849973388016224, + 0.5105274505913258, + 0.47662652283906937, + 0.2026183232665062, + 0.07508486695587635, + 0.28161366283893585, + 0.02584291808307171, + 0.310835063457489, + 0.6245899721980095, + 2.367742928676307, + 0.07042616978287697, + 0.2057859357446432, + 0.4423079425469041, + 0.08105065673589706, + 0.09627814963459969, + 0.1357651948928833, + 1.0809232778847218, + 0.10885921865701675, + 0.11893255822360516, + 0.08205394074320793, + 0.34331904724240303, + 0.6701906528323889, + 0.5391102563589811, + 0.5026044249534607, + 0.023834604769945145, + 0.6240679025650024, + 0.659020870923996, + 0.08306087553501129, + 0.0, + 0.0, + 0.31928160041570663, + 0.5302315447479486, + 0.5576262846589088, + 0.6267655752599239, + 0.9881926877424121, + 0.35904597491025925, + 0.7785468455404043, + 1.0594645459204912 + ], + "unique_experts": 59, + "load_cv": 0.8624541497922236, + "normalized_load_entropy": 0.9163761126902553, + "max_load_share": 0.06597222222222222 + } + }, + "s1_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "2695143c107fab5a3842673f93939717c4edda25807611b62f77c428350ddc51", + "route_weight_sha256": "fc04aacc46da82f2ec07a3e1b1b77e9de9c1b799359eab25dec5a9059984a173", + "loads": [ + 3, + 0, + 2, + 2, + 0, + 4, + 2, + 2, + 3, + 1, + 0, + 0, + 4, + 2, + 2, + 6, + 3, + 0, + 3, + 2, + 3, + 0, + 2, + 1, + 2, + 3, + 4, + 3, + 1, + 2, + 2, + 3, + 1, + 1, + 1, + 3, + 1, + 1, + 2, + 1, + 2, + 2, + 4, + 1, + 3, + 2, + 4, + 6, + 6, + 3, + 1, + 0, + 5, + 2, + 0, + 0, + 3, + 1, + 2, + 3, + 2, + 3, + 2, + 3 + ], + "weighted_loads": [ + 0.24101605266332626, + 0.0, + 0.14958446845412254, + 0.233591228723526, + 0.0, + 0.28890811279416084, + 0.06706826947629452, + 0.10674010217189789, + 0.29035432636737823, + 0.11599113792181015, + 0.0, + 0.0, + 0.46125804260373116, + 0.1828245408833027, + 0.1021709106862545, + 0.48398425802588463, + 0.1621297374367714, + 0.0, + 0.4702397584915161, + 0.2014293633401394, + 0.37056853994727135, + 0.0, + 0.27725958079099655, + 0.08453284204006195, + 0.24321208149194717, + 0.150666244328022, + 0.17773162946105003, + 0.22274770960211754, + 0.15862640738487244, + 0.1983095370233059, + 0.06830437667667866, + 0.28367529436945915, + 0.02603338658809662, + 0.2984411120414734, + 0.4083385467529297, + 0.2019789069890976, + 0.04270681366324425, + 0.18410050868988037, + 0.2513979356735945, + 0.07312387973070145, + 0.09692450612783432, + 0.16403421014547348, + 0.4151903986930847, + 0.10932876169681549, + 0.11977271549403667, + 0.08380765281617641, + 0.2838903218507767, + 0.3520764894783497, + 0.5502568855881691, + 0.5133629441261292, + 0.02462323009967804, + 0.0, + 0.6654927432537079, + 0.0774176586419344, + 0.0, + 0.0, + 0.31911367923021317, + 0.04089612141251564, + 0.20106221735477448, + 0.406223364174366, + 0.08732109516859055, + 0.29161055386066437, + 0.10669583268463612, + 0.22522683069109917 + ], + "unique_experts": 55, + "load_cv": 0.6820838623623242, + "normalized_load_entropy": 0.9341957693424127, + "max_load_share": 0.043478260869565216 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "be281598730d061e81654a4dc4f5e5ecc87d305cb9fafd1e2406b45158260a86", + "route_weight_sha256": "6921e0ce28b1ce46e0c9e80d41061681d7ba3f31dc923a91b98e51140a9c8b29", + "loads": [ + 7, + 11, + 3, + 5, + 2, + 5, + 2, + 5, + 13, + 2, + 7, + 0, + 5, + 4, + 12, + 7, + 6, + 0, + 3, + 8, + 5, + 11, + 3, + 1, + 8, + 4, + 4, + 6, + 6, + 2, + 3, + 5, + 1, + 1, + 10, + 21, + 1, + 3, + 8, + 4, + 2, + 2, + 14, + 2, + 6, + 2, + 10, + 13, + 8, + 4, + 2, + 9, + 6, + 5, + 0, + 0, + 7, + 8, + 4, + 14, + 13, + 8, + 14, + 17 + ], + "weighted_loads": [ + 0.7613909877836704, + 1.0051259212195873, + 0.1750602014362812, + 1.0231602229177952, + 0.0508707407861948, + 0.4294466860592365, + 0.06706826947629452, + 0.2173147089779377, + 1.0642411299049854, + 0.23306310176849365, + 0.30430085211992264, + 0.0, + 0.4890371188521385, + 0.2326822504401207, + 0.5866987723857164, + 0.5163268931210041, + 0.2546963784843683, + 0.0, + 0.4702397584915161, + 0.9709565341472626, + 0.6453656516969204, + 0.8136537317186594, + 0.3159370720386505, + 0.08453284204006195, + 0.5081821009516716, + 0.20074746385216713, + 0.17773162946105003, + 0.9192453734576702, + 0.4701202008873224, + 0.1983095370233059, + 0.10245663113892078, + 0.3266054429113865, + 0.02603338658809662, + 0.2984411120414734, + 0.7770295701920986, + 2.176162819378078, + 0.04270681366324425, + 0.2437269650399685, + 0.5322603145614266, + 0.4282916933298111, + 0.09692450612783432, + 0.16403421014547348, + 1.5269584003835917, + 0.28994864225387573, + 0.773011339828372, + 0.08380765281617641, + 0.8602325804531574, + 0.7462950237095356, + 0.619020028039813, + 0.5562500134110451, + 0.05092577077448368, + 0.9767712354660034, + 0.8415789157152176, + 0.26051272451877594, + 0.0, + 0.0, + 0.5723242871463299, + 0.3437671195715666, + 0.31199786439538, + 0.8836973384022713, + 0.8216631105169654, + 0.6551569886505604, + 1.1380922887474298, + 1.3790668100118637 + ], + "unique_experts": 60, + "load_cv": 0.7523112535528246, + "normalized_load_entropy": 0.931155531320689, + "max_load_share": 0.0546875 + } + }, + "s0_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "99d3c56773c5c9004c5738610103fbc57d4a50efc7a3299383340a94a592ae78", + "route_weight_sha256": "f2563fe2aea6f4c56456f7f264dace682ad480263a221a87bf0cafc346c72151", + "loads": [ + 3, + 0, + 2, + 2, + 0, + 4, + 2, + 1, + 3, + 1, + 0, + 0, + 4, + 2, + 3, + 6, + 2, + 0, + 3, + 2, + 3, + 0, + 2, + 1, + 2, + 3, + 4, + 3, + 1, + 2, + 2, + 3, + 1, + 1, + 1, + 3, + 1, + 1, + 2, + 1, + 2, + 1, + 4, + 1, + 3, + 2, + 4, + 6, + 6, + 3, + 1, + 0, + 5, + 2, + 0, + 0, + 3, + 2, + 2, + 4, + 1, + 3, + 3, + 3 + ], + "weighted_loads": [ + 0.24569863826036453, + 0.0, + 0.14015908911824226, + 0.23156887292861938, + 0.0, + 0.302592970430851, + 0.06017781421542168, + 0.04822775349020958, + 0.2929418534040451, + 0.1131119579076767, + 0.0, + 0.0, + 0.4211866706609726, + 0.17615220323204994, + 0.13284025713801384, + 0.46106573939323425, + 0.12467186525464058, + 0.0, + 0.47724035009741783, + 0.20173385366797447, + 0.3623754382133484, + 0.0, + 0.2680736854672432, + 0.07905008643865585, + 0.249045230448246, + 0.15024464577436447, + 0.1744004189968109, + 0.21533023193478584, + 0.14537157118320465, + 0.20085837692022324, + 0.07126057706773281, + 0.2799161896109581, + 0.026536455377936363, + 0.29215139150619507, + 0.4083015024662018, + 0.20797041431069374, + 0.0386657789349556, + 0.19132961332798004, + 0.24495648592710495, + 0.07862181216478348, + 0.09407106414437294, + 0.1292271614074707, + 0.42289528250694275, + 0.10318206250667572, + 0.11813406646251678, + 0.08021607249975204, + 0.28578780591487885, + 0.3600800335407257, + 0.5315022487193346, + 0.4863879308104515, + 0.023953866213560104, + 0.0, + 0.6646323651075363, + 0.08402783423662186, + 0.0, + 0.0, + 0.31474507600069046, + 0.07412582822144032, + 0.188573956489563, + 0.46595318615436554, + 0.06348671019077301, + 0.27781207859516144, + 0.15822103433310986, + 0.17923102155327797 + ], + "unique_experts": 55, + "load_cv": 0.6967081357519951, + "normalized_load_entropy": 0.9317803104052147, + "max_load_share": 0.043478260869565216 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "44be6d17514b9414f333936eae5c913971f3e6f044c6d4ecba3ac9bcc806d737", + "route_weight_sha256": "30ea6714119e34dab28c2fda7cf805c98d8678ce227f05805d5289b0efc6dad8", + "loads": [ + 3, + 10, + 2, + 3, + 0, + 4, + 3, + 2, + 7, + 1, + 5, + 1, + 5, + 3, + 7, + 6, + 3, + 0, + 3, + 6, + 5, + 10, + 2, + 1, + 4, + 3, + 4, + 5, + 4, + 2, + 2, + 3, + 1, + 1, + 6, + 18, + 2, + 1, + 5, + 1, + 2, + 1, + 10, + 1, + 3, + 2, + 6, + 12, + 7, + 3, + 1, + 6, + 5, + 2, + 0, + 0, + 3, + 9, + 11, + 9, + 13, + 5, + 9, + 14 + ], + "weighted_loads": [ + 0.24569863826036453, + 0.9491828717291355, + 0.14015908911824226, + 0.9563589692115784, + 0.0, + 0.302592970430851, + 0.09498937055468559, + 0.0949992835521698, + 0.5243165455758572, + 0.1131119579076767, + 0.23432812839746475, + 0.03531612455844879, + 0.4508433248847723, + 0.2021460309624672, + 0.3130299262702465, + 0.46106573939323425, + 0.15548797138035297, + 0.0, + 0.47724035009741783, + 0.9729469679296017, + 0.6633058786392212, + 1.0023593306541443, + 0.2680736854672432, + 0.07905008643865585, + 0.3457147106528282, + 0.15024464577436447, + 0.1744004189968109, + 0.5133868642151356, + 0.43278984911739826, + 0.20085837692022324, + 0.07126057706773281, + 0.2799161896109581, + 0.026536455377936363, + 0.29215139150619507, + 0.6319806799292564, + 2.3689147559925914, + 0.05681594833731651, + 0.19132961332798004, + 0.35004327166825533, + 0.07862181216478348, + 0.09407106414437294, + 0.1292271614074707, + 1.0077593810856342, + 0.10318206250667572, + 0.11813406646251678, + 0.08021607249975204, + 0.3526011146605015, + 0.6843404099345207, + 0.5571793727576733, + 0.4863879308104515, + 0.023953866213560104, + 0.5359434299170971, + 0.6646323651075363, + 0.08402783423662186, + 0.0, + 0.0, + 0.31474507600069046, + 0.4519440848380327, + 0.6827879995107651, + 0.6434965189546347, + 1.017720582894981, + 0.3636898770928383, + 0.7873013000935316, + 0.6870308574289083 + ], + "unique_experts": 60, + "load_cv": 0.8388704928078611, + "normalized_load_entropy": 0.9201836662128798, + "max_load_share": 0.0625 + } + }, + "s1_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "5dc819328d6d0ef136902e491e7e91a426d74c0bb799b65e75fa98bf5a384885", + "route_weight_sha256": "22dc0ffa6566887c0d451db2704b43abd182c9598c6d94e57b98ee4186f06824", + "loads": [ + 3, + 0, + 2, + 2, + 0, + 4, + 2, + 2, + 3, + 1, + 0, + 0, + 4, + 2, + 2, + 6, + 3, + 0, + 3, + 2, + 3, + 0, + 2, + 1, + 2, + 3, + 4, + 3, + 1, + 2, + 2, + 3, + 1, + 1, + 1, + 3, + 1, + 1, + 2, + 1, + 2, + 2, + 4, + 1, + 3, + 2, + 4, + 6, + 6, + 3, + 1, + 0, + 5, + 2, + 0, + 0, + 3, + 1, + 2, + 3, + 2, + 3, + 2, + 3 + ], + "weighted_loads": [ + 0.25218671560287476, + 0.0, + 0.14951619133353233, + 0.23418711498379707, + 0.0, + 0.2957831174135208, + 0.0653901919722557, + 0.10679400339722633, + 0.2970016971230507, + 0.111678846180439, + 0.0, + 0.0, + 0.4514298029243946, + 0.18275603652000427, + 0.09415463730692863, + 0.47220583632588387, + 0.1594717837870121, + 0.0, + 0.4642132855951786, + 0.1922449842095375, + 0.3662760965526104, + 0.0, + 0.2761838734149933, + 0.08235980570316315, + 0.23728110641241074, + 0.1506032943725586, + 0.17101410403847694, + 0.22274474054574966, + 0.1539999544620514, + 0.196027971804142, + 0.0676204077899456, + 0.2817353755235672, + 0.02630496770143509, + 0.29097980260849, + 0.4084440767765045, + 0.20519861206412315, + 0.04073788598179817, + 0.17805686593055725, + 0.24606629833579063, + 0.06952816992998123, + 0.09478635713458061, + 0.16269606165587902, + 0.42153628915548325, + 0.1036459431052208, + 0.12052488885819912, + 0.08196323737502098, + 0.28775083273649216, + 0.3378982301801443, + 0.544843889772892, + 0.5021073073148727, + 0.02481430396437645, + 0.0, + 0.6648578569293022, + 0.07483133673667908, + 0.0, + 0.0, + 0.3213261738419533, + 0.04044423997402191, + 0.20126115530729294, + 0.41362518817186356, + 0.08821183443069458, + 0.2877443693578243, + 0.10728294029831886, + 0.204218877479434 + ], + "unique_experts": 55, + "load_cv": 0.6820838623623242, + "normalized_load_entropy": 0.9341957693424127, + "max_load_share": 0.043478260869565216 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "221aebf3fdaf4ffd11a343652ddfae3628a05ac8f623b6a56bc603f31b811714", + "route_weight_sha256": "050581dfb8d7a5a6cadc874d1a3c4228d6a101531dac31daa472d569e49308cd", + "loads": [ + 7, + 11, + 3, + 4, + 1, + 5, + 2, + 5, + 13, + 2, + 9, + 1, + 5, + 4, + 10, + 7, + 6, + 0, + 3, + 8, + 5, + 12, + 3, + 1, + 8, + 4, + 4, + 6, + 6, + 2, + 3, + 5, + 2, + 1, + 10, + 21, + 2, + 2, + 7, + 4, + 2, + 2, + 13, + 2, + 6, + 2, + 10, + 14, + 8, + 4, + 3, + 8, + 6, + 5, + 0, + 0, + 7, + 8, + 5, + 14, + 14, + 8, + 13, + 16 + ], + "weighted_loads": [ + 0.7725616507232189, + 1.0051259212195873, + 0.174991924315691, + 0.9911820590496063, + 0.03022768907248974, + 0.4363216906785965, + 0.0653901919722557, + 0.21736861020326614, + 1.0852771773934364, + 0.2287508100271225, + 0.4181947335600853, + 0.035147182643413544, + 0.47772698663175106, + 0.23486405797302723, + 0.5235509183257818, + 0.5045484714210033, + 0.2576776370406151, + 0.0, + 0.4642132855951786, + 0.9717994593083858, + 0.6418023519217968, + 1.0957277361303568, + 0.31486136466264725, + 0.08235980570316315, + 0.5023442655801773, + 0.20068451389670372, + 0.17101410403847694, + 0.9221582040190697, + 0.4698753822594881, + 0.196027971804142, + 0.10177266225218773, + 0.32466552406549454, + 0.05601189099252224, + 0.29097980260849, + 0.7771351002156734, + 2.1613470939919353, + 0.05893397144973278, + 0.21973825618624687, + 0.4091870402917266, + 0.4246959835290909, + 0.09478635713458061, + 0.16269606165587902, + 1.4730539880692959, + 0.28426582366228104, + 0.7737635131925344, + 0.08196323737502098, + 0.8640930913388729, + 0.7614157628268003, + 0.6136070322245359, + 0.5449943765997887, + 0.07264822907745838, + 0.881225936114788, + 0.8409440293908119, + 0.2579264026135206, + 0.0, + 0.0, + 0.57453678175807, + 0.34204490296542645, + 0.417837779968977, + 0.8948619235306978, + 0.8684775782749057, + 0.6512908041477203, + 1.0855765528976917, + 1.0884442795068026 + ], + "unique_experts": 61, + "load_cv": 0.7377471337344073, + "normalized_load_entropy": 0.934767221927196, + "max_load_share": 0.0546875 + } + }, + "s0_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "0f11471d828b898b7b32c2662757dd9368021de5a2dad227bd36f9267ca03c2a", + "route_weight_sha256": "95951b45304d45242b7ee1699c63c622a5862613811a19e2ef78b7ca021903d5", + "loads": [ + 3, + 0, + 2, + 2, + 0, + 4, + 2, + 1, + 3, + 1, + 0, + 0, + 4, + 2, + 2, + 6, + 2, + 0, + 3, + 2, + 3, + 0, + 2, + 1, + 2, + 3, + 3, + 4, + 2, + 2, + 2, + 3, + 1, + 1, + 1, + 3, + 2, + 1, + 2, + 1, + 2, + 1, + 4, + 1, + 3, + 2, + 4, + 6, + 6, + 3, + 1, + 0, + 5, + 2, + 0, + 0, + 3, + 2, + 2, + 4, + 1, + 3, + 3, + 2 + ], + "weighted_loads": [ + 0.2493971586227417, + 0.0, + 0.1418182160705328, + 0.23134243115782738, + 0.0, + 0.3005744330585003, + 0.0613753255456686, + 0.04809778556227684, + 0.28959570825099945, + 0.11445265263319016, + 0.0, + 0.0, + 0.4289337433874607, + 0.17342665418982506, + 0.10000863671302795, + 0.47422316670417786, + 0.12601053342223167, + 0.0, + 0.478623915463686, + 0.2052513100206852, + 0.35122206062078476, + 0.0, + 0.25912483781576157, + 0.08017979562282562, + 0.2500692158937454, + 0.15230097249150276, + 0.13714058324694633, + 0.25385984778404236, + 0.17057187855243683, + 0.2010967656970024, + 0.07235699333250523, + 0.28815996646881104, + 0.026867682114243507, + 0.2860420346260071, + 0.4149957597255707, + 0.20169007405638695, + 0.06466925330460072, + 0.18929050862789154, + 0.24302883073687553, + 0.07954079657793045, + 0.09665549173951149, + 0.12951526045799255, + 0.4223703481256962, + 0.10277214646339417, + 0.11914537660777569, + 0.08222260884940624, + 0.28012222051620483, + 0.3552784360945225, + 0.5323081500828266, + 0.47291474789381027, + 0.023807376623153687, + 0.0, + 0.6646094545722008, + 0.08459147438406944, + 0.0, + 0.0, + 0.3169383741915226, + 0.07439972087740898, + 0.19355768710374832, + 0.46925322711467743, + 0.06133197993040085, + 0.2805817425251007, + 0.15969905257225037, + 0.15164264291524887 + ], + "unique_experts": 55, + "load_cv": 0.6869932112748598, + "normalized_load_entropy": 0.9336037101688945, + "max_load_share": 0.043478260869565216 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "502fecd049da66abb97fce30cfa104118a613574f45a0f65a5d8d80e5a0908ff", + "route_weight_sha256": "ea7845c1b9a1faa4769938bb2ce92ea10e7917fab13b566a65c69dfb4055871c", + "loads": [ + 4, + 10, + 2, + 4, + 0, + 4, + 2, + 2, + 8, + 1, + 3, + 0, + 4, + 3, + 6, + 7, + 2, + 0, + 3, + 6, + 5, + 9, + 2, + 1, + 5, + 3, + 3, + 6, + 5, + 2, + 2, + 3, + 1, + 2, + 6, + 17, + 3, + 1, + 6, + 1, + 2, + 1, + 10, + 1, + 3, + 2, + 7, + 12, + 8, + 3, + 1, + 6, + 5, + 2, + 0, + 0, + 3, + 9, + 10, + 9, + 14, + 5, + 9, + 12 + ], + "weighted_loads": [ + 0.5442737638950348, + 0.9491828717291355, + 0.1418182160705328, + 0.9889729507267475, + 0.0, + 0.3005744330585003, + 0.0613753255456686, + 0.09486931562423706, + 0.5710208602249622, + 0.11445265263319016, + 0.12500830367207527, + 0.0, + 0.4289337433874607, + 0.19867531210184097, + 0.27999578416347504, + 0.520687572658062, + 0.12601053342223167, + 0.0, + 0.478623915463686, + 1.0058418549597263, + 0.5946731567382812, + 0.872841976583004, + 0.25912483781576157, + 0.08017979562282562, + 0.37557278759777546, + 0.15230097249150276, + 0.13714058324694633, + 0.5531328022480011, + 0.42755888402462006, + 0.2010967656970024, + 0.07235699333250523, + 0.28815996646881104, + 0.026867682114243507, + 0.3342186249792576, + 0.6386749371886253, + 2.2973863994702697, + 0.08330123126506805, + 0.18929050862789154, + 0.4057177538052201, + 0.07954079657793045, + 0.09665549173951149, + 0.12951526045799255, + 1.0141828656196594, + 0.10277214646339417, + 0.11914537660777569, + 0.08222260884940624, + 0.3729351330548525, + 0.6806190870702267, + 0.5841435734182596, + 0.47291474789381027, + 0.023807376623153687, + 0.5205867029726505, + 0.6646094545722008, + 0.08459147438406944, + 0.0, + 0.0, + 0.3169383741915226, + 0.4482384882867336, + 0.5583963766694069, + 0.6488518100231886, + 1.0212654927745461, + 0.36645954102277756, + 0.7827762812376022, + 0.6116938982158899 + ], + "unique_experts": 59, + "load_cv": 0.8212080832830267, + "normalized_load_entropy": 0.9203562638662529, + "max_load_share": 0.059027777777777776 + } + }, + "s1_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "30979d28fe80945952e7efe923de7629e61e02de46c06cf2098b48acf0a26ea5", + "route_weight_sha256": "07ca12a6ee904dd4eefee70c2ae185886d15ca6c7331553b53207a69ff21ea07", + "loads": [ + 3, + 0, + 2, + 2, + 0, + 4, + 2, + 2, + 3, + 1, + 0, + 0, + 4, + 2, + 2, + 6, + 3, + 0, + 3, + 2, + 3, + 0, + 2, + 1, + 2, + 3, + 4, + 3, + 1, + 2, + 2, + 3, + 1, + 1, + 1, + 3, + 1, + 1, + 2, + 1, + 2, + 2, + 4, + 1, + 3, + 2, + 4, + 6, + 6, + 3, + 1, + 0, + 5, + 2, + 0, + 0, + 3, + 1, + 2, + 3, + 2, + 3, + 2, + 3 + ], + "weighted_loads": [ + 0.25216857343912125, + 0.0, + 0.14862722158432007, + 0.23670325428247452, + 0.0, + 0.2944612167775631, + 0.06551717966794968, + 0.10695323348045349, + 0.2956087812781334, + 0.11147520691156387, + 0.0, + 0.0, + 0.4533417224884033, + 0.17906473577022552, + 0.08989790827035904, + 0.4658256508409977, + 0.16071565821766853, + 0.0, + 0.4647449962794781, + 0.1941777728497982, + 0.36752356588840485, + 0.0, + 0.27339648455381393, + 0.08369232714176178, + 0.2355106920003891, + 0.15197208896279335, + 0.17058969475328922, + 0.2258419319987297, + 0.15207599103450775, + 0.19726135209202766, + 0.06802582927048206, + 0.2823321521282196, + 0.026303565129637718, + 0.28834906220436096, + 0.41470450162887573, + 0.20426534488797188, + 0.041125234216451645, + 0.17371766269207, + 0.24353836104273796, + 0.06918226927518845, + 0.09509829059243202, + 0.15880037285387516, + 0.42051397636532784, + 0.10568341612815857, + 0.1199613306671381, + 0.08332596533000469, + 0.28264622390270233, + 0.33309976756572723, + 0.5433070585131645, + 0.5039227455854416, + 0.024861259385943413, + 0.0, + 0.6694502383470535, + 0.07501986064016819, + 0.0, + 0.0, + 0.3196087218821049, + 0.04013931006193161, + 0.2021709531545639, + 0.41243261471390724, + 0.08733562007546425, + 0.2928801216185093, + 0.10726884752511978, + 0.20083318650722504 + ], + "unique_experts": 55, + "load_cv": 0.6820838623623242, + "normalized_load_entropy": 0.9341957693424127, + "max_load_share": 0.043478260869565216 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "acceb3ff03450183f5c1f1c2d40e7ff889e1019a4f818e440d6ff2d45728ca76", + "route_weight_sha256": "6dfcb47fdfb02920f2c5723ca45817232710dcb622887252783f0f5a929042e8", + "loads": [ + 8, + 11, + 3, + 5, + 1, + 5, + 2, + 5, + 14, + 2, + 7, + 0, + 4, + 4, + 10, + 8, + 6, + 0, + 3, + 8, + 5, + 11, + 3, + 1, + 8, + 4, + 4, + 6, + 6, + 2, + 3, + 5, + 2, + 2, + 10, + 19, + 2, + 2, + 8, + 4, + 2, + 2, + 13, + 2, + 6, + 2, + 11, + 14, + 9, + 4, + 3, + 8, + 6, + 5, + 0, + 0, + 7, + 8, + 4, + 14, + 15, + 8, + 13, + 15 + ], + "weighted_loads": [ + 1.041746336966753, + 1.0051259212195873, + 0.17410295456647873, + 1.0288681723177433, + 0.03022768907248974, + 0.4349997900426388, + 0.06551717966794968, + 0.2175278402864933, + 1.129492249339819, + 0.22854717075824738, + 0.30430085211992264, + 0.0, + 0.4533417224884033, + 0.23055017739534378, + 0.5188900530338287, + 0.5333977192640305, + 0.25752396881580353, + 0.0, + 0.4647449962794781, + 1.0029378235340118, + 0.6006479486823082, + 0.9229757133871317, + 0.3120739758014679, + 0.08369232714176178, + 0.5001165419816971, + 0.20205330848693848, + 0.17058969475328922, + 0.9250617548823357, + 0.431851202622056, + 0.19726135209202766, + 0.10217808373272419, + 0.32526230067014694, + 0.05170059949159622, + 0.3276367112994194, + 0.7833955250680447, + 2.0578786497935653, + 0.05964754894375801, + 0.21539905294775963, + 0.47308367025107145, + 0.4243500828742981, + 0.09509829059243202, + 0.15880037285387516, + 1.4780982173979282, + 0.2863032966852188, + 0.7731999550014734, + 0.08332596533000469, + 0.8854323886334896, + 0.7600198201835155, + 0.6365425121039152, + 0.5468098148703575, + 0.07276757434010506, + 0.846543624997139, + 0.8455364108085632, + 0.25811492651700974, + 0.0, + 0.0, + 0.5728193297982216, + 0.33869304694235325, + 0.31310660019516945, + 0.9178359266370535, + 0.8832264831289649, + 0.6564265564084053, + 1.0898356661200523, + 1.0278279967606068 + ], + "unique_experts": 60, + "load_cv": 0.7276770498572075, + "normalized_load_entropy": 0.9345376152957962, + "max_load_share": 0.049479166666666664 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "ordered_topk_exact_tokens": 22, + "set_exact_tokens": 22, + "mean_set_jaccard": 0.9875776397515529, + "mean_token_weighted_tv": 0.007246419827899207, + "aggregate_load_tv": 0.007246376811594203 + }, + "system_bos": { + "tokens": 23, + "ordered_topk_exact_tokens": 17, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.9503105590062112, + "mean_token_weighted_tv": 0.016328545813651188, + "aggregate_load_tv": 0.028985507246376812 + }, + "system_x": { + "tokens": 23, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.9503105590062112, + "mean_token_weighted_tv": 0.01759079742528822, + "aggregate_load_tv": 0.028985507246376812 + }, + "system_period": { + "tokens": 23, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.9254658385093167, + "mean_token_weighted_tv": 0.020798324445343536, + "aggregate_load_tv": 0.043478260869565216 + }, + "bos_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.9254658385093169, + "mean_token_weighted_tv": 0.029309497214853764, + "aggregate_load_tv": 0.043478260869565216 + }, + "bos_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.9503105590062112, + "mean_token_weighted_tv": 0.02630000735592583, + "aggregate_load_tv": 0.028985507246376815 + }, + "x_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.9130434782608695, + "mean_token_weighted_tv": 0.030791707984779194, + "aggregate_load_tv": 0.050724637681159424 + }, + "x_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.9503105590062112, + "mean_token_weighted_tv": 0.027317848866400513, + "aggregate_load_tv": 0.028985507246376815 + }, + "period_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.9254658385093167, + "mean_token_weighted_tv": 0.02838258793496567, + "aggregate_load_tv": 0.043478260869565216 + }, + "period_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.9503105590062112, + "mean_token_weighted_tv": 0.02695937349420527, + "aggregate_load_tv": 0.028985507246376815 + } + } + }, + "layer_03": { + "layer": 3, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "2a01d9b2269e9b1878cf662837c3f525b5ea1ba50d18a452fc86492fc44a74c8", + "route_weight_sha256": "7135907b6efa6850e1a0be8e17724178e2fb3d3f8b88f9a14c3fcffde9e05c8d", + "loads": [ + 1, + 3, + 4, + 3, + 2, + 0, + 3, + 1, + 3, + 6, + 3, + 1, + 0, + 0, + 4, + 1, + 2, + 2, + 1, + 2, + 2, + 3, + 4, + 1, + 2, + 3, + 0, + 5, + 3, + 1, + 2, + 0, + 2, + 4, + 3, + 3, + 1, + 1, + 1, + 2, + 0, + 1, + 5, + 0, + 2, + 2, + 1, + 1, + 2, + 2, + 4, + 2, + 3, + 3, + 2, + 3, + 0, + 4, + 1, + 2, + 6, + 1, + 3, + 3 + ], + "weighted_loads": [ + 0.043261975049972534, + 0.23702173680067062, + 0.30970554798841476, + 0.18189843371510506, + 0.1963513419032097, + 0.0, + 0.23959842510521412, + 0.034161847084760666, + 0.29209284856915474, + 0.7918194383382797, + 0.24059763923287392, + 0.181183323264122, + 0.0, + 0.0, + 0.27951470017433167, + 0.17426928877830505, + 0.1022554524242878, + 0.11260433495044708, + 0.13702408969402313, + 0.13980456069111824, + 0.12446785531938076, + 0.3966875448822975, + 0.2324587218463421, + 0.07452058792114258, + 0.20972643792629242, + 0.2580857090651989, + 0.0, + 0.4520947113633156, + 0.29988008737564087, + 0.10136352479457855, + 0.14765162020921707, + 0.0, + 0.13511104509234428, + 0.13449815101921558, + 0.11076421290636063, + 0.31884077936410904, + 0.08615761995315552, + 0.06825820356607437, + 0.12525740265846252, + 0.11983649805188179, + 0.0, + 0.05911285802721977, + 0.5350780915468931, + 0.0, + 0.13183613494038582, + 0.25431057810783386, + 0.03049645945429802, + 0.08652332425117493, + 0.10878417640924454, + 0.13213487714529037, + 0.20872516930103302, + 0.07151547819375992, + 0.2842969670891762, + 0.32641829177737236, + 0.07567101716995239, + 0.235976941883564, + 0.0, + 0.38622328639030457, + 0.028741730377078056, + 0.08035463467240334, + 0.34822333604097366, + 0.03790860250592232, + 0.3608097955584526, + 0.3241727501153946 + ], + "unique_experts": 56, + "load_cv": 0.6721576014669699, + "normalized_load_entropy": 0.9364906178084635, + "max_load_share": 0.043478260869565216 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "ff3fb833b59b90d9fdbf3809cf7ac2862a0f10c65a2c56b12d2f147a20d431d3", + "route_weight_sha256": "2d127f8160d62ad4799bc664628438c57c019f4fe8b923ec35ee77b819825c9c", + "loads": [ + 10, + 3, + 4, + 14, + 4, + 3, + 3, + 9, + 3, + 12, + 4, + 2, + 2, + 5, + 10, + 1, + 2, + 2, + 1, + 2, + 4, + 6, + 9, + 2, + 2, + 5, + 0, + 12, + 3, + 4, + 3, + 0, + 2, + 4, + 12, + 3, + 1, + 1, + 1, + 2, + 0, + 2, + 14, + 0, + 2, + 2, + 18, + 1, + 10, + 12, + 4, + 2, + 4, + 3, + 6, + 3, + 0, + 5, + 1, + 2, + 13, + 1, + 7, + 4 + ], + "weighted_loads": [ + 1.2650939039885998, + 0.23702173680067062, + 0.30970554798841476, + 0.8125639818608761, + 0.22499699931358919, + 0.12976271659135818, + 0.23959842510521412, + 1.3163917660713196, + 0.29209284856915474, + 1.0824595681624487, + 0.2761789821088314, + 0.18206054827896878, + 0.012014938634820282, + 0.3646407909691334, + 0.6834218353033066, + 0.17426928877830505, + 0.1022554524242878, + 0.11260433495044708, + 0.13702408969402313, + 0.13980456069111824, + 0.197568753734231, + 0.6949098408222198, + 0.6704864539206028, + 0.1019865870475769, + 0.20972643792629242, + 0.2717210380360484, + 0.0, + 0.7145699672400951, + 0.29988008737564087, + 0.25072911381721497, + 0.1939820758998394, + 0.0, + 0.13511104509234428, + 0.13449815101921558, + 1.1423829309642315, + 0.31884077936410904, + 0.08615761995315552, + 0.06825820356607437, + 0.12525740265846252, + 0.11983649805188179, + 0.0, + 0.07046221848577261, + 1.0777070689946413, + 0.0, + 0.13183613494038582, + 0.25431057810783386, + 2.1765832975506783, + 0.08652332425117493, + 1.0488044880330563, + 0.7496596090495586, + 0.20872516930103302, + 0.07151547819375992, + 0.29895633924752474, + 0.32641829177737236, + 1.9094176441431046, + 0.235976941883564, + 0.0, + 0.398986185900867, + 0.028741730377078056, + 0.08035463467240334, + 0.8755137976258993, + 0.03790860250592232, + 0.8014155626296997, + 0.3624494820833206 + ], + "unique_experts": 59, + "load_cv": 0.9262962222518369, + "normalized_load_entropy": 0.9062959837517017, + "max_load_share": 0.0625 + } + }, + "s1_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "10f79ee7e9d84d0fa82416ef846960ba91b4521d18ad128c6d4d1e7ec62bb6c4", + "route_weight_sha256": "6e52114ccf8a69cfbea2c2f32282734d2bc3af32813d1c2343713efdeba25ae9", + "loads": [ + 1, + 3, + 4, + 3, + 2, + 0, + 2, + 1, + 3, + 6, + 3, + 1, + 0, + 0, + 5, + 1, + 2, + 1, + 1, + 2, + 2, + 3, + 4, + 1, + 2, + 3, + 0, + 5, + 4, + 1, + 2, + 0, + 2, + 4, + 3, + 2, + 1, + 1, + 1, + 2, + 0, + 1, + 5, + 0, + 2, + 2, + 1, + 1, + 2, + 3, + 4, + 2, + 3, + 3, + 2, + 3, + 0, + 4, + 1, + 2, + 6, + 1, + 3, + 3 + ], + "weighted_loads": [ + 0.04983362928032875, + 0.23753631487488747, + 0.3092687353491783, + 0.17980193346738815, + 0.19526392221450806, + 0.0, + 0.223163940012455, + 0.03269203007221222, + 0.29757775738835335, + 0.7854992300271988, + 0.24067753553390503, + 0.18619820475578308, + 0.0, + 0.0, + 0.32353996112942696, + 0.17200367152690887, + 0.10590630024671555, + 0.06260532885789871, + 0.1331816464662552, + 0.14396854117512703, + 0.12499844282865524, + 0.4024451747536659, + 0.23167436942458153, + 0.07681785523891449, + 0.21245790272951126, + 0.26176921650767326, + 0.0, + 0.4637691453099251, + 0.32715779915452003, + 0.10125483572483063, + 0.14872543886303902, + 0.0, + 0.14002659544348717, + 0.13341985829174519, + 0.10789844207465649, + 0.28004562109708786, + 0.08298221230506897, + 0.07280664145946503, + 0.12439084053039551, + 0.11709745228290558, + 0.0, + 0.05690911039710045, + 0.5216780826449394, + 0.0, + 0.1308802254498005, + 0.261077880859375, + 0.02952820248901844, + 0.08528444170951843, + 0.11009420081973076, + 0.18263090029358864, + 0.19770147278904915, + 0.0738711915910244, + 0.2809736728668213, + 0.3283518850803375, + 0.07566775195300579, + 0.23645584285259247, + 0.0, + 0.37742410227656364, + 0.029047878459095955, + 0.0821942575275898, + 0.35020800307393074, + 0.03877737745642662, + 0.37011289596557617, + 0.3369296044111252 + ], + "unique_experts": 56, + "load_cv": 0.6918677253495659, + "normalized_load_entropy": 0.9339545484001185, + "max_load_share": 0.043478260869565216 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "b27dcd2089d819c91fc12277aa6ae62028760de7ac39d7d8d75aa9ac9e8f9f14", + "route_weight_sha256": "b57e166c027d2e2f19325758d28603cec6514476107c16a1bb901bb533b26e3f", + "loads": [ + 14, + 5, + 4, + 15, + 3, + 6, + 2, + 12, + 3, + 15, + 6, + 2, + 4, + 6, + 13, + 2, + 4, + 1, + 2, + 2, + 4, + 9, + 14, + 1, + 4, + 6, + 0, + 8, + 4, + 4, + 3, + 0, + 2, + 6, + 11, + 2, + 1, + 6, + 1, + 3, + 1, + 2, + 19, + 2, + 2, + 5, + 22, + 1, + 12, + 13, + 4, + 8, + 7, + 8, + 6, + 7, + 0, + 5, + 8, + 3, + 19, + 2, + 9, + 9 + ], + "weighted_loads": [ + 1.650143338367343, + 0.31170106306672096, + 0.3092687353491783, + 0.8752078711986542, + 0.19580209854757413, + 0.27465662732720375, + 0.223163940012455, + 1.392535362392664, + 0.29757775738835335, + 1.2499011299805716, + 0.3254141714423895, + 0.18707542977062985, + 0.08883492380846292, + 0.4217071644961834, + 0.9063618220388889, + 0.22080015018582344, + 0.3201350048184395, + 0.06260532885789871, + 0.18828847259283066, + 0.14396854117512703, + 0.19171630591154099, + 0.7776305302977562, + 1.184485089033842, + 0.07681785523891449, + 0.31603554263710976, + 0.3190529327839613, + 0.0, + 0.5604206658899784, + 0.32715779915452003, + 0.23991966620087624, + 0.19036751240491867, + 0.0, + 0.14002659544348717, + 0.2061073575168848, + 1.021082716062665, + 0.28004562109708786, + 0.08298221230506897, + 0.4884571637958288, + 0.12439084053039551, + 0.16715384274721146, + 0.07499654591083527, + 0.06570530217140913, + 1.1935462523251772, + 0.07386156916618347, + 0.1308802254498005, + 0.5029121674597263, + 2.746872825548053, + 0.08528444170951843, + 1.3582799397408962, + 0.6521797440946102, + 0.19770147278904915, + 0.8543030768632889, + 0.4922901727259159, + 1.0459134206175804, + 1.978160748258233, + 0.4688049405813217, + 0.0, + 0.386452192440629, + 0.5174924749881029, + 0.11278561688959599, + 1.171271601691842, + 0.08891976252198219, + 0.8399627581238747, + 0.747605737298727 + ], + "unique_experts": 61, + "load_cv": 0.8431710977020025, + "normalized_load_entropy": 0.9196689214687618, + "max_load_share": 0.057291666666666664 + } + }, + "s0_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "0a4a584e84cd530bde8f3e82208746f04b7609f1d407e97923525c26769369eb", + "route_weight_sha256": "2d6d01fdd0c33ec3273d2f7f6ac997344814416d6786dc9904645137cd4bf177", + "loads": [ + 0, + 3, + 4, + 3, + 2, + 0, + 3, + 0, + 3, + 6, + 3, + 1, + 0, + 0, + 4, + 1, + 2, + 1, + 1, + 3, + 2, + 3, + 5, + 1, + 2, + 3, + 0, + 5, + 3, + 1, + 2, + 0, + 2, + 4, + 2, + 3, + 1, + 1, + 1, + 2, + 0, + 1, + 5, + 0, + 2, + 2, + 1, + 1, + 2, + 4, + 4, + 1, + 3, + 3, + 3, + 3, + 0, + 4, + 2, + 1, + 7, + 0, + 3, + 3 + ], + "weighted_loads": [ + 0.0, + 0.2485041357576847, + 0.3000700995326042, + 0.17928089946508408, + 0.19897420704364777, + 0.0, + 0.21380625292658806, + 0.0, + 0.2867494896054268, + 0.7608172930777073, + 0.25191004015505314, + 0.18723875284194946, + 0.0, + 0.0, + 0.2570943683385849, + 0.17173239588737488, + 0.1120547279715538, + 0.07116833329200745, + 0.12808316946029663, + 0.1791679635643959, + 0.13354691490530968, + 0.40454819798469543, + 0.2624245956540108, + 0.06541368365287781, + 0.19993474334478378, + 0.2726386785507202, + 0.0, + 0.43615947291255, + 0.28065645694732666, + 0.09108708053827286, + 0.14563224837183952, + 0.0, + 0.1467735432088375, + 0.12749648466706276, + 0.08734719827771187, + 0.3454914316534996, + 0.07712774723768234, + 0.06262221932411194, + 0.10821574926376343, + 0.12503082305192947, + 0.0, + 0.05521850287914276, + 0.5274701565504074, + 0.0, + 0.12991764023900032, + 0.24311218410730362, + 0.0291555505245924, + 0.08337826281785965, + 0.10186607018113136, + 0.206916781142354, + 0.2231280542910099, + 0.03567502275109291, + 0.28915248066186905, + 0.3300607278943062, + 0.10504592396318913, + 0.21617292612791061, + 0.0, + 0.3847412057220936, + 0.056050052866339684, + 0.04191642999649048, + 0.44108254835009575, + 0.0, + 0.3357763960957527, + 0.34668806940317154 + ], + "unique_experts": 53, + "load_cv": 0.7433807885931687, + "normalized_load_entropy": 0.9213864663269702, + "max_load_share": 0.050724637681159424 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "c12f4da49123a82f36039b0e3faa68ffe155871ee6fbd60ac7698c38f4715659", + "route_weight_sha256": "3a52d8d29d0db342c8cc1cef6f348eaafe30e026c65d1b8a7cbdcae13aa82d5a", + "loads": [ + 10, + 3, + 4, + 14, + 4, + 4, + 3, + 8, + 3, + 11, + 5, + 2, + 1, + 4, + 10, + 1, + 2, + 1, + 2, + 3, + 4, + 6, + 11, + 3, + 2, + 4, + 0, + 12, + 3, + 5, + 3, + 0, + 2, + 4, + 10, + 3, + 1, + 1, + 1, + 2, + 0, + 1, + 15, + 0, + 2, + 2, + 17, + 1, + 12, + 14, + 4, + 1, + 3, + 3, + 6, + 3, + 0, + 4, + 2, + 1, + 14, + 0, + 7, + 4 + ], + "weighted_loads": [ + 1.3704344406723976, + 0.2485041357576847, + 0.3000700995326042, + 0.8023016024380922, + 0.22761986445402727, + 0.17487969994544983, + 0.21380625292658806, + 1.1233486719429493, + 0.2867494896054268, + 1.023641451378353, + 0.3198603671044111, + 0.18811597785679623, + 0.00047708500642329454, + 0.35042326152324677, + 0.6784356534481049, + 0.17173239588737488, + 0.1120547279715538, + 0.07116833329200745, + 0.16531235724687576, + 0.1791679635643959, + 0.20527678355574608, + 0.7080362737178802, + 0.7080575302243233, + 0.1219417080283165, + 0.19993474334478378, + 0.2731684846803546, + 0.0, + 0.6986347287893295, + 0.28065645694732666, + 0.2884584255516529, + 0.19196270406246185, + 0.0, + 0.1467735432088375, + 0.12749648466706276, + 1.082739494740963, + 0.3454914316534996, + 0.07712774723768234, + 0.06262221932411194, + 0.10821574926376343, + 0.12503082305192947, + 0.0, + 0.05521850287914276, + 1.1907100044190884, + 0.0, + 0.12991764023900032, + 0.24311218410730362, + 2.3214639145880938, + 0.08337826281785965, + 1.1604512445628643, + 0.8244415130466223, + 0.2231280542910099, + 0.03567502275109291, + 0.28915248066186905, + 0.3300607278943062, + 1.236480312421918, + 0.21617292612791061, + 0.0, + 0.3847412057220936, + 0.056050052866339684, + 0.04191642999649048, + 0.9666985552757978, + 0.0, + 0.7786079049110413, + 0.38496480137109756 + ], + "unique_experts": 58, + "load_cv": 0.9525793444156805, + "normalized_load_entropy": 0.8998499710902228, + "max_load_share": 0.059027777777777776 + } + }, + "s1_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "68df68643721bd97edd3d2a61bae60e978979b99eeba96be62de85c8a519b65e", + "route_weight_sha256": "7127988290f331aeda2f16cb51232e3e88236ef0d403c5a7aefbf1bf3eef8739", + "loads": [ + 0, + 3, + 4, + 3, + 2, + 0, + 2, + 1, + 3, + 6, + 3, + 1, + 0, + 0, + 4, + 1, + 2, + 2, + 1, + 3, + 2, + 3, + 5, + 1, + 2, + 3, + 0, + 5, + 3, + 1, + 2, + 1, + 2, + 4, + 1, + 4, + 1, + 1, + 1, + 2, + 0, + 1, + 5, + 0, + 2, + 2, + 1, + 1, + 2, + 4, + 3, + 2, + 3, + 3, + 2, + 3, + 0, + 5, + 0, + 2, + 6, + 0, + 3, + 3 + ], + "weighted_loads": [ + 0.0, + 0.24542907997965813, + 0.31034817546606064, + 0.17591705918312073, + 0.19770602136850357, + 0.0, + 0.19592203944921494, + 0.03643595799803734, + 0.29372477158904076, + 0.7324187159538269, + 0.25606248155236244, + 0.19035105407238007, + 0.0, + 0.0, + 0.24814723804593086, + 0.1759689897298813, + 0.11457019299268723, + 0.09195720590651035, + 0.12047164142131805, + 0.18018653616309166, + 0.1308266557753086, + 0.40100107342004776, + 0.2551080659031868, + 0.06818738579750061, + 0.20171278715133667, + 0.274769552052021, + 0.0, + 0.455390777438879, + 0.3192359358072281, + 0.09135205298662186, + 0.14830471947789192, + 0.029811084270477295, + 0.14780840277671814, + 0.12701157666742802, + 0.04704657196998596, + 0.3889222703874111, + 0.0782993957400322, + 0.06560434401035309, + 0.10691400617361069, + 0.11696209385991096, + 0.0, + 0.05356649309396744, + 0.5379915200173855, + 0.0, + 0.13015759363770485, + 0.23518510907888412, + 0.026617826893925667, + 0.08260440826416016, + 0.09186334535479546, + 0.21243293024599552, + 0.1798667535185814, + 0.06419725716114044, + 0.2990785241127014, + 0.34687625244259834, + 0.06585347093641758, + 0.21696996688842773, + 0.0, + 0.39716571010649204, + 0.0, + 0.08540927246212959, + 0.42446674406528473, + 0.0, + 0.3330695182085037, + 0.3550672195851803 + ], + "unique_experts": 54, + "load_cv": 0.7204225229934242, + "normalized_load_entropy": 0.9262679204090551, + "max_load_share": 0.043478260869565216 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "cdabb31420a7d89c160449ad8ca05e5a7813db48efed91de26501252346536c1", + "route_weight_sha256": "fe0204dbf3e01703e0d150cd15f8fd08541c51c876549f10f07e99851f53f274", + "loads": [ + 14, + 5, + 4, + 15, + 3, + 5, + 2, + 12, + 3, + 15, + 6, + 2, + 3, + 6, + 12, + 2, + 4, + 2, + 3, + 3, + 4, + 9, + 16, + 1, + 4, + 5, + 0, + 8, + 3, + 4, + 3, + 1, + 2, + 6, + 9, + 4, + 1, + 6, + 1, + 3, + 1, + 1, + 20, + 3, + 2, + 6, + 22, + 1, + 13, + 14, + 3, + 8, + 6, + 8, + 5, + 7, + 0, + 5, + 7, + 3, + 19, + 1, + 9, + 9 + ], + "weighted_loads": [ + 1.705185905098915, + 0.3195938281714916, + 0.31034817546606064, + 0.8685686998069286, + 0.19824419770156965, + 0.23833811283111572, + 0.19592203944921494, + 1.2998370081186295, + 0.29372477158904076, + 1.1995134531753138, + 0.3407991174608469, + 0.19122827908722684, + 0.0809301194967702, + 0.455929197371006, + 0.854986023157835, + 0.22476546838879585, + 0.32879889756441116, + 0.09195720590651035, + 0.21211979538202286, + 0.18018653616309166, + 0.20164208859205246, + 0.782655343413353, + 1.1932093929499388, + 0.06818738579750061, + 0.30529042705893517, + 0.3232325306162238, + 0.0, + 0.5520422980189323, + 0.3192359358072281, + 0.23300028964877129, + 0.18994679301977158, + 0.029811084270477295, + 0.14780840277671814, + 0.19969907589256763, + 0.9684120379388332, + 0.3889222703874111, + 0.0782993957400322, + 0.4812548663467169, + 0.10691400617361069, + 0.16701848432421684, + 0.07499654591083527, + 0.05356649309396744, + 1.3558526244014502, + 0.1049862764775753, + 0.13015759363770485, + 0.5184941776096821, + 2.70390404202044, + 0.08260440826416016, + 1.3812828995287418, + 0.6819817740470171, + 0.1798667535185814, + 0.8446291424334049, + 0.5000276453793049, + 1.0644377879798412, + 1.1790393721312284, + 0.449319064617157, + 0.0, + 0.39716571010649204, + 0.48844459652900696, + 0.11600063182413578, + 1.2425962518900633, + 0.05014238506555557, + 0.8355143219232559, + 0.7657433524727821 + ], + "unique_experts": 62, + "load_cv": 0.8534041311776684, + "normalized_load_entropy": 0.9203908698316163, + "max_load_share": 0.057291666666666664 + } + }, + "s0_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "a9c083917a0aa5fbe5679997708c4e24691f1a9379bc5fa8fdacfcc0ed218aaa", + "route_weight_sha256": "33c08f4b9c420d1c186d98d63ea8c50852a87b02dea1d88088e24be76d2a21cf", + "loads": [ + 0, + 3, + 5, + 3, + 2, + 0, + 3, + 0, + 3, + 6, + 3, + 1, + 0, + 0, + 4, + 1, + 2, + 1, + 1, + 2, + 2, + 3, + 5, + 1, + 2, + 3, + 0, + 5, + 3, + 1, + 2, + 1, + 2, + 4, + 2, + 3, + 1, + 1, + 1, + 2, + 0, + 1, + 5, + 0, + 2, + 2, + 1, + 1, + 2, + 4, + 3, + 3, + 3, + 3, + 2, + 3, + 0, + 4, + 0, + 1, + 7, + 1, + 3, + 3 + ], + "weighted_loads": [ + 0.0, + 0.24629784747958183, + 0.34064067527651787, + 0.17727114632725716, + 0.19811677187681198, + 0.0, + 0.21547730639576912, + 0.0, + 0.2869241237640381, + 0.7276168651878834, + 0.2526770457625389, + 0.18705208599567413, + 0.0, + 0.0, + 0.2623263895511627, + 0.1618085652589798, + 0.1158020943403244, + 0.06441682577133179, + 0.12635663151741028, + 0.1372753009200096, + 0.12404683604836464, + 0.39170820266008377, + 0.25664140842854977, + 0.06666484475135803, + 0.1985100358724594, + 0.2662651613354683, + 0.0, + 0.4660147428512573, + 0.293720044195652, + 0.09323745220899582, + 0.14854219183325768, + 0.027283137664198875, + 0.13630660623311996, + 0.12502210400998592, + 0.09166345745325089, + 0.33821776509284973, + 0.07736894488334656, + 0.07388772070407867, + 0.10361693054437637, + 0.12035694345831871, + 0.0, + 0.056446220725774765, + 0.5158816240727901, + 0.0, + 0.1333993785083294, + 0.2547354996204376, + 0.028258495032787323, + 0.08495121449232101, + 0.0960327722132206, + 0.21101961098611355, + 0.16813667491078377, + 0.09814895316958427, + 0.3009093403816223, + 0.32134846970438957, + 0.07088059931993484, + 0.22618228942155838, + 0.0, + 0.36946575343608856, + 0.0, + 0.04099971055984497, + 0.44368115812540054, + 0.03761797025799751, + 0.35054677724838257, + 0.3409609720110893 + ], + "unique_experts": 54, + "load_cv": 0.7388462084945441, + "normalized_load_entropy": 0.9242733739665394, + "max_load_share": 0.050724637681159424 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "e51c3c13dcd48934e014fb9b71805586ccf79dda5253b2533ec90f0937791479", + "route_weight_sha256": "e9f28fbccbaf1ff0be1d7c7676f0e2daeb4fbd86cec260122198c6c7c073d097", + "loads": [ + 7, + 3, + 5, + 15, + 5, + 2, + 3, + 9, + 3, + 11, + 4, + 2, + 1, + 4, + 10, + 1, + 2, + 1, + 2, + 2, + 3, + 6, + 10, + 2, + 2, + 4, + 1, + 13, + 3, + 5, + 3, + 1, + 2, + 4, + 11, + 3, + 2, + 1, + 1, + 2, + 0, + 1, + 15, + 0, + 2, + 3, + 18, + 1, + 10, + 15, + 3, + 3, + 3, + 3, + 5, + 3, + 0, + 4, + 0, + 1, + 15, + 1, + 7, + 4 + ], + "weighted_loads": [ + 1.0320870578289032, + 0.24629784747958183, + 0.34064067527651787, + 0.9374844469130039, + 0.25779501016950235, + 0.09165490046143532, + 0.21547730639576912, + 1.1529735401272774, + 0.2869241237640381, + 1.0151381894247606, + 0.2882583886384964, + 0.1879293110105209, + 0.00047708500642329454, + 0.34577636793255806, + 0.6453195437788963, + 0.1618085652589798, + 0.1158020943403244, + 0.06441682577133179, + 0.1594243124127388, + 0.1372753009200096, + 0.150766059756279, + 0.6957566812634468, + 0.6720399837940931, + 0.09413084387779236, + 0.1985100358724594, + 0.2667949674651027, + 0.042466986924409866, + 0.7756570987403393, + 0.293720044195652, + 0.29986485838890076, + 0.19487264752388, + 0.027283137664198875, + 0.13630660623311996, + 0.12502210400998592, + 1.1890267990529537, + 0.33821776509284973, + 0.12559419497847557, + 0.07388772070407867, + 0.10361693054437637, + 0.12035694345831871, + 0.0, + 0.056446220725774765, + 1.1372185051441193, + 0.0, + 0.1333993785083294, + 0.2980530150234699, + 2.3796335458755493, + 0.08495121449232101, + 0.991817019879818, + 0.8917113933712244, + 0.16813667491078377, + 0.09814895316958427, + 0.3009093403816223, + 0.32134846970438957, + 1.1807110607624054, + 0.22618228942155838, + 0.0, + 0.36946575343608856, + 0.0, + 0.04099971055984497, + 1.0314096417278051, + 0.03761797025799751, + 0.7937130257487297, + 0.37923770397901535 + ], + "unique_experts": 60, + "load_cv": 0.9710310162749186, + "normalized_load_entropy": 0.9016210020303537, + "max_load_share": 0.0625 + } + }, + "s1_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "babfc35eb35bb3689f71ceb0495cf2576ae4ca3fb065f1e3d0d4b8d622836653", + "route_weight_sha256": "94df324c8fdbccdc8c3d58b41734a3fc922c43b18bb3d2e5f11955f4b0e746bb", + "loads": [ + 0, + 3, + 4, + 3, + 2, + 1, + 2, + 1, + 2, + 6, + 3, + 1, + 0, + 0, + 4, + 1, + 2, + 2, + 1, + 3, + 2, + 3, + 4, + 1, + 2, + 3, + 0, + 5, + 3, + 1, + 2, + 1, + 2, + 4, + 3, + 4, + 1, + 1, + 1, + 2, + 0, + 1, + 5, + 0, + 2, + 2, + 0, + 1, + 2, + 3, + 3, + 3, + 3, + 3, + 2, + 3, + 0, + 4, + 0, + 2, + 7, + 0, + 3, + 3 + ], + "weighted_loads": [ + 0.0, + 0.2444106675684452, + 0.3076372854411602, + 0.17182661965489388, + 0.19554248452186584, + 0.02623843587934971, + 0.20055094361305237, + 0.04545191675424576, + 0.25689662620425224, + 0.70295025780797, + 0.254750058054924, + 0.1902606338262558, + 0.0, + 0.0, + 0.2528057098388672, + 0.17529721558094025, + 0.11616909131407738, + 0.08715935051441193, + 0.1098717674612999, + 0.17708730325102806, + 0.12593905441462994, + 0.3997056409716606, + 0.2134414203464985, + 0.0701015368103981, + 0.20034876465797424, + 0.27042583376169205, + 0.0, + 0.4578718729317188, + 0.32381071895360947, + 0.09095146507024765, + 0.14670046046376228, + 0.029911909252405167, + 0.14647353067994118, + 0.1254141815006733, + 0.10706563293933868, + 0.38566305488348007, + 0.07725433260202408, + 0.07021423429250717, + 0.1030237078666687, + 0.11496346071362495, + 0.0, + 0.05353569611907005, + 0.5516996942460537, + 0.0, + 0.12781714275479317, + 0.24164526909589767, + 0.0, + 0.08172410726547241, + 0.08292420580983162, + 0.18862559646368027, + 0.18075353279709816, + 0.09258400090038776, + 0.30826492607593536, + 0.3382304646074772, + 0.06440342962741852, + 0.2216697707772255, + 0.0, + 0.35933446884155273, + 0.0, + 0.08309920504689217, + 0.4795262776315212, + 0.0, + 0.3215539827942848, + 0.35820793733000755 + ], + "unique_experts": 54, + "load_cv": 0.7110316853354249, + "normalized_load_entropy": 0.9281613944361934, + "max_load_share": 0.050724637681159424 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "52f0dd57c60778aada40cd9c9fbf4dad3ebe4becfb638b0a8474e29f7d949dba", + "route_weight_sha256": "5a3561cb28e1616b234d111a261707ffbacbfcaedce6aa522ef65936907b95b0", + "loads": [ + 11, + 5, + 4, + 16, + 4, + 5, + 2, + 12, + 2, + 15, + 6, + 2, + 3, + 6, + 12, + 2, + 4, + 2, + 2, + 3, + 3, + 9, + 14, + 2, + 4, + 5, + 1, + 9, + 3, + 5, + 3, + 1, + 2, + 6, + 11, + 4, + 2, + 6, + 1, + 3, + 1, + 1, + 20, + 3, + 2, + 7, + 20, + 1, + 12, + 14, + 3, + 9, + 6, + 8, + 5, + 7, + 0, + 4, + 7, + 3, + 20, + 1, + 9, + 9 + ], + "weighted_loads": [ + 1.3873137421905994, + 0.3185754157602787, + 0.3076372854411602, + 1.0117812901735306, + 0.22698525193845853, + 0.21533658914268017, + 0.20055094361305237, + 1.3018119968473911, + 0.25689662620425224, + 1.1897282555000857, + 0.33948669396340847, + 0.19113785884110257, + 0.0809301194967702, + 0.44714319705963135, + 0.8333404064178467, + 0.2240936942398548, + 0.3303977958858013, + 0.08715935051441193, + 0.16497859358787537, + 0.17708730325102806, + 0.15830920077860355, + 0.7836505472660065, + 1.1217987574636936, + 0.09039766900241375, + 0.30392640456557274, + 0.31888881232589483, + 0.03909144923090935, + 0.5991077870130539, + 0.32381071895360947, + 0.27546800673007965, + 0.18834253400564194, + 0.029911909252405167, + 0.14647353067994118, + 0.1981016807258129, + 1.072805069386959, + 0.38566305488348007, + 0.1182829737663269, + 0.48586475662887096, + 0.1030237078666687, + 0.16501985117793083, + 0.07499654591083527, + 0.05353569611907005, + 1.2840289939194918, + 0.10499436222016811, + 0.12781714275479317, + 0.5710357204079628, + 2.664613366127014, + 0.08172410726547241, + 1.2365932874381542, + 0.7168099842965603, + 0.18075353279709816, + 0.8730158861726522, + 0.5092140473425388, + 1.05579200014472, + 1.1566090993583202, + 0.45401886850595474, + 0.0, + 0.35933446884155273, + 0.48844459652900696, + 0.11369056440889835, + 1.3481574151664972, + 0.05014238506555557, + 0.8089548051357269, + 0.7688840702176094 + ], + "unique_experts": 63, + "load_cv": 0.8302024518821365, + "normalized_load_entropy": 0.9248881635653454, + "max_load_share": 0.052083333333333336 + } + }, + "s0_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "dabecda339142fd06ad96cbc4fed19b0aefef9c6db70567fc2746a0de1983c78", + "route_weight_sha256": "8f1e67025bcecfe4d94f2a3278506a44e242336ab24e3bf2b5fe50dd65db739b", + "loads": [ + 0, + 3, + 4, + 3, + 2, + 0, + 3, + 0, + 3, + 6, + 3, + 1, + 0, + 0, + 4, + 1, + 2, + 1, + 1, + 2, + 2, + 3, + 5, + 1, + 2, + 3, + 0, + 5, + 3, + 1, + 2, + 1, + 2, + 4, + 2, + 3, + 1, + 1, + 1, + 2, + 0, + 1, + 5, + 0, + 2, + 2, + 1, + 1, + 2, + 4, + 4, + 2, + 3, + 3, + 2, + 3, + 0, + 5, + 0, + 1, + 7, + 1, + 3, + 3 + ], + "weighted_loads": [ + 0.0, + 0.25215697288513184, + 0.2930750995874405, + 0.17110340297222137, + 0.1983773484826088, + 0.0, + 0.2156601194292307, + 0.0, + 0.28806956112384796, + 0.7114792875945568, + 0.2528482414782047, + 0.1869059056043625, + 0.0, + 0.0, + 0.26595330238342285, + 0.16492556035518646, + 0.11604108288884163, + 0.0638943538069725, + 0.1290777623653412, + 0.13731792569160461, + 0.12377423420548439, + 0.40142400562763214, + 0.25262253545224667, + 0.0667511448264122, + 0.20375171303749084, + 0.2623187191784382, + 0.0, + 0.4646795094013214, + 0.2932160720229149, + 0.09393841028213501, + 0.1502525880932808, + 0.028023237362504005, + 0.13683050870895386, + 0.12591253221035004, + 0.08763410523533821, + 0.34633419662714005, + 0.07876602560281754, + 0.07153962552547455, + 0.10323930531740189, + 0.12126058712601662, + 0.0, + 0.05619917809963226, + 0.5043608695268631, + 0.0, + 0.13559961691498756, + 0.2581571266055107, + 0.027283960953354836, + 0.0840398445725441, + 0.09128059446811676, + 0.2077207062393427, + 0.20857203379273415, + 0.06840116903185844, + 0.3007346913218498, + 0.32249171286821365, + 0.06984049640595913, + 0.230564646422863, + 0.0, + 0.4050047155469656, + 0.0, + 0.04061509668827057, + 0.43129492551088333, + 0.03769573196768761, + 0.34695103019475937, + 0.3461808115243912 + ], + "unique_experts": 54, + "load_cv": 0.7433807885931687, + "normalized_load_entropy": 0.9236813147930211, + "max_load_share": 0.050724637681159424 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "3283d80a883a882bcb9f849f3702f7dd72fa1953d2ce29d175ba3c9e89757201", + "route_weight_sha256": "0653ae66c280e52e3e6473ece4988e9a8bc6e2060c3712914416822311433a3f", + "loads": [ + 7, + 4, + 4, + 15, + 5, + 2, + 3, + 9, + 3, + 12, + 4, + 2, + 1, + 4, + 10, + 1, + 2, + 1, + 2, + 2, + 3, + 6, + 11, + 2, + 2, + 4, + 0, + 12, + 3, + 5, + 3, + 1, + 2, + 4, + 10, + 3, + 1, + 1, + 1, + 2, + 0, + 1, + 15, + 0, + 2, + 4, + 18, + 1, + 10, + 14, + 4, + 2, + 3, + 3, + 5, + 3, + 0, + 5, + 1, + 1, + 15, + 1, + 7, + 4 + ], + "weighted_loads": [ + 0.9612443521618843, + 0.39873604476451874, + 0.2930750995874405, + 0.8643943928182125, + 0.2656827275059186, + 0.09479446336627007, + 0.2156601194292307, + 1.2091166228055954, + 0.28806956112384796, + 1.1532573654549196, + 0.2884295843541622, + 0.18778313061920926, + 0.00047708500642329454, + 0.34153736010193825, + 0.7739968821406364, + 0.16492556035518646, + 0.11604108288884163, + 0.0638943538069725, + 0.16361713036894798, + 0.13731792569160461, + 0.15049345791339874, + 0.7065071985125542, + 0.721301632001996, + 0.09421714395284653, + 0.20375171303749084, + 0.26284852530807257, + 0.0, + 0.727154765278101, + 0.2932160720229149, + 0.29063067585229874, + 0.19658304378390312, + 0.028023237362504005, + 0.13683050870895386, + 0.12591253221035004, + 1.0830264016985893, + 0.34633419662714005, + 0.07876602560281754, + 0.07153962552547455, + 0.10323930531740189, + 0.12126058712601662, + 0.0, + 0.05619917809963226, + 1.1291139535605907, + 0.0, + 0.13559961691498756, + 0.3515692166984081, + 2.340935381129384, + 0.0840398445725441, + 0.9735914543271065, + 0.825245438143611, + 0.20857203379273415, + 0.06840116903185844, + 0.3007346913218498, + 0.32249171286821365, + 1.1779197920113802, + 0.230564646422863, + 0.0, + 0.4050047155469656, + 0.03971877321600914, + 0.04061509668827057, + 0.9753977861255407, + 0.03769573196768761, + 0.8066207095980644, + 0.3844575434923172 + ], + "unique_experts": 60, + "load_cv": 0.9638528651609707, + "normalized_load_entropy": 0.901875807677062, + "max_load_share": 0.0625 + } + }, + "s1_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "babfc35eb35bb3689f71ceb0495cf2576ae4ca3fb065f1e3d0d4b8d622836653", + "route_weight_sha256": "9e05128aad52def158eecbdb1ce2401a6ac623a4352c3c254ea93e6abd83ecd3", + "loads": [ + 0, + 3, + 4, + 3, + 2, + 1, + 2, + 1, + 2, + 6, + 3, + 1, + 0, + 0, + 4, + 1, + 2, + 2, + 1, + 3, + 2, + 3, + 4, + 1, + 2, + 3, + 0, + 5, + 3, + 1, + 2, + 1, + 2, + 4, + 3, + 4, + 1, + 1, + 1, + 2, + 0, + 1, + 5, + 0, + 2, + 2, + 0, + 1, + 2, + 3, + 3, + 3, + 3, + 3, + 2, + 3, + 0, + 4, + 0, + 2, + 7, + 0, + 3, + 3 + ], + "weighted_loads": [ + 0.0, + 0.2495562881231308, + 0.30749013647437096, + 0.17274179682135582, + 0.19503995403647423, + 0.025127647444605827, + 0.20080261677503586, + 0.04563464596867561, + 0.25773682072758675, + 0.6916214674711227, + 0.256506672129035, + 0.18927031755447388, + 0.0, + 0.0, + 0.254469845443964, + 0.1726008504629135, + 0.11690771207213402, + 0.08499191701412201, + 0.11358173936605453, + 0.17810966446995735, + 0.12501132115721703, + 0.39774030447006226, + 0.21155912056565285, + 0.06928696483373642, + 0.20836368203163147, + 0.27117355167865753, + 0.0, + 0.46028411015868187, + 0.3157708942890167, + 0.09179910272359848, + 0.14819584786891937, + 0.02993917651474476, + 0.14695030823349953, + 0.1256120428442955, + 0.10618654638528824, + 0.386740829795599, + 0.07876909524202347, + 0.0692836195230484, + 0.10241922736167908, + 0.11481817811727524, + 0.0, + 0.05317973345518112, + 0.5450635403394699, + 0.0, + 0.1279459334909916, + 0.24508751183748245, + 0.0, + 0.08232017606496811, + 0.07982131093740463, + 0.18782375007867813, + 0.18196189403533936, + 0.09232922829687595, + 0.3082791641354561, + 0.3364527262747288, + 0.06383156403899193, + 0.22710805386304855, + 0.0, + 0.36178868636488914, + 0.0, + 0.0826186053454876, + 0.4739387668669224, + 0.0, + 0.32356032729148865, + 0.35929256677627563 + ], + "unique_experts": 54, + "load_cv": 0.7110316853354249, + "normalized_load_entropy": 0.9281613944361934, + "max_load_share": 0.050724637681159424 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "0b3344e29c1ff6a4de58e88814aeffe33da2fb259fe371568e8a460bf1d974ff", + "route_weight_sha256": "a7f1a0c0683e4f57faaf2b0b1f0572c0550b44cd6ea0e5df8920ff030c411d08", + "loads": [ + 10, + 6, + 4, + 16, + 4, + 5, + 2, + 13, + 2, + 16, + 6, + 2, + 3, + 6, + 12, + 2, + 4, + 2, + 2, + 3, + 3, + 9, + 15, + 1, + 4, + 5, + 0, + 8, + 3, + 5, + 3, + 1, + 2, + 6, + 10, + 4, + 1, + 6, + 1, + 3, + 1, + 1, + 21, + 3, + 2, + 8, + 20, + 1, + 11, + 13, + 3, + 9, + 6, + 8, + 5, + 7, + 0, + 4, + 8, + 3, + 21, + 1, + 9, + 9 + ], + "weighted_loads": [ + 1.2868581265211105, + 0.4321024715900421, + 0.30749013647437096, + 0.9234352149069309, + 0.23221407312666997, + 0.2142258007079363, + 0.20080261677503586, + 1.3857979252934456, + 0.25773682072758675, + 1.3030822455184534, + 0.34124330803751945, + 0.19014754256932065, + 0.0809301194967702, + 0.44053228199481964, + 0.9138769172132015, + 0.22139732912182808, + 0.33113641664385796, + 0.08499191701412201, + 0.16868856549263, + 0.17810966446995735, + 0.15738146752119064, + 0.7765977755188942, + 1.190225277096033, + 0.06928696483373642, + 0.31194132193922997, + 0.3196365302428603, + 0.0, + 0.5569356307387352, + 0.3157708942890167, + 0.2690504230558872, + 0.18983792141079903, + 0.02993917651474476, + 0.14695030823349953, + 0.19829954206943512, + 0.9803483858704567, + 0.386740829795599, + 0.07876909524202347, + 0.4849341418594122, + 0.10241922736167908, + 0.16487456858158112, + 0.07499654591083527, + 0.05317973345518112, + 1.3681839313358068, + 0.10523692891001701, + 0.1279459334909916, + 0.6355665735900402, + 2.661699954420328, + 0.08232017606496811, + 1.1853499598801136, + 0.6573725938796997, + 0.18196189403533936, + 0.8727611135691404, + 0.5092282854020596, + 1.0540142618119717, + 1.1481832265853882, + 0.4594571515917778, + 0.0, + 0.36178868636488914, + 0.5369687601923943, + 0.11320996470749378, + 1.321697786450386, + 0.05014238506555557, + 0.8231724724173546, + 0.7699686996638775 + ], + "unique_experts": 62, + "load_cv": 0.8539125638299665, + "normalized_load_entropy": 0.919845083053713, + "max_load_share": 0.0546875 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "ordered_topk_exact_tokens": 16, + "set_exact_tokens": 20, + "mean_set_jaccard": 0.9627329192546583, + "mean_token_weighted_tv": 0.010762893716278284, + "aggregate_load_tv": 0.021739130434782608 + }, + "system_bos": { + "tokens": 23, + "ordered_topk_exact_tokens": 16, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.9130434782608695, + "mean_token_weighted_tv": 0.019613725214224796, + "aggregate_load_tv": 0.050724637681159424 + }, + "system_x": { + "tokens": 23, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.9006211180124224, + "mean_token_weighted_tv": 0.023315075096552788, + "aggregate_load_tv": 0.050724637681159424 + }, + "system_period": { + "tokens": 23, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.9006211180124224, + "mean_token_weighted_tv": 0.022227746596478897, + "aggregate_load_tv": 0.05797101449275362 + }, + "bos_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.8944099378881987, + "mean_token_weighted_tv": 0.030581283585532852, + "aggregate_load_tv": 0.050724637681159424 + }, + "bos_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8881987577639753, + "mean_token_weighted_tv": 0.03142172264178162, + "aggregate_load_tv": 0.057971014492753624 + }, + "x_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.8944099378881988, + "mean_token_weighted_tv": 0.030783557090098442, + "aggregate_load_tv": 0.05072463768115943 + }, + "x_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8788819875776398, + "mean_token_weighted_tv": 0.03493483558945034, + "aggregate_load_tv": 0.057971014492753624 + }, + "period_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.906832298136646, + "mean_token_weighted_tv": 0.02881951524835566, + "aggregate_load_tv": 0.04347826086956522 + }, + "period_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8788819875776398, + "mean_token_weighted_tv": 0.03434347389670818, + "aggregate_load_tv": 0.057971014492753624 + } + } + }, + "layer_04": { + "layer": 4, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "14b5437b69706b0b5fdaab306bf4b4683a43057d25dcd7994601f92d47ec2f20", + "route_weight_sha256": "ffd8d40dd5376a8cb392093f27bf688a134a6b5ffe687d46e1be54e62c6241da", + "loads": [ + 2, + 5, + 1, + 1, + 2, + 1, + 0, + 1, + 2, + 3, + 2, + 6, + 6, + 2, + 0, + 1, + 2, + 1, + 1, + 2, + 1, + 5, + 2, + 2, + 5, + 0, + 2, + 7, + 1, + 12, + 1, + 1, + 5, + 1, + 3, + 0, + 2, + 3, + 1, + 3, + 1, + 0, + 2, + 0, + 1, + 1, + 0, + 1, + 0, + 3, + 0, + 1, + 3, + 4, + 1, + 2, + 7, + 4, + 3, + 2, + 1, + 1, + 0, + 2 + ], + "weighted_loads": [ + 0.0976688414812088, + 0.35462599620223045, + 0.03313256427645683, + 0.07233957201242447, + 0.16643677651882172, + 0.1077609583735466, + 0.0, + 0.05518757551908493, + 0.1320403330028057, + 0.19833509251475334, + 0.360366128385067, + 0.574851717799902, + 0.5876813344657421, + 0.08235358819365501, + 0.0, + 0.08082817494869232, + 0.1787768006324768, + 0.04046710580587387, + 0.12459181994199753, + 0.14062710478901863, + 0.0657099038362503, + 0.4913081508129835, + 0.133840661495924, + 0.10917694494128227, + 0.26505718752741814, + 0.0, + 0.14901072159409523, + 0.4989161528646946, + 0.06038917228579521, + 1.253072589635849, + 0.08715765178203583, + 0.11301998049020767, + 0.36198458820581436, + 0.062324006110429764, + 0.2585833668708801, + 0.0, + 0.11626886203885078, + 0.26830343157052994, + 0.04979056119918823, + 0.3419578820466995, + 0.03393296152353287, + 0.0, + 0.20017999410629272, + 0.0, + 0.06187289580702782, + 0.05775333195924759, + 0.0, + 0.05830119550228119, + 0.0, + 0.18923163041472435, + 0.0, + 0.04632820934057236, + 0.27953802049160004, + 0.19638295844197273, + 0.042645905166864395, + 0.1132885292172432, + 0.5527964793145657, + 0.24691584333777428, + 0.3227810077369213, + 0.12007742747664452, + 0.04569960758090019, + 0.08802520483732224, + 0.0, + 0.270067784935236 + ], + "unique_experts": 54, + "load_cv": 0.9913509608500108, + "normalized_load_entropy": 0.8960284199231663, + "max_load_share": 0.08695652173913043 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "3815c7ec927aba52dd85ea31115f3bddad2560ceafd8fbdf1d48c0b440ee7336", + "route_weight_sha256": "daeb40d7645e6cc427c54b5f8dfdcb5294f3b4c21a9d0b1ffda9551c2d4973b4", + "loads": [ + 2, + 8, + 3, + 5, + 2, + 1, + 1, + 1, + 2, + 3, + 12, + 8, + 6, + 17, + 2, + 4, + 2, + 1, + 5, + 2, + 1, + 7, + 2, + 2, + 5, + 6, + 8, + 8, + 1, + 31, + 1, + 3, + 5, + 3, + 15, + 0, + 2, + 5, + 2, + 3, + 4, + 3, + 10, + 0, + 1, + 3, + 11, + 1, + 1, + 5, + 1, + 1, + 3, + 4, + 1, + 2, + 7, + 4, + 3, + 15, + 5, + 1, + 3, + 2 + ], + "weighted_loads": [ + 0.0976688414812088, + 0.5234959572553635, + 0.15488313883543015, + 0.38414490479044616, + 0.16643677651882172, + 0.1077609583735466, + 0.05884351581335068, + 0.05518757551908493, + 0.1320403330028057, + 0.19833509251475334, + 1.016790460795164, + 0.6014176290482283, + 0.5876813344657421, + 1.0894658863544464, + 0.04616398923099041, + 0.28093941509723663, + 0.1787768006324768, + 0.04046710580587387, + 0.32382915416383184, + 0.14062710478901863, + 0.0657099038362503, + 1.5567893963307142, + 0.133840661495924, + 0.10917694494128227, + 0.26505718752741814, + 0.43914441764354706, + 0.681575570255518, + 0.5069364905357361, + 0.06038917228579521, + 2.869277560705086, + 0.08715765178203583, + 0.1439442876726389, + 0.36198458820581436, + 0.10256184358149767, + 1.5512316172535066, + 0.0, + 0.11626886203885078, + 0.3585509732365608, + 1.0464720726013184, + 0.3419578820466995, + 0.17366743087768555, + 0.16956932470202446, + 0.5616718381643295, + 0.0, + 0.06187289580702782, + 0.25372988544404507, + 1.1483998075127602, + 0.05830119550228119, + 0.03668026253581047, + 0.23957644030451775, + 0.04665983468294144, + 0.04632820934057236, + 0.27953802049160004, + 0.19638295844197273, + 0.042645905166864395, + 0.1132885292172432, + 0.5527964793145657, + 0.24691584333777428, + 0.3227810077369213, + 0.8716299068182707, + 0.5424593851494137, + 0.08802520483732224, + 0.2149999588727951, + 0.270067784935236 + ], + "unique_experts": 62, + "load_cv": 1.1062393195411042, + "normalized_load_entropy": 0.8953896253479116, + "max_load_share": 0.1076388888888889 + } + }, + "s1_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "50742d90268b0c90b3e77a1db9f13f385e0e678cfd4785623914e01c325eb1fd", + "route_weight_sha256": "2482a393fd0e7a4f1203e34b980e7fe67343b42dfae10df4fcf785e848beabcf", + "loads": [ + 2, + 5, + 0, + 1, + 2, + 1, + 0, + 1, + 2, + 3, + 2, + 6, + 6, + 2, + 0, + 1, + 2, + 1, + 1, + 2, + 1, + 4, + 2, + 2, + 5, + 0, + 2, + 7, + 1, + 12, + 1, + 1, + 5, + 1, + 3, + 0, + 3, + 4, + 1, + 3, + 1, + 0, + 2, + 0, + 1, + 1, + 0, + 1, + 0, + 2, + 0, + 1, + 3, + 5, + 1, + 1, + 7, + 5, + 3, + 2, + 1, + 1, + 0, + 2 + ], + "weighted_loads": [ + 0.09682730585336685, + 0.3700720965862274, + 0.0, + 0.0739145427942276, + 0.16599900647997856, + 0.10607337951660156, + 0.0, + 0.05622490122914314, + 0.1330644153058529, + 0.19703920185565948, + 0.35842806100845337, + 0.574593361467123, + 0.5859623774886131, + 0.08148901723325253, + 0.0, + 0.08050863444805145, + 0.18068689107894897, + 0.04273124039173126, + 0.12457123398780823, + 0.14137617126107216, + 0.06535950303077698, + 0.46093733981251717, + 0.13485271483659744, + 0.10808898136019707, + 0.2636304497718811, + 0.0, + 0.15019021928310394, + 0.5033058077096939, + 0.06176399439573288, + 1.2774456180632114, + 0.08676205575466156, + 0.11476341634988785, + 0.3582877777516842, + 0.06004535034298897, + 0.26713407784700394, + 0.0, + 0.15435469895601273, + 0.29912107437849045, + 0.05044817179441452, + 0.3427717834711075, + 0.03215217590332031, + 0.0, + 0.19905604422092438, + 0.0, + 0.06316833198070526, + 0.05936799198389053, + 0.0, + 0.05824826657772064, + 0.0, + 0.14425095170736313, + 0.0, + 0.04810976982116699, + 0.28132784366607666, + 0.24115844070911407, + 0.042618148028850555, + 0.06340496987104416, + 0.5698084905743599, + 0.271763451397419, + 0.32494521886110306, + 0.11682439595460892, + 0.04480524733662605, + 0.08551669865846634, + 0.0, + 0.26881667599081993 + ], + "unique_experts": 53, + "load_cv": 1.0114862281979269, + "normalized_load_entropy": 0.890165191695783, + "max_load_share": 0.08695652173913043 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "a5408bdbfc19d60b51aefe24de5a8512ba4248dfb1f589db90eaa1509526eba0", + "route_weight_sha256": "0fdd69b309fad76274f170f3c19900eed68fe3d4d73922f5e971320154718a58", + "loads": [ + 2, + 7, + 3, + 10, + 2, + 1, + 3, + 1, + 2, + 11, + 11, + 8, + 7, + 18, + 3, + 5, + 4, + 3, + 8, + 4, + 2, + 7, + 5, + 3, + 5, + 10, + 11, + 8, + 1, + 35, + 1, + 3, + 5, + 3, + 19, + 0, + 4, + 7, + 4, + 6, + 4, + 6, + 11, + 0, + 3, + 4, + 10, + 5, + 1, + 5, + 2, + 1, + 7, + 9, + 7, + 1, + 12, + 7, + 3, + 16, + 8, + 3, + 4, + 3 + ], + "weighted_loads": [ + 0.09682730585336685, + 0.5155748724937439, + 0.1707875207066536, + 0.8539098721812479, + 0.16599900647997856, + 0.10607337951660156, + 0.2130025140941143, + 0.05622490122914314, + 0.1330644153058529, + 1.2462009564042091, + 0.9491308052092791, + 0.6010821675881743, + 0.6918803155422211, + 1.1553098652511835, + 0.07467341609299183, + 0.3582654260098934, + 0.544776201248169, + 0.1132010817527771, + 0.6646287135081366, + 0.23179853335022926, + 0.11420530080795288, + 1.5585350170731544, + 0.43027999624609947, + 0.20186148956418037, + 0.2636304497718811, + 0.7161793038249016, + 0.9631062187254429, + 0.5116063384339213, + 0.06176399439573288, + 2.838157480582595, + 0.08676205575466156, + 0.1453392468392849, + 0.3582877777516842, + 0.10067487601190805, + 1.9093391001806594, + 0.0, + 0.1818049419671297, + 0.43141186609864235, + 1.241191677749157, + 0.5552619248628616, + 0.1912105716764927, + 0.2553594528872054, + 0.6311967447400093, + 0.0, + 0.13286489248275757, + 0.22172765459981747, + 1.1909424848854542, + 0.3958005830645561, + 0.02977423183619976, + 0.23090981133282185, + 0.09273863583803177, + 0.04810976982116699, + 0.7189128994941711, + 0.4236958511173725, + 0.5925460532307625, + 0.06340496987104416, + 0.9927269443869591, + 0.34551377408206463, + 0.32494521886110306, + 0.9425739701837301, + 1.0273548141121864, + 0.2819843739271164, + 0.28886479511857033, + 0.313428170979023 + ], + "unique_experts": 62, + "load_cv": 0.9152451098536999, + "normalized_load_entropy": 0.9207327110478596, + "max_load_share": 0.09114583333333333 + } + }, + "s0_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "7abcd355f4a5aa53973ad6e368769f5fb8c8782524e6a69c07dc0dfa4c289e43", + "route_weight_sha256": "ec54283dab1c5b65aca0b881da36b7e6189f50705aa97e5000b715d4a8edc7c6", + "loads": [ + 2, + 5, + 0, + 1, + 2, + 1, + 0, + 1, + 3, + 3, + 3, + 6, + 6, + 1, + 0, + 1, + 2, + 1, + 1, + 2, + 1, + 5, + 2, + 2, + 5, + 0, + 2, + 6, + 1, + 12, + 2, + 1, + 5, + 1, + 3, + 0, + 2, + 4, + 1, + 3, + 1, + 1, + 2, + 0, + 1, + 1, + 0, + 1, + 0, + 3, + 0, + 1, + 3, + 5, + 1, + 1, + 6, + 4, + 3, + 2, + 1, + 1, + 0, + 1 + ], + "weighted_loads": [ + 0.09462790191173553, + 0.39341871440410614, + 0.0, + 0.07671549171209335, + 0.16509975865483284, + 0.1129428893327713, + 0.0, + 0.05272693559527397, + 0.185457531362772, + 0.18818512186408043, + 0.39214187674224377, + 0.5590027049183846, + 0.5844447091221809, + 0.053836703300476074, + 0.0, + 0.08045680820941925, + 0.17601267248392105, + 0.03762362524867058, + 0.11604250967502594, + 0.14263980835676193, + 0.065477155148983, + 0.524250041693449, + 0.13890331238508224, + 0.11827638186514378, + 0.27511676773428917, + 0.0, + 0.14379353448748589, + 0.48578573018312454, + 0.07001693546772003, + 1.1692156940698624, + 0.1149744875729084, + 0.10329729318618774, + 0.3624717853963375, + 0.07321533560752869, + 0.23105143010616302, + 0.0, + 0.11501608416438103, + 0.3042687214910984, + 0.045700497925281525, + 0.3243633210659027, + 0.03488898277282715, + 0.03738000988960266, + 0.1965290531516075, + 0.0, + 0.061000943183898926, + 0.05711805447936058, + 0.0, + 0.05416259169578552, + 0.0, + 0.19182603433728218, + 0.0, + 0.04053134098649025, + 0.28370681405067444, + 0.23695304617285728, + 0.04133794829249382, + 0.05689244344830513, + 0.500520221889019, + 0.2495357096195221, + 0.3249235264956951, + 0.1208743043243885, + 0.04662860184907913, + 0.09253191947937012, + 0.0, + 0.2606981098651886 + ], + "unique_experts": 54, + "load_cv": 0.9811283791891484, + "normalized_load_entropy": 0.8959304621013694, + "max_load_share": 0.08695652173913043 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "0a80cd57431be35771b8599c19a4a7c031560359b4e5eec5bcc0a79bdf976c91", + "route_weight_sha256": "42203fe93fd3e55af507113e1d6acf1ebea156b14cac9c7a9dba21a100abf8a1", + "loads": [ + 2, + 8, + 2, + 6, + 2, + 1, + 1, + 1, + 3, + 3, + 13, + 7, + 6, + 16, + 2, + 4, + 2, + 1, + 6, + 2, + 1, + 6, + 2, + 2, + 5, + 6, + 8, + 6, + 2, + 33, + 2, + 2, + 5, + 2, + 15, + 0, + 2, + 6, + 2, + 3, + 4, + 4, + 10, + 0, + 1, + 3, + 11, + 1, + 1, + 4, + 1, + 1, + 3, + 5, + 1, + 1, + 6, + 4, + 3, + 15, + 6, + 1, + 3, + 1 + ], + "weighted_loads": [ + 0.09462790191173553, + 0.5634937472641468, + 0.12175057455897331, + 0.4423958722036332, + 0.16509975865483284, + 0.1129428893327713, + 0.05292552337050438, + 0.05272693559527397, + 0.185457531362772, + 0.18818512186408043, + 1.0485662091523409, + 0.5761192440986633, + 0.5844447091221809, + 1.0644329115748405, + 0.04616398923099041, + 0.2696986310184002, + 0.17601267248392105, + 0.03762362524867058, + 0.46843471625470556, + 0.14263980835676193, + 0.065477155148983, + 0.8150698058307171, + 0.13890331238508224, + 0.11827638186514378, + 0.27511676773428917, + 0.457624826580286, + 0.6843705028295517, + 0.48578573018312454, + 0.11113720387220383, + 2.920051918918034, + 0.1149744875729084, + 0.12167279794812202, + 0.3624717853963375, + 0.09852788969874382, + 1.5257997607404832, + 0.0, + 0.11501608416438103, + 0.39473409205675125, + 1.0423820093274117, + 0.3243633210659027, + 0.17462345212697983, + 0.19960849359631538, + 0.5580208972096443, + 0.0, + 0.061000943183898926, + 0.329789811745286, + 1.1483998075127602, + 0.05416259169578552, + 0.03668026253581047, + 0.2198103778064251, + 0.04665983468294144, + 0.04053134098649025, + 0.28370681405067444, + 0.23695304617285728, + 0.04133794829249382, + 0.05689244344830513, + 0.500520221889019, + 0.2495357096195221, + 0.3249235264956951, + 0.8718092534691095, + 0.7448194675671402, + 0.09253191947937012, + 0.2247546762228012, + 0.2606981098651886 + ], + "unique_experts": 62, + "load_cv": 1.1378721749035579, + "normalized_load_entropy": 0.8926709132446662, + "max_load_share": 0.11458333333333333 + } + }, + "s1_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "cd957a0283bf2c4e6713170ec8d0ba0f9ca71f21dee825476e280ce762c4d90a", + "route_weight_sha256": "d7a3bea5b016d1fb5e1ab9cce7fc2f0d0c5ffacd93ee2d50a07abdf1614d0e7d", + "loads": [ + 2, + 5, + 0, + 1, + 2, + 1, + 0, + 1, + 3, + 3, + 3, + 6, + 6, + 1, + 0, + 1, + 2, + 1, + 1, + 2, + 1, + 5, + 2, + 2, + 5, + 0, + 2, + 7, + 1, + 12, + 2, + 1, + 5, + 1, + 3, + 0, + 2, + 4, + 1, + 3, + 1, + 0, + 2, + 0, + 1, + 1, + 0, + 2, + 0, + 3, + 0, + 1, + 3, + 5, + 1, + 1, + 5, + 4, + 3, + 2, + 1, + 1, + 0, + 1 + ], + "weighted_loads": [ + 0.09610260277986526, + 0.4053524509072304, + 0.0, + 0.07419663667678833, + 0.1720787100493908, + 0.11314546316862106, + 0.0, + 0.06029560789465904, + 0.18256033584475517, + 0.1972784474492073, + 0.39947414211928844, + 0.5761784724891186, + 0.5744340755045414, + 0.05493704974651337, + 0.0, + 0.08071667701005936, + 0.18315967917442322, + 0.03603468835353851, + 0.1095442995429039, + 0.14469483122229576, + 0.06584922224283218, + 0.5319237932562828, + 0.14322824776172638, + 0.11385582387447357, + 0.2648445628583431, + 0.0, + 0.15035436302423477, + 0.5344679914414883, + 0.07325847446918488, + 1.1475768499076366, + 0.12101013958454132, + 0.10736819356679916, + 0.37255171686410904, + 0.0753525123000145, + 0.22285614162683487, + 0.0, + 0.11357391998171806, + 0.30448974668979645, + 0.0485345758497715, + 0.3219103440642357, + 0.032281722873449326, + 0.0, + 0.21651943773031235, + 0.0, + 0.0652618557214737, + 0.06398017704486847, + 0.0, + 0.10378540307283401, + 0.0, + 0.19505134597420692, + 0.0, + 0.04091862961649895, + 0.28297995775938034, + 0.23870378732681274, + 0.040522392839193344, + 0.05618399381637573, + 0.4379870146512985, + 0.25484035536646843, + 0.3424404375255108, + 0.11838913336396217, + 0.042356882244348526, + 0.09135067462921143, + 0.0, + 0.24851152300834656 + ], + "unique_experts": 53, + "load_cv": 0.9879551865016964, + "normalized_load_entropy": 0.8932232460141881, + "max_load_share": 0.08695652173913043 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "02f84ce0fe48080f9e3e781c9dbf74923ee569b518e2b3952144b1bec85682d0", + "route_weight_sha256": "774b06af5dbbb5073833fe0f0d379e6ae9a5d4579bf29ca30f67d9df5679c4a8", + "loads": [ + 2, + 7, + 3, + 11, + 2, + 1, + 3, + 1, + 3, + 11, + 12, + 7, + 7, + 17, + 3, + 5, + 4, + 3, + 9, + 4, + 2, + 7, + 5, + 3, + 5, + 10, + 11, + 7, + 2, + 36, + 2, + 2, + 5, + 2, + 19, + 0, + 3, + 7, + 4, + 6, + 4, + 6, + 11, + 0, + 3, + 4, + 11, + 6, + 1, + 5, + 2, + 1, + 7, + 9, + 7, + 1, + 10, + 6, + 3, + 16, + 9, + 3, + 4, + 2 + ], + "weighted_loads": [ + 0.09610260277986526, + 0.5566322207450867, + 0.1707875207066536, + 0.90896885067923, + 0.1720787100493908, + 0.11314546316862106, + 0.1948135904967785, + 0.06029560789465904, + 0.18256033584475517, + 1.246440201997757, + 0.9901768863201141, + 0.5932950116693974, + 0.6803520135581493, + 1.1250205636024475, + 0.07467341609299183, + 0.36569830775260925, + 0.5472489893436432, + 0.10650452971458435, + 0.7909293874399737, + 0.23511719331145287, + 0.11469502002000809, + 0.8634648732841015, + 0.4386555291712284, + 0.20762833207845688, + 0.2648445628583431, + 0.6929866373538971, + 0.9840327091515064, + 0.5344679914414883, + 0.11680488660931587, + 2.717536887153983, + 0.12101013958454132, + 0.12574369832873344, + 0.37255171686410904, + 0.10066506639122963, + 1.7966911048279144, + 0.0, + 0.14102416299283504, + 0.43673985823988914, + 1.239278081804514, + 0.5344004854559898, + 0.1913401186466217, + 0.28840505026164465, + 0.6486601382493973, + 0.0, + 0.134958416223526, + 0.23289980765548535, + 1.2389935702085495, + 0.4413377195596695, + 0.02977423183619976, + 0.2588033974170685, + 0.09273863583803177, + 0.04091862961649895, + 0.7205650135874748, + 0.4212411977350712, + 0.5904502980411053, + 0.05618399381637573, + 0.8609054684638977, + 0.3285906780511141, + 0.3424404375255108, + 0.9393366184085608, + 1.2154332622885704, + 0.2878183498978615, + 0.30632448196411133, + 0.2931230179965496 + ], + "unique_experts": 62, + "load_cv": 0.9265564982473786, + "normalized_load_entropy": 0.9202030946838411, + "max_load_share": 0.09375 + } + }, + "s0_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "cfc8a43174067fb37b34085517ea90db9f2b0e433eab0985b88af2e5ada4372f", + "route_weight_sha256": "2320a6c55cae8e50fabb3a300872816794c0daf19455c294e9b5a6271d4b5cd4", + "loads": [ + 2, + 5, + 0, + 1, + 2, + 1, + 0, + 1, + 2, + 3, + 3, + 6, + 6, + 1, + 0, + 1, + 2, + 1, + 1, + 2, + 1, + 5, + 3, + 2, + 5, + 0, + 1, + 7, + 1, + 12, + 1, + 1, + 5, + 1, + 3, + 0, + 3, + 4, + 2, + 3, + 1, + 1, + 2, + 0, + 1, + 1, + 0, + 1, + 0, + 2, + 0, + 0, + 3, + 4, + 1, + 2, + 7, + 4, + 3, + 2, + 1, + 1, + 0, + 1 + ], + "weighted_loads": [ + 0.08952588960528374, + 0.36606791988015175, + 0.0, + 0.08259636908769608, + 0.16918566450476646, + 0.11741741001605988, + 0.0, + 0.054136306047439575, + 0.1412786766886711, + 0.19161634147167206, + 0.39580853655934334, + 0.5755219422280788, + 0.5654765926301479, + 0.05417598783969879, + 0.0, + 0.07762594521045685, + 0.18102800846099854, + 0.03710681200027466, + 0.12603089213371277, + 0.13727249205112457, + 0.06891754269599915, + 0.4878165181726217, + 0.20471685752272606, + 0.11428179405629635, + 0.27175429463386536, + 0.0, + 0.087242491543293, + 0.5139476880431175, + 0.06154000759124756, + 1.0654038228094578, + 0.09029725939035416, + 0.10258018970489502, + 0.36391910165548325, + 0.06565173715353012, + 0.24566170573234558, + 0.0, + 0.1541857197880745, + 0.297357264906168, + 0.08079587295651436, + 0.3180997595191002, + 0.037588149309158325, + 0.03758774697780609, + 0.2125406712293625, + 0.0, + 0.058649636805057526, + 0.05782795324921608, + 0.0, + 0.055190157145261765, + 0.0, + 0.14641568064689636, + 0.0, + 0.0, + 0.29551367461681366, + 0.19587219133973122, + 0.03853694349527359, + 0.10477082431316376, + 0.5430436879396439, + 0.2419980801641941, + 0.3126530461013317, + 0.1259620115160942, + 0.04659251496195793, + 0.09095530211925507, + 0.0, + 0.2570546567440033 + ], + "unique_experts": 53, + "load_cv": 1.0081582776486193, + "normalized_load_entropy": 0.8902858021669302, + "max_load_share": 0.08695652173913043 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "c7b7398b659f3281bc219ea3f8d40ab10b778cd5d73988189962dafab464c82a", + "route_weight_sha256": "2c936491fe851794d5549fc6cd905fc9229b0101801a15c0f29dc8be57c009c5", + "loads": [ + 2, + 9, + 3, + 5, + 2, + 1, + 0, + 1, + 2, + 3, + 14, + 7, + 6, + 14, + 2, + 4, + 2, + 1, + 5, + 2, + 1, + 6, + 4, + 2, + 5, + 6, + 7, + 7, + 2, + 31, + 1, + 2, + 5, + 2, + 13, + 0, + 3, + 6, + 3, + 3, + 5, + 4, + 11, + 0, + 1, + 3, + 13, + 1, + 2, + 3, + 1, + 0, + 3, + 4, + 1, + 2, + 7, + 4, + 3, + 16, + 5, + 1, + 3, + 1 + ], + "weighted_loads": [ + 0.08952588960528374, + 0.5768670849502087, + 0.15274802781641483, + 0.4349454592447728, + 0.16918566450476646, + 0.11741741001605988, + 0.0, + 0.054136306047439575, + 0.1412786766886711, + 0.19161634147167206, + 1.2690384164452553, + 0.5926384814083576, + 0.5654765926301479, + 0.9940435476601124, + 0.04616398923099041, + 0.2769211679697037, + 0.18102800846099854, + 0.03710681200027466, + 0.3433999592962209, + 0.13727249205112457, + 0.06891754269599915, + 0.7786362823098898, + 0.24089491739869118, + 0.11428179405629635, + 0.27175429463386536, + 0.3885486535727978, + 0.6712526008486748, + 0.5139476880431175, + 0.10455440357327461, + 2.4940199680568185, + 0.09029725939035416, + 0.1209556944668293, + 0.36391910165548325, + 0.09096429124474525, + 1.2900715080613736, + 0.0, + 0.1541857197880745, + 0.38746795803308487, + 1.0774773843586445, + 0.3180997595191002, + 0.2340615727007389, + 0.20468014851212502, + 0.6094979867339134, + 0.0, + 0.058649636805057526, + 0.30673799104988575, + 1.3949095085263252, + 0.055190157145261765, + 0.08011985570192337, + 0.17440002411603928, + 0.04665983468294144, + 0.0, + 0.29551367461681366, + 0.19587219133973122, + 0.03853694349527359, + 0.10477082431316376, + 0.5430436879396439, + 0.2419980801641941, + 0.3126530461013317, + 0.970005301758647, + 0.5200660318660084, + 0.09095530211925507, + 0.219705980271101, + 0.2570546567440033 + ], + "unique_experts": 60, + "load_cv": 1.1013459778666117, + "normalized_load_entropy": 0.8935799281151298, + "max_load_share": 0.1076388888888889 + } + }, + "s1_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "1d0557c77ac20a37fc0848d5e2801109b44e7615b85dd478d69d9df8cccbd5c1", + "route_weight_sha256": "ba83559a2bc71d09bb06015d7227bdddfb0b984112dbdae53cbc92fc7975e927", + "loads": [ + 2, + 5, + 0, + 1, + 2, + 1, + 0, + 1, + 3, + 3, + 2, + 6, + 6, + 1, + 0, + 1, + 2, + 1, + 1, + 2, + 1, + 5, + 2, + 2, + 5, + 0, + 2, + 7, + 1, + 12, + 2, + 1, + 5, + 1, + 3, + 0, + 2, + 5, + 1, + 3, + 1, + 0, + 2, + 0, + 1, + 1, + 0, + 2, + 0, + 3, + 0, + 1, + 4, + 4, + 0, + 2, + 5, + 4, + 4, + 2, + 0, + 1, + 0, + 1 + ], + "weighted_loads": [ + 0.09195392578840256, + 0.3920792117714882, + 0.0, + 0.07723768055438995, + 0.17058050259947777, + 0.11317349970340729, + 0.0, + 0.06677138060331345, + 0.1840866431593895, + 0.1969512552022934, + 0.3652707040309906, + 0.5870136506855488, + 0.5605345070362091, + 0.05681060999631882, + 0.0, + 0.07913460582494736, + 0.18728585541248322, + 0.03561043366789818, + 0.11304540187120438, + 0.13799140229821205, + 0.06660597026348114, + 0.5299999583512545, + 0.15025677531957626, + 0.10985709726810455, + 0.2716926746070385, + 0.0, + 0.14384989440441132, + 0.5460389032959938, + 0.07048296928405762, + 1.0582574307918549, + 0.12155676819384098, + 0.10200715810060501, + 0.37717216461896896, + 0.0749274343252182, + 0.2314116209745407, + 0.0, + 0.11198696121573448, + 0.34327464923262596, + 0.050247933715581894, + 0.3162117674946785, + 0.034605722874403, + 0.0, + 0.22431734204292297, + 0.0, + 0.06276620924472809, + 0.06362996250391006, + 0.0, + 0.1034642681479454, + 0.0, + 0.19392770156264305, + 0.0, + 0.03323439881205559, + 0.3252970837056637, + 0.19557006284594536, + 0.0, + 0.09994548559188843, + 0.4320814236998558, + 0.25916148722171783, + 0.3450169339776039, + 0.12121202051639557, + 0.0, + 0.09205613285303116, + 0.0, + 0.2414046823978424 + ], + "unique_experts": 51, + "load_cv": 1.0048193050239391, + "normalized_load_entropy": 0.8862965099109157, + "max_load_share": 0.08695652173913043 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "412c4b3bfe0453b4255aa0227fcc7b87edf8f833d94702f4421cb60c0550058a", + "route_weight_sha256": "12f74ccd133dba15ba240f08b537e12d4dd1dd43594d6827532ff8db00c5d3e3", + "loads": [ + 2, + 8, + 4, + 10, + 2, + 1, + 2, + 1, + 3, + 11, + 12, + 7, + 7, + 15, + 3, + 5, + 4, + 3, + 8, + 4, + 2, + 7, + 6, + 3, + 5, + 10, + 11, + 7, + 2, + 34, + 2, + 2, + 5, + 2, + 18, + 0, + 3, + 8, + 5, + 6, + 5, + 6, + 12, + 0, + 3, + 4, + 12, + 6, + 1, + 5, + 2, + 1, + 8, + 8, + 6, + 2, + 10, + 6, + 4, + 17, + 7, + 3, + 4, + 2 + ], + "weighted_loads": [ + 0.09195392578840256, + 0.5883066318929195, + 0.2056438811123371, + 0.8964872282813303, + 0.17058050259947777, + 0.11317349970340729, + 0.14488976076245308, + 0.06677138060331345, + 0.1840866431593895, + 1.246113009750843, + 1.1444626320153475, + 0.6041301898658276, + 0.666452445089817, + 1.0576677657663822, + 0.07467341609299183, + 0.3665931262075901, + 0.5513751655817032, + 0.10608027502894402, + 0.6601412660675123, + 0.22841376438736916, + 0.11545176804065704, + 0.8615410383790731, + 0.4795699305832386, + 0.20362960547208786, + 0.2716926746070385, + 0.6364238411188126, + 1.014287542551756, + 0.5460389032959938, + 0.11426180228590965, + 2.3150072153657675, + 0.12155676819384098, + 0.12038266286253929, + 0.37717216461896896, + 0.10023998841643333, + 1.5859125108108856, + 0.0, + 0.13943720422685146, + 0.47489575296640396, + 1.2927024215459824, + 0.5287019088864326, + 0.24777162075042725, + 0.3221447288233321, + 0.6965913735330105, + 0.0, + 0.1324627697467804, + 0.19161734011140652, + 1.4461435787379742, + 0.4410165846347809, + 0.02977423183619976, + 0.2576797530055046, + 0.09273863583803177, + 0.03323439881205559, + 0.7628821395337582, + 0.3781074732542038, + 0.5499279052019119, + 0.09994548559188843, + 0.854999877512455, + 0.3329118099063635, + 0.3450169339776039, + 1.0393173154443502, + 0.9373529590666294, + 0.2885238081216812, + 0.2949174977838993, + 0.28601617738604546 + ], + "unique_experts": 62, + "load_cv": 0.8843743865329635, + "normalized_load_entropy": 0.9250958638327783, + "max_load_share": 0.08854166666666667 + } + }, + "s0_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "f1bb4f2326de1a3307a3a549f2d7ac37f684b1a4506b6fe575f01399a2ba7e8f", + "route_weight_sha256": "46e30df5d90cfab44369be6de98f69bf97a9b9d2dbb48f06f4e20a4445c44bfa", + "loads": [ + 2, + 5, + 0, + 1, + 2, + 1, + 0, + 1, + 3, + 3, + 3, + 7, + 6, + 1, + 0, + 1, + 2, + 1, + 1, + 2, + 1, + 4, + 3, + 2, + 5, + 0, + 1, + 7, + 1, + 12, + 1, + 1, + 5, + 1, + 3, + 0, + 3, + 4, + 2, + 3, + 1, + 1, + 2, + 0, + 1, + 1, + 0, + 1, + 0, + 2, + 0, + 0, + 3, + 4, + 1, + 2, + 6, + 4, + 3, + 2, + 1, + 1, + 0, + 1 + ], + "weighted_loads": [ + 0.08864393457770348, + 0.35530485957860947, + 0.0, + 0.08306776732206345, + 0.172538161277771, + 0.11693646758794785, + 0.0, + 0.056065477430820465, + 0.18890941515564919, + 0.19807979464530945, + 0.39833494648337364, + 0.5909623596817255, + 0.5702648870646954, + 0.05282885208725929, + 0.0, + 0.07759913802146912, + 0.1859564334154129, + 0.03774809464812279, + 0.14064642786979675, + 0.13968593627214432, + 0.06783038377761841, + 0.45807991549372673, + 0.20671001449227333, + 0.11360500007867813, + 0.2736014388501644, + 0.0, + 0.09063384681940079, + 0.5123195014894009, + 0.06097809225320816, + 1.0297699831426144, + 0.09229833632707596, + 0.10359058529138565, + 0.36945249885320663, + 0.06313297152519226, + 0.25564539432525635, + 0.0, + 0.15727510675787926, + 0.29370082169771194, + 0.08193645253777504, + 0.32937419414520264, + 0.03808305785059929, + 0.03709911182522774, + 0.21063794195652008, + 0.0, + 0.0600900761783123, + 0.05649098753929138, + 0.0, + 0.05709581449627876, + 0.0, + 0.14603014662861824, + 0.0, + 0.0, + 0.30108295381069183, + 0.1964941769838333, + 0.038909152150154114, + 0.10602833330631256, + 0.5045637711882591, + 0.2432459108531475, + 0.3122786320745945, + 0.1219049021601677, + 0.043395016342401505, + 0.09076041728258133, + 0.0, + 0.25839293003082275 + ], + "unique_experts": 53, + "load_cv": 1.0014692000786414, + "normalized_load_entropy": 0.8913181125199173, + "max_load_share": 0.08695652173913043 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "e96eb8792da25c0e51ee52e974b3adf2a4f6c8c49006500fe94714081b5482cc", + "route_weight_sha256": "ef4ded6960b3cf94a3e7e77f3f8abab9278ff9e2d6b47f4a1a402ce0b90af7b7", + "loads": [ + 2, + 9, + 2, + 5, + 2, + 1, + 0, + 1, + 3, + 3, + 13, + 8, + 6, + 14, + 2, + 4, + 2, + 1, + 5, + 2, + 1, + 5, + 5, + 2, + 5, + 6, + 8, + 7, + 2, + 32, + 1, + 2, + 5, + 2, + 13, + 0, + 3, + 6, + 3, + 3, + 4, + 4, + 10, + 0, + 1, + 3, + 12, + 1, + 2, + 3, + 1, + 1, + 4, + 4, + 1, + 2, + 6, + 4, + 3, + 16, + 5, + 1, + 3, + 1 + ], + "weighted_loads": [ + 0.08864393457770348, + 0.5754723995923996, + 0.12175057455897331, + 0.42813018220476806, + 0.172538161277771, + 0.11693646758794785, + 0.0, + 0.056065477430820465, + 0.18890941515564919, + 0.19807979464530945, + 1.0547592788934708, + 0.6080788988620043, + 0.5702648870646954, + 0.9715922102332115, + 0.04616398923099041, + 0.26168426871299744, + 0.1859564334154129, + 0.03774809464812279, + 0.36596882590674795, + 0.13968593627214432, + 0.06783038377761841, + 0.7488996796309948, + 0.27924713864922523, + 0.11360500007867813, + 0.2736014388501644, + 0.366940850391984, + 0.9429513923823833, + 0.5123195014894009, + 0.10519568622112274, + 2.4875844396592584, + 0.09229833632707596, + 0.12196609005331993, + 0.36945249885320663, + 0.0884455256164074, + 1.2922203039343003, + 0.0, + 0.15727510675787926, + 0.38486311957240105, + 1.0786179639399052, + 0.32937419414520264, + 0.17781752720475197, + 0.19805343821644783, + 0.5721297860145569, + 0.0, + 0.0600900761783123, + 0.33046948723495007, + 1.3091702684760094, + 0.05709581449627876, + 0.09066326916217804, + 0.17401449009776115, + 0.04665983468294144, + 0.12694862484931946, + 0.3658367767930031, + 0.1964941769838333, + 0.038909152150154114, + 0.10602833330631256, + 0.5045637711882591, + 0.2432459108531475, + 0.3122786320745945, + 0.9644765723496675, + 0.5135419086145703, + 0.09076041728258133, + 0.21933631226420403, + 0.25839293003082275 + ], + "unique_experts": 61, + "load_cv": 1.1027462911821782, + "normalized_load_entropy": 0.8963563585371315, + "max_load_share": 0.1111111111111111 + } + }, + "s1_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "37dbe4e2f4063ed2c478d49a9eca04724323c2373f90422888e14339ddc2e7d6", + "route_weight_sha256": "2b8f4b3f7ee99d25e550579c57ba5544be8cd8f464c0774212d328248dd93a02", + "loads": [ + 2, + 5, + 0, + 1, + 2, + 1, + 0, + 1, + 3, + 3, + 2, + 6, + 6, + 1, + 0, + 1, + 2, + 1, + 1, + 2, + 1, + 5, + 2, + 2, + 5, + 0, + 2, + 7, + 1, + 12, + 2, + 1, + 5, + 1, + 3, + 0, + 2, + 5, + 1, + 3, + 1, + 0, + 2, + 0, + 1, + 1, + 0, + 2, + 0, + 3, + 0, + 1, + 4, + 4, + 0, + 2, + 5, + 4, + 4, + 2, + 0, + 1, + 0, + 1 + ], + "weighted_loads": [ + 0.09101056680083275, + 0.3890019841492176, + 0.0, + 0.07859209179878235, + 0.17263473570346832, + 0.11239766329526901, + 0.0, + 0.06677962094545364, + 0.18615001812577248, + 0.2028973028063774, + 0.36398449540138245, + 0.5871914923191071, + 0.5622463412582874, + 0.055324409157037735, + 0.0, + 0.0796666219830513, + 0.18722300976514816, + 0.036067914217710495, + 0.12084028124809265, + 0.13814680837094784, + 0.06636392325162888, + 0.5205707903951406, + 0.1502663940191269, + 0.10709981620311737, + 0.26876671984791756, + 0.0, + 0.14486088976264, + 0.5345016941428185, + 0.07005676627159119, + 1.0245727468281984, + 0.12288235686719418, + 0.10385756939649582, + 0.3784596137702465, + 0.07610772550106049, + 0.24142414331436157, + 0.0, + 0.11202026531100273, + 0.3513944000005722, + 0.05107014626264572, + 0.32142826169729233, + 0.033861227333545685, + 0.0, + 0.2239064946770668, + 0.0, + 0.06299667060375214, + 0.06489231437444687, + 0.0, + 0.10190964862704277, + 0.0, + 0.19790548086166382, + 0.0, + 0.0342484749853611, + 0.32495061308145523, + 0.19561854749917984, + 0.0, + 0.10249964892864227, + 0.43647650629282, + 0.2579185590147972, + 0.34810577519237995, + 0.12138944864273071, + 0.0, + 0.09142936766147614, + 0.0, + 0.23766234517097473 + ], + "unique_experts": 51, + "load_cv": 1.0048193050239391, + "normalized_load_entropy": 0.8862965099109157, + "max_load_share": 0.08695652173913043 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "bc10dbffe4437c58f0b8ff5f9743430319efbc5cf706753204de665858c1c43c", + "route_weight_sha256": "f1b5a299ce1ff1f69fbc32dae26df3a166dcb6130bb9a09d121ea843c87d2877", + "loads": [ + 2, + 8, + 3, + 10, + 2, + 1, + 2, + 1, + 3, + 11, + 11, + 7, + 7, + 15, + 3, + 5, + 4, + 3, + 8, + 4, + 2, + 7, + 7, + 3, + 5, + 10, + 12, + 7, + 2, + 34, + 2, + 2, + 5, + 2, + 17, + 0, + 3, + 9, + 5, + 6, + 4, + 6, + 11, + 0, + 3, + 4, + 11, + 6, + 1, + 5, + 2, + 2, + 9, + 8, + 6, + 2, + 10, + 6, + 4, + 17, + 7, + 3, + 4, + 3 + ], + "weighted_loads": [ + 0.09101056680083275, + 0.5737513788044453, + 0.1707875207066536, + 0.8929800388286822, + 0.17263473570346832, + 0.11239766329526901, + 0.14488976076245308, + 0.06677962094545364, + 0.18615001812577248, + 1.252059057354927, + 0.9546872396022081, + 0.6043080314993858, + 0.6681642793118954, + 1.029084675014019, + 0.07467341609299183, + 0.37516796588897705, + 0.5513123199343681, + 0.10653775557875633, + 0.6709307945566252, + 0.22856917046010494, + 0.11520972102880478, + 0.8521118704229593, + 0.5153498016297817, + 0.20087232440710068, + 0.26876671984791756, + 0.6048547644168139, + 1.3148638308048248, + 0.5345016941428185, + 0.1152527779340744, + 2.2628531455993652, + 0.12288235686719418, + 0.1222330741584301, + 0.3784596137702465, + 0.10142027959227562, + 1.5286134556517936, + 0.0, + 0.1394705083221197, + 0.5258239917457104, + 1.300472691655159, + 0.5339184030890465, + 0.19291962310671806, + 0.3332529186445754, + 0.6560471951961517, + 0.0, + 0.13269323110580444, + 0.1917312222358305, + 1.2993209324777126, + 0.43946196511387825, + 0.02977423183619976, + 0.2616575323045254, + 0.09273863583803177, + 0.1313568614423275, + 0.8156789615750313, + 0.3781559579074383, + 0.5499279052019119, + 0.10249964892864227, + 0.8593949601054192, + 0.33166888169944286, + 0.34810577519237995, + 1.0975788068026304, + 0.9232124425470829, + 0.2878970429301262, + 0.30725187063217163, + 0.31297577917575836 + ], + "unique_experts": 62, + "load_cv": 0.8740073734751262, + "normalized_load_entropy": 0.9270068413180496, + "max_load_share": 0.08854166666666667 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "ordered_topk_exact_tokens": 17, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.9503105590062113, + "mean_token_weighted_tv": 0.010982745448532312, + "aggregate_load_tv": 0.028985507246376812 + }, + "system_bos": { + "tokens": 23, + "ordered_topk_exact_tokens": 18, + "set_exact_tokens": 21, + "mean_set_jaccard": 0.9751552795031057, + "mean_token_weighted_tv": 0.012618653516730537, + "aggregate_load_tv": 0.014492753623188408 + }, + "system_x": { + "tokens": 23, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8881987577639753, + "mean_token_weighted_tv": 0.028350732005808666, + "aggregate_load_tv": 0.06521739130434782 + }, + "system_period": { + "tokens": 23, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8881987577639753, + "mean_token_weighted_tv": 0.02773238953364932, + "aggregate_load_tv": 0.06521739130434782 + }, + "bos_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.9254658385093167, + "mean_token_weighted_tv": 0.02369612329841956, + "aggregate_load_tv": 0.04347826086956523 + }, + "bos_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.9254658385093169, + "mean_token_weighted_tv": 0.026613943116820377, + "aggregate_load_tv": 0.04347826086956521 + }, + "x_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.9254658385093167, + "mean_token_weighted_tv": 0.024740493613416733, + "aggregate_load_tv": 0.04347826086956521 + }, + "x_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8881987577639753, + "mean_token_weighted_tv": 0.03545913695479217, + "aggregate_load_tv": 0.06521739130434782 + }, + "period_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.9006211180124224, + "mean_token_weighted_tv": 0.028694278439101967, + "aggregate_load_tv": 0.05797101449275363 + }, + "period_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8881987577639753, + "mean_token_weighted_tv": 0.034952335140627365, + "aggregate_load_tv": 0.06521739130434782 + } + } + }, + "layer_05": { + "layer": 5, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "629119f7a0047d4365d76ddb97614c8380f2a47b271fe42c841d6da9a75bd148", + "route_weight_sha256": "92077dfdf276ff4557b5e16d2590c9bb751ce2ed3c46f77bd4cb536a5407c190", + "loads": [ + 2, + 4, + 1, + 1, + 0, + 1, + 4, + 1, + 3, + 1, + 1, + 8, + 3, + 2, + 1, + 1, + 3, + 9, + 3, + 1, + 3, + 2, + 0, + 1, + 2, + 3, + 2, + 3, + 2, + 1, + 2, + 1, + 3, + 3, + 5, + 5, + 0, + 8, + 0, + 1, + 3, + 4, + 2, + 3, + 4, + 0, + 1, + 0, + 1, + 0, + 0, + 1, + 0, + 2, + 0, + 2, + 6, + 1, + 0, + 2, + 0, + 2, + 4, + 3 + ], + "weighted_loads": [ + 0.39833471179008484, + 0.5655407346785069, + 0.046685539186000824, + 0.034571122378110886, + 0.0, + 0.050528161227703094, + 0.33608948439359665, + 0.03340935707092285, + 0.19081834331154823, + 0.13527439534664154, + 0.07389511913061142, + 0.6087732426822186, + 0.2168525755405426, + 0.19578855484724045, + 0.03746969625353813, + 0.04676661267876625, + 0.14267900586128235, + 0.8495847582817078, + 0.23827635869383812, + 0.08321483433246613, + 0.252107385545969, + 0.09030890837311745, + 0.0, + 0.0881349965929985, + 0.18299242854118347, + 0.12422605976462364, + 0.11243406683206558, + 0.15939877554774284, + 0.08368749916553497, + 0.07155723124742508, + 0.11318207159638405, + 0.05430248752236366, + 0.17511706985533237, + 0.16992241516709328, + 0.32969145476818085, + 0.49141208082437515, + 0.0, + 0.6494787447154522, + 0.0, + 0.115021713078022, + 0.40205105021595955, + 0.28827987238764763, + 0.20442333072423935, + 0.3213198333978653, + 0.18209906667470932, + 0.0, + 0.05468163639307022, + 0.0, + 0.1759386658668518, + 0.0, + 0.0, + 0.05413532629609108, + 0.0, + 0.10563894361257553, + 0.0, + 0.05835679732263088, + 0.33220669999718666, + 0.048616088926792145, + 0.0, + 0.15712429210543633, + 0.0, + 0.17148670181632042, + 0.337346900254488, + 0.2858813628554344 + ], + "unique_experts": 52, + "load_cv": 0.91740389670136, + "normalized_load_entropy": 0.8993470338686528, + "max_load_share": 0.06521739130434782 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "acf67a8e2d4bae55c2f6a8741ec0210fb2bd8f0e6298c04905862109e8c5230f", + "route_weight_sha256": "d7e5765768a3b6af840477dfd1d1bb4051dc7a6cc7e12049b370d42e5a151e9f", + "loads": [ + 2, + 5, + 1, + 1, + 1, + 3, + 5, + 2, + 4, + 3, + 12, + 8, + 5, + 2, + 1, + 14, + 5, + 15, + 12, + 2, + 5, + 2, + 0, + 1, + 2, + 11, + 2, + 3, + 2, + 2, + 2, + 1, + 3, + 3, + 5, + 9, + 0, + 8, + 11, + 9, + 7, + 13, + 9, + 4, + 5, + 0, + 1, + 2, + 1, + 4, + 8, + 1, + 2, + 10, + 3, + 12, + 6, + 1, + 0, + 3, + 0, + 3, + 4, + 5 + ], + "weighted_loads": [ + 0.39833471179008484, + 0.5690530855208635, + 0.046685539186000824, + 0.034571122378110886, + 0.0017690081149339676, + 0.11827040649950504, + 0.36807966232299805, + 0.03647836670279503, + 0.1941836541518569, + 0.17978400271385908, + 0.7260861285030842, + 0.6087732426822186, + 0.35625141859054565, + 0.19578855484724045, + 0.03746969625353813, + 2.219161657616496, + 0.2835718244314194, + 1.1463484652340412, + 1.2045245841145515, + 0.09627672005444765, + 0.26754408213309944, + 0.09030890837311745, + 0.0, + 0.0881349965929985, + 0.18299242854118347, + 1.027699563652277, + 0.11243406683206558, + 0.15939877554774284, + 0.08368749916553497, + 0.16069985926151276, + 0.11318207159638405, + 0.05430248752236366, + 0.17511706985533237, + 0.16992241516709328, + 0.32969145476818085, + 0.8028031811118126, + 0.0, + 0.6494787447154522, + 1.0987486839294434, + 0.7570083625614643, + 0.5776590034365654, + 1.1966467387974262, + 0.8008460961282253, + 0.3693339042365551, + 0.2640695497393608, + 0.0, + 0.05468163639307022, + 0.017964659724384546, + 0.1759386658668518, + 0.21019187662750483, + 0.8355545364320278, + 0.05413532629609108, + 1.6294481754302979, + 0.6458793357014656, + 0.016895671607926488, + 0.7978229653090239, + 0.33220669999718666, + 0.048616088926792145, + 0.0, + 0.20329706743359566, + 0.0, + 0.2112177349627018, + 0.337346900254488, + 1.221317857503891 + ], + "unique_experts": 59, + "load_cv": 0.8704688675551332, + "normalized_load_entropy": 0.9113862681373188, + "max_load_share": 0.052083333333333336 + } + }, + "s1_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "143c9ed7230113f4e757dd0751cecffdb9d195f9fa81d5e74de848ab5c769953", + "route_weight_sha256": "67821a9215e03b2c27d5fad7b0db0219174ab6c14a0b7b73327e36f4e03bff9a", + "loads": [ + 3, + 4, + 1, + 1, + 0, + 1, + 4, + 1, + 3, + 1, + 1, + 8, + 3, + 2, + 1, + 0, + 3, + 9, + 3, + 1, + 3, + 2, + 0, + 1, + 2, + 3, + 2, + 3, + 2, + 1, + 2, + 1, + 3, + 3, + 5, + 5, + 0, + 8, + 0, + 1, + 3, + 4, + 2, + 4, + 4, + 0, + 1, + 0, + 1, + 0, + 0, + 1, + 0, + 2, + 0, + 2, + 5, + 1, + 0, + 2, + 0, + 2, + 4, + 3 + ], + "weighted_loads": [ + 0.440457284450531, + 0.5667093470692635, + 0.04609648510813713, + 0.035061489790678024, + 0.0, + 0.04909229651093483, + 0.33310041204094887, + 0.03326265141367912, + 0.1904885284602642, + 0.13938328623771667, + 0.07263042777776718, + 0.5945492871105671, + 0.2184905968606472, + 0.1949782446026802, + 0.036609798669815063, + 0.0, + 0.1403704583644867, + 0.879932964220643, + 0.24106982722878456, + 0.09250690042972565, + 0.25185995548963547, + 0.08738099783658981, + 0.0, + 0.08772408962249756, + 0.19067786633968353, + 0.13165677711367607, + 0.11030782014131546, + 0.1590275578200817, + 0.08605023846030235, + 0.0709317997097969, + 0.11484689638018608, + 0.0529588907957077, + 0.17495916783809662, + 0.16948817297816277, + 0.3303782530128956, + 0.47605089843273163, + 0.0, + 0.6262548640370369, + 0.0, + 0.10928899049758911, + 0.3993041664361954, + 0.28179097548127174, + 0.2021719366312027, + 0.3678413815796375, + 0.18062549456954002, + 0.0, + 0.05740109458565712, + 0.0, + 0.17369574308395386, + 0.0, + 0.0, + 0.054557763040065765, + 0.0, + 0.10694127157330513, + 0.0, + 0.05726507492363453, + 0.2983675189316273, + 0.04704780504107475, + 0.0, + 0.16083576902747154, + 0.0, + 0.16938137635588646, + 0.33768099173903465, + 0.28670620918273926 + ], + "unique_experts": 51, + "load_cv": 0.91740389670136, + "normalized_load_entropy": 0.8968109644603074, + "max_load_share": 0.06521739130434782 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "7a2c6addff0e34f7d367eb637deab599c50dc298c4caf97a2f45bbce512e6272", + "route_weight_sha256": "40aafa43850a564c45fea332d5fb82107f79bcebd0b72d4f78a3ccdb389989ae", + "loads": [ + 4, + 5, + 1, + 7, + 1, + 3, + 12, + 3, + 4, + 3, + 15, + 11, + 7, + 2, + 2, + 15, + 6, + 20, + 15, + 11, + 5, + 2, + 1, + 1, + 3, + 11, + 2, + 5, + 2, + 4, + 2, + 1, + 4, + 4, + 6, + 9, + 1, + 11, + 12, + 13, + 7, + 18, + 13, + 8, + 5, + 0, + 1, + 3, + 1, + 14, + 10, + 3, + 2, + 12, + 4, + 12, + 5, + 1, + 1, + 3, + 1, + 3, + 4, + 7 + ], + "weighted_loads": [ + 0.47712693735957146, + 0.5702920746989548, + 0.04609648510813713, + 0.4492307938635349, + 0.0017738371388986707, + 0.12135839834809303, + 1.3161952644586563, + 0.087898078141734, + 0.19386125053279102, + 0.18698098743334413, + 0.9099985994398594, + 0.9585423730313778, + 0.5877650640904903, + 0.1949782446026802, + 0.07098792865872383, + 2.6519962288439274, + 0.36453215777873993, + 1.5608314890414476, + 1.5490045063197613, + 0.9415819207206368, + 0.2671795685309917, + 0.08738099783658981, + 0.037654053419828415, + 0.08772408962249756, + 0.2670276612043381, + 0.8528300188481808, + 0.11030782014131546, + 0.33076078817248344, + 0.08605023846030235, + 0.25234659761190414, + 0.11484689638018608, + 0.0529588907957077, + 0.2937082499265671, + 0.2128632441163063, + 0.3647446297109127, + 0.9106622040271759, + 0.04582519829273224, + 0.7781125120818615, + 1.2529701478779316, + 1.2067884989082813, + 0.561091847717762, + 1.6169287264347076, + 1.0986269041895866, + 0.6117951273918152, + 0.24204832687973976, + 0.0, + 0.05740109458565712, + 0.050839781761169434, + 0.17369574308395386, + 0.8549491995945573, + 1.2916423678398132, + 0.12304898351430893, + 1.6293217539787292, + 0.9137805327773094, + 0.054564460879191756, + 0.6718977745622396, + 0.2983675189316273, + 0.04704780504107475, + 0.06978742778301239, + 0.20798970386385918, + 0.04575442150235176, + 0.20771268010139465, + 0.33768099173903465, + 1.4640839956700802 + ], + "unique_experts": 63, + "load_cv": 0.8202091535428969, + "normalized_load_entropy": 0.9218964073516004, + "max_load_share": 0.052083333333333336 + } + }, + "s0_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "1e7a897ef01f925e0ac9ab610512f3386160d69faaa576d28218fcccbb5cbb42", + "route_weight_sha256": "ac0ceedd7f703861d3ff2556090fe9ddd94a10539ca26f31adf2ac7da0266b71", + "loads": [ + 2, + 4, + 1, + 1, + 0, + 1, + 4, + 1, + 3, + 1, + 1, + 8, + 3, + 3, + 1, + 1, + 3, + 9, + 3, + 1, + 3, + 2, + 0, + 1, + 3, + 2, + 1, + 2, + 1, + 1, + 2, + 1, + 3, + 3, + 5, + 6, + 0, + 8, + 0, + 1, + 3, + 4, + 2, + 3, + 4, + 0, + 1, + 0, + 2, + 0, + 1, + 1, + 0, + 2, + 0, + 1, + 6, + 1, + 0, + 2, + 0, + 2, + 4, + 3 + ], + "weighted_loads": [ + 0.41390088200569153, + 0.5847937203943729, + 0.04777494817972183, + 0.034690260887145996, + 0.0, + 0.05022739991545677, + 0.3373872637748718, + 0.03176066279411316, + 0.19902320578694344, + 0.13853462040424347, + 0.08229658007621765, + 0.60845160856843, + 0.21405809745192528, + 0.22091574221849442, + 0.03868767246603966, + 0.04326877370476723, + 0.1472141481935978, + 0.8247264437377453, + 0.24281856417655945, + 0.06957916915416718, + 0.2610068693757057, + 0.09351792186498642, + 0.0, + 0.09432660043239594, + 0.20855087228119373, + 0.09256446734070778, + 0.07699636369943619, + 0.13141871243715286, + 0.05138262361288071, + 0.07506974041461945, + 0.10992006957530975, + 0.06064604967832565, + 0.1779515389353037, + 0.1785994991660118, + 0.3164025917649269, + 0.5792886577546597, + 0.0, + 0.6287439540028572, + 0.0, + 0.1002882868051529, + 0.39738740399479866, + 0.30134590715169907, + 0.20889950171113014, + 0.3182756304740906, + 0.19206344336271286, + 0.0, + 0.06153750419616699, + 0.0, + 0.21760473027825356, + 0.0, + 0.037174977362155914, + 0.05506494641304016, + 0.0, + 0.10415258258581161, + 0.0, + 0.027485959231853485, + 0.35468652844429016, + 0.05420508608222008, + 0.0, + 0.1670508235692978, + 0.0, + 0.16130422800779343, + 0.3356344811618328, + 0.3069637045264244 + ], + "unique_experts": 53, + "load_cv": 0.9283284660133794, + "normalized_load_entropy": 0.8994676443397999, + "max_load_share": 0.06521739130434782 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "2bcf4c82736bba8594df82906cb8a2d6c3c358b9b360df83872463d96a9f34ae", + "route_weight_sha256": "f098a1012d733fd137befb6ced941f087e05a5bdb31ebb249bd204a92a800f5c", + "loads": [ + 2, + 5, + 1, + 1, + 0, + 3, + 6, + 2, + 4, + 3, + 12, + 8, + 5, + 3, + 1, + 15, + 5, + 15, + 12, + 2, + 4, + 2, + 0, + 1, + 3, + 10, + 1, + 2, + 1, + 2, + 2, + 1, + 3, + 3, + 5, + 10, + 0, + 8, + 12, + 10, + 7, + 13, + 10, + 4, + 5, + 0, + 1, + 1, + 2, + 5, + 8, + 1, + 1, + 10, + 2, + 12, + 6, + 1, + 0, + 3, + 0, + 2, + 4, + 5 + ], + "weighted_loads": [ + 0.41390088200569153, + 0.5883060712367296, + 0.04777494817972183, + 0.034690260887145996, + 0.0, + 0.11796964518725872, + 0.40663792937994003, + 0.034829672425985336, + 0.2023885166272521, + 0.21734285354614258, + 0.7582484968006611, + 0.60845160856843, + 0.3512381874024868, + 0.22091574221849442, + 0.03868767246603966, + 2.2227054815739393, + 0.2936313785612583, + 1.1214901506900787, + 1.2965023443102837, + 0.0826410548761487, + 0.27353966794908047, + 0.09351792186498642, + 0.0, + 0.09432660043239594, + 0.20855087228119373, + 0.9960379712283611, + 0.07699636369943619, + 0.13141871243715286, + 0.05138262361288071, + 0.12229689210653305, + 0.10992006957530975, + 0.06064604967832565, + 0.1779515389353037, + 0.1785994991660118, + 0.3164025917649269, + 0.8906797580420971, + 0.0, + 0.6287439540028572, + 1.2387742809951305, + 0.8101343847811222, + 0.5729953572154045, + 1.214648474007845, + 0.825146034359932, + 0.366329837590456, + 0.27403392642736435, + 0.0, + 0.06153750419616699, + 0.015553807839751244, + 0.21760473027825356, + 0.26210273522883654, + 0.7655531950294971, + 0.05506494641304016, + 0.6649863719940186, + 0.6443929746747017, + 0.014986032852903008, + 0.768954586237669, + 0.35468652844429016, + 0.05420508608222008, + 0.0, + 0.21322359889745712, + 0.0, + 0.16130422800779343, + 0.3356344811618328, + 1.242400199174881 + ], + "unique_experts": 58, + "load_cv": 0.9069348731841393, + "normalized_load_entropy": 0.9029100874612578, + "max_load_share": 0.052083333333333336 + } + }, + "s1_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "9642bfae264b49af7da9dac0f3477f6813d723da96673cc8954b18ab030a574b", + "route_weight_sha256": "a3ac03f65a9042ef26110518ce0823a3fde34cf10ee3fcf67e2afcbee187a3a7", + "loads": [ + 2, + 4, + 1, + 1, + 0, + 1, + 4, + 1, + 3, + 1, + 1, + 8, + 3, + 3, + 1, + 0, + 3, + 9, + 3, + 1, + 3, + 2, + 0, + 1, + 3, + 2, + 1, + 4, + 1, + 1, + 2, + 1, + 3, + 3, + 5, + 6, + 0, + 8, + 0, + 1, + 3, + 4, + 2, + 3, + 4, + 0, + 1, + 0, + 2, + 0, + 1, + 1, + 0, + 1, + 0, + 1, + 5, + 1, + 0, + 2, + 0, + 2, + 4, + 4 + ], + "weighted_loads": [ + 0.4333741366863251, + 0.6003816090524197, + 0.04562314227223396, + 0.03610732778906822, + 0.0, + 0.050590578466653824, + 0.3582408241927624, + 0.028469298034906387, + 0.20812251418828964, + 0.14383555948734283, + 0.08142397552728653, + 0.6194356642663479, + 0.21249361336231232, + 0.23047373071312904, + 0.036589231342077255, + 0.0, + 0.1412043794989586, + 0.8392114192247391, + 0.22489569708704948, + 0.08410130441188812, + 0.2721460089087486, + 0.08999546989798546, + 0.0, + 0.09251341223716736, + 0.21290032751858234, + 0.08865754306316376, + 0.07287819683551788, + 0.22705423086881638, + 0.05219527706503868, + 0.06964294612407684, + 0.1100219190120697, + 0.06092687323689461, + 0.17679799906909466, + 0.18054192140698433, + 0.31524619087576866, + 0.5457539930939674, + 0.0, + 0.6267409920692444, + 0.0, + 0.08759016543626785, + 0.39704928174614906, + 0.2677847258746624, + 0.20303940773010254, + 0.31385789066553116, + 0.19681193307042122, + 0.0, + 0.0647650957107544, + 0.0, + 0.22225314006209373, + 0.0, + 0.040981024503707886, + 0.057324234396219254, + 0.0, + 0.0561198964715004, + 0.0, + 0.026354577392339706, + 0.32348550483584404, + 0.05634818226099014, + 0.0, + 0.17321226000785828, + 0.0, + 0.15611041709780693, + 0.3525429964065552, + 0.33175867423415184 + ], + "unique_experts": 52, + "load_cv": 0.9355406431021744, + "normalized_load_entropy": 0.8954278158760965, + "max_load_share": 0.06521739130434782 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "5722ced7d0ce4bdff50e3edd2dc9a1ac542500eacf9ce0b57d01a65cb20e81d7", + "route_weight_sha256": "83ed06a781b04066e0513ef5afcb377c2a8cb39baabf000bbe43246014fa01b2", + "loads": [ + 3, + 5, + 1, + 7, + 0, + 3, + 12, + 3, + 4, + 2, + 15, + 11, + 8, + 3, + 2, + 16, + 7, + 20, + 17, + 11, + 4, + 2, + 1, + 1, + 4, + 10, + 1, + 6, + 1, + 3, + 2, + 1, + 4, + 4, + 6, + 10, + 1, + 11, + 13, + 13, + 6, + 18, + 14, + 7, + 5, + 0, + 1, + 2, + 2, + 13, + 12, + 3, + 1, + 11, + 3, + 12, + 5, + 1, + 1, + 3, + 1, + 3, + 4, + 8 + ], + "weighted_loads": [ + 0.4700437895953655, + 0.603964336682111, + 0.04562314227223396, + 0.4502766318619251, + 0.0, + 0.12285668030381203, + 1.3413356766104698, + 0.08310472476296127, + 0.21149523626081645, + 0.18603618815541267, + 0.9302676916122437, + 0.9834287501871586, + 0.6173907145857811, + 0.23047373071312904, + 0.07096736133098602, + 2.7166146375238895, + 0.40568946301937103, + 1.5201099440455437, + 1.6914570182561874, + 0.9331763247027993, + 0.2846788074821234, + 0.08999546989798546, + 0.037654053419828415, + 0.09251341223716736, + 0.2892501223832369, + 0.8098307847976685, + 0.07287819683551788, + 0.3987874612212181, + 0.05219527706503868, + 0.15685873478651047, + 0.1100219190120697, + 0.06092687323689461, + 0.2955470811575651, + 0.22391699254512787, + 0.3496125675737858, + 0.9803652986884117, + 0.04582519829273224, + 0.778598640114069, + 1.379264023154974, + 1.1954534016549587, + 0.5253156945109367, + 1.6191300638020039, + 1.1195471100509167, + 0.5608747750520706, + 0.25823476538062096, + 0.0, + 0.0647650957107544, + 0.04839483089745045, + 0.22225314006209373, + 0.8375053824856877, + 1.281171627342701, + 0.12581545487046242, + 0.6649863719940186, + 0.8629591576755047, + 0.0525682857260108, + 0.6621599085628986, + 0.32348550483584404, + 0.05634818226099014, + 0.06978742778301239, + 0.2203661948442459, + 0.04575442150235176, + 0.19455008208751678, + 0.3525429964065552, + 1.5091364607214928 + ], + "unique_experts": 62, + "load_cv": 0.8539125638299665, + "normalized_load_entropy": 0.914322548931771, + "max_load_share": 0.052083333333333336 + } + }, + "s0_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "5798c0efa65314807b51a654b90864ff9724afd468cbb8f82a5ddeaabe2052b6", + "route_weight_sha256": "6fbbe6eebb83880a25170e7f681ec12a4be42ede9ebaf8e7ecf592bde978189e", + "loads": [ + 3, + 4, + 0, + 1, + 0, + 1, + 4, + 1, + 3, + 1, + 1, + 8, + 3, + 3, + 1, + 1, + 3, + 7, + 4, + 1, + 3, + 2, + 0, + 1, + 2, + 3, + 2, + 3, + 2, + 1, + 2, + 1, + 3, + 3, + 5, + 5, + 0, + 8, + 0, + 1, + 3, + 4, + 2, + 3, + 4, + 0, + 1, + 0, + 1, + 0, + 1, + 1, + 0, + 1, + 0, + 2, + 5, + 1, + 0, + 2, + 0, + 2, + 4, + 4 + ], + "weighted_loads": [ + 0.4386969171464443, + 0.569698192179203, + 0.0, + 0.031555380672216415, + 0.0, + 0.052030742168426514, + 0.31605780497193336, + 0.030494555830955505, + 0.19214210286736488, + 0.12596358358860016, + 0.08178281784057617, + 0.5845874175429344, + 0.21922093257308006, + 0.2142988070845604, + 0.03662414848804474, + 0.04975833371281624, + 0.15313954278826714, + 0.7462384440004826, + 0.28075675293803215, + 0.08122894912958145, + 0.23794427886605263, + 0.09275457262992859, + 0.0, + 0.08659786731004715, + 0.1825343444943428, + 0.13104632124304771, + 0.12069161608815193, + 0.18292450159788132, + 0.08584828674793243, + 0.07406853139400482, + 0.10932420566678047, + 0.06008487939834595, + 0.16885241121053696, + 0.1714809350669384, + 0.3240142799913883, + 0.530505895614624, + 0.0, + 0.6194527558982372, + 0.0, + 0.09090139716863632, + 0.41763967275619507, + 0.3068943955004215, + 0.18436017632484436, + 0.3119346871972084, + 0.19418078660964966, + 0.0, + 0.06058959662914276, + 0.0, + 0.17670032382011414, + 0.0, + 0.040203191339969635, + 0.055766619741916656, + 0.0, + 0.05199950188398361, + 0.0, + 0.05921918526291847, + 0.28541392646729946, + 0.053738079965114594, + 0.0, + 0.16790326312184334, + 0.0, + 0.15453972294926643, + 0.32911913469433784, + 0.32134009897708893 + ], + "unique_experts": 52, + "load_cv": 0.8761825507357589, + "normalized_load_entropy": 0.9027020762460292, + "max_load_share": 0.057971014492753624 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "04b599a5547bf3326b67046e80f257f1e697a029b62aed974413454135ba69cc", + "route_weight_sha256": "b0dc49a13993896ce87c2edbb86dce7fad09a3b851bda5f441abb0f7ac6c658f", + "loads": [ + 3, + 6, + 0, + 1, + 0, + 3, + 5, + 2, + 4, + 1, + 13, + 8, + 6, + 3, + 1, + 15, + 5, + 13, + 13, + 3, + 4, + 2, + 0, + 1, + 2, + 12, + 2, + 3, + 2, + 1, + 2, + 1, + 3, + 3, + 5, + 9, + 0, + 8, + 10, + 9, + 9, + 13, + 9, + 4, + 5, + 0, + 1, + 1, + 1, + 3, + 8, + 1, + 1, + 11, + 2, + 13, + 5, + 1, + 0, + 3, + 0, + 3, + 4, + 6 + ], + "weighted_loads": [ + 0.4386969171464443, + 0.6099154930561781, + 0.0, + 0.031555380672216415, + 0.0, + 0.11977298744022846, + 0.34804798290133476, + 0.03356356546282768, + 0.19550741370767355, + 0.12596358358860016, + 0.8729345872998238, + 0.5845874175429344, + 0.4034179039299488, + 0.2142988070845604, + 0.03662414848804474, + 2.4056506287306547, + 0.29666460677981377, + 1.043002150952816, + 1.2443137541413307, + 0.13630994502454996, + 0.2504770774394274, + 0.09275457262992859, + 0.0, + 0.08659786731004715, + 0.1825343444943428, + 1.1208493821322918, + 0.12069161608815193, + 0.18292450159788132, + 0.08584828674793243, + 0.07406853139400482, + 0.10932420566678047, + 0.06008487939834595, + 0.16885241121053696, + 0.1714809350669384, + 0.3240142799913883, + 0.8418969959020615, + 0.0, + 0.6194527558982372, + 0.9203880466520786, + 0.7681448347866535, + 0.7091712057590485, + 1.1610845997929573, + 0.6830991953611374, + 0.3563346192240715, + 0.27615126967430115, + 0.0, + 0.06058959662914276, + 0.015553807839751244, + 0.17670032382011414, + 0.18467189464718103, + 0.7224466316401958, + 0.055766619741916656, + 0.6649863719940186, + 0.7060642652213573, + 0.014986032852903008, + 0.8742522560060024, + 0.28541392646729946, + 0.053738079965114594, + 0.0, + 0.21407603845000267, + 0.0, + 0.19206944853067398, + 0.32911913469433784, + 1.2567765936255455 + ], + "unique_experts": 57, + "load_cv": 0.9137157890776959, + "normalized_load_entropy": 0.9000406126046451, + "max_load_share": 0.052083333333333336 + } + }, + "s1_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "42640f28b794e8579288083f5d98f016045c0eae05fee5c339066da0b3c00a3a", + "route_weight_sha256": "ec14c40666040b21cc8d34938442bea638f37df79a7bbcab7d3945cbaf48e4c7", + "loads": [ + 2, + 4, + 1, + 1, + 0, + 1, + 4, + 0, + 3, + 1, + 1, + 8, + 3, + 2, + 1, + 1, + 3, + 9, + 3, + 1, + 3, + 2, + 0, + 1, + 2, + 3, + 2, + 3, + 2, + 1, + 2, + 1, + 3, + 4, + 5, + 5, + 0, + 8, + 0, + 1, + 3, + 4, + 2, + 3, + 4, + 0, + 1, + 0, + 1, + 0, + 1, + 1, + 0, + 1, + 0, + 2, + 5, + 1, + 0, + 2, + 0, + 2, + 4, + 4 + ], + "weighted_loads": [ + 0.4449354410171509, + 0.6034667789936066, + 0.04596507176756859, + 0.035239074379205704, + 0.0, + 0.05090422183275223, + 0.34526656195521355, + 0.0, + 0.21225938200950623, + 0.1386854350566864, + 0.07598662376403809, + 0.6013871394097805, + 0.21110111847519875, + 0.18636705726385117, + 0.03648246079683304, + 0.04614296182990074, + 0.14200406521558762, + 0.829956978559494, + 0.21950333192944527, + 0.10086265206336975, + 0.26347616314888, + 0.09106816351413727, + 0.0, + 0.09247232973575592, + 0.18878739327192307, + 0.12516134977340698, + 0.11897476390004158, + 0.18918898329138756, + 0.0851849876344204, + 0.0694374069571495, + 0.10813005268573761, + 0.05937550216913223, + 0.1700143702328205, + 0.20975364930927753, + 0.3299688920378685, + 0.4874894805252552, + 0.0, + 0.6263050585985184, + 0.0, + 0.09155991673469543, + 0.39785629138350487, + 0.26688177511096, + 0.1821349300444126, + 0.3092523142695427, + 0.2017785757780075, + 0.0, + 0.06144363060593605, + 0.0, + 0.17638516426086426, + 0.0, + 0.042470067739486694, + 0.057299915701150894, + 0.0, + 0.05422615259885788, + 0.0, + 0.05582627095282078, + 0.30433239787817, + 0.059075016528367996, + 0.0, + 0.17173190787434578, + 0.0, + 0.1542024277150631, + 0.35744013264775276, + 0.31563466787338257 + ], + "unique_experts": 52, + "load_cv": 0.91740389670136, + "normalized_load_entropy": 0.8986343642239873, + "max_load_share": 0.06521739130434782 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "550632e059dc4cf062b9b6bb10821a52fc70bc97c9d45c8739cb01f9b7d52818", + "route_weight_sha256": "10becbf51a1547c4994a53918a0c8b0d021003ede9882f23a94edf0a43e4e2b4", + "loads": [ + 3, + 5, + 1, + 7, + 0, + 3, + 12, + 2, + 4, + 2, + 16, + 11, + 8, + 2, + 2, + 17, + 7, + 20, + 17, + 12, + 4, + 2, + 1, + 1, + 3, + 12, + 2, + 5, + 2, + 3, + 2, + 1, + 4, + 6, + 6, + 10, + 1, + 11, + 10, + 13, + 7, + 17, + 13, + 7, + 5, + 0, + 1, + 2, + 1, + 13, + 10, + 3, + 1, + 13, + 3, + 13, + 5, + 1, + 1, + 3, + 1, + 2, + 4, + 8 + ], + "weighted_loads": [ + 0.48160509392619133, + 0.6070495066232979, + 0.04596507176756859, + 0.4494083784520626, + 0.0, + 0.12317032366991043, + 1.328361414372921, + 0.05463542672805488, + 0.21563210408203304, + 0.17778511717915535, + 1.0297825373709202, + 0.9653802253305912, + 0.635201096534729, + 0.18636705726385117, + 0.0708605907857418, + 2.9492994099855423, + 0.4141835905611515, + 1.5108555033802986, + 1.5428775511682034, + 0.9888740414753556, + 0.27600896172225475, + 0.09106816351413727, + 0.037654053419828415, + 0.09247232973575592, + 0.2651371881365776, + 0.9249608889222145, + 0.11897476390004158, + 0.3609222136437893, + 0.0851849876344204, + 0.15665319561958313, + 0.10813005268573761, + 0.05937550216913223, + 0.28876345232129097, + 0.29750544391572475, + 0.3643352687358856, + 0.9680815823376179, + 0.04582519829273224, + 0.778162706643343, + 1.0080630853772163, + 1.2076282761991024, + 0.5995410084724426, + 1.5150914564728737, + 1.0057530738413334, + 0.5541250370442867, + 0.26320140808820724, + 0.0, + 0.06144363060593605, + 0.04839483089745045, + 0.17638516426086426, + 0.8327129231765866, + 1.1085600927472115, + 0.12579113617539406, + 0.6649863719940186, + 0.9735589250922203, + 0.0525682857260108, + 0.7661455888301134, + 0.30433239787817, + 0.059075016528367996, + 0.06978742778301239, + 0.2188858427107334, + 0.04575442150235176, + 0.1542024277150631, + 0.35744013264775276, + 1.4930124543607235 + ], + "unique_experts": 62, + "load_cv": 0.8620067027323834, + "normalized_load_entropy": 0.9127715282441307, + "max_load_share": 0.052083333333333336 + } + }, + "s0_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "01d5b38c62b9c3c4d11fb90c064ef1410174d5b56d8c5655d8260dc96658fa49", + "route_weight_sha256": "892dd576de0656d224befaea86974c91c58499a395e2651616b80b4cadb0cdf5", + "loads": [ + 3, + 4, + 0, + 1, + 0, + 1, + 4, + 1, + 3, + 1, + 1, + 8, + 3, + 3, + 0, + 1, + 2, + 8, + 4, + 1, + 3, + 2, + 0, + 1, + 2, + 3, + 2, + 4, + 2, + 1, + 2, + 1, + 3, + 3, + 5, + 5, + 0, + 7, + 0, + 1, + 3, + 4, + 2, + 3, + 4, + 0, + 1, + 0, + 2, + 0, + 1, + 1, + 0, + 1, + 0, + 2, + 5, + 1, + 0, + 2, + 0, + 2, + 4, + 4 + ], + "weighted_loads": [ + 0.4393502026796341, + 0.5677493512630463, + 0.0, + 0.03358552232384682, + 0.0, + 0.053224749863147736, + 0.32065393030643463, + 0.03080129250884056, + 0.1931275725364685, + 0.1268213540315628, + 0.07688560336828232, + 0.583896316587925, + 0.2193085141479969, + 0.20896854624152184, + 0.0, + 0.04286951199173927, + 0.11535846069455147, + 0.7744070664048195, + 0.28253769874572754, + 0.08022850751876831, + 0.2410123310983181, + 0.09540917351841927, + 0.0, + 0.09215176850557327, + 0.18301258236169815, + 0.13339563831686974, + 0.12453198805451393, + 0.22038434073328972, + 0.08543518930673599, + 0.07439373433589935, + 0.10977208241820335, + 0.06200737878680229, + 0.16925742477178574, + 0.17548657208681107, + 0.32978974282741547, + 0.5232210792601109, + 0.0, + 0.5590463317930698, + 0.0, + 0.09080493450164795, + 0.4257439635694027, + 0.3311044052243233, + 0.17954367771744728, + 0.3126229792833328, + 0.19832023233175278, + 0.0, + 0.0628075823187828, + 0.0, + 0.21623874455690384, + 0.0, + 0.04057127982378006, + 0.055280786007642746, + 0.0, + 0.052153900265693665, + 0.0, + 0.05847444571554661, + 0.2978309355676174, + 0.05460819974541664, + 0.0, + 0.15740778669714928, + 0.0, + 0.15385651215910912, + 0.3306663930416107, + 0.3034878112375736 + ], + "unique_experts": 51, + "load_cv": 0.883820352955903, + "normalized_load_entropy": 0.8996945581353128, + "max_load_share": 0.057971014492753624 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "c6e40c487e35a97ca18e21e1ff496de6501c7ff9989cda8bb93ec5651929a293", + "route_weight_sha256": "13c289b415bdd10ccd9c71ac1ff987e20b8bfc5344f402d350fbbb8a92bd1bac", + "loads": [ + 3, + 6, + 0, + 1, + 0, + 3, + 5, + 2, + 4, + 2, + 13, + 8, + 6, + 3, + 0, + 15, + 5, + 15, + 13, + 2, + 4, + 2, + 0, + 1, + 2, + 11, + 2, + 4, + 2, + 1, + 2, + 1, + 3, + 3, + 5, + 10, + 0, + 7, + 10, + 9, + 8, + 13, + 9, + 4, + 6, + 0, + 1, + 1, + 2, + 3, + 8, + 1, + 1, + 9, + 2, + 13, + 5, + 1, + 0, + 3, + 0, + 3, + 4, + 6 + ], + "weighted_loads": [ + 0.4393502026796341, + 0.6081986781209707, + 0.0, + 0.03358552232384682, + 0.0, + 0.12096699513494968, + 0.35264410823583603, + 0.03387030214071274, + 0.19649288337677717, + 0.16541924700140953, + 0.8553565293550491, + 0.583896316587925, + 0.4028579108417034, + 0.20896854624152184, + 0.0, + 2.229174157604575, + 0.2967059910297394, + 1.1281110309064388, + 1.1823463328182697, + 0.09329039324074984, + 0.25354512967169285, + 0.09540917351841927, + 0.0, + 0.09215176850557327, + 0.18301258236169815, + 1.036869142204523, + 0.12453198805451393, + 0.22038434073328972, + 0.08543518930673599, + 0.07439373433589935, + 0.10977208241820335, + 0.06200737878680229, + 0.16925742477178574, + 0.17548657208681107, + 0.32978974282741547, + 0.8863339200615883, + 0.0, + 0.5590463317930698, + 0.8863157518208027, + 0.781377699226141, + 0.6591244749724865, + 1.2180690243840218, + 0.6925910748541355, + 0.35682760551571846, + 0.3357318416237831, + 0.0, + 0.0628075823187828, + 0.015553807839751244, + 0.21623874455690384, + 0.17563502583652735, + 0.755273662507534, + 0.055280786007642746, + 0.6649863719940186, + 0.5923942923545837, + 0.014986032852903008, + 1.0036791805177927, + 0.2978309355676174, + 0.05460819974541664, + 0.0, + 0.2035805620253086, + 0.0, + 0.19204265251755714, + 0.3306663930416107, + 1.2389243058860302 + ], + "unique_experts": 56, + "load_cv": 0.9128709291752768, + "normalized_load_entropy": 0.8999191470343332, + "max_load_share": 0.052083333333333336 + } + }, + "s1_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "32e03592c55848c8dc3e26e75764aaf4da4dfda9f2012b3f35024077d4122e8c", + "route_weight_sha256": "c13501c799393a8bd676b25048adbb93adc001a0e83df76205972a2ef889d4a5", + "loads": [ + 3, + 4, + 1, + 1, + 0, + 1, + 4, + 0, + 3, + 1, + 1, + 8, + 3, + 3, + 1, + 0, + 2, + 8, + 3, + 1, + 3, + 2, + 0, + 1, + 2, + 2, + 1, + 5, + 2, + 1, + 2, + 1, + 3, + 4, + 5, + 5, + 0, + 8, + 0, + 1, + 3, + 4, + 2, + 3, + 4, + 0, + 1, + 0, + 2, + 0, + 1, + 1, + 0, + 1, + 0, + 2, + 5, + 1, + 0, + 2, + 0, + 2, + 4, + 4 + ], + "weighted_loads": [ + 0.4793766662478447, + 0.5954967252910137, + 0.045152775943279266, + 0.03552182763814926, + 0.0, + 0.05297468230128288, + 0.34197691455483437, + 0.0, + 0.2093965783715248, + 0.1390971541404724, + 0.06591285020112991, + 0.6028720922768116, + 0.21484894305467606, + 0.22430666163563728, + 0.036151181906461716, + 0.0, + 0.11032469570636749, + 0.7868341654539108, + 0.21461011096835136, + 0.10203713923692703, + 0.26551418006420135, + 0.09071619808673859, + 0.0, + 0.09144076704978943, + 0.18782853335142136, + 0.08620139211416245, + 0.0817323848605156, + 0.2678186371922493, + 0.08549192175269127, + 0.07025551050901413, + 0.11018341407179832, + 0.06038472056388855, + 0.1709355227649212, + 0.21561740525066853, + 0.3279554285109043, + 0.48315057903528214, + 0.0, + 0.6237899251282215, + 0.0, + 0.09538964182138443, + 0.40230872854590416, + 0.2879939675331116, + 0.1721331849694252, + 0.3100508898496628, + 0.20314858481287956, + 0.0, + 0.06201068311929703, + 0.0, + 0.22450441122055054, + 0.0, + 0.041385162621736526, + 0.05806044116616249, + 0.0, + 0.05287395417690277, + 0.0, + 0.054893700405955315, + 0.3122147507965565, + 0.058229174464941025, + 0.0, + 0.16416677460074425, + 0.0, + 0.15585237741470337, + 0.3566366732120514, + 0.2959268018603325 + ], + "unique_experts": 51, + "load_cv": 0.9137333487622095, + "normalized_load_entropy": 0.8958258763504455, + "max_load_share": 0.057971014492753624 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "3b2439d3fca910d66c2a609e0630fb8b55e107e5e2c78cb1ad9bc2889f9869a3", + "route_weight_sha256": "582dff4cf26c5813f10ce07a40b08a824bd490845caa1d504d90726b7f17fc6c", + "loads": [ + 4, + 5, + 1, + 7, + 0, + 4, + 12, + 2, + 4, + 2, + 16, + 11, + 8, + 3, + 2, + 17, + 6, + 20, + 16, + 11, + 4, + 2, + 1, + 1, + 3, + 10, + 1, + 7, + 2, + 3, + 2, + 1, + 4, + 5, + 6, + 10, + 1, + 11, + 10, + 13, + 7, + 18, + 13, + 7, + 6, + 0, + 1, + 2, + 2, + 13, + 10, + 3, + 1, + 11, + 3, + 13, + 5, + 1, + 1, + 3, + 1, + 3, + 4, + 8 + ], + "weighted_loads": [ + 0.5160463191568851, + 0.5990794529207051, + 0.045152775943279266, + 0.44969113171100616, + 0.0, + 0.16930510476231575, + 1.3250717669725418, + 0.05463542672805488, + 0.21276930044405162, + 0.1783960834145546, + 1.0290956124663353, + 0.9668651781976223, + 0.643761657178402, + 0.22430666163563728, + 0.07052931189537048, + 2.784262105822563, + 0.40352825075387955, + 1.5100066997110844, + 1.4408488385379314, + 0.9511121595278382, + 0.2780469786375761, + 0.09071619808673859, + 0.037654053419828415, + 0.09144076704978943, + 0.2641783282160759, + 0.8073746338486671, + 0.0817323848605156, + 0.43955186754465103, + 0.08549192175269127, + 0.15747129917144775, + 0.11018341407179832, + 0.06038472056388855, + 0.28968460485339165, + 0.25899247638881207, + 0.36232180520892143, + 0.9992701411247253, + 0.04582519829273224, + 0.7756475731730461, + 0.9720800817012787, + 1.2240884453058243, + 0.5816108956933022, + 1.6436781100928783, + 0.9994235709309578, + 0.555301520973444, + 0.3096475638449192, + 0.0, + 0.06201068311929703, + 0.04839483089745045, + 0.22450441122055054, + 0.8210978778079152, + 1.1104936376214027, + 0.12655166164040565, + 0.6649863719940186, + 0.8597132153809071, + 0.0525682857260108, + 0.8520266655832529, + 0.3122147507965565, + 0.058229174464941025, + 0.06978742778301239, + 0.21132070943713188, + 0.04575442150235176, + 0.19569247961044312, + 0.3566366732120514, + 1.4733045883476734 + ], + "unique_experts": 62, + "load_cv": 0.8421409554753224, + "normalized_load_entropy": 0.9166052920639692, + "max_load_share": 0.052083333333333336 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "ordered_topk_exact_tokens": 21, + "set_exact_tokens": 21, + "mean_set_jaccard": 0.9751552795031057, + "mean_token_weighted_tv": 0.010020896630442661, + "aggregate_load_tv": 0.014492753623188404 + }, + "system_bos": { + "tokens": 23, + "ordered_topk_exact_tokens": 18, + "set_exact_tokens": 20, + "mean_set_jaccard": 0.9627329192546585, + "mean_token_weighted_tv": 0.015843503744057987, + "aggregate_load_tv": 0.021739130434782608 + }, + "system_x": { + "tokens": 23, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 18, + "mean_set_jaccard": 0.9378881987577641, + "mean_token_weighted_tv": 0.021659281388249085, + "aggregate_load_tv": 0.02898550724637681 + }, + "system_period": { + "tokens": 23, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.9254658385093167, + "mean_token_weighted_tv": 0.0245625342282912, + "aggregate_load_tv": 0.036231884057971016 + }, + "bos_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 18, + "mean_set_jaccard": 0.9378881987577641, + "mean_token_weighted_tv": 0.024228552356362343, + "aggregate_load_tv": 0.03623188405797101 + }, + "bos_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8881987577639753, + "mean_token_weighted_tv": 0.031602574188424194, + "aggregate_load_tv": 0.050724637681159424 + }, + "x_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.9254658385093167, + "mean_token_weighted_tv": 0.026330067938112694, + "aggregate_load_tv": 0.036231884057971016 + }, + "x_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.9254658385093167, + "mean_token_weighted_tv": 0.026270791969221573, + "aggregate_load_tv": 0.028985507246376815 + }, + "period_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.9130434782608695, + "mean_token_weighted_tv": 0.029749405165405376, + "aggregate_load_tv": 0.050724637681159424 + }, + "period_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8881987577639753, + "mean_token_weighted_tv": 0.032048979045256325, + "aggregate_load_tv": 0.05072463768115942 + } + } + }, + "layer_06": { + "layer": 6, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "17c36b9c55f3e72ea128a10e3cb7a5aae0d542324431ee6adbb651ab107b83e5", + "route_weight_sha256": "e392d243de9ce8946153f80a77ab86a2c4acd67b75c8819ca4225bf1ef3c4fe5", + "loads": [ + 1, + 0, + 4, + 2, + 0, + 1, + 0, + 1, + 1, + 1, + 0, + 2, + 5, + 1, + 0, + 5, + 5, + 0, + 3, + 2, + 0, + 2, + 2, + 1, + 0, + 2, + 10, + 4, + 4, + 2, + 0, + 6, + 0, + 7, + 2, + 0, + 2, + 0, + 5, + 2, + 2, + 2, + 2, + 6, + 0, + 10, + 2, + 1, + 0, + 0, + 1, + 2, + 1, + 3, + 1, + 0, + 6, + 1, + 1, + 2, + 4, + 0, + 5, + 1 + ], + "weighted_loads": [ + 0.04764951765537262, + 0.0, + 0.30328255891799927, + 0.08861703053116798, + 0.0, + 0.09773512929677963, + 0.0, + 0.07608849555253983, + 0.0425228513777256, + 0.051186300814151764, + 0.0, + 0.11409338563680649, + 0.3321254402399063, + 0.04543570429086685, + 0.0, + 0.301334410905838, + 0.4970352165400982, + 0.0, + 0.3051099479198456, + 0.08191408962011337, + 0.0, + 0.11853228136897087, + 0.25970493629574776, + 0.2826246917247772, + 0.0, + 0.0817289650440216, + 0.758109912276268, + 0.8648562803864479, + 0.29389700666069984, + 0.12232391908764839, + 0.0, + 0.41046780720353127, + 0.0, + 0.7514055408537388, + 0.10621243342757225, + 0.0, + 0.14399372413754463, + 0.0, + 0.2579462490975857, + 0.15874937176704407, + 0.11492522805929184, + 0.11838347837328911, + 0.08753804117441177, + 0.30493345856666565, + 0.0, + 1.1782042868435383, + 0.10826877877116203, + 0.04583637788891792, + 0.0, + 0.0, + 0.05178428813815117, + 0.1568077690899372, + 0.050621986389160156, + 0.16876887902617455, + 0.054645296186208725, + 0.0, + 0.5314513742923737, + 0.04334447532892227, + 0.07732751965522766, + 0.09460248425602913, + 0.25354619324207306, + 0.0, + 0.3098507672548294, + 0.05196865275502205 + ], + "unique_experts": 47, + "load_cv": 1.0758856494473892, + "normalized_load_entropy": 0.8656993071180498, + "max_load_share": 0.07246376811594203 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "105600674b0317a18e57140f3b03d3dcb3f1eff97a2fa7fe24ea74f534414422", + "route_weight_sha256": "b82c3b57e5d4874f42ccbd5e6855bec84d359cb0dffd89a15e0822cda865891f", + "loads": [ + 1, + 4, + 4, + 2, + 1, + 1, + 8, + 1, + 1, + 1, + 0, + 8, + 5, + 3, + 2, + 5, + 10, + 1, + 3, + 10, + 1, + 5, + 4, + 2, + 0, + 3, + 10, + 4, + 4, + 5, + 0, + 6, + 4, + 7, + 3, + 6, + 2, + 8, + 5, + 11, + 2, + 7, + 4, + 6, + 0, + 15, + 14, + 3, + 4, + 0, + 9, + 9, + 1, + 3, + 1, + 10, + 16, + 1, + 1, + 11, + 4, + 0, + 5, + 1 + ], + "weighted_loads": [ + 0.04764951765537262, + 0.11649067047983408, + 0.30328255891799927, + 0.08861703053116798, + 0.02863132208585739, + 0.09773512929677963, + 0.8698974959552288, + 0.07608849555253983, + 0.0425228513777256, + 0.051186300814151764, + 0.0, + 0.4493935387581587, + 0.3321254402399063, + 0.07346300920471549, + 0.12460974603891373, + 0.301334410905838, + 0.7994417697191238, + 0.004067089408636093, + 0.3051099479198456, + 0.5737679898738861, + 0.04370201379060745, + 0.2944642584770918, + 1.7533072717487812, + 0.3183022253215313, + 0.0, + 0.10960252955555916, + 0.758109912276268, + 0.8648562803864479, + 0.29389700666069984, + 0.31425611674785614, + 0.0, + 0.41046780720353127, + 0.16558472998440266, + 0.7514055408537388, + 0.14070343971252441, + 0.5495868511497974, + 0.14399372413754463, + 0.6958618983626366, + 0.2579462490975857, + 0.5221035294234753, + 0.11492522805929184, + 0.514801274985075, + 0.14545473083853722, + 0.30493345856666565, + 0.0, + 1.3137938333675265, + 1.8190336041152477, + 0.06819151155650616, + 0.2032573651522398, + 0.0, + 0.5141324438154697, + 0.4630461744964123, + 0.050621986389160156, + 0.16876887902617455, + 0.054645296186208725, + 0.759310744702816, + 1.968894936144352, + 0.04334447532892227, + 0.07732751965522766, + 1.055429358035326, + 0.25354619324207306, + 0.0, + 0.3098507672548294, + 0.05196865275502205 + ], + "unique_experts": 58, + "load_cv": 0.8624541497922236, + "normalized_load_entropy": 0.910283183657168, + "max_load_share": 0.05555555555555555 + } + }, + "s1_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "0b374b690d958af24d509583a982f988d8dec73e4b270922530d5b0d4dd83c01", + "route_weight_sha256": "d1d16b94e6bbc4f4339a084e3a96628343f061ba9697852543b1e4ffb3669a87", + "loads": [ + 1, + 0, + 5, + 2, + 0, + 1, + 0, + 1, + 1, + 1, + 0, + 2, + 5, + 1, + 0, + 5, + 5, + 0, + 3, + 1, + 0, + 2, + 2, + 1, + 0, + 2, + 10, + 4, + 4, + 2, + 0, + 6, + 0, + 7, + 2, + 0, + 2, + 0, + 5, + 2, + 2, + 2, + 2, + 6, + 0, + 10, + 2, + 1, + 0, + 0, + 1, + 2, + 1, + 3, + 1, + 0, + 6, + 1, + 1, + 2, + 4, + 0, + 5, + 1 + ], + "weighted_loads": [ + 0.04709739610552788, + 0.0, + 0.34488261491060257, + 0.0910048708319664, + 0.0, + 0.09988757222890854, + 0.0, + 0.0752769187092781, + 0.04198751598596573, + 0.051470138132572174, + 0.0, + 0.11725882068276405, + 0.3380710445344448, + 0.044297587126493454, + 0.0, + 0.2937784604728222, + 0.4955253228545189, + 0.0, + 0.31063058227300644, + 0.0401989184319973, + 0.0, + 0.11791863664984703, + 0.26326988637447357, + 0.2783089578151703, + 0.0, + 0.08303150534629822, + 0.732975922524929, + 0.8897181078791618, + 0.29387789219617844, + 0.12395602464675903, + 0.0, + 0.40363821014761925, + 0.0, + 0.745583176612854, + 0.1045427955687046, + 0.0, + 0.1517471745610237, + 0.0, + 0.2635202184319496, + 0.16084882616996765, + 0.11369886994361877, + 0.11582491546869278, + 0.10214578732848167, + 0.3072228580713272, + 0.0, + 1.1702158488333225, + 0.10535928606987, + 0.04704335704445839, + 0.0, + 0.0, + 0.05038389191031456, + 0.15663662925362587, + 0.050607871264219284, + 0.16782790422439575, + 0.05420606583356857, + 0.0, + 0.5236106291413307, + 0.04270409420132637, + 0.07641731202602386, + 0.10582279413938522, + 0.24706167727708817, + 0.0, + 0.30845633894205093, + 0.056665100157260895 + ], + "unique_experts": 47, + "load_cv": 1.0852159977694509, + "normalized_load_entropy": 0.8637552968832226, + "max_load_share": 0.07246376811594203 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "707345e02f8fd0f9e56cfd728ba8095da70f2d8671708dff004439ae43fac822", + "route_weight_sha256": "50e3823851c34da0197695af82c786ad56966dcf55768566124145905cd72852", + "loads": [ + 1, + 3, + 8, + 3, + 2, + 1, + 14, + 2, + 6, + 7, + 0, + 12, + 9, + 3, + 9, + 6, + 15, + 1, + 5, + 11, + 2, + 6, + 4, + 2, + 1, + 4, + 10, + 5, + 5, + 5, + 0, + 9, + 7, + 8, + 6, + 8, + 3, + 16, + 5, + 11, + 2, + 7, + 4, + 6, + 1, + 14, + 18, + 3, + 3, + 0, + 10, + 8, + 2, + 6, + 1, + 11, + 23, + 1, + 1, + 13, + 9, + 0, + 5, + 1 + ], + "weighted_loads": [ + 0.04709739610552788, + 0.08387106005102396, + 0.4879091642796993, + 0.12848317250609398, + 0.15025458298623562, + 0.09988757222890854, + 1.2305374890565872, + 0.13666610047221184, + 0.3841256946325302, + 0.757964551448822, + 0.0, + 0.7176882736384869, + 0.6684210821986198, + 0.07258607959374785, + 0.6625533774495125, + 0.4059341885149479, + 1.2226976677775383, + 0.004061832558363676, + 0.45876192674040794, + 0.7418250180780888, + 0.09159355238080025, + 0.3713169377297163, + 1.7551736682653427, + 0.3135524317622185, + 0.03216787055134773, + 0.16141469776630402, + 0.732975922524929, + 0.9160591140389442, + 0.3309651128947735, + 0.3405836410820484, + 0.0, + 0.6024436615407467, + 0.2624762635678053, + 0.7793852686882019, + 0.3643215484917164, + 0.761394914239645, + 0.18668950349092484, + 1.2615208998322487, + 0.2635202184319496, + 0.6363084390759468, + 0.11369886994361877, + 0.5282653868198395, + 0.16013095900416374, + 0.3072228580713272, + 0.08391585201025009, + 1.268999056192115, + 2.170190731063485, + 0.06942363735288382, + 0.16598937660455704, + 0.0, + 0.6073025912046432, + 0.39614689350128174, + 0.08744912222027779, + 0.33581462875008583, + 0.05420606583356857, + 1.005191583186388, + 2.5858853720128536, + 0.04270409420132637, + 0.07641731202602386, + 1.1588597912341356, + 0.5105823539197445, + 0.0, + 0.30845633894205093, + 0.056665100157260895 + ], + "unique_experts": 60, + "load_cv": 0.8138343743593587, + "normalized_load_entropy": 0.9202574156041441, + "max_load_share": 0.059895833333333336 + } + }, + "s0_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "920792e999a8ce5eafc200eaf00b00c3149ac8d098f9bbd7f94a5f4ba613eb37", + "route_weight_sha256": "48d8d845947192a63dd683fccc30ad9243199d082a6ffcef36ff2dfa209b5683", + "loads": [ + 1, + 0, + 3, + 2, + 0, + 1, + 2, + 1, + 1, + 1, + 0, + 2, + 3, + 2, + 0, + 5, + 5, + 0, + 3, + 2, + 0, + 2, + 2, + 1, + 0, + 2, + 10, + 4, + 4, + 2, + 0, + 6, + 0, + 7, + 2, + 0, + 2, + 0, + 6, + 2, + 2, + 2, + 1, + 6, + 0, + 10, + 3, + 0, + 0, + 0, + 1, + 2, + 1, + 3, + 1, + 0, + 6, + 0, + 1, + 2, + 5, + 0, + 5, + 1 + ], + "weighted_loads": [ + 0.052977513521909714, + 0.0, + 0.2635238543152809, + 0.08048130944371223, + 0.0, + 0.09334487468004227, + 0.0814681276679039, + 0.07415755838155746, + 0.04009796306490898, + 0.05259476602077484, + 0.0, + 0.12175732105970383, + 0.2571272552013397, + 0.09013361856341362, + 0.0, + 0.31675828620791435, + 0.49583717063069344, + 0.0, + 0.30046285688877106, + 0.09137564152479172, + 0.0, + 0.12341758236289024, + 0.25380275771021843, + 0.2909286916255951, + 0.0, + 0.08676706999540329, + 0.7879009544849396, + 0.8693947829306126, + 0.28098710626363754, + 0.11396055668592453, + 0.0, + 0.4035342335700989, + 0.0, + 0.807813324034214, + 0.09885899350047112, + 0.0, + 0.13844340294599533, + 0.0, + 0.3060091361403465, + 0.15413757041096687, + 0.1177566722035408, + 0.1276005282998085, + 0.042151860892772675, + 0.3116272948682308, + 0.0, + 1.1616795882582664, + 0.1495322547852993, + 0.0, + 0.0, + 0.0, + 0.05748704448342323, + 0.1473487690091133, + 0.05051320418715477, + 0.16482177004218102, + 0.05368540436029434, + 0.0, + 0.5138087719678879, + 0.0, + 0.07970164716243744, + 0.09507042542099953, + 0.28444429486989975, + 0.0, + 0.31216998770833015, + 0.041070275008678436 + ], + "unique_experts": 46, + "load_cv": 1.0821148205121796, + "normalized_load_entropy": 0.863084817943677, + "max_load_share": 0.07246376811594203 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "fc975bca9fdef4afa2d140c1fe8a2fc5ed22c2d1953e8d43da647641709ede61", + "route_weight_sha256": "8defe95781ec0d095c7dbf54b93adc6499f712e67d6100ad8baaf04d4d0c464b", + "loads": [ + 1, + 3, + 3, + 2, + 1, + 1, + 10, + 1, + 1, + 1, + 0, + 8, + 3, + 3, + 3, + 6, + 11, + 0, + 3, + 10, + 1, + 5, + 3, + 2, + 0, + 3, + 10, + 4, + 4, + 6, + 0, + 6, + 4, + 8, + 3, + 6, + 2, + 8, + 6, + 11, + 2, + 7, + 4, + 6, + 0, + 14, + 16, + 1, + 4, + 0, + 8, + 9, + 1, + 3, + 1, + 10, + 16, + 0, + 1, + 11, + 5, + 0, + 5, + 1 + ], + "weighted_loads": [ + 0.052977513521909714, + 0.11541135795414448, + 0.2635238543152809, + 0.08048130944371223, + 0.02863132208585739, + 0.09334487468004227, + 1.0523751489818096, + 0.07415755838155746, + 0.04009796306490898, + 0.05259476602077484, + 0.0, + 0.4772535879164934, + 0.2571272552013397, + 0.11320661008358002, + 0.18791110441088676, + 0.36328618600964546, + 0.8513630144298077, + 0.0, + 0.30046285688877106, + 0.5812030509114265, + 0.04370201379060745, + 0.2932599689811468, + 0.799832921475172, + 0.32660622522234917, + 0.0, + 0.11464063450694084, + 0.7879009544849396, + 0.8693947829306126, + 0.28098710626363754, + 0.34987175464630127, + 0.0, + 0.4035342335700989, + 0.16978961415588856, + 0.8741947710514069, + 0.13334999978542328, + 0.5612345784902573, + 0.13844340294599533, + 0.6653855852782726, + 0.3060091361403465, + 0.5136366002261639, + 0.1177566722035408, + 0.5240183249115944, + 0.14798035845160484, + 0.3116272948682308, + 0.0, + 1.2932339422404766, + 1.9148100167512894, + 0.019096266478300095, + 0.2077330369502306, + 0.0, + 0.5355358608067036, + 0.4535871744155884, + 0.05051320418715477, + 0.16482177004218102, + 0.05368540436029434, + 0.759310744702816, + 1.9114676713943481, + 0.0, + 0.07970164716243744, + 1.0558972992002964, + 0.28444429486989975, + 0.0, + 0.31216998770833015, + 0.041070275008678436 + ], + "unique_experts": 56, + "load_cv": 0.9001028747788694, + "normalized_load_entropy": 0.9010299816885204, + "max_load_share": 0.05555555555555555 + } + }, + "s1_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "fe34b4445d3c34f319aad46302fa9844e1611bef3789f749c3569a28d0026681", + "route_weight_sha256": "ff41186d4e8c85622763e2a2caef6ba64174cb6a09929c4e7abede076fb5f0e7", + "loads": [ + 1, + 0, + 3, + 2, + 0, + 1, + 1, + 1, + 1, + 1, + 0, + 2, + 4, + 1, + 0, + 5, + 5, + 0, + 3, + 1, + 0, + 2, + 3, + 1, + 0, + 2, + 10, + 4, + 4, + 2, + 0, + 6, + 0, + 7, + 2, + 0, + 2, + 0, + 6, + 2, + 2, + 2, + 2, + 6, + 0, + 10, + 3, + 1, + 0, + 0, + 1, + 2, + 1, + 3, + 1, + 0, + 6, + 0, + 1, + 2, + 4, + 0, + 5, + 1 + ], + "weighted_loads": [ + 0.05296716466546059, + 0.0, + 0.2633097618818283, + 0.09144342318177223, + 0.0, + 0.0937357097864151, + 0.04117811843752861, + 0.07193514704704285, + 0.0381244495511055, + 0.056637804955244064, + 0.0, + 0.12540536373853683, + 0.311445027589798, + 0.04830257594585419, + 0.0, + 0.30879512801766396, + 0.4865116700530052, + 0.0, + 0.31420475244522095, + 0.043407998979091644, + 0.0, + 0.1214367188513279, + 0.28981663659214973, + 0.27912116050720215, + 0.0, + 0.09142369404435158, + 0.7768546380102634, + 0.9103248342871666, + 0.27955520153045654, + 0.12388241663575172, + 0.0, + 0.4024527557194233, + 0.0, + 0.8200024887919426, + 0.09707311913371086, + 0.0, + 0.1446353755891323, + 0.0, + 0.30939653515815735, + 0.1588398814201355, + 0.11639070510864258, + 0.11862246319651604, + 0.09052973613142967, + 0.3268597349524498, + 0.0, + 1.1849363446235657, + 0.13281185552477837, + 0.046596549451351166, + 0.0, + 0.0, + 0.060080282390117645, + 0.15363556146621704, + 0.05296436697244644, + 0.15780716389417648, + 0.0517185777425766, + 0.0, + 0.5071490779519081, + 0.0, + 0.07873920351266861, + 0.10285821557044983, + 0.2506013959646225, + 0.0, + 0.32330239564180374, + 0.04955173656344414 + ], + "unique_experts": 47, + "load_cv": 1.0790047301701085, + "normalized_load_entropy": 0.8650288281785041, + "max_load_share": 0.07246376811594203 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "e48b5dab4d9f253033b1590a99a574d36c6e9430c865186c2f6e39483cb2d885", + "route_weight_sha256": "9069893d11f1e68810b3d3fc7ad3491145677ded7edbe77a4bdd37b7140a9178", + "loads": [ + 1, + 1, + 6, + 3, + 2, + 1, + 16, + 2, + 6, + 7, + 0, + 12, + 8, + 3, + 9, + 7, + 16, + 0, + 5, + 11, + 2, + 6, + 4, + 2, + 1, + 4, + 10, + 5, + 5, + 5, + 0, + 9, + 7, + 9, + 6, + 8, + 3, + 16, + 6, + 11, + 2, + 7, + 4, + 6, + 1, + 13, + 20, + 3, + 3, + 0, + 10, + 8, + 2, + 6, + 1, + 11, + 23, + 0, + 1, + 13, + 9, + 0, + 5, + 1 + ], + "weighted_loads": [ + 0.05296716466546059, + 0.0349491722881794, + 0.40633631125092506, + 0.1289217248558998, + 0.15025458298623562, + 0.0937357097864151, + 1.345491398125887, + 0.13332432880997658, + 0.38026262819767, + 0.7631322182714939, + 0.0, + 0.7438798993825912, + 0.641795065253973, + 0.11764442548155785, + 0.6763120703399181, + 0.4731675125658512, + 1.265044678002596, + 0.0, + 0.46233609691262245, + 0.7422137632966042, + 0.09159355238080025, + 0.37039569579064846, + 0.8358468003571033, + 0.31436463445425034, + 0.03216787055134773, + 0.16980688646435738, + 0.7768546380102634, + 0.936665840446949, + 0.3166424222290516, + 0.3363368734717369, + 0.0, + 0.6012582071125507, + 0.268748065456748, + 0.9160826839506626, + 0.35685187205672264, + 0.7790203653275967, + 0.17957770451903343, + 1.2747957222163677, + 0.30939653515815735, + 0.6342994943261147, + 0.11639070510864258, + 0.5310629345476627, + 0.14851490780711174, + 0.3268597349524498, + 0.08391585201025009, + 1.2799500841647387, + 2.3043781835585833, + 0.12206733226776123, + 0.18190807849168777, + 0.0, + 0.6861347705125809, + 0.3931458257138729, + 0.08980561792850494, + 0.32579388841986656, + 0.0517185777425766, + 1.005191583186388, + 2.589876413345337, + 0.0, + 0.07873920351266861, + 1.1558952126652002, + 0.5141220726072788, + 0.0, + 0.32330239564180374, + 0.04955173656344414 + ], + "unique_experts": 58, + "load_cv": 0.846766726370899, + "normalized_load_entropy": 0.9128472320373, + "max_load_share": 0.059895833333333336 + } + }, + "s0_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "e4680fe2d8eb5db555a73460f1a547478f51ccfa23797545596f1132ce09f92e", + "route_weight_sha256": "4ca2262d8192cf102f6cddca01598dd6dda2ec0fe7c201af8f54f86cc05fcb56", + "loads": [ + 1, + 0, + 5, + 1, + 0, + 1, + 3, + 1, + 1, + 1, + 0, + 2, + 3, + 1, + 0, + 4, + 5, + 0, + 3, + 2, + 0, + 2, + 3, + 1, + 0, + 2, + 10, + 4, + 4, + 2, + 0, + 6, + 0, + 6, + 2, + 0, + 2, + 0, + 6, + 2, + 2, + 2, + 1, + 6, + 0, + 10, + 2, + 1, + 0, + 0, + 1, + 2, + 1, + 3, + 1, + 0, + 6, + 0, + 1, + 2, + 5, + 0, + 5, + 1 + ], + "weighted_loads": [ + 0.04915879666805267, + 0.0, + 0.3430250957608223, + 0.04263366386294365, + 0.0, + 0.09620387107133865, + 0.13967641815543175, + 0.07234018296003342, + 0.04101291298866272, + 0.05435344949364662, + 0.0, + 0.128669586032629, + 0.25416460633277893, + 0.04434916377067566, + 0.0, + 0.2523268796503544, + 0.4976053908467293, + 0.0, + 0.2934289202094078, + 0.10441390424966812, + 0.0, + 0.11817574501037598, + 0.2921484485268593, + 0.26668649911880493, + 0.0, + 0.08811110630631447, + 0.7775800302624702, + 0.8528458289802074, + 0.28195199370384216, + 0.10998058691620827, + 0.0, + 0.40491626411676407, + 0.0, + 0.7015400715172291, + 0.10315992683172226, + 0.0, + 0.14047285914421082, + 0.0, + 0.30309269949793816, + 0.15381209924817085, + 0.12274672836065292, + 0.12660324200987816, + 0.04460803046822548, + 0.3135438486933708, + 0.0, + 1.1051171086728573, + 0.10533581674098969, + 0.04324072226881981, + 0.0, + 0.0, + 0.058998819440603256, + 0.14863678067922592, + 0.05118052288889885, + 0.16072650253772736, + 0.05057602748274803, + 0.0, + 0.5175064019858837, + 0.0, + 0.0798332467675209, + 0.09650702774524689, + 0.2861207127571106, + 0.0, + 0.31554507091641426, + 0.039792489260435104 + ], + "unique_experts": 47, + "load_cv": 1.072757499924467, + "normalized_load_entropy": 0.8656714235597113, + "max_load_share": 0.07246376811594203 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "e0aa8c864ecfcc5bccb1a4e5f201dda760b593906e1b8cc0b76cda43f3f62cf6", + "route_weight_sha256": "d14b3da067bef295ce2f139c4e26f27a91018e325d6ff1b4f01a61f0534d14f8", + "loads": [ + 1, + 2, + 5, + 1, + 1, + 1, + 13, + 1, + 1, + 1, + 0, + 7, + 3, + 3, + 3, + 5, + 10, + 0, + 3, + 11, + 1, + 5, + 4, + 2, + 0, + 3, + 10, + 4, + 4, + 5, + 0, + 6, + 4, + 6, + 3, + 6, + 2, + 9, + 6, + 10, + 2, + 9, + 4, + 6, + 0, + 14, + 14, + 2, + 4, + 0, + 6, + 10, + 1, + 3, + 1, + 11, + 15, + 0, + 1, + 12, + 5, + 0, + 5, + 1 + ], + "weighted_loads": [ + 0.04915879666805267, + 0.06601992435753345, + 0.3430250957608223, + 0.04263366386294365, + 0.02863132208585739, + 0.09620387107133865, + 1.4097343385219574, + 0.07234018296003342, + 0.04101291298866272, + 0.05435344949364662, + 0.0, + 0.4219782967120409, + 0.25416460633277893, + 0.10877667367458344, + 0.18205732107162476, + 0.296440701931715, + 0.8094376102089882, + 0.0, + 0.2934289202094078, + 0.6592009104788303, + 0.04370201379060745, + 0.2815772760659456, + 0.8381786122918129, + 0.302364032715559, + 0.0, + 0.11598467081785202, + 0.7775800302624702, + 0.8528458289802074, + 0.28195199370384216, + 0.30820395052433014, + 0.0, + 0.40491626411676407, + 0.15333920903503895, + 0.7015400715172291, + 0.13765093311667442, + 0.5855048596858978, + 0.14047285914421082, + 0.6738706417381763, + 0.30309269949793816, + 0.47064946591854095, + 0.12274672836065292, + 0.6625665538012981, + 0.13630957901477814, + 0.3135438486933708, + 0.0, + 1.2366714626550674, + 1.6001769751310349, + 0.062336988747119904, + 0.21528861857950687, + 0.0, + 0.4014741890132427, + 0.48961783945560455, + 0.05118052288889885, + 0.16072650253772736, + 0.05057602748274803, + 0.8154875636100769, + 1.6892273910343647, + 0.0, + 0.0798332467675209, + 1.1316023021936417, + 0.2861207127571106, + 0.0, + 0.31554507091641426, + 0.039792489260435104 + ], + "unique_experts": 56, + "load_cv": 0.8975274678557505, + "normalized_load_entropy": 0.9009886447022862, + "max_load_share": 0.052083333333333336 + } + }, + "s1_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "6ff9e4ab3409b89ae4610a6e0bf99790b07680c3f2c1122dc6202816e65ccc7b", + "route_weight_sha256": "1353466e262cb4fe491eb26d25320eb1ba18394de12af88415261f487804ac1d", + "loads": [ + 1, + 0, + 4, + 1, + 0, + 1, + 3, + 1, + 1, + 1, + 0, + 2, + 4, + 1, + 0, + 5, + 5, + 0, + 3, + 2, + 0, + 2, + 3, + 1, + 0, + 2, + 10, + 4, + 4, + 2, + 0, + 6, + 0, + 7, + 2, + 0, + 2, + 0, + 6, + 2, + 2, + 2, + 1, + 6, + 0, + 10, + 1, + 1, + 0, + 0, + 1, + 2, + 1, + 3, + 1, + 0, + 6, + 0, + 1, + 2, + 4, + 0, + 5, + 1 + ], + "weighted_loads": [ + 0.05107459798455238, + 0.0, + 0.3022995628416538, + 0.043871454894542694, + 0.0, + 0.09790734946727753, + 0.14508716389536858, + 0.07170376926660538, + 0.03861298784613609, + 0.059687867760658264, + 0.0, + 0.1315481774508953, + 0.30282725393772125, + 0.05239121988415718, + 0.0, + 0.2936394363641739, + 0.49438223615288734, + 0.0, + 0.30027951300144196, + 0.08734923601150513, + 0.0, + 0.1184440404176712, + 0.2980552650988102, + 0.24948886036872864, + 0.0, + 0.09300905838608742, + 0.7843253202736378, + 0.9061814546585083, + 0.275046419352293, + 0.11817190051078796, + 0.0, + 0.4045502357184887, + 0.0, + 0.7662310376763344, + 0.09776714444160461, + 0.0, + 0.15008524432778358, + 0.0, + 0.31388069689273834, + 0.17139383405447006, + 0.11703860387206078, + 0.1134328544139862, + 0.05319514498114586, + 0.3215157240629196, + 0.0, + 1.1489566564559937, + 0.0509195476770401, + 0.04995178058743477, + 0.0, + 0.0, + 0.05925719439983368, + 0.14950759708881378, + 0.05372225493192673, + 0.15509561076760292, + 0.05172896012663841, + 0.0, + 0.5026698522269726, + 0.0, + 0.08018839359283447, + 0.1001385822892189, + 0.24725008755922318, + 0.0, + 0.33298131823539734, + 0.05636666342616081 + ], + "unique_experts": 47, + "load_cv": 1.0852159977694509, + "normalized_load_entropy": 0.863525069123146, + "max_load_share": 0.07246376811594203 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "4018c6e7252d1653b4839f509ae8f0f268763ef1492b1fff265246bb59bbcfc6", + "route_weight_sha256": "1171a75d1fa24607536c6a960cc0282a808e60971ddcb30b66775bdc883e3204", + "loads": [ + 1, + 1, + 7, + 2, + 2, + 1, + 20, + 2, + 6, + 7, + 0, + 11, + 8, + 3, + 9, + 7, + 15, + 0, + 5, + 14, + 2, + 6, + 4, + 2, + 2, + 4, + 10, + 5, + 5, + 5, + 0, + 9, + 6, + 8, + 6, + 8, + 3, + 15, + 6, + 11, + 2, + 9, + 3, + 6, + 1, + 13, + 16, + 2, + 3, + 0, + 9, + 9, + 2, + 6, + 1, + 12, + 22, + 0, + 1, + 14, + 9, + 0, + 5, + 1 + ], + "weighted_loads": [ + 0.05107459798455238, + 0.0349491722881794, + 0.4453261122107506, + 0.08134975656867027, + 0.15025458298623562, + 0.09790734946727753, + 1.7952726557850838, + 0.1330929510295391, + 0.3807511664927006, + 0.7661822810769081, + 0.0, + 0.696810495108366, + 0.6331772916018963, + 0.11774186417460442, + 0.6822901181876659, + 0.472493052482605, + 1.230108380317688, + 0.0, + 0.44841085746884346, + 0.8908840417861938, + 0.09159355238080025, + 0.3561330307275057, + 0.8440854288637638, + 0.2847323343157768, + 0.06629777699708939, + 0.17139225080609322, + 0.7843253202736378, + 0.9325224608182907, + 0.31213364005088806, + 0.3339126519858837, + 0.0, + 0.6033556871116161, + 0.2161842230707407, + 0.8000331297516823, + 0.3575458973646164, + 0.7780329622328281, + 0.1850275732576847, + 1.145339373499155, + 0.31388069689273834, + 0.6468534469604492, + 0.11703860387206078, + 0.6577711440622807, + 0.11118031665682793, + 0.3215157240629196, + 0.08391585201025009, + 1.2439703959971666, + 1.8664377126842737, + 0.06904804706573486, + 0.1785879097878933, + 0.0, + 0.5949713326990604, + 0.41843254677951336, + 0.09056350588798523, + 0.323082335293293, + 0.05172896012663841, + 1.0757753662765026, + 2.3107728734612465, + 0.0, + 0.08018839359283447, + 1.2250139508396387, + 0.5107707642018795, + 0.0, + 0.33298131823539734, + 0.05636666342616081 + ], + "unique_experts": 58, + "load_cv": 0.8452276156291997, + "normalized_load_entropy": 0.912347336513752, + "max_load_share": 0.057291666666666664 + } + }, + "s0_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "0d39ac9297f324c667089c187ec485043674fb78a5fc2ac27b4b13610936d71e", + "route_weight_sha256": "a4e32bf4c8bc2340d676d312b6470c52937e49469c12b85a1587e87be9d879bf", + "loads": [ + 1, + 0, + 4, + 1, + 0, + 1, + 2, + 1, + 1, + 1, + 0, + 2, + 3, + 1, + 0, + 5, + 5, + 0, + 3, + 2, + 0, + 2, + 2, + 1, + 0, + 2, + 10, + 4, + 4, + 2, + 0, + 6, + 0, + 8, + 2, + 0, + 2, + 0, + 6, + 2, + 2, + 2, + 1, + 6, + 0, + 10, + 3, + 1, + 0, + 0, + 1, + 2, + 1, + 3, + 1, + 0, + 6, + 0, + 1, + 2, + 4, + 0, + 5, + 1 + ], + "weighted_loads": [ + 0.051879990845918655, + 0.0, + 0.29697180911898613, + 0.038437552750110626, + 0.0, + 0.09708244353532791, + 0.08720969408750534, + 0.07269594818353653, + 0.039133939892053604, + 0.05637045204639435, + 0.0, + 0.12597540020942688, + 0.24971503764390945, + 0.045076120644807816, + 0.0, + 0.2896859273314476, + 0.5122504495084286, + 0.0, + 0.295553058385849, + 0.10447527468204498, + 0.0, + 0.11644013971090317, + 0.2655201405286789, + 0.25145161151885986, + 0.0, + 0.08658766746520996, + 0.7825909666717052, + 0.8706177212297916, + 0.2747882269322872, + 0.10150396451354027, + 0.0, + 0.3949917182326317, + 0.0, + 0.780039856210351, + 0.10125595331192017, + 0.0, + 0.14778146520256996, + 0.0, + 0.3082951009273529, + 0.1438111923635006, + 0.1238839440047741, + 0.12555767968297005, + 0.04438387602567673, + 0.3170178085565567, + 0.0, + 1.1137217655777931, + 0.16936207190155983, + 0.04519107565283775, + 0.0, + 0.0, + 0.061247747391462326, + 0.14677769318223, + 0.051364198327064514, + 0.1598525159060955, + 0.05133339762687683, + 0.0, + 0.5280302613973618, + 0.0, + 0.07837116718292236, + 0.09969718009233475, + 0.24334852397441864, + 0.0, + 0.3149011619389057, + 0.0414261557161808 + ], + "unique_experts": 47, + "load_cv": 1.0944668076020667, + "normalized_load_entropy": 0.8631041566284638, + "max_load_share": 0.07246376811594203 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "26e1d391929d25ef668599ea1f995821a559f702b120c39c2ab6901e6c6e9bc9", + "route_weight_sha256": "00c1830c1c6fa2d10dcbfc0f234d0b41f8691e211d7aa802f35eee38ce6ad4f6", + "loads": [ + 1, + 3, + 4, + 1, + 1, + 1, + 12, + 1, + 1, + 1, + 0, + 7, + 4, + 2, + 2, + 6, + 10, + 0, + 3, + 12, + 1, + 5, + 3, + 2, + 0, + 3, + 10, + 4, + 5, + 5, + 0, + 6, + 4, + 8, + 3, + 6, + 2, + 9, + 6, + 10, + 2, + 8, + 4, + 6, + 0, + 14, + 15, + 2, + 4, + 0, + 6, + 10, + 1, + 3, + 1, + 11, + 15, + 0, + 1, + 11, + 4, + 0, + 5, + 1 + ], + "weighted_loads": [ + 0.051879990845918655, + 0.11153974942862988, + 0.29697180911898613, + 0.038437552750110626, + 0.02863132208585739, + 0.09708244353532791, + 1.2211256362497807, + 0.07269594818353653, + 0.039133939892053604, + 0.05637045204639435, + 0.0, + 0.41698372922837734, + 0.3029777854681015, + 0.06814911216497421, + 0.1362212412059307, + 0.32716744765639305, + 0.8114796541631222, + 0.0, + 0.295553058385849, + 0.7474462054669857, + 0.04370201379060745, + 0.28050253726541996, + 0.8115503042936325, + 0.28712914511561394, + 0.0, + 0.11446123197674751, + 0.7825909666717052, + 0.8706177212297916, + 0.37968142703175545, + 0.2973288595676422, + 0.0, + 0.3949917182326317, + 0.16225055791437626, + 0.780039856210351, + 0.13574695959687233, + 0.5822004973888397, + 0.14778146520256996, + 0.7740398719906807, + 0.3082951009273529, + 0.4606485590338707, + 0.1238839440047741, + 0.578411404043436, + 0.13846871629357338, + 0.3170178085565567, + 0.0, + 1.2452761195600033, + 1.693328782916069, + 0.06428734213113785, + 0.208182817324996, + 0.0, + 0.3985069990158081, + 0.48706719279289246, + 0.051364198327064514, + 0.1598525159060955, + 0.05133339762687683, + 0.9079319164156914, + 1.6945513598620892, + 0.0, + 0.07837116718292236, + 1.0605240538716316, + 0.24334852397441864, + 0.0, + 0.3149011619389057, + 0.0414261557161808 + ], + "unique_experts": 56, + "load_cv": 0.9026709338484401, + "normalized_load_entropy": 0.8999986387797614, + "max_load_share": 0.052083333333333336 + } + }, + "s1_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "6d2212b65dbd1f1ec02132f34aedbf3d83f0c97cd871b4d6bed168c148f98ce9", + "route_weight_sha256": "f0456b87e335a98ef60d7341aa70565990de17ea80078cd2871a3d9649537f82", + "loads": [ + 1, + 0, + 4, + 1, + 0, + 1, + 2, + 1, + 1, + 1, + 0, + 2, + 4, + 1, + 0, + 5, + 5, + 0, + 3, + 1, + 0, + 2, + 3, + 1, + 0, + 2, + 10, + 4, + 4, + 2, + 0, + 6, + 0, + 7, + 2, + 0, + 2, + 0, + 6, + 2, + 2, + 2, + 1, + 6, + 0, + 10, + 3, + 1, + 0, + 0, + 1, + 2, + 1, + 3, + 1, + 0, + 6, + 0, + 1, + 2, + 4, + 0, + 5, + 1 + ], + "weighted_loads": [ + 0.052229609340429306, + 0.0, + 0.30030566453933716, + 0.041155897080898285, + 0.0, + 0.09751869738101959, + 0.08311040699481964, + 0.07193488627672195, + 0.03824571147561073, + 0.05913884937763214, + 0.0, + 0.13084978610277176, + 0.30088019371032715, + 0.05254479870200157, + 0.0, + 0.30157439410686493, + 0.506408341228962, + 0.0, + 0.2964414581656456, + 0.04865286871790886, + 0.0, + 0.12190944328904152, + 0.2878147028386593, + 0.24615179002285004, + 0.0, + 0.09158174321055412, + 0.7772265784442425, + 0.9056369736790657, + 0.2660769335925579, + 0.11387546733021736, + 0.0, + 0.3975323885679245, + 0.0, + 0.7715124078094959, + 0.09698294475674629, + 0.0, + 0.1583585888147354, + 0.0, + 0.31167981401085854, + 0.16503668203949928, + 0.1222781278192997, + 0.1139494962990284, + 0.05213235691189766, + 0.3235894590616226, + 0.0, + 1.1431090645492077, + 0.13317003846168518, + 0.05095744878053665, + 0.0, + 0.0, + 0.06078493967652321, + 0.14631863683462143, + 0.05361916124820709, + 0.15621529147028923, + 0.05161098390817642, + 0.0, + 0.5257107056677341, + 0.0, + 0.0796055942773819, + 0.10090600699186325, + 0.25029274448752403, + 0.0, + 0.33231423422694206, + 0.05670200288295746 + ], + "unique_experts": 47, + "load_cv": 1.0852159977694509, + "normalized_load_entropy": 0.8635250691231461, + "max_load_share": 0.07246376811594203 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "6ba5ae2d7bde47c25aec1498e88696d885f6c918ef104db75138794d641e19c5", + "route_weight_sha256": "b4d7208dd46bcfbf26654c65f6a7e017695ae410ff77e6597e9717415b541677", + "loads": [ + 1, + 1, + 7, + 2, + 2, + 1, + 19, + 2, + 6, + 7, + 0, + 11, + 9, + 3, + 9, + 7, + 15, + 0, + 5, + 13, + 2, + 6, + 4, + 2, + 2, + 4, + 10, + 5, + 6, + 5, + 0, + 9, + 6, + 8, + 6, + 8, + 3, + 16, + 6, + 11, + 2, + 8, + 3, + 6, + 1, + 13, + 19, + 2, + 2, + 0, + 8, + 9, + 2, + 6, + 1, + 12, + 22, + 0, + 1, + 13, + 9, + 0, + 5, + 1 + ], + "weighted_loads": [ + 0.052229609340429306, + 0.0349491722881794, + 0.4433322139084339, + 0.07863419875502586, + 0.15025458298623562, + 0.09751869738101959, + 1.592446468770504, + 0.13332406803965569, + 0.3803838901221752, + 0.765633262693882, + 0.0, + 0.7025212980806828, + 0.6961238123476505, + 0.1199156790971756, + 0.6782376505434513, + 0.46695440262556076, + 1.2348090261220932, + 0.0, + 0.4445728026330471, + 0.9457013197243214, + 0.09159355238080025, + 0.36109562031924725, + 0.8338448666036129, + 0.2813952639698982, + 0.06738884374499321, + 0.16996493563055992, + 0.7772265784442425, + 0.9319779798388481, + 0.4275728166103363, + 0.32556067407131195, + 0.0, + 0.5963378399610519, + 0.21633129008114338, + 0.8053144998848438, + 0.35676169767975807, + 0.79040302708745, + 0.19330091774463654, + 1.3010180965065956, + 0.31167981401085854, + 0.6404962949454784, + 0.1222781278192997, + 0.5701797343790531, + 0.11011752858757973, + 0.3235894590616226, + 0.08391585201025009, + 1.2381228040903807, + 1.980059502646327, + 0.07005371525883675, + 0.10509943962097168, + 0.0, + 0.5427600108087063, + 0.4189852699637413, + 0.0904604122042656, + 0.3242020159959793, + 0.05161098390817642, + 1.1379205621778965, + 2.322930920869112, + 0.0, + 0.0796055942773819, + 1.1539430040866137, + 0.5138134211301804, + 0.0, + 0.33231423422694206, + 0.05670200288295746 + ], + "unique_experts": 58, + "load_cv": 0.8534041311776684, + "normalized_load_entropy": 0.9112185424391935, + "max_load_share": 0.057291666666666664 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "ordered_topk_exact_tokens": 20, + "set_exact_tokens": 22, + "mean_set_jaccard": 0.9875776397515529, + "mean_token_weighted_tv": 0.007782890906800394, + "aggregate_load_tv": 0.007246376811594204 + }, + "system_bos": { + "tokens": 23, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 18, + "mean_set_jaccard": 0.9378881987577641, + "mean_token_weighted_tv": 0.01824097553996936, + "aggregate_load_tv": 0.028985507246376812 + }, + "system_x": { + "tokens": 23, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.9503105590062112, + "mean_token_weighted_tv": 0.020716391098888023, + "aggregate_load_tv": 0.021739130434782615 + }, + "system_period": { + "tokens": 23, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 20, + "mean_set_jaccard": 0.9627329192546585, + "mean_token_weighted_tv": 0.017756881232818832, + "aggregate_load_tv": 0.014492753623188406 + }, + "bos_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.9130434782608695, + "mean_token_weighted_tv": 0.025682081994803055, + "aggregate_load_tv": 0.043478260869565216 + }, + "bos_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.9254658385093167, + "mean_token_weighted_tv": 0.02471154304626195, + "aggregate_load_tv": 0.02898550724637681 + }, + "x_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8881987577639753, + "mean_token_weighted_tv": 0.029132485956601475, + "aggregate_load_tv": 0.050724637681159424 + }, + "x_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.9130434782608695, + "mean_token_weighted_tv": 0.029254323600426964, + "aggregate_load_tv": 0.04347826086956521 + }, + "period_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.9006211180124224, + "mean_token_weighted_tv": 0.029241410650960777, + "aggregate_load_tv": 0.036231884057971016 + }, + "period_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.9130434782608695, + "mean_token_weighted_tv": 0.030023863701068836, + "aggregate_load_tv": 0.03623188405797101 + } + } + }, + "layer_07": { + "layer": 7, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "35fe8cbd8252262ebddd3f27f2861147fc0387a46ae9bf756499671525135285", + "route_weight_sha256": "738627cf8c59c90f31724cf2955f07102a2f4918e4d89d744e37b2513e1fa50b", + "loads": [ + 1, + 0, + 0, + 1, + 0, + 1, + 2, + 2, + 5, + 6, + 1, + 2, + 1, + 2, + 2, + 3, + 2, + 0, + 0, + 2, + 0, + 2, + 1, + 3, + 0, + 1, + 5, + 3, + 2, + 5, + 3, + 1, + 2, + 2, + 0, + 4, + 2, + 5, + 3, + 4, + 3, + 3, + 5, + 1, + 2, + 0, + 8, + 0, + 2, + 2, + 5, + 2, + 0, + 1, + 1, + 1, + 5, + 4, + 1, + 1, + 0, + 3, + 3, + 4 + ], + "weighted_loads": [ + 0.0784781277179718, + 0.0, + 0.0, + 0.05473349243402481, + 0.0, + 0.04872613400220871, + 0.12480410188436508, + 0.16160987317562103, + 0.5411253347992897, + 0.31067001819610596, + 0.053290240466594696, + 0.08352244272828102, + 0.17923299968242645, + 0.12757199071347713, + 0.17741011083126068, + 0.16819606348872185, + 0.07476768270134926, + 0.0, + 0.0, + 0.1523267664015293, + 0.0, + 0.12191999703645706, + 0.05349772423505783, + 0.21584716066718102, + 0.0, + 0.06850173324346542, + 0.4890274927020073, + 0.16266250610351562, + 0.10990884527564049, + 0.33614755794405937, + 0.20746025815606117, + 0.07077647745609283, + 0.12947165593504906, + 0.13656725361943245, + 0.0, + 0.31255749613046646, + 0.085043054074049, + 0.2903663441538811, + 0.17289245873689651, + 0.2510887421667576, + 0.21451080963015556, + 0.1639556586742401, + 0.4985624700784683, + 0.08403655886650085, + 0.06977837532758713, + 0.0, + 0.4723363518714905, + 0.0, + 0.11250604316592216, + 0.0928427092730999, + 0.5379944182932377, + 0.13903648778796196, + 0.0, + 0.06246373802423477, + 0.07296178489923477, + 0.06959182769060135, + 0.35603005439043045, + 0.269270870834589, + 0.038504090160131454, + 0.03785920888185501, + 0.0, + 0.2030741572380066, + 0.2195996195077896, + 0.5392828695476055 + ], + "unique_experts": 52, + "load_cv": 0.8207301527401605, + "normalized_load_entropy": 0.909909576317067, + "max_load_share": 0.057971014492753624 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "193310807f63ca58398ee9f5a0bad9f6633f5e93e74efdb68d33247a64987a5b", + "route_weight_sha256": "1e9cab03796237b28a1f797fcb6b5f7ad9424bfdbcb473c49a17ccdadedfb606", + "loads": [ + 1, + 0, + 0, + 4, + 0, + 2, + 8, + 2, + 13, + 6, + 2, + 5, + 1, + 7, + 2, + 3, + 17, + 2, + 2, + 2, + 0, + 2, + 4, + 5, + 4, + 1, + 10, + 3, + 5, + 5, + 3, + 1, + 5, + 3, + 0, + 4, + 2, + 5, + 13, + 7, + 3, + 14, + 10, + 3, + 6, + 0, + 11, + 2, + 2, + 2, + 20, + 2, + 0, + 2, + 1, + 8, + 5, + 4, + 5, + 1, + 0, + 9, + 6, + 11 + ], + "weighted_loads": [ + 0.0784781277179718, + 0.0, + 0.0, + 0.1653030402958393, + 0.0, + 0.09077891707420349, + 0.761946227401495, + 0.16160987317562103, + 1.1749866344034672, + 0.31067001819610596, + 0.08614863827824593, + 0.553100798279047, + 0.17923299968242645, + 0.4144906923174858, + 0.17741011083126068, + 0.16819606348872185, + 2.089738190174103, + 0.11920571699738503, + 0.04169138986617327, + 0.1523267664015293, + 0.0, + 0.12191999703645706, + 0.22628918662667274, + 0.4114782102406025, + 0.13147989800199866, + 0.06850173324346542, + 0.9449578821659088, + 0.16266250610351562, + 0.17332212440669537, + 0.33614755794405937, + 0.20746025815606117, + 0.07077647745609283, + 0.24307355284690857, + 0.18664399906992912, + 0.0, + 0.31255749613046646, + 0.085043054074049, + 0.2903663441538811, + 1.106539811939001, + 0.3865390755236149, + 0.21451080963015556, + 1.255122009664774, + 0.9062405973672867, + 0.11603304371237755, + 1.61300989985466, + 0.0, + 0.5987493693828583, + 0.13960806280374527, + 0.11250604316592216, + 0.0928427092730999, + 1.7233622185885906, + 0.13903648778796196, + 0.0, + 0.0936532560735941, + 0.07296178489923477, + 0.7228516191244125, + 0.35603005439043045, + 0.269270870834589, + 0.12380910571664572, + 0.03785920888185501, + 0.0, + 0.5023045763373375, + 0.2679739478044212, + 0.8090040180832148 + ], + "unique_experts": 56, + "load_cv": 0.9541980020732037, + "normalized_load_entropy": 0.8988335899218154, + "max_load_share": 0.06944444444444445 + } + }, + "s1_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "2ff06489fea4732a5b078c9f1ff1af99852d59f77beed79fb647fe3164fd7aab", + "route_weight_sha256": "ed5846ebfdf4354c03b59e4cfa5a1362fb55cf431ed8b6827f49041ee1c6a03c", + "loads": [ + 1, + 0, + 0, + 1, + 0, + 1, + 2, + 2, + 5, + 6, + 1, + 1, + 1, + 2, + 2, + 3, + 1, + 0, + 0, + 2, + 0, + 2, + 1, + 3, + 0, + 1, + 5, + 3, + 2, + 5, + 3, + 1, + 3, + 2, + 0, + 4, + 2, + 5, + 2, + 4, + 3, + 3, + 5, + 2, + 2, + 0, + 8, + 0, + 2, + 2, + 5, + 3, + 0, + 1, + 1, + 1, + 5, + 5, + 1, + 1, + 0, + 3, + 2, + 4 + ], + "weighted_loads": [ + 0.07952830940485, + 0.0, + 0.0, + 0.05295955017209053, + 0.0, + 0.05259981378912926, + 0.12529898434877396, + 0.169132299721241, + 0.5501347035169601, + 0.3167583867907524, + 0.05423925817012787, + 0.04089190065860748, + 0.18451164662837982, + 0.1291555892676115, + 0.1798621490597725, + 0.1694326102733612, + 0.042830269783735275, + 0.0, + 0.0, + 0.15539627149701118, + 0.0, + 0.12231942266225815, + 0.05679530277848244, + 0.2137393318116665, + 0.0, + 0.06898187100887299, + 0.490201611071825, + 0.16171183437108994, + 0.10115971788764, + 0.33662044256925583, + 0.20895033329725266, + 0.06619769334793091, + 0.17084861174225807, + 0.13402337208390236, + 0.0, + 0.3190022334456444, + 0.08589332550764084, + 0.2909127362072468, + 0.11807897314429283, + 0.2593435272574425, + 0.2144022099673748, + 0.16706309840083122, + 0.49448174238204956, + 0.11100652441382408, + 0.06951501592993736, + 0.0, + 0.4592203013598919, + 0.0, + 0.11248711496591568, + 0.09635675325989723, + 0.5365155376493931, + 0.1732804849743843, + 0.0, + 0.06715456396341324, + 0.07349586486816406, + 0.07330560684204102, + 0.3541448973119259, + 0.3107544891536236, + 0.03793739154934883, + 0.03757086023688316, + 0.0, + 0.20300672203302383, + 0.18083807453513145, + 0.5792447738349438 + ], + "unique_experts": 52, + "load_cv": 0.8329236548116529, + "normalized_load_entropy": 0.9079655660822401, + "max_load_share": 0.057971014492753624 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "ad6171ac8c9b077a1508c459c35d83ff5eb48ae0cd21279ef2fc113ac0338a57", + "route_weight_sha256": "1326cbb55258e35920098d4727ee74023de90b509d90e2b792b9b17178e414ab", + "loads": [ + 1, + 0, + 0, + 3, + 1, + 2, + 10, + 2, + 21, + 8, + 8, + 6, + 1, + 7, + 4, + 4, + 17, + 3, + 2, + 2, + 0, + 2, + 3, + 6, + 5, + 1, + 14, + 3, + 5, + 11, + 3, + 1, + 9, + 10, + 0, + 4, + 2, + 9, + 19, + 7, + 5, + 19, + 15, + 5, + 13, + 0, + 11, + 6, + 2, + 2, + 27, + 3, + 0, + 1, + 5, + 10, + 5, + 11, + 4, + 1, + 0, + 9, + 6, + 8 + ], + "weighted_loads": [ + 0.07952830940485, + 0.0, + 0.0, + 0.11602080427110195, + 0.04674067348241806, + 0.09714111313223839, + 0.7665261123329401, + 0.169132299721241, + 1.915893517434597, + 0.41963500156998634, + 0.6174703985452652, + 0.6230485215783119, + 0.18451164662837982, + 0.43751109950244427, + 0.24864236265420914, + 0.2260129600763321, + 2.471939317882061, + 0.1653543785214424, + 0.04110823292285204, + 0.15539627149701118, + 0.0, + 0.12231942266225815, + 0.17809825763106346, + 0.4424585774540901, + 0.15567996073514223, + 0.06898187100887299, + 1.3292887695133686, + 0.16171183437108994, + 0.16477420553565025, + 1.1131538525223732, + 0.20895033329725266, + 0.06619769334793091, + 0.5564406551420689, + 0.672950342297554, + 0.0, + 0.3190022334456444, + 0.08589332550764084, + 0.5187650918960571, + 1.9227273017168045, + 0.4081593118607998, + 0.4369622580707073, + 1.7305617146193981, + 1.326873179525137, + 0.1831112690269947, + 2.18454010784626, + 0.0, + 0.6027032434940338, + 0.33799368888139725, + 0.11248711496591568, + 0.09635675325989723, + 2.166069647297263, + 0.1732804849743843, + 0.0, + 0.06715456396341324, + 0.2804102785885334, + 0.8414983190596104, + 0.3541448973119259, + 0.8478352688252926, + 0.09510331321507692, + 0.03757086023688316, + 0.0, + 0.493600832298398, + 0.2649923199787736, + 0.6946539133787155 + ], + "unique_experts": 57, + "load_cv": 0.9578803277143875, + "normalized_load_entropy": 0.8967658488554541, + "max_load_share": 0.0703125 + } + }, + "s0_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "10007fe45b69d8e65430e6b40eb475ba04c861acb2f2e58fd5d48ea4333b2825", + "route_weight_sha256": "b32067b5ffc857f03a0dde27b0abf8df84b472e22e1fbe47b2c9514c8eb560d2", + "loads": [ + 1, + 0, + 0, + 2, + 0, + 1, + 2, + 2, + 5, + 5, + 1, + 2, + 1, + 2, + 2, + 3, + 2, + 0, + 0, + 2, + 0, + 2, + 1, + 3, + 0, + 1, + 6, + 3, + 1, + 4, + 3, + 1, + 2, + 2, + 0, + 4, + 2, + 5, + 3, + 5, + 2, + 3, + 5, + 1, + 1, + 0, + 9, + 0, + 2, + 1, + 5, + 2, + 0, + 1, + 1, + 1, + 5, + 5, + 1, + 1, + 0, + 3, + 4, + 4 + ], + "weighted_loads": [ + 0.07775628566741943, + 0.0, + 0.0, + 0.09270409494638443, + 0.0, + 0.05015726387500763, + 0.1294640526175499, + 0.16527222096920013, + 0.5372450351715088, + 0.2502054534852505, + 0.049326907843351364, + 0.08466390892863274, + 0.1673828512430191, + 0.11971312388777733, + 0.17470213025808334, + 0.16611360758543015, + 0.07850974053144455, + 0.0, + 0.0, + 0.14179055392742157, + 0.0, + 0.127430759370327, + 0.05759052187204361, + 0.23432349413633347, + 0.0, + 0.06390094012022018, + 0.5416184589266777, + 0.1540442667901516, + 0.06565677374601364, + 0.31861061602830887, + 0.20823932439088821, + 0.07196401059627533, + 0.15068098157644272, + 0.13171403855085373, + 0.0, + 0.3167692646384239, + 0.07840772718191147, + 0.30084605887532234, + 0.19465775042772293, + 0.3025464564561844, + 0.19003216177225113, + 0.15326419472694397, + 0.49523335695266724, + 0.07446341216564178, + 0.0360441654920578, + 0.0, + 0.5184286069124937, + 0.0, + 0.12235622480511665, + 0.05645853653550148, + 0.5337732769548893, + 0.1350756213068962, + 0.0, + 0.058881230652332306, + 0.07367584109306335, + 0.05910426378250122, + 0.3520432077348232, + 0.33063559979200363, + 0.03844846785068512, + 0.035330917686223984, + 0.0, + 0.20364053919911385, + 0.2574187256395817, + 0.5802618898451328 + ], + "unique_experts": 52, + "load_cv": 0.8645993471463568, + "normalized_load_entropy": 0.9043187665548803, + "max_load_share": 0.06521739130434782 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "362fef2464aa1cfd5a62bd1f329207e5d237d519942e72d0849b49ee37cb7397", + "route_weight_sha256": "e76043d10a6b368e6ab001c9180793131c5912c47a0926a751c08c90a5f49927", + "loads": [ + 1, + 0, + 0, + 5, + 0, + 2, + 10, + 2, + 13, + 5, + 2, + 6, + 1, + 7, + 2, + 3, + 17, + 2, + 3, + 2, + 0, + 2, + 4, + 5, + 3, + 1, + 11, + 3, + 3, + 4, + 3, + 1, + 5, + 4, + 0, + 4, + 2, + 5, + 12, + 8, + 2, + 14, + 10, + 3, + 5, + 0, + 11, + 2, + 2, + 1, + 20, + 2, + 0, + 3, + 1, + 8, + 5, + 5, + 4, + 1, + 0, + 9, + 6, + 11 + ], + "weighted_loads": [ + 0.07775628566741943, + 0.0, + 0.0, + 0.20327364280819893, + 0.0, + 0.09221004694700241, + 0.9316329061985016, + 0.16527222096920013, + 1.1720570251345634, + 0.2502054534852505, + 0.0821853056550026, + 0.6120811961591244, + 0.1673828512430191, + 0.406631825491786, + 0.17470213025808334, + 0.16611360758543015, + 2.1654377318918705, + 0.11340417340397835, + 0.08241311181336641, + 0.14179055392742157, + 0.0, + 0.127430759370327, + 0.23038198426365852, + 0.42720604687929153, + 0.12439797446131706, + 0.06390094012022018, + 0.993840217590332, + 0.1540442667901516, + 0.11594093218445778, + 0.31861061602830887, + 0.20823932439088821, + 0.07196401059627533, + 0.26428287848830223, + 0.22029084712266922, + 0.0, + 0.3167692646384239, + 0.07840772718191147, + 0.30084605887532234, + 1.0510931201279163, + 0.44368596747517586, + 0.19003216177225113, + 1.1614843346178532, + 0.8917275704443455, + 0.12937537394464016, + 0.7683212012052536, + 0.0, + 0.6196154821664095, + 0.1369798257946968, + 0.12235622480511665, + 0.05645853653550148, + 1.8297375068068504, + 0.1350756213068962, + 0.0, + 0.1349204983562231, + 0.07367584109306335, + 0.7123640552163124, + 0.3520432077348232, + 0.33063559979200363, + 0.10874460637569427, + 0.035330917686223984, + 0.0, + 0.5028709582984447, + 0.300177501514554, + 0.8499830383807421 + ], + "unique_experts": 56, + "load_cv": 0.9630519901866508, + "normalized_load_entropy": 0.8969145522925177, + "max_load_share": 0.06944444444444445 + } + }, + "s1_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "e726ada33023cd1cc40d59a215088918aa6d55f5bda7335da250175a75572f26", + "route_weight_sha256": "563cc98fca0b1af7b32fa3d47eb55a96cf4e7b189c3af07ff1f139ac38f4cd41", + "loads": [ + 1, + 0, + 0, + 2, + 0, + 1, + 1, + 2, + 5, + 6, + 1, + 2, + 1, + 2, + 3, + 3, + 1, + 0, + 0, + 3, + 0, + 2, + 1, + 3, + 0, + 1, + 7, + 3, + 1, + 5, + 3, + 1, + 2, + 2, + 0, + 4, + 2, + 5, + 2, + 4, + 2, + 3, + 5, + 1, + 1, + 0, + 7, + 0, + 2, + 2, + 5, + 2, + 0, + 1, + 1, + 1, + 5, + 5, + 1, + 1, + 0, + 3, + 4, + 4 + ], + "weighted_loads": [ + 0.07788634300231934, + 0.0, + 0.0, + 0.09065156057476997, + 0.0, + 0.0524534210562706, + 0.06783972680568695, + 0.17226508259773254, + 0.5450474843382835, + 0.312940813601017, + 0.051324184983968735, + 0.0871279127895832, + 0.17713746428489685, + 0.12603959254920483, + 0.21177106350660324, + 0.1605837643146515, + 0.04429975524544716, + 0.0, + 0.0, + 0.1861930787563324, + 0.0, + 0.13009463623166084, + 0.06442923098802567, + 0.219536405056715, + 0.0, + 0.06737782061100006, + 0.608747374266386, + 0.15529842302203178, + 0.06716941297054291, + 0.355046134442091, + 0.2132168412208557, + 0.06855358928442001, + 0.14418033510446548, + 0.13733502477407455, + 0.0, + 0.3100580796599388, + 0.07989337667822838, + 0.2965163514018059, + 0.12553544342517853, + 0.25246925838291645, + 0.18790075927972794, + 0.15479068830609322, + 0.49364980310201645, + 0.07166127115488052, + 0.03786637634038925, + 0.0, + 0.4533219449222088, + 0.0, + 0.12069344520568848, + 0.09288924187421799, + 0.5428377203643322, + 0.13760636374354362, + 0.0, + 0.06109767034649849, + 0.07251837849617004, + 0.0640159472823143, + 0.3427343927323818, + 0.3344762250781059, + 0.03536674380302429, + 0.0355067253112793, + 0.0, + 0.19480440393090248, + 0.2590431310236454, + 0.6130934655666351 + ], + "unique_experts": 52, + "load_cv": 0.8528588394089563, + "normalized_load_entropy": 0.9044167243766771, + "max_load_share": 0.050724637681159424 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "acd10d826b8d7cf9dd291d0e4d4f6f832f5ae3198610085e210c0b5460501958", + "route_weight_sha256": "9ee09ea0fb24c35c319efa29c2232ca0996b4a672f7caefee458b78d2a63fe24", + "loads": [ + 1, + 0, + 0, + 4, + 1, + 2, + 11, + 2, + 21, + 8, + 8, + 7, + 1, + 7, + 5, + 4, + 17, + 3, + 3, + 3, + 0, + 2, + 3, + 7, + 4, + 1, + 16, + 3, + 3, + 11, + 3, + 1, + 8, + 10, + 0, + 4, + 2, + 9, + 19, + 7, + 4, + 19, + 15, + 4, + 12, + 0, + 10, + 6, + 2, + 2, + 27, + 2, + 0, + 1, + 5, + 10, + 5, + 11, + 3, + 1, + 0, + 9, + 7, + 8 + ], + "weighted_loads": [ + 0.07788634300231934, + 0.0, + 0.0, + 0.1537128146737814, + 0.04674067348241806, + 0.09699472039937973, + 0.91722003929317, + 0.17226508259773254, + 1.9131121672689915, + 0.41581742838025093, + 0.6145553253591061, + 0.6855990402400494, + 0.17713746428489685, + 0.4343951027840376, + 0.2805512771010399, + 0.21716411411762238, + 2.504228200763464, + 0.1607176698744297, + 0.07835877779871225, + 0.1861930787563324, + 0.0, + 0.13009463623166084, + 0.1857321858406067, + 0.48717980086803436, + 0.1485286634415388, + 0.06737782061100006, + 1.485258836299181, + 0.15529842302203178, + 0.1170809343457222, + 1.1315795443952084, + 0.2132168412208557, + 0.06855358928442001, + 0.5297723785042763, + 0.6762619949877262, + 0.0, + 0.3100580796599388, + 0.07989337667822838, + 0.5243687070906162, + 1.8779530934989452, + 0.4043647814542055, + 0.41046080738306046, + 1.635351251810789, + 1.318708147853613, + 0.17064774595201015, + 1.3429731279611588, + 0.0, + 0.6073211431503296, + 0.335918340831995, + 0.12069344520568848, + 0.09288924187421799, + 2.313724236562848, + 0.13760636374354362, + 0.0, + 0.06109767034649849, + 0.2794327922165394, + 0.8322086594998837, + 0.3427343927323818, + 0.8715570047497749, + 0.0771705936640501, + 0.0355067253112793, + 0.0, + 0.48539851419627666, + 0.337674617767334, + 0.7285026051104069 + ], + "unique_experts": 57, + "load_cv": 0.9642030387838445, + "normalized_load_entropy": 0.8958164036808541, + "max_load_share": 0.0703125 + } + }, + "s0_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "9fb2acfc6e9a4fd62411cd457549586775fdefc22e61d1fb5ce4abb12c8d3729", + "route_weight_sha256": "836e4550e20c849116336d936aafbff9605dc47c29627b7c00484e4c308598b9", + "loads": [ + 1, + 0, + 0, + 2, + 0, + 1, + 1, + 2, + 5, + 6, + 2, + 2, + 1, + 1, + 3, + 3, + 2, + 1, + 0, + 1, + 0, + 2, + 1, + 3, + 0, + 1, + 7, + 3, + 2, + 4, + 3, + 1, + 2, + 2, + 0, + 4, + 2, + 5, + 2, + 4, + 2, + 3, + 5, + 1, + 1, + 1, + 8, + 0, + 2, + 1, + 6, + 2, + 0, + 1, + 1, + 1, + 5, + 5, + 1, + 1, + 0, + 3, + 2, + 4 + ], + "weighted_loads": [ + 0.08184432983398438, + 0.0, + 0.0, + 0.09630005061626434, + 0.0, + 0.050572190433740616, + 0.06918098777532578, + 0.16384253650903702, + 0.5355592668056488, + 0.315825417637825, + 0.07363034784793854, + 0.08262091875076294, + 0.18250660598278046, + 0.10041236132383347, + 0.22424886748194695, + 0.1693577878177166, + 0.08049093931913376, + 0.05070706829428673, + 0.0, + 0.09836196899414062, + 0.0, + 0.1282285638153553, + 0.04895307868719101, + 0.21399182081222534, + 0.0, + 0.057912036776542664, + 0.6308232173323631, + 0.1439148746430874, + 0.0954805463552475, + 0.3026076517999172, + 0.20407144725322723, + 0.07628099620342255, + 0.146853469312191, + 0.1319953016936779, + 0.0, + 0.2927549406886101, + 0.08573467284440994, + 0.3085923120379448, + 0.14173487573862076, + 0.2431228682398796, + 0.1910644918680191, + 0.15929799526929855, + 0.4789082035422325, + 0.07562334090471268, + 0.0349779948592186, + 0.03758610412478447, + 0.4814009256660938, + 0.0, + 0.12074293568730354, + 0.0549909770488739, + 0.5659644827246666, + 0.1419944204390049, + 0.0, + 0.058721404522657394, + 0.06930747628211975, + 0.05763455480337143, + 0.3535959981381893, + 0.30338870361447334, + 0.04157949611544609, + 0.034914594143629074, + 0.0, + 0.19691606238484383, + 0.18469177186489105, + 0.5385849513113499 + ], + "unique_experts": 54, + "load_cv": 0.8567902176149248, + "normalized_load_entropy": 0.9093875914070071, + "max_load_share": 0.057971014492753624 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "e82755f20d3c24534552938f9bc9cda26dec3170ba0deb894df43e0eb4e51b5f", + "route_weight_sha256": "7b6abc66210f8a954364396f43c3ee4cd40148ca15e780cedc2b8239ca3215e1", + "loads": [ + 1, + 0, + 0, + 5, + 0, + 3, + 6, + 2, + 13, + 6, + 3, + 6, + 2, + 7, + 3, + 3, + 18, + 3, + 2, + 1, + 0, + 2, + 4, + 5, + 3, + 1, + 11, + 3, + 4, + 4, + 3, + 1, + 5, + 4, + 0, + 4, + 2, + 5, + 11, + 7, + 2, + 14, + 10, + 3, + 4, + 1, + 11, + 3, + 2, + 1, + 20, + 2, + 0, + 2, + 1, + 8, + 5, + 5, + 4, + 1, + 0, + 10, + 4, + 12 + ], + "weighted_loads": [ + 0.08184432983398438, + 0.0, + 0.0, + 0.20686959847807884, + 0.0, + 0.14679880812764168, + 0.5950679518282413, + 0.16384253650903702, + 1.163902137428522, + 0.315825417637825, + 0.10648874565958977, + 0.6324421539902687, + 0.22069456055760384, + 0.42188740335404873, + 0.22424886748194695, + 0.1693577878177166, + 2.4463277384638786, + 0.1746721975505352, + 0.04169138986617327, + 0.09836196899414062, + 0.0, + 0.1282285638153553, + 0.22174454107880592, + 0.3948657289147377, + 0.12439797446131706, + 0.057912036776542664, + 1.0079449638724327, + 0.1439148746430874, + 0.14576470479369164, + 0.3026076517999172, + 0.20407144725322723, + 0.07628099620342255, + 0.2604553662240505, + 0.22160562127828598, + 0.0, + 0.2927549406886101, + 0.08573467284440994, + 0.3085923120379448, + 0.9208509102463722, + 0.3798637166619301, + 0.1910644918680191, + 1.1150448992848396, + 0.8437364622950554, + 0.12827825732529163, + 0.7148595750331879, + 0.03758610412478447, + 0.6124444268643856, + 0.18847934529185295, + 0.12074293568730354, + 0.0549909770488739, + 1.6610635183751583, + 0.1419944204390049, + 0.0, + 0.08991092257201672, + 0.06930747628211975, + 0.7108943462371826, + 0.3535959981381893, + 0.30338870361447334, + 0.11187563464045525, + 0.034914594143629074, + 0.0, + 0.5490809641778469, + 0.2274505477398634, + 0.8903527054935694 + ], + "unique_experts": 57, + "load_cv": 0.955006302092838, + "normalized_load_entropy": 0.9012581806340056, + "max_load_share": 0.06944444444444445 + } + }, + "s1_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "0447a4dd78d702e59a74f48e5c36f4b3e35106f67e5d835b825ca0bfbe5a9f72", + "route_weight_sha256": "c29202e6abed61f16727b3ee7503a3473629937514138655ef86d3b765b2abb7", + "loads": [ + 1, + 0, + 0, + 2, + 0, + 1, + 1, + 2, + 5, + 5, + 1, + 2, + 1, + 2, + 2, + 3, + 1, + 0, + 0, + 2, + 0, + 2, + 1, + 3, + 0, + 1, + 7, + 3, + 2, + 5, + 3, + 1, + 3, + 2, + 1, + 4, + 1, + 5, + 1, + 4, + 2, + 3, + 5, + 1, + 1, + 1, + 9, + 0, + 2, + 2, + 5, + 3, + 0, + 1, + 1, + 1, + 5, + 5, + 1, + 1, + 0, + 3, + 2, + 4 + ], + "weighted_loads": [ + 0.07667648792266846, + 0.0, + 0.0, + 0.09390370920300484, + 0.0, + 0.049154769629240036, + 0.06590791791677475, + 0.1822323501110077, + 0.5548911243677139, + 0.2690950408577919, + 0.04912063479423523, + 0.08330745622515678, + 0.18327370285987854, + 0.1325265783816576, + 0.19275616109371185, + 0.15778398513793945, + 0.045810505747795105, + 0.0, + 0.0, + 0.1576816886663437, + 0.0, + 0.13008221611380577, + 0.055879827588796616, + 0.22729846090078354, + 0.0, + 0.06398652493953705, + 0.6157225929200649, + 0.16010231897234917, + 0.10226428508758545, + 0.3484039269387722, + 0.21345040202140808, + 0.07106759399175644, + 0.18590735271573067, + 0.14013190940022469, + 0.052634865045547485, + 0.2927251569926739, + 0.05026543140411377, + 0.3006916083395481, + 0.08040913194417953, + 0.24760425463318825, + 0.1873333528637886, + 0.16177789494395256, + 0.4872695617377758, + 0.07266644388437271, + 0.03812681883573532, + 0.041786983609199524, + 0.5234332643449306, + 0.0, + 0.12204938009381294, + 0.08978689461946487, + 0.567193191498518, + 0.17521606758236885, + 0.0, + 0.061636872589588165, + 0.06853274255990982, + 0.06634495407342911, + 0.34377193078398705, + 0.3248888775706291, + 0.03682149946689606, + 0.033691853284835815, + 0.0, + 0.19067102298140526, + 0.1897398978471756, + 0.5789408423006535 + ], + "unique_experts": 54, + "load_cv": 0.8684775806712252, + "normalized_load_entropy": 0.9080668378686004, + "max_load_share": 0.06521739130434782 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "cffbc1f00c47967411bd5201417e41e5ab79be1eadbc6839790eeb1ed6472d89", + "route_weight_sha256": "f659788a8bebcb23b285e668a04eca8c969fa70b1a97cc64842a22e6f5dbc885", + "loads": [ + 1, + 0, + 0, + 4, + 1, + 3, + 8, + 2, + 21, + 7, + 9, + 7, + 1, + 8, + 4, + 4, + 18, + 4, + 2, + 2, + 0, + 2, + 3, + 7, + 5, + 1, + 16, + 3, + 4, + 11, + 3, + 1, + 9, + 10, + 1, + 4, + 1, + 9, + 16, + 7, + 4, + 18, + 15, + 3, + 11, + 1, + 13, + 7, + 2, + 2, + 26, + 3, + 0, + 1, + 5, + 10, + 5, + 11, + 3, + 1, + 0, + 10, + 5, + 9 + ], + "weighted_loads": [ + 0.07667648792266846, + 0.0, + 0.0, + 0.15696496330201626, + 0.04674067348241806, + 0.14730819687247276, + 0.6073070261627436, + 0.1822323501110077, + 1.9287209399044514, + 0.37197165563702583, + 0.649713221937418, + 0.7228396125137806, + 0.18327370285987854, + 0.4712633490562439, + 0.2615363746881485, + 0.21436433494091034, + 2.775383774191141, + 0.21734599024057388, + 0.04110823292285204, + 0.1576816886663437, + 0.0, + 0.13008221611380577, + 0.17718278244137764, + 0.4654056318104267, + 0.18124943785369396, + 0.06398652493953705, + 1.4299841038882732, + 0.16010231897234917, + 0.15217580646276474, + 1.1249373368918896, + 0.21345040202140808, + 0.07106759399175644, + 0.5714993961155415, + 0.6790588796138763, + 0.052634865045547485, + 0.2927251569926739, + 0.05026543140411377, + 0.5285439640283585, + 1.704046044498682, + 0.3934466727077961, + 0.4098934009671211, + 1.5131762847304344, + 1.2894241213798523, + 0.1309038195759058, + 1.3046277649700642, + 0.041786983609199524, + 0.7109182141721249, + 0.40837837755680084, + 0.12204938009381294, + 0.08978689461946487, + 2.103334518149495, + 0.17521606758236885, + 0.0, + 0.061636872589588165, + 0.27544715628027916, + 0.8345376662909985, + 0.34377193078398705, + 0.8619696572422981, + 0.07862534932792187, + 0.033691853284835815, + 0.0, + 0.5343005526810884, + 0.2683713845908642, + 0.764362134039402 + ], + "unique_experts": 59, + "load_cv": 0.9400428477232065, + "normalized_load_entropy": 0.9007953747424192, + "max_load_share": 0.06770833333333333 + } + }, + "s0_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "920e12b3108bd5e0d6412d38da34b512db922bdd3fbe6d36b2f42acf78403675", + "route_weight_sha256": "e1bda4cee4943159822650fa8f15bd417fe7688b82cc42dd39f98505c02328dc", + "loads": [ + 1, + 0, + 0, + 2, + 0, + 1, + 2, + 2, + 5, + 6, + 1, + 2, + 1, + 1, + 2, + 3, + 2, + 1, + 0, + 1, + 0, + 2, + 1, + 3, + 0, + 1, + 6, + 3, + 1, + 5, + 3, + 1, + 2, + 2, + 0, + 4, + 2, + 5, + 2, + 4, + 2, + 3, + 5, + 1, + 1, + 1, + 9, + 0, + 2, + 1, + 6, + 2, + 0, + 1, + 1, + 1, + 5, + 5, + 1, + 1, + 0, + 3, + 3, + 4 + ], + "weighted_loads": [ + 0.08192086219787598, + 0.0, + 0.0, + 0.1012735366821289, + 0.0, + 0.050724856555461884, + 0.13067581877112389, + 0.17205801606178284, + 0.5261558517813683, + 0.31277428194880486, + 0.04824803024530411, + 0.08080968260765076, + 0.18202070891857147, + 0.09807588905096054, + 0.1907052919268608, + 0.1678154319524765, + 0.08009802550077438, + 0.05401364713907242, + 0.0, + 0.0955943837761879, + 0.0, + 0.1311187893152237, + 0.053168587386608124, + 0.2087230160832405, + 0.0, + 0.05435847118496895, + 0.555130373686552, + 0.14686572551727295, + 0.062183499336242676, + 0.3298283852636814, + 0.196955144405365, + 0.07814718782901764, + 0.14662501215934753, + 0.13133268058300018, + 0.0, + 0.290324829518795, + 0.08519940450787544, + 0.30731984227895737, + 0.14300256967544556, + 0.24845963157713413, + 0.18471291661262512, + 0.1589573659002781, + 0.4805356115102768, + 0.07675644010305405, + 0.03674737736582756, + 0.03805568441748619, + 0.5107700452208519, + 0.0, + 0.12129537761211395, + 0.053428974002599716, + 0.5499302502721548, + 0.13851173967123032, + 0.0, + 0.05971452221274376, + 0.07206549495458603, + 0.05548723787069321, + 0.3605879470705986, + 0.3090251237154007, + 0.040086016058921814, + 0.035603150725364685, + 0.0, + 0.21499526500701904, + 0.22444072738289833, + 0.5371352545917034 + ], + "unique_experts": 54, + "load_cv": 0.8761825507357589, + "normalized_load_entropy": 0.9069754464343727, + "max_load_share": 0.06521739130434782 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "82fe1dfb00476f4995950b413736afade95c9e2902a4a4d2e1a014f460a41503", + "route_weight_sha256": "9341d2e2e627521c3f7ff2148096a1051ca4f6bcf46a8d3b913d047c8c310b94", + "loads": [ + 1, + 0, + 0, + 5, + 0, + 2, + 7, + 2, + 14, + 6, + 2, + 6, + 2, + 6, + 2, + 3, + 18, + 3, + 2, + 1, + 0, + 2, + 5, + 5, + 3, + 1, + 10, + 3, + 3, + 5, + 3, + 1, + 5, + 4, + 0, + 4, + 2, + 5, + 12, + 7, + 2, + 15, + 10, + 3, + 4, + 1, + 10, + 2, + 2, + 1, + 23, + 2, + 0, + 2, + 1, + 8, + 5, + 5, + 4, + 1, + 0, + 9, + 5, + 11 + ], + "weighted_loads": [ + 0.08192086219787598, + 0.0, + 0.0, + 0.2118430845439434, + 0.0, + 0.09277763962745667, + 0.615633450448513, + 0.17205801606178284, + 1.2293239682912827, + 0.31277428194880486, + 0.08110642805695534, + 0.6243889406323433, + 0.2189042791724205, + 0.3849945906549692, + 0.1907052919268608, + 0.1678154319524765, + 2.4162331894040108, + 0.1721455566585064, + 0.04169138986617327, + 0.0955943837761879, + 0.0, + 0.1311187893152237, + 0.27079397812485695, + 0.38932885974645615, + 0.12439797446131706, + 0.05435847118496895, + 0.9171936325728893, + 0.14686572551727295, + 0.11246765777468681, + 0.3298283852636814, + 0.196955144405365, + 0.07814718782901764, + 0.26022690907120705, + 0.21780004352331161, + 0.0, + 0.290324829518795, + 0.08519940450787544, + 0.30731984227895737, + 1.032682117074728, + 0.3901908379048109, + 0.18471291661262512, + 1.168487410992384, + 0.8459376655519009, + 0.12975713796913624, + 0.710872333496809, + 0.03805568441748619, + 0.5655043534934521, + 0.14205022156238556, + 0.12129537761211395, + 0.053428974002599716, + 2.049687946215272, + 0.13851173967123032, + 0.0, + 0.09090404026210308, + 0.07206549495458603, + 0.7087470293045044, + 0.3605879470705986, + 0.3090251237154007, + 0.11038215458393097, + 0.035603150725364685, + 0.0, + 0.51422568410635, + 0.2671995032578707, + 0.8068564031273127 + ], + "unique_experts": 57, + "load_cv": 1.0038506110884806, + "normalized_load_entropy": 0.8952938432737559, + "max_load_share": 0.0798611111111111 + } + }, + "s1_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "0e850a1ab4477e87081e59d5d63e09c658dda56e759a87cdf301731200c1f216", + "route_weight_sha256": "72c4f759517ca76be638379e3199faa7dc288a631801cfc3ac8d88c4fc63178b", + "loads": [ + 1, + 0, + 0, + 2, + 0, + 1, + 1, + 2, + 5, + 6, + 1, + 1, + 1, + 2, + 2, + 3, + 1, + 0, + 0, + 1, + 0, + 2, + 1, + 3, + 0, + 1, + 7, + 3, + 3, + 5, + 3, + 1, + 2, + 2, + 0, + 4, + 2, + 5, + 3, + 4, + 2, + 3, + 5, + 1, + 1, + 1, + 8, + 0, + 2, + 2, + 5, + 2, + 0, + 1, + 1, + 1, + 5, + 5, + 1, + 0, + 0, + 3, + 4, + 4 + ], + "weighted_loads": [ + 0.07761546224355698, + 0.0, + 0.0, + 0.09436002746224403, + 0.0, + 0.05248614400625229, + 0.06824995577335358, + 0.18072670698165894, + 0.5668164044618607, + 0.3208327032625675, + 0.050270725041627884, + 0.04068371653556824, + 0.18393327295780182, + 0.132888438180089, + 0.19053616374731064, + 0.15705456584692, + 0.04607683792710304, + 0.0, + 0.0, + 0.09656665474176407, + 0.0, + 0.12777630984783173, + 0.056623056530952454, + 0.22754159569740295, + 0.0, + 0.0613601915538311, + 0.6218752674758434, + 0.15822172164916992, + 0.1440531238913536, + 0.3467393331229687, + 0.2088274359703064, + 0.07204797118902206, + 0.13704931363463402, + 0.14004309475421906, + 0.0, + 0.2922961190342903, + 0.08323715999722481, + 0.29660816863179207, + 0.18961143493652344, + 0.24481751210987568, + 0.18324946612119675, + 0.16848891973495483, + 0.4929843172430992, + 0.07149699330329895, + 0.03702478110790253, + 0.04111959785223007, + 0.4901997782289982, + 0.0, + 0.12221236899495125, + 0.08918878436088562, + 0.5600297302007675, + 0.14179591089487076, + 0.0, + 0.06102834641933441, + 0.06960464268922806, + 0.0634089931845665, + 0.3433993384242058, + 0.3249618224799633, + 0.0370904877781868, + 0.0, + 0.0, + 0.20098711922764778, + 0.25211625918745995, + 0.5838739611208439 + ], + "unique_experts": 52, + "load_cv": 0.8761825507357589, + "normalized_load_entropy": 0.9015803529447968, + "max_load_share": 0.057971014492753624 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "9efa1725155d73401f04c8849e92b97132caa8bac77bbcd938bde4a303a807f6", + "route_weight_sha256": "9612e3fce46ddbd06e8851ee8d4289ae53b9b7f1f58f377fcab950762d364859", + "loads": [ + 1, + 0, + 0, + 4, + 1, + 2, + 8, + 2, + 22, + 8, + 8, + 6, + 1, + 7, + 4, + 4, + 18, + 4, + 2, + 1, + 0, + 2, + 4, + 6, + 4, + 1, + 16, + 3, + 5, + 11, + 3, + 1, + 9, + 10, + 0, + 4, + 2, + 9, + 19, + 7, + 4, + 20, + 15, + 4, + 11, + 1, + 10, + 6, + 2, + 2, + 29, + 2, + 0, + 1, + 5, + 10, + 5, + 11, + 3, + 0, + 0, + 9, + 7, + 8 + ], + "weighted_loads": [ + 0.07761546224355698, + 0.0, + 0.0, + 0.15742128156125546, + 0.04674067348241806, + 0.09702744334936142, + 0.5691326875239611, + 0.18072670698165894, + 2.002901140600443, + 0.42370931804180145, + 0.6135018654167652, + 0.6297072879970074, + 0.18393327295780182, + 0.44124394841492176, + 0.2593163773417473, + 0.2136349156498909, + 2.7240956276655197, + 0.20556151866912842, + 0.04110823292285204, + 0.09656665474176407, + 0.0, + 0.12777630984783173, + 0.21017013117671013, + 0.42902522906661034, + 0.1485286634415388, + 0.0613601915538311, + 1.430500227957964, + 0.15822172164916992, + 0.1939646452665329, + 1.123272743076086, + 0.2088274359703064, + 0.07204797118902206, + 0.5555568151175976, + 0.6789700649678707, + 0.0, + 0.2922961190342903, + 0.08323715999722481, + 0.5244605243206024, + 1.9047626666724682, + 0.3930653315037489, + 0.40580951422452927, + 1.6226066779345274, + 1.297736819833517, + 0.16759917326271534, + 1.2972854413092136, + 0.04111959785223007, + 0.596257533878088, + 0.3426160179078579, + 0.12221236899495125, + 0.08918878436088562, + 2.5962026361376047, + 0.14179591089487076, + 0.0, + 0.06102834641933441, + 0.2765190564095974, + 0.8316017054021358, + 0.3433993384242058, + 0.8620426021516323, + 0.07889433763921261, + 0.0, + 0.0, + 0.49158122949302197, + 0.33074774593114853, + 0.6992831006646156 + ], + "unique_experts": 57, + "load_cv": 0.9969571761671165, + "normalized_load_entropy": 0.8918580896650841, + "max_load_share": 0.07552083333333333 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "ordered_topk_exact_tokens": 18, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.9503105590062112, + "mean_token_weighted_tv": 0.012938877567648888, + "aggregate_load_tv": 0.02898550724637681 + }, + "system_bos": { + "tokens": 23, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.9254658385093167, + "mean_token_weighted_tv": 0.020799770991763344, + "aggregate_load_tv": 0.043478260869565216 + }, + "system_x": { + "tokens": 23, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.9037267080745341, + "mean_token_weighted_tv": 0.027189438231289387, + "aggregate_load_tv": 0.057971014492753624 + }, + "system_period": { + "tokens": 23, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.8913043478260869, + "mean_token_weighted_tv": 0.0290666121341612, + "aggregate_load_tv": 0.05072463768115942 + }, + "bos_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.9254658385093169, + "mean_token_weighted_tv": 0.023024257029528202, + "aggregate_load_tv": 0.043478260869565216 + }, + "bos_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8881987577639753, + "mean_token_weighted_tv": 0.02900495368015507, + "aggregate_load_tv": 0.05797101449275362 + }, + "x_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 13, + "mean_set_jaccard": 0.8664596273291927, + "mean_token_weighted_tv": 0.03100110691688631, + "aggregate_load_tv": 0.06521739130434782 + }, + "x_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8788819875776398, + "mean_token_weighted_tv": 0.03285468612676081, + "aggregate_load_tv": 0.05072463768115942 + }, + "period_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.8913043478260869, + "mean_token_weighted_tv": 0.027795534216515396, + "aggregate_load_tv": 0.05072463768115942 + }, + "period_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8881987577639753, + "mean_token_weighted_tv": 0.030156274812053078, + "aggregate_load_tv": 0.05797101449275362 + } + } + }, + "layer_08": { + "layer": 8, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "02742d07aa08b683eabdb457fb0fe8f446e9a8361620deb9418bb750f7e855c3", + "route_weight_sha256": "2419b15d530667cc1984f522f7d30569a358b5c64c088cc6088e8879aeedffa8", + "loads": [ + 6, + 1, + 0, + 3, + 0, + 0, + 5, + 1, + 0, + 3, + 2, + 4, + 2, + 0, + 7, + 1, + 5, + 8, + 0, + 1, + 2, + 1, + 2, + 8, + 0, + 1, + 0, + 0, + 4, + 0, + 1, + 2, + 3, + 9, + 2, + 0, + 1, + 0, + 0, + 5, + 12, + 0, + 1, + 0, + 1, + 6, + 0, + 3, + 2, + 1, + 2, + 1, + 1, + 3, + 0, + 0, + 4, + 6, + 0, + 0, + 5, + 0, + 0, + 0 + ], + "weighted_loads": [ + 0.544318325817585, + 0.03549816459417343, + 0.0, + 0.25596222281455994, + 0.0, + 0.0, + 0.3780137822031975, + 0.04629775136709213, + 0.0, + 0.18504464626312256, + 0.13254020735621452, + 0.18923597037792206, + 0.20087136328220367, + 0.0, + 0.41480666399002075, + 0.04157033935189247, + 0.43992338702082634, + 0.648616436868906, + 0.0, + 0.04039718210697174, + 0.13254061341285706, + 0.036824364215135574, + 0.13787417113780975, + 0.5809361971914768, + 0.0, + 0.07765403389930725, + 0.0, + 0.0, + 0.26879312098026276, + 0.0, + 0.0867457389831543, + 0.21222266554832458, + 0.2002602033317089, + 0.5364547856152058, + 0.1170804500579834, + 0.0, + 0.13832248747348785, + 0.0, + 0.0, + 0.22574445977807045, + 0.9345674440264702, + 0.0, + 0.042230717837810516, + 0.0, + 0.02950942888855934, + 0.5016263872385025, + 0.0, + 0.1824944205582142, + 0.12328018620610237, + 0.04103640839457512, + 0.3579007089138031, + 0.06993802636861801, + 0.028076617047190666, + 0.15181228518486023, + 0.0, + 0.0, + 0.28779640421271324, + 0.33812082558870316, + 0.0, + 0.0, + 0.27785048447549343, + 0.0, + 0.0, + 0.0 + ], + "unique_experts": 41, + "load_cv": 1.2303485741637001, + "normalized_load_entropy": 0.8273353757702948, + "max_load_share": 0.08695652173913043 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "87fcc90ab7af831ed720cc6506bbca7b618c6457f23f8e67e9d9087ab6d277ad", + "route_weight_sha256": "1e252369f6c3d5ba8dc5b6740a866a510bbb681c92511243393c8d7edb1ab837", + "loads": [ + 6, + 7, + 1, + 4, + 3, + 0, + 10, + 2, + 9, + 3, + 3, + 8, + 8, + 7, + 7, + 1, + 5, + 11, + 0, + 1, + 2, + 1, + 4, + 8, + 0, + 12, + 0, + 0, + 4, + 0, + 3, + 2, + 7, + 23, + 2, + 0, + 1, + 0, + 0, + 12, + 20, + 0, + 1, + 0, + 1, + 13, + 8, + 7, + 3, + 3, + 5, + 1, + 12, + 3, + 4, + 7, + 4, + 6, + 4, + 0, + 5, + 0, + 1, + 3 + ], + "weighted_loads": [ + 0.544318325817585, + 0.4063940402120352, + 0.012179519981145859, + 0.3008304685354233, + 0.12598169222474098, + 0.0, + 0.8061311021447182, + 0.09186630323529243, + 0.6375102810561657, + 0.18504464626312256, + 0.17589964345097542, + 0.3343390142545104, + 0.5370362512767315, + 0.5222872532904148, + 0.41480666399002075, + 0.04157033935189247, + 0.43992338702082634, + 0.8139249160885811, + 0.0, + 0.04039718210697174, + 0.13254061341285706, + 0.036824364215135574, + 0.21151527762413025, + 0.5809361971914768, + 0.0, + 0.8466668613255024, + 0.0, + 0.0, + 0.26879312098026276, + 0.0, + 0.10936250723898411, + 0.21222266554832458, + 0.37150391936302185, + 1.7865103986114264, + 0.1170804500579834, + 0.0, + 0.13832248747348785, + 0.0, + 0.0, + 0.4641670426353812, + 1.36728285998106, + 0.0, + 0.042230717837810516, + 0.0, + 0.02950942888855934, + 1.2077919840812683, + 0.8440363071858883, + 0.30611967109143734, + 0.16235952824354172, + 0.13099345564842224, + 0.5278190709650517, + 0.06993802636861801, + 0.6867152992635965, + 0.15181228518486023, + 1.5800522677600384, + 0.3721670527011156, + 0.28779640421271324, + 0.33812082558870316, + 0.11631730082444847, + 0.0, + 0.27785048447549343, + 0.0, + 0.046664755791425705, + 0.20614778995513916 + ], + "unique_experts": 51, + "load_cv": 1.0489559771388448, + "normalized_load_entropy": 0.8748233305694303, + "max_load_share": 0.0798611111111111 + } + }, + "s1_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "cf1cf98c6f5bdd13407b1879b188b3f1946e3cd428688d09740f3a96262c5df7", + "route_weight_sha256": "18e4fae7bef3d553056c28344a520ec2feb333d80a0a42b0ba014668d3329b24", + "loads": [ + 6, + 1, + 0, + 3, + 0, + 0, + 5, + 1, + 0, + 3, + 2, + 3, + 2, + 0, + 6, + 1, + 4, + 9, + 0, + 1, + 3, + 1, + 2, + 8, + 0, + 1, + 0, + 0, + 4, + 1, + 1, + 2, + 2, + 8, + 2, + 0, + 1, + 0, + 0, + 5, + 12, + 0, + 1, + 0, + 1, + 6, + 0, + 3, + 2, + 2, + 2, + 1, + 1, + 4, + 0, + 0, + 4, + 6, + 0, + 0, + 5, + 0, + 0, + 0 + ], + "weighted_loads": [ + 0.5328606888651848, + 0.03539341688156128, + 0.0, + 0.2538415491580963, + 0.0, + 0.0, + 0.37765999883413315, + 0.046417541801929474, + 0.0, + 0.1903766393661499, + 0.13276173546910286, + 0.1347021460533142, + 0.20073530822992325, + 0.0, + 0.36782024428248405, + 0.04194464161992073, + 0.41666464880108833, + 0.6868680752813816, + 0.0, + 0.041253384202718735, + 0.19100500270724297, + 0.038046322762966156, + 0.13715705275535583, + 0.5778556019067764, + 0.0, + 0.07367914170026779, + 0.0, + 0.0, + 0.26636894419789314, + 0.03735043480992317, + 0.08877445012331009, + 0.21871210634708405, + 0.1569136492908001, + 0.4808569438755512, + 0.11882850155234337, + 0.0, + 0.13923941552639008, + 0.0, + 0.0, + 0.22393643110990524, + 0.9389754347503185, + 0.0, + 0.0412166565656662, + 0.0, + 0.03020085208117962, + 0.4978203848004341, + 0.0, + 0.18346190825104713, + 0.12391740828752518, + 0.09113940224051476, + 0.3696776255965233, + 0.0711260735988617, + 0.02765696495771408, + 0.19225507229566574, + 0.0, + 0.0, + 0.2904842235147953, + 0.3384768217802048, + 0.0, + 0.0, + 0.27698905020952225, + 0.0, + 0.0, + 0.0 + ], + "unique_experts": 42, + "load_cv": 1.2055148777857978, + "normalized_load_entropy": 0.834281450558354, + "max_load_share": 0.08695652173913043 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "25217fd807f42c4b5a0cd486d8ac10be8fccbd46d7a4e941159847512991646c", + "route_weight_sha256": "566d75fba9c22991b87b251dd13e90d94e4a8c00f4b346daf78c411eae5cb0e1", + "loads": [ + 7, + 6, + 10, + 4, + 2, + 1, + 16, + 1, + 14, + 3, + 5, + 7, + 11, + 7, + 6, + 1, + 4, + 23, + 1, + 1, + 3, + 1, + 3, + 12, + 0, + 12, + 0, + 2, + 5, + 1, + 4, + 2, + 6, + 29, + 2, + 0, + 1, + 0, + 6, + 10, + 26, + 0, + 3, + 0, + 1, + 19, + 16, + 7, + 5, + 6, + 6, + 1, + 10, + 10, + 4, + 10, + 4, + 6, + 3, + 2, + 5, + 4, + 2, + 5 + ], + "weighted_loads": [ + 0.5711219385266304, + 0.3153598830103874, + 0.6192100457847118, + 0.3101652041077614, + 0.10313772037625313, + 0.04429738596081734, + 1.3238488212227821, + 0.046417541801929474, + 0.9343394096940756, + 0.1903766393661499, + 0.2634645104408264, + 0.2520972234196961, + 0.7377174124121666, + 0.4920506440103054, + 0.36782024428248405, + 0.04194464161992073, + 0.41666464880108833, + 1.6923097595572472, + 0.04674004390835762, + 0.041253384202718735, + 0.19100500270724297, + 0.038046322762966156, + 0.177090872079134, + 0.767050962895155, + 0.0, + 1.1887719705700874, + 0.0, + 0.1210886500775814, + 0.30756158754229546, + 0.03735043480992317, + 0.1640484007075429, + 0.21871210634708405, + 0.3019990883767605, + 2.0921086072921753, + 0.11882850155234337, + 0.0, + 0.13923941552639008, + 0.0, + 0.3952206000685692, + 0.3794892355799675, + 1.5856490917503834, + 0.0, + 0.20951547473669052, + 0.0, + 0.03020085208117962, + 1.792765486985445, + 1.2212429009377956, + 0.29717864468693733, + 0.43963468074798584, + 0.3543120436370373, + 0.5885580852627754, + 0.0711260735988617, + 0.5528759695589542, + 0.8628092110157013, + 1.5850101429969072, + 0.6150675937533379, + 0.2904842235147953, + 0.3384768217802048, + 0.10207748878747225, + 0.07265888899564743, + 0.27698905020952225, + 0.18764207512140274, + 0.09988690540194511, + 0.29106850922107697 + ], + "unique_experts": 58, + "load_cv": 1.034978529031185, + "normalized_load_entropy": 0.8890151678799572, + "max_load_share": 0.07552083333333333 + } + }, + "s0_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "70e28e1cec5e1bd60940f89ee67a4c24a4a4515bd026c300635c9755fd1aba38", + "route_weight_sha256": "c0803f9bb60e3d7e110e30cb6c1dc5d20788270359b5244cc0bc2bda3e6edbc8", + "loads": [ + 6, + 1, + 0, + 3, + 0, + 0, + 5, + 1, + 0, + 3, + 2, + 4, + 2, + 0, + 7, + 2, + 4, + 9, + 0, + 1, + 3, + 1, + 2, + 8, + 0, + 1, + 0, + 0, + 4, + 1, + 1, + 2, + 2, + 8, + 2, + 0, + 1, + 0, + 0, + 4, + 12, + 0, + 1, + 0, + 1, + 6, + 0, + 2, + 2, + 1, + 2, + 1, + 1, + 4, + 0, + 0, + 4, + 6, + 0, + 0, + 5, + 0, + 0, + 0 + ], + "weighted_loads": [ + 0.5408128872513771, + 0.03811875730752945, + 0.0, + 0.2600488141179085, + 0.0, + 0.0, + 0.37612173706293106, + 0.047350794076919556, + 0.0, + 0.17568644881248474, + 0.13415999710559845, + 0.1976202167570591, + 0.20841994881629944, + 0.0, + 0.39785313606262207, + 0.08289949223399162, + 0.3643970973789692, + 0.7097204700112343, + 0.0, + 0.04093395173549652, + 0.1904924139380455, + 0.03747956082224846, + 0.1319771409034729, + 0.5872701369225979, + 0.0, + 0.07439974695444107, + 0.0, + 0.0, + 0.28236865624785423, + 0.03746947646141052, + 0.0881720557808876, + 0.2108725905418396, + 0.14427892491221428, + 0.494457695633173, + 0.12072525173425674, + 0.0, + 0.13945795595645905, + 0.0, + 0.0, + 0.1694331392645836, + 0.9221537970006466, + 0.0, + 0.03802451863884926, + 0.0, + 0.02866639569401741, + 0.4919961504638195, + 0.0, + 0.14548499882221222, + 0.1230081096291542, + 0.03493146225810051, + 0.35940706729888916, + 0.07258725166320801, + 0.026379844173789024, + 0.199888214468956, + 0.0, + 0.0, + 0.2874164506793022, + 0.3487280309200287, + 0.0, + 0.0, + 0.27748564071953297, + 0.0, + 0.0, + 0.0 + ], + "unique_experts": 42, + "load_cv": 1.2138492293900511, + "normalized_load_entropy": 0.8330467960036289, + "max_load_share": 0.08695652173913043 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "852d91b61ad334afe0ddfa3ee2616583d03737ea60923d75ece15ae4f66eac80", + "route_weight_sha256": "f4e29e1413ca67bf57c43722bd47e6a041b87cd9b143291c45b518dc344ca66e", + "loads": [ + 6, + 7, + 1, + 4, + 2, + 0, + 10, + 2, + 9, + 3, + 2, + 8, + 8, + 7, + 7, + 3, + 4, + 13, + 0, + 1, + 3, + 1, + 4, + 8, + 1, + 13, + 0, + 0, + 4, + 1, + 4, + 2, + 7, + 22, + 2, + 0, + 1, + 0, + 0, + 10, + 18, + 0, + 1, + 0, + 1, + 13, + 8, + 5, + 3, + 3, + 5, + 1, + 12, + 4, + 4, + 8, + 4, + 6, + 3, + 0, + 5, + 0, + 1, + 3 + ], + "weighted_loads": [ + 0.5408128872513771, + 0.4090146329253912, + 0.012179519981145859, + 0.3049170598387718, + 0.12925386801362038, + 0.0, + 0.8032423704862595, + 0.09291934594511986, + 0.664770096540451, + 0.17568644881248474, + 0.13415999710559845, + 0.3399537308141589, + 0.5445848368108273, + 0.5171784944832325, + 0.39785313606262207, + 0.1284199170768261, + 0.3643970973789692, + 0.9042436666786671, + 0.0, + 0.04093395173549652, + 0.1904924139380455, + 0.03747956082224846, + 0.2056182473897934, + 0.5872701369225979, + 0.04531725496053696, + 0.9012377597391605, + 0.0, + 0.0, + 0.28236865624785423, + 0.03746947646141052, + 0.21503063291311264, + 0.2108725905418396, + 0.3734327331185341, + 1.7299028914421797, + 0.12072525173425674, + 0.0, + 0.13945795595645905, + 0.0, + 0.0, + 0.41888666432350874, + 1.2977060750126839, + 0.0, + 0.03802451863884926, + 0.0, + 0.02866639569401741, + 1.141227051615715, + 0.7400738634169102, + 0.25970865972340107, + 0.16208745166659355, + 0.12488850951194763, + 0.5293254293501377, + 0.07258725166320801, + 0.6850185263901949, + 0.199888214468956, + 0.708833921700716, + 0.4323254991322756, + 0.2874164506793022, + 0.3487280309200287, + 0.11327467858791351, + 0.0, + 0.27748564071953297, + 0.0, + 0.046664755791425705, + 0.20614778995513916 + ], + "unique_experts": 53, + "load_cv": 1.0122703976826999, + "normalized_load_entropy": 0.8829450503980312, + "max_load_share": 0.0763888888888889 + } + }, + "s1_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "ad35e91b07116706706d6f52081954ea633cdfff72e021dc50065fffe29f1ae6", + "route_weight_sha256": "e3fd6ea69c28b3e5020c89b0e21f1a7fccdf48d38bf4763bca47cf5329862ed0", + "loads": [ + 6, + 1, + 0, + 3, + 0, + 0, + 5, + 1, + 0, + 3, + 2, + 2, + 2, + 0, + 6, + 2, + 4, + 9, + 0, + 1, + 3, + 1, + 2, + 8, + 0, + 1, + 0, + 0, + 4, + 1, + 1, + 2, + 3, + 8, + 2, + 0, + 1, + 0, + 0, + 4, + 12, + 0, + 1, + 0, + 1, + 6, + 0, + 2, + 2, + 2, + 2, + 1, + 1, + 4, + 0, + 0, + 5, + 6, + 0, + 0, + 5, + 0, + 0, + 0 + ], + "weighted_loads": [ + 0.5224278829991817, + 0.03678615763783455, + 0.0, + 0.2464650571346283, + 0.0, + 0.0, + 0.3783046342432499, + 0.04890663921833038, + 0.0, + 0.19187846779823303, + 0.1336468905210495, + 0.08935287594795227, + 0.2298833280801773, + 0.0, + 0.35553568229079247, + 0.08294978365302086, + 0.40369080007076263, + 0.7483083680272102, + 0.0, + 0.042050302028656006, + 0.1868651695549488, + 0.03938407823443413, + 0.13688698038458824, + 0.5895975343883038, + 0.0, + 0.064014732837677, + 0.0, + 0.0, + 0.27784134820103645, + 0.037223901599645615, + 0.08869125694036484, + 0.2127728909254074, + 0.19821402430534363, + 0.4807611256837845, + 0.1222919449210167, + 0.0, + 0.14320021867752075, + 0.0, + 0.0, + 0.16474493965506554, + 0.875233493745327, + 0.0, + 0.037345483899116516, + 0.0, + 0.028833691030740738, + 0.4968501552939415, + 0.0, + 0.14809773862361908, + 0.12092523649334908, + 0.08621986582875252, + 0.3700215518474579, + 0.07438646256923676, + 0.02675703726708889, + 0.2031937763094902, + 0.0, + 0.0, + 0.33588433265686035, + 0.35093149170279503, + 0.0, + 0.0, + 0.2830283101648092, + 0.0, + 0.0, + 0.0 + ], + "unique_experts": 42, + "load_cv": 1.2027239265601517, + "normalized_load_entropy": 0.8351931504401942, + "max_load_share": 0.08695652173913043 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "5132374a5c3013f0b9003712776102978228a6d98832617b732122c5d88a9bcc", + "route_weight_sha256": "416bb2af902d21b04a56b070a776741c85bba507c42df4df6b8fb0cd61d2c4b2", + "loads": [ + 7, + 6, + 10, + 4, + 3, + 1, + 16, + 1, + 14, + 3, + 4, + 5, + 11, + 7, + 6, + 3, + 4, + 24, + 1, + 1, + 3, + 1, + 3, + 12, + 0, + 12, + 0, + 2, + 5, + 1, + 4, + 2, + 7, + 30, + 2, + 0, + 1, + 0, + 6, + 8, + 24, + 0, + 3, + 0, + 1, + 20, + 16, + 5, + 5, + 8, + 6, + 1, + 10, + 10, + 3, + 11, + 5, + 6, + 2, + 1, + 5, + 4, + 2, + 6 + ], + "weighted_loads": [ + 0.5606891326606274, + 0.3167526237666607, + 0.6192100457847118, + 0.30278871208429337, + 0.15261934325098991, + 0.04429738596081734, + 1.323097039014101, + 0.04890663921833038, + 0.9583107177168131, + 0.19187846779823303, + 0.22030270844697952, + 0.20357479620724916, + 0.7668654322624207, + 0.48758576437830925, + 0.35553568229079247, + 0.12316606938838959, + 0.40369080007076263, + 1.7895713485777378, + 0.04674004390835762, + 0.042050302028656006, + 0.1868651695549488, + 0.03938407823443413, + 0.1768207997083664, + 0.7787928953766823, + 0.0, + 1.1791075617074966, + 0.0, + 0.1210886500775814, + 0.31903399154543877, + 0.037223901599645615, + 0.20958542823791504, + 0.2127728909254074, + 0.343299463391304, + 2.164919286966324, + 0.1222919449210167, + 0.0, + 0.14320021867752075, + 0.0, + 0.3952206000685692, + 0.3234665608033538, + 1.4909141026437283, + 0.0, + 0.20564430207014084, + 0.0, + 0.028833691030740738, + 1.8141625858843327, + 1.1431512981653214, + 0.25278632901608944, + 0.43664250895380974, + 0.43676596507430077, + 0.58890201151371, + 0.07438646256923676, + 0.551976041868329, + 0.8737479150295258, + 0.6705326829105616, + 0.6761207990348339, + 0.33588433265686035, + 0.35093149170279503, + 0.0991663970053196, + 0.03345979005098343, + 0.2830283101648092, + 0.18764207512140274, + 0.09988690540194511, + 0.3430963531136513 + ], + "unique_experts": 58, + "load_cv": 1.0416666666666667, + "normalized_load_entropy": 0.8883852232389816, + "max_load_share": 0.078125 + } + }, + "s0_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "02e78aa3bfbdb49ea30d9ac1ac59d97c381201311704bef19f145b00a30a04c5", + "route_weight_sha256": "fc7b6e8ad660476cbb16e3b598cb9b8912f356c79c68cd4c3495ca5e9f15ac14", + "loads": [ + 6, + 1, + 0, + 3, + 0, + 0, + 5, + 0, + 0, + 3, + 2, + 4, + 2, + 0, + 6, + 2, + 4, + 7, + 0, + 1, + 2, + 1, + 2, + 8, + 0, + 1, + 0, + 0, + 5, + 1, + 1, + 2, + 3, + 10, + 2, + 0, + 1, + 0, + 0, + 3, + 12, + 0, + 1, + 0, + 1, + 6, + 0, + 3, + 1, + 2, + 2, + 1, + 0, + 3, + 0, + 0, + 6, + 7, + 0, + 0, + 5, + 0, + 0, + 0 + ], + "weighted_loads": [ + 0.5264531336724758, + 0.04060838744044304, + 0.0, + 0.24986478686332703, + 0.0, + 0.0, + 0.36695750802755356, + 0.0, + 0.0, + 0.16096025705337524, + 0.13792210072278976, + 0.20119665190577507, + 0.20750818401575089, + 0.0, + 0.3834356665611267, + 0.08601844310760498, + 0.35729094222187996, + 0.6035177931189537, + 0.0, + 0.04165276139974594, + 0.12825028970837593, + 0.03987652435898781, + 0.134831041097641, + 0.573208887130022, + 0.0, + 0.07305029034614563, + 0.0, + 0.0, + 0.3062480464577675, + 0.03799929469823837, + 0.08154088258743286, + 0.21005959063768387, + 0.19517222978174686, + 0.6431649401783943, + 0.12931644544005394, + 0.0, + 0.13682357966899872, + 0.0, + 0.0, + 0.13386797904968262, + 0.9191317111253738, + 0.0, + 0.03877927362918854, + 0.0, + 0.030881568789482117, + 0.5128479171544313, + 0.0, + 0.18061235919594765, + 0.07903335243463516, + 0.07589509710669518, + 0.3742436096072197, + 0.07769081741571426, + 0.0, + 0.15370876342058182, + 0.0, + 0.0, + 0.35725705511868, + 0.3851594030857086, + 0.0, + 0.0, + 0.26855022460222244, + 0.0, + 0.0, + 0.0 + ], + "unique_experts": 40, + "load_cv": 1.2439308659084878, + "normalized_load_entropy": 0.8237164598012734, + "max_load_share": 0.08695652173913043 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "bae094f925ddf27a87e7efc0185daaef64a888ff272c8ebe8db93999d3aaa14f", + "route_weight_sha256": "c79309deaa349e87a85c137ab657c496eec001d735b2de341f63f57e57c23c61", + "loads": [ + 6, + 8, + 2, + 5, + 2, + 0, + 11, + 1, + 10, + 3, + 2, + 7, + 8, + 8, + 6, + 2, + 4, + 10, + 0, + 1, + 2, + 1, + 4, + 8, + 0, + 14, + 0, + 0, + 5, + 1, + 3, + 2, + 9, + 23, + 2, + 0, + 1, + 0, + 0, + 8, + 17, + 0, + 1, + 0, + 1, + 12, + 8, + 6, + 2, + 6, + 6, + 1, + 11, + 3, + 2, + 8, + 6, + 7, + 3, + 0, + 5, + 0, + 1, + 3 + ], + "weighted_loads": [ + 0.5264531336724758, + 0.4644565563648939, + 0.05375683307647705, + 0.34265679493546486, + 0.12004272639751434, + 0.0, + 0.8448177762329578, + 0.0455685518682003, + 0.7341519854962826, + 0.16096025705337524, + 0.13792210072278976, + 0.2927088802680373, + 0.5436730720102787, + 0.6081622429192066, + 0.3834356665611267, + 0.08601844310760498, + 0.35729094222187996, + 0.7443787008523941, + 0.0, + 0.04165276139974594, + 0.12825028970837593, + 0.03987652435898781, + 0.2084721475839615, + 0.573208887130022, + 0.0, + 0.9900699369609356, + 0.0, + 0.0, + 0.3062480464577675, + 0.03799929469823837, + 0.15007144585251808, + 0.21005959063768387, + 0.47355795092880726, + 1.6861923020333052, + 0.12931644544005394, + 0.0, + 0.13682357966899872, + 0.0, + 0.0, + 0.32443716283887625, + 1.2165552526712418, + 0.0, + 0.03877927362918854, + 0.0, + 0.030881568789482117, + 1.1194096747785807, + 0.7409939952194691, + 0.2948360200971365, + 0.11811269447207451, + 0.2636040858924389, + 0.5982799306511879, + 0.07769081741571426, + 0.6586386822164059, + 0.15370876342058182, + 0.6249288432300091, + 0.4388602878898382, + 0.35725705511868, + 0.3851594030857086, + 0.11327467858791351, + 0.0, + 0.26855022460222244, + 0.0, + 0.046664755791425705, + 0.20614778995513916 + ], + "unique_experts": 52, + "load_cv": 1.0183501544346312, + "normalized_load_entropy": 0.8790779674871032, + "max_load_share": 0.0798611111111111 + } + }, + "s1_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "70c6db771396a8aed177e625882e17a8170542c46f81a1bf5e5be6ed3621526a", + "route_weight_sha256": "439f1763096409eb90847c109f91726458ad05cfb3a687b0b58b1e0f03ea3b5b", + "loads": [ + 6, + 1, + 0, + 3, + 0, + 0, + 5, + 0, + 0, + 3, + 2, + 5, + 2, + 0, + 6, + 2, + 3, + 9, + 0, + 1, + 2, + 1, + 2, + 8, + 0, + 1, + 0, + 0, + 5, + 1, + 1, + 2, + 2, + 9, + 2, + 0, + 1, + 0, + 0, + 4, + 12, + 0, + 1, + 0, + 1, + 6, + 0, + 2, + 1, + 3, + 2, + 1, + 0, + 4, + 0, + 0, + 5, + 6, + 0, + 0, + 5, + 0, + 0, + 0 + ], + "weighted_loads": [ + 0.5208868980407715, + 0.043104931712150574, + 0.0, + 0.24501612037420273, + 0.0, + 0.0, + 0.370401743799448, + 0.0, + 0.0, + 0.18554700538516045, + 0.13539239391684532, + 0.2297171615064144, + 0.23282760381698608, + 0.0, + 0.3707842715084553, + 0.08272035419940948, + 0.3474964275956154, + 0.7249585427343845, + 0.0, + 0.04375917464494705, + 0.12528524920344353, + 0.04156181961297989, + 0.14000937342643738, + 0.5748347081243992, + 0.0, + 0.0654398575425148, + 0.0, + 0.0, + 0.309061910957098, + 0.038364510983228683, + 0.08086755126714706, + 0.2120506465435028, + 0.13607994467020035, + 0.5740414820611477, + 0.12608002871274948, + 0.0, + 0.14611025154590607, + 0.0, + 0.0, + 0.16755452379584312, + 0.8933081701397896, + 0.0, + 0.03760175406932831, + 0.0, + 0.029573269188404083, + 0.5025668665766716, + 0.0, + 0.1320960782468319, + 0.07419628649950027, + 0.13249091990292072, + 0.3932945653796196, + 0.07787658274173737, + 0.0, + 0.19721175357699394, + 0.0, + 0.0, + 0.3210124410688877, + 0.34630801156163216, + 0.0, + 0.0, + 0.273776413872838, + 0.0, + 0.0, + 0.0 + ], + "unique_experts": 40, + "load_cv": 1.2439308659084878, + "normalized_load_entropy": 0.8234194717423021, + "max_load_share": 0.08695652173913043 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "fd1088c506b06815f8fe2c161a0355c236759d2d4ffac7aec8a16ed2217001a5", + "route_weight_sha256": "bce2ee4c1d8c0be282b95460b3b614331d498cf0a1c3b9b4ca1748b5eea7400b", + "loads": [ + 7, + 7, + 11, + 4, + 2, + 1, + 18, + 0, + 15, + 3, + 5, + 9, + 11, + 9, + 6, + 2, + 3, + 23, + 1, + 1, + 2, + 1, + 3, + 12, + 0, + 15, + 0, + 2, + 6, + 1, + 3, + 2, + 7, + 28, + 2, + 0, + 1, + 0, + 6, + 7, + 23, + 0, + 3, + 0, + 1, + 19, + 15, + 5, + 4, + 9, + 7, + 1, + 9, + 10, + 2, + 10, + 5, + 6, + 2, + 1, + 5, + 4, + 2, + 5 + ], + "weighted_loads": [ + 0.5591481477022171, + 0.3673660606145859, + 0.6564156301319599, + 0.3013397753238678, + 0.10239305719733238, + 0.04429738596081734, + 1.4115065857768059, + 0.0, + 0.995559012517333, + 0.18554700538516045, + 0.27316704764962196, + 0.382466041482985, + 0.7698097079992294, + 0.6252490356564522, + 0.3707842715084553, + 0.08272035419940948, + 0.3474964275956154, + 1.7224470227956772, + 0.04674004390835762, + 0.04375917464494705, + 0.12528524920344353, + 0.04156181961297989, + 0.17994319275021553, + 0.7640300691127777, + 0.0, + 1.3868903666734695, + 0.0, + 0.1210886500775814, + 0.3502545543015003, + 0.038364510983228683, + 0.1448749378323555, + 0.2120506465435028, + 0.32308612391352654, + 1.8960798121988773, + 0.12608002871274948, + 0.0, + 0.14611025154590607, + 0.0, + 0.3952206000685692, + 0.2695591328665614, + 1.4072558470070362, + 0.0, + 0.20590057224035263, + 0.0, + 0.029573269188404083, + 1.6795458048582077, + 1.0788621418178082, + 0.23678466863930225, + 0.38991355895996094, + 0.49724057130515575, + 0.6848383471369743, + 0.07787658274173737, + 0.5252190046012402, + 0.8677658922970295, + 0.6248455662280321, + 0.5937636978924274, + 0.3210124410688877, + 0.34630801156163216, + 0.0991663970053196, + 0.03345979005098343, + 0.273776413872838, + 0.18764207512140274, + 0.09988690540194511, + 0.29106850922107697 + ], + "unique_experts": 57, + "load_cv": 1.033299730636437, + "normalized_load_entropy": 0.8847892331407314, + "max_load_share": 0.07291666666666667 + } + }, + "s0_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "88f094aecb000c19a15fd16e3b300982e4621fe38f8f3d4d1767e18d3033480b", + "route_weight_sha256": "32be382e1f8ecffad881da7aff7d6e19bd9d6aa46af3457a53d7045d53c2d3dd", + "loads": [ + 6, + 1, + 0, + 3, + 0, + 1, + 5, + 0, + 0, + 3, + 2, + 4, + 2, + 0, + 6, + 2, + 4, + 9, + 0, + 1, + 2, + 1, + 2, + 8, + 0, + 1, + 0, + 0, + 4, + 1, + 1, + 2, + 2, + 10, + 2, + 0, + 1, + 0, + 0, + 2, + 12, + 0, + 1, + 0, + 1, + 6, + 0, + 3, + 2, + 2, + 2, + 2, + 0, + 3, + 0, + 0, + 6, + 6, + 0, + 0, + 4, + 0, + 0, + 0 + ], + "weighted_loads": [ + 0.5254305936396122, + 0.040192823857069016, + 0.0, + 0.25481153279542923, + 0.0, + 0.03908928856253624, + 0.37234627455472946, + 0.0, + 0.0, + 0.16189256310462952, + 0.1382507085800171, + 0.1967162936925888, + 0.19991739839315414, + 0.0, + 0.36970288679003716, + 0.0836433470249176, + 0.35758019611239433, + 0.6859230659902096, + 0.0, + 0.04211615398526192, + 0.12939203158020973, + 0.03961000218987465, + 0.13758958876132965, + 0.5784936361014843, + 0.0, + 0.07850387692451477, + 0.0, + 0.0, + 0.2754754275083542, + 0.03893139213323593, + 0.0804397389292717, + 0.21377907693386078, + 0.1357041522860527, + 0.623352836817503, + 0.12716349959373474, + 0.0, + 0.14097650349140167, + 0.0, + 0.0, + 0.08804501220583916, + 0.9185555130243301, + 0.0, + 0.039370279759168625, + 0.0, + 0.02916903607547283, + 0.5103143900632858, + 0.0, + 0.18537405505776405, + 0.12194573879241943, + 0.07473303005099297, + 0.36523668467998505, + 0.12288788333535194, + 0.0, + 0.15348975732922554, + 0.0, + 0.0, + 0.35896043851971626, + 0.34184230118989944, + 0.0, + 0.0, + 0.22710400819778442, + 0.0, + 0.0, + 0.0 + ], + "unique_experts": 41, + "load_cv": 1.2412262977061042, + "normalized_load_entropy": 0.828538832802118, + "max_load_share": 0.08695652173913043 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "636e92e49b91d3127a022b43a14da81f9bc58ddc97a347075a7cd05b428a105d", + "route_weight_sha256": "84f88540f84f0ae7d2e9bfb84a0ae8bc30b2b98fed164640b85a922d9206c2ad", + "loads": [ + 6, + 7, + 1, + 5, + 2, + 1, + 13, + 1, + 10, + 3, + 2, + 8, + 8, + 8, + 6, + 2, + 4, + 12, + 0, + 1, + 2, + 1, + 4, + 8, + 0, + 14, + 0, + 0, + 4, + 1, + 3, + 2, + 7, + 23, + 2, + 0, + 1, + 0, + 0, + 7, + 16, + 0, + 1, + 0, + 1, + 12, + 9, + 6, + 3, + 6, + 5, + 2, + 11, + 3, + 2, + 8, + 6, + 6, + 3, + 0, + 4, + 0, + 1, + 4 + ], + "weighted_loads": [ + 0.5254305936396122, + 0.41108869947493076, + 0.012179519981145859, + 0.3459056206047535, + 0.12108515202999115, + 0.03908928856253624, + 1.0157084092497826, + 0.0455685518682003, + 0.7945328205823898, + 0.16189256310462952, + 0.1382507085800171, + 0.3363393237814307, + 0.536082286387682, + 0.5671498738229275, + 0.36970288679003716, + 0.0836433470249176, + 0.35758019611239433, + 0.8166135810315609, + 0.0, + 0.04211615398526192, + 0.12939203158020973, + 0.03961000218987465, + 0.21123069524765015, + 0.5784936361014843, + 0.0, + 0.9962873868644238, + 0.0, + 0.0, + 0.2754754275083542, + 0.03893139213323593, + 0.15031147003173828, + 0.21377907693386078, + 0.380426611751318, + 1.6719672661274672, + 0.12716349959373474, + 0.0, + 0.14097650349140167, + 0.0, + 0.0, + 0.27857379149645567, + 1.163781899958849, + 0.0, + 0.039370279759168625, + 0.0, + 0.02916903607547283, + 1.109445758163929, + 0.8009966760873795, + 0.2995977159589529, + 0.16102508082985878, + 0.2472376637160778, + 0.5351550467312336, + 0.12288788333535194, + 0.6586386822164059, + 0.15348975732922554, + 0.6249288432300091, + 0.4367701839655638, + 0.35896043851971626, + 0.34184230118989944, + 0.11327467858791351, + 0.0, + 0.22710400819778442, + 0.0, + 0.046664755791425705, + 0.32997310161590576 + ], + "unique_experts": 53, + "load_cv": 1.0183501544346312, + "normalized_load_entropy": 0.8811571264747683, + "max_load_share": 0.0798611111111111 + } + }, + "s1_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "a2f12e8db85cddae6f3beb1d70ea6660737e2b826f797dd1696dad3cd7e9aa0d", + "route_weight_sha256": "001ca7d956d0539fbf7d4b5dfed5b8bb1d99919e1f18c2dafd7a371836b7c022", + "loads": [ + 6, + 1, + 0, + 3, + 0, + 0, + 5, + 1, + 0, + 3, + 2, + 3, + 2, + 0, + 7, + 2, + 4, + 9, + 0, + 1, + 2, + 1, + 2, + 8, + 0, + 1, + 0, + 0, + 3, + 1, + 1, + 2, + 2, + 9, + 2, + 0, + 1, + 0, + 0, + 4, + 12, + 0, + 1, + 0, + 1, + 6, + 0, + 2, + 2, + 3, + 2, + 1, + 0, + 4, + 0, + 0, + 5, + 6, + 0, + 0, + 5, + 0, + 0, + 0 + ], + "weighted_loads": [ + 0.5136671923100948, + 0.0411931648850441, + 0.0, + 0.2478880137205124, + 0.0, + 0.0, + 0.3675738573074341, + 0.04586451128125191, + 0.0, + 0.18474452570080757, + 0.13719427958130836, + 0.13811448961496353, + 0.218681201338768, + 0.0, + 0.3924876768141985, + 0.08387944474816322, + 0.3922086991369724, + 0.7085636779665947, + 0.0, + 0.044944290071725845, + 0.12739665806293488, + 0.041375402361154556, + 0.14321839064359665, + 0.5829534009099007, + 0.0, + 0.06534667313098907, + 0.0, + 0.0, + 0.22579250857234, + 0.03970448300242424, + 0.08114738762378693, + 0.22311876714229584, + 0.13437765650451183, + 0.5609300248324871, + 0.1252746693789959, + 0.0, + 0.14697931706905365, + 0.0, + 0.0, + 0.17054344341158867, + 0.8764967173337936, + 0.0, + 0.03844640031456947, + 0.0, + 0.02974218688905239, + 0.5009328480809927, + 0.0, + 0.13549909368157387, + 0.12508675083518028, + 0.13425161130726337, + 0.386915847659111, + 0.0790778174996376, + 0.0, + 0.20006030425429344, + 0.0, + 0.0, + 0.3362005539238453, + 0.3474353775382042, + 0.0, + 0.0, + 0.27120456099510193, + 0.0, + 0.0, + 0.0 + ], + "unique_experts": 41, + "load_cv": 1.2330770012409151, + "normalized_load_entropy": 0.8286401045884784, + "max_load_share": 0.08695652173913043 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "a40101b1a3e2b78f98978dd2118ee59fc470e0bdb5bd02071c39a6753df6679d", + "route_weight_sha256": "315c2aaf274869a209041545d03b5c4540b9673cdb57eafcfa98dd30c397271a", + "loads": [ + 7, + 6, + 10, + 5, + 2, + 1, + 19, + 1, + 14, + 3, + 5, + 6, + 11, + 7, + 7, + 2, + 4, + 24, + 1, + 1, + 2, + 1, + 3, + 12, + 0, + 15, + 0, + 2, + 4, + 1, + 3, + 2, + 6, + 28, + 2, + 0, + 1, + 0, + 6, + 7, + 23, + 0, + 3, + 0, + 1, + 18, + 17, + 5, + 5, + 11, + 6, + 1, + 9, + 10, + 2, + 11, + 5, + 6, + 2, + 1, + 5, + 4, + 2, + 6 + ], + "weighted_loads": [ + 0.5519284419715405, + 0.32115963101387024, + 0.6192100457847118, + 0.34162963554263115, + 0.10686277225613594, + 0.04429738596081734, + 1.5418140068650246, + 0.04586451128125191, + 0.98306336812675, + 0.18474452570080757, + 0.27455512061715126, + 0.2523364098742604, + 0.7556633055210114, + 0.49498436227440834, + 0.3924876768141985, + 0.08387944474816322, + 0.3922086991369724, + 1.752142459154129, + 0.04674004390835762, + 0.044944290071725845, + 0.12739665806293488, + 0.041375402361154556, + 0.1831522099673748, + 0.7721487618982792, + 0.0, + 1.3592110387980938, + 0.0, + 0.1210886500775814, + 0.2669851519167423, + 0.03970448300242424, + 0.14589540287852287, + 0.22311876714229584, + 0.2794630955904722, + 1.8667147383093834, + 0.1252746693789959, + 0.0, + 0.14697931706905365, + 0.0, + 0.3952206000685692, + 0.2726411623880267, + 1.3857998326420784, + 0.0, + 0.2067452184855938, + 0.0, + 0.02974218688905239, + 1.632600912824273, + 1.230624832212925, + 0.24018768407404423, + 0.44080402329564095, + 0.5980573538690805, + 0.6057963073253632, + 0.0790778174996376, + 0.5252190046012402, + 0.870614442974329, + 0.6248455662280321, + 0.6460477374494076, + 0.3362005539238453, + 0.3474353775382042, + 0.0991663970053196, + 0.03345979005098343, + 0.27120456099510193, + 0.18764207512140274, + 0.09988690540194511, + 0.36779823154211044 + ], + "unique_experts": 58, + "load_cv": 1.0408329997330663, + "normalized_load_entropy": 0.8857533561152445, + "max_load_share": 0.07291666666666667 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 18, + "mean_set_jaccard": 0.9378881987577641, + "mean_token_weighted_tv": 0.015297509527400784, + "aggregate_load_tv": 0.036231884057971016 + }, + "system_bos": { + "tokens": 23, + "ordered_topk_exact_tokens": 16, + "set_exact_tokens": 20, + "mean_set_jaccard": 0.9534161490683231, + "mean_token_weighted_tv": 0.017446371686199436, + "aggregate_load_tv": 0.02173913043478261 + }, + "system_x": { + "tokens": 23, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.9006211180124224, + "mean_token_weighted_tv": 0.02687256325684164, + "aggregate_load_tv": 0.043478260869565216 + }, + "system_period": { + "tokens": 23, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.9006211180124224, + "mean_token_weighted_tv": 0.02528906613588333, + "aggregate_load_tv": 0.050724637681159424 + }, + "bos_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.9130434782608695, + "mean_token_weighted_tv": 0.0243982641917208, + "aggregate_load_tv": 0.03623188405797101 + }, + "bos_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 20, + "mean_set_jaccard": 0.9627329192546585, + "mean_token_weighted_tv": 0.0185674046287718, + "aggregate_load_tv": 0.021739130434782608 + }, + "x_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8881987577639753, + "mean_token_weighted_tv": 0.030053449025296646, + "aggregate_load_tv": 0.05797101449275363 + }, + "x_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.9130434782608697, + "mean_token_weighted_tv": 0.028096543260566566, + "aggregate_load_tv": 0.05072463768115942 + }, + "period_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8788819875776398, + "mean_token_weighted_tv": 0.03148794259228136, + "aggregate_load_tv": 0.06521739130434782 + }, + "period_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.9254658385093167, + "mean_token_weighted_tv": 0.024951582126643345, + "aggregate_load_tv": 0.036231884057971016 + } + } + }, + "layer_09": { + "layer": 9, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "b74485945a4e48ecb45e126d987d4a912499d9cdd4ab51f6da2641490eb7c0d5", + "route_weight_sha256": "60ea1561b887a79fac8d7c7fdbc99c6a90106683db1333c6f17aba429a3e6347", + "loads": [ + 8, + 1, + 2, + 0, + 2, + 1, + 0, + 3, + 0, + 5, + 0, + 0, + 1, + 2, + 4, + 3, + 0, + 5, + 1, + 1, + 3, + 0, + 5, + 4, + 2, + 4, + 0, + 0, + 1, + 3, + 4, + 4, + 0, + 1, + 4, + 2, + 0, + 2, + 4, + 0, + 0, + 5, + 0, + 3, + 0, + 0, + 4, + 1, + 3, + 7, + 1, + 1, + 3, + 0, + 2, + 0, + 1, + 1, + 4, + 2, + 5, + 3, + 3, + 7 + ], + "weighted_loads": [ + 0.44661999493837357, + 0.05400269106030464, + 0.1521565467119217, + 0.0, + 0.08823882415890694, + 0.03719838336110115, + 0.0, + 0.21757852658629417, + 0.0, + 0.3119726926088333, + 0.0, + 0.0, + 0.1279800534248352, + 0.09023180603981018, + 0.21858450770378113, + 0.1531846821308136, + 0.0, + 0.3256447855383158, + 0.07619214802980423, + 0.04345664009451866, + 0.17671415209770203, + 0.0, + 0.4044369272887707, + 0.2557227574288845, + 0.10853366926312447, + 0.1638510376214981, + 0.0, + 0.0, + 0.034650515764951706, + 0.1604936383664608, + 0.1650959476828575, + 0.22052041068673134, + 0.0, + 0.06295692175626755, + 0.3027167581021786, + 0.182720348238945, + 0.0, + 0.12371083721518517, + 0.1658274345099926, + 0.0, + 0.0, + 0.3500644341111183, + 0.0, + 0.14389076828956604, + 0.0, + 0.0, + 0.3272106200456619, + 0.06009869650006294, + 0.2301996573805809, + 0.6165758222341537, + 0.04003201052546501, + 0.06988010555505753, + 0.17415058240294456, + 0.0, + 0.1430361047387123, + 0.0, + 0.06600658595561981, + 0.06337247788906097, + 0.29615433514118195, + 0.09868792071938515, + 0.38563548400998116, + 0.36605338752269745, + 0.13553934544324875, + 0.38309982419013977 + ], + "unique_experts": 46, + "load_cv": 0.9319415313491465, + "normalized_load_entropy": 0.8802309374817944, + "max_load_share": 0.057971014492753624 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "6e3d66062bd1739d0db34a04592b536c0030f7acc5ad6c35adba6cde2fa9ac4a", + "route_weight_sha256": "7274c9359c8e753e16a5027917c8e4dffbabb2bb67ce794b1836b7915c94cb86", + "loads": [ + 14, + 2, + 2, + 0, + 4, + 1, + 0, + 3, + 2, + 5, + 11, + 0, + 4, + 7, + 4, + 3, + 1, + 6, + 1, + 13, + 3, + 0, + 10, + 7, + 5, + 5, + 0, + 1, + 1, + 3, + 5, + 10, + 2, + 1, + 13, + 9, + 0, + 2, + 6, + 0, + 0, + 15, + 0, + 3, + 4, + 9, + 16, + 1, + 5, + 7, + 6, + 2, + 3, + 4, + 2, + 5, + 6, + 1, + 6, + 6, + 5, + 3, + 5, + 8 + ], + "weighted_loads": [ + 0.8849833346903324, + 0.0891917385160923, + 0.1521565467119217, + 0.0, + 0.36578861251473427, + 0.03719838336110115, + 0.0, + 0.21757852658629417, + 0.09559556469321251, + 0.3119726926088333, + 1.1778415739536285, + 0.0, + 0.18090641172602773, + 0.24180708988569677, + 0.21858450770378113, + 0.1531846821308136, + 0.04060012102127075, + 0.36820332892239094, + 0.07619214802980423, + 1.2499828860163689, + 0.17671415209770203, + 0.0, + 2.010712329298258, + 0.4751981571316719, + 0.23815976455807686, + 0.24037817865610123, + 0.0, + 0.012919825501739979, + 0.034650515764951706, + 0.1604936383664608, + 0.205084890127182, + 0.41131171747110784, + 0.03771728486754, + 0.06295692175626755, + 0.7990712150931358, + 0.6529985703527927, + 0.0, + 0.12371083721518517, + 0.2502025328576565, + 0.0, + 0.0, + 1.4139723144471645, + 0.0, + 0.14389076828956604, + 0.2627352518029511, + 0.7361210696399212, + 1.351214088499546, + 0.06009869650006294, + 0.35659612342715263, + 0.6165758222341537, + 0.34416555240750313, + 0.1035240925848484, + 0.17415058240294456, + 0.15391281247138977, + 0.1430361047387123, + 0.31354933232069016, + 0.3075290508568287, + 0.06337247788906097, + 0.41108347102999687, + 0.27373285591602325, + 0.38563548400998116, + 0.36605338752269745, + 0.19180780835449696, + 0.41932235285639763 + ], + "unique_experts": 55, + "load_cv": 0.8819171036881969, + "normalized_load_entropy": 0.9045690049029248, + "max_load_share": 0.05555555555555555 + } + }, + "s1_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "489db60069fd216af7123a10c1f31a9063491fb2855dbd7e99b111636ded6234", + "route_weight_sha256": "3db668108c4cdcc834c3a2d3b4187858a7c05d3e4152e939d308b999b5010a69", + "loads": [ + 7, + 1, + 2, + 0, + 2, + 1, + 0, + 2, + 1, + 5, + 0, + 0, + 1, + 2, + 4, + 3, + 0, + 5, + 1, + 1, + 4, + 0, + 5, + 4, + 2, + 4, + 0, + 0, + 1, + 3, + 4, + 4, + 0, + 1, + 4, + 2, + 0, + 2, + 4, + 0, + 0, + 5, + 0, + 3, + 0, + 0, + 4, + 1, + 3, + 8, + 0, + 1, + 3, + 0, + 2, + 0, + 1, + 1, + 4, + 2, + 5, + 3, + 3, + 7 + ], + "weighted_loads": [ + 0.3992736339569092, + 0.05500217154622078, + 0.15466749668121338, + 0.0, + 0.08595551922917366, + 0.037041258066892624, + 0.0, + 0.1788177490234375, + 0.04032663628458977, + 0.31018276140093803, + 0.0, + 0.0, + 0.13424339890480042, + 0.08943051099777222, + 0.22358769178390503, + 0.15365083888173103, + 0.0, + 0.31227276660501957, + 0.07741017639636993, + 0.039888568222522736, + 0.21259202435612679, + 0.0, + 0.39423857629299164, + 0.23420609161257744, + 0.10628930851817131, + 0.1603512540459633, + 0.0, + 0.0, + 0.03419109433889389, + 0.1628262735903263, + 0.16729774698615074, + 0.22032082453370094, + 0.0, + 0.062279168516397476, + 0.2965143620967865, + 0.17818591743707657, + 0.0, + 0.12360501289367676, + 0.176161028444767, + 0.0, + 0.0, + 0.3485097587108612, + 0.0, + 0.14805321022868156, + 0.0, + 0.0, + 0.3075905404984951, + 0.06440137326717377, + 0.23066087067127228, + 0.6416212804615498, + 0.0, + 0.07202062010765076, + 0.17031460627913475, + 0.0, + 0.14236335083842278, + 0.0, + 0.06367030739784241, + 0.0620400533080101, + 0.29531690292060375, + 0.10944205150008202, + 0.39306655153632164, + 0.3845517449080944, + 0.1316840723156929, + 0.3830741457641125 + ], + "unique_experts": 46, + "load_cv": 0.9355406431021744, + "normalized_load_entropy": 0.879638878308276, + "max_load_share": 0.057971014492753624 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "ab73ee35be3549b3007c2acf2147e5d1de568d6bcae29d83f01018a02e5061e1", + "route_weight_sha256": "7e3cac341e66f3fe5fbd1889511210d607b8426d57fafe52b495e7c950799408", + "loads": [ + 17, + 3, + 2, + 0, + 4, + 1, + 0, + 2, + 8, + 7, + 11, + 2, + 4, + 6, + 5, + 3, + 1, + 7, + 1, + 13, + 4, + 3, + 10, + 15, + 7, + 12, + 4, + 1, + 7, + 3, + 6, + 9, + 2, + 4, + 10, + 15, + 0, + 5, + 8, + 1, + 6, + 20, + 2, + 3, + 5, + 14, + 25, + 1, + 9, + 13, + 3, + 2, + 3, + 3, + 3, + 5, + 6, + 1, + 9, + 6, + 5, + 4, + 5, + 8 + ], + "weighted_loads": [ + 1.072446208447218, + 0.14197521656751633, + 0.15466749668121338, + 0.0, + 0.3816375322639942, + 0.037041258066892624, + 0.0, + 0.1788177490234375, + 0.46018557250499725, + 0.4006766006350517, + 1.0836709775030613, + 0.09574616327881813, + 0.18827378749847412, + 0.1818832065910101, + 0.2622978463768959, + 0.15365083888173103, + 0.04606104642152786, + 0.40388929285109043, + 0.07741017639636993, + 1.3073091506958008, + 0.21259202435612679, + 0.1271832250058651, + 1.9958832133561373, + 1.0504701845347881, + 0.2980772517621517, + 0.5946533959358931, + 0.25512557476758957, + 0.012919825501739979, + 0.456768948584795, + 0.1628262735903263, + 0.3066982552409172, + 0.36990518076345325, + 0.04198480653576553, + 0.28500108793377876, + 0.5976457167416811, + 1.0077180080115795, + 0.0, + 0.26522404327988625, + 0.3731721118092537, + 0.06790740042924881, + 0.4007585123181343, + 1.9463557004928589, + 0.09233702719211578, + 0.14805321022868156, + 0.18526988569647074, + 1.1858100332319736, + 2.156991735100746, + 0.06440137326717377, + 0.5956041030585766, + 0.9714081287384033, + 0.21150577813386917, + 0.10454036295413971, + 0.17031460627913475, + 0.1489270143210888, + 0.1840420849621296, + 0.2961429227143526, + 0.2994065508246422, + 0.0620400533080101, + 0.566583501175046, + 0.28798922896385193, + 0.39306655153632164, + 0.42288030683994293, + 0.2892565615475178, + 0.4191613420844078 + ], + "unique_experts": 61, + "load_cv": 0.840593375076334, + "normalized_load_entropy": 0.9219514617747955, + "max_load_share": 0.06510416666666667 + } + }, + "s0_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "eecd326befab492a56013bb9d6dd7804e344055ddcc56d90f6f98841ff747dd9", + "route_weight_sha256": "7479aba5deda6626cbd242b446a483fbf532a4ee1838fa9c0cb2a6e68de9de08", + "loads": [ + 8, + 1, + 2, + 0, + 2, + 1, + 1, + 3, + 0, + 5, + 0, + 0, + 1, + 6, + 3, + 2, + 0, + 5, + 1, + 1, + 4, + 0, + 6, + 4, + 2, + 2, + 0, + 0, + 1, + 2, + 2, + 4, + 0, + 1, + 4, + 2, + 0, + 2, + 4, + 0, + 0, + 5, + 0, + 3, + 0, + 1, + 4, + 1, + 3, + 9, + 0, + 1, + 3, + 0, + 2, + 0, + 1, + 1, + 4, + 1, + 4, + 3, + 3, + 7 + ], + "weighted_loads": [ + 0.47514980658888817, + 0.05341866612434387, + 0.15970545634627342, + 0.0, + 0.08716131374239922, + 0.03621378168463707, + 0.03603830933570862, + 0.20365944132208824, + 0.0, + 0.309818759560585, + 0.0, + 0.0, + 0.12585265934467316, + 0.2345605343580246, + 0.1853066198527813, + 0.09931625053286552, + 0.0, + 0.3141576498746872, + 0.07289956510066986, + 0.042480140924453735, + 0.2133966162800789, + 0.0, + 0.4500904567539692, + 0.26232396997511387, + 0.10820065811276436, + 0.08539539575576782, + 0.0, + 0.0, + 0.03335311636328697, + 0.12898940593004227, + 0.08444683998823166, + 0.22204255685210228, + 0.0, + 0.061819467693567276, + 0.30455097183585167, + 0.18145068734884262, + 0.0, + 0.12476460263133049, + 0.17560036480426788, + 0.0, + 0.0, + 0.3361250273883343, + 0.0, + 0.15315517038106918, + 0.0, + 0.056390430778265, + 0.30405156686902046, + 0.05949658900499344, + 0.2329556569457054, + 0.6974800899624825, + 0.0, + 0.06586344540119171, + 0.16229459270834923, + 0.0, + 0.13957322388887405, + 0.0, + 0.06253287196159363, + 0.06279050558805466, + 0.29915541410446167, + 0.06544943898916245, + 0.3457947447896004, + 0.3794283829629421, + 0.12558912485837936, + 0.3757336363196373 + ], + "unique_experts": 47, + "load_cv": 0.9845476999581908, + "normalized_load_entropy": 0.876404446402047, + "max_load_share": 0.06521739130434782 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "a46fd9cdc7a55a6bddf64b3fd42fda73ca1a4e65511bc7de32ca91f2959ba13a", + "route_weight_sha256": "825d3e36afc54239dd3972d5eaa67b0a9a1964b6d04def74c08dce65ebd78b28", + "loads": [ + 15, + 1, + 2, + 0, + 5, + 1, + 1, + 3, + 2, + 5, + 11, + 0, + 3, + 10, + 3, + 2, + 1, + 11, + 1, + 13, + 4, + 0, + 10, + 6, + 5, + 3, + 0, + 1, + 1, + 2, + 3, + 9, + 0, + 1, + 13, + 9, + 0, + 2, + 5, + 1, + 0, + 15, + 0, + 3, + 4, + 10, + 16, + 1, + 5, + 9, + 6, + 2, + 3, + 4, + 2, + 5, + 6, + 1, + 6, + 5, + 4, + 3, + 5, + 8 + ], + "weighted_loads": [ + 0.9661553278565407, + 0.05341866612434387, + 0.15970545634627342, + 0.0, + 0.436339545994997, + 0.03621378168463707, + 0.03603830933570862, + 0.20365944132208824, + 0.09559556469321251, + 0.309818759560585, + 1.1778415739536285, + 0.0, + 0.17141803167760372, + 0.4057924058288336, + 0.1853066198527813, + 0.09931625053286552, + 0.04060012102127075, + 0.5643620938062668, + 0.07289956510066986, + 1.231544092297554, + 0.2133966162800789, + 0.0, + 1.137023288756609, + 0.48526895977556705, + 0.23782675340771675, + 0.16192253679037094, + 0.0, + 0.012919825501739979, + 0.03335311636328697, + 0.12898940593004227, + 0.12443578243255615, + 0.41011558566242456, + 0.0, + 0.061819467693567276, + 0.8009054288268089, + 0.62156817689538, + 0.0, + 0.12476460263133049, + 0.2190474569797516, + 0.044415827840566635, + 0.0, + 1.3622609451413155, + 0.0, + 0.15315517038106918, + 0.29361986834555864, + 0.8899481669068336, + 1.2966475151479244, + 0.05949658900499344, + 0.3549095652997494, + 0.6974800899624825, + 0.33894752338528633, + 0.09950743243098259, + 0.16229459270834923, + 0.16220525279641151, + 0.13957322388887405, + 0.3535693660378456, + 0.3040553368628025, + 0.06279050558805466, + 0.4131588824093342, + 0.24049437418580055, + 0.3457947447896004, + 0.3794283829629421, + 0.18185758776962757, + 0.41195616498589516 + ], + "unique_experts": 56, + "load_cv": 0.9279607271383371, + "normalized_load_entropy": 0.8976919054107455, + "max_load_share": 0.05555555555555555 + } + }, + "s1_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "7c62fae04483e59344369e05e862e78d65ea84086d0deaf9d3b34101e6c59296", + "route_weight_sha256": "6c1fc712588dcb6a7900daaf4ad4b46ab39b5f56b3237c2db3ddaa7791e61560", + "loads": [ + 8, + 0, + 2, + 0, + 1, + 1, + 0, + 3, + 1, + 5, + 0, + 0, + 1, + 0, + 4, + 3, + 0, + 5, + 1, + 1, + 4, + 0, + 5, + 4, + 2, + 2, + 0, + 0, + 1, + 2, + 4, + 5, + 0, + 1, + 4, + 2, + 0, + 2, + 6, + 0, + 0, + 5, + 0, + 3, + 0, + 1, + 4, + 1, + 3, + 9, + 0, + 1, + 3, + 0, + 2, + 0, + 1, + 1, + 4, + 2, + 5, + 3, + 3, + 7 + ], + "weighted_loads": [ + 0.4507269077003002, + 0.0, + 0.1601829156279564, + 0.0, + 0.04295419529080391, + 0.03618701547384262, + 0.0, + 0.21852216869592667, + 0.04635756462812424, + 0.31537170708179474, + 0.0, + 0.0, + 0.12108845263719559, + 0.0, + 0.2275337614119053, + 0.15891509503126144, + 0.0, + 0.3289996348321438, + 0.0741383284330368, + 0.04526801407337189, + 0.2242618128657341, + 0.0, + 0.39177774265408516, + 0.23498232662677765, + 0.10643735527992249, + 0.08665760233998299, + 0.0, + 0.0, + 0.03368343412876129, + 0.13297712430357933, + 0.16386109218001366, + 0.25607915222644806, + 0.0, + 0.06112208962440491, + 0.3074612133204937, + 0.18349474668502808, + 0.0, + 0.1273353137075901, + 0.2538953199982643, + 0.0, + 0.0, + 0.34523504227399826, + 0.0, + 0.15326398238539696, + 0.0, + 0.05790804326534271, + 0.2965613715350628, + 0.06883718073368073, + 0.23618552088737488, + 0.6990678869187832, + 0.0, + 0.07286064326763153, + 0.1678912304341793, + 0.0, + 0.14065536111593246, + 0.0, + 0.05812951922416687, + 0.06412822008132935, + 0.3010146878659725, + 0.10784892737865448, + 0.3899204395711422, + 0.3702194057404995, + 0.12181708589196205, + 0.3874364420771599 + ], + "unique_experts": 45, + "load_cv": 1.0081582776486193, + "normalized_load_entropy": 0.8675648975868494, + "max_load_share": 0.06521739130434782 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "238c488d77ee6e4eb533a6f361db4c0e5247b3f27ca544112e586d1eeaedaba7", + "route_weight_sha256": "d33137e8f0ddbfdf7e3364d67f93bfb06d306ac4c12937e685438dd7b512e398", + "loads": [ + 19, + 2, + 2, + 0, + 4, + 1, + 0, + 3, + 8, + 7, + 11, + 2, + 3, + 4, + 5, + 3, + 1, + 11, + 1, + 13, + 4, + 3, + 9, + 14, + 7, + 10, + 4, + 1, + 7, + 2, + 6, + 9, + 0, + 4, + 10, + 14, + 0, + 5, + 9, + 2, + 6, + 20, + 2, + 3, + 4, + 15, + 25, + 1, + 9, + 14, + 4, + 2, + 3, + 4, + 3, + 5, + 6, + 1, + 9, + 6, + 5, + 4, + 5, + 8 + ], + "weighted_loads": [ + 1.210143305361271, + 0.08697304502129555, + 0.1601829156279564, + 0.0, + 0.40275733917951584, + 0.03618701547384262, + 0.0, + 0.21852216869592667, + 0.4662165008485317, + 0.40586554631590843, + 1.0836709775030613, + 0.09574616327881813, + 0.16819713450968266, + 0.14572021178901196, + 0.26624391600489616, + 0.15891509503126144, + 0.04606104642152786, + 0.5993022136390209, + 0.0741383284330368, + 1.3260387927293777, + 0.2242618128657341, + 0.1271832250058651, + 1.0795431043952703, + 1.0167837589979172, + 0.2982252985239029, + 0.5209597442299128, + 0.25512557476758957, + 0.012919825501739979, + 0.4562612883746624, + 0.13297712430357933, + 0.3032616004347801, + 0.4028394119814038, + 0.0, + 0.2838440090417862, + 0.6085925679653883, + 0.9480407424271107, + 0.0, + 0.2689543440937996, + 0.4053461253643036, + 0.11741043999791145, + 0.4007585123181343, + 1.9340564385056496, + 0.09233702719211578, + 0.15326398238539696, + 0.1700090179219842, + 1.4006924144923687, + 2.147680699825287, + 0.06883718073368073, + 0.6013245768845081, + 1.0288547351956367, + 0.25314031913876534, + 0.10538038611412048, + 0.1678912304341793, + 0.18808336555957794, + 0.18233409523963928, + 0.3319091219455004, + 0.29386576265096664, + 0.06412822008132935, + 0.5700137279927731, + 0.2863961048424244, + 0.3899204395711422, + 0.408547967672348, + 0.2793895751237869, + 0.4235236383974552 + ], + "unique_experts": 60, + "load_cv": 0.8579691784155834, + "normalized_load_entropy": 0.9180743828309382, + "max_load_share": 0.06510416666666667 + } + }, + "s0_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "6380238324f3297654a03399c890c383cecdc0809c13b4a90aaf23f7bf225bc2", + "route_weight_sha256": "043bebfc85ebd8305341dd02e105aceae57bb4f4355b9d1e93eec200a68fb606", + "loads": [ + 10, + 1, + 2, + 0, + 1, + 1, + 1, + 3, + 0, + 5, + 0, + 0, + 1, + 4, + 4, + 3, + 0, + 5, + 1, + 1, + 4, + 0, + 5, + 4, + 3, + 3, + 0, + 0, + 1, + 2, + 2, + 4, + 0, + 1, + 3, + 3, + 0, + 2, + 3, + 0, + 0, + 5, + 0, + 3, + 0, + 0, + 4, + 1, + 3, + 8, + 1, + 1, + 3, + 0, + 2, + 0, + 1, + 1, + 4, + 1, + 5, + 3, + 2, + 7 + ], + "weighted_loads": [ + 0.5739356353878975, + 0.056124839931726456, + 0.16215284541249275, + 0.0, + 0.04135226085782051, + 0.03674207627773285, + 0.04431818425655365, + 0.1963220126926899, + 0.0, + 0.3036445565521717, + 0.0, + 0.0, + 0.11861445754766464, + 0.1505078300833702, + 0.2139868214726448, + 0.1456759087741375, + 0.0, + 0.3337785340845585, + 0.07112448662519455, + 0.04421402886509895, + 0.21531005948781967, + 0.0, + 0.3853765167295933, + 0.26787519454956055, + 0.15049124136567116, + 0.1319797895848751, + 0.0, + 0.0, + 0.03414424881339073, + 0.13367612659931183, + 0.08540232107043266, + 0.22877811640501022, + 0.0, + 0.06330200284719467, + 0.23050997778773308, + 0.22751305624842644, + 0.0, + 0.12949877604842186, + 0.1267608106136322, + 0.0, + 0.0, + 0.3344980590045452, + 0.0, + 0.138217531144619, + 0.0, + 0.0, + 0.32001984119415283, + 0.057232894003391266, + 0.23646101355552673, + 0.6513085290789604, + 0.03526928648352623, + 0.058566078543663025, + 0.16677911207079887, + 0.0, + 0.13986095786094666, + 0.0, + 0.0652269497513771, + 0.06007591262459755, + 0.2923168335109949, + 0.06281550973653793, + 0.38719575479626656, + 0.41751935705542564, + 0.08359004184603691, + 0.39172281697392464 + ], + "unique_experts": 47, + "load_cv": 0.9879551865016964, + "normalized_load_entropy": 0.8765140636909763, + "max_load_share": 0.07246376811594203 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "7c883850562bdf8c8ac92122663d010ea7c73eff24945f5864288aad5f2376cd", + "route_weight_sha256": "838748e2feb6edce98a355c5ea47a5835605a5e1c005baa22d65422984a7bd10", + "loads": [ + 18, + 1, + 2, + 0, + 3, + 1, + 1, + 3, + 2, + 5, + 12, + 0, + 3, + 8, + 4, + 3, + 2, + 9, + 1, + 12, + 4, + 0, + 9, + 6, + 6, + 6, + 0, + 1, + 1, + 2, + 3, + 9, + 0, + 1, + 13, + 9, + 0, + 2, + 6, + 0, + 0, + 15, + 0, + 3, + 4, + 8, + 16, + 1, + 5, + 8, + 6, + 2, + 3, + 2, + 2, + 5, + 6, + 1, + 6, + 7, + 5, + 3, + 4, + 8 + ], + "weighted_loads": [ + 1.1799057461321354, + 0.056124839931726456, + 0.16215284541249275, + 0.0, + 0.32961711660027504, + 0.03674207627773285, + 0.04431818425655365, + 0.1963220126926899, + 0.09559556469321251, + 0.3036445565521717, + 1.3288090080022812, + 0.0, + 0.1641798298805952, + 0.28812055476009846, + 0.2139868214726448, + 0.1456759087741375, + 0.07724161446094513, + 0.5121173374354839, + 0.07112448662519455, + 1.1727290265262127, + 0.21531005948781967, + 0.0, + 1.0653502978384495, + 0.44966165348887444, + 0.28011733666062355, + 0.28110599145293236, + 0.0, + 0.012919825501739979, + 0.03414424881339073, + 0.13367612659931183, + 0.12539126351475716, + 0.4168511452153325, + 0.0, + 0.06330200284719467, + 0.8232476860284805, + 0.6324960067868233, + 0.0, + 0.12949877604842186, + 0.2497364766895771, + 0.0, + 0.0, + 1.3232187330722809, + 0.0, + 0.138217531144619, + 0.2922326410189271, + 0.6196066364645958, + 1.2944003157317638, + 0.057232894003391266, + 0.3601779527962208, + 0.6513085290789604, + 0.3278609439730644, + 0.0922100655734539, + 0.16677911207079887, + 0.07592077180743217, + 0.13986095786094666, + 0.361601822078228, + 0.306749414652586, + 0.06007591262459755, + 0.39594277180731297, + 0.315702386200428, + 0.38719575479626656, + 0.41751935705542564, + 0.13985850475728512, + 0.4279453456401825 + ], + "unique_experts": 55, + "load_cv": 0.931280811902234, + "normalized_load_entropy": 0.8971740183162528, + "max_load_share": 0.0625 + } + }, + "s1_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "f4a97a0a708c0d601200a5be8546be798fd01acf3193aadc090c2dc6162164a1", + "route_weight_sha256": "a9cfde0353e6918022f3fef23c0f31cb9068badb8546c42c20119d756e3d8df3", + "loads": [ + 7, + 1, + 2, + 0, + 1, + 1, + 1, + 3, + 1, + 5, + 0, + 1, + 1, + 2, + 5, + 3, + 0, + 5, + 1, + 1, + 3, + 0, + 5, + 4, + 3, + 3, + 0, + 0, + 1, + 3, + 3, + 4, + 0, + 1, + 4, + 2, + 0, + 2, + 5, + 0, + 0, + 5, + 0, + 3, + 0, + 0, + 4, + 1, + 3, + 8, + 0, + 1, + 3, + 0, + 2, + 0, + 1, + 1, + 4, + 1, + 5, + 3, + 2, + 7 + ], + "weighted_loads": [ + 0.4332082234323025, + 0.05591529980301857, + 0.15751910582184792, + 0.0, + 0.042810939252376556, + 0.03877340257167816, + 0.03565717861056328, + 0.207269836217165, + 0.04430147260427475, + 0.3114142529666424, + 0.0, + 0.03600286692380905, + 0.11568847298622131, + 0.08061562106013298, + 0.25368259847164154, + 0.1523575782775879, + 0.0, + 0.3308696821331978, + 0.07439828664064407, + 0.04006749764084816, + 0.19055938348174095, + 0.0, + 0.40406549721956253, + 0.24988039769232273, + 0.14352792873978615, + 0.1263669952750206, + 0.0, + 0.0, + 0.03336253762245178, + 0.16738871112465858, + 0.12914826720952988, + 0.2246619090437889, + 0.0, + 0.06295660883188248, + 0.29795507341623306, + 0.18371818214654922, + 0.0, + 0.13188109546899796, + 0.20797259360551834, + 0.0, + 0.0, + 0.3280961476266384, + 0.0, + 0.14199872687458992, + 0.0, + 0.0, + 0.30685846135020256, + 0.07117057591676712, + 0.23582395911216736, + 0.6542208157479763, + 0.0, + 0.0713345855474472, + 0.17256514728069305, + 0.0, + 0.14029884710907936, + 0.0, + 0.05891312658786774, + 0.06117336452007294, + 0.295761002227664, + 0.06520592421293259, + 0.3831026703119278, + 0.4181907884776592, + 0.07917259633541107, + 0.38689156621694565 + ], + "unique_experts": 48, + "load_cv": 0.9319415313491465, + "normalized_load_entropy": 0.8841813529972526, + "max_load_share": 0.057971014492753624 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "82b004ee74da1ffa39ff18a23ece7fda697ccec565df4e37a143bb8246fe0fe9", + "route_weight_sha256": "d4f0c0987a778d9dcd5283d41fe08d81432aa3646866f4818234047259e1b002", + "loads": [ + 20, + 3, + 2, + 0, + 3, + 1, + 1, + 3, + 9, + 7, + 12, + 3, + 3, + 4, + 6, + 3, + 2, + 9, + 1, + 13, + 3, + 3, + 9, + 15, + 8, + 13, + 5, + 1, + 7, + 3, + 5, + 8, + 0, + 4, + 11, + 14, + 0, + 5, + 10, + 2, + 6, + 20, + 2, + 3, + 4, + 11, + 24, + 1, + 9, + 13, + 2, + 2, + 3, + 2, + 3, + 5, + 6, + 1, + 9, + 6, + 5, + 4, + 4, + 8 + ], + "weighted_loads": [ + 1.3315895050764084, + 0.14288834482431412, + 0.15751910582184792, + 0.0, + 0.34123023599386215, + 0.03877340257167816, + 0.03565717861056328, + 0.207269836217165, + 0.5056835748255253, + 0.4019080922007561, + 1.244280595332384, + 0.13174903020262718, + 0.16279715485870838, + 0.13180848397314548, + 0.2923927530646324, + 0.1523575782775879, + 0.08689889684319496, + 0.5239319130778313, + 0.07439828664064407, + 1.2194047197699547, + 0.19055938348174095, + 0.1271832250058651, + 1.091907562687993, + 1.079411705955863, + 0.33531587198376656, + 0.6395748574286699, + 0.3022901937365532, + 0.012919825501739979, + 0.4559403918683529, + 0.16738871112465858, + 0.26854877546429634, + 0.3714221687987447, + 0.0, + 0.28567852824926376, + 0.6594312842935324, + 0.9486519135534763, + 0.0, + 0.27350012585520744, + 0.4608711302280426, + 0.11094389110803604, + 0.4007585123181343, + 1.7682867795228958, + 0.09233702719211578, + 0.14199872687458992, + 0.17037322837859392, + 0.9526285752654076, + 2.065234027802944, + 0.07117057591676712, + 0.6017450280487537, + 0.9840076640248299, + 0.15382957458496094, + 0.10385432839393616, + 0.17256514728069305, + 0.10039011389017105, + 0.18197758123278618, + 0.3223129827529192, + 0.2946493700146675, + 0.06117336452007294, + 0.5605321880429983, + 0.2959459684789181, + 0.3831026703119278, + 0.45651935040950775, + 0.23674508556723595, + 0.422978762537241 + ], + "unique_experts": 61, + "load_cv": 0.8518770125108697, + "normalized_load_entropy": 0.9201579976809778, + "max_load_share": 0.0625 + } + }, + "s0_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "31b14c6ca1690e88836d4abbd4f98f2358fee44bef152d3d77bdf476000fcdb4", + "route_weight_sha256": "405c4adaa470596127b81bd7eb35a8e550f9923554054a5eaad6137eeb85a84b", + "loads": [ + 11, + 1, + 2, + 0, + 2, + 1, + 1, + 3, + 0, + 5, + 0, + 0, + 1, + 4, + 4, + 3, + 0, + 5, + 1, + 1, + 3, + 0, + 4, + 4, + 2, + 2, + 0, + 0, + 1, + 2, + 2, + 4, + 0, + 1, + 4, + 2, + 0, + 2, + 2, + 0, + 0, + 5, + 0, + 3, + 0, + 0, + 4, + 2, + 3, + 8, + 2, + 1, + 3, + 0, + 2, + 0, + 1, + 1, + 4, + 1, + 5, + 3, + 2, + 8 + ], + "weighted_loads": [ + 0.5976925939321518, + 0.05641936510801315, + 0.1614750549197197, + 0.0, + 0.08484610915184021, + 0.03757455572485924, + 0.037963587790727615, + 0.20074398443102837, + 0.0, + 0.3068336583673954, + 0.0, + 0.0, + 0.11562526971101761, + 0.15912113338708878, + 0.20646033808588982, + 0.1492740735411644, + 0.0, + 0.291969645768404, + 0.06873250752687454, + 0.03676885366439819, + 0.17775072529911995, + 0.0, + 0.36159631609916687, + 0.2782948575913906, + 0.11284805834293365, + 0.08905399590730667, + 0.0, + 0.0, + 0.03285662829875946, + 0.13181046023964882, + 0.08472893014550209, + 0.2222384437918663, + 0.0, + 0.06345654278993607, + 0.2810569331049919, + 0.18583857268095016, + 0.0, + 0.12899477407336235, + 0.0880156010389328, + 0.0, + 0.0, + 0.33733438327908516, + 0.0, + 0.14079520106315613, + 0.0, + 0.0, + 0.33011435717344284, + 0.09200257435441017, + 0.2339709773659706, + 0.6583167389035225, + 0.07836664095520973, + 0.06209825724363327, + 0.16956481337547302, + 0.0, + 0.14194819703698158, + 0.0, + 0.06560393422842026, + 0.06111299246549606, + 0.2891933564096689, + 0.06152194365859032, + 0.3958892524242401, + 0.41685348004102707, + 0.08899911865592003, + 0.42272213101387024 + ], + "unique_experts": 47, + "load_cv": 1.0148032651094037, + "normalized_load_entropy": 0.8758452328713595, + "max_load_share": 0.07971014492753623 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "2e7ba53330b32a53a7b3c927ffc243af52902338b69139c691870822ff141a65", + "route_weight_sha256": "cfda3abbc91ed5c3e5fc0b0420d74894e779f855d524ad117f60dfe0a82084fe", + "loads": [ + 20, + 1, + 2, + 0, + 4, + 1, + 1, + 3, + 2, + 5, + 12, + 0, + 3, + 7, + 4, + 3, + 1, + 9, + 1, + 12, + 3, + 0, + 8, + 6, + 5, + 3, + 0, + 1, + 1, + 2, + 3, + 9, + 0, + 1, + 14, + 9, + 0, + 2, + 4, + 0, + 0, + 16, + 0, + 3, + 4, + 8, + 17, + 2, + 5, + 8, + 7, + 2, + 3, + 3, + 2, + 5, + 7, + 1, + 6, + 6, + 5, + 3, + 4, + 9 + ], + "weighted_loads": [ + 1.2135974802076817, + 0.05641936510801315, + 0.1614750549197197, + 0.0, + 0.36910945177078247, + 0.03757455572485924, + 0.037963587790727615, + 0.20074398443102837, + 0.09559556469321251, + 0.3068336583673954, + 1.2728829458355904, + 0.0, + 0.16119064204394817, + 0.2644695769995451, + 0.20646033808588982, + 0.1492740735411644, + 0.04060012102127075, + 0.47213292866945267, + 0.06873250752687454, + 1.1788660064339638, + 0.17775072529911995, + 0.0, + 1.0499093607068062, + 0.4618782363831997, + 0.24247415363788605, + 0.1655811369419098, + 0.0, + 0.012919825501739979, + 0.03285662829875946, + 0.13181046023964882, + 0.12471787258982658, + 0.4103114726021886, + 0.0, + 0.06345654278993607, + 0.8342278487980366, + 0.6161851733922958, + 0.0, + 0.12899477407336235, + 0.17741132900118828, + 0.0, + 0.0, + 1.375763650983572, + 0.0, + 0.14079520106315613, + 0.2951886923983693, + 0.6494419910013676, + 1.420353814959526, + 0.09200257435441017, + 0.35496240481734276, + 0.6583167389035225, + 0.3699321746826172, + 0.09574224427342415, + 0.16956481337547302, + 0.10999935492873192, + 0.14194819703698158, + 0.35294000059366226, + 0.3458140343427658, + 0.06111299246549606, + 0.3913231063634157, + 0.27673425897955894, + 0.3958892524242401, + 0.41685348004102707, + 0.14526758156716824, + 0.4589446596801281 + ], + "unique_experts": 55, + "load_cv": 0.976577546180386, + "normalized_load_entropy": 0.8926346906645465, + "max_load_share": 0.06944444444444445 + } + }, + "s1_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "2e301eac1c721414bdc494d12d314fb7b0acb8e49f174b74ef23ba8a3f5cac05", + "route_weight_sha256": "d0aa98d194aae36a165d0361b0aebce54962ce5575371d1f92fffedeec511685", + "loads": [ + 7, + 1, + 2, + 0, + 1, + 1, + 0, + 3, + 1, + 5, + 0, + 1, + 1, + 4, + 5, + 4, + 0, + 5, + 1, + 1, + 3, + 0, + 4, + 4, + 3, + 3, + 0, + 0, + 1, + 3, + 3, + 4, + 0, + 1, + 4, + 2, + 0, + 2, + 3, + 0, + 0, + 5, + 0, + 3, + 0, + 0, + 4, + 1, + 3, + 8, + 0, + 1, + 3, + 0, + 2, + 0, + 1, + 1, + 4, + 1, + 5, + 3, + 3, + 7 + ], + "weighted_loads": [ + 0.42479901388287544, + 0.05763495713472366, + 0.1556277796626091, + 0.0, + 0.04449459910392761, + 0.038515642285346985, + 0.0, + 0.21971004828810692, + 0.04435686022043228, + 0.3165736570954323, + 0.0, + 0.037382688373327255, + 0.11546161770820618, + 0.16207066550850868, + 0.258696511387825, + 0.19450859352946281, + 0.0, + 0.3202345296740532, + 0.07244592159986496, + 0.03736111521720886, + 0.1916387528181076, + 0.0, + 0.36959393322467804, + 0.2590098213404417, + 0.13981649838387966, + 0.12139830738306046, + 0.0, + 0.0, + 0.034687791019678116, + 0.17061834782361984, + 0.13263217732310295, + 0.2253805361688137, + 0.0, + 0.061252593994140625, + 0.2944921515882015, + 0.18645306676626205, + 0.0, + 0.13416513800621033, + 0.12881505489349365, + 0.0, + 0.0, + 0.33536746352910995, + 0.0, + 0.1479809395968914, + 0.0, + 0.0, + 0.31172575429081917, + 0.07287953794002533, + 0.23625600337982178, + 0.6658410578966141, + 0.0, + 0.07553548365831375, + 0.17424329742789268, + 0.0, + 0.14290020614862442, + 0.0, + 0.0638536810874939, + 0.06070089712738991, + 0.295267079025507, + 0.06690236926078796, + 0.3990628123283386, + 0.39426084607839584, + 0.11375318840146065, + 0.3873091898858547 + ], + "unique_experts": 47, + "load_cv": 0.9283284660133794, + "normalized_load_entropy": 0.8823267557106707, + "max_load_share": 0.057971014492753624 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "b2dc73000bdf3ec9f1fec553fcbe1fe2bbc43b49f58fea877a7990e2e65062d4", + "route_weight_sha256": "620867cf813e29b9b420b5738582b61a70141f697a81f8420ad33e556f126124", + "loads": [ + 19, + 3, + 2, + 0, + 3, + 1, + 0, + 3, + 8, + 7, + 12, + 3, + 3, + 7, + 6, + 4, + 1, + 9, + 1, + 12, + 3, + 3, + 8, + 15, + 8, + 13, + 4, + 1, + 7, + 3, + 5, + 8, + 0, + 4, + 10, + 14, + 0, + 5, + 8, + 1, + 6, + 21, + 2, + 3, + 4, + 12, + 26, + 1, + 9, + 13, + 3, + 2, + 3, + 3, + 3, + 5, + 7, + 1, + 9, + 5, + 5, + 4, + 5, + 8 + ], + "weighted_loads": [ + 1.2163105197250843, + 0.1446080021560192, + 0.1556277796626091, + 0.0, + 0.33723703026771545, + 0.038515642285346985, + 0.0, + 0.21971004828810692, + 0.46421579644083977, + 0.407067496329546, + 1.1531607918441296, + 0.13312885165214539, + 0.16257029958069324, + 0.24605162627995014, + 0.2974066659808159, + 0.19450859352946281, + 0.04606104642152786, + 0.5221678987145424, + 0.07244592159986496, + 1.2104838117957115, + 0.1916387528181076, + 0.1271832250058651, + 1.0573407355695963, + 1.0701067317277193, + 0.33160444162786007, + 0.6330389883369207, + 0.25512557476758957, + 0.012919825501739979, + 0.4572656452655792, + 0.17061834782361984, + 0.2720326855778694, + 0.3721407959237695, + 0.0, + 0.2839745134115219, + 0.5956235062330961, + 0.9702394492924213, + 0.0, + 0.2757841683924198, + 0.3930256739258766, + 0.06790740042924881, + 0.4007585123181343, + 1.8791861347854137, + 0.09233702719211578, + 0.1479809395968914, + 0.17156844679266214, + 0.9715293236076832, + 2.2785700261592865, + 0.07287953794002533, + 0.6034218706190586, + 0.9956279061734676, + 0.19133441150188446, + 0.1080552265048027, + 0.17424329742789268, + 0.14952607080340385, + 0.18457894027233124, + 0.327683599665761, + 0.34102293476462364, + 0.06070089712738991, + 0.5617332980036736, + 0.24544954672455788, + 0.3990628123283386, + 0.43258940801024437, + 0.2713256776332855, + 0.42339638620615005 + ], + "unique_experts": 60, + "load_cv": 0.8655240865767079, + "normalized_load_entropy": 0.917701538299514, + "max_load_share": 0.06770833333333333 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 20, + "mean_set_jaccard": 0.9627329192546583, + "mean_token_weighted_tv": 0.011743542090382265, + "aggregate_load_tv": 0.021739130434782605 + }, + "system_bos": { + "tokens": 23, + "ordered_topk_exact_tokens": 8, + "set_exact_tokens": 12, + "mean_set_jaccard": 0.8633540372670808, + "mean_token_weighted_tv": 0.026675162715432438, + "aggregate_load_tv": 0.07246376811594202 + }, + "system_x": { + "tokens": 23, + "ordered_topk_exact_tokens": 8, + "set_exact_tokens": 13, + "mean_set_jaccard": 0.8664596273291927, + "mean_token_weighted_tv": 0.028177254995250183, + "aggregate_load_tv": 0.057971014492753624 + }, + "system_period": { + "tokens": 23, + "ordered_topk_exact_tokens": 7, + "set_exact_tokens": 12, + "mean_set_jaccard": 0.8633540372670808, + "mean_token_weighted_tv": 0.02773701314530943, + "aggregate_load_tv": 0.07246376811594202 + }, + "bos_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 12, + "mean_set_jaccard": 0.8633540372670808, + "mean_token_weighted_tv": 0.028002805117031803, + "aggregate_load_tv": 0.07246376811594203 + }, + "bos_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 7, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.9006211180124224, + "mean_token_weighted_tv": 0.02351882146752399, + "aggregate_load_tv": 0.05072463768115941 + }, + "x_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 8, + "set_exact_tokens": 12, + "mean_set_jaccard": 0.8633540372670808, + "mean_token_weighted_tv": 0.031172351344772007, + "aggregate_load_tv": 0.06521739130434782 + }, + "x_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 7, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8881987577639753, + "mean_token_weighted_tv": 0.02671355835121611, + "aggregate_load_tv": 0.043478260869565216 + }, + "period_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 13, + "mean_set_jaccard": 0.8664596273291925, + "mean_token_weighted_tv": 0.0298059087894533, + "aggregate_load_tv": 0.07246376811594202 + }, + "period_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 5, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8881987577639753, + "mean_token_weighted_tv": 0.025742238711403763, + "aggregate_load_tv": 0.050724637681159424 + } + } + }, + "layer_10": { + "layer": 10, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "76d9aff679e8045e39dcbdb70b9defa2eaa5a87fbf58847c5b7b53b1048fe204", + "route_weight_sha256": "1a79b80b27728bcfe76aed8c5bcef84e8e5435385c67edc920675a1020f0c51f", + "loads": [ + 0, + 0, + 1, + 2, + 4, + 4, + 0, + 0, + 2, + 1, + 1, + 0, + 1, + 3, + 1, + 5, + 2, + 0, + 1, + 13, + 1, + 1, + 0, + 0, + 6, + 0, + 1, + 0, + 6, + 3, + 2, + 3, + 6, + 23, + 0, + 0, + 0, + 0, + 0, + 2, + 0, + 3, + 0, + 0, + 0, + 3, + 1, + 6, + 2, + 1, + 0, + 3, + 2, + 3, + 3, + 5, + 0, + 3, + 0, + 3, + 3, + 0, + 0, + 2 + ], + "weighted_loads": [ + 0.0, + 0.0, + 0.10228274762630463, + 0.0667993575334549, + 0.24029367789626122, + 0.18328384310007095, + 0.0, + 0.0, + 0.09867966920137405, + 0.06054019555449486, + 0.06206386163830757, + 0.0, + 0.04515537619590759, + 0.20936105772852898, + 0.04827980324625969, + 0.33835286647081375, + 0.16013803333044052, + 0.0, + 0.09121407568454742, + 0.7475122883915901, + 0.1143137589097023, + 0.08756858855485916, + 0.0, + 0.0, + 0.32052180357277393, + 0.0, + 0.03751674294471741, + 0.0, + 0.3173116222023964, + 0.2054857648909092, + 0.13246306777000427, + 0.20368041098117828, + 0.5532038658857346, + 2.8094318881630898, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.2784063518047333, + 0.0, + 0.20137037336826324, + 0.0, + 0.0, + 0.0, + 0.12448743171989918, + 0.04061567410826683, + 0.6142985243350267, + 0.09465387091040611, + 0.05538789555430412, + 0.0, + 0.24561773985624313, + 0.10512270405888557, + 0.1785733737051487, + 0.28734808415174484, + 0.4138236902654171, + 0.0, + 0.36573921889066696, + 0.0, + 0.187923114746809, + 0.2201242744922638, + 0.0, + 0.0, + 0.07335912249982357 + ], + "unique_experts": 40, + "load_cv": 1.6069974062599193, + "normalized_load_entropy": 0.7962156886718145, + "max_load_share": 0.16666666666666666 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "72a64d2deeffdf528c448fa5049651de1f835c42cd1169487c31301b368513b4", + "route_weight_sha256": "b89fb13f404bc8fa5e3f211041f93ca5e9b92966a4d2041618ee40ae851844e2", + "loads": [ + 0, + 0, + 3, + 2, + 4, + 4, + 0, + 4, + 2, + 3, + 3, + 1, + 2, + 6, + 3, + 5, + 2, + 2, + 8, + 16, + 5, + 3, + 1, + 0, + 6, + 2, + 1, + 9, + 7, + 4, + 5, + 4, + 6, + 31, + 1, + 1, + 0, + 0, + 0, + 2, + 0, + 14, + 4, + 2, + 4, + 6, + 7, + 8, + 2, + 3, + 2, + 10, + 2, + 4, + 3, + 14, + 0, + 10, + 0, + 13, + 8, + 12, + 0, + 2 + ], + "weighted_loads": [ + 0.0, + 0.0, + 0.12130769761279225, + 0.0667993575334549, + 0.24029367789626122, + 0.18328384310007095, + 0.0, + 0.17415715008974075, + 0.09867966920137405, + 0.0849748756736517, + 0.15927942097187042, + 0.045306798070669174, + 0.07805630937218666, + 1.6250942163169384, + 0.18077856302261353, + 0.33835286647081375, + 0.16013803333044052, + 0.10440178960561752, + 0.47769499104470015, + 0.8895417414605618, + 0.28330574557185173, + 0.17237771674990654, + 0.003727246541529894, + 0.0, + 0.32052180357277393, + 0.06382722593843937, + 0.03751674294471741, + 0.9899728856980801, + 0.36377786844968796, + 0.2472313866019249, + 0.3898896500468254, + 0.21746170334517956, + 0.5532038658857346, + 3.1847836524248123, + 0.02990398183465004, + 0.03698144853115082, + 0.0, + 0.0, + 0.0, + 0.2784063518047333, + 0.0, + 1.696310505270958, + 0.11508292611688375, + 0.0976313166320324, + 0.2016969844698906, + 0.2716065216809511, + 0.3120437040925026, + 0.6884102430194616, + 0.09465387091040611, + 0.13833561912178993, + 0.09444281086325645, + 0.5895813070237637, + 0.10512270405888557, + 0.26064449921250343, + 0.28734808415174484, + 1.189353358000517, + 0.0, + 0.7564269565045834, + 0.0, + 0.9454168528318405, + 0.5442575924098492, + 1.0372949317097664, + 0.0, + 0.07335912249982357 + ], + "unique_experts": 53, + "load_cv": 1.1317527104146312, + "normalized_load_entropy": 0.8756967713287008, + "max_load_share": 0.1076388888888889 + } + }, + "s1_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "41be8db1e550b9d201c63c1405cf03aef69f545971f8a78646b9e0802aa86360", + "route_weight_sha256": "59d3e07b3e944a04ae16020e9b704eda1f2879fb157bbc1a1a1aa64a6f086fc1", + "loads": [ + 0, + 0, + 1, + 2, + 4, + 4, + 0, + 0, + 2, + 1, + 1, + 0, + 1, + 3, + 1, + 4, + 2, + 0, + 1, + 13, + 1, + 1, + 0, + 0, + 6, + 0, + 1, + 0, + 7, + 3, + 2, + 3, + 6, + 23, + 0, + 0, + 0, + 0, + 0, + 2, + 0, + 3, + 0, + 0, + 0, + 2, + 1, + 6, + 2, + 1, + 0, + 3, + 2, + 3, + 3, + 5, + 0, + 3, + 1, + 3, + 3, + 0, + 0, + 2 + ], + "weighted_loads": [ + 0.0, + 0.0, + 0.10092800855636597, + 0.0713222362101078, + 0.24540656432509422, + 0.18141696974635124, + 0.0, + 0.0, + 0.09839404746890068, + 0.058684881776571274, + 0.06284280121326447, + 0.0, + 0.04349605366587639, + 0.20842063799500465, + 0.0467330701649189, + 0.2933104448020458, + 0.16505829244852066, + 0.0, + 0.09070112556219101, + 0.7313318699598312, + 0.11339205503463745, + 0.08566748350858688, + 0.0, + 0.0, + 0.3159595634788275, + 0.0, + 0.03800057992339134, + 0.0, + 0.3653278313577175, + 0.20943882316350937, + 0.1306760199368, + 0.199041698127985, + 0.5533864200115204, + 2.8103245198726654, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.2789900004863739, + 0.0, + 0.20590130984783173, + 0.0, + 0.0, + 0.0, + 0.10446932539343834, + 0.040260352194309235, + 0.6070714332163334, + 0.09537652507424355, + 0.05642024055123329, + 0.0, + 0.24355845898389816, + 0.10474223643541336, + 0.1826559118926525, + 0.2975243404507637, + 0.3990239165723324, + 0.0, + 0.38916126638650894, + 0.027330432087183, + 0.2008657343685627, + 0.21940776705741882, + 0.0, + 0.0, + 0.07272577099502087 + ], + "unique_experts": 41, + "load_cv": 1.6069974062599193, + "normalized_load_entropy": 0.7989002521096454, + "max_load_share": 0.16666666666666666 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "ebed822b3b34ba1a9a2289fe9bc64f45ba7bae2f60529d594c07cf2602921517", + "route_weight_sha256": "50d04b9ccb0d58818d097b9a8f2668054542626a081c08986b17f7f5caa684f8", + "loads": [ + 0, + 0, + 4, + 2, + 9, + 4, + 0, + 1, + 2, + 3, + 3, + 3, + 5, + 5, + 4, + 4, + 2, + 5, + 7, + 14, + 2, + 3, + 1, + 0, + 7, + 3, + 3, + 22, + 7, + 6, + 11, + 4, + 11, + 39, + 2, + 2, + 2, + 3, + 1, + 2, + 1, + 20, + 4, + 2, + 3, + 7, + 7, + 8, + 10, + 4, + 3, + 18, + 3, + 6, + 3, + 18, + 1, + 10, + 1, + 21, + 14, + 10, + 0, + 2 + ], + "weighted_loads": [ + 0.0, + 0.0, + 0.16062367986887693, + 0.0713222362101078, + 0.4843195639550686, + 0.18141696974635124, + 0.0, + 0.03773580864071846, + 0.09839404746890068, + 0.08384153991937637, + 0.14058910310268402, + 0.1708204299211502, + 0.24212845787405968, + 1.5828903950750828, + 0.24751241877675056, + 0.2933104448020458, + 0.16505829244852066, + 0.25303245708346367, + 0.45677410112693906, + 0.7610978186130524, + 0.15526922792196274, + 0.17377908900380135, + 0.003929369151592255, + 0.0, + 0.3572749514132738, + 0.3256672862917185, + 0.10853376798331738, + 1.5781999453902245, + 0.3653278313577175, + 0.34212638065218925, + 0.8368179015815258, + 0.21282299049198627, + 1.0419910624623299, + 3.61404893361032, + 0.14350364543497562, + 0.16424397006630898, + 0.08482927083969116, + 0.12719155848026276, + 0.03615724295377731, + 0.2789900004863739, + 0.042653705924749374, + 2.099599814042449, + 0.09842182695865631, + 0.0686471238732338, + 0.1767910085618496, + 0.3588673174381256, + 0.36448073759675026, + 0.675391674041748, + 0.7424266636371613, + 0.21675889752805233, + 0.18167958036065102, + 1.0931254401803017, + 0.17435116320848465, + 0.35849932581186295, + 0.2975243404507637, + 1.4550940245389938, + 0.07219786942005157, + 0.7785326391458511, + 0.027330432087183, + 1.4367537684738636, + 0.9731245972216129, + 0.8979469276964664, + 0.0, + 0.07272577099502087 + ], + "unique_experts": 59, + "load_cv": 1.1253857363391255, + "normalized_load_entropy": 0.8838032260365616, + "max_load_share": 0.1015625 + } + }, + "s0_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "ab4dd524aa219fc6247daf5989e2ec8326044cd29fde13e9638fac3b37d7f93b", + "route_weight_sha256": "74b402869d51852c7459b110466513522fc423fa858335a540b35e0e70118544", + "loads": [ + 0, + 0, + 1, + 1, + 4, + 4, + 0, + 0, + 2, + 1, + 1, + 0, + 1, + 2, + 1, + 3, + 2, + 0, + 1, + 13, + 1, + 1, + 0, + 0, + 6, + 0, + 1, + 1, + 6, + 3, + 2, + 4, + 6, + 23, + 0, + 0, + 0, + 0, + 0, + 2, + 0, + 3, + 0, + 0, + 0, + 2, + 1, + 6, + 2, + 1, + 0, + 3, + 2, + 3, + 3, + 5, + 0, + 4, + 0, + 3, + 3, + 0, + 2, + 2 + ], + "weighted_loads": [ + 0.0, + 0.0, + 0.10368070751428604, + 0.027187427505850792, + 0.2394170854240656, + 0.17547690495848656, + 0.0, + 0.0, + 0.09239419177174568, + 0.056743234395980835, + 0.06292644143104553, + 0.0, + 0.046753574162721634, + 0.17558442056179047, + 0.044494614005088806, + 0.27852045744657516, + 0.1531975343823433, + 0.0, + 0.08874943107366562, + 0.7455122508108616, + 0.11149268597364426, + 0.08324746042490005, + 0.0, + 0.0, + 0.3078621570020914, + 0.0, + 0.039796918630599976, + 0.0585341639816761, + 0.31316370517015457, + 0.20543798804283142, + 0.12634344398975372, + 0.20864002034068108, + 0.5665918663144112, + 2.8106219358742237, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.2782086431980133, + 0.0, + 0.1751287691295147, + 0.0, + 0.0, + 0.0, + 0.08955769799649715, + 0.04076804593205452, + 0.6067161411046982, + 0.09663956239819527, + 0.0530649870634079, + 0.0, + 0.254742294549942, + 0.10367367044091225, + 0.17770550027489662, + 0.27685385197401047, + 0.4062815010547638, + 0.0, + 0.4213899299502373, + 0.0, + 0.1913863681256771, + 0.2170311026275158, + 0.0, + 0.07479621469974518, + 0.0734809972345829 + ], + "unique_experts": 42, + "load_cv": 1.5965068989869469, + "normalized_load_entropy": 0.8033102574893595, + "max_load_share": 0.16666666666666666 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "90db97b8ce7b72063c2373d2234f1e222d662a372426bfce54c2b3edc5a45740", + "route_weight_sha256": "b42cceca41e47d2b17b37a56f5a51a443f53bbd6206de84a71d8014857d2feca", + "loads": [ + 0, + 1, + 2, + 1, + 4, + 4, + 0, + 4, + 2, + 2, + 3, + 1, + 2, + 5, + 4, + 3, + 2, + 3, + 7, + 16, + 6, + 3, + 0, + 0, + 6, + 2, + 1, + 10, + 7, + 4, + 5, + 5, + 6, + 31, + 1, + 1, + 0, + 0, + 0, + 2, + 0, + 13, + 5, + 2, + 3, + 5, + 7, + 9, + 2, + 3, + 2, + 10, + 2, + 4, + 3, + 14, + 0, + 11, + 0, + 13, + 8, + 12, + 2, + 2 + ], + "weighted_loads": [ + 0.0, + 0.03855763003230095, + 0.11783410143107176, + 0.027187427505850792, + 0.2394170854240656, + 0.17547690495848656, + 0.0, + 0.17415715008974075, + 0.09239419177174568, + 0.07296779192984104, + 0.16014200076460838, + 0.045306798070669174, + 0.0796545073390007, + 0.7213160619139671, + 0.23241963610053062, + 0.27852045744657516, + 0.1531975343823433, + 0.15992170199751854, + 0.49244483932852745, + 0.8908773213624954, + 0.35019057616591454, + 0.16805658861994743, + 0.0, + 0.0, + 0.3078621570020914, + 0.06382722593843937, + 0.039796918630599976, + 1.0893915072083473, + 0.35962995141744614, + 0.24718360975384712, + 0.387327928096056, + 0.22242131270468235, + 0.5665918663144112, + 3.1976117566227913, + 0.02990398183465004, + 0.03698144853115082, + 0.0, + 0.0, + 0.0, + 0.2782086431980133, + 0.0, + 1.7099116034805775, + 0.1839920785278082, + 0.0976313166320324, + 0.18799599632620811, + 0.2366767879575491, + 0.3121960759162903, + 0.7103588730096817, + 0.09663956239819527, + 0.18340057134628296, + 0.09444281086325645, + 0.5788442939519882, + 0.10367367044091225, + 0.24627713486552238, + 0.27685385197401047, + 1.1325031407177448, + 0.0, + 0.8120776675641537, + 0.0, + 0.9237271510064602, + 0.5388343073427677, + 1.0372949317097664, + 0.07479621469974518, + 0.0734809972345829 + ], + "unique_experts": 54, + "load_cv": 1.1324342839244173, + "normalized_load_entropy": 0.8767283189959532, + "max_load_share": 0.1076388888888889 + } + }, + "s1_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "5a555daa8c121dc6284a15e56b32a94d9c41ec62f5b633321e1f1477031a67c8", + "route_weight_sha256": "a176fe37433dbf55e5a5b67e901682d452336e5c64672465bb639204225d1771", + "loads": [ + 0, + 0, + 1, + 2, + 4, + 3, + 0, + 0, + 2, + 1, + 1, + 1, + 1, + 2, + 1, + 3, + 2, + 0, + 1, + 12, + 1, + 1, + 0, + 0, + 6, + 0, + 1, + 2, + 6, + 3, + 2, + 4, + 6, + 23, + 0, + 1, + 0, + 0, + 0, + 2, + 0, + 3, + 0, + 0, + 0, + 2, + 1, + 6, + 2, + 1, + 0, + 3, + 2, + 3, + 3, + 4, + 0, + 4, + 0, + 3, + 3, + 0, + 1, + 2 + ], + "weighted_loads": [ + 0.0, + 0.0, + 0.10285646468400955, + 0.0686331856995821, + 0.2440706081688404, + 0.13765641674399376, + 0.0, + 0.0, + 0.09181661158800125, + 0.05380365625023842, + 0.05733943358063698, + 0.04430650547146797, + 0.04073478654026985, + 0.1825515776872635, + 0.046962589025497437, + 0.2807970643043518, + 0.16832739114761353, + 0.0, + 0.09654983133077621, + 0.6411286853253841, + 0.11306437849998474, + 0.07946910709142685, + 0.0, + 0.0, + 0.30726881697773933, + 0.0, + 0.040964338928461075, + 0.10833486169576645, + 0.3114365302026272, + 0.2101948820054531, + 0.1298273541033268, + 0.20691686868667603, + 0.5806135758757591, + 2.782350767403841, + 0.0, + 0.02713898755609989, + 0.0, + 0.0, + 0.0, + 0.28509508073329926, + 0.0, + 0.18674926832318306, + 0.0, + 0.0, + 0.0, + 0.10272905975580215, + 0.03976020961999893, + 0.6240845825523138, + 0.10581883043050766, + 0.055813778191804886, + 0.0, + 0.2603921443223953, + 0.10465638339519501, + 0.1847199872136116, + 0.29349249973893166, + 0.33890095725655556, + 0.0, + 0.43721140176057816, + 0.0, + 0.19313952699303627, + 0.2176879681646824, + 0.0, + 0.03867510333657265, + 0.07612389326095581 + ], + "unique_experts": 44, + "load_cv": 1.558156375896024, + "normalized_load_entropy": 0.8153161986722745, + "max_load_share": 0.16666666666666666 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "077074d3970dfa99d21a47b7c99f700ac8c5ed8d3516f3f8eb7cdae7d60e3c23", + "route_weight_sha256": "42d887771a067fa497760af4e1e68d4aa0f8058f56b99f6962e327ee91d0cef6", + "loads": [ + 0, + 0, + 3, + 2, + 9, + 3, + 0, + 1, + 2, + 2, + 3, + 4, + 5, + 4, + 5, + 3, + 2, + 4, + 6, + 14, + 3, + 3, + 0, + 0, + 7, + 3, + 3, + 25, + 6, + 6, + 11, + 5, + 11, + 40, + 2, + 3, + 2, + 3, + 1, + 2, + 1, + 20, + 3, + 2, + 3, + 7, + 7, + 9, + 10, + 4, + 3, + 17, + 3, + 6, + 3, + 17, + 1, + 11, + 0, + 22, + 14, + 10, + 1, + 2 + ], + "weighted_loads": [ + 0.0, + 0.0, + 0.15754047315567732, + 0.0686331856995821, + 0.4829836077988148, + 0.13765641674399376, + 0.0, + 0.03773580864071846, + 0.09181661158800125, + 0.07002821378409863, + 0.13508573547005653, + 0.21512693539261818, + 0.23936719074845314, + 0.6915933936834335, + 0.30968812480568886, + 0.2807970643043518, + 0.16832739114761353, + 0.21638252213597298, + 0.49821359291672707, + 0.7166327219456434, + 0.21048695594072342, + 0.1675807125866413, + 0.0, + 0.0, + 0.34858420491218567, + 0.3256672862917185, + 0.11149752698838711, + 1.7531624771654606, + 0.3114365302026272, + 0.342882439494133, + 0.8456417545676231, + 0.2206981610506773, + 1.0692182183265686, + 3.6236431319266558, + 0.14350364543497562, + 0.19138295762240887, + 0.08482927083969116, + 0.12719155848026276, + 0.03615724295377731, + 0.28509508073329926, + 0.042653705924749374, + 2.255735008046031, + 0.07431354001164436, + 0.0686471238732338, + 0.21565357223153114, + 0.3571270518004894, + 0.36398059502243996, + 0.7230601869523525, + 0.7528689689934254, + 0.255489531904459, + 0.18167958036065102, + 1.0455965958535671, + 0.1742653101682663, + 0.3482017144560814, + 0.29349249973893166, + 1.3773515671491623, + 0.07219786942005157, + 0.8265827745199203, + 0.0, + 1.464966293424368, + 0.9677659757435322, + 0.8979469276964664, + 0.03867510333657265, + 0.07612389326095581 + ], + "unique_experts": 58, + "load_cv": 1.1610728994243977, + "normalized_load_entropy": 0.8779175768811414, + "max_load_share": 0.10416666666666667 + } + }, + "s0_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "6f02ba5b1aaa45c42d935364fde204b497607bacaf6ee137e7d11132570346c7", + "route_weight_sha256": "50c160a58365438307af83118522363c1c13b130d615485b327c3b003743582a", + "loads": [ + 0, + 0, + 1, + 1, + 3, + 3, + 0, + 0, + 2, + 1, + 1, + 0, + 1, + 3, + 0, + 4, + 2, + 0, + 1, + 13, + 1, + 1, + 0, + 0, + 6, + 1, + 1, + 2, + 6, + 3, + 2, + 3, + 6, + 23, + 0, + 0, + 0, + 0, + 0, + 2, + 0, + 3, + 0, + 0, + 0, + 3, + 1, + 6, + 2, + 1, + 0, + 3, + 2, + 3, + 3, + 5, + 0, + 3, + 0, + 3, + 3, + 1, + 1, + 2 + ], + "weighted_loads": [ + 0.0, + 0.0, + 0.10389341413974762, + 0.03666776791214943, + 0.20941544324159622, + 0.11424130387604237, + 0.0, + 0.0, + 0.09312649816274643, + 0.053663160651922226, + 0.06457753479480743, + 0.0, + 0.052857205271720886, + 0.2140631042420864, + 0.0, + 0.3261917196214199, + 0.14337743818759918, + 0.0, + 0.09448589384555817, + 0.7432985156774521, + 0.11055911332368851, + 0.09223774820566177, + 0.0, + 0.0, + 0.3133086580783129, + 0.03224068135023117, + 0.040254779160022736, + 0.10192405804991722, + 0.3141459543257952, + 0.20457691699266434, + 0.130728580057621, + 0.1705591343343258, + 0.5377584472298622, + 2.7058660686016083, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.2803803086280823, + 0.0, + 0.18588227778673172, + 0.0, + 0.0, + 0.0, + 0.13686499372124672, + 0.038212452083826065, + 0.6366877090185881, + 0.09679900482296944, + 0.05360982194542885, + 0.0, + 0.2579379230737686, + 0.10216376930475235, + 0.1768297217786312, + 0.27768681943416595, + 0.3908624015748501, + 0.0, + 0.35040076822042465, + 0.0, + 0.19958748668432236, + 0.2274138405919075, + 0.027650956064462662, + 0.041873395442962646, + 0.07452616840600967 + ], + "unique_experts": 43, + "load_cv": 1.5859470020463253, + "normalized_load_entropy": 0.8084135938289521, + "max_load_share": 0.16666666666666666 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "cbbc2b446f727cb1b7b0840b2bb9863e711cc748e8b6194c570a72dc8051cedd", + "route_weight_sha256": "f29223712dce7d2d5e01a80aea6b6a6e30289ca4b69c8616d93c29d8237f9724", + "loads": [ + 0, + 1, + 2, + 1, + 3, + 3, + 0, + 5, + 2, + 2, + 3, + 1, + 2, + 5, + 2, + 4, + 2, + 4, + 6, + 16, + 5, + 3, + 0, + 0, + 6, + 3, + 1, + 9, + 7, + 4, + 4, + 4, + 6, + 32, + 1, + 1, + 0, + 0, + 0, + 2, + 0, + 12, + 4, + 2, + 4, + 7, + 8, + 10, + 2, + 2, + 3, + 11, + 2, + 4, + 3, + 13, + 0, + 11, + 0, + 13, + 8, + 14, + 1, + 2 + ], + "weighted_loads": [ + 0.0, + 0.04762151464819908, + 0.11804680805653334, + 0.03666776791214943, + 0.20941544324159622, + 0.11424130387604237, + 0.0, + 0.21471533551812172, + 0.09312649816274643, + 0.06988771818578243, + 0.16179309412837029, + 0.045306798070669174, + 0.08575813844799995, + 0.7177617512643337, + 0.13751108199357986, + 0.3261917196214199, + 0.14337743818759918, + 0.2088366113603115, + 0.4344797469675541, + 0.8874681778252125, + 0.27955109998583794, + 0.17704687640070915, + 0.0, + 0.0, + 0.3133086580783129, + 0.09606790728867054, + 0.040254779160022736, + 0.939583707600832, + 0.36061220057308674, + 0.24632253870368004, + 0.35459961742162704, + 0.18434042669832706, + 0.5377584472298622, + 3.1243639923632145, + 0.02990398183465004, + 0.03698144853115082, + 0.0, + 0.0, + 0.0, + 0.2803803086280823, + 0.0, + 1.3937691152095795, + 0.13577743992209435, + 0.0976313166320324, + 0.20088337361812592, + 0.35639986023306847, + 0.3596894145011902, + 0.780974430963397, + 0.09679900482296944, + 0.1099754236638546, + 0.12878872081637383, + 0.6498611643910408, + 0.10216376930475235, + 0.24994684383273125, + 0.27768681943416595, + 1.0374590270221233, + 0.0, + 0.8031014502048492, + 0.0, + 0.9147472828626633, + 0.5457876399159431, + 1.1520112864673138, + 0.041873395442962646, + 0.07452616840600967 + ], + "unique_experts": 54, + "load_cv": 1.1587029785896783, + "normalized_load_entropy": 0.8730340968716089, + "max_load_share": 0.1111111111111111 + } + }, + "s1_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "c627a1f0c6fd2bd4013dbb3f1a3ec3002cc11e3536b0c4666c8db870c2b3a6af", + "route_weight_sha256": "41c680b40845c7e6684a11dc91e628b7df72148ecf88e74d77aa25eca4ab3dc1", + "loads": [ + 0, + 0, + 1, + 1, + 4, + 2, + 0, + 0, + 2, + 1, + 1, + 0, + 1, + 2, + 1, + 3, + 2, + 0, + 1, + 11, + 1, + 1, + 0, + 0, + 6, + 0, + 1, + 2, + 6, + 3, + 2, + 4, + 6, + 23, + 0, + 1, + 0, + 0, + 0, + 2, + 0, + 4, + 0, + 0, + 0, + 3, + 1, + 6, + 2, + 1, + 0, + 3, + 2, + 3, + 3, + 5, + 0, + 4, + 0, + 3, + 3, + 0, + 2, + 2 + ], + "weighted_loads": [ + 0.0, + 0.0, + 0.10238131880760193, + 0.02955438755452633, + 0.2402140349149704, + 0.08264021202921867, + 0.0, + 0.0, + 0.0914037898182869, + 0.05504002794623375, + 0.06065092608332634, + 0.0, + 0.04383787512779236, + 0.17474710196256638, + 0.04539547115564346, + 0.2652439773082733, + 0.14927227050065994, + 0.0, + 0.09040939807891846, + 0.6543144062161446, + 0.10928264260292053, + 0.0897100418806076, + 0.0, + 0.0, + 0.31115298345685005, + 0.0, + 0.042498938739299774, + 0.09961602464318275, + 0.32654789090156555, + 0.202816441655159, + 0.1287466064095497, + 0.20611859112977982, + 0.549721471965313, + 2.6261070743203163, + 0.0, + 0.030526386573910713, + 0.0, + 0.0, + 0.0, + 0.28758405148983, + 0.0, + 0.23984388634562492, + 0.0, + 0.0, + 0.0, + 0.1503150798380375, + 0.040041495114564896, + 0.6217245552688837, + 0.10351129621267319, + 0.057381752878427505, + 0.0, + 0.26244064420461655, + 0.10315869376063347, + 0.18286428228020668, + 0.2947205640375614, + 0.37086381018161774, + 0.0, + 0.4136432483792305, + 0.0, + 0.19634370505809784, + 0.2246028333902359, + 0.0, + 0.07754892483353615, + 0.07594175636768341 + ], + "unique_experts": 43, + "load_cv": 1.5495051415128893, + "normalized_load_entropy": 0.8130348571642675, + "max_load_share": 0.16666666666666666 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "06a353a0a31531ebe722de41c7e09f198a0ce698fe3680c8b9394a32e2ad0b05", + "route_weight_sha256": "7c4122cd22784aa6ce7051244823125d18b9d2c6e30381e07c9756c8d2d656b6", + "loads": [ + 1, + 1, + 3, + 1, + 9, + 2, + 0, + 2, + 2, + 2, + 4, + 3, + 5, + 3, + 5, + 3, + 2, + 5, + 5, + 12, + 2, + 3, + 0, + 0, + 7, + 3, + 3, + 21, + 6, + 6, + 12, + 5, + 11, + 40, + 2, + 3, + 2, + 3, + 1, + 2, + 1, + 21, + 2, + 2, + 2, + 9, + 8, + 10, + 10, + 4, + 5, + 18, + 3, + 6, + 3, + 16, + 1, + 12, + 0, + 21, + 13, + 11, + 2, + 2 + ], + "weighted_loads": [ + 0.05350692570209503, + 0.049162931740283966, + 0.1570653272792697, + 0.02955438755452633, + 0.47912703454494476, + 0.08264021202921867, + 0.0, + 0.08722853660583496, + 0.0914037898182869, + 0.07126458548009396, + 0.18830624222755432, + 0.1708204299211502, + 0.24247027933597565, + 0.6438811346888542, + 0.3166939206421375, + 0.2652439773082733, + 0.14927227050065994, + 0.2586694099009037, + 0.4165106378495693, + 0.693900141865015, + 0.15115981549024582, + 0.17782164737582207, + 0.0, + 0.0, + 0.3524683713912964, + 0.3256672862917185, + 0.11303212679922581, + 1.458097454160452, + 0.32654789090156555, + 0.3355039991438389, + 0.9241375774145126, + 0.2198998834937811, + 1.0383261144161224, + 3.4837799090892076, + 0.14350364543497562, + 0.1947703566402197, + 0.08482927083969116, + 0.12719155848026276, + 0.03615724295377731, + 0.28758405148983, + 0.042653705924749374, + 1.806227184832096, + 0.04590226896107197, + 0.0686471238732338, + 0.14241717383265495, + 0.46757722645998, + 0.42920374125242233, + 0.7634998206049204, + 0.7505614347755909, + 0.23549950867891312, + 0.26224464178085327, + 1.1503411270678043, + 0.17276762053370476, + 0.3433496057987213, + 0.2947205640375614, + 1.2417342476546764, + 0.07219786942005157, + 0.8546130768954754, + 0.0, + 1.363376371562481, + 0.9292423501610756, + 0.984385546296835, + 0.07754892483353615, + 0.07594175636768341 + ], + "unique_experts": 60, + "load_cv": 1.1349865393230196, + "normalized_load_entropy": 0.8832735851072385, + "max_load_share": 0.10416666666666667 + } + }, + "s0_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "1d887cd9206ec014ed99d16a682346f00a6b10d783ab570279a0c5cea7a63975", + "route_weight_sha256": "315cab159678f2da99e891be2ee218110880844b3b7dd7b60a2623de9ec8f5a9", + "loads": [ + 0, + 0, + 1, + 1, + 3, + 2, + 0, + 0, + 2, + 1, + 1, + 0, + 1, + 3, + 1, + 3, + 2, + 0, + 1, + 15, + 1, + 1, + 0, + 0, + 6, + 0, + 1, + 1, + 7, + 3, + 2, + 3, + 6, + 23, + 0, + 0, + 0, + 0, + 0, + 2, + 0, + 4, + 0, + 0, + 0, + 3, + 1, + 6, + 2, + 1, + 0, + 3, + 2, + 3, + 3, + 5, + 0, + 3, + 0, + 3, + 3, + 0, + 1, + 2 + ], + "weighted_loads": [ + 0.0, + 0.0, + 0.10370698571205139, + 0.03874502331018448, + 0.2044932022690773, + 0.07666211575269699, + 0.0, + 0.0, + 0.08955016732215881, + 0.055656079202890396, + 0.06445754319429398, + 0.0, + 0.04800821840763092, + 0.20431854203343391, + 0.04423933103680611, + 0.2853658050298691, + 0.14599860459566116, + 0.0, + 0.09133409708738327, + 0.8450025580823421, + 0.11366135627031326, + 0.0924934521317482, + 0.0, + 0.0, + 0.3146738354116678, + 0.0, + 0.040383435785770416, + 0.043917566537857056, + 0.3571579158306122, + 0.2079070396721363, + 0.13295115157961845, + 0.17305311933159828, + 0.5579639002680779, + 2.736738819628954, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.2869308143854141, + 0.0, + 0.24095625802874565, + 0.0, + 0.0, + 0.0, + 0.14156391471624374, + 0.03859194368124008, + 0.6178363654762506, + 0.0983685702085495, + 0.05468987300992012, + 0.0, + 0.24908984452486038, + 0.10282536596059799, + 0.17661285772919655, + 0.2737271785736084, + 0.39367495849728584, + 0.0, + 0.3591364398598671, + 0.0, + 0.20030606538057327, + 0.22454332187771797, + 0.0, + 0.04090559482574463, + 0.07592977955937386 + ], + "unique_experts": 42, + "load_cv": 1.6482919051487421, + "normalized_load_entropy": 0.796475834715176, + "max_load_share": 0.16666666666666666 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "6427729d038b3b00d4ec69f2d270ccd0ceeab87ac4a5d4d9b872c812a08cfa97", + "route_weight_sha256": "214c94307649e0adc64623bd5f3fa93faa1e38566960c83211d078a18d5fbc69", + "loads": [ + 1, + 1, + 2, + 1, + 3, + 2, + 0, + 4, + 2, + 2, + 3, + 1, + 2, + 5, + 3, + 3, + 2, + 3, + 6, + 18, + 5, + 3, + 0, + 0, + 6, + 2, + 1, + 9, + 8, + 4, + 5, + 4, + 6, + 31, + 1, + 1, + 0, + 0, + 0, + 2, + 0, + 14, + 4, + 2, + 3, + 7, + 7, + 9, + 2, + 3, + 4, + 11, + 2, + 4, + 3, + 13, + 0, + 11, + 0, + 13, + 9, + 12, + 1, + 2 + ], + "weighted_loads": [ + 0.03243512287735939, + 0.03798915445804596, + 0.11786037962883711, + 0.03874502331018448, + 0.2044932022690773, + 0.07666211575269699, + 0.0, + 0.17415715008974075, + 0.08955016732215881, + 0.0718806367367506, + 0.16167310252785683, + 0.045306798070669174, + 0.08090915158390999, + 0.7080171890556812, + 0.18079166486859322, + 0.2853658050298691, + 0.14599860459566116, + 0.18123947456479073, + 0.4313279502093792, + 0.9934409707784653, + 0.2826533429324627, + 0.17730258032679558, + 0.0, + 0.0, + 0.3146738354116678, + 0.06382722593843937, + 0.040383435785770416, + 0.9221011437475681, + 0.40362416207790375, + 0.249652661383152, + 0.43719256296753883, + 0.18683441169559956, + 0.5579639002680779, + 3.1120294593274593, + 0.02990398183465004, + 0.03698144853115082, + 0.0, + 0.0, + 0.0, + 0.2869308143854141, + 0.0, + 1.550642553716898, + 0.13307476416230202, + 0.0976313166320324, + 0.15847023203969002, + 0.3314257897436619, + 0.31001997366547585, + 0.7204146236181259, + 0.0983685702085495, + 0.16733364760875702, + 0.16171233355998993, + 0.6794740669429302, + 0.10282536596059799, + 0.2492905594408512, + 0.2737271785736084, + 1.0654141195118427, + 0.0, + 0.8253244645893574, + 0.0, + 0.9363013505935669, + 0.5920960493385792, + 1.0372949317097664, + 0.04090559482574463, + 0.07592977955937386 + ], + "unique_experts": 55, + "load_cv": 1.1553685746158568, + "normalized_load_entropy": 0.8741985183245201, + "max_load_share": 0.1076388888888889 + } + }, + "s1_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "4b86d902189fe62e9db4cb66c23acbbeb59ff13a6362cf814238c2ffab89ce64", + "route_weight_sha256": "d87dbd3df0fb94ebc4fbb586674f019afb5400a29722b08dea46286aa3bfabcc", + "loads": [ + 0, + 0, + 1, + 1, + 4, + 2, + 0, + 0, + 2, + 1, + 1, + 0, + 1, + 2, + 1, + 3, + 2, + 0, + 1, + 13, + 1, + 1, + 0, + 0, + 6, + 0, + 1, + 1, + 6, + 3, + 2, + 4, + 6, + 23, + 0, + 1, + 0, + 0, + 0, + 2, + 0, + 4, + 0, + 0, + 0, + 2, + 1, + 6, + 2, + 1, + 0, + 3, + 2, + 3, + 3, + 5, + 0, + 4, + 0, + 3, + 3, + 0, + 2, + 2 + ], + "weighted_loads": [ + 0.0, + 0.0, + 0.10240712761878967, + 0.03189428895711899, + 0.2453806884586811, + 0.08248615264892578, + 0.0, + 0.0, + 0.08893278613686562, + 0.05406186357140541, + 0.059868138283491135, + 0.0, + 0.04232773184776306, + 0.17074234783649445, + 0.046842701733112335, + 0.26378291845321655, + 0.15870817750692368, + 0.0, + 0.0902329757809639, + 0.7442862503230572, + 0.11057063192129135, + 0.08867485076189041, + 0.0, + 0.0, + 0.321437556296587, + 0.0, + 0.04146888852119446, + 0.048804644495248795, + 0.3196938969194889, + 0.2097235880792141, + 0.12970170751214027, + 0.20660436525940895, + 0.578102208673954, + 2.6189371943473816, + 0.0, + 0.03097560629248619, + 0.0, + 0.0, + 0.0, + 0.2839958518743515, + 0.0, + 0.22696194052696228, + 0.0, + 0.0, + 0.0, + 0.11286766454577446, + 0.04029650613665581, + 0.6179769225418568, + 0.10503710061311722, + 0.05720895528793335, + 0.0, + 0.251191146671772, + 0.1034606359899044, + 0.18449219688773155, + 0.27764445170760155, + 0.36874595656991005, + 0.0, + 0.4122573547065258, + 0.0, + 0.1878399234265089, + 0.22044720500707626, + 0.0, + 0.07830726355314255, + 0.07966714538633823 + ], + "unique_experts": 43, + "load_cv": 1.592291344078602, + "normalized_load_entropy": 0.8066374163083974, + "max_load_share": 0.16666666666666666 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "8cf736074737b6be2f68972266fb99e97120c5ff229b582b92823f1c46dd6303", + "route_weight_sha256": "e9b0e525593ed95a83eaf4381bb6f95d6a84a721be01827117080072258e1a02", + "loads": [ + 2, + 0, + 3, + 2, + 9, + 2, + 0, + 1, + 2, + 2, + 3, + 3, + 5, + 3, + 5, + 3, + 2, + 5, + 5, + 14, + 2, + 3, + 0, + 0, + 7, + 3, + 3, + 19, + 6, + 6, + 13, + 5, + 11, + 39, + 2, + 3, + 2, + 3, + 1, + 2, + 1, + 22, + 2, + 2, + 2, + 7, + 7, + 9, + 10, + 4, + 3, + 19, + 3, + 7, + 3, + 18, + 1, + 12, + 0, + 22, + 14, + 11, + 2, + 2 + ], + "weighted_loads": [ + 0.08545288443565369, + 0.0, + 0.15709113609045744, + 0.08819127455353737, + 0.48429368808865547, + 0.08248615264892578, + 0.0, + 0.03773580864071846, + 0.08893278613686562, + 0.07028642110526562, + 0.1376144401729107, + 0.1708204299211502, + 0.24096013605594635, + 0.6398763805627823, + 0.30138396099209785, + 0.26378291845321655, + 0.15870817750692368, + 0.3223392181098461, + 0.41633421555161476, + 0.7875199243426323, + 0.15244780480861664, + 0.17678645625710487, + 0.0, + 0.0, + 0.3627529442310333, + 0.3256672862917185, + 0.11200207658112049, + 1.3546338640153408, + 0.3196938969194889, + 0.342411145567894, + 1.016899149864912, + 0.22038565762341022, + 1.0667068511247635, + 3.4226616080850363, + 0.14350364543497562, + 0.19521957635879517, + 0.08482927083969116, + 0.12719155848026276, + 0.03615724295377731, + 0.2839958518743515, + 0.042653705924749374, + 1.8573202528059483, + 0.04590226896107197, + 0.0686471238732338, + 0.14241717383265495, + 0.36726565659046173, + 0.36451689153909683, + 0.7194338999688625, + 0.7520872391760349, + 0.231453288346529, + 0.18167958036065102, + 1.212019171565771, + 0.1730695627629757, + 0.3875469043850899, + 0.27764445170760155, + 1.3502448722720146, + 0.07219786942005157, + 0.9353544302284718, + 0.0, + 1.3718257565051317, + 0.9654099978506565, + 0.947275560349226, + 0.07830726355314255, + 0.07966714538633823 + ], + "unique_experts": 59, + "load_cv": 1.1467799120435738, + "normalized_load_entropy": 0.8794254203606356, + "max_load_share": 0.1015625 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "ordered_topk_exact_tokens": 17, + "set_exact_tokens": 21, + "mean_set_jaccard": 0.9751552795031057, + "mean_token_weighted_tv": 0.009645886638242266, + "aggregate_load_tv": 0.014492753623188408 + }, + "system_bos": { + "tokens": 23, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 18, + "mean_set_jaccard": 0.9378881987577641, + "mean_token_weighted_tv": 0.019542957251162632, + "aggregate_load_tv": 0.028985507246376815 + }, + "system_x": { + "tokens": 23, + "ordered_topk_exact_tokens": 8, + "set_exact_tokens": 12, + "mean_set_jaccard": 0.8633540372670808, + "mean_token_weighted_tv": 0.029774651943665485, + "aggregate_load_tv": 0.050724637681159424 + }, + "system_period": { + "tokens": 23, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.9130434782608695, + "mean_token_weighted_tv": 0.02389417791172214, + "aggregate_load_tv": 0.036231884057971016 + }, + "bos_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8881987577639753, + "mean_token_weighted_tv": 0.02707748414705629, + "aggregate_load_tv": 0.036231884057971016 + }, + "bos_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 13, + "mean_set_jaccard": 0.8757763975155279, + "mean_token_weighted_tv": 0.028905124727474606, + "aggregate_load_tv": 0.050724637681159424 + }, + "x_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 8, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.9006211180124224, + "mean_token_weighted_tv": 0.02858969115692636, + "aggregate_load_tv": 0.036231884057971016 + }, + "x_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 6, + "set_exact_tokens": 13, + "mean_set_jaccard": 0.8757763975155279, + "mean_token_weighted_tv": 0.03156150946312625, + "aggregate_load_tv": 0.06521739130434784 + }, + "period_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 8, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.9130434782608695, + "mean_token_weighted_tv": 0.025844613819018654, + "aggregate_load_tv": 0.043478260869565216 + }, + "period_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 7, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8881987577639753, + "mean_token_weighted_tv": 0.029428001250261845, + "aggregate_load_tv": 0.050724637681159424 + } + } + }, + "layer_11": { + "layer": 11, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "106d0c05e6f598cd1e7f6d8f3671a0debbff9fef64457883994680b9a30f92c0", + "route_weight_sha256": "0a3f3a2d99b056dde504f03f11bd3d68228c2e85932e9d4795b19e1d7de52d2d", + "loads": [ + 2, + 1, + 0, + 0, + 5, + 1, + 1, + 0, + 3, + 0, + 3, + 5, + 1, + 3, + 0, + 1, + 7, + 4, + 0, + 1, + 1, + 1, + 4, + 1, + 0, + 2, + 15, + 3, + 1, + 4, + 0, + 2, + 0, + 2, + 1, + 2, + 1, + 0, + 10, + 0, + 1, + 3, + 2, + 2, + 2, + 0, + 1, + 2, + 4, + 0, + 1, + 2, + 2, + 0, + 5, + 1, + 3, + 4, + 0, + 12, + 0, + 3, + 0, + 0 + ], + "weighted_loads": [ + 0.15033148974180222, + 0.03851616755127907, + 0.0, + 0.0, + 0.2973000817000866, + 0.04235006496310234, + 0.07184978574514389, + 0.0, + 0.18125713989138603, + 0.0, + 0.2740212418138981, + 0.2772448733448982, + 0.08241070806980133, + 0.13906782120466232, + 0.0, + 0.07493292540311813, + 0.3493912145495415, + 0.29610006138682365, + 0.0, + 0.03920217975974083, + 0.12012258917093277, + 0.07107079029083252, + 0.2868966944515705, + 0.07588066160678864, + 0.0, + 0.07229438796639442, + 1.4258901365101337, + 0.2257348634302616, + 0.05118338391184807, + 0.23136390931904316, + 0.0, + 0.13143646717071533, + 0.0, + 0.092373076826334, + 0.059191424399614334, + 0.08536363393068314, + 0.04096680507063866, + 0.0, + 0.7075071856379509, + 0.0, + 0.035550910979509354, + 0.1482892520725727, + 0.08431348204612732, + 0.09401347115635872, + 0.18332607299089432, + 0.0, + 0.031812507659196854, + 0.08271178975701332, + 0.16773675754666328, + 0.0, + 0.04232441261410713, + 0.06273815222084522, + 0.09751904383301735, + 0.0, + 0.26765765994787216, + 0.054250795394182205, + 0.1758175790309906, + 0.2870873212814331, + 0.0, + 0.6071461252868176, + 0.0, + 0.10803146660327911, + 0.0, + 0.0 + ], + "unique_experts": 46, + "load_cv": 1.294244282571866, + "normalized_load_entropy": 0.8410260468005727, + "max_load_share": 0.10869565217391304 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "d452213239c79efac7d5c8ebe84c22fd460d301fb2cdcb80ec004f00b7297b9e", + "route_weight_sha256": "dd7f64e2761694e3b78baf83c7c75f6f9b0acbb11bed53165d6a59908979520a", + "loads": [ + 2, + 2, + 1, + 0, + 10, + 1, + 1, + 0, + 8, + 1, + 6, + 8, + 1, + 3, + 0, + 7, + 12, + 6, + 12, + 1, + 1, + 1, + 5, + 7, + 0, + 2, + 16, + 4, + 8, + 4, + 6, + 9, + 2, + 2, + 6, + 4, + 1, + 0, + 10, + 0, + 9, + 3, + 2, + 25, + 5, + 0, + 1, + 10, + 4, + 1, + 1, + 2, + 2, + 0, + 12, + 3, + 3, + 4, + 3, + 12, + 0, + 7, + 9, + 0 + ], + "weighted_loads": [ + 0.15033148974180222, + 0.07221260294318199, + 0.05916612222790718, + 0.0, + 0.531737931072712, + 0.04235006496310234, + 0.07184978574514389, + 0.0, + 0.4437726065516472, + 0.031178029254078865, + 0.3461167993955314, + 0.3311563841998577, + 0.08241070806980133, + 0.13906782120466232, + 0.0, + 0.30763901583850384, + 0.8687834180891514, + 0.3259588526561856, + 2.075615484267473, + 0.03920217975974083, + 0.12012258917093277, + 0.07107079029083252, + 0.29083004174754024, + 0.36018262803554535, + 0.0, + 0.07229438796639442, + 1.429244592320174, + 0.23832323495298624, + 0.5535392314195633, + 0.23136390931904316, + 0.2963483799248934, + 0.456319835036993, + 0.0662094596773386, + 0.092373076826334, + 0.2713506445288658, + 0.20987383648753166, + 0.04096680507063866, + 0.0, + 0.7075071856379509, + 0.0, + 0.5118910260498524, + 0.1482892520725727, + 0.08431348204612732, + 2.479430265724659, + 0.3485735096037388, + 0.0, + 0.031812507659196854, + 0.6867446228861809, + 0.16773675754666328, + 0.05645789951086044, + 0.04232441261410713, + 0.06273815222084522, + 0.09751904383301735, + 0.0, + 0.6573482481762767, + 0.14250999316573143, + 0.1758175790309906, + 0.2870873212814331, + 0.13439131900668144, + 0.6071461252868176, + 0.0, + 0.2693422921001911, + 0.5538398250937462, + 0.0 + ], + "unique_experts": 54, + "load_cv": 1.041574069958482, + "normalized_load_entropy": 0.8793580474019853, + "max_load_share": 0.08680555555555555 + } + }, + "s1_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "c20b7210191f501d1b741281c827e40b264d27783ecc0f8ea92dceeecb021df3", + "route_weight_sha256": "8133af15607f6f57286fac21811e783ee2977d67ac983ca782c8757ca5637a19", + "loads": [ + 2, + 1, + 0, + 0, + 5, + 1, + 1, + 0, + 3, + 0, + 3, + 4, + 1, + 3, + 0, + 1, + 7, + 4, + 0, + 1, + 1, + 1, + 4, + 1, + 0, + 2, + 14, + 3, + 0, + 4, + 0, + 2, + 0, + 2, + 1, + 2, + 2, + 0, + 10, + 0, + 1, + 4, + 2, + 2, + 2, + 0, + 1, + 2, + 4, + 0, + 1, + 2, + 2, + 0, + 6, + 1, + 3, + 5, + 0, + 12, + 0, + 2, + 0, + 0 + ], + "weighted_loads": [ + 0.15000076591968536, + 0.03852803260087967, + 0.0, + 0.0, + 0.2947938106954098, + 0.04458698630332947, + 0.07362975925207138, + 0.0, + 0.18244220316410065, + 0.0, + 0.2709823101758957, + 0.24167915061116219, + 0.08416204154491425, + 0.14240742102265358, + 0.0, + 0.07366593182086945, + 0.34739864617586136, + 0.29382751882076263, + 0.0, + 0.04135235399007797, + 0.12276262044906616, + 0.06879227608442307, + 0.28637003526091576, + 0.07926926016807556, + 0.0, + 0.07029381394386292, + 1.3679537028074265, + 0.23071224614977837, + 0.0, + 0.2310746442526579, + 0.0, + 0.13867609947919846, + 0.0, + 0.09176171571016312, + 0.06644177436828613, + 0.08643154427409172, + 0.08006690815091133, + 0.0, + 0.713971920311451, + 0.0, + 0.036740608513355255, + 0.19729341566562653, + 0.07956627383828163, + 0.09439731389284134, + 0.18173710256814957, + 0.0, + 0.03388224542140961, + 0.08300935477018356, + 0.17111237347126007, + 0.0, + 0.04411071911454201, + 0.06304126791656017, + 0.10614807158708572, + 0.0, + 0.2975825071334839, + 0.055071208626031876, + 0.17637411877512932, + 0.31566691026091576, + 0.0, + 0.586797259747982, + 0.0, + 0.07410376518964767, + 0.0, + 0.0 + ], + "unique_experts": 45, + "load_cv": 1.2759386049773311, + "normalized_load_entropy": 0.8397096585152565, + "max_load_share": 0.10144927536231885 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "245483d392885c76b1513d8833bf96f424d07492a12561c752de198659358ef0", + "route_weight_sha256": "2f8ed79309b1d970192481d830d9146ec0ca5c80b1be50e1d831b765794e10b3", + "loads": [ + 4, + 3, + 1, + 0, + 16, + 4, + 1, + 2, + 13, + 0, + 7, + 7, + 1, + 3, + 0, + 2, + 24, + 6, + 11, + 2, + 2, + 2, + 7, + 5, + 0, + 2, + 18, + 5, + 11, + 4, + 8, + 9, + 1, + 2, + 5, + 6, + 2, + 0, + 10, + 1, + 9, + 4, + 2, + 29, + 4, + 0, + 2, + 16, + 4, + 3, + 1, + 2, + 2, + 5, + 29, + 9, + 9, + 6, + 2, + 17, + 1, + 9, + 11, + 1 + ], + "weighted_loads": [ + 0.2977469488978386, + 0.10745849460363388, + 0.04658825322985649, + 0.0, + 0.8749082796275616, + 0.15173330157995224, + 0.07362975925207138, + 0.12910082191228867, + 0.7674024552106857, + 0.0, + 0.38430272974073887, + 0.2950146961957216, + 0.08416204154491425, + 0.14240742102265358, + 0.0, + 0.11453913152217865, + 1.925521146506071, + 0.3228412074968219, + 2.0625468529760838, + 0.07992863655090332, + 0.19659025222063065, + 0.14036502689123154, + 0.3992468900978565, + 0.2559813894331455, + 0.0, + 0.07029381394386292, + 1.4877831807825714, + 0.28201059345155954, + 0.8113262057304382, + 0.2310746442526579, + 0.4055550843477249, + 0.4406532198190689, + 0.03269881382584572, + 0.09176171571016312, + 0.2706861346960068, + 0.4249970205128193, + 0.08006690815091133, + 0.0, + 0.713971920311451, + 0.04580629616975784, + 0.4822835959494114, + 0.19729341566562653, + 0.07956627383828163, + 2.8169408068060875, + 0.3153700791299343, + 0.0, + 0.08054386451840401, + 1.1429118253290653, + 0.17111237347126007, + 0.21924132108688354, + 0.04411071911454201, + 0.06304126791656017, + 0.10614807158708572, + 0.30460743233561516, + 1.6549954889342189, + 0.4242051914334297, + 0.6462795175611973, + 0.3587191663682461, + 0.1020495817065239, + 0.7761259786784649, + 0.03852226957678795, + 0.3762870542705059, + 0.5968561694025993, + 0.04201811924576759 + ], + "unique_experts": 58, + "load_cv": 1.086134199811423, + "normalized_load_entropy": 0.8810582533289621, + "max_load_share": 0.07552083333333333 + } + }, + "s0_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "16f83e4e4e8b54bdb5cabf32c2c5e21bd56f8085a04bc96a12836867bb13a7e3", + "route_weight_sha256": "bfddecef973c18f24d7828b8d4d7fd808dfb95a38b78619fef3fb910e44751fe", + "loads": [ + 2, + 1, + 0, + 0, + 5, + 1, + 1, + 0, + 3, + 0, + 3, + 3, + 1, + 3, + 0, + 1, + 7, + 4, + 1, + 1, + 1, + 1, + 4, + 1, + 0, + 2, + 14, + 4, + 1, + 4, + 0, + 2, + 0, + 2, + 1, + 2, + 2, + 0, + 10, + 0, + 1, + 3, + 2, + 2, + 2, + 0, + 1, + 2, + 4, + 0, + 1, + 1, + 2, + 0, + 5, + 1, + 3, + 4, + 0, + 12, + 0, + 4, + 0, + 0 + ], + "weighted_loads": [ + 0.1482316181063652, + 0.03764556348323822, + 0.0, + 0.0, + 0.3142301142215729, + 0.043511468917131424, + 0.06706511229276657, + 0.0, + 0.17873219028115273, + 0.0, + 0.2812384180724621, + 0.1971551850438118, + 0.07760588824748993, + 0.13030272349715233, + 0.0, + 0.07504406571388245, + 0.3634474612772465, + 0.29009831696748734, + 0.02955940179526806, + 0.040402937680482864, + 0.11797910928726196, + 0.0725461095571518, + 0.28195691481232643, + 0.07481604814529419, + 0.0, + 0.07123269513249397, + 1.3312408104538918, + 0.26260514184832573, + 0.04904377460479736, + 0.23835681565105915, + 0.0, + 0.13554082065820694, + 0.0, + 0.08948861435055733, + 0.06357884407043457, + 0.0877101756632328, + 0.07985450699925423, + 0.0, + 0.684953473508358, + 0.0, + 0.03157639876008034, + 0.14851881936192513, + 0.08668814226984978, + 0.09344066306948662, + 0.18383070081472397, + 0.0, + 0.03495128080248833, + 0.08359489217400551, + 0.17086025699973106, + 0.0, + 0.042091649025678635, + 0.03720305860042572, + 0.09838112816214561, + 0.0, + 0.24712371826171875, + 0.04742896556854248, + 0.1874343939125538, + 0.29313505440950394, + 0.0, + 0.610639926046133, + 0.0, + 0.1426459737122059, + 0.0, + 0.0 + ], + "unique_experts": 47, + "load_cv": 1.2546908413351843, + "normalized_load_entropy": 0.8478677352086905, + "max_load_share": 0.10144927536231885 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "b56da94c1a4354e10781d6e3445bd17920f4bc803445e7c7ef2b929b4abc8cc8", + "route_weight_sha256": "a90b3904ddeeeb2738ad70589078c7505d2ba4ab7bfb599ce0018f85e61990da", + "loads": [ + 2, + 2, + 1, + 0, + 9, + 1, + 1, + 0, + 8, + 2, + 5, + 5, + 1, + 3, + 0, + 9, + 12, + 5, + 12, + 1, + 1, + 1, + 4, + 7, + 0, + 2, + 14, + 6, + 6, + 4, + 6, + 10, + 2, + 2, + 5, + 5, + 2, + 0, + 10, + 0, + 9, + 3, + 2, + 26, + 5, + 0, + 1, + 10, + 4, + 1, + 1, + 1, + 2, + 0, + 11, + 3, + 3, + 4, + 3, + 13, + 0, + 10, + 10, + 0 + ], + "weighted_loads": [ + 0.1482316181063652, + 0.07134199887514114, + 0.05916612222790718, + 0.0, + 0.5078573226928711, + 0.043511468917131424, + 0.06706511229276657, + 0.0, + 0.44191261380910873, + 0.06681228615343571, + 0.3482235884293914, + 0.23900311533361673, + 0.07760588824748993, + 0.13030272349715233, + 0.0, + 0.38244699127972126, + 0.9229887835681438, + 0.30494081787765026, + 1.2090309727936983, + 0.040402937680482864, + 0.11797910928726196, + 0.0725461095571518, + 0.28195691481232643, + 0.3591180145740509, + 0.0, + 0.07123269513249397, + 1.3312408104538918, + 0.32023597229272127, + 0.4285701997578144, + 0.23835681565105915, + 0.2963483799248934, + 0.5592230744659901, + 0.0662094596773386, + 0.08948861435055733, + 0.23569770902395248, + 0.27348193898797035, + 0.07985450699925423, + 0.0, + 0.684953473508358, + 0.0, + 0.539852038025856, + 0.14851881936192513, + 0.08668814226984978, + 2.536519918590784, + 0.34907813742756844, + 0.0, + 0.03495128080248833, + 0.6482364349067211, + 0.17086025699973106, + 0.05645789951086044, + 0.042091649025678635, + 0.03720305860042572, + 0.09838112816214561, + 0.0, + 0.6056578708812594, + 0.12546748667955399, + 0.1874343939125538, + 0.29313505440950394, + 0.13439131900668144, + 0.6444537155330181, + 0.0, + 0.4035671129822731, + 0.6332587599754333, + 0.0 + ], + "unique_experts": 54, + "load_cv": 1.048220125784067, + "normalized_load_entropy": 0.8795879427480476, + "max_load_share": 0.09027777777777778 + } + }, + "s1_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "5a13a202201167b94a42016313c53adb4df54c5a7facf239ff099f1d8d3818c1", + "route_weight_sha256": "50124b58d9985535eca164e83aa639938e921880969a6e51e9db2adaa579b75a", + "loads": [ + 2, + 0, + 0, + 0, + 5, + 1, + 1, + 0, + 3, + 0, + 3, + 4, + 1, + 3, + 0, + 1, + 7, + 4, + 1, + 1, + 1, + 1, + 4, + 1, + 0, + 2, + 14, + 3, + 1, + 4, + 0, + 2, + 0, + 2, + 1, + 2, + 2, + 0, + 10, + 0, + 0, + 4, + 2, + 1, + 2, + 0, + 1, + 2, + 4, + 0, + 1, + 1, + 2, + 0, + 5, + 1, + 4, + 5, + 0, + 12, + 1, + 3, + 0, + 0 + ], + "weighted_loads": [ + 0.15168177336454391, + 0.0, + 0.0, + 0.0, + 0.30719832703471184, + 0.04746007174253464, + 0.068206287920475, + 0.0, + 0.18267672881484032, + 0.0, + 0.2886529862880707, + 0.23106038384139538, + 0.07906113564968109, + 0.1411006860435009, + 0.0, + 0.07258902490139008, + 0.35473742708563805, + 0.29721692204475403, + 0.030643517151474953, + 0.03956059366464615, + 0.12048394232988358, + 0.071748286485672, + 0.2833643965423107, + 0.07918547093868256, + 0.0, + 0.07447946444153786, + 1.3164784759283066, + 0.23521219193935394, + 0.04930250346660614, + 0.23259160108864307, + 0.0, + 0.141880352050066, + 0.0, + 0.09151466563344002, + 0.07227238267660141, + 0.08591097220778465, + 0.08240902051329613, + 0.0, + 0.6978093646466732, + 0.0, + 0.0, + 0.2058165967464447, + 0.08122682571411133, + 0.04078921303153038, + 0.1903785951435566, + 0.0, + 0.03738117963075638, + 0.08424950763583183, + 0.1771305352449417, + 0.0, + 0.042232953011989594, + 0.0372425802052021, + 0.1049475148320198, + 0.0, + 0.2462838552892208, + 0.0461563766002655, + 0.21811915561556816, + 0.3329964838922024, + 0.0, + 0.5764497518539429, + 0.03534112498164177, + 0.10860219597816467, + 0.0, + 0.0 + ], + "unique_experts": 46, + "load_cv": 1.2706599740238225, + "normalized_load_entropy": 0.8420045069813074, + "max_load_share": 0.10144927536231885 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "c85685ab5b49e869871107e6ce4d2d0925caf16ae579ca199be700db6e5ec099", + "route_weight_sha256": "394feecd8eac596a06b8d02217798033f7fbccb95e2c8338c10061a988ba2e86", + "loads": [ + 4, + 1, + 1, + 0, + 16, + 4, + 1, + 2, + 13, + 1, + 6, + 6, + 1, + 3, + 0, + 3, + 25, + 5, + 11, + 2, + 2, + 2, + 6, + 5, + 0, + 2, + 17, + 5, + 10, + 4, + 8, + 9, + 1, + 2, + 5, + 8, + 2, + 0, + 10, + 1, + 8, + 4, + 2, + 29, + 4, + 0, + 2, + 17, + 4, + 3, + 1, + 1, + 2, + 5, + 27, + 8, + 10, + 6, + 2, + 17, + 2, + 13, + 12, + 1 + ], + "weighted_loads": [ + 0.29942795634269714, + 0.033588677644729614, + 0.04658825322985649, + 0.0, + 0.8873127959668636, + 0.1546063870191574, + 0.068206287920475, + 0.12910082191228867, + 0.7747596465051174, + 0.03351188078522682, + 0.3968395469710231, + 0.27300438936799765, + 0.07906113564968109, + 0.1411006860435009, + 0.0, + 0.145119771361351, + 2.0419476367533207, + 0.31205942295491695, + 1.1949171405285597, + 0.0781368762254715, + 0.19431157410144806, + 0.14332103729248047, + 0.3924728110432625, + 0.2558976002037525, + 0.0, + 0.07447946444153786, + 1.4331422746181488, + 0.2865105392411351, + 0.7423560693860054, + 0.23259160108864307, + 0.4055550843477249, + 0.44385747238993645, + 0.03269881382584572, + 0.09151466563344002, + 0.2685484476387501, + 0.5319577679038048, + 0.08240902051329613, + 0.0, + 0.6978093646466732, + 0.04580629616975784, + 0.49267689138650894, + 0.2058165967464447, + 0.08122682571411133, + 3.0232534296810627, + 0.32401157170534134, + 0.0, + 0.08404279872775078, + 1.1568261235952377, + 0.1771305352449417, + 0.21924132108688354, + 0.042232953011989594, + 0.0372425802052021, + 0.1049475148320198, + 0.30460743233561516, + 1.569490804336965, + 0.38069285824894905, + 0.6880245544016361, + 0.3760487399995327, + 0.1020495817065239, + 0.7636396810412407, + 0.07386339455842972, + 0.5397080816328526, + 0.6314028650522232, + 0.04201811924576759 + ], + "unique_experts": 59, + "load_cv": 1.0833333333333333, + "normalized_load_entropy": 0.8815023072789753, + "max_load_share": 0.07552083333333333 + } + }, + "s0_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "03d72123a30a4d144089d9984ae215abbd014fc564ee7f4fad0953f97717fd65", + "route_weight_sha256": "f61b3e0fbd43a0aafc5baa49266c37925ef695eaeb08d4effb88126df324d056", + "loads": [ + 3, + 1, + 0, + 0, + 4, + 1, + 1, + 0, + 3, + 0, + 3, + 5, + 1, + 3, + 0, + 1, + 7, + 4, + 0, + 1, + 1, + 1, + 4, + 1, + 0, + 2, + 16, + 2, + 1, + 4, + 0, + 2, + 0, + 2, + 1, + 1, + 2, + 0, + 10, + 0, + 1, + 2, + 2, + 2, + 2, + 0, + 1, + 2, + 4, + 0, + 1, + 2, + 2, + 0, + 5, + 1, + 3, + 4, + 0, + 12, + 0, + 3, + 1, + 0 + ], + "weighted_loads": [ + 0.1950477957725525, + 0.03671685606241226, + 0.0, + 0.0, + 0.24320100620388985, + 0.04343835636973381, + 0.06901900470256805, + 0.0, + 0.18539735302329063, + 0.0, + 0.2737869881093502, + 0.278864998370409, + 0.08189396560192108, + 0.13150355964899063, + 0.0, + 0.07309337705373764, + 0.3502959720790386, + 0.29136210680007935, + 0.0, + 0.04340841993689537, + 0.11854331195354462, + 0.06972559541463852, + 0.2751120999455452, + 0.07598540931940079, + 0.0, + 0.07200955227017403, + 1.3808151856064796, + 0.19537468999624252, + 0.05056500807404518, + 0.23952192440629005, + 0.0, + 0.14310137555003166, + 0.0, + 0.0903201550245285, + 0.06269823014736176, + 0.04831321910023689, + 0.08414354175329208, + 0.0, + 0.6883816346526146, + 0.0, + 0.03574928268790245, + 0.11825908347964287, + 0.08561955019831657, + 0.09517479315400124, + 0.19086439535021782, + 0.0, + 0.03440476581454277, + 0.08541109412908554, + 0.15981093794107437, + 0.0, + 0.04230634123086929, + 0.06676984019577503, + 0.09354793280363083, + 0.0, + 0.27993155643343925, + 0.05252336710691452, + 0.1822763942182064, + 0.2794223427772522, + 0.0, + 0.6027288846671581, + 0.0, + 0.10845125839114189, + 0.039679985493421555, + 0.0 + ], + "unique_experts": 47, + "load_cv": 1.317406450702936, + "normalized_load_entropy": 0.8421949923449303, + "max_load_share": 0.11594202898550725 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "056b6b18c537f9f1746a4f138caf30394e12c66365b1d6314082b2d6ef628107", + "route_weight_sha256": "a1a149bfb9fbb937d1cc83a42d1cff0bf283a97563e5d7e6e01629b3cb1f016c", + "loads": [ + 3, + 2, + 1, + 0, + 9, + 1, + 1, + 0, + 8, + 1, + 5, + 7, + 1, + 3, + 0, + 7, + 11, + 6, + 12, + 1, + 1, + 1, + 4, + 7, + 0, + 2, + 16, + 3, + 8, + 4, + 6, + 11, + 2, + 2, + 6, + 3, + 2, + 0, + 10, + 0, + 8, + 2, + 2, + 25, + 5, + 0, + 1, + 10, + 4, + 3, + 1, + 2, + 2, + 1, + 10, + 2, + 3, + 4, + 4, + 13, + 0, + 8, + 11, + 0 + ], + "weighted_loads": [ + 0.1950477957725525, + 0.07041329145431519, + 0.05916612222790718, + 0.0, + 0.47472310811281204, + 0.04343835636973381, + 0.06901900470256805, + 0.0, + 0.44556837901473045, + 0.031178029254078865, + 0.3407721584662795, + 0.32071292866021395, + 0.08189396560192108, + 0.13150355964899063, + 0.0, + 0.30579946748912334, + 0.8215702809393406, + 0.3422123659402132, + 1.27250112965703, + 0.04340841993689537, + 0.11854331195354462, + 0.06972559541463852, + 0.2751120999455452, + 0.3602873757481575, + 0.0, + 0.07200955227017403, + 1.3808151856064796, + 0.20796306151896715, + 0.5443841479718685, + 0.23952192440629005, + 0.2963483799248934, + 0.6252476796507835, + 0.0662094596773386, + 0.0903201550245285, + 0.3495292291045189, + 0.19722246751189232, + 0.08414354175329208, + 0.0, + 0.6883816346526146, + 0.0, + 0.44818639010190964, + 0.11825908347964287, + 0.08561955019831657, + 2.275597121566534, + 0.3561118319630623, + 0.0, + 0.03440476581454277, + 0.6761648245155811, + 0.15981093794107437, + 0.14681251347064972, + 0.04230634123086929, + 0.06676984019577503, + 0.09354793280363083, + 0.053918175399303436, + 0.5702743222936988, + 0.08900183439254761, + 0.1822763942182064, + 0.2794223427772522, + 0.1942531205713749, + 0.6411143094301224, + 0.0, + 0.3313876800239086, + 0.6239849403500557, + 0.0 + ], + "unique_experts": 55, + "load_cv": 1.034885333899842, + "normalized_load_entropy": 0.8831805171955166, + "max_load_share": 0.08680555555555555 + } + }, + "s1_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "b654e4b46abdfd2e7deed26cdb971893ee5fd864acc2d32b759282200cef3b5e", + "route_weight_sha256": "eee54612819b162c6f77d32e12d9aca948361bb3d3ec539e6ae22d7e4c6a6b7e", + "loads": [ + 2, + 1, + 0, + 0, + 5, + 1, + 1, + 0, + 3, + 0, + 3, + 4, + 1, + 3, + 0, + 1, + 6, + 4, + 1, + 1, + 1, + 1, + 4, + 1, + 0, + 2, + 14, + 3, + 2, + 4, + 0, + 1, + 0, + 2, + 1, + 2, + 2, + 0, + 10, + 0, + 0, + 4, + 2, + 0, + 2, + 0, + 1, + 2, + 5, + 0, + 1, + 1, + 2, + 0, + 5, + 1, + 3, + 5, + 0, + 12, + 0, + 5, + 0, + 0 + ], + "weighted_loads": [ + 0.1576114371418953, + 0.03649856150150299, + 0.0, + 0.0, + 0.2924431078135967, + 0.043991465121507645, + 0.06949547678232193, + 0.0, + 0.1880853846669197, + 0.0, + 0.28002167493104935, + 0.23036108911037445, + 0.08002019673585892, + 0.153459794819355, + 0.0, + 0.07169590890407562, + 0.2847338616847992, + 0.28433118760585785, + 0.030542585998773575, + 0.04298878461122513, + 0.12417049705982208, + 0.06924859434366226, + 0.2808668203651905, + 0.07971609383821487, + 0.0, + 0.07240452244877815, + 1.3037450388073921, + 0.22277824208140373, + 0.09630069136619568, + 0.23201799020171165, + 0.0, + 0.11143387109041214, + 0.0, + 0.09358560293912888, + 0.07623951882123947, + 0.09417898207902908, + 0.08494772017002106, + 0.0, + 0.7240527160465717, + 0.0, + 0.0, + 0.19694315269589424, + 0.08475027605891228, + 0.0, + 0.19316072762012482, + 0.0, + 0.036520350724458694, + 0.08838694915175438, + 0.21478913351893425, + 0.0, + 0.04264989495277405, + 0.038246482610702515, + 0.10512267798185349, + 0.0, + 0.24549173563718796, + 0.044528234750032425, + 0.18629183992743492, + 0.3172744885087013, + 0.0, + 0.5695477239787579, + 0.0, + 0.18258458375930786, + 0.0, + 0.0 + ], + "unique_experts": 45, + "load_cv": 1.2759386049773311, + "normalized_load_entropy": 0.8382876331904894, + "max_load_share": 0.10144927536231885 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "e80a6166d4caf79175350fcc32032fca0c4eb5c3e23d3e37f30a202d4298ca35", + "route_weight_sha256": "393f6672b6fc6480723e885752fb6e9e06f76015f777347a70795e89aea1aab6", + "loads": [ + 4, + 2, + 1, + 0, + 16, + 4, + 1, + 2, + 13, + 0, + 6, + 6, + 1, + 3, + 0, + 2, + 24, + 5, + 12, + 2, + 2, + 2, + 6, + 5, + 0, + 2, + 17, + 6, + 12, + 4, + 8, + 9, + 1, + 2, + 6, + 6, + 2, + 0, + 10, + 1, + 6, + 5, + 2, + 27, + 4, + 0, + 2, + 15, + 5, + 5, + 1, + 1, + 2, + 6, + 27, + 10, + 9, + 6, + 3, + 17, + 1, + 13, + 11, + 1 + ], + "weighted_loads": [ + 0.3053576201200485, + 0.0700872391462326, + 0.04658825322985649, + 0.0, + 0.8725575767457485, + 0.15113778039813042, + 0.06949547678232193, + 0.12910082191228867, + 0.7846898473799229, + 0.0, + 0.38820823561400175, + 0.2723050946369767, + 0.08002019673585892, + 0.153459794819355, + 0.0, + 0.11256910860538483, + 1.9215644150972366, + 0.2991736885160208, + 1.2715777605772018, + 0.08156506717205048, + 0.19799812883138657, + 0.14082134515047073, + 0.3899752348661423, + 0.25642822310328484, + 0.0, + 0.07240452244877815, + 1.4204088374972343, + 0.3189436877146363, + 0.8473079800605774, + 0.23201799020171165, + 0.4055550843477249, + 0.46303940564393997, + 0.03269881382584572, + 0.09358560293912888, + 0.34438613429665565, + 0.471715547144413, + 0.08494772017002106, + 0.0, + 0.7240527160465717, + 0.04580629616975784, + 0.31867101415991783, + 0.2404746077954769, + 0.08475027605891228, + 2.4721254482865334, + 0.32679370418190956, + 0.0, + 0.0831819698214531, + 1.0708536878228188, + 0.21478913351893425, + 0.30508655682206154, + 0.04264989495277405, + 0.038246482610702515, + 0.10512267798185349, + 0.35611409693956375, + 1.560931128449738, + 0.458794292062521, + 0.6561972387135029, + 0.36032674461603165, + 0.14892997220158577, + 0.7592039667069912, + 0.03852226957678795, + 0.5349145457148552, + 0.6121427267789841, + 0.04201811924576759 + ], + "unique_experts": 58, + "load_cv": 1.0520317644127164, + "normalized_load_entropy": 0.8842439387035596, + "max_load_share": 0.0703125 + } + }, + "s0_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "6b520e48be74aa4b7edc2f02074243cd1e4147620ceea612bdd467a8dd1c2eae", + "route_weight_sha256": "917ec0567174cbbae5f2927d32fec69df08f27a6d22d1d8798a6c1c243079a17", + "loads": [ + 3, + 1, + 0, + 0, + 5, + 1, + 1, + 0, + 3, + 0, + 3, + 5, + 1, + 2, + 0, + 1, + 7, + 4, + 0, + 1, + 1, + 1, + 4, + 1, + 0, + 2, + 17, + 3, + 1, + 4, + 0, + 2, + 0, + 2, + 1, + 1, + 2, + 0, + 10, + 0, + 1, + 2, + 2, + 2, + 2, + 0, + 1, + 1, + 4, + 0, + 1, + 1, + 2, + 0, + 5, + 1, + 3, + 5, + 0, + 12, + 0, + 3, + 0, + 0 + ], + "weighted_loads": [ + 0.19517451897263527, + 0.042979538440704346, + 0.0, + 0.0, + 0.28124312311410904, + 0.0414343997836113, + 0.06889483332633972, + 0.0, + 0.18641680479049683, + 0.0, + 0.27121130377054214, + 0.27485524863004684, + 0.07790861278772354, + 0.090862937271595, + 0.0, + 0.07433179765939713, + 0.33610859140753746, + 0.28387435898184776, + 0.0, + 0.04430482164025307, + 0.1160554438829422, + 0.06810563057661057, + 0.2845044508576393, + 0.07421685010194778, + 0.0, + 0.07090818509459496, + 1.4212883077561855, + 0.21954602748155594, + 0.05214952677488327, + 0.2375413104891777, + 0.0, + 0.13825087994337082, + 0.0, + 0.09242834895849228, + 0.06310146301984787, + 0.0447087325155735, + 0.08365242928266525, + 0.0, + 0.6916896924376488, + 0.0, + 0.03556123375892639, + 0.1157192587852478, + 0.08520401641726494, + 0.08755232766270638, + 0.18606706336140633, + 0.0, + 0.03410162776708603, + 0.04868602752685547, + 0.17259223759174347, + 0.0, + 0.043168097734451294, + 0.028397133573889732, + 0.10195137560367584, + 0.0, + 0.2609071917831898, + 0.04883590340614319, + 0.18052979558706284, + 0.30522265285253525, + 0.0, + 0.6055550910532475, + 0.0, + 0.11361696571111679, + 0.0, + 0.0 + ], + "unique_experts": 46, + "load_cv": 1.3723803595547939, + "normalized_load_entropy": 0.8316803193375276, + "max_load_share": 0.12318840579710146 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "46d39def631763f65bab2185415217f7910c5225079d592622940b23938d5571", + "route_weight_sha256": "d258a1d433e4390bd86653c38040d1df644fc89d5f651bf6ecc1ec6bec2aa7e6", + "loads": [ + 3, + 2, + 1, + 0, + 11, + 1, + 1, + 0, + 8, + 1, + 5, + 7, + 1, + 2, + 0, + 8, + 12, + 5, + 12, + 1, + 1, + 1, + 4, + 7, + 0, + 2, + 17, + 4, + 9, + 4, + 6, + 11, + 2, + 2, + 6, + 4, + 2, + 0, + 10, + 0, + 8, + 2, + 2, + 24, + 5, + 0, + 1, + 9, + 4, + 2, + 1, + 1, + 2, + 0, + 10, + 4, + 3, + 5, + 3, + 13, + 0, + 8, + 8, + 0 + ], + "weighted_loads": [ + 0.19517451897263527, + 0.07667597383260727, + 0.05916612222790718, + 0.0, + 0.5929118357598782, + 0.0414343997836113, + 0.06889483332633972, + 0.0, + 0.4489249251782894, + 0.031178029254078865, + 0.33819647412747145, + 0.3167031789198518, + 0.07790861278772354, + 0.090862937271595, + 0.0, + 0.34425549395382404, + 0.8672529608011246, + 0.2987168598920107, + 1.2211935557425022, + 0.04430482164025307, + 0.1160554438829422, + 0.06810563057661057, + 0.2845044508576393, + 0.3585188165307045, + 0.0, + 0.07090818509459496, + 1.4212883077561855, + 0.23213439900428057, + 0.6010907702147961, + 0.2375413104891777, + 0.2963483799248934, + 0.6268546767532825, + 0.0662094596773386, + 0.09242834895849228, + 0.2998120188713074, + 0.3516998253762722, + 0.08365242928266525, + 0.0, + 0.6916896924376488, + 0.0, + 0.426510039716959, + 0.1157192587852478, + 0.08520401641726494, + 2.2977921441197395, + 0.3513144999742508, + 0.0, + 0.03410162776708603, + 0.6367142908275127, + 0.17259223759174347, + 0.10751636698842049, + 0.043168097734451294, + 0.028397133573889732, + 0.10195137560367584, + 0.0, + 0.5487746288999915, + 0.1723853275179863, + 0.18052979558706284, + 0.30522265285253525, + 0.13439131900668144, + 0.640035342425108, + 0.0, + 0.33594001084566116, + 0.5220169052481651, + 0.0 + ], + "unique_experts": 54, + "load_cv": 1.0371197056996928, + "normalized_load_entropy": 0.8799983593103317, + "max_load_share": 0.08333333333333333 + } + }, + "s1_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "612650d8d051bec52f11b9be9ed0ac26e6eee8301e74c19311cb9703ebae9d24", + "route_weight_sha256": "dea3d7007849631cd88236af93d0754c910446a99329bf4c2d6e59a3b106de24", + "loads": [ + 4, + 1, + 0, + 0, + 5, + 1, + 1, + 0, + 3, + 0, + 3, + 4, + 1, + 3, + 0, + 1, + 6, + 4, + 1, + 1, + 1, + 1, + 4, + 1, + 1, + 2, + 14, + 3, + 2, + 4, + 0, + 1, + 0, + 2, + 1, + 1, + 2, + 0, + 10, + 0, + 1, + 2, + 2, + 0, + 2, + 0, + 1, + 2, + 5, + 0, + 1, + 1, + 3, + 0, + 6, + 1, + 3, + 6, + 0, + 12, + 0, + 1, + 0, + 0 + ], + "weighted_loads": [ + 0.2490059733390808, + 0.03610264137387276, + 0.0, + 0.0, + 0.2857190817594528, + 0.04724719747900963, + 0.06917903572320938, + 0.0, + 0.18877416849136353, + 0.0, + 0.27158914133906364, + 0.2331470586359501, + 0.08053558319807053, + 0.15549194067716599, + 0.0, + 0.0696057453751564, + 0.2809738405048847, + 0.28281620889902115, + 0.029555106535553932, + 0.042407140135765076, + 0.12510022521018982, + 0.06901204586029053, + 0.2776850201189518, + 0.08057377487421036, + 0.030123230069875717, + 0.0731181800365448, + 1.3173335939645767, + 0.2204291820526123, + 0.09881142899394035, + 0.23306784965097904, + 0.0, + 0.10155004262924194, + 0.0, + 0.09570519253611565, + 0.07535528391599655, + 0.04834422469139099, + 0.08627993986010551, + 0.0, + 0.7195803411304951, + 0.0, + 0.03411385789513588, + 0.1011028103530407, + 0.0848706103861332, + 0.0, + 0.1980687491595745, + 0.0, + 0.03686727583408356, + 0.08573385700583458, + 0.21536975726485252, + 0.0, + 0.04361805319786072, + 0.0373915359377861, + 0.14782129228115082, + 0.0, + 0.27939750626683235, + 0.04698711261153221, + 0.1853669062256813, + 0.3592166006565094, + 0.0, + 0.5665682405233383, + 0.0, + 0.03740039840340614, + 0.0, + 0.0 + ], + "unique_experts": 47, + "load_cv": 1.278569748083434, + "normalized_load_entropy": 0.8419766234229689, + "max_load_share": 0.10144927536231885 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "c91528a2e66301f2aee2e8a5b7302856e007f0f3ec2349aede1d850e6d15ba8e", + "route_weight_sha256": "48a1c4cbe267c702660a20f2886befa9014ab2629a557a4acc5b61a54c7a2e54", + "loads": [ + 6, + 2, + 1, + 0, + 17, + 5, + 1, + 2, + 13, + 0, + 6, + 6, + 1, + 3, + 1, + 3, + 23, + 5, + 11, + 2, + 2, + 2, + 6, + 5, + 1, + 2, + 17, + 5, + 14, + 4, + 8, + 9, + 1, + 2, + 6, + 7, + 2, + 0, + 10, + 1, + 7, + 3, + 2, + 27, + 4, + 0, + 2, + 16, + 5, + 4, + 1, + 1, + 3, + 5, + 26, + 10, + 9, + 7, + 2, + 17, + 1, + 9, + 10, + 1 + ], + "weighted_loads": [ + 0.39675215631723404, + 0.06969131901860237, + 0.04658825322985649, + 0.0, + 0.9304022639989853, + 0.195165254175663, + 0.06917903572320938, + 0.12910082191228867, + 0.7849876880645752, + 0.0, + 0.37977570202201605, + 0.27509106416255236, + 0.08053558319807053, + 0.15549194067716599, + 0.03812861815094948, + 0.14356999099254608, + 1.894221380352974, + 0.2976587098091841, + 1.1938287299126387, + 0.08098342269659042, + 0.1989278569817543, + 0.140584796667099, + 0.38679343461990356, + 0.2572859041392803, + 0.030123230069875717, + 0.0731181800365448, + 1.433997392654419, + 0.2717275293543935, + 0.9774487316608429, + 0.23306784965097904, + 0.4055550843477249, + 0.4428755193948746, + 0.03269881382584572, + 0.09570519253611565, + 0.32683881372213364, + 0.549635648727417, + 0.08627993986010551, + 0.0, + 0.7195803411304951, + 0.04580629616975784, + 0.3345076497644186, + 0.1463944911956787, + 0.0848706103861332, + 2.4956454932689667, + 0.33170172572135925, + 0.0, + 0.08352889493107796, + 1.1112502962350845, + 0.21536975726485252, + 0.2603916861116886, + 0.04361805319786072, + 0.0373915359377861, + 0.14782129228115082, + 0.30460743233561516, + 1.510009109042585, + 0.4659945033490658, + 0.6552723050117493, + 0.4022688567638397, + 0.1020495817065239, + 0.7564331628382206, + 0.03852226957678795, + 0.3937113359570503, + 0.5520526245236397, + 0.04201811924576759 + ], + "unique_experts": 60, + "load_cv": 1.0337196858379398, + "normalized_load_entropy": 0.8896009995566103, + "max_load_share": 0.0703125 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "ordered_topk_exact_tokens": 16, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.9503105590062113, + "mean_token_weighted_tv": 0.012022376141470411, + "aggregate_load_tv": 0.02898550724637681 + }, + "system_bos": { + "tokens": 23, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.9254658385093167, + "mean_token_weighted_tv": 0.01676907240534606, + "aggregate_load_tv": 0.036231884057971016 + }, + "system_x": { + "tokens": 23, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8716356107660456, + "mean_token_weighted_tv": 0.028917882227055405, + "aggregate_load_tv": 0.07971014492753624 + }, + "system_period": { + "tokens": 23, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 12, + "mean_set_jaccard": 0.8540372670807455, + "mean_token_weighted_tv": 0.028973714610480743, + "aggregate_load_tv": 0.07246376811594202 + }, + "bos_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.9503105590062112, + "mean_token_weighted_tv": 0.015034630327768948, + "aggregate_load_tv": 0.02898550724637681 + }, + "bos_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.9254658385093167, + "mean_token_weighted_tv": 0.019702179559870907, + "aggregate_load_tv": 0.03623188405797101 + }, + "x_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.9130434782608695, + "mean_token_weighted_tv": 0.022378090566591076, + "aggregate_load_tv": 0.02898550724637681 + }, + "x_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.8913043478260869, + "mean_token_weighted_tv": 0.026022395119071007, + "aggregate_load_tv": 0.050724637681159424 + }, + "period_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.9006211180124224, + "mean_token_weighted_tv": 0.02278232092604689, + "aggregate_load_tv": 0.036231884057971016 + }, + "period_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8695652173913043, + "mean_token_weighted_tv": 0.03031328425783178, + "aggregate_load_tv": 0.06521739130434784 + } + } + }, + "layer_12": { + "layer": 12, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "0793b18fc1b9b9fba72bce06c4752d4327422b9c3c584c780e15d67195f94863", + "route_weight_sha256": "c57ee1c36f600175d1fd650e13cd6893cf901a062af34768d87865536ef8d840", + "loads": [ + 0, + 4, + 0, + 3, + 5, + 5, + 0, + 3, + 0, + 4, + 2, + 0, + 3, + 9, + 1, + 0, + 0, + 1, + 2, + 7, + 2, + 2, + 4, + 2, + 4, + 2, + 3, + 0, + 5, + 0, + 0, + 5, + 0, + 4, + 1, + 2, + 2, + 2, + 3, + 0, + 0, + 4, + 0, + 0, + 2, + 0, + 0, + 0, + 1, + 1, + 1, + 0, + 4, + 3, + 0, + 5, + 1, + 9, + 0, + 3, + 0, + 4, + 1, + 7 + ], + "weighted_loads": [ + 0.0, + 0.24876698479056358, + 0.0, + 0.2142448052763939, + 0.3105907756835222, + 0.6681556291878223, + 0.0, + 0.1811254508793354, + 0.0, + 0.23811006918549538, + 0.16183724999427795, + 0.0, + 0.18272214010357857, + 0.5358388349413872, + 0.028691366314888, + 0.0, + 0.0, + 0.05568987503647804, + 0.10212192311882973, + 0.3723442927002907, + 0.10768423229455948, + 0.0999760627746582, + 0.3169191852211952, + 0.191992849111557, + 0.21625635400414467, + 0.09464357793331146, + 0.13623382151126862, + 0.0, + 0.48214179277420044, + 0.0, + 0.0, + 0.24041136354207993, + 0.0, + 0.17463503777980804, + 0.04380882903933525, + 0.07242225855588913, + 0.09751661121845245, + 0.34130987524986267, + 0.18197571113705635, + 0.0, + 0.0, + 0.31572622805833817, + 0.0, + 0.0, + 0.09723921492695808, + 0.0, + 0.0, + 0.0, + 0.045062437653541565, + 0.040162134915590286, + 0.22475743293762207, + 0.0, + 0.2665613293647766, + 0.17050542309880257, + 0.0, + 0.3349449597299099, + 0.036462996155023575, + 0.5760020297020674, + 0.0, + 0.27857546135783195, + 0.0, + 0.17038140445947647, + 0.038221828639507294, + 0.3735562600195408 + ], + "unique_experts": 42, + "load_cv": 1.0473960269654872, + "normalized_load_entropy": 0.8566211850402066, + "max_load_share": 0.06521739130434782 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "ae66a7a58bdb7ea8e7af498b11d8f6186247d19eacce3f03d269fbe0aa2c7ddd", + "route_weight_sha256": "b2b619626a10eb5a7f8f3d608d46faf8329f434a0cf767e4bc6c97cc6a2909b1", + "loads": [ + 0, + 4, + 0, + 8, + 9, + 6, + 0, + 4, + 6, + 4, + 2, + 0, + 8, + 9, + 1, + 0, + 4, + 1, + 2, + 7, + 3, + 2, + 5, + 7, + 4, + 2, + 4, + 8, + 20, + 11, + 2, + 10, + 1, + 6, + 1, + 9, + 2, + 6, + 18, + 0, + 0, + 10, + 5, + 2, + 4, + 1, + 3, + 5, + 4, + 1, + 2, + 0, + 4, + 3, + 0, + 5, + 4, + 9, + 0, + 6, + 0, + 8, + 5, + 11 + ], + "weighted_loads": [ + 0.0, + 0.24876698479056358, + 0.0, + 0.3433119759429246, + 1.9329665582627058, + 0.6722347480244935, + 0.0, + 0.2567807547748089, + 0.363632146269083, + 0.23811006918549538, + 0.16183724999427795, + 0.0, + 0.4457438476383686, + 0.5358388349413872, + 0.028691366314888, + 0.0, + 0.2364618293941021, + 0.05568987503647804, + 0.10212192311882973, + 0.3723442927002907, + 0.10999944037757814, + 0.0999760627746582, + 0.36287520080804825, + 0.6516294814646244, + 0.21625635400414467, + 0.09464357793331146, + 0.16898612678050995, + 0.4398072212934494, + 2.3237908482551575, + 1.6559666134417057, + 0.06264849286526442, + 0.6552157066762447, + 0.04626423865556717, + 0.2613535560667515, + 0.04380882903933525, + 0.5645674951374531, + 0.09751661121845245, + 0.45483161974698305, + 1.7590563222765923, + 0.0, + 0.0, + 0.8872025571763515, + 0.2852545529603958, + 0.11426697298884392, + 0.18266686424613, + 0.03745822235941887, + 0.16268382966518402, + 0.29497106932103634, + 0.21850017830729485, + 0.040162134915590286, + 0.23771429993212223, + 0.0, + 0.2665613293647766, + 0.17050542309880257, + 0.0, + 0.3349449597299099, + 0.14298386964946985, + 0.5760020297020674, + 0.0, + 0.37268739845603704, + 0.0, + 0.32928721606731415, + 0.20323669724166393, + 0.5050245374441147 + ], + "unique_experts": 53, + "load_cv": 0.9120252866323335, + "normalized_load_entropy": 0.8990816678951797, + "max_load_share": 0.06944444444444445 + } + }, + "s1_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "9e644e2586602e568b8d6eee76f733dc95c027e75a5a5b40ef569f1d9b443d7b", + "route_weight_sha256": "2f40da886cb8d738cd005c6c4381f92861a298e4a9a8dea6549b3573abe416cf", + "loads": [ + 0, + 4, + 0, + 3, + 5, + 5, + 0, + 3, + 0, + 4, + 2, + 1, + 3, + 9, + 0, + 0, + 1, + 1, + 2, + 6, + 2, + 2, + 4, + 2, + 4, + 3, + 3, + 0, + 5, + 0, + 0, + 5, + 0, + 4, + 1, + 2, + 2, + 2, + 2, + 0, + 0, + 4, + 0, + 1, + 2, + 0, + 0, + 0, + 1, + 1, + 1, + 0, + 4, + 3, + 0, + 5, + 0, + 10, + 0, + 2, + 0, + 4, + 1, + 7 + ], + "weighted_loads": [ + 0.0, + 0.2441297546029091, + 0.0, + 0.21319924667477608, + 0.2945348061621189, + 0.6692821830511093, + 0.0, + 0.183689646422863, + 0.0, + 0.2397707924246788, + 0.16733765602111816, + 0.03363847732543945, + 0.19111955165863037, + 0.526443175971508, + 0.0, + 0.0, + 0.03230699524283409, + 0.05580680072307587, + 0.10430831089615822, + 0.3249344415962696, + 0.1118571124970913, + 0.10680874809622765, + 0.31227821484208107, + 0.1685972958803177, + 0.2190922312438488, + 0.12330069579184055, + 0.13640789315104485, + 0.0, + 0.5056712292134762, + 0.0, + 0.0, + 0.2348312772810459, + 0.0, + 0.17577200382947922, + 0.0396609827876091, + 0.0704236552119255, + 0.09856123477220535, + 0.3356495052576065, + 0.1469445303082466, + 0.0, + 0.0, + 0.3243935778737068, + 0.0, + 0.04513537138700485, + 0.09542948752641678, + 0.0, + 0.0, + 0.0, + 0.043255291879177094, + 0.04352053627371788, + 0.2148471623659134, + 0.0, + 0.2707253284752369, + 0.17189990729093552, + 0.0, + 0.3316125236451626, + 0.0, + 0.6110250689089298, + 0.0, + 0.2524358592927456, + 0.0, + 0.17249169386923313, + 0.03905898705124855, + 0.3675549551844597 + ], + "unique_experts": 43, + "load_cv": 1.0505996927211265, + "normalized_load_entropy": 0.859286210422268, + "max_load_share": 0.07246376811594203 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "e077a3406c361c2dff1f4aff56dc0c774446cac758c1db2e8c7b51ca0917a403", + "route_weight_sha256": "49b1dc1e1dddfae9d2d0ee7a958a9318964731280d3d704c54444096da4d94e3", + "loads": [ + 4, + 4, + 0, + 6, + 9, + 6, + 0, + 8, + 7, + 7, + 3, + 1, + 7, + 9, + 0, + 0, + 6, + 3, + 3, + 6, + 3, + 4, + 6, + 8, + 4, + 3, + 6, + 7, + 22, + 16, + 11, + 10, + 4, + 9, + 6, + 9, + 2, + 6, + 21, + 0, + 0, + 16, + 8, + 5, + 14, + 4, + 4, + 7, + 8, + 1, + 3, + 0, + 4, + 6, + 0, + 5, + 3, + 16, + 0, + 6, + 2, + 12, + 7, + 7 + ], + "weighted_loads": [ + 0.19010789692401886, + 0.2441297546029091, + 0.0, + 0.2699282760731876, + 1.9166436083614826, + 0.6732289646752179, + 0.0, + 0.4442192390561104, + 0.4826245717704296, + 0.5571025684475899, + 0.21069300547242165, + 0.03363847732543945, + 0.3880261369049549, + 0.526443175971508, + 0.0, + 0.0, + 0.367907028645277, + 0.16738255694508553, + 0.13960346579551697, + 0.3249344415962696, + 0.11419764393940568, + 0.1984664537012577, + 0.39854853600263596, + 0.6241069510579109, + 0.2190922312438488, + 0.12330069579184055, + 0.25997764617204666, + 0.35815001279115677, + 2.7197457775473595, + 2.4940890818834305, + 0.8596808193251491, + 0.6177324298769236, + 0.17840902507305145, + 0.46478985622525215, + 0.29156599193811417, + 0.6324899289757013, + 0.09856123477220535, + 0.5088512124493718, + 2.0196813195943832, + 0.0, + 0.0, + 1.3757376186549664, + 0.4271541852504015, + 0.2620229460299015, + 1.2387364208698273, + 0.30698514729738235, + 0.22470298781991005, + 0.3983226604759693, + 0.39980100095272064, + 0.04352053627371788, + 0.27967474795877934, + 0.0, + 0.2707253284752369, + 0.3266344964504242, + 0.0, + 0.3316125236451626, + 0.07939915964379907, + 0.8646194115281105, + 0.0, + 0.3743172939866781, + 0.07282910123467445, + 0.5760368164628744, + 0.29464156180620193, + 0.3675549551844597 + ], + "unique_experts": 55, + "load_cv": 0.8025566785107593, + "normalized_load_entropy": 0.9198806234275921, + "max_load_share": 0.057291666666666664 + } + }, + "s0_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "5e3bcd6cba6956b74f22e3dd8a2a09e41ae02e59817048360abd11b7688b9372", + "route_weight_sha256": "8292236dfaaa13cfaff7d1113944a81d91c5d0633a0258e478134e71c2e15fdb", + "loads": [ + 0, + 4, + 0, + 3, + 5, + 6, + 0, + 3, + 0, + 4, + 2, + 0, + 3, + 9, + 1, + 0, + 1, + 1, + 1, + 7, + 2, + 2, + 4, + 2, + 4, + 2, + 3, + 0, + 6, + 0, + 0, + 5, + 0, + 4, + 1, + 2, + 1, + 2, + 2, + 0, + 0, + 4, + 0, + 0, + 1, + 0, + 0, + 0, + 3, + 1, + 1, + 0, + 4, + 3, + 0, + 5, + 1, + 8, + 0, + 3, + 0, + 5, + 1, + 6 + ], + "weighted_loads": [ + 0.0, + 0.2516637034714222, + 0.0, + 0.2101244293153286, + 0.3098677769303322, + 0.6935764160007238, + 0.0, + 0.17971307411789894, + 0.0, + 0.2262434959411621, + 0.1517382711172104, + 0.0, + 0.18383866176009178, + 0.5262229852378368, + 0.03037295490503311, + 0.0, + 0.03582349419593811, + 0.054244402796030045, + 0.06291293352842331, + 0.3613852672278881, + 0.10961101576685905, + 0.08995461091399193, + 0.31499626487493515, + 0.182576272636652, + 0.2217014767229557, + 0.09285708516836166, + 0.1420132778584957, + 0.0, + 0.5482134334743023, + 0.0, + 0.0, + 0.23452448844909668, + 0.0, + 0.1813187263906002, + 0.039609700441360474, + 0.07070807740092278, + 0.05559944733977318, + 0.34150557219982147, + 0.14365257322788239, + 0.0, + 0.0, + 0.32011065632104874, + 0.0, + 0.0, + 0.04953976348042488, + 0.0, + 0.0, + 0.0, + 0.13500985875725746, + 0.03972085937857628, + 0.24035349488258362, + 0.0, + 0.2660229094326496, + 0.17445892095565796, + 0.0, + 0.3564046323299408, + 0.03380473330616951, + 0.5206076242029667, + 0.0, + 0.29018886387348175, + 0.0, + 0.2054443620145321, + 0.04129933938384056, + 0.3590742126107216 + ], + "unique_experts": 43, + "load_cv": 1.0409591169771326, + "normalized_load_entropy": 0.8581442827803515, + "max_load_share": 0.06521739130434782 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "b53a4fcb037cc10f69725d6808f8dba0cb910cb36d6e041178006b742fd188b0", + "route_weight_sha256": "217d830dfaf59876c98ab300037d4d1729624ca2acb41536496614b3e3136925", + "loads": [ + 1, + 4, + 0, + 7, + 8, + 6, + 0, + 5, + 6, + 4, + 2, + 0, + 9, + 9, + 1, + 0, + 6, + 1, + 1, + 7, + 2, + 2, + 5, + 8, + 4, + 2, + 5, + 8, + 22, + 12, + 2, + 11, + 1, + 6, + 1, + 9, + 1, + 6, + 17, + 0, + 0, + 10, + 4, + 2, + 2, + 1, + 2, + 4, + 7, + 1, + 2, + 0, + 4, + 3, + 0, + 5, + 3, + 8, + 0, + 6, + 0, + 9, + 4, + 10 + ], + "weighted_loads": [ + 0.058129485696554184, + 0.2516637034714222, + 0.0, + 0.33608499728143215, + 0.9819385148584843, + 0.6935764160007238, + 0.0, + 0.30105283856391907, + 0.3849908821284771, + 0.2262434959411621, + 0.1517382711172104, + 0.0, + 0.5307247377932072, + 0.5262229852378368, + 0.03037295490503311, + 0.0, + 0.3015320934355259, + 0.054244402796030045, + 0.06291293352842331, + 0.3613852672278881, + 0.10961101576685905, + 0.08995461091399193, + 0.3609522804617882, + 0.6836712919175625, + 0.2217014767229557, + 0.09285708516836166, + 0.2155873440206051, + 0.4398072212934494, + 2.4201221466064453, + 1.5779122039675713, + 0.06264849286526442, + 0.6951532401144505, + 0.04626423865556717, + 0.259052287787199, + 0.039609700441360474, + 0.5628533139824867, + 0.05559944733977318, + 0.45502731669694185, + 1.6334955282509327, + 0.0, + 0.0, + 0.8434043861925602, + 0.266763161867857, + 0.10158896446228027, + 0.09806550294160843, + 0.03745822235941887, + 0.10778435319662094, + 0.22015881352126598, + 0.3748641386628151, + 0.03972085937857628, + 0.2533103618770838, + 0.0, + 0.2660229094326496, + 0.17445892095565796, + 0.0, + 0.3564046323299408, + 0.13573529943823814, + 0.5206076242029667, + 0.0, + 0.4326352486386895, + 0.0, + 0.36435017362236977, + 0.15955344773828983, + 0.4905424900352955 + ], + "unique_experts": 54, + "load_cv": 0.9460770203292446, + "normalized_load_entropy": 0.8945332386860706, + "max_load_share": 0.0763888888888889 + } + }, + "s1_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "f5eaf4fd05c1ddf25707aff97d7ae8d6c9bc8438b8bb3d75dd77b6b5e3dbf9aa", + "route_weight_sha256": "5a246cf34f626771f92dc655a69ff6aa1043038fe6862621af55f27b5f83a7fa", + "loads": [ + 0, + 4, + 0, + 3, + 4, + 5, + 0, + 3, + 0, + 5, + 2, + 0, + 3, + 9, + 1, + 0, + 1, + 1, + 2, + 7, + 2, + 2, + 4, + 3, + 5, + 3, + 2, + 0, + 5, + 0, + 0, + 5, + 0, + 4, + 0, + 2, + 2, + 2, + 3, + 0, + 0, + 4, + 0, + 0, + 1, + 0, + 0, + 0, + 2, + 0, + 1, + 0, + 4, + 3, + 0, + 5, + 1, + 9, + 0, + 2, + 0, + 4, + 1, + 7 + ], + "weighted_loads": [ + 0.0, + 0.2453702762722969, + 0.0, + 0.2193114273250103, + 0.2980429232120514, + 0.6742169186472893, + 0.0, + 0.1839652620255947, + 0.0, + 0.2642345707863569, + 0.1549137979745865, + 0.0, + 0.19378182291984558, + 0.5140092931687832, + 0.0394665002822876, + 0.0, + 0.03646267578005791, + 0.05450880154967308, + 0.10093352943658829, + 0.3746752105653286, + 0.1094011552631855, + 0.10195964947342873, + 0.31471988558769226, + 0.210956621915102, + 0.25878313556313515, + 0.1198830883949995, + 0.11086353659629822, + 0.0, + 0.4698949456214905, + 0.0, + 0.0, + 0.23094924539327621, + 0.0, + 0.180023193359375, + 0.0, + 0.0716589018702507, + 0.10162050649523735, + 0.3443479388952255, + 0.1828678846359253, + 0.0, + 0.0, + 0.302154116332531, + 0.0, + 0.0, + 0.04924502968788147, + 0.0, + 0.0, + 0.0, + 0.08884360641241074, + 0.0, + 0.2402506172657013, + 0.0, + 0.27094603329896927, + 0.1698382906615734, + 0.0, + 0.36311202123761177, + 0.03603438287973404, + 0.5931455679237843, + 0.0, + 0.2393162101507187, + 0.0, + 0.1737260464578867, + 0.04132247716188431, + 0.3831841051578522 + ], + "unique_experts": 41, + "load_cv": 1.0601526048044403, + "normalized_load_entropy": 0.8522617158681813, + "max_load_share": 0.06521739130434782 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "cf3d537f6fb6293fd9b418b7ad16b2c239b54657e2a105993dcdfb5c959fb3a2", + "route_weight_sha256": "8bc17845240ef5f2624e1acbf5303375f752c877db8e016e35b59e81a511e9fa", + "loads": [ + 4, + 4, + 0, + 5, + 7, + 5, + 0, + 9, + 7, + 8, + 3, + 0, + 8, + 9, + 1, + 0, + 7, + 3, + 3, + 7, + 2, + 4, + 6, + 9, + 5, + 3, + 5, + 7, + 22, + 19, + 11, + 11, + 4, + 8, + 5, + 9, + 2, + 6, + 23, + 0, + 0, + 16, + 6, + 4, + 13, + 4, + 4, + 7, + 10, + 0, + 3, + 0, + 4, + 6, + 0, + 5, + 3, + 15, + 0, + 6, + 2, + 12, + 6, + 7 + ], + "weighted_loads": [ + 0.19010789692401886, + 0.2453702762722969, + 0.0, + 0.27309475652873516, + 0.9699279218912125, + 0.6742169186472893, + 0.0, + 0.48634300008416176, + 0.5335396565496922, + 0.581566346809268, + 0.19826914742588997, + 0.0, + 0.5227542072534561, + 0.5140092931687832, + 0.0394665002822876, + 0.0, + 0.44976408034563065, + 0.16608455777168274, + 0.13622868433594704, + 0.3746752105653286, + 0.1094011552631855, + 0.19361735507845879, + 0.40099020674824715, + 0.6664662770926952, + 0.25878313556313515, + 0.1198830883949995, + 0.23443328961730003, + 0.35815001279115677, + 2.7829525284469128, + 2.532667811959982, + 0.8596808193251491, + 0.6470411811023951, + 0.17840902507305145, + 0.42266079038381577, + 0.25190500915050507, + 0.6337251756340265, + 0.10162050649523735, + 0.5175496460869908, + 2.1139825507998466, + 0.0, + 0.0, + 1.35735122859478, + 0.35742855817079544, + 0.21638835966587067, + 1.192551963031292, + 0.30698514729738235, + 0.20160744339227676, + 0.3867582865059376, + 0.5055116713047028, + 0.0, + 0.30507820285856724, + 0.0, + 0.27094603329896927, + 0.3245728798210621, + 0.0, + 0.36311202123761177, + 0.0954893883317709, + 0.8467399105429649, + 0.0, + 0.39566143695265055, + 0.07282910123467445, + 0.577271169051528, + 0.2629399597644806, + 0.3831841051578522 + ], + "unique_experts": 54, + "load_cv": 0.8400768814023314, + "normalized_load_entropy": 0.9139698984228927, + "max_load_share": 0.059895833333333336 + } + }, + "s0_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "57eca30c7ad3064a192f61fa3f4b7c435066f5fa656e27758a8d3bd0515fdb10", + "route_weight_sha256": "f5cbc1f6523eac8d9a9a97e482994cc24c9ba4f28ac598451c46d3b795ec2bb3", + "loads": [ + 0, + 4, + 0, + 3, + 4, + 5, + 0, + 3, + 1, + 5, + 2, + 1, + 2, + 10, + 0, + 0, + 1, + 1, + 1, + 6, + 2, + 2, + 3, + 2, + 4, + 2, + 3, + 1, + 6, + 0, + 0, + 4, + 0, + 4, + 1, + 2, + 2, + 2, + 3, + 0, + 0, + 5, + 0, + 0, + 2, + 0, + 0, + 0, + 2, + 1, + 1, + 0, + 4, + 3, + 0, + 5, + 1, + 8, + 0, + 3, + 0, + 4, + 1, + 6 + ], + "weighted_loads": [ + 0.0, + 0.2450975812971592, + 0.0, + 0.19351720809936523, + 0.2734992951154709, + 0.6637040600180626, + 0.0, + 0.18040971085429192, + 0.030814163386821747, + 0.2682140860706568, + 0.16345886141061783, + 0.03295370191335678, + 0.12925751507282257, + 0.5497083701193333, + 0.0, + 0.0, + 0.04594207555055618, + 0.05574880167841911, + 0.06358218938112259, + 0.2974758446216583, + 0.11626607179641724, + 0.09075572714209557, + 0.2907184064388275, + 0.16602683439850807, + 0.20123719424009323, + 0.09088627994060516, + 0.13358088582754135, + 0.027080483734607697, + 0.5546562895178795, + 0.0, + 0.0, + 0.19113989919424057, + 0.0, + 0.17344221100211143, + 0.043718501925468445, + 0.07751194015145302, + 0.08268708735704422, + 0.3309980779886246, + 0.21519939973950386, + 0.0, + 0.0, + 0.3454412557184696, + 0.0, + 0.0, + 0.09353632852435112, + 0.0, + 0.0, + 0.0, + 0.09259212017059326, + 0.042598482221364975, + 0.2335943877696991, + 0.0, + 0.26528172567486763, + 0.17279141023755074, + 0.0, + 0.3373914174735546, + 0.04469078406691551, + 0.5190872699022293, + 0.0, + 0.29408813640475273, + 0.0, + 0.1876948829740286, + 0.04078155383467674, + 0.34625008702278137 + ], + "unique_experts": 45, + "load_cv": 1.0114862281979269, + "normalized_load_entropy": 0.8689673848558471, + "max_load_share": 0.07246376811594203 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "913dda3be719b6a637a50c605ecb03d65871a94aa825716de6fdaf30ce10a809", + "route_weight_sha256": "a61e4edba6ca82c89ae43521df9664afb451ede4d422110cfd92fb4b13e843d2", + "loads": [ + 0, + 4, + 0, + 7, + 7, + 5, + 0, + 4, + 7, + 5, + 2, + 1, + 7, + 10, + 0, + 0, + 4, + 1, + 1, + 6, + 2, + 2, + 4, + 9, + 4, + 2, + 4, + 10, + 24, + 11, + 3, + 9, + 1, + 6, + 1, + 10, + 2, + 6, + 17, + 0, + 0, + 11, + 6, + 1, + 3, + 2, + 2, + 5, + 6, + 1, + 2, + 0, + 4, + 3, + 0, + 5, + 3, + 8, + 0, + 5, + 0, + 9, + 4, + 10 + ], + "weighted_loads": [ + 0.0, + 0.2450975812971592, + 0.0, + 0.3194777760654688, + 0.945570033043623, + 0.6637040600180626, + 0.0, + 0.2560650147497654, + 0.37664564326405525, + 0.2682140860706568, + 0.16345886141061783, + 0.03295370191335678, + 0.4006982296705246, + 0.5497083701193333, + 0.0, + 0.0, + 0.23758138343691826, + 0.05574880167841911, + 0.06358218938112259, + 0.2974758446216583, + 0.11626607179641724, + 0.09075572714209557, + 0.33667442202568054, + 0.8170644007623196, + 0.20123719424009323, + 0.09088627994060516, + 0.16633319109678268, + 0.5247940048575401, + 2.7061949856579304, + 1.2971552163362503, + 0.11541942413896322, + 0.6404868774116039, + 0.04626423865556717, + 0.25299888849258423, + 0.043718501925468445, + 0.6459063068032265, + 0.08268708735704422, + 0.44451982248574495, + 1.5548598393797874, + 0.0, + 0.0, + 0.8952716886997223, + 0.34311074391007423, + 0.05092529207468033, + 0.14206206798553467, + 0.08903667703270912, + 0.10523971542716026, + 0.26013737358152866, + 0.34297284111380577, + 0.042598482221364975, + 0.24655125476419926, + 0.0, + 0.26528172567486763, + 0.17279141023755074, + 0.0, + 0.3373914174735546, + 0.14662135019898415, + 0.5190872699022293, + 0.0, + 0.3797352770343423, + 0.0, + 0.4187090303748846, + 0.15903566218912601, + 0.47771836444735527 + ], + "unique_experts": 53, + "load_cv": 0.9710310162749186, + "normalized_load_entropy": 0.8921396252501617, + "max_load_share": 0.08333333333333333 + } + }, + "s1_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "b5300186a079d4cf414095f6b450cc250291e6090fb8f6fde19bcb8f9c246b42", + "route_weight_sha256": "922e4ced48fba60c7df50a26aca1176b2ab65b7d573f2a8ff801b7dbdcd891b5", + "loads": [ + 0, + 4, + 0, + 3, + 4, + 5, + 0, + 3, + 0, + 5, + 2, + 1, + 3, + 9, + 0, + 0, + 0, + 1, + 2, + 6, + 2, + 2, + 4, + 3, + 3, + 2, + 2, + 1, + 6, + 0, + 0, + 4, + 0, + 4, + 1, + 2, + 2, + 2, + 3, + 1, + 0, + 5, + 0, + 0, + 1, + 0, + 0, + 0, + 2, + 1, + 1, + 0, + 4, + 3, + 0, + 5, + 1, + 9, + 0, + 3, + 0, + 3, + 1, + 7 + ], + "weighted_loads": [ + 0.0, + 0.24245073646306992, + 0.0, + 0.19716248661279678, + 0.2677424717694521, + 0.6706975549459457, + 0.0, + 0.18721380457282066, + 0.0, + 0.27638840675354004, + 0.15977630019187927, + 0.03486248478293419, + 0.17044278979301453, + 0.5474080629646778, + 0.0, + 0.0, + 0.0, + 0.05767391622066498, + 0.1043582633137703, + 0.3095698095858097, + 0.11384522914886475, + 0.10280648991465569, + 0.321462195366621, + 0.20271816104650497, + 0.17518534138798714, + 0.09555657207965851, + 0.10153669863939285, + 0.02845034934580326, + 0.5552585497498512, + 0.0, + 0.0, + 0.18124981224536896, + 0.0, + 0.17585287615656853, + 0.04097020626068115, + 0.07415270060300827, + 0.09941025450825691, + 0.3276434689760208, + 0.17943791672587395, + 0.03912836313247681, + 0.0, + 0.33507920056581497, + 0.0, + 0.0, + 0.04845020920038223, + 0.0, + 0.0, + 0.0, + 0.09603070095181465, + 0.04267812892794609, + 0.24106092751026154, + 0.0, + 0.2683250717818737, + 0.17913823202252388, + 0.0, + 0.3556547835469246, + 0.03849576413631439, + 0.5407620556652546, + 0.0, + 0.2778538428246975, + 0.0, + 0.15786569751799107, + 0.0411742739379406, + 0.3859296031296253 + ], + "unique_experts": 44, + "load_cv": 1.0246899521341177, + "normalized_load_entropy": 0.8647513781753021, + "max_load_share": 0.06521739130434782 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "186eb76a9230b2ff61983e259139eaa6dfef319847618a25e411d08742bb8b3b", + "route_weight_sha256": "33d810b6313fb178410d5f7263fcd81b0f7f382d41479ec54cc2ea6caa50d7aa", + "loads": [ + 4, + 4, + 0, + 5, + 7, + 5, + 0, + 9, + 7, + 8, + 3, + 1, + 7, + 9, + 0, + 0, + 4, + 3, + 3, + 6, + 2, + 5, + 6, + 10, + 3, + 2, + 5, + 9, + 25, + 15, + 12, + 9, + 4, + 8, + 6, + 10, + 2, + 6, + 22, + 1, + 0, + 16, + 9, + 4, + 14, + 5, + 4, + 6, + 9, + 1, + 3, + 0, + 4, + 6, + 0, + 5, + 2, + 16, + 0, + 6, + 2, + 12, + 6, + 7 + ], + "weighted_loads": [ + 0.19010789692401886, + 0.24245073646306992, + 0.0, + 0.25094581581652164, + 0.9396274704486132, + 0.6706975549459457, + 0.0, + 0.5060229487717152, + 0.46037178486585617, + 0.5937201827764511, + 0.20313164964318275, + 0.03486248478293419, + 0.3495052754878998, + 0.5474080629646778, + 0.0, + 0.0, + 0.3180270567536354, + 0.16924967244267464, + 0.13965341821312904, + 0.3095698095858097, + 0.11384522914886475, + 0.22757821530103683, + 0.4077325165271759, + 0.7902880609035492, + 0.17518534138798714, + 0.09555657207965851, + 0.22510645166039467, + 0.46146791614592075, + 3.0908790044486523, + 1.9060557968914509, + 0.8998922584578395, + 0.5624657776206732, + 0.17840902507305145, + 0.4184904731810093, + 0.2928752154111862, + 0.736006448045373, + 0.09941025450825691, + 0.5008451761677861, + 1.7547658942639828, + 0.03912836313247681, + 0.0, + 1.3823479637503624, + 0.5232191160321236, + 0.2023560330271721, + 1.232680980116129, + 0.3489958271384239, + 0.21037157252430916, + 0.2976674251258373, + 0.47197871282696724, + 0.04267812892794609, + 0.3058885131031275, + 0.0, + 0.2683250717818737, + 0.33387282118201256, + 0.0, + 0.3556547835469246, + 0.06614276207983494, + 0.8410982228815556, + 0.0, + 0.39187627378851175, + 0.07282910123467445, + 0.6152769532054663, + 0.2627917565405369, + 0.3859296031296253 + ], + "unique_experts": 56, + "load_cv": 0.8472791419859481, + "normalized_load_entropy": 0.9152540546341122, + "max_load_share": 0.06510416666666667 + } + }, + "s0_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "711d610b051cdd39d16e591f2020ce1befb258a90e844857ed4f3f89aebcf4ef", + "route_weight_sha256": "7521e0619f46c9748d5d1bbd7c08abc8c35ca1c788846410a93dedd7d37aab7a", + "loads": [ + 0, + 4, + 0, + 3, + 4, + 5, + 0, + 3, + 0, + 5, + 2, + 1, + 3, + 10, + 1, + 0, + 2, + 1, + 1, + 5, + 2, + 2, + 3, + 2, + 4, + 2, + 3, + 0, + 6, + 0, + 0, + 5, + 0, + 4, + 0, + 2, + 1, + 2, + 2, + 1, + 0, + 5, + 0, + 0, + 1, + 0, + 0, + 0, + 3, + 1, + 1, + 0, + 4, + 3, + 0, + 5, + 1, + 8, + 0, + 3, + 0, + 5, + 1, + 6 + ], + "weighted_loads": [ + 0.0, + 0.24886274337768555, + 0.0, + 0.2010997198522091, + 0.2564174011349678, + 0.6542741358280182, + 0.0, + 0.17971286550164223, + 0.0, + 0.2535213492810726, + 0.16116398572921753, + 0.034109584987163544, + 0.17554213479161263, + 0.5844552777707577, + 0.04471847787499428, + 0.0, + 0.07801696471869946, + 0.05502661317586899, + 0.06277702003717422, + 0.265306793153286, + 0.11196611821651459, + 0.09795733168721199, + 0.2872418910264969, + 0.18432006239891052, + 0.20592213794589043, + 0.09235963225364685, + 0.13558419048786163, + 0.0, + 0.5355810932815075, + 0.0, + 0.0, + 0.22695885226130486, + 0.0, + 0.17557717859745026, + 0.0, + 0.07544908672571182, + 0.05204450339078903, + 0.32437559962272644, + 0.150669626891613, + 0.03716345503926277, + 0.0, + 0.3492322489619255, + 0.0, + 0.0, + 0.058284591883420944, + 0.0, + 0.0, + 0.0, + 0.1365262232720852, + 0.04661316052079201, + 0.23065607249736786, + 0.0, + 0.26045603305101395, + 0.17781445756554604, + 0.0, + 0.34257539361715317, + 0.03849802538752556, + 0.4917706102132797, + 0.0, + 0.29355598613619804, + 0.0, + 0.2137251179665327, + 0.040850792080163956, + 0.34912334010005 + ], + "unique_experts": 44, + "load_cv": 1.0246899521341177, + "normalized_load_entropy": 0.864047054033206, + "max_load_share": 0.07246376811594203 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "494763fa145056db6a6319cad3bbba2a733874ceae35c919f1a3bde886d34c04", + "route_weight_sha256": "75c831622a7fe3a74cb3e126bc80c1730dbecd1eedcdcd8f9ce3097322b07ddb", + "loads": [ + 0, + 4, + 0, + 7, + 7, + 5, + 0, + 5, + 6, + 5, + 2, + 1, + 8, + 10, + 1, + 0, + 6, + 1, + 1, + 5, + 2, + 2, + 4, + 9, + 4, + 2, + 4, + 9, + 23, + 10, + 2, + 10, + 1, + 6, + 0, + 10, + 1, + 6, + 16, + 1, + 0, + 12, + 5, + 1, + 2, + 1, + 2, + 5, + 6, + 1, + 2, + 0, + 4, + 3, + 0, + 5, + 4, + 8, + 0, + 5, + 0, + 10, + 6, + 10 + ], + "weighted_loads": [ + 0.0, + 0.24886274337768555, + 0.0, + 0.32706028781831264, + 0.9284881390631199, + 0.6542741358280182, + 0.0, + 0.3021468110382557, + 0.3348268233239651, + 0.2535213492810726, + 0.16116398572921753, + 0.034109584987163544, + 0.45167552307248116, + 0.5844552777707577, + 0.04471847787499428, + 0.0, + 0.31783157773315907, + 0.05502661317586899, + 0.06277702003717422, + 0.265306793153286, + 0.11196611821651459, + 0.09795733168721199, + 0.3331979066133499, + 0.7458611242473125, + 0.20592213794589043, + 0.09235963225364685, + 0.16833649575710297, + 0.48145679384469986, + 2.710464660078287, + 1.3038105852901936, + 0.06264849286526442, + 0.6447821855545044, + 0.04626423865556717, + 0.26018815487623215, + 0.0, + 0.6205773092806339, + 0.05204450339078903, + 0.4378973441198468, + 1.5218623243272305, + 0.03716345503926277, + 0.0, + 0.9946613237261772, + 0.29697004333138466, + 0.05222062021493912, + 0.10681033134460449, + 0.03745822235941887, + 0.11911289766430855, + 0.2583527360111475, + 0.3446000777184963, + 0.04661316052079201, + 0.24361293949186802, + 0.0, + 0.26045603305101395, + 0.17781445756554604, + 0.0, + 0.34257539361715317, + 0.17035133205354214, + 0.4917706102132797, + 0.0, + 0.3792031267657876, + 0.0, + 0.42757475562393665, + 0.24813777767121792, + 0.48059161752462387 + ], + "unique_experts": 54, + "load_cv": 0.9558139185602919, + "normalized_load_entropy": 0.8932343515427035, + "max_load_share": 0.0798611111111111 + } + }, + "s1_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "c473ea70ddb4d20dffa307bbd6961769c7fe331fe3d163f810be99d1680aaf91", + "route_weight_sha256": "ee8fd2f80e74c252d97e05908663cbad7386243b3df7a76365c60f95fc2a4534", + "loads": [ + 0, + 4, + 0, + 3, + 4, + 5, + 0, + 3, + 0, + 5, + 2, + 1, + 3, + 11, + 0, + 0, + 1, + 1, + 2, + 6, + 2, + 2, + 4, + 2, + 4, + 2, + 2, + 0, + 6, + 0, + 0, + 4, + 0, + 3, + 0, + 2, + 3, + 2, + 3, + 1, + 0, + 4, + 0, + 0, + 1, + 0, + 0, + 0, + 2, + 1, + 1, + 0, + 5, + 3, + 0, + 5, + 0, + 9, + 0, + 3, + 0, + 4, + 1, + 6 + ], + "weighted_loads": [ + 0.0, + 0.24386964738368988, + 0.0, + 0.21356485411524773, + 0.26030867360532284, + 0.6584197022020817, + 0.0, + 0.18476079404354095, + 0.0, + 0.26780930906534195, + 0.15711190551519394, + 0.03469812870025635, + 0.1768750697374344, + 0.6259351503103971, + 0.0, + 0.0, + 0.0429869182407856, + 0.05589672178030014, + 0.10791465640068054, + 0.31319138407707214, + 0.11284945160150528, + 0.12030666507780552, + 0.31995629519224167, + 0.17777185142040253, + 0.21550501883029938, + 0.09691819176077843, + 0.10130288079380989, + 0.0, + 0.5325669273734093, + 0.0, + 0.0, + 0.1819569580256939, + 0.0, + 0.1446746475994587, + 0.0, + 0.0746186189353466, + 0.1332637295126915, + 0.32126106321811676, + 0.1783364899456501, + 0.041387490928173065, + 0.0, + 0.28905998170375824, + 0.0, + 0.0, + 0.05008672922849655, + 0.0, + 0.0, + 0.0, + 0.09526810422539711, + 0.04200147092342377, + 0.23458682000637054, + 0.0, + 0.3125019557774067, + 0.18449180200695992, + 0.0, + 0.3589020371437073, + 0.0, + 0.5006550885736942, + 0.0, + 0.27455612644553185, + 0.0, + 0.19231245294213295, + 0.0401780940592289, + 0.3456464186310768 + ], + "unique_experts": 42, + "load_cv": 1.0758856494473892, + "normalized_load_entropy": 0.854331298658648, + "max_load_share": 0.07971014492753623 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "d2266e61cb069a3a3ccd0ad122417df9e565e13b0c355a4ae41816a9a61d0b9e", + "route_weight_sha256": "a3bc8b8a8219d9501a94aa0d8454cc89d556fde3046e24b923693eca39e47604", + "loads": [ + 4, + 4, + 0, + 5, + 7, + 5, + 0, + 10, + 7, + 8, + 3, + 1, + 7, + 11, + 0, + 0, + 5, + 3, + 3, + 6, + 2, + 4, + 6, + 9, + 4, + 2, + 5, + 7, + 25, + 15, + 11, + 9, + 4, + 7, + 5, + 10, + 3, + 6, + 22, + 1, + 0, + 16, + 9, + 3, + 14, + 4, + 4, + 8, + 9, + 1, + 3, + 0, + 5, + 6, + 0, + 5, + 1, + 15, + 0, + 6, + 2, + 13, + 8, + 6 + ], + "weighted_loads": [ + 0.19010789692401886, + 0.24386964738368988, + 0.0, + 0.2673481833189726, + 0.9321936722844839, + 0.6584197022020817, + 0.0, + 0.5289469659328461, + 0.4646196514368057, + 0.585141085088253, + 0.20046725496649742, + 0.03469812870025635, + 0.34724055603146553, + 0.6259351503103971, + 0.0, + 0.0, + 0.37023619934916496, + 0.1674724780023098, + 0.1432098113000393, + 0.31319138407707214, + 0.11284945160150528, + 0.21196437068283558, + 0.40622661635279655, + 0.6868091858923435, + 0.21550501883029938, + 0.09691819176077843, + 0.2248726338148117, + 0.35815001279115677, + 3.0789852030575275, + 1.9285726137459278, + 0.8596808193251491, + 0.5487091112881899, + 0.17840902507305145, + 0.38731224462389946, + 0.25190500915050507, + 0.6924601774662733, + 0.1332637295126915, + 0.49446277040988207, + 1.7623609490692616, + 0.041387490928173065, + 0.0, + 1.4402252584695816, + 0.549233004450798, + 0.1665855422616005, + 1.238666657358408, + 0.30698514729738235, + 0.22177951037883759, + 0.3705272451043129, + 0.4753752090036869, + 0.04200147092342377, + 0.2994144055992365, + 0.0, + 0.3125019557774067, + 0.3392263911664486, + 0.0, + 0.3589020371437073, + 0.027646997943520546, + 0.7542494311928749, + 0.0, + 0.3885785574093461, + 0.07282910123467445, + 0.6515918262302876, + 0.33786000683903694, + 0.3456464186310768 + ], + "unique_experts": 56, + "load_cv": 0.846766726370899, + "normalized_load_entropy": 0.9149436018306996, + "max_load_share": 0.06510416666666667 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 18, + "mean_set_jaccard": 0.9378881987577641, + "mean_token_weighted_tv": 0.01563397786863472, + "aggregate_load_tv": 0.036231884057971016 + }, + "system_bos": { + "tokens": 23, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8788819875776398, + "mean_token_weighted_tv": 0.02527098697812661, + "aggregate_load_tv": 0.06521739130434782 + }, + "system_x": { + "tokens": 23, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 13, + "mean_set_jaccard": 0.875776397515528, + "mean_token_weighted_tv": 0.02751056659642769, + "aggregate_load_tv": 0.050724637681159424 + }, + "system_period": { + "tokens": 23, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 13, + "mean_set_jaccard": 0.8571428571428572, + "mean_token_weighted_tv": 0.030976139373429443, + "aggregate_load_tv": 0.06521739130434782 + }, + "bos_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.9130434782608695, + "mean_token_weighted_tv": 0.021810941519620625, + "aggregate_load_tv": 0.043478260869565216 + }, + "bos_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8788819875776398, + "mean_token_weighted_tv": 0.02706891018897295, + "aggregate_load_tv": 0.05797101449275363 + }, + "x_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 13, + "mean_set_jaccard": 0.8571428571428572, + "mean_token_weighted_tv": 0.03055197575493999, + "aggregate_load_tv": 0.06521739130434784 + }, + "x_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 12, + "mean_set_jaccard": 0.8633540372670808, + "mean_token_weighted_tv": 0.03020413232076427, + "aggregate_load_tv": 0.07246376811594203 + }, + "period_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 8, + "set_exact_tokens": 11, + "mean_set_jaccard": 0.8416149068322983, + "mean_token_weighted_tv": 0.03324000853235307, + "aggregate_load_tv": 0.07971014492753624 + }, + "period_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 8, + "set_exact_tokens": 11, + "mean_set_jaccard": 0.8416149068322983, + "mean_token_weighted_tv": 0.03550501179921886, + "aggregate_load_tv": 0.07246376811594203 + } + } + }, + "layer_13": { + "layer": 13, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "1155a582582c2fb71178b31fe9864176b3a5dd5b334fa7668e55db940890e5c1", + "route_weight_sha256": "9b00de5423bbec99c41844f5c4e5024e0f32036065430eed7b65c4782251f10a", + "loads": [ + 1, + 2, + 1, + 2, + 0, + 0, + 13, + 1, + 0, + 0, + 0, + 4, + 0, + 3, + 9, + 1, + 0, + 7, + 8, + 0, + 3, + 3, + 0, + 2, + 0, + 3, + 2, + 2, + 0, + 0, + 1, + 2, + 2, + 2, + 2, + 0, + 3, + 0, + 0, + 0, + 0, + 7, + 5, + 0, + 0, + 0, + 3, + 9, + 0, + 0, + 0, + 0, + 0, + 0, + 2, + 0, + 0, + 4, + 9, + 0, + 3, + 3, + 4, + 10 + ], + "weighted_loads": [ + 0.04949495196342468, + 0.10577023774385452, + 0.040212154388427734, + 0.09653425961732864, + 0.0, + 0.0, + 0.9728298410773277, + 0.0737115815281868, + 0.0, + 0.0, + 0.0, + 0.24435947090387344, + 0.0, + 0.33003317937254906, + 0.6808699611574411, + 0.03078995831310749, + 0.0, + 0.32115961238741875, + 0.5025207102298737, + 0.0, + 0.14030086062848568, + 0.14881295338273048, + 0.0, + 0.07668568380177021, + 0.0, + 0.1297711841762066, + 0.09201114252209663, + 0.09631657414138317, + 0.0, + 0.0, + 0.08993333578109741, + 0.07978136464953423, + 0.0714666061103344, + 0.15473609045147896, + 0.13672686368227005, + 0.0, + 0.14150768518447876, + 0.0, + 0.0, + 0.0, + 0.0, + 0.3295293338596821, + 0.6183750182390213, + 0.0, + 0.0, + 0.0, + 0.4027145430445671, + 0.501030944287777, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.1935296729207039, + 0.0, + 0.0, + 0.19843341782689095, + 0.4499152973294258, + 0.0, + 0.10017102584242821, + 0.13084436021745205, + 0.23614203743636608, + 0.7960551530122757 + ], + "unique_experts": 35, + "load_cv": 1.3797071002280374, + "normalized_load_entropy": 0.7936131561729302, + "max_load_share": 0.09420289855072464 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "70271ffb702c849736650b34cef4aadf39895f52e5882576c0e800e1f2cb78ca", + "route_weight_sha256": "00f3373ffe7d9df87a3c3e538ed5a779bf06c46571874b94a837b659e022cd9d", + "loads": [ + 1, + 7, + 1, + 2, + 0, + 3, + 32, + 1, + 0, + 3, + 11, + 10, + 0, + 3, + 10, + 7, + 0, + 10, + 9, + 1, + 3, + 3, + 0, + 2, + 5, + 3, + 6, + 2, + 0, + 14, + 1, + 2, + 2, + 9, + 3, + 0, + 7, + 1, + 0, + 2, + 0, + 9, + 6, + 2, + 10, + 10, + 4, + 11, + 1, + 0, + 1, + 0, + 3, + 3, + 4, + 0, + 3, + 4, + 14, + 5, + 3, + 4, + 4, + 11 + ], + "weighted_loads": [ + 0.04949495196342468, + 0.3441476747393608, + 0.040212154388427734, + 0.09653425961732864, + 0.0, + 0.10701842978596687, + 2.8051799088716507, + 0.0737115815281868, + 0.0, + 0.11222709715366364, + 0.6956829093396664, + 0.5491547342389822, + 0.0, + 0.33003317937254906, + 0.7261947561055422, + 0.34189421869814396, + 0.0, + 0.41368138417601585, + 0.5437885820865631, + 0.041624005883932114, + 0.14030086062848568, + 0.14881295338273048, + 0.0, + 0.07668568380177021, + 0.20435344614088535, + 0.1297711841762066, + 0.26029063761234283, + 0.09631657414138317, + 0.0, + 1.1292277202010155, + 0.08993333578109741, + 0.07978136464953423, + 0.0714666061103344, + 0.7481831647455692, + 0.15959430299699306, + 0.0, + 0.34511106833815575, + 0.03374544531106949, + 0.0, + 0.07024529948830605, + 0.0, + 0.4130997285246849, + 0.6693506725132465, + 0.09627072140574455, + 0.8877015858888626, + 0.9645635895431042, + 0.43423503264784813, + 1.6934066340327263, + 0.03221277892589569, + 0.0, + 0.03672783821821213, + 0.0, + 0.11016155406832695, + 0.14002760499715805, + 0.2818684056401253, + 0.0, + 0.1700926199555397, + 0.19843341782689095, + 0.6831208951771259, + 0.23808977380394936, + 0.10017102584242821, + 0.16056558676064014, + 0.23614203743636608, + 0.8338548168540001 + ], + "unique_experts": 52, + "load_cv": 1.1486707293408518, + "normalized_load_entropy": 0.8686283521729725, + "max_load_share": 0.1111111111111111 + } + }, + "s1_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "37f2f655642c18abbbf1359e36c21c289d0bbabd2554172467fcc95b2822aec5", + "route_weight_sha256": "743f56eebbc08386f6f25b9d0d8208b5961019c6d7a4b83616aa0fbe10156282", + "loads": [ + 1, + 1, + 1, + 2, + 0, + 0, + 13, + 1, + 0, + 0, + 0, + 4, + 0, + 4, + 10, + 1, + 0, + 7, + 7, + 0, + 2, + 3, + 0, + 1, + 0, + 3, + 3, + 2, + 0, + 0, + 2, + 2, + 3, + 2, + 2, + 0, + 3, + 0, + 0, + 0, + 0, + 7, + 5, + 0, + 0, + 0, + 3, + 10, + 0, + 0, + 0, + 0, + 0, + 0, + 2, + 0, + 0, + 4, + 9, + 0, + 3, + 2, + 4, + 9 + ], + "weighted_loads": [ + 0.049999404698610306, + 0.0654912069439888, + 0.03852284327149391, + 0.09937192872166634, + 0.0, + 0.0, + 0.9645996242761612, + 0.0751071497797966, + 0.0, + 0.0, + 0.0, + 0.2661450281739235, + 0.0, + 0.3737400099635124, + 0.6775375679135323, + 0.028764817863702774, + 0.0, + 0.32015300169587135, + 0.4466579891741276, + 0.0, + 0.11454609781503677, + 0.15234318748116493, + 0.0, + 0.0300003569573164, + 0.0, + 0.1316271610558033, + 0.12161222845315933, + 0.09720763564109802, + 0.0, + 0.0, + 0.12959332764148712, + 0.07853967696428299, + 0.10626778192818165, + 0.15871597081422806, + 0.13373514264822006, + 0.0, + 0.13648482412099838, + 0.0, + 0.0, + 0.0, + 0.0, + 0.3298632875084877, + 0.5948780439794064, + 0.0, + 0.0, + 0.0, + 0.3787868469953537, + 0.5281360410153866, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.19789447635412216, + 0.0, + 0.0, + 0.19700300320982933, + 0.4420782122761011, + 0.0, + 0.10379268229007721, + 0.1059822253882885, + 0.23568586446344852, + 0.7581518292427063 + ], + "unique_experts": 35, + "load_cv": 1.3894159890364772, + "normalized_load_entropy": 0.7916970294964416, + "max_load_share": 0.09420289855072464 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "37ddbfc4db235f22f0623890114b7c5950240507c49b65070ac6ea650ab61ac3", + "route_weight_sha256": "2f247f4a61c40a6ae053e7f222019c8cf416b1ed8018d98dc6b9a16dfb7e33a0", + "loads": [ + 6, + 7, + 1, + 2, + 0, + 3, + 45, + 1, + 0, + 3, + 9, + 16, + 0, + 4, + 11, + 8, + 0, + 11, + 10, + 3, + 2, + 6, + 0, + 4, + 5, + 3, + 8, + 2, + 0, + 18, + 9, + 3, + 3, + 14, + 5, + 1, + 8, + 1, + 1, + 1, + 2, + 12, + 13, + 2, + 16, + 11, + 4, + 13, + 2, + 5, + 1, + 0, + 1, + 2, + 4, + 2, + 3, + 15, + 16, + 4, + 4, + 4, + 4, + 10 + ], + "weighted_loads": [ + 0.2530476599931717, + 0.3777063526213169, + 0.03852284327149391, + 0.09937192872166634, + 0.0, + 0.10601198859512806, + 3.6924132872372866, + 0.0751071497797966, + 0.0, + 0.14239483512938023, + 0.6045316401869059, + 1.0864884932525456, + 0.0, + 0.3737400099635124, + 0.721166517585516, + 0.40051544457674026, + 0.0, + 0.4403481399640441, + 0.5431444514542818, + 0.12235908955335617, + 0.11454609781503677, + 0.31594130769371986, + 0.0, + 0.15106873400509357, + 0.21999077964574099, + 0.1316271610558033, + 0.3207094129174948, + 0.09720763564109802, + 0.0, + 1.8119413740932941, + 0.5327776037156582, + 0.11952117457985878, + 0.10626778192818165, + 1.2405508235096931, + 0.35945466719567776, + 0.05432172864675522, + 0.43202143907546997, + 0.033343203365802765, + 0.04365771263837814, + 0.043167706578969955, + 0.07987536489963531, + 0.5360543914139271, + 1.2534622438251972, + 0.11107414588332176, + 1.3789481669664383, + 0.9646442085504532, + 0.41858798637986183, + 1.7580775022506714, + 0.2525724619626999, + 0.24431642144918442, + 0.03674572706222534, + 0.0, + 0.03566528856754303, + 0.08203642070293427, + 0.26845676451921463, + 0.07278792187571526, + 0.14751383289694786, + 0.8999529853463173, + 0.753828477114439, + 0.19518693536520004, + 0.1329940352588892, + 0.18993788212537766, + 0.23568586446344852, + 0.8115326501429081 + ], + "unique_experts": 57, + "load_cv": 1.1524430571616109, + "normalized_load_entropy": 0.8779746643457548, + "max_load_share": 0.1171875 + } + }, + "s0_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "5572b054cbd31488e5f0f1516dcd066b9fd783a6c23cca7462571949dfbef9df", + "route_weight_sha256": "8bc32048c90f13f8c0cf190ada1d02b0ede50f55c3378734d61b34dc8766a4fc", + "loads": [ + 1, + 2, + 1, + 2, + 0, + 0, + 13, + 1, + 0, + 0, + 0, + 4, + 0, + 4, + 9, + 1, + 0, + 6, + 7, + 0, + 2, + 3, + 0, + 2, + 0, + 3, + 2, + 2, + 0, + 0, + 1, + 2, + 3, + 2, + 2, + 0, + 3, + 0, + 0, + 0, + 0, + 8, + 5, + 0, + 0, + 0, + 3, + 9, + 0, + 0, + 0, + 0, + 0, + 1, + 2, + 0, + 0, + 4, + 10, + 0, + 2, + 3, + 3, + 10 + ], + "weighted_loads": [ + 0.048592980951070786, + 0.10816517099738121, + 0.03857453539967537, + 0.09965706244111061, + 0.0, + 0.0, + 0.9961809180676937, + 0.07909511774778366, + 0.0, + 0.0, + 0.0, + 0.23813656717538834, + 0.0, + 0.3841043971478939, + 0.6790799275040627, + 0.029496241360902786, + 0.0, + 0.2642003446817398, + 0.4448375552892685, + 0.0, + 0.11421368643641472, + 0.15193503722548485, + 0.0, + 0.07842343859374523, + 0.0, + 0.12816553190350533, + 0.09356936439871788, + 0.09970712848007679, + 0.0, + 0.0, + 0.0963187962770462, + 0.08004175499081612, + 0.10224782675504684, + 0.15500011667609215, + 0.13015277311205864, + 0.0, + 0.15349631756544113, + 0.0, + 0.0, + 0.0, + 0.0, + 0.3647628128528595, + 0.6168149933218956, + 0.0, + 0.0, + 0.0, + 0.3844717964529991, + 0.4825833775103092, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.03205385431647301, + 0.2037203684449196, + 0.0, + 0.0, + 0.19012295454740524, + 0.4846452195197344, + 0.0, + 0.06732022948563099, + 0.14305394887924194, + 0.17930612340569496, + 0.8142608478665352 + ], + "unique_experts": 36, + "load_cv": 1.3821407162305501, + "normalized_load_entropy": 0.7962781815549916, + "max_load_share": 0.09420289855072464 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "6ad62caeab25430bc67ae54693a8b6fec3bc950f58404b4b7181722d485f8126", + "route_weight_sha256": "d9cdcd04e6376fa6e3f5774b0d04b1be4d0b81a71488c54d00470a205b9956ad", + "loads": [ + 1, + 8, + 2, + 2, + 1, + 3, + 32, + 1, + 0, + 5, + 8, + 9, + 0, + 4, + 9, + 7, + 0, + 8, + 8, + 1, + 2, + 3, + 0, + 2, + 4, + 3, + 5, + 2, + 0, + 15, + 1, + 2, + 3, + 7, + 3, + 0, + 6, + 1, + 0, + 2, + 0, + 10, + 6, + 3, + 10, + 10, + 4, + 10, + 1, + 0, + 1, + 0, + 3, + 5, + 5, + 0, + 5, + 4, + 16, + 5, + 2, + 4, + 3, + 11 + ], + "weighted_loads": [ + 0.048592980951070786, + 0.40153390169143677, + 0.10609817877411842, + 0.09965706244111061, + 0.046100832521915436, + 0.10959340259432793, + 2.790269158780575, + 0.07909511774778366, + 0.0, + 0.23474539443850517, + 0.5103219151496887, + 0.50758964009583, + 0.0, + 0.3841043971478939, + 0.6790799275040627, + 0.34060050174593925, + 0.0, + 0.33774229511618614, + 0.48610542714595795, + 0.041624005883932114, + 0.11421368643641472, + 0.15193503722548485, + 0.0, + 0.07842343859374523, + 0.22577177360653877, + 0.12816553190350533, + 0.2180352695286274, + 0.09970712848007679, + 0.0, + 1.0627542473375797, + 0.0963187962770462, + 0.08004175499081612, + 0.10224782675504684, + 0.6628602407872677, + 0.15302021242678165, + 0.0, + 0.3213386498391628, + 0.03374544531106949, + 0.0, + 0.07024529948830605, + 0.0, + 0.45841746404767036, + 0.692290261387825, + 0.17375139147043228, + 0.8368138670921326, + 0.9645635895431042, + 0.41599228605628014, + 0.8436778821051121, + 0.03221277892589569, + 0.0, + 0.03672783821821213, + 0.0, + 0.11016155406832695, + 0.23297859355807304, + 0.32883093506097794, + 0.0, + 0.3174242191016674, + 0.19012295454740524, + 0.7625169046223164, + 0.23808977380394936, + 0.06732022948563099, + 0.17277517542243004, + 0.17930612340569496, + 0.8520605117082596 + ], + "unique_experts": 53, + "load_cv": 1.1317527104146312, + "normalized_load_entropy": 0.8751886910147008, + "max_load_share": 0.1111111111111111 + } + }, + "s1_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "e9a7c4038e1d31a9c47eba585eb64abefa6cedde05a5c420d7938f48ede29ba5", + "route_weight_sha256": "aaac9b96839132617b9b3747444851f0b92199ecbe610d54341e300b7d434028", + "loads": [ + 2, + 2, + 1, + 2, + 0, + 0, + 12, + 1, + 0, + 1, + 0, + 4, + 0, + 4, + 9, + 1, + 0, + 6, + 7, + 0, + 2, + 3, + 0, + 2, + 0, + 3, + 2, + 2, + 0, + 0, + 1, + 2, + 2, + 2, + 2, + 1, + 3, + 0, + 0, + 0, + 0, + 8, + 5, + 0, + 0, + 0, + 3, + 10, + 0, + 0, + 0, + 0, + 0, + 1, + 2, + 0, + 0, + 4, + 8, + 0, + 3, + 3, + 2, + 10 + ], + "weighted_loads": [ + 0.08554629236459732, + 0.11510474979877472, + 0.037298060953617096, + 0.10236712172627449, + 0.0, + 0.0, + 0.8728800602257252, + 0.07715681195259094, + 0.0, + 0.0302603617310524, + 0.0, + 0.25670934841036797, + 0.0, + 0.382701575756073, + 0.6813101842999458, + 0.03006398119032383, + 0.0, + 0.2841835543513298, + 0.4294048473238945, + 0.0, + 0.1250014379620552, + 0.15729334205389023, + 0.0, + 0.08156512677669525, + 0.0, + 0.12460413575172424, + 0.08695362135767937, + 0.09952143765985966, + 0.0, + 0.0, + 0.10372072458267212, + 0.08837009966373444, + 0.07422633469104767, + 0.16252005100250244, + 0.13896529749035835, + 0.02695957012474537, + 0.1462624855339527, + 0.0, + 0.0, + 0.0, + 0.0, + 0.38176891952753067, + 0.591608926653862, + 0.0, + 0.0, + 0.0, + 0.38603977113962173, + 0.5543343387544155, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.031005777418613434, + 0.19470786303281784, + 0.0, + 0.0, + 0.18602612242102623, + 0.4039603918790817, + 0.0, + 0.10064113885164261, + 0.1502446085214615, + 0.15468347072601318, + 0.7921392135322094 + ], + "unique_experts": 38, + "load_cv": 1.3301000494575204, + "normalized_load_entropy": 0.8088027936834031, + "max_load_share": 0.08695652173913043 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "61ea623d9c1121e258fcdf2b9db1b71088262afb3225cbd3a0bc5838fd3231ec", + "route_weight_sha256": "8ac2ccb1bb63a2628fdbb1dbf82539c8843b56ec0a302e56344d1dfa8e840215", + "loads": [ + 7, + 8, + 2, + 2, + 0, + 3, + 44, + 1, + 0, + 5, + 10, + 15, + 0, + 4, + 9, + 8, + 0, + 9, + 9, + 3, + 2, + 6, + 0, + 5, + 5, + 3, + 6, + 2, + 0, + 19, + 8, + 3, + 2, + 13, + 5, + 2, + 9, + 1, + 1, + 1, + 2, + 13, + 13, + 2, + 16, + 12, + 4, + 12, + 2, + 5, + 1, + 0, + 1, + 3, + 4, + 2, + 4, + 15, + 15, + 4, + 4, + 5, + 2, + 11 + ], + "weighted_loads": [ + 0.2885945476591587, + 0.46129220724105835, + 0.08637352287769318, + 0.10236712172627449, + 0.0, + 0.11307159252464771, + 3.6658252086490393, + 0.07715681195259094, + 0.0, + 0.23039164952933788, + 0.6487376485019922, + 1.043570814654231, + 0.0, + 0.382701575756073, + 0.6813101842999458, + 0.4018146079033613, + 0.0, + 0.3874581754207611, + 0.4961413908749819, + 0.12235908955335617, + 0.1250014379620552, + 0.32089146226644516, + 0.0, + 0.20263350382447243, + 0.26589860394597054, + 0.12460413575172424, + 0.24469751305878162, + 0.09952143765985966, + 0.0, + 1.7649507857859135, + 0.5069050006568432, + 0.12935159727931023, + 0.07422633469104767, + 1.2245062217116356, + 0.36468482203781605, + 0.08128129877150059, + 0.4991522245109081, + 0.033343203365802765, + 0.04365771263837814, + 0.043167706578969955, + 0.07987536489963531, + 0.5835771411657333, + 1.2668510861694813, + 0.11598881334066391, + 1.3070085123181343, + 1.0101090855896473, + 0.42584091052412987, + 0.9546917378902435, + 0.2525724619626999, + 0.24431642144918442, + 0.03674572706222534, + 0.0, + 0.03566528856754303, + 0.1130421981215477, + 0.2652701511979103, + 0.07278792187571526, + 0.18646406382322311, + 0.8889761045575142, + 0.6911717001348734, + 0.19518693536520004, + 0.1298424918204546, + 0.23420026525855064, + 0.15468347072601318, + 0.8455200344324112 + ], + "unique_experts": 57, + "load_cv": 1.1253857363391255, + "normalized_load_entropy": 0.8828298684235932, + "max_load_share": 0.11458333333333333 + } + }, + "s0_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "9d4ef50a685f64a1adde7440b89de32796396b138b4cea784fccc6db551aabe5", + "route_weight_sha256": "f8060037f67c914fa247c5d87ab1106f7efe2454c31bdaeb5022790057bba580", + "loads": [ + 1, + 2, + 1, + 2, + 0, + 0, + 14, + 1, + 0, + 0, + 0, + 4, + 0, + 4, + 8, + 1, + 0, + 5, + 7, + 0, + 2, + 3, + 0, + 2, + 0, + 3, + 2, + 2, + 0, + 0, + 1, + 1, + 3, + 4, + 2, + 0, + 3, + 0, + 0, + 0, + 0, + 8, + 5, + 0, + 0, + 0, + 3, + 9, + 0, + 0, + 0, + 0, + 0, + 0, + 2, + 0, + 0, + 4, + 10, + 0, + 1, + 5, + 4, + 9 + ], + "weighted_loads": [ + 0.04987024515867233, + 0.12260061129927635, + 0.04182503744959831, + 0.09782322123646736, + 0.0, + 0.0, + 1.0755193419754505, + 0.07694453001022339, + 0.0, + 0.0, + 0.0, + 0.24086358398199081, + 0.0, + 0.3759712800383568, + 0.5894156713038683, + 0.029246104881167412, + 0.0, + 0.23902379721403122, + 0.4298552796244621, + 0.0, + 0.1206236369907856, + 0.15498000383377075, + 0.0, + 0.08494796976447105, + 0.0, + 0.1301085352897644, + 0.08962446078658104, + 0.09676595032215118, + 0.0, + 0.0, + 0.09787754714488983, + 0.05287013575434685, + 0.10223035141825676, + 0.21248322539031506, + 0.12341155856847763, + 0.0, + 0.14262329414486885, + 0.0, + 0.0, + 0.0, + 0.0, + 0.3691978305578232, + 0.6109478436410427, + 0.0, + 0.0, + 0.0, + 0.3986821398139, + 0.4972366653382778, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.20023566484451294, + 0.0, + 0.0, + 0.19618814438581467, + 0.4524980802088976, + 0.0, + 0.03168228268623352, + 0.20183280482888222, + 0.22017935663461685, + 0.7496505472809076 + ], + "unique_experts": 35, + "load_cv": 1.391832629173799, + "normalized_load_entropy": 0.7912326470570226, + "max_load_share": 0.10144927536231885 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "c1b27e1e72ff53c3eb153d84e4355318a28966f44228641fc745e227dd06198c", + "route_weight_sha256": "10c13f0cda563f3a5a1a836961050f4ff638626e24d223f5955638e18d4a0ff1", + "loads": [ + 1, + 7, + 1, + 2, + 0, + 3, + 33, + 1, + 0, + 2, + 9, + 9, + 0, + 4, + 8, + 8, + 0, + 7, + 8, + 1, + 2, + 4, + 0, + 2, + 6, + 3, + 5, + 2, + 0, + 15, + 1, + 1, + 3, + 11, + 3, + 0, + 6, + 1, + 0, + 2, + 0, + 10, + 6, + 1, + 12, + 12, + 5, + 10, + 1, + 0, + 1, + 0, + 3, + 3, + 4, + 0, + 4, + 4, + 15, + 5, + 1, + 6, + 4, + 10 + ], + "weighted_loads": [ + 0.04987024515867233, + 0.35306135192513466, + 0.04182503744959831, + 0.09782322123646736, + 0.0, + 0.11655401438474655, + 2.788138937205076, + 0.07694453001022339, + 0.0, + 0.07622763514518738, + 0.51309884339571, + 0.5293612312525511, + 0.0, + 0.3759712800383568, + 0.5894156713038683, + 0.5588264521211386, + 0.0, + 0.3111662454903126, + 0.4711231514811516, + 0.041624005883932114, + 0.1206236369907856, + 0.19242415949702263, + 0.0, + 0.08494796976447105, + 0.28928646817803383, + 0.1301085352897644, + 0.21409036591649055, + 0.09676595032215118, + 0.0, + 1.0999021269381046, + 0.09787754714488983, + 0.05287013575434685, + 0.10223035141825676, + 0.863419072702527, + 0.14627899788320065, + 0.0, + 0.30475952848792076, + 0.03374544531106949, + 0.0, + 0.07024529948830605, + 0.0, + 0.4581861048936844, + 0.6581565886735916, + 0.045180678367614746, + 1.0098197534680367, + 1.2037239372730255, + 0.4583341106772423, + 0.8583311699330807, + 0.03221277892589569, + 0.0, + 0.03672783821821213, + 0.0, + 0.11016155406832695, + 0.14002760499715805, + 0.2885743975639343, + 0.0, + 0.20054928585886955, + 0.19618814438581467, + 0.6812582425773144, + 0.23808977380394936, + 0.03168228268623352, + 0.2315540313720703, + 0.22017935663461685, + 0.787450211122632 + ], + "unique_experts": 52, + "load_cv": 1.1811273125260722, + "normalized_load_entropy": 0.8632853128188632, + "max_load_share": 0.11458333333333333 + } + }, + "s1_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "beeb561a94a4b1e68b6ee024ef6148adce48d36b8af4dfae94d14058c6eb773c", + "route_weight_sha256": "789d9afefbd28e4f032df483d18be28cbcfa86de4b7a024c3d23a51e996d4278", + "loads": [ + 2, + 3, + 1, + 2, + 0, + 0, + 12, + 1, + 0, + 0, + 0, + 4, + 0, + 4, + 8, + 0, + 0, + 6, + 8, + 0, + 2, + 3, + 0, + 2, + 0, + 3, + 2, + 2, + 0, + 0, + 1, + 2, + 3, + 2, + 2, + 0, + 3, + 0, + 0, + 0, + 0, + 8, + 5, + 0, + 0, + 0, + 3, + 9, + 0, + 0, + 0, + 0, + 0, + 1, + 2, + 0, + 0, + 3, + 8, + 0, + 3, + 4, + 4, + 10 + ], + "weighted_loads": [ + 0.09001418948173523, + 0.16266026347875595, + 0.03988761082291603, + 0.10347234830260277, + 0.0, + 0.0, + 0.8471155110746622, + 0.0782078206539154, + 0.0, + 0.0, + 0.0, + 0.24680641293525696, + 0.0, + 0.3733539246022701, + 0.5642802715301514, + 0.0, + 0.0, + 0.2720891870558262, + 0.460878137499094, + 0.0, + 0.12611188367009163, + 0.15911810472607613, + 0.0, + 0.08225090801715851, + 0.0, + 0.126878559589386, + 0.08547263219952583, + 0.1018617432564497, + 0.0, + 0.0, + 0.10089946538209915, + 0.09615685790777206, + 0.11016739904880524, + 0.15838653221726418, + 0.13929836824536324, + 0.0, + 0.13605565018951893, + 0.0, + 0.0, + 0.0, + 0.0, + 0.3882431276142597, + 0.6086858324706554, + 0.0, + 0.0, + 0.0, + 0.3897637352347374, + 0.49767338670790195, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.03056810051202774, + 0.2002931460738182, + 0.0, + 0.0, + 0.18521764501929283, + 0.3961052242666483, + 0.0, + 0.10899726301431656, + 0.18655375391244888, + 0.21903331018984318, + 0.8035477586090565 + ], + "unique_experts": 35, + "load_cv": 1.327571039351288, + "normalized_load_entropy": 0.8007846661459029, + "max_load_share": 0.08695652173913043 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "0b78025eeb8d8f18130a4dc74191dbd6fb95923a482ffc090b2ec30e34fd197b", + "route_weight_sha256": "f5d0c9840c04fe35fb98e977b8de01f0a3b499a04606f435aa43ce92b5b2fc95", + "loads": [ + 7, + 7, + 1, + 2, + 0, + 2, + 43, + 1, + 0, + 1, + 8, + 14, + 0, + 4, + 8, + 8, + 0, + 8, + 11, + 3, + 3, + 9, + 0, + 5, + 6, + 3, + 7, + 2, + 0, + 20, + 8, + 3, + 3, + 15, + 5, + 1, + 8, + 1, + 1, + 1, + 2, + 13, + 13, + 0, + 18, + 12, + 5, + 11, + 2, + 5, + 1, + 0, + 1, + 3, + 4, + 3, + 3, + 15, + 14, + 4, + 4, + 7, + 4, + 11 + ], + "weighted_loads": [ + 0.2930624447762966, + 0.3801545314490795, + 0.03988761082291603, + 0.10347234830260277, + 0.0, + 0.06633528880774975, + 3.326793171465397, + 0.0782078206539154, + 0.0, + 0.03057899884879589, + 0.5111340265721083, + 0.9992394540458918, + 0.0, + 0.3733539246022701, + 0.5642802715301514, + 0.5138309933245182, + 0.0, + 0.34240665286779404, + 0.5602627564221621, + 0.12235908955335617, + 0.15568246878683567, + 0.4285483658313751, + 0.0, + 0.20331928506493568, + 0.28061907924711704, + 0.126878559589386, + 0.27472701482474804, + 0.1018617432564497, + 0.0, + 1.6681177467107773, + 0.5040837414562702, + 0.13713835552334785, + 0.11016739904880524, + 1.3808670789003372, + 0.36501789279282093, + 0.05432172864675522, + 0.4353500474244356, + 0.033343203365802765, + 0.04365771263837814, + 0.043167706578969955, + 0.07987536489963531, + 0.6033657528460026, + 1.2695294581353664, + 0.0, + 1.4715360775589943, + 1.110536977648735, + 0.4721008129417896, + 0.89803078584373, + 0.2525724619626999, + 0.24431642144918442, + 0.03674572706222534, + 0.0, + 0.03566528856754303, + 0.112604521214962, + 0.2708554342389107, + 0.11287616565823555, + 0.14751383289694786, + 0.9210914969444275, + 0.6196231357753277, + 0.19518693536520004, + 0.13819861598312855, + 0.30460255593061447, + 0.21903331018984318, + 0.8569285795092583 + ], + "unique_experts": 56, + "load_cv": 1.1284668803292368, + "normalized_load_entropy": 0.8782428048480155, + "max_load_share": 0.11197916666666667 + } + }, + "s0_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "6f3b8b6c2631499922a8c99f72fc6fa734904e4f3bd5d7b0bae0bbac04735a86", + "route_weight_sha256": "e67fa162e457a6391035e1d52e2aa4a1a1f28992e86e16e5ad16a5cd01720c36", + "loads": [ + 1, + 2, + 1, + 2, + 0, + 0, + 14, + 1, + 0, + 0, + 0, + 4, + 0, + 3, + 9, + 1, + 0, + 5, + 8, + 0, + 3, + 3, + 0, + 2, + 0, + 3, + 2, + 2, + 0, + 0, + 1, + 2, + 2, + 3, + 2, + 0, + 2, + 0, + 0, + 0, + 0, + 8, + 5, + 0, + 0, + 0, + 3, + 8, + 0, + 0, + 0, + 0, + 0, + 1, + 2, + 0, + 0, + 4, + 10, + 0, + 1, + 5, + 4, + 9 + ], + "weighted_loads": [ + 0.04827595874667168, + 0.12271905317902565, + 0.041483040899038315, + 0.09979331493377686, + 0.0, + 0.0, + 1.0263610929250717, + 0.07461816072463989, + 0.0, + 0.0, + 0.0, + 0.22946398332715034, + 0.0, + 0.33014245331287384, + 0.6359192654490471, + 0.029242899268865585, + 0.0, + 0.23382780514657497, + 0.4730883985757828, + 0.0, + 0.14660907536745071, + 0.15023384988307953, + 0.0, + 0.08419881388545036, + 0.0, + 0.12707125768065453, + 0.0913851149380207, + 0.09635597653687, + 0.0, + 0.0, + 0.09363793581724167, + 0.08824211359024048, + 0.0749160535633564, + 0.18800365552306175, + 0.1270146481692791, + 0.0, + 0.11701329424977303, + 0.0, + 0.0, + 0.0, + 0.0, + 0.3696207143366337, + 0.6026229336857796, + 0.0, + 0.0, + 0.0, + 0.39056529104709625, + 0.4460315406322479, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.03116043098270893, + 0.19292403012514114, + 0.0, + 0.0, + 0.20703863352537155, + 0.4545432236045599, + 0.0, + 0.033009953796863556, + 0.20042830891907215, + 0.22453250922262669, + 0.7476504445075989 + ], + "unique_experts": 36, + "load_cv": 1.391832629173799, + "normalized_load_entropy": 0.7947309525548967, + "max_load_share": 0.10144927536231885 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "45cb0d03172c107c0776d8f17bf3c507844de2c78788d8c0f6966dc541feedb5", + "route_weight_sha256": "8489a7655b1ce66e5fad012589b395c8b4ce38accfd9ab1c8029cf5c18e2ea5a", + "loads": [ + 1, + 8, + 1, + 2, + 0, + 3, + 32, + 1, + 0, + 2, + 8, + 9, + 0, + 3, + 10, + 7, + 0, + 7, + 11, + 1, + 3, + 3, + 0, + 2, + 5, + 3, + 6, + 2, + 0, + 15, + 1, + 2, + 2, + 11, + 3, + 0, + 6, + 1, + 0, + 2, + 0, + 11, + 6, + 2, + 11, + 11, + 4, + 9, + 1, + 0, + 1, + 0, + 3, + 4, + 4, + 0, + 3, + 4, + 15, + 5, + 1, + 6, + 4, + 10 + ], + "weighted_loads": [ + 0.04827595874667168, + 0.5366793181747198, + 0.041483040899038315, + 0.09979331493377686, + 0.0, + 0.10923612490296364, + 2.741420779377222, + 0.07461816072463989, + 0.0, + 0.07622763514518738, + 0.5493813529610634, + 0.5280030611902475, + 0.0, + 0.33014245331287384, + 0.665544779971242, + 0.34034715965390205, + 0.0, + 0.3038135301321745, + 0.5875310134142637, + 0.041624005883932114, + 0.14660907536745071, + 0.15023384988307953, + 0.0, + 0.08419881388545036, + 0.3319675140082836, + 0.12707125768065453, + 0.2670220695436001, + 0.09635597653687, + 0.0, + 1.128060407936573, + 0.09363793581724167, + 0.08824211359024048, + 0.0749160535633564, + 0.8483696021139622, + 0.1498820874840021, + 0.0, + 0.33236177638173103, + 0.03374544531106949, + 0.0, + 0.07024529948830605, + 0.0, + 0.5012175589799881, + 0.6418324895203114, + 0.10623819008469582, + 0.9506684206426144, + 1.0041360966861248, + 0.4220857806503773, + 0.8071260452270508, + 0.03221277892589569, + 0.0, + 0.03672783821821213, + 0.0, + 0.11016155406832695, + 0.17118803597986698, + 0.28126276284456253, + 0.0, + 0.1700926199555397, + 0.20703863352537155, + 0.675729613751173, + 0.23808977380394936, + 0.033009953796863556, + 0.23014953546226025, + 0.22453250922262669, + 0.7854501083493233 + ], + "unique_experts": 52, + "load_cv": 1.164680849624257, + "normalized_load_entropy": 0.8653734269132377, + "max_load_share": 0.1111111111111111 + } + }, + "s1_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "101bc4495417044a444cb7fceaffce471b98138d98f8607db9870c27a6a97c29", + "route_weight_sha256": "0b475de3a18acf07dfb6342c4d77ee8b88c987ca7feec4119c32173d3ebff1c7", + "loads": [ + 2, + 2, + 1, + 2, + 0, + 0, + 12, + 1, + 0, + 0, + 0, + 4, + 0, + 4, + 8, + 0, + 0, + 6, + 8, + 0, + 2, + 3, + 0, + 2, + 0, + 3, + 2, + 2, + 0, + 0, + 1, + 2, + 3, + 2, + 2, + 0, + 3, + 0, + 0, + 0, + 0, + 8, + 5, + 0, + 0, + 0, + 3, + 9, + 0, + 0, + 0, + 0, + 0, + 1, + 2, + 0, + 0, + 4, + 7, + 0, + 4, + 4, + 4, + 10 + ], + "weighted_loads": [ + 0.0896986536681652, + 0.12155144289135933, + 0.04047670215368271, + 0.10227425396442413, + 0.0, + 0.0, + 0.7891854383051395, + 0.07945428043603897, + 0.0, + 0.0, + 0.0, + 0.23746881633996964, + 0.0, + 0.3743318244814873, + 0.5698857232928276, + 0.0, + 0.0, + 0.2650994658470154, + 0.4870612397789955, + 0.0, + 0.12796184420585632, + 0.1573825590312481, + 0.0, + 0.0799785926938057, + 0.0, + 0.1272573620080948, + 0.08631998673081398, + 0.10042165964841843, + 0.0, + 0.0, + 0.1000685840845108, + 0.09837879613041878, + 0.11034801974892616, + 0.16501117497682571, + 0.14317451417446136, + 0.0, + 0.13907335326075554, + 0.0, + 0.0, + 0.0, + 0.0, + 0.39590704441070557, + 0.6017773672938347, + 0.0, + 0.0, + 0.0, + 0.39305220544338226, + 0.5075785964727402, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.030777236446738243, + 0.1894398257136345, + 0.0, + 0.0, + 0.21092845872044563, + 0.36009126156568527, + 0.0, + 0.14205488748848438, + 0.19190432131290436, + 0.21969485841691494, + 0.786770686507225 + ], + "unique_experts": 35, + "load_cv": 1.3199549361233305, + "normalized_load_entropy": 0.8015252193489067, + "max_load_share": 0.08695652173913043 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "78debf5dfe390b44c5969c6638889f1241890e728becee6e6f1fe41dea998118", + "route_weight_sha256": "14bd54bbc5c110745a2b810db9d06accba635ed5ac5d23b713b624ee9d538371", + "loads": [ + 7, + 8, + 1, + 2, + 0, + 2, + 43, + 1, + 0, + 1, + 8, + 15, + 0, + 4, + 8, + 7, + 0, + 9, + 11, + 3, + 2, + 8, + 0, + 5, + 5, + 3, + 7, + 2, + 0, + 20, + 8, + 4, + 3, + 16, + 5, + 1, + 9, + 1, + 1, + 1, + 2, + 13, + 13, + 1, + 18, + 12, + 4, + 11, + 2, + 5, + 1, + 0, + 1, + 3, + 4, + 2, + 3, + 15, + 13, + 4, + 5, + 6, + 4, + 11 + ], + "weighted_loads": [ + 0.2927469089627266, + 0.5500260181725025, + 0.04047670215368271, + 0.10227425396442413, + 0.0, + 0.06633528880774975, + 3.210662202909589, + 0.07945428043603897, + 0.0, + 0.03057899884879589, + 0.5575046595185995, + 1.0289202947169542, + 0.0, + 0.3743318244814873, + 0.5698857232928276, + 0.3717506267130375, + 0.0, + 0.37707359343767166, + 0.5861963164061308, + 0.12235908955335617, + 0.12796184420585632, + 0.3917624168097973, + 0.0, + 0.20104696974158287, + 0.3471061736345291, + 0.1272573620080948, + 0.28951276652514935, + 0.10042165964841843, + 0.0, + 1.7011744901537895, + 0.5032528601586819, + 0.1728745773434639, + 0.11034801974892616, + 1.4202469773590565, + 0.36889403872191906, + 0.05432172864675522, + 0.4973081313073635, + 0.033343203365802765, + 0.04365771263837814, + 0.043167706578969955, + 0.07987536489963531, + 0.613829743117094, + 1.2481195516884327, + 0.03948593512177467, + 1.4528877809643745, + 0.9992539174854755, + 0.4328533448278904, + 0.9079359956085682, + 0.2525724619626999, + 0.24431642144918442, + 0.03674572706222534, + 0.0, + 0.03566528856754303, + 0.11281365714967251, + 0.26000211387872696, + 0.07278792187571526, + 0.14751383289694786, + 0.9138784408569336, + 0.5832923147827387, + 0.19518693536520004, + 0.17125624045729637, + 0.2758599780499935, + 0.21969485841691494, + 0.8401515074074268 + ], + "unique_experts": 57, + "load_cv": 1.1330728867405957, + "normalized_load_entropy": 0.8783632054362336, + "max_load_share": 0.11197916666666667 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.9254658385093169, + "mean_token_weighted_tv": 0.017529160472685875, + "aggregate_load_tv": 0.04347826086956522 + }, + "system_bos": { + "tokens": 23, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 18, + "mean_set_jaccard": 0.9378881987577641, + "mean_token_weighted_tv": 0.01763395564225705, + "aggregate_load_tv": 0.03623188405797102 + }, + "system_x": { + "tokens": 23, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 13, + "mean_set_jaccard": 0.8664596273291927, + "mean_token_weighted_tv": 0.028394836810943874, + "aggregate_load_tv": 0.06521739130434784 + }, + "system_period": { + "tokens": 23, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 13, + "mean_set_jaccard": 0.8664596273291927, + "mean_token_weighted_tv": 0.029532668099779148, + "aggregate_load_tv": 0.07246376811594203 + }, + "bos_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.9006211180124224, + "mean_token_weighted_tv": 0.021283371495487896, + "aggregate_load_tv": 0.036231884057971016 + }, + "bos_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8881987577639753, + "mean_token_weighted_tv": 0.024807999193992302, + "aggregate_load_tv": 0.06521739130434784 + }, + "x_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8788819875776398, + "mean_token_weighted_tv": 0.027332194797370746, + "aggregate_load_tv": 0.06521739130434782 + }, + "x_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 12, + "mean_set_jaccard": 0.8633540372670808, + "mean_token_weighted_tv": 0.03125622431221216, + "aggregate_load_tv": 0.07246376811594203 + }, + "period_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.9161490683229813, + "mean_token_weighted_tv": 0.022083034941359707, + "aggregate_load_tv": 0.050724637681159424 + }, + "period_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 7, + "set_exact_tokens": 12, + "mean_set_jaccard": 0.8633540372670809, + "mean_token_weighted_tv": 0.0318681362449475, + "aggregate_load_tv": 0.07246376811594203 + } + } + }, + "layer_14": { + "layer": 14, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "f73768f395ec145e31c6441cdcc5ac276008986aec59a7a1cec0df587d1c30d3", + "route_weight_sha256": "26a8de17a1e2a1ad62032c36daaf6c4eeeec906a8a6aad867d234c970edc8a10", + "loads": [ + 2, + 0, + 2, + 7, + 4, + 9, + 2, + 8, + 2, + 0, + 0, + 0, + 0, + 0, + 4, + 0, + 2, + 5, + 7, + 0, + 0, + 0, + 0, + 0, + 1, + 0, + 1, + 0, + 3, + 1, + 2, + 6, + 0, + 0, + 2, + 1, + 0, + 0, + 1, + 1, + 0, + 0, + 2, + 0, + 0, + 1, + 0, + 1, + 4, + 4, + 0, + 8, + 2, + 0, + 0, + 1, + 2, + 6, + 12, + 14, + 0, + 3, + 2, + 3 + ], + "weighted_loads": [ + 0.12732184678316116, + 0.0, + 0.11927315220236778, + 0.49332740902900696, + 0.20270098745822906, + 0.5154798366129398, + 0.13105110079050064, + 0.8123483434319496, + 0.12315508350729942, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.35025109723210335, + 0.0, + 0.07683290541172028, + 0.2191697657108307, + 0.27614079788327217, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.04144107550382614, + 0.0, + 0.06306038796901703, + 0.0, + 0.17596637457609177, + 0.05323690548539162, + 0.10779206454753876, + 0.602418027818203, + 0.0, + 0.0, + 0.22129760682582855, + 0.034991879016160965, + 0.0, + 0.0, + 0.03819599375128746, + 0.04936116561293602, + 0.0, + 0.0, + 0.07896137237548828, + 0.0, + 0.0, + 0.09281736612319946, + 0.0, + 0.04558473080396652, + 0.16432766616344452, + 0.8088202476501465, + 0.0, + 0.41153858974575996, + 0.12879113107919693, + 0.0, + 0.0, + 0.04920434206724167, + 0.10986316204071045, + 0.382309190928936, + 0.8819576278328896, + 1.2527161352336407, + 0.0, + 0.37156854569911957, + 0.10098028555512428, + 0.17230166494846344 + ], + "unique_experts": 37, + "load_cv": 1.4086330277724277, + "normalized_load_entropy": 0.7945986826166168, + "max_load_share": 0.10144927536231885 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "78a4f0a48afb0f12ed366e927b994e235178cae23a87f5d6893b4ec76e057c7d", + "route_weight_sha256": "778a0498f7212383dad5a9e04c67fef19cc626c2aa914e52c5fec1afd192cadc", + "loads": [ + 10, + 0, + 2, + 9, + 4, + 19, + 2, + 10, + 2, + 8, + 2, + 3, + 0, + 0, + 4, + 5, + 2, + 5, + 11, + 1, + 0, + 0, + 0, + 11, + 2, + 0, + 7, + 5, + 11, + 1, + 4, + 11, + 0, + 7, + 2, + 1, + 2, + 1, + 3, + 1, + 0, + 0, + 3, + 0, + 2, + 1, + 6, + 4, + 5, + 5, + 2, + 15, + 8, + 7, + 0, + 5, + 2, + 7, + 12, + 26, + 0, + 4, + 2, + 4 + ], + "weighted_loads": [ + 0.9071310795843601, + 0.0, + 0.11927315220236778, + 0.5727806389331818, + 0.20270098745822906, + 1.4362713005393744, + 0.13105110079050064, + 0.8853318952023983, + 0.12315508350729942, + 0.6202182285487652, + 0.06590710207819939, + 0.1902702860534191, + 0.0, + 0.0, + 0.35025109723210335, + 0.24120502918958664, + 0.07683290541172028, + 0.2191697657108307, + 0.5314933955669403, + 0.03989744558930397, + 0.0, + 0.0, + 0.0, + 0.4752680081874132, + 0.06404389254748821, + 0.0, + 0.4171687178313732, + 0.33581755962222815, + 1.573051244020462, + 0.05323690548539162, + 0.2722456678748131, + 0.8021770725026727, + 0.0, + 0.7020273208618164, + 0.22129760682582855, + 0.034991879016160965, + 0.08281221240758896, + 0.044433340430259705, + 0.1617957539856434, + 0.04936116561293602, + 0.0, + 0.0, + 0.13085968047380447, + 0.0, + 0.06528146378695965, + 0.09281736612319946, + 0.37212603725492954, + 0.17581452429294586, + 0.194495202973485, + 0.8518773429095745, + 0.07539094239473343, + 1.7844228129833937, + 0.8810476437211037, + 0.4798341691493988, + 0.0, + 0.39574869722127914, + 0.10986316204071045, + 0.41812264174222946, + 0.8819576278328896, + 1.8290428631007671, + 0.0, + 0.3765934584662318, + 0.10098028555512428, + 0.23110676184296608 + ], + "unique_experts": 51, + "load_cv": 1.097837380298306, + "normalized_load_entropy": 0.8698914003123192, + "max_load_share": 0.09027777777777778 + } + }, + "s1_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "0d0eb3293776e0d1d283dfbec04f55cd50b504568a7c412d94eb3133b32592dc", + "route_weight_sha256": "ab8c80368cbf0376c14ae02321ff09607946f26562447a5666117761db9b83c1", + "loads": [ + 1, + 1, + 2, + 7, + 4, + 9, + 2, + 7, + 2, + 0, + 0, + 0, + 0, + 0, + 4, + 0, + 2, + 5, + 6, + 0, + 0, + 0, + 0, + 0, + 1, + 0, + 1, + 0, + 3, + 1, + 3, + 6, + 0, + 0, + 2, + 1, + 0, + 0, + 1, + 1, + 0, + 0, + 2, + 0, + 0, + 2, + 0, + 1, + 4, + 4, + 0, + 8, + 2, + 0, + 0, + 1, + 2, + 6, + 11, + 14, + 0, + 3, + 2, + 4 + ], + "weighted_loads": [ + 0.09820305556058884, + 0.03519267216324806, + 0.1177089624106884, + 0.49594898894429207, + 0.20605845749378204, + 0.5249975360929966, + 0.12504754588007927, + 0.7726262100040913, + 0.12202832475304604, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.3410137705504894, + 0.0, + 0.07681446149945259, + 0.2164170853793621, + 0.24293435737490654, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.04077579826116562, + 0.0, + 0.06679540872573853, + 0.0, + 0.16809657961130142, + 0.04969897121191025, + 0.14554188027977943, + 0.596314299851656, + 0.0, + 0.0, + 0.21944137662649155, + 0.032379597425460815, + 0.0, + 0.0, + 0.039363741874694824, + 0.048537325114011765, + 0.0, + 0.0, + 0.07572943344712257, + 0.0, + 0.0, + 0.12483445182442665, + 0.0, + 0.04663970321416855, + 0.16257735714316368, + 0.7580739893019199, + 0.0, + 0.40163454413414, + 0.12593040615320206, + 0.0, + 0.0, + 0.05164182931184769, + 0.10462802648544312, + 0.3749142475426197, + 0.8375429250299931, + 1.260927688330412, + 0.0, + 0.3736322969198227, + 0.10396305099129677, + 0.21998320892453194 + ], + "unique_experts": 38, + "load_cv": 1.362550088298112, + "normalized_load_entropy": 0.8036035463839075, + "max_load_share": 0.10144927536231885 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "a6cefa556bf1e23ec2aed0db7046271c09a898c3eb06dab33b4889f9ff1fc8e9", + "route_weight_sha256": "ac6a111b112f950f5371148e7868e5ff1ca2ec6e49bd69b7e46ca6afc6550316", + "loads": [ + 11, + 2, + 2, + 10, + 7, + 25, + 2, + 11, + 4, + 12, + 0, + 3, + 5, + 0, + 4, + 6, + 2, + 5, + 13, + 4, + 2, + 4, + 0, + 10, + 7, + 2, + 6, + 7, + 16, + 2, + 7, + 10, + 2, + 11, + 3, + 2, + 2, + 3, + 4, + 2, + 0, + 0, + 3, + 1, + 2, + 2, + 6, + 3, + 7, + 5, + 13, + 11, + 10, + 9, + 2, + 4, + 3, + 8, + 12, + 33, + 3, + 5, + 4, + 8 + ], + "weighted_loads": [ + 0.9671024158596992, + 0.0861411988735199, + 0.1177089624106884, + 0.6171896792948246, + 0.4154796302318573, + 1.6654760148376226, + 0.12504754588007927, + 0.9375609457492828, + 0.2858786918222904, + 0.9662242569029331, + 0.0, + 0.21645011380314827, + 0.35466862842440605, + 0.0, + 0.3410137705504894, + 0.30836081877350807, + 0.07681446149945259, + 0.2164170853793621, + 0.6701011061668396, + 0.20187759771943092, + 0.23319066688418388, + 0.15000216104090214, + 0.0, + 0.4123664330691099, + 0.31734529696404934, + 0.07416538707911968, + 0.42871227860450745, + 0.26014794036746025, + 2.112152975052595, + 0.09809456765651703, + 0.3627667687833309, + 0.72799476608634, + 0.07827326282858849, + 1.2108130641281605, + 0.267496082931757, + 0.11142276227474213, + 0.06063869222998619, + 0.3531682789325714, + 0.24682191759347916, + 0.10584811121225357, + 0.0, + 0.0, + 0.12829523906111717, + 0.04567999020218849, + 0.06030291132628918, + 0.12483445182442665, + 0.40449750795960426, + 0.11428665369749069, + 0.3171578701585531, + 0.792202178388834, + 0.8532958440482616, + 1.6677315831184387, + 0.9387087561190128, + 0.6823086477816105, + 0.08147517219185829, + 0.3357516825199127, + 0.15686948969960213, + 0.4565563499927521, + 0.9461495243012905, + 2.369000382721424, + 0.2516276575624943, + 0.4197628563269973, + 0.20499339699745178, + 0.40002037957310677 + ], + "unique_experts": 59, + "load_cv": 0.9478594305064437, + "normalized_load_entropy": 0.9104525586711572, + "max_load_share": 0.0859375 + } + }, + "s0_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "a22a192a1ff7ac7e185575d093403ae4c69546ab1ea5a8004db0965849a88c3b", + "route_weight_sha256": "785a9ea32f8999c6b959056eb290d5edcbc096670914b815db74f8267ef604b2", + "loads": [ + 2, + 1, + 2, + 7, + 4, + 9, + 2, + 8, + 2, + 0, + 0, + 0, + 0, + 0, + 4, + 0, + 2, + 5, + 7, + 0, + 0, + 0, + 0, + 0, + 1, + 1, + 1, + 0, + 4, + 1, + 2, + 6, + 0, + 0, + 2, + 0, + 0, + 0, + 1, + 1, + 0, + 0, + 2, + 0, + 1, + 1, + 0, + 1, + 3, + 4, + 0, + 7, + 2, + 0, + 0, + 1, + 2, + 5, + 11, + 14, + 0, + 3, + 2, + 4 + ], + "weighted_loads": [ + 0.12955307215452194, + 0.0371866449713707, + 0.11777381971478462, + 0.502375565469265, + 0.20466312393546104, + 0.536441907286644, + 0.12756885215640068, + 0.7948405779898167, + 0.13520481437444687, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.33076029643416405, + 0.0, + 0.081227857619524, + 0.21264425665140152, + 0.2980043236166239, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.04181528091430664, + 0.03442801907658577, + 0.06852656602859497, + 0.0, + 0.23627186939120293, + 0.05129077285528183, + 0.11094899475574493, + 0.6071043238043785, + 0.0, + 0.0, + 0.22820624709129333, + 0.0, + 0.0, + 0.0, + 0.04147403687238693, + 0.05093848705291748, + 0.0, + 0.0, + 0.08697311580181122, + 0.0, + 0.03222190588712692, + 0.10389338433742523, + 0.0, + 0.05187935382127762, + 0.1363948006182909, + 0.7717413567006588, + 0.0, + 0.38610367476940155, + 0.12530793249607086, + 0.0, + 0.0, + 0.05037904903292656, + 0.11784867197275162, + 0.3363007605075836, + 0.8293266855180264, + 1.1858306024223566, + 0.0, + 0.3808413967490196, + 0.09745971485972404, + 0.2062646523118019 + ], + "unique_experts": 39, + "load_cv": 1.360081418915263, + "normalized_load_entropy": 0.8066389480529622, + "max_load_share": 0.10144927536231885 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "970358967ad7b9636e212558c58a48c155c018fac02550aaf057a042d47cce87", + "route_weight_sha256": "6ac6a435d53153f513dd7279d1b2eb4e2eeca40418adba5884f63fa26c765a04", + "loads": [ + 9, + 1, + 2, + 10, + 4, + 19, + 2, + 9, + 2, + 8, + 2, + 3, + 0, + 0, + 4, + 4, + 2, + 5, + 13, + 1, + 0, + 0, + 0, + 10, + 3, + 2, + 7, + 5, + 13, + 1, + 5, + 10, + 0, + 7, + 2, + 0, + 1, + 1, + 3, + 1, + 0, + 0, + 2, + 0, + 4, + 1, + 6, + 3, + 3, + 5, + 1, + 15, + 8, + 7, + 0, + 5, + 2, + 6, + 12, + 27, + 0, + 3, + 2, + 5 + ], + "weighted_loads": [ + 0.8555578887462616, + 0.0371866449713707, + 0.11777381971478462, + 0.6378974355757236, + 0.20466312393546104, + 1.4572333712130785, + 0.12756885215640068, + 0.8283875323832035, + 0.13520481437444687, + 0.5917439721524715, + 0.06590710207819939, + 0.1902702860534191, + 0.0, + 0.0, + 0.33076029643416405, + 0.19774919748306274, + 0.081227857619524, + 0.21264425665140152, + 0.7120691519230604, + 0.03989744558930397, + 0.0, + 0.0, + 0.0, + 0.447684021666646, + 0.10810660384595394, + 0.0741797648370266, + 0.42263489589095116, + 0.3900795038789511, + 1.5867168344557285, + 0.05129077285528183, + 0.31229591742157936, + 0.8098972253501415, + 0.0, + 0.6718631312251091, + 0.22820624709129333, + 0.0, + 0.05102124065160751, + 0.044433340430259705, + 0.1538807414472103, + 0.05093848705291748, + 0.0, + 0.0, + 0.08697311580181122, + 0.0, + 0.16946998052299023, + 0.10389338433742523, + 0.3500682804733515, + 0.13894134387373924, + 0.1363948006182909, + 0.8147984519600868, + 0.041537392884492874, + 0.9991465676575899, + 0.8775644451379776, + 0.4798341691493988, + 0.0, + 0.42827121540904045, + 0.11784867197275162, + 0.3787477873265743, + 0.870684776455164, + 1.8288693074136972, + 0.0, + 0.3808413967490196, + 0.09745971485972404, + 0.24923665449023247 + ], + "unique_experts": 52, + "load_cv": 1.1201025085364418, + "normalized_load_entropy": 0.8687116952448185, + "max_load_share": 0.09375 + } + }, + "s1_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "65919c22f7270b4ee8b7c54ab760b3d2da4ec625cba9074d142a3aa68f234807", + "route_weight_sha256": "877a3b17729b8915edf2e4e3100e85e252d22e70fa264e9de638de66f1a62698", + "loads": [ + 1, + 0, + 2, + 8, + 4, + 9, + 2, + 7, + 2, + 0, + 0, + 0, + 0, + 0, + 4, + 0, + 1, + 4, + 7, + 0, + 0, + 0, + 0, + 0, + 1, + 0, + 1, + 0, + 3, + 1, + 3, + 6, + 0, + 0, + 2, + 1, + 0, + 2, + 1, + 1, + 0, + 0, + 2, + 0, + 0, + 1, + 0, + 1, + 4, + 4, + 0, + 7, + 2, + 0, + 0, + 1, + 2, + 7, + 12, + 14, + 0, + 3, + 2, + 3 + ], + "weighted_loads": [ + 0.08594517409801483, + 0.0, + 0.10756770148873329, + 0.5564836226403713, + 0.2134442701935768, + 0.5215538218617439, + 0.12326784431934357, + 0.7626485303044319, + 0.12935003638267517, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.3345067426562309, + 0.0, + 0.04564640671014786, + 0.17387113347649574, + 0.2937147356569767, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.04273948818445206, + 0.0, + 0.06768883764743805, + 0.0, + 0.18500831350684166, + 0.05569545924663544, + 0.1602056324481964, + 0.6084022223949432, + 0.0, + 0.0, + 0.22280604392290115, + 0.03204159066081047, + 0.0, + 0.06373949348926544, + 0.04000997915863991, + 0.04797668755054474, + 0.0, + 0.0, + 0.08434206619858742, + 0.0, + 0.0, + 0.09841763973236084, + 0.0, + 0.04606826975941658, + 0.17369640804827213, + 0.7819351702928543, + 0.0, + 0.3619835823774338, + 0.13056011125445366, + 0.0, + 0.0, + 0.049668118357658386, + 0.1029655896127224, + 0.38653550297021866, + 0.8461199067533016, + 1.2784308195114136, + 0.0, + 0.39902399107813835, + 0.1041078120470047, + 0.1662903055548668 + ], + "unique_experts": 38, + "load_cv": 1.3990575037362705, + "normalized_load_entropy": 0.7982962177226481, + "max_load_share": 0.10144927536231885 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "f012e31f62a1a48a70a2651887c4004bfe932ffb5803a6e568be0ebba2a00e0f", + "route_weight_sha256": "18c3475118422776e67a457b9193fa65b26e8ac130305217e6df37a1415d0e2f", + "loads": [ + 12, + 1, + 2, + 11, + 7, + 25, + 2, + 10, + 4, + 12, + 1, + 3, + 5, + 0, + 4, + 6, + 1, + 4, + 14, + 4, + 2, + 3, + 0, + 9, + 7, + 2, + 6, + 7, + 17, + 2, + 7, + 9, + 2, + 11, + 3, + 2, + 0, + 5, + 4, + 2, + 0, + 0, + 3, + 1, + 2, + 2, + 6, + 4, + 6, + 5, + 13, + 10, + 10, + 9, + 2, + 4, + 3, + 10, + 13, + 34, + 3, + 4, + 4, + 8 + ], + "weighted_loads": [ + 1.0024165399372578, + 0.050948526710271835, + 0.10756770148873329, + 0.6960727348923683, + 0.42286544293165207, + 1.66203230060637, + 0.12326784431934357, + 0.8901082836091518, + 0.29320040345191956, + 0.9249826818704605, + 0.031520191580057144, + 0.21645011380314827, + 0.35466862842440605, + 0.0, + 0.3345067426562309, + 0.27446845173835754, + 0.04564640671014786, + 0.17387113347649574, + 0.703796062618494, + 0.20187759771943092, + 0.23319066688418388, + 0.10304976813495159, + 0.0, + 0.38477716967463493, + 0.3193089868873358, + 0.07416538707911968, + 0.42960570752620697, + 0.33684525825083256, + 2.108978569507599, + 0.10409105569124222, + 0.3805752173066139, + 0.7457849718630314, + 0.07827326282858849, + 1.207847472280264, + 0.2708607502281666, + 0.11108475551009178, + 0.0, + 0.41690777242183685, + 0.23621853813529015, + 0.10528747364878654, + 0.0, + 0.0, + 0.13690787181258202, + 0.04567999020218849, + 0.06030291132628918, + 0.13970259949564934, + 0.39896397665143013, + 0.15364953130483627, + 0.3025688510388136, + 0.8160633593797684, + 0.8496278822422028, + 0.8039314337074757, + 0.9433384612202644, + 0.6823086477816105, + 0.08147517219185829, + 0.3850477561354637, + 0.1552070528268814, + 0.5178596340119839, + 0.9547265060245991, + 2.4397935904562473, + 0.2516276575624943, + 0.4403848722577095, + 0.2051381580531597, + 0.35620617493987083 + ], + "unique_experts": 59, + "load_cv": 0.9767256808109201, + "normalized_load_entropy": 0.905355560032698, + "max_load_share": 0.08854166666666667 + } + }, + "s0_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "1180dffe74d2eb88c52a1af6fbf67c97d4d4b0112a73c514e0251f5b2c281de0", + "route_weight_sha256": "d8e3f9eaefd81a34191dab5c88cd27b26ed59e45a31b5e52f2bd98f5a9515464", + "loads": [ + 1, + 1, + 2, + 7, + 4, + 9, + 2, + 7, + 2, + 0, + 0, + 0, + 0, + 0, + 4, + 0, + 2, + 5, + 8, + 0, + 0, + 0, + 0, + 0, + 1, + 1, + 1, + 0, + 3, + 1, + 3, + 6, + 0, + 0, + 2, + 1, + 0, + 0, + 1, + 1, + 0, + 0, + 2, + 0, + 0, + 1, + 0, + 1, + 3, + 4, + 0, + 8, + 2, + 0, + 0, + 1, + 2, + 6, + 11, + 14, + 0, + 3, + 2, + 3 + ], + "weighted_loads": [ + 0.09333556145429611, + 0.036918092519044876, + 0.12489410862326622, + 0.48756202682852745, + 0.21072321012616158, + 0.5504158064723015, + 0.13324394822120667, + 0.7490060590207577, + 0.12819450348615646, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.3356392942368984, + 0.0, + 0.0802304744720459, + 0.2215416245162487, + 0.35276336036622524, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.04038955271244049, + 0.04062626138329506, + 0.06699930876493454, + 0.0, + 0.20090556144714355, + 0.05216646194458008, + 0.1493239887058735, + 0.5856467671692371, + 0.0, + 0.0, + 0.21347381174564362, + 0.03184698522090912, + 0.0, + 0.0, + 0.0416027307510376, + 0.05109712854027748, + 0.0, + 0.0, + 0.07771492749452591, + 0.0, + 0.0, + 0.09571241587400436, + 0.0, + 0.04458058252930641, + 0.1354889776557684, + 0.7456505335867405, + 0.0, + 0.3830428458750248, + 0.13865625858306885, + 0.0, + 0.0, + 0.050781119614839554, + 0.11294786259531975, + 0.3847239501774311, + 0.8105865493416786, + 1.2035019882023335, + 0.0, + 0.3832641765475273, + 0.10055061802268028, + 0.15604958683252335 + ], + "unique_experts": 39, + "load_cv": 1.3772691840657083, + "normalized_load_entropy": 0.8036035463839075, + "max_load_share": 0.10144927536231885 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "ff8bfbcbf50b79535c33e7ac69206ab1eaef6e1869673ca3c4e31106e23076be", + "route_weight_sha256": "1bc159f5762a82d3855c3acb9e842ff4ff749be94f950eac99122910acf72703", + "loads": [ + 9, + 1, + 2, + 8, + 4, + 21, + 2, + 8, + 2, + 8, + 2, + 3, + 0, + 1, + 4, + 5, + 2, + 5, + 12, + 2, + 0, + 0, + 0, + 10, + 3, + 2, + 8, + 4, + 11, + 1, + 5, + 10, + 0, + 7, + 2, + 1, + 2, + 2, + 3, + 1, + 0, + 0, + 3, + 0, + 2, + 1, + 6, + 3, + 3, + 5, + 2, + 13, + 8, + 8, + 0, + 5, + 2, + 7, + 11, + 27, + 0, + 3, + 2, + 4 + ], + "weighted_loads": [ + 0.9095600247383118, + 0.036918092519044876, + 0.12489410862326622, + 0.5273411720991135, + 0.21072321012616158, + 1.6095407139509916, + 0.13324394822120667, + 0.7825530134141445, + 0.12819450348615646, + 0.5357875376939774, + 0.06590710207819939, + 0.1902702860534191, + 0.0, + 0.05722653493285179, + 0.3356392942368984, + 0.22165149077773094, + 0.0802304744720459, + 0.2215416245162487, + 0.5531703513115644, + 0.11406653746962547, + 0.0, + 0.0, + 0.0, + 0.447684021666646, + 0.10457915626466274, + 0.07179229706525803, + 0.5344255305826664, + 0.3231625687330961, + 1.3313003703951836, + 0.05216646194458008, + 0.3112826310098171, + 0.7857530117034912, + 0.0, + 0.7305043153464794, + 0.21347381174564362, + 0.03184698522090912, + 0.08697839826345444, + 0.1163608506321907, + 0.15639344602823257, + 0.05109712854027748, + 0.0, + 0.0, + 0.12636403366923332, + 0.0, + 0.06528146378695965, + 0.09571241587400436, + 0.3821005653589964, + 0.13164257258176804, + 0.1354889776557684, + 0.7887076288461685, + 0.08343124389648438, + 0.8657957557588816, + 0.8909127712249756, + 0.5669526681303978, + 0.0, + 0.3806499354541302, + 0.11294786259531975, + 0.42682159692049026, + 0.8105865493416786, + 1.8431811779737473, + 0.0, + 0.3832641765475273, + 0.10055061802268028, + 0.2104783020913601 + ], + "unique_experts": 54, + "load_cv": 1.090786328670659, + "normalized_load_entropy": 0.8796134052736806, + "max_load_share": 0.09375 + } + }, + "s1_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "6565c0dc3b397f9b9e24123dc0d95b9c607597a169bb32cf0ac58d6bb566970f", + "route_weight_sha256": "520e245b1ca0563b69d837b2ca2b5a0c8d515717ab4d1b76c49a3bf57e9619f5", + "loads": [ + 1, + 1, + 2, + 8, + 4, + 10, + 2, + 7, + 2, + 0, + 0, + 0, + 0, + 0, + 4, + 0, + 1, + 4, + 7, + 0, + 0, + 0, + 0, + 0, + 1, + 1, + 2, + 0, + 3, + 1, + 3, + 6, + 0, + 0, + 2, + 1, + 0, + 2, + 1, + 1, + 0, + 0, + 2, + 0, + 0, + 1, + 0, + 1, + 3, + 4, + 0, + 7, + 2, + 0, + 0, + 1, + 2, + 4, + 11, + 14, + 0, + 3, + 2, + 4 + ], + "weighted_loads": [ + 0.06513361632823944, + 0.03320800140500069, + 0.11661123856902122, + 0.5368405692279339, + 0.22905069217085838, + 0.6108834482729435, + 0.1310800462961197, + 0.7425074465572834, + 0.12782049924135208, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.3230982832610607, + 0.0, + 0.043059706687927246, + 0.1874467208981514, + 0.32191333174705505, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.042289309203624725, + 0.04011419042944908, + 0.10212777554988861, + 0.0, + 0.17194406315684319, + 0.05186424404382706, + 0.16390129551291466, + 0.599601686000824, + 0.0, + 0.0, + 0.21249237656593323, + 0.031209245324134827, + 0.0, + 0.06859664246439934, + 0.03899022564291954, + 0.04686785116791725, + 0.0, + 0.0, + 0.08376822993159294, + 0.0, + 0.0, + 0.09733639657497406, + 0.0, + 0.04805046319961548, + 0.13847951963543892, + 0.7502614818513393, + 0.0, + 0.33819448575377464, + 0.13042959570884705, + 0.0, + 0.0, + 0.04591187462210655, + 0.11051907762885094, + 0.2611960098147392, + 0.7788077369332314, + 1.2323975637555122, + 0.0, + 0.38830868527293205, + 0.10930557548999786, + 0.19867302849888802 + ], + "unique_experts": 40, + "load_cv": 1.360081418915263, + "normalized_load_entropy": 0.8102857475803219, + "max_load_share": 0.10144927536231885 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "2173959fd81c679fec3602594eb80b5760d92e406af676abb720e68527dba541", + "route_weight_sha256": "08868a1c25bdd306e9e435c48261b100e225c0950027da2ffc436f04d61c3b31", + "loads": [ + 11, + 2, + 2, + 10, + 7, + 30, + 2, + 10, + 4, + 10, + 0, + 4, + 5, + 0, + 4, + 5, + 1, + 4, + 13, + 4, + 2, + 3, + 0, + 10, + 7, + 3, + 8, + 7, + 15, + 2, + 9, + 8, + 2, + 11, + 3, + 2, + 1, + 6, + 4, + 2, + 0, + 0, + 4, + 1, + 2, + 1, + 5, + 3, + 5, + 5, + 13, + 9, + 10, + 10, + 2, + 4, + 3, + 6, + 12, + 37, + 3, + 4, + 4, + 8 + ], + "weighted_loads": [ + 0.9581745639443398, + 0.08415652811527252, + 0.11661123856902122, + 0.6175605393946171, + 0.43847186490893364, + 2.031227657571435, + 0.1310800462961197, + 0.8699671998620033, + 0.29167086631059647, + 0.747630562633276, + 0.0, + 0.26424476131796837, + 0.35466862842440605, + 0.0, + 0.3230982832610607, + 0.23608896508812904, + 0.043059706687927246, + 0.1874467208981514, + 0.6906463950872421, + 0.20187759771943092, + 0.23319066688418388, + 0.10304976813495159, + 0.0, + 0.4389345161616802, + 0.31885880790650845, + 0.11427957750856876, + 0.5680777430534363, + 0.29164103232324123, + 1.5891865566372871, + 0.10025984048843384, + 0.4431237056851387, + 0.6767672039568424, + 0.07827326282858849, + 1.193698987364769, + 0.26054708287119865, + 0.11025241017341614, + 0.03826442360877991, + 0.5191281996667385, + 0.23563998937606812, + 0.10417863726615906, + 0.0, + 0.0, + 0.19313687831163406, + 0.04567999020218849, + 0.06030291132628918, + 0.09733639657497406, + 0.36992765218019485, + 0.11569741368293762, + 0.2673519626259804, + 0.7843896709382534, + 0.8528720252215862, + 0.7316892892122269, + 0.9432079456746578, + 0.8048996515572071, + 0.08147517219185829, + 0.31984877586364746, + 0.16276054084300995, + 0.3522016182541847, + 0.8874143362045288, + 2.4608535189181566, + 0.2516276575624943, + 0.4296695664525032, + 0.21033592149615288, + 0.37459084019064903 + ], + "unique_experts": 59, + "load_cv": 1.035397803315765, + "normalized_load_entropy": 0.9018235261196592, + "max_load_share": 0.09635416666666667 + } + }, + "s0_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "acdaaf9f27004f02f6f8e78d5218c47b5c7cebac01e3438c9fe868fd81ef56fb", + "route_weight_sha256": "613868fee43b81740b06dcb95ad3d15d23a8b2c0a55f850a7da6746702083dfe", + "loads": [ + 1, + 1, + 2, + 7, + 4, + 10, + 2, + 7, + 2, + 0, + 0, + 0, + 0, + 0, + 4, + 0, + 2, + 5, + 8, + 0, + 0, + 0, + 0, + 0, + 1, + 1, + 1, + 0, + 3, + 1, + 3, + 6, + 0, + 0, + 2, + 0, + 0, + 0, + 1, + 1, + 0, + 0, + 2, + 0, + 1, + 1, + 0, + 1, + 3, + 4, + 0, + 7, + 2, + 0, + 0, + 1, + 2, + 6, + 11, + 14, + 0, + 3, + 2, + 3 + ], + "weighted_loads": [ + 0.08862307667732239, + 0.03630945086479187, + 0.11392133310437202, + 0.4681573435664177, + 0.21000296622514725, + 0.5748804733157158, + 0.13674459233880043, + 0.7411427311599255, + 0.12357055395841599, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.331547524780035, + 0.0, + 0.07975535094738007, + 0.23000982403755188, + 0.3469243533909321, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.03837496042251587, + 0.038250621408224106, + 0.06895960867404938, + 0.0, + 0.1964818611741066, + 0.055188678205013275, + 0.14901933819055557, + 0.5882607698440552, + 0.0, + 0.0, + 0.21452542394399643, + 0.0, + 0.0, + 0.0, + 0.040948525071144104, + 0.051545388996601105, + 0.0, + 0.0, + 0.08137370645999908, + 0.0, + 0.03436102345585823, + 0.10073420405387878, + 0.0, + 0.04961196333169937, + 0.13649366050958633, + 0.7607743628323078, + 0.0, + 0.35569076612591743, + 0.13633989915251732, + 0.0, + 0.0, + 0.04975603520870209, + 0.10880551859736443, + 0.3763483874499798, + 0.8268677555024624, + 1.1887685395777225, + 0.0, + 0.38011017069220543, + 0.09968418627977371, + 0.16472488269209862 + ], + "unique_experts": 39, + "load_cv": 1.3821407162305501, + "normalized_load_entropy": 0.803191178762777, + "max_load_share": 0.10144927536231885 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "491d07231aa56679402f59127f89f6ce654b32643e6a932e4bda327898786afb", + "route_weight_sha256": "e3256f5a7fd5beca76c3a594649728a20c0e682131f4ac292aacf6366752e5b1", + "loads": [ + 9, + 1, + 2, + 8, + 4, + 21, + 2, + 8, + 2, + 8, + 2, + 3, + 0, + 1, + 4, + 5, + 2, + 5, + 12, + 1, + 0, + 0, + 0, + 10, + 3, + 2, + 8, + 5, + 11, + 1, + 5, + 10, + 0, + 7, + 2, + 0, + 2, + 2, + 3, + 1, + 0, + 0, + 2, + 0, + 3, + 1, + 5, + 4, + 3, + 6, + 2, + 12, + 8, + 8, + 0, + 5, + 2, + 7, + 11, + 27, + 0, + 4, + 2, + 4 + ], + "weighted_loads": [ + 0.840663293376565, + 0.03630945086479187, + 0.11392133310437202, + 0.5079364888370037, + 0.21000296622514725, + 1.5651986468583345, + 0.13674459233880043, + 0.7746896855533123, + 0.12357055395841599, + 0.5310110487043858, + 0.06590710207819939, + 0.1902702860534191, + 0.0, + 0.05182132124900818, + 0.331547524780035, + 0.22426521219313145, + 0.07975535094738007, + 0.23000982403755188, + 0.5562513694167137, + 0.03989744558930397, + 0.0, + 0.0, + 0.0, + 0.447684021666646, + 0.1109116543084383, + 0.07235134765505791, + 0.4778568670153618, + 0.3691901843994856, + 1.4722429886460304, + 0.055188678205013275, + 0.3156883120536804, + 0.7797460332512856, + 0.0, + 0.724926833063364, + 0.21452542394399643, + 0.0, + 0.09011245146393776, + 0.10110712423920631, + 0.14819862321019173, + 0.051545388996601105, + 0.0, + 0.0, + 0.08137370645999908, + 0.0, + 0.09964248724281788, + 0.10073420405387878, + 0.33196148462593555, + 0.20835039392113686, + 0.13649366050958633, + 0.8509945571422577, + 0.09237475320696831, + 0.8343202192336321, + 0.8885964117944241, + 0.5687714517116547, + 0.0, + 0.46401219815015793, + 0.10880551859736443, + 0.4162253886461258, + 0.8268677555024624, + 1.8182164914906025, + 0.0, + 0.4137687049806118, + 0.09968418627977371, + 0.2256062999367714 + ], + "unique_experts": 53, + "load_cv": 1.0886621079036347, + "normalized_load_entropy": 0.8778693664178185, + "max_load_share": 0.09375 + } + }, + "s1_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "743b7dee0752dcc737364cae308627741ede9d75ccad95803a05af2804480cfb", + "route_weight_sha256": "3df77f19829657f19ca861810f8dd2a80e8f840f95fcb2071e1e5999be90a2e7", + "loads": [ + 1, + 1, + 2, + 8, + 4, + 10, + 1, + 7, + 2, + 0, + 0, + 0, + 0, + 0, + 4, + 0, + 1, + 5, + 8, + 0, + 0, + 0, + 0, + 1, + 1, + 2, + 2, + 0, + 2, + 1, + 3, + 6, + 0, + 0, + 2, + 0, + 0, + 0, + 1, + 1, + 0, + 0, + 2, + 0, + 1, + 1, + 0, + 1, + 3, + 4, + 0, + 7, + 2, + 0, + 0, + 1, + 2, + 4, + 11, + 14, + 0, + 3, + 2, + 4 + ], + "weighted_loads": [ + 0.057022422552108765, + 0.033502113074064255, + 0.10954538360238075, + 0.5282512083649635, + 0.23332316800951958, + 0.5969293639063835, + 0.0905170664191246, + 0.7400279939174652, + 0.12881644815206528, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.3174350745975971, + 0.0, + 0.04305953532457352, + 0.23161497339606285, + 0.346499677747488, + 0.0, + 0.0, + 0.0, + 0.0, + 0.04131236672401428, + 0.0431554839015007, + 0.09400898590683937, + 0.10077251121401787, + 0.0, + 0.1177954338490963, + 0.054450616240501404, + 0.16660932078957558, + 0.5989095792174339, + 0.0, + 0.0, + 0.21173858642578125, + 0.0, + 0.0, + 0.0, + 0.03863033279776573, + 0.04960034042596817, + 0.0, + 0.0, + 0.08265481516718864, + 0.0, + 0.03183089569211006, + 0.096187524497509, + 0.0, + 0.04699231684207916, + 0.13720129989087582, + 0.7710896506905556, + 0.0, + 0.3282078430056572, + 0.1265895664691925, + 0.0, + 0.0, + 0.04416238144040108, + 0.12473919987678528, + 0.26673154532909393, + 0.7792295441031456, + 1.1919105481356382, + 0.0, + 0.3879459910094738, + 0.107681043446064, + 0.20424172282218933 + ], + "unique_experts": 40, + "load_cv": 1.3797071002280374, + "normalized_load_entropy": 0.8064170657954546, + "max_load_share": 0.10144927536231885 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "b04562f752ac18229271b54c570586ded896ee77574d47d9c6b7eb0df22e05d6", + "route_weight_sha256": "b823f21d79bbcfa5309f61d285ea76e0559825212707888bc9d75ec8ec782543", + "loads": [ + 13, + 2, + 2, + 10, + 8, + 27, + 1, + 10, + 4, + 12, + 0, + 3, + 5, + 0, + 4, + 5, + 1, + 5, + 14, + 4, + 2, + 3, + 0, + 10, + 9, + 4, + 7, + 6, + 15, + 2, + 8, + 9, + 2, + 10, + 3, + 1, + 2, + 4, + 4, + 2, + 0, + 0, + 3, + 1, + 3, + 1, + 5, + 4, + 5, + 6, + 13, + 9, + 10, + 10, + 2, + 4, + 3, + 6, + 12, + 35, + 3, + 4, + 4, + 8 + ], + "weighted_loads": [ + 1.0000612437725067, + 0.08445063978433609, + 0.10954538360238075, + 0.6084491647779942, + 0.4819601736962795, + 1.795123552903533, + 0.0905170664191246, + 0.8674877472221851, + 0.29266681522130966, + 0.8812616467475891, + 0.0, + 0.21645011380314827, + 0.35466862842440605, + 0.0, + 0.3174350745975971, + 0.24714605137705803, + 0.04305953532457352, + 0.23161497339606285, + 0.719182875007391, + 0.20187759771943092, + 0.23319066688418388, + 0.10304976813495159, + 0.0, + 0.4260895363986492, + 0.4228257406502962, + 0.16817437298595905, + 0.4626893810927868, + 0.24774052388966084, + 1.5279580615460873, + 0.10284621268510818, + 0.424004215747118, + 0.7108218260109425, + 0.07827326282858849, + 1.166940439492464, + 0.2597932927310467, + 0.07904316484928131, + 0.060314107686281204, + 0.4440367519855499, + 0.2284213788807392, + 0.10691112652420998, + 0.0, + 0.0, + 0.13522062078118324, + 0.04567999020218849, + 0.09213380701839924, + 0.096187524497509, + 0.3490411192178726, + 0.1559356227517128, + 0.2660737428814173, + 0.8469052724540234, + 0.8611637838184834, + 0.7179466895759106, + 0.9393679164350033, + 0.7631929405033588, + 0.08147517219185829, + 0.45498722419142723, + 0.1769806630909443, + 0.3570372276008129, + 0.887836143374443, + 2.329631807282567, + 0.2516276575624943, + 0.42930687218904495, + 0.208711389452219, + 0.37650223821401596 + ], + "unique_experts": 59, + "load_cv": 0.9934682514638636, + "normalized_load_entropy": 0.9045768170601691, + "max_load_share": 0.09114583333333333 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "ordered_topk_exact_tokens": 17, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.9503105590062112, + "mean_token_weighted_tv": 0.014170228220198465, + "aggregate_load_tv": 0.028985507246376815 + }, + "system_bos": { + "tokens": 23, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8788819875776398, + "mean_token_weighted_tv": 0.02746691287535688, + "aggregate_load_tv": 0.06521739130434782 + }, + "system_x": { + "tokens": 23, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.9130434782608695, + "mean_token_weighted_tv": 0.024280171679413837, + "aggregate_load_tv": 0.043478260869565216 + }, + "system_period": { + "tokens": 23, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.9254658385093167, + "mean_token_weighted_tv": 0.025336435550580853, + "aggregate_load_tv": 0.03623188405797101 + }, + "bos_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.9006211180124223, + "mean_token_weighted_tv": 0.025294280206055744, + "aggregate_load_tv": 0.036231884057971016 + }, + "bos_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.9006211180124224, + "mean_token_weighted_tv": 0.02639390985764887, + "aggregate_load_tv": 0.04347826086956522 + }, + "x_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 16, + "set_exact_tokens": 20, + "mean_set_jaccard": 0.9534161490683231, + "mean_token_weighted_tv": 0.021408418031490368, + "aggregate_load_tv": 0.028985507246376812 + }, + "x_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8881987577639753, + "mean_token_weighted_tv": 0.03270213224965593, + "aggregate_load_tv": 0.050724637681159424 + }, + "period_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 18, + "mean_set_jaccard": 0.9285714285714286, + "mean_token_weighted_tv": 0.02271563365407612, + "aggregate_load_tv": 0.04347826086956522 + }, + "period_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 8, + "set_exact_tokens": 13, + "mean_set_jaccard": 0.8757763975155279, + "mean_token_weighted_tv": 0.035119049413048706, + "aggregate_load_tv": 0.06521739130434782 + } + } + }, + "layer_15": { + "layer": 15, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "b14945b65713b715a34d73935b480784a71baea63271eb69a8895cefb8f6bf7a", + "route_weight_sha256": "6792ccfb598c2ab1e95ba3cb17e19caff8353abf60c762dae09cd28ef8d7151b", + "loads": [ + 4, + 2, + 0, + 11, + 2, + 6, + 2, + 0, + 0, + 0, + 3, + 1, + 4, + 0, + 8, + 1, + 0, + 3, + 1, + 3, + 2, + 1, + 2, + 13, + 6, + 2, + 2, + 0, + 7, + 0, + 0, + 4, + 2, + 2, + 1, + 2, + 5, + 3, + 5, + 1, + 0, + 5, + 1, + 3, + 0, + 0, + 2, + 1, + 0, + 1, + 2, + 0, + 1, + 1, + 0, + 2, + 3, + 2, + 2, + 0, + 0, + 0, + 1, + 0 + ], + "weighted_loads": [ + 0.3475858308374882, + 0.09851561114192009, + 0.0, + 0.5824056901037693, + 0.1662900447845459, + 0.22279404290020466, + 0.09513728320598602, + 0.0, + 0.0, + 0.0, + 0.6869236417114735, + 0.036647140979766846, + 0.1790135633200407, + 0.0, + 0.7078411057591438, + 0.03778379410505295, + 0.0, + 0.16831314377486706, + 0.033055633306503296, + 0.12159734219312668, + 0.08847705274820328, + 0.06846242398023605, + 0.0846482552587986, + 0.8565853349864483, + 0.5958969444036484, + 0.11747003719210625, + 0.10079129412770271, + 0.0, + 0.5755482837557793, + 0.0, + 0.0, + 0.43066458962857723, + 0.12512952089309692, + 0.08074116334319115, + 0.06667158752679825, + 0.07721706293523312, + 0.36006600968539715, + 0.10234973207116127, + 0.2651996910572052, + 0.033067330718040466, + 0.0, + 0.6209461838006973, + 0.03672017902135849, + 0.14562196657061577, + 0.0, + 0.0, + 0.13335298374295235, + 0.03360222280025482, + 0.0, + 0.052645888179540634, + 0.07459384575486183, + 0.0, + 0.033681031316518784, + 0.04363902285695076, + 0.0, + 0.07613818347454071, + 0.17946581542491913, + 0.07249558344483376, + 0.15290506184101105, + 0.0, + 0.0, + 0.0, + 0.06520968675613403, + 0.0 + ], + "unique_experts": 45, + "load_cv": 1.197122503938086, + "normalized_load_entropy": 0.8487773309120707, + "max_load_share": 0.09420289855072464 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "8ed68ec3fb18b5c92d040dd0a37ad7414422ad37e793086ba19f707c30d8807f", + "route_weight_sha256": "da2af90ed5fb57157a686bfa4071b11f936e7709f9ce76209cffabc297812e73", + "loads": [ + 9, + 2, + 0, + 11, + 10, + 9, + 10, + 2, + 5, + 1, + 8, + 2, + 8, + 0, + 18, + 2, + 7, + 5, + 1, + 5, + 2, + 1, + 2, + 18, + 11, + 4, + 11, + 0, + 11, + 0, + 4, + 4, + 7, + 4, + 1, + 2, + 10, + 3, + 6, + 1, + 6, + 6, + 1, + 5, + 0, + 0, + 2, + 3, + 1, + 11, + 7, + 2, + 6, + 1, + 0, + 6, + 3, + 2, + 3, + 0, + 0, + 1, + 1, + 4 + ], + "weighted_loads": [ + 0.6414212323725224, + 0.09851561114192009, + 0.0, + 0.5824056901037693, + 0.5700636971741915, + 0.2963372189551592, + 0.6850074641406536, + 0.06848639622330666, + 0.377792302519083, + 0.031456805765628815, + 0.879887918010354, + 0.06675403192639351, + 0.49692039377987385, + 0.0, + 1.0801750104874372, + 0.07769356295466423, + 0.6120063662528992, + 0.242540018633008, + 0.033055633306503296, + 0.22282599657773972, + 0.08847705274820328, + 0.06846242398023605, + 0.0846482552587986, + 1.1359711587429047, + 0.7310464209876955, + 0.18206409737467766, + 0.722849752753973, + 0.0, + 0.7220700494945049, + 0.0, + 0.1730712167918682, + 0.43066458962857723, + 0.5383806843310595, + 0.16897191479802132, + 0.06667158752679825, + 0.07721706293523312, + 1.0866181012243032, + 0.10234973207116127, + 0.29635918512940407, + 0.033067330718040466, + 0.5593125910963863, + 0.625233924947679, + 0.03672017902135849, + 0.23035162687301636, + 0.0, + 0.0, + 0.13335298374295235, + 0.10771128535270691, + 0.013498908840119839, + 1.9616879634559155, + 0.38006352819502354, + 0.08458566665649414, + 0.18636332731693983, + 0.04363902285695076, + 0.0, + 1.746166355907917, + 0.17946581542491913, + 0.07249558344483376, + 0.20385035127401352, + 0.0, + 0.0, + 0.04784374311566353, + 0.06520968675613403, + 0.17157496884465218 + ], + "unique_experts": 55, + "load_cv": 0.937885723118563, + "normalized_load_entropy": 0.8946032570454766, + "max_load_share": 0.0625 + } + }, + "s1_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "5d175e9cba354856802098deaeb1c939d61e4c8edab9ee1662f6542957c619b5", + "route_weight_sha256": "d80a6b61bd56578314b22fafd71cf8e110818f22d8b21dfb793c15dc6f0cf1b0", + "loads": [ + 4, + 1, + 0, + 10, + 2, + 7, + 2, + 0, + 1, + 0, + 3, + 1, + 3, + 0, + 7, + 1, + 0, + 3, + 1, + 2, + 3, + 1, + 2, + 13, + 5, + 2, + 3, + 0, + 6, + 0, + 0, + 4, + 2, + 2, + 1, + 1, + 4, + 3, + 6, + 0, + 0, + 5, + 1, + 3, + 0, + 1, + 3, + 2, + 0, + 2, + 3, + 0, + 1, + 1, + 0, + 2, + 3, + 2, + 2, + 0, + 0, + 0, + 1, + 0 + ], + "weighted_loads": [ + 0.3153988979756832, + 0.06717368960380554, + 0.0, + 0.5328575000166893, + 0.1746469885110855, + 0.2627558559179306, + 0.09753403067588806, + 0.0, + 0.03492600470781326, + 0.0, + 0.6891903653740883, + 0.03665690869092941, + 0.14625687524676323, + 0.0, + 0.6610595099627972, + 0.03977172076702118, + 0.0, + 0.16041698679327965, + 0.034426137804985046, + 0.07104061357676983, + 0.12055111303925514, + 0.0684155747294426, + 0.08390404656529427, + 0.8528111577033997, + 0.5728881321847439, + 0.11766046285629272, + 0.1345314122736454, + 0.0, + 0.5339492000639439, + 0.0, + 0.0, + 0.439094677567482, + 0.1226678416132927, + 0.0853315107524395, + 0.06672173738479614, + 0.04352302476763725, + 0.33399472013115883, + 0.10042847320437431, + 0.3057772722095251, + 0.0, + 0.0, + 0.6201678924262524, + 0.04091948643326759, + 0.14988234639167786, + 0.0, + 0.03345070406794548, + 0.1672397032380104, + 0.06309380009770393, + 0.0, + 0.09980958327651024, + 0.1063072644174099, + 0.0, + 0.029810374602675438, + 0.041267648339271545, + 0.0, + 0.07560010254383087, + 0.18068744987249374, + 0.07440797239542007, + 0.16745710745453835, + 0.0, + 0.0, + 0.0, + 0.06665647029876709, + 0.0 + ], + "unique_experts": 46, + "load_cv": 1.1454777617516225, + "normalized_load_entropy": 0.8581651000757379, + "max_load_share": 0.09420289855072464 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "e2f731040c093c000df41aa95c16bc9aadd7192b049c0f8d6a5683fefe7eefe4", + "route_weight_sha256": "a335e2eeeaa52912edcaa01c963a5b79bea11162eebd3c4032cb33e7b717420e", + "loads": [ + 25, + 2, + 0, + 10, + 12, + 12, + 16, + 1, + 11, + 1, + 8, + 5, + 8, + 1, + 12, + 11, + 12, + 7, + 2, + 6, + 4, + 2, + 2, + 18, + 9, + 4, + 13, + 2, + 12, + 1, + 6, + 8, + 7, + 4, + 3, + 1, + 10, + 3, + 8, + 1, + 6, + 7, + 1, + 5, + 0, + 2, + 3, + 4, + 3, + 16, + 11, + 2, + 3, + 2, + 0, + 6, + 3, + 8, + 4, + 4, + 0, + 7, + 3, + 4 + ], + "weighted_loads": [ + 1.6976456921547651, + 0.09427440725266933, + 0.0, + 0.5328575000166893, + 0.6878966353833675, + 0.4677509078755975, + 1.1631968598812819, + 0.03110133297741413, + 0.6103228479623795, + 0.03111063875257969, + 0.921513020992279, + 0.3693433031439781, + 0.5706166923046112, + 0.08261066675186157, + 0.8305090758949518, + 0.6965897753834724, + 1.0825071893632412, + 0.31803616136312485, + 0.08304854854941368, + 0.32772126980125904, + 0.14985985681414604, + 0.14882219582796097, + 0.08390404656529427, + 1.1034094020724297, + 0.6655279446858913, + 0.18645264953374863, + 0.8466353863477707, + 0.12212776765227318, + 0.9524227678775787, + 0.037235554307699203, + 0.22954066284000874, + 0.8851633816957474, + 0.5189020037651062, + 0.1990152858197689, + 0.21622160077095032, + 0.04352302476763725, + 1.033171683549881, + 0.10042847320437431, + 0.36927937157452106, + 0.0356471873819828, + 0.5066219789441675, + 0.7112005478702486, + 0.04091948643326759, + 0.42163392528891563, + 0.0, + 0.07114068046212196, + 0.1672397032380104, + 0.1381191499531269, + 0.14317345526069403, + 2.896241344511509, + 0.5229597687721252, + 0.06944504752755165, + 0.07811570260673761, + 0.1880461424589157, + 0.0, + 1.7245228439569473, + 0.18068744987249374, + 0.7312858551740646, + 0.24893174692988396, + 0.17367615923285484, + 0.0, + 0.36868729814887047, + 0.1813983917236328, + 0.17243999242782593 + ], + "unique_experts": 60, + "load_cv": 0.836971226108361, + "normalized_load_entropy": 0.9183981846800318, + "max_load_share": 0.06510416666666667 + } + }, + "s0_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "20709eab7308e748559dfe0e00e8b09d16a4e0d0a688cc332f2c0a0178fd814b", + "route_weight_sha256": "f4685c90c8525aaf3746ddd2990fe7164eb752315873a72dfbf549165b1fa854", + "loads": [ + 4, + 2, + 0, + 12, + 2, + 3, + 2, + 0, + 1, + 0, + 3, + 1, + 3, + 0, + 8, + 1, + 0, + 3, + 1, + 2, + 2, + 1, + 3, + 11, + 6, + 2, + 3, + 0, + 6, + 0, + 0, + 4, + 2, + 2, + 1, + 2, + 5, + 4, + 5, + 0, + 1, + 5, + 1, + 2, + 0, + 0, + 3, + 2, + 0, + 2, + 2, + 0, + 1, + 1, + 0, + 2, + 3, + 2, + 2, + 0, + 0, + 1, + 1, + 0 + ], + "weighted_loads": [ + 0.3252236358821392, + 0.1144653670489788, + 0.0, + 0.6059005931019783, + 0.16220685839653015, + 0.1120712049305439, + 0.09958219155669212, + 0.0, + 0.03431960567831993, + 0.0, + 0.6803716197609901, + 0.03596602380275726, + 0.15895304083824158, + 0.0, + 0.7213087901473045, + 0.03884841874241829, + 0.0, + 0.1649964265525341, + 0.035008057951927185, + 0.08851590752601624, + 0.07958819717168808, + 0.06782155483961105, + 0.12256888300180435, + 0.802629467099905, + 0.5957814995199442, + 0.12054970487952232, + 0.12811465188860893, + 0.0, + 0.5418373495340347, + 0.0, + 0.0, + 0.44315986707806587, + 0.12785707414150238, + 0.09108473360538483, + 0.06331083923578262, + 0.07654728181660175, + 0.37259547784924507, + 0.14937720447778702, + 0.31326547265052795, + 0.0, + 0.032157331705093384, + 0.6165092401206493, + 0.03794555366039276, + 0.10937770083546638, + 0.0, + 0.0, + 0.1643242910504341, + 0.06324019469320774, + 0.0, + 0.09863941743969917, + 0.07600459083914757, + 0.0, + 0.03549175336956978, + 0.04307299852371216, + 0.0, + 0.0678308717906475, + 0.1888418272137642, + 0.07179810106754303, + 0.15749633684754372, + 0.0, + 0.0, + 0.038643065840005875, + 0.06602416932582855, + 0.0 + ], + "unique_experts": 47, + "load_cv": 1.121761599595209, + "normalized_load_entropy": 0.8647530262952309, + "max_load_share": 0.08695652173913043 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "eb60404db12a94719fea95a112c2e569a1f8df7e451eefb4abeebc125873454c", + "route_weight_sha256": "42bd008d5c0700eb6a0f904a6a6e58ad7498f07d080f15a48f58a154d4314481", + "loads": [ + 9, + 2, + 0, + 12, + 9, + 6, + 9, + 2, + 5, + 1, + 8, + 2, + 7, + 0, + 17, + 2, + 7, + 5, + 1, + 4, + 2, + 1, + 3, + 16, + 10, + 4, + 12, + 0, + 11, + 0, + 5, + 4, + 7, + 4, + 1, + 3, + 10, + 4, + 6, + 0, + 8, + 5, + 1, + 4, + 0, + 0, + 3, + 4, + 1, + 11, + 8, + 3, + 6, + 2, + 2, + 4, + 3, + 2, + 3, + 0, + 0, + 2, + 1, + 4 + ], + "weighted_loads": [ + 0.6615699976682663, + 0.1144653670489788, + 0.0, + 0.6059005931019783, + 0.518454959616065, + 0.22246494889259338, + 0.5860220305621624, + 0.06848639622330666, + 0.3838384933769703, + 0.031456805765628815, + 0.8733358960598707, + 0.06607291474938393, + 0.4835427366197109, + 0.0, + 1.0835376381874084, + 0.07875818759202957, + 0.6076787821948528, + 0.23922330141067505, + 0.035008057951927185, + 0.18974456191062927, + 0.07958819717168808, + 0.06782155483961105, + 0.12256888300180435, + 1.0820152908563614, + 0.7415255606174469, + 0.17417146638035774, + 0.7501731105148792, + 0.0, + 0.7581196390092373, + 0.0, + 0.23003869131207466, + 0.44315986707806587, + 0.5411082375794649, + 0.179315485060215, + 0.06331083923578262, + 0.15796191431581974, + 1.1264904998242855, + 0.14937720447778702, + 0.3444249667227268, + 0.0, + 0.6380334980785847, + 0.6165092401206493, + 0.03794555366039276, + 0.19410736113786697, + 0.0, + 0.0, + 0.1643242910504341, + 0.13727805949747562, + 0.013498908840119839, + 1.6587750539183617, + 0.4551235642284155, + 0.12799754738807678, + 0.18817404936999083, + 0.10679151862859726, + 0.10039491578936577, + 0.7130396477878094, + 0.1888418272137642, + 0.07179810106754303, + 0.2084416262805462, + 0.0, + 0.0, + 0.0864868089556694, + 0.06602416932582855, + 0.18650725111365318 + ], + "unique_experts": 55, + "load_cv": 0.8827915878928169, + "normalized_load_entropy": 0.9044136193652742, + "max_load_share": 0.059027777777777776 + } + }, + "s1_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "404019208365cc1eb41a902c946a330ee78938c55df85b765edd1cc7df149ce0", + "route_weight_sha256": "a2a6d48b7c055f8913d25ea7b2d45ea5ee78d97f665ea86e1fdcb28bb6bf550b", + "loads": [ + 5, + 2, + 0, + 12, + 3, + 4, + 2, + 0, + 1, + 0, + 3, + 2, + 4, + 0, + 8, + 1, + 0, + 3, + 1, + 2, + 1, + 2, + 3, + 10, + 6, + 2, + 3, + 0, + 6, + 0, + 0, + 4, + 2, + 2, + 1, + 2, + 4, + 3, + 5, + 0, + 1, + 5, + 1, + 3, + 0, + 0, + 2, + 0, + 0, + 2, + 2, + 0, + 1, + 1, + 0, + 2, + 2, + 3, + 2, + 0, + 0, + 1, + 1, + 0 + ], + "weighted_loads": [ + 0.3576338589191437, + 0.11873631924390793, + 0.0, + 0.5731650106608868, + 0.21203439310193062, + 0.1555432714521885, + 0.10371428728103638, + 0.0, + 0.03497187793254852, + 0.0, + 0.6856461465358734, + 0.06726361438632011, + 0.19312305003404617, + 0.0, + 0.6801452301442623, + 0.038914527744054794, + 0.0, + 0.17112663760781288, + 0.035229526460170746, + 0.06754579208791256, + 0.050522442907094955, + 0.10338632389903069, + 0.11765113472938538, + 0.8491067811846733, + 0.57323057949543, + 0.1143379770219326, + 0.1383240781724453, + 0.0, + 0.5293038822710514, + 0.0, + 0.0, + 0.4562607556581497, + 0.13127990812063217, + 0.08910544216632843, + 0.06228367239236832, + 0.07166627421975136, + 0.3338933438062668, + 0.10961517319083214, + 0.2808605916798115, + 0.0, + 0.030807698145508766, + 0.6237729638814926, + 0.03836275637149811, + 0.15045437961816788, + 0.0, + 0.0, + 0.13247373327612877, + 0.0, + 0.0, + 0.10608724132180214, + 0.06871657073497772, + 0.0, + 0.03288719430565834, + 0.041897453367710114, + 0.0, + 0.07257293537259102, + 0.1531817950308323, + 0.103071428835392, + 0.16032583639025688, + 0.0, + 0.0, + 0.04022902995347977, + 0.06663037836551666, + 0.0 + ], + "unique_experts": 46, + "load_cv": 1.106680939165942, + "normalized_load_entropy": 0.8633453775707582, + "max_load_share": 0.08695652173913043 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "d32f078b0e6bf0304474369f8a95549e277e6aa99ede6c792209625ccadbc7b6", + "route_weight_sha256": "d5b00168231cd652b99f959732657260176badd9629248ffff15b40d72c321d5", + "loads": [ + 27, + 3, + 0, + 12, + 13, + 9, + 16, + 1, + 10, + 1, + 8, + 6, + 9, + 1, + 12, + 11, + 12, + 7, + 2, + 6, + 2, + 3, + 3, + 15, + 11, + 4, + 13, + 2, + 12, + 1, + 6, + 8, + 7, + 4, + 3, + 2, + 11, + 3, + 7, + 1, + 7, + 6, + 1, + 5, + 0, + 1, + 2, + 2, + 3, + 17, + 11, + 2, + 3, + 2, + 0, + 5, + 2, + 9, + 4, + 4, + 0, + 8, + 3, + 3 + ], + "weighted_loads": [ + 1.8591456953436136, + 0.14583703689277172, + 0.0, + 0.5731650106608868, + 0.6676446758210659, + 0.3979448601603508, + 1.1041152011603117, + 0.03110133297741413, + 0.5628994591534138, + 0.03111063875257969, + 0.9179688021540642, + 0.3999500088393688, + 0.6149482168257236, + 0.08261066675186157, + 0.8380532078444958, + 0.6957325823605061, + 1.0809293016791344, + 0.3287458121776581, + 0.08385193720459938, + 0.32422644831240177, + 0.07983118668198586, + 0.18379294499754906, + 0.11765113472938538, + 1.0997050255537033, + 0.7631408460438251, + 0.17487293854355812, + 0.8504280522465706, + 0.12212776765227318, + 0.9477774500846863, + 0.037235554307699203, + 0.22954066284000874, + 0.9023294597864151, + 0.5275140702724457, + 0.20278921723365784, + 0.2117835357785225, + 0.07166627421975136, + 1.0893198549747467, + 0.10961517319083214, + 0.34436269104480743, + 0.0356471873819828, + 0.6093534510582685, + 0.710611917078495, + 0.03836275637149811, + 0.42220595851540565, + 0.0, + 0.03768997639417648, + 0.13247373327612877, + 0.0788375474512577, + 0.14317345526069403, + 2.710203178226948, + 0.50190713070333, + 0.06944504752755165, + 0.08119252230972052, + 0.18867594748735428, + 0.0, + 0.787195447832346, + 0.1531817950308323, + 0.7599493116140366, + 0.2418004758656025, + 0.17367615923285484, + 0.0, + 0.40891632810235023, + 0.18137229979038239, + 0.14720360189676285 + ], + "unique_experts": 60, + "load_cv": 0.8604948511693076, + "normalized_load_entropy": 0.915010079976441, + "max_load_share": 0.0703125 + } + }, + "s0_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "c74d4d51d64e0e3aa2d8339fcff0f63b0d94ce587378bad8c75c644561e574b9", + "route_weight_sha256": "296b6021d2d941f0a2dd8b8e55954277ac20a3da26010826179ad665602001ed", + "loads": [ + 5, + 2, + 0, + 11, + 3, + 5, + 3, + 0, + 1, + 0, + 3, + 1, + 3, + 0, + 8, + 1, + 0, + 2, + 1, + 2, + 3, + 1, + 2, + 11, + 5, + 2, + 3, + 0, + 6, + 0, + 0, + 4, + 2, + 2, + 1, + 2, + 4, + 4, + 5, + 0, + 0, + 5, + 1, + 3, + 0, + 1, + 2, + 2, + 0, + 2, + 1, + 0, + 1, + 1, + 0, + 2, + 4, + 2, + 1, + 0, + 0, + 1, + 1, + 0 + ], + "weighted_loads": [ + 0.3329748474061489, + 0.1050579585134983, + 0.0, + 0.5465498268604279, + 0.18164965137839317, + 0.17462285980582237, + 0.13594723492860794, + 0.0, + 0.0386430025100708, + 0.0, + 0.6558350324630737, + 0.034565266221761703, + 0.14652585238218307, + 0.0, + 0.70161522179842, + 0.03737521544098854, + 0.0, + 0.13520356267690659, + 0.033332470804452896, + 0.09420082904398441, + 0.12272661924362183, + 0.06808865815401077, + 0.08217959105968475, + 0.7651899829506874, + 0.5604458339512348, + 0.11932581290602684, + 0.12592741660773754, + 0.0, + 0.5248825736343861, + 0.0, + 0.0, + 0.4324192348867655, + 0.13320454955101013, + 0.08069869875907898, + 0.06648235768079758, + 0.07731521129608154, + 0.34077541157603264, + 0.14659334160387516, + 0.28344525024294853, + 0.0, + 0.0, + 0.6383285038173199, + 0.04103882238268852, + 0.15026810392737389, + 0.0, + 0.032861437648534775, + 0.1332133524119854, + 0.06385778076946735, + 0.0, + 0.11064015328884125, + 0.03967854380607605, + 0.0, + 0.03325565159320831, + 0.04237343370914459, + 0.0, + 0.06926513835787773, + 0.21277380920946598, + 0.0698419064283371, + 0.12226097285747528, + 0.0, + 0.0, + 0.045605678111314774, + 0.06830841302871704, + 0.0 + ], + "unique_experts": 47, + "load_cv": 1.103640079043242, + "normalized_load_entropy": 0.8647665332532749, + "max_load_share": 0.07971014492753623 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "f3131cd0a3f25c906f1d92b01764e4817a9ce1944d5e775727a34750252ef239", + "route_weight_sha256": "bcc1c7bf06cfc25fa911818426779b2c2f9f44515acafc3a32db044646ba7dd9", + "loads": [ + 9, + 2, + 0, + 11, + 10, + 6, + 11, + 2, + 7, + 1, + 9, + 2, + 7, + 0, + 17, + 2, + 7, + 4, + 1, + 5, + 3, + 1, + 2, + 17, + 9, + 4, + 13, + 0, + 10, + 0, + 5, + 4, + 7, + 4, + 1, + 2, + 9, + 4, + 6, + 0, + 6, + 5, + 1, + 6, + 0, + 1, + 2, + 4, + 1, + 11, + 6, + 2, + 7, + 2, + 0, + 5, + 4, + 2, + 2, + 0, + 0, + 3, + 1, + 3 + ], + "weighted_loads": [ + 0.6198954880237579, + 0.1050579585134983, + 0.0, + 0.5465498268604279, + 0.553427193313837, + 0.19336383789777756, + 0.7716752514243126, + 0.06848639622330666, + 0.4602475371211767, + 0.031456805765628815, + 0.9151903446763754, + 0.06467215716838837, + 0.4727195166051388, + 0.0, + 1.0638440698385239, + 0.07728498429059982, + 0.6515203677117825, + 0.20943043753504753, + 0.033332470804452896, + 0.24518010206520557, + 0.12272661924362183, + 0.06808865815401077, + 0.08217959105968475, + 1.1460571847856045, + 0.6823868434876204, + 0.17956426739692688, + 0.8673652913421392, + 0.0, + 0.6714043393731117, + 0.0, + 0.21742378175258636, + 0.4324192348867655, + 0.5464557129889727, + 0.16892945021390915, + 0.06648235768079758, + 0.07731521129608154, + 1.0328190959990025, + 0.14659334160387516, + 0.3146047443151474, + 0.0, + 0.5247473046183586, + 0.6383285038173199, + 0.04103882238268852, + 0.3136061653494835, + 0.0, + 0.032861437648534775, + 0.1332133524119854, + 0.14738635905086994, + 0.013498908840119839, + 1.5315598249435425, + 0.3571970760822296, + 0.08458566665649414, + 0.2236473774537444, + 0.07803093269467354, + 0.0, + 0.7638312317430973, + 0.21277380920946598, + 0.0698419064283371, + 0.17320626229047775, + 0.0, + 0.0, + 0.1603483259677887, + 0.06830841302871704, + 0.12915170565247536 + ], + "unique_experts": 55, + "load_cv": 0.9018157267082181, + "normalized_load_entropy": 0.9008288891287329, + "max_load_share": 0.059027777777777776 + } + }, + "s1_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "5f607aa7049349236da317bb21a4cbc96e2811337603a07b8eb0957960e16cc7", + "route_weight_sha256": "35e4353c2ad39738ae652f7db475ca71cba8cd50857ae518523d3171cb7c6540", + "loads": [ + 5, + 2, + 0, + 11, + 4, + 4, + 2, + 0, + 1, + 0, + 3, + 1, + 3, + 0, + 8, + 1, + 0, + 4, + 1, + 2, + 3, + 2, + 1, + 10, + 5, + 2, + 3, + 0, + 6, + 0, + 0, + 4, + 2, + 3, + 1, + 1, + 4, + 3, + 5, + 1, + 0, + 5, + 1, + 3, + 0, + 1, + 2, + 2, + 0, + 2, + 2, + 0, + 0, + 1, + 0, + 2, + 2, + 3, + 2, + 0, + 0, + 1, + 1, + 0 + ], + "weighted_loads": [ + 0.3136426955461502, + 0.11444151028990746, + 0.0, + 0.53272988460958, + 0.20368047803640366, + 0.15383341908454895, + 0.10551471263170242, + 0.0, + 0.04035235941410065, + 0.0, + 0.6490296199917793, + 0.035593047738075256, + 0.1586199626326561, + 0.0, + 0.6847958527505398, + 0.03640296682715416, + 0.0, + 0.20082511007785797, + 0.036098383367061615, + 0.08634861186146736, + 0.12788337841629982, + 0.10714780539274216, + 0.04829930514097214, + 0.7499111965298653, + 0.5448822043836117, + 0.1144377626478672, + 0.14374472945928574, + 0.0, + 0.5206509567797184, + 0.0, + 0.0, + 0.44913284108042717, + 0.13364485278725624, + 0.11381825804710388, + 0.06744285672903061, + 0.04413097724318504, + 0.3173794783651829, + 0.10418892651796341, + 0.26523755863308907, + 0.0298281442373991, + 0.0, + 0.6460971981287003, + 0.0458185039460659, + 0.1497795656323433, + 0.0, + 0.031216731294989586, + 0.14279509335756302, + 0.06055774353444576, + 0.0, + 0.10327212139964104, + 0.07187462411820889, + 0.0, + 0.0, + 0.042043741792440414, + 0.0, + 0.07007098942995071, + 0.15346508473157883, + 0.10822099819779396, + 0.17111898586153984, + 0.0, + 0.0, + 0.046431683003902435, + 0.06900593638420105, + 0.0 + ], + "unique_experts": 47, + "load_cv": 1.069620202035075, + "normalized_load_entropy": 0.8692221127561854, + "max_load_share": 0.07971014492753623 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "365da11de162fefb3589c69d6490092b7c98ae86f006f19b550a73b9d574d16a", + "route_weight_sha256": "7b080bc46455f2971c55ca737d3df1ec39d4077ef521c0bb255510e2e39113d0", + "loads": [ + 27, + 3, + 0, + 11, + 11, + 8, + 16, + 1, + 12, + 1, + 9, + 5, + 8, + 1, + 12, + 12, + 12, + 8, + 2, + 7, + 4, + 3, + 1, + 16, + 8, + 4, + 14, + 2, + 12, + 2, + 6, + 8, + 8, + 5, + 3, + 1, + 10, + 3, + 7, + 2, + 4, + 6, + 1, + 6, + 0, + 2, + 2, + 4, + 3, + 16, + 9, + 3, + 2, + 2, + 0, + 5, + 2, + 9, + 4, + 4, + 0, + 9, + 3, + 3 + ], + "weighted_loads": [ + 1.7827499080449343, + 0.14154222793877125, + 0.0, + 0.53272988460958, + 0.5650623068213463, + 0.3342329300940037, + 1.2336375508457422, + 0.03110133297741413, + 0.7245156094431877, + 0.03111063875257969, + 0.9351568520069122, + 0.36827944219112396, + 0.6012093462049961, + 0.08261066675186157, + 0.8427038304507732, + 0.7269165515899658, + 1.1007261760532856, + 0.35844428464770317, + 0.08472079411149025, + 0.3952363692224026, + 0.15719212219119072, + 0.18755442649126053, + 0.04829930514097214, + 1.076975405216217, + 0.6338490657508373, + 0.1747593805193901, + 0.97710245475173, + 0.12212776765227318, + 0.9391245245933533, + 0.06644106097519398, + 0.22954066284000874, + 0.8952015452086926, + 0.5733361877501011, + 0.2275020331144333, + 0.21694272011518478, + 0.04413097724318504, + 0.9490788578987122, + 0.10418892651796341, + 0.328739657998085, + 0.0654753316193819, + 0.4264019802212715, + 0.7329361513257027, + 0.0458185039460659, + 0.5481746084988117, + 0.0, + 0.06890670768916607, + 0.14279509335756302, + 0.13587761111557484, + 0.14317345526069403, + 2.1688510552048683, + 0.36347208358347416, + 0.10416587069630623, + 0.048305328004062176, + 0.18882223591208458, + 0.0, + 0.7504309974610806, + 0.15346508473157883, + 0.7650988809764385, + 0.25259362533688545, + 0.17367615923285484, + 0.0, + 0.465548861771822, + 0.18374785780906677, + 0.11243212595582008 + ], + "unique_experts": 60, + "load_cv": 0.8462540004829125, + "normalized_load_entropy": 0.9182719300317759, + "max_load_share": 0.0703125 + } + }, + "s0_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "919b33ca9d368c7e83936df909771926e672feebce8365951d13bea780eefd5f", + "route_weight_sha256": "8eab87aa90ee93a177b5efdb3c0db670cdff2bbf140938030d0049a331d513fb", + "loads": [ + 4, + 1, + 0, + 9, + 2, + 4, + 2, + 0, + 1, + 0, + 3, + 1, + 3, + 0, + 8, + 1, + 0, + 4, + 1, + 2, + 3, + 1, + 3, + 11, + 5, + 2, + 3, + 0, + 7, + 0, + 0, + 4, + 2, + 3, + 1, + 2, + 5, + 4, + 5, + 0, + 1, + 5, + 1, + 3, + 0, + 0, + 3, + 2, + 0, + 2, + 1, + 0, + 1, + 1, + 0, + 2, + 3, + 2, + 2, + 0, + 0, + 1, + 1, + 0 + ], + "weighted_loads": [ + 0.311884555965662, + 0.07717451453208923, + 0.0, + 0.47029547579586506, + 0.14602796360850334, + 0.14524585753679276, + 0.10512882843613625, + 0.0, + 0.035447049885988235, + 0.0, + 0.6486157514154911, + 0.03656725585460663, + 0.1520702950656414, + 0.0, + 0.6862569078803062, + 0.039400506764650345, + 0.0, + 0.1969809252768755, + 0.035024479031562805, + 0.09252096898853779, + 0.12531716749072075, + 0.069378562271595, + 0.11496822535991669, + 0.778920678421855, + 0.5600651502609253, + 0.12005790695548058, + 0.1349554043263197, + 0.0, + 0.5690496601164341, + 0.0, + 0.0, + 0.4205217659473419, + 0.12882613018155098, + 0.11664160341024399, + 0.06775416433811188, + 0.07718966528773308, + 0.36511422879993916, + 0.15112949907779694, + 0.29295650497078896, + 0.0, + 0.031240377575159073, + 0.6429084837436676, + 0.039591673761606216, + 0.14819547906517982, + 0.0, + 0.0, + 0.1700826734304428, + 0.06471895426511765, + 0.0, + 0.10022923722863197, + 0.04070613160729408, + 0.0, + 0.032035019248723984, + 0.04295798018574715, + 0.0, + 0.06789066269993782, + 0.18352485820651054, + 0.07458854466676712, + 0.15900921449065208, + 0.0, + 0.0, + 0.04238864779472351, + 0.06784447282552719, + 0.0 + ], + "unique_experts": 47, + "load_cv": 1.06331783701595, + "normalized_load_entropy": 0.8689725463113221, + "max_load_share": 0.07971014492753623 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "026a1e51c702155cf297523375872e074491370b7524a4b73697256be479a643", + "route_weight_sha256": "33d6ea41d42a9a506aa3aec11976196bd382fa093264dd3cac5b6a89d4ac529a", + "loads": [ + 8, + 1, + 0, + 9, + 8, + 5, + 11, + 2, + 7, + 1, + 8, + 3, + 7, + 0, + 17, + 2, + 7, + 6, + 1, + 4, + 3, + 1, + 3, + 17, + 9, + 4, + 13, + 0, + 11, + 0, + 5, + 4, + 7, + 5, + 1, + 2, + 11, + 4, + 7, + 0, + 7, + 6, + 1, + 5, + 0, + 0, + 3, + 4, + 1, + 11, + 6, + 2, + 6, + 1, + 0, + 5, + 3, + 2, + 4, + 0, + 0, + 3, + 1, + 3 + ], + "weighted_loads": [ + 0.6088514551520348, + 0.07717451453208923, + 0.0, + 0.47029547579586506, + 0.525745403021574, + 0.16398683562874794, + 0.7376565597951412, + 0.06848639622330666, + 0.45463059656322, + 0.031456805765628815, + 0.8415800277143717, + 0.10108654946088791, + 0.45014578104019165, + 0.0, + 1.0484857559204102, + 0.07931027561426163, + 0.6528845950961113, + 0.27120780013501644, + 0.035024479031562805, + 0.19374962337315083, + 0.12531716749072075, + 0.069378562271595, + 0.11496822535991669, + 1.1377032864838839, + 0.692873353138566, + 0.1813846193253994, + 0.802842503413558, + 0.0, + 0.7155714258551598, + 0.0, + 0.2197534292936325, + 0.4205217659473419, + 0.5420772936195135, + 0.20487235486507416, + 0.06775416433811188, + 0.07718966528773308, + 1.1390616614371538, + 0.15112949907779694, + 0.36791466549038887, + 0.0, + 0.6728454120457172, + 0.6840021200478077, + 0.039591673761606216, + 0.2329251393675804, + 0.0, + 0.0, + 0.1700826734304428, + 0.14447662234306335, + 0.013498908840119839, + 1.4686659537255764, + 0.36267518252134323, + 0.08458566665649414, + 0.18471731524914503, + 0.04295798018574715, + 0.0, + 0.7757895775139332, + 0.18352485820651054, + 0.07458854466676712, + 0.2627057917416096, + 0.0, + 0.0, + 0.2455272115767002, + 0.06784447282552719, + 0.12915170565247536 + ], + "unique_experts": 54, + "load_cv": 0.8958064164776166, + "normalized_load_entropy": 0.9000606971064712, + "max_load_share": 0.059027777777777776 + } + }, + "s1_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "9d2586263d66b825a34d5416afe9da2e22384c81064b4b592c45f2e198dd5495", + "route_weight_sha256": "18fee440ebb705d424499456f13d9f3366a7ec4482fce990f589720473c76fbe", + "loads": [ + 4, + 2, + 0, + 10, + 3, + 4, + 3, + 0, + 1, + 0, + 3, + 1, + 4, + 0, + 8, + 1, + 0, + 4, + 1, + 2, + 3, + 2, + 1, + 11, + 5, + 2, + 3, + 0, + 7, + 0, + 0, + 4, + 2, + 3, + 1, + 2, + 4, + 3, + 5, + 1, + 0, + 5, + 1, + 3, + 0, + 1, + 2, + 0, + 0, + 2, + 2, + 0, + 0, + 1, + 0, + 2, + 2, + 3, + 2, + 0, + 0, + 1, + 1, + 0 + ], + "weighted_loads": [ + 0.30151743814349174, + 0.1098984070122242, + 0.0, + 0.49658089503645897, + 0.18603987246751785, + 0.14997561275959015, + 0.14965128153562546, + 0.0, + 0.03642932325601578, + 0.0, + 0.6923687793314457, + 0.03541028872132301, + 0.18715597689151764, + 0.0, + 0.6616763733327389, + 0.03710715472698212, + 0.0, + 0.20049455761909485, + 0.03684503212571144, + 0.12094437330961227, + 0.12990088015794754, + 0.10873875394463539, + 0.047478750348091125, + 0.7891394533216953, + 0.5415013022720814, + 0.11449522525072098, + 0.13826599717140198, + 0.0, + 0.5572448037564754, + 0.0, + 0.0, + 0.4457807205617428, + 0.13798187300562859, + 0.1201368048787117, + 0.06590536236763, + 0.0719889048486948, + 0.3074685372412205, + 0.10299266874790192, + 0.2562352195382118, + 0.02914850413799286, + 0.0, + 0.6444109044969082, + 0.05201290547847748, + 0.151483666151762, + 0.0, + 0.031646471470594406, + 0.13933712616562843, + 0.0, + 0.0, + 0.09787815436720848, + 0.07229484245181084, + 0.0, + 0.0, + 0.043210469186306, + 0.0, + 0.07020118832588196, + 0.14997528493404388, + 0.1131657175719738, + 0.1572020873427391, + 0.0, + 0.0, + 0.05041913315653801, + 0.06906852126121521, + 0.0 + ], + "unique_experts": 46, + "load_cv": 1.0821148205121796, + "normalized_load_entropy": 0.8652523585559404, + "max_load_share": 0.07971014492753623 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "93f2c4213e37f6dcfae9334eb7c56cba00076cc4df1425780869b1df40c96b70", + "route_weight_sha256": "dbb169e040c4f8e2492634e594aa7283b3e9c8a6cd883499aa6213172662f2e1", + "loads": [ + 26, + 3, + 0, + 10, + 10, + 7, + 17, + 1, + 12, + 1, + 8, + 6, + 9, + 1, + 12, + 12, + 12, + 8, + 2, + 6, + 4, + 3, + 1, + 17, + 8, + 4, + 14, + 2, + 13, + 2, + 6, + 8, + 7, + 6, + 3, + 2, + 10, + 3, + 8, + 2, + 5, + 6, + 1, + 6, + 0, + 2, + 2, + 2, + 3, + 15, + 10, + 2, + 2, + 2, + 0, + 5, + 2, + 9, + 5, + 4, + 0, + 10, + 3, + 2 + ], + "weighted_loads": [ + 1.7397394385188818, + 0.136999124661088, + 0.0, + 0.49658089503645897, + 0.5789817720651627, + 0.3019256852567196, + 1.31544110737741, + 0.03110133297741413, + 0.7038024812936783, + 0.03111063875257969, + 0.9246914349496365, + 0.3971396032720804, + 0.6062348783016205, + 0.08261066675186157, + 0.8195843510329723, + 0.7305189296603203, + 1.0781929418444633, + 0.35811373218894005, + 0.08546744287014008, + 0.3776250295341015, + 0.15920962393283844, + 0.18914537504315376, + 0.047478750348091125, + 1.070254947990179, + 0.630468163639307, + 0.17296121641993523, + 0.8954720385372639, + 0.12212776765227318, + 0.9757183715701103, + 0.07092466577887535, + 0.22954066284000874, + 0.8918494246900082, + 0.5342160351574421, + 0.26650068908929825, + 0.21540522575378418, + 0.0719889048486948, + 1.071204774081707, + 0.10299266874790192, + 0.37227964401245117, + 0.06479569151997566, + 0.551778994500637, + 0.7312498576939106, + 0.05201290547847748, + 0.4717082642018795, + 0.0, + 0.06933644786477089, + 0.13933712616562843, + 0.07029377669095993, + 0.14317345526069403, + 2.105179365724325, + 0.44296281412243843, + 0.06944504752755165, + 0.048305328004062176, + 0.18998896330595016, + 0.0, + 0.7611140161752701, + 0.14997528493404388, + 0.7700436003506184, + 0.29813671112060547, + 0.17367615923285484, + 0.0, + 0.6188301146030426, + 0.18381044268608093, + 0.08738528937101364 + ], + "unique_experts": 60, + "load_cv": 0.8452276156291997, + "normalized_load_entropy": 0.917741001149293, + "max_load_share": 0.06770833333333333 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 12, + "mean_set_jaccard": 0.8633540372670809, + "mean_token_weighted_tv": 0.02339185349157323, + "aggregate_load_tv": 0.07246376811594202 + }, + "system_bos": { + "tokens": 23, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.8913043478260869, + "mean_token_weighted_tv": 0.0240630971915696, + "aggregate_load_tv": 0.05797101449275362 + }, + "system_x": { + "tokens": 23, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 11, + "mean_set_jaccard": 0.8416149068322983, + "mean_token_weighted_tv": 0.030051492761982525, + "aggregate_load_tv": 0.06521739130434782 + }, + "system_period": { + "tokens": 23, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 13, + "mean_set_jaccard": 0.8664596273291927, + "mean_token_weighted_tv": 0.030183494860387367, + "aggregate_load_tv": 0.07246376811594202 + }, + "bos_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 7, + "set_exact_tokens": 10, + "mean_set_jaccard": 0.8385093167701865, + "mean_token_weighted_tv": 0.031123572596065376, + "aggregate_load_tv": 0.07246376811594203 + }, + "bos_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 6, + "set_exact_tokens": 9, + "mean_set_jaccard": 0.8167701863354039, + "mean_token_weighted_tv": 0.0336106752814806, + "aggregate_load_tv": 0.10869565217391305 + }, + "x_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 5, + "set_exact_tokens": 10, + "mean_set_jaccard": 0.829192546583851, + "mean_token_weighted_tv": 0.03353643619819828, + "aggregate_load_tv": 0.08695652173913043 + }, + "x_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 12, + "mean_set_jaccard": 0.8540372670807453, + "mean_token_weighted_tv": 0.032428806971596634, + "aggregate_load_tv": 0.08695652173913043 + }, + "period_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 7, + "set_exact_tokens": 9, + "mean_set_jaccard": 0.8260869565217391, + "mean_token_weighted_tv": 0.03418346769783808, + "aggregate_load_tv": 0.08695652173913043 + }, + "period_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 8, + "set_exact_tokens": 10, + "mean_set_jaccard": 0.829192546583851, + "mean_token_weighted_tv": 0.0379046412265819, + "aggregate_load_tv": 0.09420289855072464 + } + } + }, + "layer_16": { + "layer": 16, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "cb6ea6353d92608f93888039ffa0e1bce65a5d59ffd4c91609e480f88bdd075e", + "route_weight_sha256": "227d7dd8029d99db8290368d3bee2c9011944559308f7cce97a91fc510261f4b", + "loads": [ + 0, + 1, + 0, + 5, + 4, + 2, + 0, + 0, + 3, + 4, + 0, + 4, + 6, + 11, + 4, + 5, + 0, + 3, + 0, + 5, + 0, + 2, + 0, + 1, + 1, + 2, + 3, + 2, + 3, + 2, + 2, + 3, + 3, + 5, + 0, + 1, + 1, + 1, + 3, + 1, + 1, + 4, + 0, + 1, + 3, + 4, + 1, + 0, + 0, + 5, + 0, + 1, + 0, + 1, + 1, + 0, + 0, + 2, + 2, + 3, + 1, + 12, + 0, + 3 + ], + "weighted_loads": [ + 0.0, + 0.03766258805990219, + 0.0, + 0.40330613404512405, + 0.21015819534659386, + 0.10247212648391724, + 0.0, + 0.0, + 0.4407905340194702, + 0.42868132144212723, + 0.0, + 0.15488366782665253, + 0.41481344401836395, + 0.8777722287923098, + 0.22660353779792786, + 0.521297637373209, + 0.0, + 0.22942357882857323, + 0.0, + 0.3473703861236572, + 0.0, + 0.1959010362625122, + 0.0, + 0.11024076491594315, + 0.04183834046125412, + 0.08897605910897255, + 0.4098949767649174, + 0.055962901562452316, + 0.1598387137055397, + 0.07419433072209358, + 0.06349659524857998, + 0.09753816574811935, + 0.16185595840215683, + 0.22091925144195557, + 0.0, + 0.0305403470993042, + 0.0342300646007061, + 0.04137515276670456, + 0.11051110550761223, + 0.054740484803915024, + 0.04205675050616264, + 0.20107218623161316, + 0.0, + 0.04715830087661743, + 0.2486775480210781, + 0.1799912042915821, + 0.042693592607975006, + 0.0, + 0.0, + 0.4598597250878811, + 0.0, + 0.0452626496553421, + 0.0, + 0.030127331614494324, + 0.026384742930531502, + 0.0, + 0.0, + 0.07495316863059998, + 0.09331944957375526, + 0.6308488063514233, + 0.06498123705387115, + 1.0188938304781914, + 0.0, + 0.12448510527610779 + ], + "unique_experts": 46, + "load_cv": 1.100590817255866, + "normalized_load_entropy": 0.8632804647627749, + "max_load_share": 0.08695652173913043 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "a2cde5afe385d8c85adf62b992672335d4b25aec0aba80f90db29315e0dfc5fc", + "route_weight_sha256": "7a8cc94843d3b2cd3e60b59ea0abd900123cdf69a0487579457c73104b7d5661", + "loads": [ + 0, + 1, + 0, + 5, + 4, + 12, + 4, + 0, + 3, + 8, + 4, + 4, + 6, + 12, + 4, + 13, + 9, + 7, + 5, + 6, + 11, + 4, + 2, + 1, + 9, + 2, + 7, + 2, + 3, + 2, + 4, + 3, + 5, + 12, + 0, + 1, + 1, + 11, + 3, + 1, + 3, + 12, + 0, + 2, + 6, + 5, + 1, + 0, + 0, + 6, + 0, + 3, + 0, + 12, + 1, + 10, + 0, + 2, + 2, + 3, + 4, + 16, + 0, + 9 + ], + "weighted_loads": [ + 0.0, + 0.03766258805990219, + 0.0, + 0.40330613404512405, + 0.21015819534659386, + 1.0045502465218306, + 0.16769300028681755, + 0.0, + 0.4407905340194702, + 1.8542900271713734, + 0.20823088102042675, + 0.15488366782665253, + 0.41481344401836395, + 0.896994486451149, + 0.22660353779792786, + 1.4015429839491844, + 0.5529935853555799, + 0.46789468824863434, + 0.5731786731630564, + 0.34983894415199757, + 0.959203964099288, + 0.27766964584589005, + 0.13674823567271233, + 0.11024076491594315, + 0.7195516265928745, + 0.08897605910897255, + 0.6482857819646597, + 0.055962901562452316, + 0.1598387137055397, + 0.07419433072209358, + 0.18574588187038898, + 0.09753816574811935, + 0.2298099659383297, + 0.5295166866853833, + 0.0, + 0.0305403470993042, + 0.0342300646007061, + 0.5477170739322901, + 0.11051110550761223, + 0.054740484803915024, + 0.17295286804437637, + 1.72381392121315, + 0.0, + 0.07461999356746674, + 0.3570956401526928, + 0.24698084965348244, + 0.042693592607975006, + 0.0, + 0.0, + 0.4771892447024584, + 0.0, + 0.15123846754431725, + 0.0, + 0.7983601298183203, + 0.026384742930531502, + 0.7780040018260479, + 0.0, + 0.07495316863059998, + 0.09331944957375526, + 0.6308488063514233, + 0.26554668694734573, + 1.1961087044328451, + 0.0, + 0.5688266847282648 + ], + "unique_experts": 53, + "load_cv": 0.9069348731841393, + "normalized_load_entropy": 0.8956917471640279, + "max_load_share": 0.05555555555555555 + } + }, + "s1_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "818695c74ad1f19f0f2708913b07bea487a0f30482016c38680a613df5872310", + "route_weight_sha256": "961a5e45ddd77d21c569312bdc1c84cafc6bf79aac34cbd64bc79e5b9d4e7638", + "loads": [ + 0, + 2, + 0, + 5, + 3, + 2, + 0, + 0, + 3, + 4, + 0, + 4, + 6, + 10, + 4, + 5, + 0, + 3, + 0, + 5, + 0, + 2, + 0, + 1, + 2, + 2, + 3, + 2, + 3, + 2, + 4, + 2, + 3, + 5, + 0, + 1, + 1, + 1, + 4, + 1, + 1, + 2, + 0, + 2, + 3, + 4, + 1, + 0, + 0, + 5, + 0, + 1, + 0, + 0, + 1, + 0, + 0, + 2, + 2, + 3, + 1, + 12, + 0, + 3 + ], + "weighted_loads": [ + 0.0, + 0.07479970157146454, + 0.0, + 0.3978380113840103, + 0.17321375012397766, + 0.12231002748012543, + 0.0, + 0.0, + 0.4439338371157646, + 0.4175887554883957, + 0.0, + 0.14973149448633194, + 0.4104384183883667, + 0.8290915172547102, + 0.2193460837006569, + 0.5069713369011879, + 0.0, + 0.23661627620458603, + 0.0, + 0.3354390598833561, + 0.0, + 0.1792972832918167, + 0.0, + 0.11322932690382004, + 0.07458791509270668, + 0.09440264478325844, + 0.4279248137027025, + 0.07039830461144447, + 0.1598389334976673, + 0.0733366534113884, + 0.1281744260340929, + 0.06816978938877583, + 0.17358671128749847, + 0.21578548662364483, + 0.0, + 0.031709037721157074, + 0.035779595375061035, + 0.03955341875553131, + 0.14010417461395264, + 0.055528610944747925, + 0.04366325959563255, + 0.1346874162554741, + 0.0, + 0.06808969937264919, + 0.2514159455895424, + 0.18978777900338173, + 0.04025375843048096, + 0.0, + 0.0, + 0.4549328126013279, + 0.0, + 0.04551580175757408, + 0.0, + 0.0, + 0.02602340839803219, + 0.0, + 0.0, + 0.0770661011338234, + 0.09041935205459595, + 0.6361509710550308, + 0.06896976381540298, + 0.9871573187410831, + 0.0, + 0.12780059315264225 + ], + "unique_experts": 45, + "load_cv": 1.072757499924467, + "normalized_load_entropy": 0.8651999748573401, + "max_load_share": 0.08695652173913043 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "47702335cabae538a7a8b1de5c46ff7e4bcfd80db69598fa5a43d262cc0a073e", + "route_weight_sha256": "2b041f83b443c195264bcf701a613c0ae720442b5cd61fa522e81c77a4ae06a7", + "loads": [ + 0, + 5, + 0, + 7, + 3, + 11, + 5, + 1, + 3, + 9, + 6, + 6, + 6, + 14, + 5, + 17, + 11, + 13, + 8, + 7, + 11, + 4, + 3, + 2, + 17, + 2, + 12, + 2, + 3, + 2, + 8, + 2, + 9, + 10, + 1, + 3, + 1, + 10, + 6, + 4, + 5, + 17, + 1, + 5, + 6, + 8, + 2, + 6, + 2, + 9, + 6, + 1, + 0, + 12, + 1, + 11, + 2, + 2, + 2, + 5, + 5, + 14, + 3, + 10 + ], + "weighted_loads": [ + 0.0, + 0.19544941559433937, + 0.0, + 0.4892450198531151, + 0.17321375012397766, + 1.0143959634006023, + 0.2452184036374092, + 0.02629050612449646, + 0.4439338371157646, + 1.8449045568704605, + 0.21233714744448662, + 0.21133250184357166, + 0.4104384183883667, + 0.9526982773095369, + 0.26783010736107826, + 1.9132115170359612, + 0.4977888227440417, + 0.9266639873385429, + 0.7966361287981272, + 0.3733733119443059, + 0.9227277394384146, + 0.2717774584889412, + 0.11715009063482285, + 0.1891808733344078, + 1.2456810101866722, + 0.09440264478325844, + 1.553562294691801, + 0.07039830461144447, + 0.1598389334976673, + 0.0733366534113884, + 0.3319721966981888, + 0.06816978938877583, + 0.41744525730609894, + 0.41979090636596084, + 0.03571491688489914, + 0.148224376142025, + 0.035779595375061035, + 0.5208255685865879, + 0.2639109492301941, + 0.23200644925236702, + 0.2429851945489645, + 2.704794030636549, + 0.03737671673297882, + 0.19341941364109516, + 0.33841003105044365, + 0.38947315886616707, + 0.07091974280774593, + 0.29586566612124443, + 0.09169211611151695, + 0.6301775630563498, + 0.2599184811115265, + 0.04551580175757408, + 0.0, + 1.0741284787654877, + 0.02602340839803219, + 0.9656488336622715, + 0.10724272951483727, + 0.0770661011338234, + 0.09041935205459595, + 0.8584517855197191, + 0.25713663920760155, + 1.1065331598510966, + 0.32943442463874817, + 0.5727153923362494 + ], + "unique_experts": 61, + "load_cv": 0.7476816018719318, + "normalized_load_entropy": 0.9306793532220765, + "max_load_share": 0.044270833333333336 + } + }, + "s0_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "fcdfe7aadf8c083075cff1bbffcc87a091c7f29db86a3516d82aab70334eb808", + "route_weight_sha256": "e957218b337657375144fcdae56e23b0bb77f7e1079654ba1dd7e380be65e741", + "loads": [ + 0, + 2, + 0, + 5, + 4, + 2, + 0, + 0, + 3, + 4, + 0, + 4, + 6, + 10, + 3, + 5, + 0, + 3, + 0, + 5, + 0, + 2, + 0, + 2, + 3, + 3, + 3, + 3, + 3, + 2, + 3, + 2, + 3, + 5, + 0, + 1, + 1, + 1, + 2, + 1, + 1, + 3, + 0, + 2, + 3, + 4, + 1, + 0, + 0, + 5, + 0, + 1, + 0, + 0, + 1, + 0, + 0, + 2, + 2, + 3, + 1, + 11, + 0, + 2 + ], + "weighted_loads": [ + 0.0, + 0.07298390939831734, + 0.0, + 0.41017919033765793, + 0.21823422610759735, + 0.1319482997059822, + 0.0, + 0.0, + 0.43940356373786926, + 0.45801789313554764, + 0.0, + 0.14747308753430843, + 0.43659481406211853, + 0.8450557086616755, + 0.16231171414256096, + 0.5175360962748528, + 0.0, + 0.23675072565674782, + 0.0, + 0.323454137891531, + 0.0, + 0.1926599144935608, + 0.0, + 0.13577647134661674, + 0.11615960858762264, + 0.13539817929267883, + 0.42833458818495274, + 0.09473203867673874, + 0.16238721832633018, + 0.06942775100469589, + 0.0983828604221344, + 0.06942149810492992, + 0.16736356168985367, + 0.21775470301508904, + 0.0, + 0.028579914942383766, + 0.029385138303041458, + 0.040023624897003174, + 0.07753444090485573, + 0.0530056469142437, + 0.039709363132715225, + 0.15377555415034294, + 0.0, + 0.06557990796864033, + 0.2685694471001625, + 0.18114647641777992, + 0.04430186748504639, + 0.0, + 0.0, + 0.4553771987557411, + 0.0, + 0.041454389691352844, + 0.0, + 0.0, + 0.03224801644682884, + 0.0, + 0.0, + 0.07236658409237862, + 0.08906248956918716, + 0.6659750267863274, + 0.06986315548419952, + 1.0142754577100277, + 0.0, + 0.09856754541397095 + ], + "unique_experts": 45, + "load_cv": 1.0344821550575607, + "normalized_load_entropy": 0.8699659799237528, + "max_load_share": 0.07971014492753623 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "09bd0858dd21647cf54c01e3e5c4c5d0bb449b95eafe7fcc1f27094180e32053", + "route_weight_sha256": "1775a935417ab180ab1e79fbbdb53d50cce0d2c97e5134995af2ac3088157a7a", + "loads": [ + 0, + 2, + 1, + 5, + 4, + 13, + 4, + 0, + 3, + 8, + 5, + 4, + 8, + 12, + 3, + 13, + 9, + 7, + 5, + 6, + 11, + 4, + 2, + 2, + 10, + 3, + 6, + 3, + 3, + 2, + 5, + 2, + 4, + 9, + 1, + 1, + 1, + 10, + 2, + 1, + 3, + 12, + 0, + 2, + 7, + 5, + 1, + 0, + 0, + 7, + 1, + 3, + 0, + 11, + 1, + 10, + 0, + 2, + 2, + 3, + 3, + 14, + 0, + 7 + ], + "weighted_loads": [ + 0.0, + 0.07298390939831734, + 0.0388740673661232, + 0.41017919033765793, + 0.21823422610759735, + 1.0816056225448847, + 0.16769300028681755, + 0.0, + 0.43940356373786926, + 0.9484872110188007, + 0.2363714650273323, + 0.14747308753430843, + 0.5482750721275806, + 0.9041697829961777, + 0.16231171414256096, + 1.3355067521333694, + 0.9432954601943493, + 0.48403623327612877, + 0.5069803167134523, + 0.35682786628603935, + 0.959203964099288, + 0.27442852407693863, + 0.13674823567271233, + 0.13577647134661674, + 0.7384897451847792, + 0.13539817929267883, + 0.5958821885287762, + 0.09473203867673874, + 0.16238721832633018, + 0.06942775100469589, + 0.21079354733228683, + 0.06942149810492992, + 0.20758995041251183, + 0.4569108206778765, + 0.10386153310537338, + 0.028579914942383766, + 0.029385138303041458, + 0.5210035368800163, + 0.07753444090485573, + 0.0530056469142437, + 0.17291449755430222, + 1.690426291897893, + 0.0, + 0.06557990796864033, + 0.4087216891348362, + 0.24813612177968025, + 0.04430186748504639, + 0.0, + 0.0, + 0.5188556108623743, + 0.04408080875873566, + 0.147430207580328, + 0.0, + 0.768232798203826, + 0.03224801644682884, + 0.7780040018260479, + 0.0, + 0.07236658409237862, + 0.08906248956918716, + 0.6659750267863274, + 0.19773530960083008, + 1.2345005236566067, + 0.0, + 0.49327752739191055 + ], + "unique_experts": 56, + "load_cv": 0.8588680463189059, + "normalized_load_entropy": 0.9074613614682167, + "max_load_share": 0.04861111111111111 + } + }, + "s1_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "361e62044a875db20563a102402e83ef93b4161f26dea0c00b2c86645c5eef53", + "route_weight_sha256": "af35d6e5788bd78c11a2cb4c9618cba6d33f6160515c8d4f4cfb64b850005e5f", + "loads": [ + 1, + 1, + 0, + 5, + 4, + 2, + 0, + 0, + 3, + 4, + 0, + 4, + 6, + 10, + 4, + 5, + 0, + 3, + 0, + 5, + 1, + 2, + 0, + 2, + 3, + 2, + 3, + 1, + 3, + 2, + 2, + 2, + 3, + 5, + 0, + 1, + 1, + 1, + 2, + 1, + 1, + 4, + 0, + 2, + 3, + 4, + 1, + 0, + 0, + 5, + 0, + 1, + 0, + 0, + 1, + 0, + 0, + 2, + 2, + 3, + 1, + 11, + 0, + 3 + ], + "weighted_loads": [ + 0.02319788932800293, + 0.04026148095726967, + 0.0, + 0.41957875341176987, + 0.21190913021564484, + 0.13557405769824982, + 0.0, + 0.0, + 0.4477298781275749, + 0.4688119515776634, + 0.0, + 0.14889028295874596, + 0.42247768864035606, + 0.8813027553260326, + 0.2085215523838997, + 0.4593472555279732, + 0.0, + 0.2284095697104931, + 0.0, + 0.341012928634882, + 0.03163584694266319, + 0.18842849135398865, + 0.0, + 0.1379447616636753, + 0.1157362312078476, + 0.08970523998141289, + 0.4300733655691147, + 0.03257685527205467, + 0.1637943647801876, + 0.07141906023025513, + 0.061079246923327446, + 0.07060789316892624, + 0.1778433658182621, + 0.2164738941937685, + 0.0, + 0.030968010425567627, + 0.036645807325839996, + 0.03977363929152489, + 0.08112389966845512, + 0.05294841527938843, + 0.04469062387943268, + 0.19097302109003067, + 0.0, + 0.06940563023090363, + 0.27681703120470047, + 0.19456584006547928, + 0.04649427533149719, + 0.0, + 0.0, + 0.4652138352394104, + 0.0, + 0.0437936931848526, + 0.0, + 0.0, + 0.03247814252972603, + 0.0, + 0.0, + 0.07455739006400108, + 0.1041613221168518, + 0.6699486933648586, + 0.06592962145805359, + 0.947642719373107, + 0.0, + 0.12466331385076046 + ], + "unique_experts": 47, + "load_cv": 1.0344821550575607, + "normalized_load_entropy": 0.8736127794511127, + "max_load_share": 0.07971014492753623 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "5640bd5d29cf8b37cdfd0941185d56781ceef3a73617523b57fe518c7564f141", + "route_weight_sha256": "91ca5771cac9b39a8b6b6bacb87ef380adf8bb6ebe77992da0797efc6cc7fef8", + "loads": [ + 1, + 4, + 0, + 7, + 4, + 11, + 5, + 1, + 3, + 9, + 6, + 6, + 6, + 14, + 5, + 17, + 12, + 13, + 8, + 5, + 12, + 4, + 3, + 3, + 16, + 2, + 12, + 1, + 3, + 2, + 6, + 2, + 8, + 12, + 2, + 3, + 1, + 11, + 4, + 4, + 5, + 20, + 1, + 4, + 8, + 8, + 2, + 6, + 2, + 9, + 6, + 1, + 0, + 12, + 1, + 11, + 2, + 2, + 2, + 4, + 6, + 12, + 3, + 9 + ], + "weighted_loads": [ + 0.02319788932800293, + 0.1609111949801445, + 0.0, + 0.5109857618808746, + 0.21190913021564484, + 1.0391032211482525, + 0.2452184036374092, + 0.02629050612449646, + 0.4477298781275749, + 0.9995345249772072, + 0.2033307384699583, + 0.21049129031598568, + 0.42247768864035606, + 1.0049095153808594, + 0.25700557604432106, + 1.8412701338529587, + 0.9549580942839384, + 0.912181194871664, + 0.779974514618516, + 0.341012928634882, + 0.9543635863810778, + 0.28090866655111313, + 0.11715009063482285, + 0.21389630809426308, + 1.220581240952015, + 0.08970523998141289, + 1.5511852037161589, + 0.03257685527205467, + 0.1637943647801876, + 0.07141906023025513, + 0.24172957241535187, + 0.07060789316892624, + 0.3964178115129471, + 0.5232583936303854, + 0.0780080035328865, + 0.14748334884643555, + 0.036645807325839996, + 0.5602976903319359, + 0.20493067428469658, + 0.22942625358700752, + 0.2443533781915903, + 2.797067742794752, + 0.03737671673297882, + 0.1605697125196457, + 0.4444803576916456, + 0.3942512199282646, + 0.07716025970876217, + 0.29586566612124443, + 0.09169211611151695, + 0.6404585856944323, + 0.26654165983200073, + 0.0437936931848526, + 0.0, + 1.0741284787654877, + 0.03247814252972603, + 0.9656488336622715, + 0.10724272951483727, + 0.07455739006400108, + 0.1041613221168518, + 0.8692144714295864, + 0.30933684669435024, + 1.0746018048375845, + 0.32943442463874817, + 0.588720889762044 + ], + "unique_experts": 62, + "load_cv": 0.7631941285005918, + "normalized_load_entropy": 0.9306584938940816, + "max_load_share": 0.052083333333333336 + } + }, + "s0_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "22a28b35f45b2fa6ad899b9b7a7b2fdc68dd3e3c8079be6c42ea0719af79073c", + "route_weight_sha256": "dfcea660a8c510ca541259728267aa5aadd0674b5cff5bd956288f7ed5d59cd7", + "loads": [ + 0, + 2, + 0, + 5, + 4, + 2, + 0, + 0, + 3, + 4, + 0, + 4, + 6, + 10, + 2, + 5, + 0, + 3, + 0, + 5, + 0, + 2, + 0, + 2, + 4, + 2, + 4, + 3, + 3, + 2, + 3, + 2, + 3, + 5, + 0, + 1, + 0, + 1, + 3, + 1, + 1, + 3, + 0, + 1, + 3, + 6, + 1, + 0, + 0, + 5, + 1, + 1, + 0, + 0, + 1, + 0, + 0, + 1, + 1, + 2, + 1, + 11, + 0, + 3 + ], + "weighted_loads": [ + 0.0, + 0.07615652307868004, + 0.0, + 0.398452028632164, + 0.2077288143336773, + 0.12916214019060135, + 0.0, + 0.0, + 0.4483172968029976, + 0.4424573555588722, + 0.0, + 0.153559235855937, + 0.42417481914162636, + 0.8235494419932365, + 0.11619903892278671, + 0.4773801788687706, + 0.0, + 0.2355179749429226, + 0.0, + 0.3243250399827957, + 0.0, + 0.1883099377155304, + 0.0, + 0.13648282922804356, + 0.15039752051234245, + 0.09010929241776466, + 0.4357421323657036, + 0.10007917694747448, + 0.16077108308672905, + 0.07275725528597832, + 0.0903148427605629, + 0.06768490374088287, + 0.1592928245663643, + 0.22661880776286125, + 0.0, + 0.028283406049013138, + 0.0, + 0.03998665511608124, + 0.11882032081484795, + 0.05209377408027649, + 0.04421643540263176, + 0.15023640915751457, + 0.0, + 0.04929760843515396, + 0.2580195926129818, + 0.23608444444835186, + 0.044815246015787125, + 0.0, + 0.0, + 0.46681391075253487, + 0.03906581923365593, + 0.04134702309966087, + 0.0, + 0.0, + 0.025246012955904007, + 0.0, + 0.0, + 0.0335579439997673, + 0.06257172673940659, + 0.6332583278417587, + 0.07423766702413559, + 0.9647694565355778, + 0.0, + 0.12357363663613796 + ], + "unique_experts": 45, + "load_cv": 1.066473675042622, + "normalized_load_entropy": 0.8636313029939987, + "max_load_share": 0.07971014492753623 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "6776c17d7a8b6f11dde4d8f1da95fd9534f3eb85f30af5a73015bbcbf4c11c0b", + "route_weight_sha256": "5348f750b264844293ef1c163bafdb7096bc829c164ca95bf9a4aa9a19e79378", + "loads": [ + 0, + 2, + 0, + 5, + 4, + 13, + 4, + 0, + 3, + 6, + 5, + 4, + 6, + 11, + 2, + 13, + 8, + 8, + 5, + 5, + 12, + 5, + 2, + 2, + 13, + 2, + 8, + 3, + 3, + 2, + 6, + 2, + 5, + 9, + 0, + 1, + 0, + 11, + 3, + 1, + 3, + 11, + 1, + 1, + 5, + 7, + 1, + 0, + 0, + 6, + 2, + 3, + 0, + 12, + 1, + 11, + 0, + 1, + 1, + 2, + 4, + 13, + 0, + 9 + ], + "weighted_loads": [ + 0.0, + 0.07615652307868004, + 0.0, + 0.398452028632164, + 0.2077288143336773, + 1.0673605762422085, + 0.16769300028681755, + 0.0, + 0.4483172968029976, + 0.8525686822831631, + 0.23087644763290882, + 0.153559235855937, + 0.42417481914162636, + 0.8427716996520758, + 0.11619903892278671, + 1.3740915693342686, + 0.4030718505382538, + 0.5320868045091629, + 0.584333011880517, + 0.3243250399827957, + 1.2080279793590307, + 0.30522680282592773, + 0.13674823567271233, + 0.13648282922804356, + 0.9293789193034172, + 0.09010929241776466, + 0.6555985566228628, + 0.10007917694747448, + 0.16077108308672905, + 0.07275725528597832, + 0.2450861558318138, + 0.06768490374088287, + 0.27436431869864464, + 0.44586304388940334, + 0.0, + 0.028283406049013138, + 0.0, + 0.5563691444694996, + 0.11882032081484795, + 0.05209377408027649, + 0.18856491148471832, + 1.6086611300706863, + 0.02828170172870159, + 0.04929760843515396, + 0.3262164369225502, + 0.3030740898102522, + 0.044815246015787125, + 0.0, + 0.0, + 0.48414343036711216, + 0.07362556457519531, + 0.14732284098863602, + 0.0, + 0.8976143803447485, + 0.025246012955904007, + 0.889244694262743, + 0.0, + 0.0335579439997673, + 0.06257172673940659, + 0.6332583278417587, + 0.2743585780262947, + 1.1044679917395115, + 0.0, + 0.6038961466401815 + ], + "unique_experts": 54, + "load_cv": 0.8940820521906157, + "normalized_load_entropy": 0.8979834496545077, + "max_load_share": 0.04513888888888889 + } + }, + "s1_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "3cab182d9c928318983efeb7e7039bdec8c688383798c98e0d89fc2b74ca91d4", + "route_weight_sha256": "c27dcfb8b6b6185c1600e773fb3365478fa2370402490194fb82abe66b0eed09", + "loads": [ + 1, + 2, + 0, + 4, + 4, + 2, + 0, + 0, + 3, + 3, + 0, + 4, + 6, + 11, + 2, + 5, + 0, + 3, + 0, + 5, + 0, + 2, + 0, + 2, + 3, + 1, + 4, + 2, + 3, + 2, + 2, + 2, + 3, + 5, + 0, + 1, + 1, + 0, + 4, + 1, + 2, + 4, + 0, + 1, + 3, + 6, + 1, + 0, + 0, + 5, + 1, + 1, + 0, + 0, + 1, + 0, + 0, + 2, + 3, + 3, + 1, + 8, + 0, + 3 + ], + "weighted_loads": [ + 0.02676180563867092, + 0.0801398940384388, + 0.0, + 0.3717851750552654, + 0.19897432625293732, + 0.12656696885824203, + 0.0, + 0.0, + 0.4583137109875679, + 0.4182959124445915, + 0.0, + 0.14383217133581638, + 0.4132596328854561, + 0.8528780322521925, + 0.11465824022889137, + 0.4051181897521019, + 0.0, + 0.2263028807938099, + 0.0, + 0.3476150259375572, + 0.0, + 0.19071438163518906, + 0.0, + 0.1450423188507557, + 0.1310991495847702, + 0.050552207976579666, + 0.44294178299605846, + 0.06996021792292595, + 0.15803712233901024, + 0.070041723549366, + 0.05954759754240513, + 0.06554203107953072, + 0.1575426682829857, + 0.21333588659763336, + 0.0, + 0.029307657852768898, + 0.02726895548403263, + 0.0, + 0.16982262209057808, + 0.052153509110212326, + 0.07813489623367786, + 0.1728052906692028, + 0.0, + 0.04682973772287369, + 0.24143492430448532, + 0.2749996706843376, + 0.03927863761782646, + 0.0, + 0.0, + 0.4690224155783653, + 0.03840412199497223, + 0.04307100921869278, + 0.0, + 0.0, + 0.02849673666059971, + 0.0, + 0.0, + 0.07439502701163292, + 0.13652610778808594, + 0.6812145300209522, + 0.06989908963441849, + 0.8133498094975948, + 0.0, + 0.13204382732510567 + ], + "unique_experts": 46, + "load_cv": 1.0048193050239391, + "normalized_load_entropy": 0.874294251572876, + "max_load_share": 0.07971014492753623 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "1c699735ba0e640dfce025a08ca15bceec0987e5ac8907a1e0f869e9484a09f2", + "route_weight_sha256": "49f44d7cb408ec0387044807ce8e216f3e9a189e8a1e787faf553799c311a4c9", + "loads": [ + 1, + 5, + 0, + 6, + 4, + 12, + 5, + 1, + 3, + 6, + 6, + 6, + 6, + 15, + 3, + 17, + 10, + 14, + 8, + 5, + 14, + 5, + 4, + 3, + 18, + 1, + 13, + 2, + 3, + 3, + 6, + 2, + 9, + 8, + 1, + 3, + 1, + 9, + 6, + 4, + 6, + 19, + 1, + 3, + 5, + 10, + 2, + 6, + 3, + 9, + 7, + 1, + 0, + 13, + 1, + 12, + 2, + 3, + 3, + 4, + 6, + 9, + 3, + 8 + ], + "weighted_loads": [ + 0.02676180563867092, + 0.20078960806131363, + 0.0, + 0.4631921835243702, + 0.19897432625293732, + 1.083366271108389, + 0.2452184036374092, + 0.02629050612449646, + 0.4583137109875679, + 0.8632359392940998, + 0.20719202049076557, + 0.2054331786930561, + 0.4132596328854561, + 0.9764847923070192, + 0.16314226388931274, + 1.7889203131198883, + 0.3471943326294422, + 0.9651808831840754, + 0.7619275767356157, + 0.3476150259375572, + 1.288947330787778, + 0.3205026388168335, + 0.14875995740294456, + 0.22099386528134346, + 1.4783989563584328, + 0.050552207976579666, + 1.5437997952103615, + 0.06996021792292595, + 0.15803712233901024, + 0.09167522564530373, + 0.22984962165355682, + 0.06554203107953072, + 0.4391283728182316, + 0.3510576020926237, + 0.03571491688489914, + 0.14582299627363682, + 0.02726895548403263, + 0.4812721498310566, + 0.29362939670681953, + 0.22863134741783142, + 0.2683938182890415, + 2.552146941423416, + 0.03737671673297882, + 0.13799382001161575, + 0.3113309033215046, + 0.47468505054712296, + 0.06994462199509144, + 0.29586566612124443, + 0.12491399794816971, + 0.6442671660333872, + 0.2856911402195692, + 0.04307100921869278, + 0.0, + 1.1693117693066597, + 0.02849673666059971, + 1.0991692878305912, + 0.10724272951483727, + 0.14089158549904823, + 0.13652610778808594, + 0.88048030808568, + 0.26592648960649967, + 0.9043849669396877, + 0.32943442463874817, + 0.5100441984832287 + ], + "unique_experts": 62, + "load_cv": 0.7654655446197433, + "normalized_load_entropy": 0.9315332328169429, + "max_load_share": 0.049479166666666664 + } + }, + "s0_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "5c09a9bdf55e93acfba2d47b831e61b4412ccaf90ab716c3df0fea86a64cf1e1", + "route_weight_sha256": "b422696e246ff36c73f85fe6ed7ccc7a7583f61779eaca71157f846e7a0ba1db", + "loads": [ + 0, + 2, + 0, + 5, + 4, + 3, + 0, + 0, + 3, + 4, + 0, + 4, + 6, + 10, + 2, + 5, + 0, + 3, + 0, + 5, + 1, + 2, + 0, + 2, + 3, + 2, + 3, + 3, + 3, + 2, + 3, + 2, + 3, + 5, + 0, + 1, + 1, + 1, + 3, + 1, + 1, + 3, + 0, + 1, + 3, + 6, + 1, + 0, + 0, + 5, + 0, + 1, + 0, + 0, + 1, + 0, + 0, + 2, + 2, + 2, + 1, + 9, + 0, + 3 + ], + "weighted_loads": [ + 0.0, + 0.07960554212331772, + 0.0, + 0.40308675169944763, + 0.20567942783236504, + 0.15647911839187145, + 0.0, + 0.0, + 0.4341707304120064, + 0.42257313430309296, + 0.0, + 0.14617470279335976, + 0.42757805064320564, + 0.8309896495193243, + 0.11928632482886314, + 0.45745812356472015, + 0.0, + 0.23376277834177017, + 0.0, + 0.31985561549663544, + 0.033365629613399506, + 0.1950961947441101, + 0.0, + 0.13770713657140732, + 0.11691712215542793, + 0.09367278590798378, + 0.4123135954141617, + 0.09658385254442692, + 0.16256258636713028, + 0.07644755765795708, + 0.09429344721138477, + 0.06942043453454971, + 0.16567134112119675, + 0.2244906034320593, + 0.0, + 0.03158000484108925, + 0.027952874079346657, + 0.038007427006959915, + 0.12135049700737, + 0.05148434266448021, + 0.040742360055446625, + 0.1529993675649166, + 0.0, + 0.04665471613407135, + 0.2416665330529213, + 0.24807759374380112, + 0.04328489676117897, + 0.0, + 0.0, + 0.46515000611543655, + 0.0, + 0.04259418323636055, + 0.0, + 0.0, + 0.02699926681816578, + 0.0, + 0.0, + 0.06835096701979637, + 0.10608413442969322, + 0.6414965987205505, + 0.07748735696077347, + 0.9105908870697021, + 0.0, + 0.11954500153660774 + ], + "unique_experts": 46, + "load_cv": 0.998107850717304, + "normalized_load_entropy": 0.8748145883630073, + "max_load_share": 0.07246376811594203 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "014d6a501814b8e53450e88291ffb6f2c0761882ad1b6bdd725be5a10932c93c", + "route_weight_sha256": "8b4278e46c2ba5708826bf84b80e0c3a223e04e314f12a388840559d696cc6ba", + "loads": [ + 0, + 2, + 0, + 5, + 4, + 15, + 4, + 0, + 3, + 7, + 6, + 4, + 6, + 11, + 2, + 13, + 8, + 8, + 5, + 5, + 14, + 4, + 3, + 2, + 12, + 2, + 7, + 3, + 3, + 2, + 5, + 2, + 4, + 9, + 0, + 1, + 1, + 10, + 3, + 1, + 3, + 11, + 0, + 1, + 5, + 7, + 1, + 1, + 0, + 6, + 1, + 3, + 0, + 11, + 1, + 11, + 0, + 2, + 2, + 2, + 5, + 11, + 0, + 8 + ], + "weighted_loads": [ + 0.0, + 0.07960554212331772, + 0.0, + 0.40308675169944763, + 0.20567942783236504, + 1.1679391860961914, + 0.16769300028681755, + 0.0, + 0.4341707304120064, + 0.8585147894918919, + 0.27770525589585304, + 0.14617470279335976, + 0.42757805064320564, + 0.8502119071781635, + 0.11928632482886314, + 1.369540449231863, + 0.4785882215946913, + 0.639967042952776, + 0.5473217461258173, + 0.31985561549663544, + 1.1141887474805117, + 0.27686480432748795, + 0.17842212319374084, + 0.13770713657140732, + 0.9320834316313267, + 0.09367278590798378, + 0.6696833316236734, + 0.09658385254442692, + 0.16256258636713028, + 0.07644755765795708, + 0.2245579119771719, + 0.06942043453454971, + 0.2058977298438549, + 0.4379364475607872, + 0.0, + 0.03158000484108925, + 0.027952874079346657, + 0.5189873389899731, + 0.12135049700737, + 0.05148434266448021, + 0.18854853883385658, + 1.6621326841413975, + 0.0, + 0.04665471613407135, + 0.30903119035065174, + 0.31506723910570145, + 0.04328489676117897, + 0.03966078162193298, + 0.0, + 0.48247952573001385, + 0.043183982372283936, + 0.1485700011253357, + 0.0, + 0.768232798203826, + 0.02699926681816578, + 0.8417888171970844, + 0.0, + 0.06835096701979637, + 0.10608413442969322, + 0.6414965987205505, + 0.3006061911582947, + 1.052720621228218, + 0.0, + 0.5080354176461697 + ], + "unique_experts": 55, + "load_cv": 0.8819171036881969, + "normalized_load_entropy": 0.9024673770272583, + "max_load_share": 0.052083333333333336 + } + }, + "s1_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "80ed54f35c3bf77a5b3e810f7f993667a72e456cc7fc6e2f790ae9051de14e98", + "route_weight_sha256": "5dbeb2e4d7920b1c5cc28e276489522b69502f8d17b4cccfec8aebc1d5cd3287", + "loads": [ + 1, + 2, + 0, + 4, + 4, + 2, + 0, + 0, + 3, + 4, + 0, + 4, + 6, + 10, + 4, + 4, + 0, + 3, + 0, + 5, + 1, + 2, + 0, + 2, + 3, + 3, + 3, + 2, + 3, + 2, + 2, + 2, + 3, + 4, + 0, + 1, + 1, + 1, + 4, + 1, + 1, + 3, + 0, + 2, + 3, + 7, + 1, + 0, + 0, + 5, + 1, + 1, + 0, + 0, + 1, + 0, + 0, + 2, + 2, + 2, + 1, + 8, + 0, + 2 + ], + "weighted_loads": [ + 0.026941029354929924, + 0.08298970386385918, + 0.0, + 0.37490035593509674, + 0.19773373007774353, + 0.1208474189043045, + 0.0, + 0.0, + 0.4533633217215538, + 0.4365116897970438, + 0.0, + 0.1405077688395977, + 0.40282777324318886, + 0.8129406422376633, + 0.21796590834856033, + 0.358075562864542, + 0.0, + 0.22894636541604996, + 0.0, + 0.3406648114323616, + 0.033345237374305725, + 0.1924499347805977, + 0.0, + 0.14783528819680214, + 0.13512827083468437, + 0.1348094455897808, + 0.42100007459521294, + 0.05731501057744026, + 0.16249366849660873, + 0.07246921211481094, + 0.05962095223367214, + 0.0657054428011179, + 0.16387055069208145, + 0.1688268557190895, + 0.0, + 0.029843764379620552, + 0.027816882357001305, + 0.03368576988577843, + 0.1764877438545227, + 0.05313374474644661, + 0.04805436357855797, + 0.13022810965776443, + 0.0, + 0.06792584992945194, + 0.2413681074976921, + 0.29751026071608067, + 0.03977581486105919, + 0.0, + 0.0, + 0.458412729203701, + 0.03930576518177986, + 0.042208231985569, + 0.0, + 0.0, + 0.02807478979229927, + 0.0, + 0.0, + 0.07379546016454697, + 0.10605014860630035, + 0.6703326851129532, + 0.06973376870155334, + 0.7883236780762672, + 0.0, + 0.0997469425201416 + ], + "unique_experts": 48, + "load_cv": 0.9603568264944531, + "normalized_load_entropy": 0.8847615533326557, + "max_load_share": 0.07246376811594203 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "b058144855e6227be57adac1ee18640efdc4dc6643a52fe3ba3437df55031295", + "route_weight_sha256": "f5314ec85a8bd121b19a58995655381559418d3edc165148846ae25a257142a2", + "loads": [ + 1, + 5, + 0, + 6, + 4, + 13, + 5, + 1, + 3, + 7, + 5, + 6, + 6, + 14, + 5, + 16, + 9, + 15, + 8, + 5, + 13, + 4, + 3, + 3, + 19, + 3, + 12, + 2, + 3, + 3, + 6, + 2, + 9, + 7, + 1, + 3, + 1, + 10, + 7, + 4, + 5, + 19, + 1, + 4, + 5, + 11, + 2, + 6, + 3, + 9, + 7, + 1, + 0, + 13, + 2, + 12, + 2, + 2, + 2, + 4, + 6, + 9, + 3, + 7 + ], + "weighted_loads": [ + 0.026941029354929924, + 0.203639417886734, + 0.0, + 0.4663073644042015, + 0.19773373007774353, + 1.088864304125309, + 0.2452184036374092, + 0.02629050612449646, + 0.4533633217215538, + 0.8866590987890959, + 0.1798313893377781, + 0.20210877619683743, + 0.40282777324318886, + 0.93654740229249, + 0.2664499320089817, + 1.6432943008840084, + 0.3231503516435623, + 1.0462454296648502, + 0.7960674036294222, + 0.3406648114323616, + 1.0169246550649405, + 0.28493010997772217, + 0.11715009063482285, + 0.2237868346273899, + 1.4946589544415474, + 0.1348094455897808, + 1.5451900605112314, + 0.05731501057744026, + 0.16249366849660873, + 0.09270786307752132, + 0.2666141502559185, + 0.0657054428011179, + 0.4173627533018589, + 0.30654857121407986, + 0.03571491688489914, + 0.14635910280048847, + 0.027816882357001305, + 0.514957919716835, + 0.3512185327708721, + 0.2296115830540657, + 0.23419768922030926, + 2.504789497703314, + 0.03737671673297882, + 0.159089932218194, + 0.3112640865147114, + 0.497195640578866, + 0.07044179923832417, + 0.29586566612124443, + 0.12720123305916786, + 0.6336574796587229, + 0.2907946780323982, + 0.042208231985569, + 0.0, + 1.1349026151001453, + 0.06618896499276161, + 1.0178849063813686, + 0.10724272951483727, + 0.07379546016454697, + 0.10605014860630035, + 0.8986129630357027, + 0.31296294927597046, + 0.8615137487649918, + 0.32943442463874817, + 0.5073759034276009 + ], + "unique_experts": 62, + "load_cv": 0.7597742720337696, + "normalized_load_entropy": 0.9332352022369831, + "max_load_share": 0.049479166666666664 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.9161490683229813, + "mean_token_weighted_tv": 0.018164414062124233, + "aggregate_load_tv": 0.04347826086956521 + }, + "system_bos": { + "tokens": 23, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.9037267080745343, + "mean_token_weighted_tv": 0.02178675539629615, + "aggregate_load_tv": 0.036231884057971016 + }, + "system_x": { + "tokens": 23, + "ordered_topk_exact_tokens": 7, + "set_exact_tokens": 12, + "mean_set_jaccard": 0.8633540372670808, + "mean_token_weighted_tv": 0.028852335217854252, + "aggregate_load_tv": 0.07246376811594202 + }, + "system_period": { + "tokens": 23, + "ordered_topk_exact_tokens": 8, + "set_exact_tokens": 13, + "mean_set_jaccard": 0.8757763975155279, + "mean_token_weighted_tv": 0.029436542004670784, + "aggregate_load_tv": 0.05797101449275362 + }, + "bos_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 13, + "mean_set_jaccard": 0.875776397515528, + "mean_token_weighted_tv": 0.025880041734679886, + "aggregate_load_tv": 0.05797101449275362 + }, + "bos_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.8913043478260869, + "mean_token_weighted_tv": 0.02808165088619875, + "aggregate_load_tv": 0.050724637681159424 + }, + "x_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 8, + "set_exact_tokens": 12, + "mean_set_jaccard": 0.8540372670807453, + "mean_token_weighted_tv": 0.028397939127424488, + "aggregate_load_tv": 0.07971014492753623 + }, + "x_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 6, + "set_exact_tokens": 8, + "mean_set_jaccard": 0.813664596273292, + "mean_token_weighted_tv": 0.03835098368480154, + "aggregate_load_tv": 0.09420289855072465 + }, + "period_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 5, + "set_exact_tokens": 11, + "mean_set_jaccard": 0.8416149068322983, + "mean_token_weighted_tv": 0.03001071083480897, + "aggregate_load_tv": 0.07246376811594202 + }, + "period_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 10, + "mean_set_jaccard": 0.8105590062111803, + "mean_token_weighted_tv": 0.040067037486511727, + "aggregate_load_tv": 0.07971014492753624 + } + } + }, + "layer_17": { + "layer": 17, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "39a351d73cd4d2e2b0a60834527f92a92fbc4566dfd3356026b4599dca995cb0", + "route_weight_sha256": "16c66b9e2a7fd55c6ab73079ba3a8eec7cea48aab83120f93333162437ece04c", + "loads": [ + 2, + 0, + 2, + 4, + 0, + 1, + 0, + 6, + 1, + 0, + 2, + 1, + 0, + 2, + 0, + 9, + 3, + 1, + 0, + 4, + 1, + 1, + 4, + 0, + 1, + 1, + 3, + 2, + 0, + 6, + 1, + 2, + 8, + 1, + 1, + 2, + 0, + 1, + 1, + 0, + 0, + 6, + 4, + 5, + 1, + 2, + 3, + 0, + 1, + 4, + 1, + 0, + 0, + 14, + 3, + 3, + 0, + 1, + 4, + 3, + 1, + 8, + 0, + 0 + ], + "weighted_loads": [ + 0.09783710539340973, + 0.0, + 0.07151624746620655, + 0.4283844418823719, + 0.0, + 0.04719386249780655, + 0.0, + 0.3800101801753044, + 0.03828105702996254, + 0.0, + 0.07705846428871155, + 0.054756227880716324, + 0.0, + 0.1502935215830803, + 0.0, + 0.453929053619504, + 0.49870000034570694, + 0.028362305834889412, + 0.0, + 0.25540420413017273, + 0.055351704359054565, + 0.04146132618188858, + 0.2906295023858547, + 0.0, + 0.04398605599999428, + 0.03219586983323097, + 0.19910181686282158, + 0.1821066215634346, + 0.0, + 0.8251293711364269, + 0.03468391299247742, + 0.2675172835588455, + 0.6009372696280479, + 0.06555302441120148, + 0.027962662279605865, + 0.18010415881872177, + 0.0, + 0.028099942952394485, + 0.05091610178351402, + 0.0, + 0.0, + 1.1811146885156631, + 0.351318895816803, + 0.8650656417012215, + 0.11070689558982849, + 0.10813752934336662, + 0.22033154219388962, + 0.0, + 0.029714660719037056, + 0.15753760002553463, + 0.06059246510267258, + 0.0, + 0.0, + 0.6403049305081367, + 0.18846571817994118, + 0.16553891077637672, + 0.0, + 0.2603141963481903, + 0.23230689391493797, + 0.19681504927575588, + 0.1143902912735939, + 0.748200211673975, + 0.0, + 0.0 + ], + "unique_experts": 46, + "load_cv": 1.216614659098541, + "normalized_load_entropy": 0.8459852543637703, + "max_load_share": 0.10144927536231885 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "cd4d948cb32b3a9d16fcbd1b0f374a5a11874cd0c4731947760f766c2287fdbc", + "route_weight_sha256": "175935f954a4879acd6f93d0add289e062c293de5a72d4757be08e06b169044b", + "loads": [ + 10, + 2, + 5, + 10, + 0, + 1, + 2, + 6, + 1, + 4, + 9, + 2, + 3, + 10, + 0, + 11, + 3, + 7, + 3, + 4, + 4, + 1, + 4, + 6, + 7, + 8, + 13, + 6, + 5, + 8, + 1, + 2, + 16, + 1, + 1, + 2, + 0, + 1, + 5, + 0, + 8, + 9, + 7, + 8, + 1, + 6, + 3, + 0, + 1, + 5, + 2, + 0, + 2, + 14, + 3, + 6, + 0, + 4, + 5, + 4, + 1, + 9, + 6, + 0 + ], + "weighted_loads": [ + 0.38714675325900316, + 0.0796637237071991, + 0.2444335464388132, + 0.9727801270782948, + 0.0, + 0.04719386249780655, + 0.09607585519552231, + 0.3800101801753044, + 0.03828105702996254, + 0.14869599416851997, + 0.5308483876287937, + 0.07330644875764847, + 0.09820318780839443, + 0.7488981634378433, + 0.0, + 0.5527237858623266, + 0.49870000034570694, + 0.6580784562975168, + 0.1266416348516941, + 0.25540420413017273, + 0.3280877396464348, + 0.04146132618188858, + 0.2906295023858547, + 0.2697969637811184, + 0.5241700150072575, + 0.395581990480423, + 1.9127382300794125, + 0.36108240485191345, + 0.19819221645593643, + 0.8607956115156412, + 0.03468391299247742, + 0.2675172835588455, + 0.9398661740124226, + 0.06555302441120148, + 0.027962662279605865, + 0.18010415881872177, + 0.0, + 0.028099942952394485, + 0.21225520223379135, + 0.0, + 1.1307847276329994, + 1.2722309725359082, + 0.5874735936522484, + 0.9243973726406693, + 0.11070689558982849, + 0.9928889982402325, + 0.22033154219388962, + 0.0, + 0.029714660719037056, + 0.19802783243358135, + 0.12851618975400925, + 0.0, + 0.128316942602396, + 0.6403049305081367, + 0.18846571817994118, + 0.32002621330320835, + 0.0, + 0.4297406766563654, + 0.2626552376896143, + 0.232223404571414, + 0.1143902912735939, + 0.8032655790448189, + 0.6270523890852928, + 0.0 + ], + "unique_experts": 56, + "load_cv": 0.8388704928078611, + "normalized_load_entropy": 0.9099504665555551, + "max_load_share": 0.05555555555555555 + } + }, + "s1_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "019250062cb9796a39578ef768be28a00cb9896901920664e6a188a4a22f1667", + "route_weight_sha256": "cda3edb96d12856216fd7d2da03cdc572c8bd9fab2a94c565c96ab6812a06386", + "loads": [ + 2, + 0, + 4, + 4, + 0, + 1, + 0, + 6, + 1, + 0, + 1, + 1, + 0, + 3, + 0, + 9, + 3, + 0, + 0, + 4, + 1, + 1, + 4, + 0, + 1, + 0, + 3, + 2, + 0, + 6, + 1, + 2, + 7, + 1, + 0, + 2, + 0, + 1, + 1, + 0, + 0, + 7, + 4, + 5, + 1, + 3, + 3, + 0, + 1, + 4, + 1, + 0, + 0, + 13, + 3, + 3, + 0, + 1, + 5, + 3, + 1, + 8, + 0, + 0 + ], + "weighted_loads": [ + 0.09473752975463867, + 0.0, + 0.14077803306281567, + 0.4321861304342747, + 0.0, + 0.038004521280527115, + 0.0, + 0.3810430243611336, + 0.039956409484148026, + 0.0, + 0.051457423716783524, + 0.05353697016835213, + 0.0, + 0.17952031642198563, + 0.0, + 0.47093371115624905, + 0.49560433626174927, + 0.0, + 0.0, + 0.24906714633107185, + 0.05402287840843201, + 0.039696868509054184, + 0.2955217622220516, + 0.0, + 0.0464867502450943, + 0.0, + 0.19945374876260757, + 0.17280244082212448, + 0.0, + 0.7992560714483261, + 0.0336335189640522, + 0.26846764981746674, + 0.5501209609210491, + 0.07018321752548218, + 0.0, + 0.1794339194893837, + 0.0, + 0.028153248131275177, + 0.05119943991303444, + 0.0, + 0.0, + 1.2214395999908447, + 0.3321145214140415, + 0.8516495041549206, + 0.10735943913459778, + 0.13757773488759995, + 0.2103827130049467, + 0.0, + 0.03298867121338844, + 0.158160837367177, + 0.06193459406495094, + 0.0, + 0.0, + 0.6014610007405281, + 0.18854830414056778, + 0.16682394593954086, + 0.0, + 0.2670649588108063, + 0.26314473897218704, + 0.19042993895709515, + 0.11330015957355499, + 0.7504524439573288, + 0.0, + 0.0 + ], + "unique_experts": 43, + "load_cv": 1.2110774849893724, + "normalized_load_entropy": 0.8366671905832498, + "max_load_share": 0.09420289855072464 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "04ef3ec678a4a72e6a1c2fea4f5618050746ab62915be3731670a8b38f0f6106", + "route_weight_sha256": "d1f6e87b3cead80c208b543f493ada7a789b6d0008a1a7b1f98ea6cb961af9d0", + "loads": [ + 10, + 1, + 8, + 11, + 6, + 1, + 3, + 7, + 1, + 5, + 9, + 3, + 0, + 11, + 0, + 16, + 5, + 8, + 3, + 4, + 2, + 2, + 4, + 9, + 11, + 21, + 15, + 5, + 3, + 8, + 2, + 3, + 13, + 1, + 0, + 2, + 5, + 3, + 5, + 1, + 13, + 13, + 8, + 6, + 3, + 8, + 5, + 2, + 1, + 6, + 2, + 6, + 4, + 13, + 4, + 8, + 7, + 12, + 6, + 5, + 2, + 13, + 10, + 0 + ], + "weighted_loads": [ + 0.43101634830236435, + 0.04274054244160652, + 0.31270333006978035, + 1.100414004176855, + 0.3898263983428478, + 0.038004521280527115, + 0.11760191433131695, + 0.4376637935638428, + 0.039956409484148026, + 0.1587537806481123, + 0.606017205864191, + 0.11996007710695267, + 0.0, + 0.7946258187294006, + 0.0, + 0.8087669108062983, + 0.6640765573829412, + 0.6492554880678654, + 0.1113661453127861, + 0.24906714633107185, + 0.12425874173641205, + 0.11651776358485222, + 0.2955217622220516, + 0.6574930418282747, + 0.6048193196766078, + 1.353591287508607, + 2.0007607862353325, + 0.3057467043399811, + 0.12712854146957397, + 0.8839463647454977, + 0.09455647319555283, + 0.30790018290281296, + 0.7664432493038476, + 0.07018321752548218, + 0.0, + 0.1794339194893837, + 0.2601325251162052, + 0.10167723521590233, + 0.37355404905974865, + 0.03424076735973358, + 1.8101825155317783, + 1.553292918484658, + 0.5333440713584423, + 0.8704813178628683, + 0.3449877090752125, + 1.5205107778310776, + 0.42633849196136, + 0.13240113854408264, + 0.03298867121338844, + 0.23328440450131893, + 0.19769546762108803, + 0.2941805850714445, + 0.2247827872633934, + 0.6014610007405281, + 0.27790866792201996, + 0.5155584551393986, + 0.6188401989638805, + 0.8674663826823235, + 0.2875611614435911, + 0.28274685703217983, + 0.14898424968123436, + 1.0298273041844368, + 0.8661222066730261, + 0.0 + ], + "unique_experts": 60, + "load_cv": 0.7597742720337696, + "normalized_load_entropy": 0.9284606982080013, + "max_load_share": 0.0546875 + } + }, + "s0_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "bc3716f98ae06e231fff1a8cd1d6f183fb2baa270a5e25ec85a42cacd36e64b7", + "route_weight_sha256": "2622b75ac4673c13c064b3ae20b237da94331206382c7f6e57931d0fe6aa15d1", + "loads": [ + 2, + 0, + 4, + 4, + 0, + 1, + 0, + 6, + 0, + 0, + 1, + 1, + 0, + 2, + 0, + 8, + 3, + 0, + 0, + 4, + 1, + 1, + 4, + 0, + 1, + 1, + 3, + 3, + 0, + 6, + 1, + 2, + 8, + 1, + 0, + 2, + 0, + 1, + 1, + 0, + 0, + 6, + 4, + 5, + 1, + 3, + 3, + 0, + 1, + 5, + 1, + 0, + 0, + 14, + 3, + 3, + 0, + 1, + 5, + 2, + 1, + 7, + 1, + 0 + ], + "weighted_loads": [ + 0.08272797241806984, + 0.0, + 0.1381457131356001, + 0.42683843709528446, + 0.0, + 0.04097267612814903, + 0.0, + 0.39963575825095177, + 0.0, + 0.0, + 0.049934275448322296, + 0.05481860786676407, + 0.0, + 0.15405123680830002, + 0.0, + 0.4329004194587469, + 0.49626535177230835, + 0.0, + 0.0, + 0.25921257585287094, + 0.060624346137046814, + 0.04700811207294464, + 0.3034427613019943, + 0.0, + 0.045040108263492584, + 0.030284499749541283, + 0.20733754709362984, + 0.1919199489057064, + 0.0, + 0.8511047102510929, + 0.03628148138523102, + 0.2625657320022583, + 0.5849500559270382, + 0.06578951328992844, + 0.0, + 0.1830480471253395, + 0.0, + 0.026236454024910927, + 0.05518524348735809, + 0.0, + 0.0, + 1.1905393153429031, + 0.35328202694654465, + 0.8885837681591511, + 0.11105357855558395, + 0.1356548760086298, + 0.2228262647986412, + 0.0, + 0.03544020652770996, + 0.18985395692288876, + 0.060340847820043564, + 0.0, + 0.0, + 0.6664004698395729, + 0.1950669214129448, + 0.1693703979253769, + 0.0, + 0.27115845680236816, + 0.25359465181827545, + 0.15915411338210106, + 0.11571835726499557, + 0.6966346278786659, + 0.028389496728777885, + 0.0 + ], + "unique_experts": 44, + "load_cv": 1.2138492293900511, + "normalized_load_entropy": 0.8398302689864037, + "max_load_share": 0.10144927536231885 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "dde88ffe4d129a7f6848fe0e83cd74fb274ebe55718a0141645fed5609e604e6", + "route_weight_sha256": "d8b5214c4d72009797b8a48c7a6a9cb3a7f48362829e646ea4f2082e941b75c7", + "loads": [ + 9, + 2, + 6, + 10, + 0, + 1, + 2, + 6, + 0, + 4, + 8, + 2, + 5, + 10, + 0, + 10, + 3, + 6, + 3, + 5, + 4, + 2, + 4, + 6, + 7, + 7, + 12, + 6, + 5, + 7, + 1, + 2, + 15, + 1, + 0, + 2, + 0, + 1, + 5, + 0, + 8, + 8, + 7, + 7, + 1, + 7, + 3, + 0, + 1, + 7, + 2, + 0, + 2, + 15, + 4, + 6, + 0, + 4, + 6, + 3, + 1, + 8, + 9, + 0 + ], + "weighted_loads": [ + 0.40445092134177685, + 0.08362996578216553, + 0.23996836505830288, + 0.9712341222912073, + 0.0, + 0.04097267612814903, + 0.09607585519552231, + 0.39963575825095177, + 0.0, + 0.14869599416851997, + 0.4911998510360718, + 0.07336882874369621, + 0.28318976797163486, + 0.752655878663063, + 0.0, + 0.5287192706018686, + 0.49626535177230835, + 0.6297161504626274, + 0.2588668428361416, + 0.3185439892113209, + 0.3510507419705391, + 0.12592383474111557, + 0.3034427613019943, + 0.2697969637811184, + 0.5360498502850533, + 0.36867072246968746, + 0.9486209154129028, + 0.3170458897948265, + 0.19118354097008705, + 0.8814276438206434, + 0.03628148138523102, + 0.2625657320022583, + 0.9319639671593904, + 0.06578951328992844, + 0.0, + 0.1830480471253395, + 0.0, + 0.026236454024910927, + 0.23591357469558716, + 0.0, + 1.0037227496504784, + 1.2637539859861135, + 0.6037885695695877, + 0.9446971956640482, + 0.11105357855558395, + 0.9624256622046232, + 0.2228262647986412, + 0.0, + 0.03544020652770996, + 0.3754695486277342, + 0.12826457247138023, + 0.0, + 0.12736081704497337, + 0.7193417623639107, + 0.26970458030700684, + 0.3299006540328264, + 0.0, + 0.4398148786276579, + 0.2839429955929518, + 0.20439882203936577, + 0.11571835726499557, + 0.7705449238419533, + 0.612911282107234, + 0.0 + ], + "unique_experts": 54, + "load_cv": 0.8174410538645644, + "normalized_load_entropy": 0.9099587451090173, + "max_load_share": 0.052083333333333336 + } + }, + "s1_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "7cac8058bd166d4fea811b40b1c1beb55437f4754c5f3c66f2d9f6779c2ec47f", + "route_weight_sha256": "b6bdf7b08f5cd072b6ff246aa59ad2148562c61cca40e15a747934015564a8bf", + "loads": [ + 2, + 0, + 4, + 4, + 0, + 1, + 0, + 6, + 1, + 0, + 1, + 1, + 0, + 2, + 0, + 8, + 3, + 0, + 0, + 4, + 1, + 1, + 4, + 0, + 1, + 0, + 3, + 2, + 0, + 6, + 1, + 2, + 8, + 1, + 0, + 2, + 0, + 1, + 1, + 0, + 1, + 6, + 4, + 5, + 1, + 3, + 3, + 0, + 1, + 3, + 1, + 0, + 0, + 14, + 3, + 3, + 0, + 1, + 5, + 3, + 1, + 8, + 1, + 0 + ], + "weighted_loads": [ + 0.08556334674358368, + 0.0, + 0.13986060954630375, + 0.42816491052508354, + 0.0, + 0.042058877646923065, + 0.0, + 0.4120256323367357, + 0.03831623122096062, + 0.0, + 0.04872436076402664, + 0.052782777696847916, + 0.0, + 0.16552583873271942, + 0.0, + 0.40767003782093525, + 0.5081620067358017, + 0.0, + 0.0, + 0.26468463987112045, + 0.05698549374938011, + 0.044659558683633804, + 0.2993623986840248, + 0.0, + 0.04118538275361061, + 0.0, + 0.20963992923498154, + 0.16374343633651733, + 0.0, + 0.8724520802497864, + 0.033078890293836594, + 0.2509341165423393, + 0.552363408729434, + 0.06607482582330704, + 0.0, + 0.1746571585536003, + 0.0, + 0.026210175827145576, + 0.05731525644659996, + 0.0, + 0.04047686606645584, + 1.19734887778759, + 0.35222114995121956, + 0.8859385997056961, + 0.11054181307554245, + 0.13047181628644466, + 0.22053491324186325, + 0.0, + 0.03599921241402626, + 0.15462908521294594, + 0.0611286498606205, + 0.0, + 0.0, + 0.6256143487989902, + 0.1975713148713112, + 0.1692250408232212, + 0.0, + 0.2808803617954254, + 0.2506212815642357, + 0.1994521450251341, + 0.11888959258794785, + 0.7577796224504709, + 0.029826415702700615, + 0.0 + ], + "unique_experts": 45, + "load_cv": 1.2138492293900511, + "normalized_load_entropy": 0.8428571257819069, + "max_load_share": 0.10144927536231885 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "e81d5206d5aa4872fd5cf4fbd6bbe0ffe2d8c3895769984a7346d9f761b010f9", + "route_weight_sha256": "b19b7657d52917f185af3a628b082752a60b18cbec8d51b218fdbe24a711ff35", + "loads": [ + 9, + 4, + 8, + 11, + 6, + 1, + 3, + 7, + 1, + 6, + 9, + 3, + 2, + 10, + 0, + 14, + 5, + 8, + 3, + 4, + 2, + 2, + 4, + 9, + 10, + 20, + 14, + 5, + 1, + 7, + 2, + 3, + 13, + 1, + 0, + 2, + 5, + 3, + 5, + 1, + 15, + 11, + 8, + 6, + 3, + 8, + 5, + 2, + 1, + 5, + 3, + 6, + 4, + 15, + 4, + 8, + 7, + 12, + 6, + 5, + 2, + 13, + 12, + 0 + ], + "weighted_loads": [ + 0.4384680241346359, + 0.19577649235725403, + 0.28934015333652496, + 1.096392784267664, + 0.3898263983428478, + 0.042058877646923065, + 0.11760191433131695, + 0.4686464015394449, + 0.03831623122096062, + 0.21310960315167904, + 0.591450460255146, + 0.11920588463544846, + 0.1059335246682167, + 0.7806313410401344, + 0.0, + 0.7167929988354445, + 0.6766342278569937, + 0.6492554880678654, + 0.11767703667283058, + 0.26468463987112045, + 0.15474549308419228, + 0.12148045375943184, + 0.2993623986840248, + 0.6574930418282747, + 0.6099689081311226, + 1.3343760129064322, + 1.117908176034689, + 0.2883945256471634, + 0.03986940532922745, + 0.9519485011696815, + 0.09400184452533722, + 0.29036664962768555, + 0.8041421379894018, + 0.06607482582330704, + 0.0, + 0.1746571585536003, + 0.2601325251162052, + 0.09973416291177273, + 0.4106346517801285, + 0.03424076735973358, + 1.7814017124474049, + 1.5325755942612886, + 0.5762315653264523, + 0.9047704134136438, + 0.34817008301615715, + 1.541929816827178, + 0.4364906921982765, + 0.13240113854408264, + 0.03599921241402626, + 0.23505228385329247, + 0.25459710136055946, + 0.2941805850714445, + 0.221908837556839, + 0.6664935983717442, + 0.28693167865276337, + 0.5218989625573158, + 0.6188401989638805, + 0.8890443705022335, + 0.27503770403563976, + 0.2917690631002188, + 0.1545736826956272, + 1.0344535131007433, + 0.9190166927874088, + 0.0 + ], + "unique_experts": 61, + "load_cv": 0.7359800721939873, + "normalized_load_entropy": 0.9335654484533747, + "max_load_share": 0.052083333333333336 + } + }, + "s0_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "64992b52816b1fde9ef19687855bdd42747ebadce5d26e6e7e3c63821c2e609f", + "route_weight_sha256": "17ccfd1cfa3d895bcbfd93f34dd7ae722f68eba88590dbc02308665ad7a2768d", + "loads": [ + 2, + 0, + 3, + 4, + 0, + 1, + 0, + 6, + 1, + 0, + 1, + 1, + 0, + 3, + 0, + 7, + 3, + 0, + 0, + 5, + 1, + 1, + 4, + 0, + 1, + 1, + 3, + 3, + 1, + 6, + 1, + 2, + 8, + 1, + 0, + 2, + 0, + 0, + 1, + 0, + 1, + 6, + 3, + 5, + 1, + 3, + 2, + 0, + 1, + 5, + 1, + 0, + 0, + 14, + 3, + 3, + 0, + 1, + 5, + 3, + 1, + 7, + 0, + 0 + ], + "weighted_loads": [ + 0.08746780455112457, + 0.0, + 0.12218816950917244, + 0.42204442992806435, + 0.0, + 0.04229560121893883, + 0.0, + 0.38640089705586433, + 0.03970414400100708, + 0.0, + 0.046182166785001755, + 0.05344102159142494, + 0.0, + 0.18526540137827396, + 0.0, + 0.35079409927129745, + 0.4888644218444824, + 0.0, + 0.0, + 0.2817601654678583, + 0.05457155033946037, + 0.0438866913318634, + 0.28025713190436363, + 0.0, + 0.04368657246232033, + 0.04106808081269264, + 0.1995713748037815, + 0.20156843960285187, + 0.022409651428461075, + 0.8379902541637421, + 0.035286907106637955, + 0.278425931930542, + 0.5875282548367977, + 0.07039318978786469, + 0.0, + 0.19026051461696625, + 0.0, + 0.0, + 0.053555890917778015, + 0.0, + 0.04336684197187424, + 1.190060779452324, + 0.30993957072496414, + 0.8721224926412106, + 0.10315097868442535, + 0.13061779737472534, + 0.19311168789863586, + 0.0, + 0.032282304018735886, + 0.18886081129312515, + 0.06228361278772354, + 0.0, + 0.0, + 0.6491130944341421, + 0.20059740543365479, + 0.17420941591262817, + 0.0, + 0.2383440136909485, + 0.26114292070269585, + 0.20914671197533607, + 0.11292795091867447, + 0.6609814129769802, + 0.0, + 0.0 + ], + "unique_experts": 45, + "load_cv": 1.194311940990441, + "normalized_load_entropy": 0.8452339073495311, + "max_load_share": 0.10144927536231885 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "20868d58f27e47dab6114c47cd866b8a3f694a2ade9e43bfe568446fdd190888", + "route_weight_sha256": "64f4c0782483f2937b4aa92862a13fe6e083f8f9d96b92f330c294fc30a751f7", + "loads": [ + 8, + 1, + 7, + 11, + 0, + 1, + 2, + 6, + 1, + 5, + 9, + 2, + 3, + 12, + 0, + 9, + 3, + 7, + 3, + 5, + 3, + 2, + 4, + 7, + 7, + 9, + 10, + 6, + 5, + 7, + 1, + 2, + 15, + 1, + 0, + 2, + 0, + 0, + 5, + 0, + 8, + 8, + 7, + 7, + 1, + 7, + 2, + 0, + 2, + 6, + 3, + 0, + 2, + 14, + 4, + 7, + 0, + 4, + 6, + 3, + 1, + 8, + 7, + 0 + ], + "weighted_loads": [ + 0.3287420067936182, + 0.036176830530166626, + 0.2959650233387947, + 1.1178860403597355, + 0.0, + 0.04229560121893883, + 0.09607585519552231, + 0.38640089705586433, + 0.03970414400100708, + 0.19274812564253807, + 0.6550262458622456, + 0.07199124246835709, + 0.09820318780839443, + 0.8216979745775461, + 0.0, + 0.4440543167293072, + 0.4888644218444824, + 0.6731435544788837, + 0.32223307713866234, + 0.2817601654678583, + 0.24660715088248253, + 0.08393586426973343, + 0.28025713190436363, + 0.3269694447517395, + 0.5153202749788761, + 0.4655568990856409, + 0.8056744933128357, + 0.32669438049197197, + 0.1883464828133583, + 0.8683131877332926, + 0.035286907106637955, + 0.278425931930542, + 0.9531655926257372, + 0.07039318978786469, + 0.0, + 0.19026051461696625, + 0.0, + 0.0, + 0.22417282685637474, + 0.0, + 1.0471134781837463, + 1.2746097091585398, + 0.5663306787610054, + 0.9282359201461077, + 0.10315097868442535, + 1.0037527531385422, + 0.19311168789863586, + 0.0, + 0.07337808609008789, + 0.2196475025266409, + 0.1965872049331665, + 0.0, + 0.13139356672763824, + 0.6491130944341421, + 0.24236702919006348, + 0.3812717106193304, + 0.0, + 0.4080310184508562, + 0.29149126447737217, + 0.20914671197533607, + 0.11292795091867447, + 0.7312011905014515, + 0.5135060548782349, + 0.0 + ], + "unique_experts": 54, + "load_cv": 0.816496580927726, + "normalized_load_entropy": 0.9095079208905692, + "max_load_share": 0.052083333333333336 + } + }, + "s1_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "fe41937392b168437cb7ba3084694bca69519504947945ab5326a682a61a2b4b", + "route_weight_sha256": "9ffc9a37c2bf8cb23a18647efb33cb12a8e423279ca764a89b6fb2420a03f14c", + "loads": [ + 2, + 0, + 3, + 4, + 0, + 1, + 0, + 6, + 1, + 0, + 2, + 1, + 0, + 3, + 0, + 7, + 3, + 0, + 0, + 4, + 1, + 1, + 3, + 0, + 1, + 1, + 3, + 3, + 0, + 6, + 2, + 2, + 8, + 1, + 0, + 2, + 0, + 1, + 1, + 0, + 1, + 6, + 4, + 5, + 1, + 2, + 2, + 0, + 1, + 2, + 1, + 0, + 0, + 13, + 3, + 3, + 0, + 1, + 6, + 3, + 1, + 8, + 0, + 2 + ], + "weighted_loads": [ + 0.0889284759759903, + 0.0, + 0.11615496687591076, + 0.40619669295847416, + 0.0, + 0.04673844203352928, + 0.0, + 0.4169837646186352, + 0.04158789664506912, + 0.0, + 0.06947492063045502, + 0.05381222441792488, + 0.0, + 0.19324911199510098, + 0.0, + 0.3502377849072218, + 0.4876300320029259, + 0.0, + 0.0, + 0.25139493867754936, + 0.051884766668081284, + 0.042066097259521484, + 0.24633577093482018, + 0.0, + 0.04028737172484398, + 0.04091408848762512, + 0.20397169142961502, + 0.208227152004838, + 0.0, + 0.8309706933796406, + 0.06294597126543522, + 0.2701285034418106, + 0.5381110198795795, + 0.07311155647039413, + 0.0, + 0.17940938472747803, + 0.0, + 0.027956411242485046, + 0.0520268939435482, + 0.0, + 0.03820658475160599, + 1.1864903718233109, + 0.36484307423233986, + 0.8661424890160561, + 0.10687460005283356, + 0.0876130759716034, + 0.18470269441604614, + 0.0, + 0.03856206312775612, + 0.10949833691120148, + 0.0659671276807785, + 0.0, + 0.0, + 0.572649272158742, + 0.20016217231750488, + 0.17578905075788498, + 0.0, + 0.24190396070480347, + 0.29457238875329494, + 0.20518678799271584, + 0.11426680535078049, + 0.715850742533803, + 0.0, + 0.0732363797724247 + ], + "unique_experts": 46, + "load_cv": 1.1571535813529936, + "normalized_load_entropy": 0.8535947418284229, + "max_load_share": 0.09420289855072464 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "60752f883b76f9423918b223604e002394e37c46079248bf0c9522b9ce7d17c9", + "route_weight_sha256": "75f47ec12426d666c213070e880e7907c03fb9925359af8273d4c03b00e8bd20", + "loads": [ + 8, + 1, + 7, + 12, + 6, + 1, + 3, + 7, + 1, + 6, + 11, + 3, + 0, + 12, + 0, + 13, + 5, + 9, + 3, + 4, + 1, + 2, + 3, + 10, + 10, + 23, + 12, + 5, + 0, + 7, + 3, + 3, + 13, + 1, + 0, + 2, + 5, + 3, + 4, + 1, + 14, + 11, + 8, + 6, + 3, + 7, + 4, + 2, + 3, + 3, + 3, + 6, + 4, + 15, + 4, + 10, + 7, + 14, + 8, + 5, + 2, + 14, + 9, + 2 + ], + "weighted_loads": [ + 0.35476911067962646, + 0.04274054244160652, + 0.2809967175126076, + 1.237519757822156, + 0.3898263983428478, + 0.04673844203352928, + 0.11760191433131695, + 0.4736045338213444, + 0.04158789664506912, + 0.19461682997643948, + 0.7750583328306675, + 0.12023533135652542, + 0.0, + 0.8696496430784464, + 0.0, + 0.6603920627385378, + 0.6561022531241179, + 0.6996399722993374, + 0.12978873774409294, + 0.25139493867754936, + 0.051884766668081284, + 0.11888699233531952, + 0.24633577093482018, + 0.6865069400519133, + 0.6260611861944199, + 1.471984876319766, + 0.9417792446911335, + 0.28466024063527584, + 0.0, + 0.9104671142995358, + 0.12386892549693584, + 0.30956103652715683, + 0.7620578296482563, + 0.07311155647039413, + 0.0, + 0.17940938472747803, + 0.2601325251162052, + 0.1014803983271122, + 0.34928448870778084, + 0.03424076735973358, + 1.7505485638976097, + 1.485573884099722, + 0.57216951623559, + 0.8849743027240038, + 0.34450286999344826, + 1.3899224773049355, + 0.4006584733724594, + 0.13240113854408264, + 0.1149079017341137, + 0.1525956392288208, + 0.29020050913095474, + 0.2941805850714445, + 0.22445981949567795, + 0.6489817146211863, + 0.28952253609895706, + 0.6115131340920925, + 0.6188401989638805, + 0.9640614949166775, + 0.3703405298292637, + 0.2975037060678005, + 0.14995089545845985, + 1.0104769933968782, + 0.6628563608974218, + 0.0732363797724247 + ], + "unique_experts": 60, + "load_cv": 0.7789549623266633, + "normalized_load_entropy": 0.9266226092604007, + "max_load_share": 0.059895833333333336 + } + }, + "s0_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "e74c16b93ed34a1148086dcff22f235916a9d82f0d7dfb7add4d3c8bd73a109e", + "route_weight_sha256": "171f161ffb1c6e10a09bb09b0fb7cb579a574c029da636a1ef6421bd810b8942", + "loads": [ + 2, + 0, + 3, + 4, + 0, + 1, + 0, + 6, + 1, + 0, + 1, + 1, + 0, + 2, + 0, + 8, + 3, + 0, + 0, + 5, + 1, + 1, + 4, + 0, + 1, + 3, + 3, + 3, + 0, + 6, + 1, + 2, + 8, + 1, + 0, + 2, + 0, + 1, + 1, + 0, + 1, + 6, + 3, + 5, + 1, + 2, + 2, + 0, + 1, + 5, + 1, + 0, + 0, + 14, + 3, + 3, + 0, + 1, + 5, + 2, + 1, + 6, + 1, + 0 + ], + "weighted_loads": [ + 0.08776808902621269, + 0.0, + 0.12101229466497898, + 0.41346463561058044, + 0.0, + 0.0421474389731884, + 0.0, + 0.39329487830400467, + 0.04024529829621315, + 0.0, + 0.04497820511460304, + 0.055580880492925644, + 0.0, + 0.15488110482692719, + 0.0, + 0.3844911940395832, + 0.49099065363407135, + 0.0, + 0.0, + 0.2832816168665886, + 0.06018153950572014, + 0.04482864961028099, + 0.30197570845484734, + 0.0, + 0.04714709520339966, + 0.09523660503327847, + 0.19382299110293388, + 0.19843371771275997, + 0.0, + 0.8294550962746143, + 0.03768603503704071, + 0.2799663543701172, + 0.5742035247385502, + 0.07163437455892563, + 0.0, + 0.1907128170132637, + 0.0, + 0.026783861219882965, + 0.05213958024978638, + 0.0, + 0.044627584517002106, + 1.1774076968431473, + 0.3082701675593853, + 0.8572081662714481, + 0.10225213319063187, + 0.10162889584898949, + 0.19335394352674484, + 0.0, + 0.03398212045431137, + 0.18680774047970772, + 0.06258276104927063, + 0.0, + 0.0, + 0.653280284255743, + 0.19454757124185562, + 0.1721528358757496, + 0.0, + 0.2577161192893982, + 0.2643982693552971, + 0.17167529091238976, + 0.11211246252059937, + 0.6304838303476572, + 0.02908995933830738, + 0.0 + ], + "unique_experts": 46, + "load_cv": 1.1886708788840914, + "normalized_load_entropy": 0.8492230002345631, + "max_load_share": 0.10144927536231885 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "595435d9ec0c5e0754f8e5d35b55a800dff80b028144fd4f95f352826a9ab80d", + "route_weight_sha256": "36b6c446e05977aa10a74d2b403a5fad74e8b9126b8d5d189dfc2284f9664d0d", + "loads": [ + 8, + 1, + 7, + 11, + 0, + 1, + 2, + 6, + 1, + 5, + 8, + 2, + 3, + 10, + 0, + 10, + 3, + 6, + 3, + 5, + 4, + 2, + 4, + 6, + 7, + 11, + 11, + 6, + 4, + 8, + 1, + 2, + 15, + 1, + 0, + 2, + 0, + 1, + 5, + 0, + 9, + 8, + 7, + 7, + 1, + 6, + 2, + 0, + 1, + 6, + 3, + 0, + 2, + 14, + 4, + 8, + 0, + 4, + 6, + 2, + 1, + 7, + 8, + 0 + ], + "weighted_loads": [ + 0.31637470982968807, + 0.036176830530166626, + 0.3083461578935385, + 0.9985325634479523, + 0.0, + 0.0421474389731884, + 0.09607585519552231, + 0.39329487830400467, + 0.04024529829621315, + 0.18643975630402565, + 0.5219410993158817, + 0.07413110136985779, + 0.09820318780839443, + 0.7534857466816902, + 0.0, + 0.48340337723493576, + 0.49099065363407135, + 0.6297161504626274, + 0.3429256044328213, + 0.2832816168665886, + 0.3092808350920677, + 0.09478587284684181, + 0.30197570845484734, + 0.2697969637811184, + 0.5273636132478714, + 0.5206467527896166, + 0.840727187693119, + 0.3235596586018801, + 0.15893682092428207, + 0.8970952946692705, + 0.03768603503704071, + 0.2799663543701172, + 0.9232369307428598, + 0.07163437455892563, + 0.0, + 0.1907128170132637, + 0.0, + 0.026783861219882965, + 0.22249727696180344, + 0.0, + 1.0971219018101692, + 1.2760650757700205, + 0.5809771008789539, + 0.9133215937763453, + 0.10225213319063187, + 1.0750681422650814, + 0.19335394352674484, + 0.0, + 0.03398212045431137, + 0.22044441848993301, + 0.19571927934885025, + 0.0, + 0.13181230798363686, + 0.653280284255743, + 0.2376144528388977, + 0.5587192270904779, + 0.0, + 0.4277758467942476, + 0.2947466131299734, + 0.17167529091238976, + 0.11211246252059937, + 0.6712959613651037, + 0.5466329548507929, + 0.0 + ], + "unique_experts": 55, + "load_cv": 0.8249579113843054, + "normalized_load_entropy": 0.909275823791912, + "max_load_share": 0.052083333333333336 + } + }, + "s1_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "306cc5fd375ba5a078d6640c0006ce813bbf5416227acd2d19d69a7eadf7c86a", + "route_weight_sha256": "453a022356dc298cc9981a336eedd007bdde03430739e61f85da59ed1781d933", + "loads": [ + 2, + 0, + 1, + 4, + 0, + 1, + 0, + 6, + 1, + 0, + 1, + 1, + 0, + 3, + 0, + 7, + 3, + 1, + 0, + 4, + 1, + 1, + 3, + 0, + 1, + 3, + 3, + 3, + 0, + 6, + 2, + 2, + 8, + 1, + 1, + 2, + 1, + 1, + 1, + 0, + 0, + 6, + 5, + 5, + 1, + 2, + 2, + 0, + 1, + 3, + 2, + 0, + 0, + 13, + 3, + 3, + 0, + 1, + 6, + 3, + 1, + 6, + 0, + 0 + ], + "weighted_loads": [ + 0.08103665709495544, + 0.0, + 0.058052316308021545, + 0.4152164589613676, + 0.0, + 0.04748512804508209, + 0.0, + 0.41739098727703094, + 0.043028153479099274, + 0.0, + 0.04662420600652695, + 0.05303609371185303, + 0.0, + 0.185787258669734, + 0.0, + 0.3807529676705599, + 0.4752637669444084, + 0.02801164612174034, + 0.0, + 0.2480655312538147, + 0.052442822605371475, + 0.0436977781355381, + 0.24618881195783615, + 0.0, + 0.044473737478256226, + 0.10580234043300152, + 0.20045142620801926, + 0.2101594228297472, + 0.0, + 0.8340859115123749, + 0.06732150912284851, + 0.2680512070655823, + 0.5318824518471956, + 0.07420163601636887, + 0.04049115628004074, + 0.17848631739616394, + 0.033922649919986725, + 0.0275728777050972, + 0.05119358003139496, + 0.0, + 0.0, + 1.1594555974006653, + 0.4143790379166603, + 0.8647036664187908, + 0.10424580425024033, + 0.08970343694090843, + 0.18934492766857147, + 0.0, + 0.03719498589634895, + 0.140738382935524, + 0.09542340226471424, + 0.0, + 0.0, + 0.584701880812645, + 0.1976836770772934, + 0.1772145889699459, + 0.0, + 0.2443140745162964, + 0.30117601342499256, + 0.19801290519535542, + 0.11740107089281082, + 0.631420161575079, + 0.0, + 0.0 + ], + "unique_experts": 47, + "load_cv": 1.1336816989335916, + "normalized_load_entropy": 0.8585774676968683, + "max_load_share": 0.09420289855072464 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "5971c02b16a8106d7527b59642e7433e05b5bc20b48275410d9717975fff3a5a", + "route_weight_sha256": "d4adac0f3a120b52447f0fa1a90ffd5792cfd61883ae6a7edad194d42c110cff", + "loads": [ + 8, + 1, + 5, + 12, + 6, + 1, + 3, + 7, + 1, + 5, + 9, + 3, + 1, + 11, + 0, + 14, + 5, + 9, + 3, + 4, + 1, + 2, + 3, + 9, + 11, + 27, + 12, + 5, + 2, + 7, + 3, + 3, + 13, + 1, + 1, + 2, + 6, + 3, + 5, + 1, + 13, + 11, + 10, + 6, + 3, + 7, + 4, + 2, + 1, + 3, + 4, + 6, + 4, + 15, + 4, + 11, + 7, + 15, + 7, + 5, + 2, + 10, + 9, + 0 + ], + "weighted_loads": [ + 0.33496251329779625, + 0.04274054244160652, + 0.2087861467152834, + 1.142876861616969, + 0.3898263983428478, + 0.04748512804508209, + 0.11760191433131695, + 0.47401175647974014, + 0.043028153479099274, + 0.1587537806481123, + 0.6119215376675129, + 0.11945920065045357, + 0.04290030896663666, + 0.800892760977149, + 0.0, + 0.736459469422698, + 0.6437359880656004, + 0.6772671341896057, + 0.15275312960147858, + 0.2480655312538147, + 0.052442822605371475, + 0.12051867321133614, + 0.24618881195783615, + 0.6574930418282747, + 0.674831286072731, + 1.6432886496186256, + 0.9443090930581093, + 0.28659251146018505, + 0.06170803867280483, + 0.91358233243227, + 0.12824446335434914, + 0.3074837401509285, + 0.7427095491439104, + 0.07420163601636887, + 0.04049115628004074, + 0.17848631739616394, + 0.29405517503619194, + 0.10109686478972435, + 0.38918958604335785, + 0.03424076735973358, + 1.6219182796776295, + 1.4729002472013235, + 0.6525501720607281, + 0.8835354801267385, + 0.341874074190855, + 1.6010137014091015, + 0.40530070662498474, + 0.13240113854408264, + 0.03719498589634895, + 0.140738382935524, + 0.2948580849915743, + 0.2941805850714445, + 0.22424670308828354, + 0.6589916218072176, + 0.2870440408587456, + 0.7960820198059082, + 0.6188401989638805, + 1.0191211253404617, + 0.32559243589639664, + 0.2903298232704401, + 0.1530851610004902, + 0.8583646677434444, + 0.6808335538953543, + 0.0 + ], + "unique_experts": 62, + "load_cv": 0.8063334366818178, + "normalized_load_entropy": 0.9270678005327017, + "max_load_share": 0.0703125 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.9316770186335405, + "mean_token_weighted_tv": 0.01613210072821897, + "aggregate_load_tv": 0.04347826086956522 + }, + "system_bos": { + "tokens": 23, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.9161490683229813, + "mean_token_weighted_tv": 0.020328417460879555, + "aggregate_load_tv": 0.02898550724637681 + }, + "system_x": { + "tokens": 23, + "ordered_topk_exact_tokens": 7, + "set_exact_tokens": 13, + "mean_set_jaccard": 0.875776397515528, + "mean_token_weighted_tv": 0.02594997669043748, + "aggregate_load_tv": 0.057971014492753624 + }, + "system_period": { + "tokens": 23, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 12, + "mean_set_jaccard": 0.84472049689441, + "mean_token_weighted_tv": 0.031976543771831886, + "aggregate_load_tv": 0.07246376811594205 + }, + "bos_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 18, + "mean_set_jaccard": 0.9120082815734989, + "mean_token_weighted_tv": 0.02196502685546875, + "aggregate_load_tv": 0.05072463768115942 + }, + "bos_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 18, + "mean_set_jaccard": 0.9378881987577641, + "mean_token_weighted_tv": 0.021535801579770836, + "aggregate_load_tv": 0.028985507246376815 + }, + "x_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.865424430641822, + "mean_token_weighted_tv": 0.028146492357811203, + "aggregate_load_tv": 0.06521739130434782 + }, + "x_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 7, + "set_exact_tokens": 13, + "mean_set_jaccard": 0.8664596273291927, + "mean_token_weighted_tv": 0.031828317143346954, + "aggregate_load_tv": 0.06521739130434782 + }, + "period_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.8726708074534161, + "mean_token_weighted_tv": 0.027109032375333103, + "aggregate_load_tv": 0.06521739130434782 + }, + "period_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 6, + "set_exact_tokens": 12, + "mean_set_jaccard": 0.8540372670807453, + "mean_token_weighted_tv": 0.03405210813102515, + "aggregate_load_tv": 0.08695652173913043 + } + } + }, + "layer_18": { + "layer": 18, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "e2f9dff8099f106780190f5df5fc42abbbae90079ec7be24464a8e286055129f", + "route_weight_sha256": "202ba10c5ecfc33f3b7c407693e4d26244b45a06093e6028f0e017afe7ec501d", + "loads": [ + 0, + 2, + 4, + 1, + 0, + 6, + 1, + 0, + 2, + 0, + 0, + 6, + 0, + 1, + 0, + 5, + 3, + 0, + 4, + 0, + 1, + 0, + 1, + 4, + 6, + 1, + 2, + 1, + 2, + 1, + 0, + 2, + 2, + 2, + 3, + 0, + 7, + 3, + 9, + 2, + 0, + 0, + 0, + 0, + 3, + 0, + 0, + 12, + 3, + 6, + 0, + 3, + 2, + 0, + 2, + 1, + 10, + 3, + 1, + 0, + 0, + 2, + 5, + 1 + ], + "weighted_loads": [ + 0.0, + 0.18931473046541214, + 0.18718544766306877, + 0.04948309808969498, + 0.0, + 0.3053148929029703, + 0.035403795540332794, + 0.0, + 0.0896066464483738, + 0.0, + 0.0, + 0.30135994032025337, + 0.0, + 0.05996865779161453, + 0.0, + 0.20338977873325348, + 0.1922219842672348, + 0.0, + 0.214110616594553, + 0.0, + 0.06300473213195801, + 0.0, + 0.14301343262195587, + 0.14885175228118896, + 0.3375346250832081, + 0.048873260617256165, + 0.10531070083379745, + 0.04943189397454262, + 0.06827371008694172, + 0.03711475059390068, + 0.0, + 0.2644459679722786, + 0.06947567872703075, + 0.08926268666982651, + 0.1243441216647625, + 0.0, + 0.8554782513529062, + 0.24481602013111115, + 0.35416674986481667, + 0.15567535907030106, + 0.0, + 0.0, + 0.0, + 0.0, + 0.2710447162389755, + 0.0, + 0.0, + 0.9677658826112747, + 0.15990644320845604, + 0.46306670270860195, + 0.0, + 0.17843395099043846, + 0.43608327955007553, + 0.0, + 0.08821165934205055, + 0.11306388676166534, + 1.460801538079977, + 0.19253197312355042, + 0.03406916558742523, + 0.0, + 0.0, + 0.09760626405477524, + 0.3075050450861454, + 0.03531022369861603 + ], + "unique_experts": 42, + "load_cv": 1.2110774849893724, + "normalized_load_entropy": 0.8357658709289254, + "max_load_share": 0.08695652173913043 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "c52b8ec1ca662294113114ce5d32b235cf280e737264138e0db8c34c103b8d98", + "route_weight_sha256": "e6c2eb3a17c32f87e3f4ecef58325f8f5ed47c4c124793d64093de346098ba40", + "loads": [ + 6, + 3, + 17, + 1, + 0, + 8, + 1, + 0, + 12, + 0, + 1, + 10, + 1, + 1, + 5, + 9, + 3, + 0, + 24, + 0, + 1, + 2, + 1, + 4, + 6, + 1, + 2, + 1, + 2, + 1, + 9, + 2, + 2, + 2, + 3, + 3, + 8, + 7, + 9, + 4, + 5, + 0, + 3, + 0, + 3, + 0, + 8, + 12, + 6, + 19, + 2, + 5, + 11, + 6, + 2, + 1, + 12, + 3, + 2, + 4, + 0, + 4, + 5, + 3 + ], + "weighted_loads": [ + 0.39627138897776604, + 0.25978071242570877, + 1.2455223519355059, + 0.04948309808969498, + 0.0, + 0.3519936930388212, + 0.035403795540332794, + 0.0, + 0.7575592203065753, + 0.0, + 0.010918200016021729, + 0.686979878693819, + 0.038348786532878876, + 0.05996865779161453, + 0.967822315171361, + 0.3421816024929285, + 0.1922219842672348, + 0.0, + 2.260204590857029, + 0.0, + 0.06300473213195801, + 0.054220255464315414, + 0.14301343262195587, + 0.14885175228118896, + 0.3375346250832081, + 0.048873260617256165, + 0.10531070083379745, + 0.04943189397454262, + 0.06827371008694172, + 0.03711475059390068, + 0.5385332070291042, + 0.2644459679722786, + 0.06947567872703075, + 0.08926268666982651, + 0.1243441216647625, + 0.22309109941124916, + 0.8790362123399973, + 0.3738843258470297, + 0.35416674986481667, + 0.2032089550048113, + 0.2439715974032879, + 0.0, + 0.08838794194161892, + 0.0, + 0.2710447162389755, + 0.0, + 1.414758712053299, + 0.9677658826112747, + 0.3160892240703106, + 1.0462905205786228, + 0.06060677953064442, + 0.30599187687039375, + 1.047168092802167, + 0.39897262677550316, + 0.08821165934205055, + 0.11306388676166534, + 2.458721052855253, + 0.19253197312355042, + 0.06333214230835438, + 0.16851376742124557, + 0.0, + 0.151869036257267, + 0.3075050450861454, + 0.1258975975215435 + ], + "unique_experts": 55, + "load_cv": 1.0736748938937604, + "normalized_load_entropy": 0.8788274937128706, + "max_load_share": 0.08333333333333333 + } + }, + "s1_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "c826d85c743ba54c84e0e797975fc3cf64f75ec3aac03a42e2a74471e34d6186", + "route_weight_sha256": "7a2b5795573e15a89870344c2e3a44d5bbe811c27e1f50414c4645186073d065", + "loads": [ + 0, + 2, + 5, + 1, + 0, + 6, + 1, + 0, + 2, + 0, + 0, + 6, + 0, + 1, + 0, + 5, + 3, + 0, + 4, + 0, + 1, + 0, + 1, + 4, + 6, + 1, + 2, + 1, + 2, + 1, + 0, + 2, + 2, + 2, + 3, + 0, + 7, + 3, + 8, + 2, + 0, + 0, + 0, + 0, + 4, + 0, + 0, + 13, + 3, + 6, + 0, + 3, + 2, + 0, + 2, + 1, + 9, + 3, + 1, + 0, + 0, + 1, + 5, + 1 + ], + "weighted_loads": [ + 0.0, + 0.18570080026984215, + 0.21928671188652515, + 0.04545605182647705, + 0.0, + 0.30527093075215816, + 0.044604040682315826, + 0.0, + 0.11033374071121216, + 0.0, + 0.0, + 0.3015841692686081, + 0.0, + 0.0720490887761116, + 0.0, + 0.20140889659523964, + 0.1972413957118988, + 0.0, + 0.21565696224570274, + 0.0, + 0.06180841475725174, + 0.0, + 0.14121535420417786, + 0.1540406160056591, + 0.3231845609843731, + 0.052499812096357346, + 0.10728815943002701, + 0.045970331877470016, + 0.06947829946875572, + 0.04194492846727371, + 0.0, + 0.2686546817421913, + 0.07197507098317146, + 0.08535363152623177, + 0.12711522355675697, + 0.0, + 0.8538574054837227, + 0.25632064789533615, + 0.3185457196086645, + 0.15043756738305092, + 0.0, + 0.0, + 0.0, + 0.0, + 0.2926757298409939, + 0.0, + 0.0, + 1.013890603557229, + 0.15709399804472923, + 0.473588265478611, + 0.0, + 0.17948449403047562, + 0.42417895048856735, + 0.0, + 0.09364832937717438, + 0.11283794045448303, + 1.3804634287953377, + 0.18832309544086456, + 0.033462777733802795, + 0.0, + 0.0, + 0.06233697757124901, + 0.3162642791867256, + 0.0362866185605526 + ], + "unique_experts": 42, + "load_cv": 1.2138492293900511, + "normalized_load_entropy": 0.8348943270272586, + "max_load_share": 0.09420289855072464 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "9e5c8fc3d8b3930235c6fcf1f47b7bdb0cdfd7511d0718fd5b201ae7e412f3bc", + "route_weight_sha256": "970a0c85797957a3b7c1138e96e3ca3d7a2868d7384a2685b6beae9083846adb", + "loads": [ + 7, + 5, + 19, + 1, + 1, + 8, + 2, + 2, + 14, + 2, + 1, + 10, + 0, + 2, + 9, + 6, + 3, + 9, + 29, + 1, + 1, + 2, + 2, + 4, + 6, + 1, + 2, + 1, + 2, + 2, + 12, + 4, + 3, + 3, + 7, + 15, + 8, + 10, + 9, + 4, + 5, + 0, + 3, + 5, + 4, + 0, + 18, + 17, + 6, + 20, + 1, + 5, + 11, + 12, + 4, + 2, + 12, + 8, + 3, + 4, + 0, + 3, + 5, + 7 + ], + "weighted_loads": [ + 0.4013539329171181, + 0.3223343789577484, + 1.324630944058299, + 0.04545605182647705, + 0.03797187656164169, + 0.36434460431337357, + 0.07440415024757385, + 0.0690049771219492, + 1.1486190799623728, + 0.06248409114778042, + 0.011800280772149563, + 0.6439975239336491, + 0.0, + 0.11672748997807503, + 1.1653431486338377, + 0.23284737393260002, + 0.1972413957118988, + 0.5626588333398104, + 3.0008349493145943, + 0.13675355911254883, + 0.06180841475725174, + 0.05792212672531605, + 0.17500202730298042, + 0.1540406160056591, + 0.3231845609843731, + 0.052499812096357346, + 0.10728815943002701, + 0.045970331877470016, + 0.06947829946875572, + 0.07809950038790703, + 0.7667614547535777, + 0.5133610740303993, + 0.12875211983919144, + 0.16171079501509666, + 0.5502301044762135, + 1.4464599899947643, + 0.8773184586316347, + 0.5401082579046488, + 0.35531858913600445, + 0.19823934510350227, + 0.20423413254320621, + 0.0, + 0.08977942913770676, + 0.4530245140194893, + 0.2926757298409939, + 0.0, + 2.642848175019026, + 1.1902183163911104, + 0.25225965306162834, + 1.0896529834717512, + 0.026268912479281425, + 0.3133495822548866, + 1.0106432493776083, + 0.6256120465695858, + 0.21094254404306412, + 0.14830126240849495, + 2.391955528408289, + 0.4261242039501667, + 0.36795083433389664, + 0.27147885225713253, + 0.0, + 0.12649961560964584, + 0.3162642791867256, + 0.26691190898418427 + ], + "unique_experts": 60, + "load_cv": 0.9542485408832322, + "normalized_load_entropy": 0.9031870139174828, + "max_load_share": 0.07552083333333333 + } + }, + "s0_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "be8bbfcbbb5f8d38b2b539c5cbbfbee124cad2d1d1b7a7ff8bbde11e1acdf2ec", + "route_weight_sha256": "f25a039254c6fc1c31a7e83dc16778f99074a9f3456dc7b583d4a0002a47d44b", + "loads": [ + 0, + 2, + 5, + 1, + 0, + 6, + 1, + 0, + 3, + 0, + 1, + 6, + 0, + 1, + 0, + 5, + 3, + 0, + 4, + 0, + 1, + 0, + 1, + 4, + 6, + 1, + 2, + 2, + 2, + 1, + 0, + 2, + 2, + 2, + 2, + 0, + 7, + 3, + 9, + 3, + 0, + 1, + 0, + 0, + 3, + 0, + 0, + 11, + 3, + 6, + 0, + 3, + 2, + 0, + 2, + 1, + 9, + 2, + 0, + 0, + 0, + 1, + 5, + 1 + ], + "weighted_loads": [ + 0.0, + 0.18829265236854553, + 0.21518870629370213, + 0.04761301353573799, + 0.0, + 0.31054936721920967, + 0.036956168711185455, + 0.0, + 0.1493752207607031, + 0.0, + 0.035513442009687424, + 0.31432973593473434, + 0.0, + 0.062372274696826935, + 0.0, + 0.20110520720481873, + 0.19406875781714916, + 0.0, + 0.21731772273778915, + 0.0, + 0.06494829803705215, + 0.0, + 0.1385611742734909, + 0.1664639189839363, + 0.31095803529024124, + 0.04990541189908981, + 0.10680024698376656, + 0.07936098799109459, + 0.07573693618178368, + 0.035479482263326645, + 0.0, + 0.2784145474433899, + 0.06933228485286236, + 0.09039108827710152, + 0.0929696075618267, + 0.0, + 0.8601079136133194, + 0.24241743609309196, + 0.3410406708717346, + 0.20812258124351501, + 0.0, + 0.038289424031972885, + 0.0, + 0.0, + 0.2696252465248108, + 0.0, + 0.0, + 0.9405510760843754, + 0.1678324118256569, + 0.48052215203642845, + 0.0, + 0.18119579553604126, + 0.4351927489042282, + 0.0, + 0.09060324728488922, + 0.11521297693252563, + 1.4337806515395641, + 0.1564680151641369, + 0.0, + 0.0, + 0.0, + 0.059648506343364716, + 0.3073345758020878, + 0.04149002209305763 + ], + "unique_experts": 43, + "load_cv": 1.1658337111123411, + "normalized_load_entropy": 0.8430679454036833, + "max_load_share": 0.07971014492753623 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "e4d741888e67314c76bdd29578d1268ffa227f2dae83226acd2a2af8c47fc562", + "route_weight_sha256": "cc3c29fb67ab2b0ecc58627eb6d62ee98794b5f5f041d34e0768244a0a730a78", + "loads": [ + 6, + 3, + 16, + 1, + 0, + 8, + 1, + 0, + 12, + 0, + 1, + 10, + 2, + 1, + 5, + 8, + 3, + 0, + 24, + 0, + 1, + 2, + 1, + 5, + 6, + 1, + 2, + 2, + 2, + 1, + 7, + 2, + 2, + 3, + 2, + 3, + 7, + 7, + 9, + 7, + 6, + 2, + 4, + 0, + 3, + 0, + 9, + 11, + 6, + 18, + 2, + 5, + 11, + 6, + 2, + 1, + 10, + 3, + 1, + 3, + 0, + 4, + 5, + 3 + ], + "weighted_loads": [ + 0.39627138897776604, + 0.25875863432884216, + 1.2227104660123587, + 0.04761301353573799, + 0.0, + 0.3572281673550606, + 0.036956168711185455, + 0.0, + 0.7938728872686625, + 0.0, + 0.035513442009687424, + 0.6156563609838486, + 0.2603631690144539, + 0.062372274696826935, + 0.7634732965379953, + 0.30160837434232235, + 0.19406875781714916, + 0.0, + 2.060129089280963, + 0.0, + 0.06494829803705215, + 0.04980497807264328, + 0.1385611742734909, + 0.2131635844707489, + 0.31095803529024124, + 0.04990541189908981, + 0.10680024698376656, + 0.07936098799109459, + 0.07573693618178368, + 0.035479482263326645, + 0.5131401903927326, + 0.2784145474433899, + 0.06933228485286236, + 0.15607668086886406, + 0.0929696075618267, + 0.32969946414232254, + 0.8601079136133194, + 0.3761956561356783, + 0.3410406708717346, + 0.40794513933360577, + 0.3556976392865181, + 0.10241459682583809, + 0.15348023734986782, + 0.0, + 0.2696252465248108, + 0.0, + 1.369630727916956, + 0.9405510760843754, + 0.32401519268751144, + 1.0101493913680315, + 0.06086249090731144, + 0.31639086827635765, + 1.0462775621563196, + 0.3685132507234812, + 0.09060324728488922, + 0.11521297693252563, + 1.656772430986166, + 0.17295789159834385, + 0.029262976720929146, + 0.1251868288964033, + 0.0, + 0.13884199410676956, + 0.3073345758020878, + 0.1320773959159851 + ], + "unique_experts": 56, + "load_cv": 1.028153084628986, + "normalized_load_entropy": 0.8880693970343929, + "max_load_share": 0.08333333333333333 + } + }, + "s1_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "657b06c4410f646199e4a53caa78fb4bc1a72c98b933061991cb1474a01a10a7", + "route_weight_sha256": "b8de501234b0dd254c35fd771d3faf3f95e8cf851ae14739094c9fd9b37bcd3b", + "loads": [ + 0, + 2, + 4, + 1, + 0, + 6, + 1, + 0, + 3, + 0, + 2, + 6, + 0, + 1, + 0, + 5, + 2, + 0, + 4, + 0, + 1, + 0, + 1, + 4, + 6, + 1, + 2, + 2, + 2, + 1, + 0, + 2, + 2, + 2, + 3, + 1, + 7, + 3, + 8, + 3, + 0, + 1, + 0, + 0, + 3, + 0, + 0, + 11, + 2, + 5, + 0, + 3, + 2, + 0, + 2, + 1, + 10, + 2, + 0, + 0, + 0, + 2, + 5, + 1 + ], + "weighted_loads": [ + 0.0, + 0.1839185580611229, + 0.18677789345383644, + 0.04950675368309021, + 0.0, + 0.28737805411219597, + 0.04134728014469147, + 0.0, + 0.16095933876931667, + 0.0, + 0.08079368248581886, + 0.30469535663723946, + 0.0, + 0.06722944974899292, + 0.0, + 0.20053252205252647, + 0.17263757437467575, + 0.0, + 0.202419713139534, + 0.0, + 0.06354221701622009, + 0.0, + 0.13950367271900177, + 0.15884189307689667, + 0.3390660062432289, + 0.04735221341252327, + 0.10685978457331657, + 0.07715706527233124, + 0.07171179540455341, + 0.039846330881118774, + 0.0, + 0.28347616642713547, + 0.06948387622833252, + 0.08640757948160172, + 0.11238591931760311, + 0.02805168367922306, + 0.8653615824878216, + 0.24231579527258873, + 0.3060024995356798, + 0.2335439994931221, + 0.0, + 0.03528494015336037, + 0.0, + 0.0, + 0.28936509042978287, + 0.0, + 0.0, + 0.9388619847595692, + 0.12113796919584274, + 0.4442993700504303, + 0.0, + 0.17870229855179787, + 0.4191982001066208, + 0.0, + 0.09447335824370384, + 0.11535192281007767, + 1.4843205995857716, + 0.16981425508856773, + 0.0, + 0.0, + 0.0, + 0.09386907704174519, + 0.314022421836853, + 0.03474930301308632 + ], + "unique_experts": 44, + "load_cv": 1.14254016368129, + "normalized_load_entropy": 0.8504399642244301, + "max_load_share": 0.07971014492753623 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "266f4d67e6a4196326868a3e93f7cefb7a3b00f0b32bcd18dcc33ec7fa31d0d8", + "route_weight_sha256": "2441f1093f1ea1d03770c9f5a0565464f8b68d5672ee12e14b293ae0d85795c0", + "loads": [ + 7, + 5, + 15, + 1, + 1, + 9, + 2, + 2, + 14, + 2, + 2, + 10, + 0, + 2, + 9, + 7, + 2, + 9, + 29, + 1, + 1, + 2, + 2, + 4, + 6, + 1, + 2, + 2, + 2, + 2, + 11, + 4, + 3, + 3, + 7, + 15, + 7, + 10, + 9, + 5, + 6, + 2, + 4, + 5, + 3, + 0, + 19, + 15, + 5, + 19, + 1, + 5, + 11, + 11, + 4, + 2, + 12, + 8, + 2, + 5, + 0, + 6, + 5, + 7 + ], + "weighted_loads": [ + 0.4013539329171181, + 0.32055213674902916, + 1.2078807279467583, + 0.04950675368309021, + 0.03797187656164169, + 0.3704999163746834, + 0.0711473897099495, + 0.0690049771219492, + 1.1707169730216265, + 0.06248409114778042, + 0.08079368248581886, + 0.6459012441337109, + 0.0, + 0.11190785095095634, + 1.1424298118799925, + 0.26508647203445435, + 0.17263757437467575, + 0.5626588333398104, + 2.6906957421451807, + 0.13675355911254883, + 0.06354221701622009, + 0.05920636095106602, + 0.17329034581780434, + 0.15884189307689667, + 0.3390660062432289, + 0.04735221341252327, + 0.10685978457331657, + 0.07715706527233124, + 0.07171179540455341, + 0.07600090280175209, + 0.799887876957655, + 0.5281825587153435, + 0.1262609250843525, + 0.1627647429704666, + 0.5355008002370596, + 1.491926459595561, + 0.8653615824878216, + 0.54027009755373, + 0.34277536906301975, + 0.28134577721357346, + 0.26888849027454853, + 0.08129633963108063, + 0.1451907642185688, + 0.4530245140194893, + 0.28936509042978287, + 0.0, + 2.634380053728819, + 1.1151896975934505, + 0.21630362421274185, + 1.0680261868983507, + 0.026268912479281425, + 0.32221533730626106, + 1.0056624989956617, + 0.5823108162730932, + 0.21176757290959358, + 0.15081524476408958, + 1.7445489019155502, + 0.43512118235230446, + 0.33448805660009384, + 0.3770766630768776, + 0.0, + 0.22527899779379368, + 0.314022421836853, + 0.265374593436718 + ], + "unique_experts": 61, + "load_cv": 0.9104905576421732, + "normalized_load_entropy": 0.9119593366798081, + "max_load_share": 0.07552083333333333 + } + }, + "s0_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "aa9e2ef12505b0378abff3182d9d10cfcf680e8dcf6ba94f1af1dbd3a98868c7", + "route_weight_sha256": "83c8bfd85e615c8c4b97c5b8d8fdafab1fc10ec4720a326aaa2139c86dba2237", + "loads": [ + 0, + 2, + 4, + 1, + 0, + 6, + 1, + 0, + 2, + 0, + 1, + 6, + 0, + 1, + 0, + 4, + 3, + 0, + 4, + 0, + 1, + 0, + 1, + 4, + 6, + 1, + 2, + 1, + 2, + 1, + 0, + 2, + 2, + 2, + 3, + 0, + 8, + 3, + 10, + 2, + 0, + 1, + 0, + 0, + 3, + 0, + 0, + 12, + 3, + 6, + 0, + 3, + 2, + 0, + 2, + 1, + 10, + 2, + 0, + 0, + 0, + 1, + 5, + 1 + ], + "weighted_loads": [ + 0.0, + 0.1941908858716488, + 0.18167166784405708, + 0.05344107374548912, + 0.0, + 0.31204284355044365, + 0.040778789669275284, + 0.0, + 0.10544276051223278, + 0.0, + 0.034733764827251434, + 0.2974875941872597, + 0.0, + 0.05995649844408035, + 0.0, + 0.16606184840202332, + 0.19146472588181496, + 0.0, + 0.20970327779650688, + 0.0, + 0.06071804091334343, + 0.0, + 0.14631476998329163, + 0.16840778291225433, + 0.31663357838988304, + 0.04419486224651337, + 0.10503451526165009, + 0.05189178138971329, + 0.07830961048603058, + 0.038082145154476166, + 0.0, + 0.2772854119539261, + 0.07149813883006573, + 0.08976161479949951, + 0.12574221566319466, + 0.0, + 0.9007149431854486, + 0.21082156524062157, + 0.4193287789821625, + 0.16536888107657433, + 0.0, + 0.038291119039058685, + 0.0, + 0.0, + 0.26217738538980484, + 0.0, + 0.0, + 0.9770235307514668, + 0.16637414321303368, + 0.4792379215359688, + 0.0, + 0.1803862638771534, + 0.40263867378234863, + 0.0, + 0.08141649514436722, + 0.11346010863780975, + 1.4401722513139248, + 0.1636187732219696, + 0.0, + 0.0, + 0.0, + 0.06484494358301163, + 0.31973548606038094, + 0.04368017613887787 + ], + "unique_experts": 43, + "load_cv": 1.2357994044471483, + "normalized_load_entropy": 0.8349519294978998, + "max_load_share": 0.08695652173913043 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "a82cec396c6d42e0219ea6ea8241662e4342ed1ecaa0e35bfccecd979af0078e", + "route_weight_sha256": "7b6419d2b6bd30c0e401f389fbb555127428f8bcc099715eb342367cb28aabc5", + "loads": [ + 7, + 3, + 16, + 1, + 0, + 8, + 1, + 0, + 12, + 0, + 1, + 10, + 1, + 1, + 5, + 7, + 3, + 0, + 24, + 0, + 1, + 1, + 1, + 4, + 6, + 1, + 2, + 1, + 2, + 1, + 8, + 2, + 2, + 3, + 3, + 3, + 8, + 7, + 10, + 4, + 6, + 1, + 2, + 0, + 3, + 0, + 8, + 12, + 7, + 19, + 1, + 6, + 12, + 7, + 2, + 1, + 11, + 2, + 3, + 2, + 0, + 4, + 5, + 4 + ], + "weighted_loads": [ + 0.4381079040467739, + 0.2646568678319454, + 1.362285241484642, + 0.05344107374548912, + 0.0, + 0.35872164368629456, + 0.040778789669275284, + 0.0, + 0.7695940993726254, + 0.0, + 0.034733764827251434, + 0.684352420270443, + 0.04698100686073303, + 0.05995649844408035, + 0.8888268638402224, + 0.26656501553952694, + 0.19146472588181496, + 0.0, + 2.093496209010482, + 0.0, + 0.06071804091334343, + 0.025044217705726624, + 0.14631476998329163, + 0.16840778291225433, + 0.31663357838988304, + 0.04419486224651337, + 0.10503451526165009, + 0.05189178138971329, + 0.07830961048603058, + 0.038082145154476166, + 0.5341867431998253, + 0.2772854119539261, + 0.07149813883006573, + 0.1350930891931057, + 0.12574221566319466, + 0.294597290456295, + 0.9007149431854486, + 0.3396838530898094, + 0.4193287789821625, + 0.21290247701108456, + 0.2787079084664583, + 0.038291119039058685, + 0.05542021803557873, + 0.0, + 0.26217738538980484, + 0.0, + 1.402755118906498, + 0.9770235307514668, + 0.3623087964951992, + 1.0475279744714499, + 0.02641894854605198, + 0.3540731593966484, + 1.11113010533154, + 0.39887358993291855, + 0.08141649514436722, + 0.11346010863780975, + 1.6631640307605267, + 0.1636187732219696, + 0.13119676150381565, + 0.06260789558291435, + 0.0, + 0.14364430494606495, + 0.31973548606038094, + 0.2147519700229168 + ], + "unique_experts": 56, + "load_cv": 1.0693542530511198, + "normalized_load_entropy": 0.8792520122482155, + "max_load_share": 0.08333333333333333 + } + }, + "s1_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "f5e00cef4bf3fe4efeeff7fc2d79944233e0a888826ae08cef95de5fc3f1440d", + "route_weight_sha256": "0dce0ad0a6c736a78a19e05921925806d83bc2ac7e103810c2beaccd0f63ee90", + "loads": [ + 0, + 2, + 5, + 1, + 0, + 7, + 1, + 0, + 4, + 0, + 1, + 6, + 0, + 1, + 0, + 4, + 3, + 0, + 3, + 0, + 1, + 0, + 1, + 2, + 4, + 1, + 2, + 2, + 2, + 1, + 0, + 2, + 2, + 2, + 4, + 0, + 7, + 3, + 11, + 3, + 0, + 0, + 0, + 0, + 4, + 0, + 1, + 11, + 2, + 5, + 0, + 3, + 2, + 0, + 2, + 1, + 9, + 2, + 0, + 0, + 0, + 2, + 5, + 1 + ], + "weighted_loads": [ + 0.0, + 0.20429492741823196, + 0.21019571460783482, + 0.05085717886686325, + 0.0, + 0.32492589578032494, + 0.04554209113121033, + 0.0, + 0.1646112371236086, + 0.0, + 0.0358421616256237, + 0.29615478590130806, + 0.0, + 0.060171302407979965, + 0.0, + 0.15136895515024662, + 0.20310602337121964, + 0.0, + 0.14407439157366753, + 0.0, + 0.06520208716392517, + 0.0, + 0.13888007402420044, + 0.08436278998851776, + 0.2604390010237694, + 0.04040372371673584, + 0.0996594950556755, + 0.0952465869486332, + 0.07159411534667015, + 0.04598693922162056, + 0.0, + 0.27212971448898315, + 0.07225396856665611, + 0.08473847806453705, + 0.17032169364392757, + 0.0, + 0.8604487627744675, + 0.20402373746037483, + 0.46842854283750057, + 0.208537757396698, + 0.0, + 0.0, + 0.0, + 0.0, + 0.28509237989783287, + 0.0, + 0.034400444477796555, + 0.9697786793112755, + 0.11642995104193687, + 0.4485413171350956, + 0.0, + 0.17117251455783844, + 0.3688190057873726, + 0.0, + 0.08569524437189102, + 0.12309829145669937, + 1.3741096667945385, + 0.1956685297191143, + 0.0, + 0.0, + 0.0, + 0.10368390381336212, + 0.32320069894194603, + 0.038390468806028366 + ], + "unique_experts": 43, + "load_cv": 1.1914947483517149, + "normalized_load_entropy": 0.8416949898129529, + "max_load_share": 0.07971014492753623 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "3640c5711f967b24614ccf90356bda2f36ecc0b78a6868f5c66dd1f92a1eeda6", + "route_weight_sha256": "797e83aac72e41965730592e84b97a26a9d86275123797aaee784b5f95443354", + "loads": [ + 9, + 5, + 18, + 1, + 1, + 9, + 2, + 2, + 17, + 2, + 1, + 10, + 1, + 2, + 9, + 5, + 3, + 9, + 29, + 1, + 1, + 1, + 2, + 2, + 4, + 1, + 2, + 2, + 2, + 2, + 10, + 4, + 3, + 3, + 8, + 13, + 7, + 9, + 12, + 6, + 5, + 0, + 2, + 6, + 4, + 0, + 19, + 15, + 6, + 18, + 1, + 7, + 12, + 12, + 4, + 2, + 11, + 8, + 2, + 3, + 0, + 4, + 5, + 8 + ], + "weighted_loads": [ + 0.5864497944712639, + 0.34092850610613823, + 1.3878033962100744, + 0.05085717886686325, + 0.03797187656164169, + 0.38399956934154034, + 0.07534220069646835, + 0.0690049771219492, + 1.2377163488417864, + 0.06248409114778042, + 0.0358421616256237, + 0.5926602520048618, + 0.04083758965134621, + 0.10484970360994339, + 1.0216249953955412, + 0.182807432487607, + 0.20310602337121964, + 0.5626588333398104, + 2.4572478476911783, + 0.13675355911254883, + 0.06520208716392517, + 0.02687290869653225, + 0.172666747123003, + 0.08436278998851776, + 0.2604390010237694, + 0.04040372371673584, + 0.0996594950556755, + 0.0952465869486332, + 0.07159411534667015, + 0.08214151114225388, + 0.6794429738074541, + 0.5168361067771912, + 0.1290310174226761, + 0.16109564155340195, + 0.5934365745633841, + 1.3028768710792065, + 0.8604487627744675, + 0.4555956516414881, + 0.5052014123648405, + 0.29078587144613266, + 0.1811686884611845, + 0.0, + 0.05345485731959343, + 0.5135929509997368, + 0.28509237989783287, + 0.0, + 2.6019075885415077, + 1.1461063921451569, + 0.2490001991391182, + 1.024525111541152, + 0.026268912479281425, + 0.43034491315484047, + 1.0344542395323515, + 0.6136071477085352, + 0.20298945903778076, + 0.1585616134107113, + 1.6343379691243172, + 0.46328282728791237, + 0.33448805660009384, + 0.2176125831902027, + 0.0, + 0.16784654185175896, + 0.32320069894194603, + 0.33227457851171494 + ], + "unique_experts": 61, + "load_cv": 0.9460260449785607, + "normalized_load_entropy": 0.9041806833410782, + "max_load_share": 0.07552083333333333 + } + }, + "s0_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "6142f215be62db781c4c637aff298ef349d079024aaa896cedd137d8b04008e0", + "route_weight_sha256": "f78892c8de4256faaa1dfd3432a4b25e203ce2d667fc0bd0de4992ea0d84957b", + "loads": [ + 0, + 2, + 4, + 1, + 0, + 6, + 1, + 0, + 2, + 0, + 0, + 6, + 0, + 1, + 0, + 4, + 3, + 0, + 4, + 0, + 1, + 0, + 1, + 4, + 6, + 1, + 2, + 2, + 2, + 1, + 0, + 2, + 2, + 2, + 2, + 0, + 8, + 3, + 11, + 3, + 0, + 1, + 0, + 0, + 3, + 0, + 0, + 12, + 2, + 6, + 0, + 3, + 2, + 0, + 2, + 1, + 10, + 2, + 1, + 0, + 0, + 1, + 4, + 1 + ], + "weighted_loads": [ + 0.0, + 0.19396911934018135, + 0.17672280594706535, + 0.05396004021167755, + 0.0, + 0.30912503972649574, + 0.03626549243927002, + 0.0, + 0.08725811913609505, + 0.0, + 0.0, + 0.3013699669390917, + 0.0, + 0.059290479868650436, + 0.0, + 0.16629492118954659, + 0.19269873946905136, + 0.0, + 0.19605649262666702, + 0.0, + 0.061416029930114746, + 0.0, + 0.14542356133460999, + 0.16843389719724655, + 0.3181569315493107, + 0.043583936989307404, + 0.10961927473545074, + 0.08091762289404869, + 0.07377849891781807, + 0.03846629336476326, + 0.0, + 0.27911853790283203, + 0.06684276834130287, + 0.08780563250184059, + 0.09619326703250408, + 0.0, + 0.8976964484900236, + 0.2286408692598343, + 0.4764944948256016, + 0.18832843378186226, + 0.0, + 0.04070056229829788, + 0.0, + 0.0, + 0.26458901166915894, + 0.0, + 0.0, + 0.9845471866428852, + 0.12638986855745316, + 0.47463916800916195, + 0.0, + 0.17817064374685287, + 0.4098197668790817, + 0.0, + 0.0862385593354702, + 0.11836602538824081, + 1.4188123606145382, + 0.1634252406656742, + 0.0349436029791832, + 0.0, + 0.0, + 0.06298107653856277, + 0.27411696687340736, + 0.038925353437662125 + ], + "unique_experts": 43, + "load_cv": 1.2493224376617578, + "normalized_load_entropy": 0.8343843704646432, + "max_load_share": 0.08695652173913043 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "996db756c24241567b50fb1ab7c3debb7739cebadcbd0740b61a2211f133029e", + "route_weight_sha256": "b1af9a060ab700d4cbfb98c84b78bfea0ea50d03fe578ff034ef2e9d52d9a04d", + "loads": [ + 7, + 3, + 16, + 1, + 0, + 8, + 1, + 0, + 11, + 0, + 0, + 10, + 0, + 1, + 5, + 8, + 3, + 0, + 25, + 0, + 1, + 2, + 1, + 4, + 6, + 1, + 2, + 2, + 2, + 1, + 7, + 3, + 2, + 3, + 2, + 2, + 8, + 7, + 11, + 5, + 6, + 1, + 2, + 0, + 3, + 0, + 9, + 12, + 5, + 19, + 2, + 5, + 12, + 9, + 2, + 1, + 11, + 3, + 3, + 2, + 0, + 3, + 4, + 3 + ], + "weighted_loads": [ + 0.4446832910180092, + 0.264435101300478, + 1.2068425435572863, + 0.05396004021167755, + 0.0, + 0.35580383986234665, + 0.03626549243927002, + 0.0, + 0.7404060587286949, + 0.0, + 0.0, + 0.6482168901711702, + 0.0, + 0.059290479868650436, + 1.0165022630244493, + 0.3096971157938242, + 0.19269873946905136, + 0.0, + 2.1806850731372833, + 0.0, + 0.061416029930114746, + 0.05787332355976105, + 0.14542356133460999, + 0.16843389719724655, + 0.3181569315493107, + 0.043583936989307404, + 0.10961927473545074, + 0.08091762289404869, + 0.07377849891781807, + 0.03846629336476326, + 0.5028203167021275, + 0.3091272097080946, + 0.06684276834130287, + 0.12678108364343643, + 0.09619326703250408, + 0.235987838357687, + 0.8976964484900236, + 0.3518873006105423, + 0.4764944948256016, + 0.2358620297163725, + 0.2850898802280426, + 0.04070056229829788, + 0.05542021803557873, + 0.0, + 0.26458901166915894, + 0.0, + 1.6174041777849197, + 0.9845471866428852, + 0.2825726494193077, + 1.048334613442421, + 0.06105103902518749, + 0.3146207481622696, + 1.083382474258542, + 0.4821711238473654, + 0.0862385593354702, + 0.11836602538824081, + 1.64180414006114, + 0.21302546933293343, + 0.10544340126216412, + 0.05532929114997387, + 0.0, + 0.11724384874105453, + 0.27411696687340736, + 0.1295127272605896 + ], + "unique_experts": 54, + "load_cv": 1.0886621079036347, + "normalized_load_entropy": 0.8752584176616516, + "max_load_share": 0.08680555555555555 + } + }, + "s1_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "4875489fefbb613f68417ee24bf9caec5df902b43d8c0439b09c7459f89ea3c4", + "route_weight_sha256": "5f3025992ac432255c1e7115edc97ffe5582a1dd2c6bafac44b4438c832b7ac7", + "loads": [ + 0, + 2, + 4, + 1, + 0, + 7, + 1, + 0, + 1, + 0, + 1, + 6, + 1, + 1, + 0, + 4, + 2, + 0, + 3, + 0, + 1, + 0, + 1, + 3, + 4, + 1, + 2, + 2, + 2, + 1, + 0, + 2, + 2, + 2, + 3, + 1, + 8, + 2, + 13, + 3, + 0, + 1, + 0, + 0, + 4, + 0, + 1, + 11, + 2, + 5, + 0, + 3, + 2, + 0, + 2, + 1, + 9, + 2, + 0, + 0, + 0, + 2, + 5, + 1 + ], + "weighted_loads": [ + 0.0, + 0.20581470057368279, + 0.17594780586659908, + 0.04961204528808594, + 0.0, + 0.30522930063307285, + 0.043679721653461456, + 0.0, + 0.053315017372369766, + 0.0, + 0.03612665832042694, + 0.2945040687918663, + 0.034813154488801956, + 0.052995312958955765, + 0.0, + 0.1571427471935749, + 0.1684931293129921, + 0.0, + 0.13944745063781738, + 0.0, + 0.06703224778175354, + 0.0, + 0.14860014617443085, + 0.13113684579730034, + 0.2615402974188328, + 0.041767511516809464, + 0.09922431409358978, + 0.11070356145501137, + 0.06998657993972301, + 0.04713016375899315, + 0.0, + 0.27088306099176407, + 0.07123398222029209, + 0.08236699178814888, + 0.13440457731485367, + 0.0259122122079134, + 0.8801390379667282, + 0.1431376338005066, + 0.5431672688573599, + 0.1938830204308033, + 0.0, + 0.033860255032777786, + 0.0, + 0.0, + 0.26802013628184795, + 0.0, + 0.03598570451140404, + 0.9626502655446529, + 0.11509853228926659, + 0.43329422175884247, + 0.0, + 0.17454224079847336, + 0.3840904235839844, + 0.0, + 0.09497832879424095, + 0.11782028526067734, + 1.352862998843193, + 0.18125572428107262, + 0.0, + 0.0, + 0.0, + 0.10076678171753883, + 0.3226475194096565, + 0.04324715584516525 + ], + "unique_experts": 46, + "load_cv": 1.2330770012409151, + "normalized_load_entropy": 0.84557078256418, + "max_load_share": 0.09420289855072464 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "348400e1bab9e2826892442685a5c6df73a275e4f9757e19bf4e9001744ec98b", + "route_weight_sha256": "569ea1dbd6113c625e807e2ab560ec9e6b600b4b46e17b5be6f8ffe43610d815", + "loads": [ + 7, + 5, + 16, + 1, + 1, + 9, + 2, + 2, + 13, + 2, + 1, + 10, + 2, + 2, + 9, + 5, + 2, + 9, + 28, + 1, + 1, + 1, + 2, + 3, + 4, + 1, + 2, + 2, + 2, + 2, + 9, + 5, + 3, + 3, + 7, + 15, + 8, + 8, + 14, + 6, + 6, + 1, + 2, + 5, + 4, + 0, + 20, + 15, + 5, + 19, + 1, + 8, + 12, + 13, + 4, + 2, + 11, + 9, + 2, + 3, + 0, + 4, + 5, + 8 + ], + "weighted_loads": [ + 0.4013539329171181, + 0.34244827926158905, + 1.2341418471187353, + 0.04961204528808594, + 0.03797187656164169, + 0.36430297419428825, + 0.07347983121871948, + 0.0690049771219492, + 1.0705898012965918, + 0.06248409114778042, + 0.03612665832042694, + 0.6169209219515324, + 0.06778852269053459, + 0.09767371416091919, + 1.187841398641467, + 0.1885812245309353, + 0.1684931293129921, + 0.5626588333398104, + 2.4774803537875414, + 0.13675355911254883, + 0.06703224778175354, + 0.02687290869653225, + 0.1823868192732334, + 0.13113684579730034, + 0.2615402974188328, + 0.041767511516809464, + 0.09922431409358978, + 0.11070356145501137, + 0.06998657993972301, + 0.08328473567962646, + 0.6711389757692814, + 0.5443956088274717, + 0.12801103107631207, + 0.15872415527701378, + 0.5575194582343102, + 1.3458437453955412, + 0.8801390379667282, + 0.3963486384600401, + 0.5799401383846998, + 0.27432286366820335, + 0.2228231355547905, + 0.033860255032777786, + 0.05345485731959343, + 0.4530245140194893, + 0.26802013628184795, + 0.0, + 2.6704568341374397, + 1.1389779783785343, + 0.2102641873061657, + 1.0752546321600676, + 0.026268912479281425, + 0.4945898503065109, + 1.0352547746151686, + 0.6867051348090172, + 0.2122725434601307, + 0.15328360721468925, + 1.6130913011729717, + 0.5122128762304783, + 0.33448805660009384, + 0.22576457262039185, + 0.0, + 0.16492941975593567, + 0.3226475194096565, + 0.30733824893832207 + ], + "unique_experts": 62, + "load_cv": 0.9298297335175582, + "normalized_load_entropy": 0.9080773623078249, + "max_load_share": 0.07291666666666667 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.9254658385093167, + "mean_token_weighted_tv": 0.016564856607304966, + "aggregate_load_tv": 0.021739130434782615 + }, + "system_bos": { + "tokens": 23, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.9254658385093167, + "mean_token_weighted_tv": 0.01917757304466289, + "aggregate_load_tv": 0.036231884057971016 + }, + "system_x": { + "tokens": 23, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 11, + "mean_set_jaccard": 0.8509316770186336, + "mean_token_weighted_tv": 0.03115050405587839, + "aggregate_load_tv": 0.07971014492753623 + }, + "system_period": { + "tokens": 23, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 12, + "mean_set_jaccard": 0.8540372670807453, + "mean_token_weighted_tv": 0.03240210121578496, + "aggregate_load_tv": 0.07971014492753625 + }, + "bos_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8881987577639753, + "mean_token_weighted_tv": 0.02473250505230997, + "aggregate_load_tv": 0.043478260869565216 + }, + "bos_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8788819875776398, + "mean_token_weighted_tv": 0.026786773506066074, + "aggregate_load_tv": 0.06521739130434784 + }, + "x_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.9130434782608695, + "mean_token_weighted_tv": 0.024701293800836025, + "aggregate_load_tv": 0.028985507246376815 + }, + "x_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 12, + "mean_set_jaccard": 0.8540372670807455, + "mean_token_weighted_tv": 0.034037071199196835, + "aggregate_load_tv": 0.08695652173913043 + }, + "period_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.9130434782608695, + "mean_token_weighted_tv": 0.024983543538205002, + "aggregate_load_tv": 0.04347826086956521 + }, + "period_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 8, + "set_exact_tokens": 9, + "mean_set_jaccard": 0.8167701863354039, + "mean_token_weighted_tv": 0.040436206345000995, + "aggregate_load_tv": 0.10869565217391304 + } + } + }, + "layer_19": { + "layer": 19, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "b8f0d65647e61a5ef8eb654202c3159cbfc2b22a7e7622c767a1f0e3e5491bbb", + "route_weight_sha256": "02db57c33e7ff811a40e874a01a33b7989fbee501e380f6134259578b285e8c8", + "loads": [ + 3, + 1, + 5, + 2, + 1, + 6, + 1, + 0, + 2, + 5, + 10, + 5, + 2, + 1, + 0, + 1, + 2, + 0, + 2, + 3, + 0, + 1, + 4, + 14, + 1, + 0, + 0, + 1, + 1, + 1, + 1, + 2, + 0, + 0, + 2, + 1, + 6, + 15, + 3, + 0, + 9, + 1, + 0, + 0, + 0, + 2, + 1, + 1, + 0, + 1, + 0, + 0, + 0, + 3, + 0, + 2, + 1, + 2, + 4, + 0, + 1, + 4, + 1, + 0 + ], + "weighted_loads": [ + 0.25350038707256317, + 0.08031383156776428, + 0.1891529131680727, + 0.1663244366645813, + 0.03051784075796604, + 0.4816806986927986, + 0.04146796092391014, + 0.0, + 0.07966242544353008, + 0.38760093227028847, + 0.6575933862477541, + 0.4928433895111084, + 0.09306668490171432, + 0.03794851899147034, + 0.0, + 0.09577528387308121, + 0.14631669223308563, + 0.0, + 0.06656011939048767, + 0.11711382865905762, + 0.0, + 0.03337058424949646, + 0.1589371357113123, + 1.6465025544166565, + 0.030191516503691673, + 0.0, + 0.0, + 0.04183950275182724, + 0.03984193876385689, + 0.11516070365905762, + 0.05235391482710838, + 0.3437799960374832, + 0.0, + 0.0, + 0.07227707095444202, + 0.04261001944541931, + 0.44938358664512634, + 0.9975748229771852, + 0.17696934565901756, + 0.0, + 0.9033263400197029, + 0.14237511157989502, + 0.0, + 0.0, + 0.0, + 0.07158423215150833, + 0.04712380841374397, + 0.048449065536260605, + 0.0, + 0.030518824234604836, + 0.0, + 0.0, + 0.0, + 0.12609866447746754, + 0.0, + 0.06884713657200336, + 0.0338578075170517, + 0.07733581587672234, + 0.15489893406629562, + 0.0, + 0.05058801919221878, + 0.19564895704388618, + 0.05070454999804497, + 0.0 + ], + "unique_experts": 45, + "load_cv": 1.413396462786218, + "normalized_load_entropy": 0.8193881881521504, + "max_load_share": 0.10869565217391304 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "9cc484300de4048a005f0361bc6407e3e701f5fb4a1606565e60d48734c34249", + "route_weight_sha256": "bc9e1623a2031ddee7e0ae0ae9da0157ef41439f3212bff268528db9ed8768b6", + "loads": [ + 5, + 3, + 6, + 2, + 6, + 7, + 10, + 0, + 2, + 9, + 10, + 5, + 10, + 4, + 5, + 1, + 5, + 1, + 2, + 10, + 0, + 1, + 10, + 23, + 10, + 0, + 0, + 2, + 1, + 6, + 7, + 2, + 0, + 0, + 2, + 3, + 8, + 22, + 5, + 0, + 12, + 6, + 9, + 1, + 1, + 2, + 1, + 5, + 1, + 1, + 0, + 0, + 0, + 7, + 7, + 2, + 1, + 2, + 10, + 0, + 1, + 7, + 7, + 0 + ], + "weighted_loads": [ + 0.2980733676813543, + 0.23564082384109497, + 0.21375136636197567, + 0.1663244366645813, + 0.8429359514266253, + 0.49488422833383083, + 0.42284590005874634, + 0.0, + 0.07966242544353008, + 0.6537423506379128, + 0.6575933862477541, + 0.4928433895111084, + 0.6303929500281811, + 0.15032570250332355, + 0.44975055754184723, + 0.09577528387308121, + 0.2619392052292824, + 0.0538945235311985, + 0.06656011939048767, + 0.4848865792155266, + 0.0, + 0.03337058424949646, + 0.37973781675100327, + 1.9680684562772512, + 1.2512953015975654, + 0.0, + 0.0, + 0.07938984036445618, + 0.03984193876385689, + 0.3127795271575451, + 0.29524789191782475, + 0.3437799960374832, + 0.0, + 0.0, + 0.07227707095444202, + 0.1901925764977932, + 0.491989309201017, + 1.3464325200766325, + 0.2507155127823353, + 0.0, + 0.9662017826922238, + 0.4504281096160412, + 0.6299856752157211, + 0.05364421010017395, + 0.010681378655135632, + 0.07158423215150833, + 0.04712380841374397, + 0.32564065232872963, + 0.03802792727947235, + 0.030518824234604836, + 0.0, + 0.0, + 0.0, + 0.41167544573545456, + 1.7703781072050333, + 0.06884713657200336, + 0.0338578075170517, + 0.07733581587672234, + 0.42500071972608566, + 0.0, + 0.05058801919221878, + 0.3810424208641052, + 0.5579519681632519, + 0.0 + ], + "unique_experts": 52, + "load_cv": 1.0599324460188284, + "normalized_load_entropy": 0.8732987202225975, + "max_load_share": 0.0798611111111111 + } + }, + "s1_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "721cc1190b2c36d1b70cc79bb4d8591bc69be331c7b72cf5b33390c49f370bb4", + "route_weight_sha256": "53defebb91d999cc073ed4bc4e2b34cf932369a753278e43888bb71a0e15db1f", + "loads": [ + 3, + 1, + 5, + 2, + 0, + 6, + 1, + 0, + 2, + 5, + 9, + 5, + 3, + 1, + 0, + 1, + 2, + 0, + 2, + 3, + 1, + 1, + 2, + 13, + 2, + 0, + 0, + 1, + 1, + 1, + 1, + 2, + 0, + 0, + 2, + 1, + 7, + 15, + 3, + 0, + 9, + 1, + 0, + 0, + 0, + 2, + 1, + 2, + 0, + 1, + 0, + 0, + 0, + 3, + 0, + 2, + 1, + 2, + 4, + 0, + 1, + 4, + 1, + 0 + ], + "weighted_loads": [ + 0.2500728741288185, + 0.0855620875954628, + 0.18846863880753517, + 0.1475994475185871, + 0.0, + 0.48036736994981766, + 0.03924171254038811, + 0.0, + 0.08297604694962502, + 0.40778158605098724, + 0.6131196264177561, + 0.48495448380708694, + 0.12487243115901947, + 0.03695935755968094, + 0.0, + 0.09694922715425491, + 0.1496272161602974, + 0.0, + 0.06759949401021004, + 0.11546328663825989, + 0.030330054461956024, + 0.03289996087551117, + 0.08892731368541718, + 1.5561054684221745, + 0.06456725299358368, + 0.0, + 0.0, + 0.039821699261665344, + 0.04059020057320595, + 0.12326157838106155, + 0.050970856100320816, + 0.3411935567855835, + 0.0, + 0.0, + 0.06322662346065044, + 0.044868145138025284, + 0.48955113068223, + 1.0125284176319838, + 0.18998650088906288, + 0.0, + 0.8823318295180798, + 0.15361525118350983, + 0.0, + 0.0, + 0.0, + 0.07074424996972084, + 0.04628777131438255, + 0.0858781561255455, + 0.0, + 0.032506946474313736, + 0.0, + 0.0, + 0.0, + 0.13932957500219345, + 0.0, + 0.06829946860671043, + 0.03636815771460533, + 0.07859835028648376, + 0.16874739155173302, + 0.0, + 0.05035479739308357, + 0.1868779957294464, + 0.036931637674570084, + 0.0 + ], + "unique_experts": 45, + "load_cv": 1.3723803595547939, + "normalized_load_entropy": 0.8254154967954177, + "max_load_share": 0.10869565217391304 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "296b1786bc0547283a0da40461fb33d9507f83d6486d623874c7ee4ef2f918c6", + "route_weight_sha256": "58f488d23164896a2fcc3948ce6e062d83de0a8b6954322a049878dd7cad279a", + "loads": [ + 5, + 7, + 7, + 2, + 12, + 8, + 15, + 0, + 2, + 10, + 10, + 12, + 15, + 1, + 11, + 3, + 4, + 5, + 3, + 13, + 5, + 2, + 9, + 19, + 16, + 0, + 0, + 2, + 2, + 2, + 5, + 3, + 2, + 0, + 2, + 2, + 11, + 19, + 4, + 2, + 13, + 11, + 9, + 1, + 1, + 2, + 1, + 13, + 1, + 2, + 5, + 0, + 3, + 13, + 6, + 2, + 4, + 4, + 14, + 1, + 2, + 12, + 10, + 2 + ], + "weighted_loads": [ + 0.27557289926335216, + 0.43728472106158733, + 0.24821638315916061, + 0.1475994475185871, + 1.4721511416137218, + 0.5713360216468573, + 0.6902492772787809, + 0.0, + 0.08297604694962502, + 0.6489707641303539, + 0.6782848779112101, + 1.2218868993222713, + 0.7862229607999325, + 0.03695935755968094, + 0.8452023416757584, + 0.20677554234862328, + 0.5035880208015442, + 0.22744186781346798, + 0.16715963557362556, + 0.6537806801497936, + 0.364199498668313, + 0.08712350949645042, + 0.35960590466856956, + 1.7531368993222713, + 1.5057985759340227, + 0.0, + 0.0, + 0.09444312378764153, + 0.08016089722514153, + 0.15971778705716133, + 0.20143637992441654, + 0.38406745716929436, + 0.08620418235659599, + 0.0, + 0.06322662346065044, + 0.15362631157040596, + 0.619054805021733, + 1.2019367665052414, + 0.23613464087247849, + 0.10270571149885654, + 0.9828002946451306, + 0.7327153757214546, + 0.7274752818048, + 0.03646666184067726, + 0.010681378655135632, + 0.07074424996972084, + 0.04628777131438255, + 0.775185901671648, + 0.03392273560166359, + 0.07631513476371765, + 0.33474475517868996, + 0.0, + 0.144123625010252, + 0.9876533076167107, + 1.7446479052305222, + 0.06829946860671043, + 0.1430876925587654, + 0.16586586833000183, + 0.67583442106843, + 0.03463063761591911, + 0.08996762707829475, + 0.5426012109965086, + 0.7451162412762642, + 0.1672707349061966 + ], + "unique_experts": 59, + "load_cv": 0.8695265314462169, + "normalized_load_entropy": 0.9073155034887687, + "max_load_share": 0.049479166666666664 + } + }, + "s0_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "84224c38c7cd7e5098771d609cb47cb8e4383dd77952e66aea0ab76de45e6190", + "route_weight_sha256": "bd70a822dc55b14a2c6b1db7e8b9d9d9fa1034f57160d13038dff2165d2cc437", + "loads": [ + 3, + 1, + 4, + 2, + 0, + 6, + 1, + 0, + 2, + 5, + 9, + 5, + 3, + 1, + 0, + 1, + 2, + 0, + 1, + 3, + 1, + 1, + 6, + 13, + 1, + 0, + 0, + 1, + 2, + 1, + 1, + 2, + 0, + 0, + 1, + 1, + 6, + 14, + 3, + 0, + 9, + 1, + 1, + 1, + 0, + 3, + 1, + 1, + 0, + 0, + 0, + 0, + 0, + 3, + 0, + 2, + 1, + 2, + 4, + 0, + 1, + 4, + 1, + 0 + ], + "weighted_loads": [ + 0.2548203095793724, + 0.07837484031915665, + 0.1521284393966198, + 0.15487150847911835, + 0.0, + 0.4797719083726406, + 0.03842298686504364, + 0.0, + 0.08156045526266098, + 0.39738934114575386, + 0.6379708014428616, + 0.5084196254611015, + 0.12762917205691338, + 0.03782164677977562, + 0.0, + 0.09790671616792679, + 0.1323402002453804, + 0.0, + 0.04110325872898102, + 0.11070559173822403, + 0.03165244683623314, + 0.03337787836790085, + 0.2339317537844181, + 1.631954062730074, + 0.03159403055906296, + 0.0, + 0.0, + 0.040414027869701385, + 0.06719420291483402, + 0.11326166242361069, + 0.05583895742893219, + 0.33385106921195984, + 0.0, + 0.0, + 0.04572879895567894, + 0.037431348115205765, + 0.4629017934203148, + 1.0161882098764181, + 0.16744878143072128, + 0.0, + 0.8944643288850784, + 0.13194237649440765, + 0.03087698668241501, + 0.02573433890938759, + 0.0, + 0.10820598341524601, + 0.05332024395465851, + 0.048251718282699585, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.12337446957826614, + 0.0, + 0.07310259714722633, + 0.0319899246096611, + 0.07985524088144302, + 0.15565556101500988, + 0.0, + 0.051696471869945526, + 0.2107299640774727, + 0.0423753447830677, + 0.0 + ], + "unique_experts": 46, + "load_cv": 1.3451742652246683, + "normalized_load_entropy": 0.8287815323550118, + "max_load_share": 0.10144927536231885 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "4cc61bb4e7a3600480262e56e43a46ebce3bae601a44281b7047c6f800a2c7a1", + "route_weight_sha256": "9b5dcc78ef3ef83fce32effdc2424f03a76c8a31d5824fdfa13900b71f3d9ccc", + "loads": [ + 4, + 4, + 6, + 2, + 5, + 7, + 9, + 0, + 2, + 8, + 9, + 5, + 11, + 5, + 5, + 1, + 5, + 1, + 1, + 10, + 1, + 1, + 11, + 19, + 10, + 0, + 1, + 3, + 2, + 6, + 9, + 2, + 0, + 0, + 1, + 4, + 6, + 21, + 6, + 0, + 11, + 6, + 9, + 2, + 1, + 4, + 1, + 5, + 3, + 0, + 0, + 0, + 0, + 6, + 6, + 2, + 1, + 2, + 10, + 0, + 2, + 7, + 7, + 0 + ], + "weighted_loads": [ + 0.2949889861047268, + 0.24061349965631962, + 0.20848287642002106, + 0.15487150847911835, + 0.5838198959827423, + 0.49297543801367283, + 0.3828781843185425, + 0.0, + 0.08156045526266098, + 0.5935844108462334, + 0.6379708014428616, + 0.5084196254611015, + 0.6724421828985214, + 0.21497193723917007, + 0.4355987682938576, + 0.09790671616792679, + 0.24796271324157715, + 0.6711934208869934, + 0.04110325872898102, + 0.6300301179289818, + 0.03165244683623314, + 0.03337787836790085, + 0.4140486400574446, + 1.86518884729594, + 1.248511029407382, + 0.0, + 0.04203960672020912, + 0.12646246701478958, + 0.06719420291483402, + 0.31088048592209816, + 0.37112107686698437, + 0.33385106921195984, + 0.0, + 0.0, + 0.04572879895567894, + 0.23835301771759987, + 0.4629017934203148, + 1.3429040666669607, + 0.2772020995616913, + 0.0, + 0.9528041500598192, + 0.43652747943997383, + 0.6183298788964748, + 0.07937854900956154, + 0.010681378655135632, + 0.14074876718223095, + 0.05332024395465851, + 0.31910819560289383, + 0.12290379405021667, + 0.0, + 0.0, + 0.0, + 0.0, + 0.34142954647541046, + 0.8263913337141275, + 0.07310259714722633, + 0.0319899246096611, + 0.07985524088144302, + 0.4257573466747999, + 0.0, + 0.07607393525540829, + 0.3961234278976917, + 0.5496227629482746, + 0.0 + ], + "unique_experts": 53, + "load_cv": 0.9742043287083434, + "normalized_load_entropy": 0.887362401171055, + "max_load_share": 0.07291666666666667 + } + }, + "s1_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "80b208f4b0dc91a83fccea4d6c4caa37ea4d259666cdf4b6ca400ae0243f36e1", + "route_weight_sha256": "fb55f7950c60d24cdd1719eedb85f76c8a14b7d23b4b5fbdc67be158e8784eec", + "loads": [ + 3, + 1, + 5, + 2, + 0, + 6, + 1, + 0, + 1, + 5, + 10, + 5, + 3, + 1, + 0, + 1, + 2, + 0, + 1, + 3, + 1, + 1, + 4, + 13, + 2, + 0, + 0, + 1, + 2, + 2, + 1, + 2, + 0, + 0, + 1, + 1, + 7, + 14, + 3, + 0, + 9, + 1, + 0, + 0, + 1, + 3, + 1, + 1, + 0, + 1, + 0, + 0, + 0, + 3, + 0, + 1, + 1, + 2, + 4, + 0, + 1, + 3, + 1, + 0 + ], + "weighted_loads": [ + 0.26046205312013626, + 0.0972418412566185, + 0.18427474424242973, + 0.15170207247138023, + 0.0, + 0.4907942898571491, + 0.0374353751540184, + 0.0, + 0.05495472997426987, + 0.40018028765916824, + 0.6764054261147976, + 0.5033102743327618, + 0.11632878892123699, + 0.03454095870256424, + 0.0, + 0.09568216651678085, + 0.1441463753581047, + 0.0, + 0.040023017674684525, + 0.117333073168993, + 0.03238227963447571, + 0.033858899027109146, + 0.15492448955774307, + 1.6383266281336546, + 0.0576442014425993, + 0.0, + 0.0, + 0.040993232280015945, + 0.06455079652369022, + 0.16388879530131817, + 0.05432729050517082, + 0.328856498003006, + 0.0, + 0.0, + 0.03939923644065857, + 0.03899545222520828, + 0.5089142136275768, + 0.9592678118497133, + 0.1981273777782917, + 0.0, + 0.8969844356179237, + 0.1483602374792099, + 0.0, + 0.0, + 0.03260517865419388, + 0.11096824891865253, + 0.05320168286561966, + 0.04928587004542351, + 0.0, + 0.03137839213013649, + 0.0, + 0.0, + 0.0, + 0.1309601105749607, + 0.0, + 0.030835414305329323, + 0.03455131873488426, + 0.07832677289843559, + 0.15242972038686275, + 0.0, + 0.04720068722963333, + 0.15461113303899765, + 0.03428882732987404, + 0.0 + ], + "unique_experts": 46, + "load_cv": 1.362550088298112, + "normalized_load_entropy": 0.8267447952073761, + "max_load_share": 0.10144927536231885 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "34fc48eb6e535fe023f7c07c052df84b423a6a88c967347f061a1c42c7223d31", + "route_weight_sha256": "33a5d6de71239117ebef7abb3f52f9383539a4aec6c6fd956abbdd394b3f415e", + "loads": [ + 4, + 7, + 7, + 2, + 12, + 8, + 13, + 0, + 1, + 12, + 11, + 12, + 15, + 3, + 11, + 3, + 4, + 5, + 2, + 14, + 5, + 2, + 10, + 17, + 15, + 0, + 0, + 2, + 3, + 3, + 6, + 3, + 2, + 0, + 1, + 3, + 11, + 18, + 4, + 3, + 12, + 11, + 9, + 3, + 2, + 3, + 1, + 11, + 1, + 2, + 5, + 0, + 3, + 13, + 5, + 1, + 4, + 4, + 14, + 1, + 2, + 11, + 10, + 2 + ], + "weighted_loads": [ + 0.28160006925463676, + 0.44345666468143463, + 0.24402248859405518, + 0.15170207247138023, + 1.4542689882218838, + 0.5817629415541887, + 0.6220567654818296, + 0.0, + 0.05495472997426987, + 0.7131220996379852, + 0.7415706776082516, + 1.2402426898479462, + 0.7941751945763826, + 0.11380252242088318, + 0.8665927909314632, + 0.20550848171114922, + 0.4981071799993515, + 0.22744186781346798, + 0.13958315923810005, + 0.8571319058537483, + 0.3662517238408327, + 0.0880824476480484, + 0.39141007885336876, + 1.7852640459313989, + 1.4562461469322443, + 0.0, + 0.0, + 0.09561465680599213, + 0.1041214931756258, + 0.20034500397741795, + 0.2516093347221613, + 0.37173039838671684, + 0.08620418235659599, + 0.0, + 0.03939923644065857, + 0.22622329741716385, + 0.6701263152062893, + 1.1510722823441029, + 0.2442755177617073, + 0.14555557630956173, + 0.9876740779727697, + 0.7369322367012501, + 0.7102144360542297, + 0.11098738759756088, + 0.04328655730932951, + 0.11096824891865253, + 0.05320168286561966, + 0.6940765976905823, + 0.03392273560166359, + 0.0751865804195404, + 0.33474475517868996, + 0.0, + 0.144123625010252, + 0.9243187829852104, + 0.8030916303396225, + 0.030835414305329323, + 0.14424407668411732, + 0.16559429094195366, + 0.6516455877572298, + 0.03463063761591911, + 0.08681351691484451, + 0.5103343483060598, + 0.7424734309315681, + 0.1672707349061966 + ], + "unique_experts": 59, + "load_cv": 0.8286325750563059, + "normalized_load_entropy": 0.9140135585869138, + "max_load_share": 0.046875 + } + }, + "s0_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "c95b02aea1fe29482896e2003ab4b69b96ba6241eb217253b8618cb3eddf06d4", + "route_weight_sha256": "68327612ba9eb3d6f3eec3336c82873054bedef5c6770389fb0f661f81686dcd", + "loads": [ + 3, + 1, + 3, + 2, + 0, + 6, + 1, + 0, + 2, + 5, + 9, + 5, + 4, + 1, + 0, + 1, + 2, + 0, + 1, + 3, + 1, + 1, + 4, + 13, + 1, + 0, + 0, + 1, + 2, + 2, + 1, + 2, + 0, + 0, + 2, + 1, + 7, + 14, + 3, + 0, + 9, + 1, + 0, + 0, + 0, + 3, + 1, + 2, + 0, + 1, + 0, + 0, + 0, + 3, + 0, + 2, + 1, + 2, + 3, + 0, + 1, + 4, + 1, + 0 + ], + "weighted_loads": [ + 0.26282157748937607, + 0.06685765087604523, + 0.11389954946935177, + 0.16142116114497185, + 0.0, + 0.48638178780674934, + 0.03975074738264084, + 0.0, + 0.08096748404204845, + 0.3779459744691849, + 0.6119850259274244, + 0.4791097864508629, + 0.17548884451389313, + 0.03951559588313103, + 0.0, + 0.09597071260213852, + 0.1422591581940651, + 0.0, + 0.036271750926971436, + 0.1137700192630291, + 0.030588995665311813, + 0.03471251204609871, + 0.15242595970630646, + 1.6653719693422318, + 0.030130866914987564, + 0.0, + 0.0, + 0.041167255491018295, + 0.06633901782333851, + 0.12409395538270473, + 0.059004101902246475, + 0.3188572973012924, + 0.0, + 0.0, + 0.06678054668009281, + 0.044719796627759933, + 0.5038732588291168, + 0.9210214372724295, + 0.16126712411642075, + 0.0, + 0.9196453541517258, + 0.1312475949525833, + 0.0, + 0.0, + 0.0, + 0.11043257266283035, + 0.052886687219142914, + 0.0852174162864685, + 0.0, + 0.034223224967718124, + 0.0, + 0.0, + 0.0, + 0.12636645510792732, + 0.0, + 0.07377927750349045, + 0.03559724986553192, + 0.08082104846835136, + 0.12082554772496223, + 0.0, + 0.04414139688014984, + 0.19336284324526787, + 0.044841308146715164, + 0.0 + ], + "unique_experts": 45, + "load_cv": 1.337658391628749, + "normalized_load_entropy": 0.8295220855580157, + "max_load_share": 0.10144927536231885 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "ab65cda80635e6fc389fe7ac6f14c17a27b993980d495471850cdb712960f69e", + "route_weight_sha256": "d0e9a22e6e4dca6257cc5e674203ac07f2c89f836793e3827bae0eabb4cb3782", + "loads": [ + 5, + 3, + 4, + 2, + 5, + 8, + 10, + 0, + 2, + 8, + 9, + 5, + 14, + 3, + 6, + 1, + 5, + 0, + 1, + 9, + 1, + 1, + 11, + 20, + 9, + 0, + 0, + 2, + 2, + 7, + 6, + 2, + 0, + 0, + 3, + 3, + 7, + 20, + 5, + 1, + 12, + 5, + 10, + 1, + 1, + 3, + 1, + 7, + 1, + 1, + 0, + 0, + 0, + 7, + 6, + 2, + 2, + 2, + 11, + 0, + 1, + 7, + 8, + 0 + ], + "weighted_loads": [ + 0.3501310907304287, + 0.18485229462385178, + 0.13849800266325474, + 0.16142116114497185, + 0.6743031963706017, + 0.5849307347089052, + 0.4400535896420479, + 0.0, + 0.08096748404204845, + 0.5412133634090424, + 0.6119850259274244, + 0.4791097864508629, + 0.9162361696362495, + 0.12360942736268044, + 0.5067690722644329, + 0.09597071260213852, + 0.25788167119026184, + 0.0, + 0.036271750926971436, + 0.4010627120733261, + 0.030588995665311813, + 0.03471251204609871, + 0.41845146380364895, + 1.9326664907857776, + 0.9692660104483366, + 0.0, + 0.0, + 0.07871759310364723, + 0.06633901782333851, + 0.3217127788811922, + 0.2473962213844061, + 0.3188572973012924, + 0.0, + 0.0, + 0.11014926619827747, + 0.24576926976442337, + 0.5038732588291168, + 1.1682399865239859, + 0.23501329123973846, + 0.03419562056660652, + 1.0284297075122595, + 0.4172370210289955, + 0.7722886130213737, + 0.05364421010017395, + 0.010681378655135632, + 0.11043257266283035, + 0.052886687219142914, + 0.4478933811187744, + 0.03802792727947235, + 0.034223224967718124, + 0.0, + 0.0, + 0.0, + 0.3812786303460598, + 0.8263913337141275, + 0.07377927750349045, + 0.06480585038661957, + 0.08082104846835136, + 0.4792317897081375, + 0.0, + 0.04414139688014984, + 0.3787563070654869, + 0.6008478701114655, + 0.0 + ], + "unique_experts": 53, + "load_cv": 1.0122703976826999, + "normalized_load_entropy": 0.8804315379127812, + "max_load_share": 0.06944444444444445 + } + }, + "s1_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "44e2a29a3c5cc400b531afe983e64a5e165bcec7355ebc929f840b42e805d45c", + "route_weight_sha256": "764d2dc883f3afaefb7ecacf26cfcae4f051a7a487253e164f5423de82f08055", + "loads": [ + 3, + 1, + 4, + 2, + 0, + 6, + 1, + 0, + 2, + 5, + 10, + 5, + 3, + 1, + 0, + 1, + 2, + 0, + 1, + 3, + 1, + 1, + 2, + 14, + 2, + 0, + 0, + 1, + 1, + 1, + 1, + 2, + 0, + 0, + 1, + 1, + 7, + 14, + 3, + 0, + 9, + 1, + 0, + 1, + 1, + 3, + 1, + 1, + 0, + 1, + 0, + 0, + 0, + 3, + 0, + 2, + 1, + 2, + 5, + 0, + 1, + 3, + 1, + 0 + ], + "weighted_loads": [ + 0.2598229944705963, + 0.09882880747318268, + 0.1424846574664116, + 0.13801700994372368, + 0.0, + 0.5051159933209419, + 0.038140568882226944, + 0.0, + 0.08202710747718811, + 0.33673983067274094, + 0.6294446159154177, + 0.465829212218523, + 0.1250273920595646, + 0.03352292999625206, + 0.0, + 0.09213469177484512, + 0.1498260349035263, + 0.0, + 0.03606979176402092, + 0.11776633188128471, + 0.032791439443826675, + 0.03540616109967232, + 0.08730635419487953, + 1.6812286786735058, + 0.06291643902659416, + 0.0, + 0.0, + 0.03690385818481445, + 0.04166388139128685, + 0.12837962806224823, + 0.05027349293231964, + 0.3120093196630478, + 0.0, + 0.0, + 0.032861340790987015, + 0.042801305651664734, + 0.5052787698805332, + 0.9130056370049715, + 0.19339242950081825, + 0.0, + 0.8569564335048199, + 0.14405518770217896, + 0.0, + 0.02543036639690399, + 0.034312278032302856, + 0.11567866988480091, + 0.04559924080967903, + 0.04861985146999359, + 0.0, + 0.035039711743593216, + 0.0, + 0.0, + 0.0, + 0.1348639354109764, + 0.0, + 0.0696713961660862, + 0.04139339178800583, + 0.08174384385347366, + 0.18102914467453957, + 0.0, + 0.0397932268679142, + 0.15412084385752678, + 0.032673876732587814, + 0.0 + ], + "unique_experts": 47, + "load_cv": 1.3821407162305501, + "normalized_load_entropy": 0.8277142969308395, + "max_load_share": 0.10144927536231885 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "a8dce17e347780d35fea1ffb91802c0ec8d6ee2c531b44c174e15ceb288d7903", + "route_weight_sha256": "0fdd8459be39450febcaab61db2522bfab208f6e60ca029453c41a825a97d27b", + "loads": [ + 4, + 7, + 6, + 2, + 12, + 9, + 13, + 0, + 2, + 10, + 11, + 12, + 17, + 2, + 12, + 3, + 4, + 5, + 2, + 10, + 5, + 2, + 10, + 18, + 12, + 0, + 0, + 2, + 2, + 2, + 5, + 3, + 3, + 0, + 1, + 2, + 10, + 17, + 4, + 2, + 11, + 11, + 10, + 2, + 2, + 3, + 1, + 13, + 1, + 2, + 5, + 0, + 3, + 14, + 5, + 2, + 4, + 4, + 16, + 1, + 4, + 14, + 11, + 2 + ], + "weighted_loads": [ + 0.2809610106050968, + 0.46240198612213135, + 0.20223240181803703, + 0.13801700994372368, + 1.3939149640500546, + 0.6453871075063944, + 0.5884455721825361, + 0.0, + 0.08202710747718811, + 0.5764634944498539, + 0.6946098674088717, + 1.2027616277337074, + 0.9255660884082317, + 0.09729577228426933, + 0.8764525800943375, + 0.20196100696921349, + 0.5037868395447731, + 0.22744186781346798, + 0.13562993332743645, + 0.4544055797159672, + 0.3666608836501837, + 0.08962970972061157, + 0.40589504316449165, + 1.82816609647125, + 1.009122159332037, + 0.0, + 0.0, + 0.09152528271079063, + 0.08123457804322243, + 0.164835836738348, + 0.19695591367781162, + 0.35488322004675865, + 0.12211029604077339, + 0.0, + 0.032861340790987015, + 0.15987332165241241, + 0.6308536380529404, + 1.0426883362233639, + 0.23954056948423386, + 0.10270571149885654, + 0.9101846162229776, + 0.7057622671127319, + 0.8924873806536198, + 0.06189702823758125, + 0.04499365668743849, + 0.11567866988480091, + 0.04559924080967903, + 0.8418270908296108, + 0.03392273560166359, + 0.07884790003299713, + 0.33474475517868996, + 0.0, + 0.144123625010252, + 0.9815473407506943, + 0.8030916303396225, + 0.0696713961660862, + 0.1607999950647354, + 0.16901136189699173, + 0.7083485201001167, + 0.03463063761591911, + 0.15558185055851936, + 0.6597342621535063, + 0.8277794420719147, + 0.1672707349061966 + ], + "unique_experts": 59, + "load_cv": 0.8436856971381911, + "normalized_load_entropy": 0.9122712772593022, + "max_load_share": 0.046875 + } + }, + "s0_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "49447fd484b26fad820225405da63666adb392ac2903a50c9b0edab5dd726b3f", + "route_weight_sha256": "dccd1528319b39c9e16e45acc58ae097ae95725f502c3ac267e79954ea4750e8", + "loads": [ + 3, + 1, + 3, + 2, + 0, + 6, + 1, + 0, + 2, + 5, + 9, + 5, + 4, + 1, + 0, + 1, + 2, + 0, + 2, + 3, + 1, + 1, + 4, + 13, + 2, + 0, + 0, + 1, + 1, + 2, + 1, + 2, + 0, + 0, + 2, + 1, + 6, + 14, + 3, + 0, + 9, + 1, + 0, + 0, + 1, + 3, + 1, + 2, + 0, + 1, + 0, + 0, + 0, + 2, + 0, + 2, + 1, + 2, + 4, + 0, + 1, + 3, + 1, + 0 + ], + "weighted_loads": [ + 0.25666746497154236, + 0.07362854480743408, + 0.1076185330748558, + 0.1571626029908657, + 0.0, + 0.4813529998064041, + 0.03953403979539871, + 0.0, + 0.07841688022017479, + 0.3591395504772663, + 0.6172500662505627, + 0.49991802126169205, + 0.17219553887844086, + 0.03702188655734062, + 0.0, + 0.09241481870412827, + 0.13408033549785614, + 0.0, + 0.06859449669718742, + 0.11456738412380219, + 0.032582420855760574, + 0.03406107798218727, + 0.15017824061214924, + 1.6883153058588505, + 0.06111915223300457, + 0.0, + 0.0, + 0.040564924478530884, + 0.04258125647902489, + 0.12390696629881859, + 0.05594130977988243, + 0.33030061423778534, + 0.0, + 0.0, + 0.07012905925512314, + 0.04368991777300835, + 0.4637738838791847, + 0.942992702126503, + 0.1645072139799595, + 0.0, + 0.8958356902003288, + 0.12544943392276764, + 0.0, + 0.0, + 0.03372303396463394, + 0.11248258128762245, + 0.05071477219462395, + 0.08711489662528038, + 0.0, + 0.033235497772693634, + 0.0, + 0.0, + 0.0, + 0.09662974998354912, + 0.0, + 0.07113097608089447, + 0.033638644963502884, + 0.0775783434510231, + 0.14289560727775097, + 0.0, + 0.04623224958777428, + 0.16191570088267326, + 0.04725313559174538, + 0.0 + ], + "unique_experts": 46, + "load_cv": 1.3199549361233305, + "normalized_load_entropy": 0.835435849993088, + "max_load_share": 0.10144927536231885 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "3a2f64c41a69689fa9259d62e2746b393406ad2c337612b54690240148b4eca9", + "route_weight_sha256": "86f6575993ee55c1e541cf21bc42da191d4d72ef339f59673ef060888e05ae35", + "loads": [ + 5, + 4, + 4, + 2, + 5, + 8, + 9, + 0, + 2, + 9, + 9, + 5, + 13, + 3, + 6, + 1, + 5, + 0, + 2, + 9, + 1, + 1, + 9, + 20, + 10, + 0, + 0, + 2, + 1, + 7, + 7, + 2, + 0, + 0, + 3, + 3, + 7, + 21, + 5, + 0, + 12, + 5, + 9, + 1, + 2, + 3, + 1, + 8, + 1, + 1, + 0, + 0, + 0, + 5, + 6, + 2, + 2, + 2, + 12, + 0, + 2, + 7, + 7, + 0 + ], + "weighted_loads": [ + 0.34813618287444115, + 0.23638374917209148, + 0.13221698626875877, + 0.1571626029908657, + 0.8380788788199425, + 0.5727603193372488, + 0.38398923724889755, + 0.0, + 0.07841688022017479, + 0.5504268668591976, + 0.6172500662505627, + 0.49991802126169205, + 0.785221341997385, + 0.12147819995880127, + 0.5053392201662064, + 0.09241481870412827, + 0.2497028484940529, + 0.0, + 0.06859449669718742, + 0.45565133541822433, + 0.032582420855760574, + 0.03406107798218727, + 0.3302951268851757, + 1.9502460164949298, + 1.03638980910182, + 0.0, + 0.0, + 0.07811526209115982, + 0.04258125647902489, + 0.32152578979730606, + 0.30075748823583126, + 0.33030061423778534, + 0.0, + 0.0, + 0.13358424603939056, + 0.24399226158857346, + 0.5197288990020752, + 1.235907170921564, + 0.2382533811032772, + 0.0, + 1.0005782041698694, + 0.39046090096235275, + 0.6214461885392666, + 0.05364421010017395, + 0.04440441261976957, + 0.11248258128762245, + 0.05071477219462395, + 0.5140937678515911, + 0.03802792727947235, + 0.033235497772693634, + 0.0, + 0.0, + 0.0, + 0.3456495963037014, + 0.8263913337141275, + 0.07113097608089447, + 0.061601750552654266, + 0.0775783434510231, + 0.4797074217349291, + 0.0, + 0.09741013497114182, + 0.4295051619410515, + 0.5545005537569523, + 0.0 + ], + "unique_experts": 52, + "load_cv": 1.0107447443700142, + "normalized_load_entropy": 0.8808779627598395, + "max_load_share": 0.07291666666666667 + } + }, + "s1_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "e1f2e5169461a1dcc8d8f9f5c068a0bc301f734422b7ed520b46116684408c10", + "route_weight_sha256": "dfac0944104d1a34ab04c13765eb35a125b49eda3d224b80cd4dce3dd5045984", + "loads": [ + 3, + 1, + 4, + 2, + 0, + 6, + 1, + 0, + 1, + 5, + 9, + 5, + 2, + 1, + 0, + 1, + 2, + 0, + 1, + 3, + 1, + 1, + 2, + 14, + 1, + 0, + 0, + 0, + 1, + 2, + 1, + 2, + 0, + 0, + 2, + 1, + 7, + 14, + 4, + 1, + 9, + 1, + 0, + 0, + 1, + 3, + 1, + 2, + 0, + 1, + 0, + 0, + 0, + 4, + 0, + 2, + 1, + 2, + 5, + 0, + 1, + 3, + 1, + 0 + ], + "weighted_loads": [ + 0.2652694210410118, + 0.11622388660907745, + 0.13285681419074535, + 0.16364967077970505, + 0.0, + 0.4896043688058853, + 0.03809195011854172, + 0.0, + 0.05322997644543648, + 0.2876885924488306, + 0.5934231765568256, + 0.4657452553510666, + 0.0946614183485508, + 0.03177371993660927, + 0.0, + 0.09063135087490082, + 0.14488013088703156, + 0.0, + 0.03505565598607063, + 0.11991684138774872, + 0.033094607293605804, + 0.03594190254807472, + 0.0823790542781353, + 1.67031829059124, + 0.03100055828690529, + 0.0, + 0.0, + 0.0, + 0.04110652580857277, + 0.16026319190859795, + 0.04591263830661774, + 0.32507599890232086, + 0.0, + 0.0, + 0.06537664867937565, + 0.04449562355875969, + 0.5018645636737347, + 0.9362383056432009, + 0.2195025272667408, + 0.04026581719517708, + 0.8595004454255104, + 0.1547784060239792, + 0.0, + 0.0, + 0.03225155174732208, + 0.11021148227155209, + 0.04677436873316765, + 0.08885134756565094, + 0.0, + 0.03541600704193115, + 0.0, + 0.0, + 0.0, + 0.17292698472738266, + 0.0, + 0.0723249651491642, + 0.039225418120622635, + 0.08277745544910431, + 0.1754365898668766, + 0.0, + 0.043487269431352615, + 0.1644030213356018, + 0.037987664341926575, + 0.0 + ], + "unique_experts": 46, + "load_cv": 1.3723803595547939, + "normalized_load_entropy": 0.8264517588177759, + "max_load_share": 0.10144927536231885 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "992ab10f0635e4f9c1c33c122ba35c4ca15156bf1c8f3a684c3546ab94fbb99a", + "route_weight_sha256": "73e76287662272957d59f8935b9310a84bbe31502f2fed889f2593bb3cb86d34", + "loads": [ + 4, + 7, + 6, + 2, + 12, + 9, + 12, + 0, + 1, + 10, + 10, + 12, + 15, + 2, + 13, + 3, + 4, + 5, + 2, + 12, + 5, + 2, + 8, + 18, + 12, + 0, + 0, + 2, + 2, + 3, + 5, + 3, + 2, + 0, + 3, + 2, + 10, + 16, + 5, + 4, + 12, + 11, + 9, + 1, + 2, + 3, + 1, + 14, + 1, + 2, + 5, + 0, + 3, + 15, + 5, + 2, + 4, + 4, + 15, + 1, + 4, + 14, + 11, + 2 + ], + "weighted_loads": [ + 0.2864074371755123, + 0.46280538849532604, + 0.1926045585423708, + 0.16364967077970505, + 1.4365680329501629, + 0.629751255735755, + 0.5552130248397589, + 0.0, + 0.05322997644543648, + 0.4952624123543501, + 0.6585884280502796, + 1.202677670866251, + 0.8003068193793297, + 0.07972785830497742, + 0.8748384304344654, + 0.20045766606926918, + 0.49884093552827835, + 0.22744186781346798, + 0.13461579754948616, + 0.5340066365897655, + 0.3669640514999628, + 0.09016545116901398, + 0.318864643573761, + 1.8172557083889842, + 1.0613781102001667, + 0.0, + 0.0, + 0.10078943893313408, + 0.08067722246050835, + 0.19671940058469772, + 0.19280428625643253, + 0.3679498992860317, + 0.08620418235659599, + 0.0, + 0.1277178544551134, + 0.23860817775130272, + 0.6274394318461418, + 1.0164341814815998, + 0.2656506672501564, + 0.1861197929829359, + 0.9645322654396296, + 0.7425603866577148, + 0.7160880193114281, + 0.03646666184067726, + 0.042932930402457714, + 0.11021148227155209, + 0.04677436873316765, + 0.930433951318264, + 0.03392273560166359, + 0.07922419533133507, + 0.33474475517868996, + 0.0, + 0.144123625010252, + 1.0534338392317295, + 0.8030916303396225, + 0.0723249651491642, + 0.15653833001852036, + 0.17004497349262238, + 0.6639251299202442, + 0.03463063761591911, + 0.17834888398647308, + 0.6607978027313948, + 0.7915130667388439, + 0.1672707349061966 + ], + "unique_experts": 59, + "load_cv": 0.8286325750563059, + "normalized_load_entropy": 0.9143904094801535, + "max_load_share": 0.046875 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 18, + "mean_set_jaccard": 0.9378881987577641, + "mean_token_weighted_tv": 0.01591233933425468, + "aggregate_load_tv": 0.03623188405797102 + }, + "system_bos": { + "tokens": 23, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.9037267080745343, + "mean_token_weighted_tv": 0.023040087772128376, + "aggregate_load_tv": 0.05072463768115943 + }, + "system_x": { + "tokens": 23, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.9006211180124224, + "mean_token_weighted_tv": 0.02557158340578494, + "aggregate_load_tv": 0.05797101449275363 + }, + "system_period": { + "tokens": 23, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.8913043478260869, + "mean_token_weighted_tv": 0.027377494894292042, + "aggregate_load_tv": 0.05797101449275363 + }, + "bos_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.9006211180124224, + "mean_token_weighted_tv": 0.02244576297538436, + "aggregate_load_tv": 0.057971014492753624 + }, + "bos_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.9006211180124224, + "mean_token_weighted_tv": 0.02439312013271062, + "aggregate_load_tv": 0.05072463768115942 + }, + "x_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.8913043478260869, + "mean_token_weighted_tv": 0.02558470468806184, + "aggregate_load_tv": 0.05797101449275363 + }, + "x_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.9254658385093167, + "mean_token_weighted_tv": 0.024572073522469273, + "aggregate_load_tv": 0.043478260869565216 + }, + "period_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 13, + "mean_set_jaccard": 0.8571428571428572, + "mean_token_weighted_tv": 0.028696580506537273, + "aggregate_load_tv": 0.05797101449275363 + }, + "period_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.9037267080745341, + "mean_token_weighted_tv": 0.027511711839748466, + "aggregate_load_tv": 0.05797101449275362 + } + } + }, + "layer_20": { + "layer": 20, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "1d3c815fde78c74ba16ff0a1e773ce2e8e68edda7411dc363cdcfa6eb9f474a9", + "route_weight_sha256": "918c53df9ea2a378d4688b3fcbec48bd7149a85ddef3622fe682c6f8776a765c", + "loads": [ + 0, + 6, + 7, + 1, + 2, + 10, + 2, + 0, + 0, + 0, + 2, + 0, + 2, + 1, + 3, + 15, + 0, + 0, + 0, + 2, + 5, + 2, + 2, + 1, + 0, + 0, + 0, + 0, + 1, + 0, + 0, + 0, + 0, + 0, + 0, + 0, + 0, + 15, + 14, + 0, + 0, + 0, + 0, + 0, + 5, + 0, + 0, + 5, + 6, + 2, + 0, + 0, + 2, + 1, + 4, + 1, + 9, + 5, + 0, + 0, + 0, + 4, + 0, + 1 + ], + "weighted_loads": [ + 0.0, + 0.3397541865706444, + 0.359804118052125, + 0.03248848393559456, + 0.09942360781133175, + 0.9066439121961594, + 0.25749392062425613, + 0.0, + 0.0, + 0.0, + 0.07986858487129211, + 0.0, + 0.09029694087803364, + 0.048548489809036255, + 0.2000226117670536, + 1.2857320196926594, + 0.0, + 0.0, + 0.0, + 0.12124114856123924, + 0.32156121730804443, + 0.082190852612257, + 0.05445803701877594, + 0.054686304181814194, + 0.0, + 0.0, + 0.0, + 0.0, + 0.035901155322790146, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 1.3764632008969784, + 1.8603976145386696, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.28532151505351067, + 0.0, + 0.0, + 0.28096408396959305, + 0.393052164465189, + 0.10429700464010239, + 0.0, + 0.0, + 0.07800810411572456, + 0.024684879928827286, + 0.20502296090126038, + 0.0275073554366827, + 0.5843251850455999, + 0.29722537472844124, + 0.0, + 0.0, + 0.0, + 0.20072684064507484, + 0.0, + 0.036080002784729004 + ], + "unique_experts": 31, + "load_cv": 1.6745873539869949, + "normalized_load_entropy": 0.7401613507651004, + "max_load_share": 0.10869565217391304 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "09d8a2dcf77794046ce365884a70f208a090be5b799732842d2458593869f42b", + "route_weight_sha256": "abc89f313d10dbd15deda24c4fddd0582c873c3b9b9241b2e86c919cc573a062", + "loads": [ + 1, + 8, + 7, + 9, + 10, + 14, + 6, + 4, + 0, + 0, + 2, + 1, + 5, + 1, + 3, + 23, + 2, + 0, + 10, + 2, + 9, + 2, + 9, + 1, + 0, + 7, + 2, + 0, + 1, + 3, + 0, + 0, + 0, + 1, + 1, + 0, + 2, + 17, + 16, + 0, + 2, + 2, + 2, + 5, + 15, + 0, + 0, + 5, + 7, + 3, + 8, + 0, + 2, + 8, + 4, + 4, + 10, + 10, + 1, + 0, + 12, + 8, + 0, + 1 + ], + "weighted_loads": [ + 0.05333886668086052, + 0.3845057673752308, + 0.359804118052125, + 0.6349374353885651, + 0.49663938395678997, + 1.1016475930809975, + 0.38292133063077927, + 0.2716437466442585, + 0.0, + 0.0, + 0.07986858487129211, + 0.03595093637704849, + 0.18877796083688736, + 0.048548489809036255, + 0.2000226117670536, + 1.8934421446174383, + 0.06494607217609882, + 0.0, + 0.8792918249964714, + 0.12124114856123924, + 0.42657983978278935, + 0.082190852612257, + 0.4877161867916584, + 0.054686304181814194, + 0.0, + 0.5401316620409489, + 0.053496187552809715, + 0.0, + 0.035901155322790146, + 0.09277471154928207, + 0.0, + 0.0, + 0.0, + 0.023041347041726112, + 0.04394172877073288, + 0.0, + 0.0470968633890152, + 1.4339184779673815, + 3.178961731493473, + 0.0, + 0.09878154844045639, + 0.0942719355225563, + 0.15336593985557556, + 0.24644790217280388, + 0.7251634728163481, + 0.0, + 0.0, + 0.28096408396959305, + 0.3946920239832252, + 0.15384963154792786, + 1.0815470181405544, + 0.0, + 0.07800810411572456, + 0.39497053623199463, + 0.20502296090126038, + 0.4706332702189684, + 0.645515950396657, + 0.46009028516709805, + 0.03965134173631668, + 0.0, + 1.283620425267145, + 0.4127362221479416, + 0.0, + 0.036080002784729004 + ], + "unique_experts": 49, + "load_cv": 1.1194134266449938, + "normalized_load_entropy": 0.8555907512392688, + "max_load_share": 0.0798611111111111 + } + }, + "s1_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "07ede3a6b447c591a970e203b4380476ba1ca1b4137e90adb965163bdeb28c51", + "route_weight_sha256": "06463f1e0982bb3dad231da1befb64ac3bed92331699384e1421480501eff85d", + "loads": [ + 0, + 6, + 7, + 0, + 2, + 10, + 2, + 0, + 0, + 0, + 2, + 0, + 2, + 1, + 3, + 15, + 0, + 0, + 0, + 1, + 5, + 2, + 1, + 1, + 0, + 1, + 0, + 0, + 1, + 0, + 0, + 0, + 0, + 0, + 0, + 0, + 0, + 16, + 15, + 0, + 0, + 0, + 0, + 0, + 5, + 0, + 0, + 5, + 6, + 2, + 0, + 0, + 2, + 1, + 3, + 2, + 8, + 6, + 0, + 0, + 0, + 4, + 0, + 1 + ], + "weighted_loads": [ + 0.0, + 0.32447385787963867, + 0.35007610730826855, + 0.0, + 0.11025658622384071, + 0.8816725425422192, + 0.25692611187696457, + 0.0, + 0.0, + 0.0, + 0.08598637208342552, + 0.0, + 0.07782854698598385, + 0.04649544507265091, + 0.19840972498059273, + 1.317169077694416, + 0.0, + 0.0, + 0.0, + 0.08282067626714706, + 0.31679579988121986, + 0.08307508379220963, + 0.030109599232673645, + 0.051825329661369324, + 0.0, + 0.026933560147881508, + 0.0, + 0.0, + 0.0335620641708374, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 1.373904027044773, + 1.8804554417729378, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.29112761840224266, + 0.0, + 0.0, + 0.28396203741431236, + 0.3836607150733471, + 0.1030803695321083, + 0.0, + 0.0, + 0.07252180203795433, + 0.022928988561034203, + 0.1622520610690117, + 0.0837208479642868, + 0.5681066550314426, + 0.30824631080031395, + 0.0, + 0.0, + 0.0, + 0.2078421786427498, + 0.0, + 0.03960780054330826 + ], + "unique_experts": 31, + "load_cv": 1.7181708009017043, + "normalized_load_entropy": 0.7343367999072908, + "max_load_share": 0.11594202898550725 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "0193aec5720ba441d70de77653a7b22f2248175dbc2e96e4ae9a2daf326738a0", + "route_weight_sha256": "9f69338533179830264733f6d4803e58c08abd6ee1cb47d5c4026c3783123cd1", + "loads": [ + 6, + 8, + 7, + 11, + 10, + 16, + 4, + 9, + 0, + 2, + 4, + 0, + 3, + 2, + 4, + 29, + 5, + 0, + 10, + 2, + 9, + 3, + 12, + 3, + 1, + 14, + 1, + 1, + 1, + 6, + 0, + 1, + 1, + 1, + 3, + 2, + 3, + 21, + 18, + 4, + 5, + 2, + 2, + 9, + 20, + 1, + 0, + 5, + 8, + 7, + 13, + 0, + 2, + 10, + 4, + 12, + 9, + 13, + 2, + 2, + 13, + 6, + 1, + 1 + ], + "weighted_loads": [ + 0.2831514198333025, + 0.36872211657464504, + 0.35007610730826855, + 0.752104964107275, + 0.527460053563118, + 1.1552835162729025, + 0.3288979083299637, + 0.5858671348541975, + 0.0, + 0.23401978611946106, + 0.17807166650891304, + 0.0, + 0.12163115106523037, + 0.3305829241871834, + 0.25880173966288567, + 2.444686070084572, + 0.3052198998630047, + 0.0, + 0.9936003237962723, + 0.11686237901449203, + 0.42999501223675907, + 0.11947943270206451, + 0.6882618553936481, + 0.224201962351799, + 0.020249538123607635, + 0.9507782366126776, + 0.017446184530854225, + 0.03761542588472366, + 0.0335620641708374, + 0.18167746998369694, + 0.0, + 0.030627697706222534, + 0.049705617129802704, + 0.043824147433042526, + 0.1395232118666172, + 0.17913683503866196, + 0.10442602448165417, + 1.5589577220380306, + 3.237161599099636, + 0.19725923985242844, + 0.22459883242845535, + 0.10237009450793266, + 0.146049365401268, + 0.40521094435825944, + 1.2378954477608204, + 0.072789266705513, + 0.0, + 0.28396203741431236, + 0.4190211247187108, + 0.4130092076957226, + 1.6312491931021214, + 0.0, + 0.07252180203795433, + 0.4035326149314642, + 0.18981079012155533, + 1.0704564936459064, + 0.6137266457080841, + 0.8530916329473257, + 0.07458218559622765, + 0.052889686077833176, + 1.4210357030387968, + 0.3333766348659992, + 0.05911291390657425, + 0.03960780054330826 + ], + "unique_experts": 58, + "load_cv": 0.9934682514638636, + "normalized_load_entropy": 0.8906616806089738, + "max_load_share": 0.07552083333333333 + } + }, + "s0_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "afa846b124050def72c18fdc15a57cd04cc2647e0ba1f5b8c9773ac5c1e61220", + "route_weight_sha256": "499eb19ffcdec1996346a9cb3b28e68cfbae73ac7eeecaebb6793ac117928098", + "loads": [ + 0, + 6, + 7, + 0, + 2, + 11, + 2, + 0, + 0, + 0, + 2, + 0, + 2, + 1, + 3, + 15, + 0, + 0, + 0, + 2, + 5, + 2, + 1, + 1, + 0, + 1, + 0, + 0, + 0, + 0, + 0, + 0, + 0, + 0, + 0, + 0, + 0, + 16, + 15, + 0, + 0, + 0, + 0, + 0, + 5, + 0, + 0, + 5, + 6, + 2, + 0, + 0, + 2, + 1, + 3, + 2, + 8, + 5, + 0, + 0, + 0, + 4, + 0, + 1 + ], + "weighted_loads": [ + 0.0, + 0.3344058245420456, + 0.3714383579790592, + 0.0, + 0.10178733244538307, + 0.9493285641074181, + 0.25737592577934265, + 0.0, + 0.0, + 0.0, + 0.08154595270752907, + 0.0, + 0.09929526597261429, + 0.04637428745627403, + 0.20807700604200363, + 1.2824745289981365, + 0.0, + 0.0, + 0.0, + 0.14094281569123268, + 0.33082667738199234, + 0.08554225414991379, + 0.03229571878910065, + 0.059713780879974365, + 0.0, + 0.027728788554668427, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 1.3932844046503305, + 2.0028615072369576, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.29393476247787476, + 0.0, + 0.0, + 0.2940841391682625, + 0.4093325808644295, + 0.09997420012950897, + 0.0, + 0.0, + 0.07874812185764313, + 0.02411067858338356, + 0.17032156512141228, + 0.08430162072181702, + 0.5590162388980389, + 0.2875244691967964, + 0.0, + 0.0, + 0.0, + 0.2116735428571701, + 0.0, + 0.03673981875181198 + ], + "unique_experts": 30, + "load_cv": 1.7298666316589357, + "normalized_load_entropy": 0.7307929202862201, + "max_load_share": 0.11594202898550725 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "6eb1ebc4af55ce39716bd70a8d17b1f30ef2c97c2553d08785cf25572e1ca3e2", + "route_weight_sha256": "9fa21f5f2ecd900cf2617b0b7022633b22ea6fb3cb651aa8411b595f7ee6003a", + "loads": [ + 1, + 7, + 7, + 8, + 10, + 15, + 6, + 4, + 0, + 0, + 2, + 1, + 5, + 1, + 4, + 24, + 2, + 0, + 10, + 2, + 8, + 2, + 9, + 1, + 0, + 9, + 3, + 0, + 0, + 3, + 2, + 1, + 0, + 1, + 1, + 0, + 2, + 18, + 16, + 0, + 2, + 3, + 2, + 4, + 16, + 0, + 1, + 6, + 6, + 2, + 8, + 0, + 2, + 6, + 3, + 5, + 8, + 9, + 1, + 0, + 11, + 7, + 0, + 1 + ], + "weighted_loads": [ + 0.06928541511297226, + 0.35852005146443844, + 0.3714383579790592, + 0.6024489514529705, + 0.4990031085908413, + 1.130100030452013, + 0.3828033357858658, + 0.25526079908013344, + 0.0, + 0.0, + 0.08154595270752907, + 0.6358060836791992, + 0.20390078611671925, + 0.04637428745627403, + 0.25380469113588333, + 1.9711822103708982, + 0.06494607217609882, + 0.0, + 0.8792918249964714, + 0.14094281569123268, + 0.432697344571352, + 0.08554225414991379, + 0.48498009145259857, + 0.059713780879974365, + 0.0, + 0.6689391694962978, + 0.10302968323230743, + 0.0, + 0.0, + 0.09277471154928207, + 0.097313042730093, + 0.01489582285284996, + 0.0, + 0.023041347041726112, + 0.04238731786608696, + 0.0, + 0.0470968633890152, + 1.4507396817207336, + 2.367257721722126, + 0.0, + 0.0774340033531189, + 0.10924335662275553, + 0.1541249305009842, + 0.22270292043685913, + 0.7514312509447336, + 0.0, + 0.1524437814950943, + 0.3097233213484287, + 0.4093325808644295, + 0.09997420012950897, + 1.02553441375494, + 0.0, + 0.07874812185764313, + 0.27706820145249367, + 0.17032156512141228, + 0.517125453799963, + 0.5590162388980389, + 0.4116173963993788, + 0.03965134173631668, + 0.0, + 1.282238308340311, + 0.4026767797768116, + 0.0, + 0.03673981875181198 + ], + "unique_experts": 51, + "load_cv": 1.1235415786753713, + "normalized_load_entropy": 0.8610674897906505, + "max_load_share": 0.08333333333333333 + } + }, + "s1_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "723d779f5e5a44e1c7dd8616c00688e36817401a546a311bb978cd95f38a152d", + "route_weight_sha256": "c79aac6001e3ccc6023e2144201c1b36e8f8f4434dc914c3af04271b96fc7fc7", + "loads": [ + 0, + 5, + 7, + 0, + 2, + 13, + 2, + 0, + 0, + 0, + 2, + 0, + 2, + 1, + 3, + 15, + 0, + 0, + 0, + 2, + 5, + 2, + 2, + 1, + 0, + 1, + 0, + 0, + 0, + 0, + 0, + 0, + 0, + 0, + 0, + 0, + 0, + 14, + 15, + 0, + 0, + 1, + 0, + 0, + 5, + 0, + 0, + 5, + 7, + 2, + 0, + 0, + 2, + 1, + 4, + 2, + 7, + 4, + 0, + 0, + 0, + 3, + 0, + 1 + ], + "weighted_loads": [ + 0.0, + 0.2846231311559677, + 0.37660091556608677, + 0.0, + 0.10409250296652317, + 1.0539013408124447, + 0.25632984936237335, + 0.0, + 0.0, + 0.0, + 0.08053097128868103, + 0.0, + 0.07876505888998508, + 0.042853761464357376, + 0.20422548428177834, + 1.3316684924066067, + 0.0, + 0.0, + 0.0, + 0.13212227448821068, + 0.3241984136402607, + 0.08770949020981789, + 0.05823830887675285, + 0.05706211179494858, + 0.0, + 0.03116140328347683, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 1.2853542566299438, + 1.9173625893890858, + 0.0, + 0.0, + 0.029907438904047012, + 0.0, + 0.0, + 0.27785687893629074, + 0.0, + 0.0, + 0.2853236049413681, + 0.4679928384721279, + 0.10623929277062416, + 0.0, + 0.0, + 0.07602086290717125, + 0.020918764173984528, + 0.2071022130548954, + 0.09379305690526962, + 0.5066009610891342, + 0.2657001204788685, + 0.0, + 0.0, + 0.0, + 0.1750650592148304, + 0.0, + 0.03641004487872124 + ], + "unique_experts": 31, + "load_cv": 1.7004762296743408, + "normalized_load_entropy": 0.7384760648033906, + "max_load_share": 0.10869565217391304 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "bcffd2977f6a9aa9a48d259c47a1a365895a948226cee84c0990c0da202152f1", + "route_weight_sha256": "26c96cd8e48572b260a107a12bc6fa3e0b6c7f923a8aa31114daada898e6b69a", + "loads": [ + 5, + 6, + 7, + 11, + 10, + 20, + 4, + 9, + 0, + 2, + 4, + 0, + 3, + 2, + 4, + 30, + 6, + 0, + 10, + 3, + 10, + 3, + 14, + 3, + 1, + 14, + 2, + 1, + 0, + 5, + 0, + 1, + 1, + 0, + 2, + 2, + 3, + 20, + 17, + 5, + 4, + 4, + 2, + 8, + 21, + 1, + 0, + 5, + 7, + 7, + 13, + 0, + 2, + 10, + 5, + 12, + 9, + 11, + 1, + 2, + 12, + 6, + 1, + 1 + ], + "weighted_loads": [ + 0.2727565187960863, + 0.30873735807836056, + 0.37660091556608677, + 0.752104964107275, + 0.5212959703058004, + 1.3956875633448362, + 0.32830164581537247, + 0.5705281924456358, + 0.0, + 0.23401978611946106, + 0.17261626571416855, + 0.0, + 0.1225676629692316, + 0.32694124057888985, + 0.2646174989640713, + 2.474244147539139, + 0.3375472463667393, + 0.0, + 0.9936003237962723, + 0.16616397723555565, + 0.5107348896563053, + 0.12411383911967278, + 0.7600549012422562, + 0.22943874448537827, + 0.020249538123607635, + 1.0031472612172365, + 0.06524177826941013, + 0.03761542588472366, + 0.0, + 0.1343774665147066, + 0.0, + 0.030627697706222534, + 0.049705617129802704, + 0.0, + 0.07628526538610458, + 0.17913683503866196, + 0.10442602448165417, + 1.515172589570284, + 2.3233948089182377, + 0.25528689473867416, + 0.17503933981060982, + 0.17813873291015625, + 0.15144729614257812, + 0.43160180002450943, + 1.2476544342935085, + 0.072789266705513, + 0.0, + 0.2853236049413681, + 0.4679928384721279, + 0.43740638345479965, + 1.6005475595593452, + 0.0, + 0.07602086290717125, + 0.3870656080543995, + 0.23466094210743904, + 1.1285884864628315, + 0.5902101173996925, + 0.8105454426258802, + 0.03674850985407829, + 0.052889686077833176, + 1.4191437140107155, + 0.3813059814274311, + 0.05911291390657425, + 0.03641004487872124 + ], + "unique_experts": 56, + "load_cv": 1.0180659769058846, + "normalized_load_entropy": 0.8857273361858251, + "max_load_share": 0.078125 + } + }, + "s0_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "7e4257fecfb2631579246d0d2e9946d2b03e15485ba1f8d7f01f3a56ac118f82", + "route_weight_sha256": "4ca3eca87f5253cd79aa018f20744bc9995cad281925c92a75bb9952c407a59d", + "loads": [ + 0, + 6, + 7, + 0, + 2, + 11, + 2, + 0, + 0, + 0, + 2, + 0, + 2, + 1, + 3, + 15, + 0, + 0, + 0, + 2, + 5, + 2, + 1, + 1, + 0, + 1, + 0, + 0, + 0, + 0, + 0, + 0, + 0, + 0, + 0, + 0, + 0, + 16, + 15, + 0, + 0, + 0, + 0, + 0, + 5, + 0, + 0, + 5, + 6, + 2, + 0, + 0, + 2, + 1, + 2, + 2, + 9, + 5, + 0, + 0, + 0, + 4, + 0, + 1 + ], + "weighted_loads": [ + 0.0, + 0.335149671882391, + 0.3828516136854887, + 0.0, + 0.10832087509334087, + 0.898941807448864, + 0.2598043382167816, + 0.0, + 0.0, + 0.0, + 0.07009530067443848, + 0.0, + 0.08699977211654186, + 0.043983906507492065, + 0.20148567110300064, + 1.2800925225019455, + 0.0, + 0.0, + 0.0, + 0.11861930042505264, + 0.31851254031062126, + 0.08291230723261833, + 0.031356338411569595, + 0.05678867548704147, + 0.0, + 0.02802160196006298, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 1.389666836708784, + 1.8769058249890804, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.28908954560756683, + 0.0, + 0.0, + 0.29149504378437996, + 0.4085415378212929, + 0.09948335587978363, + 0.0, + 0.0, + 0.09741564095020294, + 0.024226361885666847, + 0.12249214947223663, + 0.08196760341525078, + 0.6158292479813099, + 0.29013286903500557, + 0.0, + 0.0, + 0.0, + 0.22123616188764572, + 0.0, + 0.03763952478766441 + ], + "unique_experts": 30, + "load_cv": 1.741483914821742, + "normalized_load_entropy": 0.7286498798142185, + "max_load_share": 0.11594202898550725 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "ddd822e2f1d9f47c2ca97b594a0066855198e415494b5e32ef9039d2358e6639", + "route_weight_sha256": "a606324fed7e79d1511895ad3177d33e476090cdcc54fef473f5e4269c657188", + "loads": [ + 1, + 8, + 7, + 8, + 11, + 13, + 7, + 5, + 0, + 0, + 2, + 0, + 5, + 2, + 4, + 22, + 2, + 0, + 11, + 2, + 8, + 2, + 8, + 1, + 0, + 9, + 1, + 0, + 0, + 5, + 1, + 0, + 0, + 1, + 1, + 0, + 3, + 18, + 16, + 0, + 2, + 2, + 2, + 2, + 17, + 0, + 0, + 5, + 6, + 3, + 8, + 0, + 2, + 6, + 2, + 6, + 10, + 10, + 1, + 0, + 12, + 7, + 0, + 1 + ], + "weighted_loads": [ + 0.05559108406305313, + 0.39804442040622234, + 0.3828516136854887, + 0.6024489514529705, + 0.6313244011253119, + 0.9739566072821617, + 0.4224253334105015, + 0.2864087224006653, + 0.0, + 0.0, + 0.07009530067443848, + 0.0, + 0.2270306646823883, + 0.07133036479353905, + 0.23741863295435905, + 1.7832948733121157, + 0.06494607217609882, + 0.0, + 0.9787308648228645, + 0.11861930042505264, + 0.4203832074999809, + 0.08291230723261833, + 0.4586004801094532, + 0.05678867548704147, + 0.0, + 0.6718615125864744, + 0.017446184530854225, + 0.0, + 0.0, + 0.15946075692772865, + 0.05446213111281395, + 0.0, + 0.0, + 0.023041347041726112, + 0.03710019215941429, + 0.0, + 0.08147739991545677, + 1.4471221137791872, + 2.241302039474249, + 0.0, + 0.06529751606285572, + 0.1068745031952858, + 0.1510549783706665, + 0.10736505687236786, + 0.7849094700068235, + 0.0, + 0.0, + 0.29149504378437996, + 0.4085415378212929, + 0.13848477602005005, + 1.0179744623601437, + 0.0, + 0.09741564095020294, + 0.26703878305852413, + 0.12249214947223663, + 0.5648475326597691, + 0.6599070429801941, + 0.46707758866250515, + 0.03965134173631668, + 0.0, + 1.4693537838757038, + 0.4102754779160023, + 0.0, + 0.03763952478766441 + ], + "unique_experts": 48, + "load_cv": 1.1297055226479307, + "normalized_load_entropy": 0.8522295268140317, + "max_load_share": 0.0763888888888889 + } + }, + "s1_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "a1d82a66344d76e0338b83bebbc5d274e149e5ca8c5b7fd0b0cd4a6028e37fad", + "route_weight_sha256": "21db807bd6be475914d905ed9ae97509e4f723a05637a913b478cf4f58abac81", + "loads": [ + 0, + 5, + 7, + 0, + 3, + 14, + 2, + 0, + 0, + 0, + 2, + 0, + 2, + 1, + 3, + 15, + 0, + 0, + 0, + 2, + 4, + 2, + 1, + 1, + 0, + 0, + 0, + 0, + 0, + 0, + 0, + 0, + 0, + 0, + 0, + 0, + 0, + 15, + 15, + 0, + 0, + 0, + 0, + 0, + 5, + 0, + 0, + 5, + 6, + 2, + 0, + 0, + 2, + 1, + 3, + 2, + 8, + 5, + 0, + 0, + 0, + 4, + 0, + 1 + ], + "weighted_loads": [ + 0.0, + 0.269303634762764, + 0.3740422260016203, + 0.0, + 0.16019469127058983, + 1.0996115691959858, + 0.2632352188229561, + 0.0, + 0.0, + 0.0, + 0.0800270102918148, + 0.0, + 0.06963996216654778, + 0.04453807696700096, + 0.1974041573703289, + 1.280212763696909, + 0.0, + 0.0, + 0.0, + 0.11609716713428497, + 0.27344537526369095, + 0.08480997756123543, + 0.03132035210728645, + 0.05200894549489021, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 1.322725109755993, + 1.7753854840993881, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.2787543721497059, + 0.0, + 0.0, + 0.28207286447286606, + 0.4040055051445961, + 0.10309180244803429, + 0.0, + 0.0, + 0.08031018823385239, + 0.02332727238535881, + 0.1574045680463314, + 0.07711784914135933, + 0.5719704497605562, + 0.29581188410520554, + 0.0, + 0.0, + 0.0, + 0.20222382247447968, + 0.0, + 0.04039996862411499 + ], + "unique_experts": 29, + "load_cv": 1.7568541322272506, + "normalized_load_entropy": 0.7246362867889249, + "max_load_share": 0.10869565217391304 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "85457895f5afee858fa666f6169bacff37955071de5bab5b8f3c2e7c32af2f33", + "route_weight_sha256": "f83c6d61d31389601dee180d36f438e22e3eea0ae3e6d4d4f567a94cb5cda8dc", + "loads": [ + 5, + 6, + 7, + 12, + 13, + 21, + 5, + 9, + 0, + 2, + 4, + 0, + 4, + 2, + 4, + 29, + 7, + 0, + 11, + 3, + 7, + 4, + 12, + 3, + 2, + 15, + 1, + 2, + 0, + 5, + 0, + 1, + 1, + 0, + 1, + 2, + 3, + 21, + 17, + 4, + 3, + 2, + 2, + 5, + 21, + 1, + 0, + 5, + 6, + 6, + 13, + 0, + 2, + 9, + 4, + 12, + 11, + 13, + 1, + 2, + 13, + 6, + 1, + 1 + ], + "weighted_loads": [ + 0.2366566676646471, + 0.2934178616851568, + 0.3740422260016203, + 0.7843181416392326, + 0.7202317155897617, + 1.4348200503736734, + 0.3740757890045643, + 0.538566118106246, + 0.0, + 0.23401978611946106, + 0.17211230471730232, + 0.0, + 0.16613417118787766, + 0.32862555608153343, + 0.25779617205262184, + 2.3248593509197235, + 0.480526652187109, + 0.0, + 1.1054776310920715, + 0.15013886988162994, + 0.3834455944597721, + 0.15296784788370132, + 0.6863174289464951, + 0.2243855781853199, + 0.05860790237784386, + 0.9762120880186558, + 0.017446184530854225, + 0.0721595361828804, + 0.0, + 0.1343774665147066, + 0.0, + 0.030627697706222534, + 0.049705617129802704, + 0.0, + 0.02799680456519127, + 0.17913683503866196, + 0.10442602448165417, + 1.5487724281847477, + 2.18141770362854, + 0.19725923985242844, + 0.13755257055163383, + 0.12120498344302177, + 0.13793063908815384, + 0.25790178775787354, + 1.2139170933514833, + 0.072789266705513, + 0.0, + 0.28207286447286606, + 0.4040055051445961, + 0.3434029892086983, + 1.4342152886092663, + 0.0, + 0.08031018823385239, + 0.3594318851828575, + 0.18496329709887505, + 1.099027767777443, + 0.7088986989110708, + 0.8865777160972357, + 0.03674850985407829, + 0.052889686077833176, + 1.5112716406583786, + 0.35986191406846046, + 0.05911291390657425, + 0.04039996862411499 + ], + "unique_experts": 56, + "load_cv": 1.0370732053878036, + "normalized_load_entropy": 0.8820438193494544, + "max_load_share": 0.07552083333333333 + } + }, + "s0_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "ed69cf7ca4680a8d80b0bfa2336a5ca3b7db36fad0082a729444bbf02ad513ab", + "route_weight_sha256": "fe01efdc2da5d671f8dacb6e6f76939ed09ce77a4f26a3dfe36e403487fa4a5a", + "loads": [ + 0, + 6, + 7, + 0, + 2, + 10, + 2, + 0, + 0, + 0, + 2, + 0, + 2, + 1, + 3, + 15, + 0, + 0, + 0, + 2, + 5, + 2, + 1, + 1, + 0, + 1, + 0, + 0, + 0, + 0, + 0, + 0, + 0, + 0, + 0, + 0, + 0, + 16, + 16, + 0, + 0, + 0, + 0, + 0, + 5, + 0, + 0, + 5, + 6, + 2, + 0, + 0, + 2, + 1, + 2, + 2, + 9, + 5, + 0, + 0, + 0, + 4, + 0, + 1 + ], + "weighted_loads": [ + 0.0, + 0.3383715823292732, + 0.3904146570712328, + 0.0, + 0.10111440531909466, + 0.8850745186209679, + 0.2575703412294388, + 0.0, + 0.0, + 0.0, + 0.0687771588563919, + 0.0, + 0.0890444926917553, + 0.045371800661087036, + 0.2025967687368393, + 1.2324348874390125, + 0.0, + 0.0, + 0.0, + 0.1243465431034565, + 0.3137037567794323, + 0.0842725895345211, + 0.03125634044408798, + 0.059374868869781494, + 0.0, + 0.02744223363697529, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 1.3961669392883778, + 1.9104052148759365, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.29032639786601067, + 0.0, + 0.0, + 0.2911280393600464, + 0.38995029404759407, + 0.10243422165513039, + 0.0, + 0.0, + 0.09842995181679726, + 0.027902528643608093, + 0.12717998772859573, + 0.07672652788460255, + 0.626853697001934, + 0.29760393872857094, + 0.0, + 0.0, + 0.0, + 0.21268154308199883, + 0.0, + 0.04094754159450531 + ], + "unique_experts": 30, + "load_cv": 1.7511061106615016, + "normalized_load_entropy": 0.7279709254546345, + "max_load_share": 0.11594202898550725 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "b860bbe31ecafbb932f78b399177c33ba5c864190b6d00e47ccfbcaa833893c0", + "route_weight_sha256": "9d64e8136e074239016474092410bbfeae330b356483eb24003a59ab3c60b23d", + "loads": [ + 1, + 8, + 7, + 8, + 11, + 13, + 7, + 7, + 0, + 0, + 2, + 0, + 5, + 1, + 3, + 22, + 2, + 0, + 10, + 2, + 9, + 2, + 8, + 1, + 0, + 9, + 1, + 0, + 0, + 4, + 1, + 0, + 0, + 1, + 1, + 0, + 2, + 18, + 17, + 1, + 2, + 2, + 2, + 2, + 18, + 0, + 0, + 5, + 6, + 3, + 9, + 0, + 2, + 6, + 2, + 5, + 10, + 9, + 1, + 0, + 11, + 8, + 0, + 1 + ], + "weighted_loads": [ + 0.04877747222781181, + 0.4023966062813997, + 0.3904146570712328, + 0.6024489514529705, + 0.5438435543328524, + 0.9934567734599113, + 0.4351676478981972, + 0.48855824023485184, + 0.0, + 0.0, + 0.0687771588563919, + 0.0, + 0.23611765913665295, + 0.045371800661087036, + 0.2025967687368393, + 1.7267453391104937, + 0.06494607217609882, + 0.0, + 0.8792918249964714, + 0.1243465431034565, + 0.4587585926055908, + 0.0842725895345211, + 0.4777400344610214, + 0.059374868869781494, + 0.0, + 0.7419058103114367, + 0.017446184530854225, + 0.0, + 0.0, + 0.1268811672925949, + 0.05428946018218994, + 0.0, + 0.0, + 0.023041347041726112, + 0.037645045667886734, + 0.0, + 0.0470968633890152, + 1.4536222163587809, + 2.274801429361105, + 0.042757533490657806, + 0.09462202712893486, + 0.1108672246336937, + 0.15356552600860596, + 0.10240547358989716, + 0.8335838820785284, + 0.0, + 0.0, + 0.2911280393600464, + 0.38995029404759407, + 0.16610565409064293, + 1.0451464131474495, + 0.0, + 0.09842995181679726, + 0.2621590606868267, + 0.12717998772859573, + 0.5361713599413633, + 0.675025288015604, + 0.4216968659311533, + 0.03965134173631668, + 0.0, + 1.282238308340311, + 0.4377591162919998, + 0.0, + 0.04094754159450531 + ], + "unique_experts": 49, + "load_cv": 1.1446332098909175, + "normalized_load_entropy": 0.8507783349289123, + "max_load_share": 0.0763888888888889 + } + }, + "s1_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "de942ba3a17d69b8f93003c4e902f43f13099398f9ade6ceba5e9d2afbfa4b19", + "route_weight_sha256": "203ada3ef4d59a8bf007df40edcbcbba3957ccfbbe2602d668828a039a2c56b1", + "loads": [ + 0, + 5, + 7, + 0, + 2, + 14, + 3, + 0, + 0, + 0, + 2, + 0, + 2, + 1, + 3, + 15, + 0, + 0, + 0, + 2, + 5, + 2, + 1, + 1, + 0, + 1, + 0, + 0, + 0, + 0, + 0, + 0, + 0, + 0, + 0, + 0, + 0, + 15, + 14, + 0, + 0, + 0, + 0, + 0, + 5, + 0, + 0, + 5, + 6, + 2, + 0, + 0, + 2, + 1, + 4, + 1, + 8, + 5, + 0, + 0, + 0, + 3, + 0, + 1 + ], + "weighted_loads": [ + 0.0, + 0.27446774020791054, + 0.38074139319360256, + 0.0, + 0.12208905816078186, + 1.0736045241355896, + 0.31128233671188354, + 0.0, + 0.0, + 0.0, + 0.0751146487891674, + 0.0, + 0.08236540295183659, + 0.04456049203872681, + 0.1966082751750946, + 1.2442944832146168, + 0.0, + 0.0, + 0.0, + 0.1207990050315857, + 0.3171323761343956, + 0.0858316458761692, + 0.03077155165374279, + 0.05219255015254021, + 0.0, + 0.033021263778209686, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 1.339747041463852, + 1.7885612472891808, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.27435189858078957, + 0.0, + 0.0, + 0.27957942709326744, + 0.4073128327727318, + 0.10164861008524895, + 0.0, + 0.0, + 0.07952126860618591, + 0.024286450818181038, + 0.18817191198468208, + 0.027150791138410568, + 0.5900516342371702, + 0.28941725194454193, + 0.0, + 0.0, + 0.0, + 0.16364546865224838, + 0.0, + 0.0399756133556366 + ], + "unique_experts": 30, + "load_cv": 1.7356849928644733, + "normalized_load_entropy": 0.7290937137827467, + "max_load_share": 0.10869565217391304 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "0efa96e02248c444762ac368864b99462b1d9058b682e54421380277fb1e951d", + "route_weight_sha256": "67e3cd3ec70378fd9ff4632ec426d528639aab4074285d5a7f8f314cf9a27724", + "loads": [ + 5, + 6, + 7, + 11, + 10, + 20, + 6, + 10, + 0, + 2, + 4, + 0, + 5, + 2, + 4, + 28, + 5, + 0, + 10, + 3, + 9, + 3, + 12, + 3, + 1, + 17, + 1, + 1, + 0, + 6, + 0, + 1, + 1, + 0, + 1, + 2, + 3, + 24, + 16, + 5, + 4, + 2, + 2, + 6, + 20, + 1, + 0, + 5, + 6, + 7, + 13, + 0, + 2, + 9, + 5, + 12, + 10, + 12, + 1, + 2, + 13, + 6, + 1, + 1 + ], + "weighted_loads": [ + 0.23936094902455807, + 0.2985819671303034, + 0.38074139319360256, + 0.752104964107275, + 0.5392925255000591, + 1.3357933964580297, + 0.4207399934530258, + 0.620977682992816, + 0.0, + 0.23401978611946106, + 0.16719994321465492, + 0.0, + 0.23549752496182919, + 0.3286479711532593, + 0.25700028985738754, + 2.240953464061022, + 0.3052198998630047, + 0.0, + 0.9936003237962723, + 0.15484070777893066, + 0.47790420055389404, + 0.1222359947860241, + 0.6720929238945246, + 0.2245691828429699, + 0.020249538123607635, + 1.0769958831369877, + 0.017446184530854225, + 0.03761542588472366, + 0.0, + 0.16402472369372845, + 0.0, + 0.030627697706222534, + 0.049705617129802704, + 0.0, + 0.02799680456519127, + 0.17913683503866196, + 0.10442602448165417, + 1.6799734719097614, + 2.1945934668183327, + 0.24541863799095154, + 0.17550931870937347, + 0.16085050627589226, + 0.13938090577721596, + 0.3166712149977684, + 1.1662776172161102, + 0.072789266705513, + 0.0, + 0.27957942709326744, + 0.4073128327727318, + 0.42570260912179947, + 1.472242534160614, + 0.0, + 0.07952126860618591, + 0.34481848962605, + 0.21573064103722572, + 1.0506462939083576, + 0.6803831811994314, + 0.8342625740915537, + 0.03674850985407829, + 0.052889686077833176, + 1.4622895456850529, + 0.34396491572260857, + 0.05911291390657425, + 0.0399756133556366 + ], + "unique_experts": 56, + "load_cv": 1.0290907529357056, + "normalized_load_entropy": 0.8825164731905876, + "max_load_share": 0.07291666666666667 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "ordered_topk_exact_tokens": 16, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.9130434782608695, + "mean_token_weighted_tv": 0.019901097347231014, + "aggregate_load_tv": 0.03623188405797101 + }, + "system_bos": { + "tokens": 23, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.9254658385093169, + "mean_token_weighted_tv": 0.023683127137305943, + "aggregate_load_tv": 0.04347826086956523 + }, + "system_x": { + "tokens": 23, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.9254658385093167, + "mean_token_weighted_tv": 0.026220018975436687, + "aggregate_load_tv": 0.03623188405797102 + }, + "system_period": { + "tokens": 23, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.9161490683229813, + "mean_token_weighted_tv": 0.027786755812880787, + "aggregate_load_tv": 0.050724637681159424 + }, + "bos_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.9254658385093169, + "mean_token_weighted_tv": 0.022855543410000595, + "aggregate_load_tv": 0.03623188405797101 + }, + "bos_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 12, + "mean_set_jaccard": 0.8633540372670809, + "mean_token_weighted_tv": 0.03263046268535697, + "aggregate_load_tv": 0.05797101449275362 + }, + "x_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.9130434782608695, + "mean_token_weighted_tv": 0.023752451995792595, + "aggregate_load_tv": 0.03623188405797101 + }, + "x_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8881987577639753, + "mean_token_weighted_tv": 0.032595887213297516, + "aggregate_load_tv": 0.04347826086956522 + }, + "period_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.9130434782608695, + "mean_token_weighted_tv": 0.023872851151163162, + "aggregate_load_tv": 0.036231884057971016 + }, + "period_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8788819875776398, + "mean_token_weighted_tv": 0.03553991801226917, + "aggregate_load_tv": 0.05072463768115942 + } + } + }, + "layer_21": { + "layer": 21, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "67775c9c4075a399dc6402287ed72004878d81a5a938010b2d3a7e8ef7e6fd96", + "route_weight_sha256": "da9d9e2df0207400b311436d299d5cd86ab0adfdabbe1944c1fa004e80cc57aa", + "loads": [ + 5, + 2, + 2, + 0, + 1, + 0, + 5, + 0, + 14, + 1, + 1, + 1, + 0, + 1, + 0, + 6, + 1, + 1, + 2, + 11, + 0, + 0, + 1, + 0, + 0, + 1, + 6, + 0, + 5, + 0, + 1, + 0, + 0, + 2, + 4, + 3, + 0, + 0, + 1, + 0, + 17, + 0, + 4, + 1, + 0, + 5, + 0, + 1, + 2, + 6, + 0, + 9, + 0, + 1, + 2, + 0, + 2, + 0, + 4, + 0, + 1, + 2, + 2, + 1 + ], + "weighted_loads": [ + 0.23879806511104107, + 0.06773405149579048, + 0.5317100584506989, + 0.0, + 0.03214727342128754, + 0.0, + 0.31593025103211403, + 0.0, + 0.932318665087223, + 0.022211624309420586, + 0.026770086959004402, + 0.047468483448028564, + 0.0, + 0.15236277878284454, + 0.0, + 0.7960814386606216, + 0.031242113560438156, + 0.037523943930864334, + 0.13655994646251202, + 0.5734457243233919, + 0.0, + 0.0, + 0.03387220948934555, + 0.0, + 0.0, + 0.19187913835048676, + 0.40727374330163, + 0.0, + 0.5223510582000017, + 0.0, + 0.03204880282282829, + 0.0, + 0.0, + 0.1858000084757805, + 0.36736541986465454, + 0.08707025274634361, + 0.0, + 0.0, + 0.14372217655181885, + 0.0, + 1.4422466363757849, + 0.0, + 0.4020891562104225, + 0.08452979475259781, + 0.0, + 0.24073530733585358, + 0.0, + 0.03385763242840767, + 0.06831654906272888, + 0.3495509885251522, + 0.0, + 0.8683943189680576, + 0.0, + 0.026982197538018227, + 0.12667718529701233, + 0.0, + 0.06379906460642815, + 0.0, + 0.2748922314494848, + 0.0, + 0.048273466527462006, + 0.06426187232136726, + 0.07153695449233055, + 0.0624963641166687 + ], + "unique_experts": 40, + "load_cv": 1.5408053333904081, + "normalized_load_entropy": 0.7872955200415973, + "max_load_share": 0.12318840579710146 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "ec214e7925cb90a68cec3d0e41c3b629e608127542387e9eb3d536ac8ef7aa38", + "route_weight_sha256": "c9e8244e12d61da4989249d8f71b6b97748b6cbdd8f1692a7d40a96739447f82", + "loads": [ + 5, + 2, + 5, + 0, + 9, + 0, + 8, + 0, + 17, + 1, + 9, + 1, + 2, + 7, + 1, + 11, + 2, + 6, + 3, + 15, + 0, + 8, + 1, + 0, + 0, + 3, + 15, + 5, + 8, + 0, + 1, + 0, + 1, + 2, + 5, + 12, + 0, + 1, + 1, + 0, + 18, + 0, + 10, + 1, + 0, + 5, + 0, + 1, + 14, + 8, + 0, + 16, + 10, + 2, + 7, + 2, + 4, + 0, + 8, + 2, + 2, + 3, + 7, + 1 + ], + "weighted_loads": [ + 0.23879806511104107, + 0.06773405149579048, + 0.5955762711819261, + 0.0, + 0.3252559434622526, + 0.0, + 0.5635312460362911, + 0.0, + 1.0965383239090443, + 0.022211624309420586, + 0.6208925787359476, + 0.047468483448028564, + 0.1233532577753067, + 0.6253864578902721, + 0.02360578626394272, + 0.9540020450949669, + 0.044511654414236546, + 0.24128025770187378, + 0.16909688524901867, + 2.1364624816924334, + 0.0, + 0.4734626612626016, + 0.03387220948934555, + 0.0, + 0.0, + 0.2601068243384361, + 0.8049122355878353, + 0.7404525987803936, + 0.5826909765601158, + 0.0, + 0.03204880282282829, + 0.0, + 0.022792797535657883, + 0.1858000084757805, + 0.41496482864022255, + 0.638197798281908, + 0.0, + 0.028133975341916084, + 0.14372217655181885, + 0.0, + 1.5104482304304838, + 0.0, + 0.7246560901403427, + 0.08452979475259781, + 0.0, + 0.24073530733585358, + 0.0, + 0.03385763242840767, + 0.7523697726428509, + 0.5090009905397892, + 0.0, + 1.1863713636994362, + 0.6187385097146034, + 0.03999769315123558, + 0.3599160900339484, + 0.23020149022340775, + 0.14083275571465492, + 0.0, + 0.44669996201992035, + 0.08968573436141014, + 0.07070627063512802, + 0.10787105932831764, + 0.3075830675661564, + 0.0624963641166687 + ], + "unique_experts": 49, + "load_cv": 1.0971343143406387, + "normalized_load_entropy": 0.8556340233376867, + "max_load_share": 0.0625 + } + }, + "s1_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "606b5a6a24c1a6a307bb4a76dd6b9ffb8e4902523ac17760f42896d32cd4a011", + "route_weight_sha256": "1789bfb8d7adc8e99a9ad0c3d67f3f839b1fad7d5436f61028d1631040fbddd5", + "loads": [ + 6, + 2, + 2, + 0, + 1, + 0, + 4, + 1, + 13, + 1, + 0, + 1, + 0, + 1, + 0, + 6, + 1, + 1, + 2, + 11, + 0, + 0, + 1, + 0, + 0, + 2, + 6, + 0, + 6, + 0, + 1, + 0, + 0, + 2, + 4, + 1, + 0, + 1, + 1, + 0, + 16, + 0, + 4, + 1, + 0, + 6, + 0, + 0, + 2, + 6, + 0, + 9, + 0, + 2, + 2, + 0, + 2, + 0, + 4, + 0, + 1, + 2, + 2, + 1 + ], + "weighted_loads": [ + 0.2489043902605772, + 0.0707843117415905, + 0.5441623032093048, + 0.0, + 0.03068380057811737, + 0.0, + 0.28071339800953865, + 0.029467400163412094, + 0.8819794654846191, + 0.023234300315380096, + 0.0, + 0.044268619269132614, + 0.0, + 0.14498858153820038, + 0.0, + 0.7702098898589611, + 0.030293406918644905, + 0.03360287845134735, + 0.13521165400743484, + 0.5391536522656679, + 0.0, + 0.0, + 0.035953931510448456, + 0.0, + 0.0, + 0.2370259389281273, + 0.3930593393743038, + 0.0, + 0.5394049528986216, + 0.0, + 0.03182611241936684, + 0.0, + 0.0, + 0.18286874145269394, + 0.37556133419275284, + 0.028784876689314842, + 0.0, + 0.03218930587172508, + 0.13781379163265228, + 0.0, + 1.4019139185547829, + 0.0, + 0.4226589035242796, + 0.06865985691547394, + 0.0, + 0.2931661829352379, + 0.0, + 0.0, + 0.06971240043640137, + 0.33361954614520073, + 0.0, + 0.8811236694455147, + 0.0, + 0.05525304935872555, + 0.1322259157896042, + 0.0, + 0.06091315485537052, + 0.0, + 0.27505848556756973, + 0.0, + 0.04665139690041542, + 0.06540727242827415, + 0.06796525791287422, + 0.06545243412256241 + ], + "unique_experts": 40, + "load_cv": 1.4987917839360487, + "normalized_load_entropy": 0.7913392945115948, + "max_load_share": 0.11594202898550725 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "550e353b747bf14cef434986ec370d8818f143c1429ecd83cd8bb7abeff0bd6e", + "route_weight_sha256": "79a3cbe354e205ddb80f401eee515d7dab00148a11a11d9c74b94a284455d4f4", + "loads": [ + 14, + 3, + 5, + 0, + 2, + 1, + 8, + 2, + 16, + 3, + 11, + 1, + 5, + 13, + 5, + 9, + 2, + 10, + 5, + 15, + 1, + 9, + 3, + 5, + 1, + 5, + 14, + 10, + 9, + 1, + 7, + 0, + 1, + 6, + 4, + 17, + 1, + 2, + 2, + 1, + 16, + 2, + 14, + 2, + 1, + 7, + 0, + 0, + 14, + 10, + 2, + 19, + 10, + 3, + 16, + 8, + 7, + 0, + 7, + 4, + 1, + 4, + 6, + 2 + ], + "weighted_loads": [ + 0.7576629091054201, + 0.11880305036902428, + 1.2378425979986787, + 0.0, + 0.06579561531543732, + 0.01571771129965782, + 0.4772862046957016, + 0.11105871573090553, + 1.0217222087085247, + 0.16885660588741302, + 0.659889928996563, + 0.044268619269132614, + 0.2487141117453575, + 0.8915920443832874, + 0.18438689410686493, + 0.8590410565957427, + 0.043562947772443295, + 0.3699015863239765, + 0.22560101561248302, + 2.0727976504713297, + 0.0464911051094532, + 0.5003826948814094, + 0.09883693419396877, + 0.4943256191909313, + 0.03564826771616936, + 0.3425674606114626, + 0.6808905079960823, + 1.1949440985918045, + 0.5748318457044661, + 0.04883778095245361, + 0.2675321754068136, + 0.0, + 0.022789930924773216, + 0.7811272069811821, + 0.37556133419275284, + 0.9150257837027311, + 0.07065285742282867, + 0.07251662760972977, + 0.1921660639345646, + 0.0381038673222065, + 1.4019139185547829, + 0.12669584900140762, + 0.8936344888061285, + 0.11738556250929832, + 0.06502456218004227, + 0.35252660512924194, + 0.0, + 0.0, + 0.9739217832684517, + 1.2612046040594578, + 0.08005453087389469, + 1.6037173308432102, + 0.5828217566013336, + 0.0682685449719429, + 0.9628138756379485, + 0.578562792390585, + 0.2587186936289072, + 0.0, + 0.4151031319051981, + 0.210040844976902, + 0.04665139690041542, + 0.17376386374235153, + 0.23406332358717918, + 0.15191592276096344 + ], + "unique_experts": 59, + "load_cv": 0.8670271686118672, + "normalized_load_entropy": 0.9069815238689513, + "max_load_share": 0.049479166666666664 + } + }, + "s0_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "966bfaff03f890bf2c883c8e38a61f6ac6d107d623e343b6b33492424ce44570", + "route_weight_sha256": "5fa40d2696f2d15eac7cc6dca272891f0a34bae9063ab5617ab8a49228b076ea", + "loads": [ + 3, + 2, + 2, + 0, + 1, + 0, + 5, + 1, + 13, + 0, + 0, + 1, + 0, + 2, + 0, + 6, + 1, + 1, + 3, + 11, + 0, + 0, + 1, + 0, + 0, + 3, + 8, + 0, + 5, + 0, + 2, + 0, + 0, + 2, + 4, + 2, + 0, + 0, + 1, + 0, + 17, + 0, + 4, + 1, + 0, + 4, + 0, + 0, + 2, + 6, + 0, + 9, + 0, + 1, + 2, + 0, + 2, + 0, + 4, + 0, + 1, + 2, + 2, + 1 + ], + "weighted_loads": [ + 0.17455266788601875, + 0.06327699683606625, + 0.537024736404419, + 0.0, + 0.03095897287130356, + 0.0, + 0.3270885609090328, + 0.03233087435364723, + 0.908831037580967, + 0.0, + 0.0, + 0.052123524248600006, + 0.0, + 0.22651521861553192, + 0.0, + 0.8087860234081745, + 0.03561055660247803, + 0.03412231430411339, + 0.16700012050569057, + 0.5514465533196926, + 0.0, + 0.0, + 0.035057805478572845, + 0.0, + 0.0, + 0.26398006826639175, + 0.4877797272056341, + 0.0, + 0.5493012629449368, + 0.0, + 0.06742600351572037, + 0.0, + 0.0, + 0.18865998834371567, + 0.37340301275253296, + 0.05551200173795223, + 0.0, + 0.0, + 0.1440369337797165, + 0.0, + 1.48122763261199, + 0.0, + 0.4124917984008789, + 0.07293110340833664, + 0.0, + 0.21041401848196983, + 0.0, + 0.0, + 0.06980928033590317, + 0.3429830316454172, + 0.0, + 0.886958334594965, + 0.0, + 0.023746432736516, + 0.1269061639904976, + 0.0, + 0.062289951369166374, + 0.0, + 0.2781201582401991, + 0.0, + 0.04742567986249924, + 0.07457725331187248, + 0.0721547082066536, + 0.0659194067120552 + ], + "unique_experts": 38, + "load_cv": 1.527662728860169, + "normalized_load_entropy": 0.7853831209133918, + "max_load_share": 0.12318840579710146 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "1041b4881793d863b97fd1e2d646b9843012f60ec32bea28f509e9d7bef8343c", + "route_weight_sha256": "c98a56b4ba03d65bdc5f753d064e5ae497dde1ac34b051decc29a6b363f36b55", + "loads": [ + 3, + 3, + 4, + 1, + 7, + 0, + 6, + 1, + 18, + 0, + 7, + 1, + 2, + 7, + 1, + 10, + 2, + 5, + 5, + 13, + 0, + 7, + 1, + 0, + 0, + 4, + 17, + 5, + 7, + 0, + 2, + 3, + 1, + 2, + 5, + 11, + 0, + 1, + 1, + 2, + 20, + 0, + 10, + 1, + 0, + 6, + 0, + 0, + 15, + 8, + 0, + 16, + 10, + 2, + 7, + 2, + 4, + 0, + 6, + 3, + 2, + 3, + 7, + 1 + ], + "weighted_loads": [ + 0.17455266788601875, + 0.10596803389489651, + 0.5984016731381416, + 0.17650486528873444, + 0.2542322687804699, + 0.0, + 0.4939153455197811, + 0.03233087435364723, + 1.13645913079381, + 0.0, + 0.4716772921383381, + 0.052123524248600006, + 0.1233532577753067, + 0.6589713394641876, + 0.02360578626394272, + 0.9526427146047354, + 0.04888009745627642, + 0.17940490320324898, + 0.2555907443165779, + 1.131637517362833, + 0.0, + 0.4740803586319089, + 0.035057805478572845, + 0.0, + 0.0, + 0.2996506430208683, + 0.8854182194918394, + 0.7322112284600735, + 0.6052420204505324, + 0.0, + 0.06742600351572037, + 0.24427005276083946, + 0.022792797535657883, + 0.18865998834371567, + 0.42100242152810097, + 0.6066395472735167, + 0.0, + 0.03651951625943184, + 0.1440369337797165, + 0.086179468780756, + 1.6705630496144295, + 0.0, + 0.7097037434577942, + 0.07293110340833664, + 0.0, + 0.3580301068723202, + 0.0, + 0.0, + 0.8316808864474297, + 0.5051757749170065, + 0.0, + 1.2049353793263435, + 0.6187385097146034, + 0.03676192834973335, + 0.3154380386695266, + 0.23020149022340775, + 0.13370519317686558, + 0.0, + 0.33946771919727325, + 0.11112566106021404, + 0.06985848397016525, + 0.12286706641316414, + 0.29105883836746216, + 0.0659194067120552 + ], + "unique_experts": 51, + "load_cv": 1.0893706417293099, + "normalized_load_entropy": 0.8652956820986462, + "max_load_share": 0.06944444444444445 + } + }, + "s1_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "fa4db2fa10e488e51accbd4e391fa3bcb57fa405782a4c7dafda5403b542c30e", + "route_weight_sha256": "1343c4d2f0598b3f6f425b5d221dd4645372ac60f52cc0185d21a840ac4365dd", + "loads": [ + 6, + 1, + 2, + 0, + 1, + 0, + 5, + 1, + 13, + 0, + 0, + 1, + 0, + 1, + 0, + 8, + 1, + 1, + 3, + 10, + 0, + 0, + 1, + 0, + 0, + 2, + 6, + 0, + 5, + 0, + 2, + 0, + 0, + 2, + 4, + 1, + 0, + 0, + 1, + 0, + 16, + 0, + 3, + 1, + 0, + 5, + 0, + 0, + 2, + 5, + 0, + 9, + 0, + 1, + 3, + 1, + 2, + 0, + 4, + 0, + 1, + 3, + 3, + 1 + ], + "weighted_loads": [ + 0.26824396289885044, + 0.05088520050048828, + 0.5492924451828003, + 0.0, + 0.029877809807658195, + 0.0, + 0.33371996507048607, + 0.03106190264225006, + 0.8611979335546494, + 0.0, + 0.0, + 0.047315724194049835, + 0.0, + 0.1775071918964386, + 0.0, + 0.8812267482280731, + 0.031965453177690506, + 0.03470080345869064, + 0.16786913760006428, + 0.5259316265583038, + 0.0, + 0.0, + 0.03815704584121704, + 0.0, + 0.0, + 0.23762188851833344, + 0.4256669282913208, + 0.0, + 0.5484514981508255, + 0.0, + 0.06417879834771156, + 0.0, + 0.0, + 0.188688263297081, + 0.3521759510040283, + 0.028246253728866577, + 0.0, + 0.0, + 0.1422862559556961, + 0.0, + 1.378615666180849, + 0.0, + 0.3563710879534483, + 0.07086139172315598, + 0.0, + 0.2484169751405716, + 0.0, + 0.0, + 0.07002051919698715, + 0.3174159750342369, + 0.0, + 0.8798810094594955, + 0.0, + 0.024116093292832375, + 0.15647324174642563, + 0.02215093933045864, + 0.05960696376860142, + 0.0, + 0.26556440256536007, + 0.0, + 0.04719487950205803, + 0.10464421473443508, + 0.10532429441809654, + 0.06550886482000351 + ], + "unique_experts": 39, + "load_cv": 1.4897958596477743, + "normalized_load_entropy": 0.7897216223677298, + "max_load_share": 0.11594202898550725 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "afc019ef0156ed693def5a417e25cb067e1636d4de4440a07551cae535daca7b", + "route_weight_sha256": "f9f26bd8c6fe3c7e875a178aec5f2c42230e56ff578a3aa4aa69f93a432815d2", + "loads": [ + 14, + 4, + 4, + 0, + 5, + 1, + 9, + 3, + 16, + 2, + 9, + 2, + 4, + 11, + 4, + 11, + 2, + 7, + 7, + 13, + 1, + 8, + 3, + 5, + 1, + 4, + 14, + 11, + 7, + 1, + 6, + 2, + 1, + 6, + 4, + 17, + 1, + 2, + 2, + 2, + 17, + 2, + 13, + 2, + 1, + 6, + 0, + 0, + 15, + 9, + 2, + 19, + 10, + 2, + 17, + 9, + 6, + 0, + 5, + 5, + 1, + 6, + 9, + 2 + ], + "weighted_loads": [ + 0.7770024817436934, + 0.16827090829610825, + 1.240305868908763, + 0.0, + 0.1882218550890684, + 0.01571771129965782, + 0.5630500540137291, + 0.14908357709646225, + 1.003231130540371, + 0.14562230557203293, + 0.5512452982366085, + 0.10080590844154358, + 0.2134474404156208, + 0.900795191526413, + 0.15029596909880638, + 1.0038296934217215, + 0.045234994031488895, + 0.2817156948149204, + 0.31630781292915344, + 1.1196356490254402, + 0.0464911051094532, + 0.49453195091336966, + 0.10104004852473736, + 0.4943256191909313, + 0.03564826771616936, + 0.3096433486789465, + 0.7134980969130993, + 1.209112025797367, + 0.5795121556147933, + 0.04883778095245361, + 0.21890314109623432, + 0.13614746183156967, + 0.022789930924773216, + 0.7869467288255692, + 0.3521759510040283, + 0.9144871607422829, + 0.07065285742282867, + 0.07049256190657616, + 0.1966385282576084, + 0.05977144092321396, + 1.4234646335244179, + 0.12669584900140762, + 0.8228637296706438, + 0.11958709731698036, + 0.06502456218004227, + 0.30777739733457565, + 0.0, + 0.0, + 1.0203356705605984, + 1.3015555329620838, + 0.08005453087389469, + 1.602474670857191, + 0.5828217566013336, + 0.03713158890604973, + 1.0022928668186069, + 0.6007137317210436, + 0.21978124789893627, + 0.0, + 0.29048067331314087, + 0.23311380669474602, + 0.04719487950205803, + 0.24301706068217754, + 0.37164389714598656, + 0.15197235345840454 + ], + "unique_experts": 60, + "load_cv": 0.8498365855987974, + "normalized_load_entropy": 0.9130012276382781, + "max_load_share": 0.049479166666666664 + } + }, + "s0_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "dccff65b7056511ba80f75d46d5d47f97cd60297ec71afa4a9d45d94d95aefe0", + "route_weight_sha256": "5dbafaad27c2e8adfaea86945f0da6b9eaabc8eb7a553fcfed2e4662c0f2a033", + "loads": [ + 6, + 2, + 2, + 0, + 0, + 0, + 4, + 1, + 13, + 0, + 0, + 1, + 0, + 1, + 0, + 8, + 1, + 1, + 3, + 11, + 0, + 0, + 1, + 0, + 0, + 3, + 6, + 0, + 5, + 0, + 2, + 0, + 0, + 2, + 4, + 2, + 0, + 0, + 1, + 0, + 16, + 0, + 3, + 1, + 0, + 5, + 0, + 0, + 2, + 6, + 0, + 9, + 0, + 1, + 2, + 0, + 2, + 0, + 4, + 0, + 1, + 2, + 3, + 1 + ], + "weighted_loads": [ + 0.27315602265298367, + 0.055645816028118134, + 0.5505115985870361, + 0.0, + 0.0, + 0.0, + 0.31321027502417564, + 0.030278068035840988, + 0.8846219852566719, + 0.0, + 0.0, + 0.04863797873258591, + 0.0, + 0.13987140357494354, + 0.0, + 0.8428475297987461, + 0.03367864340543747, + 0.033105093985795975, + 0.16356521472334862, + 0.5416285786777735, + 0.0, + 0.0, + 0.03446251526474953, + 0.0, + 0.0, + 0.24583521485328674, + 0.3881065770983696, + 0.0, + 0.519348481670022, + 0.0, + 0.06508715450763702, + 0.0, + 0.0, + 0.18774335831403732, + 0.38314738869667053, + 0.054801544174551964, + 0.0, + 0.0, + 0.16249534487724304, + 0.0, + 1.4110258743166924, + 0.0, + 0.38002054393291473, + 0.0677139163017273, + 0.0, + 0.2468041367828846, + 0.0, + 0.0, + 0.0750996470451355, + 0.34706420451402664, + 0.0, + 0.8745499178767204, + 0.0, + 0.026371289044618607, + 0.13148915022611618, + 0.0, + 0.06047577224671841, + 0.0, + 0.25948112457990646, + 0.0, + 0.04592971131205559, + 0.07057474181056023, + 0.10888457857072353, + 0.06265652924776077 + ], + "unique_experts": 37, + "load_cv": 1.5144060719941232, + "normalized_load_entropy": 0.7820282969940263, + "max_load_share": 0.11594202898550725 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "14026dc5bd0c81f8e631f79bfb8859737a107d9cb8dcacc2bf0cb19d70e80b1c", + "route_weight_sha256": "a2e25bb32f99d95112bd074f37e5d8576dfd087ef22f806a2af49d9143a31ed3", + "loads": [ + 6, + 3, + 4, + 0, + 7, + 0, + 7, + 1, + 16, + 0, + 9, + 1, + 3, + 5, + 2, + 12, + 3, + 6, + 4, + 14, + 0, + 6, + 1, + 0, + 0, + 5, + 15, + 5, + 8, + 0, + 2, + 1, + 1, + 2, + 5, + 12, + 0, + 0, + 1, + 0, + 17, + 0, + 11, + 1, + 0, + 5, + 0, + 0, + 16, + 8, + 0, + 16, + 11, + 2, + 6, + 3, + 5, + 0, + 6, + 2, + 2, + 3, + 6, + 1 + ], + "weighted_loads": [ + 0.27315602265298367, + 0.08786758780479431, + 0.6118885353207588, + 0.0, + 0.26793692260980606, + 0.0, + 0.5558164399117231, + 0.030278068035840988, + 1.0390300676226616, + 0.0, + 0.5729778781533241, + 0.04863797873258591, + 0.1561587229371071, + 0.5261122658848763, + 0.05813483148813248, + 0.9754715654999018, + 0.09258378390222788, + 0.2123531810939312, + 0.19298535399138927, + 1.149205919355154, + 0.0, + 0.4311370113864541, + 0.03446251526474953, + 0.0, + 0.0, + 0.3124344255775213, + 0.7857450693845749, + 0.706617396324873, + 0.6177842589095235, + 0.0, + 0.06508715450763702, + 0.06125844642519951, + 0.022792797535657883, + 0.18774335831403732, + 0.43074679747223854, + 0.7021879907697439, + 0.0, + 0.0, + 0.16249534487724304, + 0.0, + 1.4542088843882084, + 0.0, + 0.7741912938654423, + 0.0677139163017273, + 0.0, + 0.2468041367828846, + 0.0, + 0.0, + 0.9084571525454521, + 0.5289033688604832, + 0.0, + 1.192526962608099, + 0.8091821447014809, + 0.03938678465783596, + 0.27386948000639677, + 0.28257523477077484, + 0.1957401391118765, + 0.0, + 0.3265350889414549, + 0.0831378623843193, + 0.0683625154197216, + 0.12074106186628342, + 0.2370047364383936, + 0.06265652924776077 + ], + "unique_experts": 48, + "load_cv": 1.0736748938937604, + "normalized_load_entropy": 0.8605760326034032, + "max_load_share": 0.059027777777777776 + } + }, + "s1_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "5039bdff94efc8acbace6aa8668a33a44a44c2f316084eef8d0556dcb12306e3", + "route_weight_sha256": "4a47a21ca5b522c912877433912a85143d2e4e6ef728c9e0e4519e8d14d4a133", + "loads": [ + 6, + 0, + 2, + 0, + 0, + 1, + 4, + 1, + 13, + 0, + 1, + 1, + 0, + 1, + 0, + 8, + 1, + 0, + 3, + 10, + 0, + 0, + 1, + 0, + 0, + 3, + 6, + 0, + 5, + 0, + 2, + 0, + 0, + 2, + 4, + 2, + 0, + 1, + 1, + 0, + 16, + 0, + 2, + 1, + 0, + 5, + 0, + 0, + 3, + 6, + 0, + 9, + 0, + 2, + 2, + 1, + 1, + 0, + 4, + 0, + 1, + 4, + 1, + 1 + ], + "weighted_loads": [ + 0.2787126209586859, + 0.0, + 0.5302677601575851, + 0.0, + 0.0, + 0.029843444004654884, + 0.26094925776124, + 0.02883683517575264, + 0.8245417065918446, + 0.0, + 0.026420874521136284, + 0.04337170347571373, + 0.0, + 0.15513645112514496, + 0.0, + 0.8506098221987486, + 0.033798012882471085, + 0.0, + 0.16338461823761463, + 0.5128316842019558, + 0.0, + 0.0, + 0.03839452192187309, + 0.0, + 0.0, + 0.24704477936029434, + 0.36711475998163223, + 0.0, + 0.49716404639184475, + 0.0, + 0.06203287094831467, + 0.0, + 0.0, + 0.18778210878372192, + 0.37548840045928955, + 0.055770326405763626, + 0.0, + 0.041305068880319595, + 0.14133787155151367, + 0.0, + 1.3327384050935507, + 0.0, + 0.31593402847647667, + 0.07043008506298065, + 0.0, + 0.2263515144586563, + 0.0, + 0.0, + 0.13858681544661522, + 0.32608198188245296, + 0.0, + 0.9437051601707935, + 0.0, + 0.0493775624781847, + 0.12853683531284332, + 0.031206021085381508, + 0.034405793994665146, + 0.0, + 0.251354755833745, + 0.0, + 0.04567153379321098, + 0.16855015978217125, + 0.0415358804166317, + 0.06341354548931122 + ], + "unique_experts": 39, + "load_cv": 1.4943005914169099, + "normalized_load_entropy": 0.788778724962988, + "max_load_share": 0.11594202898550725 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "4b4dc3a3b49b5de1cab7f90c906a69f98aec5bcd0d84cd9cf90f90ce29860dc7", + "route_weight_sha256": "fd540a13f1437b1b9bd0984afef441e586e227e69dc6039b3a0bf0f7b45378d1", + "loads": [ + 14, + 2, + 4, + 0, + 1, + 2, + 7, + 2, + 15, + 2, + 11, + 1, + 9, + 11, + 5, + 10, + 2, + 7, + 6, + 13, + 1, + 8, + 3, + 7, + 1, + 8, + 14, + 10, + 7, + 1, + 7, + 0, + 1, + 6, + 4, + 19, + 1, + 2, + 2, + 0, + 16, + 3, + 15, + 2, + 2, + 6, + 0, + 0, + 17, + 10, + 2, + 19, + 11, + 3, + 16, + 10, + 5, + 0, + 5, + 4, + 1, + 6, + 3, + 2 + ], + "weighted_loads": [ + 0.7874711398035288, + 0.08817975595593452, + 1.2212811838835478, + 0.0, + 0.04441167041659355, + 0.045561155304312706, + 0.37229303270578384, + 0.11042815074324608, + 0.9241542182862759, + 0.14562230557203293, + 0.6429738961160183, + 0.04337170347571373, + 0.414648350328207, + 0.7576309069991112, + 0.19426050782203674, + 0.9309084825217724, + 0.047067553736269474, + 0.2981547750532627, + 0.2527954466640949, + 1.1065357066690922, + 0.0464911051094532, + 0.4829566637054086, + 0.10127752460539341, + 0.6146747767925262, + 0.03564826771616936, + 0.4420632775872946, + 0.6549459286034107, + 1.0863222032785416, + 0.5282247038558125, + 0.04883778095245361, + 0.2531013321131468, + 0.0, + 0.022789930924773216, + 0.7860405743122101, + 0.37548840045928955, + 1.0105404071509838, + 0.07065285742282867, + 0.08163239061832428, + 0.19569014385342598, + 0.0, + 1.3327384050935507, + 0.2010491043329239, + 0.943461749702692, + 0.11915579065680504, + 0.10201828926801682, + 0.28571193665266037, + 0.0, + 0.0, + 1.2216768264770508, + 1.2686795387417078, + 0.08005453087389469, + 1.666298821568489, + 0.778536319732666, + 0.062393058091402054, + 0.9325355170294642, + 0.6666463669389486, + 0.194580078125, + 0.0, + 0.2762710265815258, + 0.19686522893607616, + 0.04567153379321098, + 0.2866057679057121, + 0.109827920794487, + 0.14987703412771225 + ], + "unique_experts": 58, + "load_cv": 0.8843743865329635, + "normalized_load_entropy": 0.9036833457023937, + "max_load_share": 0.049479166666666664 + } + }, + "s0_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "f35507eb6954912c87413a5bd98a6c75f20b9cbf87d69512a102cc43995ad164", + "route_weight_sha256": "fbe6db126ab2d759c599592e4c3a7a5e9dd84eb5de8e4332d7e2cf03da77ccde", + "loads": [ + 4, + 2, + 2, + 0, + 1, + 1, + 4, + 1, + 14, + 0, + 1, + 1, + 0, + 2, + 0, + 6, + 1, + 1, + 3, + 10, + 0, + 0, + 1, + 0, + 0, + 3, + 6, + 0, + 5, + 0, + 1, + 0, + 0, + 2, + 4, + 2, + 0, + 0, + 1, + 0, + 16, + 0, + 4, + 1, + 0, + 4, + 0, + 0, + 2, + 6, + 0, + 9, + 0, + 1, + 3, + 0, + 1, + 0, + 5, + 0, + 1, + 2, + 3, + 1 + ], + "weighted_loads": [ + 0.21006367355585098, + 0.054646147415041924, + 0.5327796339988708, + 0.0, + 0.03006928414106369, + 0.031428899616003036, + 0.30048970878124237, + 0.03057047910988331, + 0.9289678819477558, + 0.0, + 0.02800765074789524, + 0.048332568258047104, + 0.0, + 0.19110244140028954, + 0.0, + 0.7844114489853382, + 0.03444698080420494, + 0.0333261601626873, + 0.1639762446284294, + 0.5203568562865257, + 0.0, + 0.0, + 0.036182157695293427, + 0.0, + 0.0, + 0.23869380727410316, + 0.40520018711686134, + 0.0, + 0.5087717399001122, + 0.0, + 0.03050278313457966, + 0.0, + 0.0, + 0.18795279413461685, + 0.36730629950761795, + 0.059675468131899834, + 0.0, + 0.0, + 0.1491192728281021, + 0.0, + 1.4349397495388985, + 0.0, + 0.40763366781175137, + 0.07410013675689697, + 0.0, + 0.2063947655260563, + 0.0, + 0.0, + 0.07162347063422203, + 0.35427113249897957, + 0.0, + 0.8762671872973442, + 0.0, + 0.023696640506386757, + 0.15874643996357918, + 0.0, + 0.03444068506360054, + 0.0, + 0.28926467150449753, + 0.0, + 0.04504653066396713, + 0.07354607433080673, + 0.10649148374795914, + 0.061221569776535034 + ], + "unique_experts": 40, + "load_cv": 1.4807452837179993, + "normalized_load_entropy": 0.7960829036162056, + "max_load_share": 0.11594202898550725 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "bec81c13bceebabb2a7e35b0ac527a0e419dc053abf157d0e2cbb18921085425", + "route_weight_sha256": "e7c66dfd650ce3afd5a82699c72353aea8369667176743fe30c656f24e62057d", + "loads": [ + 4, + 3, + 4, + 0, + 7, + 1, + 8, + 1, + 17, + 0, + 8, + 1, + 3, + 8, + 2, + 10, + 2, + 5, + 4, + 12, + 0, + 7, + 1, + 0, + 0, + 4, + 15, + 5, + 8, + 0, + 1, + 1, + 2, + 2, + 5, + 12, + 0, + 1, + 1, + 0, + 18, + 0, + 10, + 1, + 0, + 5, + 0, + 0, + 16, + 8, + 0, + 17, + 10, + 2, + 7, + 4, + 3, + 0, + 6, + 3, + 2, + 3, + 7, + 1 + ], + "weighted_loads": [ + 0.21006367355585098, + 0.09102725796401501, + 0.5941565707325935, + 0.0, + 0.2586994394659996, + 0.031428899616003036, + 0.6246957890689373, + 0.03057047910988331, + 1.0865883529186249, + 0.0, + 0.5715799424797297, + 0.048332568258047104, + 0.1610458791255951, + 0.5857946984469891, + 0.0560128353536129, + 0.9372497368603945, + 0.04771652165800333, + 0.18419071286916733, + 0.19685252010822296, + 1.1005478203296661, + 0.0, + 0.4630458625033498, + 0.036182157695293427, + 0.0, + 0.0, + 0.2743643820285797, + 0.8028386794030666, + 0.701407115906477, + 0.6046971371397376, + 0.0, + 0.03050278313457966, + 0.06940816342830658, + 0.0690205879509449, + 0.18795279413461685, + 0.41490570828318596, + 0.6671200301498175, + 0.0, + 0.026603441685438156, + 0.1491192728281021, + 0.0, + 1.5104651227593422, + 0.0, + 0.7168875951319933, + 0.07410013675689697, + 0.0, + 0.25122595578432083, + 0.0, + 0.0, + 0.8712455667555332, + 0.6054705642163754, + 0.0, + 1.2615053616464138, + 0.6187385097146034, + 0.03671213611960411, + 0.2976793823763728, + 0.37135049700737, + 0.1280878446996212, + 0.0, + 0.3139582071453333, + 0.15903180465102196, + 0.06747933477163315, + 0.12606120854616165, + 0.28723857551813126, + 0.061221569776535034 + ], + "unique_experts": 50, + "load_cv": 1.0707964037442435, + "normalized_load_entropy": 0.8647436341194167, + "max_load_share": 0.0625 + } + }, + "s1_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "d29effd073e60aadacc7cfebbe88bf0c29e0fc1a41be6d04d76dc0eee460f538", + "route_weight_sha256": "8393832c6057918497a6c74180581c5f5cea501f20831d703f191f19ad8478a5", + "loads": [ + 5, + 0, + 2, + 0, + 0, + 1, + 4, + 0, + 13, + 0, + 1, + 1, + 0, + 3, + 0, + 8, + 0, + 0, + 3, + 10, + 0, + 0, + 1, + 0, + 0, + 2, + 6, + 0, + 5, + 0, + 1, + 0, + 0, + 2, + 4, + 3, + 0, + 2, + 2, + 0, + 16, + 1, + 2, + 1, + 0, + 4, + 0, + 0, + 3, + 6, + 0, + 9, + 0, + 1, + 3, + 1, + 1, + 0, + 4, + 0, + 1, + 3, + 2, + 1 + ], + "weighted_loads": [ + 0.27232033386826515, + 0.0, + 0.5306586623191833, + 0.0, + 0.0, + 0.03200921416282654, + 0.26170066744089127, + 0.0, + 0.8329265713691711, + 0.0, + 0.026084383949637413, + 0.04193928837776184, + 0.0, + 0.2561023384332657, + 0.0, + 0.8625540062785149, + 0.0, + 0.0, + 0.1695129219442606, + 0.5038174502551556, + 0.0, + 0.0, + 0.041162583976984024, + 0.0, + 0.0, + 0.20664704218506813, + 0.3662994783371687, + 0.0, + 0.4929556492716074, + 0.0, + 0.02900240756571293, + 0.0, + 0.0, + 0.18696170300245285, + 0.35226312279701233, + 0.08459663949906826, + 0.0, + 0.0697423703968525, + 0.17345479130744934, + 0.0, + 1.333400746807456, + 0.03648113086819649, + 0.3140295334160328, + 0.08105472475290298, + 0.0, + 0.18524235486984253, + 0.0, + 0.0, + 0.10793904401361942, + 0.3220473397523165, + 0.0, + 0.915265079587698, + 0.0, + 0.024271342903375626, + 0.15628524497151375, + 0.03969789668917656, + 0.035489220172166824, + 0.0, + 0.2312226239591837, + 0.0, + 0.04782963916659355, + 0.15699326246976852, + 0.06713779643177986, + 0.05860849842429161 + ], + "unique_experts": 38, + "load_cv": 1.4807452837179993, + "normalized_load_entropy": 0.790282484018346, + "max_load_share": 0.11594202898550725 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "9dbce2f43396461d8c910999b86f19d228a1e6b5202b0038baeb392b80f494d7", + "route_weight_sha256": "7187568954e3ddeb7620be78e2fb0eb23912976556192c77feab8f64ece9e1d5", + "loads": [ + 13, + 2, + 4, + 0, + 3, + 2, + 8, + 1, + 15, + 2, + 9, + 1, + 6, + 16, + 5, + 10, + 1, + 7, + 7, + 13, + 1, + 8, + 3, + 7, + 1, + 4, + 14, + 10, + 7, + 1, + 5, + 0, + 1, + 6, + 4, + 21, + 1, + 3, + 3, + 0, + 18, + 3, + 14, + 2, + 1, + 5, + 0, + 0, + 16, + 10, + 2, + 20, + 10, + 2, + 18, + 11, + 6, + 0, + 6, + 4, + 1, + 5, + 3, + 2 + ], + "weighted_loads": [ + 0.7810788527131081, + 0.08666908368468285, + 1.221672086045146, + 0.0, + 0.12664135918021202, + 0.04772692546248436, + 0.44317297264933586, + 0.08159131556749344, + 0.9325390830636024, + 0.14562230557203293, + 0.5767230372875929, + 0.04193928837776184, + 0.30675435438752174, + 0.8938394393771887, + 0.21569416299462318, + 0.9428526666015387, + 0.01326954085379839, + 0.2961657829582691, + 0.3192965127527714, + 1.097521472722292, + 0.0464911051094532, + 0.48395136650651693, + 0.10404558666050434, + 0.6126531139016151, + 0.03564826771616936, + 0.2786685023456812, + 0.6541306469589472, + 1.1108959764242172, + 0.5240163067355752, + 0.04883778095245361, + 0.1837267503142357, + 0.0, + 0.022789930924773216, + 0.785220168530941, + 0.35226312279701233, + 1.0541014429181814, + 0.07065285742282867, + 0.11006969213485718, + 0.22780706360936165, + 0.0, + 1.4087145421653986, + 0.1631769798696041, + 0.935901191085577, + 0.12978043034672737, + 0.06502456218004227, + 0.2446027770638466, + 0.0, + 0.0, + 1.049492796882987, + 1.3619758691638708, + 0.08005453087389469, + 1.7087765708565712, + 0.5828217566013336, + 0.03728683851659298, + 1.0263649253174663, + 0.7184804230928421, + 0.2303272970020771, + 0.0, + 0.2853169534355402, + 0.2373555339872837, + 0.04782963916659355, + 0.2642401084303856, + 0.10320603474974632, + 0.14507198706269264 + ], + "unique_experts": 58, + "load_cv": 0.9265564982473786, + "normalized_load_entropy": 0.8981498357926894, + "max_load_share": 0.0546875 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8881987577639753, + "mean_token_weighted_tv": 0.021648036437514034, + "aggregate_load_tv": 0.050724637681159424 + }, + "system_bos": { + "tokens": 23, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 13, + "mean_set_jaccard": 0.875776397515528, + "mean_token_weighted_tv": 0.023736769292989502, + "aggregate_load_tv": 0.07246376811594203 + }, + "system_x": { + "tokens": 23, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8695652173913045, + "mean_token_weighted_tv": 0.03130993210589108, + "aggregate_load_tv": 0.057971014492753624 + }, + "system_period": { + "tokens": 23, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 10, + "mean_set_jaccard": 0.8198757763975155, + "mean_token_weighted_tv": 0.038016593610138996, + "aggregate_load_tv": 0.08695652173913043 + }, + "bos_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.8913043478260871, + "mean_token_weighted_tv": 0.025042102915113388, + "aggregate_load_tv": 0.057971014492753624 + }, + "bos_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 13, + "mean_set_jaccard": 0.8757763975155279, + "mean_token_weighted_tv": 0.028820815415162106, + "aggregate_load_tv": 0.06521739130434781 + }, + "x_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 11, + "mean_set_jaccard": 0.8509316770186335, + "mean_token_weighted_tv": 0.027119096975935543, + "aggregate_load_tv": 0.06521739130434782 + }, + "x_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 12, + "mean_set_jaccard": 0.8354037267080746, + "mean_token_weighted_tv": 0.0375681653537828, + "aggregate_load_tv": 0.08695652173913043 + }, + "period_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 13, + "mean_set_jaccard": 0.8757763975155279, + "mean_token_weighted_tv": 0.024231560204340065, + "aggregate_load_tv": 0.06521739130434782 + }, + "period_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 5, + "set_exact_tokens": 7, + "mean_set_jaccard": 0.782608695652174, + "mean_token_weighted_tv": 0.04430793719771116, + "aggregate_load_tv": 0.11594202898550723 + } + } + }, + "layer_22": { + "layer": 22, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "58cf2b4d80044b5addf26a7022c477009cedb9c4fd771f3b7920856bc92b257b", + "route_weight_sha256": "81541c65217e8c7968f50b1b3a20608892fe594a06662517e3dbda873a3ddf70", + "loads": [ + 4, + 6, + 2, + 2, + 1, + 1, + 0, + 0, + 22, + 1, + 0, + 1, + 0, + 0, + 9, + 1, + 0, + 0, + 2, + 2, + 0, + 0, + 4, + 0, + 1, + 0, + 0, + 1, + 1, + 2, + 2, + 4, + 4, + 1, + 1, + 1, + 0, + 2, + 0, + 6, + 0, + 0, + 1, + 2, + 1, + 10, + 0, + 2, + 4, + 1, + 3, + 1, + 0, + 0, + 0, + 0, + 4, + 2, + 4, + 0, + 3, + 10, + 0, + 6 + ], + "weighted_loads": [ + 0.11608638800680637, + 0.6067015752196312, + 0.25289925187826157, + 0.057271672412753105, + 0.10166161507368088, + 0.02499265782535076, + 0.0, + 0.0, + 3.8322509974241257, + 0.03171117603778839, + 0.0, + 0.033063504844903946, + 0.0, + 0.0, + 0.44922681152820587, + 0.08786259591579437, + 0.0, + 0.0, + 0.08217041939496994, + 0.07375924102962017, + 0.0, + 0.0, + 0.1971544548869133, + 0.0, + 0.07299880683422089, + 0.0, + 0.0, + 0.027106985449790955, + 0.03601521626114845, + 0.06776822917163372, + 0.11520081199705601, + 0.41365600004792213, + 0.32308418676257133, + 0.03255258500576019, + 0.02586723119020462, + 0.04164030775427818, + 0.0, + 0.11005852743983269, + 0.0, + 0.37483108416199684, + 0.0, + 0.0, + 0.02084057778120041, + 0.11341651156544685, + 0.0249323733150959, + 0.9504637680947781, + 0.0, + 0.06023493781685829, + 0.29019488766789436, + 0.028927091509103775, + 0.12420203164219856, + 0.025598715990781784, + 0.0, + 0.0, + 0.0, + 0.0, + 0.1322261355817318, + 0.08450538665056229, + 0.18438631668686867, + 0.0, + 0.10010991431772709, + 0.5959576908499002, + 0.0, + 0.371598269790411 + ], + "unique_experts": 41, + "load_cv": 1.5986105077709065, + "normalized_load_entropy": 0.7921037349001583, + "max_load_share": 0.15942028985507245 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "020e4c2a161b6d5d392fa2f339f470c2f35c57d553449f0bc11f64dcc1b951df", + "route_weight_sha256": "40856dce7b93f2227fb646e36797478007beaeeda83f4a315334bb1b14bbc5b0", + "loads": [ + 8, + 7, + 5, + 11, + 1, + 4, + 6, + 1, + 37, + 6, + 0, + 5, + 0, + 0, + 13, + 1, + 0, + 1, + 2, + 2, + 0, + 7, + 5, + 0, + 1, + 1, + 0, + 5, + 1, + 2, + 2, + 4, + 7, + 9, + 2, + 3, + 0, + 4, + 0, + 6, + 3, + 1, + 6, + 2, + 1, + 11, + 1, + 2, + 6, + 3, + 8, + 1, + 0, + 1, + 0, + 15, + 7, + 3, + 4, + 0, + 12, + 17, + 0, + 15 + ], + "weighted_loads": [ + 0.28954043984413147, + 0.653317715972662, + 0.36419089138507843, + 1.9356589261442423, + 0.10166161507368088, + 0.15991188120096922, + 0.3130631148815155, + 0.08408690989017487, + 5.18414874561131, + 0.22246083244681358, + 0.0, + 0.32345499843358994, + 0.0, + 0.0, + 0.8388602640479803, + 0.08786259591579437, + 0.0, + 0.025727735832333565, + 0.08217041939496994, + 0.07375924102962017, + 0.0, + 0.6145301330834627, + 0.22663238644599915, + 0.0, + 0.07299880683422089, + 0.02620566450059414, + 0.0, + 0.22519893199205399, + 0.03601521626114845, + 0.06776822917163372, + 0.11520081199705601, + 0.41365600004792213, + 0.39770806627348065, + 0.3062245100736618, + 0.08320040255784988, + 0.17203865572810173, + 0.0, + 0.2062792368233204, + 0.0, + 0.37483108416199684, + 0.14454994350671768, + 0.043661437928676605, + 0.33875584974884987, + 0.11341651156544685, + 0.0249323733150959, + 0.9835281707346439, + 0.03787221387028694, + 0.06023493781685829, + 0.38599376380443573, + 0.20434735342860222, + 0.351458303630352, + 0.025598715990781784, + 0.0, + 0.03877321630716324, + 0.0, + 1.1945235012099147, + 0.25354722142219543, + 0.1102154366672039, + 0.18438631668686867, + 0.0, + 1.3888532873243093, + 0.8471747823059559, + 0.0, + 0.8186366334557533 + ], + "unique_experts": 51, + "load_cv": 1.3005222123021807, + "normalized_load_entropy": 0.8461342754655471, + "max_load_share": 0.1284722222222222 + } + }, + "s1_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "47a3e980faaec1dad5b6956dceb370b42fe08364f6bd116148645c181d033c3b", + "route_weight_sha256": "d3609b9ab806a797c5652c8dd03371381eb405bf4708c9ae939aeb87a8dbe471", + "loads": [ + 5, + 6, + 2, + 2, + 1, + 1, + 0, + 0, + 22, + 1, + 0, + 0, + 0, + 0, + 7, + 1, + 0, + 0, + 2, + 2, + 0, + 0, + 4, + 0, + 1, + 0, + 0, + 1, + 1, + 2, + 1, + 4, + 4, + 1, + 3, + 1, + 0, + 2, + 0, + 6, + 0, + 0, + 2, + 2, + 1, + 10, + 0, + 2, + 3, + 1, + 3, + 1, + 0, + 0, + 0, + 0, + 4, + 2, + 4, + 0, + 3, + 11, + 0, + 6 + ], + "weighted_loads": [ + 0.14973562955856323, + 0.5929202772676945, + 0.23055455461144447, + 0.05841539427638054, + 0.10173368453979492, + 0.024976911023259163, + 0.0, + 0.0, + 3.7473564073443413, + 0.03567136451601982, + 0.0, + 0.0, + 0.0, + 0.0, + 0.42626226507127285, + 0.08609756827354431, + 0.0, + 0.0, + 0.07954384386539459, + 0.07545538246631622, + 0.0, + 0.0, + 0.19926116056740284, + 0.0, + 0.0721837729215622, + 0.0, + 0.0, + 0.025529438629746437, + 0.03590313345193863, + 0.0659150741994381, + 0.07859306782484055, + 0.4060467481613159, + 0.3138704337179661, + 0.03316960111260414, + 0.084136001765728, + 0.04564395174384117, + 0.0, + 0.10768721997737885, + 0.0, + 0.3687370754778385, + 0.0, + 0.0, + 0.04367988370358944, + 0.11766080185770988, + 0.02588742971420288, + 0.9139585830271244, + 0.0, + 0.058476587757468224, + 0.26051390916109085, + 0.03336320072412491, + 0.12791558355093002, + 0.02577846124768257, + 0.0, + 0.0, + 0.0, + 0.0, + 0.13758889958262444, + 0.08409622684121132, + 0.18514858931303024, + 0.0, + 0.09955752640962601, + 0.6499162521213293, + 0.0, + 0.36080335080623627 + ], + "unique_experts": 40, + "load_cv": 1.5965068989869469, + "normalized_load_entropy": 0.7908041675374495, + "max_load_share": 0.15942028985507245 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "606f5578b9e48d8cd6a35c4801274f43e86815d6eddb349be7a64d3077ae89cd", + "route_weight_sha256": "f2d0c257237b4b34d301f37bf366c7b589a35e7720fca84b9506cef378c639f1", + "loads": [ + 7, + 11, + 2, + 13, + 1, + 4, + 5, + 1, + 44, + 10, + 0, + 7, + 3, + 0, + 12, + 5, + 3, + 2, + 3, + 2, + 1, + 13, + 5, + 1, + 1, + 1, + 0, + 4, + 2, + 2, + 2, + 4, + 6, + 9, + 11, + 6, + 2, + 5, + 0, + 7, + 11, + 1, + 6, + 4, + 1, + 11, + 1, + 4, + 5, + 5, + 13, + 4, + 5, + 2, + 0, + 22, + 8, + 3, + 6, + 0, + 18, + 21, + 0, + 16 + ], + "weighted_loads": [ + 0.27711477875709534, + 1.0450852308422327, + 0.23055455461144447, + 2.2016498874872923, + 0.10173368453979492, + 0.12995445635169744, + 0.28058293741196394, + 0.04289092868566513, + 5.655370874330401, + 0.507566761225462, + 0.0, + 0.518580125644803, + 0.1400878131389618, + 0.0, + 0.8762961830943823, + 0.3223385773599148, + 0.14195318520069122, + 0.050206514075398445, + 0.11967288702726364, + 0.07545538246631622, + 0.0491466261446476, + 1.093345120549202, + 0.24190532229840755, + 0.046012550592422485, + 0.0721837729215622, + 0.02553967386484146, + 0.0, + 0.19238503463566303, + 0.11954829096794128, + 0.0659150741994381, + 0.13306772708892822, + 0.4060467481613159, + 0.3692292124032974, + 0.3306825626641512, + 0.42520164512097836, + 0.2654554173350334, + 0.09036019816994667, + 0.22001550905406475, + 0.0, + 0.4100057817995548, + 0.6614830940961838, + 0.025403395295143127, + 0.3536080215126276, + 0.25403473526239395, + 0.02588742971420288, + 0.9527400061488152, + 0.034112270921468735, + 0.12782109901309013, + 0.35893722623586655, + 0.5746712423861027, + 0.6257643718272448, + 0.22940147668123245, + 0.5515716783702374, + 0.0901034027338028, + 0.0, + 1.8405247274786234, + 0.35390012711286545, + 0.10914865508675575, + 0.23249962739646435, + 0.0, + 2.1906434409320354, + 1.0664771813899279, + 0.0, + 0.8553138393908739 + ], + "unique_experts": 57, + "load_cv": 1.1703809920990116, + "normalized_load_entropy": 0.8751844247544557, + "max_load_share": 0.11458333333333333 + } + }, + "s0_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "6574e3a0a738a56d27338bac88e324d98a9e5a73ffffcb0ef474da04bea898e1", + "route_weight_sha256": "7ed01ea1907392bc383294ea6eb5bfa9ec246241cfacc9a71adebfd051e9db1e", + "loads": [ + 5, + 6, + 2, + 2, + 1, + 2, + 1, + 0, + 21, + 1, + 0, + 1, + 0, + 0, + 6, + 1, + 0, + 0, + 2, + 2, + 0, + 0, + 4, + 0, + 1, + 0, + 0, + 1, + 1, + 1, + 2, + 4, + 5, + 0, + 2, + 1, + 0, + 2, + 0, + 6, + 0, + 1, + 1, + 2, + 1, + 10, + 0, + 3, + 4, + 1, + 3, + 1, + 0, + 0, + 0, + 0, + 4, + 1, + 5, + 0, + 3, + 8, + 0, + 7 + ], + "weighted_loads": [ + 0.15626597590744495, + 0.6343596316874027, + 0.2418866790831089, + 0.0533369779586792, + 0.10451516509056091, + 0.04510081931948662, + 0.028534041717648506, + 0.0, + 3.7208083011209965, + 0.031991127878427505, + 0.0, + 0.029466142877936363, + 0.0, + 0.0, + 0.37582671269774437, + 0.09136583656072617, + 0.0, + 0.0, + 0.08623718097805977, + 0.07688646018505096, + 0.0, + 0.0, + 0.20809687301516533, + 0.0, + 0.07680722326040268, + 0.0, + 0.0, + 0.030123453587293625, + 0.03523123636841774, + 0.04799423739314079, + 0.13015083968639374, + 0.43133120611310005, + 0.36125345528125763, + 0.0, + 0.05020936205983162, + 0.04094064235687256, + 0.0, + 0.11769445985555649, + 0.0, + 0.391456700861454, + 0.0, + 0.03808682784438133, + 0.022930998355150223, + 0.11235873028635979, + 0.023617712780833244, + 0.9453121051192284, + 0.0, + 0.08742392621934414, + 0.3134133405983448, + 0.02950005605816841, + 0.1336391642689705, + 0.023818286135792732, + 0.0, + 0.0, + 0.0, + 0.0, + 0.13384229317307472, + 0.046760015189647675, + 0.21777552366256714, + 0.0, + 0.10302484780550003, + 0.5200474746525288, + 0.0, + 0.41032481379806995 + ], + "unique_experts": 42, + "load_cv": 1.5144060719941232, + "normalized_load_entropy": 0.804642554119535, + "max_load_share": 0.15217391304347827 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "91f827c426a65130c75f8ad284298088ca6445554ad97be57731e9282fd3c9db", + "route_weight_sha256": "3a55cebea1e15153ab586c89fb843f23ab1003ed57e15d86b1c1c16864edb8be", + "loads": [ + 9, + 7, + 5, + 10, + 1, + 4, + 5, + 1, + 34, + 6, + 1, + 5, + 0, + 0, + 8, + 2, + 0, + 1, + 2, + 2, + 0, + 7, + 5, + 1, + 2, + 1, + 0, + 5, + 1, + 2, + 2, + 4, + 7, + 7, + 4, + 5, + 0, + 5, + 0, + 6, + 3, + 2, + 5, + 2, + 1, + 11, + 1, + 3, + 7, + 4, + 6, + 1, + 0, + 1, + 0, + 14, + 7, + 3, + 5, + 0, + 13, + 15, + 0, + 17 + ], + "weighted_loads": [ + 0.32972002774477005, + 0.6805455014109612, + 0.35317831858992577, + 1.0405556969344616, + 0.10451516509056091, + 0.10663107503205538, + 0.28179425559937954, + 0.9306259155273438, + 4.990913776680827, + 0.2227407842874527, + 0.013500477187335491, + 0.23898280039429665, + 0.0, + 0.0, + 0.6348774100188166, + 0.13500885665416718, + 0.0, + 0.025727735832333565, + 0.08623718097805977, + 0.07688646018505096, + 0.0, + 0.6145533490926027, + 0.23757480457425117, + 0.032279763370752335, + 0.08066551107913256, + 0.02620566450059414, + 0.0, + 0.2231757454574108, + 0.03523123636841774, + 0.09245972707867622, + 0.13015083968639374, + 0.43133120611310005, + 0.4293584078550339, + 0.24411691538989544, + 0.15293222665786743, + 0.23851726949214935, + 0.0, + 0.2661084942519665, + 0.0, + 0.391456700861454, + 0.15056130662560463, + 0.11468299850821495, + 0.22394229844212532, + 0.11235873028635979, + 0.023617712780833244, + 0.9783765077590942, + 0.03787221387028694, + 0.08742392621934414, + 0.5099932216107845, + 0.19343238254077733, + 0.29093195870518684, + 0.023818286135792732, + 0.0, + 0.03877321630716324, + 0.0, + 1.20415716804564, + 0.25516337901353836, + 0.0806082347407937, + 0.21777552366256714, + 0.0, + 1.355326846241951, + 0.7712645661085844, + 0.0, + 0.8150710109621286 + ], + "unique_experts": 53, + "load_cv": 1.1999228370252877, + "normalized_load_entropy": 0.8654361915799558, + "max_load_share": 0.11805555555555555 + } + }, + "s1_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "4be23709c4277f1678618971bef73342dbfbbfe53b452e921431052edf4a8295", + "route_weight_sha256": "471ad4f2b748e6bc5745472f168abea0ccf57fa4e5118aeba412104d5bdc0985", + "loads": [ + 5, + 6, + 2, + 2, + 1, + 1, + 1, + 0, + 21, + 1, + 0, + 1, + 0, + 0, + 8, + 1, + 0, + 0, + 2, + 2, + 0, + 0, + 4, + 0, + 2, + 0, + 0, + 1, + 1, + 2, + 2, + 4, + 5, + 1, + 2, + 1, + 0, + 2, + 0, + 5, + 0, + 0, + 1, + 2, + 1, + 9, + 0, + 2, + 4, + 1, + 3, + 1, + 0, + 0, + 0, + 0, + 5, + 2, + 4, + 0, + 3, + 8, + 0, + 6 + ], + "weighted_loads": [ + 0.1650017872452736, + 0.6202504895627499, + 0.22804003208875656, + 0.05845583602786064, + 0.10828135907649994, + 0.02553287148475647, + 0.029544522985816002, + 0.0, + 3.6123507767915726, + 0.03700735792517662, + 0.0, + 0.02866983413696289, + 0.0, + 0.0, + 0.45781371369957924, + 0.08872129023075104, + 0.0, + 0.0, + 0.07979988679289818, + 0.0796078722923994, + 0.0, + 0.0, + 0.1946648210287094, + 0.0, + 0.1064954325556755, + 0.0, + 0.0, + 0.02758229523897171, + 0.03689786046743393, + 0.07242739014327526, + 0.1401953250169754, + 0.42338714376091957, + 0.36544084548950195, + 0.031675439327955246, + 0.057097798213362694, + 0.042212702333927155, + 0.0, + 0.11161550879478455, + 0.0, + 0.3295821398496628, + 0.0, + 0.0, + 0.02188102714717388, + 0.12348449230194092, + 0.024558916687965393, + 0.9212987273931503, + 0.0, + 0.057855356484651566, + 0.34067536890506744, + 0.03177782520651817, + 0.14272785559296608, + 0.024913890287280083, + 0.0, + 0.0, + 0.0, + 0.0, + 0.16713492944836617, + 0.08767681941390038, + 0.17358417063951492, + 0.0, + 0.10558409616351128, + 0.5303828045725822, + 0.0, + 0.36594169586896896 + ], + "unique_experts": 42, + "load_cv": 1.4987917839360487, + "normalized_load_entropy": 0.8082614700885563, + "max_load_share": 0.15217391304347827 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "9fdded406dc725b9ea2e41c10a180ba57c43509217e48877d85be330cc081a59", + "route_weight_sha256": "ce9c5617447182ad07a195942bf43ea4868791c3594b8853aa64ada8262a0d50", + "loads": [ + 7, + 11, + 2, + 12, + 1, + 3, + 5, + 1, + 42, + 10, + 0, + 9, + 3, + 0, + 11, + 6, + 3, + 2, + 3, + 2, + 1, + 12, + 5, + 1, + 2, + 1, + 0, + 5, + 2, + 2, + 3, + 4, + 6, + 10, + 11, + 8, + 2, + 5, + 0, + 6, + 10, + 1, + 5, + 4, + 1, + 9, + 1, + 4, + 10, + 5, + 12, + 4, + 5, + 3, + 1, + 20, + 9, + 3, + 5, + 0, + 19, + 18, + 0, + 16 + ], + "weighted_loads": [ + 0.2923809364438057, + 1.072415443137288, + 0.22804003208875656, + 1.3065418731421232, + 0.10828135907649994, + 0.07643406931310892, + 0.30026127584278584, + 0.04289092868566513, + 5.448358418419957, + 0.5089027546346188, + 0.0, + 0.5218350477516651, + 0.1400878131389618, + 0.0, + 0.8468927629292011, + 0.3675888814032078, + 0.14195318520069122, + 0.050206514075398445, + 0.11992892995476723, + 0.0796078722923994, + 0.0491466261446476, + 1.0665786936879158, + 0.23730898275971413, + 0.03966570645570755, + 0.1064954325556755, + 0.02553967386484146, + 0.0, + 0.2621550224721432, + 0.12054301798343658, + 0.07242739014327526, + 0.17678167298436165, + 0.42338714376091957, + 0.41472702100872993, + 0.3568670954555273, + 0.43667933717370033, + 0.3576759360730648, + 0.09036019816994667, + 0.24886929243803024, + 0.0, + 0.3708508461713791, + 0.6333614122122526, + 0.025403395295143127, + 0.3121961001306772, + 0.259858425706625, + 0.024558916687965393, + 0.9212987273931503, + 0.034112270921468735, + 0.12719986774027348, + 0.6828953772783279, + 0.6011642925441265, + 0.5910171996802092, + 0.22853690572082996, + 0.5515716783702374, + 0.13840945065021515, + 0.040192730724811554, + 1.7307349015027285, + 0.3834461569786072, + 0.11272924765944481, + 0.21590416505932808, + 0.0, + 2.2716977894306183, + 0.9469437338411808, + 0.0, + 0.8935628160834312 + ], + "unique_experts": 58, + "load_cv": 1.107110854632202, + "normalized_load_entropy": 0.8853790346300465, + "max_load_share": 0.109375 + } + }, + "s0_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "c456cbb7ce12a1541a3abe6dc5ecf65a691cef68bb284bf9d35478ddcc1c7456", + "route_weight_sha256": "d7dad3d8730bfd49f6fb022760387b36afe886f4f0718be124a938353ba16f23", + "loads": [ + 3, + 6, + 2, + 2, + 1, + 1, + 1, + 0, + 22, + 1, + 0, + 0, + 0, + 0, + 7, + 1, + 0, + 0, + 2, + 1, + 0, + 0, + 4, + 0, + 1, + 0, + 0, + 1, + 1, + 2, + 1, + 4, + 4, + 1, + 2, + 0, + 0, + 2, + 0, + 6, + 0, + 0, + 2, + 2, + 1, + 10, + 0, + 2, + 4, + 1, + 3, + 1, + 0, + 0, + 0, + 0, + 5, + 2, + 4, + 0, + 3, + 13, + 0, + 6 + ], + "weighted_loads": [ + 0.09278331696987152, + 0.6092374585568905, + 0.2472049631178379, + 0.05878474935889244, + 0.09149295091629028, + 0.021627061069011688, + 0.031889282166957855, + 0.0, + 3.6569498293101788, + 0.03775515779852867, + 0.0, + 0.0, + 0.0, + 0.0, + 0.43566798232495785, + 0.08776166290044785, + 0.0, + 0.0, + 0.08403988555073738, + 0.05288126692175865, + 0.0, + 0.0, + 0.1952570639550686, + 0.0, + 0.07238424569368362, + 0.0, + 0.0, + 0.03026461973786354, + 0.03614014759659767, + 0.06924356333911419, + 0.08399724960327148, + 0.4212486259639263, + 0.32843519374728203, + 0.03106393665075302, + 0.05282151140272617, + 0.0, + 0.0, + 0.10847491025924683, + 0.0, + 0.39928719960153103, + 0.0, + 0.0, + 0.04513398930430412, + 0.10981381312012672, + 0.024087360128760338, + 0.9326663911342621, + 0.0, + 0.05859196372330189, + 0.2991499714553356, + 0.0327754020690918, + 0.13021093048155308, + 0.027595914900302887, + 0.0, + 0.0, + 0.0, + 0.0, + 0.15825210325419903, + 0.08718268573284149, + 0.17605935037136078, + 0.0, + 0.10313012450933456, + 0.7234680466353893, + 0.0, + 0.3395507372915745 + ], + "unique_experts": 40, + "load_cv": 1.6380658776025094, + "normalized_load_entropy": 0.7844067266815795, + "max_load_share": 0.15942028985507245 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "0798fe8525696ad5585393d35485864f8e7b30e58c1715a28a8bff615314010d", + "route_weight_sha256": "53b76bc162d41ec8c10700c1e197ed3e7caa9b40e3af4385d1af7af754d746dd", + "loads": [ + 7, + 7, + 5, + 11, + 1, + 3, + 7, + 0, + 36, + 7, + 0, + 3, + 0, + 0, + 9, + 1, + 0, + 2, + 2, + 1, + 0, + 8, + 5, + 2, + 1, + 1, + 0, + 4, + 1, + 2, + 2, + 4, + 6, + 10, + 3, + 2, + 0, + 4, + 0, + 6, + 3, + 1, + 6, + 2, + 1, + 11, + 1, + 2, + 5, + 4, + 8, + 1, + 0, + 1, + 0, + 17, + 8, + 3, + 4, + 0, + 12, + 21, + 0, + 14 + ], + "weighted_loads": [ + 0.2662373688071966, + 0.6515602096915245, + 0.35849660262465477, + 1.1300916448235512, + 0.09149295091629028, + 0.08700503874570131, + 0.4024960845708847, + 0.0, + 4.950352447107434, + 0.25998555123806, + 0.0, + 0.14667574502527714, + 0.0, + 0.0, + 0.7596409749239683, + 0.08776166290044785, + 0.0, + 0.061272600665688515, + 0.08403988555073738, + 0.05288126692175865, + 0.0, + 0.683140704408288, + 0.22473499551415443, + 0.06692643836140633, + 0.07238424569368362, + 0.02620566450059414, + 0.0, + 0.1841534972190857, + 0.03614014759659767, + 0.06924356333911419, + 0.12738631293177605, + 0.4212486259639263, + 0.3965401463210583, + 0.3579969275742769, + 0.11015468277037144, + 0.09363918378949165, + 0.0, + 0.19401007518172264, + 0.0, + 0.39928719960153103, + 0.1526140756905079, + 0.07833801209926605, + 0.31564370542764664, + 0.10981381312012672, + 0.024087360128760338, + 0.965730793774128, + 0.03787221387028694, + 0.05859196372330189, + 0.35067809745669365, + 0.3259038217365742, + 0.37984769605100155, + 0.027595914900302887, + 0.0, + 0.03877321630716324, + 0.0, + 1.3768097627907991, + 0.27957318909466267, + 0.11289273574948311, + 0.17605935037136078, + 0.0, + 1.3486295379698277, + 1.0299174133688211, + 0.0, + 0.6397742182016373 + ], + "unique_experts": 51, + "load_cv": 1.3123346456686351, + "normalized_load_entropy": 0.844431900422336, + "max_load_share": 0.125 + } + }, + "s1_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "2bdd8d301de25252d54a18f20133cd9601602d54cee9fb56a90d471d8205d56f", + "route_weight_sha256": "953441efa0c89a152c19e669b0c99c469189833814624a5699db67c05032b3b1", + "loads": [ + 4, + 6, + 2, + 2, + 1, + 1, + 0, + 0, + 22, + 1, + 0, + 0, + 0, + 0, + 8, + 1, + 1, + 0, + 2, + 2, + 0, + 0, + 4, + 0, + 2, + 0, + 0, + 1, + 1, + 2, + 2, + 3, + 4, + 1, + 2, + 0, + 0, + 2, + 0, + 5, + 0, + 0, + 0, + 2, + 2, + 9, + 0, + 1, + 3, + 1, + 3, + 1, + 0, + 0, + 0, + 2, + 6, + 2, + 5, + 0, + 1, + 13, + 0, + 5 + ], + "weighted_loads": [ + 0.14672596380114555, + 0.5900713875889778, + 0.22260292619466782, + 0.05642724223434925, + 0.1062331274151802, + 0.022385742515325546, + 0.0, + 0.0, + 3.4817268513143063, + 0.05236222594976425, + 0.0, + 0.0, + 0.0, + 0.0, + 0.4499378651380539, + 0.08324486762285233, + 0.03136304020881653, + 0.0, + 0.08142974227666855, + 0.07537355087697506, + 0.0, + 0.0, + 0.19184372574090958, + 0.0, + 0.09553522244095802, + 0.0, + 0.0, + 0.02630985528230667, + 0.03739701956510544, + 0.06693200021982193, + 0.10532845743000507, + 0.3537270426750183, + 0.31913766637444496, + 0.033787358552217484, + 0.07244089618325233, + 0.0, + 0.0, + 0.1091783307492733, + 0.0, + 0.3909987658262253, + 0.0, + 0.0, + 0.0, + 0.1251228116452694, + 0.05820694379508495, + 0.860790491104126, + 0.0, + 0.022229330614209175, + 0.27311844006180763, + 0.033630046993494034, + 0.1450689323246479, + 0.029275383800268173, + 0.0, + 0.0, + 0.0, + 0.057187097147107124, + 0.18410494551062584, + 0.08537216484546661, + 0.22248592227697372, + 0.0, + 0.0418933667242527, + 0.8699112795293331, + 0.0, + 0.2653421014547348 + ], + "unique_experts": 40, + "load_cv": 1.6257097395014435, + "normalized_load_entropy": 0.7875853914711318, + "max_load_share": 0.15942028985507245 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "55fee12c32c519302e17f21bc3bf1261873df7ad4ca6ff7824ec32b5630cb251", + "route_weight_sha256": "47ec313433f491fa98860461c44115089187a0d3054e7b42201721ec65f595c3", + "loads": [ + 6, + 11, + 2, + 13, + 1, + 3, + 6, + 1, + 45, + 11, + 0, + 6, + 3, + 0, + 11, + 5, + 4, + 2, + 3, + 2, + 1, + 14, + 5, + 0, + 2, + 1, + 0, + 3, + 2, + 2, + 2, + 3, + 5, + 10, + 11, + 5, + 2, + 5, + 0, + 6, + 12, + 1, + 4, + 4, + 2, + 9, + 1, + 3, + 6, + 4, + 14, + 4, + 5, + 3, + 0, + 25, + 10, + 3, + 6, + 0, + 16, + 25, + 1, + 12 + ], + "weighted_loads": [ + 0.27410511299967766, + 1.042236341163516, + 0.22260292619466782, + 1.352817252278328, + 0.1062331274151802, + 0.08312597591429949, + 0.356549508869648, + 0.04289092868566513, + 5.3831295017153025, + 0.5689756833016872, + 0.0, + 0.36776610277593136, + 0.1400878131389618, + 0.0, + 0.7624190002679825, + 0.3194858767092228, + 0.17331622540950775, + 0.050206514075398445, + 0.1215587854385376, + 0.07537355087697506, + 0.0491466261446476, + 1.176840603351593, + 0.2344878874719143, + 0.0, + 0.09553522244095802, + 0.02553967386484146, + 0.0, + 0.13237764686346054, + 0.1210421770811081, + 0.06693200021982193, + 0.10532845743000507, + 0.3537270426750183, + 0.36842384189367294, + 0.39811106212437153, + 0.4592545162886381, + 0.239957083016634, + 0.09036019816994667, + 0.24591656029224396, + 0.0, + 0.4322674721479416, + 0.7027088515460491, + 0.025403395295143127, + 0.3637942783534527, + 0.26149674504995346, + 0.05820694379508495, + 0.860790491104126, + 0.034112270921468735, + 0.09157384186983109, + 0.40658803284168243, + 0.5758631192147732, + 0.6694900710135698, + 0.23289839923381805, + 0.5515716783702374, + 0.1262722723186016, + 0.0, + 2.096413776278496, + 0.40041617304086685, + 0.11042459309101105, + 0.2648059166967869, + 0.0, + 2.1298144683241844, + 1.4465691298246384, + 0.028195589780807495, + 0.5843620263040066 + ], + "unique_experts": 57, + "load_cv": 1.2151388809514738, + "normalized_load_entropy": 0.8709245556692441, + "max_load_share": 0.1171875 + } + }, + "s0_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "0f8909f576528395c972b1eee5efa9486a2ad6d124e75d0c877054e8cb993731", + "route_weight_sha256": "891226e3459ee9132d10e2f8f7c7463b216fe28ae8200b7531be81096fa19b73", + "loads": [ + 4, + 6, + 2, + 2, + 1, + 2, + 1, + 0, + 22, + 1, + 0, + 0, + 0, + 0, + 7, + 1, + 0, + 0, + 2, + 1, + 0, + 0, + 4, + 0, + 1, + 0, + 0, + 1, + 1, + 2, + 1, + 3, + 4, + 0, + 3, + 1, + 0, + 2, + 0, + 6, + 0, + 0, + 1, + 2, + 1, + 10, + 0, + 2, + 4, + 1, + 3, + 1, + 0, + 0, + 0, + 0, + 5, + 2, + 5, + 0, + 3, + 11, + 0, + 6 + ], + "weighted_loads": [ + 0.12253471836447716, + 0.6191392950713634, + 0.2546681836247444, + 0.05706068314611912, + 0.09225565940141678, + 0.045328179374337196, + 0.029706578701734543, + 0.0, + 3.700436819344759, + 0.03719678893685341, + 0.0, + 0.0, + 0.0, + 0.0, + 0.4104210417717695, + 0.08574869483709335, + 0.0, + 0.0, + 0.08522854372859001, + 0.05211717635393143, + 0.0, + 0.0, + 0.19749082066118717, + 0.0, + 0.06816458702087402, + 0.0, + 0.0, + 0.030393097549676895, + 0.03475908562541008, + 0.07085341773927212, + 0.07631398737430573, + 0.37545906007289886, + 0.32511212304234505, + 0.0, + 0.08356237225234509, + 0.0415356270968914, + 0.0, + 0.11490033566951752, + 0.0, + 0.38011155650019646, + 0.0, + 0.0, + 0.02454124018549919, + 0.10973190143704414, + 0.023732773959636688, + 0.9546796157956123, + 0.0, + 0.060382384806871414, + 0.3133677374571562, + 0.034808095544576645, + 0.12961016967892647, + 0.02857746183872223, + 0.0, + 0.0, + 0.0, + 0.0, + 0.16020352579653263, + 0.08648154512047768, + 0.22216371446847916, + 0.0, + 0.11817310750484467, + 0.6125248204916716, + 0.0, + 0.356919065117836 + ], + "unique_experts": 40, + "load_cv": 1.6028094427101531, + "normalized_load_entropy": 0.7888601573026225, + "max_load_share": 0.15942028985507245 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "5f33419772b2a4781328946a09a182530d0b0aacab7c29cdfc414a17bb7a18fb", + "route_weight_sha256": "5b6635314e9c389c4e6fc53eb367fa8e3a9c718eab7d94b0a0f2bea7c912199a", + "loads": [ + 8, + 7, + 5, + 10, + 1, + 4, + 6, + 0, + 36, + 6, + 0, + 3, + 0, + 0, + 11, + 1, + 0, + 2, + 2, + 1, + 0, + 8, + 5, + 2, + 1, + 1, + 0, + 5, + 1, + 3, + 1, + 3, + 6, + 7, + 4, + 3, + 0, + 4, + 0, + 7, + 5, + 1, + 5, + 2, + 1, + 11, + 1, + 2, + 6, + 4, + 8, + 1, + 0, + 1, + 0, + 16, + 8, + 3, + 5, + 0, + 13, + 18, + 0, + 13 + ], + "weighted_loads": [ + 0.29598877020180225, + 0.7152744047343731, + 0.3659598231315613, + 1.0442794021219015, + 0.09225565940141678, + 0.12366416957229376, + 0.3301857262849808, + 0.0, + 4.992673797532916, + 0.2279464453458786, + 0.0, + 0.14458766020834446, + 0.0, + 0.0, + 0.8236326221376657, + 0.08574869483709335, + 0.0, + 0.08492984063923359, + 0.08522854372859001, + 0.05211717635393143, + 0.0, + 0.7249466869980097, + 0.22696875222027302, + 0.06976079940795898, + 0.06816458702087402, + 0.02620566450059414, + 0.0, + 0.21711041405797005, + 0.03475908562541008, + 0.12358474545180798, + 0.07631398737430573, + 0.37545906007289886, + 0.3932170756161213, + 0.24486770667135715, + 0.14089554361999035, + 0.14391642808914185, + 0.0, + 0.2254485860466957, + 0.0, + 0.40945257619023323, + 0.23876785673201084, + 0.09092717617750168, + 0.25114527344703674, + 0.10973190143704414, + 0.023732773959636688, + 0.9877440184354782, + 0.03787221387028694, + 0.060382384806871414, + 0.4050781112164259, + 0.2608081325888634, + 0.4032471999526024, + 0.02857746183872223, + 0.0, + 0.03877321630716324, + 0.0, + 1.2887207195162773, + 0.28152461163699627, + 0.1121915951371193, + 0.22216371446847916, + 0.0, + 1.444542858749628, + 0.8637419119477272, + 0.0, + 0.6367881260812283 + ], + "unique_experts": 51, + "load_cv": 1.2723313878443097, + "normalized_load_entropy": 0.8505777820422356, + "max_load_share": 0.125 + } + }, + "s1_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "86ffdd524a3a167d8e6d01667189b102a822f9428725ecbf569233208613e834", + "route_weight_sha256": "afef2744cfe4f68f6f789439ed979e3b67b2d3aa383da0e539bf2393565e2b5e", + "loads": [ + 3, + 6, + 2, + 1, + 1, + 2, + 1, + 0, + 22, + 1, + 0, + 0, + 0, + 0, + 8, + 1, + 1, + 0, + 2, + 1, + 0, + 0, + 4, + 0, + 1, + 0, + 0, + 1, + 1, + 2, + 2, + 4, + 4, + 1, + 2, + 2, + 0, + 2, + 0, + 5, + 0, + 0, + 0, + 2, + 2, + 10, + 0, + 1, + 3, + 1, + 3, + 1, + 0, + 0, + 0, + 0, + 6, + 2, + 4, + 0, + 2, + 13, + 0, + 5 + ], + "weighted_loads": [ + 0.1342768706381321, + 0.596057154238224, + 0.24348803609609604, + 0.02689240872859955, + 0.10511849820613861, + 0.042969247326254845, + 0.030328836292028427, + 0.0, + 3.3581080809235573, + 0.05173337087035179, + 0.0, + 0.0, + 0.0, + 0.0, + 0.4476289302110672, + 0.08518260717391968, + 0.03214753046631813, + 0.0, + 0.08232799544930458, + 0.05215536430478096, + 0.0, + 0.0, + 0.19242871925234795, + 0.0, + 0.058521568775177, + 0.0, + 0.0, + 0.025616690516471863, + 0.03728443756699562, + 0.06892194040119648, + 0.10753015615046024, + 0.40768522024154663, + 0.3241995498538017, + 0.033550046384334564, + 0.08833509311079979, + 0.07838317006826401, + 0.0, + 0.11713052168488503, + 0.0, + 0.39407459646463394, + 0.0, + 0.0, + 0.0, + 0.13031503185629845, + 0.06609940528869629, + 0.9080953896045685, + 0.0, + 0.024160705506801605, + 0.2722240649163723, + 0.030905066058039665, + 0.1472746580839157, + 0.03346927464008331, + 0.0, + 0.0, + 0.0, + 0.0, + 0.19153535179793835, + 0.08769293501973152, + 0.18000807613134384, + 0.0, + 0.0703225675970316, + 0.7516726143658161, + 0.0, + 0.2805277518928051 + ], + "unique_experts": 41, + "load_cv": 1.633957546963936, + "normalized_load_entropy": 0.7886961215901463, + "max_load_share": 0.15942028985507245 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "52c35721eb3b5a1a32b5c5f8674cdc9761e00c548f1ed5fdfefee0171f31a598", + "route_weight_sha256": "ca4c9e8fc6f7ed1d248aa110ede0a6f5ead63d1b6d42e8ec23f8c397a07eed05", + "loads": [ + 5, + 12, + 2, + 11, + 1, + 4, + 5, + 1, + 43, + 10, + 0, + 6, + 3, + 0, + 12, + 5, + 4, + 2, + 3, + 1, + 1, + 15, + 5, + 0, + 1, + 1, + 0, + 3, + 2, + 2, + 3, + 4, + 5, + 11, + 11, + 7, + 2, + 4, + 0, + 7, + 13, + 1, + 5, + 4, + 2, + 11, + 1, + 3, + 6, + 3, + 15, + 4, + 5, + 3, + 0, + 23, + 10, + 3, + 5, + 0, + 18, + 24, + 0, + 11 + ], + "weighted_loads": [ + 0.2616560198366642, + 1.103090399876237, + 0.24348803609609604, + 1.2749784458428621, + 0.10511849820613861, + 0.10693230759352446, + 0.30104558914899826, + 0.04289092868566513, + 5.16551429592073, + 0.5236287675797939, + 0.0, + 0.3756409455090761, + 0.1400878131389618, + 0.0, + 0.8666484132409096, + 0.32142361626029015, + 0.17410071566700935, + 0.050206514075398445, + 0.12245703861117363, + 0.05215536430478096, + 0.0491466261446476, + 1.225862730294466, + 0.23507288098335266, + 0.0, + 0.058521568775177, + 0.02553967386484146, + 0.0, + 0.14024782180786133, + 0.12092959508299828, + 0.06892194040119648, + 0.15093995071947575, + 0.40768522024154663, + 0.3734857253730297, + 0.4193581026047468, + 0.46643190644681454, + 0.29526326060295105, + 0.09036019816994667, + 0.19220943748950958, + 0.0, + 0.495688010007143, + 0.7609811741858721, + 0.025403395295143127, + 0.3781370781362057, + 0.2666889652609825, + 0.06609940528869629, + 0.9406032115221024, + 0.034112270921468735, + 0.09350521676242352, + 0.4241620749235153, + 0.4892509412020445, + 0.7468241136521101, + 0.2370922900736332, + 0.5515716783702374, + 0.15216349437832832, + 0.0, + 1.9887322541326284, + 0.40784657932817936, + 0.11274536326527596, + 0.222328070551157, + 0.0, + 2.256663018837571, + 1.2083079479634762, + 0.0, + 0.5426356196403503 + ], + "unique_experts": 56, + "load_cv": 1.1887785514739255, + "normalized_load_entropy": 0.8701644804330273, + "max_load_share": 0.11197916666666667 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 18, + "mean_set_jaccard": 0.9378881987577639, + "mean_token_weighted_tv": 0.015581588584767736, + "aggregate_load_tv": 0.03623188405797101 + }, + "system_bos": { + "tokens": 23, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.9006211180124224, + "mean_token_weighted_tv": 0.022381046584442905, + "aggregate_load_tv": 0.050724637681159424 + }, + "system_x": { + "tokens": 23, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 11, + "mean_set_jaccard": 0.8322981366459627, + "mean_token_weighted_tv": 0.03688635685197685, + "aggregate_load_tv": 0.07971014492753624 + }, + "system_period": { + "tokens": 23, + "ordered_topk_exact_tokens": 8, + "set_exact_tokens": 13, + "mean_set_jaccard": 0.875776397515528, + "mean_token_weighted_tv": 0.03574321196293053, + "aggregate_load_tv": 0.07246376811594203 + }, + "bos_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 12, + "mean_set_jaccard": 0.8633540372670808, + "mean_token_weighted_tv": 0.02765089447569588, + "aggregate_load_tv": 0.06521739130434782 + }, + "bos_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.9037267080745341, + "mean_token_weighted_tv": 0.023466664042485798, + "aggregate_load_tv": 0.05797101449275361 + }, + "x_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.9130434782608697, + "mean_token_weighted_tv": 0.022685091618610466, + "aggregate_load_tv": 0.05072463768115942 + }, + "x_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 8, + "set_exact_tokens": 11, + "mean_set_jaccard": 0.8343685300207039, + "mean_token_weighted_tv": 0.03976769247294768, + "aggregate_load_tv": 0.08695652173913045 + }, + "period_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.8944099378881988, + "mean_token_weighted_tv": 0.025243667683199696, + "aggregate_load_tv": 0.05072463768115942 + }, + "period_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8695652173913043, + "mean_token_weighted_tv": 0.03544582697846319, + "aggregate_load_tv": 0.07971014492753624 + } + } + }, + "layer_23": { + "layer": 23, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "669a1af5d55eb711b83f20d46df05622345e4f020b8e5b163f5d82692d200cd7", + "route_weight_sha256": "e9fa94b7a3f0224818b6296598d6181c41d5df06017076eb723b53e7712dc7f5", + "loads": [ + 1, + 1, + 0, + 1, + 0, + 2, + 0, + 2, + 7, + 1, + 5, + 7, + 0, + 2, + 1, + 0, + 2, + 1, + 1, + 3, + 5, + 1, + 2, + 5, + 5, + 0, + 1, + 0, + 2, + 0, + 1, + 6, + 4, + 2, + 1, + 2, + 9, + 0, + 3, + 0, + 4, + 0, + 11, + 0, + 2, + 4, + 11, + 0, + 0, + 1, + 0, + 0, + 5, + 4, + 0, + 2, + 1, + 1, + 3, + 0, + 0, + 0, + 3, + 0 + ], + "weighted_loads": [ + 0.05057277902960777, + 0.0398576445877552, + 0.0, + 0.041702751070261, + 0.0, + 0.12593932077288628, + 0.0, + 0.09386130981147289, + 0.33079245686531067, + 0.038150444626808167, + 0.3231427017599344, + 0.3884850796312094, + 0.0, + 0.09100089967250824, + 0.03272358700633049, + 0.0, + 0.06629498675465584, + 0.0332457572221756, + 0.038721807301044464, + 0.09464706480503082, + 0.5125089175999165, + 0.028957733884453773, + 0.09134576097130775, + 0.31465817615389824, + 0.2900632657110691, + 0.0, + 0.0312763936817646, + 0.0, + 0.08064822480082512, + 0.0, + 0.03012017346918583, + 0.2836146168410778, + 0.14329210296273232, + 0.06529685854911804, + 0.06051266938447952, + 0.15898508951067924, + 0.7150018624961376, + 0.0, + 0.16992198675870895, + 0.0, + 0.1574050448834896, + 0.0, + 0.5418455563485622, + 0.0, + 0.12246410176157951, + 0.29177678748965263, + 0.8733628429472446, + 0.0, + 0.0, + 0.09267604351043701, + 0.0, + 0.0, + 0.5489654876291752, + 0.19090677425265312, + 0.0, + 0.06499616429209709, + 0.030018772929906845, + 0.06335905194282532, + 0.10165269114077091, + 0.0, + 0.0, + 0.0, + 0.11758086085319519, + 0.0 + ], + "unique_experts": 43, + "load_cv": 1.2138492293900511, + "normalized_load_entropy": 0.8363032102879405, + "max_load_share": 0.07971014492753623 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "7303e156c197c2ad687c809a9626fcff3d6bb891a42da15796517b191b3b27f3", + "route_weight_sha256": "99cff1d416148827cad6b64484dcba6974d4a60ad35a7461879cf821eba0c96a", + "loads": [ + 6, + 4, + 0, + 8, + 5, + 4, + 4, + 7, + 8, + 11, + 5, + 9, + 2, + 6, + 2, + 1, + 8, + 2, + 1, + 3, + 5, + 1, + 4, + 15, + 9, + 0, + 1, + 0, + 2, + 0, + 1, + 6, + 8, + 6, + 1, + 3, + 10, + 0, + 7, + 0, + 11, + 0, + 13, + 0, + 2, + 11, + 23, + 3, + 1, + 1, + 1, + 2, + 5, + 4, + 10, + 3, + 1, + 10, + 5, + 0, + 1, + 0, + 5, + 1 + ], + "weighted_loads": [ + 0.23963079205714166, + 0.20945480465888977, + 0.0, + 0.2568493513390422, + 0.19622228480875492, + 0.17848821310326457, + 0.19734790921211243, + 0.3774333093315363, + 0.3315331137855537, + 0.3758377283811569, + 0.3231427017599344, + 0.4700340237468481, + 0.04738112259656191, + 0.27283819392323494, + 0.10895784571766853, + 0.036467649042606354, + 0.2545610349625349, + 0.07043491676449776, + 0.038721807301044464, + 0.09464706480503082, + 0.5125089175999165, + 0.028957733884453773, + 0.2109469249844551, + 1.734958939254284, + 0.41865672916173935, + 0.0, + 0.0312763936817646, + 0.0, + 0.08064822480082512, + 0.0, + 0.03012017346918583, + 0.2836146168410778, + 0.3599115088582039, + 0.5522559137316421, + 0.06051266938447952, + 0.19057997688651085, + 0.7524452209472656, + 0.0, + 0.35565977543592453, + 0.0, + 0.51972246915102, + 0.0, + 0.5935552306473255, + 0.0, + 0.12246410176157951, + 2.324011756107211, + 1.8641081117093563, + 0.06262425426393747, + 0.03934338316321373, + 0.09267604351043701, + 0.05259133502840996, + 0.11657489649951458, + 0.5489654876291752, + 0.19090677425265312, + 0.9238461330533028, + 0.1323116235435009, + 0.030018772929906845, + 0.888226605951786, + 0.18030908703804016, + 0.0, + 0.03750871866941452, + 0.0, + 0.18649916723370552, + 0.04223385453224182 + ], + "unique_experts": 54, + "load_cv": 0.9828781118307851, + "normalized_load_entropy": 0.8873207188004112, + "max_load_share": 0.0798611111111111 + } + }, + "s1_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "d043abbb7dbee4696f120535e7754470ae042bb42c762acdf5cd2d69629ec121", + "route_weight_sha256": "c92e6c8c68ef0d5c1c30887d9d966d196714f4d74d7f1456996065e6548be6b5", + "loads": [ + 1, + 3, + 0, + 1, + 0, + 3, + 0, + 1, + 4, + 1, + 5, + 7, + 0, + 2, + 1, + 0, + 2, + 1, + 1, + 2, + 6, + 0, + 2, + 5, + 5, + 0, + 0, + 0, + 2, + 0, + 1, + 7, + 4, + 1, + 1, + 2, + 9, + 0, + 3, + 0, + 3, + 0, + 11, + 0, + 2, + 5, + 12, + 1, + 0, + 1, + 0, + 0, + 5, + 4, + 0, + 3, + 1, + 1, + 2, + 1, + 0, + 0, + 3, + 0 + ], + "weighted_loads": [ + 0.05125535652041435, + 0.10488472320139408, + 0.0, + 0.042295388877391815, + 0.0, + 0.15642903558909893, + 0.0, + 0.06675264984369278, + 0.2206137701869011, + 0.03679512441158295, + 0.3230155874043703, + 0.36637580022215843, + 0.0, + 0.09532787278294563, + 0.034527331590652466, + 0.0, + 0.07099770568311214, + 0.03277650475502014, + 0.03794264793395996, + 0.07076221331954002, + 0.537465013563633, + 0.0, + 0.08508574217557907, + 0.3024241402745247, + 0.28515826165676117, + 0.0, + 0.0, + 0.0, + 0.07778903469443321, + 0.0, + 0.031505223363637924, + 0.3227302897721529, + 0.14301020838320255, + 0.031525854021310806, + 0.061819128692150116, + 0.1591457910835743, + 0.6597876660525799, + 0.0, + 0.1709558106958866, + 0.0, + 0.1157204881310463, + 0.0, + 0.516893956810236, + 0.0, + 0.12068510428071022, + 0.3166095446795225, + 0.9100907035171986, + 0.031451258808374405, + 0.0, + 0.09122798591852188, + 0.0, + 0.0, + 0.5479289330542088, + 0.1831263266503811, + 0.0, + 0.10778588056564331, + 0.030809950083494186, + 0.05679454281926155, + 0.06231609173119068, + 0.032780807465314865, + 0.0, + 0.0, + 0.12879348173737526, + 0.0 + ], + "unique_experts": 43, + "load_cv": 1.2385158235059268, + "normalized_load_entropy": 0.8333133827420823, + "max_load_share": 0.08695652173913043 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "ec255bf31ce401b7856b73a0590af709d6673e95c4803232481ab6a4f340c5ba", + "route_weight_sha256": "7830da94e3c6fcc5e778a6e8cb75180991354b4680b30dc97c10d1ad1887c212", + "loads": [ + 7, + 8, + 7, + 10, + 3, + 5, + 11, + 9, + 6, + 5, + 7, + 9, + 2, + 7, + 3, + 3, + 10, + 2, + 3, + 2, + 7, + 0, + 5, + 20, + 7, + 0, + 0, + 0, + 2, + 1, + 1, + 7, + 6, + 13, + 1, + 2, + 15, + 1, + 10, + 1, + 12, + 0, + 13, + 0, + 4, + 13, + 29, + 5, + 6, + 4, + 0, + 10, + 11, + 5, + 10, + 4, + 1, + 17, + 6, + 1, + 2, + 1, + 10, + 2 + ], + "weighted_loads": [ + 0.3787249205633998, + 0.4241416547447443, + 0.35382065922021866, + 0.5355664703529328, + 0.10557765513658524, + 0.2002736716531217, + 0.5691324174404144, + 0.3853005152195692, + 0.2570308273425326, + 0.19221044704318047, + 0.42037750966846943, + 0.4403136484324932, + 0.0492447204887867, + 0.3072827085852623, + 0.1729634329676628, + 0.1202937513589859, + 0.32402258925139904, + 0.09094160050153732, + 0.12755132839083672, + 0.07076221331954002, + 0.5851482972502708, + 0.0, + 0.21297076158225536, + 2.3283875100314617, + 0.36557819694280624, + 0.0, + 0.0, + 0.0, + 0.07778903469443321, + 0.04619290307164192, + 0.031505223363637924, + 0.3227302897721529, + 0.2806541007012129, + 0.9309947089059278, + 0.061819128692150116, + 0.1591457910835743, + 1.087455552071333, + 0.047892242670059204, + 0.5891685914248228, + 0.023720426484942436, + 0.5203380566090345, + 0.0, + 0.5697004292160273, + 0.0, + 0.2223421148955822, + 2.4093620758503675, + 2.5681753158569336, + 0.25773388356901705, + 0.2649549040943384, + 0.24300849065184593, + 0.0, + 0.6213372573256493, + 1.192473191767931, + 0.21482231095433235, + 0.9615596905350685, + 0.13945459574460983, + 0.030809950083494186, + 1.4602460358291864, + 0.2543720919638872, + 0.032780807465314865, + 0.07378042675554752, + 0.12675859034061432, + 0.39822366274893284, + 0.08427420258522034 + ], + "unique_experts": 57, + "load_cv": 0.9085817703065219, + "normalized_load_entropy": 0.9039624949482401, + "max_load_share": 0.07552083333333333 + } + }, + "s0_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "4a10eed8ecd675d31e5a0e884c74512b56f9c4e84b58dead270e9d88f76577a3", + "route_weight_sha256": "0b6ea490e4d5805ae43e36cc9240f8daff015ff04765e5f1fa8d4ae82a2949e0", + "loads": [ + 1, + 1, + 0, + 3, + 0, + 2, + 0, + 2, + 4, + 1, + 4, + 7, + 0, + 3, + 1, + 0, + 2, + 1, + 1, + 3, + 6, + 1, + 2, + 4, + 5, + 0, + 0, + 0, + 3, + 0, + 1, + 6, + 4, + 1, + 1, + 2, + 9, + 0, + 3, + 0, + 4, + 0, + 11, + 0, + 2, + 4, + 11, + 0, + 0, + 1, + 0, + 0, + 5, + 4, + 0, + 3, + 1, + 2, + 3, + 0, + 0, + 0, + 3, + 0 + ], + "weighted_loads": [ + 0.060126371681690216, + 0.03800516203045845, + 0.0, + 0.09987169876694679, + 0.0, + 0.12712340988218784, + 0.0, + 0.0981256291270256, + 0.23173164576292038, + 0.03700253739953041, + 0.25494357757270336, + 0.42772654071450233, + 0.0, + 0.13689934834837914, + 0.03553866595029831, + 0.0, + 0.07253084518015385, + 0.032847609370946884, + 0.039624761790037155, + 0.10026654042303562, + 0.5459473729133606, + 0.03366188704967499, + 0.08377326279878616, + 0.27397066727280617, + 0.3011094443500042, + 0.0, + 0.0, + 0.0, + 0.1121229287236929, + 0.0, + 0.028623392805457115, + 0.27141858264803886, + 0.1410246230661869, + 0.032814595848321915, + 0.06291604787111282, + 0.16290445998311043, + 0.7340856231749058, + 0.0, + 0.1741524264216423, + 0.0, + 0.16606172919273376, + 0.0, + 0.5618283376097679, + 0.0, + 0.12262571230530739, + 0.30678316205739975, + 0.8815633654594421, + 0.0, + 0.0, + 0.09247968345880508, + 0.0, + 0.0, + 0.5847204811871052, + 0.2038538008928299, + 0.0, + 0.11620913073420525, + 0.030990807339549065, + 0.09661526791751385, + 0.09890450164675713, + 0.0, + 0.0, + 0.0, + 0.11673638597130775, + 0.0 + ], + "unique_experts": 42, + "load_cv": 1.1886708788840914, + "normalized_load_entropy": 0.838659588143898, + "max_load_share": 0.07971014492753623 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "048cf25b988219f07a396958abece2a2fcf18cecd6f41a6ef7a6fcebbccffe06", + "route_weight_sha256": "4be6c13b5f36a2f453009d9ac626418249b8bad5cde3ea85675c386511a2c32b", + "loads": [ + 4, + 4, + 0, + 9, + 6, + 4, + 4, + 8, + 4, + 11, + 4, + 9, + 2, + 7, + 3, + 0, + 7, + 1, + 1, + 4, + 6, + 1, + 5, + 15, + 9, + 0, + 1, + 0, + 3, + 0, + 1, + 6, + 7, + 4, + 1, + 3, + 9, + 0, + 6, + 0, + 11, + 0, + 13, + 1, + 2, + 9, + 23, + 2, + 1, + 1, + 1, + 3, + 5, + 4, + 10, + 5, + 1, + 12, + 6, + 1, + 1, + 0, + 5, + 2 + ], + "weighted_loads": [ + 0.1811577663756907, + 0.20760232210159302, + 0.0, + 0.31145976576954126, + 0.25919664837419987, + 0.17967230221256614, + 0.19921477511525154, + 0.39531082659959793, + 0.23173164576292038, + 0.3701486960053444, + 0.25494357757270336, + 0.49463661573827267, + 0.04367935378104448, + 0.31873664259910583, + 0.1542583405971527, + 0.0, + 0.2280028760433197, + 0.032847609370946884, + 0.039624761790037155, + 0.2887201700359583, + 0.5459473729133606, + 0.03366188704967499, + 0.2235795557498932, + 1.7802998572587967, + 0.42970290780067444, + 0.0, + 0.10740687698125839, + 0.0, + 0.1121229287236929, + 0.0, + 0.028623392805457115, + 0.27141858264803886, + 0.28333552926778793, + 0.46794622763991356, + 0.06291604787111282, + 0.19449934735894203, + 0.7340856231749058, + 0.0, + 0.3233921639621258, + 0.0, + 0.5113939493894577, + 0.0, + 0.6135380119085312, + 0.032989632338285446, + 0.12262571230530739, + 1.335393100976944, + 1.9060808345675468, + 0.0588053073734045, + 0.03934338316321373, + 0.09247968345880508, + 0.043711934238672256, + 0.14670879766345024, + 0.5847204811871052, + 0.2038538008928299, + 0.9238461330533028, + 0.2244717888534069, + 0.030990807339549065, + 0.9729844648391008, + 0.2431715577840805, + 0.2846871614456177, + 0.032714974135160446, + 0.0, + 0.18565469235181808, + 0.0793754905462265 + ], + "unique_experts": 55, + "load_cv": 0.9694404648119526, + "normalized_load_entropy": 0.8919172501344995, + "max_load_share": 0.0798611111111111 + } + }, + "s1_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "0d0ef8220492b6263d3ff00046eaab3daa8c34c365b76f0ebd8af75ee110f135", + "route_weight_sha256": "a9b10b32d542d47b6b0349e4f1433fc1d9b72e94afbbc9707ba26ac902f0258d", + "loads": [ + 1, + 2, + 0, + 2, + 0, + 2, + 1, + 1, + 4, + 1, + 4, + 7, + 0, + 3, + 1, + 0, + 2, + 1, + 1, + 2, + 6, + 0, + 2, + 5, + 6, + 0, + 0, + 0, + 2, + 0, + 1, + 6, + 5, + 2, + 1, + 2, + 10, + 0, + 3, + 0, + 2, + 0, + 11, + 0, + 2, + 5, + 12, + 0, + 0, + 1, + 0, + 0, + 5, + 4, + 0, + 3, + 0, + 1, + 2, + 1, + 0, + 0, + 3, + 0 + ], + "weighted_loads": [ + 0.06177153438329697, + 0.06947137974202633, + 0.0, + 0.07246434316039085, + 0.0, + 0.12603666260838509, + 0.03385462239384651, + 0.07150637358427048, + 0.2358461171388626, + 0.033670127391815186, + 0.2682007625699043, + 0.3871389664709568, + 0.0, + 0.14204005151987076, + 0.03335406258702278, + 0.0, + 0.08494029194116592, + 0.032389525324106216, + 0.040451545268297195, + 0.0731893740594387, + 0.5477177388966084, + 0.0, + 0.08183804154396057, + 0.26694848760962486, + 0.3272164613008499, + 0.0, + 0.0, + 0.0, + 0.08513990789651871, + 0.0, + 0.03219633921980858, + 0.2925585210323334, + 0.1594459004700184, + 0.06830236315727234, + 0.06482567638158798, + 0.15895837545394897, + 0.7586981691420078, + 0.0, + 0.17080944404006004, + 0.0, + 0.08290517330169678, + 0.0, + 0.5003799833357334, + 0.0, + 0.11850976943969727, + 0.32312753424048424, + 0.9195929281413555, + 0.0, + 0.0, + 0.09020441025495529, + 0.0, + 0.0, + 0.5753379464149475, + 0.20267926156520844, + 0.0, + 0.11345767602324486, + 0.0, + 0.059444598853588104, + 0.05942940525710583, + 0.030270012095570564, + 0.0, + 0.0, + 0.11857135966420174, + 0.0 + ], + "unique_experts": 42, + "load_cv": 1.2546908413351843, + "normalized_load_entropy": 0.8297643416655367, + "max_load_share": 0.08695652173913043 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "5d839026b5ee629426d7c0fcc2447a87042e401e562f13595b9fa994b6ae95c9", + "route_weight_sha256": "a2366aa1d9e5443df086926f8bbee3fccf4164a35e3cb2c7bca6aa0b913f3f80", + "loads": [ + 6, + 7, + 7, + 10, + 5, + 4, + 11, + 10, + 5, + 5, + 6, + 10, + 1, + 8, + 3, + 3, + 10, + 2, + 3, + 2, + 7, + 0, + 5, + 21, + 8, + 0, + 0, + 0, + 2, + 1, + 2, + 6, + 7, + 12, + 1, + 2, + 16, + 2, + 9, + 1, + 13, + 0, + 13, + 0, + 4, + 10, + 29, + 3, + 6, + 4, + 0, + 10, + 11, + 7, + 10, + 6, + 0, + 17, + 4, + 1, + 3, + 1, + 9, + 3 + ], + "weighted_loads": [ + 0.37944653118029237, + 0.38872831128537655, + 0.350657906383276, + 0.5621920777484775, + 0.19713648781180382, + 0.16988129867240787, + 0.5620781928300858, + 0.46260405145585537, + 0.27154408395290375, + 0.19269369542598724, + 0.36556268483400345, + 0.5028968844562769, + 0.010233968496322632, + 0.3539948873221874, + 0.16677353158593178, + 0.1202937513589859, + 0.3192627876996994, + 0.0905546210706234, + 0.13006022572517395, + 0.0731893740594387, + 0.5954010225832462, + 0.0, + 0.2193468976765871, + 2.378241091966629, + 0.407636396586895, + 0.0, + 0.0, + 0.0, + 0.08513990789651871, + 0.04619290307164192, + 0.0854775458574295, + 0.2925585210323334, + 0.27044250071048737, + 0.8881297335028648, + 0.06482567638158798, + 0.15895837545394897, + 1.1863660551607609, + 0.0941333919763565, + 0.5319560077041388, + 0.023720426484942436, + 0.6012949217110872, + 0.0, + 0.5531864557415247, + 0.0, + 0.22016678005456924, + 1.3697430789470673, + 2.5955767408013344, + 0.2225788403302431, + 0.2649549040943384, + 0.24198491498827934, + 0.0, + 0.6213372573256493, + 1.2198822051286697, + 0.3538060709834099, + 0.9615596905350685, + 0.25984855368733406, + 0.0, + 1.4402368310838938, + 0.19482090882956982, + 0.030270012095570564, + 0.10993807949125767, + 0.12675859034061432, + 0.35153825022280216, + 0.134345430880785 + ], + "unique_experts": 56, + "load_cv": 0.9104905576421732, + "normalized_load_entropy": 0.9037813967342951, + "max_load_share": 0.07552083333333333 + } + }, + "s0_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "e51dc08712be9c4a76f743430df3c8e8e789d757e0765f27dc55764ad638dc84", + "route_weight_sha256": "b7b3cfd747415b0c088c940346368ef2dc6852b79febf9e1df653a3049e701c9", + "loads": [ + 1, + 1, + 0, + 3, + 0, + 3, + 0, + 1, + 4, + 1, + 5, + 6, + 0, + 2, + 1, + 0, + 2, + 1, + 1, + 3, + 6, + 1, + 2, + 4, + 5, + 0, + 1, + 0, + 2, + 0, + 0, + 6, + 3, + 3, + 1, + 2, + 9, + 0, + 3, + 0, + 4, + 0, + 11, + 0, + 2, + 4, + 12, + 0, + 0, + 1, + 0, + 0, + 5, + 4, + 1, + 3, + 1, + 1, + 3, + 0, + 0, + 0, + 3, + 0 + ], + "weighted_loads": [ + 0.05394192785024643, + 0.04298922047019005, + 0.0, + 0.10383795015513897, + 0.0, + 0.14576666802167892, + 0.0, + 0.06685304641723633, + 0.23635925725102425, + 0.036769408732652664, + 0.3097192533314228, + 0.32474489510059357, + 0.0, + 0.10096342861652374, + 0.030509619042277336, + 0.0, + 0.07697372883558273, + 0.03451717272400856, + 0.038353897631168365, + 0.09513269551098347, + 0.5542394891381264, + 0.031477190554142, + 0.07664309069514275, + 0.26147687807679176, + 0.2763235792517662, + 0.0, + 0.030822299420833588, + 0.0, + 0.0817197673022747, + 0.0, + 0.0, + 0.2892378568649292, + 0.10185992904007435, + 0.09713084436953068, + 0.055788736790418625, + 0.14837493002414703, + 0.6996434144675732, + 0.0, + 0.16830762848258018, + 0.0, + 0.1604500748217106, + 0.0, + 0.5558791197836399, + 0.0, + 0.12194393202662468, + 0.30153289437294006, + 0.9297555387020111, + 0.0, + 0.0, + 0.09083124995231628, + 0.0, + 0.0, + 0.5693166106939316, + 0.19155862741172314, + 0.03189781680703163, + 0.10965366289019585, + 0.03102753683924675, + 0.05243731662631035, + 0.08983736485242844, + 0.0, + 0.0, + 0.0, + 0.10735449194908142, + 0.0 + ], + "unique_experts": 43, + "load_cv": 1.2027239265601517, + "normalized_load_entropy": 0.8396395147982849, + "max_load_share": 0.08695652173913043 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "dba2789e790b62e7e826af304e6977674353a9cfa33d4fd45885fe0292b59984", + "route_weight_sha256": "6ac1a30ee2499d0e46b38e9ec4ef44dcaf2ac2ea990228dc933ea54350530d68", + "loads": [ + 5, + 4, + 0, + 11, + 4, + 5, + 5, + 6, + 4, + 11, + 5, + 8, + 1, + 6, + 3, + 1, + 8, + 1, + 1, + 3, + 6, + 1, + 4, + 15, + 9, + 0, + 1, + 0, + 2, + 0, + 0, + 6, + 6, + 7, + 1, + 3, + 10, + 0, + 7, + 0, + 12, + 0, + 13, + 1, + 2, + 10, + 26, + 2, + 1, + 1, + 0, + 2, + 5, + 4, + 12, + 4, + 1, + 11, + 5, + 0, + 0, + 0, + 5, + 1 + ], + "weighted_loads": [ + 0.2423701942898333, + 0.21258638054132462, + 0.0, + 0.4560689842328429, + 0.158668028190732, + 0.19831556035205722, + 0.2523129768669605, + 0.329745814204216, + 0.23635925725102425, + 0.3628697320818901, + 0.3097192533314228, + 0.4324880950152874, + 0.010243774391710758, + 0.28280072286725044, + 0.1533405613154173, + 0.03230981528759003, + 0.2523797079920769, + 0.03451717272400856, + 0.038353897631168365, + 0.09513269551098347, + 0.5542394891381264, + 0.031477190554142, + 0.16192910820245743, + 1.7085801996290684, + 0.40491704270243645, + 0.0, + 0.030822299420833588, + 0.0, + 0.0817197673022747, + 0.0, + 0.0, + 0.2892378568649292, + 0.24412878416478634, + 0.4983618091791868, + 0.055788736790418625, + 0.17996981739997864, + 0.7379659116268158, + 0.0, + 0.37970250099897385, + 0.0, + 0.48779695853590965, + 0.0, + 0.6075887940824032, + 0.024695182219147682, + 0.12194393202662468, + 1.3682636879384518, + 2.093882691115141, + 0.0588053073734045, + 0.03934338316321373, + 0.09083124995231628, + 0.0, + 0.11657489649951458, + 0.5693166106939316, + 0.19155862741172314, + 1.090406846255064, + 0.15988950803875923, + 0.03102753683924675, + 0.9748711846768856, + 0.17249121516942978, + 0.0, + 0.0, + 0.0, + 0.17627279832959175, + 0.05564730241894722 + ], + "unique_experts": 52, + "load_cv": 1.0533602903254744, + "normalized_load_entropy": 0.8752694863267939, + "max_load_share": 0.09027777777777778 + } + }, + "s1_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "ceb224a6a73a5c2efa8ee6b8b175a25a01cfc342c2105dac18ff4f99d9e389ba", + "route_weight_sha256": "e2b64cee5d4576605ca27ee3f2f9c13ad97e3ae0d6fc82dfc98e1652d22f4bf1", + "loads": [ + 1, + 2, + 0, + 1, + 0, + 2, + 0, + 1, + 5, + 1, + 4, + 6, + 0, + 3, + 1, + 0, + 2, + 1, + 1, + 2, + 6, + 1, + 1, + 4, + 5, + 0, + 1, + 0, + 2, + 0, + 1, + 6, + 4, + 2, + 1, + 2, + 11, + 0, + 3, + 0, + 4, + 0, + 12, + 0, + 2, + 4, + 12, + 1, + 0, + 1, + 0, + 0, + 5, + 3, + 0, + 2, + 1, + 1, + 2, + 1, + 0, + 0, + 4, + 0 + ], + "weighted_loads": [ + 0.054309241473674774, + 0.07776173204183578, + 0.0, + 0.0437755286693573, + 0.0, + 0.11044750735163689, + 0.0, + 0.06341655552387238, + 0.27383822202682495, + 0.035097576677799225, + 0.2581455335021019, + 0.3175975400954485, + 0.0, + 0.13379870355129242, + 0.031385596841573715, + 0.0, + 0.10642420873045921, + 0.033111754804849625, + 0.03865078464150429, + 0.07985120639204979, + 0.5440891347825527, + 0.030866120010614395, + 0.04178465157747269, + 0.2461933083832264, + 0.26680704206228256, + 0.0, + 0.0344909243285656, + 0.0, + 0.08365263044834137, + 0.0, + 0.030758874490857124, + 0.29914239421486855, + 0.12437674216926098, + 0.06888110563158989, + 0.06387168169021606, + 0.14386434108018875, + 0.7621255274862051, + 0.0, + 0.16945365816354752, + 0.0, + 0.16305707767605782, + 0.0, + 0.5328081101179123, + 0.0, + 0.12126518040895462, + 0.27653149515390396, + 0.9921536073088646, + 0.028538761660456657, + 0.0, + 0.08684699982404709, + 0.0, + 0.0, + 0.5546244457364082, + 0.14388792216777802, + 0.0, + 0.06477662734687328, + 0.03222280740737915, + 0.05309319868683815, + 0.059976620599627495, + 0.03273007273674011, + 0.0, + 0.0, + 0.14736570790410042, + 0.0 + ], + "unique_experts": 45, + "load_cv": 1.2627006527512001, + "normalized_load_entropy": 0.8372712781042122, + "max_load_share": 0.08695652173913043 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "a0fe48525272fb06958ff02c4dc91c70261e7f5ab75fc71e84f0bbbc58849869", + "route_weight_sha256": "f553747cb17503a3c712f46a4e32e499899a592b54c4ce443d619b99eb721840", + "loads": [ + 6, + 7, + 6, + 10, + 3, + 4, + 11, + 9, + 6, + 4, + 6, + 8, + 1, + 9, + 2, + 3, + 8, + 2, + 3, + 3, + 7, + 1, + 3, + 21, + 7, + 0, + 2, + 0, + 2, + 1, + 1, + 6, + 6, + 12, + 1, + 2, + 17, + 1, + 11, + 1, + 13, + 0, + 14, + 1, + 4, + 10, + 31, + 5, + 7, + 4, + 0, + 11, + 11, + 4, + 13, + 3, + 1, + 17, + 4, + 1, + 2, + 1, + 12, + 2 + ], + "weighted_loads": [ + 0.36724393302574754, + 0.397018663585186, + 0.31787339970469475, + 0.5933358399197459, + 0.10557765513658524, + 0.15429214341565967, + 0.5897102169692516, + 0.37936962582170963, + 0.3095361888408661, + 0.15005401149392128, + 0.355507455766201, + 0.3912933859974146, + 0.010233968496322632, + 0.3685600012540817, + 0.1285139136016369, + 0.1202937513589859, + 0.2635369561612606, + 0.0912768505513668, + 0.12825946509838104, + 0.11170193552970886, + 0.5917724184691906, + 0.030866120010614395, + 0.10989744774997234, + 2.370647933334112, + 0.34722697734832764, + 0.0, + 0.07411548867821693, + 0.0, + 0.08365263044834137, + 0.04619290307164192, + 0.030758874490857124, + 0.29914239421486855, + 0.23251662589609623, + 1.040278349071741, + 0.06387168169021606, + 0.14386434108018875, + 1.1897934135049582, + 0.047892242670059204, + 0.6266443282365799, + 0.023720426484942436, + 0.5159364715218544, + 0.0, + 0.5856145825237036, + 0.02825879119336605, + 0.2229221910238266, + 1.3484185729175806, + 2.9076213501393795, + 0.2886260151863098, + 0.32639829255640507, + 0.23862750455737114, + 0.0, + 0.7224600613117218, + 1.1991687044501305, + 0.17558390647172928, + 1.1923696771264076, + 0.0964453425258398, + 0.03222280740737915, + 1.4922829885035753, + 0.17393642850220203, + 0.03273007273674011, + 0.07378042675554752, + 0.12675859034061432, + 0.44940162636339664, + 0.06572353467345238 + ], + "unique_experts": 60, + "load_cv": 0.9542485408832322, + "normalized_load_entropy": 0.9022412561204604, + "max_load_share": 0.08072916666666667 + } + }, + "s0_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "dccf99c75527765bd4022d05e9d6cb3f4170e11e56443ef6e82d7fc7a561c1a5", + "route_weight_sha256": "fc46986fd9f8190bf356247f5e6695df229f4b9e267320fa2031fd1c7c77f2bc", + "loads": [ + 1, + 2, + 0, + 2, + 0, + 2, + 0, + 2, + 6, + 1, + 5, + 7, + 0, + 2, + 1, + 0, + 2, + 1, + 1, + 1, + 5, + 1, + 2, + 4, + 5, + 0, + 1, + 0, + 2, + 0, + 1, + 6, + 4, + 2, + 1, + 2, + 9, + 0, + 3, + 0, + 4, + 0, + 12, + 0, + 2, + 4, + 12, + 0, + 0, + 1, + 0, + 0, + 5, + 4, + 1, + 3, + 1, + 1, + 2, + 0, + 0, + 0, + 2, + 0 + ], + "weighted_loads": [ + 0.05404321849346161, + 0.06607974879443645, + 0.0, + 0.07536002062261105, + 0.0, + 0.11647982522845268, + 0.0, + 0.09683621115982533, + 0.3033489380031824, + 0.037156056612730026, + 0.3079635053873062, + 0.38972462341189384, + 0.0, + 0.09837912023067474, + 0.03284582495689392, + 0.0, + 0.07583702728152275, + 0.03179493173956871, + 0.04025917872786522, + 0.036115117371082306, + 0.517795991152525, + 0.033385492861270905, + 0.08100217953324318, + 0.2709517851471901, + 0.28296414390206337, + 0.0, + 0.031088344752788544, + 0.0, + 0.08335461467504501, + 0.0, + 0.029154982417821884, + 0.28720424324274063, + 0.12948784232139587, + 0.06281673721969128, + 0.05665139853954315, + 0.1540076658129692, + 0.7000924162566662, + 0.0, + 0.1720905378460884, + 0.0, + 0.16076915711164474, + 0.0, + 0.609708271920681, + 0.0, + 0.12180567532777786, + 0.29283324629068375, + 0.9792553745210171, + 0.0, + 0.0, + 0.08982711285352707, + 0.0, + 0.0, + 0.5656885877251625, + 0.18964512087404728, + 0.034257084131240845, + 0.10368947871029377, + 0.03201005607843399, + 0.05965211242437363, + 0.06054755672812462, + 0.0, + 0.0, + 0.0, + 0.07816177234053612, + 0.0 + ], + "unique_experts": 44, + "load_cv": 1.2385158235059268, + "normalized_load_entropy": 0.837908911400927, + "max_load_share": 0.08695652173913043 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "58e3e0c2a3691becb3b58f2cf3bbd62f76558e3a735ef219cc8e3b99f3dd77aa", + "route_weight_sha256": "4c090d349a8eecb1def2c14b51563383df583ffa811cfc4c77ca312e65d09a91", + "loads": [ + 5, + 5, + 1, + 8, + 5, + 4, + 6, + 8, + 6, + 12, + 5, + 9, + 1, + 6, + 2, + 0, + 7, + 1, + 1, + 1, + 5, + 1, + 4, + 14, + 9, + 0, + 1, + 0, + 2, + 0, + 1, + 6, + 7, + 6, + 1, + 3, + 9, + 0, + 8, + 0, + 11, + 0, + 15, + 0, + 2, + 9, + 25, + 2, + 1, + 1, + 0, + 3, + 5, + 5, + 12, + 4, + 1, + 12, + 3, + 0, + 1, + 0, + 5, + 1 + ], + "weighted_loads": [ + 0.2434134096838534, + 0.23567690886557102, + 0.04328685998916626, + 0.2869480876252055, + 0.2105902787297964, + 0.16902871755883098, + 0.3198392279446125, + 0.3890112917870283, + 0.3033489380031824, + 0.421630647033453, + 0.3079635053873062, + 0.48455221205949783, + 0.010243774391710758, + 0.28021641448140144, + 0.10908008366823196, + 0.0, + 0.21607194654643536, + 0.03179493173956871, + 0.04025917872786522, + 0.036115117371082306, + 0.517795991152525, + 0.033385492861270905, + 0.1716904193162918, + 1.6870432160794735, + 0.4115576073527336, + 0.0, + 0.031088344752788544, + 0.0, + 0.08335461467504501, + 0.0, + 0.029154982417821884, + 0.28720424324274063, + 0.255586851388216, + 0.4830793682485819, + 0.05665139853954315, + 0.1856025531888008, + 0.7000924162566662, + 0.0, + 0.518443301320076, + 0.0, + 0.48607586324214935, + 0.0, + 0.7054635733366013, + 0.0, + 0.12180567532777786, + 1.321443185210228, + 2.0287062041461468, + 0.0588053073734045, + 0.03934338316321373, + 0.08982711285352707, + 0.0, + 0.14504676684737206, + 0.5656885877251625, + 0.23390781693160534, + 1.0007871575653553, + 0.15830017067492008, + 0.03201005607843399, + 1.0124409645795822, + 0.11220001801848412, + 0.0, + 0.036238137632608414, + 0.0, + 0.18398570269346237, + 0.05436917766928673 + ], + "unique_experts": 53, + "load_cv": 1.0400914014916143, + "normalized_load_entropy": 0.8771483447411821, + "max_load_share": 0.08680555555555555 + } + }, + "s1_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "33a68f563439eddbfb39c46e10dca49ffbd81e3a2b858d9cdbea66ee164d85fe", + "route_weight_sha256": "978e9a96d4b6c467e37efebb6adc04f47d5cedcec6051c6adcddfc2e6c38bcc0", + "loads": [ + 1, + 2, + 0, + 1, + 0, + 2, + 0, + 1, + 6, + 1, + 4, + 6, + 1, + 4, + 1, + 0, + 2, + 1, + 1, + 2, + 5, + 1, + 2, + 5, + 5, + 0, + 1, + 0, + 2, + 0, + 1, + 6, + 4, + 2, + 1, + 2, + 10, + 0, + 3, + 0, + 5, + 0, + 11, + 0, + 2, + 4, + 12, + 0, + 0, + 1, + 0, + 0, + 5, + 3, + 1, + 0, + 1, + 1, + 2, + 1, + 0, + 0, + 3, + 0 + ], + "weighted_loads": [ + 0.05465729162096977, + 0.07875656522810459, + 0.0, + 0.04059412330389023, + 0.0, + 0.10815202817320824, + 0.0, + 0.06191762164235115, + 0.29094398580491543, + 0.03425128385424614, + 0.2663324922323227, + 0.34069146774709225, + 0.02832527458667755, + 0.1652620080858469, + 0.03187130391597748, + 0.0, + 0.11256721429526806, + 0.03267553448677063, + 0.03833891451358795, + 0.07715973258018494, + 0.5172387436032295, + 0.030797045677900314, + 0.07202083989977837, + 0.2615976296365261, + 0.27305488660931587, + 0.0, + 0.034416794776916504, + 0.0, + 0.08732360228896141, + 0.0, + 0.03253753483295441, + 0.2942163832485676, + 0.12070597521960735, + 0.06919416785240173, + 0.06892068684101105, + 0.1551232822239399, + 0.6910427566617727, + 0.0, + 0.1836686097085476, + 0.0, + 0.18687613867223263, + 0.0, + 0.49739623442292213, + 0.0, + 0.1216038130223751, + 0.27916716411709785, + 0.9581951275467873, + 0.0, + 0.0, + 0.08805093914270401, + 0.0, + 0.0, + 0.5436569564044476, + 0.14017481729388237, + 0.03245624899864197, + 0.0, + 0.03429466858506203, + 0.060148559510707855, + 0.060979368165135384, + 0.033404018729925156, + 0.0, + 0.0, + 0.12733443826436996, + 0.0 + ], + "unique_experts": 45, + "load_cv": 1.2276140830505375, + "normalized_load_entropy": 0.8403884135038578, + "max_load_share": 0.08695652173913043 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "a6acd10dac032c7305ba97da44f4bc6ee0023c49c09e786b33d20fd0648a5af5", + "route_weight_sha256": "077e196afceb9ddb0424088fd77f78248e0038215262f6e030691b75819f38e3", + "loads": [ + 6, + 7, + 7, + 9, + 3, + 4, + 14, + 10, + 7, + 5, + 6, + 7, + 3, + 9, + 2, + 3, + 8, + 2, + 3, + 2, + 6, + 1, + 4, + 20, + 7, + 0, + 2, + 0, + 2, + 1, + 1, + 6, + 6, + 13, + 1, + 2, + 16, + 1, + 12, + 1, + 14, + 0, + 13, + 1, + 4, + 10, + 31, + 3, + 6, + 4, + 0, + 10, + 11, + 5, + 13, + 1, + 1, + 18, + 4, + 1, + 3, + 1, + 9, + 2 + ], + "weighted_loads": [ + 0.36035997653380036, + 0.3980134967714548, + 0.3560817018151283, + 0.5303218578919768, + 0.10557765513658524, + 0.15199666423723102, + 0.7132597118616104, + 0.3932120893150568, + 0.32664195261895657, + 0.18322309851646423, + 0.3636944144964218, + 0.3830262739211321, + 0.08105291798710823, + 0.37721684388816357, + 0.12899962067604065, + 0.1202937513589859, + 0.26238655112683773, + 0.09084063023328781, + 0.1279475949704647, + 0.07715973258018494, + 0.5649220272898674, + 0.030797045677900314, + 0.16581394709646702, + 2.30438831448555, + 0.35347482189536095, + 0.0, + 0.08190194889903069, + 0.0, + 0.08732360228896141, + 0.04619290307164192, + 0.03253753483295441, + 0.2942163832485676, + 0.21632465161383152, + 1.084791325032711, + 0.06892068684101105, + 0.1551232822239399, + 1.1187106426805258, + 0.047892242670059204, + 0.8019100818783045, + 0.023720426484942436, + 0.5320651512593031, + 0.0, + 0.5502027068287134, + 0.026284711435437202, + 0.22326082363724709, + 1.3588394559919834, + 2.7118067108094692, + 0.2225788403302431, + 0.2649549040943384, + 0.23983144387602806, + 0.0, + 0.6213372573256493, + 1.1882012151181698, + 0.2137012593448162, + 1.1016197875142097, + 0.03166871517896652, + 0.03429466858506203, + 1.5948329214006662, + 0.17738635279238224, + 0.033404018729925156, + 0.11302571929991245, + 0.12675859034061432, + 0.3603013288229704, + 0.06495647132396698 + ], + "unique_experts": 60, + "load_cv": 0.952883052169106, + "normalized_load_entropy": 0.9024485338311836, + "max_load_share": 0.08072916666666667 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "ordered_topk_exact_tokens": 8, + "set_exact_tokens": 13, + "mean_set_jaccard": 0.875776397515528, + "mean_token_weighted_tv": 0.021669663245911183, + "aggregate_load_tv": 0.07246376811594203 + }, + "system_bos": { + "tokens": 23, + "ordered_topk_exact_tokens": 8, + "set_exact_tokens": 12, + "mean_set_jaccard": 0.8633540372670809, + "mean_token_weighted_tv": 0.025068750321541145, + "aggregate_load_tv": 0.07246376811594203 + }, + "system_x": { + "tokens": 23, + "ordered_topk_exact_tokens": 7, + "set_exact_tokens": 12, + "mean_set_jaccard": 0.8540372670807455, + "mean_token_weighted_tv": 0.02796885018925304, + "aggregate_load_tv": 0.07971014492753623 + }, + "system_period": { + "tokens": 23, + "ordered_topk_exact_tokens": 4, + "set_exact_tokens": 9, + "mean_set_jaccard": 0.8260869565217391, + "mean_token_weighted_tv": 0.03334452641075072, + "aggregate_load_tv": 0.06521739130434784 + }, + "bos_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.9130434782608695, + "mean_token_weighted_tv": 0.021158148251149967, + "aggregate_load_tv": 0.050724637681159424 + }, + "bos_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 7, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.9130434782608695, + "mean_token_weighted_tv": 0.022267622589741066, + "aggregate_load_tv": 0.050724637681159424 + }, + "x_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.888198757763975, + "mean_token_weighted_tv": 0.022443939648244694, + "aggregate_load_tv": 0.05797101449275363 + }, + "x_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 6, + "set_exact_tokens": 11, + "mean_set_jaccard": 0.8509316770186336, + "mean_token_weighted_tv": 0.03108499089822821, + "aggregate_load_tv": 0.07246376811594203 + }, + "period_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.9254658385093169, + "mean_token_weighted_tv": 0.018389447511214276, + "aggregate_load_tv": 0.04347826086956523 + }, + "period_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 5, + "set_exact_tokens": 8, + "mean_set_jaccard": 0.813664596273292, + "mean_token_weighted_tv": 0.0343761684211052, + "aggregate_load_tv": 0.08695652173913043 + } + } + }, + "layer_24": { + "layer": 24, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "44f1184b212f004f812b80b4d09cf1fe04d2cfe49dccf6f363011a89b4bfd8ac", + "route_weight_sha256": "c98a95bcf01469560845a52aa11f563ac78cccb6fef3de30c0d994522078c06c", + "loads": [ + 1, + 14, + 2, + 1, + 0, + 0, + 0, + 13, + 2, + 0, + 1, + 0, + 0, + 0, + 1, + 0, + 0, + 3, + 2, + 4, + 10, + 0, + 0, + 1, + 22, + 0, + 0, + 0, + 3, + 0, + 0, + 1, + 0, + 2, + 1, + 4, + 1, + 2, + 3, + 0, + 1, + 0, + 3, + 4, + 4, + 2, + 0, + 2, + 0, + 0, + 6, + 1, + 3, + 2, + 0, + 5, + 0, + 0, + 0, + 1, + 0, + 1, + 2, + 7 + ], + "weighted_loads": [ + 0.03843318670988083, + 0.9281276129186153, + 0.07915915735065937, + 0.06111060082912445, + 0.0, + 0.0, + 0.0, + 0.9582646228373051, + 0.0674026869237423, + 0.0, + 0.1575460582971573, + 0.0, + 0.0, + 0.0, + 0.041410110890865326, + 0.0, + 0.0, + 0.13843075186014175, + 0.08327535167336464, + 0.1535961590707302, + 0.6305688321590424, + 0.0, + 0.0, + 0.08312337100505829, + 2.4403660632669926, + 0.0, + 0.0, + 0.0, + 0.15730145946145058, + 0.0, + 0.0, + 0.060983624309301376, + 0.0, + 0.5441206693649292, + 0.029791314154863358, + 0.19103560969233513, + 0.029494579881429672, + 0.11116863787174225, + 0.16294971480965614, + 0.0, + 0.05898108333349228, + 0.0, + 0.11883329227566719, + 0.228076059371233, + 0.18526984937489033, + 0.08396071195602417, + 0.0, + 0.08074345625936985, + 0.0, + 0.0, + 0.3246065601706505, + 0.03187016770243645, + 0.08610059879720211, + 0.07405810058116913, + 0.0, + 0.23738913610577583, + 0.0, + 0.0, + 0.0, + 0.03241708129644394, + 0.0, + 0.031117431819438934, + 0.10207520984113216, + 0.3915829584002495 + ], + "unique_experts": 37, + "load_cv": 1.7568541322272506, + "normalized_load_entropy": 0.7580864441882466, + "max_load_share": 0.15942028985507245 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "79b89e45f7aebd543698155180a296e4b85f270354279c7beb0a58ae7974a7da", + "route_weight_sha256": "774ab7e0524fd9036361ad67db7397c12532dbd5587e5dd0c3b11819da9fb3db", + "loads": [ + 1, + 14, + 5, + 1, + 0, + 3, + 0, + 14, + 10, + 0, + 12, + 0, + 1, + 0, + 2, + 0, + 0, + 3, + 2, + 5, + 10, + 0, + 5, + 1, + 31, + 0, + 2, + 0, + 11, + 6, + 0, + 3, + 2, + 6, + 8, + 5, + 3, + 4, + 4, + 0, + 1, + 2, + 7, + 4, + 4, + 4, + 0, + 7, + 0, + 0, + 14, + 7, + 8, + 6, + 0, + 5, + 0, + 0, + 8, + 1, + 1, + 19, + 6, + 10 + ], + "weighted_loads": [ + 0.03843318670988083, + 0.9281276129186153, + 0.18197543546557426, + 0.06111060082912445, + 0.0, + 0.08531731006223708, + 0.0, + 1.0131394192576408, + 0.4273542435839772, + 0.0, + 0.5766967032104731, + 0.0, + 0.0027434658259153366, + 0.0, + 0.0651039369404316, + 0.0, + 0.0, + 0.13843075186014175, + 0.08327535167336464, + 0.18375600688159466, + 0.6305688321590424, + 0.0, + 0.2796929832547903, + 0.08312337100505829, + 2.7967076539061964, + 0.0, + 0.08141763508319855, + 0.0, + 0.4768129736185074, + 0.24640418589115143, + 0.0, + 0.12791049107909203, + 0.06427413783967495, + 0.7252926155924797, + 0.27611460955813527, + 0.23091328144073486, + 0.18856560066342354, + 1.0113431476056576, + 0.2048167809844017, + 0.0, + 0.05898108333349228, + 0.10301523655653, + 0.30913808359764516, + 0.228076059371233, + 0.18526984937489033, + 0.17416705936193466, + 0.0, + 0.36549846234265715, + 0.0, + 0.0, + 0.7393786478787661, + 0.4675605557858944, + 0.24475130811333656, + 0.28337420150637627, + 0.0, + 0.23738913610577583, + 0.0, + 0.0, + 0.2510677565005608, + 0.03241708129644394, + 0.037585824728012085, + 1.4996725800447166, + 0.1736284384969622, + 2.37354189902544 + ], + "unique_experts": 46, + "load_cv": 1.2203268131382665, + "normalized_load_entropy": 0.8437189461168432, + "max_load_share": 0.1076388888888889 + } + }, + "s1_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "4343999cc76497779353e78e08e632cad9b0e28350c1e79f7ec5efcf485a99ef", + "route_weight_sha256": "ef98613061cb5641105cd6a9c0643ee1deba64821290d161513b16c4cdee0b7a", + "loads": [ + 1, + 13, + 2, + 1, + 0, + 0, + 0, + 13, + 3, + 0, + 1, + 0, + 0, + 0, + 1, + 0, + 0, + 3, + 2, + 4, + 11, + 0, + 0, + 1, + 22, + 1, + 0, + 0, + 2, + 0, + 0, + 1, + 0, + 2, + 1, + 4, + 1, + 2, + 3, + 0, + 1, + 0, + 3, + 4, + 4, + 2, + 0, + 2, + 0, + 0, + 6, + 1, + 2, + 2, + 0, + 5, + 0, + 0, + 0, + 1, + 0, + 1, + 2, + 7 + ], + "weighted_loads": [ + 0.03983282297849655, + 0.9139687791466713, + 0.08640355616807938, + 0.06403592228889465, + 0.0, + 0.0, + 0.0, + 0.9410075172781944, + 0.09409295953810215, + 0.0, + 0.1522148847579956, + 0.0, + 0.0, + 0.0, + 0.042277541011571884, + 0.0, + 0.0, + 0.14219806343317032, + 0.08216484263539314, + 0.1392952147871256, + 0.6546076405793428, + 0.0, + 0.0, + 0.09859812259674072, + 2.447211839258671, + 0.02982957847416401, + 0.0, + 0.0, + 0.11503076925873756, + 0.0, + 0.0, + 0.05939020216464996, + 0.0, + 0.5402860045433044, + 0.029097264632582664, + 0.18315613642334938, + 0.029768766835331917, + 0.10880719870328903, + 0.16624118387699127, + 0.0, + 0.058910928666591644, + 0.0, + 0.11531348526477814, + 0.22893904522061348, + 0.18423436768352985, + 0.08225683867931366, + 0.0, + 0.0792975015938282, + 0.0, + 0.0, + 0.29780158400535583, + 0.03130479156970978, + 0.06061808951199055, + 0.07473492249846458, + 0.0, + 0.2423696219921112, + 0.0, + 0.0, + 0.0, + 0.030855612829327583, + 0.0, + 0.03253520280122757, + 0.09976859204471111, + 0.375529445707798 + ], + "unique_experts": 38, + "load_cv": 1.7472635910791408, + "normalized_load_entropy": 0.7618517500082939, + "max_load_share": 0.15942028985507245 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "338bb8eae52b0c28fef85b346e5171eb879cfc806d3fc7ec06bc6a707ffa96c0", + "route_weight_sha256": "bd623e7e834e291b8ecd950af5c9644b6f81d3168998fae869c25bc2fcd72cd2", + "loads": [ + 1, + 13, + 3, + 2, + 2, + 8, + 0, + 14, + 12, + 3, + 9, + 2, + 3, + 0, + 3, + 0, + 1, + 3, + 3, + 6, + 16, + 0, + 8, + 2, + 33, + 1, + 2, + 0, + 22, + 5, + 0, + 5, + 0, + 8, + 7, + 6, + 9, + 5, + 4, + 0, + 2, + 7, + 8, + 6, + 6, + 3, + 0, + 10, + 0, + 0, + 13, + 15, + 11, + 8, + 2, + 7, + 0, + 1, + 14, + 1, + 2, + 22, + 13, + 12 + ], + "weighted_loads": [ + 0.03983282297849655, + 0.9139687791466713, + 0.111122390255332, + 0.1763600930571556, + 0.06097274273633957, + 0.2504288760246709, + 0.0, + 0.9776661209762096, + 0.6857847566716373, + 0.1303626075387001, + 0.479111653752625, + 0.06684808991849422, + 0.06072664284147322, + 0.0, + 0.10338226705789566, + 0.0, + 0.028606098145246506, + 0.14219806343317032, + 0.11478181183338165, + 0.21134424395859241, + 0.8708896953612566, + 0.0, + 0.4892345368862152, + 0.1240045614540577, + 2.867581361439079, + 0.02982957847416401, + 0.07653189823031425, + 0.0, + 1.09593746624887, + 0.24180275946855545, + 0.0, + 0.22606872208416462, + 0.0, + 0.8510064333677292, + 0.2543487837538123, + 0.2828008458018303, + 0.66004435159266, + 1.0475154966115952, + 0.22089238837361336, + 0.0, + 0.1721402257680893, + 0.420223917812109, + 0.32213686453178525, + 0.4367745444178581, + 0.2750845793634653, + 0.13956904783844948, + 0.0, + 0.5818019498838112, + 0.0, + 0.0, + 0.6449081841856241, + 1.0029268991202116, + 0.34601482562720776, + 0.4678165502846241, + 0.17510559037327766, + 0.33914245665073395, + 0.0, + 0.04327869042754173, + 0.5703899828949943, + 0.030855612829327583, + 0.06918578781187534, + 2.1457753274589777, + 0.5869811041047797, + 2.452407792210579 + ], + "unique_experts": 52, + "load_cv": 1.0635207515083516, + "normalized_load_entropy": 0.8736726090463044, + "max_load_share": 0.0859375 + } + }, + "s0_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "b976a3fc7cfd2b39fcb31425808dcb10ff3a6785111f3cc0681256dc3e39d3b6", + "route_weight_sha256": "e6b9340f93371bba16d1600e343728e22cd50cb432c9b65786f46be8d297e3db", + "loads": [ + 1, + 13, + 2, + 1, + 0, + 0, + 0, + 13, + 2, + 0, + 1, + 0, + 1, + 0, + 1, + 0, + 0, + 3, + 2, + 4, + 9, + 0, + 0, + 1, + 22, + 0, + 0, + 0, + 3, + 0, + 0, + 1, + 0, + 2, + 1, + 4, + 1, + 2, + 3, + 0, + 1, + 0, + 3, + 4, + 4, + 2, + 0, + 2, + 0, + 0, + 6, + 1, + 3, + 2, + 0, + 5, + 0, + 0, + 0, + 1, + 0, + 1, + 3, + 7 + ], + "weighted_loads": [ + 0.04163959249854088, + 0.9285977315157652, + 0.07936528511345387, + 0.056366924196481705, + 0.0, + 0.0, + 0.0, + 0.9539648815989494, + 0.06790072098374367, + 0.0, + 0.17125409841537476, + 0.0, + 0.037356577813625336, + 0.0, + 0.04028506949543953, + 0.0, + 0.0, + 0.13442455977201462, + 0.08753825351595879, + 0.15881282463669777, + 0.5905658006668091, + 0.0, + 0.0, + 0.09970246255397797, + 2.443409465253353, + 0.0, + 0.0, + 0.0, + 0.1603567861020565, + 0.0, + 0.0, + 0.062153410166502, + 0.0, + 0.5466060042381287, + 0.027815410867333412, + 0.17862078174948692, + 0.02953995391726494, + 0.1159336157143116, + 0.1667911261320114, + 0.0, + 0.060235437005758286, + 0.0, + 0.12709832936525345, + 0.2290135622024536, + 0.18821675516664982, + 0.08421913906931877, + 0.0, + 0.08045400120317936, + 0.0, + 0.0, + 0.3283816669136286, + 0.02914484217762947, + 0.08834781125187874, + 0.07641655020415783, + 0.0, + 0.25940530374646187, + 0.0, + 0.0, + 0.0, + 0.03542058542370796, + 0.0, + 0.030697230249643326, + 0.1429554596543312, + 0.39720867201685905 + ], + "unique_experts": 38, + "load_cv": 1.7181708009017043, + "normalized_load_entropy": 0.766700358447548, + "max_load_share": 0.15942028985507245 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "8e485d3567bff15cdb12ebf6686ba4ff5c9eb4aa2e870fcf471a85aca1e03060", + "route_weight_sha256": "08dbf263a5c209ae73926893a0f1113d8db01c939277bf2e4345d2e9a2726710", + "loads": [ + 1, + 13, + 5, + 1, + 0, + 3, + 1, + 14, + 9, + 0, + 9, + 0, + 2, + 1, + 2, + 0, + 0, + 3, + 2, + 5, + 9, + 0, + 6, + 1, + 32, + 1, + 2, + 1, + 11, + 6, + 1, + 4, + 2, + 6, + 7, + 4, + 3, + 3, + 3, + 0, + 1, + 1, + 8, + 4, + 4, + 4, + 1, + 6, + 0, + 0, + 15, + 7, + 8, + 7, + 0, + 5, + 0, + 1, + 7, + 1, + 1, + 19, + 6, + 9 + ], + "weighted_loads": [ + 0.04163959249854088, + 0.9285977315157652, + 0.18175220489501953, + 0.056366924196481705, + 0.0, + 0.08531731006223708, + 0.1107940673828125, + 1.0088396780192852, + 0.4233398772776127, + 0.0, + 0.49272834695875645, + 0.0, + 0.04010004363954067, + 0.03642186522483826, + 0.0639788955450058, + 0.0, + 0.0, + 0.13442455977201462, + 0.08753825351595879, + 0.1991942785680294, + 0.5905658006668091, + 0.0, + 0.43058243952691555, + 0.09970246255397797, + 2.8193362313322723, + 0.029479237273335457, + 0.4698812887072563, + 0.04079527035355568, + 0.4798683002591133, + 0.2600683867931366, + 0.04816802963614464, + 0.15654298849403858, + 0.09067048691213131, + 0.7277779504656792, + 0.21941754827275872, + 0.17862078174948692, + 0.22361832484602928, + 0.9802290983498096, + 0.1667911261320114, + 0.0, + 0.060235437005758286, + 0.05785336717963219, + 0.38666676520369947, + 0.2290135622024536, + 0.18821675516664982, + 0.18885617703199387, + 0.04451838135719299, + 0.3884558983845636, + 0.0, + 0.0, + 0.754307996481657, + 0.4355631321668625, + 0.24601211957633495, + 0.3155489545315504, + 0.0, + 0.25940530374646187, + 0.0, + 0.03643526881933212, + 0.2529424633830786, + 0.03542058542370796, + 0.037585824728012085, + 1.475640385877341, + 0.23515032359864563, + 1.409801658242941 + ], + "unique_experts": 53, + "load_cv": 1.1986360561328564, + "normalized_load_entropy": 0.8606982140340744, + "max_load_share": 0.1111111111111111 + } + }, + "s1_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "833fd65b7aad7a39267ec32a2a67f858ad78ea1344d97866f3195457e47df535", + "route_weight_sha256": "819dfe2f853df9d848e3ea0518aa730e79bfd4f060f16d87648279f1233d3b2e", + "loads": [ + 1, + 13, + 2, + 1, + 0, + 0, + 0, + 12, + 2, + 0, + 2, + 0, + 1, + 0, + 1, + 0, + 0, + 3, + 3, + 3, + 9, + 0, + 0, + 1, + 22, + 0, + 0, + 0, + 3, + 0, + 0, + 1, + 0, + 2, + 1, + 4, + 1, + 2, + 4, + 0, + 1, + 0, + 3, + 4, + 4, + 2, + 0, + 1, + 0, + 0, + 6, + 2, + 2, + 2, + 0, + 6, + 0, + 0, + 0, + 1, + 0, + 1, + 3, + 6 + ], + "weighted_loads": [ + 0.038758330047130585, + 0.9191147033125162, + 0.08453840017318726, + 0.06375182420015335, + 0.0, + 0.0, + 0.0, + 0.8775070980191231, + 0.07265380769968033, + 0.0, + 0.2036943957209587, + 0.0, + 0.04409175366163254, + 0.0, + 0.04282540827989578, + 0.0, + 0.0, + 0.1395326890051365, + 0.11527409963309765, + 0.12197758257389069, + 0.6007293537259102, + 0.0, + 0.0, + 0.10110055655241013, + 2.395229883491993, + 0.0, + 0.0, + 0.0, + 0.1378008984029293, + 0.0, + 0.0, + 0.06036031246185303, + 0.0, + 0.5568337142467499, + 0.025673924013972282, + 0.191883135586977, + 0.029194103553891182, + 0.11195813119411469, + 0.22206729277968407, + 0.0, + 0.05960112065076828, + 0.0, + 0.12200383096933365, + 0.2232147976756096, + 0.1893315427005291, + 0.08434806764125824, + 0.0, + 0.05256688594818115, + 0.0, + 0.0, + 0.3100995197892189, + 0.0665009468793869, + 0.06317519024014473, + 0.07445117644965649, + 0.0, + 0.31019754335284233, + 0.0, + 0.0, + 0.0, + 0.032133799046278, + 0.0, + 0.035124748945236206, + 0.13421503081917763, + 0.36485497280955315 + ], + "unique_experts": 38, + "load_cv": 1.6945369799917458, + "normalized_load_entropy": 0.7707193696158652, + "max_load_share": 0.15942028985507245 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "6c94d1a596789d2da780f1c744271874341d510fd9392121dd2a46fe8d294590", + "route_weight_sha256": "2d76eca2cfa62c42e39ae20e85b2393a77f0f1ca89b43b7252ea0ee120b57ba5", + "loads": [ + 1, + 13, + 4, + 2, + 2, + 7, + 0, + 13, + 11, + 3, + 9, + 2, + 4, + 1, + 3, + 0, + 1, + 3, + 4, + 6, + 14, + 0, + 9, + 2, + 33, + 0, + 2, + 0, + 23, + 5, + 0, + 5, + 0, + 8, + 8, + 6, + 9, + 4, + 5, + 0, + 2, + 7, + 9, + 7, + 5, + 4, + 0, + 8, + 0, + 0, + 15, + 16, + 10, + 9, + 2, + 8, + 0, + 0, + 13, + 1, + 2, + 23, + 12, + 9 + ], + "weighted_loads": [ + 0.038758330047130585, + 0.9191147033125162, + 0.1533674243837595, + 0.1760759949684143, + 0.06097274273633957, + 0.21200900350231677, + 0.0, + 0.9141657017171383, + 0.6961224228143692, + 0.1303626075387001, + 0.5258198920637369, + 0.06684808991849422, + 0.10481839650310576, + 0.04014336317777634, + 0.10393013432621956, + 0.0, + 0.028606098145246506, + 0.1395326890051365, + 0.14789106883108616, + 0.22732244804501534, + 0.8170114085078239, + 0.0, + 0.6214818395674229, + 0.1265069954097271, + 2.801530750002712, + 0.0, + 0.07067392766475677, + 0.0, + 1.1187075953930616, + 0.24967903643846512, + 0.0, + 0.23679453507065773, + 0.0, + 0.8675541430711746, + 0.2688933266326785, + 0.2915278449654579, + 0.641625689342618, + 1.0188635997474194, + 0.26623542979359627, + 0.0, + 0.17283041775226593, + 0.420223917812109, + 0.4843780812807381, + 0.5083681158721447, + 0.228425070643425, + 0.187019981443882, + 0.0, + 0.6353713393909857, + 0.0, + 0.0, + 0.821973130106926, + 0.9871238078922033, + 0.30151112377643585, + 0.4812198970466852, + 0.17510559037327766, + 0.4069703780114651, + 0.0, + 0.0, + 0.5743098929524422, + 0.032133799046278, + 0.06918578781187534, + 2.1243867110460997, + 0.6076097873738036, + 1.4210650771856308 + ], + "unique_experts": 51, + "load_cv": 1.0614782669047498, + "normalized_load_entropy": 0.8740049960470972, + "max_load_share": 0.0859375 + } + }, + "s0_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "a6c37d203f3fb6694e080bbd2f0c94169fa31b94f6a1f5ad60e2e816ca0d3ca4", + "route_weight_sha256": "19afe160775e72848d23a7d4731cb4e91bda1e3012a1b3ec8171fe6a23505687", + "loads": [ + 1, + 13, + 2, + 1, + 0, + 0, + 0, + 13, + 1, + 0, + 2, + 0, + 1, + 0, + 1, + 0, + 0, + 3, + 2, + 3, + 11, + 0, + 0, + 1, + 22, + 1, + 0, + 0, + 2, + 0, + 0, + 1, + 0, + 2, + 3, + 4, + 1, + 2, + 3, + 0, + 1, + 0, + 3, + 4, + 2, + 2, + 0, + 2, + 0, + 0, + 6, + 0, + 5, + 2, + 0, + 4, + 0, + 0, + 0, + 1, + 0, + 1, + 2, + 7 + ], + "weighted_loads": [ + 0.036219045519828796, + 0.8499670550227165, + 0.09587778896093369, + 0.06473833322525024, + 0.0, + 0.0, + 0.0, + 0.9574282243847847, + 0.03900189325213432, + 0.0, + 0.1868825126439333, + 0.0, + 0.03688724711537361, + 0.0, + 0.03968539461493492, + 0.0, + 0.0, + 0.13398783281445503, + 0.08465493842959404, + 0.10904118046164513, + 0.6459082737565041, + 0.0, + 0.0, + 0.08807841688394547, + 2.379933726042509, + 0.029447665438055992, + 0.0, + 0.0, + 0.11067542806267738, + 0.0, + 0.0, + 0.05872691422700882, + 0.0, + 0.5358006656169891, + 0.10730252787470818, + 0.19927584379911423, + 0.029249751940369606, + 0.11617085337638855, + 0.16934099420905113, + 0.0, + 0.05995376408100128, + 0.0, + 0.11316912807524204, + 0.22229326516389847, + 0.11231570318341255, + 0.07207767106592655, + 0.0, + 0.08124983683228493, + 0.0, + 0.0, + 0.30219466611742973, + 0.0, + 0.14174246601760387, + 0.0787421315908432, + 0.0, + 0.2116537094116211, + 0.0, + 0.0, + 0.0, + 0.034172091633081436, + 0.0, + 0.03164017200469971, + 0.10104521177709103, + 0.3910493142902851 + ], + "unique_experts": 38, + "load_cv": 1.7434126025199828, + "normalized_load_entropy": 0.763355509063652, + "max_load_share": 0.15942028985507245 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "2834fe8a0169a83dcc87ca87ef7b6b814d622c60bb49452b679d7671569b9e2f", + "route_weight_sha256": "6cc5d3227330f6faa9223022b5d9c468a747eae7108585cf17ae49a99e2aed5a", + "loads": [ + 1, + 13, + 4, + 1, + 0, + 4, + 0, + 14, + 9, + 0, + 11, + 0, + 3, + 0, + 2, + 0, + 0, + 3, + 2, + 4, + 11, + 0, + 6, + 1, + 31, + 1, + 0, + 0, + 11, + 6, + 0, + 2, + 2, + 6, + 11, + 5, + 4, + 5, + 4, + 0, + 2, + 1, + 6, + 4, + 2, + 4, + 0, + 7, + 0, + 0, + 13, + 6, + 10, + 9, + 0, + 4, + 0, + 0, + 8, + 1, + 1, + 19, + 5, + 9 + ], + "weighted_loads": [ + 0.036219045519828796, + 0.8499670550227165, + 0.16073299385607243, + 0.06473833322525024, + 0.0, + 0.11669664096552879, + 0.0, + 1.0123030208051205, + 0.4762088619172573, + 0.0, + 0.5625191442668438, + 0.0, + 0.0730916690081358, + 0.0, + 0.06337922066450119, + 0.0, + 0.0, + 0.13398783281445503, + 0.08465493842959404, + 0.13817117176949978, + 0.6459082737565041, + 0.0, + 0.30966807156801224, + 0.08807841688394547, + 2.728824836667627, + 0.029447665438055992, + 0.0, + 0.0, + 0.4676493965089321, + 0.24235588312149048, + 0.0, + 0.09201468899846077, + 0.06872920133173466, + 0.7169726118445396, + 0.3852740456350148, + 0.23466025665402412, + 0.22923358343541622, + 1.0542513020336628, + 0.2068527601659298, + 0.0, + 0.09583552181720734, + 0.05785336717963219, + 0.22392176813445985, + 0.22229326516389847, + 0.11231570318341255, + 0.15870789624750614, + 0.0, + 0.44527174055110663, + 0.0, + 0.0, + 0.6310932878404856, + 0.4255859274417162, + 0.2976848818361759, + 0.4004882872104645, + 0.0, + 0.2116537094116211, + 0.0, + 0.0, + 0.27993436343967915, + 0.034172091633081436, + 0.037585824728012085, + 1.4626212785951793, + 0.20152116322424263, + 1.403642300516367 + ], + "unique_experts": 46, + "load_cv": 1.2209589431019952, + "normalized_load_entropy": 0.84292360378817, + "max_load_share": 0.1076388888888889 + } + }, + "s1_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "68976983d5ef1649e3d604db06b257bb89a09ed1a92e5192a296678faaad7957", + "route_weight_sha256": "35f8b18c84df50e2db6e0372e5be2b0fbbfcab8d4834540d107b616b2c3247d8", + "loads": [ + 1, + 13, + 2, + 1, + 0, + 0, + 0, + 12, + 1, + 0, + 1, + 0, + 1, + 0, + 1, + 0, + 0, + 4, + 1, + 3, + 12, + 0, + 0, + 1, + 22, + 1, + 0, + 0, + 3, + 0, + 0, + 1, + 0, + 2, + 2, + 4, + 1, + 2, + 3, + 0, + 1, + 0, + 2, + 4, + 4, + 2, + 0, + 2, + 0, + 0, + 5, + 0, + 2, + 1, + 0, + 6, + 0, + 0, + 0, + 1, + 1, + 2, + 2, + 8 + ], + "weighted_loads": [ + 0.03280039131641388, + 0.855037622153759, + 0.09786860272288322, + 0.07318229973316193, + 0.0, + 0.0, + 0.0, + 0.8524980191141367, + 0.03743932768702507, + 0.0, + 0.15596145391464233, + 0.0, + 0.03656976297497749, + 0.0, + 0.038949958980083466, + 0.0, + 0.0, + 0.16325027495622635, + 0.04630015045404434, + 0.11215511336922646, + 0.7365257684141397, + 0.0, + 0.0, + 0.0977441668510437, + 2.3317537158727646, + 0.030305908992886543, + 0.0, + 0.0, + 0.131869962438941, + 0.0, + 0.0, + 0.05555388703942299, + 0.0, + 0.5459960699081421, + 0.051195068284869194, + 0.18504028022289276, + 0.027303524315357208, + 0.10475961491465569, + 0.1839963160455227, + 0.0, + 0.0600736141204834, + 0.0, + 0.08452963083982468, + 0.2212078794836998, + 0.1695849895477295, + 0.07937341742217541, + 0.0, + 0.08277183584868908, + 0.0, + 0.0, + 0.24253191612660885, + 0.0, + 0.05403715744614601, + 0.039579760283231735, + 0.0, + 0.2962500602006912, + 0.0, + 0.0, + 0.0, + 0.028890470042824745, + 0.03340570628643036, + 0.07626582682132721, + 0.0947574581950903, + 0.4051908180117607 + ], + "unique_experts": 39, + "load_cv": 1.7530242119944293, + "normalized_load_entropy": 0.762487904694409, + "max_load_share": 0.15942028985507245 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "162387b0639f512aea2b06138d108dc1919f2236ccb6daeb7063b04a8379ca43", + "route_weight_sha256": "8cd07363dfbeac389f3a1bcb56bc0c30951e62293e22f30eda8a2b189c6ab1e8", + "loads": [ + 1, + 14, + 3, + 2, + 2, + 8, + 0, + 14, + 11, + 3, + 7, + 2, + 4, + 0, + 3, + 0, + 2, + 4, + 2, + 5, + 19, + 0, + 8, + 2, + 34, + 1, + 1, + 0, + 24, + 5, + 0, + 4, + 0, + 9, + 8, + 7, + 11, + 6, + 3, + 0, + 2, + 7, + 7, + 6, + 5, + 3, + 0, + 8, + 0, + 0, + 12, + 14, + 11, + 7, + 2, + 8, + 0, + 0, + 14, + 1, + 4, + 24, + 9, + 11 + ], + "weighted_loads": [ + 0.03280039131641388, + 0.8849002718925476, + 0.12258743681013584, + 0.18550647050142288, + 0.06097274273633957, + 0.24212951224762946, + 0.0, + 0.9260334242135286, + 0.7209213376045227, + 0.1303626075387001, + 0.43408931605517864, + 0.06684808991849422, + 0.09729640581645072, + 0.0, + 0.10005468502640724, + 0.0, + 0.06259990110993385, + 0.16325027495622635, + 0.07891711965203285, + 0.17317086830735207, + 1.0153140220791101, + 0.0, + 0.48253713361918926, + 0.12315060570836067, + 2.796863531228155, + 0.030305908992886543, + 0.028184205293655396, + 0.0, + 1.1545190438628197, + 0.22319316491484642, + 0.0, + 0.19474181160330772, + 0.0, + 0.8951791003346443, + 0.26681728567928076, + 0.3389468118548393, + 0.7754528373479843, + 1.0865411199629307, + 0.1839963160455227, + 0.0, + 0.17330291122198105, + 0.420223917812109, + 0.24477272713556886, + 0.42904337868094444, + 0.20867851749062538, + 0.13668562658131123, + 0.0, + 0.5541618418646976, + 0.0, + 0.0, + 0.5898434389382601, + 0.9349471647292376, + 0.3322119116783142, + 0.42643583193421364, + 0.17510559037327766, + 0.39302289485931396, + 0.0, + 0.0, + 0.6216146647930145, + 0.028890470042824745, + 0.1464903149753809, + 2.105027934536338, + 0.4691034102579579, + 1.4614009223878384 + ], + "unique_experts": 51, + "load_cv": 1.1016086722001905, + "normalized_load_entropy": 0.8686968935675732, + "max_load_share": 0.08854166666666667 + } + }, + "s0_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "729193bfe7ea30ababc404e4927cf7968204a7da5f0c41dabdcc07631280f1d0", + "route_weight_sha256": "b39d55011c5f977bd475b221c1dd37d0c27c2879149030e5b752bf449d96bedc", + "loads": [ + 1, + 13, + 2, + 1, + 0, + 0, + 0, + 13, + 1, + 0, + 2, + 0, + 1, + 0, + 1, + 0, + 0, + 3, + 2, + 3, + 9, + 0, + 0, + 1, + 22, + 0, + 0, + 0, + 3, + 0, + 0, + 1, + 0, + 2, + 2, + 4, + 1, + 2, + 3, + 0, + 1, + 0, + 3, + 4, + 4, + 2, + 0, + 2, + 0, + 0, + 6, + 0, + 4, + 2, + 0, + 5, + 0, + 0, + 0, + 1, + 0, + 1, + 3, + 7 + ], + "weighted_loads": [ + 0.04161681979894638, + 0.8655087184160948, + 0.0895259901881218, + 0.06550256907939911, + 0.0, + 0.0, + 0.0, + 0.932794526219368, + 0.039760835468769073, + 0.0, + 0.18818568252027035, + 0.0, + 0.03366660326719284, + 0.0, + 0.0398092195391655, + 0.0, + 0.0, + 0.1305440552532673, + 0.08365881815552711, + 0.1171419695019722, + 0.5864785239100456, + 0.0, + 0.0, + 0.08241688460111618, + 2.394343826919794, + 0.0, + 0.0, + 0.0, + 0.14325464889407158, + 0.0, + 0.0, + 0.060869552195072174, + 0.0, + 0.5342139899730682, + 0.05892152525484562, + 0.18594321236014366, + 0.027580739930272102, + 0.11713077127933502, + 0.15235383436083794, + 0.0, + 0.058011386543512344, + 0.0, + 0.11675922758877277, + 0.2241724543273449, + 0.1747570615261793, + 0.07794119045138359, + 0.0, + 0.08139797672629356, + 0.0, + 0.0, + 0.3203682191669941, + 0.0, + 0.11795779131352901, + 0.08071286417543888, + 0.0, + 0.248932383954525, + 0.0, + 0.0, + 0.0, + 0.03454504534602165, + 0.0, + 0.03263868764042854, + 0.13134070299565792, + 0.39915543235838413 + ], + "unique_experts": 37, + "load_cv": 1.7201256285846804, + "normalized_load_entropy": 0.7642848995103501, + "max_load_share": 0.15942028985507245 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "dd3ced376e9afc02bc78776979d4ea0f03a509f1aab8323476445aaff7e17616", + "route_weight_sha256": "eda2f4f4a72bdbae210052c2f07f4d6f849d7a969e6abbe94284b2dd09d44572", + "loads": [ + 1, + 13, + 5, + 1, + 0, + 3, + 0, + 15, + 8, + 0, + 10, + 0, + 3, + 0, + 3, + 0, + 0, + 3, + 2, + 4, + 9, + 0, + 6, + 1, + 31, + 0, + 2, + 0, + 11, + 6, + 0, + 3, + 2, + 7, + 9, + 4, + 3, + 5, + 3, + 0, + 2, + 2, + 7, + 5, + 4, + 3, + 0, + 7, + 1, + 0, + 14, + 6, + 9, + 7, + 0, + 5, + 0, + 1, + 6, + 1, + 1, + 19, + 6, + 9 + ], + "weighted_loads": [ + 0.04161681979894638, + 0.8655087184160948, + 0.19198774360120296, + 0.06550256907939911, + 0.0, + 0.08531731006223708, + 0.0, + 1.024337150156498, + 0.3951999917626381, + 0.0, + 0.509659931063652, + 0.0, + 0.070578807964921, + 0.0, + 0.09355206601321697, + 0.0, + 0.0, + 0.1305440552532673, + 0.08365881815552711, + 0.1454156804829836, + 0.5864785239100456, + 0.0, + 0.3278623316437006, + 0.08241688460111618, + 2.743241736199707, + 0.0, + 0.0685033481568098, + 0.0, + 0.4627661630511284, + 0.23652856051921844, + 0.0, + 0.12553581595420837, + 0.08363151364028454, + 0.7453607395291328, + 0.31564090261235833, + 0.18594321236014366, + 0.20865357853472233, + 1.0476833954453468, + 0.15235383436083794, + 0.0, + 0.10330571234226227, + 0.11926544457674026, + 0.2867803198751062, + 0.2615576349198818, + 0.1747570615261793, + 0.1261574812233448, + 0.0, + 0.41533302410971373, + 0.028948796913027763, + 0.0, + 0.7382026594132185, + 0.464625246822834, + 0.2751749977469444, + 0.31253420002758503, + 0.0, + 0.248932383954525, + 0.0, + 0.03407948091626167, + 0.21117965690791607, + 0.03454504534602165, + 0.037585824728012085, + 1.4956736187450588, + 0.2194950928678736, + 1.411748418584466 + ], + "unique_experts": 48, + "load_cv": 1.1941214033447043, + "normalized_load_entropy": 0.8533639145249344, + "max_load_share": 0.1076388888888889 + } + }, + "s1_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "13bc255fb8d264b93839e36cf570e8833c80af189f3a1e8d1b1a1d85eca6bfe8", + "route_weight_sha256": "92616802a5ef3d970397451adca4b0cf25074a3982e711c85c668368cb85f498", + "loads": [ + 1, + 12, + 2, + 1, + 0, + 0, + 0, + 12, + 2, + 0, + 1, + 0, + 1, + 0, + 0, + 0, + 0, + 3, + 2, + 3, + 11, + 0, + 0, + 1, + 22, + 0, + 0, + 0, + 3, + 0, + 0, + 1, + 0, + 2, + 1, + 4, + 1, + 3, + 3, + 0, + 1, + 0, + 2, + 4, + 4, + 2, + 0, + 2, + 0, + 0, + 6, + 2, + 2, + 2, + 0, + 6, + 0, + 0, + 0, + 1, + 1, + 1, + 3, + 7 + ], + "weighted_loads": [ + 0.03612186387181282, + 0.8724947385489941, + 0.09551854431629181, + 0.0732150748372078, + 0.0, + 0.0, + 0.0, + 0.8524492867290974, + 0.060459090396761894, + 0.0, + 0.15600013732910156, + 0.0, + 0.0354933924973011, + 0.0, + 0.0, + 0.0, + 0.0, + 0.14250842481851578, + 0.07136377692222595, + 0.11622543260455132, + 0.7036523073911667, + 0.0, + 0.0, + 0.08698709309101105, + 2.2986938320100307, + 0.0, + 0.0, + 0.0, + 0.13316084817051888, + 0.0, + 0.0, + 0.05508390814065933, + 0.0, + 0.5537043213844299, + 0.027782786637544632, + 0.18827175348997116, + 0.022779840975999832, + 0.13708891347050667, + 0.17883393168449402, + 0.0, + 0.058353133499622345, + 0.0, + 0.08622762933373451, + 0.22139205783605576, + 0.17818541638553143, + 0.07179339788854122, + 0.0, + 0.0816233903169632, + 0.0, + 0.0, + 0.2894898634403944, + 0.06509183347225189, + 0.05116281844675541, + 0.06576512008905411, + 0.0, + 0.29779866710305214, + 0.0, + 0.0, + 0.0, + 0.028669921681284904, + 0.031203653663396835, + 0.04737585783004761, + 0.13095551170408726, + 0.3775896932929754 + ], + "unique_experts": 38, + "load_cv": 1.71032914753291, + "normalized_load_entropy": 0.7676034687524286, + "max_load_share": 0.15942028985507245 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "7202b9ee650711a2c93c94ffd760beceb9de6a193bc7989a8fa51b3aa6fa495b", + "route_weight_sha256": "5d7006fb0acaed5976cfe3c839672d27b9f5055243b7d4edf5c96076929e6f8c", + "loads": [ + 1, + 12, + 3, + 2, + 2, + 8, + 0, + 14, + 11, + 3, + 7, + 2, + 4, + 0, + 3, + 0, + 1, + 3, + 3, + 6, + 16, + 0, + 6, + 2, + 32, + 0, + 1, + 1, + 24, + 4, + 0, + 4, + 0, + 8, + 7, + 6, + 9, + 8, + 4, + 0, + 2, + 8, + 6, + 8, + 5, + 3, + 0, + 9, + 0, + 0, + 15, + 18, + 11, + 8, + 2, + 8, + 0, + 0, + 15, + 1, + 4, + 23, + 11, + 10 + ], + "weighted_loads": [ + 0.03612186387181282, + 0.8724947385489941, + 0.12023737840354443, + 0.18553924560546875, + 0.06097274273633957, + 0.24160042603034526, + 0.0, + 0.9268034398555756, + 0.6824970822781324, + 0.1303626075387001, + 0.43412799946963787, + 0.06684808991849422, + 0.09622003533877432, + 0.0, + 0.08599022775888443, + 0.0, + 0.028606098145246506, + 0.14250842481851578, + 0.10398074612021446, + 0.2101543117314577, + 0.9199343621730804, + 0.0, + 0.41519779711961746, + 0.11239353194832802, + 2.6747701852582395, + 0.0, + 0.034581027925014496, + 0.035601288080215454, + 1.1643424946814775, + 0.1911366693675518, + 0.0, + 0.19427183270454407, + 0.0, + 0.8644247502088547, + 0.24470168072730303, + 0.28791646286845207, + 0.6391569413244724, + 1.1668650284409523, + 0.21843057125806808, + 0.0, + 0.17158243060112, + 0.466544296592474, + 0.2103808638639748, + 0.5361005775630474, + 0.21727894432842731, + 0.12910560704767704, + 0.0, + 0.6120820575160906, + 0.0, + 0.0, + 0.7629800196737051, + 1.0768435522913933, + 0.3285548072308302, + 0.43636130541563034, + 0.17510559037327766, + 0.3945715017616749, + 0.0, + 0.0, + 0.6530017592012882, + 0.028669921681284904, + 0.1394312959164381, + 2.0895554032176733, + 0.5345902306726202, + 1.433799797669053 + ], + "unique_experts": 51, + "load_cv": 1.0821307427683793, + "normalized_load_entropy": 0.86980749985036, + "max_load_share": 0.08333333333333333 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "ordered_topk_exact_tokens": 17, + "set_exact_tokens": 20, + "mean_set_jaccard": 0.9627329192546583, + "mean_token_weighted_tv": 0.011154420390401197, + "aggregate_load_tv": 0.021739130434782608 + }, + "system_bos": { + "tokens": 23, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 18, + "mean_set_jaccard": 0.9378881987577641, + "mean_token_weighted_tv": 0.015695628993537113, + "aggregate_load_tv": 0.03623188405797102 + }, + "system_x": { + "tokens": 23, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8788819875776398, + "mean_token_weighted_tv": 0.02684987032705027, + "aggregate_load_tv": 0.07246376811594203 + }, + "system_period": { + "tokens": 23, + "ordered_topk_exact_tokens": 6, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8788819875776398, + "mean_token_weighted_tv": 0.028911876451709995, + "aggregate_load_tv": 0.057971014492753624 + }, + "bos_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 16, + "set_exact_tokens": 21, + "mean_set_jaccard": 0.9751552795031057, + "mean_token_weighted_tv": 0.012195677698954292, + "aggregate_load_tv": 0.014492753623188411 + }, + "bos_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.9006211180124224, + "mean_token_weighted_tv": 0.021945144049823284, + "aggregate_load_tv": 0.057971014492753624 + }, + "x_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.9006211180124224, + "mean_token_weighted_tv": 0.021270565931563793, + "aggregate_load_tv": 0.057971014492753624 + }, + "x_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 7, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.8819875776397517, + "mean_token_weighted_tv": 0.028367399035588554, + "aggregate_load_tv": 0.06521739130434782 + }, + "period_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 18, + "mean_set_jaccard": 0.9378881987577639, + "mean_token_weighted_tv": 0.0154030478923865, + "aggregate_load_tv": 0.03623188405797102 + }, + "period_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 8, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8881987577639753, + "mean_token_weighted_tv": 0.028518023860195408, + "aggregate_load_tv": 0.050724637681159424 + } + } + }, + "layer_25": { + "layer": 25, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "dd0ec78435c383587c8ae242573c5da3cdb25b991fce0048d9f4f8eb30d77dd2", + "route_weight_sha256": "8d642f57a6f70f4876e4882af77f91f8158aa2032143d363a072752404969a69", + "loads": [ + 3, + 0, + 10, + 4, + 0, + 0, + 0, + 2, + 1, + 12, + 2, + 7, + 2, + 1, + 0, + 11, + 0, + 9, + 2, + 1, + 1, + 1, + 3, + 1, + 0, + 3, + 7, + 0, + 2, + 0, + 0, + 0, + 6, + 8, + 3, + 0, + 0, + 0, + 1, + 0, + 0, + 0, + 2, + 6, + 1, + 0, + 1, + 0, + 3, + 0, + 0, + 0, + 1, + 0, + 5, + 0, + 2, + 4, + 0, + 1, + 1, + 1, + 4, + 3 + ], + "weighted_loads": [ + 0.14579424634575844, + 0.0, + 0.6946277692914009, + 0.23427064716815948, + 0.0, + 0.0, + 0.0, + 0.07307197898626328, + 0.08454451709985733, + 0.7908648997545242, + 0.13455957919359207, + 0.4907027781009674, + 0.17373408004641533, + 0.09189113974571228, + 0.0, + 0.563447866588831, + 0.0, + 0.6518420502543449, + 0.14655038714408875, + 0.21526166796684265, + 0.027183808386325836, + 0.05304503068327904, + 0.21154891327023506, + 0.033772774040699005, + 0.0, + 0.2826034314930439, + 0.3495812565088272, + 0.0, + 0.16527286171913147, + 0.0, + 0.0, + 0.0, + 0.5149436928331852, + 0.782327625900507, + 0.11356568522751331, + 0.0, + 0.0, + 0.0, + 0.020757248625159264, + 0.0, + 0.0, + 0.0, + 0.16338936984539032, + 0.30314014479517937, + 0.032595518976449966, + 0.0, + 0.03464002162218094, + 0.0, + 0.10505234263837337, + 0.0, + 0.0, + 0.0, + 0.032249435782432556, + 0.0, + 0.3116529453545809, + 0.0, + 0.12126117944717407, + 0.2055988386273384, + 0.0, + 0.060667313635349274, + 0.057542428374290466, + 0.05841884762048721, + 0.6299373954534531, + 0.1192857138812542 + ], + "unique_experts": 39, + "load_cv": 1.360081418915263, + "normalized_load_entropy": 0.8039770372644818, + "max_load_share": 0.08695652173913043 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "b5e0cbd257fd3caf6b658962a6be9271810d6559b04ccba2630fceefcc38f03b", + "route_weight_sha256": "043febf3957772bab5b089b87b619c6dd58ee9d2873a60012414cdda797f15c8", + "loads": [ + 5, + 17, + 17, + 6, + 0, + 0, + 6, + 2, + 1, + 12, + 13, + 10, + 6, + 1, + 0, + 11, + 0, + 13, + 2, + 1, + 1, + 1, + 3, + 5, + 0, + 3, + 8, + 0, + 3, + 3, + 0, + 1, + 7, + 9, + 5, + 0, + 0, + 2, + 10, + 3, + 6, + 0, + 2, + 7, + 5, + 9, + 5, + 0, + 3, + 1, + 10, + 0, + 7, + 0, + 14, + 0, + 3, + 8, + 1, + 1, + 3, + 1, + 10, + 5 + ], + "weighted_loads": [ + 0.27009959518909454, + 1.263569159898907, + 1.2788657248020172, + 0.3469708636403084, + 0.0, + 0.0, + 0.40984828397631645, + 0.07307197898626328, + 0.08454451709985733, + 0.7908648997545242, + 1.1811597011983395, + 1.0963329402729869, + 0.5339253880083561, + 0.09189113974571228, + 0.0, + 0.563447866588831, + 0.0, + 0.7849627807736397, + 0.14655038714408875, + 0.21526166796684265, + 0.027183808386325836, + 0.05304503068327904, + 0.21154891327023506, + 0.20294634625315666, + 0.0, + 0.2826034314930439, + 0.3830253705382347, + 0.0, + 0.20646603778004646, + 0.13428353518247604, + 0.0, + 0.10010793805122375, + 0.56776312738657, + 0.8460800014436245, + 0.21987826563417912, + 0.0, + 0.0, + 0.0912511758506298, + 1.42293837107718, + 0.34873489663004875, + 0.25241113267838955, + 0.0, + 0.16338936984539032, + 0.3358338810503483, + 0.3462284803390503, + 0.7571197301149368, + 0.16025992447976023, + 0.0, + 0.10505234263837337, + 0.04006136581301689, + 0.5866097696125507, + 0.0, + 0.34131596703082323, + 0.0, + 0.7418451176490635, + 0.0, + 0.16575933620333672, + 0.4131355620920658, + 0.03671225160360336, + 0.060667313635349274, + 0.15767746418714523, + 0.05841884762048721, + 1.0774179790169, + 0.18896862491965294 + ], + "unique_experts": 50, + "load_cv": 1.0053867261585476, + "normalized_load_entropy": 0.8731196147875192, + "max_load_share": 0.059027777777777776 + } + }, + "s1_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "df2698e0e6c324fa858df101d4496aede3cd90ed627981152c0974616487f765", + "route_weight_sha256": "3692ad286222a20dca092cccf4a0593fa06c523b6cadb13d0c49e7bec278c20a", + "loads": [ + 4, + 0, + 10, + 4, + 1, + 0, + 0, + 2, + 1, + 13, + 2, + 7, + 2, + 1, + 0, + 11, + 0, + 8, + 2, + 1, + 1, + 1, + 2, + 0, + 0, + 3, + 6, + 0, + 3, + 0, + 0, + 0, + 6, + 9, + 3, + 0, + 0, + 0, + 1, + 0, + 0, + 0, + 2, + 6, + 1, + 0, + 0, + 0, + 3, + 0, + 0, + 0, + 0, + 0, + 6, + 1, + 2, + 4, + 0, + 1, + 1, + 1, + 4, + 2 + ], + "weighted_loads": [ + 0.18364140018820763, + 0.0, + 0.6592909097671509, + 0.21770615875720978, + 0.04432482644915581, + 0.0, + 0.0, + 0.07617923803627491, + 0.0802859514951706, + 0.8046732768416405, + 0.12102552130818367, + 0.4837442487478256, + 0.17701726034283638, + 0.09202999621629715, + 0.0, + 0.5795367062091827, + 0.0, + 0.6081923060119152, + 0.13821780681610107, + 0.2119428515434265, + 0.02754635363817215, + 0.056126415729522705, + 0.1692819446325302, + 0.0, + 0.0, + 0.2745160087943077, + 0.3145875595510006, + 0.0, + 0.19213256984949112, + 0.0, + 0.0, + 0.0, + 0.511211920529604, + 0.8133167326450348, + 0.10672512091696262, + 0.0, + 0.0, + 0.0, + 0.025419466197490692, + 0.0, + 0.0, + 0.0, + 0.159853957593441, + 0.3051838278770447, + 0.03662470728158951, + 0.0, + 0.0, + 0.0, + 0.09895678609609604, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.3469877876341343, + 0.03448912128806114, + 0.1196918860077858, + 0.196347177028656, + 0.0, + 0.05954458937048912, + 0.05542184039950371, + 0.059474147856235504, + 0.63356688991189, + 0.07950814440846443 + ], + "unique_experts": 38, + "load_cv": 1.3894159890364772, + "normalized_load_entropy": 0.797534022285415, + "max_load_share": 0.09420289855072464 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "10140e6e635aeb225a14f7378f7802fb0062219708afc0528c338d2245d49d64", + "route_weight_sha256": "1e3de81081e828a7fda22520fb4b2fff357babfe9b618b8442f6edf33122b133", + "loads": [ + 7, + 23, + 20, + 5, + 1, + 1, + 8, + 2, + 3, + 14, + 24, + 12, + 9, + 1, + 0, + 12, + 0, + 16, + 3, + 2, + 4, + 8, + 2, + 6, + 0, + 3, + 8, + 0, + 4, + 4, + 0, + 3, + 11, + 10, + 6, + 0, + 0, + 6, + 10, + 5, + 8, + 0, + 3, + 7, + 10, + 14, + 2, + 0, + 3, + 1, + 12, + 0, + 6, + 7, + 19, + 2, + 4, + 10, + 1, + 2, + 6, + 2, + 9, + 3 + ], + "weighted_loads": [ + 0.4494381621479988, + 1.8239362319000065, + 1.3266845904290676, + 0.2987757548689842, + 0.04432482644915581, + 0.03812273591756821, + 0.6198888793587685, + 0.07617923803627491, + 0.19556239619851112, + 0.83371826633811, + 2.1242512594908476, + 1.2082951655611396, + 0.6984684467315674, + 0.09202999621629715, + 0.0, + 0.6278544813394547, + 0.0, + 1.2614034563302994, + 0.1906903237104416, + 0.23560366965830326, + 0.28638290613889694, + 0.6975411400198936, + 0.1692819446325302, + 0.2424173206090927, + 0.0, + 0.2745160087943077, + 0.3791057877242565, + 0.0, + 0.23771889880299568, + 0.16115522012114525, + 0.0, + 0.4696270376443863, + 0.7431003898382187, + 0.8613010011613369, + 0.260499918833375, + 0.0, + 0.0, + 0.27547178976237774, + 1.675754401832819, + 0.4448345936834812, + 0.39277249947190285, + 0.0, + 0.2468990609049797, + 0.33468981832265854, + 0.6811647973954678, + 1.2300288956612349, + 0.0430705655599013, + 0.0, + 0.09895678609609604, + 0.045430902391672134, + 0.7118541803210974, + 0.0, + 0.4066498950123787, + 0.5028146654367447, + 1.174512013560161, + 0.06125553883612156, + 0.19865166768431664, + 0.48346156999468803, + 0.03860710933804512, + 0.14576417580246925, + 0.3393116481602192, + 0.10282212868332863, + 1.0629512201994658, + 0.12558462843298912 + ], + "unique_experts": 54, + "load_cv": 0.9587861249169877, + "normalized_load_entropy": 0.8909437757370775, + "max_load_share": 0.0625 + } + }, + "s0_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "c03d49f282edda09651cb231364bc9dac2e00cd7521456355183eba0aabac11a", + "route_weight_sha256": "ef8caaf92bf8ee318113317a81a217c1e957287da9a138be653286b75c7b3844", + "loads": [ + 4, + 0, + 11, + 4, + 1, + 0, + 0, + 2, + 1, + 12, + 2, + 7, + 2, + 1, + 0, + 11, + 0, + 8, + 2, + 1, + 1, + 1, + 3, + 1, + 0, + 3, + 6, + 0, + 2, + 0, + 0, + 0, + 6, + 9, + 3, + 0, + 0, + 0, + 1, + 0, + 1, + 0, + 2, + 6, + 1, + 0, + 0, + 0, + 2, + 0, + 0, + 0, + 1, + 0, + 3, + 1, + 2, + 4, + 0, + 1, + 2, + 1, + 3, + 3 + ], + "weighted_loads": [ + 0.17747512832283974, + 0.0, + 0.8009988442063332, + 0.21155643090605736, + 0.04168571159243584, + 0.0, + 0.0, + 0.08258546143770218, + 0.08766161650419235, + 0.7609773576259613, + 0.13433999568223953, + 0.4787619672715664, + 0.1769738644361496, + 0.09485764056444168, + 0.0, + 0.5722106993198395, + 0.0, + 0.6088342033326626, + 0.15309670194983482, + 0.21314996480941772, + 0.027947505936026573, + 0.05009260028600693, + 0.21586798503994942, + 0.037457238882780075, + 0.0, + 0.289790116250515, + 0.32494527846574783, + 0.0, + 0.16507306694984436, + 0.0, + 0.0, + 0.0, + 0.5306173115968704, + 0.8159433156251907, + 0.10971145145595074, + 0.0, + 0.0, + 0.0, + 0.022494610399007797, + 0.0, + 0.03249577060341835, + 0.0, + 0.17265065759420395, + 0.2971520312130451, + 0.03698207437992096, + 0.0, + 0.0, + 0.0, + 0.07231545448303223, + 0.0, + 0.0, + 0.0, + 0.0333089679479599, + 0.0, + 0.2564336024224758, + 0.03872794285416603, + 0.1204449012875557, + 0.19705678150057793, + 0.0, + 0.060903314501047134, + 0.08884262107312679, + 0.06195712089538574, + 0.617077823728323, + 0.11892744526267052 + ], + "unique_experts": 41, + "load_cv": 1.350161604367419, + "normalized_load_entropy": 0.8123307607770136, + "max_load_share": 0.08695652173913043 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "4d4a9f4a59c3590be1beb625580e5762446a066e05d94a17950d43e673a878c0", + "route_weight_sha256": "618d6abf8ca5c914d76dcb7f997317a355f31bed8cd2fe2a977e4c7f7de1c057", + "loads": [ + 5, + 16, + 19, + 5, + 1, + 0, + 7, + 3, + 1, + 12, + 14, + 9, + 7, + 1, + 0, + 11, + 0, + 12, + 3, + 1, + 1, + 1, + 3, + 5, + 0, + 3, + 6, + 0, + 3, + 2, + 1, + 1, + 7, + 10, + 5, + 0, + 1, + 0, + 9, + 2, + 7, + 1, + 2, + 9, + 6, + 8, + 2, + 0, + 2, + 3, + 10, + 0, + 6, + 0, + 13, + 1, + 2, + 9, + 1, + 1, + 3, + 1, + 9, + 5 + ], + "weighted_loads": [ + 0.23660119622945786, + 1.1883075372315943, + 1.4317067377269268, + 0.31121234223246574, + 0.04168571159243584, + 0.0, + 0.4613320790231228, + 0.12385185435414314, + 0.08766161650419235, + 0.7609773576259613, + 1.2980810180306435, + 1.0768770202994347, + 0.5310030356049538, + 0.09485764056444168, + 0.0, + 0.5722106993198395, + 0.0, + 0.7419549338519573, + 0.19532350450754166, + 0.21314996480941772, + 0.027947505936026573, + 0.05009260028600693, + 0.21586798503994942, + 0.21088194474577904, + 0.0, + 0.289790116250515, + 0.32494527846574783, + 0.0, + 0.20626624301075935, + 0.06998448446393013, + 0.3846188485622406, + 0.10010793805122375, + 0.5834367461502552, + 0.8796956911683083, + 0.22185215912759304, + 0.0, + 0.05649767071008682, + 0.0, + 0.5146446526050568, + 0.4208560883998871, + 0.2849069032818079, + 0.03146792948246002, + 0.17265065759420395, + 0.4015858508646488, + 0.3752885777503252, + 0.6804855335503817, + 0.08254300802946091, + 0.0, + 0.07231545448303223, + 0.11451707780361176, + 0.5866097696125507, + 0.0, + 0.33821507915854454, + 0.0, + 0.7743687962647527, + 0.03872794285416603, + 0.1204449012875557, + 0.4227428026497364, + 0.0376727432012558, + 0.060903314501047134, + 0.1428775805979967, + 0.06195712089538574, + 1.06455840729177, + 0.20106249675154686 + ], + "unique_experts": 54, + "load_cv": 0.9992280971447194, + "normalized_load_entropy": 0.8803086689308021, + "max_load_share": 0.06597222222222222 + } + }, + "s1_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "5f511f2d39b16f27be683cf02c3f45d6ae0c3834174dc6a6e9d35a796364b795", + "route_weight_sha256": "308b53af9b49d70d33cd7879c761d8a11da2b08067e330e844e27e8e0c90066e", + "loads": [ + 3, + 0, + 11, + 4, + 1, + 0, + 0, + 3, + 1, + 11, + 2, + 7, + 2, + 1, + 0, + 11, + 0, + 8, + 2, + 1, + 1, + 1, + 3, + 1, + 0, + 3, + 6, + 0, + 2, + 0, + 0, + 0, + 6, + 9, + 2, + 0, + 0, + 0, + 1, + 0, + 0, + 0, + 2, + 6, + 1, + 0, + 0, + 0, + 2, + 0, + 0, + 0, + 1, + 0, + 4, + 1, + 2, + 5, + 0, + 1, + 2, + 1, + 4, + 3 + ], + "weighted_loads": [ + 0.1552032120525837, + 0.0, + 0.7328721471130848, + 0.21935590356588364, + 0.03983867168426514, + 0.0, + 0.0, + 0.1094642672687769, + 0.08236337453126907, + 0.6512401215732098, + 0.1247292011976242, + 0.48706118017435074, + 0.20863251388072968, + 0.09278497099876404, + 0.0, + 0.5533182770013809, + 0.0, + 0.6240562163293362, + 0.15068482980132103, + 0.22930565476417542, + 0.029798798263072968, + 0.04391004890203476, + 0.2008679322898388, + 0.04199075698852539, + 0.0, + 0.2768597826361656, + 0.32590167969465256, + 0.0, + 0.17252027988433838, + 0.0, + 0.0, + 0.0, + 0.5216267183423042, + 0.8205580823123455, + 0.06897541135549545, + 0.0, + 0.0, + 0.0, + 0.023104457184672356, + 0.0, + 0.0, + 0.0, + 0.166750006377697, + 0.3184303529560566, + 0.04549117386341095, + 0.0, + 0.0, + 0.0, + 0.0672605112195015, + 0.0, + 0.0, + 0.0, + 0.033806029707193375, + 0.0, + 0.28829222172498703, + 0.04474176838994026, + 0.12187433242797852, + 0.2420252002775669, + 0.0, + 0.06119045987725258, + 0.08511345274746418, + 0.05975375697016716, + 0.6511736512184143, + 0.12242532894015312 + ], + "unique_experts": 40, + "load_cv": 1.3401683661904016, + "normalized_load_entropy": 0.8100494192690068, + "max_load_share": 0.07971014492753623 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "8f99f60dc143460d86782745f810b40904b157af2ce9ca474947a0c1879abeec", + "route_weight_sha256": "04a3bfd7ff926b85739e6f538870929bfe2de009a4fd245c129d0ac63f584b4b", + "loads": [ + 5, + 23, + 22, + 6, + 1, + 1, + 8, + 3, + 5, + 12, + 25, + 9, + 10, + 1, + 0, + 11, + 0, + 16, + 3, + 2, + 4, + 8, + 3, + 7, + 0, + 3, + 7, + 0, + 3, + 3, + 0, + 3, + 12, + 10, + 5, + 0, + 0, + 7, + 9, + 4, + 8, + 0, + 3, + 7, + 11, + 13, + 2, + 0, + 2, + 2, + 12, + 0, + 6, + 7, + 17, + 2, + 4, + 11, + 1, + 2, + 6, + 2, + 9, + 6 + ], + "weighted_loads": [ + 0.3536136597394943, + 1.7613302958197892, + 1.5534767173230648, + 0.31067174300551414, + 0.03983867168426514, + 0.03812273591756821, + 0.6198888793587685, + 0.1094642672687769, + 0.28392257541418076, + 0.6802851110696793, + 2.22484733723104, + 1.1276431009173393, + 0.7223184891045094, + 0.09278497099876404, + 0.0, + 0.5533182770013809, + 0.0, + 1.2772673666477203, + 0.20315734669566154, + 0.25296647287905216, + 0.28863535076379776, + 0.6853247731924057, + 0.2008679322898388, + 0.27608879655599594, + 0.0, + 0.2768597826361656, + 0.3592264764010906, + 0.0, + 0.21810660883784294, + 0.10218748822808266, + 0.0, + 0.4696270376443863, + 0.8029287531971931, + 0.8685423508286476, + 0.22789225727319717, + 0.0, + 0.0, + 0.32344107143580914, + 0.7718579266220331, + 0.43609417229890823, + 0.39277249947190285, + 0.0, + 0.2537951096892357, + 0.34793634340167046, + 0.72666385024786, + 1.1257653757929802, + 0.08131738007068634, + 0.0, + 0.0672605112195015, + 0.09082933887839317, + 0.7118541803210974, + 0.0, + 0.436256542801857, + 0.5028146654367447, + 1.144937298959121, + 0.07150818593800068, + 0.22685810923576355, + 0.5445999652147293, + 0.039498355239629745, + 0.1474100463092327, + 0.3219758179038763, + 0.10310173779726028, + 1.08055798150599, + 0.26217383705079556 + ], + "unique_experts": 54, + "load_cv": 0.9533384323872959, + "normalized_load_entropy": 0.8933924549429296, + "max_load_share": 0.06510416666666667 + } + }, + "s0_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "456f85e4d30a77b87292b2dff6de4688c020f1ffee41ec2b4747bab284a8af28", + "route_weight_sha256": "16dbd31b957a4df3697b506bf526a0df8dae1ce5fe2882765d373b6a5f093c16", + "loads": [ + 4, + 0, + 9, + 4, + 1, + 0, + 0, + 2, + 1, + 12, + 2, + 7, + 2, + 1, + 0, + 11, + 0, + 8, + 2, + 1, + 1, + 1, + 3, + 0, + 0, + 3, + 7, + 0, + 2, + 0, + 0, + 0, + 6, + 9, + 3, + 0, + 0, + 0, + 1, + 0, + 1, + 0, + 2, + 6, + 1, + 0, + 1, + 0, + 3, + 0, + 0, + 0, + 0, + 0, + 4, + 1, + 2, + 4, + 0, + 1, + 1, + 1, + 4, + 3 + ], + "weighted_loads": [ + 0.17785286717116833, + 0.0, + 0.6131824105978012, + 0.22551438584923744, + 0.04315207526087761, + 0.0, + 0.0, + 0.07816511951386929, + 0.08377479016780853, + 0.7210559714585543, + 0.13629407435655594, + 0.49178650230169296, + 0.16815759986639023, + 0.09323763102293015, + 0.0, + 0.5923891514539719, + 0.0, + 0.6244682855904102, + 0.14801184833049774, + 0.2188338041305542, + 0.02791307121515274, + 0.04624840244650841, + 0.213656697422266, + 0.0, + 0.0, + 0.2731156200170517, + 0.3441449087113142, + 0.0, + 0.167879618704319, + 0.0, + 0.0, + 0.0, + 0.5027295909821987, + 0.8111328389495611, + 0.155319694429636, + 0.0, + 0.0, + 0.0, + 0.02086062915623188, + 0.0, + 0.034555695950984955, + 0.0, + 0.1694215163588524, + 0.2883393242955208, + 0.038674741983413696, + 0.0, + 0.035758066922426224, + 0.0, + 0.09651946648955345, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.2578270062804222, + 0.036162566393613815, + 0.12193679064512253, + 0.19163723289966583, + 0.0, + 0.061251334846019745, + 0.05978677421808243, + 0.06496192514896393, + 0.615196455270052, + 0.12271788716316223 + ], + "unique_experts": 40, + "load_cv": 1.335143698502964, + "normalized_load_entropy": 0.8100814864341594, + "max_load_share": 0.08695652173913043 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "2df0efc27741abacd6ac72d06c47eeac2dde15e75f380a88d900b6dd1f74a583", + "route_weight_sha256": "1d2db810641221b58aad82b09e0c549265e56456ca6a16f88b49ab3cfeb1a7cf", + "loads": [ + 6, + 18, + 15, + 6, + 1, + 0, + 9, + 2, + 1, + 12, + 14, + 10, + 6, + 1, + 0, + 11, + 0, + 12, + 3, + 1, + 1, + 1, + 3, + 4, + 0, + 3, + 7, + 0, + 3, + 3, + 0, + 2, + 7, + 10, + 4, + 0, + 1, + 0, + 10, + 2, + 8, + 0, + 2, + 7, + 5, + 8, + 3, + 0, + 4, + 1, + 10, + 0, + 6, + 0, + 14, + 1, + 2, + 8, + 1, + 1, + 2, + 1, + 11, + 4 + ], + "weighted_loads": [ + 0.27432109601795673, + 1.3578421608544886, + 1.0738301612436771, + 0.3073475509881973, + 0.04315207526087761, + 0.0, + 0.5960224382579327, + 0.07816511951386929, + 0.08377479016780853, + 0.7210559714585543, + 1.2680913992226124, + 1.1376993656158447, + 0.49359850585460663, + 0.09323763102293015, + 0.0, + 0.5923891514539719, + 0.0, + 0.757589016109705, + 0.17348861321806908, + 0.2188338041305542, + 0.02791307121515274, + 0.04624840244650841, + 0.213656697422266, + 0.1609835959970951, + 0.0, + 0.2731156200170517, + 0.3441449087113142, + 0.0, + 0.209072794765234, + 0.10393370315432549, + 0.0, + 0.1937975287437439, + 0.5555490255355835, + 0.8748852144926786, + 0.20942573994398117, + 0.0, + 0.06540914624929428, + 0.0, + 0.6275781523436308, + 0.4044342637062073, + 0.33788698352873325, + 0.0, + 0.1694215163588524, + 0.3210330605506897, + 0.3448207266628742, + 0.7214733716100454, + 0.11830107495188713, + 0.0, + 0.13945798575878143, + 0.03006064146757126, + 0.5866097696125507, + 0.0, + 0.4186224155128002, + 0.0, + 0.787186469649896, + 0.036162566393613815, + 0.12193679064512253, + 0.36266432888805866, + 0.03839687630534172, + 0.061251334846019745, + 0.11382173374295235, + 0.06496192514896393, + 1.101879918947816, + 0.1874803751707077 + ], + "unique_experts": 52, + "load_cv": 1.0084519367039637, + "normalized_load_entropy": 0.8749912559802923, + "max_load_share": 0.0625 + } + }, + "s1_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "9a26c5e221ff7290b3c2237d43fb2a2ddf1301d81a5a5656f841857776b34c7c", + "route_weight_sha256": "12d456b948ab6419ebca4db532a3de9ab540e9e48808bb6efe1087064ab71cee", + "loads": [ + 4, + 0, + 9, + 4, + 1, + 0, + 0, + 2, + 1, + 12, + 2, + 7, + 2, + 1, + 0, + 11, + 0, + 8, + 2, + 1, + 1, + 1, + 3, + 1, + 0, + 3, + 6, + 0, + 2, + 0, + 0, + 0, + 6, + 10, + 3, + 0, + 0, + 0, + 0, + 1, + 0, + 0, + 2, + 6, + 1, + 0, + 1, + 0, + 2, + 0, + 0, + 0, + 1, + 0, + 5, + 1, + 2, + 4, + 0, + 1, + 1, + 1, + 4, + 2 + ], + "weighted_loads": [ + 0.18457525968551636, + 0.0, + 0.5823686569929123, + 0.2121073305606842, + 0.04146130755543709, + 0.0, + 0.0, + 0.08923283219337463, + 0.0753299817442894, + 0.6415614075958729, + 0.1582629531621933, + 0.4856702871620655, + 0.1439929511398077, + 0.09265316277742386, + 0.0, + 0.5824086368083954, + 0.0, + 0.6367211863398552, + 0.13442309945821762, + 0.22204114496707916, + 0.032940223813056946, + 0.04526000842452049, + 0.19588802009820938, + 0.046468641608953476, + 0.0, + 0.2615387625992298, + 0.31987062096595764, + 0.0, + 0.17296523600816727, + 0.0, + 0.0, + 0.0, + 0.4881278723478317, + 0.837703138589859, + 0.10066513903439045, + 0.0, + 0.0, + 0.0, + 0.0, + 0.05919411778450012, + 0.0, + 0.0, + 0.15646985173225403, + 0.2964128442108631, + 0.06877540051937103, + 0.0, + 0.030650559812784195, + 0.0, + 0.06459708511829376, + 0.0, + 0.0, + 0.0, + 0.036951374262571335, + 0.0, + 0.27535639330744743, + 0.04170028120279312, + 0.11259808018803596, + 0.19606882706284523, + 0.0, + 0.06094907224178314, + 0.055677298456430435, + 0.05905720964074135, + 0.6090969890356064, + 0.08195877075195312 + ], + "unique_experts": 41, + "load_cv": 1.3426736486503665, + "normalized_load_entropy": 0.8117142014632338, + "max_load_share": 0.08695652173913043 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "9cebaee3fdb80456fe316a32a361ca7a9618298dd805afb462f54bf736e8a05f", + "route_weight_sha256": "4b604e6fd45e2de8d2f9d62639e3751b3e33cd5fba280fc0d92654585237cc3f", + "loads": [ + 6, + 25, + 20, + 4, + 1, + 1, + 10, + 2, + 3, + 13, + 26, + 10, + 8, + 2, + 0, + 11, + 0, + 17, + 3, + 2, + 4, + 8, + 3, + 9, + 0, + 3, + 7, + 0, + 3, + 3, + 0, + 4, + 11, + 11, + 5, + 0, + 0, + 5, + 9, + 5, + 8, + 0, + 3, + 7, + 11, + 13, + 2, + 0, + 2, + 1, + 14, + 0, + 8, + 7, + 19, + 2, + 3, + 10, + 0, + 2, + 4, + 2, + 9, + 3 + ], + "weighted_loads": [ + 0.382985707372427, + 1.9269289304502308, + 1.2550534643232822, + 0.2121073305606842, + 0.04146130755543709, + 0.03812273591756821, + 0.8245439603924751, + 0.08923283219337463, + 0.19060642644762993, + 0.6706063970923424, + 2.314570838585496, + 1.1637073419988155, + 0.4883384723216295, + 0.13501233235001564, + 0.0, + 0.5824086368083954, + 0.0, + 1.3379681557416916, + 0.18689561635255814, + 0.2457019630819559, + 0.29177677631378174, + 0.6866747327148914, + 0.19588802009820938, + 0.3839925266802311, + 0.0, + 0.2615387625992298, + 0.3531954176723957, + 0.0, + 0.21855156496167183, + 0.11544471234083176, + 0.0, + 0.5816142708063126, + 0.7200163416564465, + 0.8856874071061611, + 0.2137536834925413, + 0.0, + 0.0, + 0.2235089335590601, + 0.8080943897366524, + 0.4834715723991394, + 0.39277249947190285, + 0.0, + 0.24351495504379272, + 0.325918834656477, + 0.7384016271680593, + 1.155858602374792, + 0.07239044085144997, + 0.0, + 0.06459708511829376, + 0.034621551632881165, + 0.8498275633901358, + 0.0, + 0.5964264571666718, + 0.5028146654367447, + 1.2386724015232176, + 0.06846669875085354, + 0.1429728977382183, + 0.4669858496636152, + 0.0, + 0.14716865867376328, + 0.2362709417939186, + 0.10240519046783447, + 1.038481319323182, + 0.18981707841157913 + ], + "unique_experts": 53, + "load_cv": 0.999565877991263, + "normalized_load_entropy": 0.8848174313845741, + "max_load_share": 0.06770833333333333 + } + }, + "s0_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "565368ecb0461fc9b439f2ec608913e38af0e946cc9ee8232c8abe515b09b007", + "route_weight_sha256": "0a91a3db05a6502868bfa50eb22029439c4d2ae11bea22e2544e62fd176b274a", + "loads": [ + 3, + 0, + 10, + 4, + 1, + 0, + 0, + 2, + 1, + 12, + 2, + 7, + 2, + 1, + 0, + 11, + 0, + 8, + 2, + 1, + 1, + 1, + 3, + 1, + 0, + 3, + 6, + 0, + 2, + 0, + 0, + 0, + 7, + 9, + 3, + 0, + 0, + 0, + 0, + 0, + 1, + 0, + 2, + 6, + 1, + 0, + 1, + 0, + 2, + 0, + 0, + 0, + 1, + 0, + 4, + 1, + 2, + 4, + 0, + 1, + 2, + 1, + 3, + 3 + ], + "weighted_loads": [ + 0.1464191935956478, + 0.0, + 0.6447796374559402, + 0.22246361896395683, + 0.04455244168639183, + 0.0, + 0.0, + 0.08703342080116272, + 0.08264142274856567, + 0.7281014639884233, + 0.14544501900672913, + 0.4707431122660637, + 0.17671022564172745, + 0.09383812546730042, + 0.0, + 0.6009483300149441, + 0.0, + 0.6201276890933514, + 0.14246484637260437, + 0.21539480984210968, + 0.03083951212465763, + 0.04602924734354019, + 0.21005358546972275, + 0.03771856054663658, + 0.0, + 0.27658695355057716, + 0.31458747759461403, + 0.0, + 0.1634591445326805, + 0.0, + 0.0, + 0.0, + 0.5400037653744221, + 0.7962523512542248, + 0.14198118448257446, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.03223348781466484, + 0.0, + 0.1665608286857605, + 0.2959507629275322, + 0.03990573063492775, + 0.0, + 0.035772569477558136, + 0.0, + 0.06925259530544281, + 0.0, + 0.0, + 0.0, + 0.03213537856936455, + 0.0, + 0.2504917737096548, + 0.0379142127931118, + 0.11531659960746765, + 0.2024543620646, + 0.0, + 0.06326892971992493, + 0.08675238862633705, + 0.06121746078133583, + 0.5899896509945393, + 0.1158592700958252 + ], + "unique_experts": 41, + "load_cv": 1.3401683661904016, + "normalized_load_entropy": 0.8131674243109029, + "max_load_share": 0.08695652173913043 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "a92dbb7bd41fc2845c76f2792c012ca6e369e97b9588394b768650cec4023ced", + "route_weight_sha256": "4a74960c9bd8637bdd66d6ce1502169e76a7d60c59e094850131ba3179a4c993", + "loads": [ + 5, + 18, + 17, + 4, + 1, + 0, + 7, + 2, + 1, + 12, + 15, + 9, + 7, + 2, + 0, + 12, + 0, + 12, + 2, + 1, + 1, + 1, + 3, + 6, + 0, + 3, + 6, + 0, + 3, + 2, + 1, + 1, + 8, + 10, + 5, + 0, + 1, + 0, + 8, + 2, + 7, + 0, + 2, + 7, + 6, + 9, + 3, + 0, + 2, + 1, + 10, + 0, + 7, + 0, + 14, + 1, + 2, + 8, + 1, + 1, + 4, + 1, + 9, + 5 + ], + "weighted_loads": [ + 0.25245146453380585, + 1.3795675137080252, + 1.1275444645434618, + 0.22246361896395683, + 0.04455244168639183, + 0.0, + 0.4905870743095875, + 0.08703342080116272, + 0.08264142274856567, + 0.7281014639884233, + 1.31857455894351, + 1.068858165293932, + 0.5245648846030235, + 0.13168859481811523, + 0.0, + 0.6447706371545792, + 0.0, + 0.7532484196126461, + 0.14246484637260437, + 0.21539480984210968, + 0.03083951212465763, + 0.04602924734354019, + 0.21005358546972275, + 0.23889196291565895, + 0.0, + 0.27658695355057716, + 0.31458747759461403, + 0.0, + 0.2046523205935955, + 0.06176595017313957, + 0.039922088384628296, + 0.10010793805122375, + 0.5928231999278069, + 0.8600047267973423, + 0.23717272281646729, + 0.0, + 0.07819321006536484, + 0.0, + 0.49215004220604897, + 0.4572739601135254, + 0.2846446204930544, + 0.0, + 0.1665608286857605, + 0.3286444991827011, + 0.37799662351608276, + 0.8355536665767431, + 0.11831557750701904, + 0.0, + 0.06925259530544281, + 0.03349154070019722, + 0.5866097696125507, + 0.0, + 0.3733159750699997, + 0.0, + 0.7526924179401249, + 0.0379142127931118, + 0.11531659960746765, + 0.37013696506619453, + 0.03989150747656822, + 0.06326892971992493, + 0.18340103328227997, + 0.06121746078133583, + 1.0374702345579863, + 0.3090933859348297 + ], + "unique_experts": 53, + "load_cv": 1.0191075737691189, + "normalized_load_entropy": 0.8754433730125127, + "max_load_share": 0.0625 + } + }, + "s1_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "55c0a5a6b25fa8e2c8eaff56d8b84b1d265246846426e5716127d5793a9e5ba0", + "route_weight_sha256": "39957bc8db188f07edf53f4c3177e84f0755c00a751e0881e87b13f4fcf8b914", + "loads": [ + 4, + 0, + 10, + 4, + 0, + 0, + 0, + 2, + 1, + 11, + 2, + 7, + 2, + 1, + 0, + 12, + 0, + 8, + 2, + 1, + 1, + 1, + 3, + 1, + 0, + 3, + 7, + 0, + 3, + 0, + 0, + 0, + 6, + 9, + 1, + 0, + 0, + 0, + 0, + 1, + 0, + 0, + 2, + 7, + 1, + 0, + 1, + 0, + 2, + 0, + 0, + 0, + 0, + 0, + 5, + 1, + 2, + 4, + 0, + 1, + 1, + 1, + 4, + 3 + ], + "weighted_loads": [ + 0.1843215823173523, + 0.0, + 0.6234381534159184, + 0.21076015010476112, + 0.0, + 0.0, + 0.0, + 0.09320992976427078, + 0.07423035055398941, + 0.5914051160216331, + 0.1425515040755272, + 0.4849314019083977, + 0.1661628969013691, + 0.0931686982512474, + 0.0, + 0.615732466802001, + 0.0, + 0.6261885464191437, + 0.13230221718549728, + 0.23859477043151855, + 0.03319859877228737, + 0.044805772602558136, + 0.197023406624794, + 0.05349545180797577, + 0.0, + 0.2714601270854473, + 0.34547410160303116, + 0.0, + 0.20156865008175373, + 0.0, + 0.0, + 0.0, + 0.48628948256373405, + 0.8060422204434872, + 0.03713296353816986, + 0.0, + 0.0, + 0.0, + 0.0, + 0.05787893012166023, + 0.0, + 0.0, + 0.15236464142799377, + 0.3412962630391121, + 0.07795203477144241, + 0.0, + 0.031396277248859406, + 0.0, + 0.06712167710065842, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.25502173602581024, + 0.04332892969250679, + 0.11218882724642754, + 0.2111714482307434, + 0.0, + 0.06315584480762482, + 0.05686519294977188, + 0.05697786062955856, + 0.6209002882242203, + 0.1172756478190422 + ], + "unique_experts": 39, + "load_cv": 1.3748269448677473, + "normalized_load_entropy": 0.8007983724749295, + "max_load_share": 0.08695652173913043 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "88f196d7a8bd04eb2c5493c11f6a965449ef38d7b6c0180e7d127fa4824bed78", + "route_weight_sha256": "7ec8b460a652610167cbf0900a48a71af39cdfc7804af097a6726d20dfbad9fe", + "loads": [ + 7, + 25, + 20, + 4, + 0, + 1, + 8, + 2, + 3, + 12, + 26, + 9, + 8, + 2, + 0, + 13, + 0, + 16, + 4, + 2, + 4, + 8, + 3, + 7, + 0, + 3, + 8, + 0, + 4, + 3, + 1, + 3, + 11, + 11, + 4, + 0, + 0, + 6, + 8, + 5, + 8, + 0, + 3, + 8, + 12, + 16, + 2, + 0, + 2, + 0, + 12, + 0, + 6, + 7, + 18, + 2, + 4, + 10, + 0, + 2, + 5, + 2, + 9, + 5 + ], + "weighted_loads": [ + 0.4460889957845211, + 1.986357778776437, + 1.293192993849516, + 0.21076015010476112, + 0.0, + 0.03812273591756821, + 0.6198888793587685, + 0.09320992976427078, + 0.18950679525732994, + 0.6204501055181026, + 2.2794561330229044, + 1.1255133226513863, + 0.5398994535207748, + 0.13623731583356857, + 0.0, + 0.6648277509957552, + 0.0, + 1.2793996967375278, + 0.22038620710372925, + 0.2622555885463953, + 0.29203515127301216, + 0.6862204968929291, + 0.197023406624794, + 0.28008122742176056, + 0.0, + 0.2714601270854473, + 0.3787988983094692, + 0.0, + 0.2471549790352583, + 0.12187003344297409, + 0.0462651327252388, + 0.4696270376443863, + 0.7181779518723488, + 0.8949641846120358, + 0.19723183661699295, + 0.0, + 0.0, + 0.24866791628301144, + 0.7487534694373608, + 0.5117692910134792, + 0.39277249947190285, + 0.0, + 0.23940974473953247, + 0.37080225348472595, + 0.7966511677950621, + 1.3005119673907757, + 0.07313615828752518, + 0.0, + 0.06712167710065842, + 0.0, + 0.7118541803210974, + 0.0, + 0.4603595621883869, + 0.5028146654367447, + 1.1101315913256258, + 0.07009534724056721, + 0.2032901793718338, + 0.4763060323894024, + 0.0, + 0.14937543123960495, + 0.28402234613895416, + 0.10032584145665169, + 1.050284618511796, + 0.4720272496342659 + ], + "unique_experts": 52, + "load_cv": 0.9912814377808599, + "normalized_load_entropy": 0.8853899775097104, + "max_load_share": 0.06770833333333333 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.8913043478260869, + "mean_token_weighted_tv": 0.020947091281414032, + "aggregate_load_tv": 0.05072463768115942 + }, + "system_bos": { + "tokens": 23, + "ordered_topk_exact_tokens": 16, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.9503105590062112, + "mean_token_weighted_tv": 0.017181413977042488, + "aggregate_load_tv": 0.028985507246376812 + }, + "system_x": { + "tokens": 23, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.9037267080745343, + "mean_token_weighted_tv": 0.026682654314714928, + "aggregate_load_tv": 0.03623188405797102 + }, + "system_period": { + "tokens": 23, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 12, + "mean_set_jaccard": 0.8447204968944099, + "mean_token_weighted_tv": 0.03462992069999809, + "aggregate_load_tv": 0.05797101449275364 + }, + "bos_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.9006211180124224, + "mean_token_weighted_tv": 0.021673590552223766, + "aggregate_load_tv": 0.050724637681159424 + }, + "bos_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.8819875776397516, + "mean_token_weighted_tv": 0.026625205357761486, + "aggregate_load_tv": 0.057971014492753624 + }, + "x_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8881987577639753, + "mean_token_weighted_tv": 0.023925796232145767, + "aggregate_load_tv": 0.036231884057971016 + }, + "x_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.9006211180124224, + "mean_token_weighted_tv": 0.028647354034625965, + "aggregate_load_tv": 0.04347826086956522 + }, + "period_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.9130434782608695, + "mean_token_weighted_tv": 0.020759437597640183, + "aggregate_load_tv": 0.04347826086956522 + }, + "period_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 13, + "mean_set_jaccard": 0.8757763975155279, + "mean_token_weighted_tv": 0.033079619073997375, + "aggregate_load_tv": 0.05797101449275363 + } + } + }, + "layer_26": { + "layer": 26, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "2d529385eb9c63fbc45c029859953b6daa1c825d5b256e6ab1df59b99f29f9be", + "route_weight_sha256": "42bb9b0d3dec84a14520f8c6e4cf31d14a6dac2d3dfd22bb33c41e256925511e", + "loads": [ + 4, + 1, + 1, + 3, + 6, + 0, + 0, + 1, + 5, + 3, + 3, + 0, + 0, + 6, + 9, + 2, + 1, + 2, + 1, + 0, + 1, + 1, + 1, + 0, + 2, + 3, + 1, + 1, + 0, + 1, + 4, + 2, + 0, + 0, + 4, + 1, + 7, + 1, + 0, + 4, + 4, + 0, + 3, + 0, + 1, + 12, + 3, + 0, + 0, + 1, + 0, + 0, + 1, + 1, + 3, + 0, + 7, + 0, + 2, + 0, + 3, + 4, + 8, + 3 + ], + "weighted_loads": [ + 0.2699738349765539, + 0.02259579673409462, + 0.03514882177114487, + 0.11815670877695084, + 0.6891182512044907, + 0.0, + 0.0, + 0.042516764253377914, + 0.4401283636689186, + 0.10136766359210014, + 0.4084456339478493, + 0.0, + 0.0, + 0.7247190549969673, + 0.7132437787950039, + 0.1112416684627533, + 0.05966050177812576, + 0.06959328055381775, + 0.019970666617155075, + 0.0, + 0.041370317339897156, + 0.0625457689166069, + 0.07700351625680923, + 0.0, + 0.08810856193304062, + 0.10479656606912613, + 0.06799741834402084, + 0.026721438392996788, + 0.0, + 0.060280587524175644, + 0.20040741562843323, + 0.12497038394212723, + 0.0, + 0.0, + 0.3842268995940685, + 0.041745301336050034, + 0.4117981418967247, + 0.06432528793811798, + 0.0, + 0.20701241120696068, + 0.2832075357437134, + 0.0, + 0.09496617317199707, + 0.0, + 0.035773325711488724, + 1.2214788645505905, + 0.16562412679195404, + 0.0, + 0.0, + 0.14816610515117645, + 0.0, + 0.0, + 0.125339075922966, + 0.025402158498764038, + 0.18324633687734604, + 0.0, + 1.0396997220814228, + 0.0, + 0.12842386588454247, + 0.0, + 0.11775840818881989, + 0.4145416058599949, + 0.4354947581887245, + 0.134722538292408 + ], + "unique_experts": 45, + "load_cv": 1.1600541745456103, + "normalized_load_entropy": 0.8486731317661647, + "max_load_share": 0.08695652173913043 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "8a69ffdac3d275f3fb145875e82af8e5b4686bc8388c23a8950a738c704d11d4", + "route_weight_sha256": "8d926b71f26abc48b65c604bcea31a43f4ebb659f9bf26d5d42b7346dabfc96f", + "loads": [ + 4, + 2, + 1, + 5, + 6, + 0, + 1, + 3, + 5, + 6, + 7, + 6, + 1, + 7, + 24, + 4, + 1, + 15, + 1, + 0, + 1, + 2, + 1, + 0, + 6, + 3, + 7, + 8, + 0, + 1, + 11, + 2, + 3, + 0, + 9, + 1, + 12, + 1, + 0, + 4, + 4, + 0, + 4, + 4, + 3, + 12, + 6, + 0, + 1, + 3, + 8, + 1, + 4, + 1, + 4, + 0, + 22, + 7, + 9, + 1, + 4, + 4, + 9, + 6 + ], + "weighted_loads": [ + 0.2699738349765539, + 0.07013578712940216, + 0.03514882177114487, + 0.19309170171618462, + 0.6891182512044907, + 0.0, + 0.04254082217812538, + 0.12390200048685074, + 0.4401283636689186, + 0.28602585569024086, + 0.7067670747637749, + 0.362120013916865, + 0.18225526809692383, + 0.7824052423238754, + 1.4088856524322182, + 0.20792635530233383, + 0.05966050177812576, + 0.8418052584165707, + 0.019970666617155075, + 0.0, + 0.041370317339897156, + 0.09408727288246155, + 0.07700351625680923, + 0.0, + 0.3019074723124504, + 0.10479656606912613, + 0.955679390579462, + 0.3053866159170866, + 0.0, + 0.060280587524175644, + 1.0977540835738182, + 0.12497038394212723, + 0.11819762364029884, + 0.0, + 0.8535329475998878, + 0.041745301336050034, + 0.67875343747437, + 0.06432528793811798, + 0.0, + 0.20701241120696068, + 0.2832075357437134, + 0.0, + 0.1417246013879776, + 0.19492878392338753, + 0.11853880435228348, + 1.2214788645505905, + 0.3224247731268406, + 0.0, + 0.05107804387807846, + 1.1783380806446075, + 0.37379470095038414, + 0.06896880269050598, + 0.48387422412633896, + 0.025402158498764038, + 0.22961441799998283, + 0.0, + 2.2026388198137283, + 0.3752078483812511, + 0.4084107168018818, + 0.048461418598890305, + 0.11856264068046585, + 0.4145416058599949, + 0.4765562266111374, + 0.29194098711013794 + ], + "unique_experts": 55, + "load_cv": 1.0621141274613979, + "normalized_load_entropy": 0.8818572434545162, + "max_load_share": 0.08333333333333333 + } + }, + "s1_eos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "72ef03fc50fedfaca2354646056593d1b2b8b0bc67d91778e828ef01629c9bed", + "route_weight_sha256": "922757af5a95a20d105c0a3fe0a836f9e6a69cda8e60240a2f27c52256f0ba6b", + "loads": [ + 5, + 1, + 1, + 3, + 6, + 0, + 0, + 1, + 5, + 3, + 3, + 0, + 0, + 6, + 9, + 2, + 1, + 2, + 1, + 0, + 1, + 1, + 1, + 0, + 1, + 3, + 2, + 1, + 0, + 1, + 4, + 2, + 0, + 0, + 4, + 2, + 7, + 1, + 0, + 4, + 4, + 0, + 2, + 0, + 1, + 12, + 3, + 0, + 0, + 1, + 0, + 0, + 1, + 1, + 3, + 0, + 8, + 0, + 2, + 0, + 3, + 4, + 7, + 2 + ], + "weighted_loads": [ + 0.2932749595493078, + 0.02236749976873398, + 0.032288916409015656, + 0.11576356180012226, + 0.6849083267152309, + 0.0, + 0.0, + 0.04378053918480873, + 0.4377993308007717, + 0.10397756099700928, + 0.38104111701250076, + 0.0, + 0.0, + 0.7305930219590664, + 0.7069657482206821, + 0.11282480880618095, + 0.05828743800520897, + 0.07254932262003422, + 0.020246630534529686, + 0.0, + 0.03847998380661011, + 0.06272044032812119, + 0.07752706110477448, + 0.0, + 0.04791523143649101, + 0.09934833459556103, + 0.10811352729797363, + 0.027979105710983276, + 0.0, + 0.06657213717699051, + 0.19956569001078606, + 0.12405619397759438, + 0.0, + 0.0, + 0.36960427835583687, + 0.0729471705853939, + 0.40782982110977173, + 0.06352850049734116, + 0.0, + 0.2140376977622509, + 0.282665241509676, + 0.0, + 0.060609353706240654, + 0.0, + 0.0387895442545414, + 1.21896668151021, + 0.16401323676109314, + 0.0, + 0.0, + 0.16838984191417694, + 0.0, + 0.0, + 0.127838134765625, + 0.02351939119398594, + 0.174161059781909, + 0.0, + 1.0622651316225529, + 0.0, + 0.12210140749812126, + 0.0, + 0.11834211274981499, + 0.4154531806707382, + 0.3932219874113798, + 0.08813598938286304 + ], + "unique_experts": 45, + "load_cv": 1.1629475331773722, + "normalized_load_entropy": 0.8485525212950175, + "max_load_share": 0.08695652173913043 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "af78a94edb21b00b5be0f2165b207e0c441f1e2d01b813717fc4c09107997ead", + "route_weight_sha256": "a79ef0a60871f9faea5791818a2f78ce4ca66cc27c5619fca2dbe485793f712d", + "loads": [ + 6, + 2, + 1, + 5, + 9, + 0, + 1, + 3, + 5, + 9, + 10, + 7, + 1, + 7, + 23, + 7, + 1, + 9, + 2, + 0, + 1, + 7, + 8, + 0, + 8, + 5, + 14, + 11, + 0, + 5, + 13, + 3, + 5, + 0, + 12, + 2, + 18, + 6, + 3, + 5, + 5, + 0, + 4, + 5, + 2, + 13, + 7, + 1, + 1, + 4, + 8, + 1, + 9, + 3, + 6, + 2, + 27, + 9, + 12, + 6, + 6, + 4, + 10, + 5 + ], + "weighted_loads": [ + 0.3413659129291773, + 0.07081000506877899, + 0.032288916409015656, + 0.18238353915512562, + 0.8635681420564651, + 0.0, + 0.040786389261484146, + 0.18572822585701942, + 0.4377993308007717, + 0.4561891481280327, + 1.1413592919707298, + 0.6123855500482023, + 0.17285512387752533, + 0.7852104194462299, + 1.4842874746536836, + 0.41780391708016396, + 0.05828743800520897, + 0.6152724488638341, + 0.07060903497040272, + 0.0, + 0.03847998380661011, + 0.4179427698254585, + 0.5725566819310188, + 0.0, + 0.3714464884251356, + 0.2053037080913782, + 1.5183169953525066, + 0.4176680650562048, + 0.0, + 0.201766949146986, + 1.3420577980577946, + 0.20350661501288414, + 0.21504078432917595, + 0.0, + 0.9626905247569084, + 0.0729471705853939, + 1.0313737355172634, + 0.3670691028237343, + 0.2855694591999054, + 0.24838648363947868, + 0.3132224828004837, + 0.0, + 0.14689498208463192, + 0.2327990084886551, + 0.09222032502293587, + 1.2363423630595207, + 0.4412990100681782, + 0.041388072073459625, + 0.03604961559176445, + 1.3040574453771114, + 0.3504122458398342, + 0.0676291361451149, + 0.8364870399236679, + 0.2160061988979578, + 0.38761444576084614, + 0.11882156878709793, + 2.922935888171196, + 0.7313631265424192, + 0.6990278214216232, + 0.263803843408823, + 0.3640779811539687, + 0.4154531806707382, + 0.5200157389044762, + 0.23708044923841953 + ], + "unique_experts": 58, + "load_cv": 0.8789592962387078, + "normalized_load_entropy": 0.9119522633531065, + "max_load_share": 0.0703125 + } + }, + "s0_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "25d97615f3ebbfb2946b58787df5d6402eca28b2ba7909bf068f08f33fd11f80", + "route_weight_sha256": "041e1cf32be9fabf07d0d6da65c507df9fc367884174369505bf6ad83b597510", + "loads": [ + 5, + 1, + 1, + 3, + 6, + 0, + 0, + 1, + 5, + 3, + 3, + 0, + 0, + 6, + 9, + 2, + 1, + 2, + 1, + 0, + 1, + 1, + 1, + 0, + 2, + 3, + 1, + 0, + 0, + 2, + 4, + 2, + 0, + 1, + 4, + 2, + 7, + 1, + 0, + 4, + 4, + 0, + 3, + 0, + 0, + 11, + 3, + 0, + 0, + 1, + 0, + 0, + 1, + 1, + 3, + 0, + 7, + 0, + 1, + 0, + 3, + 3, + 8, + 4 + ], + "weighted_loads": [ + 0.2961161192506552, + 0.02156331017613411, + 0.036853548139333725, + 0.12119892612099648, + 0.72744220495224, + 0.0, + 0.0, + 0.04355306178331375, + 0.433999240398407, + 0.10495895892381668, + 0.4140069782733917, + 0.0, + 0.0, + 0.7217543348670006, + 0.7180558405816555, + 0.1092505045235157, + 0.0612342394888401, + 0.0723950956016779, + 0.02059912495315075, + 0.0, + 0.038820378482341766, + 0.06399853527545929, + 0.07775555551052094, + 0.0, + 0.08895934000611305, + 0.09653189778327942, + 0.07409129291772842, + 0.0, + 0.0, + 0.10991581529378891, + 0.20276011899113655, + 0.1257089227437973, + 0.0, + 0.0377129428088665, + 0.39088407903909683, + 0.07596152275800705, + 0.40434926748275757, + 0.07100917398929596, + 0.0, + 0.21192005649209023, + 0.3197909705340862, + 0.0, + 0.08856577053666115, + 0.0, + 0.0, + 1.2445945404469967, + 0.1694379858672619, + 0.0, + 0.0, + 0.171452596783638, + 0.0, + 0.0, + 0.12072889506816864, + 0.023971937596797943, + 0.18120289221405983, + 0.0, + 1.0664156377315521, + 0.0, + 0.09516360610723495, + 0.0, + 0.11716664209961891, + 0.37095529586076736, + 0.4185058381408453, + 0.19011217169463634 + ], + "unique_experts": 44, + "load_cv": 1.14254016368129, + "normalized_load_entropy": 0.8478955493135159, + "max_load_share": 0.07971014492753623 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "9a8329c3dac56a1197989a59249b55660048ba85eda439aaee59b6ab6b01e590", + "route_weight_sha256": "fbf228b60d9912b5b9870323e91a99f9a76a13b434072b1863a3155c520a677a", + "loads": [ + 5, + 2, + 1, + 5, + 6, + 1, + 1, + 2, + 5, + 7, + 6, + 5, + 1, + 7, + 22, + 4, + 1, + 13, + 1, + 0, + 1, + 2, + 2, + 0, + 6, + 3, + 7, + 9, + 0, + 3, + 12, + 2, + 2, + 1, + 10, + 2, + 13, + 1, + 0, + 5, + 4, + 1, + 5, + 4, + 3, + 11, + 5, + 0, + 1, + 1, + 8, + 1, + 4, + 1, + 4, + 0, + 22, + 6, + 8, + 1, + 3, + 3, + 9, + 7 + ], + "weighted_loads": [ + 0.2961161192506552, + 0.06278282776474953, + 0.036853548139333725, + 0.1992061659693718, + 0.72744220495224, + 0.04909614473581314, + 0.046821098774671555, + 0.07763320207595825, + 0.433999240398407, + 0.32866334170103073, + 0.7999122142791748, + 0.3600804340094328, + 0.14589697122573853, + 0.7794405221939087, + 1.3213155940175056, + 0.22343465313315392, + 0.0612342394888401, + 0.7509153299033642, + 0.02059912495315075, + 0.0, + 0.038820378482341766, + 0.09554003924131393, + 0.11073646694421768, + 0.0, + 0.3005374073982239, + 0.09653189778327942, + 1.02898633107543, + 0.3665564991533756, + 0.0, + 0.1375740934163332, + 1.1277290359139442, + 0.1257089227437973, + 0.08905570581555367, + 0.0377129428088665, + 0.9127084165811539, + 0.07596152275800705, + 0.6859847400337458, + 0.07100917398929596, + 0.0, + 0.2281105313450098, + 0.3197909705340862, + 0.6043413877487183, + 0.1630806364119053, + 0.19343595206737518, + 0.11495630443096161, + 1.2445945404469967, + 0.2823820449411869, + 0.0, + 0.040640588849782944, + 0.171452596783638, + 0.3818158693611622, + 0.059400774538517, + 0.4728788360953331, + 0.023971937596797943, + 0.22757097333669662, + 0.0, + 2.1959408670663834, + 0.37038930505514145, + 0.3751504570245743, + 0.048461418598890305, + 0.11716664209961891, + 0.37095529586076736, + 0.45956730656325817, + 0.35478427074849606 + ], + "unique_experts": 58, + "load_cv": 1.0198644305936566, + "normalized_load_entropy": 0.8920565908960542, + "max_load_share": 0.0763888888888889 + } + }, + "s1_bos": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "64ab9b7f74ff5b368c21490ff4018d01e6e9786d8107db16118cb5a4ac0e25b2", + "route_weight_sha256": "79c0eb0ad7f8e207909e1cb7daf39aa84802205e483c67f6cb8c53cf16b0ed06", + "loads": [ + 5, + 1, + 1, + 1, + 6, + 0, + 0, + 1, + 5, + 3, + 3, + 0, + 0, + 6, + 9, + 2, + 1, + 3, + 1, + 0, + 1, + 1, + 1, + 0, + 3, + 2, + 1, + 1, + 0, + 2, + 4, + 2, + 0, + 2, + 4, + 2, + 9, + 1, + 1, + 3, + 4, + 0, + 3, + 0, + 0, + 11, + 3, + 0, + 0, + 1, + 0, + 0, + 1, + 0, + 3, + 0, + 7, + 0, + 1, + 0, + 3, + 4, + 6, + 3 + ], + "weighted_loads": [ + 0.28788553923368454, + 0.02371259219944477, + 0.03312210366129875, + 0.0606628954410553, + 0.7214601561427116, + 0.0, + 0.0, + 0.042081087827682495, + 0.44421158358454704, + 0.11185756325721741, + 0.4119030609726906, + 0.0, + 0.0, + 0.7272388301789761, + 0.713992316275835, + 0.10967057943344116, + 0.06448297202587128, + 0.10505030676722527, + 0.02011912316083908, + 0.0, + 0.039677828550338745, + 0.0625288113951683, + 0.0786772295832634, + 0.0, + 0.1227735597640276, + 0.08160464465618134, + 0.08706420660018921, + 0.027891822159290314, + 0.0, + 0.1111190989613533, + 0.22197239473462105, + 0.13101398199796677, + 0.0, + 0.05949357524514198, + 0.35989954322576523, + 0.08191115036606789, + 0.48668619617819786, + 0.06670617312192917, + 0.03317449241876602, + 0.17706772685050964, + 0.32043851912021637, + 0.0, + 0.07641065865755081, + 0.0, + 0.0, + 1.2044746354222298, + 0.16055701673030853, + 0.0, + 0.0, + 0.1798803210258484, + 0.0, + 0.0, + 0.12861838936805725, + 0.0, + 0.18202337808907032, + 0.0, + 1.0262791998684406, + 0.0, + 0.08759846538305283, + 0.0, + 0.11586516536772251, + 0.40402813628315926, + 0.3503286000341177, + 0.15892849303781986 + ], + "unique_experts": 45, + "load_cv": 1.1395949932244485, + "normalized_load_entropy": 0.8513466325682646, + "max_load_share": 0.07971014492753623 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "e2c649d22f2e3e5887f73f009e9460b5caab25dbe0ee7398eb98f506ceadd927", + "route_weight_sha256": "8f81e09cba29ab08ec0bf4d8e7ee834be07dfa8ccce8ac4568a0ce213ca79963", + "loads": [ + 5, + 2, + 1, + 1, + 9, + 0, + 1, + 3, + 5, + 10, + 11, + 6, + 1, + 7, + 21, + 8, + 1, + 9, + 1, + 0, + 1, + 7, + 8, + 0, + 10, + 4, + 14, + 10, + 0, + 5, + 15, + 3, + 4, + 3, + 13, + 2, + 21, + 6, + 4, + 4, + 5, + 0, + 7, + 5, + 3, + 12, + 7, + 1, + 1, + 3, + 8, + 1, + 9, + 2, + 6, + 2, + 26, + 8, + 11, + 6, + 5, + 4, + 9, + 7 + ], + "weighted_loads": [ + 0.28788553923368454, + 0.06785189919173717, + 0.03312210366129875, + 0.0606628954410553, + 0.9001199714839458, + 0.0, + 0.04444955661892891, + 0.16532185673713684, + 0.44421158358454704, + 0.5112522356212139, + 1.2799803093075752, + 0.6100977659225464, + 0.1432463526725769, + 0.7818562276661396, + 1.4208524711430073, + 0.4628542400896549, + 0.06448297202587128, + 0.6505907103419304, + 0.02011912316083908, + 0.0, + 0.039677828550338745, + 0.41775114089250565, + 0.5583167336881161, + 0.0, + 0.4462820813059807, + 0.18756001815199852, + 1.653486829251051, + 0.3790330085903406, + 0.0, + 0.21384678035974503, + 1.4780868999660015, + 0.21046440303325653, + 0.17353194579482079, + 0.10502954199910164, + 1.053432509303093, + 0.08191115036606789, + 1.132344700396061, + 0.3702467754483223, + 0.3187439516186714, + 0.21141651272773743, + 0.3509957604110241, + 0.0, + 0.24008053168654442, + 0.2407291978597641, + 0.13851001486182213, + 1.2218503169715405, + 0.43463870510458946, + 0.041388072073459625, + 0.03604961559176445, + 0.3308335952460766, + 0.3512607328593731, + 0.05915720388293266, + 0.8164647817611694, + 0.19248680770397186, + 0.39547676406800747, + 0.11882156878709793, + 2.815460380166769, + 0.7260153852403164, + 0.6645248793065548, + 0.263803843408823, + 0.36066516675055027, + 0.40402813628315926, + 0.47712235152721405, + 0.3606040421873331 + ], + "unique_experts": 59, + "load_cv": 0.8838834764831844, + "normalized_load_entropy": 0.9111518231361971, + "max_load_share": 0.06770833333333333 + } + }, + "s0_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "bc492b7a99fd97f67dcfa6e669ef85c1ebd1b5c0cd924461c572551f1bbe0c7f", + "route_weight_sha256": "da16a89dadf64419550d47e9f3c27ea3f1087c5488337af6fd6247f4c774234e", + "loads": [ + 4, + 0, + 1, + 1, + 6, + 0, + 0, + 1, + 5, + 3, + 3, + 0, + 0, + 7, + 9, + 2, + 1, + 3, + 1, + 0, + 1, + 1, + 1, + 0, + 2, + 2, + 2, + 0, + 0, + 1, + 4, + 2, + 0, + 1, + 4, + 1, + 6, + 1, + 0, + 3, + 4, + 0, + 4, + 0, + 1, + 11, + 3, + 0, + 0, + 1, + 0, + 0, + 1, + 1, + 3, + 0, + 7, + 0, + 2, + 0, + 3, + 4, + 10, + 4 + ], + "weighted_loads": [ + 0.2601852361112833, + 0.0, + 0.0356748141348362, + 0.06259720772504807, + 0.6722005307674408, + 0.0, + 0.0, + 0.04276816174387932, + 0.4404786564409733, + 0.10599820502102375, + 0.3991200253367424, + 0.0, + 0.0, + 0.7554452568292618, + 0.7244028076529503, + 0.10753694176673889, + 0.059373077005147934, + 0.09901701472699642, + 0.021290980279445648, + 0.0, + 0.0425974540412426, + 0.0649133026599884, + 0.07643678784370422, + 0.0, + 0.09169141948223114, + 0.05638573318719864, + 0.09991193749010563, + 0.0, + 0.0, + 0.057220011949539185, + 0.20948366820812225, + 0.1258147992193699, + 0.0, + 0.01979951746761799, + 0.36302364617586136, + 0.03732709586620331, + 0.3435467295348644, + 0.06775835901498795, + 0.0, + 0.17251252755522728, + 0.3043861724436283, + 0.0, + 0.15155382081866264, + 0.0, + 0.03336704149842262, + 1.2007411010563374, + 0.1752835027873516, + 0.0, + 0.0, + 0.13462033867835999, + 0.0, + 0.0, + 0.12391947954893112, + 0.02292126975953579, + 0.18338936753571033, + 0.0, + 0.967532604932785, + 0.0, + 0.1309477724134922, + 0.0, + 0.10883100144565105, + 0.41266921162605286, + 0.5095824170857668, + 0.19472727924585342 + ], + "unique_experts": 44, + "load_cv": 1.180158729654263, + "normalized_load_entropy": 0.8429440209679725, + "max_load_share": 0.07971014492753623 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "9f9078ffd94b754d26700d74ee721079641e49487f7d619922ec216f41530c6b", + "route_weight_sha256": "c59100072a840d2d726c2110c35609d967401622e8e99817f40f48c777b78af4", + "loads": [ + 4, + 1, + 1, + 2, + 6, + 0, + 1, + 2, + 5, + 6, + 7, + 7, + 1, + 8, + 23, + 4, + 1, + 16, + 1, + 0, + 1, + 2, + 1, + 0, + 6, + 2, + 8, + 8, + 0, + 2, + 10, + 2, + 2, + 2, + 9, + 1, + 12, + 1, + 0, + 3, + 4, + 0, + 6, + 6, + 2, + 11, + 5, + 0, + 0, + 1, + 8, + 1, + 4, + 1, + 4, + 0, + 26, + 7, + 9, + 1, + 3, + 4, + 11, + 6 + ], + "weighted_loads": [ + 0.2601852361112833, + 0.042061951011419296, + 0.0356748141348362, + 0.10111651197075844, + 0.6722005307674408, + 0.0, + 0.04270448908209801, + 0.07684830203652382, + 0.4404786564409733, + 0.29065639711916447, + 0.7809240818023682, + 0.5079126004129648, + 0.1503172069787979, + 0.8131314441561699, + 1.4305419214069843, + 0.20247362554073334, + 0.059373077005147934, + 0.9147877357900143, + 0.021290980279445648, + 0.0, + 0.0425974540412426, + 0.09645480662584305, + 0.07643678784370422, + 0.0, + 0.3040880858898163, + 0.05638573318719864, + 0.9399036224931479, + 0.3105562999844551, + 0.0, + 0.1058359146118164, + 0.9938906691968441, + 0.1258147992193699, + 0.08515751361846924, + 0.046939387917518616, + 0.8159315437078476, + 0.03732709586620331, + 0.6352452877908945, + 0.06775835901498795, + 0.0, + 0.17251252755522728, + 0.3043861724436283, + 0.0, + 0.2174578532576561, + 0.3332965560257435, + 0.06942066177725792, + 1.2007411010563374, + 0.27520371600985527, + 0.0, + 0.0, + 0.13462033867835999, + 0.37793755158782005, + 0.059505395591259, + 0.46307872235774994, + 0.02292126975953579, + 0.22975744865834713, + 0.0, + 2.321247424930334, + 0.4803176149725914, + 0.4109346233308315, + 0.048461418598890305, + 0.10883100144565105, + 0.41266921162605286, + 0.5506438855081797, + 0.27903030812740326 + ], + "unique_experts": 55, + "load_cv": 1.1269701541722663, + "normalized_load_entropy": 0.8718390664459055, + "max_load_share": 0.09027777777777778 + } + }, + "s1_x": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "28a38c8b1417cddb0df7fd829a80777dbb2a22157f249f4a0715f75cf0385c91", + "route_weight_sha256": "b9481a0d6863e9b3df0f553a59a03ea12a94cfdcf0cf1b79afebd53a046ba581", + "loads": [ + 4, + 0, + 1, + 1, + 7, + 0, + 0, + 1, + 5, + 3, + 3, + 1, + 0, + 6, + 9, + 2, + 1, + 1, + 0, + 0, + 1, + 1, + 1, + 0, + 2, + 2, + 1, + 2, + 0, + 2, + 4, + 2, + 0, + 1, + 4, + 2, + 9, + 1, + 2, + 3, + 4, + 0, + 1, + 0, + 1, + 10, + 3, + 0, + 0, + 1, + 0, + 0, + 1, + 0, + 2, + 0, + 8, + 1, + 2, + 0, + 3, + 4, + 8, + 4 + ], + "weighted_loads": [ + 0.23706550523638725, + 0.0, + 0.030565794557332993, + 0.056222300976514816, + 0.6495399214327335, + 0.0, + 0.0, + 0.041903525590896606, + 0.44476526975631714, + 0.11824847757816315, + 0.36662355065345764, + 0.023168453946709633, + 0.0, + 0.7384253889322281, + 0.7012666389346123, + 0.10510845109820366, + 0.056455355137586594, + 0.04482678323984146, + 0.0, + 0.0, + 0.04310011863708496, + 0.0647551566362381, + 0.07726192474365234, + 0.0, + 0.08420855551958084, + 0.0669158324599266, + 0.10489828884601593, + 0.059439098462462425, + 0.0, + 0.10335060209035873, + 0.22235574200749397, + 0.1245548203587532, + 0.0, + 0.020887155085802078, + 0.32804668322205544, + 0.0730181634426117, + 0.4941268637776375, + 0.06072016805410385, + 0.05684808827936649, + 0.18773826956748962, + 0.29089778661727905, + 0.0, + 0.0316651426255703, + 0.0, + 0.034042466431856155, + 1.1169225797057152, + 0.1516190953552723, + 0.0, + 0.0, + 0.1394771784543991, + 0.0, + 0.0, + 0.13742712140083313, + 0.0, + 0.15435482561588287, + 0.0, + 0.9860002361238003, + 0.02386465109884739, + 0.12314246222376823, + 0.0, + 0.11910594813525677, + 0.41915014386177063, + 0.44208393804728985, + 0.1787567026913166 + ], + "unique_experts": 46, + "load_cv": 1.1600541745456103, + "normalized_load_entropy": 0.8504264572663863, + "max_load_share": 0.07246376811594203 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "ebf5e9b60399470cfbdb8f4886e3ecf10ef596b3387626faa2b4219afe33e180", + "route_weight_sha256": "8f1af5fd20f22c0c49893c411874358fab6ef0b207eb806d58340712ac6b9d69", + "loads": [ + 4, + 1, + 1, + 1, + 10, + 0, + 0, + 2, + 5, + 9, + 11, + 9, + 1, + 7, + 23, + 7, + 1, + 7, + 0, + 0, + 1, + 7, + 7, + 0, + 9, + 4, + 13, + 13, + 0, + 6, + 13, + 3, + 4, + 1, + 12, + 2, + 21, + 6, + 5, + 4, + 5, + 0, + 3, + 5, + 3, + 11, + 6, + 1, + 1, + 3, + 8, + 1, + 9, + 2, + 5, + 2, + 31, + 12, + 13, + 7, + 5, + 4, + 11, + 6 + ], + "weighted_loads": [ + 0.23706550523638725, + 0.044590312987565994, + 0.030565794557332993, + 0.056222300976514816, + 0.8281997367739677, + 0.0, + 0.0, + 0.13080772757530212, + 0.44476526975631714, + 0.47046006470918655, + 1.241708267480135, + 0.7899120692163706, + 0.09340828657150269, + 0.7930427864193916, + 1.5628173537552357, + 0.4174487926065922, + 0.056455355137586594, + 0.6264459155499935, + 0.0, + 0.0, + 0.04310011863708496, + 0.41997748613357544, + 0.5211075805127621, + 0.0, + 0.4016293678432703, + 0.1728712059557438, + 1.568585593253374, + 0.4882132187485695, + 0.0, + 0.27329888194799423, + 1.2695822156965733, + 0.20400524139404297, + 0.17726411670446396, + 0.020887155085802078, + 0.9348488859832287, + 0.0730181634426117, + 1.1650488302111626, + 0.364260770380497, + 0.3424175474792719, + 0.2220870554447174, + 0.3214550279080868, + 0.0, + 0.11395595595240593, + 0.2313973307609558, + 0.09752356633543968, + 1.1342982612550259, + 0.37748805060982704, + 0.041388072073459625, + 0.03604961559176445, + 0.2904304526746273, + 0.3439922630786896, + 0.05431777611374855, + 0.8155836537480354, + 0.19248680770397186, + 0.36780821159482, + 0.11882156878709793, + 2.924218352884054, + 0.9299817550927401, + 0.7639324888586998, + 0.3087324947118759, + 0.3639059495180845, + 0.41915014386177063, + 0.5688776895403862, + 0.27071307972073555 + ], + "unique_experts": 57, + "load_cv": 0.9709316831442537, + "normalized_load_entropy": 0.896779398616229, + "max_load_share": 0.08072916666666667 + } + }, + "s0_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "c869cb40a722cdf4ccca392345726b746888e65780085358bf05d0c0a412d34d", + "route_weight_sha256": "8afecd0b3a2b9f938cd75d403338b8b42bbe0246ea08c639ccbe24ccf448d1f6", + "loads": [ + 6, + 1, + 1, + 1, + 6, + 0, + 0, + 1, + 5, + 3, + 3, + 0, + 0, + 6, + 9, + 2, + 1, + 3, + 1, + 0, + 1, + 1, + 1, + 0, + 1, + 2, + 2, + 0, + 0, + 1, + 4, + 2, + 0, + 1, + 4, + 1, + 8, + 1, + 0, + 4, + 4, + 0, + 3, + 0, + 0, + 12, + 3, + 0, + 0, + 1, + 0, + 0, + 1, + 1, + 3, + 0, + 7, + 0, + 2, + 0, + 2, + 4, + 8, + 4 + ], + "weighted_loads": [ + 0.3412384148687124, + 0.02338404767215252, + 0.03768271207809448, + 0.06804896891117096, + 0.6736992783844471, + 0.0, + 0.0, + 0.04304535314440727, + 0.4355170875787735, + 0.10860103741288185, + 0.39273112639784813, + 0.0, + 0.0, + 0.7204376757144928, + 0.7168295569717884, + 0.10967544838786125, + 0.06068755313754082, + 0.10225787572562695, + 0.022100072354078293, + 0.0, + 0.037894658744335175, + 0.063275545835495, + 0.07649114727973938, + 0.0, + 0.053588274866342545, + 0.05892770737409592, + 0.10540265403687954, + 0.0, + 0.0, + 0.05329566076397896, + 0.2238016128540039, + 0.12663909420371056, + 0.0, + 0.019041333347558975, + 0.37913910299539566, + 0.03802355378866196, + 0.40446456521749496, + 0.0682641863822937, + 0.0, + 0.20888493582606316, + 0.29744551330804825, + 0.0, + 0.1123549584299326, + 0.0, + 0.0, + 1.2451504915952682, + 0.17566019296646118, + 0.0, + 0.0, + 0.1310400366783142, + 0.0, + 0.0, + 0.12259876728057861, + 0.02582460641860962, + 0.1827879548072815, + 0.0, + 0.9770645573735237, + 0.0, + 0.13235831260681152, + 0.0, + 0.07119558937847614, + 0.41648726537823677, + 0.4431377649307251, + 0.20053354278206825 + ], + "unique_experts": 44, + "load_cv": 1.1999264837804149, + "normalized_load_entropy": 0.8395020834045303, + "max_load_share": 0.08695652173913043 + }, + "full_input": { + "tokens": 48, + "top_k": 6, + "decisions": 288, + "ordered_route_sha256": "742e71d1c94c837e134dc8b06456c03d28ecaa5dce9330426e51ee0687c048fe", + "route_weight_sha256": "813e723607b41d847255a5a9cc0f1b967f7f506cb731f9de76817dcd71f125c3", + "loads": [ + 6, + 2, + 1, + 3, + 6, + 1, + 1, + 2, + 5, + 6, + 7, + 5, + 1, + 7, + 23, + 3, + 1, + 15, + 1, + 0, + 1, + 2, + 1, + 0, + 6, + 2, + 7, + 8, + 0, + 1, + 12, + 2, + 3, + 1, + 9, + 1, + 15, + 1, + 0, + 4, + 4, + 0, + 5, + 4, + 2, + 12, + 6, + 0, + 1, + 1, + 8, + 1, + 5, + 1, + 4, + 0, + 24, + 6, + 9, + 1, + 2, + 4, + 9, + 7 + ], + "weighted_loads": [ + 0.3412384148687124, + 0.06988677196204662, + 0.03768271207809448, + 0.14606836438179016, + 0.6736992783844471, + 0.045319363474845886, + 0.038090549409389496, + 0.07712549343705177, + 0.4355170875787735, + 0.29325922951102257, + 0.7615257911384106, + 0.3600804340094328, + 0.14696112275123596, + 0.7781238630414009, + 1.360174622386694, + 0.1661328263580799, + 0.06068755313754082, + 0.8865665793418884, + 0.022100072354078293, + 0.0, + 0.037894658744335175, + 0.09481704980134964, + 0.07649114727973938, + 0.0, + 0.35334739089012146, + 0.05892770737409592, + 0.9687589574605227, + 0.31947270408272743, + 0.0, + 0.05329566076397896, + 1.0742115322500467, + 0.12663909420371056, + 0.11835932359099388, + 0.019041333347558975, + 0.8413430489599705, + 0.03802355378866196, + 0.7500383350998163, + 0.0682641863822937, + 0.0, + 0.20888493582606316, + 0.29744551330804825, + 0.0, + 0.18178375996649265, + 0.23578347265720367, + 0.0797591395676136, + 1.2451504915952682, + 0.3199060223996639, + 0.0, + 0.037310462445020676, + 0.1310400366783142, + 0.37547020241618156, + 0.05691053718328476, + 0.5394887030124664, + 0.02582460641860962, + 0.2291560359299183, + 0.0, + 2.307836625725031, + 0.37038930505514145, + 0.41234516352415085, + 0.048461418598890305, + 0.07119558937847614, + 0.41648726537823677, + 0.48419923335313797, + 0.3698202669620514 + ], + "unique_experts": 57, + "load_cv": 1.1048434334084078, + "normalized_load_entropy": 0.877115607775723, + "max_load_share": 0.08333333333333333 + } + }, + "s1_period": { + "target_content": { + "tokens": 23, + "top_k": 6, + "decisions": 138, + "ordered_route_sha256": "a29a363b88876de511b852f1d3846e41b8be78c979f8d37b0a9af7374782759a", + "route_weight_sha256": "acbc95b655a98d578dc7cc79071b198a26cd472d2822d53c70f8a3f661f94aa0", + "loads": [ + 4, + 0, + 1, + 1, + 7, + 0, + 0, + 1, + 5, + 3, + 3, + 0, + 0, + 6, + 9, + 2, + 1, + 1, + 0, + 0, + 1, + 1, + 1, + 0, + 1, + 2, + 2, + 1, + 0, + 1, + 4, + 2, + 0, + 1, + 4, + 3, + 9, + 1, + 2, + 3, + 4, + 0, + 2, + 0, + 1, + 11, + 3, + 0, + 0, + 1, + 0, + 0, + 1, + 0, + 3, + 0, + 8, + 0, + 3, + 0, + 3, + 4, + 7, + 4 + ], + "weighted_loads": [ + 0.24075752682983875, + 0.0, + 0.032725099474191666, + 0.060815855860710144, + 0.6621837932616472, + 0.0, + 0.0, + 0.042363088577985764, + 0.4559270218014717, + 0.1246480718255043, + 0.36353589594364166, + 0.0, + 0.0, + 0.7637051492929459, + 0.7130629681050777, + 0.10221540182828903, + 0.05649765208363533, + 0.04184791073203087, + 0.0, + 0.0, + 0.03673449531197548, + 0.06712312996387482, + 0.07675977796316147, + 0.0, + 0.04447293281555176, + 0.06725423410534859, + 0.1500832438468933, + 0.031007306650280952, + 0.0, + 0.04989789053797722, + 0.22969497740268707, + 0.12572821229696274, + 0.0, + 0.01975688897073269, + 0.36771781742572784, + 0.09583376161754131, + 0.4893810413777828, + 0.06076868996024132, + 0.05671144835650921, + 0.19483906775712967, + 0.2953285202383995, + 0.0, + 0.05515892244875431, + 0.0, + 0.03521700203418732, + 1.1741550639271736, + 0.15121972933411598, + 0.0, + 0.0, + 0.11708522588014603, + 0.0, + 0.0, + 0.14399367570877075, + 0.0, + 0.17413180693984032, + 0.0, + 0.9136986453086138, + 0.0, + 0.16466658934950829, + 0.0, + 0.12059816531836987, + 0.41779452562332153, + 0.41471805050969124, + 0.1884013656526804 + ], + "unique_experts": 44, + "load_cv": 1.1830029180952184, + "normalized_load_entropy": 0.8422735420284271, + "max_load_share": 0.07971014492753623 + }, + "full_input": { + "tokens": 64, + "top_k": 6, + "decisions": 384, + "ordered_route_sha256": "56dc78fc91a5b9ec64fb0f220ad94edb7670dd0ae2c38b74b376ab4bba348954", + "route_weight_sha256": "77bd8a9dd47b37eab8c173a3d2534fbe38830454e0340049fb5f2543d368f2ba", + "loads": [ + 4, + 1, + 1, + 1, + 10, + 0, + 0, + 3, + 5, + 9, + 11, + 6, + 1, + 7, + 22, + 7, + 1, + 7, + 0, + 0, + 1, + 7, + 7, + 0, + 9, + 4, + 14, + 11, + 0, + 4, + 13, + 3, + 5, + 1, + 12, + 3, + 22, + 7, + 5, + 4, + 5, + 0, + 5, + 5, + 1, + 12, + 7, + 1, + 2, + 3, + 8, + 1, + 11, + 2, + 7, + 2, + 30, + 8, + 13, + 6, + 5, + 4, + 10, + 8 + ], + "weighted_loads": [ + 0.24075752682983875, + 0.0403965599834919, + 0.032725099474191666, + 0.060815855860710144, + 0.8408436086028814, + 0.0, + 0.0, + 0.16002226248383522, + 0.4559270218014717, + 0.4768596589565277, + 1.2415190562605858, + 0.6100977659225464, + 0.07548926025629044, + 0.8183225467801094, + 1.5164749883115292, + 0.4078553095459938, + 0.05649765208363533, + 0.6341851949691772, + 0.0, + 0.0, + 0.03673449531197548, + 0.42234545946121216, + 0.5206054337322712, + 0.0, + 0.4358446281403303, + 0.17320960760116577, + 1.6373671777546406, + 0.4135570526123047, + 0.0, + 0.15262557193636894, + 1.3060853257775307, + 0.2051786333322525, + 0.2003135047852993, + 0.01975688897073269, + 0.9694141000509262, + 0.09583376161754131, + 1.202965622767806, + 0.3985835649073124, + 0.3422809075564146, + 0.22918785363435745, + 0.32588576152920723, + 0.0, + 0.16636633314192295, + 0.269030075520277, + 0.03521700203418732, + 1.1915307454764843, + 0.40783677995204926, + 0.041388072073459625, + 0.06806696951389313, + 0.2680385001003742, + 0.3382811024785042, + 0.05015100538730621, + 0.9160325825214386, + 0.19248680770397186, + 0.4294876977801323, + 0.11882156878709793, + 2.8667773082852364, + 0.7260153852403164, + 0.7415930032730103, + 0.263803843408823, + 0.3653981667011976, + 0.41779452562332153, + 0.5415118020027876, + 0.4135851487517357 + ], + "unique_experts": 57, + "load_cv": 0.9501461875826149, + "normalized_load_entropy": 0.8999450847562994, + "max_load_share": 0.078125 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 23, + "ordered_topk_exact_tokens": 17, + "set_exact_tokens": 20, + "mean_set_jaccard": 0.9534161490683231, + "mean_token_weighted_tv": 0.014523540663978329, + "aggregate_load_tv": 0.02898550724637681 + }, + "system_bos": { + "tokens": 23, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8881987577639753, + "mean_token_weighted_tv": 0.024163362570106983, + "aggregate_load_tv": 0.05797101449275362 + }, + "system_x": { + "tokens": 23, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 12, + "mean_set_jaccard": 0.8260869565217391, + "mean_token_weighted_tv": 0.035880224495802235, + "aggregate_load_tv": 0.09420289855072463 + }, + "system_period": { + "tokens": 23, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 11, + "mean_set_jaccard": 0.8416149068322983, + "mean_token_weighted_tv": 0.036493701212432075, + "aggregate_load_tv": 0.07971014492753623 + }, + "bos_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.9130434782608695, + "mean_token_weighted_tv": 0.02284828488431547, + "aggregate_load_tv": 0.03623188405797102 + }, + "bos_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 12, + "mean_set_jaccard": 0.8633540372670808, + "mean_token_weighted_tv": 0.029674781081469162, + "aggregate_load_tv": 0.07971014492753624 + }, + "x_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8881987577639753, + "mean_token_weighted_tv": 0.02421450343630884, + "aggregate_load_tv": 0.05797101449275363 + }, + "x_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 11, + "mean_set_jaccard": 0.8157349896480331, + "mean_token_weighted_tv": 0.03705750988877338, + "aggregate_load_tv": 0.10144927536231885 + }, + "period_at_s0": { + "tokens": 23, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.888198757763975, + "mean_token_weighted_tv": 0.024295102399976357, + "aggregate_load_tv": 0.050724637681159424 + }, + "period_at_s1": { + "tokens": 23, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 11, + "mean_set_jaccard": 0.8509316770186336, + "mean_token_weighted_tv": 0.03510335274040699, + "aggregate_load_tv": 0.07246376811594203 + } + } + } + } + }, + { + "id": "tnews/test/3448", + "domain": "chinese", + "label": "中文新闻", + "within_domain_index": 2, + "selection_rank": "001d2b482c8c5d11c08d0fe0d5ce8421759f1ae362e4d6ab339a98cbcf893e3d", + "source_text_sha256": "52325a330490c0bb46eabd76e188e670a81914b32fe111a3a8663670be24ac95", + "source_characters": 30, + "source_tokens": 24, + "content_token_ids_sha256": "748d2e221574cdfad884a87d0ff65bd770188bac3f4947d9df50fd2727ec2353", + "prompt_tokens_by_condition": { + "s0_eos": 49, + "s1_eos": 65, + "s0_bos": 49, + "s1_bos": 65, + "s0_x": 49, + "s1_x": 65, + "s0_period": 49, + "s1_period": 65 + }, + "batch_prompt_tokens": 65, + "content_tokens": 24, + "boundary_crossing_tokens_by_condition": { + "s0_eos": 0, + "s1_eos": 0, + "s0_bos": 0, + "s1_bos": 0, + "s0_x": 0, + "s1_x": 0, + "s0_period": 0, + "s1_period": 0 + }, + "forward_seconds": 0.6300255710084457, + "peak_cuda_memory_allocated_bytes": 27586959872, + "hidden_stages": { + "embedding": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0463215cbedb609fd09f91acc5eee9bba881c28e1fa7fe92342a4a61394a89df", + "mean": -0.0011157173430547118, + "std": 0.11446985602378845, + "rms": 0.1144752949476242, + "max_abs": 2.015625 + }, + "full_input": { + "shape": [ + 49, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a437636b9180b3f7bc5f6eb9bf73c147cca93f8210a27ea6847080654da6a2dc", + "mean": -0.0010247108293697238, + "std": 0.10062135756015778, + "rms": 0.10062658041715622, + "max_abs": 2.046875 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0463215cbedb609fd09f91acc5eee9bba881c28e1fa7fe92342a4a61394a89df", + "mean": -0.0011157173430547118, + "std": 0.11446985602378845, + "rms": 0.1144752949476242, + "max_abs": 2.015625 + }, + "full_input": { + "shape": [ + 65, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b5eb121dccbd68f8798e00179fbe3f673a964e6e675dda6f8e65321efcda13a0", + "mean": -0.001313293119892478, + "std": 0.10165585577487946, + "rms": 0.10166433453559875, + "max_abs": 2.046875 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0463215cbedb609fd09f91acc5eee9bba881c28e1fa7fe92342a4a61394a89df", + "mean": -0.0011157173430547118, + "std": 0.11446985602378845, + "rms": 0.1144752949476242, + "max_abs": 2.015625 + }, + "full_input": { + "shape": [ + 49, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f5e48d3c26103f4a6cf3899bea53d9bf9f1990be06533b555223cd77a117f981", + "mean": -0.0009934210684150457, + "std": 0.10024169087409973, + "rms": 0.1002466157078743, + "max_abs": 2.046875 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0463215cbedb609fd09f91acc5eee9bba881c28e1fa7fe92342a4a61394a89df", + "mean": -0.0011157173430547118, + "std": 0.11446985602378845, + "rms": 0.1144752949476242, + "max_abs": 2.015625 + }, + "full_input": { + "shape": [ + 65, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "03cfbc0132014d47482ae1cb1794344b807721d0b22ba65c684fc922605e753c", + "mean": -0.0012897055130451918, + "std": 0.10137276351451874, + "rms": 0.10138095915317535, + "max_abs": 2.046875 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0463215cbedb609fd09f91acc5eee9bba881c28e1fa7fe92342a4a61394a89df", + "mean": -0.0011157173430547118, + "std": 0.11446985602378845, + "rms": 0.1144752949476242, + "max_abs": 2.015625 + }, + "full_input": { + "shape": [ + 49, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "009e643ae4316055c21fb73082c1295d9cbae89c9d8b3657fe8d38119bb9be22", + "mean": -0.0010702060535550117, + "std": 0.10049757361412048, + "rms": 0.10050327330827713, + "max_abs": 2.046875 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0463215cbedb609fd09f91acc5eee9bba881c28e1fa7fe92342a4a61394a89df", + "mean": -0.0011157173430547118, + "std": 0.11446985602378845, + "rms": 0.1144752949476242, + "max_abs": 2.015625 + }, + "full_input": { + "shape": [ + 65, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d79e3db2cf0e0fe203c8bab9746d8805d69b93476d2c4aa177c4ff4f1787afca", + "mean": -0.0013475896557793021, + "std": 0.10156340897083282, + "rms": 0.10157234221696854, + "max_abs": 2.046875 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0463215cbedb609fd09f91acc5eee9bba881c28e1fa7fe92342a4a61394a89df", + "mean": -0.0011157173430547118, + "std": 0.11446985602378845, + "rms": 0.1144752949476242, + "max_abs": 2.015625 + }, + "full_input": { + "shape": [ + 49, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9eb0273721d394eecbcc7c0396aadded3f79ba7df2fd65d30ffbeb3f02d8c407", + "mean": -0.001071861945092678, + "std": 0.10020579397678375, + "rms": 0.10021153092384338, + "max_abs": 2.046875 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0463215cbedb609fd09f91acc5eee9bba881c28e1fa7fe92342a4a61394a89df", + "mean": -0.0011157173430547118, + "std": 0.11446985602378845, + "rms": 0.1144752949476242, + "max_abs": 2.015625 + }, + "full_input": { + "shape": [ + 65, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "56fb75b5e12d66c6f5acd2f7ccfcb88ae0f68e9673c3e43ee6844b35a4ecbc26", + "mean": -0.0013488378608599305, + "std": 0.10134584456682205, + "rms": 0.10135480761528015, + "max_abs": 2.046875 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 24, + "exact_hidden_rows": 24, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999998211860657, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "system_bos": { + "tokens": 24, + "exact_hidden_rows": 24, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999998211860657, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "system_x": { + "tokens": 24, + "exact_hidden_rows": 24, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999998211860657, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "system_period": { + "tokens": 24, + "exact_hidden_rows": 24, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999998211860657, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "bos_at_s0": { + "tokens": 24, + "exact_hidden_rows": 24, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999998211860657, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "bos_at_s1": { + "tokens": 24, + "exact_hidden_rows": 24, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999998211860657, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "x_at_s0": { + "tokens": 24, + "exact_hidden_rows": 24, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999998211860657, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "x_at_s1": { + "tokens": 24, + "exact_hidden_rows": 24, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999998211860657, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "period_at_s0": { + "tokens": 24, + "exact_hidden_rows": 24, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999998211860657, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "period_at_s1": { + "tokens": 24, + "exact_hidden_rows": 24, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999998211860657, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + } + } + }, + "layer_00": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "11f22665bc48a8fe8e912f9bc6896a5b74554915068d433ae8a6335b7b999c95", + "mean": -0.0020768186077475548, + "std": 0.10496916621923447, + "rms": 0.10498970746994019, + "max_abs": 2.359375 + }, + "full_input": { + "shape": [ + 49, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6c3289181391d7184db6d6c9416b3718616b6a4ef179618c7879154241980944", + "mean": -0.001805818174034357, + "std": 0.09736556559801102, + "rms": 0.0973823070526123, + "max_abs": 2.4375 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "92db81baef050e13c2c8383377a3734fbb485782aa250bd24fc84914aa657c6f", + "mean": -0.0020998353138566017, + "std": 0.10498154163360596, + "rms": 0.10500253736972809, + "max_abs": 2.375 + }, + "full_input": { + "shape": [ + 65, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8fb8098581a0f924ada6fd980f7e85736342430d50e7b9f3e711d806d8698059", + "mean": -0.0019392527174204588, + "std": 0.0975349172949791, + "rms": 0.09755419194698334, + "max_abs": 2.4375 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "77366d466e45411831d98ec1f51937bdf30c087cba65708200774aa592fb680f", + "mean": -0.002062553772702813, + "std": 0.10296101868152618, + "rms": 0.10298167914152145, + "max_abs": 2.328125 + }, + "full_input": { + "shape": [ + 49, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c742d09aee3394afb5312b55b2545a7f206ed7280c1a7cbb8dcdab223bb24ce9", + "mean": -0.00175280321855098, + "std": 0.09573370218276978, + "rms": 0.09574974328279495, + "max_abs": 2.4375 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a5b4fb2a80ceb94ce5b881029928603a3d773d7a5beaa22fbded3285b23e3598", + "mean": -0.0020872275345027447, + "std": 0.10293937474489212, + "rms": 0.10296053439378738, + "max_abs": 2.359375 + }, + "full_input": { + "shape": [ + 65, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6088f5865a5adb3d73986316437b474fc04901365f2f1a5f0c6793f0364f5a9a", + "mean": -0.0019003680208697915, + "std": 0.09628884494304657, + "rms": 0.09630759060382843, + "max_abs": 2.4375 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "406ade9af9018558724a70f2db4686cd7658ce17cbb585d61fe6204d261dd62f", + "mean": -0.0020618371199816465, + "std": 0.10266575217247009, + "rms": 0.10268645733594894, + "max_abs": 2.328125 + }, + "full_input": { + "shape": [ + 49, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1b60ba7155d668cd48778e085fbaef5a21eddb1861d51a78a23a50f1cd78fac7", + "mean": -0.0017972751520574093, + "std": 0.09585238993167877, + "rms": 0.09586923569440842, + "max_abs": 2.4375 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6e76a9fb28ce293694389d7a13dd6c9a50e8f0c2ed26b2fa346700764748f083", + "mean": -0.002091348171234131, + "std": 0.10271596163511276, + "rms": 0.10273724794387817, + "max_abs": 2.359375 + }, + "full_input": { + "shape": [ + 65, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a80168be04083d61ce06eab1541cc842f3b32ab9336d51d7572a2f4128972f67", + "mean": -0.001942899776622653, + "std": 0.09644259512424469, + "rms": 0.09646216034889221, + "max_abs": 2.4375 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9497178465ce54182533729dc4b530f953311923e3c39e8b3fcd4e1fa845897d", + "mean": -0.002063932130113244, + "std": 0.10283564776182175, + "rms": 0.1028563529253006, + "max_abs": 2.34375 + }, + "full_input": { + "shape": [ + 49, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "214133c3cbbd32356aaba65d17196dc7eebe869910869de893a3113f2e5d74a7", + "mean": -0.0017974599031731486, + "std": 0.09547248482704163, + "rms": 0.09548940509557724, + "max_abs": 2.4375 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ad5f1fe8b855c75abf2a9a9eb696c64c94309fd8a80f5fd0c80c9820033cc997", + "mean": -0.0020955195650458336, + "std": 0.10285037755966187, + "rms": 0.10287172347307205, + "max_abs": 2.34375 + }, + "full_input": { + "shape": [ + 65, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b3bd2ecb04c2e3d49bcfec97dbf0272aefbf44ad7f4b427e8b0c9e652b0c211e", + "mean": -0.001939319190569222, + "std": 0.09611468017101288, + "rms": 0.0961342379450798, + "max_abs": 2.4375 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.999772846698761, + "min_cosine_similarity": 0.9990394115447998, + "mean_relative_l2": 0.019537629559636116, + "max_abs_delta": 0.125 + }, + "system_bos": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9996216297149658, + "min_cosine_similarity": 0.9985780715942383, + "mean_relative_l2": 0.025691114366054535, + "max_abs_delta": 0.1171875 + }, + "system_x": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9996304512023926, + "min_cosine_similarity": 0.998760461807251, + "mean_relative_l2": 0.025759709998965263, + "max_abs_delta": 0.1171875 + }, + "system_period": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9996605515480042, + "min_cosine_similarity": 0.9988456964492798, + "mean_relative_l2": 0.024745313450694084, + "max_abs_delta": 0.1171875 + }, + "bos_at_s0": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9853568077087402, + "min_cosine_similarity": 0.9695135354995728, + "mean_relative_l2": 0.16870713233947754, + "max_abs_delta": 0.2412109375 + }, + "bos_at_s1": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9870011806488037, + "min_cosine_similarity": 0.9744547605514526, + "mean_relative_l2": 0.15938712656497955, + "max_abs_delta": 0.23828125 + }, + "x_at_s0": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9854459762573242, + "min_cosine_similarity": 0.9703162312507629, + "mean_relative_l2": 0.1683572381734848, + "max_abs_delta": 0.24462890625 + }, + "x_at_s1": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9871262907981873, + "min_cosine_similarity": 0.9748690724372864, + "mean_relative_l2": 0.15874122083187103, + "max_abs_delta": 0.23974609375 + }, + "period_at_s0": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9857597351074219, + "min_cosine_similarity": 0.9714176058769226, + "mean_relative_l2": 0.16655434668064117, + "max_abs_delta": 0.24560546875 + }, + "period_at_s1": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9873446822166443, + "min_cosine_similarity": 0.9754560589790344, + "mean_relative_l2": 0.1573885679244995, + "max_abs_delta": 0.2392578125 + } + } + }, + "layer_01": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2cb4b8da8b559c2236e20416ed95a28c6f358a2f1f0ff784ef22956d277a63bc", + "mean": -0.002346389926970005, + "std": 0.1187121719121933, + "rms": 0.11873535811901093, + "max_abs": 2.640625 + }, + "full_input": { + "shape": [ + 49, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e6e851c0fc4c7d7053b06a70b588eb625b7098f9dec4a407eb2a4c65d2396cb4", + "mean": -0.007706797681748867, + "std": 1.1426218748092651, + "rms": 1.1426478624343872, + "max_abs": 126.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "970100758707e9f5fd499071d55ca5b9d7d6d17af832d47cbc96964b02b5acfa", + "mean": -0.002356657525524497, + "std": 0.11872626841068268, + "rms": 0.11874966323375702, + "max_abs": 2.65625 + }, + "full_input": { + "shape": [ + 65, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "90ec039ccb67a3c9f3ad05e57f8b3e006ae33eb741c8a4481255b6b50d6692dd", + "mean": -0.006854899227619171, + "std": 1.0288913249969482, + "rms": 1.0289140939712524, + "max_abs": 135.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3b1c6a79f3ecee689bdf7f888ae6794b12126181ffe7f315b7b2cfd53668115a", + "mean": -0.0023413628805428743, + "std": 0.11582700163125992, + "rms": 0.11585065722465515, + "max_abs": 2.625 + }, + "full_input": { + "shape": [ + 49, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f5b5a2f01b401d72fcfb240a678a6f279125089aeb993e31ba0b29a6c70e2613", + "mean": -0.0018928811186924577, + "std": 0.11501532047986984, + "rms": 0.11503089964389801, + "max_abs": 4.6875 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3da38cf4b3db56a75406c7edbe4be0c5573e1f15056cf51071338f2eeb504ec5", + "mean": -0.0025096340104937553, + "std": 0.11579771339893341, + "rms": 0.11582490056753159, + "max_abs": 2.65625 + }, + "full_input": { + "shape": [ + 65, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "df249613f232a0f59fb3f535645724e12036ff865c7e49fafebbe31d7a069a69", + "mean": -0.0023125512525439262, + "std": 0.11457032710313797, + "rms": 0.11459366232156754, + "max_abs": 4.6875 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3a9d36980b30c53cea11309ca2641a4e4b92cd97c4d998c6a98813b355bef341", + "mean": -0.0023054073099046946, + "std": 0.11566586047410965, + "rms": 0.11568883061408997, + "max_abs": 2.625 + }, + "full_input": { + "shape": [ + 49, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5c84637d3c068f9a77b839acdd82cb944d9c3b2024170dc5b42240ea1f8cb244", + "mean": -0.0018793352646753192, + "std": 0.1150536835193634, + "rms": 0.11506902426481247, + "max_abs": 4.6875 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d466931bc9082dd75300f4b3940ce4c1e782ba0100884277ccca37cc5e9e35ff", + "mean": -0.00252647721208632, + "std": 0.11546371877193451, + "rms": 0.1154913529753685, + "max_abs": 2.671875 + }, + "full_input": { + "shape": [ + 65, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e21426afb1ae800d28c1f8f6d1b52c885c7881ddcb2463213f57c70c7c271f40", + "mean": -0.00233095814473927, + "std": 0.11456214636564255, + "rms": 0.11458585411310196, + "max_abs": 4.6875 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "86300daaa2f6393e1f3a304a7819bfc0aff213f7128b293e2d194cdc0c7d92cd", + "mean": -0.0022956645116209984, + "std": 0.11564735323190689, + "rms": 0.11567013710737228, + "max_abs": 2.625 + }, + "full_input": { + "shape": [ + 49, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2b74f01bac7d81d6489a1c5719c2b5a3e9dde752254cba55cbe59e188a71876b", + "mean": -0.001912146806716919, + "std": 0.11437959969043732, + "rms": 0.11439558118581772, + "max_abs": 4.6875 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "057a93cd54da047f0a8790c44d0ff057eb9ccf7f98bbdadc63d022773a7710ec", + "mean": -0.002524269511923194, + "std": 0.11553706228733063, + "rms": 0.11556462943553925, + "max_abs": 2.671875 + }, + "full_input": { + "shape": [ + 65, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "20321672ff9a35cacd985a4d3be1e15c7068029f321ee16dd5227fee7439c74a", + "mean": -0.002353220945224166, + "std": 0.11409921199083328, + "rms": 0.11412347108125687, + "max_abs": 4.6875 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9992507100105286, + "min_cosine_similarity": 0.9969981908798218, + "mean_relative_l2": 0.036600079387426376, + "max_abs_delta": 0.0703125 + }, + "system_bos": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9964308738708496, + "min_cosine_similarity": 0.9917762279510498, + "mean_relative_l2": 0.08226541429758072, + "max_abs_delta": 0.078125 + }, + "system_x": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9941604137420654, + "min_cosine_similarity": 0.9868613481521606, + "mean_relative_l2": 0.10417431592941284, + "max_abs_delta": 0.087158203125 + }, + "system_period": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9945768713951111, + "min_cosine_similarity": 0.9871378540992737, + "mean_relative_l2": 0.10028954595327377, + "max_abs_delta": 0.0858154296875 + }, + "bos_at_s0": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9836151003837585, + "min_cosine_similarity": 0.9659779071807861, + "mean_relative_l2": 0.1768178939819336, + "max_abs_delta": 0.2099609375 + }, + "bos_at_s1": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9829351902008057, + "min_cosine_similarity": 0.9653286933898926, + "mean_relative_l2": 0.1801767498254776, + "max_abs_delta": 0.2265625 + }, + "x_at_s0": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9855553507804871, + "min_cosine_similarity": 0.966562032699585, + "mean_relative_l2": 0.16516773402690887, + "max_abs_delta": 0.2568359375 + }, + "x_at_s1": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9809377789497375, + "min_cosine_similarity": 0.9605929255485535, + "mean_relative_l2": 0.18961204588413239, + "max_abs_delta": 0.2890625 + }, + "period_at_s0": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9856104850769043, + "min_cosine_similarity": 0.9647433757781982, + "mean_relative_l2": 0.16439463198184967, + "max_abs_delta": 0.248046875 + }, + "period_at_s1": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9810915589332581, + "min_cosine_similarity": 0.9598668813705444, + "mean_relative_l2": 0.18875108659267426, + "max_abs_delta": 0.287109375 + } + } + }, + "layer_02": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6a111b6a1b23e5c0f29443731c92e67f84a89b434ea15e7a649522a6180ea7db", + "mean": -0.001873958040960133, + "std": 0.1384446620941162, + "rms": 0.13845734298229218, + "max_abs": 3.25 + }, + "full_input": { + "shape": [ + 49, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2a8f3aa855304391db8a27f191a8ee69f748b5b4061aff63213d314d9bad1a00", + "mean": -0.020960846915841103, + "std": 3.4284110069274902, + "rms": 3.4284751415252686, + "max_abs": 392.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fee330d0b208d2da9630cb07e2f9037d70b6a863045be5b86d7b7d90f15bf6fe", + "mean": -0.0017191693186759949, + "std": 0.13796798884868622, + "rms": 0.1379786878824234, + "max_abs": 3.15625 + }, + "full_input": { + "shape": [ + 65, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "30d328dd455ecc98d42c32df4103a81ae67df09b83bbe3d415d58d3a1c565c21", + "mean": -0.01888159289956093, + "std": 3.2961742877960205, + "rms": 3.2962284088134766, + "max_abs": 436.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "28456b788a08ca2dfaab92f56ff4c7200a219fa2d37d01d467c0f3089b907974", + "mean": -0.002015132224187255, + "std": 0.13465671241283417, + "rms": 0.13467177748680115, + "max_abs": 3.203125 + }, + "full_input": { + "shape": [ + 49, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0bf9ac1c26bf980f895c0476ecc564b905922479847647ce3c1f4ba90515958a", + "mean": -0.002452330430969596, + "std": 0.26836222410202026, + "rms": 0.26837342977523804, + "max_abs": 23.875 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e486ec79c73e09d6a86e492cfa5a0eab563f3a9428f7a9877a5b676aa29d2871", + "mean": -0.0018785110441967845, + "std": 0.13469764590263367, + "rms": 0.13471074402332306, + "max_abs": 3.1875 + }, + "full_input": { + "shape": [ + 65, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fac4a8668be9f8c1a0fd729e065ae2eed336249c656dd9d73fe97ca494ae6ba1", + "mean": -0.0023833834566175938, + "std": 0.24221740663051605, + "rms": 0.2422291338443756, + "max_abs": 23.875 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8cd1264088dc30db7e96c004ce712e6e55510890e31f30fe00183ef3c428edbc", + "mean": -0.00198864727281034, + "std": 0.13355815410614014, + "rms": 0.13357295095920563, + "max_abs": 3.140625 + }, + "full_input": { + "shape": [ + 49, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "632fa1e9428d783044a0aa43075257f9c394f656c7ba350fb4e43103d4df12cf", + "mean": -0.0024415631778538227, + "std": 0.26824331283569336, + "rms": 0.26825442910194397, + "max_abs": 23.875 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5dc8d52b58a4d55aaa2b0b5af73d0f4b5bb00be9d6205917bad451f1c3303d02", + "mean": -0.0018511260859668255, + "std": 0.13335642218589783, + "rms": 0.13336926698684692, + "max_abs": 3.125 + }, + "full_input": { + "shape": [ + 65, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a8db9d2ed98d103661701d95a90e441a2d30e6715ac76dfeeff3b02926df63c7", + "mean": -0.002380005083978176, + "std": 0.2420261651277542, + "rms": 0.24203786253929138, + "max_abs": 23.875 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "06e5d2fb5ab434e5637a8515b82127bdeae668054dc944e126c5a946b13aeb95", + "mean": -0.0019252672791481018, + "std": 0.13359785079956055, + "rms": 0.13361172378063202, + "max_abs": 3.125 + }, + "full_input": { + "shape": [ + 49, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6772f940331803196494c65d25b76728871c1e6b1eaa2f07e2cbf6387e44c8cf", + "mean": -0.002526968251913786, + "std": 0.26763400435447693, + "rms": 0.2676459550857544, + "max_abs": 23.875 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0f41068187d69c23516509cd928c3dc8e82e312d29696f9c3c3eb7f1b31c2fce", + "mean": -0.0018494273535907269, + "std": 0.13345888257026672, + "rms": 0.13347169756889343, + "max_abs": 3.140625 + }, + "full_input": { + "shape": [ + 65, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "389c93a6bec18e8ef51ac19ba39eadb863861ec91551dff017a23b21fb892a35", + "mean": -0.0024486365728080273, + "std": 0.24158672988414764, + "rms": 0.24159912765026093, + "max_abs": 23.875 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9987068176269531, + "min_cosine_similarity": 0.9963972568511963, + "mean_relative_l2": 0.049820978194475174, + "max_abs_delta": 0.1171875 + }, + "system_bos": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9951839447021484, + "min_cosine_similarity": 0.9920101761817932, + "mean_relative_l2": 0.09774257987737656, + "max_abs_delta": 0.140625 + }, + "system_x": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9927080273628235, + "min_cosine_similarity": 0.9844808578491211, + "mean_relative_l2": 0.1191989853978157, + "max_abs_delta": 0.21875 + }, + "system_period": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9932463765144348, + "min_cosine_similarity": 0.985589861869812, + "mean_relative_l2": 0.11436998099088669, + "max_abs_delta": 0.1875 + }, + "bos_at_s0": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9839479923248291, + "min_cosine_similarity": 0.9682526588439941, + "mean_relative_l2": 0.17627985775470734, + "max_abs_delta": 0.2861328125 + }, + "bos_at_s1": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9802667498588562, + "min_cosine_similarity": 0.9629008769989014, + "mean_relative_l2": 0.19496802985668182, + "max_abs_delta": 0.3681640625 + }, + "x_at_s0": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9836997985839844, + "min_cosine_similarity": 0.9638364315032959, + "mean_relative_l2": 0.17694461345672607, + "max_abs_delta": 0.37890625 + }, + "x_at_s1": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9752264618873596, + "min_cosine_similarity": 0.9531483054161072, + "mean_relative_l2": 0.2171516865491867, + "max_abs_delta": 0.48828125 + }, + "period_at_s0": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9836905002593994, + "min_cosine_similarity": 0.9631264209747314, + "mean_relative_l2": 0.17691342532634735, + "max_abs_delta": 0.3603515625 + }, + "period_at_s1": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9754114151000977, + "min_cosine_similarity": 0.9537019729614258, + "mean_relative_l2": 0.21647071838378906, + "max_abs_delta": 0.45703125 + } + } + }, + "layer_03": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7d191c5184bcd31fa7b838c1999bae337e2ccf446cf647fc888f1a8e455a7bb5", + "mean": -0.0022417267318814993, + "std": 0.1664815992116928, + "rms": 0.16649670898914337, + "max_abs": 4.0 + }, + "full_input": { + "shape": [ + 49, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3234b7dfd922c630cb0c7742dbf7392d0c769474e61cdd3ffb7c2cca787e632b", + "mean": -0.02782532200217247, + "std": 10.293452262878418, + "rms": 10.293489456176758, + "max_abs": 1136.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bb218fdf733c7b8754209cea856b7009589ee696ded762f8d09bf56297fb2502", + "mean": -0.0021899810526520014, + "std": 0.1664724498987198, + "rms": 0.16648684442043304, + "max_abs": 4.03125 + }, + "full_input": { + "shape": [ + 65, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "72ae38b6d7056fd60427d5879af10b02de3238906a17a7e6011245bda7bec321", + "mean": -0.024674493819475174, + "std": 9.228959083557129, + "rms": 9.228992462158203, + "max_abs": 1136.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ce081e883174329f7c8646545d39ca72c8b2f9f0ace7820a9199d4758efec969", + "mean": -0.002417943673208356, + "std": 0.16319961845874786, + "rms": 0.16321751475334167, + "max_abs": 4.03125 + }, + "full_input": { + "shape": [ + 49, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "506f3b5a5a9bcc67dd0742040a2e39ca536af7b7dc043ecbeeb47ec0bf90ddb6", + "mean": -0.007226626388728619, + "std": 9.180734634399414, + "rms": 9.180737495422363, + "max_abs": 1136.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "25d1b46cf89ad0b3184b78892feeb1ee34eed7763cd0558969b45e6212dd7843", + "mean": -0.0025603652466088533, + "std": 0.1637372523546219, + "rms": 0.16375726461410522, + "max_abs": 4.03125 + }, + "full_input": { + "shape": [ + 65, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "228feac9d30c1b948a39fe8910e768183381c91e77ebf9bf1e449cd28f0751cc", + "mean": -0.006445406936109066, + "std": 7.971468448638916, + "rms": 7.971470832824707, + "max_abs": 1136.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "37e1e4cb32850d717a3a6b41b60c35d8700f6e0c0bf1ad3d2d85ddfaf1062fea", + "mean": -0.0026073679327964783, + "std": 0.16154144704341888, + "rms": 0.1615624874830246, + "max_abs": 4.0 + }, + "full_input": { + "shape": [ + 49, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "05fe79adc6e2dc9c5a8be7ae8435c5646210cdf0ac072c9276c54ef31edb4c6f", + "mean": -0.0074285781010985374, + "std": 9.180703163146973, + "rms": 9.180706024169922, + "max_abs": 1136.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5e41d8c350df17d03d6b8cd0ac851327d6a8ad6bb253326071461169b661afcf", + "mean": -0.002861917717382312, + "std": 0.16216300427913666, + "rms": 0.16218824684619904, + "max_abs": 4.0 + }, + "full_input": { + "shape": [ + 65, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "eda76a50a5d76f5b42602397a068382726baaf1c7b7805f4b7b034785d2613ed", + "mean": -0.006653123069554567, + "std": 7.971445083618164, + "rms": 7.971447944641113, + "max_abs": 1136.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ed805d139cbd35f0f262b4d974fceb2ffdc959a12f515fecc82707a86761dd91", + "mean": -0.002567981369793415, + "std": 0.1619856357574463, + "rms": 0.16200599074363708, + "max_abs": 4.0 + }, + "full_input": { + "shape": [ + 49, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "59994c0ed585f150eb5c116e7f86bf201df54bbe06ca68966b37ab910358e82b", + "mean": -0.007420359179377556, + "std": 9.180694580078125, + "rms": 9.180697441101074, + "max_abs": 1136.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "44aeee7d2abb2aae36003b5f1285d752849d7b140a3e677e3a692b119295b208", + "mean": -0.0028159022331237793, + "std": 0.16245423257350922, + "rms": 0.16247862577438354, + "max_abs": 4.03125 + }, + "full_input": { + "shape": [ + 65, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fc4cc0138d53987a58fec84d62961e49d049f69f998e6e1239ac66313ac167a9", + "mean": -0.006640918552875519, + "std": 7.971436023712158, + "rms": 7.971438407897949, + "max_abs": 1136.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9986963868141174, + "min_cosine_similarity": 0.9961397647857666, + "mean_relative_l2": 0.04978298023343086, + "max_abs_delta": 0.140625 + }, + "system_bos": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9951731562614441, + "min_cosine_similarity": 0.9920752644538879, + "mean_relative_l2": 0.09767377376556396, + "max_abs_delta": 0.203125 + }, + "system_x": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9916804432868958, + "min_cosine_similarity": 0.9833303093910217, + "mean_relative_l2": 0.12750166654586792, + "max_abs_delta": 0.15625 + }, + "system_period": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9921855926513672, + "min_cosine_similarity": 0.9850001335144043, + "mean_relative_l2": 0.1230694130063057, + "max_abs_delta": 0.171875 + }, + "bos_at_s0": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9852890968322754, + "min_cosine_similarity": 0.9774177670478821, + "mean_relative_l2": 0.16981713473796844, + "max_abs_delta": 0.3515625 + }, + "bos_at_s1": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9816412925720215, + "min_cosine_similarity": 0.9699224233627319, + "mean_relative_l2": 0.18937338888645172, + "max_abs_delta": 0.5 + }, + "x_at_s0": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9845243096351624, + "min_cosine_similarity": 0.9733431935310364, + "mean_relative_l2": 0.17343918979167938, + "max_abs_delta": 0.3828125 + }, + "x_at_s1": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9756245613098145, + "min_cosine_similarity": 0.9546527862548828, + "mean_relative_l2": 0.21626275777816772, + "max_abs_delta": 0.48828125 + }, + "period_at_s0": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9850471019744873, + "min_cosine_similarity": 0.9735694527626038, + "mean_relative_l2": 0.17041142284870148, + "max_abs_delta": 0.3564453125 + }, + "period_at_s1": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9759462475776672, + "min_cosine_similarity": 0.954387903213501, + "mean_relative_l2": 0.21484260261058807, + "max_abs_delta": 0.48046875 + } + } + }, + "layer_04": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4f1d132becfed5a4f6bfd42f747a0cd69fc75b42fe602d3cd6a3b419defdb195", + "mean": -0.0021618001628667116, + "std": 0.19450169801712036, + "rms": 0.1945136934518814, + "max_abs": 5.9375 + }, + "full_input": { + "shape": [ + 49, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5fde559707322b42c8d66aed50fcd8a0caa10533b12964a7c247f5ac3a8fb70b", + "mean": -0.027512986212968826, + "std": 10.741617202758789, + "rms": 10.74165153503418, + "max_abs": 1152.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9e13dd305e32913abb7c9df3a97e8e8869d889a1e16eb178ffbb1b29d17a7c36", + "mean": -0.0021819432731717825, + "std": 0.19475752115249634, + "rms": 0.1947697550058365, + "max_abs": 5.9375 + }, + "full_input": { + "shape": [ + 65, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bb59492727c6112d026fd39f012d35a3dc7041bfa53dae4920d619fe9b4ac940", + "mean": -0.02452116645872593, + "std": 9.60455322265625, + "rms": 9.604583740234375, + "max_abs": 1152.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c90f548afdc8bde2d64f8f5ed23c590ea998676af36eb0e05d1c2db03a7b8a11", + "mean": -0.0023874901235103607, + "std": 0.1928829401731491, + "rms": 0.1928977072238922, + "max_abs": 6.03125 + }, + "full_input": { + "shape": [ + 49, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f866821be68c3da233e4f3de5e59d2dfcd04c50fa5601a7268eddf0b5601522f", + "mean": -0.006965325213968754, + "std": 9.629406929016113, + "rms": 9.629409790039062, + "max_abs": 1152.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "02f674423b7fb6c5c840420a8b31fb6d75e336c5194287cdce5c8b2337fee60b", + "mean": -0.0024203581269830465, + "std": 0.1940721571445465, + "rms": 0.19408723711967468, + "max_abs": 5.96875 + }, + "full_input": { + "shape": [ + 65, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a377fdc5101b2c723439156ccdf2d3b4c3eaf61c3355212a05cb564d14b982e6", + "mean": -0.006263267248868942, + "std": 8.352112770080566, + "rms": 8.3521146774292, + "max_abs": 1152.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "036016eb9184defd1182795281facc133cec1afb8ab4027c98704472ea33783f", + "mean": -0.0022250148467719555, + "std": 0.18975958228111267, + "rms": 0.1897726207971573, + "max_abs": 5.875 + }, + "full_input": { + "shape": [ + 49, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2702a55c7a0fb4f38c5705412c5c25f759f683fe121a3a5a57e0c7d24e4d878f", + "mean": -0.006795017048716545, + "std": 9.629339218139648, + "rms": 9.629342079162598, + "max_abs": 1152.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ef8bc8cfccfed62d56a9a43ab9d4458d6aa7828894299baad4ef6208c73039ad", + "mean": -0.002372225048020482, + "std": 0.19088120758533478, + "rms": 0.1908959448337555, + "max_abs": 5.75 + }, + "full_input": { + "shape": [ + 65, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4b31b88ff30b6b0b66de0183e8bfef20ff03f561b82c443daf1afb5c6cddac99", + "mean": -0.00619176821783185, + "std": 8.35204792022705, + "rms": 8.352049827575684, + "max_abs": 1152.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a272c16e1e29094e4dbfdfbaee895f3ed82578725db4e6540cfc5ee11a57a2dd", + "mean": -0.0021795404609292746, + "std": 0.1903371810913086, + "rms": 0.19034965336322784, + "max_abs": 5.875 + }, + "full_input": { + "shape": [ + 49, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5b4a0f042df79d71f579c1149e4f580091a7b8882b58fa8e938fcafde866b53a", + "mean": -0.006789251696318388, + "std": 9.629329681396484, + "rms": 9.629332542419434, + "max_abs": 1152.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2f55478e29b8d8785e05506839f1a5fcc5eb21ecb1e4abaa7cf70534ba6638cc", + "mean": -0.002386736450716853, + "std": 0.19153337180614471, + "rms": 0.19154824316501617, + "max_abs": 5.78125 + }, + "full_input": { + "shape": [ + 65, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4bc8f6da372d519327cd3f6c12c5d2b307125c2b49508550871383b5dda90274", + "mean": -0.006193279288709164, + "std": 8.352042198181152, + "rms": 8.352043151855469, + "max_abs": 1152.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9984119534492493, + "min_cosine_similarity": 0.9910830855369568, + "mean_relative_l2": 0.05174911394715309, + "max_abs_delta": 0.21875 + }, + "system_bos": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9954022765159607, + "min_cosine_similarity": 0.9908580183982849, + "mean_relative_l2": 0.09519370645284653, + "max_abs_delta": 0.234375 + }, + "system_x": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9921790957450867, + "min_cosine_similarity": 0.9845911264419556, + "mean_relative_l2": 0.12384933233261108, + "max_abs_delta": 0.21875 + }, + "system_period": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9922481179237366, + "min_cosine_similarity": 0.9853296279907227, + "mean_relative_l2": 0.12326700240373611, + "max_abs_delta": 0.2265625 + }, + "bos_at_s0": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9871967434883118, + "min_cosine_similarity": 0.9781867265701294, + "mean_relative_l2": 0.15777066349983215, + "max_abs_delta": 0.375 + }, + "bos_at_s1": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.984032154083252, + "min_cosine_similarity": 0.973259687423706, + "mean_relative_l2": 0.17701716721057892, + "max_abs_delta": 0.40625 + }, + "x_at_s0": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9848552346229553, + "min_cosine_similarity": 0.97584068775177, + "mean_relative_l2": 0.16987691819667816, + "max_abs_delta": 0.451171875 + }, + "x_at_s1": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9770667552947998, + "min_cosine_similarity": 0.9616724252700806, + "mean_relative_l2": 0.21055400371551514, + "max_abs_delta": 0.60546875 + }, + "period_at_s0": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9855180382728577, + "min_cosine_similarity": 0.975456953048706, + "mean_relative_l2": 0.16658057272434235, + "max_abs_delta": 0.376953125 + }, + "period_at_s1": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9774105548858643, + "min_cosine_similarity": 0.961597204208374, + "mean_relative_l2": 0.20942579209804535, + "max_abs_delta": 0.54296875 + } + } + }, + "layer_05": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "be4dc1b88975db1e04f6eb22fc9c83088fc2dfc724ff91aaa6e3739d96cf1487", + "mean": -0.0014478778466582298, + "std": 0.21956825256347656, + "rms": 0.2195730358362198, + "max_abs": 5.71875 + }, + "full_input": { + "shape": [ + 49, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "54973e079aa807fcda0ac81a47c7f09928a77a6655941d759cf9e52ad349f666", + "mean": -0.03030562959611416, + "std": 11.068924903869629, + "rms": 11.06896686553955, + "max_abs": 1152.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a9ad367c3c33b191efc8dfb424d437ef32ef69671b37590d29a27cae34e9699f", + "mean": -0.001520835910923779, + "std": 0.2196602076292038, + "rms": 0.21966548264026642, + "max_abs": 5.65625 + }, + "full_input": { + "shape": [ + 65, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c6e38b5b0d673d610f68417118a81aaeea0f79bdd073b64ebfa4c8882b9a2e52", + "mean": -0.026421863585710526, + "std": 9.900766372680664, + "rms": 9.900800704956055, + "max_abs": 1152.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "10f54ba44656ce9fba643132404735ba6445ba25a35cd1eadeef062d93fa0d64", + "mean": -0.0015774794155731797, + "std": 0.2203972488641739, + "rms": 0.22040289640426636, + "max_abs": 6.15625 + }, + "full_input": { + "shape": [ + 49, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ca3bee4f4a58708d40c937cd26ccb01be77ea3d84c0f258126013fb5ecf4680d", + "mean": -0.007607737556099892, + "std": 9.798418998718262, + "rms": 9.798421859741211, + "max_abs": 1152.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ef20a68bdd6bd7b561fba9df584e3b6fd7deb85d58f0260555d84c5eb71b7d69", + "mean": -0.0018665734678506851, + "std": 0.22111764550209045, + "rms": 0.2211255431175232, + "max_abs": 6.0625 + }, + "full_input": { + "shape": [ + 65, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2745d384addd0edd8de420e1427142b8931846f7c0ecb7d28115d82e9951b66b", + "mean": -0.0065882159397006035, + "std": 8.496993064880371, + "rms": 8.49699592590332, + "max_abs": 1152.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ddce680c7477f92e33c0f99cf7714a35fe9869c8aa1df5386a2732b0a87358b8", + "mean": -0.0016116587212309241, + "std": 0.21772615611553192, + "rms": 0.21773211658000946, + "max_abs": 6.03125 + }, + "full_input": { + "shape": [ + 49, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e63a12f9ce94eee5f06aaa9a059f3995a32ed5d14e9903dcd250488181dac7f0", + "mean": -0.007453572005033493, + "std": 9.798352241516113, + "rms": 9.798354148864746, + "max_abs": 1152.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5a2f3b26a4efdc15904ba101a8e49c41916d43120c885f6791b0b37c34a9662b", + "mean": -0.002124518621712923, + "std": 0.21739442646503448, + "rms": 0.2174047976732254, + "max_abs": 5.9375 + }, + "full_input": { + "shape": [ + 65, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8bd334cc96b76392afbe61e24be47f53e483e6835863fa661c629bafede2623c", + "mean": -0.006574572063982487, + "std": 8.496919631958008, + "rms": 8.496922492980957, + "max_abs": 1152.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "730cc52468cf5a50d21368ff1a56b2ea26dff6ae71be2f5779664043f4eacb09", + "mean": -0.0016290989005938172, + "std": 0.2183118611574173, + "rms": 0.2183179408311844, + "max_abs": 5.96875 + }, + "full_input": { + "shape": [ + 49, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "262a314bd081ade52f508dedfd9b06f1efb0082744c0b7baeedb9b817e7f66e9", + "mean": -0.007465968374162912, + "std": 9.798334121704102, + "rms": 9.798336029052734, + "max_abs": 1152.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f491ad90cc7197a8005be66104cdba811b77d09ef04d56a2eea4c8e47748bf6c", + "mean": -0.0022609117440879345, + "std": 0.2179378867149353, + "rms": 0.21794959902763367, + "max_abs": 5.875 + }, + "full_input": { + "shape": [ + 65, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e904dc7815ca7448114ba32d281c0fc943d6506685556d31e83c4cbd4b117bcc", + "mean": -0.006654567550867796, + "std": 8.496909141540527, + "rms": 8.496912002563477, + "max_abs": 1152.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9976096749305725, + "min_cosine_similarity": 0.9918596744537354, + "mean_relative_l2": 0.06409824639558792, + "max_abs_delta": 0.21875 + }, + "system_bos": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9946224093437195, + "min_cosine_similarity": 0.9874857664108276, + "mean_relative_l2": 0.10191299766302109, + "max_abs_delta": 0.265625 + }, + "system_x": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9895539879798889, + "min_cosine_similarity": 0.9788650870323181, + "mean_relative_l2": 0.14049018919467926, + "max_abs_delta": 0.3203125 + }, + "system_period": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9900517463684082, + "min_cosine_similarity": 0.9802135229110718, + "mean_relative_l2": 0.13773097097873688, + "max_abs_delta": 0.34375 + }, + "bos_at_s0": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9855362772941589, + "min_cosine_similarity": 0.972181499004364, + "mean_relative_l2": 0.1683940887451172, + "max_abs_delta": 0.4375 + }, + "bos_at_s1": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9826574325561523, + "min_cosine_similarity": 0.9687141180038452, + "mean_relative_l2": 0.18512533605098724, + "max_abs_delta": 0.4375 + }, + "x_at_s0": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9821440577507019, + "min_cosine_similarity": 0.9610239267349243, + "mean_relative_l2": 0.18420366942882538, + "max_abs_delta": 0.337890625 + }, + "x_at_s1": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9735638499259949, + "min_cosine_similarity": 0.9572216272354126, + "mean_relative_l2": 0.22692936658859253, + "max_abs_delta": 0.537109375 + }, + "period_at_s0": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.983254611492157, + "min_cosine_similarity": 0.9683807492256165, + "mean_relative_l2": 0.17944319546222687, + "max_abs_delta": 0.357421875 + }, + "period_at_s1": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9740516543388367, + "min_cosine_similarity": 0.953803300857544, + "mean_relative_l2": 0.22504442930221558, + "max_abs_delta": 0.44140625 + } + } + }, + "layer_06": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2f56b8d15ccca58ae0231b1c5a72aa54e29a9a18005eb0a01e5b64616e768a13", + "mean": -0.0027040077839046717, + "std": 0.25425952672958374, + "rms": 0.254273921251297, + "max_abs": 7.28125 + }, + "full_input": { + "shape": [ + 49, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a15ea129f0a0ac7019cf9fd83c305295792b9a2225054abeec99697863c48533", + "mean": -0.03229609876871109, + "std": 11.270496368408203, + "rms": 11.270543098449707, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ec52e56137fb4512c31e7f49e952036c6973cdb36024d97e408220be9875ed95", + "mean": -0.002675507450476289, + "std": 0.2544783353805542, + "rms": 0.2544924020767212, + "max_abs": 7.21875 + }, + "full_input": { + "shape": [ + 65, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "313b62c505e7335850d7c0e220f911e00648053425a51e03e6d7c359d9cdadb5", + "mean": -0.028235280886292458, + "std": 10.08060073852539, + "rms": 10.080639839172363, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "90d29148a612eebf1cf25bdfc3eba420d73d71ca9f9091e7242046d25d0c32dc", + "mean": -0.0027026592288166285, + "std": 0.2547374665737152, + "rms": 0.2547518014907837, + "max_abs": 7.625 + }, + "full_input": { + "shape": [ + 49, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a74e7ab4d68914020dbdfa64875a288f9db509a5a96c9c43e589a584020f007e", + "mean": -0.008934484794735909, + "std": 9.955597877502441, + "rms": 9.955601692199707, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ab50a517fcf67bdccd487359b67ce2ddb09177703f9f07d498a75dd9bf38d120", + "mean": -0.002833382459357381, + "std": 0.2554018795490265, + "rms": 0.2554176151752472, + "max_abs": 7.4375 + }, + "full_input": { + "shape": [ + 65, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0d21e2d26618784a6a61536a5386574c3df4f8fa3175d6c172906cf7855cd474", + "mean": -0.007810437586158514, + "std": 8.633614540100098, + "rms": 8.633618354797363, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0231f66d879f769ec16f2b7995645de11be5224d49fb569e479972d0cad5a3a8", + "mean": -0.0027178723830729723, + "std": 0.25456809997558594, + "rms": 0.25458261370658875, + "max_abs": 7.4375 + }, + "full_input": { + "shape": [ + 49, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7bda255f10d0313bb80defa4fe2878afe4a1035f97dcf312650ec15887faf7b0", + "mean": -0.008675165474414825, + "std": 9.955551147460938, + "rms": 9.955554962158203, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "13666f70c943fc8e6bf4f52729136164f0b3fb54611fab0ceb36a267b5bcb317", + "mean": -0.0029135195072740316, + "std": 0.2522934079170227, + "rms": 0.25231024622917175, + "max_abs": 7.25 + }, + "full_input": { + "shape": [ + 65, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e83ef943476148126e3a59c828067c3d12fad1209d85a567b9462b4004cf4de1", + "mean": -0.00762969022616744, + "std": 8.633528709411621, + "rms": 8.633532524108887, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9eb395c17ceeae7a911121204fcd0fd749eb83e5f4497f01fdd1f89c49f6b1be", + "mean": -0.0027741752564907074, + "std": 0.25419944524765015, + "rms": 0.2542145848274231, + "max_abs": 7.25 + }, + "full_input": { + "shape": [ + 49, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2fe0cd045b0b65e437287e8a7a580f90274e32d8d69fff99777f17ad15038516", + "mean": -0.008696968667209148, + "std": 9.955530166625977, + "rms": 9.955533981323242, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "59448be7f527edf7cdfb3037f8d92c90cee80f2acaca008c1de76afd8e930ca6", + "mean": -0.0030551888048648834, + "std": 0.2518942952156067, + "rms": 0.25191283226013184, + "max_abs": 7.125 + }, + "full_input": { + "shape": [ + 65, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ce2ddbf4b170aa25d392a51171e285a3296ef8f34002a477068366b7adabb710", + "mean": -0.007723620161414146, + "std": 8.633514404296875, + "rms": 8.63351821899414, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9973686337471008, + "min_cosine_similarity": 0.9908074140548706, + "mean_relative_l2": 0.06739544123411179, + "max_abs_delta": 0.25 + }, + "system_bos": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9948267936706543, + "min_cosine_similarity": 0.9860683083534241, + "mean_relative_l2": 0.09904339909553528, + "max_abs_delta": 0.34375 + }, + "system_x": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9899399280548096, + "min_cosine_similarity": 0.9818280935287476, + "mean_relative_l2": 0.13853111863136292, + "max_abs_delta": 0.484375 + }, + "system_period": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9897297024726868, + "min_cosine_similarity": 0.9819231033325195, + "mean_relative_l2": 0.14010001718997955, + "max_abs_delta": 0.5 + }, + "bos_at_s0": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9871816039085388, + "min_cosine_similarity": 0.9667499661445618, + "mean_relative_l2": 0.15759599208831787, + "max_abs_delta": 0.40625 + }, + "bos_at_s1": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.984874427318573, + "min_cosine_similarity": 0.9651952981948853, + "mean_relative_l2": 0.17117564380168915, + "max_abs_delta": 0.5 + }, + "x_at_s0": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9829497337341309, + "min_cosine_similarity": 0.967122495174408, + "mean_relative_l2": 0.18030418455600739, + "max_abs_delta": 0.625 + }, + "x_at_s1": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9752121567726135, + "min_cosine_similarity": 0.9572842121124268, + "mean_relative_l2": 0.21829698979854584, + "max_abs_delta": 0.46875 + }, + "period_at_s0": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9837813377380371, + "min_cosine_similarity": 0.9709904193878174, + "mean_relative_l2": 0.17687760293483734, + "max_abs_delta": 0.46875 + }, + "period_at_s1": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9751743674278259, + "min_cosine_similarity": 0.9573643207550049, + "mean_relative_l2": 0.21867501735687256, + "max_abs_delta": 0.5 + } + } + }, + "layer_07": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ef9ef27eac10f6bbad69a09e2d234371a8e9d77a9b487333c828b7f2a5455942", + "mean": -0.004625590052455664, + "std": 0.280364066362381, + "rms": 0.2804022431373596, + "max_abs": 7.6875 + }, + "full_input": { + "shape": [ + 49, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "dce4115f94c111337e0177e9de06ccc25959f7c82a5a68d0f5169270618c0e24", + "mean": -0.03315124660730362, + "std": 11.303354263305664, + "rms": 11.3034029006958, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e9f5ab3a4330e794ac91f76eefebc523e830199bbcff80eab21e4855e66f3674", + "mean": -0.004613010678440332, + "std": 0.28118160367012024, + "rms": 0.2812194526195526, + "max_abs": 7.78125 + }, + "full_input": { + "shape": [ + 65, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a1c5fcca0f0a779491c75ee69a1fccca75c7e94bdd87c92dcf8cecb358b5df46", + "mean": -0.02968142367899418, + "std": 10.110512733459473, + "rms": 10.110555648803711, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bcc6a612c84082d0ae147125f3339de7e2ef55207163f315a5815a2b19e17f1b", + "mean": -0.004685363732278347, + "std": 0.27822205424308777, + "rms": 0.2782614827156067, + "max_abs": 7.6875 + }, + "full_input": { + "shape": [ + 49, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7fcb0fa841374b09e1434a88c5348b1375067477b29c17942084745831bb800d", + "mean": -0.009750391356647015, + "std": 9.97386646270752, + "rms": 9.973872184753418, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8ad728d89ea333b82354834ec442eedf23dd085747b93b3c0c5023c8024e9661", + "mean": -0.004872553516179323, + "std": 0.28041380643844604, + "rms": 0.28045615553855896, + "max_abs": 7.71875 + }, + "full_input": { + "shape": [ + 65, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8fcd2a375d242ebb44ace192ce68d62839a394a34e428bd137d95115ae0bc208", + "mean": -0.009214410558342934, + "std": 8.649678230285645, + "rms": 8.649683952331543, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a9503f8cd7d6a627815201acbe5cdd59efea59533a2b923d000f89d41850fbc2", + "mean": -0.004437689203768969, + "std": 0.27660882472991943, + "rms": 0.27664440870285034, + "max_abs": 7.5 + }, + "full_input": { + "shape": [ + 49, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "20e45de2665783ea7d9f20dbbdd89c13c64ce0a8e35a77adc3ed9b4b3a5b8e0e", + "mean": -0.009613226167857647, + "std": 9.973788261413574, + "rms": 9.973793029785156, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2a8bbb4173bdd5bcfb352ddd0a238a65ce5f61bd73fdaddf041bdc102f74ffca", + "mean": -0.004622854758054018, + "std": 0.277578741312027, + "rms": 0.2776172161102295, + "max_abs": 7.5625 + }, + "full_input": { + "shape": [ + 65, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3f4d0930655da78a2ccad79c510d8c9645f8d15f78d9eff219a586c22b70d19f", + "mean": -0.009039390832185745, + "std": 8.649581909179688, + "rms": 8.64958667755127, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0b2033f3ab3196786fa840a8d51b86ccd1009f4e4914f5c39f97fb73cfc9aca2", + "mean": -0.004624221008270979, + "std": 0.27799567580223083, + "rms": 0.27803412079811096, + "max_abs": 7.4375 + }, + "full_input": { + "shape": [ + 49, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4b3d96ade749b37a2d3a5a9605b34d0c5ec65ab364be3bcc5fa1955fd12e6761", + "mean": -0.00949020590633154, + "std": 9.97380542755127, + "rms": 9.973810195922852, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d54f248b106246e8497d4dc93f101e618396dd68e68f9d1ad43b844d400b14a5", + "mean": -0.004639470484107733, + "std": 0.2777656316757202, + "rms": 0.2778043746948242, + "max_abs": 7.5 + }, + "full_input": { + "shape": [ + 65, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f0239add2e4765f27c0dd85196bb5994f812ed16b28d3fffcbcdc376d7f132f9", + "mean": -0.008948346599936485, + "std": 8.649585723876953, + "rms": 8.649590492248535, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9972787499427795, + "min_cosine_similarity": 0.9914482831954956, + "mean_relative_l2": 0.06859153509140015, + "max_abs_delta": 0.40625 + }, + "system_bos": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9944979548454285, + "min_cosine_similarity": 0.9857540130615234, + "mean_relative_l2": 0.10254693031311035, + "max_abs_delta": 0.359375 + }, + "system_x": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9891977310180664, + "min_cosine_similarity": 0.9747592210769653, + "mean_relative_l2": 0.1441759318113327, + "max_abs_delta": 0.484375 + }, + "system_period": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9880825877189636, + "min_cosine_similarity": 0.9765819311141968, + "mean_relative_l2": 0.15165872871875763, + "max_abs_delta": 0.4921875 + }, + "bos_at_s0": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9868614077568054, + "min_cosine_similarity": 0.9623013734817505, + "mean_relative_l2": 0.1581755429506302, + "max_abs_delta": 0.53125 + }, + "bos_at_s1": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9845929741859436, + "min_cosine_similarity": 0.9608216285705566, + "mean_relative_l2": 0.1713142991065979, + "max_abs_delta": 0.5 + }, + "x_at_s0": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9825679659843445, + "min_cosine_similarity": 0.966464638710022, + "mean_relative_l2": 0.18182553350925446, + "max_abs_delta": 0.5 + }, + "x_at_s1": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9739336371421814, + "min_cosine_similarity": 0.9529470205307007, + "mean_relative_l2": 0.22490538656711578, + "max_abs_delta": 0.59375 + }, + "period_at_s0": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9830901622772217, + "min_cosine_similarity": 0.9678272008895874, + "mean_relative_l2": 0.17936529219150543, + "max_abs_delta": 0.46875 + }, + "period_at_s1": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9736266732215881, + "min_cosine_similarity": 0.9521874189376831, + "mean_relative_l2": 0.22650982439517975, + "max_abs_delta": 0.5625 + } + } + }, + "layer_08": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ad14b5b34cddd23c028696c8623f43da13607f3476236f5fbb2fe4de8f0a41f3", + "mean": -0.005244894418865442, + "std": 0.3235786259174347, + "rms": 0.32362115383148193, + "max_abs": 8.375 + }, + "full_input": { + "shape": [ + 49, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b239fce51f437ee9c16a23bd72da7e31ab33eeda890a71bef749e3d0bfa95f46", + "mean": -0.033846065402030945, + "std": 11.341448783874512, + "rms": 11.341499328613281, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "138b6db2fff5331c7d6febd6133c4484fac238ac44fccda0d98301e2ff1e8bce", + "mean": -0.005056483205407858, + "std": 0.3245875835418701, + "rms": 0.32462695240974426, + "max_abs": 8.5 + }, + "full_input": { + "shape": [ + 65, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f7ad5d4b4c6a96c5daada4e04c59c2d5dc4fbf69c55204baa9a88224f42f8fad", + "mean": -0.029734564945101738, + "std": 10.145215034484863, + "rms": 10.145258903503418, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9f209cf4f6807bd3e416a7a309e28ce906a8b26c2de9b2c154460a5da479d47c", + "mean": -0.005399505142122507, + "std": 0.32208311557769775, + "rms": 0.32212838530540466, + "max_abs": 8.3125 + }, + "full_input": { + "shape": [ + 49, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "43fd9bceb8e836767b72d37db4eb15cdfa3b21d895eea00b62d3d05aaabf985a", + "mean": -0.010623645037412643, + "std": 9.9950590133667, + "rms": 9.995065689086914, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "662fa04a5062ad06adeb02516b2b3d64dbbe910ef1eb26b04bb98a049f45bdc1", + "mean": -0.005474606063216925, + "std": 0.3240925669670105, + "rms": 0.3241388201713562, + "max_abs": 8.375 + }, + "full_input": { + "shape": [ + 65, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8cf05218f3bcaa6bb36faffc9bbeb618bf3d3775fd1720e28c76eeef1a5bfeef", + "mean": -0.009526961483061314, + "std": 8.668222427368164, + "rms": 8.668228149414062, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "853915206d3364c2094430158c8b26bf76574ef2e98cd490ce652ea12322d6bc", + "mean": -0.005133053287863731, + "std": 0.32018643617630005, + "rms": 0.32022759318351746, + "max_abs": 8.125 + }, + "full_input": { + "shape": [ + 49, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "695cbffff6279a843d951489e616d9946bbbe6d6dd9d5b9a93b8f058347bdaae", + "mean": -0.010462156496942043, + "std": 9.995000839233398, + "rms": 9.995006561279297, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0ea759975fbeb1b03d61ac16b18ee50ef17f53dcd6f19444afbd0ab1c6ac68a9", + "mean": -0.00505826948210597, + "std": 0.3196113705635071, + "rms": 0.31965139508247375, + "max_abs": 8.0625 + }, + "full_input": { + "shape": [ + 65, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "39d31c97b5c8b37e1a65dfa8e363f0f70bcd4dd762523bab6fa4c63becc2237c", + "mean": -0.009248102083802223, + "std": 8.668121337890625, + "rms": 8.668127059936523, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "465ab41580c6a0a9facc5cd981eca21d879088112d056e11edab0e4d6564ca01", + "mean": -0.005674073938280344, + "std": 0.3204594552516937, + "rms": 0.320509672164917, + "max_abs": 7.96875 + }, + "full_input": { + "shape": [ + 49, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c9d630d2d46f28f9c7477705960becf170b6123d5aab8b7ae873f28e9ba79dc0", + "mean": -0.010730426758527756, + "std": 9.995012283325195, + "rms": 9.995018005371094, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ec82a01687b701d2d71db0059eb0a1ee1e9d46d7c34c538049794563949dce02", + "mean": -0.005351858213543892, + "std": 0.3202707767486572, + "rms": 0.32031548023223877, + "max_abs": 7.96875 + }, + "full_input": { + "shape": [ + 65, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4dc0bdbf47c3e9dc6354fb0b6ca29db6f486450f4bb20073d7acd2716a86e197", + "mean": -0.009317507036030293, + "std": 8.668126106262207, + "rms": 8.668130874633789, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9964470863342285, + "min_cosine_similarity": 0.9882341027259827, + "mean_relative_l2": 0.07936833053827286, + "max_abs_delta": 0.46875 + }, + "system_bos": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9935851097106934, + "min_cosine_similarity": 0.9795531630516052, + "mean_relative_l2": 0.10998091101646423, + "max_abs_delta": 0.34375 + }, + "system_x": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9874458312988281, + "min_cosine_similarity": 0.9676544666290283, + "mean_relative_l2": 0.15422266721725464, + "max_abs_delta": 0.5859375 + }, + "system_period": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9858074188232422, + "min_cosine_similarity": 0.9601477384567261, + "mean_relative_l2": 0.1644248366355896, + "max_abs_delta": 0.5625 + }, + "bos_at_s0": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9862468838691711, + "min_cosine_similarity": 0.9638774394989014, + "mean_relative_l2": 0.1622951477766037, + "max_abs_delta": 0.46875 + }, + "bos_at_s1": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9844698309898376, + "min_cosine_similarity": 0.9657766222953796, + "mean_relative_l2": 0.17249201238155365, + "max_abs_delta": 0.5 + }, + "x_at_s0": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9807720184326172, + "min_cosine_similarity": 0.9584594964981079, + "mean_relative_l2": 0.19161713123321533, + "max_abs_delta": 0.375 + }, + "x_at_s1": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9714410305023193, + "min_cosine_similarity": 0.9467595815658569, + "mean_relative_l2": 0.23527812957763672, + "max_abs_delta": 0.625 + }, + "period_at_s0": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9820806384086609, + "min_cosine_similarity": 0.9701040983200073, + "mean_relative_l2": 0.18580694496631622, + "max_abs_delta": 0.44921875 + }, + "period_at_s1": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9720383286476135, + "min_cosine_similarity": 0.951653003692627, + "mean_relative_l2": 0.23341906070709229, + "max_abs_delta": 0.578125 + } + } + }, + "layer_09": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6c379ab65f9f45fdfd421173f8d1961b4e7115b29fdf4963b8244abc5c5a5a35", + "mean": -0.005181760061532259, + "std": 0.3712233006954193, + "rms": 0.371259480714798, + "max_abs": 10.3125 + }, + "full_input": { + "shape": [ + 49, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d55d2a950d510478deadff6e12bca812e51fc3ca4016472964367aa8c1bcd766", + "mean": -0.03303962200880051, + "std": 11.343575477600098, + "rms": 11.343623161315918, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3f79600c37e9cc326fd44155d11e7553413197cd2b8b9d9b1d94a50cb004d251", + "mean": -0.005087179597467184, + "std": 0.37138035893440247, + "rms": 0.3714151978492737, + "max_abs": 10.375 + }, + "full_input": { + "shape": [ + 65, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5f1ab87e88fed7af92eb61628d599869d1874e60bf41dff27750bef1de0dee6f", + "mean": -0.030179178342223167, + "std": 10.147292137145996, + "rms": 10.14733600616455, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a1d6be7a23e210376a2389dcec1b9e290913dd6adfb65931d5ae4503bfe648f3", + "mean": -0.005460149142891169, + "std": 0.37144333124160767, + "rms": 0.3714834749698639, + "max_abs": 10.25 + }, + "full_input": { + "shape": [ + 49, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3a71d6350649e3bb1cff80ce00c6be2503f4423205996a4c59c4b1f5c215e332", + "mean": -0.010166861116886139, + "std": 9.997386932373047, + "rms": 9.997391700744629, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3b1f11d4078a0272a79967f00262719e5c81359ff270402c6ff32188db732890", + "mean": -0.0056893606670200825, + "std": 0.37238532304763794, + "rms": 0.3724287748336792, + "max_abs": 10.5 + }, + "full_input": { + "shape": [ + 65, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0a26766e1cc15042feffcbb91a5ddcac088ec38507d835225dd47b5a3f8b2c87", + "mean": -0.010325086303055286, + "std": 8.670610427856445, + "rms": 8.670616149902344, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7804fdbafa2deaa55ec585a69c0ca7d67efd212b3d060cbc032bd2c9c189ba76", + "mean": -0.005148456897586584, + "std": 0.3698011338710785, + "rms": 0.3698369562625885, + "max_abs": 10.375 + }, + "full_input": { + "shape": [ + 49, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "37700f18835d413d304616a8b83651f8d82f6469dd9963b03478473dcc7a2ad9", + "mean": -0.009841560386121273, + "std": 9.997320175170898, + "rms": 9.997323989868164, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3468e45b3b9e7c3f81cd163beed3652f6396f1e32f4deb5df91aa5307459be67", + "mean": -0.005729749333113432, + "std": 0.3661970794200897, + "rms": 0.3662418723106384, + "max_abs": 10.25 + }, + "full_input": { + "shape": [ + 65, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cef2194f539b0c23a722f0d452c538b5841fa13f9d82c7b6602f794f8e93fc0b", + "mean": -0.010226167738437653, + "std": 8.67045783996582, + "rms": 8.670464515686035, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "03428c95016e30bad0c267a7d2936559e5f288af6a4a24031a152094b296fecd", + "mean": -0.005611727479845285, + "std": 0.36952629685401917, + "rms": 0.3695688843727112, + "max_abs": 10.3125 + }, + "full_input": { + "shape": [ + 49, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "08ff8ac2f78ba1c4a667814edac3e69f4d47e43b34a914849277baaff1bb43db", + "mean": -0.009899699129164219, + "std": 9.99729061126709, + "rms": 9.997294425964355, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ed62c66369b70374db59cd4af757defb0f2e61b0be418fd2b3da9cc34e28bbb2", + "mean": -0.00600268691778183, + "std": 0.367007851600647, + "rms": 0.3670569360256195, + "max_abs": 10.25 + }, + "full_input": { + "shape": [ + 65, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "99a6820bdb9156927e7e2806feb8954b45f903efebccc3daa9fd3f2a64d5d14c", + "mean": -0.010136342607438564, + "std": 8.670438766479492, + "rms": 8.67044448852539, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.996690034866333, + "min_cosine_similarity": 0.9893015027046204, + "mean_relative_l2": 0.0770580992102623, + "max_abs_delta": 0.4375 + }, + "system_bos": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9941606521606445, + "min_cosine_similarity": 0.9833517670631409, + "mean_relative_l2": 0.10451861470937729, + "max_abs_delta": 0.5625 + }, + "system_x": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9885396361351013, + "min_cosine_similarity": 0.9699392318725586, + "mean_relative_l2": 0.14779877662658691, + "max_abs_delta": 0.6875 + }, + "system_period": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9881718158721924, + "min_cosine_similarity": 0.9719324707984924, + "mean_relative_l2": 0.15083332359790802, + "max_abs_delta": 0.640625 + }, + "bos_at_s0": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.988750159740448, + "min_cosine_similarity": 0.9711508750915527, + "mean_relative_l2": 0.1474670022726059, + "max_abs_delta": 0.75 + }, + "bos_at_s1": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.986943244934082, + "min_cosine_similarity": 0.9731273651123047, + "mean_relative_l2": 0.1585264801979065, + "max_abs_delta": 0.625 + }, + "x_at_s0": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9846093058586121, + "min_cosine_similarity": 0.9700219631195068, + "mean_relative_l2": 0.1729363352060318, + "max_abs_delta": 0.625 + }, + "x_at_s1": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9761736392974854, + "min_cosine_similarity": 0.9552672505378723, + "mean_relative_l2": 0.21560199558734894, + "max_abs_delta": 0.75 + }, + "period_at_s0": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9854898452758789, + "min_cosine_similarity": 0.9730373620986938, + "mean_relative_l2": 0.16818960011005402, + "max_abs_delta": 0.6875 + }, + "period_at_s1": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9770933985710144, + "min_cosine_similarity": 0.9596671462059021, + "mean_relative_l2": 0.21188269555568695, + "max_abs_delta": 0.6484375 + } + } + }, + "layer_10": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "893c78d2a9b29755b388c61744a6b3fbddd999749257a87dc6080640634d2243", + "mean": -0.004674912896007299, + "std": 0.4182082712650299, + "rms": 0.4182344079017639, + "max_abs": 10.875 + }, + "full_input": { + "shape": [ + 49, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "dcaf149267f204225764cefde0bb564a6ed42e7f6d87c422f7593fad17d37fca", + "mean": -0.0336570180952549, + "std": 11.354297637939453, + "rms": 11.354347229003906, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0e3f9f8b7348ca4bff3b62a6cbe7d117e7c4c3bb5a15e507a0cfdc347e7f8eba", + "mean": -0.004234608728438616, + "std": 0.41876453161239624, + "rms": 0.4187859296798706, + "max_abs": 10.8125 + }, + "full_input": { + "shape": [ + 65, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ca071cbdfd82f43e9fd73e314e162e3801b74e5afafbaf3f049956a670d01fc1", + "mean": -0.030791150406003, + "std": 10.156928062438965, + "rms": 10.156974792480469, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a5e3a0b4da2f0fdafc90df047fc57dc70f96275c91e058bd6403261e0bc7ecec", + "mean": -0.0048759556375443935, + "std": 0.41620078682899475, + "rms": 0.41622933745384216, + "max_abs": 11.0 + }, + "full_input": { + "shape": [ + 49, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e33f9c8a76e558d628b6df7ff554ba557b619c603da1141455aaf6c4d8c5131d", + "mean": -0.010832272469997406, + "std": 10.008906364440918, + "rms": 10.008912086486816, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5f0fa84792a8b124f7659121fcd98cbaed39c8adc6489bbe005de5c5acbeed36", + "mean": -0.005122712347656488, + "std": 0.41878053545951843, + "rms": 0.4188118875026703, + "max_abs": 11.0 + }, + "full_input": { + "shape": [ + 65, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "88308e3613cf5499e377d3194adfd41070d4fb3b9b71d5017c93d463ab367488", + "mean": -0.011046046391129494, + "std": 8.681156158447266, + "rms": 8.68116283416748, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "379d71d194303331473146af17108bf5471ad435cd0353b71321228f2e698bc7", + "mean": -0.005009371787309647, + "std": 0.41542986035346985, + "rms": 0.4154600501060486, + "max_abs": 11.25 + }, + "full_input": { + "shape": [ + 49, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "473c7a52c3eac2f95c7d77fdfedfc2dd03674402df69c054e45d2eca279e0da9", + "mean": -0.010886987671256065, + "std": 10.008834838867188, + "rms": 10.008840560913086, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d6352ebb65c943d2ca196564e36a46935a4e0c78c35e1c6c6d4617325bb7a064", + "mean": -0.005375274922698736, + "std": 0.4140990674495697, + "rms": 0.4141339361667633, + "max_abs": 10.9375 + }, + "full_input": { + "shape": [ + 65, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9e664dc6589ecb112d160c4ff89e63e5afb58328dcb5e24978c4582c4d831fc7", + "mean": -0.011264881119132042, + "std": 8.680965423583984, + "rms": 8.6809720993042, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4693cdef24a780d8643ba15af11ef749203fc04f4375fc44b373b286a23c76ad", + "mean": -0.005079734604805708, + "std": 0.4148034155368805, + "rms": 0.41483449935913086, + "max_abs": 11.0 + }, + "full_input": { + "shape": [ + 49, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "956139f89698afbee3e908f2863627a900737245db46430167c8055854ec944f", + "mean": -0.010555916465818882, + "std": 10.008796691894531, + "rms": 10.008801460266113, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "266e92ed5f46e449976740bacf1faff7bc981ba17d091a0d391534979f3fd161", + "mean": -0.005517112091183662, + "std": 0.4134042263031006, + "rms": 0.4134410321712494, + "max_abs": 11.0 + }, + "full_input": { + "shape": [ + 65, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "44272cead0378901680d7c95d08d393a24a4333b9e3eb5d5451bc596a75b3311", + "mean": -0.011081159114837646, + "std": 8.680926322937012, + "rms": 8.680932998657227, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9966019988059998, + "min_cosine_similarity": 0.9905846118927002, + "mean_relative_l2": 0.07914288341999054, + "max_abs_delta": 0.375 + }, + "system_bos": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9936177730560303, + "min_cosine_similarity": 0.9817867279052734, + "mean_relative_l2": 0.10976936668157578, + "max_abs_delta": 0.375 + }, + "system_x": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9881632328033447, + "min_cosine_similarity": 0.964949369430542, + "mean_relative_l2": 0.14973081648349762, + "max_abs_delta": 0.75 + }, + "system_period": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9873811602592468, + "min_cosine_similarity": 0.9627698659896851, + "mean_relative_l2": 0.15491241216659546, + "max_abs_delta": 0.6875 + }, + "bos_at_s0": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9883986115455627, + "min_cosine_similarity": 0.9717264771461487, + "mean_relative_l2": 0.1494206041097641, + "max_abs_delta": 0.875 + }, + "bos_at_s1": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9865667223930359, + "min_cosine_similarity": 0.9740076065063477, + "mean_relative_l2": 0.16083680093288422, + "max_abs_delta": 0.5 + }, + "x_at_s0": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9842645525932312, + "min_cosine_similarity": 0.9615950584411621, + "mean_relative_l2": 0.17349915206432343, + "max_abs_delta": 0.625 + }, + "x_at_s1": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9753459095954895, + "min_cosine_similarity": 0.9471861720085144, + "mean_relative_l2": 0.21918940544128418, + "max_abs_delta": 1.0625 + }, + "period_at_s0": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9851126670837402, + "min_cosine_similarity": 0.9683915376663208, + "mean_relative_l2": 0.16949506103992462, + "max_abs_delta": 0.6875 + }, + "period_at_s1": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.975758969783783, + "min_cosine_similarity": 0.95525723695755, + "mean_relative_l2": 0.21712975203990936, + "max_abs_delta": 0.84375 + } + } + }, + "layer_11": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "25f8bc1a9b8173b8b928e41bfa710825c9dfcc18c2d54bf97f4efda41e3e1bf8", + "mean": -0.003400687128305435, + "std": 0.5385900735855103, + "rms": 0.5386008024215698, + "max_abs": 17.5 + }, + "full_input": { + "shape": [ + 49, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "eba0caf676c9ede44acdf3ed43f8170c393847ad3c658eded2dc8dab70c1fb3a", + "mean": -0.03234230726957321, + "std": 11.416682243347168, + "rms": 11.416728973388672, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d47ab46a61bb971a646e91d34c71e6c5920e199d4c1e8a47102fec20635740ed", + "mean": -0.002841637236997485, + "std": 0.5391455292701721, + "rms": 0.539152979850769, + "max_abs": 17.5 + }, + "full_input": { + "shape": [ + 65, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8f711aaf18e2b0d49316810cf81f830609e9dde559bb1d2a89e72545cc0fdd63", + "mean": -0.02990461327135563, + "std": 10.211759567260742, + "rms": 10.211803436279297, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "df4f906537d6d0b88e1df43f57c645cbaa8f825d82ab61799eee3ae1e1273be4", + "mean": -0.003527227556332946, + "std": 0.5355392694473267, + "rms": 0.5355508327484131, + "max_abs": 17.5 + }, + "full_input": { + "shape": [ + 49, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "83847cf183af8ab5df123c25f94753c9d5c35dfe7a349722a8f0f073d8a06c52", + "mean": -0.009348999708890915, + "std": 10.060145378112793, + "rms": 10.060150146484375, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "459404e5a1f3b64ce0a3b94140f34484bfaa19e6e7862bff49950964bce1a56e", + "mean": -0.003785225562751293, + "std": 0.5388996601104736, + "rms": 0.5389129519462585, + "max_abs": 18.0 + }, + "full_input": { + "shape": [ + 65, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2020369e8b29efc5df7d73bcef77397c067c69719ad4f13b5bf42e76973a368b", + "mean": -0.010043377988040447, + "std": 8.726316452026367, + "rms": 8.726322174072266, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5fdf8abc40e06c10bee2a071af443f9fa8054dfa5f1d0af0005c43f9d8a8baff", + "mean": -0.0036325014661997557, + "std": 0.5357347726821899, + "rms": 0.5357471108436584, + "max_abs": 17.75 + }, + "full_input": { + "shape": [ + 49, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "eb1f1bb0e94f56e71f6d6572c2802b01d732f31ea97f41bbb89539961328a5ce", + "mean": -0.009088727645576, + "std": 10.06014633178711, + "rms": 10.060151100158691, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8bce7d99a89df212f2508e124e61fc6c5c939796ee40d2e57b92c08203b65dff", + "mean": -0.003586513688787818, + "std": 0.5292143821716309, + "rms": 0.529226541519165, + "max_abs": 17.25 + }, + "full_input": { + "shape": [ + 65, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7d6236b59e0faa1e26b8a00404ad26506f95893bb5280694a451f8cbef77105b", + "mean": -0.009876810945570469, + "std": 8.7259521484375, + "rms": 8.725957870483398, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d147e27a201322d2d231928e79ef17ff379c9ada103046034e890d8ee874b091", + "mean": -0.003558715805411339, + "std": 0.532218337059021, + "rms": 0.5322302579879761, + "max_abs": 17.25 + }, + "full_input": { + "shape": [ + 49, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "541f2a01c4d67e0c57e11431576a345dece95b84da947ba3e009b1a993003109", + "mean": -0.008756160736083984, + "std": 10.059988021850586, + "rms": 10.059992790222168, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d58d3264c47a695bad3ccf2c39bf6ad4f2239b0dbe3de7ea162a60d307f0b696", + "mean": -0.003788735717535019, + "std": 0.5271848440170288, + "rms": 0.5271984338760376, + "max_abs": 17.25 + }, + "full_input": { + "shape": [ + 65, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e58a5c0c455d2046d01e2ff55f926f6681348b3391af95b76a245908f0d945f7", + "mean": -0.00975501723587513, + "std": 8.725871086120605, + "rms": 8.725876808166504, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9972841143608093, + "min_cosine_similarity": 0.9939534664154053, + "mean_relative_l2": 0.07151959836483002, + "max_abs_delta": 0.375 + }, + "system_bos": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9947655200958252, + "min_cosine_similarity": 0.986099123954773, + "mean_relative_l2": 0.10049593448638916, + "max_abs_delta": 0.875 + }, + "system_x": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9903584122657776, + "min_cosine_similarity": 0.9728528261184692, + "mean_relative_l2": 0.13595962524414062, + "max_abs_delta": 1.25 + }, + "system_period": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9895973205566406, + "min_cosine_similarity": 0.9736083149909973, + "mean_relative_l2": 0.1424376517534256, + "max_abs_delta": 1.1875 + }, + "bos_at_s0": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9909873604774475, + "min_cosine_similarity": 0.9820898771286011, + "mean_relative_l2": 0.13212692737579346, + "max_abs_delta": 1.25 + }, + "bos_at_s1": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9895250201225281, + "min_cosine_similarity": 0.9797725081443787, + "mean_relative_l2": 0.14270858466625214, + "max_abs_delta": 0.75 + }, + "x_at_s0": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9877611994743347, + "min_cosine_similarity": 0.9714847207069397, + "mean_relative_l2": 0.1540081650018692, + "max_abs_delta": 0.875 + }, + "x_at_s1": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9807984828948975, + "min_cosine_similarity": 0.9630129337310791, + "mean_relative_l2": 0.19432871043682098, + "max_abs_delta": 1.4375 + }, + "period_at_s0": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9881225228309631, + "min_cosine_similarity": 0.970776379108429, + "mean_relative_l2": 0.1522626131772995, + "max_abs_delta": 1.0 + }, + "period_at_s1": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9805311560630798, + "min_cosine_similarity": 0.9594752788543701, + "mean_relative_l2": 0.19489572942256927, + "max_abs_delta": 1.375 + } + } + }, + "layer_12": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3ba9bfbdb36265f291647d63b2856104ef07526f0e356cbc1184e6a3756cab67", + "mean": -0.004552805796265602, + "std": 0.5609484910964966, + "rms": 0.560966968536377, + "max_abs": 14.9375 + }, + "full_input": { + "shape": [ + 49, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0382670aee1b8ba45200674174423a1c7c7e731deab90a03269fada5e7ffc8d5", + "mean": -0.03369203954935074, + "std": 11.495536804199219, + "rms": 11.495586395263672, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "62593d751c473c6fd5ccf0e101d5190c2fafd057634364a67e3de704f9405bbf", + "mean": -0.004389732610434294, + "std": 0.5628811120986938, + "rms": 0.5628982186317444, + "max_abs": 15.0 + }, + "full_input": { + "shape": [ + 65, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "976a5b59075009cb99ff4380895d953176b35a04e739b63c0cd8db3bab918afc", + "mean": -0.030465541407465935, + "std": 10.285890579223633, + "rms": 10.285935401916504, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ad1c0254a5fb1e2f14608ca359b8ab92e05a0d5b640ef2c64bb0e25660b7fa6a", + "mean": -0.004833118990063667, + "std": 0.5584431886672974, + "rms": 0.5584641098976135, + "max_abs": 15.1875 + }, + "full_input": { + "shape": [ + 49, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2959da4bdc04a5a33e040931a1208164833889b887d2f8ba50789532777a7040", + "mean": -0.010301971808075905, + "std": 10.077345848083496, + "rms": 10.077350616455078, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9d2a29aaff85fe43b7aeb4cd9c7e832cba596c5e86281cde7f9b215e7fc5fa41", + "mean": -0.005261916201561689, + "std": 0.561840295791626, + "rms": 0.561864972114563, + "max_abs": 15.25 + }, + "full_input": { + "shape": [ + 65, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f1ebbfc342416f8d5d567da5c99f77619d2e38dd717f6ee801766b14a6c9c1f1", + "mean": -0.010500537231564522, + "std": 8.74232292175293, + "rms": 8.742329597473145, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "95b3450ef835a02bdd3f004f1f912c476d007158090d6ef6e6635d287b721791", + "mean": -0.004956485703587532, + "std": 0.5579153299331665, + "rms": 0.5579373836517334, + "max_abs": 14.875 + }, + "full_input": { + "shape": [ + 49, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9af6fb4e35825d7752a89f94ad72b82efc2b97bddeb4d2be0e69ec96859d6e9a", + "mean": -0.010776204988360405, + "std": 10.077276229858398, + "rms": 10.077281951904297, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "349ab554314ea6b7674f50c9642ec5088c5bd96c6c02623d9a13e12d81e3e944", + "mean": -0.005285257939249277, + "std": 0.5543967485427856, + "rms": 0.5544219613075256, + "max_abs": 14.875 + }, + "full_input": { + "shape": [ + 65, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ec5d63a1aaf3ecff362fb069a17548011fc96e30879464e199cfdb2b77e20be5", + "mean": -0.010724023915827274, + "std": 8.741836547851562, + "rms": 8.741843223571777, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "78d2e1c21ec19407040a5eca5d73b35bd71921e9bb5c4a2408fd83af35169b22", + "mean": -0.00495281582698226, + "std": 0.5549272298812866, + "rms": 0.5549493432044983, + "max_abs": 14.5 + }, + "full_input": { + "shape": [ + 49, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2f1cb877ea468364d5530f4e86a0afd156f3b7ea8e41dce8cdc7894c4d9d1807", + "mean": -0.009999574162065983, + "std": 10.077125549316406, + "rms": 10.077130317687988, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b2fc7e18c3b18c223f7aaffdac78588db46c7ce2396b328dd633f71b4a58b4bf", + "mean": -0.0054914760403335094, + "std": 0.553675651550293, + "rms": 0.5537028908729553, + "max_abs": 14.75 + }, + "full_input": { + "shape": [ + 65, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "656a5de61d89186fce823178e5cc44d6c96d17f8302b27ad98a053a8a48585f5", + "mean": -0.010399588383734226, + "std": 8.741816520690918, + "rms": 8.741823196411133, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9971887469291687, + "min_cosine_similarity": 0.9935004711151123, + "mean_relative_l2": 0.07293470948934555, + "max_abs_delta": 0.4375 + }, + "system_bos": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9946003556251526, + "min_cosine_similarity": 0.9862136840820312, + "mean_relative_l2": 0.10232863575220108, + "max_abs_delta": 0.6875 + }, + "system_x": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9897510409355164, + "min_cosine_similarity": 0.9717646837234497, + "mean_relative_l2": 0.14008039236068726, + "max_abs_delta": 0.953125 + }, + "system_period": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9891738891601562, + "min_cosine_similarity": 0.9729380011558533, + "mean_relative_l2": 0.1455918401479721, + "max_abs_delta": 1.25 + }, + "bos_at_s0": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9905603528022766, + "min_cosine_similarity": 0.9819579124450684, + "mean_relative_l2": 0.1351138949394226, + "max_abs_delta": 0.8125 + }, + "bos_at_s1": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9894533753395081, + "min_cosine_similarity": 0.9744214415550232, + "mean_relative_l2": 0.14294911921024323, + "max_abs_delta": 0.6875 + }, + "x_at_s0": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.987172544002533, + "min_cosine_similarity": 0.9645251035690308, + "mean_relative_l2": 0.157213032245636, + "max_abs_delta": 1.0625 + }, + "x_at_s1": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9804599285125732, + "min_cosine_similarity": 0.9595531225204468, + "mean_relative_l2": 0.19544927775859833, + "max_abs_delta": 1.75 + }, + "period_at_s0": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9876425862312317, + "min_cosine_similarity": 0.9642462730407715, + "mean_relative_l2": 0.15466727316379547, + "max_abs_delta": 1.125 + }, + "period_at_s1": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.979991614818573, + "min_cosine_similarity": 0.9483062028884888, + "mean_relative_l2": 0.19683901965618134, + "max_abs_delta": 1.75 + } + } + }, + "layer_13": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3e1bbd9c7ce155af2fd7b79588cb2dee1e6a14d665cc801376eb7c0a16df0919", + "mean": -0.004560297820717096, + "std": 0.5983363389968872, + "rms": 0.5983537435531616, + "max_abs": 15.5 + }, + "full_input": { + "shape": [ + 49, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7154e2fe0741a10fcff1e09ea0c1f71d7b58e502083e714d0ad5de7b2046a038", + "mean": -0.033352673053741455, + "std": 11.504706382751465, + "rms": 11.504754066467285, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0736f6ac45339a98faead1dd1640ecee7e624819d3064ee226b0bced120bc119", + "mean": -0.004351580981165171, + "std": 0.6006438136100769, + "rms": 0.6006596088409424, + "max_abs": 15.6875 + }, + "full_input": { + "shape": [ + 65, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3a74d938c3793aa36985a47445aab4096a3872387e9046251d2092d4dddddaf3", + "mean": -0.03121977671980858, + "std": 10.294851303100586, + "rms": 10.294898986816406, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a12ea4e0436b502ab62f39543c4fc1a1db782a12ca8129cd3e5c818c8f7bf46b", + "mean": -0.004562306683510542, + "std": 0.5961470007896423, + "rms": 0.5961644053459167, + "max_abs": 15.8125 + }, + "full_input": { + "shape": [ + 49, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5fdd86254ab5c8259f1f7048d40b7e52493f11719a207be73725e51e5273a2fb", + "mean": -0.009918957017362118, + "std": 10.08541488647461, + "rms": 10.085419654846191, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "de431e0f996ca490638e883af6e44257ed95a7d5cd4f2edd1277c75a30037397", + "mean": -0.004950817208737135, + "std": 0.6004916429519653, + "rms": 0.6005120277404785, + "max_abs": 15.8125 + }, + "full_input": { + "shape": [ + 65, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cfef9eed826096a7009cdbb5fa733827dea34d9c81465c9fef6889fcd8913e9c", + "mean": -0.011166277341544628, + "std": 8.750465393066406, + "rms": 8.750473022460938, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "86d6f19ba9ce706eb1b4e2a0ebdc8abaafdd4e65bd10d062445a6aff2c95e81c", + "mean": -0.004746625665575266, + "std": 0.5943477749824524, + "rms": 0.594366729259491, + "max_abs": 16.125 + }, + "full_input": { + "shape": [ + 49, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5bc438b59b454e1201c2439de17456db897259a7075f4506f0654d3c606b4602", + "mean": -0.010638643056154251, + "std": 10.085418701171875, + "rms": 10.085424423217773, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "76cea807d579fc7fc0c979f63a7b6543cff230b36e7e9a0b55b58c284e446fe3", + "mean": -0.004447415936738253, + "std": 0.5919073224067688, + "rms": 0.5919240713119507, + "max_abs": 16.0 + }, + "full_input": { + "shape": [ + 65, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "24da7d1252ad7bfcb1cb33b4ac958f9fbb836ca6345d67533bb6d62885fc5fc0", + "mean": -0.011292364448308945, + "std": 8.750048637390137, + "rms": 8.750056266784668, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f3cfb41c54aeed11e021659d72cfc015659134352160a1bdb8b79371fb4bbc40", + "mean": -0.0044198366813361645, + "std": 0.5915964245796204, + "rms": 0.5916129350662231, + "max_abs": 15.75 + }, + "full_input": { + "shape": [ + 49, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c8d57cb6fac43bfa6cc474f246c5fa31b8e533d90b4d5f3018c42aad5f3f8fae", + "mean": -0.009632491506636143, + "std": 10.085219383239746, + "rms": 10.085223197937012, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fcbaf2c92050a368a340a0c0061a378374e424023be75196508c40e3f25f3386", + "mean": -0.004532873164862394, + "std": 0.5905036926269531, + "rms": 0.5905210971832275, + "max_abs": 15.9375 + }, + "full_input": { + "shape": [ + 65, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "73e0eecba755ac1512ea65c823f26d7a82917f054f8e707c31486d5d0cf87961", + "mean": -0.011027444154024124, + "std": 8.749994277954102, + "rms": 8.750000953674316, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9970307350158691, + "min_cosine_similarity": 0.9909039735794067, + "mean_relative_l2": 0.07438657432794571, + "max_abs_delta": 0.40625 + }, + "system_bos": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9946429133415222, + "min_cosine_similarity": 0.9863057136535645, + "mean_relative_l2": 0.10194090008735657, + "max_abs_delta": 0.75 + }, + "system_x": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9896945357322693, + "min_cosine_similarity": 0.9733153581619263, + "mean_relative_l2": 0.14057780802249908, + "max_abs_delta": 1.3125 + }, + "system_period": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9888822436332703, + "min_cosine_similarity": 0.9745395183563232, + "mean_relative_l2": 0.14710702002048492, + "max_abs_delta": 1.1875 + }, + "bos_at_s0": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9908626675605774, + "min_cosine_similarity": 0.9818719625473022, + "mean_relative_l2": 0.13237659633159637, + "max_abs_delta": 1.125 + }, + "bos_at_s1": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9900641441345215, + "min_cosine_similarity": 0.972449541091919, + "mean_relative_l2": 0.13843277096748352, + "max_abs_delta": 0.71875 + }, + "x_at_s0": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9876914620399475, + "min_cosine_similarity": 0.9618780016899109, + "mean_relative_l2": 0.15363606810569763, + "max_abs_delta": 1.625 + }, + "x_at_s1": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9807948470115662, + "min_cosine_similarity": 0.9577503204345703, + "mean_relative_l2": 0.19323031604290009, + "max_abs_delta": 2.625 + }, + "period_at_s0": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.988142728805542, + "min_cosine_similarity": 0.9620088338851929, + "mean_relative_l2": 0.15108536183834076, + "max_abs_delta": 1.6875 + }, + "period_at_s1": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9799862504005432, + "min_cosine_similarity": 0.94340580701828, + "mean_relative_l2": 0.19598551094532013, + "max_abs_delta": 2.75 + } + } + }, + "layer_14": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "10d3e1605c9e67cb3370fad39538a6ff0bfb434c3c617db44cc30312dd15dbc7", + "mean": -0.0016719208797439933, + "std": 0.6830633282661438, + "rms": 0.6830653548240662, + "max_abs": 19.75 + }, + "full_input": { + "shape": [ + 49, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e0f157d5fa8aae390073ac2adfbb6bdf0c357d93231fb63d97ff263ccc8d6ee6", + "mean": -0.030636373907327652, + "std": 11.528037071228027, + "rms": 11.528078079223633, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5acc3a4752c39d34cb384f5de627644de09f0ada37389e239b0a2236a11f35b8", + "mean": -0.0014309631660580635, + "std": 0.6850152611732483, + "rms": 0.6850167512893677, + "max_abs": 20.0 + }, + "full_input": { + "shape": [ + 65, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6425bca96af318acead16d57d9280ffcea584bf9b6103e40f2219ab3a54b61e3", + "mean": -0.029527094215154648, + "std": 10.314945220947266, + "rms": 10.314988136291504, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f52e088d522258280b8126adcf2698b5eb65dc324bb7b7b458201770bcdd5a6a", + "mean": -0.0014578684931620955, + "std": 0.6806482672691345, + "rms": 0.6806498169898987, + "max_abs": 20.0 + }, + "full_input": { + "shape": [ + 49, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5307fe00bf29b4eaca595e9ade3c77c3d676db155e7d123dc01377436e6416a8", + "mean": -0.0070618875324726105, + "std": 10.110559463500977, + "rms": 10.110562324523926, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b43d94cfc954fcb555dbc112b487c69a732657ca4e4d5315ac149f4e0463c342", + "mean": -0.0021495718974620104, + "std": 0.6855710744857788, + "rms": 0.6855744123458862, + "max_abs": 20.0 + }, + "full_input": { + "shape": [ + 65, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4ace57b9999f4926ab00963d767c48c02c6d1cadfeac48449598ef674d395a85", + "mean": -0.009385919198393822, + "std": 8.77285099029541, + "rms": 8.772855758666992, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "116ef352ed867890bfdeee96e21addc7d8b79b0d792a56e6abd72d0e2439b9d5", + "mean": -0.0015267549315467477, + "std": 0.6781583428382874, + "rms": 0.6781601309776306, + "max_abs": 20.375 + }, + "full_input": { + "shape": [ + 49, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1eab0c34e2bf7fd220f67fc26c860dee91c288a2ef6fa67197e19d50c267f408", + "mean": -0.0077626267448067665, + "std": 10.110590934753418, + "rms": 10.110594749450684, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2860e952d83344430141f33ef511bd5f905a152ce4353d9e58d8e972c7ba58b3", + "mean": -0.0011228924850001931, + "std": 0.675355851650238, + "rms": 0.6753568053245544, + "max_abs": 20.25 + }, + "full_input": { + "shape": [ + 65, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6283d5a581b548aec5c2f77e681ccc9038b10ae7d8a439139bb86fe597010a29", + "mean": -0.009306639432907104, + "std": 8.772421836853027, + "rms": 8.77242660522461, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f32be417501196160ebf294a7e03fc978337ee8d50a22602f2597874078bd143", + "mean": -0.001392936334013939, + "std": 0.6754670739173889, + "rms": 0.6754685044288635, + "max_abs": 19.75 + }, + "full_input": { + "shape": [ + 49, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d19e574e9d792f89df8d432a32a6ac0f68e35cfe78aa5090314081da41346440", + "mean": -0.006846293341368437, + "std": 10.110371589660645, + "rms": 10.110374450683594, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3351efb653681f374515a1b344b8a5b6e9a97ff5c23f63f82904e4ef5114e897", + "mean": -0.0011175969848409295, + "std": 0.672600507736206, + "rms": 0.6726014018058777, + "max_abs": 19.875 + }, + "full_input": { + "shape": [ + 65, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6d8ba4e6aa0f7a1255206b8c46d6ae6cef00a7626c4bf13846ac26b53726886d", + "mean": -0.009155935607850552, + "std": 8.7722749710083, + "rms": 8.772279739379883, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9970501065254211, + "min_cosine_similarity": 0.992200493812561, + "mean_relative_l2": 0.0745386853814125, + "max_abs_delta": 0.5 + }, + "system_bos": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9949209094047546, + "min_cosine_similarity": 0.9884512424468994, + "mean_relative_l2": 0.09936589747667313, + "max_abs_delta": 0.9375 + }, + "system_x": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9897453784942627, + "min_cosine_similarity": 0.9755384922027588, + "mean_relative_l2": 0.14062072336673737, + "max_abs_delta": 1.3125 + }, + "system_period": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9887149930000305, + "min_cosine_similarity": 0.9743456840515137, + "mean_relative_l2": 0.14775331318378448, + "max_abs_delta": 1.3125 + }, + "bos_at_s0": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9917096495628357, + "min_cosine_similarity": 0.9833888411521912, + "mean_relative_l2": 0.12625952064990997, + "max_abs_delta": 1.4375 + }, + "bos_at_s1": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9907771944999695, + "min_cosine_similarity": 0.9743640422821045, + "mean_relative_l2": 0.13331551849842072, + "max_abs_delta": 0.875 + }, + "x_at_s0": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9886541366577148, + "min_cosine_similarity": 0.9637876749038696, + "mean_relative_l2": 0.14734074473381042, + "max_abs_delta": 2.0625 + }, + "x_at_s1": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9819634556770325, + "min_cosine_similarity": 0.9620486497879028, + "mean_relative_l2": 0.18725192546844482, + "max_abs_delta": 3.125 + }, + "period_at_s0": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9890305995941162, + "min_cosine_similarity": 0.9638317823410034, + "mean_relative_l2": 0.14536036550998688, + "max_abs_delta": 2.1875 + }, + "period_at_s1": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9809791445732117, + "min_cosine_similarity": 0.9487200975418091, + "mean_relative_l2": 0.19116497039794922, + "max_abs_delta": 3.25 + } + } + }, + "layer_15": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a108bc48d5dae2094d11148bda4b3fdd843ae6d4dbb68fb777d7b5b3184a8dec", + "mean": -0.0009388184989802539, + "std": 0.7648046612739563, + "rms": 0.7648051977157593, + "max_abs": 23.5 + }, + "full_input": { + "shape": [ + 49, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5c37be0c4cfee3be5dbd07280523fcd03396e0b89cf8642b05af415346d8e785", + "mean": -0.029071038588881493, + "std": 11.537132263183594, + "rms": 11.537169456481934, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8cfbc07b12304f2a9bf6f2971928414d95504bd628d1d74a22842ee7f4807082", + "mean": -0.0011096535017713904, + "std": 0.7666681408882141, + "rms": 0.7666689157485962, + "max_abs": 23.625 + }, + "full_input": { + "shape": [ + 65, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6921c2cc24e1482f3fbb018a6f8b8b4ade3b2522b0dfb5a935929dc437ad9e94", + "mean": -0.029068727046251297, + "std": 10.324593544006348, + "rms": 10.324633598327637, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "39ed153971fbbf802c270e46da406b249296b9059d8721546b56fb6bdfd8f527", + "mean": -0.0007213012431748211, + "std": 0.7632641792297363, + "rms": 0.7632644772529602, + "max_abs": 23.75 + }, + "full_input": { + "shape": [ + 49, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bae574d96d0ffd6c839153a4ddb3d48e091dec5a9b575253f8ab7ac4bb775172", + "mean": -0.005715592764317989, + "std": 10.120034217834473, + "rms": 10.120036125183105, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a2e09bcf0e429e7d64f3d9fd5b5990b90ad36fa1343b54bd268514a464245842", + "mean": -0.00208927015773952, + "std": 0.7678792476654053, + "rms": 0.7678820490837097, + "max_abs": 23.75 + }, + "full_input": { + "shape": [ + 65, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f3715556896d0c47e76beaccd219fea07dd88a7df72252a48b4a74169b869fc8", + "mean": -0.009236178360879421, + "std": 8.782998085021973, + "rms": 8.783002853393555, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5aae3d79f7d286956aebf2fd4f543a0913e453cd7f11d894efa37e5e3432a31a", + "mean": -0.00043247020221315324, + "std": 0.7587080597877502, + "rms": 0.7587081789970398, + "max_abs": 24.125 + }, + "full_input": { + "shape": [ + 49, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a11248d4cd67b01b8f8692a3c8243f0d704401378c6e3b2aae0203be5f53033e", + "mean": -0.0061552939005196095, + "std": 10.119902610778809, + "rms": 10.119904518127441, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "282964d5d6a7ab3e01192c939f208a835302c2690c0bb16400421a8e2fbfc30d", + "mean": -0.0012817984679713845, + "std": 0.7525249719619751, + "rms": 0.752526044845581, + "max_abs": 24.25 + }, + "full_input": { + "shape": [ + 65, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d66af6010f645b1c3a0e21474c26e20c843399d24f8c94eaa6cb48ffdc9f9ed0", + "mean": -0.009197266772389412, + "std": 8.782270431518555, + "rms": 8.782276153564453, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ad35b97801c79b58d46f5514664d7d3818fb269530ddedacf6a0efda8b91f53e", + "mean": -0.00047890408313833177, + "std": 0.7570813298225403, + "rms": 0.7570815086364746, + "max_abs": 23.5 + }, + "full_input": { + "shape": [ + 49, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "25470e5472e32db9bb3836bb45360b608fa77c3ab3a1e5416219d50b4e0b9eb0", + "mean": -0.005245876498520374, + "std": 10.11971378326416, + "rms": 10.119715690612793, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ed54c68907e21a6739e10895884405ecfa807dfad13212e778bcf82b53681f46", + "mean": -0.0011623756727203727, + "std": 0.7490692734718323, + "rms": 0.7490701079368591, + "max_abs": 23.5 + }, + "full_input": { + "shape": [ + 65, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bf21b071465282feb2d5564d030b550862f3a21169debf03ef61dad973f2d401", + "mean": -0.00882408581674099, + "std": 8.782140731811523, + "rms": 8.782145500183105, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9969190955162048, + "min_cosine_similarity": 0.9920653104782104, + "mean_relative_l2": 0.07625532895326614, + "max_abs_delta": 0.75 + }, + "system_bos": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.994884192943573, + "min_cosine_similarity": 0.9899580478668213, + "mean_relative_l2": 0.09964137524366379, + "max_abs_delta": 1.125 + }, + "system_x": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.989164412021637, + "min_cosine_similarity": 0.9706956148147583, + "mean_relative_l2": 0.14375613629817963, + "max_abs_delta": 2.0 + }, + "system_period": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9885509014129639, + "min_cosine_similarity": 0.9748820066452026, + "mean_relative_l2": 0.14820654690265656, + "max_abs_delta": 1.75 + }, + "bos_at_s0": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9921252727508545, + "min_cosine_similarity": 0.9844551682472229, + "mean_relative_l2": 0.12305447459220886, + "max_abs_delta": 1.625 + }, + "bos_at_s1": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9910055994987488, + "min_cosine_similarity": 0.9704073667526245, + "mean_relative_l2": 0.13102979958057404, + "max_abs_delta": 1.0 + }, + "x_at_s0": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9894540905952454, + "min_cosine_similarity": 0.9633609652519226, + "mean_relative_l2": 0.14158113300800323, + "max_abs_delta": 2.25 + }, + "x_at_s1": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9823169112205505, + "min_cosine_similarity": 0.9576281309127808, + "mean_relative_l2": 0.18399900197982788, + "max_abs_delta": 3.5 + }, + "period_at_s0": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.989794909954071, + "min_cosine_similarity": 0.96424400806427, + "mean_relative_l2": 0.1400260627269745, + "max_abs_delta": 2.375 + }, + "period_at_s1": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9816274642944336, + "min_cosine_similarity": 0.9468047618865967, + "mean_relative_l2": 0.18708355724811554, + "max_abs_delta": 3.625 + } + } + }, + "layer_16": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "35afa8ebc9b3d15ee51de211ff41afc5778f52f40e52b6ebcd1bcce9a5897bf0", + "mean": -0.0003577250463422388, + "std": 0.857036292552948, + "rms": 0.8570363521575928, + "max_abs": 27.25 + }, + "full_input": { + "shape": [ + 49, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "40a370e1aa7702e64abfd27136cb29c4ae10bfdbf35363592924afbfa4984057", + "mean": -0.02813422866165638, + "std": 11.547769546508789, + "rms": 11.54780387878418, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "71e61c8d76536d0cda3744568e6c1b512f5ad7d2ff166b4ea789033fda2f49bd", + "mean": -0.0004521763476077467, + "std": 0.8580000996589661, + "rms": 0.8580002188682556, + "max_abs": 27.875 + }, + "full_input": { + "shape": [ + 65, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "82d71af478f5f969aeb178d3041b62e03c45d79475e5a5439b122542fb837779", + "mean": -0.02789131924510002, + "std": 10.33509635925293, + "rms": 10.335134506225586, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7a09b7d5ac4b7d42d315e0e3380c9b2b4c84206be80a0c03f11269b9a1c77d8c", + "mean": 0.00023235131811816245, + "std": 0.8531715869903564, + "rms": 0.8531715869903564, + "max_abs": 26.75 + }, + "full_input": { + "shape": [ + 49, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0d79e51a272424d4cfba162e012c66f4a0456152406c52d5c32feb0eca24b252", + "mean": -0.004537921864539385, + "std": 10.130509376525879, + "rms": 10.130510330200195, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "146764fb8b3528dbc4487e0feece17b7964e4f7b19f249ebb4992c3c4509c49a", + "mean": -0.0010894337901845574, + "std": 0.8589576482772827, + "rms": 0.85895836353302, + "max_abs": 27.0 + }, + "full_input": { + "shape": [ + 65, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "48cf25ba6f9dacb75c36409f017e184e5031b08351c2906e82696448ab809ccc", + "mean": -0.007784747052937746, + "std": 8.794142723083496, + "rms": 8.794146537780762, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cbc54f954284c3dfa2c5e2fe885f511949a3123740d91a8e811aa33a32fb0c35", + "mean": 0.00037199072539806366, + "std": 0.8507857322692871, + "rms": 0.8507857918739319, + "max_abs": 26.75 + }, + "full_input": { + "shape": [ + 49, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1033b3a644d92dc645b3cb002df3f25166fcc89847560ef9e1804c6d443fbbb2", + "mean": -0.005139990244060755, + "std": 10.130691528320312, + "rms": 10.130692481994629, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b231d12118dece0e16a1d14f8a99bd9db07f9962fc88790228b7f23af972d043", + "mean": -0.00035764588392339647, + "std": 0.8446028232574463, + "rms": 0.8446029424667358, + "max_abs": 26.75 + }, + "full_input": { + "shape": [ + 65, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d645de970de1c622766a6a317761a20c51b7ffa350f3e0b9a628b814aa12ca78", + "mean": -0.007997672073543072, + "std": 8.793642044067383, + "rms": 8.793644905090332, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c4d6f4d11dff762b775c2a8cd4b2407a7428d3a3f0d1183c5abda1bd2ab1ac3c", + "mean": 0.0004998290096409619, + "std": 0.8503395915031433, + "rms": 0.8503397703170776, + "max_abs": 26.25 + }, + "full_input": { + "shape": [ + 49, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ab249b8a1d67d2a48358c150a6456f065cee1c952057c168f3408700fbad0396", + "mean": -0.004108273424208164, + "std": 10.13034439086914, + "rms": 10.13034439086914, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8056a708b6db317c661f32df807e714001facb1e390bbbaf2275ef61506bebb0", + "mean": -0.00016842658806126565, + "std": 0.8405296802520752, + "rms": 0.8405296206474304, + "max_abs": 26.0 + }, + "full_input": { + "shape": [ + 65, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4c3c7686949e1e506f2852426d0752b41593804ebc0195b4b8fdee8bbec21107", + "mean": -0.0074599203653633595, + "std": 8.79332447052002, + "rms": 8.793327331542969, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9966399073600769, + "min_cosine_similarity": 0.9911367893218994, + "mean_relative_l2": 0.07952290028333664, + "max_abs_delta": 0.71875 + }, + "system_bos": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9947468638420105, + "min_cosine_similarity": 0.9894804358482361, + "mean_relative_l2": 0.10074161738157272, + "max_abs_delta": 1.125 + }, + "system_x": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9888598322868347, + "min_cosine_similarity": 0.9696884155273438, + "mean_relative_l2": 0.14544041454792023, + "max_abs_delta": 1.875 + }, + "system_period": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9884149432182312, + "min_cosine_similarity": 0.9727782607078552, + "mean_relative_l2": 0.1486358791589737, + "max_abs_delta": 2.0 + }, + "bos_at_s0": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.992046058177948, + "min_cosine_similarity": 0.98263019323349, + "mean_relative_l2": 0.1233963593840599, + "max_abs_delta": 1.875 + }, + "bos_at_s1": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9910879731178284, + "min_cosine_similarity": 0.9699680209159851, + "mean_relative_l2": 0.13025686144828796, + "max_abs_delta": 1.5 + }, + "x_at_s0": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.989604651927948, + "min_cosine_similarity": 0.9665465950965881, + "mean_relative_l2": 0.14070723950862885, + "max_abs_delta": 2.4375 + }, + "x_at_s1": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9826673865318298, + "min_cosine_similarity": 0.9585496187210083, + "mean_relative_l2": 0.18204116821289062, + "max_abs_delta": 3.875 + }, + "period_at_s0": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.989741325378418, + "min_cosine_similarity": 0.9674746990203857, + "mean_relative_l2": 0.1404065191745758, + "max_abs_delta": 2.5625 + }, + "period_at_s1": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9820423722267151, + "min_cosine_similarity": 0.948143482208252, + "mean_relative_l2": 0.18478424847126007, + "max_abs_delta": 4.0 + } + } + }, + "layer_17": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2ba19223e2d2d2a163d3dfac2e01a6cfcd4dbcda598aeb0b582c86f2dfd23eff", + "mean": -0.0017362391809001565, + "std": 0.9880284070968628, + "rms": 0.988029956817627, + "max_abs": 33.0 + }, + "full_input": { + "shape": [ + 49, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9e81a557ba78b88329809d7547f500bb0554619a035d0f3b87fe1320f0c6a593", + "mean": -0.029654541984200478, + "std": 11.560822486877441, + "rms": 11.560860633850098, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fd0bd401d9757577d78863802afc65bcab55f90795bd81d0c80356aaf100e4d3", + "mean": -0.002084654988721013, + "std": 0.9876520037651062, + "rms": 0.9876542091369629, + "max_abs": 33.5 + }, + "full_input": { + "shape": [ + 65, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "276c52a59b52446284cd5e63123b9171708ccce175629ea03ad9c890dec4e407", + "mean": -0.030308270826935768, + "std": 10.348912239074707, + "rms": 10.348957061767578, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bf2a80c7890bf7c6bcb6d9723182fadfad0111ade6b9d68f66ab72959bbfb720", + "mean": -0.0009532738476991653, + "std": 0.9839023351669312, + "rms": 0.9839028120040894, + "max_abs": 32.25 + }, + "full_input": { + "shape": [ + 49, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "aa92ae3031e18d2854686d6cc26e2ee3681e47155e78ae654e86aaca8804f78d", + "mean": -0.005886532831937075, + "std": 10.144474983215332, + "rms": 10.144476890563965, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "30e8b9766afb46f0ee64e42cc4f80e23ce28c6d10527cdf0a7a5693f54c60324", + "mean": -0.002262347610667348, + "std": 0.9918822050094604, + "rms": 0.9918847680091858, + "max_abs": 32.25 + }, + "full_input": { + "shape": [ + 65, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8418eca681d7272c3e0acd5e5a23ee23a800394ceb58d019a85500ef5e042929", + "mean": -0.010124833323061466, + "std": 8.809730529785156, + "rms": 8.809736251831055, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "505edb1ff645f47d8e6345ea4d8d4d169b5d69a520a5725021049e55fd5951f7", + "mean": -0.0015799682587385178, + "std": 0.981600821018219, + "rms": 0.981602132320404, + "max_abs": 32.0 + }, + "full_input": { + "shape": [ + 49, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "237658556eec8703fe25aac6ad222c63817a4fb48a480f82f8d0a44804e2ed0f", + "mean": -0.0069182817824184895, + "std": 10.144805908203125, + "rms": 10.144808769226074, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9d249ec9a79579935527490102498795237c24663e7ff49ea678d5942fb49981", + "mean": -0.0019045248627662659, + "std": 0.9785985946655273, + "rms": 0.9786005020141602, + "max_abs": 29.5 + }, + "full_input": { + "shape": [ + 65, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e6e28769541a79d7e27a15ddd69197357d3145e3cd11c85eccc16d4edac2a7e3", + "mean": -0.010548916645348072, + "std": 8.809366226196289, + "rms": 8.809371948242188, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "797b753ad4f0c879807ac9b8f1e535e9791525f8d07cebf7f1f52dcbb844bd47", + "mean": -0.0010467147221788764, + "std": 0.9819402098655701, + "rms": 0.981940746307373, + "max_abs": 31.5 + }, + "full_input": { + "shape": [ + 49, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "853fbf822dcff98fb1e72610362990197efc3ebe2ef8e5d16073fccc1007b6d2", + "mean": -0.005699038505554199, + "std": 10.144418716430664, + "rms": 10.144420623779297, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6847f30c75c5f16c56c6b1c8fc3f464021fdbf78a042d03be527c1740368ee5b", + "mean": -0.0018511321395635605, + "std": 0.9765441417694092, + "rms": 0.9765458703041077, + "max_abs": 29.0 + }, + "full_input": { + "shape": [ + 65, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3315fae6e6d77b7ca0f15b1fba3bb1ccf4ba666aabd3ec0120ee396b67003463", + "mean": -0.009970670565962791, + "std": 8.809133529663086, + "rms": 8.809139251708984, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9966122508049011, + "min_cosine_similarity": 0.9916835427284241, + "mean_relative_l2": 0.07905681431293488, + "max_abs_delta": 0.71875 + }, + "system_bos": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9948756098747253, + "min_cosine_similarity": 0.9875980019569397, + "mean_relative_l2": 0.09904533624649048, + "max_abs_delta": 1.15625 + }, + "system_x": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9892191290855408, + "min_cosine_similarity": 0.9733406901359558, + "mean_relative_l2": 0.14318609237670898, + "max_abs_delta": 2.5 + }, + "system_period": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9891813397407532, + "min_cosine_similarity": 0.9729824662208557, + "mean_relative_l2": 0.143697589635849, + "max_abs_delta": 2.5 + }, + "bos_at_s0": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9924167990684509, + "min_cosine_similarity": 0.9821048378944397, + "mean_relative_l2": 0.11996141821146011, + "max_abs_delta": 2.25 + }, + "bos_at_s1": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9914289116859436, + "min_cosine_similarity": 0.9731848239898682, + "mean_relative_l2": 0.12758825719356537, + "max_abs_delta": 1.5 + }, + "x_at_s0": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9900930523872375, + "min_cosine_similarity": 0.9681832194328308, + "mean_relative_l2": 0.13695834577083588, + "max_abs_delta": 2.625 + }, + "x_at_s1": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9835763573646545, + "min_cosine_similarity": 0.9636228084564209, + "mean_relative_l2": 0.17774838209152222, + "max_abs_delta": 4.125 + }, + "period_at_s0": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9901845455169678, + "min_cosine_similarity": 0.9690734148025513, + "mean_relative_l2": 0.13709954917430878, + "max_abs_delta": 2.75 + }, + "period_at_s1": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9829375743865967, + "min_cosine_similarity": 0.9500102400779724, + "mean_relative_l2": 0.18046100437641144, + "max_abs_delta": 4.5 + } + } + }, + "layer_18": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cab8f9868c4a4742465b4002c4be6e97be6f6e9244f21aed24e2853ef8e49c53", + "mean": 0.0007747269119136035, + "std": 1.1250085830688477, + "rms": 1.1250088214874268, + "max_abs": 38.25 + }, + "full_input": { + "shape": [ + 49, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3ce1de1fefdf7d68cd15dae57bb55b056b37aadcc9096be2d4b3b019376aa8a8", + "mean": -0.028381625190377235, + "std": 11.580392837524414, + "rms": 11.580428123474121, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5f8cd8a7dd7f90744870b4114819390ad15754c3676ad0d03ecd652c045ab9a1", + "mean": 2.787075936794281e-05, + "std": 1.123034119606018, + "rms": 1.1230342388153076, + "max_abs": 39.0 + }, + "full_input": { + "shape": [ + 65, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f67de1b6253e6c31d3e2f70aeed24a1da5715fc877db1aefcd6c8fb9dad7e57e", + "mean": -0.029172634705901146, + "std": 10.36875057220459, + "rms": 10.368791580200195, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b8cee1ccb21b77308a36eb6f1b50aa823e53b7acebc63f9c13033b918a4b694b", + "mean": 0.0011908734450116754, + "std": 1.1244765520095825, + "rms": 1.1244771480560303, + "max_abs": 37.25 + }, + "full_input": { + "shape": [ + 49, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9b2b629d10a467bc5a8166637e3936c7194098ce11d99d3e1526fc5de0878077", + "mean": -0.004301409237086773, + "std": 10.162846565246582, + "rms": 10.162848472595215, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b6708f2c47602a440221b510b51bd1deb8514d9e633174bfb4f70e0171ca8e32", + "mean": -0.0004859554173890501, + "std": 1.13161039352417, + "rms": 1.13161039352417, + "max_abs": 38.0 + }, + "full_input": { + "shape": [ + 65, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e503769480f0abd0dac37240b43bf2d7be957b6720651ebd39211be4695c4a89", + "mean": -0.008936267346143723, + "std": 8.829639434814453, + "rms": 8.829644203186035, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e9b5ec293febc4c9d3cdc6c612406232691f0fd7196b7a7303542770aa21d15e", + "mean": 0.0014461589744314551, + "std": 1.1204265356063843, + "rms": 1.1204274892807007, + "max_abs": 36.75 + }, + "full_input": { + "shape": [ + 49, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7bcbcce04b41f574791d8025f269eeada11b64aabaa69ab483221ef703f3c12d", + "mean": -0.005191398318856955, + "std": 10.163125991821289, + "rms": 10.163126945495605, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "98417ba65216f0adef43cd92c326bf7cb0817e986fa8076ed73831d3a03d7db0", + "mean": -0.00019624705601017922, + "std": 1.1107046604156494, + "rms": 1.1107046604156494, + "max_abs": 33.5 + }, + "full_input": { + "shape": [ + 65, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "76b7cd83b84a4999a6f62fb95517c19c2271f0617a85922566574ec3b8a867dc", + "mean": -0.009174473583698273, + "std": 8.828967094421387, + "rms": 8.828971862792969, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "396a14f1b871328bf02731f8a6134bbf1e8f03a044d0a2bf715fb202bfc84319", + "mean": 0.0012431690702214837, + "std": 1.1207250356674194, + "rms": 1.1207257509231567, + "max_abs": 36.0 + }, + "full_input": { + "shape": [ + 49, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d57321d199060d737e3d46909e88c020cc99054ad0443f2407f99f8b3d8c8ff5", + "mean": -0.004453176166862249, + "std": 10.162803649902344, + "rms": 10.162805557250977, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "29aa50309545e79999258fa393740f6bcbd0fd11b634d57b0f6eca000be6fb19", + "mean": -2.3876005798229016e-05, + "std": 1.1084433794021606, + "rms": 1.1084433794021606, + "max_abs": 33.0 + }, + "full_input": { + "shape": [ + 65, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e61df74435f970d347e35b0687d4aa19930a9ba9d6058ce38deadc640a152bb9", + "mean": -0.008801992051303387, + "std": 8.828485488891602, + "rms": 8.828489303588867, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9965190887451172, + "min_cosine_similarity": 0.9928506016731262, + "mean_relative_l2": 0.08072000741958618, + "max_abs_delta": 0.9375 + }, + "system_bos": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9949271082878113, + "min_cosine_similarity": 0.9867101907730103, + "mean_relative_l2": 0.09883783012628555, + "max_abs_delta": 1.5 + }, + "system_x": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9892628192901611, + "min_cosine_similarity": 0.9753315448760986, + "mean_relative_l2": 0.14331789314746857, + "max_abs_delta": 3.25 + }, + "system_period": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9889077544212341, + "min_cosine_similarity": 0.9733715057373047, + "mean_relative_l2": 0.14562039077281952, + "max_abs_delta": 3.0 + }, + "bos_at_s0": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9927155375480652, + "min_cosine_similarity": 0.9818892478942871, + "mean_relative_l2": 0.1179974377155304, + "max_abs_delta": 2.25 + }, + "bos_at_s1": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9916056990623474, + "min_cosine_similarity": 0.9779864549636841, + "mean_relative_l2": 0.12736041843891144, + "max_abs_delta": 1.875 + }, + "x_at_s0": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9905853867530823, + "min_cosine_similarity": 0.9734667539596558, + "mean_relative_l2": 0.1347164809703827, + "max_abs_delta": 3.0 + }, + "x_at_s1": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.984128475189209, + "min_cosine_similarity": 0.9689570665359497, + "mean_relative_l2": 0.17530328035354614, + "max_abs_delta": 5.5 + }, + "period_at_s0": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9906556606292725, + "min_cosine_similarity": 0.974388599395752, + "mean_relative_l2": 0.13490253686904907, + "max_abs_delta": 3.0 + }, + "period_at_s1": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9832970499992371, + "min_cosine_similarity": 0.9569728374481201, + "mean_relative_l2": 0.17937695980072021, + "max_abs_delta": 6.0 + } + } + }, + "layer_19": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "191ff03dc3c2e60632dbed4870cf0964b340a717ed41309f2092a6d39abd2fa7", + "mean": 0.004581478890031576, + "std": 1.2364428043365479, + "rms": 1.2364511489868164, + "max_abs": 36.5 + }, + "full_input": { + "shape": [ + 49, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ceed3754bc64fdb8dc0504a4369780f3e571c0ff485619835f342b93f3da4622", + "mean": -0.025576457381248474, + "std": 11.586437225341797, + "rms": 11.586464881896973, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0e3547da88cd613a3852980fe75ddde7cb726d3c3bf6f6c92353dc328da5356e", + "mean": 0.0036631387192755938, + "std": 1.2353817224502563, + "rms": 1.2353872060775757, + "max_abs": 37.75 + }, + "full_input": { + "shape": [ + 65, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b96d8131184118298d3dc8d1e69b289277685bbd9d06afa97db2dfad16ed8677", + "mean": -0.026347022503614426, + "std": 10.377448081970215, + "rms": 10.377481460571289, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "35e1669210a02d3e45b85c71ab5b076097173fde670ebd420ace8e80c64f5a77", + "mean": 0.0056789168156683445, + "std": 1.2365466356277466, + "rms": 1.2365597486495972, + "max_abs": 35.25 + }, + "full_input": { + "shape": [ + 49, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "74e12f1ba74c344d448c1a6fae0f5f69c2c1383c4b43060b73f8cb57c3842ac5", + "mean": -0.0016283520963042974, + "std": 10.170309066772461, + "rms": 10.170309066772461, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ec5e227f4f45d274c2c61aa704d8b69d005773b1b105e4f05ccbda9686a8c0d3", + "mean": 0.00392403407022357, + "std": 1.2437176704406738, + "rms": 1.243723750114441, + "max_abs": 36.5 + }, + "full_input": { + "shape": [ + 65, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "923a59a9c60c05d747568281fcb5e8aee99595079bb4d0d37f58c8f5ed6684bb", + "mean": -0.005785033106803894, + "std": 8.8396635055542, + "rms": 8.839666366577148, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6854da3118e7ba4036f189dab61921ac5116194950d40208dc51505e67d12d92", + "mean": 0.005848777946084738, + "std": 1.2332477569580078, + "rms": 1.2332615852355957, + "max_abs": 34.5 + }, + "full_input": { + "shape": [ + 49, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3c5d5dfedcdc38d9323e5e2c3132e16145ae666342db65701b103e2c8b02a59b", + "mean": -0.0024224696680903435, + "std": 10.170951843261719, + "rms": 10.170951843261719, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "10852218eb51a4ccd8a84a738801b68b0a759f1a5586c4b55a970036d868d5ee", + "mean": 0.004099200014024973, + "std": 1.2251622676849365, + "rms": 1.2251691818237305, + "max_abs": 30.625 + }, + "full_input": { + "shape": [ + 65, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "474010be3aec9e05955d482c9459602798bbdfac06b0b300f5d60784ad2acddc", + "mean": -0.005992586258798838, + "std": 8.83908462524414, + "rms": 8.83908748626709, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7ed5694d6a08eb83a59af89c8f32e9201fcd71cc8cdd10253cc90d6192ee1b2b", + "mean": 0.005663043353706598, + "std": 1.232996940612793, + "rms": 1.233009934425354, + "max_abs": 33.75 + }, + "full_input": { + "shape": [ + 49, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fd48b6882dd223e9fe450229245604faa6c9356b1fe900a83f0c8c53fea01a74", + "mean": -0.002050242153927684, + "std": 10.170393943786621, + "rms": 10.170393943786621, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "063a57d5a1cbe1592a5a0e1f46247455a4de4536e0e93bbedd84d3a9981cc240", + "mean": 0.003433703677728772, + "std": 1.2213588953018188, + "rms": 1.2213636636734009, + "max_abs": 30.625 + }, + "full_input": { + "shape": [ + 65, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "aa776c7b48b3d6ae567b04a8c5edde7117a778bfbe2b007fec87d8f7293fbe61", + "mean": -0.006344856694340706, + "std": 8.83862018585205, + "rms": 8.838622093200684, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9963458180427551, + "min_cosine_similarity": 0.992958664894104, + "mean_relative_l2": 0.08275929093360901, + "max_abs_delta": 1.25 + }, + "system_bos": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9944595694541931, + "min_cosine_similarity": 0.9837638139724731, + "mean_relative_l2": 0.10276594012975693, + "max_abs_delta": 2.0625 + }, + "system_x": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9888038039207458, + "min_cosine_similarity": 0.9752572774887085, + "mean_relative_l2": 0.1464300900697708, + "max_abs_delta": 3.875 + }, + "system_period": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9884002208709717, + "min_cosine_similarity": 0.9700562953948975, + "mean_relative_l2": 0.14847293496131897, + "max_abs_delta": 3.125 + }, + "bos_at_s0": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9921121597290039, + "min_cosine_similarity": 0.9824440479278564, + "mean_relative_l2": 0.1229788288474083, + "max_abs_delta": 3.125 + }, + "bos_at_s1": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9911573529243469, + "min_cosine_similarity": 0.9784125685691833, + "mean_relative_l2": 0.13031591475009918, + "max_abs_delta": 2.25 + }, + "x_at_s0": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9899182319641113, + "min_cosine_similarity": 0.9743689298629761, + "mean_relative_l2": 0.1392897516489029, + "max_abs_delta": 3.375 + }, + "x_at_s1": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9831100106239319, + "min_cosine_similarity": 0.9667907953262329, + "mean_relative_l2": 0.1810319572687149, + "max_abs_delta": 7.125 + }, + "period_at_s0": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9899712204933167, + "min_cosine_similarity": 0.9753822684288025, + "mean_relative_l2": 0.13993693888187408, + "max_abs_delta": 3.375 + }, + "period_at_s1": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9821752905845642, + "min_cosine_similarity": 0.9577463865280151, + "mean_relative_l2": 0.18532715737819672, + "max_abs_delta": 7.125 + } + } + }, + "layer_20": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1f8264d376fa968d41ee93d75eae642a161da0f2f00a48bc03cc05e910369178", + "mean": 0.011415388435125351, + "std": 1.4278504848480225, + "rms": 1.4278961420059204, + "max_abs": 36.75 + }, + "full_input": { + "shape": [ + 49, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "58eab060a7a7caac45cc2e953d85d9f5f73b63a15d537a5e9a6a6b548310e3fb", + "mean": -0.02201256901025772, + "std": 11.949326515197754, + "rms": 11.949347496032715, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3747fed2662119c710d8832818d87e8c058ba53ce83d5792d7241cd7872edd55", + "mean": 0.010605101473629475, + "std": 1.4283088445663452, + "rms": 1.428348183631897, + "max_abs": 39.25 + }, + "full_input": { + "shape": [ + 65, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "59c6ad57a3316478eef371e0c5a9d03454dfa8a135ee358e95acc6c9dd155fab", + "mean": -0.023565569892525673, + "std": 10.719685554504395, + "rms": 10.719711303710938, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "473bec0135efd2f6ad356c44b4c9b4a0bd4c66af58174fb64e8a6cb1822c1443", + "mean": 0.012026246637105942, + "std": 1.427984356880188, + "rms": 1.4280349016189575, + "max_abs": 35.5 + }, + "full_input": { + "shape": [ + 49, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ad90b464a1410932d3a060d41f5282763ff717eec59bbe1960a5cb868d3338b8", + "mean": 0.000711653905455023, + "std": 10.19188117980957, + "rms": 10.19188117980957, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e312ca285ab47c32c5f586c01a1b9ac453fa86fa728f81c4550dd1f963cbca2d", + "mean": 0.010603472590446472, + "std": 1.4361389875411987, + "rms": 1.4361780881881714, + "max_abs": 38.0 + }, + "full_input": { + "shape": [ + 65, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "81970e1962a46f6e961da872e0cba8338be0ba8ba442fcf002882ae2932e7e03", + "mean": -0.0038911947049200535, + "std": 8.864541053771973, + "rms": 8.864541053771973, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0c661f6dcd64708bb7b16b25d290d9075d5704908679afd5fb33b7058a40f312", + "mean": 0.0120381535962224, + "std": 1.4252852201461792, + "rms": 1.4253360033035278, + "max_abs": 35.5 + }, + "full_input": { + "shape": [ + 49, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "40a2d502ef2964d210d9e1244e5f8e9f4e1392f2c613c64a9825277f8750e5c6", + "mean": -0.0006853725062683225, + "std": 10.192648887634277, + "rms": 10.192648887634277, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "71beb705be778b7ac0092d2e73d45c0952cd889d75e33242c02b675fa52cf8f6", + "mean": 0.011750627309083939, + "std": 1.415474534034729, + "rms": 1.4155232906341553, + "max_abs": 35.75 + }, + "full_input": { + "shape": [ + 65, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "09c7d2e8e345051d2db79440c27beb6e289947f1f8d184c797c92b33b0c2c080", + "mean": -0.0038365258369594812, + "std": 8.863880157470703, + "rms": 8.863880157470703, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d410543f3e5d86873568666f3cf8bdaa8d6efd882029e85d3f3135f907519112", + "mean": 0.01192827895283699, + "std": 1.424875259399414, + "rms": 1.4249250888824463, + "max_abs": 35.75 + }, + "full_input": { + "shape": [ + 49, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a0a0c51afb6f022b7ee7c6e38d9321e08a983734ceff7be61a3fd7be893b4412", + "mean": 1.924986827361863e-05, + "std": 10.191943168640137, + "rms": 10.191943168640137, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "932330d4bf0c0324af9a06a10f9f1695c832cd1338dbe0cc19761294864a44df", + "mean": 0.010003757663071156, + "std": 1.41191828250885, + "rms": 1.4119536876678467, + "max_abs": 35.75 + }, + "full_input": { + "shape": [ + 65, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "286a7b9428fb10b3ce9da3d41b35141581d0fa9cae2bafd5701d36f8d74809f3", + "mean": -0.004395416006445885, + "std": 8.863167762756348, + "rms": 8.863168716430664, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9960613250732422, + "min_cosine_similarity": 0.9931162595748901, + "mean_relative_l2": 0.08679274469614029, + "max_abs_delta": 2.5 + }, + "system_bos": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9940948486328125, + "min_cosine_similarity": 0.983018159866333, + "mean_relative_l2": 0.1064593568444252, + "max_abs_delta": 2.5 + }, + "system_x": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9878483414649963, + "min_cosine_similarity": 0.9700548648834229, + "mean_relative_l2": 0.15236340463161469, + "max_abs_delta": 3.375 + }, + "system_period": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9870133996009827, + "min_cosine_similarity": 0.9680108428001404, + "mean_relative_l2": 0.15678976476192474, + "max_abs_delta": 2.625 + }, + "bos_at_s0": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9920437932014465, + "min_cosine_similarity": 0.9826668500900269, + "mean_relative_l2": 0.12352768331766129, + "max_abs_delta": 3.3125 + }, + "bos_at_s1": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9908607006072998, + "min_cosine_similarity": 0.9799810647964478, + "mean_relative_l2": 0.13272352516651154, + "max_abs_delta": 2.75 + }, + "x_at_s0": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.989778995513916, + "min_cosine_similarity": 0.9766057729721069, + "mean_relative_l2": 0.14020438492298126, + "max_abs_delta": 3.5 + }, + "x_at_s1": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9826629161834717, + "min_cosine_similarity": 0.960281252861023, + "mean_relative_l2": 0.1821177750825882, + "max_abs_delta": 8.125 + }, + "period_at_s0": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9900031685829163, + "min_cosine_similarity": 0.9773204326629639, + "mean_relative_l2": 0.13917489349842072, + "max_abs_delta": 3.5 + }, + "period_at_s1": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.981389045715332, + "min_cosine_similarity": 0.9589489102363586, + "mean_relative_l2": 0.1881442666053772, + "max_abs_delta": 7.875 + } + } + }, + "layer_21": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "304f23bae9075e4ad7355d82082cfc19af2ff0937af08f9268778e3807ad27b7", + "mean": 0.01971931755542755, + "std": 1.6099367141723633, + "rms": 1.6100574731826782, + "max_abs": 47.25 + }, + "full_input": { + "shape": [ + 49, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d80fa4220a31c3cab7166bbddeb1e53e2a57f556097fcb57c6d76acf536fe7ec", + "mean": -0.01614663563668728, + "std": 12.07530403137207, + "rms": 12.07531452178955, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f0ea718a15d2675b7ca5d03955c93ee158ea7ca25cb3e742d2bc84afc1c94b92", + "mean": 0.01910007931292057, + "std": 1.6114012002944946, + "rms": 1.6115143299102783, + "max_abs": 47.5 + }, + "full_input": { + "shape": [ + 65, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "25f7816a6e6f313da4ee11834abd1c19941237ab20fc1551ee517e90059bccab", + "mean": -0.017979860305786133, + "std": 10.831425666809082, + "rms": 10.831439971923828, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a8f6bfc6ad5c1a5d74493354afbe93ef58bf3390c37b8adc84096297ea1a959c", + "mean": 0.01921808533370495, + "std": 1.6037712097167969, + "rms": 1.603886365890503, + "max_abs": 45.0 + }, + "full_input": { + "shape": [ + 49, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ca7fd4bb15599a6edc022fafab8820bd2555e5bfd8516a9c1e2711a16b5aa4eb", + "mean": 0.006699353456497192, + "std": 10.186983108520508, + "rms": 10.186984062194824, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0b41fb77e79f43c7ac7974da28e364e81ebb15ab6a7f74c7cf81f18997c62998", + "mean": 0.018458837643265724, + "std": 1.6158092021942139, + "rms": 1.6159147024154663, + "max_abs": 45.5 + }, + "full_input": { + "shape": [ + 65, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "70a7dff3730f22205d3523f27e6921eeda25bac3c2819217f2cb5710a80813fe", + "mean": 0.0016901121707633138, + "std": 8.869617462158203, + "rms": 8.869617462158203, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "908bb2e7f7473d8f4a699b26af221e586f47c547373e47254382bf0a81aa33ad", + "mean": 0.019215038046240807, + "std": 1.6035913228988647, + "rms": 1.6037064790725708, + "max_abs": 46.0 + }, + "full_input": { + "shape": [ + 49, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "11927bd813cb64309d6e860d93204a237498603d1f64b310ef5611d4339c76ab", + "mean": 0.0052229068242013454, + "std": 10.18862533569336, + "rms": 10.188626289367676, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "16d1495da0ad33a05b868a5061c1dcd696df366e39c06a0217b451e02b348762", + "mean": 0.018141375854611397, + "std": 1.5979504585266113, + "rms": 1.5980534553527832, + "max_abs": 46.5 + }, + "full_input": { + "shape": [ + 65, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7d7c67abe6d04373ed55e1347b7e59d77f4abf864229c3c1d50dc3e99c56de62", + "mean": 0.0004559159278869629, + "std": 8.869915008544922, + "rms": 8.869915008544922, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c04198300e093c015b04df0789d7b3b51104f300edf61dbb759404c1ebb1ba58", + "mean": 0.0195997916162014, + "std": 1.6019593477249146, + "rms": 1.6020792722702026, + "max_abs": 46.0 + }, + "full_input": { + "shape": [ + 49, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6a3d2699734ea2eaf5f414942e2b10d028a1ddc29f0913178c4ecddca7098ce9", + "mean": 0.005842025391757488, + "std": 10.187131881713867, + "rms": 10.187132835388184, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "686c6d8613eb2f27800a5b7329c7e406fe8336288f96a3ae3c115534646f3df5", + "mean": 0.01688939891755581, + "std": 1.5917682647705078, + "rms": 1.5918577909469604, + "max_abs": 46.25 + }, + "full_input": { + "shape": [ + 65, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c01f2af9764129a79656ceaec3b595fb255bce5fca6f475c084d62e283b0a5d6", + "mean": 0.00032459129579365253, + "std": 8.86821460723877, + "rms": 8.86821460723877, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9953048229217529, + "min_cosine_similarity": 0.9916544556617737, + "mean_relative_l2": 0.09463616460561752, + "max_abs_delta": 2.25 + }, + "system_bos": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9933609366416931, + "min_cosine_similarity": 0.9822291135787964, + "mean_relative_l2": 0.113375224173069, + "max_abs_delta": 3.5 + }, + "system_x": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9856295585632324, + "min_cosine_similarity": 0.9589220285415649, + "mean_relative_l2": 0.16482849419116974, + "max_abs_delta": 2.75 + }, + "system_period": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9844260811805725, + "min_cosine_similarity": 0.9600285887718201, + "mean_relative_l2": 0.17023800313472748, + "max_abs_delta": 2.890625 + }, + "bos_at_s0": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9917135238647461, + "min_cosine_similarity": 0.9831244349479675, + "mean_relative_l2": 0.12639088928699493, + "max_abs_delta": 4.0 + }, + "bos_at_s1": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9903378486633301, + "min_cosine_similarity": 0.9806932210922241, + "mean_relative_l2": 0.13648171722888947, + "max_abs_delta": 4.25 + }, + "x_at_s0": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9887695908546448, + "min_cosine_similarity": 0.976641058921814, + "mean_relative_l2": 0.14671863615512848, + "max_abs_delta": 3.5 + }, + "x_at_s1": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9804050326347351, + "min_cosine_similarity": 0.9531610012054443, + "mean_relative_l2": 0.1923140287399292, + "max_abs_delta": 7.75 + }, + "period_at_s0": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9892993569374084, + "min_cosine_similarity": 0.9789639711380005, + "mean_relative_l2": 0.14383871853351593, + "max_abs_delta": 3.625 + }, + "period_at_s1": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9793770909309387, + "min_cosine_similarity": 0.9505385160446167, + "mean_relative_l2": 0.19691210985183716, + "max_abs_delta": 7.875 + } + } + }, + "layer_22": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5b73c216351e22bb83dd1b4e9753a106e2426d6608d1e0ac8522b8a8b11d3eab", + "mean": 0.015274811536073685, + "std": 1.9252228736877441, + "rms": 1.9252835512161255, + "max_abs": 65.0 + }, + "full_input": { + "shape": [ + 49, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ab02c85b152ff432df61d9bd82587c182d74407ee48df0c1040e7910b8afe31c", + "mean": -0.018801260739564896, + "std": 12.1063814163208, + "rms": 12.106395721435547, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1a985182175b063a0e59f265ba7df7941fad2c1238369f01d2f242af939a3127", + "mean": 0.016954919323325157, + "std": 1.9305204153060913, + "rms": 1.9305949211120605, + "max_abs": 65.0 + }, + "full_input": { + "shape": [ + 65, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9370a2d9622003cf5ff3f2e78fc2908623564036c32d72902c9d479875abc081", + "mean": -0.019791841506958008, + "std": 10.869668006896973, + "rms": 10.869686126708984, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8c7698b09238b9f4baf9c6eec24682719fd346203387babd962d080a2d6c43b1", + "mean": 0.015636388212442398, + "std": 1.9095746278762817, + "rms": 1.9096386432647705, + "max_abs": 63.0 + }, + "full_input": { + "shape": [ + 49, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c93384a406ec812894fe70dbdf1e2d5a916225cd8d01932a1f7329e68513283b", + "mean": 0.004580226261168718, + "std": 10.223209381103516, + "rms": 10.223209381103516, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "91c5818b3264d835be4b1ff72b22a5a1736cd88f1c81c9e05624b22f35e4fa44", + "mean": 0.016565559431910515, + "std": 1.927333950996399, + "rms": 1.9274049997329712, + "max_abs": 64.0 + }, + "full_input": { + "shape": [ + 65, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "57da55a0a3241b3f185e590cc940b46d951162262345d4aa342fe854febd3b96", + "mean": 0.00028902842313982546, + "std": 8.916625022888184, + "rms": 8.916625022888184, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f12ff2000638b9f22655fb9ee94fd27f210761c80830938f05391b1351c538bd", + "mean": 0.016655324026942253, + "std": 1.9112764596939087, + "rms": 1.9113489389419556, + "max_abs": 64.5 + }, + "full_input": { + "shape": [ + 49, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c472eedbdecbe7edf8e448d0c6c67c4e7651e8157ab1f69a007af935b0563aaa", + "mean": 0.003499060170724988, + "std": 10.225909233093262, + "rms": 10.225909233093262, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "140dcb2cd5d8e340b0086112c4f0e2e86cdc03d28ea2c5d62a3f93b95111b515", + "mean": 0.01848370023071766, + "std": 1.9099537134170532, + "rms": 1.9100431203842163, + "max_abs": 65.0 + }, + "full_input": { + "shape": [ + 65, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "40cfa79c4d6bedc25f9f4e93bbe15f7cb7739904939d1dce3d02e414ad2f2923", + "mean": 0.00018309308507014066, + "std": 8.917577743530273, + "rms": 8.917577743530273, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "63b9a9141b04365072f5328808b36fc619aeb0c04110e2c995adb00153aae4e3", + "mean": 0.017205091193318367, + "std": 1.9104350805282593, + "rms": 1.9105124473571777, + "max_abs": 65.0 + }, + "full_input": { + "shape": [ + 49, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7f5e7eca0567e09d52392658118b954ca30271c51e5466ce4a94229daee77ab1", + "mean": 0.0041221813298761845, + "std": 10.224200248718262, + "rms": 10.224200248718262, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d0e68bbcbe518a79c4e8bbc0d64c69bc084cd4a0efe6591216f7a8363939175f", + "mean": 0.016741178929805756, + "std": 1.8974977731704712, + "rms": 1.8975715637207031, + "max_abs": 64.0 + }, + "full_input": { + "shape": [ + 65, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "83fcecf4b28cdb24168b104156d375b6036b4cfff9947f5fa246fc5dac22f16d", + "mean": -5.123936352902092e-05, + "std": 8.914863586425781, + "rms": 8.914863586425781, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9950723052024841, + "min_cosine_similarity": 0.9912993907928467, + "mean_relative_l2": 0.09698033332824707, + "max_abs_delta": 3.0 + }, + "system_bos": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9931949973106384, + "min_cosine_similarity": 0.9837172627449036, + "mean_relative_l2": 0.11507176607847214, + "max_abs_delta": 4.5 + }, + "system_x": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9848927855491638, + "min_cosine_similarity": 0.9482529163360596, + "mean_relative_l2": 0.16752736270427704, + "max_abs_delta": 3.75 + }, + "system_period": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.98369961977005, + "min_cosine_similarity": 0.9575369358062744, + "mean_relative_l2": 0.17312228679656982, + "max_abs_delta": 4.25 + }, + "bos_at_s0": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9919430613517761, + "min_cosine_similarity": 0.983547031879425, + "mean_relative_l2": 0.12460267543792725, + "max_abs_delta": 5.0 + }, + "bos_at_s1": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9907267689704895, + "min_cosine_similarity": 0.982790470123291, + "mean_relative_l2": 0.13365274667739868, + "max_abs_delta": 5.0 + }, + "x_at_s0": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9890019297599792, + "min_cosine_similarity": 0.9760699272155762, + "mean_relative_l2": 0.14506001770496368, + "max_abs_delta": 3.75 + }, + "x_at_s1": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9801104068756104, + "min_cosine_similarity": 0.9407313466072083, + "mean_relative_l2": 0.19177557528018951, + "max_abs_delta": 6.25 + }, + "period_at_s0": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.989468514919281, + "min_cosine_similarity": 0.9796831607818604, + "mean_relative_l2": 0.14252960681915283, + "max_abs_delta": 3.75 + }, + "period_at_s1": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9791046977043152, + "min_cosine_similarity": 0.9473633766174316, + "mean_relative_l2": 0.1966199427843094, + "max_abs_delta": 7.0 + } + } + }, + "layer_23": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8ebf2b30e7a79ffb12e9025205a03c71422b86eac7111e41e26f9c1e09303452", + "mean": 0.01901380531489849, + "std": 2.240325450897217, + "rms": 2.240406036376953, + "max_abs": 86.5 + }, + "full_input": { + "shape": [ + 49, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a8b9412af13b030ba7dc4e70d11059fc5b8ea9ba1f06514fcf4d7ca7ceae2daf", + "mean": -0.0167827270925045, + "std": 12.103943824768066, + "rms": 12.10395622253418, + "max_abs": 1160.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d0c15cdd96309c0fbb6cbdb85170ee4eb53c1691e4d48da6a35f99a0ced34dcb", + "mean": 0.020772268995642662, + "std": 2.25046706199646, + "rms": 2.250562906265259, + "max_abs": 86.5 + }, + "full_input": { + "shape": [ + 65, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c25d785b230481cefa43bf4fdd8a25557470be9c5f87bccbe74e9a1d58e4a04a", + "mean": -0.01624389737844467, + "std": 10.884254455566406, + "rms": 10.88426685333252, + "max_abs": 1160.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c5e68699bdef5b0af891e3c9e00f0fbed08f2f8bb79cf31b492804f2275bfbb5", + "mean": 0.02043144218623638, + "std": 2.2206811904907227, + "rms": 2.2207753658294678, + "max_abs": 85.5 + }, + "full_input": { + "shape": [ + 49, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8821fdb2c90711fa01187982548347cf636808a89eb2b51b0c9f078a92af18d2", + "mean": 0.007487268652766943, + "std": 10.234593391418457, + "rms": 10.23459529876709, + "max_abs": 1160.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bd258e2f85feb0c425b4fb6565a896018c8515e2f4b0f38d03d4941bacd2e2ae", + "mean": 0.021413644775748253, + "std": 2.245680093765259, + "rms": 2.2457821369171143, + "max_abs": 86.5 + }, + "full_input": { + "shape": [ + 65, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "85df3fa7465b34f407b4d8abdc96a280a36b77c89685bdc667fb941593ac6bd8", + "mean": 0.004607946611940861, + "std": 8.952130317687988, + "rms": 8.952132225036621, + "max_abs": 1160.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fd5b6d5793582a20616c115b6943a809f0499f4f2c44253d2a63716953e5c12a", + "mean": 0.020654382184147835, + "std": 2.227041244506836, + "rms": 2.2271370887756348, + "max_abs": 86.5 + }, + "full_input": { + "shape": [ + 49, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a05f6da9d8c2fe0470f17433adac2c2a74f7bebb04eb6229d76bee6d69835207", + "mean": 0.006015998311340809, + "std": 10.24079704284668, + "rms": 10.240798950195312, + "max_abs": 1160.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ac43fc726523c722705985d5f5e5599c324555549bc51333997a2fd43a98ff88", + "mean": 0.023039817810058594, + "std": 2.2277145385742188, + "rms": 2.2278337478637695, + "max_abs": 87.0 + }, + "full_input": { + "shape": [ + 65, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "45461d9fcab2a1026dc5752f64f453d3fa2779688560002146bac04705ac8d06", + "mean": 0.003886803751811385, + "std": 8.955864906311035, + "rms": 8.955865859985352, + "max_abs": 1160.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "86b539d4f8975240585758a66c477385cd1942429b5f00ac94f9c1aafd3219c4", + "mean": 0.021775884553790092, + "std": 2.227869987487793, + "rms": 2.2279765605926514, + "max_abs": 87.0 + }, + "full_input": { + "shape": [ + 49, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8bcbab073b6a097b2dec2a13cc05ce638bfcfab30f730ee291a2b6fd0b5e6187", + "mean": 0.00636034831404686, + "std": 10.237204551696777, + "rms": 10.23720645904541, + "max_abs": 1160.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "26fbb607f2b515665710ea581da13dae9b03694da5f73d110dca8d900c8bf215", + "mean": 0.021153530105948448, + "std": 2.2169320583343506, + "rms": 2.2170331478118896, + "max_abs": 87.0 + }, + "full_input": { + "shape": [ + 65, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e8c00c85bffc7201eb5ae453ba408f5dc4ece07bdafec6ed739c3402aec0fcc3", + "mean": 0.0035887076519429684, + "std": 8.951566696166992, + "rms": 8.951567649841309, + "max_abs": 1160.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9955706000328064, + "min_cosine_similarity": 0.9922857284545898, + "mean_relative_l2": 0.09222450107336044, + "max_abs_delta": 3.5 + }, + "system_bos": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9937936663627625, + "min_cosine_similarity": 0.9854244589805603, + "mean_relative_l2": 0.1104557141661644, + "max_abs_delta": 4.5 + }, + "system_x": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.986415445804596, + "min_cosine_similarity": 0.955102801322937, + "mean_relative_l2": 0.15926118195056915, + "max_abs_delta": 5.5625 + }, + "system_period": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9852309226989746, + "min_cosine_similarity": 0.9644167423248291, + "mean_relative_l2": 0.16504603624343872, + "max_abs_delta": 5.0 + }, + "bos_at_s0": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9929068684577942, + "min_cosine_similarity": 0.9851554036140442, + "mean_relative_l2": 0.11680862307548523, + "max_abs_delta": 5.0 + }, + "bos_at_s1": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9919411540031433, + "min_cosine_similarity": 0.985835075378418, + "mean_relative_l2": 0.12460479140281677, + "max_abs_delta": 4.5 + }, + "x_at_s0": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9902364611625671, + "min_cosine_similarity": 0.9806296825408936, + "mean_relative_l2": 0.13684238493442535, + "max_abs_delta": 4.0 + }, + "x_at_s1": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9824188351631165, + "min_cosine_similarity": 0.9491822719573975, + "mean_relative_l2": 0.17996782064437866, + "max_abs_delta": 6.5 + }, + "period_at_s0": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9905975461006165, + "min_cosine_similarity": 0.9830201864242554, + "mean_relative_l2": 0.13478578627109528, + "max_abs_delta": 4.25 + }, + "period_at_s1": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9812414646148682, + "min_cosine_similarity": 0.9476136565208435, + "mean_relative_l2": 0.1859406679868698, + "max_abs_delta": 8.25 + } + } + }, + "layer_24": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8eb999cf4b82e2b896a5ada188bdb1314c86969d99961fcc8ed936990d4129b4", + "mean": 0.0225233044475317, + "std": 2.7541069984436035, + "rms": 2.754199266433716, + "max_abs": 114.0 + }, + "full_input": { + "shape": [ + 49, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "441a1b3a74d2df214e1fe80d809d6a8cac1ddd3ade4395c670629bd3d264e87e", + "mean": -0.01754898764193058, + "std": 11.393811225891113, + "rms": 11.393824577331543, + "max_abs": 1008.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6ac4ae8676647b75e8c65c1a96a21da45e0fe71ee9cd778e3bf714ac388fc155", + "mean": 0.02443036623299122, + "std": 2.7582712173461914, + "rms": 2.7583794593811035, + "max_abs": 113.5 + }, + "full_input": { + "shape": [ + 65, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8816637db5c000b368ff45d096148ba9be0676c63a3be114f4ba389fb8139bea", + "mean": -0.01627206616103649, + "std": 10.598105430603027, + "rms": 10.598116874694824, + "max_abs": 1120.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e90c48d701b9573898dc2b32f6801acf08b0678c98785af3a0e3ddd520374c8c", + "mean": 0.024491334334015846, + "std": 2.7371737957000732, + "rms": 2.737283229827881, + "max_abs": 114.0 + }, + "full_input": { + "shape": [ + 49, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "43a755c930e4317f780203c6959c4b3360905308d85fb8f990d728804b074023", + "mean": 0.01044321060180664, + "std": 7.232873439788818, + "rms": 7.23288106918335, + "max_abs": 840.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a8a0245e7035f230b4f9850b9f507e309057e078697fd8926624794a5203cf89", + "mean": 0.024725407361984253, + "std": 2.7586581707000732, + "rms": 2.7587690353393555, + "max_abs": 114.0 + }, + "full_input": { + "shape": [ + 65, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fd02c0b01bcb010fb33a4158d517d5ff23504374d0e3598b32ae24c0de4a5005", + "mean": 0.007153589744120836, + "std": 6.4419450759887695, + "rms": 6.441948890686035, + "max_abs": 840.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9f8d9c2faa020bfb8f3855dc2e7ffa01d71146d55d026ce57e0ca0f9ea0bca43", + "mean": 0.02451559342443943, + "std": 2.7461905479431152, + "rms": 2.746299982070923, + "max_abs": 115.0 + }, + "full_input": { + "shape": [ + 49, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e7b0e3636feaa974e24305c305504b766695efbb3b153968fc0aa91e18b3ad9c", + "mean": 0.008465653285384178, + "std": 7.245707035064697, + "rms": 7.245711803436279, + "max_abs": 840.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "013ca9699b21fd79f70d002bd92bcd2bcc2859bc854b79e2be22d0085d90e3e1", + "mean": 0.026274316012859344, + "std": 2.730783462524414, + "rms": 2.730909824371338, + "max_abs": 113.5 + }, + "full_input": { + "shape": [ + 65, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ac9964477556cb2fb2fb4cf6b19e65a587dae4e0f1492825ec5e51341bf66d9b", + "mean": 0.005985218100249767, + "std": 6.448980808258057, + "rms": 6.448983669281006, + "max_abs": 840.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1023e1afc53a000b67a99149c12386c7af80d9fe3d7b52ceec30c219f8ef82e7", + "mean": 0.025701237842440605, + "std": 2.745006561279297, + "rms": 2.745126724243164, + "max_abs": 115.0 + }, + "full_input": { + "shape": [ + 49, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b47ad9bd17e6bccdfda8b520b44799fde063b04a78b315b5567004dc11cf2f1d", + "mean": 0.009304028935730457, + "std": 7.238761901855469, + "rms": 7.238768100738525, + "max_abs": 840.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b1c893f5547cca530e2fcfd145fc1893bb49012b20055d4a202a12c4ec7f7bef", + "mean": 0.024593675509095192, + "std": 2.719345808029175, + "rms": 2.7194571495056152, + "max_abs": 114.0 + }, + "full_input": { + "shape": [ + 65, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f28fe9b03e71a8e4b68545a16fbbf7cc4acc48036d2d497fe782a11741cbbd29", + "mean": 0.006018301472067833, + "std": 6.440545558929443, + "rms": 6.440547943115234, + "max_abs": 840.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9960525035858154, + "min_cosine_similarity": 0.9931362271308899, + "mean_relative_l2": 0.08698727935552597, + "max_abs_delta": 3.5 + }, + "system_bos": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9945034384727478, + "min_cosine_similarity": 0.9876497983932495, + "mean_relative_l2": 0.10346678644418716, + "max_abs_delta": 4.0 + }, + "system_x": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9880995750427246, + "min_cosine_similarity": 0.9631119966506958, + "mean_relative_l2": 0.14890988171100616, + "max_abs_delta": 7.25 + }, + "system_period": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9870284199714661, + "min_cosine_similarity": 0.9676389694213867, + "mean_relative_l2": 0.15429748594760895, + "max_abs_delta": 7.0 + }, + "bos_at_s0": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9937913417816162, + "min_cosine_similarity": 0.9866578578948975, + "mean_relative_l2": 0.1092478409409523, + "max_abs_delta": 4.5 + }, + "bos_at_s1": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.992917001247406, + "min_cosine_similarity": 0.98704993724823, + "mean_relative_l2": 0.1169038787484169, + "max_abs_delta": 4.0 + }, + "x_at_s0": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9912511706352234, + "min_cosine_similarity": 0.9783828854560852, + "mean_relative_l2": 0.12882934510707855, + "max_abs_delta": 4.0 + }, + "x_at_s1": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9844679236412048, + "min_cosine_similarity": 0.9508147239685059, + "mean_relative_l2": 0.1688469797372818, + "max_abs_delta": 8.25 + }, + "period_at_s0": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9916355013847351, + "min_cosine_similarity": 0.9816339015960693, + "mean_relative_l2": 0.12633676826953888, + "max_abs_delta": 4.5 + }, + "period_at_s1": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.983302652835846, + "min_cosine_similarity": 0.9468564987182617, + "mean_relative_l2": 0.17470687627792358, + "max_abs_delta": 8.5 + } + } + }, + "layer_25": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a45264a15c91ac14ff1de14a6d835dbc276e8bcb7c5be25ca248f32cfbf3eb20", + "mean": 0.037163008004426956, + "std": 3.5539708137512207, + "rms": 3.5541651248931885, + "max_abs": 161.0 + }, + "full_input": { + "shape": [ + 49, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "12aef9b6f5a8720b4ed651f44c8f4292fe88fae59df7690aaf8bf243c23df4f9", + "mean": -0.0157005712389946, + "std": 8.754767417907715, + "rms": 8.754780769348145, + "max_abs": 872.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0ac72a98d15cfe35cf69124234c0482ae7316cd62ab7e7a9a6d40e115a7c807e", + "mean": 0.04033856838941574, + "std": 3.5542125701904297, + "rms": 3.554441452026367, + "max_abs": 161.0 + }, + "full_input": { + "shape": [ + 65, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "32ebc368b8333e66e7d0d553f46ad1d70a15c5f99bd82199410b7a8f5ef6ffaf", + "mean": -0.017635103315114975, + "std": 8.478940963745117, + "rms": 8.478959083557129, + "max_abs": 984.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6f62c712cb8e88e577720990b4c6c6e62bdeb0b244361c32c23af53b1b4a2292", + "mean": 0.03832409903407097, + "std": 3.5210423469543457, + "rms": 3.5212507247924805, + "max_abs": 160.0 + }, + "full_input": { + "shape": [ + 49, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7afb37a8ae8bc254c32c2d334d4706b7412fa1691d4c9bdcd673cbc458b2fbfa", + "mean": 0.013218074105679989, + "std": 3.8882694244384766, + "rms": 3.888291835784912, + "max_abs": 252.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "383474307681870bc4e2f8c027c1e10ed9b7f98a9457392a34f81b0647672757", + "mean": 0.0393756739795208, + "std": 3.5377888679504395, + "rms": 3.5380077362060547, + "max_abs": 161.0 + }, + "full_input": { + "shape": [ + 65, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b13aa848b6bf4a9e3779ad4694714967de4571ded242c81de8d2f9465f9845a2", + "mean": 0.006529191974550486, + "std": 3.867734432220459, + "rms": 3.8677399158477783, + "max_abs": 252.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a1d78685bc7c323cd4f30198b046bbcabb48fbab1a28e9bdb274c50eb4ee6c6f", + "mean": 0.03891373053193092, + "std": 3.5440032482147217, + "rms": 3.5442168712615967, + "max_abs": 162.0 + }, + "full_input": { + "shape": [ + 49, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "832c7e698944ec451253b8a7cb159896deff3f6eecbf274df7ba5e1961c4730b", + "mean": 0.0109792435541749, + "std": 3.94429087638855, + "rms": 3.944305896759033, + "max_abs": 252.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2a3f8a0c7be51c95c0d4832e50ff65a283fd75f7db550604804d9c33d1cdd0ef", + "mean": 0.040297966450452805, + "std": 3.5081069469451904, + "rms": 3.508338451385498, + "max_abs": 160.0 + }, + "full_input": { + "shape": [ + 65, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "06e8297dfdfc7f73b335c23d5a2a4fe519642fcde08629d964d84c4b22c8ecb5", + "mean": 0.005835206713527441, + "std": 3.896007537841797, + "rms": 3.8960118293762207, + "max_abs": 252.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1f12c4e98729ad4fb0434e3babee00ace7aacfe89beeda938258e7565ca3e595", + "mean": 0.04094767943024635, + "std": 3.532360315322876, + "rms": 3.532597541809082, + "max_abs": 162.0 + }, + "full_input": { + "shape": [ + 49, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8a5e28cba2970527af369c08ad44a73901b84e9de8cb508b22996f6288b388bf", + "mean": 0.012499311938881874, + "std": 3.9152283668518066, + "rms": 3.915248394012451, + "max_abs": 252.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3ea392afc18651f9f7d9b4d3436e07e9383a2f26107c304e08f3317c6ef8ba6c", + "mean": 0.03921324387192726, + "std": 3.492265224456787, + "rms": 3.492485284805298, + "max_abs": 160.0 + }, + "full_input": { + "shape": [ + 65, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fd8d393129d1fd480f81883028f3f1490f7030b5cbd7544573188f98d39b2439", + "mean": 0.006386673543602228, + "std": 3.870532274246216, + "rms": 3.870537519454956, + "max_abs": 252.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9970371723175049, + "min_cosine_similarity": 0.9952753782272339, + "mean_relative_l2": 0.07602383941411972, + "max_abs_delta": 4.0 + }, + "system_bos": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9957513809204102, + "min_cosine_similarity": 0.9914479851722717, + "mean_relative_l2": 0.09117903560400009, + "max_abs_delta": 5.0 + }, + "system_x": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9908740520477295, + "min_cosine_similarity": 0.97390216588974, + "mean_relative_l2": 0.13125519454479218, + "max_abs_delta": 10.90625 + }, + "system_period": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9898421764373779, + "min_cosine_similarity": 0.9708791971206665, + "mean_relative_l2": 0.13719427585601807, + "max_abs_delta": 10.0 + }, + "bos_at_s0": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9952906966209412, + "min_cosine_similarity": 0.9905279874801636, + "mean_relative_l2": 0.09555944055318832, + "max_abs_delta": 7.0 + }, + "bos_at_s1": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9945507645606995, + "min_cosine_similarity": 0.9885364770889282, + "mean_relative_l2": 0.10238150507211685, + "max_abs_delta": 6.0 + }, + "x_at_s0": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9932450652122498, + "min_cosine_similarity": 0.9797224402427673, + "mean_relative_l2": 0.11268528550863266, + "max_abs_delta": 4.9375 + }, + "x_at_s1": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9876944422721863, + "min_cosine_similarity": 0.9555837512016296, + "mean_relative_l2": 0.15050069987773895, + "max_abs_delta": 12.96875 + }, + "period_at_s0": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.993602991104126, + "min_cosine_similarity": 0.9835864305496216, + "mean_relative_l2": 0.11013108491897583, + "max_abs_delta": 5.5 + }, + "period_at_s1": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.986660897731781, + "min_cosine_similarity": 0.951810896396637, + "mean_relative_l2": 0.15594176948070526, + "max_abs_delta": 9.5 + } + } + }, + "layer_26": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "21ffad718bf055a013f654f8da318b93d0eebe76a393e89e5961025a19315e3b", + "mean": 0.06149330735206604, + "std": 4.798420429229736, + "rms": 4.798814296722412, + "max_abs": 250.0 + }, + "full_input": { + "shape": [ + 49, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "addde577e47c2c9b2b35a7dadcf0775e309716da6bdcdc963adaf23eeca8dad3", + "mean": -0.018498094752430916, + "std": 9.140170097351074, + "rms": 9.140189170837402, + "max_abs": 840.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "183f0fef9de2f572d2712d2ad5e97e0cfe7a9671a0c00864488fca4e28993e8a", + "mean": 0.06175066903233528, + "std": 4.651398181915283, + "rms": 4.651808261871338, + "max_abs": 240.0 + }, + "full_input": { + "shape": [ + 65, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6e0927a9482d63a0ae40eee0444fffd11b17f86d1efc9ca80cf4de67b64225d8", + "mean": -0.013842926360666752, + "std": 8.851311683654785, + "rms": 8.851323127746582, + "max_abs": 868.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "11f03293ac29fb593b70d3269cb8634d70aad40ed370fbf1a0836580996f2d31", + "mean": 0.06271472573280334, + "std": 4.7373247146606445, + "rms": 4.737739562988281, + "max_abs": 242.0 + }, + "full_input": { + "shape": [ + 49, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2a814c015eb83adadfc63b009b21ff202b178c64857aebaac57779be562c7e7c", + "mean": 0.014325578697025776, + "std": 5.564615249633789, + "rms": 5.564633369445801, + "max_abs": 776.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "eb2d768de88ae45beace4fb39707f71c95bff155b3313f05c4f6d91898fc634f", + "mean": 0.06057855486869812, + "std": 4.605081558227539, + "rms": 4.605480194091797, + "max_abs": 233.0 + }, + "full_input": { + "shape": [ + 65, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6e0ea5c3e10618f9abac90e4f66f5cf4b4f792bd9324cc5ede41515a85871a87", + "mean": 0.013425184413790703, + "std": 5.528128623962402, + "rms": 5.528144836425781, + "max_abs": 776.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9b28d890273f8ca43f1041d44a9a4a21238788e40e26940c92991498d6202f4c", + "mean": 0.06260019540786743, + "std": 4.880767345428467, + "rms": 4.881168842315674, + "max_abs": 247.0 + }, + "full_input": { + "shape": [ + 49, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d38b6b16d362d67a2c4606fa68c2fdae3bf7b4431a84946acb3c7c2e10463fef", + "mean": 0.01138341799378395, + "std": 5.68740177154541, + "rms": 5.687413215637207, + "max_abs": 776.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f6b1fdbce0f31795a39baca1b25390fae7823fe525b6caf77ce89588fc13e372", + "mean": 0.05445296689867973, + "std": 4.443897247314453, + "rms": 4.444231033325195, + "max_abs": 216.0 + }, + "full_input": { + "shape": [ + 65, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "28eb7188ec9b4f6a21b730d28748cc041a03d497925c84b8fba5717a50a16a22", + "mean": 0.009555994533002377, + "std": 5.501576900482178, + "rms": 5.501585006713867, + "max_abs": 776.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2c25530ff4c7228a1a44d53c50685d68211f124dc36de485b964c67498e05f95", + "mean": 0.06452476978302002, + "std": 4.835705280303955, + "rms": 4.8361358642578125, + "max_abs": 254.0 + }, + "full_input": { + "shape": [ + 49, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "aefaca9608be32141f8aa00150e8c18111523f1c7fae0ace9aed78b3f6815c12", + "mean": 0.013337329030036926, + "std": 5.629278659820557, + "rms": 5.629294395446777, + "max_abs": 776.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ece130f2e3a463803735c5fd8837eae032c67eb3373e86d0469d46e384558e31", + "mean": 0.0520564429461956, + "std": 4.364947319030762, + "rms": 4.365257740020752, + "max_abs": 219.0 + }, + "full_input": { + "shape": [ + 65, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "aa24632444b93205c0a4000b7a4d3196b517eaa0832158a48903a6514d653716", + "mean": 0.009522266685962677, + "std": 5.430964469909668, + "rms": 5.430973052978516, + "max_abs": 776.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9977457523345947, + "min_cosine_similarity": 0.99430912733078, + "mean_relative_l2": 0.07415088266134262, + "max_abs_delta": 18.0 + }, + "system_bos": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9967894554138184, + "min_cosine_similarity": 0.9925878643989563, + "mean_relative_l2": 0.08475970476865768, + "max_abs_delta": 24.0 + }, + "system_x": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9919607639312744, + "min_cosine_similarity": 0.9777456521987915, + "mean_relative_l2": 0.15025518834590912, + "max_abs_delta": 47.0 + }, + "system_period": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.990670382976532, + "min_cosine_similarity": 0.974655270576477, + "mean_relative_l2": 0.1610020101070404, + "max_abs_delta": 51.0 + }, + "bos_at_s0": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9965489506721497, + "min_cosine_similarity": 0.9890022277832031, + "mean_relative_l2": 0.08565178513526917, + "max_abs_delta": 16.0 + }, + "bos_at_s1": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9956805109977722, + "min_cosine_similarity": 0.9861963987350464, + "mean_relative_l2": 0.09424212574958801, + "max_abs_delta": 16.5 + }, + "x_at_s0": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9949119091033936, + "min_cosine_similarity": 0.9853582978248596, + "mean_relative_l2": 0.1064104214310646, + "max_abs_delta": 16.0 + }, + "x_at_s1": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9895567893981934, + "min_cosine_similarity": 0.9665114283561707, + "mean_relative_l2": 0.14831985533237457, + "max_abs_delta": 27.0 + }, + "period_at_s0": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9953591227531433, + "min_cosine_similarity": 0.9859853386878967, + "mean_relative_l2": 0.09747537970542908, + "max_abs_delta": 14.0 + }, + "period_at_s1": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.98819500207901, + "min_cosine_similarity": 0.9585745334625244, + "mean_relative_l2": 0.16125907003879547, + "max_abs_delta": 40.0 + } + } + }, + "final_norm": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bfae5b0f1b82c2a31a0a5bb3766a05cc073e24d587e83dd280b6588d9d17fb7d", + "mean": 0.002708056941628456, + "std": 0.4857712686061859, + "rms": 0.48577880859375, + "max_abs": 15.5 + }, + "full_input": { + "shape": [ + 49, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2ce5009f779d55fba0130a71976f6659b96c0269518ae2e97b1f1d7e13f8d9b6", + "mean": -0.000719530857168138, + "std": 0.5419776439666748, + "rms": 0.541978120803833, + "max_abs": 22.375 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8f8d5c791a509f6fc10ce81ab0ce76b45ce531a9c302086b3ecba0f816e83d42", + "mean": 0.002962942235171795, + "std": 0.490034282207489, + "rms": 0.49004319310188293, + "max_abs": 15.375 + }, + "full_input": { + "shape": [ + 65, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "313def45c3a6e5ce7f7fda13953b955fdf2c5fb82e65a0774b79e918b92c35c9", + "mean": 0.0007311070221476257, + "std": 0.5318944454193115, + "rms": 0.5318949818611145, + "max_abs": 22.125 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "46cebb27dd063cc2b294c3dcf8ba0571114545bfbc25ab1bbc7f04c373f24d8e", + "mean": 0.003180987434461713, + "std": 0.4872637391090393, + "rms": 0.4872741401195526, + "max_abs": 15.5 + }, + "full_input": { + "shape": [ + 49, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "81a64598b392d60f5009ad17b4b69ec31f586d4dedf11f26ecc02c8a708c4bd6", + "mean": 0.0006569221150130033, + "std": 0.5446495413780212, + "rms": 0.5446498990058899, + "max_abs": 21.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cad98781e48cb949fb763a06456fce11ef91f47b41d9661cd5cd85bf9abea6b6", + "mean": 0.0030076296534389257, + "std": 0.49276164174079895, + "rms": 0.492770791053772, + "max_abs": 15.3125 + }, + "full_input": { + "shape": [ + 65, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ea65e806f086a5986a25347e58d6111652cd6757738cfc087f1f81a46128eb28", + "mean": 0.0013010139809921384, + "std": 0.5330045223236084, + "rms": 0.5330061316490173, + "max_abs": 20.625 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ab586c29f1f9c697a292ef464236ed3eb89af6352da3555feeff24687183ddc1", + "mean": 0.003092606319114566, + "std": 0.4826202392578125, + "rms": 0.4826301336288452, + "max_abs": 15.5625 + }, + "full_input": { + "shape": [ + 49, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "da4340c3f4709928c1c6e6b78644725db5296429f0a7177373cd9a72110ad123", + "mean": 2.6392997824586928e-05, + "std": 0.5316174030303955, + "rms": 0.5316174030303955, + "max_abs": 18.875 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4e8ee95d3245885d6d8a97a2ef383c55d4452eb71bcd97a0a994a9f622c74ac9", + "mean": 0.002839569002389908, + "std": 0.500059187412262, + "rms": 0.5000672340393066, + "max_abs": 15.3125 + }, + "full_input": { + "shape": [ + 65, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e3cff81c5360e3cd166a4aa72ad4e33f91f4346cf95e016f9c6be4cd7709bc3a", + "mean": 0.0009413628722541034, + "std": 0.5273042321205139, + "rms": 0.5273050665855408, + "max_abs": 17.375 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d34eac46c7a1115930ad3bca029bc698b0b3ceca9624f90bf5020bb58572d46e", + "mean": 0.0033979343716055155, + "std": 0.4842219054698944, + "rms": 0.4842338263988495, + "max_abs": 15.5625 + }, + "full_input": { + "shape": [ + 49, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0269f6bda1ef3e094a1d7d887c60e37c8b453da2fc6670a7a0f8b6a5db53acca", + "mean": 0.0002755724999587983, + "std": 0.5377098917961121, + "rms": 0.5377100110054016, + "max_abs": 19.125 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 24, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a47b15f3966002cb6e12ba7b58a7fe103c05cd896c2d8aae3e2805ba78f35815", + "mean": 0.002744196681305766, + "std": 0.5038235783576965, + "rms": 0.5038310289382935, + "max_abs": 15.3125 + }, + "full_input": { + "shape": [ + 65, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5d285d1b36325ce9dfca508d360c3faadca1eac7ca2dd2aad85784df3c99238c", + "mean": 0.0011936923256143928, + "std": 0.5343011021614075, + "rms": 0.5343024730682373, + "max_abs": 17.125 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9951542019844055, + "min_cosine_similarity": 0.9911357164382935, + "mean_relative_l2": 0.09764785319566727, + "max_abs_delta": 0.6875 + }, + "system_bos": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9932540059089661, + "min_cosine_similarity": 0.988347053527832, + "mean_relative_l2": 0.1146702989935875, + "max_abs_delta": 1.013671875 + }, + "system_x": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9839238524436951, + "min_cosine_similarity": 0.9504395127296448, + "mean_relative_l2": 0.17955447733402252, + "max_abs_delta": 2.109375 + }, + "system_period": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9817144274711609, + "min_cosine_similarity": 0.9542456865310669, + "mean_relative_l2": 0.1924969106912613, + "max_abs_delta": 1.5 + }, + "bos_at_s0": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9925970435142517, + "min_cosine_similarity": 0.9819608926773071, + "mean_relative_l2": 0.11791306734085083, + "max_abs_delta": 1.00390625 + }, + "bos_at_s1": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.991021454334259, + "min_cosine_similarity": 0.9797919988632202, + "mean_relative_l2": 0.13058821856975555, + "max_abs_delta": 0.8984375 + }, + "x_at_s0": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9891380667686462, + "min_cosine_similarity": 0.9711805582046509, + "mean_relative_l2": 0.14158254861831665, + "max_abs_delta": 1.46875 + }, + "x_at_s1": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9784535765647888, + "min_cosine_similarity": 0.9353867173194885, + "mean_relative_l2": 0.20126742124557495, + "max_abs_delta": 1.9375 + }, + "period_at_s0": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9901440143585205, + "min_cosine_similarity": 0.9771631360054016, + "mean_relative_l2": 0.13576644659042358, + "max_abs_delta": 1.28125 + }, + "period_at_s1": { + "tokens": 24, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9764130711555481, + "min_cosine_similarity": 0.9252928495407104, + "mean_relative_l2": 0.21262072026729584, + "max_abs_delta": 1.7578125 + } + } + } + }, + "router_layers": { + "layer_01": { + "layer": 1, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "0df8f05ac47dfd1ee112e2859d12b142e039ada698f3e6d3cb60fcabea7811b4", + "route_weight_sha256": "36ea9ebb9b201f0649d4b7e2c4aae7890c42a4ee70d217858c6c933f2d7c058b", + "loads": [ + 2, + 1, + 1, + 1, + 4, + 5, + 1, + 2, + 7, + 2, + 5, + 1, + 2, + 0, + 1, + 1, + 5, + 1, + 4, + 2, + 1, + 1, + 3, + 2, + 3, + 3, + 0, + 0, + 5, + 3, + 2, + 3, + 2, + 1, + 1, + 6, + 1, + 2, + 3, + 1, + 3, + 2, + 2, + 1, + 0, + 2, + 0, + 1, + 3, + 5, + 4, + 3, + 2, + 6, + 3, + 2, + 0, + 0, + 1, + 1, + 4, + 3, + 4, + 1 + ], + "weighted_loads": [ + 0.15274470299482346, + 0.07984965294599533, + 0.07146188616752625, + 0.0343715138733387, + 0.33821259811520576, + 0.28649590350687504, + 0.024902239441871643, + 0.049558261409401894, + 0.4183483589440584, + 0.23818150162696838, + 0.5335738807916641, + 0.03707599639892578, + 0.04672743193805218, + 0.0, + 0.0747012048959732, + 0.04987935721874237, + 0.18050628155469894, + 0.03408196568489075, + 0.22281063720583916, + 0.18069473281502724, + 0.10390152782201767, + 0.058260392397642136, + 0.2333129309117794, + 0.06374247930943966, + 0.11183903738856316, + 0.17465222999453545, + 0.0, + 0.0, + 0.4367947429418564, + 0.15662866458296776, + 0.19203099608421326, + 0.23795168846845627, + 0.07027509808540344, + 0.05998676270246506, + 0.034940097481012344, + 0.5430152863264084, + 0.08599182218313217, + 0.2263207510113716, + 0.16549750044941902, + 0.07263989001512527, + 0.13392477110028267, + 0.16790645569562912, + 0.160108745098114, + 0.020999068394303322, + 0.0, + 0.19001388549804688, + 0.0, + 0.026599204167723656, + 0.22042730078101158, + 0.3144247382879257, + 0.1682575847953558, + 0.24309097602963448, + 0.11059461906552315, + 0.42978907376527786, + 0.16512183472514153, + 0.07582077011466026, + 0.0, + 0.0, + 0.08235853910446167, + 0.08103300631046295, + 0.21088367328047752, + 0.26615581288933754, + 0.17702819406986237, + 0.11821786314249039 + ], + "unique_experts": 57, + "load_cv": 0.7370277311900888, + "normalized_load_entropy": 0.9299145843155714, + "max_load_share": 0.04861111111111111 + }, + "full_input": { + "tokens": 49, + "top_k": 6, + "decisions": 294, + "ordered_route_sha256": "a07709a3b4b2f4e711243985fff578200424b23d3a0fcb55e76b463fd8df347c", + "route_weight_sha256": "c560303540fd25ef7e572470579e3bf3b04f6986aa1432f1008182ab3e649708", + "loads": [ + 3, + 1, + 3, + 1, + 6, + 5, + 3, + 4, + 28, + 2, + 7, + 1, + 2, + 0, + 1, + 10, + 5, + 2, + 5, + 2, + 4, + 1, + 4, + 2, + 3, + 7, + 15, + 1, + 5, + 3, + 2, + 8, + 3, + 3, + 1, + 6, + 1, + 2, + 3, + 4, + 3, + 12, + 2, + 6, + 1, + 13, + 0, + 1, + 3, + 5, + 7, + 4, + 6, + 6, + 6, + 6, + 4, + 9, + 1, + 13, + 5, + 7, + 4, + 1 + ], + "weighted_loads": [ + 0.2288428097963333, + 0.07984965294599533, + 0.17367930337786674, + 0.0343715138733387, + 0.3900549355894327, + 0.28649590350687504, + 0.1193901002407074, + 0.3169278744608164, + 1.7030383236706257, + 0.23818150162696838, + 0.721170537173748, + 0.03707599639892578, + 0.04672743193805218, + 0.0, + 0.0747012048959732, + 0.666619710624218, + 0.18050628155469894, + 0.10590845346450806, + 0.2441815510392189, + 0.18069473281502724, + 0.5019624158740044, + 0.058260392397642136, + 0.26343644224107265, + 0.06374247930943966, + 0.11183903738856316, + 0.32710818015038967, + 0.9514855686575174, + 0.07250314950942993, + 0.4367947429418564, + 0.15662866458296776, + 0.19203099608421326, + 0.6429721789318137, + 0.13195236772298813, + 0.2572295032441616, + 0.034940097481012344, + 0.5430152863264084, + 0.08599182218313217, + 0.2263207510113716, + 0.16549750044941902, + 0.29906973242759705, + 0.13392477110028267, + 0.5806270837783813, + 0.160108745098114, + 0.1304479588579852, + 0.9843979477882385, + 1.0120998405036516, + 0.0, + 0.026599204167723656, + 0.22042730078101158, + 0.3144247382879257, + 0.3245437331497669, + 0.2436925427755341, + 0.3881535716354847, + 0.42978907376527786, + 0.210568663518643, + 0.5697123445570469, + 0.3173135109245777, + 0.5186289362609386, + 0.08235853910446167, + 0.8171987719833851, + 0.30176443979144096, + 0.47493116185069084, + 0.17702819406986237, + 0.11821786314249039 + ], + "unique_experts": 62, + "load_cv": 0.9541043687494308, + "normalized_load_entropy": 0.9161755687481954, + "max_load_share": 0.09523809523809523 + } + }, + "s1_eos": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "c762f400570739f3b55ae88dca3e31098480b5cfdfcb9026ffe55309e18cd5e0", + "route_weight_sha256": "62f0bc3819975745302606a3c95d88f03dd8240589e480ee6e1e440bbab891d1", + "loads": [ + 2, + 1, + 1, + 1, + 4, + 5, + 1, + 2, + 7, + 2, + 5, + 1, + 2, + 0, + 1, + 2, + 5, + 0, + 4, + 2, + 1, + 1, + 3, + 2, + 3, + 3, + 0, + 0, + 5, + 3, + 2, + 3, + 2, + 1, + 1, + 6, + 1, + 2, + 3, + 1, + 3, + 2, + 2, + 1, + 0, + 2, + 0, + 1, + 3, + 5, + 4, + 3, + 2, + 6, + 3, + 2, + 0, + 0, + 1, + 1, + 4, + 3, + 4, + 1 + ], + "weighted_loads": [ + 0.1528027467429638, + 0.07958882302045822, + 0.07308179885149002, + 0.03433603420853615, + 0.34260156005620956, + 0.29014066606760025, + 0.023953216150403023, + 0.04997530207037926, + 0.38576619513332844, + 0.23730801045894623, + 0.5214604400098324, + 0.037363212555646896, + 0.047906799241900444, + 0.0, + 0.07605721056461334, + 0.07989562302827835, + 0.18804575502872467, + 0.0, + 0.2170422524213791, + 0.18331865780055523, + 0.10278913378715515, + 0.057419613003730774, + 0.2374499924480915, + 0.06351197138428688, + 0.10881799086928368, + 0.17605100572109222, + 0.0, + 0.0, + 0.4431450255215168, + 0.1643362045288086, + 0.192063570022583, + 0.24054798856377602, + 0.06747237965464592, + 0.05536681413650513, + 0.03553992882370949, + 0.5445511266589165, + 0.08742519468069077, + 0.2284778282046318, + 0.1636759229004383, + 0.07301431149244308, + 0.13709496706724167, + 0.1670423001050949, + 0.16250231117010117, + 0.020649032667279243, + 0.0, + 0.18981925398111343, + 0.0, + 0.026752354577183723, + 0.2199588157236576, + 0.32590887509286404, + 0.17527219094336033, + 0.24031337909400463, + 0.11380262300372124, + 0.4117482341825962, + 0.16868968680500984, + 0.0770874135196209, + 0.0, + 0.0, + 0.08414410054683685, + 0.08124013990163803, + 0.2105453535914421, + 0.2723472788929939, + 0.1787279061973095, + 0.1190805584192276 + ], + "unique_experts": 56, + "load_cv": 0.7412035591181296, + "normalized_load_entropy": 0.9275997695007566, + "max_load_share": 0.04861111111111111 + }, + "full_input": { + "tokens": 65, + "top_k": 6, + "decisions": 390, + "ordered_route_sha256": "ecbc885d4ab34df93dd3f9e5254fc21cdb78ac3d96853cdb26477c3954ddf91d", + "route_weight_sha256": "e57cd2c78c698a819927426880b124a924722b676d5d7a9edab734e3f7ddd354", + "loads": [ + 5, + 1, + 4, + 1, + 9, + 7, + 3, + 5, + 34, + 2, + 10, + 2, + 2, + 1, + 1, + 14, + 5, + 5, + 6, + 3, + 4, + 3, + 8, + 3, + 5, + 8, + 21, + 2, + 5, + 5, + 3, + 10, + 3, + 3, + 1, + 6, + 2, + 3, + 3, + 6, + 3, + 14, + 5, + 7, + 2, + 13, + 0, + 4, + 5, + 5, + 12, + 7, + 7, + 6, + 8, + 6, + 10, + 13, + 3, + 13, + 6, + 8, + 4, + 5 + ], + "weighted_loads": [ + 0.3458559550344944, + 0.07958882302045822, + 0.23936570063233376, + 0.03433603420853615, + 0.6329031717032194, + 0.42696497961878777, + 0.10119077377021313, + 0.2869157288223505, + 2.041588068008423, + 0.23730801045894623, + 0.9010274820029736, + 0.18488894030451775, + 0.047906799241900444, + 0.039972689002752304, + 0.07605721056461334, + 0.7822166830301285, + 0.18804575502872467, + 0.201296279206872, + 0.27697320468723774, + 0.24922830425202847, + 0.45603329688310623, + 0.2624662220478058, + 0.5083604308892973, + 0.09816740080714226, + 0.18069841340184212, + 0.3546887170523405, + 1.4102285597473383, + 0.09481843933463097, + 0.4431450255215168, + 0.32560180872678757, + 0.27795691788196564, + 0.8662589934538119, + 0.11687227338552475, + 0.20834721252322197, + 0.03553992882370949, + 0.5445511266589165, + 0.3470499739050865, + 0.2622030973434448, + 0.1636759229004383, + 0.41884904727339745, + 0.13709496706724167, + 0.7418134454637766, + 0.36999277025461197, + 0.21854477934539318, + 1.1413170993328094, + 0.9582516951777507, + 0.0, + 0.10951825432130136, + 0.371427308768034, + 0.32590887509286404, + 0.6078063268214464, + 0.6047864314168692, + 0.4563046880066395, + 0.4117482341825962, + 0.2626606986450497, + 0.5500400476157665, + 0.47184594348073006, + 0.7520645800977945, + 0.1591435708105564, + 0.7715786471962929, + 0.32635133527219296, + 0.5730931088328362, + 0.1787279061973095, + 0.610835924744606 + ], + "unique_experts": 63, + "load_cv": 0.8653000908388868, + "normalized_load_entropy": 0.9307018032486898, + "max_load_share": 0.08717948717948718 + } + }, + "s0_bos": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "66fa3f4b2def780c72ca4ce5f3ad59ecd96bd6721a7d5cddb043511f905241a5", + "route_weight_sha256": "281ce7e65e65c0ba7734c488fbd4fa34e72529590ebcf2dbbc4ea5bbf9e5d924", + "loads": [ + 2, + 1, + 1, + 1, + 4, + 4, + 0, + 0, + 5, + 2, + 5, + 1, + 0, + 0, + 1, + 2, + 3, + 3, + 5, + 2, + 1, + 1, + 3, + 4, + 3, + 3, + 0, + 0, + 5, + 3, + 2, + 3, + 3, + 1, + 1, + 6, + 1, + 2, + 4, + 1, + 2, + 2, + 2, + 4, + 0, + 2, + 0, + 1, + 3, + 4, + 4, + 2, + 2, + 6, + 4, + 3, + 0, + 0, + 1, + 1, + 4, + 3, + 4, + 1 + ], + "weighted_loads": [ + 0.1571429818868637, + 0.08880724757909775, + 0.08129683136940002, + 0.03680022805929184, + 0.33556030690670013, + 0.22850615717470646, + 0.0, + 0.0, + 0.1932031735777855, + 0.25572261214256287, + 0.4932975582778454, + 0.0356786847114563, + 0.0, + 0.0, + 0.07926953583955765, + 0.08998771011829376, + 0.10773223638534546, + 0.14658958092331886, + 0.22866490855813026, + 0.18052568659186363, + 0.09788668155670166, + 0.05542733892798424, + 0.24008424580097198, + 0.12571403570473194, + 0.11782352812588215, + 0.1826893612742424, + 0.0, + 0.0, + 0.44021791964769363, + 0.16391322761774063, + 0.17977792024612427, + 0.21777400001883507, + 0.10590661130845547, + 0.055267006158828735, + 0.03832468390464783, + 0.5025534555315971, + 0.08320797979831696, + 0.20433435589075089, + 0.19364423118531704, + 0.07003913819789886, + 0.08623383939266205, + 0.1600475087761879, + 0.1679982841014862, + 0.09948247857391834, + 0.0, + 0.19056148827075958, + 0.0, + 0.026636285707354546, + 0.2209756076335907, + 0.2787431310862303, + 0.1858823001384735, + 0.2256891131401062, + 0.11783270537853241, + 0.4279753379523754, + 0.19124806113541126, + 0.1121780052781105, + 0.0, + 0.0, + 0.07773490250110626, + 0.07641667872667313, + 0.18958162143826485, + 0.26292359083890915, + 0.17641576007008553, + 0.11067473143339157 + ], + "unique_experts": 54, + "load_cv": 0.7243558228002943, + "normalized_load_entropy": 0.9244297752054326, + "max_load_share": 0.041666666666666664 + }, + "full_input": { + "tokens": 49, + "top_k": 6, + "decisions": 294, + "ordered_route_sha256": "207d1ae0fb8594cf2f2cc39912e7594886e6124e54ec445828a58755fee2879c", + "route_weight_sha256": "e3acc32fc0b5598b859615feba317686267d70a6502bcdca7132af7dba63e047", + "loads": [ + 4, + 1, + 3, + 1, + 6, + 4, + 2, + 2, + 23, + 2, + 7, + 3, + 0, + 0, + 1, + 11, + 3, + 5, + 7, + 2, + 4, + 1, + 4, + 4, + 3, + 7, + 13, + 1, + 5, + 3, + 2, + 7, + 4, + 3, + 1, + 6, + 1, + 2, + 4, + 4, + 2, + 12, + 3, + 9, + 0, + 12, + 1, + 1, + 3, + 4, + 8, + 2, + 6, + 6, + 7, + 7, + 4, + 10, + 1, + 12, + 6, + 7, + 4, + 1 + ], + "weighted_loads": [ + 0.2729480229318142, + 0.08880724757909775, + 0.16643179580569267, + 0.03680022805929184, + 0.3874026443809271, + 0.22850615717470646, + 0.10250309854745865, + 0.2590976059436798, + 1.1999071091413498, + 0.25572261214256287, + 0.6878868602216244, + 0.08778144046664238, + 0.0, + 0.0, + 0.07926953583955765, + 0.7067280635237694, + 0.10773223638534546, + 0.25324800983071327, + 0.2756773103028536, + 0.18052568659186363, + 0.4341471269726753, + 0.05542733892798424, + 0.27020775713026524, + 0.12571403570473194, + 0.11782352812588215, + 0.34410766139626503, + 0.851428197696805, + 0.06234698370099068, + 0.44021791964769363, + 0.16391322761774063, + 0.17977792024612427, + 0.6592040546238422, + 0.16758388094604015, + 0.26621994376182556, + 0.03832468390464783, + 0.5025534555315971, + 0.08320797979831696, + 0.20433435589075089, + 0.19364423118531704, + 0.30208820104599, + 0.08623383939266205, + 0.5727681368589401, + 0.21082540228962898, + 0.23400606587529182, + 0.0, + 1.0121462531387806, + 0.02604992315173149, + 0.026636285707354546, + 0.2209756076335907, + 0.2787431310862303, + 0.36462367698550224, + 0.2256891131401062, + 0.38014642521739006, + 0.4279753379523754, + 0.25879646092653275, + 0.6218804642558098, + 0.342106219381094, + 0.5817301422357559, + 0.07773490250110626, + 0.7802385222166777, + 0.38533803448081017, + 0.4749067574739456, + 0.17641576007008553, + 0.11067473143339157 + ], + "unique_experts": 61, + "load_cv": 0.8645345895092673, + "normalized_load_entropy": 0.9213874019814516, + "max_load_share": 0.0782312925170068 + } + }, + "s1_bos": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "19bceb865cf20001cf46cf2c27b59610a67549692df12d01022a1641fd6c0e32", + "route_weight_sha256": "a8cf418c600d36cbac1db53c25b2ff73f7b5361b2642753190656284682e263a", + "loads": [ + 2, + 1, + 1, + 1, + 4, + 5, + 0, + 1, + 3, + 2, + 5, + 1, + 0, + 0, + 1, + 1, + 4, + 3, + 5, + 2, + 1, + 1, + 3, + 3, + 3, + 3, + 0, + 0, + 6, + 3, + 2, + 3, + 2, + 1, + 1, + 6, + 1, + 2, + 4, + 1, + 2, + 2, + 2, + 5, + 0, + 2, + 0, + 1, + 3, + 5, + 3, + 2, + 2, + 6, + 3, + 4, + 0, + 0, + 1, + 1, + 4, + 3, + 4, + 1 + ], + "weighted_loads": [ + 0.14753543958067894, + 0.0878702774643898, + 0.0738152489066124, + 0.036540437489748, + 0.3333844840526581, + 0.30021060071885586, + 0.0, + 0.02202378399670124, + 0.09156936034560204, + 0.2511741369962692, + 0.4674212373793125, + 0.03670097887516022, + 0.0, + 0.0, + 0.07459847629070282, + 0.05153834819793701, + 0.15313969925045967, + 0.1317247599363327, + 0.22278950549662113, + 0.1836629156023264, + 0.0983411967754364, + 0.05655120685696602, + 0.24814215302467346, + 0.09291785955429077, + 0.11532817035913467, + 0.18816309794783592, + 0.0, + 0.0, + 0.4797580689191818, + 0.17006034776568413, + 0.18022239208221436, + 0.22640104219317436, + 0.07252703234553337, + 0.053297288715839386, + 0.037822920829057693, + 0.4923764690756798, + 0.08428147435188293, + 0.195621058344841, + 0.19449498876929283, + 0.07338982820510864, + 0.08107171580195427, + 0.17940730601549149, + 0.16590365767478943, + 0.12788471393287182, + 0.0, + 0.1912022903561592, + 0.0, + 0.02696056477725506, + 0.22956226393580437, + 0.31143540889024734, + 0.15933310240507126, + 0.2271861918270588, + 0.11734287068247795, + 0.4282454624772072, + 0.17597103118896484, + 0.14170511811971664, + 0.0, + 0.0, + 0.06832443177700043, + 0.07783274352550507, + 0.20087790861725807, + 0.2671252451837063, + 0.18172212317585945, + 0.1085771843791008 + ], + "unique_experts": 55, + "load_cv": 0.7412035591181296, + "normalized_load_entropy": 0.9245752578663965, + "max_load_share": 0.041666666666666664 + }, + "full_input": { + "tokens": 65, + "top_k": 6, + "decisions": 390, + "ordered_route_sha256": "6da3e701af30539c341be0701b8597e23a6c472894ae001783cc12bce1cce378", + "route_weight_sha256": "75863eb420cff40198672ab0bca086c116d3dedee79c666f520e14e9d552695f", + "loads": [ + 6, + 1, + 4, + 2, + 9, + 7, + 1, + 4, + 27, + 2, + 10, + 2, + 0, + 2, + 1, + 13, + 4, + 8, + 8, + 3, + 4, + 3, + 7, + 4, + 5, + 8, + 19, + 2, + 6, + 5, + 3, + 9, + 4, + 3, + 2, + 6, + 2, + 3, + 4, + 6, + 2, + 14, + 6, + 11, + 1, + 12, + 1, + 3, + 5, + 5, + 12, + 6, + 7, + 6, + 9, + 8, + 10, + 15, + 3, + 11, + 7, + 8, + 4, + 5 + ], + "weighted_loads": [ + 0.3798194210976362, + 0.0878702774643898, + 0.22648885846138, + 0.06819631904363632, + 0.6236860956996679, + 0.4370349142700434, + 0.045338455587625504, + 0.250415675342083, + 1.4581624269485474, + 0.2511741369962692, + 0.8507263846695423, + 0.18422670662403107, + 0.0, + 0.06434164568781853, + 0.07459847629070282, + 0.7538594081997871, + 0.15313969925045967, + 0.3330210391432047, + 0.309922993183136, + 0.24957256205379963, + 0.3877105489373207, + 0.26159781590104103, + 0.5187458284199238, + 0.12757328897714615, + 0.18720859289169312, + 0.37943251989781857, + 1.3102758936583996, + 0.0921495258808136, + 0.4797580689191818, + 0.3313259519636631, + 0.266115739941597, + 0.8873821534216404, + 0.16075845435261726, + 0.22043955326080322, + 0.06096258759498596, + 0.4923764690756798, + 0.3439062535762787, + 0.22934632748365402, + 0.19449498876929283, + 0.4275820292532444, + 0.08107171580195427, + 0.7541784513741732, + 0.40993695333600044, + 0.32578046061098576, + 0.15223047137260437, + 0.9591716155409813, + 0.030222691595554352, + 0.10941378772258759, + 0.38103075698018074, + 0.31143540889024734, + 0.6195876486599445, + 0.5916592441499233, + 0.4302593879401684, + 0.4282454624772072, + 0.3149932809174061, + 0.6299275159835815, + 0.48694203421473503, + 0.8343342877924442, + 0.14332390204071999, + 0.7151844203472137, + 0.4189247954636812, + 0.5702313408255577, + 0.18172212317585945, + 0.6003325507044792 + ], + "unique_experts": 63, + "load_cv": 0.7668167248739108, + "normalized_load_entropy": 0.9380659327224317, + "max_load_share": 0.06923076923076923 + } + }, + "s0_x": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "df809da472cef03b028eb1a8f781e98baba78dc41bc494b7696938702a0fb20e", + "route_weight_sha256": "ade605d5380731edf0a2546db3993a26db90bc02600c31b76ba5f211100f59f7", + "loads": [ + 2, + 1, + 1, + 1, + 4, + 5, + 1, + 0, + 5, + 2, + 5, + 1, + 0, + 0, + 1, + 2, + 4, + 2, + 5, + 2, + 1, + 1, + 3, + 4, + 3, + 3, + 0, + 0, + 5, + 3, + 2, + 3, + 2, + 1, + 1, + 6, + 1, + 2, + 3, + 1, + 2, + 2, + 2, + 3, + 0, + 2, + 0, + 1, + 3, + 4, + 4, + 2, + 2, + 6, + 4, + 4, + 0, + 0, + 1, + 1, + 4, + 3, + 4, + 1 + ], + "weighted_loads": [ + 0.1579417996108532, + 0.08510787039995193, + 0.07902409881353378, + 0.03432176634669304, + 0.3381190150976181, + 0.2688688337802887, + 0.02496466226875782, + 0.0, + 0.17221027798950672, + 0.2505185157060623, + 0.4918395057320595, + 0.03489203751087189, + 0.0, + 0.0, + 0.08080081641674042, + 0.08626043051481247, + 0.15559519827365875, + 0.07994620501995087, + 0.24784471653401852, + 0.18369119986891747, + 0.1016286164522171, + 0.05515618249773979, + 0.23618004843592644, + 0.12248335033655167, + 0.11877536401152611, + 0.17932558432221413, + 0.0, + 0.0, + 0.4323505721986294, + 0.15578533336520195, + 0.18660993874073029, + 0.2263859435915947, + 0.08137045800685883, + 0.05873626098036766, + 0.035958122462034225, + 0.5158976353704929, + 0.08054439723491669, + 0.21827611327171326, + 0.16071733087301254, + 0.07175134122371674, + 0.08892601542174816, + 0.1691095307469368, + 0.1700611189007759, + 0.07549421302974224, + 0.0, + 0.1963317021727562, + 0.0, + 0.026454081758856773, + 0.22669612988829613, + 0.27298472076654434, + 0.1799588929861784, + 0.23013677820563316, + 0.11781426146626472, + 0.41266968101263046, + 0.2000615131109953, + 0.14192375913262367, + 0.0, + 0.0, + 0.08112408965826035, + 0.07790137082338333, + 0.19120367243885994, + 0.2640899010002613, + 0.18350902944803238, + 0.11263133585453033 + ], + "unique_experts": 55, + "load_cv": 0.7243558228002943, + "normalized_load_entropy": 0.926629004985398, + "max_load_share": 0.041666666666666664 + }, + "full_input": { + "tokens": 49, + "top_k": 6, + "decisions": 294, + "ordered_route_sha256": "3bbd85d0425814160d51802f69318d23bc15beab3020cfa1eacacd4816e9962c", + "route_weight_sha256": "6319012d362cee8e7eec0ba6423b13eb55be9b7fb077c0e3015f9a2aa7ca2436", + "loads": [ + 3, + 1, + 3, + 1, + 6, + 5, + 3, + 3, + 23, + 3, + 7, + 2, + 0, + 0, + 2, + 12, + 4, + 3, + 7, + 2, + 4, + 1, + 5, + 4, + 3, + 7, + 14, + 1, + 5, + 3, + 2, + 7, + 3, + 3, + 1, + 6, + 1, + 2, + 3, + 4, + 2, + 13, + 2, + 8, + 0, + 13, + 0, + 1, + 3, + 4, + 8, + 2, + 6, + 6, + 6, + 8, + 3, + 9, + 1, + 13, + 5, + 7, + 4, + 1 + ], + "weighted_loads": [ + 0.2499694861471653, + 0.08510787039995193, + 0.17343682795763016, + 0.03432176634669304, + 0.38996135257184505, + 0.2688688337802887, + 0.1278999876230955, + 0.2985395323485136, + 1.1760177817195654, + 0.27683622762560844, + 0.6802496835589409, + 0.05844934098422527, + 0.0, + 0.0, + 0.1040535420179367, + 0.8202374801039696, + 0.15559519827365875, + 0.15177269279956818, + 0.295184837654233, + 0.18369119986891747, + 0.43190135061740875, + 0.05515618249773979, + 0.2971267569810152, + 0.12248335033655167, + 0.11877536401152611, + 0.3436448350548744, + 0.8984211683273315, + 0.06633616238832474, + 0.4323505721986294, + 0.15578533336520195, + 0.18660993874073029, + 0.6779509782791138, + 0.1430477276444435, + 0.269709262996912, + 0.035958122462034225, + 0.5158976353704929, + 0.08054439723491669, + 0.21827611327171326, + 0.16071733087301254, + 0.3272668421268463, + 0.08892601542174816, + 0.6376700177788734, + 0.1700611189007759, + 0.21411246992647648, + 0.0, + 1.0516886934638023, + 0.0, + 0.026454081758856773, + 0.22669612988829613, + 0.27298472076654434, + 0.37433311343193054, + 0.23013677820563316, + 0.35899970680475235, + 0.41266968101263046, + 0.24505791254341602, + 0.6655900664627552, + 0.19279605522751808, + 0.5012291725724936, + 0.08112408965826035, + 0.8798473104834557, + 0.2820844389498234, + 0.4740736521780491, + 0.18350902944803238, + 0.11263133585453033 + ], + "unique_experts": 60, + "load_cv": 0.8931794041038006, + "normalized_load_entropy": 0.9169128995097012, + "max_load_share": 0.0782312925170068 + } + }, + "s1_x": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "ea8d8af78e46d5ddc06ed1220ca0ac0e81d6b564d4dfbffc96061668101ec80f", + "route_weight_sha256": "512248a9ca32d0080a880ef448899501e3a75d9cd1c7645c0b0b5b12e1a03c3a", + "loads": [ + 2, + 1, + 1, + 1, + 4, + 5, + 1, + 1, + 2, + 2, + 5, + 1, + 0, + 0, + 1, + 1, + 5, + 2, + 5, + 2, + 1, + 1, + 3, + 3, + 3, + 3, + 0, + 0, + 6, + 3, + 2, + 3, + 2, + 1, + 1, + 6, + 1, + 2, + 4, + 1, + 2, + 2, + 2, + 6, + 0, + 2, + 0, + 1, + 3, + 4, + 3, + 2, + 2, + 6, + 3, + 4, + 0, + 0, + 1, + 1, + 4, + 3, + 4, + 1 + ], + "weighted_loads": [ + 0.1432570442557335, + 0.08579061925411224, + 0.06952840834856033, + 0.03426451236009598, + 0.33210501074790955, + 0.307079317048192, + 0.025019383057951927, + 0.02209220826625824, + 0.057761361822485924, + 0.24517781287431717, + 0.4566534571349621, + 0.036692772060632706, + 0.0, + 0.0, + 0.07380285859107971, + 0.051285870373249054, + 0.21117118000984192, + 0.07882042601704597, + 0.22473381459712982, + 0.181374903768301, + 0.10007353127002716, + 0.05636360123753548, + 0.24837074056267738, + 0.08895658142864704, + 0.11764071136713028, + 0.1866328828036785, + 0.0, + 0.0, + 0.47367748245596886, + 0.16674024984240532, + 0.18565379083156586, + 0.22998376563191414, + 0.07563546299934387, + 0.05314336344599724, + 0.0364995151758194, + 0.49561452865600586, + 0.08438470214605331, + 0.18994254618883133, + 0.19275030307471752, + 0.07496044784784317, + 0.08221233263611794, + 0.1861075460910797, + 0.16474229097366333, + 0.1531606037169695, + 0.0, + 0.1939484253525734, + 0.0, + 0.026840033009648323, + 0.2313253916800022, + 0.2854875400662422, + 0.15729111433029175, + 0.22878925502300262, + 0.11142022162675858, + 0.43855272606015205, + 0.17540550604462624, + 0.1475958153605461, + 0.0, + 0.0, + 0.06653188169002533, + 0.0776524543762207, + 0.20609402284026146, + 0.264727208763361, + 0.18516472354531288, + 0.10682791471481323 + ], + "unique_experts": 56, + "load_cv": 0.7453559924999299, + "normalized_load_entropy": 0.9264382676747723, + "max_load_share": 0.041666666666666664 + }, + "full_input": { + "tokens": 65, + "top_k": 6, + "decisions": 390, + "ordered_route_sha256": "9cfce65099a614154d1a81aa008db52366f568f38680612b2e08ca96c18c7bfd", + "route_weight_sha256": "b21b1b5aedcc80c9c22bbc0fdb5f474b20cb62a551d33df0f0e02abe6ccfa1b5", + "loads": [ + 5, + 1, + 4, + 1, + 9, + 7, + 2, + 5, + 25, + 4, + 10, + 2, + 0, + 2, + 1, + 14, + 5, + 7, + 8, + 4, + 4, + 3, + 7, + 4, + 5, + 8, + 20, + 2, + 6, + 5, + 4, + 9, + 4, + 3, + 1, + 6, + 2, + 3, + 4, + 6, + 2, + 15, + 5, + 12, + 1, + 13, + 1, + 3, + 6, + 4, + 12, + 6, + 7, + 6, + 8, + 8, + 9, + 12, + 3, + 12, + 6, + 8, + 4, + 5 + ], + "weighted_loads": [ + 0.34914565831422806, + 0.08579061925411224, + 0.22932589426636696, + 0.03426451236009598, + 0.6224066223949194, + 0.44390363059937954, + 0.07035783864557743, + 0.2875789273530245, + 1.388055332005024, + 0.29104466177523136, + 0.8374328576028347, + 0.18421849980950356, + 0.0, + 0.06601918861269951, + 0.07380285859107971, + 0.8639683425426483, + 0.21117118000984192, + 0.28011670522391796, + 0.3113662712275982, + 0.2691434118896723, + 0.3903716951608658, + 0.2614102102816105, + 0.5189744159579277, + 0.12361201085150242, + 0.18952113389968872, + 0.38263428397476673, + 1.3504577111452818, + 0.09349271655082703, + 0.47367748245596886, + 0.3280058540403843, + 0.2909426614642143, + 0.8993567787110806, + 0.16521624475717545, + 0.22252460941672325, + 0.0364995151758194, + 0.49561452865600586, + 0.34400948137044907, + 0.22366781532764435, + 0.19275030307471752, + 0.44748280569911003, + 0.08221233263611794, + 0.8278222624212503, + 0.37223275005817413, + 0.3510563503950834, + 0.15223047137260437, + 0.9966175481677055, + 0.03355787321925163, + 0.10929325595498085, + 0.4045165777206421, + 0.2854875400662422, + 0.6349113527685404, + 0.5932623073458672, + 0.40327684581279755, + 0.43855272606015205, + 0.29461210407316685, + 0.6467912346124649, + 0.35853732377290726, + 0.7063809335231781, + 0.1415313519537449, + 0.8091103360056877, + 0.3219000045210123, + 0.5645099803805351, + 0.18516472354531288, + 0.5985832810401917 + ], + "unique_experts": 63, + "load_cv": 0.7496130932768565, + "normalized_load_entropy": 0.9398333640338703, + "max_load_share": 0.0641025641025641 + } + }, + "s0_period": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "e579d6b32282b7be5492792bb85e9643f0015163ae19f3e633518717179d4316", + "route_weight_sha256": "b9d38521956f4bccdbdfcc924770df0cf8a2f17c86e4ea7344f65a134ec4e786", + "loads": [ + 2, + 1, + 1, + 1, + 4, + 5, + 1, + 0, + 3, + 2, + 5, + 1, + 0, + 0, + 1, + 1, + 5, + 2, + 5, + 2, + 1, + 1, + 3, + 4, + 3, + 3, + 0, + 0, + 5, + 3, + 2, + 3, + 2, + 1, + 1, + 6, + 1, + 2, + 3, + 1, + 2, + 2, + 2, + 5, + 0, + 2, + 0, + 1, + 3, + 4, + 4, + 2, + 2, + 6, + 4, + 4, + 0, + 0, + 1, + 1, + 4, + 3, + 4, + 1 + ], + "weighted_loads": [ + 0.15741869807243347, + 0.08633715659379959, + 0.07855638861656189, + 0.034231267869472504, + 0.33337731659412384, + 0.2706372570246458, + 0.024961642920970917, + 0.0, + 0.11216172575950623, + 0.25110095739364624, + 0.4926348440349102, + 0.03484167158603668, + 0.0, + 0.0, + 0.08085602521896362, + 0.052478231489658356, + 0.19275815412402153, + 0.07837973162531853, + 0.24839638732373714, + 0.18335653468966484, + 0.10101007670164108, + 0.055347468703985214, + 0.23651758581399918, + 0.12217789143323898, + 0.11760185472667217, + 0.18102815002202988, + 0.0, + 0.0, + 0.4301602356135845, + 0.15387403592467308, + 0.1854761242866516, + 0.2266881875693798, + 0.07841598615050316, + 0.05865195766091347, + 0.035756420344114304, + 0.5142838545143604, + 0.08074808865785599, + 0.220162071287632, + 0.16248204559087753, + 0.07102971524000168, + 0.0907859280705452, + 0.16972339153289795, + 0.17004092037677765, + 0.12934571132063866, + 0.0, + 0.1979219764471054, + 0.0, + 0.02637164294719696, + 0.22545519098639488, + 0.2740069981664419, + 0.1820238959044218, + 0.23197025805711746, + 0.11876006424427032, + 0.4071873463690281, + 0.19912260212004185, + 0.14382258988916874, + 0.0, + 0.0, + 0.08127107471227646, + 0.07792558521032333, + 0.1947396695613861, + 0.2641984038054943, + 0.1857079677283764, + 0.1123378649353981 + ], + "unique_experts": 55, + "load_cv": 0.7370277311900888, + "normalized_load_entropy": 0.924765995177022, + "max_load_share": 0.041666666666666664 + }, + "full_input": { + "tokens": 49, + "top_k": 6, + "decisions": 294, + "ordered_route_sha256": "b6c4c77923aa18c1270d44f40a502cc3ccef61393471baa27e99aef6ddef57d6", + "route_weight_sha256": "17588b790748a72d5326a03af36e24b1dd56dd6cc2bc5134246a04acf2a0e61a", + "loads": [ + 3, + 1, + 3, + 1, + 7, + 5, + 3, + 2, + 21, + 3, + 7, + 3, + 0, + 0, + 2, + 10, + 5, + 3, + 7, + 2, + 4, + 1, + 4, + 4, + 3, + 7, + 13, + 1, + 5, + 3, + 2, + 7, + 3, + 3, + 1, + 7, + 1, + 2, + 3, + 4, + 2, + 12, + 2, + 11, + 0, + 12, + 0, + 1, + 5, + 4, + 8, + 3, + 6, + 6, + 6, + 8, + 3, + 8, + 1, + 13, + 5, + 7, + 4, + 1 + ], + "weighted_loads": [ + 0.2508956268429756, + 0.08633715659379959, + 0.16391223669052124, + 0.034231267869472504, + 0.5071532931178808, + 0.2706372570246458, + 0.12701143324375153, + 0.2509942129254341, + 1.092521483078599, + 0.276732848957181, + 0.682179506868124, + 0.1958232820034027, + 0.0, + 0.0, + 0.10355883091688156, + 0.669218584895134, + 0.19275815412402153, + 0.15020621940493584, + 0.29677621088922024, + 0.18335653468966484, + 0.4323016181588173, + 0.055347468703985214, + 0.2666410971432924, + 0.12217789143323898, + 0.11760185472667217, + 0.34512966498732567, + 0.8672796431928873, + 0.06567826122045517, + 0.4301602356135845, + 0.15387403592467308, + 0.1854761242866516, + 0.682612519711256, + 0.14009325578808784, + 0.2679818905889988, + 0.035756420344114304, + 0.5356479957699776, + 0.08074808865785599, + 0.220162071287632, + 0.16248204559087753, + 0.3069944567978382, + 0.0907859280705452, + 0.5824440196156502, + 0.17004092037677765, + 0.2923466023057699, + 0.0, + 1.0195067413151264, + 0.0, + 0.02637164294719696, + 0.2703897953033447, + 0.2740069981664419, + 0.37647686526179314, + 0.2847808264195919, + 0.373666126281023, + 0.4071873463690281, + 0.24411900155246258, + 0.671335170045495, + 0.19348717853426933, + 0.47242954187095165, + 0.08127107471227646, + 0.8115747757256031, + 0.28562043607234955, + 0.47130581364035606, + 0.1857079677283764, + 0.1123378649353981 + ], + "unique_experts": 60, + "load_cv": 0.8410925728973427, + "normalized_load_entropy": 0.9223299240173268, + "max_load_share": 0.07142857142857142 + } + }, + "s1_period": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "07f8fdeed4d664ae6da81fc27a8b669836659bff7c878901b8cbb6eee9669c4f", + "route_weight_sha256": "68c7711b4d48a1193d5d15829e1a8327718c5c7d7d909438df8ad4fd543c4ffd", + "loads": [ + 2, + 1, + 1, + 1, + 4, + 5, + 1, + 1, + 2, + 2, + 5, + 1, + 0, + 0, + 1, + 1, + 5, + 2, + 5, + 2, + 1, + 1, + 3, + 3, + 3, + 3, + 0, + 0, + 6, + 3, + 2, + 3, + 2, + 1, + 1, + 6, + 1, + 2, + 4, + 1, + 2, + 2, + 2, + 6, + 0, + 2, + 0, + 1, + 3, + 4, + 3, + 2, + 2, + 6, + 3, + 4, + 0, + 0, + 1, + 1, + 4, + 3, + 4, + 1 + ], + "weighted_loads": [ + 0.14378874003887177, + 0.08668732643127441, + 0.0691617801785469, + 0.034115709364414215, + 0.32637082040309906, + 0.3086790591478348, + 0.02480953373014927, + 0.02223740890622139, + 0.057043397799134254, + 0.24662087857723236, + 0.4578094407916069, + 0.03647952154278755, + 0.0, + 0.0, + 0.07377409189939499, + 0.05132857710123062, + 0.21381205320358276, + 0.07704952731728554, + 0.225147457793355, + 0.18180130422115326, + 0.1014784649014473, + 0.05627148225903511, + 0.24879751726984978, + 0.08883987180888653, + 0.11615878157317638, + 0.18691996484994888, + 0.0, + 0.0, + 0.4770863614976406, + 0.16537177190184593, + 0.1855529323220253, + 0.23097483068704605, + 0.07308990135788918, + 0.051741939038038254, + 0.03671912103891373, + 0.49620016664266586, + 0.08326403796672821, + 0.19159884750843048, + 0.1934185680001974, + 0.07417561858892441, + 0.08315133303403854, + 0.1859688013792038, + 0.16457506269216537, + 0.15399433113634586, + 0.0, + 0.19532732665538788, + 0.0, + 0.026792794466018677, + 0.23055579513311386, + 0.28329167142510414, + 0.15790490061044693, + 0.2284359522163868, + 0.11288602277636528, + 0.43623286858201027, + 0.17644838988780975, + 0.1479939967393875, + 0.0, + 0.0, + 0.06683454662561417, + 0.07768232375383377, + 0.20768744871020317, + 0.26467911526560783, + 0.18619528785347939, + 0.10779858380556107 + ], + "unique_experts": 56, + "load_cv": 0.7453559924999299, + "normalized_load_entropy": 0.9264382676747723, + "max_load_share": 0.041666666666666664 + }, + "full_input": { + "tokens": 65, + "top_k": 6, + "decisions": 390, + "ordered_route_sha256": "d1efe713cd9334fae4a9860feab4d9587a253d5d9b4748a67813f892d49930b2", + "route_weight_sha256": "ae657365306c6c5204c6f5299140bf420eca41489fa894aa5d175a55f12cb508", + "loads": [ + 5, + 1, + 4, + 1, + 10, + 7, + 2, + 4, + 24, + 3, + 10, + 5, + 0, + 2, + 1, + 13, + 5, + 7, + 8, + 4, + 4, + 3, + 7, + 4, + 5, + 8, + 20, + 2, + 6, + 5, + 4, + 9, + 4, + 3, + 1, + 6, + 3, + 3, + 4, + 6, + 2, + 15, + 5, + 12, + 1, + 12, + 0, + 3, + 5, + 4, + 12, + 7, + 8, + 6, + 9, + 8, + 9, + 12, + 3, + 11, + 6, + 8, + 4, + 5 + ], + "weighted_loads": [ + 0.34997449815273285, + 0.08668732643127441, + 0.21913112327456474, + 0.034115709364414215, + 0.7371819000691175, + 0.4455033726990223, + 0.07014798931777477, + 0.23789955116808414, + 1.346223820000887, + 0.2675609942525625, + 0.8388213589787483, + 0.37405253760516644, + 0.0, + 0.06750998832285404, + 0.07377409189939499, + 0.7536496371030807, + 0.21381205320358276, + 0.2783458065241575, + 0.31313955411314964, + 0.26961497217416763, + 0.3892785608768463, + 0.2613180913031101, + 0.5194011926651001, + 0.1234953012317419, + 0.18803920410573483, + 0.38199651800096035, + 1.3396385256201029, + 0.09278073534369469, + 0.4770863614976406, + 0.3266373760998249, + 0.2923072725534439, + 0.9024587273597717, + 0.1618930622935295, + 0.21968698874115944, + 0.03671912103891373, + 0.49620016664266586, + 0.36485558934509754, + 0.2253241166472435, + 0.1934185680001974, + 0.42762109637260437, + 0.08315133303403854, + 0.7960461471229792, + 0.3720655217766762, + 0.3518900778144598, + 0.15223047137260437, + 0.96329665184021, + 0.0, + 0.1092460174113512, + 0.38202428817749023, + 0.28329167142510414, + 0.6346935145556927, + 0.6357176564633846, + 0.4393106661736965, + 0.43623286858201027, + 0.3166541066020727, + 0.6495522633194923, + 0.36185624450445175, + 0.7051325105130672, + 0.14183401688933372, + 0.7150340005755424, + 0.323493430390954, + 0.5596283227205276, + 0.18619528785347939, + 0.5995539501309395 + ], + "unique_experts": 62, + "load_cv": 0.7320052524933435, + "normalized_load_entropy": 0.9406826714748417, + "max_load_share": 0.06153846153846154 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 24, + "ordered_topk_exact_tokens": 19, + "set_exact_tokens": 23, + "mean_set_jaccard": 0.9880952380952381, + "mean_token_weighted_tv": 0.005615073838271201, + "aggregate_load_tv": 0.006944444444444444 + }, + "system_bos": { + "tokens": 24, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.9166666666666666, + "mean_token_weighted_tv": 0.01625653150646637, + "aggregate_load_tv": 0.04861111111111111 + }, + "system_x": { + "tokens": 24, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.9166666666666666, + "mean_token_weighted_tv": 0.018309657423136134, + "aggregate_load_tv": 0.04861111111111111 + }, + "system_period": { + "tokens": 24, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 20, + "mean_set_jaccard": 0.9523809523809524, + "mean_token_weighted_tv": 0.014393928305556377, + "aggregate_load_tv": 0.027777777777777773 + }, + "bos_at_s0": { + "tokens": 24, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 12, + "mean_set_jaccard": 0.8392857142857144, + "mean_token_weighted_tv": 0.03151910406692574, + "aggregate_load_tv": 0.09027777777777779 + }, + "bos_at_s1": { + "tokens": 24, + "ordered_topk_exact_tokens": 8, + "set_exact_tokens": 11, + "mean_set_jaccard": 0.8363095238095238, + "mean_token_weighted_tv": 0.03196613300436487, + "aggregate_load_tv": 0.09027777777777778 + }, + "x_at_s0": { + "tokens": 24, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8720238095238096, + "mean_token_weighted_tv": 0.026208054817592103, + "aggregate_load_tv": 0.06944444444444445 + }, + "x_at_s1": { + "tokens": 24, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 12, + "mean_set_jaccard": 0.8392857142857143, + "mean_token_weighted_tv": 0.03239799872972071, + "aggregate_load_tv": 0.09027777777777779 + }, + "period_at_s0": { + "tokens": 24, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8630952380952381, + "mean_token_weighted_tv": 0.027248804418680567, + "aggregate_load_tv": 0.0763888888888889 + }, + "period_at_s1": { + "tokens": 24, + "ordered_topk_exact_tokens": 8, + "set_exact_tokens": 12, + "mean_set_jaccard": 0.8392857142857143, + "mean_token_weighted_tv": 0.03254287961559991, + "aggregate_load_tv": 0.09027777777777779 + } + } + }, + "layer_02": { + "layer": 2, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "97649258a1e4e4bc5ce37da587d840b1b57b8dcbb47f7be4a2ae00cee1b60bba", + "route_weight_sha256": "c616f85f08f761831621c158b8e9a97e80c541ab351625812566cc46229a3669", + "loads": [ + 4, + 1, + 2, + 3, + 3, + 3, + 3, + 4, + 4, + 5, + 1, + 2, + 3, + 1, + 3, + 4, + 4, + 3, + 3, + 4, + 3, + 0, + 1, + 2, + 4, + 1, + 3, + 1, + 3, + 0, + 1, + 5, + 0, + 0, + 1, + 2, + 3, + 1, + 0, + 2, + 0, + 3, + 2, + 3, + 4, + 1, + 4, + 5, + 3, + 2, + 4, + 0, + 2, + 3, + 3, + 0, + 2, + 0, + 0, + 3, + 0, + 3, + 0, + 4 + ], + "weighted_loads": [ + 0.2424292452633381, + 0.03489944711327553, + 0.1426151841878891, + 0.33168398030102253, + 0.2171068824827671, + 0.16157697513699532, + 0.11581543646752834, + 0.23603476211428642, + 0.3859923332929611, + 0.3132034372538328, + 0.027819247916340828, + 0.8077012300491333, + 0.2589212730526924, + 0.025261102244257927, + 0.09214000776410103, + 0.24740054458379745, + 0.16767241433262825, + 0.3695746138691902, + 0.3518192060291767, + 0.509480431675911, + 0.16606072336435318, + 0.0, + 0.026282252743840218, + 0.23570269346237183, + 0.24746644124388695, + 0.1493270844221115, + 0.1412187609821558, + 0.04620029032230377, + 0.25370480865240097, + 0.0, + 0.08935979008674622, + 0.5105457007884979, + 0.0, + 0.0, + 0.050711583346128464, + 0.09573619067668915, + 0.15258265286684036, + 0.022915620356798172, + 0.0, + 0.17468109726905823, + 0.0, + 0.2004220075905323, + 0.20758844912052155, + 0.2722568213939667, + 0.34502071142196655, + 0.10690127313137054, + 0.2747272774577141, + 0.2874697297811508, + 0.130593903362751, + 0.23385316878557205, + 0.2437625639140606, + 0.0, + 0.15642548352479935, + 0.2200244404375553, + 0.4437110722064972, + 0.0, + 0.06221172586083412, + 0.0, + 0.0, + 0.21468133851885796, + 0.0, + 0.16801033541560173, + 0.0, + 0.3459002524614334 + ], + "unique_experts": 52, + "load_cv": 0.6666666666666666, + "normalized_load_entropy": 0.927427565096385, + "max_load_share": 0.034722222222222224 + }, + "full_input": { + "tokens": 49, + "top_k": 6, + "decisions": 294, + "ordered_route_sha256": "3336711758dc151ff4c5ec459847458c57c2fbe3bf71097f0f187f34f6291c84", + "route_weight_sha256": "672a7000fed0113021b0e8bcae1a0ee7c7dab9c94dc326fe6b0c77efd47e8c97", + "loads": [ + 4, + 11, + 2, + 5, + 3, + 3, + 3, + 5, + 7, + 5, + 4, + 2, + 3, + 2, + 12, + 4, + 4, + 4, + 4, + 8, + 5, + 9, + 1, + 2, + 7, + 1, + 4, + 3, + 6, + 0, + 1, + 6, + 0, + 0, + 6, + 17, + 4, + 1, + 3, + 2, + 0, + 3, + 8, + 3, + 4, + 1, + 7, + 9, + 4, + 2, + 4, + 6, + 2, + 4, + 3, + 0, + 2, + 7, + 9, + 6, + 11, + 5, + 6, + 15 + ], + "weighted_loads": [ + 0.2424292452633381, + 0.9810571745038033, + 0.1426151841878891, + 2.0335750449448824, + 0.2171068824827671, + 0.16157697513699532, + 0.11581543646752834, + 0.2827775962650776, + 0.5990986227989197, + 0.3132034372538328, + 0.1536670532077551, + 0.8077012300491333, + 0.2589212730526924, + 0.0518571138381958, + 0.415240278467536, + 0.24740054458379745, + 0.16767241433262825, + 0.37027484585996717, + 0.35341162828262895, + 1.3338655680418015, + 0.47889309376478195, + 0.694726150482893, + 0.026282252743840218, + 0.23570269346237183, + 0.38314574398100376, + 0.1493270844221115, + 0.14206825208384544, + 0.3403806835412979, + 0.4996865428984165, + 0.0, + 0.08935979008674622, + 0.5112450488377362, + 0.0, + 0.0, + 0.2757384181022644, + 2.2315004905685782, + 0.17473446018993855, + 0.022915620356798172, + 0.11157878022640944, + 0.17468109726905823, + 0.0, + 0.2004220075905323, + 0.7976592294871807, + 0.2722568213939667, + 0.34502071142196655, + 0.10690127313137054, + 0.366167277097702, + 0.5742217749357224, + 0.15614110976457596, + 0.23385316878557205, + 0.2437625639140606, + 0.6571432687342167, + 0.15642548352479935, + 0.22134163696318865, + 0.4437110722064972, + 0.0, + 0.06221172586083412, + 0.39373829215765, + 0.3854165356606245, + 0.403630755841732, + 0.9188749194145203, + 0.2543051913380623, + 0.494213892146945, + 0.963190134614706 + ], + "unique_experts": 59, + "load_cv": 0.7538139408688893, + "normalized_load_entropy": 0.9327617028081977, + "max_load_share": 0.05782312925170068 + } + }, + "s1_eos": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "b660c9927f243dd526f8e3cf6784b1af67a25567ab6860a0ef9365445cdc6a92", + "route_weight_sha256": "f0643fc24907486338f309f9341ff0b13ea5e9b2d6dffd02673e5541035f3d9f", + "loads": [ + 4, + 1, + 2, + 3, + 3, + 3, + 3, + 4, + 4, + 5, + 1, + 2, + 3, + 1, + 3, + 4, + 4, + 3, + 3, + 4, + 3, + 0, + 1, + 2, + 4, + 1, + 3, + 1, + 3, + 0, + 1, + 5, + 0, + 0, + 1, + 2, + 3, + 1, + 0, + 2, + 0, + 3, + 2, + 3, + 4, + 1, + 4, + 5, + 3, + 2, + 4, + 0, + 2, + 3, + 3, + 0, + 2, + 0, + 0, + 3, + 0, + 3, + 0, + 4 + ], + "weighted_loads": [ + 0.2401662953197956, + 0.03572385758161545, + 0.14548559859395027, + 0.3433683328330517, + 0.21914930641651154, + 0.16460437700152397, + 0.11603575013577938, + 0.23859401419758797, + 0.3825123980641365, + 0.31510007567703724, + 0.028773747384548187, + 0.8008833825588226, + 0.2550577484071255, + 0.025515055283904076, + 0.09200077317655087, + 0.24350430071353912, + 0.16880934312939644, + 0.36678513139486313, + 0.35564298927783966, + 0.5114677101373672, + 0.16513729095458984, + 0.0, + 0.027507362887263298, + 0.2401258572936058, + 0.23913097009062767, + 0.14170965552330017, + 0.14255644381046295, + 0.04876069352030754, + 0.2561766766011715, + 0.0, + 0.0909370630979538, + 0.5062963888049126, + 0.0, + 0.0, + 0.04813719540834427, + 0.09369276463985443, + 0.15609652549028397, + 0.022313548251986504, + 0.0, + 0.17014297097921371, + 0.0, + 0.20424699410796165, + 0.21355121582746506, + 0.27994850277900696, + 0.3466845452785492, + 0.10986597090959549, + 0.27519772201776505, + 0.2859889827668667, + 0.13469172455370426, + 0.23744111508131027, + 0.24532314389944077, + 0.0, + 0.15369479358196259, + 0.21230486035346985, + 0.46101832389831543, + 0.0, + 0.06183287501335144, + 0.0, + 0.0, + 0.22024020552635193, + 0.0, + 0.17288583517074585, + 0.0, + 0.3418424390256405 + ], + "unique_experts": 52, + "load_cv": 0.6666666666666666, + "normalized_load_entropy": 0.927427565096385, + "max_load_share": 0.034722222222222224 + }, + "full_input": { + "tokens": 65, + "top_k": 6, + "decisions": 390, + "ordered_route_sha256": "fd7dafc5408508a2ad28f2aac2038536b17908fb893bfed94cca938c2befaebc", + "route_weight_sha256": "b7ce4c4ff937ef8cf50bf2a7366b08b9874cbac42534090b00dfec60ceff562c", + "loads": [ + 8, + 12, + 3, + 6, + 5, + 4, + 3, + 7, + 13, + 6, + 8, + 2, + 3, + 4, + 15, + 5, + 6, + 4, + 4, + 10, + 5, + 11, + 2, + 2, + 11, + 2, + 4, + 4, + 8, + 0, + 2, + 7, + 0, + 0, + 10, + 19, + 4, + 2, + 7, + 5, + 0, + 3, + 11, + 4, + 7, + 1, + 11, + 12, + 5, + 3, + 5, + 9, + 3, + 7, + 3, + 0, + 6, + 6, + 2, + 12, + 11, + 8, + 10, + 18 + ], + "weighted_loads": [ + 0.7614898383617401, + 1.0412753857672215, + 0.17085189744830132, + 2.080028522759676, + 0.27144754119217396, + 0.3058185689151287, + 0.11603575013577938, + 0.3492308259010315, + 1.1263656839728355, + 0.43185784853994846, + 0.33504294604063034, + 0.8008833825588226, + 0.2550577484071255, + 0.07669212453765795, + 0.6429636273533106, + 0.2762155868113041, + 0.23231965489685535, + 0.3673705543624237, + 0.357021612348035, + 1.3630533386021852, + 0.45338617265224457, + 0.7936188727617264, + 0.06587270088493824, + 0.2401258572936058, + 0.5356229208409786, + 0.19191797450184822, + 0.1433825668063946, + 0.7405219487845898, + 0.5093042477965355, + 0.0, + 0.124648068100214, + 0.5492290537804365, + 0.0, + 0.0, + 0.41549577564001083, + 1.9936187854036689, + 0.17778325080871582, + 0.06447540409862995, + 0.24452076200395823, + 0.5232537873089314, + 0.0, + 0.20424699410796165, + 1.254018247127533, + 0.46136853098869324, + 0.9982967525720596, + 0.10986597090959549, + 0.874366907402873, + 0.6935152299702168, + 0.20345217362046242, + 0.28045855462551117, + 0.27143804356455803, + 0.9722125269472599, + 0.3301662355661392, + 0.39699889451730996, + 0.46101832389831543, + 0.0, + 0.31548476591706276, + 0.29249532520771027, + 0.11099189892411232, + 0.7046407703310251, + 0.760531347244978, + 0.5361957401037216, + 0.8955154027789831, + 1.37017772346735 + ], + "unique_experts": 59, + "load_cv": 0.7020773159189393, + "normalized_load_entropy": 0.9376570789508402, + "max_load_share": 0.04871794871794872 + } + }, + "s0_bos": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "db923203835200ec5b4bbf91060dc95d64ea55f46094dd31d8a92feff5ec9970", + "route_weight_sha256": "4d096dd82f17c0583a3661ff8059acbe23e060052f1619069ed76c3f08d198ad", + "loads": [ + 4, + 1, + 2, + 3, + 4, + 2, + 3, + 4, + 4, + 5, + 1, + 2, + 3, + 1, + 1, + 4, + 4, + 3, + 4, + 4, + 2, + 0, + 1, + 2, + 4, + 1, + 3, + 1, + 3, + 0, + 1, + 5, + 0, + 0, + 2, + 2, + 3, + 1, + 0, + 3, + 0, + 3, + 3, + 3, + 4, + 1, + 4, + 5, + 3, + 2, + 4, + 0, + 2, + 3, + 3, + 0, + 1, + 0, + 0, + 3, + 0, + 3, + 0, + 4 + ], + "weighted_loads": [ + 0.2544144280254841, + 0.04621202498674393, + 0.1433103159070015, + 0.31745604798197746, + 0.2798304930329323, + 0.11758102849125862, + 0.11469648033380508, + 0.21084855496883392, + 0.3463372066617012, + 0.29818831756711006, + 0.02603122405707836, + 0.8201870918273926, + 0.23135033249855042, + 0.026956193149089813, + 0.02921004220843315, + 0.24284029006958008, + 0.17346679419279099, + 0.37455952912569046, + 0.3725998643785715, + 0.48574622720479965, + 0.10396947711706161, + 0.0, + 0.02689053677022457, + 0.22959786653518677, + 0.21240471675992012, + 0.13783402740955353, + 0.14067892730236053, + 0.04994761943817139, + 0.26231352984905243, + 0.0, + 0.09626232087612152, + 0.5335526987910271, + 0.0, + 0.0, + 0.09581524506211281, + 0.09244638308882713, + 0.142471794039011, + 0.024978594854474068, + 0.0, + 0.20429055020213127, + 0.0, + 0.2049950174987316, + 0.2625473327934742, + 0.26806872710585594, + 0.36591679602861404, + 0.10436254739761353, + 0.2681291252374649, + 0.26830325089395046, + 0.13358044810593128, + 0.23410655558109283, + 0.25407631881535053, + 0.0, + 0.14280124008655548, + 0.216790322214365, + 0.4366079978644848, + 0.0, + 0.023551732301712036, + 0.0, + 0.0, + 0.20106638967990875, + 0.0, + 0.1992473192512989, + 0.0, + 0.318940844386816 + ], + "unique_experts": 52, + "load_cv": 0.6804138174397717, + "normalized_load_entropy": 0.9254190726270453, + "max_load_share": 0.034722222222222224 + }, + "full_input": { + "tokens": 49, + "top_k": 6, + "decisions": 294, + "ordered_route_sha256": "295bb52a82f2bbdcc22da5dc0a35da529af0fdaf8458d6eab4130808be35e2e4", + "route_weight_sha256": "d9338c92fb245844a3e291088685643028d011b7bd1b8cca11bdee3f29c933f5", + "loads": [ + 4, + 11, + 2, + 4, + 5, + 2, + 3, + 5, + 8, + 5, + 4, + 2, + 4, + 2, + 6, + 4, + 5, + 3, + 4, + 8, + 4, + 9, + 1, + 2, + 6, + 1, + 3, + 3, + 6, + 0, + 1, + 5, + 0, + 0, + 7, + 18, + 3, + 1, + 4, + 3, + 0, + 3, + 10, + 3, + 4, + 1, + 6, + 9, + 4, + 2, + 4, + 6, + 2, + 3, + 3, + 0, + 1, + 9, + 8, + 9, + 11, + 5, + 7, + 16 + ], + "weighted_loads": [ + 0.2544144280254841, + 0.9923697523772717, + 0.1433103159070015, + 1.0466226749122143, + 0.30319175869226456, + 0.11758102849125862, + 0.11469648033380508, + 0.2575913891196251, + 0.5656790789216757, + 0.29818831756711006, + 0.15187902934849262, + 0.8201870918273926, + 0.2636519707739353, + 0.05102227069437504, + 0.22809868678450584, + 0.24284029006958008, + 0.20336555130779743, + 0.37455952912569046, + 0.3725998643785715, + 1.2192620560526848, + 0.39412061125040054, + 0.7051362171769142, + 0.02689053677022457, + 0.22959786653518677, + 0.30988964065909386, + 0.13783402740955353, + 0.14067892730236053, + 0.32618898153305054, + 0.5496541373431683, + 0.0, + 0.09626232087612152, + 0.5335526987910271, + 0.0, + 0.0, + 0.32084207981824875, + 2.2332936180755496, + 0.142471794039011, + 0.024978594854474068, + 0.2033617151901126, + 0.20429055020213127, + 0.0, + 0.2049950174987316, + 0.9308385960757732, + 0.26806872710585594, + 0.36591679602861404, + 0.10436254739761353, + 0.3349371552467346, + 0.5347356181591749, + 0.15912765450775623, + 0.23410655558109283, + 0.25407631881535053, + 0.5961162485182285, + 0.14280124008655548, + 0.216790322214365, + 0.4366079978644848, + 0.0, + 0.023551732301712036, + 0.4402148798108101, + 0.36412183195352554, + 0.41051311045885086, + 0.9029358699917793, + 0.28554217517375946, + 0.6531963031738997, + 1.1755379401147366 + ], + "unique_experts": 59, + "load_cv": 0.7770303754418451, + "normalized_load_entropy": 0.9297859302417321, + "max_load_share": 0.061224489795918366 + } + }, + "s1_bos": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "2cc610fdb3b34451eab3b565e80611599713906308c8b884472f2b7695cc3204", + "route_weight_sha256": "1d52bab382deb38c60c7ad520f7b8f8a1f5347f6aef1e2939c2112a11729287d", + "loads": [ + 4, + 1, + 2, + 2, + 4, + 2, + 4, + 4, + 4, + 5, + 1, + 2, + 3, + 1, + 1, + 4, + 4, + 3, + 4, + 4, + 2, + 0, + 1, + 3, + 4, + 1, + 3, + 1, + 3, + 0, + 1, + 5, + 0, + 0, + 2, + 2, + 2, + 0, + 0, + 3, + 0, + 3, + 3, + 3, + 4, + 1, + 4, + 5, + 3, + 2, + 5, + 0, + 2, + 3, + 3, + 0, + 1, + 0, + 0, + 3, + 0, + 3, + 0, + 4 + ], + "weighted_loads": [ + 0.2623096629977226, + 0.047839462757110596, + 0.14690624922513962, + 0.32619618624448776, + 0.2799767181277275, + 0.12201295793056488, + 0.1411155555397272, + 0.20582541450858116, + 0.3740639090538025, + 0.30212882347404957, + 0.027859492227435112, + 0.8031868636608124, + 0.24048876389861107, + 0.02687755413353443, + 0.024145035073161125, + 0.24054503068327904, + 0.17953889816999435, + 0.36404503136873245, + 0.3715991210192442, + 0.49873607605695724, + 0.10783133283257484, + 0.0, + 0.030555739998817444, + 0.25637529231607914, + 0.2079685889184475, + 0.13071639835834503, + 0.14020219072699547, + 0.04332083463668823, + 0.2640332505106926, + 0.0, + 0.11177175492048264, + 0.5352991968393326, + 0.0, + 0.0, + 0.09156981110572815, + 0.09572959318757057, + 0.10920819267630577, + 0.0, + 0.0, + 0.208501435816288, + 0.0, + 0.20642708241939545, + 0.27585769817233086, + 0.2714549582451582, + 0.37473001331090927, + 0.1096215471625328, + 0.2747987061738968, + 0.2568097058683634, + 0.1333991251885891, + 0.23728995770215988, + 0.287516001611948, + 0.0, + 0.1396087445318699, + 0.22011838480830193, + 0.46947192400693893, + 0.0, + 0.021466810256242752, + 0.0, + 0.0, + 0.2044437825679779, + 0.0, + 0.21341633051633835, + 0.0, + 0.29504021257162094 + ], + "unique_experts": 51, + "load_cv": 0.7027283689263065, + "normalized_load_entropy": 0.9206738579625662, + "max_load_share": 0.034722222222222224 + }, + "full_input": { + "tokens": 65, + "top_k": 6, + "decisions": 390, + "ordered_route_sha256": "ee68fa415585348eadec84b31240f40b30805549880edcf19ee1cec837aebfbc", + "route_weight_sha256": "ad5f9f427b52ca683a978bf12e46a8d8336f1215ff47bf8a41fe525d1c57f070", + "loads": [ + 8, + 12, + 3, + 5, + 6, + 3, + 4, + 7, + 14, + 6, + 8, + 2, + 4, + 3, + 12, + 5, + 7, + 3, + 4, + 10, + 4, + 11, + 2, + 3, + 10, + 2, + 3, + 4, + 8, + 0, + 2, + 7, + 0, + 0, + 11, + 20, + 3, + 1, + 7, + 6, + 0, + 3, + 13, + 4, + 7, + 1, + 11, + 12, + 5, + 3, + 6, + 9, + 3, + 6, + 3, + 0, + 5, + 5, + 2, + 13, + 11, + 8, + 12, + 18 + ], + "weighted_loads": [ + 0.7836332060396671, + 1.0533909909427166, + 0.17227254807949066, + 1.1197283118963242, + 0.33556987531483173, + 0.2632271498441696, + 0.1411155555397272, + 0.3164622262120247, + 1.1571297124028206, + 0.4188865963369608, + 0.33412869088351727, + 0.8031868636608124, + 0.26813932321965694, + 0.07525278627872467, + 0.5242269281297922, + 0.273256316781044, + 0.27157342806458473, + 0.36404503136873245, + 0.3715991210192442, + 1.2483989987522364, + 0.382347721606493, + 0.8161719813942909, + 0.06892107799649239, + 0.25637529231607914, + 0.47287463024258614, + 0.18092471733689308, + 0.14020219072699547, + 0.7270734459161758, + 0.5738112889230251, + 0.0, + 0.14548275992274284, + 0.5782318618148565, + 0.0, + 0.0, + 0.4589283913373947, + 2.0374053521081805, + 0.12809610180556774, + 0.04216185584664345, + 0.32137075904756784, + 0.5616122521460056, + 0.0, + 0.20642708241939545, + 1.383443584665656, + 0.4528749864548445, + 1.0263422206044197, + 0.1096215471625328, + 0.876309584826231, + 0.6497983876615763, + 0.20215957425534725, + 0.2803073972463608, + 0.3136309012770653, + 0.9757623076438904, + 0.3160801865160465, + 0.40372797660529613, + 0.46947192400693893, + 0.0, + 0.27511870115995407, + 0.23384713381528854, + 0.11099189892411232, + 0.6626649349927902, + 0.737219300121069, + 0.5767262354493141, + 1.0175078082829714, + 1.45999576151371 + ], + "unique_experts": 59, + "load_cv": 0.7239129554904307, + "normalized_load_entropy": 0.9343708839757038, + "max_load_share": 0.05128205128205128 + } + }, + "s0_x": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "097f6c7c26fb79e2adcb141b0dcd67aa89851b398a10132bed9e2983b9ab14f3", + "route_weight_sha256": "1047e2842aa408e964e2fb1e19d0ac5dc4e9b08d77b6cd5302597cda2c3a76df", + "loads": [ + 4, + 1, + 2, + 3, + 3, + 2, + 3, + 4, + 4, + 5, + 1, + 2, + 3, + 1, + 1, + 4, + 4, + 3, + 4, + 4, + 2, + 0, + 1, + 2, + 4, + 1, + 3, + 1, + 3, + 0, + 1, + 5, + 0, + 0, + 2, + 2, + 3, + 1, + 0, + 3, + 0, + 3, + 3, + 3, + 4, + 1, + 4, + 5, + 3, + 2, + 4, + 0, + 2, + 3, + 3, + 1, + 1, + 0, + 0, + 3, + 0, + 3, + 0, + 4 + ], + "weighted_loads": [ + 0.270649928599596, + 0.04223727807402611, + 0.14301510900259018, + 0.3230293486267328, + 0.21961092948913574, + 0.11691150814294815, + 0.11063826829195023, + 0.21238120645284653, + 0.36441216617822647, + 0.3053291477262974, + 0.025802940130233765, + 0.7882614433765411, + 0.2432711310684681, + 0.026787975803017616, + 0.027850592508912086, + 0.2460183948278427, + 0.17146125063300133, + 0.36631738394498825, + 0.36288574896752834, + 0.4528709128499031, + 0.10392159968614578, + 0.0, + 0.025905825197696686, + 0.22565481811761856, + 0.21114901825785637, + 0.13660572469234467, + 0.14557050913572311, + 0.04853710159659386, + 0.2683085538446903, + 0.0, + 0.09461583197116852, + 0.5258565284311771, + 0.0, + 0.0, + 0.09760208427906036, + 0.09565885365009308, + 0.14623644202947617, + 0.02339417301118374, + 0.0, + 0.2093249335885048, + 0.0, + 0.19729065895080566, + 0.2659429982304573, + 0.2660992369055748, + 0.3489326164126396, + 0.10551708936691284, + 0.2789071798324585, + 0.2546877972781658, + 0.12850810773670673, + 0.23333463817834854, + 0.25257387571036816, + 0.0, + 0.1501554325222969, + 0.21122117713093758, + 0.43643711879849434, + 0.046402741223573685, + 0.024220675230026245, + 0.0, + 0.0, + 0.21081754565238953, + 0.0, + 0.1929742954671383, + 0.0, + 0.30503224581480026 + ], + "unique_experts": 53, + "load_cv": 0.6666666666666666, + "normalized_load_entropy": 0.9291749898699116, + "max_load_share": 0.034722222222222224 + }, + "full_input": { + "tokens": 49, + "top_k": 6, + "decisions": 294, + "ordered_route_sha256": "523878c8c66553012f3b7386140c6a90a28681f89e615de351fac6ef3af810e0", + "route_weight_sha256": "d9853f96d720c9b3a07edef5e0c9a1be38297f8b440e4a94d5745bddc99f58f1", + "loads": [ + 4, + 11, + 2, + 4, + 4, + 2, + 4, + 5, + 8, + 5, + 6, + 3, + 4, + 2, + 5, + 4, + 5, + 3, + 4, + 8, + 4, + 10, + 1, + 2, + 6, + 1, + 3, + 3, + 6, + 0, + 1, + 5, + 0, + 0, + 7, + 17, + 4, + 1, + 3, + 3, + 0, + 3, + 9, + 3, + 4, + 1, + 6, + 10, + 4, + 2, + 4, + 6, + 2, + 3, + 3, + 1, + 1, + 7, + 9, + 8, + 12, + 5, + 6, + 15 + ], + "weighted_loads": [ + 0.270649928599596, + 0.9883950054645538, + 0.14301510900259018, + 1.0521959755569696, + 0.2424526233226061, + 0.11691150814294815, + 0.14549904316663742, + 0.2591240406036377, + 0.6030444428324699, + 0.3053291477262974, + 0.2609412781894207, + 0.8233470842242241, + 0.27328584901988506, + 0.051970100030303, + 0.20443132519721985, + 0.2460183948278427, + 0.20230465941131115, + 0.36631738394498825, + 0.36288574896752834, + 1.2097191736102104, + 0.40443000942468643, + 1.0027375668287277, + 0.025905825197696686, + 0.22565481811761856, + 0.304897204041481, + 0.13660572469234467, + 0.14557050913572311, + 0.3226674012839794, + 0.5554957147687674, + 0.0, + 0.09461583197116852, + 0.5258565284311771, + 0.0, + 0.0, + 0.3226289190351963, + 2.2176193175837398, + 0.16687712632119656, + 0.02339417301118374, + 0.11243331711739302, + 0.2093249335885048, + 0.0, + 0.19729065895080566, + 0.8475327529013157, + 0.2660992369055748, + 0.3489326164126396, + 0.10551708936691284, + 0.3457152098417282, + 0.5578029379248619, + 0.15405531413853168, + 0.23333463817834854, + 0.25257387571036816, + 0.5367463231086731, + 0.1501554325222969, + 0.21122117713093758, + 0.43643711879849434, + 0.046402741223573685, + 0.024220675230026245, + 0.36276749707758427, + 0.49318666011095047, + 0.39014058746397495, + 0.9621762782335281, + 0.27926915138959885, + 0.6174964364618063, + 0.8351182211190462 + ], + "unique_experts": 60, + "load_cv": 0.749874655945768, + "normalized_load_entropy": 0.9345094079399723, + "max_load_share": 0.05782312925170068 + } + }, + "s1_x": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "e2b417ec8a7f61850944e018ab43f0b4ff781da1388c93e2dc222cce48782a91", + "route_weight_sha256": "4181e7a99427a6d25d46b3c883563dfd2dcf101d4dffbf82d7fc7c8fb028a519", + "loads": [ + 4, + 1, + 2, + 3, + 3, + 2, + 3, + 4, + 4, + 5, + 1, + 2, + 3, + 1, + 1, + 4, + 4, + 3, + 4, + 4, + 2, + 0, + 1, + 2, + 4, + 1, + 3, + 1, + 3, + 0, + 1, + 5, + 0, + 1, + 2, + 2, + 2, + 1, + 0, + 3, + 0, + 3, + 4, + 3, + 4, + 1, + 4, + 4, + 3, + 2, + 5, + 0, + 2, + 3, + 3, + 1, + 1, + 0, + 0, + 2, + 0, + 3, + 0, + 4 + ], + "weighted_loads": [ + 0.28227395564317703, + 0.04399527981877327, + 0.14401644468307495, + 0.3567805252969265, + 0.22547544166445732, + 0.11762840300798416, + 0.11017871834337711, + 0.20735179260373116, + 0.38670869171619415, + 0.3041395116597414, + 0.027920639142394066, + 0.7830227017402649, + 0.2477453351020813, + 0.02735523320734501, + 0.0231314804404974, + 0.23574819415807724, + 0.17551235109567642, + 0.3610154688358307, + 0.3703858610242605, + 0.4663509801030159, + 0.10603878274559975, + 0.0, + 0.030246345326304436, + 0.22919367253780365, + 0.2071591131389141, + 0.12367040663957596, + 0.13960881158709526, + 0.04354032129049301, + 0.2623325437307358, + 0.0, + 0.11616552621126175, + 0.5329257361590862, + 0.0, + 0.02333172596991062, + 0.09190845116972923, + 0.106658224016428, + 0.11095930635929108, + 0.022742707282304764, + 0.0, + 0.20866722986102104, + 0.0, + 0.1988048478960991, + 0.3339915759861469, + 0.266790684312582, + 0.3651997484266758, + 0.10440288484096527, + 0.2806774973869324, + 0.2169632688164711, + 0.13142530247569084, + 0.2311009094119072, + 0.2930824104696512, + 0.0, + 0.1351827196776867, + 0.2177504040300846, + 0.47302113473415375, + 0.04654179513454437, + 0.021710410714149475, + 0.0, + 0.0, + 0.16955462843179703, + 0.0, + 0.22056491672992706, + 0.0, + 0.2627681493759155 + ], + "unique_experts": 54, + "load_cv": 0.6620208493229436, + "normalized_load_entropy": 0.9317961270302014, + "max_load_share": 0.034722222222222224 + }, + "full_input": { + "tokens": 65, + "top_k": 6, + "decisions": 390, + "ordered_route_sha256": "fa2641d9ff74818417c2efb7e6f630f064a5493d2d547d91f36f09a49cabdabb", + "route_weight_sha256": "2c380e13a47b5afb866f02486d38e9c5909cf7e328611b675da786b7ad0df697", + "loads": [ + 8, + 12, + 3, + 5, + 5, + 3, + 3, + 7, + 14, + 6, + 10, + 3, + 4, + 3, + 9, + 5, + 7, + 3, + 4, + 10, + 4, + 12, + 2, + 2, + 10, + 2, + 3, + 4, + 8, + 0, + 2, + 7, + 1, + 1, + 11, + 20, + 3, + 2, + 6, + 6, + 0, + 3, + 13, + 4, + 7, + 1, + 11, + 12, + 5, + 3, + 6, + 8, + 3, + 6, + 3, + 1, + 5, + 5, + 3, + 13, + 12, + 8, + 11, + 17 + ], + "weighted_loads": [ + 0.8035974986851215, + 1.0495468080043793, + 0.169382743537426, + 1.117930117994547, + 0.28122467175126076, + 0.2588425949215889, + 0.11017871834337711, + 0.3179886043071747, + 1.1866249963641167, + 0.4208972845226526, + 0.44892273284494877, + 0.8178128190338612, + 0.2741979658603668, + 0.07671777717769146, + 0.44891149550676346, + 0.2684594802558422, + 0.2729129921644926, + 0.3610154688358307, + 0.3703858610242605, + 1.2235241327434778, + 0.3812773562967777, + 1.0996477901935577, + 0.06861168332397938, + 0.22919367253780365, + 0.47168223559856415, + 0.173878725618124, + 0.13960881158709526, + 0.72182247787714, + 0.5795724727213383, + 0.0, + 0.14987653121352196, + 0.5758584011346102, + 0.02965540811419487, + 0.02333172596991062, + 0.4592670314013958, + 2.023859958164394, + 0.13186808675527573, + 0.06490456312894821, + 0.1977884853258729, + 0.5617780461907387, + 0.0, + 0.1988048478960991, + 1.3809086792171001, + 0.4482107125222683, + 1.0168119557201862, + 0.10440288484096527, + 0.8821727968752384, + 0.6388221550732851, + 0.200185751542449, + 0.2741183489561081, + 0.3191973101347685, + 0.8885832168161869, + 0.3116541616618633, + 0.4013599958270788, + 0.47302113473415375, + 0.04654179513454437, + 0.2753623016178608, + 0.23341387882828712, + 0.21713337674736977, + 0.6481824144721031, + 0.7826475985348225, + 0.5838748216629028, + 0.9645974468439817, + 1.1604085639119148 + ], + "unique_experts": 62, + "load_cv": 0.7014777301647999, + "normalized_load_entropy": 0.9416094812220637, + "max_load_share": 0.05128205128205128 + } + }, + "s0_period": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "036d282d83d49b0d1fa32fb7e8dbdfc9ac5eaafc75d3e35e069142fe76fb3462", + "route_weight_sha256": "8d2d8991ef5c22666d254d8e1f6811ebe888dcb0a1784eb34995b9faca9e6f38", + "loads": [ + 4, + 1, + 2, + 3, + 3, + 2, + 3, + 4, + 4, + 5, + 1, + 2, + 3, + 1, + 1, + 4, + 4, + 3, + 4, + 4, + 2, + 0, + 1, + 2, + 4, + 1, + 3, + 1, + 3, + 0, + 1, + 5, + 0, + 0, + 2, + 2, + 3, + 1, + 0, + 3, + 0, + 3, + 3, + 3, + 4, + 1, + 4, + 5, + 3, + 2, + 4, + 0, + 2, + 3, + 3, + 1, + 1, + 0, + 0, + 3, + 0, + 3, + 0, + 4 + ], + "weighted_loads": [ + 0.2696726992726326, + 0.042083561420440674, + 0.1447305902838707, + 0.32355288974940777, + 0.21792258694767952, + 0.11954933404922485, + 0.10915031470358372, + 0.21658368408679962, + 0.36259566992521286, + 0.30795822851359844, + 0.025616101920604706, + 0.7960314452648163, + 0.2449728101491928, + 0.026563938707113266, + 0.028989028185606003, + 0.24010908976197243, + 0.175135662779212, + 0.3671903982758522, + 0.365288820117712, + 0.46010996401309967, + 0.10673293843865395, + 0.0, + 0.026322219520807266, + 0.22611094266176224, + 0.21360738202929497, + 0.13690036535263062, + 0.14407621696591377, + 0.04762106016278267, + 0.26844020187854767, + 0.0, + 0.09572058171033859, + 0.5297639146447182, + 0.0, + 0.0, + 0.09489920735359192, + 0.09123266115784645, + 0.14543316885828972, + 0.023187773302197456, + 0.0, + 0.2099064514040947, + 0.0, + 0.19847319275140762, + 0.26708758622407913, + 0.2640812322497368, + 0.3467987887561321, + 0.1047300398349762, + 0.2742837853729725, + 0.2539683170616627, + 0.12808619253337383, + 0.23389849066734314, + 0.251993240788579, + 0.0, + 0.1489691026508808, + 0.213176678866148, + 0.44111911952495575, + 0.04618705064058304, + 0.024192769080400467, + 0.0, + 0.0, + 0.20778066664934158, + 0.0, + 0.19172286242246628, + 0.0, + 0.2864031456410885 + ], + "unique_experts": 53, + "load_cv": 0.6666666666666666, + "normalized_load_entropy": 0.9291749898699116, + "max_load_share": 0.034722222222222224 + }, + "full_input": { + "tokens": 49, + "top_k": 6, + "decisions": 294, + "ordered_route_sha256": "f0893dbfeabee0235ce69ad9bce03d4d23cec1af4b18ac89573b3d639e7c02c4", + "route_weight_sha256": "c35033b941487b9e0bdaf895160072631d74d5162b455fa256414fc8996ced4d", + "loads": [ + 5, + 11, + 2, + 5, + 4, + 2, + 3, + 5, + 9, + 5, + 4, + 2, + 3, + 2, + 5, + 5, + 4, + 3, + 4, + 8, + 4, + 9, + 1, + 2, + 7, + 1, + 3, + 3, + 6, + 0, + 1, + 5, + 0, + 1, + 7, + 16, + 4, + 1, + 4, + 3, + 0, + 3, + 9, + 3, + 4, + 1, + 7, + 10, + 5, + 2, + 4, + 6, + 2, + 3, + 3, + 1, + 1, + 7, + 8, + 8, + 13, + 5, + 6, + 14 + ], + "weighted_loads": [ + 0.5637058392167091, + 0.9882412888109684, + 0.1447305902838707, + 1.0854448433965445, + 0.24090784043073654, + 0.11954933404922485, + 0.10915031470358372, + 0.2633265182375908, + 0.6513686031103134, + 0.30795822851359844, + 0.15146390721201897, + 0.7960314452648163, + 0.2449728101491928, + 0.050436537712812424, + 0.20505598187446594, + 0.2851008251309395, + 0.175135662779212, + 0.3671903982758522, + 0.365288820117712, + 1.2441377192735672, + 0.349245835095644, + 0.8740144968032837, + 0.026322219520807266, + 0.22611094266176224, + 0.33756761625409126, + 0.13690036535263062, + 0.14407621696591377, + 0.32335447147488594, + 0.5239421781152487, + 0.0, + 0.09572058171033859, + 0.5297639146447182, + 0.0, + 0.04818451404571533, + 0.31992604210972786, + 2.150175708346069, + 0.16674865037202835, + 0.023187773302197456, + 0.17119071912020445, + 0.2099064514040947, + 0.0, + 0.19847319275140762, + 0.8546929396688938, + 0.2640812322497368, + 0.3467987887561321, + 0.1047300398349762, + 0.36702057532966137, + 0.5589486956596375, + 0.17973080463707447, + 0.23389849066734314, + 0.251993240788579, + 0.5175725854933262, + 0.1489691026508808, + 0.213176678866148, + 0.44111911952495575, + 0.04618705064058304, + 0.024192769080400467, + 0.35979087464511395, + 0.36412183195352554, + 0.38993702083826065, + 0.9678344111889601, + 0.27801771834492683, + 0.613921632990241, + 0.7707987483590841 + ], + "unique_experts": 61, + "load_cv": 0.7328965165022633, + "normalized_load_entropy": 0.9372239672461817, + "max_load_share": 0.05442176870748299 + } + }, + "s1_period": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "7e3442e403bcb088cef000443e28781e9f7971eeeb9578298bcb536e082d40ec", + "route_weight_sha256": "8448beff9b3df65d976bb6b2f9b53db287e21c7ace4e84c1bdbbfbd4c8776aba", + "loads": [ + 3, + 1, + 2, + 3, + 3, + 2, + 3, + 4, + 4, + 5, + 1, + 2, + 3, + 1, + 1, + 4, + 4, + 3, + 3, + 4, + 2, + 0, + 1, + 2, + 4, + 1, + 3, + 1, + 3, + 0, + 1, + 6, + 0, + 1, + 3, + 2, + 2, + 1, + 0, + 3, + 0, + 3, + 4, + 3, + 4, + 1, + 4, + 4, + 3, + 2, + 5, + 0, + 2, + 3, + 3, + 1, + 1, + 0, + 0, + 2, + 0, + 3, + 0, + 4 + ], + "weighted_loads": [ + 0.23771202191710472, + 0.043611589819192886, + 0.1454090029001236, + 0.3500096797943115, + 0.22456327825784683, + 0.11914650350809097, + 0.10925985127687454, + 0.2086598500609398, + 0.3861212953925133, + 0.3062922041863203, + 0.0277336984872818, + 0.7845120429992676, + 0.24840646982192993, + 0.0271155908703804, + 0.023177413269877434, + 0.231742762029171, + 0.17469028197228909, + 0.36036743223667145, + 0.3393690101802349, + 0.47605690360069275, + 0.1069488525390625, + 0.0, + 0.030102714896202087, + 0.23027943074703217, + 0.20879052951931953, + 0.12575072050094604, + 0.1395566314458847, + 0.04378317669034004, + 0.2623164765536785, + 0.0, + 0.11688236147165298, + 0.5618829149752855, + 0.0, + 0.023411208763718605, + 0.13380905985832214, + 0.10385289415717125, + 0.11124131828546524, + 0.022773412987589836, + 0.0, + 0.21037670969963074, + 0.0, + 0.19792139530181885, + 0.33446482941508293, + 0.26644355058670044, + 0.36432917788624763, + 0.10518204420804977, + 0.27908678352832794, + 0.21583757176995277, + 0.1311365496367216, + 0.2319071963429451, + 0.29227455891668797, + 0.0, + 0.1366097368299961, + 0.21901140362024307, + 0.47342272102832794, + 0.046249449253082275, + 0.021532146260142326, + 0.0, + 0.0, + 0.16947579756379128, + 0.0, + 0.2162836715579033, + 0.0, + 0.25537313893437386 + ], + "unique_experts": 54, + "load_cv": 0.6666666666666666, + "normalized_load_entropy": 0.9316053897195758, + "max_load_share": 0.041666666666666664 + }, + "full_input": { + "tokens": 65, + "top_k": 6, + "decisions": 390, + "ordered_route_sha256": "a686dc85bd93146187c17dab697e90acba36fe0a9033faecce09868ba20ef405", + "route_weight_sha256": "430caaf0a135907a7890a3008abc30838e6d64d65d70c61d5e04b646466548f7", + "loads": [ + 8, + 12, + 3, + 6, + 5, + 3, + 3, + 7, + 15, + 6, + 8, + 2, + 3, + 3, + 9, + 6, + 7, + 3, + 3, + 10, + 4, + 11, + 2, + 2, + 10, + 2, + 3, + 4, + 8, + 0, + 2, + 8, + 1, + 2, + 12, + 18, + 3, + 2, + 7, + 6, + 0, + 3, + 13, + 4, + 7, + 1, + 12, + 12, + 6, + 3, + 6, + 8, + 3, + 6, + 3, + 1, + 5, + 5, + 2, + 13, + 13, + 8, + 11, + 16 + ], + "weighted_loads": [ + 1.0275983586907387, + 1.049163118004799, + 0.17077530175447464, + 1.1464458629488945, + 0.28002453595399857, + 0.2603606954216957, + 0.10925985127687454, + 0.3192966617643833, + 1.2299966625869274, + 0.42304997704923153, + 0.33400289714336395, + 0.7845120429992676, + 0.24840646982192993, + 0.07584263198077679, + 0.4488591328263283, + 0.2992311380803585, + 0.27090007066726685, + 0.36036743223667145, + 0.3393690101802349, + 1.2626087237149477, + 0.3400580808520317, + 0.9260934144258499, + 0.06846805289387703, + 0.23027943074703217, + 0.4732188582420349, + 0.1759590394794941, + 0.1395566314458847, + 0.7242176420986652, + 0.5411400534212589, + 0.0, + 0.1505933664739132, + 0.6048155799508095, + 0.025281647220253944, + 0.06309721805155277, + 0.5011676400899887, + 1.9194220965728164, + 0.13256931491196156, + 0.06493526883423328, + 0.2639633873477578, + 0.5634875260293484, + 0.0, + 0.19792139530181885, + 1.386419702321291, + 0.4478635787963867, + 1.015941385179758, + 0.10518204420804977, + 0.9066695086658001, + 0.6413546465337276, + 0.22443824633955956, + 0.274924635887146, + 0.31838945858180523, + 0.8477433733642101, + 0.31308117881417274, + 0.4026209954172373, + 0.47342272102832794, + 0.046249449253082275, + 0.27518403716385365, + 0.23101584613323212, + 0.11099189892411232, + 0.6740924827754498, + 0.7983159180730581, + 0.5795935764908791, + 0.967472730204463, + 1.0949074439704418 + ], + "unique_experts": 62, + "load_cv": 0.6930290638683246, + "normalized_load_entropy": 0.9418415641196817, + "max_load_share": 0.046153846153846156 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 24, + "ordered_topk_exact_tokens": 23, + "set_exact_tokens": 24, + "mean_set_jaccard": 1.0, + "mean_token_weighted_tv": 0.005558434408158064, + "aggregate_load_tv": 0.0 + }, + "system_bos": { + "tokens": 24, + "ordered_topk_exact_tokens": 19, + "set_exact_tokens": 21, + "mean_set_jaccard": 0.9642857142857144, + "mean_token_weighted_tv": 0.01427924664070209, + "aggregate_load_tv": 0.020833333333333336 + }, + "system_x": { + "tokens": 24, + "ordered_topk_exact_tokens": 19, + "set_exact_tokens": 21, + "mean_set_jaccard": 0.9642857142857144, + "mean_token_weighted_tv": 0.017113457977150876, + "aggregate_load_tv": 0.020833333333333336 + }, + "system_period": { + "tokens": 24, + "ordered_topk_exact_tokens": 17, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.9404761904761907, + "mean_token_weighted_tv": 0.01885169860906899, + "aggregate_load_tv": 0.034722222222222224 + }, + "bos_at_s0": { + "tokens": 24, + "ordered_topk_exact_tokens": 16, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.9404761904761904, + "mean_token_weighted_tv": 0.024313005851581693, + "aggregate_load_tv": 0.034722222222222224 + }, + "bos_at_s1": { + "tokens": 24, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.9047619047619048, + "mean_token_weighted_tv": 0.029372352873906493, + "aggregate_load_tv": 0.05555555555555555 + }, + "x_at_s0": { + "tokens": 24, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.9404761904761904, + "mean_token_weighted_tv": 0.023347785463556647, + "aggregate_load_tv": 0.034722222222222224 + }, + "x_at_s1": { + "tokens": 24, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.9047619047619048, + "mean_token_weighted_tv": 0.03176597133278847, + "aggregate_load_tv": 0.05555555555555556 + }, + "period_at_s0": { + "tokens": 24, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.9404761904761904, + "mean_token_weighted_tv": 0.023280829734479386, + "aggregate_load_tv": 0.034722222222222224 + }, + "period_at_s1": { + "tokens": 24, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.8928571428571429, + "mean_token_weighted_tv": 0.03365684789605439, + "aggregate_load_tv": 0.0625 + } + } + }, + "layer_03": { + "layer": 3, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "b3903621dc296e0895a28c4e70af24ee54b83f73f2f96c0191671a81c5ef8658", + "route_weight_sha256": "684d64ed7023984f29de1acb3bda26bd4d34c998b4465339a99821b920a8cb26", + "loads": [ + 0, + 4, + 2, + 2, + 4, + 0, + 2, + 0, + 0, + 4, + 0, + 0, + 2, + 3, + 6, + 1, + 5, + 0, + 1, + 4, + 2, + 2, + 4, + 5, + 1, + 5, + 1, + 0, + 2, + 1, + 4, + 1, + 4, + 1, + 1, + 4, + 1, + 3, + 2, + 4, + 2, + 5, + 0, + 4, + 2, + 3, + 0, + 0, + 1, + 3, + 9, + 4, + 3, + 2, + 0, + 4, + 1, + 4, + 2, + 0, + 2, + 3, + 0, + 2 + ], + "weighted_loads": [ + 0.0, + 0.2928709648549557, + 0.08130873739719391, + 0.1595059186220169, + 0.4172342009842396, + 0.0, + 0.11514777690172195, + 0.0, + 0.0, + 0.4814098998904228, + 0.0, + 0.0, + 0.40841569006443024, + 0.13521187752485275, + 0.8382489532232285, + 0.029370376840233803, + 0.3447236344218254, + 0.0, + 0.033394552767276764, + 0.2570787500590086, + 0.10194055363535881, + 0.221316359937191, + 0.27359624952077866, + 0.8378857262432575, + 0.11825979501008987, + 0.2632575295865536, + 0.061426956206560135, + 0.0, + 0.07361543364822865, + 0.04429435729980469, + 0.24404965713620186, + 0.04013179987668991, + 0.523650735616684, + 0.10772231221199036, + 0.06436391174793243, + 0.2192128449678421, + 0.02944192662835121, + 0.22573241591453552, + 0.43571603298187256, + 0.41620316728949547, + 0.17683444172143936, + 0.34579117596149445, + 0.0, + 0.18158119171857834, + 0.08071721717715263, + 0.378673292696476, + 0.0, + 0.0, + 0.05491509661078453, + 0.17439460381865501, + 0.6990009360015392, + 0.5755164176225662, + 0.1691761277616024, + 0.0842807237058878, + 0.0, + 0.31009072065353394, + 0.03391300514340401, + 0.45656528137624264, + 0.2309429943561554, + 0.0, + 0.09375585243105888, + 0.21022776514291763, + 0.0, + 0.23420260846614838 + ], + "unique_experts": 50, + "load_cv": 0.8277591347639633, + "normalized_load_entropy": 0.9044701542588626, + "max_load_share": 0.0625 + }, + "full_input": { + "tokens": 49, + "top_k": 6, + "decisions": 294, + "ordered_route_sha256": "1eac2a1bcfb80ae7a849b90eff6fcbd3999995918897c4e1f65e9bb82b5cee3b", + "route_weight_sha256": "646a9cc2c326cfa8ddc17f8a6900929515433b49929d3a2bfca1918390c5a46d", + "loads": [ + 9, + 4, + 2, + 12, + 6, + 3, + 2, + 8, + 0, + 10, + 2, + 1, + 4, + 8, + 12, + 1, + 5, + 0, + 1, + 4, + 4, + 5, + 9, + 7, + 1, + 7, + 1, + 6, + 2, + 4, + 5, + 1, + 4, + 1, + 10, + 4, + 1, + 3, + 2, + 4, + 2, + 6, + 9, + 4, + 2, + 3, + 16, + 0, + 9, + 13, + 10, + 4, + 4, + 2, + 4, + 4, + 1, + 5, + 2, + 0, + 9, + 3, + 4, + 3 + ], + "weighted_loads": [ + 1.2519665248692036, + 0.2928709648549557, + 0.08130873739719391, + 0.7484179250895977, + 0.4458972474676557, + 0.13444143533706665, + 0.11514777690172195, + 1.2854218520224094, + 0.0, + 0.7660996982012875, + 0.07274290919303894, + 0.0008772474247962236, + 0.42047356331022456, + 0.5043194256722927, + 1.2512944899499416, + 0.029370376840233803, + 0.3447236344218254, + 0.0, + 0.033394552767276764, + 0.2570787500590086, + 0.1746427621692419, + 0.543830431997776, + 0.6713161468505859, + 0.9137334804981947, + 0.11825979501008987, + 0.2769592572003603, + 0.061426956206560135, + 0.22476881742477417, + 0.07361543364822865, + 0.18346517533063889, + 0.29079264774918556, + 0.04013179987668991, + 0.523650735616684, + 0.10772231221199036, + 1.094989724457264, + 0.2192128449678421, + 0.02944192662835121, + 0.22573241591453552, + 0.43571603298187256, + 0.41620316728949547, + 0.17683444172143936, + 0.35725279804319143, + 0.5445744842290878, + 0.18158119171857834, + 0.08071721717715263, + 0.378673292696476, + 2.0835043750703335, + 0.0, + 0.9736642315983772, + 0.7905103452503681, + 0.7346189059317112, + 0.5755164176225662, + 0.18395345471799374, + 0.0842807237058878, + 1.8312795758247375, + 0.31009072065353394, + 0.03391300514340401, + 0.46940682362765074, + 0.2309429943561554, + 0.0, + 0.6037769950926304, + 0.21022776514291763, + 0.4428614601492882, + 0.27272479236125946 + ], + "unique_experts": 60, + "load_cv": 0.7770303754418451, + "normalized_load_entropy": 0.927556174482354, + "max_load_share": 0.05442176870748299 + } + }, + "s1_eos": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "602d9dd66242c3c392792419c8440e9a0fe4cb4e3d3ff7220bb9cdbd695bf50b", + "route_weight_sha256": "ba02cf1b5f04f8fa5a2abe1d893bd99a02c51d6c8ee55d4cc21c345cdad6f176", + "loads": [ + 0, + 4, + 2, + 2, + 4, + 0, + 2, + 0, + 0, + 5, + 0, + 0, + 2, + 3, + 6, + 0, + 5, + 0, + 0, + 4, + 2, + 2, + 4, + 5, + 1, + 5, + 1, + 0, + 2, + 1, + 4, + 2, + 4, + 1, + 1, + 4, + 1, + 3, + 2, + 4, + 2, + 5, + 0, + 4, + 2, + 3, + 0, + 0, + 1, + 3, + 9, + 4, + 3, + 2, + 0, + 4, + 1, + 3, + 2, + 0, + 3, + 3, + 0, + 2 + ], + "weighted_loads": [ + 0.0, + 0.2994780130684376, + 0.08352919295430183, + 0.15795926749706268, + 0.4162851385772228, + 0.0, + 0.11415887251496315, + 0.0, + 0.0, + 0.5011979378759861, + 0.0, + 0.0, + 0.4048187732696533, + 0.138644777238369, + 0.8302461057901382, + 0.0, + 0.34771578758955, + 0.0, + 0.0, + 0.24922223202884197, + 0.10259986110031605, + 0.22935990989208221, + 0.27426180243492126, + 0.8251140154898167, + 0.12103404104709625, + 0.255868598818779, + 0.06120772287249565, + 0.0, + 0.07397768460214138, + 0.042337849736213684, + 0.24189650639891624, + 0.06373658962547779, + 0.5347903072834015, + 0.10590893030166626, + 0.06386110186576843, + 0.21433113887906075, + 0.02973792515695095, + 0.22877737879753113, + 0.45482246577739716, + 0.4191700592637062, + 0.17617256194353104, + 0.3501812219619751, + 0.0, + 0.18342535756528378, + 0.08251991122961044, + 0.3883736580610275, + 0.0, + 0.0, + 0.05394677072763443, + 0.177503302693367, + 0.6931631900370121, + 0.5843187272548676, + 0.16653861477971077, + 0.08541492000222206, + 0.0, + 0.31504902243614197, + 0.033701132982969284, + 0.44224945083260536, + 0.2385774478316307, + 0.0, + 0.12194061651825905, + 0.21331196278333664, + 0.0, + 0.23349042236804962 + ], + "unique_experts": 48, + "load_cv": 0.8425417160057278, + "normalized_load_entropy": 0.8985449048621452, + "max_load_share": 0.0625 + }, + "full_input": { + "tokens": 65, + "top_k": 6, + "decisions": 390, + "ordered_route_sha256": "fc1abe9447299c23054b64e22bb87fa999511fc3da1df8220947f7f17d6ba8ee", + "route_weight_sha256": "29af0ec98eb77ad21b8c89592674e7f779521a076e2e5a8b92d0a40a1c99a151", + "loads": [ + 13, + 6, + 2, + 13, + 5, + 6, + 2, + 11, + 0, + 14, + 3, + 1, + 6, + 9, + 14, + 1, + 7, + 0, + 1, + 4, + 4, + 8, + 14, + 6, + 3, + 8, + 1, + 3, + 2, + 4, + 5, + 2, + 4, + 3, + 9, + 4, + 1, + 8, + 2, + 5, + 3, + 6, + 13, + 6, + 2, + 6, + 20, + 0, + 11, + 13, + 10, + 10, + 7, + 7, + 5, + 8, + 1, + 4, + 9, + 1, + 16, + 4, + 6, + 8 + ], + "weighted_loads": [ + 1.6280038133263588, + 0.373705280944705, + 0.08352919295430183, + 0.8169724754989147, + 0.4168197324615903, + 0.2613798025995493, + 0.11415887251496315, + 1.355677144601941, + 0.0, + 0.9602184475515969, + 0.08497787453234196, + 0.0008772474247962236, + 0.49450477940263227, + 0.5654655061662197, + 1.421977736055851, + 0.04922480881214142, + 0.5623600035905838, + 0.0, + 0.05548958107829094, + 0.24922223202884197, + 0.16892375983297825, + 0.6417034715414047, + 1.1851238571107388, + 0.873043529689312, + 0.22449424490332603, + 0.31298860255628824, + 0.06120772287249565, + 0.09643403254449368, + 0.07397768460214138, + 0.17133698239922523, + 0.2834264896810055, + 0.06373658962547779, + 0.5347903072834015, + 0.17853156849741936, + 0.9809502325952053, + 0.21433113887906075, + 0.02973792515695095, + 0.6453950870782137, + 0.45482246577739716, + 0.46961572393774986, + 0.2509335055947304, + 0.3590028127655387, + 0.6494064480066299, + 0.2569655980914831, + 0.08251991122961044, + 0.6306038945913315, + 2.644530676305294, + 0.0, + 1.2756927125155926, + 0.6439272277057171, + 0.7276235558092594, + 1.364573746919632, + 0.3775707380846143, + 0.8015103377401829, + 1.9424452893435955, + 0.5472664386034012, + 0.033701132982969284, + 0.45130452513694763, + 0.7247393168509007, + 0.030523166060447693, + 0.9220227170735598, + 0.2633951008319855, + 0.46856024488806725, + 0.6452185809612274 + ], + "unique_experts": 61, + "load_cv": 0.7314302004067518, + "normalized_load_entropy": 0.9336362406161303, + "max_load_share": 0.05128205128205128 + } + }, + "s0_bos": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "13dd4f3e5ca3b1366ae8745e9424c32421b212f47a4b94cabfe6c1392ffcd643", + "route_weight_sha256": "287b9f00301d983e9a368d9afc12dfc87262c655d4331b4fd3fe22b08a95d6af", + "loads": [ + 0, + 4, + 2, + 2, + 4, + 0, + 2, + 0, + 0, + 5, + 0, + 0, + 2, + 2, + 6, + 1, + 5, + 0, + 0, + 3, + 2, + 2, + 4, + 5, + 1, + 6, + 1, + 0, + 1, + 1, + 3, + 2, + 4, + 1, + 1, + 4, + 1, + 3, + 2, + 4, + 2, + 5, + 0, + 5, + 2, + 3, + 0, + 0, + 1, + 3, + 10, + 5, + 3, + 2, + 0, + 4, + 1, + 3, + 2, + 0, + 2, + 3, + 0, + 2 + ], + "weighted_loads": [ + 0.0, + 0.28823230043053627, + 0.08437050879001617, + 0.1404811441898346, + 0.45323194190859795, + 0.0, + 0.0991889126598835, + 0.0, + 0.0, + 0.44858936965465546, + 0.0, + 0.0, + 0.37278078496456146, + 0.09222118183970451, + 0.8212183341383934, + 0.033105745911598206, + 0.3488107956945896, + 0.0, + 0.0, + 0.2137255109846592, + 0.10610557906329632, + 0.22473101317882538, + 0.2761956751346588, + 0.9264406114816666, + 0.10058983415365219, + 0.28599192574620247, + 0.06533566117286682, + 0.0, + 0.046173661947250366, + 0.04696444049477577, + 0.15142583474516869, + 0.06494463980197906, + 0.5105459243059158, + 0.10780653357505798, + 0.05773698538541794, + 0.23392142727971077, + 0.029438002035021782, + 0.2313913069665432, + 0.3959936499595642, + 0.40088579058647156, + 0.16442085057497025, + 0.3360658586025238, + 0.0, + 0.2190900295972824, + 0.08553760498762131, + 0.36695461720228195, + 0.0, + 0.0, + 0.045414093881845474, + 0.1599870603531599, + 0.7126698717474937, + 0.5667119771242142, + 0.1914408542215824, + 0.08567014895379543, + 0.0, + 0.3190145157277584, + 0.03352164849638939, + 0.41094788163900375, + 0.2395237609744072, + 0.0, + 0.11295161023736, + 0.2105337455868721, + 0.0, + 0.2141297161579132 + ], + "unique_experts": 49, + "load_cv": 0.8819171036881969, + "normalized_load_entropy": 0.8964507249840705, + "max_load_share": 0.06944444444444445 + }, + "full_input": { + "tokens": 49, + "top_k": 6, + "decisions": 294, + "ordered_route_sha256": "a059401ea34b505e912a8929efd0ab80ce05eca51bf7f17b3927841cef5a1edb", + "route_weight_sha256": "2025146991aef7f5fb0573773f2b72852b65a4c5ad488ccb9f1b6f53fbf05e32", + "loads": [ + 10, + 4, + 2, + 12, + 6, + 3, + 2, + 9, + 0, + 10, + 2, + 1, + 3, + 6, + 12, + 1, + 5, + 0, + 1, + 3, + 4, + 5, + 9, + 7, + 1, + 7, + 1, + 6, + 1, + 5, + 4, + 2, + 4, + 1, + 9, + 4, + 1, + 3, + 2, + 4, + 2, + 5, + 10, + 6, + 2, + 4, + 16, + 0, + 11, + 13, + 10, + 5, + 3, + 2, + 3, + 4, + 1, + 3, + 2, + 0, + 10, + 3, + 4, + 3 + ], + "weighted_loads": [ + 1.4128982871770859, + 0.28823230043053627, + 0.08437050879001617, + 0.7293931506574154, + 0.48189498839201406, + 0.1387900374829769, + 0.0991889126598835, + 1.1604927070438862, + 0.0, + 0.7069242217694409, + 0.07274290919303894, + 0.0008772474247962236, + 0.37325919867726043, + 0.44324279204010963, + 1.244114976376295, + 0.033105745911598206, + 0.3488107956945896, + 0.0, + 0.03576125577092171, + 0.2137255109846592, + 0.1776660569012165, + 0.561572439968586, + 0.6788828000426292, + 0.99430220015347, + 0.10058983415365219, + 0.28651957493275404, + 0.06533566117286682, + 0.22476881742477417, + 0.046173661947250366, + 0.2371068336069584, + 0.1981688253581524, + 0.06494463980197906, + 0.5105459243059158, + 0.10780653357505798, + 1.0513968095183372, + 0.23392142727971077, + 0.029438002035021782, + 0.2313913069665432, + 0.3959936499595642, + 0.40088579058647156, + 0.16442085057497025, + 0.3360658586025238, + 0.6646759063005447, + 0.2509748078882694, + 0.08553760498762131, + 0.40747858956456184, + 2.2493466660380363, + 0.0, + 1.0527406558394432, + 0.776102801784873, + 0.7126698717474937, + 0.5667119771242142, + 0.1914408542215824, + 0.08567014895379543, + 1.1308312341570854, + 0.3190145157277584, + 0.03352164849638939, + 0.41094788163900375, + 0.2395237609744072, + 0.0, + 0.6500634327530861, + 0.2105337455868721, + 0.4428495466709137, + 0.2526519000530243 + ], + "unique_experts": 60, + "load_cv": 0.7995729805779482, + "normalized_load_entropy": 0.9243970899221423, + "max_load_share": 0.05442176870748299 + } + }, + "s1_bos": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "a361b2419df80e08820713ce582c213a0a8e71339158f44a836253943495a822", + "route_weight_sha256": "f4a04e2b54955ee16f8256386750aa46a9726d116205a08327aa8d42260ffc9a", + "loads": [ + 0, + 4, + 2, + 2, + 5, + 0, + 2, + 0, + 0, + 5, + 0, + 0, + 2, + 2, + 6, + 0, + 5, + 0, + 0, + 3, + 2, + 2, + 4, + 5, + 1, + 5, + 1, + 0, + 2, + 1, + 3, + 2, + 4, + 1, + 1, + 4, + 1, + 3, + 2, + 4, + 2, + 4, + 0, + 5, + 2, + 3, + 0, + 0, + 1, + 3, + 10, + 5, + 3, + 2, + 0, + 4, + 1, + 3, + 2, + 0, + 3, + 3, + 0, + 2 + ], + "weighted_loads": [ + 0.0, + 0.29565727338194847, + 0.09336632862687111, + 0.13957204669713974, + 0.47560442239046097, + 0.0, + 0.09863363578915596, + 0.0, + 0.0, + 0.44229908287525177, + 0.0, + 0.0, + 0.37000872194767, + 0.09836502000689507, + 0.8046177700161934, + 0.0, + 0.3527604416012764, + 0.0, + 0.0, + 0.20653189346194267, + 0.10606000386178493, + 0.2272888869047165, + 0.2638632208108902, + 0.9205715022981167, + 0.1077098697423935, + 0.2695109210908413, + 0.06402141600847244, + 0.0, + 0.07704529166221619, + 0.042580269277095795, + 0.14666028320789337, + 0.06686888821423054, + 0.5352200269699097, + 0.11029750853776932, + 0.05809047818183899, + 0.23153581470251083, + 0.0298688393086195, + 0.2356054075062275, + 0.4045555591583252, + 0.4012417383491993, + 0.16189557313919067, + 0.3151584193110466, + 0.0, + 0.2232261821627617, + 0.08697238937020302, + 0.37018855661153793, + 0.0, + 0.0, + 0.04302307963371277, + 0.16800902970135212, + 0.6867600120604038, + 0.5947335865348577, + 0.19042130187153816, + 0.08842344023287296, + 0.0, + 0.3143349699676037, + 0.03486577421426773, + 0.4120827615261078, + 0.24481767416000366, + 0.0, + 0.1567150168120861, + 0.21888840198516846, + 0.0, + 0.21319770067930222 + ], + "unique_experts": 48, + "load_cv": 0.8748897637790901, + "normalized_load_entropy": 0.895461427562458, + "max_load_share": 0.06944444444444445 + }, + "full_input": { + "tokens": 65, + "top_k": 6, + "decisions": 390, + "ordered_route_sha256": "3b003bfd794593288bf75a20681489d589630e5098332a0c45b23757f6c1809e", + "route_weight_sha256": "10c46e11ff8f197374af5e695e58ccc33f2c258dfec1771a1fbcbe82ab5a3666", + "loads": [ + 14, + 6, + 2, + 13, + 6, + 5, + 2, + 11, + 0, + 14, + 3, + 1, + 5, + 8, + 14, + 1, + 7, + 0, + 2, + 3, + 4, + 8, + 15, + 6, + 3, + 7, + 1, + 3, + 2, + 4, + 4, + 2, + 4, + 3, + 9, + 4, + 1, + 8, + 2, + 5, + 3, + 4, + 14, + 8, + 2, + 7, + 21, + 0, + 12, + 13, + 10, + 11, + 6, + 7, + 4, + 8, + 1, + 3, + 9, + 1, + 16, + 4, + 6, + 8 + ], + "weighted_loads": [ + 1.7299712970852852, + 0.3698845412582159, + 0.09336632862687111, + 0.7985852546989918, + 0.47613901627482846, + 0.22092358209192753, + 0.09863363578915596, + 1.261669972911477, + 0.0, + 0.9085517221246846, + 0.08497787453234196, + 0.0008772474247962236, + 0.45179205090971664, + 0.553610548377037, + 1.409757599234581, + 0.04922480881214142, + 0.5674046576023102, + 0.0, + 0.09165556356310844, + 0.20653189346194267, + 0.17642631568014622, + 0.6392922699451447, + 1.1902847532182932, + 0.9601899646222591, + 0.21117007359862328, + 0.317802625708282, + 0.06402141600847244, + 0.09643403254449368, + 0.07704529166221619, + 0.1789052002131939, + 0.1881902664899826, + 0.06686888821423054, + 0.5352200269699097, + 0.18292014673352242, + 0.9832593388855457, + 0.23153581470251083, + 0.0298688393086195, + 0.6522231157869101, + 0.4045555591583252, + 0.45168740302324295, + 0.23665651679039001, + 0.3151584193110466, + 0.7958694994449615, + 0.3310396410524845, + 0.08697238937020302, + 0.6665078513324261, + 2.6186059415340424, + 0.0, + 1.2719169668853283, + 0.6344329547137022, + 0.6867600120604038, + 1.3749886061996222, + 0.39105424284935, + 0.8045188579708338, + 1.1533341519534588, + 0.5465523861348629, + 0.03486577421426773, + 0.4120827615261078, + 0.7309795431792736, + 0.030523166060447693, + 0.9385183919221163, + 0.2689715400338173, + 0.5012028031051159, + 0.62492585927248 + ], + "unique_experts": 61, + "load_cv": 0.7607567428736631, + "normalized_load_entropy": 0.930307934133231, + "max_load_share": 0.05384615384615385 + } + }, + "s0_x": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "2c4fd62c67a7e315f1dcefd6f8415f1960984f971ddc7ac480a48bfa5a8d2a38", + "route_weight_sha256": "93899569954ecfb6310bc8b41430b3e92e4446df5da21b442639703cb2c9c417", + "loads": [ + 0, + 4, + 2, + 2, + 4, + 0, + 2, + 0, + 0, + 5, + 0, + 0, + 2, + 3, + 6, + 1, + 5, + 0, + 0, + 4, + 2, + 2, + 4, + 5, + 1, + 5, + 1, + 0, + 1, + 1, + 3, + 2, + 4, + 1, + 1, + 4, + 1, + 4, + 2, + 4, + 2, + 6, + 0, + 3, + 2, + 3, + 0, + 0, + 1, + 3, + 9, + 4, + 3, + 2, + 0, + 4, + 0, + 3, + 3, + 0, + 3, + 3, + 0, + 2 + ], + "weighted_loads": [ + 0.0, + 0.29017336666584015, + 0.08445726707577705, + 0.1476590782403946, + 0.4302954748272896, + 0.0, + 0.10326733812689781, + 0.0, + 0.0, + 0.4215206131339073, + 0.0, + 0.0, + 0.380760058760643, + 0.12319057248532772, + 0.8397197276353836, + 0.03491869568824768, + 0.3578799143433571, + 0.0, + 0.0, + 0.24443134851753712, + 0.10642677918076515, + 0.2031000554561615, + 0.2582078203558922, + 0.9020234569907188, + 0.10190020501613617, + 0.2683376334607601, + 0.05969138815999031, + 0.0, + 0.04841279983520508, + 0.04518614709377289, + 0.15599338710308075, + 0.06636146642267704, + 0.5115937292575836, + 0.10836561024188995, + 0.05750008672475815, + 0.2272358573973179, + 0.026053421199321747, + 0.26912417635321617, + 0.4041341245174408, + 0.40604112297296524, + 0.16162507981061935, + 0.3658923301845789, + 0.0, + 0.1650647632777691, + 0.08636076748371124, + 0.36717870831489563, + 0.0, + 0.0, + 0.04376464709639549, + 0.16888733208179474, + 0.6660513952374458, + 0.5538548938930035, + 0.1901077851653099, + 0.08473625779151917, + 0.0, + 0.3228127025067806, + 0.0, + 0.4020636323839426, + 0.280891478061676, + 0.0, + 0.13810772448778152, + 0.21309547498822212, + 0.0, + 0.21928535401821136 + ], + "unique_experts": 48, + "load_cv": 0.8534606386520676, + "normalized_load_entropy": 0.896913065123468, + "max_load_share": 0.0625 + }, + "full_input": { + "tokens": 49, + "top_k": 6, + "decisions": 294, + "ordered_route_sha256": "f93fb5e033e593a4d9024dda9622c9af88066bc7f06fd1038969d5b1c74237c8", + "route_weight_sha256": "0d9a32b6b46fe266e8e111eea739af5d01a3ef20a6b6a28f7a2f6e064f5fa011", + "loads": [ + 7, + 4, + 2, + 14, + 7, + 2, + 2, + 9, + 0, + 10, + 2, + 1, + 3, + 7, + 12, + 1, + 5, + 0, + 1, + 4, + 3, + 5, + 9, + 7, + 1, + 6, + 2, + 7, + 1, + 5, + 4, + 2, + 4, + 1, + 10, + 4, + 2, + 4, + 2, + 4, + 2, + 6, + 10, + 3, + 2, + 4, + 16, + 0, + 9, + 14, + 9, + 4, + 3, + 2, + 3, + 4, + 0, + 3, + 3, + 0, + 11, + 3, + 4, + 3 + ], + "weighted_loads": [ + 1.0535055734217167, + 0.29017336666584015, + 0.08445726707577705, + 0.9021430872380733, + 0.4900829697144218, + 0.09142904356122017, + 0.10326733812689781, + 1.1577900052070618, + 0.0, + 0.7043041356955655, + 0.07274290919303894, + 0.0008772474247962236, + 0.38123847247334197, + 0.47141248546540737, + 1.2290531620383263, + 0.03491869568824768, + 0.3578799143433571, + 0.0, + 0.040483590215444565, + 0.24443134851753712, + 0.13291741348803043, + 0.5245466083288193, + 0.6526824049651623, + 0.971482390537858, + 0.10190020501613617, + 0.2688652826473117, + 0.10209707170724869, + 0.2723037600517273, + 0.04841279983520508, + 0.24362576007843018, + 0.20273637771606445, + 0.06636146642267704, + 0.5115937292575836, + 0.10836561024188995, + 1.1536330431699753, + 0.2272358573973179, + 0.07435757666826248, + 0.26912417635321617, + 0.4041341245174408, + 0.40604112297296524, + 0.16162507981061935, + 0.3658923301845789, + 0.6234909519553185, + 0.1650647632777691, + 0.08636076748371124, + 0.4226229190826416, + 2.277279645204544, + 0.0, + 0.8798616863787174, + 0.848878763616085, + 0.6660513952374458, + 0.5538548938930035, + 0.1901077851653099, + 0.08473625779151917, + 1.1089152358472347, + 0.3228127025067806, + 0.0, + 0.4020636323839426, + 0.280891478061676, + 0.0, + 0.7082831636071205, + 0.21309547498822212, + 0.44220638275146484, + 0.25780753791332245 + ], + "unique_experts": 59, + "load_cv": 0.8096952885321634, + "normalized_load_entropy": 0.9231005723518243, + "max_load_share": 0.05442176870748299 + } + }, + "s1_x": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "636985891a9e28e82e22b62176658298858813f76b530db6021d2282fc20f9e6", + "route_weight_sha256": "6e5aea95b26221799d8c11d1db840b0ea6779779035e042c28a5c236666360ca", + "loads": [ + 0, + 4, + 2, + 2, + 5, + 0, + 2, + 0, + 0, + 5, + 0, + 0, + 2, + 2, + 6, + 0, + 5, + 0, + 0, + 3, + 2, + 2, + 4, + 6, + 1, + 5, + 1, + 0, + 1, + 1, + 3, + 2, + 4, + 1, + 1, + 4, + 1, + 3, + 2, + 4, + 2, + 6, + 0, + 2, + 2, + 3, + 0, + 0, + 1, + 3, + 9, + 5, + 3, + 2, + 0, + 4, + 1, + 4, + 3, + 0, + 3, + 3, + 0, + 2 + ], + "weighted_loads": [ + 0.0, + 0.2981477826833725, + 0.09273219481110573, + 0.14627178758382797, + 0.45213840529322624, + 0.0, + 0.09880802407860756, + 0.0, + 0.0, + 0.41203173249959946, + 0.0, + 0.0, + 0.3629715144634247, + 0.10011056438088417, + 0.803893655538559, + 0.0, + 0.36628484912216663, + 0.0, + 0.0, + 0.20492370426654816, + 0.10593545809388161, + 0.2048143744468689, + 0.2610851265490055, + 0.9426887296140194, + 0.11139456927776337, + 0.27108700945973396, + 0.0642102062702179, + 0.0, + 0.05001820996403694, + 0.04077911376953125, + 0.1357208490371704, + 0.0677449181675911, + 0.5412911996245384, + 0.11419077962636948, + 0.05848916620016098, + 0.22856146842241287, + 0.027665497735142708, + 0.24248502403497696, + 0.40695586800575256, + 0.3971664011478424, + 0.157059445977211, + 0.38336551934480667, + 0.0, + 0.13597879000008106, + 0.08318179845809937, + 0.3785398378968239, + 0.0, + 0.0, + 0.03783987835049629, + 0.17215431667864323, + 0.6347766444087029, + 0.6316508576273918, + 0.19059102982282639, + 0.08922565542161465, + 0.0, + 0.3150794543325901, + 0.034522779285907745, + 0.42452855221927166, + 0.28306082636117935, + 0.0, + 0.16007229313254356, + 0.21583060175180435, + 0.0, + 0.2169039249420166 + ], + "unique_experts": 48, + "load_cv": 0.8748897637790901, + "normalized_load_entropy": 0.8941763429283288, + "max_load_share": 0.0625 + }, + "full_input": { + "tokens": 65, + "top_k": 6, + "decisions": 390, + "ordered_route_sha256": "ea7e83a708cd37cc35b8fde712551444d3338f653d0d0c3316b0b40bca401410", + "route_weight_sha256": "dda7fa4b9de90b0ea441a89408f4acb93f50fc06ead40c053899d972b10e6e69", + "loads": [ + 12, + 6, + 2, + 14, + 7, + 5, + 2, + 11, + 0, + 14, + 3, + 1, + 5, + 8, + 14, + 1, + 7, + 0, + 1, + 3, + 3, + 8, + 14, + 7, + 3, + 7, + 2, + 4, + 1, + 5, + 4, + 2, + 4, + 3, + 9, + 4, + 2, + 8, + 2, + 5, + 3, + 6, + 14, + 5, + 2, + 7, + 20, + 0, + 11, + 14, + 9, + 11, + 6, + 7, + 4, + 8, + 1, + 4, + 10, + 1, + 16, + 4, + 6, + 8 + ], + "weighted_loads": [ + 1.4360768161714077, + 0.37237505055963993, + 0.09273219481110573, + 0.9524421878159046, + 0.4831827448797412, + 0.19150825776159763, + 0.09880802407860756, + 1.253866845741868, + 0.0, + 0.8966361091588624, + 0.08497787453234196, + 0.0008772474247962236, + 0.44475484342547134, + 0.5479542873799801, + 1.383630596101284, + 0.04922480881214142, + 0.5809290651232004, + 0.0, + 0.05548958107829094, + 0.20492370426654816, + 0.13786742463707924, + 0.6108301430940628, + 1.1616226099431515, + 0.9820503555238247, + 0.21485477313399315, + 0.31937871407717466, + 0.10281793773174286, + 0.14158677123486996, + 0.05001820996403694, + 0.22139254957437515, + 0.17725083231925964, + 0.0677449181675911, + 0.5412911996245384, + 0.18681341782212257, + 1.0285413935780525, + 0.22856146842241287, + 0.06795369647443295, + 0.6591027323156595, + 0.40695586800575256, + 0.44761206582188606, + 0.23182038962841034, + 0.38336551934480667, + 0.7101971209049225, + 0.24275620095431805, + 0.08318179845809937, + 0.6951838880777359, + 2.595054905861616, + 0.0, + 1.1182664781808853, + 0.6977543625980616, + 0.6347766444087029, + 1.4119058772921562, + 0.3912239708006382, + 0.8053210731595755, + 1.1327141486108303, + 0.5472968704998493, + 0.034522779285907745, + 0.42452855221927166, + 0.7692226953804493, + 0.030523166060447693, + 0.9874045681208372, + 0.2659137398004532, + 0.4838139973580837, + 0.6286320835351944 + ], + "unique_experts": 61, + "load_cv": 0.7417129276621407, + "normalized_load_entropy": 0.9327428155916027, + "max_load_share": 0.05128205128205128 + } + }, + "s0_period": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "075c1e580d95c5285b1a425cc592c42a15e67146ec012273d0636608cbfcb380", + "route_weight_sha256": "397ac8a553eaf3eb9d4b3daf296a79087f8a81fc4b60efd373cfb0a86364a7d6", + "loads": [ + 0, + 4, + 2, + 2, + 4, + 0, + 2, + 0, + 0, + 5, + 0, + 0, + 2, + 3, + 6, + 1, + 5, + 0, + 0, + 4, + 2, + 2, + 4, + 5, + 1, + 5, + 1, + 0, + 1, + 1, + 3, + 2, + 4, + 1, + 1, + 4, + 1, + 4, + 2, + 4, + 2, + 6, + 0, + 3, + 2, + 3, + 0, + 0, + 1, + 3, + 9, + 4, + 3, + 2, + 0, + 4, + 0, + 3, + 2, + 0, + 4, + 3, + 0, + 2 + ], + "weighted_loads": [ + 0.0, + 0.2884290739893913, + 0.0855015218257904, + 0.14354969561100006, + 0.43062882125377655, + 0.0, + 0.10270551964640617, + 0.0, + 0.0, + 0.4176478646695614, + 0.0, + 0.0, + 0.378545880317688, + 0.1214513648301363, + 0.8373300284147263, + 0.03671211004257202, + 0.3552992381155491, + 0.0, + 0.0, + 0.24389119073748589, + 0.10532372444868088, + 0.20754876732826233, + 0.254304438829422, + 0.8961495980620384, + 0.10525505244731903, + 0.2685990668833256, + 0.05908667668700218, + 0.0, + 0.04837069287896156, + 0.045335281640291214, + 0.1551017127931118, + 0.06728155165910721, + 0.5160191878676414, + 0.10958841443061829, + 0.059260107576847076, + 0.22561410814523697, + 0.025807468220591545, + 0.2641504146158695, + 0.40042631328105927, + 0.40968887135386467, + 0.16322830319404602, + 0.3676870036870241, + 0.0, + 0.16733158938586712, + 0.08438478410243988, + 0.374134361743927, + 0.0, + 0.0, + 0.04186347872018814, + 0.1690373532474041, + 0.6727108731865883, + 0.5559084787964821, + 0.19143583998084068, + 0.08606679737567902, + 0.0, + 0.33053679019212723, + 0.0, + 0.40376293659210205, + 0.24833188205957413, + 0.0, + 0.15852939523756504, + 0.21694690361618996, + 0.0, + 0.21798040717840195 + ], + "unique_experts": 48, + "load_cv": 0.8570693678078618, + "normalized_load_entropy": 0.8963456750821798, + "max_load_share": 0.0625 + }, + "full_input": { + "tokens": 49, + "top_k": 6, + "decisions": 294, + "ordered_route_sha256": "57e50bff03adba547edac9c070ad90dd76f3261ee2f2b6f453b431bb6c64d894", + "route_weight_sha256": "900c6dfb00264a07c518e880fdf7a866a738c8010df8227a2dea6bd7060a750e", + "loads": [ + 7, + 5, + 2, + 13, + 7, + 2, + 2, + 9, + 0, + 11, + 2, + 1, + 3, + 7, + 12, + 1, + 5, + 0, + 1, + 4, + 3, + 5, + 10, + 7, + 1, + 6, + 1, + 6, + 1, + 5, + 4, + 2, + 4, + 1, + 9, + 4, + 1, + 4, + 2, + 4, + 2, + 6, + 10, + 4, + 2, + 5, + 16, + 0, + 9, + 13, + 9, + 4, + 3, + 2, + 3, + 4, + 0, + 3, + 3, + 0, + 12, + 3, + 4, + 3 + ], + "weighted_loads": [ + 0.9797899164259434, + 0.43558336049318314, + 0.0855015218257904, + 0.8033089675009251, + 0.49942687508882955, + 0.09250250831246376, + 0.10270551964640617, + 1.2150954380631447, + 0.0, + 0.8565721989725716, + 0.07274290919303894, + 0.0008772474247962236, + 0.37902429403038695, + 0.4685490969568491, + 1.3532332591712475, + 0.03671211004257202, + 0.3552992381155491, + 0.0, + 0.03988407924771309, + 0.24389119073748589, + 0.13181435875594616, + 0.5284173414111137, + 0.706754881888628, + 0.966544458642602, + 0.10525505244731903, + 0.26912671606987715, + 0.05908667668700218, + 0.22476881742477417, + 0.04837069287896156, + 0.2345905862748623, + 0.2018447034060955, + 0.06728155165910721, + 0.5160191878676414, + 0.10958841443061829, + 1.0529199317097664, + 0.22561410814523697, + 0.025807468220591545, + 0.2641504146158695, + 0.40042631328105927, + 0.40968887135386467, + 0.16322830319404602, + 0.3676870036870241, + 0.626822717487812, + 0.19949024729430676, + 0.08438478410243988, + 0.48022061586380005, + 2.244163792580366, + 0.0, + 0.8619389906525612, + 0.7851530946791172, + 0.6727108731865883, + 0.5559084787964821, + 0.19143583998084068, + 0.08606679737567902, + 1.1042845472693443, + 0.33053679019212723, + 0.0, + 0.40376293659210205, + 0.2875485494732857, + 0.0, + 0.6828768793493509, + 0.21694690361618996, + 0.46430258452892303, + 0.25650259107351303 + ], + "unique_experts": 59, + "load_cv": 0.8078643025669179, + "normalized_load_entropy": 0.9221207265975899, + "max_load_share": 0.05442176870748299 + } + }, + "s1_period": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "5fc25c5118abcba4e76acae3f8e4c4f720c32e8f6a70cf430505f22f1325a2c8", + "route_weight_sha256": "d94baed86b4d3cb0208f2ac118381db8a79efb309864ba8430cbaa2aa23ecb90", + "loads": [ + 0, + 4, + 2, + 2, + 4, + 0, + 2, + 0, + 0, + 5, + 0, + 0, + 2, + 3, + 6, + 0, + 5, + 0, + 0, + 3, + 2, + 2, + 4, + 6, + 1, + 6, + 1, + 0, + 1, + 1, + 3, + 2, + 4, + 1, + 1, + 4, + 1, + 3, + 2, + 4, + 2, + 6, + 0, + 2, + 2, + 3, + 0, + 0, + 1, + 3, + 9, + 4, + 3, + 2, + 0, + 4, + 1, + 4, + 3, + 0, + 3, + 3, + 0, + 2 + ], + "weighted_loads": [ + 0.0, + 0.29964590817689896, + 0.09292307123541832, + 0.1394675076007843, + 0.43053922429680824, + 0.0, + 0.09931277483701706, + 0.0, + 0.0, + 0.40519949793815613, + 0.0, + 0.0, + 0.36448729038238525, + 0.12579269893467426, + 0.8019185438752174, + 0.0, + 0.3672254476696253, + 0.0, + 0.0, + 0.20294953882694244, + 0.10433519259095192, + 0.20931148529052734, + 0.253765806555748, + 0.9372712709009647, + 0.11336799710988998, + 0.2937488742172718, + 0.06416624039411545, + 0.0, + 0.05004251003265381, + 0.04021252319216728, + 0.13584380224347115, + 0.06733121909201145, + 0.5495930761098862, + 0.11300810426473618, + 0.058891914784908295, + 0.22568291425704956, + 0.027697399258613586, + 0.24193480610847473, + 0.40483127534389496, + 0.39937999844551086, + 0.15692084282636642, + 0.3800826072692871, + 0.0, + 0.13714079558849335, + 0.08168518543243408, + 0.3862348794937134, + 0.0, + 0.0, + 0.037144508212804794, + 0.17334019765257835, + 0.6399446874856949, + 0.608602199703455, + 0.19182275980710983, + 0.08902017027139664, + 0.0, + 0.32255061715841293, + 0.0344189889729023, + 0.42495076544582844, + 0.27907354570925236, + 0.0, + 0.15991730988025665, + 0.21926447749137878, + 0.0, + 0.21712777763605118 + ], + "unique_experts": 48, + "load_cv": 0.8713548411865624, + "normalized_load_entropy": 0.894829420378352, + "max_load_share": 0.0625 + }, + "full_input": { + "tokens": 65, + "top_k": 6, + "decisions": 390, + "ordered_route_sha256": "edfa0b9398a967c3639f58bf975afd732df2938d0a0b81b9204d5a918f14b21c", + "route_weight_sha256": "450790983739991ef7530abdf8a89e4e75aa27e22a7b38511e06dc065055afa0", + "loads": [ + 11, + 7, + 2, + 14, + 6, + 4, + 2, + 12, + 0, + 15, + 3, + 1, + 5, + 9, + 14, + 1, + 7, + 0, + 1, + 3, + 3, + 8, + 15, + 7, + 3, + 8, + 1, + 3, + 1, + 5, + 4, + 2, + 4, + 3, + 8, + 4, + 1, + 8, + 2, + 5, + 3, + 6, + 15, + 5, + 2, + 8, + 20, + 0, + 10, + 13, + 9, + 10, + 6, + 7, + 4, + 8, + 1, + 4, + 11, + 1, + 17, + 4, + 6, + 8 + ], + "weighted_loads": [ + 1.3342813737690449, + 0.48246253468096256, + 0.09292307123541832, + 0.8571022301912308, + 0.4676189234596677, + 0.1712463740259409, + 0.09931277483701706, + 1.3406856004148722, + 0.0, + 1.0150227577541955, + 0.08497787453234196, + 0.0008772474247962236, + 0.4462706193444319, + 0.5686375293880701, + 1.4607760086655617, + 0.04922480881214142, + 0.5818696636706591, + 0.0, + 0.05548958107829094, + 0.20294953882694244, + 0.13626715913414955, + 0.6047015190124512, + 1.2237869128584862, + 0.9771037213504314, + 0.21682820096611977, + 0.3420405788347125, + 0.06416624039411545, + 0.09643403254449368, + 0.05004251003265381, + 0.21350755169987679, + 0.17737378552556038, + 0.06733121909201145, + 0.5495930761098862, + 0.18563074246048927, + 0.9366081207990646, + 0.22568291425704956, + 0.027697399258613586, + 0.6585525143891573, + 0.40483127534389496, + 0.4498256631195545, + 0.23168178647756577, + 0.3800826072692871, + 0.8031301386654377, + 0.2447788193821907, + 0.08168518543243408, + 0.763190146535635, + 2.6001983359456062, + 0.0, + 1.0735598728060722, + 0.6397641226649284, + 0.6399446874856949, + 1.3888572193682194, + 0.39245570078492165, + 0.8051155880093575, + 1.124442234635353, + 0.5547680333256721, + 0.0344189889729023, + 0.42495076544582844, + 0.8139026034623384, + 0.030523166060447693, + 0.9665425550192595, + 0.2693476155400276, + 0.49645035341382027, + 0.628855936229229 + ], + "unique_experts": 61, + "load_cv": 0.7640681458433136, + "normalized_load_entropy": 0.9288117912039826, + "max_load_share": 0.05128205128205128 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 24, + "ordered_topk_exact_tokens": 19, + "set_exact_tokens": 21, + "mean_set_jaccard": 0.9642857142857143, + "mean_token_weighted_tv": 0.009203821149033805, + "aggregate_load_tv": 0.020833333333333336 + }, + "system_bos": { + "tokens": 24, + "ordered_topk_exact_tokens": 19, + "set_exact_tokens": 21, + "mean_set_jaccard": 0.9642857142857144, + "mean_token_weighted_tv": 0.013179119598741332, + "aggregate_load_tv": 0.020833333333333336 + }, + "system_x": { + "tokens": 24, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.9166666666666666, + "mean_token_weighted_tv": 0.020756549628761906, + "aggregate_load_tv": 0.034722222222222224 + }, + "system_period": { + "tokens": 24, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.9166666666666666, + "mean_token_weighted_tv": 0.02073155832476914, + "aggregate_load_tv": 0.03472222222222222 + }, + "bos_at_s0": { + "tokens": 24, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.9047619047619048, + "mean_token_weighted_tv": 0.032479204276266195, + "aggregate_load_tv": 0.04166666666666667 + }, + "bos_at_s1": { + "tokens": 24, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.9404761904761904, + "mean_token_weighted_tv": 0.030981061592077214, + "aggregate_load_tv": 0.027777777777777783 + }, + "x_at_s0": { + "tokens": 24, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.9047619047619048, + "mean_token_weighted_tv": 0.031461178325116634, + "aggregate_load_tv": 0.04166666666666666 + }, + "x_at_s1": { + "tokens": 24, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.9166666666666666, + "mean_token_weighted_tv": 0.03480204660445452, + "aggregate_load_tv": 0.04166666666666667 + }, + "period_at_s0": { + "tokens": 24, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.9047619047619048, + "mean_token_weighted_tv": 0.031248433437819283, + "aggregate_load_tv": 0.04166666666666667 + }, + "period_at_s1": { + "tokens": 24, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 18, + "mean_set_jaccard": 0.9285714285714285, + "mean_token_weighted_tv": 0.03348548279609531, + "aggregate_load_tv": 0.03472222222222222 + } + } + }, + "layer_04": { + "layer": 4, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "2ee1993958cbcea476f8e33cf507b5b97d520c8ca7e31f52df64a2a3fb6ef372", + "route_weight_sha256": "f573f90aaeae9577485558976efaff146c09aebc7eb99db38de116c5a6a58fe5", + "loads": [ + 0, + 5, + 0, + 1, + 1, + 0, + 1, + 1, + 3, + 6, + 0, + 2, + 6, + 0, + 0, + 9, + 4, + 1, + 0, + 0, + 4, + 2, + 3, + 4, + 1, + 0, + 1, + 2, + 3, + 9, + 2, + 4, + 2, + 3, + 2, + 0, + 5, + 7, + 1, + 4, + 0, + 2, + 1, + 4, + 3, + 1, + 0, + 2, + 0, + 4, + 3, + 3, + 5, + 1, + 3, + 1, + 3, + 3, + 0, + 0, + 0, + 4, + 1, + 1 + ], + "weighted_loads": [ + 0.0, + 0.21745514497160912, + 0.0, + 0.04839673638343811, + 0.08433392643928528, + 0.0, + 0.07978184521198273, + 0.03917147219181061, + 0.2546849325299263, + 0.408576387912035, + 0.0, + 0.17411818727850914, + 0.6736272238194942, + 0.0, + 0.0, + 0.9139407761394978, + 0.3582328222692013, + 0.08053188025951385, + 0.0, + 0.0, + 0.44895999133586884, + 0.09545353800058365, + 0.18516477942466736, + 0.3136865273118019, + 0.06686288863420486, + 0.0, + 0.0928160771727562, + 0.20013394951820374, + 0.27795905992388725, + 0.9086995236575603, + 0.10191095992922783, + 0.29064399003982544, + 0.10857518389821053, + 0.17184985429048538, + 0.10994360223412514, + 0.0, + 0.2919483296573162, + 0.4293622672557831, + 0.03600286319851875, + 0.4067081958055496, + 0.0, + 0.11374833062291145, + 0.05865024775266647, + 0.36199136450886726, + 0.30232714861631393, + 0.1949993371963501, + 0.0, + 0.1434514820575714, + 0.0, + 0.2896947357803583, + 0.18687409535050392, + 0.26190854236483574, + 0.5388661026954651, + 0.03796682879328728, + 0.2098286934196949, + 0.09108159691095352, + 0.25870657712221146, + 0.14425481483340263, + 0.0, + 0.0, + 0.0, + 0.3257164731621742, + 0.03633430600166321, + 0.03314483165740967 + ], + "unique_experts": 48, + "load_cv": 0.9590375834240038, + "normalized_load_entropy": 0.8823631010112607, + "max_load_share": 0.0625 + }, + "full_input": { + "tokens": 49, + "top_k": 6, + "decisions": 294, + "ordered_route_sha256": "f8dc25ad28d4f728ef187f99eed242bcba72dcf39f319864279b2f322a0d65e1", + "route_weight_sha256": "8c0490330bd4011dee8e8b7c1eba1c4334255282c547228e2ff4a6f3caec8e25", + "loads": [ + 0, + 8, + 2, + 5, + 1, + 0, + 2, + 1, + 3, + 6, + 10, + 4, + 6, + 15, + 2, + 12, + 4, + 1, + 4, + 0, + 4, + 4, + 3, + 4, + 1, + 6, + 7, + 3, + 4, + 28, + 2, + 6, + 2, + 5, + 13, + 0, + 5, + 9, + 2, + 4, + 3, + 5, + 9, + 4, + 3, + 3, + 11, + 2, + 1, + 6, + 4, + 3, + 5, + 1, + 3, + 1, + 3, + 3, + 0, + 13, + 4, + 4, + 4, + 1 + ], + "weighted_loads": [ + 0.0, + 0.37869924306869507, + 0.1224716566503048, + 0.3505566574749537, + 0.08433392643928528, + 0.0, + 0.13723115622997284, + 0.03917147219181061, + 0.2546849325299263, + 0.408576387912035, + 0.658172557130456, + 0.20062371157109737, + 0.6736272238194942, + 1.0069615934044123, + 0.04682381637394428, + 1.1081711687147617, + 0.3582328222692013, + 0.08053188025951385, + 0.23972489856532775, + 0.0, + 0.44895999133586884, + 1.1603187695145607, + 0.18516477942466736, + 0.3136865273118019, + 0.06686288863420486, + 0.44697603955864906, + 0.6284382194280624, + 0.2080939020961523, + 0.3196868300437927, + 2.515154851716943, + 0.10191095992922783, + 0.32159632071852684, + 0.10857518389821053, + 0.2121202079579234, + 1.4077871445042547, + 0.0, + 0.2919483296573162, + 0.5195102505385876, + 1.0327219255268574, + 0.4067081958055496, + 0.14008765667676926, + 0.2749914824962616, + 0.4167136549949646, + 0.36199136450886726, + 0.30232714861631393, + 0.3916121441870928, + 1.148902915418148, + 0.1434514820575714, + 0.0368838757276535, + 0.3400473389774561, + 0.23372376337647438, + 0.26190854236483574, + 0.5388661026954651, + 0.03796682879328728, + 0.2098286934196949, + 0.09108159691095352, + 0.25870657712221146, + 0.14425481483340263, + 0.0, + 0.7537844721227884, + 0.5076446670282166, + 0.3257164731621742, + 0.24460764974355698, + 0.03314483165740967 + ], + "unique_experts": 59, + "load_cv": 0.9717896011602172, + "normalized_load_entropy": 0.9099400647959899, + "max_load_share": 0.09523809523809523 + } + }, + "s1_eos": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "63e760dda790425746afe67cd22acfa08b56f8fbb00d09ee7fd37cc3f6ce895e", + "route_weight_sha256": "631497f4f136a0f361fdfa6f43209017dfe46c9f97847cbc54e370b97ba6d480", + "loads": [ + 0, + 5, + 0, + 1, + 1, + 0, + 1, + 1, + 3, + 6, + 0, + 2, + 6, + 0, + 0, + 9, + 4, + 1, + 0, + 0, + 4, + 2, + 3, + 4, + 1, + 0, + 1, + 2, + 3, + 9, + 2, + 4, + 2, + 3, + 2, + 0, + 5, + 6, + 1, + 4, + 0, + 2, + 1, + 4, + 3, + 1, + 0, + 2, + 0, + 4, + 3, + 3, + 5, + 1, + 3, + 1, + 3, + 3, + 0, + 0, + 0, + 5, + 1, + 1 + ], + "weighted_loads": [ + 0.0, + 0.22188054770231247, + 0.0, + 0.047603540122509, + 0.08710348606109619, + 0.0, + 0.07721700519323349, + 0.03923290967941284, + 0.2543291375041008, + 0.40236351266503334, + 0.0, + 0.17339427396655083, + 0.6858354657888412, + 0.0, + 0.0, + 0.9064673408865929, + 0.35193558782339096, + 0.08118802309036255, + 0.0, + 0.0, + 0.44333670288324356, + 0.11079230904579163, + 0.18530186265707016, + 0.317331962287426, + 0.06606332212686539, + 0.0, + 0.09536423534154892, + 0.19836261495947838, + 0.28129740059375763, + 0.9099012427031994, + 0.10172036290168762, + 0.29134487360715866, + 0.11536777392029762, + 0.1680963635444641, + 0.109616219997406, + 0.0, + 0.29378746822476387, + 0.366822924464941, + 0.03618291765451431, + 0.4067205339670181, + 0.0, + 0.11318127810955048, + 0.05851428210735321, + 0.35570234805345535, + 0.29719657450914383, + 0.20118367671966553, + 0.0, + 0.14091769605875015, + 0.0, + 0.28662756085395813, + 0.18783466517925262, + 0.2618718110024929, + 0.5371148884296417, + 0.038340166211128235, + 0.20400065183639526, + 0.09128345549106598, + 0.2560882121324539, + 0.14345917105674744, + 0.0, + 0.0, + 0.0, + 0.3648279421031475, + 0.03653043881058693, + 0.033847514539957047 + ], + "unique_experts": 48, + "load_cv": 0.9525793444156805, + "normalized_load_entropy": 0.8829789215849174, + "max_load_share": 0.0625 + }, + "full_input": { + "tokens": 65, + "top_k": 6, + "decisions": 390, + "ordered_route_sha256": "a3f36cb16c0e998b9a6d6bad273ca60563238fd925f5338a419c5f7352cd6ec0", + "route_weight_sha256": "a182106a41439c6c0778a3f4637afeaed2b9685312a0ce41609fcf851924e4f4", + "loads": [ + 0, + 7, + 3, + 10, + 1, + 0, + 4, + 1, + 3, + 14, + 9, + 4, + 7, + 16, + 3, + 13, + 6, + 3, + 7, + 2, + 5, + 5, + 6, + 5, + 1, + 10, + 10, + 3, + 4, + 32, + 2, + 6, + 2, + 5, + 17, + 0, + 6, + 9, + 4, + 7, + 3, + 8, + 10, + 4, + 5, + 4, + 10, + 6, + 1, + 7, + 5, + 3, + 9, + 5, + 9, + 1, + 8, + 5, + 0, + 14, + 7, + 7, + 5, + 2 + ], + "weighted_loads": [ + 0.0, + 0.35971371084451675, + 0.17068889364600182, + 0.8206366127415095, + 0.08710348606109619, + 0.0, + 0.2896730303764343, + 0.03923290967941284, + 0.2543291375041008, + 1.446890588849783, + 0.5898145101964474, + 0.1998325251042843, + 0.7917463034391403, + 1.0653229784220457, + 0.07468878291547298, + 1.1797627620398998, + 0.7159812822937965, + 0.1516549438238144, + 0.586935478146188, + 0.09045704454183578, + 0.4928155802190304, + 1.2063731104135513, + 0.48472604900598526, + 0.41067270189523697, + 0.06606332212686539, + 0.7188990972936153, + 0.9091765210032463, + 0.20668243151158094, + 0.3235098756849766, + 2.4482891857624054, + 0.10172036290168762, + 0.3219537865370512, + 0.11536777392029762, + 0.2087611174210906, + 1.7564807000453584, + 0.0, + 0.32105627842247486, + 0.4993203990161419, + 1.2240275256335735, + 0.617835208773613, + 0.16070892289280891, + 0.3595020472421311, + 0.4902910850942135, + 0.35570234805345535, + 0.3670159541070461, + 0.36376844564802013, + 1.1946148201823235, + 0.47809309139847755, + 0.029735155403614044, + 0.37314499355852604, + 0.28051480650901794, + 0.2618718110024929, + 0.9715849608182907, + 0.2217252478003502, + 0.7527361139655113, + 0.09128345549106598, + 0.6807544529438019, + 0.21704412437975407, + 0.0, + 0.8277425039559603, + 0.9852917715907097, + 0.5621430836617947, + 0.3179326429963112, + 0.07830605283379555 + ], + "unique_experts": 60, + "load_cv": 0.8290422061744938, + "normalized_load_entropy": 0.9280198085999236, + "max_load_share": 0.08205128205128205 + } + }, + "s0_bos": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "ffe3f6e1953673c30f3df980cd3efb7a0619618eda4e1ec51b7ba40a18e5411b", + "route_weight_sha256": "33e3a5196c697be271bf9ff460085b6b3e8a0f68494fc1a62cf22a884612c406", + "loads": [ + 0, + 5, + 0, + 1, + 1, + 0, + 1, + 0, + 3, + 7, + 0, + 1, + 6, + 0, + 0, + 9, + 4, + 1, + 0, + 0, + 4, + 4, + 3, + 4, + 1, + 0, + 1, + 2, + 4, + 9, + 2, + 4, + 2, + 3, + 2, + 0, + 4, + 7, + 1, + 4, + 0, + 2, + 1, + 4, + 3, + 1, + 0, + 2, + 0, + 4, + 3, + 3, + 5, + 1, + 3, + 1, + 3, + 1, + 0, + 1, + 0, + 4, + 1, + 1 + ], + "weighted_loads": [ + 0.0, + 0.22130277007818222, + 0.0, + 0.04980424419045448, + 0.07560490071773529, + 0.0, + 0.08271650224924088, + 0.0, + 0.23543860763311386, + 0.4808300994336605, + 0.0, + 0.12711691856384277, + 0.621147159487009, + 0.0, + 0.0, + 0.8926549628376961, + 0.3772423267364502, + 0.07600105553865433, + 0.0, + 0.0, + 0.4427702948451042, + 0.21716537699103355, + 0.1998405158519745, + 0.3095466382801533, + 0.07154884934425354, + 0.0, + 0.0857553631067276, + 0.1938040629029274, + 0.3079218864440918, + 0.7946509681642056, + 0.1027580015361309, + 0.30774880573153496, + 0.10670585185289383, + 0.17161427810788155, + 0.08765649423003197, + 0.0, + 0.2508152201771736, + 0.42638611420989037, + 0.03422575816512108, + 0.43570274859666824, + 0.0, + 0.10499082505702972, + 0.07048248499631882, + 0.36592360958456993, + 0.31662271171808243, + 0.17457883059978485, + 0.0, + 0.15330132097005844, + 0.0, + 0.27503037452697754, + 0.1783187985420227, + 0.2205180786550045, + 0.6197132207453251, + 0.04030142351984978, + 0.2173568569123745, + 0.09645430743694305, + 0.2562716007232666, + 0.07293912768363953, + 0.0, + 0.03492451831698418, + 0.0, + 0.3163854628801346, + 0.03403613716363907, + 0.03144458681344986 + ], + "unique_experts": 48, + "load_cv": 0.9781564923143894, + "normalized_load_entropy": 0.8788650755815007, + "max_load_share": 0.0625 + }, + "full_input": { + "tokens": 49, + "top_k": 6, + "decisions": 294, + "ordered_route_sha256": "b10c18a718d6dbb2f79d929b09c9acfd18d3d7c18b2f6e828d9a2cb84c92d9ff", + "route_weight_sha256": "e18775019162c69b2cb723f3f53e68f2c76c162dab2807fa000f54864cb63af1", + "loads": [ + 0, + 8, + 2, + 6, + 1, + 0, + 2, + 0, + 3, + 7, + 10, + 2, + 6, + 15, + 2, + 12, + 4, + 1, + 5, + 0, + 4, + 5, + 3, + 4, + 1, + 6, + 7, + 2, + 5, + 30, + 2, + 5, + 2, + 4, + 14, + 0, + 4, + 9, + 2, + 4, + 3, + 5, + 9, + 4, + 3, + 3, + 11, + 2, + 1, + 5, + 4, + 3, + 5, + 1, + 3, + 1, + 3, + 1, + 0, + 14, + 5, + 4, + 4, + 1 + ], + "weighted_loads": [ + 0.0, + 0.38805822655558586, + 0.1224716566503048, + 0.41406401694985107, + 0.07560490071773529, + 0.0, + 0.13487540557980537, + 0.0, + 0.23543860763311386, + 0.4808300994336605, + 0.658172557130456, + 0.14418150298297405, + 0.621147159487009, + 1.007256731390953, + 0.04682381637394428, + 1.084629338234663, + 0.3772423267364502, + 0.07600105553865433, + 0.38734369896701537, + 0.0, + 0.4427702948451042, + 0.5064451955258846, + 0.1998405158519745, + 0.3095466382801533, + 0.07154884934425354, + 0.45732272416353226, + 0.627693772315979, + 0.1938040629029274, + 0.3535678945481777, + 2.517225226503797, + 0.1027580015361309, + 0.3261655103415251, + 0.10670585185289383, + 0.19697857275605202, + 1.3898563984257635, + 0.0, + 0.2508152201771736, + 0.5173251964151859, + 1.0309448204934597, + 0.43570274859666824, + 0.14008765667676926, + 0.2599221430718899, + 0.42854589223861694, + 0.36592360958456993, + 0.31662271171808243, + 0.45072280056774616, + 1.148902915418148, + 0.15330132097005844, + 0.0368838757276535, + 0.3030416890978813, + 0.22516846656799316, + 0.2205180786550045, + 0.6197132207453251, + 0.04030142351984978, + 0.2173568569123745, + 0.09645430743694305, + 0.2562716007232666, + 0.07293912768363953, + 0.0, + 0.7941090408712626, + 0.6981822836387437, + 0.3163854628801346, + 0.24981601163744926, + 0.03144458681344986 + ], + "unique_experts": 58, + "load_cv": 1.0323787648932032, + "normalized_load_entropy": 0.9003332813145158, + "max_load_share": 0.10204081632653061 + } + }, + "s1_bos": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "c11766dc2b11b08bb9a9d5fb79d86a041750ab2a042079ae1d8eee7bcb3a41b3", + "route_weight_sha256": "b319525d8159cce743c15dcb2a4355a85c8f2bd65883409cda0c1bc2ac6ef031", + "loads": [ + 0, + 4, + 0, + 1, + 1, + 0, + 1, + 0, + 3, + 6, + 0, + 1, + 6, + 0, + 0, + 10, + 5, + 1, + 0, + 0, + 4, + 4, + 3, + 4, + 1, + 0, + 1, + 2, + 3, + 9, + 2, + 6, + 2, + 3, + 2, + 0, + 4, + 7, + 1, + 4, + 0, + 2, + 1, + 4, + 3, + 1, + 0, + 2, + 0, + 4, + 3, + 2, + 5, + 1, + 3, + 1, + 3, + 2, + 0, + 0, + 0, + 4, + 1, + 1 + ], + "weighted_loads": [ + 0.0, + 0.1672368459403515, + 0.0, + 0.047553956508636475, + 0.0753793865442276, + 0.0, + 0.07852368801832199, + 0.0, + 0.2359132394194603, + 0.45112419500947, + 0.0, + 0.13035354018211365, + 0.626070398837328, + 0.0, + 0.0, + 0.9435945991426706, + 0.40801943466067314, + 0.07998376339673996, + 0.0, + 0.0, + 0.44687535613775253, + 0.23103025928139687, + 0.20433449000120163, + 0.32924386113882065, + 0.07281641662120819, + 0.0, + 0.0921042412519455, + 0.178713571280241, + 0.2774542160332203, + 0.7123030684888363, + 0.10519198700785637, + 0.3752518929541111, + 0.12658796831965446, + 0.18058181926608086, + 0.07936574704945087, + 0.0, + 0.2620426379144192, + 0.4318350702524185, + 0.036414165049791336, + 0.4389152079820633, + 0.0, + 0.10420693457126617, + 0.06734207272529602, + 0.3603106327354908, + 0.3224845677614212, + 0.17012132704257965, + 0.0, + 0.16360164433717728, + 0.0, + 0.2849346250295639, + 0.1826799102127552, + 0.19996099174022675, + 0.603640403598547, + 0.0385761596262455, + 0.2156069502234459, + 0.09740118682384491, + 0.25481780618429184, + 0.11465341225266457, + 0.0, + 0.0, + 0.0, + 0.32516081258654594, + 0.03380560502409935, + 0.032503027468919754 + ], + "unique_experts": 47, + "load_cv": 1.003081671403766, + "normalized_load_entropy": 0.8741682914493902, + "max_load_share": 0.06944444444444445 + }, + "full_input": { + "tokens": 65, + "top_k": 6, + "decisions": 390, + "ordered_route_sha256": "38cd310ed74053696b06f27c4f169f9d0b9f9d170dd9f0f06fcb681a3ef31233", + "route_weight_sha256": "691d67fdd24bd4b4eb25dfdb0da94ce993706dc8ac564a0825cf2c731c352e2f", + "loads": [ + 0, + 6, + 3, + 11, + 1, + 0, + 4, + 0, + 3, + 14, + 9, + 2, + 7, + 15, + 3, + 14, + 7, + 3, + 8, + 2, + 5, + 6, + 7, + 5, + 1, + 10, + 10, + 2, + 4, + 33, + 2, + 7, + 2, + 4, + 18, + 0, + 5, + 10, + 4, + 7, + 3, + 8, + 10, + 4, + 5, + 4, + 11, + 6, + 1, + 6, + 5, + 2, + 9, + 5, + 9, + 1, + 8, + 4, + 0, + 14, + 8, + 6, + 5, + 2 + ], + "weighted_loads": [ + 0.0, + 0.31460055336356163, + 0.17068889364600182, + 0.878032145468751, + 0.0753793865442276, + 0.0, + 0.27316419780254364, + 0.0, + 0.2359132394194603, + 1.4956512711942196, + 0.5898145101964474, + 0.14741812460124493, + 0.731981236487627, + 1.0297472923994064, + 0.07468878291547298, + 1.231048857793212, + 0.7720651291310787, + 0.1504506841301918, + 0.7100503024412319, + 0.09045704454183578, + 0.49635423347353935, + 0.5606391616165638, + 0.5341359116137028, + 0.4225846007466316, + 0.07281641662120819, + 0.6868795976042747, + 0.9258187152445316, + 0.178713571280241, + 0.32615185156464577, + 2.2477000802755356, + 0.10519198700785637, + 0.3936685975641012, + 0.12658796831965446, + 0.20594611391425133, + 1.6310081488336436, + 0.0, + 0.28931144811213017, + 0.5645029507577419, + 1.2242587730288506, + 0.6500298827886581, + 0.16070892289280891, + 0.38399488845607266, + 0.4991188757121563, + 0.3603106327354908, + 0.3923039473593235, + 0.3395652196777519, + 1.2425486221909523, + 0.5007770396769047, + 0.029735155403614044, + 0.34856392443180084, + 0.2753600515425205, + 0.19996099174022675, + 1.038110475987196, + 0.22196124121546745, + 0.764342412352562, + 0.09740118682384491, + 0.6794840469956398, + 0.1882383655756712, + 0.0, + 0.8298256229609251, + 1.1523483842611313, + 0.5224759541451931, + 0.3329276256263256, + 0.07696156576275826 + ], + "unique_experts": 59, + "load_cv": 0.8653000908388868, + "normalized_load_entropy": 0.9211120034901826, + "max_load_share": 0.08461538461538462 + } + }, + "s0_x": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "6389564246a098cffd049ef77f75c73236c2f3c0f1b7133d66f684e184311637", + "route_weight_sha256": "8ce5f5e81f0e40ad012e2a1a4f5696c06f53c7c5be2efffc9e813aaf79af07cd", + "loads": [ + 0, + 5, + 0, + 1, + 1, + 0, + 1, + 1, + 3, + 7, + 0, + 1, + 5, + 0, + 0, + 9, + 4, + 1, + 0, + 0, + 4, + 4, + 3, + 4, + 1, + 0, + 1, + 2, + 3, + 9, + 2, + 5, + 2, + 4, + 2, + 0, + 4, + 7, + 1, + 4, + 0, + 2, + 1, + 4, + 3, + 1, + 0, + 2, + 0, + 4, + 3, + 2, + 5, + 1, + 3, + 1, + 3, + 1, + 0, + 1, + 0, + 4, + 1, + 1 + ], + "weighted_loads": [ + 0.0, + 0.21870671957731247, + 0.0, + 0.05455196648836136, + 0.07410835474729538, + 0.0, + 0.08417482674121857, + 0.040059302002191544, + 0.23892974853515625, + 0.493132509291172, + 0.0, + 0.12723927199840546, + 0.5953561775386333, + 0.0, + 0.0, + 0.8839066177606583, + 0.3672705441713333, + 0.07544882595539093, + 0.0, + 0.0, + 0.432855561375618, + 0.2210642248392105, + 0.21272734180092812, + 0.30442896485328674, + 0.06809041649103165, + 0.0, + 0.08576669543981552, + 0.1921992115676403, + 0.26742560788989067, + 0.6681484207510948, + 0.10450677201151848, + 0.34568919986486435, + 0.10700276121497154, + 0.2080613560974598, + 0.08811565861105919, + 0.0, + 0.23713234812021255, + 0.4261685349047184, + 0.034743547439575195, + 0.42562372237443924, + 0.0, + 0.10847678780555725, + 0.06940094381570816, + 0.3548736572265625, + 0.32214242964982986, + 0.17229582369327545, + 0.0, + 0.1487613394856453, + 0.0, + 0.2901728004217148, + 0.17082595452666283, + 0.21383601054549217, + 0.6325349025428295, + 0.041288502514362335, + 0.209742221981287, + 0.09220275282859802, + 0.2660460025072098, + 0.07225965708494186, + 0.0, + 0.03743024170398712, + 0.0, + 0.32277143746614456, + 0.03594310209155083, + 0.032942451536655426 + ], + "unique_experts": 49, + "load_cv": 0.9686442096757053, + "normalized_load_entropy": 0.8823898227546684, + "max_load_share": 0.0625 + }, + "full_input": { + "tokens": 49, + "top_k": 6, + "decisions": 294, + "ordered_route_sha256": "46ca780aa5b8a929add09cc2457f9b3547ea8eb5c618c721d9817cacfd1543fb", + "route_weight_sha256": "355726aec212c48ed3f12fbc5faf217d21b3ec7488cb671d20519a7b14422415", + "loads": [ + 0, + 9, + 3, + 5, + 1, + 0, + 1, + 1, + 3, + 7, + 11, + 2, + 5, + 12, + 2, + 12, + 4, + 1, + 4, + 0, + 4, + 5, + 5, + 4, + 1, + 6, + 7, + 2, + 4, + 28, + 2, + 6, + 2, + 5, + 12, + 0, + 4, + 9, + 2, + 4, + 4, + 5, + 10, + 4, + 3, + 3, + 13, + 2, + 2, + 5, + 4, + 2, + 5, + 1, + 3, + 1, + 3, + 1, + 0, + 15, + 4, + 4, + 4, + 1 + ], + "weighted_loads": [ + 0.0, + 0.42579062283039093, + 0.15349462814629078, + 0.3958553753909655, + 0.07410835474729538, + 0.0, + 0.08417482674121857, + 0.040059302002191544, + 0.23892974853515625, + 0.493132509291172, + 0.873404348269105, + 0.14430385641753674, + 0.5953561775386333, + 0.9132940322160721, + 0.04682381637394428, + 1.0859408751130104, + 0.3672705441713333, + 0.07544882595539093, + 0.2500507923250552, + 0.0, + 0.432855561375618, + 0.5103440433740616, + 0.29156672954559326, + 0.30442896485328674, + 0.06809041649103165, + 0.3875514827668667, + 0.6702084913849831, + 0.1921992115676403, + 0.3147718720138073, + 2.059753703069873, + 0.10450677201151848, + 0.36410590447485447, + 0.10700276121497154, + 0.23342565074563026, + 1.1314885954780038, + 0.0, + 0.23713234812021255, + 0.5185975022614002, + 1.0314626097679138, + 0.42562372237443924, + 0.19653495773673058, + 0.2692517414689064, + 0.4630838930606842, + 0.3548736572265625, + 0.32214242964982986, + 0.42033794708549976, + 1.3943392112851143, + 0.1487613394856453, + 0.07986892387270927, + 0.31818411499261856, + 0.21767562255263329, + 0.21383601054549217, + 0.6325349025428295, + 0.041288502514362335, + 0.209742221981287, + 0.09220275282859802, + 0.2660460025072098, + 0.07225965708494186, + 0.0, + 0.8849291931837797, + 0.4633580136287492, + 0.32277143746614456, + 0.24767112359404564, + 0.032942451536655426 + ], + "unique_experts": 59, + "load_cv": 0.98840985776392, + "normalized_load_entropy": 0.9060483898880802, + "max_load_share": 0.09523809523809523 + } + }, + "s1_x": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "26427e0b16fb9d2420bce458b298c353e14d19615068225f082a50697544ae6b", + "route_weight_sha256": "1dc85b0b761759719d8cd70a76d256fedc9a05910d649080d96613a348a79c08", + "loads": [ + 0, + 4, + 0, + 1, + 1, + 0, + 1, + 0, + 3, + 6, + 0, + 1, + 6, + 0, + 0, + 10, + 4, + 1, + 0, + 0, + 4, + 4, + 3, + 4, + 1, + 0, + 1, + 2, + 3, + 9, + 2, + 6, + 2, + 3, + 1, + 0, + 4, + 7, + 1, + 4, + 0, + 2, + 1, + 4, + 3, + 1, + 0, + 2, + 0, + 4, + 3, + 2, + 5, + 1, + 3, + 1, + 3, + 3, + 0, + 1, + 0, + 4, + 1, + 1 + ], + "weighted_loads": [ + 0.0, + 0.16476032510399818, + 0.0, + 0.05168287456035614, + 0.07223374396562576, + 0.0, + 0.08173870295286179, + 0.0, + 0.22961480170488358, + 0.4664743058383465, + 0.0, + 0.12744715809822083, + 0.6152077130973339, + 0.0, + 0.0, + 0.9496064074337482, + 0.365869227796793, + 0.08146761357784271, + 0.0, + 0.0, + 0.44240105152130127, + 0.2318229228258133, + 0.2195620946586132, + 0.3286896273493767, + 0.07136053591966629, + 0.0, + 0.09444106370210648, + 0.17667435482144356, + 0.27527904137969017, + 0.5769075453281403, + 0.107928067445755, + 0.3733593728393316, + 0.1283637471497059, + 0.17882026359438896, + 0.04584122076630592, + 0.0, + 0.25338004902005196, + 0.4336472973227501, + 0.036933254450559616, + 0.4254547730088234, + 0.0, + 0.10418978706002235, + 0.06700347363948822, + 0.35781464725732803, + 0.330675907433033, + 0.16995973885059357, + 0.0, + 0.1560814082622528, + 0.0, + 0.2831788398325443, + 0.18131981045007706, + 0.20581402257084846, + 0.6267652288079262, + 0.03831930458545685, + 0.2207571342587471, + 0.09898413717746735, + 0.25119413435459137, + 0.1469556111842394, + 0.0, + 0.04010595381259918, + 0.0, + 0.32425905391573906, + 0.0339813157916069, + 0.032841961830854416 + ], + "unique_experts": 48, + "load_cv": 0.9938079899999066, + "normalized_load_entropy": 0.8774724036858178, + "max_load_share": 0.06944444444444445 + }, + "full_input": { + "tokens": 65, + "top_k": 6, + "decisions": 390, + "ordered_route_sha256": "f255c10cfaa114f029ca0b8c88a36497dcde05e47b902f4da7f28b60d915d21a", + "route_weight_sha256": "bd835e278c3404d2599077df36cacc6b078c739615e75432286607dd436da2d6", + "loads": [ + 0, + 7, + 4, + 10, + 1, + 0, + 3, + 0, + 3, + 14, + 10, + 2, + 7, + 14, + 3, + 14, + 6, + 3, + 7, + 2, + 5, + 6, + 8, + 5, + 1, + 10, + 10, + 2, + 4, + 30, + 2, + 7, + 2, + 4, + 16, + 0, + 5, + 10, + 5, + 7, + 4, + 8, + 11, + 4, + 5, + 4, + 12, + 6, + 1, + 6, + 5, + 2, + 9, + 5, + 9, + 1, + 8, + 5, + 0, + 16, + 7, + 6, + 5, + 2 + ], + "weighted_loads": [ + 0.0, + 0.35413723438978195, + 0.20583036541938782, + 0.8626732876582537, + 0.07223374396562576, + 0.0, + 0.22686606645584106, + 0.0, + 0.22961480170488358, + 1.511001382023096, + 0.7786636762320995, + 0.1445117425173521, + 0.721118550747633, + 0.9953311905264854, + 0.07468878291547298, + 1.2403875924646854, + 0.7299149222671986, + 0.15193453431129456, + 0.565914208884351, + 0.09045704454183578, + 0.4918799288570881, + 0.5614318251609802, + 0.6011568643152714, + 0.42203036695718765, + 0.07136053591966629, + 0.6309862360358238, + 0.9653134532272816, + 0.17667435482144356, + 0.325091153383255, + 1.756853349506855, + 0.107928067445755, + 0.39177607744932175, + 0.1283637471497059, + 0.20418455824255943, + 1.3564618403906934, + 0.0, + 0.28064885921776295, + 0.5675415880978107, + 1.2775886356830597, + 0.6365694478154182, + 0.21471698954701424, + 0.41258207702776417, + 0.5386447198688984, + 0.35781464725732803, + 0.4004952870309353, + 0.2952046788705047, + 1.4500017389655113, + 0.4932568036019802, + 0.029735155403614044, + 0.34680813923478127, + 0.2739999517798424, + 0.20581402257084846, + 1.0612353011965752, + 0.2217043861746788, + 0.7694925963878632, + 0.09898413717746735, + 0.6758603751659393, + 0.22054056450724602, + 0.0, + 0.966170085594058, + 0.9107795432209969, + 0.5215741954743862, + 0.3215492367744446, + 0.07730050012469292 + ], + "unique_experts": 59, + "load_cv": 0.8219058687390658, + "normalized_load_entropy": 0.9250216876739489, + "max_load_share": 0.07692307692307693 + } + }, + "s0_period": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "8156e162c0d69e0bbd0f7f7453003f45e9cd6bdccdecc1a14bcd9fab8c73be77", + "route_weight_sha256": "bf2125adc7daedde0f1f177c1c791ba49923df66e20cf5390a709ef40db80109", + "loads": [ + 0, + 5, + 0, + 1, + 1, + 0, + 1, + 1, + 3, + 7, + 0, + 1, + 6, + 0, + 0, + 10, + 4, + 1, + 0, + 0, + 4, + 3, + 3, + 4, + 1, + 0, + 1, + 2, + 3, + 9, + 2, + 5, + 2, + 3, + 1, + 0, + 4, + 7, + 1, + 4, + 0, + 2, + 1, + 4, + 3, + 1, + 0, + 2, + 0, + 4, + 3, + 2, + 5, + 1, + 3, + 1, + 3, + 2, + 0, + 1, + 0, + 4, + 1, + 1 + ], + "weighted_loads": [ + 0.0, + 0.21489537507295609, + 0.0, + 0.055431559681892395, + 0.07383246719837189, + 0.0, + 0.08291062712669373, + 0.040345363318920135, + 0.24269405752420425, + 0.49280741065740585, + 0.0, + 0.1289665848016739, + 0.6607351303100586, + 0.0, + 0.0, + 0.931985342875123, + 0.3670147657394409, + 0.07663675397634506, + 0.0, + 0.0, + 0.4348081350326538, + 0.16222405061125755, + 0.21018249168992043, + 0.3100926950573921, + 0.06867174804210663, + 0.0, + 0.08378299325704575, + 0.19046742841601372, + 0.26749419048428535, + 0.6454477533698082, + 0.10501682013273239, + 0.3420519270002842, + 0.11766764894127846, + 0.16734244674444199, + 0.0560465045273304, + 0.0, + 0.23708128556609154, + 0.43705035746097565, + 0.03496953845024109, + 0.4399919733405113, + 0.0, + 0.10699847340583801, + 0.06959517300128937, + 0.35574907809495926, + 0.319625549018383, + 0.1698795109987259, + 0.0, + 0.1510399729013443, + 0.0, + 0.2796843647956848, + 0.17472750693559647, + 0.19990044459700584, + 0.6407163627445698, + 0.04136086255311966, + 0.2131589725613594, + 0.09332819283008575, + 0.26431936025619507, + 0.10596631467342377, + 0.0, + 0.03519175574183464, + 0.0, + 0.32562246546149254, + 0.03612971678376198, + 0.032851312309503555 + ], + "unique_experts": 49, + "load_cv": 0.9938079899999066, + "normalized_load_entropy": 0.8799594229050042, + "max_load_share": 0.06944444444444445 + }, + "full_input": { + "tokens": 49, + "top_k": 6, + "decisions": 294, + "ordered_route_sha256": "eff0f0f9a4658ea8fa45058abcced0c393db9e9d102400ea430596ce6167cc76", + "route_weight_sha256": "4afd9d3072d5c09b4052d623387e91ea7f577c96d1e45a9b94c96a35b455ced4", + "loads": [ + 0, + 9, + 2, + 5, + 1, + 0, + 1, + 1, + 3, + 7, + 10, + 2, + 6, + 12, + 2, + 12, + 4, + 1, + 4, + 0, + 4, + 4, + 6, + 4, + 1, + 6, + 8, + 2, + 4, + 29, + 2, + 6, + 2, + 4, + 11, + 1, + 4, + 9, + 2, + 4, + 3, + 5, + 9, + 4, + 3, + 3, + 12, + 2, + 2, + 5, + 4, + 3, + 6, + 1, + 3, + 1, + 3, + 2, + 0, + 15, + 4, + 4, + 4, + 1 + ], + "weighted_loads": [ + 0.0, + 0.4297097772359848, + 0.1224716566503048, + 0.39222386555047706, + 0.07383246719837189, + 0.0, + 0.08291062712669373, + 0.040345363318920135, + 0.24269405752420425, + 0.49280741065740585, + 0.658172557130456, + 0.14603116922080517, + 0.6607351303100586, + 0.8878403082489967, + 0.04682381637394428, + 1.0704943034797907, + 0.3670147657394409, + 0.07663675397634506, + 0.2513436766748782, + 0.0, + 0.4348081350326538, + 0.4515038691461086, + 0.3274831548333168, + 0.3100926950573921, + 0.06867174804210663, + 0.3652005195617676, + 0.9373729638755322, + 0.19046742841601372, + 0.31719664484262466, + 2.0656099749030545, + 0.10501682013273239, + 0.3604686316102743, + 0.11766764894127846, + 0.19270674139261246, + 1.0868957343918737, + 0.048155855387449265, + 0.23708128556609154, + 0.5293530002236366, + 1.0316886007785797, + 0.4399919733405113, + 0.14008765667676926, + 0.2622120827436447, + 0.4276585802435875, + 0.35574907809495926, + 0.319625549018383, + 0.4402859229594469, + 1.3095093294978142, + 0.1510399729013443, + 0.09108759090304375, + 0.3076956793665886, + 0.22157717496156693, + 0.3240888901054859, + 0.7055441401898861, + 0.04136086255311966, + 0.2131589725613594, + 0.09332819283008575, + 0.26431936025619507, + 0.10596631467342377, + 0.0, + 0.8846072088927031, + 0.4558658587920945, + 0.32562246546149254, + 0.2445657104253769, + 0.032851312309503555 + ], + "unique_experts": 60, + "load_cv": 0.9869104913899951, + "normalized_load_entropy": 0.9092889537164304, + "max_load_share": 0.09863945578231292 + } + }, + "s1_period": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "f0c2f266a666456afbff08393b5c066a16dd32cbf759dda0e0543e8cad70f654", + "route_weight_sha256": "1c9c6957060c7ddc39c7313a1541c9caeb9cd19b68512dcb794a63f59de7f73a", + "loads": [ + 0, + 4, + 0, + 1, + 1, + 0, + 1, + 0, + 3, + 6, + 0, + 1, + 6, + 0, + 0, + 10, + 4, + 2, + 0, + 0, + 4, + 4, + 3, + 4, + 1, + 0, + 1, + 2, + 3, + 8, + 2, + 6, + 2, + 3, + 1, + 0, + 4, + 7, + 0, + 4, + 0, + 2, + 1, + 4, + 4, + 1, + 0, + 2, + 0, + 4, + 3, + 2, + 5, + 1, + 3, + 1, + 3, + 3, + 0, + 1, + 0, + 4, + 1, + 1 + ], + "weighted_loads": [ + 0.0, + 0.1660090871155262, + 0.0, + 0.051510490477085114, + 0.07187103480100632, + 0.0, + 0.08159603923559189, + 0.0, + 0.22982724756002426, + 0.45981115102767944, + 0.0, + 0.13233737647533417, + 0.6256344467401505, + 0.0, + 0.0, + 0.9573284741491079, + 0.3646582216024399, + 0.11742588505148888, + 0.0, + 0.0, + 0.4435950666666031, + 0.2231406606733799, + 0.21638640761375427, + 0.3300164081156254, + 0.07099112868309021, + 0.0, + 0.09052236378192902, + 0.1765160635113716, + 0.27572711557149887, + 0.5189931057393551, + 0.1065509095788002, + 0.3711342867463827, + 0.13649363070726395, + 0.17941440641880035, + 0.04527270793914795, + 0.0, + 0.25062238797545433, + 0.4405635930597782, + 0.0, + 0.43863558024168015, + 0.0, + 0.10271167382597923, + 0.06759020686149597, + 0.360429584980011, + 0.3610239140689373, + 0.16682371497154236, + 0.0, + 0.15476641803979874, + 0.0, + 0.2818812467157841, + 0.1808611936867237, + 0.2010033167898655, + 0.6229028515517712, + 0.038770344108343124, + 0.2152085341513157, + 0.09844475239515305, + 0.24525437504053116, + 0.14781126007437706, + 0.0, + 0.038865070790052414, + 0.0, + 0.32560864835977554, + 0.03409850597381592, + 0.03265926614403725 + ], + "unique_experts": 47, + "load_cv": 0.9813067629253164, + "normalized_load_entropy": 0.8766439459487163, + "max_load_share": 0.06944444444444445 + }, + "full_input": { + "tokens": 65, + "top_k": 6, + "decisions": 390, + "ordered_route_sha256": "b684c37f6a9713a4baff841bb4e1e7c869e19ce0d46b070ed660472d075b5c51", + "route_weight_sha256": "c35ccb0c09bd770330e27d517e924da69aba0db2e578406fb152bf99725789c3", + "loads": [ + 0, + 7, + 3, + 10, + 1, + 0, + 3, + 0, + 3, + 14, + 9, + 2, + 7, + 13, + 3, + 14, + 6, + 4, + 7, + 2, + 5, + 6, + 9, + 5, + 1, + 10, + 11, + 2, + 4, + 30, + 2, + 7, + 2, + 4, + 15, + 0, + 5, + 11, + 4, + 7, + 3, + 8, + 10, + 4, + 6, + 4, + 11, + 6, + 1, + 6, + 5, + 3, + 10, + 5, + 9, + 1, + 8, + 5, + 0, + 16, + 7, + 6, + 5, + 3 + ], + "weighted_loads": [ + 0.0, + 0.3439709022641182, + 0.17068889364600182, + 0.857193832664052, + 0.07187103480100632, + 0.0, + 0.22672340273857117, + 0.0, + 0.22982724756002426, + 1.504338227212429, + 0.5898145101964474, + 0.14940196089446545, + 0.7315452843904495, + 0.9314653277397156, + 0.07468878291547298, + 1.2568868082016706, + 0.7287039160728455, + 0.18789280578494072, + 0.5689627480460331, + 0.09045704454183578, + 0.4930739440023899, + 0.5527495630085468, + 0.6348420865833759, + 0.42335714772343636, + 0.07099112868309021, + 0.59981794282794, + 1.2642628215253353, + 0.1765160635113716, + 0.327403049916029, + 1.7210294902324677, + 0.1065509095788002, + 0.38955099135637283, + 0.13649363070726395, + 0.20477870106697083, + 1.2931301395292394, + 0.0, + 0.2778911981731653, + 0.6171574592590332, + 1.2455935217440128, + 0.649750255048275, + 0.16070892289280891, + 0.42389643558999524, + 0.49936700984835625, + 0.360429584980011, + 0.4308432936668396, + 0.2940847746504005, + 1.3031299859285355, + 0.49194181337952614, + 0.029735155403614044, + 0.345510546118021, + 0.27354133501648903, + 0.2977043278515339, + 1.109446231275797, + 0.22215542569756508, + 0.7639439962804317, + 0.09844475239515305, + 0.6699206158518791, + 0.2213962133973837, + 0.0, + 1.022481294348836, + 0.9018623530864716, + 0.5229237899184227, + 0.3335389643907547, + 0.10767238773405552 + ], + "unique_experts": 59, + "load_cv": 0.8121205430617141, + "normalized_load_entropy": 0.9265775626360971, + "max_load_share": 0.07692307692307693 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 24, + "ordered_topk_exact_tokens": 22, + "set_exact_tokens": 22, + "mean_set_jaccard": 0.9761904761904763, + "mean_token_weighted_tv": 0.008582282927818596, + "aggregate_load_tv": 0.0069444444444444475 + }, + "system_bos": { + "tokens": 24, + "ordered_topk_exact_tokens": 17, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.9404761904761906, + "mean_token_weighted_tv": 0.018500894928971928, + "aggregate_load_tv": 0.034722222222222224 + }, + "system_x": { + "tokens": 24, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.9404761904761906, + "mean_token_weighted_tv": 0.022762536459291976, + "aggregate_load_tv": 0.03472222222222222 + }, + "system_period": { + "tokens": 24, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 18, + "mean_set_jaccard": 0.9285714285714285, + "mean_token_weighted_tv": 0.023736699988755088, + "aggregate_load_tv": 0.034722222222222224 + }, + "bos_at_s0": { + "tokens": 24, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 18, + "mean_set_jaccard": 0.9285714285714287, + "mean_token_weighted_tv": 0.030648206011392176, + "aggregate_load_tv": 0.034722222222222224 + }, + "bos_at_s1": { + "tokens": 24, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.9047619047619048, + "mean_token_weighted_tv": 0.03592729917727411, + "aggregate_load_tv": 0.04861111111111112 + }, + "x_at_s0": { + "tokens": 24, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.9166666666666666, + "mean_token_weighted_tv": 0.03534643394717326, + "aggregate_load_tv": 0.04166666666666667 + }, + "x_at_s1": { + "tokens": 24, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.8928571428571429, + "mean_token_weighted_tv": 0.04342686113280555, + "aggregate_load_tv": 0.04861111111111112 + }, + "period_at_s0": { + "tokens": 24, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 18, + "mean_set_jaccard": 0.9285714285714285, + "mean_token_weighted_tv": 0.033333182878171407, + "aggregate_load_tv": 0.034722222222222224 + }, + "period_at_s1": { + "tokens": 24, + "ordered_topk_exact_tokens": 8, + "set_exact_tokens": 13, + "mean_set_jaccard": 0.8690476190476192, + "mean_token_weighted_tv": 0.04701370761419336, + "aggregate_load_tv": 0.0625 + } + } + }, + "layer_05": { + "layer": 5, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "5c36739a405dafe7858b94b44a79a401359b77ef9bdc84612e064a2f72edaa6b", + "route_weight_sha256": "01a6c097d70f0f72f6069c834e271efd3b705b0497a93b76a9118d6f1e12ba25", + "loads": [ + 2, + 0, + 2, + 6, + 0, + 0, + 2, + 3, + 4, + 5, + 0, + 2, + 3, + 8, + 0, + 0, + 3, + 5, + 1, + 0, + 3, + 1, + 2, + 2, + 3, + 0, + 0, + 4, + 1, + 1, + 6, + 7, + 1, + 4, + 3, + 5, + 2, + 4, + 0, + 1, + 0, + 1, + 8, + 4, + 3, + 1, + 0, + 1, + 2, + 0, + 0, + 2, + 3, + 1, + 0, + 1, + 5, + 5, + 3, + 0, + 0, + 5, + 2, + 1 + ], + "weighted_loads": [ + 0.11309546232223511, + 0.0, + 0.17452827841043472, + 0.5064012072980404, + 0.0, + 0.0, + 0.19901587069034576, + 0.1416175700724125, + 0.370966125279665, + 0.3561699129641056, + 0.0, + 0.15646639466285706, + 0.24005860835313797, + 0.6033931598067284, + 0.0, + 0.0, + 0.13793384656310081, + 0.5563945062458515, + 0.07616027444601059, + 0.0, + 0.20885224640369415, + 0.05966021865606308, + 0.21777862310409546, + 0.15593314170837402, + 0.2794078588485718, + 0.0, + 0.0, + 0.24675984680652618, + 0.17445482313632965, + 0.05227314680814743, + 0.41872765496373177, + 0.4498642962425947, + 0.06114349886775017, + 0.3460812494158745, + 0.17222188785672188, + 0.3789617642760277, + 0.07229624316096306, + 0.2998913712799549, + 0.0, + 0.04595338925719261, + 0.0, + 0.029239894822239876, + 1.013653889298439, + 0.3464328572154045, + 0.20812556892633438, + 0.035302307456731796, + 0.0, + 0.03707103431224823, + 0.10017688944935799, + 0.0, + 0.0, + 0.10038728639483452, + 0.3275085315108299, + 0.13414454460144043, + 0.0, + 0.05029427260160446, + 0.33823972195386887, + 0.27353619411587715, + 0.1925564669072628, + 0.0, + 0.0, + 0.4511510170996189, + 0.1001429557800293, + 0.06496651470661163 + ], + "unique_experts": 47, + "load_cv": 0.9428090415820632, + "normalized_load_entropy": 0.8811878881696109, + "max_load_share": 0.05555555555555555 + }, + "full_input": { + "tokens": 49, + "top_k": 6, + "decisions": 294, + "ordered_route_sha256": "1aac0438c7f27e680078db2177e0a88cfa91ed776b1029bffec0533d4bd4980f", + "route_weight_sha256": "3e1dec5bacece465e1ae0fc5b5977591c47db1d913d9f0fb2c32d149f1d25e2b", + "loads": [ + 2, + 1, + 2, + 6, + 1, + 2, + 2, + 5, + 5, + 7, + 11, + 2, + 6, + 9, + 0, + 13, + 5, + 11, + 10, + 1, + 5, + 1, + 2, + 2, + 3, + 8, + 0, + 4, + 1, + 2, + 6, + 7, + 1, + 4, + 3, + 9, + 2, + 4, + 11, + 9, + 5, + 9, + 15, + 5, + 4, + 1, + 0, + 3, + 2, + 3, + 8, + 2, + 5, + 10, + 3, + 10, + 5, + 5, + 3, + 1, + 0, + 5, + 2, + 3 + ], + "weighted_loads": [ + 0.11309546232223511, + 0.0034909851383417845, + 0.17452827841043472, + 0.5064012072980404, + 0.0017591987270861864, + 0.06824550032615662, + 0.19901587069034576, + 0.17671152483671904, + 0.37430985062383115, + 0.41051151184365153, + 0.650331974029541, + 0.15646639466285706, + 0.40573645010590553, + 0.6404117830097675, + 0.0, + 2.168934112880379, + 0.280491154640913, + 0.8550994135439396, + 0.9675327055156231, + 0.013051547110080719, + 0.22430724510923028, + 0.05966021865606308, + 0.21777862310409546, + 0.15593314170837402, + 0.2794078588485718, + 0.9068775661289692, + 0.0, + 0.24675984680652618, + 0.17445482313632965, + 0.11015229672193527, + 0.41872765496373177, + 0.4498642962425947, + 0.06114349886775017, + 0.3460812494158745, + 0.17222188785672188, + 0.6908259652554989, + 0.07229624316096306, + 0.2998913712799549, + 1.0962050259113312, + 0.6676478646695614, + 0.2073056697845459, + 0.957858657464385, + 1.7722324095666409, + 0.37997348234057426, + 0.2902246043086052, + 0.035302307456731796, + 0.0, + 0.05504028871655464, + 0.10017688944935799, + 0.16678352933377028, + 0.8651849702000618, + 0.10038728639483452, + 1.9570679292082787, + 0.7295549660921097, + 0.016856804373674095, + 0.7375015988945961, + 0.33823972195386887, + 0.27353619411587715, + 0.1925564669072628, + 0.046343833208084106, + 0.0, + 0.4511510170996189, + 0.1001429557800293, + 1.0009362399578094 + ], + "unique_experts": 60, + "load_cv": 0.7684064186793772, + "normalized_load_entropy": 0.9279168348169243, + "max_load_share": 0.05102040816326531 + } + }, + "s1_eos": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "3716bd5ff84d7ef106017b565c5f74f1245ceb7c5f721061d21c7ed9f5ce6496", + "route_weight_sha256": "d6180dca3137e2df25bafaca953f2c725aa7ec949bd38d511f748c1077e16575", + "loads": [ + 3, + 0, + 2, + 6, + 0, + 0, + 2, + 3, + 4, + 5, + 0, + 2, + 3, + 8, + 0, + 0, + 2, + 5, + 1, + 0, + 3, + 1, + 2, + 2, + 3, + 0, + 0, + 4, + 2, + 1, + 5, + 7, + 1, + 4, + 3, + 5, + 2, + 4, + 0, + 1, + 0, + 1, + 8, + 4, + 3, + 1, + 0, + 1, + 2, + 0, + 0, + 2, + 3, + 1, + 0, + 1, + 5, + 4, + 3, + 0, + 1, + 5, + 2, + 1 + ], + "weighted_loads": [ + 0.1506427526473999, + 0.0, + 0.1802104040980339, + 0.5141878351569176, + 0.0, + 0.0, + 0.20399226248264313, + 0.1427951417863369, + 0.3844938762485981, + 0.35181235522031784, + 0.0, + 0.15369264781475067, + 0.2355218157172203, + 0.5964483618736267, + 0.0, + 0.0, + 0.10906340181827545, + 0.5600480958819389, + 0.07387964427471161, + 0.0, + 0.21003399789333344, + 0.057941168546676636, + 0.21784092485904694, + 0.15734775364398956, + 0.27652667462825775, + 0.0, + 0.0, + 0.24495458230376244, + 0.22704005986452103, + 0.051485344767570496, + 0.3742995671927929, + 0.4457308705896139, + 0.06133430823683739, + 0.3494387976825237, + 0.17300832271575928, + 0.3831962123513222, + 0.06861751899123192, + 0.29116882383823395, + 0.0, + 0.044843122363090515, + 0.0, + 0.029591182246804237, + 1.019665502011776, + 0.339527178555727, + 0.2033950500190258, + 0.036885250359773636, + 0.0, + 0.03707808256149292, + 0.10225743055343628, + 0.0, + 0.0, + 0.0990830808877945, + 0.3226117193698883, + 0.1338558942079544, + 0.0, + 0.04825250431895256, + 0.33429449424147606, + 0.2175050899386406, + 0.19239002093672752, + 0.0, + 0.03636160120368004, + 0.46844467520713806, + 0.09938524663448334, + 0.06546062231063843 + ], + "unique_experts": 48, + "load_cv": 0.9162456945817024, + "normalized_load_entropy": 0.8875649425727671, + "max_load_share": 0.05555555555555555 + }, + "full_input": { + "tokens": 65, + "top_k": 6, + "decisions": 390, + "ordered_route_sha256": "1c95ee7df4a377c51058f8e7c755544cd914035cebe230aeeb246b074af0571c", + "route_weight_sha256": "a4aaa8732ef3c30177fdda254da9877aea7022fe3dc1dc79bc7ff081ea859825", + "loads": [ + 4, + 2, + 2, + 12, + 1, + 2, + 10, + 5, + 5, + 7, + 14, + 5, + 8, + 9, + 1, + 15, + 5, + 16, + 13, + 10, + 5, + 1, + 3, + 2, + 4, + 8, + 0, + 6, + 2, + 4, + 5, + 7, + 2, + 5, + 4, + 9, + 3, + 7, + 12, + 13, + 4, + 14, + 19, + 8, + 4, + 1, + 0, + 4, + 2, + 14, + 10, + 3, + 5, + 11, + 4, + 11, + 5, + 4, + 4, + 1, + 2, + 5, + 2, + 5 + ], + "weighted_loads": [ + 0.18725209683179855, + 0.023775976849719882, + 0.1802104040980339, + 0.9275438226759434, + 0.0017808630364015698, + 0.07182217389345169, + 1.183316197246313, + 0.19721522089093924, + 0.38786028884351254, + 0.4077497380785644, + 0.8376197759062052, + 0.5207879319787025, + 0.6288434192538261, + 0.6339060962200165, + 0.03463760018348694, + 2.6425620396621525, + 0.33480092138051987, + 1.2376508302986622, + 1.3093031160533428, + 0.8453261852264404, + 0.22540637874044478, + 0.057941168546676636, + 0.2556798942387104, + 0.15734775364398956, + 0.35203787684440613, + 0.7168988175690174, + 0.0, + 0.4188969321548939, + 0.22704005986452103, + 0.1936391331255436, + 0.3742995671927929, + 0.4457308705896139, + 0.180575143545866, + 0.39159415289759636, + 0.20729876682162285, + 0.8197811022400856, + 0.11418946832418442, + 0.44314105436205864, + 1.2401550896465778, + 1.1501307375729084, + 0.16252204030752182, + 1.3849244322627783, + 2.060638550668955, + 0.5708126798272133, + 0.2648169733583927, + 0.036885250359773636, + 0.0, + 0.08811525464989245, + 0.10225743055343628, + 0.8463778151199222, + 1.3196092918515205, + 0.14714699611067772, + 1.9517334997653961, + 0.9451493583619595, + 0.0548455745447427, + 0.664612902328372, + 0.33429449424147606, + 0.2175050899386406, + 0.2627071179449558, + 0.04764636233448982, + 0.08189067244529724, + 0.46844467520713806, + 0.09938524663448334, + 1.2424829564988613 + ], + "unique_experts": 62, + "load_cv": 0.7285481315693213, + "normalized_load_entropy": 0.9368061866162231, + "max_load_share": 0.04871794871794872 + } + }, + "s0_bos": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "c17bf1bb7bb30ef193929c35662720c1e4c0badcf781c083bd3cb34b812e44a6", + "route_weight_sha256": "dce1480fd15fde9f154369fb2c0e70b0bd3111b3a2ac166ced176d185ba0845f", + "loads": [ + 3, + 0, + 2, + 6, + 0, + 0, + 2, + 3, + 4, + 4, + 0, + 2, + 3, + 8, + 0, + 0, + 2, + 5, + 1, + 0, + 3, + 1, + 4, + 2, + 4, + 0, + 0, + 4, + 3, + 1, + 6, + 6, + 1, + 5, + 3, + 4, + 2, + 4, + 0, + 1, + 0, + 0, + 8, + 4, + 4, + 0, + 0, + 1, + 2, + 0, + 0, + 2, + 2, + 1, + 0, + 1, + 5, + 4, + 2, + 0, + 1, + 5, + 2, + 1 + ], + "weighted_loads": [ + 0.1454363875091076, + 0.0, + 0.191033735871315, + 0.516582902520895, + 0.0, + 0.0, + 0.1784362569451332, + 0.1506733037531376, + 0.39151091128587723, + 0.28848695382475853, + 0.0, + 0.1519557163119316, + 0.2291431874036789, + 0.5956492461264133, + 0.0, + 0.0, + 0.10693815350532532, + 0.5781027153134346, + 0.06352759897708893, + 0.0, + 0.2000770904123783, + 0.056185364723205566, + 0.2734564710408449, + 0.16412460058927536, + 0.29754582419991493, + 0.0, + 0.0, + 0.2528540939092636, + 0.25943827629089355, + 0.046774573624134064, + 0.4118838235735893, + 0.45756393298506737, + 0.059719379991292953, + 0.36265185102820396, + 0.16638719104230404, + 0.3522772379219532, + 0.07080024480819702, + 0.32206256687641144, + 0.0, + 0.03661462292075157, + 0.0, + 0.0, + 0.946789376437664, + 0.3429699242115021, + 0.21290313825011253, + 0.0, + 0.0, + 0.039069149643182755, + 0.09908651933073997, + 0.0, + 0.0, + 0.10465960204601288, + 0.28934773802757263, + 0.14270861446857452, + 0.0, + 0.06194879114627838, + 0.3463949002325535, + 0.21271993219852448, + 0.14735303446650505, + 0.0, + 0.033803194761276245, + 0.47567693516612053, + 0.11190555617213249, + 0.07419352233409882 + ], + "unique_experts": 46, + "load_cv": 0.9296222517045284, + "normalized_load_entropy": 0.8807546160694262, + "max_load_share": 0.05555555555555555 + }, + "full_input": { + "tokens": 49, + "top_k": 6, + "decisions": 294, + "ordered_route_sha256": "b179b88d1a1e2c7c9c20ff20c5dec8d1ac499966f50097c053d54d556a558eaf", + "route_weight_sha256": "77e266870880df53c9792141c0bbd67fcea375ebfc966cf407e7eea274a5c595", + "loads": [ + 3, + 1, + 2, + 6, + 0, + 2, + 2, + 5, + 5, + 6, + 11, + 2, + 6, + 9, + 0, + 14, + 4, + 11, + 10, + 1, + 4, + 1, + 4, + 2, + 4, + 8, + 0, + 4, + 3, + 1, + 6, + 6, + 1, + 5, + 3, + 8, + 2, + 4, + 12, + 10, + 4, + 9, + 16, + 5, + 5, + 0, + 0, + 2, + 2, + 5, + 7, + 2, + 3, + 10, + 2, + 11, + 5, + 4, + 2, + 1, + 1, + 5, + 2, + 3 + ], + "weighted_loads": [ + 0.1454363875091076, + 0.0034909851383417845, + 0.191033735871315, + 0.516582902520895, + 0.0, + 0.06824550032615662, + 0.1784362569451332, + 0.18576725851744413, + 0.3948546366300434, + 0.3714071772992611, + 0.6777390837669373, + 0.1519557163119316, + 0.41038912534713745, + 0.6355368420481682, + 0.0, + 2.1772148334421217, + 0.2541171535849571, + 0.8768076226115227, + 1.0552192218601704, + 0.013051547110080719, + 0.2126547135412693, + 0.056185364723205566, + 0.2734564710408449, + 0.16412460058927536, + 0.29754582419991493, + 0.9068775661289692, + 0.0, + 0.2528540939092636, + 0.25943827629089355, + 0.046774573624134064, + 0.4118838235735893, + 0.45756393298506737, + 0.059719379991292953, + 0.36265185102820396, + 0.16638719104230404, + 0.6641414389014244, + 0.07080024480819702, + 0.32206256687641144, + 1.2212328352034092, + 0.6790559515357018, + 0.17610961571335793, + 0.9403661601245403, + 1.7428350411355495, + 0.3820171691477299, + 0.29500217363238335, + 0.0, + 0.0, + 0.05464491154998541, + 0.09908651933073997, + 0.24389112275093794, + 0.7211072482168674, + 0.10465960204601288, + 0.9542435109615326, + 0.7381190359592438, + 0.01495483098551631, + 0.7462743520736694, + 0.3463949002325535, + 0.21271993219852448, + 0.14735303446650505, + 0.046343833208084106, + 0.033803194761276245, + 0.47567693516612053, + 0.11190555617213249, + 1.0101632475852966 + ], + "unique_experts": 59, + "load_cv": 0.7958602223077884, + "normalized_load_entropy": 0.9238387150762287, + "max_load_share": 0.05442176870748299 + } + }, + "s1_bos": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "7f3f172a0950818ed400789708651042bb5d0db9430fe9d870e34043c903241b", + "route_weight_sha256": "9e3074c6849cdb78640246a59ba6fd97c1baf538b66d0d58f3ca3d37d5321a76", + "loads": [ + 3, + 0, + 2, + 6, + 0, + 0, + 2, + 3, + 4, + 4, + 0, + 2, + 3, + 8, + 0, + 0, + 2, + 5, + 1, + 0, + 3, + 1, + 4, + 2, + 3, + 0, + 0, + 4, + 3, + 1, + 6, + 6, + 1, + 4, + 4, + 4, + 2, + 4, + 0, + 1, + 0, + 0, + 8, + 4, + 3, + 1, + 0, + 1, + 2, + 0, + 0, + 2, + 2, + 1, + 0, + 1, + 5, + 4, + 3, + 0, + 1, + 5, + 2, + 1 + ], + "weighted_loads": [ + 0.15131466835737228, + 0.0, + 0.19205909222364426, + 0.5475604794919491, + 0.0, + 0.0, + 0.18141544610261917, + 0.15422267839312553, + 0.4323720298707485, + 0.29865318536758423, + 0.0, + 0.13586284965276718, + 0.22669614106416702, + 0.597888421267271, + 0.0, + 0.0, + 0.11152690649032593, + 0.5827706828713417, + 0.05822267383337021, + 0.0, + 0.21391358971595764, + 0.050588808953762054, + 0.27551293559372425, + 0.16540436446666718, + 0.2777020186185837, + 0.0, + 0.0, + 0.2710963189601898, + 0.2548736594617367, + 0.04787403345108032, + 0.4128523878753185, + 0.4564707912504673, + 0.06244689226150513, + 0.33569520339369774, + 0.21145633049309254, + 0.34654446691274643, + 0.07212827727198601, + 0.300651416182518, + 0.0, + 0.034067317843437195, + 0.0, + 0.0, + 0.9501977749168873, + 0.3389952555298805, + 0.18398629501461983, + 0.03321436420083046, + 0.0, + 0.0414731539785862, + 0.09653850644826889, + 0.0, + 0.0, + 0.10607141628861427, + 0.30206146091222763, + 0.13470374047756195, + 0.0, + 0.06364022195339203, + 0.3538258783519268, + 0.22964497283101082, + 0.19527940079569817, + 0.0, + 0.03257907181978226, + 0.4817141033709049, + 0.1084182970225811, + 0.06790368258953094 + ], + "unique_experts": 47, + "load_cv": 0.9128709291752768, + "normalized_load_entropy": 0.885499830733905, + "max_load_share": 0.05555555555555555 + }, + "full_input": { + "tokens": 65, + "top_k": 6, + "decisions": 390, + "ordered_route_sha256": "3425a8c5b5dc2e99a2b60eefbcec661f58aa9b343496e6c0d5082df9e4f9130c", + "route_weight_sha256": "601c912fc41271075693419ec423d7e4ef76d6ca4affa90db8eca8d4dd220922", + "loads": [ + 4, + 2, + 2, + 12, + 0, + 2, + 10, + 5, + 5, + 5, + 14, + 5, + 8, + 9, + 1, + 16, + 6, + 16, + 15, + 10, + 4, + 1, + 5, + 2, + 4, + 8, + 0, + 6, + 3, + 3, + 6, + 6, + 2, + 5, + 5, + 8, + 3, + 7, + 13, + 13, + 3, + 14, + 20, + 8, + 4, + 1, + 0, + 3, + 2, + 13, + 11, + 3, + 3, + 11, + 3, + 12, + 5, + 4, + 4, + 1, + 2, + 5, + 2, + 5 + ], + "weighted_loads": [ + 0.18792401254177094, + 0.023775976849719882, + 0.19205909222364426, + 0.9609164670109749, + 0.0, + 0.07182217389345169, + 1.1607393808662891, + 0.20864275749772787, + 0.43573844246566296, + 0.3472624830901623, + 0.8500427659600973, + 0.502958133816719, + 0.6442348472774029, + 0.6379830054938793, + 0.03463760018348694, + 2.709605757612735, + 0.3773949071764946, + 1.260373417288065, + 1.4739684574306011, + 0.8453261852264404, + 0.22649121284484863, + 0.050588808953762054, + 0.3133519049733877, + 0.16540436446666718, + 0.35321322083473206, + 0.7168988175690174, + 0.0, + 0.44503866881132126, + 0.2548736594617367, + 0.1344589926302433, + 0.4128523878753185, + 0.4564707912504673, + 0.18168772757053375, + 0.37785055860877037, + 0.2457467745989561, + 0.7831293568015099, + 0.11770022660493851, + 0.4526236467063427, + 1.3528674952685833, + 1.1050744503736496, + 0.12818360701203346, + 1.3682814165949821, + 2.0332867726683617, + 0.5795349106192589, + 0.24540821835398674, + 0.03321436420083046, + 0.0, + 0.09005764406174421, + 0.09653850644826889, + 0.8152368469163775, + 1.1932789236307144, + 0.1541353315114975, + 0.9669572338461876, + 0.945997204631567, + 0.05284386733546853, + 0.7007506545633078, + 0.3538258783519268, + 0.22964497283101082, + 0.26559649780392647, + 0.04764636233448982, + 0.07810814306139946, + 0.4817141033709049, + 0.1084182970225811, + 1.2449260167777538 + ], + "unique_experts": 61, + "load_cv": 0.7602034400191587, + "normalized_load_entropy": 0.9316039499717584, + "max_load_share": 0.05128205128205128 + } + }, + "s0_x": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "7c16dfe35b6a15fa25532a50cd58a911c1b469ae86fb755d3193c7bd3290e716", + "route_weight_sha256": "886397cc89e5bf436c50d68711df3e872fb6ed8951973d52ec9308300e556182", + "loads": [ + 3, + 0, + 2, + 6, + 0, + 0, + 2, + 3, + 4, + 4, + 0, + 2, + 3, + 8, + 0, + 0, + 2, + 5, + 1, + 0, + 3, + 1, + 3, + 2, + 4, + 0, + 0, + 4, + 3, + 1, + 6, + 7, + 1, + 5, + 3, + 5, + 2, + 4, + 0, + 1, + 0, + 0, + 8, + 4, + 3, + 0, + 0, + 1, + 2, + 0, + 0, + 2, + 3, + 1, + 0, + 1, + 4, + 4, + 2, + 0, + 1, + 5, + 2, + 1 + ], + "weighted_loads": [ + 0.1480160355567932, + 0.0, + 0.18599916994571686, + 0.4954407662153244, + 0.0, + 0.0, + 0.1859075427055359, + 0.1478366181254387, + 0.36594510078430176, + 0.2836253456771374, + 0.0, + 0.15459077060222626, + 0.23291654139757156, + 0.573534470051527, + 0.0, + 0.0, + 0.10672229528427124, + 0.563805565237999, + 0.06683652848005295, + 0.0, + 0.1975455842912197, + 0.052429355680942535, + 0.23093508929014206, + 0.15564420074224472, + 0.3004821799695492, + 0.0, + 0.0, + 0.24691928550601006, + 0.271788515150547, + 0.047424424439668655, + 0.4183472543954849, + 0.5224060788750648, + 0.05867111310362816, + 0.3642176501452923, + 0.17314235493540764, + 0.37514013797044754, + 0.07136819884181023, + 0.3214961737394333, + 0.0, + 0.036962687969207764, + 0.0, + 0.0, + 0.8789583370089531, + 0.34391769021749496, + 0.17118778452277184, + 0.0, + 0.0, + 0.03901992738246918, + 0.10595391690731049, + 0.0, + 0.0, + 0.10387607291340828, + 0.3369915746152401, + 0.13057789206504822, + 0.0, + 0.06336317956447601, + 0.30214759707450867, + 0.2059930581599474, + 0.14726051315665245, + 0.0, + 0.03340911492705345, + 0.4612714536488056, + 0.1075996644794941, + 0.06914214044809341 + ], + "unique_experts": 46, + "load_cv": 0.9362388636862621, + "normalized_load_entropy": 0.8802842781567332, + "max_load_share": 0.05555555555555555 + }, + "full_input": { + "tokens": 49, + "top_k": 6, + "decisions": 294, + "ordered_route_sha256": "c313f7786970b9cc0cca20499813148172b0c0d1d0c30b621cc0b8ec9490930c", + "route_weight_sha256": "26a41609db910c8d7417b941cbdbc44fca4bc33ceba3501cb0dadd9394f40c1b", + "loads": [ + 3, + 2, + 2, + 6, + 0, + 2, + 2, + 5, + 5, + 5, + 12, + 2, + 6, + 9, + 0, + 14, + 4, + 11, + 10, + 1, + 4, + 1, + 3, + 2, + 4, + 9, + 0, + 4, + 3, + 1, + 6, + 7, + 1, + 5, + 3, + 9, + 2, + 4, + 10, + 9, + 6, + 9, + 15, + 5, + 4, + 0, + 0, + 2, + 2, + 3, + 7, + 2, + 4, + 12, + 2, + 11, + 4, + 4, + 2, + 1, + 1, + 5, + 2, + 3 + ], + "weighted_loads": [ + 0.1480160355567932, + 0.04041977669112384, + 0.18599916994571686, + 0.4954407662153244, + 0.0, + 0.06824550032615662, + 0.1859075427055359, + 0.18293057288974524, + 0.3692888261284679, + 0.3287270553410053, + 0.7922177277505398, + 0.15459077060222626, + 0.42632752656936646, + 0.612440213561058, + 0.0, + 2.354617512319237, + 0.2509589269757271, + 0.862510472536087, + 0.9524130076169968, + 0.013051547110080719, + 0.2101232074201107, + 0.052429355680942535, + 0.23093508929014206, + 0.15564420074224472, + 0.3004821799695492, + 0.9929164461791515, + 0.0, + 0.24691928550601006, + 0.271788515150547, + 0.047424424439668655, + 0.4183472543954849, + 0.5224060788750648, + 0.05867111310362816, + 0.3642176501452923, + 0.17314235493540764, + 0.6870043389499187, + 0.07136819884181023, + 0.3214961737394333, + 0.902392964810133, + 0.6699233092367649, + 0.2910389266908169, + 0.8795385658740997, + 1.5321257784962654, + 0.3802776522934437, + 0.25328681990504265, + 0.0, + 0.0, + 0.05459568928927183, + 0.10595391690731049, + 0.16550811659544706, + 0.6737964563071728, + 0.10387607291340828, + 1.0018873475492, + 0.8394929207861423, + 0.01495483098551631, + 0.8248486369848251, + 0.30214759707450867, + 0.2059930581599474, + 0.14726051315665245, + 0.046343833208084106, + 0.03340911492705345, + 0.4612714536488056, + 0.1075996644794941, + 1.0051118656992912 + ], + "unique_experts": 59, + "load_cv": 0.7949293232716838, + "normalized_load_entropy": 0.9240568719746379, + "max_load_share": 0.05102040816326531 + } + }, + "s1_x": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "8cf852d3a0243e815da798062f1ae4ff77762975426d87bbadc91b8cda81d1c5", + "route_weight_sha256": "e2de1eb7c198a304b35a75092668754c22bb2cf55ec69de04bb9b411d58d0b33", + "loads": [ + 3, + 0, + 2, + 6, + 0, + 0, + 2, + 3, + 4, + 4, + 0, + 2, + 3, + 8, + 0, + 0, + 2, + 5, + 1, + 0, + 3, + 1, + 4, + 2, + 4, + 0, + 0, + 4, + 2, + 1, + 5, + 6, + 1, + 5, + 3, + 5, + 2, + 4, + 0, + 0, + 0, + 0, + 8, + 4, + 3, + 0, + 0, + 1, + 1, + 0, + 0, + 2, + 2, + 2, + 0, + 2, + 5, + 5, + 3, + 0, + 2, + 5, + 1, + 1 + ], + "weighted_loads": [ + 0.15516507253050804, + 0.0, + 0.18878014385700226, + 0.549798633903265, + 0.0, + 0.0, + 0.17930665612220764, + 0.1606019213795662, + 0.4306132011115551, + 0.295458160340786, + 0.0, + 0.13233203813433647, + 0.22864073514938354, + 0.5906804129481316, + 0.0, + 0.0, + 0.10880956426262856, + 0.5798977538943291, + 0.05281122401356697, + 0.0, + 0.2146676406264305, + 0.046780139207839966, + 0.2948962412774563, + 0.15956677496433258, + 0.3235807791352272, + 0.0, + 0.0, + 0.27214618399739265, + 0.1999819204211235, + 0.04737090319395065, + 0.3781658746302128, + 0.45726560056209564, + 0.06151067093014717, + 0.3590278998017311, + 0.16988588124513626, + 0.37386297434568405, + 0.07071741670370102, + 0.2955130562186241, + 0.0, + 0.0, + 0.0, + 0.0, + 0.8783988617360592, + 0.3300577290356159, + 0.17999354749917984, + 0.0, + 0.0, + 0.03959653154015541, + 0.06021687760949135, + 0.0, + 0.0, + 0.1088964194059372, + 0.3083566650748253, + 0.16117070615291595, + 0.0, + 0.10572503507137299, + 0.3585423342883587, + 0.2709111012518406, + 0.1970221810042858, + 0.0, + 0.07278642430901527, + 0.46491363272070885, + 0.04897196963429451, + 0.06428007036447525 + ], + "unique_experts": 45, + "load_cv": 0.9329364235414813, + "normalized_load_entropy": 0.8783541138458764, + "max_load_share": 0.05555555555555555 + }, + "full_input": { + "tokens": 65, + "top_k": 6, + "decisions": 390, + "ordered_route_sha256": "91d8d57c19e156c865252510db691da6d301c70b991a01fb438bf73164496ae1", + "route_weight_sha256": "908148270a97c779047b47d46f320408270e8800ee5bcc8841456a2bc0923079", + "loads": [ + 4, + 2, + 2, + 12, + 0, + 2, + 10, + 5, + 5, + 5, + 15, + 5, + 8, + 8, + 1, + 16, + 6, + 16, + 15, + 10, + 4, + 1, + 5, + 2, + 5, + 9, + 0, + 6, + 2, + 3, + 5, + 6, + 2, + 7, + 4, + 10, + 3, + 7, + 10, + 12, + 4, + 13, + 19, + 8, + 4, + 0, + 0, + 3, + 1, + 13, + 9, + 3, + 3, + 14, + 3, + 13, + 5, + 5, + 4, + 1, + 3, + 6, + 1, + 5 + ], + "weighted_loads": [ + 0.1917744167149067, + 0.023775976849719882, + 0.18878014385700226, + 0.9631546214222908, + 0.0, + 0.07182217389345169, + 1.1586305908858776, + 0.21502200048416853, + 0.43397961370646954, + 0.3412504382431507, + 0.9549979660660028, + 0.49942732229828835, + 0.6696585938334465, + 0.5906804129481316, + 0.03463760018348694, + 2.895217426586896, + 0.3828994147479534, + 1.2575004883110523, + 1.3164962381124496, + 0.8453261852264404, + 0.2272452637553215, + 0.046780139207839966, + 0.33273521065711975, + 0.15956677496433258, + 0.3990919813513756, + 0.7954413332045078, + 0.0, + 0.4460885338485241, + 0.1999819204211235, + 0.13395586237311363, + 0.3781658746302128, + 0.45726560056209564, + 0.1807515062391758, + 0.44551120698451996, + 0.20417632535099983, + 0.8568668588995934, + 0.11628936603665352, + 0.4474852867424488, + 0.9899243637919426, + 1.0989441387355328, + 0.20198271051049232, + 1.2611267268657684, + 1.8413450382649899, + 0.5697234459221363, + 0.24141547083854675, + 0.0, + 0.0, + 0.08818102162331343, + 0.06021687760949135, + 0.8068795828148723, + 1.0167975313961506, + 0.15696033462882042, + 0.9732524380087852, + 1.0835513174533844, + 0.05284386733546853, + 0.8191966023296118, + 0.3585423342883587, + 0.2709111012518406, + 0.2673392780125141, + 0.04764636233448982, + 0.11831549555063248, + 0.5045676454901695, + 0.04897196963429451, + 1.2413024045526981 + ], + "unique_experts": 60, + "load_cv": 0.7596497341579079, + "normalized_load_entropy": 0.9293264118794723, + "max_load_share": 0.04871794871794872 + } + }, + "s0_period": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "5240b40e794f1b1b77f2b7dab50c1d23ed85b6d8cfec85ac2859e6e3ad835b23", + "route_weight_sha256": "a29c7d7cc5c08531973e69b5d791fffde8c2f1bcd8f207aee280654cf2396de2", + "loads": [ + 3, + 0, + 2, + 6, + 0, + 0, + 2, + 3, + 4, + 5, + 0, + 2, + 3, + 7, + 0, + 0, + 2, + 5, + 1, + 0, + 3, + 1, + 3, + 2, + 4, + 0, + 0, + 4, + 2, + 1, + 6, + 7, + 1, + 5, + 3, + 5, + 2, + 4, + 0, + 1, + 0, + 0, + 8, + 4, + 3, + 0, + 0, + 1, + 2, + 0, + 0, + 2, + 3, + 1, + 0, + 1, + 4, + 5, + 2, + 0, + 1, + 5, + 2, + 1 + ], + "weighted_loads": [ + 0.1516997031867504, + 0.0, + 0.18186131119728088, + 0.5074534453451633, + 0.0, + 0.0, + 0.18375127017498016, + 0.1499100998044014, + 0.37672070413827896, + 0.33112911880016327, + 0.0, + 0.15115688741207123, + 0.2339957281947136, + 0.5246029943227768, + 0.0, + 0.0, + 0.10764002799987793, + 0.548614539206028, + 0.06397497653961182, + 0.0, + 0.2076297253370285, + 0.05073381960391998, + 0.23044715262949467, + 0.15394756197929382, + 0.30675626546144485, + 0.0, + 0.0, + 0.2514951266348362, + 0.21925395354628563, + 0.0482422299683094, + 0.41417859867215157, + 0.5373693853616714, + 0.059119272977113724, + 0.3674139454960823, + 0.17098231427371502, + 0.3633022718131542, + 0.0723535381257534, + 0.3118327781558037, + 0.0, + 0.03574604168534279, + 0.0, + 0.0, + 0.9011185765266418, + 0.34384679049253464, + 0.1835736595094204, + 0.0, + 0.0, + 0.03993057459592819, + 0.10399923473596573, + 0.0, + 0.0, + 0.1028214804828167, + 0.34875689819455147, + 0.12964628636837006, + 0.0, + 0.06238389387726784, + 0.30245985835790634, + 0.2641763836145401, + 0.1478630267083645, + 0.0, + 0.033774252980947495, + 0.4705899879336357, + 0.1066560298204422, + 0.0729256346821785 + ], + "unique_experts": 46, + "load_cv": 0.9329364235414813, + "normalized_load_entropy": 0.8801501602156296, + "max_load_share": 0.05555555555555555 + }, + "full_input": { + "tokens": 49, + "top_k": 6, + "decisions": 294, + "ordered_route_sha256": "0d0eee3f60f7b76a0d11e792cd805f8ce2ebe1d05c7d19a879a71b0997f75d84", + "route_weight_sha256": "c1bc87afe0c92ffa6508fd16a868c5a73334357e8970d22cfa61a41ac44716b9", + "loads": [ + 3, + 2, + 2, + 6, + 0, + 2, + 2, + 5, + 5, + 6, + 12, + 2, + 6, + 8, + 0, + 14, + 4, + 12, + 10, + 1, + 4, + 1, + 3, + 2, + 4, + 8, + 0, + 4, + 2, + 1, + 6, + 7, + 1, + 5, + 3, + 10, + 2, + 4, + 10, + 9, + 6, + 9, + 15, + 5, + 5, + 0, + 0, + 2, + 2, + 3, + 7, + 2, + 4, + 10, + 2, + 11, + 4, + 5, + 2, + 1, + 1, + 5, + 2, + 3 + ], + "weighted_loads": [ + 0.1516997031867504, + 0.04165887529961765, + 0.18186131119728088, + 0.5074534453451633, + 0.0, + 0.06824550032615662, + 0.18375127017498016, + 0.18500405456870794, + 0.3800644294824451, + 0.3764161206781864, + 0.7776019722223282, + 0.15115688741207123, + 0.4293026886880398, + 0.5636617429554462, + 0.0, + 2.18176236608997, + 0.25174277275800705, + 0.9046812132000923, + 0.8906455300748348, + 0.013051547110080719, + 0.2202073484659195, + 0.05073381960391998, + 0.23044715262949467, + 0.15394756197929382, + 0.30675626546144485, + 0.9068775661289692, + 0.0, + 0.2514951266348362, + 0.21925395354628563, + 0.0482422299683094, + 0.41417859867215157, + 0.5373693853616714, + 0.059119272977113724, + 0.3674139454960823, + 0.17098231427371502, + 0.7211434319615364, + 0.0723535381257534, + 0.3118327781558037, + 0.8713850863277912, + 0.6759917326271534, + 0.27147743105888367, + 0.9139805063605309, + 1.5629025362432003, + 0.38140327483415604, + 0.31807394325733185, + 0.0, + 0.0, + 0.055506336502730846, + 0.10399923473596573, + 0.15606227796524763, + 0.6894484870135784, + 0.1028214804828167, + 1.0136526711285114, + 0.7250567078590393, + 0.01495483098551631, + 0.9530865214765072, + 0.30245985835790634, + 0.2641763836145401, + 0.1478630267083645, + 0.046343833208084106, + 0.033774252980947495, + 0.4705899879336357, + 0.1066560298204422, + 1.0088953599333763 + ], + "unique_experts": 59, + "load_cv": 0.789320874086974, + "normalized_load_entropy": 0.9245322874902872, + "max_load_share": 0.05102040816326531 + } + }, + "s1_period": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "acd44986c1f13a67e0150b5fb7cb840d1f2b24d930c1c60526e9f7edcafc31d3", + "route_weight_sha256": "34fd606e752be4b79796921fc9ff71922ba31243664872b59fe6352f7265d7bb", + "loads": [ + 4, + 0, + 2, + 6, + 0, + 0, + 2, + 3, + 4, + 4, + 0, + 2, + 3, + 8, + 0, + 0, + 2, + 5, + 1, + 0, + 3, + 1, + 4, + 2, + 4, + 0, + 0, + 4, + 2, + 1, + 5, + 7, + 1, + 5, + 3, + 5, + 1, + 4, + 0, + 0, + 0, + 0, + 8, + 4, + 3, + 0, + 0, + 1, + 1, + 0, + 0, + 2, + 2, + 2, + 0, + 1, + 4, + 5, + 3, + 0, + 2, + 5, + 2, + 1 + ], + "weighted_loads": [ + 0.19985001906752586, + 0.0, + 0.1870480328798294, + 0.5641696788370609, + 0.0, + 0.0, + 0.17628301680088043, + 0.16080745682120323, + 0.43826722353696823, + 0.29833725094795227, + 0.0, + 0.13140177726745605, + 0.2300235852599144, + 0.5975150465965271, + 0.0, + 0.0, + 0.10854119434952736, + 0.57178895175457, + 0.04974425584077835, + 0.0, + 0.22343242913484573, + 0.04932323470711708, + 0.274464700371027, + 0.15887560695409775, + 0.3253266364336014, + 0.0, + 0.0, + 0.27914755046367645, + 0.20055462047457695, + 0.04856664314866066, + 0.3762473911046982, + 0.521282434463501, + 0.060880135744810104, + 0.3608436770737171, + 0.17698605172336102, + 0.3615952469408512, + 0.03320326283574104, + 0.2948433943092823, + 0.0, + 0.0, + 0.0, + 0.0, + 0.8923433646559715, + 0.33049722388386726, + 0.18075096234679222, + 0.0, + 0.0, + 0.03989987447857857, + 0.0589001327753067, + 0.0, + 0.0, + 0.10761155188083649, + 0.31699585169553757, + 0.1608053706586361, + 0.0, + 0.06716646254062653, + 0.3098427802324295, + 0.2709094025194645, + 0.19877367839217186, + 0.0, + 0.073215302079916, + 0.47193439304828644, + 0.10371766611933708, + 0.06684096157550812 + ], + "unique_experts": 45, + "load_cv": 0.9460770203292446, + "normalized_load_entropy": 0.876297190844168, + "max_load_share": 0.05555555555555555 + }, + "full_input": { + "tokens": 65, + "top_k": 6, + "decisions": 390, + "ordered_route_sha256": "4ee62881c676d56fed804c9f9cf6afd6a5bf758c6adc5689a76766f6d211617f", + "route_weight_sha256": "bf66d8c54c5eddd33cb7ca164d7f89a3b3eca078d45ba8400745cb8235ae1b3f", + "loads": [ + 5, + 2, + 2, + 12, + 0, + 3, + 10, + 5, + 5, + 5, + 15, + 5, + 8, + 8, + 1, + 17, + 6, + 17, + 14, + 10, + 4, + 1, + 5, + 2, + 5, + 8, + 0, + 6, + 2, + 3, + 5, + 7, + 2, + 6, + 4, + 10, + 2, + 7, + 10, + 12, + 4, + 14, + 19, + 8, + 5, + 0, + 0, + 3, + 1, + 13, + 9, + 3, + 3, + 12, + 3, + 12, + 4, + 5, + 4, + 1, + 3, + 6, + 2, + 5 + ], + "weighted_loads": [ + 0.23645936325192451, + 0.023775976849719882, + 0.1870480328798294, + 0.9775256663560867, + 0.0, + 0.11585643142461777, + 1.1556069515645504, + 0.21522753592580557, + 0.44163363613188267, + 0.3438543900847435, + 0.9671746511012316, + 0.49849706143140793, + 0.6712170802056789, + 0.5975150465965271, + 0.03463760018348694, + 2.776592266280204, + 0.4049034081399441, + 1.2915718257427216, + 1.230358213186264, + 0.8453261852264404, + 0.23601005226373672, + 0.04932323470711708, + 0.31230366975069046, + 0.15887560695409775, + 0.40083783864974976, + 0.7168988175690174, + 0.0, + 0.4530899003148079, + 0.20055462047457695, + 0.13515160232782364, + 0.3762473911046982, + 0.521282434463501, + 0.18012097105383873, + 0.40299903228878975, + 0.2112764958292246, + 0.8788349516689777, + 0.07877521216869354, + 0.446815624833107, + 0.9520309269428253, + 1.1047240756452084, + 0.17897993698716164, + 1.3736528232693672, + 1.8616845272481441, + 0.5707810893654823, + 0.2871314473450184, + 0.0, + 0.0, + 0.08848436456173658, + 0.0589001327753067, + 0.7975518954917789, + 1.0309435613453388, + 0.1556754671037197, + 0.9818916246294975, + 0.9720988348126411, + 0.05284386733546853, + 0.8654565829783678, + 0.3098427802324295, + 0.2709094025194645, + 0.26909077540040016, + 0.04764636233448982, + 0.1187443733215332, + 0.5126315169036388, + 0.10371766611933708, + 1.243863295763731 + ], + "unique_experts": 60, + "load_cv": 0.754648099519994, + "normalized_load_entropy": 0.9307873822280683, + "max_load_share": 0.04871794871794872 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 24, + "ordered_topk_exact_tokens": 17, + "set_exact_tokens": 21, + "mean_set_jaccard": 0.9642857142857144, + "mean_token_weighted_tv": 0.01007405947893858, + "aggregate_load_tv": 0.020833333333333332 + }, + "system_bos": { + "tokens": 24, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 21, + "mean_set_jaccard": 0.9642857142857144, + "mean_token_weighted_tv": 0.014594232430681586, + "aggregate_load_tv": 0.020833333333333336 + }, + "system_x": { + "tokens": 24, + "ordered_topk_exact_tokens": 17, + "set_exact_tokens": 18, + "mean_set_jaccard": 0.9196428571428571, + "mean_token_weighted_tv": 0.02631265720507751, + "aggregate_load_tv": 0.04861111111111112 + }, + "system_period": { + "tokens": 24, + "ordered_topk_exact_tokens": 17, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.9315476190476192, + "mean_token_weighted_tv": 0.023266273822324973, + "aggregate_load_tv": 0.041666666666666664 + }, + "bos_at_s0": { + "tokens": 24, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.8958333333333334, + "mean_token_weighted_tv": 0.031146605188647907, + "aggregate_load_tv": 0.0625 + }, + "bos_at_s1": { + "tokens": 24, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.9315476190476192, + "mean_token_weighted_tv": 0.027936793786163133, + "aggregate_load_tv": 0.034722222222222224 + }, + "x_at_s0": { + "tokens": 24, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.9077380952380952, + "mean_token_weighted_tv": 0.03180272663788249, + "aggregate_load_tv": 0.04861111111111112 + }, + "x_at_s1": { + "tokens": 24, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.8928571428571428, + "mean_token_weighted_tv": 0.03647441122060021, + "aggregate_load_tv": 0.05555555555555555 + }, + "period_at_s0": { + "tokens": 24, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 18, + "mean_set_jaccard": 0.9196428571428573, + "mean_token_weighted_tv": 0.02875854951950411, + "aggregate_load_tv": 0.04166666666666667 + }, + "period_at_s1": { + "tokens": 24, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8809523809523809, + "mean_token_weighted_tv": 0.03901335996730874, + "aggregate_load_tv": 0.055555555555555566 + } + } + }, + "layer_06": { + "layer": 6, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "652b1030b0e688c6256815e51dcc417517aba3193d8790d9f835b865568fe83f", + "route_weight_sha256": "0163d02473e541b1869af090c896c4859cdad988c2cb9709607809e7cd32fb45", + "loads": [ + 3, + 0, + 1, + 4, + 0, + 3, + 3, + 5, + 2, + 0, + 1, + 1, + 4, + 3, + 1, + 0, + 4, + 0, + 5, + 1, + 0, + 4, + 2, + 1, + 6, + 0, + 8, + 6, + 0, + 3, + 3, + 1, + 1, + 3, + 2, + 0, + 0, + 0, + 1, + 1, + 1, + 6, + 0, + 4, + 3, + 1, + 2, + 1, + 1, + 1, + 0, + 0, + 6, + 6, + 1, + 1, + 4, + 5, + 2, + 2, + 5, + 2, + 3, + 4 + ], + "weighted_loads": [ + 0.19278085976839066, + 0.0, + 0.0845656618475914, + 0.2253047525882721, + 0.0, + 0.16261157393455505, + 0.1374039500951767, + 0.33260225504636765, + 0.12208856269717216, + 0.0, + 0.13678117096424103, + 0.05364455282688141, + 0.354097343981266, + 0.13872040435671806, + 0.06334996223449707, + 0.0, + 0.3366363123059273, + 0.0, + 0.37956686690449715, + 0.0342787429690361, + 0.0, + 0.32985544949769974, + 0.3558668941259384, + 0.059012264013290405, + 0.38533657044172287, + 0.0, + 0.6303210817277431, + 0.8410998657345772, + 0.0, + 0.25183218717575073, + 0.20949069410562515, + 0.06639192998409271, + 0.038531918078660965, + 0.22520985454320908, + 0.28984786570072174, + 0.0, + 0.0, + 0.0, + 0.08274121582508087, + 0.0397929847240448, + 0.06285284459590912, + 0.49978800117969513, + 0.0, + 0.21403007581830025, + 0.1665085144340992, + 0.03182348608970642, + 0.08294066414237022, + 0.0715043693780899, + 0.08383382111787796, + 0.03791607543826103, + 0.0, + 0.0, + 0.3457573167979717, + 0.3552189990878105, + 0.0584588348865509, + 0.06994597613811493, + 0.4564117342233658, + 0.2398415394127369, + 0.18835172802209854, + 0.1913331001996994, + 0.2808769568800926, + 0.25487954169511795, + 0.16481681913137436, + 0.3007434792816639 + ], + "unique_experts": 50, + "load_cv": 0.8923543557893895, + "normalized_load_entropy": 0.8931571478806019, + "max_load_share": 0.05555555555555555 + }, + "full_input": { + "tokens": 49, + "top_k": 6, + "decisions": 294, + "ordered_route_sha256": "6d87ca608f385bea6bb979a2e6d51d65c52062d6252d95484aff5093a81a842a", + "route_weight_sha256": "294dfc1d4d382de9e5a07153ddf9acdea9767b937a7a3a7246d6f09ad481147b", + "loads": [ + 3, + 3, + 1, + 4, + 1, + 3, + 11, + 5, + 2, + 0, + 1, + 7, + 4, + 6, + 3, + 0, + 9, + 1, + 5, + 9, + 1, + 7, + 5, + 2, + 6, + 1, + 8, + 6, + 0, + 6, + 3, + 1, + 4, + 3, + 3, + 6, + 0, + 8, + 1, + 10, + 1, + 11, + 2, + 4, + 3, + 6, + 14, + 3, + 5, + 1, + 8, + 7, + 6, + 6, + 1, + 11, + 14, + 5, + 2, + 11, + 5, + 2, + 3, + 4 + ], + "weighted_loads": [ + 0.19278085976839066, + 0.07085182005539536, + 0.0845656618475914, + 0.2253047525882721, + 0.0288657546043396, + 0.16261157393455505, + 0.9978795647621155, + 0.33260225504636765, + 0.12208856269717216, + 0.0, + 0.13678117096424103, + 0.40048685297369957, + 0.354097343981266, + 0.21311684790998697, + 0.1943485178053379, + 0.0, + 0.6349223777651787, + 0.004042807500809431, + 0.37956686690449715, + 0.5235530100762844, + 0.043942950665950775, + 0.5132701192051172, + 1.8793956898152828, + 0.09477949142456055, + 0.38533657044172287, + 0.02799288183450699, + 0.6303210817277431, + 0.8410998657345772, + 0.0, + 0.42567115277051926, + 0.20949069410562515, + 0.06639192998409271, + 0.1829596348106861, + 0.22520985454320908, + 0.32455866038799286, + 0.5511638261377811, + 0.0, + 0.7609120160341263, + 0.08274121582508087, + 0.40516705997288227, + 0.06285284459590912, + 0.8964472375810146, + 0.057954564690589905, + 0.21403007581830025, + 0.1665085144340992, + 0.16682139225304127, + 1.7549393121153116, + 0.09380540042184293, + 0.2953656818717718, + 0.03791607543826103, + 0.4827308841049671, + 0.3081264980137348, + 0.3457573167979717, + 0.3552189990878105, + 0.0584588348865509, + 0.833302017301321, + 1.825181756168604, + 0.2398415394127369, + 0.18835172802209854, + 1.1529813632369041, + 0.2808769568800926, + 0.25487954169511795, + 0.16481681913137436, + 0.3007434792816639 + ], + "unique_experts": 60, + "load_cv": 0.752831052091809, + "normalized_load_entropy": 0.92934548645313, + "max_load_share": 0.047619047619047616 + } + }, + "s1_eos": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "c222c9e8576341bd12db71a2bc8b20328888ee84463fe1d9c34b1cdbae2a1f9c", + "route_weight_sha256": "17e6f208dad9e9c0f15819217f760bb84f0ce076be893feb4b161509e6c670c7", + "loads": [ + 3, + 0, + 1, + 3, + 0, + 3, + 1, + 5, + 2, + 0, + 1, + 1, + 4, + 4, + 1, + 0, + 4, + 0, + 5, + 2, + 0, + 3, + 2, + 1, + 6, + 0, + 8, + 6, + 0, + 3, + 4, + 1, + 1, + 3, + 2, + 0, + 0, + 1, + 1, + 1, + 1, + 6, + 0, + 4, + 3, + 1, + 2, + 1, + 1, + 1, + 0, + 0, + 6, + 6, + 1, + 1, + 4, + 5, + 2, + 2, + 5, + 2, + 3, + 4 + ], + "weighted_loads": [ + 0.19027255102992058, + 0.0, + 0.08501339703798294, + 0.1894088238477707, + 0.0, + 0.16439155116677284, + 0.06666991859674454, + 0.328675240278244, + 0.11815758794546127, + 0.0, + 0.132966548204422, + 0.05246037617325783, + 0.35730551183223724, + 0.17193865403532982, + 0.06391157954931259, + 0.0, + 0.3372215963900089, + 0.0, + 0.38502034172415733, + 0.07401473820209503, + 0.0, + 0.2774880900979042, + 0.37141140550374985, + 0.05310467258095741, + 0.38960837200284004, + 0.0, + 0.627800177782774, + 0.8634031116962433, + 0.0, + 0.24387357756495476, + 0.25784456729888916, + 0.06697990745306015, + 0.039055511355400085, + 0.23743652552366257, + 0.2896921634674072, + 0.0, + 0.0, + 0.02782629057765007, + 0.08852493017911911, + 0.038709718734025955, + 0.06226928532123566, + 0.48829569295048714, + 0.0, + 0.21056538820266724, + 0.15984589979052544, + 0.032112788408994675, + 0.08061400055885315, + 0.07597779482603073, + 0.0867217630147934, + 0.04171307384967804, + 0.0, + 0.0, + 0.3436366096138954, + 0.35540302097797394, + 0.05762353539466858, + 0.07003659009933472, + 0.4377085790038109, + 0.2529681473970413, + 0.1813500002026558, + 0.1910361647605896, + 0.2702707387506962, + 0.25580552965402603, + 0.16417241096496582, + 0.29533813148736954 + ], + "unique_experts": 51, + "load_cv": 0.8854098583616238, + "normalized_load_entropy": 0.8963456750821799, + "max_load_share": 0.05555555555555555 + }, + "full_input": { + "tokens": 65, + "top_k": 6, + "decisions": 390, + "ordered_route_sha256": "8edb90b40567f85aa0ccea2620657c3ae167301c9e2060d040d0eb0e6212224a", + "route_weight_sha256": "3f6a1f910a3fb0688fe101c6ac40353717e02c37e46b8f2ed67bb53b344a55b1", + "loads": [ + 3, + 2, + 4, + 4, + 2, + 3, + 15, + 6, + 7, + 6, + 1, + 11, + 8, + 7, + 10, + 1, + 14, + 1, + 7, + 12, + 2, + 7, + 4, + 2, + 7, + 1, + 8, + 7, + 1, + 6, + 4, + 4, + 8, + 4, + 6, + 8, + 1, + 17, + 1, + 10, + 1, + 11, + 2, + 4, + 4, + 5, + 18, + 3, + 4, + 1, + 9, + 6, + 7, + 9, + 1, + 12, + 21, + 5, + 2, + 13, + 11, + 2, + 3, + 4 + ], + "weighted_loads": [ + 0.19027255102992058, + 0.0396796097047627, + 0.22752774134278297, + 0.22684437781572342, + 0.1519274339079857, + 0.16439155116677284, + 1.2971149738878012, + 0.38994045555591583, + 0.457288708537817, + 0.7040250450372696, + 0.132966548204422, + 0.6639356799423695, + 0.6868886388838291, + 0.24647402297705412, + 0.7322382926940918, + 0.11140228062868118, + 1.0649195723235607, + 0.004074265714734793, + 0.5326217785477638, + 0.772006381303072, + 0.09288572147488594, + 0.5360255893319845, + 1.8649690970778465, + 0.08836660161614418, + 0.42210930958390236, + 0.035363126546144485, + 0.627800177782774, + 0.8899676185101271, + 0.03687845170497894, + 0.44440484791994095, + 0.25784456729888916, + 0.26537784934043884, + 0.31244777515530586, + 0.27122460678219795, + 0.5476239994168282, + 0.7733068987727165, + 0.03451807051897049, + 1.372648250311613, + 0.08852493017911911, + 0.5155624821782112, + 0.06226928532123566, + 0.9022159241139889, + 0.05796252191066742, + 0.21056538820266724, + 0.24435822293162346, + 0.13103002402931452, + 2.0822842437773943, + 0.09833074221387506, + 0.25988346338272095, + 0.04171307384967804, + 0.5788817293941975, + 0.24009498208761215, + 0.38056882470846176, + 0.5231035649776459, + 0.05762353539466858, + 1.0824394710361958, + 2.449152272194624, + 0.2529681473970413, + 0.1813500002026558, + 1.2434692066162825, + 0.5770043917000294, + 0.25580552965402603, + 0.16417241096496582, + 0.29533813148736954 + ], + "unique_experts": 64, + "load_cv": 0.751855036596302, + "normalized_load_entropy": 0.9354773254111011, + "max_load_share": 0.05384615384615385 + } + }, + "s0_bos": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "5cfff0d06eef0c86336955702900a97e7a80f99f45bec1737c36eb8d70b04ba7", + "route_weight_sha256": "a49095f53ea624f19c3b552d2590fff5a7f06b8efcb084bd89cada01a741fb75", + "loads": [ + 3, + 0, + 1, + 4, + 0, + 3, + 2, + 5, + 2, + 0, + 1, + 2, + 4, + 2, + 1, + 0, + 4, + 0, + 5, + 2, + 0, + 3, + 2, + 0, + 6, + 0, + 8, + 6, + 0, + 4, + 4, + 1, + 1, + 3, + 2, + 0, + 0, + 0, + 1, + 1, + 1, + 6, + 0, + 4, + 4, + 1, + 1, + 1, + 1, + 1, + 0, + 0, + 4, + 7, + 1, + 1, + 4, + 5, + 2, + 2, + 5, + 2, + 5, + 3 + ], + "weighted_loads": [ + 0.19150133430957794, + 0.0, + 0.08359543234109879, + 0.23574040457606316, + 0.0, + 0.15696162730455399, + 0.12747463211417198, + 0.32469920441508293, + 0.11830664053559303, + 0.0, + 0.12937425076961517, + 0.08298167027533054, + 0.3555898144841194, + 0.08816110715270042, + 0.05774013325572014, + 0.0, + 0.32882581651210785, + 0.0, + 0.3967580683529377, + 0.08140284195542336, + 0.0, + 0.283129058778286, + 0.3473562076687813, + 0.0, + 0.386710524559021, + 0.0, + 0.6548822857439518, + 0.8380776941776276, + 0.0, + 0.2440168261528015, + 0.2722131423652172, + 0.07818499207496643, + 0.03883005678653717, + 0.22172889113426208, + 0.289914608001709, + 0.0, + 0.0, + 0.0, + 0.0840226262807846, + 0.043732549995183945, + 0.05961781367659569, + 0.4740346670150757, + 0.0, + 0.22276534140110016, + 0.2005692943930626, + 0.03513047471642494, + 0.04276731237769127, + 0.0765417292714119, + 0.09896521270275116, + 0.030336514115333557, + 0.0, + 0.0, + 0.2444683574140072, + 0.418260395526886, + 0.06498517096042633, + 0.06514593958854675, + 0.42162300646305084, + 0.2544141039252281, + 0.17177703231573105, + 0.17908605188131332, + 0.28170010820031166, + 0.28132957965135574, + 0.2409838456660509, + 0.2547607570886612 + ], + "unique_experts": 49, + "load_cv": 0.9060836905722272, + "normalized_load_entropy": 0.8894279523811431, + "max_load_share": 0.05555555555555555 + }, + "full_input": { + "tokens": 49, + "top_k": 6, + "decisions": 294, + "ordered_route_sha256": "5dcb3a42068ca74d6a5b43d977853ef24c3cac9326161d5e38e8bd309211cbfb", + "route_weight_sha256": "286f48db17b16a9391040faccaa46b272dd6bf6fb38b376a5845b4a6fb641554", + "loads": [ + 3, + 2, + 1, + 4, + 1, + 3, + 10, + 5, + 2, + 0, + 1, + 8, + 4, + 4, + 4, + 1, + 10, + 0, + 5, + 10, + 1, + 6, + 4, + 1, + 6, + 1, + 8, + 6, + 0, + 8, + 4, + 1, + 4, + 3, + 3, + 6, + 0, + 9, + 1, + 10, + 1, + 11, + 3, + 4, + 4, + 5, + 14, + 2, + 5, + 1, + 7, + 7, + 4, + 7, + 1, + 11, + 14, + 5, + 2, + 11, + 5, + 2, + 5, + 3 + ], + "weighted_loads": [ + 0.19150133430957794, + 0.0661397110670805, + 0.08359543234109879, + 0.23574040457606316, + 0.0288657546043396, + 0.15696162730455399, + 1.087606206536293, + 0.32469920441508293, + 0.11830664053559303, + 0.0, + 0.12937425076961517, + 0.45170644111931324, + 0.3555898144841194, + 0.1614004336297512, + 0.24834845960140228, + 0.046369317919015884, + 0.6833031922578812, + 0.0, + 0.3967580683529377, + 0.5689587369561195, + 0.043942950665950775, + 0.460360387340188, + 0.9229316599667072, + 0.03576722741127014, + 0.386710524559021, + 0.02799288183450699, + 0.6548822857439518, + 0.8380776941776276, + 0.0, + 0.47067907452583313, + 0.2722131423652172, + 0.07818499207496643, + 0.18450532853603363, + 0.22172889113426208, + 0.3246254026889801, + 0.563527874648571, + 0.0, + 0.8002558685839176, + 0.0840226262807846, + 0.405227767303586, + 0.05961781367659569, + 0.8706939034163952, + 0.1046210303902626, + 0.22276534140110016, + 0.2005692943930626, + 0.16610783338546753, + 1.8075466956943274, + 0.09560101851820946, + 0.31706651486456394, + 0.030336514115333557, + 0.4923129975795746, + 0.3081264980137348, + 0.2444683574140072, + 0.418260395526886, + 0.06498517096042633, + 0.8285019807517529, + 1.7847654446959496, + 0.2544141039252281, + 0.17177703231573105, + 1.140734314918518, + 0.28170010820031166, + 0.28132957965135574, + 0.2409838456660509, + 0.2547607570886612 + ], + "unique_experts": 60, + "load_cv": 0.7645423248252282, + "normalized_load_entropy": 0.9272900666815286, + "max_load_share": 0.047619047619047616 + } + }, + "s1_bos": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "469a8cdd9bb5e3051a4e0ad4a398a9bbb2b99adace05da90e99cb837adb7c9bf", + "route_weight_sha256": "c4da106da290b15557b8e22a97bccedc50dc1a457d0cc5a79fe8fd0e9f5a8199", + "loads": [ + 3, + 0, + 1, + 4, + 0, + 3, + 2, + 5, + 2, + 0, + 1, + 1, + 4, + 3, + 1, + 0, + 4, + 0, + 5, + 1, + 0, + 3, + 2, + 0, + 6, + 0, + 9, + 6, + 0, + 3, + 4, + 1, + 1, + 3, + 2, + 0, + 0, + 0, + 1, + 1, + 1, + 6, + 0, + 4, + 4, + 1, + 0, + 1, + 1, + 1, + 1, + 0, + 5, + 6, + 1, + 1, + 4, + 5, + 2, + 2, + 5, + 3, + 5, + 3 + ], + "weighted_loads": [ + 0.18953720480203629, + 0.0, + 0.08296995609998703, + 0.2352139949798584, + 0.0, + 0.1594277173280716, + 0.11580511927604675, + 0.33049509674310684, + 0.12233872711658478, + 0.0, + 0.1288154125213623, + 0.05616576597094536, + 0.3661908209323883, + 0.13483716174960136, + 0.05854952707886696, + 0.0, + 0.33177856355905533, + 0.0, + 0.4103801026940346, + 0.03579902648925781, + 0.0, + 0.2813573032617569, + 0.3955310136079788, + 0.0, + 0.3807942382991314, + 0.0, + 0.7081554308533669, + 0.8527740053832531, + 0.0, + 0.2080015130341053, + 0.2636939138174057, + 0.07673783600330353, + 0.04310594126582146, + 0.23199956491589546, + 0.29219649732112885, + 0.0, + 0.0, + 0.0, + 0.0885837972164154, + 0.04423551633954048, + 0.05990296229720116, + 0.47273462265729904, + 0.0, + 0.22161713242530823, + 0.19807054474949837, + 0.03825978934764862, + 0.0, + 0.07745330780744553, + 0.09835168719291687, + 0.032255273312330246, + 0.04115850850939751, + 0.0, + 0.2887555733323097, + 0.3579203896224499, + 0.06581620872020721, + 0.06438980996608734, + 0.39546962082386017, + 0.25894471630454063, + 0.17539501190185547, + 0.17576555162668228, + 0.2692579850554466, + 0.28669016622006893, + 0.24569339491426945, + 0.2474728710949421 + ], + "unique_experts": 49, + "load_cv": 0.9229582069908973, + "normalized_load_entropy": 0.8868099911035601, + "max_load_share": 0.0625 + }, + "full_input": { + "tokens": 65, + "top_k": 6, + "decisions": 390, + "ordered_route_sha256": "eebef431644145ac3d116e73376766ccf47da02ab2c3799828efcbdce5664f02", + "route_weight_sha256": "49fa7a5a1d101e170746ab5fb0b61ce7957cd32567b8c611b47b278fe6fe921d", + "loads": [ + 3, + 1, + 4, + 5, + 2, + 3, + 17, + 6, + 7, + 6, + 1, + 11, + 8, + 5, + 10, + 2, + 15, + 0, + 7, + 11, + 2, + 7, + 3, + 1, + 7, + 1, + 9, + 7, + 1, + 6, + 4, + 4, + 8, + 4, + 6, + 8, + 1, + 17, + 1, + 10, + 1, + 11, + 2, + 4, + 5, + 4, + 17, + 3, + 4, + 1, + 10, + 6, + 6, + 9, + 1, + 12, + 21, + 5, + 2, + 13, + 11, + 3, + 5, + 3 + ], + "weighted_loads": [ + 0.18953720480203629, + 0.034923870116472244, + 0.22548430040478706, + 0.2726495489478111, + 0.1519274339079857, + 0.1594277173280716, + 1.4210175443440676, + 0.39176031202077866, + 0.4614698477089405, + 0.7040250450372696, + 0.1288154125213623, + 0.700882226228714, + 0.6957739479839802, + 0.20547927916049957, + 0.7434190139174461, + 0.16334665939211845, + 1.1216931268572807, + 0.0, + 0.5579815395176411, + 0.7305906787514687, + 0.09288572147488594, + 0.5320796277374029, + 0.9432968646287918, + 0.03526192903518677, + 0.4132951758801937, + 0.035363126546144485, + 0.7081554308533669, + 0.8793385121971369, + 0.03687845170497894, + 0.4137415289878845, + 0.2636939138174057, + 0.2751357778906822, + 0.3175147958099842, + 0.26578764617443085, + 0.5501283332705498, + 0.7967908605933189, + 0.03451807051897049, + 1.3911055773496628, + 0.0885837972164154, + 0.5210882797837257, + 0.05990296229720116, + 0.8866548538208008, + 0.05796252191066742, + 0.22161713242530823, + 0.2825828678905964, + 0.1333931814879179, + 2.094744997099042, + 0.15360301360487938, + 0.28857142850756645, + 0.032255273312330246, + 0.6769023202359676, + 0.24009498208761215, + 0.32568778842687607, + 0.5256209336221218, + 0.06581620872020721, + 1.0767926909029484, + 2.4437297098338604, + 0.25894471630454063, + 0.17539501190185547, + 1.2281985934823751, + 0.5759916380047798, + 0.28669016622006893, + 0.24569339491426945, + 0.2474728710949421 + ], + "unique_experts": 63, + "load_cv": 0.7646186520764594, + "normalized_load_entropy": 0.932310189113609, + "max_load_share": 0.05384615384615385 + } + }, + "s0_x": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "4c0fa4f12dddb71cc1acc4a6951d8a6025abf06891a5dc3f34bb467c2cb0467c", + "route_weight_sha256": "4add8cd453e0982d05e07ade17da5f7ec1e28ed503aa3a24dd70f8d33d6d6065", + "loads": [ + 3, + 0, + 1, + 5, + 0, + 2, + 2, + 5, + 3, + 0, + 1, + 1, + 4, + 2, + 1, + 0, + 4, + 0, + 4, + 2, + 0, + 3, + 2, + 0, + 6, + 0, + 9, + 6, + 0, + 3, + 4, + 1, + 1, + 3, + 2, + 0, + 0, + 1, + 1, + 1, + 1, + 6, + 0, + 5, + 4, + 0, + 0, + 1, + 1, + 1, + 1, + 0, + 5, + 5, + 1, + 2, + 4, + 5, + 2, + 2, + 5, + 2, + 5, + 3 + ], + "weighted_loads": [ + 0.1893651857972145, + 0.0, + 0.0809597596526146, + 0.2645016089081764, + 0.0, + 0.11065806448459625, + 0.1475507691502571, + 0.32394884526729584, + 0.16474217548966408, + 0.0, + 0.13061805069446564, + 0.05954072251915932, + 0.341481514275074, + 0.08314874023199081, + 0.05783352255821228, + 0.0, + 0.32836349681019783, + 0.0, + 0.33880162984132767, + 0.09360231086611748, + 0.0, + 0.28870413452386856, + 0.3896864131093025, + 0.0, + 0.39863740280270576, + 0.0, + 0.6851786375045776, + 0.7877007462084293, + 0.0, + 0.23016709461808205, + 0.25226449221372604, + 0.07248039543628693, + 0.03914334997534752, + 0.2063225507736206, + 0.2867184281349182, + 0.0, + 0.0, + 0.027682414278388023, + 0.07617286592721939, + 0.04559532180428505, + 0.06186000630259514, + 0.46646641194820404, + 0.0, + 0.2562532462179661, + 0.19813772663474083, + 0.0, + 0.0, + 0.06372294574975967, + 0.09523660689592361, + 0.032619863748550415, + 0.04144546762108803, + 0.0, + 0.2813178822398186, + 0.30277159810066223, + 0.06645458191633224, + 0.11362801492214203, + 0.4293857663869858, + 0.24347032979130745, + 0.17388484627008438, + 0.18477270752191544, + 0.2732580304145813, + 0.27413755655288696, + 0.2351770233362913, + 0.2534801661968231 + ], + "unique_experts": 49, + "load_cv": 0.9128709291752768, + "normalized_load_entropy": 0.888893635848676, + "max_load_share": 0.0625 + }, + "full_input": { + "tokens": 49, + "top_k": 6, + "decisions": 294, + "ordered_route_sha256": "c451f1bb4fd4fdd7bd026af3bf7f72bb42a0fda8d90e8ce9032b5a397c736989", + "route_weight_sha256": "2d2dfbe74b4e3f5b8f40513a6d2dd95af174e2ba4db6b85ccac28b9f877c2e34", + "loads": [ + 3, + 2, + 1, + 5, + 1, + 2, + 12, + 5, + 3, + 0, + 1, + 6, + 4, + 4, + 4, + 1, + 9, + 0, + 4, + 11, + 1, + 6, + 4, + 1, + 6, + 1, + 9, + 6, + 0, + 6, + 4, + 1, + 4, + 3, + 3, + 6, + 0, + 10, + 1, + 9, + 1, + 13, + 3, + 5, + 4, + 4, + 12, + 2, + 5, + 1, + 6, + 8, + 5, + 5, + 1, + 13, + 13, + 5, + 2, + 12, + 5, + 2, + 5, + 3 + ], + "weighted_loads": [ + 0.1893651857972145, + 0.0661397110670805, + 0.0809597596526146, + 0.2645016089081764, + 0.0288657546043396, + 0.11065806448459625, + 1.4016152545809746, + 0.32394884526729584, + 0.16474217548966408, + 0.0, + 0.13061805069446564, + 0.3819985017180443, + 0.341481514275074, + 0.15518644079566002, + 0.2455856315791607, + 0.04384269937872887, + 0.6408461593091488, + 0.0, + 0.33880162984132767, + 0.6461198516190052, + 0.043942950665950775, + 0.45997957326471806, + 0.9652618654072285, + 0.03576722741127014, + 0.39863740280270576, + 0.02799288183450699, + 0.6851786375045776, + 0.7877007462084293, + 0.0, + 0.41476988419890404, + 0.25226449221372604, + 0.07248039543628693, + 0.17641085013747215, + 0.2063225507736206, + 0.32142922282218933, + 0.5934132561087608, + 0.0, + 0.743398254737258, + 0.07617286592721939, + 0.3644034508615732, + 0.06186000630259514, + 1.0024949684739113, + 0.09166638925671577, + 0.2562532462179661, + 0.19813772663474083, + 0.1309773586690426, + 1.416984574869275, + 0.08278223499655724, + 0.31644939072430134, + 0.032619863748550415, + 0.4066850244998932, + 0.34316083043813705, + 0.2813178822398186, + 0.30277159810066223, + 0.06645458191633224, + 0.9331020899116993, + 1.5999196469783783, + 0.24347032979130745, + 0.17388484627008438, + 1.2223159968852997, + 0.2732580304145813, + 0.27413755655288696, + 0.2351770233362913, + 0.2534801661968231 + ], + "unique_experts": 60, + "load_cv": 0.7808326723298638, + "normalized_load_entropy": 0.925670267711111, + "max_load_share": 0.04421768707482993 + } + }, + "s1_x": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "8dc75886ef199fc80ddb4989238d35433024b1a6e8c696abdaa074ce3ee902c1", + "route_weight_sha256": "384ae1f3190128383cef1e9120b211c644f1672fe2685aa43ea43b908b29155e", + "loads": [ + 3, + 1, + 1, + 4, + 0, + 3, + 3, + 5, + 2, + 0, + 1, + 1, + 4, + 2, + 1, + 0, + 4, + 0, + 4, + 2, + 0, + 4, + 2, + 0, + 5, + 0, + 10, + 5, + 0, + 3, + 3, + 1, + 1, + 4, + 2, + 0, + 0, + 0, + 1, + 1, + 1, + 6, + 0, + 4, + 4, + 1, + 0, + 1, + 1, + 1, + 1, + 0, + 4, + 6, + 1, + 2, + 4, + 5, + 2, + 2, + 5, + 2, + 5, + 3 + ], + "weighted_loads": [ + 0.18216035515069962, + 0.026648370549082756, + 0.08176451176404953, + 0.2335669845342636, + 0.0, + 0.15620512515306473, + 0.17986096069216728, + 0.33213549107313156, + 0.11949284747242928, + 0.0, + 0.12377004325389862, + 0.05830584093928337, + 0.356402687728405, + 0.08105882070958614, + 0.06201953440904617, + 0.0, + 0.32681215554475784, + 0.0, + 0.35662539303302765, + 0.09167590737342834, + 0.0, + 0.3143520876765251, + 0.3852868229150772, + 0.0, + 0.350558765232563, + 0.0, + 0.7311369739472866, + 0.7728660404682159, + 0.0, + 0.21580160409212112, + 0.23143915459513664, + 0.07103040814399719, + 0.04102836176753044, + 0.25496813654899597, + 0.29468388855457306, + 0.0, + 0.0, + 0.0, + 0.08257100731134415, + 0.05140024796128273, + 0.06247849017381668, + 0.4727970063686371, + 0.0, + 0.21258803457021713, + 0.1950949765741825, + 0.03872887045145035, + 0.0, + 0.06798263639211655, + 0.09905014932155609, + 0.034937091171741486, + 0.03983914852142334, + 0.0, + 0.257164865732193, + 0.3547023646533489, + 0.06420750170946121, + 0.1124211810529232, + 0.36948319524526596, + 0.2518455944955349, + 0.16774208843708038, + 0.1785048469901085, + 0.2583065815269947, + 0.2615315392613411, + 0.24769797548651695, + 0.24508442729711533 + ], + "unique_experts": 50, + "load_cv": 0.9026709338484401, + "normalized_load_entropy": 0.8935685201279675, + "max_load_share": 0.06944444444444445 + }, + "full_input": { + "tokens": 65, + "top_k": 6, + "decisions": 390, + "ordered_route_sha256": "ca63b0d9ad85e26743994dc185d916916406e8cb50ff25c89efd1c209c2edaa7", + "route_weight_sha256": "feee7f3456c4d08cae75b27ae89301ad0b4fc118d1c344d489695752a05b760e", + "loads": [ + 3, + 2, + 4, + 5, + 2, + 3, + 21, + 6, + 7, + 6, + 1, + 10, + 8, + 4, + 10, + 2, + 13, + 0, + 6, + 14, + 2, + 8, + 3, + 1, + 7, + 1, + 10, + 6, + 1, + 6, + 3, + 4, + 7, + 5, + 6, + 8, + 1, + 15, + 1, + 10, + 1, + 13, + 2, + 4, + 5, + 4, + 15, + 2, + 4, + 1, + 9, + 7, + 5, + 9, + 1, + 14, + 20, + 5, + 2, + 14, + 11, + 2, + 5, + 3 + ], + "weighted_loads": [ + 0.18216035515069962, + 0.061572240665555, + 0.22427885606884956, + 0.27100253850221634, + 0.1519274339079857, + 0.15620512515306473, + 1.868582522496581, + 0.3934007063508034, + 0.458623968064785, + 0.7040250450372696, + 0.12377004325389862, + 0.6628447435796261, + 0.6859858147799969, + 0.15432331524789333, + 0.7493843547999859, + 0.17808964848518372, + 1.0337300077080727, + 0.0, + 0.5042268298566341, + 0.892320778220892, + 0.09288572147488594, + 0.5558299925178289, + 0.9330526739358902, + 0.03526192903518677, + 0.41752513125538826, + 0.035363126546144485, + 0.7311369739472866, + 0.7994305472820997, + 0.03687845170497894, + 0.41919413581490517, + 0.23143915459513664, + 0.2694283500313759, + 0.27381305396556854, + 0.28875621780753136, + 0.552615724503994, + 0.796271838247776, + 0.03451807051897049, + 1.1865792162716389, + 0.08257100731134415, + 0.528253011405468, + 0.06247849017381668, + 1.0199132598936558, + 0.05796252191066742, + 0.21258803457021713, + 0.27960729971528053, + 0.13386226259171963, + 1.6802273262292147, + 0.08704192563891411, + 0.28808216378092766, + 0.034937091171741486, + 0.5861528292298317, + 0.2693181987851858, + 0.29409708082675934, + 0.5224029086530209, + 0.06420750170946121, + 1.195177011191845, + 2.1779480651021004, + 0.2518455944955349, + 0.16774208843708038, + 1.3037217762321234, + 0.5650402344763279, + 0.2615315392613411, + 0.24769797548651695, + 0.24508442729711533 + ], + "unique_experts": 63, + "load_cv": 0.7836427690476093, + "normalized_load_entropy": 0.9298154476463354, + "max_load_share": 0.05384615384615385 + } + }, + "s0_period": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "2feec7067a3b20e2fb36376a6f039644725105bedfff0e39735b0f213529fb45", + "route_weight_sha256": "e368cff8eb89534c9ef08069ad1a5523be723686d4f5f0e2b6f427257b516515", + "loads": [ + 3, + 0, + 1, + 5, + 0, + 1, + 3, + 5, + 3, + 0, + 1, + 1, + 4, + 2, + 1, + 0, + 4, + 0, + 4, + 2, + 0, + 4, + 2, + 1, + 6, + 0, + 9, + 6, + 0, + 3, + 3, + 1, + 1, + 3, + 2, + 0, + 0, + 1, + 1, + 1, + 1, + 6, + 0, + 6, + 4, + 0, + 0, + 1, + 1, + 1, + 1, + 0, + 5, + 5, + 1, + 2, + 4, + 5, + 2, + 2, + 5, + 2, + 3, + 3 + ], + "weighted_loads": [ + 0.18887294828891754, + 0.0, + 0.07918300479650497, + 0.25931522622704506, + 0.0, + 0.07398342341184616, + 0.16687551885843277, + 0.32602886110544205, + 0.1649310365319252, + 0.0, + 0.12840861082077026, + 0.058811284601688385, + 0.3420097306370735, + 0.0860103890299797, + 0.056883495301008224, + 0.0, + 0.33089523762464523, + 0.0, + 0.33324627578258514, + 0.09407897666096687, + 0.0, + 0.3278932310640812, + 0.39481500536203384, + 0.04518350213766098, + 0.4003165103495121, + 0.0, + 0.6847696788609028, + 0.7912159096449614, + 0.0, + 0.22849633172154427, + 0.20704226195812225, + 0.0697711631655693, + 0.04070551320910454, + 0.2138473577797413, + 0.2924748808145523, + 0.0, + 0.0, + 0.02923537790775299, + 0.07271481305360794, + 0.04563787579536438, + 0.06181532144546509, + 0.4803878664970398, + 0.0, + 0.2926713638007641, + 0.19937288016080856, + 0.0, + 0.0, + 0.06617584824562073, + 0.0991903617978096, + 0.032507769763469696, + 0.04334059730172157, + 0.0, + 0.2849678471684456, + 0.30089975520968437, + 0.06254494190216064, + 0.11292124167084694, + 0.42729048430919647, + 0.23894644156098366, + 0.1749621108174324, + 0.19019175320863724, + 0.26189935952425003, + 0.27443867176771164, + 0.16023466736078262, + 0.25413893908262253 + ], + "unique_experts": 50, + "load_cv": 0.9094836413191612, + "normalized_load_entropy": 0.8914396207331897, + "max_load_share": 0.0625 + }, + "full_input": { + "tokens": 49, + "top_k": 6, + "decisions": 294, + "ordered_route_sha256": "4ec277a0c4bf15ddab27c51b6c99d139d0ff8d13d59cb9298183a37ef551d9b8", + "route_weight_sha256": "d7c7f6fd22fdfcd0b0cb914fbebf2bb1002ff7f95296d2870b92655c180d0c3e", + "loads": [ + 3, + 2, + 1, + 5, + 1, + 1, + 13, + 5, + 3, + 0, + 1, + 6, + 5, + 4, + 4, + 0, + 9, + 0, + 4, + 12, + 1, + 7, + 4, + 2, + 6, + 1, + 9, + 6, + 1, + 6, + 3, + 1, + 4, + 3, + 3, + 6, + 0, + 10, + 1, + 9, + 1, + 12, + 3, + 6, + 4, + 4, + 12, + 2, + 5, + 1, + 6, + 8, + 5, + 5, + 1, + 13, + 13, + 5, + 2, + 11, + 5, + 2, + 3, + 3 + ], + "weighted_loads": [ + 0.18887294828891754, + 0.0661397110670805, + 0.07918300479650497, + 0.25931522622704506, + 0.0288657546043396, + 0.07398342341184616, + 1.2896026112139225, + 0.32602886110544205, + 0.1649310365319252, + 0.0, + 0.12840861082077026, + 0.37937842682003975, + 0.3954661376774311, + 0.15804308652877808, + 0.2369156889617443, + 0.0, + 0.6357583627104759, + 0.0, + 0.33324627578258514, + 0.7283271700143814, + 0.043942950665950775, + 0.4970904942601919, + 0.9703904576599598, + 0.08095072954893112, + 0.4003165103495121, + 0.02799288183450699, + 0.6847696788609028, + 0.7912159096449614, + 0.10344885289669037, + 0.4175901599228382, + 0.20704226195812225, + 0.0697711631655693, + 0.17781603708863258, + 0.2138473577797413, + 0.3271856755018234, + 0.582671195268631, + 0.0, + 0.825448501855135, + 0.07271481305360794, + 0.36444600485265255, + 0.06181532144546509, + 0.9327470026910305, + 0.09505083784461021, + 0.2926713638007641, + 0.19937288016080856, + 0.1309773586690426, + 1.4215536806732416, + 0.08523513749241829, + 0.31775651313364506, + 0.032507769763469696, + 0.4085906185209751, + 0.34259846806526184, + 0.2849678471684456, + 0.30089975520968437, + 0.06254494190216064, + 1.0256425440311432, + 1.5809074491262436, + 0.23894644156098366, + 0.1749621108174324, + 1.151840016245842, + 0.26189935952425003, + 0.27443867176771164, + 0.16023466736078262, + 0.25413893908262253 + ], + "unique_experts": 60, + "load_cv": 0.7855596632025624, + "normalized_load_entropy": 0.9247906651123052, + "max_load_share": 0.04421768707482993 + } + }, + "s1_period": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "4e19f614eecb6d17b3ec413ebf0c16ab02234bf3ff5845e0cdf133b2ceae8a3e", + "route_weight_sha256": "e620033fff1ac40e0f5e4e58f144e0c30c38b0283a491e943ee2632bff1b8814", + "loads": [ + 3, + 1, + 1, + 4, + 0, + 3, + 3, + 5, + 2, + 0, + 1, + 1, + 4, + 2, + 1, + 0, + 4, + 0, + 4, + 2, + 0, + 4, + 2, + 0, + 5, + 0, + 10, + 6, + 0, + 3, + 3, + 1, + 1, + 4, + 2, + 0, + 0, + 0, + 1, + 1, + 1, + 6, + 0, + 4, + 4, + 1, + 0, + 1, + 1, + 1, + 1, + 0, + 4, + 6, + 1, + 2, + 4, + 5, + 2, + 2, + 5, + 2, + 4, + 3 + ], + "weighted_loads": [ + 0.18470104038715363, + 0.026181824505329132, + 0.08093351870775223, + 0.23359378427267075, + 0.0, + 0.15560958161950111, + 0.1697686817497015, + 0.33354477211833, + 0.11930621787905693, + 0.0, + 0.11629515886306763, + 0.057412561029195786, + 0.35927192121744156, + 0.08330494165420532, + 0.06155575066804886, + 0.0, + 0.3300943188369274, + 0.0, + 0.35064080357551575, + 0.09217292070388794, + 0.0, + 0.3138332888484001, + 0.3780839443206787, + 0.0, + 0.3593474142253399, + 0.0, + 0.7249207198619843, + 0.8054801821708679, + 0.0, + 0.2164454571902752, + 0.23245980963110924, + 0.07081288844347, + 0.04118950664997101, + 0.2559535726904869, + 0.2992759197950363, + 0.0, + 0.0, + 0.0, + 0.08214140683412552, + 0.04696614667773247, + 0.062222257256507874, + 0.47323306277394295, + 0.0, + 0.2143961600959301, + 0.19458692893385887, + 0.0375954806804657, + 0.0, + 0.06761617213487625, + 0.10186879336833954, + 0.03640442714095116, + 0.04128943011164665, + 0.0, + 0.26018156856298447, + 0.35746097937226295, + 0.06392330676317215, + 0.11072476953268051, + 0.369937464594841, + 0.25543344393372536, + 0.17330648005008698, + 0.1849658116698265, + 0.25684579461812973, + 0.25339318811893463, + 0.20537307858467102, + 0.2466137893497944 + ], + "unique_experts": 50, + "load_cv": 0.9060836905722272, + "normalized_load_entropy": 0.8932323001563779, + "max_load_share": 0.06944444444444445 + }, + "full_input": { + "tokens": 65, + "top_k": 6, + "decisions": 390, + "ordered_route_sha256": "95edb97b9dd7cce9bfabaf8b2798b83abc3c245a9abc07d30470953e4c0fc9bc", + "route_weight_sha256": "9a1a12e2795d2d86ef7b04d1a4821e38bfca12dd4c7fdf43251a38aa25e4c12d", + "loads": [ + 3, + 2, + 4, + 5, + 2, + 3, + 21, + 6, + 7, + 6, + 1, + 10, + 9, + 4, + 10, + 2, + 13, + 0, + 6, + 14, + 2, + 8, + 3, + 1, + 7, + 1, + 10, + 7, + 2, + 6, + 3, + 4, + 7, + 5, + 6, + 8, + 1, + 16, + 1, + 10, + 1, + 12, + 2, + 4, + 5, + 4, + 16, + 2, + 3, + 1, + 8, + 7, + 5, + 9, + 1, + 14, + 20, + 5, + 2, + 13, + 11, + 2, + 4, + 3 + ], + "weighted_loads": [ + 0.18470104038715363, + 0.061105694621801376, + 0.22344786301255226, + 0.2710293382406235, + 0.1519274339079857, + 0.15560958161950111, + 1.7223785668611526, + 0.3948099873960018, + 0.45843733847141266, + 0.7040250450372696, + 0.11629515886306763, + 0.6574581004679203, + 0.7540622390806675, + 0.1550409272313118, + 0.7508542723953724, + 0.16495442762970924, + 1.0330456160008907, + 0.0, + 0.49824224039912224, + 0.9870431572198868, + 0.09288572147488594, + 0.5538680832833052, + 0.9258497953414917, + 0.03526192903518677, + 0.4272976219654083, + 0.035363126546144485, + 0.7249207198619843, + 0.8320446889847517, + 0.15841248631477356, + 0.42418020218610764, + 0.23245980963110924, + 0.2692108303308487, + 0.2710261009633541, + 0.2897416539490223, + 0.5572077557444572, + 0.8076658919453621, + 0.03451807051897049, + 1.3317834436893463, + 0.08214140683412552, + 0.5238189101219177, + 0.062222257256507874, + 0.9302132911980152, + 0.05796252191066742, + 0.2143961600959301, + 0.2790992520749569, + 0.13272887282073498, + 1.737955978140235, + 0.08667546138167381, + 0.21583617851138115, + 0.03640442714095116, + 0.5352214947342873, + 0.2725752256810665, + 0.2971137836575508, + 0.5251615233719349, + 0.06392330676317215, + 1.2576617561280727, + 2.1748655140399933, + 0.25543344393372536, + 0.17330648005008698, + 1.2373988535255194, + 0.5635794475674629, + 0.25339318811893463, + 0.20537307858467102, + 0.2466137893497944 + ], + "unique_experts": 63, + "load_cv": 0.7863229282772547, + "normalized_load_entropy": 0.9299022768303546, + "max_load_share": 0.05384615384615385 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 24, + "ordered_topk_exact_tokens": 19, + "set_exact_tokens": 20, + "mean_set_jaccard": 0.9523809523809524, + "mean_token_weighted_tv": 0.012276802056779465, + "aggregate_load_tv": 0.027777777777777776 + }, + "system_bos": { + "tokens": 24, + "ordered_topk_exact_tokens": 17, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.9404761904761906, + "mean_token_weighted_tv": 0.01677891534442703, + "aggregate_load_tv": 0.034722222222222224 + }, + "system_x": { + "tokens": 24, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.9047619047619048, + "mean_token_weighted_tv": 0.022915191870803635, + "aggregate_load_tv": 0.05555555555555555 + }, + "system_period": { + "tokens": 24, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.9077380952380952, + "mean_token_weighted_tv": 0.02380560850724578, + "aggregate_load_tv": 0.05555555555555555 + }, + "bos_at_s0": { + "tokens": 24, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.9077380952380953, + "mean_token_weighted_tv": 0.028108035291855533, + "aggregate_load_tv": 0.05555555555555556 + }, + "bos_at_s1": { + "tokens": 24, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.8958333333333334, + "mean_token_weighted_tv": 0.029000869176040094, + "aggregate_load_tv": 0.05555555555555556 + }, + "x_at_s0": { + "tokens": 24, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 13, + "mean_set_jaccard": 0.8601190476190476, + "mean_token_weighted_tv": 0.035392674539859094, + "aggregate_load_tv": 0.08333333333333333 + }, + "x_at_s1": { + "tokens": 24, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 12, + "mean_set_jaccard": 0.8392857142857143, + "mean_token_weighted_tv": 0.040761170365537204, + "aggregate_load_tv": 0.09027777777777776 + }, + "period_at_s0": { + "tokens": 24, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8809523809523809, + "mean_token_weighted_tv": 0.03178978792857379, + "aggregate_load_tv": 0.06944444444444445 + }, + "period_at_s1": { + "tokens": 24, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 12, + "mean_set_jaccard": 0.8482142857142857, + "mean_token_weighted_tv": 0.038178341036352016, + "aggregate_load_tv": 0.08333333333333334 + } + } + }, + "layer_07": { + "layer": 7, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "30ead19823dbfcd78a7f15e1c31fb204be26ec16f5e44d688017f817068bd95c", + "route_weight_sha256": "cdc9b0ebb805eff0ab73b3836a55d94b4d1a620ac372fbe35b43a0ece9bd1d55", + "loads": [ + 4, + 0, + 0, + 0, + 3, + 0, + 1, + 1, + 4, + 0, + 4, + 0, + 0, + 0, + 1, + 1, + 2, + 0, + 1, + 5, + 0, + 2, + 0, + 8, + 1, + 2, + 3, + 5, + 0, + 4, + 3, + 0, + 3, + 6, + 6, + 1, + 2, + 7, + 1, + 5, + 3, + 1, + 4, + 13, + 0, + 8, + 2, + 0, + 5, + 3, + 0, + 2, + 0, + 0, + 0, + 2, + 1, + 1, + 0, + 1, + 0, + 0, + 12, + 0 + ], + "weighted_loads": [ + 0.3246891647577286, + 0.0, + 0.0, + 0.0, + 0.15944675728678703, + 0.0, + 0.10434585064649582, + 0.0373864583671093, + 0.3035085126757622, + 0.0, + 0.20069443807005882, + 0.0, + 0.0, + 0.0, + 0.09608517587184906, + 0.05863290652632713, + 0.07730576395988464, + 0.0, + 0.055576909333467484, + 0.49063197523355484, + 0.0, + 0.1239086389541626, + 0.0, + 0.5081086345016956, + 0.03336497023701668, + 0.11547988653182983, + 0.1688392572104931, + 0.3478804938495159, + 0.0, + 0.26754749193787575, + 0.20008427277207375, + 0.0, + 0.2731170579791069, + 0.507970716804266, + 0.4633696787059307, + 0.09627217799425125, + 0.13244662061333656, + 0.5398277416825294, + 0.04395322874188423, + 0.39049025624990463, + 0.27714698016643524, + 0.06364826112985611, + 0.4312940537929535, + 2.0684326365590096, + 0.0, + 0.4169795699417591, + 0.1697143167257309, + 0.0, + 0.45371921360492706, + 0.11807743087410927, + 0.0, + 0.07781142368912697, + 0.0, + 0.0, + 0.0, + 0.1270442120730877, + 0.04051588475704193, + 0.042074255645275116, + 0.0, + 0.06471303850412369, + 0.0, + 0.0, + 1.1621487513184547, + 0.0 + ], + "unique_experts": 41, + "load_cv": 1.257078722109418, + "normalized_load_entropy": 0.8260474681590507, + "max_load_share": 0.09027777777777778 + }, + "full_input": { + "tokens": 49, + "top_k": 6, + "decisions": 294, + "ordered_route_sha256": "f21120c8bc5be2a49a51a3289a291f9bd9ba0c6ff8e2a53f66c7c5d41593a0f3", + "route_weight_sha256": "944b1994779e4f2e1841e9d054084c8fde10e9605993cd44ef79c12cf84c17f4", + "loads": [ + 4, + 0, + 0, + 3, + 3, + 1, + 7, + 1, + 10, + 0, + 5, + 3, + 0, + 5, + 1, + 1, + 18, + 2, + 3, + 6, + 0, + 2, + 3, + 10, + 5, + 2, + 7, + 5, + 3, + 4, + 3, + 0, + 6, + 7, + 6, + 1, + 2, + 7, + 11, + 8, + 3, + 12, + 9, + 16, + 4, + 8, + 4, + 2, + 5, + 3, + 16, + 2, + 0, + 1, + 0, + 9, + 1, + 1, + 4, + 1, + 0, + 6, + 15, + 7 + ], + "weighted_loads": [ + 0.3246891647577286, + 0.0, + 0.0, + 0.11104106903076172, + 0.15944675728678703, + 0.04137057065963745, + 0.6998582296073437, + 0.0373864583671093, + 0.751173485070467, + 0.0, + 0.23321423307061195, + 0.48188917338848114, + 0.0, + 0.2849753275513649, + 0.09608517587184906, + 0.05863290652632713, + 2.1740726456046104, + 0.1151486188173294, + 0.09701946750283241, + 0.5912224501371384, + 0.0, + 0.1239086389541626, + 0.17284908518195152, + 0.7048976980149746, + 0.165116464253515, + 0.11547988653182983, + 0.4654519818723202, + 0.3478804938495159, + 0.06306990049779415, + 0.26754749193787575, + 0.20008427277207375, + 0.0, + 0.3873002864420414, + 0.5573030598461628, + 0.4633696787059307, + 0.09627217799425125, + 0.13244662061333656, + 0.5398277416825294, + 0.9003818780183792, + 0.5304662100970745, + 0.27714698016643524, + 1.2271083407104015, + 0.8314739279448986, + 2.1544060464948416, + 1.5602666288614273, + 0.4169795699417591, + 0.25456936843693256, + 0.13255035877227783, + 0.45371921360492706, + 0.11807743087410927, + 1.3106278106570244, + 0.07781142368912697, + 0.0, + 0.0302556362003088, + 0.0, + 0.7819921039044857, + 0.04051588475704193, + 0.042074255645275116, + 0.08479320630431175, + 0.06471303850412369, + 0.0, + 0.29748353734612465, + 1.2108094664290547, + 0.2661509495228529 + ], + "unique_experts": 55, + "load_cv": 0.9321217419078041, + "normalized_load_entropy": 0.8975807474509353, + "max_load_share": 0.061224489795918366 + } + }, + "s1_eos": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "b0bb78f5ac72b7d9210756c59993634e53cf97811860e6681d607183978aeab8", + "route_weight_sha256": "561209bead4e3b063138e1c381bed319b7827caed7159e08008a0aea2730a85b", + "loads": [ + 4, + 0, + 0, + 0, + 3, + 0, + 1, + 0, + 4, + 0, + 4, + 1, + 0, + 0, + 1, + 1, + 1, + 0, + 1, + 5, + 0, + 2, + 0, + 7, + 1, + 2, + 3, + 5, + 0, + 4, + 3, + 1, + 3, + 6, + 6, + 1, + 2, + 6, + 1, + 5, + 3, + 1, + 4, + 13, + 0, + 8, + 2, + 0, + 5, + 3, + 0, + 2, + 1, + 0, + 0, + 2, + 1, + 1, + 1, + 1, + 0, + 0, + 12, + 0 + ], + "weighted_loads": [ + 0.3198348879814148, + 0.0, + 0.0, + 0.0, + 0.1607749629765749, + 0.0, + 0.10295718908309937, + 0.0, + 0.29980824142694473, + 0.0, + 0.20281187072396278, + 0.04300849884748459, + 0.0, + 0.0, + 0.09523502737283707, + 0.060261599719524384, + 0.04505574703216553, + 0.0, + 0.05692130699753761, + 0.49956632032990456, + 0.0, + 0.12534455955028534, + 0.0, + 0.4612233303487301, + 0.033558256924152374, + 0.11825713142752647, + 0.16541996598243713, + 0.35773052275180817, + 0.0, + 0.2726343907415867, + 0.1986098773777485, + 0.04360419884324074, + 0.2714630104601383, + 0.48771238699555397, + 0.4656995199620724, + 0.09792571514844894, + 0.1318957768380642, + 0.4950450211763382, + 0.04208650812506676, + 0.3930448591709137, + 0.2722896486520767, + 0.061369601637125015, + 0.42962605506181717, + 2.0934202298521996, + 0.0, + 0.41509540006518364, + 0.16723518073558807, + 0.0, + 0.4465596079826355, + 0.1146455779671669, + 0.0, + 0.07772896066308022, + 0.03469100594520569, + 0.0, + 0.0, + 0.1284843534231186, + 0.04190048947930336, + 0.04456588998436928, + 0.0391392707824707, + 0.0621383860707283, + 0.0, + 0.0, + 1.1674090437591076, + 0.0 + ], + "unique_experts": 44, + "load_cv": 1.2222222222222223, + "normalized_load_entropy": 0.8381889322744129, + "max_load_share": 0.09027777777777778 + }, + "full_input": { + "tokens": 65, + "top_k": 6, + "decisions": 390, + "ordered_route_sha256": "98146a37dfa2f3767020fecc1e982be3ca54a15250679024f7a8cce832b0c89c", + "route_weight_sha256": "e7c619e50e7965e0338b3401aeeb56422fecb34e90b1b3444c469c395799451e", + "loads": [ + 4, + 0, + 0, + 2, + 4, + 1, + 8, + 0, + 19, + 2, + 11, + 6, + 0, + 6, + 3, + 2, + 18, + 3, + 3, + 6, + 0, + 2, + 2, + 10, + 6, + 2, + 11, + 5, + 3, + 10, + 3, + 1, + 9, + 14, + 6, + 1, + 2, + 10, + 18, + 8, + 5, + 17, + 14, + 17, + 11, + 8, + 4, + 6, + 5, + 3, + 23, + 2, + 1, + 0, + 4, + 11, + 1, + 7, + 4, + 1, + 0, + 6, + 16, + 3 + ], + "weighted_loads": [ + 0.3198348879814148, + 0.0, + 0.0, + 0.06324093043804169, + 0.20726115070283413, + 0.04475545883178711, + 0.6368997860699892, + 0.0, + 1.534528560936451, + 0.10124382749199867, + 0.7631799839437008, + 0.6327206902205944, + 0.0, + 0.3393929358571768, + 0.16326699405908585, + 0.11408692970871925, + 2.551426190882921, + 0.16541729494929314, + 0.09801802597939968, + 0.6002230904996395, + 0.0, + 0.12534455955028534, + 0.12122637778520584, + 0.6909422166645527, + 0.18779481016099453, + 0.11825713142752647, + 0.8305244110524654, + 0.35773052275180817, + 0.0635960130020976, + 1.0468443967401981, + 0.1986098773777485, + 0.04360419884324074, + 0.6562773175537586, + 1.0290381200611591, + 0.4656995199620724, + 0.09792571514844894, + 0.1318957768380642, + 0.724422374740243, + 1.7583054937422276, + 0.5438612066209316, + 0.49267056584358215, + 1.6895629614591599, + 1.2671326659619808, + 2.2217762349173427, + 2.131203332915902, + 0.41509540006518364, + 0.273404598236084, + 0.33439575880765915, + 0.4465596079826355, + 0.1146455779671669, + 1.7526522427797318, + 0.07772896066308022, + 0.03469100594520569, + 0.0, + 0.20672141760587692, + 0.8967007603496313, + 0.04190048947930336, + 0.5866640657186508, + 0.09630671050399542, + 0.0621383860707283, + 0.0, + 0.2926546726375818, + 1.2512199585326016, + 0.08895362168550491 + ], + "unique_experts": 57, + "load_cv": 0.9176908390098649, + "normalized_load_entropy": 0.9007154263430649, + "max_load_share": 0.05897435897435897 + } + }, + "s0_bos": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "c8309cf87d65210f924f1f75bcad60531edd9f0f0264ac3cb3478fd8fe707f51", + "route_weight_sha256": "ea0282b6ed80eed8fd1c34cb4f31e20d92589880e0d7730d99e8e5347af8d231", + "loads": [ + 4, + 0, + 0, + 0, + 3, + 0, + 1, + 0, + 4, + 0, + 4, + 0, + 0, + 0, + 1, + 1, + 1, + 0, + 1, + 4, + 0, + 2, + 0, + 6, + 1, + 2, + 3, + 5, + 0, + 4, + 3, + 1, + 3, + 6, + 6, + 2, + 2, + 8, + 1, + 5, + 3, + 1, + 4, + 13, + 0, + 8, + 2, + 0, + 5, + 3, + 1, + 1, + 0, + 0, + 1, + 2, + 1, + 1, + 1, + 1, + 0, + 0, + 12, + 0 + ], + "weighted_loads": [ + 0.33019883185625076, + 0.0, + 0.0, + 0.0, + 0.15414954908192158, + 0.0, + 0.09117313474416733, + 0.0, + 0.306362122297287, + 0.0, + 0.21170180290937424, + 0.0, + 0.0, + 0.0, + 0.09498453885316849, + 0.058335866779088974, + 0.03181567043066025, + 0.0, + 0.0538378581404686, + 0.4336584694683552, + 0.0, + 0.12299134209752083, + 0.0, + 0.4141284190118313, + 0.039501164108514786, + 0.1200208067893982, + 0.1615290232002735, + 0.36271705105900764, + 0.0, + 0.2625423036515713, + 0.2029746174812317, + 0.039102282375097275, + 0.2775503322482109, + 0.5084214434027672, + 0.4764735959470272, + 0.12845611572265625, + 0.13489093258976936, + 0.57645258679986, + 0.0406561940908432, + 0.3793686181306839, + 0.278755858540535, + 0.05897840857505798, + 0.4294247403740883, + 1.9998220056295395, + 0.0, + 0.4214685633778572, + 0.148904737085104, + 0.0, + 0.45018263906240463, + 0.11749807745218277, + 0.04475889354944229, + 0.03900407999753952, + 0.0, + 0.0, + 0.04162989556789398, + 0.13301926106214523, + 0.03667190670967102, + 0.06268421560525894, + 0.040982574224472046, + 0.06500774621963501, + 0.0, + 0.0, + 1.158936146646738, + 0.0 + ], + "unique_experts": 44, + "load_cv": 1.2297746456210363, + "normalized_load_entropy": 0.8373337527939038, + "max_load_share": 0.09027777777777778 + }, + "full_input": { + "tokens": 49, + "top_k": 6, + "decisions": 294, + "ordered_route_sha256": "e5c9df4d85ee813b5b5c4e4e3a7a6c405e76c6037fbf3a7cfb0e5434dbd5e21a", + "route_weight_sha256": "50c267a84f1d3bb07ae5f4097f1517e53fa053da872ffe10bd49770041ea84e0", + "loads": [ + 4, + 0, + 0, + 3, + 3, + 1, + 7, + 0, + 12, + 0, + 5, + 4, + 0, + 5, + 1, + 1, + 16, + 3, + 4, + 5, + 0, + 2, + 3, + 8, + 4, + 2, + 7, + 5, + 2, + 4, + 3, + 1, + 6, + 8, + 6, + 2, + 2, + 8, + 10, + 8, + 3, + 12, + 9, + 15, + 4, + 8, + 4, + 2, + 5, + 3, + 17, + 1, + 0, + 2, + 1, + 9, + 1, + 1, + 4, + 1, + 0, + 6, + 14, + 7 + ], + "weighted_loads": [ + 0.33019883185625076, + 0.0, + 0.0, + 0.11104106903076172, + 0.15414954908192158, + 0.04137057065963745, + 0.714968841522932, + 0.0, + 0.8794470690190792, + 0.0, + 0.24422159790992737, + 0.5206698663532734, + 0.0, + 0.2849753275513649, + 0.09498453885316849, + 0.058335866779088974, + 2.131262958049774, + 0.14563016965985298, + 0.13618800789117813, + 0.5369952954351902, + 0.0, + 0.12299134209752083, + 0.17284908518195152, + 0.6095207519829273, + 0.1642049252986908, + 0.1200208067893982, + 0.45002515986561775, + 0.36271705105900764, + 0.04998159781098366, + 0.2625423036515713, + 0.2029746174812317, + 0.039102282375097275, + 0.3917335607111454, + 0.5980514846742153, + 0.4764735959470272, + 0.12845611572265625, + 0.13489093258976936, + 0.57645258679986, + 0.848521638661623, + 0.524023562669754, + 0.278755858540535, + 1.1534562185406685, + 0.8514894172549248, + 2.079588083550334, + 0.7507098317146301, + 0.4214685633778572, + 0.24919303506612778, + 0.13224123418331146, + 0.45018263906240463, + 0.11749807745218277, + 1.4266378432512283, + 0.03900407999753952, + 0.0, + 0.07488110475242138, + 0.04162989556789398, + 0.7879671528935432, + 0.03667190670967102, + 0.06268421560525894, + 0.11080681532621384, + 0.06500774621963501, + 0.0, + 0.29748353734612465, + 1.2019813423976302, + 0.2661509495228529 + ], + "unique_experts": 56, + "load_cv": 0.8997868433980483, + "normalized_load_entropy": 0.9037285991961674, + "max_load_share": 0.05782312925170068 + } + }, + "s1_bos": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "2234587d8a9fa19e0781dd10c61d74fded2a00c93ba696ffb7a59678222a7989", + "route_weight_sha256": "09fe35a7287e73a1e533e7de186f656b48b4ff9e9885f577ead31d05c8851883", + "loads": [ + 4, + 0, + 0, + 0, + 2, + 0, + 1, + 0, + 4, + 0, + 4, + 0, + 0, + 0, + 1, + 1, + 0, + 0, + 1, + 4, + 0, + 2, + 0, + 6, + 1, + 2, + 3, + 5, + 0, + 4, + 3, + 1, + 3, + 6, + 6, + 2, + 2, + 8, + 1, + 5, + 3, + 0, + 4, + 13, + 0, + 8, + 2, + 0, + 5, + 3, + 1, + 2, + 0, + 0, + 1, + 3, + 2, + 1, + 1, + 1, + 0, + 0, + 12, + 0 + ], + "weighted_loads": [ + 0.3312414065003395, + 0.0, + 0.0, + 0.0, + 0.1204680074006319, + 0.0, + 0.0829145610332489, + 0.0, + 0.29952380806207657, + 0.0, + 0.20876669883728027, + 0.0, + 0.0, + 0.0, + 0.10075774788856506, + 0.06035737320780754, + 0.0, + 0.0, + 0.053027164191007614, + 0.43634263426065445, + 0.0, + 0.13199979811906815, + 0.0, + 0.4081520028412342, + 0.04116180166602135, + 0.12429650872945786, + 0.14775966852903366, + 0.3776360712945461, + 0.0, + 0.26315704733133316, + 0.20577127486467361, + 0.04138694703578949, + 0.27742378413677216, + 0.49125561490654945, + 0.4771096855401993, + 0.13239801675081253, + 0.1352396011352539, + 0.600107379257679, + 0.0386013463139534, + 0.38547227159142494, + 0.27508504688739777, + 0.0, + 0.4342406541109085, + 2.0243064388632774, + 0.0, + 0.4325397238135338, + 0.14462697505950928, + 0.0, + 0.4512938857078552, + 0.1128080002963543, + 0.05117039382457733, + 0.07413934543728828, + 0.0, + 0.0, + 0.042387109249830246, + 0.1857246831059456, + 0.07750352472066879, + 0.06347022205591202, + 0.04152891784906387, + 0.05898624658584595, + 0.0, + 0.0, + 1.1740582510828972, + 0.0 + ], + "unique_experts": 42, + "load_cv": 1.2347839317162705, + "normalized_load_entropy": 0.8327041231642742, + "max_load_share": 0.09027777777777778 + }, + "full_input": { + "tokens": 65, + "top_k": 6, + "decisions": 390, + "ordered_route_sha256": "cc9a6b9b452bea65acee672dab9807868452433052696957a419dd4332abd338", + "route_weight_sha256": "03df1866b2f7306b3a3acc8256bc6b4d93c8ed8f4f66a9eab6d1fd1b6e04ddb8", + "loads": [ + 4, + 0, + 0, + 2, + 3, + 1, + 10, + 0, + 20, + 2, + 11, + 5, + 0, + 6, + 3, + 2, + 16, + 3, + 4, + 5, + 0, + 2, + 2, + 10, + 5, + 2, + 11, + 5, + 2, + 10, + 3, + 1, + 9, + 14, + 6, + 2, + 2, + 12, + 18, + 8, + 5, + 16, + 14, + 16, + 11, + 8, + 5, + 6, + 5, + 3, + 24, + 2, + 0, + 0, + 5, + 12, + 2, + 7, + 3, + 1, + 0, + 6, + 15, + 3 + ], + "weighted_loads": [ + 0.3312414065003395, + 0.0, + 0.0, + 0.06324093043804169, + 0.16695419512689114, + 0.04475545883178711, + 0.7887665722519159, + 0.0, + 1.6164728999137878, + 0.10124382749199867, + 0.7691348120570183, + 0.5925913043320179, + 0.0, + 0.3393929358571768, + 0.16878971457481384, + 0.11418270319700241, + 2.469221655279398, + 0.160957720130682, + 0.13156828843057156, + 0.5410567820072174, + 0.0, + 0.13199979811906815, + 0.12122637778520584, + 0.6825508289039135, + 0.18820292688906193, + 0.12429650872945786, + 0.8001634553074837, + 0.3776360712945461, + 0.049855345860123634, + 1.0373670533299446, + 0.20577127486467361, + 0.04138694703578949, + 0.6622380912303925, + 1.0325813479721546, + 0.4771096855401993, + 0.13239801675081253, + 0.1352396011352539, + 0.8294847328215837, + 1.749268226325512, + 0.5374261513352394, + 0.4954659640789032, + 1.56007507070899, + 1.2948341481387615, + 2.150634227320552, + 1.3103318270295858, + 0.4325397238135338, + 0.2985965684056282, + 0.33555271103978157, + 0.4512938857078552, + 0.1128080002963543, + 1.9049255140125751, + 0.07413934543728828, + 0.0, + 0.0, + 0.24910852685570717, + 0.9539410900324583, + 0.07750352472066879, + 0.6055683977901936, + 0.08321825228631496, + 0.05898624658584595, + 0.0, + 0.2926546726375818, + 1.2523219594731927, + 0.08895362168550491 + ], + "unique_experts": 56, + "load_cv": 0.9181492403816561, + "normalized_load_entropy": 0.8999460605108124, + "max_load_share": 0.06153846153846154 + } + }, + "s0_x": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "b83c08322817392c39af2bdec3851f66326129a4a5fc71d00c6920623e74672f", + "route_weight_sha256": "383bce914afd726ab80f8e2fc281d5d065a23b614bd19b21c10ce75d8a436000", + "loads": [ + 4, + 0, + 0, + 0, + 3, + 0, + 1, + 0, + 4, + 0, + 4, + 0, + 0, + 0, + 1, + 1, + 2, + 1, + 1, + 4, + 0, + 1, + 0, + 6, + 1, + 2, + 3, + 6, + 0, + 4, + 3, + 0, + 3, + 7, + 6, + 2, + 2, + 7, + 1, + 5, + 3, + 1, + 4, + 13, + 0, + 8, + 2, + 0, + 5, + 3, + 0, + 1, + 0, + 0, + 1, + 2, + 1, + 1, + 1, + 1, + 0, + 0, + 12, + 0 + ], + "weighted_loads": [ + 0.3340689390897751, + 0.0, + 0.0, + 0.0, + 0.1562007013708353, + 0.0, + 0.08462515473365784, + 0.0, + 0.30866606533527374, + 0.0, + 0.20561427623033524, + 0.0, + 0.0, + 0.0, + 0.08688817918300629, + 0.057159606367349625, + 0.0867767445743084, + 0.052735816687345505, + 0.05697757750749588, + 0.4456801526248455, + 0.0, + 0.07608259469270706, + 0.0, + 0.38871174305677414, + 0.040026333183050156, + 0.11528151854872704, + 0.1576233245432377, + 0.41014284268021584, + 0.0, + 0.2397763505578041, + 0.19725756347179413, + 0.0, + 0.2649419717490673, + 0.5679260715842247, + 0.4480813778936863, + 0.1381084844470024, + 0.13517703860998154, + 0.5271707661449909, + 0.04459143057465553, + 0.36617109924554825, + 0.2729794532060623, + 0.06474075466394424, + 0.42648202925920486, + 2.0311782509088516, + 0.0, + 0.42000237852334976, + 0.16890085861086845, + 0.0, + 0.45512060821056366, + 0.11236805468797684, + 0.0, + 0.038238685578107834, + 0.0, + 0.0, + 0.041314058005809784, + 0.12435585632920265, + 0.0370890349149704, + 0.04890106990933418, + 0.041053108870983124, + 0.06674934923648834, + 0.0, + 0.0, + 1.1407286413013935, + 0.0 + ], + "unique_experts": 43, + "load_cv": 1.239772978023411, + "normalized_load_entropy": 0.833059067105976, + "max_load_share": 0.09027777777777778 + }, + "full_input": { + "tokens": 49, + "top_k": 6, + "decisions": 294, + "ordered_route_sha256": "edd3c1edb3c54d568faf1edecea310f126777d0bc16f5d1c9a2b500e27ce925f", + "route_weight_sha256": "8acc47d688a6915fb3a55fd286733ec3d0943a1c064b2e8aa2f9fa6e7d929c63", + "loads": [ + 4, + 0, + 0, + 3, + 3, + 2, + 6, + 0, + 12, + 0, + 5, + 4, + 1, + 6, + 1, + 1, + 18, + 4, + 3, + 5, + 0, + 1, + 3, + 8, + 4, + 2, + 5, + 6, + 2, + 4, + 3, + 0, + 6, + 9, + 6, + 2, + 2, + 7, + 10, + 8, + 3, + 12, + 9, + 15, + 3, + 8, + 5, + 3, + 5, + 3, + 14, + 1, + 0, + 1, + 1, + 9, + 1, + 1, + 4, + 1, + 0, + 7, + 14, + 8 + ], + "weighted_loads": [ + 0.3340689390897751, + 0.0, + 0.0, + 0.11104106903076172, + 0.1562007013708353, + 0.09628040716052055, + 0.5434787198901176, + 0.0, + 0.8856353610754013, + 0.0, + 0.23813407123088837, + 0.5323621332645416, + 0.037623945623636246, + 0.3181254640221596, + 0.08688817918300629, + 0.057159606367349625, + 2.465907294303179, + 0.23960914835333824, + 0.09842013567686081, + 0.5358064882457256, + 0.0, + 0.07608259469270706, + 0.17284908518195152, + 0.5843418389558792, + 0.16473009437322617, + 0.11528151854872704, + 0.32633422687649727, + 0.41014284268021584, + 0.04998159781098366, + 0.2397763505578041, + 0.19725756347179413, + 0.0, + 0.3791252002120018, + 0.6572212725877762, + 0.4480813778936863, + 0.1381084844470024, + 0.13517703860998154, + 0.5271707661449909, + 0.8449353612959385, + 0.5098394826054573, + 0.2729794532060623, + 1.0880695283412933, + 0.8159371800720692, + 2.1113675963133574, + 0.7009239047765732, + 0.42000237852334976, + 0.29991675913333893, + 0.1800299435853958, + 0.45512060821056366, + 0.11236805468797684, + 1.1139211244881153, + 0.038238685578107834, + 0.0, + 0.0302556362003088, + 0.041314058005809784, + 0.7793037481606007, + 0.0370890349149704, + 0.04890106990933418, + 0.11087734997272491, + 0.06674934923648834, + 0.0, + 0.34882212430238724, + 1.1837738370522857, + 0.3446312379091978 + ], + "unique_experts": 56, + "load_cv": 0.8973147553608752, + "normalized_load_entropy": 0.9035687827533837, + "max_load_share": 0.061224489795918366 + } + }, + "s1_x": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "084f2377e264e19589785be8089a788a2342e9bc8a629304444c7341983bd142", + "route_weight_sha256": "891fe1bfae5ff746324d8190099494bf53fab005f1fcc783d9fe6e3d7e17fff7", + "loads": [ + 4, + 0, + 1, + 0, + 2, + 0, + 1, + 0, + 4, + 0, + 3, + 0, + 0, + 0, + 1, + 1, + 2, + 0, + 1, + 4, + 0, + 1, + 0, + 5, + 1, + 2, + 2, + 6, + 0, + 4, + 3, + 1, + 4, + 6, + 6, + 2, + 2, + 8, + 2, + 5, + 3, + 0, + 4, + 13, + 0, + 8, + 2, + 0, + 5, + 3, + 0, + 1, + 0, + 0, + 1, + 3, + 2, + 1, + 1, + 1, + 0, + 0, + 12, + 0 + ], + "weighted_loads": [ + 0.33001386374235153, + 0.0, + 0.05761861056089401, + 0.0, + 0.12304024398326874, + 0.0, + 0.07014086097478867, + 0.0, + 0.3087709844112396, + 0.0, + 0.14777616411447525, + 0.0, + 0.0, + 0.0, + 0.09292981028556824, + 0.0629659965634346, + 0.08698711916804314, + 0.0, + 0.05345470830798149, + 0.4399249032139778, + 0.0, + 0.07747170329093933, + 0.0, + 0.33950065448880196, + 0.04248196259140968, + 0.12088317424058914, + 0.10584374144673347, + 0.433050949126482, + 0.0, + 0.24115650728344917, + 0.2024955078959465, + 0.039939917623996735, + 0.2988824136555195, + 0.49575838446617126, + 0.4644749201834202, + 0.1444508545100689, + 0.13391727209091187, + 0.58017473295331, + 0.0972721315920353, + 0.36837202683091164, + 0.2725837454199791, + 0.0, + 0.42778587341308594, + 2.0568641275167465, + 0.0, + 0.4202497862279415, + 0.16990095004439354, + 0.0, + 0.44077084958553314, + 0.1174105629324913, + 0.0, + 0.041293662041425705, + 0.0, + 0.0, + 0.041740868240594864, + 0.18048840761184692, + 0.0786813274025917, + 0.06050538644194603, + 0.043981458991765976, + 0.05431921035051346, + 0.0, + 0.0, + 1.1324580013751984, + 0.0 + ], + "unique_experts": 43, + "load_cv": 1.2297746456210363, + "normalized_load_entropy": 0.8358926503658524, + "max_load_share": 0.09027777777777778 + }, + "full_input": { + "tokens": 65, + "top_k": 6, + "decisions": 390, + "ordered_route_sha256": "39dbf4f73d4e04aa1f5317ee23ba15f008b87d4671469936e046ceeeb790e961", + "route_weight_sha256": "2bb6901db7512a1e29884de7431ac89e23972dca60b298f7beec61612a9eff68", + "loads": [ + 4, + 0, + 1, + 2, + 3, + 2, + 8, + 0, + 20, + 2, + 10, + 5, + 0, + 7, + 3, + 2, + 19, + 5, + 3, + 5, + 0, + 1, + 2, + 9, + 6, + 2, + 9, + 6, + 2, + 10, + 3, + 1, + 10, + 14, + 6, + 2, + 2, + 12, + 17, + 8, + 5, + 15, + 14, + 16, + 10, + 8, + 6, + 7, + 5, + 3, + 21, + 1, + 0, + 0, + 5, + 12, + 2, + 7, + 3, + 1, + 0, + 7, + 15, + 4 + ], + "weighted_loads": [ + 0.33001386374235153, + 0.0, + 0.05761861056089401, + 0.06324093043804169, + 0.16952643170952797, + 0.09835551679134369, + 0.5412089806050062, + 0.0, + 1.6467749401926994, + 0.10124382749199867, + 0.7081442773342133, + 0.6307942904531956, + 0.0, + 0.3689776100218296, + 0.16096177697181702, + 0.11679132655262947, + 2.824230369180441, + 0.2699941024184227, + 0.09455142728984356, + 0.5250259116292, + 0.0, + 0.07747170329093933, + 0.12122637778520584, + 0.5850712284445763, + 0.22245720215141773, + 0.12088317424058914, + 0.6998069249093533, + 0.433050949126482, + 0.049855345860123634, + 1.0153665132820606, + 0.2024955078959465, + 0.039939917623996735, + 0.6836967207491398, + 1.0370841175317764, + 0.4644749201834202, + 0.1444508545100689, + 0.13391727209091187, + 0.8095520865172148, + 1.7286166064441204, + 0.5155787579715252, + 0.4929646626114845, + 1.4023523405194283, + 1.2469648644328117, + 2.1966907512396574, + 1.2638616133481264, + 0.4202497862279415, + 0.35773399472236633, + 0.40134096145629883, + 0.44077084958553314, + 0.1174105629324913, + 1.5321964621543884, + 0.041293662041425705, + 0.0, + 0.0, + 0.2484622858464718, + 0.9487048145383596, + 0.0786813274025917, + 0.6026035621762276, + 0.08567079342901707, + 0.05431921035051346, + 0.0, + 0.3461115602403879, + 1.2107217097654939, + 0.15807407349348068 + ], + "unique_experts": 57, + "load_cv": 0.8883348042958465, + "normalized_load_entropy": 0.9048565676540209, + "max_load_share": 0.05384615384615385 + } + }, + "s0_period": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "c4052ca989f5ab3be29156b26ad439f7910929c87f590f9d2b75201c26874edf", + "route_weight_sha256": "f1225bcea32aec18329c77c83f69a6460b6393f4ea17f924b1c73449f1ad5ab6", + "loads": [ + 4, + 0, + 0, + 0, + 3, + 0, + 1, + 0, + 4, + 0, + 4, + 1, + 0, + 0, + 1, + 1, + 2, + 1, + 1, + 2, + 0, + 2, + 0, + 7, + 1, + 2, + 3, + 5, + 0, + 4, + 3, + 0, + 3, + 6, + 6, + 1, + 2, + 8, + 2, + 5, + 3, + 1, + 4, + 13, + 0, + 8, + 2, + 0, + 5, + 3, + 0, + 1, + 0, + 0, + 1, + 2, + 1, + 1, + 1, + 1, + 0, + 0, + 12, + 0 + ], + "weighted_loads": [ + 0.3354233056306839, + 0.0, + 0.0, + 0.0, + 0.15914423950016499, + 0.0, + 0.086992546916008, + 0.0, + 0.3030877932906151, + 0.0, + 0.20389684662222862, + 0.03755819797515869, + 0.0, + 0.0, + 0.08691633492708206, + 0.05726870149374008, + 0.08292467892169952, + 0.05361182987689972, + 0.05738307908177376, + 0.34167352318763733, + 0.0, + 0.12457225099205971, + 0.0, + 0.43814511224627495, + 0.04021431505680084, + 0.11655689403414726, + 0.16317934170365334, + 0.36282042413949966, + 0.0, + 0.23166890442371368, + 0.2021079882979393, + 0.0, + 0.26569729670882225, + 0.529716033488512, + 0.4478169120848179, + 0.10612647235393524, + 0.13741546496748924, + 0.5541233196854591, + 0.1006745919585228, + 0.3698479048907757, + 0.26661989837884903, + 0.0637100487947464, + 0.43898656219244003, + 2.0570710375905037, + 0.0, + 0.4075404852628708, + 0.17242243885993958, + 0.0, + 0.4590272903442383, + 0.11610963195562363, + 0.0, + 0.03309675678610802, + 0.0, + 0.0, + 0.04060908779501915, + 0.12548650056123734, + 0.03562893345952034, + 0.04569144546985626, + 0.042207129299640656, + 0.06764727085828781, + 0.0, + 0.0, + 1.117598656564951, + 0.0 + ], + "unique_experts": 44, + "load_cv": 1.2347839317162705, + "normalized_load_entropy": 0.8371697372266858, + "max_load_share": 0.09027777777777778 + }, + "full_input": { + "tokens": 49, + "top_k": 6, + "decisions": 294, + "ordered_route_sha256": "f5a2195defae50582d1430203a66348df24fe5761ea195428966145f5882ac13", + "route_weight_sha256": "78ec52475a9d56888c0bc20631e7c07a6f2a26fe56ddf1aeb8f6ad7f998012f4", + "loads": [ + 4, + 0, + 0, + 3, + 3, + 1, + 7, + 0, + 13, + 0, + 5, + 5, + 1, + 5, + 1, + 1, + 18, + 4, + 3, + 3, + 0, + 2, + 4, + 9, + 4, + 2, + 5, + 5, + 2, + 4, + 3, + 0, + 6, + 8, + 6, + 1, + 2, + 8, + 12, + 8, + 3, + 13, + 9, + 15, + 3, + 8, + 3, + 2, + 5, + 3, + 16, + 1, + 0, + 1, + 1, + 9, + 1, + 1, + 4, + 1, + 0, + 6, + 14, + 7 + ], + "weighted_loads": [ + 0.3354233056306839, + 0.0, + 0.0, + 0.11104106903076172, + 0.15914423950016499, + 0.04137057065963745, + 0.5889573208987713, + 0.0, + 0.9541306011378765, + 0.0, + 0.23641664162278175, + 0.5577678307890892, + 0.03640579432249069, + 0.2849753275513649, + 0.08691633492708206, + 0.05726870149374008, + 2.446256659924984, + 0.23790885508060455, + 0.09882563725113869, + 0.4354780688881874, + 0.0, + 0.12457225099205971, + 0.21675927937030792, + 0.6343270353972912, + 0.16491807624697685, + 0.11655689403414726, + 0.33374205604195595, + 0.36282042413949966, + 0.04998159781098366, + 0.23166890442371368, + 0.2021079882979393, + 0.0, + 0.37988052517175674, + 0.6140458807349205, + 0.4478169120848179, + 0.10612647235393524, + 0.13741546496748924, + 0.5541233196854591, + 1.03150175511837, + 0.5161337852478027, + 0.26661989837884903, + 1.135709285736084, + 0.8188670538365841, + 2.136420676484704, + 0.6925490275025368, + 0.4075404852628708, + 0.22708215191960335, + 0.13437700271606445, + 0.4590272903442383, + 0.11610963195562363, + 1.4501039497554302, + 0.03309675678610802, + 0.0, + 0.0302556362003088, + 0.04060908779501915, + 0.7804343923926353, + 0.03562893345952034, + 0.04569144546985626, + 0.11203137040138245, + 0.06764727085828781, + 0.0, + 0.29748353734612465, + 1.160643852315843, + 0.2661509495228529 + ], + "unique_experts": 56, + "load_cv": 0.9408190318749501, + "normalized_load_entropy": 0.8971857196745188, + "max_load_share": 0.061224489795918366 + } + }, + "s1_period": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "6295fd61db8cf072cc111449edb096b56d56d6a65e7f7c7f80ea7265a0088745", + "route_weight_sha256": "56ab62d1b8a927522e55d19b5bd0fffa10eb4cc123f58b4fced8dab7e8fb9465", + "loads": [ + 4, + 0, + 1, + 0, + 3, + 0, + 1, + 0, + 4, + 0, + 3, + 1, + 0, + 0, + 1, + 1, + 0, + 0, + 1, + 3, + 0, + 2, + 0, + 5, + 1, + 2, + 2, + 6, + 0, + 4, + 3, + 1, + 4, + 6, + 6, + 2, + 2, + 8, + 2, + 5, + 3, + 0, + 4, + 13, + 0, + 8, + 2, + 0, + 5, + 3, + 1, + 1, + 0, + 0, + 1, + 3, + 1, + 1, + 1, + 1, + 0, + 0, + 12, + 0 + ], + "weighted_loads": [ + 0.3266535699367523, + 0.0, + 0.05739646777510643, + 0.0, + 0.16246004030108452, + 0.0, + 0.06941959261894226, + 0.0, + 0.307630218565464, + 0.0, + 0.14847132563591003, + 0.03832154721021652, + 0.0, + 0.0, + 0.09209878742694855, + 0.06376516819000244, + 0.0, + 0.0, + 0.05422219634056091, + 0.38815825060009956, + 0.0, + 0.1277051456272602, + 0.0, + 0.3403032533824444, + 0.04123997315764427, + 0.12502697110176086, + 0.11021756380796432, + 0.43306177482008934, + 0.0, + 0.24507764726877213, + 0.20423894375562668, + 0.04093557596206665, + 0.3001253753900528, + 0.4981711804866791, + 0.4600367061793804, + 0.14645253121852875, + 0.13456643745303154, + 0.5771206393837929, + 0.09814433380961418, + 0.3682950995862484, + 0.26554399356245995, + 0.0, + 0.4374949783086777, + 2.0376763939857483, + 0.0, + 0.4226009324193001, + 0.17160696536302567, + 0.0, + 0.455907866358757, + 0.11641287431120872, + 0.05036245658993721, + 0.034588102251291275, + 0.0, + 0.0, + 0.04141341149806976, + 0.18626409769058228, + 0.03682262450456619, + 0.059655554592609406, + 0.04459719359874725, + 0.05425674840807915, + 0.0, + 0.0, + 1.127347532659769, + 0.0 + ], + "unique_experts": 44, + "load_cv": 1.224744871391589, + "normalized_load_entropy": 0.8387748552219553, + "max_load_share": 0.09027777777777778 + }, + "full_input": { + "tokens": 65, + "top_k": 6, + "decisions": 390, + "ordered_route_sha256": "6f0e039dc07fdb3c9f7fb51f2e0fe711a7dc58a58ac71ee876bd6deb169e0ab8", + "route_weight_sha256": "4ce058a4e4d04c021b47fe89cb5b2de9d4d85e4bebb5201f18d825210aa441f8", + "loads": [ + 4, + 0, + 1, + 2, + 4, + 1, + 9, + 0, + 20, + 2, + 10, + 6, + 0, + 6, + 3, + 2, + 17, + 5, + 3, + 4, + 0, + 2, + 3, + 8, + 5, + 2, + 9, + 6, + 2, + 10, + 3, + 1, + 11, + 14, + 6, + 2, + 2, + 12, + 18, + 8, + 5, + 17, + 14, + 16, + 10, + 8, + 4, + 6, + 5, + 3, + 25, + 1, + 0, + 0, + 5, + 12, + 1, + 7, + 3, + 1, + 0, + 6, + 15, + 3 + ], + "weighted_loads": [ + 0.3266535699367523, + 0.0, + 0.05739646777510643, + 0.06324093043804169, + 0.20894622802734375, + 0.04475545883178711, + 0.5780058968812227, + 0.0, + 1.6340220868587494, + 0.10124382749199867, + 0.708839438855648, + 0.6208275072276592, + 0.0, + 0.3393929358571768, + 0.16013075411319733, + 0.11759049817919731, + 2.688900850713253, + 0.2612338326871395, + 0.09531891532242298, + 0.4705897755920887, + 0.0, + 0.1277051456272602, + 0.15397074073553085, + 0.5525020025670528, + 0.18828109838068485, + 0.12502697110176086, + 0.7067234702408314, + 0.43306177482008934, + 0.049855345860123634, + 1.0192876532673836, + 0.20423894375562668, + 0.04093557596206665, + 0.7187311388552189, + 1.0394969135522842, + 0.4600367061793804, + 0.14645253121852875, + 0.13456643745303154, + 0.8064979929476976, + 1.8306342028081417, + 0.5180573277175426, + 0.4859249107539654, + 1.4950349144637585, + 1.2526151463389397, + 2.1764890756458044, + 1.263116391375661, + 0.4226009324193001, + 0.2777763828635216, + 0.3353632315993309, + 0.455907866358757, + 0.11641287431120872, + 2.087320316582918, + 0.034588102251291275, + 0.0, + 0.0, + 0.24813482910394669, + 0.954480504617095, + 0.03682262450456619, + 0.601753730326891, + 0.08628652803599834, + 0.05425674840807915, + 0.0, + 0.2926546726375818, + 1.2056112410500646, + 0.08895362168550491 + ], + "unique_experts": 57, + "load_cv": 0.9268157897976693, + "normalized_load_entropy": 0.9000984112296689, + "max_load_share": 0.0641025641025641 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 24, + "ordered_topk_exact_tokens": 18, + "set_exact_tokens": 20, + "mean_set_jaccard": 0.9523809523809524, + "mean_token_weighted_tv": 0.012574440683238208, + "aggregate_load_tv": 0.027777777777777776 + }, + "system_bos": { + "tokens": 24, + "ordered_topk_exact_tokens": 19, + "set_exact_tokens": 20, + "mean_set_jaccard": 0.9523809523809526, + "mean_token_weighted_tv": 0.015885268338024616, + "aggregate_load_tv": 0.020833333333333332 + }, + "system_x": { + "tokens": 24, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.9166666666666666, + "mean_token_weighted_tv": 0.02639436663594097, + "aggregate_load_tv": 0.048611111111111105 + }, + "system_period": { + "tokens": 24, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8720238095238096, + "mean_token_weighted_tv": 0.03560631291475147, + "aggregate_load_tv": 0.05555555555555555 + }, + "bos_at_s0": { + "tokens": 24, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.9166666666666666, + "mean_token_weighted_tv": 0.025535228157726426, + "aggregate_load_tv": 0.04166666666666667 + }, + "bos_at_s1": { + "tokens": 24, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.8928571428571429, + "mean_token_weighted_tv": 0.03225688814806441, + "aggregate_load_tv": 0.048611111111111105 + }, + "x_at_s0": { + "tokens": 24, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 18, + "mean_set_jaccard": 0.9285714285714285, + "mean_token_weighted_tv": 0.02720201516058296, + "aggregate_load_tv": 0.04166666666666667 + }, + "x_at_s1": { + "tokens": 24, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 13, + "mean_set_jaccard": 0.8601190476190478, + "mean_token_weighted_tv": 0.04309283247372756, + "aggregate_load_tv": 0.0763888888888889 + }, + "period_at_s0": { + "tokens": 24, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.9166666666666666, + "mean_token_weighted_tv": 0.02931541115200768, + "aggregate_load_tv": 0.04166666666666666 + }, + "period_at_s1": { + "tokens": 24, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 10, + "mean_set_jaccard": 0.8333333333333334, + "mean_token_weighted_tv": 0.04550621848708639, + "aggregate_load_tv": 0.06944444444444445 + } + } + }, + "layer_08": { + "layer": 8, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "c0fc869b7a120fdd585adeb918b81a95ef9db83cc2a3478ea0f12d7f40ef8a8d", + "route_weight_sha256": "0de00ed63d5618e4c4546f0e8622901431e8f26f699095913fb80fbbb60b070f", + "loads": [ + 1, + 0, + 0, + 3, + 11, + 2, + 2, + 0, + 0, + 2, + 3, + 0, + 2, + 0, + 9, + 5, + 2, + 12, + 2, + 3, + 2, + 3, + 1, + 7, + 1, + 0, + 0, + 0, + 1, + 6, + 5, + 0, + 0, + 8, + 2, + 2, + 0, + 1, + 0, + 6, + 5, + 0, + 3, + 0, + 1, + 4, + 1, + 1, + 2, + 0, + 0, + 1, + 0, + 4, + 1, + 0, + 1, + 3, + 8, + 1, + 4, + 0, + 0, + 0 + ], + "weighted_loads": [ + 0.04097294062376022, + 0.0, + 0.0, + 0.21613901481032372, + 1.1932420693337917, + 0.10467993468046188, + 0.16711139678955078, + 0.0, + 0.0, + 0.09328046813607216, + 0.2212919220328331, + 0.0, + 0.11273283883929253, + 0.0, + 0.5797211267054081, + 0.3996005207300186, + 0.22214147076010704, + 1.2074465900659561, + 0.07987065240740776, + 0.14633512124419212, + 0.13442155718803406, + 0.2299507074058056, + 0.04845884069800377, + 0.5330777354538441, + 0.033468879759311676, + 0.0, + 0.0, + 0.0, + 0.04071430116891861, + 0.418607696890831, + 0.25825852155685425, + 0.0, + 0.0, + 0.4142945408821106, + 0.07651302963495255, + 0.14991164207458496, + 0.0, + 0.04740191996097565, + 0.0, + 0.3866278752684593, + 0.35031507909297943, + 0.0, + 0.20091333240270615, + 0.0, + 0.048259563744068146, + 0.35037489607930183, + 0.061181481927633286, + 0.10576217621564865, + 0.15709132701158524, + 0.0, + 0.0, + 0.058357272297143936, + 0.0, + 0.33528653532266617, + 0.1359596699476242, + 0.0, + 0.06123657524585724, + 0.17162274941802025, + 0.6395858079195023, + 0.10593712329864502, + 0.1692562773823738, + 0.0, + 0.0, + 0.0 + ], + "unique_experts": 42, + "load_cv": 1.2422599874998832, + "normalized_load_entropy": 0.8296727968538191, + "max_load_share": 0.08333333333333333 + }, + "full_input": { + "tokens": 49, + "top_k": 6, + "decisions": 294, + "ordered_route_sha256": "77dbfda17091d579195538c3afaecf23eb0530f3a95212ee5555991032e201e7", + "route_weight_sha256": "9d053076f94808b761676f1eecce64bb166458788ae566d69fbe5d0de6561b71", + "loads": [ + 1, + 6, + 2, + 4, + 14, + 2, + 7, + 1, + 9, + 2, + 4, + 3, + 9, + 7, + 9, + 5, + 2, + 15, + 2, + 3, + 2, + 3, + 3, + 7, + 1, + 11, + 0, + 0, + 1, + 6, + 8, + 0, + 4, + 22, + 2, + 2, + 0, + 1, + 0, + 13, + 12, + 0, + 3, + 0, + 1, + 11, + 9, + 5, + 2, + 2, + 3, + 1, + 11, + 4, + 5, + 7, + 1, + 3, + 12, + 1, + 4, + 0, + 1, + 3 + ], + "weighted_loads": [ + 0.04097294062376022, + 0.369229169562459, + 0.03916857857257128, + 0.2615937143564224, + 1.3621372499037534, + 0.10467993468046188, + 0.6050414517521858, + 0.045346442610025406, + 0.6128653474152088, + 0.09328046813607216, + 0.26798852905631065, + 0.10886896774172783, + 0.4947629049420357, + 0.5280990265309811, + 0.5797211267054081, + 0.3996005207300186, + 0.22214147076010704, + 1.3715217150747776, + 0.07987065240740776, + 0.14633512124419212, + 0.13442155718803406, + 0.2299507074058056, + 0.12193750590085983, + 0.5330777354538441, + 0.033468879759311676, + 0.7700113542377949, + 0.0, + 0.0, + 0.04071430116891861, + 0.418607696890831, + 0.3360291952267289, + 0.0, + 0.17107700183987617, + 1.6597211472690105, + 0.07651302963495255, + 0.14991164207458496, + 0.0, + 0.04740191996097565, + 0.0, + 0.6049244846217334, + 0.7457371242344379, + 0.0, + 0.20091333240270615, + 0.0, + 0.048259563744068146, + 1.0383316688239574, + 0.9980191849172115, + 0.22836418077349663, + 0.15709132701158524, + 0.08931464329361916, + 0.17189645767211914, + 0.058357272297143936, + 0.6613909900188446, + 0.33528653532266617, + 1.7130697462707758, + 0.3857656177133322, + 0.06123657524585724, + 0.17162274941802025, + 0.7557873940095305, + 0.10593712329864502, + 0.1692562773823738, + 0.0, + 0.04717801883816719, + 0.2055344134569168 + ], + "unique_experts": 56, + "load_cv": 0.9839049040416152, + "normalized_load_entropy": 0.8910277646496345, + "max_load_share": 0.07482993197278912 + } + }, + "s1_eos": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "b58d030aca9a2c022c58467a4ca2f89bd26ea1c0dcfde751e68b06ebe14bbc0e", + "route_weight_sha256": "579dac95ccbffade3aeab2c63f9b6c920c65231600baf80f1b30f0eb97901b86", + "loads": [ + 0, + 0, + 0, + 3, + 10, + 2, + 2, + 0, + 0, + 1, + 3, + 0, + 2, + 0, + 9, + 4, + 2, + 12, + 2, + 3, + 2, + 3, + 1, + 7, + 2, + 0, + 0, + 0, + 1, + 6, + 5, + 0, + 0, + 9, + 3, + 2, + 0, + 2, + 0, + 6, + 6, + 0, + 3, + 0, + 1, + 4, + 1, + 1, + 2, + 0, + 0, + 1, + 0, + 4, + 1, + 0, + 1, + 2, + 8, + 1, + 4, + 0, + 0, + 0 + ], + "weighted_loads": [ + 0.0, + 0.0, + 0.0, + 0.2129128873348236, + 1.1381260715425014, + 0.10465005040168762, + 0.16552288085222244, + 0.0, + 0.0, + 0.047918934375047684, + 0.21752513572573662, + 0.0, + 0.11132295429706573, + 0.0, + 0.5693016611039639, + 0.3671432137489319, + 0.22252706065773964, + 1.2056046091020107, + 0.082054752856493, + 0.14406349137425423, + 0.13214796036481857, + 0.229293804615736, + 0.048267289996147156, + 0.5273764207959175, + 0.07325276359915733, + 0.0, + 0.0, + 0.0, + 0.041815031319856644, + 0.4101237803697586, + 0.2628146931529045, + 0.0, + 0.0, + 0.45673258788883686, + 0.12092362716794014, + 0.14955029636621475, + 0.0, + 0.09810425713658333, + 0.0, + 0.382545068860054, + 0.38761455938220024, + 0.0, + 0.19801515713334084, + 0.0, + 0.05152781680226326, + 0.3434859588742256, + 0.0610208697617054, + 0.11846622079610825, + 0.16530491411685944, + 0.0, + 0.0, + 0.06795109063386917, + 0.0, + 0.3444053679704666, + 0.13145282864570618, + 0.0, + 0.07150719314813614, + 0.12246246635913849, + 0.6372864618897438, + 0.10390470176935196, + 0.17239191383123398, + 0.0, + 0.0, + 0.0 + ], + "unique_experts": 41, + "load_cv": 1.2422599874998832, + "normalized_load_entropy": 0.8273749354969933, + "max_load_share": 0.08333333333333333 + }, + "full_input": { + "tokens": 65, + "top_k": 6, + "decisions": 390, + "ordered_route_sha256": "d55c11b1fd77299726bdee9f8634a69ad71486a6619f40187a2e643c6a886382", + "route_weight_sha256": "c1099a1fd21061080a3953a9f3fd0ad8e4831fd2ff5e11b13f48bdebbbdb0941", + "loads": [ + 1, + 5, + 10, + 5, + 12, + 3, + 13, + 0, + 14, + 1, + 6, + 4, + 11, + 7, + 9, + 4, + 2, + 26, + 3, + 3, + 2, + 3, + 2, + 11, + 2, + 11, + 0, + 2, + 2, + 6, + 8, + 0, + 4, + 28, + 3, + 2, + 0, + 2, + 6, + 11, + 19, + 0, + 5, + 0, + 1, + 17, + 17, + 5, + 6, + 4, + 4, + 1, + 9, + 10, + 6, + 10, + 1, + 2, + 11, + 3, + 4, + 4, + 2, + 5 + ], + "weighted_loads": [ + 0.03889032080769539, + 0.28216821886599064, + 0.6191956913098693, + 0.3127805143594742, + 1.2933500297367573, + 0.1494317501783371, + 1.123828686773777, + 0.0, + 0.8976964503526688, + 0.047918934375047684, + 0.35023967921733856, + 0.11725641135126352, + 0.6466696746647358, + 0.49982957169413567, + 0.5693016611039639, + 0.3671432137489319, + 0.22252706065773964, + 2.206348080188036, + 0.1301536001265049, + 0.14406349137425423, + 0.13214796036481857, + 0.229293804615736, + 0.08790851011872292, + 0.7165386080741882, + 0.07325276359915733, + 1.117983117699623, + 0.0, + 0.12051612883806229, + 0.08346762135624886, + 0.4101237803697586, + 0.3392955753952265, + 0.0, + 0.14418363943696022, + 1.9554391521960497, + 0.12092362716794014, + 0.14955029636621475, + 0.0, + 0.09810425713658333, + 0.4011854790151119, + 0.5158506548032165, + 1.0003373734652996, + 0.0, + 0.3661363124847412, + 0.0, + 0.05152781680226326, + 1.591801106929779, + 1.3808406665921211, + 0.2329012854024768, + 0.5112939588725567, + 0.2608059421181679, + 0.21840676292777061, + 0.06795109063386917, + 0.5211193468421698, + 1.015865907073021, + 1.757395600900054, + 0.6205108053982258, + 0.07150719314813614, + 0.12246246635913849, + 0.7388798370957375, + 0.1771901436150074, + 0.17239191383123398, + 0.18805702775716782, + 0.09942397847771645, + 0.2943316027522087 + ], + "unique_experts": 58, + "load_cv": 0.9681176622813153, + "normalized_load_entropy": 0.8996434779927334, + "max_load_share": 0.07179487179487179 + } + }, + "s0_bos": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "c875f4a8a36b6d315a1d90b756468fc987b8b7cc105f90b8eb52c29e8a377acb", + "route_weight_sha256": "6da06836ae0dc9de5983daa6f0c7deb14dc7975c101bfb1e6881dd2d0cc63e5c", + "loads": [ + 0, + 0, + 0, + 3, + 10, + 2, + 2, + 0, + 0, + 2, + 3, + 0, + 2, + 0, + 9, + 4, + 2, + 11, + 1, + 3, + 1, + 3, + 2, + 7, + 2, + 0, + 0, + 0, + 1, + 6, + 5, + 0, + 0, + 9, + 2, + 3, + 0, + 3, + 0, + 6, + 4, + 0, + 3, + 0, + 0, + 4, + 1, + 1, + 2, + 0, + 0, + 1, + 0, + 4, + 2, + 0, + 1, + 5, + 8, + 1, + 3, + 0, + 0, + 0 + ], + "weighted_loads": [ + 0.0, + 0.0, + 0.0, + 0.2083059698343277, + 1.1115656159818172, + 0.10620512440800667, + 0.16699164360761642, + 0.0, + 0.0, + 0.09126656502485275, + 0.21929866075515747, + 0.0, + 0.11784210801124573, + 0.0, + 0.5438354834914207, + 0.36182931438088417, + 0.2250826545059681, + 1.129649706184864, + 0.04111895710229874, + 0.15014412254095078, + 0.07247821986675262, + 0.23893490061163902, + 0.09484641626477242, + 0.5443078763782978, + 0.08563057333230972, + 0.0, + 0.0, + 0.0, + 0.03596898540854454, + 0.4294544346630573, + 0.2643532417714596, + 0.0, + 0.0, + 0.47533395513892174, + 0.07691902667284012, + 0.18963373824954033, + 0.0, + 0.12461685761809349, + 0.0, + 0.4022032134234905, + 0.31749168783426285, + 0.0, + 0.2151608020067215, + 0.0, + 0.0, + 0.34455060213804245, + 0.06415440887212753, + 0.1135547012090683, + 0.1557476595044136, + 0.0, + 0.0, + 0.05588734894990921, + 0.0, + 0.35608309134840965, + 0.19166003167629242, + 0.0, + 0.05762524530291557, + 0.29839614778757095, + 0.6219936162233353, + 0.0932898223400116, + 0.11880553141236305, + 0.0, + 0.0, + 0.0 + ], + "unique_experts": 40, + "load_cv": 1.2146228393930805, + "normalized_load_entropy": 0.8289445671280197, + "max_load_share": 0.0763888888888889 + }, + "full_input": { + "tokens": 49, + "top_k": 6, + "decisions": 294, + "ordered_route_sha256": "140c694123d9e34bc207d33d973b25f542c1097f77813ce663c320637807ac5b", + "route_weight_sha256": "3cbd5948921801ad760a7be9e92e937c40f8ab20a075d94f4471f7fb251e97e7", + "loads": [ + 0, + 6, + 2, + 4, + 12, + 2, + 7, + 1, + 8, + 2, + 4, + 2, + 9, + 7, + 9, + 5, + 2, + 15, + 1, + 3, + 1, + 3, + 4, + 7, + 3, + 13, + 0, + 0, + 1, + 6, + 8, + 0, + 5, + 24, + 2, + 3, + 0, + 3, + 0, + 12, + 9, + 0, + 3, + 0, + 0, + 11, + 9, + 4, + 2, + 2, + 3, + 1, + 11, + 4, + 7, + 7, + 1, + 5, + 11, + 1, + 3, + 0, + 1, + 3 + ], + "weighted_loads": [ + 0.0, + 0.369229169562459, + 0.03916857857257128, + 0.26102190092206, + 1.2795778065919876, + 0.10620512440800667, + 0.6192878559231758, + 0.045346442610025406, + 0.5945816710591316, + 0.09126656502485275, + 0.27498751133680344, + 0.06541381776332855, + 0.4998721741139889, + 0.5114541687071323, + 0.5438354834914207, + 0.4079277329146862, + 0.2250826545059681, + 1.326593205332756, + 0.04111895710229874, + 0.15014412254095078, + 0.07247821986675262, + 0.23893490061163902, + 0.16832508146762848, + 0.5443078763782978, + 0.13131064549088478, + 0.8815886415541172, + 0.0, + 0.0, + 0.03596898540854454, + 0.4294544346630573, + 0.3912510313093662, + 0.0, + 0.22843510285019875, + 1.7513306364417076, + 0.07691902667284012, + 0.18963373824954033, + 0.0, + 0.12461685761809349, + 0.0, + 0.6332750292494893, + 0.6485570594668388, + 0.0, + 0.2151608020067215, + 0.0, + 0.0, + 0.9754310064017773, + 0.8656841740012169, + 0.22681778389960527, + 0.1557476595044136, + 0.08931464329361916, + 0.17189645767211914, + 0.05588734894990921, + 0.6613909900188446, + 0.35608309134840965, + 0.9442869331687689, + 0.3971686717122793, + 0.05762524530291557, + 0.29839614778757095, + 0.7351669408380985, + 0.0932898223400116, + 0.11880553141236305, + 0.0, + 0.04717801883816719, + 0.2055344134569168 + ], + "unique_experts": 54, + "load_cv": 0.9869104913899951, + "normalized_load_entropy": 0.889307238881467, + "max_load_share": 0.08163265306122448 + } + }, + "s1_bos": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "0443d3edca444ea071efc0aa44097a8172fd5c2c764363094658fed15b31b91e", + "route_weight_sha256": "2f679eea60b930ce0fd0e26798d5a10567d69a4c2f04def954cd2913d269576e", + "loads": [ + 0, + 0, + 0, + 3, + 12, + 2, + 2, + 0, + 0, + 2, + 2, + 0, + 2, + 0, + 9, + 4, + 3, + 11, + 2, + 2, + 2, + 3, + 2, + 7, + 2, + 0, + 0, + 0, + 1, + 6, + 5, + 0, + 0, + 8, + 4, + 2, + 0, + 2, + 0, + 6, + 4, + 0, + 3, + 0, + 0, + 4, + 1, + 1, + 2, + 0, + 0, + 1, + 0, + 4, + 1, + 0, + 1, + 3, + 8, + 1, + 3, + 0, + 1, + 0 + ], + "weighted_loads": [ + 0.0, + 0.0, + 0.0, + 0.2110867090523243, + 1.2132545001804829, + 0.10947511717677116, + 0.16728689521551132, + 0.0, + 0.0, + 0.09017721563577652, + 0.159329853951931, + 0.0, + 0.11920813098549843, + 0.0, + 0.5477943122386932, + 0.36810866743326187, + 0.2647858336567879, + 1.1393515467643738, + 0.07846872508525848, + 0.1099378690123558, + 0.13531504571437836, + 0.24120643362402916, + 0.09829601645469666, + 0.5542350523173809, + 0.08913490921258926, + 0.0, + 0.0, + 0.0, + 0.03546994552016258, + 0.4210926219820976, + 0.26209621876478195, + 0.0, + 0.0, + 0.4164669457823038, + 0.1583593636751175, + 0.1429843120276928, + 0.0, + 0.08945682644844055, + 0.0, + 0.3960583433508873, + 0.2972351536154747, + 0.0, + 0.21700868010520935, + 0.0, + 0.0, + 0.3354456014931202, + 0.06279733031988144, + 0.12153991311788559, + 0.1565760150551796, + 0.0, + 0.0, + 0.06595354527235031, + 0.0, + 0.37054724618792534, + 0.150760218501091, + 0.0, + 0.0716724619269371, + 0.19792631641030312, + 0.6260710656642914, + 0.09428130835294724, + 0.1210654117166996, + 0.0, + 0.04795929044485092, + 0.0 + ], + "unique_experts": 41, + "load_cv": 1.2297746456210363, + "normalized_load_entropy": 0.8310840016557561, + "max_load_share": 0.08333333333333333 + }, + "full_input": { + "tokens": 65, + "top_k": 6, + "decisions": 390, + "ordered_route_sha256": "e3b5327ed137da56ce33e7f15c419bbe1b8a45d99b819abe5b9f7445c691386a", + "route_weight_sha256": "8eee47161b0465244d346c179a9e79446958385623142e11a1ee7c2ce7776525", + "loads": [ + 1, + 5, + 10, + 6, + 15, + 3, + 13, + 0, + 13, + 2, + 5, + 3, + 11, + 7, + 9, + 5, + 3, + 26, + 3, + 2, + 2, + 3, + 3, + 11, + 2, + 11, + 0, + 2, + 2, + 6, + 8, + 0, + 4, + 29, + 4, + 2, + 0, + 2, + 6, + 10, + 15, + 0, + 5, + 0, + 0, + 18, + 17, + 4, + 6, + 5, + 4, + 1, + 9, + 10, + 5, + 10, + 1, + 3, + 10, + 2, + 3, + 4, + 3, + 6 + ], + "weighted_loads": [ + 0.03889032080769539, + 0.28216821886599064, + 0.6191956913098693, + 0.36084793135523796, + 1.417487259954214, + 0.15425681695342064, + 1.1399139538407326, + 0.0, + 0.8853834047913551, + 0.09017721563577652, + 0.30434397980570793, + 0.11408867686986923, + 0.6545548513531685, + 0.48643673583865166, + 0.5477943122386932, + 0.40869030356407166, + 0.2647858336567879, + 2.1754921562969685, + 0.12656757235527039, + 0.1099378690123558, + 0.13531504571437836, + 0.24120643362402916, + 0.13793723657727242, + 0.7433972395956516, + 0.08913490921258926, + 1.117983117699623, + 0.0, + 0.12051612883806229, + 0.0771225355565548, + 0.4210926219820976, + 0.3806396536529064, + 0.0, + 0.14418363943696022, + 2.048536205664277, + 0.1583593636751175, + 0.1429843120276928, + 0.0, + 0.08945682644844055, + 0.4011854790151119, + 0.5327935768291354, + 0.8660600855946541, + 0.0, + 0.3851298354566097, + 0.0, + 0.0, + 1.5995152369141579, + 1.252433031797409, + 0.22692711371928453, + 0.5025650598108768, + 0.30147017538547516, + 0.21840676292777061, + 0.06595354527235031, + 0.5211193468421698, + 1.0420077852904797, + 0.8629548083990812, + 0.6310227550566196, + 0.0716724619269371, + 0.19792631641030312, + 0.7247542925179005, + 0.12765397876501083, + 0.1210654117166996, + 0.18805702775716782, + 0.14738326892256737, + 0.3470888137817383 + ], + "unique_experts": 57, + "load_cv": 0.9641980312798805, + "normalized_load_entropy": 0.9003563179219437, + "max_load_share": 0.07435897435897436 + } + }, + "s0_x": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "ac58f6a086203c3c4e6c09f0ced36f183883a50bb5ac7b20ecf32fd1656a9c10", + "route_weight_sha256": "9cd25202a47d009492a2ddbe4e8d57020315b9be0a11629030fc9bdf051e2808", + "loads": [ + 0, + 0, + 0, + 1, + 10, + 3, + 3, + 0, + 0, + 2, + 3, + 0, + 2, + 0, + 9, + 6, + 2, + 10, + 1, + 3, + 1, + 3, + 1, + 7, + 2, + 0, + 0, + 0, + 1, + 6, + 4, + 0, + 0, + 11, + 1, + 3, + 0, + 3, + 0, + 6, + 7, + 0, + 3, + 0, + 0, + 4, + 1, + 1, + 2, + 0, + 0, + 1, + 0, + 4, + 1, + 0, + 0, + 4, + 8, + 1, + 3, + 0, + 0, + 0 + ], + "weighted_loads": [ + 0.0, + 0.0, + 0.0, + 0.08482465893030167, + 1.1195126622915268, + 0.1472429744899273, + 0.23538557440042496, + 0.0, + 0.0, + 0.08894465863704681, + 0.21640991047024727, + 0.0, + 0.11331131309270859, + 0.0, + 0.5688023902475834, + 0.43369679152965546, + 0.23182038590312004, + 1.0725627765059471, + 0.04139019921422005, + 0.14417100697755814, + 0.07331066578626633, + 0.23603083938360214, + 0.04784413054585457, + 0.5281908512115479, + 0.07609811797738075, + 0.0, + 0.0, + 0.0, + 0.044808074831962585, + 0.4170309081673622, + 0.21358780935406685, + 0.0, + 0.0, + 0.6167284771800041, + 0.04010932147502899, + 0.19208306819200516, + 0.0, + 0.12897411733865738, + 0.0, + 0.38180481269955635, + 0.48679274320602417, + 0.0, + 0.20715687051415443, + 0.0, + 0.0, + 0.36202964931726456, + 0.07106588035821915, + 0.07307031750679016, + 0.1678343564271927, + 0.0, + 0.0, + 0.054454538971185684, + 0.0, + 0.3444575071334839, + 0.14946413040161133, + 0.0, + 0.0, + 0.2374875694513321, + 0.6207199469208717, + 0.10005155950784683, + 0.1142970398068428, + 0.0, + 0.0, + 0.0 + ], + "unique_experts": 39, + "load_cv": 1.2717247935843998, + "normalized_load_entropy": 0.8157653750586763, + "max_load_share": 0.0763888888888889 + }, + "full_input": { + "tokens": 49, + "top_k": 6, + "decisions": 294, + "ordered_route_sha256": "dd878e54824026210089b9d92a9d7a1844d89b9a02c4cd9c2a2f3bd72fab8a77", + "route_weight_sha256": "404904b83815c2c0d902aa4762e777e430d7caf876a104705852582229a4fd35", + "loads": [ + 0, + 7, + 3, + 3, + 12, + 3, + 9, + 1, + 9, + 2, + 3, + 2, + 9, + 8, + 9, + 6, + 2, + 13, + 1, + 3, + 1, + 3, + 3, + 7, + 2, + 13, + 0, + 0, + 1, + 6, + 6, + 0, + 6, + 25, + 1, + 3, + 0, + 3, + 0, + 11, + 12, + 0, + 3, + 0, + 0, + 10, + 9, + 4, + 2, + 3, + 4, + 1, + 11, + 4, + 4, + 8, + 0, + 4, + 11, + 1, + 3, + 0, + 1, + 3 + ], + "weighted_loads": [ + 0.0, + 0.4214899521321058, + 0.0811197916045785, + 0.18586203455924988, + 1.282778400927782, + 0.1472429744899273, + 0.7342711500823498, + 0.045346442610025406, + 0.6596173569560051, + 0.08894465863704681, + 0.21640991047024727, + 0.06541381776332855, + 0.49534137919545174, + 0.6027094386518002, + 0.5688023902475834, + 0.43369679152965546, + 0.23182038590312004, + 1.213307362049818, + 0.04139019921422005, + 0.14417100697755814, + 0.07331066578626633, + 0.23603083938360214, + 0.12132279574871063, + 0.5281908512115479, + 0.07609811797738075, + 0.9198989607393742, + 0.0, + 0.0, + 0.044808074831962585, + 0.4170309081673622, + 0.2840927131474018, + 0.0, + 0.27888428419828415, + 1.6729112714529037, + 0.04010932147502899, + 0.19208306819200516, + 0.0, + 0.12897411733865738, + 0.0, + 0.5576861584559083, + 0.7947766706347466, + 0.0, + 0.20715687051415443, + 0.0, + 0.0, + 0.9098614007234573, + 0.8556942120194435, + 0.18633340019732714, + 0.1678343564271927, + 0.13927976042032242, + 0.22691663727164268, + 0.054454538971185684, + 0.6613909900188446, + 0.3444575071334839, + 0.818785360082984, + 0.4502772409468889, + 0.0, + 0.2374875694513321, + 0.733893271535635, + 0.10005155950784683, + 0.1142970398068428, + 0.0, + 0.04717801883816719, + 0.2055344134569168 + ], + "unique_experts": 53, + "load_cv": 1.0047552263743895, + "normalized_load_entropy": 0.8850192608081062, + "max_load_share": 0.08503401360544217 + } + }, + "s1_x": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "85f88541816b9d4b5f1b63ddf3cd18fd2f5a6133460569570bc7d95152e82086", + "route_weight_sha256": "b3a4c86983ceaebfbaae06b1a78704d763974bef6340f9072a1fd398b3964ed1", + "loads": [ + 0, + 0, + 0, + 3, + 11, + 3, + 3, + 0, + 0, + 2, + 2, + 0, + 2, + 0, + 9, + 5, + 2, + 10, + 1, + 3, + 1, + 3, + 2, + 7, + 2, + 0, + 0, + 0, + 1, + 6, + 3, + 0, + 0, + 11, + 1, + 3, + 0, + 3, + 0, + 6, + 5, + 0, + 3, + 0, + 0, + 4, + 1, + 1, + 2, + 0, + 0, + 1, + 0, + 4, + 1, + 0, + 1, + 3, + 8, + 1, + 3, + 0, + 1, + 0 + ], + "weighted_loads": [ + 0.0, + 0.0, + 0.0, + 0.20358728989958763, + 1.1805976442992687, + 0.15018348023295403, + 0.2311587892472744, + 0.0, + 0.0, + 0.09004440531134605, + 0.1557769626379013, + 0.0, + 0.1156964860856533, + 0.0, + 0.5699338130652905, + 0.3978220298886299, + 0.23208443447947502, + 1.0828331373631954, + 0.0452265590429306, + 0.14405040815472603, + 0.07540453970432281, + 0.24392428249120712, + 0.09914537146687508, + 0.5212030783295631, + 0.08362866938114166, + 0.0, + 0.0, + 0.0, + 0.037602800875902176, + 0.42513199150562286, + 0.17286770418286324, + 0.0, + 0.0, + 0.5924121737480164, + 0.044113773852586746, + 0.1788010187447071, + 0.0, + 0.13091764226555824, + 0.0, + 0.38668422773480415, + 0.3598295897245407, + 0.0, + 0.22158915922045708, + 0.0, + 0.0, + 0.34776873141527176, + 0.07128801196813583, + 0.07801029831171036, + 0.16054339706897736, + 0.0, + 0.0, + 0.06831061094999313, + 0.0, + 0.34092456102371216, + 0.15393570065498352, + 0.0, + 0.0576118566095829, + 0.19312416017055511, + 0.6328200213611126, + 0.09109584242105484, + 0.12609195709228516, + 0.0, + 0.04749385267496109, + 0.0 + ], + "unique_experts": 41, + "load_cv": 1.2472191289246473, + "normalized_load_entropy": 0.8268738665510291, + "max_load_share": 0.0763888888888889 + }, + "full_input": { + "tokens": 65, + "top_k": 6, + "decisions": 390, + "ordered_route_sha256": "5d0bea5af602b2486826dd858598fd1e5f90eafe65d6acca062ab29109d9f2ef", + "route_weight_sha256": "cd3e9c0d2e1d0f68c4a109ee5cb4e38a00b0bba1a6d86c0a1d267ad75d76477a", + "loads": [ + 1, + 6, + 11, + 5, + 13, + 4, + 16, + 0, + 14, + 2, + 5, + 4, + 11, + 9, + 9, + 5, + 2, + 24, + 2, + 3, + 1, + 3, + 3, + 11, + 2, + 14, + 0, + 2, + 2, + 6, + 5, + 0, + 5, + 29, + 1, + 3, + 0, + 3, + 6, + 9, + 16, + 0, + 5, + 0, + 0, + 16, + 16, + 4, + 6, + 6, + 5, + 1, + 9, + 10, + 4, + 10, + 1, + 3, + 10, + 2, + 3, + 4, + 3, + 5 + ], + "weighted_loads": [ + 0.03889032080769539, + 0.3262964393943548, + 0.656655459664762, + 0.3130575083196163, + 1.355568740516901, + 0.1949651800096035, + 1.284409586340189, + 0.0, + 0.9441158436238766, + 0.09004440531134605, + 0.29799578711390495, + 0.15252873301506042, + 0.6510432064533234, + 0.628153171390295, + 0.5699338130652905, + 0.3978220298886299, + 0.23208443447947502, + 2.0752896331250668, + 0.0933254063129425, + 0.14405040815472603, + 0.07540453970432281, + 0.24392428249120712, + 0.13878659158945084, + 0.7103652656078339, + 0.08362866938114166, + 1.3240101039409637, + 0.0, + 0.12051612883806229, + 0.07925539091229439, + 0.42513199150562286, + 0.24417614564299583, + 0.0, + 0.18620258569717407, + 1.8335390090942383, + 0.044113773852586746, + 0.1788010187447071, + 0.0, + 0.13091764226555824, + 0.4011854790151119, + 0.48255986254662275, + 0.8726773411035538, + 0.0, + 0.38971031457185745, + 0.0, + 0.0, + 1.4085844866931438, + 1.1402261145412922, + 0.1833974989131093, + 0.5065324418246746, + 0.35519493371248245, + 0.2915506921708584, + 0.06831061094999313, + 0.5211193468421698, + 1.0123851001262665, + 0.8217123430222273, + 0.5930978767573833, + 0.0576118566095829, + 0.19312416017055511, + 0.7315032482147217, + 0.12446851283311844, + 0.12609195709228516, + 0.18805702775716782, + 0.14691783115267754, + 0.2943316027522087 + ], + "unique_experts": 57, + "load_cv": 0.9571901680186019, + "normalized_load_entropy": 0.8994979205918299, + "max_load_share": 0.07435897435897436 + } + }, + "s0_period": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "ecdfac50e88a58c055da0dfa4275dc548e91051b15ec4db1f6dafd7c54c16026", + "route_weight_sha256": "f7e4840b86f0bdcdd2ea46918937503d487d3b53a07c7fdd8a4dafa77f3d0cd0", + "loads": [ + 0, + 0, + 0, + 2, + 10, + 3, + 2, + 0, + 0, + 1, + 3, + 0, + 2, + 0, + 8, + 5, + 2, + 11, + 1, + 2, + 1, + 3, + 2, + 7, + 2, + 0, + 0, + 0, + 1, + 6, + 5, + 0, + 0, + 11, + 2, + 3, + 0, + 2, + 0, + 6, + 7, + 0, + 3, + 0, + 0, + 4, + 1, + 1, + 2, + 0, + 0, + 1, + 0, + 4, + 1, + 0, + 0, + 5, + 8, + 1, + 3, + 0, + 0, + 0 + ], + "weighted_loads": [ + 0.0, + 0.0, + 0.0, + 0.14463786780834198, + 1.1088115647435188, + 0.1515447162091732, + 0.16326919943094254, + 0.0, + 0.0, + 0.04419129341840744, + 0.2166137918829918, + 0.0, + 0.11806637048721313, + 0.0, + 0.5254718586802483, + 0.39358414709568024, + 0.22549531236290932, + 1.1491674557328224, + 0.043618470430374146, + 0.10482394695281982, + 0.07086994498968124, + 0.24067075178027153, + 0.09425089508295059, + 0.529713150113821, + 0.07287029176950455, + 0.0, + 0.0, + 0.0, + 0.039695367217063904, + 0.41428831964731216, + 0.24786845594644547, + 0.0, + 0.0, + 0.5975426509976387, + 0.0781962051987648, + 0.19217965006828308, + 0.0, + 0.09180065244436264, + 0.0, + 0.38848812878131866, + 0.4620623290538788, + 0.0, + 0.2086602970957756, + 0.0, + 0.0, + 0.35908640921115875, + 0.06881500780582428, + 0.0731610655784607, + 0.16058766841888428, + 0.0, + 0.0, + 0.05289329215884209, + 0.0, + 0.3402649983763695, + 0.1554926633834839, + 0.0, + 0.0, + 0.27156318351626396, + 0.5927317850291729, + 0.1031695008277893, + 0.11834585294127464, + 0.0, + 0.0, + 0.0 + ], + "unique_experts": 39, + "load_cv": 1.2741494379088572, + "normalized_load_entropy": 0.816506548952601, + "max_load_share": 0.0763888888888889 + }, + "full_input": { + "tokens": 49, + "top_k": 6, + "decisions": 294, + "ordered_route_sha256": "dbc8e2b69ba17aa3075b95c505b6187db1a383361d8a9aca00a573033dbf9a6d", + "route_weight_sha256": "0fa1c1d9f96e0b3e4869df187ddfa0bd79f7b1cf85c0fbd0dac7ae467955dab5", + "loads": [ + 0, + 6, + 2, + 2, + 12, + 3, + 10, + 1, + 9, + 1, + 4, + 2, + 9, + 7, + 8, + 5, + 2, + 14, + 1, + 2, + 1, + 3, + 4, + 7, + 2, + 14, + 0, + 0, + 1, + 6, + 7, + 0, + 5, + 25, + 2, + 3, + 0, + 2, + 0, + 11, + 11, + 0, + 3, + 0, + 0, + 11, + 10, + 4, + 2, + 4, + 3, + 1, + 11, + 4, + 4, + 8, + 0, + 5, + 11, + 1, + 3, + 0, + 1, + 4 + ], + "weighted_loads": [ + 0.0, + 0.369229169562459, + 0.03916857857257128, + 0.14463786780834198, + 1.2736599333584309, + 0.1515447162091732, + 0.8234393708407879, + 0.045346442610025406, + 0.7226639576256275, + 0.04419129341840744, + 0.2663220129907131, + 0.06541381776332855, + 0.5000964365899563, + 0.5189648829400539, + 0.5254718586802483, + 0.39358414709568024, + 0.22549531236290932, + 1.278045017272234, + 0.043618470430374146, + 0.10482394695281982, + 0.07086994498968124, + 0.24067075178027153, + 0.16772956028580666, + 0.529713150113821, + 0.07287029176950455, + 0.965602982789278, + 0.0, + 0.0, + 0.039695367217063904, + 0.41428831964731216, + 0.3182768374681473, + 0.0, + 0.24515556916594505, + 1.6821852028369904, + 0.0781962051987648, + 0.19217965006828308, + 0.0, + 0.09180065244436264, + 0.0, + 0.5652042524889112, + 0.7167078331112862, + 0.0, + 0.2086602970957756, + 0.0, + 0.0, + 0.9416601918637753, + 0.9120294488966465, + 0.18642414826899767, + 0.16058766841888428, + 0.16718431189656258, + 0.17189645767211914, + 0.05289329215884209, + 0.6613909900188446, + 0.3402649983763695, + 0.8252559434622526, + 0.44085667841136456, + 0.0, + 0.27156318351626396, + 0.7059051096439362, + 0.1031695008277893, + 0.11834585294127464, + 0.0, + 0.04717801883816719, + 0.3311523348093033 + ], + "unique_experts": 53, + "load_cv": 1.0215639712631974, + "normalized_load_entropy": 0.8820201678312591, + "max_load_share": 0.08503401360544217 + } + }, + "s1_period": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "6729ce84db35a83287e12f220896a3844ade49ed1dcdd54f75546aca9d4f10a8", + "route_weight_sha256": "ed4d34b505ebf7e85432d16bfe7814d94585e0d2ac3f1bd047e2d1b65c7645ec", + "loads": [ + 0, + 0, + 0, + 3, + 11, + 3, + 3, + 0, + 0, + 2, + 2, + 0, + 2, + 0, + 8, + 5, + 2, + 10, + 2, + 3, + 2, + 3, + 2, + 7, + 2, + 0, + 0, + 0, + 1, + 6, + 3, + 0, + 0, + 10, + 2, + 2, + 0, + 3, + 0, + 6, + 5, + 0, + 3, + 0, + 0, + 4, + 1, + 1, + 2, + 0, + 0, + 1, + 0, + 4, + 1, + 0, + 1, + 3, + 8, + 1, + 3, + 0, + 1, + 0 + ], + "weighted_loads": [ + 0.0, + 0.0, + 0.0, + 0.203799556940794, + 1.1630867011845112, + 0.15581101924180984, + 0.21630505099892616, + 0.0, + 0.0, + 0.08827617391943932, + 0.1546829715371132, + 0.0, + 0.12026794999837875, + 0.0, + 0.5284460075199604, + 0.39054250344634056, + 0.23314334079623222, + 1.1205841563642025, + 0.08146907761693001, + 0.13974731788039207, + 0.13314715772867203, + 0.23650402203202248, + 0.1007983423769474, + 0.5337845757603645, + 0.0834939070045948, + 0.0, + 0.0, + 0.0, + 0.03790650516748428, + 0.4254411980509758, + 0.17337287962436676, + 0.0, + 0.0, + 0.5022474303841591, + 0.08318932354450226, + 0.14656683802604675, + 0.0, + 0.12924108281731606, + 0.0, + 0.38678498193621635, + 0.34255190938711166, + 0.0, + 0.21991155669093132, + 0.0, + 0.0, + 0.3436441048979759, + 0.06287121772766113, + 0.08000428974628448, + 0.15880291163921356, + 0.0, + 0.0, + 0.07069743424654007, + 0.0, + 0.3472028486430645, + 0.15282100439071655, + 0.0, + 0.057317107915878296, + 0.1971280574798584, + 0.6235210075974464, + 0.09381099045276642, + 0.11885954812169075, + 0.0, + 0.04622386023402214, + 0.0 + ], + "unique_experts": 41, + "load_cv": 1.204415743815489, + "normalized_load_entropy": 0.8339556713789006, + "max_load_share": 0.0763888888888889 + }, + "full_input": { + "tokens": 65, + "top_k": 6, + "decisions": 390, + "ordered_route_sha256": "c790f8b57812e16ea985e42ed92407ff17be0d8e3a7a0de67a8de7852c76f4f1", + "route_weight_sha256": "8b7ba39726b7dc32f34c413086435a61ccba8531d75011b543f7e449e3a3ad4d", + "loads": [ + 1, + 5, + 10, + 5, + 13, + 4, + 17, + 0, + 14, + 2, + 5, + 3, + 11, + 7, + 8, + 5, + 2, + 25, + 3, + 3, + 2, + 3, + 3, + 11, + 2, + 14, + 0, + 2, + 2, + 6, + 5, + 0, + 4, + 28, + 2, + 2, + 0, + 3, + 6, + 9, + 16, + 0, + 5, + 0, + 0, + 16, + 18, + 4, + 6, + 7, + 4, + 1, + 9, + 10, + 4, + 11, + 1, + 3, + 10, + 2, + 3, + 4, + 3, + 6 + ], + "weighted_loads": [ + 0.03889032080769539, + 0.28216821886599064, + 0.6191956913098693, + 0.31120458990335464, + 1.3425411842763424, + 0.20059271901845932, + 1.3881620429456234, + 0.0, + 0.9721277616918087, + 0.08827617391943932, + 0.29311973601579666, + 0.11408867686986923, + 0.6556146703660488, + 0.4932657666504383, + 0.5284460075199604, + 0.39054250344634056, + 0.23314334079623222, + 2.1618280708789825, + 0.1295679248869419, + 0.13974731788039207, + 0.13314715772867203, + 0.23650402203202248, + 0.14043956249952316, + 0.7229467630386353, + 0.0834939070045948, + 1.2989712581038475, + 0.0, + 0.12051612883806229, + 0.0795590952038765, + 0.4254411980509758, + 0.2423606999218464, + 0.0, + 0.14418363943696022, + 1.7498605027794838, + 0.08318932354450226, + 0.14656683802604675, + 0.0, + 0.12924108281731606, + 0.4011854790151119, + 0.48255095537751913, + 0.8583123125135899, + 0.0, + 0.3880327120423317, + 0.0, + 0.0, + 1.4008363969624043, + 1.2877486310899258, + 0.18539149034768343, + 0.5047919563949108, + 0.409992229193449, + 0.21840676292777061, + 0.07069743424654007, + 0.5211193468421698, + 1.0186633877456188, + 0.8189564738422632, + 0.6391916237771511, + 0.057317107915878296, + 0.1971280574798584, + 0.7222042344510555, + 0.12718366086483002, + 0.11885954812169075, + 0.18805702775716782, + 0.1456478387117386, + 0.375459760427475 + ], + "unique_experts": 57, + "load_cv": 0.9655063429912537, + "normalized_load_entropy": 0.8992425947606337, + "max_load_share": 0.07179487179487179 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 24, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.9166666666666666, + "mean_token_weighted_tv": 0.018012280847566824, + "aggregate_load_tv": 0.034722222222222224 + }, + "system_bos": { + "tokens": 24, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.8958333333333334, + "mean_token_weighted_tv": 0.024040696094743907, + "aggregate_load_tv": 0.05555555555555555 + }, + "system_x": { + "tokens": 24, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.9166666666666666, + "mean_token_weighted_tv": 0.025193139677867293, + "aggregate_load_tv": 0.041666666666666664 + }, + "system_period": { + "tokens": 24, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 13, + "mean_set_jaccard": 0.8601190476190476, + "mean_token_weighted_tv": 0.0343049883376807, + "aggregate_load_tv": 0.06944444444444445 + }, + "bos_at_s0": { + "tokens": 24, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 13, + "mean_set_jaccard": 0.8690476190476191, + "mean_token_weighted_tv": 0.03402922938888272, + "aggregate_load_tv": 0.06249999999999999 + }, + "bos_at_s1": { + "tokens": 24, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.8958333333333334, + "mean_token_weighted_tv": 0.03185329345675806, + "aggregate_load_tv": 0.055555555555555546 + }, + "x_at_s0": { + "tokens": 24, + "ordered_topk_exact_tokens": 8, + "set_exact_tokens": 9, + "mean_set_jaccard": 0.8035714285714285, + "mean_token_weighted_tv": 0.046435723857333265, + "aggregate_load_tv": 0.09027777777777778 + }, + "x_at_s1": { + "tokens": 24, + "ordered_topk_exact_tokens": 8, + "set_exact_tokens": 12, + "mean_set_jaccard": 0.8482142857142859, + "mean_token_weighted_tv": 0.042921482624175646, + "aggregate_load_tv": 0.08333333333333334 + }, + "period_at_s0": { + "tokens": 24, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 12, + "mean_set_jaccard": 0.8482142857142857, + "mean_token_weighted_tv": 0.03883058166441818, + "aggregate_load_tv": 0.08333333333333334 + }, + "period_at_s1": { + "tokens": 24, + "ordered_topk_exact_tokens": 7, + "set_exact_tokens": 13, + "mean_set_jaccard": 0.8690476190476192, + "mean_token_weighted_tv": 0.038078508145796754, + "aggregate_load_tv": 0.06944444444444445 + } + } + }, + "layer_09": { + "layer": 9, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "328fb9cc860ff242a8fead62d3886a4513381dc50664ff8c8bfa2205548b2af8", + "route_weight_sha256": "e96d10d95425a56c72b4edbe3b37c120356911154d8a510175d63d7d3fe01953", + "loads": [ + 3, + 2, + 3, + 0, + 6, + 0, + 4, + 3, + 2, + 4, + 0, + 3, + 0, + 3, + 0, + 5, + 3, + 0, + 2, + 0, + 2, + 4, + 1, + 0, + 0, + 5, + 0, + 0, + 0, + 5, + 7, + 1, + 0, + 2, + 0, + 3, + 3, + 3, + 0, + 0, + 5, + 4, + 5, + 8, + 0, + 0, + 1, + 0, + 3, + 4, + 5, + 0, + 3, + 0, + 5, + 6, + 0, + 0, + 4, + 0, + 3, + 1, + 3, + 5 + ], + "weighted_loads": [ + 0.20147981122136116, + 0.10686985030770302, + 0.16669494658708572, + 0.0, + 0.357860766351223, + 0.0, + 0.27142681926488876, + 0.16076885908842087, + 0.1980343461036682, + 0.26658401265740395, + 0.0, + 0.10766606405377388, + 0.0, + 0.1546648032963276, + 0.0, + 0.3599620535969734, + 0.18226638063788414, + 0.0, + 0.06674243323504925, + 0.0, + 0.10314217209815979, + 0.19483152031898499, + 0.050632018595933914, + 0.0, + 0.0, + 0.27617453783750534, + 0.0, + 0.0, + 0.0, + 0.24559101089835167, + 0.4356713593006134, + 0.03538836911320686, + 0.0, + 0.15252024680376053, + 0.0, + 0.2119315266609192, + 0.21587121114134789, + 0.190731018781662, + 0.0, + 0.0, + 0.24987151101231575, + 0.2654661275446415, + 0.28445079550147057, + 0.5928027406334877, + 0.0, + 0.0, + 0.08483503758907318, + 0.0, + 0.23155822604894638, + 0.30720215663313866, + 0.38524844124913216, + 0.0, + 0.15675262734293938, + 0.0, + 0.2917038220912218, + 0.7682930082082748, + 0.0, + 0.0, + 0.32821477949619293, + 0.0, + 0.21951213106513023, + 0.05668025463819504, + 0.5975250750780106, + 0.4250355511903763 + ], + "unique_experts": 40, + "load_cv": 0.9590375834240038, + "normalized_load_entropy": 0.8623929449317319, + "max_load_share": 0.05555555555555555 + }, + "full_input": { + "tokens": 49, + "top_k": 6, + "decisions": 294, + "ordered_route_sha256": "5b7ec0cc8da49f075eea1becb5a37a590664b058290fd74f1cc840bff0fa10a5", + "route_weight_sha256": "08a44d49a4cd81587b3b67aa9bbbed439b3d5fa7e7211132fcfe2e226548f06a", + "loads": [ + 9, + 3, + 3, + 0, + 8, + 0, + 4, + 3, + 4, + 4, + 11, + 3, + 3, + 8, + 0, + 5, + 4, + 1, + 2, + 12, + 2, + 4, + 6, + 2, + 3, + 6, + 0, + 1, + 0, + 5, + 8, + 7, + 2, + 2, + 9, + 10, + 3, + 3, + 2, + 0, + 5, + 14, + 5, + 8, + 5, + 9, + 13, + 0, + 5, + 4, + 10, + 1, + 3, + 4, + 5, + 11, + 5, + 0, + 6, + 4, + 3, + 1, + 5, + 6 + ], + "weighted_loads": [ + 0.6337905675172806, + 0.14473901689052582, + 0.16669494658708572, + 0.0, + 0.6387543007731438, + 0.0, + 0.27142681926488876, + 0.16076885908842087, + 0.2935544438660145, + 0.26658401265740395, + 1.1676652878522873, + 0.10766606405377388, + 0.05408299947157502, + 0.31056987354531884, + 0.0, + 0.3599620535969734, + 0.2234288789331913, + 0.04242738336324692, + 0.06674243323504925, + 1.2397038899362087, + 0.10314217209815979, + 0.19483152031898499, + 1.6561022158712149, + 0.1662648431956768, + 0.12946036458015442, + 0.3521338552236557, + 0.0, + 0.01301862858235836, + 0.0, + 0.24559101089835167, + 0.47588180750608444, + 0.22390762297436595, + 0.036605302011594176, + 0.15252024680376053, + 0.4961721021682024, + 0.6718803010880947, + 0.21587121114134789, + 0.190731018781662, + 0.08557641506195068, + 0.0, + 0.24987151101231575, + 1.3746550753712654, + 0.28445079550147057, + 0.5928027406334877, + 0.31597951985895634, + 0.771442998200655, + 1.0873347707092762, + 0.0, + 0.3565394915640354, + 0.30720215663313866, + 0.6796814315021038, + 0.034136831760406494, + 0.15675262734293938, + 0.1539362668991089, + 0.2917038220912218, + 1.0944613832980394, + 0.24164609238505363, + 0.0, + 0.4412740170955658, + 0.1711532361805439, + 0.21951213106513023, + 0.05668025463819504, + 0.6533600781112909, + 0.4612373001873493 + ], + "unique_experts": 56, + "load_cv": 0.7518468783861743, + "normalized_load_entropy": 0.9254054296023864, + "max_load_share": 0.047619047619047616 + } + }, + "s1_eos": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "52c5184c4b354ab4693d18eb5df770cdb9637643e5b569abf6a6063c7a6d2064", + "route_weight_sha256": "ee1be90a612315752349c31007e8724d412880acf3b786448aace3d7528f19d0", + "loads": [ + 3, + 2, + 3, + 0, + 5, + 0, + 5, + 4, + 2, + 4, + 0, + 3, + 0, + 2, + 0, + 5, + 3, + 0, + 1, + 0, + 3, + 4, + 0, + 0, + 0, + 6, + 0, + 0, + 0, + 5, + 8, + 0, + 0, + 2, + 0, + 3, + 3, + 4, + 0, + 0, + 5, + 4, + 4, + 8, + 0, + 0, + 1, + 0, + 3, + 4, + 5, + 0, + 3, + 0, + 5, + 6, + 0, + 0, + 4, + 0, + 3, + 1, + 3, + 5 + ], + "weighted_loads": [ + 0.19256414473056793, + 0.1059790626168251, + 0.16563955694437027, + 0.0, + 0.30676616355776787, + 0.0, + 0.31403058767318726, + 0.20834247022867203, + 0.2033149152994156, + 0.26320819556713104, + 0.0, + 0.11166863329708576, + 0.0, + 0.1051366962492466, + 0.0, + 0.3469674773514271, + 0.17865768820047379, + 0.0, + 0.029764819890260696, + 0.0, + 0.13662532344460487, + 0.1914995238184929, + 0.0, + 0.0, + 0.0, + 0.3213219791650772, + 0.0, + 0.0, + 0.0, + 0.24612068384885788, + 0.48234907165169716, + 0.0, + 0.0, + 0.15387937426567078, + 0.0, + 0.20567451789975166, + 0.2148471735417843, + 0.23547545447945595, + 0.0, + 0.0, + 0.2457771897315979, + 0.25820476189255714, + 0.2455444410443306, + 0.5833457969129086, + 0.0, + 0.0, + 0.08384093642234802, + 0.0, + 0.22579991817474365, + 0.29409049451351166, + 0.3751879632472992, + 0.0, + 0.15602828934788704, + 0.0, + 0.2910914923995733, + 0.7584003359079361, + 0.0, + 0.0, + 0.31958266720175743, + 0.0, + 0.2326790988445282, + 0.06138196587562561, + 0.5939549058675766, + 0.44160278141498566 + ], + "unique_experts": 38, + "load_cv": 0.996908802495909, + "normalized_load_entropy": 0.8521629211571141, + "max_load_share": 0.05555555555555555 + }, + "full_input": { + "tokens": 65, + "top_k": 6, + "decisions": 390, + "ordered_route_sha256": "c8b7334526b7df3beb1d50683d39baf13577fe0da060f14763cce2bbacf10f7b", + "route_weight_sha256": "2a77094c35ec456565362b15e0059034738ee32ad0466aca149dea27d1266db1", + "loads": [ + 13, + 5, + 3, + 0, + 7, + 0, + 5, + 4, + 9, + 6, + 11, + 5, + 3, + 6, + 1, + 5, + 4, + 1, + 1, + 12, + 3, + 7, + 5, + 10, + 5, + 14, + 4, + 1, + 6, + 5, + 10, + 5, + 2, + 5, + 7, + 16, + 3, + 7, + 5, + 1, + 11, + 19, + 6, + 8, + 6, + 14, + 22, + 0, + 9, + 9, + 7, + 1, + 3, + 3, + 6, + 10, + 5, + 0, + 9, + 4, + 3, + 2, + 5, + 6 + ], + "weighted_loads": [ + 0.8634342513978481, + 0.2337917760014534, + 0.16563955694437027, + 0.0, + 0.6014175675809383, + 0.0, + 0.31403058767318726, + 0.20834247022867203, + 0.6212611943483353, + 0.3534860871732235, + 1.0903534591197968, + 0.2072551492601633, + 0.05395429488271475, + 0.20084973447956145, + 0.038838326930999756, + 0.3469674773514271, + 0.2248450256884098, + 0.056257277727127075, + 0.029764819890260696, + 1.2860053852200508, + 0.13662532344460487, + 0.31796613335609436, + 1.603855388239026, + 0.7639305852353573, + 0.18875189125537872, + 0.7536790147423744, + 0.2534972205758095, + 0.01301862858235836, + 0.42415616661310196, + 0.24612068384885788, + 0.6211567707359791, + 0.1489192098379135, + 0.04203762812539935, + 0.3753409720957279, + 0.34215900488197803, + 1.037177111953497, + 0.2148471735417843, + 0.376165721565485, + 0.2425917237997055, + 0.06689780205488205, + 0.6484392695128918, + 1.8477965779602528, + 0.33788543567061424, + 0.5833457969129086, + 0.23130583949387074, + 1.1868326403200626, + 1.9333750121295452, + 0.0, + 0.5829057656228542, + 0.6247096359729767, + 0.5389305949211121, + 0.03321006894111633, + 0.15602828934788704, + 0.14868300408124924, + 0.3323995489627123, + 1.0271254107356071, + 0.23307358846068382, + 0.0, + 0.5886017978191376, + 0.1799600087106228, + 0.2326790988445282, + 0.10018923133611679, + 0.7566833421587944, + 0.47761478647589684 + ], + "unique_experts": 60, + "load_cv": 0.7388709691192584, + "normalized_load_entropy": 0.9346158614596339, + "max_load_share": 0.05641025641025641 + } + }, + "s0_bos": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "5515f2cbd680e9d2417250f26c9327456a1dfed64101f9f54182bdec62a59999", + "route_weight_sha256": "b5f4e4d2f921b9674906f84f12bb2b9764ab3b0e17e9cda4da97d65495caff66", + "loads": [ + 4, + 2, + 3, + 0, + 4, + 0, + 5, + 3, + 2, + 4, + 0, + 2, + 0, + 3, + 0, + 5, + 3, + 0, + 1, + 2, + 1, + 4, + 1, + 0, + 0, + 5, + 0, + 0, + 0, + 5, + 7, + 0, + 0, + 2, + 0, + 3, + 3, + 3, + 0, + 0, + 6, + 4, + 6, + 8, + 0, + 0, + 1, + 0, + 3, + 4, + 5, + 0, + 3, + 0, + 4, + 6, + 0, + 0, + 4, + 0, + 3, + 1, + 3, + 6 + ], + "weighted_loads": [ + 0.22583700716495514, + 0.10583318024873734, + 0.16800233349204063, + 0.0, + 0.2744906358420849, + 0.0, + 0.32828687131404877, + 0.14639438688755035, + 0.2072335183620453, + 0.2719629108905792, + 0.0, + 0.08229239657521248, + 0.0, + 0.16547416523098946, + 0.0, + 0.3619595244526863, + 0.16418272629380226, + 0.0, + 0.028562042862176895, + 0.0609702430665493, + 0.06471283733844757, + 0.1967251505702734, + 0.053590185940265656, + 0.0, + 0.0, + 0.27845217287540436, + 0.0, + 0.0, + 0.0, + 0.23413121700286865, + 0.44790688529610634, + 0.0, + 0.0, + 0.15929068624973297, + 0.0, + 0.211920116096735, + 0.22447654977440834, + 0.1844576820731163, + 0.0, + 0.0, + 0.299566101282835, + 0.2544897831976414, + 0.3197133969515562, + 0.5776802785694599, + 0.0, + 0.0, + 0.10010505467653275, + 0.0, + 0.22942772135138512, + 0.28541701659560204, + 0.39696361869573593, + 0.0, + 0.1463874038308859, + 0.0, + 0.25934235006570816, + 0.7427940033376217, + 0.0, + 0.0, + 0.3280550204217434, + 0.0, + 0.21293823048472404, + 0.058738261461257935, + 0.6392869204282761, + 0.4886804260313511 + ], + "unique_experts": 40, + "load_cv": 0.9781564923143894, + "normalized_load_entropy": 0.8592901051388888, + "max_load_share": 0.05555555555555555 + }, + "full_input": { + "tokens": 49, + "top_k": 6, + "decisions": 294, + "ordered_route_sha256": "5d98490c28ccc08781c6fd10f8232fa99a414e0159f68ca21b1714425b642d60", + "route_weight_sha256": "68d8c7389a9d46e86955bf1600e51ce3319dd759144824b82006f3424b062674", + "loads": [ + 11, + 3, + 3, + 0, + 7, + 0, + 5, + 3, + 4, + 4, + 11, + 2, + 2, + 7, + 0, + 5, + 4, + 4, + 1, + 14, + 1, + 4, + 5, + 2, + 3, + 6, + 0, + 1, + 0, + 5, + 8, + 5, + 0, + 2, + 9, + 10, + 3, + 3, + 1, + 1, + 6, + 14, + 6, + 8, + 4, + 9, + 13, + 0, + 5, + 4, + 12, + 1, + 3, + 4, + 4, + 11, + 5, + 0, + 6, + 4, + 3, + 1, + 5, + 7 + ], + "weighted_loads": [ + 0.710364330559969, + 0.14314934983849525, + 0.16800233349204063, + 0.0, + 0.6187043525278568, + 0.0, + 0.32828687131404877, + 0.14639438688755035, + 0.30275361612439156, + 0.2719629108905792, + 1.1676652878522873, + 0.08229239657521248, + 0.04669901356101036, + 0.335346476174891, + 0.0, + 0.3619595244526863, + 0.20534522458910942, + 0.15859128534793854, + 0.028562042862176895, + 1.2471651658415794, + 0.06471283733844757, + 0.1967251505702734, + 0.7317992243915796, + 0.21745648980140686, + 0.12946036458015442, + 0.3544114902615547, + 0.0, + 0.01301862858235836, + 0.0, + 0.23413121700286865, + 0.4881173335015774, + 0.1857979092746973, + 0.0, + 0.15929068624973297, + 0.4961721021682024, + 0.6699934378266335, + 0.22447654977440834, + 0.1844576820731163, + 0.04489565268158913, + 0.044823288917541504, + 0.299566101282835, + 1.3127716705203056, + 0.3197133969515562, + 0.5776802785694599, + 0.307478460483253, + 0.8646871782839298, + 1.0836252383887768, + 0.0, + 0.36946142464876175, + 0.28541701659560204, + 0.77612573094666, + 0.034136831760406494, + 0.1463874038308859, + 0.1623254492878914, + 0.25934235006570816, + 1.0743149798363447, + 0.24164609238505363, + 0.0, + 0.458019383251667, + 0.1711532361805439, + 0.21293823048472404, + 0.058738261461257935, + 0.6951219234615564, + 0.5248821750283241 + ], + "unique_experts": 56, + "load_cv": 0.7949293232716838, + "normalized_load_entropy": 0.9187208127191636, + "max_load_share": 0.047619047619047616 + } + }, + "s1_bos": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "9ee935c73a632802f4952979e397116af17b2dd3bff56c59ab489fd0a69a2eca", + "route_weight_sha256": "da72cd3f0bd265cc52b2d46244de0ec8809da2957b6e70ff4a138e73c347e315", + "loads": [ + 3, + 2, + 3, + 0, + 3, + 0, + 5, + 4, + 2, + 4, + 0, + 1, + 0, + 3, + 1, + 5, + 3, + 0, + 1, + 1, + 1, + 4, + 0, + 0, + 0, + 6, + 0, + 0, + 0, + 5, + 8, + 0, + 0, + 2, + 0, + 2, + 3, + 4, + 0, + 0, + 5, + 4, + 6, + 8, + 0, + 0, + 1, + 0, + 3, + 5, + 6, + 0, + 3, + 0, + 4, + 6, + 0, + 0, + 4, + 0, + 3, + 1, + 3, + 6 + ], + "weighted_loads": [ + 0.17892533168196678, + 0.1039675623178482, + 0.16360363364219666, + 0.0, + 0.22817574441432953, + 0.0, + 0.3303830251097679, + 0.19529327750205994, + 0.20662979781627655, + 0.2697054482996464, + 0.0, + 0.02784675918519497, + 0.0, + 0.1581605076789856, + 0.04117151349782944, + 0.35028065741062164, + 0.1685873456299305, + 0.0, + 0.027660364285111427, + 0.03021921031177044, + 0.0657537430524826, + 0.19791709072887897, + 0.0, + 0.0, + 0.0, + 0.3396913558244705, + 0.0, + 0.0, + 0.0, + 0.24004743620753288, + 0.49971386790275574, + 0.0, + 0.0, + 0.16196169704198837, + 0.0, + 0.15744948387145996, + 0.2178504653275013, + 0.23141275718808174, + 0.0, + 0.0, + 0.2663569413125515, + 0.24750860407948494, + 0.3206108585000038, + 0.5754111856222153, + 0.0, + 0.0, + 0.09866882860660553, + 0.0, + 0.21652759239077568, + 0.32751287519931793, + 0.42796236649155617, + 0.0, + 0.15930714271962643, + 0.0, + 0.2625375874340534, + 0.7196260802447796, + 0.0, + 0.0, + 0.32595399394631386, + 0.0, + 0.22977647930383682, + 0.06173323839902878, + 0.6225719153881073, + 0.5010102987289429 + ], + "unique_experts": 40, + "load_cv": 1.0153148268053926, + "normalized_load_entropy": 0.8533833886484254, + "max_load_share": 0.05555555555555555 + }, + "full_input": { + "tokens": 65, + "top_k": 6, + "decisions": 390, + "ordered_route_sha256": "02eaefcf58b398341e885da5bdacd5303fab8ab0d0079dd9c3c68215fceff0db", + "route_weight_sha256": "350a04b0595835cfe42ba1bfb889e4a0695d534ca28ddfbcdb049bc8f57c1828", + "loads": [ + 14, + 5, + 3, + 0, + 6, + 0, + 5, + 4, + 9, + 6, + 11, + 3, + 2, + 7, + 2, + 5, + 4, + 4, + 1, + 13, + 1, + 7, + 4, + 10, + 5, + 14, + 4, + 1, + 6, + 5, + 10, + 4, + 0, + 5, + 7, + 14, + 3, + 7, + 3, + 2, + 11, + 19, + 8, + 8, + 4, + 14, + 22, + 0, + 9, + 10, + 11, + 1, + 3, + 4, + 5, + 10, + 5, + 0, + 9, + 4, + 3, + 2, + 5, + 7 + ], + "weighted_loads": [ + 0.9345847219228745, + 0.22934722900390625, + 0.16360363364219666, + 0.0, + 0.5824413150548935, + 0.0, + 0.3303830251097679, + 0.19529327750205994, + 0.6245760768651962, + 0.35998333990573883, + 1.0903534591197968, + 0.12343327514827251, + 0.04700896516442299, + 0.3035084353759885, + 0.0800098404288292, + 0.35028065741062164, + 0.21477468311786652, + 0.17943905666470528, + 0.027660364285111427, + 1.3047257084399462, + 0.0657537430524826, + 0.32438370026648045, + 0.679967949166894, + 0.7799336612224579, + 0.18875189125537872, + 0.7720483914017677, + 0.2534972205758095, + 0.01301862858235836, + 0.42415616661310196, + 0.24004743620753288, + 0.6385215669870377, + 0.14608820714056492, + 0.0, + 0.3834232948720455, + 0.34215900488197803, + 0.9454008936882019, + 0.2178504653275013, + 0.3721030242741108, + 0.15267839282751083, + 0.11687222495675087, + 0.6690190210938454, + 1.8105674274265766, + 0.41295185312628746, + 0.5754111856222153, + 0.18272267188876867, + 1.327573250979185, + 1.9540260769426823, + 0.0, + 0.5915136188268661, + 0.658132016658783, + 0.7068260852247477, + 0.03321006894111633, + 0.15930714271962643, + 0.18806077912449837, + 0.3038456439971924, + 0.999866921454668, + 0.23307358846068382, + 0.0, + 0.6137884631752968, + 0.1799600087106228, + 0.22977647930383682, + 0.10054050385951996, + 0.7853003516793251, + 0.537022303789854 + ], + "unique_experts": 59, + "load_cv": 0.7540903145501581, + "normalized_load_entropy": 0.93089484325148, + "max_load_share": 0.05641025641025641 + } + }, + "s0_x": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "c32cf02a7d534c64998331e5a6de2060bab49d667209f668f5f97a7bd2d11b83", + "route_weight_sha256": "8949c596240f599a759530ae76bfdb2f00db90e90818074a8fe6d6aca248340d", + "loads": [ + 3, + 2, + 3, + 0, + 4, + 0, + 5, + 3, + 2, + 4, + 0, + 2, + 0, + 3, + 0, + 5, + 3, + 0, + 0, + 1, + 2, + 4, + 1, + 0, + 0, + 6, + 0, + 0, + 0, + 5, + 7, + 0, + 0, + 2, + 0, + 3, + 3, + 3, + 0, + 0, + 6, + 4, + 5, + 8, + 0, + 0, + 1, + 0, + 3, + 4, + 7, + 0, + 3, + 0, + 4, + 6, + 0, + 0, + 4, + 0, + 3, + 1, + 4, + 5 + ], + "weighted_loads": [ + 0.2280208170413971, + 0.10213682055473328, + 0.18704965338110924, + 0.0, + 0.26546766981482506, + 0.0, + 0.3106711655855179, + 0.14970381930470467, + 0.198850616812706, + 0.2782612144947052, + 0.0, + 0.08175082132220268, + 0.0, + 0.15536363422870636, + 0.0, + 0.3752373121678829, + 0.16070611402392387, + 0.0, + 0.0, + 0.029614921659231186, + 0.09214428626000881, + 0.20380962640047073, + 0.045156896114349365, + 0.0, + 0.0, + 0.31944289803504944, + 0.0, + 0.0, + 0.0, + 0.23865675181150436, + 0.43430862948298454, + 0.0, + 0.0, + 0.15576563775539398, + 0.0, + 0.22076422348618507, + 0.2163749635219574, + 0.18258914351463318, + 0.0, + 0.0, + 0.2951442413032055, + 0.2707774303853512, + 0.28246620669960976, + 0.5747347809374332, + 0.0, + 0.0, + 0.09668762236833572, + 0.0, + 0.24381975829601288, + 0.2891921065747738, + 0.45879090949893, + 0.0, + 0.15296382829546928, + 0.0, + 0.26077547296881676, + 0.7192954830825329, + 0.0, + 0.0, + 0.35038772970438004, + 0.0, + 0.20533325523138046, + 0.046762045472860336, + 0.6527460049837828, + 0.4497225061058998 + ], + "unique_experts": 39, + "load_cv": 0.996908802495909, + "normalized_load_entropy": 0.8544964599420412, + "max_load_share": 0.05555555555555555 + }, + "full_input": { + "tokens": 49, + "top_k": 6, + "decisions": 294, + "ordered_route_sha256": "ddb6ed77214f60779377119eec4e7f26f17c576abf0149edde95cd55b6abab15", + "route_weight_sha256": "e04a159dbafe03816349d504857c46c0744050f29fced5dff871b95b4417fb04", + "loads": [ + 11, + 2, + 3, + 0, + 6, + 0, + 5, + 3, + 4, + 4, + 12, + 2, + 2, + 7, + 0, + 5, + 5, + 1, + 0, + 13, + 2, + 4, + 5, + 2, + 3, + 9, + 0, + 1, + 0, + 5, + 8, + 5, + 0, + 2, + 10, + 9, + 3, + 3, + 3, + 0, + 6, + 14, + 5, + 8, + 4, + 8, + 13, + 0, + 6, + 4, + 12, + 1, + 3, + 3, + 4, + 11, + 5, + 0, + 6, + 6, + 3, + 1, + 6, + 6 + ], + "weighted_loads": [ + 0.8308602161705494, + 0.10213682055473328, + 0.18704965338110924, + 0.0, + 0.544381033629179, + 0.0, + 0.3106711655855179, + 0.14970381930470467, + 0.29437071457505226, + 0.2782612144947052, + 1.3171579986810684, + 0.08175082132220268, + 0.04669901356101036, + 0.2991835782304406, + 0.0, + 0.3752373121678829, + 0.23796242475509644, + 0.04242738336324692, + 0.0, + 1.1965149454772472, + 0.09214428626000881, + 0.20380962640047073, + 0.7247078362852335, + 0.17448589205741882, + 0.12946036458015442, + 0.4679309353232384, + 0.0, + 0.01301862858235836, + 0.0, + 0.23865675181150436, + 0.4745190776884556, + 0.1857979092746973, + 0.0, + 0.15576563775539398, + 0.592344643548131, + 0.641904279589653, + 0.2163749635219574, + 0.18258914351463318, + 0.12391279637813568, + 0.0, + 0.2951442413032055, + 1.2596220336854458, + 0.28246620669960976, + 0.5747347809374332, + 0.3069233475252986, + 0.6029925644397736, + 1.0552293062210083, + 0.0, + 0.42035427689552307, + 0.2891921065747738, + 0.7676461413502693, + 0.034136831760406494, + 0.15296382829546928, + 0.11826496943831444, + 0.26077547296881676, + 1.0487754475325346, + 0.24164609238505363, + 0.0, + 0.46188830211758614, + 0.24973630160093307, + 0.20533325523138046, + 0.046762045472860336, + 0.7085810080170631, + 0.48592425510287285 + ], + "unique_experts": 54, + "load_cv": 0.8041898243222374, + "normalized_load_entropy": 0.9143275058954623, + "max_load_share": 0.047619047619047616 + } + }, + "s1_x": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "8c8d943a12ef5414c33a3d6dcf96ffa1294a0162a2a35d0304fdc50c873f7fd1", + "route_weight_sha256": "1f5ba4394e103d2c714125556928ac5ae306345d98b42f30b79ae1da3b52fa0e", + "loads": [ + 4, + 2, + 3, + 0, + 4, + 0, + 4, + 3, + 2, + 4, + 0, + 2, + 0, + 3, + 1, + 5, + 3, + 0, + 0, + 0, + 2, + 3, + 0, + 0, + 0, + 8, + 0, + 0, + 0, + 6, + 7, + 0, + 0, + 2, + 0, + 2, + 3, + 3, + 0, + 0, + 5, + 4, + 5, + 9, + 0, + 0, + 2, + 0, + 3, + 4, + 6, + 0, + 3, + 0, + 4, + 6, + 0, + 0, + 4, + 0, + 3, + 1, + 3, + 6 + ], + "weighted_loads": [ + 0.27839088439941406, + 0.10220161080360413, + 0.18098363652825356, + 0.0, + 0.26303384080529213, + 0.0, + 0.2788316272199154, + 0.14937114343047142, + 0.20207997411489487, + 0.27184315770864487, + 0.0, + 0.07130503095686436, + 0.0, + 0.14963793754577637, + 0.04306454211473465, + 0.34435243159532547, + 0.16097235307097435, + 0.0, + 0.0, + 0.0, + 0.09351746551692486, + 0.17116035521030426, + 0.0, + 0.0, + 0.0, + 0.4292314015328884, + 0.0, + 0.0, + 0.0, + 0.2635462246835232, + 0.4397631697356701, + 0.0, + 0.0, + 0.15785371512174606, + 0.0, + 0.15923576056957245, + 0.22775723785161972, + 0.19045370817184448, + 0.0, + 0.0, + 0.2686840631067753, + 0.2522750645875931, + 0.2697403058409691, + 0.6223153509199619, + 0.0, + 0.0, + 0.15745212882757187, + 0.0, + 0.22432354092597961, + 0.2868262566626072, + 0.41888051852583885, + 0.0, + 0.15308470465242863, + 0.0, + 0.26575368270277977, + 0.6932720132172108, + 0.0, + 0.0, + 0.321968175470829, + 0.0, + 0.21421559154987335, + 0.05338125303387642, + 0.6364586800336838, + 0.49025534093379974 + ], + "unique_experts": 38, + "load_cv": 1.0333930687632376, + "normalized_load_entropy": 0.8485145911758016, + "max_load_share": 0.0625 + }, + "full_input": { + "tokens": 65, + "top_k": 6, + "decisions": 390, + "ordered_route_sha256": "23aa1b51bccd1452935c3d3e8574ddf47f6a5581cb583e2482a39d2e0d5cc6c3", + "route_weight_sha256": "0a547fccb719f6596ff53865789ba207efdf3b91b1562ab905910f1466f9fd79", + "loads": [ + 17, + 5, + 3, + 0, + 6, + 0, + 4, + 3, + 9, + 6, + 12, + 4, + 2, + 6, + 2, + 5, + 5, + 3, + 0, + 12, + 2, + 6, + 4, + 10, + 5, + 18, + 5, + 1, + 6, + 6, + 9, + 4, + 0, + 5, + 8, + 14, + 3, + 6, + 5, + 2, + 11, + 19, + 7, + 9, + 4, + 11, + 22, + 0, + 10, + 9, + 8, + 1, + 3, + 2, + 5, + 10, + 5, + 0, + 9, + 5, + 3, + 2, + 5, + 7 + ], + "weighted_loads": [ + 1.1729917153716087, + 0.23552218824625015, + 0.18098363652825356, + 0.0, + 0.5510574169456959, + 0.0, + 0.2788316272199154, + 0.14937114343047142, + 0.6200262531638145, + 0.3621210493147373, + 1.2519755810499191, + 0.1668915469199419, + 0.04700896516442299, + 0.24256004486232996, + 0.0819028690457344, + 0.34435243159532547, + 0.24723098799586296, + 0.14719901978969574, + 0.0, + 1.157282367348671, + 0.09351746551692486, + 0.29762696474790573, + 0.6751138959079981, + 0.7887127734720707, + 0.18875189125537872, + 0.9409299716353416, + 0.3006645441055298, + 0.01301862858235836, + 0.42415616661310196, + 0.2635462246835232, + 0.578570868819952, + 0.14608820714056492, + 0.0, + 0.3793153129518032, + 0.40266996063292027, + 0.9314578510820866, + 0.22775723785161972, + 0.33114397525787354, + 0.25643156096339226, + 0.10987609997391701, + 0.6713461428880692, + 1.6555222384631634, + 0.36208130046725273, + 0.6223153509199619, + 0.17791556846350431, + 0.8966810777783394, + 1.9256748743355274, + 0.0, + 0.6415777951478958, + 0.6174453981220722, + 0.5754338689148426, + 0.03321006894111633, + 0.15308470465242863, + 0.09995121136307716, + 0.30706173926591873, + 0.9677526317536831, + 0.23307358846068382, + 0.0, + 0.5945278406143188, + 0.23313264176249504, + 0.21421559154987335, + 0.0921885184943676, + 0.7991871163249016, + 0.5262673459947109 + ], + "unique_experts": 58, + "load_cv": 0.7744608525272949, + "normalized_load_entropy": 0.9280488842098896, + "max_load_share": 0.05641025641025641 + } + }, + "s0_period": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "7b6c00bb1e6b5c644cf3f473fb9cbe10df4e1a6ea69c671b37db1a4755d71fdd", + "route_weight_sha256": "52fb6b3a82887c312329ab58469d50a0707198ec05617d07b8324d243d387889", + "loads": [ + 4, + 2, + 3, + 0, + 4, + 0, + 5, + 3, + 2, + 4, + 0, + 2, + 0, + 3, + 1, + 5, + 3, + 0, + 1, + 1, + 2, + 4, + 1, + 0, + 0, + 5, + 0, + 0, + 0, + 5, + 7, + 0, + 0, + 2, + 0, + 3, + 3, + 3, + 0, + 0, + 5, + 4, + 5, + 8, + 0, + 0, + 1, + 0, + 3, + 4, + 6, + 0, + 3, + 0, + 4, + 6, + 0, + 0, + 4, + 0, + 3, + 1, + 3, + 6 + ], + "weighted_loads": [ + 0.25395465083420277, + 0.10099391639232635, + 0.17568568512797356, + 0.0, + 0.265029851347208, + 0.0, + 0.3197372481226921, + 0.15435681864619255, + 0.19624309241771698, + 0.277658898383379, + 0.0, + 0.07256685197353363, + 0.0, + 0.15520760044455528, + 0.040231555700302124, + 0.35709286108613014, + 0.15797918662428856, + 0.0, + 0.03753737732768059, + 0.029319502413272858, + 0.09257825277745724, + 0.2005140632390976, + 0.04666326567530632, + 0.0, + 0.0, + 0.29966647922992706, + 0.0, + 0.0, + 0.0, + 0.24184566363692284, + 0.42502377182245255, + 0.0, + 0.0, + 0.15636279433965683, + 0.0, + 0.22777418047189713, + 0.21859733760356903, + 0.1919100433588028, + 0.0, + 0.0, + 0.26038655638694763, + 0.26915113255381584, + 0.2778502553701401, + 0.5837720781564713, + 0.0, + 0.0, + 0.09636998921632767, + 0.0, + 0.238998394459486, + 0.28310564160346985, + 0.4234347715973854, + 0.0, + 0.16455359011888504, + 0.0, + 0.2622431181371212, + 0.7266553267836571, + 0.0, + 0.0, + 0.34168076515197754, + 0.0, + 0.20617204532027245, + 0.05007574334740639, + 0.6165902614593506, + 0.48318827524781227 + ], + "unique_experts": 41, + "load_cv": 0.9622504486493764, + "normalized_load_entropy": 0.8638041497336689, + "max_load_share": 0.05555555555555555 + }, + "full_input": { + "tokens": 49, + "top_k": 6, + "decisions": 294, + "ordered_route_sha256": "f6723a19e29a76d5ca2e78b58d0c38dfff2edb3251d3d5ca0d57e21bd93b97de", + "route_weight_sha256": "17f9339f04f5167cdf57b5dcbcc70809cb246dc73901eab2371ee8e18311d44c", + "loads": [ + 13, + 2, + 3, + 1, + 6, + 0, + 5, + 3, + 4, + 4, + 12, + 2, + 2, + 6, + 1, + 5, + 4, + 2, + 1, + 13, + 2, + 4, + 5, + 2, + 3, + 6, + 0, + 1, + 0, + 5, + 8, + 5, + 0, + 2, + 10, + 10, + 3, + 3, + 2, + 0, + 5, + 15, + 5, + 8, + 4, + 8, + 14, + 0, + 5, + 4, + 11, + 1, + 3, + 3, + 4, + 11, + 6, + 0, + 6, + 5, + 3, + 1, + 5, + 7 + ], + "weighted_loads": [ + 0.8648033645004034, + 0.10099391639232635, + 0.17568568512797356, + 0.044228337705135345, + 0.5387232787907124, + 0.0, + 0.3197372481226921, + 0.15435681864619255, + 0.29176319018006325, + 0.277658898383379, + 1.2633720263838768, + 0.07256685197353363, + 0.04669901356101036, + 0.26181160006672144, + 0.040231555700302124, + 0.35709286108613014, + 0.19914168491959572, + 0.09360750019550323, + 0.03753737732768059, + 1.2105909287929535, + 0.09257825277745724, + 0.2005140632390976, + 0.7250310834497213, + 0.1705222763121128, + 0.12946036458015442, + 0.3756257966160774, + 0.0, + 0.01301862858235836, + 0.0, + 0.24184566363692284, + 0.4652342200279236, + 0.1857979092746973, + 0.0, + 0.15636279433965683, + 0.5530517045408487, + 0.6860046647489071, + 0.21859733760356903, + 0.1919100433588028, + 0.0898667760193348, + 0.0, + 0.26038655638694763, + 1.300314024090767, + 0.2778502553701401, + 0.5837720781564713, + 0.30591851007193327, + 0.6247863620519638, + 1.177602555602789, + 0.0, + 0.37094422429800034, + 0.28310564160346985, + 0.7286963574588299, + 0.034136831760406494, + 0.16455359011888504, + 0.11039173603057861, + 0.2622431181371212, + 1.0617218259721994, + 0.2798539698123932, + 0.0, + 0.45608357712626457, + 0.21106117218732834, + 0.20617204532027245, + 0.05007574334740639, + 0.672425264492631, + 0.5193900242447853 + ], + "unique_experts": 57, + "load_cv": 0.8106092305949943, + "normalized_load_entropy": 0.9193222432614246, + "max_load_share": 0.05102040816326531 + } + }, + "s1_period": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "ddc2c11b0e8db8ade4d06e2e2da589323aff892ebfc2bcaf056ccc85e3ec96fc", + "route_weight_sha256": "f85c27b0b9f1e71601b3b72b27898b402c4bf04b6c52fab65afc7010e5977ed4", + "loads": [ + 5, + 2, + 3, + 0, + 4, + 0, + 4, + 4, + 2, + 4, + 0, + 2, + 0, + 3, + 1, + 5, + 3, + 0, + 0, + 1, + 1, + 4, + 0, + 0, + 0, + 6, + 0, + 0, + 0, + 5, + 7, + 0, + 0, + 2, + 0, + 3, + 3, + 3, + 0, + 0, + 5, + 4, + 5, + 9, + 0, + 0, + 1, + 0, + 3, + 4, + 6, + 0, + 3, + 0, + 4, + 6, + 0, + 0, + 4, + 0, + 3, + 1, + 3, + 6 + ], + "weighted_loads": [ + 0.30395836383104324, + 0.10074957087635994, + 0.1752423383295536, + 0.0, + 0.26504139229655266, + 0.0, + 0.2870778813958168, + 0.19647977501153946, + 0.19821877032518387, + 0.27883195132017136, + 0.0, + 0.07370784506201744, + 0.0, + 0.14762191101908684, + 0.044449467211961746, + 0.33148563653230667, + 0.15506669133901596, + 0.0, + 0.0, + 0.029670000076293945, + 0.06438116729259491, + 0.2048250176012516, + 0.0, + 0.0, + 0.0, + 0.37196048721671104, + 0.0, + 0.0, + 0.0, + 0.2304351106286049, + 0.435197401791811, + 0.0, + 0.0, + 0.16373859345912933, + 0.0, + 0.21427300572395325, + 0.22619317471981049, + 0.1937469094991684, + 0.0, + 0.0, + 0.2698398306965828, + 0.244302898645401, + 0.2715546377003193, + 0.6083353534340858, + 0.0, + 0.0, + 0.10324925184249878, + 0.0, + 0.2247225120663643, + 0.2800898961722851, + 0.4056774713099003, + 0.0, + 0.15057091787457466, + 0.0, + 0.27069707214832306, + 0.6888978146016598, + 0.0, + 0.0, + 0.3246915340423584, + 0.0, + 0.2180885523557663, + 0.051899563521146774, + 0.6406052559614182, + 0.49828242510557175 + ], + "unique_experts": 39, + "load_cv": 1.0092167846991638, + "normalized_load_entropy": 0.8526067283902575, + "max_load_share": 0.0625 + }, + "full_input": { + "tokens": 65, + "top_k": 6, + "decisions": 390, + "ordered_route_sha256": "a6f9294685c6e560b39c7f156dc5bbd11d76a5306a35ce08e9677ac40cc94a80", + "route_weight_sha256": "b66ecd46db66cf0a5fdab3f1669bbc68aad48e70426d4029afecb83d760ddbe4", + "loads": [ + 17, + 4, + 3, + 0, + 6, + 0, + 4, + 4, + 9, + 6, + 12, + 4, + 2, + 7, + 2, + 5, + 4, + 3, + 0, + 13, + 1, + 7, + 4, + 10, + 5, + 16, + 4, + 1, + 6, + 5, + 9, + 4, + 0, + 5, + 7, + 15, + 3, + 6, + 5, + 1, + 11, + 20, + 7, + 9, + 4, + 12, + 23, + 0, + 10, + 9, + 8, + 1, + 3, + 3, + 5, + 10, + 6, + 0, + 9, + 4, + 3, + 2, + 5, + 7 + ], + "weighted_loads": [ + 1.0925991013646126, + 0.18956368789076805, + 0.1752423383295536, + 0.0, + 0.5532813034951687, + 0.0, + 0.2870778813958168, + 0.19647977501153946, + 0.6161650493741035, + 0.3691098429262638, + 1.1624007672071457, + 0.16929436102509499, + 0.04700896516442299, + 0.27351943869143724, + 0.0832877941429615, + 0.33148563653230667, + 0.20125402882695198, + 0.15109547227621078, + 0.0, + 1.229498889297247, + 0.06438116729259491, + 0.3312916271388531, + 0.6766486261039972, + 0.7714620716869831, + 0.18875189125537872, + 0.8816038742661476, + 0.2534972205758095, + 0.01301862858235836, + 0.42415616661310196, + 0.2304351106286049, + 0.5740051008760929, + 0.14608820714056492, + 0.0, + 0.3852001912891865, + 0.34215900488197803, + 0.9914771988987923, + 0.22619317471981049, + 0.33443717658519745, + 0.2679731138050556, + 0.06689780205488205, + 0.6725019104778767, + 1.7470713444054127, + 0.36389563232660294, + 0.6083353534340858, + 0.1781728258356452, + 0.9309737607836723, + 2.0889970622956753, + 0.0, + 0.6380635015666485, + 0.6107090376317501, + 0.5639164857566357, + 0.03321006894111633, + 0.15057091787457466, + 0.1491202712059021, + 0.312005128711462, + 0.9715256579220295, + 0.2740013487637043, + 0.0, + 0.5952757783234119, + 0.1799600087106228, + 0.2180885523557663, + 0.09070682898163795, + 0.803333692252636, + 0.5342944301664829 + ], + "unique_experts": 58, + "load_cv": 0.794309147433323, + "normalized_load_entropy": 0.9248640899754443, + "max_load_share": 0.05897435897435897 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 24, + "ordered_topk_exact_tokens": 16, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.9315476190476191, + "mean_token_weighted_tv": 0.016682317402834695, + "aggregate_load_tv": 0.04166666666666666 + }, + "system_bos": { + "tokens": 24, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.8958333333333334, + "mean_token_weighted_tv": 0.023231103473032515, + "aggregate_load_tv": 0.0486111111111111 + }, + "system_x": { + "tokens": 24, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8720238095238096, + "mean_token_weighted_tv": 0.02797446916035066, + "aggregate_load_tv": 0.05555555555555555 + }, + "system_period": { + "tokens": 24, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.9404761904761906, + "mean_token_weighted_tv": 0.020070914179086685, + "aggregate_load_tv": 0.027777777777777783 + }, + "bos_at_s0": { + "tokens": 24, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.9047619047619048, + "mean_token_weighted_tv": 0.023244797989415627, + "aggregate_load_tv": 0.048611111111111105 + }, + "bos_at_s1": { + "tokens": 24, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.9047619047619048, + "mean_token_weighted_tv": 0.02549540946104874, + "aggregate_load_tv": 0.05555555555555555 + }, + "x_at_s0": { + "tokens": 24, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.8928571428571429, + "mean_token_weighted_tv": 0.027017352714513738, + "aggregate_load_tv": 0.04861111111111111 + }, + "x_at_s1": { + "tokens": 24, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 12, + "mean_set_jaccard": 0.8482142857142857, + "mean_token_weighted_tv": 0.03804568554429958, + "aggregate_load_tv": 0.0763888888888889 + }, + "period_at_s0": { + "tokens": 24, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.9077380952380952, + "mean_token_weighted_tv": 0.025055838205541175, + "aggregate_load_tv": 0.041666666666666664 + }, + "period_at_s1": { + "tokens": 24, + "ordered_topk_exact_tokens": 6, + "set_exact_tokens": 13, + "mean_set_jaccard": 0.8690476190476191, + "mean_token_weighted_tv": 0.035194448195397854, + "aggregate_load_tv": 0.06249999999999999 + } + } + }, + "layer_10": { + "layer": 10, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "a55278ccad997e4f5c7a4e6376978f30f427209f74b4b7763e757ce4e5feda4d", + "route_weight_sha256": "5fb7f73aa1d2442bf2d9b0d95c502cfb7f3cfbdd1aedd8233e2dc8ff2a775112", + "loads": [ + 0, + 4, + 2, + 2, + 5, + 5, + 3, + 3, + 0, + 1, + 0, + 1, + 0, + 1, + 4, + 7, + 6, + 0, + 0, + 4, + 7, + 0, + 0, + 2, + 0, + 0, + 1, + 0, + 0, + 2, + 1, + 1, + 4, + 24, + 0, + 1, + 1, + 0, + 2, + 2, + 3, + 2, + 4, + 0, + 0, + 2, + 0, + 2, + 1, + 2, + 0, + 3, + 4, + 3, + 0, + 4, + 6, + 0, + 1, + 0, + 4, + 1, + 5, + 1 + ], + "weighted_loads": [ + 0.0, + 0.2074102759361267, + 0.12606770545244217, + 0.06872828118503094, + 0.29702988266944885, + 0.44579365104436874, + 0.12684381008148193, + 0.13978588581085205, + 0.0, + 0.07068262994289398, + 0.0, + 0.06427280604839325, + 0.0, + 0.06586352735757828, + 0.22477001324295998, + 0.6168332695960999, + 0.3050919137895107, + 0.0, + 0.0, + 0.23325495421886444, + 0.4974280260503292, + 0.0, + 0.0, + 0.13560618460178375, + 0.0, + 0.0, + 0.045295897871255875, + 0.0, + 0.0, + 0.12127724289894104, + 0.04874517768621445, + 0.05330231413245201, + 0.3183901533484459, + 3.4790444150567055, + 0.0, + 0.0639084205031395, + 0.03796757012605667, + 0.0, + 0.08635704591870308, + 0.18373526632785797, + 0.16546624898910522, + 0.11815676838159561, + 0.2758125737309456, + 0.0, + 0.0, + 0.1283479630947113, + 0.0, + 0.1020817756652832, + 0.052498772740364075, + 0.1649966537952423, + 0.0, + 0.16480031982064247, + 0.2886975146830082, + 0.187619861215353, + 0.0, + 0.34054501354694366, + 0.45448553562164307, + 0.0, + 0.06638539582490921, + 0.0, + 0.23002561181783676, + 0.036314576864242554, + 0.23870932683348656, + 0.07898230850696564 + ], + "unique_experts": 43, + "load_cv": 1.4927809825049336, + "normalized_load_entropy": 0.8211854425217561, + "max_load_share": 0.16666666666666666 + }, + "full_input": { + "tokens": 49, + "top_k": 6, + "decisions": 294, + "ordered_route_sha256": "c5f405e7593829613c62fea0cb40d8375097c2e66e138ae6d9bd4f0e9a8cad91", + "route_weight_sha256": "01c69fd78a03b9caca41df0cf363cd9ec3edb7a04b5a1d9abf1062b9f340e95b", + "loads": [ + 0, + 4, + 4, + 2, + 5, + 5, + 3, + 7, + 0, + 3, + 2, + 2, + 1, + 4, + 6, + 7, + 6, + 3, + 7, + 5, + 10, + 2, + 1, + 2, + 0, + 2, + 1, + 8, + 1, + 3, + 3, + 2, + 4, + 32, + 1, + 2, + 1, + 0, + 2, + 2, + 3, + 13, + 9, + 2, + 4, + 5, + 6, + 5, + 1, + 3, + 2, + 9, + 4, + 5, + 0, + 14, + 6, + 6, + 1, + 12, + 9, + 14, + 5, + 1 + ], + "weighted_loads": [ + 0.0, + 0.2074102759361267, + 0.14510020334273577, + 0.06872828118503094, + 0.29702988266944885, + 0.44579365104436874, + 0.12684381008148193, + 0.314879585057497, + 0.0, + 0.09514711890369654, + 0.09344489127397537, + 0.11225062608718872, + 0.03279339522123337, + 1.4821070097386837, + 0.36525896936655045, + 0.6168332695960999, + 0.3050919137895107, + 0.17995210364460945, + 0.38441321859136224, + 0.2971509099006653, + 0.6119573451578617, + 0.08326978608965874, + 0.003731429111212492, + 0.13560618460178375, + 0.0, + 0.06322913430631161, + 0.045295897871255875, + 0.9155034869909286, + 0.04660563915967941, + 0.16395417600870132, + 0.24586967378854752, + 0.06708252616226673, + 0.3183901533484459, + 3.8469962254166603, + 0.029802804812788963, + 0.10082492232322693, + 0.03796757012605667, + 0.0, + 0.08635704591870308, + 0.18373526632785797, + 0.16546624898910522, + 1.5331639125943184, + 0.425559020601213, + 0.09672427177429199, + 0.21302295103669167, + 0.27303391322493553, + 0.26920871436595917, + 0.20847395434975624, + 0.052498772740364075, + 0.22032850235700607, + 0.09573136642575264, + 0.46365533024072647, + 0.2886975146830082, + 0.31621071323752403, + 0.0, + 1.2123380601406097, + 0.45448553562164307, + 0.3466404974460602, + 0.06638539582490921, + 0.8034998215734959, + 0.5602370835840702, + 1.132015086710453, + 0.23870932683348656, + 0.07898230850696564 + ], + "unique_experts": 59, + "load_cv": 1.0550798911695873, + "normalized_load_entropy": 0.8997223271037006, + "max_load_share": 0.10884353741496598 + } + }, + "s1_eos": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "426353580698dc04a25a052df033e9de8479b7dc93fbe447935552b58b7a037c", + "route_weight_sha256": "5608b2f8ef8977518fabfa2d3b1b0b16cfff29b095c075579613838b46857bb7", + "loads": [ + 0, + 4, + 2, + 2, + 5, + 5, + 3, + 3, + 0, + 1, + 0, + 1, + 0, + 1, + 5, + 7, + 6, + 0, + 0, + 5, + 7, + 0, + 0, + 2, + 0, + 0, + 1, + 0, + 0, + 2, + 1, + 1, + 4, + 24, + 0, + 1, + 1, + 0, + 2, + 2, + 3, + 2, + 2, + 0, + 0, + 2, + 0, + 2, + 1, + 2, + 0, + 3, + 4, + 3, + 0, + 4, + 6, + 0, + 1, + 0, + 4, + 1, + 5, + 1 + ], + "weighted_loads": [ + 0.0, + 0.20276661217212677, + 0.12794673070311546, + 0.06644898653030396, + 0.2985846921801567, + 0.4547722600400448, + 0.12646407261490822, + 0.13584642484784126, + 0.0, + 0.06866732984781265, + 0.0, + 0.06369242072105408, + 0.0, + 0.0668322965502739, + 0.2587758041918278, + 0.6424352265894413, + 0.30475132167339325, + 0.0, + 0.0, + 0.2711709998548031, + 0.496691569685936, + 0.0, + 0.0, + 0.13360103033483028, + 0.0, + 0.0, + 0.048542484641075134, + 0.0, + 0.0, + 0.12174055725336075, + 0.04857263341546059, + 0.05269639939069748, + 0.3281130976974964, + 3.464547388255596, + 0.0, + 0.06362957507371902, + 0.03710564598441124, + 0.0, + 0.08500449731945992, + 0.1812281757593155, + 0.1599387302994728, + 0.10921430587768555, + 0.19575729966163635, + 0.0, + 0.0, + 0.1307501643896103, + 0.0, + 0.1041114404797554, + 0.05401185527443886, + 0.1668918877840042, + 0.0, + 0.16256899014115334, + 0.27667563036084175, + 0.19166896119713783, + 0.0, + 0.33176103234291077, + 0.43862809240818024, + 0.0, + 0.06738750636577606, + 0.0, + 0.2272694818675518, + 0.03697780892252922, + 0.2437591589987278, + 0.07913669943809509 + ], + "unique_experts": 43, + "load_cv": 1.4989708403591158, + "normalized_load_entropy": 0.8197742377198189, + "max_load_share": 0.16666666666666666 + }, + "full_input": { + "tokens": 65, + "top_k": 6, + "decisions": 390, + "ordered_route_sha256": "c2038b57db4494dc321779404106d01bfa2c20b8221bd1419728c74dc174a2ef", + "route_weight_sha256": "1acd4c51b19d6f600cb180edca34e4083628f8a2c011091796c5f40d2a74d94f", + "loads": [ + 0, + 4, + 5, + 2, + 10, + 5, + 3, + 4, + 0, + 3, + 3, + 4, + 4, + 3, + 8, + 7, + 6, + 5, + 6, + 5, + 8, + 1, + 1, + 2, + 1, + 3, + 2, + 23, + 0, + 5, + 9, + 2, + 9, + 40, + 2, + 3, + 4, + 3, + 3, + 2, + 4, + 19, + 7, + 2, + 3, + 7, + 6, + 5, + 9, + 4, + 3, + 17, + 5, + 6, + 0, + 17, + 7, + 7, + 1, + 19, + 15, + 11, + 5, + 1 + ], + "weighted_loads": [ + 0.0, + 0.20276661217212677, + 0.18778364500030875, + 0.06644898653030396, + 0.5374630987644196, + 0.4547722600400448, + 0.12646407261490822, + 0.17372839897871017, + 0.0, + 0.09380464907735586, + 0.11607566103339195, + 0.2352030910551548, + 0.19990605115890503, + 1.4414070472121239, + 0.47570715099573135, + 0.6424352265894413, + 0.30475132167339325, + 0.28356072679162025, + 0.3635204085148871, + 0.2711709998548031, + 0.5368048921227455, + 0.048981741070747375, + 0.003920895047485828, + 0.13360103033483028, + 0.04166174307465553, + 0.3232223931699991, + 0.09065286442637444, + 1.572050267830491, + 0.0, + 0.25397199392318726, + 0.6908105760812759, + 0.0664766114205122, + 0.8156811855733395, + 4.274929167702794, + 0.142679987475276, + 0.22908153384923935, + 0.1506434828042984, + 0.12720591202378273, + 0.12123190984129906, + 0.1812281757593155, + 0.20207494124770164, + 1.8704652674496174, + 0.3304458502680063, + 0.069225138053298, + 0.1779939904808998, + 0.3892267644405365, + 0.32753248885273933, + 0.2064850553870201, + 0.703280296176672, + 0.3003860265016556, + 0.17819882556796074, + 0.979179784655571, + 0.34667637571692467, + 0.36231754347682, + 0.0, + 1.441258180886507, + 0.5117580965161324, + 0.3881781995296478, + 0.06738750636577606, + 1.2310320362448692, + 0.9929013624787331, + 0.9313965067267418, + 0.2437591589987278, + 0.07913669943809509 + ], + "unique_experts": 60, + "load_cv": 1.0645812948447542, + "normalized_load_entropy": 0.8997256015516101, + "max_load_share": 0.10256410256410256 + } + }, + "s0_bos": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "3b1c1e69ed02677f095ce7267fd3cba8bef578406fd9800d897a1c58e1563e3b", + "route_weight_sha256": "ec4e7b7efd2b9fd6449f2c8633ddb78836c4c464433421472221590a374e444b", + "loads": [ + 0, + 4, + 2, + 2, + 5, + 5, + 3, + 2, + 0, + 2, + 0, + 1, + 0, + 1, + 4, + 7, + 5, + 0, + 0, + 3, + 7, + 0, + 0, + 2, + 0, + 1, + 1, + 1, + 0, + 3, + 1, + 1, + 4, + 24, + 0, + 1, + 1, + 0, + 2, + 2, + 4, + 2, + 4, + 0, + 0, + 1, + 0, + 2, + 1, + 2, + 0, + 3, + 4, + 3, + 0, + 4, + 6, + 0, + 1, + 0, + 4, + 1, + 4, + 1 + ], + "weighted_loads": [ + 0.0, + 0.21315016970038414, + 0.13688036799430847, + 0.07545837759971619, + 0.2867387570440769, + 0.44442329928278923, + 0.12927956879138947, + 0.0934397429227829, + 0.0, + 0.122904933989048, + 0.0, + 0.06498152017593384, + 0.0, + 0.058101046830415726, + 0.2440977580845356, + 0.6508935838937759, + 0.2542516179382801, + 0.0, + 0.0, + 0.17169136926531792, + 0.4815000556409359, + 0.0, + 0.0, + 0.1345910243690014, + 0.0, + 0.0391203947365284, + 0.044256191700696945, + 0.03698798269033432, + 0.0, + 0.1678585596382618, + 0.0489768423140049, + 0.04811181128025055, + 0.3123203106224537, + 3.43743047863245, + 0.0, + 0.06583785265684128, + 0.04093686491250992, + 0.0, + 0.08647824823856354, + 0.18060395866632462, + 0.19931314885616302, + 0.09994783997535706, + 0.2821452431380749, + 0.0, + 0.0, + 0.07699941843748093, + 0.0, + 0.11229977756738663, + 0.05607433617115021, + 0.17969205230474472, + 0.0, + 0.16400044411420822, + 0.27653423324227333, + 0.19258345663547516, + 0.0, + 0.34613577648997307, + 0.4575081840157509, + 0.0, + 0.06369012594223022, + 0.0, + 0.240049097687006, + 0.03492162376642227, + 0.20709695294499397, + 0.07126925140619278 + ], + "unique_experts": 45, + "load_cv": 1.4740554623801776, + "normalized_load_entropy": 0.8298773117397269, + "max_load_share": 0.16666666666666666 + }, + "full_input": { + "tokens": 49, + "top_k": 6, + "decisions": 294, + "ordered_route_sha256": "142353051da59b157208b0309a3b6f744fe83a601dd1707da4056a51fc5059cd", + "route_weight_sha256": "8a073fc6df1012441909b756e4e11abc633a82f72d9a93452be1d21dacad5fcc", + "loads": [ + 0, + 5, + 3, + 2, + 5, + 5, + 3, + 6, + 0, + 3, + 2, + 2, + 1, + 4, + 7, + 7, + 5, + 3, + 6, + 4, + 11, + 2, + 0, + 2, + 0, + 3, + 1, + 11, + 1, + 4, + 3, + 2, + 4, + 32, + 1, + 2, + 1, + 0, + 2, + 2, + 4, + 12, + 9, + 2, + 3, + 4, + 6, + 5, + 1, + 5, + 2, + 8, + 4, + 5, + 0, + 14, + 6, + 6, + 1, + 13, + 9, + 13, + 4, + 1 + ], + "weighted_loads": [ + 0.0, + 0.25045245885849, + 0.15103092975914478, + 0.07545837759971619, + 0.2867387570440769, + 0.44442329928278923, + 0.12927956879138947, + 0.26853344216942787, + 0.0, + 0.13914364948868752, + 0.09344489127397537, + 0.11295934021472931, + 0.03279339522123337, + 0.6053617186844349, + 0.43332772701978683, + 0.6508935838937759, + 0.2542516179382801, + 0.18617187440395355, + 0.4025057181715965, + 0.23558732494711876, + 0.6669410578906536, + 0.08326978608965874, + 0.0, + 0.1345910243690014, + 0.0, + 0.10234952904284, + 0.044256191700696945, + 1.0997744463384151, + 0.04660563915967941, + 0.21053549274802208, + 0.24728335067629814, + 0.06189202331006527, + 0.3123203106224537, + 3.8191591799259186, + 0.029802804812788963, + 0.10275435447692871, + 0.04093686491250992, + 0.0, + 0.08647824823856354, + 0.18060395866632462, + 0.19931314885616302, + 1.5572259239852428, + 0.4776736218482256, + 0.09672427177429199, + 0.20096497237682343, + 0.22168536856770515, + 0.26920871436595917, + 0.2197798155248165, + 0.05607433617115021, + 0.3394786659628153, + 0.09573136642575264, + 0.40401284024119377, + 0.27653423324227333, + 0.32230107858777046, + 0.0, + 1.180137138813734, + 0.4575081840157509, + 0.3466404974460602, + 0.06369012594223022, + 0.8432288952171803, + 0.5788814797997475, + 1.0741374716162682, + 0.20709695294499397, + 0.07126925140619278 + ], + "unique_experts": 58, + "load_cv": 1.059282192561633, + "normalized_load_entropy": 0.8977324446656108, + "max_load_share": 0.10884353741496598 + } + }, + "s1_bos": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "d61d7151c02c17e4ff56732a5e5303fcbdcf2265db0ca94b15d5f519668aeae7", + "route_weight_sha256": "8ab33c523bf854c02f403df27905d88f81bcbf7c6f5dc2ac5bf557c78ddbb101", + "loads": [ + 0, + 4, + 2, + 2, + 5, + 5, + 3, + 2, + 0, + 2, + 0, + 1, + 0, + 1, + 4, + 7, + 5, + 0, + 0, + 4, + 7, + 0, + 0, + 2, + 0, + 1, + 1, + 0, + 0, + 3, + 1, + 1, + 4, + 24, + 0, + 1, + 1, + 0, + 2, + 2, + 3, + 2, + 3, + 0, + 0, + 2, + 0, + 2, + 1, + 2, + 0, + 3, + 4, + 3, + 0, + 4, + 6, + 0, + 1, + 0, + 4, + 1, + 5, + 1 + ], + "weighted_loads": [ + 0.0, + 0.2061937227845192, + 0.13309215381741524, + 0.07223324105143547, + 0.2892009802162647, + 0.4326455444097519, + 0.1298511102795601, + 0.07936719059944153, + 0.0, + 0.11898550018668175, + 0.0, + 0.06297804415225983, + 0.0, + 0.061079297214746475, + 0.2448783852159977, + 0.6716980449855328, + 0.2597600556910038, + 0.0, + 0.0, + 0.20779823884367943, + 0.4584268406033516, + 0.0, + 0.0, + 0.13505112007260323, + 0.0, + 0.038751017302274704, + 0.04652966558933258, + 0.0, + 0.0, + 0.1722589172422886, + 0.04884718731045723, + 0.04694344475865364, + 0.3275735415518284, + 3.54106492549181, + 0.0, + 0.06444020569324493, + 0.037556663155555725, + 0.0, + 0.08665124326944351, + 0.18586282432079315, + 0.15903746709227562, + 0.10078081116080284, + 0.23818574100732803, + 0.0, + 0.0, + 0.12164768949151039, + 0.0, + 0.1060887835919857, + 0.05909780040383339, + 0.17868468910455704, + 0.0, + 0.16900967061519623, + 0.27011266723275185, + 0.19018147140741348, + 0.0, + 0.3314887210726738, + 0.45089898258447647, + 0.0, + 0.06856030225753784, + 0.0, + 0.23865095525979996, + 0.03467770665884018, + 0.24219616129994392, + 0.07016885280609131 + ], + "unique_experts": 44, + "load_cv": 1.4782371884055634, + "normalized_load_entropy": 0.8271405895445877, + "max_load_share": 0.16666666666666666 + }, + "full_input": { + "tokens": 65, + "top_k": 6, + "decisions": 390, + "ordered_route_sha256": "f27fc61e513adc919e56f629b0bbb446c665493f3fd12f55e7627d90bfc90e61", + "route_weight_sha256": "1bfd0499551fefbd82335d42bcb268ac6a02fe2101e63303ac99ba24076dc61e", + "loads": [ + 0, + 4, + 4, + 2, + 10, + 5, + 3, + 3, + 0, + 3, + 3, + 4, + 4, + 3, + 8, + 7, + 5, + 4, + 5, + 5, + 9, + 1, + 0, + 2, + 1, + 4, + 2, + 24, + 0, + 6, + 9, + 2, + 9, + 41, + 2, + 3, + 4, + 3, + 3, + 2, + 4, + 19, + 6, + 2, + 3, + 7, + 6, + 5, + 9, + 6, + 3, + 16, + 5, + 6, + 0, + 17, + 7, + 7, + 1, + 20, + 15, + 11, + 5, + 1 + ], + "weighted_loads": [ + 0.0, + 0.2061937227845192, + 0.18791464529931545, + 0.07223324105143547, + 0.5280793868005276, + 0.4326455444097519, + 0.1298511102795601, + 0.11724916473031044, + 0.0, + 0.13522421568632126, + 0.11607566103339195, + 0.23448871448636055, + 0.19990605115890503, + 0.5695282891392708, + 0.5141572467982769, + 0.6716980449855328, + 0.2597600556910038, + 0.22686324641108513, + 0.400654386729002, + 0.2539810389280319, + 0.5551085881888866, + 0.048981741070747375, + 0.0, + 0.13505112007260323, + 0.04166174307465553, + 0.3619734104722738, + 0.08864004537463188, + 1.671112833544612, + 0.0, + 0.3044903539121151, + 0.6935896426439285, + 0.06072365678846836, + 0.8151416294276714, + 4.3891125079244375, + 0.142679987475276, + 0.22989216446876526, + 0.1510944999754429, + 0.12720591202378273, + 0.12287865579128265, + 0.18586282432079315, + 0.20117367804050446, + 2.0440272390842438, + 0.321428332477808, + 0.069225138053298, + 0.216467946767807, + 0.3801242895424366, + 0.32753248885273933, + 0.20713282749056816, + 0.7083662413060665, + 0.4093335494399071, + 0.17819882556796074, + 0.9170910343527794, + 0.34011341258883476, + 0.3690161369740963, + 0.0, + 1.436411328613758, + 0.5240289866924286, + 0.3881781995296478, + 0.06856030225753784, + 1.2853468246757984, + 1.0087036043405533, + 0.9290964044630527, + 0.24219616129994392, + 0.07016885280609131 + ], + "unique_experts": 59, + "load_cv": 1.089583698677346, + "normalized_load_entropy": 0.8955381103758091, + "max_load_share": 0.10512820512820513 + } + }, + "s0_x": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "6427d670d861a37d3851a791cb94ff1ee314c1d09aac23ee7f3542c9e5bbfe57", + "route_weight_sha256": "2f55ca219f877ced1bcbece840bbc47afc2f733bf4f86c231cf73ff57b988224", + "loads": [ + 0, + 4, + 2, + 2, + 5, + 5, + 3, + 2, + 0, + 1, + 0, + 1, + 0, + 1, + 3, + 7, + 6, + 0, + 0, + 3, + 7, + 0, + 0, + 2, + 0, + 1, + 1, + 0, + 0, + 3, + 1, + 1, + 4, + 24, + 0, + 1, + 1, + 0, + 2, + 2, + 4, + 4, + 3, + 0, + 0, + 2, + 0, + 3, + 1, + 2, + 0, + 3, + 4, + 3, + 0, + 4, + 6, + 0, + 1, + 0, + 4, + 1, + 3, + 1 + ], + "weighted_loads": [ + 0.0, + 0.21350502222776413, + 0.13482563570141792, + 0.08017410337924957, + 0.2951788865029812, + 0.4463649205863476, + 0.13853513821959496, + 0.09241548925638199, + 0.0, + 0.0673099234700203, + 0.0, + 0.06322664022445679, + 0.0, + 0.05296221002936363, + 0.188601765781641, + 0.6612978354096413, + 0.2914368212223053, + 0.0, + 0.0, + 0.1486228033900261, + 0.47735850140452385, + 0.0, + 0.0, + 0.13702469319105148, + 0.0, + 0.042801693081855774, + 0.042914364486932755, + 0.0, + 0.0, + 0.18044044077396393, + 0.048153024166822433, + 0.04668630287051201, + 0.3163548372685909, + 3.392635479569435, + 0.0, + 0.06137710437178612, + 0.04045352339744568, + 0.0, + 0.09000712633132935, + 0.19662859290838242, + 0.1966419629752636, + 0.2113405130803585, + 0.23695755004882812, + 0.0, + 0.0, + 0.11615730077028275, + 0.0, + 0.15153726562857628, + 0.055932145565748215, + 0.17675918340682983, + 0.0, + 0.1714380756020546, + 0.27915528416633606, + 0.19607598334550858, + 0.0, + 0.3495757132768631, + 0.45910925045609474, + 0.0, + 0.06348469853401184, + 0.0, + 0.24814243242144585, + 0.03185511752963066, + 0.15570877119898796, + 0.07549750804901123 + ], + "unique_experts": 44, + "load_cv": 1.4803236216082476, + "normalized_load_entropy": 0.8264980472275233, + "max_load_share": 0.16666666666666666 + }, + "full_input": { + "tokens": 49, + "top_k": 6, + "decisions": 294, + "ordered_route_sha256": "27d7c631e14cb4238d23e65cd227382faeac403b8b07e0aef45b28092cc4932e", + "route_weight_sha256": "b55749c2117ebdccd08c5741486733af7136e970338bb05fa13713472ebf91cd", + "loads": [ + 0, + 5, + 3, + 2, + 5, + 5, + 3, + 7, + 0, + 2, + 2, + 2, + 1, + 3, + 5, + 7, + 6, + 4, + 5, + 4, + 10, + 2, + 0, + 2, + 0, + 3, + 1, + 7, + 1, + 4, + 3, + 2, + 4, + 33, + 1, + 2, + 1, + 0, + 2, + 2, + 4, + 13, + 7, + 2, + 4, + 6, + 7, + 7, + 1, + 4, + 3, + 9, + 4, + 5, + 0, + 13, + 6, + 7, + 1, + 13, + 9, + 14, + 3, + 1 + ], + "weighted_loads": [ + 0.0, + 0.26100973784923553, + 0.14897619746625423, + 0.08017410337924957, + 0.2951788865029812, + 0.4463649205863476, + 0.13853513821959496, + 0.30653466656804085, + 0.0, + 0.0835486389696598, + 0.09344489127397537, + 0.11120446026325226, + 0.03279339522123337, + 0.5571586042642593, + 0.32274212688207626, + 0.6612978354096413, + 0.2914368212223053, + 0.2303774170577526, + 0.3385411724448204, + 0.21251875907182693, + 0.5918878205120564, + 0.08326978608965874, + 0.0, + 0.13702469319105148, + 0.0, + 0.10603082738816738, + 0.042914364486932755, + 0.8333763964474201, + 0.04660563915967941, + 0.2231173738837242, + 0.25115660205483437, + 0.06046651490032673, + 0.3163548372685909, + 3.805568680167198, + 0.029802804812788963, + 0.09829360619187355, + 0.04045352339744568, + 0.0, + 0.09000712633132935, + 0.19662859290838242, + 0.1966419629752636, + 1.3446046113967896, + 0.3816882502287626, + 0.09672427177429199, + 0.21683244779706, + 0.32979485765099525, + 0.3186831958591938, + 0.29751331731677055, + 0.055932145565748215, + 0.26334885135293007, + 0.12996966019272804, + 0.48400944098830223, + 0.27915528416633606, + 0.31569890305399895, + 0.0, + 1.0699658654630184, + 0.45910925045609474, + 0.4100257083773613, + 0.06348469853401184, + 0.8386490792036057, + 0.5855806916952133, + 1.157565627247095, + 0.15570877119898796, + 0.07549750804901123 + ], + "unique_experts": 58, + "load_cv": 1.070407676893335, + "normalized_load_entropy": 0.8975673713131231, + "max_load_share": 0.11224489795918367 + } + }, + "s1_x": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "4f966cbf677a78645af16cc8dc524d74381f7b3a54d0b6b9bcdfbd5bb39c546c", + "route_weight_sha256": "1cfb7ab8fe3ccd50361a27bc346ab9b451b85a2358a0cd7d26b5ed857a2170ca", + "loads": [ + 0, + 4, + 2, + 2, + 5, + 5, + 3, + 2, + 0, + 2, + 0, + 1, + 0, + 1, + 3, + 7, + 5, + 0, + 0, + 4, + 7, + 0, + 0, + 2, + 0, + 1, + 1, + 1, + 1, + 3, + 1, + 1, + 4, + 24, + 0, + 1, + 1, + 0, + 2, + 2, + 3, + 3, + 3, + 0, + 0, + 2, + 0, + 3, + 1, + 2, + 0, + 3, + 4, + 3, + 0, + 4, + 6, + 0, + 1, + 0, + 3, + 1, + 3, + 1 + ], + "weighted_loads": [ + 0.0, + 0.20619503781199455, + 0.13605771586298943, + 0.07500125467777252, + 0.2938542887568474, + 0.4384610988199711, + 0.1288013681769371, + 0.08308404311537743, + 0.0, + 0.11382779851555824, + 0.0, + 0.05863999202847481, + 0.0, + 0.055391520261764526, + 0.19042840227484703, + 0.6546273268759251, + 0.2523619011044502, + 0.0, + 0.0, + 0.1866146344691515, + 0.47804177924990654, + 0.0, + 0.0, + 0.13225328363478184, + 0.0, + 0.039150577038526535, + 0.046236880123615265, + 0.036280740052461624, + 0.04313866049051285, + 0.17750677466392517, + 0.046338554471731186, + 0.04507971927523613, + 0.318394485861063, + 3.4665821939706802, + 0.0, + 0.0663231685757637, + 0.03900706395506859, + 0.0, + 0.08982814848423004, + 0.1916065588593483, + 0.15581810474395752, + 0.1522759608924389, + 0.22226208820939064, + 0.0, + 0.0, + 0.11213543638586998, + 0.0, + 0.1450868360698223, + 0.05898725613951683, + 0.18046975135803223, + 0.0, + 0.18250969052314758, + 0.26581504568457603, + 0.1981729455292225, + 0.0, + 0.33230213820934296, + 0.47793133184313774, + 0.0, + 0.06569666415452957, + 0.0, + 0.19647811725735664, + 0.033373210579156876, + 0.15467848256230354, + 0.07009701430797577 + ], + "unique_experts": 46, + "load_cv": 1.4593250596181886, + "normalized_load_entropy": 0.8362091114932214, + "max_load_share": 0.16666666666666666 + }, + "full_input": { + "tokens": 65, + "top_k": 6, + "decisions": 390, + "ordered_route_sha256": "c50aa54ab8dcbcfba8e069d656b26c5a6c80f6f09650aec8d1b8813d849594b8", + "route_weight_sha256": "2b4402ce2b28a8d89585b896ef034c25d0fac4a62edbd40bb1f8dc70663555f5", + "loads": [ + 1, + 5, + 4, + 2, + 10, + 5, + 3, + 4, + 0, + 3, + 4, + 4, + 4, + 2, + 7, + 7, + 5, + 5, + 4, + 4, + 8, + 1, + 0, + 2, + 1, + 4, + 2, + 21, + 1, + 6, + 10, + 2, + 9, + 41, + 2, + 3, + 4, + 3, + 3, + 2, + 4, + 19, + 6, + 2, + 2, + 8, + 7, + 7, + 9, + 6, + 5, + 18, + 5, + 6, + 0, + 15, + 7, + 8, + 1, + 18, + 13, + 12, + 3, + 1 + ], + "weighted_loads": [ + 0.05338577181100845, + 0.25649064779281616, + 0.19088020734488964, + 0.07500125467777252, + 0.5327326953411102, + 0.4384610988199711, + 0.1288013681769371, + 0.1699218563735485, + 0.0, + 0.13006651401519775, + 0.16602184996008873, + 0.23015066236257553, + 0.19990605115890503, + 0.5245552062988281, + 0.45836083963513374, + 0.6546273268759251, + 0.2523619011044502, + 0.26451990380883217, + 0.3231992907822132, + 0.1866146344691515, + 0.5181551016867161, + 0.048981741070747375, + 0.0, + 0.13225328363478184, + 0.04166174307465553, + 0.36237297020852566, + 0.08834725990891457, + 1.4111460987478495, + 0.04313866049051285, + 0.3097382113337517, + 0.7734624408185482, + 0.05885993130505085, + 0.805962573736906, + 4.330699959769845, + 0.142679987475276, + 0.23177512735128403, + 0.15254490077495575, + 0.12720591202378273, + 0.12605556100606918, + 0.1916065588593483, + 0.19795431569218636, + 1.6156451851129532, + 0.3037841059267521, + 0.069225138053298, + 0.14351516216993332, + 0.43434490635991096, + 0.3932446800172329, + 0.2918805405497551, + 0.70825569704175, + 0.3916655443608761, + 0.2613540589809418, + 1.0774992853403091, + 0.33581579104065895, + 0.3569400832056999, + 0.0, + 1.2373431138694286, + 0.5510613359510899, + 0.440676499158144, + 0.06569666415452957, + 1.132632065564394, + 0.922206349670887, + 1.0127859711647034, + 0.15467848256230354, + 0.07009701430797577 + ], + "unique_experts": 61, + "load_cv": 1.0542547090020473, + "normalized_load_entropy": 0.9027449034769449, + "max_load_share": 0.10512820512820513 + } + }, + "s0_period": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "dee51320a64736323693f73b2bb7418056f1ab9afbb8c0a9320fbcc109cdee32", + "route_weight_sha256": "5b69367037c279d4d677b19f72122699715607f886bc75921abf3a86d2406b9d", + "loads": [ + 0, + 4, + 2, + 2, + 5, + 5, + 3, + 3, + 0, + 1, + 0, + 1, + 0, + 1, + 3, + 7, + 6, + 0, + 0, + 4, + 8, + 0, + 0, + 2, + 0, + 0, + 1, + 0, + 0, + 2, + 1, + 1, + 4, + 24, + 0, + 1, + 1, + 0, + 2, + 2, + 5, + 4, + 2, + 0, + 0, + 2, + 0, + 2, + 1, + 2, + 0, + 3, + 4, + 3, + 0, + 4, + 6, + 0, + 1, + 1, + 4, + 0, + 3, + 1 + ], + "weighted_loads": [ + 0.0, + 0.21593549475073814, + 0.13684530183672905, + 0.07629081606864929, + 0.3025249242782593, + 0.44314707070589066, + 0.13047203049063683, + 0.1251511387526989, + 0.0, + 0.07440611720085144, + 0.0, + 0.06391044706106186, + 0.0, + 0.05796222761273384, + 0.18749646469950676, + 0.6603179275989532, + 0.2913168892264366, + 0.0, + 0.0, + 0.22471759840846062, + 0.5181787610054016, + 0.0, + 0.0, + 0.14086363464593887, + 0.0, + 0.0, + 0.043860938400030136, + 0.0, + 0.0, + 0.12268960103392601, + 0.04645449295639992, + 0.045409638434648514, + 0.3211934454739094, + 3.3697532415390015, + 0.0, + 0.0600983165204525, + 0.04164297878742218, + 0.0, + 0.09075162559747696, + 0.1911492645740509, + 0.2369230017066002, + 0.20813146606087685, + 0.19765867292881012, + 0.0, + 0.0, + 0.11948278173804283, + 0.0, + 0.10962574928998947, + 0.06138717010617256, + 0.17854509502649307, + 0.0, + 0.1733374111354351, + 0.27901892364025116, + 0.19458064809441566, + 0.0, + 0.35911403223872185, + 0.4631654694676399, + 0.0, + 0.06579983234405518, + 0.04353322833776474, + 0.253687035292387, + 0.0, + 0.15914565697312355, + 0.07075940817594528 + ], + "unique_experts": 43, + "load_cv": 1.5010284540118106, + "normalized_load_entropy": 0.8199083556609223, + "max_load_share": 0.16666666666666666 + }, + "full_input": { + "tokens": 49, + "top_k": 6, + "decisions": 294, + "ordered_route_sha256": "2a7d7ab35e2a5dfbb1c7690ab69c7a11d6e9e136ec3e13a60a50d1774d690ed7", + "route_weight_sha256": "2a7fdefc909ff122f689b673af519b117575d882891dac546b8e165478176c52", + "loads": [ + 1, + 5, + 3, + 2, + 5, + 5, + 3, + 7, + 0, + 2, + 2, + 2, + 1, + 3, + 5, + 7, + 6, + 3, + 5, + 5, + 11, + 2, + 0, + 2, + 0, + 2, + 1, + 7, + 1, + 3, + 4, + 2, + 4, + 32, + 1, + 2, + 1, + 0, + 2, + 2, + 5, + 14, + 6, + 2, + 3, + 6, + 6, + 5, + 1, + 5, + 4, + 9, + 4, + 5, + 0, + 13, + 6, + 7, + 1, + 14, + 11, + 12, + 3, + 1 + ], + "weighted_loads": [ + 0.030833249911665916, + 0.2519368678331375, + 0.15099586360156536, + 0.07629081606864929, + 0.3025249242782593, + 0.44314707070589066, + 0.13047203049063683, + 0.30024483799934387, + 0.0, + 0.09064483270049095, + 0.09344489127397537, + 0.11188826709985733, + 0.03279339522123337, + 0.5621586218476295, + 0.32128357887268066, + 0.6603179275989532, + 0.2913168892264366, + 0.20589573681354523, + 0.3385411724448204, + 0.28861355409026146, + 0.6327080801129341, + 0.08326978608965874, + 0.0, + 0.14086363464593887, + 0.0, + 0.06322913430631161, + 0.043860938400030136, + 0.8163990303874016, + 0.04660563915967941, + 0.1653665341436863, + 0.3217674754559994, + 0.059189850464463234, + 0.3211934454739094, + 3.7389593720436096, + 0.029802804812788963, + 0.09701481834053993, + 0.04164297878742218, + 0.0, + 0.09075162559747696, + 0.1911492645740509, + 0.2369230017066002, + 1.454664908349514, + 0.3420614283531904, + 0.09672427177429199, + 0.16906801611185074, + 0.3071795850992203, + 0.26920871436595917, + 0.21631534025073051, + 0.06138717010617256, + 0.3123854286968708, + 0.1625755112618208, + 0.5202782563865185, + 0.27901892364025116, + 0.32009630277752876, + 0.0, + 1.1223853193223476, + 0.4631654694676399, + 0.41983119398355484, + 0.06579983234405518, + 0.8865107856690884, + 0.6913276687264442, + 1.0392158478498459, + 0.15914565697312355, + 0.07075940817594528 + ], + "unique_experts": 59, + "load_cv": 1.0578832802199538, + "normalized_load_entropy": 0.899546606858293, + "max_load_share": 0.10884353741496598 + } + }, + "s1_period": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "031a07eb2d6834efcb2c5a5c40f6f140c8a5da8ae82aab1e46e7cac2032196ab", + "route_weight_sha256": "9a409a8a77759b741d7f21e4cc1a226c4f77b5ccdfae9c3a65d9568e2887466c", + "loads": [ + 0, + 4, + 2, + 2, + 5, + 5, + 3, + 2, + 0, + 2, + 0, + 1, + 0, + 1, + 3, + 7, + 5, + 0, + 0, + 3, + 7, + 0, + 0, + 2, + 0, + 1, + 1, + 1, + 1, + 3, + 1, + 1, + 4, + 24, + 0, + 1, + 1, + 0, + 2, + 2, + 4, + 4, + 3, + 0, + 0, + 2, + 0, + 3, + 1, + 2, + 0, + 3, + 4, + 3, + 0, + 4, + 6, + 0, + 1, + 0, + 3, + 0, + 3, + 1 + ], + "weighted_loads": [ + 0.0, + 0.20871314406394958, + 0.1500241421163082, + 0.0757010318338871, + 0.2990163117647171, + 0.43132368102669716, + 0.1292990706861019, + 0.08155741542577744, + 0.0, + 0.11318112537264824, + 0.0, + 0.06117360666394234, + 0.0, + 0.05760549381375313, + 0.18468020111322403, + 0.6600571386516094, + 0.25744643062353134, + 0.0, + 0.0, + 0.17248404026031494, + 0.4764648601412773, + 0.0, + 0.0, + 0.14248132333159447, + 0.0, + 0.037688564509153366, + 0.046280696988105774, + 0.0363946408033371, + 0.04357191547751427, + 0.17014407739043236, + 0.04675104469060898, + 0.04243450239300728, + 0.32651500776410103, + 3.3766483515501022, + 0.0, + 0.06569821387529373, + 0.03907772898674011, + 0.0, + 0.08972816169261932, + 0.19454150646924973, + 0.1909341737627983, + 0.1851036101579666, + 0.2202298827469349, + 0.0, + 0.0, + 0.12045682594180107, + 0.0, + 0.14875885844230652, + 0.0622582733631134, + 0.1849767342209816, + 0.0, + 0.18454060330986977, + 0.2650282308459282, + 0.1973712258040905, + 0.0, + 0.3364507779479027, + 0.48026031628251076, + 0.0, + 0.06784579902887344, + 0.0, + 0.2043033242225647, + 0.0, + 0.15588195249438286, + 0.07076193392276764 + ], + "unique_experts": 45, + "load_cv": 1.46565621758588, + "normalized_load_entropy": 0.8324531942503551, + "max_load_share": 0.16666666666666666 + }, + "full_input": { + "tokens": 65, + "top_k": 6, + "decisions": 390, + "ordered_route_sha256": "b1ae6b63eae76743612b620de1b1cb5a46a9d879818bb3dfbcb6b6723cbccdff", + "route_weight_sha256": "53cf7b0018345021897982c318ca2af12fdf63b00926759ad756ab1262e1b261", + "loads": [ + 1, + 4, + 4, + 3, + 10, + 5, + 3, + 3, + 0, + 3, + 3, + 4, + 4, + 2, + 7, + 7, + 5, + 5, + 4, + 3, + 8, + 1, + 0, + 2, + 1, + 4, + 2, + 21, + 1, + 6, + 11, + 2, + 9, + 40, + 2, + 3, + 4, + 3, + 3, + 2, + 5, + 21, + 6, + 2, + 2, + 8, + 6, + 6, + 9, + 6, + 3, + 19, + 5, + 6, + 0, + 17, + 7, + 8, + 1, + 19, + 14, + 11, + 3, + 1 + ], + "weighted_loads": [ + 0.05081218108534813, + 0.20871314406394958, + 0.20484663359820843, + 0.1310306340456009, + 0.53789471834898, + 0.43132368102669716, + 0.1292990706861019, + 0.11943938955664635, + 0.0, + 0.12941984087228775, + 0.11607566103339195, + 0.23268427699804306, + 0.19990605115890503, + 0.5267691798508167, + 0.4352349489927292, + 0.6600571386516094, + 0.25744643062353134, + 0.32382214069366455, + 0.3231992907822132, + 0.17248404026031494, + 0.5165781825780869, + 0.048981741070747375, + 0.0, + 0.14248132333159447, + 0.04166174307465553, + 0.3609109576791525, + 0.08839107677340508, + 1.4144048113375902, + 0.04357191547751427, + 0.30237551406025887, + 0.8715705312788486, + 0.056214714422822, + 0.8140830956399441, + 4.1870301309973, + 0.142679987475276, + 0.23115017265081406, + 0.15261556580662727, + 0.12720591202378273, + 0.12595557421445847, + 0.19454150646924973, + 0.23307038471102715, + 1.7104889638721943, + 0.30148905143141747, + 0.069225138053298, + 0.14351516216993332, + 0.41694530472159386, + 0.32753248885273933, + 0.25290508195757866, + 0.7115267142653465, + 0.39353399723768234, + 0.17819882556796074, + 1.1549187675118446, + 0.3350289762020111, + 0.3596281595528126, + 0.0, + 1.346499890089035, + 0.5533903203904629, + 0.5195183455944061, + 0.06784579902887344, + 1.162693865597248, + 0.9704913310706615, + 0.9423744566738605, + 0.15588195249438286, + 0.07076193392276764 + ], + "unique_experts": 61, + "load_cv": 1.0748086691191485, + "normalized_load_entropy": 0.8985225594953923, + "max_load_share": 0.10256410256410256 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 24, + "ordered_topk_exact_tokens": 17, + "set_exact_tokens": 22, + "mean_set_jaccard": 0.9761904761904763, + "mean_token_weighted_tv": 0.010018138059725365, + "aggregate_load_tv": 0.013888888888888892 + }, + "system_bos": { + "tokens": 24, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.9166666666666666, + "mean_token_weighted_tv": 0.020302570502584178, + "aggregate_load_tv": 0.020833333333333336 + }, + "system_x": { + "tokens": 24, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.9166666666666666, + "mean_token_weighted_tv": 0.023309617613752682, + "aggregate_load_tv": 0.027777777777777773 + }, + "system_period": { + "tokens": 24, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.8988095238095238, + "mean_token_weighted_tv": 0.02599876148936649, + "aggregate_load_tv": 0.04861111111111111 + }, + "bos_at_s0": { + "tokens": 24, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 18, + "mean_set_jaccard": 0.9196428571428571, + "mean_token_weighted_tv": 0.02313872593610237, + "aggregate_load_tv": 0.03472222222222222 + }, + "bos_at_s1": { + "tokens": 24, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.9047619047619048, + "mean_token_weighted_tv": 0.025342633676094312, + "aggregate_load_tv": 0.027777777777777776 + }, + "x_at_s0": { + "tokens": 24, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 18, + "mean_set_jaccard": 0.9285714285714287, + "mean_token_weighted_tv": 0.02441174245905131, + "aggregate_load_tv": 0.041666666666666664 + }, + "x_at_s1": { + "tokens": 24, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.8839285714285713, + "mean_token_weighted_tv": 0.03388342723095169, + "aggregate_load_tv": 0.05555555555555555 + }, + "period_at_s0": { + "tokens": 24, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 18, + "mean_set_jaccard": 0.9196428571428572, + "mean_token_weighted_tv": 0.026299804565496743, + "aggregate_load_tv": 0.04166666666666667 + }, + "period_at_s1": { + "tokens": 24, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8720238095238094, + "mean_token_weighted_tv": 0.03613126762987425, + "aggregate_load_tv": 0.06944444444444445 + } + } + }, + "layer_11": { + "layer": 11, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "0c25305fe2ca6b5bc31be318d53fabe45978bdd01dd486ff5a955236dfe823dc", + "route_weight_sha256": "5b533c492d07e8f68324948d6f26164623d4fd5aa3a33a6d280cf8c89e496d32", + "loads": [ + 5, + 16, + 0, + 0, + 4, + 1, + 1, + 1, + 4, + 0, + 1, + 0, + 0, + 4, + 0, + 1, + 4, + 3, + 0, + 2, + 2, + 4, + 3, + 0, + 2, + 0, + 5, + 3, + 0, + 1, + 0, + 0, + 0, + 4, + 1, + 1, + 4, + 0, + 3, + 1, + 8, + 1, + 5, + 1, + 0, + 2, + 3, + 1, + 3, + 2, + 3, + 0, + 2, + 0, + 0, + 6, + 0, + 12, + 0, + 6, + 5, + 2, + 1, + 0 + ], + "weighted_loads": [ + 0.28758392855525017, + 1.4928824417293072, + 0.0, + 0.0, + 0.2520141080021858, + 0.06177952513098717, + 0.06478830426931381, + 0.034260351210832596, + 0.21202534064650536, + 0.0, + 0.07431057095527649, + 0.0, + 0.0, + 0.1928040236234665, + 0.0, + 0.09127700328826904, + 0.2347724474966526, + 0.2426801398396492, + 0.0, + 0.0737372562289238, + 0.08374615758657455, + 0.23213412426412106, + 0.23164808377623558, + 0.0, + 0.0764104537665844, + 0.0, + 0.2763040103018284, + 0.19037912786006927, + 0.0, + 0.04372372478246689, + 0.0, + 0.0, + 0.0, + 0.3312895894050598, + 0.04259328171610832, + 0.04926915466785431, + 0.2251717783510685, + 0.0, + 0.18866481259465218, + 0.03847911208868027, + 0.5431328527629375, + 0.05725986510515213, + 0.30235207080841064, + 0.036309678107500076, + 0.0, + 0.09542093425989151, + 0.14755689352750778, + 0.050035662949085236, + 0.14745000377297401, + 0.06308766081929207, + 0.12019475921988487, + 0.0, + 0.11971617862582207, + 0.0, + 0.0, + 0.3109707832336426, + 0.0, + 1.1488615646958351, + 0.0, + 0.3662917725741863, + 0.23661509528756142, + 0.22308743000030518, + 0.041192494332790375, + 0.0 + ], + "unique_experts": 43, + "load_cv": 1.2765694770084508, + "normalized_load_entropy": 0.8341519974276548, + "max_load_share": 0.1111111111111111 + }, + "full_input": { + "tokens": 49, + "top_k": 6, + "decisions": 294, + "ordered_route_sha256": "81e5b9e72b997e86a362a61681478ec2d3c32ac922b646683bca7175fb7a5859", + "route_weight_sha256": "893d4916f8ba5906cd919523254b3b4ee27368858ac722604eb1e42ac9cc9f9e", + "loads": [ + 5, + 16, + 1, + 0, + 9, + 1, + 1, + 1, + 8, + 2, + 4, + 3, + 0, + 4, + 0, + 7, + 10, + 5, + 12, + 2, + 2, + 4, + 4, + 6, + 2, + 0, + 6, + 4, + 7, + 1, + 6, + 8, + 1, + 4, + 5, + 4, + 4, + 0, + 3, + 1, + 16, + 1, + 5, + 23, + 3, + 2, + 3, + 9, + 3, + 4, + 3, + 0, + 2, + 0, + 5, + 9, + 0, + 12, + 3, + 7, + 5, + 6, + 10, + 0 + ], + "weighted_loads": [ + 0.28758392855525017, + 1.4928824417293072, + 0.058468516916036606, + 0.0, + 0.4898938927799463, + 0.06177952513098717, + 0.06478830426931381, + 0.034260351210832596, + 0.4230094738304615, + 0.05754473991692066, + 0.14579129125922918, + 0.053851000033318996, + 0.0, + 0.1928040236234665, + 0.0, + 0.3238389026373625, + 0.8329088240861893, + 0.272487360984087, + 2.069892857223749, + 0.0737372562289238, + 0.08374615758657455, + 0.23213412426412106, + 0.23556581046432257, + 0.27959019504487514, + 0.0764104537665844, + 0.0, + 0.2796458585653454, + 0.20296574290841818, + 0.5032053589820862, + 0.04372372478246689, + 0.2937798611819744, + 0.3521811328828335, + 0.0355902723968029, + 0.3312895894050598, + 0.21905003115534782, + 0.2585044614970684, + 0.2251717783510685, + 0.0, + 0.18866481259465218, + 0.03847911208868027, + 1.0363352000713348, + 0.05725986510515213, + 0.30235207080841064, + 2.4828923791646957, + 0.1630147360265255, + 0.09542093425989151, + 0.14755689352750778, + 0.6490355096757412, + 0.14745000377297401, + 0.15814253315329552, + 0.12019475921988487, + 0.0, + 0.11971617862582207, + 0.0, + 0.29942632280290127, + 0.44235388189554214, + 0.0, + 1.1488615646958351, + 0.13712431117892265, + 0.40571676939725876, + 0.23661509528756142, + 0.40517920441925526, + 0.5411925762891769, + 0.0 + ], + "unique_experts": 55, + "load_cv": 0.9541043687494308, + "normalized_load_entropy": 0.8983336160409862, + "max_load_share": 0.0782312925170068 + } + }, + "s1_eos": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "a3fb27e6bc9e6ff6e4afea77cd0b1a4ed99175a702664926fbf94916dd667be9", + "route_weight_sha256": "24430fb82def96d9986cdce9b601d5ec06db77702cc63bf7c74776bb4b7882b0", + "loads": [ + 5, + 16, + 0, + 0, + 4, + 1, + 1, + 0, + 4, + 0, + 3, + 0, + 0, + 4, + 0, + 1, + 4, + 3, + 0, + 2, + 2, + 4, + 3, + 0, + 2, + 0, + 4, + 3, + 0, + 1, + 0, + 0, + 0, + 4, + 0, + 1, + 4, + 0, + 3, + 1, + 8, + 1, + 5, + 1, + 0, + 2, + 3, + 1, + 3, + 2, + 3, + 0, + 2, + 0, + 0, + 6, + 0, + 11, + 0, + 6, + 7, + 2, + 1, + 0 + ], + "weighted_loads": [ + 0.2789822220802307, + 1.5282182097434998, + 0.0, + 0.0, + 0.2502785921096802, + 0.057724691927433014, + 0.06990879774093628, + 0.0, + 0.21067775413393974, + 0.0, + 0.14400535263121128, + 0.0, + 0.0, + 0.18984409049153328, + 0.0, + 0.08761446923017502, + 0.22983482852578163, + 0.23658566921949387, + 0.0, + 0.07424012944102287, + 0.08456191420555115, + 0.22765092179179192, + 0.23010963201522827, + 0.0, + 0.07596111297607422, + 0.0, + 0.2500843517482281, + 0.19459833204746246, + 0.0, + 0.044653695076704025, + 0.0, + 0.0, + 0.0, + 0.32771994918584824, + 0.0, + 0.04914724454283714, + 0.2284635677933693, + 0.0, + 0.17800090089440346, + 0.03682919964194298, + 0.5450262352824211, + 0.0580059178173542, + 0.2969418354332447, + 0.033597663044929504, + 0.0, + 0.093726247549057, + 0.14692924544215202, + 0.04683950915932655, + 0.14886339381337166, + 0.06276557594537735, + 0.11751085892319679, + 0.0, + 0.12253792583942413, + 0.0, + 0.0, + 0.3024646006524563, + 0.0, + 1.120207704603672, + 0.0, + 0.36906565725803375, + 0.2963439542800188, + 0.2207789495587349, + 0.04113087058067322, + 0.0 + ], + "unique_experts": 41, + "load_cv": 1.2741494379088572, + "normalized_load_entropy": 0.8292662464970421, + "max_load_share": 0.1111111111111111 + }, + "full_input": { + "tokens": 65, + "top_k": 6, + "decisions": 390, + "ordered_route_sha256": "48fe6c36a0084dbcc5ded3d4b1c8f542fde6a569524673c952dbc4a5dbca842b", + "route_weight_sha256": "9de3cd32995e55e73e5872be69b5f38f5ee0d52b54a8e2b355e8765532ddad34", + "loads": [ + 7, + 17, + 1, + 0, + 15, + 5, + 1, + 2, + 14, + 0, + 7, + 3, + 0, + 4, + 0, + 2, + 21, + 5, + 11, + 3, + 3, + 5, + 6, + 4, + 2, + 0, + 8, + 5, + 11, + 1, + 8, + 6, + 1, + 4, + 4, + 7, + 4, + 0, + 3, + 2, + 16, + 1, + 5, + 28, + 2, + 2, + 4, + 15, + 3, + 5, + 3, + 0, + 2, + 5, + 21, + 14, + 6, + 12, + 2, + 11, + 8, + 10, + 12, + 1 + ], + "weighted_loads": [ + 0.42640379071235657, + 1.5610219724476337, + 0.04751334711909294, + 0.0, + 0.8298292048275471, + 0.1977727897465229, + 0.06990879774093628, + 0.12945480272173882, + 0.7801181934773922, + 0.0, + 0.25859298650175333, + 0.053198582492768764, + 0.0, + 0.18984409049153328, + 0.0, + 0.1271163746714592, + 1.8414028100669384, + 0.26560886669903994, + 2.0651397593319416, + 0.11304499208927155, + 0.1579701527953148, + 0.30010394379496574, + 0.3476197416894138, + 0.17923102900385857, + 0.07596111297607422, + 0.0, + 0.36996456724591553, + 0.24562213476747274, + 0.8079633265733719, + 0.044653695076704025, + 0.40802273340523243, + 0.2735954113304615, + 0.03201495483517647, + 0.32771994918584824, + 0.2036215327680111, + 0.5161064229905605, + 0.2284635677933693, + 0.0, + 0.17800090089440346, + 0.08389471098780632, + 1.0181374065577984, + 0.0580059178173542, + 0.2969418354332447, + 2.7837675288319588, + 0.1317407488822937, + 0.093726247549057, + 0.19336386024951935, + 1.106362134218216, + 0.14886339381337166, + 0.2822013609111309, + 0.11751085892319679, + 0.0, + 0.12253792583942413, + 0.30495115742087364, + 1.2531096432358027, + 0.6753999628126621, + 0.47307490184903145, + 1.16278475522995, + 0.10221727192401886, + 0.5628675799816847, + 0.33434645645320415, + 0.5781137067824602, + 0.6029039062559605, + 0.03990883752703667 + ], + "unique_experts": 57, + "load_cv": 0.970288393249631, + "normalized_load_entropy": 0.8956306913288301, + "max_load_share": 0.07179487179487179 + } + }, + "s0_bos": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "2368c2bccb48e6212111dff520b8cedaba18574ba4e162f09a1c7543b4b14c6c", + "route_weight_sha256": "d2c02ca122c595fecaccc0ba65875f798510012e1c6f76c604934703c6d250aa", + "loads": [ + 5, + 13, + 0, + 0, + 3, + 2, + 1, + 0, + 4, + 0, + 2, + 0, + 0, + 4, + 0, + 2, + 6, + 3, + 0, + 1, + 2, + 3, + 3, + 0, + 1, + 0, + 5, + 3, + 0, + 2, + 0, + 0, + 0, + 4, + 1, + 1, + 4, + 0, + 4, + 2, + 9, + 1, + 5, + 1, + 0, + 2, + 2, + 1, + 2, + 2, + 3, + 0, + 2, + 0, + 0, + 7, + 0, + 12, + 0, + 6, + 5, + 2, + 1, + 0 + ], + "weighted_loads": [ + 0.27543429657816887, + 1.3647205345332623, + 0.0, + 0.0, + 0.2168816775083542, + 0.0945630893111229, + 0.06486717611551285, + 0.0, + 0.21476389467716217, + 0.0, + 0.1011190116405487, + 0.0, + 0.0, + 0.18909913673996925, + 0.0, + 0.13958850875496864, + 0.31825101375579834, + 0.22772708535194397, + 0.0, + 0.03912801668047905, + 0.08499108999967575, + 0.20171593502163887, + 0.21711568534374237, + 0.0, + 0.03635964170098305, + 0.0, + 0.2875213287770748, + 0.19011712819337845, + 0.0, + 0.08168622106313705, + 0.0, + 0.0, + 0.0, + 0.3298034705221653, + 0.04356423392891884, + 0.05132617428898811, + 0.2137487791478634, + 0.0, + 0.21922845020890236, + 0.06745092198252678, + 0.6274843811988831, + 0.05085466057062149, + 0.3043953888118267, + 0.03673024848103523, + 0.0, + 0.08898340910673141, + 0.11768058314919472, + 0.05063345283269882, + 0.10471386462450027, + 0.06311452575027943, + 0.12148070707917213, + 0.0, + 0.11434997618198395, + 0.0, + 0.0, + 0.35334936901926994, + 0.0, + 1.1098398435860872, + 0.0, + 0.3895380273461342, + 0.22954798489809036, + 0.21075787395238876, + 0.04849662631750107, + 0.0 + ], + "unique_experts": 42, + "load_cv": 1.2196943555611195, + "normalized_load_entropy": 0.8370088975421748, + "max_load_share": 0.09027777777777778 + }, + "full_input": { + "tokens": 49, + "top_k": 6, + "decisions": 294, + "ordered_route_sha256": "8831c5137fa8519b7cd3f15316693f1d7dbebdb5a504788cc4b90fbbba985e94", + "route_weight_sha256": "0c893ed14cab7b2e9ec95608a41cb8b374f91f4af820755165681ac2e31e8d58", + "loads": [ + 5, + 13, + 1, + 0, + 7, + 2, + 1, + 0, + 8, + 3, + 4, + 2, + 0, + 4, + 0, + 10, + 13, + 4, + 11, + 1, + 2, + 3, + 3, + 6, + 1, + 0, + 5, + 5, + 5, + 2, + 6, + 9, + 1, + 4, + 5, + 4, + 4, + 0, + 4, + 2, + 18, + 1, + 5, + 24, + 3, + 2, + 2, + 9, + 2, + 4, + 3, + 0, + 2, + 0, + 4, + 10, + 0, + 12, + 3, + 7, + 5, + 8, + 10, + 0 + ], + "weighted_loads": [ + 0.27543429657816887, + 1.3647205345332623, + 0.058468516916036606, + 0.0, + 0.4147107321768999, + 0.0945630893111229, + 0.06486717611551285, + 0.0, + 0.42473140731453896, + 0.09359140880405903, + 0.1675079856067896, + 0.041787613183259964, + 0.0, + 0.18909913673996925, + 0.0, + 0.4441905114799738, + 1.010576881468296, + 0.24255912378430367, + 1.1735022403299809, + 0.03912801668047905, + 0.08499108999967575, + 0.20171593502163887, + 0.21711568534374237, + 0.27959019504487514, + 0.03635964170098305, + 0.0, + 0.2875213287770748, + 0.24769397731870413, + 0.37963114865124226, + 0.08168622106313705, + 0.2937798611819744, + 0.4510343484580517, + 0.0355902723968029, + 0.3298034705221653, + 0.21801215037703514, + 0.2808423340320587, + 0.2137487791478634, + 0.0, + 0.21922845020890236, + 0.06745092198252678, + 1.1837553456425667, + 0.05085466057062149, + 0.3043953888118267, + 2.5383652076125145, + 0.1630147360265255, + 0.08898340910673141, + 0.11768058314919472, + 0.6120499074459076, + 0.10471386462450027, + 0.15816939808428288, + 0.12148070707917213, + 0.0, + 0.11434997618198395, + 0.0, + 0.26778186298906803, + 0.47767601534724236, + 0.0, + 1.1098398435860872, + 0.13712431117892265, + 0.4297012388706207, + 0.22954798489809036, + 0.4866975527256727, + 0.5801513902842999, + 0.0 + ], + "unique_experts": 54, + "load_cv": 0.9914017877447034, + "normalized_load_entropy": 0.891998508349891, + "max_load_share": 0.08163265306122448 + } + }, + "s1_bos": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "c07bec17378d4bb448c5d73d5080a36fdfd1a97773538f1e9fc5c9235b7d80bb", + "route_weight_sha256": "d5b0dd980757c66a8467b82201228d558f414a8203a7090c3184baa6346845bd", + "loads": [ + 5, + 14, + 0, + 0, + 3, + 2, + 1, + 0, + 4, + 0, + 2, + 0, + 0, + 4, + 0, + 2, + 6, + 3, + 0, + 2, + 2, + 3, + 3, + 0, + 3, + 0, + 4, + 3, + 0, + 2, + 0, + 0, + 1, + 4, + 0, + 1, + 4, + 0, + 4, + 1, + 8, + 1, + 5, + 1, + 0, + 2, + 3, + 1, + 2, + 1, + 3, + 0, + 2, + 0, + 0, + 7, + 0, + 12, + 0, + 6, + 4, + 2, + 1, + 0 + ], + "weighted_loads": [ + 0.2789164334535599, + 1.387656569480896, + 0.0, + 0.0, + 0.2211264744400978, + 0.09723414480686188, + 0.06742203235626221, + 0.0, + 0.21184536814689636, + 0.0, + 0.10329452343285084, + 0.0, + 0.0, + 0.19462965801358223, + 0.0, + 0.134662713855505, + 0.30438321083784103, + 0.2303401157259941, + 0.0, + 0.06840945221483707, + 0.0817392710596323, + 0.19829530268907547, + 0.22185171768069267, + 0.0, + 0.1074552908539772, + 0.0, + 0.23653839901089668, + 0.19322023168206215, + 0.0, + 0.08534147217869759, + 0.0, + 0.0, + 0.039642877876758575, + 0.3351746052503586, + 0.0, + 0.047907352447509766, + 0.20902427285909653, + 0.0, + 0.20738103613257408, + 0.02760252356529236, + 0.5791692696511745, + 0.051675379276275635, + 0.29141201451420784, + 0.033054668456315994, + 0.0, + 0.09441482275724411, + 0.152544055134058, + 0.047544851899147034, + 0.1058667004108429, + 0.039788465946912766, + 0.11736332252621651, + 0.0, + 0.11389824375510216, + 0.0, + 0.0, + 0.3580891638994217, + 0.0, + 1.1071857996284962, + 0.0, + 0.3857952170073986, + 0.19176790118217468, + 0.2216300591826439, + 0.042453981935977936, + 0.0 + ], + "unique_experts": 42, + "load_cv": 1.2222222222222223, + "normalized_load_entropy": 0.8382144280798545, + "max_load_share": 0.09722222222222222 + }, + "full_input": { + "tokens": 65, + "top_k": 6, + "decisions": 390, + "ordered_route_sha256": "5bcd6bcd71379f8ec10be15514271db55f0b2de638fac99bab3c981465caecc1", + "route_weight_sha256": "5ff3d71b590ef9fda57f5cfd48983fc28facd006abf9cf443f9811c82e2f11df", + "loads": [ + 7, + 15, + 1, + 0, + 14, + 6, + 1, + 2, + 14, + 1, + 5, + 2, + 0, + 4, + 0, + 4, + 24, + 4, + 10, + 3, + 3, + 4, + 5, + 4, + 3, + 0, + 7, + 5, + 9, + 2, + 8, + 6, + 2, + 4, + 4, + 7, + 4, + 0, + 4, + 2, + 16, + 1, + 5, + 29, + 2, + 2, + 4, + 16, + 2, + 4, + 3, + 0, + 2, + 5, + 21, + 15, + 6, + 13, + 2, + 11, + 5, + 12, + 13, + 1 + ], + "weighted_loads": [ + 0.42633800208568573, + 1.42046033218503, + 0.04751334711909294, + 0.0, + 0.8006770871579647, + 0.23728224262595177, + 0.06742203235626221, + 0.12945480272173882, + 0.7825012132525444, + 0.033694203943014145, + 0.21273881196975708, + 0.041798895224928856, + 0.0, + 0.19462965801358223, + 0.0, + 0.20534605160355568, + 2.0344913750886917, + 0.2451721541583538, + 1.1670595295727253, + 0.10721431486308575, + 0.15514750964939594, + 0.2707483246922493, + 0.33559010177850723, + 0.17923102900385857, + 0.1074552908539772, + 0.0, + 0.3532511815428734, + 0.24424403440207243, + 0.6771537661552429, + 0.08534147217869759, + 0.40802273340523243, + 0.2735954113304615, + 0.07165783271193504, + 0.3351746052503586, + 0.1951216533780098, + 0.5328126810491085, + 0.20902427285909653, + 0.0, + 0.20738103613257408, + 0.0746680349111557, + 1.0807552970945835, + 0.051675379276275635, + 0.29141201451420784, + 3.0416839607059956, + 0.1317407488822937, + 0.09441482275724411, + 0.19897866994142532, + 1.1010627001523972, + 0.1058667004108429, + 0.2592242509126663, + 0.11736332252621651, + 0.0, + 0.11389824375510216, + 0.30495115742087364, + 1.2681207079440355, + 0.7277870811522007, + 0.47307490184903145, + 1.149762850254774, + 0.10221727192401886, + 0.5800317395478487, + 0.22977040335536003, + 0.6628250125795603, + 0.6495036706328392, + 0.03990883752703667 + ], + "unique_experts": 58, + "load_cv": 0.9934300947007791, + "normalized_load_entropy": 0.8960224120698574, + "max_load_share": 0.07435897435897436 + } + }, + "s0_x": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "7955e77e01d20292ce03a993428798ed0d745870222b12ecf982255e1063ecc1", + "route_weight_sha256": "64cdd079ae4adc6e04b3c48e4ebaa70732ab8a1c4dcf79b49275943f79e35838", + "loads": [ + 5, + 14, + 0, + 0, + 4, + 2, + 1, + 0, + 4, + 0, + 1, + 0, + 0, + 4, + 0, + 1, + 5, + 3, + 0, + 1, + 2, + 4, + 3, + 0, + 3, + 0, + 7, + 2, + 0, + 2, + 0, + 0, + 0, + 5, + 1, + 1, + 4, + 0, + 4, + 1, + 8, + 1, + 5, + 1, + 0, + 2, + 2, + 1, + 2, + 1, + 3, + 0, + 2, + 0, + 0, + 6, + 0, + 13, + 0, + 5, + 6, + 2, + 0, + 0 + ], + "weighted_loads": [ + 0.27639075368642807, + 1.3786434307694435, + 0.0, + 0.0, + 0.25669410452246666, + 0.10783222317695618, + 0.06695584952831268, + 0.0, + 0.22720349580049515, + 0.0, + 0.07312245666980743, + 0.0, + 0.0, + 0.19207828119397163, + 0.0, + 0.1000775396823883, + 0.27712446823716164, + 0.22907473146915436, + 0.0, + 0.039724353700876236, + 0.09009262174367905, + 0.23320096544921398, + 0.21536505967378616, + 0.0, + 0.10939393565058708, + 0.0, + 0.36832805909216404, + 0.13805465027689934, + 0.0, + 0.09069833531975746, + 0.0, + 0.0, + 0.0, + 0.3693448565900326, + 0.04983926936984062, + 0.05387052893638611, + 0.2181238941848278, + 0.0, + 0.25139835104346275, + 0.03943740949034691, + 0.5500086434185505, + 0.04913055896759033, + 0.3000077083706856, + 0.03838340565562248, + 0.0, + 0.08818915858864784, + 0.10877814143896103, + 0.05621085315942764, + 0.10650558024644852, + 0.03352692350745201, + 0.12665196880698204, + 0.0, + 0.10943524539470673, + 0.0, + 0.0, + 0.31411013007164, + 0.0, + 1.1325358357280493, + 0.0, + 0.3383373133838177, + 0.2600419968366623, + 0.2001330778002739, + 0.0, + 0.0 + ], + "unique_experts": 41, + "load_cv": 1.2789849370245931, + "normalized_load_entropy": 0.8256038519897654, + "max_load_share": 0.09722222222222222 + }, + "full_input": { + "tokens": 49, + "top_k": 6, + "decisions": 294, + "ordered_route_sha256": "d7fe08b938961ed441bc80a2b9fa79a832fca15566096c6c65cbad93fe09f5a0", + "route_weight_sha256": "7725cfcc530df4a491dcaa8bcaf221d21408950b27e57b2c14371e3fc010c95b", + "loads": [ + 5, + 14, + 1, + 0, + 9, + 2, + 1, + 0, + 8, + 2, + 3, + 2, + 0, + 4, + 0, + 7, + 10, + 5, + 12, + 1, + 2, + 4, + 3, + 6, + 3, + 0, + 7, + 3, + 6, + 2, + 6, + 10, + 1, + 5, + 6, + 3, + 4, + 0, + 4, + 1, + 15, + 1, + 5, + 23, + 3, + 2, + 2, + 9, + 2, + 5, + 3, + 0, + 2, + 1, + 5, + 8, + 0, + 13, + 4, + 6, + 7, + 7, + 9, + 0 + ], + "weighted_loads": [ + 0.27639075368642807, + 1.3786434307694435, + 0.058468516916036606, + 0.0, + 0.49224952049553394, + 0.10783222317695618, + 0.06695584952831268, + 0.0, + 0.449665654450655, + 0.05754473991692066, + 0.13951143063604832, + 0.041787613183259964, + 0.0, + 0.19207828119397163, + 0.0, + 0.33263943903148174, + 0.8307719975709915, + 0.2794993035495281, + 1.264691311866045, + 0.039724353700876236, + 0.09009262174367905, + 0.23320096544921398, + 0.21536505967378616, + 0.27959019504487514, + 0.10939393565058708, + 0.0, + 0.36832805909216404, + 0.15064126532524824, + 0.4349358454346657, + 0.09069833531975746, + 0.2937798611819744, + 0.510729867964983, + 0.0355902723968029, + 0.3693448565900326, + 0.3303496278822422, + 0.24991845339536667, + 0.2181238941848278, + 0.0, + 0.25139835104346275, + 0.03943740949034691, + 0.9564099013805389, + 0.04913055896759033, + 0.3000077083706856, + 2.2106666900217533, + 0.1630147360265255, + 0.08818915858864784, + 0.10877814143896103, + 0.6129573956131935, + 0.10650558024644852, + 0.21872826665639877, + 0.12665196880698204, + 0.0, + 0.10943524539470673, + 0.05470292642712593, + 0.32114296965301037, + 0.39850637316703796, + 0.0, + 1.1325358357280493, + 0.19723417982459068, + 0.3801574222743511, + 0.30355748906731606, + 0.43518647737801075, + 0.4892885833978653, + 0.0 + ], + "unique_experts": 55, + "load_cv": 0.9408190318749501, + "normalized_load_entropy": 0.899380240967945, + "max_load_share": 0.0782312925170068 + } + }, + "s1_x": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "e812f9be8a05e525a480278f5ea96c1fcec1c58121cd635d2748daebe895aa0f", + "route_weight_sha256": "a37c9468d2fd838388eba381531c883d93e48eb9f9f827bd567143eae5faa3d7", + "loads": [ + 5, + 14, + 0, + 0, + 3, + 2, + 1, + 0, + 4, + 0, + 1, + 0, + 0, + 4, + 0, + 1, + 5, + 3, + 0, + 1, + 1, + 3, + 3, + 0, + 3, + 0, + 5, + 2, + 0, + 2, + 0, + 0, + 1, + 5, + 1, + 1, + 5, + 0, + 4, + 3, + 8, + 1, + 5, + 1, + 0, + 1, + 3, + 1, + 2, + 0, + 3, + 0, + 2, + 0, + 0, + 7, + 0, + 11, + 0, + 7, + 6, + 2, + 1, + 0 + ], + "weighted_loads": [ + 0.27887821942567825, + 1.3895250707864761, + 0.0, + 0.0, + 0.21116987988352776, + 0.10557286813855171, + 0.07072915881872177, + 0.0, + 0.23110784217715263, + 0.0, + 0.0695740282535553, + 0.0, + 0.0, + 0.2018849104642868, + 0.0, + 0.09832508862018585, + 0.26685449853539467, + 0.22719072923064232, + 0.0, + 0.0422261618077755, + 0.0551670677959919, + 0.20413567498326302, + 0.213670764118433, + 0.0, + 0.11449845880270004, + 0.0, + 0.285152368247509, + 0.1427137814462185, + 0.0, + 0.10871830582618713, + 0.0, + 0.0, + 0.0404488742351532, + 0.37497565522789955, + 0.046799901872873306, + 0.050134386867284775, + 0.2515712659806013, + 0.0, + 0.24390239641070366, + 0.09782122634351254, + 0.5607758387923241, + 0.05157442018389702, + 0.2965030297636986, + 0.036885689944028854, + 0.0, + 0.055821485817432404, + 0.1575632244348526, + 0.05278091877698898, + 0.10811915248632431, + 0.0, + 0.12307140231132507, + 0.0, + 0.10714643076062202, + 0.0, + 0.0, + 0.35903819650411606, + 0.0, + 1.0046252571046352, + 0.0, + 0.40023515932261944, + 0.25738956592977047, + 0.20794852823019028, + 0.0393558107316494, + 0.0 + ], + "unique_experts": 42, + "load_cv": 1.239772978023411, + "normalized_load_entropy": 0.8317161999037203, + "max_load_share": 0.09722222222222222 + }, + "full_input": { + "tokens": 65, + "top_k": 6, + "decisions": 390, + "ordered_route_sha256": "9535b5f05b56036a3088a210b8cac8df52216f57513a1ab2a5f63301dd48c89e", + "route_weight_sha256": "001f6ab9437a02c55fa348cf391f3bee64b0538b355292ce0a87919761f1b490", + "loads": [ + 7, + 15, + 1, + 0, + 14, + 6, + 1, + 2, + 14, + 0, + 4, + 2, + 0, + 4, + 0, + 2, + 23, + 4, + 11, + 2, + 2, + 4, + 5, + 4, + 3, + 0, + 8, + 5, + 10, + 2, + 8, + 7, + 2, + 5, + 6, + 6, + 5, + 0, + 4, + 4, + 14, + 1, + 5, + 28, + 2, + 1, + 4, + 15, + 2, + 4, + 3, + 0, + 2, + 6, + 21, + 16, + 6, + 12, + 3, + 12, + 8, + 10, + 12, + 1 + ], + "weighted_loads": [ + 0.4262997880578041, + 1.4223288334906101, + 0.04751334711909294, + 0.0, + 0.7907204926013947, + 0.2456209659576416, + 0.07072915881872177, + 0.12945480272173882, + 0.8140153475105762, + 0.0, + 0.17901831679046154, + 0.041798895224928856, + 0.0, + 0.2018849104642868, + 0.0, + 0.13782699406147003, + 1.9118931405246258, + 0.24202276766300201, + 1.2446260042488575, + 0.08103102445602417, + 0.12857530638575554, + 0.27658869698643684, + 0.32740914821624756, + 0.17923102900385857, + 0.11449845880270004, + 0.0, + 0.4018651507794857, + 0.23645296972244978, + 0.7596909292042255, + 0.10871830582618713, + 0.40802273340523243, + 0.32294535264372826, + 0.07246382907032967, + 0.37497565522789955, + 0.3126950152218342, + 0.4785974994301796, + 0.2515712659806013, + 0.0, + 0.24390239641070366, + 0.14488673768937588, + 0.9027892760932446, + 0.05157442018389702, + 0.2965030297636986, + 2.475796442478895, + 0.1317407488822937, + 0.055821485817432404, + 0.20399783924221992, + 1.0479603856801987, + 0.10811915248632431, + 0.26829632744193077, + 0.12307140231132507, + 0.0, + 0.10714643076062202, + 0.35618656128644943, + 1.26734914816916, + 0.7805742584168911, + 0.47307490184903145, + 1.0472023077309132, + 0.14884188026189804, + 0.595499224960804, + 0.3386597502976656, + 0.5628682356327772, + 0.6377822272479534, + 0.03990883752703667 + ], + "unique_experts": 57, + "load_cv": 0.969854635738866, + "normalized_load_entropy": 0.8966414532241711, + "max_load_share": 0.07179487179487179 + } + }, + "s0_period": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "dcf666fde239803f5fc677a3a47bd2a4fb25348899581f194909b90cc7684cee", + "route_weight_sha256": "4bcc88d1784049c61df26e90e548982653c95bdcb6cfbf398386a7e25ee6d333", + "loads": [ + 5, + 15, + 0, + 0, + 4, + 2, + 1, + 0, + 4, + 0, + 2, + 0, + 0, + 4, + 0, + 1, + 4, + 3, + 0, + 1, + 2, + 3, + 3, + 0, + 2, + 0, + 8, + 2, + 0, + 2, + 0, + 0, + 0, + 4, + 1, + 1, + 4, + 0, + 5, + 2, + 8, + 1, + 5, + 1, + 0, + 2, + 2, + 1, + 2, + 0, + 3, + 0, + 2, + 0, + 0, + 6, + 0, + 13, + 0, + 5, + 5, + 2, + 1, + 0 + ], + "weighted_loads": [ + 0.2816539742052555, + 1.4146923050284386, + 0.0, + 0.0, + 0.2563515603542328, + 0.10807771235704422, + 0.0649564266204834, + 0.0, + 0.228058323264122, + 0.0, + 0.10803543403744698, + 0.0, + 0.0, + 0.19322161376476288, + 0.0, + 0.10026303678750992, + 0.23234571889042854, + 0.23569489270448685, + 0.0, + 0.040703583508729935, + 0.09243611618876457, + 0.20715507864952087, + 0.22042887285351753, + 0.0, + 0.0716882161796093, + 0.0, + 0.4152511451393366, + 0.13707280904054642, + 0.0, + 0.08410308137536049, + 0.0, + 0.0, + 0.0, + 0.3314713090658188, + 0.051843199878931046, + 0.053327757865190506, + 0.22056034952402115, + 0.0, + 0.2925136871635914, + 0.0678377877920866, + 0.5337611325085163, + 0.05313122272491455, + 0.30509043857455254, + 0.03703867644071579, + 0.0, + 0.08915554732084274, + 0.1096004880964756, + 0.055787041783332825, + 0.10800663754343987, + 0.0, + 0.12585097923874855, + 0.0, + 0.10904132202267647, + 0.0, + 0.0, + 0.3147980682551861, + 0.0, + 1.1181369796395302, + 0.0, + 0.3417755626142025, + 0.22735032811760902, + 0.20029280334711075, + 0.03944570571184158, + 0.0 + ], + "unique_experts": 41, + "load_cv": 1.3005222123021807, + "normalized_load_entropy": 0.8254428212413961, + "max_load_share": 0.10416666666666667 + }, + "full_input": { + "tokens": 49, + "top_k": 6, + "decisions": 294, + "ordered_route_sha256": "db8fd3e71d3533b3b2ab2d3f75872cbe89275e1c56ed91c42d0713a5f02e64b8", + "route_weight_sha256": "8696bc9c4ace6bd154cf55509b6f67c9d2f756307cf9a4ca104c6f7f535335ad", + "loads": [ + 5, + 15, + 1, + 0, + 10, + 2, + 1, + 0, + 8, + 2, + 4, + 2, + 0, + 4, + 0, + 8, + 10, + 4, + 12, + 1, + 2, + 3, + 3, + 6, + 2, + 0, + 8, + 3, + 8, + 2, + 6, + 10, + 1, + 4, + 6, + 4, + 4, + 0, + 5, + 2, + 15, + 1, + 5, + 24, + 3, + 2, + 2, + 9, + 2, + 3, + 3, + 0, + 2, + 0, + 5, + 9, + 0, + 13, + 3, + 5, + 5, + 7, + 8, + 0 + ], + "weighted_loads": [ + 0.2816539742052555, + 1.4146923050284386, + 0.058468516916036606, + 0.0, + 0.5721526313573122, + 0.10807771235704422, + 0.0649564266204834, + 0.0, + 0.44951901212334633, + 0.05754473991692066, + 0.17442440800368786, + 0.041787613183259964, + 0.0, + 0.19322161376476288, + 0.0, + 0.3742109667509794, + 0.8228883557021618, + 0.25052693113684654, + 1.2149725630879402, + 0.040703583508729935, + 0.09243611618876457, + 0.20715507864952087, + 0.22042887285351753, + 0.27959019504487514, + 0.0716882161796093, + 0.0, + 0.4152511451393366, + 0.14965942408889532, + 0.5217286385595798, + 0.08410308137536049, + 0.2937798611819744, + 0.5156952291727066, + 0.0355902723968029, + 0.3314713090658188, + 0.28771907091140747, + 0.40853453800082207, + 0.22056034952402115, + 0.0, + 0.2925136871635914, + 0.0678377877920866, + 0.9402970746159554, + 0.05313122272491455, + 0.30509043857455254, + 2.3275854848325253, + 0.1630147360265255, + 0.08915554732084274, + 0.1096004880964756, + 0.6134305074810982, + 0.10800663754343987, + 0.147896196693182, + 0.12585097923874855, + 0.0, + 0.10904132202267647, + 0.0, + 0.32392395846545696, + 0.4384498782455921, + 0.0, + 1.1181369796395302, + 0.13712431117892265, + 0.3417755626142025, + 0.22735032811760902, + 0.42892119847238064, + 0.45508984848856926, + 0.0 + ], + "unique_experts": 54, + "load_cv": 0.9755917953715381, + "normalized_load_entropy": 0.8937036436791996, + "max_load_share": 0.08163265306122448 + } + }, + "s1_period": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "6e064e72234209bb12c30d3f436d911e62ba6a788bb5d28f05216b10200945f5", + "route_weight_sha256": "4b6b4fe15b9b96a87dba74b2a10e4eea8e3c4b8a4cd55399c9f8cc98bdd44206", + "loads": [ + 5, + 16, + 0, + 0, + 4, + 2, + 1, + 0, + 4, + 0, + 1, + 0, + 0, + 4, + 0, + 2, + 5, + 3, + 0, + 1, + 1, + 3, + 3, + 0, + 2, + 0, + 6, + 3, + 0, + 2, + 0, + 0, + 1, + 6, + 1, + 1, + 5, + 0, + 3, + 2, + 8, + 1, + 5, + 1, + 0, + 2, + 2, + 1, + 3, + 0, + 3, + 0, + 2, + 0, + 0, + 5, + 0, + 11, + 0, + 6, + 5, + 2, + 0, + 0 + ], + "weighted_loads": [ + 0.2838938534259796, + 1.434857577085495, + 0.0, + 0.0, + 0.25517334416508675, + 0.11089401692152023, + 0.07182842493057251, + 0.0, + 0.22711950913071632, + 0.0, + 0.08135689049959183, + 0.0, + 0.0, + 0.20207475125789642, + 0.0, + 0.13337956741452217, + 0.25135011225938797, + 0.22607264295220375, + 0.0, + 0.04340556263923645, + 0.05865135043859482, + 0.20215186476707458, + 0.21359257027506828, + 0.0, + 0.0783548392355442, + 0.0, + 0.3353440500795841, + 0.187668576836586, + 0.0, + 0.10204334929585457, + 0.0, + 0.0, + 0.042499370872974396, + 0.411388523876667, + 0.046129945665597916, + 0.05090780556201935, + 0.25572159327566624, + 0.0, + 0.18898886069655418, + 0.05887077562510967, + 0.5398413129150867, + 0.0537734180688858, + 0.30064209178090096, + 0.034455087035894394, + 0.0, + 0.09850015491247177, + 0.11439590156078339, + 0.0522104911506176, + 0.15281573683023453, + 0.0, + 0.12721002474427223, + 0.0, + 0.10730552673339844, + 0.0, + 0.0, + 0.2823960930109024, + 0.0, + 0.9596427790820599, + 0.0, + 0.36091331019997597, + 0.2186007872223854, + 0.19053366035223007, + 0.0, + 0.0 + ], + "unique_experts": 41, + "load_cv": 1.2813958438523108, + "normalized_load_entropy": 0.827481564847149, + "max_load_share": 0.1111111111111111 + }, + "full_input": { + "tokens": 65, + "top_k": 6, + "decisions": 390, + "ordered_route_sha256": "426839db8c073dddecc2c8fdb72247ae2be69df15ff5064214dbe9d7128e2238", + "route_weight_sha256": "4ad5555904bc3896f76c0ff0cc1bb81e3394744f5440b00111dbbd982215a108", + "loads": [ + 7, + 17, + 1, + 0, + 16, + 7, + 1, + 2, + 14, + 0, + 4, + 2, + 0, + 4, + 1, + 4, + 22, + 4, + 10, + 2, + 2, + 4, + 5, + 4, + 2, + 0, + 9, + 5, + 11, + 2, + 8, + 7, + 2, + 6, + 6, + 7, + 5, + 0, + 3, + 3, + 15, + 1, + 5, + 28, + 2, + 2, + 3, + 15, + 3, + 4, + 3, + 0, + 2, + 5, + 21, + 14, + 6, + 12, + 2, + 11, + 6, + 10, + 10, + 1 + ], + "weighted_loads": [ + 0.43131542205810547, + 1.467661339789629, + 0.04751334711909294, + 0.0, + 0.9024481624364853, + 0.29318802058696747, + 0.07182842493057251, + 0.12945480272173882, + 0.8060607984662056, + 0.0, + 0.19080117903649807, + 0.041798895224928856, + 0.0, + 0.20207475125789642, + 0.040087491273880005, + 0.20594198256731033, + 1.863869983702898, + 0.24090468138456345, + 1.1670595295727253, + 0.08221042528748512, + 0.13205958902835846, + 0.2746048867702484, + 0.32733095437288284, + 0.17923102900385857, + 0.0783548392355442, + 0.0, + 0.4520568326115608, + 0.23869237955659628, + 0.8379630260169506, + 0.10204334929585457, + 0.40802273340523243, + 0.3123931735754013, + 0.07451432570815086, + 0.411388523876667, + 0.29486268386244774, + 0.5755640603601933, + 0.25572159327566624, + 0.0, + 0.18898886069655418, + 0.10593628697097301, + 0.9007034730166197, + 0.0537734180688858, + 0.30064209178090096, + 2.5131450183689594, + 0.1317407488822937, + 0.09850015491247177, + 0.1608305163681507, + 1.0614315569400787, + 0.15281573683023453, + 0.2599823959171772, + 0.12721002474427223, + 0.0, + 0.10730552673339844, + 0.30495115742087364, + 1.2657265942543745, + 0.6969943717122078, + 0.47307490184903145, + 1.0022198297083378, + 0.10221727192401886, + 0.5561049152165651, + 0.25660328939557076, + 0.5495276432484388, + 0.5351828336715698, + 0.03990883752703667 + ], + "unique_experts": 58, + "load_cv": 0.9668128842690771, + "normalized_load_entropy": 0.898643293962837, + "max_load_share": 0.07179487179487179 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 24, + "ordered_topk_exact_tokens": 19, + "set_exact_tokens": 20, + "mean_set_jaccard": 0.9523809523809524, + "mean_token_weighted_tv": 0.011144816991873085, + "aggregate_load_tv": 0.027777777777777776 + }, + "system_bos": { + "tokens": 24, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.9047619047619048, + "mean_token_weighted_tv": 0.019428679525541764, + "aggregate_load_tv": 0.04166666666666667 + }, + "system_x": { + "tokens": 24, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.880952380952381, + "mean_token_weighted_tv": 0.024085144395940006, + "aggregate_load_tv": 0.06249999999999999 + }, + "system_period": { + "tokens": 24, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 13, + "mean_set_jaccard": 0.8601190476190478, + "mean_token_weighted_tv": 0.028447464263687532, + "aggregate_load_tv": 0.06944444444444443 + }, + "bos_at_s0": { + "tokens": 24, + "ordered_topk_exact_tokens": 8, + "set_exact_tokens": 10, + "mean_set_jaccard": 0.8333333333333334, + "mean_token_weighted_tv": 0.031959021425185107, + "aggregate_load_tv": 0.06944444444444445 + }, + "bos_at_s1": { + "tokens": 24, + "ordered_topk_exact_tokens": 7, + "set_exact_tokens": 9, + "mean_set_jaccard": 0.8214285714285715, + "mean_token_weighted_tv": 0.03299049586833765, + "aggregate_load_tv": 0.06944444444444443 + }, + "x_at_s0": { + "tokens": 24, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8720238095238096, + "mean_token_weighted_tv": 0.02993341403392454, + "aggregate_load_tv": 0.06944444444444443 + }, + "x_at_s1": { + "tokens": 24, + "ordered_topk_exact_tokens": 6, + "set_exact_tokens": 8, + "mean_set_jaccard": 0.8005952380952381, + "mean_token_weighted_tv": 0.04200291819870472, + "aggregate_load_tv": 0.09722222222222224 + }, + "period_at_s0": { + "tokens": 24, + "ordered_topk_exact_tokens": 6, + "set_exact_tokens": 11, + "mean_set_jaccard": 0.8363095238095238, + "mean_token_weighted_tv": 0.0345103235837693, + "aggregate_load_tv": 0.06944444444444443 + }, + "period_at_s1": { + "tokens": 24, + "ordered_topk_exact_tokens": 7, + "set_exact_tokens": 9, + "mean_set_jaccard": 0.7946428571428572, + "mean_token_weighted_tv": 0.0440898498830696, + "aggregate_load_tv": 0.08333333333333333 + } + } + }, + "layer_12": { + "layer": 12, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "5da3729e5fe0306bf56fdc080d184700cfd3d72a0c4ea7c761b5f6951d2a8471", + "route_weight_sha256": "403aeea6401b8aeaec33b4626d6f6bbbbc1546029f95ab4d2f860df5c4bf0e73", + "loads": [ + 6, + 1, + 0, + 0, + 0, + 3, + 0, + 4, + 3, + 2, + 1, + 1, + 2, + 1, + 6, + 0, + 6, + 3, + 1, + 0, + 3, + 2, + 7, + 1, + 3, + 2, + 1, + 0, + 0, + 0, + 0, + 11, + 0, + 6, + 3, + 0, + 5, + 0, + 3, + 0, + 0, + 4, + 1, + 1, + 0, + 0, + 0, + 1, + 7, + 5, + 0, + 2, + 5, + 4, + 0, + 2, + 1, + 13, + 0, + 5, + 1, + 4, + 0, + 1 + ], + "weighted_loads": [ + 0.3628283143043518, + 0.08281746506690979, + 0.0, + 0.0, + 0.0, + 0.59495535120368, + 0.0, + 0.19489533826708794, + 0.2551909536123276, + 0.10669084265828133, + 0.06591098010540009, + 0.0525829903781414, + 0.2494792938232422, + 0.03578180447220802, + 0.2825964689254761, + 0.0, + 0.38354919105768204, + 0.22787167504429817, + 0.03912641108036041, + 0.0, + 0.15668291598558426, + 0.14444370567798615, + 0.45719141885638237, + 0.036272358149290085, + 0.1604948677122593, + 0.12393581122159958, + 0.03806941956281662, + 0.0, + 0.0, + 0.0, + 0.0, + 0.8786509744822979, + 0.0, + 0.3170381411910057, + 0.17841120064258575, + 0.0, + 0.2457720898091793, + 0.0, + 0.17273424193263054, + 0.0, + 0.0, + 0.17336799949407578, + 0.03563017025589943, + 0.15415576100349426, + 0.0, + 0.0, + 0.0, + 0.038066569715738297, + 0.43945248797535896, + 0.27945394814014435, + 0.0, + 0.1015496775507927, + 0.30988409370183945, + 0.19998008757829666, + 0.0, + 0.09549212455749512, + 0.035444121807813644, + 0.9925429150462151, + 0.0, + 0.5019777193665504, + 0.043847329914569855, + 0.1976151056587696, + 0.0, + 0.036929015070199966 + ], + "unique_experts": 42, + "load_cv": 1.2069756101333573, + "normalized_load_entropy": 0.8347741813979662, + "max_load_share": 0.09027777777777778 + }, + "full_input": { + "tokens": 49, + "top_k": 6, + "decisions": 294, + "ordered_route_sha256": "811c7c0106865aa44fb80ef1e6d53312151e9854dcc89742fb2e1489c0bc1b2a", + "route_weight_sha256": "bfefef12af9a4e924b30542ff93a8c410a6f7a1371798eadc841525f41619411", + "loads": [ + 6, + 1, + 0, + 5, + 4, + 4, + 0, + 5, + 9, + 2, + 1, + 1, + 7, + 1, + 6, + 0, + 9, + 3, + 1, + 0, + 4, + 2, + 8, + 6, + 3, + 2, + 2, + 8, + 15, + 12, + 3, + 16, + 1, + 7, + 3, + 7, + 5, + 4, + 19, + 0, + 0, + 9, + 6, + 4, + 1, + 1, + 3, + 6, + 10, + 5, + 1, + 2, + 5, + 4, + 0, + 2, + 4, + 13, + 0, + 8, + 1, + 8, + 4, + 5 + ], + "weighted_loads": [ + 0.3628283143043518, + 0.08281746506690979, + 0.0, + 0.12552493554539979, + 1.623170129954815, + 0.5990358153358102, + 0.0, + 0.27193037793040276, + 0.6394599657505751, + 0.10669084265828133, + 0.06591098010540009, + 0.0525829903781414, + 0.5104794465005398, + 0.03578180447220802, + 0.2825964689254761, + 0.0, + 0.5576199665665627, + 0.22787167504429817, + 0.03912641108036041, + 0.0, + 0.15900781797245145, + 0.14444370567798615, + 0.5072853304445744, + 0.49246857687830925, + 0.1604948677122593, + 0.12393581122159958, + 0.07087854668498039, + 0.42596288956701756, + 1.9295053519308567, + 1.7354973182082176, + 0.10569385811686516, + 1.2552181892096996, + 0.046385444700717926, + 0.35744569078087807, + 0.17841120064258575, + 0.49822046607732773, + 0.2457720898091793, + 0.11260077357292175, + 1.7695007473230362, + 0.0, + 0.0, + 0.718937985599041, + 0.36114856228232384, + 0.3202699590474367, + 0.049022674560546875, + 0.03944015875458717, + 0.17754611000418663, + 0.3363767471164465, + 0.6284147314727306, + 0.27945394814014435, + 0.012934602797031403, + 0.1015496775507927, + 0.30988409370183945, + 0.19998008757829666, + 0.0, + 0.09549212455749512, + 0.13894381886348128, + 0.9925429150462151, + 0.0, + 0.5954930987209082, + 0.043847329914569855, + 0.3537425212562084, + 0.16671457141637802, + 0.16527609899640083 + ], + "unique_experts": 56, + "load_cv": 0.8973147553608752, + "normalized_load_entropy": 0.9044906783547328, + "max_load_share": 0.06462585034013606 + } + }, + "s1_eos": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "7c782deab1a5a40c667c6372dbe5189aac0d215c94fe7e59790e64b105b03734", + "route_weight_sha256": "240ec4f58a6fc4baa576efd223330ba1879a5e8bab31a4c9e6e17f85b6e0b049", + "loads": [ + 6, + 1, + 0, + 0, + 0, + 2, + 0, + 4, + 3, + 2, + 1, + 1, + 2, + 1, + 6, + 0, + 6, + 3, + 1, + 0, + 3, + 2, + 7, + 1, + 3, + 2, + 1, + 0, + 0, + 0, + 0, + 11, + 0, + 6, + 3, + 0, + 5, + 0, + 3, + 0, + 0, + 4, + 1, + 2, + 0, + 0, + 0, + 1, + 7, + 5, + 0, + 2, + 5, + 4, + 0, + 2, + 1, + 13, + 0, + 5, + 1, + 4, + 0, + 1 + ], + "weighted_loads": [ + 0.3554268926382065, + 0.08210650086402893, + 0.0, + 0.0, + 0.0, + 0.5467700660228729, + 0.0, + 0.19315657019615173, + 0.26574625819921494, + 0.10633590817451477, + 0.07011369615793228, + 0.05190254747867584, + 0.24580002576112747, + 0.03740311786532402, + 0.28184403106570244, + 0.0, + 0.3810892291367054, + 0.2379702292382717, + 0.03841361030936241, + 0.0, + 0.15539975836873055, + 0.14575836062431335, + 0.46628402918577194, + 0.036264389753341675, + 0.16261054947972298, + 0.12504373863339424, + 0.03569357097148895, + 0.0, + 0.0, + 0.0, + 0.0, + 0.8659922443330288, + 0.0, + 0.3166639544069767, + 0.1770874708890915, + 0.0, + 0.2552137076854706, + 0.0, + 0.16765788942575455, + 0.0, + 0.0, + 0.173807542771101, + 0.04212503507733345, + 0.19033734500408173, + 0.0, + 0.0, + 0.0, + 0.03967843949794769, + 0.4321754015982151, + 0.2685205303132534, + 0.0, + 0.10154948383569717, + 0.3112313374876976, + 0.20273031666874886, + 0.0, + 0.09804033115506172, + 0.03622189164161682, + 1.0211782790720463, + 0.0, + 0.49490872770547867, + 0.0459403470158577, + 0.1896020509302616, + 0.0, + 0.0346212163567543 + ], + "unique_experts": 42, + "load_cv": 1.204415743815489, + "normalized_load_entropy": 0.8356478937847295, + "max_load_share": 0.09027777777777778 + }, + "full_input": { + "tokens": 65, + "top_k": 6, + "decisions": 390, + "ordered_route_sha256": "c89ecccd03b3c07e626be6dcd7cd504e8c5ec987e3325e893f6dd5999ee55729", + "route_weight_sha256": "d220007c457122f0643f2090bc36e2170418837bdf336e77dc93bffaeede1cdc", + "loads": [ + 10, + 1, + 0, + 3, + 4, + 3, + 0, + 10, + 10, + 5, + 2, + 1, + 6, + 1, + 6, + 0, + 11, + 5, + 2, + 0, + 4, + 4, + 9, + 7, + 3, + 2, + 4, + 7, + 17, + 17, + 11, + 16, + 4, + 10, + 8, + 7, + 5, + 4, + 23, + 0, + 0, + 15, + 8, + 6, + 12, + 4, + 5, + 8, + 14, + 5, + 2, + 2, + 5, + 7, + 0, + 2, + 4, + 19, + 0, + 9, + 3, + 12, + 5, + 1 + ], + "weighted_loads": [ + 0.5473748538643122, + 0.08210650086402893, + 0.0, + 0.057111918926239014, + 1.620517011731863, + 0.5507227694615722, + 0.0, + 0.48067502304911613, + 0.768061637878418, + 0.42518457770347595, + 0.11239168047904968, + 0.05190254747867584, + 0.44194338470697403, + 0.03740311786532402, + 0.28184403106570244, + 0.0, + 0.7077881991863251, + 0.34991927072405815, + 0.073647640645504, + 0.0, + 0.15774069842882454, + 0.23547625541687012, + 0.5544271767139435, + 0.49503225088119507, + 0.16261054947972298, + 0.12504373863339424, + 0.15759553387761116, + 0.35426777228713036, + 2.2293981462717056, + 2.553763672709465, + 0.8637138567864895, + 1.2265935074537992, + 0.1776317860931158, + 0.5591900050640106, + 0.4291790686547756, + 0.5637357719242573, + 0.2552137076854706, + 0.17363439686596394, + 2.049074161797762, + 0.0, + 0.0, + 1.2137463204562664, + 0.45036107674241066, + 0.4400644339621067, + 1.1502347849309444, + 0.3058609776198864, + 0.24827853590250015, + 0.4399399124085903, + 0.8251760192215443, + 0.2685205303132534, + 0.0654086098074913, + 0.10154948383569717, + 0.3112313374876976, + 0.35704077407717705, + 0.0, + 0.09804033115506172, + 0.11616656230762601, + 1.2752581983804703, + 0.0, + 0.6169594414532185, + 0.1183121856302023, + 0.5858406089246273, + 0.22270628064870834, + 0.0346212163567543 + ], + "unique_experts": 56, + "load_cv": 0.8515754823290059, + "normalized_load_entropy": 0.9109921130611426, + "max_load_share": 0.05897435897435897 + } + }, + "s0_bos": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "f7dae69b16f6991854b1b4e2905c21a1287f6537e2e3c286793d2629dab1e0ee", + "route_weight_sha256": "ecd5d84e5fc1716f7c4227dbb89ef0484eedca4d44a80f4921c1ad72e72f27a4", + "loads": [ + 6, + 1, + 0, + 0, + 0, + 2, + 0, + 4, + 3, + 2, + 1, + 1, + 3, + 1, + 6, + 0, + 7, + 3, + 1, + 0, + 3, + 2, + 7, + 1, + 3, + 2, + 1, + 0, + 0, + 0, + 0, + 11, + 0, + 6, + 3, + 0, + 5, + 0, + 3, + 0, + 0, + 4, + 1, + 2, + 0, + 0, + 0, + 1, + 7, + 5, + 0, + 2, + 5, + 3, + 0, + 1, + 1, + 13, + 0, + 5, + 1, + 4, + 0, + 1 + ], + "weighted_loads": [ + 0.3496049530804157, + 0.08279535174369812, + 0.0, + 0.0, + 0.0, + 0.5462579131126404, + 0.0, + 0.19615519419312477, + 0.2654096335172653, + 0.10463037341833115, + 0.06343598663806915, + 0.04986654967069626, + 0.28829699009656906, + 0.03771485760807991, + 0.29912901669740677, + 0.0, + 0.4491295926272869, + 0.21304736658930779, + 0.03876224160194397, + 0.0, + 0.14346292987465858, + 0.13644616305828094, + 0.4576404392719269, + 0.03662428632378578, + 0.15825841575860977, + 0.12292696535587311, + 0.036572035402059555, + 0.0, + 0.0, + 0.0, + 0.0, + 0.8830930702388287, + 0.0, + 0.3147336021065712, + 0.18107421323657036, + 0.0, + 0.2486814521253109, + 0.0, + 0.16387920454144478, + 0.0, + 0.0, + 0.1646292582154274, + 0.03605931997299194, + 0.1869140937924385, + 0.0, + 0.0, + 0.0, + 0.03791406750679016, + 0.4492463059723377, + 0.2819904461503029, + 0.0, + 0.09339314699172974, + 0.3129200153052807, + 0.14733311533927917, + 0.0, + 0.048343122005462646, + 0.03214113414287567, + 0.9578061141073704, + 0.0, + 0.503543995320797, + 0.042772769927978516, + 0.20168936625123024, + 0.0, + 0.04169454053044319 + ], + "unique_experts": 42, + "load_cv": 1.2146228393930805, + "normalized_load_entropy": 0.833736453443985, + "max_load_share": 0.09027777777777778 + }, + "full_input": { + "tokens": 49, + "top_k": 6, + "decisions": 294, + "ordered_route_sha256": "105d03fea6ceb2162ac5d0cc3b0b01a5af00d97a63ab751d2799aceaf7a477d9", + "route_weight_sha256": "a6eee0d5610ce68fd366bcddd611a22b5592e74c6919cb9f77e3cc726dda5ce6", + "loads": [ + 7, + 1, + 0, + 4, + 3, + 2, + 0, + 6, + 9, + 2, + 1, + 1, + 9, + 1, + 6, + 0, + 12, + 3, + 1, + 0, + 3, + 2, + 8, + 7, + 3, + 2, + 3, + 8, + 16, + 11, + 2, + 17, + 1, + 7, + 3, + 7, + 5, + 4, + 19, + 0, + 0, + 9, + 5, + 4, + 1, + 1, + 2, + 5, + 12, + 5, + 1, + 2, + 5, + 3, + 0, + 1, + 3, + 14, + 0, + 8, + 1, + 8, + 3, + 5 + ], + "weighted_loads": [ + 0.4041488729417324, + 0.08279535174369812, + 0.0, + 0.12241765949875116, + 0.6729954406619072, + 0.5462579131126404, + 0.0, + 0.3090377040207386, + 0.6857440527528524, + 0.10463037341833115, + 0.06343598663806915, + 0.04986654967069626, + 0.6420530080795288, + 0.03771485760807991, + 0.29912901669740677, + 0.0, + 0.6832242347300053, + 0.21304736658930779, + 0.03876224160194397, + 0.0, + 0.14346292987465858, + 0.13644616305828094, + 0.5077343508601189, + 0.5374546237289906, + 0.15825841575860977, + 0.12292696535587311, + 0.11180607602000237, + 0.42596288956701756, + 1.9272481128573418, + 1.6091966554522514, + 0.06286903470754623, + 1.3172078020870686, + 0.046385444700717926, + 0.35514115169644356, + 0.18107421323657036, + 0.49822046607732773, + 0.2486814521253109, + 0.11260077357292175, + 1.757646854966879, + 0.0, + 0.0, + 0.6476476900279522, + 0.3118916004896164, + 0.3350096084177494, + 0.049022674560546875, + 0.03944015875458717, + 0.11841259524226189, + 0.26358253695070744, + 0.7552497014403343, + 0.2819904461503029, + 0.012934602797031403, + 0.09339314699172974, + 0.3129200153052807, + 0.14733311533927917, + 0.0, + 0.048343122005462646, + 0.13103679195046425, + 1.0006354041397572, + 0.0, + 0.6480773817747831, + 0.042772769927978516, + 0.35781678184866905, + 0.11950582265853882, + 0.17004162445664406 + ], + "unique_experts": 56, + "load_cv": 0.9602926960587346, + "normalized_load_entropy": 0.8942432360333229, + "max_load_share": 0.06462585034013606 + } + }, + "s1_bos": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "f29b332478dbacc6de07dc260bfa86f59a4e705194aadb767f11f6338af2c9a0", + "route_weight_sha256": "fe519c18bfebeca6f3f369ca4c62782e5b5cbc6d0e085d4c3db305507388a9ba", + "loads": [ + 6, + 1, + 0, + 0, + 0, + 2, + 0, + 4, + 3, + 2, + 1, + 1, + 2, + 1, + 6, + 0, + 6, + 3, + 1, + 0, + 3, + 2, + 7, + 1, + 3, + 2, + 0, + 0, + 0, + 0, + 0, + 11, + 0, + 6, + 3, + 0, + 5, + 0, + 3, + 0, + 0, + 4, + 1, + 1, + 0, + 0, + 0, + 1, + 7, + 5, + 1, + 2, + 5, + 4, + 0, + 2, + 1, + 12, + 0, + 6, + 1, + 5, + 0, + 1 + ], + "weighted_loads": [ + 0.341382447630167, + 0.08235791325569153, + 0.0, + 0.0, + 0.0, + 0.560376763343811, + 0.0, + 0.19441847875714302, + 0.24309127032756805, + 0.10444612428545952, + 0.06437581777572632, + 0.050488460808992386, + 0.26300612837076187, + 0.03637257218360901, + 0.28925687447190285, + 0.0, + 0.405873604118824, + 0.2230074591934681, + 0.03837678208947182, + 0.0, + 0.13986781984567642, + 0.13621098548173904, + 0.454244963824749, + 0.035857927054166794, + 0.1591009385883808, + 0.1231963187456131, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.8926329240202904, + 0.0, + 0.3129769302904606, + 0.17268335446715355, + 0.0, + 0.2572733126580715, + 0.0, + 0.14966373145580292, + 0.0, + 0.0, + 0.16733134910464287, + 0.04001973569393158, + 0.15738514065742493, + 0.0, + 0.0, + 0.0, + 0.03975311666727066, + 0.4536711312830448, + 0.28011466935276985, + 0.03519079089164734, + 0.09637948870658875, + 0.31739358976483345, + 0.18475758284330368, + 0.0, + 0.0884341225028038, + 0.029905688017606735, + 0.9165059141814709, + 0.0, + 0.5360506698489189, + 0.04305054619908333, + 0.22885430231690407, + 0.0, + 0.03795970603823662 + ], + "unique_experts": 42, + "load_cv": 1.1941214033447043, + "normalized_load_entropy": 0.835157605963958, + "max_load_share": 0.08333333333333333 + }, + "full_input": { + "tokens": 65, + "top_k": 6, + "decisions": 390, + "ordered_route_sha256": "62fc3edc785f22402ed99b1ed9997a29a3176349fcca0c7b9b59aaf633a38a68", + "route_weight_sha256": "25706119dddc9c750bf5680fdefafda3b77697f40b83eb0517957efa1380c26f", + "loads": [ + 10, + 1, + 0, + 2, + 3, + 2, + 0, + 10, + 10, + 5, + 2, + 1, + 7, + 1, + 6, + 0, + 12, + 5, + 2, + 0, + 3, + 4, + 9, + 7, + 3, + 2, + 3, + 7, + 17, + 18, + 11, + 17, + 4, + 10, + 8, + 7, + 5, + 4, + 23, + 0, + 0, + 15, + 7, + 6, + 12, + 4, + 3, + 8, + 16, + 5, + 3, + 2, + 5, + 7, + 0, + 2, + 3, + 19, + 0, + 10, + 3, + 13, + 5, + 1 + ], + "weighted_loads": [ + 0.5333304088562727, + 0.08235791325569153, + 0.0, + 0.054155112244188786, + 0.6704154573380947, + 0.560376763343811, + 0.0, + 0.487654197961092, + 0.812880203127861, + 0.4232947938144207, + 0.10665380209684372, + 0.050488460808992386, + 0.5896710269153118, + 0.03637257218360901, + 0.28925687447190285, + 0.0, + 0.7729409597814083, + 0.33495650067925453, + 0.0736108124256134, + 0.0, + 0.13986781984567642, + 0.2259288802742958, + 0.5423881113529205, + 0.4946257881820202, + 0.1591009385883808, + 0.1231963187456131, + 0.12190196290612221, + 0.35426777228713036, + 2.3267579525709152, + 2.554323948919773, + 0.8637138567864895, + 1.288137475028634, + 0.1776317860931158, + 0.5555029809474945, + 0.4247749522328377, + 0.5637357719242573, + 0.2572733126580715, + 0.17363439686596394, + 2.1267834082245827, + 0.0, + 0.0, + 1.187258455902338, + 0.4032761827111244, + 0.4402356334030628, + 1.1502347849309444, + 0.3058609776198864, + 0.1614205315709114, + 0.42515600472688675, + 0.9497751407325268, + 0.28011466935276985, + 0.10059940069913864, + 0.09637948870658875, + 0.31739358976483345, + 0.3390680402517319, + 0.0, + 0.0884341225028038, + 0.09012510068714619, + 1.214252732694149, + 0.0, + 0.6928449515253305, + 0.11542238481342793, + 0.6250928603112698, + 0.22270628064870834, + 0.03795970603823662 + ], + "unique_experts": 56, + "load_cv": 0.8864381073037251, + "normalized_load_entropy": 0.9051371092053441, + "max_load_share": 0.05897435897435897 + } + }, + "s0_x": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "798a815b3dc835b5e2557abdc5cc8678f280aa4ba3c8b3b92f1f42f2bd5501a1", + "route_weight_sha256": "886e11041cabc078ab4ec0f494443abf73d5db6958a7b7ef146cd06c747c5804", + "loads": [ + 6, + 1, + 0, + 0, + 0, + 3, + 0, + 4, + 4, + 2, + 1, + 1, + 3, + 1, + 6, + 0, + 5, + 3, + 1, + 0, + 3, + 2, + 6, + 1, + 3, + 2, + 2, + 0, + 0, + 0, + 0, + 11, + 0, + 6, + 3, + 0, + 5, + 0, + 3, + 0, + 0, + 4, + 1, + 1, + 0, + 0, + 0, + 1, + 7, + 5, + 0, + 2, + 5, + 3, + 0, + 1, + 1, + 13, + 0, + 6, + 1, + 4, + 0, + 1 + ], + "weighted_loads": [ + 0.3484165072441101, + 0.08051815629005432, + 0.0, + 0.0, + 0.0, + 0.5903197936713696, + 0.0, + 0.20206781849265099, + 0.3037581220269203, + 0.11418937519192696, + 0.0626312717795372, + 0.04904843866825104, + 0.28072503581643105, + 0.040855515748262405, + 0.29458579793572426, + 0.0, + 0.3615856245160103, + 0.2169070802628994, + 0.03845541924238205, + 0.0, + 0.14373727142810822, + 0.15039213746786118, + 0.4087315574288368, + 0.03577691689133644, + 0.16712655499577522, + 0.12484448775649071, + 0.07729073241353035, + 0.0, + 0.0, + 0.0, + 0.0, + 0.8662629872560501, + 0.0, + 0.3013230301439762, + 0.176804069429636, + 0.0, + 0.2532162331044674, + 0.0, + 0.19931623339653015, + 0.0, + 0.0, + 0.18415160849690437, + 0.04110567644238472, + 0.16659753024578094, + 0.0, + 0.0, + 0.0, + 0.03803103789687157, + 0.47458115220069885, + 0.27375679463148117, + 0.0, + 0.09532317891716957, + 0.30275968462228775, + 0.15884341299533844, + 0.0, + 0.045002538710832596, + 0.03433144465088844, + 0.8982302621006966, + 0.0, + 0.5289442539215088, + 0.04123169928789139, + 0.2068229392170906, + 0.0, + 0.03753666579723358 + ], + "unique_experts": 42, + "load_cv": 1.1967032904743342, + "normalized_load_entropy": 0.8363792993932357, + "max_load_share": 0.09027777777777778 + }, + "full_input": { + "tokens": 49, + "top_k": 6, + "decisions": 294, + "ordered_route_sha256": "42ca6a95fc5e90f51c2cf72ede4da50db69efe65c8c51f6dc10985e45808444d", + "route_weight_sha256": "89f298796bbe68568d991b88b782dea47f20aa243e0184be082c97c383b5b5bb", + "loads": [ + 6, + 1, + 0, + 4, + 3, + 3, + 0, + 7, + 10, + 2, + 1, + 1, + 8, + 1, + 6, + 0, + 8, + 3, + 1, + 0, + 3, + 2, + 7, + 8, + 3, + 2, + 3, + 9, + 18, + 10, + 3, + 16, + 1, + 7, + 3, + 8, + 5, + 4, + 18, + 0, + 0, + 9, + 6, + 2, + 1, + 2, + 1, + 6, + 12, + 5, + 1, + 2, + 5, + 3, + 0, + 1, + 3, + 14, + 0, + 8, + 1, + 9, + 3, + 5 + ], + "weighted_loads": [ + 0.3484165072441101, + 0.08051815629005432, + 0.0, + 0.12241765949875116, + 0.6729954406619072, + 0.5903197936713696, + 0.0, + 0.3688656650483608, + 0.6762573961168528, + 0.11418937519192696, + 0.0626312717795372, + 0.04904843866825104, + 0.54830227419734, + 0.040855515748262405, + 0.29458579793572426, + 0.0, + 0.5274486728012562, + 0.2169070802628994, + 0.03845541924238205, + 0.0, + 0.14373727142810822, + 0.15039213746786118, + 0.4588254690170288, + 0.6820009350776672, + 0.16712655499577522, + 0.12484448775649071, + 0.11009985953569412, + 0.48331653513014317, + 2.230667367577553, + 1.206750463694334, + 0.11702323332428932, + 1.2579880356788635, + 0.046385444700717926, + 0.34173057973384857, + 0.176804069429636, + 0.5732196420431137, + 0.2532162331044674, + 0.11260077357292175, + 1.569695357233286, + 0.0, + 0.0, + 0.6989841349422932, + 0.37294158712029457, + 0.2750503793358803, + 0.049022674560546875, + 0.09049705415964127, + 0.06890077888965607, + 0.3000106159597635, + 0.7841216661036015, + 0.27375679463148117, + 0.012934602797031403, + 0.09532317891716957, + 0.30275968462228775, + 0.15884341299533844, + 0.0, + 0.045002538710832596, + 0.13322710245847702, + 0.9410932995378971, + 0.0, + 0.6139572840183973, + 0.04123169928789139, + 0.432522714138031, + 0.11950582265853882, + 0.16588374972343445 + ], + "unique_experts": 56, + "load_cv": 0.947875641015079, + "normalized_load_entropy": 0.8959758705633533, + "max_load_share": 0.061224489795918366 + } + }, + "s1_x": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "b2fb59fdd2fa890b5de99daf3894a7117709a5450ed537bbac1ff24450459566", + "route_weight_sha256": "c14abcbc71fbb92c540cfe515cb92dcfe8fed5c208afe6c92b9a25ec5f6919a1", + "loads": [ + 6, + 1, + 0, + 0, + 0, + 2, + 0, + 4, + 3, + 2, + 1, + 1, + 3, + 1, + 6, + 0, + 5, + 3, + 1, + 0, + 3, + 2, + 7, + 1, + 3, + 2, + 2, + 0, + 0, + 1, + 0, + 11, + 0, + 5, + 3, + 0, + 6, + 0, + 3, + 0, + 0, + 4, + 1, + 3, + 0, + 0, + 0, + 1, + 6, + 4, + 1, + 2, + 5, + 4, + 0, + 1, + 1, + 12, + 0, + 5, + 1, + 4, + 0, + 1 + ], + "weighted_loads": [ + 0.329851359128952, + 0.0794382244348526, + 0.0, + 0.0, + 0.0, + 0.5509259402751923, + 0.0, + 0.2063647322356701, + 0.24378696829080582, + 0.10648360475897789, + 0.06425274908542633, + 0.04345794394612312, + 0.24784725531935692, + 0.04455402120947838, + 0.312483549118042, + 0.0, + 0.37375155836343765, + 0.2166069783270359, + 0.03844837471842766, + 0.0, + 0.14514442905783653, + 0.1619688719511032, + 0.46739209815859795, + 0.03434550389647484, + 0.17229211702942848, + 0.13829484209418297, + 0.07760081067681313, + 0.0, + 0.0, + 0.03192673623561859, + 0.0, + 0.8659150712192059, + 0.0, + 0.25167328491806984, + 0.18486736714839935, + 0.0, + 0.3099236227571964, + 0.0, + 0.1793583407998085, + 0.0, + 0.0, + 0.19474974274635315, + 0.04807433858513832, + 0.24641630798578262, + 0.0, + 0.0, + 0.0, + 0.03980333358049393, + 0.4326114058494568, + 0.24175475165247917, + 0.037530433386564255, + 0.09190502390265465, + 0.31833065301179886, + 0.20384309068322182, + 0.0, + 0.04105208069086075, + 0.033411938697099686, + 0.8408411219716072, + 0.0, + 0.46817678958177567, + 0.04412352293729782, + 0.21381863206624985, + 0.0, + 0.035141412168741226 + ], + "unique_experts": 44, + "load_cv": 1.1439589045541112, + "normalized_load_entropy": 0.8486431203787764, + "max_load_share": 0.08333333333333333 + }, + "full_input": { + "tokens": 65, + "top_k": 6, + "decisions": 390, + "ordered_route_sha256": "084aa3304871e81f87f16fd2eacf1a04cbb3ef2be907d5019746ff6a5da738f2", + "route_weight_sha256": "de6f7216242cd31fbcbf2c990479c69518cba4f2a8dca4adf182d39a073da870", + "loads": [ + 10, + 1, + 0, + 2, + 3, + 2, + 0, + 10, + 10, + 5, + 2, + 1, + 7, + 1, + 6, + 0, + 9, + 5, + 2, + 0, + 3, + 5, + 9, + 8, + 3, + 2, + 5, + 8, + 19, + 16, + 12, + 16, + 4, + 9, + 8, + 8, + 6, + 4, + 22, + 0, + 0, + 15, + 10, + 6, + 12, + 5, + 4, + 7, + 15, + 4, + 3, + 2, + 5, + 7, + 0, + 1, + 2, + 19, + 0, + 8, + 3, + 13, + 5, + 1 + ], + "weighted_loads": [ + 0.5217993203550577, + 0.0794382244348526, + 0.0, + 0.054155112244188786, + 0.6704154573380947, + 0.5509259402751923, + 0.0, + 0.5286810025572777, + 0.7172081954777241, + 0.42533227428793907, + 0.10653073340654373, + 0.04345794394612312, + 0.42517194524407387, + 0.04455402120947838, + 0.312483549118042, + 0.0, + 0.6686711870133877, + 0.32855601981282234, + 0.07368240505456924, + 0.0, + 0.14514442905783653, + 0.2828036230057478, + 0.5555352456867695, + 0.6246634088456631, + 0.17229211702942848, + 0.13829484209418297, + 0.19950277358293533, + 0.42898891493678093, + 2.5144400745630264, + 1.9395301081240177, + 0.9100398048758507, + 1.236803425475955, + 0.1776317860931158, + 0.49419933557510376, + 0.4369589649140835, + 0.6626858152449131, + 0.3099236227571964, + 0.17363439686596394, + 1.7813104912638664, + 0.0, + 0.0, + 1.2664798274636269, + 0.5828119479119778, + 0.4526444636285305, + 1.1502347849309444, + 0.34724654257297516, + 0.19388318061828613, + 0.3407411649823189, + 0.9574906006455421, + 0.24175475165247917, + 0.10293904319405556, + 0.09190502390265465, + 0.31833065301179886, + 0.35815354809165, + 0.0, + 0.04105208069086075, + 0.06116163544356823, + 1.143294233828783, + 0.0, + 0.5823426935821772, + 0.11649536155164242, + 0.6631426364183426, + 0.22270628064870834, + 0.035141412168741226 + ], + "unique_experts": 56, + "load_cv": 0.8662720995318679, + "normalized_load_entropy": 0.907259721785287, + "max_load_share": 0.05641025641025641 + } + }, + "s0_period": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "d03f724fc328d90783151ea42083ab9f68b8a84862aad21c3e69ef435182d051", + "route_weight_sha256": "4c4c80c83350687027f15320e529123bd2e144a07859f8a264755f80fc71fdbc", + "loads": [ + 6, + 1, + 0, + 0, + 0, + 3, + 0, + 4, + 3, + 2, + 1, + 1, + 3, + 1, + 6, + 0, + 5, + 3, + 1, + 0, + 3, + 2, + 7, + 1, + 3, + 2, + 1, + 0, + 0, + 0, + 0, + 11, + 0, + 6, + 3, + 0, + 5, + 0, + 3, + 0, + 0, + 4, + 1, + 1, + 0, + 0, + 0, + 1, + 7, + 5, + 1, + 2, + 5, + 3, + 0, + 1, + 1, + 13, + 0, + 6, + 1, + 4, + 0, + 1 + ], + "weighted_loads": [ + 0.33768032491207123, + 0.08196940273046494, + 0.0, + 0.0, + 0.0, + 0.5757144689559937, + 0.0, + 0.20912795141339302, + 0.26062247157096863, + 0.11030200868844986, + 0.06654901802539825, + 0.04946771636605263, + 0.28176621720194817, + 0.03986029699444771, + 0.30088257044553757, + 0.0, + 0.3551022708415985, + 0.2205088920891285, + 0.03685089573264122, + 0.0, + 0.13839932903647423, + 0.15218372642993927, + 0.4562925659120083, + 0.035581961274147034, + 0.16818196699023247, + 0.125611936673522, + 0.04480397701263428, + 0.0, + 0.0, + 0.0, + 0.0, + 0.854165431112051, + 0.0, + 0.3014198802411556, + 0.17746076360344887, + 0.0, + 0.2558630704879761, + 0.0, + 0.17492065951228142, + 0.0, + 0.0, + 0.18452605977654457, + 0.040937818586826324, + 0.15463075041770935, + 0.0, + 0.0, + 0.0, + 0.03821949288249016, + 0.45421215519309044, + 0.27861468121409416, + 0.035281676799058914, + 0.0939190648496151, + 0.31369858980178833, + 0.1538856402039528, + 0.0, + 0.044404178857803345, + 0.03267129883170128, + 0.896748062223196, + 0.0, + 0.5381387546658516, + 0.04105202853679657, + 0.20674530789256096, + 0.0, + 0.04339480400085449 + ], + "unique_experts": 43, + "load_cv": 1.2018504251546631, + "normalized_load_entropy": 0.8376563862540692, + "max_load_share": 0.09027777777777778 + }, + "full_input": { + "tokens": 49, + "top_k": 6, + "decisions": 294, + "ordered_route_sha256": "901758202ea631d6cacfec3c5db8201d6c8193e8024bb35b7d92a688a7c67a7b", + "route_weight_sha256": "a1d11182bb090c0132e6c45d567f906a71efefa4d05b052c0ce351d91e29de56", + "loads": [ + 6, + 1, + 0, + 4, + 3, + 3, + 0, + 6, + 8, + 2, + 1, + 1, + 8, + 1, + 6, + 0, + 9, + 3, + 1, + 0, + 3, + 2, + 8, + 8, + 3, + 2, + 2, + 9, + 17, + 10, + 3, + 16, + 1, + 7, + 3, + 8, + 5, + 4, + 18, + 0, + 0, + 10, + 6, + 2, + 1, + 1, + 3, + 7, + 11, + 5, + 2, + 2, + 5, + 3, + 0, + 1, + 3, + 13, + 0, + 8, + 1, + 9, + 4, + 5 + ], + "weighted_loads": [ + 0.33768032491207123, + 0.08196940273046494, + 0.0, + 0.12241765949875116, + 0.6729954406619072, + 0.5757144689559937, + 0.0, + 0.3317794054746628, + 0.5901387166231871, + 0.11030200868844986, + 0.06654901802539825, + 0.04946771636605263, + 0.5578703247010708, + 0.03986029699444771, + 0.30088257044553757, + 0.0, + 0.571092963218689, + 0.2205088920891285, + 0.03685089573264122, + 0.0, + 0.13839932903647423, + 0.15218372642993927, + 0.5063864775002003, + 0.5876222476363182, + 0.16818196699023247, + 0.125611936673522, + 0.07761310413479805, + 0.4667969662696123, + 2.2430023066699505, + 1.30869747325778, + 0.09368078038096428, + 1.2430752627551556, + 0.046385444700717926, + 0.341827429831028, + 0.17746076360344887, + 0.5488094016909599, + 0.2558630704879761, + 0.11260077357292175, + 1.6198869571089745, + 0.0, + 0.0, + 0.7896728105843067, + 0.367962796241045, + 0.2718350738286972, + 0.049022674560546875, + 0.03944015875458717, + 0.16370003670454025, + 0.32626420818269253, + 0.7042968608438969, + 0.27861468121409416, + 0.04821627959609032, + 0.0939190648496151, + 0.31369858980178833, + 0.1538856402039528, + 0.0, + 0.044404178857803345, + 0.13156695663928986, + 0.896748062223196, + 0.0, + 0.6231517847627401, + 0.04105202853679657, + 0.41285133361816406, + 0.17648052796721458, + 0.17174188792705536 + ], + "unique_experts": 56, + "load_cv": 0.9241440889769221, + "normalized_load_entropy": 0.8994572812537661, + "max_load_share": 0.061224489795918366 + } + }, + "s1_period": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "34c0edf5f2c9f82762162b82a8007a2b163fefe272ac0b64528e35e4f3452f3d", + "route_weight_sha256": "810b44a2f0545bd944dffe7b14da2e9b197d03a2a3fff7d15e9f5501a0ef8258", + "loads": [ + 6, + 1, + 0, + 0, + 0, + 2, + 0, + 4, + 3, + 2, + 1, + 1, + 3, + 2, + 6, + 0, + 5, + 3, + 1, + 0, + 3, + 2, + 7, + 1, + 3, + 2, + 1, + 0, + 0, + 1, + 0, + 11, + 0, + 5, + 3, + 0, + 5, + 0, + 3, + 0, + 0, + 4, + 1, + 3, + 0, + 0, + 0, + 1, + 6, + 4, + 1, + 2, + 5, + 4, + 0, + 1, + 1, + 12, + 0, + 6, + 1, + 4, + 0, + 1 + ], + "weighted_loads": [ + 0.33750734850764275, + 0.07820093631744385, + 0.0, + 0.0, + 0.0, + 0.5479141473770142, + 0.0, + 0.21203995868563652, + 0.2527139112353325, + 0.10247674956917763, + 0.06969214230775833, + 0.046096716076135635, + 0.25729166716337204, + 0.07379365153610706, + 0.3072871156036854, + 0.0, + 0.37134435772895813, + 0.2156401202082634, + 0.037299107760190964, + 0.0, + 0.14504403620958328, + 0.15355605632066727, + 0.4652593210339546, + 0.03471316024661064, + 0.17601201310753822, + 0.12643805518746376, + 0.04212971031665802, + 0.0, + 0.0, + 0.03218243643641472, + 0.0, + 0.8394431248307228, + 0.0, + 0.25113097205758095, + 0.17832905054092407, + 0.0, + 0.2771928906440735, + 0.0, + 0.17344947904348373, + 0.0, + 0.0, + 0.19347482174634933, + 0.05093146488070488, + 0.24640586972236633, + 0.0, + 0.0, + 0.0, + 0.038262177258729935, + 0.3851063773036003, + 0.23665332421660423, + 0.04008825868368149, + 0.09795940667390823, + 0.31442397832870483, + 0.2030136100947857, + 0.0, + 0.040617309510707855, + 0.03259121999144554, + 0.8320416957139969, + 0.0, + 0.5093361325562, + 0.042486175894737244, + 0.2223336659371853, + 0.0, + 0.03593970462679863 + ], + "unique_experts": 44, + "load_cv": 1.1439589045541112, + "normalized_load_entropy": 0.8486431203787765, + "max_load_share": 0.08333333333333333 + }, + "full_input": { + "tokens": 65, + "top_k": 6, + "decisions": 390, + "ordered_route_sha256": "c841dc6979b68cc8a9bfb15be9705581be8ae810758ad2294cc17d00fb82629b", + "route_weight_sha256": "041ea853d46fd174e5a327bcc5e668b5d122d82647e9d95c25cae8c128e3afa9", + "loads": [ + 10, + 1, + 0, + 2, + 3, + 2, + 0, + 11, + 10, + 5, + 2, + 1, + 7, + 2, + 6, + 0, + 9, + 5, + 2, + 0, + 3, + 4, + 9, + 8, + 3, + 2, + 4, + 7, + 19, + 16, + 11, + 16, + 4, + 9, + 8, + 8, + 5, + 4, + 23, + 0, + 0, + 16, + 10, + 6, + 12, + 4, + 4, + 8, + 15, + 4, + 3, + 2, + 5, + 7, + 0, + 1, + 2, + 18, + 0, + 9, + 3, + 13, + 6, + 1 + ], + "weighted_loads": [ + 0.5294553097337484, + 0.07820093631744385, + 0.0, + 0.054155112244188786, + 0.6704154573380947, + 0.5479141473770142, + 0.0, + 0.5538084357976913, + 0.732750654220581, + 0.4213254190981388, + 0.11197012662887573, + 0.046096716076135635, + 0.42581553757190704, + 0.07379365153610706, + 0.3072871156036854, + 0.0, + 0.6767499446868896, + 0.32758916169404984, + 0.07253313809633255, + 0.0, + 0.14504403620958328, + 0.24327395111322403, + 0.5534024685621262, + 0.5441628880798817, + 0.17601201310753822, + 0.12643805518746376, + 0.16403167322278023, + 0.35426777228713036, + 2.54632630571723, + 1.9489555098116398, + 0.8637138567864895, + 1.202861050143838, + 0.1776317860931158, + 0.49365702271461487, + 0.4304206483066082, + 0.620302002876997, + 0.2771928906440735, + 0.17363439686596394, + 1.8255405128002167, + 0.0, + 0.0, + 1.3668875247240067, + 0.6024530418217182, + 0.44635703042149544, + 1.1502347849309444, + 0.3058609776198864, + 0.20434238389134407, + 0.37577957659959793, + 0.8782165050506592, + 0.23665332421660423, + 0.10549686849117279, + 0.09795940667390823, + 0.31442397832870483, + 0.3573240675032139, + 0.0, + 0.040617309510707855, + 0.060340916737914085, + 1.0861216150224209, + 0.0, + 0.6235020365566015, + 0.11485801450908184, + 0.6726458184421062, + 0.25840889289975166, + 0.03593970462679863 + ], + "unique_experts": 56, + "load_cv": 0.8735276896521862, + "normalized_load_entropy": 0.9067263175297914, + "max_load_share": 0.05897435897435897 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 24, + "ordered_topk_exact_tokens": 21, + "set_exact_tokens": 23, + "mean_set_jaccard": 0.9880952380952381, + "mean_token_weighted_tv": 0.007889552507549524, + "aggregate_load_tv": 0.006944444444444444 + }, + "system_bos": { + "tokens": 24, + "ordered_topk_exact_tokens": 16, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.9404761904761904, + "mean_token_weighted_tv": 0.01580647611990571, + "aggregate_load_tv": 0.034722222222222224 + }, + "system_x": { + "tokens": 24, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.9047619047619048, + "mean_token_weighted_tv": 0.02322130766697228, + "aggregate_load_tv": 0.04861111111111111 + }, + "system_period": { + "tokens": 24, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 18, + "mean_set_jaccard": 0.9285714285714285, + "mean_token_weighted_tv": 0.021261461234341066, + "aggregate_load_tv": 0.034722222222222224 + }, + "bos_at_s0": { + "tokens": 24, + "ordered_topk_exact_tokens": 16, + "set_exact_tokens": 20, + "mean_set_jaccard": 0.9523809523809526, + "mean_token_weighted_tv": 0.017440614678586524, + "aggregate_load_tv": 0.020833333333333336 + }, + "bos_at_s1": { + "tokens": 24, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 21, + "mean_set_jaccard": 0.9642857142857144, + "mean_token_weighted_tv": 0.017340243561193347, + "aggregate_load_tv": 0.020833333333333336 + }, + "x_at_s0": { + "tokens": 24, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.9404761904761906, + "mean_token_weighted_tv": 0.023033220786601305, + "aggregate_load_tv": 0.027777777777777776 + }, + "x_at_s1": { + "tokens": 24, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 18, + "mean_set_jaccard": 0.9285714285714285, + "mean_token_weighted_tv": 0.029192330858980615, + "aggregate_load_tv": 0.04166666666666667 + }, + "period_at_s0": { + "tokens": 24, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.9404761904761906, + "mean_token_weighted_tv": 0.021981888023825984, + "aggregate_load_tv": 0.02083333333333333 + }, + "period_at_s1": { + "tokens": 24, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.9166666666666666, + "mean_token_weighted_tv": 0.029708649148233235, + "aggregate_load_tv": 0.041666666666666664 + } + } + }, + "layer_13": { + "layer": 13, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "5a3bb3b140013ba9a86a8e8978af223ebb754ff4c61034f9cd054a3803957716", + "route_weight_sha256": "41fd55fd5dc694128b5ca52aaeefd3296f3c811f4cc263b9ca84d75ae1d33742", + "loads": [ + 0, + 0, + 0, + 1, + 2, + 7, + 13, + 0, + 0, + 2, + 4, + 3, + 3, + 5, + 3, + 3, + 0, + 3, + 0, + 0, + 10, + 3, + 3, + 0, + 0, + 4, + 2, + 2, + 9, + 0, + 1, + 2, + 0, + 0, + 5, + 2, + 0, + 0, + 1, + 0, + 1, + 4, + 1, + 1, + 0, + 0, + 3, + 2, + 6, + 0, + 0, + 9, + 0, + 0, + 1, + 0, + 0, + 0, + 5, + 0, + 0, + 7, + 4, + 7 + ], + "weighted_loads": [ + 0.0, + 0.0, + 0.0, + 0.043155405670404434, + 0.06943495571613312, + 0.4502979591488838, + 0.7777597345411777, + 0.0, + 0.0, + 0.06441504880785942, + 0.17187810689210892, + 0.23643629997968674, + 0.11787865310907364, + 0.3132563680410385, + 0.16245117411017418, + 0.1247263066470623, + 0.0, + 0.1040550135076046, + 0.0, + 0.0, + 0.9528329726308584, + 0.1261589080095291, + 0.20877252519130707, + 0.0, + 0.0, + 0.2338973619043827, + 0.08438180759549141, + 0.10390287637710571, + 0.5104923881590366, + 0.0, + 0.03272449970245361, + 0.09533716365695, + 0.0, + 0.0, + 0.2728288769721985, + 0.09359217435121536, + 0.0, + 0.0, + 0.03286709263920784, + 0.0, + 0.026446562260389328, + 0.19384590536355972, + 0.039057713001966476, + 0.03084440343081951, + 0.0, + 0.0, + 0.1906574498862028, + 0.0712200179696083, + 0.2564685009419918, + 0.0, + 0.0, + 0.5321611277759075, + 0.0, + 0.0, + 0.05814426392316818, + 0.0, + 0.0, + 0.0, + 0.6971920393407345, + 0.0, + 0.0, + 0.40189290419220924, + 0.2216779813170433, + 0.48428772762417793 + ], + "unique_experts": 37, + "load_cv": 1.286204100310025, + "normalized_load_entropy": 0.8110570637602649, + "max_load_share": 0.09027777777777778 + }, + "full_input": { + "tokens": 49, + "top_k": 6, + "decisions": 294, + "ordered_route_sha256": "043b0599cc840adf9c70c2907467ba0662283c49359087bc856fe5935238d03c", + "route_weight_sha256": "ffb8ae7c238718e15e0ebc27184d6be07b690c5aa0adc2df49e7e91bb9133feb", + "loads": [ + 0, + 6, + 0, + 1, + 2, + 8, + 33, + 0, + 0, + 5, + 14, + 9, + 3, + 5, + 4, + 9, + 0, + 5, + 1, + 1, + 10, + 5, + 3, + 0, + 4, + 4, + 5, + 2, + 9, + 15, + 1, + 2, + 0, + 7, + 6, + 2, + 3, + 1, + 1, + 2, + 1, + 6, + 3, + 3, + 10, + 10, + 4, + 5, + 7, + 0, + 1, + 9, + 3, + 3, + 3, + 0, + 3, + 0, + 11, + 4, + 0, + 8, + 4, + 8 + ], + "weighted_loads": [ + 0.0, + 0.30967598035931587, + 0.0, + 0.043155405670404434, + 0.06943495571613312, + 0.4815063178539276, + 2.5032262541353703, + 0.0, + 0.0, + 0.17915392108261585, + 0.8378978576511145, + 0.5048511466011405, + 0.11787865310907364, + 0.3132563680410385, + 0.20770836248993874, + 0.4328770823776722, + 0.0, + 0.15211583953350782, + 0.04231458529829979, + 0.04426967725157738, + 0.9528329726308584, + 0.2024725377559662, + 0.20877252519130707, + 0.0, + 0.15736139938235283, + 0.2338973619043827, + 0.2075072079896927, + 0.10390287637710571, + 0.5104923881590366, + 1.0578806027770042, + 0.03272449970245361, + 0.09533716365695, + 0.0, + 0.657599426805973, + 0.2956360634416342, + 0.09359217435121536, + 0.1486523672938347, + 0.03365176171064377, + 0.03286709263920784, + 0.06917024031281471, + 0.026446562260389328, + 0.2987159751355648, + 0.140565674751997, + 0.1290950644761324, + 1.0486672259867191, + 0.9692635014653206, + 0.2218046970665455, + 1.2949684876948595, + 0.28851454704999924, + 0.0, + 0.03834308683872223, + 0.5321611277759075, + 0.1081555038690567, + 0.14088914915919304, + 0.145884083583951, + 0.0, + 0.1631915606558323, + 0.0, + 0.9755091350525618, + 0.2040790691971779, + 0.0, + 0.4315743464976549, + 0.2216779813170433, + 0.5216521918773651 + ], + "unique_experts": 53, + "load_cv": 1.1077996839485842, + "normalized_load_entropy": 0.8799429255151328, + "max_load_share": 0.11224489795918367 + } + }, + "s1_eos": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "2927f4e0f389efe576980645671db0e91f0b22cece97d6842913702e2a016620", + "route_weight_sha256": "8f328807d936359f1390b43802b024d03261b01890469244c59db899a9866373", + "loads": [ + 0, + 0, + 0, + 1, + 2, + 7, + 13, + 0, + 0, + 2, + 4, + 3, + 2, + 5, + 3, + 2, + 0, + 3, + 0, + 0, + 10, + 3, + 3, + 0, + 0, + 4, + 2, + 2, + 9, + 0, + 1, + 2, + 0, + 0, + 4, + 3, + 0, + 0, + 1, + 0, + 1, + 3, + 1, + 1, + 0, + 0, + 4, + 2, + 6, + 0, + 0, + 9, + 0, + 0, + 1, + 0, + 0, + 1, + 5, + 0, + 0, + 7, + 4, + 8 + ], + "weighted_loads": [ + 0.0, + 0.0, + 0.0, + 0.0453060045838356, + 0.0693376287817955, + 0.4583757780492306, + 0.7794851139187813, + 0.0, + 0.0, + 0.0648694634437561, + 0.17060527950525284, + 0.2304532341659069, + 0.07368503883481026, + 0.30347368493676186, + 0.16045605018734932, + 0.09215949475765228, + 0.0, + 0.10388852469623089, + 0.0, + 0.0, + 0.9734679870307446, + 0.12346836924552917, + 0.20907576754689217, + 0.0, + 0.0, + 0.22736438363790512, + 0.08126816898584366, + 0.1040906235575676, + 0.5135169252753258, + 0.0, + 0.03190440684556961, + 0.09695656970143318, + 0.0, + 0.0, + 0.24833807721734047, + 0.11381197348237038, + 0.0, + 0.0, + 0.032993417233228683, + 0.0, + 0.03228635713458061, + 0.1639324463903904, + 0.04010096564888954, + 0.03181058540940285, + 0.0, + 0.0, + 0.21925605461001396, + 0.07141292467713356, + 0.2525496780872345, + 0.0, + 0.0, + 0.5354962050914764, + 0.0, + 0.0, + 0.05695977434515953, + 0.0, + 0.0, + 0.02662605047225952, + 0.6941858120262623, + 0.0, + 0.0, + 0.3986712023615837, + 0.22218528017401695, + 0.5218596123158932 + ], + "unique_experts": 38, + "load_cv": 1.2886015005270224, + "normalized_load_entropy": 0.8133904114813336, + "max_load_share": 0.09027777777777778 + }, + "full_input": { + "tokens": 65, + "top_k": 6, + "decisions": 390, + "ordered_route_sha256": "e175dccc35599e75cec2e313479d725ec8fc73446209ed6706caa1c6f7d5b55a", + "route_weight_sha256": "f61d2df2ade39e8a5bed4cd7abf957321fd5ebd52b68ee069a9496a753af31c6", + "loads": [ + 5, + 6, + 0, + 1, + 2, + 9, + 44, + 0, + 0, + 5, + 13, + 15, + 2, + 5, + 4, + 9, + 0, + 5, + 3, + 3, + 10, + 7, + 3, + 3, + 5, + 4, + 7, + 2, + 9, + 19, + 8, + 3, + 0, + 12, + 7, + 4, + 4, + 1, + 2, + 1, + 3, + 8, + 9, + 3, + 16, + 11, + 5, + 5, + 8, + 5, + 1, + 9, + 3, + 2, + 3, + 2, + 3, + 12, + 12, + 4, + 1, + 9, + 4, + 10 + ], + "weighted_loads": [ + 0.20263899490237236, + 0.34650105983018875, + 0.0, + 0.0453060045838356, + 0.0693376287817955, + 0.5431694984436035, + 3.348584871739149, + 0.0, + 0.0, + 0.20945661328732967, + 0.7787548433989286, + 0.9977050889283419, + 0.07368503883481026, + 0.30347368493676186, + 0.20419546216726303, + 0.45705532655119896, + 0.0, + 0.1567913293838501, + 0.09779335558414459, + 0.1224154569208622, + 0.9734679870307446, + 0.32915859296917915, + 0.20907576754689217, + 0.12339235097169876, + 0.20986958732828498, + 0.22736438363790512, + 0.2840035930275917, + 0.1040906235575676, + 0.5135169252753258, + 1.7430637441575527, + 0.43186693266034126, + 0.1377883106470108, + 0.0, + 1.1471980288624763, + 0.47349886037409306, + 0.16628898680210114, + 0.24506336078047752, + 0.03339720889925957, + 0.07582384720444679, + 0.04221672937273979, + 0.11244294419884682, + 0.3811626359820366, + 0.708348298445344, + 0.1439172402024269, + 1.4733281880617142, + 0.9663150869309902, + 0.25816742330789566, + 1.3009915202856064, + 0.5073254890739918, + 0.2469778098165989, + 0.0366373173892498, + 0.5354962050914764, + 0.10454224050045013, + 0.08114603161811829, + 0.12874804064631462, + 0.07246025279164314, + 0.15532293543219566, + 0.7325792424380779, + 1.0068244896829128, + 0.19493836537003517, + 0.028817499056458473, + 0.481510728597641, + 0.22218528017401695, + 0.6069928742945194 + ], + "unique_experts": 59, + "load_cv": 1.045839570692638, + "normalized_load_entropy": 0.9032508530451484, + "max_load_share": 0.11282051282051282 + } + }, + "s0_bos": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "565f842c743146769034aa697736e114a852a3ee5d080a0c838a6f8edf5604bb", + "route_weight_sha256": "e2c00929bea993135b83549da43a67b8dc4867a8ea2065cd611589ad446bb1c3", + "loads": [ + 0, + 0, + 0, + 1, + 2, + 7, + 13, + 0, + 0, + 3, + 4, + 3, + 1, + 5, + 3, + 2, + 1, + 3, + 1, + 0, + 10, + 3, + 3, + 0, + 0, + 4, + 2, + 2, + 9, + 0, + 1, + 2, + 0, + 0, + 5, + 2, + 0, + 0, + 1, + 0, + 2, + 4, + 1, + 1, + 0, + 0, + 3, + 0, + 6, + 0, + 0, + 9, + 0, + 0, + 1, + 0, + 0, + 0, + 5, + 0, + 0, + 7, + 4, + 8 + ], + "weighted_loads": [ + 0.0, + 0.0, + 0.0, + 0.03353029489517212, + 0.07169465161859989, + 0.45769333466887474, + 0.7908832430839539, + 0.0, + 0.0, + 0.10111724771559238, + 0.16851526871323586, + 0.24129921197891235, + 0.044050510972738266, + 0.28184347227215767, + 0.16306601092219353, + 0.09319942072033882, + 0.036509886384010315, + 0.10945308208465576, + 0.024968741461634636, + 0.0, + 0.9559644088149071, + 0.11881902255117893, + 0.204157967120409, + 0.0, + 0.0, + 0.23138558492064476, + 0.0881681889295578, + 0.10173523426055908, + 0.4856809601187706, + 0.0, + 0.03860202059149742, + 0.09883545339107513, + 0.0, + 0.0, + 0.2919744346290827, + 0.1007688120007515, + 0.0, + 0.0, + 0.03841231018304825, + 0.0, + 0.06035320460796356, + 0.19476773217320442, + 0.039243798702955246, + 0.03359837085008621, + 0.0, + 0.0, + 0.18383722566068172, + 0.0, + 0.25460147485136986, + 0.0, + 0.0, + 0.5620390102267265, + 0.0, + 0.0, + 0.059364352375268936, + 0.0, + 0.0, + 0.0, + 0.6901621669530869, + 0.0, + 0.0, + 0.38948846608400345, + 0.2353239469230175, + 0.5521114282310009 + ], + "unique_experts": 38, + "load_cv": 1.2957670877434002, + "normalized_load_entropy": 0.8115274016729578, + "max_load_share": 0.09027777777777778 + }, + "full_input": { + "tokens": 49, + "top_k": 6, + "decisions": 294, + "ordered_route_sha256": "a19cd5905b7e96e3a9a3505f000d8c6eb42790c0e99d00f219a05bcec954bc6d", + "route_weight_sha256": "f37ef309224fa9ad0f1445ee3dd80da613206f10de08c9c721ca5cac1162971d", + "loads": [ + 0, + 6, + 1, + 1, + 3, + 9, + 33, + 0, + 0, + 8, + 13, + 7, + 1, + 5, + 3, + 8, + 1, + 4, + 2, + 1, + 10, + 5, + 3, + 0, + 3, + 4, + 5, + 2, + 9, + 15, + 1, + 2, + 0, + 5, + 6, + 2, + 2, + 1, + 1, + 2, + 2, + 6, + 3, + 4, + 10, + 11, + 4, + 2, + 7, + 0, + 1, + 9, + 3, + 4, + 3, + 0, + 5, + 0, + 11, + 4, + 0, + 8, + 4, + 9 + ], + "weighted_loads": [ + 0.0, + 0.359114196151495, + 0.06993032991886139, + 0.03353029489517212, + 0.12177267484366894, + 0.5397470183670521, + 2.5376957580447197, + 0.0, + 0.0, + 0.3369525708258152, + 0.7261170279234648, + 0.45610638335347176, + 0.044050510972738266, + 0.28184347227215767, + 0.16306601092219353, + 0.4013501964509487, + 0.036509886384010315, + 0.14445986971259117, + 0.06728332675993443, + 0.04426967725157738, + 0.9559644088149071, + 0.21642264537513256, + 0.204157967120409, + 0.0, + 0.1516221147030592, + 0.23138558492064476, + 0.21129358932375908, + 0.10173523426055908, + 0.4856809601187706, + 0.9957064874470234, + 0.03860202059149742, + 0.09883545339107513, + 0.0, + 0.5574133731424809, + 0.31478162109851837, + 0.1007688120007515, + 0.10674018040299416, + 0.03365176171064377, + 0.03841231018304825, + 0.06917024031281471, + 0.06035320460796356, + 0.2983247675001621, + 0.1655535139143467, + 0.21632670238614082, + 0.9110864140093327, + 1.0064965933561325, + 0.2149844728410244, + 0.39253624714910984, + 0.2866475209593773, + 0.0, + 0.03834308683872223, + 0.5620390102267265, + 0.1081555038690567, + 0.20216379687190056, + 0.14710417203605175, + 0.0, + 0.31283073127269745, + 0.0, + 0.960648225620389, + 0.2040790691971779, + 0.0, + 0.4191699083894491, + 0.2353239469230175, + 0.5894758924841881 + ], + "unique_experts": 55, + "load_cv": 1.1010955885890783, + "normalized_load_entropy": 0.8841845361702344, + "max_load_share": 0.11224489795918367 + } + }, + "s1_bos": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "ae400edcc92d06d221f47983cc527a5b8d7ce79ba271943622ecf6904b4b3fac", + "route_weight_sha256": "abc18b23d48445923cece5d897e433183afd5844a9817f1d0f851c8bd27ed871", + "loads": [ + 0, + 0, + 0, + 1, + 2, + 7, + 13, + 0, + 0, + 2, + 4, + 3, + 1, + 5, + 3, + 2, + 1, + 3, + 0, + 0, + 10, + 3, + 3, + 0, + 0, + 4, + 2, + 3, + 9, + 0, + 1, + 2, + 0, + 0, + 4, + 2, + 0, + 0, + 1, + 0, + 1, + 4, + 1, + 0, + 0, + 0, + 3, + 1, + 6, + 0, + 0, + 10, + 0, + 0, + 1, + 0, + 1, + 1, + 5, + 0, + 0, + 7, + 4, + 8 + ], + "weighted_loads": [ + 0.0, + 0.0, + 0.0, + 0.04097098857164383, + 0.06584993563592434, + 0.4468471445143223, + 0.746404904872179, + 0.0, + 0.0, + 0.06628632545471191, + 0.17164326831698418, + 0.22955120354890823, + 0.038198888301849365, + 0.2897515185177326, + 0.16490377485752106, + 0.09646765142679214, + 0.03892682120203972, + 0.10940461605787277, + 0.0, + 0.0, + 0.9611897747963667, + 0.11996114067733288, + 0.20582523569464684, + 0.0, + 0.0, + 0.2334023155272007, + 0.0876152366399765, + 0.142136100679636, + 0.4908975027501583, + 0.0, + 0.03585252910852432, + 0.10103823617100716, + 0.0, + 0.0, + 0.26209525763988495, + 0.09511258080601692, + 0.0, + 0.0, + 0.033534880727529526, + 0.0, + 0.03464049473404884, + 0.20324643701314926, + 0.042849861085414886, + 0.0, + 0.0, + 0.0, + 0.19325394555926323, + 0.03338408097624779, + 0.2548868991434574, + 0.0, + 0.0, + 0.5672464724630117, + 0.0, + 0.0, + 0.05510536953806877, + 0.0, + 0.02330690436065197, + 0.03126806393265724, + 0.7170684784650803, + 0.0, + 0.0, + 0.394332405179739, + 0.232698742300272, + 0.5152980424463749 + ], + "unique_experts": 39, + "load_cv": 1.3052600138300812, + "normalized_load_entropy": 0.8125918513703467, + "max_load_share": 0.09027777777777778 + }, + "full_input": { + "tokens": 65, + "top_k": 6, + "decisions": 390, + "ordered_route_sha256": "94f8cd560d6fdd8e0e19500d2b68432a31c17cd86d781bdcef4c172fc8527706", + "route_weight_sha256": "65c2797205b71ed5ed42d709db188446bc1ba8a6ac0b5938b67682f2352e32dd", + "loads": [ + 5, + 7, + 1, + 1, + 2, + 9, + 44, + 0, + 0, + 6, + 15, + 13, + 1, + 5, + 3, + 9, + 1, + 4, + 2, + 3, + 10, + 8, + 3, + 3, + 5, + 4, + 6, + 3, + 9, + 19, + 8, + 3, + 0, + 11, + 7, + 3, + 5, + 1, + 2, + 1, + 3, + 8, + 9, + 2, + 16, + 12, + 4, + 3, + 8, + 5, + 1, + 10, + 3, + 2, + 3, + 2, + 5, + 12, + 12, + 4, + 1, + 9, + 4, + 10 + ], + "weighted_loads": [ + 0.20263899490237236, + 0.4322884865105152, + 0.049164678901433945, + 0.04097098857164383, + 0.06584993563592434, + 0.5329638496041298, + 3.4264362417161465, + 0.0, + 0.0, + 0.26509921438992023, + 0.8756951075047255, + 0.9534258283674717, + 0.038198888301849365, + 0.2897515185177326, + 0.16490377485752106, + 0.4613634832203388, + 0.03892682120203972, + 0.1485893502831459, + 0.06748213805258274, + 0.1224154569208622, + 0.9611897747963667, + 0.3703241962939501, + 0.20582523569464684, + 0.12339235097169876, + 0.2579620871692896, + 0.2334023155272007, + 0.24208608642220497, + 0.142136100679636, + 0.4908975027501583, + 1.6639114059507847, + 0.435815054923296, + 0.14186997711658478, + 0.0, + 1.1142648942768574, + 0.48725604079663754, + 0.14758959412574768, + 0.29881907626986504, + 0.03339720889925957, + 0.07636531069874763, + 0.04221672937273979, + 0.11479708179831505, + 0.3846829757094383, + 0.7267867606133223, + 0.11676808446645737, + 1.3609689027071, + 1.011065799742937, + 0.23216531425714493, + 0.43365541845560074, + 0.5096627101302147, + 0.2469778098165989, + 0.0366373173892498, + 0.5672464724630117, + 0.10454224050045013, + 0.08114603161811829, + 0.12689363583922386, + 0.07246025279164314, + 0.21876522339880466, + 0.7372212558984756, + 1.007319362834096, + 0.19493836537003517, + 0.028817499056458473, + 0.4771719314157963, + 0.232698742300272, + 0.6004313044250011 + ], + "unique_experts": 61, + "load_cv": 1.0490532972698863, + "normalized_load_entropy": 0.9040697192677525, + "max_load_share": 0.11282051282051282 + } + }, + "s0_x": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "20ac59589d1ef99f3f5736beee34def1580a9b1e110830c9f69f6590b62d17e9", + "route_weight_sha256": "eaca95ac4249c1b3db37f56ed7c8ab421bbac9a6e4e56b0d004b8d79b3fcae90", + "loads": [ + 0, + 1, + 0, + 1, + 2, + 7, + 13, + 0, + 0, + 2, + 3, + 3, + 1, + 5, + 2, + 2, + 0, + 3, + 1, + 0, + 9, + 3, + 3, + 0, + 0, + 4, + 2, + 3, + 9, + 0, + 1, + 2, + 0, + 0, + 5, + 2, + 0, + 0, + 1, + 0, + 2, + 4, + 1, + 1, + 0, + 0, + 3, + 2, + 6, + 0, + 0, + 9, + 0, + 0, + 1, + 0, + 0, + 0, + 5, + 0, + 1, + 7, + 4, + 8 + ], + "weighted_loads": [ + 0.0, + 0.03556273505091667, + 0.0, + 0.03675364330410957, + 0.07303374446928501, + 0.44361284747719765, + 0.820677325129509, + 0.0, + 0.0, + 0.06618908420205116, + 0.13903655484318733, + 0.2308044172823429, + 0.044197697192430496, + 0.2926323935389519, + 0.11792614310979843, + 0.09607496485114098, + 0.0, + 0.11084407567977905, + 0.028020422905683517, + 0.0, + 0.9271970801055431, + 0.12941326573491096, + 0.20604054257273674, + 0.0, + 0.0, + 0.2250298522412777, + 0.07663004472851753, + 0.13407443836331367, + 0.48272980749607086, + 0.0, + 0.04093635827302933, + 0.10468437895178795, + 0.0, + 0.0, + 0.29782796651124954, + 0.1003335677087307, + 0.0, + 0.0, + 0.037227846682071686, + 0.0, + 0.05874404311180115, + 0.19165102019906044, + 0.04396945983171463, + 0.030466513708233833, + 0.0, + 0.0, + 0.19254152476787567, + 0.07270028814673424, + 0.2615077309310436, + 0.0, + 0.0, + 0.5311361066997051, + 0.0, + 0.0, + 0.059191204607486725, + 0.0, + 0.0, + 0.0, + 0.6530936546623707, + 0.0, + 0.04040537402033806, + 0.36208856105804443, + 0.23218978196382523, + 0.5427800454199314 + ], + "unique_experts": 40, + "load_cv": 1.2644229640823381, + "normalized_load_entropy": 0.821585221043204, + "max_load_share": 0.09027777777777778 + }, + "full_input": { + "tokens": 49, + "top_k": 6, + "decisions": 294, + "ordered_route_sha256": "5918759d6d798146f5cacb3ae7c901d0c9a2f4004ce17a73d4ef78067936b2c3", + "route_weight_sha256": "f5d37d56d9a3ca9e2317e24286b6813cac359a1ada64abba24c3b122569928b0", + "loads": [ + 0, + 6, + 0, + 1, + 2, + 9, + 33, + 0, + 0, + 4, + 13, + 8, + 1, + 5, + 2, + 9, + 0, + 4, + 2, + 1, + 9, + 5, + 3, + 0, + 5, + 4, + 5, + 3, + 9, + 15, + 1, + 2, + 0, + 7, + 6, + 2, + 2, + 1, + 1, + 2, + 2, + 6, + 3, + 2, + 12, + 12, + 5, + 4, + 7, + 0, + 1, + 9, + 3, + 3, + 3, + 0, + 4, + 0, + 10, + 4, + 1, + 8, + 4, + 9 + ], + "weighted_loads": [ + 0.0, + 0.3162800446152687, + 0.0, + 0.03675364330410957, + 0.07303374446928501, + 0.5296845212578773, + 2.4753462933003902, + 0.0, + 0.0, + 0.14347831718623638, + 0.7087172660976648, + 0.5057382695376873, + 0.044197697192430496, + 0.2926323935389519, + 0.11792614310979843, + 0.6231368668377399, + 0.0, + 0.14585086330771446, + 0.0703350082039833, + 0.04426967725157738, + 0.9271970801055431, + 0.21839628741145134, + 0.20604054257273674, + 0.0, + 0.23750079236924648, + 0.2250298522412777, + 0.1997554451227188, + 0.13407443836331367, + 0.48272980749607086, + 0.9886115305125713, + 0.04093635827302933, + 0.10468437895178795, + 0.0, + 0.6902573332190514, + 0.32063515298068523, + 0.1003335677087307, + 0.10674018040299416, + 0.03365176171064377, + 0.037227846682071686, + 0.06917024031281471, + 0.05874404311180115, + 0.300019484013319, + 0.14457927644252777, + 0.07660611532628536, + 1.0031823590397835, + 1.2060365192592144, + 0.25231048837304115, + 0.4652365352958441, + 0.29355377703905106, + 0.0, + 0.03834308683872223, + 0.5311361066997051, + 0.1081555038690567, + 0.14088914915919304, + 0.14693102426826954, + 0.0, + 0.19348080083727837, + 0.0, + 0.8796022832393646, + 0.2040790691971779, + 0.04040537402033806, + 0.3917700033634901, + 0.23218978196382523, + 0.5801445096731186 + ], + "unique_experts": 54, + "load_cv": 1.1137988686689404, + "normalized_load_entropy": 0.8802071631644456, + "max_load_share": 0.11224489795918367 + } + }, + "s1_x": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "c3738d93a6990b8c557e030aef82a20a92104f56399fe15501ea0ad3a0461e99", + "route_weight_sha256": "c6526842f259af46ecf3ef294b92cf084333235b9eab94a07ba95b980f87a56d", + "loads": [ + 0, + 1, + 0, + 1, + 2, + 7, + 13, + 0, + 0, + 1, + 5, + 3, + 1, + 5, + 2, + 2, + 1, + 3, + 1, + 0, + 9, + 3, + 3, + 0, + 0, + 3, + 1, + 3, + 10, + 0, + 1, + 2, + 1, + 2, + 4, + 2, + 0, + 0, + 1, + 0, + 1, + 4, + 1, + 1, + 0, + 0, + 3, + 1, + 5, + 0, + 0, + 9, + 0, + 0, + 1, + 0, + 0, + 0, + 5, + 0, + 1, + 8, + 3, + 8 + ], + "weighted_loads": [ + 0.0, + 0.03238297626376152, + 0.0, + 0.04126677289605141, + 0.06614377908408642, + 0.4497741423547268, + 0.7531905360519886, + 0.0, + 0.0, + 0.0348033681511879, + 0.20619474910199642, + 0.22331885248422623, + 0.039673902094364166, + 0.27006151154637337, + 0.10469869896769524, + 0.08805521577596664, + 0.03702852874994278, + 0.10749317333102226, + 0.02670261263847351, + 0.0, + 0.9575787745416164, + 0.13010196201503277, + 0.2108168751001358, + 0.0, + 0.0, + 0.17993716895580292, + 0.039646297693252563, + 0.13999560475349426, + 0.5454849153757095, + 0.0, + 0.041093237698078156, + 0.1069939099252224, + 0.03878585994243622, + 0.07162794098258018, + 0.2626994661986828, + 0.08672528713941574, + 0.0, + 0.0, + 0.041295211762189865, + 0.0, + 0.028184158727526665, + 0.20974551513791084, + 0.04258774593472481, + 0.03350738435983658, + 0.0, + 0.0, + 0.19462749548256397, + 0.03398565948009491, + 0.216833658516407, + 0.0, + 0.0, + 0.5513630863279104, + 0.0, + 0.0, + 0.055472198873758316, + 0.0, + 0.0, + 0.0, + 0.6152665875852108, + 0.0, + 0.04274571314454079, + 0.41244758293032646, + 0.18273836001753807, + 0.5775220654904842 + ], + "unique_experts": 43, + "load_cv": 1.2765694770084508, + "normalized_load_entropy": 0.8263384334809786, + "max_load_share": 0.09027777777777778 + }, + "full_input": { + "tokens": 65, + "top_k": 6, + "decisions": 390, + "ordered_route_sha256": "db0e8baa5c5ed8229b0f84d65d996977467694433dd8a60e32e4ad6559c7160a", + "route_weight_sha256": "cc7dc0b71a049f8e683e2aeadb98ed3c74f2c2cd65c959e38452b9509526e627", + "loads": [ + 5, + 5, + 0, + 1, + 2, + 9, + 42, + 0, + 0, + 3, + 14, + 13, + 1, + 5, + 2, + 10, + 1, + 4, + 4, + 3, + 9, + 9, + 3, + 3, + 6, + 3, + 6, + 3, + 10, + 19, + 9, + 3, + 1, + 15, + 7, + 3, + 5, + 1, + 2, + 1, + 3, + 9, + 9, + 1, + 18, + 12, + 5, + 3, + 7, + 5, + 1, + 9, + 3, + 2, + 3, + 3, + 3, + 12, + 10, + 4, + 2, + 11, + 3, + 10 + ], + "weighted_loads": [ + 0.20263899490237236, + 0.25670283660292625, + 0.0, + 0.04126677289605141, + 0.06614377908408642, + 0.5499820783734322, + 3.0960649624466896, + 0.0, + 0.0, + 0.11128919012844563, + 0.7761583663523197, + 0.9372666589915752, + 0.039673902094364166, + 0.27006151154637337, + 0.10469869896769524, + 0.5959855355322361, + 0.03702852874994278, + 0.1466779075562954, + 0.13399004749953747, + 0.1224154569208622, + 0.9575787745416164, + 0.41577538661658764, + 0.2108168751001358, + 0.12339235097169876, + 0.27270813286304474, + 0.17993716895580292, + 0.22778361290693283, + 0.13999560475349426, + 0.5454849153757095, + 1.573853075504303, + 0.49533171206712723, + 0.14782565087080002, + 0.03878585994243622, + 1.326964620500803, + 0.48786024935543537, + 0.1392023004591465, + 0.2772867940366268, + 0.03339720889925957, + 0.08412564173340797, + 0.04221672937273979, + 0.10834074579179287, + 0.43548624590039253, + 0.7063390221446753, + 0.03350738435983658, + 1.5235251188278198, + 1.1114931963384151, + 0.2759630810469389, + 0.43425699695944786, + 0.4716094695031643, + 0.2469778098165989, + 0.0366373173892498, + 0.5513630863279104, + 0.10454224050045013, + 0.08114603161811829, + 0.1272604651749134, + 0.11384056136012077, + 0.15532293543219566, + 0.7405813969671726, + 0.7934828121215105, + 0.19493836537003517, + 0.07156321220099926, + 0.5300975888967514, + 0.18273836001753807, + 0.6626553274691105 + ], + "unique_experts": 61, + "load_cv": 1.0397870615971454, + "normalized_load_entropy": 0.9028295951454149, + "max_load_share": 0.1076923076923077 + } + }, + "s0_period": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "fb3026b0b859c3953cf7c6a99aea20dd3072b8ec9abf6b9e041c4bca6af49dcd", + "route_weight_sha256": "9bc5bb2cd6c520a21a1adc9fac37fe8afc5a52cd598a93c4bafeab939984e11e", + "loads": [ + 0, + 1, + 0, + 1, + 2, + 7, + 13, + 0, + 0, + 3, + 4, + 3, + 1, + 5, + 2, + 2, + 1, + 3, + 1, + 0, + 9, + 3, + 3, + 0, + 0, + 4, + 2, + 2, + 9, + 0, + 1, + 2, + 0, + 0, + 5, + 2, + 0, + 0, + 1, + 0, + 2, + 4, + 1, + 0, + 0, + 0, + 3, + 1, + 6, + 0, + 0, + 9, + 0, + 0, + 1, + 0, + 0, + 0, + 5, + 0, + 1, + 7, + 4, + 8 + ], + "weighted_loads": [ + 0.0, + 0.037214167416095734, + 0.0, + 0.03881881758570671, + 0.07170773297548294, + 0.43056296557188034, + 0.7762826345860958, + 0.0, + 0.0, + 0.09773914143443108, + 0.16471543908119202, + 0.22785181552171707, + 0.04774164408445358, + 0.2893167994916439, + 0.12302816286683083, + 0.09736631065607071, + 0.03854115679860115, + 0.10833378881216049, + 0.027024416252970695, + 0.0, + 0.9341329149901867, + 0.1319880373775959, + 0.2091502659022808, + 0.0, + 0.0, + 0.23631156980991364, + 0.07895082607865334, + 0.09495483711361885, + 0.494210172444582, + 0.0, + 0.03947540745139122, + 0.10555126890540123, + 0.0, + 0.0, + 0.2940458916127682, + 0.09311459958553314, + 0.0, + 0.0, + 0.03771250694990158, + 0.0, + 0.06090383417904377, + 0.20111232995986938, + 0.044650740921497345, + 0.0, + 0.0, + 0.0, + 0.1927525158971548, + 0.034612514078617096, + 0.25859982520341873, + 0.0, + 0.0, + 0.5631169714033604, + 0.0, + 0.0, + 0.05682460218667984, + 0.0, + 0.0, + 0.0, + 0.6594520024955273, + 0.0, + 0.03988504409790039, + 0.37361667305231094, + 0.23401067033410072, + 0.5484777465462685 + ], + "unique_experts": 40, + "load_cv": 1.2692955176439848, + "normalized_load_entropy": 0.8201441186151525, + "max_load_share": 0.09027777777777778 + }, + "full_input": { + "tokens": 49, + "top_k": 6, + "decisions": 294, + "ordered_route_sha256": "30ab77266b8372dcecfebed1e2c34f2ca5f8938cf1e5d086709ef36eef0917f1", + "route_weight_sha256": "c41d5a81c254ddd560da9428f66592373455e3d7bc67683948af0c57a5456912", + "loads": [ + 0, + 7, + 0, + 1, + 2, + 9, + 32, + 0, + 0, + 6, + 14, + 8, + 1, + 5, + 3, + 8, + 1, + 4, + 2, + 1, + 9, + 5, + 3, + 0, + 4, + 4, + 5, + 2, + 9, + 16, + 1, + 2, + 0, + 7, + 6, + 2, + 3, + 1, + 1, + 2, + 2, + 7, + 3, + 2, + 11, + 11, + 4, + 3, + 8, + 0, + 1, + 9, + 3, + 3, + 3, + 0, + 3, + 0, + 9, + 4, + 1, + 8, + 4, + 9 + ], + "weighted_loads": [ + 0.0, + 0.5093044340610504, + 0.0, + 0.03881881758570671, + 0.07170773297548294, + 0.5163711830973625, + 2.4456025175750256, + 0.0, + 0.0, + 0.22303635068237782, + 0.7849704027175903, + 0.5094180144369602, + 0.04774164408445358, + 0.2893167994916439, + 0.15203135088086128, + 0.4055170863866806, + 0.03854115679860115, + 0.1433405764400959, + 0.06933900155127048, + 0.04426967725157738, + 0.9341329149901867, + 0.22260475158691406, + 0.2091502659022808, + 0.0, + 0.2631333228200674, + 0.23631156980991364, + 0.20207622647285461, + 0.09495483711361885, + 0.494210172444582, + 1.098978877067566, + 0.03947540745139122, + 0.10555126890540123, + 0.0, + 0.6694880723953247, + 0.31685307808220387, + 0.09311459958553314, + 0.1628299579024315, + 0.03365176171064377, + 0.03771250694990158, + 0.06917024031281471, + 0.06090383417904377, + 0.3561131916940212, + 0.13791686296463013, + 0.11106264218688011, + 0.9823121204972267, + 1.0107377246022224, + 0.22389976307749748, + 0.42714876122772694, + 0.32987315207719803, + 0.0, + 0.03834308683872223, + 0.5631169714033604, + 0.1081555038690567, + 0.14088914915919304, + 0.14456442184746265, + 0.0, + 0.1631915606558323, + 0.0, + 0.8347171079367399, + 0.2040790691971779, + 0.03988504409790039, + 0.4032981153577566, + 0.23401067033410072, + 0.5858422107994556 + ], + "unique_experts": 55, + "load_cv": 1.0957027788471314, + "normalized_load_entropy": 0.8835149333733185, + "max_load_share": 0.10884353741496598 + } + }, + "s1_period": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "aa1d86e0004d375e2c0d6780ce0481e97258d92cc54d302e323ae2dac49c2981", + "route_weight_sha256": "44187cbaec7621bf9e6c56818639ea8aadc820eb215c3b7a74b7869572a78bb1", + "loads": [ + 0, + 1, + 0, + 1, + 1, + 7, + 13, + 0, + 0, + 2, + 3, + 3, + 2, + 5, + 2, + 2, + 1, + 3, + 1, + 0, + 8, + 3, + 3, + 0, + 0, + 3, + 1, + 2, + 10, + 0, + 1, + 2, + 1, + 2, + 4, + 3, + 0, + 0, + 1, + 0, + 1, + 5, + 1, + 0, + 0, + 0, + 4, + 1, + 6, + 0, + 0, + 8, + 0, + 0, + 1, + 0, + 0, + 0, + 5, + 0, + 0, + 8, + 4, + 9 + ], + "weighted_loads": [ + 0.0, + 0.03719537332653999, + 0.0, + 0.039951715618371964, + 0.03947515785694122, + 0.4348479397594929, + 0.7059609480202198, + 0.0, + 0.0, + 0.06414320319890976, + 0.12534347921609879, + 0.23079505562782288, + 0.09954196959733963, + 0.27260861173272133, + 0.1134754866361618, + 0.08544372767210007, + 0.037254560738801956, + 0.10674826055765152, + 0.028944848105311394, + 0.0, + 0.9099652133882046, + 0.13485761731863022, + 0.20932745561003685, + 0.0, + 0.0, + 0.1899901032447815, + 0.037690669298172, + 0.09767227992415428, + 0.5434152856469154, + 0.0, + 0.03922567889094353, + 0.11022691801190376, + 0.035191431641578674, + 0.06997399404644966, + 0.26685116812586784, + 0.1131843626499176, + 0.0, + 0.0, + 0.04094960168004036, + 0.0, + 0.03216993436217308, + 0.2397731300443411, + 0.04275132715702057, + 0.0, + 0.0, + 0.0, + 0.2227677907794714, + 0.036810148507356644, + 0.24942272901535034, + 0.0, + 0.0, + 0.525370892137289, + 0.0, + 0.0, + 0.055268533527851105, + 0.0, + 0.0, + 0.0, + 0.5980345346033573, + 0.0, + 0.0, + 0.4240420423448086, + 0.22584080696105957, + 0.6342983730137348 + ], + "unique_experts": 41, + "load_cv": 1.2789849370245931, + "normalized_load_entropy": 0.8209959311490967, + "max_load_share": 0.09027777777777778 + }, + "full_input": { + "tokens": 65, + "top_k": 6, + "decisions": 390, + "ordered_route_sha256": "a579cc47c6e1868f5b95cdb91cf70dd2297952a9a8f8497964030e1e27fc507f", + "route_weight_sha256": "e4529aa184e41e331875a9536a2b75ebbcd3dee99f60687506c149e5a8b694bc", + "loads": [ + 5, + 7, + 0, + 1, + 1, + 9, + 42, + 0, + 0, + 4, + 11, + 14, + 2, + 5, + 2, + 9, + 1, + 4, + 4, + 3, + 8, + 8, + 3, + 3, + 5, + 3, + 6, + 2, + 10, + 21, + 9, + 4, + 1, + 16, + 7, + 4, + 5, + 1, + 2, + 1, + 3, + 10, + 9, + 1, + 18, + 12, + 5, + 3, + 8, + 5, + 1, + 8, + 3, + 2, + 3, + 2, + 3, + 11, + 10, + 4, + 1, + 10, + 4, + 11 + ], + "weighted_loads": [ + 0.20263899490237236, + 0.49806585535407066, + 0.0, + 0.039951715618371964, + 0.03947515785694122, + 0.5289775840938091, + 3.0067518055438995, + 0.0, + 0.0, + 0.14197438023984432, + 0.6893687676638365, + 0.9879650622606277, + 0.09954196959733963, + 0.27260861173272133, + 0.1134754866361618, + 0.45033955946564674, + 0.037254560738801956, + 0.14593299478292465, + 0.12814221531152725, + 0.1224154569208622, + 0.9099652133882046, + 0.3868071436882019, + 0.20932745561003685, + 0.12339235097169876, + 0.3389324750751257, + 0.1899901032447815, + 0.2475397177040577, + 0.09767227992415428, + 0.5434152856469154, + 1.708163596689701, + 0.5053206384181976, + 0.1840916946530342, + 0.035191431641578674, + 1.3764530755579472, + 0.49201195128262043, + 0.16566137596964836, + 0.3043443411588669, + 0.03339720889925957, + 0.08378003165125847, + 0.04221672937273979, + 0.11232652142643929, + 0.4660231042653322, + 0.6975993569940329, + 0.03927610442042351, + 1.468632534146309, + 0.9978166371583939, + 0.2616791594773531, + 0.4370814859867096, + 0.5041985400021076, + 0.2469778098165989, + 0.0366373173892498, + 0.525370892137289, + 0.10454224050045013, + 0.08114603161811829, + 0.1270567998290062, + 0.07246025279164314, + 0.15532293543219566, + 0.7059531919658184, + 0.776250759139657, + 0.19493836537003517, + 0.028817499056458473, + 0.5068815685808659, + 0.22584080696105957, + 0.7194316349923611 + ], + "unique_experts": 61, + "load_cv": 1.0462418263658473, + "normalized_load_entropy": 0.9018553052317052, + "max_load_share": 0.1076923076923077 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 24, + "ordered_topk_exact_tokens": 16, + "set_exact_tokens": 18, + "mean_set_jaccard": 0.9285714285714287, + "mean_token_weighted_tv": 0.01249633263796568, + "aggregate_load_tv": 0.027777777777777776 + }, + "system_bos": { + "tokens": 24, + "ordered_topk_exact_tokens": 17, + "set_exact_tokens": 20, + "mean_set_jaccard": 0.943452380952381, + "mean_token_weighted_tv": 0.015615293174050748, + "aggregate_load_tv": 0.034722222222222224 + }, + "system_x": { + "tokens": 24, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.8839285714285715, + "mean_token_weighted_tv": 0.02680914841281871, + "aggregate_load_tv": 0.05555555555555556 + }, + "system_period": { + "tokens": 24, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.8839285714285715, + "mean_token_weighted_tv": 0.02695403395531078, + "aggregate_load_tv": 0.06944444444444445 + }, + "bos_at_s0": { + "tokens": 24, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.9166666666666669, + "mean_token_weighted_tv": 0.022302925237454474, + "aggregate_load_tv": 0.034722222222222224 + }, + "bos_at_s1": { + "tokens": 24, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.9404761904761904, + "mean_token_weighted_tv": 0.018084222683683038, + "aggregate_load_tv": 0.034722222222222224 + }, + "x_at_s0": { + "tokens": 24, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.9047619047619048, + "mean_token_weighted_tv": 0.024777731431337695, + "aggregate_load_tv": 0.041666666666666664 + }, + "x_at_s1": { + "tokens": 24, + "ordered_topk_exact_tokens": 6, + "set_exact_tokens": 10, + "mean_set_jaccard": 0.824404761904762, + "mean_token_weighted_tv": 0.03804310174503674, + "aggregate_load_tv": 0.08333333333333333 + }, + "period_at_s0": { + "tokens": 24, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.8928571428571429, + "mean_token_weighted_tv": 0.02678344041729967, + "aggregate_load_tv": 0.04861111111111111 + }, + "period_at_s1": { + "tokens": 24, + "ordered_topk_exact_tokens": 7, + "set_exact_tokens": 11, + "mean_set_jaccard": 0.8363095238095238, + "mean_token_weighted_tv": 0.03827690511631469, + "aggregate_load_tv": 0.0763888888888889 + } + } + }, + "layer_14": { + "layer": 14, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "babf0475b3bbf41bbe6c0eea98560bc78014f68ec4c08a86c7ff2c62386588d4", + "route_weight_sha256": "b0b8cb8234505c02e9fb50858aa6d12b40ccfba7539704d5b8c89794d2516edd", + "loads": [ + 2, + 2, + 0, + 2, + 3, + 6, + 1, + 3, + 2, + 0, + 4, + 0, + 1, + 0, + 0, + 0, + 0, + 0, + 9, + 1, + 2, + 4, + 0, + 0, + 1, + 1, + 0, + 13, + 6, + 2, + 2, + 8, + 2, + 0, + 6, + 4, + 1, + 3, + 1, + 2, + 0, + 0, + 3, + 0, + 2, + 1, + 3, + 2, + 3, + 0, + 0, + 1, + 0, + 0, + 0, + 1, + 0, + 3, + 4, + 11, + 2, + 5, + 2, + 7 + ], + "weighted_loads": [ + 0.07615416124463081, + 0.11492721736431122, + 0.0, + 0.06806981936097145, + 0.18792475759983063, + 0.382030937820673, + 0.035198379307985306, + 0.2744088117033243, + 0.17210054397583008, + 0.0, + 0.20443283021450043, + 0.0, + 0.03988495469093323, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.6266721896827221, + 0.03633158281445503, + 0.10913731902837753, + 0.19792888313531876, + 0.0, + 0.0, + 0.062089838087558746, + 0.05127938836812973, + 0.0, + 1.6117146499454975, + 0.31176014244556427, + 0.11894066631793976, + 0.10259339958429337, + 0.7421558909118176, + 0.08559010177850723, + 0.0, + 0.38529350236058235, + 0.21316615492105484, + 0.04833192005753517, + 0.12788429483771324, + 0.07117456942796707, + 0.17417632788419724, + 0.0, + 0.0, + 0.14523833245038986, + 0.0, + 0.07968073338270187, + 0.05458344519138336, + 0.12477267533540726, + 0.08739233389496803, + 0.1939083207398653, + 0.0, + 0.0, + 0.044289082288742065, + 0.0, + 0.0, + 0.0, + 0.05442645773291588, + 0.0, + 0.2925820089876652, + 0.35848456248641014, + 0.8964729718863964, + 0.1732012778520584, + 0.48822328448295593, + 0.1330028399825096, + 0.44423668272793293 + ], + "unique_experts": 43, + "load_cv": 1.2196943555611195, + "normalized_load_entropy": 0.8387798016167854, + "max_load_share": 0.09027777777777778 + }, + "full_input": { + "tokens": 49, + "top_k": 6, + "decisions": 294, + "ordered_route_sha256": "93a9c2739446b3b8e6f3a9e4f713c443c51f879a8c404182c79ee4bbacadc912", + "route_weight_sha256": "8b3dcb5670743d9794bcd3b4c97d7aa722994d572dc2e8c8b83eac9aca11ae2f", + "loads": [ + 9, + 2, + 0, + 4, + 3, + 17, + 1, + 5, + 2, + 9, + 6, + 3, + 1, + 0, + 0, + 5, + 0, + 0, + 13, + 3, + 2, + 4, + 0, + 11, + 2, + 2, + 6, + 19, + 14, + 2, + 4, + 13, + 2, + 7, + 6, + 4, + 3, + 4, + 2, + 2, + 0, + 0, + 4, + 1, + 3, + 1, + 9, + 4, + 4, + 1, + 3, + 6, + 6, + 6, + 0, + 5, + 0, + 4, + 4, + 24, + 2, + 6, + 2, + 7 + ], + "weighted_loads": [ + 0.7716289889067411, + 0.11492721736431122, + 0.0, + 0.14694232493638992, + 0.18792475759983063, + 1.3506551925092936, + 0.035198379307985306, + 0.34735859744250774, + 0.17210054397583008, + 0.6336366236209869, + 0.26995736360549927, + 0.19255921617150307, + 0.03988495469093323, + 0.0, + 0.0, + 0.21619362756609917, + 0.0, + 0.0, + 0.8589086942374706, + 0.11531058326363564, + 0.10913731902837753, + 0.19792888313531876, + 0.0, + 0.4700802657753229, + 0.08469760231673717, + 0.07684420235455036, + 0.3481760807335377, + 2.0018830336630344, + 1.9018255770206451, + 0.11894066631793976, + 0.26250987499952316, + 0.931611068546772, + 0.08559010177850723, + 0.7329962439835072, + 0.38529350236058235, + 0.21316615492105484, + 0.12562178634107113, + 0.1711379438638687, + 0.13001013547182083, + 0.17417632788419724, + 0.0, + 0.0, + 0.19580799713730812, + 0.048092324286699295, + 0.11023098602890968, + 0.05458344519138336, + 0.5075060743838549, + 0.1740762386471033, + 0.22792141698300838, + 0.042943283915519714, + 0.10604199767112732, + 1.3515490032732487, + 0.757103219628334, + 0.42492277547717094, + 0.0, + 0.41470997780561447, + 0.0, + 0.32873696833848953, + 0.35848456248641014, + 1.517034338787198, + 0.1732012778520584, + 0.493244003970176, + 0.1330028399825096, + 0.44423668272793293 + ], + "unique_experts": 54, + "load_cv": 1.0402381569637287, + "normalized_load_entropy": 0.8866674112857629, + "max_load_share": 0.08163265306122448 + } + }, + "s1_eos": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "dd0077e6deea8d2f92c10884c9b8687e863465f4248e636d0b180be76d8a57a2", + "route_weight_sha256": "d60db8bc4486cc44418de1ff1294766902d682a75a03dbcb6fbd4b9b79f60d5b", + "loads": [ + 2, + 2, + 0, + 1, + 3, + 6, + 0, + 3, + 2, + 0, + 4, + 0, + 1, + 0, + 1, + 0, + 0, + 0, + 9, + 1, + 2, + 4, + 0, + 0, + 1, + 2, + 0, + 12, + 6, + 2, + 2, + 8, + 2, + 0, + 6, + 3, + 1, + 3, + 1, + 2, + 0, + 0, + 3, + 0, + 2, + 1, + 3, + 2, + 2, + 0, + 0, + 1, + 1, + 0, + 0, + 1, + 0, + 3, + 4, + 12, + 2, + 5, + 2, + 8 + ], + "weighted_loads": [ + 0.07399589940905571, + 0.11309965699911118, + 0.0, + 0.036624472588300705, + 0.1871236450970173, + 0.3947395905852318, + 0.0, + 0.27754898369312286, + 0.16779273003339767, + 0.0, + 0.1984778270125389, + 0.0, + 0.043028574436903, + 0.0, + 0.029214268550276756, + 0.0, + 0.0, + 0.0, + 0.6458477005362511, + 0.03606384992599487, + 0.10736167803406715, + 0.2040596455335617, + 0.0, + 0.0, + 0.0633654072880745, + 0.08339115977287292, + 0.0, + 1.5679957754909992, + 0.29761143773794174, + 0.1171749196946621, + 0.10382765531539917, + 0.7478927597403526, + 0.08608715981245041, + 0.0, + 0.3727241940796375, + 0.17520351335406303, + 0.048102132976055145, + 0.1280670203268528, + 0.06854601949453354, + 0.17780180275440216, + 0.0, + 0.0, + 0.14766757190227509, + 0.0, + 0.07684244960546494, + 0.05282370746135712, + 0.12408480793237686, + 0.08475996181368828, + 0.14782011695206165, + 0.0, + 0.0, + 0.047662556171417236, + 0.04189842566847801, + 0.0, + 0.0, + 0.0517922006547451, + 0.0, + 0.28588418662548065, + 0.3460801988840103, + 0.937949925661087, + 0.17028417438268661, + 0.4781358055770397, + 0.13561983406543732, + 0.47853294759988785 + ], + "unique_experts": 44, + "load_cv": 1.2222222222222223, + "normalized_load_entropy": 0.8408305522856974, + "max_load_share": 0.08333333333333333 + }, + "full_input": { + "tokens": 65, + "top_k": 6, + "decisions": 390, + "ordered_route_sha256": "dcd13f0437e0c9a48c30ada7e665e1a478e630358a3fffc18172a36882ddf760", + "route_weight_sha256": "1f1582e9e6079e1f0a4d1747f791e36b7aff15b67a027b9650ad841097115b88", + "loads": [ + 10, + 3, + 0, + 4, + 6, + 23, + 0, + 7, + 4, + 12, + 4, + 3, + 6, + 0, + 1, + 6, + 0, + 0, + 15, + 6, + 4, + 8, + 0, + 10, + 7, + 5, + 5, + 19, + 19, + 3, + 6, + 11, + 4, + 11, + 7, + 4, + 3, + 6, + 3, + 3, + 0, + 0, + 5, + 1, + 4, + 1, + 9, + 4, + 5, + 1, + 13, + 5, + 9, + 9, + 2, + 4, + 1, + 5, + 5, + 32, + 5, + 7, + 4, + 11 + ], + "weighted_loads": [ + 0.8561749085783958, + 0.1639738455414772, + 0.0, + 0.15673046186566353, + 0.396416287869215, + 1.5749987568706274, + 0.0, + 0.4424309507012367, + 0.33213163912296295, + 0.9344325959682465, + 0.1984778270125389, + 0.21397103741765022, + 0.396824236959219, + 0.0, + 0.029214268550276756, + 0.28113826736807823, + 0.0, + 0.0, + 1.0392545517534018, + 0.2715623937547207, + 0.34089354798197746, + 0.3555636629462242, + 0.0, + 0.4072489384561777, + 0.34029088355600834, + 0.1853597555309534, + 0.35909736528992653, + 1.8307731933891773, + 2.3473165333271027, + 0.16634982451796532, + 0.3195684589445591, + 0.8350848173722625, + 0.16519885510206223, + 1.2246743477880955, + 0.42144840955734253, + 0.2541368640959263, + 0.10041177831590176, + 0.4859447106719017, + 0.20931120961904526, + 0.23547958955168724, + 0.0, + 0.0, + 0.24469536915421486, + 0.04589187726378441, + 0.13777664862573147, + 0.05282370746135712, + 0.5262432768940926, + 0.15307503007352352, + 0.3040145020931959, + 0.03285813704133034, + 0.8574527241289616, + 1.327627720311284, + 0.8499719835817814, + 0.6823790073394775, + 0.08220934867858887, + 0.3504398800432682, + 0.051413100212812424, + 0.36717867478728294, + 0.4554683491587639, + 2.096655961126089, + 0.4242894873023033, + 0.5245340233668685, + 0.23670386895537376, + 0.5880485288798809 + ], + "unique_experts": 56, + "load_cv": 0.9492444831324522, + "normalized_load_entropy": 0.904447952811878, + "max_load_share": 0.08205128205128205 + } + }, + "s0_bos": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "3b735076d817e4ab97ecabb0c24f5a84e99bc95f36f2c320c1d71f5703a69566", + "route_weight_sha256": "0e733a45b271c268bbe9c9a7f783779a2c454ba3a4adcac2c28f19ecdae8a566", + "loads": [ + 1, + 2, + 0, + 1, + 3, + 6, + 1, + 2, + 2, + 1, + 4, + 0, + 1, + 0, + 1, + 0, + 0, + 0, + 9, + 2, + 2, + 4, + 0, + 0, + 2, + 1, + 0, + 12, + 6, + 2, + 2, + 8, + 2, + 0, + 6, + 2, + 2, + 3, + 1, + 2, + 0, + 0, + 3, + 0, + 2, + 1, + 2, + 2, + 2, + 0, + 0, + 1, + 1, + 0, + 0, + 2, + 0, + 3, + 4, + 12, + 2, + 5, + 2, + 7 + ], + "weighted_loads": [ + 0.03367770463228226, + 0.11920801922678947, + 0.0, + 0.03351840004324913, + 0.18458598479628563, + 0.39793752506375313, + 0.033275920897722244, + 0.2344890981912613, + 0.178706593811512, + 0.026393605396151543, + 0.19378617778420448, + 0.0, + 0.04227703437209129, + 0.0, + 0.026378773152828217, + 0.0, + 0.0, + 0.0, + 0.62378004565835, + 0.06923844665288925, + 0.10609489679336548, + 0.2129044011235237, + 0.0, + 0.0, + 0.10923126339912415, + 0.05114952102303505, + 0.0, + 1.6317921448498964, + 0.3140730522572994, + 0.12093408033251762, + 0.09653889387845993, + 0.7587071061134338, + 0.07809294015169144, + 0.0, + 0.3624854199588299, + 0.1458483561873436, + 0.08045409619808197, + 0.13090235739946365, + 0.06506006419658661, + 0.15351954102516174, + 0.0, + 0.0, + 0.1427200734615326, + 0.0, + 0.07600509002804756, + 0.05830422043800354, + 0.08429419621825218, + 0.09159811586141586, + 0.16982878744602203, + 0.0, + 0.0, + 0.046446021646261215, + 0.042791880667209625, + 0.0, + 0.0, + 0.07832001149654388, + 0.0, + 0.27977530285716057, + 0.358917485922575, + 0.9262786842882633, + 0.16080831736326218, + 0.4812059886753559, + 0.13147253543138504, + 0.4246679861098528 + ], + "unique_experts": 46, + "load_cv": 1.1941214033447043, + "normalized_load_entropy": 0.850799508364502, + "max_load_share": 0.08333333333333333 + }, + "full_input": { + "tokens": 49, + "top_k": 6, + "decisions": 294, + "ordered_route_sha256": "288c9036fd377a9b615c81778e34ff2a3832f8df878adab08c5fe8a82ef552a5", + "route_weight_sha256": "b5723a8003b1a983bcd3e14a03419dcaed01fede36e21f93284f0a101a10ca3e", + "loads": [ + 7, + 2, + 0, + 4, + 3, + 17, + 1, + 3, + 2, + 9, + 6, + 3, + 1, + 1, + 1, + 4, + 0, + 0, + 15, + 3, + 2, + 4, + 0, + 10, + 4, + 3, + 6, + 17, + 16, + 2, + 4, + 13, + 2, + 7, + 6, + 2, + 5, + 4, + 3, + 2, + 0, + 0, + 3, + 1, + 4, + 1, + 8, + 4, + 3, + 1, + 1, + 5, + 7, + 6, + 0, + 6, + 0, + 4, + 5, + 25, + 2, + 5, + 2, + 7 + ], + "weighted_loads": [ + 0.6836551111191511, + 0.11920801922678947, + 0.0, + 0.1712711937725544, + 0.18458598479628563, + 1.3656778167933226, + 0.033275920897722244, + 0.2680775821208954, + 0.178706593811512, + 0.5960462260991335, + 0.2593107111752033, + 0.19255921617150307, + 0.04227703437209129, + 0.038500625640153885, + 0.026378773152828217, + 0.200242530554533, + 0.0, + 0.0, + 1.0190432593226433, + 0.10903280228376389, + 0.10609489679336548, + 0.2129044011235237, + 0.0, + 0.4423459880053997, + 0.17293024621903896, + 0.12525910511612892, + 0.3481760807335377, + 2.032970631495118, + 1.8465878553688526, + 0.12093408033251762, + 0.2554313838481903, + 0.9925648979842663, + 0.07809294015169144, + 0.6754683181643486, + 0.3624854199588299, + 0.1458483561873436, + 0.18859925121068954, + 0.17415600642561913, + 0.16309577599167824, + 0.15351954102516174, + 0.0, + 0.0, + 0.1427200734615326, + 0.048092324286699295, + 0.18156566470861435, + 0.05830422043800354, + 0.4348906222730875, + 0.17828202061355114, + 0.21395109966397285, + 0.042943283915519714, + 0.041868820786476135, + 0.49541519954800606, + 0.7998951002955437, + 0.42492277547717094, + 0.0, + 0.4623536951839924, + 0.0, + 0.3232693076133728, + 0.4018421582877636, + 1.5869220048189163, + 0.16080831736326218, + 0.4812059886753559, + 0.13147253543138504, + 0.4246679861098528 + ], + "unique_experts": 56, + "load_cv": 1.048038611981531, + "normalized_load_entropy": 0.8891969229302112, + "max_load_share": 0.08503401360544217 + } + }, + "s1_bos": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "8ad0810c60f507579588ed52f59a76319e946b7e9f18f3f5cf05a6241379e16b", + "route_weight_sha256": "cb6b0629afb8d06c8e8f55b23bee9276e793e35341e8a9d11761edea45d1bfad", + "loads": [ + 1, + 2, + 0, + 1, + 3, + 6, + 1, + 2, + 2, + 1, + 4, + 0, + 1, + 0, + 0, + 0, + 0, + 0, + 9, + 2, + 2, + 4, + 0, + 0, + 2, + 1, + 0, + 12, + 6, + 2, + 2, + 8, + 2, + 0, + 6, + 2, + 2, + 4, + 1, + 2, + 0, + 0, + 3, + 0, + 1, + 1, + 2, + 3, + 2, + 0, + 0, + 1, + 1, + 0, + 0, + 2, + 0, + 3, + 4, + 12, + 2, + 5, + 2, + 7 + ], + "weighted_loads": [ + 0.03511903062462807, + 0.1112033911049366, + 0.0, + 0.03403499722480774, + 0.1911253146827221, + 0.37665075436234474, + 0.03523770719766617, + 0.24109891057014465, + 0.1736767813563347, + 0.026769183576107025, + 0.18956387415528297, + 0.0, + 0.04715285450220108, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.6364045292139053, + 0.06943893432617188, + 0.11191290616989136, + 0.206925380975008, + 0.0, + 0.0, + 0.10959620028734207, + 0.0508195161819458, + 0.0, + 1.610236056149006, + 0.30948356539011, + 0.12152162939310074, + 0.10173628479242325, + 0.7514040730893612, + 0.08200737088918686, + 0.0, + 0.35980870947241783, + 0.14497149735689163, + 0.08157611638307571, + 0.16417019069194794, + 0.06929057091474533, + 0.1424780860543251, + 0.0, + 0.0, + 0.15051106736063957, + 0.0, + 0.04108888655900955, + 0.0560428723692894, + 0.08243762701749802, + 0.11335219070315361, + 0.1680164709687233, + 0.0, + 0.0, + 0.04303135722875595, + 0.04738054797053337, + 0.0, + 0.0, + 0.0730490330606699, + 0.0, + 0.2754315659403801, + 0.34370920062065125, + 0.8980288170278072, + 0.16504131257534027, + 0.49014268070459366, + 0.13639992475509644, + 0.4247376136481762 + ], + "unique_experts": 45, + "load_cv": 1.204415743815489, + "normalized_load_entropy": 0.8461698787348724, + "max_load_share": 0.08333333333333333 + }, + "full_input": { + "tokens": 65, + "top_k": 6, + "decisions": 390, + "ordered_route_sha256": "7c11b796291c19d96dbce58fda507d62652ac33c4522d4f50bfeaf1890c78df5", + "route_weight_sha256": "447ee7f9277424ac2bf0e8bbd050c81e97211e4f868b25ad62f2ffceabbef2d0", + "loads": [ + 9, + 3, + 0, + 4, + 6, + 23, + 1, + 5, + 4, + 13, + 4, + 3, + 6, + 0, + 0, + 6, + 0, + 0, + 15, + 6, + 4, + 7, + 0, + 9, + 8, + 5, + 5, + 19, + 21, + 3, + 6, + 11, + 4, + 11, + 7, + 3, + 2, + 7, + 3, + 3, + 0, + 0, + 4, + 1, + 4, + 2, + 8, + 5, + 5, + 1, + 13, + 6, + 9, + 9, + 2, + 5, + 1, + 6, + 5, + 32, + 5, + 6, + 4, + 11 + ], + "weighted_loads": [ + 0.8249633572995663, + 0.16207757964730263, + 0.0, + 0.17375598102808, + 0.4004179574549198, + 1.5531826931983232, + 0.03523770719766617, + 0.3684357851743698, + 0.33801569044589996, + 0.9476389400660992, + 0.18956387415528297, + 0.21397103741765022, + 0.40094851702451706, + 0.0, + 0.0, + 0.2710159569978714, + 0.0, + 0.0, + 1.0037131253629923, + 0.26817139238119125, + 0.34544477611780167, + 0.3108397424221039, + 0.0, + 0.3796536885201931, + 0.3865216765552759, + 0.18749858438968658, + 0.35909736528992653, + 1.949738159775734, + 2.392565943300724, + 0.17069653421640396, + 0.31352511420845985, + 0.8883268311619759, + 0.16111906617879868, + 1.1741140000522137, + 0.40853292495012283, + 0.22390484809875488, + 0.08157611638307571, + 0.5220478810369968, + 0.21005576103925705, + 0.20015587285161018, + 0.0, + 0.0, + 0.20213251933455467, + 0.04589187726378441, + 0.14112119562923908, + 0.0975409559905529, + 0.47095490992069244, + 0.18166725896298885, + 0.32912854850292206, + 0.03285813704133034, + 0.8532156199216843, + 0.5186401773244143, + 0.8554541058838367, + 0.6823790073394775, + 0.08220934867858887, + 0.4255656022578478, + 0.051413100212812424, + 0.4070769436657429, + 0.4530973508954048, + 2.0863572508096695, + 0.41904662549495697, + 0.5317761898040771, + 0.23748395964503288, + 0.5641516707837582 + ], + "unique_experts": 56, + "load_cv": 0.9598241127499212, + "normalized_load_entropy": 0.9035620390855572, + "max_load_share": 0.08205128205128205 + } + }, + "s0_x": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "b1a29c62eb35c98746f5c5c79fc7eb4046e5d159d4dfb3948150b24a32879d18", + "route_weight_sha256": "c46fd20d97dddefda232be634382f5f2d754072f0c07c966de374c76314853cb", + "loads": [ + 2, + 2, + 0, + 1, + 3, + 8, + 1, + 2, + 2, + 1, + 4, + 0, + 1, + 0, + 0, + 0, + 0, + 0, + 9, + 1, + 2, + 4, + 0, + 0, + 2, + 2, + 0, + 11, + 6, + 2, + 2, + 8, + 2, + 0, + 6, + 2, + 2, + 3, + 1, + 2, + 0, + 0, + 3, + 0, + 2, + 1, + 3, + 3, + 3, + 0, + 0, + 1, + 0, + 0, + 0, + 1, + 0, + 3, + 4, + 11, + 2, + 5, + 2, + 6 + ], + "weighted_loads": [ + 0.07286175340414047, + 0.11804073676466942, + 0.0, + 0.03348488733172417, + 0.1889682374894619, + 0.5103043392300606, + 0.03239356726408005, + 0.2403898984193802, + 0.17626554518938065, + 0.026961853727698326, + 0.18766302801668644, + 0.0, + 0.04001283273100853, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.6441747471690178, + 0.032999470829963684, + 0.11037886515259743, + 0.21176491305232048, + 0.0, + 0.0, + 0.1146283969283104, + 0.08876512572169304, + 0.0, + 1.560782641172409, + 0.32928598299622536, + 0.12287496775388718, + 0.09966438636183739, + 0.7745275683701038, + 0.07800159603357315, + 0.0, + 0.36518238112330437, + 0.1439337655901909, + 0.08330944925546646, + 0.1303100399672985, + 0.06983128935098648, + 0.13284749537706375, + 0.0, + 0.0, + 0.1456545852124691, + 0.0, + 0.07641460001468658, + 0.056375376880168915, + 0.11088694632053375, + 0.11109218187630177, + 0.19580417685210705, + 0.0, + 0.0, + 0.052519842982292175, + 0.0, + 0.0, + 0.0, + 0.05171635001897812, + 0.0, + 0.2848845310509205, + 0.34404047206044197, + 0.9181215204298496, + 0.1476699784398079, + 0.5058152414858341, + 0.13164133578538895, + 0.396286491304636 + ], + "unique_experts": 44, + "load_cv": 1.1706281947614154, + "normalized_load_entropy": 0.8476958351645021, + "max_load_share": 0.0763888888888889 + }, + "full_input": { + "tokens": 49, + "top_k": 6, + "decisions": 294, + "ordered_route_sha256": "8d3f443118b90c693a12450fd787cb6560c165c795cc2cd5526deff946bab892", + "route_weight_sha256": "0be6967afaac05f86df7c65250cbedc4e0c433938175f6f0b3e95dcaa6ad6ac5", + "loads": [ + 9, + 2, + 0, + 2, + 4, + 21, + 1, + 3, + 2, + 9, + 6, + 3, + 1, + 1, + 0, + 3, + 0, + 0, + 13, + 4, + 2, + 4, + 0, + 10, + 4, + 5, + 7, + 15, + 14, + 2, + 5, + 13, + 2, + 7, + 6, + 2, + 4, + 5, + 3, + 2, + 0, + 0, + 4, + 1, + 3, + 1, + 9, + 5, + 3, + 1, + 2, + 3, + 6, + 7, + 0, + 5, + 0, + 4, + 4, + 25, + 2, + 5, + 2, + 6 + ], + "weighted_loads": [ + 0.8299123179167509, + 0.11804073676466942, + 0.0, + 0.0733477957546711, + 0.21997178345918655, + 1.6064018737524748, + 0.03239356726408005, + 0.2739783823490143, + 0.17626554518938065, + 0.5208388958126307, + 0.2531875614076853, + 0.19255921617150307, + 0.04001283273100853, + 0.05797561630606651, + 0.0, + 0.13665609806776047, + 0.0, + 0.0, + 0.8324485942721367, + 0.18395152688026428, + 0.11037886515259743, + 0.21176491305232048, + 0.0, + 0.4423459880053997, + 0.17841037176549435, + 0.18497800081968307, + 0.45811423286795616, + 1.8951895460486412, + 1.496313150972128, + 0.12287496775388718, + 0.28252655826509, + 1.0040016882121563, + 0.07800159603357315, + 0.7256418243050575, + 0.36518238112330437, + 0.1439337655901909, + 0.1740950457751751, + 0.24627841264009476, + 0.17254739999771118, + 0.13284749537706375, + 0.0, + 0.0, + 0.1929694600403309, + 0.048092324286699295, + 0.1069648526608944, + 0.056375376880168915, + 0.48918244801461697, + 0.19777608662843704, + 0.19580417685210705, + 0.042943283915519714, + 0.08697903156280518, + 0.4184609055519104, + 0.757103219628334, + 0.5097054801881313, + 0.0, + 0.4013620875775814, + 0.0, + 0.325579147785902, + 0.34404047206044197, + 1.6291359551250935, + 0.1476699784398079, + 0.5058152414858341, + 0.13164133578538895, + 0.396286491304636 + ], + "unique_experts": 55, + "load_cv": 1.053675399656449, + "normalized_load_entropy": 0.8874761754617164, + "max_load_share": 0.08503401360544217 + } + }, + "s1_x": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "a077f122cb7fd33465b8f5afa39f4538bfa9b43be652f21ee0d9991f44a8aba5", + "route_weight_sha256": "76f2294c878143ae6431540710d101080768d79c45389ea3366147c14bd5eea8", + "loads": [ + 1, + 2, + 0, + 1, + 3, + 8, + 1, + 3, + 2, + 0, + 3, + 0, + 1, + 0, + 1, + 0, + 0, + 0, + 9, + 0, + 1, + 4, + 0, + 0, + 2, + 2, + 0, + 13, + 6, + 3, + 2, + 8, + 3, + 0, + 6, + 2, + 1, + 5, + 1, + 2, + 0, + 0, + 3, + 0, + 3, + 1, + 1, + 1, + 3, + 0, + 0, + 1, + 1, + 0, + 0, + 2, + 0, + 3, + 4, + 11, + 2, + 4, + 2, + 6 + ], + "weighted_loads": [ + 0.03212457522749901, + 0.13043171912431717, + 0.0, + 0.033029861748218536, + 0.19611898064613342, + 0.46604995243251324, + 0.03303511440753937, + 0.251102177426219, + 0.16949284821748734, + 0.0, + 0.15338293835520744, + 0.0, + 0.05190030112862587, + 0.0, + 0.03489871695637703, + 0.0, + 0.0, + 0.0, + 0.6321695446968079, + 0.0, + 0.07572715729475021, + 0.20403850264847279, + 0.0, + 0.0, + 0.1140718013048172, + 0.08648238703608513, + 0.0, + 1.6325861606746912, + 0.2935408353805542, + 0.1741468757390976, + 0.10605976358056068, + 0.7532827332615852, + 0.12029343098402023, + 0.0, + 0.36787912249565125, + 0.1416642889380455, + 0.04136981442570686, + 0.1982843168079853, + 0.06952205300331116, + 0.14059264585375786, + 0.0, + 0.0, + 0.13558800891041756, + 0.0, + 0.1075255498290062, + 0.05167577043175697, + 0.03687205910682678, + 0.048653796315193176, + 0.19889920204877853, + 0.0, + 0.0, + 0.04496699944138527, + 0.047082364559173584, + 0.0, + 0.0, + 0.0673700962215662, + 0.0, + 0.2720848359167576, + 0.3198678530752659, + 0.9623013362288475, + 0.1706918403506279, + 0.4399808794260025, + 0.1370842531323433, + 0.3945157565176487 + ], + "unique_experts": 44, + "load_cv": 1.2297746456210363, + "normalized_load_entropy": 0.8389438171840033, + "max_load_share": 0.09027777777777778 + }, + "full_input": { + "tokens": 65, + "top_k": 6, + "decisions": 390, + "ordered_route_sha256": "0344aa224d4f285116bfbefc0ac8b95e63d13ef87c2f2d8a01197dbafe4b2777", + "route_weight_sha256": "0c6bf067fb5fc6cada3e966f82f3664cdaf58ba818133f0aae75f5bfceacce2b", + "loads": [ + 10, + 3, + 0, + 2, + 6, + 28, + 1, + 6, + 4, + 11, + 3, + 4, + 6, + 0, + 1, + 4, + 0, + 0, + 14, + 5, + 3, + 7, + 0, + 10, + 8, + 6, + 6, + 20, + 18, + 4, + 7, + 10, + 5, + 11, + 7, + 3, + 2, + 9, + 3, + 3, + 0, + 0, + 5, + 1, + 6, + 1, + 6, + 3, + 5, + 1, + 13, + 4, + 9, + 10, + 2, + 5, + 1, + 5, + 5, + 34, + 5, + 5, + 4, + 10 + ], + "weighted_loads": [ + 0.8828473761677742, + 0.1813059076666832, + 0.0, + 0.0770728588104248, + 0.40541162341833115, + 1.870855174958706, + 0.03303511440753937, + 0.37843905203044415, + 0.3338317573070526, + 0.753668274730444, + 0.15338293835520744, + 0.26075027883052826, + 0.40569596365094185, + 0.0, + 0.03489871695637703, + 0.19469406455755234, + 0.0, + 0.0, + 0.9395103808492422, + 0.23488567024469376, + 0.3092590272426605, + 0.30795286409556866, + 0.0, + 0.433101050555706, + 0.39099727757275105, + 0.22588572464883327, + 0.46539806202054024, + 1.9263574723154306, + 1.7428012043237686, + 0.22332178056240082, + 0.35500791668891907, + 0.829659216105938, + 0.19940512627363205, + 1.1756697371602058, + 0.41660333797335625, + 0.22059763967990875, + 0.07889080420136452, + 0.6526787579059601, + 0.21028724312782288, + 0.19827043265104294, + 0.0, + 0.0, + 0.2416512742638588, + 0.04589187726378441, + 0.2103614080697298, + 0.05167577043175697, + 0.4097594730556011, + 0.11696886457502842, + 0.32590822130441666, + 0.03285813704133034, + 0.8559782467782497, + 0.4535904210060835, + 0.855155922472477, + 0.803677387535572, + 0.08220934867858887, + 0.33508517034351826, + 0.051413100212812424, + 0.3621247373521328, + 0.42925600335001945, + 2.2402884382754564, + 0.4246971532702446, + 0.481614388525486, + 0.23816828802227974, + 0.5480227507650852 + ], + "unique_experts": 57, + "load_cv": 1.0093970052793546, + "normalized_load_entropy": 0.8990670278696369, + "max_load_share": 0.08717948717948718 + } + }, + "s0_period": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "b2b9afe016d1ceee39ece7c4c4b2ce09970de3c4e7cbbe3097ad928248e4ec46", + "route_weight_sha256": "22584c4166444a0edb37071ade090d440734248f6157aa515ea1bc77caa097cf", + "loads": [ + 2, + 2, + 0, + 2, + 3, + 7, + 0, + 2, + 2, + 0, + 5, + 0, + 1, + 0, + 0, + 0, + 0, + 0, + 8, + 2, + 2, + 4, + 0, + 0, + 2, + 1, + 0, + 12, + 6, + 2, + 3, + 8, + 2, + 0, + 6, + 2, + 2, + 3, + 1, + 2, + 0, + 0, + 3, + 0, + 2, + 1, + 1, + 2, + 3, + 0, + 0, + 1, + 1, + 0, + 0, + 1, + 0, + 3, + 4, + 12, + 2, + 5, + 2, + 7 + ], + "weighted_loads": [ + 0.07558978721499443, + 0.12442277371883392, + 0.0, + 0.06926548853516579, + 0.19214531034231186, + 0.43365080654621124, + 0.0, + 0.24867704510688782, + 0.17472680658102036, + 0.0, + 0.2105839103460312, + 0.0, + 0.04382438585162163, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.6049600020051003, + 0.0679263323545456, + 0.11201810091733932, + 0.20893984660506248, + 0.0, + 0.0, + 0.10893016681075096, + 0.05290381237864494, + 0.0, + 1.5558067988604307, + 0.3260076902806759, + 0.12318262085318565, + 0.14263908192515373, + 0.7712599970400333, + 0.07867643237113953, + 0.0, + 0.3677399717271328, + 0.1467549353837967, + 0.08281169459223747, + 0.12995260208845139, + 0.07452084869146347, + 0.1359393298625946, + 0.0, + 0.0, + 0.14991774410009384, + 0.0, + 0.07697264850139618, + 0.05525797978043556, + 0.036532968282699585, + 0.08428818359971046, + 0.19246626645326614, + 0.0, + 0.0, + 0.050526656210422516, + 0.025219717994332314, + 0.0, + 0.0, + 0.04927844926714897, + 0.0, + 0.2912110760807991, + 0.3469427861273289, + 0.9646108411252499, + 0.1464761421084404, + 0.5149916186928749, + 0.12326821312308311, + 0.43210513330996037 + ], + "unique_experts": 43, + "load_cv": 1.2095300587265134, + "normalized_load_entropy": 0.8406932584618871, + "max_load_share": 0.08333333333333333 + }, + "full_input": { + "tokens": 49, + "top_k": 6, + "decisions": 294, + "ordered_route_sha256": "4538b5f13858ecae69f7650d8abd679a7ad1d4666e272105ccff2ca0baa847e9", + "route_weight_sha256": "928d47718415ee91de648bd1d42b69faeda5e645a0de3e6c2520e85421e0910f", + "loads": [ + 9, + 2, + 0, + 4, + 3, + 19, + 0, + 3, + 2, + 9, + 7, + 3, + 1, + 1, + 0, + 4, + 0, + 0, + 12, + 4, + 2, + 4, + 0, + 10, + 4, + 3, + 7, + 17, + 14, + 2, + 6, + 12, + 2, + 7, + 6, + 2, + 4, + 5, + 3, + 2, + 0, + 0, + 3, + 1, + 3, + 1, + 6, + 5, + 3, + 2, + 3, + 3, + 7, + 7, + 0, + 5, + 0, + 4, + 4, + 26, + 2, + 5, + 2, + 7 + ], + "weighted_loads": [ + 0.7707872036844492, + 0.12442277371883392, + 0.0, + 0.14390913769602776, + 0.19214531034231186, + 1.4584091361612082, + 0.0, + 0.2822655290365219, + 0.17472680658102036, + 0.5397664569318295, + 0.27610844373703003, + 0.19255921617150307, + 0.04382438585162163, + 0.05241616815328598, + 0.0, + 0.18165984749794006, + 0.0, + 0.0, + 0.8006159961223602, + 0.14509491994976997, + 0.11201810091733932, + 0.20893984660506248, + 0.0, + 0.4423459880053997, + 0.1810105424374342, + 0.11530330777168274, + 0.4006497822701931, + 1.9301374312490225, + 1.6730594001710415, + 0.12318262085318565, + 0.3302542809396982, + 0.9496547281742096, + 0.07867643237113953, + 0.7590745463967323, + 0.3677399717271328, + 0.1467549353837967, + 0.1728910394012928, + 0.226928498595953, + 0.17406030371785164, + 0.1359393298625946, + 0.0, + 0.0, + 0.14991774410009384, + 0.048092324286699295, + 0.10752290114760399, + 0.05525797978043556, + 0.3513789940625429, + 0.23899990506470203, + 0.19246626645326614, + 0.09296095743775368, + 0.13530241698026657, + 0.41646771878004074, + 0.7823229376226664, + 0.5115527771413326, + 0.0, + 0.4745851382613182, + 0.0, + 0.3317345753312111, + 0.3469427861273289, + 1.6612831093370914, + 0.1464761421084404, + 0.5149916186928749, + 0.12326821312308311, + 0.43210513330996037 + ], + "unique_experts": 54, + "load_cv": 1.0487448672860333, + "normalized_load_entropy": 0.8878963022073737, + "max_load_share": 0.08843537414965986 + } + }, + "s1_period": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "e06a21b33a2bd8f2e36fff6b52b43b41dc77a7148fe078b3c2e980935e8c1302", + "route_weight_sha256": "51159f96a255d9eb41a24a91985680a3e243b8f9c08103dfafb79514cc8730ee", + "loads": [ + 1, + 2, + 0, + 1, + 3, + 9, + 0, + 3, + 2, + 0, + 3, + 0, + 1, + 0, + 0, + 0, + 0, + 0, + 9, + 0, + 1, + 4, + 0, + 0, + 2, + 2, + 0, + 13, + 3, + 3, + 3, + 8, + 3, + 0, + 6, + 3, + 2, + 5, + 1, + 2, + 0, + 0, + 3, + 0, + 2, + 1, + 2, + 1, + 3, + 0, + 0, + 1, + 1, + 0, + 0, + 2, + 0, + 3, + 4, + 11, + 2, + 4, + 2, + 7 + ], + "weighted_loads": [ + 0.034087855368852615, + 0.13870085030794144, + 0.0, + 0.03555813804268837, + 0.19708368182182312, + 0.49514175951480865, + 0.0, + 0.2619875278323889, + 0.17362304776906967, + 0.0, + 0.13215524703264236, + 0.0, + 0.05004159361124039, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.6292371191084385, + 0.0, + 0.0724882259964943, + 0.21103986352682114, + 0.0, + 0.0, + 0.11467103660106659, + 0.0863370168954134, + 0.0, + 1.5940651465207338, + 0.17256145924329758, + 0.17363395541906357, + 0.14275527372956276, + 0.7633969262242317, + 0.1172250472009182, + 0.0, + 0.3718814291059971, + 0.17782607674598694, + 0.07624459452927113, + 0.20254644751548767, + 0.07110850512981415, + 0.12878476828336716, + 0.0, + 0.0, + 0.13793682307004929, + 0.0, + 0.0717721339315176, + 0.05312427878379822, + 0.07169767841696739, + 0.048619482666254044, + 0.20085041224956512, + 0.0, + 0.0, + 0.04322442039847374, + 0.04857880249619484, + 0.0, + 0.0, + 0.0671275146305561, + 0.0, + 0.278511893004179, + 0.3236430175602436, + 0.9780260734260082, + 0.16021321713924408, + 0.45669837668538094, + 0.1296531856060028, + 0.4005328584462404 + ], + "unique_experts": 42, + "load_cv": 1.24474202791156, + "normalized_load_entropy": 0.8335375272962059, + "max_load_share": 0.09027777777777778 + }, + "full_input": { + "tokens": 65, + "top_k": 6, + "decisions": 390, + "ordered_route_sha256": "ba50f19eac7873a84e1a22f71978508c5a18186d0a92a9cf28a40e3e5e16b769", + "route_weight_sha256": "7248632727ece86a0455806841d506874b0250d8bc654346129d1194481db35f", + "loads": [ + 10, + 3, + 0, + 3, + 6, + 26, + 0, + 6, + 4, + 12, + 3, + 3, + 6, + 0, + 0, + 5, + 0, + 0, + 14, + 4, + 3, + 7, + 0, + 9, + 10, + 6, + 6, + 19, + 16, + 4, + 8, + 11, + 5, + 10, + 7, + 4, + 4, + 9, + 4, + 3, + 0, + 0, + 4, + 1, + 5, + 1, + 7, + 4, + 5, + 2, + 13, + 4, + 9, + 10, + 2, + 5, + 1, + 5, + 5, + 32, + 5, + 5, + 4, + 11 + ], + "weighted_loads": [ + 0.8651446998119354, + 0.18957503885030746, + 0.0, + 0.1148625984787941, + 0.40637632459402084, + 1.689245643094182, + 0.0, + 0.38932440243661404, + 0.33796195685863495, + 0.8556644879281521, + 0.13215524703264236, + 0.21397103741765022, + 0.40383725613355637, + 0.0, + 0.0, + 0.22493225149810314, + 0.0, + 0.0, + 0.9365779552608728, + 0.19873245805501938, + 0.3060200959444046, + 0.314954224973917, + 0.0, + 0.3796536885201931, + 0.4940528925508261, + 0.22768011316657066, + 0.40140776708722115, + 1.8443931955844164, + 1.624470617622137, + 0.2228088602423668, + 0.3972620218992233, + 0.8737249784171581, + 0.19633674249053001, + 1.1378495544195175, + 0.4206056445837021, + 0.2567594274878502, + 0.13965879380702972, + 0.6518347822129726, + 0.24885037168860435, + 0.18646255508065224, + 0.0, + 0.0, + 0.18955827504396439, + 0.04589187726378441, + 0.17585333809256554, + 0.05312427878379822, + 0.4356508031487465, + 0.1579370554536581, + 0.32785943150520325, + 0.0737830325961113, + 0.8655752241611481, + 0.4485873896628618, + 0.8566523604094982, + 0.763354979455471, + 0.08220934867858887, + 0.4409242905676365, + 0.051413100212812424, + 0.3680998459458351, + 0.4330311678349972, + 2.1825937926769257, + 0.4142185300588608, + 0.4983318857848644, + 0.23073722049593925, + 0.5551557820290327 + ], + "unique_experts": 55, + "load_cv": 0.9567504722448256, + "normalized_load_entropy": 0.9031694528075827, + "max_load_share": 0.08205128205128205 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 24, + "ordered_topk_exact_tokens": 18, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.9404761904761904, + "mean_token_weighted_tv": 0.013283427998734018, + "aggregate_load_tv": 0.03472222222222222 + }, + "system_bos": { + "tokens": 24, + "ordered_topk_exact_tokens": 18, + "set_exact_tokens": 22, + "mean_set_jaccard": 0.9761904761904763, + "mean_token_weighted_tv": 0.01215623808093369, + "aggregate_load_tv": 0.013888888888888888 + }, + "system_x": { + "tokens": 24, + "ordered_topk_exact_tokens": 4, + "set_exact_tokens": 11, + "mean_set_jaccard": 0.8273809523809524, + "mean_token_weighted_tv": 0.03601120905174563, + "aggregate_load_tv": 0.07638888888888888 + }, + "system_period": { + "tokens": 24, + "ordered_topk_exact_tokens": 8, + "set_exact_tokens": 9, + "mean_set_jaccard": 0.8035714285714285, + "mean_token_weighted_tv": 0.03758535584590087, + "aggregate_load_tv": 0.09027777777777779 + }, + "bos_at_s0": { + "tokens": 24, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8809523809523809, + "mean_token_weighted_tv": 0.02571740762020151, + "aggregate_load_tv": 0.05555555555555555 + }, + "bos_at_s1": { + "tokens": 24, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 13, + "mean_set_jaccard": 0.8690476190476191, + "mean_token_weighted_tv": 0.02945453064360966, + "aggregate_load_tv": 0.055555555555555546 + }, + "x_at_s0": { + "tokens": 24, + "ordered_topk_exact_tokens": 8, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.8928571428571429, + "mean_token_weighted_tv": 0.029068969927417736, + "aggregate_load_tv": 0.048611111111111105 + }, + "x_at_s1": { + "tokens": 24, + "ordered_topk_exact_tokens": 5, + "set_exact_tokens": 10, + "mean_set_jaccard": 0.8154761904761904, + "mean_token_weighted_tv": 0.04050326801370829, + "aggregate_load_tv": 0.08333333333333333 + }, + "period_at_s0": { + "tokens": 24, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8809523809523809, + "mean_token_weighted_tv": 0.029315948796768982, + "aggregate_load_tv": 0.05555555555555555 + }, + "period_at_s1": { + "tokens": 24, + "ordered_topk_exact_tokens": 6, + "set_exact_tokens": 8, + "mean_set_jaccard": 0.8005952380952381, + "mean_token_weighted_tv": 0.043625591322779655, + "aggregate_load_tv": 0.09027777777777778 + } + } + }, + "layer_15": { + "layer": 15, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "121f01478d93ff553baca49e43dd5daec6bd67c09618fe1ac531f2b90e38ed24", + "route_weight_sha256": "cd101b765ff90256e3a2c1d3ac8055ab8f77815cad5587ccd1e590f337c7a8eb", + "loads": [ + 2, + 2, + 0, + 0, + 1, + 4, + 2, + 14, + 3, + 0, + 0, + 2, + 4, + 1, + 2, + 2, + 0, + 0, + 0, + 1, + 3, + 3, + 4, + 2, + 3, + 6, + 0, + 2, + 1, + 0, + 0, + 4, + 0, + 2, + 3, + 2, + 5, + 0, + 3, + 0, + 2, + 7, + 0, + 5, + 2, + 1, + 2, + 5, + 1, + 7, + 2, + 0, + 1, + 3, + 1, + 6, + 7, + 0, + 0, + 0, + 1, + 5, + 3, + 0 + ], + "weighted_loads": [ + 0.07950233668088913, + 0.13311686366796494, + 0.0, + 0.0, + 0.04899902269244194, + 0.2912488952279091, + 0.21635876968502998, + 1.3660134337842464, + 0.14990026503801346, + 0.0, + 0.0, + 0.1291753202676773, + 0.26135194674134254, + 0.03661350533366203, + 0.08074336498975754, + 0.06965125352144241, + 0.0, + 0.0, + 0.0, + 0.026341378688812256, + 0.08054935745894909, + 0.13003204204142094, + 0.24065070785582066, + 0.19151035696268082, + 0.6010034568607807, + 0.3911430090665817, + 0.0, + 0.11791836097836494, + 0.037201568484306335, + 0.0, + 0.0, + 0.16377893090248108, + 0.0, + 0.06614840589463711, + 0.22025791183114052, + 0.06083817966282368, + 0.3372044153511524, + 0.0, + 0.13861363381147385, + 0.0, + 0.06908970512449741, + 0.40923701599240303, + 0.0, + 0.34947825223207474, + 0.1345217116177082, + 0.054360877722501755, + 0.20114095509052277, + 0.19351082667708397, + 0.03705059736967087, + 0.3202005047351122, + 0.07740581408143044, + 0.0, + 0.04131918027997017, + 0.2954890839755535, + 0.04709221050143242, + 0.3019995540380478, + 0.43986570835113525, + 0.0, + 0.0, + 0.0, + 0.04805782437324524, + 0.23385873809456825, + 0.16489700600504875, + 0.0 + ], + "unique_experts": 45, + "load_cv": 1.0999438818457405, + "normalized_load_entropy": 0.8619381551064444, + "max_load_share": 0.09722222222222222 + }, + "full_input": { + "tokens": 49, + "top_k": 6, + "decisions": 294, + "ordered_route_sha256": "987cd962fea9ecf7d4e76fa8e61b7b193642a2c11f3aa8a533d6f6a3bc64377a", + "route_weight_sha256": "3c43e8dfc477f514b268c613176669374419ebec394c0c4ad50c6400f31a1222", + "loads": [ + 6, + 2, + 0, + 0, + 7, + 7, + 10, + 15, + 9, + 1, + 5, + 3, + 8, + 1, + 12, + 3, + 7, + 2, + 0, + 3, + 3, + 3, + 4, + 7, + 7, + 7, + 10, + 2, + 4, + 0, + 4, + 4, + 6, + 4, + 3, + 2, + 10, + 0, + 5, + 0, + 8, + 8, + 0, + 7, + 2, + 1, + 2, + 7, + 2, + 17, + 8, + 2, + 7, + 3, + 1, + 10, + 7, + 0, + 1, + 0, + 1, + 7, + 3, + 4 + ], + "weighted_loads": [ + 0.31179772317409515, + 0.13311686366796494, + 0.0, + 0.0, + 0.4163155220448971, + 0.37105727288872004, + 0.802771795541048, + 1.3988086022436619, + 0.5652122274041176, + 0.031405895948410034, + 0.18839828856289387, + 0.15929661318659782, + 0.57273218780756, + 0.03661350533366203, + 0.45593518763780594, + 0.1013503223657608, + 0.6503778696060181, + 0.07410415634512901, + 0.0, + 0.133737001568079, + 0.08054935745894909, + 0.13003204204142094, + 0.24065070785582066, + 0.4642796851694584, + 0.7110650567337871, + 0.41965628787875175, + 0.6663943864405155, + 0.11791836097836494, + 0.14938868023455143, + 0.0, + 0.17589322105050087, + 0.16377893090248108, + 0.43663879483938217, + 0.15343975834548473, + 0.22025791183114052, + 0.06083817966282368, + 1.0108425142243505, + 0.0, + 0.1770879440009594, + 0.0, + 0.5611327874939889, + 0.4134765164926648, + 0.0, + 0.4328838735818863, + 0.1345217116177082, + 0.054360877722501755, + 0.20114095509052277, + 0.2691809833049774, + 0.05053125787526369, + 2.233311692252755, + 0.4124362673610449, + 0.08213557675480843, + 0.22221951372921467, + 0.2954890839755535, + 0.04709221050143242, + 1.973835363984108, + 0.43986570835113525, + 0.0, + 0.051647767424583435, + 0.0, + 0.04805782437324524, + 0.31107371486723423, + 0.16489700600504875, + 0.1736891306936741 + ], + "unique_experts": 55, + "load_cv": 0.8214972295639915, + "normalized_load_entropy": 0.9125528250318071, + "max_load_share": 0.05782312925170068 + } + }, + "s1_eos": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "8bab0c4457d99d5e1973e428e8aac191e41bb97426d2c49927e9ff1658edf8bb", + "route_weight_sha256": "ef59318fb84b95a7f44d6bd40cbd1d8c777a809ae915113b38fa8196104754d5", + "loads": [ + 2, + 3, + 0, + 0, + 1, + 4, + 2, + 14, + 3, + 0, + 0, + 2, + 5, + 1, + 3, + 2, + 0, + 0, + 0, + 1, + 3, + 3, + 4, + 2, + 3, + 6, + 0, + 2, + 0, + 0, + 0, + 4, + 0, + 2, + 3, + 3, + 5, + 0, + 3, + 0, + 1, + 6, + 0, + 5, + 2, + 2, + 2, + 5, + 1, + 7, + 2, + 0, + 1, + 3, + 1, + 6, + 6, + 0, + 0, + 0, + 1, + 4, + 3, + 0 + ], + "weighted_loads": [ + 0.08041441440582275, + 0.1687203347682953, + 0.0, + 0.0, + 0.04694151505827904, + 0.2930028364062309, + 0.22425789386034012, + 1.3615434356033802, + 0.15164075046777725, + 0.0, + 0.0, + 0.12538308650255203, + 0.29089606925845146, + 0.03692851960659027, + 0.12561561167240143, + 0.07090442627668381, + 0.0, + 0.0, + 0.0, + 0.025698721408843994, + 0.08375024423003197, + 0.12883060611784458, + 0.22916803695261478, + 0.19248828291893005, + 0.6082386039197445, + 0.39688383787870407, + 0.0, + 0.12206600978970528, + 0.0, + 0.0, + 0.0, + 0.15804485976696014, + 0.0, + 0.07644577324390411, + 0.22037189453840256, + 0.08575345203280449, + 0.3282083012163639, + 0.0, + 0.1386052891612053, + 0.0, + 0.03809063881635666, + 0.3670320101082325, + 0.0, + 0.36471565812826157, + 0.13440461084246635, + 0.09213685989379883, + 0.203937578946352, + 0.19265001267194748, + 0.0377790704369545, + 0.31759561970829964, + 0.079226890578866, + 0.0, + 0.0395348034799099, + 0.29399652779102325, + 0.04274918884038925, + 0.30146246775984764, + 0.3900584690272808, + 0.0, + 0.0, + 0.0, + 0.04732833057641983, + 0.19690677151083946, + 0.17437788844108582, + 0.0 + ], + "unique_experts": 44, + "load_cv": 1.082977149423218, + "normalized_load_entropy": 0.8619598638954054, + "max_load_share": 0.09722222222222222 + }, + "full_input": { + "tokens": 65, + "top_k": 6, + "decisions": 390, + "ordered_route_sha256": "4877fe639393cd5dd541843d988cd5527f00c711d2a650c5a356f5412e80cb80", + "route_weight_sha256": "ecac4b5cc24ee26cfc41d7757c5ce8b1938858ebf968d4127f81cbec630b0265", + "loads": [ + 23, + 4, + 0, + 0, + 10, + 9, + 16, + 16, + 13, + 1, + 5, + 6, + 10, + 2, + 8, + 11, + 12, + 4, + 1, + 4, + 4, + 4, + 4, + 7, + 7, + 7, + 10, + 4, + 6, + 1, + 6, + 8, + 5, + 5, + 5, + 3, + 11, + 0, + 6, + 1, + 7, + 8, + 0, + 7, + 2, + 3, + 2, + 7, + 4, + 21, + 10, + 2, + 3, + 4, + 1, + 10, + 6, + 6, + 2, + 4, + 1, + 11, + 5, + 5 + ], + "weighted_loads": [ + 1.4913368932902813, + 0.19566294737160206, + 0.0, + 0.0, + 0.5533200241625309, + 0.5007764101028442, + 1.3165522702038288, + 1.4258360415697098, + 0.7438949868083, + 0.031033821403980255, + 0.2301889844238758, + 0.45863610692322254, + 0.719033794477582, + 0.11852352321147919, + 0.2980202753096819, + 0.7172923907637596, + 1.128452617675066, + 0.15822038426995277, + 0.04986792057752609, + 0.23644227534532547, + 0.11299940198659897, + 0.21093507297337055, + 0.22916803695261478, + 0.44630732387304306, + 0.7047806840855628, + 0.4253826979547739, + 0.6984482333064079, + 0.243271354585886, + 0.43151674792170525, + 0.03682715818285942, + 0.22691777721047401, + 0.6070813946425915, + 0.40082211047410965, + 0.2089194543659687, + 0.3695225305855274, + 0.08575345203280449, + 0.969213736243546, + 0.0, + 0.21608293801546097, + 0.03595353290438652, + 0.5055985772050917, + 0.4591253185644746, + 0.0, + 0.639639999717474, + 0.13440461084246635, + 0.12954974547028542, + 0.203937578946352, + 0.27173183485865593, + 0.18096787203103304, + 2.9091817289590836, + 0.48718213848769665, + 0.0743551142513752, + 0.0884463619440794, + 0.4436924010515213, + 0.04274918884038925, + 1.95080341771245, + 0.3900584690272808, + 0.6582623720169067, + 0.0805031806230545, + 0.17342786863446236, + 0.04732833057641983, + 0.5615237690508366, + 0.2904675863683224, + 0.19991440512239933 + ], + "unique_experts": 60, + "load_cv": 0.7750039765756604, + "normalized_load_entropy": 0.9298187734497106, + "max_load_share": 0.05897435897435897 + } + }, + "s0_bos": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "3ccf1d09b649b31d4fdd8230a0e8e367c879c3ef39270e96f231442d86c20f64", + "route_weight_sha256": "686882de5a4226d4516bd5450e5d5c4b8537488c69e4caa161b4daee9ead0a4d", + "loads": [ + 2, + 2, + 0, + 0, + 2, + 5, + 2, + 12, + 5, + 0, + 0, + 2, + 5, + 1, + 3, + 2, + 0, + 1, + 0, + 0, + 2, + 3, + 4, + 2, + 5, + 6, + 0, + 2, + 0, + 0, + 1, + 4, + 0, + 3, + 3, + 5, + 5, + 0, + 3, + 0, + 1, + 6, + 0, + 5, + 2, + 1, + 2, + 3, + 1, + 7, + 0, + 0, + 0, + 3, + 2, + 5, + 6, + 0, + 0, + 0, + 1, + 4, + 3, + 0 + ], + "weighted_loads": [ + 0.08563040941953659, + 0.12029099836945534, + 0.0, + 0.0, + 0.08566414937376976, + 0.3166370205581188, + 0.22614163160324097, + 1.300342746078968, + 0.23407886922359467, + 0.0, + 0.0, + 0.13730596378445625, + 0.2746480293571949, + 0.0356605239212513, + 0.13082930445671082, + 0.07003658451139927, + 0.0, + 0.034961286932229996, + 0.0, + 0.0, + 0.049923332408070564, + 0.1312912367284298, + 0.23694784566760063, + 0.1802249178290367, + 0.6995828561484814, + 0.3826581612229347, + 0.0, + 0.1215263269841671, + 0.0, + 0.0, + 0.027374455705285072, + 0.20332936197519302, + 0.0, + 0.1082464661449194, + 0.2125548981130123, + 0.1553590651601553, + 0.3468357138335705, + 0.0, + 0.13050604984164238, + 0.0, + 0.037465956062078476, + 0.3736902289092541, + 0.0, + 0.35109150409698486, + 0.13051682338118553, + 0.05994873866438866, + 0.20613974705338478, + 0.12035738304257393, + 0.03930136561393738, + 0.315069954842329, + 0.0, + 0.0, + 0.0, + 0.2706487998366356, + 0.08042611554265022, + 0.27021732553839684, + 0.40657439455389977, + 0.0, + 0.0, + 0.0, + 0.04562065005302429, + 0.19281363859772682, + 0.14606139063835144, + 0.0 + ], + "unique_experts": 43, + "load_cv": 1.0423146132940955, + "normalized_load_entropy": 0.8615192325449685, + "max_load_share": 0.08333333333333333 + }, + "full_input": { + "tokens": 49, + "top_k": 6, + "decisions": 294, + "ordered_route_sha256": "e568e4cfeeb488feedb03e113ac0db72661ef4120f08845573b1f434d2345b32", + "route_weight_sha256": "1cbb75b042dddc21ef9dc80f1d32cefb8e2ed73792493b8700b5c72b08e362fe", + "loads": [ + 6, + 2, + 0, + 0, + 7, + 9, + 9, + 13, + 10, + 1, + 5, + 3, + 9, + 1, + 12, + 3, + 7, + 3, + 0, + 2, + 2, + 3, + 4, + 7, + 8, + 7, + 10, + 2, + 4, + 0, + 6, + 4, + 6, + 5, + 3, + 6, + 10, + 0, + 4, + 0, + 8, + 6, + 0, + 7, + 2, + 1, + 2, + 5, + 2, + 16, + 7, + 3, + 6, + 4, + 4, + 7, + 6, + 0, + 1, + 0, + 1, + 6, + 3, + 4 + ], + "weighted_loads": [ + 0.3977910429239273, + 0.12029099836945534, + 0.0, + 0.0, + 0.39847399294376373, + 0.4413526635617018, + 0.6995967924594879, + 1.3331379145383835, + 0.6148520335555077, + 0.031405895948410034, + 0.18839828856289387, + 0.16742725670337677, + 0.5932100340723991, + 0.0356605239212513, + 0.4959734305739403, + 0.10173565335571766, + 0.6361427493393421, + 0.10906544327735901, + 0.0, + 0.10739562287926674, + 0.049923332408070564, + 0.1312912367284298, + 0.23694784566760063, + 0.4529942460358143, + 0.8214158229529858, + 0.41117144003510475, + 0.6663943864405155, + 0.1215263269841671, + 0.18106752075254917, + 0.0, + 0.2579240221530199, + 0.20332936197519302, + 0.44311609119176865, + 0.19553781859576702, + 0.2125548981130123, + 0.2400678601115942, + 1.0511246295645833, + 0.0, + 0.16123253665864468, + 0.0, + 0.5345234498381615, + 0.3736902289092541, + 0.0, + 0.4344971254467964, + 0.13051682338118553, + 0.05994873866438866, + 0.20613974705338478, + 0.20391957834362984, + 0.0527820261195302, + 1.94826814904809, + 0.40960313379764557, + 0.1318679228425026, + 0.1809003334492445, + 0.3280215486884117, + 0.18239052593708038, + 0.9116496033966541, + 0.40657439455389977, + 0.0, + 0.051647767424583435, + 0.0, + 0.04562065005302429, + 0.2700286153703928, + 0.14606139063835144, + 0.18756629899144173 + ], + "unique_experts": 55, + "load_cv": 0.7712917850149464, + "normalized_load_entropy": 0.9198304194999699, + "max_load_share": 0.05442176870748299 + } + }, + "s1_bos": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "bbaa92443e0fa700d44d32c61ee5509484061defd140fabb72add4d40adc7a2e", + "route_weight_sha256": "3e3e95d5b4a456a30eac459894dd1264645b71f6f6f21c66edb682994d7eea5e", + "loads": [ + 2, + 2, + 0, + 0, + 2, + 4, + 2, + 11, + 5, + 0, + 0, + 2, + 5, + 1, + 3, + 2, + 0, + 1, + 0, + 0, + 3, + 2, + 4, + 2, + 4, + 6, + 0, + 2, + 1, + 0, + 1, + 4, + 0, + 3, + 3, + 3, + 5, + 0, + 3, + 0, + 2, + 7, + 0, + 5, + 2, + 1, + 2, + 4, + 1, + 7, + 1, + 0, + 0, + 3, + 1, + 6, + 6, + 0, + 0, + 0, + 1, + 5, + 2, + 0 + ], + "weighted_loads": [ + 0.08315544947981834, + 0.12146557867527008, + 0.0, + 0.0, + 0.08197136595845222, + 0.305586751550436, + 0.23110631108283997, + 1.241260539740324, + 0.2296756412833929, + 0.0, + 0.0, + 0.13325554877519608, + 0.2712301053106785, + 0.03534315153956413, + 0.11564508825540543, + 0.07113183289766312, + 0.0, + 0.031606145203113556, + 0.0, + 0.0, + 0.08292149566113949, + 0.10034137964248657, + 0.23884662985801697, + 0.17106153815984726, + 0.6440420560538769, + 0.39614711329340935, + 0.0, + 0.12020943686366081, + 0.03882920369505882, + 0.0, + 0.026608580723404884, + 0.19731545448303223, + 0.0, + 0.11134465038776398, + 0.2259766049683094, + 0.08786316402256489, + 0.33241211250424385, + 0.0, + 0.14078893512487411, + 0.0, + 0.06591563113033772, + 0.4109526127576828, + 0.0, + 0.35879577323794365, + 0.12847476080060005, + 0.0622764490544796, + 0.20757773518562317, + 0.1577481497079134, + 0.0399540513753891, + 0.3175720348954201, + 0.047930750995874405, + 0.0, + 0.0, + 0.2594776824116707, + 0.04516258463263512, + 0.30884672328829765, + 0.39866703748703003, + 0.0, + 0.0, + 0.0, + 0.04573291540145874, + 0.253390833735466, + 0.10263270884752274, + 0.0 + ], + "unique_experts": 45, + "load_cv": 1.0122703976826999, + "normalized_load_entropy": 0.8695031754555175, + "max_load_share": 0.0763888888888889 + }, + "full_input": { + "tokens": 65, + "top_k": 6, + "decisions": 390, + "ordered_route_sha256": "b9b23afc977532996c06d284ef4a8a49cd111bd2ffe08a8a803f83b2ee59dfcb", + "route_weight_sha256": "84e2b9dabed4473e9bc4d0b579564d8f36504b884bb8ff39b8cfc4a2a87984a7", + "loads": [ + 24, + 3, + 0, + 0, + 12, + 9, + 16, + 13, + 14, + 1, + 5, + 6, + 10, + 2, + 7, + 11, + 12, + 5, + 1, + 3, + 4, + 3, + 4, + 7, + 8, + 8, + 10, + 4, + 7, + 1, + 7, + 8, + 5, + 6, + 5, + 3, + 12, + 0, + 5, + 1, + 8, + 8, + 0, + 7, + 2, + 2, + 2, + 6, + 4, + 22, + 10, + 2, + 2, + 4, + 1, + 9, + 6, + 6, + 2, + 4, + 1, + 12, + 4, + 4 + ], + "weighted_loads": [ + 1.6158765777945518, + 0.14840819127857685, + 0.0, + 0.0, + 0.5413205195218325, + 0.5490615591406822, + 1.2488800883293152, + 1.3055531457066536, + 0.7657990399748087, + 0.031033821403980255, + 0.2301889844238758, + 0.4665085691958666, + 0.6928707268089056, + 0.11693815514445305, + 0.2765937075018883, + 0.7175197973847389, + 1.1090841516852379, + 0.18982652947306633, + 0.04986792057752609, + 0.21074355393648148, + 0.11217065341770649, + 0.18244584649801254, + 0.23884662985801697, + 0.42488057911396027, + 0.8087196853011847, + 0.45918781869113445, + 0.6984482333064079, + 0.24141478165984154, + 0.47034595161676407, + 0.03682715818285942, + 0.2535263579338789, + 0.6463519893586636, + 0.40082211047410965, + 0.24381833150982857, + 0.37512724101543427, + 0.08786316402256489, + 1.0466293590143323, + 0.0, + 0.2089484967291355, + 0.03595353290438652, + 0.5579740200191736, + 0.49889513850212097, + 0.0, + 0.6337201148271561, + 0.12847476080060005, + 0.09968933463096619, + 0.20757773518562317, + 0.24326997436583042, + 0.18314285296946764, + 2.894621465355158, + 0.47531526908278465, + 0.0743551142513752, + 0.0489115584641695, + 0.40917355567216873, + 0.04516258463263512, + 1.024082262068987, + 0.39866703748703003, + 0.6582623720169067, + 0.0805031806230545, + 0.17342786863446236, + 0.04573291540145874, + 0.6180078312754631, + 0.2187224067747593, + 0.17397481761872768 + ], + "unique_experts": 60, + "load_cv": 0.8027402116929053, + "normalized_load_entropy": 0.9254619876511463, + "max_load_share": 0.06153846153846154 + } + }, + "s0_x": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "4c88f2d5710b4c16b4ba06f60620bd2e025218f771e12dcfe4174009ea15a59e", + "route_weight_sha256": "673f7001898598117f9a1852f82f3c8359ddc80c210cf70998f8abf07963827b", + "loads": [ + 2, + 2, + 0, + 0, + 2, + 4, + 2, + 12, + 6, + 0, + 0, + 2, + 5, + 1, + 2, + 1, + 0, + 0, + 0, + 0, + 2, + 3, + 4, + 2, + 3, + 6, + 0, + 2, + 1, + 0, + 1, + 4, + 0, + 1, + 3, + 4, + 5, + 0, + 3, + 0, + 1, + 6, + 0, + 5, + 2, + 1, + 2, + 5, + 2, + 7, + 2, + 0, + 1, + 3, + 1, + 6, + 7, + 0, + 0, + 0, + 1, + 5, + 2, + 0 + ], + "weighted_loads": [ + 0.10727547481656075, + 0.13862251490354538, + 0.0, + 0.0, + 0.0746714249253273, + 0.27354831993579865, + 0.22499695047736168, + 1.288065254688263, + 0.2914514522999525, + 0.0, + 0.0, + 0.11990496888756752, + 0.26960311457514763, + 0.035351306200027466, + 0.08886490389704704, + 0.04472900554537773, + 0.0, + 0.0, + 0.0, + 0.0, + 0.05515122413635254, + 0.13429870828986168, + 0.24626817367970943, + 0.15733572095632553, + 0.5830640159547329, + 0.38929376751184464, + 0.0, + 0.12096396833658218, + 0.041246335953474045, + 0.0, + 0.027318811044096947, + 0.194613516330719, + 0.0, + 0.051481943577528, + 0.20467758178710938, + 0.12559458054602146, + 0.3448803760111332, + 0.0, + 0.13369320333003998, + 0.0, + 0.038553595542907715, + 0.3801135756075382, + 0.0, + 0.3525206074118614, + 0.11748991906642914, + 0.05709783360362053, + 0.1986551210284233, + 0.18202748149633408, + 0.0741555280983448, + 0.3513132855296135, + 0.07282940298318863, + 0.0, + 0.0241329874843359, + 0.2721966467797756, + 0.044542133808135986, + 0.27893567830324173, + 0.4573012851178646, + 0.0, + 0.0, + 0.0, + 0.0483020581305027, + 0.2540469914674759, + 0.10088232904672623, + 0.0 + ], + "unique_experts": 45, + "load_cv": 1.057016532802247, + "normalized_load_entropy": 0.8637557192013003, + "max_load_share": 0.08333333333333333 + }, + "full_input": { + "tokens": 49, + "top_k": 6, + "decisions": 294, + "ordered_route_sha256": "2e117720daf0a93c8a46ede0582cac8f7dec653798712d82ea17fdd1c3873fcc", + "route_weight_sha256": "bb0f64e3ac27c25eeadd106b9a834b8f047c13da589c67eedb12c0ca383c0a9f", + "loads": [ + 5, + 2, + 0, + 0, + 8, + 5, + 10, + 13, + 13, + 1, + 6, + 3, + 9, + 1, + 11, + 2, + 7, + 2, + 0, + 3, + 2, + 3, + 4, + 8, + 6, + 7, + 11, + 2, + 4, + 0, + 6, + 4, + 6, + 3, + 3, + 4, + 10, + 0, + 3, + 0, + 7, + 6, + 0, + 8, + 2, + 1, + 2, + 7, + 3, + 16, + 8, + 2, + 8, + 4, + 1, + 9, + 7, + 0, + 1, + 0, + 1, + 8, + 2, + 4 + ], + "weighted_loads": [ + 0.39222634583711624, + 0.13862251490354538, + 0.0, + 0.0, + 0.42679646611213684, + 0.29230811074376106, + 0.8686363622546196, + 1.3208604231476784, + 0.749009320512414, + 0.031405895948410034, + 0.25816616602241993, + 0.15002626180648804, + 0.5929087176918983, + 0.035351306200027466, + 0.4540090300142765, + 0.07642807438969612, + 0.6385880038142204, + 0.07410415634512901, + 0.0, + 0.15653083473443985, + 0.05515122413635254, + 0.13429870828986168, + 0.24626817367970943, + 0.5236951820552349, + 0.6777972988784313, + 0.41780704632401466, + 0.783090528100729, + 0.12096396833658218, + 0.15343344770371914, + 0.0, + 0.24623857624828815, + 0.194613516330719, + 0.43907465040683746, + 0.13877329602837563, + 0.20467758178710938, + 0.12559458054602146, + 1.0285429479554296, + 0.0, + 0.13369320333003998, + 0.0, + 0.48119284585118294, + 0.3801135756075382, + 0.0, + 0.5161083117127419, + 0.11748991906642914, + 0.05709783360362053, + 0.1986551210284233, + 0.2752174846827984, + 0.08763618860393763, + 1.6834516189992428, + 0.3977399691939354, + 0.08213557675480843, + 0.24250392988324165, + 0.30698341131210327, + 0.044542133808135986, + 0.9686224535107613, + 0.4573012851178646, + 0.0, + 0.051647767424583435, + 0.0, + 0.0483020581305027, + 0.39630537293851376, + 0.10088232904672623, + 0.16171473264694214 + ], + "unique_experts": 55, + "load_cv": 0.8196926065739903, + "normalized_load_entropy": 0.9118921419607849, + "max_load_share": 0.05442176870748299 + } + }, + "s1_x": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "fad87b40bc592eab46e10f38bc5c8a5cdeffa5149b61de0abbb7930b869e213b", + "route_weight_sha256": "b047072277fcce3ef1760019b4e077bc88fb3c2d6d682228482d67b0e3238c11", + "loads": [ + 3, + 3, + 0, + 0, + 2, + 4, + 2, + 14, + 6, + 0, + 0, + 2, + 5, + 0, + 3, + 2, + 0, + 1, + 0, + 0, + 3, + 3, + 5, + 2, + 4, + 6, + 0, + 2, + 1, + 0, + 0, + 3, + 0, + 1, + 3, + 3, + 5, + 0, + 4, + 0, + 1, + 5, + 1, + 5, + 2, + 1, + 1, + 3, + 1, + 6, + 2, + 0, + 0, + 3, + 1, + 6, + 6, + 0, + 0, + 0, + 1, + 5, + 2, + 0 + ], + "weighted_loads": [ + 0.16089730709791183, + 0.15359580516815186, + 0.0, + 0.0, + 0.07004087418317795, + 0.2467641830444336, + 0.237816721200943, + 1.3545244988054037, + 0.2846665605902672, + 0.0, + 0.0, + 0.11047965288162231, + 0.2733609527349472, + 0.0, + 0.13788354769349098, + 0.07068308256566525, + 0.0, + 0.0322117879986763, + 0.0, + 0.0, + 0.08986509405076504, + 0.14753592014312744, + 0.274295587092638, + 0.13718727976083755, + 0.6344506107270718, + 0.3792276866734028, + 0.0, + 0.11811469495296478, + 0.03846987336874008, + 0.0, + 0.0, + 0.1403740681707859, + 0.0, + 0.050153378397226334, + 0.22693603485822678, + 0.08779791370034218, + 0.32839207723736763, + 0.0, + 0.1687571331858635, + 0.0, + 0.0326504148542881, + 0.3110446333885193, + 0.037789732217788696, + 0.35357223078608513, + 0.10883723944425583, + 0.06411350518465042, + 0.16770021617412567, + 0.11465806514024734, + 0.04192862659692764, + 0.30514808744192123, + 0.08861451968550682, + 0.0, + 0.0, + 0.26685724779963493, + 0.042996812611818314, + 0.278897900134325, + 0.4093359671533108, + 0.0, + 0.0, + 0.0, + 0.049057118594646454, + 0.2890161760151386, + 0.09880654141306877, + 0.0 + ], + "unique_experts": 44, + "load_cv": 1.0914934835771388, + "normalized_load_entropy": 0.8592715722326346, + "max_load_share": 0.09722222222222222 + }, + "full_input": { + "tokens": 65, + "top_k": 6, + "decisions": 390, + "ordered_route_sha256": "23c892c335c46ee88ad8e5a155d695561c604ec72cf9254fa150f074d2fcd51e", + "route_weight_sha256": "91bf5ce0f7bd42382bde5abd2dc3afd8f4a8e5d98d54bf9bb49206409071c613", + "loads": [ + 25, + 4, + 0, + 0, + 10, + 7, + 16, + 16, + 16, + 1, + 6, + 6, + 10, + 1, + 7, + 13, + 12, + 5, + 1, + 4, + 4, + 4, + 5, + 8, + 7, + 7, + 11, + 4, + 7, + 2, + 6, + 7, + 6, + 4, + 5, + 3, + 11, + 0, + 6, + 1, + 6, + 6, + 1, + 8, + 2, + 2, + 1, + 5, + 4, + 20, + 9, + 3, + 2, + 4, + 1, + 9, + 6, + 6, + 2, + 4, + 1, + 13, + 4, + 3 + ], + "weighted_loads": [ + 1.7110637240111828, + 0.18053841777145863, + 0.0, + 0.0, + 0.4509035460650921, + 0.3982664383947849, + 1.402660496532917, + 1.4188171047717333, + 0.9330440051853657, + 0.031033821403980255, + 0.2830589972436428, + 0.4437326733022928, + 0.7196966987103224, + 0.08159500360488892, + 0.29883216693997383, + 0.776307987049222, + 1.1193124502897263, + 0.19043217226862907, + 0.04986792057752609, + 0.2609672285616398, + 0.11911425180733204, + 0.2296403869986534, + 0.274295587092638, + 0.4652773514389992, + 0.7293455097824335, + 0.4077265467494726, + 0.8231997266411781, + 0.2393200397491455, + 0.46998662129044533, + 0.06326325982809067, + 0.22691777721047401, + 0.5894106030464172, + 0.4515308700501919, + 0.18262705951929092, + 0.37608667090535164, + 0.08779791370034218, + 0.9395785974338651, + 0.0, + 0.2404720075428486, + 0.03595353290438652, + 0.3761933296918869, + 0.39898715913295746, + 0.037789732217788696, + 0.7554467171430588, + 0.10883723944425583, + 0.10152639076113701, + 0.16770021617412567, + 0.2208351381123066, + 0.18511742819100618, + 2.265535455197096, + 0.35895741544663906, + 0.10969238355755806, + 0.0489115584641695, + 0.416553121060133, + 0.042996812611818314, + 0.959341250360012, + 0.4093359671533108, + 0.6582623720169067, + 0.0805031806230545, + 0.17342786863446236, + 0.049057118594646454, + 0.7038209065794945, + 0.21489623934030533, + 0.11480099521577358 + ], + "unique_experts": 61, + "load_cv": 0.8110836413350282, + "normalized_load_entropy": 0.9261914783489666, + "max_load_share": 0.0641025641025641 + } + }, + "s0_period": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "bbefaa760164c189bbdd0e4b55d11c423fb92c4b4e79b2a9eb23cdc768568ee9", + "route_weight_sha256": "4ea758494d4c85b03ed3489458b5e2a77a6f4b0b645f3e674166c72a249988c8", + "loads": [ + 2, + 2, + 0, + 0, + 2, + 4, + 2, + 12, + 6, + 0, + 0, + 2, + 5, + 1, + 3, + 1, + 0, + 1, + 0, + 0, + 4, + 3, + 4, + 2, + 3, + 6, + 0, + 2, + 1, + 0, + 0, + 3, + 0, + 2, + 3, + 2, + 5, + 0, + 4, + 0, + 1, + 6, + 0, + 5, + 2, + 1, + 2, + 5, + 2, + 7, + 2, + 0, + 0, + 3, + 2, + 5, + 6, + 0, + 0, + 0, + 1, + 5, + 2, + 0 + ], + "weighted_loads": [ + 0.1090526133775711, + 0.12546882033348083, + 0.0, + 0.0, + 0.07325960323214531, + 0.27227070182561874, + 0.2303740195930004, + 1.3130498006939888, + 0.28640156611800194, + 0.0, + 0.0, + 0.11937913298606873, + 0.2632502019405365, + 0.034830883145332336, + 0.1249791607260704, + 0.04269110783934593, + 0.0, + 0.030107960104942322, + 0.0, + 0.0, + 0.1123578567057848, + 0.13847008347511292, + 0.23900789767503738, + 0.1682053804397583, + 0.5909897908568382, + 0.4009152427315712, + 0.0, + 0.12118252366781235, + 0.041120268404483795, + 0.0, + 0.0, + 0.16323361918330193, + 0.0, + 0.07950383797287941, + 0.20879298448562622, + 0.0616446677595377, + 0.3466973043978214, + 0.0, + 0.16068619303405285, + 0.0, + 0.04337090253829956, + 0.37576958164572716, + 0.0, + 0.3602166511118412, + 0.12043265253305435, + 0.05896943062543869, + 0.20241525769233704, + 0.1802282389253378, + 0.07509016990661621, + 0.3477509506046772, + 0.07726584002375603, + 0.0, + 0.0, + 0.2779558263719082, + 0.07566088810563087, + 0.2511633299291134, + 0.41846781224012375, + 0.0, + 0.0, + 0.0, + 0.045548200607299805, + 0.24211063608527184, + 0.1008196473121643, + 0.0 + ], + "unique_experts": 44, + "load_cv": 1.0363754503432017, + "normalized_load_entropy": 0.8652452521617204, + "max_load_share": 0.08333333333333333 + }, + "full_input": { + "tokens": 49, + "top_k": 6, + "decisions": 294, + "ordered_route_sha256": "1e1a692d8c0beffed46fea798dc6548af60700570596821af005e47b6c3f3f1a", + "route_weight_sha256": "b49a2762ef43bc39929435cc425adf17788451fab6b5ca5618e3f785a9417167", + "loads": [ + 5, + 2, + 0, + 0, + 8, + 5, + 11, + 13, + 13, + 1, + 5, + 4, + 9, + 1, + 12, + 2, + 7, + 3, + 0, + 2, + 4, + 3, + 4, + 8, + 7, + 7, + 11, + 2, + 4, + 0, + 5, + 3, + 5, + 4, + 3, + 2, + 11, + 0, + 4, + 0, + 7, + 7, + 0, + 7, + 2, + 1, + 2, + 7, + 3, + 16, + 8, + 2, + 6, + 3, + 2, + 8, + 6, + 0, + 2, + 0, + 1, + 8, + 2, + 4 + ], + "weighted_loads": [ + 0.3930898532271385, + 0.12546882033348083, + 0.0, + 0.0, + 0.4705009199678898, + 0.29103049263358116, + 0.8487251177430153, + 1.3458449691534042, + 0.7401015721261501, + 0.031405895948410034, + 0.18839828856289387, + 0.18467336520552635, + 0.559944037348032, + 0.034830883145332336, + 0.49012328684329987, + 0.07439017668366432, + 0.6486530490219593, + 0.10421211645007133, + 0.0, + 0.10739562287926674, + 0.1123578567057848, + 0.13847008347511292, + 0.23900789767503738, + 0.5233539901673794, + 0.7291984595358372, + 0.4294285215437412, + 0.7123289816081524, + 0.12118252366781235, + 0.1533073801547289, + 0.0, + 0.22765161842107773, + 0.16323361918330193, + 0.4045035019516945, + 0.16679519042372704, + 0.20879298448562622, + 0.0616446677595377, + 1.0973159605637193, + 0.0, + 0.16068619303405285, + 0.0, + 0.5720361322164536, + 0.41857118159532547, + 0.0, + 0.44362227246165276, + 0.12043265253305435, + 0.05896943062543869, + 0.20241525769233704, + 0.27993529103696346, + 0.08857083041220903, + 1.802434217184782, + 0.3810934778302908, + 0.08213557675480843, + 0.1809003334492445, + 0.2779558263719082, + 0.07566088810563087, + 0.9520772881805897, + 0.41846781224012375, + 0.0, + 0.10279947891831398, + 0.0, + 0.045548200607299805, + 0.458562346175313, + 0.1008196473121643, + 0.16196514666080475 + ], + "unique_experts": 55, + "load_cv": 0.8187888035491431, + "normalized_load_entropy": 0.9136194159290907, + "max_load_share": 0.05442176870748299 + } + }, + "s1_period": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "4335b6a745aefa03b528ab3ec64e6b3bfc5990db69c34874c695b11545fe3df9", + "route_weight_sha256": "50426d50be4f9b9c14be41e2460041ab813a842822cc6099ab1a43827a16c264", + "loads": [ + 2, + 3, + 0, + 0, + 1, + 4, + 3, + 13, + 5, + 0, + 0, + 2, + 5, + 1, + 3, + 1, + 0, + 1, + 0, + 0, + 4, + 3, + 5, + 2, + 3, + 6, + 0, + 2, + 1, + 0, + 0, + 3, + 0, + 2, + 3, + 3, + 5, + 0, + 4, + 0, + 1, + 6, + 1, + 5, + 2, + 1, + 1, + 3, + 2, + 7, + 2, + 0, + 0, + 3, + 1, + 5, + 6, + 0, + 0, + 0, + 1, + 5, + 2, + 0 + ], + "weighted_loads": [ + 0.11100553348660469, + 0.1536441519856453, + 0.0, + 0.0, + 0.037837401032447815, + 0.24917428195476532, + 0.2680869475007057, + 1.344539113342762, + 0.2505198400467634, + 0.0, + 0.0, + 0.11130184680223465, + 0.2610309235751629, + 0.032495494931936264, + 0.13626911491155624, + 0.04122772812843323, + 0.0, + 0.03084222786128521, + 0.0, + 0.0, + 0.12186230160295963, + 0.1488598845899105, + 0.2573971524834633, + 0.15202251076698303, + 0.5888526141643524, + 0.3883153609931469, + 0.0, + 0.12009282037615776, + 0.037355173379182816, + 0.0, + 0.0, + 0.14449768885970116, + 0.0, + 0.08333295956254005, + 0.23121246322989464, + 0.09166407957673073, + 0.33204909786581993, + 0.0, + 0.17914395406842232, + 0.0, + 0.03598354756832123, + 0.3428805433213711, + 0.03825480118393898, + 0.3654232770204544, + 0.10969725996255875, + 0.06020009145140648, + 0.16820983588695526, + 0.11223683319985867, + 0.07890576869249344, + 0.3334614969789982, + 0.08402078598737717, + 0.0, + 0.0, + 0.2855651080608368, + 0.04359513521194458, + 0.24503925070166588, + 0.40458134189248085, + 0.0, + 0.0, + 0.0, + 0.049392201006412506, + 0.27634279802441597, + 0.09668488055467606, + 0.0 + ], + "unique_experts": 45, + "load_cv": 1.057016532802247, + "normalized_load_entropy": 0.8650073102566926, + "max_load_share": 0.09027777777777778 + }, + "full_input": { + "tokens": 65, + "top_k": 6, + "decisions": 390, + "ordered_route_sha256": "2a7ade5f2ecc0bb93c128c09efdba98261f87f9994fdb9c3945e12830430bb3a", + "route_weight_sha256": "9fa92575954ea92e23213b5637c1333fa2fb9570190cb8e96027dbd538d5e698", + "loads": [ + 24, + 4, + 0, + 0, + 10, + 7, + 17, + 15, + 16, + 1, + 6, + 6, + 10, + 2, + 7, + 11, + 12, + 5, + 1, + 3, + 5, + 4, + 5, + 7, + 6, + 7, + 11, + 4, + 7, + 2, + 6, + 7, + 5, + 6, + 5, + 3, + 11, + 0, + 6, + 1, + 6, + 7, + 1, + 8, + 2, + 2, + 1, + 5, + 5, + 20, + 10, + 2, + 2, + 4, + 1, + 8, + 6, + 6, + 3, + 4, + 1, + 13, + 4, + 4 + ], + "weighted_loads": [ + 1.6236144751310349, + 0.18058676458895206, + 0.0, + 0.0, + 0.5036539621651173, + 0.40067653730511665, + 1.4889066517353058, + 1.4088317193090916, + 0.9226459693163633, + 0.031033821403980255, + 0.25990414433181286, + 0.44455486722290516, + 0.6826237346976995, + 0.11409049853682518, + 0.2972177341580391, + 0.721984189003706, + 1.0756047628819942, + 0.18906261213123798, + 0.04986792057752609, + 0.21074355393648148, + 0.15111145935952663, + 0.23096435144543648, + 0.2573971524834633, + 0.40584155172109604, + 0.6818503681570292, + 0.41681422106921673, + 0.7445161305367947, + 0.24129816517233849, + 0.46887192130088806, + 0.06960544362664223, + 0.22691777721047401, + 0.5935342237353325, + 0.40082211047410965, + 0.25000255554914474, + 0.3803630992770195, + 0.09166407957673073, + 1.078701582737267, + 0.0, + 0.2510567456483841, + 0.03595353290438652, + 0.4423190541565418, + 0.43082306906580925, + 0.03825480118393898, + 0.6890943236649036, + 0.10969725996255875, + 0.09761297702789307, + 0.16820983588695526, + 0.2192810568958521, + 0.22209457028657198, + 2.250984348356724, + 0.4088781215250492, + 0.0743551142513752, + 0.0489115584641695, + 0.43526098132133484, + 0.04359513521194458, + 0.937167439609766, + 0.40458134189248085, + 0.6582623720169067, + 0.14336171001195908, + 0.17342786863446236, + 0.049392201006412506, + 0.8111978434026241, + 0.2127745784819126, + 0.14195920154452324 + ], + "unique_experts": 61, + "load_cv": 0.7905922845694713, + "normalized_load_entropy": 0.9293444737429303, + "max_load_share": 0.06153846153846154 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 24, + "ordered_topk_exact_tokens": 16, + "set_exact_tokens": 18, + "mean_set_jaccard": 0.9285714285714285, + "mean_token_weighted_tv": 0.01481577979090313, + "aggregate_load_tv": 0.03472222222222223 + }, + "system_bos": { + "tokens": 24, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.8988095238095237, + "mean_token_weighted_tv": 0.02217354334425181, + "aggregate_load_tv": 0.05555555555555555 + }, + "system_x": { + "tokens": 24, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 13, + "mean_set_jaccard": 0.8422619047619048, + "mean_token_weighted_tv": 0.0323083174880594, + "aggregate_load_tv": 0.08333333333333334 + }, + "system_period": { + "tokens": 24, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.8958333333333334, + "mean_token_weighted_tv": 0.024391277227550745, + "aggregate_load_tv": 0.04166666666666667 + }, + "bos_at_s0": { + "tokens": 24, + "ordered_topk_exact_tokens": 8, + "set_exact_tokens": 10, + "mean_set_jaccard": 0.8154761904761906, + "mean_token_weighted_tv": 0.0345107635948807, + "aggregate_load_tv": 0.10416666666666669 + }, + "bos_at_s1": { + "tokens": 24, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 12, + "mean_set_jaccard": 0.8323412698412699, + "mean_token_weighted_tv": 0.0329490426229313, + "aggregate_load_tv": 0.0763888888888889 + }, + "x_at_s0": { + "tokens": 24, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 13, + "mean_set_jaccard": 0.8690476190476192, + "mean_token_weighted_tv": 0.029441118162746232, + "aggregate_load_tv": 0.0625 + }, + "x_at_s1": { + "tokens": 24, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 11, + "mean_set_jaccard": 0.8005952380952381, + "mean_token_weighted_tv": 0.04345200591099759, + "aggregate_load_tv": 0.08333333333333334 + }, + "period_at_s0": { + "tokens": 24, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 13, + "mean_set_jaccard": 0.8601190476190478, + "mean_token_weighted_tv": 0.03133061850288262, + "aggregate_load_tv": 0.0763888888888889 + }, + "period_at_s1": { + "tokens": 24, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 11, + "mean_set_jaccard": 0.8115079365079364, + "mean_token_weighted_tv": 0.041830306445869304, + "aggregate_load_tv": 0.0763888888888889 + } + } + }, + "layer_16": { + "layer": 16, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "fa589b1e04a53e40f8bc3a8057f905d6f57dc306aa2cda39feee298ed070c4d1", + "route_weight_sha256": "22cc3dfa5136ac6be976c2aa686449c64435bb54790fc020210a40f548d97769", + "loads": [ + 0, + 2, + 0, + 3, + 4, + 0, + 3, + 2, + 0, + 2, + 0, + 0, + 0, + 0, + 4, + 2, + 2, + 4, + 2, + 2, + 0, + 0, + 0, + 3, + 3, + 4, + 3, + 1, + 1, + 10, + 4, + 5, + 6, + 10, + 3, + 0, + 0, + 1, + 3, + 1, + 3, + 0, + 0, + 3, + 0, + 2, + 2, + 3, + 0, + 3, + 0, + 0, + 5, + 2, + 3, + 0, + 2, + 1, + 1, + 3, + 9, + 5, + 4, + 3 + ], + "weighted_loads": [ + 0.0, + 0.07333816960453987, + 0.0, + 0.2684199810028076, + 0.20656534656882286, + 0.0, + 0.20081347599625587, + 0.09900042787194252, + 0.0, + 0.12289613857865334, + 0.0, + 0.0, + 0.0, + 0.0, + 0.20194182731211185, + 0.14832621067762375, + 0.05636756680905819, + 0.35966792702674866, + 0.07857362367212772, + 0.12086686864495277, + 0.0, + 0.0, + 0.0, + 0.19049066305160522, + 0.14029865711927414, + 0.2996343821287155, + 0.11974337138235569, + 0.022644376382231712, + 0.04663211107254028, + 0.5766973309218884, + 0.16055623069405556, + 0.33121689409017563, + 0.23821686953306198, + 1.5213195905089378, + 0.12449228391051292, + 0.0, + 0.0, + 0.043936725705862045, + 0.17771290615200996, + 0.0865175649523735, + 0.15871967002749443, + 0.0, + 0.0, + 0.1500311978161335, + 0.0, + 0.09357680007815361, + 0.1284080296754837, + 0.13083282858133316, + 0.0, + 0.15896659344434738, + 0.0, + 0.0, + 0.4375746324658394, + 0.06060344725847244, + 0.10576106421649456, + 0.0, + 0.10802645608782768, + 0.05370248109102249, + 0.02866940014064312, + 0.24061224795877934, + 0.5296124219894409, + 0.484060600399971, + 0.3566315323114395, + 0.20183167979121208 + ], + "unique_experts": 44, + "load_cv": 1.0243938285880985, + "normalized_load_entropy": 0.8687432775914804, + "max_load_share": 0.06944444444444445 + }, + "full_input": { + "tokens": 49, + "top_k": 6, + "decisions": 294, + "ordered_route_sha256": "6aaaff5b41fab34f336b8574586501a50c981862ff4e95cf03e16529f329febf", + "route_weight_sha256": "36bcb73f7ff4a4bf3ddfc2db9eca5e97ebc3d37ff222665e154a7a7fa1a1d096", + "loads": [ + 0, + 2, + 0, + 3, + 4, + 10, + 7, + 2, + 0, + 5, + 4, + 0, + 0, + 1, + 4, + 10, + 13, + 8, + 7, + 4, + 11, + 2, + 2, + 3, + 10, + 4, + 7, + 1, + 1, + 10, + 7, + 5, + 7, + 17, + 3, + 0, + 0, + 10, + 3, + 1, + 6, + 8, + 0, + 4, + 3, + 3, + 2, + 3, + 0, + 3, + 0, + 2, + 5, + 13, + 3, + 10, + 2, + 1, + 1, + 3, + 12, + 8, + 4, + 10 + ], + "weighted_loads": [ + 0.0, + 0.07333816960453987, + 0.0, + 0.2684199810028076, + 0.20656534656882286, + 0.9181861393153667, + 0.36970584467053413, + 0.09900042787194252, + 0.0, + 1.517988134175539, + 0.2129570133984089, + 0.0, + 0.0, + 0.019096260890364647, + 0.20194182731211185, + 1.0962980277836323, + 0.680699186399579, + 0.6288505550473928, + 0.6545222699642181, + 0.16378322732634842, + 0.9659245479851961, + 0.07980341836810112, + 0.11914385110139847, + 0.19049066305160522, + 0.7287703491747379, + 0.2996343821287155, + 0.3596269078552723, + 0.022644376382231712, + 0.04663211107254028, + 0.5766973309218884, + 0.29893275536596775, + 0.33121689409017563, + 0.2779003083705902, + 1.8392969882115722, + 0.12449228391051292, + 0.0, + 0.0, + 0.5068656541407108, + 0.17771290615200996, + 0.0865175649523735, + 0.29910796508193016, + 1.3013374879956245, + 0.0, + 0.1909368485212326, + 0.12739337980747223, + 0.16033980622887611, + 0.1284080296754837, + 0.13083282858133316, + 0.0, + 0.15896659344434738, + 0.0, + 0.1045909933745861, + 0.4375746324658394, + 0.8322575185447931, + 0.10576106421649456, + 0.7920323982834816, + 0.10802645608782768, + 0.05370248109102249, + 0.02866940014064312, + 0.24061224795877934, + 0.7291537187993526, + 0.633855735999532, + 0.3566315323114395, + 0.5533530069515109 + ], + "unique_experts": 54, + "load_cv": 0.8713592669473139, + "normalized_load_entropy": 0.9032041441223919, + "max_load_share": 0.05782312925170068 + } + }, + "s1_eos": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "21ce1c68359238b4f573e44d5914729b2c13c405342192347fc95bf3eb5707cb", + "route_weight_sha256": "d7d10c8d8a85d2ba129caa67f719a45e4964b6047dd846257f5b824572cd058b", + "loads": [ + 0, + 2, + 0, + 3, + 4, + 0, + 3, + 2, + 0, + 2, + 0, + 0, + 0, + 0, + 3, + 1, + 2, + 4, + 2, + 2, + 0, + 0, + 0, + 3, + 3, + 4, + 3, + 1, + 1, + 8, + 4, + 5, + 7, + 10, + 4, + 0, + 0, + 1, + 3, + 1, + 3, + 1, + 0, + 3, + 0, + 2, + 2, + 3, + 0, + 3, + 0, + 0, + 6, + 2, + 3, + 0, + 2, + 1, + 1, + 3, + 9, + 5, + 4, + 3 + ], + "weighted_loads": [ + 0.0, + 0.07519107311964035, + 0.0, + 0.2598178833723068, + 0.20173638686537743, + 0.0, + 0.19998369365930557, + 0.10108792036771774, + 0.0, + 0.12182256951928139, + 0.0, + 0.0, + 0.0, + 0.0, + 0.15930583700537682, + 0.09907501935958862, + 0.05615610256791115, + 0.3404550813138485, + 0.07318359427154064, + 0.11846283823251724, + 0.0, + 0.0, + 0.0, + 0.19467732310295105, + 0.14582416415214539, + 0.29240042343735695, + 0.12067070975899696, + 0.025211624801158905, + 0.04476379603147507, + 0.5090833529829979, + 0.1656980738043785, + 0.3219594731926918, + 0.27898941189050674, + 1.5414340645074844, + 0.15683711506426334, + 0.0, + 0.0, + 0.04166514798998833, + 0.185203168541193, + 0.08892977982759476, + 0.1477141659706831, + 0.03635060414671898, + 0.0, + 0.15046263113617897, + 0.0, + 0.0930115170776844, + 0.11963465437293053, + 0.1302820537239313, + 0.0, + 0.15516111999750137, + 0.0, + 0.0, + 0.4801134802401066, + 0.0587113406509161, + 0.10408671945333481, + 0.0, + 0.11040948331356049, + 0.05419968441128731, + 0.03034045360982418, + 0.24093356356024742, + 0.5302967820316553, + 0.47257205843925476, + 0.36303000897169113, + 0.20448702946305275 + ], + "unique_experts": 45, + "load_cv": 1.003081671403766, + "normalized_load_entropy": 0.8724208666758637, + "max_load_share": 0.06944444444444445 + }, + "full_input": { + "tokens": 65, + "top_k": 6, + "decisions": 390, + "ordered_route_sha256": "40ab3a9e26f15b6b26dfd112bfbf06caca77c6ef5e665dd662580748ccb5e98a", + "route_weight_sha256": "3f1067d374791146cdc831ef3e609906099c829c735904fefcc9024aec38704d", + "loads": [ + 0, + 5, + 0, + 5, + 4, + 10, + 8, + 3, + 0, + 6, + 6, + 2, + 0, + 4, + 4, + 13, + 13, + 15, + 9, + 4, + 11, + 2, + 2, + 4, + 18, + 4, + 13, + 1, + 1, + 8, + 8, + 5, + 12, + 15, + 5, + 2, + 0, + 9, + 5, + 4, + 7, + 16, + 1, + 6, + 3, + 7, + 3, + 9, + 3, + 6, + 6, + 1, + 6, + 14, + 3, + 11, + 4, + 1, + 1, + 5, + 13, + 7, + 7, + 10 + ], + "weighted_loads": [ + 0.0, + 0.19553158804774284, + 0.0, + 0.3501344248652458, + 0.20173638686537743, + 0.9578990712761879, + 0.44782015681266785, + 0.1264396347105503, + 0.0, + 1.5215661562979221, + 0.2132504116743803, + 0.06187283992767334, + 0.0, + 0.12302054464817047, + 0.2079591490328312, + 1.5326129719614983, + 0.5771622122265399, + 1.086219646036625, + 0.8525260556489229, + 0.1564316162839532, + 0.9106930829584599, + 0.0903930813074112, + 0.0862000621855259, + 0.2699955478310585, + 1.3293623216450214, + 0.29240042343735695, + 1.2941461820155382, + 0.025211624801158905, + 0.04476379603147507, + 0.5090833529829979, + 0.3231976944953203, + 0.3219594731926918, + 0.49957755021750927, + 1.7484056884422898, + 0.19290201552212238, + 0.11895396932959557, + 0.0, + 0.48693692311644554, + 0.30763931944966316, + 0.26481275260448456, + 0.3133482839912176, + 2.3691933564841747, + 0.0370611771941185, + 0.2844715751707554, + 0.10360813327133656, + 0.32841144129633904, + 0.14978608675301075, + 0.4269255232065916, + 0.1204471830278635, + 0.31363701820373535, + 0.25821826234459877, + 0.043011922389268875, + 0.4801134802401066, + 1.135709224268794, + 0.10408671945333481, + 0.962646346539259, + 0.21772542968392372, + 0.05419968441128731, + 0.03034045360982418, + 0.469193359836936, + 0.7140577118843794, + 0.5728543843142688, + 0.6963726095855236, + 0.570814554579556 + ], + "unique_experts": 59, + "load_cv": 0.7405774529646303, + "normalized_load_entropy": 0.9293235766921413, + "max_load_share": 0.046153846153846156 + } + }, + "s0_bos": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "fc8b1cfae2c5d4fc25b4e67f175e8c7e7c7b8a628b7586414eb95c37204937b6", + "route_weight_sha256": "db0fc530b0b0bbe6ce7fd11b95ab8295a822dba657c42436acd62110edaf1c24", + "loads": [ + 0, + 2, + 0, + 3, + 3, + 0, + 4, + 2, + 0, + 1, + 0, + 0, + 0, + 1, + 4, + 2, + 2, + 4, + 3, + 2, + 0, + 0, + 0, + 4, + 2, + 4, + 2, + 1, + 1, + 9, + 4, + 5, + 6, + 10, + 3, + 0, + 0, + 1, + 3, + 1, + 3, + 0, + 0, + 3, + 0, + 2, + 2, + 2, + 0, + 4, + 1, + 0, + 9, + 2, + 2, + 0, + 2, + 1, + 0, + 2, + 8, + 5, + 4, + 3 + ], + "weighted_loads": [ + 0.0, + 0.07143350318074226, + 0.0, + 0.2737310864031315, + 0.16404293105006218, + 0.0, + 0.24632498249411583, + 0.10612067580223083, + 0.0, + 0.07564771920442581, + 0.0, + 0.0, + 0.0, + 0.03161735087633133, + 0.19263744167983532, + 0.1189550906419754, + 0.05440866760909557, + 0.3578459955751896, + 0.10049308277666569, + 0.12143712118268013, + 0.0, + 0.0, + 0.0, + 0.25145306810736656, + 0.10429268330335617, + 0.3123476468026638, + 0.10273783653974533, + 0.023944834247231483, + 0.04387807846069336, + 0.5205608047544956, + 0.15794415771961212, + 0.3346277065575123, + 0.22840275056660175, + 1.5037188399583101, + 0.13203428871929646, + 0.0, + 0.0, + 0.044530969113111496, + 0.18232116475701332, + 0.08018174022436142, + 0.15395500138401985, + 0.0, + 0.0, + 0.1517365165054798, + 0.0, + 0.09366106986999512, + 0.12911731004714966, + 0.11104616895318031, + 0.0, + 0.17929470352828503, + 0.029726127162575722, + 0.0, + 0.5857505910098553, + 0.054496316239237785, + 0.07486969605088234, + 0.0, + 0.11382472142577171, + 0.050526224076747894, + 0.0, + 0.2388075292110443, + 0.47155328653752804, + 0.48018674552440643, + 0.3746112585067749, + 0.19212313368916512 + ], + "unique_experts": 45, + "load_cv": 1.0423146132940955, + "normalized_load_entropy": 0.8673878625721637, + "max_load_share": 0.06944444444444445 + }, + "full_input": { + "tokens": 49, + "top_k": 6, + "decisions": 294, + "ordered_route_sha256": "8e91365dd785d50d7b1542ab0d508da6e5624ef9f6a095e73caff43f457f85ea", + "route_weight_sha256": "64259a54fa984b207d5c9e0e4cd4adf943a5447d1e03f7986a57042cdeb553a3", + "loads": [ + 0, + 2, + 1, + 3, + 3, + 11, + 8, + 2, + 0, + 4, + 4, + 0, + 1, + 3, + 4, + 10, + 12, + 8, + 9, + 4, + 11, + 2, + 2, + 4, + 8, + 4, + 6, + 1, + 1, + 9, + 6, + 5, + 7, + 15, + 4, + 0, + 0, + 9, + 3, + 1, + 6, + 9, + 0, + 3, + 4, + 3, + 2, + 2, + 0, + 5, + 2, + 2, + 9, + 13, + 2, + 10, + 2, + 1, + 0, + 2, + 10, + 8, + 4, + 8 + ], + "weighted_loads": [ + 0.0, + 0.07143350318074226, + 0.03803177550435066, + 0.2737310864031315, + 0.16404293105006218, + 0.9814961161464453, + 0.4152173511683941, + 0.10612067580223083, + 0.0, + 0.5340007022023201, + 0.20458044297993183, + 0.0, + 0.07533839344978333, + 0.0914220679551363, + 0.19263744167983532, + 0.9825585037469864, + 1.0625086445361376, + 0.6147257182747126, + 0.6760899350047112, + 0.19237800315022469, + 0.9659245479851961, + 0.07980341836810112, + 0.11914385110139847, + 0.25145306810736656, + 0.6537117473781109, + 0.3123476468026638, + 0.3232061844319105, + 0.023944834247231483, + 0.04387807846069336, + 0.5205608047544956, + 0.2512353826314211, + 0.3346277065575123, + 0.26808618940413, + 1.7774916887283325, + 0.2520445231348276, + 0.0, + 0.0, + 0.4823648426681757, + 0.18232116475701332, + 0.08018174022436142, + 0.29546353593468666, + 1.3727478366345167, + 0.0, + 0.1517365165054798, + 0.15729940310120583, + 0.16042407602071762, + 0.12911731004714966, + 0.11104616895318031, + 0.0, + 0.22333735786378384, + 0.07403657399117947, + 0.1045909933745861, + 0.5857505910098553, + 0.8261503875255585, + 0.07486969605088234, + 0.7920323982834816, + 0.11382472142577171, + 0.050526224076747894, + 0.0, + 0.2388075292110443, + 0.6011775080114603, + 0.6560615003108978, + 0.3746112585067749, + 0.5168135333806276 + ], + "unique_experts": 56, + "load_cv": 0.8205954141516317, + "normalized_load_entropy": 0.913057633306401, + "max_load_share": 0.05102040816326531 + } + }, + "s1_bos": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "e2ffa3becc210ca2ee1ae0c9fda11de8c66fb75ef4086450669429f851955c8f", + "route_weight_sha256": "1c31afa3a4fcc282a6b35f83ca1f2edc228c2c8411b635adf475380d0d1bf3e3", + "loads": [ + 0, + 2, + 0, + 3, + 4, + 0, + 3, + 2, + 0, + 1, + 0, + 0, + 0, + 0, + 4, + 1, + 2, + 4, + 2, + 3, + 0, + 0, + 0, + 4, + 2, + 4, + 2, + 0, + 1, + 9, + 4, + 5, + 7, + 10, + 3, + 0, + 0, + 1, + 3, + 1, + 2, + 1, + 0, + 3, + 0, + 2, + 2, + 3, + 0, + 4, + 1, + 0, + 8, + 3, + 3, + 0, + 2, + 1, + 0, + 3, + 7, + 5, + 4, + 3 + ], + "weighted_loads": [ + 0.0, + 0.07331104949116707, + 0.0, + 0.26341310888528824, + 0.1915171518921852, + 0.0, + 0.20073314756155014, + 0.10959092527627945, + 0.0, + 0.07408808916807175, + 0.0, + 0.0, + 0.0, + 0.0, + 0.2009243108332157, + 0.0725531205534935, + 0.05373582988977432, + 0.3386686444282532, + 0.07649898156523705, + 0.14750324562191963, + 0.0, + 0.0, + 0.0, + 0.25797129049897194, + 0.10776134580373764, + 0.30971478670835495, + 0.10359758138656616, + 0.0, + 0.04261927306652069, + 0.5454401075839996, + 0.1648733764886856, + 0.33545341715216637, + 0.25535932555794716, + 1.594167497009039, + 0.12816824950277805, + 0.0, + 0.0, + 0.04291771724820137, + 0.19234680384397507, + 0.08847659826278687, + 0.11917736381292343, + 0.035464026033878326, + 0.0, + 0.1456168219447136, + 0.0, + 0.09325415268540382, + 0.12191983312368393, + 0.1344360951334238, + 0.0, + 0.1774813625961542, + 0.027620738372206688, + 0.0, + 0.53690579906106, + 0.08631054311990738, + 0.10544601269066334, + 0.0, + 0.1153055764734745, + 0.05473068356513977, + 0.0, + 0.24707251321524382, + 0.44445931166410446, + 0.4465689957141876, + 0.3831166550517082, + 0.18891886249184608 + ], + "unique_experts": 44, + "load_cv": 1.0304020550550783, + "normalized_load_entropy": 0.8656187290096764, + "max_load_share": 0.06944444444444445 + }, + "full_input": { + "tokens": 65, + "top_k": 6, + "decisions": 390, + "ordered_route_sha256": "ec163beaf036a09a594a7105aebb18760e3a5ff5492f8024a2bc0b9706c80713", + "route_weight_sha256": "ec25d33d7953e3fa65f0f507f339b92540e6c65ff12451b284435e2aa776e579", + "loads": [ + 0, + 5, + 0, + 5, + 4, + 10, + 8, + 3, + 0, + 5, + 5, + 2, + 0, + 4, + 5, + 13, + 13, + 15, + 10, + 3, + 11, + 2, + 2, + 5, + 15, + 4, + 12, + 0, + 1, + 9, + 8, + 5, + 12, + 17, + 5, + 2, + 0, + 10, + 5, + 4, + 6, + 17, + 1, + 5, + 5, + 7, + 3, + 9, + 3, + 7, + 7, + 1, + 8, + 15, + 3, + 11, + 4, + 1, + 0, + 4, + 12, + 6, + 7, + 9 + ], + "weighted_loads": [ + 0.0, + 0.19365156441926956, + 0.0, + 0.35372965037822723, + 0.1915171518921852, + 0.9726442601531744, + 0.4485696107149124, + 0.13494263961911201, + 0.0, + 0.5692866630852222, + 0.18015013821423054, + 0.06187283992767334, + 0.0, + 0.12302054464817047, + 0.2495776228606701, + 1.477122064679861, + 0.9973375871777534, + 1.0649753287434578, + 0.8957715556025505, + 0.14750324562191963, + 0.9106930829584599, + 0.0903930813074112, + 0.0862000621855259, + 0.3332895152270794, + 1.196709781885147, + 0.30971478670835495, + 1.2717166598886251, + 0.0, + 0.04261927306652069, + 0.5454401075839996, + 0.3223729971796274, + 0.33545341715216637, + 0.4759474638849497, + 1.9037714935839176, + 0.20826544798910618, + 0.11895396932959557, + 0.0, + 0.5271447636187077, + 0.3147829547524452, + 0.26435957103967667, + 0.2898200936615467, + 2.496936686336994, + 0.0370611771941185, + 0.2367323637008667, + 0.18257435597479343, + 0.32865407690405846, + 0.15207126550376415, + 0.4310795646160841, + 0.1204471830278635, + 0.3359572608023882, + 0.2920094709843397, + 0.043011922389268875, + 0.53690579906106, + 1.1633084267377853, + 0.10544601269066334, + 0.962646346539259, + 0.22262152284383774, + 0.05473068356513977, + 0.0, + 0.45213989447802305, + 0.6844451874494553, + 0.533913291990757, + 0.7164592556655407, + 0.5487536136060953 + ], + "unique_experts": 57, + "load_cv": 0.7473644246075457, + "normalized_load_entropy": 0.9257887359864746, + "max_load_share": 0.04358974358974359 + } + }, + "s0_x": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "bad12393a52785a6e6d6c60528315c5cce91d9fca5311d271a827c124c14d122", + "route_weight_sha256": "378d284ae5b891b48c0d4941bdb5761ef1db79feb4cdbeb276cbae39e9442abd", + "loads": [ + 0, + 2, + 0, + 3, + 4, + 0, + 4, + 2, + 0, + 2, + 0, + 0, + 0, + 0, + 4, + 3, + 1, + 4, + 3, + 2, + 0, + 0, + 0, + 4, + 3, + 4, + 2, + 0, + 1, + 8, + 3, + 5, + 6, + 9, + 3, + 0, + 0, + 1, + 3, + 1, + 1, + 1, + 0, + 3, + 0, + 4, + 2, + 3, + 0, + 4, + 1, + 1, + 7, + 2, + 3, + 0, + 2, + 1, + 1, + 2, + 6, + 5, + 4, + 4 + ], + "weighted_loads": [ + 0.0, + 0.07139559090137482, + 0.0, + 0.2687230668962002, + 0.2012106142938137, + 0.0, + 0.24294792115688324, + 0.10639295354485512, + 0.0, + 0.12235474959015846, + 0.0, + 0.0, + 0.0, + 0.0, + 0.20279504917562008, + 0.16577325575053692, + 0.02350236102938652, + 0.36908983439207077, + 0.10657721571624279, + 0.12779681757092476, + 0.0, + 0.0, + 0.0, + 0.25488215684890747, + 0.16229048743844032, + 0.30844317749142647, + 0.10460639372467995, + 0.0, + 0.04651768505573273, + 0.5010214876383543, + 0.10696701891720295, + 0.3414447121322155, + 0.22604592703282833, + 1.4151139482855797, + 0.11916550621390343, + 0.0, + 0.0, + 0.041990041732788086, + 0.1932610273361206, + 0.07952278107404709, + 0.07625836133956909, + 0.03795314207673073, + 0.0, + 0.16499988734722137, + 0.0, + 0.1469851452857256, + 0.12548968195915222, + 0.13298963010311127, + 0.0, + 0.17872530594468117, + 0.028534766286611557, + 0.01650002971291542, + 0.48866873420774937, + 0.05539616011083126, + 0.11096394620835781, + 0.0, + 0.11204522103071213, + 0.04779041185975075, + 0.028540566563606262, + 0.2270050123333931, + 0.4224310927093029, + 0.4541979767382145, + 0.37242238223552704, + 0.23160366714000702 + ], + "unique_experts": 46, + "load_cv": 0.9428090415820632, + "normalized_load_entropy": 0.880209125880957, + "max_load_share": 0.0625 + }, + "full_input": { + "tokens": 49, + "top_k": 6, + "decisions": 294, + "ordered_route_sha256": "0f008f45c697b896cfe5b26f0b5ac0ad062309c0c47e9f3a5cac10a4f3595461", + "route_weight_sha256": "6fc5085c98555665258818e36518c66b1988efd4ce21948817651fa4cde98bc2", + "loads": [ + 0, + 2, + 0, + 3, + 4, + 11, + 8, + 2, + 0, + 3, + 4, + 0, + 0, + 1, + 4, + 11, + 9, + 10, + 8, + 3, + 12, + 3, + 3, + 4, + 11, + 4, + 7, + 0, + 1, + 8, + 6, + 5, + 8, + 13, + 3, + 0, + 0, + 10, + 3, + 1, + 4, + 9, + 1, + 3, + 2, + 5, + 2, + 3, + 0, + 4, + 2, + 3, + 7, + 14, + 3, + 11, + 2, + 1, + 1, + 2, + 9, + 7, + 4, + 10 + ], + "weighted_loads": [ + 0.0, + 0.07139559090137482, + 0.0, + 0.2687230668962002, + 0.2012106142938137, + 0.917860109359026, + 0.4118402898311615, + 0.10639295354485512, + 0.0, + 0.5005561448633671, + 0.20095779560506344, + 0.0, + 0.0, + 0.019096260890364647, + 0.20279504917562008, + 1.0860763397067785, + 0.41699399799108505, + 0.6951332986354828, + 0.7542968951165676, + 0.16824820637702942, + 1.213351147249341, + 0.11479412019252777, + 0.14783950336277485, + 0.25488215684890747, + 0.879436194896698, + 0.30844317749142647, + 0.3672211077064276, + 0.0, + 0.04651768505573273, + 0.5010214876383543, + 0.2474987581372261, + 0.3414447121322155, + 0.3378014098852873, + 1.632430611178279, + 0.11916550621390343, + 0.0, + 0.0, + 0.5135817471891642, + 0.1932610273361206, + 0.07952278107404709, + 0.23871256038546562, + 1.3692797496914864, + 0.028688624501228333, + 0.16499988734722137, + 0.0908498503267765, + 0.2137481514364481, + 0.12548968195915222, + 0.13298963010311127, + 0.0, + 0.17872530594468117, + 0.06487417966127396, + 0.12109102308750153, + 0.48866873420774937, + 0.9562153145670891, + 0.11096394620835781, + 0.905224971473217, + 0.11204522103071213, + 0.04779041185975075, + 0.028540566563606262, + 0.2270050123333931, + 0.6225743070244789, + 0.5814955718815327, + 0.37242238223552704, + 0.6201337706297636 + ], + "unique_experts": 55, + "load_cv": 0.8322427960858646, + "normalized_load_entropy": 0.9097660732328707, + "max_load_share": 0.047619047619047616 + } + }, + "s1_x": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "c900abb6afe00358b9015793e423fb39219898a165716af7cf9087139b8730aa", + "route_weight_sha256": "dfdcee542c3dd8822ec70bdf081f7861c502e8cc034284a336d2c9ccf14ca093", + "loads": [ + 0, + 3, + 0, + 3, + 2, + 0, + 3, + 2, + 0, + 1, + 0, + 0, + 0, + 0, + 4, + 2, + 1, + 4, + 1, + 2, + 0, + 0, + 0, + 5, + 5, + 4, + 3, + 1, + 1, + 11, + 3, + 5, + 5, + 9, + 3, + 0, + 0, + 1, + 3, + 1, + 5, + 1, + 0, + 2, + 0, + 2, + 2, + 2, + 1, + 4, + 0, + 0, + 8, + 2, + 2, + 0, + 2, + 1, + 1, + 2, + 6, + 5, + 4, + 4 + ], + "weighted_loads": [ + 0.0, + 0.10890928283333778, + 0.0, + 0.2797914445400238, + 0.10493172705173492, + 0.0, + 0.19497401267290115, + 0.11471916362643242, + 0.0, + 0.07158306986093521, + 0.0, + 0.0, + 0.0, + 0.0, + 0.19421308673918247, + 0.12439479678869247, + 0.025340881198644638, + 0.33129749074578285, + 0.04910683631896973, + 0.12549594417214394, + 0.0, + 0.0, + 0.0, + 0.2997056357562542, + 0.24986550584435463, + 0.3067316934466362, + 0.11516924574971199, + 0.040648724883794785, + 0.047803860157728195, + 0.6270166896283627, + 0.12242520228028297, + 0.32622792199254036, + 0.19412049278616905, + 1.3919695410877466, + 0.12666073068976402, + 0.0, + 0.0, + 0.037483640015125275, + 0.20589256659150124, + 0.0887070819735527, + 0.21494542621076107, + 0.05394718050956726, + 0.0, + 0.11760987713932991, + 0.0, + 0.09319296106696129, + 0.11145161092281342, + 0.07374497875571251, + 0.03006470575928688, + 0.17432991042733192, + 0.0, + 0.0, + 0.5481756441295147, + 0.05252157896757126, + 0.07921164855360985, + 0.0, + 0.11457020789384842, + 0.048532988876104355, + 0.030277850106358528, + 0.22904162108898163, + 0.420288885012269, + 0.4348887763917446, + 0.3754331022500992, + 0.2283722572028637 + ], + "unique_experts": 46, + "load_cv": 1.0333930687632376, + "normalized_load_entropy": 0.8697156215551041, + "max_load_share": 0.0763888888888889 + }, + "full_input": { + "tokens": 65, + "top_k": 6, + "decisions": 390, + "ordered_route_sha256": "8022dfe22b2e489e04159aa0a2127bcc8f902ba5ce644f6f958a19ece42f36cd", + "route_weight_sha256": "10038043e4e57272ddf1ea6bd759490063c42dfac9047defda3f1a98848fabe4", + "loads": [ + 0, + 6, + 0, + 5, + 2, + 10, + 8, + 3, + 0, + 3, + 7, + 2, + 0, + 4, + 5, + 14, + 10, + 16, + 8, + 2, + 14, + 3, + 3, + 6, + 20, + 4, + 12, + 1, + 1, + 11, + 7, + 5, + 11, + 12, + 4, + 2, + 0, + 10, + 6, + 4, + 9, + 16, + 1, + 4, + 2, + 7, + 3, + 8, + 5, + 7, + 6, + 1, + 8, + 15, + 2, + 12, + 4, + 2, + 1, + 4, + 10, + 6, + 7, + 9 + ], + "weighted_loads": [ + 0.0, + 0.22924979776144028, + 0.0, + 0.3701079860329628, + 0.10493172705173492, + 0.9202040452510118, + 0.4428104758262634, + 0.14007087796926498, + 0.0, + 0.48469555750489235, + 0.2264934442937374, + 0.06187283992767334, + 0.0, + 0.12302054464817047, + 0.24286639876663685, + 1.4508188292384148, + 0.3496287018060684, + 1.1062522195279598, + 0.845156591385603, + 0.12549594417214394, + 1.2849253229796886, + 0.12699320539832115, + 0.11887017264962196, + 0.37502386048436165, + 1.657051209360361, + 0.3067316934466362, + 1.218670992180705, + 0.040648724883794785, + 0.047803860157728195, + 0.6270166896283627, + 0.2799248229712248, + 0.32622792199254036, + 0.4794735927134752, + 1.5300864689052105, + 0.16272563114762306, + 0.11895396932959557, + 0.0, + 0.5157568119466305, + 0.3519821707159281, + 0.2645900547504425, + 0.4125421363860369, + 2.2633607275784016, + 0.0370611771941185, + 0.20872541889548302, + 0.06787786073982716, + 0.3285928852856159, + 0.14160304330289364, + 0.3703884482383728, + 0.18117618560791016, + 0.3328058086335659, + 0.24980611726641655, + 0.043011922389268875, + 0.5481756441295147, + 1.2253810316324234, + 0.07921164855360985, + 1.0963217876851559, + 0.22188615426421165, + 0.10611936450004578, + 0.030277850106358528, + 0.4535786285996437, + 0.5888883639127016, + 0.5191198252141476, + 0.7087757028639317, + 0.5493992548435926 + ], + "unique_experts": 59, + "load_cv": 0.7563189862362877, + "normalized_load_entropy": 0.9273887810056439, + "max_load_share": 0.05128205128205128 + } + }, + "s0_period": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "850e682074202cc2067b591d572af834cdcee495c7509954a628626053a403e2", + "route_weight_sha256": "db80dfa1ec05063d00169cd5cddf00e3cc22556ffcce076cd2ab6662e4b54b71", + "loads": [ + 0, + 2, + 0, + 3, + 3, + 0, + 5, + 2, + 0, + 2, + 0, + 0, + 0, + 0, + 5, + 2, + 2, + 4, + 3, + 2, + 0, + 0, + 0, + 4, + 3, + 4, + 2, + 0, + 1, + 8, + 3, + 5, + 6, + 9, + 3, + 0, + 0, + 1, + 3, + 1, + 1, + 1, + 0, + 3, + 0, + 3, + 2, + 3, + 0, + 4, + 1, + 0, + 8, + 2, + 2, + 0, + 2, + 1, + 1, + 2, + 7, + 5, + 4, + 4 + ], + "weighted_loads": [ + 0.0, + 0.07319269329309464, + 0.0, + 0.2767619416117668, + 0.163086649030447, + 0.0, + 0.29868585616350174, + 0.11142650619149208, + 0.0, + 0.12085796892642975, + 0.0, + 0.0, + 0.0, + 0.0, + 0.23535727709531784, + 0.1330062933266163, + 0.05498996376991272, + 0.38811633735895157, + 0.10598016157746315, + 0.13548900932073593, + 0.0, + 0.0, + 0.0, + 0.24299705028533936, + 0.16026896610856056, + 0.31985796242952347, + 0.1100015938282013, + 0.0, + 0.04745451733469963, + 0.5026558600366116, + 0.10813834704458714, + 0.3366861492395401, + 0.22734056785702705, + 1.3989352770149708, + 0.1275257244706154, + 0.0, + 0.0, + 0.04051864519715309, + 0.18754439428448677, + 0.08002177625894547, + 0.0808880478143692, + 0.03648628666996956, + 0.0, + 0.16157086566090584, + 0.0, + 0.12066228874027729, + 0.13695792108774185, + 0.13276750594377518, + 0.0, + 0.17091272585093975, + 0.027506215497851372, + 0.0, + 0.5326315239071846, + 0.05540050193667412, + 0.08045083284378052, + 0.0, + 0.11377974599599838, + 0.048910848796367645, + 0.03193126618862152, + 0.2243191823363304, + 0.42360774986445904, + 0.44311853870749474, + 0.37511785328388214, + 0.22681278735399246 + ], + "unique_experts": 45, + "load_cv": 0.9813067629253164, + "normalized_load_entropy": 0.873600901408102, + "max_load_share": 0.0625 + }, + "full_input": { + "tokens": 49, + "top_k": 6, + "decisions": 294, + "ordered_route_sha256": "2f9dd494ee41702813f3aa76befb018c2e5b5d2447f4babe2742f872bbbdbaa2", + "route_weight_sha256": "1b3c69f5edf046b96330a0eadfbf56dd8bc9ca71b867aab379eab67352347108", + "loads": [ + 0, + 2, + 0, + 3, + 3, + 13, + 9, + 2, + 0, + 3, + 4, + 1, + 0, + 1, + 5, + 10, + 11, + 10, + 8, + 3, + 13, + 2, + 3, + 4, + 11, + 4, + 7, + 0, + 1, + 8, + 6, + 5, + 7, + 13, + 3, + 0, + 0, + 9, + 3, + 1, + 4, + 9, + 0, + 3, + 3, + 4, + 2, + 4, + 0, + 4, + 1, + 2, + 8, + 13, + 2, + 11, + 2, + 1, + 1, + 2, + 10, + 7, + 4, + 9 + ], + "weighted_loads": [ + 0.0, + 0.07319269329309464, + 0.0, + 0.2767619416117668, + 0.163086649030447, + 0.9972199518233538, + 0.46757822483778, + 0.11142650619149208, + 0.0, + 0.49905936419963837, + 0.22356315329670906, + 0.028678137809038162, + 0.0, + 0.019096260890364647, + 0.23535727709531784, + 1.0750514641404152, + 0.5560283344238997, + 0.8350333105772734, + 0.7049889955669641, + 0.1759403981268406, + 1.0906001050025225, + 0.07980341836810112, + 0.16167659685015678, + 0.24299705028533936, + 0.8982784617692232, + 0.31985796242952347, + 0.40909205190837383, + 0.0, + 0.04745451733469963, + 0.5026558600366116, + 0.2642774321138859, + 0.3366861492395401, + 0.2670240066945553, + 1.611636446788907, + 0.1275257244706154, + 0.0, + 0.0, + 0.4783525187522173, + 0.18754439428448677, + 0.08002177625894547, + 0.24596450105309486, + 1.3572322763502598, + 0.0, + 0.16157086566090584, + 0.13493116199970245, + 0.1874252948909998, + 0.13695792108774185, + 0.18027464300394058, + 0.0, + 0.17091272585093975, + 0.027506215497851372, + 0.1045909933745861, + 0.5326315239071846, + 0.8270545732229948, + 0.08045083284378052, + 0.8533590659499168, + 0.11377974599599838, + 0.048910848796367645, + 0.03193126618862152, + 0.2243191823363304, + 0.6059140842407942, + 0.5611725710332394, + 0.37511785328388214, + 0.5647750776261091 + ], + "unique_experts": 55, + "load_cv": 0.8541953424143992, + "normalized_load_entropy": 0.9058202499371304, + "max_load_share": 0.04421768707482993 + } + }, + "s1_period": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "ac1b39164cdf9d4d673a90f32087fecc897232078b2bc7e7bf4afcb682d2bf12", + "route_weight_sha256": "66dc160c0447f00f6f20e0d7456ac4bb69810a0007b7b21ce151d95f0c984476", + "loads": [ + 0, + 3, + 0, + 3, + 3, + 0, + 5, + 2, + 0, + 1, + 0, + 0, + 0, + 0, + 4, + 2, + 1, + 4, + 2, + 2, + 0, + 0, + 0, + 4, + 5, + 4, + 3, + 1, + 1, + 11, + 3, + 5, + 5, + 9, + 3, + 0, + 0, + 1, + 3, + 1, + 3, + 1, + 0, + 2, + 0, + 2, + 2, + 2, + 0, + 4, + 0, + 0, + 9, + 2, + 2, + 0, + 2, + 1, + 1, + 2, + 5, + 5, + 4, + 4 + ], + "weighted_loads": [ + 0.0, + 0.11010032519698143, + 0.0, + 0.2661643549799919, + 0.14326747506856918, + 0.0, + 0.2768968343734741, + 0.11944950371980667, + 0.0, + 0.0761970654129982, + 0.0, + 0.0, + 0.0, + 0.0, + 0.19748834148049355, + 0.10917646437883377, + 0.025260278955101967, + 0.3432389572262764, + 0.06613399274647236, + 0.12947792559862137, + 0.0, + 0.0, + 0.0, + 0.25863173976540565, + 0.24456781148910522, + 0.3129906989634037, + 0.11928119882941246, + 0.041828956454992294, + 0.04878346621990204, + 0.6269586756825447, + 0.12363389134407043, + 0.3256182335317135, + 0.20061296969652176, + 1.3430120795965195, + 0.12971944734454155, + 0.0, + 0.0, + 0.03664875403046608, + 0.2082637958228588, + 0.08811140060424805, + 0.14097217656672, + 0.04992874711751938, + 0.0, + 0.11017219722270966, + 0.0, + 0.09559249132871628, + 0.1128888837993145, + 0.07544233277440071, + 0.0, + 0.17006580159068108, + 0.0, + 0.0, + 0.5780806355178356, + 0.05502302199602127, + 0.07518057897686958, + 0.0, + 0.11486675962805748, + 0.04889436066150665, + 0.03647914156317711, + 0.22529231011867523, + 0.38372209295630455, + 0.43265562877058983, + 0.3768526241183281, + 0.23743149638175964 + ], + "unique_experts": 45, + "load_cv": 1.0393492741038726, + "normalized_load_entropy": 0.8676618744361024, + "max_load_share": 0.0763888888888889 + }, + "full_input": { + "tokens": 65, + "top_k": 6, + "decisions": 390, + "ordered_route_sha256": "0f355dce731b114390c5fb0a92dc24cc7b50b1393106fdc4ed7c80a0179ffb79", + "route_weight_sha256": "cd4886ad2b5b3dd2e4cb308a727f722609293f30c82fe0344f94fe427c8bc3de", + "loads": [ + 0, + 6, + 0, + 5, + 3, + 12, + 10, + 3, + 0, + 3, + 5, + 2, + 0, + 4, + 5, + 14, + 8, + 16, + 9, + 2, + 12, + 2, + 2, + 5, + 21, + 4, + 12, + 1, + 1, + 12, + 8, + 5, + 12, + 12, + 4, + 2, + 0, + 10, + 6, + 4, + 7, + 17, + 1, + 4, + 3, + 7, + 3, + 8, + 4, + 7, + 6, + 1, + 9, + 15, + 3, + 12, + 4, + 1, + 1, + 4, + 9, + 6, + 7, + 9 + ], + "weighted_loads": [ + 0.0, + 0.23044084012508392, + 0.0, + 0.3564808964729309, + 0.14326747506856918, + 0.975489092990756, + 0.5247332975268364, + 0.14480121806263924, + 0.0, + 0.48930955305695534, + 0.18015013821423054, + 0.06187283992767334, + 0.0, + 0.12302054464817047, + 0.24614165350794792, + 1.3542617075145245, + 0.28338548354804516, + 1.187404453754425, + 0.8932530116289854, + 0.12947792559862137, + 0.9665433317422867, + 0.0903930813074112, + 0.0862000621855259, + 0.3339499644935131, + 1.6885383538901806, + 0.3129906989634037, + 1.2499283347278833, + 0.041828956454992294, + 0.04878346621990204, + 0.6510941963642836, + 0.3491759616881609, + 0.3256182335317135, + 0.4829979073256254, + 1.4811290074139833, + 0.1657843478024006, + 0.11895396932959557, + 0.0, + 0.5165902301669121, + 0.3775933235883713, + 0.26399437338113785, + 0.34259591810405254, + 2.3053919970989227, + 0.0370611771941185, + 0.20128773897886276, + 0.09420070610940456, + 0.3309924155473709, + 0.14304031617939472, + 0.372085802257061, + 0.1552014071494341, + 0.32854169979691505, + 0.249256931245327, + 0.043011922389268875, + 0.5780806355178356, + 1.1917195171117783, + 0.11310935765504837, + 1.0115869417786598, + 0.22218270599842072, + 0.04889436066150665, + 0.03647914156317711, + 0.4601034037768841, + 0.5828508883714676, + 0.5105467326939106, + 0.7101952247321606, + 0.5673523489385843 + ], + "unique_experts": 59, + "load_cv": 0.7750039765756604, + "normalized_load_entropy": 0.9249195226963552, + "max_load_share": 0.05384615384615385 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 24, + "ordered_topk_exact_tokens": 16, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.9166666666666666, + "mean_token_weighted_tv": 0.01740144336751352, + "aggregate_load_tv": 0.027777777777777776 + }, + "system_bos": { + "tokens": 24, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.8988095238095238, + "mean_token_weighted_tv": 0.021291822408481192, + "aggregate_load_tv": 0.05555555555555555 + }, + "system_x": { + "tokens": 24, + "ordered_topk_exact_tokens": 5, + "set_exact_tokens": 8, + "mean_set_jaccard": 0.7827380952380953, + "mean_token_weighted_tv": 0.03789926820900291, + "aggregate_load_tv": 0.10416666666666669 + }, + "system_period": { + "tokens": 24, + "ordered_topk_exact_tokens": 6, + "set_exact_tokens": 11, + "mean_set_jaccard": 0.8363095238095237, + "mean_token_weighted_tv": 0.03289917026025554, + "aggregate_load_tv": 0.0763888888888889 + }, + "bos_at_s0": { + "tokens": 24, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.875, + "mean_token_weighted_tv": 0.026013492412554722, + "aggregate_load_tv": 0.06944444444444445 + }, + "bos_at_s1": { + "tokens": 24, + "ordered_topk_exact_tokens": 8, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8720238095238096, + "mean_token_weighted_tv": 0.025815901133076597, + "aggregate_load_tv": 0.0625 + }, + "x_at_s0": { + "tokens": 24, + "ordered_topk_exact_tokens": 6, + "set_exact_tokens": 11, + "mean_set_jaccard": 0.8293650793650794, + "mean_token_weighted_tv": 0.03321291824492315, + "aggregate_load_tv": 0.09027777777777778 + }, + "x_at_s1": { + "tokens": 24, + "ordered_topk_exact_tokens": 5, + "set_exact_tokens": 9, + "mean_set_jaccard": 0.7966269841269842, + "mean_token_weighted_tv": 0.04175923803510765, + "aggregate_load_tv": 0.11805555555555555 + }, + "period_at_s0": { + "tokens": 24, + "ordered_topk_exact_tokens": 6, + "set_exact_tokens": 11, + "mean_set_jaccard": 0.8273809523809524, + "mean_token_weighted_tv": 0.034356533200480044, + "aggregate_load_tv": 0.09027777777777779 + }, + "period_at_s1": { + "tokens": 24, + "ordered_topk_exact_tokens": 4, + "set_exact_tokens": 10, + "mean_set_jaccard": 0.7996031746031748, + "mean_token_weighted_tv": 0.04161741848414143, + "aggregate_load_tv": 0.11111111111111112 + } + } + }, + "layer_17": { + "layer": 17, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "a96faca11856f6272adfe3a64938618722b5fe96bc468785e00c1b398358335f", + "route_weight_sha256": "2037a6c8ce22a12aed7476a22d81e9ae5a1ecaa3874fa82447f24cbbe921915b", + "loads": [ + 3, + 0, + 1, + 0, + 2, + 0, + 0, + 3, + 1, + 2, + 4, + 2, + 4, + 2, + 3, + 11, + 1, + 0, + 0, + 1, + 0, + 5, + 3, + 1, + 3, + 1, + 4, + 4, + 0, + 4, + 4, + 3, + 7, + 2, + 5, + 0, + 2, + 1, + 3, + 4, + 0, + 4, + 3, + 4, + 2, + 3, + 4, + 1, + 0, + 0, + 1, + 1, + 1, + 3, + 6, + 4, + 1, + 2, + 2, + 1, + 1, + 3, + 1, + 0 + ], + "weighted_loads": [ + 0.3170929439365864, + 0.0, + 0.03623262420296669, + 0.0, + 0.09346379525959492, + 0.0, + 0.0, + 0.19776584766805172, + 0.05089151859283447, + 0.08766012266278267, + 0.16621705144643784, + 0.11004258692264557, + 0.28957557678222656, + 0.11026524007320404, + 0.16240360215306282, + 0.6492272205650806, + 0.06330110132694244, + 0.0, + 0.0, + 0.04162317514419556, + 0.0, + 0.41035169921815395, + 0.2696492597460747, + 0.041725240647792816, + 0.5133544914424419, + 0.03684769198298454, + 0.24569033086299896, + 0.38577328622341156, + 0.0, + 0.5247573181986809, + 0.15491380915045738, + 0.18668130412697792, + 0.8541302867233753, + 0.10270481929183006, + 0.30380386114120483, + 0.0, + 0.0703128632158041, + 0.14924423396587372, + 0.1316986009478569, + 0.21697260066866875, + 0.0, + 0.32341236993670464, + 0.2182239107787609, + 0.47245369851589203, + 0.37186577916145325, + 0.15707025304436684, + 0.23549269884824753, + 0.03017597645521164, + 0.0, + 0.0, + 0.03732310235500336, + 0.037909507751464844, + 0.03945091739296913, + 0.12288005650043488, + 0.44520239531993866, + 0.28727735579013824, + 0.03776000812649727, + 0.12285100296139717, + 0.10774775594472885, + 0.06675752252340317, + 0.03894444555044174, + 0.16081896051764488, + 0.04785547032952309, + 0.0 + ], + "unique_experts": 51, + "load_cv": 0.8923543557893895, + "normalized_load_entropy": 0.9001517933695381, + "max_load_share": 0.0763888888888889 + }, + "full_input": { + "tokens": 49, + "top_k": 6, + "decisions": 294, + "ordered_route_sha256": "7b0c55eee70854929bb4f1e583cea49b62dce3b89ee625c6ad866bb0e616f6b7", + "route_weight_sha256": "444742f2000acafd7ee50369b47602ce8f2725f85ff99971561497d7bbd0d383", + "loads": [ + 11, + 2, + 3, + 7, + 2, + 0, + 2, + 3, + 1, + 5, + 11, + 3, + 6, + 10, + 3, + 14, + 1, + 7, + 3, + 1, + 3, + 5, + 3, + 7, + 10, + 8, + 13, + 8, + 4, + 5, + 4, + 3, + 15, + 2, + 5, + 0, + 2, + 1, + 10, + 4, + 8, + 9, + 6, + 7, + 2, + 7, + 4, + 1, + 0, + 1, + 2, + 1, + 3, + 4, + 6, + 6, + 1, + 5, + 2, + 1, + 1, + 3, + 7, + 0 + ], + "weighted_loads": [ + 0.5808993494138122, + 0.08025966584682465, + 0.13042426481842995, + 0.5854342468082905, + 0.09346379525959492, + 0.0, + 0.09650560468435287, + 0.19776584766805172, + 0.05089151859283447, + 0.19744551554322243, + 0.6307881884276867, + 0.12852046638727188, + 0.3510754406452179, + 0.7047865353524685, + 0.16240360215306282, + 0.7756144665181637, + 0.06330110132694244, + 0.6643123403191566, + 0.12296906486153603, + 0.04162317514419556, + 0.288475401699543, + 0.41035169921815395, + 0.2696492597460747, + 0.3126473017036915, + 1.0084853060543537, + 0.42592478170990944, + 1.931538661941886, + 0.5631207413971424, + 0.1534428484737873, + 0.5300654419697821, + 0.15491380915045738, + 0.18668130412697792, + 1.1755677689798176, + 0.10270481929183006, + 0.30380386114120483, + 0.0, + 0.0703128632158041, + 0.14924423396587372, + 0.45277492702007294, + 0.21697260066866875, + 1.0780738331377506, + 0.46057442389428616, + 0.45075978338718414, + 0.5307175836060196, + 0.37186577916145325, + 1.0296731926500797, + 0.23549269884824753, + 0.03017597645521164, + 0.0, + 0.04051733389496803, + 0.10642355680465698, + 0.037909507751464844, + 0.16909758746623993, + 0.15722782164812088, + 0.44520239531993866, + 0.405838493257761, + 0.03776000812649727, + 0.2750572059303522, + 0.10774775594472885, + 0.06675752252340317, + 0.03894444555044174, + 0.16081896051764488, + 0.6684681475162506, + 0.0 + ], + "unique_experts": 60, + "load_cv": 0.7836722883588985, + "normalized_load_entropy": 0.9256529918344415, + "max_load_share": 0.05102040816326531 + } + }, + "s1_eos": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "dd66e0ab7b3ac7034494e7df916a8d67a18d8d9866ac8b0f978c22a47328264f", + "route_weight_sha256": "f5270e11a464db06576288bfb2ea03538f0ea9ebcc8baff97ebfe64e952503a7", + "loads": [ + 3, + 0, + 0, + 0, + 2, + 0, + 0, + 2, + 2, + 1, + 4, + 2, + 4, + 2, + 3, + 11, + 1, + 0, + 0, + 1, + 0, + 5, + 3, + 1, + 3, + 1, + 4, + 4, + 0, + 4, + 4, + 3, + 7, + 2, + 4, + 0, + 2, + 1, + 4, + 4, + 1, + 4, + 3, + 4, + 2, + 3, + 4, + 1, + 0, + 0, + 1, + 1, + 2, + 3, + 6, + 4, + 1, + 2, + 2, + 1, + 0, + 4, + 1, + 0 + ], + "weighted_loads": [ + 0.31652268022298813, + 0.0, + 0.0, + 0.0, + 0.09600040316581726, + 0.0, + 0.0, + 0.17402353137731552, + 0.0853639505803585, + 0.04324215650558472, + 0.1652115397155285, + 0.10873481631278992, + 0.28148388862609863, + 0.11313582584261894, + 0.16741809248924255, + 0.6372766904532909, + 0.06341557204723358, + 0.0, + 0.0, + 0.043602436780929565, + 0.0, + 0.3999471999704838, + 0.2637753039598465, + 0.04341484233736992, + 0.49297749623656273, + 0.03986551612615585, + 0.24353354424238205, + 0.39832859858870506, + 0.0, + 0.507877741008997, + 0.15737107768654823, + 0.18826844543218613, + 0.8580326326191425, + 0.10833561047911644, + 0.2813076712191105, + 0.0, + 0.06856622733175755, + 0.14816151559352875, + 0.1589348092675209, + 0.21941695362329483, + 0.04041431099176407, + 0.3295307829976082, + 0.21897976100444794, + 0.4672785587608814, + 0.3710077852010727, + 0.15587978437542915, + 0.2155616134405136, + 0.03150549158453941, + 0.0, + 0.0, + 0.03645861893892288, + 0.038196079432964325, + 0.07889886572957039, + 0.12170227244496346, + 0.4431704878807068, + 0.28660643473267555, + 0.03864732384681702, + 0.12345315515995026, + 0.11067439988255501, + 0.06074725463986397, + 0.0, + 0.19399934448301792, + 0.04401277005672455, + 0.0 + ], + "unique_experts": 50, + "load_cv": 0.8958064164776166, + "normalized_load_entropy": 0.8976914958937593, + "max_load_share": 0.0763888888888889 + }, + "full_input": { + "tokens": 65, + "top_k": 6, + "decisions": 390, + "ordered_route_sha256": "d4d30c8ffb64c943be4030bc3a9b7c8f3f9b75071d7d2d4e472dd495e00ae4a4", + "route_weight_sha256": "f995cdb8bd9612478c9243abae2837ff3091fec0f83c5e8c0cd3ec767b02e812", + "loads": [ + 12, + 2, + 2, + 7, + 8, + 0, + 3, + 3, + 2, + 7, + 12, + 4, + 4, + 10, + 3, + 20, + 3, + 8, + 3, + 1, + 1, + 6, + 3, + 10, + 12, + 22, + 17, + 6, + 3, + 6, + 5, + 4, + 11, + 2, + 4, + 0, + 7, + 3, + 10, + 5, + 14, + 10, + 6, + 5, + 4, + 8, + 6, + 3, + 0, + 0, + 2, + 7, + 6, + 3, + 7, + 10, + 8, + 14, + 3, + 3, + 1, + 8, + 11, + 0 + ], + "weighted_loads": [ + 0.6632290333509445, + 0.08410312235355377, + 0.07858719676733017, + 0.6576448045670986, + 0.4908687863498926, + 0.0, + 0.11647601425647736, + 0.22865460813045502, + 0.0853639505803585, + 0.23631866462528706, + 0.7468194719403982, + 0.17444445192813873, + 0.28148388862609863, + 0.7181641347706318, + 0.16741809248924255, + 1.0497207920998335, + 0.23527760803699493, + 0.6510592103004456, + 0.11075256019830704, + 0.043602436780929565, + 0.06957467645406723, + 0.47683295980095863, + 0.2637753039598465, + 0.696174144744873, + 1.0035277481656522, + 1.429258070886135, + 2.0714327823370695, + 0.49507445842027664, + 0.1258397251367569, + 0.5926978760398924, + 0.2191898226737976, + 0.22773678973317146, + 0.9977150289341807, + 0.10833561047911644, + 0.2813076712191105, + 0.0, + 0.3276114743202925, + 0.22137554734945297, + 0.6055712383240461, + 0.25335148349404335, + 1.8189749345183372, + 0.6631854684092104, + 0.4002744294703007, + 0.48607511073350906, + 0.606787022203207, + 1.4325193278491497, + 0.42832548171281815, + 0.16420747712254524, + 0.0, + 0.0, + 0.1715029552578926, + 0.32997735776007175, + 0.308416947722435, + 0.12170227244496346, + 0.5311067402362823, + 0.6560747511684895, + 0.6605425551533699, + 0.7406402938067913, + 0.13336054608225822, + 0.1534941904246807, + 0.03604094684123993, + 0.418201120570302, + 0.927267262712121, + 0.0 + ], + "unique_experts": 59, + "load_cv": 0.7755467202682693, + "normalized_load_entropy": 0.9280998994051759, + "max_load_share": 0.05641025641025641 + } + }, + "s0_bos": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "d49ac9529a12f30d3044d9a2862dc3384f1b7f3bae24af263a82d59990a12438", + "route_weight_sha256": "b3807d8978cdd58dbdfb0e327839e80a2afb03fe3aaa60ef52e62d2e9a2ea1a7", + "loads": [ + 3, + 0, + 1, + 0, + 2, + 0, + 0, + 2, + 1, + 2, + 4, + 2, + 4, + 2, + 3, + 10, + 1, + 0, + 0, + 1, + 0, + 6, + 3, + 1, + 3, + 1, + 3, + 4, + 0, + 4, + 4, + 3, + 7, + 2, + 5, + 0, + 2, + 1, + 4, + 4, + 0, + 4, + 3, + 5, + 2, + 3, + 4, + 1, + 0, + 0, + 1, + 1, + 1, + 3, + 6, + 4, + 1, + 2, + 2, + 1, + 0, + 4, + 1, + 0 + ], + "weighted_loads": [ + 0.315023947507143, + 0.0, + 0.03616417571902275, + 0.0, + 0.09988563880324364, + 0.0, + 0.0, + 0.16946867108345032, + 0.049454160034656525, + 0.08799884095788002, + 0.16371812857687473, + 0.11582949757575989, + 0.2925180718302727, + 0.11493765562772751, + 0.1521467175334692, + 0.5664630010724068, + 0.06158516928553581, + 0.0, + 0.0, + 0.041527919471263885, + 0.0, + 0.4571089670062065, + 0.2793029174208641, + 0.0433533675968647, + 0.5282110497355461, + 0.038267411291599274, + 0.20591696724295616, + 0.3695504777133465, + 0.0, + 0.48006393760442734, + 0.15956173837184906, + 0.1901296153664589, + 0.856374517083168, + 0.08998505771160126, + 0.3206252418458462, + 0.0, + 0.0736759714782238, + 0.1514539122581482, + 0.1691983938217163, + 0.22606375440955162, + 0.0, + 0.33504030108451843, + 0.2142658345401287, + 0.467114869505167, + 0.3727630078792572, + 0.16254083439707756, + 0.2417735420167446, + 0.031113669276237488, + 0.0, + 0.0, + 0.04625029116868973, + 0.04205150529742241, + 0.03861444443464279, + 0.11785046383738518, + 0.4935908690094948, + 0.2917387969791889, + 0.05260426551103592, + 0.11762186512351036, + 0.10657484456896782, + 0.06842611730098724, + 0.0, + 0.20294488221406937, + 0.039102714508771896, + 0.0 + ], + "unique_experts": 50, + "load_cv": 0.8923543557893895, + "normalized_load_entropy": 0.8964879818604369, + "max_load_share": 0.06944444444444445 + }, + "full_input": { + "tokens": 49, + "top_k": 6, + "decisions": 294, + "ordered_route_sha256": "68b32727ad4be105b92bcceff44a266fd0323bc2f3633356873642dbd64fb3e9", + "route_weight_sha256": "99014abff4ddf4d84cf1202040ab3e401cddbf077f1c16ca04cfd6d83db86e5c", + "loads": [ + 10, + 2, + 2, + 7, + 2, + 0, + 2, + 2, + 1, + 5, + 11, + 3, + 8, + 10, + 3, + 13, + 1, + 7, + 3, + 2, + 3, + 7, + 3, + 8, + 9, + 8, + 10, + 7, + 5, + 4, + 4, + 3, + 14, + 2, + 5, + 0, + 2, + 1, + 11, + 4, + 8, + 8, + 5, + 7, + 2, + 7, + 4, + 1, + 0, + 2, + 2, + 1, + 3, + 5, + 7, + 6, + 1, + 5, + 2, + 2, + 0, + 4, + 8, + 0 + ], + "weighted_loads": [ + 0.6014233957976103, + 0.08400548994541168, + 0.0895363911986351, + 0.5854342468082905, + 0.09988563880324364, + 0.0, + 0.09650560468435287, + 0.16946867108345032, + 0.049454160034656525, + 0.19778423383831978, + 0.6370136346668005, + 0.1343073770403862, + 0.5447428449988365, + 0.709458950906992, + 0.1521467175334692, + 0.6949460282921791, + 0.06158516928553581, + 0.6643123403191566, + 0.2596958614885807, + 0.09816671535372734, + 0.3030519559979439, + 0.5371857360005379, + 0.2793029174208641, + 0.35170306637883186, + 0.986020527780056, + 0.4125733934342861, + 0.8890762217342854, + 0.4969532638788223, + 0.186465073376894, + 0.48006393760442734, + 0.15956173837184906, + 0.1901296153664589, + 1.1789238527417183, + 0.08998505771160126, + 0.3206252418458462, + 0.0, + 0.0736759714782238, + 0.1514539122581482, + 0.4991922788321972, + 0.22606375440955162, + 1.0236029513180256, + 0.4590475521981716, + 0.404242929071188, + 0.5221681967377663, + 0.3727630078792572, + 0.935347031801939, + 0.2417735420167446, + 0.031113669276237488, + 0.0, + 0.20047351345419884, + 0.11535074561834335, + 0.04205150529742241, + 0.16832636296749115, + 0.20931420847773552, + 0.5669233128428459, + 0.4102999344468117, + 0.05260426551103592, + 0.26698007248342037, + 0.10657484456896782, + 0.11376935243606567, + 0.0, + 0.20294488221406937, + 0.535276997834444, + 0.0 + ], + "unique_experts": 59, + "load_cv": 0.7459145673676593, + "normalized_load_entropy": 0.9291315754652572, + "max_load_share": 0.047619047619047616 + } + }, + "s1_bos": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "c0e7a6e3a27506b9b470fa95db8c87c31c2f74ba763116c6a6bc2f1d7cee7d31", + "route_weight_sha256": "04c45e4c955f662011b3e0424744a1a18cc06225778b368d3577b7bdd2cfcef8", + "loads": [ + 3, + 0, + 0, + 0, + 2, + 0, + 0, + 2, + 1, + 1, + 3, + 2, + 4, + 1, + 4, + 10, + 1, + 0, + 0, + 1, + 0, + 6, + 3, + 0, + 3, + 1, + 3, + 4, + 0, + 5, + 4, + 2, + 7, + 2, + 6, + 0, + 2, + 1, + 4, + 4, + 0, + 4, + 4, + 5, + 2, + 3, + 4, + 1, + 0, + 0, + 1, + 1, + 2, + 4, + 6, + 4, + 1, + 2, + 2, + 1, + 0, + 4, + 1, + 0 + ], + "weighted_loads": [ + 0.31764156371355057, + 0.0, + 0.0, + 0.0, + 0.10493680648505688, + 0.0, + 0.0, + 0.1664728969335556, + 0.049496132880449295, + 0.05143018066883087, + 0.1292162835597992, + 0.10818511247634888, + 0.2951790727674961, + 0.07547483593225479, + 0.19704337418079376, + 0.5806683674454689, + 0.05899667739868164, + 0.0, + 0.0, + 0.04156928136944771, + 0.0, + 0.45455555245280266, + 0.2709020636975765, + 0.0, + 0.4936005063354969, + 0.03786134719848633, + 0.20859570056200027, + 0.39688442647457123, + 0.0, + 0.5750565752387047, + 0.16621506214141846, + 0.1477051079273224, + 0.8187087401747704, + 0.08949941024184227, + 0.3602641560137272, + 0.0, + 0.0675853006541729, + 0.14859123528003693, + 0.1601553037762642, + 0.23155467212200165, + 0.0, + 0.33006690442562103, + 0.2643708325922489, + 0.47145649790763855, + 0.35514938831329346, + 0.1564536765217781, + 0.24257996305823326, + 0.03169000893831253, + 0.0, + 0.0, + 0.045962460339069366, + 0.04283604025840759, + 0.07800043374300003, + 0.16387881711125374, + 0.4717177487909794, + 0.2861361801624298, + 0.054929766803979874, + 0.12030264362692833, + 0.10336874052882195, + 0.06204841285943985, + 0.0, + 0.19473901763558388, + 0.037574466317892075, + 0.0 + ], + "unique_experts": 48, + "load_cv": 0.9329364235414813, + "normalized_load_entropy": 0.8857876201731261, + "max_load_share": 0.06944444444444445 + }, + "full_input": { + "tokens": 65, + "top_k": 6, + "decisions": 390, + "ordered_route_sha256": "9faf8e10452f7489f775f2dd28682c3d5e389ba3e6b7389110affb8bcd3e090c", + "route_weight_sha256": "b2ecdfa249cdb2ef9e891da63c33168367bb5e57acb78448af587cdf2e2884cc", + "loads": [ + 10, + 4, + 2, + 7, + 8, + 0, + 3, + 3, + 1, + 8, + 11, + 4, + 6, + 9, + 4, + 18, + 3, + 8, + 3, + 1, + 1, + 7, + 3, + 10, + 11, + 22, + 14, + 6, + 0, + 6, + 5, + 3, + 10, + 2, + 6, + 0, + 7, + 3, + 10, + 5, + 14, + 9, + 7, + 6, + 4, + 8, + 6, + 3, + 0, + 2, + 3, + 7, + 6, + 5, + 7, + 9, + 8, + 15, + 3, + 3, + 1, + 9, + 11, + 0 + ], + "weighted_loads": [ + 0.6099916882812977, + 0.1962602138519287, + 0.07858719676733017, + 0.6576448045670986, + 0.49980518966913223, + 0.0, + 0.11647601425647736, + 0.2211039736866951, + 0.049496132880449295, + 0.2988856751471758, + 0.7027080077677965, + 0.1738947480916977, + 0.40445009246468544, + 0.6805031448602676, + 0.19704337418079376, + 0.9610338807106018, + 0.230858713388443, + 0.6510592103004456, + 0.11721168085932732, + 0.04156928136944771, + 0.09691839665174484, + 0.5314413122832775, + 0.2709020636975765, + 0.6922997236251831, + 1.0103680565953255, + 1.412779625505209, + 1.1075370740145445, + 0.4879976958036423, + 0.0, + 0.6546744927763939, + 0.22803380712866783, + 0.18717345222830772, + 0.9552674144506454, + 0.08949941024184227, + 0.3602641560137272, + 0.0, + 0.3266305476427078, + 0.22180526703596115, + 0.6131021827459335, + 0.26548920199275017, + 1.7528574466705322, + 0.6673109270632267, + 0.43878891319036484, + 0.4902530498802662, + 0.5909286253154278, + 1.513665296137333, + 0.4553438313305378, + 0.16439199447631836, + 0.0, + 0.08164604753255844, + 0.23466138169169426, + 0.334617318585515, + 0.30752919241786003, + 0.20590442419052124, + 0.559654001146555, + 0.6209931448101997, + 0.6768249981105328, + 0.7855268232524395, + 0.12605488672852516, + 0.1547953486442566, + 0.03604094684123993, + 0.4706101790070534, + 0.8329123537987471, + 0.0 + ], + "unique_experts": 59, + "load_cv": 0.7268134046512916, + "normalized_load_entropy": 0.9340673918839146, + "max_load_share": 0.05641025641025641 + } + }, + "s0_x": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "17586b95733efe4d0b98ad7edd66d71891aa93b8095e1a0b1a2bcdc6be6ff1a8", + "route_weight_sha256": "8f88b9d0f5da247a14b41520e58ecef3c71c4f13085b9029ae5e4a8c6ae53b99", + "loads": [ + 3, + 0, + 0, + 0, + 1, + 0, + 0, + 2, + 1, + 1, + 3, + 2, + 4, + 2, + 1, + 10, + 1, + 0, + 0, + 1, + 1, + 6, + 3, + 1, + 3, + 1, + 3, + 4, + 0, + 5, + 4, + 3, + 7, + 1, + 5, + 0, + 2, + 1, + 4, + 4, + 0, + 4, + 4, + 5, + 2, + 3, + 4, + 1, + 0, + 0, + 1, + 1, + 2, + 4, + 7, + 4, + 1, + 2, + 2, + 1, + 1, + 4, + 1, + 0 + ], + "weighted_loads": [ + 0.29939141869544983, + 0.0, + 0.0, + 0.0, + 0.06542591750621796, + 0.0, + 0.0, + 0.16854843497276306, + 0.05234270170331001, + 0.049152858555316925, + 0.12997310981154442, + 0.11213069409132004, + 0.2884697951376438, + 0.11462694779038429, + 0.08240838348865509, + 0.582839023321867, + 0.06340911984443665, + 0.0, + 0.0, + 0.041291363537311554, + 0.022481994703412056, + 0.4596090652048588, + 0.28142891451716423, + 0.02925817109644413, + 0.5378442108631134, + 0.0415319949388504, + 0.21261431276798248, + 0.3596148267388344, + 0.0, + 0.5041342452168465, + 0.15560843795537949, + 0.19029584154486656, + 0.8619234301149845, + 0.041758943349123, + 0.29183248803019524, + 0.0, + 0.07486242428421974, + 0.1531795710325241, + 0.17117178812623024, + 0.2257002256810665, + 0.0, + 0.307718139141798, + 0.2874882258474827, + 0.4968661479651928, + 0.3438883572816849, + 0.14871800690889359, + 0.25013428181409836, + 0.030127691105008125, + 0.0, + 0.0, + 0.04215271770954132, + 0.037650223821401596, + 0.07943804934620857, + 0.1555989682674408, + 0.5213277991861105, + 0.30499573424458504, + 0.04441315308213234, + 0.12397267669439316, + 0.09736891835927963, + 0.06724709272384644, + 0.03847120702266693, + 0.20480931922793388, + 0.03998193144798279, + 0.0 + ], + "unique_experts": 51, + "load_cv": 0.9196080754026027, + "normalized_load_entropy": 0.8938935664435547, + "max_load_share": 0.06944444444444445 + }, + "full_input": { + "tokens": 49, + "top_k": 6, + "decisions": 294, + "ordered_route_sha256": "c875c497bbf977cfb5dfb3b2d17eb6dbe3608a9c50b900d03f395e3568841d39", + "route_weight_sha256": "190e57fbfaa1209a4b51395900e38c89510f546fbc31cba29821277c1309a52a", + "loads": [ + 9, + 1, + 3, + 8, + 1, + 0, + 2, + 2, + 1, + 5, + 11, + 3, + 6, + 11, + 1, + 13, + 1, + 8, + 3, + 1, + 3, + 7, + 3, + 9, + 8, + 9, + 9, + 7, + 4, + 5, + 4, + 3, + 14, + 1, + 5, + 0, + 2, + 1, + 11, + 4, + 8, + 8, + 7, + 7, + 2, + 7, + 4, + 1, + 1, + 1, + 3, + 1, + 4, + 4, + 8, + 8, + 1, + 5, + 2, + 1, + 1, + 5, + 6, + 0 + ], + "weighted_loads": [ + 0.5196471940726042, + 0.036181773990392685, + 0.12825027480721474, + 0.7366506494581699, + 0.06542591750621796, + 0.0, + 0.09650560468435287, + 0.16854843497276306, + 0.05234270170331001, + 0.20350563898682594, + 0.7551747187972069, + 0.13060857355594635, + 0.34996965900063515, + 0.7482138238847256, + 0.08240838348865509, + 0.7582765258848667, + 0.06340911984443665, + 0.7102821543812752, + 0.3104669041931629, + 0.041291363537311554, + 0.22649076767265797, + 0.5006146840751171, + 0.28142891451716423, + 0.3887236062437296, + 0.9282026886940002, + 0.47535573318600655, + 0.7906134761869907, + 0.4870176129043102, + 0.15693485736846924, + 0.5041342452168465, + 0.15560843795537949, + 0.19029584154486656, + 1.1865539625287056, + 0.041758943349123, + 0.29183248803019524, + 0.0, + 0.07486242428421974, + 0.1531795710325241, + 0.5054115168750286, + 0.2257002256810665, + 0.9754141662269831, + 0.4449040964245796, + 0.5250330567359924, + 0.551919475197792, + 0.3438883572816849, + 1.0210433080792427, + 0.25013428181409836, + 0.030127691105008125, + 0.04010915383696556, + 0.032259173691272736, + 0.1774100959300995, + 0.037650223821401596, + 0.21535249054431915, + 0.1555989682674408, + 0.5647637527436018, + 0.5073994621634483, + 0.04441315308213234, + 0.2818881440907717, + 0.09736891835927963, + 0.06724709272384644, + 0.03847120702266693, + 0.25668734312057495, + 0.46066341549158096, + 0.0 + ], + "unique_experts": 61, + "load_cv": 0.7626029357010855, + "normalized_load_entropy": 0.9265346108289672, + "max_load_share": 0.047619047619047616 + } + }, + "s1_x": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "e1fd679d12697a36e9cc52d294e23f7745ca377085f85cd236e5d4d203b5ca24", + "route_weight_sha256": "e7a072098e2c4a0823a8bee364502e426d07f0f29fdc0438ec3695bda3c64ad5", + "loads": [ + 3, + 0, + 0, + 0, + 2, + 0, + 0, + 3, + 1, + 1, + 2, + 2, + 4, + 1, + 3, + 10, + 1, + 0, + 0, + 1, + 0, + 6, + 3, + 1, + 4, + 1, + 3, + 3, + 0, + 4, + 4, + 3, + 7, + 2, + 7, + 0, + 2, + 1, + 3, + 4, + 1, + 4, + 4, + 5, + 2, + 2, + 4, + 1, + 0, + 0, + 1, + 1, + 2, + 4, + 6, + 4, + 1, + 2, + 2, + 1, + 0, + 4, + 1, + 0 + ], + "weighted_loads": [ + 0.2951809950172901, + 0.0, + 0.0, + 0.0, + 0.10858499258756638, + 0.0, + 0.0, + 0.2060459405183792, + 0.04979580268263817, + 0.049363091588020325, + 0.09531433507800102, + 0.11335311084985733, + 0.2837514877319336, + 0.07572301477193832, + 0.15302937850356102, + 0.5533315688371658, + 0.06183304637670517, + 0.0, + 0.0, + 0.0414414219558239, + 0.0, + 0.4541216269135475, + 0.2726075164973736, + 0.044139035046100616, + 0.5891372263431549, + 0.05651981011033058, + 0.21645814552903175, + 0.3325764574110508, + 0.0, + 0.4320167861878872, + 0.1599159650504589, + 0.1891665905714035, + 0.8599574379622936, + 0.0874185673892498, + 0.39666032791137695, + 0.0, + 0.07756476476788521, + 0.14813460409641266, + 0.13038119301199913, + 0.24419934302568436, + 0.05402808636426926, + 0.2812866307795048, + 0.2785312607884407, + 0.438711442053318, + 0.35166308283805847, + 0.11047346144914627, + 0.22241098806262016, + 0.03150716796517372, + 0.0, + 0.0, + 0.044774703681468964, + 0.040648091584444046, + 0.07877335697412491, + 0.15522874519228935, + 0.44982305355370045, + 0.2905046083033085, + 0.062262143939733505, + 0.14137371629476547, + 0.10196686536073685, + 0.06628471612930298, + 0.0, + 0.2062010057270527, + 0.040590833872556686, + 0.0 + ], + "unique_experts": 50, + "load_cv": 0.9196080754026027, + "normalized_load_entropy": 0.892683634085202, + "max_load_share": 0.06944444444444445 + }, + "full_input": { + "tokens": 65, + "top_k": 6, + "decisions": 390, + "ordered_route_sha256": "36e444f18df1099cb1163255bdf8765c01fad708024f3d330de61a6a9ea5b1cf", + "route_weight_sha256": "2e63b15bcde04b5631b039e8fe73ff53bca852f49bda2fe98c9a7dafb1bd0b01", + "loads": [ + 10, + 1, + 3, + 8, + 8, + 0, + 3, + 4, + 1, + 8, + 11, + 4, + 4, + 10, + 3, + 18, + 3, + 9, + 4, + 1, + 0, + 7, + 3, + 12, + 13, + 24, + 11, + 4, + 0, + 5, + 5, + 4, + 10, + 2, + 7, + 0, + 7, + 3, + 8, + 5, + 14, + 9, + 8, + 6, + 4, + 7, + 6, + 3, + 1, + 1, + 3, + 7, + 6, + 4, + 7, + 10, + 8, + 17, + 4, + 3, + 1, + 9, + 9, + 0 + ], + "weighted_loads": [ + 0.6011473126709461, + 0.04310368373990059, + 0.1267891824245453, + 0.8227383904159069, + 0.5034533757716417, + 0.0, + 0.11647601425647736, + 0.2606770172715187, + 0.04979580268263817, + 0.2797406818717718, + 0.8053922858089209, + 0.17906274646520615, + 0.2837514877319336, + 0.741071242839098, + 0.15302937850356102, + 0.9504129439592361, + 0.23369508236646652, + 0.7018203176558018, + 0.1624420266598463, + 0.0414414219558239, + 0.0, + 0.5310073867440224, + 0.2726075164973736, + 0.7639357391744852, + 1.1275766640901566, + 1.563393983989954, + 0.9064053427428007, + 0.37225688621401787, + 0.0, + 0.5116347037255764, + 0.22173471003770828, + 0.22863493487238884, + 0.9874271936714649, + 0.0874185673892498, + 0.39666032791137695, + 0.0, + 0.33661001175642014, + 0.22134863585233688, + 0.5394788943231106, + 0.2781338728964329, + 1.701513435691595, + 0.5777212753891945, + 0.4773414768278599, + 0.45750799402594566, + 0.5874423198401928, + 1.3798257783055305, + 0.4351748563349247, + 0.16420915350317955, + 0.03975459188222885, + 0.04002971202135086, + 0.26573846489191055, + 0.3324293699115515, + 0.33704474195837975, + 0.15522874519228935, + 0.537759305909276, + 0.6662579029798508, + 0.6841573752462864, + 0.9594100676476955, + 0.17567654326558113, + 0.15903165191411972, + 0.03604094684123993, + 0.4565155655145645, + 0.6409063991159201, + 0.0 + ], + "unique_experts": 59, + "load_cv": 0.7629659417502687, + "normalized_load_entropy": 0.929351670352525, + "max_load_share": 0.06153846153846154 + } + }, + "s0_period": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "53c29fa2adb1abf8bea03cab39ef7d754c49184825bc4b37ab45c65de4de0d73", + "route_weight_sha256": "9d330eba5cafd0a6c61a62184e9d473af35a25b606b380ea7b5f36e34fdf323f", + "loads": [ + 3, + 0, + 1, + 0, + 1, + 0, + 0, + 3, + 1, + 1, + 2, + 2, + 4, + 2, + 2, + 10, + 1, + 0, + 0, + 1, + 1, + 6, + 3, + 0, + 3, + 1, + 3, + 3, + 0, + 5, + 5, + 3, + 7, + 2, + 6, + 0, + 2, + 1, + 5, + 4, + 0, + 4, + 4, + 5, + 2, + 3, + 4, + 1, + 0, + 0, + 1, + 1, + 1, + 4, + 6, + 4, + 1, + 2, + 2, + 1, + 0, + 2, + 1, + 1 + ], + "weighted_loads": [ + 0.3042314164340496, + 0.0, + 0.03593546897172928, + 0.0, + 0.06803128868341446, + 0.0, + 0.0, + 0.20371020585298538, + 0.05123066157102585, + 0.04571980983018875, + 0.08450151607394218, + 0.1124972440302372, + 0.2935308888554573, + 0.11770270019769669, + 0.11850577965378761, + 0.5609150137752295, + 0.059602849185466766, + 0.0, + 0.0, + 0.04048912599682808, + 0.02223910577595234, + 0.45771555975079536, + 0.27580026164650917, + 0.0, + 0.5098458603024483, + 0.04259365051984787, + 0.20716950297355652, + 0.3342159353196621, + 0.0, + 0.5089886337518692, + 0.1972406730055809, + 0.18441088497638702, + 0.8735439889132977, + 0.08055631816387177, + 0.3262942247092724, + 0.0, + 0.08151540905237198, + 0.1559009999036789, + 0.2094709537923336, + 0.22741247341036797, + 0.0, + 0.3005770780146122, + 0.28406062349677086, + 0.4952957443892956, + 0.3449869304895401, + 0.14397740736603737, + 0.27168308943510056, + 0.029812676832079887, + 0.0, + 0.0, + 0.04075540229678154, + 0.039770402014255524, + 0.04160695895552635, + 0.15656888484954834, + 0.4700561221688986, + 0.29935116693377495, + 0.046127043664455414, + 0.12823015823960304, + 0.0996498204767704, + 0.06574883311986923, + 0.0, + 0.14924368634819984, + 0.039554618299007416, + 0.028357185423374176 + ], + "unique_experts": 51, + "load_cv": 0.9196080754026027, + "normalized_load_entropy": 0.8942030646717366, + "max_load_share": 0.06944444444444445 + }, + "full_input": { + "tokens": 49, + "top_k": 6, + "decisions": 294, + "ordered_route_sha256": "91543c380737cd445e56107994bf993c642b22a5883d216b63ce04de344f8a6a", + "route_weight_sha256": "b2351e2dbeec01ca828e7f5ecddf21049b6a8d4935562168b73bd2539cc66674", + "loads": [ + 9, + 1, + 3, + 8, + 1, + 0, + 2, + 3, + 1, + 5, + 9, + 3, + 6, + 10, + 2, + 14, + 1, + 7, + 3, + 1, + 4, + 7, + 3, + 7, + 8, + 10, + 9, + 6, + 5, + 6, + 5, + 3, + 14, + 2, + 6, + 0, + 2, + 1, + 11, + 4, + 7, + 8, + 8, + 7, + 2, + 7, + 4, + 1, + 0, + 1, + 3, + 1, + 3, + 4, + 7, + 9, + 1, + 6, + 2, + 1, + 0, + 3, + 6, + 1 + ], + "weighted_loads": [ + 0.5257625449448824, + 0.036181773990392685, + 0.14944224432110786, + 0.6290981322526932, + 0.06803128868341446, + 0.0, + 0.09650560468435287, + 0.20371020585298538, + 0.05123066157102585, + 0.18867386132478714, + 0.5582465082406998, + 0.1309751234948635, + 0.35503075271844864, + 0.7122239954769611, + 0.11850577965378761, + 0.7529437467455864, + 0.059602849185466766, + 0.6643123403191566, + 0.3506688065826893, + 0.04048912599682808, + 0.2774615790694952, + 0.5061501637101173, + 0.27580026164650917, + 0.2959496397525072, + 0.9002043381333351, + 0.5228184200823307, + 0.785523846745491, + 0.46161872148513794, + 0.18737539649009705, + 0.5443601123988628, + 0.1972406730055809, + 0.18441088497638702, + 1.1927199624478817, + 0.08055631816387177, + 0.3262942247092724, + 0.0, + 0.08151540905237198, + 0.1559009999036789, + 0.49085284024477005, + 0.22741247341036797, + 0.9929640516638756, + 0.44914693385362625, + 0.5843625515699387, + 0.5503490716218948, + 0.3449869304895401, + 1.0646349824965, + 0.27168308943510056, + 0.029812676832079887, + 0.0, + 0.03393636271357536, + 0.1847820095717907, + 0.039770402014255524, + 0.1805652715265751, + 0.15656888484954834, + 0.515847584232688, + 0.6775652207434177, + 0.046127043664455414, + 0.3233977723866701, + 0.0996498204767704, + 0.06574883311986923, + 0.0, + 0.1988690420985222, + 0.49015506729483604, + 0.028357185423374176 + ], + "unique_experts": 60, + "load_cv": 0.7488865970059542, + "normalized_load_entropy": 0.9281440882426483, + "max_load_share": 0.047619047619047616 + } + }, + "s1_period": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "06cd4fd12db78f0fe5958c106b6225d9b5e03719faf2b5837fea2f0f121c2448", + "route_weight_sha256": "46c189158e901a4ccdfbf7a3ab5aa08dcde23e0fbcecc624656d7f0a0bb8169a", + "loads": [ + 3, + 0, + 0, + 0, + 2, + 0, + 0, + 3, + 1, + 1, + 2, + 2, + 4, + 2, + 2, + 10, + 1, + 0, + 0, + 1, + 0, + 6, + 3, + 1, + 4, + 1, + 3, + 3, + 0, + 4, + 4, + 4, + 7, + 2, + 7, + 0, + 2, + 1, + 4, + 4, + 1, + 4, + 4, + 4, + 2, + 3, + 4, + 0, + 0, + 0, + 1, + 1, + 2, + 4, + 5, + 4, + 1, + 2, + 2, + 1, + 1, + 3, + 1, + 0 + ], + "weighted_loads": [ + 0.29077278822660446, + 0.0, + 0.0, + 0.0, + 0.1021545771509409, + 0.0, + 0.0, + 0.20345188304781914, + 0.04737447574734688, + 0.04766978695988655, + 0.09610630199313164, + 0.11047080904245377, + 0.2846344895660877, + 0.1174214668571949, + 0.1089898832142353, + 0.5177269596606493, + 0.057253383100032806, + 0.0, + 0.0, + 0.04084420204162598, + 0.0, + 0.4483020566403866, + 0.2561780549585819, + 0.04451798275113106, + 0.5551260635256767, + 0.06396929919719696, + 0.20908423513174057, + 0.33377011492848396, + 0.0, + 0.453464288264513, + 0.15680984035134315, + 0.22386181727051735, + 0.8775859773159027, + 0.08533725887537003, + 0.3964454233646393, + 0.0, + 0.08474746346473694, + 0.14567974209785461, + 0.17219488322734833, + 0.24131811782717705, + 0.04660360515117645, + 0.27800336852669716, + 0.2799238748848438, + 0.4138127788901329, + 0.344988152384758, + 0.14326633140444756, + 0.24572153761982918, + 0.0, + 0.0, + 0.0, + 0.04426025226712227, + 0.04132826626300812, + 0.08491092920303345, + 0.164213664829731, + 0.42924977093935013, + 0.28363030031323433, + 0.05166443809866905, + 0.14716918021440506, + 0.10481799766421318, + 0.06485484540462494, + 0.03890691697597504, + 0.17731140553951263, + 0.038723088800907135, + 0.0 + ], + "unique_experts": 50, + "load_cv": 0.9026709338484401, + "normalized_load_entropy": 0.8953047712454919, + "max_load_share": 0.06944444444444445 + }, + "full_input": { + "tokens": 65, + "top_k": 6, + "decisions": 390, + "ordered_route_sha256": "b255b68b460c5c3030ec4576ba47ff3c75a487645d36b4eed24628d71cb49914", + "route_weight_sha256": "37f734218edf3c8c2f21a0fcc7b292160844642bc19cc424484ec3cbdb0ba661", + "loads": [ + 10, + 1, + 3, + 8, + 8, + 0, + 3, + 4, + 1, + 7, + 11, + 4, + 4, + 10, + 2, + 19, + 3, + 8, + 3, + 1, + 0, + 7, + 3, + 10, + 13, + 25, + 12, + 4, + 1, + 5, + 5, + 5, + 9, + 2, + 7, + 0, + 7, + 3, + 10, + 5, + 14, + 9, + 9, + 5, + 4, + 8, + 6, + 2, + 0, + 0, + 3, + 7, + 6, + 4, + 6, + 12, + 8, + 19, + 3, + 3, + 2, + 8, + 9, + 0 + ], + "weighted_loads": [ + 0.586007833480835, + 0.04310368373990059, + 0.12249461561441422, + 0.7126618288457394, + 0.49702296033501625, + 0.0, + 0.11647601425647736, + 0.25808295980095863, + 0.04737447574734688, + 0.2407462950795889, + 0.6953820250928402, + 0.17618044465780258, + 0.2846344895660877, + 0.7224497757852077, + 0.1089898832142353, + 0.9764544311910868, + 0.22911541908979416, + 0.6510592103004456, + 0.1543060913681984, + 0.04084420204162598, + 0.0, + 0.5251878164708614, + 0.2561780549585819, + 0.6972772851586342, + 1.0932173281908035, + 1.6509554646909237, + 0.9341291766613722, + 0.37345054373145103, + 0.03035205416381359, + 0.5330822058022022, + 0.21862858533859253, + 0.2633301615715027, + 0.9577734172344208, + 0.08533725887537003, + 0.3964454233646393, + 0.0, + 0.34379271045327187, + 0.21889377385377884, + 0.6186653710901737, + 0.27525264769792557, + 1.6161773763597012, + 0.5907638892531395, + 0.5133052803575993, + 0.43260933086276054, + 0.5807673893868923, + 1.583355437964201, + 0.4584854058921337, + 0.13270198553800583, + 0.0, + 0.0, + 0.2429119311273098, + 0.33310954459011555, + 0.34928009286522865, + 0.164213664829731, + 0.5171860232949257, + 0.8794735409319401, + 0.6735596694052219, + 1.0577061958611012, + 0.1275041438639164, + 0.15760178118944168, + 0.07494786381721497, + 0.44519251585006714, + 0.6274562422186136, + 0.0 + ], + "unique_experts": 58, + "load_cv": 0.8016911776034497, + "normalized_load_entropy": 0.9235967000068782, + "max_load_share": 0.0641025641025641 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 24, + "ordered_topk_exact_tokens": 16, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.9404761904761906, + "mean_token_weighted_tv": 0.014510372032721838, + "aggregate_load_tv": 0.034722222222222224 + }, + "system_bos": { + "tokens": 24, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 18, + "mean_set_jaccard": 0.9196428571428571, + "mean_token_weighted_tv": 0.021736665822875995, + "aggregate_load_tv": 0.04166666666666667 + }, + "system_x": { + "tokens": 24, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8630952380952381, + "mean_token_weighted_tv": 0.03275617766970148, + "aggregate_load_tv": 0.0625 + }, + "system_period": { + "tokens": 24, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.8839285714285715, + "mean_token_weighted_tv": 0.02916898384379844, + "aggregate_load_tv": 0.0625 + }, + "bos_at_s0": { + "tokens": 24, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.9404761904761906, + "mean_token_weighted_tv": 0.020497770902390283, + "aggregate_load_tv": 0.027777777777777776 + }, + "bos_at_s1": { + "tokens": 24, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.8928571428571428, + "mean_token_weighted_tv": 0.02919658199728777, + "aggregate_load_tv": 0.055555555555555566 + }, + "x_at_s0": { + "tokens": 24, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 12, + "mean_set_jaccard": 0.8482142857142859, + "mean_token_weighted_tv": 0.03437228275773426, + "aggregate_load_tv": 0.06944444444444445 + }, + "x_at_s1": { + "tokens": 24, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8720238095238096, + "mean_token_weighted_tv": 0.03800515306647867, + "aggregate_load_tv": 0.0625 + }, + "period_at_s0": { + "tokens": 24, + "ordered_topk_exact_tokens": 8, + "set_exact_tokens": 12, + "mean_set_jaccard": 0.8392857142857144, + "mean_token_weighted_tv": 0.03709247576383253, + "aggregate_load_tv": 0.0763888888888889 + }, + "period_at_s1": { + "tokens": 24, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8630952380952381, + "mean_token_weighted_tv": 0.04021018735753993, + "aggregate_load_tv": 0.06944444444444445 + } + } + }, + "layer_18": { + "layer": 18, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "95e7763e3739e123f5afd09e2ca1695cd00b32144117c4ee92c32928b3e2732a", + "route_weight_sha256": "3d903cca9a27333b2790e6744b187c60f3ecd92a8d676c8489f98db07066a7e0", + "loads": [ + 0, + 4, + 3, + 2, + 14, + 9, + 0, + 0, + 0, + 0, + 0, + 9, + 0, + 2, + 3, + 0, + 0, + 2, + 1, + 1, + 1, + 0, + 0, + 7, + 0, + 2, + 0, + 0, + 0, + 0, + 3, + 2, + 4, + 6, + 4, + 2, + 5, + 0, + 3, + 5, + 5, + 0, + 1, + 0, + 0, + 1, + 0, + 15, + 1, + 5, + 0, + 4, + 0, + 1, + 0, + 2, + 2, + 3, + 4, + 1, + 2, + 0, + 0, + 3 + ], + "weighted_loads": [ + 0.0, + 0.24309065379202366, + 0.13005908019840717, + 0.16037707030773163, + 1.0528851989656687, + 1.0064217112958431, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.7169611044228077, + 0.0, + 0.10019931197166443, + 0.3012755699455738, + 0.0, + 0.0, + 0.11128446832299232, + 0.046354182064533234, + 0.029564594849944115, + 0.03154993802309036, + 0.0, + 0.0, + 0.4068540148437023, + 0.0, + 0.15288259834051132, + 0.0, + 0.0, + 0.0, + 0.0, + 0.09975675120949745, + 0.16642343625426292, + 0.2251289300620556, + 0.49292854592204094, + 0.355407040566206, + 0.08823404088616371, + 0.8929477445781231, + 0.0, + 0.15252698957920074, + 0.1868580114096403, + 0.2349461428821087, + 0.0, + 0.026365084573626518, + 0.0, + 0.0, + 0.031507719308137894, + 0.0, + 1.1950311437249184, + 0.07981155067682266, + 0.3357812035828829, + 0.0, + 0.2815254107117653, + 0.0, + 0.034637488424777985, + 0.0, + 0.08246168866753578, + 0.08267403021454811, + 0.16006064042448997, + 0.17556489259004593, + 0.08531688153743744, + 0.06463745422661304, + 0.0, + 0.0, + 0.1425047069787979 + ], + "unique_experts": 38, + "load_cv": 1.3855515459266585, + "normalized_load_entropy": 0.8048322638534015, + "max_load_share": 0.10416666666666667 + }, + "full_input": { + "tokens": 49, + "top_k": 6, + "decisions": 294, + "ordered_route_sha256": "1529716c19993c9a4cfe1892e6e74542ebb225840fcf9d6174f2d8c6ab71faa1", + "route_weight_sha256": "ad517a4a64c9375e97f1ab838adcb91df2581c081c539608e3b48651c274769d", + "loads": [ + 6, + 5, + 15, + 2, + 14, + 11, + 0, + 0, + 9, + 0, + 1, + 13, + 1, + 2, + 8, + 4, + 0, + 2, + 21, + 1, + 1, + 2, + 0, + 8, + 0, + 2, + 0, + 0, + 0, + 0, + 12, + 2, + 4, + 6, + 4, + 6, + 6, + 4, + 3, + 7, + 10, + 0, + 4, + 0, + 0, + 1, + 8, + 15, + 4, + 17, + 2, + 6, + 9, + 7, + 0, + 2, + 4, + 3, + 5, + 5, + 2, + 3, + 0, + 5 + ], + "weighted_loads": [ + 0.3810088559985161, + 0.31828867830336094, + 1.1711224243044853, + 0.16037707030773163, + 1.0528851989656687, + 1.0552687421441078, + 0.0, + 0.0, + 0.6604007259011269, + 0.0, + 0.010975132696330547, + 1.105065744370222, + 0.030220678076148033, + 0.10019931197166443, + 1.1576242819428444, + 0.1319570578634739, + 0.0, + 0.11128446832299232, + 2.018065731972456, + 0.029564594849944115, + 0.03154993802309036, + 0.05110938288271427, + 0.0, + 0.41865442879498005, + 0.0, + 0.15288259834051132, + 0.0, + 0.0, + 0.0, + 0.0, + 0.6332059456035495, + 0.16642343625426292, + 0.2251289300620556, + 0.49292854592204094, + 0.355407040566206, + 0.2871510609984398, + 0.9164175074547529, + 0.12130767293274403, + 0.15252698957920074, + 0.23448649235069752, + 0.4706920199096203, + 0.0, + 0.11077006161212921, + 0.0, + 0.0, + 0.031507719308137894, + 1.4227906912565231, + 1.1950311437249184, + 0.22184766083955765, + 0.8786619454622269, + 0.06102356128394604, + 0.46112655848264694, + 0.6064442247152328, + 0.44223910197615623, + 0.0, + 0.08246168866753578, + 1.0804932154715061, + 0.16006064042448997, + 0.20486478507518768, + 0.24878631345927715, + 0.06463745422661304, + 0.0957681592553854, + 0.0, + 0.23530585318803787 + ], + "unique_experts": 49, + "load_cv": 1.0437910449301728, + "normalized_load_entropy": 0.8704401558765346, + "max_load_share": 0.07142857142857142 + } + }, + "s1_eos": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "51dfc057cf92f4c57e0d531648789184abd088bd21ce124460c562b9b68bf8f6", + "route_weight_sha256": "0b40fecd747bce6a18baf73235272759b4a946268ed033da89a68bca379dca53", + "loads": [ + 0, + 4, + 2, + 2, + 16, + 10, + 0, + 0, + 0, + 0, + 1, + 9, + 1, + 2, + 3, + 0, + 0, + 2, + 1, + 1, + 0, + 0, + 0, + 7, + 1, + 2, + 0, + 1, + 0, + 0, + 3, + 3, + 4, + 6, + 4, + 2, + 4, + 0, + 3, + 2, + 4, + 0, + 1, + 0, + 0, + 1, + 0, + 15, + 1, + 5, + 0, + 4, + 0, + 1, + 0, + 2, + 2, + 3, + 3, + 1, + 2, + 0, + 0, + 3 + ], + "weighted_loads": [ + 0.0, + 0.24871999956667423, + 0.10812849551439285, + 0.15354540944099426, + 1.120955714955926, + 1.0254709348082542, + 0.0, + 0.0, + 0.0, + 0.0, + 0.03344610333442688, + 0.6985144279897213, + 0.0358322337269783, + 0.10396758466959, + 0.29919466376304626, + 0.0, + 0.0, + 0.10864448174834251, + 0.04146089777350426, + 0.029161665588617325, + 0.0, + 0.0, + 0.0, + 0.41101280599832535, + 0.02869250625371933, + 0.15080155804753304, + 0.0, + 0.03742794319987297, + 0.0, + 0.0, + 0.10325540974736214, + 0.19829084910452366, + 0.21529854461550713, + 0.47721900045871735, + 0.35214483737945557, + 0.09322158992290497, + 0.8324620760977268, + 0.0, + 0.16152838617563248, + 0.06886685639619827, + 0.18966681510210037, + 0.0, + 0.027210135012865067, + 0.0, + 0.0, + 0.030781053006649017, + 0.0, + 1.2288292795419693, + 0.08001012355089188, + 0.344912625849247, + 0.0, + 0.2733810991048813, + 0.0, + 0.03396833315491676, + 0.0, + 0.08148229122161865, + 0.08050903677940369, + 0.16734017059206963, + 0.14133165404200554, + 0.07986406981945038, + 0.062394432723522186, + 0.0, + 0.0, + 0.1435460690408945 + ], + "unique_experts": 41, + "load_cv": 1.4250839264867399, + "normalized_load_entropy": 0.8102570866474532, + "max_load_share": 0.1111111111111111 + }, + "full_input": { + "tokens": 65, + "top_k": 6, + "decisions": 390, + "ordered_route_sha256": "ca701c2f042978abc474d8f7d5324b711328d6746450ce1a1b404893e4c6c0e0", + "route_weight_sha256": "dd97993156b906bc5487e77d74eb54607d6b86872659ff717bf3398ef701103f", + "loads": [ + 8, + 7, + 15, + 2, + 17, + 13, + 0, + 2, + 11, + 1, + 2, + 13, + 1, + 3, + 12, + 2, + 0, + 12, + 25, + 2, + 0, + 1, + 0, + 7, + 1, + 2, + 0, + 1, + 0, + 1, + 15, + 5, + 5, + 7, + 8, + 18, + 5, + 7, + 4, + 4, + 9, + 0, + 4, + 6, + 1, + 1, + 18, + 19, + 4, + 19, + 1, + 6, + 9, + 11, + 2, + 2, + 5, + 9, + 5, + 6, + 2, + 3, + 0, + 9 + ], + "weighted_loads": [ + 0.41981921158730984, + 0.38555201329290867, + 1.184774486348033, + 0.15354540944099426, + 1.1591640654951334, + 1.1126269660890102, + 0.0, + 0.07005714625120163, + 1.011863086372614, + 0.037187498062849045, + 0.04519403446465731, + 1.0584234930574894, + 0.0358322337269783, + 0.14867999404668808, + 1.319171892479062, + 0.05879911594092846, + 0.0, + 0.6972299478948116, + 2.717897590249777, + 0.16488156095147133, + 0.0, + 0.028038278222084045, + 0.0, + 0.41101280599832535, + 0.02869250625371933, + 0.15080155804753304, + 0.0, + 0.03742794319987297, + 0.0, + 0.03580532968044281, + 0.8859337419271469, + 0.44652273692190647, + 0.2713729292154312, + 0.5531822443008423, + 0.7718814387917519, + 1.457763735204935, + 0.8559304121881723, + 0.27822205424308777, + 0.19951292127370834, + 0.11664847284555435, + 0.38938354328274727, + 0.0, + 0.11845554038882256, + 0.49575258791446686, + 0.03302628546953201, + 0.030781053006649017, + 2.6549117490649223, + 1.4079817365854979, + 0.17625202238559723, + 0.9612063448876143, + 0.026267167180776596, + 0.4572755917906761, + 0.5837701614946127, + 0.6301363743841648, + 0.1185334287583828, + 0.08148229122161865, + 1.0920885354280472, + 0.4160650372505188, + 0.47576240822672844, + 0.36863247863948345, + 0.062394432723522186, + 0.10339738614857197, + 0.0, + 0.36910530738532543 + ], + "unique_experts": 56, + "load_cv": 0.9694206841476956, + "normalized_load_entropy": 0.8886161185160961, + "max_load_share": 0.0641025641025641 + } + }, + "s0_bos": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "7f692e3657ae8bb4250d2522521921ba9043b060e7163093927791ca52bc1a24", + "route_weight_sha256": "3c81cbb280b3b97689fee2f5271a794da637b97a24d442598c0f98cace976936", + "loads": [ + 0, + 4, + 2, + 2, + 14, + 10, + 0, + 0, + 0, + 0, + 0, + 9, + 1, + 2, + 3, + 0, + 0, + 2, + 1, + 1, + 0, + 0, + 0, + 7, + 1, + 2, + 0, + 1, + 0, + 0, + 2, + 3, + 6, + 6, + 3, + 3, + 4, + 0, + 3, + 3, + 5, + 0, + 1, + 0, + 0, + 1, + 0, + 15, + 2, + 5, + 0, + 4, + 0, + 0, + 0, + 2, + 2, + 3, + 4, + 1, + 1, + 0, + 0, + 3 + ], + "weighted_loads": [ + 0.0, + 0.26009236462414265, + 0.09762945398688316, + 0.1609349064528942, + 1.0478641241788864, + 1.0969159789383411, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.7264679782092571, + 0.03359504044055939, + 0.10318488627672195, + 0.2987861968576908, + 0.0, + 0.0, + 0.11548560112714767, + 0.044196031987667084, + 0.029220346361398697, + 0.0, + 0.0, + 0.0, + 0.401350412517786, + 0.02848207578063011, + 0.16826703026890755, + 0.0, + 0.028950313106179237, + 0.0, + 0.0, + 0.05373014509677887, + 0.21259363368153572, + 0.29698076471686363, + 0.5092786736786366, + 0.3221435248851776, + 0.12809095904231071, + 0.8497863933444023, + 0.0, + 0.16310303658246994, + 0.12922750040888786, + 0.242677329108119, + 0.0, + 0.024243317544460297, + 0.0, + 0.0, + 0.03292076289653778, + 0.0, + 1.1549127213656902, + 0.11424412950873375, + 0.3414282537996769, + 0.0, + 0.2841910719871521, + 0.0, + 0.0, + 0.0, + 0.08364584669470787, + 0.07634699903428555, + 0.1615905500948429, + 0.17381751537322998, + 0.08616277575492859, + 0.0300863329321146, + 0.0, + 0.0, + 0.14126348495483398 + ], + "unique_experts": 39, + "load_cv": 1.3944333775567925, + "normalized_load_entropy": 0.8065796886269281, + "max_load_share": 0.10416666666666667 + }, + "full_input": { + "tokens": 49, + "top_k": 6, + "decisions": 294, + "ordered_route_sha256": "8f1dd4a1a8512e2ab096e36cfe9d23a71a45f6c67528d0418c349e97561cf48b", + "route_weight_sha256": "d36a306b020d6dd6c40b6d253e1dc84501bdfe21d7a2ce911c2268d4cab58996", + "loads": [ + 6, + 5, + 13, + 2, + 14, + 12, + 0, + 0, + 9, + 0, + 0, + 12, + 3, + 2, + 8, + 3, + 0, + 2, + 21, + 1, + 0, + 2, + 0, + 8, + 1, + 2, + 1, + 1, + 0, + 0, + 9, + 3, + 6, + 7, + 3, + 9, + 4, + 4, + 3, + 7, + 11, + 1, + 5, + 0, + 0, + 1, + 9, + 15, + 5, + 16, + 2, + 6, + 9, + 5, + 0, + 2, + 3, + 4, + 5, + 3, + 1, + 3, + 0, + 5 + ], + "weighted_loads": [ + 0.3810088559985161, + 0.3352903891354799, + 1.1120485812425613, + 0.1609349064528942, + 1.0478641241788864, + 1.1457630097866058, + 0.0, + 0.0, + 0.6418954655528069, + 0.0, + 0.0, + 0.9813917987048626, + 0.30119074136018753, + 0.10318488627672195, + 1.0339145548641682, + 0.09847104176878929, + 0.0, + 0.11548560112714767, + 1.926985714584589, + 0.029220346361398697, + 0.0, + 0.05382753163576126, + 0.0, + 0.44955042377114296, + 0.02848207578063011, + 0.16826703026890755, + 0.04624764621257782, + 0.028950313106179237, + 0.0, + 0.0, + 0.5272407606244087, + 0.21259363368153572, + 0.29698076471686363, + 0.5733599103987217, + 0.3221435248851776, + 0.42868013493716717, + 0.8497863933444023, + 0.12395473942160606, + 0.16310303658246994, + 0.3335965499281883, + 0.5713815484195948, + 0.06960555166006088, + 0.18147733435034752, + 0.0, + 0.0, + 0.03292076289653778, + 1.3993737287819386, + 1.1549127213656902, + 0.25628023967146873, + 0.8319109659641981, + 0.06109507568180561, + 0.4784509986639023, + 0.6064442247152328, + 0.3540514260530472, + 0.0, + 0.08364584669470787, + 0.2997536715120077, + 0.19051303155720234, + 0.20311740785837173, + 0.19292400777339935, + 0.0300863329321146, + 0.09755864180624485, + 0.0, + 0.23406463116407394 + ], + "unique_experts": 51, + "load_cv": 1.0142900486728543, + "normalized_load_entropy": 0.8776554703241671, + "max_load_share": 0.07142857142857142 + } + }, + "s1_bos": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "4089c2768984160b4f4e94cdb1bd7d266c179e1b5de6bba7202106f4382c7a1e", + "route_weight_sha256": "81f6c32101030558baa3995ec3e699ec4341339c394813c9f73262ca38fb03b2", + "loads": [ + 0, + 5, + 2, + 2, + 11, + 10, + 0, + 0, + 1, + 0, + 0, + 9, + 1, + 2, + 3, + 0, + 0, + 2, + 1, + 1, + 0, + 0, + 0, + 7, + 1, + 2, + 0, + 1, + 0, + 1, + 3, + 3, + 4, + 6, + 4, + 4, + 4, + 0, + 3, + 2, + 5, + 0, + 1, + 0, + 0, + 1, + 0, + 15, + 1, + 4, + 2, + 4, + 0, + 0, + 0, + 3, + 2, + 3, + 3, + 1, + 1, + 0, + 0, + 3 + ], + "weighted_loads": [ + 0.0, + 0.324892271310091, + 0.1028621681034565, + 0.1460656113922596, + 0.8498358055949211, + 1.0713868960738182, + 0.0, + 0.0, + 0.02794813923537731, + 0.0, + 0.0, + 0.7037619985640049, + 0.03157791867852211, + 0.10551629588007927, + 0.30602630972862244, + 0.0, + 0.0, + 0.11042468622326851, + 0.04503852128982544, + 0.03117043897509575, + 0.0, + 0.0, + 0.0, + 0.41992854326963425, + 0.031572338193655014, + 0.1683843471109867, + 0.0, + 0.02936384081840515, + 0.0, + 0.028361264616250992, + 0.0885815154761076, + 0.2149925995618105, + 0.2224181517958641, + 0.4962279163300991, + 0.3759722150862217, + 0.15175184234976768, + 0.8603729493916035, + 0.0, + 0.16898398473858833, + 0.07793522253632545, + 0.23034654930233955, + 0.0, + 0.022327393293380737, + 0.0, + 0.0, + 0.03462975472211838, + 0.0, + 1.175065916031599, + 0.07683997601270676, + 0.3057401403784752, + 0.06984175369143486, + 0.2735064700245857, + 0.0, + 0.0, + 0.0, + 0.11968203634023666, + 0.08080681972205639, + 0.15891732834279537, + 0.13965678587555885, + 0.08222449570894241, + 0.03205650672316551, + 0.0, + 0.0, + 0.14151334762573242 + ], + "unique_experts": 42, + "load_cv": 1.3028932666176194, + "normalized_load_entropy": 0.8259766748631816, + "max_load_share": 0.10416666666666667 + }, + "full_input": { + "tokens": 65, + "top_k": 6, + "decisions": 390, + "ordered_route_sha256": "6b3e81f2cab1169203a6e218f42bfc05e3d0c03bafde201e81b7a318f3dd7b13", + "route_weight_sha256": "a732f5fcf0f5877533d07479d49d2991ccc33973275145c49b198d397b636612", + "loads": [ + 8, + 8, + 13, + 2, + 12, + 13, + 0, + 2, + 12, + 1, + 0, + 13, + 1, + 3, + 12, + 3, + 0, + 12, + 26, + 2, + 0, + 1, + 0, + 7, + 1, + 2, + 0, + 1, + 0, + 2, + 14, + 5, + 5, + 7, + 8, + 20, + 4, + 6, + 4, + 4, + 11, + 1, + 5, + 6, + 1, + 1, + 19, + 19, + 4, + 18, + 3, + 6, + 9, + 11, + 2, + 3, + 4, + 9, + 5, + 5, + 1, + 4, + 0, + 9 + ], + "weighted_loads": [ + 0.41981921158730984, + 0.46172428503632545, + 1.118028536438942, + 0.1460656113922596, + 0.8880441561341286, + 1.1585429273545742, + 0.0, + 0.07005714625120163, + 1.0174384731799364, + 0.037187498062849045, + 0.0, + 1.0319807715713978, + 0.03157791867852211, + 0.15022870525717735, + 1.4326673839241266, + 0.091664994135499, + 0.0, + 0.6990101523697376, + 2.712170347571373, + 0.16689033433794975, + 0.0, + 0.02954174391925335, + 0.0, + 0.41992854326963425, + 0.031572338193655014, + 0.1683843471109867, + 0.0, + 0.02936384081840515, + 0.0, + 0.0641665942966938, + 0.824833769351244, + 0.4632244873791933, + 0.2784925363957882, + 0.572191160172224, + 0.795708816498518, + 1.5138164665549994, + 0.8603729493916035, + 0.25743772834539413, + 0.2069685198366642, + 0.12571683898568153, + 0.47509488835930824, + 0.043993640691041946, + 0.17127308622002602, + 0.49575258791446686, + 0.03302628546953201, + 0.03462975472211838, + 2.639724977314472, + 1.3542183730751276, + 0.1730818748474121, + 0.928138630464673, + 0.09610892087221146, + 0.4706196114420891, + 0.5837701614946127, + 0.5886794254183769, + 0.1185334287583828, + 0.11968203634023666, + 0.34071518294513226, + 0.43140880204737186, + 0.47408754006028175, + 0.42987676709890366, + 0.03205650672316551, + 0.13885999284684658, + 0.0, + 0.36707258597016335 + ], + "unique_experts": 56, + "load_cv": 0.9615760676406745, + "normalized_load_entropy": 0.8912115800656418, + "max_load_share": 0.06666666666666667 + } + }, + "s0_x": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "383328f90882a5903005c49168e08de5c4304d1824e84e3443358469fd602920", + "route_weight_sha256": "ba16b52665ba4106a77f7d1e44d1de30ccef66d4f46575eb4e8e2c7134bbdd28", + "loads": [ + 0, + 4, + 2, + 2, + 15, + 10, + 0, + 0, + 1, + 0, + 0, + 8, + 2, + 2, + 3, + 0, + 0, + 2, + 1, + 1, + 0, + 0, + 0, + 7, + 0, + 2, + 0, + 1, + 0, + 0, + 3, + 3, + 5, + 6, + 4, + 2, + 4, + 0, + 3, + 4, + 4, + 0, + 1, + 0, + 0, + 1, + 0, + 14, + 1, + 5, + 0, + 4, + 0, + 1, + 0, + 2, + 2, + 3, + 3, + 1, + 2, + 0, + 0, + 3 + ], + "weighted_loads": [ + 0.0, + 0.24917686358094215, + 0.1018458940088749, + 0.1539567932486534, + 1.0469123609364033, + 1.1012269631028175, + 0.0, + 0.0, + 0.046202972531318665, + 0.0, + 0.0, + 0.678696483373642, + 0.05696231313049793, + 0.09411711245775223, + 0.2897242195904255, + 0.0, + 0.0, + 0.11243369430303574, + 0.039114948362112045, + 0.03143298625946045, + 0.0, + 0.0, + 0.0, + 0.4045684114098549, + 0.0, + 0.18077655136585236, + 0.0, + 0.027473928406834602, + 0.0, + 0.0, + 0.09372471459209919, + 0.21533574163913727, + 0.25715916976332664, + 0.49287017434835434, + 0.3564870320260525, + 0.09185522794723511, + 0.8499901704490185, + 0.0, + 0.1589677780866623, + 0.1609907578676939, + 0.20879283174872398, + 0.0, + 0.02435377612709999, + 0.0, + 0.0, + 0.03573877736926079, + 0.0, + 1.1885530427098274, + 0.07948226481676102, + 0.33846061676740646, + 0.0, + 0.30161910131573677, + 0.0, + 0.03484858572483063, + 0.0, + 0.08554422855377197, + 0.07309425622224808, + 0.173988189548254, + 0.1391436867415905, + 0.08081817626953125, + 0.057913945987820625, + 0.0, + 0.0, + 0.13357912935316563 + ], + "unique_experts": 40, + "load_cv": 1.3653561919382786, + "normalized_load_entropy": 0.8144431001077976, + "max_load_share": 0.10416666666666667 + }, + "full_input": { + "tokens": 49, + "top_k": 6, + "decisions": 294, + "ordered_route_sha256": "d38239260ca00a43bfee7eb7b11dbdd07230f04e3ff71fb93fb114dd79f9e38b", + "route_weight_sha256": "68ddc2e0fb8a41d870cccaddf4d01d66b7d2f0c6531ca4a409ae1c1c2db00923", + "loads": [ + 7, + 5, + 14, + 2, + 15, + 12, + 0, + 0, + 10, + 0, + 0, + 12, + 3, + 2, + 8, + 3, + 0, + 2, + 21, + 1, + 0, + 1, + 0, + 7, + 0, + 2, + 0, + 1, + 0, + 0, + 10, + 3, + 5, + 7, + 4, + 6, + 4, + 4, + 3, + 6, + 9, + 0, + 3, + 0, + 0, + 1, + 8, + 14, + 5, + 17, + 1, + 8, + 10, + 8, + 0, + 2, + 3, + 5, + 6, + 3, + 2, + 3, + 0, + 6 + ], + "weighted_loads": [ + 0.4234214127063751, + 0.32437488809227943, + 1.2812230810523033, + 0.1539567932486534, + 1.0469123609364033, + 1.1500739939510822, + 0.0, + 0.0, + 0.6622154489159584, + 0.0, + 0.0, + 1.055274024605751, + 0.10323084332048893, + 0.09411711245775223, + 1.1944153234362602, + 0.09847104176878929, + 0.0, + 0.11243369430303574, + 1.9076610170304775, + 0.03143298625946045, + 0.0, + 0.025374451652169228, + 0.0, + 0.4045684114098549, + 0.0, + 0.18077655136585236, + 0.0, + 0.027473928406834602, + 0.0, + 0.0, + 0.4899331536144018, + 0.21533574163913727, + 0.25715916976332664, + 0.5397258996963501, + 0.3564870320260525, + 0.29096853360533714, + 0.8499901704490185, + 0.1264908853918314, + 0.1589677780866623, + 0.2086192388087511, + 0.45363014563918114, + 0.0, + 0.08061252534389496, + 0.0, + 0.0, + 0.03573877736926079, + 1.425871267914772, + 1.1885530427098274, + 0.2638681195676327, + 0.8655597809702158, + 0.026294318959116936, + 0.5392146613448858, + 0.7061807438731194, + 0.4447114169597626, + 0.0, + 0.08554422855377197, + 0.29650092869997025, + 0.22555383667349815, + 0.26742928847670555, + 0.1419115662574768, + 0.057913945987820625, + 0.09398453496396542, + 0.0, + 0.30579044856131077 + ], + "unique_experts": 48, + "load_cv": 1.0402381569637287, + "normalized_load_entropy": 0.8685211764614847, + "max_load_share": 0.07142857142857142 + } + }, + "s1_x": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "3d43e5e50d3c95e6cd8dc57c884613f452f540bc7c0b30510bc42d13e8a914e2", + "route_weight_sha256": "235c2b9af3b9db1ab800ad495e8f97d3637de32ca01bbac9536d96c03a6ce1b5", + "loads": [ + 0, + 4, + 3, + 2, + 14, + 10, + 0, + 0, + 1, + 0, + 1, + 9, + 1, + 2, + 3, + 0, + 0, + 2, + 1, + 1, + 0, + 0, + 0, + 7, + 1, + 2, + 0, + 2, + 0, + 1, + 2, + 3, + 3, + 6, + 4, + 4, + 4, + 0, + 3, + 3, + 3, + 0, + 0, + 0, + 0, + 1, + 1, + 15, + 2, + 4, + 0, + 4, + 0, + 0, + 0, + 2, + 2, + 3, + 3, + 1, + 1, + 0, + 0, + 3 + ], + "weighted_loads": [ + 0.0, + 0.26393504440784454, + 0.12697921507060528, + 0.14532676339149475, + 1.027794124558568, + 1.0684720277786255, + 0.0, + 0.0, + 0.05121622607111931, + 0.0, + 0.0364321805536747, + 0.713104709982872, + 0.03506738319993019, + 0.10114125162363052, + 0.2846728079020977, + 0.0, + 0.0, + 0.1094948798418045, + 0.03475974500179291, + 0.033162448555231094, + 0.0, + 0.0, + 0.0, + 0.39695778489112854, + 0.031016014516353607, + 0.169149961322546, + 0.0, + 0.07395831309258938, + 0.0, + 0.02820790745317936, + 0.052453551441431046, + 0.2023015096783638, + 0.17850705049932003, + 0.459504846483469, + 0.36344773322343826, + 0.1592574454843998, + 0.8295380957424641, + 0.0, + 0.17306044697761536, + 0.1301899030804634, + 0.15179625526070595, + 0.0, + 0.0, + 0.0, + 0.0, + 0.03396051004528999, + 0.03581618145108223, + 1.2740815617144108, + 0.11629233881831169, + 0.29616631753742695, + 0.0, + 0.271132905036211, + 0.0, + 0.0, + 0.0, + 0.07924702391028404, + 0.0649928692728281, + 0.18134233355522156, + 0.1335841789841652, + 0.07766146957874298, + 0.03168078884482384, + 0.0, + 0.0, + 0.1406463347375393 + ], + "unique_experts": 42, + "load_cv": 1.3562839573037446, + "normalized_load_entropy": 0.821879782317754, + "max_load_share": 0.10416666666666667 + }, + "full_input": { + "tokens": 65, + "top_k": 6, + "decisions": 390, + "ordered_route_sha256": "effb777aa1a6604fd00eb84785e13d942639009e76196c71e165491f474a6ec8", + "route_weight_sha256": "d5bbf981f271f2e10524e3af70bc9ae7f6545c862381a813f947640787559c46", + "loads": [ + 10, + 7, + 15, + 2, + 16, + 13, + 0, + 2, + 14, + 1, + 1, + 13, + 2, + 3, + 12, + 2, + 0, + 12, + 26, + 2, + 0, + 0, + 0, + 7, + 1, + 2, + 0, + 2, + 0, + 2, + 10, + 5, + 4, + 7, + 8, + 17, + 4, + 6, + 4, + 5, + 9, + 0, + 2, + 7, + 1, + 1, + 19, + 19, + 6, + 18, + 1, + 8, + 10, + 12, + 2, + 2, + 4, + 10, + 5, + 4, + 1, + 2, + 0, + 10 + ], + "weighted_loads": [ + 0.5845653396099806, + 0.400767058134079, + 1.2636610064655542, + 0.14532676339149475, + 1.103741755709052, + 1.1556280590593815, + 0.0, + 0.07005714625120163, + 1.096092600375414, + 0.037187498062849045, + 0.0364321805536747, + 1.0131827220320702, + 0.07265467941761017, + 0.1458536610007286, + 1.297650447115302, + 0.05879911594092846, + 0.0, + 0.6980803459882736, + 2.43149571493268, + 0.1688823439180851, + 0.0, + 0.0, + 0.0, + 0.39695778489112854, + 0.031016014516353607, + 0.169149961322546, + 0.0, + 0.07395831309258938, + 0.0, + 0.06401323713362217, + 0.5610420852899551, + 0.4505333974957466, + 0.23458143509924412, + 0.535468090325594, + 0.7831843346357346, + 1.4167858697474003, + 0.8295380957424641, + 0.25042590498924255, + 0.21104498207569122, + 0.1779715195298195, + 0.35188515670597553, + 0.0, + 0.054456986486911774, + 0.5438423119485378, + 0.03302628546953201, + 0.03396051004528999, + 2.582695573568344, + 1.4532340187579393, + 0.2510448507964611, + 0.8910043500363827, + 0.026267167180776596, + 0.5821421183645725, + 0.6608501058071852, + 0.6336742155253887, + 0.1185334287583828, + 0.07924702391028404, + 0.32490123249590397, + 0.4874676298350096, + 0.4680149331688881, + 0.2937166579067707, + 0.03168078884482384, + 0.06401128508150578, + 0.0, + 0.429263673722744 + ], + "unique_experts": 55, + "load_cv": 0.9789231830386887, + "normalized_load_entropy": 0.8853287131636549, + "max_load_share": 0.06666666666666667 + } + }, + "s0_period": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "17028f649ad6b7acb60bbec8c5afbbca9f64f3595670752fe77f68be130ab2be", + "route_weight_sha256": "d8d06a4200449219ca8c0ce51719b5b64c225d91ed3671b3a1e5f0839cd887fd", + "loads": [ + 0, + 4, + 2, + 1, + 13, + 10, + 0, + 0, + 1, + 0, + 0, + 9, + 2, + 2, + 3, + 0, + 0, + 2, + 1, + 1, + 0, + 0, + 0, + 7, + 1, + 2, + 0, + 2, + 0, + 0, + 2, + 3, + 5, + 6, + 4, + 3, + 4, + 0, + 3, + 3, + 4, + 0, + 1, + 0, + 0, + 1, + 1, + 15, + 1, + 4, + 0, + 4, + 0, + 0, + 0, + 3, + 2, + 3, + 3, + 1, + 2, + 0, + 0, + 3 + ], + "weighted_loads": [ + 0.0, + 0.2517597656697035, + 0.10218648239970207, + 0.10595161467790604, + 1.006997510790825, + 1.0893495604395866, + 0.0, + 0.0, + 0.04548526555299759, + 0.0, + 0.0, + 0.7105630673468113, + 0.06127304397523403, + 0.09885659068822861, + 0.29192420467734337, + 0.0, + 0.0, + 0.11099724844098091, + 0.044467657804489136, + 0.03378883749246597, + 0.0, + 0.0, + 0.0, + 0.4122391641139984, + 0.029616981744766235, + 0.18051796779036522, + 0.0, + 0.06961841136217117, + 0.0, + 0.0, + 0.05143370293080807, + 0.21487917378544807, + 0.26226576045155525, + 0.4967743270099163, + 0.35602855682373047, + 0.11789536103606224, + 0.8549253158271313, + 0.0, + 0.1649063117802143, + 0.12634559348225594, + 0.20950739830732346, + 0.0, + 0.022330714389681816, + 0.0, + 0.0, + 0.034694772213697433, + 0.03384855017066002, + 1.2074847240000963, + 0.07522749155759811, + 0.316559175029397, + 0.0, + 0.2989744320511818, + 0.0, + 0.0, + 0.0, + 0.11699170246720314, + 0.07622938603162766, + 0.17111201211810112, + 0.13977083191275597, + 0.07914184778928757, + 0.05903346836566925, + 0.0, + 0.0, + 0.14065669104456902 + ], + "unique_experts": 41, + "load_cv": 1.3425606637327303, + "normalized_load_entropy": 0.8199613790778222, + "max_load_share": 0.10416666666666667 + }, + "full_input": { + "tokens": 49, + "top_k": 6, + "decisions": 294, + "ordered_route_sha256": "ed8b58d5de123d8f9e5ca9657c09948d1072d8ebad08ba1e47ec6a4136909ffc", + "route_weight_sha256": "3d1c1f64c2e53151a28535482ee1ed417b7e189603120c351187734e3feee168", + "loads": [ + 7, + 5, + 13, + 1, + 13, + 12, + 0, + 0, + 10, + 0, + 0, + 13, + 2, + 2, + 8, + 4, + 0, + 2, + 22, + 1, + 0, + 2, + 0, + 7, + 1, + 2, + 0, + 2, + 0, + 0, + 9, + 4, + 5, + 7, + 4, + 7, + 4, + 4, + 3, + 5, + 9, + 0, + 3, + 0, + 0, + 1, + 10, + 15, + 4, + 16, + 2, + 6, + 10, + 8, + 0, + 3, + 3, + 5, + 5, + 3, + 2, + 3, + 0, + 5 + ], + "weighted_loads": [ + 0.4255659356713295, + 0.32695779018104076, + 1.1166056096553802, + 0.10595161467790604, + 1.006997510790825, + 1.1381965912878513, + 0.0, + 0.0, + 0.6714596897363663, + 0.0, + 0.0, + 1.0569224767386913, + 0.06127304397523403, + 0.09885659068822861, + 1.3218579590320587, + 0.1403852105140686, + 0.0, + 0.11099724844098091, + 2.06002813950181, + 0.03378883749246597, + 0.0, + 0.05739320255815983, + 0.0, + 0.4122391641139984, + 0.029616981744766235, + 0.18051796779036522, + 0.0, + 0.06961841136217117, + 0.0, + 0.0, + 0.46177189238369465, + 0.24506362713873386, + 0.26226576045155525, + 0.5390407517552376, + 0.35602855682373047, + 0.3221007287502289, + 0.8549253158271313, + 0.12133793160319328, + 0.1649063117802143, + 0.17397407442331314, + 0.46639633923768997, + 0.0, + 0.07858946360647678, + 0.0, + 0.0, + 0.034694772213697433, + 1.632202435284853, + 1.2074847240000963, + 0.2172636017203331, + 0.8368436433374882, + 0.0612605307251215, + 0.47517094761133194, + 0.6822119727730751, + 0.4814405273646116, + 0.0, + 0.11699170246720314, + 0.2996360585093498, + 0.24400543048977852, + 0.20455709472298622, + 0.13727304339408875, + 0.05903346836566925, + 0.09121204726397991, + 0.0, + 0.23345783725380898 + ], + "unique_experts": 49, + "load_cv": 1.026625052570515, + "normalized_load_entropy": 0.8739437314441397, + "max_load_share": 0.07482993197278912 + } + }, + "s1_period": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "fd0808197d0f5856828d7a8a5a073ff3630da81ae92fd8e387743993b014f67c", + "route_weight_sha256": "fafdf0d25eaefc68048bc01ea8ec059ad9bdf978d263811e6f7a89a02eca7ced", + "loads": [ + 0, + 4, + 2, + 2, + 14, + 10, + 0, + 0, + 1, + 0, + 2, + 9, + 2, + 2, + 3, + 0, + 0, + 2, + 1, + 1, + 0, + 0, + 0, + 6, + 1, + 2, + 0, + 2, + 0, + 1, + 2, + 3, + 3, + 6, + 5, + 4, + 4, + 0, + 3, + 4, + 3, + 0, + 0, + 0, + 0, + 0, + 1, + 14, + 1, + 4, + 0, + 4, + 0, + 0, + 0, + 2, + 2, + 3, + 3, + 1, + 2, + 0, + 0, + 3 + ], + "weighted_loads": [ + 0.0, + 0.2700116727501154, + 0.10443321987986565, + 0.13888993114233017, + 1.0063666757196188, + 1.0820322670042515, + 0.0, + 0.0, + 0.04336104914546013, + 0.0, + 0.06342004798352718, + 0.688884012401104, + 0.06552613899111748, + 0.10308826342225075, + 0.2830081060528755, + 0.0, + 0.0, + 0.10777144879102707, + 0.03484895080327988, + 0.03374302014708519, + 0.0, + 0.0, + 0.0, + 0.35801737010478973, + 0.03380434960126877, + 0.17282172292470932, + 0.0, + 0.08021895214915276, + 0.0, + 0.028780583292245865, + 0.052353378385305405, + 0.21218152344226837, + 0.19810932129621506, + 0.45450517907738686, + 0.4110533595085144, + 0.16977551952004433, + 0.8258815854787827, + 0.0, + 0.1760915443301201, + 0.15298360399901867, + 0.1542959026992321, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0338706336915493, + 1.1866073831915855, + 0.07529144734144211, + 0.3083246722817421, + 0.0, + 0.2697300389409065, + 0.0, + 0.0, + 0.0, + 0.08284186944365501, + 0.0656331367790699, + 0.18304657191038132, + 0.13905955478549004, + 0.06859137117862701, + 0.05977804958820343, + 0.0, + 0.0, + 0.1561492420732975 + ], + "unique_experts": 41, + "load_cv": 1.3263707095903692, + "normalized_load_entropy": 0.8234332938979482, + "max_load_share": 0.09722222222222222 + }, + "full_input": { + "tokens": 65, + "top_k": 6, + "decisions": 390, + "ordered_route_sha256": "9511414c6b904a79b7045e66c22dda443e93a30b3bb3716872243da54573533b", + "route_weight_sha256": "0aeadfe0cb35dbee11c090d0f20db243f71725ed4aebb681302ffac3db3dc19e", + "loads": [ + 8, + 7, + 13, + 2, + 16, + 13, + 0, + 2, + 12, + 2, + 2, + 13, + 3, + 3, + 12, + 2, + 0, + 12, + 25, + 2, + 0, + 0, + 0, + 6, + 1, + 2, + 0, + 2, + 0, + 2, + 10, + 6, + 4, + 7, + 9, + 19, + 4, + 6, + 4, + 6, + 9, + 0, + 2, + 6, + 1, + 0, + 20, + 18, + 5, + 18, + 1, + 9, + 10, + 13, + 2, + 2, + 4, + 10, + 5, + 4, + 2, + 2, + 0, + 10 + ], + "weighted_loads": [ + 0.41981921158730984, + 0.40684368647634983, + 1.119599588215351, + 0.13888993114233017, + 1.0840490255504847, + 1.1691882982850075, + 0.0, + 0.07005714625120163, + 1.0219379588961601, + 0.08487198501825333, + 0.06342004798352718, + 1.0202343612909317, + 0.0972789078950882, + 0.14780067279934883, + 1.4040360022336245, + 0.05879911594092846, + 0.0, + 0.6963569149374962, + 2.400450263172388, + 0.1694629155099392, + 0.0, + 0.0, + 0.0, + 0.35801737010478973, + 0.03380434960126877, + 0.17282172292470932, + 0.0, + 0.08021895214915276, + 0.0, + 0.06458591297268867, + 0.561429638415575, + 0.4890905972570181, + 0.25418370589613914, + 0.5304684229195118, + 0.8307899609208107, + 1.4860990159213543, + 0.8258815854787827, + 0.25530314818024635, + 0.21407607942819595, + 0.20076522044837475, + 0.3853028044104576, + 0.0, + 0.054456986486911774, + 0.49575258791446686, + 0.03302628546953201, + 0.0, + 2.6520850621163845, + 1.365759840235114, + 0.199621906504035, + 0.9110809024423361, + 0.026267167180776596, + 0.6464172080159187, + 0.645573066547513, + 0.7189360782504082, + 0.1185334287583828, + 0.08284186944365501, + 0.32554150000214577, + 0.5303702391684055, + 0.47349030897021294, + 0.27967234142124653, + 0.05977804958820343, + 0.06401128508150578, + 0.0, + 0.4160589799284935 + ], + "unique_experts": 54, + "load_cv": 0.9650704361576734, + "normalized_load_entropy": 0.8880206918057713, + "max_load_share": 0.0641025641025641 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 24, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.8928571428571429, + "mean_token_weighted_tv": 0.021868632563079398, + "aggregate_load_tv": 0.05555555555555555 + }, + "system_bos": { + "tokens": 24, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.8958333333333335, + "mean_token_weighted_tv": 0.02510861602301399, + "aggregate_load_tv": 0.0625 + }, + "system_x": { + "tokens": 24, + "ordered_topk_exact_tokens": 8, + "set_exact_tokens": 13, + "mean_set_jaccard": 0.8601190476190476, + "mean_token_weighted_tv": 0.031482125904100634, + "aggregate_load_tv": 0.0763888888888889 + }, + "system_period": { + "tokens": 24, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.8958333333333334, + "mean_token_weighted_tv": 0.02817924142194291, + "aggregate_load_tv": 0.05555555555555556 + }, + "bos_at_s0": { + "tokens": 24, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.8839285714285715, + "mean_token_weighted_tv": 0.026355540806738038, + "aggregate_load_tv": 0.0625 + }, + "bos_at_s1": { + "tokens": 24, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 13, + "mean_set_jaccard": 0.8601190476190478, + "mean_token_weighted_tv": 0.03147024036540339, + "aggregate_load_tv": 0.0625 + }, + "x_at_s0": { + "tokens": 24, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.8839285714285715, + "mean_token_weighted_tv": 0.029003643974040944, + "aggregate_load_tv": 0.055555555555555566 + }, + "x_at_s1": { + "tokens": 24, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.8958333333333334, + "mean_token_weighted_tv": 0.030286211093577247, + "aggregate_load_tv": 0.0625 + }, + "period_at_s0": { + "tokens": 24, + "ordered_topk_exact_tokens": 8, + "set_exact_tokens": 12, + "mean_set_jaccard": 0.8482142857142857, + "mean_token_weighted_tv": 0.031957726227119565, + "aggregate_load_tv": 0.08333333333333334 + }, + "period_at_s1": { + "tokens": 24, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 13, + "mean_set_jaccard": 0.8511904761904762, + "mean_token_weighted_tv": 0.036407506791874766, + "aggregate_load_tv": 0.0763888888888889 + } + } + }, + "layer_19": { + "layer": 19, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "a9c8cd18766243dad3333260b958d6d83e305640c0895dde7bb7cea6a50d17c5", + "route_weight_sha256": "c1495470323d29a05b8df2c4d8f22fc79862b7e7e4c049d27cd1e8876cacdc17", + "loads": [ + 3, + 3, + 4, + 0, + 1, + 11, + 1, + 0, + 0, + 12, + 3, + 1, + 3, + 18, + 0, + 0, + 1, + 0, + 6, + 3, + 0, + 1, + 5, + 4, + 1, + 0, + 0, + 1, + 1, + 0, + 2, + 0, + 0, + 7, + 0, + 4, + 0, + 1, + 0, + 0, + 3, + 0, + 1, + 1, + 1, + 0, + 0, + 4, + 0, + 4, + 0, + 0, + 2, + 8, + 0, + 15, + 1, + 2, + 2, + 0, + 0, + 2, + 1, + 0 + ], + "weighted_loads": [ + 0.3524497523903847, + 0.29657890275120735, + 0.2412419356405735, + 0.0, + 0.041644759476184845, + 0.9891058579087257, + 0.04577293246984482, + 0.0, + 0.0, + 0.8937867470085621, + 0.1744178868830204, + 0.04304776340723038, + 0.1388949528336525, + 1.4552361257374287, + 0.0, + 0.0, + 0.11083905398845673, + 0.0, + 0.5467964448034763, + 0.11145692318677902, + 0.0, + 0.0337795615196228, + 0.21093541011214256, + 0.748727835714817, + 0.06119178980588913, + 0.0, + 0.0, + 0.09583911299705505, + 0.04964934289455414, + 0.0, + 0.07440825179219246, + 0.0, + 0.0, + 0.34160076826810837, + 0.0, + 0.25509509816765785, + 0.0, + 0.03654241934418678, + 0.0, + 0.0, + 0.4624968022108078, + 0.0, + 0.04311201721429825, + 0.06093220040202141, + 0.04228584095835686, + 0.0, + 0.0, + 0.2086290791630745, + 0.0, + 0.15382543578743935, + 0.0, + 0.0, + 0.07305386662483215, + 0.5193561725318432, + 0.0, + 1.0806793849915266, + 0.04386284947395325, + 0.09112713858485222, + 0.05626458115875721, + 0.0, + 0.0, + 0.13959567621350288, + 0.0314197763800621, + 0.0 + ], + "unique_experts": 38, + "load_cv": 1.6024672335395507, + "normalized_load_entropy": 0.7736500792682776, + "max_load_share": 0.125 + }, + "full_input": { + "tokens": 49, + "top_k": 6, + "decisions": 294, + "ordered_route_sha256": "7c62e895fc81c9cc9274ca6f097f600c65ac155007f55e00ae040588db0c46ba", + "route_weight_sha256": "53e66ed030cfde5932aab9e99102c987fcbf88be27d2de00131b48b1245c5c72", + "loads": [ + 5, + 6, + 5, + 0, + 6, + 12, + 11, + 0, + 0, + 17, + 3, + 2, + 11, + 20, + 5, + 0, + 4, + 0, + 6, + 10, + 0, + 1, + 11, + 13, + 12, + 0, + 0, + 2, + 1, + 4, + 8, + 0, + 0, + 7, + 0, + 6, + 2, + 7, + 1, + 0, + 6, + 4, + 9, + 2, + 2, + 0, + 0, + 9, + 2, + 4, + 0, + 0, + 2, + 10, + 6, + 15, + 1, + 2, + 8, + 0, + 1, + 5, + 8, + 0 + ], + "weighted_loads": [ + 0.3961754129268229, + 0.49613191187381744, + 0.26574365608394146, + 0.0, + 0.7329473253339529, + 1.0022733639925718, + 0.4599247658625245, + 0.0, + 0.0, + 1.1522757895290852, + 0.1744178868830204, + 0.07318364642560482, + 0.7152976728975773, + 1.5457680076360703, + 0.48366424068808556, + 0.0, + 0.2246169112622738, + 0.0, + 0.5467964448034763, + 0.5053529776632786, + 0.0, + 0.0337795615196228, + 0.4387503247708082, + 1.068168906494975, + 1.0646524955518544, + 0.0, + 0.0, + 0.1338311731815338, + 0.04964934289455414, + 0.16274694725871086, + 0.3087337389588356, + 0.0, + 0.0, + 0.34160076826810837, + 0.0, + 0.40044157207012177, + 0.04327659634873271, + 0.34079791232943535, + 0.041338298469781876, + 0.0, + 0.5276956153102219, + 0.2459195852279663, + 0.6349249705672264, + 0.11753813177347183, + 0.05299332085996866, + 0.0, + 0.0, + 0.5261671245098114, + 0.07010561600327492, + 0.15382543578743935, + 0.0, + 0.0, + 0.07305386662483215, + 0.7330471836030483, + 1.741104856133461, + 1.0806793849915266, + 0.04386284947395325, + 0.09112713858485222, + 0.34848752804100513, + 0.0, + 0.0444144643843174, + 0.32189589738845825, + 0.5764546878635883, + 0.0 + ], + "unique_experts": 46, + "load_cv": 1.0402381569637287, + "normalized_load_entropy": 0.8621408958175736, + "max_load_share": 0.06802721088435375 + } + }, + "s1_eos": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "58e00ffc14dde7c439ed15eac1ea569e07f3a2b6e6f7d9406206b63c47beea64", + "route_weight_sha256": "3d731bec51b96f01e3a00b5ef238f5495ce8b2461691958ef86c5ec5d6a09fb4", + "loads": [ + 3, + 3, + 3, + 0, + 1, + 11, + 1, + 0, + 0, + 11, + 3, + 1, + 3, + 18, + 0, + 0, + 1, + 0, + 6, + 4, + 0, + 1, + 5, + 4, + 2, + 0, + 0, + 1, + 1, + 0, + 1, + 0, + 0, + 7, + 0, + 4, + 0, + 1, + 0, + 0, + 3, + 1, + 1, + 1, + 1, + 0, + 0, + 4, + 0, + 5, + 0, + 0, + 2, + 9, + 0, + 13, + 1, + 2, + 2, + 0, + 0, + 2, + 1, + 0 + ], + "weighted_loads": [ + 0.34365203231573105, + 0.29002857208251953, + 0.19889715313911438, + 0.0, + 0.042951375246047974, + 0.9869516044855118, + 0.048117149621248245, + 0.0, + 0.0, + 0.861633475869894, + 0.1696648746728897, + 0.040265776216983795, + 0.13507288321852684, + 1.4349218234419823, + 0.0, + 0.0, + 0.10783139616250992, + 0.0, + 0.5350571647286415, + 0.1500818245112896, + 0.0, + 0.03582124039530754, + 0.2097608707845211, + 0.7506399042904377, + 0.09579440578818321, + 0.0, + 0.0, + 0.10341024398803711, + 0.045330196619033813, + 0.0, + 0.03527097404003143, + 0.0, + 0.0, + 0.34367315098643303, + 0.0, + 0.2538860160857439, + 0.0, + 0.0412868931889534, + 0.0, + 0.0, + 0.4643857479095459, + 0.03659547492861748, + 0.0417916402220726, + 0.058233052492141724, + 0.039670977741479874, + 0.0, + 0.0, + 0.21518298611044884, + 0.0, + 0.1892698872834444, + 0.0, + 0.0, + 0.07756310701370239, + 0.5578116476535797, + 0.0, + 1.0230269934982061, + 0.04625139757990837, + 0.0914563313126564, + 0.05764251574873924, + 0.0, + 0.0, + 0.14295046031475067, + 0.03229224681854248, + 0.0 + ], + "unique_experts": 39, + "load_cv": 1.5515822270854378, + "normalized_load_entropy": 0.7821274858823047, + "max_load_share": 0.125 + }, + "full_input": { + "tokens": 65, + "top_k": 6, + "decisions": 390, + "ordered_route_sha256": "f03870e7c54355351e236d7057a5018f797e189a5c88913f8d059a5cb2bdb76d", + "route_weight_sha256": "2e97a0db5e856afb87cfead7aa23c967e2ce252c02aa0ac10a59756f8f232bf4", + "loads": [ + 5, + 9, + 5, + 0, + 13, + 13, + 15, + 0, + 0, + 17, + 4, + 9, + 16, + 18, + 11, + 2, + 3, + 5, + 7, + 14, + 3, + 2, + 12, + 10, + 16, + 0, + 0, + 2, + 2, + 1, + 5, + 0, + 2, + 7, + 0, + 5, + 4, + 5, + 1, + 2, + 7, + 11, + 10, + 2, + 2, + 0, + 0, + 15, + 1, + 6, + 5, + 0, + 5, + 19, + 6, + 13, + 3, + 4, + 12, + 1, + 2, + 9, + 10, + 2 + ], + "weighted_loads": [ + 0.369400673545897, + 0.6538710407912731, + 0.25817287527024746, + 0.0, + 1.459139784798026, + 1.0764865409582853, + 0.7048771725967526, + 0.0, + 0.0, + 1.1129560805857182, + 0.23485591262578964, + 0.804077859967947, + 0.886157039552927, + 1.4349218234419823, + 0.8566497880965471, + 0.10780739784240723, + 0.4548441879451275, + 0.23096109367907047, + 0.6354499980807304, + 0.6928531117737293, + 0.30279599875211716, + 0.09068095311522484, + 0.48831692337989807, + 0.947052238509059, + 1.3028681534342468, + 0.0, + 0.0, + 0.15644437819719315, + 0.0834880955517292, + 0.03557787463068962, + 0.18222555704414845, + 0.0, + 0.08668867498636246, + 0.34367315098643303, + 0.0, + 0.34678387083113194, + 0.12700075795874, + 0.23666719533503056, + 0.04439942538738251, + 0.10323183797299862, + 0.5642424859106541, + 0.5534145422279835, + 0.7356324754655361, + 0.09681236743927002, + 0.05037845764309168, + 0.0, + 0.0, + 0.9020897280424833, + 0.03473791107535362, + 0.23790101893246174, + 0.33814559504389763, + 0.0, + 0.22155844047665596, + 1.4046471193432808, + 1.7398357316851616, + 1.0230269934982061, + 0.12887343019247055, + 0.17859896644949913, + 0.5649503823369741, + 0.03437012434005737, + 0.09519170597195625, + 0.4666388910263777, + 0.7343280911445618, + 0.16630462184548378 + ], + "unique_experts": 54, + "load_cv": 0.887861009906707, + "normalized_load_entropy": 0.8975502744907683, + "max_load_share": 0.04871794871794872 + } + }, + "s0_bos": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "74930bfc67d3d8e93cb09f1081f332098f7d749d10d2289fc6089a8c34de50d1", + "route_weight_sha256": "7bc45ab8b1fbb8e93f822e9eb677822df80fa12a77cbb805358204b8a6a6ec82", + "loads": [ + 3, + 3, + 3, + 0, + 1, + 11, + 1, + 0, + 0, + 10, + 3, + 2, + 3, + 17, + 0, + 0, + 2, + 0, + 6, + 3, + 0, + 1, + 7, + 4, + 1, + 0, + 0, + 1, + 1, + 0, + 2, + 0, + 0, + 8, + 0, + 5, + 0, + 1, + 0, + 0, + 3, + 0, + 1, + 2, + 1, + 0, + 0, + 4, + 0, + 4, + 0, + 0, + 2, + 8, + 0, + 13, + 1, + 2, + 1, + 0, + 0, + 2, + 1, + 0 + ], + "weighted_loads": [ + 0.3583252839744091, + 0.3229210954159498, + 0.20474202558398247, + 0.0, + 0.04995795711874962, + 0.975029680877924, + 0.04557572305202484, + 0.0, + 0.0, + 0.8316069468855858, + 0.16935501620173454, + 0.07800756208598614, + 0.12620167806744576, + 1.4214192032814026, + 0.0, + 0.0, + 0.13933583907783031, + 0.0, + 0.5894537419080734, + 0.1090409867465496, + 0.0, + 0.03605043515563011, + 0.2752531059086323, + 0.696386992931366, + 0.05568454787135124, + 0.0, + 0.0, + 0.09537323564291, + 0.03894641622900963, + 0.0, + 0.07878521457314491, + 0.0, + 0.0, + 0.38663869723677635, + 0.0, + 0.29930231906473637, + 0.0, + 0.03561319410800934, + 0.0, + 0.0, + 0.46354909241199493, + 0.0, + 0.042694974690675735, + 0.10794761031866074, + 0.04185720533132553, + 0.0, + 0.0, + 0.21003025770187378, + 0.0, + 0.15624785982072353, + 0.0, + 0.0, + 0.06220008060336113, + 0.5216370671987534, + 0.0, + 1.0022612810134888, + 0.043528106063604355, + 0.0966029241681099, + 0.031975820660591125, + 0.0, + 0.0, + 0.1410382129251957, + 0.029284436255693436, + 0.0 + ], + "unique_experts": 38, + "load_cv": 1.5153535218873173, + "normalized_load_entropy": 0.7841996231115831, + "max_load_share": 0.11805555555555555 + }, + "full_input": { + "tokens": 49, + "top_k": 6, + "decisions": 294, + "ordered_route_sha256": "0315503349a5a85177d52890d5ac55e31d83ed0096aaeab0b4cb19d21efccfe6", + "route_weight_sha256": "bb9778b9cc73d0bb2946c3c82e928785f3ade061dfce18e14e26a9c2679eb1fe", + "loads": [ + 4, + 6, + 5, + 0, + 5, + 12, + 10, + 0, + 0, + 14, + 4, + 3, + 11, + 21, + 5, + 0, + 5, + 1, + 6, + 10, + 0, + 1, + 13, + 10, + 11, + 0, + 1, + 3, + 1, + 4, + 9, + 0, + 0, + 8, + 0, + 8, + 0, + 7, + 1, + 0, + 5, + 3, + 9, + 3, + 2, + 1, + 0, + 7, + 4, + 4, + 0, + 1, + 2, + 10, + 5, + 13, + 1, + 2, + 8, + 0, + 2, + 5, + 8, + 0 + ], + "weighted_loads": [ + 0.39761973172426224, + 0.5084302965551615, + 0.2784640360623598, + 0.0, + 0.5806553903967142, + 0.9881971869617701, + 0.4211738230660558, + 0.0, + 0.0, + 1.0288711208850145, + 0.21112190186977386, + 0.10814344510436058, + 0.6917356252670288, + 1.598128017038107, + 0.45318789780139923, + 0.0, + 0.2531136963516474, + 0.7383723258972168, + 0.5894537419080734, + 0.7189250774681568, + 0.0, + 0.03605043515563011, + 0.5018574465066195, + 0.926515968516469, + 1.0320651736110449, + 0.0, + 0.029681555926799774, + 0.18638313189148903, + 0.03894641622900963, + 0.16274694725871086, + 0.3485172502696514, + 0.0, + 0.0, + 0.38663869723677635, + 0.0, + 0.4740813672542572, + 0.0, + 0.32965952530503273, + 0.041338298469781876, + 0.0, + 0.5241586975753307, + 0.1705557517707348, + 0.6345079280436039, + 0.16455354169011116, + 0.052564685232937336, + 0.026902135461568832, + 0.0, + 0.4575287289917469, + 0.1515245959162712, + 0.15624785982072353, + 0.0, + 0.01517296489328146, + 0.06220008060336113, + 0.6982749849557877, + 0.7974422127008438, + 1.0022612810134888, + 0.043528106063604355, + 0.0966029241681099, + 0.33140817657113075, + 0.0, + 0.09471090883016586, + 0.32333843410015106, + 0.5743193477392197, + 0.0 + ], + "unique_experts": 49, + "load_cv": 0.9861599533346588, + "normalized_load_entropy": 0.8760080670270748, + "max_load_share": 0.07142857142857142 + } + }, + "s1_bos": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "fef11331c62e197b0ef334bc13dcbd1e32b86accae90cd3abffd414f53b9cf45", + "route_weight_sha256": "4f5168dd94a6f74f1ce03ed243d629644429940f2118fd7a4f1d8e57d19494b9", + "loads": [ + 3, + 4, + 2, + 0, + 1, + 11, + 1, + 0, + 0, + 9, + 3, + 2, + 3, + 17, + 1, + 0, + 1, + 0, + 6, + 4, + 0, + 1, + 5, + 4, + 2, + 0, + 0, + 1, + 2, + 0, + 1, + 0, + 0, + 8, + 0, + 5, + 0, + 1, + 0, + 0, + 3, + 1, + 1, + 2, + 1, + 0, + 0, + 4, + 0, + 4, + 0, + 0, + 1, + 9, + 0, + 13, + 1, + 2, + 2, + 0, + 0, + 2, + 0, + 0 + ], + "weighted_loads": [ + 0.35184523463249207, + 0.33339872024953365, + 0.1717040054500103, + 0.0, + 0.04641285911202431, + 0.9264788888394833, + 0.048386696726083755, + 0.0, + 0.0, + 0.7420843690633774, + 0.16250920295715332, + 0.06715363264083862, + 0.12872090935707092, + 1.4346631728112698, + 0.03492657095193863, + 0.0, + 0.10381629317998886, + 0.0, + 0.5871965512633324, + 0.1472908817231655, + 0.0, + 0.034020766615867615, + 0.20670031011104584, + 0.72434226796031, + 0.09264219924807549, + 0.0, + 0.0, + 0.09869054704904556, + 0.07058115117251873, + 0.0, + 0.03412671387195587, + 0.0, + 0.0, + 0.3682025894522667, + 0.0, + 0.3007206507027149, + 0.0, + 0.03586472198367119, + 0.0, + 0.0, + 0.4784858152270317, + 0.03805847465991974, + 0.04017720744013786, + 0.10498670302331448, + 0.04418591037392616, + 0.0, + 0.0, + 0.21293126791715622, + 0.0, + 0.16575738787651062, + 0.0, + 0.0, + 0.030693838372826576, + 0.5447638519108295, + 0.0, + 1.0610832311213017, + 0.045099589973688126, + 0.09783800691366196, + 0.06702299602329731, + 0.0, + 0.0, + 0.13457751274108887, + 0.0, + 0.0 + ], + "unique_experts": 39, + "load_cv": 1.4989708403591158, + "normalized_load_entropy": 0.7893699210390933, + "max_load_share": 0.11805555555555555 + }, + "full_input": { + "tokens": 65, + "top_k": 6, + "decisions": 390, + "ordered_route_sha256": "33db8603a52f75a3a94ba24a7bfc164c6447916687a0be4f5cca0dab96b52b85", + "route_weight_sha256": "d7287671586cca52cad2c0aad8e855b771f35003f9279ad208ec05b01cd3f76d", + "loads": [ + 4, + 10, + 4, + 0, + 13, + 14, + 13, + 0, + 0, + 17, + 4, + 10, + 16, + 19, + 12, + 2, + 3, + 5, + 7, + 15, + 3, + 2, + 11, + 8, + 15, + 0, + 0, + 2, + 3, + 1, + 6, + 0, + 2, + 8, + 0, + 7, + 4, + 5, + 1, + 3, + 6, + 10, + 10, + 4, + 2, + 0, + 0, + 13, + 1, + 5, + 5, + 0, + 4, + 19, + 5, + 13, + 3, + 4, + 13, + 1, + 3, + 9, + 9, + 2 + ], + "weighted_loads": [ + 0.3732380848377943, + 0.6980815101414919, + 0.23097972758114338, + 0.0, + 1.5299649480730295, + 1.0648607518523932, + 0.639711351133883, + 0.0, + 0.0, + 1.0849064588546753, + 0.22770024091005325, + 0.8309657163918018, + 0.8447367958724499, + 1.5127248167991638, + 0.8749387506395578, + 0.10780739784240723, + 0.45082908496260643, + 0.23096109367907047, + 0.6875893846154213, + 0.9923225939273834, + 0.30279599875211716, + 0.08888047933578491, + 0.44202543422579765, + 0.8708603363484144, + 1.2804190330207348, + 0.0, + 0.0, + 0.1517246812582016, + 0.10873905010521412, + 0.03557787463068962, + 0.2268270906060934, + 0.0, + 0.08668867498636246, + 0.3682025894522667, + 0.0, + 0.46249590441584587, + 0.1585996150970459, + 0.2282646130770445, + 0.04439942538738251, + 0.14559726975858212, + 0.5703060366213322, + 0.5086192227900028, + 0.7340180426836014, + 0.1795684825628996, + 0.05489339027553797, + 0.0, + 0.0, + 0.8233063258230686, + 0.03473791107535362, + 0.21438851952552795, + 0.33814559504389763, + 0.0, + 0.17468917183578014, + 1.3383415751159191, + 0.7983417436480522, + 1.0610832311213017, + 0.1277216225862503, + 0.18498064205050468, + 0.6195553094148636, + 0.03437012434005737, + 0.14975344762206078, + 0.4582659434527159, + 0.7020358443260193, + 0.16630462184548378 + ], + "unique_experts": 54, + "load_cv": 0.8764131070755277, + "normalized_load_entropy": 0.900428770152247, + "max_load_share": 0.04871794871794872 + } + }, + "s0_x": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "d7253a272c72ea1509a60f396ed49116453a156b08734ff707518356c78bf0ec", + "route_weight_sha256": "132844fa8a1291048420bd14b72bdb0feccca317a0eddd37e2e753777f7f0da8", + "loads": [ + 3, + 3, + 2, + 0, + 1, + 11, + 1, + 0, + 0, + 9, + 3, + 2, + 3, + 17, + 1, + 0, + 2, + 0, + 6, + 4, + 0, + 1, + 6, + 4, + 1, + 0, + 0, + 1, + 2, + 0, + 2, + 0, + 0, + 8, + 0, + 4, + 0, + 1, + 0, + 0, + 3, + 0, + 1, + 2, + 1, + 0, + 0, + 4, + 0, + 4, + 0, + 0, + 1, + 8, + 0, + 13, + 1, + 2, + 3, + 0, + 0, + 2, + 1, + 0 + ], + "weighted_loads": [ + 0.34980302676558495, + 0.32729853317141533, + 0.15803391113877296, + 0.0, + 0.04101892560720444, + 1.005440678447485, + 0.04391595721244812, + 0.0, + 0.0, + 0.756687767803669, + 0.17344024032354355, + 0.07655342668294907, + 0.14869865775108337, + 1.4119125735014677, + 0.03025703877210617, + 0.0, + 0.13838263414800167, + 0.0, + 0.5723617970943451, + 0.14580704271793365, + 0.0, + 0.0365612618625164, + 0.22669083438813686, + 0.7259924858808517, + 0.055601686239242554, + 0.0, + 0.0, + 0.1063358262181282, + 0.07474741712212563, + 0.0, + 0.07678214088082314, + 0.0, + 0.0, + 0.38554418087005615, + 0.0, + 0.24835481122136116, + 0.0, + 0.03035890869796276, + 0.0, + 0.0, + 0.47993098199367523, + 0.0, + 0.04211444780230522, + 0.09719611145555973, + 0.050347700715065, + 0.0, + 0.0, + 0.22627244144678116, + 0.0, + 0.15233632363379002, + 0.0, + 0.0, + 0.03379795700311661, + 0.5073952339589596, + 0.0, + 0.9951741602271795, + 0.0400158166885376, + 0.09141987562179565, + 0.09305957518517971, + 0.0, + 0.0, + 0.13912265375256538, + 0.029551343992352486, + 0.0 + ], + "unique_experts": 39, + "load_cv": 1.4844876906541542, + "normalized_load_entropy": 0.7925285506145571, + "max_load_share": 0.11805555555555555 + }, + "full_input": { + "tokens": 49, + "top_k": 6, + "decisions": 294, + "ordered_route_sha256": "8dc15669ad37e0f3c71e2c48945817303b0453196af4450e04a86e10167a2593", + "route_weight_sha256": "38220cc1510289f1e2ca856b1553445b2fa0115bd5917d99b9ae23d66d03cb6b", + "loads": [ + 5, + 4, + 3, + 0, + 6, + 13, + 11, + 0, + 0, + 12, + 3, + 3, + 13, + 19, + 7, + 0, + 5, + 0, + 6, + 10, + 0, + 1, + 13, + 10, + 9, + 0, + 0, + 2, + 2, + 4, + 7, + 0, + 0, + 8, + 1, + 6, + 0, + 6, + 1, + 1, + 6, + 4, + 10, + 4, + 2, + 0, + 0, + 9, + 2, + 4, + 0, + 0, + 1, + 12, + 5, + 13, + 1, + 2, + 11, + 0, + 2, + 6, + 9, + 0 + ], + "weighted_loads": [ + 0.4340332821011543, + 0.4137759171426296, + 0.18253563158214092, + 0.0, + 0.7394654061645269, + 1.1015037391334772, + 0.47365248296409845, + 0.0, + 0.0, + 0.9106381610035896, + 0.17344024032354355, + 0.10668930970132351, + 0.8677836619317532, + 1.4962236192077398, + 0.5218516811728477, + 0.0, + 0.25216049142181873, + 0.0, + 0.5723617970943451, + 0.46122436225414276, + 0.0, + 0.0365612618625164, + 0.5135375261306763, + 0.9561214614659548, + 0.7773169968277216, + 0.0, + 0.0, + 0.14432788640260696, + 0.07474741712212563, + 0.16274694725871086, + 0.25754909589886665, + 0.0, + 0.0, + 0.38554418087005615, + 0.0432216040790081, + 0.40518781542778015, + 0.0, + 0.2370752114802599, + 0.041338298469781876, + 0.034591931849718094, + 0.5896100550889969, + 0.2622799836099148, + 0.7741605006158352, + 0.19409395940601826, + 0.06105518061667681, + 0.0, + 0.0, + 0.5973828583955765, + 0.07010561600327492, + 0.15233632363379002, + 0.0, + 0.0, + 0.03379795700311661, + 0.7585230097174644, + 0.7974422127008438, + 0.9951741602271795, + 0.0400158166885376, + 0.09141987562179565, + 0.44424215890467167, + 0.0, + 0.08306274563074112, + 0.3488117940723896, + 0.6222218591719866, + 0.0 + ], + "unique_experts": 47, + "load_cv": 0.9995834201027313, + "normalized_load_entropy": 0.868890342917044, + "max_load_share": 0.06462585034013606 + } + }, + "s1_x": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "a7748bfff46d79fe60154181b1db0ed492492dece7ab575c06bc8647a2e8ee9b", + "route_weight_sha256": "7c4de7a8844910bb07d83c72b83ddb4efa61ae1bc9f072825e3b422da47bc812", + "loads": [ + 3, + 3, + 3, + 0, + 1, + 11, + 1, + 0, + 0, + 10, + 3, + 1, + 3, + 17, + 1, + 0, + 1, + 0, + 6, + 4, + 0, + 2, + 5, + 4, + 2, + 0, + 0, + 1, + 2, + 0, + 1, + 0, + 0, + 8, + 0, + 5, + 0, + 1, + 0, + 0, + 3, + 1, + 1, + 1, + 1, + 0, + 0, + 4, + 0, + 5, + 0, + 0, + 1, + 8, + 0, + 11, + 1, + 3, + 3, + 0, + 0, + 2, + 0, + 0 + ], + "weighted_loads": [ + 0.3366477470844984, + 0.3239849805831909, + 0.18333441205322742, + 0.0, + 0.05614392086863518, + 0.9771584160625935, + 0.03981376439332962, + 0.0, + 0.0, + 0.7628572955727577, + 0.162051759660244, + 0.03874301165342331, + 0.15100761875510216, + 1.367977935820818, + 0.034202881157398224, + 0.0, + 0.10174933820962906, + 0.0, + 0.5768370591104031, + 0.15347485430538654, + 0.0, + 0.07203105464577675, + 0.19727886468172073, + 0.7006813958287239, + 0.08978813514113426, + 0.0, + 0.0, + 0.1110592931509018, + 0.06899530813097954, + 0.0, + 0.03183212876319885, + 0.0, + 0.0, + 0.39650589786469936, + 0.0, + 0.27831263840198517, + 0.0, + 0.030926454812288284, + 0.0, + 0.0, + 0.4962801933288574, + 0.03628866747021675, + 0.0360579639673233, + 0.075442373752594, + 0.049578722566366196, + 0.0, + 0.0, + 0.22338858246803284, + 0.0, + 0.19979805313050747, + 0.0, + 0.0, + 0.03361402079463005, + 0.5077096410095692, + 0.0, + 0.9640068504959345, + 0.04553632065653801, + 0.12674486450850964, + 0.10198923572897911, + 0.0, + 0.0, + 0.14926379546523094, + 0.0, + 0.0 + ], + "unique_experts": 39, + "load_cv": 1.46565621758588, + "normalized_load_entropy": 0.7931455542854143, + "max_load_share": 0.11805555555555555 + }, + "full_input": { + "tokens": 65, + "top_k": 6, + "decisions": 390, + "ordered_route_sha256": "6c4900ec60cc41fe90293da161065cd30bd129df7b756685bbda292f210f4f4f", + "route_weight_sha256": "f3ae8fdc11381a47542c62cf487fab65ae659b40d045955e00d99565ca56598c", + "loads": [ + 4, + 9, + 5, + 0, + 13, + 15, + 13, + 0, + 0, + 16, + 4, + 9, + 18, + 17, + 13, + 2, + 3, + 6, + 7, + 11, + 3, + 3, + 13, + 8, + 12, + 0, + 0, + 2, + 3, + 1, + 6, + 0, + 3, + 8, + 1, + 6, + 3, + 4, + 1, + 2, + 5, + 11, + 11, + 2, + 2, + 0, + 0, + 16, + 1, + 6, + 5, + 0, + 4, + 18, + 5, + 11, + 3, + 5, + 14, + 1, + 3, + 11, + 10, + 2 + ], + "weighted_loads": [ + 0.35804059728980064, + 0.674442283809185, + 0.2426101341843605, + 0.0, + 1.4409802947193384, + 1.1481855679303408, + 0.5970523031428456, + 0.0, + 0.0, + 1.0222821831703186, + 0.22724279761314392, + 0.8025550954043865, + 1.0011714547872543, + 1.367977935820818, + 0.9683709051460028, + 0.10780739784240723, + 0.44876212999224663, + 0.2685486879199743, + 0.677229892462492, + 0.5390774887055159, + 0.30279599875211716, + 0.12689076736569405, + 0.5119164660573006, + 0.8471994642168283, + 0.8204052187502384, + 0.0, + 0.0, + 0.16409342736005783, + 0.10715320706367493, + 0.03557787463068962, + 0.2179864253848791, + 0.0, + 0.1232888400554657, + 0.39650589786469936, + 0.031279440969228745, + 0.36823541671037674, + 0.12306685373187065, + 0.15001090429723263, + 0.04439942538738251, + 0.10323183797299862, + 0.548879224807024, + 0.6111491210758686, + 0.9167077131569386, + 0.11402168869972229, + 0.060286202467978, + 0.0, + 0.0, + 1.001315388828516, + 0.03473791107535362, + 0.2484291847795248, + 0.33814559504389763, + 0.0, + 0.17760935425758362, + 1.3097628615796566, + 0.7983417436480522, + 0.9640068504959345, + 0.1281583532691002, + 0.21388749964535236, + 0.6483649294823408, + 0.03437012434005737, + 0.1366913877427578, + 0.5822276081889868, + 0.7880233898758888, + 0.16630462184548378 + ], + "unique_experts": 55, + "load_cv": 0.8682128522836321, + "normalized_load_entropy": 0.9023851939970747, + "max_load_share": 0.046153846153846156 + } + }, + "s0_period": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "6b259f4b39cbad8b083daad36658f000d7e1bcf6c7d13917d78e144e1862b418", + "route_weight_sha256": "e4b2f460f2adb4ced7cbbcba4fe7e67759f46fb68e99274704d39b640a378ec0", + "loads": [ + 3, + 3, + 3, + 0, + 1, + 11, + 1, + 0, + 0, + 9, + 3, + 2, + 3, + 17, + 1, + 0, + 1, + 0, + 6, + 4, + 0, + 1, + 5, + 4, + 1, + 0, + 0, + 1, + 2, + 0, + 2, + 0, + 0, + 8, + 0, + 4, + 0, + 1, + 0, + 0, + 3, + 0, + 1, + 2, + 1, + 0, + 0, + 4, + 0, + 4, + 0, + 0, + 1, + 9, + 0, + 13, + 1, + 2, + 3, + 0, + 0, + 2, + 1, + 0 + ], + "weighted_loads": [ + 0.35151398926973343, + 0.3241321071982384, + 0.1939005795866251, + 0.0, + 0.042704787105321884, + 0.9641969725489616, + 0.04612020403146744, + 0.0, + 0.0, + 0.7206542678177357, + 0.1685360185801983, + 0.07696046121418476, + 0.13969603180885315, + 1.4210573434829712, + 0.028653375804424286, + 0.0, + 0.1072368398308754, + 0.0, + 0.5702953524887562, + 0.1401343084871769, + 0.0, + 0.036297284066677094, + 0.19299061223864555, + 0.7262150533497334, + 0.05522672459483147, + 0.0, + 0.0, + 0.10438896715641022, + 0.07120941951870918, + 0.0, + 0.07947792112827301, + 0.0, + 0.0, + 0.3971802517771721, + 0.0, + 0.25735557451844215, + 0.0, + 0.03040356934070587, + 0.0, + 0.0, + 0.4925019443035126, + 0.0, + 0.04220631346106529, + 0.0978711899369955, + 0.04778117686510086, + 0.0, + 0.0, + 0.22057568654417992, + 0.0, + 0.15310855023562908, + 0.0, + 0.0, + 0.033360790461301804, + 0.5299854651093483, + 0.0, + 1.0070548504590988, + 0.04014386981725693, + 0.09374352172017097, + 0.09248059429228306, + 0.0, + 0.0, + 0.14163735136389732, + 0.03090832196176052, + 0.0 + ], + "unique_experts": 39, + "load_cv": 1.4927809825049336, + "normalized_load_entropy": 0.7909266085019944, + "max_load_share": 0.11805555555555555 + }, + "full_input": { + "tokens": 49, + "top_k": 6, + "decisions": 294, + "ordered_route_sha256": "0aba976d2942716b995650192f9fdcd01d6373fd4fdb8bb3348d5d1be35e4ad8", + "route_weight_sha256": "00465e26e8314634c375d8d8382e65b70cec52d8645235db7e58e576fa3f0ba1", + "loads": [ + 5, + 5, + 4, + 0, + 6, + 13, + 10, + 0, + 0, + 13, + 3, + 3, + 12, + 19, + 7, + 0, + 4, + 0, + 7, + 10, + 0, + 1, + 11, + 10, + 10, + 0, + 0, + 3, + 2, + 4, + 8, + 0, + 0, + 8, + 1, + 6, + 1, + 7, + 1, + 1, + 6, + 4, + 9, + 3, + 2, + 0, + 0, + 10, + 2, + 4, + 0, + 0, + 1, + 12, + 5, + 13, + 1, + 2, + 9, + 0, + 1, + 6, + 9, + 0 + ], + "weighted_loads": [ + 0.44589123502373695, + 0.4460037611424923, + 0.21840230002999306, + 0.0, + 0.8341149780899286, + 1.0509132277220488, + 0.42171830404549837, + 0.0, + 0.0, + 0.9075881838798523, + 0.1685360185801983, + 0.1070963442325592, + 0.7413505017757416, + 1.5060712322592735, + 0.531997486948967, + 0.0, + 0.22101469710469246, + 0.0, + 0.6130813620984554, + 0.511500995606184, + 0.0, + 0.036297284066677094, + 0.4220580104738474, + 0.9563440289348364, + 0.8537824917584658, + 0.0, + 0.0, + 0.1704272460192442, + 0.07120941951870918, + 0.16274694725871086, + 0.30972735211253166, + 0.0, + 0.0, + 0.3971802517771721, + 0.07002180069684982, + 0.4134225472807884, + 0.050152309238910675, + 0.285345695912838, + 0.041338298469781876, + 0.029001163318753242, + 0.5922644250094891, + 0.261114951223135, + 0.6340192668139935, + 0.15447712130844593, + 0.058488656766712666, + 0.0, + 0.0, + 0.6671404130756855, + 0.07010561600327492, + 0.15310855023562908, + 0.0, + 0.0, + 0.033360790461301804, + 0.7750072292983532, + 0.7974422127008438, + 1.0070548504590988, + 0.04014386981725693, + 0.09374352172017097, + 0.35925510339438915, + 0.0, + 0.037263575941324234, + 0.4075968861579895, + 0.6134103070944548, + 0.0 + ], + "unique_experts": 48, + "load_cv": 0.9823986620959381, + "normalized_load_entropy": 0.8724810913837019, + "max_load_share": 0.06462585034013606 + } + }, + "s1_period": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "8ceca0d97ca6a387cf8f37d874c5583b488c7313e660998de6ca8728725f0691", + "route_weight_sha256": "59cca9b8ee870f1519a8a0dba523fe2be17028950722f9267746dd684ef72a96", + "loads": [ + 3, + 3, + 3, + 0, + 2, + 11, + 2, + 0, + 0, + 9, + 3, + 1, + 3, + 16, + 1, + 0, + 1, + 0, + 6, + 6, + 0, + 2, + 3, + 4, + 1, + 0, + 0, + 1, + 2, + 0, + 1, + 0, + 0, + 8, + 0, + 4, + 0, + 1, + 1, + 0, + 3, + 1, + 1, + 2, + 1, + 0, + 0, + 4, + 0, + 5, + 0, + 0, + 1, + 10, + 0, + 10, + 1, + 2, + 2, + 0, + 0, + 3, + 0, + 0 + ], + "weighted_loads": [ + 0.32935316674411297, + 0.33664457499980927, + 0.19055067002773285, + 0.0, + 0.07448917627334595, + 0.9720442183315754, + 0.07081476412713528, + 0.0, + 0.0, + 0.6730439215898514, + 0.1564856804907322, + 0.0373038575053215, + 0.14077754318714142, + 1.26945629902184, + 0.03307662531733513, + 0.0, + 0.10439097136259079, + 0.0, + 0.5549203045666218, + 0.22293415293097496, + 0.0, + 0.06842015497386456, + 0.1208525262773037, + 0.7086715959012508, + 0.04913576319813728, + 0.0, + 0.0, + 0.11635689437389374, + 0.06856642663478851, + 0.0, + 0.032053519040346146, + 0.0, + 0.0, + 0.40805714577436447, + 0.0, + 0.2543662190437317, + 0.0, + 0.029006315395236015, + 0.0317528136074543, + 0.0, + 0.49827923625707626, + 0.03806586563587189, + 0.036575865000486374, + 0.10304119810461998, + 0.052464213222265244, + 0.0, + 0.0, + 0.2256808616220951, + 0.0, + 0.20298918522894382, + 0.0, + 0.0, + 0.03592629358172417, + 0.5512565113604069, + 0.0, + 0.9831253588199615, + 0.04353514313697815, + 0.09632822498679161, + 0.07031995616853237, + 0.0, + 0.0, + 0.17940797843039036, + 0.0, + 0.0 + ], + "unique_experts": 40, + "load_cv": 1.4229164972072996, + "normalized_load_entropy": 0.8018278645735605, + "max_load_share": 0.1111111111111111 + }, + "full_input": { + "tokens": 65, + "top_k": 6, + "decisions": 390, + "ordered_route_sha256": "5a5a9e3c27a381c3c3dd42f2188da214d60ddac8e6621cc23f0585b094447795", + "route_weight_sha256": "e473308021181d3afd12ba7e6c361d1584b5967aa2119db3807e5b30d9b4c59e", + "loads": [ + 4, + 8, + 5, + 0, + 14, + 14, + 13, + 0, + 0, + 15, + 4, + 9, + 16, + 17, + 14, + 2, + 3, + 5, + 7, + 15, + 3, + 3, + 10, + 8, + 12, + 0, + 0, + 2, + 3, + 1, + 5, + 0, + 2, + 8, + 1, + 5, + 3, + 3, + 2, + 3, + 6, + 11, + 12, + 3, + 2, + 0, + 0, + 16, + 1, + 6, + 5, + 0, + 4, + 21, + 5, + 10, + 3, + 4, + 12, + 1, + 4, + 13, + 10, + 2 + ], + "weighted_loads": [ + 0.3507460169494152, + 0.6472311280667782, + 0.24982639215886593, + 0.0, + 1.503826668485999, + 1.109035262838006, + 0.5952034844085574, + 0.0, + 0.0, + 0.9300604276359081, + 0.22167671844363213, + 0.8011159412562847, + 0.8463841862976551, + 1.3107780124992132, + 0.9549083542078733, + 0.10780739784240723, + 0.45140376314520836, + 0.23096109367907047, + 0.6553131379187107, + 0.6930196508765221, + 0.30279599875211716, + 0.12327986769378185, + 0.39996009692549706, + 0.8551896642893553, + 0.8539702594280243, + 0.0, + 0.0, + 0.16939102858304977, + 0.1067243255674839, + 0.03557787463068962, + 0.175912918522954, + 0.0, + 0.08668867498636246, + 0.40805714577436447, + 0.05892709270119667, + 0.35743044316768646, + 0.12306685373187065, + 0.105785321444273, + 0.07615223899483681, + 0.14642656035721302, + 0.6011437475681305, + 0.6536996141076088, + 0.8041633889079094, + 0.14162051305174828, + 0.06317169312387705, + 0.0, + 0.0, + 1.0704359412193298, + 0.03473791107535362, + 0.25162031687796116, + 0.33814559504389763, + 0.0, + 0.17992162704467773, + 1.4360836036503315, + 0.7983417436480522, + 0.9831253588199615, + 0.12615717574954033, + 0.18347086012363434, + 0.5835431031882763, + 0.03437012434005737, + 0.1893179453909397, + 0.6486286595463753, + 0.7451154552400112, + 0.16630462184548378 + ], + "unique_experts": 55, + "load_cv": 0.8768930869065868, + "normalized_load_entropy": 0.9023007694002874, + "max_load_share": 0.05384615384615385 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 24, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 20, + "mean_set_jaccard": 0.9434523809523809, + "mean_token_weighted_tv": 0.01578867866192013, + "aggregate_load_tv": 0.034722222222222224 + }, + "system_bos": { + "tokens": 24, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.8869047619047619, + "mean_token_weighted_tv": 0.02408374830459555, + "aggregate_load_tv": 0.05555555555555555 + }, + "system_x": { + "tokens": 24, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.8839285714285715, + "mean_token_weighted_tv": 0.026128934618706506, + "aggregate_load_tv": 0.05555555555555555 + }, + "system_period": { + "tokens": 24, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8630952380952381, + "mean_token_weighted_tv": 0.030999298595512908, + "aggregate_load_tv": 0.06944444444444445 + }, + "bos_at_s0": { + "tokens": 24, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.9166666666666669, + "mean_token_weighted_tv": 0.024189135408960283, + "aggregate_load_tv": 0.048611111111111105 + }, + "bos_at_s1": { + "tokens": 24, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.880952380952381, + "mean_token_weighted_tv": 0.027761114994063973, + "aggregate_load_tv": 0.04861111111111112 + }, + "x_at_s0": { + "tokens": 24, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8809523809523809, + "mean_token_weighted_tv": 0.027196403165968757, + "aggregate_load_tv": 0.06249999999999999 + }, + "x_at_s1": { + "tokens": 24, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.8839285714285715, + "mean_token_weighted_tv": 0.034240788547322154, + "aggregate_load_tv": 0.04861111111111111 + }, + "period_at_s0": { + "tokens": 24, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 13, + "mean_set_jaccard": 0.8690476190476191, + "mean_token_weighted_tv": 0.0300186841438214, + "aggregate_load_tv": 0.05555555555555555 + }, + "period_at_s1": { + "tokens": 24, + "ordered_topk_exact_tokens": 7, + "set_exact_tokens": 9, + "mean_set_jaccard": 0.8035714285714285, + "mean_token_weighted_tv": 0.04263980675023049, + "aggregate_load_tv": 0.08333333333333333 + } + } + }, + "layer_20": { + "layer": 20, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "543dd8bad03b407f8f29452350976f384b7abaaa2e6dac42250f9fa02c89db23", + "route_weight_sha256": "fb931c780c7106bb76f815b6a496371bc8fd9bf6fbe6d4ef0abcfbec7bbdef42", + "loads": [ + 3, + 2, + 3, + 3, + 1, + 18, + 0, + 0, + 0, + 1, + 2, + 1, + 2, + 3, + 3, + 2, + 0, + 0, + 1, + 0, + 6, + 1, + 1, + 3, + 1, + 0, + 0, + 0, + 0, + 2, + 12, + 0, + 1, + 3, + 1, + 5, + 1, + 1, + 2, + 0, + 0, + 4, + 0, + 0, + 4, + 1, + 0, + 0, + 4, + 3, + 0, + 0, + 0, + 15, + 3, + 0, + 0, + 3, + 4, + 0, + 0, + 4, + 0, + 14 + ], + "weighted_loads": [ + 0.13270500116050243, + 0.3437037244439125, + 0.2736581116914749, + 0.216649966314435, + 0.03998298943042755, + 1.9679720550775528, + 0.0, + 0.0, + 0.0, + 0.09621274471282959, + 0.08685226365923882, + 0.03659326210618019, + 0.14021572470664978, + 0.11157390102744102, + 0.22738400101661682, + 0.12814436480402946, + 0.0, + 0.0, + 0.04709737375378609, + 0.0, + 0.7378638759255409, + 0.04413069039583206, + 0.04931469261646271, + 0.1541990153491497, + 0.034201480448246, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0660124234855175, + 0.6487960834056139, + 0.0, + 0.030637318268418312, + 0.11804402805864811, + 0.02093273401260376, + 0.22454238682985306, + 0.028304720297455788, + 0.03923428803682327, + 0.08582534268498421, + 0.0, + 0.0, + 0.17907393723726273, + 0.0, + 0.0, + 0.22473321110010147, + 0.08484508097171783, + 0.0, + 0.0, + 0.4374375455081463, + 0.19354549795389175, + 0.0, + 0.0, + 0.0, + 1.636530589312315, + 0.15573497861623764, + 0.0, + 0.0, + 0.1737958863377571, + 0.21813400462269783, + 0.0, + 0.0, + 0.38484612852334976, + 0.0, + 1.19980388879776 + ], + "unique_experts": 39, + "load_cv": 1.6024672335395507, + "normalized_load_entropy": 0.7821948863770195, + "max_load_share": 0.125 + }, + "full_input": { + "tokens": 49, + "top_k": 6, + "decisions": 294, + "ordered_route_sha256": "4f9682f4e21e00fd12bb7868cd48024a031a41d435bb3c34afab23d7e2ee485b", + "route_weight_sha256": "ca8dfc40593661799432a52f117cd6779f748cdb07b832873bfc67442184af74", + "loads": [ + 4, + 4, + 3, + 11, + 9, + 22, + 5, + 4, + 0, + 1, + 2, + 1, + 4, + 3, + 3, + 8, + 1, + 0, + 11, + 0, + 10, + 1, + 8, + 3, + 1, + 8, + 1, + 0, + 0, + 4, + 13, + 0, + 1, + 5, + 3, + 5, + 4, + 4, + 4, + 0, + 2, + 6, + 2, + 3, + 14, + 1, + 0, + 0, + 6, + 4, + 8, + 0, + 0, + 24, + 3, + 3, + 1, + 8, + 5, + 0, + 12, + 7, + 0, + 14 + ], + "weighted_loads": [ + 0.18710734136402607, + 0.38842858001589775, + 0.2736581116914749, + 0.8198455516248941, + 0.43577637150883675, + 2.1628170534968376, + 0.15178022533655167, + 0.26399899274110794, + 0.0, + 0.09621274471282959, + 0.08685226365923882, + 0.03659326210618019, + 0.2143658921122551, + 0.11157390102744102, + 0.22738400101661682, + 0.5491903647780418, + 0.03671130910515785, + 0.0, + 0.9391956329345703, + 0.0, + 0.847151385853067, + 0.04413069039583206, + 0.5109565034508705, + 0.1541990153491497, + 0.034201480448246, + 0.5877909176051617, + 0.01743382401764393, + 0.0, + 0.0, + 0.13210195861756802, + 0.6742783952504396, + 0.0, + 0.030637318268418312, + 0.17840619571506977, + 0.09876848012208939, + 0.22454238682985306, + 0.11273257248103619, + 0.12683655135333538, + 1.404639232903719, + 0.0, + 0.0895921178162098, + 0.28715964034199715, + 0.14825629815459251, + 0.09810801362618804, + 0.6797673385590315, + 0.08484508097171783, + 0.0, + 0.0, + 0.47379616636317223, + 0.2391848973929882, + 1.1904313303530216, + 0.0, + 0.0, + 2.109571849927306, + 0.15573497861623764, + 0.5481917969882488, + 0.06231635436415672, + 0.33469247445464134, + 0.24950963631272316, + 0.0, + 1.2645759504521266, + 0.5632334835827351, + 0.0, + 1.19980388879776 + ], + "unique_experts": 51, + "load_cv": 1.0936736196002215, + "normalized_load_entropy": 0.8695130791624007, + "max_load_share": 0.08163265306122448 + } + }, + "s1_eos": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "1bf259c0e11343f55c7160116755e3725005655e88567bae8032e1167d87ff70", + "route_weight_sha256": "ea2fd0a7bf619454e2ef1f40cfbea3538c7dcdad7c7e4f77f98224c69e323e65", + "loads": [ + 3, + 2, + 3, + 3, + 1, + 18, + 0, + 0, + 0, + 1, + 2, + 1, + 2, + 2, + 3, + 3, + 0, + 0, + 1, + 0, + 6, + 1, + 1, + 3, + 1, + 0, + 0, + 0, + 0, + 1, + 11, + 1, + 1, + 3, + 2, + 5, + 1, + 2, + 2, + 0, + 0, + 5, + 0, + 0, + 4, + 1, + 0, + 0, + 4, + 3, + 0, + 0, + 0, + 14, + 3, + 0, + 0, + 3, + 3, + 0, + 0, + 4, + 0, + 14 + ], + "weighted_loads": [ + 0.12548953853547573, + 0.3421795144677162, + 0.2646254301071167, + 0.20317980274558067, + 0.043946072459220886, + 1.910499844700098, + 0.0, + 0.0, + 0.0, + 0.09058394283056259, + 0.0781797468662262, + 0.03540737181901932, + 0.1389545202255249, + 0.07841449603438377, + 0.216247096657753, + 0.1826195791363716, + 0.0, + 0.0, + 0.04904978349804878, + 0.0, + 0.72663564234972, + 0.04256897047162056, + 0.04493076354265213, + 0.14407852664589882, + 0.03510129451751709, + 0.0, + 0.0, + 0.0, + 0.0, + 0.031880032271146774, + 0.6018981300294399, + 0.04557167366147041, + 0.030125517398118973, + 0.11704215593636036, + 0.04698149859905243, + 0.2388826422393322, + 0.027615414932370186, + 0.07346593216061592, + 0.09311758354306221, + 0.0, + 0.0, + 0.2243576981127262, + 0.0, + 0.0, + 0.22043632715940475, + 0.08432631939649582, + 0.0, + 0.0, + 0.44175873696804047, + 0.191447913646698, + 0.0, + 0.0, + 0.0, + 1.572819385677576, + 0.14703279361128807, + 0.0, + 0.0, + 0.17105086147785187, + 0.18742093071341515, + 0.0, + 0.0, + 0.3881330266594887, + 0.0, + 1.1959689520299435 + ], + "unique_experts": 40, + "load_cv": 1.5575384187640209, + "normalized_load_entropy": 0.7913403311135526, + "max_load_share": 0.125 + }, + "full_input": { + "tokens": 65, + "top_k": 6, + "decisions": 390, + "ordered_route_sha256": "933e8a558295524364544e55305c6ba490f558aaac6029eb5b2141ac152ea323", + "route_weight_sha256": "474c8ca36dbadd932c79dc1a628bfbdcdb9fc923db9bccf1a489fbf0901d5866", + "loads": [ + 9, + 4, + 3, + 14, + 9, + 24, + 2, + 8, + 0, + 3, + 4, + 1, + 4, + 3, + 4, + 15, + 5, + 0, + 12, + 1, + 11, + 2, + 12, + 5, + 2, + 14, + 1, + 2, + 0, + 7, + 11, + 1, + 2, + 5, + 5, + 7, + 4, + 7, + 5, + 4, + 5, + 7, + 2, + 7, + 20, + 2, + 0, + 0, + 6, + 8, + 11, + 0, + 0, + 23, + 4, + 11, + 2, + 10, + 5, + 2, + 13, + 5, + 1, + 14 + ], + "weighted_loads": [ + 0.4250909145921469, + 0.3864381033927202, + 0.2646254301071167, + 0.9618763066828251, + 0.45008430257439613, + 2.1858249492943287, + 0.06688885949552059, + 0.5303073208779097, + 0.0, + 0.32390209287405014, + 0.17230592668056488, + 0.03540737181901932, + 0.20395882986485958, + 0.36244138702750206, + 0.2780636139214039, + 1.0368766747415066, + 0.2991695683449507, + 0.0, + 1.066239196807146, + 0.03515274450182915, + 0.8711968415882438, + 0.07941168174147606, + 0.7481410950422287, + 0.31567036733031273, + 0.05532732419669628, + 0.9793530032038689, + 0.01743382401764393, + 0.06608065590262413, + 0.0, + 0.2182421050965786, + 0.6018981300294399, + 0.04557167366147041, + 0.08018283545970917, + 0.20238116569817066, + 0.19267303310334682, + 0.41846757009625435, + 0.1302460115402937, + 0.25534484907984734, + 1.4509764090180397, + 0.1954963244497776, + 0.20990325510501862, + 0.3434913083910942, + 0.14167676120996475, + 0.27010780945420265, + 1.2436371706426144, + 0.15752357244491577, + 0.0, + 0.0, + 0.47747562010772526, + 0.49965109303593636, + 1.6767899915575981, + 0.0, + 0.0, + 2.025209480896592, + 0.17921314761042595, + 1.1879862882196903, + 0.08427600562572479, + 0.7096901871263981, + 0.26086753234267235, + 0.05304880999028683, + 1.400170975131914, + 0.44996878504753113, + 0.060498423874378204, + 1.1959689520299435 + ], + "unique_experts": 57, + "load_cv": 0.9019665854320928, + "normalized_load_entropy": 0.9052479690902088, + "max_load_share": 0.06153846153846154 + } + }, + "s0_bos": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "671247db02d99e8df7801b99d8ff2ce1a9341ed5eb46ee455f3775298999706e", + "route_weight_sha256": "a811e73140610ff82878f5393d475302ae07044ec2fca1321d25e810c4ae7bf2", + "loads": [ + 3, + 2, + 3, + 2, + 1, + 16, + 0, + 0, + 0, + 1, + 1, + 3, + 2, + 3, + 4, + 3, + 0, + 0, + 1, + 0, + 6, + 1, + 1, + 3, + 1, + 0, + 0, + 0, + 0, + 2, + 12, + 0, + 0, + 3, + 0, + 4, + 1, + 1, + 2, + 0, + 0, + 5, + 0, + 0, + 4, + 1, + 0, + 0, + 4, + 3, + 0, + 0, + 0, + 15, + 3, + 1, + 0, + 4, + 4, + 0, + 0, + 4, + 0, + 14 + ], + "weighted_loads": [ + 0.14442220330238342, + 0.31240957230329514, + 0.2714933082461357, + 0.19591792672872543, + 0.03904394432902336, + 1.9831022433936596, + 0.0, + 0.0, + 0.0, + 0.1062028706073761, + 0.04284719377756119, + 0.1095594484359026, + 0.1365807130932808, + 0.11872157454490662, + 0.260969091206789, + 0.17371311783790588, + 0.0, + 0.0, + 0.0497153215110302, + 0.0, + 0.7104966565966606, + 0.04580497741699219, + 0.052845098078250885, + 0.15851322561502457, + 0.035280149430036545, + 0.0, + 0.0, + 0.0, + 0.0, + 0.06490535475313663, + 0.5889710932970047, + 0.0, + 0.0, + 0.11521323211491108, + 0.0, + 0.20591693744063377, + 0.030062753707170486, + 0.04057026654481888, + 0.08879648149013519, + 0.0, + 0.0, + 0.2174321673810482, + 0.0, + 0.0, + 0.22325274720788002, + 0.08976654708385468, + 0.0, + 0.0, + 0.4456791989505291, + 0.1874132603406906, + 0.0, + 0.0, + 0.0, + 1.5957366079092026, + 0.15513010323047638, + 0.03236450254917145, + 0.0, + 0.22309092804789543, + 0.2293272577226162, + 0.0, + 0.0, + 0.39998914301395416, + 0.0, + 1.1174845471978188 + ], + "unique_experts": 38, + "load_cv": 1.5535701615677293, + "normalized_load_entropy": 0.7842938881456829, + "max_load_share": 0.1111111111111111 + }, + "full_input": { + "tokens": 49, + "top_k": 6, + "decisions": 294, + "ordered_route_sha256": "26f08d324b7f58f4943557d4b2e6f7f068b2f449bc2ba09be9e48f5edaaef9b5", + "route_weight_sha256": "fdc0b167d46e44a4fcd2bfa54c54755bf0e3f0f985524b116bc3d09210cca909", + "loads": [ + 4, + 3, + 3, + 10, + 9, + 20, + 5, + 4, + 0, + 1, + 1, + 4, + 4, + 3, + 5, + 10, + 1, + 0, + 12, + 0, + 9, + 1, + 9, + 3, + 1, + 9, + 3, + 0, + 0, + 4, + 15, + 1, + 0, + 5, + 1, + 4, + 3, + 4, + 3, + 0, + 1, + 8, + 2, + 2, + 15, + 1, + 1, + 1, + 5, + 3, + 8, + 0, + 0, + 23, + 3, + 4, + 0, + 8, + 4, + 0, + 11, + 6, + 0, + 14 + ], + "weighted_loads": [ + 0.22500113397836685, + 0.3365716151893139, + 0.2714933082461357, + 0.7991135120391846, + 0.43483732640743256, + 2.167406689375639, + 0.15178022533655167, + 0.2481182962656021, + 0.0, + 0.1062028706073761, + 0.04284719377756119, + 0.8107063490897417, + 0.21479100361466408, + 0.11872157454490662, + 0.30678487569093704, + 0.6292275451123714, + 0.03671130910515785, + 0.0, + 0.977998711168766, + 0.0, + 0.8166380897164345, + 0.04580497741699219, + 0.5275902934372425, + 0.15851322561502457, + 0.035280149430036545, + 0.6212239488959312, + 0.09921158477663994, + 0.0, + 0.0, + 0.13099488988518715, + 0.7151891402900219, + 0.012027827091515064, + 0.0, + 0.1683048214763403, + 0.042151547968387604, + 0.20591693744063377, + 0.07682474330067635, + 0.12817252986133099, + 0.45335812866687775, + 0.0, + 0.04629724100232124, + 0.3364485986530781, + 0.15802065283060074, + 0.11874856799840927, + 0.6953181009739637, + 0.08976654708385468, + 0.1383921205997467, + 0.010382196865975857, + 0.48039769008755684, + 0.1874132603406906, + 1.3299424424767494, + 0.0, + 0.0, + 2.001825250685215, + 0.15513010323047638, + 0.5839702151715755, + 0.0, + 0.34375418722629547, + 0.2293272577226162, + 0.0, + 1.2631928957998753, + 0.5345684923231602, + 0.0, + 1.1174845471978188 + ], + "unique_experts": 52, + "load_cv": 1.0834708207377202, + "normalized_load_entropy": 0.870375289984632, + "max_load_share": 0.0782312925170068 + } + }, + "s1_bos": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "ec6aaacc45089f9ed83cec0e1fb1353c53bb68ffbe3edcdd4a40086252120c12", + "route_weight_sha256": "6cb2d41811bdf3156f07dc3ba0b160f721fe560f3d4b522bc0120c7274b81e4a", + "loads": [ + 3, + 2, + 3, + 2, + 1, + 17, + 0, + 0, + 0, + 1, + 2, + 2, + 2, + 3, + 4, + 3, + 0, + 0, + 1, + 0, + 6, + 1, + 1, + 3, + 0, + 0, + 0, + 0, + 0, + 1, + 6, + 0, + 1, + 3, + 3, + 6, + 1, + 1, + 2, + 0, + 0, + 6, + 0, + 0, + 3, + 1, + 0, + 0, + 4, + 3, + 0, + 0, + 0, + 15, + 3, + 1, + 0, + 4, + 4, + 0, + 1, + 4, + 0, + 14 + ], + "weighted_loads": [ + 0.1395768988877535, + 0.3345975801348686, + 0.26185233145952225, + 0.1768285185098648, + 0.03904810547828674, + 1.9325246550142765, + 0.0, + 0.0, + 0.0, + 0.10556546598672867, + 0.08096678555011749, + 0.0769585631787777, + 0.13634194433689117, + 0.11571097746491432, + 0.25685744918882847, + 0.1854420118033886, + 0.0, + 0.0, + 0.053327776491642, + 0.0, + 0.7429915834218264, + 0.045410118997097015, + 0.04714791104197502, + 0.15108538791537285, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.033721040934324265, + 0.3789694793522358, + 0.0, + 0.028341298922896385, + 0.12094664201140404, + 0.08374969474971294, + 0.300679799169302, + 0.029008449986577034, + 0.03878822922706604, + 0.0844549648463726, + 0.0, + 0.0, + 0.24732952006161213, + 0.0, + 0.0, + 0.16738877445459366, + 0.0964120402932167, + 0.0, + 0.0, + 0.44330790266394615, + 0.1862606704235077, + 0.0, + 0.0, + 0.0, + 1.6088992767035961, + 0.1516619808971882, + 0.03151220455765724, + 0.0, + 0.2160087637603283, + 0.23586271330714226, + 0.0, + 0.028803477063775063, + 0.3775148391723633, + 0.0, + 1.1392648853361607 + ], + "unique_experts": 40, + "load_cv": 1.507184440694504, + "normalized_load_entropy": 0.79801855211176, + "max_load_share": 0.11805555555555555 + }, + "full_input": { + "tokens": 65, + "top_k": 6, + "decisions": 390, + "ordered_route_sha256": "42c56c9af18ba1a291f29a0e3bea879f956b13241defa41114b0e4ef6a9986a3", + "route_weight_sha256": "0af8c9d94cb3e8169c00fe76caf8568fa264fd97cda6d881bc9dc85aaae92123", + "loads": [ + 9, + 3, + 3, + 13, + 9, + 24, + 2, + 8, + 0, + 3, + 4, + 2, + 4, + 4, + 5, + 16, + 5, + 0, + 12, + 1, + 11, + 2, + 13, + 5, + 1, + 14, + 2, + 2, + 0, + 6, + 6, + 0, + 2, + 4, + 5, + 8, + 4, + 7, + 4, + 5, + 5, + 9, + 2, + 6, + 19, + 2, + 0, + 0, + 4, + 8, + 12, + 0, + 0, + 26, + 4, + 12, + 2, + 11, + 5, + 2, + 13, + 5, + 1, + 14 + ], + "weighted_loads": [ + 0.43783055804669857, + 0.3587596230208874, + 0.26185233145952225, + 0.9355250224471092, + 0.445186335593462, + 2.272450987249613, + 0.06688885949552059, + 0.5243725460022688, + 0.0, + 0.3388836160302162, + 0.17509296536445618, + 0.0769585631787777, + 0.20134625397622585, + 0.3997378684580326, + 0.31867396645247936, + 1.0659498646855354, + 0.2991695683449507, + 0.0, + 1.0644756462424994, + 0.03515274450182915, + 0.9282935131341219, + 0.08225283026695251, + 0.7702736482024193, + 0.32267722859978676, + 0.02022602967917919, + 0.9768996573984623, + 0.06493291072547436, + 0.06608065590262413, + 0.0, + 0.1701485551893711, + 0.3789694793522358, + 0.0, + 0.07839861698448658, + 0.16886334866285324, + 0.16129708662629128, + 0.48026472702622414, + 0.13163904659450054, + 0.26530401036143303, + 0.49159592390060425, + 0.25316647812724113, + 0.20194228552281857, + 0.4063179735094309, + 0.1456618346273899, + 0.32051269710063934, + 1.168228829279542, + 0.16960929334163666, + 0.0, + 0.0, + 0.44330790266394615, + 0.5116450898349285, + 1.9185905158519745, + 0.0, + 0.0, + 2.152523411437869, + 0.18384233489632607, + 1.2324990406632423, + 0.084856066852808, + 0.7546480894088745, + 0.27136628329753876, + 0.05304880999028683, + 1.427095403894782, + 0.43935059756040573, + 0.060498423874378204, + 1.1392648853361607 + ], + "unique_experts": 56, + "load_cv": 0.9299883706228557, + "normalized_load_entropy": 0.9012384032686047, + "max_load_share": 0.06666666666666667 + } + }, + "s0_x": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "03b6049b00b370c310a232b1a73ae83461624f9b28b1e053ee50df69057b067f", + "route_weight_sha256": "26c80699f89d4d9c9875f8ccf98343a4f9417e9c6dfe1a4667d16d248135f28e", + "loads": [ + 3, + 2, + 3, + 2, + 1, + 17, + 0, + 0, + 0, + 1, + 2, + 1, + 2, + 3, + 4, + 3, + 0, + 0, + 1, + 0, + 6, + 1, + 1, + 3, + 0, + 0, + 0, + 0, + 0, + 1, + 12, + 0, + 1, + 3, + 1, + 5, + 2, + 1, + 2, + 0, + 0, + 5, + 0, + 0, + 5, + 1, + 0, + 0, + 4, + 3, + 0, + 0, + 0, + 15, + 3, + 0, + 0, + 4, + 3, + 0, + 0, + 4, + 0, + 13 + ], + "weighted_loads": [ + 0.13264259696006775, + 0.31464962661266327, + 0.28126514703035355, + 0.1737588793039322, + 0.04631529003381729, + 1.9372010566294193, + 0.0, + 0.0, + 0.0, + 0.11494021862745285, + 0.07768907025456429, + 0.03315817937254906, + 0.12476541101932526, + 0.10763302445411682, + 0.2573659382760525, + 0.18012411519885063, + 0.0, + 0.0, + 0.043158117681741714, + 0.0, + 0.70918383076787, + 0.04158572480082512, + 0.05214626342058182, + 0.15149318799376488, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.037586987018585205, + 0.6155101731419563, + 0.0, + 0.028004208579659462, + 0.12172447703778744, + 0.03732893615961075, + 0.24658098444342613, + 0.060125404968857765, + 0.039327505975961685, + 0.10331783816218376, + 0.0, + 0.0, + 0.21546394005417824, + 0.0, + 0.0, + 0.28114495798945427, + 0.09696890413761139, + 0.0, + 0.0, + 0.4580812565982342, + 0.19542710483074188, + 0.0, + 0.0, + 0.0, + 1.5885065346956253, + 0.14208872243762016, + 0.0, + 0.0, + 0.262867234647274, + 0.19109715893864632, + 0.0, + 0.0, + 0.3948107808828354, + 0.0, + 1.093191348016262 + ], + "unique_experts": 38, + "load_cv": 1.5654447559561524, + "normalized_load_entropy": 0.7825474799545288, + "max_load_share": 0.11805555555555555 + }, + "full_input": { + "tokens": 49, + "top_k": 6, + "decisions": 294, + "ordered_route_sha256": "5cae0ecca7f33acfd4dffc9981a16933932476acd9a11d8b91a77814888a3f44", + "route_weight_sha256": "f96e60e19ca027114cc2baea9581e3df6d10ac7336c58c942aba58bcc7aea651", + "loads": [ + 4, + 4, + 3, + 10, + 10, + 20, + 6, + 4, + 0, + 1, + 2, + 1, + 4, + 4, + 5, + 8, + 1, + 0, + 13, + 0, + 9, + 1, + 8, + 3, + 0, + 9, + 1, + 0, + 0, + 5, + 14, + 0, + 1, + 5, + 2, + 5, + 5, + 4, + 3, + 0, + 0, + 7, + 2, + 2, + 17, + 1, + 0, + 0, + 5, + 4, + 8, + 0, + 0, + 22, + 3, + 4, + 1, + 9, + 3, + 0, + 12, + 6, + 0, + 13 + ], + "weighted_loads": [ + 0.20492249727249146, + 0.37515442073345184, + 0.28126514703035355, + 0.7769544646143913, + 0.5675056986510754, + 2.045312289148569, + 0.1914132460951805, + 0.243646077811718, + 0.0, + 0.11494021862745285, + 0.07768907025456429, + 0.03315817937254906, + 0.24123984575271606, + 0.13426517136394978, + 0.29560649394989014, + 0.582714170217514, + 0.03671130910515785, + 0.0, + 1.0671743303537369, + 0.0, + 0.8153252638876438, + 0.04158572480082512, + 0.5258701518177986, + 0.15149318799376488, + 0.0, + 0.5754218399524689, + 0.01743382401764393, + 0.0, + 0.0, + 0.17182697542011738, + 0.6928780302405357, + 0.0, + 0.028004208579659462, + 0.17963671125471592, + 0.07390966638922691, + 0.24658098444342613, + 0.1399557013064623, + 0.1269297692924738, + 0.4678794853389263, + 0.0, + 0.0, + 0.33257053792476654, + 0.16764406114816666, + 0.0962359718978405, + 0.7986624632030725, + 0.09696890413761139, + 0.0, + 0.0, + 0.4927997477352619, + 0.23484018445014954, + 1.063141543418169, + 0.0, + 0.0, + 1.9537213053554296, + 0.14208872243762016, + 0.5560015290975571, + 0.04035819694399834, + 0.4361676573753357, + 0.19109715893864632, + 0.0, + 1.4420705176889896, + 0.5293901301920414, + 0.0, + 1.093191348016262 + ], + "unique_experts": 49, + "load_cv": 1.089603964512656, + "normalized_load_entropy": 0.8639495126000872, + "max_load_share": 0.07482993197278912 + } + }, + "s1_x": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "9ec92557476249e2f5067197af6827f549930b3d1262f26ed2f55e5e522e433a", + "route_weight_sha256": "19a1c7929445e87e399d01ee036dbe8dbd8ef00ea360cb74fd9180dde5d24c01", + "loads": [ + 3, + 2, + 3, + 2, + 1, + 18, + 0, + 0, + 0, + 1, + 2, + 2, + 2, + 2, + 4, + 3, + 0, + 0, + 0, + 0, + 5, + 1, + 1, + 3, + 0, + 0, + 0, + 0, + 0, + 1, + 9, + 0, + 0, + 3, + 2, + 5, + 1, + 3, + 2, + 0, + 1, + 5, + 0, + 0, + 5, + 1, + 0, + 0, + 4, + 3, + 0, + 0, + 0, + 14, + 3, + 0, + 0, + 4, + 3, + 0, + 0, + 4, + 0, + 16 + ], + "weighted_loads": [ + 0.13048533722758293, + 0.29590634256601334, + 0.2576102837920189, + 0.17191971838474274, + 0.047677379101514816, + 1.9080480709671974, + 0.0, + 0.0, + 0.0, + 0.10358740389347076, + 0.0862121544778347, + 0.05886618793010712, + 0.12387996166944504, + 0.07061399146914482, + 0.2508730925619602, + 0.17897523939609528, + 0.0, + 0.0, + 0.0, + 0.0, + 0.6281799748539925, + 0.04156636819243431, + 0.04369068518280983, + 0.14602511376142502, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.028656097128987312, + 0.5217115059494972, + 0.0, + 0.0, + 0.11715067923069, + 0.06915998458862305, + 0.29407545551657677, + 0.02930874563753605, + 0.11350684240460396, + 0.0979638546705246, + 0.0, + 0.021272795274853706, + 0.22448211163282394, + 0.0, + 0.0, + 0.27194223552942276, + 0.10149909555912018, + 0.0, + 0.0, + 0.4499066323041916, + 0.1998174898326397, + 0.0, + 0.0, + 0.0, + 1.4899844117462635, + 0.1576354019343853, + 0.0, + 0.0, + 0.2104357648640871, + 0.18666934594511986, + 0.0, + 0.0, + 0.38966047763824463, + 0.0, + 1.2734335251152515 + ], + "unique_experts": 37, + "load_cv": 1.5889277384527878, + "normalized_load_entropy": 0.7804927162531546, + "max_load_share": 0.125 + }, + "full_input": { + "tokens": 65, + "top_k": 6, + "decisions": 390, + "ordered_route_sha256": "ebd9b202432a13765f6d837af799eeb8b9de622552c74105157bfdc5c3d0c336", + "route_weight_sha256": "6fcd0152ccdad9d699f2312ef13535f2184f0c86e5e0bbe46210431b5a505c63", + "loads": [ + 8, + 3, + 3, + 14, + 11, + 25, + 3, + 8, + 0, + 3, + 4, + 2, + 5, + 3, + 5, + 17, + 7, + 0, + 12, + 1, + 8, + 3, + 12, + 5, + 2, + 15, + 1, + 3, + 0, + 6, + 9, + 0, + 1, + 3, + 3, + 7, + 4, + 9, + 4, + 4, + 4, + 7, + 2, + 5, + 21, + 2, + 0, + 0, + 4, + 7, + 12, + 0, + 0, + 23, + 4, + 11, + 2, + 12, + 4, + 2, + 13, + 5, + 1, + 16 + ], + "weighted_loads": [ + 0.4093356095254421, + 0.3200683854520321, + 0.2576102837920189, + 0.9623751975595951, + 0.6074745580554008, + 2.225317396223545, + 0.10603603906929493, + 0.4833004157990217, + 0.0, + 0.3369055539369583, + 0.18033833429217339, + 0.05886618793010712, + 0.2406489010900259, + 0.3546408824622631, + 0.3126896098256111, + 1.1865041330456734, + 0.4651671964675188, + 0.0, + 1.1331595964729786, + 0.03515274450182915, + 0.7370808534324169, + 0.10944528691470623, + 0.7078476138412952, + 0.31761695444583893, + 0.05215704254806042, + 0.9792142659425735, + 0.01743382401764393, + 0.10004843026399612, + 0.0, + 0.16508361138403416, + 0.5217115059494972, + 0.0, + 0.050057318061590195, + 0.11715067923069, + 0.0977370347827673, + 0.4736603833734989, + 0.13193934224545956, + 0.3353126719594002, + 0.5051048137247562, + 0.1954963244497776, + 0.15792052261531353, + 0.35000085458159447, + 0.15119928866624832, + 0.23528949171304703, + 1.1978587750345469, + 0.17469634860754013, + 0.0, + 0.0, + 0.4499066323041916, + 0.4372427836060524, + 1.4850950688123703, + 0.0, + 0.0, + 1.92301114089787, + 0.18981575593352318, + 1.1355383284389973, + 0.0867314487695694, + 0.7986495960503817, + 0.22217291593551636, + 0.05304880999028683, + 1.492488581687212, + 0.4514962360262871, + 0.060498423874378204, + 1.2734335251152515 + ], + "unique_experts": 56, + "load_cv": 0.9443558762663523, + "normalized_load_entropy": 0.8986242161906403, + "max_load_share": 0.0641025641025641 + } + }, + "s0_period": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "726ce3369f99a79a7cdea64ceaf8fd3b14b8ac8dd00c1543d8e4d261337833b6", + "route_weight_sha256": "c8c410e780cd835ff2e9a00cc23919a866cf0294e64e5dce4e27dad1d828b7bc", + "loads": [ + 3, + 2, + 3, + 2, + 1, + 19, + 0, + 0, + 0, + 1, + 2, + 1, + 2, + 2, + 4, + 2, + 0, + 0, + 1, + 0, + 5, + 1, + 1, + 3, + 1, + 0, + 0, + 0, + 0, + 1, + 11, + 0, + 1, + 3, + 2, + 5, + 2, + 1, + 2, + 0, + 0, + 6, + 0, + 0, + 5, + 1, + 0, + 0, + 4, + 3, + 0, + 0, + 0, + 15, + 2, + 0, + 0, + 3, + 3, + 0, + 0, + 4, + 0, + 14 + ], + "weighted_loads": [ + 0.13579456508159637, + 0.3239927217364311, + 0.2694917246699333, + 0.18244686722755432, + 0.04026538133621216, + 2.058328103274107, + 0.0, + 0.0, + 0.0, + 0.11257242411375046, + 0.0745626948773861, + 0.03344406560063362, + 0.12712376937270164, + 0.07448120787739754, + 0.26782078109681606, + 0.1387718990445137, + 0.0, + 0.0, + 0.044651955366134644, + 0.0, + 0.6945526339113712, + 0.04385855793952942, + 0.05105896294116974, + 0.1503269262611866, + 0.032838016748428345, + 0.0, + 0.0, + 0.0, + 0.0, + 0.03882814943790436, + 0.5847319066524506, + 0.0, + 0.027186546474695206, + 0.11770308949053288, + 0.06576471216976643, + 0.2572721354663372, + 0.0585581436753273, + 0.04125494137406349, + 0.10183188691735268, + 0.0, + 0.0, + 0.24580320715904236, + 0.0, + 0.0, + 0.27789392694830894, + 0.0878135934472084, + 0.0, + 0.0, + 0.4579598270356655, + 0.19580768421292305, + 0.0, + 0.0, + 0.0, + 1.5527714975178242, + 0.11045245826244354, + 0.0, + 0.0, + 0.20883067697286606, + 0.190108310431242, + 0.0, + 0.0, + 0.38958584517240524, + 0.0, + 1.1263067610561848 + ], + "unique_experts": 39, + "load_cv": 1.6216132799251581, + "normalized_load_entropy": 0.7802958250712254, + "max_load_share": 0.13194444444444445 + }, + "full_input": { + "tokens": 49, + "top_k": 6, + "decisions": 294, + "ordered_route_sha256": "e3df3b6167601ffa7a149ac54faa657172afb487f941ac3c31f7dd7969c84ea8", + "route_weight_sha256": "fbbbac46cac8936dd192d357d98546e8af7aec7eb262d766b5985a0a9e4fa4cc", + "loads": [ + 4, + 3, + 3, + 10, + 10, + 21, + 6, + 5, + 2, + 1, + 2, + 1, + 5, + 2, + 4, + 8, + 2, + 0, + 12, + 0, + 9, + 1, + 8, + 3, + 1, + 9, + 1, + 0, + 0, + 4, + 13, + 0, + 1, + 4, + 3, + 5, + 4, + 4, + 3, + 1, + 1, + 8, + 2, + 2, + 18, + 1, + 0, + 0, + 5, + 4, + 9, + 0, + 0, + 21, + 2, + 3, + 1, + 7, + 3, + 0, + 11, + 7, + 0, + 14 + ], + "weighted_loads": [ + 0.21128316968679428, + 0.3481547646224499, + 0.2694917246699333, + 0.7856424525380135, + 0.48142150044441223, + 2.1342331543564796, + 0.21097386628389359, + 0.4154241755604744, + 0.06896735727787018, + 0.11257242411375046, + 0.0745626948773861, + 0.03344406560063362, + 0.3001471310853958, + 0.07448120787739754, + 0.26782078109681606, + 0.5425943732261658, + 0.08822735771536827, + 0.0, + 0.9681623764336109, + 0.0, + 0.8355265259742737, + 0.04385855793952942, + 0.590699203312397, + 0.1503269262611866, + 0.032838016748428345, + 0.6503034941852093, + 0.01743382401764393, + 0.0, + 0.0, + 0.14007113315165043, + 0.66369703784585, + 0.0, + 0.027186546474695206, + 0.14082050137221813, + 0.10357941500842571, + 0.2572721354663372, + 0.10532013326883316, + 0.1288572046905756, + 0.46639353409409523, + 0.049280498176813126, + 0.05665356665849686, + 0.3553350754082203, + 0.16362163424491882, + 0.07900867983698845, + 0.8079176675528288, + 0.0878135934472084, + 0.0, + 0.0, + 0.49267831817269325, + 0.2602924145758152, + 1.157931450754404, + 0.0, + 0.0, + 1.8966109920293093, + 0.11045245826244354, + 0.5114170722663403, + 0.046698153018951416, + 0.3294939361512661, + 0.190108310431242, + 0.0, + 1.2631928957998753, + 0.5659148246049881, + 0.0, + 1.1263067610561848 + ], + "unique_experts": 53, + "load_cv": 1.0773027612043147, + "normalized_load_entropy": 0.8730859689785727, + "max_load_share": 0.07142857142857142 + } + }, + "s1_period": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "c30e54d84dfc6dab443afb53d3e6ca87ae96c64451e00538cf590f0d52839f8a", + "route_weight_sha256": "3c68463ee5bffaef32199a667fb2019e1f0dc75f68f80d89c866339a620e7467", + "loads": [ + 3, + 2, + 3, + 2, + 1, + 18, + 0, + 0, + 0, + 1, + 3, + 2, + 2, + 3, + 4, + 2, + 0, + 0, + 0, + 0, + 5, + 1, + 1, + 3, + 0, + 0, + 0, + 0, + 0, + 2, + 10, + 1, + 0, + 2, + 3, + 5, + 0, + 3, + 2, + 0, + 0, + 5, + 0, + 0, + 4, + 1, + 0, + 0, + 4, + 3, + 0, + 0, + 0, + 13, + 3, + 0, + 0, + 4, + 3, + 0, + 0, + 4, + 0, + 16 + ], + "weighted_loads": [ + 0.12754995189607143, + 0.2943786680698395, + 0.2541442923247814, + 0.17483815550804138, + 0.042621105909347534, + 1.8920390624552965, + 0.0, + 0.0, + 0.0, + 0.10770805925130844, + 0.11205200478434563, + 0.05889017879962921, + 0.12778310850262642, + 0.10807807743549347, + 0.24426152370870113, + 0.14369428902864456, + 0.0, + 0.0, + 0.0, + 0.0, + 0.6420136913657188, + 0.042604319751262665, + 0.03997035697102547, + 0.1498609110713005, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0664222352206707, + 0.5653017591685057, + 0.05566708743572235, + 0.0, + 0.07899758964776993, + 0.10535217821598053, + 0.29644280672073364, + 0.0, + 0.12389272451400757, + 0.10633427277207375, + 0.0, + 0.0, + 0.22326377034187317, + 0.0, + 0.0, + 0.23359443992376328, + 0.09918908774852753, + 0.0, + 0.0, + 0.45847033336758614, + 0.1966908723115921, + 0.0, + 0.0, + 0.0, + 1.4022409282624722, + 0.16243726760149002, + 0.0, + 0.0, + 0.2160621490329504, + 0.19016391411423683, + 0.0, + 0.0, + 0.39342910051345825, + 0.0, + 1.2407045029103756 + ], + "unique_experts": 36, + "load_cv": 1.579185600394655, + "normalized_load_entropy": 0.7797543477454613, + "max_load_share": 0.125 + }, + "full_input": { + "tokens": 65, + "top_k": 6, + "decisions": 390, + "ordered_route_sha256": "5bd9b79e4bd89b3085911c329dfc9574b927683da4c63c35ddc5b8998efa18e3", + "route_weight_sha256": "27da562fd8c6fa234bcc86a2dd7d282e71627379591d158e261b9777903635a2", + "loads": [ + 8, + 3, + 3, + 13, + 9, + 24, + 3, + 9, + 0, + 3, + 5, + 2, + 7, + 4, + 5, + 15, + 6, + 0, + 10, + 1, + 9, + 2, + 12, + 5, + 1, + 15, + 1, + 2, + 0, + 7, + 10, + 1, + 1, + 2, + 4, + 7, + 3, + 12, + 4, + 5, + 4, + 7, + 2, + 5, + 21, + 2, + 0, + 0, + 4, + 8, + 12, + 0, + 0, + 21, + 4, + 12, + 1, + 11, + 4, + 2, + 13, + 7, + 1, + 16 + ], + "weighted_loads": [ + 0.3939537163823843, + 0.31854071095585823, + 0.2541442923247814, + 0.9335346594452858, + 0.4487593360245228, + 2.157632226124406, + 0.10876579396426678, + 0.5632396172732115, + 0.0, + 0.341026209294796, + 0.2061781845986843, + 0.05889017879962921, + 0.3406850192695856, + 0.39210496842861176, + 0.30607804097235203, + 1.1187647245824337, + 0.3294088691473007, + 0.0, + 0.9817607328295708, + 0.03515274450182915, + 0.8010040707886219, + 0.07944703102111816, + 0.6982245221734047, + 0.3214527517557144, + 0.02022602967917919, + 1.0372192077338696, + 0.01743382401764393, + 0.06608065590262413, + 0.0, + 0.20284974947571754, + 0.5653017591685057, + 0.05566708743572235, + 0.050057318061590195, + 0.07899758964776993, + 0.13392922841012478, + 0.4760277345776558, + 0.10263059660792351, + 0.46779076382517815, + 0.5134752318263054, + 0.24473418667912483, + 0.17436199262738228, + 0.35089680179953575, + 0.1520693674683571, + 0.24415680393576622, + 1.202558996155858, + 0.17238634079694748, + 0.0, + 0.0, + 0.45847033336758614, + 0.522655438631773, + 1.4886848889291286, + 0.0, + 0.0, + 1.7792815808206797, + 0.1946176216006279, + 1.168256040662527, + 0.04603590816259384, + 0.7547014746814966, + 0.22566748410463333, + 0.05304880999028683, + 1.4396016523241997, + 0.5369897820055485, + 0.060498423874378204, + 1.2407045029103756 + ], + "unique_experts": 57, + "load_cv": 0.9153953888614024, + "normalized_load_entropy": 0.9013572299627132, + "max_load_share": 0.06153846153846154 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 24, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.9404761904761904, + "mean_token_weighted_tv": 0.01742022077087313, + "aggregate_load_tv": 0.03472222222222222 + }, + "system_bos": { + "tokens": 24, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 12, + "mean_set_jaccard": 0.8571428571428572, + "mean_token_weighted_tv": 0.02841675200033933, + "aggregate_load_tv": 0.06944444444444445 + }, + "system_x": { + "tokens": 24, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 12, + "mean_set_jaccard": 0.8482142857142857, + "mean_token_weighted_tv": 0.03607749477184067, + "aggregate_load_tv": 0.06249999999999999 + }, + "system_period": { + "tokens": 24, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 11, + "mean_set_jaccard": 0.8452380952380952, + "mean_token_weighted_tv": 0.03803220383512477, + "aggregate_load_tv": 0.08333333333333333 + }, + "bos_at_s0": { + "tokens": 24, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.880952380952381, + "mean_token_weighted_tv": 0.028830033300134044, + "aggregate_load_tv": 0.04861111111111112 + }, + "bos_at_s1": { + "tokens": 24, + "ordered_topk_exact_tokens": 6, + "set_exact_tokens": 8, + "mean_set_jaccard": 0.8095238095238096, + "mean_token_weighted_tv": 0.0395479901926592, + "aggregate_load_tv": 0.07638888888888888 + }, + "x_at_s0": { + "tokens": 24, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.8928571428571429, + "mean_token_weighted_tv": 0.029027711561260123, + "aggregate_load_tv": 0.04166666666666667 + }, + "x_at_s1": { + "tokens": 24, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 11, + "mean_set_jaccard": 0.8363095238095237, + "mean_token_weighted_tv": 0.04201904470877101, + "aggregate_load_tv": 0.05555555555555555 + }, + "period_at_s0": { + "tokens": 24, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8809523809523809, + "mean_token_weighted_tv": 0.030324886514184374, + "aggregate_load_tv": 0.048611111111111105 + }, + "period_at_s1": { + "tokens": 24, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 10, + "mean_set_jaccard": 0.8244047619047619, + "mean_token_weighted_tv": 0.0439578949008137, + "aggregate_load_tv": 0.06944444444444445 + } + } + }, + "layer_21": { + "layer": 21, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "88aaa7abd1cf3db0708c1246c793f57cb5ff1d91f43adb5ddc9f2631c66225f8", + "route_weight_sha256": "10473db1e47cf6485f59bde331ce97146b5e1a053488df8e96ae88f2097d164e", + "loads": [ + 0, + 4, + 2, + 1, + 0, + 2, + 4, + 2, + 3, + 0, + 2, + 2, + 18, + 12, + 0, + 6, + 5, + 3, + 0, + 0, + 0, + 3, + 1, + 0, + 0, + 0, + 6, + 1, + 4, + 0, + 15, + 0, + 1, + 1, + 2, + 0, + 3, + 2, + 1, + 3, + 3, + 0, + 2, + 0, + 0, + 3, + 1, + 0, + 0, + 3, + 0, + 5, + 0, + 1, + 2, + 0, + 4, + 3, + 2, + 0, + 0, + 4, + 1, + 1 + ], + "weighted_loads": [ + 0.0, + 0.15449228137731552, + 0.13110709935426712, + 0.03293321281671524, + 0.0, + 0.30497676134109497, + 0.15696892142295837, + 0.12568919360637665, + 0.11501835286617279, + 0.0, + 0.08955228514969349, + 0.08983584493398666, + 1.8495308440178633, + 1.3410662896931171, + 0.0, + 0.7154805976897478, + 0.27264704927802086, + 0.12758779898285866, + 0.0, + 0.0, + 0.0, + 0.11206690222024918, + 0.030926087871193886, + 0.0, + 0.0, + 0.0, + 0.25693451799452305, + 0.027295444160699844, + 0.9582672715187073, + 0.0, + 1.394198777154088, + 0.0, + 0.0933689996600151, + 0.045023735612630844, + 0.07965878769755363, + 0.0, + 0.11445749551057816, + 0.07983436435461044, + 0.05431131646037102, + 0.09766877256333828, + 0.19469105824828148, + 0.0, + 0.11286567524075508, + 0.0, + 0.0, + 0.14867953583598137, + 0.024744847789406776, + 0.0, + 0.0, + 0.2425457499921322, + 0.0, + 0.5218729935586452, + 0.0, + 0.025970149785280228, + 0.07261200994253159, + 0.0, + 0.15854868665337563, + 0.21537209302186966, + 0.06682701781392097, + 0.0, + 0.0, + 0.20307012647390366, + 0.04246709868311882, + 0.03997981175780296 + ], + "unique_experts": 41, + "load_cv": 1.4719601443879744, + "normalized_load_entropy": 0.8087440078263322, + "max_load_share": 0.125 + }, + "full_input": { + "tokens": 49, + "top_k": 6, + "decisions": 294, + "ordered_route_sha256": "4933e142d237021e12c451fb14e5565c06d9ca1a046761db2979dac2b26529a8", + "route_weight_sha256": "331bb3087ee6b650a228f4eb61303cd30290a5f8a976eaa056e1c6578e2c63b9", + "loads": [ + 0, + 4, + 5, + 1, + 7, + 2, + 7, + 2, + 5, + 1, + 10, + 2, + 20, + 17, + 3, + 11, + 6, + 8, + 0, + 5, + 0, + 11, + 1, + 1, + 0, + 1, + 15, + 6, + 7, + 0, + 18, + 0, + 2, + 1, + 3, + 9, + 3, + 2, + 1, + 3, + 4, + 0, + 7, + 0, + 0, + 3, + 1, + 0, + 12, + 5, + 0, + 12, + 11, + 2, + 7, + 2, + 6, + 3, + 6, + 1, + 1, + 6, + 4, + 1 + ], + "weighted_loads": [ + 0.0, + 0.15449228137731552, + 0.20736709190532565, + 0.03293321281671524, + 0.26518746837973595, + 0.30497676134109497, + 0.41518983617424965, + 0.12568919360637665, + 0.25086379051208496, + 0.03904026374220848, + 0.6369988601654768, + 0.08983584493398666, + 1.9575174655765295, + 1.6994080729782581, + 0.1115660797804594, + 0.8737862706184387, + 0.2858786303550005, + 0.3227213923819363, + 0.0, + 1.596313189715147, + 0.0, + 0.5725129428319633, + 0.030926087871193886, + 0.04428989812731743, + 0.0, + 0.03499699383974075, + 0.6608046628534794, + 0.6579971686005592, + 1.0178686678409576, + 0.0, + 1.6242696810513735, + 0.0, + 0.11622036807239056, + 0.045023735612630844, + 0.12531251832842827, + 0.5553560145199299, + 0.11445749551057816, + 0.07983436435461044, + 0.05431131646037102, + 0.09766877256333828, + 0.24364535883069038, + 0.0, + 0.4231533296406269, + 0.0, + 0.0, + 0.14867953583598137, + 0.024744847789406776, + 0.0, + 0.6314321905374527, + 0.40219660848379135, + 0.0, + 0.8410552516579628, + 0.6487552672624588, + 0.038980147801339626, + 0.28309325501322746, + 0.2533615976572037, + 0.23748107254505157, + 0.21537209302186966, + 0.23327427171170712, + 0.04479784518480301, + 0.022215312346816063, + 0.28730710968375206, + 0.19473152607679367, + 0.03997981175780296 + ], + "unique_experts": 53, + "load_cv": 1.0359586075107163, + "normalized_load_entropy": 0.8766400774513757, + "max_load_share": 0.06802721088435375 + } + }, + "s1_eos": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "ee1f91816af3c704e590ab0d8dbe1d9862ecb3561fef978bc05f376051560a9b", + "route_weight_sha256": "27da1f5cf0a317dfc8cd529db297b91168f0a528af7481fdbd025bba5b81ed98", + "loads": [ + 0, + 4, + 2, + 1, + 0, + 2, + 4, + 2, + 3, + 0, + 2, + 2, + 18, + 12, + 0, + 6, + 4, + 3, + 0, + 0, + 0, + 3, + 1, + 0, + 0, + 1, + 5, + 1, + 4, + 0, + 15, + 0, + 1, + 1, + 2, + 0, + 3, + 2, + 1, + 3, + 3, + 0, + 2, + 0, + 0, + 3, + 1, + 0, + 0, + 4, + 0, + 5, + 0, + 1, + 2, + 0, + 4, + 3, + 1, + 0, + 0, + 4, + 2, + 1 + ], + "weighted_loads": [ + 0.0, + 0.1513952799141407, + 0.13789067789912224, + 0.03903500363230705, + 0.0, + 0.30696119368076324, + 0.14760096929967403, + 0.12396024540066719, + 0.11654528602957726, + 0.0, + 0.09096110239624977, + 0.08336927182972431, + 1.8083301801234484, + 1.2458848543465137, + 0.0, + 0.7174601852893829, + 0.24113068357110023, + 0.12844179198145866, + 0.0, + 0.0, + 0.0, + 0.1124351117759943, + 0.03236338868737221, + 0.0, + 0.0, + 0.032654184848070145, + 0.22207267582416534, + 0.026668723672628403, + 0.9469011798501015, + 0.0, + 1.4027416314929724, + 0.0, + 0.090510793030262, + 0.04777076095342636, + 0.08064435422420502, + 0.0, + 0.12465817108750343, + 0.09168650582432747, + 0.057940613478422165, + 0.09710652381181717, + 0.1924510896205902, + 0.0, + 0.10817954689264297, + 0.0, + 0.0, + 0.13723500072956085, + 0.026667974889278412, + 0.0, + 0.0, + 0.2626372091472149, + 0.0, + 0.5167136490345001, + 0.0, + 0.02543739043176174, + 0.079109326004982, + 0.0, + 0.16480296663939953, + 0.20356280729174614, + 0.039486389607191086, + 0.0, + 0.0, + 0.208724033087492, + 0.06929580867290497, + 0.03630411997437477 + ], + "unique_experts": 42, + "load_cv": 1.4593250596181886, + "normalized_load_entropy": 0.8136799598014368, + "max_load_share": 0.125 + }, + "full_input": { + "tokens": 65, + "top_k": 6, + "decisions": 390, + "ordered_route_sha256": "16078c7bf2dd04265197ee8a306975005528edaeff425938da555067656a9e8c", + "route_weight_sha256": "81ab6609356c3b3678bac1b43f5391f9dbd6d79b347d7c53f978544b03e4bbaa", + "loads": [ + 8, + 5, + 6, + 1, + 0, + 3, + 9, + 3, + 6, + 3, + 13, + 2, + 22, + 23, + 7, + 9, + 5, + 13, + 2, + 3, + 1, + 13, + 2, + 5, + 1, + 3, + 13, + 11, + 7, + 1, + 22, + 0, + 2, + 5, + 2, + 16, + 4, + 3, + 2, + 4, + 4, + 2, + 12, + 1, + 1, + 4, + 1, + 0, + 11, + 7, + 2, + 15, + 10, + 2, + 14, + 9, + 9, + 3, + 4, + 5, + 1, + 6, + 5, + 2 + ], + "weighted_loads": [ + 0.5118442457169294, + 0.20043450593948364, + 0.8660621708258986, + 0.03903500363230705, + 0.0, + 0.3221778254956007, + 0.39089968614280224, + 0.20410354062914848, + 0.2527114525437355, + 0.19488628022372723, + 0.7266148142516613, + 0.08336927182972431, + 2.013605972751975, + 1.8437258582562208, + 0.2759219966828823, + 0.8049999950453639, + 0.25436226464807987, + 0.5341666401363909, + 0.053501829504966736, + 1.5048673823475838, + 0.04684650897979736, + 0.6492302254773676, + 0.06286495365202427, + 0.49098507314920425, + 0.03586822375655174, + 0.1043862085789442, + 0.5043167192488909, + 1.065021637827158, + 0.9821924837306142, + 0.04966295138001442, + 1.8280267510563135, + 0.0, + 0.11317981407046318, + 0.6457597240805626, + 0.08064435422420502, + 0.8902464061975479, + 0.1964183859527111, + 0.13172045350074768, + 0.11527635902166367, + 0.13592858612537384, + 0.23307983577251434, + 0.12296096235513687, + 0.5971032995730639, + 0.04419117048382759, + 0.06589469313621521, + 0.1963326632976532, + 0.026667974889278412, + 0.0, + 0.8106835968792439, + 1.1664637364447117, + 0.07989320904016495, + 1.236998450011015, + 0.5778358019888401, + 0.03844738844782114, + 0.8249766640365124, + 0.6441085301339626, + 0.36760574392974377, + 0.20356280729174614, + 0.18103807605803013, + 0.24425991997122765, + 0.02242094837129116, + 0.31841932982206345, + 0.19146055355668068, + 0.12463386729359627 + ], + "unique_experts": 61, + "load_cv": 0.9042961236729596, + "normalized_load_entropy": 0.9099928429954265, + "max_load_share": 0.05897435897435897 + } + }, + "s0_bos": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "9554a2f34907967e30773d5010b78b4720a59421b6804887b5ca19c090e8b5ed", + "route_weight_sha256": "1deaf47cb55a5be11b32111fa69831ec34455ddc4ca3188e14b5565153012e7f", + "loads": [ + 0, + 5, + 3, + 1, + 0, + 2, + 4, + 2, + 1, + 0, + 2, + 2, + 17, + 12, + 0, + 6, + 6, + 3, + 0, + 0, + 0, + 3, + 1, + 0, + 0, + 0, + 6, + 1, + 4, + 0, + 15, + 0, + 1, + 1, + 3, + 0, + 3, + 2, + 1, + 3, + 3, + 0, + 2, + 0, + 0, + 3, + 1, + 0, + 0, + 2, + 1, + 5, + 0, + 1, + 3, + 0, + 3, + 3, + 1, + 0, + 0, + 4, + 1, + 1 + ], + "weighted_loads": [ + 0.0, + 0.18898768350481987, + 0.17740263417363167, + 0.039431311190128326, + 0.0, + 0.3234451711177826, + 0.16984862089157104, + 0.12123789638280869, + 0.04327718913555145, + 0.0, + 0.08567299507558346, + 0.09555613622069359, + 1.8820176590234041, + 1.2567596063017845, + 0.0, + 0.7044665142893791, + 0.28522903472185135, + 0.12355326116085052, + 0.0, + 0.0, + 0.0, + 0.10868526808917522, + 0.030206164345145226, + 0.0, + 0.0, + 0.0, + 0.2595698665827513, + 0.024613389745354652, + 0.9693505391478539, + 0.0, + 1.3903576731681824, + 0.0, + 0.0918581485748291, + 0.035346757620573044, + 0.11574555560946465, + 0.0, + 0.1334133930504322, + 0.08118489012122154, + 0.0553518608212471, + 0.09595344960689545, + 0.17526889592409134, + 0.0, + 0.11135174706578255, + 0.0, + 0.0, + 0.14524934068322182, + 0.03978492319583893, + 0.0, + 0.0, + 0.2206994630396366, + 0.040908388793468475, + 0.5149460807442665, + 0.0, + 0.024361899122595787, + 0.11980578675866127, + 0.0, + 0.12611760944128036, + 0.23202482610940933, + 0.03587724640965462, + 0.0, + 0.0, + 0.20293583162128925, + 0.04317013919353485, + 0.04103735834360123 + ], + "unique_experts": 42, + "load_cv": 1.4487116456005886, + "normalized_load_entropy": 0.8116979797199109, + "max_load_share": 0.11805555555555555 + }, + "full_input": { + "tokens": 49, + "top_k": 6, + "decisions": 294, + "ordered_route_sha256": "147f60ea68c0bf2ad8cd8084e3ed48d9a3760bb8c08dc5fc19d3317194200375", + "route_weight_sha256": "3d3a395e1f8b7ab8b6cd186f118a66eb6f2b1da8bd97459c7a3af00062eea934", + "loads": [ + 0, + 7, + 6, + 2, + 6, + 2, + 5, + 2, + 4, + 0, + 8, + 2, + 19, + 18, + 2, + 10, + 7, + 7, + 1, + 3, + 0, + 11, + 1, + 1, + 0, + 1, + 15, + 6, + 6, + 0, + 18, + 3, + 2, + 1, + 4, + 9, + 3, + 2, + 1, + 6, + 6, + 0, + 7, + 0, + 0, + 5, + 1, + 0, + 12, + 4, + 1, + 12, + 10, + 2, + 7, + 2, + 4, + 3, + 3, + 2, + 1, + 6, + 4, + 1 + ], + "weighted_loads": [ + 0.0, + 0.27025868743658066, + 0.287913054227829, + 0.24325702339410782, + 0.22795670107007027, + 0.3234451711177826, + 0.3350116163492203, + 0.12123789638280869, + 0.20030413568019867, + 0.0, + 0.4955404829233885, + 0.09555613622069359, + 1.9900042805820704, + 1.6117578223347664, + 0.06841023080050945, + 0.8476563338190317, + 0.298460615798831, + 0.29829316586256027, + 0.05425674095749855, + 0.6142085194587708, + 0.0, + 0.6048781117424369, + 0.030206164345145226, + 0.04428989812731743, + 0.0, + 0.03499699383974075, + 0.6634400114417076, + 0.6785235982388258, + 1.0245352741330862, + 0.0, + 1.6323261745274067, + 0.2439737543463707, + 0.11470951698720455, + 0.035346757620573044, + 0.16139928624033928, + 0.5553560145199299, + 0.1334133930504322, + 0.08118489012122154, + 0.0553518608212471, + 0.21913277357816696, + 0.35415028780698776, + 0.0, + 0.40710968896746635, + 0.0, + 0.0, + 0.2991683781147003, + 0.03978492319583893, + 0.0, + 0.6223446577787399, + 0.3804090954363346, + 0.040908388793468475, + 0.8341283388435841, + 0.6199528761208057, + 0.037371897138655186, + 0.2550406903028488, + 0.22365360334515572, + 0.16734886914491653, + 0.23202482610940933, + 0.09736439026892185, + 0.08627413585782051, + 0.022215312346816063, + 0.29541668109595776, + 0.19085955247282982, + 0.04103735834360123 + ], + "unique_experts": 55, + "load_cv": 1.0032802878644633, + "normalized_load_entropy": 0.8868435868171033, + "max_load_share": 0.06462585034013606 + } + }, + "s1_bos": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "cdf1b351c2432e661457ca6bd8749f4d00ddc6996e38c4a9a103c4433b7fd742", + "route_weight_sha256": "0c73e70b1b03b51fdf1bad33a01ffaf6747ca5c0db46b2d576e8f13ca361379b", + "loads": [ + 1, + 4, + 3, + 1, + 0, + 2, + 3, + 2, + 2, + 0, + 3, + 2, + 17, + 12, + 0, + 6, + 5, + 3, + 0, + 0, + 0, + 3, + 1, + 0, + 0, + 0, + 6, + 0, + 4, + 0, + 16, + 0, + 1, + 1, + 1, + 0, + 3, + 2, + 1, + 3, + 3, + 0, + 2, + 0, + 0, + 3, + 2, + 0, + 0, + 3, + 1, + 5, + 0, + 0, + 3, + 0, + 3, + 3, + 1, + 0, + 0, + 4, + 2, + 1 + ], + "weighted_loads": [ + 0.03184797614812851, + 0.15271880477666855, + 0.16705917567014694, + 0.036314457654953, + 0.0, + 0.32541198283433914, + 0.1086401641368866, + 0.10942165553569794, + 0.06040985696017742, + 0.0, + 0.10727855749428272, + 0.08734813146293163, + 1.8458030726760626, + 1.2293768152594566, + 0.0, + 0.6916172932833433, + 0.2520227674394846, + 0.12070654705166817, + 0.0, + 0.0, + 0.0, + 0.1119602806866169, + 0.03231032192707062, + 0.0, + 0.0, + 0.0, + 0.2500465791672468, + 0.0, + 0.9926470667123795, + 0.0, + 1.444943144917488, + 0.0, + 0.08742260932922363, + 0.034946609288454056, + 0.04808386415243149, + 0.0, + 0.134149681776762, + 0.09614041075110435, + 0.05820946395397186, + 0.10302329994738102, + 0.20116930454969406, + 0.0, + 0.10697461664676666, + 0.0, + 0.0, + 0.1344447210431099, + 0.07494233921170235, + 0.0, + 0.0, + 0.2610372193157673, + 0.038665108382701874, + 0.5048486404120922, + 0.0, + 0.0, + 0.12448763474822044, + 0.0, + 0.119689567014575, + 0.2193291150033474, + 0.03570767119526863, + 0.0, + 0.0, + 0.20500710047781467, + 0.07132941111922264, + 0.03678066283464432 + ], + "unique_experts": 41, + "load_cv": 1.4635488747021657, + "normalized_load_entropy": 0.8100814970047809, + "max_load_share": 0.11805555555555555 + }, + "full_input": { + "tokens": 65, + "top_k": 6, + "decisions": 390, + "ordered_route_sha256": "a6c6ffb54636cd2f6aae18c952ec6761aa9328d1e3464c3e7547ed15a5fca62d", + "route_weight_sha256": "1852ac887fe34d00ccc14b9847f720c15553123764da5ec8b907fe22c9246b05", + "loads": [ + 9, + 6, + 6, + 1, + 3, + 3, + 7, + 4, + 5, + 2, + 12, + 3, + 21, + 24, + 5, + 9, + 6, + 10, + 4, + 2, + 1, + 12, + 2, + 5, + 1, + 2, + 14, + 11, + 6, + 1, + 23, + 2, + 2, + 5, + 1, + 16, + 4, + 3, + 2, + 4, + 4, + 2, + 12, + 1, + 1, + 4, + 2, + 0, + 10, + 7, + 3, + 15, + 10, + 1, + 15, + 10, + 8, + 3, + 2, + 6, + 1, + 6, + 6, + 2 + ], + "weighted_loads": [ + 0.543692221865058, + 0.26356029883027077, + 0.9051029067486525, + 0.036314457654953, + 0.10975685715675354, + 0.3406286146491766, + 0.32985902577638626, + 0.22615014389157295, + 0.20254282839596272, + 0.14641900174319744, + 0.6619042512029409, + 0.14046414382755756, + 2.0510788653045893, + 1.85655746050179, + 0.20019621774554253, + 0.8122893143445253, + 0.26525434851646423, + 0.43404069915413857, + 0.15218840911984444, + 0.5650026872754097, + 0.04684650897979736, + 0.6420384598895907, + 0.06281188689172268, + 0.49098507314920425, + 0.03586822375655174, + 0.07173202373087406, + 0.5322906225919724, + 1.0535357668995857, + 1.023574087768793, + 0.04966295138001442, + 1.8863167576491833, + 0.13540387526154518, + 0.11009163036942482, + 0.6329355724155903, + 0.04808386415243149, + 0.8902464061975479, + 0.20590989664196968, + 0.13617435842752457, + 0.11554520949721336, + 0.13681809417903423, + 0.24602104350924492, + 0.12296096235513687, + 0.5765339639037848, + 0.04419117048382759, + 0.06589469313621521, + 0.19354238361120224, + 0.07494233921170235, + 0.0, + 0.7660098187625408, + 1.25639383867383, + 0.11855831742286682, + 1.225133441388607, + 0.5778358019888401, + 0.013009998016059399, + 0.8786169067025185, + 0.6600043475627899, + 0.31352262385189533, + 0.2193291150033474, + 0.06065153516829014, + 0.29816242679953575, + 0.02242094837129116, + 0.3086444344371557, + 0.25785911455750465, + 0.12511041015386581 + ], + "unique_experts": 63, + "load_cv": 0.8949415886382157, + "normalized_load_entropy": 0.9154452958111378, + "max_load_share": 0.06153846153846154 + } + }, + "s0_x": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "da120578814cc8a8979ae8ad81da8c73d57bb56891dee14d4de4096fa6f2e3c3", + "route_weight_sha256": "f804b3042188be8afd4d1de9b81aef55bd468ff5872e908936ce47e894d6f2a3", + "loads": [ + 1, + 4, + 3, + 1, + 0, + 2, + 3, + 2, + 2, + 0, + 2, + 2, + 19, + 11, + 1, + 6, + 4, + 3, + 0, + 0, + 0, + 3, + 0, + 0, + 0, + 0, + 5, + 1, + 4, + 0, + 15, + 0, + 1, + 1, + 3, + 0, + 3, + 2, + 1, + 4, + 3, + 0, + 2, + 0, + 0, + 3, + 0, + 0, + 1, + 3, + 1, + 5, + 0, + 1, + 1, + 0, + 3, + 3, + 2, + 0, + 0, + 4, + 2, + 1 + ], + "weighted_loads": [ + 0.031484466046094894, + 0.15329385921359062, + 0.166789211332798, + 0.03359777852892876, + 0.0, + 0.3448335900902748, + 0.14600476995110512, + 0.12113410606980324, + 0.09764403104782104, + 0.0, + 0.09048720449209213, + 0.08805796690285206, + 1.8839294910430908, + 1.1841591969132423, + 0.03451763093471527, + 0.7235676776617765, + 0.20236478932201862, + 0.12067175284028053, + 0.0, + 0.0, + 0.0, + 0.10482992604374886, + 0.0, + 0.0, + 0.0, + 0.0, + 0.21938421204686165, + 0.023877382278442383, + 0.9214257597923279, + 0.0, + 1.3753737676888704, + 0.0, + 0.09511831402778625, + 0.036345332860946655, + 0.1209675706923008, + 0.0, + 0.12397795543074608, + 0.08223393186926842, + 0.0572577528655529, + 0.15845691598951817, + 0.2018515281379223, + 0.0, + 0.11529191210865974, + 0.0, + 0.0, + 0.15173916518688202, + 0.0, + 0.0, + 0.038063038140535355, + 0.2657230831682682, + 0.03881736099720001, + 0.5001124069094658, + 0.0, + 0.03497616946697235, + 0.035203106701374054, + 0.0, + 0.11576487682759762, + 0.22676213085651398, + 0.06417533941566944, + 0.0, + 0.0, + 0.20899610221385956, + 0.06881045736372471, + 0.03890339285135269 + ], + "unique_experts": 43, + "load_cv": 1.46565621758588, + "normalized_load_entropy": 0.8172090882362595, + "max_load_share": 0.13194444444444445 + }, + "full_input": { + "tokens": 49, + "top_k": 6, + "decisions": 294, + "ordered_route_sha256": "b4e26b20d84df8ad6431150dfdc66a3031f92a7c7bbba7bdbaa628d27d32c408", + "route_weight_sha256": "1e8096735bed696f7300b0c3433530287ce4a7e9f86e269cca378e6ce13b9601", + "loads": [ + 1, + 5, + 6, + 1, + 6, + 2, + 5, + 2, + 4, + 0, + 11, + 2, + 22, + 16, + 4, + 9, + 6, + 8, + 0, + 3, + 0, + 10, + 0, + 1, + 0, + 1, + 14, + 6, + 7, + 0, + 18, + 1, + 2, + 1, + 4, + 10, + 3, + 2, + 1, + 4, + 4, + 0, + 9, + 0, + 0, + 3, + 0, + 0, + 16, + 5, + 1, + 12, + 11, + 2, + 5, + 3, + 5, + 3, + 4, + 2, + 1, + 5, + 4, + 1 + ], + "weighted_loads": [ + 0.031484466046094894, + 0.2092297300696373, + 0.28652670234441757, + 0.03359777852892876, + 0.23379522562026978, + 0.3448335900902748, + 0.3564967028796673, + 0.12113410606980324, + 0.2212292142212391, + 0.0, + 0.6377095803618431, + 0.08805796690285206, + 2.0247212648391724, + 1.4980136156082153, + 0.14601455070078373, + 0.8257146812975407, + 0.26043570786714554, + 0.3488645516335964, + 0.0, + 0.6090460661798716, + 0.0, + 0.5555124888196588, + 0.0, + 0.04428989812731743, + 0.0, + 0.03499699383974075, + 0.623254356905818, + 0.5610242448747158, + 1.0198990050703287, + 0.0, + 1.5933815333992243, + 0.06316425651311874, + 0.1179696824401617, + 0.036345332860946655, + 0.16662130132317543, + 0.6511308513581753, + 0.12397795543074608, + 0.08223393186926842, + 0.0572577528655529, + 0.15845691598951817, + 0.2411857694387436, + 0.0, + 0.5020506903529167, + 0.0, + 0.0, + 0.15173916518688202, + 0.0, + 0.0, + 0.8239548243582249, + 0.4478733204305172, + 0.03881736099720001, + 0.8192946650087833, + 0.8111383058130741, + 0.04798616748303175, + 0.1704380102455616, + 0.2784450054168701, + 0.20442047156393528, + 0.22676213085651398, + 0.13130224868655205, + 0.09841722249984741, + 0.022215312346816063, + 0.25388548895716667, + 0.1535158772021532, + 0.03890339285135269 + ], + "unique_experts": 53, + "load_cv": 1.059282192561633, + "normalized_load_entropy": 0.8755597689714116, + "max_load_share": 0.07482993197278912 + } + }, + "s1_x": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "c7af0deeb80312ca185781d20aa2b6d16795e6da3f4c4d94eab01ec07c9a14be", + "route_weight_sha256": "682b53e7055dce88e31d9fdc1396b984bc2e7508dc192b5ebcf4e389bf78817a", + "loads": [ + 1, + 3, + 3, + 1, + 0, + 2, + 2, + 2, + 2, + 0, + 2, + 2, + 17, + 10, + 1, + 6, + 6, + 2, + 0, + 1, + 0, + 3, + 1, + 1, + 0, + 1, + 4, + 1, + 4, + 0, + 15, + 0, + 1, + 1, + 2, + 0, + 4, + 2, + 1, + 5, + 3, + 0, + 1, + 0, + 0, + 3, + 0, + 0, + 1, + 3, + 1, + 5, + 0, + 1, + 3, + 0, + 3, + 3, + 1, + 0, + 0, + 4, + 2, + 1 + ], + "weighted_loads": [ + 0.035372842103242874, + 0.1153489500284195, + 0.1776745468378067, + 0.04696345701813698, + 0.0, + 0.2957364022731781, + 0.12152738869190216, + 0.10712135955691338, + 0.08501022681593895, + 0.0, + 0.08396755903959274, + 0.08493178896605968, + 1.701107231900096, + 1.075232908129692, + 0.030016863718628883, + 0.7117930762469769, + 0.2983170747756958, + 0.07626558840274811, + 0.0, + 0.03251856938004494, + 0.0, + 0.10768366418778896, + 0.03162899613380432, + 0.028334230184555054, + 0.0, + 0.030083755031228065, + 0.18806117400527, + 0.024764444679021835, + 0.8466486558318138, + 0.0, + 1.3366624154150486, + 0.0, + 0.0844673365354538, + 0.03756945580244064, + 0.0864560678601265, + 0.0, + 0.17648819088935852, + 0.09330972284078598, + 0.05433151125907898, + 0.18303443491458893, + 0.2256554365158081, + 0.0, + 0.07505664229393005, + 0.0, + 0.0, + 0.1302168369293213, + 0.0, + 0.0, + 0.06820400804281235, + 0.2465968932956457, + 0.040752775967121124, + 0.549726128578186, + 0.0, + 0.034263525158166885, + 0.11786751449108124, + 0.0, + 0.10830238088965416, + 0.20754355192184448, + 0.032563772052526474, + 0.0, + 0.0, + 0.21724487096071243, + 0.05876168794929981, + 0.03416513279080391 + ], + "unique_experts": 47, + "load_cv": 1.376612410373763, + "normalized_load_entropy": 0.8357949925305985, + "max_load_share": 0.11805555555555555 + }, + "full_input": { + "tokens": 65, + "top_k": 6, + "decisions": 390, + "ordered_route_sha256": "38b536e19472dffd11f2ec6fa3dee851757d9bccdc51d437d3fcf40d4dd53d76", + "route_weight_sha256": "de4d3bbd5663f945a20309f31125d0834482cfcee1456cca77f2883554c0d68b", + "loads": [ + 9, + 5, + 7, + 1, + 0, + 3, + 5, + 4, + 4, + 2, + 11, + 2, + 26, + 20, + 7, + 8, + 7, + 8, + 3, + 4, + 1, + 10, + 2, + 8, + 1, + 6, + 12, + 11, + 6, + 1, + 21, + 0, + 2, + 5, + 2, + 17, + 5, + 3, + 2, + 5, + 3, + 3, + 13, + 1, + 2, + 4, + 0, + 0, + 15, + 7, + 3, + 15, + 11, + 2, + 16, + 9, + 7, + 3, + 2, + 6, + 1, + 6, + 3, + 2 + ], + "weighted_loads": [ + 0.5472170878201723, + 0.20644887164235115, + 0.9705542344599962, + 0.04696345701813698, + 0.0, + 0.31095303408801556, + 0.23048772662878036, + 0.2154172658920288, + 0.18447775021195412, + 0.14641900174319744, + 0.5825095809996128, + 0.08493178896605968, + 2.101312519982457, + 1.595262611284852, + 0.2623965013772249, + 0.7907964326441288, + 0.31154865585267544, + 0.3462894558906555, + 0.08691967278718948, + 0.6333281211555004, + 0.04684650897979736, + 0.5672246823087335, + 0.06213056109845638, + 0.6181498616933823, + 0.03586822375655174, + 0.22858842834830284, + 0.47030521742999554, + 0.969240702688694, + 0.8775756768882275, + 0.04966295138001442, + 1.7129654474556446, + 0.0, + 0.10713635757565498, + 0.6355584189295769, + 0.0864560678601265, + 0.9592068493366241, + 0.2482484057545662, + 0.1333436705172062, + 0.11166725680232048, + 0.18303443491458893, + 0.2256554365158081, + 0.19685039669275284, + 0.683581842109561, + 0.04419117048382759, + 0.09829813987016678, + 0.18931449949741364, + 0.0, + 0.0, + 1.174312137067318, + 1.1989288050681353, + 0.12064598500728607, + 1.2700109295547009, + 0.7704449631273746, + 0.047273523174226284, + 0.8928064107894897, + 0.6257497817277908, + 0.2669888697564602, + 0.20754355192184448, + 0.05750763602554798, + 0.29213935136795044, + 0.02242094837129116, + 0.32708702236413956, + 0.09380834363400936, + 0.1224948801100254 + ], + "unique_experts": 60, + "load_cv": 0.9084742394735155, + "normalized_load_entropy": 0.9099693633896998, + "max_load_share": 0.06666666666666667 + } + }, + "s0_period": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "db3a9ffa1d2650dc8c7eb2c674e81eddd4b012fc5d0df734a20a80f5b3a40ab1", + "route_weight_sha256": "66168898eb337b1a6608977b8c00f81d4df0b86e295894db34fb01219c243048", + "loads": [ + 0, + 4, + 2, + 1, + 0, + 2, + 3, + 2, + 3, + 0, + 2, + 2, + 19, + 11, + 0, + 6, + 5, + 3, + 0, + 2, + 0, + 3, + 0, + 0, + 0, + 0, + 7, + 0, + 4, + 0, + 14, + 0, + 1, + 1, + 3, + 0, + 3, + 2, + 1, + 3, + 3, + 0, + 2, + 0, + 0, + 3, + 1, + 0, + 0, + 3, + 1, + 5, + 0, + 1, + 1, + 0, + 3, + 3, + 1, + 1, + 0, + 4, + 2, + 1 + ], + "weighted_loads": [ + 0.0, + 0.15229430422186852, + 0.14597563818097115, + 0.038758572190999985, + 0.0, + 0.32525352388620377, + 0.13672930747270584, + 0.11511829122900963, + 0.1204206831753254, + 0.0, + 0.09105811454355717, + 0.08643739856779575, + 1.9349645394831896, + 1.1332081742584705, + 0.0, + 0.7021813690662384, + 0.2605813555419445, + 0.1194898709654808, + 0.0, + 0.05485180392861366, + 0.0, + 0.10709863342344761, + 0.0, + 0.0, + 0.0, + 0.0, + 0.2928740903735161, + 0.0, + 0.9429183229804039, + 0.0, + 1.3139333464205265, + 0.0, + 0.10067755728960037, + 0.035415615886449814, + 0.11865305155515671, + 0.0, + 0.13325756043195724, + 0.07848415523767471, + 0.05221155285835266, + 0.10480214469134808, + 0.20659486204385757, + 0.0, + 0.11137249320745468, + 0.0, + 0.0, + 0.14950421825051308, + 0.04314650222659111, + 0.0, + 0.0, + 0.27180985920131207, + 0.04129648953676224, + 0.5149680376052856, + 0.0, + 0.03326020389795303, + 0.0362740159034729, + 0.0, + 0.1190864872187376, + 0.22596103325486183, + 0.029731377959251404, + 0.030690358951687813, + 0.0, + 0.20800503343343735, + 0.06957008689641953, + 0.04004112631082535 + ], + "unique_experts": 42, + "load_cv": 1.4614384931073228, + "normalized_load_entropy": 0.8136142017417624, + "max_load_share": 0.13194444444444445 + }, + "full_input": { + "tokens": 49, + "top_k": 6, + "decisions": 294, + "ordered_route_sha256": "1ba8c7e99a42af3173b4bbf2ac31409e3e89bff3d4a33ae8ecca2f31dded7785", + "route_weight_sha256": "9d88a9e6501b28069c967402e8193c889ea0dba22cd3ab0193d0978900d7b7f5", + "loads": [ + 0, + 5, + 5, + 1, + 6, + 2, + 5, + 2, + 5, + 0, + 9, + 2, + 23, + 17, + 3, + 10, + 7, + 7, + 0, + 5, + 0, + 11, + 0, + 1, + 0, + 1, + 16, + 5, + 7, + 0, + 16, + 2, + 2, + 1, + 4, + 10, + 3, + 2, + 1, + 3, + 4, + 0, + 8, + 0, + 0, + 4, + 1, + 0, + 13, + 5, + 1, + 13, + 10, + 2, + 5, + 4, + 4, + 3, + 2, + 5, + 1, + 5, + 4, + 1 + ], + "weighted_loads": [ + 0.0, + 0.21456989645957947, + 0.2594444118440151, + 0.038758572190999985, + 0.2340453378856182, + 0.32525352388620377, + 0.3734157159924507, + 0.11511829122900963, + 0.2453862801194191, + 0.0, + 0.5517692286521196, + 0.08643739856779575, + 2.1099618785083294, + 1.4969686269760132, + 0.12265484966337681, + 0.8508394230157137, + 0.31542773731052876, + 0.29955536499619484, + 0.0, + 0.6676166206598282, + 0.0, + 0.5930360397323966, + 0.0, + 0.04428989812731743, + 0.0, + 0.03499699383974075, + 0.6967442352324724, + 0.5539367757737637, + 1.034169552847743, + 0.0, + 1.5164908207952976, + 0.1092517264187336, + 0.12352892570197582, + 0.035415615886449814, + 0.16430678218603134, + 0.617320604622364, + 0.13325756043195724, + 0.07848415523767471, + 0.05221155285835266, + 0.10480214469134808, + 0.25161872431635857, + 0.0, + 0.47633253782987595, + 0.0, + 0.0, + 0.19163111224770546, + 0.04314650222659111, + 0.0, + 0.6937336586415768, + 0.526700658723712, + 0.04129648953676224, + 0.8931170366704464, + 0.6199528761208057, + 0.04627020191401243, + 0.17150891944766045, + 0.3649347350001335, + 0.16031774692237377, + 0.22596103325486183, + 0.054346973076462746, + 0.23949136398732662, + 0.022215312346816063, + 0.25344187021255493, + 0.1690625473856926, + 0.04004112631082535 + ], + "unique_experts": 53, + "load_cv": 1.0501559529746285, + "normalized_load_entropy": 0.8781986080694361, + "max_load_share": 0.0782312925170068 + } + }, + "s1_period": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "1877a2f881a493e63e3823a258b69bb7a6a4f1ddf5d213d985b0d8f0498c185f", + "route_weight_sha256": "fbfd7b8cd0d09765a2c77e08896999047a35134fa0cf1eae309b12c341a36af3", + "loads": [ + 1, + 3, + 3, + 1, + 1, + 2, + 2, + 2, + 1, + 0, + 2, + 2, + 18, + 10, + 0, + 5, + 7, + 3, + 0, + 1, + 1, + 3, + 1, + 2, + 0, + 0, + 6, + 0, + 4, + 0, + 14, + 0, + 1, + 1, + 2, + 0, + 5, + 2, + 1, + 3, + 3, + 0, + 2, + 0, + 0, + 3, + 1, + 0, + 1, + 3, + 1, + 5, + 1, + 1, + 1, + 0, + 2, + 3, + 1, + 0, + 0, + 4, + 1, + 1 + ], + "weighted_loads": [ + 0.03644074499607086, + 0.11350218206644058, + 0.18414153531193733, + 0.04912861809134483, + 0.04363654926419258, + 0.2967159226536751, + 0.10682565718889236, + 0.1054491363465786, + 0.025385169312357903, + 0.0, + 0.08940171077847481, + 0.08114391565322876, + 1.7713612485677004, + 1.0119769871234894, + 0.0, + 0.6816871613264084, + 0.344839908182621, + 0.11005361005663872, + 0.0, + 0.032765500247478485, + 0.032426442950963974, + 0.10338148288428783, + 0.033766839653253555, + 0.06456168554723263, + 0.0, + 0.0, + 0.26339786872267723, + 0.0, + 0.8692386522889137, + 0.0, + 1.2498509362339973, + 0.0, + 0.08793088048696518, + 0.03837320953607559, + 0.08347063139081001, + 0.0, + 0.21142080426216125, + 0.09813300892710686, + 0.05895712971687317, + 0.10277776792645454, + 0.23039240762591362, + 0.0, + 0.11745796725153923, + 0.0, + 0.0, + 0.12872905656695366, + 0.04177488759160042, + 0.0, + 0.03702245280146599, + 0.24258184246718884, + 0.03653889149427414, + 0.531170092523098, + 0.03093671426177025, + 0.032412171363830566, + 0.04048573598265648, + 0.0, + 0.09022833034396172, + 0.20895515382289886, + 0.032758086919784546, + 0.0, + 0.0, + 0.2157021351158619, + 0.03357325866818428, + 0.03351181745529175 + ], + "unique_experts": 48, + "load_cv": 1.3922182317935186, + "normalized_load_entropy": 0.835768671206643, + "max_load_share": 0.125 + }, + "full_input": { + "tokens": 65, + "top_k": 6, + "decisions": 390, + "ordered_route_sha256": "9adc2ab16806d415f938c38bf934f30756a601a42599e88b69eec852a63dd8d3", + "route_weight_sha256": "b6f2ce36365385f9643a70051c366d864e1babe3d8a9dcb0ddfdd3590dbb4a36", + "loads": [ + 9, + 5, + 7, + 1, + 2, + 3, + 6, + 3, + 3, + 2, + 10, + 2, + 25, + 21, + 6, + 7, + 9, + 9, + 4, + 3, + 2, + 12, + 2, + 9, + 1, + 2, + 14, + 10, + 6, + 1, + 20, + 0, + 2, + 5, + 2, + 18, + 6, + 3, + 2, + 3, + 3, + 2, + 14, + 1, + 1, + 4, + 1, + 0, + 14, + 7, + 3, + 16, + 11, + 2, + 15, + 10, + 6, + 3, + 3, + 7, + 1, + 5, + 2, + 2 + ], + "weighted_loads": [ + 0.5482849907130003, + 0.21864960715174675, + 0.9711193796247244, + 0.04912861809134483, + 0.08542143926024437, + 0.31193255446851254, + 0.2826540693640709, + 0.1855924315750599, + 0.12485269270837307, + 0.14641900174319744, + 0.5538632944226265, + 0.08114391565322876, + 2.1211377810686827, + 1.5827195178717375, + 0.26486485823988914, + 0.7606905177235603, + 0.3925050739198923, + 0.37946053221821785, + 0.13856175914406776, + 0.5977681875228882, + 0.07927295193076134, + 0.6472954014316201, + 0.06426840461790562, + 0.6694916132837534, + 0.03586822375655174, + 0.07173202373087406, + 0.5456419121474028, + 0.936348918825388, + 0.9001656733453274, + 0.04966295138001442, + 1.6125323064625263, + 0.0, + 0.11059990152716637, + 0.6363621726632118, + 0.08347063139081001, + 0.972828846424818, + 0.2831810191273689, + 0.13816695660352707, + 0.11629287526011467, + 0.10277776792645454, + 0.23039240762591362, + 0.12296096235513687, + 0.7529297079890966, + 0.04419117048382759, + 0.06589469313621521, + 0.187826719135046, + 0.04177488759160042, + 0.0, + 0.9920722618699074, + 1.2988921012729406, + 0.11643210053443909, + 1.3182312957942486, + 0.6087725162506104, + 0.045422169379889965, + 0.8556956592947245, + 0.6772115491330624, + 0.24891481921076775, + 0.20895515382289886, + 0.08703571371734142, + 0.34643537551164627, + 0.02242094837129116, + 0.278508085757494, + 0.06861991435289383, + 0.12184156477451324 + ], + "unique_experts": 62, + "load_cv": 0.9181492403816561, + "normalized_load_entropy": 0.9098859932303288, + "max_load_share": 0.0641025641025641 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 24, + "ordered_topk_exact_tokens": 17, + "set_exact_tokens": 21, + "mean_set_jaccard": 0.9642857142857143, + "mean_token_weighted_tv": 0.014859199019459387, + "aggregate_load_tv": 0.020833333333333332 + }, + "system_bos": { + "tokens": 24, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 18, + "mean_set_jaccard": 0.9196428571428571, + "mean_token_weighted_tv": 0.02290070429444313, + "aggregate_load_tv": 0.048611111111111105 + }, + "system_x": { + "tokens": 24, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.8779761904761906, + "mean_token_weighted_tv": 0.03753951832186431, + "aggregate_load_tv": 0.06944444444444445 + }, + "system_period": { + "tokens": 24, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 12, + "mean_set_jaccard": 0.8392857142857143, + "mean_token_weighted_tv": 0.04051621192290137, + "aggregate_load_tv": 0.09027777777777778 + }, + "bos_at_s0": { + "tokens": 24, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 18, + "mean_set_jaccard": 0.9196428571428572, + "mean_token_weighted_tv": 0.025753955744827788, + "aggregate_load_tv": 0.04166666666666667 + }, + "bos_at_s1": { + "tokens": 24, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.8898809523809524, + "mean_token_weighted_tv": 0.03184146189596504, + "aggregate_load_tv": 0.06249999999999999 + }, + "x_at_s0": { + "tokens": 24, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 12, + "mean_set_jaccard": 0.8571428571428571, + "mean_token_weighted_tv": 0.034258343977853656, + "aggregate_load_tv": 0.06249999999999999 + }, + "x_at_s1": { + "tokens": 24, + "ordered_topk_exact_tokens": 7, + "set_exact_tokens": 10, + "mean_set_jaccard": 0.8065476190476192, + "mean_token_weighted_tv": 0.04772761557251215, + "aggregate_load_tv": 0.09027777777777778 + }, + "period_at_s0": { + "tokens": 24, + "ordered_topk_exact_tokens": 7, + "set_exact_tokens": 12, + "mean_set_jaccard": 0.8571428571428571, + "mean_token_weighted_tv": 0.03484993940219283, + "aggregate_load_tv": 0.05555555555555556 + }, + "period_at_s1": { + "tokens": 24, + "ordered_topk_exact_tokens": 5, + "set_exact_tokens": 9, + "mean_set_jaccard": 0.7787698412698413, + "mean_token_weighted_tv": 0.05061588785611093, + "aggregate_load_tv": 0.11111111111111109 + } + } + }, + "layer_22": { + "layer": 22, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "0f1d17d85a797871db8ce6a003b2d5f0b3e9783572594b9a86b68a075358ffb0", + "route_weight_sha256": "85b3d376f287a103b55bf2f7c095c0de38b0314caa3530bc3df3639dd9e9d1c9", + "loads": [ + 8, + 2, + 0, + 1, + 0, + 3, + 0, + 2, + 21, + 0, + 0, + 0, + 0, + 1, + 3, + 3, + 1, + 1, + 2, + 2, + 0, + 0, + 2, + 1, + 2, + 0, + 0, + 3, + 2, + 7, + 1, + 5, + 5, + 4, + 1, + 19, + 0, + 5, + 1, + 0, + 0, + 0, + 1, + 2, + 2, + 5, + 0, + 0, + 0, + 4, + 3, + 1, + 0, + 0, + 2, + 1, + 2, + 4, + 3, + 0, + 2, + 3, + 0, + 1 + ], + "weighted_loads": [ + 0.4208719152957201, + 0.19278927519917488, + 0.0, + 0.03792448341846466, + 0.0, + 0.13157926686108112, + 0.0, + 0.08161110430955887, + 2.828549537807703, + 0.0, + 0.0, + 0.0, + 0.0, + 0.05629684776067734, + 0.17195966094732285, + 0.21164454892277718, + 0.023103373125195503, + 0.0684921070933342, + 0.164568729698658, + 0.06450539827346802, + 0.0, + 0.0, + 0.09451115876436234, + 0.030277719721198082, + 0.0909072756767273, + 0.0, + 0.0, + 0.1369776614010334, + 0.0971536636352539, + 0.5627932958304882, + 0.02412419207394123, + 0.35649600625038147, + 0.3583589941263199, + 0.15484940633177757, + 0.027925489470362663, + 2.2938954792916775, + 0.0, + 0.22214272990822792, + 0.0321601964533329, + 0.0, + 0.0, + 0.0, + 0.04315125569701195, + 0.10040027648210526, + 0.06827456876635551, + 0.7325704135000706, + 0.0, + 0.0, + 0.0, + 0.3156113363802433, + 0.12684248760342598, + 0.025491997599601746, + 0.0, + 0.0, + 0.09899547323584557, + 0.0402737595140934, + 0.06927288882434368, + 0.22886786237359047, + 0.1475411243736744, + 0.0, + 0.07242042198777199, + 0.15252406895160675, + 0.0, + 0.041255783289670944 + ], + "unique_experts": 42, + "load_cv": 1.6311020284336886, + "normalized_load_entropy": 0.7964648758178429, + "max_load_share": 0.14583333333333334 + }, + "full_input": { + "tokens": 49, + "top_k": 6, + "decisions": 294, + "ordered_route_sha256": "d23a2c3163e1b249d80f803aa788500d82021f494e36e53fb8bdc5b1c399cd7c", + "route_weight_sha256": "2358764a870d362fc421c5eeaa85830461f9f3be6df1700afe8be9f89d770666", + "loads": [ + 12, + 3, + 2, + 10, + 0, + 6, + 4, + 2, + 35, + 5, + 0, + 4, + 0, + 1, + 7, + 3, + 1, + 3, + 2, + 2, + 0, + 7, + 3, + 1, + 2, + 2, + 0, + 7, + 2, + 7, + 1, + 5, + 8, + 11, + 3, + 22, + 0, + 8, + 1, + 0, + 3, + 1, + 6, + 2, + 2, + 6, + 1, + 0, + 2, + 8, + 6, + 1, + 0, + 1, + 2, + 16, + 5, + 6, + 3, + 0, + 11, + 11, + 0, + 9 + ], + "weighted_loads": [ + 0.5948212370276451, + 0.241188682615757, + 0.0815793052315712, + 1.9094278290867805, + 0.0, + 0.2593099810183048, + 0.22324923891574144, + 0.08161110430955887, + 4.105436388403177, + 0.1968892551958561, + 0.0, + 0.14489472471177578, + 0.0, + 0.05629684776067734, + 0.5659361095167696, + 0.21164454892277718, + 0.023103373125195503, + 0.13908406160771847, + 0.164568729698658, + 0.06450539827346802, + 0.0, + 0.7086179405450821, + 0.12432836927473545, + 0.030277719721198082, + 0.0909072756767273, + 0.05959753692150116, + 0.0, + 0.31732634641230106, + 0.0971536636352539, + 0.5627932958304882, + 0.02412419207394123, + 0.35649600625038147, + 0.43519409745931625, + 0.4299169834703207, + 0.1238088421523571, + 2.521846603602171, + 0.0, + 0.33765836246311665, + 0.0321601964533329, + 0.0, + 0.14613431692123413, + 0.044038161635398865, + 0.3697270378470421, + 0.10040027648210526, + 0.06827456876635551, + 0.764353197067976, + 0.040375083684921265, + 0.0, + 0.09750540927052498, + 0.5862725377082825, + 0.28882207348942757, + 0.025491997599601746, + 0.0, + 0.04401104897260666, + 0.09899547323584557, + 1.2125911857001483, + 0.1882867943495512, + 0.29266329295933247, + 0.1475411243736744, + 0.0, + 1.4106668680906296, + 0.43630697950720787, + 0.0, + 0.4297312032431364 + ], + "unique_experts": 53, + "load_cv": 1.2450094742068902, + "normalized_load_entropy": 0.8593389580587049, + "max_load_share": 0.11904761904761904 + } + }, + "s1_eos": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "4beb3d745ea5b33550d5044829191dd9f7471bd987465dccb7a013ffb62417c2", + "route_weight_sha256": "f4ccfca3f007b1baf990362290ac041036972f7ee0bbdb051c412dfe540673a0", + "loads": [ + 7, + 1, + 0, + 1, + 0, + 4, + 0, + 2, + 21, + 0, + 0, + 0, + 0, + 1, + 3, + 3, + 1, + 1, + 2, + 2, + 0, + 0, + 2, + 1, + 3, + 0, + 0, + 3, + 2, + 7, + 1, + 5, + 5, + 5, + 0, + 19, + 0, + 4, + 1, + 0, + 1, + 0, + 1, + 2, + 3, + 5, + 0, + 0, + 0, + 4, + 4, + 2, + 0, + 0, + 2, + 0, + 2, + 4, + 2, + 0, + 0, + 4, + 0, + 1 + ], + "weighted_loads": [ + 0.4025540091097355, + 0.16226842999458313, + 0.0, + 0.04129263386130333, + 0.0, + 0.1725017912685871, + 0.0, + 0.08688100799918175, + 2.7956263162195683, + 0.0, + 0.0, + 0.0, + 0.0, + 0.05929214507341385, + 0.1734098643064499, + 0.2132437899708748, + 0.024614254012703896, + 0.06803319603204727, + 0.16315771639347076, + 0.0609437171369791, + 0.0, + 0.0, + 0.09607749804854393, + 0.03241845592856407, + 0.12639832496643066, + 0.0, + 0.0, + 0.1300240494310856, + 0.09437742456793785, + 0.5555227138102055, + 0.024834083393216133, + 0.35215383395552635, + 0.3607242777943611, + 0.18335234560072422, + 0.0, + 2.208145346492529, + 0.0, + 0.18008580058813095, + 0.03217393904924393, + 0.0, + 0.03541518375277519, + 0.0, + 0.04417085275053978, + 0.10896575823426247, + 0.10858121886849403, + 0.7084624394774437, + 0.0, + 0.0, + 0.0, + 0.30501965805888176, + 0.15521844290196896, + 0.056549523025751114, + 0.0, + 0.0, + 0.10262789577245712, + 0.0, + 0.06956442445516586, + 0.2379963919520378, + 0.10856565646827221, + 0.0, + 0.0, + 0.20172381028532982, + 0.0, + 0.03798013925552368 + ], + "unique_experts": 40, + "load_cv": 1.6367688736284705, + "normalized_load_entropy": 0.7893564158061803, + "max_load_share": 0.14583333333333334 + }, + "full_input": { + "tokens": 65, + "top_k": 6, + "decisions": 390, + "ordered_route_sha256": "3ddfc25ab31f47c29e6568074f75db608e97c0987641caa593edf7f103e73b82", + "route_weight_sha256": "70922a021263f829177dfc60cce3b0ed88f9df7e639039406d8627efa03f7709", + "loads": [ + 10, + 7, + 0, + 12, + 0, + 7, + 5, + 3, + 43, + 9, + 0, + 7, + 3, + 1, + 7, + 7, + 4, + 3, + 3, + 2, + 1, + 14, + 3, + 1, + 3, + 1, + 0, + 6, + 3, + 7, + 2, + 5, + 7, + 15, + 8, + 25, + 2, + 6, + 1, + 1, + 11, + 1, + 6, + 4, + 3, + 6, + 1, + 2, + 3, + 8, + 14, + 5, + 5, + 2, + 2, + 21, + 6, + 6, + 4, + 0, + 15, + 14, + 1, + 6 + ], + "weighted_loads": [ + 0.5530022084712982, + 0.6493643689900637, + 0.0, + 2.175073651596904, + 0.0, + 0.2836131025105715, + 0.281894919462502, + 0.12909257039427757, + 4.644103463739157, + 0.46780257299542427, + 0.0, + 0.42221109196543694, + 0.1402255818247795, + 0.05929214507341385, + 0.5722195971757174, + 0.4485829472541809, + 0.16810868866741657, + 0.11821847595274448, + 0.2033950686454773, + 0.0609437171369791, + 0.04985015094280243, + 1.2146831639111042, + 0.1385812871158123, + 0.03241845592856407, + 0.12639832496643066, + 0.02558961696922779, + 0.0, + 0.26380839943885803, + 0.17737700417637825, + 0.5555227138102055, + 0.07763714529573917, + 0.35215383395552635, + 0.4159850110299885, + 0.5648669395595789, + 0.3455126266926527, + 2.539578054100275, + 0.08995973318815231, + 0.25187940150499344, + 0.03217393904924393, + 0.041700296103954315, + 0.6640678513795137, + 0.025275612249970436, + 0.409797128289938, + 0.24463806673884392, + 0.10858121886849403, + 0.7458366714417934, + 0.036209240555763245, + 0.06992734409868717, + 0.13322492316365242, + 0.8763418458402157, + 0.638390064239502, + 0.2591082230210304, + 0.5519670248031616, + 0.09212230145931244, + 0.10262789577245712, + 1.7257272000424564, + 0.29374439269304276, + 0.3168525919318199, + 0.1558519140817225, + 0.0, + 2.1495636887848377, + 0.6117747034877539, + 0.028116004541516304, + 0.3402584195137024 + ], + "unique_experts": 59, + "load_cv": 1.1249253025095343, + "normalized_load_entropy": 0.8871348176448346, + "max_load_share": 0.11025641025641025 + } + }, + "s0_bos": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "f84fd99e87dde168711d3d633c78840b00b01f58d40d70982f148d732895bdb9", + "route_weight_sha256": "9e15b26d42d962d51ae7be1e82319ba7bc714f847244e13530d002d72ef6cdc5", + "loads": [ + 8, + 3, + 0, + 1, + 0, + 3, + 0, + 2, + 21, + 0, + 0, + 0, + 1, + 1, + 3, + 4, + 1, + 1, + 2, + 2, + 0, + 0, + 2, + 1, + 2, + 0, + 0, + 3, + 2, + 7, + 1, + 6, + 5, + 4, + 0, + 19, + 0, + 5, + 0, + 0, + 0, + 0, + 0, + 2, + 1, + 5, + 0, + 0, + 0, + 4, + 2, + 1, + 0, + 0, + 2, + 1, + 2, + 4, + 4, + 0, + 2, + 3, + 0, + 1 + ], + "weighted_loads": [ + 0.428815133869648, + 0.2550918832421303, + 0.0, + 0.03627484291791916, + 0.0, + 0.12023779936134815, + 0.0, + 0.09012914448976517, + 2.7694202698767185, + 0.0, + 0.0, + 0.0, + 0.024458179250359535, + 0.05773771554231644, + 0.1572570838034153, + 0.24357040971517563, + 0.023642759770154953, + 0.07982876896858215, + 0.16868802160024643, + 0.06597953662276268, + 0.0, + 0.0, + 0.09217460826039314, + 0.029444478452205658, + 0.09401317313313484, + 0.0, + 0.0, + 0.1279979571700096, + 0.10237409919500351, + 0.6021068170666695, + 0.024354711174964905, + 0.41209885478019714, + 0.3629932068288326, + 0.13579074293375015, + 0.0, + 2.299305245280266, + 0.0, + 0.22285936772823334, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.09752842038869858, + 0.035852983593940735, + 0.7054926492273808, + 0.0, + 0.0, + 0.0, + 0.3414621092379093, + 0.08436562679708004, + 0.027943776920437813, + 0.0, + 0.0, + 0.09078602865338326, + 0.040675003081560135, + 0.06991959549486637, + 0.2300615757703781, + 0.1964570451527834, + 0.0, + 0.07601716369390488, + 0.16705249436199665, + 0.0, + 0.0363834872841835 + ], + "unique_experts": 40, + "load_cv": 1.6499158227686108, + "normalized_load_entropy": 0.7867538115521447, + "max_load_share": 0.14583333333333334 + }, + "full_input": { + "tokens": 49, + "top_k": 6, + "decisions": 294, + "ordered_route_sha256": "583e7437509562f95bc3ec6a2b39391e411978ca3fe5549f6cf1a8b7bd9e8457", + "route_weight_sha256": "3da84ac78ee5f5d02ccc5ba6226e6821700e287100f5db409d692765496ac5a7", + "loads": [ + 12, + 4, + 2, + 9, + 0, + 5, + 3, + 3, + 34, + 5, + 1, + 3, + 1, + 1, + 4, + 5, + 1, + 2, + 2, + 2, + 0, + 7, + 3, + 1, + 3, + 2, + 0, + 8, + 2, + 8, + 1, + 6, + 7, + 12, + 1, + 24, + 0, + 7, + 0, + 0, + 4, + 1, + 6, + 2, + 1, + 6, + 1, + 0, + 3, + 8, + 4, + 1, + 0, + 1, + 2, + 14, + 5, + 8, + 4, + 0, + 12, + 11, + 0, + 9 + ], + "weighted_loads": [ + 0.602764455601573, + 0.3018979839980602, + 0.0815793052315712, + 1.017587587237358, + 0.0, + 0.18539723381400108, + 0.21203654631972313, + 1.0168375447392464, + 4.018172305077314, + 0.1968892551958561, + 0.016829241067171097, + 0.12134869396686554, + 0.024458179250359535, + 0.05773771554231644, + 0.4128693677484989, + 0.2869553565979004, + 0.023642759770154953, + 0.10554144345223904, + 0.16868802160024643, + 0.06597953662276268, + 0.0, + 0.6539923697710037, + 0.12199181877076626, + 0.029444478452205658, + 0.09775413852185011, + 0.05959753692150116, + 0.0, + 0.3423155602067709, + 0.10237409919500351, + 0.6485973484814167, + 0.024354711174964905, + 0.41209885478019714, + 0.4332274831831455, + 0.43375433050096035, + 0.06535837799310684, + 2.581485580652952, + 0.0, + 0.3323054313659668, + 0.0, + 0.0, + 0.18771430104970932, + 0.08117411285638809, + 0.25918746041134, + 0.09752842038869858, + 0.035852983593940735, + 0.7372754327952862, + 0.040375083684921265, + 0.0, + 0.2013624720275402, + 0.5541072590276599, + 0.20364545099437237, + 0.027943776920437813, + 0.0, + 0.04401104897260666, + 0.09078602865338326, + 1.168453911319375, + 0.1889335010200739, + 0.33277548663318157, + 0.1964570451527834, + 0.0, + 1.4294248521327972, + 0.45083540491759777, + 0.0, + 0.3646320980042219 + ], + "unique_experts": 54, + "load_cv": 1.2414360249876613, + "normalized_load_entropy": 0.8604110831686016, + "max_load_share": 0.11564625850340136 + } + }, + "s1_bos": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "7baa1913098a5cd440e59e100e7cc9a8a85d13fe6836eb3a23c9a3c3afb8b49e", + "route_weight_sha256": "6bcd8ff7b6718d911487cc2a92716a0bc19a07f248e42a72ade88d00bb61993e", + "loads": [ + 7, + 1, + 0, + 1, + 0, + 3, + 0, + 2, + 21, + 0, + 0, + 0, + 0, + 2, + 3, + 3, + 1, + 1, + 2, + 2, + 0, + 0, + 2, + 1, + 2, + 0, + 0, + 3, + 2, + 7, + 1, + 5, + 5, + 3, + 1, + 19, + 0, + 4, + 0, + 0, + 0, + 0, + 1, + 2, + 3, + 5, + 0, + 0, + 0, + 5, + 3, + 1, + 0, + 0, + 2, + 1, + 2, + 4, + 4, + 0, + 2, + 3, + 0, + 2 + ], + "weighted_loads": [ + 0.4148483704775572, + 0.16176483035087585, + 0.0, + 0.03803040832281113, + 0.0, + 0.11876317486166954, + 0.0, + 0.08246424421668053, + 2.709009449928999, + 0.0, + 0.0, + 0.0, + 0.0, + 0.08465458638966084, + 0.16231880709528923, + 0.19263850525021553, + 0.025047020986676216, + 0.07365076243877411, + 0.16804639250040054, + 0.06484902650117874, + 0.0, + 0.0, + 0.1047862321138382, + 0.03126244619488716, + 0.08872286602854729, + 0.0, + 0.0, + 0.11737410351634026, + 0.10207677632570267, + 0.5719135440886021, + 0.024607161059975624, + 0.3712601736187935, + 0.3607783317565918, + 0.11039828322827816, + 0.031249457970261574, + 2.2540313974022865, + 0.0, + 0.18197304010391235, + 0.0, + 0.0, + 0.0, + 0.0, + 0.042952924966812134, + 0.10074828937649727, + 0.10862014070153236, + 0.7370859868824482, + 0.0, + 0.0, + 0.0, + 0.3405533395707607, + 0.12190065160393715, + 0.026630887761712074, + 0.0, + 0.0, + 0.09862950444221497, + 0.03467392176389694, + 0.07015930488705635, + 0.23874714970588684, + 0.19924898073077202, + 0.0, + 0.07233807444572449, + 0.16107019409537315, + 0.0, + 0.06568428128957748 + ], + "unique_experts": 41, + "load_cv": 1.6235154662447175, + "normalized_load_entropy": 0.7959945379051498, + "max_load_share": 0.14583333333333334 + }, + "full_input": { + "tokens": 65, + "top_k": 6, + "decisions": 390, + "ordered_route_sha256": "33a136751a0548448e11698f2fc6a7068d73621df685698103818aba8a90685e", + "route_weight_sha256": "914c3e0aa3bd66ba59417d163616c5e61adf6095a31af3a810528536644b1120", + "loads": [ + 10, + 6, + 0, + 11, + 0, + 5, + 4, + 3, + 42, + 9, + 0, + 9, + 3, + 2, + 6, + 8, + 4, + 3, + 3, + 2, + 1, + 12, + 3, + 1, + 2, + 1, + 0, + 7, + 3, + 7, + 2, + 5, + 6, + 12, + 8, + 27, + 2, + 7, + 0, + 1, + 11, + 1, + 6, + 4, + 3, + 5, + 1, + 2, + 6, + 10, + 13, + 4, + 5, + 3, + 2, + 21, + 6, + 4, + 5, + 0, + 18, + 13, + 1, + 9 + ], + "weighted_loads": [ + 0.5652965698391199, + 0.6109129022806883, + 0.0, + 1.2766723278909922, + 0.0, + 0.17253576405346394, + 0.27193501964211464, + 0.12467580661177635, + 4.541674952954054, + 0.46780257299542427, + 0.0, + 0.5040606688708067, + 0.1402255818247795, + 0.08465458638966084, + 0.5480667967349291, + 0.4703606814146042, + 0.1685414556413889, + 0.12383604235947132, + 0.20828374475240707, + 0.06484902650117874, + 0.04985015094280243, + 1.0795588940382004, + 0.14729002118110657, + 0.03126244619488716, + 0.08872286602854729, + 0.02558961696922779, + 0.0, + 0.2956422492861748, + 0.18507635593414307, + 0.5719135440886021, + 0.06154611147940159, + 0.3712601736187935, + 0.4099896289408207, + 0.43813915364444256, + 0.342749435454607, + 2.670785278081894, + 0.08995973318815231, + 0.3103729970753193, + 0.0, + 0.041700296103954315, + 0.6682345550507307, + 0.025275612249970436, + 0.3814215697348118, + 0.23642059788107872, + 0.10862014070153236, + 0.7370859868824482, + 0.036209240555763245, + 0.06992734409868717, + 0.33504340052604675, + 0.9412660021334887, + 0.600184703245759, + 0.2291895877569914, + 0.5519670248031616, + 0.14151574671268463, + 0.09862950444221497, + 1.747491117566824, + 0.29433927312493324, + 0.23874714970588684, + 0.24151314422488213, + 0.0, + 2.304059561342001, + 0.5711210872977972, + 0.028116004541516304, + 0.48079535737633705 + ], + "unique_experts": 58, + "load_cv": 1.1226787726511411, + "normalized_load_entropy": 0.8864176244139154, + "max_load_share": 0.1076923076923077 + } + }, + "s0_x": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "68a5c92b060b9d44829d86a9958133326b5095c5f40d2af065000618850ad351", + "route_weight_sha256": "6db367423d4fb4355510cc34978c8774991a603d6613714755c8741e4290f8ce", + "loads": [ + 10, + 3, + 0, + 1, + 0, + 4, + 0, + 1, + 21, + 0, + 0, + 0, + 1, + 1, + 3, + 4, + 1, + 1, + 2, + 2, + 0, + 0, + 2, + 1, + 2, + 0, + 0, + 2, + 2, + 7, + 1, + 6, + 5, + 2, + 1, + 19, + 0, + 5, + 0, + 0, + 0, + 0, + 0, + 2, + 1, + 5, + 0, + 0, + 0, + 4, + 2, + 0, + 0, + 0, + 2, + 1, + 2, + 4, + 4, + 0, + 1, + 5, + 0, + 1 + ], + "weighted_loads": [ + 0.4953917320817709, + 0.24363693967461586, + 0.0, + 0.03593761473894119, + 0.0, + 0.14415420778095722, + 0.0, + 0.052450042217969894, + 2.7246003039181232, + 0.0, + 0.0, + 0.0, + 0.02466079592704773, + 0.05795084312558174, + 0.157272357493639, + 0.23440359346568584, + 0.024143127724528313, + 0.0681128054857254, + 0.1644650176167488, + 0.0715874433517456, + 0.0, + 0.0, + 0.09767241030931473, + 0.02810497395694256, + 0.09447566792368889, + 0.0, + 0.0, + 0.07950270175933838, + 0.10371794924139977, + 0.572977215051651, + 0.023362204432487488, + 0.42215676605701447, + 0.3757643736898899, + 0.08818526566028595, + 0.029924027621746063, + 2.295498002320528, + 0.0, + 0.21038297936320305, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.08901409059762955, + 0.03708590194582939, + 0.6926943175494671, + 0.0, + 0.0, + 0.0, + 0.30954359099268913, + 0.07897642254829407, + 0.0, + 0.0, + 0.0, + 0.09374142810702324, + 0.042710136622190475, + 0.07028783299028873, + 0.21407932043075562, + 0.18739811517298222, + 0.0, + 0.04138876125216484, + 0.26133863255381584, + 0.0, + 0.035689037293195724 + ], + "unique_experts": 40, + "load_cv": 1.6832508230603462, + "normalized_load_entropy": 0.7791562896576771, + "max_load_share": 0.14583333333333334 + }, + "full_input": { + "tokens": 49, + "top_k": 6, + "decisions": 294, + "ordered_route_sha256": "d4e5caf9993c3660d89537e85263d316c39955b5a5d2facc9645abe906a6b1f3", + "route_weight_sha256": "f2aa4817eaf1acbd574d052f8721337f82595b0151bf3e52df372e9663a60461", + "loads": [ + 14, + 4, + 2, + 10, + 0, + 6, + 4, + 1, + 35, + 6, + 0, + 3, + 1, + 1, + 5, + 4, + 1, + 3, + 2, + 2, + 0, + 9, + 3, + 1, + 2, + 2, + 0, + 5, + 2, + 7, + 2, + 6, + 7, + 11, + 2, + 23, + 0, + 6, + 0, + 0, + 4, + 1, + 5, + 2, + 1, + 6, + 1, + 0, + 2, + 7, + 6, + 0, + 0, + 1, + 2, + 16, + 5, + 6, + 4, + 0, + 10, + 14, + 0, + 9 + ], + "weighted_loads": [ + 0.6693410538136959, + 0.28804656118154526, + 0.0815793052315712, + 1.099829226732254, + 0.0, + 0.217201117426157, + 0.28207239881157875, + 0.052450042217969894, + 4.006269957870245, + 0.22788207791745663, + 0.0, + 0.15863947570323944, + 0.02466079592704773, + 0.05795084312558174, + 0.4857502616941929, + 0.23440359346568584, + 0.024143127724528313, + 0.12749325297772884, + 0.1644650176167488, + 0.0715874433517456, + 0.0, + 0.7238361574709415, + 0.12748962081968784, + 0.02810497395694256, + 0.09447566792368889, + 0.05959753692150116, + 0.0, + 0.21844140626490116, + 0.10371794924139977, + 0.572977215051651, + 0.0678449235856533, + 0.42215676605701447, + 0.4459986500442028, + 0.46007815562188625, + 0.0952824056148529, + 2.528877265751362, + 0.0, + 0.25251614674925804, + 0.0, + 0.0, + 0.18883800506591797, + 0.07747753709554672, + 0.3233022950589657, + 0.08901409059762955, + 0.03708590194582939, + 0.7244771011173725, + 0.040375083684921265, + 0.0, + 0.08250038512051105, + 0.6181594096124172, + 0.2851262800395489, + 0.0, + 0.0, + 0.04401104897260666, + 0.09374142810702324, + 1.3682971764355898, + 0.18930173851549625, + 0.27680925838649273, + 0.18739811517298222, + 0.0, + 1.317941538989544, + 0.6001352667808533, + 0.0, + 0.3289055060595274 + ], + "unique_experts": 52, + "load_cv": 1.27439860859787, + "normalized_load_entropy": 0.8530350558137404, + "max_load_share": 0.11904761904761904 + } + }, + "s1_x": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "a9fa872f75425aa9c265f1330e3517ae6979c63d64b469a277bb3f2662a5b918", + "route_weight_sha256": "d5b4c0b93954dddd959b2e3af618cb8a556ff21755bbd63aabad2b3bcc0bc7d9", + "loads": [ + 8, + 1, + 0, + 0, + 0, + 3, + 0, + 1, + 21, + 0, + 0, + 0, + 0, + 1, + 3, + 4, + 1, + 1, + 2, + 2, + 0, + 0, + 2, + 1, + 2, + 1, + 0, + 3, + 2, + 8, + 1, + 5, + 5, + 2, + 0, + 19, + 0, + 4, + 0, + 0, + 0, + 0, + 1, + 2, + 2, + 5, + 0, + 0, + 0, + 3, + 4, + 2, + 0, + 0, + 2, + 3, + 2, + 4, + 3, + 0, + 1, + 6, + 0, + 1 + ], + "weighted_loads": [ + 0.45649195834994316, + 0.16931161284446716, + 0.0, + 0.0, + 0.0, + 0.11249126307666302, + 0.0, + 0.046200212091207504, + 2.708818703889847, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0645439624786377, + 0.15736595913767815, + 0.2288323976099491, + 0.02460983581840992, + 0.06510228663682938, + 0.1668250635266304, + 0.06887666508555412, + 0.0, + 0.0, + 0.10689904168248177, + 0.03274468332529068, + 0.0949566699564457, + 0.02425864152610302, + 0.0, + 0.10864439979195595, + 0.0956244058907032, + 0.5809768922626972, + 0.023665625602006912, + 0.358701441437006, + 0.37229645624756813, + 0.059468960389494896, + 0.0, + 2.164961276575923, + 0.0, + 0.16028929501771927, + 0.0, + 0.0, + 0.0, + 0.0, + 0.03989532217383385, + 0.10574174672365189, + 0.07385805249214172, + 0.6761873103678226, + 0.0, + 0.0, + 0.0, + 0.27102644741535187, + 0.16703070886433125, + 0.057951584458351135, + 0.0, + 0.0, + 0.09167703613638878, + 0.1278344988822937, + 0.06799092888832092, + 0.223507110029459, + 0.17355676367878914, + 0.0, + 0.045270081609487534, + 0.33250635117292404, + 0.0, + 0.0314851775765419 + ], + "unique_experts": 40, + "load_cv": 1.657381543352922, + "normalized_load_entropy": 0.7854767246913109, + "max_load_share": 0.14583333333333334 + }, + "full_input": { + "tokens": 65, + "top_k": 6, + "decisions": 390, + "ordered_route_sha256": "0fe43c0a1b5533c5ac0537bb0636a46909bd9b4fd92db39c447c37e7f55c09d1", + "route_weight_sha256": "7b1c51df3f6ac43bbca0f0d79e12e1ca46589162c7a3c7dab4aee129f047abf0", + "loads": [ + 11, + 6, + 0, + 11, + 0, + 5, + 5, + 2, + 43, + 10, + 0, + 5, + 3, + 1, + 7, + 8, + 4, + 3, + 3, + 2, + 1, + 14, + 3, + 1, + 2, + 2, + 0, + 5, + 3, + 8, + 1, + 5, + 6, + 13, + 7, + 26, + 2, + 7, + 0, + 1, + 10, + 1, + 6, + 4, + 2, + 5, + 1, + 2, + 4, + 6, + 15, + 5, + 5, + 3, + 2, + 28, + 6, + 5, + 4, + 0, + 16, + 18, + 1, + 5 + ], + "weighted_loads": [ + 0.6069401577115059, + 0.6184596847742796, + 0.0, + 1.2869269009679556, + 0.0, + 0.17672497034072876, + 0.30997540801763535, + 0.08841177448630333, + 4.5525072067976, + 0.5144144482910633, + 0.0, + 0.34021024219691753, + 0.1402255818247795, + 0.0645439624786377, + 0.5245924312621355, + 0.46417155489325523, + 0.1681042704731226, + 0.11528756655752659, + 0.20706241577863693, + 0.06887666508555412, + 0.04985015094280243, + 1.1559017822146416, + 0.14940283074975014, + 0.03274468332529068, + 0.0949566699564457, + 0.04984825849533081, + 0.0, + 0.20888878032565117, + 0.1786239854991436, + 0.5809768922626972, + 0.023665625602006912, + 0.358701441437006, + 0.421507753431797, + 0.4645312372595072, + 0.31149997748434544, + 2.520398559048772, + 0.08995973318815231, + 0.28112611547112465, + 0.0, + 0.041700296103954315, + 0.6413171160966158, + 0.025275612249970436, + 0.4351574257016182, + 0.24141405522823334, + 0.07385805249214172, + 0.6761873103678226, + 0.036209240555763245, + 0.06992734409868717, + 0.16699173673987389, + 0.8145847171545029, + 0.7011461891233921, + 0.26051028445363045, + 0.5519670248031616, + 0.1258101612329483, + 0.09167703613638878, + 2.2820155303925276, + 0.2921708971261978, + 0.2631796970963478, + 0.21582092717289925, + 0.0, + 2.1483950093388557, + 0.9094764161854982, + 0.028116004541516304, + 0.2326548509299755 + ], + "unique_experts": 58, + "load_cv": 1.1974002081103223, + "normalized_load_entropy": 0.8751992553701647, + "max_load_share": 0.11025641025641025 + } + }, + "s0_period": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "9929813db11bc3fb55a270717ba0c9cc9d2dc32b8c5190b7493586e1c37c97c2", + "route_weight_sha256": "23acbbc7ff0b048c26e125d268cb8cc8d2d8b8302f8ff98bcb186cb62d28d8dc", + "loads": [ + 7, + 1, + 0, + 1, + 0, + 3, + 0, + 2, + 21, + 0, + 0, + 0, + 1, + 2, + 4, + 4, + 1, + 1, + 2, + 2, + 0, + 0, + 2, + 1, + 3, + 0, + 0, + 2, + 2, + 8, + 1, + 6, + 4, + 2, + 1, + 19, + 0, + 5, + 0, + 0, + 0, + 0, + 1, + 2, + 1, + 6, + 0, + 0, + 0, + 4, + 3, + 0, + 0, + 0, + 2, + 1, + 2, + 4, + 4, + 0, + 2, + 3, + 0, + 1 + ], + "weighted_loads": [ + 0.4009365141391754, + 0.15861786901950836, + 0.0, + 0.03646913915872574, + 0.0, + 0.09481137618422508, + 0.0, + 0.08928898349404335, + 2.7325493656098843, + 0.0, + 0.0, + 0.0, + 0.025452975183725357, + 0.08722847141325474, + 0.19110795110464096, + 0.23573746904730797, + 0.022953009232878685, + 0.06492287665605545, + 0.16859019547700882, + 0.068375363945961, + 0.0, + 0.0, + 0.09498542547225952, + 0.02811574935913086, + 0.12480534240603447, + 0.0, + 0.0, + 0.0818212702870369, + 0.10395638644695282, + 0.6114660836756229, + 0.021907689049839973, + 0.41369712725281715, + 0.35011520609259605, + 0.08226558938622475, + 0.02868504449725151, + 2.288875311613083, + 0.0, + 0.21308059990406036, + 0.0, + 0.0, + 0.0, + 0.0, + 0.04095282778143883, + 0.09411461278796196, + 0.03810276463627815, + 0.7431789897382259, + 0.0, + 0.0, + 0.0, + 0.2922135479748249, + 0.13983811810612679, + 0.0, + 0.0, + 0.0, + 0.09613068401813507, + 0.037656962871551514, + 0.07264429703354836, + 0.2287694662809372, + 0.1815618872642517, + 0.0, + 0.08564809337258339, + 0.16565814428031445, + 0.0, + 0.03636156767606735 + ], + "unique_experts": 41, + "load_cv": 1.6480441082434807, + "normalized_load_entropy": 0.7896061187821332, + "max_load_share": 0.14583333333333334 + }, + "full_input": { + "tokens": 49, + "top_k": 6, + "decisions": 294, + "ordered_route_sha256": "c5bf069d18dc375537d87dd8aa226ba15ca17ca20371b55686b73aa1f68c2ec3", + "route_weight_sha256": "c40ea4cf6644cd67c33c5dd0fcaf08a3be4361b883d5dc0a16a1aa01ee217498", + "loads": [ + 11, + 2, + 2, + 9, + 0, + 5, + 3, + 2, + 35, + 5, + 0, + 3, + 1, + 2, + 7, + 4, + 1, + 3, + 2, + 2, + 0, + 9, + 3, + 1, + 3, + 2, + 0, + 5, + 2, + 9, + 1, + 6, + 6, + 9, + 3, + 23, + 0, + 7, + 0, + 1, + 5, + 1, + 6, + 2, + 1, + 7, + 1, + 0, + 2, + 7, + 8, + 0, + 0, + 1, + 2, + 15, + 5, + 6, + 4, + 0, + 12, + 11, + 0, + 9 + ], + "weighted_loads": [ + 0.5748858358711004, + 0.2569677159190178, + 0.0815793052315712, + 1.0177818834781647, + 0.0, + 0.16080264560878277, + 0.21203654631972313, + 0.08928898349404335, + 4.01872181519866, + 0.1968892551958561, + 0.0, + 0.14299233630299568, + 0.025452975183725357, + 0.08722847141325474, + 0.5583089403808117, + 0.23573746904730797, + 0.022953009232878685, + 0.15289046801626682, + 0.16859019547700882, + 0.068375363945961, + 0.0, + 0.7553978338837624, + 0.12480263598263264, + 0.02811574935913086, + 0.12480534240603447, + 0.05959753692150116, + 0.0, + 0.21685215272009373, + 0.10395638644695282, + 0.6736457124352455, + 0.021907689049839973, + 0.41369712725281715, + 0.42034948244690895, + 0.3549213092774153, + 0.11838429793715477, + 2.532663255929947, + 0.0, + 0.3113986626267433, + 0.0, + 0.03733865171670914, + 0.249783705919981, + 0.09559796005487442, + 0.31945281475782394, + 0.09411461278796196, + 0.03810276463627815, + 0.7749617733061314, + 0.040375083684921265, + 0.0, + 0.09348532557487488, + 0.509797465056181, + 0.41741451248526573, + 0.0, + 0.0, + 0.04401104897260666, + 0.09613068401813507, + 1.258098617196083, + 0.19165820255875587, + 0.29234968312084675, + 0.1815618872642517, + 0.0, + 1.5331170856952667, + 0.44944105483591557, + 0.0, + 0.3431693874299526 + ], + "unique_experts": 53, + "load_cv": 1.243224033511676, + "normalized_load_entropy": 0.8602818843320377, + "max_load_share": 0.11904761904761904 + } + }, + "s1_period": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "2e4e231afaa8b7b69de14f9f70b69580071a8ec9d95aaee12b8765105b1b0c94", + "route_weight_sha256": "43be1428c6558a0c97b621114f18344e2dee615e576424b5d460e07cfba140f4", + "loads": [ + 8, + 2, + 0, + 1, + 0, + 3, + 0, + 2, + 20, + 0, + 0, + 0, + 0, + 2, + 3, + 4, + 1, + 2, + 2, + 2, + 0, + 0, + 2, + 1, + 2, + 1, + 0, + 2, + 2, + 8, + 1, + 5, + 5, + 1, + 0, + 18, + 0, + 4, + 0, + 0, + 0, + 0, + 2, + 2, + 2, + 5, + 0, + 0, + 0, + 5, + 3, + 2, + 0, + 0, + 2, + 2, + 2, + 4, + 3, + 0, + 1, + 4, + 0, + 1 + ], + "weighted_loads": [ + 0.4688409250229597, + 0.21381587535142899, + 0.0, + 0.03833629935979843, + 0.0, + 0.08011533133685589, + 0.0, + 0.08687708154320717, + 2.5096331983804703, + 0.0, + 0.0, + 0.0, + 0.0, + 0.09510843269526958, + 0.16904264315962791, + 0.23051922768354416, + 0.02529863640666008, + 0.10528610646724701, + 0.16727901250123978, + 0.07259485870599747, + 0.0, + 0.0, + 0.10626045241951942, + 0.0332120805978775, + 0.10097486153244972, + 0.024382488802075386, + 0.0, + 0.0788233932107687, + 0.0965939536690712, + 0.573256716132164, + 0.024316100403666496, + 0.3573894239962101, + 0.38306038454174995, + 0.03193842992186546, + 0.0, + 2.126183360815048, + 0.0, + 0.15764820203185081, + 0.0, + 0.0, + 0.0, + 0.0, + 0.06811145693063736, + 0.10730574280023575, + 0.07076127827167511, + 0.708472553640604, + 0.0, + 0.0, + 0.0, + 0.3307471666485071, + 0.13917692005634308, + 0.06642055325210094, + 0.0, + 0.0, + 0.09670417383313179, + 0.07492702826857567, + 0.07278817892074585, + 0.238430704921484, + 0.18044910207390785, + 0.0, + 0.03638020157814026, + 0.2259090691804886, + 0.0, + 0.03171500563621521 + ], + "unique_experts": 41, + "load_cv": 1.575271875417536, + "normalized_load_entropy": 0.8003632828444248, + "max_load_share": 0.1388888888888889 + }, + "full_input": { + "tokens": 65, + "top_k": 6, + "decisions": 390, + "ordered_route_sha256": "4bee3edbdb214fb86d057368996018b3664770186678e973d4e1b63109bce829", + "route_weight_sha256": "c9ff1b3015f024b4baccca61821f73c23d5a8f7fb33e2c48b19d0d1f207e575d", + "loads": [ + 11, + 8, + 0, + 11, + 0, + 5, + 4, + 3, + 41, + 9, + 0, + 5, + 3, + 2, + 7, + 8, + 4, + 4, + 3, + 2, + 1, + 15, + 3, + 1, + 2, + 2, + 0, + 4, + 3, + 8, + 2, + 5, + 6, + 12, + 7, + 25, + 2, + 5, + 0, + 3, + 12, + 1, + 7, + 4, + 2, + 5, + 1, + 2, + 4, + 8, + 15, + 5, + 5, + 3, + 2, + 26, + 6, + 4, + 4, + 0, + 17, + 15, + 1, + 5 + ], + "weighted_loads": [ + 0.6192891243845224, + 0.7171952668577433, + 0.0, + 1.2769782189279795, + 0.0, + 0.14442235976457596, + 0.27193501964211464, + 0.129088643938303, + 4.284163109958172, + 0.46780257299542427, + 0.0, + 0.36326916329562664, + 0.1402255818247795, + 0.09510843269526958, + 0.579998442903161, + 0.4658583849668503, + 0.16879307106137276, + 0.15547138638794422, + 0.2075163647532463, + 0.07259485870599747, + 0.04985015094280243, + 1.201262190937996, + 0.1487642414867878, + 0.0332120805978775, + 0.10097486153244972, + 0.04997210577130318, + 0.0, + 0.19050736539065838, + 0.1795935332775116, + 0.573256716132164, + 0.06675230525434017, + 0.3573894239962101, + 0.43227168172597885, + 0.4453793168067932, + 0.31149997748434544, + 2.46548730507493, + 0.08995973318815231, + 0.19862144067883492, + 0.0, + 0.14015913382172585, + 0.7216434609144926, + 0.025275612249970436, + 0.4426978603005409, + 0.2429780513048172, + 0.07076127827167511, + 0.708472553640604, + 0.036209240555763245, + 0.06992734409868717, + 0.17649544402956963, + 0.825946407392621, + 0.7473960388451815, + 0.26897925324738026, + 0.5519670248031616, + 0.15482420474290848, + 0.09670417383313179, + 2.109053213149309, + 0.29696814715862274, + 0.238430704921484, + 0.22271326556801796, + 0.0, + 2.2062046118080616, + 0.6795257274061441, + 0.028116004541516304, + 0.23664741590619087 + ], + "unique_experts": 58, + "load_cv": 1.1397890158522594, + "normalized_load_entropy": 0.8840953621070596, + "max_load_share": 0.10512820512820513 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 24, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.9047619047619048, + "mean_token_weighted_tv": 0.020045446736427646, + "aggregate_load_tv": 0.05555555555555555 + }, + "system_bos": { + "tokens": 24, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.8928571428571429, + "mean_token_weighted_tv": 0.023439044908930857, + "aggregate_load_tv": 0.05555555555555555 + }, + "system_x": { + "tokens": 24, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 11, + "mean_set_jaccard": 0.8363095238095241, + "mean_token_weighted_tv": 0.036322678866175316, + "aggregate_load_tv": 0.08333333333333334 + }, + "system_period": { + "tokens": 24, + "ordered_topk_exact_tokens": 8, + "set_exact_tokens": 13, + "mean_set_jaccard": 0.8511904761904762, + "mean_token_weighted_tv": 0.036956611865510546, + "aggregate_load_tv": 0.08333333333333331 + }, + "bos_at_s0": { + "tokens": 24, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 18, + "mean_set_jaccard": 0.9285714285714285, + "mean_token_weighted_tv": 0.022691591177135706, + "aggregate_load_tv": 0.03472222222222222 + }, + "bos_at_s1": { + "tokens": 24, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.8928571428571428, + "mean_token_weighted_tv": 0.027514015363218885, + "aggregate_load_tv": 0.0625 + }, + "x_at_s0": { + "tokens": 24, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.880952380952381, + "mean_token_weighted_tv": 0.02933918118166427, + "aggregate_load_tv": 0.06944444444444445 + }, + "x_at_s1": { + "tokens": 24, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 13, + "mean_set_jaccard": 0.8531746031746033, + "mean_token_weighted_tv": 0.03889827663078904, + "aggregate_load_tv": 0.0763888888888889 + }, + "period_at_s0": { + "tokens": 24, + "ordered_topk_exact_tokens": 7, + "set_exact_tokens": 12, + "mean_set_jaccard": 0.8571428571428571, + "mean_token_weighted_tv": 0.02997119651020815, + "aggregate_load_tv": 0.06249999999999999 + }, + "period_at_s1": { + "tokens": 24, + "ordered_topk_exact_tokens": 7, + "set_exact_tokens": 8, + "mean_set_jaccard": 0.8095238095238096, + "mean_token_weighted_tv": 0.04326689701216916, + "aggregate_load_tv": 0.09027777777777776 + } + } + }, + "layer_23": { + "layer": 23, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "b94d0d4add0e9bf00f6497e0602c859a6aa3f23ac950cea685728c21b76f45ab", + "route_weight_sha256": "cedb62ab5d61a922df981999f3db894d88a324037d449d7706e97a1e9598da00", + "loads": [ + 1, + 1, + 0, + 2, + 0, + 4, + 1, + 3, + 0, + 4, + 1, + 2, + 6, + 3, + 4, + 0, + 7, + 2, + 1, + 0, + 1, + 3, + 1, + 3, + 3, + 0, + 1, + 1, + 2, + 2, + 2, + 0, + 1, + 8, + 0, + 0, + 7, + 0, + 4, + 0, + 4, + 2, + 0, + 0, + 5, + 4, + 8, + 1, + 1, + 6, + 0, + 0, + 0, + 3, + 0, + 0, + 3, + 2, + 17, + 1, + 1, + 3, + 0, + 2 + ], + "weighted_loads": [ + 0.040989816188812256, + 0.054261188954114914, + 0.0, + 0.07652510702610016, + 0.0, + 0.31110673397779465, + 0.030098022893071175, + 0.17657511681318283, + 0.0, + 0.3526414930820465, + 0.043082330375909805, + 0.07491490989923477, + 0.21360841020941734, + 0.20997069776058197, + 0.16800126060843468, + 0.0, + 0.31567564234137535, + 0.09677588194608688, + 0.0452025830745697, + 0.0, + 0.03447895497083664, + 0.11282314546406269, + 0.02761532925069332, + 0.13878987357020378, + 0.18138517066836357, + 0.0, + 0.04349060729146004, + 0.03503643721342087, + 0.09911579638719559, + 0.14158093929290771, + 0.09903537854552269, + 0.0, + 0.04768417403101921, + 0.5521860104054213, + 0.0, + 0.0, + 0.6755692735314369, + 0.0, + 0.24127686768770218, + 0.0, + 0.17001692950725555, + 0.06046414375305176, + 0.0, + 0.0, + 0.20341592654585838, + 0.23446548357605934, + 0.37582260742783546, + 0.0369272381067276, + 0.04774995148181915, + 0.3894025906920433, + 0.0, + 0.0, + 0.0, + 0.1485000140964985, + 0.0, + 0.0, + 0.26572203263640404, + 0.06482440792024136, + 1.0762864276766777, + 0.03332337737083435, + 0.04539525881409645, + 0.12115580402314663, + 0.0, + 0.09030918590724468 + ], + "unique_experts": 45, + "load_cv": 1.2496913199113324, + "normalized_load_entropy": 0.8437628153903152, + "max_load_share": 0.11805555555555555 + }, + "full_input": { + "tokens": 49, + "top_k": 6, + "decisions": 294, + "ordered_route_sha256": "499e8d59d40f0091671ff08985fea290a2f3b85ca6852d8068a790d1181b9fc3", + "route_weight_sha256": "7ffe5d1b05978cd5bd7adcec89f0d7686a45e83d084dba76ee20e3adb74257da", + "loads": [ + 7, + 4, + 0, + 10, + 5, + 6, + 4, + 10, + 1, + 13, + 1, + 3, + 7, + 8, + 6, + 0, + 13, + 2, + 1, + 0, + 1, + 3, + 3, + 14, + 6, + 0, + 1, + 1, + 2, + 2, + 2, + 0, + 4, + 13, + 0, + 1, + 8, + 0, + 8, + 0, + 11, + 2, + 2, + 0, + 5, + 11, + 20, + 5, + 2, + 6, + 0, + 2, + 0, + 3, + 10, + 2, + 3, + 10, + 19, + 1, + 2, + 3, + 3, + 2 + ], + "weighted_loads": [ + 0.26815220597200096, + 0.22164884582161903, + 0.0, + 0.3082984013017267, + 0.19082928448915482, + 0.3651802819222212, + 0.1979850586503744, + 0.5146700385957956, + 0.0007526780245825648, + 0.6683348342776299, + 0.043082330375909805, + 0.12176505103707314, + 0.22382770664989948, + 0.41810235753655434, + 0.339076142758131, + 0.0, + 0.5452669076621532, + 0.09677588194608688, + 0.0452025830745697, + 0.0, + 0.03447895497083664, + 0.11282314546406269, + 0.13872374966740608, + 1.569829523563385, + 0.2832298818975687, + 0.0, + 0.04349060729146004, + 0.03503643721342087, + 0.09911579638719559, + 0.14158093929290771, + 0.09903537854552269, + 0.0, + 0.17366532050073147, + 0.9964072091970593, + 0.0, + 0.030968084931373596, + 0.7209616787731647, + 0.0, + 0.43207754846662283, + 0.0, + 0.5464909672737122, + 0.06046414375305176, + 0.051620516926050186, + 0.0, + 0.20341592654585838, + 2.2825911305844784, + 1.3893877230584621, + 0.16150766192004085, + 0.08595691248774529, + 0.3894025906920433, + 0.0, + 0.12884344160556793, + 0.0, + 0.1485000140964985, + 0.916759230196476, + 0.09924405440688133, + 0.26572203263640404, + 0.8135749325156212, + 1.1853003688156605, + 0.03332337737083435, + 0.08439014852046967, + 0.12115580402314663, + 0.11507523991167545, + 0.09030918590724468 + ], + "unique_experts": 53, + "load_cv": 1.0280664995391415, + "normalized_load_entropy": 0.8783982678811354, + "max_load_share": 0.06802721088435375 + } + }, + "s1_eos": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "83cebc4ab7ee0632a8336c261d55ee15a18acaff5157338f376c5d1640ab0bad", + "route_weight_sha256": "9c6f08848369c7fe5962f4921d07db330e15aece0146539e367123001ee2ca5a", + "loads": [ + 1, + 1, + 0, + 1, + 0, + 4, + 1, + 3, + 0, + 4, + 1, + 2, + 5, + 2, + 3, + 0, + 7, + 2, + 1, + 0, + 1, + 3, + 1, + 3, + 3, + 0, + 1, + 1, + 2, + 2, + 2, + 0, + 1, + 8, + 2, + 0, + 7, + 0, + 4, + 0, + 4, + 3, + 0, + 0, + 5, + 4, + 9, + 1, + 2, + 6, + 0, + 0, + 0, + 3, + 0, + 0, + 3, + 2, + 17, + 0, + 1, + 3, + 0, + 2 + ], + "weighted_loads": [ + 0.0347602479159832, + 0.054131411015987396, + 0.0, + 0.04396257549524307, + 0.0, + 0.317673996090889, + 0.029940227046608925, + 0.16545908153057098, + 0.0, + 0.3489246964454651, + 0.047135330736637115, + 0.07173740118741989, + 0.17826953530311584, + 0.17120884731411934, + 0.1261797584593296, + 0.0, + 0.2998925484716892, + 0.0931815542280674, + 0.04697200283408165, + 0.0, + 0.029413394629955292, + 0.12645236030220985, + 0.02906927652657032, + 0.13918523117899895, + 0.1674260012805462, + 0.0, + 0.04278063774108887, + 0.04284625127911568, + 0.09862888604402542, + 0.1450507789850235, + 0.09917113557457924, + 0.0, + 0.04813697934150696, + 0.5245528966188431, + 0.06776616722345352, + 0.0, + 0.5918668545782566, + 0.0, + 0.2543228939175606, + 0.0, + 0.16799775511026382, + 0.09687339700758457, + 0.0, + 0.0, + 0.20194105803966522, + 0.23104046657681465, + 0.4291365444660187, + 0.03614616021513939, + 0.08483830839395523, + 0.37085844203829765, + 0.0, + 0.0, + 0.0, + 0.1344763319939375, + 0.0, + 0.0, + 0.27530115470290184, + 0.06354141607880592, + 1.0641448758542538, + 0.0, + 0.04720760136842728, + 0.11966071650385857, + 0.0, + 0.08582199737429619 + ], + "unique_experts": 45, + "load_cv": 1.2521586299538494, + "normalized_load_entropy": 0.8444756880925675, + "max_load_share": 0.11805555555555555 + }, + "full_input": { + "tokens": 65, + "top_k": 6, + "decisions": 390, + "ordered_route_sha256": "a6cd9c28c04ff12bdf129c07171883a4960723b1ffde7d434e77fc1bba108007", + "route_weight_sha256": "95b4a69d27f6f42ab817d1e17429799db677c2a86ca1a752c6e9d531d9032e9c", + "loads": [ + 8, + 6, + 6, + 10, + 4, + 6, + 11, + 12, + 2, + 8, + 3, + 4, + 7, + 7, + 5, + 3, + 15, + 3, + 3, + 0, + 2, + 4, + 3, + 18, + 5, + 0, + 1, + 1, + 2, + 3, + 2, + 0, + 3, + 20, + 2, + 0, + 13, + 1, + 11, + 1, + 12, + 3, + 2, + 1, + 7, + 12, + 26, + 6, + 8, + 9, + 0, + 11, + 6, + 4, + 10, + 0, + 3, + 17, + 20, + 0, + 4, + 4, + 6, + 4 + ], + "weighted_loads": [ + 0.3858828702941537, + 0.37822598963975906, + 0.31841711327433586, + 0.534798467066139, + 0.143933841958642, + 0.36099463514983654, + 0.5640585217624903, + 0.5139186885207891, + 0.03446717112092301, + 0.5049606990069151, + 0.13990337029099464, + 0.14153325371444225, + 0.23342229891568422, + 0.3827990125864744, + 0.3068988211452961, + 0.12068681418895721, + 0.5781450029462576, + 0.15516304597258568, + 0.1369352750480175, + 0.0, + 0.0774911418557167, + 0.163066565990448, + 0.1448980886489153, + 2.1344779953360558, + 0.24702967330813408, + 0.0, + 0.04278063774108887, + 0.04284625127911568, + 0.09862888604402542, + 0.1905948407948017, + 0.09917113557457924, + 0.0, + 0.1273096166551113, + 1.3200639580609277, + 0.06776616722345352, + 0.0, + 1.0226295311003923, + 0.04795137792825699, + 0.6816128883510828, + 0.02381807379424572, + 0.5658424906432629, + 0.09687339700758457, + 0.052790381014347076, + 0.04829365015029907, + 0.30370668694376945, + 2.3379800375550985, + 2.090232763439417, + 0.32960965880192816, + 0.34779621846973896, + 0.5218905918300152, + 0.0, + 0.6477689500898123, + 0.6476897858083248, + 0.16554135456681252, + 0.9553952515125275, + 0.0, + 0.27530115470290184, + 1.4279491696506739, + 1.2319818623363972, + 0.0, + 0.1586898323148489, + 0.24591810628771782, + 0.23174017295241356, + 0.1620316095650196 + ], + "unique_experts": 57, + "load_cv": 0.9195230733623596, + "normalized_load_entropy": 0.9035476581575939, + "max_load_share": 0.06666666666666667 + } + }, + "s0_bos": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "cc1233bc8228b42d3179cc461ca6722be97739431da9ed9442d463bad60791e3", + "route_weight_sha256": "71a5b1327b378b12428e49aa2e5b46a7ffe95eb62c908724b38470d62097d9fd", + "loads": [ + 1, + 1, + 0, + 3, + 0, + 4, + 1, + 3, + 0, + 4, + 2, + 1, + 6, + 5, + 3, + 0, + 8, + 2, + 1, + 0, + 1, + 3, + 1, + 3, + 3, + 0, + 1, + 1, + 2, + 2, + 1, + 0, + 1, + 9, + 0, + 0, + 7, + 0, + 4, + 0, + 4, + 0, + 0, + 0, + 5, + 3, + 8, + 1, + 1, + 6, + 0, + 0, + 0, + 3, + 0, + 0, + 3, + 3, + 17, + 1, + 1, + 3, + 0, + 1 + ], + "weighted_loads": [ + 0.03804081678390503, + 0.05070124939084053, + 0.0, + 0.10795901343226433, + 0.0, + 0.3229120671749115, + 0.03154422342777252, + 0.189188364893198, + 0.0, + 0.3448311686515808, + 0.0731547623872757, + 0.03770669549703598, + 0.21604505367577076, + 0.29569167643785477, + 0.13050076737999916, + 0.0, + 0.34460706636309624, + 0.09347106516361237, + 0.04417871683835983, + 0.0, + 0.033077917993068695, + 0.12045412510633469, + 0.02717130072414875, + 0.13893737271428108, + 0.18454847112298012, + 0.0, + 0.04574788361787796, + 0.03445368632674217, + 0.09967724978923798, + 0.1306617707014084, + 0.06431404501199722, + 0.0, + 0.0426800362765789, + 0.600639259442687, + 0.0, + 0.0, + 0.6883727982640266, + 0.0, + 0.25022224336862564, + 0.0, + 0.16525257378816605, + 0.0, + 0.0, + 0.0, + 0.2150508537888527, + 0.19945164024829865, + 0.37972185015678406, + 0.0389549620449543, + 0.04395301640033722, + 0.401546947658062, + 0.0, + 0.0, + 0.0, + 0.1476324237883091, + 0.0, + 0.0, + 0.27463318407535553, + 0.09692670404911041, + 1.0350546576082706, + 0.03133876994252205, + 0.046130839735269547, + 0.12357068806886673, + 0.0, + 0.06582693010568619 + ], + "unique_experts": 44, + "load_cv": 1.2909944487358056, + "normalized_load_entropy": 0.8336330196269994, + "max_load_share": 0.11805555555555555 + }, + "full_input": { + "tokens": 49, + "top_k": 6, + "decisions": 294, + "ordered_route_sha256": "dfd4552ce4ca514b3ee0e3de067893a76c0ee2c0266768a78e8c09503a5f349b", + "route_weight_sha256": "3354cd9ade8ce8babeef86892aeaf88cf6f6a7a36c4acc145ef00ef71b9f0456", + "loads": [ + 4, + 4, + 0, + 10, + 6, + 6, + 4, + 10, + 1, + 12, + 2, + 1, + 8, + 10, + 5, + 1, + 14, + 2, + 1, + 1, + 1, + 4, + 4, + 15, + 6, + 0, + 2, + 1, + 2, + 2, + 1, + 0, + 2, + 12, + 0, + 1, + 7, + 0, + 7, + 0, + 11, + 0, + 2, + 1, + 5, + 9, + 21, + 4, + 2, + 6, + 1, + 1, + 0, + 3, + 10, + 3, + 3, + 12, + 20, + 2, + 1, + 3, + 3, + 2 + ], + "weighted_loads": [ + 0.1632939651608467, + 0.21808890625834465, + 0.0, + 0.33616801211610436, + 0.25887494906783104, + 0.37698561511933804, + 0.19943125918507576, + 0.48339574970304966, + 0.03026425838470459, + 0.6167658716440201, + 0.0731547623872757, + 0.03770669549703598, + 0.2580842822790146, + 0.5038233362138271, + 0.3123303912580013, + 0.04057988151907921, + 0.5675836019217968, + 0.09347106516361237, + 0.04417871683835983, + 0.16476833820343018, + 0.033077917993068695, + 0.15670324862003326, + 0.1710931956768036, + 1.648950945585966, + 0.28639318235218525, + 0.0, + 0.15641530603170395, + 0.03445368632674217, + 0.09967724978923798, + 0.1306617707014084, + 0.06431404501199722, + 0.0, + 0.09504218772053719, + 0.9781252052634954, + 0.0, + 0.030968084931373596, + 0.6883727982640266, + 0.0, + 0.4091182677075267, + 0.0, + 0.5403894148766994, + 0.0, + 0.051620516926050186, + 0.03419233858585358, + 0.2150508537888527, + 1.2645263485610485, + 1.4250882379710674, + 0.15163978468626738, + 0.08215997740626335, + 0.401546947658062, + 0.07572494447231293, + 0.09169112145900726, + 0.0, + 0.1476324237883091, + 0.916759230196476, + 0.1423359252512455, + 0.27463318407535553, + 0.8735808730125427, + 1.1960176639258862, + 0.2951119430363178, + 0.046130839735269547, + 0.12357068806886673, + 0.12366456724703312, + 0.11030413210391998 + ], + "unique_experts": 56, + "load_cv": 1.0522690335327398, + "normalized_load_entropy": 0.8794021993977343, + "max_load_share": 0.07142857142857142 + } + }, + "s1_bos": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "0ecfa8a0f70d1bfd206df91154073dff5e74d55974f8fe0d53b1ad9390d0f15e", + "route_weight_sha256": "d21f286282e1995d092e0a106481b35239bb8ddb7b74673602ad47592e15016f", + "loads": [ + 1, + 1, + 0, + 1, + 0, + 4, + 1, + 3, + 0, + 4, + 1, + 1, + 7, + 3, + 3, + 0, + 8, + 1, + 1, + 0, + 0, + 4, + 1, + 3, + 3, + 0, + 1, + 1, + 1, + 2, + 2, + 0, + 1, + 9, + 1, + 0, + 8, + 0, + 4, + 0, + 4, + 0, + 0, + 0, + 5, + 3, + 8, + 2, + 2, + 6, + 0, + 0, + 0, + 3, + 0, + 0, + 5, + 2, + 17, + 1, + 1, + 3, + 0, + 1 + ], + "weighted_loads": [ + 0.03133467957377434, + 0.05151690915226936, + 0.0, + 0.04121733084321022, + 0.0, + 0.3264002278447151, + 0.03206875920295715, + 0.17147237062454224, + 0.0, + 0.3395569957792759, + 0.04580352455377579, + 0.0322880782186985, + 0.257231954485178, + 0.19284654408693314, + 0.1313493698835373, + 0.0, + 0.33373334258794785, + 0.058453723788261414, + 0.0461527481675148, + 0.0, + 0.0, + 0.16094795241951942, + 0.028750384226441383, + 0.13520410284399986, + 0.18536308407783508, + 0.0, + 0.04496457055211067, + 0.04257672652602196, + 0.062410224229097366, + 0.13087086752057076, + 0.0981876589357853, + 0.0, + 0.04520225152373314, + 0.5564697179943323, + 0.030362626537680626, + 0.0, + 0.677679780870676, + 0.0, + 0.26312579214572906, + 0.0, + 0.1620004028081894, + 0.0, + 0.0, + 0.0, + 0.20686160773038864, + 0.1895022764801979, + 0.3840612582862377, + 0.07011028565466404, + 0.08426545187830925, + 0.37973786890506744, + 0.0, + 0.0, + 0.0, + 0.13194887712597847, + 0.0, + 0.0, + 0.3446878772228956, + 0.0647285133600235, + 1.0601585768163204, + 0.03147011622786522, + 0.0476636104285717, + 0.11597355268895626, + 0.0, + 0.06498531252145767 + ], + "unique_experts": 44, + "load_cv": 1.3170299545699664, + "normalized_load_entropy": 0.8287423223015566, + "max_load_share": 0.11805555555555555 + }, + "full_input": { + "tokens": 65, + "top_k": 6, + "decisions": 390, + "ordered_route_sha256": "bbffe3e20a4eac25871dab3d63bef880ced485c5ad3c075da14c8384d701d5d1", + "route_weight_sha256": "c8208c1ac19509570c41e6c175244e88f4e33571ad64d54b255982eff35298dc", + "loads": [ + 6, + 6, + 6, + 9, + 5, + 6, + 11, + 12, + 2, + 8, + 3, + 3, + 9, + 8, + 5, + 3, + 16, + 2, + 3, + 0, + 1, + 5, + 4, + 19, + 5, + 0, + 1, + 1, + 1, + 3, + 3, + 0, + 2, + 19, + 1, + 0, + 14, + 2, + 10, + 1, + 15, + 0, + 2, + 0, + 7, + 9, + 25, + 6, + 8, + 9, + 0, + 10, + 6, + 6, + 10, + 2, + 5, + 18, + 20, + 1, + 3, + 4, + 6, + 3 + ], + "weighted_loads": [ + 0.3565093968063593, + 0.37561148777604103, + 0.31841711327433586, + 0.5285270833410323, + 0.20111474953591824, + 0.3697208669036627, + 0.5629998333752155, + 0.5373931098729372, + 0.062265755608677864, + 0.49879531003534794, + 0.13857156410813332, + 0.11374579928815365, + 0.32431686762720346, + 0.4044367093592882, + 0.2983498126268387, + 0.12068681418895721, + 0.6027736626565456, + 0.1204352155327797, + 0.13611602038145065, + 0.0, + 0.048077747225761414, + 0.1968858204782009, + 0.1768799889832735, + 2.1733242236077785, + 0.264966756105423, + 0.0, + 0.04496457055211067, + 0.04257672652602196, + 0.062410224229097366, + 0.17641492933034897, + 0.1532340571284294, + 0.0, + 0.08963600173592567, + 1.3676527999341488, + 0.030362626537680626, + 0.0, + 1.1084424573928118, + 0.09673364087939262, + 0.6393030565232038, + 0.02381807379424572, + 0.691237349063158, + 0.0, + 0.052790381014347076, + 0.0, + 0.3086272366344929, + 1.2708446849137545, + 2.0492835603654385, + 0.33140613604336977, + 0.347223361954093, + 0.530770018696785, + 0.0, + 0.6175263747572899, + 0.6476897858083248, + 0.2742529194802046, + 0.9553952515125275, + 0.11347857490181923, + 0.3446878772228956, + 1.43470299243927, + 1.2375383749604225, + 0.03147011622786522, + 0.12103964574635029, + 0.2422309424728155, + 0.23174017295241356, + 0.15686402469873428 + ], + "unique_experts": 57, + "load_cv": 0.9286300203317827, + "normalized_load_entropy": 0.9005436772434879, + "max_load_share": 0.0641025641025641 + } + }, + "s0_x": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "7e5bbf8c583283fddbb4c727df03740dd1987a0758c30b4d741ec8eacf1e267f", + "route_weight_sha256": "328fcac47a6e94f96412331bfc66ffe1585dbf01bb19855af32a5514c06e505d", + "loads": [ + 1, + 2, + 0, + 5, + 0, + 4, + 0, + 3, + 0, + 4, + 1, + 2, + 4, + 5, + 2, + 0, + 7, + 1, + 1, + 0, + 0, + 2, + 1, + 3, + 3, + 0, + 1, + 1, + 2, + 2, + 1, + 0, + 1, + 8, + 1, + 0, + 9, + 0, + 4, + 0, + 4, + 0, + 1, + 0, + 5, + 3, + 10, + 1, + 1, + 6, + 0, + 0, + 0, + 4, + 1, + 1, + 3, + 2, + 17, + 0, + 1, + 2, + 0, + 1 + ], + "weighted_loads": [ + 0.03772510588169098, + 0.07731981575489044, + 0.0, + 0.16727408580482006, + 0.0, + 0.3235512003302574, + 0.0, + 0.18131960928440094, + 0.0, + 0.34353479743003845, + 0.050325483083724976, + 0.07736308127641678, + 0.15616005286574364, + 0.29176539555191994, + 0.0821877159178257, + 0.0, + 0.299170795828104, + 0.06290672719478607, + 0.04656956344842911, + 0.0, + 0.0, + 0.08575929701328278, + 0.026969093829393387, + 0.1408156305551529, + 0.18291736766695976, + 0.0, + 0.04590783640742302, + 0.03884775936603546, + 0.10333723202347755, + 0.14143629372119904, + 0.06435330957174301, + 0.0, + 0.04325898364186287, + 0.5639597028493881, + 0.030319858342409134, + 0.0, + 0.7422137819230556, + 0.0, + 0.24539045989513397, + 0.0, + 0.16635530814528465, + 0.0, + 0.035194046795368195, + 0.0, + 0.20580418407917023, + 0.18958904594182968, + 0.4655764754861593, + 0.03517862409353256, + 0.049102071672677994, + 0.39261310920119286, + 0.0, + 0.0, + 0.0, + 0.1741728875786066, + 0.03769964724779129, + 0.03069266490638256, + 0.27428101748228073, + 0.06434139795601368, + 1.099034782499075, + 0.0, + 0.04058827832341194, + 0.09273070842027664, + 0.0, + 0.04946819692850113 + ], + "unique_experts": 45, + "load_cv": 1.314684396244359, + "normalized_load_entropy": 0.8327188744811631, + "max_load_share": 0.11805555555555555 + }, + "full_input": { + "tokens": 49, + "top_k": 6, + "decisions": 294, + "ordered_route_sha256": "00a4719b1271ccff88ce4a99d7db6d54ff632c9afceceae6be8846dd84ad0b1b", + "route_weight_sha256": "d75349c0b41a0df7f580d5f1a6a0e2218165e7b304ecd1d7920723873fd5b5a4", + "loads": [ + 5, + 5, + 0, + 14, + 4, + 6, + 4, + 10, + 0, + 11, + 1, + 3, + 6, + 10, + 6, + 1, + 13, + 1, + 1, + 0, + 0, + 2, + 3, + 15, + 6, + 0, + 1, + 1, + 2, + 2, + 1, + 0, + 3, + 12, + 1, + 1, + 10, + 0, + 8, + 0, + 11, + 0, + 3, + 0, + 5, + 10, + 24, + 4, + 2, + 6, + 0, + 1, + 0, + 4, + 12, + 3, + 3, + 10, + 19, + 0, + 1, + 2, + 4, + 1 + ], + "weighted_loads": [ + 0.2321292608976364, + 0.24470747262239456, + 0.0, + 0.534717031288892, + 0.15768390521407127, + 0.37762474827468395, + 0.2202727608382702, + 0.5081936363130808, + 0.0, + 0.5709580965340137, + 0.050325483083724976, + 0.12333367764949799, + 0.22263832204043865, + 0.4998970553278923, + 0.2852451130747795, + 0.04051312059164047, + 0.4941918756812811, + 0.06290672719478607, + 0.04656956344842911, + 0.0, + 0.0, + 0.08575929701328278, + 0.17215568758547306, + 1.6191382966935635, + 0.2847620788961649, + 0.0, + 0.04590783640742302, + 0.03884775936603546, + 0.10333723202347755, + 0.14143629372119904, + 0.06435330957174301, + 0.0, + 0.12110638432204723, + 1.0361657440662384, + 0.030319858342409134, + 0.030968084931373596, + 0.7801477052271366, + 0.0, + 0.47097624372690916, + 0.0, + 0.4662478994578123, + 0.0, + 0.08681456372141838, + 0.0, + 0.20580418407917023, + 1.2907188273966312, + 1.6567012090235949, + 0.13359879236668348, + 0.08730903267860413, + 0.39261310920119286, + 0.0, + 0.09169112145900726, + 0.0, + 0.1741728875786066, + 1.0897251814603806, + 0.11579232849180698, + 0.27428101748228073, + 0.8588662389665842, + 1.1870197728276253, + 0.0, + 0.04058827832341194, + 0.09273070842027664, + 0.13800327479839325, + 0.04946819692850113 + ], + "unique_experts": 51, + "load_cv": 1.1191044792534852, + "normalized_load_entropy": 0.8598592860548552, + "max_load_share": 0.08163265306122448 + } + }, + "s1_x": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "f45d0f538e0eb9c97098dc8d91e9943f55c0dcd6c0e68b0f8874dc146ad44ea2", + "route_weight_sha256": "aec83e16eeeb13bc64655c76201e010682b43f0bf2d929d05eb2ba2cad452eb4", + "loads": [ + 0, + 2, + 0, + 3, + 0, + 4, + 1, + 3, + 0, + 4, + 1, + 2, + 7, + 3, + 3, + 0, + 6, + 2, + 1, + 0, + 0, + 3, + 1, + 3, + 3, + 0, + 1, + 1, + 1, + 2, + 2, + 0, + 1, + 8, + 1, + 0, + 7, + 0, + 4, + 0, + 4, + 1, + 1, + 0, + 5, + 3, + 10, + 2, + 2, + 6, + 0, + 0, + 0, + 3, + 0, + 0, + 4, + 1, + 18, + 0, + 1, + 2, + 0, + 1 + ], + "weighted_loads": [ + 0.0, + 0.07903353869915009, + 0.0, + 0.10645912028849125, + 0.0, + 0.369119580835104, + 0.03144663944840431, + 0.15440401434898376, + 0.0, + 0.343230739235878, + 0.03590299189090729, + 0.09050087258219719, + 0.2615390196442604, + 0.22848007082939148, + 0.12274259701371193, + 0.0, + 0.24740871414542198, + 0.09561599418520927, + 0.04486731439828873, + 0.0, + 0.0, + 0.12411953508853912, + 0.03027445264160633, + 0.16401899233460426, + 0.1807570643723011, + 0.0, + 0.04659121483564377, + 0.04108600690960884, + 0.0634520947933197, + 0.12938445061445236, + 0.0942898616194725, + 0.0, + 0.046387217938899994, + 0.5505734160542488, + 0.028362276032567024, + 0.0, + 0.6082503031939268, + 0.0, + 0.242308359593153, + 0.0, + 0.15525993332266808, + 0.028699200600385666, + 0.033601533621549606, + 0.0, + 0.2038150690495968, + 0.18479815497994423, + 0.5091498047113419, + 0.07611548155546188, + 0.0884883850812912, + 0.39183641225099564, + 0.0, + 0.0, + 0.0, + 0.12738622538745403, + 0.0, + 0.0, + 0.3207880463451147, + 0.029114210978150368, + 1.161540262401104, + 0.0, + 0.041143640875816345, + 0.08430931717157364, + 0.0, + 0.03938858583569527 + ], + "unique_experts": 44, + "load_cv": 1.321708583707813, + "normalized_load_entropy": 0.8327142619461683, + "max_load_share": 0.125 + }, + "full_input": { + "tokens": 65, + "top_k": 6, + "decisions": 390, + "ordered_route_sha256": "ba3daac3160aef520da794fe995b6090cf16cf750ed1332ddfc411add408cad4", + "route_weight_sha256": "cd7d2c83b66949544b8f3400d5a20b9d56b2c44467d70672df5277b20bac94b8", + "loads": [ + 5, + 7, + 6, + 12, + 3, + 6, + 13, + 12, + 1, + 7, + 3, + 3, + 8, + 9, + 5, + 3, + 12, + 3, + 3, + 1, + 1, + 3, + 3, + 21, + 5, + 0, + 2, + 1, + 1, + 3, + 2, + 0, + 2, + 18, + 1, + 0, + 14, + 1, + 12, + 1, + 13, + 1, + 3, + 0, + 7, + 9, + 29, + 6, + 9, + 9, + 0, + 11, + 6, + 4, + 13, + 0, + 4, + 16, + 22, + 0, + 3, + 3, + 7, + 2 + ], + "weighted_loads": [ + 0.3130630571395159, + 0.40312811732292175, + 0.31841711327433586, + 0.6517921318300068, + 0.10712805576622486, + 0.41244021989405155, + 0.6576108708977699, + 0.5216086003929377, + 0.03375517204403877, + 0.4580687824636698, + 0.12867103144526482, + 0.12175056524574757, + 0.27173706982284784, + 0.4727595020085573, + 0.27267009392380714, + 0.12068681418895721, + 0.39611284248530865, + 0.15759748592972755, + 0.13483058661222458, + 0.0321977362036705, + 0.048077747225761414, + 0.12411953508853912, + 0.12219795770943165, + 2.3178503271192312, + 0.260360736399889, + 0.0, + 0.0822276771068573, + 0.04108600690960884, + 0.0634520947933197, + 0.17492851242423058, + 0.0942898616194725, + 0.0, + 0.09082096815109253, + 1.3536187801510096, + 0.028362276032567024, + 0.0, + 1.0772538296878338, + 0.04795137792825699, + 0.7107313685119152, + 0.02381807379424572, + 0.49249131977558136, + 0.028699200600385666, + 0.08639191463589668, + 0.0, + 0.305580697953701, + 1.2722538989037275, + 2.444773145020008, + 0.3331558583304286, + 0.4059151802212, + 0.5428685620427132, + 0.0, + 0.6970781087875366, + 0.6476897858083248, + 0.15845124796032906, + 1.2155537009239197, + 0.0, + 0.3207880463451147, + 1.404285131022334, + 1.3341501746326685, + 0.0, + 0.11451967619359493, + 0.2105667069554329, + 0.26540493965148926, + 0.07862301170825958 + ], + "unique_experts": 57, + "load_cv": 0.9917344133456647, + "normalized_load_entropy": 0.8906711909817359, + "max_load_share": 0.07435897435897436 + } + }, + "s0_period": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "a578804d20fee7ac9ef4c9ef20aed75284ebcbcd8d5287af34e30878b75d44a8", + "route_weight_sha256": "33010309bf04be51d2e2fb6b9fd211baf8e8737ff45130f3f00d1a139467e1d5", + "loads": [ + 1, + 1, + 0, + 4, + 0, + 4, + 0, + 3, + 0, + 4, + 1, + 2, + 5, + 4, + 2, + 0, + 7, + 1, + 1, + 0, + 0, + 3, + 1, + 3, + 3, + 0, + 1, + 1, + 2, + 2, + 1, + 0, + 1, + 8, + 1, + 0, + 9, + 0, + 4, + 0, + 4, + 1, + 1, + 0, + 5, + 3, + 10, + 1, + 2, + 6, + 0, + 0, + 0, + 4, + 0, + 0, + 3, + 2, + 17, + 0, + 1, + 3, + 0, + 1 + ], + "weighted_loads": [ + 0.03551539033651352, + 0.050564516335725784, + 0.0, + 0.13646873645484447, + 0.0, + 0.32946212589740753, + 0.0, + 0.18300830200314522, + 0.0, + 0.3419041633605957, + 0.04516458511352539, + 0.0785442665219307, + 0.18806562945246696, + 0.26394815742969513, + 0.0872272402048111, + 0.0, + 0.2915990464389324, + 0.06188848242163658, + 0.047537051141262054, + 0.0, + 0.0, + 0.11349205300211906, + 0.027276113629341125, + 0.15038781985640526, + 0.18908389657735825, + 0.0, + 0.04334665462374687, + 0.03994134068489075, + 0.09852287918329239, + 0.143865168094635, + 0.06331807374954224, + 0.0, + 0.04147107154130936, + 0.539812820032239, + 0.029403869062662125, + 0.0, + 0.744451642036438, + 0.0, + 0.23507363721728325, + 0.0, + 0.16489670053124428, + 0.026596255600452423, + 0.03560450300574303, + 0.0, + 0.2029784619808197, + 0.18199504539370537, + 0.48392452858388424, + 0.03667881339788437, + 0.08618335425853729, + 0.3962264582514763, + 0.0, + 0.0, + 0.0, + 0.17679543793201447, + 0.0, + 0.0, + 0.2869138792157173, + 0.0668938048183918, + 1.1186138950288296, + 0.0, + 0.03993275389075279, + 0.12136801332235336, + 0.0, + 0.05056223273277283 + ], + "unique_experts": 44, + "load_cv": 1.314684396244359, + "normalized_load_entropy": 0.8305196447011977, + "max_load_share": 0.11805555555555555 + }, + "full_input": { + "tokens": 49, + "top_k": 6, + "decisions": 294, + "ordered_route_sha256": "d7b7b1390c9bf96537a33543a870ceba0c79bf967b1ca28f3361785ba60d4ed3", + "route_weight_sha256": "63cb225b87bb1f1ba50e9ab8da7e0d2071f709b18cc57221bb0ab3c58164be74", + "loads": [ + 5, + 4, + 1, + 11, + 5, + 6, + 6, + 10, + 0, + 12, + 1, + 4, + 7, + 9, + 4, + 1, + 12, + 1, + 1, + 0, + 0, + 3, + 4, + 15, + 6, + 0, + 1, + 1, + 2, + 2, + 1, + 0, + 3, + 12, + 1, + 1, + 9, + 0, + 9, + 0, + 11, + 1, + 4, + 0, + 5, + 9, + 22, + 4, + 3, + 6, + 0, + 1, + 0, + 5, + 11, + 2, + 3, + 11, + 19, + 0, + 1, + 3, + 2, + 1 + ], + "weighted_loads": [ + 0.2319294437766075, + 0.2179521732032299, + 0.054464660584926605, + 0.3646777351386845, + 0.2092512957751751, + 0.38353567384183407, + 0.32284068316221237, + 0.5090140420943499, + 0.0, + 0.6203307062387466, + 0.04516458511352539, + 0.17498300597071648, + 0.24021673016250134, + 0.4720798172056675, + 0.22081562131643295, + 0.0385318361222744, + 0.46847939863801, + 0.06188848242163658, + 0.047537051141262054, + 0.0, + 0.0, + 0.11349205300211906, + 0.21302437596023083, + 1.6805030070245266, + 0.2909286078065634, + 0.0, + 0.04334665462374687, + 0.03994134068489075, + 0.09852287918329239, + 0.143865168094635, + 0.06331807374954224, + 0.0, + 0.1211355347186327, + 1.0303268190473318, + 0.029403869062662125, + 0.030968084931373596, + 0.744451642036438, + 0.0, + 0.5927403224632144, + 0.0, + 0.5065585449337959, + 0.026596255600452423, + 0.1324249729514122, + 0.0, + 0.2029784619808197, + 1.2502518109977245, + 1.525394605472684, + 0.13217601459473372, + 0.12439031526446342, + 0.3962264582514763, + 0.0, + 0.09169112145900726, + 0.0, + 0.2279094085097313, + 0.963620126247406, + 0.09069281443953514, + 0.2869138792157173, + 0.9189947880804539, + 1.2089646272361279, + 0.0, + 0.03993275389075279, + 0.12136801332235336, + 0.07003426738083363, + 0.05056223273277283 + ], + "unique_experts": 53, + "load_cv": 1.0620744895235372, + "normalized_load_entropy": 0.8711838922648749, + "max_load_share": 0.07482993197278912 + } + }, + "s1_period": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "d61f637f35930e7a79a49f0601add5ba917f05292d36f4bd24fa11cbe48f105c", + "route_weight_sha256": "6d97a4237a50608a64c3bb9dc72a1e0a592b56042201d9a25d269652e9015b08", + "loads": [ + 0, + 2, + 0, + 2, + 0, + 4, + 1, + 3, + 0, + 4, + 1, + 2, + 7, + 4, + 2, + 0, + 6, + 2, + 1, + 0, + 0, + 3, + 1, + 3, + 3, + 0, + 1, + 1, + 1, + 2, + 2, + 0, + 1, + 8, + 1, + 0, + 8, + 0, + 4, + 0, + 3, + 1, + 1, + 0, + 5, + 3, + 10, + 2, + 2, + 6, + 0, + 0, + 0, + 3, + 0, + 0, + 3, + 3, + 18, + 0, + 2, + 1, + 0, + 1 + ], + "weighted_loads": [ + 0.0, + 0.07432308606803417, + 0.0, + 0.07707355916500092, + 0.0, + 0.3756742961704731, + 0.031351130455732346, + 0.16363252326846123, + 0.0, + 0.344407569617033, + 0.04807354509830475, + 0.09189123287796974, + 0.2724202908575535, + 0.28050049394369125, + 0.08766314759850502, + 0.0, + 0.2534806355834007, + 0.09631288051605225, + 0.04675648361444473, + 0.0, + 0.0, + 0.12206228449940681, + 0.030457371845841408, + 0.13065581768751144, + 0.19234564900398254, + 0.0, + 0.0392206571996212, + 0.04621422663331032, + 0.0648500919342041, + 0.1319884918630123, + 0.09238880127668381, + 0.0, + 0.045059990137815475, + 0.5195627883076668, + 0.0334935300052166, + 0.0, + 0.6702269520610571, + 0.0, + 0.25028443336486816, + 0.0, + 0.12697907537221909, + 0.029779335483908653, + 0.03667533025145531, + 0.0, + 0.19858228415250778, + 0.17994219437241554, + 0.4738388415426016, + 0.07235574722290039, + 0.0908440425992012, + 0.3855080306529999, + 0.0, + 0.0, + 0.0, + 0.1262621246278286, + 0.0, + 0.0, + 0.287098690867424, + 0.09209667146205902, + 1.1423724703490734, + 0.0, + 0.07353994622826576, + 0.050603944808244705, + 0.0, + 0.03729163110256195 + ], + "unique_experts": 44, + "load_cv": 1.3286956381223776, + "normalized_load_entropy": 0.832310887472098, + "max_load_share": 0.125 + }, + "full_input": { + "tokens": 65, + "top_k": 6, + "decisions": 390, + "ordered_route_sha256": "5717be2ec0771ded764f3b67753ebac585f9f9a383dea1a5685ac72891030f7a", + "route_weight_sha256": "58cba1036f6a317cdba26ada82bd4b28298a9b7175ad3fea3b7525ad4ceed4ea", + "loads": [ + 5, + 7, + 7, + 11, + 3, + 6, + 15, + 12, + 1, + 8, + 3, + 3, + 9, + 10, + 5, + 3, + 13, + 3, + 3, + 0, + 1, + 3, + 3, + 18, + 5, + 0, + 2, + 1, + 1, + 3, + 2, + 0, + 2, + 19, + 1, + 0, + 14, + 1, + 13, + 1, + 11, + 1, + 3, + 0, + 7, + 9, + 29, + 6, + 8, + 9, + 0, + 10, + 6, + 5, + 12, + 0, + 3, + 19, + 21, + 0, + 4, + 2, + 6, + 2 + ], + "weighted_loads": [ + 0.3084999416023493, + 0.39841766469180584, + 0.3572958819568157, + 0.6010713786818087, + 0.10712805576622486, + 0.41899493522942066, + 0.7586044128984213, + 0.5050495024770498, + 0.03375517204403877, + 0.4923228118568659, + 0.14084158465266228, + 0.12314092554152012, + 0.32527486700564623, + 0.5278012435883284, + 0.2664972320199013, + 0.12068681418895721, + 0.4356524348258972, + 0.15829437226057053, + 0.13671975582838058, + 0.0, + 0.048077747225761414, + 0.12206228449940681, + 0.15911329723894596, + 2.1228750571608543, + 0.27194932103157043, + 0.0, + 0.08482944965362549, + 0.04621422663331032, + 0.0648500919342041, + 0.17753255367279053, + 0.09238880127668381, + 0.0, + 0.08949374035000801, + 1.3996372390538454, + 0.0334935300052166, + 0.0, + 1.1009896285831928, + 0.04795137792825699, + 0.8886573184281588, + 0.02381807379424572, + 0.4385855346918106, + 0.029779335483908653, + 0.08946571126580238, + 0.0, + 0.300347913056612, + 1.287978770211339, + 2.2187580186873674, + 0.32486149948090315, + 0.35380195267498493, + 0.5365401804447174, + 0.0, + 0.6175263747572899, + 0.6476897858083248, + 0.20143199525773525, + 1.0648128390312195, + 0.0, + 0.287098690867424, + 1.5756997130811214, + 1.2920468710362911, + 0.0, + 0.14691598154604435, + 0.17686133459210396, + 0.23174017295241356, + 0.07652605697512627 + ], + "unique_experts": 56, + "load_cv": 0.9934300947007791, + "normalized_load_entropy": 0.8885607013708519, + "max_load_share": 0.07435897435897436 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 24, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.9315476190476191, + "mean_token_weighted_tv": 0.017266916227526963, + "aggregate_load_tv": 0.034722222222222224 + }, + "system_bos": { + "tokens": 24, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.880952380952381, + "mean_token_weighted_tv": 0.02489659023315956, + "aggregate_load_tv": 0.0625 + }, + "system_x": { + "tokens": 24, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 11, + "mean_set_jaccard": 0.8363095238095238, + "mean_token_weighted_tv": 0.03325101073520879, + "aggregate_load_tv": 0.09027777777777779 + }, + "system_period": { + "tokens": 24, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.875, + "mean_token_weighted_tv": 0.029357326527436573, + "aggregate_load_tv": 0.06944444444444445 + }, + "bos_at_s0": { + "tokens": 24, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.9047619047619048, + "mean_token_weighted_tv": 0.020825539870808523, + "aggregate_load_tv": 0.04861111111111111 + }, + "bos_at_s1": { + "tokens": 24, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 13, + "mean_set_jaccard": 0.8601190476190476, + "mean_token_weighted_tv": 0.027501558186486363, + "aggregate_load_tv": 0.0763888888888889 + }, + "x_at_s0": { + "tokens": 24, + "ordered_topk_exact_tokens": 6, + "set_exact_tokens": 10, + "mean_set_jaccard": 0.824404761904762, + "mean_token_weighted_tv": 0.03237764645988742, + "aggregate_load_tv": 0.10416666666666669 + }, + "x_at_s1": { + "tokens": 24, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 13, + "mean_set_jaccard": 0.8601190476190478, + "mean_token_weighted_tv": 0.03330886026378721, + "aggregate_load_tv": 0.0763888888888889 + }, + "period_at_s0": { + "tokens": 24, + "ordered_topk_exact_tokens": 7, + "set_exact_tokens": 11, + "mean_set_jaccard": 0.8363095238095238, + "mean_token_weighted_tv": 0.03159821064521869, + "aggregate_load_tv": 0.0763888888888889 + }, + "period_at_s1": { + "tokens": 24, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 12, + "mean_set_jaccard": 0.8392857142857143, + "mean_token_weighted_tv": 0.03661318794668963, + "aggregate_load_tv": 0.09027777777777778 + } + } + }, + "layer_24": { + "layer": 24, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "d0f6d2f4244651bb6a381a66c142ff5ebd1f5ac38e0a16cefc0c5ff7520398fd", + "route_weight_sha256": "051ce40569423a7b63f8272f85b4b6b350891c96ffd34ff0cc37b9426b35d227", + "loads": [ + 3, + 0, + 1, + 0, + 0, + 0, + 1, + 8, + 2, + 0, + 1, + 1, + 7, + 1, + 2, + 2, + 0, + 0, + 3, + 4, + 14, + 0, + 0, + 4, + 23, + 0, + 0, + 1, + 3, + 4, + 3, + 2, + 0, + 0, + 0, + 2, + 2, + 2, + 0, + 0, + 6, + 0, + 0, + 9, + 3, + 1, + 0, + 18, + 0, + 0, + 3, + 0, + 0, + 0, + 1, + 0, + 0, + 0, + 0, + 2, + 0, + 0, + 4, + 1 + ], + "weighted_loads": [ + 0.19324618205428123, + 0.0, + 0.043234772980213165, + 0.0, + 0.0, + 0.0, + 0.029559215530753136, + 0.6286398805677891, + 0.07064500078558922, + 0.0, + 0.036076925694942474, + 0.021424679085612297, + 0.19824045710265636, + 0.048927973955869675, + 0.08505142852663994, + 0.09988190606236458, + 0.0, + 0.0, + 0.1715298816561699, + 0.15278971008956432, + 1.0509986244142056, + 0.0, + 0.0, + 0.21267128363251686, + 2.2274699956178665, + 0.0, + 0.0, + 0.04474804922938347, + 0.09314367920160294, + 0.23039482533931732, + 0.08992155082523823, + 0.08351488225162029, + 0.0, + 0.0, + 0.0, + 0.21555563062429428, + 0.060263630002737045, + 0.09738896042108536, + 0.0, + 0.0, + 0.27431774139404297, + 0.0, + 0.0, + 0.8344943951815367, + 0.11101009510457516, + 0.0329427570104599, + 0.0, + 2.296677492558956, + 0.0, + 0.0, + 0.12186476960778236, + 0.0, + 0.0, + 0.0, + 0.046680234372615814, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0668554063886404, + 0.0, + 0.0, + 0.16656258516013622, + 0.0860852375626564 + ], + "unique_experts": 34, + "load_cv": 1.854257696475404, + "normalized_load_entropy": 0.735932577313567, + "max_load_share": 0.1597222222222222 + }, + "full_input": { + "tokens": 49, + "top_k": 6, + "decisions": 294, + "ordered_route_sha256": "e9219cdac07d2c41bdb6c87fd2e77c167b1f53b557440e0b467192e81bdec960", + "route_weight_sha256": "6ab15a611f6888247d1e58bbfbe688a4b14f2d8660daa94fd7856cf99f371bae", + "loads": [ + 3, + 0, + 3, + 0, + 0, + 4, + 2, + 9, + 10, + 0, + 11, + 1, + 8, + 1, + 4, + 2, + 0, + 0, + 3, + 5, + 15, + 0, + 4, + 4, + 31, + 0, + 1, + 2, + 11, + 10, + 3, + 4, + 2, + 4, + 7, + 2, + 4, + 3, + 1, + 0, + 6, + 1, + 4, + 10, + 3, + 4, + 0, + 24, + 0, + 0, + 10, + 4, + 3, + 5, + 1, + 0, + 1, + 0, + 8, + 2, + 3, + 18, + 9, + 4 + ], + "weighted_loads": [ + 0.19324618205428123, + 0.0, + 0.10939819179475307, + 0.0, + 0.0, + 0.1409076564013958, + 0.08377602137625217, + 0.6815364770591259, + 0.42415425600484014, + 0.0, + 0.4028521857690066, + 0.021424679085612297, + 0.20097584882751107, + 0.048927973955869675, + 0.1438601203262806, + 0.09988190606236458, + 0.0, + 0.0, + 0.1715298816561699, + 0.22889827005565166, + 1.0839413739740849, + 0.0, + 0.2459738776087761, + 0.21267128363251686, + 2.5269629387184978, + 0.0, + 0.04193292185664177, + 0.09196561202406883, + 0.4207664951682091, + 0.46949002146720886, + 0.08992155082523823, + 0.14997115917503834, + 0.06441892869770527, + 0.1856721118092537, + 0.2548442529514432, + 0.21555563062429428, + 0.2573959045112133, + 0.9616605415940285, + 0.04656430333852768, + 0.0, + 0.27431774139404297, + 0.060457680374383926, + 0.18776061362586915, + 0.8717707563191652, + 0.11101009510457516, + 0.15858660638332367, + 0.0, + 2.644471197389066, + 0.0, + 0.0, + 0.4223675765097141, + 0.3124772682785988, + 0.08515856973826885, + 0.22219859436154366, + 0.046680234372615814, + 0.0, + 0.04964505881071091, + 0.0, + 0.2587399740004912, + 0.0668554063886404, + 0.13023469224572182, + 1.3654286316595972, + 0.2857744151260704, + 2.0741745978593826 + ], + "unique_experts": 50, + "load_cv": 1.2414360249876613, + "normalized_load_entropy": 0.8520178939490435, + "max_load_share": 0.1054421768707483 + } + }, + "s1_eos": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "8590ee1d1a242ddfdea25c084f981c4db74e38201bf392556314200979d1677c", + "route_weight_sha256": "eaf616194be36fd5139c2db5c395127b72cb5aedc93b5acd169c197e730e2e5d", + "loads": [ + 4, + 1, + 1, + 0, + 1, + 0, + 1, + 8, + 2, + 1, + 1, + 0, + 9, + 1, + 2, + 2, + 0, + 0, + 3, + 5, + 13, + 0, + 0, + 4, + 23, + 0, + 0, + 2, + 3, + 3, + 1, + 2, + 0, + 0, + 0, + 2, + 1, + 3, + 0, + 0, + 6, + 0, + 0, + 9, + 2, + 1, + 0, + 18, + 0, + 0, + 2, + 0, + 0, + 0, + 1, + 0, + 0, + 0, + 0, + 2, + 0, + 0, + 3, + 1 + ], + "weighted_loads": [ + 0.23161472752690315, + 0.02086445316672325, + 0.04276830703020096, + 0.0, + 0.03571055829524994, + 0.0, + 0.03394542634487152, + 0.6297179721295834, + 0.07394841685891151, + 0.03168990835547447, + 0.038040436804294586, + 0.0, + 0.2621392197906971, + 0.044105060398578644, + 0.07817016541957855, + 0.09901521727442741, + 0.0, + 0.0, + 0.16725188866257668, + 0.18951742723584175, + 0.998143570497632, + 0.0, + 0.0, + 0.21353008970618248, + 2.1972111109644175, + 0.0, + 0.0, + 0.0691689271479845, + 0.09758571162819862, + 0.19431665539741516, + 0.033976245671510696, + 0.07587837427854538, + 0.0, + 0.0, + 0.0, + 0.21995530277490616, + 0.02803499437868595, + 0.12566358037292957, + 0.0, + 0.0, + 0.2640029117465019, + 0.0, + 0.0, + 0.8288882374763489, + 0.08355031535029411, + 0.03673814982175827, + 0.0, + 2.2005954906344414, + 0.0, + 0.0, + 0.08683804795145988, + 0.0, + 0.0, + 0.0, + 0.045719046145677567, + 0.0, + 0.0, + 0.0, + 0.0, + 0.060863906517624855, + 0.0, + 0.0, + 0.14273592829704285, + 0.089925616979599 + ], + "unique_experts": 36, + "load_cv": 1.8509256943286314, + "normalized_load_entropy": 0.7399425993530592, + "max_load_share": 0.1597222222222222 + }, + "full_input": { + "tokens": 65, + "top_k": 6, + "decisions": 390, + "ordered_route_sha256": "6b650376b528e47179a6c8a07c070c6a2777e416e117d6095e37189d5f43a0e9", + "route_weight_sha256": "0d53316ac5b57c85403ce9037132a2387875176e524af2c95bb5be35c32b4f56", + "loads": [ + 4, + 2, + 2, + 1, + 3, + 8, + 2, + 9, + 11, + 4, + 10, + 2, + 12, + 1, + 4, + 2, + 1, + 0, + 4, + 8, + 18, + 0, + 9, + 5, + 33, + 0, + 2, + 3, + 23, + 8, + 2, + 5, + 0, + 6, + 6, + 4, + 9, + 5, + 1, + 0, + 7, + 7, + 5, + 11, + 4, + 3, + 0, + 26, + 0, + 0, + 8, + 12, + 6, + 5, + 3, + 2, + 1, + 1, + 14, + 2, + 5, + 21, + 12, + 6 + ], + "weighted_loads": [ + 0.23161472752690315, + 0.05046696588397026, + 0.06817556731402874, + 0.11051279306411743, + 0.09660637192428112, + 0.2658627890050411, + 0.10019827634096146, + 0.668694019317627, + 0.6635404652915895, + 0.1617160327732563, + 0.3960928290616721, + 0.06692410260438919, + 0.32284379680640996, + 0.044105060398578644, + 0.14027125760912895, + 0.09901521727442741, + 0.028885528445243835, + 0.0, + 0.19955751672387123, + 0.3260375689715147, + 1.2160510066896677, + 0.0, + 0.526102228090167, + 0.2382782232016325, + 2.560355949215591, + 0.0, + 0.07224514335393906, + 0.11630729399621487, + 1.0816034469753504, + 0.4136987756937742, + 0.08021324500441551, + 0.21474620699882507, + 0.0, + 0.3040114678442478, + 0.24579576356336474, + 0.32141684368252754, + 0.6471595596522093, + 1.0327285658568144, + 0.051582977175712585, + 0.0, + 0.3783218413591385, + 0.41742405109107494, + 0.20971768675372005, + 1.034387405961752, + 0.17818301543593407, + 0.13615042343735695, + 0.0, + 2.707876863423735, + 0.0, + 0.0, + 0.36002678237855434, + 0.8693565800786018, + 0.1739420536905527, + 0.31865667179226875, + 0.2186703011393547, + 0.09994275495409966, + 0.04587719962000847, + 0.03863086551427841, + 0.5737956537632272, + 0.060863906517624855, + 0.19234134629368782, + 2.0613360782153904, + 0.5654360358603299, + 2.1572184190154076 + ], + "unique_experts": 56, + "load_cv": 1.0693137765233935, + "normalized_load_entropy": 0.8835672267283036, + "max_load_share": 0.08461538461538462 + } + }, + "s0_bos": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "8f9302b586d5b1d07a41d57d275e474008dcf03d6ad90cc9472f188cd9db57d0", + "route_weight_sha256": "8e4cf044599b69c1054d9b894156c60e21ac40d7e88c81419af41f05c33ab229", + "loads": [ + 3, + 1, + 1, + 0, + 0, + 0, + 1, + 8, + 2, + 0, + 1, + 1, + 4, + 1, + 2, + 2, + 0, + 0, + 3, + 4, + 15, + 0, + 0, + 4, + 23, + 0, + 0, + 2, + 4, + 3, + 2, + 2, + 1, + 0, + 0, + 2, + 2, + 2, + 0, + 0, + 6, + 0, + 1, + 9, + 3, + 0, + 0, + 18, + 0, + 0, + 3, + 0, + 0, + 0, + 1, + 0, + 0, + 0, + 0, + 2, + 0, + 0, + 4, + 1 + ], + "weighted_loads": [ + 0.21266623958945274, + 0.020655905827879906, + 0.04396567493677139, + 0.0, + 0.0, + 0.0, + 0.03493048995733261, + 0.586419764906168, + 0.06818683445453644, + 0.0, + 0.034673359245061874, + 0.02050727978348732, + 0.12443051859736443, + 0.046738654375076294, + 0.08858482167124748, + 0.11257441341876984, + 0.0, + 0.0, + 0.16579339653253555, + 0.15776232443749905, + 1.1059023272246122, + 0.0, + 0.0, + 0.20402276143431664, + 2.207928616553545, + 0.0, + 0.0, + 0.08270716667175293, + 0.13255451247096062, + 0.2079477533698082, + 0.06883759051561356, + 0.07790542207658291, + 0.03469351306557655, + 0.0, + 0.0, + 0.21502146124839783, + 0.06384295225143433, + 0.09994079172611237, + 0.0, + 0.0, + 0.2868073433637619, + 0.0, + 0.03090970776975155, + 0.84157426469028, + 0.10329348407685757, + 0.0, + 0.0, + 2.361407086253166, + 0.0, + 0.0, + 0.12147440016269684, + 0.0, + 0.0, + 0.0, + 0.04789099097251892, + 0.0, + 0.0, + 0.0, + 0.0, + 0.07109314016997814, + 0.0, + 0.0, + 0.16808749549090862, + 0.08784344047307968 + ], + "unique_experts": 36, + "load_cv": 1.8509256943286314, + "normalized_load_entropy": 0.7441570934376937, + "max_load_share": 0.1597222222222222 + }, + "full_input": { + "tokens": 49, + "top_k": 6, + "decisions": 294, + "ordered_route_sha256": "b1845b3cb4d2647a774a95843ec3f4369727540bd214158f77fc720b80597ee4", + "route_weight_sha256": "2fffeebdaae103ac12d96b84f524de74ea53fb4c1042a28b2f6c1282598aa18e", + "loads": [ + 3, + 2, + 5, + 0, + 0, + 4, + 3, + 9, + 10, + 0, + 9, + 1, + 5, + 1, + 4, + 2, + 1, + 0, + 3, + 5, + 16, + 0, + 5, + 4, + 31, + 0, + 1, + 2, + 12, + 9, + 4, + 5, + 3, + 4, + 6, + 2, + 4, + 3, + 0, + 0, + 6, + 1, + 6, + 9, + 4, + 3, + 1, + 22, + 0, + 0, + 11, + 5, + 3, + 5, + 1, + 0, + 0, + 0, + 7, + 2, + 3, + 18, + 6, + 3 + ], + "weighted_loads": [ + 0.21266623958945274, + 0.06637595780193806, + 0.17204170860350132, + 0.0, + 0.0, + 0.1476677991449833, + 0.15532319992780685, + 0.6393163613975048, + 0.4684501476585865, + 0.0, + 0.35149239539168775, + 0.02050727978348732, + 0.12716591032221913, + 0.046738654375076294, + 0.14739351347088814, + 0.11257441341876984, + 0.03211842104792595, + 0.0, + 0.16579339653253555, + 0.22085805051028728, + 1.1388450767844915, + 0.0, + 0.40412869304418564, + 0.20402276143431664, + 2.5074215596541762, + 0.0, + 0.43173208832740784, + 0.08270716667175293, + 0.4481724835932255, + 0.46007685735821724, + 0.1681446135044098, + 0.17138593085110188, + 0.12105265818536282, + 0.1856721118092537, + 0.18860549945384264, + 0.21502146124839783, + 0.22387371212244034, + 0.9642123728990555, + 0.0, + 0.0, + 0.2868073433637619, + 0.060457680374383926, + 0.29055586620233953, + 0.84157426469028, + 0.14154149778187275, + 0.16277921199798584, + 0.06280601024627686, + 2.6642954086419195, + 0.0, + 0.0, + 0.47946877405047417, + 0.3285485543310642, + 0.08515856973826885, + 0.23697229847311974, + 0.04789099097251892, + 0.0, + 0.0, + 0.0, + 0.25434716790914536, + 0.07109314016997814, + 0.12760907411575317, + 1.3242195784114301, + 0.20492833433672786, + 1.1061162948608398 + ], + "unique_experts": 51, + "load_cv": 1.2020429337534142, + "normalized_load_entropy": 0.8615620770959269, + "max_load_share": 0.1054421768707483 + } + }, + "s1_bos": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "f3dd1646639a6f3159612aceae26a315b18daf86bd6c6545577e6af736359eec", + "route_weight_sha256": "86e246cc528e1a18b872224ea3d1b038f454e3b30f475b4abefb44d2e99583f7", + "loads": [ + 3, + 0, + 1, + 0, + 0, + 0, + 1, + 8, + 2, + 0, + 1, + 0, + 8, + 1, + 2, + 2, + 0, + 0, + 3, + 4, + 14, + 0, + 0, + 3, + 24, + 0, + 0, + 3, + 3, + 3, + 1, + 2, + 0, + 0, + 0, + 2, + 1, + 3, + 0, + 0, + 6, + 0, + 2, + 9, + 3, + 1, + 0, + 18, + 1, + 0, + 2, + 0, + 0, + 0, + 1, + 0, + 0, + 0, + 0, + 2, + 0, + 0, + 3, + 1 + ], + "weighted_loads": [ + 0.2112194448709488, + 0.0, + 0.041771288961172104, + 0.0, + 0.0, + 0.0, + 0.034828074276447296, + 0.5768174342811108, + 0.07004347816109657, + 0.0, + 0.03422791510820389, + 0.0, + 0.22477109171450138, + 0.0442313551902771, + 0.08162463083863258, + 0.11514662951231003, + 0.0, + 0.0, + 0.17042645812034607, + 0.15038412436842918, + 1.101422518491745, + 0.0, + 0.0, + 0.167801383882761, + 2.2132739443331957, + 0.0, + 0.0, + 0.10001330263912678, + 0.09790281765162945, + 0.19345298781991005, + 0.03527113050222397, + 0.07444581016898155, + 0.0, + 0.0, + 0.0, + 0.21655835956335068, + 0.028744712471961975, + 0.12841427698731422, + 0.0, + 0.0, + 0.2733069658279419, + 0.0, + 0.05742442421615124, + 0.8380247671157122, + 0.0998639389872551, + 0.03465929627418518, + 0.0, + 2.3337687142193317, + 0.03244404122233391, + 0.0, + 0.08441366627812386, + 0.0, + 0.0, + 0.0, + 0.04456188157200813, + 0.0, + 0.0, + 0.0, + 0.0, + 0.06323741376399994, + 0.0, + 0.0, + 0.1471308432519436, + 0.09099259227514267 + ], + "unique_experts": 35, + "load_cv": 1.8888888888888888, + "normalized_load_entropy": 0.7352261501375442, + "max_load_share": 0.16666666666666666 + }, + "full_input": { + "tokens": 65, + "top_k": 6, + "decisions": 390, + "ordered_route_sha256": "6f67b7b85ce04ca3b547885c0da51abde49907a6062b6fffb47bb42dcbf6a176", + "route_weight_sha256": "03e244129215fbb80a7b3db1d46cb35c6fe55b486f7ec7dafc6a90e2e1fdd927", + "loads": [ + 3, + 0, + 4, + 1, + 2, + 8, + 1, + 9, + 11, + 3, + 10, + 2, + 11, + 1, + 4, + 2, + 1, + 0, + 4, + 8, + 19, + 0, + 10, + 4, + 34, + 0, + 0, + 3, + 23, + 8, + 2, + 6, + 0, + 6, + 6, + 4, + 9, + 5, + 1, + 0, + 7, + 7, + 9, + 12, + 4, + 4, + 0, + 25, + 1, + 0, + 11, + 13, + 7, + 6, + 3, + 2, + 0, + 0, + 13, + 2, + 3, + 22, + 10, + 4 + ], + "weighted_loads": [ + 0.2112194448709488, + 0.0, + 0.1333606969565153, + 0.11051279306411743, + 0.06089581362903118, + 0.2636082209646702, + 0.034828074276447296, + 0.6157934814691544, + 0.7076117657124996, + 0.13002612441778183, + 0.42230759910307825, + 0.06692410260438919, + 0.28547566873021424, + 0.0442313551902771, + 0.14372572302818298, + 0.11514662951231003, + 0.028885528445243835, + 0.0, + 0.20273208618164062, + 0.29824431240558624, + 1.3193299546837807, + 0.0, + 0.655793072655797, + 0.19254951737821102, + 2.5769217079505324, + 0.0, + 0.0, + 0.10001330263912678, + 1.0819205529987812, + 0.4394131451845169, + 0.09019765257835388, + 0.2502368688583374, + 0.0, + 0.3040114678442478, + 0.2147456551901996, + 0.31801990047097206, + 0.6251758001744747, + 1.035479262471199, + 0.044398583471775055, + 0.0, + 0.38762589544057846, + 0.41742405109107494, + 0.4599121338687837, + 1.117680897936225, + 0.13866161927580833, + 0.18963797390460968, + 0.0, + 2.8769926649983972, + 0.03244404122233391, + 0.0, + 0.5632755793631077, + 0.8571413904428482, + 0.21442670561373234, + 0.377374816685915, + 0.21751313656568527, + 0.09994275495409966, + 0.0, + 0.0, + 0.5698509886860847, + 0.06323741376399994, + 0.11073823273181915, + 2.0136787709780037, + 0.5282479557208717, + 1.1446741558611393 + ], + "unique_experts": 53, + "load_cv": 1.1003436197503544, + "normalized_load_entropy": 0.8726123770572737, + "max_load_share": 0.08717948717948718 + } + }, + "s0_x": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "dc3099de61057a0021678f7d3d81cd5738c86e6fdd920d5ce19e7bc46c050901", + "route_weight_sha256": "c7147986fa0cbdf9596e7a4c59af9a35dec9c19467d3dad474e539e9a8bb9fbf", + "loads": [ + 3, + 0, + 1, + 0, + 1, + 0, + 1, + 9, + 2, + 0, + 1, + 0, + 6, + 1, + 2, + 2, + 0, + 0, + 3, + 3, + 14, + 0, + 0, + 4, + 24, + 0, + 0, + 2, + 3, + 4, + 1, + 2, + 1, + 0, + 0, + 2, + 2, + 2, + 0, + 0, + 6, + 0, + 0, + 9, + 3, + 1, + 0, + 18, + 0, + 0, + 3, + 0, + 0, + 0, + 1, + 0, + 0, + 0, + 0, + 2, + 0, + 0, + 4, + 1 + ], + "weighted_loads": [ + 0.20903189852833748, + 0.0, + 0.04588671773672104, + 0.0, + 0.035397086292505264, + 0.0, + 0.029827358201146126, + 0.5974579695612192, + 0.06893036141991615, + 0.0, + 0.03370502218604088, + 0.0, + 0.1914371456950903, + 0.04851890355348587, + 0.09216693043708801, + 0.1020447202026844, + 0.0, + 0.0, + 0.16226071491837502, + 0.12299385108053684, + 1.0391635689884424, + 0.0, + 0.0, + 0.2155589424073696, + 2.2256386820226908, + 0.0, + 0.0, + 0.06409575417637825, + 0.10724925249814987, + 0.22049162723124027, + 0.03517800569534302, + 0.07533481530845165, + 0.030840767547488213, + 0.0, + 0.0, + 0.20979563146829605, + 0.0663694441318512, + 0.10056503862142563, + 0.0, + 0.0, + 0.28335779905319214, + 0.0, + 0.0, + 0.8410604503005743, + 0.10463447496294975, + 0.03249239921569824, + 0.0, + 2.3285689502954483, + 0.0, + 0.0, + 0.12372630462050438, + 0.0, + 0.0, + 0.0, + 0.04650960490107536, + 0.0, + 0.0, + 0.0, + 0.0, + 0.06736816465854645, + 0.0, + 0.0, + 0.15943503566086292, + 0.09293416887521744 + ], + "unique_experts": 35, + "load_cv": 1.8872541946070034, + "normalized_load_entropy": 0.7354872178333576, + "max_load_share": 0.16666666666666666 + }, + "full_input": { + "tokens": 49, + "top_k": 6, + "decisions": 294, + "ordered_route_sha256": "37ecb1acb198bee93582e71ae43f7034b0602c92ca2af6b106c0ac864f38d722", + "route_weight_sha256": "65abd8e863866bdbc88241d915cdfaa244d78af3846d0d7506f5549c65716c2c", + "loads": [ + 3, + 0, + 3, + 0, + 1, + 5, + 2, + 10, + 10, + 0, + 10, + 0, + 9, + 1, + 4, + 2, + 0, + 0, + 3, + 4, + 15, + 0, + 3, + 4, + 32, + 0, + 1, + 2, + 11, + 10, + 2, + 4, + 3, + 4, + 8, + 3, + 5, + 5, + 1, + 0, + 7, + 1, + 3, + 9, + 3, + 4, + 0, + 23, + 0, + 0, + 10, + 5, + 4, + 6, + 1, + 0, + 0, + 0, + 7, + 2, + 2, + 18, + 6, + 3 + ], + "weighted_loads": [ + 0.20903189852833748, + 0.0, + 0.11205013655126095, + 0.0, + 0.035397086292505264, + 0.17065213061869144, + 0.07258043624460697, + 0.650354566052556, + 0.4965098053216934, + 0.0, + 0.4023999364580959, + 0.0, + 0.2591807977296412, + 0.04851890355348587, + 0.15097562223672867, + 0.1020447202026844, + 0.0, + 0.0, + 0.16226071491837502, + 0.1594333853572607, + 1.0721063185483217, + 0.0, + 0.22044695168733597, + 0.2155589424073696, + 2.525131625123322, + 0.0, + 0.041253186762332916, + 0.06409575417637825, + 0.425862118601799, + 0.47568399645388126, + 0.09007445722818375, + 0.13251410238444805, + 0.09748484194278717, + 0.1856721118092537, + 0.2788554960861802, + 0.24727438017725945, + 0.24363546073436737, + 1.045809280127287, + 0.03699323907494545, + 0.0, + 0.3170321434736252, + 0.060457680374383926, + 0.10235139331780374, + 0.8410604503005743, + 0.10463447496294975, + 0.1623358651995659, + 0.0, + 2.7015968372579664, + 0.0, + 0.0, + 0.42047400027513504, + 0.36716894432902336, + 0.12422538362443447, + 0.2717707082629204, + 0.04650960490107536, + 0.0, + 0.0, + 0.0, + 0.2477604802697897, + 0.06736816465854645, + 0.08395729586482048, + 1.283620165195316, + 0.19421302108094096, + 1.1112070232629776 + ], + "unique_experts": 49, + "load_cv": 1.2444146119402053, + "normalized_load_entropy": 0.8504738461011745, + "max_load_share": 0.10884353741496598 + } + }, + "s1_x": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "ff55f9edcd671a5b69f1192e95b79d341d1545e82253ca57420c8d1b54fed9a2", + "route_weight_sha256": "273773f0bdd800629bc59197fbf6d2cb22100fa5e3cce06816c992e5a4858bfc", + "loads": [ + 3, + 0, + 1, + 0, + 2, + 0, + 1, + 8, + 2, + 1, + 0, + 0, + 8, + 1, + 2, + 2, + 0, + 0, + 3, + 6, + 12, + 0, + 0, + 3, + 24, + 0, + 0, + 2, + 4, + 3, + 0, + 2, + 0, + 0, + 0, + 2, + 3, + 2, + 0, + 0, + 6, + 0, + 0, + 9, + 3, + 1, + 0, + 18, + 0, + 0, + 3, + 0, + 0, + 0, + 1, + 0, + 0, + 0, + 0, + 2, + 0, + 0, + 3, + 1 + ], + "weighted_loads": [ + 0.21084416285157204, + 0.0, + 0.0430675707757473, + 0.0, + 0.06844451650977135, + 0.0, + 0.029896603897213936, + 0.5663733389228582, + 0.07034488767385483, + 0.032145798206329346, + 0.0, + 0.0, + 0.25007108598947525, + 0.04155920073390007, + 0.08117814362049103, + 0.10133788362145424, + 0.0, + 0.0, + 0.16030949354171753, + 0.22235224582254887, + 0.9856477938592434, + 0.0, + 0.0, + 0.17114900425076485, + 2.1728734970092773, + 0.0, + 0.0, + 0.05972472205758095, + 0.15576635859906673, + 0.17582133784890175, + 0.0, + 0.07984509132802486, + 0.0, + 0.0, + 0.0, + 0.21080231666564941, + 0.10263920947909355, + 0.09808305278420448, + 0.0, + 0.0, + 0.2695778962224722, + 0.0, + 0.0, + 0.8323470875620842, + 0.118553901091218, + 0.034282371401786804, + 0.0, + 2.264731889590621, + 0.0, + 0.0, + 0.11618530377745628, + 0.0, + 0.0, + 0.0, + 0.04964364692568779, + 0.0, + 0.0, + 0.0, + 0.0, + 0.05876564607024193, + 0.0, + 0.0, + 0.13251066207885742, + 0.10374674946069717 + ], + "unique_experts": 33, + "load_cv": 1.8691782045845247, + "normalized_load_entropy": 0.732365654070402, + "max_load_share": 0.16666666666666666 + }, + "full_input": { + "tokens": 65, + "top_k": 6, + "decisions": 390, + "ordered_route_sha256": "740331472ad4be27b9cc786799158ab3a169910b8a55b00f23f214fd14308e05", + "route_weight_sha256": "119c6c6fdfc69c8a84778a63c6215b268b75ab60553915dd8b6acf6bd2073c55", + "loads": [ + 3, + 0, + 2, + 1, + 4, + 9, + 1, + 9, + 13, + 4, + 7, + 2, + 12, + 1, + 4, + 2, + 1, + 0, + 4, + 9, + 18, + 0, + 8, + 4, + 33, + 1, + 0, + 3, + 25, + 8, + 0, + 6, + 0, + 7, + 6, + 5, + 13, + 6, + 0, + 0, + 7, + 7, + 5, + 11, + 4, + 2, + 0, + 25, + 0, + 0, + 9, + 13, + 6, + 6, + 3, + 2, + 0, + 0, + 15, + 2, + 5, + 22, + 11, + 4 + ], + "weighted_loads": [ + 0.21084416285157204, + 0.0, + 0.06847483105957508, + 0.11051279306411743, + 0.12934033013880253, + 0.29299470968544483, + 0.029896603897213936, + 0.6053493861109018, + 0.7761150076985359, + 0.16217192262411118, + 0.30942766717635095, + 0.06692410260438919, + 0.34042875771410763, + 0.04155920073390007, + 0.14327923581004143, + 0.10133788362145424, + 0.028885528445243835, + 0.0, + 0.19261512160301208, + 0.3092316649854183, + 1.235143929719925, + 0.0, + 0.4896844867616892, + 0.19589713774621487, + 2.495705490000546, + 0.02913287654519081, + 0.0, + 0.09695254638791084, + 1.181135829538107, + 0.43657855689525604, + 0.0, + 0.24484738521277905, + 0.0, + 0.3434881642460823, + 0.2043890650384128, + 0.35797997936606407, + 0.8162321262061596, + 1.0729752257466316, + 0.0, + 0.0, + 0.38389682583510876, + 0.41742405109107494, + 0.1486579026095569, + 1.0378462560474873, + 0.15735158137977123, + 0.0925409309566021, + 0.0, + 2.7648002372588962, + 0.0, + 0.0, + 0.39789343625307083, + 0.9046302773058414, + 0.1739420536905527, + 0.3693843297660351, + 0.22259490191936493, + 0.09994275495409966, + 0.0, + 0.0, + 0.666834432631731, + 0.05876564607024193, + 0.19730563461780548, + 2.0143002015538514, + 0.5526545378379524, + 1.1574283130466938 + ], + "unique_experts": 51, + "load_cv": 1.115912047415651, + "normalized_load_entropy": 0.866504961930566, + "max_load_share": 0.08461538461538462 + } + }, + "s0_period": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "6da985a2d89211740cf022f08bf70298934456d193828b1ee7dda56ae57d204f", + "route_weight_sha256": "f73707496e943fb68c130fec80cd2894c2f237a3d034fa00fcb17d3237c6579a", + "loads": [ + 4, + 0, + 1, + 0, + 1, + 0, + 0, + 9, + 1, + 0, + 0, + 0, + 5, + 1, + 2, + 2, + 0, + 0, + 3, + 5, + 15, + 0, + 0, + 4, + 24, + 0, + 0, + 1, + 3, + 3, + 1, + 2, + 0, + 0, + 0, + 2, + 2, + 2, + 0, + 0, + 6, + 0, + 0, + 9, + 4, + 1, + 0, + 18, + 0, + 0, + 3, + 0, + 0, + 1, + 1, + 0, + 0, + 0, + 0, + 2, + 0, + 1, + 4, + 1 + ], + "weighted_loads": [ + 0.2438851185142994, + 0.0, + 0.04565516859292984, + 0.0, + 0.035297367721796036, + 0.0, + 0.0, + 0.6023703496903181, + 0.03640665113925934, + 0.0, + 0.0, + 0.0, + 0.15601908415555954, + 0.04909808933734894, + 0.08965276926755905, + 0.10688110440969467, + 0.0, + 0.0, + 0.16787177696824074, + 0.1879515629261732, + 1.103770136833191, + 0.0, + 0.0, + 0.21166043356060982, + 2.2345818858593702, + 0.0, + 0.0, + 0.04357493296265602, + 0.10493066534399986, + 0.19676057249307632, + 0.03660154342651367, + 0.07587611302733421, + 0.0, + 0.0, + 0.0, + 0.20802941918373108, + 0.059361331164836884, + 0.10032525658607483, + 0.0, + 0.0, + 0.28279975801706314, + 0.0, + 0.0, + 0.8517410941421986, + 0.12957528978586197, + 0.032913729548454285, + 0.0, + 2.3284823782742023, + 0.0, + 0.0, + 0.12090972810983658, + 0.0, + 0.0, + 0.02875518426299095, + 0.04446268454194069, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0704443659633398, + 0.0, + 0.03276069089770317, + 0.16131704486906528, + 0.09465258568525314 + ], + "unique_experts": 34, + "load_cv": 1.9148542155126762, + "normalized_load_entropy": 0.7268065222713889, + "max_load_share": 0.16666666666666666 + }, + "full_input": { + "tokens": 49, + "top_k": 6, + "decisions": 294, + "ordered_route_sha256": "68f95faa8b125b1ae9f561e93aae94228625095bc9066649275c35e86b81c94a", + "route_weight_sha256": "c742c713a5784f1ad34a4ebbd707641794dfcda494881a06ce899f5bd74ca760", + "loads": [ + 5, + 0, + 4, + 0, + 1, + 5, + 1, + 11, + 8, + 0, + 8, + 0, + 6, + 1, + 4, + 2, + 0, + 1, + 3, + 6, + 16, + 0, + 4, + 4, + 33, + 0, + 0, + 1, + 12, + 9, + 2, + 3, + 2, + 5, + 7, + 2, + 4, + 5, + 0, + 0, + 7, + 2, + 5, + 10, + 4, + 3, + 0, + 23, + 0, + 0, + 11, + 6, + 4, + 5, + 1, + 0, + 0, + 0, + 7, + 2, + 2, + 19, + 5, + 3 + ], + "weighted_loads": [ + 0.28029651939868927, + 0.0, + 0.1531266737729311, + 0.0, + 0.035297367721796036, + 0.1795964390039444, + 0.04111337661743164, + 0.6932989787310362, + 0.3854682259261608, + 0.0, + 0.3168190361466259, + 0.0, + 0.15875447588041425, + 0.04909808933734894, + 0.1484614610671997, + 0.10688110440969467, + 0.0, + 0.0338713601231575, + 0.16787177696824074, + 0.2413891088217497, + 1.1367128863930702, + 0.0, + 0.2712836377322674, + 0.21166043356060982, + 2.5665875235572457, + 0.0, + 0.0, + 0.04357493296265602, + 0.46126531437039375, + 0.462519109249115, + 0.10114862024784088, + 0.1077735386788845, + 0.07957388646900654, + 0.21975275501608849, + 0.24509030673652887, + 0.20802941918373108, + 0.19468219950795174, + 1.0515230484306812, + 0.0, + 0.0, + 0.3309270516037941, + 0.12953079119324684, + 0.20443214080296457, + 0.8902532123029232, + 0.12957528978586197, + 0.12301609292626381, + 0.0, + 2.672661859309301, + 0.0, + 0.0, + 0.5045883506536484, + 0.45243171602487564, + 0.12640551291406155, + 0.21070284396409988, + 0.04446268454194069, + 0.0, + 0.0, + 0.0, + 0.2580748684704304, + 0.0704443659633398, + 0.08398478105664253, + 1.3537043943069875, + 0.1630234974436462, + 1.1129254400730133 + ], + "unique_experts": 48, + "load_cv": 1.2738174708888088, + "normalized_load_entropy": 0.8451471952448367, + "max_load_share": 0.11224489795918367 + } + }, + "s1_period": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "2e1e9f38219a7ea0986c8c719ecb538ba2f643c1aa57acdd724cb903b76a6707", + "route_weight_sha256": "94a1b7426da9a7a215db5af8ca589451e78e0cc68766d408e7bf687633da8219", + "loads": [ + 4, + 0, + 1, + 0, + 1, + 0, + 1, + 8, + 2, + 1, + 0, + 0, + 8, + 1, + 2, + 2, + 0, + 0, + 3, + 4, + 15, + 0, + 0, + 2, + 24, + 0, + 0, + 4, + 3, + 3, + 0, + 2, + 0, + 0, + 0, + 2, + 1, + 4, + 0, + 0, + 6, + 0, + 0, + 9, + 3, + 1, + 0, + 18, + 0, + 0, + 2, + 0, + 0, + 0, + 1, + 0, + 0, + 0, + 0, + 2, + 0, + 0, + 3, + 1 + ], + "weighted_loads": [ + 0.24956083297729492, + 0.0, + 0.043469756841659546, + 0.0, + 0.037444259971380234, + 0.0, + 0.030324190855026245, + 0.5481497161090374, + 0.07244126871228218, + 0.03446323797106743, + 0.0, + 0.0, + 0.23747490532696247, + 0.04301290959119797, + 0.0824873298406601, + 0.10767230577766895, + 0.0, + 0.0, + 0.16777433454990387, + 0.17932261154055595, + 1.1114135812968016, + 0.0, + 0.0, + 0.14875805005431175, + 2.0992628391832113, + 0.0, + 0.0, + 0.12471792660653591, + 0.1157397162169218, + 0.17244839295744896, + 0.0, + 0.07659976743161678, + 0.0, + 0.0, + 0.0, + 0.20402250438928604, + 0.028807008638978004, + 0.16675371676683426, + 0.0, + 0.0, + 0.27445121482014656, + 0.0, + 0.0, + 0.8688080310821533, + 0.11314960941672325, + 0.03680582344532013, + 0.0, + 2.2482003662735224, + 0.0, + 0.0, + 0.08694062381982803, + 0.0, + 0.0, + 0.0, + 0.04894063249230385, + 0.0, + 0.0, + 0.0, + 0.0, + 0.05793462507426739, + 0.0, + 0.0, + 0.13321134448051453, + 0.11388123780488968 + ], + "unique_experts": 33, + "load_cv": 1.9212907184211758, + "normalized_load_entropy": 0.723327029747883, + "max_load_share": 0.16666666666666666 + }, + "full_input": { + "tokens": 65, + "top_k": 6, + "decisions": 390, + "ordered_route_sha256": "b8796ff4808522396b2c5066b6808b901a39492f389420c5392f82084373b479", + "route_weight_sha256": "998d8da1f60d72a3822e6a1d20719da47b3d7c76459edd8429b78a8a995454cf", + "loads": [ + 4, + 0, + 2, + 1, + 3, + 10, + 2, + 10, + 11, + 4, + 7, + 2, + 12, + 1, + 4, + 2, + 1, + 0, + 4, + 7, + 20, + 0, + 8, + 3, + 33, + 1, + 0, + 5, + 24, + 8, + 0, + 5, + 0, + 6, + 6, + 4, + 9, + 8, + 1, + 0, + 7, + 8, + 4, + 12, + 4, + 4, + 0, + 25, + 0, + 0, + 10, + 13, + 6, + 6, + 3, + 2, + 0, + 0, + 16, + 2, + 4, + 22, + 10, + 4 + ], + "weighted_loads": [ + 0.24956083297729492, + 0.0, + 0.06887701712548733, + 0.11051279306411743, + 0.09834007360041142, + 0.32735693641006947, + 0.07371766492724419, + 0.6251791603863239, + 0.7092864699661732, + 0.16448936238884926, + 0.30942766717635095, + 0.06692410260438919, + 0.3236772466916591, + 0.04301290959119797, + 0.1445884220302105, + 0.10767230577766895, + 0.028885528445243835, + 0.0, + 0.20007996261119843, + 0.27284821681678295, + 1.3293210174888372, + 0.0, + 0.4850699733942747, + 0.17350618354976177, + 2.42209483217448, + 0.027373185381293297, + 0.0, + 0.16178245283663273, + 1.1559960581362247, + 0.42012082040309906, + 0.0, + 0.21546760015189648, + 0.0, + 0.3040114678442478, + 0.22202933905646205, + 0.3054840452969074, + 0.5905100982636213, + 1.160293322056532, + 0.0395742766559124, + 0.0, + 0.3887701444327831, + 0.465896038338542, + 0.11714179022237659, + 1.118493665009737, + 0.1519472897052765, + 0.18013208359479904, + 0.0, + 2.772262310376391, + 0.0, + 0.0, + 0.47338177636265755, + 0.9277749843895435, + 0.1739420536905527, + 0.38036131858825684, + 0.221891887485981, + 0.09994275495409966, + 0.0, + 0.0, + 0.6805740129202604, + 0.05793462507426739, + 0.15828434750437737, + 2.055279165972024, + 0.5153451929800212, + 1.1675628013908863 + ], + "unique_experts": 52, + "load_cv": 1.1094833573263232, + "normalized_load_entropy": 0.8699272411758832, + "max_load_share": 0.08461538461538462 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 24, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.8839285714285715, + "mean_token_weighted_tv": 0.02053979194412629, + "aggregate_load_tv": 0.0625 + }, + "system_bos": { + "tokens": 24, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8720238095238096, + "mean_token_weighted_tv": 0.023531344602815807, + "aggregate_load_tv": 0.06944444444444445 + }, + "system_x": { + "tokens": 24, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.8839285714285715, + "mean_token_weighted_tv": 0.026787157054059207, + "aggregate_load_tv": 0.0625 + }, + "system_period": { + "tokens": 24, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8561507936507936, + "mean_token_weighted_tv": 0.031486322133181, + "aggregate_load_tv": 0.0763888888888889 + }, + "bos_at_s0": { + "tokens": 24, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.9047619047619048, + "mean_token_weighted_tv": 0.021271039304944377, + "aggregate_load_tv": 0.04166666666666667 + }, + "bos_at_s1": { + "tokens": 24, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.9166666666666666, + "mean_token_weighted_tv": 0.023091531125828624, + "aggregate_load_tv": 0.04861111111111112 + }, + "x_at_s0": { + "tokens": 24, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8720238095238096, + "mean_token_weighted_tv": 0.024981030068981152, + "aggregate_load_tv": 0.034722222222222224 + }, + "x_at_s1": { + "tokens": 24, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.8988095238095237, + "mean_token_weighted_tv": 0.02851335339558621, + "aggregate_load_tv": 0.05555555555555555 + }, + "period_at_s0": { + "tokens": 24, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.8839285714285715, + "mean_token_weighted_tv": 0.023819241013067465, + "aggregate_load_tv": 0.0625 + }, + "period_at_s1": { + "tokens": 24, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 18, + "mean_set_jaccard": 0.9196428571428573, + "mean_token_weighted_tv": 0.02814975761187573, + "aggregate_load_tv": 0.04861111111111112 + } + } + }, + "layer_25": { + "layer": 25, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "e7a20bfdf59bd9d69d641d2adc3c86c8f0bca8a8f2ebdbdd459cd6f125728932", + "route_weight_sha256": "d8252da1315dc9c4985a3ebdbcf9571d570bf8a2481e678e31d5dc0c4025d603", + "loads": [ + 1, + 0, + 0, + 1, + 7, + 1, + 2, + 1, + 3, + 11, + 1, + 9, + 3, + 3, + 0, + 2, + 1, + 4, + 1, + 3, + 1, + 0, + 4, + 3, + 0, + 0, + 6, + 0, + 0, + 5, + 4, + 2, + 4, + 3, + 0, + 0, + 5, + 1, + 0, + 0, + 1, + 1, + 1, + 1, + 0, + 0, + 8, + 1, + 1, + 8, + 1, + 1, + 2, + 0, + 4, + 0, + 2, + 4, + 0, + 6, + 6, + 0, + 0, + 4 + ], + "weighted_loads": [ + 0.15000377595424652, + 0.0, + 0.0, + 0.03229092061519623, + 0.4303086958825588, + 0.0390377901494503, + 0.09211418777704239, + 0.03785209730267525, + 0.1919717825949192, + 0.861172541975975, + 0.031176481395959854, + 0.6027168668806553, + 0.22406400740146637, + 0.11751565709710121, + 0.0, + 0.16313821077346802, + 0.03262127935886383, + 0.38973062485456467, + 0.0367969386279583, + 0.5561413168907166, + 0.049907345324754715, + 0.0, + 0.32339443638920784, + 0.1294020488858223, + 0.0, + 0.0, + 0.34340205043554306, + 0.0, + 0.0, + 0.2333151139318943, + 0.15486974269151688, + 0.07724235206842422, + 0.20270708203315735, + 0.28464682400226593, + 0.0, + 0.0, + 0.42767101898789406, + 0.04136984795331955, + 0.0, + 0.0, + 0.04709913954138756, + 0.02715640515089035, + 0.07030855864286423, + 0.036683984100818634, + 0.0, + 0.0, + 0.6315342336893082, + 0.044329188764095306, + 0.08713335543870926, + 0.39421706832945347, + 0.03002503141760826, + 0.03161061927676201, + 0.09544925391674042, + 0.0, + 0.15956412628293037, + 0.0, + 0.0833447240293026, + 0.2967780977487564, + 0.0, + 0.39693189412355423, + 0.4922563508152962, + 0.0, + 0.0, + 0.13257386907935143 + ], + "unique_experts": 45, + "load_cv": 1.1331154474650633, + "normalized_load_entropy": 0.8494869351394254, + "max_load_share": 0.0763888888888889 + }, + "full_input": { + "tokens": 49, + "top_k": 6, + "decisions": 294, + "ordered_route_sha256": "32b1caa19ad75f2e86c1445eb336ead0f2b277eb159a63a774f7b2d05a5d7334", + "route_weight_sha256": "0280b73fbb43127fb08ac399f79ffd7d05a06719d47e263397514fc3626425a4", + "loads": [ + 3, + 17, + 7, + 2, + 7, + 1, + 9, + 1, + 3, + 11, + 10, + 13, + 7, + 3, + 0, + 2, + 1, + 8, + 4, + 3, + 1, + 0, + 4, + 5, + 0, + 0, + 6, + 1, + 1, + 7, + 7, + 4, + 5, + 4, + 2, + 0, + 5, + 2, + 11, + 3, + 7, + 1, + 1, + 2, + 3, + 9, + 11, + 1, + 1, + 10, + 11, + 1, + 7, + 0, + 13, + 0, + 3, + 8, + 0, + 6, + 8, + 0, + 6, + 5 + ], + "weighted_loads": [ + 0.25857874006032944, + 1.2323915106244385, + 0.5108126290142536, + 0.08737426996231079, + 0.4303086958825588, + 0.0390377901494503, + 0.5729887634515762, + 0.03785209730267525, + 0.1919717825949192, + 0.861172541975975, + 0.939354382455349, + 1.2561380970291793, + 0.5056683011353016, + 0.11751565709710121, + 0.0, + 0.16313821077346802, + 0.03262127935886383, + 0.5190700478851795, + 0.14617852866649628, + 0.5561413168907166, + 0.049907345324754715, + 0.0, + 0.32339443638920784, + 0.22141913324594498, + 0.0, + 0.0, + 0.34340205043554306, + 0.04854532331228256, + 0.04210519418120384, + 0.30471091344952583, + 0.3166583590209484, + 0.2264837585389614, + 0.25359855592250824, + 0.34397100657224655, + 0.10002541914582253, + 0.0, + 0.42767101898789406, + 0.080856803804636, + 1.4583640787750483, + 0.3512429818511009, + 0.30398815870285034, + 0.02715640515089035, + 0.07030855864286423, + 0.06945965066552162, + 0.24614732339978218, + 0.7296773288398981, + 0.722483818535693, + 0.044329188764095306, + 0.08713335543870926, + 0.4835261795669794, + 0.6243255734443665, + 0.03161061927676201, + 0.36414645006880164, + 0.0, + 0.6464379478711635, + 0.0, + 0.12437599897384644, + 0.4760640971362591, + 0.0, + 0.39693189412355423, + 0.5938643552362919, + 0.0, + 0.44858062267303467, + 0.1812787540256977 + ], + "unique_experts": 55, + "load_cv": 0.8705091083040631, + "normalized_load_entropy": 0.9021999289447403, + "max_load_share": 0.05782312925170068 + } + }, + "s1_eos": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "5b4d5be9d9cec7730a651a181df765791d27578d68b8d66528e77cb3b1108fe8", + "route_weight_sha256": "8a06e89bd91102c25c422ddbc129b0b40891137b9d3ebb68d2673c7c1a153249", + "loads": [ + 1, + 0, + 0, + 1, + 6, + 1, + 2, + 1, + 3, + 10, + 0, + 9, + 3, + 3, + 0, + 3, + 1, + 4, + 1, + 3, + 1, + 0, + 4, + 3, + 0, + 0, + 6, + 0, + 0, + 4, + 5, + 1, + 4, + 3, + 0, + 0, + 5, + 1, + 1, + 3, + 1, + 2, + 1, + 1, + 0, + 0, + 6, + 1, + 1, + 8, + 1, + 1, + 2, + 0, + 4, + 0, + 2, + 4, + 0, + 6, + 6, + 1, + 0, + 3 + ], + "weighted_loads": [ + 0.14476336538791656, + 0.0, + 0.0, + 0.03702656179666519, + 0.37370035983622074, + 0.03708435222506523, + 0.09155995771288872, + 0.03585576266050339, + 0.17848032154142857, + 0.7759427651762962, + 0.0, + 0.6071597971022129, + 0.23302165791392326, + 0.12395160272717476, + 0.0, + 0.19628144428133965, + 0.03340240195393562, + 0.3970023803412914, + 0.03670945391058922, + 0.5548001006245613, + 0.05822407081723213, + 0.0, + 0.3018033429980278, + 0.11850868351757526, + 0.0, + 0.0, + 0.34316470474004745, + 0.0, + 0.0, + 0.20820731297135353, + 0.1893886923789978, + 0.04241248592734337, + 0.2020905204117298, + 0.28428640961647034, + 0.0, + 0.0, + 0.41916822269558907, + 0.03863077983260155, + 0.039685774594545364, + 0.11431161686778069, + 0.045096755027770996, + 0.06111552566289902, + 0.06651531159877777, + 0.036512915045022964, + 0.0, + 0.0, + 0.5173076018691063, + 0.046397313475608826, + 0.0884978324174881, + 0.40600911155343056, + 0.03201787546277046, + 0.031535226851701736, + 0.09323027357459068, + 0.0, + 0.1571192741394043, + 0.0, + 0.08762823045253754, + 0.29923172295093536, + 0.0, + 0.3918893598020077, + 0.4609021134674549, + 0.03481568396091461, + 0.0, + 0.10821432806551456 + ], + "unique_experts": 47, + "load_cv": 1.057016532802247, + "normalized_load_entropy": 0.864766725411874, + "max_load_share": 0.06944444444444445 + }, + "full_input": { + "tokens": 65, + "top_k": 6, + "decisions": 390, + "ordered_route_sha256": "97109af59930219de59993e32e243b1faa25a8aff7882bfdbcc2c07c9b493d54", + "route_weight_sha256": "f13667b0ead1eda813c72629ef69c43e866599988310540a70132a8f4c7c4ce1", + "loads": [ + 4, + 23, + 10, + 2, + 6, + 2, + 9, + 1, + 5, + 11, + 22, + 13, + 11, + 3, + 0, + 3, + 1, + 12, + 4, + 4, + 4, + 7, + 4, + 8, + 0, + 0, + 6, + 1, + 1, + 7, + 9, + 4, + 9, + 4, + 3, + 0, + 6, + 7, + 11, + 8, + 8, + 2, + 2, + 2, + 8, + 14, + 8, + 1, + 1, + 9, + 13, + 1, + 9, + 7, + 17, + 1, + 4, + 9, + 0, + 7, + 10, + 2, + 5, + 5 + ], + "weighted_loads": [ + 0.4055970013141632, + 1.83183957869187, + 0.585036750882864, + 0.11058592051267624, + 0.37370035983622074, + 0.07788201048970222, + 0.6976112015545368, + 0.03585576266050339, + 0.29314627312123775, + 0.8043519370257854, + 1.9300554599612951, + 1.3257611840963364, + 0.7043829672038555, + 0.12395160272717476, + 0.0, + 0.19628144428133965, + 0.03340240195393562, + 1.0408250577747822, + 0.1944432221353054, + 0.5788191221654415, + 0.3168652169406414, + 0.6447991412132978, + 0.3018033429980278, + 0.31398930214345455, + 0.0, + 0.0, + 0.34316470474004745, + 0.0471867173910141, + 0.04641503840684891, + 0.3132566660642624, + 0.3949926346540451, + 0.5049219988286495, + 0.43188838846981525, + 0.3314450979232788, + 0.15311324223876, + 0.0, + 0.461783692240715, + 0.3121392894536257, + 1.7261309288442135, + 0.5724842958152294, + 0.3946673162281513, + 0.06111552566289902, + 0.15215303748846054, + 0.06622093170881271, + 0.5956728234887123, + 1.221772599965334, + 0.5615532486699522, + 0.046397313475608826, + 0.0884978324174881, + 0.450010284781456, + 0.7460514511913061, + 0.031535226851701736, + 0.5306324171833694, + 0.5020045526325703, + 1.0664414272177964, + 0.026911862194538116, + 0.17230906151235104, + 0.5226871259510517, + 0.0, + 0.47866691276431084, + 0.7019748911261559, + 0.07800434902310371, + 0.42681573145091534, + 0.19395452551543713 + ], + "unique_experts": 59, + "load_cv": 0.8172853189496782, + "normalized_load_entropy": 0.9192446560970818, + "max_load_share": 0.05897435897435897 + } + }, + "s0_bos": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "c2b863b3087df5bd153ee8d90fe140879b70844eaa8ab05e65a6582da66815a7", + "route_weight_sha256": "58531d7f28bf1d0533f1076fea39dc0a3fbf32f11937c608870167e023ac2a5e", + "loads": [ + 1, + 0, + 0, + 1, + 8, + 1, + 2, + 3, + 3, + 10, + 0, + 8, + 3, + 2, + 0, + 2, + 1, + 4, + 1, + 3, + 1, + 0, + 6, + 3, + 0, + 0, + 6, + 0, + 0, + 4, + 3, + 2, + 4, + 3, + 1, + 0, + 6, + 1, + 0, + 0, + 1, + 2, + 1, + 1, + 1, + 0, + 7, + 1, + 1, + 7, + 1, + 1, + 2, + 0, + 5, + 0, + 1, + 4, + 0, + 5, + 6, + 1, + 0, + 3 + ], + "weighted_loads": [ + 0.1650722771883011, + 0.0, + 0.0, + 0.03337312489748001, + 0.4592787306755781, + 0.040935371071100235, + 0.08731387183070183, + 0.10215995833277702, + 0.20088837668299675, + 0.7514735721051693, + 0.0, + 0.5657228603959084, + 0.2329297587275505, + 0.09192427061498165, + 0.0, + 0.14400158822536469, + 0.03558474779129028, + 0.40034959837794304, + 0.04045345261693001, + 0.5512777492403984, + 0.053241997957229614, + 0.0, + 0.44172360748052597, + 0.11943302676081657, + 0.0, + 0.0, + 0.3344462104141712, + 0.0, + 0.0, + 0.2058422788977623, + 0.10612938925623894, + 0.07663307711482048, + 0.18536347150802612, + 0.30556487292051315, + 0.031084150075912476, + 0.0, + 0.5004775933921337, + 0.04439287260174751, + 0.0, + 0.0, + 0.04742633178830147, + 0.05244298093020916, + 0.07329487055540085, + 0.03505440801382065, + 0.025645924732089043, + 0.0, + 0.6051783338189125, + 0.04549882560968399, + 0.08762407302856445, + 0.3619508631527424, + 0.030839214101433754, + 0.0337129607796669, + 0.0924193374812603, + 0.0, + 0.20321517251431942, + 0.0, + 0.04399660974740982, + 0.29976125806570053, + 0.0, + 0.3565661497414112, + 0.5060718692839146, + 0.03202517330646515, + 0.0, + 0.10436041466891766 + ], + "unique_experts": 47, + "load_cv": 1.0743933114340953, + "normalized_load_entropy": 0.8618628117668101, + "max_load_share": 0.06944444444444445 + }, + "full_input": { + "tokens": 49, + "top_k": 6, + "decisions": 294, + "ordered_route_sha256": "a39c4c72dfa1267affee30b60c881caaafe6b9546f086f395f33e245a4ed825b", + "route_weight_sha256": "b17a0aa2c7e76bca85f64af27c794f9fddaf031bda53034e72fd9ec6661f68c6", + "loads": [ + 2, + 16, + 7, + 2, + 8, + 1, + 9, + 4, + 3, + 10, + 9, + 10, + 8, + 2, + 0, + 2, + 1, + 8, + 3, + 3, + 1, + 0, + 6, + 6, + 0, + 0, + 6, + 0, + 1, + 6, + 6, + 4, + 5, + 4, + 3, + 0, + 7, + 1, + 10, + 2, + 7, + 3, + 1, + 4, + 6, + 8, + 9, + 1, + 1, + 10, + 12, + 1, + 7, + 0, + 15, + 0, + 1, + 8, + 0, + 5, + 7, + 1, + 6, + 5 + ], + "weighted_loads": [ + 0.2213738150894642, + 1.162237845826894, + 0.5016615241765976, + 0.16655226796865463, + 0.4592787306755781, + 0.040935371071100235, + 0.5705019198358059, + 0.1513681523501873, + 0.20088837668299675, + 0.7514735721051693, + 1.0127885714173317, + 1.1721034534275532, + 0.5480651520192623, + 0.09192427061498165, + 0.0, + 0.14400158822536469, + 0.03558474779129028, + 0.5296890214085579, + 0.14631619304418564, + 0.5512777492403984, + 0.053241997957229614, + 0.0, + 0.44172360748052597, + 0.25060858577489853, + 0.0, + 0.0, + 0.3344462104141712, + 0.0, + 0.04210519418120384, + 0.2710043415427208, + 0.4285670891404152, + 0.2544492743909359, + 0.23625494539737701, + 0.3648890554904938, + 0.14189723879098892, + 0.0, + 0.5595640242099762, + 0.04439287260174751, + 0.5491209719330072, + 0.42291663587093353, + 0.30431535094976425, + 0.09249957837164402, + 0.07329487055540085, + 0.1418205164372921, + 0.34500260278582573, + 0.6673314180225134, + 0.6947950646281242, + 0.04549882560968399, + 0.08762407302856445, + 0.4759894199669361, + 0.6624764036387205, + 0.0337129607796669, + 0.43439099937677383, + 0.0, + 0.7521716423798352, + 0.0, + 0.04399660974740982, + 0.4646110311150551, + 0.0, + 0.3565661497414112, + 0.5589481256902218, + 0.03202517330646515, + 0.44858062267303467, + 0.19506113417446613 + ], + "unique_experts": 55, + "load_cv": 0.8384474478577627, + "normalized_load_entropy": 0.9065682853561452, + "max_load_share": 0.05442176870748299 + } + }, + "s1_bos": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "87547382a5748fcdfb65345e30afc35e51bcdff7225ce048e2c09ec20c4b54f3", + "route_weight_sha256": "f290ba2d35a6604bcfdf6ac7619e4ffb82c2f3fd916465f2fc14f783c4baddf7", + "loads": [ + 1, + 0, + 0, + 1, + 6, + 1, + 2, + 3, + 3, + 10, + 0, + 8, + 3, + 2, + 0, + 3, + 1, + 4, + 1, + 3, + 1, + 0, + 6, + 3, + 0, + 0, + 6, + 0, + 0, + 3, + 4, + 1, + 4, + 3, + 1, + 0, + 5, + 1, + 0, + 2, + 1, + 1, + 1, + 1, + 0, + 0, + 7, + 1, + 2, + 8, + 1, + 1, + 2, + 0, + 4, + 1, + 1, + 4, + 0, + 6, + 7, + 1, + 0, + 2 + ], + "weighted_loads": [ + 0.1528865098953247, + 0.0, + 0.0, + 0.03146807476878166, + 0.3892763815820217, + 0.03931889683008194, + 0.0933365747332573, + 0.11267131567001343, + 0.18463052809238434, + 0.7535985074937344, + 0.0, + 0.587847463786602, + 0.24444566294550896, + 0.08724868670105934, + 0.0, + 0.19650528579950333, + 0.03715190291404724, + 0.39595018327236176, + 0.03932230547070503, + 0.5358821228146553, + 0.060074009001255035, + 0.0, + 0.4266775920987129, + 0.12237338908016682, + 0.0, + 0.0, + 0.33555993996560574, + 0.0, + 0.0, + 0.15841060131788254, + 0.14154231548309326, + 0.04047257453203201, + 0.1948828510940075, + 0.28321365267038345, + 0.03215603530406952, + 0.0, + 0.4330087639391422, + 0.04404504969716072, + 0.0, + 0.06541674956679344, + 0.04550669714808464, + 0.02595541626214981, + 0.06932646036148071, + 0.035721030086278915, + 0.0, + 0.0, + 0.6549800783395767, + 0.046023350208997726, + 0.12608890607953072, + 0.396150266751647, + 0.027559908106923103, + 0.0335129015147686, + 0.091257493942976, + 0.0, + 0.15767791867256165, + 0.025977633893489838, + 0.03937395662069321, + 0.2938748672604561, + 0.0, + 0.39710937812924385, + 0.49580613151192665, + 0.03148878738284111, + 0.0, + 0.07898444309830666 + ], + "unique_experts": 48, + "load_cv": 1.0628403594282774, + "normalized_load_entropy": 0.8660406363900007, + "max_load_share": 0.06944444444444445 + }, + "full_input": { + "tokens": 65, + "top_k": 6, + "decisions": 390, + "ordered_route_sha256": "79dcedd319adc5b1f76130ce0795dcdd233717d1d63d094b2a1ec8e455082efd", + "route_weight_sha256": "1169bb27e8ffd4fd67501aa0acabfe1fd06f0b9255588c99c8c82789aaf5297e", + "loads": [ + 3, + 23, + 11, + 2, + 6, + 2, + 9, + 3, + 7, + 11, + 25, + 10, + 12, + 2, + 0, + 3, + 1, + 12, + 3, + 4, + 4, + 7, + 6, + 9, + 0, + 0, + 6, + 0, + 1, + 6, + 6, + 5, + 10, + 4, + 4, + 0, + 6, + 7, + 9, + 6, + 8, + 1, + 2, + 2, + 8, + 12, + 8, + 1, + 2, + 11, + 13, + 1, + 8, + 7, + 17, + 2, + 3, + 9, + 0, + 7, + 10, + 2, + 5, + 6 + ], + "weighted_loads": [ + 0.34864456951618195, + 1.7788701900281012, + 0.6926168464124203, + 0.08603610098361969, + 0.3892763815820217, + 0.08011655509471893, + 0.6900853998959064, + 0.11267131567001343, + 0.3831675983965397, + 0.7820076793432236, + 2.2074303720146418, + 1.2309826985001564, + 0.7793670035898685, + 0.08724868670105934, + 0.0, + 0.19650528579950333, + 0.03715190291404724, + 1.0397728607058525, + 0.1742449514567852, + 0.5599011443555355, + 0.3187151551246643, + 0.6447991412132978, + 0.4266775920987129, + 0.35456489957869053, + 0.0, + 0.0, + 0.33555993996560574, + 0.0, + 0.04641503840684891, + 0.2627091631293297, + 0.2641333192586899, + 0.5537208952009678, + 0.47227959521114826, + 0.3303723409771919, + 0.185499619692564, + 0.0, + 0.4756242334842682, + 0.3281203079968691, + 0.7847755923867226, + 0.5139869675040245, + 0.39507725834846497, + 0.02595541626214981, + 0.15496418625116348, + 0.06542904675006866, + 0.5767794400453568, + 1.0744945704936981, + 0.6978963427245617, + 0.046023350208997726, + 0.12608890607953072, + 0.5205529797822237, + 0.7415934838354588, + 0.0335129015147686, + 0.5244746804237366, + 0.5020045526325703, + 1.0178244889248163, + 0.052889496088027954, + 0.13923650421202183, + 0.5353609472513199, + 0.0, + 0.483886931091547, + 0.6751742288470268, + 0.07467745244503021, + 0.42681573145091534, + 0.24322320893406868 + ], + "unique_experts": 58, + "load_cv": 0.8305634439650104, + "normalized_load_entropy": 0.9182921072161196, + "max_load_share": 0.0641025641025641 + } + }, + "s0_x": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "ac3391560fcd42e40381f14342f821790b9b616cc090ada43abb2f89160cf40c", + "route_weight_sha256": "5426f121438240c1c7067c32b8c44a65503a66db9d6bd30453acf45fe547b33f", + "loads": [ + 1, + 0, + 0, + 1, + 5, + 1, + 2, + 2, + 3, + 10, + 1, + 10, + 3, + 3, + 0, + 3, + 1, + 4, + 1, + 3, + 1, + 0, + 6, + 2, + 0, + 0, + 6, + 0, + 0, + 3, + 5, + 1, + 4, + 3, + 0, + 0, + 6, + 1, + 1, + 2, + 1, + 0, + 1, + 1, + 0, + 0, + 6, + 1, + 1, + 7, + 1, + 1, + 2, + 0, + 5, + 0, + 1, + 4, + 0, + 6, + 6, + 1, + 0, + 4 + ], + "weighted_loads": [ + 0.17252027988433838, + 0.0, + 0.0, + 0.03139078989624977, + 0.34197005815804005, + 0.045663755387067795, + 0.08743996173143387, + 0.08070972189307213, + 0.19969919323921204, + 0.7540867514908314, + 0.03618355095386505, + 0.64328658208251, + 0.23023071512579918, + 0.116905577480793, + 0.0, + 0.20362262055277824, + 0.03370002657175064, + 0.3911401517689228, + 0.042959507554769516, + 0.5453976914286613, + 0.05160452425479889, + 0.0, + 0.41738642007112503, + 0.08099881000816822, + 0.0, + 0.0, + 0.3452365845441818, + 0.0, + 0.0, + 0.13825267553329468, + 0.18466169014573097, + 0.03686634823679924, + 0.19976627826690674, + 0.32319166511297226, + 0.0, + 0.0, + 0.4758913628757, + 0.0441587008535862, + 0.039990536868572235, + 0.06176372617483139, + 0.051594074815511703, + 0.0, + 0.07266201078891754, + 0.03473017364740372, + 0.0, + 0.0, + 0.46751102060079575, + 0.044416673481464386, + 0.08571302890777588, + 0.3575561083853245, + 0.030366791412234306, + 0.03337962180376053, + 0.09970538690686226, + 0.0, + 0.19353497587144375, + 0.0, + 0.05158315598964691, + 0.3120148256421089, + 0.0, + 0.3854227587580681, + 0.4955214560031891, + 0.03277399018406868, + 0.0, + 0.1343220490962267 + ], + "unique_experts": 47, + "load_cv": 1.0858233492051148, + "normalized_load_entropy": 0.8601937151517666, + "max_load_share": 0.06944444444444445 + }, + "full_input": { + "tokens": 49, + "top_k": 6, + "decisions": 294, + "ordered_route_sha256": "7f0eeeef98d6746ddfe1e37d136dbb48fbebd2b7bb73d8117ae5a2e5c5144432", + "route_weight_sha256": "a6d660b4f5b2256c4aab05147fac392527616df22be050dd610e6a5f914bf8c7", + "loads": [ + 3, + 18, + 5, + 2, + 5, + 1, + 11, + 2, + 3, + 10, + 12, + 13, + 7, + 3, + 0, + 3, + 1, + 8, + 5, + 3, + 1, + 0, + 6, + 5, + 0, + 0, + 6, + 0, + 1, + 5, + 7, + 3, + 5, + 4, + 1, + 0, + 7, + 1, + 12, + 4, + 8, + 0, + 1, + 2, + 3, + 7, + 8, + 1, + 2, + 8, + 11, + 1, + 8, + 0, + 15, + 0, + 1, + 8, + 0, + 6, + 7, + 1, + 7, + 6 + ], + "weighted_loads": [ + 0.2661488801240921, + 1.3354588304646313, + 0.35188719257712364, + 0.06636154279112816, + 0.34197005815804005, + 0.045663755387067795, + 0.6999780349433422, + 0.08070972189307213, + 0.19969919323921204, + 0.7540867514908314, + 1.0230695605278015, + 1.3041178546845913, + 0.5245711542665958, + 0.116905577480793, + 0.0, + 0.20362262055277824, + 0.03370002657175064, + 0.5204795747995377, + 0.18122624047100544, + 0.5453976914286613, + 0.05160452425479889, + 0.0, + 0.41738642007112503, + 0.2083867061883211, + 0.0, + 0.0, + 0.3452365845441818, + 0.0, + 0.04210519418120384, + 0.20236723124980927, + 0.29645758122205734, + 0.2290041483938694, + 0.25065775215625763, + 0.3825158476829529, + 0.06108632683753967, + 0.0, + 0.5371569991111755, + 0.0441587008535862, + 0.7024243269115686, + 0.46354348212480545, + 0.35551199689507484, + 0.0, + 0.07266201078891754, + 0.0675058402121067, + 0.24614732339978218, + 0.6399338822811842, + 0.5571277514100075, + 0.044416673481464386, + 0.1269255466759205, + 0.4175410568714142, + 0.6246673334389925, + 0.03337962180376053, + 0.5614577233791351, + 0.0, + 0.7321212508250028, + 0.0, + 0.05158315598964691, + 0.4915805011987686, + 0.0, + 0.3854227587580681, + 0.5483977124094963, + 0.03277399018406868, + 0.48746879771351814, + 0.2710843440145254 + ], + "unique_experts": 54, + "load_cv": 0.8989635693939985, + "normalized_load_entropy": 0.8972108874173886, + "max_load_share": 0.061224489795918366 + } + }, + "s1_x": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "5e8bde6051a9c54c93e3af4627176aa900454eceb6fef9861e05a139f258847d", + "route_weight_sha256": "acdd0f4574cb134f377c27b4dcf5939f3b1d3cf659919a442dc86e32489f99b4", + "loads": [ + 1, + 0, + 0, + 1, + 6, + 1, + 2, + 4, + 3, + 10, + 2, + 8, + 3, + 3, + 0, + 2, + 1, + 5, + 1, + 3, + 1, + 0, + 6, + 2, + 0, + 0, + 6, + 0, + 0, + 4, + 3, + 1, + 4, + 3, + 0, + 0, + 5, + 1, + 1, + 3, + 1, + 0, + 1, + 0, + 0, + 0, + 5, + 1, + 2, + 6, + 1, + 1, + 3, + 0, + 4, + 1, + 1, + 4, + 0, + 6, + 6, + 1, + 0, + 4 + ], + "weighted_loads": [ + 0.17856107652187347, + 0.0, + 0.0, + 0.044575318694114685, + 0.39294517785310745, + 0.040654752403497696, + 0.08683770149946213, + 0.1581082120537758, + 0.18202940002083778, + 0.7024290300905704, + 0.10012494772672653, + 0.5813779607415199, + 0.2134731113910675, + 0.12193262949585915, + 0.0, + 0.17477857321500778, + 0.03126635402441025, + 0.4267671965062618, + 0.04356588423252106, + 0.5559783652424812, + 0.062232136726379395, + 0.0, + 0.38514069467782974, + 0.07363399118185043, + 0.0, + 0.0, + 0.36562491580843925, + 0.0, + 0.0, + 0.18231574073433876, + 0.10466040298342705, + 0.03330978751182556, + 0.18943149968981743, + 0.309368833899498, + 0.0, + 0.0, + 0.4221354238688946, + 0.03691995143890381, + 0.039493951946496964, + 0.11924617551267147, + 0.04635331407189369, + 0.0, + 0.06737823784351349, + 0.0, + 0.0, + 0.0, + 0.3818780090659857, + 0.043600894510746, + 0.1097040418535471, + 0.32442910596728325, + 0.031537022441625595, + 0.035071924328804016, + 0.12384520471096039, + 0.0, + 0.1595424972474575, + 0.027996931225061417, + 0.06608900427818298, + 0.2968675084412098, + 0.0, + 0.40066836029291153, + 0.4591958522796631, + 0.0333271361887455, + 0.0, + 0.14325098134577274 + ], + "unique_experts": 47, + "load_cv": 1.0183501544346312, + "normalized_load_entropy": 0.8695870923521292, + "max_load_share": 0.06944444444444445 + }, + "full_input": { + "tokens": 65, + "top_k": 6, + "decisions": 390, + "ordered_route_sha256": "cebd2e9b5949572e5d7ccd6ef65677392d11b8c8dd0d52a379d822315feebef9", + "route_weight_sha256": "8cef6f70b609f4223c778f0e1cbf30effc2d3b3297e5c1dfbc7244e15f934ca2", + "loads": [ + 3, + 25, + 10, + 1, + 6, + 2, + 11, + 4, + 5, + 11, + 27, + 11, + 10, + 3, + 0, + 2, + 1, + 14, + 3, + 4, + 4, + 7, + 6, + 8, + 0, + 0, + 6, + 0, + 1, + 6, + 5, + 5, + 9, + 4, + 2, + 0, + 6, + 6, + 11, + 7, + 8, + 0, + 2, + 1, + 8, + 14, + 6, + 1, + 2, + 6, + 15, + 1, + 11, + 7, + 18, + 2, + 2, + 10, + 0, + 7, + 10, + 2, + 5, + 6 + ], + "weighted_loads": [ + 0.3743191361427307, + 1.9617437371052802, + 0.527865432202816, + 0.044575318694114685, + 0.39294517785310745, + 0.08145241066813469, + 0.8930746540427208, + 0.1581082120537758, + 0.296695351600647, + 0.7308382019400597, + 2.212416796013713, + 1.2744756266474724, + 0.6292666979134083, + 0.12193262949585915, + 0.0, + 0.17477857321500778, + 0.03126635402441025, + 1.116935521364212, + 0.14222050458192825, + 0.5799973867833614, + 0.32087328284978867, + 0.6447991412132978, + 0.38514069467782974, + 0.3068442717194557, + 0.0, + 0.0, + 0.36562491580843925, + 0.0, + 0.04641503840684891, + 0.2526426687836647, + 0.20333772525191307, + 0.600477784872055, + 0.41922936774790287, + 0.35652752220630646, + 0.10444284602999687, + 0.0, + 0.46475089341402054, + 0.2574931290000677, + 0.88355378434062, + 0.5739711690694094, + 0.395923875272274, + 0.0, + 0.15301596373319626, + 0.02970801666378975, + 0.567243006080389, + 1.2073420323431492, + 0.42479427345097065, + 0.043600894510746, + 0.1097040418535471, + 0.32442910596728325, + 0.8883729260414839, + 0.035071924328804016, + 0.7141142822802067, + 0.5020045526325703, + 1.0840822078753263, + 0.05490879341959953, + 0.09636629559099674, + 0.580892650410533, + 0.0, + 0.4874459132552147, + 0.6760597378015518, + 0.0765158012509346, + 0.42681573145091534, + 0.3344148676842451 + ], + "unique_experts": 57, + "load_cv": 0.9047613115627365, + "normalized_load_entropy": 0.906641103926301, + "max_load_share": 0.06923076923076923 + } + }, + "s0_period": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "4c4536c55f1dd33f52d518c50258ec84f37711445f6caca81fddb75e967e3494", + "route_weight_sha256": "0f68d3b036c8dd1e85f0f57f7606a0264fe4aa16a5148b282e6f8cb14ac7ce9c", + "loads": [ + 1, + 0, + 0, + 1, + 5, + 1, + 2, + 3, + 3, + 10, + 1, + 9, + 3, + 2, + 0, + 3, + 1, + 4, + 1, + 3, + 1, + 0, + 6, + 2, + 0, + 0, + 6, + 0, + 0, + 2, + 5, + 1, + 5, + 3, + 0, + 0, + 6, + 1, + 0, + 0, + 1, + 1, + 1, + 1, + 1, + 0, + 8, + 1, + 1, + 7, + 1, + 1, + 2, + 0, + 5, + 1, + 1, + 4, + 0, + 6, + 6, + 0, + 0, + 4 + ], + "weighted_loads": [ + 0.16360940039157867, + 0.0, + 0.0, + 0.032879967242479324, + 0.35421259328722954, + 0.04387640580534935, + 0.08997596427798271, + 0.11556370556354523, + 0.19861508533358574, + 0.795572642236948, + 0.035926930606365204, + 0.5955377575010061, + 0.23248763009905815, + 0.09328261762857437, + 0.0, + 0.18329401314258575, + 0.033672939985990524, + 0.38980070129036903, + 0.04408746212720871, + 0.5230148509144783, + 0.05274075269699097, + 0.0, + 0.4278606101870537, + 0.07931192591786385, + 0.0, + 0.0, + 0.3488220665603876, + 0.0, + 0.0, + 0.10556139051914215, + 0.18322372436523438, + 0.0417998842895031, + 0.23632416129112244, + 0.30761320143938065, + 0.0, + 0.0, + 0.4762488193809986, + 0.045115988701581955, + 0.0, + 0.0, + 0.049967654049396515, + 0.024974264204502106, + 0.07235531508922577, + 0.03459469974040985, + 0.025439148768782616, + 0.0, + 0.5975757129490376, + 0.041778046637773514, + 0.08874721825122833, + 0.357868917286396, + 0.029459767043590546, + 0.032759588211774826, + 0.09408732503652573, + 0.0, + 0.1942823827266693, + 0.026324331760406494, + 0.04556160792708397, + 0.30266786366701126, + 0.0, + 0.3898731954395771, + 0.49424314871430397, + 0.0, + 0.0, + 0.13647065125405788 + ], + "unique_experts": 47, + "load_cv": 1.0999438818457405, + "normalized_load_entropy": 0.8571207729850377, + "max_load_share": 0.06944444444444445 + }, + "full_input": { + "tokens": 49, + "top_k": 6, + "decisions": 294, + "ordered_route_sha256": "18534e41ce3bb802e3c5aa252fcb78cbf34336b146bfa86154e3931d43276999", + "route_weight_sha256": "a68ee9225136a12ed0e301316be88af5d29b93b2dc65a6a864a3276d43e91dd8", + "loads": [ + 3, + 18, + 7, + 1, + 5, + 1, + 9, + 3, + 3, + 10, + 13, + 12, + 8, + 3, + 0, + 4, + 1, + 8, + 4, + 3, + 1, + 0, + 6, + 4, + 0, + 0, + 6, + 0, + 1, + 4, + 6, + 3, + 6, + 4, + 2, + 0, + 7, + 1, + 10, + 2, + 7, + 1, + 1, + 2, + 4, + 8, + 11, + 1, + 1, + 8, + 11, + 1, + 8, + 0, + 15, + 1, + 1, + 8, + 0, + 6, + 8, + 0, + 6, + 6 + ], + "weighted_loads": [ + 0.27063341438770294, + 1.3704665233381093, + 0.42552835308015347, + 0.032879967242479324, + 0.35421259328722954, + 0.04387640580534935, + 0.5800574608147144, + 0.11556370556354523, + 0.19861508533358574, + 0.795572642236948, + 1.124739732593298, + 1.2557456251233816, + 0.5734303593635559, + 0.13494951277971268, + 0.0, + 0.2228609137237072, + 0.033672939985990524, + 0.5191401243209839, + 0.1473180428147316, + 0.5230148509144783, + 0.05274075269699097, + 0.0, + 0.4278606101870537, + 0.17132901027798653, + 0.0, + 0.0, + 0.3488220665603876, + 0.0, + 0.04210519418120384, + 0.17345517128705978, + 0.2519943043589592, + 0.1844186782836914, + 0.2872156351804733, + 0.36693738400936127, + 0.1070016399025917, + 0.0, + 0.5544400177896023, + 0.045115988701581955, + 0.5491209719330072, + 0.4558692127466202, + 0.3068566732108593, + 0.024974264204502106, + 0.07235531508922577, + 0.06737036630511284, + 0.2715864721685648, + 0.7680130694061518, + 0.723402626812458, + 0.041778046637773514, + 0.08874721825122833, + 0.4170405901968479, + 0.6237603090703487, + 0.032759588211774826, + 0.46719859912991524, + 0.0, + 0.7002517592627555, + 0.026324331760406494, + 0.04556160792708397, + 0.4788946397602558, + 0.0, + 0.3898731954395771, + 0.5953115299344063, + 0.0, + 0.44858062267303467, + 0.37447202019393444 + ], + "unique_experts": 55, + "load_cv": 0.8948358379191523, + "normalized_load_entropy": 0.8986276460746311, + "max_load_share": 0.061224489795918366 + } + }, + "s1_period": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "b70201ab977fe7c0361297737215a5166522932f8b929b330f146ba202fa92ff", + "route_weight_sha256": "89bd202faae6ac3af2de5bc9b720247a4aaa2c0c2e5281236aee57d0ba174e55", + "loads": [ + 1, + 0, + 0, + 1, + 5, + 1, + 2, + 4, + 3, + 9, + 1, + 7, + 3, + 2, + 0, + 3, + 1, + 5, + 1, + 3, + 1, + 0, + 6, + 2, + 0, + 0, + 6, + 0, + 0, + 2, + 5, + 1, + 4, + 3, + 1, + 0, + 5, + 1, + 0, + 3, + 1, + 0, + 1, + 0, + 0, + 0, + 7, + 1, + 2, + 7, + 1, + 2, + 3, + 0, + 4, + 1, + 1, + 4, + 0, + 6, + 6, + 0, + 1, + 4 + ], + "weighted_loads": [ + 0.1810809075832367, + 0.0, + 0.0, + 0.044186823070049286, + 0.35675453767180443, + 0.045965757220983505, + 0.08575373515486717, + 0.16680847853422165, + 0.17845972254872322, + 0.6533278711140156, + 0.04145011305809021, + 0.5270124897360802, + 0.21456097811460495, + 0.09796041250228882, + 0.0, + 0.2165888249874115, + 0.032806478440761566, + 0.440207801759243, + 0.04137028381228447, + 0.5473830103874207, + 0.06587442755699158, + 0.0, + 0.37622153386473656, + 0.07756160572171211, + 0.0, + 0.0, + 0.36378139816224575, + 0.0, + 0.0, + 0.09807176515460014, + 0.18452660366892815, + 0.03570882976055145, + 0.18943465128540993, + 0.3157544806599617, + 0.03170052170753479, + 0.0, + 0.4208531603217125, + 0.0383724719285965, + 0.0, + 0.12433324009180069, + 0.04587592929601669, + 0.0, + 0.0662207156419754, + 0.0, + 0.0, + 0.0, + 0.4924131724983454, + 0.04667644202709198, + 0.1198542769998312, + 0.3680092915892601, + 0.029810670763254166, + 0.061762481927871704, + 0.12068579904735088, + 0.0, + 0.14874549210071564, + 0.035441190004348755, + 0.056025516241788864, + 0.2947149947285652, + 0.0, + 0.40758322924375534, + 0.4546266384422779, + 0.0, + 0.03485364839434624, + 0.15446489490568638 + ], + "unique_experts": 47, + "load_cv": 1.0122703976826999, + "normalized_load_entropy": 0.8694716983811381, + "max_load_share": 0.0625 + }, + "full_input": { + "tokens": 65, + "top_k": 6, + "decisions": 390, + "ordered_route_sha256": "135e5eb7efbaebe3f24e49d8ee4ca7e16f275889e0bfa5a258c149ef117beb34", + "route_weight_sha256": "812026778c84ed0670be59105c31b5f548f24da502feb478fa37376aca956756", + "loads": [ + 4, + 25, + 8, + 2, + 5, + 2, + 9, + 4, + 5, + 10, + 25, + 9, + 11, + 2, + 0, + 4, + 1, + 13, + 4, + 4, + 4, + 7, + 6, + 7, + 0, + 0, + 6, + 0, + 1, + 4, + 7, + 4, + 9, + 5, + 4, + 0, + 6, + 7, + 9, + 7, + 8, + 0, + 2, + 1, + 9, + 16, + 9, + 1, + 2, + 7, + 13, + 2, + 10, + 7, + 17, + 2, + 3, + 10, + 0, + 7, + 10, + 1, + 6, + 7 + ], + "weighted_loads": [ + 0.440690279006958, + 2.0493282922543585, + 0.48073334619402885, + 0.08531283959746361, + 0.35675453767180443, + 0.0867634154856205, + 0.6793237328529358, + 0.16680847853422165, + 0.2931256741285324, + 0.6817370429635048, + 2.0697562526911497, + 1.1701477244496346, + 0.654537795111537, + 0.09796041250228882, + 0.0, + 0.2662513591349125, + 0.032806478440761566, + 1.0840304791927338, + 0.16676749289035797, + 0.5714020319283009, + 0.32451557368040085, + 0.6447991412132978, + 0.37622153386473656, + 0.2730422243475914, + 0.0, + 0.0, + 0.36378139816224575, + 0.0, + 0.04641503840684891, + 0.1683986932039261, + 0.29092002287507057, + 0.4982183426618576, + 0.41923251934349537, + 0.40343183279037476, + 0.19189384952187538, + 0.0, + 0.46346862986683846, + 0.2837494593113661, + 0.7847755923867226, + 0.5942242331802845, + 0.395446490496397, + 0.0, + 0.15185844153165817, + 0.02970801666378975, + 0.640452679246664, + 1.3131251502782106, + 0.5749015416949987, + 0.04667644202709198, + 0.1198542769998312, + 0.3680092915892601, + 0.7438442464917898, + 0.061762481927871704, + 0.6089135315269232, + 0.5020045526325703, + 0.9806181334424764, + 0.06235305219888687, + 0.1486725453287363, + 0.560580637305975, + 0.0, + 0.4943607822060585, + 0.6833636499941349, + 0.0431886650621891, + 0.4616693798452616, + 0.5699475277215242 + ], + "unique_experts": 57, + "load_cv": 0.855027288090477, + "normalized_load_entropy": 0.9146900090555076, + "max_load_share": 0.0641025641025641 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 24, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.9047619047619048, + "mean_token_weighted_tv": 0.02138617483433336, + "aggregate_load_tv": 0.05555555555555555 + }, + "system_bos": { + "tokens": 24, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 13, + "mean_set_jaccard": 0.8601190476190478, + "mean_token_weighted_tv": 0.02875256511227538, + "aggregate_load_tv": 0.06249999999999999 + }, + "system_x": { + "tokens": 24, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 13, + "mean_set_jaccard": 0.8690476190476191, + "mean_token_weighted_tv": 0.03366521439359834, + "aggregate_load_tv": 0.06944444444444445 + }, + "system_period": { + "tokens": 24, + "ordered_topk_exact_tokens": 7, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8809523809523809, + "mean_token_weighted_tv": 0.03323516199210038, + "aggregate_load_tv": 0.06944444444444445 + }, + "bos_at_s0": { + "tokens": 24, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8630952380952381, + "mean_token_weighted_tv": 0.029614611295983195, + "aggregate_load_tv": 0.0763888888888889 + }, + "bos_at_s1": { + "tokens": 24, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.8839285714285715, + "mean_token_weighted_tv": 0.028317524818703532, + "aggregate_load_tv": 0.0625 + }, + "x_at_s0": { + "tokens": 24, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8630952380952381, + "mean_token_weighted_tv": 0.032466913030172385, + "aggregate_load_tv": 0.08333333333333334 + }, + "x_at_s1": { + "tokens": 24, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 11, + "mean_set_jaccard": 0.8095238095238096, + "mean_token_weighted_tv": 0.044124386350934706, + "aggregate_load_tv": 0.08333333333333333 + }, + "period_at_s0": { + "tokens": 24, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8720238095238096, + "mean_token_weighted_tv": 0.028804300003685057, + "aggregate_load_tv": 0.0763888888888889 + }, + "period_at_s1": { + "tokens": 24, + "ordered_topk_exact_tokens": 7, + "set_exact_tokens": 9, + "mean_set_jaccard": 0.7946428571428572, + "mean_token_weighted_tv": 0.04369379017346849, + "aggregate_load_tv": 0.10416666666666667 + } + } + }, + "layer_26": { + "layer": 26, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "5a736a993fffb513831fb86b33c3548a5376e02ef90c50e96f80003bb082c6f9", + "route_weight_sha256": "036f6997e55a6d16610ceb4ed4cb3996a4796d5acf2d5c00c5c25156b40200de", + "loads": [ + 0, + 2, + 1, + 6, + 2, + 5, + 1, + 1, + 1, + 10, + 1, + 1, + 2, + 5, + 2, + 4, + 2, + 4, + 10, + 0, + 1, + 2, + 3, + 0, + 0, + 0, + 5, + 0, + 2, + 3, + 3, + 4, + 0, + 1, + 4, + 2, + 9, + 5, + 1, + 1, + 1, + 1, + 1, + 1, + 2, + 4, + 5, + 1, + 0, + 0, + 0, + 0, + 3, + 0, + 1, + 0, + 6, + 1, + 3, + 2, + 0, + 3, + 3, + 0 + ], + "weighted_loads": [ + 0.0, + 0.06323259510099888, + 0.03613066300749779, + 0.3744584582746029, + 0.06131824478507042, + 0.30320220440626144, + 0.05937078595161438, + 0.08303868770599365, + 0.030476408079266548, + 1.112826431170106, + 0.037576254457235336, + 0.0301336869597435, + 0.0690108947455883, + 0.645081177353859, + 0.3215254843235016, + 0.28684714436531067, + 0.1494818851351738, + 0.2772180587053299, + 0.5677866414189339, + 0.0, + 0.02792121097445488, + 0.19047971442341805, + 0.15702953934669495, + 0.0, + 0.0, + 0.0, + 0.3661148101091385, + 0.0, + 0.08113598451018333, + 0.2928097229450941, + 0.13773277401924133, + 0.32828912883996964, + 0.0, + 0.04125223308801651, + 0.3204880654811859, + 0.13020818680524826, + 0.5528537631034851, + 0.25544271618127823, + 0.07827223837375641, + 0.04839404672384262, + 0.044432856142520905, + 0.028512725606560707, + 0.027931902557611465, + 0.03555382043123245, + 0.08729657158255577, + 0.3686365634202957, + 0.5596004165709019, + 0.039277058094739914, + 0.0, + 0.0, + 0.0, + 0.0, + 0.23096685484051704, + 0.0, + 0.054119739681482315, + 0.0, + 0.6335216220468283, + 0.03938992694020271, + 0.15262419171631336, + 0.12946661561727524, + 0.0, + 0.23992805927991867, + 0.15247268229722977, + 0.0 + ], + "unique_experts": 49, + "load_cv": 1.0452715401237098, + "normalized_load_entropy": 0.8740154495381744, + "max_load_share": 0.06944444444444445 + }, + "full_input": { + "tokens": 49, + "top_k": 6, + "decisions": 294, + "ordered_route_sha256": "cfc18fc873136ef4f9238ffece3ba68f51d4f7e1023e55f3cef7ff8027043ff6", + "route_weight_sha256": "be7bd9b36558a5532a09c92f89c462b85d90dfe91223664ea9b4534970e1009e", + "loads": [ + 0, + 3, + 1, + 8, + 2, + 5, + 1, + 2, + 1, + 14, + 5, + 8, + 3, + 6, + 17, + 6, + 2, + 16, + 10, + 1, + 1, + 3, + 3, + 0, + 4, + 0, + 11, + 5, + 3, + 3, + 10, + 4, + 3, + 1, + 8, + 2, + 14, + 5, + 1, + 1, + 1, + 2, + 2, + 5, + 4, + 4, + 8, + 1, + 1, + 1, + 9, + 1, + 6, + 0, + 2, + 0, + 22, + 10, + 9, + 3, + 1, + 3, + 4, + 2 + ], + "weighted_loads": [ + 0.0, + 0.12719191797077656, + 0.03613066300749779, + 0.4678776189684868, + 0.06131824478507042, + 0.30320220440626144, + 0.05937078595161438, + 0.12119566649198532, + 0.030476408079266548, + 1.3169909678399563, + 0.38905227556824684, + 0.40301537746563554, + 0.22842995449900627, + 0.7029942683875561, + 1.0013672107597813, + 0.38573481515049934, + 0.1494818851351738, + 0.9722627633018419, + 0.5677866414189339, + 0.03430570289492607, + 0.02792121097445488, + 0.22263602539896965, + 0.15702953934669495, + 0.0, + 0.22161078080534935, + 0.0, + 1.2045133039355278, + 0.2223702371120453, + 0.12065756693482399, + 0.2928097229450941, + 0.946625430136919, + 0.32828912883996964, + 0.113822802901268, + 0.04125223308801651, + 0.7810011431574821, + 0.13020818680524826, + 0.823290515691042, + 0.25544271618127823, + 0.07827223837375641, + 0.04839404672384262, + 0.044432856142520905, + 0.06901425309479237, + 0.06603644788265228, + 0.28826817497611046, + 0.16210351884365082, + 0.3686365634202957, + 0.7230791747570038, + 0.039277058094739914, + 0.03261725232005119, + 0.9863986372947693, + 0.3971289284527302, + 0.06735855340957642, + 0.5872795544564724, + 0.0, + 0.10131751000881195, + 0.0, + 1.8258358500897884, + 0.4614423122256994, + 0.3892034459859133, + 0.17862599715590477, + 0.0008079505059868097, + 0.23992805927991867, + 0.19348401948809624, + 0.14923515170812607 + ], + "unique_experts": 59, + "load_cv": 0.9995834201027313, + "normalized_load_entropy": 0.894762818634225, + "max_load_share": 0.07482993197278912 + } + }, + "s1_eos": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "d410778acb83eaaf7082ad8dd85de4b6279f1971c282a43aa19adc242f472777", + "route_weight_sha256": "cef24535cee5bd0e31aea1907276c9a8a257363201704dcfa3b7af08a698154b", + "loads": [ + 0, + 2, + 1, + 7, + 1, + 5, + 1, + 2, + 2, + 10, + 0, + 2, + 2, + 5, + 3, + 4, + 2, + 4, + 10, + 0, + 1, + 2, + 2, + 0, + 0, + 0, + 5, + 0, + 2, + 3, + 3, + 4, + 0, + 0, + 4, + 2, + 10, + 3, + 1, + 1, + 1, + 1, + 1, + 1, + 2, + 3, + 5, + 1, + 0, + 0, + 0, + 0, + 4, + 0, + 1, + 0, + 7, + 0, + 3, + 2, + 0, + 3, + 3, + 0 + ], + "weighted_loads": [ + 0.0, + 0.06440199911594391, + 0.036829229444265366, + 0.40170425549149513, + 0.03338020294904709, + 0.3076184131205082, + 0.05826176330447197, + 0.12625543773174286, + 0.05594341270625591, + 1.0755025446414948, + 0.0, + 0.0648038275539875, + 0.07052583992481232, + 0.6343023031949997, + 0.3643192686140537, + 0.28485118970274925, + 0.14158618077635765, + 0.25721175596117973, + 0.5972438119351864, + 0.0, + 0.028707440942525864, + 0.1817324124276638, + 0.12436903640627861, + 0.0, + 0.0, + 0.0, + 0.3392355814576149, + 0.0, + 0.08023788034915924, + 0.28905777260661125, + 0.13965464010834694, + 0.3180515393614769, + 0.0, + 0.0, + 0.3075433745980263, + 0.13486852496862411, + 0.5810582675039768, + 0.18560127913951874, + 0.07053527235984802, + 0.05446021258831024, + 0.04039851576089859, + 0.029061295092105865, + 0.028331732377409935, + 0.03460050746798515, + 0.08340933918952942, + 0.3365246392786503, + 0.56309425085783, + 0.038406237959861755, + 0.0, + 0.0, + 0.0, + 0.0, + 0.2621821016073227, + 0.0, + 0.055754393339157104, + 0.0, + 0.67204381339252, + 0.0, + 0.1571645401418209, + 0.12504902854561806, + 0.0, + 0.24143396690487862, + 0.15516741573810577, + 0.0 + ], + "unique_experts": 46, + "load_cv": 1.0914934835771388, + "normalized_load_entropy": 0.8623040816402902, + "max_load_share": 0.06944444444444445 + }, + "full_input": { + "tokens": 65, + "top_k": 6, + "decisions": 390, + "ordered_route_sha256": "7cdc2cdf48cec7888d0ab14a40438b7cd60927f7f9213d9f855869ef3ab085d6", + "route_weight_sha256": "63f5a9991410a73135bd3e18588d6d2e3aaa1ecab750548c2dae1794e68b635e", + "loads": [ + 1, + 3, + 1, + 9, + 4, + 5, + 1, + 3, + 2, + 17, + 7, + 10, + 3, + 6, + 18, + 9, + 2, + 11, + 11, + 1, + 1, + 7, + 9, + 0, + 6, + 2, + 17, + 10, + 3, + 5, + 12, + 5, + 6, + 0, + 11, + 2, + 21, + 8, + 4, + 2, + 2, + 2, + 2, + 6, + 3, + 4, + 8, + 2, + 1, + 3, + 8, + 1, + 13, + 2, + 4, + 2, + 27, + 10, + 13, + 8, + 3, + 3, + 6, + 2 + ], + "weighted_loads": [ + 0.04738520085811615, + 0.12829768657684326, + 0.036829229444265366, + 0.4760254696011543, + 0.20665627531707287, + 0.3076184131205082, + 0.05826176330447197, + 0.2124750316143036, + 0.05594341270625591, + 1.4598503652960062, + 0.8175335079431534, + 0.7305617402307689, + 0.21357527375221252, + 0.6881098747253418, + 1.1705360925989226, + 0.5871679931879044, + 0.14158618077635765, + 0.7281446103006601, + 0.6485800556838512, + 0.04017682373523712, + 0.028707440942525864, + 0.5024454910308123, + 0.6168240420520306, + 0.0, + 0.29502853751182556, + 0.1061709113419056, + 1.7208173014223576, + 0.38419158570468426, + 0.11751672998070717, + 0.3595682941377163, + 1.157176498323679, + 0.39747632294893265, + 0.25112863816320896, + 0.0, + 0.8838426060974598, + 0.13486852496862411, + 1.1978508718311787, + 0.4869939386844635, + 0.3549516946077347, + 0.0894370786845684, + 0.07059268280863762, + 0.06900638714432716, + 0.07182732783257961, + 0.33965863659977913, + 0.13468477129936218, + 0.35416644997894764, + 0.7782756127417088, + 0.08014514669775963, + 0.03568478301167488, + 1.1368624493479729, + 0.3269818127155304, + 0.07866004854440689, + 1.0022740215063095, + 0.1872318796813488, + 0.27115657180547714, + 0.11257103830575943, + 2.4712418001145124, + 0.7685047397390008, + 0.7337138652801514, + 0.39379899576306343, + 0.2445446343626827, + 0.24143396690487862, + 0.2803601883351803, + 0.2129931040108204 + ], + "unique_experts": 62, + "load_cv": 0.8902274602406227, + "normalized_load_entropy": 0.9153196145064665, + "max_load_share": 0.06923076923076923 + } + }, + "s0_bos": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "50155a239a931a71e3d1ac8b7d43a4a5649c8727ec7efab34fd008a1877223ef", + "route_weight_sha256": "a5cba1a25c1accd6a948234d2a0806ff43a8e455a6e3d2c30cc8be67681be938", + "loads": [ + 0, + 2, + 1, + 6, + 1, + 5, + 1, + 1, + 2, + 9, + 1, + 1, + 1, + 5, + 2, + 4, + 2, + 5, + 10, + 0, + 1, + 2, + 2, + 0, + 0, + 0, + 5, + 0, + 2, + 3, + 3, + 4, + 0, + 1, + 4, + 2, + 10, + 4, + 1, + 1, + 1, + 1, + 1, + 2, + 2, + 4, + 5, + 1, + 0, + 0, + 0, + 0, + 4, + 0, + 1, + 0, + 6, + 1, + 2, + 2, + 0, + 3, + 4, + 0 + ], + "weighted_loads": [ + 0.0, + 0.06408478692173958, + 0.039613500237464905, + 0.36829008534550667, + 0.03765228018164635, + 0.2932096943259239, + 0.060742173343896866, + 0.08346514403820038, + 0.061323754489421844, + 1.0912773683667183, + 0.041142985224723816, + 0.03166646882891655, + 0.03480382636189461, + 0.6233965754508972, + 0.3130815476179123, + 0.30402495339512825, + 0.14968891441822052, + 0.32517629489302635, + 0.642632806673646, + 0.0, + 0.02799343876540661, + 0.18699391186237335, + 0.11921971663832664, + 0.0, + 0.0, + 0.0, + 0.320099413394928, + 0.0, + 0.08189668133854866, + 0.3127326965332031, + 0.1411963813006878, + 0.3333989232778549, + 0.0, + 0.03763195127248764, + 0.32015999034047127, + 0.12553050741553307, + 0.5963482949882746, + 0.22001979127526283, + 0.073443204164505, + 0.05080171301960945, + 0.0427461639046669, + 0.02930355817079544, + 0.028994347900152206, + 0.06837299093604088, + 0.08449316769838333, + 0.37615418061614037, + 0.5860571078956127, + 0.03712818771600723, + 0.0, + 0.0, + 0.0, + 0.0, + 0.28835323825478554, + 0.0, + 0.05615575984120369, + 0.0, + 0.625945445150137, + 0.04089323803782463, + 0.1149651687592268, + 0.12181883677840233, + 0.0, + 0.23173780739307404, + 0.18878545239567757, + 0.0 + ], + "unique_experts": 49, + "load_cv": 1.051160440468028, + "normalized_load_entropy": 0.8728806694555981, + "max_load_share": 0.06944444444444445 + }, + "full_input": { + "tokens": 49, + "top_k": 6, + "decisions": 294, + "ordered_route_sha256": "3adc602e3b42b63d2a518a721cfbf2ecc5377e2f06d205021c372465eba2eed7", + "route_weight_sha256": "2391160474d60ea8f4c6593fd1906c6ba4714c21ff0e9e6f98246e7f54ecbbd5", + "loads": [ + 1, + 3, + 1, + 8, + 1, + 6, + 1, + 2, + 2, + 14, + 4, + 8, + 2, + 6, + 15, + 6, + 2, + 15, + 10, + 0, + 1, + 3, + 3, + 0, + 4, + 0, + 11, + 6, + 3, + 3, + 11, + 4, + 2, + 1, + 9, + 2, + 15, + 4, + 1, + 1, + 1, + 2, + 3, + 6, + 5, + 4, + 7, + 1, + 1, + 0, + 9, + 1, + 7, + 0, + 2, + 0, + 22, + 10, + 8, + 3, + 0, + 3, + 5, + 3 + ], + "weighted_loads": [ + 0.024968521669507027, + 0.12625624611973763, + 0.039613500237464905, + 0.44683127850294113, + 0.03765228018164635, + 0.34111957252025604, + 0.060742173343896866, + 0.12162212282419205, + 0.061323754489421844, + 1.3446777015924454, + 0.3458753004670143, + 0.44109939970076084, + 0.1969265677034855, + 0.6813096664845943, + 0.9157579950988293, + 0.4188900329172611, + 0.14968891441822052, + 0.9569241907447577, + 0.642632806673646, + 0.0, + 0.02799343876540661, + 0.21915022283792496, + 0.15225369110703468, + 0.0, + 0.21734419092535973, + 0.0, + 1.2743530049920082, + 0.29551278054714203, + 0.11829987168312073, + 0.3127326965332031, + 1.0278586372733116, + 0.3333989232778549, + 0.08467481285333633, + 0.03763195127248764, + 0.7863239608705044, + 0.12553050741553307, + 0.8519154507666826, + 0.22001979127526283, + 0.073443204164505, + 0.05080171301960945, + 0.0427461639046669, + 0.37302110344171524, + 0.11466730386018753, + 0.33358435332775116, + 0.23944289982318878, + 0.37615418061614037, + 0.7066704668104649, + 0.03712818771600723, + 0.06734451651573181, + 0.0, + 0.3991957977414131, + 0.07422129064798355, + 0.6406326033174992, + 0.0, + 0.10335353016853333, + 0.0, + 1.8443269524723291, + 0.5027159973978996, + 0.3515444230288267, + 0.17097821831703186, + 0.0, + 0.23173780739307404, + 0.22979678958654404, + 0.20772957056760788 + ], + "unique_experts": 57, + "load_cv": 0.9936398231287181, + "normalized_load_entropy": 0.8917309002994136, + "max_load_share": 0.07482993197278912 + } + }, + "s1_bos": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "ec2a4e9ed9482ec21ccc5377fc7093b435db2447a26ae7dde3068a889326a44e", + "route_weight_sha256": "d3d292bb7eab334eec6c2781b811c560d7f3f394a6bba74d8a8a760d4bc8fc05", + "loads": [ + 0, + 2, + 1, + 7, + 1, + 6, + 1, + 2, + 2, + 10, + 1, + 1, + 1, + 5, + 2, + 4, + 2, + 5, + 10, + 0, + 1, + 2, + 2, + 0, + 0, + 0, + 5, + 0, + 2, + 3, + 3, + 4, + 0, + 0, + 4, + 2, + 9, + 3, + 1, + 1, + 1, + 1, + 1, + 2, + 2, + 4, + 5, + 1, + 0, + 1, + 0, + 0, + 3, + 0, + 1, + 0, + 5, + 0, + 3, + 2, + 0, + 3, + 4, + 0 + ], + "weighted_loads": [ + 0.0, + 0.06474594399333, + 0.03712906315922737, + 0.4094725176692009, + 0.0313250832259655, + 0.346311517059803, + 0.05883016064763069, + 0.12059729546308517, + 0.058608803898096085, + 1.1251256316900253, + 0.03249597176909447, + 0.03351772949099541, + 0.03470085561275482, + 0.6489244922995567, + 0.3235790878534317, + 0.3126281835138798, + 0.1470440775156021, + 0.3235460855066776, + 0.6085397116839886, + 0.0, + 0.027011629194021225, + 0.18650181591510773, + 0.11081180721521378, + 0.0, + 0.0, + 0.0, + 0.31380419060587883, + 0.0, + 0.08301645889878273, + 0.32115509174764156, + 0.14832474663853645, + 0.32739606499671936, + 0.0, + 0.0, + 0.31934794038534164, + 0.1266661211848259, + 0.551647137850523, + 0.16061079502105713, + 0.07115642726421356, + 0.05669478327035904, + 0.04188626632094383, + 0.031034570187330246, + 0.030542869120836258, + 0.06871600076556206, + 0.08094729110598564, + 0.3880559019744396, + 0.5693047046661377, + 0.033453624695539474, + 0.0, + 0.03935863450169563, + 0.0, + 0.0, + 0.2551811896264553, + 0.0, + 0.05788441374897957, + 0.0, + 0.5741383247077465, + 0.0, + 0.15194077044725418, + 0.11348052695393562, + 0.0, + 0.23481792956590652, + 0.1850571185350418, + 0.0 + ], + "unique_experts": 48, + "load_cv": 1.0599324460188284, + "normalized_load_entropy": 0.8700955167280903, + "max_load_share": 0.06944444444444445 + }, + "full_input": { + "tokens": 65, + "top_k": 6, + "decisions": 390, + "ordered_route_sha256": "9e53c5dd3083b51e074a0b2c0d55ef9bc825d747f5c1b6e0c5e99e46a1dec231", + "route_weight_sha256": "94b1bc1799ce409e7b2a99354e4bba701a9189b8fa2f5ead5e2ba6ad4a4003d7", + "loads": [ + 0, + 3, + 1, + 7, + 4, + 6, + 1, + 3, + 2, + 18, + 9, + 8, + 2, + 7, + 15, + 10, + 2, + 11, + 10, + 0, + 1, + 7, + 9, + 0, + 6, + 2, + 18, + 10, + 2, + 5, + 14, + 5, + 5, + 1, + 12, + 2, + 20, + 8, + 4, + 2, + 2, + 1, + 4, + 7, + 5, + 5, + 8, + 2, + 1, + 3, + 8, + 1, + 12, + 2, + 4, + 2, + 25, + 9, + 13, + 8, + 2, + 3, + 7, + 4 + ], + "weighted_loads": [ + 0.0, + 0.12187054008245468, + 0.03712906315922737, + 0.4094725176692009, + 0.20460115559399128, + 0.346311517059803, + 0.05883016064763069, + 0.2068168893456459, + 0.058608803898096085, + 1.57170769572258, + 0.8870115429162979, + 0.6997649371623993, + 0.15383358299732208, + 0.7482082881033421, + 1.058364324271679, + 0.6644772477447987, + 0.1470440775156021, + 0.8192710392177105, + 0.6085397116839886, + 0.0, + 0.027011629194021225, + 0.5072148945182562, + 0.5887301117181778, + 0.0, + 0.2929370142519474, + 0.1061709113419056, + 1.9455163031816483, + 0.3849560860544443, + 0.08301645889878273, + 0.3916656132787466, + 1.3631990626454353, + 0.4068208485841751, + 0.21216814033687115, + 0.04616228863596916, + 0.9412742592394352, + 0.1266661211848259, + 1.1646667756140232, + 0.4620034545660019, + 0.3555728495121002, + 0.0916716493666172, + 0.07208043336868286, + 0.031034570187330246, + 0.15696226060390472, + 0.3589058332145214, + 0.21673278510570526, + 0.405697712674737, + 0.7720132544636726, + 0.07519253343343735, + 0.03568478301167488, + 0.19137335941195488, + 0.3248117081820965, + 0.07269789278507233, + 0.9745322875678539, + 0.1872318796813488, + 0.2732865922152996, + 0.11257103830575943, + 2.3901081942021847, + 0.7670780550688505, + 0.7284900955855846, + 0.382230494171381, + 0.2436128407716751, + 0.23481792956590652, + 0.3102498911321163, + 0.22862320765852928 + ], + "unique_experts": 61, + "load_cv": 0.8633527904412287, + "normalized_load_entropy": 0.9164577440684409, + "max_load_share": 0.0641025641025641 + } + }, + "s0_x": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "1b35849732f27ee1587cd8e35a3835dc026454f6cbf2d21693034b7a589aa6a4", + "route_weight_sha256": "f244e320bb9f8edd41665e49faea9f2e6ed2392d8614a991eeafde3c21e26723", + "loads": [ + 0, + 2, + 1, + 6, + 1, + 5, + 1, + 1, + 2, + 10, + 1, + 1, + 0, + 5, + 2, + 5, + 3, + 5, + 10, + 0, + 1, + 2, + 2, + 0, + 0, + 0, + 5, + 0, + 2, + 2, + 2, + 4, + 0, + 0, + 4, + 2, + 10, + 3, + 1, + 1, + 1, + 0, + 1, + 2, + 1, + 4, + 6, + 1, + 0, + 0, + 0, + 0, + 3, + 0, + 1, + 0, + 8, + 0, + 3, + 2, + 1, + 3, + 5, + 0 + ], + "weighted_loads": [ + 0.0, + 0.061762453988194466, + 0.03845469281077385, + 0.3706425540149212, + 0.04003917798399925, + 0.2851698286831379, + 0.06396587193012238, + 0.08291833847761154, + 0.06089400500059128, + 1.091657817363739, + 0.04077552258968353, + 0.03306504338979721, + 0.0, + 0.6232630014419556, + 0.334510862827301, + 0.3318718634545803, + 0.16993902064859867, + 0.29419469833374023, + 0.5767386648803949, + 0.0, + 0.028694072738289833, + 0.1872047409415245, + 0.10381066799163818, + 0.0, + 0.0, + 0.0, + 0.31005561351776123, + 0.0, + 0.08031237125396729, + 0.2589905336499214, + 0.10702860355377197, + 0.324614442884922, + 0.0, + 0.0, + 0.29815445467829704, + 0.12337658181786537, + 0.6110971197485924, + 0.17806414887309074, + 0.06776442378759384, + 0.05169321596622467, + 0.04166446998715401, + 0.0, + 0.02881794609129429, + 0.06694286689162254, + 0.03624304383993149, + 0.31211500242352486, + 0.612468495965004, + 0.03951675817370415, + 0.0, + 0.0, + 0.0, + 0.0, + 0.23357031866908073, + 0.0, + 0.05715535581111908, + 0.0, + 0.6851992271840572, + 0.0, + 0.1424083299934864, + 0.1156637854874134, + 0.041036371141672134, + 0.23737989738583565, + 0.22597820311784744, + 0.0 + ], + "unique_experts": 46, + "load_cv": 1.130388330520878, + "normalized_load_entropy": 0.8545827858738195, + "max_load_share": 0.06944444444444445 + }, + "full_input": { + "tokens": 49, + "top_k": 6, + "decisions": 294, + "ordered_route_sha256": "2c4c0cf260ad0d0d9cd2b63f4d69770f0845c76e2dcd2b166290f83abd9f44bf", + "route_weight_sha256": "59086f3839bc6832de64ac96208c798d7dbe13dc7124b294e94f86eb848cd548", + "loads": [ + 0, + 3, + 1, + 7, + 1, + 6, + 1, + 2, + 2, + 13, + 5, + 8, + 1, + 6, + 16, + 7, + 3, + 17, + 10, + 0, + 1, + 3, + 2, + 0, + 5, + 0, + 11, + 7, + 2, + 3, + 8, + 4, + 2, + 0, + 9, + 2, + 16, + 3, + 1, + 1, + 1, + 0, + 2, + 8, + 1, + 4, + 9, + 1, + 0, + 0, + 9, + 1, + 6, + 0, + 2, + 0, + 27, + 10, + 9, + 3, + 1, + 3, + 6, + 2 + ], + "weighted_loads": [ + 0.0, + 0.11937410943210125, + 0.03845469281077385, + 0.43677152320742607, + 0.04003917798399925, + 0.3240134119987488, + 0.06396587193012238, + 0.12107531726360321, + 0.06089400500059128, + 1.276225809007883, + 0.39970291033387184, + 0.5109096299856901, + 0.14991560578346252, + 0.6811760924756527, + 1.0409520156681538, + 0.4271497018635273, + 0.16993902064859867, + 1.094971815124154, + 0.5767386648803949, + 0.0, + 0.028694072738289833, + 0.2193610519170761, + 0.10381066799163818, + 0.0, + 0.2528855577111244, + 0.0, + 1.1166705302894115, + 0.29266028478741646, + 0.08031237125396729, + 0.30635033920407295, + 0.8148225843906403, + 0.324614442884922, + 0.08009405061602592, + 0.0, + 0.690208911895752, + 0.12337658181786537, + 0.9034490659832954, + 0.17806414887309074, + 0.06776442378759384, + 0.05169321596622467, + 0.04166446998715401, + 0.0, + 0.07006222568452358, + 0.3965790867805481, + 0.03624304383993149, + 0.31211500242352486, + 0.7753620706498623, + 0.03951675817370415, + 0.0, + 0.0, + 0.3943028189241886, + 0.07356838881969452, + 0.5701656602323055, + 0.0, + 0.10435312613844872, + 0.0, + 1.9975424949079752, + 0.5598491169512272, + 0.3789875842630863, + 0.16482316702604294, + 0.041036371141672134, + 0.23737989738583565, + 0.2669895403087139, + 0.12883581221103668 + ], + "unique_experts": 54, + "load_cv": 1.1118027372175046, + "normalized_load_entropy": 0.8699673841197116, + "max_load_share": 0.09183673469387756 + } + }, + "s1_x": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "6f71f174403c334f8e27aa865cd5c6ebbde70b2e5b5c1d982328b3bdbcfcfa55", + "route_weight_sha256": "4146a88ca807b2b7b4f3fa260425ab93e77e7dd6432e7db76bf7a922715f7111", + "loads": [ + 0, + 0, + 1, + 6, + 1, + 6, + 1, + 2, + 2, + 10, + 1, + 2, + 1, + 5, + 2, + 4, + 2, + 5, + 8, + 0, + 1, + 2, + 2, + 0, + 0, + 1, + 6, + 0, + 2, + 3, + 2, + 5, + 0, + 0, + 4, + 2, + 9, + 3, + 1, + 1, + 1, + 1, + 1, + 0, + 0, + 3, + 6, + 1, + 0, + 0, + 0, + 0, + 3, + 0, + 1, + 1, + 6, + 2, + 3, + 2, + 1, + 3, + 6, + 0 + ], + "weighted_loads": [ + 0.0, + 0.0, + 0.03891255706548691, + 0.3490019701421261, + 0.037369731813669205, + 0.3362976759672165, + 0.0583154670894146, + 0.12967045605182648, + 0.06421707943081856, + 1.122362144291401, + 0.0403958298265934, + 0.07010334357619286, + 0.034400735050439835, + 0.5876360312104225, + 0.32674525678157806, + 0.3071390651166439, + 0.1490999013185501, + 0.27827880159020424, + 0.5049786902964115, + 0.0, + 0.027232175692915916, + 0.1869395412504673, + 0.10566911473870277, + 0.0, + 0.0, + 0.036156341433525085, + 0.30028517730534077, + 0.0, + 0.07579604163765907, + 0.3068839982151985, + 0.11093681305646896, + 0.35310857370495796, + 0.0, + 0.0, + 0.28593648597598076, + 0.1134660504758358, + 0.5520215183496475, + 0.15307895466685295, + 0.06295768171548843, + 0.06662595272064209, + 0.03830362483859062, + 0.03359869495034218, + 0.02765648066997528, + 0.0, + 0.0, + 0.27480698749423027, + 0.6110992655158043, + 0.029891880229115486, + 0.0, + 0.0, + 0.0, + 0.0, + 0.25019796192646027, + 0.0, + 0.05666545778512955, + 0.0341666005551815, + 0.6530468054115772, + 0.0668068453669548, + 0.14837927371263504, + 0.09936011210083961, + 0.04017840325832367, + 0.24647969752550125, + 0.27288103103637695, + 0.0 + ], + "unique_experts": 48, + "load_cv": 1.057016532802247, + "normalized_load_entropy": 0.8684070576198909, + "max_load_share": 0.06944444444444445 + }, + "full_input": { + "tokens": 65, + "top_k": 6, + "decisions": 390, + "ordered_route_sha256": "b93ebdf52a682e3874ba315b2bb6e6f0cc6c52c51d564973b983c10985ea1239", + "route_weight_sha256": "11bfa4ca39eb7e4f826dbac645ab7cf87f0d72c1f2cb686e7fb347c7783a134a", + "loads": [ + 0, + 0, + 1, + 7, + 4, + 7, + 1, + 3, + 2, + 16, + 8, + 10, + 2, + 6, + 18, + 9, + 2, + 11, + 8, + 0, + 1, + 7, + 8, + 0, + 6, + 3, + 19, + 11, + 2, + 6, + 11, + 6, + 5, + 0, + 12, + 2, + 21, + 8, + 4, + 2, + 2, + 1, + 3, + 5, + 0, + 4, + 8, + 2, + 2, + 2, + 8, + 1, + 13, + 2, + 4, + 3, + 28, + 13, + 14, + 9, + 3, + 3, + 9, + 2 + ], + "weighted_loads": [ + 0.0, + 0.0, + 0.03891255706548691, + 0.39194701239466667, + 0.21064580418169498, + 0.3702890910208225, + 0.0583154670894146, + 0.2158900499343872, + 0.06421707943081856, + 1.4815691709518433, + 0.8312200792133808, + 0.8395380675792694, + 0.11653949692845345, + 0.6414436027407646, + 1.2396624721586704, + 0.6169180572032928, + 0.1490999013185501, + 0.8250455372035503, + 0.5049786902964115, + 0.0, + 0.027232175692915916, + 0.5076526198536158, + 0.5476856492459774, + 0.0, + 0.28499674424529076, + 0.14232725277543068, + 1.8100106436759233, + 0.4328837227076292, + 0.07579604163765907, + 0.4542943611741066, + 1.142876647412777, + 0.4325333572924137, + 0.21927698515355587, + 0.0, + 0.8289817944169044, + 0.1134660504758358, + 1.2083133161067963, + 0.4544716142117977, + 0.3473741039633751, + 0.10160281881690025, + 0.06849779188632965, + 0.03359869495034218, + 0.0992634929716587, + 0.28393975645303726, + 0.0, + 0.2924487981945276, + 0.7724485583603382, + 0.07163078896701336, + 0.06470591761171818, + 0.15201472491025925, + 0.3248884305357933, + 0.06941015273332596, + 1.0098414458334446, + 0.1872318796813488, + 0.2720676362514496, + 0.14673763886094093, + 2.522624369710684, + 0.9701675269752741, + 0.7889762632548809, + 0.41497862711548805, + 0.2837912440299988, + 0.24647969752550125, + 0.39807380363345146, + 0.13862861320376396 + ], + "unique_experts": 58, + "load_cv": 0.9331501651766616, + "normalized_load_entropy": 0.9025642459618137, + "max_load_share": 0.07179487179487179 + } + }, + "s0_period": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "d7dba65dd0011eb280038953aeb940571fe50604bed08ea9be66103dd64ab9ee", + "route_weight_sha256": "2bdce9b59483c6f5f4c117abc6a952676399297bbd3239a5c51697a6ff3595d9", + "loads": [ + 0, + 2, + 1, + 7, + 1, + 5, + 1, + 1, + 2, + 11, + 1, + 1, + 0, + 5, + 2, + 5, + 3, + 5, + 10, + 0, + 1, + 2, + 2, + 0, + 0, + 0, + 5, + 0, + 1, + 2, + 2, + 4, + 0, + 0, + 4, + 2, + 10, + 3, + 1, + 1, + 1, + 0, + 1, + 2, + 1, + 4, + 6, + 1, + 0, + 0, + 0, + 0, + 4, + 0, + 1, + 0, + 6, + 2, + 2, + 2, + 1, + 3, + 4, + 0 + ], + "weighted_loads": [ + 0.0, + 0.06162159703671932, + 0.040200721472501755, + 0.4067598935216665, + 0.03474166616797447, + 0.2850089892745018, + 0.061649445444345474, + 0.083043172955513, + 0.06053311191499233, + 1.1986694652587175, + 0.04116826504468918, + 0.03288878872990608, + 0.0, + 0.6177412644028664, + 0.3314749598503113, + 0.3377704322338104, + 0.1748204492032528, + 0.2943246550858021, + 0.5745063498616219, + 0.0, + 0.028038492426276207, + 0.18987375870347023, + 0.10290713608264923, + 0.0, + 0.0, + 0.0, + 0.2936430834233761, + 0.0, + 0.03928429260849953, + 0.2819524332880974, + 0.11256953701376915, + 0.31940965354442596, + 0.0, + 0.0, + 0.2998170182108879, + 0.1219259612262249, + 0.6025743708014488, + 0.17697244882583618, + 0.07183349877595901, + 0.048113126307725906, + 0.044068582355976105, + 0.0, + 0.028992481529712677, + 0.06752701103687286, + 0.037140440195798874, + 0.3273157961666584, + 0.616116538643837, + 0.03844831883907318, + 0.0, + 0.0, + 0.0, + 0.0, + 0.26727934554219246, + 0.0, + 0.057796988636255264, + 0.0, + 0.6305301934480667, + 0.07046935148537159, + 0.10743323341012001, + 0.12603598460555077, + 0.040650077164173126, + 0.23476231843233109, + 0.1871001422405243, + 0.0 + ], + "unique_experts": 47, + "load_cv": 1.130388330520878, + "normalized_load_entropy": 0.8576307768092639, + "max_load_share": 0.0763888888888889 + }, + "full_input": { + "tokens": 49, + "top_k": 6, + "decisions": 294, + "ordered_route_sha256": "4590e25a147e9328130683cce35c9710f35b600f38b4de680b5166e97f288ca2", + "route_weight_sha256": "5c93b6d6835ec0cdfb5970ed9a7a66f74b0396a6c5a53a73eab33ad4a1801a07", + "loads": [ + 0, + 3, + 1, + 9, + 1, + 6, + 1, + 3, + 2, + 14, + 5, + 6, + 1, + 6, + 16, + 7, + 3, + 16, + 10, + 0, + 1, + 3, + 2, + 0, + 5, + 0, + 11, + 5, + 2, + 2, + 10, + 4, + 3, + 0, + 9, + 2, + 17, + 3, + 1, + 1, + 1, + 0, + 2, + 6, + 1, + 4, + 10, + 1, + 1, + 0, + 9, + 1, + 8, + 0, + 2, + 0, + 23, + 11, + 8, + 3, + 1, + 3, + 5, + 3 + ], + "weighted_loads": [ + 0.0, + 0.12003700621426105, + 0.040200721472501755, + 0.5223154071718454, + 0.03474166616797447, + 0.330298975110054, + 0.061649445444345474, + 0.1596636138856411, + 0.06053311191499233, + 1.3832374569028616, + 0.41695183515548706, + 0.36301680468022823, + 0.15951888263225555, + 0.6756543554365635, + 0.9785361103713512, + 0.4306117370724678, + 0.1748204492032528, + 1.0313456486910582, + 0.5745063498616219, + 0.0, + 0.028038492426276207, + 0.22203006967902184, + 0.10290713608264923, + 0.0, + 0.30787235125899315, + 0.0, + 1.106532271951437, + 0.2223702371120453, + 0.07701510190963745, + 0.2819524332880974, + 0.9286336489021778, + 0.31940965354442596, + 0.12062274292111397, + 0.0, + 0.7421492002904415, + 0.1219259612262249, + 0.9500605836510658, + 0.17697244882583618, + 0.07183349877595901, + 0.048113126307725906, + 0.044068582355976105, + 0.0, + 0.06872284784913063, + 0.32617509737610817, + 0.037140440195798874, + 0.3273157961666584, + 0.8157867826521397, + 0.03844831883907318, + 0.03961058706045151, + 0.0, + 0.39324743673205376, + 0.07459065318107605, + 0.6889390125870705, + 0.0, + 0.1049947589635849, + 0.0, + 1.959151865914464, + 0.5206244122236967, + 0.3440124876797199, + 0.1751953661441803, + 0.040650077164173126, + 0.23476231843233109, + 0.22811147943139076, + 0.22951780259609222 + ], + "unique_experts": 55, + "load_cv": 1.0662492241612345, + "normalized_load_entropy": 0.8761879023798211, + "max_load_share": 0.0782312925170068 + } + }, + "s1_period": { + "target_content": { + "tokens": 24, + "top_k": 6, + "decisions": 144, + "ordered_route_sha256": "3a75a44768ead2cfcb1dce8ba3434cb8e94242bebdd027bde137a16074d541dd", + "route_weight_sha256": "69a2d70d32ec72a4b0b18fd66c235e7c1e9693f7caf56edb281db3a1e51648f6", + "loads": [ + 0, + 1, + 0, + 7, + 1, + 5, + 1, + 2, + 2, + 11, + 1, + 1, + 0, + 6, + 3, + 5, + 2, + 5, + 8, + 0, + 1, + 2, + 1, + 0, + 0, + 1, + 5, + 0, + 1, + 3, + 2, + 6, + 0, + 0, + 4, + 2, + 10, + 2, + 1, + 2, + 0, + 1, + 1, + 2, + 0, + 4, + 6, + 1, + 0, + 0, + 0, + 0, + 4, + 0, + 1, + 1, + 5, + 0, + 3, + 2, + 1, + 3, + 5, + 0 + ], + "weighted_loads": [ + 0.0, + 0.025868356227874756, + 0.0, + 0.3977866619825363, + 0.034151386469602585, + 0.29371923953294754, + 0.05654549598693848, + 0.1359829306602478, + 0.06947677209973335, + 1.1824372615665197, + 0.041507188230752945, + 0.03624472767114639, + 0.0, + 0.6608494333922863, + 0.3770959638059139, + 0.34249352291226387, + 0.1444886215031147, + 0.27678679302334785, + 0.486969280987978, + 0.0, + 0.03033679910004139, + 0.18889368325471878, + 0.07093753665685654, + 0.0, + 0.0, + 0.04082120209932327, + 0.2563491612672806, + 0.0, + 0.03419551998376846, + 0.33180540427565575, + 0.10653524473309517, + 0.3907264992594719, + 0.0, + 0.0, + 0.28774167969822884, + 0.10602045431733131, + 0.5836060158908367, + 0.12424082309007645, + 0.06477833539247513, + 0.10646705329418182, + 0.0, + 0.03118138387799263, + 0.03098335675895214, + 0.06865013390779495, + 0.0, + 0.33800069242715836, + 0.644973699003458, + 0.029984980821609497, + 0.0, + 0.0, + 0.0, + 0.0, + 0.2648156173527241, + 0.0, + 0.05587255209684372, + 0.03416483849287033, + 0.5407084077596664, + 0.0, + 0.1605483777821064, + 0.10017255693674088, + 0.042232464998960495, + 0.2454063966870308, + 0.20600060746073723, + 0.0 + ], + "unique_experts": 46, + "load_cv": 1.1221672153735642, + "normalized_load_entropy": 0.8545578346425351, + "max_load_share": 0.0763888888888889 + }, + "full_input": { + "tokens": 65, + "top_k": 6, + "decisions": 390, + "ordered_route_sha256": "79250fadb8a120241b4b28b6783275cb177f44e3949437bc1bdd8921dd738f6a", + "route_weight_sha256": "ab9c4f835d2ee459cd255528c591e55526e372f43a952a54d80acf85af90c508", + "loads": [ + 0, + 1, + 0, + 7, + 4, + 5, + 1, + 3, + 2, + 18, + 9, + 7, + 1, + 7, + 17, + 10, + 2, + 11, + 8, + 1, + 1, + 7, + 7, + 0, + 7, + 3, + 17, + 11, + 1, + 5, + 11, + 7, + 6, + 1, + 11, + 2, + 23, + 8, + 4, + 3, + 1, + 1, + 4, + 7, + 0, + 5, + 10, + 2, + 2, + 2, + 8, + 1, + 15, + 2, + 5, + 3, + 25, + 9, + 13, + 8, + 3, + 3, + 8, + 4 + ], + "weighted_loads": [ + 0.0, + 0.025868356227874756, + 0.0, + 0.3977866619825363, + 0.20742745883762836, + 0.29371923953294754, + 0.05654549598693848, + 0.22220252454280853, + 0.06947677209973335, + 1.5753097739070654, + 0.8869743086397648, + 0.6527493558824062, + 0.0670461505651474, + 0.7146570049226284, + 1.2053395546972752, + 0.6415620781481266, + 0.1444886215031147, + 0.8543655164539814, + 0.486969280987978, + 0.03229513764381409, + 0.03033679910004139, + 0.5096067618578672, + 0.5129540711641312, + 0.0, + 0.35684359818696976, + 0.14699211344122887, + 1.6767676956951618, + 0.4309267979115248, + 0.03419551998376846, + 0.4023159258067608, + 1.1316945292055607, + 0.47015128284692764, + 0.25656563602387905, + 0.029980381950736046, + 0.806181862950325, + 0.10602045431733131, + 1.2923995330929756, + 0.46043670549988747, + 0.3491947576403618, + 0.14144391939044, + 0.03019416704773903, + 0.03118138387799263, + 0.14369324035942554, + 0.36625954508781433, + 0.0, + 0.3556425031274557, + 0.8828246183693409, + 0.07172388955950737, + 0.06824437528848648, + 0.15201472491025925, + 0.3258163705468178, + 0.056391436606645584, + 1.090793427079916, + 0.1872318796813488, + 0.3094366826117039, + 0.14673587679862976, + 2.403672691434622, + 0.7579539995640516, + 0.7370977029204369, + 0.36892252415418625, + 0.2858453057706356, + 0.2454063966870308, + 0.33119338005781174, + 0.3065522648394108 + ], + "unique_experts": 60, + "load_cv": 0.8996310150178889, + "normalized_load_entropy": 0.9087937136906851, + "max_load_share": 0.0641025641025641 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 24, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.8988095238095237, + "mean_token_weighted_tv": 0.024056125665083528, + "aggregate_load_tv": 0.05555555555555555 + }, + "system_bos": { + "tokens": 24, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 18, + "mean_set_jaccard": 0.9285714285714287, + "mean_token_weighted_tv": 0.020239226093205314, + "aggregate_load_tv": 0.04166666666666667 + }, + "system_x": { + "tokens": 24, + "ordered_topk_exact_tokens": 7, + "set_exact_tokens": 12, + "mean_set_jaccard": 0.8482142857142857, + "mean_token_weighted_tv": 0.034511244079718985, + "aggregate_load_tv": 0.09027777777777776 + }, + "system_period": { + "tokens": 24, + "ordered_topk_exact_tokens": 7, + "set_exact_tokens": 12, + "mean_set_jaccard": 0.8482142857142857, + "mean_token_weighted_tv": 0.03798111330252141, + "aggregate_load_tv": 0.08333333333333334 + }, + "bos_at_s0": { + "tokens": 24, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.9077380952380953, + "mean_token_weighted_tv": 0.024186932054969173, + "aggregate_load_tv": 0.04166666666666667 + }, + "bos_at_s1": { + "tokens": 24, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8809523809523809, + "mean_token_weighted_tv": 0.030571078648790717, + "aggregate_load_tv": 0.048611111111111105 + }, + "x_at_s0": { + "tokens": 24, + "ordered_topk_exact_tokens": 6, + "set_exact_tokens": 10, + "mean_set_jaccard": 0.8333333333333334, + "mean_token_weighted_tv": 0.03703796739379565, + "aggregate_load_tv": 0.08333333333333334 + }, + "x_at_s1": { + "tokens": 24, + "ordered_topk_exact_tokens": 5, + "set_exact_tokens": 7, + "mean_set_jaccard": 0.7976190476190478, + "mean_token_weighted_tv": 0.04586856501797835, + "aggregate_load_tv": 0.09722222222222222 + }, + "period_at_s0": { + "tokens": 24, + "ordered_topk_exact_tokens": 7, + "set_exact_tokens": 11, + "mean_set_jaccard": 0.8273809523809526, + "mean_token_weighted_tv": 0.037081525777466595, + "aggregate_load_tv": 0.09027777777777778 + }, + "period_at_s1": { + "tokens": 24, + "ordered_topk_exact_tokens": 5, + "set_exact_tokens": 10, + "mean_set_jaccard": 0.8154761904761906, + "mean_token_weighted_tv": 0.04786625667475164, + "aggregate_load_tv": 0.1111111111111111 + } + } + } + } + }, + { + "id": "tnews/test/1059", + "domain": "chinese", + "label": "中文新闻", + "within_domain_index": 3, + "selection_rank": "003c8ebfb96b25b85cd0d61695249921a80438fbed1d314631b98720f7e9d0bd", + "source_text_sha256": "02423d8805b68349a9a70d9b64ce830f1e9fbdd2a0cda7b4a9dd320f6bb6ec8e", + "source_characters": 29, + "source_tokens": 27, + "content_token_ids_sha256": "63a87e13e168c4240f0949aa0a3e3e762f46d35cb2b163d6cb8d0f38b7f563df", + "prompt_tokens_by_condition": { + "s0_eos": 52, + "s1_eos": 68, + "s0_bos": 52, + "s1_bos": 68, + "s0_x": 52, + "s1_x": 68, + "s0_period": 52, + "s1_period": 68 + }, + "batch_prompt_tokens": 68, + "content_tokens": 27, + "boundary_crossing_tokens_by_condition": { + "s0_eos": 0, + "s1_eos": 0, + "s0_bos": 0, + "s1_bos": 0, + "s0_x": 0, + "s1_x": 0, + "s0_period": 0, + "s1_period": 0 + }, + "forward_seconds": 0.6324969330162276, + "peak_cuda_memory_allocated_bytes": 27591142400, + "hidden_stages": { + "embedding": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6ad48e86651a5100f018f95bbc2f41d0eff86fef4582fa28c3c595b09921cc86", + "mean": 0.00015644806262571365, + "std": 0.11187863349914551, + "rms": 0.11187873780727386, + "max_abs": 2.015625 + }, + "full_input": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a948f553a8d59ac99ce0b8bc9ba829b1cf9a644ab588e616af87209c2d27e6f9", + "mean": -0.00036941375583410263, + "std": 0.0999612808227539, + "rms": 0.09996195882558823, + "max_abs": 2.046875 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6ad48e86651a5100f018f95bbc2f41d0eff86fef4582fa28c3c595b09921cc86", + "mean": 0.00015644806262571365, + "std": 0.11187863349914551, + "rms": 0.11187873780727386, + "max_abs": 2.015625 + }, + "full_input": { + "shape": [ + 68, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "45b58b252fb34c68d1a022ebe184c40e684073142c9a24ffab0f9a1aa67ce012", + "mean": -0.0007994519546627998, + "std": 0.10111276805400848, + "rms": 0.10111591964960098, + "max_abs": 2.046875 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6ad48e86651a5100f018f95bbc2f41d0eff86fef4582fa28c3c595b09921cc86", + "mean": 0.00015644806262571365, + "std": 0.11187863349914551, + "rms": 0.11187873780727386, + "max_abs": 2.015625 + }, + "full_input": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d350e56d169eefd43dc38e69145006ebd5b4e6aaae1e13d9be04baad4d2690a4", + "mean": -0.0003399292763788253, + "std": 0.09960098564624786, + "rms": 0.09960156679153442, + "max_abs": 2.046875 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6ad48e86651a5100f018f95bbc2f41d0eff86fef4582fa28c3c595b09921cc86", + "mean": 0.00015644806262571365, + "std": 0.11187863349914551, + "rms": 0.11187873780727386, + "max_abs": 2.015625 + }, + "full_input": { + "shape": [ + 68, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9729e1396382ed07b5561030927f633b560b35aea3f5010c7b064b253a100478", + "mean": -0.0007769049843773246, + "std": 0.10084060579538345, + "rms": 0.10084359347820282, + "max_abs": 2.046875 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6ad48e86651a5100f018f95bbc2f41d0eff86fef4582fa28c3c595b09921cc86", + "mean": 0.00015644806262571365, + "std": 0.11187863349914551, + "rms": 0.11187873780727386, + "max_abs": 2.015625 + }, + "full_input": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e275db69cdf4435d2a176c33a977cc5c7eddbbcde9059247699b716ca6d5beae", + "mean": -0.00041228439658880234, + "std": 0.09984415024518967, + "rms": 0.09984500706195831, + "max_abs": 2.046875 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6ad48e86651a5100f018f95bbc2f41d0eff86fef4582fa28c3c595b09921cc86", + "mean": 0.00015644806262571365, + "std": 0.11187863349914551, + "rms": 0.11187873780727386, + "max_abs": 2.015625 + }, + "full_input": { + "shape": [ + 68, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "eaea3cd9ad712c43dc44a44810d3659c54f5035c4093dc67cc6691dd924486cc", + "mean": -0.0008322353824041784, + "std": 0.1010240912437439, + "rms": 0.10102751106023788, + "max_abs": 2.046875 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6ad48e86651a5100f018f95bbc2f41d0eff86fef4582fa28c3c595b09921cc86", + "mean": 0.00015644806262571365, + "std": 0.11187863349914551, + "rms": 0.11187873780727386, + "max_abs": 2.015625 + }, + "full_input": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6b13448702f29488e0ac043bd1d938a3ffa8c40c9539e73d33c2aed1fbc27487", + "mean": -0.00041384471114724874, + "std": 0.09956743568181992, + "rms": 0.09956829994916916, + "max_abs": 2.046875 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6ad48e86651a5100f018f95bbc2f41d0eff86fef4582fa28c3c595b09921cc86", + "mean": 0.00015644806262571365, + "std": 0.11187863349914551, + "rms": 0.11187873780727386, + "max_abs": 2.015625 + }, + "full_input": { + "shape": [ + 68, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f4fda0478c39cba2182561cdf662cdd7a53d5f929a0a2bacc377b3bcb236f1ad", + "mean": -0.0008334285812452435, + "std": 0.10081502050161362, + "rms": 0.10081847012042999, + "max_abs": 2.046875 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 27, + "exact_hidden_rows": 27, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999998211860657, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "system_bos": { + "tokens": 27, + "exact_hidden_rows": 27, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999998211860657, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "system_x": { + "tokens": 27, + "exact_hidden_rows": 27, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999998211860657, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "system_period": { + "tokens": 27, + "exact_hidden_rows": 27, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999998211860657, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "bos_at_s0": { + "tokens": 27, + "exact_hidden_rows": 27, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999998211860657, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "bos_at_s1": { + "tokens": 27, + "exact_hidden_rows": 27, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999998211860657, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "x_at_s0": { + "tokens": 27, + "exact_hidden_rows": 27, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999998211860657, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "x_at_s1": { + "tokens": 27, + "exact_hidden_rows": 27, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999998211860657, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "period_at_s0": { + "tokens": 27, + "exact_hidden_rows": 27, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999998211860657, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "period_at_s1": { + "tokens": 27, + "exact_hidden_rows": 27, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999998211860657, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + } + } + }, + "layer_00": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "298af20a79dedaf8c6ed3e1eb139c086741c362eb90541e3cc211faa66b964ba", + "mean": -0.0016748786438256502, + "std": 0.10487580299377441, + "rms": 0.10488917678594589, + "max_abs": 2.640625 + }, + "full_input": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8c72c044a563cd3a770f0a242b3cfdbee6fee6844a21d99638fe20dfef9aef06", + "mean": -0.001602891250513494, + "std": 0.09774699807167053, + "rms": 0.0977601408958435, + "max_abs": 2.640625 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "57e541f6b1d050a5cca31acb2711f35c6f85cf92a90ee1daed15b6be01f510c5", + "mean": -0.0017049191519618034, + "std": 0.10504598915576935, + "rms": 0.10505981743335724, + "max_abs": 2.671875 + }, + "full_input": { + "shape": [ + 68, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "71b167505cc1b7e0e602d8b3df17681265f279330b40098587791e574c11dfb6", + "mean": -0.001782736973837018, + "std": 0.09790871292352676, + "rms": 0.09792494773864746, + "max_abs": 2.671875 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f31e6ef88496e94a6a429b9b69434e7b2daa196248f71acb2ea40f07471d8e42", + "mean": -0.0016075985040515661, + "std": 0.10303951799869537, + "rms": 0.10305205732584, + "max_abs": 2.453125 + }, + "full_input": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c0400688e3fe02ae1b2c6e8f98109617960672132f8af1afbe21f38fc328df07", + "mean": -0.0015244343085214496, + "std": 0.09621354937553406, + "rms": 0.09622563421726227, + "max_abs": 2.453125 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "618825d2fdb0d55921e98ab8eca207ed22c7305e4dbf415151c57fdd0a161c14", + "mean": -0.0016461180057376623, + "std": 0.10313523560762405, + "rms": 0.10314837843179703, + "max_abs": 2.5 + }, + "full_input": { + "shape": [ + 68, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d4b7904de894b1207bfe74c060f0ea457f97d77304baad85d5bad6c98051f03a", + "mean": -0.0017265834612771869, + "std": 0.09669199585914612, + "rms": 0.09670741111040115, + "max_abs": 2.5 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4fe78ba0d7fb4db6cc3af4d7bc6e99f47e9c2cf12431e18e30ba256725f3fd7c", + "mean": -0.0016063051298260689, + "std": 0.10261379182338715, + "rms": 0.10262636095285416, + "max_abs": 2.453125 + }, + "full_input": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "49c42337fa94538e6f4f728b2d11b55d9fd4241c333c88ae4c724810510e6983", + "mean": -0.0015651663998141885, + "std": 0.09622882306575775, + "rms": 0.0962415561079979, + "max_abs": 2.453125 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5d4e1f81de192cdaecd81e394b6cce4d346acc1af777e9cbab2e668d43a54fff", + "mean": -0.001652135862968862, + "std": 0.10281401872634888, + "rms": 0.102827288210392, + "max_abs": 2.484375 + }, + "full_input": { + "shape": [ + 68, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "95aa9a025f26f869972285f480beff199415ef62a7d78eb0f4be2e83e606b92d", + "mean": -0.0017673773691058159, + "std": 0.09678784012794495, + "rms": 0.09680397063493729, + "max_abs": 2.484375 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "010caf4630c563e73445256e1eac54bca82f7b1eec738a325cc50212d14eaff2", + "mean": -0.001609847997315228, + "std": 0.10273810476064682, + "rms": 0.10275071859359741, + "max_abs": 2.46875 + }, + "full_input": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "82f6f9ee2c1e9ffbdb1c3d1b6b19d93874ae5d94d7d0588e76afd18a10dd2227", + "mean": -0.0015660898061469197, + "std": 0.09586019814014435, + "rms": 0.09587299078702927, + "max_abs": 2.46875 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d1f4bf1624ac217209eecd6090553dc5a5b5f942fe22840b5d8c568a64eb4465", + "mean": -0.0016588784055784345, + "std": 0.1029447391629219, + "rms": 0.10295810550451279, + "max_abs": 2.5 + }, + "full_input": { + "shape": [ + 68, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5254ff6b00104eee802d7c6ed3596a03bfacdd59447edd4b829a7b44c36b8816", + "mean": -0.0017650710651651025, + "std": 0.09647812694311142, + "rms": 0.09649427235126495, + "max_abs": 2.5 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9996939301490784, + "min_cosine_similarity": 0.9987387657165527, + "mean_relative_l2": 0.022670093923807144, + "max_abs_delta": 0.1015625 + }, + "system_bos": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.999565601348877, + "min_cosine_similarity": 0.9984331130981445, + "mean_relative_l2": 0.02763458527624607, + "max_abs_delta": 0.1171875 + }, + "system_x": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9995933175086975, + "min_cosine_similarity": 0.9987332820892334, + "mean_relative_l2": 0.027467850595712662, + "max_abs_delta": 0.1015625 + }, + "system_period": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9996242523193359, + "min_cosine_similarity": 0.9988144636154175, + "mean_relative_l2": 0.0262871365994215, + "max_abs_delta": 0.11328125 + }, + "bos_at_s0": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9863778352737427, + "min_cosine_similarity": 0.9751859903335571, + "mean_relative_l2": 0.16324590146541595, + "max_abs_delta": 0.28125 + }, + "bos_at_s1": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.987676203250885, + "min_cosine_similarity": 0.9782923460006714, + "mean_relative_l2": 0.15557177364826202, + "max_abs_delta": 0.28125 + }, + "x_at_s0": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9865593910217285, + "min_cosine_similarity": 0.9758924245834351, + "mean_relative_l2": 0.16236212849617004, + "max_abs_delta": 0.28125 + }, + "x_at_s1": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9878605008125305, + "min_cosine_similarity": 0.9784846305847168, + "mean_relative_l2": 0.1544867306947708, + "max_abs_delta": 0.265625 + }, + "period_at_s0": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9868793487548828, + "min_cosine_similarity": 0.9768928289413452, + "mean_relative_l2": 0.1604793518781662, + "max_abs_delta": 0.28125 + }, + "period_at_s1": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9881064295768738, + "min_cosine_similarity": 0.9793310165405273, + "mean_relative_l2": 0.15293534100055695, + "max_abs_delta": 0.265625 + } + } + }, + "layer_01": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b9fe531807fc1df7f1365c878b608e3c50ade31664612da440e6b78dd22e0b3a", + "mean": -0.0017540781991556287, + "std": 0.12093430757522583, + "rms": 0.12094702571630478, + "max_abs": 2.9375 + }, + "full_input": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3456f9acdc1260f02b53273a73a1bfbcfbf5e23d345e5ef04378f78a1355a81b", + "mean": -0.0070661455392837524, + "std": 1.109689474105835, + "rms": 1.10971200466156, + "max_abs": 126.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "91cebcc5e1fae19705b5b62dd5bcc3aab91ff5df4e49b1cc81bf6c50e20a183e", + "mean": -0.0017168201738968492, + "std": 0.12135586142539978, + "rms": 0.12136800587177277, + "max_abs": 2.96875 + }, + "full_input": { + "shape": [ + 68, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f830b648524e4c28a79cab93a7563c622992ce55b05cdd650474578a9bd83386", + "mean": -0.006383808329701424, + "std": 1.006393313407898, + "rms": 1.006413459777832, + "max_abs": 135.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "71e9546f8b37c272810d21d58fce41e6546a70953c43ee4c5689aeeaf705d875", + "mean": -0.001888170139864087, + "std": 0.11974170058965683, + "rms": 0.11975659430027008, + "max_abs": 3.03125 + }, + "full_input": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b384872d78feb3927e9de2168e5333f046f87aee10580b624441c9f7866bafb4", + "mean": -0.0016596970381215215, + "std": 0.11718079447746277, + "rms": 0.11719254404306412, + "max_abs": 4.6875 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "40f717ba0c9340d98fa40f91a2c037798506744224ced9a3903d73b8ec8a8207", + "mean": -0.0020130339544266462, + "std": 0.11997555196285248, + "rms": 0.1199924424290657, + "max_abs": 3.0625 + }, + "full_input": { + "shape": [ + 68, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "660c59f89d35d27503e6f0877df7209dc6f58b71928218c2f80c7fcce8897447", + "mean": -0.002097326098009944, + "std": 0.11635968089103699, + "rms": 0.11637857556343079, + "max_abs": 4.6875 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "139c1eb4ebf90690dc450a1d9bd168743e14a6c6a2e0d5389260ffc0ee5541aa", + "mean": -0.0017758990870788693, + "std": 0.12008320540189743, + "rms": 0.12009633332490921, + "max_abs": 3.03125 + }, + "full_input": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "01b12fb66fb93d1b189ffd291f35379f1af5b156a82305bc45c18158ab02c2c4", + "mean": -0.0015995422145351768, + "std": 0.11750534921884537, + "rms": 0.11751624196767807, + "max_abs": 4.6875 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "84d90b73099806e1d14b7ef42e8466e5bfbbce2ebb26d2079284bcc549ef69df", + "mean": -0.0020237951539456844, + "std": 0.119675412774086, + "rms": 0.11969252675771713, + "max_abs": 3.0625 + }, + "full_input": { + "shape": [ + 68, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e2f4ccaf74f2e7e96066bbbe7c14c80b92cbc7ad7aed9d07e26319d3764186d0", + "mean": -0.0021095643751323223, + "std": 0.11634626239538193, + "rms": 0.11636538058519363, + "max_abs": 4.6875 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5ceb08066119f11c008dab9c61d0f81c5288b59df4e6c99991d2d76d7891e9bb", + "mean": -0.0017741051269695163, + "std": 0.12012603878974915, + "rms": 0.12013913691043854, + "max_abs": 3.046875 + }, + "full_input": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7c9d46b575088fc29bed37233e23be3603e75a821b94a8f10b942e4a909f9d6c", + "mean": -0.0016333574894815683, + "std": 0.11690668761730194, + "rms": 0.11691809445619583, + "max_abs": 4.6875 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9dc169494b03af35c4a614f479e44cf9dd7b1a140e4aa06b36966fd59266fc89", + "mean": -0.0020235993433743715, + "std": 0.11980579793453217, + "rms": 0.11982288211584091, + "max_abs": 3.078125 + }, + "full_input": { + "shape": [ + 68, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "426f289b23b227fe2fdfc861df4c7ef4d48c58e6185735dbae22c052ef1fcc38", + "mean": -0.002131132176145911, + "std": 0.11593665927648544, + "rms": 0.11595624685287476, + "max_abs": 4.6875 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9990628361701965, + "min_cosine_similarity": 0.996641993522644, + "mean_relative_l2": 0.04172980412840843, + "max_abs_delta": 0.05859375 + }, + "system_bos": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9971565008163452, + "min_cosine_similarity": 0.9920742511749268, + "mean_relative_l2": 0.07327145338058472, + "max_abs_delta": 0.078125 + }, + "system_x": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.996336042881012, + "min_cosine_similarity": 0.9871336221694946, + "mean_relative_l2": 0.08219315111637115, + "max_abs_delta": 0.078125 + }, + "system_period": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9965373277664185, + "min_cosine_similarity": 0.9881800413131714, + "mean_relative_l2": 0.07989123463630676, + "max_abs_delta": 0.078125 + }, + "bos_at_s0": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9872391819953918, + "min_cosine_similarity": 0.9667239189147949, + "mean_relative_l2": 0.15583206713199615, + "max_abs_delta": 0.234375 + }, + "bos_at_s1": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.987553060054779, + "min_cosine_similarity": 0.9656696319580078, + "mean_relative_l2": 0.15334953367710114, + "max_abs_delta": 0.2734375 + }, + "x_at_s0": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9875141978263855, + "min_cosine_similarity": 0.9683647751808167, + "mean_relative_l2": 0.15446217358112335, + "max_abs_delta": 0.3125 + }, + "x_at_s1": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9865407347679138, + "min_cosine_similarity": 0.9572372436523438, + "mean_relative_l2": 0.15840691328048706, + "max_abs_delta": 0.353515625 + }, + "period_at_s0": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9876274466514587, + "min_cosine_similarity": 0.9672366380691528, + "mean_relative_l2": 0.15367811918258667, + "max_abs_delta": 0.3125 + }, + "period_at_s1": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9867464900016785, + "min_cosine_similarity": 0.9569381475448608, + "mean_relative_l2": 0.1571045070886612, + "max_abs_delta": 0.3515625 + } + } + }, + "layer_02": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "622a152ed529e15ce7f7a046f5af3c01b537fa177d1e718cbf30a5630de79b8e", + "mean": -0.0025158505886793137, + "std": 0.1491730809211731, + "rms": 0.14919430017471313, + "max_abs": 3.859375 + }, + "full_input": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "640c2485f7eafcaa23a886aa703fdd09735cd18e286c728c6ca5cc07e9a64502", + "mean": -0.02016030065715313, + "std": 3.3284072875976562, + "rms": 3.3284685611724854, + "max_abs": 392.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "92d24f2ec875c05c805194b411ef551550d71ed107835fae722010f69c6b996a", + "mean": -0.0023360704071819782, + "std": 0.14932489395141602, + "rms": 0.14934316277503967, + "max_abs": 3.875 + }, + "full_input": { + "shape": [ + 68, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4e31081a82674f7a3dec06124a9925f3be4d2759c4fe344f2e70046494b75502", + "mean": -0.018345918506383896, + "std": 3.2229669094085693, + "rms": 3.2230193614959717, + "max_abs": 436.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "abb1a023d7854025b5284bb93bd39d7b4d613e2f6863b9e340971009ef417745", + "mean": -0.002703114179894328, + "std": 0.1476810723543167, + "rms": 0.1477058231830597, + "max_abs": 4.09375 + }, + "full_input": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f7108735621af6a60eb5ce52e12c2e86ed1af5191a159408b6627dc790981a52", + "mean": -0.002744120778515935, + "std": 0.26608386635780334, + "rms": 0.2660979926586151, + "max_abs": 23.875 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "faf8c2d89d99ace47fc91839e1116b37228bf3217b21ba3d5590c04b2db6128a", + "mean": -0.0025393483228981495, + "std": 0.14777489006519318, + "rms": 0.14779670536518097, + "max_abs": 4.0625 + }, + "full_input": { + "shape": [ + 68, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "778994b3aa5a77ad5e902e7a3ef1db048b9e8ba3b6c8f605169bdb54083b3a40", + "mean": -0.0025800527073442936, + "std": 0.24151253700256348, + "rms": 0.24152632057666779, + "max_abs": 23.875 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a5487aa225b12613750a4792a658d8f1b99404ba4a6aca720324de5240194a51", + "mean": -0.0024843309074640274, + "std": 0.14721916615962982, + "rms": 0.14724011719226837, + "max_abs": 4.09375 + }, + "full_input": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a290ab9fa56c5f8f81556f31b931cee8f05b3541f5141731a567491b28c60800", + "mean": -0.0026263068430125713, + "std": 0.2661559283733368, + "rms": 0.26616886258125305, + "max_abs": 23.875 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "72ae32d01e35f9d4be69a75dba64fa5bb7ac2a05b86a0eab2a3af25827e8cba0", + "mean": -0.0024361119139939547, + "std": 0.14641927182674408, + "rms": 0.14643952250480652, + "max_abs": 4.0 + }, + "full_input": { + "shape": [ + 68, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2e82ff1c5daa53f3f4535aa5b722925e40db2a20053f285972714d2ade87f78f", + "mean": -0.002536760875955224, + "std": 0.2412889152765274, + "rms": 0.2413022518157959, + "max_abs": 23.875 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "38b50b460e5a07697108686049938da58bea7c4b793feb77983c9edcbdbf8717", + "mean": -0.002436667215079069, + "std": 0.14718984067440033, + "rms": 0.1472100019454956, + "max_abs": 4.0625 + }, + "full_input": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "68edb3c05f21f63a457be815a89e7081434bdbd1e1d4e8b0077a7dd0a7510619", + "mean": -0.002711381996050477, + "std": 0.2655489146709442, + "rms": 0.2655627429485321, + "max_abs": 23.875 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "83b522c1500314ba257361f7fe27a154c1dca906d9e64e84b3cfc1cd2f9d08c6", + "mean": -0.0024266589898616076, + "std": 0.14660541713237762, + "rms": 0.14662550389766693, + "max_abs": 4.03125 + }, + "full_input": { + "shape": [ + 68, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7fc21565c54abd53624b123fb0a7be2fc6128f4a0974669cb3ec5138f8b50c8a", + "mean": -0.0025978153571486473, + "std": 0.24089227616786957, + "rms": 0.24090628325939178, + "max_abs": 23.875 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9982575178146362, + "min_cosine_similarity": 0.9949116706848145, + "mean_relative_l2": 0.056310731917619705, + "max_abs_delta": 0.09375 + }, + "system_bos": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9957826137542725, + "min_cosine_similarity": 0.9864341020584106, + "mean_relative_l2": 0.08943094313144684, + "max_abs_delta": 0.119140625 + }, + "system_x": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.994842529296875, + "min_cosine_similarity": 0.9837329983711243, + "mean_relative_l2": 0.09825547784566879, + "max_abs_delta": 0.126953125 + }, + "system_period": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.995024561882019, + "min_cosine_similarity": 0.9826174974441528, + "mean_relative_l2": 0.09639190882444382, + "max_abs_delta": 0.12890625 + }, + "bos_at_s0": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.987916111946106, + "min_cosine_similarity": 0.9757226705551147, + "mean_relative_l2": 0.15257319808006287, + "max_abs_delta": 0.31640625 + }, + "bos_at_s1": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9856477379798889, + "min_cosine_similarity": 0.9686756134033203, + "mean_relative_l2": 0.1656220406293869, + "max_abs_delta": 0.453125 + }, + "x_at_s0": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9859520792961121, + "min_cosine_similarity": 0.9710216522216797, + "mean_relative_l2": 0.16329070925712585, + "max_abs_delta": 0.42578125 + }, + "x_at_s1": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9818980097770691, + "min_cosine_similarity": 0.9549134969711304, + "mean_relative_l2": 0.18382282555103302, + "max_abs_delta": 0.55859375 + }, + "period_at_s0": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.985821545124054, + "min_cosine_similarity": 0.9695956707000732, + "mean_relative_l2": 0.164280503988266, + "max_abs_delta": 0.431640625 + }, + "period_at_s1": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9819300770759583, + "min_cosine_similarity": 0.9534428119659424, + "mean_relative_l2": 0.1837078332901001, + "max_abs_delta": 0.5546875 + } + } + }, + "layer_03": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2ed5182d858868f67b094f239bedc85c2c5099a18f7fd7d272983f0d3867529a", + "mean": -0.0033227524254471064, + "std": 0.1754165142774582, + "rms": 0.1754479855298996, + "max_abs": 4.875 + }, + "full_input": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a438972713c694a8e2cdac42e86ee39a2136591ab7dc4b474fd213345839b4db", + "mean": -0.026859231293201447, + "std": 9.99181079864502, + "rms": 9.991847038269043, + "max_abs": 1136.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "389a948bab978c2984055018b1e39290fcafeef1d0a53d76333c55bc89b38e45", + "mean": -0.0031596007756888866, + "std": 0.17559881508350372, + "rms": 0.1756272315979004, + "max_abs": 4.875 + }, + "full_input": { + "shape": [ + 68, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7d18952e277445aeadb212f166eff2ba918966be8b7c1c5c772d2baf727c278b", + "mean": -0.02402873896062374, + "std": 9.022814750671387, + "rms": 9.022847175598145, + "max_abs": 1136.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8dee5941cf205c2ad92baf7957ae09563b0008a1d1a5088091974fdd5774628b", + "mean": -0.003616247558966279, + "std": 0.17643365263938904, + "rms": 0.17647069692611694, + "max_abs": 4.96875 + }, + "full_input": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b0d86f47372f4129049e0e983a6febbe429640e805fbbfbe24b3b9c67110ef49", + "mean": -0.0075330245308578014, + "std": 8.91169548034668, + "rms": 8.911698341369629, + "max_abs": 1136.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1a020a3c9633bd00532c07cd949de35171cd84f0656a2b6ecb5423371713aa81", + "mean": -0.003714322578161955, + "std": 0.17737345397472382, + "rms": 0.17741234600543976, + "max_abs": 5.03125 + }, + "full_input": { + "shape": [ + 68, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6dc4c809b98703e83eb8e285005a19f7b9b7d97bef77b4ea69013d666072ef3f", + "mean": -0.006689998786896467, + "std": 7.793406009674072, + "rms": 7.7934088706970215, + "max_abs": 1136.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9614dd977f95b02cc62bab20f6dc141c338c429fdd3a59b209afd12676f6ae5f", + "mean": -0.003508423687890172, + "std": 0.17451636493206024, + "rms": 0.17455162107944489, + "max_abs": 5.0 + }, + "full_input": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "781f2b74eb4045957ef20038b3cc560fc5c898469440e77bc0111f641146eda5", + "mean": -0.007563514169305563, + "std": 8.911662101745605, + "rms": 8.911664962768555, + "max_abs": 1136.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "99c5cf3101f1b70a284c186abd8c33a53f40fa574d1a9eb203af314de3285085", + "mean": -0.003765201661735773, + "std": 0.17545107007026672, + "rms": 0.17549146711826324, + "max_abs": 5.0 + }, + "full_input": { + "shape": [ + 68, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "707b454157ee54f40dc2501db3f7f084ffa1bf8a5c49c3a61b8ae8aaaeb58e76", + "mean": -0.006786125712096691, + "std": 7.793378829956055, + "rms": 7.793381214141846, + "max_abs": 1136.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fb133bc7b32e7d48b75ebad9c39b94c1a39bac59651e76d2bd1e631171df9ea7", + "mean": -0.0034576973412185907, + "std": 0.17468154430389404, + "rms": 0.17471575736999512, + "max_abs": 5.0 + }, + "full_input": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4af3bcf12888747f02d656277601b4967e788fcabc90f7ca0900e50872dc41a1", + "mean": -0.00754430890083313, + "std": 8.911650657653809, + "rms": 8.911654472351074, + "max_abs": 1136.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a50ab4bdfaf9295b627d207f85beb68903c5213a64ddbf7b7182c3142dbd3c61", + "mean": -0.0037106822710484266, + "std": 0.1756727546453476, + "rms": 0.17571192979812622, + "max_abs": 5.03125 + }, + "full_input": { + "shape": [ + 68, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7e81b1f9e74c1a6128fce022767c7262206c46dd7670aa454d1e2ee02ce29736", + "mean": -0.006767296697944403, + "std": 7.793369770050049, + "rms": 7.793372631072998, + "max_abs": 1136.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9984024167060852, + "min_cosine_similarity": 0.9946848154067993, + "mean_relative_l2": 0.054193444550037384, + "max_abs_delta": 0.109375 + }, + "system_bos": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9955217838287354, + "min_cosine_similarity": 0.9851089715957642, + "mean_relative_l2": 0.09276571869850159, + "max_abs_delta": 0.15625 + }, + "system_x": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9939051866531372, + "min_cosine_similarity": 0.979778528213501, + "mean_relative_l2": 0.10718189924955368, + "max_abs_delta": 0.17578125 + }, + "system_period": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9941351413726807, + "min_cosine_similarity": 0.9790130257606506, + "mean_relative_l2": 0.10461825877428055, + "max_abs_delta": 0.18359375 + }, + "bos_at_s0": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.989159107208252, + "min_cosine_similarity": 0.9798761606216431, + "mean_relative_l2": 0.14598257839679718, + "max_abs_delta": 0.26953125 + }, + "bos_at_s1": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9865503907203674, + "min_cosine_similarity": 0.9734470844268799, + "mean_relative_l2": 0.16277357935905457, + "max_abs_delta": 0.4296875 + }, + "x_at_s0": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9871556758880615, + "min_cosine_similarity": 0.9728318452835083, + "mean_relative_l2": 0.1572219878435135, + "max_abs_delta": 0.38671875 + }, + "x_at_s1": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9824585914611816, + "min_cosine_similarity": 0.9597371220588684, + "mean_relative_l2": 0.18224093317985535, + "max_abs_delta": 0.55859375 + }, + "period_at_s0": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9870142340660095, + "min_cosine_similarity": 0.9728780388832092, + "mean_relative_l2": 0.15870225429534912, + "max_abs_delta": 0.3984375 + }, + "period_at_s1": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9823318719863892, + "min_cosine_similarity": 0.958983838558197, + "mean_relative_l2": 0.1832798272371292, + "max_abs_delta": 0.57421875 + } + } + }, + "layer_04": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "23f2e66939a0df716d1d1dea5a78042d34808631a3a24358d6eec5d24ea13f0c", + "mean": -0.0036751823499798775, + "std": 0.20611287653446198, + "rms": 0.20614562928676605, + "max_abs": 5.8125 + }, + "full_input": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "189598c9d4b1575893de889bd657fa5204f54403e6d48a52bf0a624def959f7d", + "mean": -0.026781022548675537, + "std": 10.426584243774414, + "rms": 10.426619529724121, + "max_abs": 1152.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c281af5844d403878d9c6f59327a5f9fd444f218bae4c7fd5ab5fd860b67c232", + "mean": -0.0035520801320672035, + "std": 0.2068246752023697, + "rms": 0.2068551629781723, + "max_abs": 5.90625 + }, + "full_input": { + "shape": [ + 68, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2033d8ae0c779badddfb002baa75f29ec21cc10354e786f6c8a26b7dedba032b", + "mean": -0.02404138445854187, + "std": 9.389299392700195, + "rms": 9.389328956604004, + "max_abs": 1152.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "abc7e8cff8ecae6a58e3bb5bcbcc63f120a180b1b6b71f330ab1fa776c50a468", + "mean": -0.0039005351718515158, + "std": 0.20906773209571838, + "rms": 0.20910410583019257, + "max_abs": 5.96875 + }, + "full_input": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "892ef41be811b8e5027fc2dd6344f2aa05df0f53cdaa370c9e6307438a7a949c", + "mean": -0.007338821422308683, + "std": 9.346943855285645, + "rms": 9.346946716308594, + "max_abs": 1152.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "56d0952a5102fc56ee40a7516add487b098f03e79ec1345d49637b6efc898dd3", + "mean": -0.004049169365316629, + "std": 0.20959189534187317, + "rms": 0.20963101089000702, + "max_abs": 5.9375 + }, + "full_input": { + "shape": [ + 68, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "40792b03f772f28c00e0b198e4e944313d599b1250bf94daec6bf602935d8230", + "mean": -0.0066447933204472065, + "std": 8.1647367477417, + "rms": 8.164738655090332, + "max_abs": 1152.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ab066fcddc66604cb1b6b59a22fb5595d26cd6e4334f2d97552c5102e5746891", + "mean": -0.0036510643549263477, + "std": 0.20545275509357452, + "rms": 0.20548518002033234, + "max_abs": 5.5 + }, + "full_input": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9dd8503d6694d8f08e9dc30818a91baaef943c19521f937018b226be426d1f27", + "mean": -0.007180006243288517, + "std": 9.346866607666016, + "rms": 9.346870422363281, + "max_abs": 1152.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "dcc7f701a6caa7f27396958ab193a0ccf7d18ea379a1b474171f6446c15d93d5", + "mean": -0.003980767913162708, + "std": 0.20601849257946014, + "rms": 0.20605693757534027, + "max_abs": 5.5 + }, + "full_input": { + "shape": [ + 68, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "48b028d1d4b9fae5ef58b1f6beee287f7df8ef8b28b64d0dbcdad3241474fcfb", + "mean": -0.006618542596697807, + "std": 8.164667129516602, + "rms": 8.16466999053955, + "max_abs": 1152.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "177aa3d40c98679433f587bcbcfe68fe55e7274190a93ff3e4e8dc96925d0056", + "mean": -0.003635500557720661, + "std": 0.20584352314472198, + "rms": 0.20587562024593353, + "max_abs": 5.53125 + }, + "full_input": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "dbd20a3fa1fb417b91e18e556c5374c6ae463a3a12d82b2b9b9b079c121d3d8f", + "mean": -0.007200310938060284, + "std": 9.346858024597168, + "rms": 9.346860885620117, + "max_abs": 1152.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f8fd416f02a48559e19e83be5806b3f24f616fa317f9cfbaff2d8b38af64e8f3", + "mean": -0.0039537339471280575, + "std": 0.20609112083911896, + "rms": 0.2061290442943573, + "max_abs": 5.53125 + }, + "full_input": { + "shape": [ + 68, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "668232541e4a50941afa3a6fe2e809afc9e453a786a5d7bcee4cbb99766b6219", + "mean": -0.0066035534255206585, + "std": 8.164656639099121, + "rms": 8.16465950012207, + "max_abs": 1152.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9984531998634338, + "min_cosine_similarity": 0.9946528673171997, + "mean_relative_l2": 0.05289545655250549, + "max_abs_delta": 0.09765625 + }, + "system_bos": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9954583048820496, + "min_cosine_similarity": 0.9871481657028198, + "mean_relative_l2": 0.09276706725358963, + "max_abs_delta": 0.267578125 + }, + "system_x": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.993195652961731, + "min_cosine_similarity": 0.9795172214508057, + "mean_relative_l2": 0.1123989149928093, + "max_abs_delta": 0.30859375 + }, + "system_period": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9934601187705994, + "min_cosine_similarity": 0.9791436195373535, + "mean_relative_l2": 0.11024603992700577, + "max_abs_delta": 0.3203125 + }, + "bos_at_s0": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9911800026893616, + "min_cosine_similarity": 0.9826772212982178, + "mean_relative_l2": 0.13207027316093445, + "max_abs_delta": 0.375 + }, + "bos_at_s1": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9884423017501831, + "min_cosine_similarity": 0.9781366586685181, + "mean_relative_l2": 0.15105222165584564, + "max_abs_delta": 0.46875 + }, + "x_at_s0": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.988538384437561, + "min_cosine_similarity": 0.9742662906646729, + "mean_relative_l2": 0.14868856966495514, + "max_abs_delta": 0.421875 + }, + "x_at_s1": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9828857779502869, + "min_cosine_similarity": 0.9641147255897522, + "mean_relative_l2": 0.18121099472045898, + "max_abs_delta": 0.6484375 + }, + "period_at_s0": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.987435519695282, + "min_cosine_similarity": 0.9733411073684692, + "mean_relative_l2": 0.15536564588546753, + "max_abs_delta": 0.4140625 + }, + "period_at_s1": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9824333190917969, + "min_cosine_similarity": 0.9616862535476685, + "mean_relative_l2": 0.1833486557006836, + "max_abs_delta": 0.6640625 + } + } + }, + "layer_05": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f0728671dcbff529dddeaa729f88ca80fb2a6ccdab939a672effc9d7f040b793", + "mean": -0.002670255722478032, + "std": 0.22958536446094513, + "rms": 0.22960089147090912, + "max_abs": 5.15625 + }, + "full_input": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "24fa66033d18641467ff31ca7fc814a1669403959e33a938903dcebefff90689", + "mean": -0.029117543250322342, + "std": 10.743420600891113, + "rms": 10.743460655212402, + "max_abs": 1152.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "87e7d16b90a0909ebab62959e48692dd8969d34f990731c8190748ab23101cc0", + "mean": -0.002472497522830963, + "std": 0.23017574846744537, + "rms": 0.2301890105009079, + "max_abs": 5.125 + }, + "full_input": { + "shape": [ + 68, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "695392eb6e439a82d3d0a8043625a207368961b66c33be53aa88a595f216a1e2", + "mean": -0.025613443925976753, + "std": 9.679856300354004, + "rms": 9.679889678955078, + "max_abs": 1152.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fd975d1d404ef869ced4647244495f76949ea972fe0c4399f4b1311cb3f85a14", + "mean": -0.002714435337111354, + "std": 0.23379310965538025, + "rms": 0.23380886018276215, + "max_abs": 5.28125 + }, + "full_input": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "992d8e2c2e0a8c6e38275c8e569aea145572f5935059f97a851c05b561833688", + "mean": -0.0076157161965966225, + "std": 9.509991645812988, + "rms": 9.509994506835938, + "max_abs": 1152.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0f2fb986caf73079713055839e61bb4abe51d00dac40c3c480e25f09bf18ece0", + "mean": -0.0028687184676527977, + "std": 0.23479177057743073, + "rms": 0.2348092943429947, + "max_abs": 5.375 + }, + "full_input": { + "shape": [ + 68, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2aec2717466540fec09e94b0d35e1f4133903c95706bfcc62c7781a2a69096a8", + "mean": -0.006598147563636303, + "std": 8.307488441467285, + "rms": 8.307491302490234, + "max_abs": 1152.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "77b845677bad37c269db6bbb930eac07e2234f77960b421025dc9793be63d461", + "mean": -0.002690679393708706, + "std": 0.23077158629894257, + "rms": 0.2307872623205185, + "max_abs": 5.125 + }, + "full_input": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b386840b2e5728b5d8b042647f7409aded6221f181415b460cb45232f8f7a271", + "mean": -0.0074622007086873055, + "std": 9.509916305541992, + "rms": 9.509919166564941, + "max_abs": 1152.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "df6580fac154da2da7745d56a69e085b1dbc385b97e1400b8aa7919dda08728b", + "mean": -0.0030856728553771973, + "std": 0.23106807470321655, + "rms": 0.23108868300914764, + "max_abs": 5.3125 + }, + "full_input": { + "shape": [ + 68, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4f419b0236cddd2d8eba547a5442fc6118df7393d0f80c04030fc9a91627bd5e", + "mean": -0.006629641633480787, + "std": 8.307412147521973, + "rms": 8.307415008544922, + "max_abs": 1152.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "946b056e25e90b6cf56c86ab1872b5f45d0f2c89acd981eda4db37c62a7e54f1", + "mean": -0.002726699924096465, + "std": 0.2312113493680954, + "rms": 0.23122742772102356, + "max_abs": 5.03125 + }, + "full_input": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "03b0f96a99e659fbfecd000052ca41c1ff81b7fcb7fe00479167325c3e3a32c7", + "mean": -0.007466453127563, + "std": 9.50989818572998, + "rms": 9.50990104675293, + "max_abs": 1152.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "38411d3b176919ce5621ba1d4f7b84cd4e7690484d1b0e33d98acf338e8651e4", + "mean": -0.0030909625347703695, + "std": 0.23056748509407043, + "rms": 0.23058819770812988, + "max_abs": 5.1875 + }, + "full_input": { + "shape": [ + 68, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "341107b886205607716aaed20c17b7f9dc25eacd51e9e3a6e2cee4ddc2b0030a", + "mean": -0.006640804931521416, + "std": 8.307389259338379, + "rms": 8.307392120361328, + "max_abs": 1152.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9972324371337891, + "min_cosine_similarity": 0.9797003269195557, + "mean_relative_l2": 0.06610672175884247, + "max_abs_delta": 0.26953125 + }, + "system_bos": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9937533140182495, + "min_cosine_similarity": 0.9712330102920532, + "mean_relative_l2": 0.10520196706056595, + "max_abs_delta": 0.375 + }, + "system_x": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9900203943252563, + "min_cosine_similarity": 0.9588322639465332, + "mean_relative_l2": 0.1325853168964386, + "max_abs_delta": 0.408203125 + }, + "system_period": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.989772379398346, + "min_cosine_similarity": 0.9471967816352844, + "mean_relative_l2": 0.1311989426612854, + "max_abs_delta": 0.41015625 + }, + "bos_at_s0": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9907703399658203, + "min_cosine_similarity": 0.9758702516555786, + "mean_relative_l2": 0.13518421351909637, + "max_abs_delta": 0.640625 + }, + "bos_at_s1": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9873654842376709, + "min_cosine_similarity": 0.9709981679916382, + "mean_relative_l2": 0.15886908769607544, + "max_abs_delta": 0.78125 + }, + "x_at_s0": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9872351288795471, + "min_cosine_similarity": 0.9594917893409729, + "mean_relative_l2": 0.1550799161195755, + "max_abs_delta": 0.671875 + }, + "x_at_s1": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9793895483016968, + "min_cosine_similarity": 0.9475945234298706, + "mean_relative_l2": 0.19794441759586334, + "max_abs_delta": 0.7109375 + }, + "period_at_s0": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9857787489891052, + "min_cosine_similarity": 0.960291862487793, + "mean_relative_l2": 0.1639086753129959, + "max_abs_delta": 0.609375 + }, + "period_at_s1": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9791562557220459, + "min_cosine_similarity": 0.9368318915367126, + "mean_relative_l2": 0.1980656385421753, + "max_abs_delta": 0.765625 + } + } + }, + "layer_06": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d126ebd28a3551e2e85d388e405e93a5e825cec0b7478b4d8d3876e5c99986ef", + "mean": -0.003614128101617098, + "std": 0.2654799222946167, + "rms": 0.26550453901290894, + "max_abs": 6.9375 + }, + "full_input": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5ea4be740360b835b670eca59f607da12b871cf12dcda31a63c3a32da1515eb4", + "mean": -0.03103950247168541, + "std": 10.9391508102417, + "rms": 10.93919563293457, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a4590b4aac1b2384f4130a3638fcc14d334e841300bf3bc7f36364a1aa2bb35d", + "mean": -0.0032865835819393396, + "std": 0.26606857776641846, + "rms": 0.2660888433456421, + "max_abs": 6.65625 + }, + "full_input": { + "shape": [ + 68, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2c87b0d3a4ad8eaf2ce3aa49b89410032306e033556498f07344b9dc11e2268f", + "mean": -0.027323372662067413, + "std": 9.855735778808594, + "rms": 9.855772972106934, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4cc8e87b3ab6efd3e40c93c640fe3629fe71c005a7d414dac3577cfefc51a305", + "mean": -0.00347351748496294, + "std": 0.26973918080329895, + "rms": 0.2697615623474121, + "max_abs": 7.28125 + }, + "full_input": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b3ada8350b9e34c819d4c851502e0c70b5fbb92443138eb2a5e8702797bc6cd3", + "mean": -0.008845442906022072, + "std": 9.66265869140625, + "rms": 9.662663459777832, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "dac10b35132b2816aa948d4dcb1f1dbc7aff33579222a485c3c9f3ec3836e80e", + "mean": -0.0033425879664719105, + "std": 0.27102258801460266, + "rms": 0.27104321122169495, + "max_abs": 7.09375 + }, + "full_input": { + "shape": [ + 68, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b1404e25d04aff72f48d55805c955ac4b9f37138d40661acf01e67ef27292c0b", + "mean": -0.007661842275410891, + "std": 8.441152572631836, + "rms": 8.441155433654785, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b89d0954f478c3630bd1265516b1d3f993511dc0b4334b83b9956eef2bc0879b", + "mean": -0.003330385312438011, + "std": 0.2686136066913605, + "rms": 0.26863422989845276, + "max_abs": 7.0 + }, + "full_input": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2b431df16391ead084aa13c3b93b82b73bf615bf1e2c91f2e1ccbf3b2db6af35", + "mean": -0.008547846227884293, + "std": 9.662599563598633, + "rms": 9.662604331970215, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a05cab94fad22bdac630d7cc260141ae8974f0e35b1c984c7394e2857b9042cd", + "mean": -0.0031912592239677906, + "std": 0.2678239643573761, + "rms": 0.26784297823905945, + "max_abs": 6.6875 + }, + "full_input": { + "shape": [ + 68, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a65e2e70b0a1f65484b8b792a156130d27f78e735f180348fc292b260ea9b3d7", + "mean": -0.007417505141347647, + "std": 8.441065788269043, + "rms": 8.441068649291992, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1d88a036d555d363627f4fe2ec2961b1d32a70d3cb52dc697871385132a92d1d", + "mean": -0.0034036634024232626, + "std": 0.26812508702278137, + "rms": 0.26814669370651245, + "max_abs": 6.875 + }, + "full_input": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5cdf597775e68890e90dd501584b385b063e25726a66794468477942840dc24c", + "mean": -0.00854156818240881, + "std": 9.662579536437988, + "rms": 9.662583351135254, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "034ca805a7adb067819704d27ef85ba8e92412a7bd5e8220d721deff62d1d0ed", + "mean": -0.00329026416875422, + "std": 0.2671894431114197, + "rms": 0.2672096788883209, + "max_abs": 6.5 + }, + "full_input": { + "shape": [ + 68, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "37588e7898a25db1fbe9815adf3f9b577c5cfca2f5ce670453091a7ac4917335", + "mean": -0.00746631994843483, + "std": 8.441045761108398, + "rms": 8.441049575805664, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9963886141777039, + "min_cosine_similarity": 0.9664760828018188, + "mean_relative_l2": 0.0734407976269722, + "max_abs_delta": 0.625 + }, + "system_bos": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9936434626579285, + "min_cosine_similarity": 0.9564247131347656, + "mean_relative_l2": 0.1051240861415863, + "max_abs_delta": 0.875 + }, + "system_x": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9900889992713928, + "min_cosine_similarity": 0.9399335384368896, + "mean_relative_l2": 0.13058723509311676, + "max_abs_delta": 0.5 + }, + "system_period": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9894789457321167, + "min_cosine_similarity": 0.9223855137825012, + "mean_relative_l2": 0.13064011931419373, + "max_abs_delta": 0.625 + }, + "bos_at_s0": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9911035895347595, + "min_cosine_similarity": 0.9751325845718384, + "mean_relative_l2": 0.13126911222934723, + "max_abs_delta": 0.84375 + }, + "bos_at_s1": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9882420897483826, + "min_cosine_similarity": 0.9670210480690002, + "mean_relative_l2": 0.15263742208480835, + "max_abs_delta": 1.09375 + }, + "x_at_s0": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9871079325675964, + "min_cosine_similarity": 0.9391735196113586, + "mean_relative_l2": 0.1551518589258194, + "max_abs_delta": 1.46875 + }, + "x_at_s1": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.979060709476471, + "min_cosine_similarity": 0.9185341596603394, + "mean_relative_l2": 0.1989646852016449, + "max_abs_delta": 1.28125 + }, + "period_at_s0": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9856398105621338, + "min_cosine_similarity": 0.9444316625595093, + "mean_relative_l2": 0.1641639620065689, + "max_abs_delta": 1.28125 + }, + "period_at_s1": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9782136082649231, + "min_cosine_similarity": 0.9073562622070312, + "mean_relative_l2": 0.20170935988426208, + "max_abs_delta": 1.21875 + } + } + }, + "layer_07": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "94e764a8a55a3b8fc8f941fd8639ae3146e6d571752b29e5f26c1b68ab71313c", + "mean": -0.004185777623206377, + "std": 0.29298895597457886, + "rms": 0.2930188477039337, + "max_abs": 7.5625 + }, + "full_input": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c58858a1208dae043354bdee4b1028a0e99ef4e8e083ea2dc4c9ff84abcbd400", + "mean": -0.031118301674723625, + "std": 10.97108268737793, + "rms": 10.971126556396484, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bb60e44bb3849b8043722e0e474eb8ee55a65d438317e92afcf30ed546eb850e", + "mean": -0.003816175740212202, + "std": 0.29428502917289734, + "rms": 0.2943097949028015, + "max_abs": 7.65625 + }, + "full_input": { + "shape": [ + 68, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "49ed5b0d4494a627415c1c2c6d65cf5339c92f9baa2d08eb0b5092b9a51d97a4", + "mean": -0.028122693300247192, + "std": 9.885037422180176, + "rms": 9.885077476501465, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "658bb3498217d5df0bbc04691296f04cff4006d8ad7a47443fa70619388f7785", + "mean": -0.0038403773214668036, + "std": 0.2971436381340027, + "rms": 0.29716846346855164, + "max_abs": 7.40625 + }, + "full_input": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8743cb8c4c552dacfc01f839e66ff7b29e13e4347ea2096fada60b6970d420e6", + "mean": -0.008908414281904697, + "std": 9.680474281311035, + "rms": 9.680479049682617, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e9b9cedb5e016f3648a49c2aa2d12a826901bb7f7e84c9e22f208ecafbf82c06", + "mean": -0.0036158154252916574, + "std": 0.2982797622680664, + "rms": 0.29830166697502136, + "max_abs": 7.65625 + }, + "full_input": { + "shape": [ + 68, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e3592ae0870edb1398c62f0fb487f8346b94e735595e8d4955ddf634b3b9d25d", + "mean": -0.00837934110313654, + "std": 8.456939697265625, + "rms": 8.456944465637207, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "010a0ca94f1064a8811e6f984f905b5aa2eac8ed0444f9947c3f79622c49cc55", + "mean": -0.0035843481309711933, + "std": 0.29453137516975403, + "rms": 0.2945531904697418, + "max_abs": 7.1875 + }, + "full_input": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5b3823eb7e15bb20fc84935294b52f3c7a43a3e8127ac02782c64a15c306129a", + "mean": -0.0087431026622653, + "std": 9.680367469787598, + "rms": 9.680371284484863, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a7b2a187024ae567c6c4fa7bbe2d85144f5d3c1f140b0722280950740fc1dcb4", + "mean": -0.0032610204070806503, + "std": 0.29405128955841064, + "rms": 0.2940693795681, + "max_abs": 7.28125 + }, + "full_input": { + "shape": [ + 68, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "148528ae153d947b5b75a8465a284e66d011f29abc937e27ce534ddfd6fc048f", + "mean": -0.00818630401045084, + "std": 8.456823348999023, + "rms": 8.456827163696289, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9c326fdf09532643415bfbcd7cc1dcd15dcf879853b790bf9dbb94775548cbda", + "mean": -0.003802895313128829, + "std": 0.2945382297039032, + "rms": 0.29456278681755066, + "max_abs": 7.09375 + }, + "full_input": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2f1fa8561d2ab723f1e1d9c865e7333b1fc84d172f4ebadf309ed01601c6f940", + "mean": -0.008623549714684486, + "std": 9.680365562438965, + "rms": 9.68036937713623, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5e5298e641dead38e1c52702c4a83a559e264384e04c9d6099906c0f3713537b", + "mean": -0.003423520363867283, + "std": 0.2942783236503601, + "rms": 0.2942982316017151, + "max_abs": 7.15625 + }, + "full_input": { + "shape": [ + 68, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a5f879cc65a01d4b89f58f8a11f8e4cd395891e75580aedb88abfcaac1bb5376", + "mean": -0.008157717064023018, + "std": 8.456826210021973, + "rms": 8.456830978393555, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9962706565856934, + "min_cosine_similarity": 0.9656151533126831, + "mean_relative_l2": 0.07431674748659134, + "max_abs_delta": 0.2734375 + }, + "system_bos": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9931697249412537, + "min_cosine_similarity": 0.9515886306762695, + "mean_relative_l2": 0.10799947381019592, + "max_abs_delta": 0.34765625 + }, + "system_x": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9893315434455872, + "min_cosine_similarity": 0.9258612394332886, + "mean_relative_l2": 0.1336749792098999, + "max_abs_delta": 0.546875 + }, + "system_period": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.988149106502533, + "min_cosine_similarity": 0.8998363018035889, + "mean_relative_l2": 0.1366078108549118, + "max_abs_delta": 0.6875 + }, + "bos_at_s0": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9905973076820374, + "min_cosine_similarity": 0.9745343923568726, + "mean_relative_l2": 0.13419535756111145, + "max_abs_delta": 0.5 + }, + "bos_at_s1": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9879428148269653, + "min_cosine_similarity": 0.9665156006813049, + "mean_relative_l2": 0.15304090082645416, + "max_abs_delta": 0.625 + }, + "x_at_s0": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9863075613975525, + "min_cosine_similarity": 0.9339867830276489, + "mean_relative_l2": 0.15754705667495728, + "max_abs_delta": 0.75 + }, + "x_at_s1": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9778482913970947, + "min_cosine_similarity": 0.9068104028701782, + "mean_relative_l2": 0.20215965807437897, + "max_abs_delta": 0.78125 + }, + "period_at_s0": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9843664765357971, + "min_cosine_similarity": 0.9401149153709412, + "mean_relative_l2": 0.168824702501297, + "max_abs_delta": 0.6875 + }, + "period_at_s1": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9768203496932983, + "min_cosine_similarity": 0.8935703039169312, + "mean_relative_l2": 0.2057202011346817, + "max_abs_delta": 0.859375 + } + } + }, + "layer_08": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "83f950f6a5053a29f5f90db3086fd21abad3537477407e45c53262384f3c68a4", + "mean": -0.005043369717895985, + "std": 0.33913108706474304, + "rms": 0.33916860818862915, + "max_abs": 9.0 + }, + "full_input": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8d116afccc750aa41cd1e1ce44faeaf30be7570ccb3c656defbc20d547d163a3", + "mean": -0.03190343827009201, + "std": 11.008183479309082, + "rms": 11.008230209350586, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4468f7bd6a6a2ce51f86fb5b4dfc57fd2eecd51b60306fe820632d8ccc4a2b4e", + "mean": -0.004558066371828318, + "std": 0.3399341404438019, + "rms": 0.33996468782424927, + "max_abs": 9.125 + }, + "full_input": { + "shape": [ + 68, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1f1cdaa443ad09a2469c0ee53482b8903d3fcee043935ea7ca9e76511fa12d74", + "mean": -0.02833552472293377, + "std": 9.919092178344727, + "rms": 9.919132232666016, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "548d4b95cf50b5cb03b8bddfcd065a2ad7ed44a806c076f6b0933bfad589738e", + "mean": -0.004891825374215841, + "std": 0.3441741168498993, + "rms": 0.34420889616012573, + "max_abs": 9.0 + }, + "full_input": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c581b8474d1fd6695c1a16d84fb3b2d82f7e74a1d064c5ce975a495bbbe0112c", + "mean": -0.0099204545840621, + "std": 9.701212882995605, + "rms": 9.701217651367188, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f439142a8ee9f67779d18b41e0f9b99c7d9cbaca6883cef64a7fb52e628c9a58", + "mean": -0.004544595722109079, + "std": 0.34526723623275757, + "rms": 0.3452971279621124, + "max_abs": 9.1875 + }, + "full_input": { + "shape": [ + 68, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5148a1558cc677b87fa7315442ea268b53d27c681b37d83e8d481c551bc979c9", + "mean": -0.008841043338179588, + "std": 8.475237846374512, + "rms": 8.475242614746094, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "07de0bd86ea929e684027287572fa759bc9100593874f3787d575ff4db87c7b2", + "mean": -0.0045320456847548485, + "std": 0.34123799204826355, + "rms": 0.34126806259155273, + "max_abs": 8.75 + }, + "full_input": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "085680ad502b1f78bfbbd5c7ce59d94af1de4cc9268f90dbf9fae22117bf0036", + "mean": -0.009706477634608746, + "std": 9.701116561889648, + "rms": 9.70112133026123, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ef34a50c66b0725303723e93d2600635abea472c0e9c7d81ea02e0a6a746adf3", + "mean": -0.004187708720564842, + "std": 0.3398197293281555, + "rms": 0.3398455083370209, + "max_abs": 8.5625 + }, + "full_input": { + "shape": [ + 68, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9e38a5b08bd8d2d5e6fdf3e12ddce878ff1f9fe2d874e9e2082fd9f62294f625", + "mean": -0.008571866899728775, + "std": 8.475118637084961, + "rms": 8.475122451782227, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "83ae27538448a7ac489abc55531b8c0138251bd7fbab8ed4bab0f88191516ba9", + "mean": -0.004948275163769722, + "std": 0.34131258726119995, + "rms": 0.34134843945503235, + "max_abs": 8.6875 + }, + "full_input": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "979969a5ba5c25c5293efa38fb016d2a9d5f48090bc99c9816437d9d01f16fca", + "mean": -0.00992249883711338, + "std": 9.701120376586914, + "rms": 9.701125144958496, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "afe43173729235ea402cf7b7e236c8a1dd2bf4bfa559c094a80cd36732e99148", + "mean": -0.004608032759279013, + "std": 0.3408166170120239, + "rms": 0.34084776043891907, + "max_abs": 8.5625 + }, + "full_input": { + "shape": [ + 68, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8933501030f17aa56e6ee32feae48c8413ae391de7cf2fbe4c40a8d3fefdb28a", + "mean": -0.00870276428759098, + "std": 8.475123405456543, + "rms": 8.475127220153809, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9956328868865967, + "min_cosine_similarity": 0.9638150930404663, + "mean_relative_l2": 0.08148761093616486, + "max_abs_delta": 0.40625 + }, + "system_bos": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9928146004676819, + "min_cosine_similarity": 0.9529891610145569, + "mean_relative_l2": 0.11207824945449829, + "max_abs_delta": 0.3984375 + }, + "system_x": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9860554933547974, + "min_cosine_similarity": 0.8672336339950562, + "mean_relative_l2": 0.1463627815246582, + "max_abs_delta": 0.9140625 + }, + "system_period": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9851581454277039, + "min_cosine_similarity": 0.8482965230941772, + "mean_relative_l2": 0.14881494641304016, + "max_abs_delta": 1.09375 + }, + "bos_at_s0": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9899001121520996, + "min_cosine_similarity": 0.9716143608093262, + "mean_relative_l2": 0.13964569568634033, + "max_abs_delta": 0.53125 + }, + "bos_at_s1": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.987280547618866, + "min_cosine_similarity": 0.9637556076049805, + "mean_relative_l2": 0.15710468590259552, + "max_abs_delta": 0.8125 + }, + "x_at_s0": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9849851131439209, + "min_cosine_similarity": 0.9255826473236084, + "mean_relative_l2": 0.16516801714897156, + "max_abs_delta": 0.8125 + }, + "x_at_s1": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.973090410232544, + "min_cosine_similarity": 0.8415552377700806, + "mean_relative_l2": 0.21763162314891815, + "max_abs_delta": 1.2109375 + }, + "period_at_s0": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9825707674026489, + "min_cosine_similarity": 0.9324482679367065, + "mean_relative_l2": 0.17918367683887482, + "max_abs_delta": 0.84375 + }, + "period_at_s1": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9723613262176514, + "min_cosine_similarity": 0.8387013673782349, + "mean_relative_l2": 0.22113102674484253, + "max_abs_delta": 1.28125 + } + } + }, + "layer_09": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "25be5e19b54ce304fff96354b688d3f1809574edf9c087f7cebcad0605485ace", + "mean": -0.006751317530870438, + "std": 0.393456369638443, + "rms": 0.3935142755508423, + "max_abs": 11.8125 + }, + "full_input": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "839d6ba7e5a33ffe2ee93fca1057a1b1b12caa63f83aaf0a6ea67d6e2752996c", + "mean": -0.032533079385757446, + "std": 11.010464668273926, + "rms": 11.010513305664062, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7da61e1d328ef85090c183013f2d1c7f8cb1a12c4ff613f93a8a0b8a86449548", + "mean": -0.006351821590214968, + "std": 0.39384931325912476, + "rms": 0.3939005136489868, + "max_abs": 11.75 + }, + "full_input": { + "shape": [ + 68, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "10c1b826dbeb9ee7afd2bc44dc8c77d9e1060dcaea5a84bd801212b33d29ba68", + "mean": -0.0297933891415596, + "std": 9.921300888061523, + "rms": 9.921344757080078, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2fe95c0c557a55d667978cb081c1f3926b840606a9cabebb99527ddd83725461", + "mean": -0.006916311103850603, + "std": 0.3967074155807495, + "rms": 0.3967677056789398, + "max_abs": 11.75 + }, + "full_input": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3708ec498a5f814f4b366c2e8d9141a641bbfcc2e5696bc3c4b6d4707612ba0e", + "mean": -0.010926001705229282, + "std": 9.703652381896973, + "rms": 9.703659057617188, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "80fa700a121f79277fbe43543c1c20e46e6b6874370e5a3aea5d3f56bd85d0b3", + "mean": -0.006650387309491634, + "std": 0.3978319764137268, + "rms": 0.39788752794265747, + "max_abs": 11.75 + }, + "full_input": { + "shape": [ + 68, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "deb9841abc5282e9211be2adb0700115451b550930caedcbea60131315491186", + "mean": -0.010655706748366356, + "std": 8.47776985168457, + "rms": 8.477775573730469, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "215dc1cfcb177714047ac60b53f0558f8edf839de6c9dedb2a49e1561f322cd3", + "mean": -0.006773036904633045, + "std": 0.3943082392215729, + "rms": 0.39436638355255127, + "max_abs": 11.875 + }, + "full_input": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "24e7712c5ab6ea8c2f516e65be609ba46c30d16cd42714be84a7f064dc94170f", + "mean": -0.010666459798812866, + "std": 9.703546524047852, + "rms": 9.703553199768066, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a5ecbaf205f1e73d1658c9179a77de4a6050939b2433df4caf6c39e6ae567c46", + "mean": -0.006588663440197706, + "std": 0.3915645182132721, + "rms": 0.3916199505329132, + "max_abs": 11.375 + }, + "full_input": { + "shape": [ + 68, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ba6178e6f622328a2dce77ac1b627919c54e0561b333f6bddacc863caef99d57", + "mean": -0.010461710393428802, + "std": 8.477577209472656, + "rms": 8.477582931518555, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1c670de956d2ab9693998484d5e9c748a931a0bdc55325d144741170a486bffa", + "mean": -0.007455444894731045, + "std": 0.3939844071865082, + "rms": 0.39405494928359985, + "max_abs": 11.75 + }, + "full_input": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f8d66b88fa573091e189967b6fdf421ae3d48cd05bdf7d4a069adb8b29b3294c", + "mean": -0.010844101198017597, + "std": 9.70350170135498, + "rms": 9.703508377075195, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6d9b32ea141c722ea0365fe738048883b91e9109a731fa6062c26c3e7c671880", + "mean": -0.0071185859851539135, + "std": 0.39225003123283386, + "rms": 0.3923145830631256, + "max_abs": 11.375 + }, + "full_input": { + "shape": [ + 68, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4603e5f64e6ec4ae4dea66336f8a2a1b55c35929cfbed4af9caef6dad0c40e43", + "mean": -0.01049470528960228, + "std": 8.477553367614746, + "rms": 8.477558135986328, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9958933591842651, + "min_cosine_similarity": 0.9682196378707886, + "mean_relative_l2": 0.08044540137052536, + "max_abs_delta": 0.6875 + }, + "system_bos": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9930654168128967, + "min_cosine_similarity": 0.949394941329956, + "mean_relative_l2": 0.1087476834654808, + "max_abs_delta": 0.78125 + }, + "system_x": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9836812615394592, + "min_cosine_similarity": 0.7903332114219666, + "mean_relative_l2": 0.14674142003059387, + "max_abs_delta": 1.421875 + }, + "system_period": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9825837016105652, + "min_cosine_similarity": 0.7502648830413818, + "mean_relative_l2": 0.1471962034702301, + "max_abs_delta": 1.625 + }, + "bos_at_s0": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9912111759185791, + "min_cosine_similarity": 0.9757540225982666, + "mean_relative_l2": 0.12996867299079895, + "max_abs_delta": 0.421875 + }, + "bos_at_s1": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9888654351234436, + "min_cosine_similarity": 0.9702982902526855, + "mean_relative_l2": 0.14623922109603882, + "max_abs_delta": 0.875 + }, + "x_at_s0": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9872550964355469, + "min_cosine_similarity": 0.9401407241821289, + "mean_relative_l2": 0.15260903537273407, + "max_abs_delta": 1.5 + }, + "x_at_s1": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9722344875335693, + "min_cosine_similarity": 0.7607070803642273, + "mean_relative_l2": 0.21078650653362274, + "max_abs_delta": 2.15625 + }, + "period_at_s0": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9846668243408203, + "min_cosine_similarity": 0.9480154514312744, + "mean_relative_l2": 0.16834411025047302, + "max_abs_delta": 1.5625 + }, + "period_at_s1": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9710822701454163, + "min_cosine_similarity": 0.7455595135688782, + "mean_relative_l2": 0.21521268784999847, + "max_abs_delta": 1.96875 + } + } + }, + "layer_10": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "866032d9f5144289edc8bf06d7e527ea4b65678207e936ff8033c46b557f02bf", + "mean": -0.004498173948377371, + "std": 0.4430706202983856, + "rms": 0.4430934488773346, + "max_abs": 12.25 + }, + "full_input": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0d20af5d1458c433b587f869650575b377320f77bae6243d13c855a80ebe4316", + "mean": -0.032252926379442215, + "std": 11.021041870117188, + "rms": 11.021088600158691, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7851eb55edc5cc1c0fc51a5e83b403a77c2498b15df3e396431929d631bff7b4", + "mean": -0.004375147167593241, + "std": 0.4430830776691437, + "rms": 0.44310465455055237, + "max_abs": 12.0 + }, + "full_input": { + "shape": [ + 68, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1b3057d0dc28cafc77c9e6e7c95c4e6fb3f112ae4ebafdf25ce9c0e127f692d4", + "mean": -0.02991666831076145, + "std": 9.930888175964355, + "rms": 9.930932998657227, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "678a9b28819bf9ce311969dda824e6b23e265e903394339ae00c54749c08dd55", + "mean": -0.004800176247954369, + "std": 0.44429898262023926, + "rms": 0.44432491064071655, + "max_abs": 11.875 + }, + "full_input": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e8e60562d0bb6bcd9fe6b85d33241a7a0ae611a09ab847725b02732e8aa6be5d", + "mean": -0.010804474353790283, + "std": 9.715052604675293, + "rms": 9.715059280395508, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a2b6067b0c29fcc0f775231552b55954e8066e6c2439f893f3f5590d930df284", + "mean": -0.0048310160636901855, + "std": 0.446288526058197, + "rms": 0.44631466269493103, + "max_abs": 11.9375 + }, + "full_input": { + "shape": [ + 68, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7fe9e1a340bf725b28040f628da0e5438d572a68e33141d66f732b853b13cc64", + "mean": -0.010828198865056038, + "std": 8.488273620605469, + "rms": 8.48828125, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cb38df5a8ca2a1f04d658513035d1bd84c95f60c3e9477f0c3f7b1030983c111", + "mean": -0.004614475183188915, + "std": 0.44118791818618774, + "rms": 0.4412120580673218, + "max_abs": 12.125 + }, + "full_input": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4278e1c0d617a187107a7d511d4fd9884affcbb23854591aa924d8eda84346b1", + "mean": -0.0106270806863904, + "std": 9.714911460876465, + "rms": 9.714917182922363, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "186ead135b6246984df791408c7abbf2e5d81780074272189114c56346afbb7d", + "mean": -0.004902380984276533, + "std": 0.439385324716568, + "rms": 0.4394126832485199, + "max_abs": 12.0 + }, + "full_input": { + "shape": [ + 68, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7dd13514393df0a859cbab0c33e54456fd066078017f493ea0c00dc560d458cf", + "mean": -0.010957161895930767, + "std": 8.488019943237305, + "rms": 8.48802661895752, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c64606588c263bb2d145f2114ece233b911e92f2e81d57c679beeb416750cdc3", + "mean": -0.005410571116954088, + "std": 0.44084978103637695, + "rms": 0.44088298082351685, + "max_abs": 12.0625 + }, + "full_input": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f686870b6b4ca728ed881f61250d0aa39891e5de89414b72c0c81ca58532aa0a", + "mean": -0.010667229071259499, + "std": 9.714873313903809, + "rms": 9.714879989624023, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3ddfe094043b6c0cf3a0aa17ba854b6739e40a82a74c7172f1efef1b4f460e29", + "mean": -0.00542848976328969, + "std": 0.4390376806259155, + "rms": 0.4390712082386017, + "max_abs": 11.9375 + }, + "full_input": { + "shape": [ + 68, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f5ff82e7be28360db4a7598a07d3316a92065c21119aac47118802966a9c866e", + "mean": -0.010952933691442013, + "std": 8.487983703613281, + "rms": 8.487990379333496, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9956746101379395, + "min_cosine_similarity": 0.9680322408676147, + "mean_relative_l2": 0.08277687430381775, + "max_abs_delta": 0.625 + }, + "system_bos": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9927138686180115, + "min_cosine_similarity": 0.9536045789718628, + "mean_relative_l2": 0.11229290813207626, + "max_abs_delta": 1.1875 + }, + "system_x": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.981195867061615, + "min_cosine_similarity": 0.747936487197876, + "mean_relative_l2": 0.15479108691215515, + "max_abs_delta": 2.265625 + }, + "system_period": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9804535508155823, + "min_cosine_similarity": 0.7054542303085327, + "mean_relative_l2": 0.15290085971355438, + "max_abs_delta": 2.296875 + }, + "bos_at_s0": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.989997148513794, + "min_cosine_similarity": 0.9709572792053223, + "mean_relative_l2": 0.13737905025482178, + "max_abs_delta": 0.625 + }, + "bos_at_s1": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9882368445396423, + "min_cosine_similarity": 0.9655282497406006, + "mean_relative_l2": 0.15015916526317596, + "max_abs_delta": 1.0 + }, + "x_at_s0": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9853345155715942, + "min_cosine_similarity": 0.9476091265678406, + "mean_relative_l2": 0.16372562944889069, + "max_abs_delta": 1.625 + }, + "x_at_s1": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.967697024345398, + "min_cosine_similarity": 0.7332199811935425, + "mean_relative_l2": 0.2264057993888855, + "max_abs_delta": 3.03125 + }, + "period_at_s0": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9820474982261658, + "min_cosine_similarity": 0.9420720934867859, + "mean_relative_l2": 0.180283322930336, + "max_abs_delta": 1.25 + }, + "period_at_s1": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9653213620185852, + "min_cosine_similarity": 0.7047045230865479, + "mean_relative_l2": 0.23442880809307098, + "max_abs_delta": 2.875 + } + } + }, + "layer_11": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c14b6a4b00ee37f1efaed6f233ecc9cea3d65476f83924eb21038b179ec7a828", + "mean": -0.0037594095338135958, + "std": 0.5581740736961365, + "rms": 0.5581867694854736, + "max_abs": 18.0 + }, + "full_input": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "364132cb698c8f2b437309702573648e5ba3f0dfcb2c07f8abf1910e5cc72f0d", + "mean": -0.030961034819483757, + "std": 11.081851959228516, + "rms": 11.081894874572754, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3e41c1b26fc1094225dca7b3b75934ddd398a155acb0916b9aeffa44e899c3db", + "mean": -0.003420243738219142, + "std": 0.5563753843307495, + "rms": 0.5563859343528748, + "max_abs": 17.75 + }, + "full_input": { + "shape": [ + 68, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2fb9fb05987001803dde09e46bf32f9e346e33df7bf284adab3668b8b25ea8aa", + "mean": -0.028967276215553284, + "std": 9.984705924987793, + "rms": 9.984748840332031, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "93ae9eaeff51f40e89fef6ae770af1b33065473adc5a2a81a06b16c9c38e16e7", + "mean": -0.0040944418869912624, + "std": 0.56129390001297, + "rms": 0.5613088011741638, + "max_abs": 17.5 + }, + "full_input": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6b3354996562f470f650b2670a09532b026b9ebb92353f6b99b2a23ea50882fe", + "mean": -0.00956334825605154, + "std": 9.765170097351074, + "rms": 9.765174865722656, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5d40ee1f706ee4d239d5b7d35d13b66e8ba52c39afb4e0c122868985da4d6621", + "mean": -0.004116270691156387, + "std": 0.5607069730758667, + "rms": 0.5607221126556396, + "max_abs": 17.5 + }, + "full_input": { + "shape": [ + 68, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9a7afef2bcb349731640356fc777f136bd8bce065833401898d1c0743f7b5135", + "mean": -0.009970102459192276, + "std": 8.53274154663086, + "rms": 8.532747268676758, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bf8e032d5f9b70e5a23e4b6d0bc1bdbce6976e99587df75be59dfab60b3532d9", + "mean": -0.003753053257241845, + "std": 0.5567232370376587, + "rms": 0.5567358732223511, + "max_abs": 17.75 + }, + "full_input": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a395420d5a0055126b8e43230517d46b4cb1f202e2da5d1caecdfb06716e898f", + "mean": -0.009123625233769417, + "std": 9.765036582946777, + "rms": 9.76504135131836, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6c6f3b602954a47f1638a187d421d09eea84a939c6727d2b9671fadef44c2750", + "mean": -0.003450374584645033, + "std": 0.5485398173332214, + "rms": 0.5485506057739258, + "max_abs": 17.5 + }, + "full_input": { + "shape": [ + 68, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9f8f90e57c64c0dd1946ad21969341327b9630e743c98bf47aecf52830202bac", + "mean": -0.009582345373928547, + "std": 8.532293319702148, + "rms": 8.53229808807373, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e2e78eddcef2a196750a9e80966c7fec58455b9fa63465ac0dfc703248cde703", + "mean": -0.004370531067252159, + "std": 0.5576651096343994, + "rms": 0.55768221616745, + "max_abs": 17.625 + }, + "full_input": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "51298856096c7ba71eb163ba62d45291b5d803f76ea7bf0219891f409b3e9f37", + "mean": -0.00918416678905487, + "std": 9.764993667602539, + "rms": 9.764998435974121, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6863b5de98182ab5c8454d889898dfbf7584b827b228cd6e18c1f72a3047148f", + "mean": -0.004151794593781233, + "std": 0.5494540333747864, + "rms": 0.5494697093963623, + "max_abs": 17.25 + }, + "full_input": { + "shape": [ + 68, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "06f81c9c5dd49f4c2191b31f5f2cae72e6d7060cce31b3a07864e7857696e41c", + "mean": -0.00970439612865448, + "std": 8.532282829284668, + "rms": 8.532288551330566, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9963814616203308, + "min_cosine_similarity": 0.9774409532546997, + "mean_relative_l2": 0.07746917754411697, + "max_abs_delta": 1.375 + }, + "system_bos": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9940965175628662, + "min_cosine_similarity": 0.9684371948242188, + "mean_relative_l2": 0.10303837060928345, + "max_abs_delta": 1.5 + }, + "system_x": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9800301790237427, + "min_cosine_similarity": 0.6766354441642761, + "mean_relative_l2": 0.147003173828125, + "max_abs_delta": 5.9375 + }, + "system_period": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9807553291320801, + "min_cosine_similarity": 0.6862739324569702, + "mean_relative_l2": 0.14518506824970245, + "max_abs_delta": 5.84375 + }, + "bos_at_s0": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9922003746032715, + "min_cosine_similarity": 0.9784073829650879, + "mean_relative_l2": 0.1221052035689354, + "max_abs_delta": 0.5625 + }, + "bos_at_s1": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9910288453102112, + "min_cosine_similarity": 0.9762316346168518, + "mean_relative_l2": 0.13161562383174896, + "max_abs_delta": 1.1875 + }, + "x_at_s0": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9885869026184082, + "min_cosine_similarity": 0.966677188873291, + "mean_relative_l2": 0.14578935503959656, + "max_abs_delta": 1.3125 + }, + "x_at_s1": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9703288674354553, + "min_cosine_similarity": 0.6821275949478149, + "mean_relative_l2": 0.20711258053779602, + "max_abs_delta": 5.25 + }, + "period_at_s0": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9860117435455322, + "min_cosine_similarity": 0.9501227140426636, + "mean_relative_l2": 0.16073983907699585, + "max_abs_delta": 1.0625 + }, + "period_at_s1": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9693866968154907, + "min_cosine_similarity": 0.6965712308883667, + "mean_relative_l2": 0.21484233438968658, + "max_abs_delta": 4.71875 + } + } + }, + "layer_12": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "38c11af62d9d54d3635c02f1fa89f62d9149bbe453ee5a1f9fb5a8ca058a29cf", + "mean": -0.004399564582854509, + "std": 0.5820972323417664, + "rms": 0.5821138620376587, + "max_abs": 17.375 + }, + "full_input": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d700cf5064f4fd1a1b6500e9b20cca9cf9391653d59c361d5cf89e1d1e1f0268", + "mean": -0.03245813027024269, + "std": 11.158377647399902, + "rms": 11.158425331115723, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e8030e255590d13b837fbf5d2a6a55d60036d1f5e4fb3b50cddd5c42688f8258", + "mean": -0.003979482688009739, + "std": 0.581379234790802, + "rms": 0.5813928246498108, + "max_abs": 17.75 + }, + "full_input": { + "shape": [ + 68, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c5fad65d775a3b11dfa5e8759d22e837ac1ce30e622fdeec80d2d1f32df09b6c", + "mean": -0.029525160789489746, + "std": 10.05720043182373, + "rms": 10.057243347167969, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "92b91b2b3b8d0b135ab89a9388ff7f4859d0f05cf3d08c5b4d910b340aaa47e8", + "mean": -0.00495960982516408, + "std": 0.5866855978965759, + "rms": 0.5867065191268921, + "max_abs": 17.5 + }, + "full_input": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5bcdb60c397f83215fc6157b42c9028d07929e046ba9a3c81cf523db47e6efca", + "mean": -0.010904114693403244, + "std": 9.781855583190918, + "rms": 9.781861305236816, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4b134a06b1172639906e2da219d59e8e5a94a77cb736e59cccdbe2954df57fe5", + "mean": -0.004720597993582487, + "std": 0.5870940089225769, + "rms": 0.5871129631996155, + "max_abs": 17.75 + }, + "full_input": { + "shape": [ + 68, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "46386c039dfdfc81eddbf767ee8167c007c35fb13c9184f9ff354f070e504104", + "mean": -0.010548736900091171, + "std": 8.548486709594727, + "rms": 8.548492431640625, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1604e9cc93956502649b6244f97f8ecbdfabe8cdba136d4aa69f6374355cf57b", + "mean": -0.0043296511285007, + "std": 0.5816134214401245, + "rms": 0.5816295146942139, + "max_abs": 17.375 + }, + "full_input": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "81761dd2aff8ead521535a33a1a3bde0227910800f5c1b45500eb9a4abef2ff5", + "mean": -0.010810418985784054, + "std": 9.781728744506836, + "rms": 9.781734466552734, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "874068e0c2af0808a3c69643fef970693b69e260047f8a419e94a356583bdb04", + "mean": -0.004225433338433504, + "std": 0.5736218690872192, + "rms": 0.5736374258995056, + "max_abs": 17.25 + }, + "full_input": { + "shape": [ + 68, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "22cbb4f7b8feaa0e360287c5172ff778bf45912d10340cd198aa13b3f0278c65", + "mean": -0.010341459885239601, + "std": 8.547896385192871, + "rms": 8.547901153564453, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "843b692f223d247c0409b5b6baa7cbc28ed32c835164b162d943dda03a081106", + "mean": -0.0049425638280808926, + "std": 0.582009494304657, + "rms": 0.5820304751396179, + "max_abs": 17.5 + }, + "full_input": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "549ca0ee49756b1d6d11023bfc5da7e503844cc37cd50d543017882dfff77961", + "mean": -0.010584693402051926, + "std": 9.781623840332031, + "rms": 9.781628608703613, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "25340653ccb119e4fcdcc35e5cf8271bc49644ff7aafd44a6fde42243a64c95a", + "mean": -0.004949901718646288, + "std": 0.5753681659698486, + "rms": 0.5753894448280334, + "max_abs": 17.25 + }, + "full_input": { + "shape": [ + 68, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ce2773c98c28de1877cf4da219dfad516c953d30ed12395efe4ce4b844c0df2b", + "mean": -0.010331897996366024, + "std": 8.547956466674805, + "rms": 8.547962188720703, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9959959983825684, + "min_cosine_similarity": 0.97784823179245, + "mean_relative_l2": 0.0812203586101532, + "max_abs_delta": 0.875 + }, + "system_bos": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.993582546710968, + "min_cosine_similarity": 0.9681731462478638, + "mean_relative_l2": 0.10749882459640503, + "max_abs_delta": 1.0 + }, + "system_x": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9764389991760254, + "min_cosine_similarity": 0.6099509000778198, + "mean_relative_l2": 0.15620070695877075, + "max_abs_delta": 7.375 + }, + "system_period": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.976292073726654, + "min_cosine_similarity": 0.6052859425544739, + "mean_relative_l2": 0.157814159989357, + "max_abs_delta": 7.03125 + }, + "bos_at_s0": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9910942316055298, + "min_cosine_similarity": 0.9761227369308472, + "mean_relative_l2": 0.13034410774707794, + "max_abs_delta": 0.75 + }, + "bos_at_s1": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9903595447540283, + "min_cosine_similarity": 0.9746999740600586, + "mean_relative_l2": 0.13604460656642914, + "max_abs_delta": 1.125 + }, + "x_at_s0": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9870389103889465, + "min_cosine_similarity": 0.9649972915649414, + "mean_relative_l2": 0.1555575132369995, + "max_abs_delta": 1.5 + }, + "x_at_s1": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9653365612030029, + "min_cosine_similarity": 0.6149625778198242, + "mean_relative_l2": 0.22008782625198364, + "max_abs_delta": 6.75 + }, + "period_at_s0": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9844810962677002, + "min_cosine_similarity": 0.9394010305404663, + "mean_relative_l2": 0.16898301243782043, + "max_abs_delta": 1.3125 + }, + "period_at_s1": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9630658030509949, + "min_cosine_similarity": 0.6081432700157166, + "mean_relative_l2": 0.2317837029695511, + "max_abs_delta": 6.78125 + } + } + }, + "layer_13": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "16e2111af782fd50d1d5d6a16279d663b426182b8c0a2f95e589561e288af3c2", + "mean": -0.002666839398443699, + "std": 0.6553468704223633, + "rms": 0.6553522944450378, + "max_abs": 17.5 + }, + "full_input": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2ab6ec660ea43c656f864916b8f0f2940affe28473202846e89922c568faf771", + "mean": -0.03140461817383766, + "std": 11.168551445007324, + "rms": 11.168595314025879, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e2e71cdda0081143bd7385b194bfb98bd0d792010f3790662051fa598091f48d", + "mean": -0.0023040296509861946, + "std": 0.6539320945739746, + "rms": 0.6539361476898193, + "max_abs": 18.0 + }, + "full_input": { + "shape": [ + 68, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "67a0cd54c2315315068f954d77950b4cd5e15e5d1dfb5ee89e087997b8d46e33", + "mean": -0.029730267822742462, + "std": 10.06699275970459, + "rms": 10.067036628723145, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9c5d196dae68b831d5ddd2cc0ebacfd3caeb7e7d7faf54868b9788bfe27b6e9f", + "mean": -0.0028837190475314856, + "std": 0.6578855514526367, + "rms": 0.6578919291496277, + "max_abs": 17.75 + }, + "full_input": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5ea5df8d042565eac289bcf90775cb82c1fcbc72c1e5b66cebb21af3dcdae47b", + "mean": -0.009359484538435936, + "std": 9.791078567504883, + "rms": 9.791082382202148, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "22f3fbea58d6293d82ec0738e9625c7ea9a47c430f3d42782f0e0e00fa9afe9f", + "mean": -0.0028041601181030273, + "std": 0.658136785030365, + "rms": 0.6581427454948425, + "max_abs": 18.0 + }, + "full_input": { + "shape": [ + 68, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "dc596c27aa518627d141246c326118d7c7fc1b3dfc36f6b474c9483e996910d2", + "mean": -0.010362125933170319, + "std": 8.557621002197266, + "rms": 8.557626724243164, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c2280bb4e9f7d9271b720b44eeaab9b7be572f789719099c4700bdc22a0d666a", + "mean": -0.0022928686812520027, + "std": 0.6536358594894409, + "rms": 0.6536398530006409, + "max_abs": 17.75 + }, + "full_input": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2623304694666e38e12b8a5b6f02f3fb4c3f01c1a5d8bea9da3193ef50242878", + "mean": -0.009388519451022148, + "std": 9.79104232788086, + "rms": 9.791046142578125, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bf4a8f774b621c942ed709bd4e12df4ca891a42f64d6a692de84c7f350bdc6d1", + "mean": -0.0021119925659149885, + "std": 0.6468825936317444, + "rms": 0.6468860507011414, + "max_abs": 17.625 + }, + "full_input": { + "shape": [ + 68, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0d537688d2061e7db9612819ef298111c565d9fc8a1e985894c5043dd9a6a631", + "mean": -0.010188023559749126, + "std": 8.55712890625, + "rms": 8.557134628295898, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "56cb021c1a2d99595d7845377cdc54036da5b1e6aef389bdf6963240a357faad", + "mean": -0.00281799235381186, + "std": 0.6564512252807617, + "rms": 0.6564573049545288, + "max_abs": 17.75 + }, + "full_input": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "460f6536b34333669b93e29133168bd43ad122526b6662278d8ed7df4c6ca14b", + "mean": -0.009057613089680672, + "std": 9.79098129272461, + "rms": 9.790986061096191, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b843a87b9b2d34419b053c6cdf5187380e4551da2dcef064612c25d61908358c", + "mean": -0.0029168378096073866, + "std": 0.6485180854797363, + "rms": 0.6485246419906616, + "max_abs": 17.625 + }, + "full_input": { + "shape": [ + 68, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "361188d8959a2694b6b30650dcc4fe6a6a28c5ab9d5d10a1df577aa1750eb0d3", + "mean": -0.010216905735433102, + "std": 8.557169914245605, + "rms": 8.557175636291504, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9958842396736145, + "min_cosine_similarity": 0.977919340133667, + "mean_relative_l2": 0.08134669810533524, + "max_abs_delta": 0.75 + }, + "system_bos": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9936985969543457, + "min_cosine_similarity": 0.970929741859436, + "mean_relative_l2": 0.10677357763051987, + "max_abs_delta": 1.0 + }, + "system_x": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9788479208946228, + "min_cosine_similarity": 0.6701198816299438, + "mean_relative_l2": 0.15343615412712097, + "max_abs_delta": 5.4375 + }, + "system_period": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9775227308273315, + "min_cosine_similarity": 0.6474573612213135, + "mean_relative_l2": 0.1575317531824112, + "max_abs_delta": 5.484375 + }, + "bos_at_s0": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9910934567451477, + "min_cosine_similarity": 0.9688786268234253, + "mean_relative_l2": 0.12885011732578278, + "max_abs_delta": 1.125 + }, + "bos_at_s1": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9907348155975342, + "min_cosine_similarity": 0.9772242307662964, + "mean_relative_l2": 0.13315227627754211, + "max_abs_delta": 1.0 + }, + "x_at_s0": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9869716763496399, + "min_cosine_similarity": 0.9591314792633057, + "mean_relative_l2": 0.15498214960098267, + "max_abs_delta": 1.375 + }, + "x_at_s1": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9675281047821045, + "min_cosine_similarity": 0.6650558710098267, + "mean_relative_l2": 0.21679852902889252, + "max_abs_delta": 5.25 + }, + "period_at_s0": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9842831492424011, + "min_cosine_similarity": 0.9284812211990356, + "mean_relative_l2": 0.16814666986465454, + "max_abs_delta": 1.4375 + }, + "period_at_s1": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9644615650177002, + "min_cosine_similarity": 0.645527720451355, + "mean_relative_l2": 0.230295792222023, + "max_abs_delta": 5.359375 + } + } + }, + "layer_14": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a30534fd12f4ea9df0d9fa5c3c87cd6965b9a87c6ecd60326431f2545ce7789b", + "mean": 0.0023398499470204115, + "std": 0.7566444873809814, + "rms": 0.756648063659668, + "max_abs": 21.5 + }, + "full_input": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "45bc9480f034c73dcfaa2813da303b183c7d48cf42747eab69838ccff61e034a", + "mean": -0.02755139023065567, + "std": 11.192232131958008, + "rms": 11.192266464233398, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8575954e41a2aaea235534a50daf0af5e31d3e010e673f9a4431de88421e3c99", + "mean": 0.0025394861586391926, + "std": 0.7552735805511475, + "rms": 0.7552778720855713, + "max_abs": 21.625 + }, + "full_input": { + "shape": [ + 68, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b9dea6676a04adfe758b4adf246950fb2ba82d94cf8566722dccbb5fe7d56fac", + "mean": -0.027188237756490707, + "std": 10.08757495880127, + "rms": 10.087611198425293, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "275f0adcacb361c214abc872c206260f903c90f1341f1e8ff8c6f6770755d782", + "mean": 0.0024979913141578436, + "std": 0.7574639916419983, + "rms": 0.7574681043624878, + "max_abs": 21.375 + }, + "full_input": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3e540d29262240a169efdbfcee14ae4000aa1385864d36cf12ab7aea88db3a35", + "mean": -0.005295299459248781, + "std": 9.81669807434082, + "rms": 9.816699028015137, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b779d632bcc99ee01ae5afed4dcb7f491b3c0d032a36bcace521fe172db6456f", + "mean": 0.0023983181454241276, + "std": 0.7600955963134766, + "rms": 0.7600993514060974, + "max_abs": 22.0 + }, + "full_input": { + "shape": [ + 68, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e776019c3f6aaac8e85dcd0a4a6185c05438b8011d3975ecaa8072ae855bb2b1", + "mean": -0.007491272874176502, + "std": 8.580667495727539, + "rms": 8.580670356750488, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9e52a11220f2e53d52df8c00be7f58d08ccfbad9c8c865a1a4fce718bbf32ad6", + "mean": 0.0036256168968975544, + "std": 0.7525511384010315, + "rms": 0.7525598406791687, + "max_abs": 21.125 + }, + "full_input": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "05bbb619914a3067c890e174bca5d41fb6997ce989ff9fc063b62e67d92fb417", + "mean": -0.005014691036194563, + "std": 9.816685676574707, + "rms": 9.81668758392334, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b0a4381f73fecef5290dc8428738dbe84ce4ebf6e85c2647e2917a138f171132", + "mean": 0.0040017785504460335, + "std": 0.7459090948104858, + "rms": 0.7459198236465454, + "max_abs": 21.75 + }, + "full_input": { + "shape": [ + 68, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b3dc8ed19ba73c4a543077b147d3d2a9ada752ab032df3a47bb2667b63cc54a6", + "mean": -0.007080534007400274, + "std": 8.580086708068848, + "rms": 8.580089569091797, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1e6f5bbe99906fe93416c34c17f02e478d57c4cfbe1affc24e11f53d85c9c4b2", + "mean": 0.0029074731282889843, + "std": 0.7554629445075989, + "rms": 0.755468487739563, + "max_abs": 21.25 + }, + "full_input": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a03bd21aec3acbe2f6ccd719bea72635b1ce196ead851ee527ca2ae3cde183ac", + "mean": -0.004869302734732628, + "std": 9.81661605834961, + "rms": 9.816617012023926, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d61ae3073d7f7facd27bbf3c38880db0fd282eb4d569a1d41fb0685e1db745b0", + "mean": 0.0030667304527014494, + "std": 0.7476516962051392, + "rms": 0.7476579546928406, + "max_abs": 21.5 + }, + "full_input": { + "shape": [ + 68, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1051b5620922daff67f38fbd851137bd065ffc838fa9ecde965aecd0f5f3ccfb", + "mean": -0.0073730009607970715, + "std": 8.58008098602295, + "rms": 8.580084800720215, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9958712458610535, + "min_cosine_similarity": 0.9773648977279663, + "mean_relative_l2": 0.08150830119848251, + "max_abs_delta": 0.8125 + }, + "system_bos": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9937736988067627, + "min_cosine_similarity": 0.971055269241333, + "mean_relative_l2": 0.10622536391019821, + "max_abs_delta": 1.0625 + }, + "system_x": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9792577028274536, + "min_cosine_similarity": 0.6871604919433594, + "mean_relative_l2": 0.15433651208877563, + "max_abs_delta": 6.4375 + }, + "system_period": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9780480265617371, + "min_cosine_similarity": 0.6754875779151917, + "mean_relative_l2": 0.15957461297512054, + "max_abs_delta": 5.6875 + }, + "bos_at_s0": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9917231202125549, + "min_cosine_similarity": 0.9687443375587463, + "mean_relative_l2": 0.12380190193653107, + "max_abs_delta": 1.3125 + }, + "bos_at_s1": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9911547303199768, + "min_cosine_similarity": 0.9773107767105103, + "mean_relative_l2": 0.12983015179634094, + "max_abs_delta": 1.46875 + }, + "x_at_s0": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9877216815948486, + "min_cosine_similarity": 0.960127055644989, + "mean_relative_l2": 0.14991696178913116, + "max_abs_delta": 2.1875 + }, + "x_at_s1": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.968296468257904, + "min_cosine_similarity": 0.6795060634613037, + "mean_relative_l2": 0.21429318189620972, + "max_abs_delta": 5.5625 + }, + "period_at_s0": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9851315021514893, + "min_cosine_similarity": 0.9352289438247681, + "mean_relative_l2": 0.16245368123054504, + "max_abs_delta": 1.921875 + }, + "period_at_s1": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9653153419494629, + "min_cosine_similarity": 0.6706875562667847, + "mean_relative_l2": 0.22867977619171143, + "max_abs_delta": 5.5625 + } + } + }, + "layer_15": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6e2afb6fae974632d58ea843e51048d039bc15c7e68a0e69f2bb55b373ac74ca", + "mean": 0.0011391734005883336, + "std": 0.8452096581459045, + "rms": 0.8452104330062866, + "max_abs": 25.25 + }, + "full_input": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8b8ac401e813c0ec5b640205be4eb77ec77c4c9883411a7570c461f81010d08e", + "mean": -0.026932844892144203, + "std": 11.20197868347168, + "rms": 11.202011108398438, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d2bd56c5283deefedef0e6948a358845da57ec4f126a1bcd49ad96e29ddb134c", + "mean": 0.0011798855848610401, + "std": 0.8425944447517395, + "rms": 0.8425952196121216, + "max_abs": 25.375 + }, + "full_input": { + "shape": [ + 68, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c2d8de5f795e3d1d1df58c93888d76f374986f22678fb9de3bad4b5cfe4c18a4", + "mean": -0.0273665152490139, + "std": 10.09761905670166, + "rms": 10.09765625, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ae2ffd1e3977d7ec0ed5bca85ab48d5395a4b81e8988510f513f569cc15ace5b", + "mean": 0.0007999177905730903, + "std": 0.8452392816543579, + "rms": 0.8452396392822266, + "max_abs": 25.0 + }, + "full_input": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a78a366a9850508758defe315466554feb08d62f3aa91bba2af2e510eb7ab09c", + "mean": -0.005278112832456827, + "std": 9.826783180236816, + "rms": 9.82678508758545, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c5e2acf958fdf0dbd7f0d41cace71cacc56bb6430704364419323079a407545d", + "mean": 0.0008847211138345301, + "std": 0.8475408554077148, + "rms": 0.847541332244873, + "max_abs": 25.375 + }, + "full_input": { + "shape": [ + 68, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8314d3a37d7477dc010c504817d36d4ab1b4c681c4cf092b2dec3a3c4989edd3", + "mean": -0.00802095327526331, + "std": 8.591374397277832, + "rms": 8.591377258300781, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1d6eabdafd0f33f8136c006e39e7d10f37f34b9f5100644bff5a5b0ffc1168c2", + "mean": 0.0020062464755028486, + "std": 0.840678870677948, + "rms": 0.8406811952590942, + "max_abs": 24.0 + }, + "full_input": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bd96ec08c119a8a7559b452a1eb0effb6e6015e1ec68b6fa5a56adec844e4dbf", + "mean": -0.004921899177134037, + "std": 9.826719284057617, + "rms": 9.826720237731934, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "244e571092d007226b0e4971831244fc2ba9930e993aef1fa6ee2255a3fe681b", + "mean": 0.002100475365296006, + "std": 0.8310641050338745, + "rms": 0.8310667872428894, + "max_abs": 24.0 + }, + "full_input": { + "shape": [ + 68, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "14fa70ba274d804ad0073f246aebaa902bbba7710f415a0131bb4a74a406538d", + "mean": -0.0078023443929851055, + "std": 8.590568542480469, + "rms": 8.590571403503418, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a4957cda0c865847c7d3afa607caa0ecb23842430e9a94b745e694680c4a0caa", + "mean": 0.001477037905715406, + "std": 0.8421430587768555, + "rms": 0.8421443700790405, + "max_abs": 24.125 + }, + "full_input": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8fae2b2ab228fcee1908730dc98eb1a9c9b6ccd66212a6c423222d8758836ced", + "mean": -0.004570645745843649, + "std": 9.8265962600708, + "rms": 9.826598167419434, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f8a447d0c01f71452aece5128a5a17884786f820ff04d7d2e3175d821172b399", + "mean": 0.0013623370323330164, + "std": 0.8309916853904724, + "rms": 0.8309928178787231, + "max_abs": 23.625 + }, + "full_input": { + "shape": [ + 68, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c528c2ba6440a84be87fc7e6b0e2ebcc3679a0d90bb6ef0d8ec6c42b3d3da930", + "mean": -0.007812006399035454, + "std": 8.590560913085938, + "rms": 8.590563774108887, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9956669807434082, + "min_cosine_similarity": 0.9782213568687439, + "mean_relative_l2": 0.08264181017875671, + "max_abs_delta": 1.125 + }, + "system_bos": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9939202070236206, + "min_cosine_similarity": 0.9713002443313599, + "mean_relative_l2": 0.10443080216646194, + "max_abs_delta": 1.125 + }, + "system_x": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9794961214065552, + "min_cosine_similarity": 0.7052539587020874, + "mean_relative_l2": 0.15605737268924713, + "max_abs_delta": 6.0 + }, + "system_period": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.977897584438324, + "min_cosine_similarity": 0.6874032020568848, + "mean_relative_l2": 0.16286098957061768, + "max_abs_delta": 6.125 + }, + "bos_at_s0": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9915644526481628, + "min_cosine_similarity": 0.965512752532959, + "mean_relative_l2": 0.1238228902220726, + "max_abs_delta": 1.875 + }, + "bos_at_s1": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9911156296730042, + "min_cosine_similarity": 0.9761480093002319, + "mean_relative_l2": 0.12922753393650055, + "max_abs_delta": 2.0 + }, + "x_at_s0": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9873297810554504, + "min_cosine_similarity": 0.9555598497390747, + "mean_relative_l2": 0.15083983540534973, + "max_abs_delta": 2.84375 + }, + "x_at_s1": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9684960842132568, + "min_cosine_similarity": 0.6952962875366211, + "mean_relative_l2": 0.2137775719165802, + "max_abs_delta": 5.625 + }, + "period_at_s0": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9849467873573303, + "min_cosine_similarity": 0.9347622394561768, + "mean_relative_l2": 0.16173261404037476, + "max_abs_delta": 2.8125 + }, + "period_at_s1": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9649768471717834, + "min_cosine_similarity": 0.6802493333816528, + "mean_relative_l2": 0.22937631607055664, + "max_abs_delta": 5.875 + } + } + }, + "layer_16": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3f49a28666f10e202e22f1ff16cbd56937c25b9036c3b0ba80a08f0f7a6b7c12", + "mean": 0.005149583797901869, + "std": 0.9551038146018982, + "rms": 0.9551177024841309, + "max_abs": 30.75 + }, + "full_input": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ef46c27363aca1746e4ea0abe1a9416fab12c6a38e1f45c49dee35e4e569ca6e", + "mean": -0.024215390905737877, + "std": 11.213849067687988, + "rms": 11.213874816894531, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f4ff347afc97e7cb05038d37de3f52d40e4f86f8619f8ec5579f339d392cdd7c", + "mean": 0.005336391273885965, + "std": 0.9532670378684998, + "rms": 0.9532819986343384, + "max_abs": 30.875 + }, + "full_input": { + "shape": [ + 68, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "971459f8aeffdefb728707f962c1aa3067abd64d7088bfc26d58ecb8b00ff354", + "mean": -0.02470102719962597, + "std": 10.109241485595703, + "rms": 10.109272003173828, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c94be5c944165b44af9cab7302a25fb611969e7bbf9d80d9e6457b6892f14b68", + "mean": 0.005052504129707813, + "std": 0.9545279145240784, + "rms": 0.9545412659645081, + "max_abs": 30.25 + }, + "full_input": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1733fc50eb71e53691e96ec822abb5e17550f58afd22b2929001e9095ba10d73", + "mean": -0.002435751026496291, + "std": 9.838805198669434, + "rms": 9.838805198669434, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "660d29f7bec68394d9a02dbd918de5f7ced60d778c122582d8e6b60e1e366a12", + "mean": 0.005448367912322283, + "std": 0.9585368633270264, + "rms": 0.9585524201393127, + "max_abs": 30.625 + }, + "full_input": { + "shape": [ + 68, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9ebcb5a34008693d7187f8e2a23bcdd46948684849833241e2ab2a651b4a9571", + "mean": -0.004944986198097467, + "std": 8.603897094726562, + "rms": 8.603899002075195, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0ced6fc7d923c936ef1fc8fa91c15cf3b7912db43edab9468776b3990e38a3d7", + "mean": 0.006489964667707682, + "std": 0.9535731673240662, + "rms": 0.9535952210426331, + "max_abs": 29.625 + }, + "full_input": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "474a6b8b405b122533df5e45eba4f433dffebbe8526a172486ef1c82286b2736", + "mean": -0.002113029360771179, + "std": 9.839170455932617, + "rms": 9.8391695022583, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f1f2a12541497820e9cfd83bd7bda4f9cb5f237b2651d087029baebaaeb977b4", + "mean": 0.006471735890954733, + "std": 0.9459064602851868, + "rms": 0.9459286332130432, + "max_abs": 28.375 + }, + "full_input": { + "shape": [ + 68, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e9c4403675a4235575518c01278b06e7d3620793ad4777b4f9f4a3fdffcbf2c8", + "mean": -0.005088581703603268, + "std": 8.603409767150879, + "rms": 8.603411674499512, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6124f07e1f036b8254fc423dfdb75f94bebcfa352edccfbb41b94675972ee0b1", + "mean": 0.0057466947473585606, + "std": 0.9557617902755737, + "rms": 0.9557790756225586, + "max_abs": 29.5 + }, + "full_input": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "eba966dcac4fdb3e4819a922f9173190e6c54b89f378dcea8e33697db951a885", + "mean": -0.0017271979013457894, + "std": 9.838854789733887, + "rms": 9.838854789733887, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4542d9c27a4ac596bf501be5c73f4e99b697e1c996dd217d0b5f9803d652ec96", + "mean": 0.005826957989484072, + "std": 0.9454052448272705, + "rms": 0.9454231858253479, + "max_abs": 27.875 + }, + "full_input": { + "shape": [ + 68, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "81fb67443f8ab92a99103ecbb780b5552ebd50217ddd7355da9ce55dde3e875c", + "mean": -0.00494040222838521, + "std": 8.603224754333496, + "rms": 8.603226661682129, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9956284165382385, + "min_cosine_similarity": 0.9780588746070862, + "mean_relative_l2": 0.08300863206386566, + "max_abs_delta": 1.5 + }, + "system_bos": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9939636588096619, + "min_cosine_similarity": 0.9716751575469971, + "mean_relative_l2": 0.10403209924697876, + "max_abs_delta": 1.25 + }, + "system_x": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9791008234024048, + "min_cosine_similarity": 0.7017565965652466, + "mean_relative_l2": 0.15655551850795746, + "max_abs_delta": 7.5 + }, + "system_period": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.97748863697052, + "min_cosine_similarity": 0.6919795274734497, + "mean_relative_l2": 0.1645793318748474, + "max_abs_delta": 7.25 + }, + "bos_at_s0": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9912891983985901, + "min_cosine_similarity": 0.9620559215545654, + "mean_relative_l2": 0.12460654228925705, + "max_abs_delta": 2.3125 + }, + "bos_at_s1": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.991024374961853, + "min_cosine_similarity": 0.974590003490448, + "mean_relative_l2": 0.1286165714263916, + "max_abs_delta": 2.625 + }, + "x_at_s0": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9869104027748108, + "min_cosine_similarity": 0.9495970010757446, + "mean_relative_l2": 0.1518460363149643, + "max_abs_delta": 3.53125 + }, + "x_at_s1": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9673750996589661, + "min_cosine_similarity": 0.6866105794906616, + "mean_relative_l2": 0.21482184529304504, + "max_abs_delta": 5.875 + }, + "period_at_s0": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9843916296958923, + "min_cosine_similarity": 0.9219255447387695, + "mean_relative_l2": 0.1630391776561737, + "max_abs_delta": 3.59375 + }, + "period_at_s1": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9635534882545471, + "min_cosine_similarity": 0.6810460090637207, + "mean_relative_l2": 0.23171792924404144, + "max_abs_delta": 6.4375 + } + } + }, + "layer_17": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4a29160f8842de54f37f85b0db58bee2485c400e21317062a4ed2f6cfea7213e", + "mean": 0.0029437055345624685, + "std": 1.123586654663086, + "rms": 1.1235905885696411, + "max_abs": 35.5 + }, + "full_input": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4dc38f0b7627b57a7159ea283472d0d7c6494fea91421480b90aad6867e6f3fb", + "mean": -0.025988716632127762, + "std": 11.229670524597168, + "rms": 11.229701042175293, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "79e88e3fc3577516c980dd34f3e033f29a87035e291b3c48fc9e1c8591cdfecc", + "mean": 0.0029908474534749985, + "std": 1.1200374364852905, + "rms": 1.1200414896011353, + "max_abs": 35.75 + }, + "full_input": { + "shape": [ + 68, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e75db6ebb51d348bba70bf6203e6245373aec25c34ff9494f3fdfb9ab8daaebd", + "mean": -0.02730242908000946, + "std": 10.1254243850708, + "rms": 10.12546157836914, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3c64ab4fe69f703ca805848f7609c1e87939708ddc5f2a1a9c0e6571a21bf6ef", + "mean": 0.0029198969714343548, + "std": 1.1243906021118164, + "rms": 1.124394416809082, + "max_abs": 35.0 + }, + "full_input": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "71d488a7852e645f57533352a2fd62ba13eb6f3d954c8005b1834b3904c0c1b2", + "mean": -0.004201403819024563, + "std": 9.856073379516602, + "rms": 9.856074333190918, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3896cca6934300c920f7338c3feb1c164a29e2ca0dfb6d1728e9a425f8ae3d14", + "mean": 0.00338046089746058, + "std": 1.1279407739639282, + "rms": 1.1279457807540894, + "max_abs": 35.5 + }, + "full_input": { + "shape": [ + 68, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f8e2aba28c951c5b9610443640c1d31b190c566c9ea43b031198a74f4926ff6c", + "mean": -0.007535329554229975, + "std": 8.622283935546875, + "rms": 8.62228775024414, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "80b07a228c3deafd9d9b0760c6564477436a1d68daa811e6d3d5c3a705c5a7df", + "mean": 0.00416208291426301, + "std": 1.1220747232437134, + "rms": 1.1220823526382446, + "max_abs": 34.25 + }, + "full_input": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f87b5dc32295304c365e693ea77ed318c95676043ed9bab294e4b7993a74c85e", + "mean": -0.004231786355376244, + "std": 9.856510162353516, + "rms": 9.856511116027832, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4787936a5ee1ff342e77e7aaa80d11994798af831c73ef7228f1bb10d4dc0365", + "mean": 0.004455245099961758, + "std": 1.1167808771133423, + "rms": 1.116789698600769, + "max_abs": 33.0 + }, + "full_input": { + "shape": [ + 68, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9cd4e078fd1f276f4dc4d122c008b7ca2b0dcedea618bec616b0e698e43d7ce3", + "mean": -0.007797226309776306, + "std": 8.621944427490234, + "rms": 8.6219482421875, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6ab51257179ea55dc471fddec4e0325185a7fb5ce66ecbea50d72ef774cb36dd", + "mean": 0.0034885273780673742, + "std": 1.122880220413208, + "rms": 1.1228855848312378, + "max_abs": 34.0 + }, + "full_input": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fd462fed115250961a40ff4cbf7090b044cdd82ece34ecb1e3ab59ce5f579800", + "mean": -0.0036675098817795515, + "std": 9.856062889099121, + "rms": 9.856063842773438, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8aa88ce3171af27dc6ea511e78423903bbb1efafba0242ee0bc05ca0c1e4a44d", + "mean": 0.003773018717765808, + "std": 1.115693211555481, + "rms": 1.1156995296478271, + "max_abs": 32.25 + }, + "full_input": { + "shape": [ + 68, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "24af6c2ebfdd3c13c0fea16678ea52b705f24c4953b9457ce5465e71bcae3e82", + "mean": -0.007697437424212694, + "std": 8.621747970581055, + "rms": 8.62175178527832, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.995935320854187, + "min_cosine_similarity": 0.9790259599685669, + "mean_relative_l2": 0.08100961148738861, + "max_abs_delta": 1.75 + }, + "system_bos": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9939994215965271, + "min_cosine_similarity": 0.9676542282104492, + "mean_relative_l2": 0.10268817096948624, + "max_abs_delta": 1.75 + }, + "system_x": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.980746865272522, + "min_cosine_similarity": 0.7519549131393433, + "mean_relative_l2": 0.15417569875717163, + "max_abs_delta": 6.125 + }, + "system_period": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9790017008781433, + "min_cosine_similarity": 0.743159294128418, + "mean_relative_l2": 0.16353321075439453, + "max_abs_delta": 6.0 + }, + "bos_at_s0": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9918412566184998, + "min_cosine_similarity": 0.9674063920974731, + "mean_relative_l2": 0.12066297233104706, + "max_abs_delta": 2.125 + }, + "bos_at_s1": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9911323189735413, + "min_cosine_similarity": 0.9643829464912415, + "mean_relative_l2": 0.12600857019424438, + "max_abs_delta": 2.8125 + }, + "x_at_s0": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.987123966217041, + "min_cosine_similarity": 0.9466660022735596, + "mean_relative_l2": 0.14970140159130096, + "max_abs_delta": 3.5 + }, + "x_at_s1": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9685021042823792, + "min_cosine_similarity": 0.7370896935462952, + "mean_relative_l2": 0.21297435462474823, + "max_abs_delta": 6.53125 + }, + "period_at_s0": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.985027015209198, + "min_cosine_similarity": 0.9323294162750244, + "mean_relative_l2": 0.15932585299015045, + "max_abs_delta": 4.25 + }, + "period_at_s1": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9645230174064636, + "min_cosine_similarity": 0.7319916486740112, + "mean_relative_l2": 0.2304074913263321, + "max_abs_delta": 7.5 + } + } + }, + "layer_18": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "118a0cffa79956583293b4cc8faae46846ccc4de3a708531e6327dd891568e33", + "mean": 0.012008251622319221, + "std": 1.2655854225158691, + "rms": 1.2656424045562744, + "max_abs": 38.25 + }, + "full_input": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b85878143064240d9dae4871a7d262d37535976d6b6be125373fa17564a43115", + "mean": -0.020689351484179497, + "std": 11.2505521774292, + "rms": 11.250571250915527, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c61edebd6345dd4b7b98f64a2f706f5282a666ca1c01e0dd935e16c163e3a6d5", + "mean": 0.011878508143126965, + "std": 1.2629987001419067, + "rms": 1.263054609298706, + "max_abs": 38.25 + }, + "full_input": { + "shape": [ + 68, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c72b43b9936b2cda75da2062d2190391521afe9d1b4af01deef9306618fd6df1", + "mean": -0.02293587476015091, + "std": 10.146662712097168, + "rms": 10.146688461303711, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f1e580ff748408fbd315f8bc48d83f76fd55dce7d52addf192b4c894c2606db4", + "mean": 0.011235112324357033, + "std": 1.2650848627090454, + "rms": 1.2651348114013672, + "max_abs": 37.5 + }, + "full_input": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c359e0f1dbc24669ae4877deb298dd2e9e1b7398b8992c5faa44a49a0f06dd86", + "mean": 0.0008139002602547407, + "std": 9.87567138671875, + "rms": 9.87567138671875, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "186f77b325aceac39d3f45cc0fa8134d5b7607c0710ce684a457e372892ba50c", + "mean": 0.012059248052537441, + "std": 1.2675846815109253, + "rms": 1.2676420211791992, + "max_abs": 38.25 + }, + "full_input": { + "shape": [ + 68, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9439585f0401ef88f5d24a169d238cfddba0a3aa1df9ad4b182802750aa605a9", + "mean": -0.0032627175096422434, + "std": 8.64332389831543, + "rms": 8.643324851989746, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e7be80f239825d953934fc8d714ae79fe9220ad145fef9bb49ba4334176febea", + "mean": 0.012738951481878757, + "std": 1.261741280555725, + "rms": 1.261805534362793, + "max_abs": 36.5 + }, + "full_input": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "31f90dee8cd9a4dbd5d579de51a5a5464abf1f90282c0443d4ec71b1721e8f99", + "mean": 0.0007647183956578374, + "std": 9.876286506652832, + "rms": 9.876286506652832, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f51cf9ba69fbcb394895e684d47cf96adf7f5d947b82b9f7bfcc32febb0e47f7", + "mean": 0.012900066561996937, + "std": 1.2493672370910645, + "rms": 1.2494338750839233, + "max_abs": 35.0 + }, + "full_input": { + "shape": [ + 68, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5cf0e0354a2ec1ca141a2e321e4d38eb215e6a3e5b4fe1a2de323971db57d218", + "mean": -0.0035411580465734005, + "std": 8.64274787902832, + "rms": 8.64274787902832, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3942e1e510ec93a81d6c8bda14397518c4f696f5e084970be6dcbde989629206", + "mean": 0.011650673113763332, + "std": 1.2616196870803833, + "rms": 1.2616735696792603, + "max_abs": 36.25 + }, + "full_input": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ef9dd40a8229351182e2975993b541560fcaa709eb0a80b6d71f53fd0bd9e918", + "mean": 0.001186912995763123, + "std": 9.87573528289795, + "rms": 9.87573528289795, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "01f5de8e833c2a8298d7e5735e9214d2649369c7d295da3fb08eae30a6cb7328", + "mean": 0.011597983539104462, + "std": 1.243844985961914, + "rms": 1.2438989877700806, + "max_abs": 34.0 + }, + "full_input": { + "shape": [ + 68, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "796cc9019dd3df33f74351d2d311bb6f8d1c21ccb7ca5fdc2f365db8de4043cb", + "mean": -0.0038017272017896175, + "std": 8.642058372497559, + "rms": 8.642059326171875, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9961283206939697, + "min_cosine_similarity": 0.9799314737319946, + "mean_relative_l2": 0.07956681400537491, + "max_abs_delta": 1.875 + }, + "system_bos": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9939043521881104, + "min_cosine_similarity": 0.9649997353553772, + "mean_relative_l2": 0.1022053137421608, + "max_abs_delta": 3.0625 + }, + "system_x": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9818829894065857, + "min_cosine_similarity": 0.7949686050415039, + "mean_relative_l2": 0.15451976656913757, + "max_abs_delta": 6.0234375 + }, + "system_period": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.979834258556366, + "min_cosine_similarity": 0.7776721715927124, + "mean_relative_l2": 0.16300442814826965, + "max_abs_delta": 6.75 + }, + "bos_at_s0": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9919823408126831, + "min_cosine_similarity": 0.969414472579956, + "mean_relative_l2": 0.1195390373468399, + "max_abs_delta": 2.4375 + }, + "bos_at_s1": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9909565448760986, + "min_cosine_similarity": 0.9634246826171875, + "mean_relative_l2": 0.1258719563484192, + "max_abs_delta": 4.875 + }, + "x_at_s0": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9871819019317627, + "min_cosine_similarity": 0.9462969303131104, + "mean_relative_l2": 0.14906489849090576, + "max_abs_delta": 4.375 + }, + "x_at_s1": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9692769050598145, + "min_cosine_similarity": 0.7771848440170288, + "mean_relative_l2": 0.2123318761587143, + "max_abs_delta": 7.5546875 + }, + "period_at_s0": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9851851463317871, + "min_cosine_similarity": 0.9273192882537842, + "mean_relative_l2": 0.15826104581356049, + "max_abs_delta": 6.0 + }, + "period_at_s1": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9647482633590698, + "min_cosine_similarity": 0.7643459439277649, + "mean_relative_l2": 0.23055869340896606, + "max_abs_delta": 8.6875 + } + } + }, + "layer_19": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9b165b9b7ef5613e7f03975c98724a48c56b54c02308d558cd29f04a12183810", + "mean": 0.015678448602557182, + "std": 1.403889536857605, + "rms": 1.4039771556854248, + "max_abs": 40.0 + }, + "full_input": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b34b09277f003fb1ad6223147ba9aacbd73482f9578e242d375215b9efc26026", + "mean": -0.017529407516121864, + "std": 11.259688377380371, + "rms": 11.2597017288208, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "25df4d4cb5925c61bbeabae0076fbba93dc6a7051fe691d3a39f3290ede64a3d", + "mean": 0.015654662624001503, + "std": 1.4019781351089478, + "rms": 1.4020655155181885, + "max_abs": 40.0 + }, + "full_input": { + "shape": [ + 68, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8c7eb98ea046df82740a5430838224b09c797b9236175c129abe335bd4b69c00", + "mean": -0.01974279060959816, + "std": 10.157767295837402, + "rms": 10.15778636932373, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b5f25f79acc4cf13b0729e035ab56d3c71e25bb2e691cfbbf9e81a67a2350c7c", + "mean": 0.01577872224152088, + "std": 1.3976207971572876, + "rms": 1.397709846496582, + "max_abs": 39.25 + }, + "full_input": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "43a8ed2e93185e2b99e83ad8ba1dc74be3f1fb64027afbd21bf120b517ce9388", + "mean": 0.003840502817183733, + "std": 9.886141777038574, + "rms": 9.886141777038574, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3ef2cba76f3ab51e482ea844280cb7bbc238c7187b54cb50159978cbff327e4c", + "mean": 0.016296150162816048, + "std": 1.4037461280822754, + "rms": 1.4038406610488892, + "max_abs": 40.25 + }, + "full_input": { + "shape": [ + 68, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b8150bde1b6b81ed46c8990a267d29478b4dbd5d95beb8a238e17d1f92ebf5f5", + "mean": 0.00014106622256804258, + "std": 8.656158447265625, + "rms": 8.656158447265625, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f1abd3afccb7f6f7a5bfe5c24bd4632c30c3d45b4e2baf2d8a669729077a3a9b", + "mean": 0.01716037280857563, + "std": 1.3939414024353027, + "rms": 1.3940470218658447, + "max_abs": 37.5 + }, + "full_input": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9ad6824d79af86ebe6929fa02f377a31e93f10eb4252d624365e399a2e86788c", + "mean": 0.0038053805474191904, + "std": 9.887099266052246, + "rms": 9.887099266052246, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "db8359e01d6717a960ab321e1397ed24a450a2a7a2dca20a87c03dbc29a8e601", + "mean": 0.01745721511542797, + "std": 1.377639889717102, + "rms": 1.3777505159378052, + "max_abs": 36.25 + }, + "full_input": { + "shape": [ + 68, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4e64ce7e3b8d377d4acdd0392d2bad7a71966b0a67eccd606a3138952853f501", + "mean": 6.13577212789096e-05, + "std": 8.655052185058594, + "rms": 8.655052185058594, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7be8107a402f76251030c0d0238d53e9299fc63c0b5fdf42c030f3f614f50326", + "mean": 0.0158067774027586, + "std": 1.392871379852295, + "rms": 1.392961025238037, + "max_abs": 37.5 + }, + "full_input": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "143c182def576a801944b0cce95be513afab1cb91b6bf6a98a932be114dbb67a", + "mean": 0.003673122962936759, + "std": 9.886280059814453, + "rms": 9.88628101348877, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "164836ccd8f3db34a24c23066d12a21bada9ed35eed723f87915892397e665da", + "mean": 0.015739886090159416, + "std": 1.3743268251419067, + "rms": 1.3744169473648071, + "max_abs": 35.0 + }, + "full_input": { + "shape": [ + 68, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5acae7c78e46c2f141bd24c3eb271518bd3b10e1889adfc6dd660897a1c77c09", + "mean": -0.0007733928505331278, + "std": 8.654601097106934, + "rms": 8.654601097106934, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9959599375724792, + "min_cosine_similarity": 0.9789447784423828, + "mean_relative_l2": 0.08127464354038239, + "max_abs_delta": 1.5 + }, + "system_bos": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9935660362243652, + "min_cosine_similarity": 0.9623437523841858, + "mean_relative_l2": 0.104498490691185, + "max_abs_delta": 3.25 + }, + "system_x": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9813074469566345, + "min_cosine_similarity": 0.8081966638565063, + "mean_relative_l2": 0.15817035734653473, + "max_abs_delta": 6.125 + }, + "system_period": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9791077375411987, + "min_cosine_similarity": 0.7850311994552612, + "mean_relative_l2": 0.16623619198799133, + "max_abs_delta": 7.0 + }, + "bos_at_s0": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9916504621505737, + "min_cosine_similarity": 0.9660265445709229, + "mean_relative_l2": 0.12139906734228134, + "max_abs_delta": 2.75 + }, + "bos_at_s1": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.990703284740448, + "min_cosine_similarity": 0.9630309343338013, + "mean_relative_l2": 0.12646272778511047, + "max_abs_delta": 5.125 + }, + "x_at_s0": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9865214824676514, + "min_cosine_similarity": 0.9442846775054932, + "mean_relative_l2": 0.152278870344162, + "max_abs_delta": 4.5 + }, + "x_at_s1": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9674269556999207, + "min_cosine_similarity": 0.7818049192428589, + "mean_relative_l2": 0.21690504252910614, + "max_abs_delta": 8.125 + }, + "period_at_s0": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9842129945755005, + "min_cosine_similarity": 0.9183528423309326, + "mean_relative_l2": 0.16217531263828278, + "max_abs_delta": 6.25 + }, + "period_at_s1": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9624370336532593, + "min_cosine_similarity": 0.7635246515274048, + "mean_relative_l2": 0.23512119054794312, + "max_abs_delta": 9.75 + } + } + }, + "layer_20": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c3371d235bf32b4580de47c86d7185da3925c7bd5db1e3db75ad3e59754b5cf9", + "mean": 0.02283991500735283, + "std": 1.554152011871338, + "rms": 1.5543197393417358, + "max_abs": 39.5 + }, + "full_input": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ebf3ac273bd6b1e4b0add9ce1ec2eb5cd1d548a229bf3a96294adfcd1feb1e84", + "mean": -0.01392333209514618, + "std": 11.61134147644043, + "rms": 11.611349105834961, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3b98bb77ac7b7c9bac73034c1868cf7f0e10b77ed753313064a73378f5542e7e", + "mean": 0.022954411804676056, + "std": 1.550193428993225, + "rms": 1.550363302230835, + "max_abs": 40.25 + }, + "full_input": { + "shape": [ + 68, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "42f7da74d987c0f87c917505b2c4e76161e4783c6177cc11609b8d7bbb752366", + "mean": -0.01679408550262451, + "std": 10.491710662841797, + "rms": 10.491724014282227, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "33046a9aa29b74ca43eef9ec6d5e869b6bfacf3bcd65569fb75fe7f04d40feea", + "mean": 0.0230712927877903, + "std": 1.5444204807281494, + "rms": 1.5445927381515503, + "max_abs": 39.0 + }, + "full_input": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "07d27579b2a976a0cf0dfbf4e3eea76f0957ffbf930ee594bac92a9d91b1d0b7", + "mean": 0.006457031704485416, + "std": 9.906434059143066, + "rms": 9.906435012817383, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1a80725ee785ae64adb763083f8fa47aadbed4b5adea124728c7c68eea385a19", + "mean": 0.023920034989714622, + "std": 1.548621416091919, + "rms": 1.548806071281433, + "max_abs": 40.5 + }, + "full_input": { + "shape": [ + 68, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "dbbbd40376e15de013874e97c6a34f47742a48dd9c35b377b24eb4787db4908c", + "mean": 0.002436400856822729, + "std": 8.679753303527832, + "rms": 8.679753303527832, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1ebad43fb65ea1535d235cce136e5cfeb76e922a7130b3842c02bb52b650b8f8", + "mean": 0.024514390155673027, + "std": 1.5370686054229736, + "rms": 1.537264108657837, + "max_abs": 38.0 + }, + "full_input": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4043c5f4391cb9d72bb083ade22970ebf303eddb6c2b23a5a4330b31904676c4", + "mean": 0.0062767197377979755, + "std": 9.907471656799316, + "rms": 9.90747356414795, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6f04d4fbe9e8c7f1f458cb4bbcc363dedda514b0e2cb8eda44f178e223fa1415", + "mean": 0.026304515078663826, + "std": 1.516040563583374, + "rms": 1.5162687301635742, + "max_abs": 37.0 + }, + "full_input": { + "shape": [ + 68, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "471f0ba6e0a8303404f55f6e58acf98f70c3541bafed39f302ec7325036577ff", + "mean": 0.002872867975383997, + "std": 8.678449630737305, + "rms": 8.678450584411621, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e90e137621d7dd59502ca3d8ea02d9886bd56a1adba7e7ad51d1ef212b598302", + "mean": 0.022670339792966843, + "std": 1.5351852178573608, + "rms": 1.5353525876998901, + "max_abs": 37.75 + }, + "full_input": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d91bbfcf9396bc16b7bae96384f4f5071d948fe5f54415048d555d5800c981ae", + "mean": 0.00615935493260622, + "std": 9.906417846679688, + "rms": 9.906418800354004, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "574f792952e511990e9f304ba7a8f4f20e9cd587b7dec32149037b2e0aad5477", + "mean": 0.02358461171388626, + "std": 1.5127609968185425, + "rms": 1.5129448175430298, + "max_abs": 37.5 + }, + "full_input": { + "shape": [ + 68, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "37d99158ae2ccfe252aa4abd0b71340e6bc6e5996adaedb36e901be35bd27c3d", + "mean": 0.0019323917804285884, + "std": 8.677715301513672, + "rms": 8.677715301513672, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9955658912658691, + "min_cosine_similarity": 0.9773997664451599, + "mean_relative_l2": 0.08495911210775375, + "max_abs_delta": 1.75 + }, + "system_bos": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9932349324226379, + "min_cosine_similarity": 0.9596861600875854, + "mean_relative_l2": 0.10709638893604279, + "max_abs_delta": 3.625 + }, + "system_x": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9795309901237488, + "min_cosine_similarity": 0.7923927307128906, + "mean_relative_l2": 0.1676999181509018, + "max_abs_delta": 5.875 + }, + "system_period": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9777572154998779, + "min_cosine_similarity": 0.7777098417282104, + "mean_relative_l2": 0.17424005270004272, + "max_abs_delta": 7.375 + }, + "bos_at_s0": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9913501739501953, + "min_cosine_similarity": 0.9623357057571411, + "mean_relative_l2": 0.12296375632286072, + "max_abs_delta": 2.75 + }, + "bos_at_s1": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9904986619949341, + "min_cosine_similarity": 0.9651762843132019, + "mean_relative_l2": 0.1282244324684143, + "max_abs_delta": 5.375 + }, + "x_at_s0": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9862850904464722, + "min_cosine_similarity": 0.9496580958366394, + "mean_relative_l2": 0.15446196496486664, + "max_abs_delta": 4.5 + }, + "x_at_s1": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.966691255569458, + "min_cosine_similarity": 0.7775998711585999, + "mean_relative_l2": 0.22173984348773956, + "max_abs_delta": 8.375 + }, + "period_at_s0": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9836902618408203, + "min_cosine_similarity": 0.9139013886451721, + "mean_relative_l2": 0.16478930413722992, + "max_abs_delta": 6.5 + }, + "period_at_s1": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9612928032875061, + "min_cosine_similarity": 0.7593533992767334, + "mean_relative_l2": 0.2407768815755844, + "max_abs_delta": 10.0 + } + } + }, + "layer_21": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2557894cddda63bff656cd18bcea26066fb2ee4b09eff14667a85de5474514f2", + "mean": 0.03210185095667839, + "std": 1.75750732421875, + "rms": 1.7578004598617554, + "max_abs": 48.5 + }, + "full_input": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "66088a53a52bdfb73c8648631c4c62caf7eefd4b260396983f54719fda104698", + "mean": -0.00754781998693943, + "std": 11.740222930908203, + "rms": 11.740225791931152, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "406b252d100eb994cb3bcc031c0d80cbf5496682a70fbbf93f36a1d215c09d67", + "mean": 0.03234696760773659, + "std": 1.7498785257339478, + "rms": 1.7501773834228516, + "max_abs": 48.25 + }, + "full_input": { + "shape": [ + 68, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6bdbc28d04cd906a4b12c834aa54d4b4ffbc3a4161ea73fa5b5561a2cd3fbc7c", + "mean": -0.010897746309638023, + "std": 10.603889465332031, + "rms": 10.60389518737793, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "25b45ddfe672a736942759c737e655131a3ba0250b0986d4e30bc1ca1ce2c98c", + "mean": 0.030882371589541435, + "std": 1.7390880584716797, + "rms": 1.7393622398376465, + "max_abs": 48.5 + }, + "full_input": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3e8e22b1d7e2ab83ce23c8957c8a44e142090ecbcf960e8132bcd71dcf3103a9", + "mean": 0.012276621535420418, + "std": 9.905879974365234, + "rms": 9.905888557434082, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "28480e6899e8df70cf234014bbdfba560253a47e67eebfe2dccbfbd31ee9d906", + "mean": 0.0320608876645565, + "std": 1.7355563640594482, + "rms": 1.7358523607254028, + "max_abs": 47.5 + }, + "full_input": { + "shape": [ + 68, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "dcf6464e7662d3720e0f84a0639628cf3e72768494a19c1459bb2036327e12ef", + "mean": 0.007930180989205837, + "std": 8.687427520751953, + "rms": 8.687430381774902, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f6d6372b008705b6c7a9fda76b3354b4e371cad489873ed6676ef16c6c391727", + "mean": 0.0325763076543808, + "std": 1.729347586631775, + "rms": 1.729654312133789, + "max_abs": 48.25 + }, + "full_input": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9f447845f02427f07e8c9880fcd6998810c1f8249784f0cfa4b03c35788db915", + "mean": 0.012354627251625061, + "std": 9.907452583312988, + "rms": 9.907461166381836, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e6eb31845d6d01265512a654374559493726b07570d3283c527d5719b29c8c94", + "mean": 0.033959031105041504, + "std": 1.7061370611190796, + "rms": 1.706475019454956, + "max_abs": 46.5 + }, + "full_input": { + "shape": [ + 68, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4ee9bcbe371fd7e3cc3d3d2180de143adb1919190355a0c905c1fc371842f484", + "mean": 0.007856772281229496, + "std": 8.687067985534668, + "rms": 8.687070846557617, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b53258d6b4dcd1abbda2c818dbcf9066c22d8658c9e2b70e050910234c2276d4", + "mean": 0.03108680620789528, + "std": 1.7228097915649414, + "rms": 1.7230901718139648, + "max_abs": 47.5 + }, + "full_input": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b6b826226dd69ba498905268906cd3b750e1110a9b0bfce3132d40c075632402", + "mean": 0.01233853492885828, + "std": 9.905240058898926, + "rms": 9.905247688293457, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b98e1ef8f71b784623d13c042b75b912592952c196e745052a39e9c10ed68d07", + "mean": 0.031319018453359604, + "std": 1.6978589296340942, + "rms": 1.6981478929519653, + "max_abs": 47.0 + }, + "full_input": { + "shape": [ + 68, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "de80a8cdd41e553787108ae1f729c9fa871a643d93b674f03bf01d48a3527740", + "mean": 0.007114604581147432, + "std": 8.685091018676758, + "rms": 8.68509292602539, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9952377676963806, + "min_cosine_similarity": 0.9756366014480591, + "mean_relative_l2": 0.08899108320474625, + "max_abs_delta": 1.75 + }, + "system_bos": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9927733540534973, + "min_cosine_similarity": 0.9554351568222046, + "mean_relative_l2": 0.11070805042982101, + "max_abs_delta": 4.5 + }, + "system_x": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9771241545677185, + "min_cosine_similarity": 0.7776566743850708, + "mean_relative_l2": 0.17723052203655243, + "max_abs_delta": 5.875 + }, + "system_period": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.975553035736084, + "min_cosine_similarity": 0.7571044564247131, + "mean_relative_l2": 0.18289153277873993, + "max_abs_delta": 6.625 + }, + "bos_at_s0": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9907323122024536, + "min_cosine_similarity": 0.962262749671936, + "mean_relative_l2": 0.12810619175434113, + "max_abs_delta": 3.0 + }, + "bos_at_s1": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9895594120025635, + "min_cosine_similarity": 0.9610056281089783, + "mean_relative_l2": 0.1345975697040558, + "max_abs_delta": 6.75 + }, + "x_at_s0": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9850143194198608, + "min_cosine_similarity": 0.9447818398475647, + "mean_relative_l2": 0.1615229845046997, + "max_abs_delta": 5.25 + }, + "x_at_s1": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9633564352989197, + "min_cosine_similarity": 0.7546466588973999, + "mean_relative_l2": 0.2320840209722519, + "max_abs_delta": 9.0 + }, + "period_at_s0": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9823546409606934, + "min_cosine_similarity": 0.9120582938194275, + "mean_relative_l2": 0.17188504338264465, + "max_abs_delta": 8.0 + }, + "period_at_s1": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9580110907554626, + "min_cosine_similarity": 0.7358791828155518, + "mean_relative_l2": 0.2505987286567688, + "max_abs_delta": 12.0 + } + } + }, + "layer_22": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7bb68b9688f94785fa971a2abd5206891d213a9ec936f2459cf88acfa355a7cd", + "mean": 0.043110404163599014, + "std": 2.0748870372772217, + "rms": 2.0753350257873535, + "max_abs": 62.0 + }, + "full_input": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ea00b7fd6c9880e4ea0d87c72b20f2b713ab844cbdde71bda1e534624697ca17", + "mean": -0.0026552139315754175, + "std": 11.775309562683105, + "rms": 11.775310516357422, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "afd05517d6a4e60bf73a7892a375544d22ccbd48eaa78597ab485e7665fedfc7", + "mean": 0.04419267177581787, + "std": 2.062566041946411, + "rms": 2.0630393028259277, + "max_abs": 62.0 + }, + "full_input": { + "shape": [ + 68, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2d9ff106848df3598c4667e12b862b06964e7891ed4fd0cbab18ad843cd7addf", + "mean": -0.00722947483882308, + "std": 10.644713401794434, + "rms": 10.644716262817383, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f77dbc5b8758a5084e4c05ea51c6a1591115ed8a7a30be306b241188cc702f7f", + "mean": 0.04249291494488716, + "std": 2.039628744125366, + "rms": 2.0400712490081787, + "max_abs": 60.5 + }, + "full_input": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a152687bfbccde86ac993f27da1d2c1bb0c9bc3d9a39fb7562cd2061e06eb523", + "mean": 0.01815270259976387, + "std": 9.945694923400879, + "rms": 9.945711135864258, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "88092f1519bc3143ebcca8fe71e5e98abb8aa84dfc9767a33341274a696ee6de", + "mean": 0.043772440403699875, + "std": 2.030895471572876, + "rms": 2.031367063522339, + "max_abs": 60.5 + }, + "full_input": { + "shape": [ + 68, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b4beb3385025b4b6ba13838e693a14be208516b1527a0d763cb58919a3e66e68", + "mean": 0.011681090109050274, + "std": 8.736337661743164, + "rms": 8.736346244812012, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4ea650a736e228fd14ba759c03b3eaf8e720f8660b280fecf1953d1987bf7260", + "mean": 0.04345056787133217, + "std": 2.0229575634002686, + "rms": 2.0234241485595703, + "max_abs": 60.0 + }, + "full_input": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b21d7a38c48d657909f8fca93740d9684b6580c914b1324f1ee802550853f8b9", + "mean": 0.01762668415904045, + "std": 9.947064399719238, + "rms": 9.9470796585083, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "14e845c670be2829d24dffc4907213401e2e3b28e288882a8c9553a3c6e0ea76", + "mean": 0.04544100537896156, + "std": 1.9889435768127441, + "rms": 1.9894624948501587, + "max_abs": 59.0 + }, + "full_input": { + "shape": [ + 68, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a5a990c348b102d5e498403ba0a1a1c621833c2dab9e224c12d0a96020e5ceed", + "mean": 0.012143327854573727, + "std": 8.735305786132812, + "rms": 8.73531436920166, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d78ce9634719ffe04d731b3623b6fd02b60b9ee8fc71bd2396aec40295b01186", + "mean": 0.042391255497932434, + "std": 2.01267409324646, + "rms": 2.013120412826538, + "max_abs": 60.0 + }, + "full_input": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5b99f9a8c2b5fd24d16601812164188a82c1057afe9fa639edf8229c28ba8f9a", + "mean": 0.017702940851449966, + "std": 9.943989753723145, + "rms": 9.944005966186523, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a58303952c8dbc9ba79b77f18a8bce5f369fc5c4e7dd30f613e811c8da2c172f", + "mean": 0.04342794045805931, + "std": 1.9751873016357422, + "rms": 1.9756646156311035, + "max_abs": 58.25 + }, + "full_input": { + "shape": [ + 68, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "31f47486b9f1b564226fc3838035bb1c91af3819b9901ac1548074597aa66472", + "mean": 0.011530057527124882, + "std": 8.732263565063477, + "rms": 8.732271194458008, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9955822825431824, + "min_cosine_similarity": 0.981619119644165, + "mean_relative_l2": 0.08694448322057724, + "max_abs_delta": 1.75 + }, + "system_bos": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9929072260856628, + "min_cosine_similarity": 0.9571812748908997, + "mean_relative_l2": 0.11048470437526703, + "max_abs_delta": 5.75 + }, + "system_x": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9770487546920776, + "min_cosine_similarity": 0.8104981184005737, + "mean_relative_l2": 0.18046683073043823, + "max_abs_delta": 6.9375 + }, + "system_period": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9757000207901001, + "min_cosine_similarity": 0.8032395839691162, + "mean_relative_l2": 0.18659989535808563, + "max_abs_delta": 8.5 + }, + "bos_at_s0": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9904267191886902, + "min_cosine_similarity": 0.9616086483001709, + "mean_relative_l2": 0.13029325008392334, + "max_abs_delta": 4.25 + }, + "bos_at_s1": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9895316362380981, + "min_cosine_similarity": 0.9624589681625366, + "mean_relative_l2": 0.1356891691684723, + "max_abs_delta": 8.75 + }, + "x_at_s0": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9850607514381409, + "min_cosine_similarity": 0.9451072216033936, + "mean_relative_l2": 0.16245819628238678, + "max_abs_delta": 6.75 + }, + "x_at_s1": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9629279375076294, + "min_cosine_similarity": 0.7894150614738464, + "mean_relative_l2": 0.23432376980781555, + "max_abs_delta": 11.0 + }, + "period_at_s0": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9820718169212341, + "min_cosine_similarity": 0.9117078185081482, + "mean_relative_l2": 0.17491494119167328, + "max_abs_delta": 9.75 + }, + "period_at_s1": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9571799635887146, + "min_cosine_similarity": 0.7823961973190308, + "mean_relative_l2": 0.2551330029964447, + "max_abs_delta": 14.5 + } + } + }, + "layer_23": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "915f2f6f8174921a7d2ea4365a94a7fd3d07faa224711a1226f1a791bdaa49ba", + "mean": 0.055002376437187195, + "std": 2.446223497390747, + "rms": 2.4468417167663574, + "max_abs": 80.0 + }, + "full_input": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "05223c444b555adf935ba1b50349a430039109fb1f674ba9917754d10a25fbbe", + "mean": 0.00391796138137579, + "std": 11.784357070922852, + "rms": 11.784357070922852, + "max_abs": 1160.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "76d6494489097ec7e3dbef94ea07f312880d297f7e60401fa300b561739ca189", + "mean": 0.05640551075339317, + "std": 2.4048702716827393, + "rms": 2.405531644821167, + "max_abs": 80.5 + }, + "full_input": { + "shape": [ + 68, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "af671953af057a90665e6f416520e28509030944208d7628c69e372ad516c1e8", + "mean": -2.5458195523242466e-05, + "std": 10.665608406066895, + "rms": 10.665607452392578, + "max_abs": 1160.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c8c326d54f0b188ea6306daaa557a1e4768b6ea5c1d906af409fd51495a06ced", + "mean": 0.05633498728275299, + "std": 2.3937034606933594, + "rms": 2.3943662643432617, + "max_abs": 78.5 + }, + "full_input": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "86de531bea62fbf8894b1331a71ddfebb0d7db2a0deb2327fad8265bd343818c", + "mean": 0.026010660454630852, + "std": 9.967784881591797, + "rms": 9.967819213867188, + "max_abs": 1160.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ebcbae0e19e01d866090e9de529fa287aa885e0618bb7df4e83a738c1933728c", + "mean": 0.05802306532859802, + "std": 2.359999418258667, + "rms": 2.3607125282287598, + "max_abs": 79.0 + }, + "full_input": { + "shape": [ + 68, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ceca683aa0a4fd0a082dd0e3efcaa2b081d84e5559623eec0b757fd85ec04c20", + "mean": 0.0199254360049963, + "std": 8.777040481567383, + "rms": 8.77706241607666, + "max_abs": 1160.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "561ec38a7d543ba29f98602b48bb447a2ba3578a8a51d02a42e0ff7a5a8f680d", + "mean": 0.05781662091612816, + "std": 2.401898145675659, + "rms": 2.4025938510894775, + "max_abs": 77.5 + }, + "full_input": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4973efb896de5df86d3d42849076d026279bb64a00b07ab6cdcc6a26c8e3c49c", + "mean": 0.02622726745903492, + "std": 9.974692344665527, + "rms": 9.974726676940918, + "max_abs": 1160.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1c803b6988025d97cb92afb907b2f453aaf5cd42a2ad8515d49e8924b34cc6aa", + "mean": 0.06003458425402641, + "std": 2.384350299835205, + "rms": 2.385105848312378, + "max_abs": 77.5 + }, + "full_input": { + "shape": [ + 68, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "68ff83d83b3fb0dedb3d57ae185451c188d8946c35e574e3a08d7693daf2bd6d", + "mean": 0.02046085335314274, + "std": 8.785197257995605, + "rms": 8.785221099853516, + "max_abs": 1160.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6221567331b777d133cbc209b6fd508b9785ba6c4a7a7940cf40c9355fd7527f", + "mean": 0.05668587610125542, + "std": 2.3867385387420654, + "rms": 2.387411594390869, + "max_abs": 77.5 + }, + "full_input": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b4d02801fc2b08f961b6c256c741dade83c5fd56e904937716422b0b1c34eba8", + "mean": 0.026015818119049072, + "std": 9.969155311584473, + "rms": 9.969189643859863, + "max_abs": 1160.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f2e8be9b69bce0308a585e7ace32f9c6da0eb87b6a7978a8b0134790d3383723", + "mean": 0.058561060577631, + "std": 2.352395534515381, + "rms": 2.3531243801116943, + "max_abs": 76.0 + }, + "full_input": { + "shape": [ + 68, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "104d045c6c15403966431a68cecf71683844e36bfeaae293752f26016ecdc7bc", + "mean": 0.019579071551561356, + "std": 8.77852725982666, + "rms": 8.778549194335938, + "max_abs": 1160.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9959592223167419, + "min_cosine_similarity": 0.9814443588256836, + "mean_relative_l2": 0.085844486951828, + "max_abs_delta": 3.8125 + }, + "system_bos": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9940227270126343, + "min_cosine_similarity": 0.9804214239120483, + "mean_relative_l2": 0.10523927956819534, + "max_abs_delta": 7.75 + }, + "system_x": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9824517369270325, + "min_cosine_similarity": 0.9104388952255249, + "mean_relative_l2": 0.16927538812160492, + "max_abs_delta": 7.5 + }, + "system_period": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9812518954277039, + "min_cosine_similarity": 0.8969389796257019, + "mean_relative_l2": 0.1743234395980835, + "max_abs_delta": 11.25 + }, + "bos_at_s0": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9908948540687561, + "min_cosine_similarity": 0.958537757396698, + "mean_relative_l2": 0.12713973224163055, + "max_abs_delta": 5.5 + }, + "bos_at_s1": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.989997148513794, + "min_cosine_similarity": 0.9584404230117798, + "mean_relative_l2": 0.1320946365594864, + "max_abs_delta": 11.75 + }, + "x_at_s0": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9861988425254822, + "min_cosine_similarity": 0.941679835319519, + "mean_relative_l2": 0.15517981350421906, + "max_abs_delta": 8.5 + }, + "x_at_s1": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9686339497566223, + "min_cosine_similarity": 0.8299692273139954, + "mean_relative_l2": 0.22527669370174408, + "max_abs_delta": 14.5 + }, + "period_at_s0": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.982604444026947, + "min_cosine_similarity": 0.9019337296485901, + "mean_relative_l2": 0.16915275156497955, + "max_abs_delta": 12.5 + }, + "period_at_s1": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9627541303634644, + "min_cosine_similarity": 0.8039060831069946, + "mean_relative_l2": 0.2448222041130066, + "max_abs_delta": 18.25 + } + } + }, + "layer_24": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "283f062fea80c4dc729a4ffc40c8ec813edde14f0c181ab9a6a2d6bbfa166a99", + "mean": 0.0631260797381401, + "std": 6.844358921051025, + "rms": 6.8446502685546875, + "max_abs": 486.0 + }, + "full_input": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "beea466a862519efbd297c5ef1022870c54d8d08a27498dac0fab6f4cf5e8773", + "mean": 0.005871822126209736, + "std": 11.9718017578125, + "rms": 11.971802711486816, + "max_abs": 1008.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "affee6897c99697c11e1cf813ffb6f15c8ebfb4bd68d271b75e9e5a135e434f2", + "mean": 0.06416326016187668, + "std": 6.97870397567749, + "rms": 6.97899866104126, + "max_abs": 500.0 + }, + "full_input": { + "shape": [ + 68, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "63680c479807b807397578e44ab00f1244d3ce7593748b5b897aa8a632821b99", + "mean": 0.0020974997896701097, + "std": 11.136897087097168, + "rms": 11.136898040771484, + "max_abs": 1120.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e70da6b2752cb48b620d8be564e745c2caedaa89493cb56536e0821458d06e9a", + "mean": 0.06458749622106552, + "std": 6.81397819519043, + "rms": 6.814283847808838, + "max_abs": 484.0 + }, + "full_input": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "081309122294f814738f11a0b02010d43f097716cd3e8f936063aa028673da69", + "mean": 0.030911464244127274, + "std": 8.363839149475098, + "rms": 8.363896369934082, + "max_abs": 840.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "66705eb58088b939a3d4ff16942679c0ce7097f08e581bf5f9697ab8ed92def8", + "mean": 0.06511977314949036, + "std": 7.122550964355469, + "rms": 7.122849464416504, + "max_abs": 512.0 + }, + "full_input": { + "shape": [ + 68, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "33e6b46bb378cacbc31fc46b6ed720dd062624fb1d54f73dd94b83474eafd789", + "mean": 0.02407018467783928, + "std": 7.558543682098389, + "rms": 7.558582305908203, + "max_abs": 840.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ffa1f37a5ab83882092126c3b590a8fd8e2b35e5f259b344a72866a4028e9a8d", + "mean": 0.06693115830421448, + "std": 6.730860233306885, + "rms": 6.731192588806152, + "max_abs": 478.0 + }, + "full_input": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f3bf2ffa8fd3228aff2bde6199baa3348dbe960831e3f5a836316b13881c3c28", + "mean": 0.03164695203304291, + "std": 8.338353157043457, + "rms": 8.33841323852539, + "max_abs": 840.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "194b8e47d610bdc849f96435069365c23cf44b814d3de27045537a01ccf9414d", + "mean": 0.06982811540365219, + "std": 6.104041576385498, + "rms": 6.104440689086914, + "max_abs": 430.0 + }, + "full_input": { + "shape": [ + 68, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "550175062e9a4212646619fb3fd5ba215c3bf452846baae85ccc66054ac2c750", + "mean": 0.02581324242055416, + "std": 7.205715656280518, + "rms": 7.205761909484863, + "max_abs": 840.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d120833d39b96dcf66b58a864f235416b21a2184fa0ae5756988479373df2228", + "mean": 0.06519433110952377, + "std": 6.748641014099121, + "rms": 6.748955726623535, + "max_abs": 480.0 + }, + "full_input": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6cbdb432d49e2ca0c01268510f247c080fb7433a6098186a3defb9ec36c74d71", + "mean": 0.031329717487096786, + "std": 8.340317726135254, + "rms": 8.340375900268555, + "max_abs": 840.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c28de0ec03d5930e6ca6729a8072b9ed0b410e81fd8d3307dcec4abfff146585", + "mean": 0.06777019053697586, + "std": 6.145187854766846, + "rms": 6.145561695098877, + "max_abs": 434.0 + }, + "full_input": { + "shape": [ + 68, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "733f15ebf76a24dabab7280c4b215972a51936fcfe93abf02a8ec17731765d59", + "mean": 0.024910302832722664, + "std": 7.213945388793945, + "rms": 7.213988780975342, + "max_abs": 840.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.996399462223053, + "min_cosine_similarity": 0.9795773029327393, + "mean_relative_l2": 0.07815838605165482, + "max_abs_delta": 14.0 + }, + "system_bos": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9951907992362976, + "min_cosine_similarity": 0.983312726020813, + "mean_relative_l2": 0.0946924164891243, + "max_abs_delta": 28.0 + }, + "system_x": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9861889481544495, + "min_cosine_similarity": 0.928342342376709, + "mean_relative_l2": 0.1530258059501648, + "max_abs_delta": 48.0 + }, + "system_period": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9852398633956909, + "min_cosine_similarity": 0.9183871746063232, + "mean_relative_l2": 0.1571296751499176, + "max_abs_delta": 46.0 + }, + "bos_at_s0": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9918530583381653, + "min_cosine_similarity": 0.955553412437439, + "mean_relative_l2": 0.1166699081659317, + "max_abs_delta": 9.0 + }, + "bos_at_s1": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9910960793495178, + "min_cosine_similarity": 0.9552687406539917, + "mean_relative_l2": 0.12226592749357224, + "max_abs_delta": 17.5 + }, + "x_at_s0": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9879963397979736, + "min_cosine_similarity": 0.9386865496635437, + "mean_relative_l2": 0.14169877767562866, + "max_abs_delta": 12.0 + }, + "x_at_s1": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9748744368553162, + "min_cosine_similarity": 0.8667846918106079, + "mean_relative_l2": 0.20106211304664612, + "max_abs_delta": 70.0 + }, + "period_at_s0": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9842835664749146, + "min_cosine_similarity": 0.8975505828857422, + "mean_relative_l2": 0.1571018397808075, + "max_abs_delta": 19.0 + }, + "period_at_s1": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9690120816230774, + "min_cosine_similarity": 0.8430604338645935, + "mean_relative_l2": 0.2224806398153305, + "max_abs_delta": 66.0 + } + } + }, + "layer_25": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ac25b40869c21238c04dde09c5f22554b314a9a88ccf73dcd490b081d1d0c958", + "mean": 0.09216871857643127, + "std": 7.2908124923706055, + "rms": 7.29139518737793, + "max_abs": 490.0 + }, + "full_input": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ecbab3211eef62151a5cf5847b456b5d42892c4615a428f961f7eed4826feefb", + "mean": 0.01723565347492695, + "std": 9.705113410949707, + "rms": 9.70512866973877, + "max_abs": 872.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2ed1b729a75fa6c32df63812c3ec73322e0c10fc308ffa62cb6c4d3de673e085", + "mean": 0.09477496892213821, + "std": 7.412022113800049, + "rms": 7.412628173828125, + "max_abs": 504.0 + }, + "full_input": { + "shape": [ + 68, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "085d218c865b0bcf3a4d86df40fb4fb2879afad9998541ee0e2c5a6bd54bbd3a", + "mean": 0.008230173960328102, + "std": 9.279648780822754, + "rms": 9.27965259552002, + "max_abs": 984.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "01f96187aecb677583a153b31dd1a4136668529c2d2524dc8c2716030669ebf5", + "mean": 0.0915231704711914, + "std": 7.241281032562256, + "rms": 7.241859436035156, + "max_abs": 488.0 + }, + "full_input": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4b06bdf7059f76c84834e049137da23c4fa8058f6e7fb3193e944c6684fdff82", + "mean": 0.04244082793593407, + "std": 5.98265266418457, + "rms": 5.9828033447265625, + "max_abs": 488.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "43e0e14cd45dd500e4c44d5bf2a746f050dd639eee0a3a96b97b4161e3564394", + "mean": 0.0920027643442154, + "std": 7.525463581085205, + "rms": 7.526025295257568, + "max_abs": 516.0 + }, + "full_input": { + "shape": [ + 68, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7949aa171b46e900d3d6ee7f637b3467954e3a52d2cd42ffe60c5bb3c53a8f1b", + "mean": 0.030061833560466766, + "std": 5.691911220550537, + "rms": 5.691990852355957, + "max_abs": 516.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f773310078abcfbe8733563544ad03cb7f4087629a91ef9ccb748977997d740b", + "mean": 0.09438967704772949, + "std": 7.158567428588867, + "rms": 7.159189701080322, + "max_abs": 482.0 + }, + "full_input": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c87a7e415492749acd1a91dc5f2304a4b34ca9d195ca25784c39271e9318ed95", + "mean": 0.04240914434194565, + "std": 5.9576616287231445, + "rms": 5.957812786102295, + "max_abs": 482.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "da574f3d1527d10b75f115b09307788c1d60a9373b9ff4d6c4db917899b30213", + "mean": 0.0971732810139656, + "std": 6.541213035583496, + "rms": 6.541934490203857, + "max_abs": 434.0 + }, + "full_input": { + "shape": [ + 68, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "53adac96cc9f3d4fdd8b9170b3e18ef884d5988c6c63361170444964a4b960c3", + "mean": 0.03192055597901344, + "std": 5.209789752960205, + "rms": 5.2098870277404785, + "max_abs": 434.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ffd62894d2057bed94bfe64b2d053b14c9f78a6dd0b2946ddad90ac218c34f88", + "mean": 0.09352521598339081, + "std": 7.173458576202393, + "rms": 7.174067974090576, + "max_abs": 484.0 + }, + "full_input": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e7ece9713c856b55a92b49e57a052d8c12d712d5c2b000f5bf1b0b9f50ef499d", + "mean": 0.04295806586742401, + "std": 5.952582359313965, + "rms": 5.952737331390381, + "max_abs": 484.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c7f652a523184a67a171196cddd1b91856de888fc01a6c91d25906080e0abfd8", + "mean": 0.09277690201997757, + "std": 6.565744400024414, + "rms": 6.566399574279785, + "max_abs": 438.0 + }, + "full_input": { + "shape": [ + 68, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0c0f33a7057e26def641d3ad52f90ff114c9c04a270a1c74852e1f3ed11e6dd6", + "mean": 0.030361715704202652, + "std": 5.2086052894592285, + "rms": 5.208693504333496, + "max_abs": 438.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9972601532936096, + "min_cosine_similarity": 0.9827562570571899, + "mean_relative_l2": 0.06833285838365555, + "max_abs_delta": 14.0 + }, + "system_bos": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9962173700332642, + "min_cosine_similarity": 0.9828159809112549, + "mean_relative_l2": 0.0841234028339386, + "max_abs_delta": 28.0 + }, + "system_x": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9891895055770874, + "min_cosine_similarity": 0.9482160806655884, + "mean_relative_l2": 0.1365685909986496, + "max_abs_delta": 48.0 + }, + "system_period": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9880793690681458, + "min_cosine_similarity": 0.9399895071983337, + "mean_relative_l2": 0.14207088947296143, + "max_abs_delta": 46.0 + }, + "bos_at_s0": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9937821626663208, + "min_cosine_similarity": 0.9616135954856873, + "mean_relative_l2": 0.10209177434444427, + "max_abs_delta": 18.5 + }, + "bos_at_s1": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9928932189941406, + "min_cosine_similarity": 0.9544872641563416, + "mean_relative_l2": 0.10874354094266891, + "max_abs_delta": 27.5 + }, + "x_at_s0": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9906166195869446, + "min_cosine_similarity": 0.9455947279930115, + "mean_relative_l2": 0.12582534551620483, + "max_abs_delta": 23.0 + }, + "x_at_s1": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.979858934879303, + "min_cosine_similarity": 0.8893420696258545, + "mean_relative_l2": 0.18090316653251648, + "max_abs_delta": 70.0 + }, + "period_at_s0": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9877055287361145, + "min_cosine_similarity": 0.9086400270462036, + "mean_relative_l2": 0.13829243183135986, + "max_abs_delta": 33.0 + }, + "period_at_s1": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9743337035179138, + "min_cosine_similarity": 0.847448468208313, + "mean_relative_l2": 0.20252974331378937, + "max_abs_delta": 66.0 + } + } + }, + "layer_26": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ac6f7b18b4bb58bda0497fcef821ff4fe46afd49b0d6b5e9957c16270c2bcc14", + "mean": 0.12614989280700684, + "std": 5.253081798553467, + "rms": 5.254595756530762, + "max_abs": 292.0 + }, + "full_input": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "09348f759840ba47eba830c830ef1fcf1e79abac21f345258a00937a08895827", + "mean": 0.02163141965866089, + "std": 9.100632667541504, + "rms": 9.100658416748047, + "max_abs": 840.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d90b5485d5fd1ee1e17b2646057ab89c468b29be4b9a1267454f71a6712fda56", + "mean": 0.12855364382266998, + "std": 5.174890518188477, + "rms": 5.176486492156982, + "max_abs": 282.0 + }, + "full_input": { + "shape": [ + 68, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "caa950ce565afc90ba73f6ac1f5b30cd38dbdbe5bad4a62f34c22321b6a99788", + "mean": 0.017992030829191208, + "std": 8.834590911865234, + "rms": 8.834609031677246, + "max_abs": 868.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9d13715f464d732438f0b2fdc3a9cb03490da4f8ca5bb9893356e83985e92bc1", + "mean": 0.1271456629037857, + "std": 5.191921710968018, + "rms": 5.193478584289551, + "max_abs": 274.0 + }, + "full_input": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "38ef6c594a3b2b4a2f6b645b9f882589741ad6f3c31418947b486ce78fdcb300", + "mean": 0.051618099212646484, + "std": 5.741212368011475, + "rms": 5.741444110870361, + "max_abs": 776.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c6bc0fb876b5f2c93d4df7d16120efb6a06f8009df772df94f1379c3d211acf0", + "mean": 0.12669318914413452, + "std": 5.096395969390869, + "rms": 5.097970485687256, + "max_abs": 278.0 + }, + "full_input": { + "shape": [ + 68, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c35e0fd1ca9db353f4e912e14c22e3495b392d7a657038c667aa86632957038f", + "mean": 0.04335048422217369, + "std": 5.671515464782715, + "rms": 5.671680927276611, + "max_abs": 776.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4e1fdc6709b841ca23956cf573ee4b58435f4e198a6adf5cbcc1b0e505928880", + "mean": 0.129183828830719, + "std": 5.284689426422119, + "rms": 5.28626823425293, + "max_abs": 284.0 + }, + "full_input": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "181993474052fdf632cfdf485331fbd281d35d494fbc77c452095f73a6a6563a", + "mean": 0.05054256692528725, + "std": 5.843924522399902, + "rms": 5.844143390655518, + "max_abs": 776.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e0b0ba2c1c64c6649991d64f839d143b226c91a476bfe4485ac8ab27e0756e67", + "mean": 0.12644608318805695, + "std": 4.947720527648926, + "rms": 4.949336051940918, + "max_abs": 270.0 + }, + "full_input": { + "shape": [ + 68, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3b0328ba8c337292402c8779e70528079fc25d68bc9376ca1f95d128008cde98", + "mean": 0.04309830069541931, + "std": 5.633996963500977, + "rms": 5.634161949157715, + "max_abs": 776.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "204b1e908a2d7a316132847dae726e177b78c9cb42c85f3fa057305b4c19bb8e", + "mean": 0.1280076801776886, + "std": 5.2013258934021, + "rms": 5.2029008865356445, + "max_abs": 276.0 + }, + "full_input": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "430d298f2162f6aa358c93c5668c98af9869dbbe62abe83aa56dd5f8c979b7be", + "mean": 0.05118217691779137, + "std": 5.761175155639648, + "rms": 5.761402606964111, + "max_abs": 776.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f934123ec999143f60ab4c8d401bde2b97631c098599fbbca29c3afb74547fae", + "mean": 0.11993812769651413, + "std": 4.802646636962891, + "rms": 4.804143905639648, + "max_abs": 270.0 + }, + "full_input": { + "shape": [ + 68, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "26e5521874ddeb8af62411e06b1bb53b283e3e496d974725e59f600c71c1be0a", + "mean": 0.04027300700545311, + "std": 5.543407917022705, + "rms": 5.543554306030273, + "max_abs": 776.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9975618720054626, + "min_cosine_similarity": 0.9811369180679321, + "mean_relative_l2": 0.06520003080368042, + "max_abs_delta": 12.0 + }, + "system_bos": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9963949918746948, + "min_cosine_similarity": 0.9695741534233093, + "mean_relative_l2": 0.08200947195291519, + "max_abs_delta": 22.0 + }, + "system_x": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9864227175712585, + "min_cosine_similarity": 0.8212825655937195, + "mean_relative_l2": 0.14485815167427063, + "max_abs_delta": 57.0 + }, + "system_period": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9832631349563599, + "min_cosine_similarity": 0.7902023196220398, + "mean_relative_l2": 0.16014741361141205, + "max_abs_delta": 64.25 + }, + "bos_at_s0": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9957113862037659, + "min_cosine_similarity": 0.9800849556922913, + "mean_relative_l2": 0.09056463092565536, + "max_abs_delta": 20.0 + }, + "bos_at_s1": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.994860053062439, + "min_cosine_similarity": 0.9740523099899292, + "mean_relative_l2": 0.09669985622167587, + "max_abs_delta": 34.0 + }, + "x_at_s0": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9929664134979248, + "min_cosine_similarity": 0.9723931550979614, + "mean_relative_l2": 0.11729418486356735, + "max_abs_delta": 27.921875 + }, + "x_at_s1": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9783329367637634, + "min_cosine_similarity": 0.7810404300689697, + "mean_relative_l2": 0.1797942966222763, + "max_abs_delta": 55.0 + }, + "period_at_s0": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9917332530021667, + "min_cosine_similarity": 0.9499209523200989, + "mean_relative_l2": 0.12227325141429901, + "max_abs_delta": 35.0 + }, + "period_at_s1": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9728078246116638, + "min_cosine_similarity": 0.7752910256385803, + "mean_relative_l2": 0.2028203010559082, + "max_abs_delta": 88.0 + } + } + }, + "final_norm": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1eca90cf1085dbed63b7f934d1b6c3f4207bf4813d0e6de6e48f33cb14783655", + "mean": 0.010828622616827488, + "std": 0.49728673696517944, + "rms": 0.49740463495254517, + "max_abs": 15.5625 + }, + "full_input": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7b041d3cf2b2b6a6644b52aaabf49759de2b104f0970d770d00097829102d0cb", + "mean": 0.003981906455010176, + "std": 0.541491687297821, + "rms": 0.5415063500404358, + "max_abs": 17.25 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7196ace0ac3fa2f068e167f6cfb258cbecf97586a2732ae51ce0951e670ad71e", + "mean": 0.011354158632457256, + "std": 0.496734619140625, + "rms": 0.49686434864997864, + "max_abs": 15.5625 + }, + "full_input": { + "shape": [ + 68, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "120eef32fb9dfe79eb1faad671d3b6ad349737b32a40dbdf271b7f4b57a2ee26", + "mean": 0.00447125406935811, + "std": 0.5300217270851135, + "rms": 0.5300406217575073, + "max_abs": 17.625 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7ccfe7bb148da7184f6a850b96f4506b5bcd7e5653337b18b14dc4c8a79106fd", + "mean": 0.011315690353512764, + "std": 0.4957898259162903, + "rms": 0.4959189295768738, + "max_abs": 15.5 + }, + "full_input": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e4c72160146a0585e2c8e626f9cbae4cb589ca0baf2808bf8a5907100c25ff11", + "mean": 0.004819387570023537, + "std": 0.5437420606613159, + "rms": 0.5437634587287903, + "max_abs": 20.25 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e44e7a1f2ac90a6ba4f1a60797cd584fcdc89bfd9d30b3a256cceb2b6ac53c82", + "mean": 0.011529209092259407, + "std": 0.5004115700721741, + "rms": 0.5005443692207336, + "max_abs": 15.5 + }, + "full_input": { + "shape": [ + 68, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "80ae9c5434f1d9864eb8f077f0aab5539d7a75faf65670c849bb6c3143f74144", + "mean": 0.004934696480631828, + "std": 0.534237265586853, + "rms": 0.534260094165802, + "max_abs": 18.375 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8de9c5de659952bbd0bae74c42b56d2f32ed31cf1e0e7f296c722157db14b9dc", + "mean": 0.011474009603261948, + "std": 0.49136364459991455, + "rms": 0.49149757623672485, + "max_abs": 15.6875 + }, + "full_input": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1c74e03189c3f2639c0eae424f65a873a27b693fd5538512ca55112f54e3f1a7", + "mean": 0.004785651341080666, + "std": 0.5319749116897583, + "rms": 0.5319964289665222, + "max_abs": 17.25 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1fc763670f4833a657cd427ede4f7d5a055c72d64d6291ce2aadc454ede5807e", + "mean": 0.012255903333425522, + "std": 0.5014863610267639, + "rms": 0.5016360878944397, + "max_abs": 15.375 + }, + "full_input": { + "shape": [ + 68, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "27aa5db085fa2274bec2c7972ff29cdc68adae9121c6207c2ca10b1b318b693d", + "mean": 0.0053980471566319466, + "std": 0.5266501307487488, + "rms": 0.5266777873039246, + "max_abs": 17.875 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "64e9e839909f928502bd764343c5f0b3ec27a25c2e10514c7c8ff3408dce19d0", + "mean": 0.011560613289475441, + "std": 0.4940757751464844, + "rms": 0.49421098828315735, + "max_abs": 15.5625 + }, + "full_input": { + "shape": [ + 52, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "23d47840d6088768fbf531de7e747693be0b5b91ea9ec141c35f3625723613a8", + "mean": 0.005145398434251547, + "std": 0.5397722721099854, + "rms": 0.539796769618988, + "max_abs": 18.25 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 27, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5880e3fd7e78d0ba49802d11a36b1bbeed9d8b862d353a770b95539d01f0f3fe", + "mean": 0.011910833418369293, + "std": 0.5098280906677246, + "rms": 0.5099672079086304, + "max_abs": 15.375 + }, + "full_input": { + "shape": [ + 68, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e446efbdb98d9c3a1fc1a24caeb24348e54ee0b168ab5e5ad1c181b594082d67", + "mean": 0.005224862135946751, + "std": 0.5354568362236023, + "rms": 0.5354823470115662, + "max_abs": 19.5 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9955695271492004, + "min_cosine_similarity": 0.9777271151542664, + "mean_relative_l2": 0.08562038838863373, + "max_abs_delta": 1.0625 + }, + "system_bos": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9937776923179626, + "min_cosine_similarity": 0.9661121964454651, + "mean_relative_l2": 0.10335130989551544, + "max_abs_delta": 1.09375 + }, + "system_x": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.980004608631134, + "min_cosine_similarity": 0.8329616785049438, + "mean_relative_l2": 0.17534139752388, + "max_abs_delta": 3.5 + }, + "system_period": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9766407608985901, + "min_cosine_similarity": 0.8177310824394226, + "mean_relative_l2": 0.1904628723859787, + "max_abs_delta": 4.1953125 + }, + "bos_at_s0": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9916733503341675, + "min_cosine_similarity": 0.9648348093032837, + "mean_relative_l2": 0.1207108423113823, + "max_abs_delta": 1.53125 + }, + "bos_at_s1": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.990497350692749, + "min_cosine_similarity": 0.9576560854911804, + "mean_relative_l2": 0.128168985247612, + "max_abs_delta": 1.34375 + }, + "x_at_s0": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9856520295143127, + "min_cosine_similarity": 0.950969934463501, + "mean_relative_l2": 0.15986163914203644, + "max_abs_delta": 2.203125 + }, + "x_at_s1": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.964745819568634, + "min_cosine_similarity": 0.7744539976119995, + "mean_relative_l2": 0.23682361841201782, + "max_abs_delta": 4.59375 + }, + "period_at_s0": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9837706089019775, + "min_cosine_similarity": 0.9146157503128052, + "mean_relative_l2": 0.16594259440898895, + "max_abs_delta": 1.8671875 + }, + "period_at_s1": { + "tokens": 27, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9570810794830322, + "min_cosine_similarity": 0.7855185270309448, + "mean_relative_l2": 0.26536861062049866, + "max_abs_delta": 4.65625 + } + } + } + }, + "router_layers": { + "layer_01": { + "layer": 1, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "5203b91fc3f7b6c06e3fd214a6f4225e231ac8b9576c6eea407513e4263073db", + "route_weight_sha256": "f5e696095d39373c7708231001ab7d120fd97a301424ced877cbaf64b95ed053", + "loads": [ + 0, + 2, + 1, + 4, + 2, + 3, + 2, + 2, + 9, + 4, + 0, + 4, + 1, + 0, + 3, + 1, + 5, + 1, + 0, + 3, + 1, + 1, + 3, + 6, + 1, + 2, + 0, + 1, + 6, + 4, + 6, + 4, + 0, + 3, + 3, + 6, + 6, + 0, + 3, + 2, + 6, + 1, + 2, + 4, + 3, + 0, + 3, + 3, + 0, + 2, + 2, + 1, + 6, + 9, + 2, + 3, + 1, + 0, + 2, + 1, + 2, + 2, + 1, + 1 + ], + "weighted_loads": [ + 0.0, + 0.22827596962451935, + 0.06869395822286606, + 0.338469497859478, + 0.1318735033273697, + 0.14606500416994095, + 0.08731418289244175, + 0.08535024896264076, + 0.45779016241431236, + 0.3073120564222336, + 0.0, + 0.3364450726658106, + 0.021478259935975075, + 0.0, + 0.12779958732426167, + 0.04545674845576286, + 0.26796079613268375, + 0.039133403450250626, + 0.0, + 0.1945833470672369, + 0.0869196206331253, + 0.05127106234431267, + 0.2749991714954376, + 0.44489578902721405, + 0.03304475545883179, + 0.10345719382166862, + 0.0, + 0.05741410702466965, + 0.26383210346102715, + 0.4277263078838587, + 0.5085643418133259, + 0.3713707849383354, + 0.0, + 0.18006250448524952, + 0.24707606248557568, + 0.35422927141189575, + 0.4644682426005602, + 0.0, + 0.14750832319259644, + 0.09655700996518135, + 0.343148585408926, + 0.07040248811244965, + 0.14425210654735565, + 0.36301749758422375, + 0.18071748316287994, + 0.0, + 0.17925075627863407, + 0.10682289488613605, + 0.0, + 0.1334635466337204, + 0.08288715593516827, + 0.14729894697666168, + 0.5117231085896492, + 0.44763048738241196, + 0.0839520562440157, + 0.17465009540319443, + 0.037464745342731476, + 0.0, + 0.23949133604764938, + 0.02632744424045086, + 0.06794990040361881, + 0.13464640453457832, + 0.03179341182112694, + 0.11483152210712433 + ], + "unique_experts": 54, + "load_cv": 0.8408667261164356, + "normalized_load_entropy": 0.9110238913712182, + "max_load_share": 0.05555555555555555 + }, + "full_input": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "422beacaaea84b3eb2af23ec37d957f4965f974866dc2db4f062c3e54c714a7b", + "route_weight_sha256": "34aab099fe546ad6b7923b50f56e8163bfd0aa2ad914ab46788ba81e36ac84a9", + "loads": [ + 1, + 2, + 3, + 4, + 4, + 3, + 3, + 4, + 30, + 4, + 2, + 4, + 1, + 1, + 3, + 10, + 5, + 2, + 0, + 3, + 4, + 1, + 4, + 6, + 1, + 6, + 15, + 2, + 6, + 4, + 6, + 9, + 1, + 5, + 3, + 6, + 6, + 0, + 3, + 5, + 7, + 11, + 2, + 9, + 4, + 11, + 3, + 3, + 0, + 2, + 6, + 2, + 10, + 9, + 6, + 7, + 5, + 8, + 2, + 12, + 3, + 6, + 1, + 1 + ], + "weighted_loads": [ + 0.07609810680150986, + 0.22827596962451935, + 0.17091137543320656, + 0.338469497859478, + 0.18371584080159664, + 0.14606500416994095, + 0.14898463152348995, + 0.35271986201405525, + 1.8474383372813463, + 0.3073120564222336, + 0.20533573627471924, + 0.3364450726658106, + 0.021478259935975075, + 0.028590546920895576, + 0.12779958732426167, + 0.6621971018612385, + 0.26796079613268375, + 0.11095989122986794, + 0.0, + 0.1945833470672369, + 0.484980508685112, + 0.05127106234431267, + 0.3051226828247309, + 0.44489578902721405, + 0.03304475545883179, + 0.25775206834077835, + 0.9731054697185755, + 0.12991725653409958, + 0.26383210346102715, + 0.4277263078838587, + 0.5085643418133259, + 0.7860957013326697, + 0.061677269637584686, + 0.361605366691947, + 0.24707606248557568, + 0.35422927141189575, + 0.4644682426005602, + 0.0, + 0.14750832319259644, + 0.31215862929821014, + 0.40609123185276985, + 0.4831231161952019, + 0.14425210654735565, + 0.47246638804790564, + 1.1651154309511185, + 0.8220859550056048, + 0.17925075627863407, + 0.10682289488613605, + 0.0, + 0.1334635466337204, + 0.22665564343333244, + 0.1479005137225613, + 0.7923422753810883, + 0.44763048738241196, + 0.14871500511071645, + 0.669648066163063, + 0.3547782562673092, + 0.49720218777656555, + 0.23949133604764938, + 0.7436999697238207, + 0.15883066691458225, + 0.32106519863009453, + 0.03179341182112694, + 0.11483152210712433 + ], + "unique_experts": 61, + "load_cv": 0.9220079280187283, + "normalized_load_entropy": 0.9205146645620426, + "max_load_share": 0.09615384615384616 + } + }, + "s1_eos": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "899dfb68e9c392b30d4bf76bf9288e6f35527cde02a9204e49a17b894c22fafe", + "route_weight_sha256": "6e3a67d28e6839ce94eae03a4e1055e57b81190e176a80d80ecfce497f2d65d9", + "loads": [ + 0, + 2, + 1, + 4, + 2, + 3, + 1, + 2, + 8, + 4, + 0, + 4, + 1, + 0, + 3, + 1, + 6, + 1, + 0, + 3, + 1, + 1, + 3, + 6, + 1, + 2, + 0, + 1, + 6, + 4, + 7, + 4, + 0, + 2, + 3, + 6, + 6, + 0, + 3, + 2, + 6, + 1, + 2, + 4, + 3, + 0, + 3, + 3, + 0, + 2, + 2, + 1, + 6, + 9, + 2, + 3, + 1, + 0, + 2, + 1, + 3, + 2, + 1, + 1 + ], + "weighted_loads": [ + 0.0, + 0.24320224672555923, + 0.06859494000673294, + 0.34519433975219727, + 0.13564441353082657, + 0.1445665992796421, + 0.05559001863002777, + 0.08512325957417488, + 0.3969880882650614, + 0.30459680408239365, + 0.0, + 0.33872513845562935, + 0.021595286205410957, + 0.0, + 0.12546096369624138, + 0.04497292637825012, + 0.3037695847451687, + 0.03143095225095749, + 0.0, + 0.19662385992705822, + 0.08391927182674408, + 0.04974476993083954, + 0.27708833664655685, + 0.4447523094713688, + 0.03141159191727638, + 0.10525240376591682, + 0.0, + 0.05867189168930054, + 0.268908828496933, + 0.44301968440413475, + 0.5336556658148766, + 0.36631232500076294, + 0.0, + 0.1348439920693636, + 0.24967043474316597, + 0.34918657317757607, + 0.4693547636270523, + 0.0, + 0.14610101096332073, + 0.09343776479363441, + 0.35263702273368835, + 0.0675906389951706, + 0.1447887420654297, + 0.3648312706500292, + 0.18446074053645134, + 0.0, + 0.17701136134564877, + 0.10749734006822109, + 0.0, + 0.14032198302447796, + 0.08674614131450653, + 0.14565327763557434, + 0.5227331444621086, + 0.4271348714828491, + 0.08153283782303333, + 0.17288587987422943, + 0.039599064737558365, + 0.0, + 0.23978601396083832, + 0.025998197495937347, + 0.09693421609699726, + 0.1330426149070263, + 0.03187071532011032, + 0.11607987433671951 + ], + "unique_experts": 54, + "load_cv": 0.8466471884246878, + "normalized_load_entropy": 0.9094678018990109, + "max_load_share": 0.05555555555555555 + }, + "full_input": { + "tokens": 68, + "top_k": 6, + "decisions": 408, + "ordered_route_sha256": "c299fa427620df44762e5adc95de4e964a074d87ff8015a9bfa43fee4a11df82", + "route_weight_sha256": "7510d21c3a6af16c28fbdac751da2b2c9ae494b026daab83aa7d20b9b5abe1cb", + "loads": [ + 3, + 2, + 4, + 4, + 7, + 5, + 2, + 5, + 35, + 4, + 5, + 5, + 1, + 2, + 3, + 13, + 6, + 6, + 1, + 4, + 4, + 3, + 8, + 7, + 3, + 7, + 21, + 3, + 6, + 6, + 8, + 11, + 1, + 4, + 3, + 6, + 7, + 1, + 3, + 7, + 7, + 13, + 5, + 10, + 5, + 11, + 3, + 6, + 2, + 2, + 11, + 5, + 11, + 9, + 8, + 7, + 11, + 12, + 4, + 12, + 5, + 7, + 1, + 5 + ], + "weighted_loads": [ + 0.1930532082915306, + 0.24320224672555923, + 0.23487884178757668, + 0.34519433975219727, + 0.4259460251778364, + 0.2813909128308296, + 0.10092847421765327, + 0.3220636863261461, + 2.1401779763400555, + 0.30459680408239365, + 0.39925289154052734, + 0.4862508662045002, + 0.021595286205410957, + 0.06920060142874718, + 0.12546096369624138, + 0.7472939863801003, + 0.3037695847451687, + 0.23272723145782948, + 0.038772981613874435, + 0.26253350637853146, + 0.43716343492269516, + 0.25479137897491455, + 0.5479987750877626, + 0.47940773889422417, + 0.10329201444983482, + 0.28616889379918575, + 1.4337313398718834, + 0.1534903310239315, + 0.268908828496933, + 0.6042852886021137, + 0.6195490136742592, + 1.0021859888802283, + 0.04939989373087883, + 0.2721582558006048, + 0.24967043474316597, + 0.34918657317757607, + 0.7289795428514481, + 0.03372526913881302, + 0.14610101096332073, + 0.42885974049568176, + 0.41635334491729736, + 0.6423617843538523, + 0.3522792011499405, + 0.5627270173281431, + 1.3257778398692608, + 0.7684324411966372, + 0.17701136134564877, + 0.19026323981233872, + 0.15146849304437637, + 0.14032198302447796, + 0.5091674104332924, + 0.5101263299584389, + 0.8662607446312904, + 0.4271348714828491, + 0.19500038182013668, + 0.6479275152087212, + 0.5114450082182884, + 0.7298957370221615, + 0.3147854842245579, + 0.69790905341506, + 0.2127401977777481, + 0.41184936463832855, + 0.03187071532011032, + 0.6078352406620979 + ], + "unique_experts": 64, + "load_cv": 0.8110634462724092, + "normalized_load_entropy": 0.9401640933123506, + "max_load_share": 0.0857843137254902 + } + }, + "s0_bos": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "41fcb15a339b3d0e3e0ac8ece7226068e4c9d5538258d93c7bf63227d06b0d10", + "route_weight_sha256": "ab44934239758a0e04b5962f796b9de9da0113935cf6bd2167d09b8a7d0d951a", + "loads": [ + 0, + 2, + 1, + 5, + 2, + 3, + 3, + 1, + 3, + 4, + 0, + 4, + 0, + 0, + 4, + 1, + 5, + 1, + 0, + 3, + 2, + 1, + 4, + 6, + 1, + 2, + 0, + 1, + 7, + 4, + 7, + 4, + 0, + 4, + 3, + 6, + 6, + 0, + 3, + 2, + 6, + 1, + 2, + 4, + 3, + 0, + 3, + 3, + 0, + 2, + 2, + 1, + 6, + 8, + 4, + 3, + 1, + 0, + 2, + 1, + 1, + 2, + 1, + 1 + ], + "weighted_loads": [ + 0.0, + 0.2107563279569149, + 0.0731167271733284, + 0.36230237782001495, + 0.1362631507217884, + 0.13679666444659233, + 0.11133789457380772, + 0.06569014489650726, + 0.1477786898612976, + 0.32812781259417534, + 0.0, + 0.36806922405958176, + 0.0, + 0.0, + 0.15988161228597164, + 0.055107615888118744, + 0.26615029014647007, + 0.04825121536850929, + 0.0, + 0.20841684937477112, + 0.11669734865427017, + 0.048725105822086334, + 0.2979204896837473, + 0.45493069663643837, + 0.03777410089969635, + 0.10533886030316353, + 0.0, + 0.058291882276535034, + 0.30364202708005905, + 0.39461415261030197, + 0.5226582176983356, + 0.3588906079530716, + 0.0, + 0.19461378827691078, + 0.2510468792170286, + 0.3418375886976719, + 0.4331911187618971, + 0.0, + 0.15308759734034538, + 0.09638447314500809, + 0.27936234325170517, + 0.06578503549098969, + 0.14066611975431442, + 0.37902700901031494, + 0.19332735240459442, + 0.0, + 0.18087573163211346, + 0.10702207125723362, + 0.0, + 0.14056278951466084, + 0.09654226526618004, + 0.15985921025276184, + 0.5228915959596634, + 0.3944337461143732, + 0.12806827574968338, + 0.1741143986582756, + 0.04928498715162277, + 0.0, + 0.22169215232133865, + 0.02734983153641224, + 0.045219771564006805, + 0.13743839412927628, + 0.03444506600499153, + 0.11389588564634323 + ], + "unique_experts": 53, + "load_cv": 0.8113469037356916, + "normalized_load_entropy": 0.9109420787719751, + "max_load_share": 0.04938271604938271 + }, + "full_input": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "84e902429159b8f7e5f41be532c40d5b5cf6161d25feb26e4ec0e3bb20913115", + "route_weight_sha256": "b20590f5ab46fb1308dce8e1c2d8eb9068c073d4c49e5bf15e42f720292cad1e", + "loads": [ + 2, + 2, + 3, + 5, + 4, + 3, + 4, + 3, + 22, + 4, + 2, + 6, + 0, + 1, + 4, + 10, + 5, + 3, + 0, + 3, + 5, + 1, + 5, + 6, + 1, + 6, + 14, + 2, + 7, + 4, + 7, + 8, + 2, + 6, + 3, + 6, + 6, + 0, + 3, + 5, + 6, + 11, + 3, + 9, + 3, + 10, + 4, + 3, + 0, + 2, + 6, + 1, + 10, + 8, + 8, + 7, + 5, + 9, + 2, + 11, + 3, + 6, + 1, + 1 + ], + "weighted_loads": [ + 0.11580504104495049, + 0.2107563279569149, + 0.15825169160962105, + 0.36230237782001495, + 0.18810548819601536, + 0.13679666444659233, + 0.17300834320485592, + 0.3247877508401871, + 1.219775054603815, + 0.32812781259417534, + 0.19632083922624588, + 0.42017197981476784, + 0.0, + 0.028806058689951897, + 0.15988161228597164, + 0.6718479692935944, + 0.26615029014647007, + 0.1549096442759037, + 0.0, + 0.20841684937477112, + 0.45295779407024384, + 0.048725105822086334, + 0.32804400101304054, + 0.45493069663643837, + 0.03777410089969635, + 0.2694403752684593, + 0.8762672320008278, + 0.12063886597752571, + 0.30364202708005905, + 0.39461415261030197, + 0.5226582176983356, + 0.811740092933178, + 0.10068066045641899, + 0.40155262127518654, + 0.2510468792170286, + 0.3418375886976719, + 0.4331911187618971, + 0.0, + 0.15308759734034538, + 0.3243255279958248, + 0.27936234325170517, + 0.4785056635737419, + 0.1834932379424572, + 0.5135505963116884, + 0.19332735240459442, + 0.821584764868021, + 0.20692565478384495, + 0.10702207125723362, + 0.0, + 0.14056278951466084, + 0.25449370592832565, + 0.15985921025276184, + 0.788636926561594, + 0.3944337461143732, + 0.22116862423717976, + 0.692604660987854, + 0.39139120653271675, + 0.5635900869965553, + 0.22169215232133865, + 0.7114168386906385, + 0.24097618460655212, + 0.33554353564977646, + 0.03444506600499153, + 0.11389588564634323 + ], + "unique_experts": 60, + "load_cv": 0.7713645618713499, + "normalized_load_entropy": 0.9328563063627247, + "max_load_share": 0.07051282051282051 + } + }, + "s1_bos": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "fb0cfbb0da53554db853a71b34d6c81cd49ece9aa85dde08586e9a1e85c9a2eb", + "route_weight_sha256": "cb167c0d668f90fa12d20c9cd92b11f1250c8a6e1f9821710e7ae3a3d5353253", + "loads": [ + 0, + 2, + 1, + 4, + 2, + 3, + 2, + 1, + 2, + 4, + 0, + 4, + 0, + 0, + 4, + 1, + 5, + 1, + 0, + 3, + 2, + 1, + 4, + 6, + 1, + 2, + 0, + 1, + 8, + 4, + 8, + 4, + 0, + 4, + 4, + 6, + 6, + 0, + 3, + 2, + 5, + 1, + 2, + 4, + 3, + 0, + 4, + 3, + 0, + 2, + 2, + 1, + 6, + 8, + 3, + 3, + 1, + 0, + 2, + 1, + 2, + 2, + 1, + 1 + ], + "weighted_loads": [ + 0.0, + 0.2271229363977909, + 0.0696273222565651, + 0.33823785558342934, + 0.13624945282936096, + 0.14744018763303757, + 0.07328798621892929, + 0.06506519019603729, + 0.07433388754725456, + 0.31782829761505127, + 0.0, + 0.3623312581330538, + 0.0, + 0.0, + 0.15174490213394165, + 0.05406248942017555, + 0.28588120080530643, + 0.044324688613414764, + 0.0, + 0.20353661850094795, + 0.11445930227637291, + 0.04930498078465462, + 0.3070130906999111, + 0.44488732144236565, + 0.03636166453361511, + 0.11066171154379845, + 0.0, + 0.06118549033999443, + 0.3483937904238701, + 0.4107815567404032, + 0.5573122669011354, + 0.36420051008462906, + 0.0, + 0.17471973039209843, + 0.2805706840008497, + 0.3404069058597088, + 0.4386563301086426, + 0.0, + 0.15298384800553322, + 0.09501820057630539, + 0.2547243945300579, + 0.06849689036607742, + 0.13877366855740547, + 0.3772062510251999, + 0.203212209045887, + 0.0, + 0.20317109115421772, + 0.10814116522669792, + 0.0, + 0.15017602033913136, + 0.0988114532083273, + 0.16040867567062378, + 0.5111372694373131, + 0.4018378295004368, + 0.11122729070484638, + 0.1787230670452118, + 0.04830717667937279, + 0.0, + 0.20608463883399963, + 0.02708921954035759, + 0.06959625147283077, + 0.13433856889605522, + 0.03586283326148987, + 0.11090106517076492 + ], + "unique_experts": 53, + "load_cv": 0.8262386608272656, + "normalized_load_entropy": 0.9099929084217938, + "max_load_share": 0.04938271604938271 + }, + "full_input": { + "tokens": 68, + "top_k": 6, + "decisions": 408, + "ordered_route_sha256": "302e6aca7d073f635ad32975f314d5e7940a4955366a17e7bbbf2d7a89c60e4c", + "route_weight_sha256": "b98e6f0288019bc6e8173315ea90bd980b577ad4a51db82823bfde09514a772d", + "loads": [ + 4, + 2, + 4, + 5, + 7, + 5, + 3, + 4, + 26, + 5, + 5, + 5, + 0, + 3, + 4, + 13, + 5, + 6, + 2, + 4, + 5, + 3, + 8, + 7, + 3, + 7, + 19, + 3, + 8, + 6, + 9, + 10, + 2, + 6, + 5, + 6, + 7, + 1, + 3, + 7, + 5, + 13, + 6, + 10, + 4, + 10, + 5, + 5, + 2, + 2, + 11, + 5, + 11, + 8, + 9, + 7, + 11, + 14, + 4, + 11, + 5, + 7, + 1, + 5 + ], + "weighted_loads": [ + 0.23228398151695728, + 0.2271229363977909, + 0.2223009318113327, + 0.36989373713731766, + 0.4265510644763708, + 0.2842645011842251, + 0.1186264418065548, + 0.29345708154141903, + 1.47429327853024, + 0.33915369026362896, + 0.38926251977682114, + 0.5098569858819246, + 0.0, + 0.09422227181494236, + 0.15174490213394165, + 0.7563835494220257, + 0.28588120080530643, + 0.24562096782028675, + 0.06079505942761898, + 0.2694462649524212, + 0.4038286544382572, + 0.25435158982872963, + 0.5776167660951614, + 0.479542750865221, + 0.10824208706617355, + 0.30483739264309406, + 1.3148879371583462, + 0.15333501622080803, + 0.3483937904238701, + 0.5720471609383821, + 0.6432056147605181, + 1.0384954735636711, + 0.08598995953798294, + 0.33513172157108784, + 0.303710350766778, + 0.3404069058597088, + 0.6982811093330383, + 0.03372526913881302, + 0.15298384800553322, + 0.44542623311281204, + 0.2547243945300579, + 0.6432680357247591, + 0.3828069642186165, + 0.5751019977033138, + 0.35544268041849136, + 0.7679693251848221, + 0.23339378274977207, + 0.19059438817203045, + 0.15146849304437637, + 0.15017602033913136, + 0.5384523663669825, + 0.5248817279934883, + 0.8227262198925018, + 0.4018378295004368, + 0.2580243367701769, + 0.6759018748998642, + 0.5352492108941078, + 0.8164133746176958, + 0.2810841090977192, + 0.6644408963620663, + 0.2876431383192539, + 0.424901582300663, + 0.03586283326148987, + 0.6026564314961433 + ], + "unique_experts": 63, + "load_cv": 0.6704047449913239, + "normalized_load_entropy": 0.9529444610157769, + "max_load_share": 0.06372549019607843 + } + }, + "s0_x": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "ef62b4facea23b222ccde6eb192f684cd71d8adbe5ae2b0e756f31bf0512cce8", + "route_weight_sha256": "b0fe405b62eb38564a0af5c9e1a5a30d506a6f625523a1716a1506c25c3de552", + "loads": [ + 0, + 2, + 1, + 4, + 2, + 3, + 3, + 1, + 3, + 4, + 0, + 4, + 0, + 0, + 5, + 1, + 5, + 1, + 0, + 3, + 2, + 1, + 4, + 6, + 1, + 2, + 0, + 1, + 7, + 4, + 7, + 4, + 0, + 4, + 3, + 6, + 6, + 0, + 3, + 2, + 6, + 1, + 2, + 4, + 3, + 0, + 3, + 3, + 0, + 1, + 2, + 1, + 6, + 8, + 4, + 3, + 1, + 0, + 2, + 1, + 2, + 2, + 1, + 1 + ], + "weighted_loads": [ + 0.0, + 0.25168638676404953, + 0.07137545943260193, + 0.33865925297141075, + 0.1391052082180977, + 0.1496400572359562, + 0.11425383575260639, + 0.06532832980155945, + 0.13609980791807175, + 0.3216380327939987, + 0.0, + 0.34953589364886284, + 0.0, + 0.0, + 0.18317079171538353, + 0.050668131560087204, + 0.2819930221885443, + 0.03903069347143173, + 0.0, + 0.2053426317870617, + 0.11840810626745224, + 0.04956766590476036, + 0.30015700310468674, + 0.4507232904434204, + 0.03958510980010033, + 0.10560271516442299, + 0.0, + 0.05684186890721321, + 0.2989873308688402, + 0.3782069757580757, + 0.5259652752429247, + 0.37648871541023254, + 0.0, + 0.19299736246466637, + 0.24118828400969505, + 0.34038158133625984, + 0.41439548693597317, + 0.0, + 0.14821353554725647, + 0.09552032500505447, + 0.34052327647805214, + 0.07248096168041229, + 0.14142365753650665, + 0.38405533507466316, + 0.19331449642777443, + 0.0, + 0.1769913863390684, + 0.10850802436470985, + 0.0, + 0.11268872022628784, + 0.09465355798602104, + 0.16406327486038208, + 0.5237968266010284, + 0.3671816159039736, + 0.13403015956282616, + 0.17734435573220253, + 0.04650440439581871, + 0.0, + 0.23431643098592758, + 0.027771934866905212, + 0.0659396518021822, + 0.13404738157987595, + 0.036105215549468994, + 0.11514250934123993 + ], + "unique_experts": 53, + "load_cv": 0.8113469037356916, + "normalized_load_entropy": 0.9109420787719752, + "max_load_share": 0.04938271604938271 + }, + "full_input": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "1c050fb32255015a754ce7863b70f187931ab2959dcffd5aa492325345fc49e1", + "route_weight_sha256": "b860f81cff66702ff0ceb6fa3292f1871860055e399bb0174723b652fadbb98c", + "loads": [ + 1, + 2, + 3, + 4, + 4, + 3, + 4, + 4, + 22, + 5, + 2, + 5, + 0, + 1, + 5, + 11, + 5, + 2, + 0, + 3, + 5, + 1, + 6, + 6, + 1, + 6, + 15, + 2, + 7, + 4, + 7, + 8, + 1, + 6, + 3, + 6, + 6, + 0, + 3, + 5, + 7, + 12, + 2, + 9, + 3, + 11, + 3, + 3, + 0, + 1, + 6, + 1, + 10, + 8, + 8, + 7, + 4, + 8, + 2, + 12, + 3, + 6, + 1, + 1 + ], + "weighted_loads": [ + 0.0920276865363121, + 0.25168638676404953, + 0.1657881885766983, + 0.33865925297141075, + 0.19094754569232464, + 0.1496400572359562, + 0.1759242843836546, + 0.36386786215007305, + 1.2316852379590273, + 0.34795574471354485, + 0.19323308765888214, + 0.3730931971222162, + 0.0, + 0.03259589895606041, + 0.18317079171538353, + 0.7846451811492443, + 0.2819930221885443, + 0.11085718125104904, + 0.0, + 0.2053426317870617, + 0.4486808404326439, + 0.04956766590476036, + 0.3611037116497755, + 0.4507232904434204, + 0.03958510980010033, + 0.272638663649559, + 0.92748480476439, + 0.12317803129553795, + 0.2989873308688402, + 0.3782069757580757, + 0.5259652752429247, + 0.8423650413751602, + 0.061677269637584686, + 0.39986636117100716, + 0.24118828400969505, + 0.34038158133625984, + 0.41439548693597317, + 0.0, + 0.14821353554725647, + 0.34474823251366615, + 0.3821090944111347, + 0.5410414487123489, + 0.14142365753650665, + 0.5226735919713974, + 0.19331449642777443, + 0.8553569912910461, + 0.1769913863390684, + 0.10850802436470985, + 0.0, + 0.11268872022628784, + 0.26260921359062195, + 0.16406327486038208, + 0.7651866562664509, + 0.3671816159039736, + 0.22599263675510883, + 0.7089942954480648, + 0.2393004596233368, + 0.4807552192360163, + 0.23431643098592758, + 0.8102208636701107, + 0.15682041831314564, + 0.3252173438668251, + 0.036105215549468994, + 0.11514250934123993 + ], + "unique_experts": 60, + "load_cv": 0.8104349040655953, + "normalized_load_entropy": 0.9259099721866292, + "max_load_share": 0.07051282051282051 + } + }, + "s1_x": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "5de070083e3fcc6501122a3a2f79be433f907342ebab5559a2062460fc84a009", + "route_weight_sha256": "56825ab30d4bf5ec82a0708d9c795280532326a80966d3236b6a2b609e07735d", + "loads": [ + 0, + 2, + 1, + 4, + 2, + 3, + 3, + 1, + 1, + 4, + 0, + 4, + 0, + 0, + 3, + 1, + 5, + 1, + 0, + 3, + 2, + 1, + 4, + 5, + 1, + 2, + 0, + 1, + 8, + 4, + 8, + 4, + 0, + 4, + 4, + 6, + 6, + 0, + 3, + 2, + 6, + 1, + 2, + 4, + 3, + 0, + 4, + 3, + 0, + 2, + 2, + 1, + 6, + 9, + 3, + 4, + 1, + 0, + 2, + 0, + 2, + 2, + 1, + 1 + ], + "weighted_loads": [ + 0.0, + 0.24000731855630875, + 0.06733782589435577, + 0.32906097546219826, + 0.13651464506983757, + 0.15434763953089714, + 0.10265567153692245, + 0.06468936800956726, + 0.032267745584249496, + 0.31191496551036835, + 0.0, + 0.35854270681738853, + 0.0, + 0.0, + 0.12197496555745602, + 0.051888901740312576, + 0.2944567948579788, + 0.04235554113984108, + 0.0, + 0.20034172758460045, + 0.11665136367082596, + 0.04971301183104515, + 0.3099713381379843, + 0.4029114842414856, + 0.03720051050186157, + 0.11078057065606117, + 0.0, + 0.060085225850343704, + 0.3476412482559681, + 0.4017271101474762, + 0.5636362880468369, + 0.37351977080106735, + 0.0, + 0.1788961086422205, + 0.27495173923671246, + 0.34565646573901176, + 0.42737953551113605, + 0.0, + 0.15318621695041656, + 0.09569700807332993, + 0.31489358097314835, + 0.07014542818069458, + 0.13829093426465988, + 0.3759302366524935, + 0.20329132303595543, + 0.0, + 0.2035885974764824, + 0.10772090777754784, + 0.0, + 0.1508773136883974, + 0.09710082598030567, + 0.16334646940231323, + 0.488449078053236, + 0.4328666068613529, + 0.11281099356710911, + 0.2154632117599249, + 0.04756462574005127, + 0.0, + 0.2084101438522339, + 0.0, + 0.07260138913989067, + 0.1326252520084381, + 0.03694143146276474, + 0.11076401174068451 + ], + "unique_experts": 52, + "load_cv": 0.8523884514967836, + "normalized_load_entropy": 0.9045564757930445, + "max_load_share": 0.05555555555555555 + }, + "full_input": { + "tokens": 68, + "top_k": 6, + "decisions": 408, + "ordered_route_sha256": "57c4e20f95d38689f98ef191239259a4547406f8e832b9b06b3222b05e0a8635", + "route_weight_sha256": "070f93ad53bfdf42fe1c4da973b2a73759eab98e6f39261ab041508b2c2d5de4", + "loads": [ + 3, + 2, + 4, + 4, + 7, + 5, + 4, + 5, + 25, + 6, + 5, + 5, + 0, + 3, + 3, + 14, + 5, + 6, + 1, + 4, + 5, + 3, + 8, + 6, + 3, + 7, + 20, + 3, + 8, + 6, + 9, + 10, + 2, + 6, + 4, + 6, + 7, + 1, + 3, + 7, + 6, + 14, + 5, + 10, + 4, + 11, + 5, + 6, + 3, + 2, + 11, + 5, + 11, + 9, + 9, + 8, + 10, + 12, + 4, + 11, + 4, + 7, + 1, + 5 + ], + "weighted_loads": [ + 0.20588861405849457, + 0.24000731855630875, + 0.2271353118121624, + 0.32906097546219826, + 0.4268162567168474, + 0.29117195308208466, + 0.14799412712454796, + 0.3301760870963335, + 1.4171881061047316, + 0.3581180851906538, + 0.38692673295736313, + 0.5060684345662594, + 0.0, + 0.09820157289505005, + 0.12197496555745602, + 0.8645713739097118, + 0.2944567948579788, + 0.24365182034671307, + 0.038772981613874435, + 0.2662513740360737, + 0.4069495275616646, + 0.25475962087512016, + 0.5805750135332346, + 0.437566913664341, + 0.10908093303442001, + 0.310124633833766, + 1.3535628002136946, + 0.15357794240117073, + 0.3476412482559681, + 0.5629927143454552, + 0.6495296359062195, + 1.0577870979905128, + 0.08727714791893959, + 0.34091839753091335, + 0.27495173923671246, + 0.34565646573901176, + 0.6870043147355318, + 0.03372526913881302, + 0.15318621695041656, + 0.4645749628543854, + 0.31489358097314835, + 0.7118601445108652, + 0.3457813933491707, + 0.5738259833306074, + 0.3555217944085598, + 0.8026691228151321, + 0.23714647069573402, + 0.21106550097465515, + 0.17319118604063988, + 0.1508773136883974, + 0.5492118336260319, + 0.5278195217251778, + 0.7767784334719181, + 0.4328666068613529, + 0.25809571146965027, + 0.7233384307473898, + 0.4061019495129585, + 0.7084230706095695, + 0.28340961411595345, + 0.731457881629467, + 0.18840737082064152, + 0.4200511574745178, + 0.03694143146276474, + 0.6025193780660629 + ], + "unique_experts": 63, + "load_cv": 0.6726947764081742, + "normalized_load_entropy": 0.9519024300988873, + "max_load_share": 0.061274509803921566 + } + }, + "s0_period": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "d6899d9519a7e389b72fafad96b6e67d37483b311759ddefec4696367473f23a", + "route_weight_sha256": "7c1f66dee230d223b9f13411804b2ca1aadb985717d74d7654847f0178a6e131", + "loads": [ + 0, + 2, + 1, + 4, + 2, + 3, + 3, + 1, + 3, + 4, + 0, + 4, + 0, + 0, + 5, + 1, + 5, + 1, + 0, + 3, + 2, + 1, + 4, + 6, + 1, + 2, + 0, + 1, + 7, + 4, + 7, + 4, + 0, + 4, + 3, + 6, + 6, + 0, + 3, + 2, + 6, + 1, + 2, + 4, + 3, + 0, + 3, + 3, + 0, + 1, + 2, + 1, + 6, + 8, + 4, + 3, + 1, + 0, + 2, + 1, + 2, + 2, + 1, + 1 + ], + "weighted_loads": [ + 0.0, + 0.2518656551837921, + 0.07143153250217438, + 0.33728205785155296, + 0.1365453153848648, + 0.1501072570681572, + 0.11297038570046425, + 0.06550196558237076, + 0.1285129114985466, + 0.3222883902490139, + 0.0, + 0.34792629070580006, + 0.0, + 0.0, + 0.18347511999309063, + 0.049839042127132416, + 0.2844393439590931, + 0.03718845918774605, + 0.0, + 0.207429775968194, + 0.11804360151290894, + 0.05000242963433266, + 0.30075035244226456, + 0.45078951492905617, + 0.0390656553208828, + 0.10605880990624428, + 0.0, + 0.056603413075208664, + 0.29596255347132683, + 0.37915741465985775, + 0.5264421869069338, + 0.37489912658929825, + 0.0, + 0.18465584516525269, + 0.24029450491070747, + 0.33614813908934593, + 0.41558200865983963, + 0.0, + 0.14883704856038094, + 0.094842828810215, + 0.3423057682812214, + 0.07202830910682678, + 0.1417103409767151, + 0.3854390066117048, + 0.19216732308268547, + 0.0, + 0.17709008418023586, + 0.10882779024541378, + 0.0, + 0.11148864030838013, + 0.09529280848801136, + 0.1631276160478592, + 0.5262849777936935, + 0.36384659446775913, + 0.13569430634379387, + 0.17663757130503654, + 0.0465758852660656, + 0.0, + 0.23659639060497284, + 0.02770386077463627, + 0.06670225039124489, + 0.13408802449703217, + 0.03665145859122276, + 0.11671296507120132 + ], + "unique_experts": 53, + "load_cv": 0.8113469037356916, + "normalized_load_entropy": 0.9109420787719752, + "max_load_share": 0.04938271604938271 + }, + "full_input": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "bcbf8eb485ac29ce77b1cc0f2a99e83ba3d1b423089d3eb95158608245abc50c", + "route_weight_sha256": "986a3a9b3b5bde6600e074e3569a06e365ed1348815fd96604bb890bf2f32c17", + "loads": [ + 1, + 2, + 3, + 4, + 5, + 3, + 4, + 3, + 22, + 5, + 2, + 6, + 0, + 1, + 5, + 10, + 5, + 2, + 0, + 3, + 5, + 1, + 5, + 6, + 1, + 6, + 14, + 2, + 7, + 4, + 7, + 8, + 1, + 6, + 3, + 7, + 6, + 0, + 3, + 5, + 7, + 11, + 2, + 10, + 3, + 10, + 3, + 3, + 2, + 1, + 6, + 2, + 10, + 8, + 8, + 7, + 4, + 7, + 2, + 12, + 3, + 6, + 1, + 1 + ], + "weighted_loads": [ + 0.09347692877054214, + 0.2518656551837921, + 0.15678738057613373, + 0.33728205785155296, + 0.3103212919086218, + 0.1501072570681572, + 0.17464083433151245, + 0.31649617850780487, + 1.198294734582305, + 0.34792028181254864, + 0.19396613538265228, + 0.5089079011231661, + 0.0, + 0.03333891183137894, + 0.18347511999309063, + 0.666579395532608, + 0.2844393439590931, + 0.10901494696736336, + 0.0, + 0.207429775968194, + 0.44933514297008514, + 0.05000242963433266, + 0.3308738637715578, + 0.45078951492905617, + 0.0390656553208828, + 0.2728409208357334, + 0.896559352055192, + 0.12228167429566383, + 0.29596255347132683, + 0.37915741465985775, + 0.5264421869069338, + 0.8439489677548409, + 0.061677269637584686, + 0.3898664340376854, + 0.24029450491070747, + 0.3575122803449631, + 0.41558200865983963, + 0.0, + 0.14883704856038094, + 0.3244437202811241, + 0.3846908360719681, + 0.484748937189579, + 0.1417103409767151, + 0.5484398975968361, + 0.19216732308268547, + 0.821584764868021, + 0.17709008418023586, + 0.10882779024541378, + 0.044934604316949844, + 0.11148864030838013, + 0.2631963398307562, + 0.21593818441033363, + 0.7821534909307957, + 0.36384659446775913, + 0.22814208455383778, + 0.711749080568552, + 0.24006306380033493, + 0.45214729756116867, + 0.23659639060497284, + 0.7418533023446798, + 0.15758301690220833, + 0.3229442946612835, + 0.03665145859122276, + 0.11671296507120132 + ], + "unique_experts": 61, + "load_cv": 0.7823664770457619, + "normalized_load_entropy": 0.9318327543042926, + "max_load_share": 0.07051282051282051 + } + }, + "s1_period": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "89cc0e34a77e4e22e55ce0e69706936cce04cee53eb88e021e93e85a1f8c6459", + "route_weight_sha256": "4816d05c27779f640bf2af6e9d4cbb2d3cd11f28939f1a7099831ee969e0b0be", + "loads": [ + 0, + 2, + 1, + 4, + 2, + 3, + 2, + 1, + 1, + 4, + 0, + 4, + 0, + 0, + 3, + 1, + 5, + 1, + 0, + 3, + 2, + 1, + 4, + 5, + 1, + 2, + 0, + 1, + 8, + 4, + 8, + 4, + 0, + 4, + 4, + 6, + 6, + 0, + 3, + 2, + 6, + 1, + 2, + 4, + 3, + 0, + 4, + 3, + 0, + 2, + 2, + 1, + 6, + 9, + 3, + 4, + 1, + 0, + 2, + 1, + 2, + 2, + 1, + 1 + ], + "weighted_loads": [ + 0.0, + 0.24038826301693916, + 0.06682886928319931, + 0.32912443578243256, + 0.1336301751434803, + 0.15613896772265434, + 0.0752787571400404, + 0.0648856908082962, + 0.032040536403656006, + 0.3130122609436512, + 0.0, + 0.35655500181019306, + 0.0, + 0.0, + 0.12209047004580498, + 0.05081379786133766, + 0.2951771877706051, + 0.04175591096282005, + 0.0, + 0.20205598697066307, + 0.11726563796401024, + 0.049990665167570114, + 0.3097340948879719, + 0.40120121091604233, + 0.03689449280500412, + 0.11051029339432716, + 0.0, + 0.0597066804766655, + 0.345683503895998, + 0.3977281991392374, + 0.5630039516836405, + 0.3738666921854019, + 0.0, + 0.17450669966638088, + 0.2740917280316353, + 0.3418661244213581, + 0.430673036724329, + 0.0, + 0.15317218005657196, + 0.09531119838356972, + 0.3157435953617096, + 0.07046213746070862, + 0.138026375323534, + 0.3767712600529194, + 0.20355160161852837, + 0.0, + 0.20299527794122696, + 0.10861403122544289, + 0.0, + 0.14829923957586288, + 0.09768756479024887, + 0.16208967566490173, + 0.49298257008194923, + 0.4315451178699732, + 0.11444956250488758, + 0.21505815722048283, + 0.047887999564409256, + 0.0, + 0.20759769529104233, + 0.026934005320072174, + 0.07284224592149258, + 0.13255564495921135, + 0.03702613338828087, + 0.11184623092412949 + ], + "unique_experts": 53, + "load_cv": 0.8466471884246878, + "normalized_load_entropy": 0.9073907221944473, + "max_load_share": 0.05555555555555555 + }, + "full_input": { + "tokens": 68, + "top_k": 6, + "decisions": 408, + "ordered_route_sha256": "cf8cb52122cd738e187842108932d62d38ea98c26a4c85f7bed091f7aaa10677", + "route_weight_sha256": "8501178c86041f0641a11c02dcc7234e9da2e60f2918eadeb0a51c40d2aed4bb", + "loads": [ + 3, + 2, + 4, + 4, + 8, + 5, + 3, + 4, + 24, + 5, + 5, + 8, + 0, + 3, + 3, + 13, + 5, + 6, + 2, + 4, + 5, + 3, + 8, + 6, + 3, + 7, + 20, + 3, + 8, + 6, + 10, + 10, + 2, + 6, + 4, + 6, + 8, + 1, + 3, + 7, + 6, + 14, + 5, + 10, + 4, + 10, + 4, + 5, + 2, + 2, + 11, + 6, + 12, + 9, + 9, + 8, + 10, + 12, + 4, + 11, + 4, + 7, + 1, + 5 + ], + "weighted_loads": [ + 0.20618575811386108, + 0.24038826301693916, + 0.21679821237921715, + 0.32912443578243256, + 0.5444412548094988, + 0.29296328127384186, + 0.1206172127276659, + 0.28054783307015896, + 1.3756193723529577, + 0.3342349957674742, + 0.3868519514799118, + 0.694128017872572, + 0.0, + 0.10005119256675243, + 0.12209047004580498, + 0.7531348578631878, + 0.2951771877706051, + 0.24305219016969204, + 0.0598885640501976, + 0.2679656334221363, + 0.40506573393940926, + 0.2550372742116451, + 0.5803377702832222, + 0.4358566403388977, + 0.10877491533756256, + 0.3092371020466089, + 1.342813277617097, + 0.15248741582036018, + 0.345683503895998, + 0.5589938033372164, + 0.6697582919150591, + 1.0612412691116333, + 0.08634450659155846, + 0.33549279905855656, + 0.2740917280316353, + 0.3418661244213581, + 0.7122645881026983, + 0.03372526913881302, + 0.15317218005657196, + 0.4450780153274536, + 0.3157435953617096, + 0.680539483204484, + 0.3455168344080448, + 0.5746670067310333, + 0.35578207299113274, + 0.7679693251848221, + 0.20299527794122696, + 0.1910672541707754, + 0.15146849304437637, + 0.14829923957586288, + 0.5489186272025108, + 0.5693713799118996, + 0.8153597079217434, + 0.4315451178699732, + 0.26107849925756454, + 0.7251523230224848, + 0.409744244068861, + 0.7079312838613987, + 0.2825971655547619, + 0.6642856821417809, + 0.18864822760224342, + 0.4149697981774807, + 0.03702613338828087, + 0.6036015972495079 + ], + "unique_experts": 63, + "load_cv": 0.6658010527980254, + "normalized_load_entropy": 0.9520924999022534, + "max_load_share": 0.058823529411764705 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 27, + "ordered_topk_exact_tokens": 23, + "set_exact_tokens": 24, + "mean_set_jaccard": 0.9682539682539684, + "mean_token_weighted_tv": 0.008228208662735092, + "aggregate_load_tv": 0.018518518518518517 + }, + "system_bos": { + "tokens": 27, + "ordered_topk_exact_tokens": 19, + "set_exact_tokens": 22, + "mean_set_jaccard": 0.947089947089947, + "mean_token_weighted_tv": 0.012119688369609692, + "aggregate_load_tv": 0.030864197530864196 + }, + "system_x": { + "tokens": 27, + "ordered_topk_exact_tokens": 17, + "set_exact_tokens": 20, + "mean_set_jaccard": 0.9259259259259259, + "mean_token_weighted_tv": 0.01608984986389125, + "aggregate_load_tv": 0.043209876543209874 + }, + "system_period": { + "tokens": 27, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 20, + "mean_set_jaccard": 0.9259259259259259, + "mean_token_weighted_tv": 0.01573711185267678, + "aggregate_load_tv": 0.043209876543209874 + }, + "bos_at_s0": { + "tokens": 27, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 18, + "mean_set_jaccard": 0.8968253968253969, + "mean_token_weighted_tv": 0.024649873168932065, + "aggregate_load_tv": 0.06172839506172839 + }, + "bos_at_s1": { + "tokens": 27, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.8783068783068784, + "mean_token_weighted_tv": 0.026698870032473846, + "aggregate_load_tv": 0.07407407407407407 + }, + "x_at_s0": { + "tokens": 27, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 18, + "mean_set_jaccard": 0.8968253968253969, + "mean_token_weighted_tv": 0.024120272206211532, + "aggregate_load_tv": 0.06172839506172839 + }, + "x_at_s1": { + "tokens": 27, + "ordered_topk_exact_tokens": 16, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.8677248677248678, + "mean_token_weighted_tv": 0.028621364833304175, + "aggregate_load_tv": 0.08024691358024691 + }, + "period_at_s0": { + "tokens": 27, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 18, + "mean_set_jaccard": 0.8968253968253969, + "mean_token_weighted_tv": 0.024364459293859976, + "aggregate_load_tv": 0.06172839506172839 + }, + "period_at_s1": { + "tokens": 27, + "ordered_topk_exact_tokens": 16, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.8783068783068784, + "mean_token_weighted_tv": 0.027401296214924917, + "aggregate_load_tv": 0.07407407407407407 + } + } + }, + "layer_02": { + "layer": 2, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "1126e080457ec959fa9f51bdcedec7f8c62261b8936870bc7488ac9e1ca27bf1", + "route_weight_sha256": "050d0238a953189238cc47d91fcfeb4e0482a7434dc5fc7ddaab3f80a40339f0", + "loads": [ + 2, + 0, + 4, + 2, + 6, + 5, + 3, + 7, + 2, + 1, + 5, + 2, + 3, + 2, + 3, + 6, + 8, + 2, + 5, + 3, + 2, + 1, + 0, + 6, + 6, + 2, + 0, + 1, + 2, + 0, + 1, + 10, + 3, + 1, + 1, + 3, + 2, + 0, + 0, + 1, + 2, + 3, + 3, + 0, + 2, + 2, + 2, + 4, + 3, + 5, + 3, + 0, + 2, + 1, + 5, + 2, + 1, + 1, + 2, + 2, + 0, + 1, + 0, + 3 + ], + "weighted_loads": [ + 0.13448084890842438, + 0.0, + 0.21096841990947723, + 0.1723252646625042, + 0.9838450625538826, + 0.3583231568336487, + 0.19769233278930187, + 0.6056776084005833, + 0.17910461127758026, + 0.048726655542850494, + 0.26659832522273064, + 0.13683712109923363, + 0.2652113400399685, + 0.2742096483707428, + 0.10892516933381557, + 0.3443024381995201, + 0.7896227464079857, + 0.10578582808375359, + 0.42267467081546783, + 0.4819864481687546, + 0.2642532289028168, + 0.04463937133550644, + 0.0, + 0.6297802235931158, + 0.7386663816869259, + 0.07594543322920799, + 0.0, + 0.034195367246866226, + 0.21339689940214157, + 0.0, + 0.06222017854452133, + 0.7668924145400524, + 0.1113332211971283, + 0.04480885714292526, + 0.027103383094072342, + 0.24348440393805504, + 0.09408649802207947, + 0.0, + 0.0, + 0.03671297803521156, + 0.4516183137893677, + 0.23473665118217468, + 0.2741592451930046, + 0.0, + 0.09622117690742016, + 0.08045296184718609, + 0.15249690413475037, + 0.2059480957686901, + 0.254745839163661, + 0.3042280301451683, + 0.23971247673034668, + 0.0, + 0.2783910222351551, + 0.03325319662690163, + 0.45277390256524086, + 0.23180795833468437, + 0.025976920500397682, + 0.04953852295875549, + 0.17619754001498222, + 0.156450092792511, + 0.0, + 0.10231562703847885, + 0.0, + 0.24333501234650612 + ], + "unique_experts": 54, + "load_cv": 0.8350462505227582, + "normalized_load_entropy": 0.9133681791674304, + "max_load_share": 0.06172839506172839 + }, + "full_input": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "09998931187400af1ec7748815f4360baefb156ec2369364ed1b0e73ced0843e", + "route_weight_sha256": "219fb74655732b0c566a2eea001561bddf2c2e2d90d9981d11b8154d47dfcf3a", + "loads": [ + 2, + 10, + 4, + 4, + 6, + 5, + 3, + 8, + 5, + 1, + 8, + 2, + 3, + 2, + 11, + 7, + 8, + 3, + 6, + 7, + 4, + 10, + 0, + 6, + 9, + 2, + 1, + 3, + 5, + 0, + 1, + 11, + 3, + 1, + 6, + 18, + 2, + 0, + 4, + 1, + 2, + 3, + 9, + 0, + 2, + 2, + 5, + 9, + 4, + 5, + 3, + 6, + 2, + 2, + 5, + 2, + 1, + 9, + 10, + 5, + 11, + 3, + 6, + 14 + ], + "weighted_loads": [ + 0.13448084890842438, + 0.9458485282957554, + 0.21096841990947723, + 1.8737339489161968, + 0.9838450625538826, + 0.3583231568336487, + 0.19769233278930187, + 0.6524940952658653, + 0.30528772808611393, + 0.048726655542850494, + 0.39234041050076485, + 0.13683712109923363, + 0.2652113400399685, + 0.2742096483707428, + 0.42069183103740215, + 0.3903401643037796, + 0.7896227464079857, + 0.106486180156935, + 0.42426716710906476, + 1.339780107140541, + 0.5775816142559052, + 0.7399385124444962, + 0.0, + 0.6297802235931158, + 0.8819415271282196, + 0.07594543322920799, + 0.0008497790549881756, + 0.34850523993372917, + 0.459242794662714, + 0.0, + 0.06222017854452133, + 0.7675918858731166, + 0.1113332211971283, + 0.04480885714292526, + 0.25228874012827873, + 2.446646347641945, + 0.09408649802207947, + 0.0, + 0.10944226197898388, + 0.03671297803521156, + 0.4516183137893677, + 0.23473665118217468, + 0.8545968122780323, + 0.0, + 0.09622117690742016, + 0.08045296184718609, + 0.28971911035478115, + 0.5131153352558613, + 0.28031001053750515, + 0.3042280301451683, + 0.23971247673034668, + 0.6497125998139381, + 0.2783910222351551, + 0.03457065031398088, + 0.45277390256524086, + 0.23180795833468437, + 0.025976920500397682, + 0.47800014913082123, + 0.5399201028048992, + 0.34556591510772705, + 0.9063176438212395, + 0.18888885527849197, + 0.512144211679697, + 0.7793945465236902 + ], + "unique_experts": 60, + "load_cv": 0.755866819127368, + "normalized_load_entropy": 0.9311320965617228, + "max_load_share": 0.057692307692307696 + } + }, + "s1_eos": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "9ad642fdd87b052208b6f56e08d094d36776db60ef7a51a94dc07827fbe57ee2", + "route_weight_sha256": "f7c99b70cca5223359cd70433295e069daf99397895fee89ac0f789baa5de269", + "loads": [ + 2, + 0, + 4, + 2, + 6, + 5, + 3, + 7, + 2, + 1, + 5, + 2, + 3, + 2, + 2, + 6, + 8, + 1, + 5, + 3, + 2, + 1, + 0, + 5, + 6, + 2, + 0, + 1, + 2, + 1, + 1, + 10, + 2, + 1, + 1, + 3, + 2, + 0, + 0, + 0, + 3, + 3, + 3, + 0, + 2, + 1, + 2, + 4, + 2, + 4, + 4, + 0, + 2, + 2, + 6, + 3, + 1, + 1, + 2, + 2, + 0, + 2, + 0, + 4 + ], + "weighted_loads": [ + 0.13545393198728561, + 0.0, + 0.21389814466238022, + 0.17488129064440727, + 0.9664909429848194, + 0.3702157959342003, + 0.1991823185235262, + 0.6239820048213005, + 0.17799106985330582, + 0.04870384931564331, + 0.27687326073646545, + 0.13903683423995972, + 0.27149754762649536, + 0.2711442783474922, + 0.07083877176046371, + 0.3604791797697544, + 0.7865104377269745, + 0.06274668872356415, + 0.434473916888237, + 0.4989302307367325, + 0.2655017673969269, + 0.04563150554895401, + 0.0, + 0.611828213557601, + 0.716540053486824, + 0.07333025708794594, + 0.0, + 0.030537519603967667, + 0.21061801724135876, + 0.02680264227092266, + 0.0595119334757328, + 0.7592853922396898, + 0.08867085725069046, + 0.04506121203303337, + 0.027125513181090355, + 0.2296103872358799, + 0.09601542726159096, + 0.0, + 0.0, + 0.0, + 0.48797426372766495, + 0.2366507165133953, + 0.2855557091534138, + 0.0, + 0.09367014840245247, + 0.0527123361825943, + 0.1535184010863304, + 0.20911293476819992, + 0.23130282014608383, + 0.2695744261145592, + 0.28174467384815216, + 0.0, + 0.2672199457883835, + 0.05849349498748779, + 0.47775727324187756, + 0.26166075095534325, + 0.025490237399935722, + 0.04218633845448494, + 0.17537439614534378, + 0.15967749804258347, + 0.0, + 0.14458446204662323, + 0.0, + 0.28391770273447037 + ], + "unique_experts": 54, + "load_cv": 0.8350462505227582, + "normalized_load_entropy": 0.9132388612465738, + "max_load_share": 0.06172839506172839 + }, + "full_input": { + "tokens": 68, + "top_k": 6, + "decisions": 408, + "ordered_route_sha256": "5412f4b68f2ec88d7cf795acfe9a9bc7957dcd7243ffcb9e100843800914550b", + "route_weight_sha256": "3b7d1331f113cde3d048b51306daa27913e762599803d95bd061da35ca9fe008", + "loads": [ + 6, + 11, + 5, + 5, + 7, + 6, + 3, + 10, + 11, + 2, + 12, + 2, + 3, + 4, + 13, + 8, + 10, + 2, + 6, + 9, + 4, + 11, + 1, + 5, + 13, + 3, + 1, + 4, + 7, + 1, + 2, + 12, + 2, + 1, + 10, + 20, + 2, + 1, + 8, + 3, + 3, + 3, + 12, + 1, + 5, + 1, + 9, + 12, + 4, + 5, + 5, + 9, + 3, + 6, + 6, + 3, + 5, + 8, + 4, + 12, + 11, + 7, + 10, + 18 + ], + "weighted_loads": [ + 0.6561716571450233, + 1.0071812830865383, + 0.2393231950700283, + 1.9111544638872147, + 0.9968229215592146, + 0.5118678882718086, + 0.1991823185235262, + 0.734643004834652, + 0.8386830482631922, + 0.1653345376253128, + 0.5829724222421646, + 0.13903683423995972, + 0.27149754762649536, + 0.29601813526824117, + 0.612867085263133, + 0.43774425983428955, + 0.8501665256917477, + 0.06333216623170301, + 0.43585268477909267, + 1.381739530712366, + 0.5540216714143753, + 0.8173500187695026, + 0.03843115642666817, + 0.611828213557601, + 1.0203171707689762, + 0.123480174690485, + 0.0008260990725830197, + 0.742125753313303, + 0.4638214409351349, + 0.02680264227092266, + 0.09328139200806618, + 0.8020505420863628, + 0.08867085725069046, + 0.04506121203303337, + 0.39419030398130417, + 2.1861018538475037, + 0.09601542726159096, + 0.04206346347928047, + 0.24516022391617298, + 0.35443443432450294, + 0.48797426372766495, + 0.2366507165133953, + 1.3191562816500664, + 0.18071240186691284, + 0.7439187355339527, + 0.0527123361825943, + 0.8009602800011635, + 0.6372406966984272, + 0.3002382554113865, + 0.3125838451087475, + 0.3077800180763006, + 0.9611409194767475, + 0.4441806972026825, + 0.2428997524548322, + 0.47775727324187756, + 0.26166075095534325, + 0.27946155704557896, + 0.3704838454723358, + 0.2861561179161072, + 0.6678389236330986, + 0.7474912963807583, + 0.5077412240207195, + 0.9197525251656771, + 1.2357699126005173 + ], + "unique_experts": 64, + "load_cv": 0.6749770383552356, + "normalized_load_entropy": 0.9456916434264853, + "max_load_share": 0.049019607843137254 + } + }, + "s0_bos": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "93b9944f0dfea1286129caed2eefdf925d87b78b72c81a0df9b8e71e768e011c", + "route_weight_sha256": "1f219fb962cebcbf2e7d8885838a2e8bbe6cf53c835bf798b9ac3973d951bb25", + "loads": [ + 2, + 0, + 4, + 2, + 6, + 5, + 3, + 7, + 2, + 1, + 5, + 3, + 3, + 2, + 2, + 6, + 8, + 1, + 5, + 3, + 2, + 1, + 0, + 6, + 5, + 2, + 0, + 1, + 2, + 0, + 1, + 10, + 3, + 1, + 1, + 3, + 2, + 0, + 0, + 0, + 2, + 3, + 3, + 0, + 1, + 2, + 2, + 4, + 3, + 5, + 3, + 0, + 2, + 1, + 6, + 2, + 1, + 1, + 2, + 2, + 1, + 2, + 0, + 4 + ], + "weighted_loads": [ + 0.14634881913661957, + 0.0, + 0.19660846143960953, + 0.18701281398534775, + 0.9813674464821815, + 0.35375816375017166, + 0.17743770219385624, + 0.6246020644903183, + 0.18302131444215775, + 0.04772023856639862, + 0.2463933266699314, + 0.1820395365357399, + 0.2582334503531456, + 0.27106112241744995, + 0.06456953473389149, + 0.35533005371689796, + 0.7880581803619862, + 0.06342387199401855, + 0.4059526138007641, + 0.4779106229543686, + 0.2610217481851578, + 0.047473400831222534, + 0.0, + 0.6442354135215282, + 0.6316120848059654, + 0.07517800107598305, + 0.0, + 0.03704169765114784, + 0.2208811230957508, + 0.0, + 0.056509602814912796, + 0.7708547562360764, + 0.12152554839849472, + 0.04552485793828964, + 0.02834203839302063, + 0.2456168830394745, + 0.1026395931839943, + 0.0, + 0.0, + 0.0, + 0.4438222199678421, + 0.2243974693119526, + 0.2979300357401371, + 0.0, + 0.06322888284921646, + 0.07838356867432594, + 0.15656151622533798, + 0.20680205523967743, + 0.2767297048121691, + 0.3005319945514202, + 0.24840456619858742, + 0.0, + 0.2980712093412876, + 0.03474390134215355, + 0.47521103732287884, + 0.2204764559864998, + 0.025571543723344803, + 0.05234065651893616, + 0.185415867716074, + 0.13894206285476685, + 0.03640642762184143, + 0.1484602838754654, + 0.0, + 0.26021090894937515 + ], + "unique_experts": 54, + "load_cv": 0.8408667261164356, + "normalized_load_entropy": 0.9120871992313847, + "max_load_share": 0.06172839506172839 + }, + "full_input": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "75a927f064de947eeb34f358675f09eac379d5d8040bdf5418230da1ef92ea68", + "route_weight_sha256": "d0bb3e683159b142b96c3d26a33cc2b7329b64e03161783d91184794f29ef308", + "loads": [ + 2, + 10, + 4, + 3, + 6, + 5, + 3, + 8, + 6, + 1, + 8, + 3, + 4, + 2, + 7, + 7, + 9, + 1, + 5, + 7, + 4, + 10, + 0, + 6, + 7, + 2, + 0, + 3, + 5, + 0, + 1, + 10, + 3, + 1, + 6, + 19, + 2, + 0, + 5, + 0, + 2, + 3, + 10, + 0, + 1, + 2, + 5, + 9, + 4, + 5, + 3, + 6, + 2, + 1, + 6, + 2, + 1, + 10, + 10, + 6, + 12, + 4, + 7, + 16 + ], + "weighted_loads": [ + 0.14634881913661957, + 0.9458485282957554, + 0.19660846143960953, + 0.9157023653388023, + 0.9813674464821815, + 0.35375816375017166, + 0.17743770219385624, + 0.6714185513556004, + 0.35130847431719303, + 0.04772023856639862, + 0.3721354119479656, + 0.1820395365357399, + 0.2905351184308529, + 0.27106112241744995, + 0.2714813929051161, + 0.3955024480819702, + 0.8179453369230032, + 0.06342387199401855, + 0.4059526138007641, + 1.2347239404916763, + 0.5513598620891571, + 0.7533890008926392, + 0.0, + 0.6442354135215282, + 0.7380854859948158, + 0.07517800107598305, + 0.0, + 0.335161741822958, + 0.5076464377343655, + 0.0, + 0.056509602814912796, + 0.7708547562360764, + 0.12152554839849472, + 0.04552485793828964, + 0.253527395427227, + 2.4295028895139694, + 0.1026395931839943, + 0.0, + 0.2049642764031887, + 0.0, + 0.4438222199678421, + 0.2243974693119526, + 0.9649005606770515, + 0.0, + 0.06322888284921646, + 0.07838356867432594, + 0.2988897170871496, + 0.5156090036034584, + 0.3022938761860132, + 0.3005319945514202, + 0.24840456619858742, + 0.5923350602388382, + 0.2980712093412876, + 0.03474390134215355, + 0.47521103732287884, + 0.2204764559864998, + 0.025571543723344803, + 0.5015005432069302, + 0.549138430505991, + 0.30267515033483505, + 0.9315867573022842, + 0.23503351211547852, + 0.6572221554815769, + 1.0805364064872265 + ], + "unique_experts": 58, + "load_cv": 0.7940442342154883, + "normalized_load_entropy": 0.9226351929154201, + "max_load_share": 0.060897435897435896 + } + }, + "s1_bos": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "faf1cdda7d49036533047e5bf6a8a5fee50cd14e81b70b63baaab3b9f59d5690", + "route_weight_sha256": "f64b491ee37ef312e4c46b0384a589305c7b9d9c5b005f316e8abe27af921a3f", + "loads": [ + 2, + 0, + 4, + 2, + 6, + 5, + 3, + 8, + 2, + 1, + 5, + 3, + 3, + 2, + 0, + 6, + 9, + 1, + 5, + 3, + 2, + 1, + 0, + 6, + 6, + 2, + 0, + 1, + 2, + 0, + 1, + 10, + 3, + 1, + 1, + 3, + 2, + 0, + 0, + 0, + 2, + 3, + 3, + 0, + 1, + 1, + 2, + 4, + 3, + 4, + 4, + 0, + 2, + 2, + 6, + 2, + 1, + 1, + 2, + 2, + 0, + 2, + 0, + 4 + ], + "weighted_loads": [ + 0.15294967591762543, + 0.0, + 0.20133912190794945, + 0.1962038390338421, + 0.9622124023735523, + 0.3646824397146702, + 0.18408836610615253, + 0.7039588168263435, + 0.18938693404197693, + 0.04741156846284866, + 0.26616451516747475, + 0.18586408346891403, + 0.2692648209631443, + 0.27614283561706543, + 0.0, + 0.36751168593764305, + 0.8185462616384029, + 0.059942323714494705, + 0.4246724881231785, + 0.4991952180862427, + 0.26774681359529495, + 0.047080591320991516, + 0.0, + 0.6458347998559475, + 0.6573073193430901, + 0.07503719441592693, + 0.0, + 0.02619103528559208, + 0.2185726910829544, + 0.0, + 0.059408947825431824, + 0.7574422303587198, + 0.11498420499265194, + 0.04598173126578331, + 0.02914244681596756, + 0.23052895069122314, + 0.10473593324422836, + 0.0, + 0.0, + 0.0, + 0.43634113669395447, + 0.23198535293340683, + 0.3095425106585026, + 0.0, + 0.059553053230047226, + 0.048889972269535065, + 0.1590132936835289, + 0.2021191380918026, + 0.26520261354744434, + 0.25632067769765854, + 0.2888268604874611, + 0.0, + 0.2947266213595867, + 0.0609506219625473, + 0.47584743052721024, + 0.20658843591809273, + 0.02446325309574604, + 0.0418904647231102, + 0.184634979814291, + 0.13608750700950623, + 0.0, + 0.15811984613537788, + 0.0, + 0.24635397270321846 + ], + "unique_experts": 52, + "load_cv": 0.8915426777718919, + "normalized_load_entropy": 0.9013737762767886, + "max_load_share": 0.06172839506172839 + }, + "full_input": { + "tokens": 68, + "top_k": 6, + "decisions": 408, + "ordered_route_sha256": "89518b8f2fbf9c08ec352a75ae275bd62b6ad4f4a69dc9eb5e9378cdfa773a82", + "route_weight_sha256": "62a2188e4a36cf42e0c8c2b456a5d2f0b68aee4843201c53a5fae9529eeb95ac", + "loads": [ + 6, + 11, + 5, + 5, + 7, + 6, + 3, + 11, + 12, + 2, + 12, + 3, + 4, + 3, + 11, + 8, + 12, + 1, + 5, + 10, + 4, + 11, + 1, + 6, + 12, + 3, + 0, + 4, + 7, + 0, + 2, + 12, + 3, + 1, + 10, + 21, + 2, + 2, + 8, + 3, + 2, + 3, + 12, + 1, + 4, + 1, + 9, + 12, + 5, + 5, + 5, + 9, + 3, + 5, + 6, + 2, + 5, + 7, + 4, + 12, + 11, + 7, + 12, + 17 + ], + "weighted_loads": [ + 0.6736674010753632, + 1.0071812830865383, + 0.22676417231559753, + 0.9892840310931206, + 0.9925443809479475, + 0.5063345320522785, + 0.18408836610615253, + 0.814619816839695, + 0.9096060711890459, + 0.16404225677251816, + 0.5722636766731739, + 0.18586408346891403, + 0.29694066010415554, + 0.3003144655376673, + 0.5086172670125961, + 0.441272996366024, + 0.9107341188937426, + 0.059942323714494705, + 0.4246724881231785, + 1.295890923589468, + 0.5427082851529121, + 0.8413391262292862, + 0.03843115642666817, + 0.6458347998559475, + 0.9296858571469784, + 0.125187112018466, + 0.0, + 0.7365461234003305, + 0.5285676214843988, + 0.0, + 0.0931784063577652, + 0.8002073802053928, + 0.11498420499265194, + 0.04598173126578331, + 0.3962072376161814, + 2.19736660271883, + 0.10473593324422836, + 0.06455565989017487, + 0.32501855678856373, + 0.35443443432450294, + 0.43634113669395447, + 0.23198535293340683, + 1.3885595090687275, + 0.18071240186691284, + 0.7098016403615475, + 0.048889972269535065, + 0.8179225325584412, + 0.6349231898784637, + 0.334138048812747, + 0.29933009669184685, + 0.31486220471560955, + 0.9790630787611008, + 0.4716873727738857, + 0.24427243694663048, + 0.47584743052721024, + 0.20658843591809273, + 0.2784345727413893, + 0.3180072121322155, + 0.2954167015850544, + 0.5932046994566917, + 0.7380336634814739, + 0.5212766081094742, + 1.0259886179119349, + 1.3598575927317142 + ], + "unique_experts": 62, + "load_cv": 0.6907417628944523, + "normalized_load_entropy": 0.94122583442418, + "max_load_share": 0.051470588235294115 + } + }, + "s0_x": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "7b681f19d52f66540383d1f387561589fdfeb2d1d6427ae95b4d75de6c204c9b", + "route_weight_sha256": "53b549c799be1ff16964e702bc36ad72789cac5f15aa11b522df2914090ea9f2", + "loads": [ + 2, + 0, + 4, + 2, + 6, + 5, + 2, + 7, + 2, + 1, + 5, + 3, + 3, + 2, + 2, + 6, + 8, + 1, + 5, + 3, + 2, + 2, + 0, + 6, + 5, + 1, + 0, + 2, + 2, + 0, + 1, + 10, + 4, + 2, + 2, + 3, + 2, + 0, + 0, + 0, + 2, + 3, + 3, + 0, + 1, + 1, + 2, + 4, + 3, + 5, + 2, + 0, + 2, + 1, + 5, + 2, + 1, + 1, + 2, + 2, + 1, + 2, + 0, + 4 + ], + "weighted_loads": [ + 0.15485244989395142, + 0.0, + 0.19809778407216072, + 0.18393628671765327, + 0.9215983375906944, + 0.3547642081975937, + 0.15766482800245285, + 0.6396229974925518, + 0.19263355433940887, + 0.04608409106731415, + 0.24408486485481262, + 0.18748877197504044, + 0.2659005708992481, + 0.27661196887493134, + 0.06652464531362057, + 0.34414632990956306, + 0.7913113310933113, + 0.06314654648303986, + 0.3849850408732891, + 0.4704468548297882, + 0.26885632425546646, + 0.06953196600079536, + 0.0, + 0.6392321400344372, + 0.6303028278052807, + 0.049810245633125305, + 0.0, + 0.0696226954460144, + 0.22416672110557556, + 0.0, + 0.05634631589055061, + 0.7615297418087721, + 0.14569447748363018, + 0.07677727192640305, + 0.053189316764473915, + 0.25256258249282837, + 0.10771892964839935, + 0.0, + 0.0, + 0.0, + 0.42838891595602036, + 0.22685616835951805, + 0.3120379336178303, + 0.0, + 0.06422406435012817, + 0.05140595883131027, + 0.1630636602640152, + 0.20261801779270172, + 0.24768671207129955, + 0.29051997140049934, + 0.21374686807394028, + 0.0, + 0.29304344952106476, + 0.036276161670684814, + 0.4532642588019371, + 0.22354654222726822, + 0.026989977806806564, + 0.04654938355088234, + 0.1865272931754589, + 0.1424538940191269, + 0.037083081901073456, + 0.15264733508229256, + 0.0, + 0.2464623712003231 + ], + "unique_experts": 54, + "load_cv": 0.8291849190225671, + "normalized_load_entropy": 0.9143143566762206, + "max_load_share": 0.06172839506172839 + }, + "full_input": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "cbcd6dd665221cc269a89d3d1d694f5ed103681ab62fc8a86c08b36d81603b74", + "route_weight_sha256": "6ab96211d13c1483d04accf62153dfbb0a08355b71925aea66e6172d6b869f04", + "loads": [ + 2, + 10, + 4, + 3, + 6, + 5, + 3, + 8, + 6, + 1, + 10, + 4, + 4, + 2, + 7, + 7, + 9, + 1, + 5, + 7, + 4, + 12, + 0, + 6, + 7, + 1, + 0, + 4, + 5, + 0, + 1, + 10, + 4, + 2, + 7, + 18, + 3, + 0, + 4, + 0, + 2, + 3, + 9, + 0, + 1, + 1, + 5, + 10, + 4, + 5, + 2, + 6, + 2, + 1, + 5, + 2, + 1, + 8, + 11, + 5, + 13, + 4, + 6, + 14 + ], + "weighted_loads": [ + 0.15485244989395142, + 0.9458485282957554, + 0.19809778407216072, + 0.9126258380711079, + 0.9215983375906944, + 0.3547642081975937, + 0.19260245189070702, + 0.6864394843578339, + 0.38084330782294273, + 0.04608409106731415, + 0.4789963960647583, + 0.2225707285106182, + 0.2958950996398926, + 0.27661196887493134, + 0.2664101831614971, + 0.38252200186252594, + 0.8221666514873505, + 0.06314654648303986, + 0.3849850408732891, + 1.2533470392227173, + 0.5694084092974663, + 1.0737024433910847, + 0.0, + 0.6392321400344372, + 0.731300201267004, + 0.049810245633125305, + 0.0, + 0.3701893016695976, + 0.5111707970499992, + 0.0, + 0.05634631589055061, + 0.7615297418087721, + 0.14569447748363018, + 0.07677727192640305, + 0.2783746737986803, + 2.443906918168068, + 0.1290279384702444, + 0.0, + 0.11333375051617622, + 0.0, + 0.42838891595602036, + 0.22685616835951805, + 0.886300090700388, + 0.0, + 0.06422406435012817, + 0.05140595883131027, + 0.3149087782949209, + 0.5449658557772636, + 0.2732508834451437, + 0.29051997140049934, + 0.21374686807394028, + 0.5311712250113487, + 0.29304344952106476, + 0.036276161670684814, + 0.4532642588019371, + 0.22354654222726822, + 0.026989977806806564, + 0.4232496842741966, + 0.67932253703475, + 0.27535299211740494, + 0.9958000630140305, + 0.23922056332230568, + 0.6211236119270325, + 0.7192562595009804 + ], + "unique_experts": 58, + "load_cv": 0.7857206895407468, + "normalized_load_entropy": 0.9227968775405646, + "max_load_share": 0.057692307692307696 + } + }, + "s1_x": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "103a4a15275a8ff24fc49cbad91bade46b4e4626db2242f08eb1d44f8c286b7d", + "route_weight_sha256": "240dcee6c8d3e1bb622e1021535b52b4751777f3fa7eef90b8295e7c9451db5b", + "loads": [ + 2, + 0, + 4, + 2, + 6, + 5, + 3, + 8, + 2, + 1, + 5, + 3, + 3, + 2, + 0, + 6, + 9, + 1, + 5, + 3, + 2, + 1, + 0, + 6, + 5, + 1, + 0, + 1, + 2, + 0, + 1, + 10, + 3, + 2, + 2, + 3, + 2, + 0, + 0, + 0, + 2, + 3, + 3, + 0, + 1, + 1, + 2, + 4, + 3, + 4, + 3, + 0, + 2, + 2, + 6, + 2, + 1, + 1, + 2, + 2, + 1, + 2, + 0, + 4 + ], + "weighted_loads": [ + 0.16734839230775833, + 0.0, + 0.20005328208208084, + 0.19082053750753403, + 0.9350051060318947, + 0.3604547940194607, + 0.18464790657162666, + 0.6960084475576878, + 0.19844449311494827, + 0.04683271050453186, + 0.26383988931775093, + 0.18690042197704315, + 0.27633002400398254, + 0.27726029604673386, + 0.0, + 0.35691889747977257, + 0.8095326982438564, + 0.05907471105456352, + 0.4203241765499115, + 0.4715188145637512, + 0.2673462703824043, + 0.04622652009129524, + 0.0, + 0.6374339479953051, + 0.627389170229435, + 0.04955625534057617, + 0.0, + 0.02640373446047306, + 0.21869681030511856, + 0.0, + 0.05829976499080658, + 0.7716023325920105, + 0.1157321073114872, + 0.07852372527122498, + 0.05257183685898781, + 0.23673109337687492, + 0.10410415381193161, + 0.0, + 0.0, + 0.0, + 0.43456414341926575, + 0.2307293862104416, + 0.3189312629401684, + 0.0, + 0.06309525668621063, + 0.04852059856057167, + 0.16425836831331253, + 0.19450362026691437, + 0.25533244758844376, + 0.24956481531262398, + 0.25476711615920067, + 0.0, + 0.28575872257351875, + 0.06326532922685146, + 0.4716623406857252, + 0.20276663079857826, + 0.02461996302008629, + 0.03934346139431, + 0.18063493818044662, + 0.136559896171093, + 0.032953497022390366, + 0.15657096728682518, + 0.0, + 0.23526861146092415 + ], + "unique_experts": 53, + "load_cv": 0.8721853067249413, + "normalized_load_entropy": 0.9066672402970833, + "max_load_share": 0.06172839506172839 + }, + "full_input": { + "tokens": 68, + "top_k": 6, + "decisions": 408, + "ordered_route_sha256": "cc678bcc3f02293158125bccf34dcf1d58f16cd2ba5a9554a0b44c2e00350dcb", + "route_weight_sha256": "27360d0b4fbed1545eb618248530664152a46f56021e31e2c52744fc053f5f46", + "loads": [ + 6, + 11, + 5, + 4, + 7, + 6, + 3, + 11, + 12, + 2, + 14, + 4, + 4, + 3, + 8, + 8, + 12, + 1, + 5, + 9, + 4, + 12, + 1, + 6, + 11, + 2, + 0, + 4, + 7, + 0, + 2, + 12, + 4, + 2, + 11, + 21, + 3, + 2, + 7, + 3, + 2, + 3, + 12, + 1, + 4, + 1, + 9, + 13, + 5, + 5, + 4, + 8, + 3, + 5, + 6, + 2, + 5, + 7, + 5, + 12, + 13, + 7, + 11, + 16 + ], + "weighted_loads": [ + 0.6880661174654961, + 1.0071812830865383, + 0.22547833248972893, + 0.9515843652188778, + 0.9653370846062899, + 0.502106886357069, + 0.18464790657162666, + 0.8066694475710392, + 0.9308316353708506, + 0.16346339881420135, + 0.6847166679799557, + 0.22198951244354248, + 0.3029500264674425, + 0.3014319259673357, + 0.43169839307665825, + 0.4277396537363529, + 0.9071158170700073, + 0.05907471105456352, + 0.4203241765499115, + 1.2454898543655872, + 0.5428918078541756, + 1.1231990791857243, + 0.03843115642666817, + 0.6374339479953051, + 0.898043803870678, + 0.09970617294311523, + 0.0, + 0.7453030291944742, + 0.5363305527716875, + 0.0, + 0.09206922352313995, + 0.8143674824386835, + 0.14542802423238754, + 0.07852372527122498, + 0.4196366276592016, + 2.182363700121641, + 0.12098023109138012, + 0.06493859179317951, + 0.20299630425870419, + 0.35443443432450294, + 0.43456414341926575, + 0.2307293862104416, + 1.3686349019408226, + 0.18071240186691284, + 0.7133438438177109, + 0.04852059856057167, + 0.8278744593262672, + 0.658263960853219, + 0.3242678828537464, + 0.2925742343068123, + 0.28080246038734913, + 0.8949439264833927, + 0.46271947398781776, + 0.24658714421093464, + 0.4716623406857252, + 0.20276663079857826, + 0.2785912826657295, + 0.31177341006696224, + 0.39742711931467056, + 0.5946583226323128, + 0.8168242946267128, + 0.5197277292609215, + 0.9710741396993399, + 1.087212160229683 + ], + "unique_experts": 62, + "load_cv": 0.6879531291313268, + "normalized_load_entropy": 0.9424258383738737, + "max_load_share": 0.051470588235294115 + } + }, + "s0_period": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "f6766038f6b07dcf88c05eb01b003db906f379ea4a0c6cb853e0397ca59f192e", + "route_weight_sha256": "76e82d7b1f17086413281574f7ac817a86db248ec4956b8596e3d1ccb4b781c7", + "loads": [ + 2, + 0, + 4, + 2, + 6, + 5, + 2, + 7, + 2, + 1, + 5, + 3, + 3, + 2, + 2, + 6, + 8, + 1, + 5, + 3, + 2, + 2, + 0, + 6, + 5, + 1, + 0, + 2, + 2, + 0, + 1, + 10, + 4, + 1, + 2, + 3, + 2, + 0, + 0, + 0, + 2, + 3, + 3, + 0, + 1, + 1, + 2, + 4, + 2, + 5, + 3, + 0, + 2, + 1, + 6, + 2, + 1, + 1, + 2, + 2, + 1, + 2, + 0, + 4 + ], + "weighted_loads": [ + 0.1541130095720291, + 0.0, + 0.20215808227658272, + 0.18279077112674713, + 0.9199272021651268, + 0.3586391359567642, + 0.15743014961481094, + 0.6361188627779484, + 0.1909913644194603, + 0.0456799678504467, + 0.24400578439235687, + 0.1872420758008957, + 0.26741648092865944, + 0.2728654742240906, + 0.0624111071228981, + 0.35224005952477455, + 0.8023443184792995, + 0.06468150019645691, + 0.3824132829904556, + 0.4777415990829468, + 0.26930852979421616, + 0.06990866921842098, + 0.0, + 0.6391056906431913, + 0.630011536180973, + 0.04990430176258087, + 0.0, + 0.0735875815153122, + 0.2224259003996849, + 0.0, + 0.05813361331820488, + 0.7610851190984249, + 0.1431843675673008, + 0.044603195041418076, + 0.054071247577667236, + 0.24836323410272598, + 0.10490183532238007, + 0.0, + 0.0, + 0.0, + 0.43393271416425705, + 0.22786733135581017, + 0.31765541434288025, + 0.0, + 0.06360859423875809, + 0.051483821123838425, + 0.1566835641860962, + 0.19966331496834755, + 0.22247491776943207, + 0.28702113404870033, + 0.24612434580922127, + 0.0, + 0.2865927740931511, + 0.0360407754778862, + 0.48246573843061924, + 0.22437702119350433, + 0.027118166908621788, + 0.04178236052393913, + 0.1860811561346054, + 0.13955990970134735, + 0.0367395356297493, + 0.15434972196817398, + 0.0, + 0.24139826744794846 + ], + "unique_experts": 54, + "load_cv": 0.8408667261164356, + "normalized_load_entropy": 0.9123594857606957, + "max_load_share": 0.06172839506172839 + }, + "full_input": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "55d9de3b5078df40c2a859fecba33bd5c73167f97ddffa82a2a7ba90fffdb721", + "route_weight_sha256": "1e2537e5110c7fdc46b8d4c41cef2638d6c00fbb0727ef88a3017c0e9738687f", + "loads": [ + 3, + 10, + 4, + 4, + 6, + 5, + 2, + 8, + 7, + 1, + 8, + 3, + 3, + 2, + 7, + 8, + 8, + 1, + 5, + 7, + 4, + 11, + 0, + 6, + 8, + 1, + 0, + 4, + 5, + 0, + 1, + 10, + 4, + 2, + 7, + 17, + 3, + 0, + 5, + 0, + 2, + 3, + 9, + 0, + 1, + 1, + 6, + 10, + 4, + 5, + 3, + 6, + 2, + 1, + 6, + 2, + 1, + 8, + 10, + 5, + 14, + 4, + 6, + 13 + ], + "weighted_loads": [ + 0.4466542452573776, + 0.9458485282957554, + 0.20215808227658272, + 0.9441967122256756, + 0.9199272021651268, + 0.3586391359567642, + 0.15743014961481094, + 0.6829353496432304, + 0.425375510007143, + 0.0456799678504467, + 0.3697478696703911, + 0.1872420758008957, + 0.26741648092865944, + 0.2728654742240906, + 0.26092755794525146, + 0.4367752932012081, + 0.8023443184792995, + 0.06468150019645691, + 0.3824132829904556, + 1.287836641073227, + 0.5122684016823769, + 0.9451950769871473, + 0.0, + 0.6391056906431913, + 0.7611857447773218, + 0.04990430176258087, + 0.0, + 0.37574587017297745, + 0.4783929642289877, + 0.0, + 0.05813361331820488, + 0.7610851190984249, + 0.1431843675673008, + 0.09281739965081215, + 0.2792566046118736, + 2.373994078487158, + 0.1265250165015459, + 0.0, + 0.17179332301020622, + 0.0, + 0.43393271416425705, + 0.22786733135581017, + 0.8975756093859673, + 0.0, + 0.06360859423875809, + 0.051483821123838425, + 0.33419595286250114, + 0.541786290705204, + 0.2742014955729246, + 0.28702113404870033, + 0.24612434580922127, + 0.5098175145685673, + 0.2865927740931511, + 0.0360407754778862, + 0.48246573843061924, + 0.22437702119350433, + 0.027118166908621788, + 0.41552089899778366, + 0.5498037189245224, + 0.27670731768012047, + 1.0014740079641342, + 0.2409229502081871, + 0.6243209764361382, + 0.6682618875056505 + ], + "unique_experts": 58, + "load_cv": 0.7602034400191586, + "normalized_load_entropy": 0.9256613175333671, + "max_load_share": 0.05448717948717949 + } + }, + "s1_period": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "49bb04ab80a029cb1f48cf0a8f964956868d5aa0cfadc17589065cc250ce5a89", + "route_weight_sha256": "94b39afbeed78fdbbaf3b633bc06ace0e8191c22a3e3fa080f7cf5aa0ce247c8", + "loads": [ + 2, + 0, + 4, + 2, + 6, + 5, + 3, + 8, + 2, + 1, + 5, + 3, + 3, + 2, + 0, + 6, + 9, + 1, + 5, + 3, + 2, + 1, + 0, + 7, + 5, + 1, + 0, + 1, + 2, + 0, + 1, + 10, + 3, + 2, + 2, + 3, + 2, + 0, + 0, + 0, + 2, + 3, + 3, + 0, + 1, + 1, + 2, + 4, + 3, + 4, + 3, + 0, + 2, + 2, + 6, + 2, + 1, + 1, + 2, + 2, + 0, + 2, + 0, + 4 + ], + "weighted_loads": [ + 0.165058933198452, + 0.0, + 0.20166315510869026, + 0.19014132767915726, + 0.9314942620694637, + 0.36460745707154274, + 0.18313585966825485, + 0.6942729242146015, + 0.19657902419567108, + 0.04632106050848961, + 0.2616349458694458, + 0.18664885684847832, + 0.27504613623023033, + 0.27530040591955185, + 0.0, + 0.3567018620669842, + 0.8147702254354954, + 0.06102869659662247, + 0.4149954468011856, + 0.4808167815208435, + 0.27035899460315704, + 0.047248709946870804, + 0.0, + 0.6708063054829836, + 0.6251149065792561, + 0.04998033493757248, + 0.0, + 0.02683248743414879, + 0.21937280148267746, + 0.0, + 0.059462543576955795, + 0.7712400667369366, + 0.11485997959971428, + 0.07834585756063461, + 0.05324039049446583, + 0.2344277836382389, + 0.10409333556890488, + 0.0, + 0.0, + 0.0, + 0.4376394897699356, + 0.22986795753240585, + 0.32402582839131355, + 0.0, + 0.06316833943128586, + 0.048110008239746094, + 0.15896183997392654, + 0.1915392316877842, + 0.2552688382565975, + 0.2484661601483822, + 0.257159560918808, + 0.0, + 0.2839693985879421, + 0.06290766038000584, + 0.4734907690435648, + 0.20604073256254196, + 0.024637892842292786, + 0.0357869528234005, + 0.18115303665399551, + 0.13524961099028587, + 0.0, + 0.15742970630526543, + 0.0, + 0.23144196346402168 + ], + "unique_experts": 52, + "load_cv": 0.8888031508719171, + "normalized_load_entropy": 0.90240622234433, + "max_load_share": 0.06172839506172839 + }, + "full_input": { + "tokens": 68, + "top_k": 6, + "decisions": 408, + "ordered_route_sha256": "b2efd19c130f21ce31aefc936671c7e6acc6a1e5af015bcf879f27f90411e03b", + "route_weight_sha256": "4d19ef20ccdb370a241fff54c2dcaf77bbe358f24a0bff06e2943493c1bc0563", + "loads": [ + 7, + 11, + 5, + 5, + 7, + 6, + 3, + 11, + 13, + 2, + 12, + 3, + 3, + 3, + 8, + 9, + 12, + 1, + 5, + 9, + 4, + 11, + 1, + 7, + 11, + 2, + 0, + 4, + 7, + 0, + 2, + 12, + 4, + 3, + 11, + 19, + 3, + 2, + 8, + 3, + 2, + 3, + 12, + 1, + 4, + 1, + 10, + 13, + 6, + 5, + 4, + 8, + 3, + 5, + 6, + 2, + 5, + 7, + 4, + 12, + 13, + 7, + 11, + 15 + ], + "weighted_loads": [ + 0.9532093480229378, + 1.0071812830865383, + 0.22708820551633835, + 0.9861386865377426, + 0.9618262406438589, + 0.5062595494091511, + 0.18313585966825485, + 0.804933924227953, + 0.9727337118238211, + 0.1629517488181591, + 0.567734107375145, + 0.18664885684847832, + 0.27504613623023033, + 0.2994720358401537, + 0.43133413046598434, + 0.4631066881120205, + 0.9112768992781639, + 0.06102869659662247, + 0.4149954468011856, + 1.2852453477680683, + 0.5035509467124939, + 0.9514746405184269, + 0.03843115642666817, + 0.6708063054829836, + 0.8959849067032337, + 0.10013025254011154, + 0.0, + 0.7489313893020153, + 0.4987760130316019, + 0.0, + 0.09323200210928917, + 0.8140052165836096, + 0.14020019210875034, + 0.11794814467430115, + 0.42030518129467964, + 2.079406224191189, + 0.1212624292820692, + 0.06499986350536346, + 0.26983458921313286, + 0.35443443432450294, + 0.4376394897699356, + 0.22986795753240585, + 1.3790021017193794, + 0.18071240186691284, + 0.7134169265627861, + 0.048110008239746094, + 0.8497349284589291, + 0.657337874174118, + 0.3488330002874136, + 0.2914755791425705, + 0.28319490514695644, + 0.853732492774725, + 0.46093015000224113, + 0.246229475364089, + 0.4734907690435648, + 0.20604073256254196, + 0.278609212487936, + 0.30665725842118263, + 0.2919347584247589, + 0.6193389855325222, + 0.7997522950172424, + 0.5205864682793617, + 0.9775781910866499, + 1.024640765041113 + ], + "unique_experts": 62, + "load_cv": 0.6646451473207173, + "normalized_load_entropy": 0.9444976220889107, + "max_load_share": 0.04656862745098039 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 27, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.8941798941798943, + "mean_token_weighted_tv": 0.01847527352058225, + "aggregate_load_tv": 0.04938271604938271 + }, + "system_bos": { + "tokens": 27, + "ordered_topk_exact_tokens": 16, + "set_exact_tokens": 21, + "mean_set_jaccard": 0.9365079365079365, + "mean_token_weighted_tv": 0.017912689147999993, + "aggregate_load_tv": 0.030864197530864196 + }, + "system_x": { + "tokens": 27, + "ordered_topk_exact_tokens": 19, + "set_exact_tokens": 21, + "mean_set_jaccard": 0.9365079365079365, + "mean_token_weighted_tv": 0.015916436669175273, + "aggregate_load_tv": 0.037037037037037035 + }, + "system_period": { + "tokens": 27, + "ordered_topk_exact_tokens": 16, + "set_exact_tokens": 18, + "mean_set_jaccard": 0.9047619047619049, + "mean_token_weighted_tv": 0.018705958017596492, + "aggregate_load_tv": 0.043209876543209874 + }, + "bos_at_s0": { + "tokens": 27, + "ordered_topk_exact_tokens": 19, + "set_exact_tokens": 20, + "mean_set_jaccard": 0.9259259259259259, + "mean_token_weighted_tv": 0.02453523684568979, + "aggregate_load_tv": 0.030864197530864196 + }, + "bos_at_s1": { + "tokens": 27, + "ordered_topk_exact_tokens": 17, + "set_exact_tokens": 20, + "mean_set_jaccard": 0.9259259259259259, + "mean_token_weighted_tv": 0.024081968357441603, + "aggregate_load_tv": 0.037037037037037035 + }, + "x_at_s0": { + "tokens": 27, + "ordered_topk_exact_tokens": 17, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.8941798941798943, + "mean_token_weighted_tv": 0.029891525567681702, + "aggregate_load_tv": 0.05555555555555555 + }, + "x_at_s1": { + "tokens": 27, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.8941798941798943, + "mean_token_weighted_tv": 0.028624779924198433, + "aggregate_load_tv": 0.05555555555555555 + }, + "period_at_s0": { + "tokens": 27, + "ordered_topk_exact_tokens": 17, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.8941798941798943, + "mean_token_weighted_tv": 0.029388118362813083, + "aggregate_load_tv": 0.05555555555555555 + }, + "period_at_s1": { + "tokens": 27, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.8941798941798943, + "mean_token_weighted_tv": 0.028460483998060226, + "aggregate_load_tv": 0.05555555555555555 + } + } + }, + "layer_03": { + "layer": 3, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "6db6a3cbbd799d9a8af38e8a440f76333acaba379f8226f17358a85fe1d16a7a", + "route_weight_sha256": "b0b754203bcdba00b41b68f5cd6f48c578dad1c9fd6a6d629166cdc5269f09c2", + "loads": [ + 0, + 1, + 9, + 2, + 3, + 0, + 2, + 0, + 2, + 2, + 3, + 2, + 1, + 2, + 7, + 1, + 6, + 3, + 1, + 9, + 2, + 3, + 2, + 9, + 1, + 2, + 0, + 2, + 8, + 1, + 6, + 3, + 1, + 3, + 2, + 2, + 1, + 2, + 6, + 1, + 2, + 5, + 0, + 1, + 4, + 1, + 0, + 0, + 1, + 4, + 5, + 2, + 1, + 1, + 0, + 2, + 1, + 8, + 3, + 1, + 3, + 1, + 2, + 1 + ], + "weighted_loads": [ + 0.0, + 0.10369792580604553, + 0.680102564394474, + 0.08691055327653885, + 0.3505130782723427, + 0.0, + 0.08703052252531052, + 0.0, + 0.2378511056303978, + 0.1762925274670124, + 0.13414396718144417, + 0.3114112690091133, + 0.036153241991996765, + 0.1070335078984499, + 0.8574362434446812, + 0.2017344981431961, + 0.4530758857727051, + 0.1581810526549816, + 0.0323295071721077, + 1.1147495694458485, + 0.08133413270115852, + 0.2928239330649376, + 0.12501386180520058, + 0.6211326532065868, + 0.08807829767465591, + 0.10248834267258644, + 0.0, + 0.12338623777031898, + 0.982803463935852, + 0.07294376194477081, + 0.5002781599760056, + 0.20056099444627762, + 0.06228553131222725, + 0.30161647498607635, + 0.13167262822389603, + 0.17592311650514603, + 0.03782372921705246, + 0.0701315701007843, + 0.39093006402254105, + 0.06413695216178894, + 0.09422917291522026, + 0.6237696222960949, + 0.0, + 0.05165235325694084, + 0.23412401601672173, + 0.1351846158504486, + 0.0, + 0.0, + 0.05297226086258888, + 0.21424409002065659, + 0.5378330871462822, + 0.287127323448658, + 0.03547121584415436, + 0.03649355098605156, + 0.0, + 0.16828260570764542, + 0.07640132308006287, + 0.7076268009841442, + 0.17219027876853943, + 0.17286090552806854, + 0.1783362291753292, + 0.03737303987145424, + 0.0750538781285286, + 0.04171539843082428 + ], + "unique_experts": 56, + "load_cv": 0.9342832712351872, + "normalized_load_entropy": 0.9033215380604952, + "max_load_share": 0.05555555555555555 + }, + "full_input": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "8b4c0541c3808a514e66551780d2d61ebba69cc8c05a61c85b38bf23f8ac2d21", + "route_weight_sha256": "3aa800b2a80c07fd19614b694d3752e36c390c1b386d5d71e1d746975dd2b32b", + "loads": [ + 8, + 1, + 9, + 12, + 5, + 3, + 2, + 8, + 2, + 8, + 5, + 3, + 3, + 7, + 13, + 1, + 6, + 3, + 2, + 9, + 4, + 5, + 7, + 10, + 1, + 4, + 0, + 8, + 8, + 4, + 7, + 3, + 1, + 3, + 11, + 2, + 1, + 2, + 6, + 1, + 2, + 6, + 9, + 1, + 4, + 1, + 17, + 0, + 9, + 14, + 6, + 2, + 2, + 1, + 4, + 3, + 1, + 9, + 3, + 1, + 10, + 1, + 6, + 2 + ], + "weighted_loads": [ + 1.2173029407858849, + 0.10369792580604553, + 0.680102564394474, + 0.6772749796509743, + 0.3792577286949381, + 0.1218552403151989, + 0.08703052252531052, + 1.322948805987835, + 0.2378511056303978, + 0.48228728462709114, + 0.20717604085803032, + 0.3122919681482017, + 0.048216772760497406, + 0.4893988911062479, + 1.2260367684066296, + 0.2017344981431961, + 0.4530758857727051, + 0.1581810526549816, + 0.07812689617276192, + 1.1147495694458485, + 0.153985433280468, + 0.45458514988422394, + 0.5281842835247517, + 0.6484994310885668, + 0.08807829767465591, + 0.11619507544673979, + 0.0, + 0.34906355291604996, + 0.982803463935852, + 0.21700506284832954, + 0.5469557344913483, + 0.20056099444627762, + 0.06228553131222725, + 0.30161647498607635, + 1.1632578447461128, + 0.17592311650514603, + 0.03782372921705246, + 0.0701315701007843, + 0.39093006402254105, + 0.06413695216178894, + 0.09422917291522026, + 0.6352358181029558, + 0.5431925393640995, + 0.05165235325694084, + 0.23412401601672173, + 0.1351846158504486, + 2.1399902254343033, + 0.0, + 0.9778218232095242, + 0.8307278752326965, + 0.5812740847468376, + 0.287127323448658, + 0.05024822987616062, + 0.03649355098605156, + 1.8312698975205421, + 0.22291774302721024, + 0.07640132308006287, + 0.7204737206920981, + 0.17219027876853943, + 0.17286090552806854, + 0.7526923641562462, + 0.03737303987145424, + 0.5184650123119354, + 0.0801372267305851 + ], + "unique_experts": 62, + "load_cv": 0.7798413500382333, + "normalized_load_entropy": 0.9276816795605487, + "max_load_share": 0.05448717948717949 + } + }, + "s1_eos": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "35fff0f7951def3cc3b87b1a938798e7697e625507607342f372130f1d2ca0d4", + "route_weight_sha256": "2bedcad9bc6e6a239bd31c00dd0df321c0203f3cc95c945bcbbaba7d14cbf331", + "loads": [ + 0, + 1, + 8, + 2, + 3, + 0, + 2, + 0, + 2, + 2, + 3, + 2, + 1, + 2, + 7, + 1, + 6, + 3, + 1, + 9, + 2, + 3, + 2, + 9, + 1, + 2, + 0, + 1, + 8, + 1, + 6, + 3, + 1, + 3, + 2, + 2, + 1, + 2, + 6, + 1, + 2, + 6, + 0, + 2, + 4, + 1, + 0, + 0, + 1, + 4, + 5, + 2, + 1, + 1, + 0, + 2, + 1, + 8, + 3, + 1, + 3, + 1, + 2, + 1 + ], + "weighted_loads": [ + 0.0, + 0.10294634103775024, + 0.63960837200284, + 0.08777373656630516, + 0.3453475199639797, + 0.0, + 0.08958578109741211, + 0.0, + 0.23607724159955978, + 0.17211076989769936, + 0.1334027200937271, + 0.31877803802490234, + 0.03633405268192291, + 0.10185492224991322, + 0.8619992770254612, + 0.19686421751976013, + 0.46494699642062187, + 0.16198816895484924, + 0.03226548805832863, + 1.1291567496955395, + 0.08376796543598175, + 0.30069824308156967, + 0.12447228282690048, + 0.6181710548698902, + 0.09078444540500641, + 0.09686052426695824, + 0.0, + 0.08594600111246109, + 0.9869391284883022, + 0.07246221601963043, + 0.5091410726308823, + 0.20179950073361397, + 0.06471064686775208, + 0.30916547775268555, + 0.13080143555998802, + 0.17387517541646957, + 0.036401402205228806, + 0.0732085108757019, + 0.40133945271372795, + 0.06187352538108826, + 0.09087107703089714, + 0.6694861873984337, + 0.0, + 0.07581881061196327, + 0.23836420103907585, + 0.13881270587444305, + 0.0, + 0.0, + 0.05301205441355705, + 0.21959581598639488, + 0.5229265987873077, + 0.2878972440958023, + 0.03420998528599739, + 0.03903283178806305, + 0.0, + 0.16804197430610657, + 0.07717469334602356, + 0.7039573490619659, + 0.17210888117551804, + 0.16687367856502533, + 0.178481113165617, + 0.03681981936097145, + 0.07773341983556747, + 0.04058969020843506 + ], + "unique_experts": 56, + "load_cv": 0.9264196214693634, + "normalized_load_entropy": 0.9039688533723169, + "max_load_share": 0.05555555555555555 + }, + "full_input": { + "tokens": 68, + "top_k": 6, + "decisions": 408, + "ordered_route_sha256": "9b98308db8169e99611ac9af0bd96b1e3a58ad8c5254a7b4f6830351d7ed3b9e", + "route_weight_sha256": "064ffbf975dbcc6ff7533938087de75031d322f2c5d1e90c9ce876fda2836802", + "loads": [ + 12, + 3, + 8, + 13, + 4, + 6, + 2, + 11, + 2, + 11, + 7, + 3, + 5, + 8, + 15, + 2, + 8, + 3, + 3, + 9, + 4, + 8, + 12, + 9, + 3, + 5, + 0, + 4, + 8, + 4, + 7, + 3, + 1, + 5, + 10, + 2, + 1, + 7, + 6, + 2, + 3, + 7, + 13, + 4, + 4, + 4, + 21, + 0, + 11, + 14, + 6, + 8, + 5, + 6, + 5, + 7, + 1, + 9, + 10, + 2, + 15, + 2, + 8, + 7 + ], + "weighted_loads": [ + 1.596316423267126, + 0.17753133364021778, + 0.63960837200284, + 0.7463543973863125, + 0.345885363756679, + 0.24611702747642994, + 0.08958578109741211, + 1.3934096954762936, + 0.23607724159955978, + 0.6533597565139644, + 0.24683173932135105, + 0.31965873716399074, + 0.12590087347780354, + 0.5426014456897974, + 1.4140843972563744, + 0.24598338827490807, + 0.6787897907197475, + 0.16198816895484924, + 0.13317016884684563, + 1.1291567496955395, + 0.1502275951206684, + 0.5539219006896019, + 1.0378148034214973, + 0.6181710548698902, + 0.19425704330205917, + 0.1540605251211673, + 0.0, + 0.18239976093173027, + 0.9869391284883022, + 0.2072903849184513, + 0.550671610981226, + 0.20179950073361397, + 0.06471064686775208, + 0.381838321685791, + 1.0489951744675636, + 0.17387517541646957, + 0.036401402205228806, + 0.4894528351724148, + 0.40133945271372795, + 0.11213070154190063, + 0.16569457575678825, + 0.6783100450411439, + 0.6495281923562288, + 0.1492512933909893, + 0.23836420103907585, + 0.3810763321816921, + 2.7076206989586353, + 0.0, + 1.2791582569479942, + 0.6856815628707409, + 0.5620716698467731, + 1.0687531642615795, + 0.2458356972783804, + 0.754568487405777, + 1.9425292424857616, + 0.4526129011064768, + 0.07717469334602356, + 0.7130155060440302, + 0.6608249098062515, + 0.19738308899104595, + 1.008976874873042, + 0.08685291931033134, + 0.5463347360491753, + 0.45175446197390556 + ], + "unique_experts": 62, + "load_cv": 0.6605835501146281, + "normalized_load_entropy": 0.9468474069433015, + "max_load_share": 0.051470588235294115 + } + }, + "s0_bos": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "0e2cf5792f7d50529ace4fdb953d6c48259c042beef0c169db6174a9851dca25", + "route_weight_sha256": "228b8daa74236340a2096888c5cb8295615247a4b3a21912fa0b1ac595e54d5f", + "loads": [ + 0, + 1, + 9, + 2, + 3, + 0, + 2, + 0, + 2, + 2, + 3, + 2, + 1, + 1, + 7, + 1, + 6, + 3, + 0, + 9, + 3, + 3, + 2, + 9, + 1, + 2, + 0, + 1, + 9, + 1, + 6, + 2, + 1, + 3, + 2, + 2, + 1, + 2, + 5, + 1, + 2, + 7, + 1, + 1, + 4, + 1, + 0, + 1, + 1, + 4, + 6, + 2, + 1, + 1, + 0, + 2, + 1, + 8, + 3, + 1, + 3, + 0, + 1, + 1 + ], + "weighted_loads": [ + 0.0, + 0.09739822149276733, + 0.6599982231855392, + 0.09261725284159184, + 0.384271964430809, + 0.0, + 0.09168928116559982, + 0.0, + 0.23995805531740189, + 0.14772404730319977, + 0.14790954440832138, + 0.30727238953113556, + 0.03486311808228493, + 0.0785725936293602, + 0.869053527712822, + 0.17134924232959747, + 0.4711773805320263, + 0.15764854103326797, + 0.0, + 1.1296011544764042, + 0.10638687387108803, + 0.2945215664803982, + 0.12462421879172325, + 0.6156240776181221, + 0.08022242039442062, + 0.09998926520347595, + 0.0, + 0.09371589124202728, + 1.0152357332408428, + 0.06502840667963028, + 0.4862659014761448, + 0.1674761325120926, + 0.05703093856573105, + 0.31956712901592255, + 0.1279916875064373, + 0.19186154752969742, + 0.03512456640601158, + 0.06738507002592087, + 0.34743548929691315, + 0.05366051197052002, + 0.09638771414756775, + 0.6722939573228359, + 0.030777916312217712, + 0.05224113166332245, + 0.24437705054879189, + 0.1327715665102005, + 0.0, + 0.030840637162327766, + 0.046572014689445496, + 0.22373845055699348, + 0.5951546430587769, + 0.279111348092556, + 0.03583989664912224, + 0.03772185742855072, + 0.0, + 0.16616787761449814, + 0.09350898116827011, + 0.6994631178677082, + 0.16961125656962395, + 0.18894051015377045, + 0.19856959581375122, + 0.0, + 0.04527611657977104, + 0.04237157106399536 + ], + "unique_experts": 56, + "load_cv": 0.9751523550354421, + "normalized_load_entropy": 0.8965610761335948, + "max_load_share": 0.05555555555555555 + }, + "full_input": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "ce6d1c3e039f3eb18100e2325863218d45a29bd9ebf6500260a6d9d3d4a0ea3f", + "route_weight_sha256": "bc54882de8ec39005b926a2eafb7108e3f21178295a618b84b95e2149d49b084", + "loads": [ + 9, + 1, + 9, + 13, + 5, + 3, + 2, + 9, + 2, + 7, + 5, + 3, + 2, + 5, + 13, + 1, + 6, + 3, + 2, + 9, + 5, + 5, + 8, + 10, + 1, + 3, + 0, + 7, + 9, + 5, + 7, + 2, + 1, + 3, + 10, + 2, + 1, + 2, + 5, + 1, + 2, + 7, + 11, + 1, + 4, + 2, + 16, + 1, + 11, + 14, + 7, + 2, + 1, + 1, + 3, + 3, + 1, + 8, + 3, + 1, + 10, + 0, + 5, + 2 + ], + "weighted_loads": [ + 1.37947853282094, + 0.09739822149276733, + 0.6599982231855392, + 0.7164028491824865, + 0.41301661485340446, + 0.1393350213766098, + 0.09168928116559982, + 1.1838318668305874, + 0.23995805531740189, + 0.41942976106656715, + 0.22094161808490753, + 0.30815308867022395, + 0.035342402319656685, + 0.4391922727227211, + 1.2704866155982018, + 0.17134924232959747, + 0.4711773805320263, + 0.15764854103326797, + 0.08098458871245384, + 1.1296011544764042, + 0.1780070886015892, + 0.4726559706032276, + 0.5585320219397545, + 0.642990855500102, + 0.08022242039442062, + 0.10051903803832829, + 0.0, + 0.31939320638775826, + 1.0152357332408428, + 0.2588486261665821, + 0.5329434759914875, + 0.1674761325120926, + 0.05703093856573105, + 0.31956712901592255, + 1.1225434616208076, + 0.19186154752969742, + 0.03512456640601158, + 0.06738507002592087, + 0.34743548929691315, + 0.05366051197052002, + 0.09638771414756775, + 0.6722939573228359, + 0.6938351206481457, + 0.05224113166332245, + 0.24437705054879189, + 0.16997519880533218, + 2.261888012290001, + 0.030840637162327766, + 1.0862533561885357, + 0.8402222357690334, + 0.6273077614605427, + 0.279111348092556, + 0.03583989664912224, + 0.03772185742855072, + 1.1303901374340057, + 0.21366588026285172, + 0.09350898116827011, + 0.6994631178677082, + 0.16961125656962395, + 0.18894051015377045, + 0.7600250579416752, + 0.0, + 0.48877763375639915, + 0.08079339936375618 + ], + "unique_experts": 62, + "load_cv": 0.7981734572447887, + "normalized_load_entropy": 0.9243780481270598, + "max_load_share": 0.05128205128205128 + } + }, + "s1_bos": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "0438a1ab1c5b674fcc06814e7d5c00650af6f05cfe3a14d1add9f3a381086c62", + "route_weight_sha256": "fa990e723a2fcf615d10d75d380e62b3a030171802b7a60d22bdcd5ba9c18420", + "loads": [ + 0, + 1, + 8, + 2, + 3, + 0, + 2, + 0, + 2, + 2, + 3, + 2, + 1, + 2, + 7, + 1, + 6, + 3, + 0, + 9, + 2, + 3, + 2, + 9, + 1, + 2, + 0, + 1, + 8, + 1, + 6, + 3, + 1, + 3, + 2, + 2, + 1, + 2, + 5, + 1, + 2, + 7, + 0, + 2, + 4, + 1, + 0, + 1, + 1, + 4, + 6, + 2, + 1, + 1, + 0, + 2, + 1, + 8, + 3, + 1, + 3, + 0, + 2, + 1 + ], + "weighted_loads": [ + 0.0, + 0.09753556549549103, + 0.6383540071547031, + 0.08911018073558807, + 0.37306467443704605, + 0.0, + 0.09855160489678383, + 0.0, + 0.2387581467628479, + 0.13833460211753845, + 0.13934000208973885, + 0.31455880403518677, + 0.032854169607162476, + 0.10445748269557953, + 0.8559171818196774, + 0.183292418718338, + 0.4882133826613426, + 0.16208108142018318, + 0.0, + 1.1332603208720684, + 0.07745411247015, + 0.2943680137395859, + 0.11856360360980034, + 0.6145378202199936, + 0.0838610827922821, + 0.09119488671422005, + 0.0, + 0.09009141474962234, + 0.9630149379372597, + 0.063292495906353, + 0.4845471531152725, + 0.20846231654286385, + 0.05816783756017685, + 0.3281004875898361, + 0.1306205540895462, + 0.1857420802116394, + 0.032568830996751785, + 0.07573242858052254, + 0.3602798953652382, + 0.05281955376267433, + 0.09432888403534889, + 0.6953692398965359, + 0.0, + 0.07620911300182343, + 0.24863552302122116, + 0.131436288356781, + 0.0, + 0.030350303277373314, + 0.040843166410923004, + 0.22447562217712402, + 0.5977099724113941, + 0.305728554725647, + 0.034530043601989746, + 0.039675645530223846, + 0.0, + 0.1591881439089775, + 0.08624498546123505, + 0.6858929581940174, + 0.17206156998872757, + 0.1790502965450287, + 0.1999221183359623, + 0.0, + 0.07795668765902519, + 0.04120795801281929 + ], + "unique_experts": 55, + "load_cv": 0.9420812845908818, + "normalized_load_entropy": 0.8997078354195636, + "max_load_share": 0.05555555555555555 + }, + "full_input": { + "tokens": 68, + "top_k": 6, + "decisions": 408, + "ordered_route_sha256": "68ce396f28eb88719550fe77d51196f9318ca8052ae648775d3a564867e31036", + "route_weight_sha256": "b2d1e9e1b5bc68c8442122158584278b9dfc62942e49a49dfdf610a8372ff55d", + "loads": [ + 13, + 3, + 8, + 14, + 4, + 5, + 2, + 11, + 2, + 11, + 7, + 3, + 4, + 8, + 15, + 2, + 8, + 3, + 3, + 9, + 4, + 9, + 13, + 9, + 3, + 4, + 0, + 4, + 8, + 4, + 7, + 3, + 1, + 5, + 10, + 2, + 1, + 7, + 5, + 2, + 3, + 7, + 14, + 5, + 4, + 5, + 21, + 1, + 12, + 14, + 6, + 8, + 4, + 6, + 4, + 6, + 1, + 8, + 10, + 2, + 15, + 1, + 8, + 7 + ], + "weighted_loads": [ + 1.7007978707551956, + 0.17212055809795856, + 0.6383540071547031, + 0.780566643923521, + 0.37360251822974533, + 0.22373163513839245, + 0.09855160489678383, + 1.282683338969946, + 0.2387581467628479, + 0.6139145537163131, + 0.2527690213173628, + 0.31543950317427516, + 0.11451833278988488, + 0.5700600743293762, + 1.4381817132234573, + 0.23241158947348595, + 0.7020561769604683, + 0.16208108142018318, + 0.13734380900859833, + 1.1332603208720684, + 0.1482657454907894, + 0.6135689839720726, + 1.0473465453833342, + 0.6145378202199936, + 0.18733368068933487, + 0.1395650573540479, + 0.0, + 0.18654517456889153, + 0.9630149379372597, + 0.20308582484722137, + 0.5260776914656162, + 0.20846231654286385, + 0.05816783756017685, + 0.4007733315229416, + 1.0572183579206467, + 0.1857420802116394, + 0.032568830996751785, + 0.4919767528772354, + 0.3602798953652382, + 0.10307672992348671, + 0.16915238276124, + 0.6953692398965359, + 0.7851921934634447, + 0.18105921149253845, + 0.24863552302122116, + 0.42234056442976, + 2.64352435991168, + 0.030350303277373314, + 1.2919129729270935, + 0.69056136906147, + 0.5977099724113941, + 1.0865844748914242, + 0.2357560433447361, + 0.7552113011479378, + 1.1534918509423733, + 0.39127841778099537, + 0.08624498546123505, + 0.6858929581940174, + 0.6607775986194611, + 0.2095597069710493, + 1.008335741236806, + 0.050033099949359894, + 0.5791002884507179, + 0.4523727297782898 + ], + "unique_experts": 63, + "load_cv": 0.6812138339623611, + "normalized_load_entropy": 0.9450617122761371, + "max_load_share": 0.051470588235294115 + } + }, + "s0_x": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "90997a226f210585f3de1920f4ad9b15b042940d7b0dfd0d3cab6e5bfd4ec846", + "route_weight_sha256": "1966888969f82700f900d3d2a1ad32864f8142361dd9825500ecaa5fec6cd575", + "loads": [ + 0, + 1, + 9, + 2, + 3, + 0, + 2, + 0, + 2, + 2, + 3, + 2, + 1, + 1, + 7, + 1, + 6, + 4, + 0, + 9, + 2, + 3, + 2, + 9, + 1, + 2, + 0, + 1, + 6, + 1, + 6, + 3, + 1, + 3, + 2, + 2, + 1, + 2, + 5, + 1, + 3, + 7, + 0, + 1, + 4, + 1, + 1, + 1, + 1, + 4, + 6, + 2, + 1, + 1, + 0, + 2, + 1, + 8, + 3, + 1, + 3, + 0, + 2, + 1 + ], + "weighted_loads": [ + 0.0, + 0.09968498349189758, + 0.6480805240571499, + 0.09050979278981686, + 0.37629611790180206, + 0.0, + 0.0913340412080288, + 0.0, + 0.2352176085114479, + 0.14037438854575157, + 0.143800288438797, + 0.3037305548787117, + 0.03554897382855415, + 0.0784476026892662, + 0.8934303373098373, + 0.16911742091178894, + 0.47402680292725563, + 0.20221597701311111, + 0.0, + 1.1428607441484928, + 0.08422897011041641, + 0.27457641065120697, + 0.12513168528676033, + 0.6222213059663773, + 0.07990968972444534, + 0.09663175418972969, + 0.0, + 0.09699732810258865, + 0.8933956027030945, + 0.07045365869998932, + 0.48394886776804924, + 0.20620780065655708, + 0.05471476912498474, + 0.32083356380462646, + 0.13037769496440887, + 0.18480902910232544, + 0.03297893702983856, + 0.06911857426166534, + 0.34129080176353455, + 0.053391020745038986, + 0.12849318608641624, + 0.6675879135727882, + 0.0, + 0.05204484611749649, + 0.25546518340706825, + 0.12931199371814728, + 0.030582116916775703, + 0.03423387557268143, + 0.04637697711586952, + 0.23175738751888275, + 0.5965062379837036, + 0.28750599175691605, + 0.03349205479025841, + 0.03637513145804405, + 0.0, + 0.16868620365858078, + 0.09447338432073593, + 0.6839831545948982, + 0.18467339873313904, + 0.17475081980228424, + 0.19068383052945137, + 0.0, + 0.07745842449367046, + 0.04320291429758072 + ], + "unique_experts": 56, + "load_cv": 0.9368898207360085, + "normalized_load_entropy": 0.9017252222330329, + "max_load_share": 0.05555555555555555 + }, + "full_input": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "edc133545a3c334117c4048869fe1545a68142299437d861a09a53bf8ec9cd23", + "route_weight_sha256": "01f3ab41c74b8395c1ef5e1366f06a5d4d8e47d471c95361e3ae092168cbaf36", + "loads": [ + 7, + 1, + 9, + 14, + 6, + 2, + 2, + 9, + 2, + 7, + 5, + 3, + 2, + 5, + 13, + 1, + 6, + 4, + 1, + 9, + 3, + 5, + 7, + 10, + 1, + 3, + 1, + 8, + 6, + 5, + 7, + 3, + 1, + 3, + 11, + 2, + 2, + 2, + 5, + 1, + 3, + 7, + 10, + 1, + 4, + 2, + 18, + 1, + 9, + 15, + 6, + 2, + 1, + 1, + 3, + 3, + 1, + 8, + 3, + 1, + 11, + 0, + 6, + 2 + ], + "weighted_loads": [ + 1.0619055517017841, + 0.09968498349189758, + 0.6480805240571499, + 0.8525102008134127, + 0.4361213141819462, + 0.09155914559960365, + 0.0913340412080288, + 1.1879611946642399, + 0.2352176085114479, + 0.4353292888845317, + 0.21683236211538315, + 0.3046112540178001, + 0.03602825806592591, + 0.4342222362756729, + 1.2538707815110683, + 0.16911742091178894, + 0.47402680292725563, + 0.20221597701311111, + 0.057898301631212234, + 1.1428607441484928, + 0.11080619692802429, + 0.45797888189554214, + 0.5308283679187298, + 0.6495880838483572, + 0.07990968972444534, + 0.09716152702458203, + 0.04269843176007271, + 0.370390634983778, + 0.8933956027030945, + 0.2714475356042385, + 0.530626442283392, + 0.20620780065655708, + 0.05471476912498474, + 0.32083356380462646, + 1.2272484190762043, + 0.18480902910232544, + 0.08116018772125244, + 0.06911857426166534, + 0.34129080176353455, + 0.053391020745038986, + 0.12849318608641624, + 0.6675879135727882, + 0.6222370900213718, + 0.05204484611749649, + 0.25546518340706825, + 0.17643925175070763, + 2.364669566974044, + 0.03423387557268143, + 0.9269191324710846, + 0.9122400656342506, + 0.5965062379837036, + 0.28750599175691605, + 0.03349205479025841, + 0.03637513145804405, + 1.1088254526257515, + 0.22196383401751518, + 0.09447338432073593, + 0.6839831545948982, + 0.18467339873313904, + 0.17475081980228424, + 0.8104661777615547, + 0.0, + 0.5208107214421034, + 0.08162474259734154 + ], + "unique_experts": 63, + "load_cv": 0.8120557754929804, + "normalized_load_entropy": 0.9255678169526146, + "max_load_share": 0.057692307692307696 + } + }, + "s1_x": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "169a365ac9ee60cee89e7a1df2e81ad43250987d7cf92b696f16f1f14e5784f4", + "route_weight_sha256": "155ef75ab47dfa6245f289811fa3afe185a219e69b068accee90842dce9627f0", + "loads": [ + 0, + 1, + 8, + 2, + 3, + 0, + 2, + 0, + 2, + 2, + 3, + 2, + 1, + 2, + 7, + 1, + 6, + 3, + 0, + 9, + 2, + 3, + 2, + 9, + 1, + 2, + 0, + 1, + 8, + 1, + 6, + 3, + 1, + 3, + 2, + 2, + 1, + 2, + 5, + 1, + 2, + 7, + 0, + 2, + 4, + 1, + 0, + 1, + 1, + 4, + 6, + 2, + 1, + 1, + 0, + 2, + 1, + 8, + 3, + 1, + 3, + 0, + 2, + 1 + ], + "weighted_loads": [ + 0.0, + 0.09909035265445709, + 0.634340438991785, + 0.08563852682709694, + 0.3680401146411896, + 0.0, + 0.097604900598526, + 0.0, + 0.23359576612710953, + 0.13053498044610023, + 0.13401412591338158, + 0.30801286548376083, + 0.03209556266665459, + 0.1041994709521532, + 0.8811717890202999, + 0.1865779012441635, + 0.4961589090526104, + 0.156930860131979, + 0.0, + 1.12075836956501, + 0.07932907342910767, + 0.28416807949543, + 0.1137053556740284, + 0.6205662377178669, + 0.08181842416524887, + 0.09316977858543396, + 0.0, + 0.08915023505687714, + 0.9664456807076931, + 0.06755155324935913, + 0.4830162711441517, + 0.2065117210149765, + 0.055929187685251236, + 0.32194626331329346, + 0.12752525880932808, + 0.18209388107061386, + 0.03174462169408798, + 0.07684367522597313, + 0.3497246839106083, + 0.056596171110868454, + 0.0907496027648449, + 0.6991418190300465, + 0.0, + 0.07273138128221035, + 0.2522527910768986, + 0.12593509256839752, + 0.0, + 0.03234817460179329, + 0.03759744390845299, + 0.22373203560709953, + 0.5939853377640247, + 0.3071220964193344, + 0.0342148095369339, + 0.04033650457859039, + 0.0, + 0.15701093524694443, + 0.08302769064903259, + 0.6749482732266188, + 0.18044346198439598, + 0.17314346134662628, + 0.2009805515408516, + 0.0, + 0.0780186727643013, + 0.04114538058638573 + ], + "unique_experts": 55, + "load_cv": 0.9420812845908818, + "normalized_load_entropy": 0.8997078354195636, + "max_load_share": 0.05555555555555555 + }, + "full_input": { + "tokens": 68, + "top_k": 6, + "decisions": 408, + "ordered_route_sha256": "d1f6f2a812936c90440d0f8f39e70cae426f22981d2d5c8e340948e9ff99d9d6", + "route_weight_sha256": "6fbd46751756cd28d3f601d8bed3216736f8b5b15cd38d41299c03fec923befb", + "loads": [ + 11, + 3, + 8, + 15, + 5, + 5, + 2, + 11, + 2, + 11, + 7, + 3, + 4, + 8, + 15, + 2, + 8, + 3, + 2, + 9, + 3, + 9, + 11, + 9, + 3, + 4, + 1, + 5, + 8, + 5, + 7, + 3, + 1, + 5, + 10, + 2, + 2, + 7, + 5, + 2, + 3, + 7, + 14, + 5, + 4, + 6, + 20, + 1, + 11, + 15, + 6, + 8, + 4, + 6, + 4, + 6, + 1, + 8, + 10, + 2, + 15, + 1, + 8, + 7 + ], + "weighted_loads": [ + 1.4122900180518627, + 0.17367534525692463, + 0.634340438991785, + 0.9254716522991657, + 0.3991128554334864, + 0.19073469564318657, + 0.097604900598526, + 1.281665112823248, + 0.23359576612710953, + 0.6219161792541854, + 0.24744314514100552, + 0.3088935646228492, + 0.11375972584937699, + 0.5583035964518785, + 1.4391298182308674, + 0.23569707199931145, + 0.7100017033517361, + 0.156930860131979, + 0.10586799681186676, + 1.12075836956501, + 0.11125210672616959, + 0.6093648746609688, + 0.9658179096877575, + 0.6205662377178669, + 0.18529102206230164, + 0.1415399492252618, + 0.03875865042209625, + 0.23071002960205078, + 0.9664456807076931, + 0.2489275112748146, + 0.5245468094944954, + 0.2065117210149765, + 0.055929187685251236, + 0.3946191072463989, + 1.0981872491538525, + 0.18209388107061386, + 0.07167548313736916, + 0.493087999522686, + 0.3497246839106083, + 0.10685334727168083, + 0.165573101490736, + 0.6991418190300465, + 0.7108083050698042, + 0.17810421995818615, + 0.2522527910768986, + 0.4828685484826565, + 2.627442102879286, + 0.03234817460179329, + 1.1435424201190472, + 0.74918994307518, + 0.5939853377640247, + 1.0879780165851116, + 0.23544080927968025, + 0.7558721601963043, + 1.1327742002904415, + 0.3891012091189623, + 0.08302769064903259, + 0.6749482732266188, + 0.6691594906151295, + 0.2036528717726469, + 1.061603719368577, + 0.050033099949359894, + 0.5619368739426136, + 0.45231015235185623 + ], + "unique_experts": 64, + "load_cv": 0.6605835501146281, + "normalized_load_entropy": 0.9489587740580223, + "max_load_share": 0.049019607843137254 + } + }, + "s0_period": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "a0fb9e368821ed764642867fbbe5670e80ede50ab62008ee7cf94286b5f22de9", + "route_weight_sha256": "15ce9cc68732997b9a8834edeafbd4678a69bd92ffbb0b6b84b546e1700801a1", + "loads": [ + 0, + 1, + 9, + 2, + 3, + 0, + 2, + 0, + 2, + 2, + 3, + 2, + 1, + 1, + 7, + 1, + 6, + 4, + 0, + 9, + 2, + 3, + 2, + 9, + 1, + 2, + 0, + 1, + 6, + 1, + 6, + 3, + 1, + 3, + 2, + 2, + 1, + 2, + 5, + 1, + 3, + 7, + 0, + 1, + 4, + 1, + 1, + 1, + 1, + 4, + 6, + 2, + 1, + 1, + 0, + 2, + 1, + 8, + 3, + 1, + 3, + 0, + 2, + 1 + ], + "weighted_loads": [ + 0.0, + 0.10105479508638382, + 0.6460424903780222, + 0.08851192146539688, + 0.3779590427875519, + 0.0, + 0.09214277565479279, + 0.0, + 0.23800300061702728, + 0.13357283547520638, + 0.14367330074310303, + 0.3013468235731125, + 0.03576087951660156, + 0.07794119417667389, + 0.8674206137657166, + 0.17385081946849823, + 0.47574448212981224, + 0.20265435427427292, + 0.0, + 1.1394642665982246, + 0.08255539834499359, + 0.2783152870833874, + 0.12276331335306168, + 0.6186203509569168, + 0.08146637678146362, + 0.097482830286026, + 0.0, + 0.09803445637226105, + 0.8823399692773819, + 0.06959164887666702, + 0.48499950766563416, + 0.20538486540317535, + 0.055223248898983, + 0.3251848816871643, + 0.13550658896565437, + 0.1869494393467903, + 0.032840389758348465, + 0.06774863973259926, + 0.34559012576937675, + 0.053659580647945404, + 0.13094398379325867, + 0.670219648629427, + 0.0, + 0.0514318011701107, + 0.2542590759694576, + 0.1300334483385086, + 0.032817427068948746, + 0.03320368751883507, + 0.04322010651230812, + 0.23670616373419762, + 0.597560066729784, + 0.2866191044449806, + 0.03346448019146919, + 0.035878319293260574, + 0.0, + 0.17195027321577072, + 0.0918591171503067, + 0.6845105364918709, + 0.18124167248606682, + 0.17226731777191162, + 0.18399963527917862, + 0.0, + 0.07769415527582169, + 0.04362023249268532 + ], + "unique_experts": 56, + "load_cv": 0.9368898207360085, + "normalized_load_entropy": 0.9017252222330329, + "max_load_share": 0.05555555555555555 + }, + "full_input": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "611b17fdf0508d377dfd1a4d90e7730a991cc20099c7c43a9f587774dc4e5e81", + "route_weight_sha256": "528ee177dba9daf4786c37a86639c2d281fb454285e70193210196beae1fad83", + "loads": [ + 7, + 2, + 9, + 14, + 6, + 2, + 2, + 9, + 2, + 8, + 5, + 3, + 2, + 5, + 13, + 1, + 6, + 4, + 1, + 9, + 3, + 5, + 7, + 10, + 1, + 3, + 0, + 7, + 6, + 5, + 7, + 3, + 1, + 3, + 10, + 2, + 1, + 2, + 5, + 1, + 3, + 7, + 10, + 1, + 4, + 4, + 18, + 1, + 9, + 14, + 6, + 2, + 1, + 1, + 3, + 3, + 1, + 8, + 4, + 1, + 11, + 0, + 6, + 2 + ], + "weighted_loads": [ + 0.9901507571339607, + 0.24861907213926315, + 0.6460424903780222, + 0.7872112020850182, + 0.44678460562136024, + 0.09257388859987259, + 0.09214277565479279, + 1.245266079902649, + 0.23800300061702728, + 0.5845880738343112, + 0.21670537441968918, + 0.3022275227122009, + 0.03624016375397332, + 0.43272340297698975, + 1.354941464960575, + 0.17385081946849823, + 0.47574448212981224, + 0.20265435427427292, + 0.06382223963737488, + 1.1394642665982246, + 0.10913262516260147, + 0.45932191982865334, + 0.530731201171875, + 0.6459871288388968, + 0.08146637678146362, + 0.09801260312087834, + 0.0, + 0.323711771517992, + 0.8823399692773819, + 0.2622905410826206, + 0.5316770821809769, + 0.20538486540317535, + 0.055223248898983, + 0.3251848816871643, + 1.1300583630800247, + 0.1869494393467903, + 0.032840389758348465, + 0.06774863973259926, + 0.34559012576937675, + 0.053659580647945404, + 0.13094398379325867, + 0.670219648629427, + 0.6260597743093967, + 0.0514318011701107, + 0.2542590759694576, + 0.2810641974210739, + 2.3412149883806705, + 0.03320368751883507, + 0.9036909565329552, + 0.8531899489462376, + 0.597560066729784, + 0.2866191044449806, + 0.03346448019146919, + 0.035878319293260574, + 1.1045205406844616, + 0.22484232112765312, + 0.0918591171503067, + 0.6845105364918709, + 0.22024617716670036, + 0.17226731777191162, + 0.7560549601912498, + 0.0, + 0.5423208624124527, + 0.08204206079244614 + ], + "unique_experts": 62, + "load_cv": 0.7989967410709171, + "normalized_load_entropy": 0.9260431077558311, + "max_load_share": 0.057692307692307696 + } + }, + "s1_period": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "fe980b601abae3776f462df97ff39da9eb63f1ce268927448c174ce78b5e46c1", + "route_weight_sha256": "ccfba6ddb148c2400f5f5beb32cd3d9d00e7d092f95aca6fe6e0aed5653155bd", + "loads": [ + 0, + 1, + 8, + 2, + 3, + 0, + 2, + 0, + 2, + 2, + 3, + 2, + 1, + 2, + 7, + 1, + 6, + 3, + 0, + 9, + 2, + 3, + 2, + 9, + 1, + 2, + 0, + 1, + 8, + 1, + 6, + 3, + 1, + 3, + 2, + 2, + 1, + 2, + 5, + 1, + 2, + 7, + 0, + 2, + 4, + 1, + 0, + 1, + 1, + 4, + 6, + 2, + 1, + 1, + 0, + 2, + 1, + 8, + 3, + 1, + 3, + 0, + 2, + 1 + ], + "weighted_loads": [ + 0.0, + 0.10008888691663742, + 0.6373011916875839, + 0.08440958335995674, + 0.3700244724750519, + 0.0, + 0.0989476628601551, + 0.0, + 0.2313455268740654, + 0.12612493336200714, + 0.13449557311832905, + 0.3095592260360718, + 0.0330815427005291, + 0.10367880761623383, + 0.8741355761885643, + 0.19111664593219757, + 0.4980461858212948, + 0.157853115350008, + 0.0, + 1.1150860339403152, + 0.07868833094835281, + 0.28743140771985054, + 0.11216789856553078, + 0.6166339404881, + 0.08393359184265137, + 0.09230097010731697, + 0.0, + 0.08915990591049194, + 0.9605542942881584, + 0.06752707064151764, + 0.48284149914979935, + 0.20869150012731552, + 0.057145923376083374, + 0.3259658142924309, + 0.13079028576612473, + 0.18187524378299713, + 0.031977828592061996, + 0.07514685392379761, + 0.3532640226185322, + 0.05620390176773071, + 0.0909530520439148, + 0.6985535472631454, + 0.0, + 0.07415496930480003, + 0.24972450733184814, + 0.12859073281288147, + 0.0, + 0.031784772872924805, + 0.03624030575156212, + 0.22670844197273254, + 0.5978173166513443, + 0.31027524173259735, + 0.033972691744565964, + 0.039548110216856, + 0.0, + 0.16145586967468262, + 0.08179055154323578, + 0.6749484241008759, + 0.1802777387201786, + 0.17079009115695953, + 0.1975153125822544, + 0.0, + 0.07804208621382713, + 0.04143579676747322 + ], + "unique_experts": 55, + "load_cv": 0.9420812845908818, + "normalized_load_entropy": 0.8997078354195636, + "max_load_share": 0.05555555555555555 + }, + "full_input": { + "tokens": 68, + "top_k": 6, + "decisions": 408, + "ordered_route_sha256": "edd05547e7323957483d47918efe2189e1bd893122860626c07e714f3eda0311", + "route_weight_sha256": "c63818dc6fdedefdd98f6ef431ca2d53e0c4b24d04f7c97904b94dd200ba3868", + "loads": [ + 10, + 4, + 8, + 15, + 5, + 4, + 2, + 12, + 2, + 12, + 7, + 3, + 4, + 8, + 15, + 2, + 8, + 3, + 2, + 9, + 3, + 9, + 12, + 9, + 3, + 4, + 0, + 4, + 8, + 5, + 7, + 3, + 1, + 5, + 9, + 2, + 1, + 7, + 5, + 2, + 3, + 7, + 15, + 5, + 4, + 7, + 20, + 1, + 10, + 14, + 6, + 8, + 4, + 6, + 4, + 6, + 1, + 8, + 11, + 2, + 16, + 1, + 8, + 7 + ], + "weighted_loads": [ + 1.3128571026027203, + 0.2835438121110201, + 0.6373011916875839, + 0.8342038244009018, + 0.4071179529419169, + 0.170398922637105, + 0.0989476628601551, + 1.368670117110014, + 0.2313455268740654, + 0.7435778907383792, + 0.247924592345953, + 0.31043992517516017, + 0.1147457058832515, + 0.5533418245613575, + 1.5121523775160313, + 0.2402358166873455, + 0.7118889801204205, + 0.157853115350008, + 0.108890350908041, + 1.1150860339403152, + 0.11061136424541473, + 0.6077036820352077, + 1.0346217192709446, + 0.6166339404881, + 0.18740618973970413, + 0.14067114074714482, + 0.0, + 0.18561366572976112, + 0.9605542942881584, + 0.24153505638241768, + 0.524372037500143, + 0.20869150012731552, + 0.057145923376083374, + 0.39863865822553635, + 1.0093650743365288, + 0.18187524378299713, + 0.031977828592061996, + 0.4913911782205105, + 0.3532640226185322, + 0.10646107792854309, + 0.1657765507698059, + 0.6985535472631454, + 0.8019548263400793, + 0.17953290417790413, + 0.24972450733184814, + 0.5470695681869984, + 2.629079971462488, + 0.031784772872924805, + 1.093081135302782, + 0.6927941888570786, + 0.5978173166513443, + 1.0911311618983746, + 0.23519869148731232, + 0.7550837658345699, + 1.1247419975697994, + 0.3935461435467005, + 0.08179055154323578, + 0.6749484241008759, + 0.717467799782753, + 0.20129950158298016, + 1.0389388799667358, + 0.050033099949359894, + 0.5735489875078201, + 0.4526005685329437 + ], + "unique_experts": 63, + "load_cv": 0.677251609379237, + "normalized_load_entropy": 0.9453079710009092, + "max_load_share": 0.049019607843137254 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 27, + "ordered_topk_exact_tokens": 25, + "set_exact_tokens": 25, + "mean_set_jaccard": 0.978835978835979, + "mean_token_weighted_tv": 0.008899838077249351, + "aggregate_load_tv": 0.012345679012345678 + }, + "system_bos": { + "tokens": 27, + "ordered_topk_exact_tokens": 20, + "set_exact_tokens": 23, + "mean_set_jaccard": 0.9576719576719578, + "mean_token_weighted_tv": 0.01423585694283247, + "aggregate_load_tv": 0.024691358024691357 + }, + "system_x": { + "tokens": 27, + "ordered_topk_exact_tokens": 19, + "set_exact_tokens": 23, + "mean_set_jaccard": 0.9576719576719578, + "mean_token_weighted_tv": 0.015228477065209989, + "aggregate_load_tv": 0.024691358024691357 + }, + "system_period": { + "tokens": 27, + "ordered_topk_exact_tokens": 21, + "set_exact_tokens": 23, + "mean_set_jaccard": 0.9576719576719578, + "mean_token_weighted_tv": 0.015182437444174732, + "aggregate_load_tv": 0.024691358024691357 + }, + "bos_at_s0": { + "tokens": 27, + "ordered_topk_exact_tokens": 16, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.9153439153439153, + "mean_token_weighted_tv": 0.02380002065803166, + "aggregate_load_tv": 0.043209876543209874 + }, + "bos_at_s1": { + "tokens": 27, + "ordered_topk_exact_tokens": 22, + "set_exact_tokens": 24, + "mean_set_jaccard": 0.9682539682539684, + "mean_token_weighted_tv": 0.018482101943205903, + "aggregate_load_tv": 0.018518518518518517 + }, + "x_at_s0": { + "tokens": 27, + "ordered_topk_exact_tokens": 17, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.9153439153439153, + "mean_token_weighted_tv": 0.02449709149422469, + "aggregate_load_tv": 0.043209876543209874 + }, + "x_at_s1": { + "tokens": 27, + "ordered_topk_exact_tokens": 20, + "set_exact_tokens": 24, + "mean_set_jaccard": 0.9682539682539684, + "mean_token_weighted_tv": 0.01901926645250232, + "aggregate_load_tv": 0.018518518518518517 + }, + "period_at_s0": { + "tokens": 27, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.9153439153439153, + "mean_token_weighted_tv": 0.024168102553597203, + "aggregate_load_tv": 0.043209876543209874 + }, + "period_at_s1": { + "tokens": 27, + "ordered_topk_exact_tokens": 20, + "set_exact_tokens": 24, + "mean_set_jaccard": 0.9682539682539684, + "mean_token_weighted_tv": 0.018707797966069646, + "aggregate_load_tv": 0.018518518518518517 + } + } + }, + "layer_04": { + "layer": 4, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "6f0765f5385723ca69d058bb763367e65fa311985668362388a7bed06a78cb5b", + "route_weight_sha256": "15a3145967e4c54e30d7fe744508b0b2c74aa2a09776afc54fc23d07d00b27f5", + "loads": [ + 2, + 8, + 1, + 0, + 2, + 1, + 1, + 1, + 8, + 5, + 2, + 5, + 4, + 0, + 3, + 1, + 3, + 0, + 0, + 1, + 1, + 8, + 2, + 1, + 3, + 0, + 0, + 4, + 1, + 9, + 4, + 4, + 4, + 9, + 1, + 1, + 2, + 13, + 1, + 2, + 2, + 1, + 0, + 0, + 4, + 1, + 1, + 2, + 2, + 9, + 0, + 5, + 2, + 4, + 1, + 0, + 3, + 2, + 2, + 0, + 0, + 0, + 1, + 2 + ], + "weighted_loads": [ + 0.057418281212449074, + 0.5697235018014908, + 0.048099812120199203, + 0.0, + 0.2246841862797737, + 0.14263233542442322, + 0.04135345295071602, + 0.08926144987344742, + 0.6222543306648731, + 0.2588828094303608, + 0.12476194649934769, + 0.292951250448823, + 0.3491077274084091, + 0.0, + 0.09924661740660667, + 0.08349142968654633, + 0.2834421619772911, + 0.0, + 0.0, + 0.04126286879181862, + 0.03758201748132706, + 0.7546311393380165, + 0.11513824388384819, + 0.03079531155526638, + 0.3126985505223274, + 0.0, + 0.0, + 0.5987939685583115, + 0.07293586432933807, + 0.6560471933335066, + 0.21129159443080425, + 0.2624305933713913, + 0.1400605384260416, + 1.0422746390104294, + 0.06785526126623154, + 0.03571072965860367, + 0.11557598039507866, + 1.2969291880726814, + 0.040749192237854004, + 0.21736914664506912, + 0.10429612919688225, + 0.03633422031998634, + 0.0, + 0.0, + 0.34998128563165665, + 0.03617556393146515, + 0.06039143726229668, + 0.11319686844944954, + 0.07957856729626656, + 0.7956778705120087, + 0.0, + 0.2677617557346821, + 0.24394268542528152, + 0.29548075422644615, + 0.0485883504152298, + 0.0, + 0.2356867901980877, + 0.08295504562556744, + 0.23946233838796616, + 0.0, + 0.0, + 0.0, + 0.0570598840713501, + 0.1064198762178421 + ], + "unique_experts": 51, + "load_cv": 1.0885921042313826, + "normalized_load_entropy": 0.8719275078812432, + "max_load_share": 0.08024691358024691 + }, + "full_input": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "98e0f3966bf197192dc3f43b8bf111b33bfdfe432f4abbdb312fd58d38757596", + "route_weight_sha256": "9334f88fcb4372cead752db5b196714a81306b06d26d3c6a86397f4cd2425fb3", + "loads": [ + 2, + 11, + 3, + 4, + 2, + 1, + 2, + 1, + 8, + 5, + 12, + 7, + 4, + 13, + 5, + 4, + 3, + 0, + 4, + 1, + 1, + 10, + 2, + 1, + 3, + 6, + 6, + 5, + 1, + 29, + 4, + 6, + 4, + 11, + 13, + 1, + 2, + 14, + 2, + 3, + 5, + 4, + 8, + 0, + 4, + 3, + 12, + 2, + 3, + 11, + 1, + 5, + 2, + 4, + 1, + 0, + 3, + 2, + 2, + 14, + 4, + 0, + 4, + 2 + ], + "weighted_loads": [ + 0.057418281212449074, + 0.7356494627892971, + 0.1704123392701149, + 0.31669834844069555, + 0.2246841862797737, + 0.14263233542442322, + 0.0988725870847702, + 0.08926144987344742, + 0.6222543306648731, + 0.2588828094303608, + 0.7827571723610163, + 0.31946018896996975, + 0.3491077274084091, + 0.9302616976201534, + 0.14587124809622765, + 0.2644103392958641, + 0.2834421619772911, + 0.0, + 0.2019016930134967, + 0.04126286879181862, + 0.03758201748132706, + 1.8194582238793373, + 0.11513824388384819, + 0.03079531155526638, + 0.3126985505223274, + 0.46441300585865974, + 0.5404741279780865, + 0.6067526089027524, + 0.07293586432933807, + 2.377486109136953, + 0.21129159443080425, + 0.2933914605528116, + 0.1400605384260416, + 1.0825646510347724, + 1.3622981365479063, + 0.03571072965860367, + 0.11557598039507866, + 1.3374725133180618, + 1.0374456644058228, + 0.2990235686302185, + 0.24529901146888733, + 0.21108661964535713, + 0.3589503765106201, + 0.0, + 0.34998128563165665, + 0.23377645388245583, + 1.2103330940008163, + 0.11319686844944954, + 0.11631464958190918, + 0.8460414875298738, + 0.046734318137168884, + 0.2677617557346821, + 0.24394268542528152, + 0.29548075422644615, + 0.0485883504152298, + 0.0, + 0.2356867901980877, + 0.08295504562556744, + 0.23946233838796616, + 0.7811303045600653, + 0.3819042817049194, + 0.0, + 0.2504850812256336, + 0.1064198762178421 + ], + "unique_experts": 60, + "load_cv": 0.9940652294861604, + "normalized_load_entropy": 0.9040672137826475, + "max_load_share": 0.09294871794871795 + } + }, + "s1_eos": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "7de80ccd706390a611ac43051683585502c77c29eef38d91590641bea94f1854", + "route_weight_sha256": "bac9db22b6c9d60a6c602567f25b26cbe54571df2be057aa50bb338ea1f6cdf3", + "loads": [ + 2, + 8, + 1, + 0, + 2, + 1, + 1, + 1, + 8, + 5, + 2, + 5, + 4, + 0, + 3, + 1, + 3, + 0, + 0, + 1, + 1, + 8, + 2, + 1, + 3, + 0, + 0, + 4, + 1, + 11, + 3, + 4, + 4, + 9, + 1, + 1, + 2, + 12, + 1, + 2, + 2, + 1, + 0, + 0, + 4, + 1, + 1, + 2, + 1, + 9, + 0, + 5, + 2, + 4, + 1, + 0, + 3, + 2, + 2, + 0, + 1, + 0, + 1, + 2 + ], + "weighted_loads": [ + 0.058173058554530144, + 0.570713721215725, + 0.048561494797468185, + 0.0, + 0.21809089928865433, + 0.13621002435684204, + 0.039813291281461716, + 0.091539666056633, + 0.6273334249854088, + 0.25715680606663227, + 0.12220898270606995, + 0.2905705254524946, + 0.3583155646920204, + 0.0, + 0.10005194135010242, + 0.08310549706220627, + 0.286310039460659, + 0.0, + 0.0, + 0.04133773222565651, + 0.03758548945188522, + 0.7454575374722481, + 0.11549970880150795, + 0.030956493690609932, + 0.31210068985819817, + 0.0, + 0.0, + 0.5912578329443932, + 0.07534650713205338, + 0.7401467151939869, + 0.18150923773646355, + 0.25394416600465775, + 0.14383685402572155, + 1.039636418223381, + 0.06565152108669281, + 0.036405183374881744, + 0.12076893448829651, + 1.2899442315101624, + 0.04050002619624138, + 0.21804700791835785, + 0.1111764907836914, + 0.03718068450689316, + 0.0, + 0.0, + 0.34680499881505966, + 0.03667385131120682, + 0.059628378599882126, + 0.11653261631727219, + 0.034568049013614655, + 0.7832894809544086, + 0.0, + 0.2683402933180332, + 0.2433161363005638, + 0.2980252578854561, + 0.04899681732058525, + 0.0, + 0.2439790815114975, + 0.08152676746249199, + 0.23431392759084702, + 0.0, + 0.03296824172139168, + 0.0, + 0.05629666522145271, + 0.10770919919013977 + ], + "unique_experts": 52, + "load_cv": 1.0952920547787213, + "normalized_load_entropy": 0.8727576066806129, + "max_load_share": 0.07407407407407407 + }, + "full_input": { + "tokens": 68, + "top_k": 6, + "decisions": 408, + "ordered_route_sha256": "8511ac23be308e4e512df77426b856ce755e8c75a08e6e7ae9e715759740cb8e", + "route_weight_sha256": "1d19c495a5999911950f5bf732c56a37ed651efce7f52b0d21aa25a6f47992bb", + "loads": [ + 2, + 10, + 4, + 9, + 2, + 1, + 4, + 1, + 8, + 13, + 11, + 7, + 5, + 14, + 6, + 5, + 5, + 2, + 7, + 3, + 2, + 11, + 5, + 2, + 3, + 10, + 9, + 5, + 1, + 35, + 3, + 6, + 4, + 11, + 17, + 1, + 3, + 14, + 4, + 6, + 5, + 7, + 9, + 0, + 6, + 4, + 11, + 6, + 2, + 12, + 2, + 5, + 6, + 8, + 7, + 0, + 8, + 4, + 2, + 15, + 8, + 2, + 5, + 3 + ], + "weighted_loads": [ + 0.058173058554530144, + 0.7113955169916153, + 0.21918584778904915, + 0.7841853198187891, + 0.21809089928865433, + 0.13621002435684204, + 0.2526468522846699, + 0.091539666056633, + 0.6273334249854088, + 1.3035563919693232, + 0.7103485949337482, + 0.3170129740610719, + 0.4651799499988556, + 0.989585105329752, + 0.1746116653084755, + 0.34134021028876305, + 0.6512128934264183, + 0.07040183804929256, + 0.5438874147948809, + 0.13165515661239624, + 0.08685014024376869, + 1.8410545624792576, + 0.41441088542342186, + 0.12454614974558353, + 0.31210068985819817, + 0.7399524077773094, + 0.8178669847548008, + 0.5995774138718843, + 0.07534650713205338, + 2.4138692766427994, + 0.18150923773646355, + 0.28456036653369665, + 0.14383685402572155, + 1.0803248872980475, + 1.718091396818636, + 0.036405183374881744, + 0.14819234423339367, + 1.372922133654356, + 1.2286805175244808, + 0.5107380636036396, + 0.27215448021888733, + 0.29776702549133915, + 0.43067609891295433, + 0.0, + 0.4167874827980995, + 0.19913338078185916, + 1.2531723007559776, + 0.45273834466934204, + 0.06431404501199722, + 0.8697929792106152, + 0.09263472631573677, + 0.2683402933180332, + 0.6782210692763329, + 0.48190728947520256, + 0.5984502993524075, + 0.0, + 0.6687191352248192, + 0.15503043308854103, + 0.23431392759084702, + 0.8523860089480877, + 0.8951192907989025, + 0.19686682522296906, + 0.3225974254310131, + 0.15233474224805832 + ], + "unique_experts": 62, + "load_cv": 0.8362693377308283, + "normalized_load_entropy": 0.9307375511548999, + "max_load_share": 0.0857843137254902 + } + }, + "s0_bos": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "0874347af9a5afe7f9e0b9023ad7c934cbe4a5ae737b8e47154c152e9bd7f6c7", + "route_weight_sha256": "d5c1a95660765f2448270364d1b7ac458a3876105b2b38cc8226a3656f0ded7f", + "loads": [ + 2, + 8, + 2, + 1, + 2, + 1, + 1, + 1, + 8, + 4, + 2, + 6, + 4, + 0, + 4, + 1, + 3, + 1, + 0, + 1, + 1, + 8, + 2, + 2, + 3, + 1, + 0, + 4, + 1, + 5, + 4, + 4, + 3, + 9, + 1, + 1, + 2, + 12, + 1, + 2, + 2, + 1, + 0, + 0, + 4, + 1, + 1, + 2, + 2, + 10, + 0, + 4, + 2, + 4, + 1, + 0, + 3, + 2, + 2, + 0, + 0, + 0, + 1, + 2 + ], + "weighted_loads": [ + 0.06176118366420269, + 0.5766323506832123, + 0.08610914647579193, + 0.038506895303726196, + 0.2227291688323021, + 0.144220232963562, + 0.04952722042798996, + 0.09905440360307693, + 0.6453763730823994, + 0.24626131355762482, + 0.1156122088432312, + 0.3348128963261843, + 0.3382962569594383, + 0.0, + 0.1323772743344307, + 0.0872233510017395, + 0.284720741212368, + 0.026048649102449417, + 0.0, + 0.045087046921253204, + 0.03767691180109978, + 0.7333729565143585, + 0.12558703497052193, + 0.07017207518219948, + 0.30085553228855133, + 0.026401033625006676, + 0.0, + 0.5663616955280304, + 0.07689815759658813, + 0.4550854153931141, + 0.2256803661584854, + 0.25505656749010086, + 0.11302050203084946, + 1.0561223663389683, + 0.05876138433814049, + 0.035865556448698044, + 0.1150473952293396, + 1.2104837000370026, + 0.043957553803920746, + 0.21436547487974167, + 0.09441826492547989, + 0.03622148931026459, + 0.0, + 0.0, + 0.35443539172410965, + 0.03128502517938614, + 0.05802106484770775, + 0.11289834976196289, + 0.08880588039755821, + 0.8310183957219124, + 0.0, + 0.21648414991796017, + 0.2525935545563698, + 0.2958749830722809, + 0.048021748661994934, + 0.0, + 0.24251916259527206, + 0.08410301245748997, + 0.24686647579073906, + 0.0, + 0.0, + 0.0, + 0.05609498172998428, + 0.1033051535487175 + ], + "unique_experts": 54, + "load_cv": 1.0191730033365638, + "normalized_load_entropy": 0.8890417479520405, + "max_load_share": 0.07407407407407407 + }, + "full_input": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "cb688b7443e5534986c5e45bee82189e398b8e82454cd325d9c8bd562898691f", + "route_weight_sha256": "a5d74e0d5b5020951ab440baf0c924a04a7ca8fbdf6189617129f1a3f2c76fef", + "loads": [ + 2, + 11, + 4, + 6, + 2, + 1, + 2, + 1, + 8, + 4, + 12, + 7, + 4, + 13, + 6, + 4, + 3, + 1, + 5, + 1, + 1, + 9, + 3, + 2, + 3, + 7, + 6, + 4, + 1, + 26, + 4, + 5, + 3, + 10, + 14, + 1, + 2, + 14, + 2, + 3, + 5, + 4, + 8, + 0, + 4, + 3, + 12, + 2, + 3, + 11, + 1, + 4, + 2, + 4, + 1, + 0, + 3, + 2, + 2, + 13, + 5, + 0, + 4, + 2 + ], + "weighted_loads": [ + 0.06176118366420269, + 0.746889304369688, + 0.20842167362570763, + 0.41682557977037504, + 0.2227291688323021, + 0.144220232963562, + 0.10200349614024162, + 0.09905440360307693, + 0.6453763730823994, + 0.24626131355762482, + 0.7736074347048998, + 0.35188203305006027, + 0.3382962569594383, + 0.9381023198366165, + 0.17900190502405167, + 0.2665417082607746, + 0.284720741212368, + 0.026048649102449417, + 0.35779338714201003, + 0.045087046921253204, + 0.03767691180109978, + 1.0226252973079681, + 0.1552701983600855, + 0.07017207518219948, + 0.30085553228855133, + 0.49738422594964504, + 0.5469890236854553, + 0.5663616955280304, + 0.07689815759658813, + 2.2231359419965884, + 0.2256803661584854, + 0.27347765304148197, + 0.11302050203084946, + 1.0815033800899982, + 1.3504389542795252, + 0.035865556448698044, + 0.1150473952293396, + 1.29774384573102, + 1.0406540259718895, + 0.29285574704408646, + 0.23542114719748497, + 0.20196744799613953, + 0.3589503765106201, + 0.0, + 0.35443539172410965, + 0.30521514639258385, + 1.2079627215862274, + 0.11289834976196289, + 0.12554196268320084, + 0.8590397946536541, + 0.046734318137168884, + 0.21648414991796017, + 0.2525935545563698, + 0.2958749830722809, + 0.048021748661994934, + 0.0, + 0.24251916259527206, + 0.08410301245748997, + 0.24686647579073906, + 0.7493598703294992, + 0.597649000614183, + 0.0, + 0.26565517857670784, + 0.1033051535487175 + ], + "unique_experts": 61, + "load_cv": 0.9354582742028051, + "normalized_load_entropy": 0.9122924848814353, + "max_load_share": 0.08333333333333333 + } + }, + "s1_bos": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "058d2083e31dde1250f7660fbc16401b9d7533d7a71ed5caa6e40824c3c6ec45", + "route_weight_sha256": "aa96c3060dd41965d286b96fd017a12c953f4b97054f1302ec01e3dde0a183df", + "loads": [ + 2, + 7, + 2, + 1, + 2, + 1, + 1, + 1, + 8, + 4, + 2, + 4, + 4, + 0, + 4, + 1, + 3, + 1, + 0, + 1, + 2, + 8, + 2, + 1, + 3, + 1, + 0, + 4, + 1, + 5, + 5, + 4, + 4, + 9, + 1, + 1, + 2, + 12, + 1, + 2, + 2, + 1, + 0, + 0, + 4, + 1, + 2, + 2, + 2, + 10, + 0, + 4, + 2, + 4, + 1, + 0, + 3, + 2, + 2, + 0, + 0, + 0, + 1, + 2 + ], + "weighted_loads": [ + 0.06357472389936447, + 0.5161101743578911, + 0.08922276273369789, + 0.038959622383117676, + 0.22539684921503067, + 0.1422353982925415, + 0.05320688337087631, + 0.10386324673891068, + 0.6306837536394596, + 0.2479907125234604, + 0.11273010820150375, + 0.25666686706244946, + 0.3567037954926491, + 0.0, + 0.13673103973269463, + 0.0937126874923706, + 0.30241406708955765, + 0.02566765435039997, + 0.0, + 0.04615301638841629, + 0.07265383750200272, + 0.73267687484622, + 0.13150232285261154, + 0.03447570279240608, + 0.2929031662642956, + 0.030352970585227013, + 0.0, + 0.5662822797894478, + 0.0834076926112175, + 0.39065469428896904, + 0.2646595239639282, + 0.2518302034586668, + 0.155200507491827, + 1.062167327851057, + 0.05171094089746475, + 0.034751392900943756, + 0.12727415561676025, + 1.240099085494876, + 0.043354861438274384, + 0.21926473826169968, + 0.1202281154692173, + 0.03736110031604767, + 0.0, + 0.0, + 0.35857708007097244, + 0.02988559380173683, + 0.0904298685491085, + 0.11242904886603355, + 0.06849240139126778, + 0.8217540085315704, + 0.0, + 0.21944764256477356, + 0.24618587642908096, + 0.31375982612371445, + 0.05030151829123497, + 0.0, + 0.23494447767734528, + 0.0816103108227253, + 0.24923191964626312, + 0.0, + 0.0, + 0.0, + 0.05684039369225502, + 0.09960439056158066 + ], + "unique_experts": 54, + "load_cv": 0.999847572592667, + "normalized_load_entropy": 0.8921318071883062, + "max_load_share": 0.07407407407407407 + }, + "full_input": { + "tokens": 68, + "top_k": 6, + "decisions": 408, + "ordered_route_sha256": "b15338aa137c2f7d884e5c083fe0ae328714f1ccf48eb6fedf7467bfe52666f3", + "route_weight_sha256": "aa8ecb530f38c9267f0dc7b9cd59210d706cedd33f32aa7245a858d134b2d15d", + "loads": [ + 2, + 9, + 5, + 11, + 2, + 1, + 4, + 1, + 8, + 12, + 11, + 5, + 5, + 15, + 7, + 5, + 5, + 3, + 8, + 3, + 3, + 10, + 5, + 2, + 3, + 11, + 9, + 4, + 1, + 29, + 5, + 5, + 4, + 10, + 18, + 1, + 3, + 15, + 4, + 6, + 5, + 7, + 9, + 0, + 6, + 4, + 13, + 6, + 3, + 12, + 2, + 4, + 6, + 8, + 7, + 0, + 8, + 4, + 2, + 14, + 8, + 2, + 5, + 3 + ], + "weighted_loads": [ + 0.06357472389936447, + 0.661436915397644, + 0.25984711572527885, + 0.8730957951920573, + 0.22539684921503067, + 0.1422353982925415, + 0.24753997847437859, + 0.10386324673891068, + 0.6306837536394596, + 1.2943902984261513, + 0.700869720429182, + 0.27373600378632545, + 0.46356818079948425, + 1.0209307596087456, + 0.2112907636910677, + 0.36827346310019493, + 0.6673169210553169, + 0.09606949239969254, + 0.6923613779363222, + 0.13647044077515602, + 0.12191848829388618, + 1.0623214319348335, + 0.43041349947452545, + 0.12806535884737968, + 0.2929031662642956, + 0.731805706396699, + 0.8397610932588577, + 0.5662822797894478, + 0.0834076926112175, + 1.945489302277565, + 0.2646595239639282, + 0.2702512890100479, + 0.155200507491827, + 1.087548341602087, + 1.601099247316597, + 0.034751392900943756, + 0.15469756536185741, + 1.369799355044961, + 1.2315353527665138, + 0.5165488310158253, + 0.2812061049044132, + 0.32700559224758763, + 0.43067609891295433, + 0.0, + 0.4285595640540123, + 0.19966478226706386, + 1.3320894688367844, + 0.4486347772181034, + 0.09823839738965034, + 0.8853619024157524, + 0.09263472631573677, + 0.21944764256477356, + 0.68109080940485, + 0.4976418577134609, + 0.5997550003230572, + 0.0, + 0.659684531390667, + 0.15511397644877434, + 0.24923191964626312, + 0.8229159787297249, + 1.0949223935604095, + 0.19686682522296906, + 0.34923456609249115, + 0.1442299336194992 + ], + "unique_experts": 62, + "load_cv": 0.7687174817220651, + "normalized_load_entropy": 0.9367618408977756, + "max_load_share": 0.07107843137254902 + } + }, + "s0_x": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "0a428563868d1b9131bf77b2a41fd9b6594f8d1c1eeed5d5c06ea42ac228601f", + "route_weight_sha256": "384ca49e72da5969e29399a830fcc159865020e18a6ffd0ac5057622edff0fb1", + "loads": [ + 2, + 8, + 2, + 1, + 2, + 1, + 1, + 1, + 8, + 4, + 2, + 5, + 4, + 0, + 4, + 1, + 3, + 1, + 0, + 1, + 1, + 8, + 2, + 1, + 3, + 1, + 0, + 4, + 1, + 5, + 5, + 4, + 4, + 9, + 1, + 0, + 2, + 12, + 1, + 2, + 2, + 1, + 0, + 0, + 4, + 1, + 2, + 2, + 2, + 9, + 0, + 4, + 2, + 4, + 1, + 0, + 3, + 2, + 2, + 0, + 1, + 0, + 1, + 2 + ], + "weighted_loads": [ + 0.06091080605983734, + 0.5718045569956303, + 0.09025242924690247, + 0.04187990352511406, + 0.21473540365695953, + 0.13890711963176727, + 0.05158931016921997, + 0.0899021252989769, + 0.6362100392580032, + 0.2474301941692829, + 0.11685215309262276, + 0.2950635589659214, + 0.3427167870104313, + 0.0, + 0.1330791525542736, + 0.09074733406305313, + 0.2936331257224083, + 0.0251148734241724, + 0.0, + 0.04466601461172104, + 0.03719113767147064, + 0.7151117697358131, + 0.13231652602553368, + 0.031014297157526016, + 0.3048927113413811, + 0.027939429506659508, + 0.0, + 0.5746941938996315, + 0.07771335542201996, + 0.3951362259685993, + 0.26329516246914864, + 0.25572940707206726, + 0.1440269835293293, + 1.0437467619776726, + 0.05989048629999161, + 0.0, + 0.10093826800584793, + 1.228308105841279, + 0.046615127474069595, + 0.21342133730649948, + 0.09468907117843628, + 0.03993714600801468, + 0.0, + 0.0, + 0.34790148958563805, + 0.03139856457710266, + 0.08305875584483147, + 0.11426626890897751, + 0.08492643386125565, + 0.8146417923271656, + 0.0, + 0.20017878338694572, + 0.26218821108341217, + 0.3071823287755251, + 0.04951087012887001, + 0.0, + 0.23595302551984787, + 0.08581585064530373, + 0.23998313769698143, + 0.0, + 0.03451332077383995, + 0.0, + 0.05737859010696411, + 0.10438788309693336 + ], + "unique_experts": 54, + "load_cv": 1.0022836293725825, + "normalized_load_entropy": 0.8908270745914536, + "max_load_share": 0.07407407407407407 + }, + "full_input": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "a6f6edb6c79645e9e32f29102f902a7641ecb5f84ed97c6c682a056f934f7441", + "route_weight_sha256": "1d70a06d954107025defacec198fe8161126182f3dca00a5d1187fbb886ee12f", + "loads": [ + 2, + 12, + 5, + 5, + 2, + 1, + 1, + 1, + 8, + 4, + 13, + 6, + 4, + 12, + 6, + 4, + 3, + 1, + 3, + 1, + 1, + 9, + 3, + 1, + 3, + 7, + 6, + 4, + 1, + 24, + 5, + 5, + 4, + 10, + 12, + 0, + 2, + 14, + 2, + 3, + 6, + 4, + 9, + 0, + 4, + 3, + 15, + 2, + 4, + 10, + 1, + 4, + 3, + 4, + 1, + 0, + 3, + 2, + 2, + 14, + 5, + 0, + 4, + 2 + ], + "weighted_loads": [ + 0.06091080605983734, + 0.7823305130004883, + 0.243478087708354, + 0.3843634448130615, + 0.21473540365695953, + 0.13890711963176727, + 0.05158931016921997, + 0.0899021252989769, + 0.6362100392580032, + 0.2474301941692829, + 0.9925712402909994, + 0.3121326956897974, + 0.3427167870104313, + 0.9025293774902821, + 0.17970378324389458, + 0.28221452608704567, + 0.2936331257224083, + 0.0251148734241724, + 0.14840080973226577, + 0.04466601461172104, + 0.03719113767147064, + 1.0043641105294228, + 0.17110297456383705, + 0.031014297157526016, + 0.3048927113413811, + 0.4299606326967478, + 0.5914000384509563, + 0.5746941938996315, + 0.07771335542201996, + 1.837173362597241, + 0.26329516246914864, + 0.27415049262344837, + 0.1440269835293293, + 1.0691277757287025, + 1.1081201489723753, + 0.0, + 0.10093826800584793, + 1.31376956962049, + 1.0433115996420383, + 0.295379675924778, + 0.29239794611930847, + 0.21183623373508453, + 0.3944178856909275, + 0.0, + 0.34790148958563805, + 0.2796141393482685, + 1.4774105623364449, + 0.11426626890897751, + 0.16485922411084175, + 0.8426631912589073, + 0.046734318137168884, + 0.20017878338694572, + 0.32944437861442566, + 0.3071823287755251, + 0.04951087012887001, + 0.0, + 0.23595302551984787, + 0.08581585064530373, + 0.23998313769698143, + 0.8418397735804319, + 0.4084666632406879, + 0.0, + 0.2570301406085491, + 0.10438788309693336 + ], + "unique_experts": 60, + "load_cv": 0.926986024744883, + "normalized_load_entropy": 0.9099132640861463, + "max_load_share": 0.07692307692307693 + } + }, + "s1_x": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "ccb37d67763cef145b0bd8b288d9bcaf9c958deaa2e32e61bb0b14eb3914d2de", + "route_weight_sha256": "1ba3e54ddc6385fb0d8a114dea74cc1f1f7adb37c5ccc690176133d2bcb3e65f", + "loads": [ + 2, + 7, + 2, + 1, + 2, + 1, + 1, + 1, + 8, + 4, + 1, + 5, + 4, + 0, + 3, + 1, + 3, + 1, + 0, + 1, + 2, + 9, + 2, + 1, + 3, + 1, + 0, + 4, + 1, + 4, + 6, + 4, + 4, + 9, + 1, + 1, + 2, + 13, + 1, + 2, + 2, + 1, + 0, + 0, + 4, + 1, + 2, + 2, + 0, + 10, + 0, + 4, + 2, + 4, + 1, + 0, + 3, + 2, + 2, + 0, + 1, + 0, + 1, + 2 + ], + "weighted_loads": [ + 0.061375148594379425, + 0.5012568701058626, + 0.09368496388196945, + 0.042905885726213455, + 0.2199612781405449, + 0.14166836440563202, + 0.05183543637394905, + 0.09881545603275299, + 0.620608739554882, + 0.2498982921242714, + 0.0764690563082695, + 0.29426558315753937, + 0.3589010201394558, + 0.0, + 0.09885089471936226, + 0.09346160292625427, + 0.3017703741788864, + 0.02526668645441532, + 0.0, + 0.046335168182849884, + 0.07289190217852592, + 0.7831516601145267, + 0.13750476390123367, + 0.03363078460097313, + 0.29194575920701027, + 0.028733978047966957, + 0.0, + 0.5909131094813347, + 0.08361557871103287, + 0.27738843858242035, + 0.3106200061738491, + 0.24882609024643898, + 0.15406292863190174, + 1.0545168779790401, + 0.04865005984902382, + 0.034729473292827606, + 0.11455123499035835, + 1.273323841392994, + 0.043592002242803574, + 0.2213171124458313, + 0.12424113973975182, + 0.038981225341558456, + 0.0, + 0.0, + 0.3568006530404091, + 0.03072507120668888, + 0.08801020681858063, + 0.11559558659791946, + 0.0, + 0.8256773874163628, + 0.0, + 0.2024158239364624, + 0.25355735421180725, + 0.32194047048687935, + 0.04963988810777664, + 0.0, + 0.23137389868497849, + 0.080728679895401, + 0.24155350029468536, + 0.0, + 0.036379192024469376, + 0.0, + 0.057057593017816544, + 0.09984811767935753 + ], + "unique_experts": 54, + "load_cv": 1.047492851620481, + "normalized_load_entropy": 0.8856806617436408, + "max_load_share": 0.08024691358024691 + }, + "full_input": { + "tokens": 68, + "top_k": 6, + "decisions": 408, + "ordered_route_sha256": "7f88732b8dee6b31e8fcaec23cc41f965f2025e05e67b7835ec93012c57c14ff", + "route_weight_sha256": "dbcfa7acfa613f57b3c25e8ae8438d614a14ae401a0209f107347b5bd633b0d4", + "loads": [ + 2, + 10, + 6, + 10, + 2, + 1, + 3, + 1, + 8, + 12, + 11, + 6, + 5, + 13, + 6, + 5, + 5, + 3, + 7, + 3, + 3, + 11, + 6, + 2, + 3, + 11, + 9, + 4, + 1, + 25, + 6, + 5, + 4, + 10, + 17, + 1, + 3, + 16, + 5, + 6, + 6, + 7, + 10, + 0, + 6, + 4, + 14, + 6, + 1, + 12, + 2, + 4, + 7, + 8, + 7, + 0, + 8, + 4, + 2, + 15, + 8, + 2, + 5, + 3 + ], + "weighted_loads": [ + 0.061375148594379425, + 0.6913186106830835, + 0.2993193082511425, + 0.8443644155340735, + 0.2199612781405449, + 0.14166836440563202, + 0.1970517374575138, + 0.09881545603275299, + 0.620608739554882, + 1.2962978780269623, + 0.8541265986859798, + 0.31133471988141537, + 0.46576540544629097, + 0.9523063078522682, + 0.17341061867773533, + 0.3712606802582741, + 0.6666732281446457, + 0.09566852450370789, + 0.5416462577995844, + 0.13665259256958961, + 0.1221565529704094, + 1.1127962172031403, + 0.47561902180314064, + 0.12722044065594673, + 0.29194575920701027, + 0.6712749879807234, + 0.8799422681331635, + 0.5909131094813347, + 0.08361557871103287, + 1.4600784592330456, + 0.3106200061738491, + 0.2672471757978201, + 0.15406292863190174, + 1.0798978917300701, + 1.3622749878268223, + 0.034729473292827606, + 0.1419746447354555, + 1.403069656342268, + 1.2842293754220009, + 0.5187880136072636, + 0.3397086523473263, + 0.36164833705697674, + 0.47083646804094315, + 0.0, + 0.42678313702344894, + 0.15693091740831733, + 1.5358329452574253, + 0.4518013149499893, + 0.02974599599838257, + 0.8892852813005447, + 0.09263472631573677, + 0.2024158239364624, + 0.7457042783498764, + 0.5058225020766258, + 0.5990933701395988, + 0.0, + 0.6561139523983002, + 0.15423234552145004, + 0.24155350029468536, + 0.9213769882917404, + 0.9079635702073574, + 0.19686682522296906, + 0.3393201492726803, + 0.14447366073727608 + ], + "unique_experts": 62, + "load_cv": 0.7307703981797735, + "normalized_load_entropy": 0.9387301723206061, + "max_load_share": 0.061274509803921566 + } + }, + "s0_period": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "04b79da13ea0133dcc19e48af3d62ace9dde739834439750284a4661d56b5340", + "route_weight_sha256": "07647695c6949e73a3a3a140cfa572a53be682aee601534c6d9e6b697c76e533", + "loads": [ + 2, + 8, + 2, + 1, + 2, + 1, + 1, + 1, + 8, + 4, + 2, + 5, + 4, + 0, + 4, + 1, + 3, + 1, + 0, + 1, + 1, + 8, + 2, + 1, + 3, + 1, + 0, + 4, + 1, + 4, + 6, + 4, + 3, + 9, + 1, + 0, + 2, + 12, + 1, + 2, + 2, + 1, + 0, + 0, + 4, + 1, + 2, + 2, + 2, + 10, + 0, + 4, + 2, + 4, + 1, + 0, + 3, + 2, + 2, + 0, + 1, + 0, + 1, + 2 + ], + "weighted_loads": [ + 0.06269955821335316, + 0.5720198787748814, + 0.08710363134741783, + 0.044567909091711044, + 0.21760762482881546, + 0.1447608917951584, + 0.05425826832652092, + 0.08940254896879196, + 0.6471337825059891, + 0.2550518959760666, + 0.11692341789603233, + 0.2966805938631296, + 0.3414090797305107, + 0.0, + 0.13415304943919182, + 0.09021098166704178, + 0.2991386204957962, + 0.02524963952600956, + 0.0, + 0.04422736167907715, + 0.03649087995290756, + 0.6951974146068096, + 0.13479139655828476, + 0.03133084625005722, + 0.3038567304611206, + 0.027874290943145752, + 0.0, + 0.5704186409711838, + 0.07931637763977051, + 0.32006245106458664, + 0.3167129084467888, + 0.25430477783083916, + 0.11271341145038605, + 1.0506777688860893, + 0.06091195344924927, + 0.0, + 0.09851033985614777, + 1.2433071546256542, + 0.0462409183382988, + 0.21826284378767014, + 0.09903081133961678, + 0.03928375616669655, + 0.0, + 0.0, + 0.3493468873202801, + 0.030353395268321037, + 0.08259297534823418, + 0.11791959404945374, + 0.0844561792910099, + 0.8408093675971031, + 0.0, + 0.20013754814863205, + 0.2687913179397583, + 0.3083911556750536, + 0.04909863322973251, + 0.0, + 0.2339748740196228, + 0.08571592904627323, + 0.24304163455963135, + 0.0, + 0.035582285374403, + 0.0, + 0.057424452155828476, + 0.09921031817793846 + ], + "unique_experts": 54, + "load_cv": 1.0191730033365638, + "normalized_load_entropy": 0.8890417479520405, + "max_load_share": 0.07407407407407407 + }, + "full_input": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "2bc22e62e59b2d4041d4ac28646a3d41023b7dba5db585f76078e31f847a9a5a", + "route_weight_sha256": "7fa3b41dc8700dfcf9083338d7f3b41f0ff875fb48c2f7ceead9e67ff6014c3c", + "loads": [ + 2, + 12, + 4, + 5, + 2, + 1, + 1, + 1, + 8, + 4, + 12, + 6, + 4, + 12, + 6, + 3, + 3, + 1, + 4, + 1, + 1, + 9, + 4, + 1, + 3, + 7, + 7, + 4, + 1, + 23, + 6, + 5, + 3, + 10, + 12, + 1, + 2, + 14, + 2, + 3, + 5, + 4, + 8, + 0, + 4, + 3, + 14, + 2, + 4, + 11, + 1, + 5, + 4, + 4, + 1, + 0, + 3, + 2, + 2, + 14, + 5, + 0, + 4, + 2 + ], + "weighted_loads": [ + 0.06269955821335316, + 0.7922973334789276, + 0.20941615849733353, + 0.3802888191421516, + 0.21760762482881546, + 0.1447608917951584, + 0.05425826832652092, + 0.08940254896879196, + 0.6471337825059891, + 0.2550518959760666, + 0.7749186437577009, + 0.3137497305870056, + 0.3414090797305107, + 0.8756267167627811, + 0.1807776801288128, + 0.21779458224773407, + 0.2991386204957962, + 0.02524963952600956, + 0.21766459580976516, + 0.04422736167907715, + 0.03649087995290756, + 0.9844497554004192, + 0.21184776723384857, + 0.03133084625005722, + 0.3038567304611206, + 0.40809705294668674, + 0.8611165247857571, + 0.5704186409711838, + 0.07931637763977051, + 1.7101164994382998, + 0.3167129084467888, + 0.27272586338222027, + 0.11271341145038605, + 1.0760587826371193, + 1.088546032056911, + 0.048551805317401886, + 0.09851033985614777, + 1.3295069374144077, + 1.0429373905062675, + 0.30082037299871445, + 0.24003369361162186, + 0.20454515144228935, + 0.3589503765106201, + 0.0, + 0.3493468873202801, + 0.29910960979759693, + 1.392947942018509, + 0.11791959404945374, + 0.1756618432700634, + 0.8688307665288448, + 0.046734318137168884, + 0.32437607645988464, + 0.40658586472272873, + 0.3083911556750536, + 0.04909863322973251, + 0.0, + 0.2339748740196228, + 0.08571592904627323, + 0.24304163455963135, + 0.8443032447248697, + 0.41010702031780966, + 0.0, + 0.2584533542394638, + 0.09921031817793846 + ], + "unique_experts": 61, + "load_cv": 0.8996310150178889, + "normalized_load_entropy": 0.9145563023283627, + "max_load_share": 0.07371794871794872 + } + }, + "s1_period": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "28b5972b183e4deeee2f71e161194e67310c11f536633da6e28968599c19b9dd", + "route_weight_sha256": "71dbaae9d1c761e40e3d833e30d6b35fb12ff61adf08b48bf7354ca3384d909b", + "loads": [ + 2, + 7, + 2, + 1, + 2, + 1, + 1, + 1, + 8, + 4, + 2, + 5, + 4, + 0, + 4, + 1, + 3, + 1, + 0, + 1, + 2, + 8, + 2, + 1, + 3, + 1, + 0, + 4, + 1, + 4, + 6, + 4, + 4, + 9, + 1, + 1, + 2, + 12, + 1, + 2, + 2, + 2, + 0, + 0, + 4, + 1, + 2, + 2, + 0, + 10, + 0, + 4, + 2, + 4, + 1, + 0, + 3, + 2, + 2, + 0, + 1, + 0, + 1, + 1 + ], + "weighted_loads": [ + 0.062655383720994, + 0.5045748110860586, + 0.09016716107726097, + 0.04584885388612747, + 0.2239997684955597, + 0.14506228268146515, + 0.05485120788216591, + 0.0981968566775322, + 0.6261012963950634, + 0.25905899703502655, + 0.11226246878504753, + 0.29302959330379963, + 0.36102602258324623, + 0.0, + 0.13164176419377327, + 0.09319579601287842, + 0.30614740401506424, + 0.02529103495180607, + 0.0, + 0.04658997431397438, + 0.07191121205687523, + 0.7260765321552753, + 0.1396832838654518, + 0.03348609805107117, + 0.29261229932308197, + 0.0282527357339859, + 0.0, + 0.5833411887288094, + 0.0853130891919136, + 0.26038650795817375, + 0.3143902122974396, + 0.24712614342570305, + 0.15342296846210957, + 1.061130478978157, + 0.04853036627173424, + 0.03424105420708656, + 0.11394282802939415, + 1.2538085952401161, + 0.044440072029829025, + 0.2260335311293602, + 0.12772589921951294, + 0.0856720581650734, + 0.0, + 0.0, + 0.35811879485845566, + 0.03031974285840988, + 0.08673345670104027, + 0.1174798533320427, + 0.0, + 0.8277002349495888, + 0.0, + 0.20003068633377552, + 0.2535787373781204, + 0.3236074671149254, + 0.04992157593369484, + 0.0, + 0.23080039396882057, + 0.0811221394687891, + 0.24243730306625366, + 0.0, + 0.0390583798289299, + 0.0, + 0.0565858893096447, + 0.05086072161793709 + ], + "unique_experts": 54, + "load_cv": 1.0095565311436303, + "normalized_load_entropy": 0.8901769362727814, + "max_load_share": 0.07407407407407407 + }, + "full_input": { + "tokens": 68, + "top_k": 6, + "decisions": 408, + "ordered_route_sha256": "be46c3f4bffd06e20cc558e7f6fa8401803b3e22f2ec3aa187ef97cd417f1e23", + "route_weight_sha256": "4b7f230b5047d930a49a80d56a50cebfed50ab9fe9d5bd34393e66e34aa255a0", + "loads": [ + 2, + 10, + 5, + 10, + 2, + 1, + 3, + 1, + 8, + 12, + 11, + 6, + 5, + 13, + 7, + 5, + 5, + 3, + 7, + 3, + 3, + 10, + 8, + 2, + 3, + 11, + 10, + 4, + 1, + 24, + 6, + 5, + 4, + 10, + 16, + 1, + 3, + 16, + 5, + 6, + 5, + 8, + 9, + 0, + 6, + 4, + 13, + 6, + 1, + 12, + 2, + 5, + 7, + 8, + 7, + 0, + 8, + 4, + 2, + 15, + 9, + 2, + 5, + 3 + ], + "weighted_loads": [ + 0.062655383720994, + 0.6826879624277353, + 0.26079151406884193, + 0.8460609239118639, + 0.2239997684955597, + 0.14506228268146515, + 0.20006750896573067, + 0.0981968566775322, + 0.6261012963950634, + 1.3054585829377174, + 0.7004020810127258, + 0.31009873002767563, + 0.4678904078900814, + 0.9243932738900185, + 0.20620148815214634, + 0.3783443719148636, + 0.6710502579808235, + 0.09569287300109863, + 0.5411148749408312, + 0.1369073987007141, + 0.1211758628487587, + 1.0557210892438889, + 0.571847453713417, + 0.12707575410604477, + 0.29261229932308197, + 0.6393733974546194, + 1.181158795952797, + 0.5833411887288094, + 0.0853130891919136, + 1.3763393945991993, + 0.3143902122974396, + 0.26554722897708416, + 0.15342296846210957, + 1.086511492729187, + 1.3014976030390244, + 0.03424105420708656, + 0.1413662377744913, + 1.4259246438741684, + 1.290533658117056, + 0.5226947627961636, + 0.28870388865470886, + 0.4199876981583657, + 0.43067609891295433, + 0.0, + 0.4281012788414955, + 0.1582779879681766, + 1.388632632791996, + 0.45368558168411255, + 0.02974599599838257, + 0.8913081288337708, + 0.09263472631573677, + 0.2968385387212038, + 0.7407032176852226, + 0.5074894987046719, + 0.599375057965517, + 0.0, + 0.6555404476821423, + 0.15462580509483814, + 0.24243730306625366, + 0.9784725531935692, + 0.9579923376441002, + 0.19686682522296906, + 0.3507756106555462, + 0.12575642578303814 + ], + "unique_experts": 62, + "load_cv": 0.7121184234248972, + "normalized_load_entropy": 0.9404690391663747, + "max_load_share": 0.058823529411764705 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 27, + "ordered_topk_exact_tokens": 24, + "set_exact_tokens": 24, + "mean_set_jaccard": 0.9682539682539684, + "mean_token_weighted_tv": 0.009148842793095994, + "aggregate_load_tv": 0.018518518518518517 + }, + "system_bos": { + "tokens": 27, + "ordered_topk_exact_tokens": 17, + "set_exact_tokens": 22, + "mean_set_jaccard": 0.9470899470899471, + "mean_token_weighted_tv": 0.016114088051297045, + "aggregate_load_tv": 0.024691358024691357 + }, + "system_x": { + "tokens": 27, + "ordered_topk_exact_tokens": 19, + "set_exact_tokens": 20, + "mean_set_jaccard": 0.9259259259259259, + "mean_token_weighted_tv": 0.020665861079814257, + "aggregate_load_tv": 0.037037037037037035 + }, + "system_period": { + "tokens": 27, + "ordered_topk_exact_tokens": 19, + "set_exact_tokens": 21, + "mean_set_jaccard": 0.9365079365079365, + "mean_token_weighted_tv": 0.018843794000093585, + "aggregate_load_tv": 0.024691358024691357 + }, + "bos_at_s0": { + "tokens": 27, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.9153439153439153, + "mean_token_weighted_tv": 0.021730748936533928, + "aggregate_load_tv": 0.04938271604938271 + }, + "bos_at_s1": { + "tokens": 27, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.8862433862433862, + "mean_token_weighted_tv": 0.028322935276837262, + "aggregate_load_tv": 0.06790123456790123 + }, + "x_at_s0": { + "tokens": 27, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 20, + "mean_set_jaccard": 0.9179894179894179, + "mean_token_weighted_tv": 0.02404104887197415, + "aggregate_load_tv": 0.04938271604938271 + }, + "x_at_s1": { + "tokens": 27, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.8650793650793651, + "mean_token_weighted_tv": 0.03414089691445783, + "aggregate_load_tv": 0.07407407407407407 + }, + "period_at_s0": { + "tokens": 27, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 18, + "mean_set_jaccard": 0.8968253968253969, + "mean_token_weighted_tv": 0.028733923651829914, + "aggregate_load_tv": 0.06172839506172839 + }, + "period_at_s1": { + "tokens": 27, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.8650793650793651, + "mean_token_weighted_tv": 0.03525235169325714, + "aggregate_load_tv": 0.07407407407407407 + } + } + }, + "layer_05": { + "layer": 5, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "7f19cd406681a299cb37ad7472a5f0438a14a2030421f3cd221c13e2dbdfb0fd", + "route_weight_sha256": "6483aa5860c6f4e6363e4c1337d5d03d8b65b4454eabe9b8747697c666a2e610", + "loads": [ + 7, + 5, + 0, + 0, + 2, + 1, + 1, + 1, + 5, + 11, + 0, + 1, + 2, + 4, + 1, + 2, + 3, + 4, + 0, + 1, + 8, + 1, + 0, + 1, + 4, + 2, + 4, + 2, + 1, + 0, + 1, + 6, + 0, + 6, + 3, + 6, + 2, + 5, + 0, + 0, + 0, + 0, + 9, + 2, + 5, + 3, + 1, + 2, + 1, + 1, + 0, + 2, + 7, + 1, + 3, + 0, + 5, + 8, + 0, + 1, + 2, + 1, + 5, + 0 + ], + "weighted_loads": [ + 0.3766142874956131, + 0.4116116277873516, + 0.0, + 0.0, + 0.1539379432797432, + 0.05351864546537399, + 0.042257729917764664, + 0.04479152709245682, + 0.39094867184758186, + 0.9699925221502781, + 0.0, + 0.039361290633678436, + 0.16520071774721146, + 0.2967190407216549, + 0.04889697581529617, + 0.0663163848221302, + 0.2625865861773491, + 0.40447375178337097, + 0.0, + 0.02383301965892315, + 0.5115758925676346, + 0.03179914131760597, + 0.0, + 0.042855098843574524, + 0.32266275957226753, + 0.10308044403791428, + 0.3766361251473427, + 0.13379710912704468, + 0.05251537635922432, + 0.0, + 0.026177698746323586, + 0.44562574103474617, + 0.0, + 0.38083030097186565, + 0.13699186593294144, + 0.5317397899925709, + 0.08409031108021736, + 0.2750052846968174, + 0.0, + 0.0, + 0.0, + 0.0, + 0.794223602861166, + 0.2223917469382286, + 0.33356548845767975, + 0.11262625083327293, + 0.03201936557888985, + 0.07642742060124874, + 0.04137207567691803, + 0.022474657744169235, + 0.0, + 0.11814415454864502, + 1.341554220765829, + 0.05585027486085892, + 0.2576585151255131, + 0.0, + 0.3707483038306236, + 0.8478890992701054, + 0.0, + 0.03810834512114525, + 0.05320345051586628, + 0.0592644102871418, + 0.3083299584686756, + 0.0 + ], + "unique_experts": 49, + "load_cv": 1.0263262281538728, + "normalized_load_entropy": 0.8723898568644611, + "max_load_share": 0.06790123456790123 + }, + "full_input": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "58c74b6a1e6ba831928aae988f75a6de1885780d5b2272c93c3f1250018e0238", + "route_weight_sha256": "d5aaf684fa1279abe635252c327aa8cca566b68e6c0c5e45aa3d5b35998da057", + "loads": [ + 7, + 6, + 0, + 0, + 3, + 3, + 2, + 2, + 6, + 13, + 11, + 1, + 5, + 4, + 1, + 15, + 5, + 11, + 10, + 2, + 10, + 1, + 0, + 1, + 4, + 10, + 4, + 2, + 1, + 1, + 1, + 6, + 0, + 6, + 3, + 10, + 2, + 5, + 11, + 8, + 4, + 8, + 16, + 3, + 6, + 3, + 1, + 4, + 1, + 5, + 7, + 2, + 9, + 10, + 6, + 9, + 5, + 8, + 0, + 2, + 2, + 1, + 5, + 2 + ], + "weighted_loads": [ + 0.3766142874956131, + 0.415123205864802, + 0.0, + 0.0, + 0.1556965239578858, + 0.1215782668441534, + 0.0744154080748558, + 0.04784841067157686, + 0.3943153014406562, + 1.0121433031745255, + 0.6644076257944107, + 0.039361290633678436, + 0.3658664971590042, + 0.2967190407216549, + 0.04889697581529617, + 2.240202763583511, + 0.3909166008234024, + 0.7821029908955097, + 1.0546499527990818, + 0.03691490273922682, + 0.5270403239410371, + 0.03179914131760597, + 0.0, + 0.042855098843574524, + 0.32266275957226753, + 1.0080472640693188, + 0.3766361251473427, + 0.13379710912704468, + 0.05251537635922432, + 0.11398037523031235, + 0.026177698746323586, + 0.44562574103474617, + 0.0, + 0.38083030097186565, + 0.13699186593294144, + 0.8449095971882343, + 0.08409031108021736, + 0.2750052846968174, + 1.1709182262420654, + 0.507312472909689, + 0.17597942054271698, + 0.8779611177742481, + 1.3457131497561932, + 0.33861473202705383, + 0.4151449277997017, + 0.11262625083327293, + 0.03201936557888985, + 0.0944140141364187, + 0.04137207567691803, + 0.21935528609901667, + 0.6669095493853092, + 0.11814415454864502, + 2.9707621298730373, + 0.6537202224135399, + 0.27455641340930015, + 0.6874137297272682, + 0.3707483038306236, + 0.8478890992701054, + 0.0, + 0.08456898853182793, + 0.05320345051586628, + 0.0592644102871418, + 0.3083299584686756, + 0.935757577419281 + ], + "unique_experts": 59, + "load_cv": 0.8031005006854269, + "normalized_load_entropy": 0.9194584506076351, + "max_load_share": 0.05128205128205128 + } + }, + "s1_eos": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "f71e390a389e9b1a6bcddc366b5f7ee03d9bf1cf8035a844d9c10cf8d5cb3d42", + "route_weight_sha256": "7998d7ed75e369edd1d175fbfbca2e7f1fa6313f4f4e5253bb2a8aa5d82995da", + "loads": [ + 7, + 6, + 0, + 0, + 2, + 1, + 1, + 1, + 5, + 11, + 0, + 0, + 2, + 4, + 1, + 2, + 3, + 4, + 0, + 1, + 8, + 1, + 0, + 1, + 4, + 2, + 4, + 2, + 1, + 0, + 1, + 6, + 0, + 6, + 3, + 5, + 2, + 5, + 1, + 1, + 0, + 0, + 8, + 2, + 5, + 3, + 1, + 2, + 1, + 1, + 0, + 2, + 7, + 1, + 3, + 1, + 5, + 8, + 0, + 1, + 1, + 1, + 5, + 0 + ], + "weighted_loads": [ + 0.3674401715397835, + 0.4542296901345253, + 0.0, + 0.0, + 0.15924208983778954, + 0.05380715802311897, + 0.045753832906484604, + 0.04144279658794403, + 0.38744691386818886, + 0.9772480092942715, + 0.0, + 0.0, + 0.16734495759010315, + 0.2989090345799923, + 0.049563176929950714, + 0.07319560647010803, + 0.26475390046834946, + 0.40071358531713486, + 0.0, + 0.026315877214074135, + 0.5124420560896397, + 0.031026296317577362, + 0.0, + 0.04526444524526596, + 0.33772914856672287, + 0.09979690983891487, + 0.39233316108584404, + 0.13721943646669388, + 0.05133294314146042, + 0.0, + 0.02690090425312519, + 0.4359199870377779, + 0.0, + 0.3805820271372795, + 0.13976440206170082, + 0.49593839421868324, + 0.08273223042488098, + 0.27884478121995926, + 0.03539218381047249, + 0.041418734937906265, + 0.0, + 0.0, + 0.7606004029512405, + 0.22191040217876434, + 0.328605480492115, + 0.11425873450934887, + 0.031455449759960175, + 0.07709650509059429, + 0.03971918299794197, + 0.021391423419117928, + 0.0, + 0.11898297071456909, + 1.3643637299537659, + 0.05344395712018013, + 0.2605624794960022, + 0.03522782027721405, + 0.3640896938741207, + 0.8295552581548691, + 0.0, + 0.040251486003398895, + 0.022413166239857674, + 0.04695986583828926, + 0.3128582611680031, + 0.0 + ], + "unique_experts": 51, + "load_cv": 1.004713779639308, + "normalized_load_entropy": 0.8791072694292562, + "max_load_share": 0.06790123456790123 + }, + "full_input": { + "tokens": 68, + "top_k": 6, + "decisions": 408, + "ordered_route_sha256": "d6c47b26ab4e1e92d5ceef01366b99430ddd429fb57ac8b05b1785855615a891", + "route_weight_sha256": "c430f93582960fea9365a1d62ba20b0cc63ef680509c5ac63111f81dd39a5e85", + "loads": [ + 8, + 8, + 0, + 6, + 3, + 3, + 9, + 3, + 6, + 13, + 14, + 3, + 8, + 4, + 2, + 17, + 6, + 16, + 13, + 11, + 10, + 1, + 1, + 1, + 5, + 10, + 4, + 4, + 1, + 2, + 1, + 6, + 1, + 7, + 4, + 9, + 3, + 8, + 13, + 13, + 4, + 13, + 19, + 6, + 6, + 3, + 1, + 5, + 1, + 15, + 9, + 3, + 9, + 11, + 7, + 11, + 5, + 8, + 1, + 2, + 2, + 1, + 5, + 4 + ], + "weighted_loads": [ + 0.4042583517730236, + 0.47799724875949323, + 0.0, + 0.41596338152885437, + 0.16102127742487937, + 0.12776606902480125, + 1.0286832489073277, + 0.0957018113695085, + 0.3907552051823586, + 1.0199674600735307, + 0.8517224807292223, + 0.36506589502096176, + 0.6349859796464443, + 0.2989090345799923, + 0.08423575386404991, + 2.709492893423885, + 0.47995126619935036, + 1.1572580598294735, + 1.4079643934965134, + 0.8661607122048736, + 0.5278251119889319, + 0.031026296317577362, + 0.03812186419963837, + 0.04526444524526596, + 0.4139880985021591, + 0.813345555216074, + 0.39233316108584404, + 0.31146789342164993, + 0.05133294314146042, + 0.15491735935211182, + 0.02690090425312519, + 0.4359199870377779, + 0.1196313127875328, + 0.42288538813591003, + 0.17409197241067886, + 0.9328403510153294, + 0.1283438354730606, + 0.4316473416984081, + 1.34901312738657, + 1.0117689035832882, + 0.16210652887821198, + 1.3036179058253765, + 1.6150930300354958, + 0.5373105108737946, + 0.38969895616173744, + 0.11425873450934887, + 0.031455449759960175, + 0.12830817908979952, + 0.03971918299794197, + 0.8634920055046678, + 1.1113556139171124, + 0.1670122817158699, + 2.993124306201935, + 0.8563776314258575, + 0.3154694412369281, + 0.6533330455422401, + 0.3640896938741207, + 0.8295552581548691, + 0.07041709870100021, + 0.08796010911464691, + 0.06770136393606663, + 0.04695986583828926, + 0.3128582611680031, + 1.1790157817304134 + ], + "unique_experts": 63, + "load_cv": 0.7276068751089989, + "normalized_load_entropy": 0.9350145589187991, + "max_load_share": 0.04656862745098039 + } + }, + "s0_bos": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "4d299434b97b32448090c4e859a02c2f8b01c88489b8a56bf2caa512872ab359", + "route_weight_sha256": "94307fd93f8f3b1254ab067962c27ccb53e3ffea03b99674fb0706d8ea668340", + "loads": [ + 7, + 5, + 0, + 0, + 1, + 1, + 1, + 1, + 5, + 11, + 0, + 1, + 2, + 4, + 1, + 1, + 3, + 4, + 0, + 1, + 8, + 1, + 0, + 1, + 5, + 2, + 4, + 2, + 1, + 0, + 1, + 6, + 0, + 6, + 3, + 6, + 2, + 5, + 1, + 0, + 0, + 0, + 10, + 2, + 5, + 2, + 1, + 2, + 1, + 1, + 0, + 2, + 6, + 1, + 3, + 2, + 5, + 8, + 0, + 1, + 1, + 1, + 5, + 0 + ], + "weighted_loads": [ + 0.3842824772000313, + 0.43444114550948143, + 0.0, + 0.0, + 0.10373445600271225, + 0.056191205978393555, + 0.0437174066901207, + 0.049012646079063416, + 0.41096925362944603, + 0.9671391695737839, + 0.0, + 0.040670037269592285, + 0.15473636984825134, + 0.2927558720111847, + 0.052407752722501755, + 0.03263644501566887, + 0.25614722818136215, + 0.3972662165760994, + 0.0, + 0.030252991244196892, + 0.518714364618063, + 0.03770621493458748, + 0.0, + 0.04295279085636139, + 0.3949584364891052, + 0.09837456792593002, + 0.3693276681005955, + 0.1396474651992321, + 0.04923126846551895, + 0.0, + 0.02527696080505848, + 0.4655949231237173, + 0.0, + 0.38886452838778496, + 0.14141680672764778, + 0.5399027056992054, + 0.060787130147218704, + 0.2639264538884163, + 0.037373390048742294, + 0.0, + 0.0, + 0.0, + 0.8265559282153845, + 0.21628055721521378, + 0.3264796547591686, + 0.08391734212636948, + 0.031001035124063492, + 0.07631774619221687, + 0.03728625550866127, + 0.026322435587644577, + 0.0, + 0.12698550149798393, + 1.3752525635063648, + 0.06105319783091545, + 0.2554123066365719, + 0.06740570440888405, + 0.3663482591509819, + 0.7567750737071037, + 0.0, + 0.03671862557530403, + 0.0341629795730114, + 0.05974534526467323, + 0.2966722548007965, + 0.0 + ], + "unique_experts": 51, + "load_cv": 1.0334299407618492, + "normalized_load_entropy": 0.8750616681215703, + "max_load_share": 0.06790123456790123 + }, + "full_input": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "7c2ad810ff0fbf104dcb40eec8b7b90494588ac1afe111d8f54b918f27943ef4", + "route_weight_sha256": "a78e38fb55075c45e93917962accef54a781134e8404c7b6ffc1c97631650150", + "loads": [ + 7, + 6, + 0, + 0, + 1, + 3, + 3, + 2, + 6, + 12, + 11, + 1, + 5, + 4, + 1, + 15, + 5, + 11, + 9, + 3, + 9, + 1, + 0, + 1, + 5, + 10, + 4, + 2, + 1, + 1, + 1, + 6, + 0, + 6, + 3, + 10, + 2, + 5, + 13, + 8, + 4, + 8, + 18, + 3, + 6, + 2, + 1, + 3, + 1, + 6, + 6, + 2, + 7, + 11, + 5, + 12, + 5, + 8, + 0, + 2, + 1, + 1, + 5, + 2 + ], + "weighted_loads": [ + 0.3842824772000313, + 0.4379527235869318, + 0.0, + 0.0, + 0.10373445600271225, + 0.12425082735717297, + 0.11103861406445503, + 0.052069529658183455, + 0.41433588322252035, + 1.005151268094778, + 0.6891915649175644, + 0.040670037269592285, + 0.34365376085042953, + 0.2927558720111847, + 0.052407752722501755, + 2.2140231668017805, + 0.39968234300613403, + 0.7779532484710217, + 1.0755011551082134, + 0.07889036368578672, + 0.5313027454540133, + 0.03770621493458748, + 0.0, + 0.04295279085636139, + 0.3949584364891052, + 1.0033413879573345, + 0.3693276681005955, + 0.1396474651992321, + 0.04923126846551895, + 0.042000170797109604, + 0.02527696080505848, + 0.4655949231237173, + 0.0, + 0.38886452838778496, + 0.14141680672764778, + 0.8530725128948689, + 0.060787130147218704, + 0.2639264538884163, + 1.304316483438015, + 0.4990720637142658, + 0.17597942054271698, + 0.8813938908278942, + 1.4413802679628134, + 0.3213178962469101, + 0.40805909410119057, + 0.08391734212636948, + 0.031001035124063492, + 0.09191153664141893, + 0.03728625550866127, + 0.2836810117587447, + 0.5989384390413761, + 0.12698550149798393, + 2.0397834964096546, + 0.706012237817049, + 0.27040838939137757, + 0.7513821125030518, + 0.3663482591509819, + 0.7567750737071037, + 0.0, + 0.08317926898598671, + 0.0341629795730114, + 0.05974534526467323, + 0.2966722548007965, + 0.935757577419281 + ], + "unique_experts": 59, + "load_cv": 0.8383478320139393, + "normalized_load_entropy": 0.9144829109828617, + "max_load_share": 0.057692307692307696 + } + }, + "s1_bos": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "2f32df8e4eb4798183b807cd856b004c3930aa992f63e306a4b7c8e6df89ff64", + "route_weight_sha256": "1ccb76a29b69ef482a5983edd41f614a22a8a766a2888036222272fbf7ef352b", + "loads": [ + 6, + 5, + 0, + 0, + 2, + 1, + 1, + 1, + 6, + 11, + 0, + 2, + 2, + 4, + 0, + 2, + 4, + 4, + 0, + 1, + 8, + 2, + 0, + 1, + 5, + 2, + 4, + 2, + 1, + 0, + 1, + 7, + 0, + 6, + 3, + 6, + 1, + 4, + 0, + 1, + 0, + 0, + 10, + 2, + 5, + 2, + 1, + 1, + 1, + 1, + 0, + 2, + 7, + 2, + 3, + 0, + 5, + 7, + 0, + 1, + 0, + 1, + 5, + 0 + ], + "weighted_loads": [ + 0.34334998205304146, + 0.4558517262339592, + 0.0, + 0.0, + 0.15327035263180733, + 0.05758525803685188, + 0.045742832124233246, + 0.046018630266189575, + 0.45466788299381733, + 0.9560257792472839, + 0.0, + 0.07496174797415733, + 0.15954071283340454, + 0.30006884410977364, + 0.0, + 0.0731208585202694, + 0.2924999203532934, + 0.3936798945069313, + 0.0, + 0.03447287529706955, + 0.5259123034775257, + 0.06928496435284615, + 0.0, + 0.04623306915163994, + 0.3949772045016289, + 0.09914691746234894, + 0.3822238966822624, + 0.15190325677394867, + 0.0516837015748024, + 0.0, + 0.026517143473029137, + 0.5150297470390797, + 0.0, + 0.39548606239259243, + 0.1400119513273239, + 0.530369196087122, + 0.023940376937389374, + 0.2255857065320015, + 0.0, + 0.03683958947658539, + 0.0, + 0.0, + 0.8393363077193499, + 0.21205932646989822, + 0.32419272884726524, + 0.08731672167778015, + 0.028190484270453453, + 0.0482553094625473, + 0.035336434841156006, + 0.027592947706580162, + 0.0, + 0.13127870857715607, + 1.399907547980547, + 0.10658850148320198, + 0.25718979164958, + 0.0, + 0.3697868287563324, + 0.7104187794029713, + 0.0, + 0.035698749125003815, + 0.0, + 0.048775676637887955, + 0.3006182983517647, + 0.0 + ], + "unique_experts": 48, + "load_cv": 1.0451621734961416, + "normalized_load_entropy": 0.8675217499551409, + "max_load_share": 0.06790123456790123 + }, + "full_input": { + "tokens": 68, + "top_k": 6, + "decisions": 408, + "ordered_route_sha256": "fd2fc2ef07f36ef35d17e2bb23da87fa7dd8d5def6ab628b1cfb4c788ba2dc82", + "route_weight_sha256": "c8f05c871d892d3e07286c03fa445b119bd0bb3f7f58a824ca8bafe77e2f96e9", + "loads": [ + 7, + 7, + 0, + 6, + 2, + 3, + 10, + 3, + 7, + 12, + 14, + 5, + 8, + 4, + 1, + 18, + 8, + 16, + 14, + 11, + 9, + 2, + 1, + 1, + 6, + 10, + 4, + 4, + 1, + 1, + 1, + 7, + 1, + 7, + 4, + 10, + 2, + 7, + 13, + 12, + 3, + 13, + 22, + 7, + 6, + 2, + 1, + 3, + 1, + 14, + 9, + 3, + 8, + 13, + 6, + 11, + 5, + 7, + 1, + 2, + 1, + 1, + 5, + 5 + ], + "weighted_loads": [ + 0.3801681622862816, + 0.47961928485892713, + 0.0, + 0.41596338152885437, + 0.15327035263180733, + 0.13154416903853416, + 1.0644627138972282, + 0.10027764504775405, + 0.4579761743079871, + 0.9922324940562248, + 0.8634486328810453, + 0.4400276429951191, + 0.6309259757399559, + 0.30006884410977364, + 0.0346725769340992, + 2.778959510382265, + 0.5594408791512251, + 1.1607372425496578, + 1.4428368620574474, + 0.874317710287869, + 0.5385006843134761, + 0.06928496435284615, + 0.03812186419963837, + 0.04623306915163994, + 0.4712361544370651, + 0.8126955628395081, + 0.3822238966822624, + 0.3261517137289047, + 0.0516837015748024, + 0.04931577295064926, + 0.026517143473029137, + 0.5150297470390797, + 0.1196313127875328, + 0.43778942339122295, + 0.17433952167630196, + 0.9672711528837681, + 0.069551981985569, + 0.37838826701045036, + 1.3962439596652985, + 0.9858964160084724, + 0.1274745874106884, + 1.3147240541875362, + 1.7675160486251116, + 0.5487284939736128, + 0.38528620451688766, + 0.08731672167778015, + 0.028190484270453453, + 0.0970133924856782, + 0.035336434841156006, + 0.8392450558021665, + 1.0192969962954521, + 0.17930801957845688, + 2.0644384808838367, + 0.9518436677753925, + 0.3100955404806882, + 0.6365538947284222, + 0.3697868287563324, + 0.7104187794029713, + 0.07041709870100021, + 0.08340737223625183, + 0.045288197696208954, + 0.048775676637887955, + 0.3006182983517647, + 1.228837724775076 + ], + "unique_experts": 63, + "load_cv": 0.7642029517609834, + "normalized_load_entropy": 0.9291790337391573, + "max_load_share": 0.05392156862745098 + } + }, + "s0_x": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "e4c62c0b0e69e2e06e35ce083f426dd2cb40e885023644bba8e8853604cd6f00", + "route_weight_sha256": "55d22b997cf78b96718488b3f77a2285ad9c0e8a6eb5c7acd899a82e1b018c31", + "loads": [ + 7, + 5, + 0, + 0, + 2, + 1, + 1, + 1, + 6, + 12, + 0, + 1, + 2, + 4, + 1, + 2, + 3, + 4, + 0, + 1, + 8, + 2, + 0, + 1, + 5, + 2, + 4, + 2, + 1, + 0, + 1, + 6, + 0, + 6, + 3, + 6, + 1, + 5, + 0, + 1, + 0, + 0, + 9, + 2, + 5, + 2, + 1, + 1, + 1, + 1, + 0, + 2, + 7, + 1, + 3, + 1, + 5, + 7, + 0, + 1, + 0, + 1, + 5, + 0 + ], + "weighted_loads": [ + 0.3781880736351013, + 0.45166589319705963, + 0.0, + 0.0, + 0.13716769963502884, + 0.05975572019815445, + 0.042376141995191574, + 0.03905085101723671, + 0.42129075713455677, + 0.9593977574259043, + 0.0, + 0.03927231952548027, + 0.1574508249759674, + 0.2828495018184185, + 0.04978008195757866, + 0.07314502820372581, + 0.25763344019651413, + 0.40647492557764053, + 0.0, + 0.02956479974091053, + 0.5294156111776829, + 0.06852724403142929, + 0.0, + 0.04134223610162735, + 0.3884437792003155, + 0.09667618572711945, + 0.36003006994724274, + 0.1433824636042118, + 0.046811655163764954, + 0.0, + 0.025603143498301506, + 0.4717929344624281, + 0.0, + 0.3801434338092804, + 0.14256611466407776, + 0.5440567284822464, + 0.024201249703764915, + 0.26247162371873856, + 0.0, + 0.04075092449784279, + 0.0, + 0.0, + 0.7804387416690588, + 0.2063407525420189, + 0.3205242268741131, + 0.08417348936200142, + 0.031950943171978, + 0.04733732342720032, + 0.03656931221485138, + 0.02497539110481739, + 0.0, + 0.12318063899874687, + 1.4048889763653278, + 0.059543903917074203, + 0.2538742907345295, + 0.03699825331568718, + 0.36623668670654297, + 0.7122376561164856, + 0.0, + 0.03669346868991852, + 0.0, + 0.051694389432668686, + 0.29473876953125, + 0.0 + ], + "unique_experts": 50, + "load_cv": 1.047492851620481, + "normalized_load_entropy": 0.8709781550535451, + "max_load_share": 0.07407407407407407 + }, + "full_input": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "02e9b621153ef1a4fd98ff866538c72557612f677bfd3851429d20874026d982", + "route_weight_sha256": "a75c11fe991e0434477de06f1a7a87794be363270a5cfcb14b8617df06dcea9d", + "loads": [ + 7, + 7, + 0, + 0, + 2, + 3, + 2, + 2, + 7, + 12, + 12, + 1, + 5, + 4, + 1, + 16, + 5, + 11, + 10, + 3, + 9, + 2, + 0, + 1, + 5, + 11, + 4, + 2, + 1, + 1, + 1, + 6, + 0, + 6, + 3, + 10, + 1, + 5, + 10, + 8, + 6, + 8, + 16, + 3, + 6, + 2, + 1, + 2, + 1, + 4, + 6, + 2, + 8, + 13, + 5, + 11, + 5, + 7, + 0, + 2, + 0, + 1, + 5, + 2 + ], + "weighted_loads": [ + 0.3781880736351013, + 0.4919836411718279, + 0.0, + 0.0, + 0.13716769963502884, + 0.12781534157693386, + 0.07453382015228271, + 0.04210773459635675, + 0.4246573867276311, + 0.9593977574259043, + 0.8052099943161011, + 0.03927231952548027, + 0.3654351159930229, + 0.2828495018184185, + 0.04978008195757866, + 2.4305415763519704, + 0.3968080207705498, + 0.7838455699384212, + 0.9787991121411324, + 0.07842330541461706, + 0.5420039920136333, + 0.06852724403142929, + 0.0, + 0.04134223610162735, + 0.3884437792003155, + 1.0866133086383343, + 0.36003006994724274, + 0.1433824636042118, + 0.046811655163764954, + 0.03321709856390953, + 0.025603143498301506, + 0.4717929344624281, + 0.0, + 0.3801434338092804, + 0.14256611466407776, + 0.8572265356779099, + 0.024201249703764915, + 0.26247162371873856, + 0.9493802823126316, + 0.5265807136893272, + 0.291854165494442, + 0.8192437179386616, + 1.308237025514245, + 0.3240508511662483, + 0.402103666216135, + 0.08417348936200142, + 0.031950943171978, + 0.06293111387640238, + 0.03656931221485138, + 0.19187644589692354, + 0.5581812858581543, + 0.12318063899874687, + 2.0694199092686176, + 0.8082562200725079, + 0.2688703734893352, + 0.8012177757918835, + 0.36623668670654297, + 0.7122376561164856, + 0.0, + 0.0831541121006012, + 0.0, + 0.051694389432668686, + 0.29473876953125, + 0.935757577419281 + ], + "unique_experts": 58, + "load_cv": 0.8383478320139393, + "normalized_load_entropy": 0.9124521466283589, + "max_load_share": 0.05128205128205128 + } + }, + "s1_x": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "2025149cc3b60d7f99154c96fc8a4a9035739070ba8380452b18e55791baf244", + "route_weight_sha256": "5258ad716f20c64b1774ce226a06cc194520730962a73b2020b9468f4f91ce21", + "loads": [ + 6, + 5, + 0, + 0, + 2, + 1, + 1, + 1, + 7, + 11, + 0, + 2, + 2, + 4, + 0, + 2, + 3, + 4, + 0, + 2, + 8, + 2, + 0, + 1, + 5, + 2, + 4, + 2, + 1, + 0, + 1, + 7, + 0, + 6, + 3, + 6, + 0, + 4, + 0, + 1, + 0, + 0, + 9, + 2, + 5, + 2, + 1, + 1, + 1, + 1, + 0, + 2, + 7, + 2, + 3, + 0, + 5, + 8, + 0, + 0, + 1, + 1, + 5, + 0 + ], + "weighted_loads": [ + 0.34514739364385605, + 0.47069747000932693, + 0.0, + 0.0, + 0.1486215740442276, + 0.0586685873568058, + 0.043093081563711166, + 0.03564135730266571, + 0.4843542445451021, + 0.9214184395968914, + 0.0, + 0.07328499481081963, + 0.15648677200078964, + 0.2937300130724907, + 0.0, + 0.0810306966304779, + 0.2575606666505337, + 0.40057653933763504, + 0.0, + 0.06262665241956711, + 0.5321186073124409, + 0.06778175756335258, + 0.0, + 0.04475007578730583, + 0.3964472748339176, + 0.09981988370418549, + 0.36877238005399704, + 0.1547442302107811, + 0.05122408643364906, + 0.0, + 0.027127843350172043, + 0.5484156794846058, + 0.0, + 0.39158713072538376, + 0.14883994683623314, + 0.5260736681520939, + 0.0, + 0.22537236288189888, + 0.0, + 0.051279664039611816, + 0.0, + 0.0, + 0.7985515706241131, + 0.19856039434671402, + 0.3257032595574856, + 0.08904080837965012, + 0.027748953551054, + 0.0485997311770916, + 0.03697110712528229, + 0.02261948399245739, + 0.0, + 0.1293676197528839, + 1.392219178378582, + 0.10673870891332626, + 0.24804917350411415, + 0.0, + 0.3682408891618252, + 0.7069670651108027, + 0.0, + 0.0, + 0.02369949221611023, + 0.039429064840078354, + 0.29689527302980423, + 0.0 + ], + "unique_experts": 47, + "load_cv": 1.0498183554714762, + "normalized_load_entropy": 0.864892988060137, + "max_load_share": 0.06790123456790123 + }, + "full_input": { + "tokens": 68, + "top_k": 6, + "decisions": 408, + "ordered_route_sha256": "956282a32d8947c97b3d73b68a7b5aea1964474d781585cddef3c3434a58df4b", + "route_weight_sha256": "d417b3856e28f197e46e64d1f5a2c739ef8956fc840067e5e6f1cd44ee37c516", + "loads": [ + 7, + 7, + 0, + 6, + 2, + 3, + 9, + 3, + 8, + 12, + 15, + 5, + 8, + 4, + 1, + 18, + 7, + 16, + 14, + 12, + 9, + 2, + 1, + 1, + 6, + 11, + 4, + 4, + 1, + 1, + 1, + 7, + 1, + 8, + 4, + 11, + 1, + 7, + 10, + 12, + 4, + 12, + 20, + 7, + 6, + 2, + 1, + 3, + 1, + 14, + 8, + 3, + 8, + 15, + 6, + 11, + 5, + 8, + 1, + 1, + 2, + 2, + 5, + 4 + ], + "weighted_loads": [ + 0.3819655738770962, + 0.49446502863429487, + 0.0, + 0.41596338152885437, + 0.1486215740442276, + 0.13262749835848808, + 1.0260224975645542, + 0.08990037208423018, + 0.4876625358592719, + 0.956778809428215, + 0.969385826960206, + 0.4383508898317814, + 0.6456979401409626, + 0.2937300130724907, + 0.0346725769340992, + 2.9739326699636877, + 0.5328235477209091, + 1.1719108559191227, + 1.2656127288937569, + 0.9024714874103665, + 0.5447069881483912, + 0.06778175756335258, + 0.03812186419963837, + 0.04475007578730583, + 0.47270622476935387, + 0.8913132175803185, + 0.36877238005399704, + 0.32899268716573715, + 0.05122408643364906, + 0.04931577295064926, + 0.027127843350172043, + 0.5484156794846058, + 0.1196313127875328, + 0.4784501902759075, + 0.18316751718521118, + 1.0090487003326416, + 0.045611605048179626, + 0.37817492336034775, + 1.024663370102644, + 1.036683987826109, + 0.20122907683253288, + 1.2114822305738926, + 1.6196786724030972, + 0.5418753419071436, + 0.386796735227108, + 0.08904080837965012, + 0.027748953551054, + 0.09735781420022249, + 0.03697110712528229, + 0.8209948288276792, + 0.9462113752961159, + 0.17739693075418472, + 2.056750111281872, + 1.0624398551881313, + 0.30095492233522236, + 0.7123828679323196, + 0.3682408891618252, + 0.7069670651108027, + 0.07041709870100021, + 0.047708623111248016, + 0.06898768991231918, + 0.07516873627901077, + 0.29689527302980423, + 1.1790157817304134 + ], + "unique_experts": 63, + "load_cv": 0.7550929221164591, + "normalized_load_entropy": 0.930035056909567, + "max_load_share": 0.049019607843137254 + } + }, + "s0_period": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "3b10202c24864534a4beafaced3d5931e7afabc11fb2890c33747f1e3284a8c6", + "route_weight_sha256": "e0768fe0029476f5648bff6c48e52166716fb133698f7fa6383f84425f4cca84", + "loads": [ + 6, + 5, + 0, + 0, + 1, + 1, + 1, + 1, + 6, + 11, + 0, + 1, + 2, + 4, + 1, + 2, + 3, + 4, + 0, + 1, + 8, + 1, + 0, + 1, + 5, + 2, + 3, + 2, + 1, + 0, + 1, + 7, + 0, + 6, + 3, + 6, + 2, + 5, + 1, + 1, + 0, + 0, + 10, + 2, + 6, + 1, + 1, + 1, + 1, + 1, + 0, + 2, + 6, + 1, + 3, + 1, + 5, + 8, + 0, + 1, + 0, + 2, + 5, + 0 + ], + "weighted_loads": [ + 0.34763137996196747, + 0.45746036618947983, + 0.0, + 0.0, + 0.10548193752765656, + 0.05728090927004814, + 0.04694113880395889, + 0.035201553255319595, + 0.4203895479440689, + 0.927794273942709, + 0.0, + 0.03408077359199524, + 0.15798286348581314, + 0.27726395800709724, + 0.04757756367325783, + 0.07455215230584145, + 0.2577679567039013, + 0.4007489010691643, + 0.0, + 0.030535994097590446, + 0.5199827663600445, + 0.031903862953186035, + 0.0, + 0.04206344112753868, + 0.3894185274839401, + 0.09595552086830139, + 0.3134435713291168, + 0.14390947297215462, + 0.04638275131583214, + 0.0, + 0.025553766638040543, + 0.5299315899610519, + 0.0, + 0.3780065141618252, + 0.1417790688574314, + 0.5336370803415775, + 0.0581677220761776, + 0.2634744569659233, + 0.033331360667943954, + 0.04461889714002609, + 0.0, + 0.0, + 0.8232025355100632, + 0.20496738702058792, + 0.354573342949152, + 0.0507851243019104, + 0.031762830913066864, + 0.046914707869291306, + 0.03581039980053902, + 0.029323339462280273, + 0.0, + 0.12442603707313538, + 1.3728342093527317, + 0.05987151712179184, + 0.2531353160738945, + 0.03758285194635391, + 0.37195729836821556, + 0.738875376060605, + 0.0, + 0.03710491210222244, + 0.0, + 0.09088046103715897, + 0.29496295750141144, + 0.0 + ], + "unique_experts": 51, + "load_cv": 1.047492851620481, + "normalized_load_entropy": 0.8724329062265664, + "max_load_share": 0.06790123456790123 + }, + "full_input": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "dfb4ceea1178964fa69efd2930033e4ee01b8b894e62ebff59ea021643dd8b32", + "route_weight_sha256": "ca53a809ea4178025c98bfc2e9b4fd33c3030250e559da87313b364dd4b9ea16", + "loads": [ + 6, + 7, + 0, + 0, + 1, + 3, + 2, + 2, + 7, + 12, + 12, + 1, + 5, + 4, + 1, + 16, + 5, + 12, + 10, + 2, + 9, + 1, + 0, + 1, + 5, + 10, + 3, + 2, + 1, + 1, + 1, + 7, + 0, + 6, + 3, + 11, + 2, + 5, + 11, + 8, + 6, + 8, + 17, + 3, + 8, + 1, + 1, + 2, + 1, + 4, + 6, + 2, + 7, + 11, + 5, + 11, + 5, + 8, + 0, + 2, + 0, + 2, + 5, + 2 + ], + "weighted_loads": [ + 0.34763137996196747, + 0.4989200870040804, + 0.0, + 0.0, + 0.10548193752765656, + 0.12534053064882755, + 0.07909881696105003, + 0.038258436834439635, + 0.42375617753714323, + 0.9636900350451469, + 0.7916887700557709, + 0.03408077359199524, + 0.3680679090321064, + 0.27726395800709724, + 0.04757756367325783, + 2.2622908069752157, + 0.3961730860173702, + 0.8368116095662117, + 0.9035142250359058, + 0.043617877177894115, + 0.5325711471959949, + 0.031903862953186035, + 0.0, + 0.04206344112753868, + 0.3894185274839401, + 1.0009223408997059, + 0.3134435713291168, + 0.14390947297215462, + 0.04638275131583214, + 0.03398049622774124, + 0.025553766638040543, + 0.5299315899610519, + 0.0, + 0.3780065141618252, + 0.1417790688574314, + 0.8930816948413849, + 0.0581677220761776, + 0.2634744569659233, + 0.946882888674736, + 0.5359757617115974, + 0.27196553722023964, + 0.8530954979360104, + 1.3453162647783756, + 0.3206092566251755, + 0.48903659358620644, + 0.0507851243019104, + 0.031762830913066864, + 0.06250849831849337, + 0.03581039980053902, + 0.18918396811932325, + 0.5623872764408588, + 0.12442603707313538, + 2.0373651422560215, + 0.6959238946437836, + 0.2681313988287002, + 0.9311173856258392, + 0.37195729836821556, + 0.738875376060605, + 0.0, + 0.08356555551290512, + 0.0, + 0.09088046103715897, + 0.29496295750141144, + 0.935757577419281 + ], + "unique_experts": 58, + "load_cv": 0.8546581185896901, + "normalized_load_entropy": 0.9093937097555571, + "max_load_share": 0.05448717948717949 + } + }, + "s1_period": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "2e9492330de866e83ae695791b97b93aab30b5315785faa451d4d99d12d4b0cc", + "route_weight_sha256": "925a02fd0763803124d36d1a6fe34b4f07aff1e1e071f8c93d4e89dbf0c3362f", + "loads": [ + 6, + 5, + 0, + 0, + 2, + 1, + 1, + 0, + 6, + 11, + 0, + 2, + 2, + 4, + 1, + 2, + 4, + 4, + 1, + 2, + 8, + 1, + 0, + 1, + 5, + 2, + 4, + 2, + 1, + 0, + 1, + 7, + 0, + 6, + 3, + 6, + 1, + 4, + 0, + 1, + 0, + 0, + 9, + 2, + 5, + 2, + 1, + 1, + 1, + 1, + 0, + 2, + 7, + 1, + 3, + 0, + 5, + 7, + 0, + 1, + 1, + 1, + 5, + 0 + ], + "weighted_loads": [ + 0.3482845425605774, + 0.4682403430342674, + 0.0, + 0.0, + 0.14930104464292526, + 0.05807507783174515, + 0.045431867241859436, + 0.0, + 0.4463203251361847, + 0.9182296171784401, + 0.0, + 0.07017413154244423, + 0.15952365100383759, + 0.2984575517475605, + 0.047121867537498474, + 0.08452959731221199, + 0.28866877034306526, + 0.393806554377079, + 0.03252047672867775, + 0.06430123746395111, + 0.5271896459162235, + 0.034513939172029495, + 0.0, + 0.04419853910803795, + 0.40172095596790314, + 0.10142591595649719, + 0.37696758657693863, + 0.15524142235517502, + 0.050956133753061295, + 0.0, + 0.02564547210931778, + 0.5520592611283064, + 0.0, + 0.3959210216999054, + 0.14989937469363213, + 0.5124933794140816, + 0.03463714197278023, + 0.22682272270321846, + 0.0, + 0.05977236106991768, + 0.0, + 0.0, + 0.8183289282023907, + 0.19871637970209122, + 0.333149965852499, + 0.08772995322942734, + 0.028159119188785553, + 0.048507049679756165, + 0.03612091764807701, + 0.028369810432195663, + 0.0, + 0.12946007028222084, + 1.3808330073952675, + 0.05834227427840233, + 0.24460091814398766, + 0.0, + 0.3788241967558861, + 0.6748714856803417, + 0.0, + 0.03619459643959999, + 0.02247849851846695, + 0.035162363201379776, + 0.29533878341317177, + 0.0 + ], + "unique_experts": 50, + "load_cv": 1.0215629770204575, + "normalized_load_entropy": 0.87440442067108, + "max_load_share": 0.06790123456790123 + }, + "full_input": { + "tokens": 68, + "top_k": 6, + "decisions": 408, + "ordered_route_sha256": "c4ec758dba47babb2fcd8bc1c809eab0b26cd3bea9213889df9d52470c4b3973", + "route_weight_sha256": "7ec91e7bdf0c5e57afda18d7d20dfebef1fdada85bdb0e1f14fa40f6f95f316d", + "loads": [ + 7, + 7, + 0, + 6, + 2, + 4, + 9, + 2, + 7, + 12, + 15, + 5, + 8, + 4, + 2, + 19, + 8, + 17, + 14, + 12, + 9, + 1, + 1, + 1, + 6, + 10, + 4, + 4, + 1, + 1, + 1, + 7, + 1, + 7, + 4, + 11, + 2, + 7, + 10, + 12, + 4, + 14, + 20, + 6, + 7, + 2, + 1, + 3, + 1, + 14, + 8, + 3, + 8, + 12, + 6, + 11, + 5, + 7, + 1, + 2, + 2, + 2, + 5, + 4 + ], + "weighted_loads": [ + 0.3851027227938175, + 0.49200790165923536, + 0.0, + 0.41596338152885437, + 0.14930104464292526, + 0.17605381086468697, + 1.0283612832427025, + 0.054259014781564474, + 0.44962861645035446, + 0.9542028196156025, + 0.980805279687047, + 0.435240026563406, + 0.6406945697963238, + 0.2984575517475605, + 0.08179444447159767, + 2.8563873819075525, + 0.5837890319526196, + 1.2071841284632683, + 1.2259655185043812, + 0.9041460724547505, + 0.5397780267521739, + 0.034513939172029495, + 0.03812186419963837, + 0.04419853910803795, + 0.4779799059033394, + 0.8149745613336563, + 0.37696758657693863, + 0.3294898793101311, + 0.050956133753061295, + 0.04931577295064926, + 0.02564547210931778, + 0.5520592611283064, + 0.1196313127875328, + 0.4382243826985359, + 0.18422694504261017, + 1.0306727513670921, + 0.08024874702095985, + 0.37962528318166733, + 0.986940898001194, + 1.0487043634057045, + 0.17826110124588013, + 1.3562832735478878, + 1.6484873332083225, + 0.4975193440914154, + 0.43921293318271637, + 0.08772995322942734, + 0.028159119188785553, + 0.09726513270288706, + 0.03612091764807701, + 0.820339354686439, + 0.9432240687310696, + 0.17748938128352165, + 2.0453639402985573, + 0.9057483412325382, + 0.29750666697509587, + 0.7994013875722885, + 0.3788241967558861, + 0.6748714856803417, + 0.07041709870100021, + 0.08390321955084801, + 0.0677666962146759, + 0.07237302511930466, + 0.29533878341317177, + 1.1790157817304134 + ], + "unique_experts": 63, + "load_cv": 0.7545835845056414, + "normalized_load_entropy": 0.9313433992078743, + "max_load_share": 0.049019607843137254 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 27, + "ordered_topk_exact_tokens": 17, + "set_exact_tokens": 23, + "mean_set_jaccard": 0.9576719576719577, + "mean_token_weighted_tv": 0.010914973845636403, + "aggregate_load_tv": 0.024691358024691357 + }, + "system_bos": { + "tokens": 27, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.8862433862433863, + "mean_token_weighted_tv": 0.022794819298993657, + "aggregate_load_tv": 0.06172839506172839 + }, + "system_x": { + "tokens": 27, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.9153439153439153, + "mean_token_weighted_tv": 0.020883985726093804, + "aggregate_load_tv": 0.043209876543209874 + }, + "system_period": { + "tokens": 27, + "ordered_topk_exact_tokens": 17, + "set_exact_tokens": 18, + "mean_set_jaccard": 0.8968253968253969, + "mean_token_weighted_tv": 0.023167564809598303, + "aggregate_load_tv": 0.05555555555555555 + }, + "bos_at_s0": { + "tokens": 27, + "ordered_topk_exact_tokens": 17, + "set_exact_tokens": 20, + "mean_set_jaccard": 0.9259259259259259, + "mean_token_weighted_tv": 0.02100018912029487, + "aggregate_load_tv": 0.030864197530864196 + }, + "bos_at_s1": { + "tokens": 27, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.873015873015873, + "mean_token_weighted_tv": 0.02959333118741159, + "aggregate_load_tv": 0.06790123456790123 + }, + "x_at_s0": { + "tokens": 27, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.9153439153439153, + "mean_token_weighted_tv": 0.023663921523149365, + "aggregate_load_tv": 0.037037037037037035 + }, + "x_at_s1": { + "tokens": 27, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.8835978835978837, + "mean_token_weighted_tv": 0.032175897103216916, + "aggregate_load_tv": 0.06790123456790123 + }, + "period_at_s0": { + "tokens": 27, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.8835978835978836, + "mean_token_weighted_tv": 0.029628859522442024, + "aggregate_load_tv": 0.05555555555555555 + }, + "period_at_s1": { + "tokens": 27, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.8941798941798942, + "mean_token_weighted_tv": 0.03105072842703925, + "aggregate_load_tv": 0.06172839506172839 + } + } + }, + "layer_06": { + "layer": 6, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "34f40ed467a358c86e5bd2a1be0806ce9604fc2093480013ff56e163c72d4496", + "route_weight_sha256": "5e3eb13ed9848629f3888b8e5f3c5e92ddcf1f2b3747849ec37204f16fab8542", + "loads": [ + 0, + 7, + 2, + 2, + 0, + 1, + 2, + 0, + 5, + 0, + 1, + 2, + 2, + 10, + 0, + 3, + 2, + 0, + 3, + 2, + 0, + 8, + 10, + 1, + 1, + 2, + 7, + 7, + 1, + 3, + 1, + 1, + 4, + 3, + 3, + 0, + 2, + 0, + 3, + 0, + 1, + 7, + 1, + 9, + 0, + 9, + 1, + 2, + 2, + 0, + 0, + 0, + 2, + 0, + 4, + 0, + 3, + 0, + 5, + 1, + 4, + 1, + 4, + 5 + ], + "weighted_loads": [ + 0.0, + 0.409338790923357, + 0.2087402492761612, + 0.09913331270217896, + 0.0, + 0.08879844099283218, + 0.14335915073752403, + 0.0, + 0.38362952321767807, + 0.0, + 0.04295143112540245, + 0.08126948401331902, + 0.21588705480098724, + 0.8152460381388664, + 0.0, + 0.32601092755794525, + 0.22438915073871613, + 0.0, + 0.24995074421167374, + 0.12383361160755157, + 0.0, + 0.7255902290344238, + 1.4317779205739498, + 0.03344079852104187, + 0.03367563337087631, + 0.1196434274315834, + 0.5941967852413654, + 0.44708234816789627, + 0.06262251734733582, + 0.20301875472068787, + 0.03757064417004585, + 0.04085260629653931, + 0.34714433923363686, + 0.36420557275414467, + 0.2806888222694397, + 0.0, + 0.1175212636590004, + 0.0, + 0.17778337001800537, + 0.0, + 0.0901394858956337, + 0.5346832759678364, + 0.038619380444288254, + 0.6844962313771248, + 0.0, + 0.8121965080499649, + 0.03450416028499603, + 0.13614778220653534, + 0.0727696605026722, + 0.0, + 0.0, + 0.0, + 0.12984394282102585, + 0.0, + 0.25561239942908287, + 0.0, + 0.19464696943759918, + 0.0, + 0.39247266203165054, + 0.058023601770401, + 0.21387888118624687, + 0.05541582405567169, + 0.2148217260837555, + 0.5387558341026306 + ], + "unique_experts": 47, + "load_cv": 1.0750669456652184, + "normalized_load_entropy": 0.863003515213511, + "max_load_share": 0.06172839506172839 + }, + "full_input": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "92e4aa1b7d9d8be10038095e6dd3bdfc04a98f81708a1d277de62f07b1e7cf00", + "route_weight_sha256": "da22bbd0d1e53c4d13c71b51914ef8e089b8d342c9525b6e4be2c61bec12f7be", + "loads": [ + 0, + 11, + 2, + 2, + 1, + 1, + 10, + 0, + 5, + 0, + 1, + 8, + 3, + 12, + 1, + 3, + 7, + 1, + 4, + 10, + 1, + 11, + 12, + 2, + 1, + 3, + 7, + 7, + 1, + 6, + 1, + 1, + 8, + 3, + 4, + 6, + 2, + 7, + 3, + 9, + 1, + 12, + 3, + 9, + 0, + 14, + 14, + 4, + 6, + 0, + 7, + 7, + 2, + 0, + 4, + 10, + 13, + 0, + 5, + 10, + 4, + 1, + 4, + 5 + ], + "weighted_loads": [ + 0.0, + 0.5293231583200395, + 0.2087402492761612, + 0.09913331270217896, + 0.02850438840687275, + 0.08879844099283218, + 1.0050695315003395, + 0.0, + 0.38362952321767807, + 0.0, + 0.04295143112540245, + 0.4324360154569149, + 0.27490438148379326, + 0.8432535408064723, + 0.07740773260593414, + 0.32601092755794525, + 0.5964954867959023, + 0.004042740911245346, + 0.3708081394433975, + 0.6148385368287563, + 0.043848611414432526, + 0.9001765362918377, + 2.927537765353918, + 0.06915939226746559, + 0.03367563337087631, + 0.1476280763745308, + 0.5941967852413654, + 0.44708234816789627, + 0.06262251734733582, + 0.38697971031069756, + 0.03757064417004585, + 0.04085260629653931, + 0.5015050452202559, + 0.36420557275414467, + 0.31542273610830307, + 0.5440139546990395, + 0.1175212636590004, + 0.6131276078522205, + 0.17778337001800537, + 0.3631064146757126, + 0.0901394858956337, + 0.9336214363574982, + 0.09648758918046951, + 0.6844962313771248, + 0.0, + 0.9469417659565806, + 1.6857764422893524, + 0.15844132122583687, + 0.27533031813800335, + 0.0, + 0.3997744396328926, + 0.3056480176746845, + 0.12984394282102585, + 0.0, + 0.25561239942908287, + 0.7637483216822147, + 1.5342635102570057, + 0.0, + 0.39247266203165054, + 1.016283381730318, + 0.21387888118624687, + 0.05541582405567169, + 0.2148217260837555, + 0.5387558341026306 + ], + "unique_experts": 57, + "load_cv": 0.8359918147128772, + "normalized_load_entropy": 0.9088864532577162, + "max_load_share": 0.04487179487179487 + } + }, + "s1_eos": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "96a2ccdf77b149072aa546203f95c65fc9d227dc774462758ba41a43fff3a4fe", + "route_weight_sha256": "481c73e89e4a4aaa4aa110f741e534a02bb455478ac9d86f479849d6cad8a3f6", + "loads": [ + 0, + 7, + 3, + 2, + 0, + 1, + 2, + 0, + 5, + 0, + 0, + 2, + 2, + 10, + 0, + 3, + 2, + 0, + 3, + 2, + 0, + 8, + 10, + 1, + 1, + 2, + 8, + 7, + 1, + 3, + 1, + 1, + 4, + 3, + 3, + 0, + 2, + 0, + 3, + 0, + 1, + 7, + 1, + 9, + 0, + 9, + 1, + 2, + 1, + 1, + 0, + 0, + 1, + 0, + 4, + 0, + 3, + 0, + 5, + 1, + 4, + 1, + 4, + 5 + ], + "weighted_loads": [ + 0.0, + 0.4141009449958801, + 0.25117596611380577, + 0.09802721813321114, + 0.0, + 0.08893287926912308, + 0.1300196275115013, + 0.0, + 0.38591908663511276, + 0.0, + 0.0, + 0.09337461739778519, + 0.21607139706611633, + 0.8058689869940281, + 0.0, + 0.3194582499563694, + 0.22518222779035568, + 0.0, + 0.25284532830119133, + 0.122812420129776, + 0.0, + 0.7169743739068508, + 1.4277020748704672, + 0.03343190625309944, + 0.03274356946349144, + 0.12106238678097725, + 0.6222975812852383, + 0.44810814037919044, + 0.06397037208080292, + 0.20579145848751068, + 0.04673284664750099, + 0.043160464614629745, + 0.3562048636376858, + 0.3692959360778332, + 0.276782862842083, + 0.0, + 0.117409847676754, + 0.0, + 0.1856789067387581, + 0.0, + 0.08895692229270935, + 0.5277285650372505, + 0.037887994199991226, + 0.6815259456634521, + 0.0, + 0.7931464612483978, + 0.03625214472413063, + 0.13842631503939629, + 0.040886733680963516, + 0.04954243823885918, + 0.0, + 0.0, + 0.08226629346609116, + 0.0, + 0.25156934186816216, + 0.0, + 0.20085416734218597, + 0.0, + 0.39398879930377007, + 0.05491407960653305, + 0.21087199449539185, + 0.05357920378446579, + 0.21625887230038643, + 0.5314295589923859 + ], + "unique_experts": 47, + "load_cv": 1.0908299934837404, + "normalized_load_entropy": 0.8598107137240459, + "max_load_share": 0.06172839506172839 + }, + "full_input": { + "tokens": 68, + "top_k": 6, + "decisions": 408, + "ordered_route_sha256": "7a15d0078bde3c23c432c03a3cb11c2228e8e486c7d151153e08180bc89b13e1", + "route_weight_sha256": "388c5cc50221a2c26246f9eb4cb638a58113a9a36705cfdd902b1d0eb601faf6", + "loads": [ + 0, + 10, + 6, + 3, + 2, + 1, + 16, + 1, + 10, + 6, + 0, + 12, + 7, + 12, + 8, + 4, + 12, + 1, + 6, + 12, + 2, + 12, + 12, + 2, + 2, + 4, + 8, + 8, + 2, + 6, + 1, + 4, + 11, + 4, + 7, + 8, + 3, + 15, + 3, + 9, + 1, + 13, + 3, + 9, + 1, + 13, + 17, + 4, + 4, + 1, + 8, + 6, + 2, + 3, + 4, + 11, + 20, + 0, + 5, + 12, + 9, + 1, + 4, + 5 + ], + "weighted_loads": [ + 0.0, + 0.505158903542906, + 0.39441440626978874, + 0.13531845435500145, + 0.15162651427090168, + 0.08893287926912308, + 1.3597913086414337, + 0.06110488995909691, + 0.724361278116703, + 0.7035647481679916, + 0.0, + 0.7066498920321465, + 0.6049910932779312, + 0.8341560200788081, + 0.6141643859446049, + 0.4300007186830044, + 1.009601779282093, + 0.004071946721524, + 0.5241477303206921, + 0.8234144784510136, + 0.09283514320850372, + 0.9682094678282738, + 2.921326344832778, + 0.06872851774096489, + 0.06532648950815201, + 0.19911843538284302, + 0.6222975812852383, + 0.4744587913155556, + 0.10109508037567139, + 0.41311536729335785, + 0.04673284664750099, + 0.24248550459742546, + 0.6122541781514883, + 0.4028843268752098, + 0.5352637059986591, + 0.7677590996026993, + 0.15163236483931541, + 1.190916944295168, + 0.1856789067387581, + 0.4731190353631973, + 0.08895692229270935, + 0.968361858278513, + 0.09586247429251671, + 0.6815259456634521, + 0.08486327528953552, + 0.8920643178280443, + 2.0209077149629593, + 0.1607729410752654, + 0.20787116885185242, + 0.04954243823885918, + 0.48675697296857834, + 0.23899152129888535, + 0.1190837025642395, + 0.16863584518432617, + 0.25156934186816216, + 1.0094880051910877, + 2.1941622644662857, + 0.0, + 0.39398879930377007, + 1.1079434920102358, + 0.47520384192466736, + 0.05357920378446579, + 0.21625887230038643, + 0.5314295589923859 + ], + "unique_experts": 61, + "load_cv": 0.7474164138253301, + "normalized_load_entropy": 0.9291229055237549, + "max_load_share": 0.049019607843137254 + } + }, + "s0_bos": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "7f9f73d567bfdabc9473749ac2f0bbc7b1fd76a723de3af092dea26a35ca51f9", + "route_weight_sha256": "f435de875bdeb46bc2555132e199f45c8e930ea13fd3edd50ede03797eb3a9e6", + "loads": [ + 0, + 6, + 3, + 2, + 0, + 1, + 2, + 0, + 4, + 0, + 0, + 2, + 2, + 11, + 0, + 3, + 2, + 0, + 3, + 2, + 0, + 8, + 10, + 0, + 1, + 2, + 9, + 7, + 1, + 3, + 1, + 1, + 4, + 4, + 3, + 0, + 2, + 0, + 4, + 0, + 1, + 6, + 1, + 10, + 0, + 9, + 0, + 2, + 1, + 1, + 0, + 0, + 1, + 0, + 4, + 0, + 3, + 0, + 5, + 1, + 4, + 1, + 4, + 5 + ], + "weighted_loads": [ + 0.0, + 0.40700896456837654, + 0.24080343544483185, + 0.10103344544768333, + 0.0, + 0.08631405979394913, + 0.14052439108490944, + 0.0, + 0.32737303152680397, + 0.0, + 0.0, + 0.07896814122796059, + 0.22317273914813995, + 0.8559564873576164, + 0.0, + 0.32973552495241165, + 0.22876779735088348, + 0.0, + 0.25279010087251663, + 0.13451310992240906, + 0.0, + 0.7334602326154709, + 1.496019460260868, + 0.0, + 0.03332866355776787, + 0.1250075213611126, + 0.6788053065538406, + 0.46325982734560966, + 0.05251826345920563, + 0.20430157333612442, + 0.03831428661942482, + 0.038581375032663345, + 0.3704780451953411, + 0.41040655225515366, + 0.29799749702215195, + 0.0, + 0.11102219671010971, + 0.0, + 0.21519199386239052, + 0.0, + 0.08987073600292206, + 0.49188676103949547, + 0.038815319538116455, + 0.7173326648771763, + 0.0, + 0.8261762820184231, + 0.0, + 0.14200996607542038, + 0.040229275822639465, + 0.049460023641586304, + 0.0, + 0.0, + 0.09061315655708313, + 0.0, + 0.2544734850525856, + 0.0, + 0.17487343400716782, + 0.0, + 0.3897225223481655, + 0.05513129010796547, + 0.19815485924482346, + 0.05169679969549179, + 0.21896552294492722, + 0.4971003830432892 + ], + "unique_experts": 45, + "load_cv": 1.1281951358669349, + "normalized_load_entropy": 0.8509105970305335, + "max_load_share": 0.06790123456790123 + }, + "full_input": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "cd60a1eb8550f80ed415f6af6058de54752c69bc6dde145b4b56f1e7f15be9a5", + "route_weight_sha256": "37ebf9d3a51c0ef3b64c34495c632c57907c6d9c0619cc542d554436ea823b25", + "loads": [ + 0, + 9, + 3, + 2, + 1, + 1, + 10, + 0, + 4, + 0, + 0, + 8, + 3, + 12, + 3, + 4, + 8, + 0, + 4, + 10, + 1, + 11, + 11, + 1, + 1, + 3, + 9, + 7, + 1, + 7, + 1, + 1, + 8, + 4, + 4, + 6, + 2, + 9, + 4, + 9, + 1, + 11, + 4, + 10, + 0, + 13, + 12, + 3, + 5, + 1, + 6, + 7, + 1, + 0, + 4, + 10, + 13, + 0, + 5, + 10, + 4, + 1, + 4, + 5 + ], + "weighted_loads": [ + 0.0, + 0.5282757300883532, + 0.24080343544483185, + 0.10103344544768333, + 0.02850438840687275, + 0.08631405979394913, + 1.100115917623043, + 0.0, + 0.32737303152680397, + 0.0, + 0.0, + 0.44834448769688606, + 0.28570643067359924, + 0.8790270946919918, + 0.19082938134670258, + 0.3770800158381462, + 0.6444802545011044, + 0.0, + 0.3865385130047798, + 0.6235574558377266, + 0.043848611414432526, + 0.9034107513725758, + 2.043841578066349, + 0.03571859374642372, + 0.03332866355776787, + 0.15299217030405998, + 0.6788053065538406, + 0.46325982734560966, + 0.05251826345920563, + 0.4380304031074047, + 0.03831428661942482, + 0.038581375032663345, + 0.5178404431790113, + 0.41040655225515366, + 0.3327314108610153, + 0.5475605465471745, + 0.11102219671010971, + 0.7122289761900902, + 0.21519199386239052, + 0.3594011515378952, + 0.08987073600292206, + 0.8908249214291573, + 0.14301955327391624, + 0.7173326648771763, + 0.0, + 0.9568992126733065, + 1.616610236465931, + 0.1610614936798811, + 0.2389263454824686, + 0.049460023641586304, + 0.4112132005393505, + 0.3056480176746845, + 0.09061315655708313, + 0.0, + 0.2544734850525856, + 0.7637483216822147, + 1.4797879680991173, + 0.0, + 0.3897225223481655, + 1.0133910700678825, + 0.19815485924482346, + 0.05169679969549179, + 0.21896552294492722, + 0.4971003830432892 + ], + "unique_experts": 56, + "load_cv": 0.8120557754929804, + "normalized_load_entropy": 0.9101723552771003, + "max_load_share": 0.041666666666666664 + } + }, + "s1_bos": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "3dc6bf81719954e5b395e7bed581d9f2d56aa1071eb8d0c6a5066180ebd0bf0a", + "route_weight_sha256": "9a3482138f343c8b25dab18ab57696051bf6331bcd95052324a1f393c15582e4", + "loads": [ + 0, + 6, + 2, + 2, + 0, + 1, + 1, + 0, + 4, + 0, + 0, + 2, + 2, + 11, + 0, + 3, + 2, + 0, + 3, + 3, + 0, + 8, + 10, + 0, + 1, + 2, + 9, + 7, + 1, + 3, + 1, + 1, + 5, + 5, + 3, + 0, + 2, + 0, + 3, + 0, + 1, + 5, + 1, + 10, + 0, + 9, + 1, + 2, + 1, + 1, + 0, + 0, + 1, + 0, + 4, + 0, + 3, + 0, + 5, + 1, + 4, + 1, + 4, + 5 + ], + "weighted_loads": [ + 0.0, + 0.4185488484799862, + 0.20438281446695328, + 0.09813671186566353, + 0.0, + 0.08754437416791916, + 0.07185468077659607, + 0.0, + 0.33178967982530594, + 0.0, + 0.0, + 0.0935090146958828, + 0.22352616488933563, + 0.854257132858038, + 0.0, + 0.33262650668621063, + 0.22343266010284424, + 0.0, + 0.25263408198952675, + 0.1632816530764103, + 0.0, + 0.721393495798111, + 1.4552298411726952, + 0.0, + 0.035213060677051544, + 0.1225435920059681, + 0.6894231103360653, + 0.48092228919267654, + 0.05171992629766464, + 0.20325766876339912, + 0.05147818848490715, + 0.03938979282975197, + 0.43803636357188225, + 0.461416807025671, + 0.30819498747587204, + 0.0, + 0.11269330233335495, + 0.0, + 0.18693330883979797, + 0.0, + 0.0892052873969078, + 0.43484124541282654, + 0.045033205300569534, + 0.7225424014031887, + 0.0, + 0.8515817373991013, + 0.03515748679637909, + 0.15115906670689583, + 0.03919301554560661, + 0.04791032150387764, + 0.0, + 0.0, + 0.09113990515470505, + 0.0, + 0.24762122333049774, + 0.0, + 0.18139774352312088, + 0.0, + 0.37595025077462196, + 0.056078795343637466, + 0.1917571984231472, + 0.054803516715765, + 0.21628861874341965, + 0.4934780076146126 + ], + "unique_experts": 46, + "load_cv": 1.1260315090196118, + "normalized_load_entropy": 0.8528920436137156, + "max_load_share": 0.06790123456790123 + }, + "full_input": { + "tokens": 68, + "top_k": 6, + "decisions": 408, + "ordered_route_sha256": "00b719fdc6e03fcc6d65a4adcff0a81aea5030872b8a2364cb239fc124322943", + "route_weight_sha256": "ce2939bbf530615b09577985ec79764365fc7c1ab50bf50ad648dd728f875bec", + "loads": [ + 0, + 8, + 5, + 3, + 2, + 1, + 16, + 1, + 9, + 6, + 0, + 12, + 7, + 12, + 9, + 5, + 13, + 0, + 6, + 13, + 2, + 12, + 11, + 1, + 2, + 4, + 9, + 8, + 2, + 6, + 1, + 4, + 12, + 6, + 7, + 8, + 3, + 17, + 3, + 9, + 1, + 11, + 3, + 10, + 1, + 12, + 16, + 4, + 4, + 1, + 8, + 6, + 2, + 3, + 4, + 11, + 20, + 0, + 5, + 12, + 9, + 1, + 4, + 5 + ], + "weighted_loads": [ + 0.0, + 0.505431767553091, + 0.34762125462293625, + 0.13542794808745384, + 0.15162651427090168, + 0.08754437416791916, + 1.3759401701390743, + 0.06110488995909691, + 0.6702318713068962, + 0.7035647481679916, + 0.0, + 0.7226974591612816, + 0.6210532076656818, + 0.8773277401924133, + 0.6809183992445469, + 0.49519260600209236, + 1.0546935014426708, + 0.0, + 0.5310635603964329, + 0.8617976531386375, + 0.09283514320850372, + 0.9667469225823879, + 2.003051958978176, + 0.03529661148786545, + 0.06779598072171211, + 0.20059964060783386, + 0.6894231103360653, + 0.5072729401290417, + 0.08884463459253311, + 0.4140723682940006, + 0.05147818848490715, + 0.23871483281254768, + 0.688040541484952, + 0.49500519782304764, + 0.5666758306324482, + 0.7816915884613991, + 0.14691581949591637, + 1.3331052511930466, + 0.18693330883979797, + 0.4731190353631973, + 0.0892052873969078, + 0.875474538654089, + 0.10300768539309502, + 0.7225424014031887, + 0.08486327528953552, + 0.9467165805399418, + 2.030093275010586, + 0.22729298658668995, + 0.2089022509753704, + 0.04791032150387764, + 0.5460841655731201, + 0.23899152129888535, + 0.1279573142528534, + 0.16863584518432617, + 0.24762122333049774, + 1.0094880051910877, + 2.159963645040989, + 0.0, + 0.37595025077462196, + 1.1091082077473402, + 0.4560890458524227, + 0.054803516715765, + 0.21628861874341965, + 0.4934780076146126 + ], + "unique_experts": 60, + "load_cv": 0.7525427867606074, + "normalized_load_entropy": 0.9268804672524353, + "max_load_share": 0.049019607843137254 + } + }, + "s0_x": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "806f955ba6317539763bf450c3826ae7d9f47b722c2195a2a5525f0568a7e388", + "route_weight_sha256": "d534d4f822984c66c0d01850c833806b53df5bbf6c6d1a98b08e149387b16eb2", + "loads": [ + 1, + 7, + 2, + 2, + 0, + 1, + 2, + 0, + 4, + 0, + 0, + 2, + 2, + 10, + 0, + 3, + 2, + 0, + 3, + 2, + 0, + 8, + 10, + 1, + 1, + 2, + 8, + 7, + 1, + 3, + 0, + 2, + 4, + 5, + 3, + 1, + 2, + 0, + 3, + 0, + 1, + 6, + 1, + 10, + 0, + 9, + 1, + 2, + 1, + 0, + 0, + 0, + 2, + 0, + 4, + 0, + 3, + 0, + 4, + 1, + 3, + 1, + 4, + 5 + ], + "weighted_loads": [ + 0.04047660529613495, + 0.4243546612560749, + 0.20302172377705574, + 0.09978855028748512, + 0.0, + 0.08498122543096542, + 0.1598171591758728, + 0.0, + 0.3294728361070156, + 0.0, + 0.0, + 0.10488146543502808, + 0.21920104324817657, + 0.7948484681546688, + 0.0, + 0.3210865259170532, + 0.23000468313694, + 0.0, + 0.24365420266985893, + 0.1457410790026188, + 0.0, + 0.7395705543458462, + 1.4951501302421093, + 0.03294786810874939, + 0.03514666482806206, + 0.11586097255349159, + 0.6539021655917168, + 0.4284377917647362, + 0.05448111519217491, + 0.19145582243800163, + 0.0, + 0.07742005959153175, + 0.36479418352246284, + 0.4401279017329216, + 0.2790633887052536, + 0.031646277755498886, + 0.11059920117259026, + 0.0, + 0.17632626369595528, + 0.0, + 0.09065220504999161, + 0.4813147522509098, + 0.04121509939432144, + 0.7275851853191853, + 0.0, + 0.8430190719664097, + 0.04341216757893562, + 0.13133250549435616, + 0.04030868411064148, + 0.0, + 0.0, + 0.0, + 0.13686764612793922, + 0.0, + 0.24868466332554817, + 0.0, + 0.19448160380125046, + 0.0, + 0.3548777475953102, + 0.054235003888607025, + 0.15544918179512024, + 0.05251462012529373, + 0.22280965745449066, + 0.4937235191464424 + ], + "unique_experts": 47, + "load_cv": 1.0885921042313826, + "normalized_load_entropy": 0.8616793160808193, + "max_load_share": 0.06172839506172839 + }, + "full_input": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "5ebdccb3deec3ee34697d3a52b8baae1a0cf6eab242968113f8608f7c633e93b", + "route_weight_sha256": "0e3708938d7ce5a0f8dc1965b233eaff48c9c9443fc660dda9759f43d63c2a58", + "loads": [ + 1, + 10, + 2, + 2, + 1, + 1, + 12, + 0, + 4, + 0, + 0, + 7, + 3, + 11, + 3, + 4, + 7, + 0, + 4, + 11, + 1, + 11, + 11, + 2, + 1, + 3, + 8, + 7, + 1, + 6, + 0, + 2, + 8, + 5, + 4, + 7, + 2, + 9, + 3, + 8, + 1, + 13, + 4, + 10, + 0, + 13, + 12, + 3, + 5, + 0, + 4, + 8, + 2, + 0, + 4, + 11, + 12, + 0, + 4, + 11, + 3, + 1, + 4, + 5 + ], + "weighted_loads": [ + 0.04047660529613495, + 0.5449427533894777, + 0.20302172377705574, + 0.09978855028748512, + 0.02850438840687275, + 0.08498122543096542, + 1.4164760895073414, + 0.0, + 0.3294728361070156, + 0.0, + 0.0, + 0.4190237820148468, + 0.2786075621843338, + 0.8179190754890442, + 0.17296136170625687, + 0.3650151453912258, + 0.6208677142858505, + 0.0, + 0.35788797959685326, + 0.7000892087817192, + 0.043848611414432526, + 0.9054321721196175, + 2.0429722480475903, + 0.06866646185517311, + 0.03514666482806206, + 0.14384562149643898, + 0.6539021655917168, + 0.4284377917647362, + 0.05448111519217491, + 0.3797442689538002, + 0.0, + 0.07742005959153175, + 0.5055010933429003, + 0.4401279017329216, + 0.313797302544117, + 0.6211732514202595, + 0.11059920117259026, + 0.6455872431397438, + 0.17632626369595528, + 0.31713220849633217, + 0.09065220504999161, + 1.0200113989412785, + 0.13170472532510757, + 0.7275851853191853, + 0.0, + 0.9737420026212931, + 1.3493865430355072, + 0.15038403309881687, + 0.24681268073618412, + 0.0, + 0.2776806242763996, + 0.3408694639801979, + 0.13686764612793922, + 0.0, + 0.24868466332554817, + 0.8189394250512123, + 1.282764058560133, + 0.0, + 0.3548777475953102, + 1.088209804147482, + 0.15544918179512024, + 0.05251462012529373, + 0.22280965745449066, + 0.4937235191464424 + ], + "unique_experts": 55, + "load_cv": 0.83046844824111, + "normalized_load_entropy": 0.9075913870664374, + "max_load_share": 0.041666666666666664 + } + }, + "s1_x": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "cb6574b9f36016cd743086da76c571edef52b0f937aac4354f973c8d78b47990", + "route_weight_sha256": "01073321789ffcdad7e9d5f5f53bb42b503e29902d1c4d70678fd8378f10fd11", + "loads": [ + 2, + 7, + 2, + 2, + 0, + 1, + 1, + 0, + 5, + 0, + 0, + 2, + 2, + 9, + 0, + 3, + 3, + 0, + 3, + 2, + 0, + 8, + 10, + 0, + 1, + 2, + 8, + 7, + 1, + 3, + 1, + 2, + 4, + 5, + 3, + 0, + 2, + 0, + 3, + 0, + 1, + 6, + 1, + 10, + 0, + 9, + 1, + 2, + 1, + 0, + 0, + 0, + 2, + 0, + 4, + 0, + 3, + 0, + 4, + 1, + 3, + 1, + 4, + 5 + ], + "weighted_loads": [ + 0.07955813780426979, + 0.432068333029747, + 0.19575782865285873, + 0.09867780283093452, + 0.0, + 0.0870668813586235, + 0.09943346679210663, + 0.0, + 0.3709750510752201, + 0.0, + 0.0, + 0.12890683487057686, + 0.22255446761846542, + 0.7676108442246914, + 0.0, + 0.33242470398545265, + 0.2584441564977169, + 0.0, + 0.2454000972211361, + 0.1404670961201191, + 0.0, + 0.7112045884132385, + 1.4438740126788616, + 0.0, + 0.03755592182278633, + 0.11362169310450554, + 0.6633001938462257, + 0.443195603787899, + 0.045670732855796814, + 0.18895982578396797, + 0.038485441356897354, + 0.07739873230457306, + 0.37004972994327545, + 0.4635309688746929, + 0.2943849340081215, + 0.0, + 0.11545783281326294, + 0.0, + 0.1925676092505455, + 0.0, + 0.09177449345588684, + 0.4915304481983185, + 0.050835419446229935, + 0.7414543889462948, + 0.0, + 0.8835229240357876, + 0.03480798006057739, + 0.1397150382399559, + 0.0402410626411438, + 0.0, + 0.0, + 0.0, + 0.13540269806981087, + 0.0, + 0.23331266269087791, + 0.0, + 0.1880234144628048, + 0.0, + 0.3420291766524315, + 0.05568842217326164, + 0.15176813304424286, + 0.057498641312122345, + 0.21424239501357079, + 0.4989522099494934 + ], + "unique_experts": 46, + "load_cv": 1.081850661380038, + "normalized_load_entropy": 0.8599565053393506, + "max_load_share": 0.06172839506172839 + }, + "full_input": { + "tokens": 68, + "top_k": 6, + "decisions": 408, + "ordered_route_sha256": "858dde587cc522dff35ed62e4dedb56509ce76f00b0dd5841f96028627d999f2", + "route_weight_sha256": "5cebe424e95d3b49973b3340498e4b208fc7b7de43035fe9d9925275bb9e009f", + "loads": [ + 2, + 9, + 5, + 3, + 2, + 1, + 19, + 1, + 10, + 6, + 0, + 11, + 7, + 10, + 9, + 5, + 12, + 0, + 6, + 14, + 2, + 12, + 11, + 1, + 3, + 4, + 8, + 8, + 2, + 6, + 1, + 5, + 10, + 6, + 7, + 8, + 3, + 15, + 3, + 9, + 1, + 14, + 3, + 10, + 1, + 12, + 14, + 3, + 4, + 0, + 7, + 7, + 3, + 3, + 4, + 12, + 19, + 0, + 4, + 13, + 8, + 1, + 4, + 5 + ], + "weighted_loads": [ + 0.07955813780426979, + 0.5210854858160019, + 0.3389962688088417, + 0.13596903905272484, + 0.15162651427090168, + 0.0870668813586235, + 1.7843144424259663, + 0.06110488995909691, + 0.7094172425568104, + 0.7035647481679916, + 0.0, + 0.699379350990057, + 0.6194279752671719, + 0.7906814515590668, + 0.6816337816417217, + 0.5102833844721317, + 1.0228745304048061, + 0.0, + 0.5039575733244419, + 0.9435424841940403, + 0.09283514320850372, + 0.950646061450243, + 1.9916961304843426, + 0.03529661148786545, + 0.10401194542646408, + 0.1916777417063713, + 0.6633001938462257, + 0.46954625472426414, + 0.08279544115066528, + 0.3920521102845669, + 0.038485441356897354, + 0.2767237722873688, + 0.5741833355277777, + 0.49711935967206955, + 0.5528657771646976, + 0.7925403639674187, + 0.14968034997582436, + 1.141874223947525, + 0.1925676092505455, + 0.4731190353631973, + 0.09177449345588684, + 1.0647321939468384, + 0.10880989953875542, + 0.7414543889462948, + 0.08486327528953552, + 0.9786577671766281, + 1.648767326027155, + 0.15876656584441662, + 0.21233851835131645, + 0.0, + 0.4595506638288498, + 0.26803905330598354, + 0.1722201071679592, + 0.16863584518432617, + 0.23331266269087791, + 1.0799529068171978, + 1.9264844357967377, + 0.0, + 0.3420291766524315, + 1.1807755585759878, + 0.41609998047351837, + 0.057498641312122345, + 0.21424239501357079, + 0.4989522099494934 + ], + "unique_experts": 60, + "load_cv": 0.7427724284265025, + "normalized_load_entropy": 0.9291408569395769, + "max_load_share": 0.04656862745098039 + } + }, + "s0_period": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "5d2b3c2de4e2d60a0f9202bb07ffef8e2e49f34a97ee175b783f65cfb1fdb8a3", + "route_weight_sha256": "4cef2ba160e398c3af671823f96bd12ac50d2b7135bed5f2f2f2eb5cdd20ebeb", + "loads": [ + 1, + 7, + 2, + 2, + 0, + 1, + 2, + 0, + 4, + 0, + 0, + 2, + 2, + 10, + 0, + 3, + 2, + 0, + 3, + 2, + 0, + 8, + 11, + 1, + 1, + 2, + 8, + 7, + 1, + 3, + 0, + 2, + 4, + 5, + 3, + 0, + 2, + 1, + 3, + 0, + 1, + 6, + 1, + 10, + 0, + 9, + 1, + 2, + 1, + 0, + 0, + 0, + 2, + 0, + 4, + 0, + 3, + 0, + 4, + 1, + 2, + 1, + 4, + 5 + ], + "weighted_loads": [ + 0.04441569000482559, + 0.43163393065333366, + 0.20152855291962624, + 0.09899111837148666, + 0.0, + 0.0866643413901329, + 0.17467356473207474, + 0.0, + 0.3231496810913086, + 0.0, + 0.0, + 0.10481316968798637, + 0.21415817737579346, + 0.7919245585799217, + 0.0, + 0.32075558602809906, + 0.23335786908864975, + 0.0, + 0.23789511248469353, + 0.14375890791416168, + 0.0, + 0.7379061430692673, + 1.5308843553066254, + 0.033633943647146225, + 0.035554543137550354, + 0.11700938269495964, + 0.63608019053936, + 0.417777169495821, + 0.05490265414118767, + 0.18961862102150917, + 0.0, + 0.07833459973335266, + 0.3714188486337662, + 0.4449465312063694, + 0.28484058380126953, + 0.0, + 0.1081623025238514, + 0.033185042440891266, + 0.1718258485198021, + 0.0, + 0.08865208923816681, + 0.4922508932650089, + 0.041980329900979996, + 0.7268804870545864, + 0.0, + 0.8235514648258686, + 0.04490768164396286, + 0.14059140905737877, + 0.03996749967336655, + 0.0, + 0.0, + 0.0, + 0.14237874746322632, + 0.0, + 0.24337494000792503, + 0.0, + 0.20055223628878593, + 0.0, + 0.35674626007676125, + 0.0533757209777832, + 0.11222004890441895, + 0.05092388018965721, + 0.21422315761446953, + 0.4938937574625015 + ], + "unique_experts": 47, + "load_cv": 1.1063684791720763, + "normalized_load_entropy": 0.859539831148748, + "max_load_share": 0.06790123456790123 + }, + "full_input": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "bcc17cc587864a95d53e787bf351eef690bbaa3205c5929fc3baefd9b3e5417f", + "route_weight_sha256": "94292ca2e68f5c342994417aec127eace0cfaaf237aba32e1e7905dc0ef476a0", + "loads": [ + 1, + 10, + 2, + 2, + 1, + 1, + 12, + 0, + 4, + 0, + 0, + 7, + 4, + 11, + 3, + 3, + 7, + 0, + 4, + 12, + 1, + 11, + 12, + 2, + 1, + 3, + 8, + 7, + 2, + 6, + 0, + 2, + 8, + 5, + 4, + 6, + 2, + 10, + 3, + 8, + 1, + 12, + 4, + 10, + 0, + 13, + 13, + 3, + 4, + 0, + 4, + 8, + 2, + 0, + 4, + 11, + 12, + 0, + 4, + 10, + 2, + 1, + 4, + 5 + ], + "weighted_loads": [ + 0.04441569000482559, + 0.5604041945189238, + 0.20152855291962624, + 0.09899111837148666, + 0.02850438840687275, + 0.0866643413901329, + 1.2986445166170597, + 0.0, + 0.3231496810913086, + 0.0, + 0.0, + 0.4114244244992733, + 0.3280767500400543, + 0.8149951659142971, + 0.16685840114951134, + 0.32075558602809906, + 0.6237749271094799, + 0.0, + 0.34852438792586327, + 0.7839143052697182, + 0.043848611414432526, + 0.9021943621337414, + 2.0787064731121063, + 0.06935253739356995, + 0.035554543137550354, + 0.14499403163790703, + 0.63608019053936, + 0.417777169495821, + 0.15972701832652092, + 0.3749164864420891, + 0.0, + 0.07833459973335266, + 0.5214167069643736, + 0.4449465312063694, + 0.3195744976401329, + 0.5824815332889557, + 0.1081623025238514, + 0.7629364654421806, + 0.1718258485198021, + 0.31713220849633217, + 0.08865208923816681, + 0.9477838017046452, + 0.13635147362947464, + 0.7268804870545864, + 0.0, + 0.954274395480752, + 1.3915619142353535, + 0.15964293666183949, + 0.19502960331737995, + 0.0, + 0.2767845392227173, + 0.3400369994342327, + 0.14237874746322632, + 0.0, + 0.24337494000792503, + 0.9115374125540257, + 1.2949473187327385, + 0.0, + 0.35674626007676125, + 1.0116355009377003, + 0.11222004890441895, + 0.05092388018965721, + 0.21422315761446953, + 0.4938937574625015 + ], + "unique_experts": 55, + "load_cv": 0.8383478320139393, + "normalized_load_entropy": 0.9069071690854722, + "max_load_share": 0.041666666666666664 + } + }, + "s1_period": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "8149fc85d4d9ddbc9df9f5d1d99199f789c5836c1acc388958e92f7fac861db9", + "route_weight_sha256": "3735461d50c8e9d46756f082f77227fc00aba492dfab3e6bd54f96e97f945b6a", + "loads": [ + 1, + 7, + 2, + 2, + 0, + 1, + 2, + 0, + 5, + 0, + 0, + 2, + 2, + 9, + 0, + 3, + 3, + 0, + 3, + 2, + 0, + 8, + 10, + 0, + 1, + 2, + 8, + 7, + 1, + 3, + 1, + 2, + 4, + 6, + 3, + 1, + 2, + 0, + 3, + 0, + 1, + 6, + 1, + 10, + 0, + 9, + 0, + 2, + 1, + 0, + 0, + 0, + 2, + 0, + 3, + 0, + 3, + 0, + 4, + 1, + 3, + 1, + 4, + 5 + ], + "weighted_loads": [ + 0.04183217138051987, + 0.42913582921028137, + 0.19887927174568176, + 0.09847161546349525, + 0.0, + 0.08960220962762833, + 0.1373034007847309, + 0.0, + 0.3657061792910099, + 0.0, + 0.0, + 0.1230766735970974, + 0.22103121876716614, + 0.7588317319750786, + 0.0, + 0.33194736391305923, + 0.2684730142354965, + 0.0, + 0.24099135026335716, + 0.141758780926466, + 0.0, + 0.7101820819079876, + 1.4495840854942799, + 0.0, + 0.040386002510786057, + 0.11240949854254723, + 0.6425474733114243, + 0.44812631234526634, + 0.05284396559000015, + 0.18904559686779976, + 0.03954492136836052, + 0.07746325060725212, + 0.37209273874759674, + 0.5060915276408195, + 0.29536739736795425, + 0.03563374653458595, + 0.11453353241086006, + 0.0, + 0.19058271870017052, + 0.0, + 0.09093919396400452, + 0.4884021319448948, + 0.046922869980335236, + 0.7301039658486843, + 0.0, + 0.8607634417712688, + 0.0, + 0.14258670061826706, + 0.04017065092921257, + 0.0, + 0.0, + 0.0, + 0.14035946130752563, + 0.0, + 0.19095436856150627, + 0.0, + 0.19199851527810097, + 0.0, + 0.34731335937976837, + 0.056157100945711136, + 0.14699861779808998, + 0.05629502981901169, + 0.21583613753318787, + 0.4940377399325371 + ], + "unique_experts": 46, + "load_cv": 1.08634960491827, + "normalized_load_entropy": 0.8592826143598716, + "max_load_share": 0.06172839506172839 + }, + "full_input": { + "tokens": 68, + "top_k": 6, + "decisions": 408, + "ordered_route_sha256": "1c12cd89cf138e2f92896da7dc519543e46c4dbca0547b7536733f30a58c5c58", + "route_weight_sha256": "3473ff3103fea059b5348a89224d1d59417d04cf826900eeec53c8c3b1021358", + "loads": [ + 1, + 9, + 5, + 3, + 2, + 1, + 20, + 1, + 10, + 6, + 0, + 11, + 8, + 10, + 9, + 5, + 12, + 0, + 6, + 14, + 2, + 12, + 11, + 1, + 3, + 4, + 8, + 8, + 3, + 6, + 1, + 5, + 10, + 7, + 7, + 9, + 3, + 16, + 3, + 9, + 1, + 13, + 3, + 10, + 1, + 12, + 15, + 3, + 2, + 0, + 6, + 7, + 3, + 3, + 3, + 12, + 19, + 0, + 4, + 12, + 8, + 1, + 4, + 5 + ], + "weighted_loads": [ + 0.04183217138051987, + 0.5196208618581295, + 0.34211771190166473, + 0.13576285168528557, + 0.15162651427090168, + 0.08960220962762833, + 1.6858738586306572, + 0.06110488995909691, + 0.7041483707726002, + 0.7035647481679916, + 0.0, + 0.6957433186471462, + 0.682753462344408, + 0.781902339309454, + 0.6805057190358639, + 0.496233195066452, + 1.0275995582342148, + 0.0, + 0.5073160491883755, + 1.0401489324867725, + 0.09283514320850372, + 0.9471089839935303, + 1.9974062032997608, + 0.03529661148786545, + 0.10820047557353973, + 0.190465547144413, + 0.6425474733114243, + 0.47447696328163147, + 0.21107719093561172, + 0.3919941149652004, + 0.03954492136836052, + 0.27678829059004784, + 0.5765806715935469, + 0.5396799184381962, + 0.5538482405245304, + 0.8463141731917858, + 0.14875604957342148, + 1.285530224442482, + 0.19058271870017052, + 0.4731190353631973, + 0.09093919396400452, + 0.9724242761731148, + 0.10489735007286072, + 0.7301039658486843, + 0.08486327528953552, + 0.9558982849121094, + 1.690179143100977, + 0.16163822822272778, + 0.09014713391661644, + 0.0, + 0.3990217074751854, + 0.27132467553019524, + 0.17717687040567398, + 0.16863584518432617, + 0.19095436856150627, + 1.1439534462988377, + 1.9235630482435226, + 0.0, + 0.34731335937976837, + 1.1091865133494139, + 0.4113304652273655, + 0.05629502981901169, + 0.21583613753318787, + 0.4940377399325371 + ], + "unique_experts": 60, + "load_cv": 0.7586487106726707, + "normalized_load_entropy": 0.9264737135995995, + "max_load_share": 0.049019607843137254 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 27, + "ordered_topk_exact_tokens": 22, + "set_exact_tokens": 22, + "mean_set_jaccard": 0.9470899470899473, + "mean_token_weighted_tv": 0.013209984913744309, + "aggregate_load_tv": 0.018518518518518517 + }, + "system_bos": { + "tokens": 27, + "ordered_topk_exact_tokens": 19, + "set_exact_tokens": 23, + "mean_set_jaccard": 0.9576719576719578, + "mean_token_weighted_tv": 0.016492532014294906, + "aggregate_load_tv": 0.024691358024691357 + }, + "system_x": { + "tokens": 27, + "ordered_topk_exact_tokens": 19, + "set_exact_tokens": 23, + "mean_set_jaccard": 0.9497354497354499, + "mean_token_weighted_tv": 0.01956513151526451, + "aggregate_load_tv": 0.024691358024691357 + }, + "system_period": { + "tokens": 27, + "ordered_topk_exact_tokens": 19, + "set_exact_tokens": 22, + "mean_set_jaccard": 0.9329805996472664, + "mean_token_weighted_tv": 0.02134798894877787, + "aggregate_load_tv": 0.037037037037037035 + }, + "bos_at_s0": { + "tokens": 27, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 18, + "mean_set_jaccard": 0.8968253968253967, + "mean_token_weighted_tv": 0.027837862088172523, + "aggregate_load_tv": 0.04938271604938271 + }, + "bos_at_s1": { + "tokens": 27, + "ordered_topk_exact_tokens": 16, + "set_exact_tokens": 20, + "mean_set_jaccard": 0.9259259259259259, + "mean_token_weighted_tv": 0.02505077459607963, + "aggregate_load_tv": 0.043209876543209874 + }, + "x_at_s0": { + "tokens": 27, + "ordered_topk_exact_tokens": 16, + "set_exact_tokens": 20, + "mean_set_jaccard": 0.9179894179894179, + "mean_token_weighted_tv": 0.02529909937745995, + "aggregate_load_tv": 0.043209876543209874 + }, + "x_at_s1": { + "tokens": 27, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.8941798941798943, + "mean_token_weighted_tv": 0.03108698698795504, + "aggregate_load_tv": 0.04938271604938271 + }, + "period_at_s0": { + "tokens": 27, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.9074074074074074, + "mean_token_weighted_tv": 0.02757497111128436, + "aggregate_load_tv": 0.04938271604938271 + }, + "period_at_s1": { + "tokens": 27, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.8862433862433863, + "mean_token_weighted_tv": 0.031698835289312735, + "aggregate_load_tv": 0.05555555555555555 + } + } + }, + "layer_07": { + "layer": 7, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "5009c0b98dc3d17bcc7485052eff088b25d0da6121982352b9c13960427961be", + "route_weight_sha256": "1f51882c81dd3ab153a27a305997eca689bc49b0eeb0f2d390dd193e92742a35", + "loads": [ + 2, + 0, + 3, + 0, + 1, + 1, + 1, + 2, + 2, + 4, + 2, + 0, + 0, + 2, + 4, + 1, + 2, + 0, + 3, + 2, + 2, + 2, + 0, + 10, + 3, + 6, + 2, + 2, + 3, + 4, + 7, + 1, + 2, + 6, + 3, + 1, + 1, + 1, + 1, + 7, + 5, + 0, + 2, + 10, + 7, + 2, + 8, + 2, + 0, + 0, + 1, + 5, + 1, + 0, + 0, + 3, + 3, + 0, + 5, + 2, + 1, + 1, + 8, + 0 + ], + "weighted_loads": [ + 0.10986610874533653, + 0.0, + 0.1727927215397358, + 0.0, + 0.05423302948474884, + 0.03468097746372223, + 0.05335493013262749, + 0.14185529574751854, + 0.15802138298749924, + 0.4733920879662037, + 0.09002920612692833, + 0.0, + 0.0, + 0.11694252863526344, + 0.21379949524998665, + 0.041959330439567566, + 0.09152237698435783, + 0.0, + 0.13446737825870514, + 0.12754159048199654, + 0.14047647640109062, + 0.14656274393200874, + 0.0, + 1.0488362647593021, + 0.13948954641819, + 0.4160381443798542, + 0.14289673417806625, + 0.10139132663607597, + 0.1556788571178913, + 0.30190451815724373, + 0.7047748416662216, + 0.04410552978515625, + 0.1699836477637291, + 0.3665255159139633, + 0.12916385382413864, + 0.04115993529558182, + 0.057409219443798065, + 0.056911543011665344, + 0.09557432681322098, + 0.6990139298141003, + 0.4950580820441246, + 0.0, + 0.268131747841835, + 0.9739062748849392, + 0.5678444616496563, + 0.09901051595807076, + 0.774333193898201, + 0.0952434092760086, + 0.0, + 0.0, + 0.035717643797397614, + 0.3523292802274227, + 0.03879488259553909, + 0.0, + 0.0, + 0.21757131069898605, + 0.20299571380019188, + 0.0, + 0.8508812040090561, + 0.14352722465991974, + 0.08610120415687561, + 0.08331751078367233, + 0.5053224563598633, + 0.0 + ], + "unique_experts": 51, + "load_cv": 0.9875771574795098, + "normalized_load_entropy": 0.8853189313366705, + "max_load_share": 0.06172839506172839 + }, + "full_input": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "de6b19c79b4ed670cde6f61bfc54729d5763a653211c2c5aa418b1ab00c1a32c", + "route_weight_sha256": "6cc837d54479326c9c4ca400bd18f78a456621420da0a217406d6bd3045330ee", + "loads": [ + 2, + 0, + 3, + 3, + 1, + 2, + 7, + 2, + 10, + 4, + 3, + 3, + 0, + 7, + 4, + 1, + 17, + 2, + 5, + 2, + 2, + 2, + 3, + 12, + 7, + 6, + 7, + 2, + 6, + 4, + 7, + 1, + 5, + 7, + 3, + 1, + 1, + 1, + 11, + 10, + 5, + 11, + 7, + 12, + 11, + 2, + 11, + 4, + 0, + 0, + 16, + 5, + 1, + 1, + 0, + 10, + 3, + 0, + 9, + 2, + 1, + 7, + 11, + 7 + ], + "weighted_loads": [ + 0.10986610874533653, + 0.0, + 0.1727927215397358, + 0.11171025037765503, + 0.05423302948474884, + 0.07652958109974861, + 0.613595612347126, + 0.14185529574751854, + 0.7713313139975071, + 0.4733920879662037, + 0.12285100668668747, + 0.4580599367618561, + 0.0, + 0.40166632644832134, + 0.21379949524998665, + 0.041959330439567566, + 2.1255666315555573, + 0.11625625938177109, + 0.1759631922468543, + 0.12754159048199654, + 0.14047647640109062, + 0.14656274393200874, + 0.17215830460190773, + 1.2368007488548756, + 0.27069838577881455, + 0.4160381443798542, + 0.591235563158989, + 0.10139132663607597, + 0.21889679972082376, + 0.30190451815724373, + 0.7047748416662216, + 0.04410552978515625, + 0.2840999960899353, + 0.4159424267709255, + 0.12916385382413864, + 0.04115993529558182, + 0.057409219443798065, + 0.056911543011665344, + 1.061551719903946, + 0.8418374620378017, + 0.4950580820441246, + 1.0478885509073734, + 0.7047450207173824, + 1.0058607691898942, + 2.0986480824649334, + 0.09901051595807076, + 0.8969748262315989, + 0.24766096472740173, + 0.0, + 0.0, + 1.1962645910680294, + 0.3523292802274227, + 0.03879488259553909, + 0.0320337638258934, + 0.0, + 0.8720953091979027, + 0.20299571380019188, + 0.0, + 0.936091654933989, + 0.14352722465991974, + 0.08610120415687561, + 0.38030756264925003, + 0.5540461898781359, + 0.2653937377035618 + ], + "unique_experts": 58, + "load_cv": 0.845376488299207, + "normalized_load_entropy": 0.9121035964586702, + "max_load_share": 0.05448717948717949 + } + }, + "s1_eos": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "e5ddd41baa6401634a229da80a052ad44ba9f3156d0650373c2f1a7e2ab57295", + "route_weight_sha256": "72bfb256ed426aa236ef950de4bd7292750a95c4304162b0234e47da4a1252d6", + "loads": [ + 2, + 0, + 3, + 0, + 1, + 1, + 1, + 2, + 2, + 5, + 2, + 0, + 0, + 2, + 4, + 1, + 2, + 0, + 3, + 2, + 2, + 2, + 0, + 10, + 3, + 6, + 2, + 2, + 3, + 4, + 7, + 1, + 2, + 6, + 2, + 0, + 1, + 1, + 2, + 7, + 5, + 0, + 2, + 10, + 7, + 2, + 8, + 2, + 0, + 0, + 1, + 5, + 1, + 0, + 0, + 3, + 3, + 0, + 5, + 2, + 1, + 1, + 8, + 0 + ], + "weighted_loads": [ + 0.11193053051829338, + 0.0, + 0.17946898937225342, + 0.0, + 0.05127904936671257, + 0.03441217169165611, + 0.05262446776032448, + 0.1440972164273262, + 0.15440566837787628, + 0.5243929773569107, + 0.09774844720959663, + 0.0, + 0.0, + 0.12143198028206825, + 0.2218153290450573, + 0.04182213172316551, + 0.09045707434415817, + 0.0, + 0.1345009244978428, + 0.13133284449577332, + 0.13473545014858246, + 0.14845653623342514, + 0.0, + 1.045088890939951, + 0.13758944533765316, + 0.4026060402393341, + 0.1455550566315651, + 0.09810052439570427, + 0.1548377349972725, + 0.3061421103775501, + 0.6963547132909298, + 0.05795813351869583, + 0.17553511261940002, + 0.35905671864748, + 0.07282791659235954, + 0.0, + 0.05915066599845886, + 0.05337654799222946, + 0.14383870363235474, + 0.7062634080648422, + 0.49318240210413933, + 0.0, + 0.2687881663441658, + 0.9581625498831272, + 0.5652367658913136, + 0.10198530182242393, + 0.7507869340479374, + 0.09130590781569481, + 0.0, + 0.0, + 0.036694590002298355, + 0.36269839107990265, + 0.03637431934475899, + 0.0, + 0.0, + 0.21829623356461525, + 0.20232624933123589, + 0.0, + 0.8242149353027344, + 0.14308711141347885, + 0.08896724134683609, + 0.08703234791755676, + 0.514380045235157, + 0.0 + ], + "unique_experts": 50, + "load_cv": 0.9949575658498168, + "normalized_load_entropy": 0.8823819426820684, + "max_load_share": 0.06172839506172839 + }, + "full_input": { + "tokens": 68, + "top_k": 6, + "decisions": 408, + "ordered_route_sha256": "499a966860c88d801e316cb1c9971be1f1ea319232c58cda9658f1ee8505282e", + "route_weight_sha256": "200ca8cbd7dc26a359b9b6c5214a373f19ca556cff9954b49d6f8a5982485e72", + "loads": [ + 2, + 0, + 3, + 2, + 2, + 2, + 10, + 2, + 18, + 7, + 9, + 5, + 0, + 8, + 6, + 2, + 18, + 3, + 5, + 2, + 2, + 2, + 2, + 13, + 8, + 6, + 11, + 2, + 6, + 10, + 7, + 1, + 8, + 14, + 2, + 0, + 1, + 5, + 19, + 10, + 7, + 16, + 11, + 13, + 18, + 2, + 11, + 8, + 0, + 0, + 23, + 5, + 1, + 0, + 4, + 12, + 3, + 6, + 8, + 2, + 1, + 7, + 12, + 3 + ], + "weighted_loads": [ + 0.11193053051829338, + 0.0, + 0.17946898937225342, + 0.06338144280016422, + 0.09791503474116325, + 0.07902340963482857, + 0.6908054761588573, + 0.1440972164273262, + 1.4935221411287785, + 0.626347329467535, + 0.6609355583786964, + 0.5758806020021439, + 0.0, + 0.4583700466901064, + 0.2897030897438526, + 0.09683426842093468, + 2.5259712785482407, + 0.16552739590406418, + 0.17556531820446253, + 0.13133284449577332, + 0.13473545014858246, + 0.14845653623342514, + 0.11924022808670998, + 1.2688422799110413, + 0.29201598232612014, + 0.4026060402393341, + 0.9615009985864162, + 0.09810052439570427, + 0.21839429531246424, + 1.0812344290316105, + 0.6963547132909298, + 0.05795813351869583, + 0.5608601234853268, + 0.9024400785565376, + 0.07282791659235954, + 0.0, + 0.05915066599845886, + 0.28100864589214325, + 1.9701360911130905, + 0.8666835390031338, + 0.7149791158735752, + 1.5256088003516197, + 1.0588712319731712, + 1.0302906474098563, + 2.6713907569646835, + 0.10198530182242393, + 0.8935433179140091, + 0.4375012032687664, + 0.0, + 0.0, + 1.65148551389575, + 0.36269839107990265, + 0.03637431934475899, + 0.0, + 0.20681129023432732, + 0.9895709920674562, + 0.20232624933123589, + 0.5345526747405529, + 0.8813134459778666, + 0.14308711141347885, + 0.08896724134683609, + 0.37721195444464684, + 0.5976055338978767, + 0.0877796895802021 + ], + "unique_experts": 58, + "load_cv": 0.8669682733111429, + "normalized_load_entropy": 0.9086666581241868, + "max_load_share": 0.056372549019607844 + } + }, + "s0_bos": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "24398b9bfa30583abd82b8d1d1e4ac68d50abd0b2290cbfdf8a88c8f782826d9", + "route_weight_sha256": "13a4ee55675df81d443246d3ec7698e63a437cce325cdfd1b504cf9279185421", + "loads": [ + 2, + 0, + 3, + 0, + 1, + 2, + 1, + 3, + 2, + 5, + 1, + 1, + 0, + 2, + 4, + 1, + 2, + 0, + 3, + 2, + 3, + 2, + 0, + 10, + 3, + 6, + 2, + 2, + 3, + 3, + 7, + 1, + 2, + 6, + 3, + 1, + 1, + 1, + 2, + 7, + 5, + 0, + 2, + 10, + 7, + 1, + 8, + 1, + 0, + 0, + 1, + 5, + 1, + 0, + 0, + 3, + 3, + 0, + 5, + 2, + 1, + 1, + 6, + 0 + ], + "weighted_loads": [ + 0.110854871571064, + 0.0, + 0.16470903158187866, + 0.0, + 0.04945192486047745, + 0.06593238934874535, + 0.058597709983587265, + 0.18612070381641388, + 0.16198809444904327, + 0.5485936850309372, + 0.051832105964422226, + 0.03433355689048767, + 0.0, + 0.1197408065199852, + 0.2220982238650322, + 0.03678392991423607, + 0.09654705226421356, + 0.0, + 0.13624181225895882, + 0.11102227494120598, + 0.17091519385576248, + 0.15367092937231064, + 0.0, + 1.0702497623860836, + 0.14107468724250793, + 0.43222731724381447, + 0.12559853866696358, + 0.09459008276462555, + 0.15551947429776192, + 0.24577700719237328, + 0.7060472629964352, + 0.05237218365073204, + 0.18178027123212814, + 0.3660314716398716, + 0.11549437046051025, + 0.043600670993328094, + 0.06267604231834412, + 0.05658509209752083, + 0.13954588770866394, + 0.7299093119800091, + 0.48233965411782265, + 0.0, + 0.272730253636837, + 0.9686124436557293, + 0.5857526399195194, + 0.05272027850151062, + 0.7529323138296604, + 0.05528256669640541, + 0.0, + 0.0, + 0.04150017350912094, + 0.34794455394148827, + 0.03858957067131996, + 0.0, + 0.0, + 0.22254441305994987, + 0.2105718031525612, + 0.0, + 0.9027078561484814, + 0.14165369421243668, + 0.08836062997579575, + 0.07760576158761978, + 0.4084884375333786, + 0.0 + ], + "unique_experts": 52, + "load_cv": 0.9650973496885469, + "normalized_load_entropy": 0.890067822298343, + "max_load_share": 0.06172839506172839 + }, + "full_input": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "7315a2f1782cfded25fe4bdc3f89a11bfaec61fbcc01d86dacd03b08e8dbc0f0", + "route_weight_sha256": "5ece4eefcf61d370691315e222b46b22cb2463422a941f15a6b4187bbe7f729c", + "loads": [ + 2, + 0, + 3, + 3, + 1, + 3, + 7, + 3, + 10, + 5, + 2, + 5, + 0, + 7, + 4, + 1, + 17, + 4, + 6, + 2, + 3, + 2, + 3, + 12, + 6, + 6, + 7, + 2, + 5, + 3, + 7, + 1, + 5, + 8, + 3, + 1, + 1, + 1, + 11, + 10, + 5, + 11, + 7, + 12, + 11, + 1, + 10, + 3, + 0, + 0, + 16, + 5, + 1, + 2, + 0, + 10, + 3, + 0, + 8, + 2, + 1, + 7, + 8, + 7 + ], + "weighted_loads": [ + 0.110854871571064, + 0.0, + 0.16470903158187866, + 0.11171025037765503, + 0.04945192486047745, + 0.10778099298477173, + 0.6009079553186893, + 0.18612070381641388, + 0.7770734019577503, + 0.5485936850309372, + 0.08465390652418137, + 0.546934612095356, + 0.0, + 0.4044646043330431, + 0.2220982238650322, + 0.03678392991423607, + 2.20334355160594, + 0.24067473784089088, + 0.2191252065822482, + 0.11102227494120598, + 0.17091519385576248, + 0.15367092937231064, + 0.17215830460190773, + 1.2446103058755398, + 0.2652319222688675, + 0.43222731724381447, + 0.588631484657526, + 0.09459008276462555, + 0.2056447472423315, + 0.24577700719237328, + 0.7060472629964352, + 0.05237218365073204, + 0.29589661955833435, + 0.45356806740164757, + 0.11549437046051025, + 0.043600670993328094, + 0.06267604231834412, + 0.05658509209752083, + 1.0071153864264488, + 0.8700146973133087, + 0.48233965411782265, + 0.9625888653099537, + 0.750634890049696, + 1.0175507701933384, + 1.3138199038803577, + 0.05272027850151062, + 0.8530558981001377, + 0.21715569868683815, + 0.0, + 0.0, + 1.3025569953024387, + 0.34794455394148827, + 0.03858957067131996, + 0.07720556110143661, + 0.0, + 0.8770684115588665, + 0.2105718031525612, + 0.0, + 0.9729346055537462, + 0.14165369421243668, + 0.08836062997579575, + 0.3745958134531975, + 0.45159964822232723, + 0.2653937377035618 + ], + "unique_experts": 58, + "load_cv": 0.8217138645621572, + "normalized_load_entropy": 0.9162311552851892, + "max_load_share": 0.05448717948717949 + } + }, + "s1_bos": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "dec1bf02e98d1b2e0e479cb2291a9288115191a040529d7ce5fa5e2cf8eab486", + "route_weight_sha256": "2a9b3ef6280633285cf0bdc78c7144cd8c80ef70626de767c5e3b16f49d1a9b4", + "loads": [ + 2, + 0, + 3, + 0, + 1, + 1, + 1, + 3, + 2, + 5, + 1, + 1, + 0, + 2, + 3, + 1, + 2, + 0, + 3, + 2, + 3, + 2, + 0, + 10, + 3, + 6, + 2, + 2, + 3, + 3, + 7, + 1, + 2, + 6, + 4, + 1, + 1, + 1, + 2, + 7, + 5, + 0, + 2, + 9, + 7, + 1, + 8, + 1, + 0, + 0, + 0, + 5, + 1, + 0, + 0, + 3, + 3, + 0, + 5, + 2, + 1, + 1, + 9, + 0 + ], + "weighted_loads": [ + 0.11460819840431213, + 0.0, + 0.17953969910740852, + 0.0, + 0.04977719858288765, + 0.031529251486063004, + 0.053719960153102875, + 0.1927674375474453, + 0.15852215141057968, + 0.5531748607754707, + 0.05816393718123436, + 0.035882364958524704, + 0.0, + 0.12376636639237404, + 0.17308137938380241, + 0.03693656250834465, + 0.09844524040818214, + 0.0, + 0.13613484799861908, + 0.11568934097886086, + 0.16545508056879044, + 0.15798045694828033, + 0.0, + 1.046608604490757, + 0.1289186291396618, + 0.4140540286898613, + 0.13267307355999947, + 0.09095506370067596, + 0.1552274003624916, + 0.23714794591069221, + 0.7002353668212891, + 0.07289805263280869, + 0.1862814500927925, + 0.3700977936387062, + 0.15900447219610214, + 0.04685110226273537, + 0.06493661552667618, + 0.056189991533756256, + 0.14538711681962013, + 0.7303876988589764, + 0.4967146925628185, + 0.0, + 0.27150286734104156, + 0.9259405136108398, + 0.5777520947158337, + 0.05312039330601692, + 0.7353159710764885, + 0.05219557508826256, + 0.0, + 0.0, + 0.0, + 0.35575496405363083, + 0.037807151675224304, + 0.0, + 0.0, + 0.2145698070526123, + 0.20636866986751556, + 0.0, + 0.9102594591677189, + 0.13590862601995468, + 0.09035790711641312, + 0.08246272802352905, + 0.5176097247749567, + 0.0 + ], + "unique_experts": 51, + "load_cv": 0.9925035277282214, + "normalized_load_entropy": 0.883555894239947, + "max_load_share": 0.06172839506172839 + }, + "full_input": { + "tokens": 68, + "top_k": 6, + "decisions": 408, + "ordered_route_sha256": "19197b95038ad2099819642fe71c821f213e0006fd2cf5f6c8758602e7effe0f", + "route_weight_sha256": "40a763153b6e3babbb26c97deb5baab33f93d5cf7731361b874f8ecd7dd8de99", + "loads": [ + 2, + 0, + 3, + 2, + 2, + 2, + 9, + 3, + 18, + 7, + 8, + 6, + 0, + 8, + 5, + 2, + 18, + 4, + 6, + 2, + 3, + 3, + 2, + 14, + 7, + 6, + 11, + 2, + 5, + 9, + 7, + 1, + 8, + 14, + 4, + 1, + 1, + 5, + 19, + 10, + 7, + 16, + 12, + 12, + 18, + 1, + 11, + 7, + 0, + 0, + 22, + 5, + 1, + 0, + 4, + 12, + 3, + 6, + 7, + 2, + 1, + 7, + 12, + 3 + ], + "weighted_loads": [ + 0.11460819840431213, + 0.0, + 0.17953969910740852, + 0.06338144280016422, + 0.09641318395733833, + 0.07614048942923546, + 0.6343683116137981, + 0.1927674375474453, + 1.4991697147488594, + 0.655129212886095, + 0.6213510483503342, + 0.6150909028947353, + 0.0, + 0.4607044328004122, + 0.24096914008259773, + 0.09194869920611382, + 2.5653031803667545, + 0.2242470532655716, + 0.21451873797923326, + 0.11568934097886086, + 0.16545508056879044, + 0.2178255394101143, + 0.11924022808670998, + 1.2962830625474453, + 0.27614976465702057, + 0.4140540286898613, + 0.9555333666503429, + 0.09095506370067596, + 0.20504830963909626, + 1.0122402645647526, + 0.7002353668212891, + 0.07289805263280869, + 0.5716064609587193, + 0.9134811535477638, + 0.15900447219610214, + 0.04685110226273537, + 0.06493661552667618, + 0.28382208943367004, + 1.8933951184153557, + 0.8837522305548191, + 0.7185114063322544, + 1.4544275104999542, + 1.1697481647133827, + 1.0178802348673344, + 1.8731820993125439, + 0.05312039330601692, + 0.8901741802692413, + 0.41448287293314934, + 0.0, + 0.0, + 1.7599251866340637, + 0.35575496405363083, + 0.037807151675224304, + 0.0, + 0.20681129023432732, + 0.9858445655554533, + 0.20636866986751556, + 0.5345526747405529, + 0.951898604631424, + 0.13590862601995468, + 0.09035790711641312, + 0.3726423345506191, + 0.5952907223254442, + 0.0877796895802021 + ], + "unique_experts": 59, + "load_cv": 0.847231282371306, + "normalized_load_entropy": 0.913692209368911, + "max_load_share": 0.05392156862745098 + } + }, + "s0_x": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "5de74d5fe0cc9eb54ddab0ac5c5eef1fb322fc929229570a3a5b855a542ed25a", + "route_weight_sha256": "778ae8d6422df1071c250c0f5b55fe62f114e54fd332db7c64aa4ba5c0973e6c", + "loads": [ + 2, + 0, + 3, + 0, + 1, + 1, + 1, + 3, + 2, + 5, + 1, + 1, + 0, + 2, + 3, + 1, + 2, + 1, + 3, + 1, + 3, + 2, + 0, + 10, + 3, + 6, + 2, + 3, + 3, + 4, + 7, + 1, + 2, + 6, + 1, + 1, + 1, + 1, + 2, + 7, + 4, + 1, + 2, + 10, + 7, + 1, + 8, + 1, + 0, + 0, + 2, + 5, + 1, + 0, + 0, + 3, + 3, + 0, + 5, + 2, + 1, + 1, + 7, + 0 + ], + "weighted_loads": [ + 0.11212890967726707, + 0.0, + 0.15140173584222794, + 0.0, + 0.052286479622125626, + 0.03177106752991676, + 0.056873541325330734, + 0.18328861519694328, + 0.1625848412513733, + 0.5417356565594673, + 0.05048802122473717, + 0.03369329869747162, + 0.0, + 0.1169261708855629, + 0.17336197942495346, + 0.03588367626070976, + 0.09154296666383743, + 0.05385010689496994, + 0.1387757919728756, + 0.061935409903526306, + 0.1634373739361763, + 0.15002179518342018, + 0.0, + 1.0552968531847, + 0.14459387212991714, + 0.42928100377321243, + 0.13415733352303505, + 0.13073008507490158, + 0.1528579294681549, + 0.2860336862504482, + 0.7231259644031525, + 0.04735749587416649, + 0.17556560039520264, + 0.3801340274512768, + 0.03795965388417244, + 0.04628746956586838, + 0.059933967888355255, + 0.05477779731154442, + 0.17063581943511963, + 0.6841016374528408, + 0.44378626346588135, + 0.04217275604605675, + 0.2738693580031395, + 0.968171127140522, + 0.558008711785078, + 0.05295529216527939, + 0.7543301805853844, + 0.0553722120821476, + 0.0, + 0.0, + 0.08382223546504974, + 0.3494868203997612, + 0.04179675132036209, + 0.0, + 0.0, + 0.21658418886363506, + 0.20592020452022552, + 0.0, + 0.9079122580587864, + 0.1426907293498516, + 0.09091487526893616, + 0.077203668653965, + 0.41744188964366913, + 0.0 + ], + "unique_experts": 54, + "load_cv": 0.9650973496885469, + "normalized_load_entropy": 0.8936356525703189, + "max_load_share": 0.06172839506172839 + }, + "full_input": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "5169e3cf7deda12954e87b595f2d22a1469425217e566b34d7e15431e265e377", + "route_weight_sha256": "25c53455550e2f895cf7ec24e8bada618c413f47bfb680d4fcf7f99f598fb18e", + "loads": [ + 2, + 0, + 3, + 3, + 1, + 3, + 4, + 3, + 10, + 5, + 2, + 5, + 1, + 8, + 3, + 1, + 18, + 5, + 5, + 1, + 3, + 2, + 3, + 12, + 6, + 6, + 6, + 3, + 5, + 4, + 7, + 1, + 5, + 8, + 1, + 1, + 1, + 1, + 11, + 10, + 4, + 12, + 7, + 12, + 10, + 1, + 11, + 4, + 0, + 0, + 16, + 5, + 1, + 1, + 0, + 10, + 3, + 0, + 8, + 2, + 1, + 8, + 9, + 8 + ], + "weighted_loads": [ + 0.11212890967726707, + 0.0, + 0.15140173584222794, + 0.11171025037765503, + 0.052286479622125626, + 0.12920396402478218, + 0.34189198166131973, + 0.18328861519694328, + 0.7547485865652561, + 0.5417356565594673, + 0.08330982178449631, + 0.5401967540383339, + 0.0373733825981617, + 0.4353210236877203, + 0.17336197942495346, + 0.03588367626070976, + 2.4796164706349373, + 0.3184993043541908, + 0.18027160596102476, + 0.061935409903526306, + 0.1634373739361763, + 0.15002179518342018, + 0.17215830460190773, + 1.2281020358204842, + 0.2687511071562767, + 0.42928100377321243, + 0.5037829987704754, + 0.13073008507490158, + 0.2029832024127245, + 0.2860336862504482, + 0.7231259644031525, + 0.04735749587416649, + 0.28968194872140884, + 0.4695294760167599, + 0.03795965388417244, + 0.04628746956586838, + 0.059933967888355255, + 0.05477779731154442, + 1.0042522810399532, + 0.8233405165374279, + 0.44378626346588135, + 0.95878741517663, + 0.7350010760128498, + 1.0200858190655708, + 1.2317608147859573, + 0.05295529216527939, + 0.8849330767989159, + 0.26121725514531136, + 0.0, + 0.0, + 1.1504015140235424, + 0.3494868203997612, + 0.04179675132036209, + 0.0320337638258934, + 0.0, + 0.8711081873625517, + 0.20592020452022552, + 0.0, + 0.9781390074640512, + 0.1426907293498516, + 0.09091487526893616, + 0.42589083686470985, + 0.46055310033261776, + 0.3438628800213337 + ], + "unique_experts": 59, + "load_cv": 0.8461538461538461, + "normalized_load_entropy": 0.9132053862458794, + "max_load_share": 0.057692307692307696 + } + }, + "s1_x": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "f7abb038c80ac9964ff1ca19d896ff2f8c0f27bc35ea372cf7149197c5308da2", + "route_weight_sha256": "16f7f31901b89c97e9fd5a6fdd24c6ec1a6a6b2ce66ba60e2bd6d54d83df3fed", + "loads": [ + 2, + 0, + 3, + 0, + 1, + 1, + 1, + 3, + 2, + 5, + 1, + 1, + 0, + 2, + 3, + 1, + 2, + 1, + 3, + 2, + 2, + 2, + 0, + 9, + 3, + 6, + 3, + 2, + 3, + 4, + 8, + 1, + 2, + 6, + 3, + 1, + 1, + 1, + 2, + 7, + 5, + 0, + 3, + 9, + 7, + 1, + 7, + 1, + 0, + 0, + 1, + 5, + 1, + 1, + 0, + 3, + 3, + 0, + 4, + 2, + 1, + 1, + 7, + 0 + ], + "weighted_loads": [ + 0.11861944943666458, + 0.0, + 0.16563154011964798, + 0.0, + 0.05304498225450516, + 0.030455151572823524, + 0.04706618934869766, + 0.19238264858722687, + 0.15934497863054276, + 0.5396784283220768, + 0.05798695608973503, + 0.03563149273395538, + 0.0, + 0.1234908290207386, + 0.16770440340042114, + 0.035697102546691895, + 0.09184090420603752, + 0.03505793213844299, + 0.1385037712752819, + 0.11585688963532448, + 0.10735940560698509, + 0.15305667743086815, + 0.0, + 0.9904786162078381, + 0.12910327315330505, + 0.43092555180191994, + 0.18479782715439796, + 0.09166741371154785, + 0.155763927847147, + 0.28496696799993515, + 0.7562065534293652, + 0.07561637461185455, + 0.18106117844581604, + 0.3765743859112263, + 0.12227655202150345, + 0.04699360579252243, + 0.061863914132118225, + 0.057845644652843475, + 0.16991881281137466, + 0.6847429275512695, + 0.5019676648080349, + 0.0, + 0.30442097783088684, + 0.9258091151714325, + 0.5515114292502403, + 0.05461074039340019, + 0.7310055270791054, + 0.05572890862822533, + 0.0, + 0.0, + 0.0443221777677536, + 0.35756050422787666, + 0.04350806027650833, + 0.040226880460977554, + 0.0, + 0.2064588312059641, + 0.20395832508802414, + 0.0, + 0.8770382739603519, + 0.1366266869008541, + 0.09282762557268143, + 0.07587315142154694, + 0.418402599170804, + 0.0 + ], + "unique_experts": 54, + "load_cv": 0.9264196214693634, + "normalized_load_entropy": 0.8983939080946216, + "max_load_share": 0.05555555555555555 + }, + "full_input": { + "tokens": 68, + "top_k": 6, + "decisions": 408, + "ordered_route_sha256": "2ae4d9d1c38295d1f161d5f2f04974c0f7889d1a2cb81d115691a8bed347a7c7", + "route_weight_sha256": "f29b3de60b1118d034832f34169e919c7639385eec08279c05a402df824e1692", + "loads": [ + 2, + 0, + 3, + 2, + 2, + 3, + 6, + 3, + 18, + 7, + 8, + 6, + 0, + 9, + 5, + 2, + 19, + 7, + 5, + 2, + 2, + 2, + 2, + 13, + 8, + 6, + 12, + 2, + 5, + 10, + 8, + 1, + 8, + 14, + 3, + 1, + 1, + 5, + 17, + 10, + 7, + 15, + 13, + 12, + 17, + 1, + 11, + 8, + 0, + 0, + 22, + 5, + 1, + 1, + 4, + 12, + 3, + 6, + 6, + 2, + 1, + 8, + 10, + 4 + ], + "weighted_loads": [ + 0.11861944943666458, + 0.0, + 0.16563154011964798, + 0.06338144280016422, + 0.09968096762895584, + 0.1285484042018652, + 0.3583112135529518, + 0.19238264858722687, + 1.5105406492948532, + 0.6416327804327011, + 0.6211740672588348, + 0.6494763940572739, + 0.0, + 0.4900224693119526, + 0.23559216409921646, + 0.09070923924446106, + 2.82394652813673, + 0.37190327420830727, + 0.17956816498190165, + 0.11585688963532448, + 0.10735940560698509, + 0.15305667743086815, + 0.11924022808670998, + 1.212275169789791, + 0.30904747545719147, + 0.43092555180191994, + 0.964345894753933, + 0.09166741371154785, + 0.20558483712375164, + 1.0600592866539955, + 0.7562065534293652, + 0.07561637461185455, + 0.5663861893117428, + 0.9199577458202839, + 0.12227655202150345, + 0.04699360579252243, + 0.061863914132118225, + 0.28547774255275726, + 1.8156973868608475, + 0.8339616283774376, + 0.7237643785774708, + 1.3460607938468456, + 1.1787083595991135, + 1.0214711390435696, + 1.8000742234289646, + 0.05461074039340019, + 0.918452437967062, + 0.4825286976993084, + 0.0, + 0.0, + 1.5622985437512398, + 0.35756050422787666, + 0.04350806027650833, + 0.040226880460977554, + 0.20681129023432732, + 0.9777335897088051, + 0.20395832508802414, + 0.5345526747405529, + 0.918677419424057, + 0.1366266869008541, + 0.09282762557268143, + 0.418830793350935, + 0.49608359672129154, + 0.15733793005347252 + ], + "unique_experts": 60, + "load_cv": 0.8316592180568038, + "normalized_load_entropy": 0.9165668872783606, + "max_load_share": 0.05392156862745098 + } + }, + "s0_period": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "162d19034abb87a5cd9039a7a29f8e8b281f308b6a504bb87d20b6f5ee24bf78", + "route_weight_sha256": "081a2321c505f67e1c1282c14f2bb2e11e26ab572b085ade7ea81541377af3de", + "loads": [ + 2, + 0, + 3, + 0, + 1, + 1, + 1, + 3, + 2, + 6, + 1, + 1, + 0, + 2, + 3, + 1, + 3, + 1, + 3, + 1, + 3, + 1, + 0, + 10, + 3, + 6, + 2, + 2, + 3, + 4, + 7, + 1, + 2, + 5, + 2, + 1, + 1, + 1, + 3, + 7, + 4, + 1, + 2, + 10, + 7, + 1, + 8, + 1, + 0, + 0, + 1, + 5, + 1, + 0, + 0, + 3, + 3, + 0, + 5, + 2, + 1, + 1, + 7, + 0 + ], + "weighted_loads": [ + 0.10704581812024117, + 0.0, + 0.14202331751585007, + 0.0, + 0.053979288786649704, + 0.03216778114438057, + 0.05121593177318573, + 0.1855889894068241, + 0.1609041690826416, + 0.5726736411452293, + 0.05124654620885849, + 0.035911109298467636, + 0.0, + 0.11475905030965805, + 0.1689981333911419, + 0.03628308326005936, + 0.160087950527668, + 0.05393610894680023, + 0.1360093615949154, + 0.06083652749657631, + 0.16165849938988686, + 0.10228006541728973, + 0.0, + 1.0447409711778164, + 0.14565212652087212, + 0.4238048382103443, + 0.137054231017828, + 0.09535752609372139, + 0.1522950530052185, + 0.2758984863758087, + 0.7247865796089172, + 0.04879266396164894, + 0.18147863447666168, + 0.32416292279958725, + 0.07159796357154846, + 0.04754605144262314, + 0.05774674192070961, + 0.05345192924141884, + 0.22315553575754166, + 0.6812769845128059, + 0.43435174971818924, + 0.03840179368853569, + 0.2767922580242157, + 0.9590408392250538, + 0.560745969414711, + 0.050887640565633774, + 0.7644365318119526, + 0.05535070225596428, + 0.0, + 0.0, + 0.04426960274577141, + 0.35099325329065323, + 0.04242797940969467, + 0.0, + 0.0, + 0.2242899239063263, + 0.20485074073076248, + 0.0, + 0.9298268854618073, + 0.13497161865234375, + 0.08788488805294037, + 0.07590583711862564, + 0.4228096269071102, + 0.0 + ], + "unique_experts": 54, + "load_cv": 0.9676208966659853, + "normalized_load_entropy": 0.8928590193376406, + "max_load_share": 0.06172839506172839 + }, + "full_input": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "bed1ec1e632c918c381c9f307a04fc9020e7e03a5cac281c4672c43284dedf70", + "route_weight_sha256": "12366bb00d5b7be07142b31427079793eaf77d5f84385d24978b1628d01ca695", + "loads": [ + 2, + 0, + 3, + 3, + 1, + 2, + 5, + 3, + 11, + 6, + 2, + 5, + 1, + 7, + 3, + 1, + 19, + 5, + 5, + 1, + 3, + 1, + 4, + 12, + 6, + 6, + 6, + 2, + 5, + 4, + 7, + 1, + 5, + 7, + 2, + 1, + 1, + 1, + 13, + 10, + 4, + 13, + 7, + 12, + 10, + 1, + 9, + 3, + 0, + 0, + 17, + 5, + 1, + 1, + 0, + 10, + 3, + 0, + 8, + 2, + 1, + 7, + 9, + 7 + ], + "weighted_loads": [ + 0.10704581812024117, + 0.0, + 0.14202331751585007, + 0.11171025037765503, + 0.053979288786649704, + 0.07401638478040695, + 0.37755393609404564, + 0.1855889894068241, + 0.831754457205534, + 0.5726736411452293, + 0.08406834676861763, + 0.5290135778486729, + 0.035966720432043076, + 0.39948284812271595, + 0.1689981333911419, + 0.03628308326005936, + 2.5275868922472, + 0.31203514337539673, + 0.17750517558306456, + 0.06083652749657631, + 0.16165849938988686, + 0.10228006541728973, + 0.2161644957959652, + 1.2129111103713512, + 0.2698093615472317, + 0.4238048382103443, + 0.5077503509819508, + 0.09535752609372139, + 0.2024203259497881, + 0.2758984863758087, + 0.7247865796089172, + 0.04879266396164894, + 0.2955949828028679, + 0.40809279307723045, + 0.07159796357154846, + 0.04754605144262314, + 0.05774674192070961, + 0.05345192924141884, + 1.1774325296282768, + 0.8207158260047436, + 0.43435174971818924, + 1.0192200653254986, + 0.7320710234344006, + 1.0125915817916393, + 1.2298232428729534, + 0.050887640565633774, + 0.8185933791100979, + 0.21705768629908562, + 0.0, + 0.0, + 1.452952578663826, + 0.35099325329065323, + 0.04242797940969467, + 0.0320337638258934, + 0.0, + 0.8788139224052429, + 0.20485074073076248, + 0.0, + 1.000053634867072, + 0.13497161865234375, + 0.08788488805294037, + 0.37289588898420334, + 0.46592083759605885, + 0.2653937377035618 + ], + "unique_experts": 59, + "load_cv": 0.8744304053835864, + "normalized_load_entropy": 0.909897182308675, + "max_load_share": 0.060897435897435896 + } + }, + "s1_period": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "6fe74b5f7cb37730b3cb64a303dff6cb4c9a65dd28dee3b704f24790d448eebd", + "route_weight_sha256": "2ae20256cead3073a0fa8cad0782aa28dc5d8b80c0328439572a2173097ca9be", + "loads": [ + 2, + 0, + 3, + 0, + 1, + 1, + 1, + 3, + 2, + 5, + 1, + 1, + 0, + 2, + 3, + 1, + 2, + 1, + 3, + 2, + 2, + 2, + 0, + 9, + 3, + 6, + 3, + 2, + 3, + 4, + 8, + 1, + 2, + 6, + 3, + 1, + 1, + 1, + 2, + 7, + 5, + 0, + 3, + 9, + 7, + 1, + 7, + 1, + 0, + 0, + 1, + 5, + 1, + 1, + 0, + 3, + 3, + 0, + 4, + 2, + 1, + 1, + 7, + 0 + ], + "weighted_loads": [ + 0.1165950857102871, + 0.0, + 0.16155333817005157, + 0.0, + 0.05302084982395172, + 0.02884485572576523, + 0.046684954315423965, + 0.1955912709236145, + 0.15930595993995667, + 0.5389371663331985, + 0.05887942388653755, + 0.03486591577529907, + 0.0, + 0.12075158581137657, + 0.16506711766123772, + 0.03616299852728844, + 0.09518078714609146, + 0.03686138242483139, + 0.136052668094635, + 0.11546202376484871, + 0.10965119674801826, + 0.1504855751991272, + 0.0, + 0.980403259396553, + 0.1302371621131897, + 0.42185934633016586, + 0.19249017909169197, + 0.09114884585142136, + 0.15625279396772385, + 0.28037090599536896, + 0.7551691941916943, + 0.07817806303501129, + 0.18369384855031967, + 0.3692706897854805, + 0.12370773777365685, + 0.046645116060972214, + 0.0618438795208931, + 0.05644409731030464, + 0.1844276711344719, + 0.6796190179884434, + 0.48221516236662865, + 0.0, + 0.3141801618039608, + 0.924745038151741, + 0.5535804815590382, + 0.05501498654484749, + 0.7166792303323746, + 0.05482475087046623, + 0.0, + 0.0, + 0.055118363350629807, + 0.35231172665953636, + 0.04432462900876999, + 0.041825443506240845, + 0.0, + 0.20980308949947357, + 0.20211488381028175, + 0.0, + 0.891592264175415, + 0.13728103414177895, + 0.08770987391471863, + 0.08070303499698639, + 0.41985926032066345, + 0.0 + ], + "unique_experts": 54, + "load_cv": 0.9264196214693634, + "normalized_load_entropy": 0.8983939080946216, + "max_load_share": 0.05555555555555555 + }, + "full_input": { + "tokens": 68, + "top_k": 6, + "decisions": 408, + "ordered_route_sha256": "348510b026a0aacde55f6d4285d7df23a6c8b590c2d0ea7fc2e6b06ab32d5915", + "route_weight_sha256": "cc3a6aee6f5404b8982893dc60aac777d29159707b3c2e23e0bbcba86bece406", + "loads": [ + 2, + 0, + 3, + 2, + 2, + 2, + 7, + 3, + 19, + 7, + 9, + 6, + 0, + 8, + 5, + 2, + 19, + 6, + 5, + 2, + 2, + 3, + 3, + 12, + 7, + 6, + 12, + 2, + 5, + 10, + 8, + 1, + 9, + 14, + 3, + 1, + 1, + 5, + 18, + 10, + 7, + 17, + 13, + 11, + 17, + 1, + 9, + 7, + 0, + 0, + 24, + 5, + 1, + 1, + 4, + 12, + 3, + 6, + 6, + 2, + 1, + 7, + 10, + 3 + ], + "weighted_loads": [ + 0.1165950857102871, + 0.0, + 0.16155333817005157, + 0.06338144280016422, + 0.0996568351984024, + 0.07345609366893768, + 0.39871908351778984, + 0.1955912709236145, + 1.5722001791000366, + 0.6408915184438229, + 0.6598828919231892, + 0.5982736647129059, + 0.0, + 0.4576896522194147, + 0.23295487836003304, + 0.0911751352250576, + 2.7802690155804157, + 0.3009115792810917, + 0.17711706180125475, + 0.11546202376484871, + 0.10965119674801826, + 0.20816848799586296, + 0.15181633457541466, + 1.163252491503954, + 0.2774682976305485, + 0.42185934633016586, + 0.9660793356597424, + 0.09114884585142136, + 0.2060737032443285, + 1.0554632246494293, + 0.7551691941916943, + 0.07817806303501129, + 0.6027902625501156, + 0.9126540496945381, + 0.12370773777365685, + 0.046645116060972214, + 0.0618438795208931, + 0.28407619521021843, + 1.9106434509158134, + 0.8288743235170841, + 0.7040118761360645, + 1.4458844847977161, + 1.1886266507208347, + 0.9828999415040016, + 1.802976317703724, + 0.05501498654484749, + 0.8234528787434101, + 0.4142211265861988, + 0.0, + 0.0, + 2.0085853822529316, + 0.35231172665953636, + 0.04432462900876999, + 0.041825443506240845, + 0.20681129023432732, + 0.9810778480023146, + 0.20211488381028175, + 0.5345526747405529, + 0.9332314096391201, + 0.13728103414177895, + 0.08770987391471863, + 0.37088264152407646, + 0.49754025787115097, + 0.0877796895802021 + ], + "unique_experts": 60, + "load_cv": 0.8567079323511169, + "normalized_load_entropy": 0.9143381167365912, + "max_load_share": 0.058823529411764705 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 27, + "ordered_topk_exact_tokens": 19, + "set_exact_tokens": 25, + "mean_set_jaccard": 0.978835978835979, + "mean_token_weighted_tv": 0.01040250611388021, + "aggregate_load_tv": 0.012345679012345678 + }, + "system_bos": { + "tokens": 27, + "ordered_topk_exact_tokens": 19, + "set_exact_tokens": 21, + "mean_set_jaccard": 0.9365079365079365, + "mean_token_weighted_tv": 0.019362955285167252, + "aggregate_load_tv": 0.024691358024691357 + }, + "system_x": { + "tokens": 27, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.9012345679012347, + "mean_token_weighted_tv": 0.02591965816639088, + "aggregate_load_tv": 0.04938271604938271 + }, + "system_period": { + "tokens": 27, + "ordered_topk_exact_tokens": 17, + "set_exact_tokens": 18, + "mean_set_jaccard": 0.8857142857142859, + "mean_token_weighted_tv": 0.03137455087293078, + "aggregate_load_tv": 0.05555555555555555 + }, + "bos_at_s0": { + "tokens": 27, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 20, + "mean_set_jaccard": 0.9259259259259259, + "mean_token_weighted_tv": 0.02308903827711388, + "aggregate_load_tv": 0.037037037037037035 + }, + "bos_at_s1": { + "tokens": 27, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.9153439153439153, + "mean_token_weighted_tv": 0.02675488342841466, + "aggregate_load_tv": 0.043209876543209874 + }, + "x_at_s0": { + "tokens": 27, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 18, + "mean_set_jaccard": 0.8906525573192241, + "mean_token_weighted_tv": 0.030560238804254267, + "aggregate_load_tv": 0.05555555555555555 + }, + "x_at_s1": { + "tokens": 27, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 18, + "mean_set_jaccard": 0.8857142857142859, + "mean_token_weighted_tv": 0.03553676467250894, + "aggregate_load_tv": 0.05555555555555555 + }, + "period_at_s0": { + "tokens": 27, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.8862433862433862, + "mean_token_weighted_tv": 0.03324716048384154, + "aggregate_load_tv": 0.06172839506172839 + }, + "period_at_s1": { + "tokens": 27, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 18, + "mean_set_jaccard": 0.8857142857142859, + "mean_token_weighted_tv": 0.0364109946552802, + "aggregate_load_tv": 0.05555555555555555 + } + } + }, + "layer_08": { + "layer": 8, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "274ef589df7dec78f2d8ffb87b10db74b7c29736c5a76d54cf6803d8dea1579c", + "route_weight_sha256": "6ef00e890f2981e43f3e274eda3711031bd1f8dd95c34702c3e7728d7a1a841a", + "loads": [ + 2, + 0, + 0, + 2, + 2, + 2, + 2, + 1, + 0, + 1, + 2, + 7, + 3, + 0, + 6, + 7, + 1, + 11, + 4, + 5, + 2, + 0, + 1, + 3, + 2, + 0, + 0, + 1, + 6, + 1, + 10, + 1, + 0, + 5, + 3, + 0, + 0, + 0, + 2, + 11, + 10, + 1, + 3, + 0, + 1, + 2, + 1, + 3, + 4, + 0, + 0, + 1, + 1, + 0, + 11, + 0, + 1, + 4, + 0, + 6, + 5, + 0, + 2, + 0 + ], + "weighted_loads": [ + 0.15946143493056297, + 0.0, + 0.0, + 0.19546286016702652, + 0.10481002181768417, + 0.07640551775693893, + 0.165648452937603, + 0.042095478624105453, + 0.0, + 0.10099010914564133, + 0.14580056071281433, + 0.5255039446055889, + 0.21492809802293777, + 0.0, + 0.4888533912599087, + 0.3790108449757099, + 0.04521236941218376, + 0.955445758998394, + 0.19670353643596172, + 0.210532758384943, + 0.12989740446209908, + 0.0, + 0.06358207762241364, + 0.20546825975179672, + 0.07182451710104942, + 0.0, + 0.0, + 0.04739860072731972, + 0.37005237862467766, + 0.032062970101833344, + 0.8986946381628513, + 0.05754030868411064, + 0.0, + 0.20731844007968903, + 0.11519943177700043, + 0.0, + 0.0, + 0.0, + 0.2908490225672722, + 1.0110394693911076, + 0.407461304217577, + 0.04435179382562637, + 0.21984406560659409, + 0.0, + 0.03576122596859932, + 0.19662030786275864, + 0.06878706812858582, + 0.1981964446604252, + 0.43330465629696846, + 0.0, + 0.0, + 0.04864714667201042, + 0.06879092007875443, + 0.0, + 1.309554647654295, + 0.0, + 0.06441034376621246, + 0.3186084181070328, + 0.0, + 0.8443780392408371, + 0.31822987273335457, + 0.0, + 0.10513446107506752, + 0.0 + ], + "unique_experts": 45, + "load_cv": 1.1933233964636232, + "normalized_load_entropy": 0.8415846114183294, + "max_load_share": 0.06790123456790123 + }, + "full_input": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "34da54cb1b0bb3b2a44c55feec123a3fbd6fc973ae0edf1ae34102ebc5c00bef", + "route_weight_sha256": "9820b213fad8c294de7ac3f2780231aaff7bb895b759f00d90d67831113b3072", + "loads": [ + 2, + 6, + 1, + 3, + 4, + 2, + 7, + 2, + 9, + 1, + 3, + 10, + 10, + 7, + 6, + 7, + 1, + 14, + 4, + 5, + 3, + 0, + 3, + 3, + 2, + 11, + 0, + 1, + 6, + 1, + 13, + 1, + 4, + 20, + 3, + 0, + 0, + 0, + 2, + 18, + 17, + 1, + 3, + 0, + 1, + 9, + 8, + 7, + 4, + 3, + 3, + 1, + 12, + 0, + 15, + 7, + 1, + 4, + 4, + 6, + 5, + 0, + 3, + 3 + ], + "weighted_loads": [ + 0.15946143493056297, + 0.36929475143551826, + 0.0122604388743639, + 0.3108488470315933, + 0.16816359222866595, + 0.07640551775693893, + 0.6379261016845703, + 0.08737703412771225, + 0.5895019210875034, + 0.10099010914564133, + 0.22893529385328293, + 0.6175484172999859, + 0.5955996997654438, + 0.5265586413443089, + 0.4888533912599087, + 0.3790108449757099, + 0.04521236941218376, + 1.1202640756964684, + 0.19670353643596172, + 0.210532758384943, + 0.2025570459663868, + 0.0, + 0.1367444470524788, + 0.20546825975179672, + 0.07182451710104942, + 0.7688084281980991, + 0.0, + 0.04739860072731972, + 0.37005237862467766, + 0.032062970101833344, + 0.97547059180215, + 0.05754030868411064, + 0.1717781350016594, + 1.4634430333971977, + 0.11519943177700043, + 0.0, + 0.0, + 0.0, + 0.2908490225672722, + 1.2358170971274376, + 0.8082287684082985, + 0.04435179382562637, + 0.21984406560659409, + 0.0, + 0.03576122596859932, + 0.8985796943306923, + 0.8490291386842728, + 0.32078111078590155, + 0.43330465629696846, + 0.13868534192442894, + 0.17005208507180214, + 0.04864714667201042, + 0.7299381457269192, + 0.0, + 2.8881181310862303, + 0.3739186767488718, + 0.06441034376621246, + 0.3186084181070328, + 0.11584949353709817, + 0.8443780392408371, + 0.31822987273335457, + 0.0, + 0.15144718438386917, + 0.20601917430758476 + ], + "unique_experts": 56, + "load_cv": 0.9719944318474291, + "normalized_load_entropy": 0.8929803912296581, + "max_load_share": 0.0641025641025641 + } + }, + "s1_eos": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "86ceb15f8e07712475631481e438f0aba4a9ed3f592729cb20b8e74445c08d7a", + "route_weight_sha256": "097dbdfc3c735e4b79a18b120954fc19cd9c597ed12e94626bf8386cc8609a69", + "loads": [ + 2, + 0, + 0, + 2, + 2, + 3, + 2, + 0, + 0, + 2, + 2, + 6, + 3, + 0, + 6, + 7, + 1, + 10, + 4, + 6, + 2, + 0, + 1, + 3, + 0, + 0, + 0, + 1, + 6, + 1, + 10, + 1, + 0, + 6, + 3, + 0, + 1, + 0, + 2, + 11, + 10, + 1, + 3, + 0, + 1, + 2, + 1, + 3, + 4, + 0, + 0, + 1, + 1, + 0, + 10, + 0, + 1, + 4, + 0, + 6, + 5, + 0, + 2, + 1 + ], + "weighted_loads": [ + 0.16497930139303207, + 0.0, + 0.0, + 0.18725919723510742, + 0.10719909891486168, + 0.11721879616379738, + 0.16090363264083862, + 0.0, + 0.0, + 0.13585660234093666, + 0.1471063271164894, + 0.47031595557928085, + 0.21507837250828743, + 0.0, + 0.49253522232174873, + 0.3722785450518131, + 0.04417272284626961, + 0.9194949939846992, + 0.20296086184680462, + 0.25663192570209503, + 0.13091173395514488, + 0.0, + 0.06395244598388672, + 0.20325859636068344, + 0.0, + 0.0, + 0.0, + 0.05038870871067047, + 0.3715413510799408, + 0.0336572490632534, + 0.8866137489676476, + 0.058217961341142654, + 0.0, + 0.2563222534954548, + 0.11694324761629105, + 0.0, + 0.04402206465601921, + 0.0, + 0.279480017721653, + 0.975029282271862, + 0.39252900891005993, + 0.044671159237623215, + 0.22183401137590408, + 0.0, + 0.03621748834848404, + 0.20553669333457947, + 0.062471549957990646, + 0.19283811375498772, + 0.4333771951496601, + 0.0, + 0.0, + 0.05451799929141998, + 0.08610662072896957, + 0.0, + 1.245519034564495, + 0.0, + 0.06873274594545364, + 0.3221239149570465, + 0.0, + 0.8544284403324127, + 0.3228440582752228, + 0.0, + 0.10613482818007469, + 0.038201697170734406 + ], + "unique_experts": 45, + "load_cv": 1.164361822847128, + "normalized_load_entropy": 0.8449338774681296, + "max_load_share": 0.06790123456790123 + }, + "full_input": { + "tokens": 68, + "top_k": 6, + "decisions": 408, + "ordered_route_sha256": "c08af1f259dbae9354d11ca04a04264fa6c44508119405843b1e122316f23b6c", + "route_weight_sha256": "94e4eaef63e8f6e7579ec0173f535d79d104e428b7da02b37b654454e1d4f36d", + "loads": [ + 3, + 5, + 10, + 4, + 4, + 4, + 13, + 0, + 14, + 2, + 5, + 10, + 12, + 7, + 6, + 7, + 1, + 24, + 5, + 6, + 3, + 0, + 2, + 7, + 0, + 11, + 0, + 3, + 7, + 1, + 13, + 1, + 4, + 27, + 3, + 0, + 1, + 0, + 8, + 16, + 23, + 1, + 5, + 0, + 1, + 15, + 16, + 7, + 7, + 4, + 4, + 1, + 10, + 6, + 14, + 10, + 1, + 4, + 3, + 8, + 5, + 4, + 4, + 6 + ], + "weighted_loads": [ + 0.2043856419622898, + 0.27911216393113136, + 0.6220426540821791, + 0.3511386774480343, + 0.196756761521101, + 0.16164611652493477, + 1.1301168948411942, + 0.0, + 0.9033844731748104, + 0.13585660234093666, + 0.3167010098695755, + 0.588162092724815, + 0.7483855411410332, + 0.49888670817017555, + 0.49253522232174873, + 0.3722785450518131, + 0.04417272284626961, + 1.9236342124640942, + 0.25083903409540653, + 0.25663192570209503, + 0.2059514783322811, + 0.0, + 0.10343339666724205, + 0.39201031252741814, + 0.0, + 1.116694912314415, + 0.0, + 0.17056627199053764, + 0.4136018119752407, + 0.0336572490632534, + 0.9647171949036419, + 0.058217961341142654, + 0.1442105919122696, + 1.8083433024585247, + 0.11694324761629105, + 0.0, + 0.04402206465601921, + 0.0, + 0.6793622635304928, + 1.1161508625373244, + 1.009432977065444, + 0.044671159237623215, + 0.3914339281618595, + 0.0, + 0.03621748834848404, + 1.460931371897459, + 1.2204548865556717, + 0.30724585615098476, + 0.7479951344430447, + 0.2604434937238693, + 0.22125385701656342, + 0.05451799929141998, + 0.6081899050623178, + 0.6722221523523331, + 2.8278218135237694, + 0.6144136860966682, + 0.06873274594545364, + 0.3221239149570465, + 0.10011706873774529, + 0.9282736927270889, + 0.3228440582752228, + 0.18889345973730087, + 0.20517617091536522, + 0.3286031112074852 + ], + "unique_experts": 57, + "load_cv": 0.9323524257230384, + "normalized_load_entropy": 0.9014480205474026, + "max_load_share": 0.0661764705882353 + } + }, + "s0_bos": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "a4ab591fa981cdefc88d15b42fea7df220413e55fa3791f2b54fcaad1716f5e0", + "route_weight_sha256": "c11c5f1ef3eaeb84191ccfcf151d4e6ae61b8af1168596e9495eae7a5820582c", + "loads": [ + 3, + 0, + 0, + 2, + 3, + 3, + 2, + 0, + 0, + 1, + 2, + 7, + 3, + 0, + 5, + 7, + 1, + 10, + 4, + 4, + 2, + 0, + 1, + 4, + 2, + 0, + 0, + 1, + 6, + 1, + 10, + 1, + 0, + 5, + 3, + 0, + 1, + 0, + 2, + 10, + 10, + 1, + 3, + 0, + 1, + 2, + 1, + 3, + 4, + 0, + 0, + 1, + 1, + 0, + 10, + 0, + 1, + 5, + 0, + 6, + 5, + 0, + 2, + 0 + ], + "weighted_loads": [ + 0.20991617813706398, + 0.0, + 0.0, + 0.1974734179675579, + 0.1373281441628933, + 0.12716476991772652, + 0.16800332069396973, + 0.0, + 0.0, + 0.10250771790742874, + 0.1422753483057022, + 0.5329156182706356, + 0.22874154150485992, + 0.0, + 0.46686556562781334, + 0.3787863925099373, + 0.044353682547807693, + 0.9351834319531918, + 0.2008436918258667, + 0.18407367542386055, + 0.12636178359389305, + 0.0, + 0.06426415592432022, + 0.25386498868465424, + 0.07611236721277237, + 0.0, + 0.0, + 0.045902591198682785, + 0.3738638237118721, + 0.03146534785628319, + 0.8964578285813332, + 0.057475410401821136, + 0.0, + 0.20278491266071796, + 0.12180223315954208, + 0.0, + 0.046016160398721695, + 0.0, + 0.30007538199424744, + 0.9244496040046215, + 0.38902795501053333, + 0.04302434250712395, + 0.2321145161986351, + 0.0, + 0.03683910891413689, + 0.18721234798431396, + 0.06986255943775177, + 0.20216210931539536, + 0.4677591994404793, + 0.0, + 0.0, + 0.055880650877952576, + 0.07885459065437317, + 0.0, + 1.2550293020904064, + 0.0, + 0.07072193920612335, + 0.3534621596336365, + 0.0, + 0.7843638360500336, + 0.31245454028248787, + 0.0, + 0.11081452667713165, + 0.0 + ], + "unique_experts": 45, + "load_cv": 1.1389516192700861, + "normalized_load_entropy": 0.8486769571940219, + "max_load_share": 0.06172839506172839 + }, + "full_input": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "ac5099f42005fc2a1d94d55d93d865ff84a9c199050c169a90f85ea839d15fa4", + "route_weight_sha256": "5c420ff2ec84fd0d1fe9e01ae2a5caa1831f6e4cb99f5a3e6f58332abf8e3e1a", + "loads": [ + 3, + 6, + 1, + 4, + 5, + 3, + 7, + 1, + 8, + 1, + 4, + 10, + 10, + 7, + 5, + 8, + 1, + 14, + 4, + 4, + 3, + 0, + 3, + 4, + 3, + 12, + 0, + 1, + 6, + 1, + 13, + 1, + 5, + 20, + 3, + 0, + 1, + 0, + 2, + 16, + 15, + 1, + 3, + 0, + 1, + 9, + 8, + 6, + 4, + 3, + 3, + 1, + 12, + 0, + 14, + 6, + 1, + 5, + 3, + 6, + 5, + 0, + 3, + 3 + ], + "weighted_loads": [ + 0.20991617813706398, + 0.36929475143551826, + 0.0122604388743639, + 0.38973285257816315, + 0.2504631243646145, + 0.12716476991772652, + 0.630607970058918, + 0.045281555503606796, + 0.5708269402384758, + 0.10250771790742874, + 0.28775379806756973, + 0.6249600909650326, + 0.609413143247366, + 0.517884161323309, + 0.46686556562781334, + 0.42531586065888405, + 0.044353682547807693, + 1.1296523287892342, + 0.2008436918258667, + 0.18407367542386055, + 0.20582244917750359, + 0.0, + 0.13742652535438538, + 0.25386498868465424, + 0.12259112298488617, + 0.826637152582407, + 0.0, + 0.045902591198682785, + 0.3738638237118721, + 0.03146534785628319, + 1.0175457783043385, + 0.057475410401821136, + 0.22977066412568092, + 1.4334181379526854, + 0.12180223315954208, + 0.0, + 0.046016160398721695, + 0.0, + 0.30007538199424744, + 1.1639693016186357, + 0.7071116361767054, + 0.04302434250712395, + 0.2321145161986351, + 0.0, + 0.03683910891413689, + 0.8259462714195251, + 0.7643661871552467, + 0.3154060496017337, + 0.4677591994404793, + 0.13611745089292526, + 0.17005208507180214, + 0.055880650877952576, + 0.7400018163025379, + 0.0, + 1.9602238964289427, + 0.33608331717550755, + 0.07072193920612335, + 0.3534621596336365, + 0.11282139644026756, + 0.7843638360500336, + 0.31245454028248787, + 0.0, + 0.1571272499859333, + 0.20601917430758476 + ], + "unique_experts": 57, + "load_cv": 0.9262765060609457, + "normalized_load_entropy": 0.900815295963182, + "max_load_share": 0.0641025641025641 + } + }, + "s1_bos": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "3f8e5a181d6ddc552499f71d7710f7765e0821ae04a1e19ecd3688cf88b6f16f", + "route_weight_sha256": "e6c67c39a2fde9ba049a5cb3c335a1a6217f425ef847d8989dedd939efb4b53a", + "loads": [ + 3, + 0, + 0, + 2, + 3, + 2, + 2, + 1, + 0, + 2, + 2, + 7, + 3, + 1, + 5, + 7, + 2, + 9, + 4, + 4, + 2, + 0, + 1, + 4, + 0, + 0, + 0, + 1, + 6, + 1, + 10, + 1, + 0, + 5, + 3, + 0, + 1, + 0, + 2, + 11, + 9, + 1, + 3, + 0, + 1, + 2, + 1, + 2, + 4, + 0, + 0, + 1, + 1, + 1, + 10, + 0, + 1, + 5, + 0, + 6, + 5, + 0, + 2, + 0 + ], + "weighted_loads": [ + 0.20678088441491127, + 0.0, + 0.0, + 0.19301122799515724, + 0.1358790136873722, + 0.08830544352531433, + 0.1633889079093933, + 0.03942740336060524, + 0.0, + 0.13120044209063053, + 0.1477217972278595, + 0.5225645937025547, + 0.22025569155812263, + 0.04108637198805809, + 0.46235452964901924, + 0.3803253322839737, + 0.08628323674201965, + 0.889656737446785, + 0.20503094233572483, + 0.1851467341184616, + 0.12912187725305557, + 0.0, + 0.0634307935833931, + 0.2531747370958328, + 0.0, + 0.0, + 0.0, + 0.047026872634887695, + 0.38406235724687576, + 0.034975215792655945, + 0.8788143582642078, + 0.05912189185619354, + 0.0, + 0.22365766018629074, + 0.13334045559167862, + 0.0, + 0.053972017019987106, + 0.0, + 0.31803521513938904, + 0.9224722906947136, + 0.3349529728293419, + 0.04602702334523201, + 0.23273880779743195, + 0.0, + 0.03733452782034874, + 0.2005481868982315, + 0.06600617617368698, + 0.14965180680155754, + 0.4617297351360321, + 0.0, + 0.0, + 0.06653133779764175, + 0.07438334077596664, + 0.030970335006713867, + 1.2820999398827553, + 0.0, + 0.08941381424665451, + 0.3551202788949013, + 0.0, + 0.8168000914156437, + 0.31133878976106644, + 0.0, + 0.10555826872587204, + 0.0 + ], + "unique_experts": 47, + "load_cv": 1.115150408178576, + "normalized_load_entropy": 0.8569642205890587, + "max_load_share": 0.06790123456790123 + }, + "full_input": { + "tokens": 68, + "top_k": 6, + "decisions": 408, + "ordered_route_sha256": "1b3cdaf7135d6adfe0d8a03c81b4904f0e9158fd2228db0feef67e5413d70e6c", + "route_weight_sha256": "51f6ac3ca3dd09f1e7d0586cd927f6de3f6b6b298303f2152c1920388b59537a", + "loads": [ + 4, + 5, + 10, + 5, + 6, + 3, + 13, + 1, + 13, + 2, + 6, + 10, + 12, + 8, + 5, + 8, + 2, + 24, + 5, + 4, + 3, + 0, + 2, + 8, + 0, + 11, + 0, + 3, + 7, + 1, + 13, + 1, + 4, + 27, + 3, + 0, + 1, + 0, + 8, + 15, + 21, + 1, + 5, + 0, + 1, + 16, + 16, + 5, + 7, + 5, + 4, + 1, + 10, + 7, + 13, + 9, + 1, + 5, + 2, + 7, + 5, + 4, + 4, + 6 + ], + "weighted_loads": [ + 0.246187224984169, + 0.27911216393113136, + 0.6220426540821791, + 0.4267762675881386, + 0.27603157609701157, + 0.13273276388645172, + 1.125597469508648, + 0.03942740336060524, + 0.8822586201131344, + 0.13120044209063053, + 0.37672753259539604, + 0.6372431870549917, + 0.7535628601908684, + 0.5333114713430405, + 0.46235452964901924, + 0.4206356443464756, + 0.08628323674201965, + 1.9302732646465302, + 0.25290911458432674, + 0.1851467341184616, + 0.21207033842802048, + 0.0, + 0.10291174426674843, + 0.4419264532625675, + 0.0, + 1.116694912314415, + 0.0, + 0.16720443591475487, + 0.4261228181421757, + 0.034975215792655945, + 0.9941515140235424, + 0.05912189185619354, + 0.1442105919122696, + 1.8189730755984783, + 0.13334045559167862, + 0.0, + 0.053972017019987106, + 0.0, + 0.7179174609482288, + 1.0691131064668298, + 0.9286763593554497, + 0.04602702334523201, + 0.4023387245833874, + 0.0, + 0.03733452782034874, + 1.4652051515877247, + 1.1623986028134823, + 0.2550140945240855, + 0.7763476744294167, + 0.30751756206154823, + 0.22125385701656342, + 0.06653133779764175, + 0.5964666251093149, + 0.7031924873590469, + 1.9518099017441273, + 0.5796261839568615, + 0.08941381424665451, + 0.3551202788949013, + 0.09720657393336296, + 0.8503968268632889, + 0.31133878976106644, + 0.18889345973730087, + 0.20459961146116257, + 0.34180765226483345 + ], + "unique_experts": 58, + "load_cv": 0.9081204844634833, + "normalized_load_entropy": 0.9063568398735237, + "max_load_share": 0.0661764705882353 + } + }, + "s0_x": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "61ed9db108d587c7755a02b635eb8f6bae49072e218c288bc4f4aada5e13eddf", + "route_weight_sha256": "6a0afff7ccf447eb6b3b35de6d14109bb400f0c1224ac902997e1ca522d629de", + "loads": [ + 3, + 1, + 0, + 2, + 3, + 2, + 2, + 1, + 0, + 1, + 2, + 7, + 3, + 1, + 5, + 7, + 1, + 10, + 4, + 4, + 1, + 0, + 1, + 4, + 1, + 0, + 0, + 1, + 5, + 1, + 10, + 1, + 0, + 6, + 3, + 0, + 0, + 0, + 2, + 10, + 11, + 1, + 3, + 0, + 1, + 2, + 1, + 3, + 4, + 0, + 0, + 1, + 1, + 0, + 10, + 0, + 1, + 5, + 0, + 6, + 5, + 0, + 2, + 0 + ], + "weighted_loads": [ + 0.21427227184176445, + 0.04648267477750778, + 0.0, + 0.19837304949760437, + 0.13428124226629734, + 0.09363147243857384, + 0.17331992089748383, + 0.0441289097070694, + 0.0, + 0.09635947644710541, + 0.1473546400666237, + 0.5350200943648815, + 0.2255595289170742, + 0.04455575719475746, + 0.44008879363536835, + 0.3836447075009346, + 0.04177847132086754, + 0.9115960672497749, + 0.2033664844930172, + 0.18605974689126015, + 0.07802775502204895, + 0.0, + 0.06146235391497612, + 0.2530973218381405, + 0.032576218247413635, + 0.0, + 0.0, + 0.04504783824086189, + 0.3236984796822071, + 0.03142472729086876, + 0.8685859069228172, + 0.05569339543581009, + 0.0, + 0.28267373889684677, + 0.12042364478111267, + 0.0, + 0.0, + 0.0, + 0.29420124739408493, + 0.8916293755173683, + 0.44281697273254395, + 0.045897990465164185, + 0.22845028340816498, + 0.0, + 0.035878948867321014, + 0.20637688040733337, + 0.0714212954044342, + 0.18575379624962807, + 0.4758743867278099, + 0.0, + 0.0, + 0.06336115300655365, + 0.07295998185873032, + 0.0, + 1.2597492150962353, + 0.0, + 0.06021582707762718, + 0.34824587404727936, + 0.0, + 0.7808318063616753, + 0.31008171662688255, + 0.0, + 0.1060522310435772, + 0.0 + ], + "unique_experts": 47, + "load_cv": 1.1517268004049046, + "normalized_load_entropy": 0.8506526985993993, + "max_load_share": 0.06790123456790123 + }, + "full_input": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "c30081b8f77e86118ec81af06e901121e423815471c03602ed9849d9f972b348", + "route_weight_sha256": "c8d3447b50f05529118b6976bac478df804e2de6b6c891868edf613f4591327d", + "loads": [ + 3, + 8, + 2, + 4, + 5, + 2, + 8, + 2, + 9, + 1, + 3, + 10, + 10, + 9, + 5, + 7, + 1, + 13, + 4, + 4, + 2, + 0, + 3, + 4, + 1, + 13, + 0, + 1, + 5, + 1, + 12, + 1, + 6, + 19, + 3, + 0, + 0, + 0, + 2, + 15, + 16, + 1, + 3, + 0, + 1, + 8, + 9, + 6, + 4, + 4, + 4, + 1, + 12, + 0, + 12, + 7, + 1, + 5, + 3, + 6, + 5, + 0, + 3, + 3 + ], + "weighted_loads": [ + 0.21427227184176445, + 0.4684884026646614, + 0.05476824380457401, + 0.38977618515491486, + 0.24449924193322659, + 0.09363147243857384, + 0.67868971824646, + 0.0894104652106762, + 0.6634416952729225, + 0.09635947644710541, + 0.23023438453674316, + 0.6270645670592785, + 0.6062311306595802, + 0.6443431079387665, + 0.44008879363536835, + 0.3836447075009346, + 0.04177847132086754, + 1.0525201335549355, + 0.2033664844930172, + 0.18605974689126015, + 0.15637775510549545, + 0.0, + 0.13462472334504128, + 0.2530973218381405, + 0.032576218247413635, + 0.9208830334246159, + 0.0, + 0.04504783824086189, + 0.3236984796822071, + 0.03142472729086876, + 0.9371279738843441, + 0.05569339543581009, + 0.28004589304327965, + 1.265243038535118, + 0.12042364478111267, + 0.0, + 0.0, + 0.0, + 0.29420124739408493, + 1.0776128182187676, + 0.7420263849198818, + 0.045897990465164185, + 0.22845028340816498, + 0.0, + 0.035878948867321014, + 0.7863068655133247, + 0.830854631960392, + 0.2989977365359664, + 0.4758743867278099, + 0.1943208947777748, + 0.2245970219373703, + 0.06336115300655365, + 0.7341072075068951, + 0.0, + 1.8825627658516169, + 0.38603134639561176, + 0.06021582707762718, + 0.34824587404727936, + 0.11282139644026756, + 0.7808318063616753, + 0.31008171662688255, + 0.0, + 0.15236495435237885, + 0.20601917430758476 + ], + "unique_experts": 56, + "load_cv": 0.9141304343577378, + "normalized_load_entropy": 0.8998479138086897, + "max_load_share": 0.060897435897435896 + } + }, + "s1_x": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "135689ed7a8f53f6933115d9e213891cc4ecf28b4c2cea2a5f33528df648280e", + "route_weight_sha256": "9840aab74067b6d6cd93846fbd665ed4a24a2ca4d3ef8ac51df8e3c9ce41f4a1", + "loads": [ + 3, + 1, + 0, + 3, + 3, + 3, + 2, + 1, + 0, + 1, + 2, + 6, + 3, + 0, + 5, + 7, + 1, + 12, + 4, + 4, + 1, + 0, + 1, + 4, + 1, + 0, + 0, + 1, + 5, + 1, + 9, + 1, + 0, + 6, + 3, + 0, + 1, + 0, + 2, + 9, + 9, + 1, + 3, + 0, + 1, + 3, + 2, + 2, + 4, + 0, + 0, + 1, + 1, + 0, + 10, + 1, + 1, + 4, + 0, + 6, + 5, + 0, + 2, + 0 + ], + "weighted_loads": [ + 0.2258577048778534, + 0.04074367135763168, + 0.0, + 0.23133080825209618, + 0.13204455561935902, + 0.13353471085429192, + 0.17087452858686447, + 0.03877171128988266, + 0.0, + 0.0987359806895256, + 0.1487126126885414, + 0.47540609538555145, + 0.21611391752958298, + 0.0, + 0.45090941339731216, + 0.3879009932279587, + 0.04081577807664871, + 0.9890523925423622, + 0.22104943357408047, + 0.18592817336320877, + 0.07912833243608475, + 0.0, + 0.059288397431373596, + 0.24462180957198143, + 0.03214278817176819, + 0.0, + 0.0, + 0.048247259110212326, + 0.34293028339743614, + 0.03596096113324165, + 0.8319547027349472, + 0.059428658336400986, + 0.0, + 0.25655344501137733, + 0.1328352876007557, + 0.0, + 0.05845935642719269, + 0.0, + 0.3074335753917694, + 0.8414218053221703, + 0.3402821309864521, + 0.05114542692899704, + 0.23400603607296944, + 0.0, + 0.035484205931425095, + 0.26489920169115067, + 0.0990622229874134, + 0.14861013367772102, + 0.4570699594914913, + 0.0, + 0.0, + 0.08046650141477585, + 0.07688303291797638, + 0.0, + 1.2800260856747627, + 0.06381858140230179, + 0.07324767857789993, + 0.3026787042617798, + 0.0, + 0.7810272350907326, + 0.3166787810623646, + 0.0, + 0.10634282231330872, + 0.0 + ], + "unique_experts": 48, + "load_cv": 1.1063684791720763, + "normalized_load_entropy": 0.8602675551057994, + "max_load_share": 0.07407407407407407 + }, + "full_input": { + "tokens": 68, + "top_k": 6, + "decisions": 408, + "ordered_route_sha256": "c7e982bdde55cfdb8c0bb0965a5ccf5954d4dfc3bbdd960829f5bd4e91082f77", + "route_weight_sha256": "f65bf0077daa29b8c57d415fad2cf00ef05c038fb5583a3a361765698d332fe4", + "loads": [ + 4, + 7, + 11, + 5, + 5, + 4, + 15, + 1, + 14, + 1, + 6, + 10, + 12, + 9, + 5, + 7, + 1, + 26, + 5, + 4, + 2, + 0, + 2, + 8, + 1, + 14, + 0, + 3, + 6, + 1, + 11, + 1, + 5, + 24, + 3, + 0, + 1, + 0, + 8, + 12, + 20, + 1, + 5, + 0, + 1, + 16, + 17, + 5, + 7, + 6, + 5, + 1, + 10, + 6, + 12, + 10, + 1, + 4, + 2, + 7, + 5, + 4, + 4, + 5 + ], + "weighted_loads": [ + 0.26526404544711113, + 0.3634955771267414, + 0.6591882612556219, + 0.4052414447069168, + 0.22304401732981205, + 0.1779620312154293, + 1.2079460360109806, + 0.03877171128988266, + 0.9654026627540588, + 0.0987359806895256, + 0.37806418910622597, + 0.6285340320318937, + 0.7494210861623287, + 0.6265358179807663, + 0.45090941339731216, + 0.3879009932279587, + 0.04081577807664871, + 1.9860536493360996, + 0.2689276058226824, + 0.18592817336320877, + 0.15970048308372498, + 0.0, + 0.09876934811472893, + 0.4333735257387161, + 0.03214278817176819, + 1.3231281600892544, + 0.0, + 0.1684248223900795, + 0.38499074429273605, + 0.03596096113324165, + 0.8960704579949379, + 0.059428658336400986, + 0.18627217784523964, + 1.4734359718859196, + 0.1328352876007557, + 0.0, + 0.05845935642719269, + 0.0, + 0.7073158212006092, + 0.9360704319551587, + 0.8414049483835697, + 0.05114542692899704, + 0.40360595285892487, + 0.0, + 0.035484205931425095, + 1.4093293212354183, + 1.1479758396744728, + 0.253972421400249, + 0.7716878987848759, + 0.3651624545454979, + 0.29516950249671936, + 0.08046650141477585, + 0.5989663172513247, + 0.6722221523523331, + 1.9025680869817734, + 0.6137272417545319, + 0.07324767857789993, + 0.3026787042617798, + 0.09720657393336296, + 0.8146239705383778, + 0.3166787810623646, + 0.18889345973730087, + 0.20538416504859924, + 0.2904014140367508 + ], + "unique_experts": 59, + "load_cv": 0.903451453608492, + "normalized_load_entropy": 0.9066012045773901, + "max_load_share": 0.06372549019607843 + } + }, + "s0_period": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "ffd598d551ee8677197c5f6382b179d4190c479cfa29c53d6ea4d21897195134", + "route_weight_sha256": "cedca614f1c2ab3b367956d3559bd00758588b6315080465af5babdc996bf01f", + "loads": [ + 3, + 1, + 0, + 2, + 3, + 2, + 2, + 1, + 0, + 1, + 2, + 6, + 3, + 1, + 5, + 7, + 1, + 10, + 5, + 5, + 1, + 0, + 1, + 4, + 1, + 0, + 0, + 1, + 6, + 0, + 10, + 1, + 0, + 6, + 3, + 0, + 0, + 0, + 2, + 10, + 11, + 1, + 3, + 0, + 1, + 2, + 1, + 3, + 4, + 0, + 0, + 1, + 1, + 0, + 10, + 0, + 1, + 5, + 0, + 6, + 4, + 0, + 2, + 0 + ], + "weighted_loads": [ + 0.2189059741795063, + 0.045094702392816544, + 0.0, + 0.19971700385212898, + 0.1351548694074154, + 0.09433302655816078, + 0.1776432916522026, + 0.04409359022974968, + 0.0, + 0.09829176217317581, + 0.1495499163866043, + 0.4842996522784233, + 0.22691448405385017, + 0.046963904052972794, + 0.4390241578221321, + 0.3836873173713684, + 0.04131556302309036, + 0.9098974503576756, + 0.2392932679504156, + 0.2291674129664898, + 0.07942281663417816, + 0.0, + 0.059440575540065765, + 0.24944637715816498, + 0.03229280561208725, + 0.0, + 0.0, + 0.045852527022361755, + 0.36802513524889946, + 0.0, + 0.8724484629929066, + 0.061152439564466476, + 0.0, + 0.27388083934783936, + 0.12047231942415237, + 0.0, + 0.0, + 0.0, + 0.27597297728061676, + 0.8971066549420357, + 0.4370051808655262, + 0.044866591691970825, + 0.2314542755484581, + 0.0, + 0.03577003628015518, + 0.2068617194890976, + 0.06213955208659172, + 0.19465404748916626, + 0.47303638234734535, + 0.0, + 0.0, + 0.060806628316640854, + 0.07171238958835602, + 0.0, + 1.2490416467189789, + 0.0, + 0.05742199346423149, + 0.3406677506864071, + 0.0, + 0.7811916135251522, + 0.26460347324609756, + 0.0, + 0.10911786183714867, + 0.0 + ], + "unique_experts": 46, + "load_cv": 1.1580615435448165, + "normalized_load_entropy": 0.847187610580623, + "max_load_share": 0.06790123456790123 + }, + "full_input": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "4a57997758e6e11eb1d85c2519c94a50bfa0eb42400c69e706fe45b93e90e134", + "route_weight_sha256": "f7ac1434f529aa89f6d9a04f031008bb61583c53df2750a5b1471dfbfba29ac6", + "loads": [ + 3, + 7, + 1, + 4, + 5, + 2, + 10, + 2, + 9, + 1, + 3, + 9, + 10, + 8, + 5, + 7, + 1, + 13, + 5, + 5, + 2, + 0, + 3, + 4, + 1, + 13, + 0, + 1, + 6, + 0, + 12, + 1, + 5, + 20, + 3, + 0, + 0, + 0, + 2, + 15, + 16, + 1, + 3, + 0, + 1, + 8, + 9, + 6, + 4, + 5, + 3, + 1, + 12, + 0, + 12, + 7, + 1, + 5, + 3, + 6, + 4, + 0, + 3, + 4 + ], + "weighted_loads": [ + 0.2189059741795063, + 0.4143894538283348, + 0.0122604388743639, + 0.39264287427067757, + 0.2493630312383175, + 0.09433302655816078, + 0.8399262204766273, + 0.08937514573335648, + 0.7247307486832142, + 0.09829176217317581, + 0.23346197605133057, + 0.5763441249728203, + 0.6075860857963562, + 0.5716431960463524, + 0.4390241578221321, + 0.3836873173713684, + 0.04131556302309036, + 1.039157696068287, + 0.2392932679504156, + 0.2291674129664898, + 0.15865910798311234, + 0.0, + 0.13260294497013092, + 0.24944637715816498, + 0.03229280561208725, + 0.9177946262061596, + 0.0, + 0.045852527022361755, + 0.36802513524889946, + 0.0, + 0.9411893859505653, + 0.061152439564466476, + 0.24554819613695145, + 1.336069282144308, + 0.12047231942415237, + 0.0, + 0.0, + 0.0, + 0.27597297728061676, + 1.0845243567600846, + 0.7148456797003746, + 0.044866591691970825, + 0.2314542755484581, + 0.0, + 0.03577003628015518, + 0.7800153307616711, + 0.8047696687281132, + 0.3078979877755046, + 0.47303638234734535, + 0.22404683753848076, + 0.17005208507180214, + 0.060806628316640854, + 0.7328596152365208, + 0.0, + 1.8718551974743605, + 0.3802467752248049, + 0.05742199346423149, + 0.3406677506864071, + 0.11282139644026756, + 0.7811916135251522, + 0.26460347324609756, + 0.0, + 0.15543058514595032, + 0.32961807772517204 + ], + "unique_experts": 55, + "load_cv": 0.9276950007756688, + "normalized_load_entropy": 0.8963229647992901, + "max_load_share": 0.0641025641025641 + } + }, + "s1_period": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "7839705f3b46172bd6d48a608d043d64a71c6680a866fc556b3b231b2f53b004", + "route_weight_sha256": "83cb1f4512679c5d76234c0907cb1f4082d487db07efd8577a5203857029b0ad", + "loads": [ + 3, + 1, + 0, + 3, + 3, + 3, + 2, + 1, + 0, + 1, + 2, + 6, + 3, + 0, + 5, + 7, + 1, + 12, + 4, + 4, + 1, + 0, + 1, + 4, + 1, + 0, + 0, + 1, + 5, + 1, + 9, + 1, + 0, + 6, + 3, + 0, + 1, + 0, + 2, + 9, + 9, + 1, + 3, + 0, + 1, + 3, + 2, + 2, + 4, + 0, + 0, + 1, + 1, + 0, + 10, + 1, + 1, + 4, + 0, + 6, + 5, + 0, + 2, + 0 + ], + "weighted_loads": [ + 0.23271488398313522, + 0.0397205613553524, + 0.0, + 0.2424694262444973, + 0.13082094304263592, + 0.13384176418185234, + 0.17511780560016632, + 0.04083331674337387, + 0.0, + 0.09943266212940216, + 0.15014465153217316, + 0.4713643305003643, + 0.21770645305514336, + 0.0, + 0.4559844508767128, + 0.388236828148365, + 0.039565760642290115, + 0.9896473176777363, + 0.21989647299051285, + 0.18453944846987724, + 0.08084246516227722, + 0.0, + 0.058145541697740555, + 0.24171077087521553, + 0.03058812953531742, + 0.0, + 0.0, + 0.0486827977001667, + 0.3434249237179756, + 0.036878250539302826, + 0.8246357887983322, + 0.06323637813329697, + 0.0, + 0.24526644125580788, + 0.13228151202201843, + 0.0, + 0.06078970804810524, + 0.0, + 0.30134277045726776, + 0.8447890914976597, + 0.33693106286227703, + 0.04792610928416252, + 0.23621972277760506, + 0.0, + 0.03546549379825592, + 0.2646118029952049, + 0.09695340320467949, + 0.15112122148275375, + 0.4678826816380024, + 0.0, + 0.0, + 0.08575419336557388, + 0.0766998678445816, + 0.0, + 1.2666545771062374, + 0.06512293219566345, + 0.07404748350381851, + 0.3056955374777317, + 0.0, + 0.7926743291318417, + 0.3141178674995899, + 0.0, + 0.10508070513606071, + 0.0 + ], + "unique_experts": 48, + "load_cv": 1.1063684791720763, + "normalized_load_entropy": 0.8602675551057994, + "max_load_share": 0.07407407407407407 + }, + "full_input": { + "tokens": 68, + "top_k": 6, + "decisions": 408, + "ordered_route_sha256": "d11b4bcd9e4d91d868f354696262821b1a6d5c6490ea88c8276289dc3ac9512c", + "route_weight_sha256": "d5349c9c176dfdad63313133cdefa9bb01ce629529d256d49d584540f121f61d", + "loads": [ + 4, + 6, + 10, + 6, + 5, + 4, + 16, + 1, + 14, + 1, + 6, + 9, + 12, + 7, + 5, + 7, + 1, + 27, + 5, + 4, + 2, + 0, + 2, + 8, + 1, + 14, + 0, + 3, + 6, + 1, + 11, + 1, + 4, + 24, + 3, + 0, + 1, + 0, + 8, + 12, + 20, + 1, + 5, + 0, + 1, + 15, + 19, + 5, + 7, + 8, + 4, + 1, + 10, + 6, + 12, + 10, + 1, + 4, + 2, + 7, + 5, + 4, + 4, + 6 + ], + "weighted_loads": [ + 0.27212122455239296, + 0.31883272528648376, + 0.6220426540821791, + 0.4697527661919594, + 0.2228772919625044, + 0.17826908454298973, + 1.3277239240705967, + 0.04083331674337387, + 0.987625990062952, + 0.09943266212940216, + 0.3759963996708393, + 0.5860429238528013, + 0.7510136216878891, + 0.4975563921034336, + 0.4559844508767128, + 0.388236828148365, + 0.039565760642290115, + 2.033633604645729, + 0.26777464523911476, + 0.18453944846987724, + 0.1622772216796875, + 0.0, + 0.09762649238109589, + 0.4304624870419502, + 0.03058812953531742, + 1.2977251596748829, + 0.0, + 0.16886036098003387, + 0.38548538461327553, + 0.036878250539302826, + 0.8867713361978531, + 0.06323637813329697, + 0.1442105919122696, + 1.465702559798956, + 0.13228151202201843, + 0.0, + 0.06078970804810524, + 0.0, + 0.7012250162661076, + 0.9399583647027612, + 0.8444213215261698, + 0.04792610928416252, + 0.4058196395635605, + 0.0, + 0.03546549379825592, + 1.3710618279874325, + 1.2982988618314266, + 0.25648350920528173, + 0.782500620931387, + 0.4629257097840309, + 0.22125385701656342, + 0.08575419336557388, + 0.5987831521779299, + 0.6722221523523331, + 1.889196578413248, + 0.5952947847545147, + 0.07404748350381851, + 0.3056955374777317, + 0.09720657393336296, + 0.8262710645794868, + 0.3141178674995899, + 0.18889345973730087, + 0.20412204787135124, + 0.37229473888874054 + ], + "unique_experts": 59, + "load_cv": 0.9186436686370572, + "normalized_load_entropy": 0.9049992745746065, + "max_load_share": 0.0661764705882353 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 27, + "ordered_topk_exact_tokens": 20, + "set_exact_tokens": 22, + "mean_set_jaccard": 0.9391534391534392, + "mean_token_weighted_tv": 0.01615196780336124, + "aggregate_load_tv": 0.037037037037037035 + }, + "system_bos": { + "tokens": 27, + "ordered_topk_exact_tokens": 19, + "set_exact_tokens": 22, + "mean_set_jaccard": 0.9391534391534392, + "mean_token_weighted_tv": 0.018072712200659292, + "aggregate_load_tv": 0.037037037037037035 + }, + "system_x": { + "tokens": 27, + "ordered_topk_exact_tokens": 21, + "set_exact_tokens": 23, + "mean_set_jaccard": 0.9345839345839346, + "mean_token_weighted_tv": 0.024685404746344796, + "aggregate_load_tv": 0.04938271604938271 + }, + "system_period": { + "tokens": 27, + "ordered_topk_exact_tokens": 19, + "set_exact_tokens": 21, + "mean_set_jaccard": 0.9134199134199135, + "mean_token_weighted_tv": 0.027358237791944434, + "aggregate_load_tv": 0.06172839506172839 + }, + "bos_at_s0": { + "tokens": 27, + "ordered_topk_exact_tokens": 16, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.9074074074074074, + "mean_token_weighted_tv": 0.024648980789438443, + "aggregate_load_tv": 0.037037037037037035 + }, + "bos_at_s1": { + "tokens": 27, + "ordered_topk_exact_tokens": 16, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.8994708994708994, + "mean_token_weighted_tv": 0.02779510893203594, + "aggregate_load_tv": 0.05555555555555555 + }, + "x_at_s0": { + "tokens": 27, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 18, + "mean_set_jaccard": 0.8968253968253967, + "mean_token_weighted_tv": 0.02920601447975194, + "aggregate_load_tv": 0.04938271604938271 + }, + "x_at_s1": { + "tokens": 27, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.8605098605098606, + "mean_token_weighted_tv": 0.039764484735550706, + "aggregate_load_tv": 0.07407407407407407 + }, + "period_at_s0": { + "tokens": 27, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.8783068783068784, + "mean_token_weighted_tv": 0.03223603667208442, + "aggregate_load_tv": 0.05555555555555555 + }, + "period_at_s1": { + "tokens": 27, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.8605098605098606, + "mean_token_weighted_tv": 0.04001574711529193, + "aggregate_load_tv": 0.07407407407407407 + } + } + }, + "layer_09": { + "layer": 9, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "db8519e0b8c888d1713104f9f62ff14f81eb8a6dd73700df26d8396ed46031de", + "route_weight_sha256": "45a072cc3333e37892f9dcd57e744bf6c1aefd93a5cca0cdbf3a2bd7b6e7eb71", + "loads": [ + 7, + 0, + 3, + 0, + 10, + 1, + 0, + 7, + 3, + 2, + 0, + 1, + 1, + 7, + 2, + 4, + 5, + 0, + 0, + 0, + 7, + 0, + 15, + 3, + 0, + 7, + 0, + 0, + 1, + 10, + 7, + 1, + 3, + 2, + 1, + 2, + 0, + 1, + 1, + 1, + 0, + 1, + 3, + 1, + 2, + 1, + 3, + 1, + 2, + 5, + 8, + 2, + 3, + 1, + 1, + 1, + 0, + 1, + 2, + 0, + 6, + 1, + 2, + 0 + ], + "weighted_loads": [ + 0.3570422548800707, + 0.0, + 0.2291947901248932, + 0.0, + 0.8278154172003269, + 0.15585067868232727, + 0.0, + 0.513467613607645, + 0.30465031042695045, + 0.09966595843434334, + 0.0, + 0.04930794984102249, + 0.04999871924519539, + 0.48390015214681625, + 0.10634050518274307, + 0.26682958751916885, + 0.3521161377429962, + 0.0, + 0.0, + 0.0, + 0.42210499197244644, + 0.0, + 1.6417313478887081, + 0.16049229726195335, + 0.0, + 0.3940904252231121, + 0.0, + 0.0, + 0.07802410423755646, + 0.6772034391760826, + 0.4233260191977024, + 0.044020723551511765, + 0.1785685010254383, + 0.21814772486686707, + 0.04205281287431717, + 0.15626764670014381, + 0.0, + 0.032309774309396744, + 0.039713140577077866, + 0.08064475655555725, + 0.0, + 0.08073267340660095, + 0.1632085070014, + 0.035660047084093094, + 0.08637828379869461, + 0.03124239109456539, + 0.169285386800766, + 0.0390172004699707, + 0.15107613056898117, + 0.4539446718990803, + 0.5650042593479156, + 0.1392146199941635, + 0.15615498647093773, + 0.030159983783960342, + 0.030988525599241257, + 0.04597911238670349, + 0.0, + 0.04897192865610123, + 0.16954369097948074, + 0.0, + 0.4109421409666538, + 0.05106634274125099, + 0.15290964394807816, + 0.0 + ], + "unique_experts": 48, + "load_cv": 1.2014699121088257, + "normalized_load_entropy": 0.8478308687661215, + "max_load_share": 0.09259259259259259 + }, + "full_input": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "67fb02b0f3ae34d01d1634a0b43e86cc70848f30cd5e28b32597f16426f29b9e", + "route_weight_sha256": "060bf154d0ee182280ea75c57a7395d8989336881e8827a079dc224c618bd79b", + "loads": [ + 13, + 0, + 3, + 0, + 12, + 1, + 0, + 7, + 5, + 2, + 11, + 1, + 4, + 11, + 2, + 5, + 6, + 1, + 0, + 12, + 7, + 0, + 20, + 6, + 3, + 8, + 0, + 1, + 1, + 10, + 8, + 7, + 5, + 2, + 10, + 9, + 0, + 1, + 4, + 1, + 0, + 11, + 3, + 1, + 7, + 9, + 15, + 1, + 5, + 5, + 12, + 3, + 3, + 5, + 1, + 6, + 5, + 1, + 4, + 4, + 6, + 1, + 4, + 1 + ], + "weighted_loads": [ + 0.7905145492404699, + 0.0, + 0.2291947901248932, + 0.0, + 1.0970920957624912, + 0.15585067868232727, + 0.0, + 0.513467613607645, + 0.40050163492560387, + 0.09966595843434334, + 1.1675054803490639, + 0.04930794984102249, + 0.10437822714447975, + 0.5954699474386871, + 0.10634050518274307, + 0.3408272713422775, + 0.39331986755132675, + 0.04239411652088165, + 0.0, + 1.2046820521354675, + 0.42210499197244644, + 0.0, + 3.2289184778928757, + 0.40126022323966026, + 0.1304948702454567, + 0.47077547386288643, + 0.0, + 0.013018812984228134, + 0.07802410423755646, + 0.6772034391760826, + 0.46326179057359695, + 0.23232948267832398, + 0.2151745306327939, + 0.21814772486686707, + 0.5375902876257896, + 0.6373911388218403, + 0.0, + 0.032309774309396744, + 0.15957461670041084, + 0.08064475655555725, + 0.0, + 1.112793643027544, + 0.1632085070014, + 0.035660047084093094, + 0.40094713075086474, + 0.7130861561745405, + 1.1016929596662521, + 0.0390172004699707, + 0.3320816867053509, + 0.4539446718990803, + 0.8191206231713295, + 0.17319579795002937, + 0.15615498647093773, + 0.18444101698696613, + 0.030988525599241257, + 0.3081762474030256, + 0.24212753400206566, + 0.04897192865610123, + 0.33466047421097755, + 0.17180490493774414, + 0.4109421409666538, + 0.05106634274125099, + 0.20901061594486237, + 0.03623296320438385 + ], + "unique_experts": 56, + "load_cv": 0.8967029974382416, + "normalized_load_entropy": 0.900370614896269, + "max_load_share": 0.0641025641025641 + } + }, + "s1_eos": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "cb5ccf4e6c8769029ae6d94c23c25390373f1bf3826b26f5f7b1bfbaa84d0da0", + "route_weight_sha256": "491438c58dc565b8a6cacab44c635e4d312cde9f244737593f8715f19a60b9ce", + "loads": [ + 6, + 0, + 3, + 0, + 9, + 1, + 0, + 7, + 3, + 2, + 0, + 2, + 1, + 8, + 2, + 3, + 6, + 1, + 2, + 0, + 7, + 0, + 14, + 3, + 0, + 7, + 0, + 0, + 1, + 10, + 6, + 1, + 3, + 3, + 0, + 2, + 0, + 1, + 1, + 1, + 0, + 1, + 3, + 1, + 2, + 1, + 2, + 1, + 2, + 4, + 9, + 2, + 3, + 1, + 1, + 1, + 0, + 1, + 2, + 0, + 6, + 1, + 2, + 0 + ], + "weighted_loads": [ + 0.30413077399134636, + 0.0, + 0.24283874034881592, + 0.0, + 0.7919226475059986, + 0.14815156161785126, + 0.0, + 0.5105459615588188, + 0.3005134016275406, + 0.10228191316127777, + 0.0, + 0.09380851686000824, + 0.04842498153448105, + 0.5271157175302505, + 0.10782302916049957, + 0.2355441004037857, + 0.38749781623482704, + 0.02988344430923462, + 0.0658857487142086, + 0.0, + 0.42345086857676506, + 0.0, + 1.608045194298029, + 0.158831138163805, + 0.0, + 0.38815003260970116, + 0.0, + 0.0, + 0.09105274826288223, + 0.6950112096965313, + 0.390632301568985, + 0.0431920625269413, + 0.18350141867995262, + 0.2499491535127163, + 0.0, + 0.15491361171007156, + 0.0, + 0.032407764345407486, + 0.03921568766236305, + 0.08337301015853882, + 0.0, + 0.07936116307973862, + 0.16564925760030746, + 0.03290139138698578, + 0.08607367053627968, + 0.030190961435437202, + 0.1264418289065361, + 0.04065060243010521, + 0.15457294136285782, + 0.4116012901067734, + 0.6113532483577728, + 0.1421392448246479, + 0.15567122027277946, + 0.030012186616659164, + 0.0301759485155344, + 0.047298308461904526, + 0.0, + 0.04934999346733093, + 0.17057570815086365, + 0.0, + 0.4006706662476063, + 0.05258738994598389, + 0.15425654500722885, + 0.0 + ], + "unique_experts": 49, + "load_cv": 1.1601654381708804, + "normalized_load_entropy": 0.8564219621253522, + "max_load_share": 0.08641975308641975 + }, + "full_input": { + "tokens": 68, + "top_k": 6, + "decisions": 408, + "ordered_route_sha256": "009914b491a3f3978b6cdf355fe12488ce4d6ae160c4fdd7f0679fb29519af9f", + "route_weight_sha256": "1370d72de05dbf68dab2feda8f774ac4290c7ac3265f8b80bf1ed81e021ba92f", + "loads": [ + 16, + 3, + 3, + 0, + 11, + 1, + 0, + 7, + 10, + 4, + 11, + 4, + 4, + 11, + 3, + 4, + 7, + 2, + 2, + 12, + 7, + 3, + 19, + 14, + 5, + 15, + 4, + 1, + 7, + 10, + 8, + 6, + 5, + 6, + 7, + 15, + 0, + 4, + 6, + 2, + 6, + 16, + 5, + 1, + 8, + 14, + 22, + 1, + 9, + 9, + 11, + 3, + 3, + 4, + 2, + 5, + 5, + 1, + 7, + 4, + 6, + 2, + 4, + 1 + ], + "weighted_loads": [ + 0.976700447499752, + 0.14117919653654099, + 0.24283874034881592, + 0.0, + 1.0848921425640583, + 0.14815156161785126, + 0.0, + 0.5105459615588188, + 0.7209534272551537, + 0.19229605048894882, + 1.0864798091351986, + 0.1896228902041912, + 0.1014164388179779, + 0.5813447951804847, + 0.1466354764997959, + 0.31035540252923965, + 0.4336454048752785, + 0.08594260737299919, + 0.0658857487142086, + 1.2682769112288952, + 0.42345086857676506, + 0.1272287704050541, + 3.192192016169429, + 0.9852730557322502, + 0.19164331629872322, + 0.821524927392602, + 0.2540854439139366, + 0.013018812984228134, + 0.5123014077544212, + 0.6950112096965313, + 0.5309519395232201, + 0.19135942426510155, + 0.22540495544672012, + 0.4714386723935604, + 0.3385575655847788, + 0.9931689985096455, + 0.0, + 0.17393889278173447, + 0.27428603544831276, + 0.15090730786323547, + 0.4039984606206417, + 1.6188531816005707, + 0.2588742896914482, + 0.03290139138698578, + 0.3221983164548874, + 1.1471778806298971, + 1.8460713475942612, + 0.04065060243010521, + 0.5678291246294975, + 0.739337932318449, + 0.7793445959687233, + 0.17510303854942322, + 0.15567122027277946, + 0.17848922312259674, + 0.07111798413097858, + 0.252936040982604, + 0.23261306807398796, + 0.04934999346733093, + 0.4895591735839844, + 0.17891351506114006, + 0.4006706662476063, + 0.09079867973923683, + 0.31206539645791054, + 0.03596269339323044 + ], + "unique_experts": 61, + "load_cv": 0.7692174606248248, + "normalized_load_entropy": 0.9301273297334275, + "max_load_share": 0.05392156862745098 + } + }, + "s0_bos": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "4820bafe3c3fb88acc116a60abcf1e6083f4f30bc843cb17bcce2583e83429c7", + "route_weight_sha256": "dff3608a7413cd5722267fbe565481c3358623b4039585f55dabb1f3f03f43b1", + "loads": [ + 8, + 0, + 3, + 0, + 10, + 1, + 0, + 7, + 3, + 2, + 0, + 2, + 2, + 7, + 3, + 3, + 5, + 0, + 0, + 0, + 8, + 0, + 14, + 3, + 0, + 9, + 0, + 0, + 1, + 10, + 6, + 1, + 3, + 3, + 0, + 2, + 0, + 1, + 1, + 1, + 0, + 1, + 3, + 1, + 1, + 1, + 3, + 1, + 2, + 4, + 8, + 2, + 3, + 0, + 0, + 1, + 0, + 1, + 2, + 0, + 6, + 1, + 2, + 0 + ], + "weighted_loads": [ + 0.3748127184808254, + 0.0, + 0.24748549610376358, + 0.0, + 0.8480272889137268, + 0.15162721276283264, + 0.0, + 0.5135593377053738, + 0.2965727783739567, + 0.10863402858376503, + 0.0, + 0.10366475582122803, + 0.08292094431817532, + 0.4861781448125839, + 0.1475115492939949, + 0.23366671055555344, + 0.3476618528366089, + 0.0, + 0.0, + 0.0, + 0.454690907150507, + 0.0, + 1.637288924306631, + 0.15994617715477943, + 0.0, + 0.49010223150253296, + 0.0, + 0.0, + 0.09245652705430984, + 0.6784153059124947, + 0.3936764746904373, + 0.04595775902271271, + 0.17550591379404068, + 0.26012396439909935, + 0.0, + 0.15534206852316856, + 0.0, + 0.034602001309394836, + 0.04089866578578949, + 0.07786061614751816, + 0.0, + 0.07700115442276001, + 0.1646040566265583, + 0.035529810935258865, + 0.040333110839128494, + 0.031423937529325485, + 0.1788865178823471, + 0.03931263089179993, + 0.1518562063574791, + 0.42902252078056335, + 0.5554381683468819, + 0.14641563966870308, + 0.1638534665107727, + 0.0, + 0.0, + 0.04631481692194939, + 0.0, + 0.04807087779045105, + 0.17992333322763443, + 0.0, + 0.4149334207177162, + 0.05594258010387421, + 0.15240300446748734, + 0.0 + ], + "unique_experts": 45, + "load_cv": 1.2155949517518507, + "normalized_load_entropy": 0.8387899282245297, + "max_load_share": 0.08641975308641975 + }, + "full_input": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "061e401adc0713f01f5fe79cb5aea3a4fc1ccd5230c57614c83ad55dc857d6ea", + "route_weight_sha256": "745f98589d88f96c0c155dcb7e924fd515f2163c8a6aef718355f7d739d2a930", + "loads": [ + 15, + 0, + 3, + 0, + 13, + 1, + 0, + 7, + 5, + 2, + 11, + 2, + 4, + 10, + 3, + 4, + 6, + 4, + 0, + 12, + 8, + 0, + 18, + 6, + 3, + 10, + 0, + 1, + 1, + 10, + 7, + 6, + 3, + 3, + 9, + 9, + 0, + 1, + 3, + 2, + 0, + 11, + 3, + 1, + 5, + 8, + 15, + 1, + 5, + 4, + 14, + 3, + 3, + 4, + 0, + 6, + 5, + 1, + 5, + 4, + 6, + 1, + 4, + 1 + ], + "weighted_loads": [ + 0.8596561327576637, + 0.0, + 0.24748549610376358, + 0.0, + 1.2057790532708168, + 0.15162721276283264, + 0.0, + 0.5135593377053738, + 0.3924241028726101, + 0.10863402858376503, + 1.1675054803490639, + 0.10366475582122803, + 0.12990505434572697, + 0.609423934482038, + 0.1475115492939949, + 0.30426014959812164, + 0.3888655826449394, + 0.15504446253180504, + 0.0, + 1.173157311975956, + 0.454690907150507, + 0.0, + 2.3044373616576195, + 0.42491863295435905, + 0.1304948702454567, + 0.5667872801423073, + 0.0, + 0.013018812984228134, + 0.09245652705430984, + 0.6784153059124947, + 0.43361224606633186, + 0.23154264502227306, + 0.17550591379404068, + 0.26012396439909935, + 0.4955374747514725, + 0.6389175243675709, + 0.0, + 0.034602001309394836, + 0.11917853727936745, + 0.12391019612550735, + 0.0, + 1.075657393783331, + 0.1646040566265583, + 0.035529810935258865, + 0.3393533071503043, + 0.7855069674551487, + 1.0993951745331287, + 0.03931263089179993, + 0.3460928313434124, + 0.42902252078056335, + 0.8645695764571428, + 0.18039681762456894, + 0.1638534665107727, + 0.16292338259518147, + 0.0, + 0.3466386180371046, + 0.24212753400206566, + 0.04807087779045105, + 0.41305024549365044, + 0.17180490493774414, + 0.4149334207177162, + 0.05594258010387421, + 0.20850397646427155, + 0.03623296320438385 + ], + "unique_experts": 55, + "load_cv": 0.8922929559643751, + "normalized_load_entropy": 0.9016206553594072, + "max_load_share": 0.057692307692307696 + } + }, + "s1_bos": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "f39d8990f8831340157717eba1e67f3879ead198701039761f796c98ec088c5b", + "route_weight_sha256": "1d7a6ebbdd8a62435408fa17596b69a907eefa6902085dfeed6a70f032713150", + "loads": [ + 4, + 0, + 3, + 0, + 9, + 1, + 0, + 7, + 3, + 2, + 0, + 2, + 1, + 9, + 3, + 3, + 4, + 1, + 1, + 0, + 8, + 0, + 14, + 3, + 0, + 8, + 0, + 0, + 1, + 10, + 6, + 1, + 3, + 3, + 0, + 2, + 0, + 1, + 1, + 1, + 0, + 1, + 3, + 1, + 2, + 1, + 2, + 1, + 2, + 4, + 9, + 2, + 3, + 2, + 0, + 1, + 0, + 1, + 2, + 0, + 6, + 1, + 2, + 1 + ], + "weighted_loads": [ + 0.20119633898139, + 0.0, + 0.2506074458360672, + 0.0, + 0.8102307207882404, + 0.1484270989894867, + 0.0, + 0.5239401794970036, + 0.2903103306889534, + 0.10469301789999008, + 0.0, + 0.10448788106441498, + 0.056772515177726746, + 0.5624308846890926, + 0.14401508122682571, + 0.23918868601322174, + 0.30473844707012177, + 0.037958066910505295, + 0.030707525089383125, + 0.0, + 0.45720819756388664, + 0.0, + 1.6079576462507248, + 0.16594106331467628, + 0.0, + 0.4437531419098377, + 0.0, + 0.0, + 0.089081309735775, + 0.6977525353431702, + 0.3784749135375023, + 0.04698227718472481, + 0.16764992475509644, + 0.255618691444397, + 0.0, + 0.15972699224948883, + 0.0, + 0.03401920199394226, + 0.03980819508433342, + 0.07961545139551163, + 0.0, + 0.07998400181531906, + 0.16616243869066238, + 0.037040598690509796, + 0.09433973580598831, + 0.03166106715798378, + 0.13742488622665405, + 0.04157790541648865, + 0.15512622147798538, + 0.41984207928180695, + 0.611329723149538, + 0.14792633056640625, + 0.1649787724018097, + 0.05751665495336056, + 0.0, + 0.04646037518978119, + 0.0, + 0.05006213113665581, + 0.1816002056002617, + 0.0, + 0.39329564198851585, + 0.052118998020887375, + 0.16552400588989258, + 0.0388728529214859 + ], + "unique_experts": 49, + "load_cv": 1.1727095444564262, + "normalized_load_entropy": 0.8554325654199161, + "max_load_share": 0.08641975308641975 + }, + "full_input": { + "tokens": 68, + "top_k": 6, + "decisions": 408, + "ordered_route_sha256": "c7a60d827cfcaac2009cb82a4e49ff65fab6a53d3ff90ea4e7364b8d51698e4a", + "route_weight_sha256": "b60d4e23e4c6c77201606c5e88803236d04ae0265bfa9043dbe7e3caebefa2fa", + "loads": [ + 15, + 3, + 3, + 0, + 12, + 1, + 0, + 7, + 10, + 4, + 11, + 4, + 3, + 12, + 4, + 4, + 5, + 5, + 1, + 12, + 8, + 3, + 18, + 14, + 5, + 16, + 4, + 1, + 7, + 10, + 8, + 5, + 3, + 6, + 7, + 14, + 0, + 4, + 5, + 3, + 6, + 16, + 5, + 1, + 6, + 13, + 22, + 1, + 9, + 9, + 13, + 3, + 3, + 6, + 1, + 5, + 5, + 1, + 8, + 4, + 6, + 2, + 4, + 2 + ], + "weighted_loads": [ + 0.9692087769508362, + 0.14375117048621178, + 0.2506074458360672, + 0.0, + 1.170006312429905, + 0.1484270989894867, + 0.0, + 0.5239401794970036, + 0.7107503563165665, + 0.19470715522766113, + 1.0864798091351986, + 0.20030225440859795, + 0.10282761231064796, + 0.6712272567674518, + 0.18282752856612206, + 0.3094446733593941, + 0.3508860357105732, + 0.21591917425394058, + 0.030707525089383125, + 1.2762184888124466, + 0.45720819756388664, + 0.1272287704050541, + 2.277472736313939, + 0.9827691055834293, + 0.19164331629872322, + 0.8771280366927385, + 0.2540854439139366, + 0.013018812984228134, + 0.510329969227314, + 0.6977525353431702, + 0.5187945514917374, + 0.1923206876963377, + 0.16764992475509644, + 0.4771082103252411, + 0.3385575655847788, + 0.9575902223587036, + 0.0, + 0.17555033043026924, + 0.22880063578486443, + 0.18921540677547455, + 0.4039984606206417, + 1.6115713268518448, + 0.25938747078180313, + 0.037040598690509796, + 0.2716147406026721, + 1.2514774799346924, + 1.8644446618855, + 0.04157790541648865, + 0.5848987735807896, + 0.7475787214934826, + 0.8286991026252508, + 0.18089012429118156, + 0.1649787724018097, + 0.2470449712127447, + 0.04094203561544418, + 0.28589713387191296, + 0.23261306807398796, + 0.05006213113665581, + 0.5644683465361595, + 0.17891351506114006, + 0.39329564198851585, + 0.09033028781414032, + 0.32333285734057426, + 0.07483554631471634 + ], + "unique_experts": 61, + "load_cv": 0.7652084823956022, + "normalized_load_entropy": 0.9304466922028807, + "max_load_share": 0.05392156862745098 + } + }, + "s0_x": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "8c8d3307b45228ab48d08d1cd229699515aef331dae4d7dac80865c077aa7513", + "route_weight_sha256": "eee0359d7b8489257189c301ed365aa0dc02032ae456c2e8aa17ff6ce877a33d", + "loads": [ + 7, + 0, + 3, + 0, + 9, + 1, + 0, + 7, + 3, + 2, + 0, + 2, + 1, + 8, + 3, + 3, + 5, + 1, + 0, + 0, + 8, + 0, + 14, + 4, + 0, + 8, + 0, + 0, + 1, + 10, + 5, + 1, + 3, + 3, + 0, + 2, + 0, + 1, + 1, + 1, + 0, + 1, + 3, + 1, + 1, + 1, + 3, + 2, + 2, + 4, + 8, + 2, + 3, + 0, + 1, + 1, + 0, + 1, + 2, + 0, + 6, + 1, + 2, + 0 + ], + "weighted_loads": [ + 0.3749665506184101, + 0.0, + 0.2623096778988838, + 0.0, + 0.8063858970999718, + 0.15629006922245026, + 0.0, + 0.5164154730737209, + 0.30098096653819084, + 0.09969084709882736, + 0.0, + 0.10156036168336868, + 0.04946159943938255, + 0.5067454911768436, + 0.14616591483354568, + 0.24493731558322906, + 0.3391098193824291, + 0.03600078076124191, + 0.0, + 0.0, + 0.4486663155257702, + 0.0, + 1.6174108944833279, + 0.21140795201063156, + 0.0, + 0.454649705439806, + 0.0, + 0.0, + 0.08626502752304077, + 0.6820282377302647, + 0.34121105819940567, + 0.04654765874147415, + 0.15450528264045715, + 0.27219418808817863, + 0.0, + 0.1566971354186535, + 0.0, + 0.032619085162878036, + 0.03777513653039932, + 0.07684414833784103, + 0.0, + 0.08201983571052551, + 0.1636512391269207, + 0.03892951086163521, + 0.0409967266023159, + 0.03483056649565697, + 0.1810903698205948, + 0.06961269490420818, + 0.15644139051437378, + 0.4271335154771805, + 0.5713687166571617, + 0.14525945484638214, + 0.1599603071808815, + 0.0, + 0.030169377103447914, + 0.047649580985307693, + 0.0, + 0.049079541116952896, + 0.18584971874952316, + 0.0, + 0.3998067304491997, + 0.049395427107810974, + 0.1470172256231308, + 0.0 + ], + "unique_experts": 47, + "load_cv": 1.1768612009225445, + "normalized_load_entropy": 0.8489486761472944, + "max_load_share": 0.08641975308641975 + }, + "full_input": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "e8cc0127f2b6d1edc7c6f7325016a74156a0d95d5c201064b3cf1bc75c1ad572", + "route_weight_sha256": "b782fe947ba91b7057112a1df05807c08ca8e0f2bd82a48dc82252c4896530ad", + "loads": [ + 15, + 0, + 3, + 0, + 11, + 1, + 0, + 7, + 5, + 2, + 12, + 2, + 3, + 11, + 3, + 4, + 7, + 2, + 0, + 12, + 8, + 0, + 18, + 7, + 3, + 11, + 0, + 1, + 1, + 10, + 6, + 6, + 3, + 3, + 10, + 8, + 0, + 1, + 4, + 1, + 0, + 11, + 3, + 1, + 5, + 8, + 15, + 2, + 5, + 4, + 13, + 3, + 3, + 3, + 1, + 6, + 5, + 1, + 4, + 6, + 6, + 1, + 4, + 1 + ], + "weighted_loads": [ + 0.9822095483541489, + 0.0, + 0.2623096778988838, + 0.0, + 1.0963808223605156, + 0.15629006922245026, + 0.0, + 0.5164154730737209, + 0.39683229103684425, + 0.09969084709882736, + 1.3184768930077553, + 0.10156036168336868, + 0.0964457094669342, + 0.6058243727311492, + 0.14616591483354568, + 0.3213355019688606, + 0.41650382056832314, + 0.07839489728212357, + 0.0, + 1.1670821160078049, + 0.4486663155257702, + 0.0, + 2.2891155630350113, + 0.43799053132534027, + 0.1304948702454567, + 0.6047782301902771, + 0.0, + 0.013018812984228134, + 0.08626502752304077, + 0.6820282377302647, + 0.3811468295753002, + 0.2321325447410345, + 0.15450528264045715, + 0.27219418808817863, + 0.5897468402981758, + 0.5908190719783306, + 0.0, + 0.032619085162878036, + 0.16142551600933075, + 0.07684414833784103, + 0.0, + 1.0206061154603958, + 0.1636512391269207, + 0.03892951086163521, + 0.34314418490976095, + 0.5628709234297276, + 1.1244827397167683, + 0.06961269490420818, + 0.34547754377126694, + 0.4271335154771805, + 0.8391634598374367, + 0.179240632802248, + 0.1599603071808815, + 0.11841775290668011, + 0.030169377103447914, + 0.33827398531138897, + 0.24212753400206566, + 0.049079541116952896, + 0.35642965510487556, + 0.2504086010158062, + 0.3998067304491997, + 0.049395427107810974, + 0.203118197619915, + 0.03623296320438385 + ], + "unique_experts": 56, + "load_cv": 0.8915558282417287, + "normalized_load_entropy": 0.9025058705211795, + "max_load_share": 0.057692307692307696 + } + }, + "s1_x": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "b4acacaa71fd26cc7248dd5796d0b8f83b6eb470fef6e3a8c5805a914ab10487", + "route_weight_sha256": "d548d448f4eef89ea7f46467734c55d6f92e749250db3645e90f53ecd3d6b8e9", + "loads": [ + 7, + 0, + 3, + 0, + 9, + 2, + 0, + 7, + 2, + 2, + 0, + 2, + 2, + 7, + 2, + 3, + 4, + 1, + 0, + 0, + 8, + 0, + 14, + 3, + 0, + 10, + 0, + 1, + 1, + 10, + 5, + 1, + 2, + 3, + 0, + 3, + 0, + 1, + 1, + 1, + 0, + 2, + 2, + 1, + 1, + 2, + 3, + 2, + 2, + 4, + 9, + 2, + 3, + 0, + 0, + 1, + 0, + 1, + 2, + 0, + 5, + 0, + 2, + 1 + ], + "weighted_loads": [ + 0.3655297849327326, + 0.0, + 0.2695791944861412, + 0.0, + 0.7976255230605602, + 0.17034747079014778, + 0.0, + 0.5241376832127571, + 0.2339719608426094, + 0.09620046615600586, + 0.0, + 0.10083917528390884, + 0.08612444810569286, + 0.44266609102487564, + 0.10720402002334595, + 0.24397464841604233, + 0.29346074536442757, + 0.03695511072874069, + 0.0, + 0.0, + 0.4514499232172966, + 0.0, + 1.5205688625574112, + 0.16436302661895752, + 0.0, + 0.5873041227459908, + 0.0, + 0.03689589351415634, + 0.08888798952102661, + 0.6800917685031891, + 0.33599552512168884, + 0.04852055758237839, + 0.11784245073795319, + 0.26274548843503, + 0.0, + 0.20862707123160362, + 0.0, + 0.03334873169660568, + 0.04027095437049866, + 0.07815217226743698, + 0.0, + 0.12774009630084038, + 0.13682805374264717, + 0.039818745106458664, + 0.04458082467317581, + 0.0721726194024086, + 0.23154624551534653, + 0.07616365700960159, + 0.15561964362859726, + 0.42293377220630646, + 0.621946357190609, + 0.15146198868751526, + 0.16493941843509674, + 0.0, + 0.0, + 0.04845808073878288, + 0.0, + 0.04790996015071869, + 0.18626898527145386, + 0.0, + 0.3491225130856037, + 0.0, + 0.15391620993614197, + 0.03937497362494469 + ], + "unique_experts": 47, + "load_cv": 1.1851208830293076, + "normalized_load_entropy": 0.85061478683906, + "max_load_share": 0.08641975308641975 + }, + "full_input": { + "tokens": 68, + "top_k": 6, + "decisions": 408, + "ordered_route_sha256": "283dc009ae8d898770e8af11fc2d7f947288d366708817bed333eb7fd0ff421f", + "route_weight_sha256": "90513b01e149662369fa2357d2a79ac21eb2aa88283d204452c644294daabd22", + "loads": [ + 20, + 2, + 3, + 0, + 11, + 2, + 0, + 7, + 10, + 4, + 12, + 4, + 4, + 9, + 3, + 4, + 6, + 3, + 0, + 13, + 8, + 3, + 18, + 14, + 5, + 20, + 5, + 2, + 7, + 10, + 7, + 5, + 2, + 6, + 8, + 15, + 0, + 4, + 6, + 3, + 6, + 16, + 4, + 1, + 5, + 12, + 24, + 2, + 9, + 9, + 11, + 3, + 3, + 2, + 1, + 5, + 5, + 1, + 7, + 5, + 5, + 1, + 4, + 2 + ], + "weighted_loads": [ + 1.2648846451193094, + 0.08696373552083969, + 0.2695791944861412, + 0.0, + 1.0937289111316204, + 0.17034747079014778, + 0.0, + 0.5241376832127571, + 0.695301990956068, + 0.1862146034836769, + 1.2473036460578442, + 0.1966535486280918, + 0.13217954523861408, + 0.4939924878999591, + 0.1460164673626423, + 0.3180709183216095, + 0.3803786039352417, + 0.13956046849489212, + 0.0, + 1.2244069017469883, + 0.4514499232172966, + 0.1272287704050541, + 2.193330170586705, + 0.9934149347245693, + 0.19164331629872322, + 1.0992723945528269, + 0.3011355847120285, + 0.049914706498384476, + 0.5101366490125656, + 0.6800917685031891, + 0.4763151630759239, + 0.19385896809399128, + 0.11784245073795319, + 0.4842350073158741, + 0.3977119270712137, + 0.9850954487919807, + 0.0, + 0.17487986013293266, + 0.2880713678896427, + 0.18920212611556053, + 0.4039984606206417, + 1.467221762984991, + 0.23005308583378792, + 0.039818745106458664, + 0.21433669235557318, + 0.9733198769390583, + 1.9838736467063427, + 0.07616365700960159, + 0.5804519951343536, + 0.7506704144179821, + 0.7548843547701836, + 0.18442578241229057, + 0.16493941843509674, + 0.09993859007954597, + 0.04094203561544418, + 0.2798775155097246, + 0.23261306807398796, + 0.04790996015071869, + 0.514041118323803, + 0.23173518851399422, + 0.3491225130856037, + 0.038211289793252945, + 0.31172506138682365, + 0.07533766701817513 + ], + "unique_experts": 60, + "load_cv": 0.8302711905780443, + "normalized_load_entropy": 0.9221336253256783, + "max_load_share": 0.058823529411764705 + } + }, + "s0_period": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "34773766abe91164eadf1537b92eebbf8d7848e25cdaaf3a7371bfd59bd542b5", + "route_weight_sha256": "5e8fe617b695ff7f5554314aa4c88e805146bb4d0d4c23b1e91b0e77c0903b39", + "loads": [ + 8, + 0, + 3, + 0, + 9, + 1, + 0, + 6, + 3, + 2, + 0, + 1, + 1, + 8, + 3, + 3, + 6, + 1, + 0, + 0, + 8, + 0, + 14, + 3, + 0, + 8, + 0, + 0, + 1, + 11, + 5, + 1, + 3, + 3, + 0, + 2, + 0, + 1, + 1, + 1, + 0, + 1, + 3, + 1, + 2, + 1, + 4, + 2, + 2, + 4, + 7, + 2, + 3, + 0, + 1, + 1, + 0, + 1, + 2, + 0, + 6, + 0, + 2, + 0 + ], + "weighted_loads": [ + 0.4322548359632492, + 0.0, + 0.2744012176990509, + 0.0, + 0.7956652939319611, + 0.15070104598999023, + 0.0, + 0.4889596551656723, + 0.3042837493121624, + 0.10046876966953278, + 0.0, + 0.05793815106153488, + 0.04961817339062691, + 0.5053035542368889, + 0.14365721493959427, + 0.247953612357378, + 0.38160746172070503, + 0.03512590378522873, + 0.0, + 0.0, + 0.4461943134665489, + 0.0, + 1.6183931566774845, + 0.17075593024492264, + 0.0, + 0.4709741845726967, + 0.0, + 0.0, + 0.08627108484506607, + 0.7171196900308132, + 0.345666840672493, + 0.04601409658789635, + 0.1662890873849392, + 0.2607380710542202, + 0.0, + 0.1557426080107689, + 0.0, + 0.032622821629047394, + 0.03820062428712845, + 0.07823827117681503, + 0.0, + 0.08008576929569244, + 0.15833847597241402, + 0.039499297738075256, + 0.08284999802708626, + 0.03407279774546623, + 0.22704870998859406, + 0.07139112800359726, + 0.15486765652894974, + 0.42892467975616455, + 0.5140158236026764, + 0.144198477268219, + 0.1598442979156971, + 0.0, + 0.031266335397958755, + 0.048166997730731964, + 0.0, + 0.04815575107932091, + 0.18589599430561066, + 0.0, + 0.4082886688411236, + 0.0, + 0.1425667479634285, + 0.0 + ], + "unique_experts": 46, + "load_cv": 1.1953652303109312, + "normalized_load_entropy": 0.8442234786823247, + "max_load_share": 0.08641975308641975 + }, + "full_input": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "6d2fefa1362ab92ce0e062459b17111fa7464c5fe6a16ee545981c02884c86d9", + "route_weight_sha256": "9e8d130ad0a20e937cf0d2a5b4f4cba339b850fab46a13f7c0d38de34df7f1b0", + "loads": [ + 17, + 0, + 3, + 0, + 11, + 1, + 0, + 6, + 5, + 2, + 12, + 1, + 3, + 10, + 3, + 4, + 7, + 3, + 0, + 12, + 8, + 0, + 18, + 6, + 3, + 9, + 0, + 1, + 1, + 11, + 6, + 6, + 3, + 3, + 10, + 9, + 0, + 1, + 3, + 1, + 0, + 12, + 3, + 1, + 6, + 8, + 17, + 2, + 5, + 4, + 12, + 3, + 3, + 3, + 1, + 6, + 6, + 1, + 4, + 5, + 6, + 0, + 4, + 1 + ], + "weighted_loads": [ + 1.0457670837640762, + 0.0, + 0.2744012176990509, + 0.0, + 1.0917432308197021, + 0.15070104598999023, + 0.0, + 0.4889596551656723, + 0.4001350738108158, + 0.10046876966953278, + 1.2639406397938728, + 0.05793815106153488, + 0.09660228341817856, + 0.5681049851700664, + 0.14365721493959427, + 0.31846458092331886, + 0.42281119152903557, + 0.12859344109892845, + 0.0, + 1.1789996176958084, + 0.4461943134665489, + 0.0, + 2.2900401204824448, + 0.39158931747078896, + 0.1304948702454567, + 0.547659233212471, + 0.0, + 0.013018812984228134, + 0.08627108484506607, + 0.7171196900308132, + 0.3856026120483875, + 0.2315989825874567, + 0.1662890873849392, + 0.2607380710542202, + 0.5524568930268288, + 0.6168690137565136, + 0.0, + 0.032622821629047394, + 0.1280519999563694, + 0.07823827117681503, + 0.0, + 1.0632955357432365, + 0.15833847597241402, + 0.039499297738075256, + 0.3818444376811385, + 0.584416288882494, + 1.2904702834784985, + 0.07139112800359726, + 0.3373993746936321, + 0.42892467975616455, + 0.7807128243148327, + 0.17817965522408485, + 0.1598442979156971, + 0.11057881824672222, + 0.031266335397958755, + 0.3493789304047823, + 0.28052712976932526, + 0.04815575107932091, + 0.35623224452137947, + 0.21192697808146477, + 0.4082886688411236, + 0.0, + 0.1986677199602127, + 0.03623296320438385 + ], + "unique_experts": 55, + "load_cv": 0.9212945755498299, + "normalized_load_entropy": 0.897282554567261, + "max_load_share": 0.057692307692307696 + } + }, + "s1_period": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "668de42fbbe4346ef5e6e62883698ed8f9874683dddfddc60a4373b4dc2ef41e", + "route_weight_sha256": "b21e2471268de888021df833e9eaa32a8fe7304d7709b5bdd0d18ecc2045277c", + "loads": [ + 6, + 0, + 3, + 0, + 9, + 2, + 0, + 6, + 2, + 2, + 0, + 2, + 1, + 7, + 2, + 3, + 5, + 1, + 0, + 0, + 8, + 0, + 14, + 2, + 0, + 11, + 0, + 1, + 1, + 10, + 5, + 1, + 2, + 3, + 0, + 3, + 0, + 1, + 1, + 1, + 0, + 2, + 2, + 1, + 1, + 2, + 4, + 2, + 2, + 4, + 9, + 2, + 3, + 0, + 1, + 1, + 0, + 1, + 2, + 0, + 5, + 0, + 2, + 1 + ], + "weighted_loads": [ + 0.3263339325785637, + 0.0, + 0.27092718333005905, + 0.0, + 0.7873717695474625, + 0.17114108055830002, + 0.0, + 0.4959769882261753, + 0.2356928214430809, + 0.09799585863947868, + 0.0, + 0.10288059338927269, + 0.057570282369852066, + 0.4392997995018959, + 0.10606781393289566, + 0.24405837431550026, + 0.324875321239233, + 0.03401712700724602, + 0.0, + 0.0, + 0.4564253631979227, + 0.0, + 1.5171500369906425, + 0.12915493175387383, + 0.0, + 0.6074666287750006, + 0.0, + 0.03728592023253441, + 0.08801659941673279, + 0.6767344959080219, + 0.33946480974555016, + 0.04757952690124512, + 0.12070242688059807, + 0.258692666888237, + 0.0, + 0.21752871572971344, + 0.0, + 0.033427294343709946, + 0.03908494859933853, + 0.0790010392665863, + 0.0, + 0.12943919748067856, + 0.13706733286380768, + 0.04008619487285614, + 0.043837662786245346, + 0.07165112346410751, + 0.29448864981532097, + 0.07422588393092155, + 0.15619435906410217, + 0.4213549569249153, + 0.6121903136372566, + 0.1498546563088894, + 0.16591578349471092, + 0.0, + 0.030997658148407936, + 0.04727499932050705, + 0.0, + 0.049697913229465485, + 0.1861826255917549, + 0.0, + 0.3593467138707638, + 0.0, + 0.15332580357789993, + 0.042560875415802 + ], + "unique_experts": 48, + "load_cv": 1.1892292117038756, + "normalized_load_entropy": 0.8520027359891691, + "max_load_share": 0.08641975308641975 + }, + "full_input": { + "tokens": 68, + "top_k": 6, + "decisions": 408, + "ordered_route_sha256": "bffb55473f331118fe7c258b6d338a86eec56ad2b5505335ba9ecbec9fdec7c7", + "route_weight_sha256": "9492b2f68663affff8b99e579226c0131b485f4e701a46ebb4e2fdfaa7c55cf5", + "loads": [ + 18, + 2, + 3, + 0, + 11, + 2, + 0, + 6, + 9, + 4, + 12, + 4, + 3, + 10, + 3, + 4, + 6, + 4, + 0, + 12, + 8, + 3, + 18, + 13, + 5, + 21, + 4, + 2, + 7, + 10, + 7, + 5, + 2, + 6, + 7, + 15, + 0, + 4, + 6, + 2, + 6, + 18, + 4, + 1, + 5, + 13, + 26, + 2, + 9, + 9, + 11, + 3, + 3, + 3, + 2, + 5, + 6, + 1, + 7, + 4, + 5, + 1, + 4, + 2 + ], + "weighted_loads": [ + 1.11630904302001, + 0.08696373552083969, + 0.27092718333005905, + 0.0, + 1.0823350101709366, + 0.17114108055830002, + 0.0, + 0.4959769882261753, + 0.656132847070694, + 0.18800999596714973, + 1.158988643437624, + 0.19869496673345566, + 0.10362537950277328, + 0.5226021921262145, + 0.144880261272192, + 0.31619661673903465, + 0.37102290987968445, + 0.1845473162829876, + 0.0, + 1.2188360281288624, + 0.4564253631979227, + 0.1272287704050541, + 2.197983058169484, + 0.9421672262251377, + 0.19164331629872322, + 1.117751207202673, + 0.2540854439139366, + 0.05030473321676254, + 0.5092652589082718, + 0.6767344959080219, + 0.47978444769978523, + 0.192917937412858, + 0.12070242688059807, + 0.4801821857690811, + 0.3385575655847788, + 1.0062852911651134, + 0.0, + 0.17495842278003693, + 0.29766200110316277, + 0.14653533697128296, + 0.4039984606206417, + 1.6076526045799255, + 0.23029236495494843, + 0.04008619487285614, + 0.2142668543383479, + 0.9999095387756824, + 2.216172467917204, + 0.07422588393092155, + 0.5796310305595398, + 0.749091599136591, + 0.7413574084639549, + 0.1828184500336647, + 0.16591578349471092, + 0.14908356219530106, + 0.07193969376385212, + 0.27889847569167614, + 0.2738169692456722, + 0.049697913229465485, + 0.5062315315008163, + 0.17891351506114006, + 0.3593467138707638, + 0.038211289793252945, + 0.3111346550285816, + 0.07852356880903244 + ], + "unique_experts": 60, + "load_cv": 0.847231282371306, + "normalized_load_entropy": 0.9210533349655826, + "max_load_share": 0.06372549019607843 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 27, + "ordered_topk_exact_tokens": 19, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.9153439153439153, + "mean_token_weighted_tv": 0.016509549002404564, + "aggregate_load_tv": 0.04938271604938271 + }, + "system_bos": { + "tokens": 27, + "ordered_topk_exact_tokens": 16, + "set_exact_tokens": 18, + "mean_set_jaccard": 0.8888888888888888, + "mean_token_weighted_tv": 0.023705320467275602, + "aggregate_load_tv": 0.05555555555555555 + }, + "system_x": { + "tokens": 27, + "ordered_topk_exact_tokens": 16, + "set_exact_tokens": 18, + "mean_set_jaccard": 0.8777777777777779, + "mean_token_weighted_tv": 0.0313901127902446, + "aggregate_load_tv": 0.06172839506172839 + }, + "system_period": { + "tokens": 27, + "ordered_topk_exact_tokens": 16, + "set_exact_tokens": 18, + "mean_set_jaccard": 0.8737373737373737, + "mean_token_weighted_tv": 0.03336370084434748, + "aggregate_load_tv": 0.07407407407407407 + }, + "bos_at_s0": { + "tokens": 27, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.8862433862433863, + "mean_token_weighted_tv": 0.02486785366717312, + "aggregate_load_tv": 0.04938271604938271 + }, + "bos_at_s1": { + "tokens": 27, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.8650793650793651, + "mean_token_weighted_tv": 0.02921383862418157, + "aggregate_load_tv": 0.037037037037037035 + }, + "x_at_s0": { + "tokens": 27, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 18, + "mean_set_jaccard": 0.8888888888888888, + "mean_token_weighted_tv": 0.027025378274696844, + "aggregate_load_tv": 0.05555555555555555 + }, + "x_at_s1": { + "tokens": 27, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 12, + "mean_set_jaccard": 0.7943722943722944, + "mean_token_weighted_tv": 0.0498162272075812, + "aggregate_load_tv": 0.08641975308641975 + }, + "period_at_s0": { + "tokens": 27, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.8597883597883599, + "mean_token_weighted_tv": 0.03377550936959408, + "aggregate_load_tv": 0.06790123456790123 + }, + "period_at_s1": { + "tokens": 27, + "ordered_topk_exact_tokens": 8, + "set_exact_tokens": 10, + "mean_set_jaccard": 0.7811447811447811, + "mean_token_weighted_tv": 0.05237667148725854, + "aggregate_load_tv": 0.08641975308641975 + } + } + }, + "layer_10": { + "layer": 10, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "a2e098271e0b94e1879aefa85edc610650e1ebc91c9f9e517f3479fa0b479f27", + "route_weight_sha256": "68625a18dcadd578c5b4b674d131c323fff88662fd122e91b4ecc88099322051", + "loads": [ + 3, + 0, + 2, + 3, + 4, + 6, + 5, + 1, + 0, + 3, + 1, + 0, + 0, + 1, + 6, + 1, + 8, + 0, + 5, + 9, + 2, + 0, + 0, + 5, + 3, + 6, + 0, + 0, + 1, + 3, + 2, + 4, + 5, + 27, + 2, + 0, + 0, + 3, + 1, + 6, + 0, + 2, + 10, + 0, + 0, + 3, + 0, + 3, + 0, + 0, + 0, + 1, + 0, + 2, + 3, + 2, + 0, + 1, + 1, + 1, + 2, + 0, + 2, + 1 + ], + "weighted_loads": [ + 0.20109602063894272, + 0.0, + 0.1814662590622902, + 0.15768269449472427, + 0.2985212691128254, + 0.5476062521338463, + 0.2965809889137745, + 0.03983436897397041, + 0.0, + 0.22060434520244598, + 0.03708456829190254, + 0.0, + 0.0, + 0.03902667760848999, + 0.473144318908453, + 0.08519735187292099, + 0.5659770891070366, + 0.0, + 0.285431444644928, + 0.542222123593092, + 0.08872941881418228, + 0.0, + 0.0, + 0.38751088455319405, + 0.17160974815487862, + 0.3905935175716877, + 0.0, + 0.0, + 0.04689088091254234, + 0.17749372124671936, + 0.11482299864292145, + 0.4348256513476372, + 0.30674276128411293, + 3.510012123733759, + 0.06916387379169464, + 0.0, + 0.0, + 0.1178998090326786, + 0.03428056091070175, + 0.40317126736044884, + 0.0, + 0.1258912980556488, + 0.9504037722945213, + 0.0, + 0.0, + 0.1127256415784359, + 0.0, + 0.20660506933927536, + 0.0, + 0.0, + 0.0, + 0.06804321706295013, + 0.0, + 0.1421215608716011, + 0.2567882463335991, + 0.1928073763847351, + 0.0, + 0.07444152235984802, + 0.04009924829006195, + 0.057164303958415985, + 0.12866279110312462, + 0.0, + 0.11176494136452675, + 0.06161678954958916 + ], + "unique_experts": 43, + "load_cv": 1.5363799478001654, + "normalized_load_entropy": 0.8124007021733693, + "max_load_share": 0.16666666666666666 + }, + "full_input": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "5c998e04806eb265e85789fe31c2a3e7863e366427e31763c4c521ad5c4234df", + "route_weight_sha256": "e0d1592850424c40d3620fe9fa71b846e942d20a9c34e4b8a10dcf033e788d0d", + "loads": [ + 3, + 0, + 4, + 3, + 4, + 6, + 5, + 5, + 0, + 5, + 3, + 1, + 1, + 4, + 8, + 1, + 8, + 2, + 12, + 11, + 6, + 2, + 1, + 5, + 3, + 8, + 0, + 8, + 2, + 5, + 4, + 5, + 5, + 36, + 3, + 1, + 0, + 3, + 1, + 6, + 0, + 13, + 14, + 2, + 4, + 6, + 6, + 5, + 0, + 2, + 2, + 7, + 0, + 4, + 3, + 11, + 0, + 7, + 1, + 12, + 7, + 13, + 2, + 1 + ], + "weighted_loads": [ + 0.20109602063894272, + 0.0, + 0.20049880491569638, + 0.15768269449472427, + 0.2985212691128254, + 0.5476062521338463, + 0.2965809889137745, + 0.215774767100811, + 0.0, + 0.24506432469934225, + 0.1326100192964077, + 0.04784318432211876, + 0.03284722566604614, + 1.4552732296288013, + 0.5964154843240976, + 0.08519735187292099, + 0.5659770891070366, + 0.11316323280334473, + 0.6677061547525227, + 0.6475852094590664, + 0.2562076710164547, + 0.0838569812476635, + 0.003727385774254799, + 0.38751088455319405, + 0.17160974815487862, + 0.4540139604359865, + 0.0, + 0.9656163826584816, + 0.09332529827952385, + 0.2964300625026226, + 0.31200411170721054, + 0.44860418513417244, + 0.30674276128411293, + 3.9557287581264973, + 0.09903680346906185, + 0.03690798208117485, + 0.0, + 0.1178998090326786, + 0.03428056091070175, + 0.40317126736044884, + 0.0, + 1.5341152548789978, + 1.0643925033509731, + 0.09648371860384941, + 0.21012866497039795, + 0.25734538212418556, + 0.2687440291047096, + 0.28030943870544434, + 0.0, + 0.0921766646206379, + 0.09569424763321877, + 0.3661857843399048, + 0.0, + 0.3050030618906021, + 0.2567882463335991, + 0.9217961467802525, + 0.0, + 0.42061973363161087, + 0.04009924829006195, + 0.8228067308664322, + 0.4746673218905926, + 1.1020325906574726, + 0.11176494136452675, + 0.06161678954958916 + ], + "unique_experts": 56, + "load_cv": 1.0929816146639546, + "normalized_load_entropy": 0.890279129449686, + "max_load_share": 0.11538461538461539 + } + }, + "s1_eos": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "fe325b00d059bf6b28cfdeb6915b3008cdc09b15184928e03dc43464e607a8b9", + "route_weight_sha256": "7369b8978d54f84139178baab1270d13cec85c0be0e7e1cd47fd83dfc61f57b5", + "loads": [ + 2, + 0, + 2, + 3, + 4, + 6, + 5, + 1, + 0, + 3, + 1, + 0, + 0, + 1, + 6, + 1, + 8, + 0, + 4, + 10, + 2, + 0, + 0, + 5, + 3, + 5, + 0, + 1, + 1, + 3, + 2, + 4, + 5, + 27, + 2, + 0, + 0, + 4, + 1, + 6, + 0, + 3, + 9, + 0, + 0, + 2, + 0, + 3, + 0, + 0, + 0, + 1, + 0, + 2, + 3, + 2, + 0, + 1, + 1, + 2, + 2, + 0, + 2, + 1 + ], + "weighted_loads": [ + 0.1532524935901165, + 0.0, + 0.18094713985919952, + 0.1600983887910843, + 0.3076134920120239, + 0.542996734380722, + 0.2976434826850891, + 0.041375163942575455, + 0.0, + 0.21351351216435432, + 0.03663680702447891, + 0.0, + 0.0, + 0.03911329433321953, + 0.48103678598999977, + 0.08521686494350433, + 0.5629589930176735, + 0.0, + 0.24762850627303123, + 0.5890146121382713, + 0.09344140067696571, + 0.0, + 0.0, + 0.38701509684324265, + 0.17814714834094048, + 0.34771016612648964, + 0.0, + 0.03561313450336456, + 0.05174991115927696, + 0.18126028776168823, + 0.11024620570242405, + 0.42894619703292847, + 0.30917396396398544, + 3.485509969294071, + 0.07259057462215424, + 0.0, + 0.0, + 0.16992076858878136, + 0.0348094180226326, + 0.41023942455649376, + 0.0, + 0.17798050120472908, + 0.9083121344447136, + 0.0, + 0.0, + 0.0758134126663208, + 0.0, + 0.20592745766043663, + 0.0, + 0.0, + 0.0, + 0.06700924038887024, + 0.0, + 0.1441441886126995, + 0.24517691880464554, + 0.1903027817606926, + 0.0, + 0.0767400786280632, + 0.040747590363025665, + 0.09646016731858253, + 0.13131145015358925, + 0.0, + 0.11528640240430832, + 0.06058921292424202 + ], + "unique_experts": 44, + "load_cv": 1.5252285753226116, + "normalized_load_entropy": 0.8175648482728074, + "max_load_share": 0.16666666666666666 + }, + "full_input": { + "tokens": 68, + "top_k": 6, + "decisions": 408, + "ordered_route_sha256": "7fb9e2bb52836e3a048b6fbff756fbc54a78e3ebfb714872912e566b65e61ed8", + "route_weight_sha256": "df352dc3074e1b8daab823142c44df1b4f2f7a81147bb516a46c14924a35cd48", + "loads": [ + 2, + 0, + 5, + 3, + 8, + 6, + 5, + 2, + 0, + 5, + 3, + 3, + 4, + 3, + 9, + 1, + 8, + 4, + 10, + 11, + 3, + 2, + 1, + 5, + 4, + 8, + 1, + 23, + 1, + 7, + 10, + 5, + 10, + 44, + 4, + 2, + 3, + 7, + 2, + 6, + 1, + 20, + 13, + 2, + 3, + 7, + 6, + 5, + 8, + 3, + 3, + 14, + 1, + 5, + 3, + 15, + 1, + 8, + 1, + 21, + 13, + 11, + 2, + 2 + ], + "weighted_loads": [ + 0.1532524935901165, + 0.0, + 0.2404732503928244, + 0.1600983887910843, + 0.5117074176669121, + 0.542996734380722, + 0.2976434826850891, + 0.0792444460093975, + 0.0, + 0.23865533620119095, + 0.11355353891849518, + 0.17066021636128426, + 0.19912005588412285, + 1.4136866442859173, + 0.6793286260217428, + 0.08521686494350433, + 0.5629589930176735, + 0.22699304297566414, + 0.6099860426038504, + 0.6246567815542221, + 0.13239987194538116, + 0.08788494765758514, + 0.00392276793718338, + 0.38701509684324265, + 0.2198769487440586, + 0.6742234751582146, + 0.041377078741788864, + 1.6235091760754585, + 0.05174991115927696, + 0.3864583298563957, + 0.7620774414390326, + 0.44272473081946373, + 0.7980142906308174, + 4.364119140431285, + 0.21517100743949413, + 0.16448035836219788, + 0.11331458203494549, + 0.2973976731300354, + 0.07101668044924736, + 0.41023942455649376, + 0.04192402586340904, + 1.9758856277912855, + 1.0062123909592628, + 0.06872713938355446, + 0.17777461558580399, + 0.3289665915071964, + 0.32513434812426567, + 0.27469634264707565, + 0.650668565183878, + 0.1714172139763832, + 0.17798033729195595, + 0.841018732637167, + 0.069259874522686, + 0.33815523609519005, + 0.24517691880464554, + 1.1786025241017342, + 0.07247401773929596, + 0.46360599622130394, + 0.040747590363025665, + 1.3423602133989334, + 0.9028847739100456, + 0.949698094278574, + 0.11528640240430832, + 0.09643654897809029 + ], + "unique_experts": 62, + "load_cv": 1.0795003614510434, + "normalized_load_entropy": 0.8989799161910984, + "max_load_share": 0.10784313725490197 + } + }, + "s0_bos": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "9820b28dda7039ffa073f4c905c6d1d17968e6430af10e00f05ca3eb9a17e696", + "route_weight_sha256": "8944cf62ec285755df1bcf741ac8449a2d4ba39826d30678bee7ea6c98d5a619", + "loads": [ + 1, + 0, + 2, + 3, + 4, + 6, + 5, + 0, + 0, + 4, + 1, + 0, + 0, + 1, + 8, + 1, + 7, + 0, + 4, + 10, + 2, + 0, + 0, + 4, + 3, + 5, + 0, + 0, + 1, + 3, + 2, + 5, + 5, + 26, + 2, + 0, + 0, + 2, + 1, + 7, + 0, + 3, + 10, + 0, + 0, + 2, + 0, + 3, + 0, + 1, + 0, + 2, + 0, + 2, + 3, + 2, + 0, + 1, + 2, + 1, + 2, + 0, + 2, + 1 + ], + "weighted_loads": [ + 0.09655139595270157, + 0.0, + 0.192776620388031, + 0.15315032005310059, + 0.3002123758196831, + 0.5523095577955246, + 0.3108861446380615, + 0.0, + 0.0, + 0.28130732104182243, + 0.03995278850197792, + 0.0, + 0.0, + 0.04012085869908333, + 0.5872781947255135, + 0.08577993512153625, + 0.5475269891321659, + 0.0, + 0.26491546630859375, + 0.5598163232207298, + 0.0885283499956131, + 0.0, + 0.0, + 0.36096739396452904, + 0.18843518197536469, + 0.38343779370188713, + 0.0, + 0.0, + 0.054908640682697296, + 0.18466642126441002, + 0.10874990373849869, + 0.5010120086371899, + 0.31385741010308266, + 3.184978038072586, + 0.07439466938376427, + 0.0, + 0.0, + 0.08572373911738396, + 0.034270647913217545, + 0.49541837722063065, + 0.0, + 0.15541380643844604, + 0.9863894730806351, + 0.0, + 0.0, + 0.07778437063097954, + 0.0, + 0.2222774587571621, + 0.0, + 0.03705848008394241, + 0.0, + 0.11993830278515816, + 0.0, + 0.14578066393733025, + 0.25850824639201164, + 0.19424069672822952, + 0.0, + 0.07224768400192261, + 0.08058362826704979, + 0.054646316915750504, + 0.13986995816230774, + 0.0, + 0.11653265729546547, + 0.05947009101510048 + ], + "unique_experts": 43, + "load_cv": 1.5139950693310886, + "normalized_load_entropy": 0.8134002829979754, + "max_load_share": 0.16049382716049382 + }, + "full_input": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "23cd174c64b3576f3c0136c72f353fbc22296436976f781622aa1376a2ddf8ba", + "route_weight_sha256": "1c87676d11b5b613fb63306fe422f88bcf88920c59b382be701b1bb18107d8e5", + "loads": [ + 1, + 1, + 3, + 3, + 4, + 6, + 5, + 4, + 0, + 5, + 3, + 1, + 1, + 4, + 11, + 1, + 7, + 4, + 10, + 12, + 7, + 2, + 0, + 4, + 3, + 7, + 0, + 8, + 2, + 5, + 4, + 6, + 5, + 35, + 3, + 1, + 0, + 2, + 1, + 7, + 0, + 12, + 14, + 2, + 3, + 5, + 6, + 6, + 0, + 4, + 2, + 7, + 0, + 4, + 3, + 11, + 0, + 7, + 2, + 13, + 7, + 13, + 2, + 1 + ], + "weighted_loads": [ + 0.09655139595270157, + 0.03757305443286896, + 0.20692427176982164, + 0.15315032005310059, + 0.3002123758196831, + 0.5523095577955246, + 0.3108861446380615, + 0.1759403981268406, + 0.0, + 0.2975367773324251, + 0.13547823950648308, + 0.04784318432211876, + 0.03284722566604614, + 0.5875562243163586, + 0.7781092189252377, + 0.08577993512153625, + 0.5475269891321659, + 0.21416408941149712, + 0.6649172715842724, + 0.6765045262873173, + 0.32815996184945107, + 0.0838569812476635, + 0.0, + 0.36096739396452904, + 0.18843518197536469, + 0.44685823656618595, + 0.0, + 0.9516314044594765, + 0.1013430580496788, + 0.31957653164863586, + 0.3201672285795212, + 0.5147905424237251, + 0.31385741010308266, + 3.6442883796989918, + 0.10426759906113148, + 0.03690798208117485, + 0.0, + 0.08572373911738396, + 0.034270647913217545, + 0.49541837722063065, + 0.0, + 1.5119923800230026, + 1.142169388011098, + 0.09648371860384941, + 0.1991475224494934, + 0.2224041111767292, + 0.2687440291047096, + 0.3275000751018524, + 0.0, + 0.2046145685017109, + 0.09569424763321877, + 0.3581918105483055, + 0.0, + 0.3248474784195423, + 0.25850824639201164, + 0.8911240287125111, + 0.0, + 0.41842589527368546, + 0.08058362826704979, + 0.8638259582221508, + 0.4855530932545662, + 1.1083096154034138, + 0.11653265729546547, + 0.05947009101510048 + ], + "unique_experts": 56, + "load_cv": 1.0790577134615802, + "normalized_load_entropy": 0.8908698731035323, + "max_load_share": 0.11217948717948718 + } + }, + "s1_bos": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "11bffd603e9dbe7192dead5930cb4f70778ccd606dab52cb7795de8b0fd5628f", + "route_weight_sha256": "fbbd8d97403f76b39374b6cdb9181aae7bdd1ac3abb20e4a12bc0ad429b38a06", + "loads": [ + 2, + 0, + 2, + 3, + 5, + 6, + 5, + 0, + 0, + 4, + 1, + 0, + 0, + 1, + 8, + 1, + 8, + 0, + 4, + 10, + 1, + 0, + 0, + 4, + 3, + 5, + 0, + 1, + 1, + 3, + 2, + 5, + 5, + 26, + 2, + 0, + 0, + 2, + 1, + 7, + 0, + 3, + 10, + 0, + 0, + 2, + 0, + 3, + 0, + 0, + 0, + 1, + 0, + 2, + 3, + 2, + 0, + 1, + 1, + 1, + 2, + 0, + 2, + 1 + ], + "weighted_loads": [ + 0.15273743495345116, + 0.0, + 0.197742760181427, + 0.15066075325012207, + 0.3418309837579727, + 0.5647943168878555, + 0.31548698619008064, + 0.0, + 0.0, + 0.2688696086406708, + 0.03742027282714844, + 0.0, + 0.0, + 0.03704921156167984, + 0.5773978233337402, + 0.09808340668678284, + 0.579777430742979, + 0.0, + 0.26013222709298134, + 0.5553561858832836, + 0.051623255014419556, + 0.0, + 0.0, + 0.3554149940609932, + 0.18958299234509468, + 0.37355993688106537, + 0.0, + 0.03691611811518669, + 0.06614460796117783, + 0.17974749207496643, + 0.11184163205325603, + 0.4915032833814621, + 0.31357182934880257, + 3.1493624225258827, + 0.07233590446412563, + 0.0, + 0.0, + 0.09376564994454384, + 0.03372080251574516, + 0.4945373870432377, + 0.0, + 0.15844620019197464, + 0.9697954244911671, + 0.0, + 0.0, + 0.07765695825219154, + 0.0, + 0.2194502241909504, + 0.0, + 0.0, + 0.0, + 0.06744490563869476, + 0.0, + 0.1461256518959999, + 0.24766043946146965, + 0.19850042462348938, + 0.0, + 0.07857725024223328, + 0.04323239251971245, + 0.04505486786365509, + 0.14063473790884018, + 0.0, + 0.11938461661338806, + 0.05707024037837982 + ], + "unique_experts": 43, + "load_cv": 1.528422983849137, + "normalized_load_entropy": 0.8093281060226323, + "max_load_share": 0.16049382716049382 + }, + "full_input": { + "tokens": 68, + "top_k": 6, + "decisions": 408, + "ordered_route_sha256": "50a9499d00b883e3571db6ae14148f8244da8b0e2337e19f0be25d19152c3c1f", + "route_weight_sha256": "0d1b99fdfd7d9174861bdeff1dafbf995b2ca4e81e3c50033759887c810d9d04", + "loads": [ + 2, + 0, + 4, + 3, + 9, + 6, + 5, + 1, + 0, + 5, + 3, + 3, + 4, + 3, + 12, + 1, + 8, + 4, + 9, + 12, + 3, + 2, + 0, + 4, + 4, + 8, + 1, + 23, + 1, + 7, + 11, + 6, + 10, + 44, + 4, + 2, + 3, + 5, + 2, + 7, + 1, + 19, + 12, + 2, + 3, + 7, + 6, + 6, + 8, + 4, + 3, + 13, + 1, + 5, + 3, + 15, + 1, + 8, + 1, + 21, + 13, + 11, + 2, + 2 + ], + "weighted_loads": [ + 0.15273743495345116, + 0.0, + 0.2522552954033017, + 0.15066075325012207, + 0.5459249094128609, + 0.5647943168878555, + 0.31548698619008064, + 0.03786928206682205, + 0.0, + 0.28509906493127346, + 0.1143370047211647, + 0.17066021636128426, + 0.19912005588412285, + 0.545766644179821, + 0.8327828720211983, + 0.09808340668678284, + 0.579777430742979, + 0.21037084981799126, + 0.6523471027612686, + 0.6481468379497528, + 0.14820368587970734, + 0.08788494765758514, + 0.0, + 0.3554149940609932, + 0.23131279274821281, + 0.7000732459127903, + 0.041377078741788864, + 1.5664854273200035, + 0.06614460796117783, + 0.3977500796318054, + 0.8253549467772245, + 0.5052818171679974, + 0.8024121560156345, + 4.080435050651431, + 0.21491633728146553, + 0.16448035836219788, + 0.11331458203494549, + 0.22124255448579788, + 0.06992806494235992, + 0.4945373870432377, + 0.04192402586340904, + 2.052757551893592, + 1.0156517252326012, + 0.06872713938355446, + 0.21788927540183067, + 0.33081013709306717, + 0.32513434812426567, + 0.32252277433872223, + 0.650668565183878, + 0.23167689889669418, + 0.17798033729195595, + 0.7716403529047966, + 0.069259874522686, + 0.3614616394042969, + 0.24766043946146965, + 1.2091213911771774, + 0.07247401773929596, + 0.465443167835474, + 0.04323239251971245, + 1.366378240287304, + 0.9048434570431709, + 0.9510271847248077, + 0.11938461661338806, + 0.09291757643222809 + ], + "unique_experts": 61, + "load_cv": 1.0812796610950774, + "normalized_load_entropy": 0.8965107694717673, + "max_load_share": 0.10784313725490197 + } + }, + "s0_x": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "9a7d0d1f83eb4a5d7b70a62ab3f763121f7c1524c9bd69e47b9544b01807752a", + "route_weight_sha256": "a7294b82d82e47fae28bf531b3138083245287514ec59dd51221e650a302168f", + "loads": [ + 1, + 0, + 2, + 3, + 5, + 6, + 5, + 0, + 0, + 4, + 0, + 0, + 0, + 1, + 8, + 1, + 8, + 0, + 4, + 9, + 2, + 0, + 0, + 4, + 3, + 6, + 0, + 1, + 1, + 3, + 2, + 5, + 5, + 25, + 2, + 0, + 0, + 3, + 1, + 6, + 0, + 3, + 9, + 0, + 0, + 4, + 0, + 3, + 0, + 0, + 0, + 2, + 0, + 2, + 3, + 2, + 0, + 1, + 1, + 1, + 2, + 0, + 2, + 1 + ], + "weighted_loads": [ + 0.10156219452619553, + 0.0, + 0.18873285502195358, + 0.15123126655817032, + 0.33540384471416473, + 0.5542930290102959, + 0.3128288872539997, + 0.0, + 0.0, + 0.27257296070456505, + 0.0, + 0.0, + 0.0, + 0.03942106291651726, + 0.5716608799993992, + 0.06598150730133057, + 0.5746810846030712, + 0.0, + 0.266863401979208, + 0.4994904100894928, + 0.09628500789403915, + 0.0, + 0.0, + 0.35797978565096855, + 0.1872038058936596, + 0.42064085602760315, + 0.0, + 0.037181027233600616, + 0.04765075445175171, + 0.18560074269771576, + 0.11023942194879055, + 0.503975622355938, + 0.32116829603910446, + 2.9142479561269283, + 0.07127400487661362, + 0.0, + 0.0, + 0.12981173023581505, + 0.032659970223903656, + 0.4568198099732399, + 0.0, + 0.18898387253284454, + 0.9526569657027721, + 0.0, + 0.0, + 0.18089109659194946, + 0.0, + 0.22777723520994186, + 0.0, + 0.0, + 0.0, + 0.12504258379340172, + 0.0, + 0.151004359126091, + 0.25291311368346214, + 0.2003849372267723, + 0.0, + 0.07680828869342804, + 0.04412463307380676, + 0.0588432140648365, + 0.1487651765346527, + 0.0, + 0.11750320717692375, + 0.05316697806119919 + ], + "unique_experts": 42, + "load_cv": 1.4698618394803282, + "normalized_load_entropy": 0.8144532369044312, + "max_load_share": 0.15432098765432098 + }, + "full_input": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "227fcd5e0559a1a1e6d2b9ed2e9d9208f0ee063c4413aa42f7b74e4392363afa", + "route_weight_sha256": "8c4b94eaa62d65e9f4d95904c2b8088345536d38ceef4b5c4be8666d50a7d7f0", + "loads": [ + 2, + 1, + 3, + 3, + 5, + 6, + 5, + 5, + 0, + 5, + 2, + 1, + 1, + 3, + 10, + 1, + 8, + 4, + 9, + 11, + 6, + 2, + 0, + 4, + 3, + 8, + 0, + 7, + 2, + 5, + 5, + 6, + 5, + 35, + 3, + 1, + 0, + 3, + 1, + 6, + 0, + 12, + 12, + 2, + 4, + 8, + 7, + 6, + 0, + 2, + 3, + 7, + 0, + 4, + 3, + 10, + 0, + 8, + 1, + 13, + 7, + 13, + 2, + 1 + ], + "weighted_loads": [ + 0.13553005456924438, + 0.047698721289634705, + 0.20288050640374422, + 0.15123126655817032, + 0.33540384471416473, + 0.5542930290102959, + 0.3128288872539997, + 0.2159726545214653, + 0.0, + 0.28880241699516773, + 0.09552545100450516, + 0.04784318432211876, + 0.03284722566604614, + 0.543594241142273, + 0.7036026231944561, + 0.06598150730133057, + 0.5746810846030712, + 0.1928529143333435, + 0.6028884798288345, + 0.611791580915451, + 0.26376326009631157, + 0.0838569812476635, + 0.0, + 0.35797978565096855, + 0.1872038058936596, + 0.48406129889190197, + 0.0, + 0.79390973970294, + 0.09408517181873322, + 0.3228556402027607, + 0.36998037807643414, + 0.5177541561424732, + 0.32116829603910446, + 3.3998750559985638, + 0.10114693455398083, + 0.03690798208117485, + 0.0, + 0.12981173023581505, + 0.032659970223903656, + 0.4568198099732399, + 0.0, + 1.271862180903554, + 1.0585885141044855, + 0.09648371860384941, + 0.21498509868979454, + 0.3947981670498848, + 0.31817733496427536, + 0.33974524959921837, + 0.0, + 0.09069667011499405, + 0.1294056437909603, + 0.40131157636642456, + 0.0, + 0.3288779780268669, + 0.25291311368346214, + 0.8210157155990601, + 0.0, + 0.48487959429621696, + 0.04412463307380676, + 0.8823854364454746, + 0.5011911243200302, + 1.126618456095457, + 0.11750320717692375, + 0.05316697806119919 + ], + "unique_experts": 56, + "load_cv": 1.060621429740843, + "normalized_load_entropy": 0.8935828114901818, + "max_load_share": 0.11217948717948718 + } + }, + "s1_x": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "a328bcdcd2315b5e62d6b577c1d2d7a30f35e1bd19f7e630b4ce2d3cc86031ec", + "route_weight_sha256": "81e1570f4da8bc16f68d2e8e570fffcbcc11fb0ea85e87dcf288b7aab66ec576", + "loads": [ + 2, + 0, + 2, + 2, + 5, + 6, + 5, + 1, + 0, + 3, + 0, + 0, + 0, + 1, + 8, + 1, + 8, + 0, + 4, + 9, + 1, + 0, + 0, + 4, + 3, + 6, + 0, + 1, + 1, + 3, + 2, + 5, + 5, + 24, + 2, + 0, + 0, + 2, + 1, + 7, + 0, + 3, + 9, + 0, + 0, + 4, + 0, + 3, + 0, + 0, + 0, + 3, + 0, + 2, + 3, + 3, + 0, + 1, + 1, + 1, + 3, + 0, + 2, + 0 + ], + "weighted_loads": [ + 0.14966754615306854, + 0.0, + 0.20306234806776047, + 0.11399580538272858, + 0.33844250813126564, + 0.5426500663161278, + 0.320453017950058, + 0.038947008550167084, + 0.0, + 0.2349339760839939, + 0.0, + 0.0, + 0.0, + 0.038805216550827026, + 0.5768274888396263, + 0.07056301087141037, + 0.5687367394566536, + 0.0, + 0.2641761414706707, + 0.5012876875698566, + 0.059252288192510605, + 0.0, + 0.0, + 0.37739652395248413, + 0.19014699384570122, + 0.3708249032497406, + 0.0, + 0.035247962921857834, + 0.07084175199270248, + 0.1821354739367962, + 0.1225649043917656, + 0.4949512183666229, + 0.3239575885236263, + 2.6709932535886765, + 0.07041013427078724, + 0.0, + 0.0, + 0.0901450365781784, + 0.03484594076871872, + 0.5034205541014671, + 0.0, + 0.22251258790493011, + 0.9481702707707882, + 0.0, + 0.0, + 0.18995844572782516, + 0.0, + 0.22064074873924255, + 0.0, + 0.0, + 0.0, + 0.14916459657251835, + 0.0, + 0.14943796396255493, + 0.2547198422253132, + 0.2239484265446663, + 0.0, + 0.07547029107809067, + 0.04343283921480179, + 0.053396742790937424, + 0.1814461164176464, + 0.0, + 0.12128720059990883, + 0.0 + ], + "unique_experts": 42, + "load_cv": 1.4379934028613495, + "normalized_load_entropy": 0.8169283606417327, + "max_load_share": 0.14814814814814814 + }, + "full_input": { + "tokens": 68, + "top_k": 6, + "decisions": 408, + "ordered_route_sha256": "e34f7c39f7ae964a22e6dfb0090347e4fcf609fd8c1b43dcf319c98e162a0eaf", + "route_weight_sha256": "b418903f652598a234d2ce106cbf283fc133fc17cd951bf54f693b8cdc423adb", + "loads": [ + 3, + 1, + 4, + 2, + 9, + 6, + 5, + 3, + 0, + 4, + 3, + 3, + 4, + 2, + 12, + 1, + 8, + 3, + 9, + 10, + 2, + 2, + 0, + 4, + 4, + 9, + 1, + 20, + 1, + 7, + 12, + 6, + 10, + 42, + 4, + 2, + 3, + 5, + 2, + 7, + 1, + 18, + 11, + 2, + 2, + 10, + 7, + 7, + 8, + 4, + 5, + 17, + 1, + 5, + 3, + 14, + 1, + 9, + 1, + 20, + 13, + 11, + 2, + 1 + ], + "weighted_loads": [ + 0.20503713190555573, + 0.05038747936487198, + 0.2575748832896352, + 0.11399580538272858, + 0.5425364337861538, + 0.5426500663161278, + 0.320453017950058, + 0.12653257325291634, + 0.0, + 0.2511634323745966, + 0.12905551865696907, + 0.17066021636128426, + 0.19912005588412285, + 0.5080614387989044, + 0.8532354608178139, + 0.07056301087141037, + 0.5687367394566536, + 0.16629254817962646, + 0.6200769506394863, + 0.5348591729998589, + 0.09821075946092606, + 0.08788494765758514, + 0.0, + 0.37739652395248413, + 0.23187679424881935, + 0.6973382122814655, + 0.041377078741788864, + 1.3444995880126953, + 0.07084175199270248, + 0.40507838502526283, + 0.9127290733158588, + 0.5087297521531582, + 0.8127979151904583, + 3.608171297237277, + 0.21299056708812714, + 0.16448035836219788, + 0.11331458203494549, + 0.21762194111943245, + 0.07105320319533348, + 0.5034205541014671, + 0.04192402586340904, + 1.658689571544528, + 0.9940265715122223, + 0.06872713938355446, + 0.14290141686797142, + 0.5057587511837482, + 0.38928859308362007, + 0.36989786475896835, + 0.650668565183878, + 0.20807627402245998, + 0.25928405672311783, + 0.9877803307026625, + 0.069259874522686, + 0.3525194153189659, + 0.2547198422253132, + 1.0565374121069908, + 0.07247401773929596, + 0.5138211399316788, + 0.04343283921480179, + 1.2958199754357338, + 0.905527088791132, + 0.9777989163994789, + 0.12128720059990883, + 0.03584733605384827 + ], + "unique_experts": 62, + "load_cv": 1.0395855797499265, + "normalized_load_entropy": 0.901050195929444, + "max_load_share": 0.10294117647058823 + } + }, + "s0_period": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "e02cecd591586bf3aa035d43108c8b4b9316695e05a5999f9db2d2835899e8fd", + "route_weight_sha256": "ae987cdf4577b1f94900eb4273ee18466204adc9e9295b925e3008139c08dd48", + "loads": [ + 2, + 0, + 2, + 3, + 5, + 6, + 5, + 1, + 0, + 4, + 0, + 0, + 0, + 1, + 8, + 1, + 7, + 0, + 4, + 8, + 2, + 0, + 0, + 4, + 3, + 6, + 0, + 1, + 1, + 3, + 1, + 5, + 5, + 25, + 2, + 0, + 0, + 3, + 1, + 6, + 0, + 3, + 9, + 0, + 0, + 4, + 0, + 4, + 0, + 0, + 0, + 2, + 0, + 2, + 3, + 2, + 0, + 1, + 1, + 2, + 2, + 0, + 2, + 0 + ], + "weighted_loads": [ + 0.14631976932287216, + 0.0, + 0.1861342415213585, + 0.1534966044127941, + 0.338587187230587, + 0.5544476211071014, + 0.31307626888155937, + 0.0395604744553566, + 0.0, + 0.27338726073503494, + 0.0, + 0.0, + 0.0, + 0.038725048303604126, + 0.5803551226854324, + 0.06776907294988632, + 0.5339063219726086, + 0.0, + 0.26673097908496857, + 0.4783538244664669, + 0.09415137767791748, + 0.0, + 0.0, + 0.3622990921139717, + 0.18856719136238098, + 0.4275747016072273, + 0.0, + 0.03828471526503563, + 0.04521114379167557, + 0.1916121169924736, + 0.07625237852334976, + 0.502299539744854, + 0.31982266902923584, + 2.866900809109211, + 0.06859143264591694, + 0.0, + 0.0, + 0.11746337823569775, + 0.03319684416055679, + 0.46121226996183395, + 0.0, + 0.193724375218153, + 0.9560149572789669, + 0.0, + 0.0, + 0.18522006645798683, + 0.0, + 0.2508928030729294, + 0.0, + 0.0, + 0.0, + 0.12538768723607063, + 0.0, + 0.14657802134752274, + 0.2655135430395603, + 0.19781596213579178, + 0.0, + 0.07643542438745499, + 0.04423174634575844, + 0.09955252334475517, + 0.14953403919935226, + 0.0, + 0.11620280146598816, + 0.0 + ], + "unique_experts": 42, + "load_cv": 1.4514969751891964, + "normalized_load_entropy": 0.8181906114525188, + "max_load_share": 0.15432098765432098 + }, + "full_input": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "9928d8fd4c9bda450ee52ba53c07c80bb785c0aba3a6ea7d78b011c3d8ced2ad", + "route_weight_sha256": "c257c7ebc907c5efd9a87217be0cfa3fa0c193372dd84176e0f91afc8e7f20b1", + "loads": [ + 3, + 1, + 3, + 3, + 5, + 6, + 5, + 5, + 0, + 5, + 2, + 1, + 2, + 3, + 10, + 1, + 7, + 3, + 9, + 10, + 6, + 2, + 0, + 4, + 3, + 8, + 0, + 7, + 2, + 5, + 5, + 6, + 5, + 34, + 3, + 1, + 0, + 3, + 1, + 6, + 0, + 13, + 12, + 2, + 3, + 8, + 6, + 6, + 0, + 3, + 3, + 8, + 0, + 4, + 3, + 10, + 0, + 8, + 1, + 14, + 9, + 12, + 2, + 0 + ], + "weighted_loads": [ + 0.17781800404191017, + 0.03562026098370552, + 0.20028189290314913, + 0.1534966044127941, + 0.338587187230587, + 0.5544476211071014, + 0.31307626888155937, + 0.2155008725821972, + 0.0, + 0.2896167170256376, + 0.09552545100450516, + 0.04784318432211876, + 0.07013681530952454, + 0.5428982265293598, + 0.7195270098745823, + 0.06776907294988632, + 0.5339063219726086, + 0.1690312847495079, + 0.6027560569345951, + 0.5896457396447659, + 0.2616296298801899, + 0.0838569812476635, + 0.0, + 0.3622990921139717, + 0.18856719136238098, + 0.49099514447152615, + 0.0, + 0.7810210548341274, + 0.09164556115865707, + 0.32500915601849556, + 0.4116596542298794, + 0.5160780735313892, + 0.31982266902923584, + 3.3201542124152184, + 0.09846436232328415, + 0.03690798208117485, + 0.0, + 0.11746337823569775, + 0.03319684416055679, + 0.46121226996183395, + 0.0, + 1.368302769958973, + 1.0619465056806803, + 0.09648371860384941, + 0.16774678230285645, + 0.37273769453167915, + 0.2687440291047096, + 0.32459717243909836, + 0.0, + 0.1392981931567192, + 0.12490889057517052, + 0.4698999151587486, + 0.0, + 0.3203931897878647, + 0.2655135430395603, + 0.8526643179357052, + 0.0, + 0.494571715593338, + 0.04423174634575844, + 0.9151341766119003, + 0.5989385917782784, + 1.0412253327667713, + 0.11620280146598816, + 0.0 + ], + "unique_experts": 55, + "load_cv": 1.0462669622104188, + "normalized_load_entropy": 0.8938139558045896, + "max_load_share": 0.10897435897435898 + } + }, + "s1_period": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "f4e9b6f09ece2535a6c55f69f60da71640099d59c187a9276ae111c20cedf209", + "route_weight_sha256": "6626b56b060bc0652564721e4994790352b54dde133b9873f0eeda2ee57e8218", + "loads": [ + 2, + 0, + 2, + 3, + 5, + 6, + 5, + 1, + 0, + 3, + 0, + 0, + 0, + 1, + 8, + 1, + 8, + 1, + 4, + 9, + 1, + 0, + 0, + 4, + 3, + 5, + 0, + 0, + 1, + 3, + 3, + 5, + 5, + 24, + 2, + 0, + 0, + 2, + 1, + 7, + 0, + 3, + 9, + 0, + 0, + 4, + 0, + 3, + 0, + 1, + 0, + 2, + 0, + 2, + 3, + 2, + 0, + 1, + 1, + 1, + 3, + 0, + 2, + 0 + ], + "weighted_loads": [ + 0.15354226529598236, + 0.0, + 0.1975250318646431, + 0.14961454644799232, + 0.3591293580830097, + 0.5471139252185822, + 0.33381180092692375, + 0.03912848234176636, + 0.0, + 0.23194709420204163, + 0.0, + 0.0, + 0.0, + 0.03792095556855202, + 0.5789460390806198, + 0.07295754551887512, + 0.5657654292881489, + 0.03906654566526413, + 0.2645942270755768, + 0.5314701199531555, + 0.05886679142713547, + 0.0, + 0.0, + 0.3682629317045212, + 0.1884683519601822, + 0.3321680948138237, + 0.0, + 0.0, + 0.06924834102392197, + 0.18760646134614944, + 0.1564610693603754, + 0.5011549144983292, + 0.32303736358880997, + 2.4965617284178734, + 0.07087630033493042, + 0.0, + 0.0, + 0.09064150229096413, + 0.03427404910326004, + 0.5047456361353397, + 0.0, + 0.20234691351652145, + 0.9482449442148209, + 0.0, + 0.0, + 0.19198232889175415, + 0.0, + 0.21971986442804337, + 0.0, + 0.036974258720874786, + 0.0, + 0.12384039908647537, + 0.0, + 0.1486828848719597, + 0.25741514563560486, + 0.18574480712413788, + 0.0, + 0.07744991779327393, + 0.04523228108882904, + 0.04810678958892822, + 0.19485735148191452, + 0.0, + 0.12320258095860481, + 0.0 + ], + "unique_experts": 43, + "load_cv": 1.429488894755263, + "normalized_load_entropy": 0.8209408447259818, + "max_load_share": 0.14814814814814814 + }, + "full_input": { + "tokens": 68, + "top_k": 6, + "decisions": 408, + "ordered_route_sha256": "77f3b5c4307688d87f584e97194d8e9c862a9095085cc50ca85e2904231f1b8c", + "route_weight_sha256": "6c72608890167b964b80b35ffe4c9aed6fe83aeff7cc744c2aa91a4faa9c6503", + "loads": [ + 3, + 0, + 4, + 4, + 9, + 6, + 5, + 2, + 0, + 4, + 2, + 3, + 4, + 2, + 12, + 1, + 8, + 5, + 8, + 10, + 2, + 2, + 0, + 4, + 4, + 8, + 1, + 19, + 1, + 7, + 14, + 6, + 10, + 41, + 4, + 2, + 3, + 5, + 2, + 7, + 1, + 19, + 11, + 2, + 2, + 10, + 6, + 6, + 8, + 5, + 3, + 17, + 1, + 5, + 3, + 15, + 1, + 9, + 1, + 21, + 14, + 11, + 2, + 1 + ], + "weighted_loads": [ + 0.2042318545281887, + 0.0, + 0.2520375670865178, + 0.2054288610816002, + 0.5632232837378979, + 0.5471139252185822, + 0.33381180092692375, + 0.07699776440858841, + 0.0, + 0.2481765504926443, + 0.07691673189401627, + 0.17066021636128426, + 0.19912005588412285, + 0.5071771778166294, + 0.834802221506834, + 0.07295754551887512, + 0.5657654292881489, + 0.3036637268960476, + 0.5870772190392017, + 0.5654404386878014, + 0.09782526269555092, + 0.08788494765758514, + 0.0, + 0.3682629317045212, + 0.23019815236330032, + 0.6586814038455486, + 0.041377078741788864, + 1.3118379637598991, + 0.06924834102392197, + 0.4051755741238594, + 1.0330778863281012, + 0.5149334482848644, + 0.8118776902556419, + 3.3754568826407194, + 0.21345673315227032, + 0.16448035836219788, + 0.11331458203494549, + 0.21811840683221817, + 0.0704813115298748, + 0.5047456361353397, + 0.04192402586340904, + 1.675834821537137, + 0.994101244956255, + 0.06872713938355446, + 0.14290141686797142, + 0.48316390439867973, + 0.32513434812426567, + 0.3224015645682812, + 0.650668565183878, + 0.24377956613898277, + 0.17798033729195595, + 1.0356421247124672, + 0.069259874522686, + 0.35313214361667633, + 0.25741514563560486, + 1.1198130697011948, + 0.07247401773929596, + 0.5956743247807026, + 0.04523228108882904, + 1.3021802939474583, + 0.9586439430713654, + 0.9404854699969292, + 0.12320258095860481, + 0.03584733605384827 + ], + "unique_experts": 61, + "load_cv": 1.04217115811124, + "normalized_load_entropy": 0.8984173135590073, + "max_load_share": 0.10049019607843138 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 27, + "ordered_topk_exact_tokens": 19, + "set_exact_tokens": 23, + "mean_set_jaccard": 0.9497354497354499, + "mean_token_weighted_tv": 0.014961365023972812, + "aggregate_load_tv": 0.030864197530864196 + }, + "system_bos": { + "tokens": 27, + "ordered_topk_exact_tokens": 19, + "set_exact_tokens": 23, + "mean_set_jaccard": 0.9576719576719578, + "mean_token_weighted_tv": 0.017821009719261417, + "aggregate_load_tv": 0.024691358024691357 + }, + "system_x": { + "tokens": 27, + "ordered_topk_exact_tokens": 19, + "set_exact_tokens": 20, + "mean_set_jaccard": 0.9118165784832452, + "mean_token_weighted_tv": 0.026938956403345975, + "aggregate_load_tv": 0.037037037037037035 + }, + "system_period": { + "tokens": 27, + "ordered_topk_exact_tokens": 19, + "set_exact_tokens": 21, + "mean_set_jaccard": 0.9223985890652557, + "mean_token_weighted_tv": 0.027642553292766766, + "aggregate_load_tv": 0.04938271604938271 + }, + "bos_at_s0": { + "tokens": 27, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.8835978835978836, + "mean_token_weighted_tv": 0.032611241564154625, + "aggregate_load_tv": 0.06172839506172839 + }, + "bos_at_s1": { + "tokens": 27, + "ordered_topk_exact_tokens": 19, + "set_exact_tokens": 20, + "mean_set_jaccard": 0.9259259259259259, + "mean_token_weighted_tv": 0.028238916528169757, + "aggregate_load_tv": 0.043209876543209874 + }, + "x_at_s0": { + "tokens": 27, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.8941798941798943, + "mean_token_weighted_tv": 0.0378186158766901, + "aggregate_load_tv": 0.05555555555555555 + }, + "x_at_s1": { + "tokens": 27, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 13, + "mean_set_jaccard": 0.8377425044091711, + "mean_token_weighted_tv": 0.05261034797877073, + "aggregate_load_tv": 0.07407407407407407 + }, + "period_at_s0": { + "tokens": 27, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.8756613756613757, + "mean_token_weighted_tv": 0.041755532224973045, + "aggregate_load_tv": 0.06790123456790123 + }, + "period_at_s1": { + "tokens": 27, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.8615520282186949, + "mean_token_weighted_tv": 0.05406659275845245, + "aggregate_load_tv": 0.07407407407407407 + } + } + }, + "layer_11": { + "layer": 11, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "f36b229681d0c7a87abedef9aaa86996df8e043cf31ed5b04df4debfc18b6b7c", + "route_weight_sha256": "ea553d6cbae72777df32928d55d26076f80668f7e487bdc94c939e1fc56db630", + "loads": [ + 2, + 1, + 0, + 0, + 2, + 4, + 2, + 1, + 2, + 0, + 6, + 1, + 0, + 2, + 1, + 1, + 6, + 8, + 1, + 2, + 1, + 0, + 3, + 1, + 3, + 0, + 14, + 4, + 0, + 1, + 0, + 0, + 0, + 5, + 2, + 0, + 3, + 0, + 8, + 0, + 10, + 0, + 1, + 0, + 0, + 0, + 6, + 1, + 1, + 5, + 1, + 1, + 4, + 0, + 4, + 1, + 2, + 11, + 0, + 11, + 3, + 11, + 2, + 0 + ], + "weighted_loads": [ + 0.11142488569021225, + 0.05324302613735199, + 0.0, + 0.0, + 0.09621338918805122, + 0.25095104798674583, + 0.08536623232066631, + 0.06058841571211815, + 0.13095861673355103, + 0.0, + 0.4096083976328373, + 0.048599034547805786, + 0.0, + 0.10946433246135712, + 0.06607196480035782, + 0.061181019991636276, + 0.26957109197974205, + 0.9734204784035683, + 0.11954480409622192, + 0.11769257858395576, + 0.03570833057165146, + 0.0, + 0.17240506038069725, + 0.03756176307797432, + 0.12365886941552162, + 0.0, + 0.8701631128787994, + 0.17862197756767273, + 0.0, + 0.11129878461360931, + 0.0, + 0.0, + 0.0, + 0.20298095792531967, + 0.08024286106228828, + 0.0, + 0.12479198724031448, + 0.0, + 0.4988812282681465, + 0.0, + 0.5019189417362213, + 0.0, + 0.04813651368021965, + 0.0, + 0.0, + 0.0, + 0.33003222942352295, + 0.03753166273236275, + 0.06356674432754517, + 0.2208695262670517, + 0.03419927880167961, + 0.04821283742785454, + 0.31551502272486687, + 0.0, + 0.2336064726114273, + 0.03949323669075966, + 0.07115280628204346, + 0.9516783207654953, + 0.0, + 0.7804495133459568, + 0.1248189453035593, + 0.9173636212944984, + 0.07474203780293465, + 0.0 + ], + "unique_experts": 44, + "load_cv": 1.2933535086269732, + "normalized_load_entropy": 0.8246955259507099, + "max_load_share": 0.08641975308641975 + }, + "full_input": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "bbe4afd9a915f1217560a65dea154de8bcdd236c0980dee49794ca8038faec84", + "route_weight_sha256": "4fe0135f314d312a549c19239d0b8b55fa55e6e958612d4b3a31a144b90b3196", + "loads": [ + 2, + 1, + 1, + 0, + 7, + 4, + 2, + 1, + 6, + 2, + 9, + 4, + 0, + 2, + 1, + 7, + 12, + 10, + 13, + 2, + 1, + 0, + 4, + 7, + 3, + 0, + 15, + 5, + 7, + 1, + 6, + 8, + 1, + 5, + 6, + 1, + 3, + 0, + 8, + 0, + 17, + 0, + 1, + 22, + 3, + 0, + 6, + 9, + 1, + 7, + 1, + 1, + 4, + 0, + 11, + 4, + 2, + 12, + 3, + 12, + 3, + 15, + 11, + 0 + ], + "weighted_loads": [ + 0.11142488569021225, + 0.05324302613735199, + 0.05882972851395607, + 0.0, + 0.33443582244217396, + 0.25095104798674583, + 0.08536623232066631, + 0.06058841571211815, + 0.36497311666607857, + 0.057942647486925125, + 0.48180212546139956, + 0.1023973859846592, + 0.0, + 0.10946433246135712, + 0.06607196480035782, + 0.2916100788861513, + 0.8184321783483028, + 1.0032271640375257, + 2.189948320388794, + 0.11769257858395576, + 0.03570833057165146, + 0.0, + 0.1763217058032751, + 0.31761958450078964, + 0.12365886941552162, + 0.0, + 0.8735060694161803, + 0.19121600035578012, + 0.5349372737109661, + 0.11129878461360931, + 0.2943855542689562, + 0.3506840243935585, + 0.03556125611066818, + 0.20298095792531967, + 0.25548581406474113, + 0.0788106918334961, + 0.12479198724031448, + 0.0, + 0.4988812282681465, + 0.0, + 0.9143801331520081, + 0.0, + 0.04813651368021965, + 2.3577334247529507, + 0.16296610981225967, + 0.0, + 0.33003222942352295, + 0.6598411053419113, + 0.06356674432754517, + 0.3161345571279526, + 0.03419927880167961, + 0.04821283742785454, + 0.31551502272486687, + 0.0, + 0.6069611115381122, + 0.17235662788152695, + 0.07115280628204346, + 1.0001172684133053, + 0.13703903928399086, + 0.823020800948143, + 0.1248189453035593, + 1.0941899046301842, + 0.6854954324662685, + 0.0 + ], + "unique_experts": 54, + "load_cv": 1.004591693546653, + "normalized_load_entropy": 0.8810920816291791, + "max_load_share": 0.07051282051282051 + } + }, + "s1_eos": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "a4b48958ee2c296830a9f9599aa2b3a09968dcd63daf3a9efc8f8aadbbef939f", + "route_weight_sha256": "763703d14bdfeeef22e272aea6d3e27143d96045e74c243e034e507c71d1b648", + "loads": [ + 2, + 1, + 0, + 0, + 3, + 4, + 3, + 1, + 2, + 0, + 6, + 0, + 0, + 2, + 1, + 1, + 6, + 8, + 1, + 2, + 1, + 0, + 3, + 1, + 3, + 0, + 14, + 4, + 0, + 1, + 0, + 0, + 1, + 3, + 2, + 0, + 3, + 0, + 8, + 0, + 10, + 0, + 1, + 0, + 0, + 0, + 5, + 1, + 1, + 5, + 1, + 1, + 4, + 0, + 3, + 1, + 3, + 11, + 0, + 11, + 4, + 11, + 2, + 0 + ], + "weighted_loads": [ + 0.11148315668106079, + 0.05181831493973732, + 0.0, + 0.0, + 0.14178848266601562, + 0.240953478962183, + 0.1240103505551815, + 0.06098039075732231, + 0.1333753988146782, + 0.0, + 0.3909214399755001, + 0.0, + 0.0, + 0.10889656469225883, + 0.07305959612131119, + 0.06277871876955032, + 0.2695029526948929, + 0.9594444818794727, + 0.11822769790887833, + 0.12184325233101845, + 0.03694991394877434, + 0.0, + 0.17091379687190056, + 0.03799440711736679, + 0.12290886417031288, + 0.0, + 0.8596680127084255, + 0.1814757026731968, + 0.0, + 0.10889212042093277, + 0.0, + 0.0, + 0.04075013846158981, + 0.12689148262143135, + 0.07918594777584076, + 0.0, + 0.12889694795012474, + 0.0, + 0.49518895521759987, + 0.0, + 0.5198708772659302, + 0.0, + 0.04999995976686478, + 0.0, + 0.0, + 0.0, + 0.28916242718696594, + 0.036455150693655014, + 0.06533282995223999, + 0.22831712290644646, + 0.035007406026124954, + 0.04666055366396904, + 0.31453778967261314, + 0.0, + 0.2019340544939041, + 0.03845273703336716, + 0.11334796994924545, + 0.9568298682570457, + 0.0, + 0.7762436382472515, + 0.164150919765234, + 0.9313007146120071, + 0.07456636428833008, + 0.0 + ], + "unique_experts": 44, + "load_cv": 1.281990431534001, + "normalized_load_entropy": 0.8272574858228015, + "max_load_share": 0.08641975308641975 + }, + "full_input": { + "tokens": 68, + "top_k": 6, + "decisions": 408, + "ordered_route_sha256": "c3b39a7e3a7283d644c83f16fb5e1cbb9ff8d71990c9b53b3c5ff24b566ead99", + "route_weight_sha256": "344c20b27adbc633ae587e3e24dfff1f9fb0eef8f0ef6fffe25103c7a7714d88", + "loads": [ + 4, + 2, + 1, + 0, + 13, + 8, + 3, + 3, + 12, + 0, + 10, + 3, + 0, + 2, + 1, + 3, + 24, + 10, + 12, + 3, + 2, + 1, + 6, + 5, + 3, + 0, + 17, + 6, + 11, + 1, + 9, + 6, + 2, + 3, + 6, + 3, + 3, + 0, + 8, + 1, + 16, + 0, + 1, + 27, + 2, + 0, + 6, + 15, + 1, + 8, + 1, + 1, + 4, + 5, + 26, + 10, + 9, + 13, + 2, + 16, + 5, + 19, + 13, + 1 + ], + "weighted_loads": [ + 0.2587464302778244, + 0.08401045575737953, + 0.04595424607396126, + 0.0, + 0.6900794133543968, + 0.37833940982818604, + 0.1240103505551815, + 0.189920075237751, + 0.7321132160723209, + 0.0, + 0.5054963226430118, + 0.053187393583357334, + 0.0, + 0.10889656469225883, + 0.07305959612131119, + 0.13455913588404655, + 1.8938618339598179, + 0.9884659582749009, + 2.1776196099817753, + 0.16039319336414337, + 0.11155453696846962, + 0.07169895619153976, + 0.28355245222337544, + 0.21466035023331642, + 0.12290886417031288, + 0.0, + 0.9377159664873034, + 0.232936249114573, + 0.8431596532464027, + 0.10889212042093277, + 0.4443422984331846, + 0.27036043256521225, + 0.07293045520782471, + 0.12689148262143135, + 0.28346236050128937, + 0.2979688495397568, + 0.12889694795012474, + 0.0, + 0.49518895521759987, + 0.04695942625403404, + 0.8738079182803631, + 0.0, + 0.04999995976686478, + 2.738629460334778, + 0.1303233467042446, + 0.0, + 0.3351948708295822, + 1.1157398708164692, + 0.06533282995223999, + 0.4481859914958477, + 0.035007406026124954, + 0.04666055366396904, + 0.31453778967261314, + 0.30457813665270805, + 1.5629925793036819, + 0.4502054639160633, + 0.5810530371963978, + 1.043875329196453, + 0.10241077840328217, + 0.9722387827932835, + 0.2022329829633236, + 1.2869865875691175, + 0.7198601551353931, + 0.040640514343976974 + ], + "unique_experts": 57, + "load_cv": 1.026185420245453, + "normalized_load_entropy": 0.8826053597301264, + "max_load_share": 0.0661764705882353 + } + }, + "s0_bos": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "28627905549a469e82aef4e0266ea8f1e27a54ac45965e2e06aae7f43a2c17d1", + "route_weight_sha256": "b6c0d807f757760f3221070f1b76bd1bd7741fefbfde48d9ce3a95bff1f7b690", + "loads": [ + 2, + 1, + 0, + 0, + 2, + 3, + 1, + 1, + 2, + 0, + 6, + 2, + 0, + 2, + 1, + 1, + 6, + 8, + 1, + 2, + 1, + 0, + 3, + 1, + 3, + 0, + 14, + 4, + 0, + 1, + 0, + 0, + 1, + 4, + 1, + 1, + 3, + 0, + 9, + 0, + 10, + 0, + 1, + 1, + 0, + 0, + 4, + 1, + 1, + 5, + 1, + 1, + 3, + 0, + 4, + 1, + 3, + 11, + 0, + 11, + 4, + 11, + 2, + 0 + ], + "weighted_loads": [ + 0.10788276046514511, + 0.049911096692085266, + 0.0, + 0.0, + 0.09532749652862549, + 0.21240068972110748, + 0.04807133227586746, + 0.06282707303762436, + 0.13431020826101303, + 0.0, + 0.39969829469919205, + 0.0805567167699337, + 0.0, + 0.10723977908492088, + 0.07482889294624329, + 0.06198429688811302, + 0.2811028007417917, + 0.9632234685122967, + 0.12791283428668976, + 0.11861757561564445, + 0.035313066095113754, + 0.0, + 0.17037319019436836, + 0.03536888211965561, + 0.1282372735440731, + 0.0, + 0.9093430452048779, + 0.18486373126506805, + 0.0, + 0.11890134960412979, + 0.0, + 0.0, + 0.044417236000299454, + 0.16802499815821648, + 0.04243437573313713, + 0.045509204268455505, + 0.12311236187815666, + 0.0, + 0.5429574064910412, + 0.0, + 0.5073672607541084, + 0.0, + 0.04878377169370651, + 0.03521643206477165, + 0.0, + 0.0, + 0.25910624116659164, + 0.036060966551303864, + 0.0712549090385437, + 0.21797799319028854, + 0.03435737267136574, + 0.04722027853131294, + 0.28555091470479965, + 0.0, + 0.22705961018800735, + 0.03930756077170372, + 0.1136813797056675, + 0.9913204424083233, + 0.0, + 0.8149884268641472, + 0.15269819274544716, + 0.9527238644659519, + 0.07610290125012398, + 0.0 + ], + "unique_experts": 47, + "load_cv": 1.2800867787989634, + "normalized_load_entropy": 0.8340374142855412, + "max_load_share": 0.08641975308641975 + }, + "full_input": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "0ef3980949c97dd0851e1f3d9b17779fc36362b1ed23c6ab4d999483c8a5bed6", + "route_weight_sha256": "9b137654261d423f25e7ded832de155c0c6af8681f00598a97bd3d066a4ada96", + "loads": [ + 2, + 1, + 1, + 0, + 6, + 3, + 1, + 1, + 6, + 3, + 8, + 4, + 0, + 2, + 1, + 9, + 11, + 9, + 12, + 2, + 1, + 0, + 3, + 7, + 3, + 0, + 14, + 6, + 6, + 1, + 6, + 9, + 2, + 4, + 5, + 3, + 3, + 0, + 9, + 0, + 18, + 0, + 1, + 23, + 3, + 0, + 4, + 9, + 1, + 7, + 1, + 1, + 3, + 0, + 10, + 4, + 3, + 12, + 3, + 12, + 5, + 17, + 11, + 0 + ], + "weighted_loads": [ + 0.10788276046514511, + 0.049911096692085266, + 0.05882972851395607, + 0.0, + 0.2927847523242235, + 0.21240068972110748, + 0.04807133227586746, + 0.06282707303762436, + 0.3872010223567486, + 0.09421369805932045, + 0.46679808013141155, + 0.1222958154976368, + 0.0, + 0.10723977908492088, + 0.07482889294624329, + 0.3665796611458063, + 0.8383917454630136, + 0.9780496265739202, + 1.3019350320100784, + 0.11861757561564445, + 0.035313066095113754, + 0.0, + 0.17037319019436836, + 0.31542670354247093, + 0.1282372735440731, + 0.0, + 0.9093430452048779, + 0.24302683491259813, + 0.4262888766825199, + 0.11890134960412979, + 0.2943855542689562, + 0.44899795204401016, + 0.07997849211096764, + 0.16802499815821648, + 0.21355076134204865, + 0.16225527971982956, + 0.12311236187815666, + 0.0, + 0.5429574064910412, + 0.0, + 0.9898278973996639, + 0.0, + 0.04878377169370651, + 2.387475974857807, + 0.16296610981225967, + 0.0, + 0.25910624116659164, + 0.620465911924839, + 0.0712549090385437, + 0.3132430240511894, + 0.03435737267136574, + 0.04722027853131294, + 0.28555091470479965, + 0.0, + 0.5643120659515262, + 0.20114611461758614, + 0.1136813797056675, + 1.0564077459275723, + 0.13703903928399086, + 0.8543500229716301, + 0.19962864741683006, + 1.2296793721616268, + 0.6837798021733761, + 0.0 + ], + "unique_experts": 54, + "load_cv": 1.015656529248121, + "normalized_load_entropy": 0.8816789682206075, + "max_load_share": 0.07371794871794872 + } + }, + "s1_bos": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "64f5a754ee43b818628f965131689128ababc0ea37b3db1e09f70599b1ed4acd", + "route_weight_sha256": "4dd5cfebb6dd2dbf0ca3f4fc11c36e1caf2c168cf0497798e1a28ce134ae13ad", + "loads": [ + 2, + 1, + 0, + 0, + 2, + 4, + 3, + 1, + 2, + 0, + 5, + 1, + 0, + 2, + 1, + 1, + 6, + 8, + 1, + 2, + 1, + 0, + 3, + 1, + 3, + 0, + 14, + 4, + 0, + 1, + 0, + 0, + 0, + 4, + 2, + 1, + 3, + 0, + 9, + 0, + 10, + 0, + 1, + 0, + 0, + 0, + 4, + 1, + 1, + 5, + 1, + 1, + 4, + 0, + 3, + 1, + 3, + 11, + 0, + 12, + 3, + 11, + 2, + 0 + ], + "weighted_loads": [ + 0.10887694731354713, + 0.04751325771212578, + 0.0, + 0.0, + 0.09844069182872772, + 0.24310136958956718, + 0.1354922205209732, + 0.06437952071428299, + 0.1351650506258011, + 0.0, + 0.36000293120741844, + 0.04701503738760948, + 0.0, + 0.10622582957148552, + 0.07123412191867828, + 0.061475880444049835, + 0.28118149749934673, + 0.9716447666287422, + 0.12910284101963043, + 0.12364986911416054, + 0.03631957992911339, + 0.0, + 0.17403771355748177, + 0.036062564700841904, + 0.1330392062664032, + 0.0, + 0.8620774410665035, + 0.1801602467894554, + 0.0, + 0.12086749076843262, + 0.0, + 0.0, + 0.0, + 0.16219374909996986, + 0.06577016413211823, + 0.04186080023646355, + 0.12639110907912254, + 0.0, + 0.5241923071444035, + 0.0, + 0.5024603568017483, + 0.0, + 0.049282368272542953, + 0.0, + 0.0, + 0.0, + 0.2512991204857826, + 0.03544200584292412, + 0.06759417802095413, + 0.22210804000496864, + 0.03470882773399353, + 0.04881018400192261, + 0.3187324069440365, + 0.0, + 0.1982446424663067, + 0.03659496083855629, + 0.11999281495809555, + 0.9663665778934956, + 0.0, + 0.8225060477852821, + 0.12178592570126057, + 0.9620628692209721, + 0.07673563435673714, + 0.0 + ], + "unique_experts": 45, + "load_cv": 1.2971190804453374, + "normalized_load_entropy": 0.8280491887959147, + "max_load_share": 0.08641975308641975 + }, + "full_input": { + "tokens": 68, + "top_k": 6, + "decisions": 408, + "ordered_route_sha256": "b0ecd2b59da0d418657d884b383882c6fa761af5ecd55431384c5c26f442514d", + "route_weight_sha256": "bc74299aed195de2f9e207b1a6fc50c07450e5f7e1469c8ece676688598485f6", + "loads": [ + 4, + 2, + 1, + 0, + 12, + 8, + 3, + 3, + 12, + 1, + 8, + 3, + 0, + 2, + 1, + 5, + 23, + 9, + 11, + 3, + 2, + 1, + 5, + 5, + 3, + 0, + 16, + 6, + 9, + 1, + 9, + 6, + 1, + 4, + 6, + 6, + 3, + 0, + 9, + 1, + 17, + 0, + 1, + 28, + 2, + 0, + 5, + 16, + 1, + 8, + 1, + 1, + 4, + 5, + 25, + 9, + 9, + 13, + 2, + 17, + 4, + 21, + 14, + 1 + ], + "weighted_loads": [ + 0.25614022091031075, + 0.07970539852976799, + 0.04595424607396126, + 0.0, + 0.6467316225171089, + 0.3804873004555702, + 0.1354922205209732, + 0.19331920519471169, + 0.7460903376340866, + 0.033297475427389145, + 0.4694333169609308, + 0.08879835717380047, + 0.0, + 0.10622582957148552, + 0.07123412191867828, + 0.20551703870296478, + 1.9511998910456896, + 0.9864709246903658, + 1.290460478514433, + 0.16219981014728546, + 0.11092420294880867, + 0.07169895619153976, + 0.2829026095569134, + 0.21272850781679153, + 0.1330392062664032, + 0.0, + 0.9369561113417149, + 0.23162079323083162, + 0.6847480349242687, + 0.12086749076843262, + 0.4443422984331846, + 0.27036043256521225, + 0.032180316746234894, + 0.16219374909996986, + 0.25990859419107437, + 0.4326115660369396, + 0.12639110907912254, + 0.0, + 0.5241923071444035, + 0.04695942625403404, + 0.9326402731239796, + 0.0, + 0.049282368272542953, + 2.9824985153973103, + 0.1303233467042446, + 0.0, + 0.2973315641283989, + 1.1319678574800491, + 0.06759417802095413, + 0.4419769085943699, + 0.03470882773399353, + 0.04881018400192261, + 0.3187324069440365, + 0.30457813665270805, + 1.5296284956857562, + 0.43260902538895607, + 0.5876978822052479, + 1.0717419981956482, + 0.10241077840328217, + 1.010043516755104, + 0.15986798889935017, + 1.4072083625942469, + 0.7391394525766373, + 0.040640514343976974 + ], + "unique_experts": 58, + "load_cv": 1.026185420245453, + "normalized_load_entropy": 0.8844357675428498, + "max_load_share": 0.06862745098039216 + } + }, + "s0_x": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "fd59fa29bfe93a585096ce10b0e09af1bf5b0067aa7666f85c8b449854e35c91", + "route_weight_sha256": "a4596c849e4e87eb5b6657563914e02dd03e827e8aef830655a29122b9b1f195", + "loads": [ + 3, + 1, + 0, + 0, + 3, + 3, + 2, + 1, + 2, + 0, + 6, + 2, + 0, + 2, + 1, + 1, + 5, + 8, + 2, + 2, + 1, + 0, + 3, + 1, + 3, + 0, + 14, + 4, + 0, + 1, + 0, + 0, + 1, + 4, + 1, + 1, + 3, + 0, + 9, + 0, + 10, + 0, + 2, + 0, + 0, + 0, + 4, + 1, + 1, + 4, + 1, + 1, + 4, + 0, + 3, + 1, + 3, + 11, + 0, + 11, + 2, + 11, + 2, + 0 + ], + "weighted_loads": [ + 0.1475398913025856, + 0.05781383439898491, + 0.0, + 0.0, + 0.14281167462468147, + 0.22790230438113213, + 0.07797167636454105, + 0.06418081372976303, + 0.1407320722937584, + 0.0, + 0.4087756983935833, + 0.08103404566645622, + 0.0, + 0.10444701462984085, + 0.06948710232973099, + 0.06440326571464539, + 0.21875576861202717, + 1.0048634707927704, + 0.16582444682717323, + 0.12123071774840355, + 0.0371844545006752, + 0.0, + 0.18251682817935944, + 0.03667802736163139, + 0.13671749085187912, + 0.0, + 0.863207183778286, + 0.18708990514278412, + 0.0, + 0.11606942117214203, + 0.0, + 0.0, + 0.042764294892549515, + 0.1665048450231552, + 0.048989031463861465, + 0.04452011361718178, + 0.1224137395620346, + 0.0, + 0.5261199213564396, + 0.0, + 0.507909007370472, + 0.0, + 0.08079762384295464, + 0.0, + 0.0, + 0.0, + 0.25656072422862053, + 0.04137410968542099, + 0.07100500166416168, + 0.16170284897089005, + 0.04231741651892662, + 0.04912618547677994, + 0.30135923251509666, + 0.0, + 0.19078302383422852, + 0.03749343007802963, + 0.12235183268785477, + 0.9839455895125866, + 0.0, + 0.8009509593248367, + 0.09295640513300896, + 0.9491799548268318, + 0.07259759306907654, + 0.0 + ], + "unique_experts": 46, + "load_cv": 1.2666811059750243, + "normalized_load_entropy": 0.8360950274542654, + "max_load_share": 0.08641975308641975 + }, + "full_input": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "5adda1c9fa34085efce4b99c88acb12b3ec259a76f2883dca7016ad7d8e4b905", + "route_weight_sha256": "d4013a17cc1ea559f43e4e194e6aab398837b4f17e2c45f3fa31bd7ea4faeffe", + "loads": [ + 3, + 1, + 1, + 0, + 7, + 3, + 2, + 1, + 6, + 2, + 8, + 4, + 0, + 2, + 1, + 7, + 9, + 10, + 14, + 2, + 1, + 0, + 3, + 7, + 3, + 0, + 14, + 5, + 7, + 1, + 6, + 10, + 2, + 4, + 6, + 3, + 3, + 0, + 9, + 0, + 16, + 0, + 2, + 21, + 3, + 0, + 4, + 9, + 1, + 8, + 1, + 1, + 4, + 1, + 8, + 6, + 3, + 12, + 4, + 12, + 2, + 16, + 11, + 0 + ], + "weighted_loads": [ + 0.1475398913025856, + 0.05781383439898491, + 0.05882972851395607, + 0.0, + 0.3402689304202795, + 0.22790230438113213, + 0.07797167636454105, + 0.06418081372976303, + 0.39527327939867973, + 0.057942647486925125, + 0.4758754838258028, + 0.12277314439415932, + 0.0, + 0.10444701462984085, + 0.06948710232973099, + 0.2948323246091604, + 0.6908449027687311, + 1.054908799007535, + 1.429866548627615, + 0.12123071774840355, + 0.0371844545006752, + 0.0, + 0.18251682817935944, + 0.3167358487844467, + 0.13671749085187912, + 0.0, + 0.863207183778286, + 0.1996839279308915, + 0.5089021772146225, + 0.11606942117214203, + 0.2943855542689562, + 0.5099141374230385, + 0.0783255510032177, + 0.1665048450231552, + 0.31923920661211014, + 0.17806263640522957, + 0.1224137395620346, + 0.0, + 0.5261199213564396, + 0.0, + 0.8377499878406525, + 0.0, + 0.08079762384295464, + 2.097822282463312, + 0.16296610981225967, + 0.0, + 0.25656072422862053, + 0.6540567390620708, + 0.07100500166416168, + 0.3466563709080219, + 0.04231741651892662, + 0.04912618547677994, + 0.30135923251509666, + 0.05473548546433449, + 0.4760553715750575, + 0.26181338354945183, + 0.12235183268785477, + 1.0542165450751781, + 0.1976616196334362, + 0.839052427560091, + 0.09295640513300896, + 1.1787920966744423, + 0.6174213215708733, + 0.0 + ], + "unique_experts": 55, + "load_cv": 0.9672480058389752, + "normalized_load_entropy": 0.8898438704612082, + "max_load_share": 0.0673076923076923 + } + }, + "s1_x": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "f8ea6e7360b3b367c02087e73b0b6d44cbd3a24d5784cffe19ff1eb78562465e", + "route_weight_sha256": "efa8a3e3e6a2145dce8390310eeac084c28d53da8b2cd93fab4b7777d53ed050", + "loads": [ + 3, + 1, + 0, + 0, + 3, + 3, + 3, + 1, + 2, + 0, + 5, + 2, + 0, + 2, + 2, + 1, + 4, + 8, + 1, + 2, + 1, + 0, + 3, + 1, + 2, + 0, + 15, + 4, + 0, + 1, + 1, + 0, + 1, + 4, + 2, + 1, + 1, + 1, + 10, + 0, + 9, + 0, + 2, + 0, + 0, + 0, + 5, + 1, + 1, + 4, + 1, + 1, + 4, + 0, + 3, + 2, + 3, + 11, + 0, + 10, + 3, + 10, + 1, + 0 + ], + "weighted_loads": [ + 0.14361179992556572, + 0.04989030957221985, + 0.0, + 0.0, + 0.17274055257439613, + 0.2252170741558075, + 0.1398858018219471, + 0.06231675669550896, + 0.14048442989587784, + 0.0, + 0.358853816986084, + 0.08021009340882301, + 0.0, + 0.10497456416487694, + 0.1006044540554285, + 0.06576628237962723, + 0.17090049758553505, + 0.8868779502809048, + 0.1240580677986145, + 0.12292968481779099, + 0.03560086712241173, + 0.0, + 0.17788302525877953, + 0.0370572954416275, + 0.08943760022521019, + 0.0, + 0.9016078673303127, + 0.18571719527244568, + 0.0, + 0.10348033905029297, + 0.040481749922037125, + 0.0, + 0.04587363451719284, + 0.1638375036418438, + 0.081868726760149, + 0.04165523499250412, + 0.0433063842356205, + 0.037356898188591, + 0.5623751170933247, + 0.0, + 0.44381093978881836, + 0.0, + 0.08193008974194527, + 0.0, + 0.0, + 0.0, + 0.27992694452404976, + 0.03767988830804825, + 0.07065442949533463, + 0.1436815783381462, + 0.042787425220012665, + 0.0518387146294117, + 0.30661556497216225, + 0.0, + 0.20233546197414398, + 0.0758899562060833, + 0.12877152487635612, + 1.0016947761178017, + 0.0, + 0.7509373798966408, + 0.12403224781155586, + 0.894812747836113, + 0.03614812344312668, + 0.0 + ], + "unique_experts": 48, + "load_cv": 1.2453235186316058, + "normalized_load_entropy": 0.8446018980477245, + "max_load_share": 0.09259259259259259 + }, + "full_input": { + "tokens": 68, + "top_k": 6, + "decisions": 408, + "ordered_route_sha256": "ceef66880833f11f84669b22317ac1dce4b66f44beb4cf3a467d3e2b9e106464", + "route_weight_sha256": "d2f50b88ca4793e032fb60d87a5ec151053105462e1ad4eac8dd5e2661caf4bb", + "loads": [ + 5, + 2, + 1, + 0, + 13, + 7, + 3, + 3, + 12, + 0, + 8, + 4, + 0, + 2, + 2, + 3, + 21, + 9, + 12, + 3, + 2, + 1, + 5, + 5, + 2, + 0, + 17, + 7, + 11, + 1, + 10, + 7, + 2, + 4, + 7, + 5, + 1, + 1, + 10, + 1, + 14, + 0, + 2, + 26, + 2, + 0, + 6, + 14, + 1, + 9, + 1, + 1, + 4, + 6, + 26, + 12, + 9, + 13, + 3, + 15, + 4, + 18, + 12, + 1 + ], + "weighted_loads": [ + 0.29087507352232933, + 0.08208245038986206, + 0.04595424607396126, + 0.0, + 0.7210314832627773, + 0.36260300502181053, + 0.1398858018219471, + 0.19125644117593765, + 0.7586158290505409, + 0.0, + 0.46828420273959637, + 0.121993413195014, + 0.0, + 0.10497456416487694, + 0.1006044540554285, + 0.13754669949412346, + 1.7689811363816261, + 0.9017041083425283, + 1.3620761148631573, + 0.1614796258509159, + 0.11020549014210701, + 0.07169895619153976, + 0.28674792125821114, + 0.21372323855757713, + 0.08943760022521019, + 0.0, + 0.9764865376055241, + 0.2840003902092576, + 0.8264134228229523, + 0.10348033905029297, + 0.48482404835522175, + 0.31866447627544403, + 0.07805395126342773, + 0.1638375036418438, + 0.3467388488352299, + 0.3854615353047848, + 0.0433063842356205, + 0.037356898188591, + 0.5623751170933247, + 0.04695942625403404, + 0.7034123502671719, + 0.0, + 0.08193008974194527, + 2.430831555277109, + 0.1303233467042446, + 0.0, + 0.32595938816666603, + 1.0391861274838448, + 0.07065442949533463, + 0.44890784472227097, + 0.042787425220012665, + 0.0518387146294117, + 0.30661556497216225, + 0.35578909143805504, + 1.562702358700335, + 0.5419628694653511, + 0.5964765921235085, + 1.1115682236850262, + 0.14883200824260712, + 0.9376128315925598, + 0.16211431100964546, + 1.24917115829885, + 0.6512775421142578, + 0.040640514343976974 + ], + "unique_experts": 58, + "load_cv": 0.9770531375138034, + "normalized_load_entropy": 0.8912274462993898, + "max_load_share": 0.06372549019607843 + } + }, + "s0_period": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "49adbebb56ccd1103cf6d9bf8ba9fffb6129eebac9b1a7255a9f29cf74fa5d06", + "route_weight_sha256": "f400b17bf999036e781e4e5cfef6fff72f88695d95e0478b2d14e66d84c7a187", + "loads": [ + 3, + 1, + 0, + 0, + 3, + 3, + 1, + 1, + 2, + 0, + 6, + 2, + 0, + 2, + 2, + 1, + 6, + 8, + 2, + 2, + 1, + 0, + 4, + 1, + 3, + 0, + 14, + 3, + 0, + 1, + 0, + 0, + 1, + 4, + 2, + 1, + 1, + 0, + 9, + 0, + 9, + 0, + 2, + 0, + 0, + 0, + 4, + 1, + 1, + 4, + 1, + 1, + 4, + 0, + 3, + 2, + 4, + 11, + 0, + 11, + 2, + 11, + 1, + 0 + ], + "weighted_loads": [ + 0.1442791037261486, + 0.05724542587995529, + 0.0, + 0.0, + 0.14220557361841202, + 0.22383732721209526, + 0.0485633909702301, + 0.06539273262023926, + 0.1384533792734146, + 0.0, + 0.4246128425002098, + 0.07971521094441414, + 0.0, + 0.10321805998682976, + 0.09832624159753323, + 0.06408774107694626, + 0.2584678716957569, + 1.003394104540348, + 0.1669635809957981, + 0.11434024572372437, + 0.035820942372083664, + 0.0, + 0.2052057906985283, + 0.03644587844610214, + 0.13448427245020866, + 0.0, + 0.9179224595427513, + 0.1488312929868698, + 0.0, + 0.11199070513248444, + 0.0, + 0.0, + 0.04217259958386421, + 0.1681133285164833, + 0.08338186517357826, + 0.04539131745696068, + 0.04064476117491722, + 0.0, + 0.539924044162035, + 0.0, + 0.46570035442709923, + 0.0, + 0.08328519389033318, + 0.0, + 0.0, + 0.0, + 0.2373897023499012, + 0.039712827652692795, + 0.06885386258363724, + 0.16861111670732498, + 0.04446515813469887, + 0.04952570050954819, + 0.30372998863458633, + 0.0, + 0.19017191231250763, + 0.0759437344968319, + 0.156565360724926, + 0.9913246668875217, + 0.0, + 0.8149620220065117, + 0.09129158034920692, + 0.9455190598964691, + 0.03733726218342781, + 0.0 + ], + "unique_experts": 46, + "load_cv": 1.260892187448089, + "normalized_load_entropy": 0.8364032542138639, + "max_load_share": 0.08641975308641975 + }, + "full_input": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "d5825f853c53349dd7e1095edcb5fe9e6208ea6c8eb4ecf7b52697fce5717fd1", + "route_weight_sha256": "e962c823e716a5a65e7607190adbd8b95c02194482942b65be0158867feb19ec", + "loads": [ + 3, + 1, + 1, + 0, + 9, + 3, + 1, + 1, + 6, + 2, + 8, + 4, + 0, + 2, + 2, + 8, + 11, + 9, + 14, + 2, + 1, + 0, + 4, + 7, + 3, + 0, + 14, + 4, + 8, + 1, + 6, + 10, + 2, + 4, + 6, + 4, + 1, + 0, + 9, + 0, + 15, + 0, + 2, + 23, + 3, + 0, + 4, + 9, + 1, + 7, + 1, + 1, + 4, + 0, + 7, + 7, + 4, + 12, + 3, + 12, + 2, + 16, + 8, + 0 + ], + "weighted_loads": [ + 0.1442791037261486, + 0.05724542587995529, + 0.05882972851395607, + 0.0, + 0.4536615777760744, + 0.22383732721209526, + 0.0485633909702301, + 0.06539273262023926, + 0.39228151738643646, + 0.057942647486925125, + 0.4917126279324293, + 0.12145430967211723, + 0.0, + 0.10321805998682976, + 0.09832624159753323, + 0.3360618781298399, + 0.7776482552289963, + 1.0182202626019716, + 1.3827195093035698, + 0.11434024572372437, + 0.035820942372083664, + 0.0, + 0.2052057906985283, + 0.31650369986891747, + 0.13448427245020866, + 0.0, + 0.9179224595427513, + 0.1614253157749772, + 0.55020397529006, + 0.11199070513248444, + 0.2943855542689562, + 0.5116575472056866, + 0.0777338556945324, + 0.1681133285164833, + 0.2783156782388687, + 0.32896191254258156, + 0.04064476117491722, + 0.0, + 0.539924044162035, + 0.0, + 0.8041050955653191, + 0.0, + 0.08328519389033318, + 2.2155788354575634, + 0.16296610981225967, + 0.0, + 0.2373897023499012, + 0.6398000195622444, + 0.06885386258363724, + 0.31497980281710625, + 0.04446515813469887, + 0.04952570050954819, + 0.30372998863458633, + 0.0, + 0.42912042420357466, + 0.3021232895553112, + 0.156565360724926, + 1.059554260224104, + 0.13703903928399086, + 0.8519152142107487, + 0.09129158034920692, + 1.1705162562429905, + 0.5169582925736904, + 0.0 + ], + "unique_experts": 54, + "load_cv": 0.9880948137434714, + "normalized_load_entropy": 0.8853927037283353, + "max_load_share": 0.07371794871794872 + } + }, + "s1_period": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "2a67534ade0f8fa94ea7f3ee3428fe9765097e54b462d0aedbfe6ddd83e9ed86", + "route_weight_sha256": "5f127a1a8aa50cdcd35e9800402bc95952995bee4aa47fca6f82a3883b83ff16", + "loads": [ + 3, + 1, + 0, + 0, + 3, + 3, + 4, + 1, + 2, + 0, + 5, + 2, + 0, + 2, + 2, + 1, + 4, + 8, + 1, + 2, + 1, + 0, + 3, + 1, + 3, + 0, + 14, + 4, + 0, + 1, + 1, + 0, + 1, + 4, + 2, + 1, + 1, + 1, + 11, + 0, + 9, + 0, + 2, + 0, + 0, + 0, + 4, + 1, + 1, + 4, + 1, + 1, + 4, + 0, + 3, + 2, + 3, + 11, + 0, + 10, + 3, + 10, + 0, + 0 + ], + "weighted_loads": [ + 0.14476114138960838, + 0.04944975674152374, + 0.0, + 0.0, + 0.18526609241962433, + 0.2245316542685032, + 0.17335529997944832, + 0.06276243180036545, + 0.14067892730236053, + 0.0, + 0.3850964792072773, + 0.08354568853974342, + 0.0, + 0.10636192560195923, + 0.10227305814623833, + 0.06460115313529968, + 0.1724088415503502, + 0.8872807584702969, + 0.13121584057807922, + 0.11682853102684021, + 0.036534182727336884, + 0.0, + 0.1769544668495655, + 0.037358228117227554, + 0.1282285898923874, + 0.0, + 0.909238837659359, + 0.18534305691719055, + 0.0, + 0.09994331002235413, + 0.040318384766578674, + 0.0, + 0.04533817246556282, + 0.16717852279543877, + 0.07720590382814407, + 0.044892244040966034, + 0.043891869485378265, + 0.0397212840616703, + 0.6182876713573933, + 0.0, + 0.433709803968668, + 0.0, + 0.08440981060266495, + 0.0, + 0.0, + 0.0, + 0.2462918497622013, + 0.03723686933517456, + 0.07140737026929855, + 0.14673853293061256, + 0.041579075157642365, + 0.050950635224580765, + 0.31063374876976013, + 0.0, + 0.20234012231230736, + 0.07699122279882431, + 0.12861594930291176, + 1.0279616452753544, + 0.0, + 0.737676165997982, + 0.12352850660681725, + 0.8821376822888851, + 0.0, + 0.0 + ], + "unique_experts": 47, + "load_cv": 1.2394348511279323, + "normalized_load_entropy": 0.8426220252530964, + "max_load_share": 0.08641975308641975 + }, + "full_input": { + "tokens": 68, + "top_k": 6, + "decisions": 408, + "ordered_route_sha256": "fe0216a9ced56da7631fb5ec86c3f0128eb429ddda543798dca7c65332bdc94d", + "route_weight_sha256": "e94f73a28fb717be96515c985574864c0c1420a810477168f59ffb59a11a4dba", + "loads": [ + 5, + 2, + 1, + 0, + 14, + 8, + 4, + 3, + 12, + 0, + 8, + 4, + 0, + 2, + 3, + 4, + 21, + 9, + 11, + 3, + 2, + 1, + 5, + 5, + 3, + 0, + 16, + 6, + 12, + 1, + 10, + 7, + 2, + 4, + 7, + 5, + 1, + 1, + 11, + 1, + 15, + 0, + 2, + 26, + 2, + 0, + 5, + 15, + 1, + 8, + 1, + 1, + 4, + 5, + 25, + 12, + 9, + 13, + 2, + 15, + 4, + 18, + 10, + 1 + ], + "weighted_loads": [ + 0.292024414986372, + 0.08164189755916595, + 0.04595424607396126, + 0.0, + 0.7998873889446259, + 0.4036744609475136, + 0.17335529997944832, + 0.19170211628079414, + 0.7456992119550705, + 0.0, + 0.4945268649607897, + 0.1253290083259344, + 0.0, + 0.10636192560195923, + 0.14305061474442482, + 0.16928188502788544, + 1.8039308972656727, + 0.9021069165319204, + 1.2925734780728817, + 0.15537847205996513, + 0.11113880574703217, + 0.07169895619153976, + 0.2858193628489971, + 0.21402417123317719, + 0.1282285898923874, + 0.0, + 0.9841175079345703, + 0.23680360335856676, + 0.9013356044888496, + 0.09994331002235413, + 0.4846606831997633, + 0.3088280260562897, + 0.07751848921179771, + 0.16717852279543877, + 0.3239005170762539, + 0.43799637258052826, + 0.043891869485378265, + 0.0397212840616703, + 0.6182876713573933, + 0.04695942625403404, + 0.7239969111979008, + 0.0, + 0.08440981060266495, + 2.4676584489643574, + 0.1303233467042446, + 0.0, + 0.2923242934048176, + 1.072326522320509, + 0.07140737026929855, + 0.4068825952708721, + 0.041579075157642365, + 0.050950635224580765, + 0.31063374876976013, + 0.30457813665270805, + 1.519940490834415, + 0.545732643455267, + 0.5963210165500641, + 1.1307945847511292, + 0.10241077840328217, + 0.9249981120228767, + 0.16161056980490685, + 1.2417805660516024, + 0.5518826022744179, + 0.040640514343976974 + ], + "unique_experts": 58, + "load_cv": 0.9691512436280312, + "normalized_load_entropy": 0.8927173732961173, + "max_load_share": 0.06372549019607843 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 27, + "ordered_topk_exact_tokens": 17, + "set_exact_tokens": 22, + "mean_set_jaccard": 0.9470899470899473, + "mean_token_weighted_tv": 0.013153165785802735, + "aggregate_load_tv": 0.030864197530864196 + }, + "system_bos": { + "tokens": 27, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.9153439153439153, + "mean_token_weighted_tv": 0.01902669319814002, + "aggregate_load_tv": 0.037037037037037035 + }, + "system_x": { + "tokens": 27, + "ordered_topk_exact_tokens": 16, + "set_exact_tokens": 18, + "mean_set_jaccard": 0.8698412698412699, + "mean_token_weighted_tv": 0.032398218737432254, + "aggregate_load_tv": 0.06172839506172839 + }, + "system_period": { + "tokens": 27, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.8645502645502645, + "mean_token_weighted_tv": 0.03216358498428707, + "aggregate_load_tv": 0.05555555555555555 + }, + "bos_at_s0": { + "tokens": 27, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.8941798941798942, + "mean_token_weighted_tv": 0.02317750995495805, + "aggregate_load_tv": 0.043209876543209874 + }, + "bos_at_s1": { + "tokens": 27, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.8941798941798943, + "mean_token_weighted_tv": 0.02376874819121979, + "aggregate_load_tv": 0.030864197530864196 + }, + "x_at_s0": { + "tokens": 27, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8624338624338626, + "mean_token_weighted_tv": 0.028608546419828025, + "aggregate_load_tv": 0.05555555555555555 + }, + "x_at_s1": { + "tokens": 27, + "ordered_topk_exact_tokens": 7, + "set_exact_tokens": 13, + "mean_set_jaccard": 0.816931216931217, + "mean_token_weighted_tv": 0.04325163830071688, + "aggregate_load_tv": 0.08024691358024691 + }, + "period_at_s0": { + "tokens": 27, + "ordered_topk_exact_tokens": 7, + "set_exact_tokens": 12, + "mean_set_jaccard": 0.8253968253968254, + "mean_token_weighted_tv": 0.03428964237510054, + "aggregate_load_tv": 0.08024691358024691 + }, + "period_at_s1": { + "tokens": 27, + "ordered_topk_exact_tokens": 6, + "set_exact_tokens": 11, + "mean_set_jaccard": 0.7957671957671958, + "mean_token_weighted_tv": 0.04730590163833565, + "aggregate_load_tv": 0.08641975308641975 + } + } + }, + "layer_12": { + "layer": 12, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "17624facd8c0f24df8a7de6cdf4eb98c5a747f790d5e41a5ca8681e38e130ad9", + "route_weight_sha256": "f44d87fdf4213ef72321562c45724bfa001ff278e5ae733bca591d273c0166d4", + "loads": [ + 0, + 1, + 1, + 2, + 10, + 5, + 0, + 2, + 6, + 1, + 3, + 1, + 6, + 4, + 0, + 0, + 3, + 5, + 1, + 8, + 1, + 5, + 5, + 8, + 6, + 6, + 1, + 0, + 1, + 0, + 0, + 8, + 0, + 4, + 0, + 0, + 2, + 2, + 1, + 0, + 0, + 2, + 0, + 0, + 2, + 0, + 0, + 0, + 2, + 5, + 0, + 1, + 4, + 1, + 0, + 3, + 5, + 8, + 0, + 9, + 1, + 5, + 3, + 2 + ], + "weighted_loads": [ + 0.0, + 0.05161679536104202, + 0.04790699481964111, + 0.3531056083738804, + 0.5409071799367666, + 0.309660118073225, + 0.0, + 0.12692617252469063, + 0.4864747151732445, + 0.03603131324052811, + 0.1696653962135315, + 0.0564546100795269, + 0.4961912930011749, + 0.23828181251883507, + 0.0, + 0.0, + 0.1070990301668644, + 0.3931375928223133, + 0.03575989603996277, + 0.37503333389759064, + 0.05791100114583969, + 0.24528869055211544, + 0.48726237565279007, + 0.4739735461771488, + 0.2634053975343704, + 0.3582505378872156, + 0.03594755381345749, + 0.0, + 0.037696462124586105, + 0.0, + 0.0, + 0.7081923633813858, + 0.0, + 0.2051406390964985, + 0.0, + 0.0, + 0.08839412406086922, + 0.3063116893172264, + 0.038286831229925156, + 0.0, + 0.0, + 0.10694657266139984, + 0.0, + 0.0, + 0.1616397425532341, + 0.0, + 0.0, + 0.0, + 0.13319599255919456, + 0.2511124685406685, + 0.0, + 0.05096694454550743, + 0.22873414307832718, + 0.046502672135829926, + 0.0, + 0.17113520205020905, + 0.6907873004674911, + 0.6501815430819988, + 0.0, + 0.9264347851276398, + 0.05131211876869202, + 0.23087961599230766, + 0.10622109845280647, + 0.18255433812737465 + ], + "unique_experts": 44, + "load_cv": 1.0750669456652184, + "normalized_load_entropy": 0.8528610711506538, + "max_load_share": 0.06172839506172839 + }, + "full_input": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "a1b292939077c8bc2658c2b9832357fa877c813838a6fd0c3b0048292d362d5e", + "route_weight_sha256": "11455df9ffa3888044ba2effc342cc67bf98636db3a261cb9465b1daa11573c2", + "loads": [ + 0, + 1, + 1, + 7, + 14, + 6, + 0, + 4, + 12, + 1, + 3, + 1, + 11, + 4, + 0, + 0, + 5, + 5, + 1, + 8, + 2, + 5, + 6, + 13, + 6, + 6, + 2, + 8, + 16, + 11, + 3, + 13, + 1, + 6, + 0, + 7, + 2, + 6, + 16, + 0, + 0, + 8, + 6, + 2, + 4, + 1, + 2, + 5, + 5, + 5, + 1, + 1, + 4, + 1, + 0, + 3, + 8, + 8, + 0, + 12, + 1, + 9, + 7, + 6 + ], + "weighted_loads": [ + 0.0, + 0.05161679536104202, + 0.04790699481964111, + 0.4788414614740759, + 2.163635542616248, + 0.3136904747225344, + 0.0, + 0.24933071061968803, + 0.8535833731293678, + 0.03603131324052811, + 0.1696653962135315, + 0.0564546100795269, + 0.7554501816630363, + 0.23828181251883507, + 0.0, + 0.0, + 0.22624750435352325, + 0.3931375928223133, + 0.03575989603996277, + 0.37503333389759064, + 0.06022153771482408, + 0.24528869055211544, + 0.5373677536845207, + 0.9307595863938332, + 0.2634053975343704, + 0.3582505378872156, + 0.06866160780191422, + 0.42808197624981403, + 1.9467608444392681, + 1.6017433591187, + 0.10445683728903532, + 1.0437374226748943, + 0.046244069933891296, + 0.3094373196363449, + 0.0, + 0.4975783936679363, + 0.08839412406086922, + 0.4199357386678457, + 1.5154293328523636, + 0.0, + 0.0, + 0.6544633619487286, + 0.38015206530690193, + 0.12322886288166046, + 0.2563302777707577, + 0.039670225232839584, + 0.14558827131986618, + 0.2958142515271902, + 0.3293128274381161, + 0.2511124685406685, + 0.012932265177369118, + 0.05096694454550743, + 0.22873414307832718, + 0.046502672135829926, + 0.0, + 0.17113520205020905, + 0.7973244399763644, + 0.6501815430819988, + 0.0, + 1.0197789557278156, + 0.05131211876869202, + 0.3872105050832033, + 0.27297443337738514, + 0.3118729591369629 + ], + "unique_experts": 55, + "load_cv": 0.8744304053835864, + "normalized_load_entropy": 0.901655988949413, + "max_load_share": 0.05128205128205128 + } + }, + "s1_eos": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "08e091e86e7a413f4c2ee0db9cd241c1802a6e8d632c93f5a193b879e869fa7f", + "route_weight_sha256": "d35b6c5d2c188187f13bae89f7a2504e36635ff306e374d2230ed7de116d9a41", + "loads": [ + 0, + 1, + 1, + 1, + 9, + 6, + 0, + 2, + 6, + 1, + 3, + 0, + 6, + 4, + 0, + 0, + 3, + 5, + 1, + 8, + 1, + 5, + 5, + 9, + 4, + 6, + 1, + 0, + 1, + 0, + 0, + 8, + 0, + 4, + 0, + 0, + 2, + 2, + 1, + 1, + 0, + 3, + 0, + 0, + 2, + 0, + 0, + 0, + 2, + 5, + 0, + 1, + 4, + 1, + 0, + 3, + 5, + 9, + 0, + 8, + 1, + 5, + 4, + 2 + ], + "weighted_loads": [ + 0.0, + 0.05394507199525833, + 0.04432071000337601, + 0.30707353353500366, + 0.5192758701741695, + 0.34310922399163246, + 0.0, + 0.12723306566476822, + 0.48017648607492447, + 0.03863762691617012, + 0.17481978982686996, + 0.0, + 0.505207896232605, + 0.24785638600587845, + 0.0, + 0.0, + 0.10543088056147099, + 0.38522834703326225, + 0.03346908092498779, + 0.3744076155126095, + 0.05749932676553726, + 0.2531366404145956, + 0.48951422423124313, + 0.5353040397167206, + 0.19679591804742813, + 0.351506132632494, + 0.035927318036556244, + 0.0, + 0.03839786350727081, + 0.0, + 0.0, + 0.7038470134139061, + 0.0, + 0.20431922376155853, + 0.0, + 0.0, + 0.09451757371425629, + 0.3119885325431824, + 0.03836333006620407, + 0.03816790133714676, + 0.0, + 0.1384131982922554, + 0.0, + 0.0, + 0.15912286937236786, + 0.0, + 0.0, + 0.0, + 0.13282738626003265, + 0.25543319806456566, + 0.0, + 0.04954197257757187, + 0.22967037558555603, + 0.047082606703042984, + 0.0, + 0.1677354034036398, + 0.6505817323923111, + 0.6941280253231525, + 0.0, + 0.8762184791266918, + 0.04805205389857292, + 0.2288073282688856, + 0.14625147357583046, + 0.1895848959684372 + ], + "unique_experts": 44, + "load_cv": 1.0727961746637216, + "normalized_load_entropy": 0.8526247248516299, + "max_load_share": 0.05555555555555555 + }, + "full_input": { + "tokens": 68, + "top_k": 6, + "decisions": 408, + "ordered_route_sha256": "05ec0f2020e142587807c48f15b766bbbe81b204ba6c9a5256a54c9a7b3ed644", + "route_weight_sha256": "b251d1b339612601e086988d51dd60a11d827f43200ebb492863e8ad95c28ea8", + "loads": [ + 4, + 1, + 1, + 4, + 13, + 7, + 0, + 8, + 12, + 4, + 4, + 0, + 10, + 4, + 0, + 0, + 6, + 7, + 2, + 8, + 2, + 7, + 8, + 15, + 4, + 6, + 4, + 7, + 18, + 16, + 11, + 12, + 4, + 9, + 5, + 7, + 2, + 6, + 20, + 1, + 1, + 15, + 8, + 4, + 15, + 4, + 4, + 7, + 9, + 5, + 2, + 1, + 4, + 4, + 0, + 3, + 8, + 15, + 0, + 13, + 3, + 13, + 9, + 2 + ], + "weighted_loads": [ + 0.19010300189256668, + 0.05394507199525833, + 0.04432071000337601, + 0.3635473803151399, + 2.1425882019102573, + 0.3470573262311518, + 0.0, + 0.42656712979078293, + 0.9385608918964863, + 0.3587673641741276, + 0.21742190793156624, + 0.0, + 0.700409572571516, + 0.24785638600587845, + 0.0, + 0.0, + 0.34846063889563084, + 0.49776725098490715, + 0.06954947859048843, + 0.3744076155126095, + 0.05983642255887389, + 0.3432235550135374, + 0.6122353374958038, + 0.9905927404761314, + 0.19679591804742813, + 0.351506132632494, + 0.15713533014059067, + 0.3572038523852825, + 2.309261277318001, + 2.4485316202044487, + 0.8647458022460341, + 1.0017091818153858, + 0.1775439903140068, + 0.49695536494255066, + 0.2555324174463749, + 0.5610096715390682, + 0.09451757371425629, + 0.48681976832449436, + 1.8093006312847137, + 0.03816790133714676, + 0.029796680435538292, + 1.1964555904269218, + 0.4778039790689945, + 0.21541018038988113, + 1.3492137119174004, + 0.30551744252443314, + 0.23286769539117813, + 0.39909073896706104, + 0.521075788885355, + 0.25543319806456566, + 0.0659091230481863, + 0.04954197257757187, + 0.22967037558555603, + 0.20217673480510712, + 0.0, + 0.1677354034036398, + 0.7310377964749932, + 0.9493454657495022, + 0.0, + 1.0426613613963127, + 0.11740059405565262, + 0.6271982323378325, + 0.368624035269022, + 0.1895848959684372 + ], + "unique_experts": 58, + "load_cv": 0.7746959319662122, + "normalized_load_entropy": 0.9232248167295396, + "max_load_share": 0.049019607843137254 + } + }, + "s0_bos": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "29753cddeb7c3a895822e202a495e52a823f11466bd64360bb17266379929e79", + "route_weight_sha256": "5084fc504683d995adde47d85b82dba5e340961f639630922b0b14b89391ebc4", + "loads": [ + 0, + 1, + 2, + 2, + 9, + 6, + 1, + 2, + 6, + 0, + 3, + 1, + 6, + 4, + 1, + 0, + 3, + 5, + 1, + 10, + 1, + 5, + 5, + 9, + 4, + 5, + 1, + 0, + 1, + 0, + 0, + 8, + 0, + 3, + 0, + 0, + 2, + 1, + 1, + 1, + 0, + 3, + 0, + 0, + 2, + 0, + 0, + 0, + 2, + 5, + 0, + 1, + 3, + 1, + 0, + 3, + 6, + 9, + 0, + 8, + 1, + 4, + 2, + 2 + ], + "weighted_loads": [ + 0.0, + 0.055764392018318176, + 0.0854470357298851, + 0.3507724106311798, + 0.5214476678520441, + 0.34460708126425743, + 0.04476214200258255, + 0.13041606545448303, + 0.508313063532114, + 0.0, + 0.18183407932519913, + 0.0361018143594265, + 0.4592168591916561, + 0.23224204033613205, + 0.025844529271125793, + 0.0, + 0.10484894178807735, + 0.38537418842315674, + 0.03602663800120354, + 0.46708476915955544, + 0.05446729436516762, + 0.2660222165286541, + 0.501600943505764, + 0.51258360221982, + 0.19201303645968437, + 0.3170289322733879, + 0.034956905990839005, + 0.0, + 0.03672201931476593, + 0.0, + 0.0, + 0.731944851577282, + 0.0, + 0.1583569012582302, + 0.0, + 0.0, + 0.08136672526597977, + 0.2981204688549042, + 0.03507490083575249, + 0.035576339811086655, + 0.0, + 0.1346031092107296, + 0.0, + 0.0, + 0.15373461693525314, + 0.0, + 0.0, + 0.0, + 0.12149802967905998, + 0.24240618012845516, + 0.0, + 0.051368486136198044, + 0.17252132296562195, + 0.04588627815246582, + 0.0, + 0.17063463851809502, + 0.764482993632555, + 0.6468975581228733, + 0.0, + 0.9014297239482403, + 0.04944264888763428, + 0.1875799000263214, + 0.06549140810966492, + 0.19698597490787506 + ], + "unique_experts": 46, + "load_cv": 1.0795941590429237, + "normalized_load_entropy": 0.8576459023426136, + "max_load_share": 0.06172839506172839 + }, + "full_input": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "4e01e861619f7f4be7a40fcb3883e399b2ff9c5e5bb8ea771dc005e16fcfdb6c", + "route_weight_sha256": "62f772eabde059ee273fb6cbd9e9c626d3c870af40a8d5ab6dfcc9015b4ba21b", + "loads": [ + 1, + 1, + 2, + 6, + 12, + 6, + 1, + 4, + 12, + 0, + 3, + 1, + 12, + 4, + 1, + 0, + 7, + 5, + 1, + 11, + 1, + 5, + 6, + 15, + 4, + 5, + 3, + 8, + 17, + 11, + 2, + 14, + 1, + 5, + 0, + 7, + 2, + 5, + 16, + 1, + 0, + 8, + 5, + 1, + 4, + 1, + 2, + 4, + 6, + 5, + 1, + 1, + 3, + 1, + 0, + 3, + 8, + 9, + 0, + 11, + 1, + 8, + 6, + 6 + ], + "weighted_loads": [ + 0.05631678178906441, + 0.055764392018318176, + 0.0854470357298851, + 0.4734371257945895, + 1.1935178283602, + 0.34460708126425743, + 0.04476214200258255, + 0.2653861753642559, + 0.908330325037241, + 0.0, + 0.18183407932519913, + 0.0361018143594265, + 0.8066155575215816, + 0.23224204033613205, + 0.025844529271125793, + 0.0, + 0.29232303984463215, + 0.38537418842315674, + 0.03602663800120354, + 0.503918681293726, + 0.05446729436516762, + 0.2660222165286541, + 0.5517063215374947, + 1.0115092806518078, + 0.19201303645968437, + 0.3170289322733879, + 0.1098066195845604, + 0.42808197624981403, + 1.9715365543961525, + 1.4711637385189533, + 0.06236416008323431, + 1.0779091641306877, + 0.046244069933891296, + 0.2517329715192318, + 0.0, + 0.4975783936679363, + 0.08136672526597977, + 0.4117445182055235, + 1.462101150304079, + 0.035576339811086655, + 0.0, + 0.5955767147243023, + 0.3388279713690281, + 0.06774472445249557, + 0.270665742456913, + 0.039670225232839584, + 0.13556132093071938, + 0.2227326910942793, + 0.37527816370129585, + 0.24240618012845516, + 0.012932265177369118, + 0.051368486136198044, + 0.17252132296562195, + 0.04588627815246582, + 0.0, + 0.17063463851809502, + 0.8664455059915781, + 0.6468975581228733, + 0.0, + 1.0458818096667528, + 0.04944264888763428, + 0.34391078911721706, + 0.21889531426131725, + 0.3263045959174633 + ], + "unique_experts": 58, + "load_cv": 0.8930294752445127, + "normalized_load_entropy": 0.9034478768281937, + "max_load_share": 0.05448717948717949 + } + }, + "s1_bos": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "0ad040fb29cb1d15a14216ce39089147ecf29a509cad995784fc52514e4f18a7", + "route_weight_sha256": "2f516d4dc14f3b5129b6c2a4fd56417cb42f7dda46cbd5b1d4e767d991b6674e", + "loads": [ + 0, + 1, + 2, + 1, + 10, + 6, + 0, + 2, + 6, + 0, + 3, + 1, + 6, + 4, + 0, + 0, + 3, + 5, + 1, + 9, + 2, + 6, + 5, + 9, + 3, + 5, + 1, + 0, + 1, + 0, + 0, + 8, + 0, + 4, + 0, + 0, + 2, + 2, + 1, + 1, + 0, + 3, + 0, + 0, + 2, + 0, + 0, + 0, + 2, + 5, + 0, + 1, + 3, + 1, + 0, + 3, + 6, + 9, + 0, + 7, + 1, + 4, + 3, + 2 + ], + "weighted_loads": [ + 0.0, + 0.05636126548051834, + 0.07942771539092064, + 0.31973370909690857, + 0.5611337553709745, + 0.34823475405573845, + 0.0, + 0.13101879134774208, + 0.5108384005725384, + 0.0, + 0.1831504888832569, + 0.03856182470917702, + 0.47795461490750313, + 0.24156056344509125, + 0.0, + 0.0, + 0.10800096392631531, + 0.39354199543595314, + 0.0347159244120121, + 0.43413956463336945, + 0.09245032072067261, + 0.30326654575765133, + 0.49684033542871475, + 0.4966656528413296, + 0.15071433037519455, + 0.318464208394289, + 0.03438008949160576, + 0.0, + 0.036530233919620514, + 0.0, + 0.0, + 0.7275589220225811, + 0.0, + 0.2044462189078331, + 0.0, + 0.0, + 0.09362833946943283, + 0.3395794592797756, + 0.03564004600048065, + 0.04121824726462364, + 0.0, + 0.1378804799169302, + 0.0, + 0.0, + 0.15925083309412003, + 0.0, + 0.0, + 0.0, + 0.13147392123937607, + 0.24514569714665413, + 0.0, + 0.04539727792143822, + 0.1682036556303501, + 0.045380085706710815, + 0.0, + 0.17830100655555725, + 0.7206505872309208, + 0.6635155566036701, + 0.0, + 0.8241426572203636, + 0.0440429262816906, + 0.17503386177122593, + 0.10118965059518814, + 0.20066334307193756 + ], + "unique_experts": 44, + "load_cv": 1.081850661380038, + "normalized_load_entropy": 0.8532153401137488, + "max_load_share": 0.06172839506172839 + }, + "full_input": { + "tokens": 68, + "top_k": 6, + "decisions": 408, + "ordered_route_sha256": "3f02bfe7593fac040163fbdca23108f9e0358255c7890a38dcbea960f914f414", + "route_weight_sha256": "df32bca9c0d472b1cf7095b0b68c1a61ba08cca764979ecc8aaafb3adc10505b", + "loads": [ + 4, + 1, + 2, + 3, + 13, + 6, + 0, + 8, + 12, + 3, + 4, + 1, + 11, + 4, + 0, + 0, + 8, + 7, + 2, + 9, + 2, + 8, + 8, + 15, + 3, + 5, + 4, + 7, + 18, + 18, + 11, + 13, + 4, + 9, + 5, + 7, + 2, + 6, + 20, + 1, + 1, + 14, + 7, + 4, + 15, + 4, + 3, + 7, + 10, + 5, + 2, + 1, + 3, + 4, + 0, + 3, + 8, + 16, + 0, + 11, + 3, + 12, + 9, + 2 + ], + "weighted_loads": [ + 0.19010300189256668, + 0.05636126548051834, + 0.07942771539092064, + 0.37325214873999357, + 1.2343085911124945, + 0.34823475405573845, + 0.0, + 0.43414538353681564, + 1.0381138063967228, + 0.32012973725795746, + 0.22575260698795319, + 0.03856182470917702, + 0.8074817731976509, + 0.24156056344509125, + 0.0, + 0.0, + 0.42987532168626785, + 0.506080899387598, + 0.07079632207751274, + 0.43413956463336945, + 0.09245032072067261, + 0.39335346035659313, + 0.6195614486932755, + 0.9519543536007404, + 0.15071433037519455, + 0.318464208394289, + 0.15558810159564018, + 0.3572038523852825, + 2.4312759563326836, + 2.410286296159029, + 0.8647458022460341, + 1.0097587816417217, + 0.1775439903140068, + 0.4929945431649685, + 0.2555324174463749, + 0.5610096715390682, + 0.09362833946943283, + 0.5144106950610876, + 1.8965486288070679, + 0.04121824726462364, + 0.029796680435538292, + 1.1457562949508429, + 0.4301084540784359, + 0.20499790087342262, + 1.3766569532454014, + 0.30551744252443314, + 0.17849204689264297, + 0.38466223888099194, + 0.5664064586162567, + 0.24514569714665413, + 0.0659091230481863, + 0.04539727792143822, + 0.1682036556303501, + 0.20047421380877495, + 0.0, + 0.17830100655555725, + 0.7878072187304497, + 0.955657098442316, + 0.0, + 0.9823431838303804, + 0.1133914664387703, + 0.5734247658401728, + 0.3685047887265682, + 0.20066334307193756 + ], + "unique_experts": 59, + "load_cv": 0.7874935540401257, + "normalized_load_entropy": 0.9226612959504453, + "max_load_share": 0.049019607843137254 + } + }, + "s0_x": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "528ce807d64f2532b670aa0176eae50017437084f784dc3775b3a18f649cda72", + "route_weight_sha256": "5c2179db0b1599a1a130c75575e28f49a96610b42d0f295eb8c8436a78f9c612", + "loads": [ + 0, + 1, + 2, + 1, + 9, + 6, + 0, + 2, + 6, + 1, + 3, + 1, + 6, + 4, + 0, + 0, + 2, + 5, + 1, + 10, + 1, + 5, + 6, + 9, + 4, + 5, + 1, + 0, + 0, + 0, + 0, + 8, + 1, + 4, + 0, + 0, + 1, + 2, + 1, + 1, + 0, + 3, + 0, + 0, + 2, + 0, + 0, + 0, + 2, + 5, + 0, + 0, + 2, + 1, + 0, + 3, + 6, + 9, + 0, + 8, + 1, + 6, + 3, + 2 + ], + "weighted_loads": [ + 0.0, + 0.0571662038564682, + 0.08155139163136482, + 0.3017627000808716, + 0.5358173605054617, + 0.3753174878656864, + 0.0, + 0.13332561403512955, + 0.5542989708483219, + 0.03684000298380852, + 0.1859455145895481, + 0.03523000702261925, + 0.4570515491068363, + 0.23705220967531204, + 0.0, + 0.0, + 0.0792190432548523, + 0.40171196684241295, + 0.03606295585632324, + 0.4738248772919178, + 0.05767716467380524, + 0.250456964597106, + 0.5327082313597202, + 0.5071036797016859, + 0.21019406616687775, + 0.31915659084916115, + 0.039300188422203064, + 0.0, + 0.0, + 0.0, + 0.0, + 0.721346590667963, + 0.032845184206962585, + 0.21137254685163498, + 0.0, + 0.0, + 0.04202375188469887, + 0.3361692354083061, + 0.04158369451761246, + 0.03691961243748665, + 0.0, + 0.1302158646285534, + 0.0, + 0.0, + 0.1633090004324913, + 0.0, + 0.0, + 0.0, + 0.1293742060661316, + 0.24639249220490456, + 0.0, + 0.0, + 0.12710942327976227, + 0.04552264139056206, + 0.0, + 0.16173705086112022, + 0.7685030810534954, + 0.6498787254095078, + 0.0, + 0.908909760415554, + 0.053325992077589035, + 0.27116994373500347, + 0.08752906695008278, + 0.1937420479953289 + ], + "unique_experts": 44, + "load_cv": 1.1107681226445005, + "normalized_load_entropy": 0.8474605787521918, + "max_load_share": 0.06172839506172839 + }, + "full_input": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "a0626b156b14f34f0ce0aec24d5ea7818dba0aea5f22e46a81ef1aaad2482d36", + "route_weight_sha256": "bcc9998f1af94de5113f5f26958f5a5df3e5962a9793cfc9fb1b0a15ccb316b9", + "loads": [ + 0, + 1, + 2, + 5, + 12, + 6, + 0, + 5, + 12, + 1, + 3, + 1, + 11, + 4, + 0, + 0, + 4, + 5, + 1, + 10, + 1, + 5, + 7, + 16, + 4, + 5, + 2, + 9, + 18, + 10, + 3, + 13, + 2, + 6, + 0, + 8, + 1, + 6, + 15, + 1, + 0, + 8, + 6, + 2, + 4, + 2, + 2, + 4, + 6, + 5, + 1, + 0, + 2, + 1, + 0, + 3, + 8, + 9, + 0, + 10, + 1, + 11, + 6, + 6 + ], + "weighted_loads": [ + 0.0, + 0.0571662038564682, + 0.08155139163136482, + 0.4244274152442813, + 1.2078875210136175, + 0.3753174878656864, + 0.0, + 0.30851344764232635, + 0.9062894620001316, + 0.03684000298380852, + 0.1859455145895481, + 0.03523000702261925, + 0.7112348675727844, + 0.23705220967531204, + 0.0, + 0.0, + 0.16991570964455605, + 0.40171196684241295, + 0.03606295585632324, + 0.4738248772919178, + 0.05767716467380524, + 0.250456964597106, + 0.5828136093914509, + 1.153155056759715, + 0.21019406616687775, + 0.31915659084916115, + 0.07201424241065979, + 0.4845865685492754, + 2.232145480811596, + 1.200904693454504, + 0.11639501061290503, + 1.043981395661831, + 0.07908925414085388, + 0.3190453536808491, + 0.0, + 0.5726653300225735, + 0.04202375188469887, + 0.44979328475892544, + 1.3272464461624622, + 0.03691961243748665, + 0.0, + 0.6290865875780582, + 0.39878810569643974, + 0.1019095778465271, + 0.2637869864702225, + 0.09167267382144928, + 0.12421467527747154, + 0.20245336554944515, + 0.399828240275383, + 0.24639249220490456, + 0.012932265177369118, + 0.0, + 0.12710942327976227, + 0.04552264139056206, + 0.0, + 0.16173705086112022, + 0.8704655934125185, + 0.6498787254095078, + 0.0, + 0.9938072059303522, + 0.053325992077589035, + 0.4980650506913662, + 0.2058331873267889, + 0.32306066900491714 + ], + "unique_experts": 55, + "load_cv": 0.9003615315938174, + "normalized_load_entropy": 0.8986497134889873, + "max_load_share": 0.057692307692307696 + } + }, + "s1_x": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "32f52da0718c5c4dce917f1abfb7b6080a4871e96d2cdc4c04205ba5c169d94d", + "route_weight_sha256": "e71158b7cf9d01654bb1e843d5d030243ead442cb28a718e7ec16c1255e25f0c", + "loads": [ + 0, + 1, + 2, + 2, + 9, + 6, + 0, + 2, + 6, + 0, + 3, + 1, + 5, + 5, + 0, + 0, + 2, + 5, + 1, + 9, + 1, + 4, + 6, + 8, + 4, + 6, + 1, + 0, + 1, + 0, + 1, + 8, + 0, + 4, + 0, + 0, + 2, + 2, + 1, + 1, + 0, + 4, + 1, + 0, + 3, + 0, + 0, + 1, + 2, + 5, + 0, + 0, + 3, + 1, + 0, + 3, + 5, + 9, + 0, + 7, + 0, + 4, + 3, + 2 + ], + "weighted_loads": [ + 0.0, + 0.05837725102901459, + 0.08962484449148178, + 0.3448757529258728, + 0.5507885701954365, + 0.37548181414604187, + 0.0, + 0.13084972649812698, + 0.5292446278035641, + 0.0, + 0.16428011283278465, + 0.03831460326910019, + 0.4016633406281471, + 0.2768499404191971, + 0.0, + 0.0, + 0.08263746276497841, + 0.40400782227516174, + 0.03474511206150055, + 0.46428510546684265, + 0.05884867161512375, + 0.21986042335629463, + 0.544857032597065, + 0.4424539264291525, + 0.2227892279624939, + 0.3477017693221569, + 0.03786769509315491, + 0.0, + 0.0370941124856472, + 0.0, + 0.03449906408786774, + 0.6951718293130398, + 0.0, + 0.2051849029958248, + 0.0, + 0.0, + 0.09290352091193199, + 0.3246166706085205, + 0.041191138327121735, + 0.040943462401628494, + 0.0, + 0.17728783003985882, + 0.03334064036607742, + 0.0, + 0.1977541409432888, + 0.0, + 0.0, + 0.034536007791757584, + 0.12893646210432053, + 0.24855898320674896, + 0.0, + 0.0, + 0.13083438761532307, + 0.04797547310590744, + 0.0, + 0.16112974658608437, + 0.6170068569481373, + 0.6146964579820633, + 0.0, + 0.8287358060479164, + 0.0, + 0.19798785261809826, + 0.08810772560536861, + 0.19865743070840836 + ], + "unique_experts": 45, + "load_cv": 1.0451621734961416, + "normalized_load_entropy": 0.8600354949317432, + "max_load_share": 0.05555555555555555 + }, + "full_input": { + "tokens": 68, + "top_k": 6, + "decisions": 408, + "ordered_route_sha256": "1d93e27652023983661eaca646708c6637c0987732bee605c316a8fa8e244439", + "route_weight_sha256": "5d7b908ba2f9d0ccbd5b64c83a37c3e78e41afcfd926a616b15e537794bb9d84", + "loads": [ + 4, + 1, + 2, + 4, + 12, + 6, + 0, + 9, + 12, + 3, + 4, + 1, + 9, + 5, + 0, + 0, + 5, + 7, + 2, + 9, + 1, + 7, + 9, + 15, + 4, + 7, + 4, + 8, + 20, + 15, + 13, + 12, + 4, + 9, + 5, + 8, + 2, + 6, + 19, + 1, + 1, + 15, + 10, + 4, + 16, + 5, + 4, + 7, + 8, + 5, + 2, + 0, + 3, + 4, + 0, + 3, + 6, + 16, + 0, + 10, + 2, + 13, + 8, + 2 + ], + "weighted_loads": [ + 0.19010300189256668, + 0.05837725102901459, + 0.08962484449148178, + 0.3983941925689578, + 1.2239634059369564, + 0.37548181414604187, + 0.0, + 0.4963427037000656, + 0.9743574187159538, + 0.32012973725795746, + 0.20688223093748093, + 0.03831460326910019, + 0.5812111720442772, + 0.2768499404191971, + 0.0, + 0.0, + 0.29170291498303413, + 0.5165467262268066, + 0.07082550972700119, + 0.46428510546684265, + 0.05884867161512375, + 0.34224145859479904, + 0.6675781458616257, + 1.030810309574008, + 0.2227892279624939, + 0.37967584282159805, + 0.15907570719718933, + 0.4302368424832821, + 2.635806906968355, + 1.9059720821678638, + 0.9352318150922656, + 0.9609242305159569, + 0.1775439903140068, + 0.48561517521739006, + 0.2555324174463749, + 0.6584080792963505, + 0.09290352091193199, + 0.4994479063898325, + 1.5899907313287258, + 0.040943462401628494, + 0.029796680435538292, + 1.2133368831127882, + 0.5897482708096504, + 0.1987401880323887, + 1.4108710438013077, + 0.3472310043871403, + 0.21050777286291122, + 0.32890828140079975, + 0.4974447675049305, + 0.24855898320674896, + 0.0659091230481863, + 0.0, + 0.13083438761532307, + 0.20306960120797157, + 0.0, + 0.16112974658608437, + 0.6447284705936909, + 0.9165263772010803, + 0.0, + 0.9431686047464609, + 0.0693485401570797, + 0.6511475425213575, + 0.31048028729856014, + 0.19865743070840836 + ], + "unique_experts": 58, + "load_cv": 0.7860275393265664, + "normalized_load_entropy": 0.921399869566692, + "max_load_share": 0.049019607843137254 + } + }, + "s0_period": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "e791bf41ff87a22e8bed0923cb2d1c77d5142cb4d87f6111792893fdb7bb6cda", + "route_weight_sha256": "acaea821e98883290cf1c79f31257bbb533a158981a2301f17699ead0a5889c2", + "loads": [ + 0, + 1, + 2, + 1, + 10, + 6, + 0, + 2, + 6, + 1, + 3, + 1, + 6, + 4, + 0, + 0, + 2, + 5, + 1, + 10, + 1, + 5, + 6, + 9, + 4, + 5, + 1, + 0, + 0, + 0, + 0, + 8, + 1, + 4, + 0, + 0, + 1, + 2, + 1, + 0, + 0, + 2, + 0, + 0, + 3, + 0, + 0, + 0, + 2, + 5, + 0, + 0, + 2, + 1, + 0, + 3, + 6, + 8, + 0, + 9, + 1, + 6, + 3, + 2 + ], + "weighted_loads": [ + 0.0, + 0.05647875368595123, + 0.07628268003463745, + 0.29841774702072144, + 0.5963154956698418, + 0.36097918078303337, + 0.0, + 0.13595050573349, + 0.5498969629406929, + 0.03766059875488281, + 0.17658652365207672, + 0.03559807687997818, + 0.46767157688736916, + 0.23219197615981102, + 0.0, + 0.0, + 0.0783766470849514, + 0.39968496561050415, + 0.035386115312576294, + 0.45972695387899876, + 0.05685431882739067, + 0.24897748604416847, + 0.5338587053120136, + 0.5083385556936264, + 0.21343332529067993, + 0.3231923058629036, + 0.03653158247470856, + 0.0, + 0.0, + 0.0, + 0.0, + 0.7111768610775471, + 0.035167984664440155, + 0.21298371255397797, + 0.0, + 0.0, + 0.03980426490306854, + 0.32614872977137566, + 0.045527271926403046, + 0.0, + 0.0, + 0.10827924683690071, + 0.0, + 0.0, + 0.18311419151723385, + 0.0, + 0.0, + 0.0, + 0.1292301081120968, + 0.22925479337573051, + 0.0, + 0.0, + 0.1310015767812729, + 0.0457858145236969, + 0.0, + 0.15124187618494034, + 0.7792948111891747, + 0.5595219749957323, + 0.0, + 0.9484714865684509, + 0.04260328412055969, + 0.2783854454755783, + 0.08777635730803013, + 0.1810932420194149 + ], + "unique_experts": 43, + "load_cv": 1.1303546212948572, + "normalized_load_entropy": 0.842635521204977, + "max_load_share": 0.06172839506172839 + }, + "full_input": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "ef7f481365b40c650a102a60898bd01995bf68a9102bb0ed62d39401f80ed677", + "route_weight_sha256": "303c2f92505f490a9bf0d3dc4fdac2eef5082d975b897d00166e0434c1e1f152", + "loads": [ + 0, + 1, + 2, + 5, + 13, + 6, + 0, + 5, + 11, + 1, + 3, + 1, + 11, + 4, + 0, + 0, + 4, + 5, + 1, + 10, + 1, + 5, + 7, + 16, + 4, + 5, + 2, + 9, + 18, + 10, + 2, + 13, + 2, + 6, + 0, + 8, + 1, + 6, + 15, + 0, + 0, + 8, + 6, + 2, + 5, + 1, + 2, + 5, + 6, + 5, + 1, + 0, + 2, + 1, + 0, + 3, + 8, + 8, + 0, + 11, + 1, + 11, + 7, + 6 + ], + "weighted_loads": [ + 0.0, + 0.05647875368595123, + 0.07628268003463745, + 0.42108246218413115, + 1.2683856561779976, + 0.36097918078303337, + 0.0, + 0.3155682347714901, + 0.8628997802734375, + 0.03766059875488281, + 0.17658652365207672, + 0.03559807687997818, + 0.7418709471821785, + 0.23219197615981102, + 0.0, + 0.0, + 0.1917259506881237, + 0.39968496561050415, + 0.035386115312576294, + 0.45972695387899876, + 0.05685431882739067, + 0.24897748604416847, + 0.5839640833437443, + 1.066243201494217, + 0.21343332529067993, + 0.3231923058629036, + 0.06924563646316528, + 0.46607561595737934, + 2.2601188831031322, + 1.2199078686535358, + 0.06236416008323431, + 1.0477667599916458, + 0.08141205459833145, + 0.31263617426157, + 0.0, + 0.5457058809697628, + 0.03980426490306854, + 0.43977277912199497, + 1.355588186532259, + 0.0, + 0.0, + 0.6962355561554432, + 0.39497948810458183, + 0.10834548249840736, + 0.29420832358300686, + 0.039670225232839584, + 0.12675007060170174, + 0.23079431429505348, + 0.3866935186088085, + 0.22925479337573051, + 0.012932265177369118, + 0.0, + 0.1310015767812729, + 0.0457858145236969, + 0.0, + 0.15124187618494034, + 0.8812573235481977, + 0.5595219749957323, + 0.0, + 1.033368932083249, + 0.04260328412055969, + 0.48682827688753605, + 0.26127029210329056, + 0.31041186302900314 + ], + "unique_experts": 54, + "load_cv": 0.910527225875113, + "normalized_load_entropy": 0.8948935121730262, + "max_load_share": 0.057692307692307696 + } + }, + "s1_period": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "b1e8df28c3708ccb977a2db9b8d5298e221dd45d01e2f04d347405227935cc05", + "route_weight_sha256": "0ef2ea10bad962a976d39453e222f35551f459ceff21e3d0f428946a21be9656", + "loads": [ + 0, + 1, + 2, + 2, + 11, + 6, + 1, + 2, + 6, + 1, + 3, + 1, + 5, + 5, + 0, + 0, + 2, + 5, + 1, + 8, + 1, + 4, + 5, + 8, + 3, + 5, + 1, + 0, + 0, + 0, + 1, + 8, + 0, + 3, + 0, + 1, + 2, + 3, + 1, + 0, + 0, + 4, + 1, + 0, + 3, + 0, + 0, + 1, + 2, + 5, + 0, + 0, + 3, + 1, + 0, + 2, + 5, + 9, + 0, + 8, + 1, + 4, + 3, + 2 + ], + "weighted_loads": [ + 0.0, + 0.05815032869577408, + 0.08171799033880234, + 0.3464993089437485, + 0.6502503976225853, + 0.37153342738747597, + 0.04204513877630234, + 0.14012005180120468, + 0.5719369985163212, + 0.03744944930076599, + 0.1809159442782402, + 0.03899134695529938, + 0.38733256608247757, + 0.309559665620327, + 0.0, + 0.0, + 0.08025801926851273, + 0.4099111594259739, + 0.03343141824007034, + 0.4092857055366039, + 0.05896396189928055, + 0.22874587774276733, + 0.4991413950920105, + 0.4518900755792856, + 0.17077530920505524, + 0.31103260070085526, + 0.03752356022596359, + 0.0, + 0.0, + 0.0, + 0.04041128605604172, + 0.7008578740060329, + 0.0, + 0.16061773896217346, + 0.0, + 0.050061825662851334, + 0.08759844303131104, + 0.37422217428684235, + 0.04258856177330017, + 0.0, + 0.0, + 0.17288903519511223, + 0.03533964976668358, + 0.0, + 0.20429910346865654, + 0.0, + 0.0, + 0.032804593443870544, + 0.116898313164711, + 0.23491688817739487, + 0.0, + 0.0, + 0.13211539760231972, + 0.04601740464568138, + 0.0, + 0.11681829392910004, + 0.6387745067477226, + 0.563503984361887, + 0.0, + 0.8756457418203354, + 0.04065568000078201, + 0.19323580712080002, + 0.08815787546336651, + 0.19962970167398453 + ], + "unique_experts": 47, + "load_cv": 1.0498183554714762, + "normalized_load_entropy": 0.8651248783996526, + "max_load_share": 0.06790123456790123 + }, + "full_input": { + "tokens": 68, + "top_k": 6, + "decisions": 408, + "ordered_route_sha256": "8b13b380b2c3484f5de6ab2368078a8e4808206eab812eda1a066bd2e81e6529", + "route_weight_sha256": "194a7975656b02c87d419e0c31e95117b9e2f699e20febec05838a7f29f88790", + "loads": [ + 4, + 1, + 2, + 4, + 14, + 6, + 1, + 10, + 12, + 4, + 4, + 1, + 8, + 5, + 0, + 0, + 5, + 7, + 2, + 8, + 1, + 6, + 8, + 15, + 3, + 5, + 4, + 7, + 19, + 16, + 12, + 12, + 4, + 8, + 5, + 9, + 2, + 7, + 20, + 0, + 1, + 16, + 10, + 4, + 16, + 4, + 4, + 8, + 9, + 5, + 2, + 0, + 3, + 4, + 0, + 2, + 6, + 15, + 0, + 11, + 3, + 13, + 9, + 2 + ], + "weighted_loads": [ + 0.19010300189256668, + 0.05815032869577408, + 0.08171799033880234, + 0.4000177485868335, + 1.3234252333641052, + 0.37153342738747597, + 0.04204513877630234, + 0.5328615698963404, + 1.0261758752167225, + 0.35757918655872345, + 0.22351806238293648, + 0.03899134695529938, + 0.5116981156170368, + 0.309559665620327, + 0.0, + 0.0, + 0.31787051260471344, + 0.5224500633776188, + 0.06951181590557098, + 0.4092857055366039, + 0.05896396189928055, + 0.31883279234170914, + 0.6218625083565712, + 0.9584732595831156, + 0.17077530920505524, + 0.31103260070085526, + 0.15873157232999802, + 0.3572038523852825, + 2.585235260426998, + 1.9805269688367844, + 0.9051570883020759, + 0.9747711196541786, + 0.1775439903140068, + 0.4429515041410923, + 0.2555324174463749, + 0.6651433408260345, + 0.08759844303131104, + 0.5490534100681543, + 1.6300608925521374, + 0.0, + 0.029796680435538292, + 1.3217178918421268, + 0.6089878641068935, + 0.18863671645522118, + 1.4275539219379425, + 0.30551744252443314, + 0.21629181131720543, + 0.3695992436259985, + 0.5149133652448654, + 0.23491688817739487, + 0.0659091230481863, + 0.0, + 0.13211539760231972, + 0.20111153274774551, + 0.0, + 0.11681829392910004, + 0.6664961203932762, + 0.8187214247882366, + 0.0, + 0.9900785405188799, + 0.11000422015786171, + 0.6459203213453293, + 0.34621710516512394, + 0.19962970167398453 + ], + "unique_experts": 58, + "load_cv": 0.7976802198748232, + "normalized_load_entropy": 0.9197914108397761, + "max_load_share": 0.049019607843137254 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 27, + "ordered_topk_exact_tokens": 16, + "set_exact_tokens": 22, + "mean_set_jaccard": 0.9391534391534392, + "mean_token_weighted_tv": 0.015914394451236283, + "aggregate_load_tv": 0.037037037037037035 + }, + "system_bos": { + "tokens": 27, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 21, + "mean_set_jaccard": 0.9285714285714286, + "mean_token_weighted_tv": 0.019211308513250615, + "aggregate_load_tv": 0.037037037037037035 + }, + "system_x": { + "tokens": 27, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.8677248677248678, + "mean_token_weighted_tv": 0.03683278906262583, + "aggregate_load_tv": 0.06790123456790123 + }, + "system_period": { + "tokens": 27, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.835978835978836, + "mean_token_weighted_tv": 0.042613341162602104, + "aggregate_load_tv": 0.08641975308641975 + }, + "bos_at_s0": { + "tokens": 27, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8544973544973545, + "mean_token_weighted_tv": 0.031003403856798454, + "aggregate_load_tv": 0.06790123456790123 + }, + "bos_at_s1": { + "tokens": 27, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.9153439153439153, + "mean_token_weighted_tv": 0.02453710856261077, + "aggregate_load_tv": 0.043209876543209874 + }, + "x_at_s0": { + "tokens": 27, + "ordered_topk_exact_tokens": 5, + "set_exact_tokens": 10, + "mean_set_jaccard": 0.8121693121693121, + "mean_token_weighted_tv": 0.039078368736362015, + "aggregate_load_tv": 0.07407407407407407 + }, + "x_at_s1": { + "tokens": 27, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.8492063492063493, + "mean_token_weighted_tv": 0.04542004341190612, + "aggregate_load_tv": 0.06790123456790123 + }, + "period_at_s0": { + "tokens": 27, + "ordered_topk_exact_tokens": 5, + "set_exact_tokens": 10, + "mean_set_jaccard": 0.8201058201058201, + "mean_token_weighted_tv": 0.039287009483410254, + "aggregate_load_tv": 0.06172839506172839 + }, + "period_at_s1": { + "tokens": 27, + "ordered_topk_exact_tokens": 6, + "set_exact_tokens": 12, + "mean_set_jaccard": 0.798941798941799, + "mean_token_weighted_tv": 0.05673595255723706, + "aggregate_load_tv": 0.08641975308641975 + } + } + }, + "layer_13": { + "layer": 13, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "662585f0fec65ec11e64b04cff29ae5292328150e0fcce7d7988f55eb1695f69", + "route_weight_sha256": "b682b3dddcf00f05d9dd201856b02e8a6de21a09a5d1307b02ca405e4dde0bbc", + "loads": [ + 1, + 0, + 3, + 6, + 0, + 4, + 11, + 0, + 0, + 0, + 1, + 3, + 2, + 3, + 13, + 2, + 1, + 7, + 3, + 0, + 0, + 2, + 1, + 0, + 1, + 2, + 0, + 3, + 6, + 0, + 1, + 2, + 1, + 0, + 4, + 3, + 1, + 1, + 0, + 0, + 1, + 6, + 3, + 0, + 0, + 3, + 3, + 11, + 2, + 0, + 1, + 0, + 0, + 0, + 2, + 0, + 0, + 2, + 13, + 0, + 3, + 6, + 6, + 12 + ], + "weighted_loads": [ + 0.04817018285393715, + 0.0, + 0.141396164894104, + 0.2886621169745922, + 0.0, + 0.1540875993669033, + 0.7165590897202492, + 0.0, + 0.0, + 0.0, + 0.028615066781640053, + 0.24518980085849762, + 0.19712283462285995, + 0.21234701573848724, + 1.100518949329853, + 0.34386034309864044, + 0.03074653074145317, + 0.26490926928818226, + 0.12073182314634323, + 0.0, + 0.0, + 0.11508248001337051, + 0.03702196851372719, + 0.0, + 0.03501958027482033, + 0.10283954069018364, + 0.0, + 0.23750482499599457, + 0.28520145639777184, + 0.0, + 0.11951466649770737, + 0.07170633226633072, + 0.04050535708665848, + 0.0, + 0.3697510864585638, + 0.1847386173903942, + 0.059184730052948, + 0.03244815394282341, + 0.0, + 0.0, + 0.0339207798242569, + 0.38517971336841583, + 0.10072307661175728, + 0.0, + 0.0, + 0.09477969817817211, + 0.14225571230053902, + 0.5165002439171076, + 0.07251843437552452, + 0.0, + 0.030759526416659355, + 0.0, + 0.0, + 0.0, + 0.25434256345033646, + 0.0, + 0.0, + 0.09695684537291527, + 1.762900110334158, + 0.0, + 0.19782369956374168, + 0.4277666099369526, + 0.4141825735569, + 0.9494555443525314 + ], + "unique_experts": 42, + "load_cv": 1.3139306132573396, + "normalized_load_entropy": 0.8199259132503023, + "max_load_share": 0.08024691358024691 + }, + "full_input": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "ddb36a1e014857eb4bbd181ac9e6347e4503abfe82982d93acac98a4d8026962", + "route_weight_sha256": "1762637351d446a2d6e892b84da7a37ab702e49e873e75315d712b81f1a5d01e", + "loads": [ + 1, + 5, + 3, + 6, + 0, + 5, + 31, + 0, + 0, + 3, + 11, + 9, + 2, + 3, + 14, + 8, + 1, + 9, + 4, + 1, + 0, + 5, + 1, + 0, + 5, + 2, + 4, + 3, + 6, + 14, + 1, + 2, + 1, + 7, + 5, + 3, + 4, + 2, + 0, + 2, + 1, + 7, + 5, + 2, + 11, + 14, + 4, + 14, + 3, + 0, + 2, + 0, + 3, + 3, + 4, + 0, + 3, + 2, + 18, + 4, + 3, + 7, + 6, + 13 + ], + "weighted_loads": [ + 0.04817018285393715, + 0.23400259017944336, + 0.141396164894104, + 0.2886621169745922, + 0.0, + 0.19732480868697166, + 2.502083061262965, + 0.0, + 0.0, + 0.11378760263323784, + 0.7065567579120398, + 0.5396033707074821, + 0.19712283462285995, + 0.21234701573848724, + 1.1458361893892288, + 0.6512281857430935, + 0.03074653074145317, + 0.3127292860299349, + 0.1628454513847828, + 0.04498879984021187, + 0.0, + 0.2253842893987894, + 0.03702196851372719, + 0.0, + 0.16682922700420022, + 0.10283954069018364, + 0.2170095145702362, + 0.23750482499599457, + 0.28520145639777184, + 0.9354828707873821, + 0.11951466649770737, + 0.07170633226633072, + 0.04050535708665848, + 0.6856342814862728, + 0.3925807513296604, + 0.1847386173903942, + 0.2078480590134859, + 0.06614856794476509, + 0.0, + 0.06909957528114319, + 0.0339207798242569, + 0.4351069889962673, + 0.205582894384861, + 0.09803363680839539, + 0.8688498809933662, + 1.1136203985661268, + 0.17360001057386398, + 1.7402336429804564, + 0.10463376715779305, + 0.0, + 0.06888300739228725, + 0.0, + 0.10790962353348732, + 0.14064712077379227, + 0.34290042147040367, + 0.0, + 0.16303827241063118, + 0.09695684537291527, + 1.9949703570455313, + 0.20476696267724037, + 0.19782369956374168, + 0.4572205301374197, + 0.4141825735569, + 0.9868532493710518 + ], + "unique_experts": 55, + "load_cv": 1.0923799181610663, + "normalized_load_entropy": 0.8820686553341768, + "max_load_share": 0.09935897435897435 + } + }, + "s1_eos": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "3b06bac41f82401c3435b2c203726c6ab7c7ce342c152e7cc8b3b6c7c5061e4c", + "route_weight_sha256": "664c83f1cb18ff11b64a7ef30003d4c1fa7a334ffe00c0f443ec3c6fc74441f7", + "loads": [ + 1, + 0, + 3, + 5, + 0, + 3, + 10, + 0, + 0, + 0, + 1, + 3, + 2, + 2, + 13, + 2, + 1, + 5, + 3, + 0, + 0, + 2, + 1, + 0, + 1, + 2, + 0, + 4, + 6, + 0, + 1, + 2, + 1, + 0, + 4, + 3, + 2, + 1, + 0, + 0, + 0, + 6, + 3, + 0, + 0, + 4, + 3, + 13, + 2, + 0, + 1, + 0, + 0, + 0, + 3, + 0, + 0, + 3, + 13, + 0, + 3, + 6, + 6, + 12 + ], + "weighted_loads": [ + 0.049523938447237015, + 0.0, + 0.1304612159729004, + 0.2594047226011753, + 0.0, + 0.11871328577399254, + 0.641417607665062, + 0.0, + 0.0, + 0.0, + 0.029287032783031464, + 0.23712274804711342, + 0.21275286376476288, + 0.1715434454381466, + 1.104009073227644, + 0.33937968313694, + 0.03156207129359245, + 0.19338681735098362, + 0.1199878491461277, + 0.0, + 0.0, + 0.11572534590959549, + 0.03803444653749466, + 0.0, + 0.034278128296136856, + 0.10201393440365791, + 0.0, + 0.29154133796691895, + 0.2861586734652519, + 0.0, + 0.12017735093832016, + 0.0731704831123352, + 0.042154133319854736, + 0.0, + 0.3449822273105383, + 0.18384690582752228, + 0.0908561423420906, + 0.03336532413959503, + 0.0, + 0.0, + 0.0, + 0.37827543914318085, + 0.09803227335214615, + 0.0, + 0.0, + 0.12972449511289597, + 0.1406312845647335, + 0.5816802605986595, + 0.08329731225967407, + 0.0, + 0.028343800455331802, + 0.0, + 0.0, + 0.0, + 0.2873344011604786, + 0.0, + 0.0, + 0.12985770404338837, + 1.7326620575040579, + 0.0, + 0.20188908651471138, + 0.4348011687397957, + 0.4015601724386215, + 0.9522801972925663 + ], + "unique_experts": 41, + "load_cv": 1.3194868594727622, + "normalized_load_entropy": 0.8186136466198181, + "max_load_share": 0.08024691358024691 + }, + "full_input": { + "tokens": 68, + "top_k": 6, + "decisions": 408, + "ordered_route_sha256": "73594fe5c9b01b4585ad19bc83c7c2a06e76509934057f464507aeedb269d777", + "route_weight_sha256": "be78545d599f54cb3d50b61a3889dd516a097443f0bf93178c4dbf1554dba346", + "loads": [ + 6, + 5, + 3, + 5, + 0, + 5, + 42, + 0, + 0, + 3, + 11, + 15, + 2, + 2, + 14, + 9, + 1, + 8, + 5, + 3, + 0, + 7, + 1, + 3, + 5, + 2, + 5, + 4, + 6, + 18, + 8, + 3, + 1, + 12, + 7, + 4, + 6, + 2, + 1, + 1, + 2, + 11, + 11, + 2, + 16, + 16, + 4, + 16, + 4, + 5, + 2, + 0, + 3, + 2, + 5, + 2, + 3, + 14, + 20, + 4, + 4, + 8, + 6, + 13 + ], + "weighted_loads": [ + 0.25210239365696907, + 0.27036663703620434, + 0.1304612159729004, + 0.2594047226011753, + 0.0, + 0.19954288378357887, + 3.349640538915992, + 0.0, + 0.0, + 0.14403873309493065, + 0.6945015490055084, + 1.0282104290090501, + 0.21275286376476288, + 0.1715434454381466, + 1.1477507092058659, + 0.7058645188808441, + 0.03156207129359245, + 0.27804049104452133, + 0.18657071702182293, + 0.122291449457407, + 0.0, + 0.34669581800699234, + 0.03803444653749466, + 0.12223831564188004, + 0.20775991072878242, + 0.10201393440365791, + 0.24845862574875355, + 0.29154133796691895, + 0.2861586734652519, + 1.5922315865755081, + 0.5191141851246357, + 0.11417780071496964, + 0.042154133319854736, + 1.183621782809496, + 0.5700575970113277, + 0.23751062154769897, + 0.3337030950933695, + 0.06676888838410378, + 0.04280334711074829, + 0.04212108626961708, + 0.07951659709215164, + 0.5920780450105667, + 0.7541734110563993, + 0.11149265617132187, + 1.3272229507565498, + 1.139309722930193, + 0.17979291826486588, + 1.8114326745271683, + 0.33502350002527237, + 0.24840737879276276, + 0.06537402048707008, + 0.0, + 0.10476512089371681, + 0.08119941502809525, + 0.35933093167841434, + 0.07189788669347763, + 0.15278422459959984, + 0.8387899994850159, + 2.05036330036819, + 0.19174960628151894, + 0.23049436882138252, + 0.518381129950285, + 0.4015601724386215, + 1.004965428262949 + ], + "unique_experts": 59, + "load_cv": 1.0491570369938623, + "normalized_load_entropy": 0.8961791091025166, + "max_load_share": 0.10294117647058823 + } + }, + "s0_bos": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "f745522fbb23bd750b9024e6f87932ec04ad7c949ea673cedd9aa62d4c56aaec", + "route_weight_sha256": "5a5f76713d65ca68e5ecc1dbc3cd686b5a31139a720294819cd8c9949eacf9df", + "loads": [ + 1, + 0, + 3, + 5, + 0, + 3, + 10, + 0, + 0, + 0, + 1, + 3, + 2, + 3, + 14, + 2, + 1, + 6, + 2, + 0, + 0, + 2, + 1, + 0, + 1, + 1, + 0, + 4, + 6, + 0, + 1, + 2, + 1, + 0, + 4, + 3, + 1, + 1, + 0, + 0, + 1, + 5, + 3, + 0, + 0, + 3, + 3, + 12, + 3, + 0, + 0, + 0, + 0, + 1, + 3, + 0, + 0, + 2, + 13, + 0, + 5, + 6, + 6, + 12 + ], + "weighted_loads": [ + 0.056662771850824356, + 0.0, + 0.13135594874620438, + 0.25879954919219017, + 0.0, + 0.12226767465472221, + 0.607191912829876, + 0.0, + 0.0, + 0.0, + 0.028897875919938087, + 0.2346641942858696, + 0.21222615242004395, + 0.21160531044006348, + 1.1393588613718748, + 0.3432396501302719, + 0.03126535937190056, + 0.22421355545520782, + 0.08397958427667618, + 0.0, + 0.0, + 0.11787895858287811, + 0.0391567088663578, + 0.0, + 0.03550942987203598, + 0.06190859153866768, + 0.0, + 0.284827783703804, + 0.27336548641324043, + 0.0, + 0.11584930121898651, + 0.07392758876085281, + 0.043526168912649155, + 0.0, + 0.3933792430907488, + 0.1867937073111534, + 0.05838719755411148, + 0.03194882720708847, + 0.0, + 0.0, + 0.038601573556661606, + 0.3096342794597149, + 0.1059909351170063, + 0.0, + 0.0, + 0.09458178840577602, + 0.13947917707264423, + 0.5713200308382511, + 0.11513998731970787, + 0.0, + 0.0, + 0.0, + 0.0, + 0.028576834127306938, + 0.30566636472940445, + 0.0, + 0.0, + 0.09674299135804176, + 1.7174602709710598, + 0.0, + 0.26340558752417564, + 0.44502751901745796, + 0.42823610082268715, + 1.0013233423233032 + ], + "unique_experts": 42, + "load_cv": 1.3250198067152719, + "normalized_load_entropy": 0.818900964808883, + "max_load_share": 0.08641975308641975 + }, + "full_input": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "2cd9ce2fe5a1b3d9fb1c63c124e24ec549c74f1d31722afdb143b0015c655337", + "route_weight_sha256": "fc62e9c0093f4dc9c160662bf5acece9c4486f528c7bb1f03ed47b38683a36c6", + "loads": [ + 1, + 5, + 4, + 5, + 1, + 4, + 29, + 0, + 0, + 5, + 11, + 7, + 2, + 3, + 14, + 8, + 1, + 7, + 3, + 1, + 0, + 4, + 1, + 0, + 4, + 1, + 4, + 4, + 6, + 13, + 1, + 2, + 1, + 5, + 5, + 3, + 3, + 2, + 0, + 2, + 1, + 9, + 5, + 3, + 11, + 14, + 4, + 14, + 4, + 0, + 1, + 0, + 3, + 5, + 5, + 0, + 5, + 2, + 19, + 4, + 5, + 7, + 6, + 13 + ], + "weighted_loads": [ + 0.056662771850824356, + 0.2546924129128456, + 0.2005801424384117, + 0.25879954919219017, + 0.05026799440383911, + 0.16675354912877083, + 2.282970329746604, + 0.0, + 0.0, + 0.23420268669724464, + 0.6361479889601469, + 0.48871640861034393, + 0.21222615242004395, + 0.21160531044006348, + 1.1393588613718748, + 0.650607492774725, + 0.03126535937190056, + 0.2589687705039978, + 0.12609321251511574, + 0.04498879984021187, + 0.0, + 0.21095279976725578, + 0.0391567088663578, + 0.0, + 0.1820212174206972, + 0.06190859153866768, + 0.20262540876865387, + 0.284827783703804, + 0.27336548641324043, + 0.8161874040961266, + 0.11584930121898651, + 0.07392758876085281, + 0.043526168912649155, + 0.5789559595286846, + 0.4162089079618454, + 0.1867937073111534, + 0.1657074447721243, + 0.06564924120903015, + 0.0, + 0.06909957528114319, + 0.038601573556661606, + 0.48477885872125626, + 0.23308607935905457, + 0.17645751684904099, + 0.8157130889594555, + 1.0978450533002615, + 0.1708234753459692, + 0.9639405086636543, + 0.1472553201019764, + 0.0, + 0.0381234809756279, + 0.0, + 0.10790962353348732, + 0.23274572007358074, + 0.39422422274947166, + 0.0, + 0.3159821182489395, + 0.09674299135804176, + 1.9912982359528542, + 0.20476696267724037, + 0.26340558752417564, + 0.47448143921792507, + 0.42823610082268715, + 1.0387210473418236 + ], + "unique_experts": 56, + "load_cv": 1.054404368971902, + "normalized_load_entropy": 0.8878720766669831, + "max_load_share": 0.09294871794871795 + } + }, + "s1_bos": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "df205bdc9c5c1b877165850f931cd7f9b9d140b5c102812f662028ecff00a800", + "route_weight_sha256": "c08538b0300991b1de073b9b6a8be787bfba4f10bb60d10d8268be6e49aa898f", + "loads": [ + 1, + 0, + 3, + 5, + 0, + 3, + 9, + 0, + 0, + 0, + 1, + 3, + 2, + 3, + 15, + 2, + 1, + 3, + 3, + 0, + 0, + 2, + 1, + 0, + 1, + 1, + 1, + 4, + 6, + 0, + 1, + 1, + 1, + 0, + 4, + 4, + 3, + 1, + 0, + 0, + 1, + 6, + 2, + 0, + 0, + 2, + 4, + 11, + 3, + 0, + 0, + 0, + 0, + 0, + 2, + 0, + 0, + 3, + 13, + 0, + 5, + 6, + 6, + 13 + ], + "weighted_loads": [ + 0.0567028783261776, + 0.0, + 0.13001329079270363, + 0.2609543055295944, + 0.0, + 0.1284770667552948, + 0.5581675842404366, + 0.0, + 0.0, + 0.0, + 0.03011244349181652, + 0.23825065791606903, + 0.2181963250041008, + 0.20401295647025108, + 1.148716889321804, + 0.34554818272590637, + 0.03057987242937088, + 0.10362382978200912, + 0.12018120288848877, + 0.0, + 0.0, + 0.11616482213139534, + 0.038290269672870636, + 0.0, + 0.035212527960538864, + 0.06148220971226692, + 0.033806297928094864, + 0.280196238309145, + 0.27497245371341705, + 0.0, + 0.11776681244373322, + 0.04146508499979973, + 0.04461643472313881, + 0.0, + 0.3903623949736357, + 0.1989247091114521, + 0.12022353336215019, + 0.03335443511605263, + 0.0, + 0.0, + 0.037566833198070526, + 0.36552246659994125, + 0.06689941138029099, + 0.0, + 0.0, + 0.06390073895454407, + 0.1790253408253193, + 0.5306219756603241, + 0.12837504595518112, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.26465536653995514, + 0.0, + 0.0, + 0.11855557933449745, + 1.7184653021395206, + 0.0, + 0.2741203736513853, + 0.4302571602165699, + 0.4181714653968811, + 1.012564592063427 + ], + "unique_experts": 42, + "load_cv": 1.3341903966945332, + "normalized_load_entropy": 0.8185241435780548, + "max_load_share": 0.09259259259259259 + }, + "full_input": { + "tokens": 68, + "top_k": 6, + "decisions": 408, + "ordered_route_sha256": "6176938c0f7b6e29ac6aa365ad25e8d31d31afab46cfe65cfdba05827dc73bb0", + "route_weight_sha256": "477ff722aa2bd2cec8e3b573e16b80b946da0261775b4a3784af9ae33ad80fe2", + "loads": [ + 6, + 6, + 4, + 5, + 0, + 4, + 41, + 0, + 0, + 4, + 13, + 13, + 2, + 3, + 16, + 9, + 1, + 5, + 5, + 3, + 0, + 6, + 1, + 3, + 5, + 1, + 6, + 4, + 6, + 17, + 8, + 2, + 1, + 11, + 7, + 5, + 8, + 2, + 1, + 1, + 3, + 12, + 10, + 2, + 16, + 14, + 5, + 13, + 5, + 5, + 1, + 0, + 3, + 2, + 4, + 2, + 3, + 14, + 21, + 4, + 6, + 8, + 6, + 14 + ], + "weighted_loads": [ + 0.25928133353590965, + 0.3429178297519684, + 0.17232365161180496, + 0.2609543055295944, + 0.0, + 0.16369759663939476, + 3.2842043917626143, + 0.0, + 0.0, + 0.19995801150798798, + 0.7839125748723745, + 1.0264317356050014, + 0.2181963250041008, + 0.20401295647025108, + 1.1874024234712124, + 0.7120330184698105, + 0.03057987242937088, + 0.17457083612680435, + 0.186764070764184, + 0.122291449457407, + 0.0, + 0.3259992301464081, + 0.038290269672870636, + 0.12223831564188004, + 0.2835476826876402, + 0.06148220971226692, + 0.2547317426651716, + 0.280196238309145, + 0.27497245371341705, + 1.5049854591488838, + 0.5167036466300488, + 0.08247240260243416, + 0.04461643472313881, + 1.1100521720945835, + 0.6154377646744251, + 0.2525884248316288, + 0.41468957252800465, + 0.06675799936056137, + 0.04280334711074829, + 0.04212108626961708, + 0.11708343029022217, + 0.6313389763236046, + 0.7498510424047709, + 0.11637713760137558, + 1.25667155534029, + 1.0702128075063229, + 0.21818697452545166, + 0.931047759950161, + 0.3801012337207794, + 0.24840737879276276, + 0.03703022003173828, + 0.0, + 0.10476512089371681, + 0.08119941502809525, + 0.3366518970578909, + 0.07189788669347763, + 0.15278422459959984, + 0.827487874776125, + 2.049419593065977, + 0.19174960628151894, + 0.30272565595805645, + 0.5138371214270592, + 0.4181714653968811, + 1.0652498230338097 + ], + "unique_experts": 59, + "load_cv": 1.025810694864967, + "normalized_load_entropy": 0.8988112971212465, + "max_load_share": 0.10049019607843138 + } + }, + "s0_x": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "02c83e7caeaf23cee94c285e39fa6f4bde78f8dc12371100e31073f5d5c87012", + "route_weight_sha256": "2247e861cb95c2b234012d55c7102632a71ffe16b34efcc44eb7a9ab9d5b5559", + "loads": [ + 1, + 0, + 3, + 5, + 0, + 3, + 8, + 0, + 0, + 0, + 1, + 3, + 2, + 3, + 14, + 2, + 1, + 4, + 3, + 0, + 0, + 2, + 1, + 0, + 1, + 1, + 0, + 4, + 5, + 0, + 1, + 2, + 1, + 0, + 4, + 4, + 2, + 1, + 0, + 0, + 1, + 6, + 4, + 0, + 0, + 1, + 4, + 13, + 2, + 0, + 0, + 0, + 0, + 1, + 3, + 0, + 0, + 2, + 14, + 1, + 4, + 6, + 6, + 12 + ], + "weighted_loads": [ + 0.05507877841591835, + 0.0, + 0.1309281811118126, + 0.244915459305048, + 0.0, + 0.11975429952144623, + 0.574668925255537, + 0.0, + 0.0, + 0.0, + 0.02830505557358265, + 0.2360341139137745, + 0.21075093746185303, + 0.22329722344875336, + 1.1640310920774937, + 0.3042154908180237, + 0.030934961512684822, + 0.14445293694734573, + 0.12955128774046898, + 0.0, + 0.0, + 0.11885319277644157, + 0.036096155643463135, + 0.0, + 0.03649482876062393, + 0.06362912803888321, + 0.0, + 0.2961369976401329, + 0.23349148780107498, + 0.0, + 0.12506428360939026, + 0.07102955505251884, + 0.044453900307416916, + 0.0, + 0.39506421238183975, + 0.18260810151696205, + 0.09596975706517696, + 0.03237101808190346, + 0.0, + 0.0, + 0.03841541334986687, + 0.3559510000050068, + 0.13525235652923584, + 0.0, + 0.0, + 0.03076218068599701, + 0.1763746589422226, + 0.5977318994700909, + 0.07457697577774525, + 0.0, + 0.0, + 0.0, + 0.0, + 0.030359748750925064, + 0.3102744556963444, + 0.0, + 0.0, + 0.10338898748159409, + 1.7687694318592548, + 0.029158364981412888, + 0.23941633850336075, + 0.4466595984995365, + 0.4363180920481682, + 0.9740968458354473 + ], + "unique_experts": 43, + "load_cv": 1.3286956381223776, + "normalized_load_entropy": 0.8220643676238405, + "max_load_share": 0.08641975308641975 + }, + "full_input": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "468a6369c961af92cf42cb314028e43d80dc2ab5ef1879b4b47b5e2d0d2f5462", + "route_weight_sha256": "3cca0ae49fc5fda149c5304e130a32f397fff27aeb2924f32177f7d757076317", + "loads": [ + 1, + 4, + 3, + 5, + 0, + 4, + 28, + 0, + 0, + 2, + 12, + 8, + 2, + 3, + 14, + 9, + 1, + 5, + 4, + 1, + 0, + 3, + 1, + 0, + 7, + 1, + 4, + 4, + 5, + 13, + 1, + 2, + 1, + 7, + 5, + 4, + 4, + 2, + 0, + 2, + 1, + 10, + 6, + 1, + 13, + 13, + 6, + 15, + 3, + 0, + 1, + 0, + 3, + 4, + 5, + 0, + 3, + 2, + 19, + 5, + 4, + 7, + 6, + 13 + ], + "weighted_loads": [ + 0.05507877841591835, + 0.1813887171447277, + 0.1309281811118126, + 0.244915459305048, + 0.0, + 0.16871321201324463, + 2.190068570896983, + 0.0, + 0.0, + 0.07651004567742348, + 0.6476619709283113, + 0.5473791621625423, + 0.21075093746185303, + 0.22329722344875336, + 1.1640310920774937, + 0.8308844976127148, + 0.030934961512684822, + 0.1792081519961357, + 0.17166491597890854, + 0.04498879984021187, + 0.0, + 0.1749655120074749, + 0.036096155643463135, + 0.0, + 0.2845091391354799, + 0.06362912803888321, + 0.1995706632733345, + 0.2961369976401329, + 0.23349148780107498, + 0.8213629834353924, + 0.12506428360939026, + 0.07102955505251884, + 0.044453900307416916, + 0.6712768040597439, + 0.41789387725293636, + 0.18260810151696205, + 0.20329000428318977, + 0.06607143208384514, + 0.0, + 0.06909957528114319, + 0.03841541334986687, + 0.5400471948087215, + 0.23629942908883095, + 0.04580795019865036, + 0.9570735692977905, + 1.2308039888739586, + 0.23679758794605732, + 0.9903523772954941, + 0.10669230856001377, + 0.0, + 0.0381234809756279, + 0.0, + 0.10790962353348732, + 0.17100686952471733, + 0.3988323137164116, + 0.0, + 0.16303827241063118, + 0.10338898748159409, + 1.9956811983138323, + 0.23392532765865326, + 0.23941633850336075, + 0.4761135187000036, + 0.4363180920481682, + 1.0114945508539677 + ], + "unique_experts": 55, + "load_cv": 1.071721258666993, + "normalized_load_entropy": 0.8808550407689151, + "max_load_share": 0.08974358974358974 + } + }, + "s1_x": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "53d90cffef7f0eff732fb0be3e1469fde75e60414e7ba21abd05aaf07f03bf47", + "route_weight_sha256": "5517801165e6416603016c0387243a8c94787fb78c4ee928762d65e4dcc33bab", + "loads": [ + 1, + 3, + 3, + 5, + 0, + 3, + 7, + 0, + 0, + 0, + 0, + 2, + 2, + 2, + 14, + 2, + 2, + 4, + 3, + 0, + 0, + 2, + 1, + 0, + 2, + 1, + 1, + 4, + 6, + 0, + 2, + 1, + 1, + 0, + 3, + 5, + 2, + 1, + 0, + 0, + 1, + 6, + 3, + 0, + 0, + 1, + 4, + 13, + 2, + 0, + 0, + 0, + 0, + 0, + 3, + 0, + 0, + 2, + 13, + 0, + 6, + 6, + 6, + 11 + ], + "weighted_loads": [ + 0.055434249341487885, + 0.11205146461725235, + 0.1250290647149086, + 0.23588652908802032, + 0.0, + 0.12734729424118996, + 0.4968327283859253, + 0.0, + 0.0, + 0.0, + 0.0, + 0.18625236675143242, + 0.21594763547182083, + 0.17240513116121292, + 1.1653602570295334, + 0.17100461944937706, + 0.06227891333401203, + 0.14288329891860485, + 0.12693092226982117, + 0.0, + 0.0, + 0.11404545232653618, + 0.03851471096277237, + 0.0, + 0.08665573596954346, + 0.060812730342149734, + 0.03194958344101906, + 0.2853025235235691, + 0.2798355408012867, + 0.0, + 0.17503388971090317, + 0.04026400297880173, + 0.04657936468720436, + 0.0, + 0.3619244024157524, + 0.17887970432639122, + 0.09041786938905716, + 0.03161749243736267, + 0.0, + 0.0, + 0.03682500869035721, + 0.3530614674091339, + 0.10211755335330963, + 0.0, + 0.0, + 0.031019994989037514, + 0.17877697199583054, + 0.6268402934074402, + 0.07234335318207741, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.3035544715821743, + 0.0, + 0.0, + 0.08407935872673988, + 1.6382812298834324, + 0.0, + 0.31070257537066936, + 0.4373699873685837, + 0.42842477560043335, + 0.8993398398160934 + ], + "unique_experts": 42, + "load_cv": 1.295237662966349, + "normalized_load_entropy": 0.8248803478824777, + "max_load_share": 0.08641975308641975 + }, + "full_input": { + "tokens": 68, + "top_k": 6, + "decisions": 408, + "ordered_route_sha256": "2687f95323971a3ef57f1b0c79c29b537f8dd2389d00c3375a214942a76898f0", + "route_weight_sha256": "63851df52d942760e7e9679e373b25991a189f8dd7b95137471ce60c6de34672", + "loads": [ + 6, + 5, + 3, + 5, + 0, + 4, + 38, + 0, + 0, + 1, + 9, + 12, + 2, + 2, + 14, + 10, + 2, + 6, + 5, + 3, + 0, + 8, + 1, + 3, + 7, + 1, + 7, + 4, + 6, + 19, + 10, + 2, + 1, + 13, + 6, + 6, + 8, + 2, + 1, + 1, + 3, + 13, + 11, + 0, + 18, + 13, + 6, + 15, + 4, + 5, + 1, + 0, + 3, + 2, + 5, + 3, + 3, + 14, + 18, + 4, + 7, + 9, + 6, + 12 + ], + "weighted_loads": [ + 0.25801270455121994, + 0.2376512587070465, + 0.1250290647149086, + 0.23588652908802032, + 0.0, + 0.16256782412528992, + 2.9422278087586164, + 0.0, + 0.0, + 0.03051966056227684, + 0.5677863843739033, + 0.9874353632330894, + 0.21594763547182083, + 0.17240513116121292, + 1.1653602570295334, + 0.6813823841512203, + 0.06227891333401203, + 0.21383030526340008, + 0.1935137901455164, + 0.122291449457407, + 0.0, + 0.40314995124936104, + 0.03851471096277237, + 0.12223831564188004, + 0.3011979032307863, + 0.060812730342149734, + 0.27276342920958996, + 0.2853025235235691, + 0.2798355408012867, + 1.5498047359287739, + 0.6182231232523918, + 0.08127132058143616, + 0.04657936468720436, + 1.1901232711970806, + 0.5869997721165419, + 0.23254342004656792, + 0.40802142955362797, + 0.06502105668187141, + 0.04280334711074829, + 0.04212108626961708, + 0.11634160578250885, + 0.6672697179019451, + 0.7733404505997896, + 0.0, + 1.3950961604714394, + 1.1378761548548937, + 0.26051298156380653, + 1.027266077697277, + 0.3240695409476757, + 0.24840737879276276, + 0.03703022003173828, + 0.0, + 0.10476512089371681, + 0.08119941502809525, + 0.37555100210011005, + 0.10813919827342033, + 0.15278422459959984, + 0.8275229036808014, + 1.8161746598780155, + 0.19174960628151894, + 0.3393078576773405, + 0.5554526299238205, + 0.42842477560043335, + 0.9520250707864761 + ], + "unique_experts": 58, + "load_cv": 0.9915056376290613, + "normalized_load_entropy": 0.898745331870942, + "max_load_share": 0.09313725490196079 + } + }, + "s0_period": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "895f64a15575511ccd77e73b184980475892bc1e34fddc3a3108ca214d6da22b", + "route_weight_sha256": "050c0cae47e99e541a5a2aabd4985789792503770a0f6ecc7ad279ad02747bc9", + "loads": [ + 1, + 0, + 3, + 5, + 0, + 3, + 9, + 0, + 0, + 0, + 1, + 3, + 2, + 3, + 14, + 2, + 1, + 5, + 3, + 0, + 0, + 2, + 1, + 0, + 1, + 1, + 1, + 4, + 5, + 0, + 2, + 2, + 1, + 0, + 4, + 3, + 1, + 1, + 0, + 0, + 1, + 6, + 3, + 0, + 0, + 1, + 3, + 13, + 2, + 0, + 0, + 0, + 0, + 1, + 3, + 0, + 0, + 1, + 14, + 1, + 5, + 6, + 6, + 12 + ], + "weighted_loads": [ + 0.05684695020318031, + 0.0, + 0.1272796057164669, + 0.2443487085402012, + 0.0, + 0.11803573183715343, + 0.5827997475862503, + 0.0, + 0.0, + 0.0, + 0.028157712891697884, + 0.23231760039925575, + 0.2039165124297142, + 0.20842381939291954, + 1.153481276705861, + 0.3246484100818634, + 0.030640382319688797, + 0.20222513377666473, + 0.13078909739851952, + 0.0, + 0.0, + 0.12330344319343567, + 0.04135105386376381, + 0.0, + 0.03863855451345444, + 0.062278375029563904, + 0.02942393347620964, + 0.3113195598125458, + 0.2250814326107502, + 0.0, + 0.16346901655197144, + 0.07126891613006592, + 0.0422087199985981, + 0.0, + 0.3837328776717186, + 0.15485087037086487, + 0.06296347081661224, + 0.031738150864839554, + 0.0, + 0.0, + 0.038292739540338516, + 0.3606053926050663, + 0.10346080362796783, + 0.0, + 0.0, + 0.031063135713338852, + 0.13657368533313274, + 0.6290095522999763, + 0.07593973353505135, + 0.0, + 0.0, + 0.0, + 0.0, + 0.02741205133497715, + 0.3113595023751259, + 0.0, + 0.0, + 0.0529535710811615, + 1.7673039883375168, + 0.02891085483133793, + 0.2754561807960272, + 0.44573961198329926, + 0.42828307300806046, + 0.9578830543905497 + ], + "unique_experts": 44, + "load_cv": 1.3396626181611546, + "normalized_load_entropy": 0.822050716936243, + "max_load_share": 0.08641975308641975 + }, + "full_input": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "8243a56333a170fc5c6a46c0d4e67d463b67010533e90da5c3c48d108b90a2e4", + "route_weight_sha256": "8b831098c513b5e045e77046151f3d8dfb1958add4ac5f220e559b0aa1675b0a", + "loads": [ + 1, + 5, + 3, + 5, + 0, + 4, + 28, + 0, + 0, + 3, + 11, + 8, + 2, + 3, + 15, + 8, + 1, + 6, + 4, + 1, + 0, + 3, + 1, + 0, + 5, + 1, + 5, + 4, + 5, + 14, + 2, + 2, + 1, + 7, + 5, + 3, + 5, + 2, + 0, + 2, + 1, + 11, + 5, + 2, + 12, + 13, + 4, + 15, + 3, + 0, + 1, + 0, + 3, + 4, + 5, + 0, + 3, + 1, + 18, + 5, + 5, + 7, + 6, + 13 + ], + "weighted_loads": [ + 0.05684695020318031, + 0.36497773230075836, + 0.1272796057164669, + 0.2443487085402012, + 0.0, + 0.1647342760115862, + 2.232175951823592, + 0.0, + 0.0, + 0.13460371270775795, + 0.6418607775121927, + 0.5562328174710274, + 0.2039165124297142, + 0.20842381939291954, + 1.1855359692126513, + 0.6320162527263165, + 0.030640382319688797, + 0.2369803488254547, + 0.17290272563695908, + 0.04498879984021187, + 0.0, + 0.18035975098609924, + 0.04135105386376381, + 0.0, + 0.2821980584412813, + 0.062278375029563904, + 0.2386622615158558, + 0.3113195598125458, + 0.2250814326107502, + 0.8868608847260475, + 0.16346901655197144, + 0.07126891613006592, + 0.0422087199985981, + 0.6468724273145199, + 0.4065625425428152, + 0.15485087037086487, + 0.2753951344639063, + 0.06543856486678123, + 0.0, + 0.06909957528114319, + 0.038292739540338516, + 0.6004159785807133, + 0.1996287778019905, + 0.1161583662033081, + 0.8788477517664433, + 1.0768258646130562, + 0.1679179836064577, + 1.0216300301253796, + 0.10805506631731987, + 0.0, + 0.0381234809756279, + 0.0, + 0.10790962353348732, + 0.16805917210876942, + 0.3999173603951931, + 0.0, + 0.16303827241063118, + 0.0529535710811615, + 1.9432276226580143, + 0.2336778175085783, + 0.2754561807960272, + 0.47519353218376637, + 0.42828307300806046, + 0.99528075940907 + ], + "unique_experts": 55, + "load_cv": 1.0618604738896746, + "normalized_load_entropy": 0.8832612581305925, + "max_load_share": 0.08974358974358974 + } + }, + "s1_period": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "62c066f824e0c0dd69ee3118cdf1bd5e280b29b167ffe85723ad9cf0c885ccc7", + "route_weight_sha256": "62340e507d2a747fe1b056408ccff0aa5e15f7faf2da716b2ab7c29d4a7fafce", + "loads": [ + 1, + 2, + 3, + 5, + 0, + 3, + 8, + 0, + 0, + 0, + 1, + 2, + 2, + 2, + 14, + 2, + 1, + 4, + 3, + 1, + 0, + 2, + 1, + 0, + 2, + 1, + 1, + 4, + 6, + 0, + 2, + 1, + 1, + 1, + 3, + 3, + 2, + 1, + 0, + 0, + 1, + 6, + 3, + 1, + 0, + 1, + 4, + 13, + 1, + 0, + 0, + 0, + 0, + 0, + 2, + 0, + 0, + 3, + 12, + 1, + 6, + 6, + 6, + 11 + ], + "weighted_loads": [ + 0.05936548486351967, + 0.08236361667513847, + 0.1355733871459961, + 0.2444090135395527, + 0.0, + 0.12704825401306152, + 0.5152356661856174, + 0.0, + 0.0, + 0.0, + 0.03059207834303379, + 0.17802149802446365, + 0.23551445454359055, + 0.171920295804739, + 1.1631203591823578, + 0.18615972250699997, + 0.030665824189782143, + 0.15226813778281212, + 0.125726155936718, + 0.03808382898569107, + 0.0, + 0.11955468356609344, + 0.039501454681158066, + 0.0, + 0.08746127039194107, + 0.062487464398145676, + 0.03190281242132187, + 0.2879958152770996, + 0.2717633619904518, + 0.0, + 0.17969601973891258, + 0.04045022279024124, + 0.04896438866853714, + 0.03839624673128128, + 0.348802350461483, + 0.10482051968574524, + 0.08852808550000191, + 0.031042737886309624, + 0.0, + 0.0, + 0.040747325867414474, + 0.3470815345644951, + 0.09920958615839481, + 0.03447200357913971, + 0.0, + 0.030436573550105095, + 0.17607687413692474, + 0.6588620729744434, + 0.03314211592078209, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.27167999371886253, + 0.0, + 0.0, + 0.1294337548315525, + 1.5917257964611053, + 0.02935517393052578, + 0.32745977863669395, + 0.4410775639116764, + 0.4373191297054291, + 0.8862930051982403 + ], + "unique_experts": 47, + "load_cv": 1.2647544105261237, + "normalized_load_entropy": 0.8396409355944329, + "max_load_share": 0.08641975308641975 + }, + "full_input": { + "tokens": 68, + "top_k": 6, + "decisions": 408, + "ordered_route_sha256": "ed68ba41da2b09473833fc24f75f8fec916acce9d8365003ff05c529f86f5adb", + "route_weight_sha256": "b7f4fb13b4aed0b45986f3f2308306f3c350684c432c41365c5ce2612fb8fed6", + "loads": [ + 6, + 7, + 3, + 5, + 0, + 4, + 39, + 0, + 0, + 1, + 10, + 13, + 2, + 2, + 14, + 9, + 1, + 6, + 6, + 4, + 0, + 7, + 1, + 3, + 6, + 1, + 6, + 4, + 6, + 19, + 10, + 3, + 1, + 15, + 6, + 4, + 8, + 2, + 1, + 1, + 3, + 12, + 11, + 2, + 18, + 13, + 5, + 15, + 3, + 5, + 1, + 0, + 3, + 2, + 4, + 2, + 3, + 14, + 18, + 5, + 7, + 8, + 6, + 12 + ], + "weighted_loads": [ + 0.2619439400732517, + 0.46424845792353153, + 0.1355733871459961, + 0.2444090135395527, + 0.0, + 0.16226878389716148, + 2.9049056973308325, + 0.0, + 0.0, + 0.03051966056227684, + 0.6460660714656115, + 1.011538591235876, + 0.23551445454359055, + 0.171920295804739, + 1.1631203591823578, + 0.5526445582509041, + 0.030665824189782143, + 0.22321514412760735, + 0.22321081720292568, + 0.16037527844309807, + 0.0, + 0.3683076910674572, + 0.039501454681158066, + 0.12223831564188004, + 0.37977992929518223, + 0.062487464398145676, + 0.24196119792759418, + 0.2879958152770996, + 0.2717633619904518, + 1.5869305320084095, + 0.629096046090126, + 0.11380679160356522, + 0.04896438866853714, + 1.266132976859808, + 0.5738777201622725, + 0.15848423540592194, + 0.4406076278537512, + 0.06444630213081837, + 0.04280334711074829, + 0.04212108626961708, + 0.12026392295956612, + 0.6287310011684895, + 0.7495560459792614, + 0.0738624632358551, + 1.3539711758494377, + 1.0232000146061182, + 0.2152385078370571, + 1.0592878572642803, + 0.2848683036863804, + 0.24840737879276276, + 0.03703022003173828, + 0.0, + 0.10476512089371681, + 0.08119941502809525, + 0.3436765242367983, + 0.07189788669347763, + 0.15278422459959984, + 0.83836605027318, + 1.818094965070486, + 0.22110478021204472, + 0.3560650609433651, + 0.5246575251221657, + 0.4373191297054291, + 0.938978236168623 + ], + "unique_experts": 59, + "load_cv": 1.0068966334484524, + "normalized_load_entropy": 0.8985092644118021, + "max_load_share": 0.09558823529411764 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 27, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 20, + "mean_set_jaccard": 0.9259259259259259, + "mean_token_weighted_tv": 0.01635906765996306, + "aggregate_load_tv": 0.043209876543209874 + }, + "system_bos": { + "tokens": 27, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 18, + "mean_set_jaccard": 0.8968253968253969, + "mean_token_weighted_tv": 0.021943115491282056, + "aggregate_load_tv": 0.06172839506172839 + }, + "system_x": { + "tokens": 27, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8433862433862435, + "mean_token_weighted_tv": 0.03572297889601301, + "aggregate_load_tv": 0.06790123456790123 + }, + "system_period": { + "tokens": 27, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.8499278499278499, + "mean_token_weighted_tv": 0.03899880629722719, + "aggregate_load_tv": 0.07407407407407407 + }, + "bos_at_s0": { + "tokens": 27, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 20, + "mean_set_jaccard": 0.9100529100529101, + "mean_token_weighted_tv": 0.023742611416512065, + "aggregate_load_tv": 0.04938271604938271 + }, + "bos_at_s1": { + "tokens": 27, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.8650793650793651, + "mean_token_weighted_tv": 0.028712988934583135, + "aggregate_load_tv": 0.07407407407407407 + }, + "x_at_s0": { + "tokens": 27, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 13, + "mean_set_jaccard": 0.8359788359788362, + "mean_token_weighted_tv": 0.03547539424013208, + "aggregate_load_tv": 0.08024691358024691 + }, + "x_at_s1": { + "tokens": 27, + "ordered_topk_exact_tokens": 5, + "set_exact_tokens": 8, + "mean_set_jaccard": 0.7402116402116403, + "mean_token_weighted_tv": 0.05593861898200379, + "aggregate_load_tv": 0.09259259259259259 + }, + "period_at_s0": { + "tokens": 27, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8386243386243387, + "mean_token_weighted_tv": 0.03614056613986139, + "aggregate_load_tv": 0.07407407407407407 + }, + "period_at_s1": { + "tokens": 27, + "ordered_topk_exact_tokens": 8, + "set_exact_tokens": 10, + "mean_set_jaccard": 0.7652717652717653, + "mean_token_weighted_tv": 0.056400242537536005, + "aggregate_load_tv": 0.09259259259259259 + } + } + }, + "layer_14": { + "layer": 14, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "e5eb770fdcccf774ac4563957dc0336efa3a1a3634082e274b22595766e102d0", + "route_weight_sha256": "130f1c5416740fb6d14204e47665d575e1b1805ba5cdde2892a91181e0a2dc5b", + "loads": [ + 3, + 0, + 1, + 2, + 2, + 6, + 1, + 11, + 3, + 1, + 0, + 0, + 0, + 0, + 2, + 0, + 3, + 1, + 3, + 3, + 0, + 2, + 0, + 1, + 0, + 2, + 0, + 8, + 1, + 0, + 2, + 7, + 0, + 0, + 8, + 0, + 1, + 1, + 1, + 6, + 0, + 1, + 4, + 0, + 1, + 0, + 5, + 4, + 2, + 2, + 0, + 14, + 1, + 0, + 0, + 2, + 1, + 3, + 4, + 11, + 4, + 3, + 7, + 11 + ], + "weighted_loads": [ + 0.32489192113280296, + 0.0, + 0.031071703881025314, + 0.06553146988153458, + 0.12670864537358284, + 0.2448593359440565, + 0.052368760108947754, + 1.6800517607480288, + 0.15845634043216705, + 0.0387352779507637, + 0.0, + 0.0, + 0.0, + 0.0, + 0.15890014171600342, + 0.0, + 0.23254659958183765, + 0.08327055722475052, + 0.1902036815881729, + 0.1689696740359068, + 0.0, + 0.1078169047832489, + 0.0, + 0.04707547649741173, + 0.0, + 0.09313071146607399, + 0.0, + 0.5874580442905426, + 0.11092252284288406, + 0.0, + 0.09766501933336258, + 0.9736987538635731, + 0.0, + 0.0, + 0.6318164244294167, + 0.0, + 0.026309246197342873, + 0.06567562371492386, + 0.038287900388240814, + 0.36580875515937805, + 0.0, + 0.05050564184784889, + 0.3768683262169361, + 0.0, + 0.02446938492357731, + 0.0, + 0.19475203566253185, + 0.19665254279971123, + 0.0750286802649498, + 0.1517791412770748, + 0.0, + 1.3976411670446396, + 0.03166024759411812, + 0.0, + 0.0, + 0.051471590995788574, + 0.030860133469104767, + 0.3548847362399101, + 0.2739058993756771, + 0.9562447033822536, + 0.45182474702596664, + 0.29091310128569603, + 0.3673807270824909, + 0.6911761071532965 + ], + "unique_experts": 44, + "load_cv": 1.2570180976382046, + "normalized_load_entropy": 0.83166164221855, + "max_load_share": 0.08641975308641975 + }, + "full_input": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "bc912c7dfea97e7ea4e48d21fdff3de0a681a88510623f2b318049cf29fa0269", + "route_weight_sha256": "8264ea827c225fe4303a19d1ca9c46a71519f68e81caa719c180784dbff55ba3", + "loads": [ + 12, + 0, + 1, + 4, + 2, + 16, + 1, + 13, + 3, + 10, + 2, + 3, + 0, + 0, + 2, + 5, + 3, + 1, + 6, + 4, + 0, + 2, + 0, + 12, + 1, + 2, + 6, + 13, + 9, + 0, + 5, + 11, + 0, + 7, + 8, + 0, + 2, + 3, + 3, + 6, + 0, + 1, + 5, + 1, + 3, + 0, + 11, + 7, + 2, + 3, + 2, + 20, + 8, + 6, + 0, + 6, + 1, + 4, + 4, + 23, + 4, + 4, + 7, + 12 + ], + "weighted_loads": [ + 1.138381116092205, + 0.0, + 0.031071703881025314, + 0.14508559182286263, + 0.12670864537358284, + 1.165776016190648, + 0.052368760108947754, + 1.7530242148786783, + 0.15845634043216705, + 0.6357435807585716, + 0.06733614578843117, + 0.19310494139790535, + 0.0, + 0.0, + 0.15890014171600342, + 0.2489427626132965, + 0.23254659958183765, + 0.08327055722475052, + 0.3995380438864231, + 0.20888114534318447, + 0.0, + 0.1078169047832489, + 0.0, + 0.5148244127631187, + 0.022589728236198425, + 0.09313071146607399, + 0.34911539405584335, + 0.9339492097496986, + 1.384802021086216, + 0.0, + 0.3072871305048466, + 1.1291530979797244, + 0.0, + 0.7265678457915783, + 0.6318164244294167, + 0.0, + 0.07832354120910168, + 0.1660366877913475, + 0.20208963006734848, + 0.36580875515937805, + 0.0, + 0.05050564184784889, + 0.4278640113770962, + 0.04807879403233528, + 0.08614659495651722, + 0.0, + 0.5777599476277828, + 0.3270349111407995, + 0.0750286802649498, + 0.19529571384191513, + 0.07543742284178734, + 2.72809861600399, + 0.8136438652873039, + 0.4256640896201134, + 0.0, + 0.40953247994184494, + 0.030860133469104767, + 0.3909188248217106, + 0.2739058993756771, + 1.4972177781164646, + 0.45182474702596664, + 0.2959378268569708, + 0.3673807270824909, + 0.7416737396270037 + ], + "unique_experts": 53, + "load_cv": 1.0208220121740708, + "normalized_load_entropy": 0.8818495506437816, + "max_load_share": 0.07371794871794872 + } + }, + "s1_eos": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "3502f5fbfee0b3adf7a986d31bbcd5fa763771134f637a7df864e08715d1b285", + "route_weight_sha256": "71120c2feb314ec281d17437f46fbc7028c4b6155217fa4dfcf6f5ae9ea30f92", + "loads": [ + 3, + 0, + 0, + 1, + 2, + 7, + 1, + 10, + 3, + 1, + 0, + 0, + 0, + 0, + 2, + 0, + 3, + 1, + 3, + 3, + 0, + 2, + 0, + 1, + 2, + 2, + 0, + 8, + 1, + 0, + 2, + 7, + 0, + 0, + 8, + 0, + 1, + 1, + 1, + 6, + 0, + 1, + 4, + 0, + 1, + 0, + 5, + 3, + 3, + 1, + 0, + 17, + 0, + 0, + 0, + 2, + 1, + 3, + 4, + 11, + 4, + 3, + 7, + 10 + ], + "weighted_loads": [ + 0.3383142240345478, + 0.0, + 0.0, + 0.030321400612592697, + 0.12895019724965096, + 0.26978323608636856, + 0.054979827255010605, + 1.6295394897460938, + 0.15707499906420708, + 0.04018527269363403, + 0.0, + 0.0, + 0.0, + 0.0, + 0.16205648705363274, + 0.0, + 0.24067891016602516, + 0.08370426297187805, + 0.19023725017905235, + 0.18590874783694744, + 0.0, + 0.10559149831533432, + 0.0, + 0.05120892450213432, + 0.07861800491809845, + 0.09836873784661293, + 0.0, + 0.5876467414200306, + 0.11704915016889572, + 0.0, + 0.10059492662549019, + 0.9646168909966946, + 0.0, + 0.0, + 0.6428965963423252, + 0.0, + 0.027963213622570038, + 0.06828631460666656, + 0.042259637266397476, + 0.3436223529279232, + 0.0, + 0.05144549906253815, + 0.3922928124666214, + 0.0, + 0.024662954732775688, + 0.0, + 0.19655470736324787, + 0.17368584126234055, + 0.10660800337791443, + 0.1082521602511406, + 0.0, + 1.4790672920644283, + 0.0, + 0.0, + 0.0, + 0.05047539621591568, + 0.03159076347947121, + 0.33338041976094246, + 0.2655745632946491, + 0.9864678978919983, + 0.4557725004851818, + 0.28940655291080475, + 0.37801720947027206, + 0.6450033690780401 + ], + "unique_experts": 43, + "load_cv": 1.3120733025124705, + "normalized_load_entropy": 0.8232599445492297, + "max_load_share": 0.10493827160493827 + }, + "full_input": { + "tokens": 68, + "top_k": 6, + "decisions": 408, + "ordered_route_sha256": "667c2b595de86cf8c4d730048220e336315276288459f669b2133e621970ef24", + "route_weight_sha256": "dab4d0eacc5897aa4c71d4d87beea4ee7640f0d16fa04a55726112155df9b538", + "loads": [ + 14, + 1, + 0, + 4, + 5, + 23, + 1, + 14, + 5, + 13, + 0, + 3, + 5, + 0, + 2, + 6, + 3, + 1, + 9, + 7, + 2, + 5, + 0, + 11, + 8, + 4, + 5, + 17, + 14, + 1, + 7, + 10, + 2, + 11, + 9, + 1, + 1, + 4, + 4, + 7, + 0, + 1, + 6, + 1, + 2, + 0, + 11, + 5, + 5, + 2, + 13, + 21, + 9, + 9, + 2, + 5, + 2, + 5, + 5, + 30, + 7, + 5, + 9, + 14 + ], + "weighted_loads": [ + 1.2644948307424784, + 0.051600608974695206, + 0.0, + 0.14621185511350632, + 0.3390324041247368, + 1.4058190174400806, + 0.054979827255010605, + 1.7944045811891556, + 0.3246341906487942, + 0.9464352577924728, + 0.0, + 0.21797355636954308, + 0.3497659005224705, + 0.0, + 0.16205648705363274, + 0.3026655800640583, + 0.24067891016602516, + 0.08370426297187805, + 0.584214810281992, + 0.38738521188497543, + 0.22868893668055534, + 0.2090932559221983, + 0.0, + 0.459422180429101, + 0.3578854352235794, + 0.17177785746753216, + 0.3532266169786453, + 0.938294867053628, + 1.9208704680204391, + 0.047890618443489075, + 0.3620045632123947, + 1.0515001425519586, + 0.07938499003648758, + 1.2379852421581745, + 0.689665898680687, + 0.07854100316762924, + 0.027963213622570038, + 0.42711614817380905, + 0.26414622738957405, + 0.4019690826535225, + 0.0, + 0.05144549906253815, + 0.4892084375023842, + 0.046553753316402435, + 0.054237520322203636, + 0.0, + 0.6071508042514324, + 0.24240437895059586, + 0.23469098657369614, + 0.14214974641799927, + 0.855965219438076, + 2.7769658491015434, + 0.8383647613227367, + 0.6912472732365131, + 0.08266397193074226, + 0.34788690507411957, + 0.08433714881539345, + 0.41509731486439705, + 0.37445609644055367, + 2.0831265300512314, + 0.7110476940870285, + 0.3360628401860595, + 0.4801176115870476, + 0.8106032442301512 + ], + "unique_experts": 58, + "load_cv": 0.9348233287106053, + "normalized_load_entropy": 0.9024034300253645, + "max_load_share": 0.07352941176470588 + } + }, + "s0_bos": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "2415abc49e974e946f7899c16cc14d4e7339378ae4fa639ac2a06b8786640458", + "route_weight_sha256": "1ae438059c02f3a98ed84359e3d2e15d7b4378e41dac8292b4f4cbd4fd8bbac0", + "loads": [ + 3, + 0, + 0, + 1, + 2, + 5, + 1, + 10, + 3, + 1, + 0, + 0, + 0, + 0, + 2, + 0, + 4, + 1, + 3, + 3, + 0, + 2, + 0, + 1, + 2, + 2, + 0, + 9, + 1, + 0, + 2, + 7, + 0, + 0, + 8, + 0, + 1, + 1, + 1, + 6, + 0, + 1, + 4, + 0, + 1, + 0, + 5, + 4, + 3, + 2, + 0, + 15, + 0, + 0, + 0, + 2, + 1, + 3, + 4, + 11, + 4, + 3, + 6, + 11 + ], + "weighted_loads": [ + 0.3017640635371208, + 0.0, + 0.0, + 0.029572702944278717, + 0.126545961946249, + 0.20658836513757706, + 0.060747064650058746, + 1.598900981247425, + 0.1592797376215458, + 0.036042969673871994, + 0.0, + 0.0, + 0.0, + 0.0, + 0.15884514525532722, + 0.0, + 0.26901775784790516, + 0.08766006678342819, + 0.18829599767923355, + 0.17001409642398357, + 0.0, + 0.11199241876602173, + 0.0, + 0.052836038172245026, + 0.08153827488422394, + 0.10345108062028885, + 0.0, + 0.6263425797224045, + 0.11005531251430511, + 0.0, + 0.09829123318195343, + 0.9820485897362232, + 0.0, + 0.0, + 0.6655997186899185, + 0.0, + 0.024007083848118782, + 0.06542105972766876, + 0.04110097512602806, + 0.3513906467705965, + 0.0, + 0.05222264677286148, + 0.4197284206748009, + 0.0, + 0.02388044074177742, + 0.0, + 0.19798859767615795, + 0.19813396036624908, + 0.10903721675276756, + 0.1572665572166443, + 0.0, + 1.4820670932531357, + 0.0, + 0.0, + 0.0, + 0.051390210166573524, + 0.029210278764367104, + 0.34829171746969223, + 0.2763636037707329, + 0.9592255018651485, + 0.4456573873758316, + 0.2916592061519623, + 0.33489296585321426, + 0.6547460630536079 + ], + "unique_experts": 43, + "load_cv": 1.268604875255861, + "normalized_load_entropy": 0.8286231605290447, + "max_load_share": 0.09259259259259259 + }, + "full_input": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "8a01afaaf127ce29342ff4da429902b02475804646dec2fa6b2ce4fb7776e873", + "route_weight_sha256": "2c7317584e9ab998eb96f690915bbc9496c727e19f5ea58a432dcb6c4e3e2fef", + "loads": [ + 11, + 0, + 0, + 4, + 2, + 15, + 1, + 11, + 3, + 9, + 2, + 3, + 0, + 0, + 2, + 3, + 4, + 1, + 8, + 4, + 0, + 2, + 0, + 11, + 4, + 3, + 6, + 14, + 10, + 0, + 5, + 12, + 0, + 6, + 8, + 0, + 2, + 3, + 3, + 6, + 0, + 1, + 4, + 1, + 4, + 0, + 11, + 6, + 3, + 3, + 1, + 22, + 7, + 6, + 0, + 6, + 1, + 4, + 5, + 24, + 4, + 3, + 6, + 12 + ], + "weighted_loads": [ + 1.0498676672577858, + 0.0, + 0.0, + 0.16549048945307732, + 0.126545961946249, + 1.1275050453841686, + 0.060747064650058746, + 1.6324568465352058, + 0.1592797376215458, + 0.5499143823981285, + 0.06733614578843117, + 0.19310494139790535, + 0.0, + 0.0, + 0.15884514525532722, + 0.17069633677601814, + 0.26901775784790516, + 0.08766006678342819, + 0.5515535734593868, + 0.20992556773126125, + 0.0, + 0.11199241876602173, + 0.0, + 0.4928718451410532, + 0.14938518404960632, + 0.1431330218911171, + 0.34911539405584335, + 1.0260889828205109, + 1.357675090432167, + 0.0, + 0.3177148476243019, + 1.2150263786315918, + 0.0, + 0.6376335434615612, + 0.6655997186899185, + 0.0, + 0.07602137885987759, + 0.15316630899906158, + 0.22896379604935646, + 0.3513906467705965, + 0.0, + 0.05222264677286148, + 0.4197284206748009, + 0.04807879403233528, + 0.16193796321749687, + 0.0, + 0.5639809519052505, + 0.2840592507272959, + 0.10903721675276756, + 0.2007831297814846, + 0.041312240064144135, + 2.0368549153208733, + 0.7872792296111584, + 0.4256640896201134, + 0.0, + 0.45363943465054035, + 0.029210278764367104, + 0.391050111502409, + 0.3190966881811619, + 1.5552967824041843, + 0.4456573873758316, + 0.2916592061519623, + 0.33489296585321426, + 0.7161283865571022 + ], + "unique_experts": 52, + "load_cv": 1.03425866821019, + "normalized_load_entropy": 0.880746097041944, + "max_load_share": 0.07692307692307693 + } + }, + "s1_bos": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "129ad31254d62a6ff0c70c364944009175aa4452dc2501c2568fbe06d004ca09", + "route_weight_sha256": "a085f2eef5e561dcfcc1fec70bb07d9c09644eaac063d3d6260dfc140c002f87", + "loads": [ + 3, + 0, + 0, + 1, + 2, + 7, + 1, + 10, + 3, + 1, + 0, + 0, + 0, + 0, + 2, + 0, + 4, + 2, + 3, + 2, + 0, + 2, + 2, + 1, + 1, + 3, + 0, + 9, + 1, + 0, + 2, + 7, + 0, + 0, + 8, + 0, + 1, + 1, + 1, + 5, + 0, + 1, + 4, + 0, + 1, + 0, + 5, + 4, + 2, + 1, + 0, + 15, + 0, + 0, + 0, + 2, + 1, + 3, + 4, + 11, + 4, + 2, + 7, + 10 + ], + "weighted_loads": [ + 0.32279855757951736, + 0.0, + 0.0, + 0.031603313982486725, + 0.13014214113354683, + 0.26048521138727665, + 0.05997006222605705, + 1.5729743093252182, + 0.15381711721420288, + 0.03755052015185356, + 0.0, + 0.0, + 0.0, + 0.0, + 0.15723931416869164, + 0.0, + 0.2732876017689705, + 0.11421005055308342, + 0.19431854039430618, + 0.1548002026975155, + 0.0, + 0.11281048879027367, + 0.07072434015572071, + 0.052324868738651276, + 0.041557297110557556, + 0.13052086904644966, + 0.0, + 0.6594636328518391, + 0.11175062507390976, + 0.0, + 0.10111526027321815, + 0.9589502587914467, + 0.0, + 0.0, + 0.6548611745238304, + 0.0, + 0.028114359825849533, + 0.06953057646751404, + 0.04359316825866699, + 0.3297855257987976, + 0.0, + 0.048626963049173355, + 0.4476688504219055, + 0.0, + 0.02462300844490528, + 0.0, + 0.2049977369606495, + 0.20713014528155327, + 0.06824648939073086, + 0.11107580363750458, + 0.0, + 1.460618745535612, + 0.0, + 0.0, + 0.0, + 0.052664611488580704, + 0.03002232126891613, + 0.37471333891153336, + 0.27302297949790955, + 0.984276931732893, + 0.43498875200748444, + 0.25817880034446716, + 0.36423899605870247, + 0.6327562779188156 + ], + "unique_experts": 44, + "load_cv": 1.2647544105261237, + "normalized_load_entropy": 0.8307433487598174, + "max_load_share": 0.09259259259259259 + }, + "full_input": { + "tokens": 68, + "top_k": 6, + "decisions": 408, + "ordered_route_sha256": "88cb287c87fb2d8292a167b58d552539e3bd2d9fa28b027dcd796cb57ab0b61a", + "route_weight_sha256": "1ddebfd6e56fd184f626342fb7315fa4a3e713712e89fde90fc180ee0816489b", + "loads": [ + 14, + 1, + 0, + 4, + 5, + 23, + 1, + 13, + 5, + 13, + 0, + 3, + 5, + 0, + 2, + 5, + 4, + 2, + 10, + 6, + 2, + 5, + 2, + 10, + 7, + 5, + 5, + 16, + 15, + 1, + 7, + 10, + 2, + 11, + 9, + 1, + 1, + 4, + 4, + 6, + 0, + 1, + 5, + 1, + 2, + 1, + 11, + 7, + 4, + 2, + 13, + 20, + 9, + 9, + 2, + 5, + 2, + 6, + 5, + 31, + 7, + 3, + 9, + 14 + ], + "weighted_loads": [ + 1.2606802117079496, + 0.051600608974695206, + 0.0, + 0.1672961376607418, + 0.34022434800863266, + 1.3965209927409887, + 0.05997006222605705, + 1.7003239020705223, + 0.32137630879879, + 0.901595264673233, + 0.0, + 0.21797355636954308, + 0.3497659005224705, + 0.0, + 0.15723931416869164, + 0.23567726090550423, + 0.2732876017689705, + 0.11421005055308342, + 0.5961170420050621, + 0.3562766667455435, + 0.22868893668055534, + 0.21631224639713764, + 0.07072434015572071, + 0.4328982289880514, + 0.3208247274160385, + 0.2039299886673689, + 0.3532266169786453, + 1.0049073528498411, + 1.9578361734747887, + 0.047890618443489075, + 0.3783009983599186, + 1.0942548289895058, + 0.07938499003648758, + 1.1876684203743935, + 0.7016304768621922, + 0.07854100316762924, + 0.028114359825849533, + 0.4283604100346565, + 0.29307055473327637, + 0.3881322555243969, + 0.0, + 0.048626963049173355, + 0.5013107694685459, + 0.046553753316402435, + 0.05419757403433323, + 0.036991316825151443, + 0.5884919706732035, + 0.3124822750687599, + 0.19632947258651257, + 0.14497338980436325, + 0.8512790240347385, + 1.9550534971058369, + 0.8384094722568989, + 0.6912472732365131, + 0.08266397193074226, + 0.4315336160361767, + 0.08276870660483837, + 0.5082304701209068, + 0.3819045126438141, + 2.1256391033530235, + 0.6902639456093311, + 0.3000689260661602, + 0.466339398175478, + 0.8114594034850597 + ], + "unique_experts": 60, + "load_cv": 0.9261463277348662, + "normalized_load_entropy": 0.9077362909183914, + "max_load_share": 0.07598039215686274 + } + }, + "s0_x": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "ea3f3ea4b6d9afbe8029bd1916c0e129f6a766f8541b7964b46898d6fb9bfaad", + "route_weight_sha256": "a23a188758a69ad4f0d513d4c7fa4df39e80e66562a3a8ac3abb38387acdcd9a", + "loads": [ + 3, + 0, + 0, + 2, + 2, + 7, + 1, + 11, + 3, + 1, + 0, + 0, + 0, + 0, + 2, + 2, + 3, + 1, + 3, + 2, + 0, + 2, + 1, + 1, + 1, + 2, + 0, + 7, + 1, + 0, + 2, + 7, + 0, + 0, + 8, + 0, + 1, + 1, + 1, + 6, + 0, + 1, + 4, + 0, + 1, + 0, + 4, + 3, + 2, + 2, + 0, + 15, + 1, + 0, + 0, + 2, + 1, + 3, + 4, + 11, + 4, + 3, + 6, + 11 + ], + "weighted_loads": [ + 0.2800697349011898, + 0.0, + 0.0, + 0.06519598886370659, + 0.12892412766814232, + 0.3242644891142845, + 0.055513445287942886, + 1.6427660267800093, + 0.15728629752993584, + 0.0428691990673542, + 0.0, + 0.0, + 0.0, + 0.0, + 0.16908257082104683, + 0.06758008152246475, + 0.2537121046334505, + 0.08311806619167328, + 0.19451598078012466, + 0.12282681837677956, + 0.0, + 0.09844290092587471, + 0.0256776325404644, + 0.05379006266593933, + 0.045127734541893005, + 0.10469453781843185, + 0.0, + 0.5743658430874348, + 0.11241618543863297, + 0.0, + 0.09999202564358711, + 0.9786992035806179, + 0.0, + 0.0, + 0.6423590742051601, + 0.0, + 0.025093168020248413, + 0.0654703676700592, + 0.038277506828308105, + 0.3357705697417259, + 0.0, + 0.05555782839655876, + 0.44546622410416603, + 0.0, + 0.025472242385149002, + 0.0, + 0.16265624947845936, + 0.16893387958407402, + 0.07807514443993568, + 0.15491721034049988, + 0.0, + 1.4963386207818985, + 0.032835453748703, + 0.0, + 0.0, + 0.053366782143712044, + 0.031470488756895065, + 0.3707316517829895, + 0.2792442589998245, + 0.9807302914559841, + 0.45140525698661804, + 0.2880741357803345, + 0.32900485023856163, + 0.6612833775579929 + ], + "unique_experts": 46, + "load_cv": 1.255076568381843, + "normalized_load_entropy": 0.8385111957110521, + "max_load_share": 0.09259259259259259 + }, + "full_input": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "e1cfb197e28c28797d98afe17c8c832dd8a993af53d9646cf963e8f3341cf25a", + "route_weight_sha256": "f2f55e84a090cf0f328c3e91ef7c97ea5ae1b724c89c0a728ac3831d88ab6145", + "loads": [ + 12, + 0, + 0, + 3, + 2, + 19, + 1, + 12, + 3, + 9, + 2, + 3, + 0, + 1, + 2, + 5, + 3, + 1, + 6, + 4, + 0, + 2, + 1, + 11, + 3, + 4, + 7, + 11, + 9, + 0, + 5, + 11, + 0, + 7, + 8, + 0, + 2, + 4, + 3, + 6, + 0, + 1, + 5, + 1, + 3, + 0, + 10, + 5, + 2, + 3, + 2, + 19, + 8, + 7, + 0, + 6, + 1, + 4, + 4, + 24, + 4, + 3, + 6, + 12 + ], + "weighted_loads": [ + 1.1366236060857773, + 0.0, + 0.0, + 0.10500024631619453, + 0.12892412766814232, + 1.3809384517371655, + 0.055513445287942886, + 1.67632189206779, + 0.15728629752993584, + 0.5260676704347134, + 0.06733614578843117, + 0.19310494139790535, + 0.0, + 0.060780107975006104, + 0.16908257082104683, + 0.20089013129472733, + 0.2537121046334505, + 0.08311806619167328, + 0.35641179233789444, + 0.2372332327067852, + 0.0, + 0.09844290092587471, + 0.0256776325404644, + 0.4938258696347475, + 0.10860525071620941, + 0.1771874763071537, + 0.45894376188516617, + 0.9081136099994183, + 1.1010880842804909, + 0.0, + 0.32462989166378975, + 1.1738986745476723, + 0.0, + 0.708694588392973, + 0.6423590742051601, + 0.0, + 0.07710746303200722, + 0.22384575381875038, + 0.20675982534885406, + 0.3357705697417259, + 0.0, + 0.05555782839655876, + 0.4924754537642002, + 0.04807879403233528, + 0.08714945241808891, + 0.0, + 0.5167327038943768, + 0.2548591699451208, + 0.07807514443993568, + 0.1984337829053402, + 0.08504211902618408, + 1.935212817043066, + 0.8180459141731262, + 0.5108806490898132, + 0.0, + 0.4126160088926554, + 0.031470488756895065, + 0.4109005816280842, + 0.2792442589998245, + 1.5644319728016853, + 0.45140525698661804, + 0.2880741357803345, + 0.32900485023856163, + 0.7229536846280098 + ], + "unique_experts": 54, + "load_cv": 1.0143610484539733, + "normalized_load_entropy": 0.8866780018927853, + "max_load_share": 0.07692307692307693 + } + }, + "s1_x": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "1fd889e5a101256dd23d3691730b266043ec823f96476fed09d6fb5424edd525", + "route_weight_sha256": "33cc4152393373432e1961bd401ccf98a5e8ba665427116713f995609ef398f4", + "loads": [ + 2, + 0, + 0, + 1, + 2, + 8, + 1, + 12, + 3, + 2, + 0, + 0, + 0, + 0, + 1, + 0, + 3, + 2, + 4, + 2, + 0, + 2, + 0, + 1, + 1, + 3, + 0, + 9, + 1, + 0, + 2, + 9, + 0, + 0, + 8, + 0, + 1, + 1, + 1, + 5, + 1, + 1, + 4, + 0, + 1, + 0, + 4, + 3, + 1, + 2, + 0, + 15, + 0, + 0, + 0, + 1, + 1, + 3, + 3, + 12, + 4, + 2, + 6, + 11 + ], + "weighted_loads": [ + 0.07842372357845306, + 0.0, + 0.0, + 0.030948050320148468, + 0.13145039603114128, + 0.35490531101822853, + 0.05590040609240532, + 1.6279682833701372, + 0.14562499150633812, + 0.0867147147655487, + 0.0, + 0.0, + 0.0, + 0.0, + 0.13307835161685944, + 0.0, + 0.24541907012462616, + 0.11547700315713882, + 0.22388207353651524, + 0.0761999785900116, + 0.0, + 0.10255063325166702, + 0.0, + 0.05295475199818611, + 0.04133164882659912, + 0.1482766978442669, + 0.0, + 0.6761351190507412, + 0.111129529774189, + 0.0, + 0.1023968979716301, + 1.0360118746757507, + 0.0, + 0.0, + 0.6397109404206276, + 0.0, + 0.030255895107984543, + 0.06661105901002884, + 0.04464680701494217, + 0.29913995414972305, + 0.04758401960134506, + 0.05395923927426338, + 0.5207035019993782, + 0.0, + 0.026337316259741783, + 0.0, + 0.15372031927108765, + 0.15385183319449425, + 0.037658657878637314, + 0.14600852131843567, + 0.0, + 1.494084756821394, + 0.0, + 0.0, + 0.0, + 0.028494590893387794, + 0.03270682319998741, + 0.39074792712926865, + 0.23712211474776268, + 1.0345624424517155, + 0.44363346695899963, + 0.2660936191678047, + 0.3241933174431324, + 0.6492968965321779 + ], + "unique_experts": 44, + "load_cv": 1.346924330336976, + "normalized_load_entropy": 0.8185721226267051, + "max_load_share": 0.09259259259259259 + }, + "full_input": { + "tokens": 68, + "top_k": 6, + "decisions": 408, + "ordered_route_sha256": "b26889fc4017c473cb72ff58bc2dcd14e85374dcc21ab915c69e3632a93d4a68", + "route_weight_sha256": "36b0bd03d7443599230f266eb06c30a617e5dfcd3c104662557333c6b812b4c9", + "loads": [ + 13, + 1, + 0, + 3, + 5, + 28, + 1, + 15, + 5, + 12, + 0, + 4, + 5, + 0, + 1, + 3, + 3, + 2, + 10, + 6, + 2, + 5, + 0, + 11, + 7, + 6, + 6, + 16, + 13, + 1, + 8, + 11, + 2, + 11, + 9, + 1, + 2, + 5, + 4, + 6, + 1, + 1, + 6, + 1, + 2, + 0, + 9, + 5, + 3, + 3, + 13, + 18, + 8, + 10, + 2, + 4, + 2, + 5, + 4, + 35, + 7, + 3, + 8, + 15 + ], + "weighted_loads": [ + 1.0325433779507875, + 0.051600608974695206, + 0.0, + 0.10604555532336235, + 0.3415326029062271, + 1.7815649472177029, + 0.05590040609240532, + 1.7553178761154413, + 0.3131841830909252, + 0.8043131045997143, + 0.0, + 0.26443951576948166, + 0.3497659005224705, + 0.0, + 0.13307835161685944, + 0.14413859695196152, + 0.24541907012462616, + 0.11547700315713882, + 0.5787521954625845, + 0.2776764426380396, + 0.22868893668055534, + 0.206052390858531, + 0.0, + 0.48602707870304585, + 0.3205990791320801, + 0.25999665819108486, + 0.45639870315790176, + 0.972671115770936, + 1.497480683028698, + 0.047890618443489075, + 0.40937019139528275, + 1.1120836697518826, + 0.07938499003648758, + 1.1803744211792946, + 0.6864802427589893, + 0.07854100316762924, + 0.06725995987653732, + 0.5177849754691124, + 0.25292496383190155, + 0.35748668387532234, + 0.04758401960134506, + 0.05395923927426338, + 0.622890017926693, + 0.046553753316402435, + 0.05591188184916973, + 0.0, + 0.4585674647241831, + 0.22257037088274956, + 0.16574164107441902, + 0.17990610748529434, + 0.8548935800790787, + 1.931794948875904, + 0.7967204190790653, + 0.8119218610227108, + 0.08266397193074226, + 0.3116711061447859, + 0.08545320853590965, + 0.47846701368689537, + 0.3460036478936672, + 2.267393436282873, + 0.6989086605608463, + 0.30798374488949776, + 0.4262937195599079, + 0.8184858504682779 + ], + "unique_experts": 59, + "load_cv": 1.0023041505201613, + "normalized_load_entropy": 0.8980022555555925, + "max_load_share": 0.0857843137254902 + } + }, + "s0_period": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "ad02fe45f778784c7a327dc43b3696287b5bce5d4ee062874ec002e854a2fadf", + "route_weight_sha256": "112289129d61a6855b54b803c9f9731efc5ca42622ebb814d78f0333638a6817", + "loads": [ + 3, + 0, + 0, + 2, + 2, + 7, + 1, + 11, + 3, + 1, + 0, + 0, + 0, + 0, + 2, + 2, + 3, + 2, + 3, + 2, + 0, + 2, + 1, + 1, + 1, + 2, + 0, + 6, + 1, + 0, + 2, + 7, + 0, + 0, + 8, + 0, + 1, + 1, + 1, + 6, + 0, + 1, + 4, + 0, + 1, + 0, + 4, + 3, + 2, + 2, + 0, + 15, + 1, + 0, + 0, + 2, + 1, + 3, + 4, + 11, + 4, + 3, + 6, + 11 + ], + "weighted_loads": [ + 0.2829032652080059, + 0.0, + 0.0, + 0.0703602023422718, + 0.13134291768074036, + 0.3077818714082241, + 0.05531339347362518, + 1.6303472127765417, + 0.16234933212399483, + 0.042785998433828354, + 0.0, + 0.0, + 0.0, + 0.0, + 0.1655462123453617, + 0.0696827732026577, + 0.2519523501396179, + 0.11562326923012733, + 0.1878751665353775, + 0.12972164899110794, + 0.0, + 0.10631370544433594, + 0.025052618235349655, + 0.05318957567214966, + 0.0447072871029377, + 0.10913337394595146, + 0.0, + 0.5375140346586704, + 0.11320223659276962, + 0.0, + 0.10141892358660698, + 0.9878670126199722, + 0.0, + 0.0, + 0.6724182069301605, + 0.0, + 0.02561124600470066, + 0.06291718035936356, + 0.0382266603410244, + 0.3407566398382187, + 0.0, + 0.051969077438116074, + 0.437035970389843, + 0.0, + 0.025214258581399918, + 0.0, + 0.16560117714107037, + 0.17095740139484406, + 0.07880813628435135, + 0.15431977808475494, + 0.0, + 1.487937219440937, + 0.03238006681203842, + 0.0, + 0.0, + 0.05471160262823105, + 0.03122529946267605, + 0.35446395725011826, + 0.2796328440308571, + 0.961728896945715, + 0.4691573306918144, + 0.2890648655593395, + 0.3234528973698616, + 0.6418037880212069 + ], + "unique_experts": 46, + "load_cv": 1.2453235186316058, + "normalized_load_entropy": 0.8407146004950813, + "max_load_share": 0.09259259259259259 + }, + "full_input": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "2792a407ab741e93dae9e0b8cedd21fca923ed5751c724661cc854423bf2693a", + "route_weight_sha256": "e1ed1e3df42d6bfc5f1b603943c8fdd1ed545128fb1aa7cb4cadaffdb1726f80", + "loads": [ + 12, + 0, + 0, + 4, + 2, + 18, + 1, + 12, + 3, + 9, + 2, + 3, + 0, + 1, + 2, + 5, + 3, + 2, + 6, + 3, + 0, + 2, + 1, + 11, + 3, + 4, + 7, + 11, + 9, + 0, + 5, + 10, + 0, + 7, + 8, + 0, + 2, + 4, + 3, + 6, + 0, + 1, + 4, + 1, + 4, + 0, + 9, + 6, + 2, + 4, + 3, + 19, + 8, + 7, + 0, + 6, + 1, + 4, + 4, + 23, + 4, + 3, + 6, + 12 + ], + "weighted_loads": [ + 1.0863055177032948, + 0.0, + 0.0, + 0.14601637050509453, + 0.13134291768074036, + 1.2980690896511078, + 0.05531339347362518, + 1.6639030780643225, + 0.16234933212399483, + 0.5612489841878414, + 0.06733614578843117, + 0.19310494139790535, + 0.0, + 0.051121786236763, + 0.1655462123453617, + 0.2072044536471367, + 0.2519523501396179, + 0.11562326923012733, + 0.35977841913700104, + 0.16963312029838562, + 0.0, + 0.10631370544433594, + 0.025052618235349655, + 0.49322538264095783, + 0.11692981794476509, + 0.18408573418855667, + 0.4028276354074478, + 0.9143850617110729, + 1.1865890063345432, + 0.0, + 0.3347115255892277, + 1.1322517953813076, + 0.0, + 0.6961329355835915, + 0.6724182069301605, + 0.0, + 0.07762554101645947, + 0.19929975271224976, + 0.19939524307847023, + 0.3407566398382187, + 0.0, + 0.051969077438116074, + 0.437035970389843, + 0.04807879403233528, + 0.13125399872660637, + 0.0, + 0.46970580145716667, + 0.3189887348562479, + 0.07880813628435135, + 0.24426867812871933, + 0.13685235381126404, + 1.9252516888082027, + 0.8180959671735764, + 0.5075012370944023, + 0.0, + 0.5095582529902458, + 0.03122529946267605, + 0.3952172137796879, + 0.2796328440308571, + 1.4863558635115623, + 0.4691573306918144, + 0.2890648655593395, + 0.3234528973698616, + 0.7039871718734503 + ], + "unique_experts": 54, + "load_cv": 0.9814184209745969, + "normalized_load_entropy": 0.8918264869334919, + "max_load_share": 0.07371794871794872 + } + }, + "s1_period": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "9653bdcf90fe2dec950d7ec3afb8d35a4efa60564897b3f70e1c3036db03a47e", + "route_weight_sha256": "996b239793bce52c04d43399ab92307892b78cc7f5832f7af5fd8e73aa662b31", + "loads": [ + 2, + 0, + 0, + 1, + 2, + 6, + 1, + 12, + 3, + 2, + 0, + 0, + 0, + 0, + 1, + 1, + 3, + 2, + 4, + 2, + 0, + 2, + 0, + 1, + 1, + 3, + 0, + 9, + 1, + 0, + 2, + 9, + 0, + 0, + 8, + 0, + 1, + 1, + 1, + 6, + 1, + 1, + 4, + 0, + 1, + 0, + 4, + 3, + 1, + 2, + 0, + 15, + 0, + 0, + 0, + 1, + 1, + 3, + 3, + 11, + 4, + 3, + 6, + 11 + ], + "weighted_loads": [ + 0.07638038322329521, + 0.0, + 0.0, + 0.031013529747724533, + 0.13102545216679573, + 0.29664861783385277, + 0.05691241845488548, + 1.6539996266365051, + 0.1445257104933262, + 0.09436371549963951, + 0.0, + 0.0, + 0.0, + 0.0, + 0.1328946202993393, + 0.03302311897277832, + 0.23899761587381363, + 0.11971226334571838, + 0.22706700302660465, + 0.07557269930839539, + 0.0, + 0.11094927787780762, + 0.0, + 0.054694510996341705, + 0.042447127401828766, + 0.1631457880139351, + 0.0, + 0.663584515452385, + 0.11312492936849594, + 0.0, + 0.1045823022723198, + 1.0392247885465622, + 0.0, + 0.0, + 0.6790493205189705, + 0.0, + 0.029189351946115494, + 0.06608428806066513, + 0.046349141746759415, + 0.34242838993668556, + 0.04590923339128494, + 0.05311800166964531, + 0.5315687470138073, + 0.0, + 0.025823527947068214, + 0.0, + 0.14004358276724815, + 0.15260304883122444, + 0.03882993757724762, + 0.14792008697986603, + 0.0, + 1.4637416265904903, + 0.0, + 0.0, + 0.0, + 0.026633575558662415, + 0.032224010676145554, + 0.3848492503166199, + 0.24439026787877083, + 0.9686359837651253, + 0.4612763896584511, + 0.29380667954683304, + 0.3139909952878952, + 0.669311560690403 + ], + "unique_experts": 45, + "load_cv": 1.315785302298075, + "normalized_load_entropy": 0.8255690415230662, + "max_load_share": 0.09259259259259259 + }, + "full_input": { + "tokens": 68, + "top_k": 6, + "decisions": 408, + "ordered_route_sha256": "75b93abfd1513872446152104d5758148b8a7f8ee3173e5152d1a72dd1836b20", + "route_weight_sha256": "0b354a79bc08ea1b036a6e960e93bd2d1f434207e2ea2d063735010015d55898", + "loads": [ + 14, + 1, + 0, + 2, + 5, + 23, + 1, + 16, + 5, + 14, + 0, + 3, + 5, + 0, + 1, + 6, + 3, + 2, + 10, + 6, + 2, + 5, + 0, + 10, + 9, + 5, + 6, + 15, + 14, + 1, + 8, + 12, + 2, + 11, + 9, + 1, + 2, + 5, + 4, + 7, + 1, + 1, + 5, + 1, + 2, + 0, + 9, + 6, + 3, + 4, + 13, + 18, + 8, + 10, + 2, + 4, + 2, + 5, + 4, + 31, + 7, + 4, + 8, + 15 + ], + "weighted_loads": [ + 1.03583905659616, + 0.051600608974695206, + 0.0, + 0.07062400877475739, + 0.34110765904188156, + 1.4937633611261845, + 0.05691241845488548, + 1.8156753592193127, + 0.3120849020779133, + 0.9137259982526302, + 0.0, + 0.21797355636954308, + 0.3497659005224705, + 0.0, + 0.1328946202993393, + 0.24273234233260155, + 0.23899761587381363, + 0.11971226334571838, + 0.5963047314435244, + 0.2770491633564234, + 0.22868893668055534, + 0.2144510354846716, + 0.0, + 0.43526787124574184, + 0.42290566861629486, + 0.23655490763485432, + 0.39507943391799927, + 0.9136256445199251, + 1.4958076067268848, + 0.047890618443489075, + 0.412512369453907, + 1.148949671536684, + 0.07938499003648758, + 1.1760940216481686, + 0.7258186228573322, + 0.07854100316762924, + 0.06453454494476318, + 0.5162585973739624, + 0.248018030077219, + 0.40077511966228485, + 0.04590923339128494, + 0.05311800166964531, + 0.5852106660604477, + 0.046553753316402435, + 0.05539809353649616, + 0.0, + 0.44777565263211727, + 0.26194803044199944, + 0.16691292077302933, + 0.22338593751192093, + 0.863766685128212, + 1.904976986348629, + 0.7967204190790653, + 0.7721375562250614, + 0.08266397193074226, + 0.4157564863562584, + 0.0849703960120678, + 0.47373560443520546, + 0.35327180102467537, + 2.083987817168236, + 0.7165515832602978, + 0.3356968052685261, + 0.4160913974046707, + 0.8408494405448437 + ], + "unique_experts": 59, + "load_cv": 0.9331767870031996, + "normalized_load_entropy": 0.9042665714988842, + "max_load_share": 0.07598039215686274 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 27, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.9153439153439153, + "mean_token_weighted_tv": 0.018933909910696524, + "aggregate_load_tv": 0.043209876543209874 + }, + "system_bos": { + "tokens": 27, + "ordered_topk_exact_tokens": 16, + "set_exact_tokens": 18, + "mean_set_jaccard": 0.9047619047619049, + "mean_token_weighted_tv": 0.02281330332711891, + "aggregate_load_tv": 0.043209876543209874 + }, + "system_x": { + "tokens": 27, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.8539682539682539, + "mean_token_weighted_tv": 0.03813313820433838, + "aggregate_load_tv": 0.07407407407407407 + }, + "system_period": { + "tokens": 27, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.8694885361552027, + "mean_token_weighted_tv": 0.03745826840814617, + "aggregate_load_tv": 0.06172839506172839 + }, + "bos_at_s0": { + "tokens": 27, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 21, + "mean_set_jaccard": 0.9365079365079365, + "mean_token_weighted_tv": 0.020428799541184196, + "aggregate_load_tv": 0.037037037037037035 + }, + "bos_at_s1": { + "tokens": 27, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.9074074074074074, + "mean_token_weighted_tv": 0.025863452883506263, + "aggregate_load_tv": 0.043209876543209874 + }, + "x_at_s0": { + "tokens": 27, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 20, + "mean_set_jaccard": 0.9259259259259259, + "mean_token_weighted_tv": 0.025412285148545547, + "aggregate_load_tv": 0.037037037037037035 + }, + "x_at_s1": { + "tokens": 27, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.8566137566137565, + "mean_token_weighted_tv": 0.049286932615494286, + "aggregate_load_tv": 0.08641975308641975 + }, + "period_at_s0": { + "tokens": 27, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.9153439153439153, + "mean_token_weighted_tv": 0.028051389829704055, + "aggregate_load_tv": 0.043209876543209874 + }, + "period_at_s1": { + "tokens": 27, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.8566137566137565, + "mean_token_weighted_tv": 0.05204598467659067, + "aggregate_load_tv": 0.08024691358024691 + } + } + }, + "layer_15": { + "layer": 15, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "46ffb079eccade62695fef423beeaecad0370692431809718642c3838253d3c5", + "route_weight_sha256": "bd8d711b3f4420715f17d3e8b6e23952cb0cae1893fbde343cc406396f5dabf7", + "loads": [ + 3, + 1, + 0, + 12, + 6, + 9, + 1, + 3, + 6, + 0, + 1, + 3, + 5, + 0, + 5, + 0, + 0, + 1, + 0, + 2, + 0, + 1, + 7, + 4, + 10, + 0, + 1, + 0, + 3, + 0, + 2, + 5, + 2, + 3, + 2, + 0, + 7, + 2, + 4, + 2, + 4, + 5, + 0, + 1, + 2, + 0, + 2, + 1, + 2, + 3, + 3, + 1, + 6, + 4, + 0, + 11, + 3, + 0, + 0, + 1, + 0, + 0, + 0, + 0 + ], + "weighted_loads": [ + 0.10115030407905579, + 0.23835167288780212, + 0.0, + 0.595636697486043, + 0.3829314596951008, + 0.5462406612932682, + 0.0364820696413517, + 0.12910491600632668, + 0.296245738863945, + 0.0, + 0.19093948602676392, + 0.10379289463162422, + 0.4311870448291302, + 0.0, + 0.7157319225370884, + 0.0, + 0.0, + 0.14067214727401733, + 0.0, + 0.07424949109554291, + 0.0, + 0.04395003989338875, + 0.6332061365246773, + 0.1830819882452488, + 0.5146104153245687, + 0.0, + 0.04550439491868019, + 0.0, + 0.24599146470427513, + 0.0, + 0.14780882000923157, + 0.4491920843720436, + 0.07736299932003021, + 0.24213546887040138, + 0.1086164154112339, + 0.0, + 0.46278361417353153, + 0.10959156602621078, + 0.21690843254327774, + 0.24314730614423752, + 0.3261282593011856, + 0.395281657576561, + 0.0, + 0.06900309771299362, + 0.058398932218551636, + 0.0, + 0.11100922897458076, + 0.025014271959662437, + 0.08071256056427956, + 0.14535032957792282, + 0.12224292010068893, + 0.04866359010338783, + 0.19613425247371197, + 0.18455352261662483, + 0.0, + 2.6252340227365494, + 0.27009954303503036, + 0.0, + 0.0, + 0.03958742320537567, + 0.0, + 0.0, + 0.0, + 0.0 + ], + "unique_experts": 44, + "load_cv": 1.1303546212948572, + "normalized_load_entropy": 0.8497158856532391, + "max_load_share": 0.07407407407407407 + }, + "full_input": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "c670e2b1915a10950cd075619179c566548c68fae2e3fb84570ad261dbfb9e8d", + "route_weight_sha256": "2e2c3f6001af4c68defe8aa5ee2ce815642dbaf129f76dc00dae3947835bf963", + "loads": [ + 7, + 1, + 0, + 12, + 14, + 12, + 9, + 5, + 11, + 1, + 6, + 4, + 9, + 0, + 15, + 1, + 7, + 3, + 0, + 4, + 0, + 1, + 7, + 9, + 14, + 2, + 10, + 0, + 6, + 0, + 6, + 5, + 7, + 5, + 2, + 0, + 12, + 2, + 5, + 2, + 10, + 6, + 0, + 3, + 2, + 0, + 2, + 3, + 3, + 13, + 9, + 3, + 12, + 4, + 0, + 15, + 3, + 0, + 1, + 1, + 0, + 2, + 0, + 4 + ], + "weighted_loads": [ + 0.4080538637936115, + 0.23835167288780212, + 0.0, + 0.595636697486043, + 0.7944890949875116, + 0.6241860380396247, + 0.5808163844048977, + 0.19542843475937843, + 0.645616389811039, + 0.031530942767858505, + 0.3795307595282793, + 0.1339903026819229, + 0.7365069463849068, + 0.0, + 1.0911907134577632, + 0.031232573091983795, + 0.6264123320579529, + 0.21419864892959595, + 0.0, + 0.18303026631474495, + 0.0, + 0.04395003989338875, + 0.6332061365246773, + 0.4547906219959259, + 0.6205638397950679, + 0.06494546122848988, + 0.6774336211383343, + 0.0, + 0.35844820737838745, + 0.0, + 0.32173274271190166, + 0.4491920843720436, + 0.47786813601851463, + 0.33477526530623436, + 0.1086164154112339, + 0.0, + 1.1633922616019845, + 0.10959156602621078, + 0.2638590633869171, + 0.24314730614423752, + 1.0057165268808603, + 0.3995165661908686, + 0.0, + 0.1556185930967331, + 0.058398932218551636, + 0.0, + 0.11100922897458076, + 0.08290589600801468, + 0.09421166405081749, + 1.973183710128069, + 0.42432396672666073, + 0.13357599079608917, + 0.3760958546772599, + 0.18455352261662483, + 0.0, + 4.294432371854782, + 0.27009954303503036, + 0.0, + 0.05131320655345917, + 0.03958742320537567, + 0.0, + 0.07761716842651367, + 0.0, + 0.17433407716453075 + ], + "unique_experts": 51, + "load_cv": 0.9255664434758998, + "normalized_load_entropy": 0.8871935821198579, + "max_load_share": 0.04807692307692308 + } + }, + "s1_eos": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "a0bce6c6a8b4266b8452b1a85808c9d3a2e56ad58d658dcdc91068b53d3416af", + "route_weight_sha256": "8807a9c11696ea144760df535957151ddc3f2c6b74eb9f6d9f713096001bb9c4", + "loads": [ + 3, + 1, + 0, + 11, + 6, + 9, + 0, + 3, + 7, + 0, + 1, + 3, + 5, + 0, + 6, + 0, + 0, + 1, + 0, + 3, + 0, + 1, + 7, + 3, + 10, + 0, + 1, + 0, + 3, + 0, + 2, + 6, + 2, + 3, + 2, + 0, + 7, + 2, + 4, + 2, + 4, + 5, + 0, + 1, + 1, + 0, + 2, + 1, + 2, + 3, + 3, + 1, + 6, + 3, + 0, + 11, + 3, + 0, + 0, + 1, + 0, + 1, + 0, + 0 + ], + "weighted_loads": [ + 0.10775032453238964, + 0.2379845827817917, + 0.0, + 0.5447190254926682, + 0.37803665921092033, + 0.5389341376721859, + 0.0, + 0.1295795552432537, + 0.35360949859023094, + 0.0, + 0.192173033952713, + 0.10378768481314182, + 0.43002424761652946, + 0.0, + 0.7282880246639252, + 0.0, + 0.0, + 0.14048665761947632, + 0.0, + 0.11440866068005562, + 0.0, + 0.04315062239766121, + 0.6486232355237007, + 0.13675540685653687, + 0.5176566112786531, + 0.0, + 0.04542003571987152, + 0.0, + 0.23033380880951881, + 0.0, + 0.14664636366069317, + 0.4828060418367386, + 0.07673945277929306, + 0.22598068788647652, + 0.10914506018161774, + 0.0, + 0.45786667987704277, + 0.1080641895532608, + 0.21214893087744713, + 0.23565634340047836, + 0.3307380639016628, + 0.3871633354574442, + 0.0, + 0.07021377980709076, + 0.030166659504175186, + 0.0, + 0.11267836019396782, + 0.025961045175790787, + 0.08046772330999374, + 0.15173036977648735, + 0.11655039712786674, + 0.049977581948041916, + 0.19866990856826305, + 0.157975472509861, + 0.0, + 2.6358404122292995, + 0.26267387717962265, + 0.0, + 0.0, + 0.03706712648272514, + 0.0, + 0.03536122292280197, + 0.0, + 0.0 + ], + "unique_experts": 44, + "load_cv": 1.1303546212948572, + "normalized_load_entropy": 0.8484393025125978, + "max_load_share": 0.06790123456790123 + }, + "full_input": { + "tokens": 68, + "top_k": 6, + "decisions": 408, + "ordered_route_sha256": "1f32c90c30d0e36800931d992d4082e8608ba6b4a85cde0f59237138ac229bca", + "route_weight_sha256": "1005a3d161d1f73f153bba7062936163db9bdbb6f1ed3b82876ef62bb4b7ab01", + "loads": [ + 23, + 2, + 0, + 11, + 16, + 14, + 14, + 4, + 16, + 1, + 6, + 7, + 10, + 1, + 12, + 9, + 12, + 5, + 1, + 7, + 1, + 2, + 7, + 8, + 13, + 2, + 11, + 2, + 9, + 1, + 8, + 10, + 7, + 6, + 4, + 0, + 13, + 2, + 7, + 3, + 10, + 7, + 0, + 3, + 1, + 1, + 2, + 3, + 5, + 17, + 11, + 3, + 8, + 4, + 0, + 15, + 3, + 6, + 2, + 5, + 0, + 8, + 2, + 5 + ], + "weighted_loads": [ + 1.4898446220904589, + 0.26429266668856144, + 0.0, + 0.5447190254926682, + 0.9014897681772709, + 0.7476000608876348, + 1.0393944680690765, + 0.16156365722417831, + 0.8736311681568623, + 0.03104834072291851, + 0.4193486459553242, + 0.4357636049389839, + 0.8572770543396473, + 0.08169505000114441, + 0.9314715275540948, + 0.6511056683957577, + 1.0999423414468765, + 0.294514499604702, + 0.04954567551612854, + 0.37728677317500114, + 0.02945021726191044, + 0.12378853186964989, + 0.6486232355237007, + 0.3867971785366535, + 0.5837221350520849, + 0.05922494828701019, + 0.7446717396378517, + 0.12480543926358223, + 0.6462221816182137, + 0.03702360391616821, + 0.3709175903350115, + 0.9293359331786633, + 0.4754751995205879, + 0.3565911762416363, + 0.2595970146358013, + 0.0, + 1.147529768757522, + 0.1080641895532608, + 0.3210283126682043, + 0.27171527594327927, + 0.920847054803744, + 0.48003293853253126, + 0.0, + 0.3404821641743183, + 0.030166659504175186, + 0.03750820457935333, + 0.11267836019396782, + 0.08737953379750252, + 0.22361347451806068, + 2.8424164578318596, + 0.47507091984152794, + 0.12055870518088341, + 0.24751499947160482, + 0.3064145967364311, + 0.0, + 4.27673377841711, + 0.26267387717962265, + 0.6617375761270523, + 0.08108371123671532, + 0.2066192515194416, + 0.0, + 0.40915845707058907, + 0.1152152270078659, + 0.198892742395401 + ], + "unique_experts": 59, + "load_cv": 0.8053550108985431, + "normalized_load_entropy": 0.9182320054564985, + "max_load_share": 0.056372549019607844 + } + }, + "s0_bos": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "8d1df8f07bf4e953bbb1c33fe06418b8c089e3dcee1135dc7746d80c2c51aead", + "route_weight_sha256": "e7e241b2e81827c056371ce215552ad2dcb5c943c62e9b03c28659423cdd1399", + "loads": [ + 3, + 1, + 0, + 10, + 5, + 9, + 1, + 3, + 6, + 0, + 1, + 3, + 5, + 0, + 6, + 0, + 0, + 1, + 0, + 3, + 0, + 0, + 8, + 3, + 10, + 0, + 1, + 0, + 3, + 0, + 2, + 6, + 2, + 4, + 2, + 0, + 7, + 2, + 4, + 2, + 4, + 5, + 0, + 1, + 1, + 0, + 2, + 2, + 2, + 3, + 3, + 1, + 5, + 4, + 0, + 12, + 3, + 0, + 0, + 0, + 0, + 0, + 1, + 0 + ], + "weighted_loads": [ + 0.09435289353132248, + 0.2288820594549179, + 0.0, + 0.5028906799852848, + 0.33655302226543427, + 0.5503099523484707, + 0.037601571530103683, + 0.1206248551607132, + 0.31652965024113655, + 0.0, + 0.20868894457817078, + 0.10635283403098583, + 0.42609966173768044, + 0.0, + 0.7211679182946682, + 0.0, + 0.0, + 0.1489056646823883, + 0.0, + 0.11655506491661072, + 0.0, + 0.0, + 0.68166384100914, + 0.12982215359807014, + 0.5268142204731703, + 0.0, + 0.042123157531023026, + 0.0, + 0.2481117993593216, + 0.0, + 0.15929346531629562, + 0.49354909360408783, + 0.08493876084685326, + 0.2637755982577801, + 0.121278565376997, + 0.0, + 0.4750690162181854, + 0.10989565774798393, + 0.20886709168553352, + 0.23895106092095375, + 0.32957347854971886, + 0.38288985565304756, + 0.0, + 0.06974036246538162, + 0.030463816598057747, + 0.0, + 0.11631585657596588, + 0.05773555859923363, + 0.08047987520694733, + 0.1453968584537506, + 0.11971498280763626, + 0.05945565178990364, + 0.16713647171854973, + 0.20312731713056564, + 0.0, + 2.674681082367897, + 0.2656429633498192, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0317767933011055, + 0.0 + ], + "unique_experts": 43, + "load_cv": 1.1281951358669349, + "normalized_load_entropy": 0.847381589159799, + "max_load_share": 0.07407407407407407 + }, + "full_input": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "478ec0a1843e5613d7cf424843e386a7c23f1677548d27be1e227c22b7626c97", + "route_weight_sha256": "160b1e1d4c86c5743a695d1e7f3548e7f1747a161bfeac067999d3bd281018e9", + "loads": [ + 7, + 1, + 0, + 10, + 12, + 11, + 8, + 5, + 11, + 1, + 6, + 4, + 9, + 0, + 15, + 2, + 7, + 3, + 0, + 5, + 0, + 0, + 8, + 8, + 13, + 2, + 10, + 0, + 7, + 0, + 7, + 6, + 7, + 6, + 2, + 1, + 12, + 2, + 4, + 2, + 11, + 5, + 0, + 3, + 1, + 0, + 2, + 4, + 3, + 12, + 10, + 4, + 11, + 5, + 2, + 14, + 3, + 0, + 1, + 0, + 0, + 2, + 1, + 4 + ], + "weighted_loads": [ + 0.4033934511244297, + 0.2288820594549179, + 0.0, + 0.5028906799852848, + 0.6955644749104977, + 0.6214169058948755, + 0.4603336751461029, + 0.18694837391376495, + 0.6840742453932762, + 0.031530942767858505, + 0.39728021807968616, + 0.13655024208128452, + 0.7371731773018837, + 0.0, + 1.0866157598793507, + 0.06934414431452751, + 0.6154212281107903, + 0.22243216633796692, + 0.0, + 0.22533584013581276, + 0.0, + 0.0, + 0.68166384100914, + 0.40153078734874725, + 0.6441011503338814, + 0.07028803043067455, + 0.6740523837506771, + 0.0, + 0.42898445948958397, + 0.0, + 0.3878911044448614, + 0.49354909360408783, + 0.4854438975453377, + 0.35641539469361305, + 0.121278565376997, + 0.094344861805439, + 1.2143463483080268, + 0.10989565774798393, + 0.20886709168553352, + 0.23895106092095375, + 1.0007167533040047, + 0.38288985565304756, + 0.0, + 0.1563558578491211, + 0.030463816598057747, + 0.0, + 0.11631585657596588, + 0.12640299275517464, + 0.09397897869348526, + 1.5787358153611422, + 0.5014173798263073, + 0.19647076725959778, + 0.3470980739220977, + 0.26751522719860077, + 0.10187149792909622, + 3.3193299621343613, + 0.2656429633498192, + 0.0, + 0.05131320655345917, + 0.0, + 0.0, + 0.07761716842651367, + 0.0317767933011055, + 0.19020196609199047 + ], + "unique_experts": 52, + "load_cv": 0.8751819572244108, + "normalized_load_entropy": 0.8960084293852836, + "max_load_share": 0.04807692307692308 + } + }, + "s1_bos": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "a3d595e94153af9160a582fdc28a06ed708851250b395f6e61a8f8e70abda643", + "route_weight_sha256": "f53499c0adbb912401c566bd8ebca25bbc9d5c20fe16a811a04237912c661bfc", + "loads": [ + 3, + 2, + 0, + 10, + 5, + 9, + 1, + 3, + 6, + 0, + 1, + 3, + 5, + 0, + 6, + 0, + 0, + 1, + 0, + 2, + 0, + 0, + 8, + 4, + 10, + 0, + 1, + 0, + 3, + 0, + 2, + 6, + 2, + 4, + 2, + 0, + 7, + 2, + 4, + 2, + 4, + 5, + 0, + 1, + 1, + 0, + 2, + 2, + 2, + 3, + 2, + 1, + 5, + 4, + 0, + 12, + 3, + 0, + 0, + 0, + 0, + 0, + 1, + 0 + ], + "weighted_loads": [ + 0.09223856776952744, + 0.26798469573259354, + 0.0, + 0.49088918790221214, + 0.3413035571575165, + 0.5339624807238579, + 0.03762717545032501, + 0.12486476451158524, + 0.3060993142426014, + 0.0, + 0.20127707719802856, + 0.10392712242901325, + 0.41666773334145546, + 0.0, + 0.6868086792528629, + 0.0, + 0.0, + 0.14773085713386536, + 0.0, + 0.0864260382950306, + 0.0, + 0.0, + 0.688787467777729, + 0.18049069866538048, + 0.5169247705489397, + 0.0, + 0.04196857661008835, + 0.0, + 0.24253365024924278, + 0.0, + 0.17514042183756828, + 0.5157544352114201, + 0.08169759809970856, + 0.26029444113373756, + 0.1199449747800827, + 0.0, + 0.4689387418329716, + 0.10797502100467682, + 0.21050988510251045, + 0.23932363465428352, + 0.3188685029745102, + 0.3729950897395611, + 0.0, + 0.07198441028594971, + 0.030017700046300888, + 0.0, + 0.12188107147812843, + 0.05786011926829815, + 0.08066540211439133, + 0.15464992448687553, + 0.0758831612765789, + 0.055586740374565125, + 0.16634858399629593, + 0.20616227388381958, + 0.0, + 2.774544306099415, + 0.26661134511232376, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.03420157730579376, + 0.0 + ], + "unique_experts": 43, + "load_cv": 1.1281951358669349, + "normalized_load_entropy": 0.8476538756891103, + "max_load_share": 0.07407407407407407 + }, + "full_input": { + "tokens": 68, + "top_k": 6, + "decisions": 408, + "ordered_route_sha256": "8eb1bd13780f721610e798e18a9690fa30fa3a576adb18fcdc60b1016413a349", + "route_weight_sha256": "c399f650c316d6f6bf7010110e58b2a2ee427e171eab780d5741733612a1aae0", + "loads": [ + 24, + 3, + 0, + 10, + 15, + 14, + 15, + 4, + 15, + 1, + 6, + 7, + 10, + 1, + 11, + 9, + 12, + 5, + 1, + 6, + 1, + 1, + 8, + 9, + 14, + 2, + 11, + 2, + 9, + 1, + 9, + 10, + 7, + 7, + 4, + 0, + 14, + 2, + 6, + 3, + 10, + 6, + 0, + 3, + 1, + 1, + 2, + 4, + 5, + 17, + 11, + 3, + 7, + 5, + 0, + 15, + 3, + 6, + 2, + 4, + 0, + 7, + 3, + 4 + ], + "weighted_loads": [ + 1.5831466689705849, + 0.2942927796393633, + 0.0, + 0.49088918790221214, + 0.8290405534207821, + 0.775509538128972, + 1.018399078398943, + 0.15684886649250984, + 0.8256579153239727, + 0.03104834072291851, + 0.4284526892006397, + 0.43590304255485535, + 0.8421668708324432, + 0.08169505000114441, + 0.8785618059337139, + 0.6511056683957577, + 1.1031479574739933, + 0.30175869911909103, + 0.04954567551612854, + 0.3493041507899761, + 0.02945021726191044, + 0.08063790947198868, + 0.688787467777729, + 0.43053247034549713, + 0.682611620053649, + 0.0674723070114851, + 0.7412202805280685, + 0.12480543926358223, + 0.6584220230579376, + 0.03702360391616821, + 0.4472578093409538, + 0.9622843265533447, + 0.4804333448410034, + 0.3909049294888973, + 0.2703969292342663, + 0.0, + 1.234403151087463, + 0.10797502100467682, + 0.27335682697594166, + 0.2753825671970844, + 0.958773648366332, + 0.4617077149450779, + 0.0, + 0.34225279465317726, + 0.030017700046300888, + 0.03750820457935333, + 0.12188107147812843, + 0.12486557103693485, + 0.22381115332245827, + 2.4915710277855396, + 0.4806263670325279, + 0.12616786360740662, + 0.2151936748996377, + 0.3546013981103897, + 0.0, + 3.490936279296875, + 0.26661134511232376, + 0.6617375761270523, + 0.08108371123671532, + 0.16955212503671646, + 0.0, + 0.3737972341477871, + 0.14941680431365967, + 0.1747044175863266 + ], + "unique_experts": 59, + "load_cv": 0.8105892787684074, + "normalized_load_entropy": 0.917958115907611, + "max_load_share": 0.058823529411764705 + } + }, + "s0_x": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "e5e86236c75d49e9b2e4b55bd59162e21eb02137c1341c991c108f827dcc7a28", + "route_weight_sha256": "6a3c619e66d35987f2675741777458025905e3a1cfb25a69eaabdb0285d5dbb6", + "loads": [ + 2, + 1, + 0, + 12, + 5, + 8, + 1, + 3, + 5, + 0, + 1, + 3, + 5, + 0, + 6, + 0, + 0, + 1, + 0, + 2, + 0, + 1, + 8, + 4, + 9, + 0, + 1, + 0, + 3, + 0, + 2, + 6, + 2, + 5, + 2, + 0, + 7, + 2, + 4, + 2, + 4, + 5, + 0, + 1, + 0, + 0, + 2, + 2, + 2, + 3, + 2, + 1, + 5, + 4, + 0, + 12, + 4, + 0, + 0, + 0, + 0, + 0, + 1, + 1 + ], + "weighted_loads": [ + 0.07887085899710655, + 0.22451429069042206, + 0.0, + 0.5617738123983145, + 0.3386436700820923, + 0.523215789347887, + 0.03315097838640213, + 0.1298300288617611, + 0.27681564912199974, + 0.0, + 0.20049087703227997, + 0.10647564940154552, + 0.4179381690919399, + 0.0, + 0.7061756104230881, + 0.0, + 0.0, + 0.15394149720668793, + 0.0, + 0.08674705773591995, + 0.0, + 0.038689788430929184, + 0.6716386508196592, + 0.18906676769256592, + 0.4684811681509018, + 0.0, + 0.03980964794754982, + 0.0, + 0.2581319622695446, + 0.0, + 0.22055475413799286, + 0.51375363022089, + 0.10245833173394203, + 0.30191611871123314, + 0.11280025541782379, + 0.0, + 0.48871507309377193, + 0.11155134066939354, + 0.2209036499261856, + 0.24958498030900955, + 0.32135584205389023, + 0.3889641370624304, + 0.0, + 0.07104779034852982, + 0.0, + 0.0, + 0.12115670368075371, + 0.05432865582406521, + 0.08003295585513115, + 0.14644693583250046, + 0.0968497209250927, + 0.05141151696443558, + 0.15953597612679005, + 0.20565764978528023, + 0.0, + 2.7927354015409946, + 0.2903457246720791, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.03098106011748314, + 0.03927221894264221 + ], + "unique_experts": 44, + "load_cv": 1.1346612624304646, + "normalized_load_entropy": 0.8489082799574987, + "max_load_share": 0.07407407407407407 + }, + "full_input": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "228936e06015cc2bd9a1c40cfa4532d5b6a7f1c6ba80f3a7908312d345a292f5", + "route_weight_sha256": "3587c038bc0d833f0062caee80bdd8446270f166c3ae7f102bbdf829e7d75c1b", + "loads": [ + 5, + 1, + 0, + 12, + 12, + 9, + 9, + 5, + 11, + 1, + 7, + 5, + 9, + 0, + 15, + 2, + 7, + 3, + 0, + 5, + 0, + 1, + 8, + 10, + 11, + 2, + 12, + 0, + 6, + 0, + 7, + 6, + 7, + 7, + 2, + 0, + 12, + 2, + 4, + 2, + 9, + 5, + 0, + 4, + 0, + 0, + 2, + 4, + 3, + 12, + 8, + 3, + 12, + 5, + 0, + 15, + 4, + 0, + 1, + 0, + 0, + 3, + 1, + 4 + ], + "weighted_loads": [ + 0.29757435247302055, + 0.22451429069042206, + 0.0, + 0.5617738123983145, + 0.7246739380061626, + 0.541968559846282, + 0.6074504926800728, + 0.19615354761481285, + 0.7139981836080551, + 0.031530942767858505, + 0.45774621702730656, + 0.16245767660439014, + 0.7381193563342094, + 0.0, + 1.0716234520077705, + 0.06611673161387444, + 0.6552407369017601, + 0.22746799886226654, + 0.0, + 0.24380382895469666, + 0.0, + 0.038689788430929184, + 0.6716386508196592, + 0.5577648915350437, + 0.5258753318339586, + 0.0733612384647131, + 0.8242979124188423, + 0.0, + 0.3705887049436569, + 0.0, + 0.43249703384935856, + 0.51375363022089, + 0.5029634684324265, + 0.3945559151470661, + 0.11280025541782379, + 0.0, + 1.1756191300228238, + 0.11155134066939354, + 0.2209036499261856, + 0.24958498030900955, + 0.8868230618536472, + 0.3889641370624304, + 0.0, + 0.23861835896968842, + 0.0, + 0.0, + 0.12115670368075371, + 0.12309928052127361, + 0.09353205934166908, + 1.5081269443035126, + 0.39016770385205746, + 0.13632391765713692, + 0.3774396302178502, + 0.2389524206519127, + 0.0, + 3.4859784059226513, + 0.2903457246720791, + 0.0, + 0.05131320655345917, + 0.0, + 0.0, + 0.14351709187030792, + 0.03098106011748314, + 0.1708104107528925 + ], + "unique_experts": 50, + "load_cv": 0.8878610099067069, + "normalized_load_entropy": 0.8911982011848721, + "max_load_share": 0.04807692307692308 + } + }, + "s1_x": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "d5ea1846a3567a4d76c46ca78c9e95cc35d13138f2ea8374f06f298d0d2eb5dc", + "route_weight_sha256": "9be9aab76a8dafeadea1925afde03981f44452652a5fcc3781342cbd38de9369", + "loads": [ + 2, + 1, + 0, + 11, + 4, + 10, + 2, + 3, + 8, + 0, + 1, + 3, + 4, + 0, + 6, + 0, + 0, + 1, + 0, + 3, + 0, + 0, + 8, + 2, + 10, + 0, + 1, + 0, + 3, + 1, + 2, + 6, + 2, + 4, + 2, + 0, + 7, + 2, + 4, + 3, + 4, + 5, + 0, + 1, + 0, + 0, + 2, + 3, + 2, + 3, + 1, + 1, + 4, + 4, + 0, + 12, + 3, + 0, + 0, + 0, + 0, + 0, + 1, + 0 + ], + "weighted_loads": [ + 0.06953546404838562, + 0.23457635939121246, + 0.0, + 0.5009223502129316, + 0.28648947179317474, + 0.5654890891164541, + 0.06756677851080894, + 0.14028489962220192, + 0.42247868701815605, + 0.0, + 0.1922239065170288, + 0.10882763378322124, + 0.3677895627915859, + 0.0, + 0.6960251033306122, + 0.0, + 0.0, + 0.1539243906736374, + 0.0, + 0.1263164058327675, + 0.0, + 0.0, + 0.6707677766680717, + 0.08954907581210136, + 0.5195735283195972, + 0.0, + 0.0393359549343586, + 0.0, + 0.25690512731671333, + 0.03409070521593094, + 0.08511601015925407, + 0.5245034322142601, + 0.10553234070539474, + 0.27276643738150597, + 0.12061688303947449, + 0.0, + 0.4704828094691038, + 0.11580497398972511, + 0.21630395203828812, + 0.28560373559594154, + 0.32232122123241425, + 0.3790800292044878, + 0.0, + 0.07140322774648666, + 0.0, + 0.0, + 0.11782737448811531, + 0.09194938652217388, + 0.06757947243750095, + 0.13550543040037155, + 0.04479748755693436, + 0.05151437222957611, + 0.11787598952651024, + 0.22887392714619637, + 0.0, + 2.845616415143013, + 0.26627934724092484, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0315890908241272, + 0.0 + ], + "unique_experts": 43, + "load_cv": 1.1664543539259111, + "normalized_load_entropy": 0.8428231129640906, + "max_load_share": 0.07407407407407407 + }, + "full_input": { + "tokens": 68, + "top_k": 6, + "decisions": 408, + "ordered_route_sha256": "bc941ce77491fa73e7f437724bac1601584baa091ce3b4b3f56a321b4fa28320", + "route_weight_sha256": "e3e30f424e54c034f662838ade666b77c9444f5034aba773ee3e8747dd7d9c4d", + "loads": [ + 22, + 2, + 0, + 11, + 12, + 14, + 16, + 4, + 21, + 1, + 7, + 7, + 9, + 1, + 11, + 10, + 12, + 5, + 1, + 8, + 1, + 1, + 8, + 8, + 12, + 1, + 12, + 2, + 9, + 3, + 8, + 10, + 8, + 7, + 4, + 0, + 13, + 2, + 6, + 4, + 8, + 6, + 0, + 4, + 0, + 1, + 2, + 5, + 5, + 17, + 7, + 4, + 7, + 5, + 0, + 15, + 3, + 6, + 2, + 4, + 0, + 8, + 3, + 3 + ], + "weighted_loads": [ + 1.4753017574548721, + 0.2608844432979822, + 0.0, + 0.5009223502129316, + 0.6890525799244642, + 0.7485375441610813, + 1.179036509245634, + 0.17226900160312653, + 1.162101473659277, + 0.03104834072291851, + 0.47211506590247154, + 0.44080355390906334, + 0.8052001185715199, + 0.08169505000114441, + 0.8877782300114632, + 0.68593555316329, + 1.1221397705376148, + 0.30795223265886307, + 0.04954567551612854, + 0.4394228644669056, + 0.02945021726191044, + 0.08063790947198868, + 0.6707677766680717, + 0.4168820381164551, + 0.5820076242089272, + 0.02833595685660839, + 0.8643765859305859, + 0.12480543926358223, + 0.6727935001254082, + 0.09976312704384327, + 0.3093872368335724, + 0.9710333235561848, + 0.5429770909249783, + 0.4033769257366657, + 0.27106883749365807, + 0.0, + 1.075193633325398, + 0.11580497398972511, + 0.2791508939117193, + 0.32166266813874245, + 0.7522047441452742, + 0.4677926544100046, + 0.0, + 0.46721523627638817, + 0.0, + 0.03750820457935333, + 0.11782737448811531, + 0.15664482489228249, + 0.2107252236455679, + 2.1084038130939007, + 0.26201435923576355, + 0.15522116422653198, + 0.19999693427234888, + 0.3773130513727665, + 0.0, + 3.527103718370199, + 0.26627934724092484, + 0.6617375761270523, + 0.08108371123671532, + 0.16955212503671646, + 0.0, + 0.42592908814549446, + 0.1468043178319931, + 0.11503780260682106 + ], + "unique_experts": 58, + "load_cv": 0.8082142684519588, + "normalized_load_entropy": 0.9177192397043418, + "max_load_share": 0.05392156862745098 + } + }, + "s0_period": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "dbf03d555e0aea57bea88027d8fa47128c4e239917f056be634ae84de78dba61", + "route_weight_sha256": "dbfd7b68a491d56b40c6baa0a564c8b827bda781476a008e987ea6b2ab8c8cb9", + "loads": [ + 3, + 1, + 0, + 13, + 5, + 8, + 1, + 2, + 6, + 0, + 1, + 3, + 5, + 0, + 6, + 0, + 0, + 1, + 0, + 2, + 0, + 1, + 7, + 4, + 9, + 0, + 1, + 0, + 3, + 0, + 2, + 6, + 2, + 4, + 2, + 0, + 7, + 2, + 4, + 2, + 4, + 5, + 0, + 1, + 1, + 0, + 2, + 2, + 2, + 3, + 2, + 1, + 5, + 3, + 0, + 12, + 3, + 0, + 0, + 0, + 0, + 1, + 1, + 1 + ], + "weighted_loads": [ + 0.09777776151895523, + 0.2283627986907959, + 0.0, + 0.5943564847111702, + 0.342133492231369, + 0.518031720072031, + 0.034048713743686676, + 0.08016319200396538, + 0.32049133628606796, + 0.0, + 0.20023417472839355, + 0.10969791933894157, + 0.4214788116514683, + 0.0, + 0.7075647264719009, + 0.0, + 0.0, + 0.15697453916072845, + 0.0, + 0.08585843071341515, + 0.0, + 0.035511817783117294, + 0.6770509220659733, + 0.180379506200552, + 0.4654734842479229, + 0.0, + 0.04066704586148262, + 0.0, + 0.2602436766028404, + 0.0, + 0.19076830707490444, + 0.5299647450447083, + 0.09535867348313332, + 0.25087954103946686, + 0.11705978214740753, + 0.0, + 0.4801646750420332, + 0.11452220752835274, + 0.22221550717949867, + 0.2436002790927887, + 0.30735665187239647, + 0.3758022915571928, + 0.0, + 0.07026277482509613, + 0.028881922364234924, + 0.0, + 0.11913331970572472, + 0.053926847875118256, + 0.0792158991098404, + 0.1467965804040432, + 0.10392068326473236, + 0.052374981343746185, + 0.15393888112157583, + 0.1713135652244091, + 0.0, + 2.7734072729945183, + 0.2665756121277809, + 0.0, + 0.0, + 0.0, + 0.0, + 0.03385165333747864, + 0.031553879380226135, + 0.03967463970184326 + ], + "unique_experts": 46, + "load_cv": 1.1346612624304646, + "normalized_load_entropy": 0.8545277039890176, + "max_load_share": 0.08024691358024691 + }, + "full_input": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "4b1a481f4b6ce70fd4473f3b24f55e46e90b41d8a2333f012d22e9cc15558545", + "route_weight_sha256": "79e3d0e62ea260b6cc93308da12ba275eed9ad6c6deb870289f80d8740d0f576", + "loads": [ + 6, + 1, + 0, + 13, + 13, + 9, + 10, + 4, + 12, + 1, + 6, + 5, + 9, + 0, + 15, + 1, + 7, + 3, + 0, + 4, + 0, + 1, + 7, + 10, + 12, + 2, + 11, + 0, + 6, + 0, + 7, + 6, + 7, + 6, + 2, + 0, + 13, + 2, + 4, + 2, + 10, + 5, + 0, + 3, + 1, + 0, + 2, + 4, + 3, + 12, + 8, + 3, + 11, + 4, + 0, + 15, + 3, + 0, + 2, + 0, + 0, + 4, + 1, + 4 + ], + "weighted_loads": [ + 0.3568134307861328, + 0.2283627986907959, + 0.0, + 0.5943564847111702, + 0.8061013109982014, + 0.536784490570426, + 0.6071526668965816, + 0.14648671075701714, + 0.742260567843914, + 0.031530942767858505, + 0.38882544822990894, + 0.1738828718662262, + 0.7159117683768272, + 0.0, + 1.0730125680565834, + 0.031232573091983795, + 0.6374259330332279, + 0.23050104081630707, + 0.0, + 0.1946392059326172, + 0.0, + 0.035511817783117294, + 0.6770509220659733, + 0.5403130203485489, + 0.5705896597355604, + 0.07331507094204426, + 0.7174712084233761, + 0.0, + 0.37270041927695274, + 0.0, + 0.4138203263282776, + 0.5299647450447083, + 0.49586381018161774, + 0.34351933747529984, + 0.11705978214740753, + 0.0, + 1.2466525780037045, + 0.11452220752835274, + 0.22221550717949867, + 0.2436002790927887, + 0.9731630720198154, + 0.3758022915571928, + 0.0, + 0.1568782702088356, + 0.028881922364234924, + 0.0, + 0.11913331970572472, + 0.12480088323354721, + 0.09271500259637833, + 1.4801036044955254, + 0.39327985793352127, + 0.13728738203644753, + 0.3339004833251238, + 0.2125781886279583, + 0.0, + 3.4781790673732758, + 0.2665756121277809, + 0.0, + 0.10178700089454651, + 0.0, + 0.0, + 0.25402095913887024, + 0.031553879380226135, + 0.17121283151209354 + ], + "unique_experts": 51, + "load_cv": 0.9061844639524252, + "normalized_load_entropy": 0.8902192604710258, + "max_load_share": 0.04807692307692308 + } + }, + "s1_period": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "db78221bcca86b285bc2d823915efe2a8aa0b102bfd2f20b90f4e261c0ba8fb4", + "route_weight_sha256": "71e4689371d772c2a412aa9a26e1ef4fdf3b633fa2b972b29d49bb8ff77e7281", + "loads": [ + 2, + 1, + 0, + 11, + 5, + 9, + 1, + 3, + 8, + 0, + 1, + 3, + 5, + 0, + 6, + 0, + 0, + 1, + 0, + 3, + 0, + 1, + 8, + 3, + 9, + 0, + 1, + 0, + 3, + 1, + 3, + 6, + 2, + 3, + 2, + 0, + 7, + 2, + 4, + 3, + 4, + 5, + 0, + 1, + 0, + 0, + 2, + 2, + 2, + 3, + 1, + 1, + 3, + 4, + 0, + 12, + 3, + 0, + 0, + 0, + 0, + 1, + 1, + 0 + ], + "weighted_loads": [ + 0.06719304248690605, + 0.2364339381456375, + 0.0, + 0.5124592501670122, + 0.31035707518458366, + 0.5484488233923912, + 0.035777490586042404, + 0.13469115272164345, + 0.41801949217915535, + 0.0, + 0.1956758052110672, + 0.11003195121884346, + 0.4094921089708805, + 0.0, + 0.6479850895702839, + 0.0, + 0.0, + 0.1605682373046875, + 0.0, + 0.1271081641316414, + 0.0, + 0.032441090792417526, + 0.67101726308465, + 0.12391666322946548, + 0.49106790125370026, + 0.0, + 0.03912658989429474, + 0.0, + 0.2641299478709698, + 0.039108458906412125, + 0.13310348242521286, + 0.5245154947042465, + 0.11376256868243217, + 0.23131076619029045, + 0.1169276088476181, + 0.0, + 0.4694379176944494, + 0.11579044535756111, + 0.21884842216968536, + 0.27432863786816597, + 0.3158307448029518, + 0.37785261310636997, + 0.0, + 0.07207303494215012, + 0.0, + 0.0, + 0.11844228953123093, + 0.05690375901758671, + 0.06953763775527477, + 0.1393259447067976, + 0.045020800083875656, + 0.04945160821080208, + 0.08175782859325409, + 0.21751219034194946, + 0.0, + 2.8570615984499454, + 0.26731792837381363, + 0.0, + 0.0, + 0.0, + 0.0, + 0.029728831723332405, + 0.03220434486865997, + 0.0 + ], + "unique_experts": 45, + "load_cv": 1.1346612624304646, + "normalized_load_entropy": 0.8509465372608208, + "max_load_share": 0.07407407407407407 + }, + "full_input": { + "tokens": 68, + "top_k": 6, + "decisions": 408, + "ordered_route_sha256": "d550a5b0c3751d27ed2995780dbdf3dc9eb601b712ac30398d8ecc94c0f0f1f7", + "route_weight_sha256": "b5a02fc11b880a696303a3742fe960b17631ce08c3bbf5679a9bec69d2d49c2c", + "loads": [ + 23, + 2, + 0, + 11, + 14, + 13, + 15, + 4, + 19, + 1, + 7, + 7, + 10, + 1, + 11, + 10, + 12, + 5, + 1, + 7, + 1, + 2, + 8, + 8, + 11, + 1, + 12, + 2, + 9, + 3, + 10, + 10, + 7, + 6, + 4, + 0, + 13, + 2, + 6, + 4, + 9, + 6, + 0, + 4, + 0, + 1, + 2, + 4, + 5, + 17, + 8, + 3, + 5, + 5, + 0, + 15, + 3, + 6, + 3, + 4, + 0, + 10, + 3, + 3 + ], + "weighted_loads": [ + 1.4667194075882435, + 0.26274202205240726, + 0.0, + 0.5124592501670122, + 0.8075414001941681, + 0.7314998861402273, + 1.1806654930114746, + 0.16667525470256805, + 1.0727786384522915, + 0.03104834072291851, + 0.4538921117782593, + 0.44200787134468555, + 0.8343271277844906, + 0.08169505000114441, + 0.8397382162511349, + 0.684360072016716, + 1.0955770090222359, + 0.3145960792899132, + 0.04954567551612854, + 0.3899862766265869, + 0.02945021726191044, + 0.1130790002644062, + 0.67101726308465, + 0.37395843490958214, + 0.5535019971430302, + 0.02833595685660839, + 0.7848407477140427, + 0.12480543926358223, + 0.6800183206796646, + 0.10828669741749763, + 0.38943327218294144, + 0.9710453860461712, + 0.512498315423727, + 0.3619212545454502, + 0.2673795633018017, + 0.0, + 1.2257987158372998, + 0.11579044535756111, + 0.28169536404311657, + 0.3103875704109669, + 0.8110582511872053, + 0.4665652383118868, + 0.0, + 0.39139602705836296, + 0.0, + 0.03750820457935333, + 0.11844228953123093, + 0.12207895703613758, + 0.2126833889633417, + 2.0845358539372683, + 0.3151790164411068, + 0.12003273144364357, + 0.13060291949659586, + 0.3659513145685196, + 0.0, + 3.5477759800851345, + 0.26731792837381363, + 0.6617375761270523, + 0.14375917986035347, + 0.16955212503671646, + 0.0, + 0.5958668123930693, + 0.14741957187652588, + 0.11503780260682106 + ], + "unique_experts": 58, + "load_cv": 0.8043996665398437, + "normalized_load_entropy": 0.9184725004417189, + "max_load_share": 0.056372549019607844 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 27, + "ordered_topk_exact_tokens": 18, + "set_exact_tokens": 22, + "mean_set_jaccard": 0.9391534391534392, + "mean_token_weighted_tv": 0.01614209964733433, + "aggregate_load_tv": 0.030864197530864196 + }, + "system_bos": { + "tokens": 27, + "ordered_topk_exact_tokens": 21, + "set_exact_tokens": 23, + "mean_set_jaccard": 0.9576719576719578, + "mean_token_weighted_tv": 0.018045437211791675, + "aggregate_load_tv": 0.012345679012345678 + }, + "system_x": { + "tokens": 27, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.8800705467372134, + "mean_token_weighted_tv": 0.03416807873657456, + "aggregate_load_tv": 0.06790123456790123 + }, + "system_period": { + "tokens": 27, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.8509700176366843, + "mean_token_weighted_tv": 0.03890767350309977, + "aggregate_load_tv": 0.06172839506172839 + }, + "bos_at_s0": { + "tokens": 27, + "ordered_topk_exact_tokens": 18, + "set_exact_tokens": 20, + "mean_set_jaccard": 0.9100529100529102, + "mean_token_weighted_tv": 0.02604900804106836, + "aggregate_load_tv": 0.04938271604938271 + }, + "bos_at_s1": { + "tokens": 27, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.9074074074074074, + "mean_token_weighted_tv": 0.027342917432111723, + "aggregate_load_tv": 0.05555555555555555 + }, + "x_at_s0": { + "tokens": 27, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 13, + "mean_set_jaccard": 0.8439153439153438, + "mean_token_weighted_tv": 0.03751375719353005, + "aggregate_load_tv": 0.06172839506172839 + }, + "x_at_s1": { + "tokens": 27, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8386243386243387, + "mean_token_weighted_tv": 0.045281721658452796, + "aggregate_load_tv": 0.08024691358024691 + }, + "period_at_s0": { + "tokens": 27, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.8756613756613757, + "mean_token_weighted_tv": 0.03541228425240627, + "aggregate_load_tv": 0.05555555555555555 + }, + "period_at_s1": { + "tokens": 27, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.8536155202821871, + "mean_token_weighted_tv": 0.04578154144325742, + "aggregate_load_tv": 0.06172839506172839 + } + } + }, + "layer_16": { + "layer": 16, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "4e83851bdadecb5efd87acc736286ca24faf0a9867e0a3b5521e42ed0113c798", + "route_weight_sha256": "bd51aed442c8c835e970f99d6d3646d6b0aeb40717e09d150950e4d0636570e6", + "loads": [ + 2, + 3, + 0, + 9, + 2, + 0, + 2, + 1, + 3, + 5, + 0, + 2, + 9, + 7, + 3, + 2, + 5, + 2, + 1, + 6, + 0, + 0, + 0, + 1, + 3, + 4, + 2, + 0, + 2, + 0, + 2, + 4, + 2, + 12, + 0, + 0, + 4, + 2, + 2, + 0, + 0, + 2, + 0, + 0, + 2, + 2, + 3, + 1, + 0, + 3, + 4, + 2, + 0, + 2, + 1, + 0, + 2, + 1, + 2, + 4, + 3, + 11, + 6, + 7 + ], + "weighted_loads": [ + 0.1265045814216137, + 0.1148478053510189, + 0.0, + 0.8063861429691315, + 0.08019941858947277, + 0.0, + 0.08930538222193718, + 0.06253363937139511, + 0.40973667055368423, + 0.9101986140012741, + 0.0, + 0.08053738810122013, + 0.5143071934580803, + 0.4057827778160572, + 0.12017516605556011, + 0.17984595149755478, + 1.1946608312427998, + 0.1770363748073578, + 0.09292896091938019, + 0.46436233446002007, + 0.0, + 0.0, + 0.0, + 0.040053192526102066, + 0.15549498796463013, + 0.18250202015042305, + 0.09333767369389534, + 0.0, + 0.21128246188163757, + 0.0, + 0.0656855646520853, + 0.284855380654335, + 0.03557847440242767, + 1.4788454193621874, + 0.0, + 0.0, + 0.16408423148095608, + 0.06351356580853462, + 0.08027729764580727, + 0.0, + 0.0, + 0.08255071379244328, + 0.0, + 0.0, + 0.09128798916935921, + 0.0779662299901247, + 0.23653562739491463, + 0.01973969116806984, + 0.0, + 0.22974061593413353, + 0.2659686245024204, + 0.07161474972963333, + 0.0, + 0.0782409394159913, + 0.03869038447737694, + 0.0, + 0.06590174324810505, + 0.04089200869202614, + 0.10662804171442986, + 0.3480561301112175, + 0.1451754793524742, + 1.0012182667851448, + 0.32239703088998795, + 0.8526955172419548 + ], + "unique_experts": 47, + "load_cv": 1.0613694483679914, + "normalized_load_entropy": 0.8704709261792234, + "max_load_share": 0.07407407407407407 + }, + "full_input": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "4999fa3a7279de291bf824552e3505e0839ae93e7838287912d755313d2c5a4c", + "route_weight_sha256": "79fac2b02795bafc53b5172bb11012361b14a7256535bae2cd77272ee0f3443a", + "loads": [ + 2, + 3, + 0, + 9, + 2, + 8, + 6, + 1, + 3, + 9, + 4, + 2, + 9, + 8, + 3, + 10, + 16, + 7, + 6, + 8, + 11, + 2, + 2, + 1, + 10, + 4, + 6, + 0, + 2, + 0, + 4, + 4, + 3, + 19, + 0, + 0, + 4, + 11, + 2, + 0, + 3, + 10, + 0, + 0, + 5, + 3, + 3, + 2, + 0, + 3, + 4, + 4, + 0, + 13, + 1, + 10, + 2, + 1, + 2, + 4, + 7, + 14, + 6, + 14 + ], + "weighted_loads": [ + 0.1265045814216137, + 0.1148478053510189, + 0.0, + 0.8063861429691315, + 0.08019941858947277, + 0.7776421681046486, + 0.25969088822603226, + 0.06253363937139511, + 0.40973667055368423, + 2.3282568994909525, + 0.20021667703986168, + 0.08053738810122013, + 0.5143071934580803, + 0.42488231882452965, + 0.12017516605556011, + 1.1592269837856293, + 1.8123102271929383, + 0.48375433310866356, + 0.7032887954264879, + 0.5069664758630097, + 0.9771555569022894, + 0.07996942475438118, + 0.1212662048637867, + 0.040053192526102066, + 0.7877665255218744, + 0.18250202015042305, + 0.3299202583730221, + 0.0, + 0.21128246188163757, + 0.0, + 0.1592346802353859, + 0.284855380654335, + 0.07533339783549309, + 1.7941706981509924, + 0.0, + 0.0, + 0.16408423148095608, + 0.5265594590455294, + 0.08027729764580727, + 0.0, + 0.1884089596569538, + 1.6499931532889605, + 0.0, + 0.0, + 0.19841181300580502, + 0.14478007890284061, + 0.23653562739491463, + 0.06731174886226654, + 0.0, + 0.22974061593413353, + 0.2659686245024204, + 0.17817946150898933, + 0.0, + 0.8524799747392535, + 0.03869038447737694, + 0.8038905113935471, + 0.06590174324810505, + 0.04089200869202614, + 0.10662804171442986, + 0.3480561301112175, + 0.39733194559812546, + 1.1029391894116998, + 0.32239703088998795, + 1.2359169125556946 + ], + "unique_experts": 54, + "load_cv": 0.9047322443270437, + "normalized_load_entropy": 0.8996046001676444, + "max_load_share": 0.060897435897435896 + } + }, + "s1_eos": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "58e7a456e61aeb4a267fcae158a0e0d516bd839769800afe59a442151ad97e82", + "route_weight_sha256": "ba3fbc5934a84620c7193dbb782045eaa082679101d0a7af0d3b79232442a72b", + "loads": [ + 2, + 2, + 0, + 9, + 2, + 0, + 2, + 1, + 4, + 5, + 0, + 2, + 10, + 7, + 3, + 2, + 5, + 2, + 1, + 6, + 0, + 0, + 0, + 0, + 3, + 4, + 2, + 0, + 2, + 0, + 2, + 4, + 2, + 13, + 0, + 0, + 4, + 2, + 3, + 0, + 0, + 2, + 0, + 0, + 2, + 2, + 2, + 1, + 0, + 3, + 4, + 2, + 0, + 2, + 1, + 0, + 1, + 1, + 2, + 4, + 4, + 11, + 6, + 6 + ], + "weighted_loads": [ + 0.1285836510360241, + 0.08937766030430794, + 0.0, + 0.8205771464854479, + 0.07988310791552067, + 0.0, + 0.08931130543351173, + 0.0646066889166832, + 0.42475857958197594, + 0.8737298808991909, + 0.0, + 0.08584626577794552, + 0.530772989615798, + 0.40383037738502026, + 0.11054595932364464, + 0.182105153799057, + 1.1868381761014462, + 0.17824479192495346, + 0.09440964460372925, + 0.45991882495582104, + 0.0, + 0.0, + 0.0, + 0.0, + 0.1583283506333828, + 0.18343935906887054, + 0.09537507966160774, + 0.0, + 0.2196091040968895, + 0.0, + 0.06593087688088417, + 0.28014056757092476, + 0.045029254630208015, + 1.5183882918208838, + 0.0, + 0.0, + 0.16639001667499542, + 0.07095079310238361, + 0.12006750702857971, + 0.0, + 0.0, + 0.08232275955379009, + 0.0, + 0.0, + 0.08894746005535126, + 0.07687234692275524, + 0.19791308417916298, + 0.02079095132648945, + 0.0, + 0.2270311638712883, + 0.2699507661163807, + 0.07248975895345211, + 0.0, + 0.09978476911783218, + 0.03880908712744713, + 0.0, + 0.03714689612388611, + 0.04214123263955116, + 0.10480915009975433, + 0.41702089831233025, + 0.15650517866015434, + 1.0177452359348536, + 0.3217557482421398, + 0.8513243906199932 + ], + "unique_experts": 46, + "load_cv": 1.1019512698517466, + "normalized_load_entropy": 0.8628888785387847, + "max_load_share": 0.08024691358024691 + }, + "full_input": { + "tokens": 68, + "top_k": 6, + "decisions": 408, + "ordered_route_sha256": "9b5bb5921098da9881bd0e455e93b532ddab6a388b624f003393cf0385840e6d", + "route_weight_sha256": "fad0a5bae6c48bcaaf89944f66f77738da94dc4d7a858d28c934a7e903f0e8f3", + "loads": [ + 2, + 5, + 0, + 11, + 2, + 9, + 6, + 2, + 4, + 10, + 6, + 5, + 10, + 10, + 4, + 14, + 16, + 14, + 9, + 8, + 11, + 2, + 2, + 1, + 18, + 4, + 11, + 0, + 2, + 0, + 6, + 4, + 7, + 19, + 1, + 2, + 4, + 11, + 5, + 3, + 4, + 17, + 1, + 2, + 5, + 7, + 3, + 7, + 3, + 6, + 10, + 3, + 0, + 14, + 1, + 11, + 3, + 1, + 2, + 5, + 8, + 13, + 9, + 13 + ], + "weighted_loads": [ + 0.1285836510360241, + 0.21077249199151993, + 0.0, + 0.9110503029078245, + 0.07988310791552067, + 0.8412547595798969, + 0.29004213213920593, + 0.09055393375456333, + 0.42475857958197594, + 2.2985129319131374, + 0.20029395818710327, + 0.17146134190261364, + 0.530772989615798, + 0.49666760489344597, + 0.15918011218309402, + 1.6918313205242157, + 1.6955203898251057, + 0.9734428487718105, + 0.9342362228780985, + 0.4978343998081982, + 0.9292328972369432, + 0.09001335129141808, + 0.08501680940389633, + 0.07540082186460495, + 1.344863135367632, + 0.18343935906887054, + 1.2199681997299194, + 0.0, + 0.2196091040968895, + 0.0, + 0.22302619740366936, + 0.28014056757092476, + 0.26661418192088604, + 1.760401395149529, + 0.03575523942708969, + 0.11641072109341621, + 0.16639001667499542, + 0.55137082003057, + 0.2414776012301445, + 0.17640169709920883, + 0.214758463203907, + 2.67632538639009, + 0.03684661537408829, + 0.09356065467000008, + 0.17590189073234797, + 0.3110195603221655, + 0.22851606272161007, + 0.3145656455308199, + 0.12480076961219311, + 0.3870640769600868, + 0.5281892530620098, + 0.11459398083388805, + 0.0, + 1.175967339426279, + 0.03880908712744713, + 0.9700772576034069, + 0.14461136236786842, + 0.04214123263955116, + 0.10480915009975433, + 0.6185849718749523, + 0.33349159359931946, + 1.0818480745656416, + 0.6527712792158127, + 1.2818927243351936 + ], + "unique_experts": 60, + "load_cv": 0.7667143057261628, + "normalized_load_entropy": 0.9262348970264012, + "max_load_share": 0.04656862745098039 + } + }, + "s0_bos": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "cea22d86dd3b859e77a1b09c9eb957fbd9e6ddec1a87357899a7f583c02af36e", + "route_weight_sha256": "136f906d66a9d2e12ae58177fb13f045fc236249535ac23da07edf7c264b1dcf", + "loads": [ + 2, + 2, + 0, + 7, + 3, + 0, + 4, + 1, + 4, + 5, + 0, + 2, + 9, + 7, + 2, + 2, + 5, + 2, + 1, + 6, + 0, + 0, + 0, + 0, + 3, + 4, + 2, + 0, + 2, + 0, + 2, + 4, + 3, + 14, + 0, + 0, + 4, + 2, + 2, + 0, + 0, + 2, + 0, + 0, + 2, + 2, + 3, + 1, + 0, + 3, + 4, + 2, + 0, + 2, + 0, + 0, + 1, + 1, + 3, + 4, + 3, + 11, + 6, + 6 + ], + "weighted_loads": [ + 0.1277909129858017, + 0.0927312895655632, + 0.0, + 0.7728813886642456, + 0.10934930853545666, + 0.0, + 0.13752328976988792, + 0.06203322857618332, + 0.4430278614163399, + 0.9482272677123547, + 0.0, + 0.08923874981701374, + 0.519935829564929, + 0.41878835670650005, + 0.07569719664752483, + 0.1485556960105896, + 1.1853726245462894, + 0.17660892009735107, + 0.09458326548337936, + 0.4737449996173382, + 0.0, + 0.0, + 0.0, + 0.0, + 0.1614220030605793, + 0.18924787640571594, + 0.0920189619064331, + 0.0, + 0.21250730752944946, + 0.0, + 0.06358226202428341, + 0.299875695258379, + 0.055140999145805836, + 1.4772029053419828, + 0.0, + 0.0, + 0.1596107017248869, + 0.057313560508191586, + 0.07990547642111778, + 0.0, + 0.0, + 0.0851569939404726, + 0.0, + 0.0, + 0.0773179717361927, + 0.07536616548895836, + 0.2469412460923195, + 0.040790263563394547, + 0.0, + 0.2354317456483841, + 0.28076037764549255, + 0.0710979700088501, + 0.0, + 0.07480546925216913, + 0.0, + 0.0, + 0.0359051339328289, + 0.04289377108216286, + 0.1403183452785015, + 0.4299187399446964, + 0.12960135377943516, + 1.0248090848326683, + 0.3174004703760147, + 0.9556666202843189 + ], + "unique_experts": 45, + "load_cv": 1.0908299934837404, + "normalized_load_entropy": 0.8629978100357063, + "max_load_share": 0.08641975308641975 + }, + "full_input": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "25b216a2e71a02ac9f7fa87b2ca9575ee026dc651b59d246ae968acb88bb343e", + "route_weight_sha256": "ba146bc21e6329ce2153e25f1d300a9f258fbdeef6eb140c3ca880ba2cd16b7a", + "loads": [ + 2, + 2, + 0, + 7, + 3, + 9, + 8, + 1, + 4, + 8, + 3, + 3, + 10, + 9, + 2, + 10, + 15, + 7, + 6, + 8, + 11, + 2, + 3, + 0, + 9, + 4, + 5, + 0, + 2, + 0, + 4, + 4, + 4, + 20, + 1, + 0, + 4, + 10, + 2, + 0, + 3, + 11, + 0, + 0, + 6, + 3, + 3, + 2, + 0, + 4, + 5, + 4, + 0, + 14, + 0, + 10, + 1, + 1, + 3, + 4, + 5, + 14, + 6, + 11 + ], + "weighted_loads": [ + 0.1277909129858017, + 0.0927312895655632, + 0.0, + 0.7728813886642456, + 0.10934930853545666, + 0.8200623765587807, + 0.307908795773983, + 0.06203322857618332, + 0.4430278614163399, + 1.4069407731294632, + 0.17641302943229675, + 0.129786791279912, + 0.5952623914927244, + 0.4776980374008417, + 0.07569719664752483, + 1.0464757569134235, + 2.189340790733695, + 0.5047747120261192, + 0.6447919700294733, + 0.5448649637401104, + 0.9771555569022894, + 0.07996942475438118, + 0.13896719925105572, + 0.0, + 0.7416639402508736, + 0.18924787640571594, + 0.2614600881934166, + 0.0, + 0.21250730752944946, + 0.0, + 0.157131377607584, + 0.299875695258379, + 0.09489592257887125, + 1.7927939034998417, + 0.1208065003156662, + 0.0, + 0.1596107017248869, + 0.4952070964500308, + 0.07990547642111778, + 0.0, + 0.15455661341547966, + 1.4782183673232794, + 0.0, + 0.0, + 0.21250994317233562, + 0.14218001440167427, + 0.2469412460923195, + 0.07905452698469162, + 0.0, + 0.278489887714386, + 0.32578886300325394, + 0.1776626817882061, + 0.0, + 0.8818911826238036, + 0.0, + 0.8038905113935471, + 0.0359051339328289, + 0.04289377108216286, + 0.1403183452785015, + 0.4299187399446964, + 0.25858437456190586, + 1.172654114663601, + 0.3174004703760147, + 1.3567492626607418 + ], + "unique_experts": 53, + "load_cv": 0.8967029974382416, + "normalized_load_entropy": 0.8996105641152033, + "max_load_share": 0.0641025641025641 + } + }, + "s1_bos": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "30064181b12fd6b65fa2eaaaaad4fc4ea72001172e9f631930f4f1056994a3dd", + "route_weight_sha256": "b9abed57296dd6a6e55d70b46e3ff69e9869c42e013ce06240a9b749d173d272", + "loads": [ + 2, + 2, + 0, + 9, + 2, + 0, + 3, + 1, + 4, + 5, + 0, + 2, + 9, + 6, + 2, + 2, + 5, + 2, + 1, + 6, + 0, + 0, + 0, + 1, + 3, + 4, + 2, + 1, + 2, + 0, + 3, + 4, + 3, + 13, + 0, + 0, + 4, + 2, + 2, + 0, + 0, + 2, + 0, + 0, + 2, + 2, + 4, + 1, + 0, + 3, + 4, + 1, + 0, + 2, + 0, + 0, + 1, + 1, + 3, + 4, + 3, + 10, + 6, + 6 + ], + "weighted_loads": [ + 0.12479547411203384, + 0.08996805921196938, + 0.0, + 0.848242711275816, + 0.0771394707262516, + 0.0, + 0.10871046222746372, + 0.06413911283016205, + 0.4379266183823347, + 0.8665725365281105, + 0.0, + 0.09560548514127731, + 0.5039703324437141, + 0.36356339044868946, + 0.07754556648433208, + 0.14973004162311554, + 1.1691483184695244, + 0.17671871930360794, + 0.08282868564128876, + 0.4532359726727009, + 0.0, + 0.0, + 0.0, + 0.03605487942695618, + 0.1665915735065937, + 0.1976136490702629, + 0.09546181187033653, + 0.04356483742594719, + 0.21303407847881317, + 0.0, + 0.08880692534148693, + 0.29868486896157265, + 0.06583993416279554, + 1.5089187622070312, + 0.0, + 0.0, + 0.15315602533519268, + 0.07029490917921066, + 0.0781117957085371, + 0.0, + 0.0, + 0.08375113643705845, + 0.0, + 0.0, + 0.08153367415070534, + 0.07073077000677586, + 0.26821539364755154, + 0.040648382157087326, + 0.0, + 0.2210654877126217, + 0.28411727026104927, + 0.032013554126024246, + 0.0, + 0.0924474811181426, + 0.0, + 0.0, + 0.03902754187583923, + 0.03242557495832443, + 0.1609577238559723, + 0.4796493574976921, + 0.12866966985166073, + 1.0098615903407335, + 0.32015117444097996, + 1.0697826631367207 + ], + "unique_experts": 47, + "load_cv": 1.0567641625979367, + "normalized_load_entropy": 0.870503559336743, + "max_load_share": 0.08024691358024691 + }, + "full_input": { + "tokens": 68, + "top_k": 6, + "decisions": 408, + "ordered_route_sha256": "77fa0880767172a8ee4a62ba7a9150e479de8d4956a313e5b99614c15f02ce14", + "route_weight_sha256": "58ddc480ca85725fb7d62ee2d101ca19a266a8a8cb5333f9fc15644b6523e7e9", + "loads": [ + 2, + 5, + 0, + 11, + 2, + 9, + 7, + 2, + 4, + 9, + 6, + 4, + 9, + 9, + 3, + 14, + 16, + 13, + 9, + 6, + 11, + 2, + 2, + 2, + 17, + 4, + 11, + 1, + 2, + 0, + 7, + 4, + 8, + 20, + 1, + 2, + 4, + 12, + 5, + 3, + 4, + 18, + 1, + 2, + 6, + 7, + 5, + 7, + 3, + 7, + 10, + 2, + 0, + 15, + 0, + 11, + 3, + 1, + 3, + 5, + 8, + 11, + 9, + 12 + ], + "weighted_loads": [ + 0.12479547411203384, + 0.21136289089918137, + 0.0, + 0.9387158676981926, + 0.0771394707262516, + 0.8258747681975365, + 0.3094412889331579, + 0.09008635766804218, + 0.4379266183823347, + 1.3627085126936436, + 0.19248010031878948, + 0.15787737257778645, + 0.5039703324437141, + 0.4564006179571152, + 0.12617971934378147, + 1.6118399016559124, + 2.099932111799717, + 0.9415182247757912, + 0.9097999576479197, + 0.4532359726727009, + 0.9292328972369432, + 0.09001335129141808, + 0.08501680940389633, + 0.11145570129156113, + 1.2676371447741985, + 0.1976136490702629, + 1.2282877676188946, + 0.04356483742594719, + 0.21303407847881317, + 0.0, + 0.24590224586427212, + 0.29868486896157265, + 0.28742486145347357, + 1.8267698474228382, + 0.03575523942708969, + 0.11641072109341621, + 0.15315602533519268, + 0.5908643528819084, + 0.21908924728631973, + 0.17640169709920883, + 0.17952978610992432, + 2.617260677739978, + 0.03684661537408829, + 0.09356065467000008, + 0.22669485956430435, + 0.3048779834061861, + 0.2988183721899986, + 0.33442307636141777, + 0.12480076961219311, + 0.4198315925896168, + 0.5513335429131985, + 0.07411777600646019, + 0.0, + 1.1979093151167035, + 0.0, + 0.9700772576034069, + 0.14649200811982155, + 0.03242557495832443, + 0.1609577238559723, + 0.6812134310603142, + 0.36435310170054436, + 1.0682900603860617, + 0.6511667054146528, + 1.5406105630099773 + ], + "unique_experts": 60, + "load_cv": 0.7601675284305932, + "normalized_load_entropy": 0.9279618457344601, + "max_load_share": 0.049019607843137254 + } + }, + "s0_x": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "2b03fd0ae31e39632557cab9a15bc5160be0c4e7debd8c7ceb55816f018e9cc6", + "route_weight_sha256": "04d0d6b385846682375ee18ecaa8bb98a5b26edff20e3615d531b0fa48ca0207", + "loads": [ + 2, + 2, + 0, + 8, + 1, + 0, + 4, + 1, + 4, + 5, + 0, + 2, + 9, + 7, + 1, + 2, + 5, + 2, + 1, + 7, + 0, + 0, + 0, + 1, + 4, + 4, + 2, + 0, + 2, + 0, + 2, + 4, + 1, + 14, + 0, + 0, + 4, + 2, + 2, + 0, + 0, + 2, + 0, + 0, + 2, + 3, + 3, + 1, + 0, + 3, + 4, + 1, + 0, + 2, + 0, + 0, + 2, + 1, + 3, + 4, + 2, + 11, + 6, + 7 + ], + "weighted_loads": [ + 0.12367531284689903, + 0.09525735676288605, + 0.0, + 0.7949432451277971, + 0.05760278180241585, + 0.0, + 0.13418251276016235, + 0.06124323606491089, + 0.4485298655927181, + 0.908809520304203, + 0.0, + 0.08502334542572498, + 0.530383788049221, + 0.4387537147849798, + 0.0475575253367424, + 0.1568121835589409, + 1.1924504861235619, + 0.18788638710975647, + 0.08871878683567047, + 0.4768540496006608, + 0.0, + 0.0, + 0.0, + 0.03796642646193504, + 0.20508780889213085, + 0.1996443010866642, + 0.09075616300106049, + 0.0, + 0.22696848213672638, + 0.0, + 0.0609261579811573, + 0.306480772793293, + 0.03190864250063896, + 1.555410785600543, + 0.0, + 0.0, + 0.1645477470010519, + 0.0547440480440855, + 0.07926756329834461, + 0.0, + 0.0, + 0.09536361135542393, + 0.0, + 0.0, + 0.0825062207877636, + 0.10151004791259766, + 0.2452080324292183, + 0.019886478781700134, + 0.0, + 0.22854547202587128, + 0.3025555722415447, + 0.03522500768303871, + 0.0, + 0.06435892824083567, + 0.0, + 0.0, + 0.07920435070991516, + 0.035584259778261185, + 0.1468554586172104, + 0.4734681658446789, + 0.10697721689939499, + 1.017220489680767, + 0.3207615241408348, + 1.0495565198361874 + ], + "unique_experts": 46, + "load_cv": 1.123863716834099, + "normalized_load_entropy": 0.8585047319088965, + "max_load_share": 0.08641975308641975 + }, + "full_input": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "3b351a1a7ffd26b583b8870ba873b3ee98ed5a99d2357eb4d8120fb045d9db6c", + "route_weight_sha256": "f8576bc910c7bbc51658b383e55847b70b17d5f503638e912af6e357e4c37612", + "loads": [ + 2, + 2, + 0, + 8, + 1, + 9, + 8, + 1, + 4, + 6, + 3, + 3, + 9, + 8, + 1, + 10, + 14, + 8, + 6, + 8, + 12, + 3, + 3, + 1, + 12, + 4, + 6, + 0, + 2, + 0, + 5, + 4, + 3, + 18, + 0, + 0, + 4, + 11, + 2, + 0, + 3, + 10, + 1, + 0, + 4, + 4, + 3, + 2, + 0, + 3, + 5, + 3, + 0, + 15, + 0, + 11, + 2, + 1, + 3, + 4, + 5, + 13, + 6, + 13 + ], + "weighted_loads": [ + 0.12367531284689903, + 0.09525735676288605, + 0.0, + 0.7949432451277971, + 0.05760278180241585, + 0.8205166198313236, + 0.30456801876425743, + 0.06124323606491089, + 0.4485298655927181, + 1.2870152667164803, + 0.17641302943229675, + 0.11083369329571724, + 0.530383788049221, + 0.45785325579345226, + 0.0475575253367424, + 1.1268964186310768, + 1.5996629390865564, + 0.5497743003070354, + 0.7216468546539545, + 0.5169955240562558, + 1.2262289877980947, + 0.11471343040466309, + 0.14162906631827354, + 0.03796642646193504, + 0.9278330523520708, + 0.1996443010866642, + 0.3116263374686241, + 0.0, + 0.22696848213672638, + 0.0, + 0.2024481501430273, + 0.306480772793293, + 0.1438399776816368, + 1.7751024030148983, + 0.0, + 0.0, + 0.1645477470010519, + 0.5265538040548563, + 0.07926756329834461, + 0.0, + 0.16926679387688637, + 1.3916389103978872, + 0.03137671947479248, + 0.0, + 0.14845224283635616, + 0.16832389682531357, + 0.2452080324292183, + 0.0667816624045372, + 0.0, + 0.22854547202587128, + 0.33878178521990776, + 0.14178971946239471, + 0.0, + 0.9988278793171048, + 0.0, + 0.9169509038329124, + 0.07920435070991516, + 0.035584259778261185, + 0.1468554586172104, + 0.4734681658446789, + 0.30583617836236954, + 1.114498559385538, + 0.3207615241408348, + 1.4760264791548252 + ], + "unique_experts": 54, + "load_cv": 0.8974358974358975, + "normalized_load_entropy": 0.8994702872495552, + "max_load_share": 0.057692307692307696 + } + }, + "s1_x": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "36f13a2176dbc6ede151992790f60ee264d2aa8509a41e2f6423888c0afb60fd", + "route_weight_sha256": "c6d0346d883f519f4f25cbf4e8157dfde1fd321cb6e13d344363f7ab1343bf95", + "loads": [ + 2, + 2, + 0, + 9, + 1, + 0, + 3, + 1, + 4, + 5, + 0, + 1, + 9, + 6, + 2, + 2, + 5, + 2, + 1, + 7, + 0, + 0, + 0, + 1, + 4, + 4, + 2, + 0, + 2, + 0, + 2, + 4, + 1, + 14, + 0, + 0, + 4, + 2, + 2, + 0, + 0, + 1, + 1, + 0, + 2, + 4, + 3, + 0, + 0, + 3, + 4, + 1, + 0, + 2, + 0, + 0, + 2, + 1, + 3, + 4, + 2, + 11, + 6, + 8 + ], + "weighted_loads": [ + 0.12808533012866974, + 0.08960805088281631, + 0.0, + 0.8305379245430231, + 0.05428403988480568, + 0.0, + 0.1075567789375782, + 0.062158938497304916, + 0.42741017788648605, + 0.6935455948114395, + 0.0, + 0.057726603001356125, + 0.5084779914468527, + 0.37988168001174927, + 0.07690868526697159, + 0.1315511092543602, + 1.171506341546774, + 0.18350420892238617, + 0.07373446226119995, + 0.4845303427428007, + 0.0, + 0.0, + 0.0, + 0.037171803414821625, + 0.2028588242828846, + 0.2067870832979679, + 0.08949244767427444, + 0.0, + 0.2173522412776947, + 0.0, + 0.061381688341498375, + 0.3126920722424984, + 0.020053749904036522, + 1.5086314305663109, + 0.0, + 0.0, + 0.15406562387943268, + 0.04613301157951355, + 0.09457141160964966, + 0.0, + 0.0, + 0.0631226971745491, + 0.030775003135204315, + 0.0, + 0.07492246478796005, + 0.14614488370716572, + 0.2509574927389622, + 0.0, + 0.0, + 0.23377928510308266, + 0.31615376472473145, + 0.03579099103808403, + 0.0, + 0.04933748859912157, + 0.0, + 0.0, + 0.08247239515185356, + 0.023800307884812355, + 0.15358470380306244, + 0.5468553751707077, + 0.10539788007736206, + 1.0211855880916119, + 0.325409771874547, + 1.227619657292962 + ], + "unique_experts": 46, + "load_cv": 1.1410907485063488, + "normalized_load_entropy": 0.8556897822087925, + "max_load_share": 0.08641975308641975 + }, + "full_input": { + "tokens": 68, + "top_k": 6, + "decisions": 408, + "ordered_route_sha256": "04270cac40b3e2b609f0d84f34c2dfe8cb27d9fb6f63721221d58cd1ddc4198c", + "route_weight_sha256": "ccf3a1e22e0839954981ced6b29f69cfe4eb29dce479e3a69cfbc6abdea10853", + "loads": [ + 2, + 5, + 0, + 11, + 1, + 9, + 7, + 2, + 4, + 7, + 8, + 3, + 9, + 9, + 3, + 14, + 13, + 14, + 9, + 7, + 14, + 3, + 3, + 2, + 19, + 4, + 11, + 0, + 2, + 0, + 7, + 4, + 7, + 19, + 1, + 2, + 4, + 11, + 5, + 3, + 4, + 16, + 2, + 2, + 5, + 9, + 4, + 6, + 4, + 6, + 10, + 2, + 0, + 16, + 0, + 12, + 4, + 2, + 3, + 5, + 4, + 12, + 9, + 13 + ], + "weighted_loads": [ + 0.12808533012866974, + 0.2110028825700283, + 0.0, + 0.9210110809653997, + 0.05428403988480568, + 0.8350483030080795, + 0.3082876056432724, + 0.08810618333518505, + 0.42741017788648605, + 1.1070332489907742, + 0.24015082232654095, + 0.11999849043786526, + 0.5084779914468527, + 0.472718907520175, + 0.12554283812642097, + 1.5865235775709152, + 1.4548237640410662, + 1.011332979425788, + 0.8536374215036631, + 0.4845303427428007, + 1.294464560225606, + 0.12639837339520454, + 0.12165233492851257, + 0.11257262527942657, + 1.5334521122276783, + 0.2067870832979679, + 1.1896397713571787, + 0.0, + 0.2173522412776947, + 0.0, + 0.24873041547834873, + 0.3126920722424984, + 0.3073284272104502, + 1.721021119505167, + 0.03575523942708969, + 0.11641072109341621, + 0.15406562387943268, + 0.5265530385077, + 0.24423394724726677, + 0.17640169709920883, + 0.18568004667758942, + 2.3486701920628548, + 0.0676216185092926, + 0.09356065467000008, + 0.1657414734363556, + 0.38029209710657597, + 0.28156047128140926, + 0.29377469420433044, + 0.15676669217646122, + 0.3938121981918812, + 0.5640504024922848, + 0.07789521291851997, + 0.0, + 1.2494149254634976, + 0.0, + 1.101490493863821, + 0.18993686139583588, + 0.09403897263109684, + 0.15358470380306244, + 0.7484194487333298, + 0.20440195128321648, + 1.0979301296174526, + 0.6564253028482199, + 1.555093603208661 + ], + "unique_experts": 59, + "load_cv": 0.7626921701481068, + "normalized_load_entropy": 0.9272743141196614, + "max_load_share": 0.04656862745098039 + } + }, + "s0_period": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "44b45674c94cb7f99ad828b2659153736b12e888e22ea9c81faafb976eecb110", + "route_weight_sha256": "d1c4f627968011150ee1d228ce2b866fa07c1fe0fb8c5469dec275a7179ad539", + "loads": [ + 2, + 2, + 0, + 8, + 1, + 0, + 4, + 1, + 4, + 5, + 0, + 3, + 9, + 7, + 2, + 2, + 5, + 2, + 1, + 7, + 0, + 0, + 0, + 0, + 3, + 4, + 2, + 0, + 2, + 0, + 2, + 4, + 1, + 14, + 0, + 0, + 4, + 2, + 2, + 0, + 0, + 2, + 0, + 0, + 2, + 3, + 3, + 2, + 0, + 3, + 4, + 2, + 0, + 2, + 0, + 0, + 1, + 1, + 3, + 4, + 2, + 11, + 5, + 7 + ], + "weighted_loads": [ + 0.12396888807415962, + 0.0954509936273098, + 0.0, + 0.8277713414281607, + 0.0578574538230896, + 0.0, + 0.1361060831695795, + 0.06338155269622803, + 0.4474057089537382, + 0.9316939935088158, + 0.0, + 0.1072395108640194, + 0.5212787948548794, + 0.42502665147185326, + 0.07574574090540409, + 0.14793004095554352, + 1.1902873702347279, + 0.19022497534751892, + 0.09200049936771393, + 0.4737385381013155, + 0.0, + 0.0, + 0.0, + 0.0, + 0.17736830189824104, + 0.20149734243750572, + 0.08876623958349228, + 0.0, + 0.20778899639844894, + 0.0, + 0.05950234457850456, + 0.3005139157176018, + 0.03758012875914574, + 1.5278003979474306, + 0.0, + 0.0, + 0.16066657565534115, + 0.053781152702867985, + 0.07533984631299973, + 0.0, + 0.0, + 0.09515323676168919, + 0.0, + 0.0, + 0.08405841141939163, + 0.10119578801095486, + 0.23899755999445915, + 0.059728916734457016, + 0.0, + 0.2393026165664196, + 0.3311391845345497, + 0.07259366661310196, + 0.0, + 0.06491794623434544, + 0.0, + 0.0, + 0.038035787642002106, + 0.03571756184101105, + 0.146239772439003, + 0.5298964455723763, + 0.10663434490561485, + 1.0128380712121725, + 0.29534054175019264, + 1.022133832797408 + ], + "unique_experts": 45, + "load_cv": 1.115150408178576, + "normalized_load_entropy": 0.8589063363590645, + "max_load_share": 0.08641975308641975 + }, + "full_input": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "b91464ec88f835cfba3c0ec4a04078dd77278b59404c51880e722dd40edde5d2", + "route_weight_sha256": "9f4220261fe43446f7b2a2f0f1dd126cb2aabd93ac367b75b4e718b1ee39fd9b", + "loads": [ + 2, + 2, + 0, + 8, + 1, + 10, + 8, + 1, + 4, + 6, + 4, + 4, + 9, + 8, + 2, + 10, + 14, + 8, + 6, + 8, + 13, + 2, + 4, + 0, + 11, + 4, + 6, + 0, + 2, + 0, + 5, + 4, + 2, + 18, + 0, + 0, + 4, + 10, + 3, + 0, + 3, + 10, + 0, + 0, + 4, + 4, + 3, + 4, + 0, + 3, + 4, + 4, + 0, + 14, + 0, + 11, + 1, + 1, + 3, + 4, + 6, + 13, + 5, + 12 + ], + "weighted_loads": [ + 0.12396888807415962, + 0.0954509936273098, + 0.0, + 0.8277713414281607, + 0.0578574538230896, + 0.8563946038484573, + 0.3064915891736746, + 0.06338155269622803, + 0.4474057089537382, + 1.309899739921093, + 0.2289564162492752, + 0.13732722587883472, + 0.5212787948548794, + 0.4441261924803257, + 0.07574574090540409, + 1.0838682875037193, + 1.66963298805058, + 0.6701844595372677, + 0.6463663894683123, + 0.5138800125569105, + 1.098743362352252, + 0.07996942475438118, + 0.18432365357875824, + 0.0, + 0.9278363436460495, + 0.20149734243750572, + 0.3517831787467003, + 0.0, + 0.20778899639844894, + 0.0, + 0.21492953412234783, + 0.3005139157176018, + 0.07733505219221115, + 1.7433694526553154, + 0.0, + 0.0, + 0.16066657565534115, + 0.4916746886447072, + 0.09363930858671665, + 0.0, + 0.16611867025494576, + 1.4570678863674402, + 0.0, + 0.0, + 0.17248423770070076, + 0.16800963692367077, + 0.23899755999445915, + 0.15045271068811417, + 0.0, + 0.2393026165664196, + 0.3311391845345497, + 0.17915837839245796, + 0.0, + 0.8717566095292568, + 0.0, + 0.8666150644421577, + 0.038035787642002106, + 0.03571756184101105, + 0.146239772439003, + 0.5298964455723763, + 0.33368199318647385, + 1.1083518546074629, + 0.29534054175019264, + 1.4062260817736387 + ], + "unique_experts": 52, + "load_cv": 0.8863787701253131, + "normalized_load_entropy": 0.8982922857188197, + "max_load_share": 0.057692307692307696 + } + }, + "s1_period": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "d612465fef728688cedd4e8e4b4290288445d3f7ce2497002dae50e60cb9ffc8", + "route_weight_sha256": "c14e7ce5c92531cd42a6e72bda85dd377923127179dcb1feeb4849b98c0ee8c3", + "loads": [ + 2, + 2, + 0, + 9, + 1, + 0, + 4, + 1, + 4, + 5, + 0, + 1, + 9, + 7, + 2, + 1, + 5, + 2, + 1, + 7, + 0, + 0, + 0, + 1, + 4, + 4, + 2, + 0, + 2, + 0, + 2, + 4, + 1, + 14, + 0, + 0, + 3, + 2, + 3, + 0, + 0, + 1, + 0, + 0, + 2, + 4, + 3, + 0, + 0, + 3, + 4, + 1, + 0, + 1, + 0, + 0, + 2, + 1, + 4, + 4, + 3, + 11, + 6, + 7 + ], + "weighted_loads": [ + 0.12916972488164902, + 0.09271164610981941, + 0.0, + 0.8622913043946028, + 0.057202499359846115, + 0.0, + 0.13016209565103054, + 0.06551757454872131, + 0.4389524217694998, + 0.7264111936092377, + 0.0, + 0.05969385802745819, + 0.5014480464160442, + 0.4189944211393595, + 0.07608091458678246, + 0.08178109675645828, + 1.1689303927123547, + 0.17972326278686523, + 0.07211373746395111, + 0.48529915884137154, + 0.0, + 0.0, + 0.0, + 0.03950163722038269, + 0.20783017203211784, + 0.2101213075220585, + 0.08731374889612198, + 0.0, + 0.21087732166051865, + 0.0, + 0.06167927384376526, + 0.2865404598414898, + 0.020104315131902695, + 1.5004312042146921, + 0.0, + 0.0, + 0.12231076508760452, + 0.04924132954329252, + 0.12334409169852734, + 0.0, + 0.0, + 0.05576383322477341, + 0.0, + 0.0, + 0.07820471003651619, + 0.1530267372727394, + 0.24630563147366047, + 0.0, + 0.0, + 0.23224152252078056, + 0.33046985045075417, + 0.03716817870736122, + 0.0, + 0.011781022883951664, + 0.0, + 0.0, + 0.0806853286921978, + 0.02220868691802025, + 0.19597868993878365, + 0.5820556543767452, + 0.1356132384389639, + 0.9871091321110725, + 0.3184884022921324, + 1.2297308202832937 + ], + "unique_experts": 45, + "load_cv": 1.1496074623462094, + "normalized_load_entropy": 0.8510106861114232, + "max_load_share": 0.08641975308641975 + }, + "full_input": { + "tokens": 68, + "top_k": 6, + "decisions": 408, + "ordered_route_sha256": "f03634428bdfcce410b11aa43154fdd7d5cde709b0b074678992f64f5a1580f9", + "route_weight_sha256": "f5073329fff6a08f9237e6adf6ed842d25e12eaeda720a7362c72e0ad6754926", + "loads": [ + 2, + 5, + 0, + 11, + 1, + 10, + 8, + 2, + 4, + 7, + 5, + 3, + 9, + 10, + 3, + 13, + 12, + 15, + 9, + 7, + 12, + 2, + 2, + 2, + 20, + 4, + 11, + 0, + 2, + 0, + 7, + 4, + 7, + 19, + 1, + 2, + 3, + 11, + 7, + 3, + 4, + 17, + 1, + 3, + 5, + 9, + 4, + 6, + 4, + 6, + 10, + 2, + 0, + 15, + 1, + 12, + 4, + 1, + 4, + 6, + 6, + 12, + 9, + 12 + ], + "weighted_loads": [ + 0.12916972488164902, + 0.2141064777970314, + 0.0, + 0.9527644608169794, + 0.057202499359846115, + 0.877851102501154, + 0.33089292235672474, + 0.09146481938660145, + 0.4389524217694998, + 1.1398988477885723, + 0.17678455263376236, + 0.12196574546396732, + 0.5014480464160442, + 0.5118316486477852, + 0.12471506744623184, + 1.4280563071370125, + 1.4127829875797033, + 1.087006701156497, + 0.8905658964067698, + 0.48529915884137154, + 0.9859363529831171, + 0.09001335129141808, + 0.08501680940389633, + 0.11490245908498764, + 1.597116831690073, + 0.2101213075220585, + 1.218203078955412, + 0.0, + 0.21087732166051865, + 0.0, + 0.28697969764471054, + 0.2865404598414898, + 0.2757112979888916, + 1.7199602406471968, + 0.03575523942708969, + 0.11641072109341621, + 0.12231076508760452, + 0.5296613564714789, + 0.3177931848913431, + 0.17640169709920883, + 0.17583738267421722, + 2.3201428949832916, + 0.03684661537408829, + 0.11383702047169209, + 0.17124314792454243, + 0.38717395067214966, + 0.27690861001610756, + 0.29377469420433044, + 0.15990219078958035, + 0.3922744356095791, + 0.5786752700805664, + 0.07927240058779716, + 0.0, + 1.1751188365742564, + 0.03660275787115097, + 1.019214428961277, + 0.18814979493618011, + 0.02220868691802025, + 0.19597868993878365, + 0.8136335760354996, + 0.2974489573389292, + 1.052456684410572, + 0.6495039332658052, + 1.546274421736598 + ], + "unique_experts": 60, + "load_cv": 0.7626921701481068, + "normalized_load_entropy": 0.9274783638829875, + "max_load_share": 0.049019607843137254 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 27, + "ordered_topk_exact_tokens": 19, + "set_exact_tokens": 21, + "mean_set_jaccard": 0.9365079365079365, + "mean_token_weighted_tv": 0.016809120998476392, + "aggregate_load_tv": 0.030864197530864196 + }, + "system_bos": { + "tokens": 27, + "ordered_topk_exact_tokens": 16, + "set_exact_tokens": 21, + "mean_set_jaccard": 0.9365079365079365, + "mean_token_weighted_tv": 0.02202388597652316, + "aggregate_load_tv": 0.037037037037037035 + }, + "system_x": { + "tokens": 27, + "ordered_topk_exact_tokens": 16, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.9153439153439153, + "mean_token_weighted_tv": 0.031056474497610773, + "aggregate_load_tv": 0.030864197530864196 + }, + "system_period": { + "tokens": 27, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.8862433862433863, + "mean_token_weighted_tv": 0.036408904301761476, + "aggregate_load_tv": 0.05555555555555555 + }, + "bos_at_s0": { + "tokens": 27, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.8862433862433863, + "mean_token_weighted_tv": 0.029003846562570997, + "aggregate_load_tv": 0.04938271604938271 + }, + "bos_at_s1": { + "tokens": 27, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.8941798941798943, + "mean_token_weighted_tv": 0.028906799714874337, + "aggregate_load_tv": 0.04938271604938271 + }, + "x_at_s0": { + "tokens": 27, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.8862433862433862, + "mean_token_weighted_tv": 0.0330938367276556, + "aggregate_load_tv": 0.05555555555555555 + }, + "x_at_s1": { + "tokens": 27, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 12, + "mean_set_jaccard": 0.8412698412698413, + "mean_token_weighted_tv": 0.048117830952698434, + "aggregate_load_tv": 0.08024691358024691 + }, + "period_at_s0": { + "tokens": 27, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.8862433862433862, + "mean_token_weighted_tv": 0.03530929510102228, + "aggregate_load_tv": 0.06172839506172839 + }, + "period_at_s1": { + "tokens": 27, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 12, + "mean_set_jaccard": 0.8333333333333335, + "mean_token_weighted_tv": 0.05462653231289652, + "aggregate_load_tv": 0.08024691358024691 + } + } + }, + "layer_17": { + "layer": 17, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "7d36d0e07824f83d530e97416ac5ae320b75b25f5277e37794d2535e2a33f3bc", + "route_weight_sha256": "47135c3c78661dc00844a56ec6876d1b95d07332eea27274a6ef9e4136540e45", + "loads": [ + 12, + 1, + 1, + 1, + 0, + 1, + 0, + 4, + 1, + 4, + 3, + 0, + 1, + 2, + 3, + 10, + 1, + 0, + 4, + 1, + 3, + 3, + 3, + 3, + 1, + 3, + 7, + 7, + 0, + 5, + 0, + 4, + 5, + 0, + 0, + 2, + 0, + 0, + 1, + 0, + 1, + 7, + 5, + 7, + 4, + 3, + 2, + 1, + 0, + 0, + 2, + 0, + 1, + 17, + 3, + 2, + 0, + 1, + 1, + 1, + 0, + 5, + 2, + 0 + ], + "weighted_loads": [ + 1.3668346665799618, + 0.040826454758644104, + 0.0336785726249218, + 0.14060577750205994, + 0.0, + 0.04600022733211517, + 0.0, + 0.31158580258488655, + 0.04301644116640091, + 0.13249843195080757, + 0.07820550724864006, + 0.0, + 0.034915730357170105, + 0.08359720557928085, + 0.14882321283221245, + 0.7021333910524845, + 0.24139456450939178, + 0.0, + 0.4244070854038, + 0.07251179218292236, + 0.12793439999222755, + 0.14741985127329826, + 0.2006722167134285, + 0.10067101195454597, + 0.06533918529748917, + 0.14540624991059303, + 1.9821157660335302, + 0.5253859320655465, + 0.0, + 0.2709325682371855, + 0.0, + 0.29161201417446136, + 0.5784497708082199, + 0.0, + 0.0, + 0.15111802704632282, + 0.0, + 0.0, + 0.041697245091199875, + 0.0, + 0.034699562937021255, + 0.3606375381350517, + 0.4712379276752472, + 0.5176942944526672, + 0.3521743305027485, + 0.15715624764561653, + 0.16373180598020554, + 0.048973750323057175, + 0.0, + 0.0, + 0.09668421372771263, + 0.0, + 0.0438959002494812, + 1.1331619210541248, + 0.2822648249566555, + 0.1526140794157982, + 0.0, + 0.029796969145536423, + 0.07829149812459946, + 0.07610122114419937, + 0.0, + 0.3418116755783558, + 0.7745252177119255, + 0.0 + ], + "unique_experts": 47, + "load_cv": 1.2295577350195395, + "normalized_load_entropy": 0.8472134917424841, + "max_load_share": 0.10493827160493827 + }, + "full_input": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "1e753a871e3c00f40e7f5b58a52e808fb32886bbb140ce7c1ffc0f51e2d35a06", + "route_weight_sha256": "84dd47d31884e012d4755ed3e54148201f568e432b6a7b174e5c77653c4a8584", + "loads": [ + 20, + 3, + 3, + 8, + 0, + 1, + 2, + 4, + 1, + 7, + 10, + 1, + 3, + 10, + 3, + 12, + 1, + 6, + 7, + 1, + 6, + 3, + 3, + 9, + 8, + 10, + 18, + 11, + 5, + 6, + 0, + 4, + 14, + 0, + 0, + 2, + 0, + 0, + 7, + 0, + 9, + 10, + 7, + 10, + 4, + 7, + 2, + 1, + 0, + 1, + 3, + 0, + 3, + 17, + 3, + 5, + 0, + 5, + 1, + 1, + 0, + 5, + 9, + 0 + ], + "weighted_loads": [ + 1.6195089761167765, + 0.12126514688134193, + 0.12899918109178543, + 0.7249755077064037, + 0.0, + 0.04600022733211517, + 0.09653342887759209, + 0.31158580258488655, + 0.04301644116640091, + 0.22124927304685116, + 0.5211754739284515, + 0.01849314756691456, + 0.09638877771794796, + 0.6750354841351509, + 0.14882321283221245, + 0.7944283485412598, + 0.24139456450939178, + 0.6248567253351212, + 0.545174540951848, + 0.07251179218292236, + 0.40936126187443733, + 0.14741985127329826, + 0.2006722167134285, + 0.3717583231627941, + 0.6409409679472446, + 0.5937013477087021, + 3.7561403270810843, + 0.7066753087565303, + 0.19717349857091904, + 0.2762437043711543, + 0.0, + 0.29161201417446136, + 0.9207911742851138, + 0.0, + 0.0, + 0.15111802704632282, + 0.0, + 0.0, + 0.287443071603775, + 0.0, + 1.1769130788743496, + 0.44586410420015454, + 0.6223050206899643, + 0.5783662502653897, + 0.3521743305027485, + 1.076484177261591, + 0.16373180598020554, + 0.048973750323057175, + 0.0, + 0.04028995335102081, + 0.16505076363682747, + 0.0, + 0.16737211495637894, + 1.1331619210541248, + 0.2822648249566555, + 0.32624372094869614, + 0.0, + 0.2275184877216816, + 0.07829149812459946, + 0.07610122114419937, + 0.0, + 0.3418116755783558, + 1.4385448433458805, + 0.0 + ], + "unique_experts": 52, + "load_cv": 0.968606500898672, + "normalized_load_entropy": 0.8846054854978955, + "max_load_share": 0.0641025641025641 + } + }, + "s1_eos": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "c7aaef8173953933b9348f980581d1a933eaf2d598b948435baf39cccc7e8615", + "route_weight_sha256": "13a2c358a8b29fc5fd26ce03bd6dc510a7e65dbd95f5ba9834079e427b8e1fca", + "loads": [ + 11, + 1, + 1, + 1, + 0, + 1, + 0, + 4, + 1, + 4, + 3, + 0, + 0, + 2, + 3, + 10, + 1, + 0, + 4, + 2, + 3, + 3, + 3, + 3, + 1, + 3, + 7, + 7, + 0, + 4, + 0, + 4, + 5, + 0, + 0, + 2, + 0, + 0, + 1, + 0, + 1, + 6, + 5, + 7, + 4, + 3, + 2, + 1, + 1, + 0, + 2, + 0, + 1, + 18, + 3, + 2, + 0, + 1, + 1, + 1, + 1, + 5, + 2, + 0 + ], + "weighted_loads": [ + 1.3882042299956083, + 0.04090007767081261, + 0.031269486993551254, + 0.1452402025461197, + 0.0, + 0.04591329023241997, + 0.0, + 0.3116842694580555, + 0.04620765149593353, + 0.1314490158110857, + 0.08095096237957478, + 0.0, + 0.0, + 0.08352592587471008, + 0.14368007332086563, + 0.7156740836799145, + 0.24158449470996857, + 0.0, + 0.3904705327004194, + 0.11081009730696678, + 0.1291462406516075, + 0.13475007936358452, + 0.197090532630682, + 0.10211906209588051, + 0.06455456465482712, + 0.14718276262283325, + 1.974041709676385, + 0.5171240530908108, + 0.0, + 0.2375848926603794, + 0.0, + 0.31085312739014626, + 0.5623601246625185, + 0.0, + 0.0, + 0.14701390452682972, + 0.0, + 0.0, + 0.04478675499558449, + 0.0, + 0.03515445068478584, + 0.31391648575663567, + 0.4611586816608906, + 0.5477283298969269, + 0.3657836243510246, + 0.15484336018562317, + 0.16792283207178116, + 0.05342268571257591, + 0.016161922365427017, + 0.0, + 0.09183672443032265, + 0.0, + 0.04433879256248474, + 1.1505570840090513, + 0.2856754660606384, + 0.15087395161390305, + 0.0, + 0.029858488589525223, + 0.0781315267086029, + 0.07773028314113617, + 0.034274399280548096, + 0.3589808978140354, + 0.7550735101103783, + 0.0 + ], + "unique_experts": 48, + "load_cv": 1.2235931954207233, + "normalized_load_entropy": 0.8525070826925365, + "max_load_share": 0.1111111111111111 + }, + "full_input": { + "tokens": 68, + "top_k": 6, + "decisions": 408, + "ordered_route_sha256": "16a04a043aec9721111bb6729931b15a7144e1a96c8e452ee69c6f4fc4a25485", + "route_weight_sha256": "e6e779ba8b346db0c1f21bf3091797e9bd43fdc1f31d08ab32183a368ff1ded1", + "loads": [ + 19, + 2, + 3, + 8, + 6, + 1, + 3, + 5, + 1, + 10, + 11, + 2, + 0, + 10, + 3, + 18, + 3, + 7, + 7, + 2, + 4, + 4, + 3, + 11, + 11, + 24, + 22, + 9, + 1, + 6, + 1, + 5, + 9, + 0, + 0, + 2, + 5, + 2, + 6, + 1, + 14, + 12, + 7, + 8, + 6, + 8, + 4, + 3, + 1, + 2, + 4, + 6, + 5, + 18, + 4, + 10, + 7, + 13, + 2, + 3, + 2, + 9, + 13, + 0 + ], + "weighted_loads": [ + 1.6973619321361184, + 0.08420459553599358, + 0.11146007478237152, + 0.8046387173235416, + 0.3918984401971102, + 0.04591329023241997, + 0.11797799170017242, + 0.3666619770228863, + 0.04620765149593353, + 0.32353256084024906, + 0.6439555268734694, + 0.06630056537687778, + 0.0, + 0.6880261078476906, + 0.14368007332086563, + 1.0964593291282654, + 0.4114297293126583, + 0.6096398048102856, + 0.501067167147994, + 0.11081009730696678, + 0.19596627354621887, + 0.21113568916916847, + 0.197090532630682, + 0.729849373921752, + 0.6679421421140432, + 1.5968375727534294, + 3.881539423018694, + 0.617903757840395, + 0.056494198739528656, + 0.3228336335159838, + 0.06065230816602707, + 0.35003354400396347, + 0.682214920874685, + 0.0, + 0.0, + 0.14701390452682972, + 0.2609148509800434, + 0.07375821471214294, + 0.42979783937335014, + 0.03376895189285278, + 1.8957479521632195, + 0.6402351558208466, + 0.5616163872182369, + 0.56652657315135, + 0.6012432798743248, + 1.55380230396986, + 0.38694556057453156, + 0.1855735294520855, + 0.016161922365427017, + 0.07758316770195961, + 0.2592330016195774, + 0.29496963508427143, + 0.2581809498369694, + 1.1505570840090513, + 0.37401605397462845, + 0.601341625675559, + 0.6189544312655926, + 0.6782492585480213, + 0.10150345601141453, + 0.171600554138422, + 0.06960964947938919, + 0.5854282155632973, + 1.6705442480742931, + 0.0 + ], + "unique_experts": 60, + "load_cv": 0.8549109551604565, + "normalized_load_entropy": 0.9164854660734595, + "max_load_share": 0.058823529411764705 + } + }, + "s0_bos": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "c36c36e8ce81b6a54daa386f09ee772f9ea397beb120c36a9433cdaf0e0aa836", + "route_weight_sha256": "f7270a806f72cef978233a3b4bd3ff38bcab4b29d2ae1dbd4b3b862a8d523cbf", + "loads": [ + 12, + 1, + 1, + 1, + 0, + 1, + 0, + 4, + 1, + 4, + 3, + 0, + 0, + 1, + 3, + 10, + 1, + 0, + 4, + 2, + 3, + 3, + 3, + 3, + 1, + 3, + 7, + 7, + 0, + 4, + 0, + 4, + 5, + 0, + 0, + 2, + 0, + 0, + 1, + 0, + 1, + 7, + 5, + 7, + 4, + 3, + 4, + 1, + 0, + 0, + 1, + 0, + 1, + 17, + 3, + 2, + 0, + 1, + 1, + 1, + 1, + 5, + 2, + 0 + ], + "weighted_loads": [ + 1.5227019786834717, + 0.04309257119894028, + 0.03430793061852455, + 0.1257360577583313, + 0.0, + 0.04934515804052353, + 0.0, + 0.31953372061252594, + 0.0418333038687706, + 0.1336966771632433, + 0.07741549797356129, + 0.0, + 0.0, + 0.047816578298807144, + 0.13832995109260082, + 0.6997183188796043, + 0.2437840700149536, + 0.0, + 0.41800419241189957, + 0.11146686226129532, + 0.1202983632683754, + 0.13719393499195576, + 0.20492545515298843, + 0.10403462499380112, + 0.07188829779624939, + 0.14962860196828842, + 1.9995111599564552, + 0.5371170854195952, + 0.0, + 0.25164978206157684, + 0.0, + 0.3104047253727913, + 0.5754920970648527, + 0.0, + 0.0, + 0.1530059315264225, + 0.0, + 0.0, + 0.04282769560813904, + 0.0, + 0.03366797789931297, + 0.35556131787598133, + 0.4505337178707123, + 0.5701225996017456, + 0.3521704189479351, + 0.15374556183815002, + 0.23952915892004967, + 0.04465518519282341, + 0.0, + 0.0, + 0.059699028730392456, + 0.0, + 0.04496302455663681, + 1.1161261480301619, + 0.2836945354938507, + 0.15631690993905067, + 0.0, + 0.029979731887578964, + 0.07173728942871094, + 0.08104795217514038, + 0.03861720487475395, + 0.3279659077525139, + 0.7679942473769188, + 0.0 + ], + "unique_experts": 47, + "load_cv": 1.2295577350195395, + "normalized_load_entropy": 0.8468118872923163, + "max_load_share": 0.10493827160493827 + }, + "full_input": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "fddcb912b9dd247062bccb074cdf1bac4c8427663dfdbafe4761f0f8fba1c4de", + "route_weight_sha256": "2435a892ad09c3dc8ba8f2e271e64494e60435ac389b3bd38b4cb698cdc1eae4", + "loads": [ + 19, + 3, + 2, + 8, + 0, + 1, + 2, + 4, + 1, + 7, + 9, + 1, + 4, + 9, + 3, + 14, + 1, + 6, + 7, + 3, + 6, + 4, + 3, + 9, + 7, + 10, + 15, + 10, + 4, + 4, + 1, + 4, + 14, + 0, + 0, + 2, + 0, + 0, + 7, + 0, + 9, + 9, + 7, + 9, + 4, + 7, + 4, + 1, + 0, + 2, + 2, + 0, + 3, + 18, + 4, + 5, + 0, + 4, + 1, + 2, + 1, + 6, + 10, + 0 + ], + "weighted_loads": [ + 1.8020926006138325, + 0.1264391988515854, + 0.08741495013237, + 0.7101057879626751, + 0.0, + 0.04934515804052353, + 0.09653342887759209, + 0.31953372061252594, + 0.0418333038687706, + 0.22244751825928688, + 0.47300501354038715, + 0.01849314756691456, + 0.2593077328056097, + 0.6392548568546772, + 0.13832995109260082, + 0.8790373653173447, + 0.2437840700149536, + 0.6248567253351212, + 0.6740889735519886, + 0.16695109382271767, + 0.41850732266902924, + 0.2137512806802988, + 0.20492545515298843, + 0.37512193620204926, + 0.6567097790539265, + 0.6095459498465061, + 2.7175476364791393, + 0.6669008517637849, + 0.1534874476492405, + 0.25164978206157684, + 0.0372164361178875, + 0.3104047253727913, + 0.9519873764365911, + 0.0, + 0.0, + 0.1530059315264225, + 0.0, + 0.0, + 0.2908282205462456, + 0.0, + 1.0821202956140041, + 0.4241902958601713, + 0.5908506326377392, + 0.6275798343122005, + 0.3521704189479351, + 0.9486378543078899, + 0.23952915892004967, + 0.04465518519282341, + 0.0, + 0.20710022374987602, + 0.1280655786395073, + 0.0, + 0.1745080091059208, + 1.1671897675842047, + 0.3568911552429199, + 0.33298570290207863, + 0.0, + 0.19785955548286438, + 0.07173728942871094, + 0.12463770061731339, + 0.03861720487475395, + 0.3653755262494087, + 1.2947642281651497, + 0.0 + ], + "unique_experts": 54, + "load_cv": 0.9227207289972605, + "normalized_load_entropy": 0.8960527885164161, + "max_load_share": 0.060897435897435896 + } + }, + "s1_bos": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "47cfdf4b41566f5d9319d304aeb5dafa793c859a28996ce54a7cd991dde2a174", + "route_weight_sha256": "aa076dc7ebea19559b77175e7d7425f83efe70fc8735d3135c7b20fc2fea54f6", + "loads": [ + 12, + 1, + 1, + 1, + 0, + 1, + 0, + 4, + 1, + 5, + 3, + 0, + 0, + 2, + 3, + 9, + 1, + 0, + 4, + 2, + 3, + 3, + 3, + 3, + 1, + 2, + 7, + 7, + 0, + 4, + 0, + 4, + 6, + 0, + 0, + 1, + 1, + 0, + 1, + 0, + 1, + 7, + 5, + 7, + 4, + 3, + 3, + 1, + 0, + 0, + 1, + 0, + 1, + 17, + 3, + 2, + 0, + 1, + 1, + 1, + 1, + 5, + 2, + 0 + ], + "weighted_loads": [ + 1.6260198410600424, + 0.04774319753050804, + 0.035259950906038284, + 0.12129760533571243, + 0.0, + 0.046430554240942, + 0.0, + 0.3244349807500839, + 0.04394116997718811, + 0.15625211969017982, + 0.0772924367338419, + 0.0, + 0.0, + 0.08575885370373726, + 0.1384500488638878, + 0.6688674874603748, + 0.23689161241054535, + 0.0, + 0.44191876240074635, + 0.10971889272332191, + 0.11334222927689552, + 0.14213747344911098, + 0.19897378236055374, + 0.10234512388706207, + 0.07109345495700836, + 0.10518771782517433, + 2.003017531707883, + 0.5393315842375159, + 0.0, + 0.2597145363688469, + 0.0, + 0.30080094933509827, + 0.6223029866814613, + 0.0, + 0.0, + 0.12645311653614044, + 0.03529878705739975, + 0.0, + 0.04669396951794624, + 0.0, + 0.034702230244874954, + 0.33208123594522476, + 0.46204495429992676, + 0.581457644701004, + 0.3506556674838066, + 0.15213558822870255, + 0.18879006057977676, + 0.03930656611919403, + 0.0, + 0.0, + 0.059355076402425766, + 0.0, + 0.04507943242788315, + 1.1297658700495958, + 0.2869396135210991, + 0.1539977416396141, + 0.0, + 0.030038980767130852, + 0.07502290606498718, + 0.07462069392204285, + 0.043832600116729736, + 0.32539073191583157, + 0.7304139137268066, + 0.0 + ], + "unique_experts": 48, + "load_cv": 1.219600630248378, + "normalized_load_entropy": 0.8500836783741741, + "max_load_share": 0.10493827160493827 + }, + "full_input": { + "tokens": 68, + "top_k": 6, + "decisions": 408, + "ordered_route_sha256": "66c76337c65cf258365d4e194f63b4eb1eeeada86bd1dbad019557007ed3de1c", + "route_weight_sha256": "762c474b0589a77a0c7bf224baf9b74a4aae9b1ea39ef86cc842504ac3bece71", + "loads": [ + 19, + 5, + 3, + 8, + 6, + 1, + 3, + 5, + 1, + 12, + 11, + 2, + 2, + 10, + 3, + 16, + 3, + 7, + 7, + 2, + 4, + 4, + 3, + 11, + 10, + 23, + 19, + 9, + 0, + 5, + 2, + 5, + 10, + 0, + 0, + 1, + 6, + 2, + 7, + 1, + 15, + 12, + 7, + 8, + 6, + 8, + 5, + 3, + 0, + 2, + 3, + 6, + 5, + 17, + 4, + 9, + 7, + 13, + 2, + 3, + 2, + 9, + 14, + 0 + ], + "weighted_loads": [ + 1.9428622089326382, + 0.2428603172302246, + 0.11545053869485855, + 0.7806961201131344, + 0.3918984401971102, + 0.046430554240942, + 0.11797799170017242, + 0.3794126883149147, + 0.04394116997718811, + 0.401204451918602, + 0.6148767601698637, + 0.06630056537687778, + 0.09178110584616661, + 0.6902590356767178, + 0.1384500488638878, + 1.0202882513403893, + 0.4067368470132351, + 0.6096398048102856, + 0.5583317782729864, + 0.10971889272332191, + 0.2097342647612095, + 0.21852308325469494, + 0.19897378236055374, + 0.7300754357129335, + 0.6932170167565346, + 1.5118521116673946, + 2.9418089725077152, + 0.6360289258882403, + 0.0, + 0.3397793546319008, + 0.08750244416296482, + 0.3399813659489155, + 0.7854267451912165, + 0.0, + 0.0, + 0.12645311653614044, + 0.29621363803744316, + 0.07375821471214294, + 0.4720601215958595, + 0.03376895189285278, + 1.8532647266983986, + 0.665462538599968, + 0.5625026598572731, + 0.6002558879554272, + 0.5861153230071068, + 1.5643409714102745, + 0.40781278908252716, + 0.1714574098587036, + 0.0, + 0.07999726757407188, + 0.2424551025032997, + 0.29496963508427143, + 0.269685760140419, + 1.1297658700495958, + 0.3752802014350891, + 0.58042280562222, + 0.6189544312655926, + 0.685009928420186, + 0.0983948353677988, + 0.1684909649193287, + 0.07916785031557083, + 0.5518380496650934, + 1.639535527676344, + 0.0 + ], + "unique_experts": 59, + "load_cv": 0.8190822970276637, + "normalized_load_entropy": 0.9199352850808965, + "max_load_share": 0.056372549019607844 + } + }, + "s0_x": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "9e7f8ae0a1f794d92e8bf80d10a552d0bd62608236c5dde08fb002b229a24963", + "route_weight_sha256": "27761168459c89b9e6cdbd7c54301934b365a7338aa06ec429fe517e8f42ba60", + "loads": [ + 11, + 0, + 1, + 1, + 0, + 1, + 0, + 4, + 1, + 3, + 4, + 0, + 0, + 2, + 3, + 10, + 1, + 0, + 4, + 1, + 3, + 3, + 3, + 3, + 1, + 3, + 8, + 7, + 0, + 4, + 0, + 4, + 6, + 0, + 0, + 2, + 1, + 0, + 1, + 0, + 1, + 7, + 5, + 7, + 4, + 3, + 2, + 1, + 0, + 0, + 2, + 0, + 1, + 17, + 3, + 2, + 0, + 1, + 1, + 1, + 1, + 5, + 2, + 0 + ], + "weighted_loads": [ + 1.5531960390508175, + 0.0, + 0.03041488490998745, + 0.12499608099460602, + 0.0, + 0.04783448576927185, + 0.0, + 0.3147118426859379, + 0.0384674072265625, + 0.09750721789896488, + 0.10256854817271233, + 0.0, + 0.0, + 0.08158751204609871, + 0.1366032473742962, + 0.6951244082301855, + 0.250060111284256, + 0.0, + 0.4344441816210747, + 0.07723358273506165, + 0.11492763459682465, + 0.13318155333399773, + 0.19834569469094276, + 0.10298414155840874, + 0.07394210994243622, + 0.15723104029893875, + 2.057453379034996, + 0.5768841011449695, + 0.0, + 0.2559069599956274, + 0.0, + 0.3318106457591057, + 0.6266514174640179, + 0.0, + 0.0, + 0.15158767253160477, + 0.03667200729250908, + 0.0, + 0.042369090020656586, + 0.0, + 0.03735937178134918, + 0.36586236394941807, + 0.45694320648908615, + 0.5776310004293919, + 0.3547906428575516, + 0.14869482442736626, + 0.1487148478627205, + 0.042393580079078674, + 0.0, + 0.0, + 0.09558113291859627, + 0.0, + 0.044638339430093765, + 1.16462492197752, + 0.2746669426560402, + 0.1643458530306816, + 0.0, + 0.02796306274831295, + 0.07066534459590912, + 0.07790995389223099, + 0.04076322540640831, + 0.3493577726185322, + 0.7104187831282616, + 0.0 + ], + "unique_experts": 47, + "load_cv": 1.2235931954207233, + "normalized_load_entropy": 0.8475496981237531, + "max_load_share": 0.10493827160493827 + }, + "full_input": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "70c16408ab14af050506ae8fe9e4a5a2e356404bd29c2bc1cf523e2a2cfd9d0a", + "route_weight_sha256": "fbb01b55e1603ff1061c0591327ab97ecc2ab2b175eafe7c4246da6c13b6927f", + "loads": [ + 17, + 1, + 4, + 9, + 0, + 1, + 2, + 4, + 1, + 7, + 12, + 1, + 2, + 11, + 3, + 12, + 1, + 7, + 7, + 1, + 5, + 4, + 3, + 10, + 7, + 11, + 15, + 10, + 4, + 4, + 0, + 4, + 15, + 0, + 0, + 2, + 1, + 0, + 8, + 0, + 9, + 9, + 7, + 9, + 4, + 8, + 2, + 1, + 1, + 1, + 4, + 0, + 3, + 17, + 4, + 6, + 0, + 5, + 1, + 1, + 1, + 5, + 8, + 0 + ], + "weighted_loads": [ + 1.7687154151499271, + 0.036002472043037415, + 0.1650914754718542, + 0.8586929999291897, + 0.0, + 0.04783448576927185, + 0.09653342887759209, + 0.3147118426859379, + 0.0384674072265625, + 0.23072455078363419, + 0.6975899301469326, + 0.01849314756691456, + 0.061473047360777855, + 0.7114659883081913, + 0.1366032473742962, + 0.8005522917956114, + 0.250060111284256, + 0.6702182404696941, + 0.7364520765841007, + 0.07723358273506165, + 0.3142603188753128, + 0.17605968192219734, + 0.19834569469094276, + 0.43174008280038834, + 0.6214471943676472, + 0.6339026018977165, + 2.669108461588621, + 0.7066678674891591, + 0.16018906980752945, + 0.2559069599956274, + 0.0, + 0.3318106457591057, + 1.0041104219853878, + 0.0, + 0.0, + 0.15158767253160477, + 0.03667200729250908, + 0.0, + 0.3460598923265934, + 0.0, + 1.0537374578416348, + 0.44569541700184345, + 0.612414225935936, + 0.6350882351398468, + 0.3547906428575516, + 1.0912406407296658, + 0.1487148478627205, + 0.042393580079078674, + 0.04122604429721832, + 0.03762832283973694, + 0.22981910780072212, + 0.0, + 0.18447579070925713, + 1.16462492197752, + 0.31634943187236786, + 0.3809540681540966, + 0.0, + 0.228389548137784, + 0.07066534459590912, + 0.07790995389223099, + 0.04076322540640831, + 0.3493577726185322, + 1.0785247944295406, + 0.0 + ], + "unique_experts": 55, + "load_cv": 0.9276950007756688, + "normalized_load_entropy": 0.8927894225593546, + "max_load_share": 0.05448717948717949 + } + }, + "s1_x": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "550ebdd182d56718a1bf7d0bf9fa3a1f131c58e2753ba359f7b0c5995731b9b6", + "route_weight_sha256": "3edb296d46f9bbe77d31f930f7bc662f86a466d988e7ef3f6b6a198bbc60350a", + "loads": [ + 11, + 0, + 1, + 1, + 0, + 1, + 0, + 4, + 1, + 3, + 3, + 0, + 1, + 2, + 3, + 9, + 1, + 0, + 4, + 1, + 3, + 3, + 3, + 1, + 1, + 3, + 7, + 7, + 0, + 4, + 0, + 4, + 6, + 0, + 0, + 2, + 1, + 0, + 1, + 0, + 1, + 7, + 5, + 7, + 4, + 3, + 2, + 1, + 0, + 0, + 2, + 1, + 1, + 17, + 3, + 2, + 0, + 1, + 1, + 1, + 1, + 7, + 3, + 0 + ], + "weighted_loads": [ + 1.716004565358162, + 0.0, + 0.028774119913578033, + 0.12268692255020142, + 0.0, + 0.046457789838314056, + 0.0, + 0.3137296624481678, + 0.038742464035749435, + 0.07802523113787174, + 0.07653296180069447, + 0.0, + 0.025308893993496895, + 0.08947007358074188, + 0.13726982474327087, + 0.6125696040689945, + 0.24140846729278564, + 0.0, + 0.4780755080282688, + 0.07873444259166718, + 0.10189543664455414, + 0.13705219328403473, + 0.20032661966979504, + 0.04527847096323967, + 0.06325676292181015, + 0.15029428899288177, + 2.055703692138195, + 0.574011217802763, + 0.0, + 0.28432201221585274, + 0.0, + 0.30789222195744514, + 0.6220821868628263, + 0.0, + 0.0, + 0.15539764799177647, + 0.03479576110839844, + 0.0, + 0.026684265583753586, + 0.0, + 0.03882100433111191, + 0.3227201532572508, + 0.48539240285754204, + 0.6171802058815956, + 0.34144826233386993, + 0.1477135643362999, + 0.1231275238096714, + 0.039824653416872025, + 0.0, + 0.0, + 0.09552744403481483, + 0.036562997847795486, + 0.04530850052833557, + 1.138531530275941, + 0.28459062054753304, + 0.15556581318378448, + 0.0, + 0.026064427569508553, + 0.07227449864149094, + 0.0719938725233078, + 0.0420309379696846, + 0.414861086755991, + 0.5223726332187653, + 0.0 + ], + "unique_experts": 49, + "load_cv": 1.2055225258287152, + "normalized_load_entropy": 0.853971241332971, + "max_load_share": 0.10493827160493827 + }, + "full_input": { + "tokens": 68, + "top_k": 6, + "decisions": 408, + "ordered_route_sha256": "473a43398678af1f1aecc32b0a536b251b5fffc211399bf4231224868b9507f7", + "route_weight_sha256": "b64eb1836f44a6996d8a4404a5ad6a23dadea1978f2ca1225b3d91b296f14848", + "loads": [ + 17, + 1, + 4, + 9, + 6, + 1, + 3, + 5, + 1, + 10, + 12, + 2, + 1, + 11, + 3, + 17, + 3, + 8, + 7, + 1, + 3, + 4, + 3, + 10, + 10, + 26, + 17, + 8, + 0, + 5, + 1, + 5, + 10, + 0, + 0, + 2, + 6, + 2, + 6, + 1, + 14, + 12, + 10, + 8, + 6, + 8, + 4, + 3, + 1, + 1, + 4, + 7, + 5, + 17, + 4, + 10, + 7, + 14, + 3, + 3, + 2, + 13, + 11, + 0 + ], + "weighted_loads": [ + 1.9752131346613169, + 0.04330451786518097, + 0.16958019509911537, + 0.9446357823908329, + 0.3918984401971102, + 0.046457789838314056, + 0.11797799170017242, + 0.3687073700129986, + 0.038742464035749435, + 0.30513342283666134, + 0.7846835609525442, + 0.06630056537687778, + 0.025308893993496895, + 0.7559777945280075, + 0.13726982474327087, + 1.0134339481592178, + 0.4112537018954754, + 0.6593281365931034, + 0.6050063073635101, + 0.07873444259166718, + 0.10189543664455414, + 0.21343780308961868, + 0.20032661966979504, + 0.7020790260285139, + 0.7133376151323318, + 1.6357778906822205, + 2.819913810119033, + 0.6157444939017296, + 0.0, + 0.36438683047890663, + 0.06065230816602707, + 0.34707263857126236, + 0.787327978760004, + 0.0, + 0.0, + 0.15539764799177647, + 0.29571061208844185, + 0.07375821471214294, + 0.41937948763370514, + 0.03376895189285278, + 1.7392023392021656, + 0.6178848203271627, + 0.7222286127507687, + 0.6359784491360188, + 0.5769079178571701, + 1.377934768795967, + 0.3421502523124218, + 0.1719754971563816, + 0.03961171954870224, + 0.04012463614344597, + 0.3183980993926525, + 0.3315326329320669, + 0.27923739701509476, + 1.138531530275941, + 0.37293120846152306, + 0.6231786254793406, + 0.6189544312655926, + 0.7458351124078035, + 0.14736018143594265, + 0.16586414352059364, + 0.0773661881685257, + 0.7099784947931767, + 1.0959667600691319, + 0.0 + ], + "unique_experts": 60, + "load_cv": 0.8381062852220592, + "normalized_load_entropy": 0.91667326710176, + "max_load_share": 0.06372549019607843 + } + }, + "s0_period": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "208ab7dc9314ba9e9abde8edc22c70de00fbb7b1b214f616cc53066924dd2fba", + "route_weight_sha256": "b110aee5e7ada466f7d9fcb68ca713be19cb54b150d9bd47dc427cfb2dfc5d21", + "loads": [ + 12, + 0, + 1, + 1, + 0, + 1, + 0, + 4, + 1, + 4, + 4, + 0, + 0, + 2, + 3, + 9, + 1, + 0, + 4, + 1, + 3, + 3, + 3, + 2, + 1, + 3, + 8, + 7, + 0, + 4, + 0, + 4, + 5, + 0, + 0, + 2, + 1, + 0, + 1, + 0, + 1, + 7, + 5, + 7, + 4, + 3, + 2, + 1, + 0, + 0, + 2, + 0, + 1, + 17, + 3, + 2, + 0, + 1, + 1, + 1, + 1, + 6, + 2, + 0 + ], + "weighted_loads": [ + 1.571803281083703, + 0.0, + 0.030653271824121475, + 0.12107006460428238, + 0.0, + 0.048411719501018524, + 0.0, + 0.32733576372265816, + 0.039209578186273575, + 0.11427926644682884, + 0.10539654083549976, + 0.0, + 0.0, + 0.08234206587076187, + 0.13332162238657475, + 0.6420333124697208, + 0.24709486961364746, + 0.0, + 0.4581573884934187, + 0.07476583123207092, + 0.11696485430002213, + 0.13626412115991116, + 0.20317549630999565, + 0.06614291109144688, + 0.07831678539514542, + 0.16218537464737892, + 2.0769232530146837, + 0.5396014200523496, + 0.0, + 0.2817302271723747, + 0.0, + 0.3341641128063202, + 0.5794521868228912, + 0.0, + 0.0, + 0.15329122357070446, + 0.037724677473306656, + 0.0, + 0.04444928094744682, + 0.0, + 0.036853913217782974, + 0.34773516096174717, + 0.45405616983771324, + 0.6099188402295113, + 0.34710588306188583, + 0.1497928947210312, + 0.15526451170444489, + 0.047561079263687134, + 0.0, + 0.0, + 0.09222216159105301, + 0.0, + 0.04477633535861969, + 1.1603863816708326, + 0.27100782096385956, + 0.16175605356693268, + 0.0, + 0.02743992768228054, + 0.07074330002069473, + 0.07453159987926483, + 0.03807370364665985, + 0.36341627687215805, + 0.73285311460495, + 0.0 + ], + "unique_experts": 47, + "load_cv": 1.2295577350195395, + "normalized_load_entropy": 0.8467615589638521, + "max_load_share": 0.10493827160493827 + }, + "full_input": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "ad9bb0a7db31c2b2d8bc07f6320dbac86d9778ba2fe0fa2112c8911471664a2b", + "route_weight_sha256": "4a33e1ccde11013623f3217ca9f9cbef02ac1288e1eb6e005f48953a89f78d57", + "loads": [ + 18, + 1, + 3, + 9, + 0, + 1, + 2, + 4, + 1, + 8, + 11, + 1, + 2, + 10, + 3, + 12, + 1, + 6, + 7, + 1, + 6, + 4, + 3, + 8, + 7, + 12, + 15, + 10, + 4, + 5, + 0, + 4, + 14, + 0, + 0, + 2, + 1, + 0, + 6, + 0, + 8, + 9, + 9, + 9, + 4, + 8, + 2, + 1, + 0, + 1, + 4, + 0, + 3, + 17, + 4, + 7, + 0, + 6, + 1, + 1, + 1, + 7, + 8, + 0 + ], + "weighted_loads": [ + 1.790225064381957, + 0.036002472043037415, + 0.1501980870962143, + 0.7524560950696468, + 0.0, + 0.048411719501018524, + 0.09653342887759209, + 0.32733576372265816, + 0.039209578186273575, + 0.23658032156527042, + 0.5587715860456228, + 0.01849314756691456, + 0.061473047360777855, + 0.6737803444266319, + 0.13332162238657475, + 0.7942465543746948, + 0.24709486961364746, + 0.6248567253351212, + 0.8017937187105417, + 0.07476583123207092, + 0.36521581932902336, + 0.18159333430230618, + 0.20317549630999565, + 0.337230222299695, + 0.5678286738693714, + 0.6798520796000957, + 2.6920978780835867, + 0.6693851863965392, + 0.15522794798016548, + 0.31751757860183716, + 0.0, + 0.3341641128063202, + 0.9540501162409782, + 0.0, + 0.0, + 0.15329122357070446, + 0.037724677473306656, + 0.0, + 0.27607838064432144, + 0.0, + 1.0077473782002926, + 0.4411477576941252, + 0.698274590075016, + 0.6673760749399662, + 0.34710588306188583, + 1.1906269304454327, + 0.15526451170444489, + 0.047561079263687134, + 0.0, + 0.03498174995183945, + 0.23349275439977646, + 0.0, + 0.1829456090927124, + 1.1603863816708326, + 0.31590505316853523, + 0.546105045825243, + 0.0, + 0.26097542606294155, + 0.07074330002069473, + 0.07453159987926483, + 0.03807370364665985, + 0.40430959686636925, + 1.115793813019991, + 0.0 + ], + "unique_experts": 54, + "load_cv": 0.926986024744883, + "normalized_load_entropy": 0.8913839252269604, + "max_load_share": 0.057692307692307696 + } + }, + "s1_period": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "108445e5dd68fc83ab586d521f493b5f31a77d494280b8b6ffe4e77cb9b74763", + "route_weight_sha256": "7f59db0a691245fd8e98ed0e72fbee716592a3a3a48f2903edea6a8911d627cd", + "loads": [ + 12, + 0, + 0, + 1, + 0, + 1, + 0, + 4, + 1, + 2, + 3, + 0, + 1, + 2, + 3, + 9, + 1, + 0, + 4, + 1, + 3, + 3, + 2, + 1, + 1, + 4, + 8, + 7, + 0, + 4, + 1, + 3, + 7, + 0, + 0, + 2, + 0, + 0, + 1, + 0, + 1, + 7, + 6, + 7, + 4, + 3, + 2, + 1, + 1, + 0, + 2, + 0, + 1, + 16, + 3, + 2, + 0, + 1, + 1, + 1, + 1, + 8, + 2, + 0 + ], + "weighted_loads": [ + 1.7487952001392841, + 0.0, + 0.0, + 0.11957428604364395, + 0.0, + 0.0476902611553669, + 0.0, + 0.3218977451324463, + 0.03746596351265907, + 0.03535621240735054, + 0.07732963748276234, + 0.0, + 0.025005269795656204, + 0.09250106289982796, + 0.1330335345119238, + 0.6207743212580681, + 0.23728613555431366, + 0.0, + 0.5510135442018509, + 0.07682136446237564, + 0.10675203241407871, + 0.1342458315193653, + 0.17745331302285194, + 0.0443660132586956, + 0.06513075530529022, + 0.1819997802376747, + 2.1175514310598373, + 0.5582932783290744, + 0.0, + 0.2804603651165962, + 0.03231729567050934, + 0.263724684715271, + 0.63578971195966, + 0.0, + 0.0, + 0.15214406326413155, + 0.0, + 0.0, + 0.023594412952661514, + 0.0, + 0.03574919328093529, + 0.3267875574529171, + 0.5398428477346897, + 0.6199651807546616, + 0.34078141301870346, + 0.1583155356347561, + 0.12442391365766525, + 0.04194601625204086, + 0.025748006999492645, + 0.0, + 0.09020593017339706, + 0.0, + 0.04695352539420128, + 1.0810343325138092, + 0.27004342898726463, + 0.16423634439706802, + 0.0, + 0.025389613583683968, + 0.07175535708665848, + 0.07585373520851135, + 0.04349616914987564, + 0.44719114527106285, + 0.5510508269071579, + 0.0 + ], + "unique_experts": 48, + "load_cv": 1.2335180721513714, + "normalized_load_entropy": 0.845788991881266, + "max_load_share": 0.09876543209876543 + }, + "full_input": { + "tokens": 68, + "top_k": 6, + "decisions": 408, + "ordered_route_sha256": "7f363ff8f292ed9489b67acb9fa8c0b219cc99e50a253141ea0ff377be677666", + "route_weight_sha256": "afe51778bd846f718a0062bfe8cb4f2b334fbc8e6bc263986767a9ad9c371803", + "loads": [ + 18, + 1, + 3, + 9, + 6, + 1, + 3, + 5, + 1, + 8, + 12, + 2, + 2, + 10, + 3, + 18, + 3, + 7, + 7, + 1, + 3, + 4, + 2, + 9, + 10, + 28, + 18, + 8, + 2, + 5, + 2, + 4, + 10, + 0, + 0, + 2, + 5, + 2, + 6, + 1, + 14, + 13, + 12, + 8, + 6, + 8, + 4, + 3, + 1, + 0, + 4, + 6, + 5, + 16, + 4, + 12, + 7, + 15, + 2, + 3, + 2, + 12, + 10, + 0 + ], + "weighted_loads": [ + 2.007893478497863, + 0.04330451786518097, + 0.12537024915218353, + 0.8354801125824451, + 0.3918984401971102, + 0.0476902611553669, + 0.11797799170017242, + 0.37687545269727707, + 0.03746596351265907, + 0.2274397574365139, + 0.671132642775774, + 0.06630056537687778, + 0.0741422064602375, + 0.6970012448728085, + 0.1330335345119238, + 1.0704189836978912, + 0.4071313701570034, + 0.6096398048102856, + 0.7022583447396755, + 0.07682136446237564, + 0.10675203241407871, + 0.21063144132494926, + 0.17745331302285194, + 0.6720963250845671, + 0.6530278399586678, + 1.7611967511475086, + 2.8771799076348543, + 0.600026554428041, + 0.06140338070690632, + 0.3605251833796501, + 0.09296960383653641, + 0.3029051013290882, + 0.7512431470677257, + 0.0, + 0.0, + 0.15214406326413155, + 0.2609148509800434, + 0.07375821471214294, + 0.40897678956389427, + 0.03376895189285278, + 1.6791748851537704, + 0.6868984550237656, + 0.8169894330203533, + 0.6387634240090847, + 0.5762410685420036, + 1.5629157535731792, + 0.34344664216041565, + 0.17409685999155045, + 0.025748006999492645, + 0.0, + 0.2871066480875015, + 0.29496963508427143, + 0.2865323983132839, + 1.0810343325138092, + 0.35838401690125465, + 0.8501794654875994, + 0.6189544312655926, + 0.8098529260605574, + 0.0951272863894701, + 0.1697240062057972, + 0.07883141934871674, + 0.6736384630203247, + 1.1103651523590088, + 0.0 + ], + "unique_experts": 60, + "load_cv": 0.8705087404087495, + "normalized_load_entropy": 0.9141443242649606, + "max_load_share": 0.06862745098039216 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 27, + "ordered_topk_exact_tokens": 18, + "set_exact_tokens": 22, + "mean_set_jaccard": 0.9470899470899471, + "mean_token_weighted_tv": 0.014581615881373486, + "aggregate_load_tv": 0.024691358024691357 + }, + "system_bos": { + "tokens": 27, + "ordered_topk_exact_tokens": 17, + "set_exact_tokens": 22, + "mean_set_jaccard": 0.9391534391534392, + "mean_token_weighted_tv": 0.019915392863805646, + "aggregate_load_tv": 0.024691358024691357 + }, + "system_x": { + "tokens": 27, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 21, + "mean_set_jaccard": 0.9285714285714286, + "mean_token_weighted_tv": 0.030637250092156506, + "aggregate_load_tv": 0.030864197530864196 + }, + "system_period": { + "tokens": 27, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.9074074074074074, + "mean_token_weighted_tv": 0.03361164017890891, + "aggregate_load_tv": 0.05555555555555555 + }, + "bos_at_s0": { + "tokens": 27, + "ordered_topk_exact_tokens": 17, + "set_exact_tokens": 22, + "mean_set_jaccard": 0.9470899470899471, + "mean_token_weighted_tv": 0.020412008726486453, + "aggregate_load_tv": 0.024691358024691357 + }, + "bos_at_s1": { + "tokens": 27, + "ordered_topk_exact_tokens": 16, + "set_exact_tokens": 20, + "mean_set_jaccard": 0.9179894179894179, + "mean_token_weighted_tv": 0.028508906752836925, + "aggregate_load_tv": 0.037037037037037035 + }, + "x_at_s0": { + "tokens": 27, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 20, + "mean_set_jaccard": 0.9259259259259259, + "mean_token_weighted_tv": 0.02970320514092843, + "aggregate_load_tv": 0.030864197530864196 + }, + "x_at_s1": { + "tokens": 27, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.8721340388007055, + "mean_token_weighted_tv": 0.048793546889943105, + "aggregate_load_tv": 0.04938271604938271 + }, + "period_at_s0": { + "tokens": 27, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.9153439153439153, + "mean_token_weighted_tv": 0.031683202660470096, + "aggregate_load_tv": 0.030864197530864196 + }, + "period_at_s1": { + "tokens": 27, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.8571428571428572, + "mean_token_weighted_tv": 0.05219410018374523, + "aggregate_load_tv": 0.07407407407407407 + } + } + }, + "layer_18": { + "layer": 18, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "9131931525d0e8296fbd55374482fda3971492be3d029c78a081ec4325ccd4da", + "route_weight_sha256": "557cec2b2e8d4322a7d9c3fdb0d54559f97ee3a057065b489400fafff8ad26a9", + "loads": [ + 1, + 3, + 10, + 2, + 0, + 10, + 0, + 0, + 0, + 0, + 3, + 8, + 0, + 1, + 0, + 0, + 1, + 0, + 2, + 4, + 0, + 0, + 0, + 0, + 1, + 11, + 0, + 0, + 3, + 0, + 4, + 4, + 1, + 3, + 1, + 2, + 10, + 12, + 1, + 1, + 5, + 1, + 2, + 1, + 4, + 0, + 0, + 10, + 0, + 9, + 0, + 2, + 1, + 0, + 2, + 0, + 10, + 1, + 3, + 5, + 0, + 3, + 3, + 1 + ], + "weighted_loads": [ + 0.07037829607725143, + 0.1618318036198616, + 0.7510258685797453, + 0.11884358525276184, + 0.0, + 0.8909051846712828, + 0.0, + 0.0, + 0.0, + 0.0, + 0.07888540253043175, + 0.740163329988718, + 0.0, + 0.10318361967802048, + 0.0, + 0.0, + 0.09370818734169006, + 0.0, + 0.06995179504156113, + 0.13546913489699364, + 0.0, + 0.0, + 0.0, + 0.0, + 0.026539361104369164, + 0.7219830695539713, + 0.0, + 0.0, + 0.08894894272089005, + 0.0, + 0.4651988670229912, + 0.5449882000684738, + 0.04496387392282486, + 0.28224410116672516, + 0.022070124745368958, + 0.09489819779992104, + 0.8274842333048582, + 0.726629015058279, + 0.02583097666501999, + 0.01594911701977253, + 0.38288405537605286, + 0.04694905877113342, + 0.0752916932106018, + 0.043213874101638794, + 0.2832251414656639, + 0.0, + 0.0, + 0.8867713864892721, + 0.0, + 0.49195372126996517, + 0.0, + 0.191220223903656, + 0.07807284593582153, + 0.0, + 0.050975166261196136, + 0.0, + 1.089004648849368, + 0.056502752006053925, + 0.1434822902083397, + 0.8612968623638153, + 0.0, + 0.10021395608782768, + 0.11707258224487305, + 0.02360345423221588 + ], + "unique_experts": 41, + "load_cv": 1.3194868594727622, + "normalized_load_entropy": 0.8115773450949365, + "max_load_share": 0.07407407407407407 + }, + "full_input": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "3e85cfd407addae43a9b3909b0395e7bca29ad4a05b397b38faa123d2bb8853f", + "route_weight_sha256": "b383ce961689547ba0ac7ca242fa10e1d91e0bfb12f4c6f4aa7c3fbf678da84f", + "loads": [ + 7, + 4, + 22, + 2, + 0, + 12, + 0, + 0, + 10, + 0, + 4, + 12, + 1, + 1, + 5, + 4, + 1, + 0, + 22, + 4, + 0, + 1, + 0, + 0, + 1, + 11, + 0, + 0, + 3, + 0, + 13, + 4, + 2, + 3, + 1, + 5, + 11, + 16, + 1, + 3, + 9, + 1, + 5, + 1, + 4, + 0, + 8, + 10, + 3, + 21, + 2, + 5, + 10, + 8, + 2, + 0, + 12, + 1, + 4, + 9, + 0, + 5, + 3, + 3 + ], + "weighted_loads": [ + 0.4543287195265293, + 0.23223626613616943, + 1.7904174402356148, + 0.11884358525276184, + 0.0, + 0.9398223496973515, + 0.0, + 0.0, + 0.6433929111808538, + 0.0, + 0.089883285574615, + 1.091959834098816, + 0.03213396668434143, + 0.10318361967802048, + 1.1568010784685612, + 0.13278388790786266, + 0.09370818734169006, + 0.0, + 1.6701099202036858, + 0.13546913489699364, + 0.0, + 0.02566339448094368, + 0.0, + 0.0, + 0.026539361104369164, + 0.7219830695539713, + 0.0, + 0.0, + 0.08894894272089005, + 0.0, + 1.3676488613709807, + 0.5449882000684738, + 0.059288750402629375, + 0.28224410116672516, + 0.022070124745368958, + 0.27394263818860054, + 0.8510128986090422, + 0.894654018804431, + 0.02583097666501999, + 0.06358317844569683, + 0.5725861601531506, + 0.04694905877113342, + 0.15806769579648972, + 0.043213874101638794, + 0.2832251414656639, + 0.0, + 1.3647053390741348, + 0.8867713864892721, + 0.14373119920492172, + 1.0259583555161953, + 0.06106533482670784, + 0.3563467040657997, + 0.6858393643051386, + 0.4667775072157383, + 0.050975166261196136, + 0.0, + 2.0868091266602278, + 0.056502752006053925, + 0.1724778711795807, + 1.0562703870236874, + 0.0, + 0.15459584072232246, + 0.11707258224487305, + 0.11693517863750458 + ], + "unique_experts": 50, + "load_cv": 1.1302429148991893, + "normalized_load_entropy": 0.857037643430908, + "max_load_share": 0.07051282051282051 + } + }, + "s1_eos": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "553ba674edfb8417a53e2045903a4ac860f5f26aee92a9b7f75c2c75c1720f7f", + "route_weight_sha256": "1a0397851de83576cd0ef65b2b15078f6e48a6b02145e42680687ab4e0fd7daf", + "loads": [ + 1, + 3, + 9, + 2, + 0, + 10, + 0, + 0, + 0, + 0, + 3, + 6, + 0, + 1, + 0, + 0, + 1, + 1, + 2, + 3, + 0, + 0, + 0, + 0, + 1, + 11, + 0, + 0, + 4, + 0, + 4, + 4, + 2, + 3, + 0, + 2, + 10, + 12, + 1, + 0, + 5, + 1, + 3, + 1, + 4, + 0, + 0, + 11, + 0, + 9, + 1, + 2, + 1, + 0, + 2, + 0, + 10, + 1, + 3, + 5, + 0, + 3, + 3, + 1 + ], + "weighted_loads": [ + 0.06365253031253815, + 0.16354376636445522, + 0.7176257167011499, + 0.11810999363660812, + 0.0, + 0.9027681648731232, + 0.0, + 0.0, + 0.0, + 0.0, + 0.078219935297966, + 0.6916420236229897, + 0.0, + 0.10748864710330963, + 0.0, + 0.0, + 0.10075791925191879, + 0.014425230212509632, + 0.07005787268280983, + 0.11680947057902813, + 0.0, + 0.0, + 0.0, + 0.0, + 0.026465686038136482, + 0.7008518669754267, + 0.0, + 0.0, + 0.1154479831457138, + 0.0, + 0.4440353214740753, + 0.6138867773115635, + 0.07586177624762058, + 0.28362756967544556, + 0.0, + 0.10393566265702248, + 0.826732087880373, + 0.7241440657526255, + 0.02651531994342804, + 0.0, + 0.3727596774697304, + 0.04553726688027382, + 0.11564896441996098, + 0.04319431260228157, + 0.26968245953321457, + 0.0, + 0.0, + 0.9136856887489557, + 0.0, + 0.49333054944872856, + 0.02338303253054619, + 0.19050661474466324, + 0.07629907131195068, + 0.0, + 0.04927011765539646, + 0.0, + 1.1059597097337246, + 0.056271862238645554, + 0.16917459666728973, + 0.8599852360785007, + 0.0, + 0.09646917507052422, + 0.12404538318514824, + 0.023914584890007973 + ], + "unique_experts": 41, + "load_cv": 1.3027470302103326, + "normalized_load_entropy": 0.8152716111168149, + "max_load_share": 0.07407407407407407 + }, + "full_input": { + "tokens": 68, + "top_k": 6, + "decisions": 408, + "ordered_route_sha256": "9235dab47cb5900bb0da1ee945f34e866a0aa99297b013293c12675b394ad2ca", + "route_weight_sha256": "a7b1292e55371cfac58a32c205313e06a023fccfebcce4a91ea61a09938feeba", + "loads": [ + 7, + 6, + 22, + 2, + 1, + 12, + 1, + 2, + 12, + 2, + 4, + 10, + 0, + 2, + 9, + 1, + 1, + 10, + 27, + 4, + 0, + 2, + 0, + 0, + 1, + 11, + 0, + 0, + 4, + 1, + 17, + 6, + 4, + 4, + 4, + 17, + 11, + 19, + 2, + 2, + 9, + 1, + 6, + 6, + 4, + 0, + 18, + 15, + 3, + 23, + 2, + 4, + 10, + 12, + 4, + 1, + 13, + 6, + 5, + 10, + 0, + 5, + 3, + 8 + ], + "weighted_loads": [ + 0.4189562350511551, + 0.3001577164977789, + 1.7988369408994913, + 0.11810999363660812, + 0.03934295475482941, + 0.9600752871483564, + 0.030470525845885277, + 0.06900512427091599, + 0.9887486230581999, + 0.06186976470053196, + 0.08999285660684109, + 1.016436878591776, + 0.0, + 0.15338777378201485, + 1.320165079087019, + 0.03365262597799301, + 0.10075791925191879, + 0.5854662274941802, + 2.432852817699313, + 0.25073510222136974, + 0.0, + 0.05220821686089039, + 0.0, + 0.0, + 0.026465686038136482, + 0.7008518669754267, + 0.0, + 0.0, + 0.1154479831457138, + 0.03639918938279152, + 1.623474939726293, + 0.8587068691849709, + 0.14800439588725567, + 0.3605096563696861, + 0.42258621007204056, + 1.4197397697716951, + 0.8502763267606497, + 1.056610081344843, + 0.06155019626021385, + 0.047722725197672844, + 0.5198039636015892, + 0.04553726688027382, + 0.20168433710932732, + 0.5036037378013134, + 0.26968245953321457, + 0.0, + 2.5684889666736126, + 1.093819884583354, + 0.096763601526618, + 1.1282608676701784, + 0.04964454658329487, + 0.3300879970192909, + 0.6677227579057217, + 0.6633271314203739, + 0.17007572762668133, + 0.03496715798974037, + 2.1184079982340336, + 0.2894642949104309, + 0.504176426678896, + 1.1724498979747295, + 0.0, + 0.16058273240923882, + 0.12404538318514824, + 0.29015061259269714 + ], + "unique_experts": 56, + "load_cv": 0.9957618765172253, + "normalized_load_entropy": 0.8861661506642504, + "max_load_share": 0.0661764705882353 + } + }, + "s0_bos": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "cabd0bb61c334b568419bbdd8dbc3d1f80e2dccdeabe92788eb36132fe891a35", + "route_weight_sha256": "4b07874514bf392c6d7396ed565f1164ab3740eaefdc7bf55138de1ae7c57c7a", + "loads": [ + 1, + 3, + 10, + 2, + 0, + 9, + 0, + 0, + 0, + 0, + 5, + 7, + 0, + 1, + 0, + 0, + 1, + 0, + 2, + 3, + 0, + 0, + 0, + 0, + 1, + 11, + 0, + 0, + 4, + 0, + 4, + 4, + 2, + 3, + 0, + 2, + 10, + 11, + 1, + 1, + 5, + 1, + 3, + 1, + 4, + 0, + 0, + 10, + 0, + 9, + 0, + 2, + 1, + 0, + 2, + 0, + 10, + 1, + 3, + 5, + 0, + 3, + 3, + 1 + ], + "weighted_loads": [ + 0.06356048583984375, + 0.1506098285317421, + 0.7568914871662855, + 0.12634388729929924, + 0.0, + 0.9361684657633305, + 0.0, + 0.0, + 0.0, + 0.0, + 0.13843461871147156, + 0.739216398447752, + 0.0, + 0.10110807418823242, + 0.0, + 0.0, + 0.10922405868768692, + 0.0, + 0.0645762737840414, + 0.11008954234421253, + 0.0, + 0.0, + 0.0, + 0.0, + 0.02717740088701248, + 0.672189112752676, + 0.0, + 0.0, + 0.11894155293703079, + 0.0, + 0.43471261113882065, + 0.6357261128723621, + 0.06416030600667, + 0.29057955741882324, + 0.0, + 0.10448184981942177, + 0.818834962323308, + 0.6639143358916044, + 0.02634373866021633, + 0.016154561191797256, + 0.38882066681981087, + 0.04623855650424957, + 0.11294680833816528, + 0.039772357791662216, + 0.28685780987143517, + 0.0, + 0.0, + 0.8612835220992565, + 0.0, + 0.5103079993277788, + 0.0, + 0.1957780197262764, + 0.07211078703403473, + 0.0, + 0.04896020330488682, + 0.0, + 1.0690834745764732, + 0.06523856520652771, + 0.15133504569530487, + 0.8761987052857876, + 0.0, + 0.08851052261888981, + 0.11944099701941013, + 0.02357586659491062 + ], + "unique_experts": 40, + "load_cv": 1.28768450422113, + "normalized_load_entropy": 0.8140409595092333, + "max_load_share": 0.06790123456790123 + }, + "full_input": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "39ff9ba5f611ef3052f2d4666df0bd8532d11f891cdcf032221fed7be61aeeed", + "route_weight_sha256": "d913bf10548af98d823792baf446a97f89080f140e61a763e07b3e6a99ee5dc8", + "loads": [ + 7, + 4, + 21, + 2, + 0, + 11, + 0, + 0, + 9, + 0, + 5, + 10, + 2, + 1, + 5, + 3, + 1, + 0, + 22, + 4, + 0, + 1, + 0, + 1, + 1, + 11, + 1, + 0, + 4, + 0, + 11, + 4, + 2, + 4, + 0, + 6, + 10, + 14, + 1, + 6, + 11, + 2, + 7, + 1, + 4, + 0, + 9, + 10, + 3, + 20, + 1, + 4, + 10, + 6, + 2, + 0, + 11, + 3, + 4, + 8, + 0, + 6, + 3, + 3 + ], + "weighted_loads": [ + 0.44751090928912163, + 0.22101429104804993, + 1.7696568127721548, + 0.12634388729929924, + 0.0, + 0.9850856307893991, + 0.0, + 0.0, + 0.5859523564577103, + 0.0, + 0.13843461871147156, + 0.9698564521968365, + 0.2581171840429306, + 0.10110807418823242, + 0.9215462505817413, + 0.09805572964251041, + 0.10922405868768692, + 0.0, + 1.5394242517650127, + 0.14735865779221058, + 0.0, + 0.02566339448094368, + 0.0, + 0.04728833585977554, + 0.02717740088701248, + 0.672189112752676, + 0.049156539142131805, + 0.0, + 0.11894155293703079, + 0.0, + 0.9746170602738857, + 0.6357261128723621, + 0.06416030600667, + 0.35322730988264084, + 0.0, + 0.41960255801677704, + 0.818834962323308, + 0.8173754084855318, + 0.02634373866021633, + 0.24190549738705158, + 0.6919612567871809, + 0.11310318112373352, + 0.2664315905421972, + 0.039772357791662216, + 0.28685780987143517, + 0.0, + 1.3588112778961658, + 0.8612835220992565, + 0.14373119920492172, + 0.988210815936327, + 0.026270870119333267, + 0.34675274044275284, + 0.6798773054033518, + 0.3952246829867363, + 0.04896020330488682, + 0.0, + 1.2925900593400002, + 0.12284853868186474, + 0.18033062666654587, + 1.0292474329471588, + 0.0, + 0.17857993207871914, + 0.11944099701941013, + 0.11690759100019932 + ], + "unique_experts": 51, + "load_cv": 1.064951777297189, + "normalized_load_entropy": 0.8698811430330025, + "max_load_share": 0.07051282051282051 + } + }, + "s1_bos": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "8c6aff804aeaf6b4049e50adabfb03409700fcb763c26ad0c37694b64c12e1f9", + "route_weight_sha256": "f821489fe77f95d2594bf560fb7b3785937f69a26e6c09219b6dcfc706c8bc6e", + "loads": [ + 1, + 3, + 9, + 2, + 0, + 9, + 0, + 0, + 0, + 0, + 5, + 7, + 0, + 1, + 0, + 0, + 1, + 0, + 2, + 3, + 0, + 1, + 0, + 0, + 1, + 11, + 0, + 0, + 3, + 0, + 4, + 4, + 2, + 3, + 0, + 2, + 10, + 12, + 1, + 1, + 5, + 1, + 3, + 1, + 4, + 0, + 0, + 10, + 0, + 8, + 1, + 2, + 1, + 0, + 2, + 1, + 10, + 1, + 3, + 5, + 0, + 3, + 2, + 1 + ], + "weighted_loads": [ + 0.05625852942466736, + 0.14732378348708153, + 0.7382698096334934, + 0.12368461489677429, + 0.0, + 0.9012191258370876, + 0.0, + 0.0, + 0.0, + 0.0, + 0.14356654696166515, + 0.7426462508738041, + 0.0, + 0.09743743389844894, + 0.0, + 0.0, + 0.11957639455795288, + 0.0, + 0.06590302288532257, + 0.1104174479842186, + 0.0, + 0.03711779788136482, + 0.0, + 0.0, + 0.025945911183953285, + 0.6831300985068083, + 0.0, + 0.0, + 0.08873960934579372, + 0.0, + 0.4387980327010155, + 0.6903957761824131, + 0.07228190638124943, + 0.28135164082050323, + 0.0, + 0.09923045337200165, + 0.8139995001256466, + 0.6911971755325794, + 0.026061857119202614, + 0.01557164266705513, + 0.3916004076600075, + 0.0476030595600605, + 0.1150066889822483, + 0.04366970434784889, + 0.2739209309220314, + 0.0, + 0.0, + 0.8922583051025867, + 0.0, + 0.4728193897753954, + 0.022591782733798027, + 0.19503182172775269, + 0.06928350031375885, + 0.0, + 0.05028373748064041, + 0.037790264934301376, + 1.0531577095389366, + 0.06552478671073914, + 0.15179312974214554, + 0.910764966160059, + 0.0, + 0.09791144542396069, + 0.0808020755648613, + 0.02078896574676037 + ], + "unique_experts": 43, + "load_cv": 1.2666811059750243, + "normalized_load_entropy": 0.8245898059549431, + "max_load_share": 0.07407407407407407 + }, + "full_input": { + "tokens": 68, + "top_k": 6, + "decisions": 408, + "ordered_route_sha256": "c7f085cda15640fa82c3416c257dee5be0216af8f5aa526fc8e44dde0849e054", + "route_weight_sha256": "08c4a8bc545dd9182e0c24c14c8de1cd5dcb37d861c359643d14e37e49fceaef", + "loads": [ + 7, + 7, + 21, + 2, + 1, + 11, + 1, + 2, + 11, + 2, + 5, + 11, + 0, + 2, + 9, + 1, + 1, + 9, + 28, + 5, + 0, + 3, + 0, + 0, + 1, + 11, + 0, + 0, + 3, + 1, + 16, + 6, + 3, + 4, + 4, + 16, + 10, + 19, + 2, + 4, + 9, + 2, + 6, + 6, + 4, + 0, + 19, + 14, + 3, + 22, + 2, + 4, + 10, + 11, + 4, + 2, + 12, + 8, + 5, + 10, + 0, + 6, + 2, + 8 + ], + "weighted_loads": [ + 0.4115622341632843, + 0.3135524168610573, + 1.7848385646939278, + 0.12368461489677429, + 0.03934295475482941, + 0.9585262481123209, + 0.030470525845885277, + 0.06900512427091599, + 0.9550769329071045, + 0.06186976470053196, + 0.14356654696166515, + 1.0535799898207188, + 0.0, + 0.14333656057715416, + 1.2931024692952633, + 0.03365262597799301, + 0.11957639455795288, + 0.5710409972816706, + 2.445932663977146, + 0.2739037461578846, + 0.0, + 0.08932601474225521, + 0.0, + 0.0, + 0.025945911183953285, + 0.6831300985068083, + 0.0, + 0.0, + 0.08873960934579372, + 0.03639918938279152, + 1.347354918718338, + 0.9352158680558205, + 0.1287944782525301, + 0.3582337275147438, + 0.42258621007204056, + 1.4566504582762718, + 0.8139995001256466, + 1.026327021420002, + 0.061096733435988426, + 0.08995102904736996, + 0.5633568912744522, + 0.07730556093156338, + 0.22286556847393513, + 0.5040791295468807, + 0.2739209309220314, + 0.0, + 2.6017539240419865, + 1.072392500936985, + 0.096763601526618, + 1.1100531332194805, + 0.04885329678654671, + 0.3439824804663658, + 0.6607071869075298, + 0.5984517224133015, + 0.17108934745192528, + 0.07275742292404175, + 1.3139275908470154, + 0.35833803564310074, + 0.48679495975375175, + 1.2988476231694221, + 0.0, + 0.20445584319531918, + 0.0808020755648613, + 0.28702499344944954 + ], + "unique_experts": 56, + "load_cv": 0.9703406299340096, + "normalized_load_entropy": 0.8917273605070968, + "max_load_share": 0.06862745098039216 + } + }, + "s0_x": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "d4406ee881d1a1b18fff89518c91814a7a77b07b4ecd690f8332756433b26c2c", + "route_weight_sha256": "223c865e16bdc43ac32731f58bb2efe01b38ad8cadfca048deb625d7ea491bbe", + "loads": [ + 1, + 5, + 9, + 2, + 0, + 12, + 0, + 0, + 0, + 0, + 3, + 7, + 0, + 1, + 0, + 0, + 1, + 0, + 0, + 4, + 0, + 0, + 0, + 0, + 1, + 11, + 0, + 0, + 3, + 0, + 4, + 4, + 2, + 3, + 0, + 3, + 9, + 12, + 1, + 1, + 5, + 1, + 3, + 1, + 4, + 0, + 0, + 10, + 0, + 8, + 0, + 2, + 1, + 0, + 1, + 0, + 10, + 1, + 3, + 5, + 0, + 3, + 3, + 2 + ], + "weighted_loads": [ + 0.0913255587220192, + 0.21996834501624107, + 0.7420771420001984, + 0.12450067326426506, + 0.0, + 1.0229603499174118, + 0.0, + 0.0, + 0.0, + 0.0, + 0.09182687848806381, + 0.7516738176345825, + 0.0, + 0.10625070333480835, + 0.0, + 0.0, + 0.09158888459205627, + 0.0, + 0.0, + 0.14099304378032684, + 0.0, + 0.0, + 0.0, + 0.0, + 0.02890719473361969, + 0.6932844612747431, + 0.0, + 0.0, + 0.09797701798379421, + 0.0, + 0.4159448370337486, + 0.6700644828379154, + 0.06801304034888744, + 0.2781454026699066, + 0.0, + 0.1300257071852684, + 0.74558275192976, + 0.6829801108688116, + 0.0269160196185112, + 0.016216566786170006, + 0.4057677388191223, + 0.035336803644895554, + 0.1082947738468647, + 0.04147612676024437, + 0.28707028925418854, + 0.0, + 0.0, + 0.8765578418970108, + 0.0, + 0.48053256422281265, + 0.0, + 0.20100092142820358, + 0.07184004783630371, + 0.0, + 0.021479126065969467, + 0.0, + 1.073159098625183, + 0.06926076114177704, + 0.14080080017447472, + 0.9001987986266613, + 0.0, + 0.09173010289669037, + 0.11759559437632561, + 0.05621142312884331 + ], + "unique_experts": 39, + "load_cv": 1.3176373807055053, + "normalized_load_entropy": 0.8075577518788694, + "max_load_share": 0.07407407407407407 + }, + "full_input": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "727063006a37ecd94376d5defd84145b0a4248c5adf807dc5d550ae8100fe17f", + "route_weight_sha256": "4e2e9ce995330c8773bd71994fd2ebe6dcb3fc208150889ffb037e70c057fd3e", + "loads": [ + 8, + 6, + 21, + 2, + 0, + 14, + 0, + 0, + 9, + 0, + 3, + 11, + 1, + 1, + 5, + 3, + 1, + 0, + 20, + 5, + 0, + 3, + 0, + 0, + 1, + 11, + 0, + 0, + 3, + 0, + 12, + 4, + 2, + 4, + 0, + 7, + 9, + 15, + 1, + 4, + 9, + 1, + 5, + 1, + 4, + 0, + 8, + 10, + 4, + 20, + 1, + 5, + 11, + 7, + 1, + 0, + 11, + 2, + 6, + 7, + 0, + 5, + 3, + 5 + ], + "weighted_loads": [ + 0.5168587118387222, + 0.2903728075325489, + 1.9219449386000633, + 0.12450067326426506, + 0.0, + 1.0718775149434805, + 0.0, + 0.0, + 0.5798805058002472, + 0.0, + 0.09182687848806381, + 1.0967354513704777, + 0.04700131341814995, + 0.10625070333480835, + 1.0463982559740543, + 0.09805572964251041, + 0.09158888459205627, + 0.0, + 1.6927139218896627, + 0.1913168877363205, + 0.0, + 0.08040006272494793, + 0.0, + 0.0, + 0.02890719473361969, + 0.6932844612747431, + 0.0, + 0.0, + 0.09797701798379421, + 0.0, + 0.8813868574798107, + 0.6700644828379154, + 0.06801304034888744, + 0.3211662918329239, + 0.0, + 0.4007748141884804, + 0.74558275192976, + 0.8213289473205805, + 0.0269160196185112, + 0.08573014661669731, + 0.5957037135958672, + 0.035336803644895554, + 0.16183281876146793, + 0.04147612676024437, + 0.28707028925418854, + 0.0, + 1.3570266216993332, + 0.8765578418970108, + 0.1859208457171917, + 1.0110228266566992, + 0.026270870119333267, + 0.393568929284811, + 0.778788672760129, + 0.4160511679947376, + 0.021479126065969467, + 0.0, + 1.29666568338871, + 0.09244612231850624, + 0.27006038650870323, + 0.9706815630197525, + 0.0, + 0.14611198753118515, + 0.11759559437632561, + 0.22885267063975334 + ], + "unique_experts": 49, + "load_cv": 1.0741723110591492, + "normalized_load_entropy": 0.8635551783239455, + "max_load_share": 0.0673076923076923 + } + }, + "s1_x": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "5cda716adba2e47b1064cc47854451530a57baf8dd5870d03089a3b5ee69e51e", + "route_weight_sha256": "4e0ad9ddb9fce054b4573ab3f3ea20aae99859153042f4db6db90579600b3b46", + "loads": [ + 1, + 3, + 8, + 2, + 2, + 14, + 0, + 0, + 0, + 1, + 4, + 7, + 0, + 1, + 1, + 0, + 1, + 0, + 0, + 3, + 0, + 0, + 0, + 1, + 0, + 10, + 0, + 0, + 1, + 0, + 4, + 4, + 0, + 3, + 0, + 3, + 8, + 12, + 1, + 1, + 5, + 2, + 4, + 1, + 4, + 0, + 0, + 11, + 0, + 8, + 1, + 2, + 1, + 0, + 1, + 1, + 10, + 2, + 2, + 5, + 0, + 4, + 2, + 0 + ], + "weighted_loads": [ + 0.07143765687942505, + 0.15367982722818851, + 0.7130717877298594, + 0.11519894376397133, + 0.08858098834753036, + 1.068425489589572, + 0.0, + 0.0, + 0.0, + 0.03504969924688339, + 0.12137932144105434, + 0.7789474800229073, + 0.0, + 0.1100199818611145, + 0.027030738070607185, + 0.0, + 0.10367412120103836, + 0.0, + 0.0, + 0.11256533116102219, + 0.0, + 0.0, + 0.0, + 0.051525335758924484, + 0.0, + 0.6629981119185686, + 0.0, + 0.0, + 0.03814573958516121, + 0.0, + 0.3414728119969368, + 0.7730287797749043, + 0.0, + 0.28249554336071014, + 0.0, + 0.1309167891740799, + 0.7191706355661154, + 0.6646002512425184, + 0.02744138613343239, + 0.016000350937247276, + 0.39619985595345497, + 0.08592777326703072, + 0.16781474091112614, + 0.04448935389518738, + 0.2573355585336685, + 0.0, + 0.0, + 0.8827399760484695, + 0.0, + 0.5047705471515656, + 0.02711225487291813, + 0.19139710813760757, + 0.06930918246507645, + 0.0, + 0.022453391924500465, + 0.035902541130781174, + 1.0734489019960165, + 0.09345540404319763, + 0.07515046373009682, + 0.7221282087266445, + 0.0, + 0.14288881607353687, + 0.07041795365512371, + 0.0 + ], + "unique_experts": 42, + "load_cv": 1.321333749516041, + "normalized_load_entropy": 0.8151754695834987, + "max_load_share": 0.08641975308641975 + }, + "full_input": { + "tokens": 68, + "top_k": 6, + "decisions": 408, + "ordered_route_sha256": "f60f19a3249ebc9337758de54d5a947eb945519e60d5c25c02425feedb2696e3", + "route_weight_sha256": "ef0df72f15aaaad896084ead63cb8870b1e122e8fc499535f87529508b3a7bcd", + "loads": [ + 9, + 6, + 20, + 2, + 3, + 16, + 1, + 2, + 12, + 3, + 4, + 11, + 1, + 2, + 10, + 1, + 1, + 9, + 26, + 5, + 0, + 2, + 0, + 1, + 0, + 10, + 0, + 0, + 1, + 1, + 15, + 6, + 1, + 4, + 4, + 17, + 8, + 18, + 2, + 4, + 9, + 2, + 6, + 7, + 4, + 0, + 18, + 15, + 4, + 21, + 2, + 7, + 11, + 11, + 3, + 2, + 12, + 8, + 4, + 7, + 1, + 6, + 2, + 8 + ], + "weighted_loads": [ + 0.6137001439929008, + 0.2902937773615122, + 1.8537733536213636, + 0.11519894376397133, + 0.12792394310235977, + 1.1257326118648052, + 0.030470525845885277, + 0.06900512427091599, + 0.9814518094062805, + 0.09691946394741535, + 0.12137932144105434, + 1.0467882119119167, + 0.03634021058678627, + 0.15591910853981972, + 1.140826826915145, + 0.03365262597799301, + 0.10367412120103836, + 0.5710409972816706, + 2.3598912451416254, + 0.27894459292292595, + 0.0, + 0.05220821686089039, + 0.0, + 0.051525335758924484, + 0.0, + 0.6629981119185686, + 0.0, + 0.0, + 0.03814573958516121, + 0.03639918938279152, + 1.0292933695018291, + 1.0178488716483116, + 0.05651257187128067, + 0.3593776300549507, + 0.42258621007204056, + 1.46650261990726, + 0.7191706355661154, + 0.9659278225153685, + 0.0624762624502182, + 0.09006419405341148, + 0.5358542408794165, + 0.08592777326703072, + 0.22019773721694946, + 0.5616868957877159, + 0.2573355585336685, + 0.0, + 2.541719328612089, + 1.0628741718828678, + 0.1306349467486143, + 1.0833391305059195, + 0.05337376892566681, + 0.49813414365053177, + 0.7395257465541363, + 0.6010897010564804, + 0.14325900189578533, + 0.07086969912052155, + 1.3342187833040953, + 0.3624832555651665, + 0.41015229374170303, + 0.9018786214292049, + 0.026206858456134796, + 0.20700237341225147, + 0.07041795365512371, + 0.33049572817981243 + ], + "unique_experts": 58, + "load_cv": 0.9495137264943726, + "normalized_load_entropy": 0.8952431601816558, + "max_load_share": 0.06372549019607843 + } + }, + "s0_period": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "729f312b261ca2f5f1df088555282de6729b6c8387e3c28a3e96c07e7a0c4f85", + "route_weight_sha256": "cbbc55e678ed7f489174064a9012e2730c8597213b8b513fd82760fa1042f01b", + "loads": [ + 1, + 4, + 9, + 2, + 0, + 12, + 0, + 0, + 0, + 0, + 4, + 8, + 0, + 1, + 0, + 0, + 1, + 0, + 0, + 3, + 0, + 0, + 0, + 0, + 1, + 11, + 0, + 0, + 2, + 0, + 4, + 4, + 1, + 3, + 0, + 3, + 9, + 12, + 1, + 1, + 5, + 1, + 3, + 1, + 4, + 0, + 0, + 9, + 0, + 8, + 1, + 2, + 1, + 0, + 2, + 1, + 10, + 1, + 3, + 5, + 0, + 4, + 2, + 2 + ], + "weighted_loads": [ + 0.0835203155875206, + 0.17012411542236805, + 0.7322989124804735, + 0.12059656158089638, + 0.0, + 1.0193772986531258, + 0.0, + 0.0, + 0.0, + 0.0, + 0.11747043393552303, + 0.7792640458792448, + 0.0, + 0.09888818114995956, + 0.0, + 0.0, + 0.09233363717794418, + 0.0, + 0.0, + 0.1177790742367506, + 0.0, + 0.0, + 0.0, + 0.0, + 0.027387192472815514, + 0.706782303750515, + 0.0, + 0.0, + 0.0685458593070507, + 0.0, + 0.4257277771830559, + 0.7122831344604492, + 0.04736653342843056, + 0.28070542961359024, + 0.0, + 0.12781194224953651, + 0.7501317784190178, + 0.6785014308989048, + 0.026590777561068535, + 0.01651693508028984, + 0.40208519622683525, + 0.03861374408006668, + 0.11107414774596691, + 0.03973999246954918, + 0.27856406569480896, + 0.0, + 0.0, + 0.8610324449837208, + 0.0, + 0.48126921243965626, + 0.026073932647705078, + 0.20161046087741852, + 0.07325885444879532, + 0.0, + 0.05094793252646923, + 0.03902779892086983, + 1.1133228726685047, + 0.0691368356347084, + 0.14555270224809647, + 0.882173266261816, + 0.0, + 0.11956906132400036, + 0.08030521869659424, + 0.05772601254284382 + ], + "unique_experts": 41, + "load_cv": 1.3046176183122276, + "normalized_load_entropy": 0.8139525495858891, + "max_load_share": 0.07407407407407407 + }, + "full_input": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "98db8361dc8b68d1d17206fe6eb69f0094af4aab2971c72621da0d7248bd0d66", + "route_weight_sha256": "8ff934c901b2754fec5fb6cbafbf94d4b3151cb3cec51399d95427bf0e558efd", + "loads": [ + 8, + 5, + 20, + 2, + 0, + 14, + 0, + 0, + 9, + 0, + 4, + 12, + 0, + 1, + 5, + 4, + 1, + 0, + 21, + 4, + 0, + 3, + 0, + 0, + 1, + 11, + 0, + 0, + 2, + 0, + 11, + 5, + 1, + 4, + 0, + 6, + 9, + 15, + 1, + 4, + 9, + 1, + 5, + 1, + 4, + 0, + 9, + 9, + 3, + 20, + 3, + 5, + 11, + 8, + 2, + 1, + 11, + 3, + 5, + 7, + 0, + 6, + 2, + 4 + ], + "weighted_loads": [ + 0.5116151757538319, + 0.24052857793867588, + 1.7450642380863428, + 0.12059656158089638, + 0.0, + 1.0682944636791945, + 0.0, + 0.0, + 0.5857378244400024, + 0.0, + 0.11747043393552303, + 1.1143073048442602, + 0.0, + 0.09888818114995956, + 1.2019287385046482, + 0.138807138428092, + 0.09233363717794418, + 0.0, + 1.6922267340123653, + 0.15976283885538578, + 0.0, + 0.08759988099336624, + 0.0, + 0.0, + 0.027387192472815514, + 0.706782303750515, + 0.0, + 0.0, + 0.0685458593070507, + 0.0, + 0.8380014486610889, + 0.7408893126994371, + 0.04736653342843056, + 0.3221691995859146, + 0.0, + 0.31945589557290077, + 0.7501317784190178, + 0.8188262656331062, + 0.026590777561068535, + 0.0858995895832777, + 0.6064186170697212, + 0.03861374408006668, + 0.16461219266057014, + 0.03973999246954918, + 0.27856406569480896, + 0.0, + 1.5939784049987793, + 0.8610324449837208, + 0.14373119920492172, + 1.0021038129925728, + 0.08700691536068916, + 0.38356639072299004, + 0.7579095605760813, + 0.4888766072690487, + 0.05094793252646923, + 0.03902779892086983, + 1.3368294574320316, + 0.147286219522357, + 0.20995336771011353, + 0.9562879875302315, + 0.0, + 0.17395094595849514, + 0.08030521869659424, + 0.15105773694813251 + ], + "unique_experts": 49, + "load_cv": 1.0711076191900217, + "normalized_load_entropy": 0.864740267711703, + "max_load_share": 0.0673076923076923 + } + }, + "s1_period": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "e5fd06dd91173cf41bf63dd894a6476bd1f4456a89ea1c56a403ec9f28e8f148", + "route_weight_sha256": "0e7eb3c235ae1ff6b35967056bcc3344b278b6ad75333119c5dc5dfb5e05530a", + "loads": [ + 1, + 3, + 7, + 2, + 1, + 13, + 0, + 0, + 0, + 0, + 4, + 7, + 0, + 1, + 0, + 0, + 1, + 0, + 0, + 3, + 0, + 0, + 0, + 1, + 0, + 10, + 0, + 0, + 1, + 0, + 5, + 4, + 1, + 3, + 0, + 4, + 8, + 13, + 1, + 1, + 5, + 2, + 3, + 1, + 4, + 0, + 0, + 11, + 0, + 8, + 0, + 2, + 1, + 0, + 1, + 1, + 10, + 1, + 2, + 5, + 1, + 4, + 2, + 3 + ], + "weighted_loads": [ + 0.07776687294244766, + 0.1336003914475441, + 0.6917350366711617, + 0.1226707436144352, + 0.04746617004275322, + 1.0356897171586752, + 0.0, + 0.0, + 0.0, + 0.0, + 0.12847359292209148, + 0.8054015673696995, + 0.0, + 0.11059487611055374, + 0.0, + 0.0, + 0.10312139987945557, + 0.0, + 0.0, + 0.11220585741102695, + 0.0, + 0.0, + 0.0, + 0.05158444121479988, + 0.0, + 0.6677757073193789, + 0.0, + 0.0, + 0.03852568566799164, + 0.0, + 0.3118398953229189, + 0.7922763377428055, + 0.027887912467122078, + 0.267241682857275, + 0.0, + 0.19036081433296204, + 0.7267368473112583, + 0.6732778009027243, + 0.02991180494427681, + 0.016286393627524376, + 0.39466263726353645, + 0.08404430374503136, + 0.13983695767819881, + 0.041938185691833496, + 0.2552357241511345, + 0.0, + 0.0, + 0.8738876078277826, + 0.0, + 0.5083982683718204, + 0.0, + 0.1984916627407074, + 0.07031112164258957, + 0.0, + 0.0224289633333683, + 0.03830071911215782, + 1.0988259352743626, + 0.08348394185304642, + 0.07288865000009537, + 0.7154242396354675, + 0.026235457509756088, + 0.14910932816565037, + 0.07609603926539421, + 0.0846023503690958 + ], + "unique_experts": 42, + "load_cv": 1.315785302298075, + "normalized_load_entropy": 0.8152732821501534, + "max_load_share": 0.08024691358024691 + }, + "full_input": { + "tokens": 68, + "top_k": 6, + "decisions": 408, + "ordered_route_sha256": "25b8f894fa609f65970d9bbd3e50af7b3a1c684137a127a2fbf98b9b8e67ecc6", + "route_weight_sha256": "a6a2ea3feecc5908f425a163c4699ac562be6859f973f4cc960ca9300a290e0f", + "loads": [ + 7, + 7, + 18, + 2, + 2, + 15, + 1, + 2, + 11, + 3, + 4, + 11, + 1, + 2, + 9, + 1, + 1, + 9, + 24, + 4, + 0, + 3, + 0, + 1, + 0, + 10, + 0, + 0, + 1, + 1, + 15, + 7, + 2, + 4, + 4, + 19, + 8, + 19, + 2, + 4, + 9, + 2, + 5, + 6, + 4, + 0, + 19, + 15, + 3, + 22, + 1, + 7, + 11, + 12, + 3, + 2, + 12, + 8, + 4, + 8, + 1, + 7, + 2, + 11 + ], + "weighted_loads": [ + 0.4330705776810646, + 0.29847270622849464, + 1.7105758972465992, + 0.1226707436144352, + 0.08680912479758263, + 1.0929968394339085, + 0.030470525845885277, + 0.06900512427091599, + 0.9369853362441063, + 0.11022916249930859, + 0.12847359292209148, + 1.1208668500185013, + 0.03146343678236008, + 0.15649400278925896, + 1.2138108871877193, + 0.03365262597799301, + 0.10312139987945557, + 0.5710409972816706, + 2.2405889946967363, + 0.24613148905336857, + 0.0, + 0.08132797107100487, + 0.0, + 0.05158444121479988, + 0.0, + 0.6677757073193789, + 0.0, + 0.0, + 0.03852568566799164, + 0.03639918938279152, + 0.9302956629544497, + 1.0657333731651306, + 0.08440048433840275, + 0.3441237695515156, + 0.42258621007204056, + 1.561799593269825, + 0.7267368473112583, + 0.9761373084038496, + 0.06494668126106262, + 0.1104317344725132, + 0.54903968796134, + 0.08404430374503136, + 0.19221995398402214, + 0.5023476108908653, + 0.2552357241511345, + 0.0, + 2.62632704898715, + 1.054021803662181, + 0.096763601526618, + 1.1348925549536943, + 0.02626151405274868, + 0.5300001800060272, + 0.7254368402063847, + 0.6735339313745499, + 0.14323457330465317, + 0.0732678771018982, + 1.3595958165824413, + 0.423641636967659, + 0.4078904800117016, + 0.9273234084248543, + 0.026235457509756088, + 0.24093009531497955, + 0.07609603926539421, + 0.38159302435815334 + ], + "unique_experts": 58, + "load_cv": 0.9499185501011235, + "normalized_load_entropy": 0.8945035187164274, + "max_load_share": 0.058823529411764705 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 27, + "ordered_topk_exact_tokens": 16, + "set_exact_tokens": 21, + "mean_set_jaccard": 0.9365079365079365, + "mean_token_weighted_tv": 0.015706836159720464, + "aggregate_load_tv": 0.037037037037037035 + }, + "system_bos": { + "tokens": 27, + "ordered_topk_exact_tokens": 16, + "set_exact_tokens": 22, + "mean_set_jaccard": 0.9470899470899471, + "mean_token_weighted_tv": 0.015599610249477404, + "aggregate_load_tv": 0.024691358024691357 + }, + "system_x": { + "tokens": 27, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8275132275132274, + "mean_token_weighted_tv": 0.04224039607301906, + "aggregate_load_tv": 0.09259259259259259 + }, + "system_period": { + "tokens": 27, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.8592592592592594, + "mean_token_weighted_tv": 0.04043725836608145, + "aggregate_load_tv": 0.06790123456790123 + }, + "bos_at_s0": { + "tokens": 27, + "ordered_topk_exact_tokens": 16, + "set_exact_tokens": 22, + "mean_set_jaccard": 0.9470899470899473, + "mean_token_weighted_tv": 0.02068530209362507, + "aggregate_load_tv": 0.030864197530864196 + }, + "bos_at_s1": { + "tokens": 27, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.9153439153439153, + "mean_token_weighted_tv": 0.023714012759565202, + "aggregate_load_tv": 0.037037037037037035 + }, + "x_at_s0": { + "tokens": 27, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.8756613756613757, + "mean_token_weighted_tv": 0.03134933321012391, + "aggregate_load_tv": 0.04938271604938271 + }, + "x_at_s1": { + "tokens": 27, + "ordered_topk_exact_tokens": 8, + "set_exact_tokens": 11, + "mean_set_jaccard": 0.7957671957671958, + "mean_token_weighted_tv": 0.051465546453578606, + "aggregate_load_tv": 0.1111111111111111 + }, + "period_at_s0": { + "tokens": 27, + "ordered_topk_exact_tokens": 8, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.873015873015873, + "mean_token_weighted_tv": 0.03394220379629621, + "aggregate_load_tv": 0.06172839506172839 + }, + "period_at_s1": { + "tokens": 27, + "ordered_topk_exact_tokens": 5, + "set_exact_tokens": 9, + "mean_set_jaccard": 0.7746031746031746, + "mean_token_weighted_tv": 0.05784128149281497, + "aggregate_load_tv": 0.1111111111111111 + } + } + }, + "layer_19": { + "layer": 19, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "afcdade6b71a3db77da8cd0a693bf885a95cd6bee534eea2a8916d2ff9731ecd", + "route_weight_sha256": "7e03a5377c3388b66ca34e9cb70ef9b4625e68429aa8c25b665a285bb490c2bc", + "loads": [ + 3, + 0, + 4, + 0, + 0, + 3, + 3, + 0, + 1, + 2, + 5, + 2, + 1, + 0, + 0, + 8, + 2, + 0, + 2, + 1, + 0, + 0, + 5, + 11, + 3, + 1, + 0, + 2, + 2, + 1, + 5, + 1, + 0, + 0, + 4, + 0, + 5, + 14, + 5, + 3, + 6, + 2, + 4, + 2, + 1, + 0, + 5, + 2, + 1, + 6, + 1, + 1, + 0, + 6, + 1, + 1, + 5, + 3, + 3, + 0, + 2, + 9, + 1, + 1 + ], + "weighted_loads": [ + 1.0762872397899628, + 0.0, + 0.2650545500218868, + 0.0, + 0.0, + 0.18651149421930313, + 0.10749987326562405, + 0.0, + 0.031142547726631165, + 0.06689964979887009, + 0.39027319103479385, + 0.14282676205039024, + 0.05392869561910629, + 0.0, + 0.0, + 0.6659283339977264, + 0.10433686152100563, + 0.0, + 0.12544335797429085, + 0.030213797464966774, + 0.0, + 0.0, + 0.3659947421401739, + 0.562365336343646, + 0.5418291538953781, + 0.04010462388396263, + 0.0, + 0.07616244070231915, + 0.17017073556780815, + 0.03793417662382126, + 0.32891586422920227, + 0.09093042463064194, + 0.0, + 0.0, + 0.146452771499753, + 0.0, + 0.335640374571085, + 1.2017721384763718, + 0.8087637238204479, + 0.10288584791123867, + 1.0208137072622776, + 0.08050328306853771, + 0.4677894748747349, + 0.094121053814888, + 0.05596579611301422, + 0.0, + 0.22408192418515682, + 0.07835761457681656, + 0.03314680606126785, + 0.18744871765375137, + 0.02888590842485428, + 0.04054419696331024, + 0.0, + 0.29015721194446087, + 0.02768043987452984, + 0.038810838013887405, + 0.18107895366847515, + 0.14806748554110527, + 0.09861547127366066, + 0.0, + 0.07502112537622452, + 0.9675027094781399, + 0.018194781616330147, + 0.06133166700601578 + ], + "unique_experts": 48, + "load_cv": 1.10416208339931, + "normalized_load_entropy": 0.8642887221104208, + "max_load_share": 0.08641975308641975 + }, + "full_input": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "b008b6f506479276abc52a7263555e6aae5f9c7828123985ddec7473afdbf274", + "route_weight_sha256": "7fb7954804dc7a95514083c0e3ff2677e8e5e20098e3398ffd68539cac90f1d4", + "loads": [ + 5, + 2, + 5, + 0, + 5, + 4, + 13, + 0, + 1, + 6, + 5, + 3, + 9, + 2, + 5, + 8, + 5, + 1, + 2, + 7, + 0, + 0, + 11, + 20, + 14, + 1, + 0, + 3, + 2, + 5, + 12, + 1, + 0, + 0, + 4, + 2, + 7, + 21, + 6, + 3, + 9, + 7, + 12, + 3, + 2, + 0, + 5, + 6, + 3, + 6, + 1, + 1, + 0, + 8, + 7, + 1, + 5, + 3, + 9, + 0, + 2, + 13, + 8, + 1 + ], + "weighted_loads": [ + 1.1202873894944787, + 0.13494201377034187, + 0.28959182649850845, + 0.0, + 0.8249192964285612, + 0.1996604222804308, + 0.5194398202002048, + 0.0, + 0.031142547726631165, + 0.27333809062838554, + 0.39027319103479385, + 0.17351645603775978, + 0.6447426378726959, + 0.08885464072227478, + 0.41991371661424637, + 0.6659283339977264, + 0.21832618862390518, + 0.043940041214227676, + 0.12544335797429085, + 0.3116410057991743, + 0.0, + 0.0, + 0.5980393663048744, + 0.8857303056865931, + 1.7259514979086816, + 0.04010462388396263, + 0.0, + 0.11443880759179592, + 0.17017073556780815, + 0.20031550526618958, + 0.5859470684081316, + 0.09093042463064194, + 0.0, + 0.0, + 0.146452771499753, + 0.10627997666597366, + 0.3785879781935364, + 1.5310337822884321, + 0.8502799198031425, + 0.10288584791123867, + 1.083986759185791, + 0.511211572214961, + 1.0554391257464886, + 0.1493481621146202, + 0.0666717179119587, + 0.0, + 0.22408192418515682, + 0.3665435463190079, + 0.1028599701821804, + 0.18744871765375137, + 0.02888590842485428, + 0.04054419696331024, + 0.0, + 0.504850460216403, + 1.7691868301481009, + 0.038810838013887405, + 0.18107895366847515, + 0.14806748554110527, + 0.36400172114372253, + 0.0, + 0.07502112537622452, + 1.1826075986027718, + 0.5588174257427454, + 0.06133166700601578 + ], + "unique_experts": 54, + "load_cv": 0.9542458495347895, + "normalized_load_entropy": 0.892901662900295, + "max_load_share": 0.0673076923076923 + } + }, + "s1_eos": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "5f88128b911b194b5a0668413572219f0819e0ea010d076e9e8c4c26c495a260", + "route_weight_sha256": "9ba1b19f9f30150a13ea858cd5dfb9364e8c57da997db4ebfd470995c6fa7b4b", + "loads": [ + 3, + 0, + 6, + 0, + 0, + 3, + 2, + 0, + 1, + 2, + 5, + 2, + 1, + 0, + 0, + 7, + 2, + 0, + 2, + 0, + 0, + 0, + 4, + 10, + 3, + 1, + 0, + 2, + 2, + 1, + 6, + 1, + 0, + 0, + 4, + 1, + 6, + 14, + 5, + 3, + 6, + 2, + 3, + 1, + 1, + 0, + 5, + 2, + 1, + 6, + 1, + 1, + 0, + 6, + 1, + 1, + 7, + 3, + 5, + 0, + 2, + 7, + 1, + 1 + ], + "weighted_loads": [ + 1.0778440684080124, + 0.0, + 0.3404528237879276, + 0.0, + 0.0, + 0.18310659751296043, + 0.07422921247780323, + 0.0, + 0.03079087845981121, + 0.06667620688676834, + 0.39425019919872284, + 0.14149891212582588, + 0.0536644347012043, + 0.0, + 0.0, + 0.6133015006780624, + 0.10337749123573303, + 0.0, + 0.12376896291971207, + 0.0, + 0.0, + 0.0, + 0.3412018045783043, + 0.5071645025163889, + 0.5747680738568306, + 0.03757304698228836, + 0.0, + 0.07959074154496193, + 0.14474141597747803, + 0.037766024470329285, + 0.3664737604558468, + 0.09436097741127014, + 0.0, + 0.0, + 0.14211101830005646, + 0.03342235088348389, + 0.3746653385460377, + 1.1952490136027336, + 0.7938069552183151, + 0.10149220377206802, + 1.0037333853542805, + 0.07973972521722317, + 0.45082756131887436, + 0.05930216610431671, + 0.059108976274728775, + 0.0, + 0.22457936592400074, + 0.08146264404058456, + 0.03524961322546005, + 0.18927604518830776, + 0.03115670196712017, + 0.04294656962156296, + 0.0, + 0.3076074365526438, + 0.02747408114373684, + 0.03408019617199898, + 0.25009340792894363, + 0.14749837666749954, + 0.16061403416097164, + 0.0, + 0.07669651135802269, + 0.8900053165853024, + 0.019610146060585976, + 0.06965969502925873 + ], + "unique_experts": 48, + "load_cv": 1.0930633009906447, + "normalized_load_entropy": 0.8637370990840841, + "max_load_share": 0.08641975308641975 + }, + "full_input": { + "tokens": 68, + "top_k": 6, + "decisions": 408, + "ordered_route_sha256": "7585ad699caca157e79839c417a405f8a9132d6643fdd8d1e07e6baf9fea1758", + "route_weight_sha256": "ffd436374b0cffbb314df994e148be9af31ca938852685ca165285eb9f87c92c", + "loads": [ + 5, + 5, + 9, + 0, + 12, + 5, + 16, + 0, + 1, + 8, + 6, + 9, + 13, + 0, + 11, + 9, + 4, + 5, + 3, + 9, + 3, + 1, + 11, + 16, + 18, + 1, + 0, + 3, + 3, + 2, + 11, + 1, + 2, + 0, + 4, + 2, + 10, + 19, + 6, + 5, + 10, + 12, + 13, + 2, + 2, + 0, + 5, + 13, + 2, + 7, + 5, + 1, + 3, + 16, + 6, + 1, + 9, + 5, + 16, + 1, + 3, + 15, + 10, + 3 + ], + "weighted_loads": [ + 1.1036374885588884, + 0.30711521953344345, + 0.4394063074141741, + 0.0, + 1.5944222509860992, + 0.27489583007991314, + 0.7370613906532526, + 0.0, + 0.03079087845981121, + 0.3061917833983898, + 0.46034038066864014, + 0.8750022538006306, + 0.7718088775873184, + 0.0, + 0.8095254264771938, + 0.7213567085564137, + 0.45509839802980423, + 0.22415652871131897, + 0.22431021928787231, + 0.4474440775811672, + 0.30255622416734695, + 0.05432814359664917, + 0.6110846158117056, + 0.695098320953548, + 1.9967061136849225, + 0.03757304698228836, + 0.0, + 0.13259056210517883, + 0.18327514454722404, + 0.07430165633559227, + 0.5326662287116051, + 0.09436097741127014, + 0.08446826972067356, + 0.0, + 0.14211101830005646, + 0.09560761973261833, + 0.5029737609438598, + 1.423062527552247, + 0.83875822275877, + 0.20502960868179798, + 1.1056511807255447, + 0.7493587415665388, + 1.1760650649666786, + 0.09655719995498657, + 0.06981489807367325, + 0.0, + 0.22457936592400074, + 0.7700397931039333, + 0.07007216662168503, + 0.23430603183805943, + 0.33358688838779926, + 0.04294656962156296, + 0.14422577619552612, + 1.157788747921586, + 1.73951874114573, + 0.03408019617199898, + 0.3300218917429447, + 0.23600752279162407, + 0.6900683548301458, + 0.034508559852838516, + 0.12137268111109734, + 1.2476450577378273, + 0.7454225067049265, + 0.23322336375713348 + ], + "unique_experts": 58, + "load_cv": 0.8186127743195334, + "normalized_load_entropy": 0.913730719640304, + "max_load_share": 0.04656862745098039 + } + }, + "s0_bos": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "d9c77d1293e97e7d5a882edc80b4ef6cfb5aa3d0c8f1e0a282b2a3661bf3f7ba", + "route_weight_sha256": "81d7b41c43c5f3e5a68d04045764779cee704f472eaa7e5485bd7b74e0b40833", + "loads": [ + 3, + 0, + 5, + 0, + 0, + 3, + 3, + 0, + 2, + 1, + 4, + 2, + 1, + 0, + 0, + 7, + 2, + 0, + 2, + 1, + 0, + 0, + 5, + 12, + 3, + 0, + 0, + 2, + 2, + 1, + 6, + 1, + 0, + 0, + 4, + 1, + 6, + 15, + 5, + 2, + 6, + 2, + 3, + 2, + 2, + 0, + 5, + 1, + 1, + 3, + 0, + 1, + 0, + 5, + 1, + 1, + 6, + 3, + 6, + 0, + 2, + 9, + 1, + 1 + ], + "weighted_loads": [ + 1.062885582447052, + 0.0, + 0.3123910203576088, + 0.0, + 0.0, + 0.19384756311774254, + 0.106021448969841, + 0.0, + 0.058797894045710564, + 0.03137960657477379, + 0.35598358511924744, + 0.14963243901729584, + 0.05309136211872101, + 0.0, + 0.0, + 0.6000759974122047, + 0.10745902359485626, + 0.0, + 0.12991291284561157, + 0.034140367060899734, + 0.0, + 0.0, + 0.37220053002238274, + 0.5871137529611588, + 0.5284468494355679, + 0.0, + 0.0, + 0.0784679539501667, + 0.1425032950937748, + 0.04012993350625038, + 0.35507192462682724, + 0.08996689319610596, + 0.0, + 0.0, + 0.14729086495935917, + 0.03232112526893616, + 0.3529156167060137, + 1.2615560460835695, + 0.7854253947734833, + 0.05949731543660164, + 0.9840844608843327, + 0.08645492047071457, + 0.435180202126503, + 0.094169020652771, + 0.09867125004529953, + 0.0, + 0.22521040961146355, + 0.046677034348249435, + 0.029917823150753975, + 0.10093970596790314, + 0.0, + 0.04133806377649307, + 0.0, + 0.27825294621288776, + 0.026843538507819176, + 0.033761341124773026, + 0.24900419265031815, + 0.15163730457425117, + 0.19945157878100872, + 0.0, + 0.07436893880367279, + 0.986484358087182, + 0.02454741857945919, + 0.07526928186416626 + ], + "unique_experts": 47, + "load_cv": 1.153842245742349, + "normalized_load_entropy": 0.8563484487121198, + "max_load_share": 0.09259259259259259 + }, + "full_input": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "4f4de5a28891e60de0d53b3410e0b5206aa7bfd12b9e54d52b7bac2c884c3d6c", + "route_weight_sha256": "a76c507acdda12654c704f6a3cc7919ddcf1f251fe83dfee14004b74a2e6bde7", + "loads": [ + 4, + 3, + 6, + 0, + 4, + 4, + 12, + 0, + 2, + 4, + 4, + 3, + 9, + 4, + 5, + 7, + 5, + 1, + 2, + 7, + 0, + 0, + 10, + 18, + 13, + 0, + 1, + 5, + 2, + 5, + 14, + 1, + 0, + 0, + 4, + 4, + 6, + 22, + 6, + 2, + 8, + 6, + 11, + 4, + 3, + 1, + 5, + 5, + 5, + 3, + 0, + 2, + 0, + 7, + 6, + 1, + 6, + 3, + 13, + 0, + 3, + 12, + 8, + 1 + ], + "weighted_loads": [ + 1.102448709309101, + 0.18296627327799797, + 0.3369282968342304, + 0.0, + 0.6892407815903425, + 0.2069964911788702, + 0.47927832417190075, + 0.0, + 0.058797894045710564, + 0.19454538449645042, + 0.35598358511924744, + 0.18032213300466537, + 0.6272377669811249, + 0.17197725176811218, + 0.44124990701675415, + 0.6000759974122047, + 0.2214483506977558, + 0.7424860000610352, + 0.12991291284561157, + 0.5067182518541813, + 0.0, + 0.0, + 0.556318374350667, + 0.8196308929473162, + 1.3490229286253452, + 0.0, + 0.032045114785432816, + 0.21090847626328468, + 0.1425032950937748, + 0.2025112621486187, + 0.6568823736160994, + 0.08996689319610596, + 0.0, + 0.0, + 0.14729086495935917, + 0.17118147760629654, + 0.3529156167060137, + 1.5858338344842196, + 0.8269415907561779, + 0.05949731543660164, + 1.0426744809374213, + 0.4282040558755398, + 1.0228298529982567, + 0.18269633501768112, + 0.109377171844244, + 0.02588854543864727, + 0.22521040961146355, + 0.33699577301740646, + 0.17713354714214802, + 0.10093970596790314, + 0.0, + 0.05664381384849548, + 0.0, + 0.45906892605125904, + 0.8245910834521055, + 0.033761341124773026, + 0.24900419265031815, + 0.15163730457425117, + 0.5222256723791361, + 0.0, + 0.11698254197835922, + 1.168332064524293, + 0.5651700627058744, + 0.07526928186416626 + ], + "unique_experts": 54, + "load_cv": 0.9248558357369965, + "normalized_load_entropy": 0.8999538352356742, + "max_load_share": 0.07051282051282051 + } + }, + "s1_bos": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "559598b5a737c93081c713c7e8b1cc2bd285befd9e79e9313768a173be974956", + "route_weight_sha256": "c4dcf2433aa5ff5ee1b6f98b0d767b588d73ac6d6aadac4892fab3f3a3cc1b20", + "loads": [ + 3, + 0, + 4, + 0, + 0, + 3, + 2, + 0, + 1, + 2, + 5, + 2, + 1, + 0, + 0, + 7, + 2, + 0, + 2, + 0, + 0, + 0, + 4, + 10, + 4, + 1, + 0, + 2, + 2, + 1, + 6, + 1, + 0, + 0, + 4, + 1, + 7, + 15, + 5, + 3, + 6, + 2, + 3, + 2, + 2, + 0, + 5, + 2, + 1, + 6, + 1, + 1, + 0, + 5, + 1, + 1, + 5, + 3, + 4, + 0, + 2, + 8, + 1, + 1 + ], + "weighted_loads": [ + 1.0835034102201462, + 0.0, + 0.27874229848384857, + 0.0, + 0.0, + 0.18338311463594437, + 0.06922472268342972, + 0.0, + 0.03132280707359314, + 0.0641998965293169, + 0.39292942360043526, + 0.1516818031668663, + 0.05577809736132622, + 0.0, + 0.0, + 0.5933050103485584, + 0.1079678051173687, + 0.0, + 0.12536612525582314, + 0.0, + 0.0, + 0.0, + 0.3578798286616802, + 0.5041680559515953, + 0.6016171667724848, + 0.03163277730345726, + 0.0, + 0.07975636050105095, + 0.12286865524947643, + 0.03878464177250862, + 0.3435189910233021, + 0.0893734022974968, + 0.0, + 0.0, + 0.14984973706305027, + 0.035436779260635376, + 0.42161193303763866, + 1.2249939106404781, + 0.7857239730656147, + 0.1064274050295353, + 0.9702441319823265, + 0.08867756277322769, + 0.4365866146981716, + 0.09647082164883614, + 0.11609381809830666, + 0.0, + 0.23967722803354263, + 0.07980798184871674, + 0.02923104166984558, + 0.19057870469987392, + 0.027670875191688538, + 0.041847337037324905, + 0.0, + 0.28853892907500267, + 0.02733885683119297, + 0.030997995287179947, + 0.21980752050876617, + 0.15200823545455933, + 0.14412151090800762, + 0.0, + 0.07650822773575783, + 0.9859161246567965, + 0.02906184084713459, + 0.07840166240930557 + ], + "unique_experts": 48, + "load_cv": 1.0997360118860566, + "normalized_load_entropy": 0.865821118085925, + "max_load_share": 0.09259259259259259 + }, + "full_input": { + "tokens": 68, + "top_k": 6, + "decisions": 408, + "ordered_route_sha256": "1fd54b15f7dd88b9e9e4e5fcf7a847a89d8541861cadea485ca37d03c6e305ce", + "route_weight_sha256": "5ce769a7acbe41f9daecd56c0210aec8879fec3a30fc0077e89a336934f4fa72", + "loads": [ + 4, + 6, + 6, + 0, + 12, + 5, + 14, + 0, + 1, + 10, + 6, + 9, + 13, + 2, + 11, + 9, + 4, + 5, + 3, + 10, + 3, + 1, + 10, + 15, + 17, + 1, + 0, + 4, + 3, + 2, + 12, + 1, + 2, + 0, + 4, + 3, + 10, + 20, + 6, + 6, + 9, + 11, + 13, + 4, + 3, + 0, + 5, + 11, + 2, + 7, + 6, + 1, + 3, + 15, + 5, + 1, + 7, + 5, + 16, + 1, + 4, + 16, + 10, + 3 + ], + "weighted_loads": [ + 1.1049327943474054, + 0.36592957749962807, + 0.3391160760074854, + 0.0, + 1.6898820400238037, + 0.27517234720289707, + 0.6637237071990967, + 0.0, + 0.03132280707359314, + 0.40059382282197475, + 0.45901960507035255, + 0.885185144841671, + 0.7541990503668785, + 0.07762255892157555, + 0.8147425651550293, + 0.7013602182269096, + 0.4596887119114399, + 0.22415652871131897, + 0.22590738162398338, + 0.694636132568121, + 0.30255622416734695, + 0.05432814359664917, + 0.5932009276002645, + 0.6819985415786505, + 1.7373175974935293, + 0.03163277730345726, + 0.0, + 0.18107138946652412, + 0.16140238381922245, + 0.0753202736377716, + 0.5645594447851181, + 0.0893734022974968, + 0.08446826972067356, + 0.0, + 0.14984973706305027, + 0.15545867383480072, + 0.545979144051671, + 1.4547517765313387, + 0.8306752406060696, + 0.2458262462168932, + 1.057860947214067, + 0.6494515016674995, + 1.1618241183459759, + 0.16529159620404243, + 0.12679973989725113, + 0.0, + 0.23967722803354263, + 0.6883667334914207, + 0.06405359506607056, + 0.2356086913496256, + 0.3651116229593754, + 0.041847337037324905, + 0.14422577619552612, + 1.0839042775332928, + 0.79798155836761, + 0.030997995287179947, + 0.29973600432276726, + 0.24051738157868385, + 0.7591506782919168, + 0.034508559852838516, + 0.1774999052286148, + 1.3435558658093214, + 0.7548742014914751, + 0.24196533113718033 + ], + "unique_experts": 59, + "load_cv": 0.7840685891424395, + "normalized_load_entropy": 0.9216193761596778, + "max_load_share": 0.049019607843137254 + } + }, + "s0_x": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "f9535a03783c9cadb2a3b1c41b470a2d77612057eca2683feffb4e7be88062f8", + "route_weight_sha256": "d015b7e86e041a956ac6432c03026c9f679dab6144c81509e50b113b5550217f", + "loads": [ + 3, + 0, + 5, + 0, + 0, + 3, + 2, + 0, + 1, + 1, + 4, + 2, + 1, + 0, + 0, + 7, + 2, + 0, + 2, + 1, + 0, + 0, + 4, + 11, + 4, + 1, + 0, + 2, + 2, + 1, + 6, + 1, + 0, + 0, + 5, + 1, + 6, + 16, + 5, + 3, + 6, + 2, + 3, + 2, + 2, + 0, + 6, + 1, + 1, + 4, + 0, + 1, + 0, + 5, + 1, + 1, + 6, + 2, + 4, + 0, + 2, + 9, + 1, + 1 + ], + "weighted_loads": [ + 1.0799665749073029, + 0.0, + 0.2829015851020813, + 0.0, + 0.0, + 0.20156081393361092, + 0.06435272097587585, + 0.0, + 0.027794968336820602, + 0.030163362622261047, + 0.36257684975862503, + 0.14783742651343346, + 0.054344069212675095, + 0.0, + 0.0, + 0.6060746237635612, + 0.11054159700870514, + 0.0, + 0.12377533316612244, + 0.035960398614406586, + 0.0, + 0.0, + 0.3299995120614767, + 0.5765047334134579, + 0.5267967935651541, + 0.030199917033314705, + 0.0, + 0.07758177444338799, + 0.13054579123854637, + 0.038422659039497375, + 0.33960772305727005, + 0.08774136751890182, + 0.0, + 0.0, + 0.1719613764435053, + 0.03737699240446091, + 0.35592564195394516, + 1.246553000062704, + 0.8103352673351765, + 0.09820457175374031, + 0.9774368926882744, + 0.09014122933149338, + 0.41913991421461105, + 0.09955054894089699, + 0.11424010246992111, + 0.0, + 0.28069961443543434, + 0.05148310214281082, + 0.02908051200211048, + 0.13779599033296108, + 0.0, + 0.03970285505056381, + 0.0, + 0.25655348785221577, + 0.027889270335435867, + 0.035392362624406815, + 0.2480599656701088, + 0.1168457642197609, + 0.13938153348863125, + 0.0, + 0.07609529793262482, + 1.0235072113573551, + 0.02554495632648468, + 0.08111200481653214 + ], + "unique_experts": 48, + "load_cv": 1.1601654381708804, + "normalized_load_entropy": 0.8578334941017275, + "max_load_share": 0.09876543209876543 + }, + "full_input": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "1e46a8c58dafb5e5f174caf4921dfb4e023468890827304dda00d38a0f812f7a", + "route_weight_sha256": "e4b36f2ae2426cf166688eb7419146af1afa4d579d1daece889736a7ea4edf2e", + "loads": [ + 5, + 3, + 6, + 0, + 5, + 5, + 12, + 0, + 1, + 4, + 4, + 3, + 11, + 2, + 6, + 7, + 5, + 0, + 2, + 6, + 0, + 0, + 11, + 17, + 12, + 1, + 0, + 4, + 2, + 5, + 12, + 1, + 0, + 0, + 6, + 3, + 6, + 22, + 6, + 4, + 9, + 5, + 12, + 3, + 3, + 0, + 6, + 5, + 3, + 4, + 0, + 1, + 0, + 9, + 6, + 1, + 6, + 2, + 12, + 0, + 4, + 12, + 9, + 1 + ], + "weighted_loads": [ + 1.1599698550999165, + 0.20042266696691513, + 0.3074388615787029, + 0.0, + 0.8892536591738462, + 0.2953638192266226, + 0.49197775684297085, + 0.0, + 0.027794968336820602, + 0.1693551018834114, + 0.36257684975862503, + 0.178527120500803, + 0.8102222494781017, + 0.0820382721722126, + 0.46307384967803955, + 0.6060746237635612, + 0.2245309241116047, + 0.0, + 0.12377533316612244, + 0.267059501260519, + 0.0, + 0.0, + 0.5995095111429691, + 0.8090218733996153, + 1.1025507804006338, + 0.030199917033314705, + 0.0, + 0.15728649497032166, + 0.13054579123854637, + 0.2008039876818657, + 0.5578566957265139, + 0.08774136751890182, + 0.0, + 0.0, + 0.21393784694373608, + 0.15193960443139076, + 0.35592564195394516, + 1.4858106262981892, + 0.8518514633178711, + 0.13294069096446037, + 1.0849319389089942, + 0.3288608640432358, + 1.1467645913362503, + 0.1547776572406292, + 0.12494602426886559, + 0.0, + 0.28069961443543434, + 0.3834061957895756, + 0.09879367612302303, + 0.13779599033296108, + 0.0, + 0.03970285505056381, + 0.0, + 0.5162594746798277, + 0.8256368152797222, + 0.035392362624406815, + 0.2480599656701088, + 0.1168457642197609, + 0.5413760598748922, + 0.0, + 0.16963781788945198, + 1.205354917794466, + 0.6136511191725731, + 0.08111200481653214 + ], + "unique_experts": 52, + "load_cv": 0.9319375305326281, + "normalized_load_entropy": 0.893484022353352, + "max_load_share": 0.07051282051282051 + } + }, + "s1_x": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "fc938c1d471a1d2ab29d4fac30f781328693c715129d2e40b9526e2289e8921b", + "route_weight_sha256": "9c00939fe3553dca0d1f90a15dfcf8e3578904fe3b512606dc47b9384260cd40", + "loads": [ + 3, + 1, + 6, + 0, + 0, + 3, + 1, + 0, + 2, + 2, + 4, + 2, + 2, + 0, + 0, + 7, + 2, + 1, + 2, + 2, + 0, + 0, + 5, + 10, + 5, + 0, + 0, + 2, + 1, + 1, + 6, + 1, + 0, + 0, + 4, + 1, + 7, + 16, + 5, + 3, + 7, + 2, + 3, + 3, + 2, + 0, + 4, + 1, + 1, + 5, + 0, + 1, + 0, + 5, + 1, + 0, + 4, + 2, + 2, + 0, + 2, + 8, + 1, + 1 + ], + "weighted_loads": [ + 1.0749074816703796, + 0.03131831809878349, + 0.3372372090816498, + 0.0, + 0.0, + 0.18695372715592384, + 0.02195723168551922, + 0.0, + 0.054739201441407204, + 0.06505754590034485, + 0.35863736271858215, + 0.15009010210633278, + 0.0893162228167057, + 0.0, + 0.0, + 0.6039921641349792, + 0.10459785535931587, + 0.055765584111213684, + 0.12127368897199631, + 0.06988071650266647, + 0.0, + 0.0, + 0.38419347256422043, + 0.5119847059249878, + 0.45926424115896225, + 0.0, + 0.0, + 0.07764656469225883, + 0.0850830227136612, + 0.0401131808757782, + 0.3133834283798933, + 0.08440875262022018, + 0.0, + 0.0, + 0.15049422532320023, + 0.03230907395482063, + 0.471002958714962, + 1.117053922265768, + 0.778974499553442, + 0.11165343411266804, + 1.0112367514520884, + 0.08723842725157738, + 0.40945159271359444, + 0.17641929164528847, + 0.13225072622299194, + 0.0, + 0.23182480037212372, + 0.052716270089149475, + 0.03164241090416908, + 0.1643057744950056, + 0.0, + 0.039954204112291336, + 0.0, + 0.2662579007446766, + 0.02725503221154213, + 0.0, + 0.1809716410934925, + 0.12444722279906273, + 0.07835783064365387, + 0.0, + 0.07916423305869102, + 0.9990673419088125, + 0.02947120927274227, + 0.07157152146100998 + ], + "unique_experts": 48, + "load_cv": 1.1346612624304646, + "normalized_load_entropy": 0.8621808397773361, + "max_load_share": 0.09876543209876543 + }, + "full_input": { + "tokens": 68, + "top_k": 6, + "decisions": 408, + "ordered_route_sha256": "3012ce01954b3c553e94d4d4211a643f76f501ae3de331a7050d27a46c6c6c27", + "route_weight_sha256": "288f0be6024f42ab48369ddb4b9fef3139343ed466e385404b225eeb627d9d03", + "loads": [ + 4, + 8, + 8, + 0, + 12, + 6, + 14, + 0, + 2, + 8, + 5, + 9, + 16, + 0, + 12, + 9, + 4, + 8, + 3, + 9, + 3, + 1, + 12, + 15, + 16, + 0, + 0, + 4, + 2, + 2, + 10, + 1, + 2, + 0, + 4, + 2, + 10, + 20, + 6, + 5, + 9, + 11, + 14, + 4, + 3, + 0, + 4, + 12, + 2, + 6, + 4, + 1, + 3, + 16, + 5, + 0, + 6, + 4, + 14, + 1, + 5, + 18, + 11, + 3 + ], + "weighted_loads": [ + 1.096336865797639, + 0.42830437421798706, + 0.3976109866052866, + 0.0, + 1.5351961702108383, + 0.3291747663170099, + 0.6105283163487911, + 0.0, + 0.054739201441407204, + 0.3167165592312813, + 0.42472754418849945, + 0.8835934437811375, + 0.9119665697216988, + 0.0, + 0.8748060241341591, + 0.7120473720133305, + 0.45631876215338707, + 0.365164864808321, + 0.22181494534015656, + 0.4346865378320217, + 0.30255622416734695, + 0.05432814359664917, + 0.6545596998184919, + 0.689815191552043, + 1.2271093539893627, + 0.0, + 0.0, + 0.18919026479125023, + 0.12361675128340721, + 0.07664881274104118, + 0.45677036605775356, + 0.08440875262022018, + 0.08446826972067356, + 0.0, + 0.15049422532320023, + 0.08745746314525604, + 0.5953701697289944, + 1.301964683458209, + 0.8239257670938969, + 0.215190839022398, + 1.0640318552032113, + 0.5953507460653782, + 1.3199932910501957, + 0.21367432549595833, + 0.14295664802193642, + 0.0, + 0.23182480037212372, + 0.7934445105493069, + 0.06646496430039406, + 0.20933576114475727, + 0.3024301864206791, + 0.039954204112291336, + 0.14422577619552612, + 1.1251946836709976, + 0.7978977337479591, + 0.0, + 0.2609001249074936, + 0.21295636892318726, + 0.6934172809123993, + 0.034508559852838516, + 0.22067886590957642, + 1.4662836659699678, + 0.8415689822286367, + 0.23513519018888474 + ], + "unique_experts": 56, + "load_cv": 0.8195515507453477, + "normalized_load_entropy": 0.9123147078921305, + "max_load_share": 0.049019607843137254 + } + }, + "s0_period": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "2ff0c8f94f7d889896f9551949a06687d2a1296690254921d57a1bd9fe5beffa", + "route_weight_sha256": "710908595f1b6fe88cb7036fb8f918c41d77e16ae3defc21a87dafb3da598947", + "loads": [ + 3, + 0, + 5, + 0, + 0, + 4, + 2, + 0, + 2, + 1, + 4, + 2, + 1, + 0, + 0, + 7, + 2, + 0, + 2, + 1, + 0, + 0, + 4, + 11, + 3, + 1, + 0, + 2, + 2, + 1, + 6, + 1, + 0, + 0, + 4, + 1, + 6, + 16, + 5, + 3, + 6, + 2, + 4, + 2, + 2, + 0, + 6, + 1, + 1, + 4, + 0, + 1, + 0, + 5, + 1, + 1, + 7, + 2, + 4, + 0, + 2, + 7, + 1, + 1 + ], + "weighted_loads": [ + 1.083583027124405, + 0.0, + 0.283807847648859, + 0.0, + 0.0, + 0.22915494441986084, + 0.05938424728810787, + 0.0, + 0.054403116926550865, + 0.028696373105049133, + 0.35355284065008163, + 0.15380657836794853, + 0.05243527144193649, + 0.0, + 0.0, + 0.6036746352910995, + 0.10984179750084877, + 0.0, + 0.12249129638075829, + 0.03749792277812958, + 0.0, + 0.0, + 0.3263349439948797, + 0.5758285038173199, + 0.5230475440621376, + 0.02960602007806301, + 0.0, + 0.08160605281591415, + 0.12277562357485294, + 0.039591073989868164, + 0.34050773084163666, + 0.08469363301992416, + 0.0, + 0.0, + 0.14170412719249725, + 0.03542147949337959, + 0.3693714626133442, + 1.2166609577834606, + 0.8109140805900097, + 0.1022789292037487, + 0.9832927510142326, + 0.08661490678787231, + 0.4483404792845249, + 0.10530690103769302, + 0.12008703872561455, + 0.0, + 0.2878178469836712, + 0.05037805810570717, + 0.031067822128534317, + 0.1381527204066515, + 0.0, + 0.04023817181587219, + 0.0, + 0.25807708501815796, + 0.028661971911787987, + 0.03142985701560974, + 0.2762498054653406, + 0.12027045339345932, + 0.14363198168575764, + 0.0, + 0.07713356241583824, + 0.9694520905613899, + 0.023715639486908913, + 0.0745997428894043 + ], + "unique_experts": 48, + "load_cv": 1.1410907485063488, + "normalized_load_entropy": 0.8610234725843423, + "max_load_share": 0.09876543209876543 + }, + "full_input": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "292f0fb91ff4677204f35d08e3bdaca0825de5fd72a6efc37da2b7a48f3b9513", + "route_weight_sha256": "450e1871849f510bc26a2347abfaedd5dff5c6ca955096a5ed27cda38fefe69a", + "loads": [ + 5, + 3, + 6, + 0, + 5, + 6, + 11, + 0, + 2, + 4, + 4, + 3, + 10, + 1, + 6, + 7, + 5, + 0, + 3, + 6, + 0, + 0, + 10, + 18, + 12, + 1, + 0, + 4, + 2, + 5, + 12, + 1, + 0, + 0, + 5, + 3, + 7, + 22, + 6, + 4, + 9, + 5, + 12, + 3, + 3, + 0, + 6, + 6, + 3, + 4, + 0, + 1, + 0, + 10, + 6, + 1, + 7, + 2, + 11, + 0, + 3, + 11, + 9, + 1 + ], + "weighted_loads": [ + 1.1758258901536465, + 0.20118552073836327, + 0.30834512412548065, + 0.0, + 0.9751465301960707, + 0.3248949144035578, + 0.4326411224901676, + 0.0, + 0.054403116926550865, + 0.16973449289798737, + 0.35355284065008163, + 0.18449627235531807, + 0.6612717136740685, + 0.03922676667571068, + 0.47145967185497284, + 0.6036746352910995, + 0.22383112460374832, + 0.0, + 0.16657700762152672, + 0.2835976481437683, + 0.0, + 0.0, + 0.5575880594551563, + 0.842418173328042, + 1.144577544182539, + 0.02960602007806301, + 0.0, + 0.16313591599464417, + 0.12277562357485294, + 0.20197240263223648, + 0.5676343459635973, + 0.08469363301992416, + 0.0, + 0.0, + 0.20875521004199982, + 0.15615080669522285, + 0.4159439951181412, + 1.4776598438620567, + 0.8524302765727043, + 0.13053367100656033, + 1.0843247240409255, + 0.34344320371747017, + 1.0359901301562786, + 0.16053400933742523, + 0.13079296052455902, + 0.0, + 0.2878178469836712, + 0.4545689523220062, + 0.10078098624944687, + 0.1381527204066515, + 0.0, + 0.04023817181587219, + 0.0, + 0.587125675752759, + 0.8264095168560743, + 0.03142985701560974, + 0.2762498054653406, + 0.12027045339345932, + 0.4785634446889162, + 0.0, + 0.1277550794184208, + 1.2416405975818634, + 0.6043518576771021, + 0.0745997428894043 + ], + "unique_experts": 52, + "load_cv": 0.9241446815866717, + "normalized_load_entropy": 0.8948789338000591, + "max_load_share": 0.07051282051282051 + } + }, + "s1_period": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "a04fa447b3df7c1d65a1b7991fffcee8d4301be41d265701f08d4f78b87fcf8c", + "route_weight_sha256": "d8337ac731b8a99482bb4430e054281c3d905911b723788e6df62d780850d22f", + "loads": [ + 3, + 0, + 6, + 0, + 0, + 4, + 2, + 0, + 1, + 1, + 5, + 2, + 2, + 0, + 0, + 7, + 2, + 1, + 2, + 2, + 0, + 0, + 4, + 10, + 4, + 0, + 0, + 2, + 1, + 1, + 6, + 1, + 0, + 0, + 4, + 1, + 8, + 15, + 5, + 3, + 6, + 2, + 3, + 3, + 2, + 0, + 5, + 1, + 1, + 5, + 0, + 1, + 0, + 4, + 1, + 1, + 4, + 2, + 4, + 0, + 2, + 8, + 1, + 1 + ], + "weighted_loads": [ + 1.0864439904689789, + 0.0, + 0.32144802063703537, + 0.0, + 0.0, + 0.23527104780077934, + 0.046711767092347145, + 0.0, + 0.028892774134874344, + 0.039051275700330734, + 0.39607833698391914, + 0.1526470184326172, + 0.08510616794228554, + 0.0, + 0.0, + 0.6264083348214626, + 0.10840616002678871, + 0.05645628646016121, + 0.12007899582386017, + 0.07178029790520668, + 0.0, + 0.0, + 0.33597891591489315, + 0.521330825984478, + 0.35623741894960403, + 0.0, + 0.0, + 0.07644947245717049, + 0.0822691097855568, + 0.03844843804836273, + 0.30701317079365253, + 0.08660957217216492, + 0.0, + 0.0, + 0.14444840140640736, + 0.02831556834280491, + 0.541253887116909, + 1.107247432693839, + 0.7740122973918915, + 0.10698750242590904, + 0.9772197604179382, + 0.0856044813990593, + 0.41276049241423607, + 0.19374842196702957, + 0.12984955310821533, + 0.0, + 0.2752382569015026, + 0.05426599085330963, + 0.02989671565592289, + 0.16969485022127628, + 0.0, + 0.041295915842056274, + 0.0, + 0.2428877353668213, + 0.02730359323322773, + 0.0325583815574646, + 0.18489478155970573, + 0.12918128445744514, + 0.12424666807055473, + 0.0, + 0.07903767749667168, + 1.0560596864670515, + 0.03361644223332405, + 0.07122880965471268 + ], + "unique_experts": 48, + "load_cv": 1.1107681226445005, + "normalized_load_entropy": 0.8637799786116488, + "max_load_share": 0.09259259259259259 + }, + "full_input": { + "tokens": 68, + "top_k": 6, + "decisions": 408, + "ordered_route_sha256": "e0e9b5460218c87709f0aead338152ef47c6576b609fa4e2c641f42fd09870e9", + "route_weight_sha256": "3c6f1816f1fbd432257c058ef492ef18775f95e7dd166b74222c9b6a4aa1bccd", + "loads": [ + 4, + 5, + 8, + 0, + 12, + 7, + 13, + 0, + 1, + 6, + 6, + 9, + 15, + 0, + 13, + 9, + 4, + 7, + 3, + 10, + 3, + 1, + 10, + 15, + 15, + 0, + 0, + 4, + 2, + 2, + 10, + 1, + 2, + 0, + 5, + 2, + 11, + 18, + 6, + 6, + 9, + 12, + 14, + 4, + 3, + 0, + 5, + 13, + 2, + 6, + 5, + 1, + 3, + 15, + 5, + 1, + 6, + 4, + 15, + 1, + 6, + 19, + 11, + 3 + ], + "weighted_loads": [ + 1.1078733745962381, + 0.30324844643473625, + 0.3818217981606722, + 0.0, + 1.5630559027194977, + 0.3744764942675829, + 0.5721723306924105, + 0.0, + 0.028892774134874344, + 0.23735328391194344, + 0.46216851845383644, + 0.8861503601074219, + 0.8094181269407272, + 0.0, + 0.8834937326610088, + 0.7344635426998138, + 0.4601270668208599, + 0.3204345442354679, + 0.22062025219202042, + 0.4831625148653984, + 0.30255622416734695, + 0.05432814359664917, + 0.5713000148534775, + 0.6991613116115332, + 1.0991803333163261, + 0.0, + 0.0, + 0.19204244017601013, + 0.12080283835530281, + 0.07498406991362572, + 0.4477961976081133, + 0.08660957217216492, + 0.08446826972067356, + 0.0, + 0.20339896716177464, + 0.11549963988363743, + 0.6656210981309414, + 1.2414995729923248, + 0.8189635649323463, + 0.2551833111792803, + 1.0773736601695418, + 0.6639610603451729, + 1.1710985265672207, + 0.23100345581769943, + 0.1405554749071598, + 0.0, + 0.2752382569015026, + 0.8897375836968422, + 0.06471926905214787, + 0.21472483687102795, + 0.34329410642385483, + 0.041295915842056274, + 0.14422577619552612, + 1.1405821777880192, + 0.7979462947696447, + 0.0325583815574646, + 0.2648232653737068, + 0.21769043058156967, + 0.6848273389041424, + 0.034508559852838516, + 0.27745047211647034, + 1.5619520228356123, + 0.8023673817515373, + 0.23479247838258743 + ], + "unique_experts": 57, + "load_cv": 0.802485565869848, + "normalized_load_entropy": 0.9153827233746097, + "max_load_share": 0.04656862745098039 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 27, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 18, + "mean_set_jaccard": 0.8968253968253969, + "mean_token_weighted_tv": 0.01989245435429944, + "aggregate_load_tv": 0.05555555555555555 + }, + "system_bos": { + "tokens": 27, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.8650793650793652, + "mean_token_weighted_tv": 0.027053800032094674, + "aggregate_load_tv": 0.06790123456790123 + }, + "system_x": { + "tokens": 27, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.8804232804232804, + "mean_token_weighted_tv": 0.037403658101404155, + "aggregate_load_tv": 0.08024691358024691 + }, + "system_period": { + "tokens": 27, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.8641975308641976, + "mean_token_weighted_tv": 0.03840287091831366, + "aggregate_load_tv": 0.06790123456790123 + }, + "bos_at_s0": { + "tokens": 27, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 13, + "mean_set_jaccard": 0.8439153439153438, + "mean_token_weighted_tv": 0.030373510904610157, + "aggregate_load_tv": 0.07407407407407407 + }, + "bos_at_s1": { + "tokens": 27, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 20, + "mean_set_jaccard": 0.9179894179894179, + "mean_token_weighted_tv": 0.023156200604582275, + "aggregate_load_tv": 0.037037037037037035 + }, + "x_at_s0": { + "tokens": 27, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 13, + "mean_set_jaccard": 0.8280423280423282, + "mean_token_weighted_tv": 0.0360054120214449, + "aggregate_load_tv": 0.07407407407407407 + }, + "x_at_s1": { + "tokens": 27, + "ordered_topk_exact_tokens": 4, + "set_exact_tokens": 11, + "mean_set_jaccard": 0.781657848324515, + "mean_token_weighted_tv": 0.05471609046475755, + "aggregate_load_tv": 0.10493827160493827 + }, + "period_at_s0": { + "tokens": 27, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 13, + "mean_set_jaccard": 0.8218694885361552, + "mean_token_weighted_tv": 0.03931451164599922, + "aggregate_load_tv": 0.08024691358024691 + }, + "period_at_s1": { + "tokens": 27, + "ordered_topk_exact_tokens": 6, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.810405643738977, + "mean_token_weighted_tv": 0.05537528044509667, + "aggregate_load_tv": 0.08024691358024691 + } + } + }, + "layer_20": { + "layer": 20, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "95f941f118d395993bd5c5d8b56bba5ee9c574a7064ee1ebef65c348efd25879", + "route_weight_sha256": "52e4b942fb14c84a4b14a01f5b25b1bfe33464c57bd9852e1df3c701982c03af", + "loads": [ + 3, + 11, + 1, + 2, + 4, + 14, + 1, + 3, + 0, + 1, + 1, + 0, + 11, + 1, + 3, + 8, + 0, + 0, + 1, + 0, + 9, + 3, + 2, + 0, + 1, + 0, + 0, + 0, + 2, + 1, + 1, + 3, + 0, + 0, + 1, + 0, + 1, + 1, + 8, + 1, + 1, + 1, + 0, + 2, + 3, + 1, + 3, + 2, + 8, + 0, + 0, + 1, + 3, + 4, + 7, + 0, + 9, + 8, + 3, + 0, + 2, + 3, + 2, + 0 + ], + "weighted_loads": [ + 0.12682157009840012, + 0.8002033457159996, + 0.0665634348988533, + 0.13891959749162197, + 0.2101748213171959, + 1.2967217788100243, + 0.07505175471305847, + 0.1403612270951271, + 0.0, + 0.053728267550468445, + 0.035255543887615204, + 0.0, + 1.0387310683727264, + 0.06927712261676788, + 0.16816952638328075, + 0.5672475807368755, + 0.0, + 0.0, + 0.19485393166542053, + 0.0, + 0.8867895565927029, + 0.12541964277625084, + 0.07478383556008339, + 0.0, + 0.042764853686094284, + 0.0, + 0.0, + 0.0, + 0.07495995610952377, + 0.03227581828832626, + 0.03109712153673172, + 0.12327887117862701, + 0.0, + 0.0, + 0.0670609101653099, + 0.0, + 0.05592133104801178, + 0.09279116988182068, + 1.389489620923996, + 0.05334831029176712, + 0.07537099719047546, + 0.03715674951672554, + 0.0, + 0.5461576282978058, + 0.22498029470443726, + 0.044985152781009674, + 0.11250022239983082, + 0.08728621527552605, + 0.5699498020112514, + 0.0, + 0.0, + 0.03775740787386894, + 0.12655172497034073, + 0.1230973582714796, + 0.4596979506313801, + 0.0, + 0.5752309113740921, + 0.40999733470380306, + 0.24209899082779884, + 0.0, + 0.057701192796230316, + 0.17576834186911583, + 0.09774400666356087, + 0.0 + ], + "unique_experts": 46, + "load_cv": 1.270525731660625, + "normalized_load_entropy": 0.8327018790601675, + "max_load_share": 0.08641975308641975 + }, + "full_input": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "36dce298e5cc7adaa6d83c046a9f5244b67d607ebd88f47e0f7b94d114f2f057", + "route_weight_sha256": "38c299eb4eadcdfa23db77e700e74c5e7eb7390f3103da5f091488fa7526709f", + "loads": [ + 3, + 13, + 1, + 10, + 12, + 18, + 6, + 7, + 1, + 1, + 1, + 1, + 15, + 1, + 3, + 14, + 1, + 0, + 11, + 0, + 13, + 3, + 9, + 0, + 1, + 7, + 1, + 0, + 2, + 4, + 1, + 3, + 0, + 1, + 3, + 0, + 3, + 3, + 10, + 1, + 2, + 3, + 2, + 6, + 15, + 1, + 3, + 2, + 9, + 1, + 8, + 1, + 3, + 11, + 7, + 3, + 10, + 14, + 4, + 0, + 14, + 7, + 2, + 0 + ], + "weighted_loads": [ + 0.12682157009840012, + 0.8449299111962318, + 0.0665634348988533, + 0.7395311910659075, + 0.6114700585603714, + 1.493090158328414, + 0.2256503477692604, + 0.40777207165956497, + 0.02672370709478855, + 0.053728267550468445, + 0.035255543887615204, + 0.033058978617191315, + 1.1735801324248314, + 0.06927712261676788, + 0.16816952638328075, + 1.0964162424206734, + 0.037206027656793594, + 0.0, + 1.0846593230962753, + 0.0, + 0.9919942456763238, + 0.12541964277625084, + 0.5281936824321747, + 0.0, + 0.042764853686094284, + 0.46767453476786613, + 0.01745333895087242, + 0.0, + 0.07495995610952377, + 0.17354177869856358, + 0.03109712153673172, + 0.12327887117862701, + 0.0, + 0.023166675120592117, + 0.14695066958665848, + 0.0, + 0.10261566936969757, + 0.1505144853144884, + 2.7081353664398193, + 0.05334831029176712, + 0.13025109469890594, + 0.12859638035297394, + 0.16182608902454376, + 0.6839815776329488, + 0.7330528367310762, + 0.044985152781009674, + 0.11250022239983082, + 0.08728621527552605, + 0.571593857719563, + 0.044103287160396576, + 0.9841295666992664, + 0.03775740787386894, + 0.12655172497034073, + 0.4537585061043501, + 0.4596979506313801, + 0.45032278820872307, + 0.6343079917132854, + 0.6064453367143869, + 0.2794267572462559, + 0.0, + 1.3161644582869485, + 0.4130854681134224, + 0.09774400666356087, + 0.0 + ], + "unique_experts": 56, + "load_cv": 1.0013140610136735, + "normalized_load_entropy": 0.8808157030723263, + "max_load_share": 0.057692307692307696 + } + }, + "s1_eos": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "adf0f610fdb0963dc3af613d58a96ebeea8e3755d4b2def309d60ac03c0243d8", + "route_weight_sha256": "a062f17df090c4ededd489ab3e2ba477fd1d8a2091c8c6138ea409feffd9dd51", + "loads": [ + 3, + 12, + 1, + 1, + 4, + 14, + 1, + 3, + 0, + 1, + 1, + 0, + 11, + 2, + 3, + 7, + 0, + 0, + 1, + 0, + 9, + 3, + 2, + 0, + 1, + 0, + 0, + 0, + 3, + 3, + 1, + 3, + 0, + 0, + 1, + 0, + 1, + 1, + 8, + 1, + 1, + 1, + 0, + 2, + 3, + 2, + 2, + 2, + 8, + 0, + 0, + 1, + 1, + 4, + 7, + 0, + 9, + 7, + 3, + 0, + 2, + 3, + 2, + 0 + ], + "weighted_loads": [ + 0.12226610630750656, + 0.8443146236240864, + 0.06335147470235825, + 0.10381968319416046, + 0.2091185711324215, + 1.3090180978178978, + 0.07652787119150162, + 0.13970715552568436, + 0.0, + 0.046128690242767334, + 0.0366845466196537, + 0.0, + 0.992258932441473, + 0.115784652531147, + 0.1670855637639761, + 0.5317371152341366, + 0.0, + 0.0, + 0.20343196392059326, + 0.0, + 0.8921212125569582, + 0.12945642322301865, + 0.07925477996468544, + 0.0, + 0.0453985296189785, + 0.0, + 0.0, + 0.0, + 0.10895434767007828, + 0.0883022379130125, + 0.030205469578504562, + 0.12102693691849709, + 0.0, + 0.0, + 0.05480298399925232, + 0.0, + 0.06306256353855133, + 0.09246450662612915, + 1.3746108748018742, + 0.05313212051987648, + 0.08251664787530899, + 0.04312620311975479, + 0.0, + 0.5043118074536324, + 0.2301134131848812, + 0.08856184780597687, + 0.07392425090074539, + 0.08846978843212128, + 0.5705564729869366, + 0.0, + 0.0, + 0.04033292829990387, + 0.04538864642381668, + 0.1222466416656971, + 0.4503041096031666, + 0.0, + 0.5880811810493469, + 0.3778001666069031, + 0.2339011300355196, + 0.0, + 0.06733447313308716, + 0.1765468828380108, + 0.09402240067720413, + 0.0 + ], + "unique_experts": 46, + "load_cv": 1.2666811059750243, + "normalized_load_entropy": 0.8344829787387167, + "max_load_share": 0.08641975308641975 + }, + "full_input": { + "tokens": 68, + "top_k": 6, + "decisions": 408, + "ordered_route_sha256": "511bf2c411e9b9808ab4b8321817ba6058747be9c5b03c8b9d1dc7861ba3cd06", + "route_weight_sha256": "401d8ab013f8ae95c8aea59e8f57f9737377efc35185f94d69704af56388a39b", + "loads": [ + 8, + 14, + 1, + 12, + 12, + 21, + 3, + 11, + 1, + 3, + 3, + 0, + 13, + 3, + 4, + 20, + 5, + 0, + 12, + 1, + 14, + 4, + 12, + 2, + 2, + 13, + 1, + 1, + 3, + 9, + 1, + 4, + 1, + 1, + 5, + 2, + 4, + 6, + 11, + 5, + 4, + 3, + 2, + 9, + 18, + 3, + 2, + 2, + 9, + 5, + 13, + 1, + 1, + 13, + 8, + 11, + 11, + 15, + 5, + 2, + 15, + 5, + 3, + 0 + ], + "weighted_loads": [ + 0.3560573644936085, + 0.888543888926506, + 0.06335147470235825, + 0.8609861768782139, + 0.6300981976091862, + 1.62021260894835, + 0.14702356792986393, + 0.6671955492347479, + 0.025681456550955772, + 0.2790884040296078, + 0.12961610779166222, + 0.0, + 1.0602312814444304, + 0.39972079545259476, + 0.22750461660325527, + 1.526844508945942, + 0.3060098420828581, + 0.0, + 1.2291333824396133, + 0.03452989086508751, + 1.0371155350003392, + 0.1674286350607872, + 0.7558867186307907, + 0.17211419343948364, + 0.06509908102452755, + 0.8288891799747944, + 0.01745333895087242, + 0.037453778088092804, + 0.10895434767007828, + 0.2961256429553032, + 0.030205469578504562, + 0.15177680552005768, + 0.0491110160946846, + 0.043712906539440155, + 0.24508877471089363, + 0.17925312370061874, + 0.16774141043424606, + 0.27557324059307575, + 2.7307710759341717, + 0.25063563510775566, + 0.22081205621361732, + 0.16032911837100983, + 0.14714017510414124, + 0.7713774498552084, + 1.2119263224303722, + 0.1610189750790596, + 0.07392425090074539, + 0.08846978843212128, + 0.572293032775633, + 0.31342241168022156, + 1.585055187344551, + 0.04033292829990387, + 0.04538864642381668, + 0.4795524701476097, + 0.4797454196959734, + 1.155545897781849, + 0.6728273294866085, + 0.9461699519306421, + 0.31317377276718616, + 0.05335965007543564, + 1.467535529169254, + 0.3126017451286316, + 0.15349141135811806, + 0.0 + ], + "unique_experts": 61, + "load_cv": 0.8522083847882639, + "normalized_load_entropy": 0.912291771458843, + "max_load_share": 0.051470588235294115 + } + }, + "s0_bos": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "15927dffcea0e01e7a83dca3c56098581c71b207247964f76422ff2eaf3bf860", + "route_weight_sha256": "0337df3d2334c4003b0eb61ca088b61dcf2641f2b5a1977927876f7f2c5a4d0a", + "loads": [ + 2, + 12, + 1, + 1, + 5, + 16, + 1, + 4, + 0, + 1, + 1, + 0, + 10, + 1, + 2, + 7, + 0, + 0, + 1, + 1, + 9, + 3, + 2, + 0, + 1, + 0, + 0, + 0, + 3, + 1, + 1, + 3, + 0, + 0, + 1, + 0, + 3, + 1, + 8, + 1, + 1, + 1, + 0, + 2, + 3, + 2, + 2, + 2, + 8, + 0, + 0, + 1, + 1, + 3, + 7, + 0, + 9, + 7, + 3, + 0, + 2, + 3, + 2, + 0 + ], + "weighted_loads": [ + 0.08478789031505585, + 0.8360638841986656, + 0.06427930295467377, + 0.1035541296005249, + 0.2182889711111784, + 1.451315250247717, + 0.07124140113592148, + 0.1717667169868946, + 0.0, + 0.057908207178115845, + 0.033940307796001434, + 0.0, + 0.9967750459909439, + 0.08206451684236526, + 0.15070093423128128, + 0.47693607211112976, + 0.0, + 0.0, + 0.20756034553050995, + 0.040495552122592926, + 0.8690938297659159, + 0.13949644565582275, + 0.07741529494524002, + 0.0, + 0.04422387480735779, + 0.0, + 0.0, + 0.0, + 0.10996789671480656, + 0.03296089172363281, + 0.031212978065013885, + 0.10701560229063034, + 0.0, + 0.0, + 0.06617014110088348, + 0.0, + 0.11195333302021027, + 0.09036292135715485, + 1.3690659366548061, + 0.050811104476451874, + 0.07411392778158188, + 0.03823418915271759, + 0.0, + 0.5352967977523804, + 0.22275737300515175, + 0.08723058179020882, + 0.08376747742295265, + 0.09063205495476723, + 0.5699828937649727, + 0.0, + 0.0, + 0.04396683722734451, + 0.04839419946074486, + 0.08477660827338696, + 0.4666701517999172, + 0.0, + 0.5722266100347042, + 0.4128688797354698, + 0.24364623986184597, + 0.0, + 0.0643182173371315, + 0.17900997772812843, + 0.09086163341999054, + 0.0 + ], + "unique_experts": 47, + "load_cv": 1.3008737523038172, + "normalized_load_entropy": 0.8324640181366934, + "max_load_share": 0.09876543209876543 + }, + "full_input": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "1576da33735e54f34b626a165b82333d5e5401de3787fa2b2177132912f2aee2", + "route_weight_sha256": "7346ffb805f6b98a59bfb93d024dda44f12933806c431ac15b5e98a224400809", + "loads": [ + 3, + 13, + 1, + 9, + 13, + 20, + 6, + 8, + 0, + 1, + 1, + 1, + 14, + 1, + 3, + 13, + 1, + 0, + 11, + 1, + 12, + 3, + 11, + 0, + 1, + 7, + 3, + 0, + 3, + 4, + 3, + 4, + 0, + 2, + 2, + 0, + 5, + 3, + 9, + 1, + 2, + 4, + 2, + 6, + 15, + 2, + 3, + 3, + 8, + 0, + 8, + 1, + 1, + 9, + 7, + 3, + 9, + 11, + 4, + 0, + 13, + 6, + 2, + 0 + ], + "weighted_loads": [ + 0.11947823688387871, + 0.8602316472679377, + 0.06427930295467377, + 0.7041657231748104, + 0.6195842083543539, + 1.6344540361315012, + 0.2218399941921234, + 0.4200836233794689, + 0.0, + 0.057908207178115845, + 0.033940307796001434, + 0.7056635618209839, + 1.1377355717122555, + 0.08206451684236526, + 0.19598426669836044, + 0.9976648725569248, + 0.037206027656793594, + 0.0, + 1.0973657369613647, + 0.040495552122592926, + 0.9711422361433506, + 0.13949644565582275, + 0.5916862413287163, + 0.0, + 0.04422387480735779, + 0.4638843312859535, + 0.10136671923100948, + 0.0, + 0.10996789671480656, + 0.15525480173528194, + 0.12907741218805313, + 0.11859490815550089, + 0.0, + 0.05836622416973114, + 0.10902173072099686, + 0.0, + 0.15864767134189606, + 0.14808623678982258, + 1.7334690354764462, + 0.050811104476451874, + 0.11914793401956558, + 0.13853091839700937, + 0.15985851734876633, + 0.7223976962268353, + 0.6773352902382612, + 0.08723058179020882, + 0.21797839179635048, + 0.10142753273248672, + 0.5699828937649727, + 0.0, + 0.9229363091289997, + 0.04396683722734451, + 0.04839419946074486, + 0.3728696759790182, + 0.4666701517999172, + 0.44927674159407616, + 0.5722266100347042, + 0.5364600364118814, + 0.280974006280303, + 0.0, + 1.3214014749974012, + 0.39542629197239876, + 0.09086163341999054, + 0.0 + ], + "unique_experts": 55, + "load_cv": 0.9658876000942237, + "normalized_load_entropy": 0.8878145482412055, + "max_load_share": 0.0641025641025641 + } + }, + "s1_bos": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "40200f265da3d0f91e539e4ce7105fc03a3a467025cb3c4df03f9d5f8c3320b2", + "route_weight_sha256": "598483eef7303b7e2f744a6f8cca0b6b2bfa17b5e26fa6e73a926d3bd1959b6b", + "loads": [ + 3, + 13, + 1, + 2, + 5, + 14, + 1, + 3, + 0, + 1, + 2, + 0, + 10, + 1, + 2, + 6, + 0, + 0, + 1, + 1, + 8, + 3, + 2, + 0, + 1, + 0, + 0, + 0, + 3, + 2, + 1, + 3, + 0, + 0, + 1, + 0, + 2, + 2, + 8, + 1, + 1, + 1, + 0, + 2, + 3, + 1, + 2, + 2, + 7, + 0, + 0, + 1, + 1, + 4, + 7, + 0, + 9, + 8, + 3, + 0, + 2, + 3, + 2, + 0 + ], + "weighted_loads": [ + 0.12560373544692993, + 0.8954984322190285, + 0.061128534376621246, + 0.13196292705833912, + 0.21658304519951344, + 1.2630742751061916, + 0.07203266024589539, + 0.1368011198937893, + 0.0, + 0.056787434965372086, + 0.0640342254191637, + 0.0, + 0.9877526648342609, + 0.07340741902589798, + 0.14624617248773575, + 0.41518307477235794, + 0.0, + 0.0, + 0.20402760803699493, + 0.044835321605205536, + 0.8575561568140984, + 0.15203364193439484, + 0.07694222405552864, + 0.0, + 0.03982924669981003, + 0.0, + 0.0, + 0.0, + 0.11413159780204296, + 0.06392350792884827, + 0.03127812221646309, + 0.11075424030423164, + 0.0, + 0.0, + 0.0710003450512886, + 0.0, + 0.09136711247265339, + 0.12489359080791473, + 1.3681965358555317, + 0.05372658744454384, + 0.0746721625328064, + 0.04705971106886864, + 0.0, + 0.513912208378315, + 0.22590508311986923, + 0.046217452734708786, + 0.0869409441947937, + 0.08287744969129562, + 0.5303094908595085, + 0.0, + 0.0, + 0.04379182308912277, + 0.05210067331790924, + 0.11675839871168137, + 0.4551353417336941, + 0.0, + 0.5859039332717657, + 0.4429908636957407, + 0.24511876329779625, + 0.0, + 0.058418069034814835, + 0.18059896305203438, + 0.09593487903475761, + 0.0 + ], + "unique_experts": 47, + "load_cv": 1.247280229678091, + "normalized_load_entropy": 0.840984490592527, + "max_load_share": 0.08641975308641975 + }, + "full_input": { + "tokens": 68, + "top_k": 6, + "decisions": 408, + "ordered_route_sha256": "f0af6f817da61ac4760c395520a753009b35dee7d00e4b743882bc1a68ca73db", + "route_weight_sha256": "72f7c8f0f92a789806b3f88a9e3b5cbca268c5a6bb1a04cec0a17f7efc7115b1", + "loads": [ + 8, + 14, + 1, + 13, + 13, + 22, + 3, + 11, + 0, + 3, + 4, + 0, + 12, + 2, + 3, + 20, + 5, + 0, + 11, + 2, + 13, + 4, + 13, + 2, + 2, + 13, + 2, + 1, + 3, + 7, + 1, + 4, + 1, + 0, + 4, + 2, + 5, + 8, + 10, + 6, + 5, + 4, + 2, + 10, + 18, + 2, + 2, + 3, + 7, + 5, + 13, + 1, + 1, + 14, + 8, + 11, + 11, + 15, + 4, + 2, + 14, + 5, + 3, + 0 + ], + "weighted_loads": [ + 0.38645167276263237, + 0.9196661952883005, + 0.061128534376621246, + 0.8891294207423925, + 0.6375626716762781, + 1.6422374676913023, + 0.1425283569842577, + 0.660480996593833, + 0.0, + 0.2897471487522125, + 0.15696578659117222, + 0.0, + 1.0557250138372183, + 0.35734356194734573, + 0.20666522532701492, + 1.4513253308832645, + 0.3060098420828581, + 0.0, + 1.1990059651434422, + 0.07936521247029305, + 1.047370908781886, + 0.1900058537721634, + 0.7584155239164829, + 0.17211419343948364, + 0.05952979810535908, + 0.866758681833744, + 0.06441902741789818, + 0.037453778088092804, + 0.11413159780204296, + 0.20725699327886105, + 0.03127812221646309, + 0.14150410890579224, + 0.0491110160946846, + 0.0, + 0.1895790807902813, + 0.17925312370061874, + 0.19604595936834812, + 0.3528392966836691, + 1.7734811566770077, + 0.29951200261712074, + 0.24913647770881653, + 0.18751081079244614, + 0.14888424053788185, + 0.904266007244587, + 1.1655405648052692, + 0.11867458000779152, + 0.0869409441947937, + 0.12203368544578552, + 0.5303094908595085, + 0.33105645328760147, + 1.6053897738456726, + 0.04379182308912277, + 0.05210067331790924, + 0.5361583903431892, + 0.4845766518265009, + 1.1190621480345726, + 0.6701219994574785, + 0.97791837900877, + 0.2810794301331043, + 0.05335965007543564, + 1.4567541182041168, + 0.32155434787273407, + 0.15540388971567154, + 0.0 + ], + "unique_experts": 59, + "load_cv": 0.8567079323511169, + "normalized_load_entropy": 0.9103492213604364, + "max_load_share": 0.05392156862745098 + } + }, + "s0_x": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "504a7b1896bb1b9dc04961a4181f9735cc6fbbb23335ad21543999904e96103d", + "route_weight_sha256": "328e0c9f3e19a70611bf39dd6af685cfd119c448097270f446314c7677871bf7", + "loads": [ + 2, + 13, + 1, + 1, + 5, + 15, + 1, + 4, + 1, + 1, + 1, + 0, + 12, + 1, + 2, + 7, + 0, + 0, + 1, + 1, + 8, + 3, + 2, + 0, + 1, + 0, + 0, + 0, + 2, + 1, + 2, + 2, + 0, + 0, + 1, + 0, + 3, + 1, + 8, + 1, + 1, + 1, + 0, + 2, + 3, + 1, + 1, + 2, + 8, + 0, + 0, + 1, + 1, + 3, + 7, + 0, + 9, + 7, + 3, + 0, + 2, + 4, + 2, + 0 + ], + "weighted_loads": [ + 0.08125106990337372, + 0.8739268090575933, + 0.060251813381910324, + 0.09498566389083862, + 0.24770484119653702, + 1.3353295661509037, + 0.07036521285772324, + 0.1614414118230343, + 0.03223782405257225, + 0.05308802053332329, + 0.035162147134542465, + 0.0, + 1.133431613445282, + 0.059399787336587906, + 0.1475192904472351, + 0.457497701048851, + 0.0, + 0.0, + 0.21126395463943481, + 0.04045788198709488, + 0.8613404855132103, + 0.14942586794495583, + 0.08464143797755241, + 0.0, + 0.04991650581359863, + 0.0, + 0.0, + 0.0, + 0.07744387164711952, + 0.03293526545166969, + 0.06331014446914196, + 0.07184859365224838, + 0.0, + 0.0, + 0.06759302318096161, + 0.0, + 0.11217111349105835, + 0.09326624870300293, + 1.3673288896679878, + 0.05334837734699249, + 0.0829530581831932, + 0.04065675660967827, + 0.0, + 0.5477037876844406, + 0.22963662073016167, + 0.04183303937315941, + 0.040992747992277145, + 0.09564325958490372, + 0.5946205146610737, + 0.0, + 0.0, + 0.04218027740716934, + 0.03261638805270195, + 0.08862844854593277, + 0.47231240943074226, + 0.0, + 0.5743860453367233, + 0.4202938340604305, + 0.2269322220236063, + 0.0, + 0.053863849490880966, + 0.22735003754496574, + 0.09412706270813942, + 0.0 + ], + "unique_experts": 48, + "load_cv": 1.315785302298075, + "normalized_load_entropy": 0.8317481675177456, + "max_load_share": 0.09259259259259259 + }, + "full_input": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "a689aa0f15347eeffd1281fb5528a60074c02c7105846129d04153f7b35a7aa7", + "route_weight_sha256": "26378e46722b5093aca13b84e443e4933088b34bb92d3d4737574d9de2e2b5fe", + "loads": [ + 3, + 15, + 1, + 9, + 14, + 17, + 7, + 8, + 1, + 1, + 1, + 0, + 16, + 2, + 3, + 13, + 1, + 0, + 12, + 1, + 11, + 3, + 9, + 0, + 1, + 8, + 1, + 0, + 2, + 6, + 3, + 2, + 0, + 2, + 2, + 0, + 6, + 3, + 9, + 1, + 2, + 2, + 2, + 4, + 16, + 1, + 1, + 2, + 8, + 1, + 8, + 1, + 1, + 9, + 7, + 4, + 10, + 12, + 4, + 0, + 14, + 7, + 2, + 0 + ], + "weighted_loads": [ + 0.11456232890486717, + 0.9354752451181412, + 0.060251813381910324, + 0.6955972574651241, + 0.7735156640410423, + 1.4108072351664305, + 0.2599363289773464, + 0.4073430933058262, + 0.03223782405257225, + 0.05308802053332329, + 0.035162147134542465, + 0.0, + 1.3133727423846722, + 0.08679044060409069, + 0.18541071563959122, + 0.920008473098278, + 0.037206027656793594, + 0.0, + 1.201627992093563, + 0.04045788198709488, + 0.963388891890645, + 0.14942586794495583, + 0.49804868549108505, + 0.0, + 0.04991650581359863, + 0.5332843884825706, + 0.01745333895087242, + 0.0, + 0.07744387164711952, + 0.2071313876658678, + 0.11654804088175297, + 0.07184859365224838, + 0.0, + 0.05202002264559269, + 0.10465876385569572, + 0.0, + 0.19236700236797333, + 0.15098956413567066, + 1.7317319884896278, + 0.05334837734699249, + 0.11496004089713097, + 0.0815303735435009, + 0.16031427681446075, + 0.6106860917061567, + 0.7338481154292822, + 0.04183303937315941, + 0.040992747992277145, + 0.09564325958490372, + 0.5946205146610737, + 0.040269359946250916, + 0.9497564546763897, + 0.04218027740716934, + 0.03261638805270195, + 0.3444613143801689, + 0.47231240943074226, + 0.49981651082634926, + 0.6153288781642914, + 0.5967680793255568, + 0.26425998844206333, + 0.0, + 1.4916947800666094, + 0.4484681598842144, + 0.09412706270813942, + 0.0 + ], + "unique_experts": 56, + "load_cv": 1.0, + "normalized_load_entropy": 0.8809111865333307, + "max_load_share": 0.05448717948717949 + } + }, + "s1_x": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "e0ef8a7fb176041d13314ee56f679963041d4fba87fc14a42fa13d98dbb6880a", + "route_weight_sha256": "442a6befc4cf7fbc6d3142cf4b2f4dceba42f4a3b4cb2843721ca4c8eaaabe33", + "loads": [ + 3, + 14, + 1, + 1, + 8, + 14, + 1, + 4, + 0, + 1, + 1, + 0, + 11, + 1, + 2, + 6, + 0, + 0, + 1, + 2, + 7, + 2, + 1, + 0, + 1, + 0, + 1, + 0, + 3, + 1, + 1, + 2, + 0, + 1, + 1, + 0, + 3, + 1, + 8, + 1, + 1, + 0, + 0, + 3, + 3, + 1, + 2, + 2, + 8, + 0, + 0, + 1, + 1, + 2, + 7, + 0, + 8, + 8, + 3, + 1, + 0, + 3, + 3, + 0 + ], + "weighted_loads": [ + 0.1179376058280468, + 0.9157382231205702, + 0.055810973048210144, + 0.08867952972650528, + 0.3864382319152355, + 1.2629860900342464, + 0.07025481760501862, + 0.15354131534695625, + 0.0, + 0.05284379422664642, + 0.032860953360795975, + 0.0, + 1.0256194435060024, + 0.03161923587322235, + 0.14470494538545609, + 0.3932215981185436, + 0.0, + 0.0, + 0.19716741144657135, + 0.08445978164672852, + 0.8287709839642048, + 0.15791577473282814, + 0.04452931880950928, + 0.0, + 0.03798665851354599, + 0.0, + 0.03658543899655342, + 0.0, + 0.10824275948107243, + 0.03430315852165222, + 0.035637643188238144, + 0.07243765145540237, + 0.0, + 0.06422476470470428, + 0.07700072973966599, + 0.0, + 0.08526873402297497, + 0.08582771569490433, + 1.3564532697200775, + 0.05461074039340019, + 0.07483939081430435, + 0.0, + 0.0, + 0.3881978243589401, + 0.23918811604380608, + 0.04708683118224144, + 0.08874185755848885, + 0.09129192307591438, + 0.5910047888755798, + 0.0, + 0.0, + 0.05379347503185272, + 0.02956402860581875, + 0.053723786026239395, + 0.44667506217956543, + 0.0, + 0.5535846129059792, + 0.4812704995274544, + 0.21640067361295223, + 0.04533301293849945, + 0.0, + 0.17871145904064178, + 0.13185594603419304, + 0.0 + ], + "unique_experts": 48, + "load_cv": 1.3008737523038172, + "normalized_load_entropy": 0.8328643733685648, + "max_load_share": 0.08641975308641975 + }, + "full_input": { + "tokens": 68, + "top_k": 6, + "decisions": 408, + "ordered_route_sha256": "f889dc0d6be54f6646b6581570296305128bbf476311e1c817172a21a470055b", + "route_weight_sha256": "cb8b5d4a7d256adc2e05aec7ceb1e7007ce217f9fa20e82ef6375c8343716467", + "loads": [ + 8, + 15, + 1, + 13, + 18, + 22, + 4, + 12, + 0, + 3, + 3, + 0, + 14, + 2, + 3, + 20, + 6, + 0, + 12, + 3, + 10, + 4, + 11, + 2, + 3, + 14, + 2, + 1, + 3, + 5, + 1, + 3, + 1, + 2, + 3, + 2, + 6, + 7, + 10, + 5, + 4, + 2, + 2, + 8, + 18, + 2, + 2, + 2, + 8, + 4, + 13, + 1, + 1, + 11, + 8, + 11, + 11, + 16, + 4, + 3, + 13, + 5, + 5, + 0 + ], + "weighted_loads": [ + 0.36777427420020103, + 0.9399059861898422, + 0.055810973048210144, + 0.8777514696121216, + 0.9507541730999947, + 1.6296618711203337, + 0.1804113034158945, + 0.6521166022866964, + 0.0, + 0.28580350801348686, + 0.1257925145328045, + 0.0, + 1.1439943630248308, + 0.3155553787946701, + 0.20512399822473526, + 1.406179741024971, + 0.44035552255809307, + 0.0, + 1.303728874772787, + 0.11898967251181602, + 0.9377021919935942, + 0.22625283896923065, + 0.6857918538153172, + 0.17211419343948364, + 0.09775941632688046, + 0.8701603598892689, + 0.05403877794742584, + 0.037453778088092804, + 0.10824275948107243, + 0.13896030373871326, + 0.035637643188238144, + 0.10318752005696297, + 0.0491110160946846, + 0.09539012052118778, + 0.14572203531861305, + 0.17925312370061874, + 0.1899475809186697, + 0.3113457504659891, + 1.7617378905415535, + 0.2521142549812794, + 0.2131347991526127, + 0.0937216468155384, + 0.1417863555252552, + 0.6090448461472988, + 1.1723762042820454, + 0.11954395845532417, + 0.08874185755848885, + 0.09129192307591438, + 0.5910047888755798, + 0.23924680054187775, + 1.514830481261015, + 0.05379347503185272, + 0.02956402860581875, + 0.39504894614219666, + 0.47611637227237225, + 1.1395328417420387, + 0.6841138601303101, + 1.0601376164704561, + 0.2523613404482603, + 0.09869266301393509, + 1.491468708962202, + 0.35158470645546913, + 0.22715936228632927, + 0.0 + ], + "unique_experts": 60, + "load_cv": 0.8696249749622229, + "normalized_load_entropy": 0.9107694032639153, + "max_load_share": 0.05392156862745098 + } + }, + "s0_period": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "55b04c96854359b7850912d9981daf9c46f956338a1d603dff9bc058a05ebc92", + "route_weight_sha256": "1a709d2b06d31f246f7ee0a505e03ded30668a4b2245545d870d4cdc9bec6568", + "loads": [ + 2, + 14, + 1, + 2, + 5, + 13, + 1, + 4, + 0, + 1, + 1, + 0, + 12, + 1, + 2, + 7, + 0, + 0, + 1, + 1, + 9, + 3, + 2, + 0, + 1, + 0, + 0, + 0, + 3, + 2, + 1, + 2, + 0, + 0, + 1, + 0, + 3, + 1, + 8, + 1, + 1, + 1, + 0, + 2, + 3, + 1, + 2, + 2, + 8, + 0, + 0, + 1, + 0, + 3, + 7, + 0, + 7, + 9, + 3, + 0, + 2, + 3, + 2, + 0 + ], + "weighted_loads": [ + 0.08518826961517334, + 0.9470407497137785, + 0.061796024441719055, + 0.12325073778629303, + 0.24567478522658348, + 1.2198403179645538, + 0.0685664638876915, + 0.15646519511938095, + 0.0, + 0.04910242557525635, + 0.03394278883934021, + 0.0, + 1.0936263389885426, + 0.06525842845439911, + 0.15190360695123672, + 0.45362498611211777, + 0.0, + 0.0, + 0.22631797194480896, + 0.050641171634197235, + 0.8725444581359625, + 0.15485615655779839, + 0.083476722240448, + 0.0, + 0.04897385463118553, + 0.0, + 0.0, + 0.0, + 0.11006738618016243, + 0.06650089100003242, + 0.035103511065244675, + 0.07399838045239449, + 0.0, + 0.0, + 0.07832706719636917, + 0.0, + 0.11088059470057487, + 0.09233208745718002, + 1.3841176368296146, + 0.0518798790872097, + 0.0792207270860672, + 0.045960165560245514, + 0.0, + 0.5357306450605392, + 0.2248239740729332, + 0.04252910986542702, + 0.08484761044383049, + 0.0957210324704647, + 0.5802266336977482, + 0.0, + 0.0, + 0.041993703693151474, + 0.0, + 0.08572567999362946, + 0.47440192103385925, + 0.0, + 0.4895250052213669, + 0.49731605499982834, + 0.21577538922429085, + 0.0, + 0.05526638589799404, + 0.181719359010458, + 0.09392638877034187, + 0.0 + ], + "unique_experts": 46, + "load_cv": 1.3064855281630552, + "normalized_load_entropy": 0.8289305646453317, + "max_load_share": 0.08641975308641975 + }, + "full_input": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "f57f8afb721f33f43be95da7bfca734e9d389cea4f8b649be67fc9b0816ff427", + "route_weight_sha256": "7f08944e2b8c65479dc72a5a9d6de307fff8811cb5aa454dfc68ec5e0ddbf400", + "loads": [ + 2, + 15, + 1, + 10, + 14, + 15, + 7, + 9, + 1, + 1, + 2, + 0, + 17, + 1, + 2, + 12, + 2, + 0, + 11, + 2, + 12, + 3, + 9, + 0, + 1, + 8, + 1, + 0, + 3, + 6, + 2, + 2, + 0, + 2, + 3, + 0, + 5, + 3, + 9, + 2, + 2, + 3, + 2, + 4, + 16, + 1, + 2, + 2, + 8, + 1, + 9, + 1, + 0, + 9, + 7, + 3, + 8, + 13, + 4, + 0, + 13, + 7, + 2, + 0 + ], + "weighted_loads": [ + 0.08518826961517334, + 0.9712085127830505, + 0.061796024441719055, + 0.7238623313605785, + 0.6963210813701153, + 1.2953179869800806, + 0.27594174444675446, + 0.5727567970752716, + 0.04468503221869469, + 0.04910242557525635, + 0.06567730009555817, + 0.0, + 1.3301867544651031, + 0.06525842845439911, + 0.15190360695123672, + 0.8886398449540138, + 0.0846683643758297, + 0.0, + 1.1161233633756638, + 0.08585936576128006, + 0.9745928645133972, + 0.15485615655779839, + 0.49974266439676285, + 0.0, + 0.04897385463118553, + 0.5888780988752842, + 0.01745333895087242, + 0.0, + 0.11006738618016243, + 0.20540260709822178, + 0.08517828211188316, + 0.07399838045239449, + 0.0, + 0.05667497590184212, + 0.15569067373871803, + 0.0, + 0.15757493302226067, + 0.15005540288984776, + 1.7485207356512547, + 0.0954192616045475, + 0.13698183000087738, + 0.12352298200130463, + 0.16229578107595444, + 0.5933090411126614, + 0.7154048252850771, + 0.04252910986542702, + 0.08484761044383049, + 0.0957210324704647, + 0.5802266336977482, + 0.06175130233168602, + 0.9980747811496258, + 0.041993703693151474, + 0.0, + 0.3545961230993271, + 0.47440192103385925, + 0.4279137961566448, + 0.5378347784280777, + 0.62090721167624, + 0.2531031556427479, + 0.0, + 1.3123496435582638, + 0.43466001376509666, + 0.09392638877034187, + 0.0 + ], + "unique_experts": 55, + "load_cv": 0.9840944134561789, + "normalized_load_entropy": 0.8836942077158042, + "max_load_share": 0.05448717948717949 + } + }, + "s1_period": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "033b35f09356a24c61fcdbadea12533ccc6718138575d386d170670ae909a369", + "route_weight_sha256": "d4a2e78b74b5c9114d32c9d74781f3cbf96f5d9fc2f800448110f1782de2a94d", + "loads": [ + 2, + 12, + 1, + 2, + 7, + 14, + 1, + 2, + 1, + 1, + 1, + 1, + 11, + 0, + 2, + 5, + 0, + 0, + 1, + 2, + 8, + 3, + 2, + 0, + 1, + 0, + 1, + 0, + 2, + 2, + 1, + 3, + 0, + 1, + 1, + 0, + 2, + 2, + 8, + 2, + 1, + 0, + 0, + 2, + 3, + 1, + 2, + 2, + 8, + 0, + 0, + 1, + 1, + 2, + 8, + 0, + 7, + 8, + 3, + 0, + 1, + 3, + 4, + 0 + ], + "weighted_loads": [ + 0.07117752730846405, + 0.8723604008555412, + 0.056564219295978546, + 0.1159158106893301, + 0.3821832165122032, + 1.222370132803917, + 0.07276804745197296, + 0.07588673010468483, + 0.033706553280353546, + 0.05369475856423378, + 0.034441087394952774, + 0.038858164101839066, + 1.0643878728151321, + 0.0, + 0.1400785744190216, + 0.3447689451277256, + 0.0, + 0.0, + 0.20070062577724457, + 0.09189597517251968, + 0.8345635868608952, + 0.22364214435219765, + 0.07460161671042442, + 0.0, + 0.03778330981731415, + 0.0, + 0.035571128129959106, + 0.0, + 0.07062320783734322, + 0.06954645738005638, + 0.03400777652859688, + 0.11389529332518578, + 0.0, + 0.039001431316137314, + 0.10592402517795563, + 0.0, + 0.05540386587381363, + 0.13596567139029503, + 1.3837997391819954, + 0.08732244372367859, + 0.08003319054841995, + 0.0, + 0.0, + 0.3425571396946907, + 0.22474367544054985, + 0.04312700033187866, + 0.0842098519206047, + 0.09324212744832039, + 0.5877733565866947, + 0.0, + 0.0, + 0.046689849346876144, + 0.0295377466827631, + 0.05213705077767372, + 0.4860963150858879, + 0.0, + 0.5304448492825031, + 0.48093902319669724, + 0.19672024995088577, + 0.0, + 0.024452175945043564, + 0.1761031374335289, + 0.16093233413994312, + 0.0 + ], + "unique_experts": 49, + "load_cv": 1.2414008439981614, + "normalized_load_entropy": 0.8456711798876317, + "max_load_share": 0.08641975308641975 + }, + "full_input": { + "tokens": 68, + "top_k": 6, + "decisions": 408, + "ordered_route_sha256": "c3ef2984dc7688d1e0df358b660c0522edd74773e4e0625133c2d284f2b61bfd", + "route_weight_sha256": "b058f0a0fd3ce02fe1dbd2426a0ec53f85df10d6f619d2cac4767f0747c1237d", + "loads": [ + 7, + 13, + 1, + 13, + 16, + 21, + 4, + 11, + 1, + 3, + 3, + 1, + 15, + 1, + 3, + 18, + 5, + 0, + 11, + 3, + 12, + 4, + 12, + 2, + 2, + 14, + 2, + 1, + 2, + 6, + 2, + 4, + 1, + 2, + 3, + 2, + 5, + 11, + 10, + 7, + 5, + 2, + 2, + 7, + 18, + 2, + 2, + 2, + 8, + 5, + 13, + 1, + 1, + 10, + 9, + 12, + 9, + 15, + 4, + 2, + 14, + 6, + 5, + 0 + ], + "weighted_loads": [ + 0.3230636678636074, + 0.8965281639248133, + 0.056564219295978546, + 0.8730823043733835, + 0.8361953534185886, + 1.5258277226239443, + 0.18573754467070103, + 0.6431603413075209, + 0.033706553280353546, + 0.2866544723510742, + 0.1273726485669613, + 0.038858164101839066, + 1.2418141905218363, + 0.28393614292144775, + 0.20049762725830078, + 1.344862312078476, + 0.3060098420828581, + 0.0, + 1.1956789828836918, + 0.1264258660376072, + 0.9914084803313017, + 0.2616143561899662, + 0.7136118747293949, + 0.17211419343948364, + 0.0574838612228632, + 0.9168241396546364, + 0.05302446708083153, + 0.037453778088092804, + 0.07062320783734322, + 0.17420360259711742, + 0.061491986736655235, + 0.14464516192674637, + 0.0491110160946846, + 0.07441945374011993, + 0.1746453307569027, + 0.17925312370061874, + 0.16008271276950836, + 0.48077973164618015, + 1.7890843600034714, + 0.3338713198900223, + 0.25747326388955116, + 0.10195948928594589, + 0.14520904049277306, + 0.5622290186583996, + 1.1580008752644062, + 0.1155841276049614, + 0.0842098519206047, + 0.09324212744832039, + 0.5877733565866947, + 0.32556185126304626, + 1.5042180307209492, + 0.046689849346876144, + 0.0295377466827631, + 0.35305074974894524, + 0.5155376251786947, + 1.086683239787817, + 0.6192377358675003, + 1.0158665385097265, + 0.23268091678619385, + 0.05335965007543564, + 1.4637881480157375, + 0.35592516139149666, + 0.22040134482085705, + 0.0 + ], + "unique_experts": 62, + "load_cv": 0.8381062852220592, + "normalized_load_entropy": 0.9164011520756355, + "max_load_share": 0.051470588235294115 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 27, + "ordered_topk_exact_tokens": 20, + "set_exact_tokens": 20, + "mean_set_jaccard": 0.9259259259259259, + "mean_token_weighted_tv": 0.020004950084344105, + "aggregate_load_tv": 0.037037037037037035 + }, + "system_bos": { + "tokens": 27, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.8941798941798943, + "mean_token_weighted_tv": 0.02490041322178311, + "aggregate_load_tv": 0.04938271604938271 + }, + "system_x": { + "tokens": 27, + "ordered_topk_exact_tokens": 7, + "set_exact_tokens": 13, + "mean_set_jaccard": 0.828042328042328, + "mean_token_weighted_tv": 0.04359492776846444, + "aggregate_load_tv": 0.08641975308641975 + }, + "system_period": { + "tokens": 27, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.8509700176366842, + "mean_token_weighted_tv": 0.04095837432477209, + "aggregate_load_tv": 0.09259259259259259 + }, + "bos_at_s0": { + "tokens": 27, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.8756613756613757, + "mean_token_weighted_tv": 0.028905893572502665, + "aggregate_load_tv": 0.06172839506172839 + }, + "bos_at_s1": { + "tokens": 27, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.8756613756613758, + "mean_token_weighted_tv": 0.02920808687944103, + "aggregate_load_tv": 0.04938271604938271 + }, + "x_at_s0": { + "tokens": 27, + "ordered_topk_exact_tokens": 8, + "set_exact_tokens": 13, + "mean_set_jaccard": 0.8518518518518519, + "mean_token_weighted_tv": 0.03383320549296008, + "aggregate_load_tv": 0.07407407407407407 + }, + "x_at_s1": { + "tokens": 27, + "ordered_topk_exact_tokens": 5, + "set_exact_tokens": 8, + "mean_set_jaccard": 0.7707231040564374, + "mean_token_weighted_tv": 0.05678894588102897, + "aggregate_load_tv": 0.10493827160493827 + }, + "period_at_s0": { + "tokens": 27, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.8597883597883599, + "mean_token_weighted_tv": 0.03815233693630607, + "aggregate_load_tv": 0.07407407407407407 + }, + "period_at_s1": { + "tokens": 27, + "ordered_topk_exact_tokens": 6, + "set_exact_tokens": 10, + "mean_set_jaccard": 0.7631393298059966, + "mean_token_weighted_tv": 0.06222799485894265, + "aggregate_load_tv": 0.10493827160493827 + } + } + }, + "layer_21": { + "layer": 21, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "34d68e7f03900eda1a493289fb9372f64c1ef8e5e9c2e37acc958fde4fe9e730", + "route_weight_sha256": "21887434a0fe1e136e392c316a72c92d9330cbc2c47e3f0d6bd58ccb1595170f", + "loads": [ + 3, + 1, + 2, + 0, + 0, + 3, + 5, + 3, + 11, + 0, + 2, + 3, + 0, + 16, + 1, + 10, + 18, + 2, + 1, + 15, + 1, + 2, + 1, + 1, + 0, + 3, + 8, + 0, + 8, + 0, + 1, + 0, + 2, + 0, + 5, + 1, + 1, + 1, + 4, + 0, + 1, + 0, + 4, + 0, + 0, + 0, + 2, + 0, + 0, + 4, + 0, + 5, + 2, + 1, + 2, + 0, + 2, + 0, + 1, + 0, + 0, + 1, + 1, + 1 + ], + "weighted_loads": [ + 0.09204763546586037, + 0.05045963078737259, + 0.1281532160937786, + 0.0, + 0.0, + 0.2238943725824356, + 0.4915587641298771, + 0.14742262661457062, + 0.6077184248715639, + 0.0, + 0.06805593892931938, + 0.13347330316901207, + 0.0, + 2.7565154526382685, + 0.027235794812440872, + 1.4218589905649424, + 1.6163596510887146, + 0.34242314100265503, + 0.07179058343172073, + 0.7484143618494272, + 0.047579433768987656, + 0.08446197211742401, + 0.03566932678222656, + 0.05458727106451988, + 0.0, + 0.26312618516385555, + 0.4605978671461344, + 0.0, + 1.2747672460973263, + 0.0, + 0.04117894172668457, + 0.0, + 0.10346027091145515, + 0.0, + 0.46852410212159157, + 0.0432434119284153, + 0.064903624355793, + 0.052382856607437134, + 0.26345825754106045, + 0.0, + 0.06729602813720703, + 0.0, + 0.11970200389623642, + 0.0, + 0.0, + 0.0, + 0.0978301540017128, + 0.0, + 0.0, + 0.26565367355942726, + 0.0, + 0.4505394157022238, + 0.14155018143355846, + 0.030544783920049667, + 0.07900956645607948, + 0.0, + 0.10579924657940865, + 0.0, + 0.05688421055674553, + 0.0, + 0.0, + 0.05197785049676895, + 0.0864737257361412, + 0.022176576778292656 + ], + "unique_experts": 43, + "load_cv": 1.533202117603802, + "normalized_load_entropy": 0.7937420821185269, + "max_load_share": 0.1111111111111111 + }, + "full_input": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "18ea2766a7329e08ad65e6d9ab60109919141f05099670add310b5fe8d5392ec", + "route_weight_sha256": "0df58f95197a24f9b37e6c5caf00a8adb939bf17bf5fcc240af2670b336c1478", + "loads": [ + 3, + 2, + 6, + 0, + 7, + 3, + 7, + 3, + 13, + 0, + 10, + 3, + 2, + 22, + 3, + 15, + 19, + 7, + 2, + 19, + 1, + 10, + 1, + 2, + 0, + 4, + 16, + 5, + 11, + 0, + 2, + 0, + 3, + 0, + 6, + 10, + 1, + 1, + 4, + 1, + 2, + 0, + 9, + 0, + 0, + 0, + 2, + 0, + 13, + 5, + 0, + 12, + 14, + 2, + 8, + 2, + 3, + 0, + 5, + 3, + 1, + 1, + 5, + 1 + ], + "weighted_loads": [ + 0.09204763546586037, + 0.08208039775490761, + 0.23278215061873198, + 0.0, + 0.2609909735620022, + 0.2238943725824356, + 0.6927842609584332, + 0.14742262661457062, + 0.7372479047626257, + 0.0, + 0.6053249426186085, + 0.13347330316901207, + 0.10932298749685287, + 3.134093312546611, + 0.09828681871294975, + 1.5791347669437528, + 1.6295910123735666, + 0.5461137560196221, + 0.11367110162973404, + 2.3103557247668505, + 0.047579433768987656, + 0.5431279251351953, + 0.03566932678222656, + 0.09719396382570267, + 0.0, + 0.298698665574193, + 0.8408726882189512, + 0.6968982629477978, + 1.3376965723000467, + 0.0, + 0.08542926609516144, + 0.0, + 0.1263248510658741, + 0.0, + 0.5192760676145554, + 0.6022189296782017, + 0.064903624355793, + 0.052382856607437134, + 0.26345825754106045, + 0.03939429298043251, + 0.12166711315512657, + 0.0, + 0.5282611064612865, + 0.0, + 0.0, + 0.0, + 0.0978301540017128, + 0.0, + 0.713542852550745, + 0.38648631796240807, + 0.0, + 0.77581294067204, + 0.8468215595930815, + 0.04355468321591616, + 0.31753231678158045, + 0.2135901302099228, + 0.14631743356585503, + 0.0, + 0.22276265919208527, + 0.11029595695436001, + 0.022252995520830154, + 0.05197785049676895, + 0.29932957142591476, + 0.022176576778292656 + ], + "unique_experts": 51, + "load_cv": 1.11088097550946, + "normalized_load_entropy": 0.8609438353041442, + "max_load_share": 0.07051282051282051 + } + }, + "s1_eos": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "0b7a0bde65ecddb1bffa7f6c1694c9ea4d917b364c005f4701af4b4ffd539551", + "route_weight_sha256": "0142eedb962da1b29e19375ab5044f978b905db0161f2166cbd741cf7ae2d707", + "loads": [ + 2, + 1, + 2, + 0, + 0, + 3, + 5, + 4, + 11, + 0, + 2, + 3, + 0, + 16, + 0, + 10, + 18, + 2, + 1, + 15, + 1, + 2, + 1, + 1, + 0, + 2, + 7, + 0, + 8, + 0, + 3, + 0, + 2, + 0, + 5, + 1, + 1, + 1, + 4, + 0, + 1, + 0, + 3, + 0, + 0, + 0, + 2, + 0, + 1, + 5, + 0, + 5, + 1, + 3, + 2, + 0, + 2, + 0, + 1, + 0, + 0, + 1, + 1, + 0 + ], + "weighted_loads": [ + 0.05454500764608383, + 0.05883761867880821, + 0.13315391913056374, + 0.0, + 0.0, + 0.22248045727610588, + 0.48373422399163246, + 0.1689447034150362, + 0.604421379044652, + 0.0, + 0.07537268288433552, + 0.13208923488855362, + 0.0, + 2.726144118234515, + 0.0, + 1.4085452482104301, + 1.5889809653162956, + 0.30355510860681534, + 0.07576964795589447, + 0.7790603190660477, + 0.04559049755334854, + 0.08765509724617004, + 0.03601723909378052, + 0.046094413846731186, + 0.0, + 0.2353370450437069, + 0.4140322841703892, + 0.0, + 1.2688431963324547, + 0.0, + 0.098320621997118, + 0.0, + 0.10087541490793228, + 0.0, + 0.4615878239274025, + 0.04229646548628807, + 0.07493497431278229, + 0.05353401601314545, + 0.28189362585544586, + 0.0, + 0.06859100610017776, + 0.0, + 0.09639223851263523, + 0.0, + 0.0, + 0.0, + 0.09805919229984283, + 0.0, + 0.027646504342556, + 0.27140600979328156, + 0.0, + 0.4646458700299263, + 0.11448504030704498, + 0.08412502892315388, + 0.08695432543754578, + 0.0, + 0.10956724174320698, + 0.0, + 0.057241495698690414, + 0.0, + 0.0, + 0.05122625082731247, + 0.09658413380384445, + 0.0 + ], + "unique_experts": 42, + "load_cv": 1.5300176871027102, + "normalized_load_entropy": 0.7924446284880331, + "max_load_share": 0.1111111111111111 + }, + "full_input": { + "tokens": 68, + "top_k": 6, + "decisions": 408, + "ordered_route_sha256": "566ece3c17b27b0d232623705cd3b06a26486eda586ca5817be72a2d212fc673", + "route_weight_sha256": "b19dd50cf4506ecdafb0c6b1fd1d2e2241ab51c7c1a3cee36822030908f9d240", + "loads": [ + 10, + 2, + 5, + 0, + 0, + 4, + 9, + 5, + 14, + 3, + 13, + 3, + 4, + 28, + 7, + 13, + 19, + 12, + 4, + 19, + 2, + 11, + 2, + 6, + 1, + 4, + 15, + 10, + 11, + 1, + 7, + 0, + 3, + 4, + 5, + 17, + 2, + 2, + 5, + 1, + 1, + 2, + 14, + 1, + 1, + 1, + 2, + 0, + 13, + 9, + 1, + 15, + 13, + 4, + 15, + 9, + 6, + 0, + 4, + 4, + 1, + 3, + 5, + 1 + ], + "weighted_loads": [ + 0.5715153273195028, + 0.10697789117693901, + 0.8253524834290147, + 0.0, + 0.0, + 0.23816428147256374, + 0.6690140925347805, + 0.25076943822205067, + 0.7419677954167128, + 0.17425908893346786, + 0.7063594963401556, + 0.13208923488855362, + 0.21811493486166, + 3.358424250036478, + 0.2672745492309332, + 1.4966079024598002, + 1.6022123266011477, + 0.684428378008306, + 0.1923924721777439, + 2.3129231929779053, + 0.09308576583862305, + 0.5919128987006843, + 0.06638092175126076, + 0.5372349489480257, + 0.036014486104249954, + 0.3069888576865196, + 0.695613706484437, + 1.1513772420585155, + 1.3041700567118824, + 0.04896918684244156, + 0.2720273155719042, + 0.0, + 0.12357466667890549, + 0.5968379527330399, + 0.4615878239274025, + 0.9438634179532528, + 0.14645467698574066, + 0.09419388696551323, + 0.3366597630083561, + 0.0384686142206192, + 0.06859100610017776, + 0.12483986094594002, + 0.7202864643186331, + 0.043906550854444504, + 0.06056966260075569, + 0.058362312614917755, + 0.09805919229984283, + 0.0, + 0.9318872727453709, + 1.2041031196713448, + 0.0538286492228508, + 1.190683763474226, + 0.7740029916167259, + 0.09713492821902037, + 0.854194619692862, + 0.6053120382130146, + 0.2708434034138918, + 0.0, + 0.1957236286252737, + 0.2067384421825409, + 0.02241954393684864, + 0.15821248292922974, + 0.28004036843776703, + 0.08817769587039948 + ], + "unique_experts": 59, + "load_cv": 0.9327646974326507, + "normalized_load_entropy": 0.899286255750674, + "max_load_share": 0.06862745098039216 + } + }, + "s0_bos": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "9855d5613cc621cb9c65dcac6aacd4acce08ee09246a2347a3d96ae61aad7adb", + "route_weight_sha256": "2bee893528045c6463f4ebdb6e819c3e7bee684d49fdf53d2846b1a7cc258cb5", + "loads": [ + 0, + 2, + 2, + 0, + 0, + 3, + 5, + 3, + 11, + 0, + 2, + 3, + 0, + 16, + 0, + 10, + 18, + 2, + 1, + 16, + 1, + 1, + 1, + 1, + 0, + 2, + 6, + 0, + 9, + 0, + 2, + 0, + 2, + 0, + 5, + 2, + 1, + 1, + 4, + 0, + 1, + 0, + 3, + 0, + 0, + 0, + 1, + 0, + 1, + 4, + 0, + 5, + 2, + 2, + 4, + 0, + 3, + 1, + 1, + 0, + 0, + 1, + 1, + 0 + ], + "weighted_loads": [ + 0.0, + 0.08641937002539635, + 0.11951134353876114, + 0.0, + 0.0, + 0.22019049525260925, + 0.474211847409606, + 0.12753314897418022, + 0.5955607201904058, + 0.0, + 0.06837380863726139, + 0.11744227260351181, + 0.0, + 2.7565802223980427, + 0.0, + 1.4259558469057083, + 1.6070220209658146, + 0.35770776495337486, + 0.06824342161417007, + 0.899630194529891, + 0.05039573088288307, + 0.0522739514708519, + 0.03565831854939461, + 0.04392431676387787, + 0.0, + 0.23320582136511803, + 0.4096072129905224, + 0.0, + 1.3159759193658829, + 0.0, + 0.07778460904955864, + 0.0, + 0.09584857895970345, + 0.0, + 0.4660368114709854, + 0.07179613783955574, + 0.04998047277331352, + 0.050684068351984024, + 0.3209184519946575, + 0.0, + 0.07228226959705353, + 0.0, + 0.10021933540701866, + 0.0, + 0.0, + 0.0, + 0.04477506875991821, + 0.0, + 0.028079871088266373, + 0.23745174705982208, + 0.0, + 0.4619307331740856, + 0.15564540214836597, + 0.057435501366853714, + 0.14588500186800957, + 0.0, + 0.15525409393012524, + 0.024965845048427582, + 0.06313078850507736, + 0.0, + 0.0, + 0.05307265371084213, + 0.08033598959445953, + 0.0 + ], + "unique_experts": 42, + "load_cv": 1.550599590997589, + "normalized_load_entropy": 0.7902073690699879, + "max_load_share": 0.1111111111111111 + }, + "full_input": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "eb79fcaee476e95ddbe3761caa712160fb8a715e2aaf5f5e31ba116e79999b70", + "route_weight_sha256": "4cd7c1edb6de76bddde080cd8a4dd03ab4962a6400dcef1c89fc05455cd4513a", + "loads": [ + 0, + 4, + 4, + 1, + 5, + 3, + 6, + 3, + 14, + 0, + 9, + 3, + 2, + 22, + 2, + 15, + 19, + 7, + 3, + 18, + 1, + 8, + 1, + 2, + 0, + 3, + 14, + 5, + 11, + 0, + 3, + 3, + 3, + 0, + 6, + 11, + 1, + 1, + 4, + 3, + 4, + 0, + 8, + 0, + 0, + 2, + 1, + 0, + 14, + 6, + 0, + 12, + 12, + 3, + 8, + 3, + 5, + 1, + 3, + 2, + 1, + 2, + 5, + 0 + ], + "weighted_loads": [ + 0.0, + 0.16510747745633125, + 0.1891941875219345, + 0.19801545143127441, + 0.19169437140226364, + 0.22019049525260925, + 0.6266026552766562, + 0.12753314897418022, + 0.7486258801072836, + 0.0, + 0.5179872792214155, + 0.11744227260351181, + 0.10932298749685287, + 3.243994727730751, + 0.0777881070971489, + 1.6012743096798658, + 1.6202533822506666, + 0.5618312060832977, + 0.15754762291908264, + 1.47825856693089, + 0.05039573088288307, + 0.5091046309098601, + 0.03565831854939461, + 0.08653100952506065, + 0.0, + 0.2687783017754555, + 0.7898820340633392, + 0.6489974819123745, + 1.374475977383554, + 0.0, + 0.13429008051753044, + 0.24797068908810616, + 0.11871315911412239, + 0.0, + 0.5167887769639492, + 0.6307716555893421, + 0.04998047277331352, + 0.050684068351984024, + 0.3209184519946575, + 0.12240924686193466, + 0.24772519245743752, + 0.0, + 0.43161316215991974, + 0.0, + 0.0, + 0.15456409379839897, + 0.04477506875991821, + 0.0, + 0.7351101003587246, + 0.40106067061424255, + 0.0, + 0.7872042581439018, + 0.7804311532527208, + 0.0704454006627202, + 0.2737570898607373, + 0.2640647068619728, + 0.23309116251766682, + 0.024965845048427582, + 0.12754783779382706, + 0.06901274807751179, + 0.022252995520830154, + 0.08868518471717834, + 0.2694702222943306, + 0.0 + ], + "unique_experts": 53, + "load_cv": 1.064951777297189, + "normalized_load_entropy": 0.8740932244666999, + "max_load_share": 0.07051282051282051 + } + }, + "s1_bos": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "a01262037af62046ff2edf8bddf3be5b2ac949a053e6ddfb21c698cbd69db7b8", + "route_weight_sha256": "0f3e73b5ecf065c3f7b0e23bb971e1476de09ee39874ac866ee8aa9960813a7d", + "loads": [ + 2, + 2, + 2, + 0, + 0, + 3, + 5, + 3, + 10, + 0, + 2, + 3, + 0, + 16, + 0, + 10, + 18, + 2, + 1, + 15, + 1, + 2, + 1, + 1, + 0, + 2, + 6, + 0, + 9, + 0, + 3, + 0, + 2, + 0, + 5, + 2, + 1, + 1, + 4, + 0, + 1, + 0, + 2, + 0, + 0, + 0, + 2, + 0, + 1, + 5, + 0, + 5, + 2, + 2, + 4, + 0, + 1, + 0, + 1, + 0, + 0, + 1, + 1, + 0 + ], + "weighted_loads": [ + 0.06419551931321621, + 0.09537586569786072, + 0.12492856755852699, + 0.0, + 0.0, + 0.23143388330936432, + 0.5138846337795258, + 0.12207040563225746, + 0.5877261087298393, + 0.0, + 0.06758861988782883, + 0.11702438071370125, + 0.0, + 2.691568085923791, + 0.0, + 1.4265861473977566, + 1.604334119707346, + 0.28410837799310684, + 0.07329725474119186, + 0.8646176606416702, + 0.05709720775485039, + 0.07994304224848747, + 0.0362914502620697, + 0.05926947668194771, + 0.0, + 0.2237645760178566, + 0.4041641466319561, + 0.0, + 1.3303353823721409, + 0.0, + 0.08839817903935909, + 0.0, + 0.10003286227583885, + 0.0, + 0.47164173424243927, + 0.06631759367883205, + 0.06430970132350922, + 0.05116285756230354, + 0.3235456980764866, + 0.0, + 0.07587513327598572, + 0.0, + 0.07396569103002548, + 0.0, + 0.0, + 0.0, + 0.09762091562151909, + 0.0, + 0.02877369336783886, + 0.2609259616583586, + 0.0, + 0.47927554324269295, + 0.14926041290163994, + 0.05651416815817356, + 0.15167606249451637, + 0.0, + 0.0671488344669342, + 0.0, + 0.06292911618947983, + 0.0, + 0.0, + 0.05242855101823807, + 0.09298168122768402, + 0.0 + ], + "unique_experts": 42, + "load_cv": 1.5172131295689817, + "normalized_load_entropy": 0.7957385984421438, + "max_load_share": 0.1111111111111111 + }, + "full_input": { + "tokens": 68, + "top_k": 6, + "decisions": 408, + "ordered_route_sha256": "9b097d307e60b8475be59d9d251813e49919459e916a169847a18b9cc45d08fa", + "route_weight_sha256": "ea9e36d7c0c8bacc24dc7b323fa011bfa757ab88583f565410e26a96bc36af06", + "loads": [ + 10, + 4, + 5, + 0, + 3, + 4, + 9, + 5, + 14, + 3, + 11, + 4, + 4, + 26, + 6, + 13, + 19, + 11, + 5, + 19, + 2, + 10, + 2, + 6, + 1, + 4, + 14, + 11, + 11, + 1, + 7, + 1, + 3, + 4, + 5, + 18, + 2, + 2, + 5, + 1, + 2, + 2, + 12, + 1, + 1, + 1, + 2, + 0, + 13, + 9, + 1, + 15, + 12, + 3, + 17, + 10, + 7, + 0, + 2, + 3, + 1, + 2, + 6, + 1 + ], + "weighted_loads": [ + 0.5811658389866352, + 0.17957013472914696, + 0.8521308768540621, + 0.0, + 0.10867257416248322, + 0.24711770750582218, + 0.7628142535686493, + 0.24081870540976524, + 0.769708875566721, + 0.17425908893346786, + 0.6130212768912315, + 0.1598040834069252, + 0.21811493486166, + 3.319041181355715, + 0.24255363084375858, + 1.546763677150011, + 1.617565480992198, + 0.659593366086483, + 0.22052831947803497, + 1.494016196578741, + 0.1045924760401249, + 0.5772164640948176, + 0.06665513291954994, + 0.5504100117832422, + 0.036014486104249954, + 0.2954163886606693, + 0.6857455689460039, + 1.1416050642728806, + 1.3612954309210181, + 0.04896918684244156, + 0.2551405057311058, + 0.08930191397666931, + 0.12273211404681206, + 0.5968379527330399, + 0.47164173424243927, + 0.9678845461457968, + 0.1358294039964676, + 0.09182272851467133, + 0.3783118352293968, + 0.03190779313445091, + 0.12089572474360466, + 0.12483986094594002, + 0.5903096199035645, + 0.043906550854444504, + 0.06056966260075569, + 0.058362312614917755, + 0.09762091562151909, + 0.0, + 0.9268459398299456, + 1.2618077155202627, + 0.0538286492228508, + 1.2053134366869926, + 0.7301381938159466, + 0.06952406745404005, + 0.926167362369597, + 0.664851076900959, + 0.3034287095069885, + 0.0, + 0.0877970028668642, + 0.16723810881376266, + 0.02241954393684864, + 0.11870411038398743, + 0.3290336988866329, + 0.08817769587039948 + ], + "unique_experts": 61, + "load_cv": 0.902173887868811, + "normalized_load_entropy": 0.9069138462730799, + "max_load_share": 0.06372549019607843 + } + }, + "s0_x": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "1f09f69ac1309c185a6f158b43b8651e7f613373b62efd291b4e00297b30ce8a", + "route_weight_sha256": "332f7c7311fc95013b338afc04bfef5de714e52a53e64cc74ef6a909202e297a", + "loads": [ + 1, + 1, + 2, + 0, + 0, + 3, + 5, + 4, + 11, + 0, + 2, + 3, + 0, + 16, + 2, + 10, + 18, + 2, + 1, + 15, + 1, + 1, + 1, + 1, + 0, + 2, + 6, + 0, + 9, + 0, + 3, + 0, + 1, + 0, + 5, + 2, + 1, + 1, + 5, + 0, + 1, + 0, + 2, + 0, + 0, + 0, + 1, + 0, + 0, + 5, + 0, + 5, + 1, + 3, + 3, + 0, + 2, + 1, + 1, + 0, + 0, + 1, + 1, + 0 + ], + "weighted_loads": [ + 0.047226421535015106, + 0.05919380858540535, + 0.12645892426371574, + 0.0, + 0.0, + 0.21485469862818718, + 0.4956513326615095, + 0.13997026160359383, + 0.6395994983613491, + 0.0, + 0.06813650764524937, + 0.12176907062530518, + 0.0, + 2.7822893280535936, + 0.05593546852469444, + 1.4599681794643402, + 1.6222326420247555, + 0.2505023665726185, + 0.0684385672211647, + 0.8397471886128187, + 0.051460396498441696, + 0.0523548386991024, + 0.03528260067105293, + 0.0747603103518486, + 0.0, + 0.22742580994963646, + 0.4061330743134022, + 0.0, + 1.3065378312021494, + 0.0, + 0.09229171089828014, + 0.0, + 0.06303862482309341, + 0.0, + 0.46882568672299385, + 0.07337547279894352, + 0.05309055745601654, + 0.052696142345666885, + 0.3257085047662258, + 0.0, + 0.06614820659160614, + 0.0, + 0.07663559168577194, + 0.0, + 0.0, + 0.0, + 0.04296305403113365, + 0.0, + 0.0, + 0.2637162022292614, + 0.0, + 0.4573388546705246, + 0.1371164619922638, + 0.09065231680870056, + 0.1267850697040558, + 0.0, + 0.12666795030236244, + 0.02887757122516632, + 0.06616416573524475, + 0.0, + 0.0, + 0.06326442211866379, + 0.08861743658781052, + 0.0 + ], + "unique_experts": 43, + "load_cv": 1.5363799478001654, + "normalized_load_entropy": 0.7924474514948835, + "max_load_share": 0.1111111111111111 + }, + "full_input": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "bd8254a933a6102d59b5a9bc480e3e443dc7561da5ecc5a2af2720dc8d1a8187", + "route_weight_sha256": "440a6e04a254dadf1ac53a9060fd2ab57aed2f706a978a4a25e15476e48f0379", + "loads": [ + 1, + 1, + 4, + 0, + 6, + 3, + 7, + 4, + 14, + 0, + 11, + 3, + 3, + 20, + 4, + 14, + 20, + 9, + 1, + 18, + 1, + 7, + 1, + 2, + 0, + 3, + 14, + 5, + 12, + 0, + 4, + 1, + 2, + 0, + 6, + 12, + 1, + 1, + 5, + 0, + 2, + 0, + 10, + 0, + 0, + 0, + 1, + 0, + 15, + 7, + 0, + 12, + 12, + 4, + 8, + 3, + 4, + 1, + 3, + 2, + 1, + 3, + 4, + 0 + ], + "weighted_loads": [ + 0.047226421535015106, + 0.05919380858540535, + 0.19614176824688911, + 0.0, + 0.23203210532665253, + 0.21485469862818718, + 0.6929152999073267, + 0.13997026160359383, + 0.8031746074557304, + 0.0, + 0.6076208930462599, + 0.12176907062530518, + 0.14245599508285522, + 3.0821296852082014, + 0.13063906878232956, + 1.6077592428773642, + 1.6786758657544851, + 0.5402227621525526, + 0.0684385672211647, + 1.4568696077913046, + 0.051460396498441696, + 0.4675775049254298, + 0.03528260067105293, + 0.11736700311303139, + 0.0, + 0.2629982903599739, + 0.786407895386219, + 0.7065155170857906, + 1.408186581917107, + 0.0, + 0.1377661768347025, + 0.06150864437222481, + 0.08590320497751236, + 0.0, + 0.5195776522159576, + 0.7272654790431261, + 0.05309055745601654, + 0.052696142345666885, + 0.3257085047662258, + 0.0, + 0.1046854630112648, + 0.0, + 0.5280336737632751, + 0.0, + 0.0, + 0.0, + 0.04296305403113365, + 0.0, + 0.8399851676076651, + 0.44918348267674446, + 0.0, + 0.7826123796403408, + 0.955033928155899, + 0.10366221610456705, + 0.2940029324963689, + 0.2875826545059681, + 0.21521348506212234, + 0.02887757122516632, + 0.13403350487351418, + 0.06901274807751179, + 0.022252995520830154, + 0.12883934751152992, + 0.2148086316883564, + 0.0 + ], + "unique_experts": 51, + "load_cv": 1.0965848605304152, + "normalized_load_entropy": 0.8612389968833637, + "max_load_share": 0.0641025641025641 + } + }, + "s1_x": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "9011e66b73b48dc109af1c320b642673646d033cdd86bbc24458644c066c5d42", + "route_weight_sha256": "00b8d9b828fe737b23f5fcfdc926af01443369d01ca6c1455a908fe59659cda6", + "loads": [ + 3, + 1, + 2, + 1, + 1, + 4, + 4, + 2, + 10, + 0, + 2, + 3, + 1, + 16, + 1, + 10, + 18, + 2, + 1, + 17, + 1, + 1, + 1, + 0, + 0, + 3, + 6, + 0, + 8, + 0, + 2, + 0, + 2, + 0, + 5, + 2, + 0, + 1, + 4, + 0, + 1, + 0, + 2, + 0, + 0, + 0, + 1, + 0, + 2, + 4, + 0, + 4, + 1, + 3, + 5, + 0, + 1, + 1, + 1, + 0, + 0, + 0, + 1, + 0 + ], + "weighted_loads": [ + 0.12497945874929428, + 0.057231198996305466, + 0.11899202316999435, + 0.03259016200900078, + 0.22092679142951965, + 0.25098406337201595, + 0.47411201521754265, + 0.07237699627876282, + 0.5861409977078438, + 0.0, + 0.07149676606059074, + 0.10830910503864288, + 0.030107762664556503, + 2.6414557229727507, + 0.02684912271797657, + 1.4581954628229141, + 1.5478810258209705, + 0.1828799545764923, + 0.06938914209604263, + 1.038273461163044, + 0.05791253596544266, + 0.045707326382398605, + 0.03630119934678078, + 0.0, + 0.0, + 0.25993972457945347, + 0.3792765215039253, + 0.0, + 1.2660986334085464, + 0.0, + 0.06758638843894005, + 0.0, + 0.11043784022331238, + 0.0, + 0.449215292930603, + 0.07213870994746685, + 0.0, + 0.05012363940477371, + 0.32743946835398674, + 0.0, + 0.07015256583690643, + 0.0, + 0.07007858529686928, + 0.0, + 0.0, + 0.0, + 0.05014496669173241, + 0.0, + 0.08366720005869865, + 0.22607549279928207, + 0.0, + 0.4913123846054077, + 0.1305929720401764, + 0.09658289328217506, + 0.17899943701922894, + 0.0, + 0.07055902481079102, + 0.03009115345776081, + 0.06103263050317764, + 0.0, + 0.0, + 0.0, + 0.08653859049081802, + 0.0 + ], + "unique_experts": 44, + "load_cv": 1.54429591414553, + "normalized_load_entropy": 0.7966286155149076, + "max_load_share": 0.1111111111111111 + }, + "full_input": { + "tokens": 68, + "top_k": 6, + "decisions": 408, + "ordered_route_sha256": "9852701969faf8d0a552607bbdea9be734fe4002f150a714951756508974f09d", + "route_weight_sha256": "a93c9c477b475332b3a8fbd46d3ec8ac39694907fa907d5700eeb38570fda3f2", + "loads": [ + 12, + 2, + 4, + 1, + 2, + 5, + 7, + 3, + 13, + 3, + 12, + 3, + 10, + 26, + 8, + 13, + 19, + 8, + 4, + 21, + 2, + 8, + 2, + 7, + 1, + 7, + 14, + 10, + 10, + 1, + 7, + 0, + 3, + 4, + 5, + 19, + 1, + 2, + 5, + 0, + 1, + 3, + 15, + 1, + 1, + 1, + 1, + 0, + 17, + 8, + 1, + 14, + 12, + 4, + 19, + 10, + 5, + 1, + 2, + 3, + 1, + 1, + 2, + 1 + ], + "weighted_loads": [ + 0.6785702686756849, + 0.10537147149443626, + 0.8085191231220961, + 0.03259016200900078, + 0.25123339518904686, + 0.2666678875684738, + 0.5837290845811367, + 0.15420173108577728, + 0.7372946552932262, + 0.17425908893346786, + 0.6116218753159046, + 0.10830910503864288, + 0.43570562824606895, + 3.27423308044672, + 0.3172283358871937, + 1.5741284638643265, + 1.5611123871058226, + 0.43532638251781464, + 0.16498297080397606, + 1.6757623441517353, + 0.10540780425071716, + 0.503594177775085, + 0.06666488200426102, + 0.6131503824144602, + 0.036014486104249954, + 0.4213013965636492, + 0.6608579438179731, + 1.138250906020403, + 1.2970586819574237, + 0.04896918684244156, + 0.28181169740855694, + 0.0, + 0.13313709199428558, + 0.5968379527330399, + 0.449215292930603, + 1.0420560147613287, + 0.07151970267295837, + 0.0907835103571415, + 0.382205605506897, + 0.0, + 0.07015256583690643, + 0.19747613742947578, + 0.7331862896680832, + 0.043906550854444504, + 0.06056966260075569, + 0.058362312614917755, + 0.05014496669173241, + 0.0, + 1.210013784468174, + 1.168943490833044, + 0.0538286492228508, + 1.2173502780497074, + 0.9104169011116028, + 0.10959279257804155, + 0.9752769125625491, + 0.6740292496979237, + 0.23183518648147583, + 0.03009115345776081, + 0.08590051718056202, + 0.16723810881376266, + 0.02241954393684864, + 0.06627555936574936, + 0.1223650723695755, + 0.08817769587039948 + ], + "unique_experts": 61, + "load_cv": 0.9579790980632241, + "normalized_load_entropy": 0.8959764609614386, + "max_load_share": 0.06372549019607843 + } + }, + "s0_period": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "0881d2ded398f22d394ff08579fff8b444334bacd84a05be3644986f2ff1f0f6", + "route_weight_sha256": "36c3a6373fdf372bb23c1866a07e5d02f0c2c6f6edd45feb945f4d812e6a290f", + "loads": [ + 1, + 2, + 2, + 0, + 0, + 3, + 5, + 3, + 11, + 0, + 2, + 3, + 0, + 16, + 0, + 10, + 18, + 2, + 1, + 16, + 1, + 1, + 1, + 1, + 0, + 2, + 6, + 0, + 8, + 0, + 1, + 0, + 1, + 0, + 5, + 2, + 1, + 1, + 4, + 0, + 2, + 0, + 3, + 0, + 0, + 0, + 2, + 0, + 0, + 6, + 0, + 5, + 1, + 3, + 3, + 0, + 2, + 1, + 1, + 0, + 0, + 1, + 2, + 0 + ], + "weighted_loads": [ + 0.04614967852830887, + 0.08901937678456306, + 0.12307603657245636, + 0.0, + 0.0, + 0.20903614908456802, + 0.485713766887784, + 0.11058177053928375, + 0.6192987635731697, + 0.0, + 0.06910576298832893, + 0.12178558483719826, + 0.0, + 2.7388882376253605, + 0.0, + 1.447840441018343, + 1.590741828083992, + 0.28225988522171974, + 0.06846057623624802, + 0.9786765426397324, + 0.05427006632089615, + 0.05308554321527481, + 0.03634077310562134, + 0.06335935741662979, + 0.0, + 0.22509197145700455, + 0.41384560242295265, + 0.0, + 1.312393344938755, + 0.0, + 0.04121849313378334, + 0.0, + 0.06358806043863297, + 0.0, + 0.4619688391685486, + 0.07399818859994411, + 0.05500078201293945, + 0.05432457849383354, + 0.2991919107735157, + 0.0, + 0.08244359493255615, + 0.0, + 0.09768456593155861, + 0.0, + 0.0, + 0.0, + 0.0969076044857502, + 0.0, + 0.0, + 0.31187926046550274, + 0.0, + 0.48026720993220806, + 0.13253261148929596, + 0.08963295631110668, + 0.12083862721920013, + 0.0, + 0.10062852874398232, + 0.029841959476470947, + 0.06563972681760788, + 0.0, + 0.0, + 0.05970550328493118, + 0.11234730295836926, + 0.0 + ], + "unique_experts": 42, + "load_cv": 1.547450962397269, + "normalized_load_entropy": 0.7904796555992989, + "max_load_share": 0.1111111111111111 + }, + "full_input": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "b8f56718363ccd068d123375b27dfccea3cde5cf636df923e1ac809c63ae4896", + "route_weight_sha256": "7c658bb3f7f626e48bdb22bae8e4d5ec3f48a5cf46c4cf14429e25018939bc95", + "loads": [ + 1, + 3, + 4, + 0, + 7, + 3, + 8, + 3, + 14, + 0, + 9, + 3, + 3, + 22, + 2, + 15, + 19, + 8, + 1, + 19, + 1, + 7, + 1, + 2, + 0, + 3, + 14, + 5, + 11, + 0, + 2, + 1, + 2, + 0, + 6, + 12, + 1, + 1, + 4, + 0, + 4, + 0, + 9, + 0, + 0, + 1, + 2, + 0, + 14, + 8, + 0, + 13, + 11, + 4, + 9, + 4, + 3, + 1, + 2, + 3, + 1, + 1, + 5, + 0 + ], + "weighted_loads": [ + 0.04614967852830887, + 0.12384426221251488, + 0.19275888055562973, + 0.0, + 0.26861731335520744, + 0.20903614908456802, + 0.7532058116048574, + 0.11058177053928375, + 0.774392906576395, + 0.0, + 0.5163793452084064, + 0.12178558483719826, + 0.1455393210053444, + 3.1295748613774776, + 0.07580715417861938, + 1.6326250899583101, + 1.603973189368844, + 0.5360697973519564, + 0.06846057623624802, + 1.5894163101911545, + 0.05427006632089615, + 0.46830820944160223, + 0.03634077310562134, + 0.10596605017781258, + 0.0, + 0.260664451867342, + 0.7941204234957695, + 0.7318926863372326, + 1.4088045796379447, + 0.0, + 0.08670511841773987, + 0.07113092392683029, + 0.08645264059305191, + 0.0, + 0.5127208046615124, + 0.6933417972177267, + 0.05500078201293945, + 0.05432457849383354, + 0.2991919107735157, + 0.0, + 0.16130029410123825, + 0.0, + 0.4659232571721077, + 0.0, + 0.0, + 0.042313143610954285, + 0.0969076044857502, + 0.0, + 0.7991781309247017, + 0.5583100374788046, + 0.0, + 0.8697982598096132, + 0.7573183625936508, + 0.10264285560697317, + 0.32837206963449717, + 0.3468128927052021, + 0.1411467157304287, + 0.029841959476470947, + 0.09036078304052353, + 0.1579145435243845, + 0.022252995520830154, + 0.05970550328493118, + 0.2590400744229555, + 0.0 + ], + "unique_experts": 52, + "load_cv": 1.1055415967851332, + "normalized_load_entropy": 0.8622396493754445, + "max_load_share": 0.07051282051282051 + } + }, + "s1_period": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "266dcec32ca297c297cdcbeebd10c4a19c8d09fc3eb25473cb1f440aeb3ca02c", + "route_weight_sha256": "551bfb7bb1ee16e2ceb95522bdb79714146a10d231a645bf1fd53feaae5b6765", + "loads": [ + 3, + 1, + 3, + 1, + 1, + 4, + 5, + 3, + 10, + 0, + 2, + 3, + 0, + 16, + 1, + 10, + 18, + 2, + 1, + 17, + 1, + 1, + 1, + 0, + 0, + 2, + 6, + 0, + 8, + 0, + 2, + 0, + 2, + 0, + 5, + 2, + 0, + 1, + 4, + 0, + 1, + 0, + 2, + 0, + 0, + 0, + 1, + 0, + 2, + 6, + 0, + 4, + 2, + 2, + 3, + 0, + 1, + 0, + 1, + 0, + 0, + 0, + 1, + 0 + ], + "weighted_loads": [ + 0.1408216394484043, + 0.06436831504106522, + 0.1565612405538559, + 0.02942619100213051, + 0.16830524802207947, + 0.24498404003679752, + 0.49034454487264156, + 0.10485827550292015, + 0.5755793862044811, + 0.0, + 0.06984361447393894, + 0.11426398530602455, + 0.0, + 2.5318087469786406, + 0.027567103505134583, + 1.450460221618414, + 1.5202607065439224, + 0.17921749502420425, + 0.07099060714244843, + 1.1880807615816593, + 0.05296340584754944, + 0.047783587127923965, + 0.04056559503078461, + 0.0, + 0.0, + 0.21452658623456955, + 0.40855858102440834, + 0.0, + 1.2453345730900764, + 0.0, + 0.06940069049596786, + 0.0, + 0.10942890495061874, + 0.0, + 0.46144910529255867, + 0.08007672429084778, + 0.0, + 0.052763327956199646, + 0.3542718328535557, + 0.0, + 0.06307143718004227, + 0.0, + 0.07213913835585117, + 0.0, + 0.0, + 0.0, + 0.04664631187915802, + 0.0, + 0.06187463738024235, + 0.3031872697174549, + 0.0, + 0.4584966450929642, + 0.1592798177152872, + 0.06776351854205132, + 0.14100349321961403, + 0.0, + 0.06853001564741135, + 0.0, + 0.0721285417675972, + 0.0, + 0.0, + 0.0, + 0.08458613604307175, + 0.0 + ], + "unique_experts": 42, + "load_cv": 1.5553105823173627, + "normalized_load_entropy": 0.7901834894794236, + "max_load_share": 0.1111111111111111 + }, + "full_input": { + "tokens": 68, + "top_k": 6, + "decisions": 408, + "ordered_route_sha256": "458d1a225702c015b20acec92d96f8c554c263aeac513f1b9eaec3a803ed6e86", + "route_weight_sha256": "12efeb2e10736b1b681f134ecfb5d6548f31dc8f5efd63854481a4ce2deb7c3f", + "loads": [ + 11, + 2, + 5, + 1, + 2, + 5, + 9, + 4, + 13, + 4, + 10, + 3, + 9, + 27, + 8, + 12, + 19, + 9, + 5, + 22, + 2, + 8, + 2, + 7, + 1, + 4, + 14, + 10, + 10, + 1, + 6, + 0, + 3, + 5, + 5, + 20, + 1, + 2, + 5, + 0, + 1, + 2, + 15, + 1, + 1, + 1, + 1, + 0, + 15, + 10, + 1, + 15, + 12, + 3, + 17, + 10, + 5, + 0, + 2, + 4, + 1, + 1, + 3, + 1 + ], + "weighted_loads": [ + 0.6577919591218233, + 0.11250858753919601, + 0.8460883405059576, + 0.02942619100213051, + 0.21030768007040024, + 0.2606678642332554, + 0.6675580572336912, + 0.18668301030993462, + 0.7309641875326633, + 0.2061961404979229, + 0.550718953832984, + 0.11426398530602455, + 0.4122220315039158, + 3.1576008424162865, + 0.34174670837819576, + 1.5300066210329533, + 1.5334920678287745, + 0.45236069336533546, + 0.21851267665624619, + 1.861700003966689, + 0.10045867413282394, + 0.5056704385206103, + 0.07092927768826485, + 0.6023810971528292, + 0.036014486104249954, + 0.2861783988773823, + 0.6901400033384562, + 1.1295667253434658, + 1.2762946216389537, + 0.04896918684244156, + 0.23525316826999187, + 0.0, + 0.13212815672159195, + 0.6265576872974634, + 0.46144910529255867, + 1.065039660781622, + 0.07151970267295837, + 0.09342319890856743, + 0.4090379700064659, + 0.0, + 0.06307143718004227, + 0.12483986094594002, + 0.7686967831104994, + 0.043906550854444504, + 0.06056966260075569, + 0.058362312614917755, + 0.04664631187915802, + 0.0, + 1.0089068543165922, + 1.3453560806810856, + 0.0538286492228508, + 1.245040837675333, + 0.7401575986295938, + 0.0807734178379178, + 0.9539180705323815, + 0.6836966536939144, + 0.22980617731809616, + 0.0, + 0.09699642844498158, + 0.24025751650333405, + 0.02241954393684864, + 0.06627555936574936, + 0.16691016405820847, + 0.08817769587039948 + ], + "unique_experts": 60, + "load_cv": 0.9571760978399155, + "normalized_load_entropy": 0.8957433602779457, + "max_load_share": 0.0661764705882353 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 27, + "ordered_topk_exact_tokens": 18, + "set_exact_tokens": 21, + "mean_set_jaccard": 0.9285714285714286, + "mean_token_weighted_tv": 0.017961136341370917, + "aggregate_load_tv": 0.043209876543209874 + }, + "system_bos": { + "tokens": 27, + "ordered_topk_exact_tokens": 18, + "set_exact_tokens": 20, + "mean_set_jaccard": 0.9259259259259259, + "mean_token_weighted_tv": 0.02358939122684576, + "aggregate_load_tv": 0.037037037037037035 + }, + "system_x": { + "tokens": 27, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.8460317460317462, + "mean_token_weighted_tv": 0.04622530171440707, + "aggregate_load_tv": 0.08641975308641975 + }, + "system_period": { + "tokens": 27, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.8566137566137567, + "mean_token_weighted_tv": 0.04617039103888803, + "aggregate_load_tv": 0.08024691358024691 + }, + "bos_at_s0": { + "tokens": 27, + "ordered_topk_exact_tokens": 16, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.8862433862433863, + "mean_token_weighted_tv": 0.029504498811783613, + "aggregate_load_tv": 0.06790123456790123 + }, + "bos_at_s1": { + "tokens": 27, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.8941798941798943, + "mean_token_weighted_tv": 0.028024148333955695, + "aggregate_load_tv": 0.037037037037037035 + }, + "x_at_s0": { + "tokens": 27, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 13, + "mean_set_jaccard": 0.8439153439153438, + "mean_token_weighted_tv": 0.03700066078454256, + "aggregate_load_tv": 0.07407407407407407 + }, + "x_at_s1": { + "tokens": 27, + "ordered_topk_exact_tokens": 8, + "set_exact_tokens": 13, + "mean_set_jaccard": 0.816931216931217, + "mean_token_weighted_tv": 0.0582328311133164, + "aggregate_load_tv": 0.09259259259259259 + }, + "period_at_s0": { + "tokens": 27, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.8650793650793652, + "mean_token_weighted_tv": 0.035732604977157384, + "aggregate_load_tv": 0.06790123456790123 + }, + "period_at_s1": { + "tokens": 27, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.846031746031746, + "mean_token_weighted_tv": 0.059770413432960155, + "aggregate_load_tv": 0.08024691358024691 + } + } + }, + "layer_22": { + "layer": 22, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "e05282b594f3cf2f75c169bd05828ac863a9836a41a5704d8590e85de5d7361a", + "route_weight_sha256": "0bf707cc929a99c518c5a6555c00081fbdafdbb2b4f79d0f27a302b9dfb77289", + "loads": [ + 6, + 5, + 1, + 1, + 0, + 0, + 1, + 0, + 23, + 0, + 1, + 2, + 0, + 2, + 5, + 0, + 0, + 1, + 0, + 6, + 0, + 0, + 1, + 0, + 1, + 1, + 3, + 0, + 0, + 4, + 1, + 4, + 8, + 1, + 1, + 0, + 0, + 13, + 1, + 11, + 1, + 0, + 1, + 2, + 2, + 10, + 0, + 2, + 4, + 3, + 0, + 2, + 0, + 0, + 5, + 0, + 4, + 2, + 6, + 0, + 1, + 7, + 0, + 6 + ], + "weighted_loads": [ + 0.23934422805905342, + 0.3475509509444237, + 0.04029570147395134, + 0.06074688211083412, + 0.0, + 0.0, + 0.031197354197502136, + 0.0, + 2.70289246737957, + 0.0, + 0.08358440548181534, + 0.32512443512678146, + 0.0, + 0.0975748747587204, + 0.5515540353953838, + 0.0, + 0.0, + 0.03133133798837662, + 0.0, + 0.3365088142454624, + 0.0, + 0.0, + 0.05862613394856453, + 0.0, + 0.07414621114730835, + 0.037961866706609726, + 0.16907557845115662, + 0.0, + 0.0, + 0.1942806951701641, + 0.12424203008413315, + 0.4267961233854294, + 0.7250426597893238, + 0.026217292994260788, + 0.05167370289564133, + 0.0, + 0.0, + 1.2093520015478134, + 0.04176304116845131, + 0.7513507753610611, + 0.02813255786895752, + 0.0, + 0.02123849093914032, + 0.09429251775145531, + 0.08741887286305428, + 0.8920939303934574, + 0.0, + 0.20230253785848618, + 0.22999058105051517, + 0.14550422504544258, + 0.0, + 0.06694562919437885, + 0.0, + 0.0, + 0.7215241380035877, + 0.0, + 0.1947629190981388, + 0.07875142991542816, + 1.0500022917985916, + 0.0, + 0.05252319946885109, + 0.44914529472589493, + 0.0, + 0.37942202761769295 + ], + "unique_experts": 41, + "load_cv": 1.5347918551756816, + "normalized_load_entropy": 0.7917754624371725, + "max_load_share": 0.1419753086419753 + }, + "full_input": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "fa925eeda520ea9e200199ed3c4bfd14aa59b15621c6ccad147dd9488142232f", + "route_weight_sha256": "c241594674db735f2fab42f6076bf723c945a9a6beba8333115fb5688ff605e7", + "loads": [ + 10, + 6, + 3, + 10, + 0, + 3, + 6, + 0, + 38, + 5, + 1, + 6, + 0, + 2, + 11, + 0, + 0, + 3, + 0, + 6, + 0, + 7, + 2, + 1, + 1, + 2, + 3, + 3, + 0, + 4, + 1, + 4, + 11, + 8, + 2, + 2, + 0, + 16, + 1, + 11, + 4, + 1, + 6, + 2, + 2, + 11, + 1, + 2, + 6, + 6, + 5, + 2, + 0, + 1, + 5, + 15, + 7, + 3, + 6, + 0, + 10, + 15, + 0, + 13 + ], + "weighted_loads": [ + 0.41307302843779325, + 0.3995629996061325, + 0.1223246157169342, + 1.9316581301391125, + 0.0, + 0.12773335631936789, + 0.301124625839293, + 0.0, + 4.013443600386381, + 0.19437496177852154, + 0.08358440548181534, + 0.44324205350130796, + 0.0, + 0.0975748747587204, + 1.0452215666882694, + 0.0, + 0.0, + 0.10580974444746971, + 0.0, + 0.3365088142454624, + 0.0, + 0.6766389831900597, + 0.08819746971130371, + 0.028657522052526474, + 0.07414621114730835, + 0.06422982551157475, + 0.16907557845115662, + 0.12452822178602219, + 0.0, + 0.1942806951701641, + 0.12424203008413315, + 0.4267961233854294, + 0.8020233893766999, + 0.290964936837554, + 0.10963759571313858, + 0.12919895723462105, + 0.0, + 1.3565261214971542, + 0.04176304116845131, + 0.7513507753610611, + 0.19432826340198517, + 0.041399553418159485, + 0.44294314458966255, + 0.09429251775145531, + 0.08741887286305428, + 0.9229085501283407, + 0.04303233325481415, + 0.20230253785848618, + 0.32716568745672703, + 0.359005780890584, + 0.26701484248042107, + 0.06694562919437885, + 0.0, + 0.04347246512770653, + 0.7215241380035877, + 1.2020580009557307, + 0.314756628125906, + 0.10440007969737053, + 1.0500022917985916, + 0.0, + 1.3642763793468475, + 0.7319749761372805, + 0.0, + 0.7320551406592131 + ], + "unique_experts": 52, + "load_cv": 1.2170712088518787, + "normalized_load_entropy": 0.860950621326763, + "max_load_share": 0.12179487179487179 + } + }, + "s1_eos": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "36c8fddb3e259a246165708bc547046cc51db34c125720f345294a940ec0086c", + "route_weight_sha256": "eebdef620bc284dcc02166299ba7082b54a431821db42ecff32638d07ce1c302", + "loads": [ + 6, + 5, + 1, + 1, + 0, + 0, + 1, + 0, + 23, + 0, + 1, + 2, + 0, + 2, + 5, + 0, + 0, + 1, + 0, + 6, + 0, + 0, + 2, + 0, + 1, + 1, + 3, + 0, + 0, + 4, + 1, + 4, + 9, + 1, + 1, + 0, + 0, + 12, + 1, + 10, + 1, + 0, + 1, + 2, + 2, + 10, + 1, + 2, + 3, + 3, + 0, + 2, + 0, + 0, + 5, + 0, + 4, + 2, + 6, + 0, + 1, + 6, + 0, + 7 + ], + "weighted_loads": [ + 0.24096743948757648, + 0.34985697641968727, + 0.0404917448759079, + 0.07116556167602539, + 0.0, + 0.0, + 0.031318362802267075, + 0.0, + 2.6444690227508545, + 0.0, + 0.07737904042005539, + 0.3356744013726711, + 0.0, + 0.08644992113113403, + 0.5377679578959942, + 0.0, + 0.0, + 0.029612278565764427, + 0.0, + 0.34140170365571976, + 0.0, + 0.0, + 0.10257689282298088, + 0.0, + 0.07587672770023346, + 0.04018880054354668, + 0.16716507822275162, + 0.0, + 0.0, + 0.1878606453537941, + 0.12396933883428574, + 0.4394456073641777, + 0.7347680199891329, + 0.026472017168998718, + 0.047149889171123505, + 0.0, + 0.0, + 1.1672661267220974, + 0.04418173059821129, + 0.7076503746211529, + 0.027272501960396767, + 0.0, + 0.021904250606894493, + 0.0945785753428936, + 0.08173496834933758, + 0.8770121932029724, + 0.034516479820013046, + 0.19846241176128387, + 0.23094743117690086, + 0.14855747669935226, + 0.0, + 0.0688751544803381, + 0.0, + 0.0, + 0.7356212958693504, + 0.0, + 0.20554004609584808, + 0.08519589900970459, + 1.0410853400826454, + 0.0, + 0.04803059995174408, + 0.41782617941498756, + 0.0, + 0.39310339465737343 + ], + "unique_experts": 42, + "load_cv": 1.5091551126681326, + "normalized_load_entropy": 0.7986030557171855, + "max_load_share": 0.1419753086419753 + }, + "full_input": { + "tokens": 68, + "top_k": 6, + "decisions": 408, + "ordered_route_sha256": "d2b06ccbea9607d9f8373437e1b41e0dc65266e42996f9c4cc06254dc191a616", + "route_weight_sha256": "c31739107421e35eda15a8ca2a76a4f1c1bd3a25749e3a6c5362939129c008b6", + "loads": [ + 10, + 11, + 1, + 12, + 0, + 2, + 7, + 1, + 45, + 9, + 1, + 8, + 3, + 2, + 10, + 4, + 3, + 4, + 1, + 6, + 1, + 14, + 3, + 1, + 1, + 2, + 3, + 2, + 1, + 4, + 2, + 4, + 11, + 11, + 9, + 5, + 2, + 15, + 1, + 11, + 11, + 1, + 6, + 4, + 2, + 10, + 2, + 4, + 6, + 6, + 11, + 5, + 5, + 2, + 5, + 22, + 8, + 2, + 8, + 0, + 16, + 16, + 1, + 12 + ], + "weighted_loads": [ + 0.42460938077419996, + 0.8403551280498505, + 0.0404917448759079, + 2.211745733395219, + 0.0, + 0.06720420252531767, + 0.3671901486814022, + 0.043035559356212616, + 4.542650301009417, + 0.4561002850532532, + 0.07737904042005539, + 0.6947763310745358, + 0.13977450504899025, + 0.08644992113113403, + 0.9593196343630552, + 0.23606888577342033, + 0.14766712114214897, + 0.11509936302900314, + 0.039523474872112274, + 0.34140170365571976, + 0.04945092648267746, + 1.2080940268933773, + 0.14486131072044373, + 0.03454037010669708, + 0.07587672770023346, + 0.0657531414180994, + 0.16716507822275162, + 0.0953766405582428, + 0.08442115038633347, + 0.1878606453537941, + 0.1861254796385765, + 0.4394456073641777, + 0.7923443662002683, + 0.38559198565781116, + 0.4060658626258373, + 0.22160007432103157, + 0.09103851020336151, + 1.312898114323616, + 0.04418173059821129, + 0.7488720268011093, + 0.6620127893984318, + 0.02546614408493042, + 0.45159786380827427, + 0.23170403763651848, + 0.08173496834933758, + 0.8770121932029724, + 0.06869569048285484, + 0.26508366502821445, + 0.3638864643871784, + 0.64914895221591, + 0.5482384506613016, + 0.27909143827855587, + 0.5482489429414272, + 0.09029773995280266, + 0.7356212958693504, + 1.778556204866618, + 0.41834136098623276, + 0.08519589900970459, + 1.088701659347862, + 0.0, + 2.2020603977143764, + 0.8450364097952843, + 0.02866595797240734, + 0.6989548318088055 + ], + "unique_experts": 62, + "load_cv": 1.0712775199723714, + "normalized_load_entropy": 0.8966403393131194, + "max_load_share": 0.11029411764705882 + } + }, + "s0_bos": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "fa3949e920f76fff18c3e70567aeb169f16073a0080dc4929ba9cae019bff25c", + "route_weight_sha256": "e5178b077702aee263deed53fae66962b41c0eeb9601bca7601d76c05c608778", + "loads": [ + 7, + 5, + 1, + 1, + 0, + 0, + 1, + 0, + 21, + 0, + 1, + 2, + 0, + 2, + 5, + 0, + 0, + 1, + 0, + 7, + 0, + 0, + 1, + 0, + 2, + 0, + 3, + 0, + 0, + 3, + 1, + 5, + 9, + 1, + 1, + 0, + 0, + 12, + 1, + 11, + 1, + 0, + 1, + 2, + 2, + 11, + 0, + 2, + 3, + 3, + 0, + 1, + 0, + 0, + 5, + 0, + 4, + 2, + 6, + 0, + 1, + 8, + 0, + 6 + ], + "weighted_loads": [ + 0.2722097709774971, + 0.35531140491366386, + 0.04050318896770477, + 0.07511281222105026, + 0.0, + 0.0, + 0.032418686896562576, + 0.0, + 2.4456860795617104, + 0.0, + 0.07319416850805283, + 0.33357176184654236, + 0.0, + 0.08959870785474777, + 0.5380324963480234, + 0.0, + 0.0, + 0.03270100802183151, + 0.0, + 0.38061233423650265, + 0.0, + 0.0, + 0.05674334987998009, + 0.0, + 0.1077814307063818, + 0.0, + 0.17063424363732338, + 0.0, + 0.0, + 0.15065433830022812, + 0.1305907666683197, + 0.4739891327917576, + 0.7715023700147867, + 0.02388661354780197, + 0.04701050743460655, + 0.0, + 0.0, + 1.1655430048704147, + 0.041761305183172226, + 0.751805268228054, + 0.027628673240542412, + 0.0, + 0.019227923825383186, + 0.10359356552362442, + 0.08608474209904671, + 0.9620905909687281, + 0.0, + 0.21390177309513092, + 0.24772269278764725, + 0.15845715999603271, + 0.0, + 0.04037000611424446, + 0.0, + 0.0, + 0.7154706381261349, + 0.0, + 0.19238372147083282, + 0.07893998175859451, + 1.1059629060328007, + 0.0, + 0.059085413813591, + 0.5158855952322483, + 0.0, + 0.37487414106726646 + ], + "unique_experts": 40, + "load_cv": 1.5026775878201726, + "normalized_load_entropy": 0.7894856307957187, + "max_load_share": 0.12962962962962962 + }, + "full_input": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "c2764bf2c9a1c3edf0c14146bb1c63536c7e40e28852d2f933aca31309de7443", + "route_weight_sha256": "257eda50e408d549908883e8076cd3b1a35ea8a242403f3595ce84a33f391a1d", + "loads": [ + 12, + 5, + 3, + 9, + 0, + 1, + 5, + 1, + 34, + 5, + 2, + 5, + 0, + 2, + 8, + 1, + 0, + 2, + 0, + 7, + 0, + 7, + 2, + 0, + 3, + 2, + 3, + 5, + 0, + 4, + 1, + 5, + 11, + 7, + 2, + 4, + 0, + 16, + 1, + 11, + 4, + 1, + 6, + 2, + 2, + 12, + 1, + 2, + 6, + 5, + 4, + 1, + 0, + 1, + 5, + 14, + 7, + 5, + 6, + 0, + 11, + 16, + 0, + 15 + ], + "weighted_loads": [ + 0.48082934971898794, + 0.35531140491366386, + 0.12253210321068764, + 1.0556620359420776, + 0.0, + 0.012603330425918102, + 0.30392560362815857, + 0.9176504611968994, + 3.6384241990745068, + 0.19437496177852154, + 0.09282957017421722, + 0.4308357825502753, + 0.0, + 0.08959870785474777, + 1.0215196963399649, + 0.044142428785562515, + 0.0, + 0.05842940881848335, + 0.0, + 0.38061233423650265, + 0.0, + 0.6345245465636253, + 0.08631468564271927, + 0.0, + 0.11207300750538707, + 0.06762764416635036, + 0.17063424363732338, + 0.2184886857867241, + 0.0, + 0.19533662125468254, + 0.1305907666683197, + 0.4739891327917576, + 0.841883035376668, + 0.24562990479171276, + 0.1049744002521038, + 0.19666137918829918, + 0.0, + 1.3561308607459068, + 0.041761305183172226, + 0.751805268228054, + 0.18813513033092022, + 0.07760802656412125, + 0.24409172171726823, + 0.10359356552362442, + 0.08608474209904671, + 0.9929052107036114, + 0.04303233325481415, + 0.21390177309513092, + 0.44723545387387276, + 0.2889752076007426, + 0.19655791670084, + 0.04037000611424446, + 0.0, + 0.04347246512770653, + 0.7154706381261349, + 1.227420068345964, + 0.3123774304986, + 0.14033702481538057, + 1.1059629060328007, + 0.0, + 1.361547477543354, + 0.7987152766436338, + 0.0, + 0.734607869759202 + ], + "unique_experts": 53, + "load_cv": 1.154985192774893, + "normalized_load_entropy": 0.8683488620658338, + "max_load_share": 0.10897435897435898 + } + }, + "s1_bos": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "e10ab39bc9a0a963a7208e2aba3b7218aee2c5c399f8fbd620d7e3ba40b271e2", + "route_weight_sha256": "44cf978958a20d5641ca13923884d0b244c8bfa90d3b1da061c139e954a0cdb6", + "loads": [ + 6, + 5, + 1, + 1, + 0, + 0, + 1, + 0, + 21, + 0, + 2, + 2, + 0, + 2, + 5, + 0, + 0, + 0, + 0, + 6, + 0, + 0, + 1, + 0, + 1, + 1, + 3, + 0, + 0, + 2, + 1, + 5, + 9, + 1, + 1, + 0, + 0, + 12, + 1, + 11, + 1, + 0, + 1, + 2, + 2, + 11, + 0, + 2, + 4, + 3, + 0, + 2, + 0, + 0, + 5, + 0, + 4, + 2, + 6, + 0, + 1, + 8, + 0, + 7 + ], + "weighted_loads": [ + 0.2346348613500595, + 0.34274371713399887, + 0.041654303669929504, + 0.07496044784784317, + 0.0, + 0.0, + 0.03615832328796387, + 0.0, + 2.4818711429834366, + 0.0, + 0.11204730346798897, + 0.35891570895910263, + 0.0, + 0.09394341334700584, + 0.5381282027810812, + 0.0, + 0.0, + 0.0, + 0.0, + 0.3279368672519922, + 0.0, + 0.0, + 0.05819675326347351, + 0.0, + 0.07365213334560394, + 0.04018089175224304, + 0.16621436551213264, + 0.0, + 0.0, + 0.11277876421809196, + 0.12750782072544098, + 0.47821488603949547, + 0.7552783656865358, + 0.026852959766983986, + 0.05003942921757698, + 0.0, + 0.0, + 1.1226189769804478, + 0.03841875493526459, + 0.7450921423733234, + 0.02582666091620922, + 0.0, + 0.02177511900663376, + 0.10395588725805283, + 0.08943740278482437, + 0.9695341475307941, + 0.0, + 0.20259184390306473, + 0.330259770154953, + 0.14173655584454536, + 0.0, + 0.06989487633109093, + 0.0, + 0.0, + 0.7218357250094414, + 0.0, + 0.20812660083174706, + 0.08639462664723396, + 1.0769132189452648, + 0.0, + 0.05098947137594223, + 0.5029552578926086, + 0.0, + 0.4150825086981058 + ], + "unique_experts": 40, + "load_cv": 1.4961720194488803, + "normalized_load_entropy": 0.7911846888763805, + "max_load_share": 0.12962962962962962 + }, + "full_input": { + "tokens": 68, + "top_k": 6, + "decisions": 408, + "ordered_route_sha256": "d1e937a1d219a422b611b17f393d954865bcaab4b3613d2898bd5a63e863b442", + "route_weight_sha256": "fcbb93cc25c46506365fff04a7756cd437b3f3a13f9313b4049e7742c960433e", + "loads": [ + 10, + 10, + 1, + 11, + 0, + 1, + 6, + 1, + 43, + 9, + 2, + 9, + 3, + 2, + 9, + 5, + 3, + 3, + 1, + 6, + 2, + 12, + 2, + 1, + 1, + 2, + 3, + 2, + 1, + 2, + 2, + 5, + 10, + 10, + 8, + 7, + 2, + 16, + 1, + 12, + 11, + 1, + 6, + 4, + 2, + 11, + 1, + 5, + 9, + 6, + 10, + 5, + 5, + 3, + 5, + 21, + 8, + 2, + 7, + 0, + 17, + 18, + 1, + 14 + ], + "weighted_loads": [ + 0.41862547490745783, + 0.7923469394445419, + 0.041654303669929504, + 1.3206523973494768, + 0.0, + 0.012603330425918102, + 0.3698852173984051, + 0.043035559356212616, + 4.335211679339409, + 0.4561002850532532, + 0.11204730346798897, + 0.7763337818905711, + 0.13977450504899025, + 0.09394341334700584, + 0.9661880284547806, + 0.27728377282619476, + 0.14766712114214897, + 0.08548708446323872, + 0.039523474872112274, + 0.3279368672519922, + 0.08822153136134148, + 1.0932972468435764, + 0.10048117116093636, + 0.031969182193279266, + 0.07365213334560394, + 0.06574523262679577, + 0.16621436551213264, + 0.1149679645895958, + 0.08442115038633347, + 0.11277876421809196, + 0.16673918068408966, + 0.47821488603949547, + 0.8067955579608679, + 0.3572841379791498, + 0.3691219501197338, + 0.3166102133691311, + 0.09103851020336151, + 1.2901286445558071, + 0.03841875493526459, + 0.7863137945532799, + 0.6598447300493717, + 0.02546614408493042, + 0.3715185560286045, + 0.2410813495516777, + 0.08943740278482437, + 0.9695341475307941, + 0.0341792106628418, + 0.2991154361516237, + 0.6295271068811417, + 0.6694673337042332, + 0.48305649496614933, + 0.2801111601293087, + 0.5482489429414272, + 0.13071956485509872, + 0.7218357250094414, + 1.797142799012363, + 0.42092791572213173, + 0.08639462664723396, + 1.1194793619215488, + 0.0, + 2.290740493685007, + 0.9301654882729053, + 0.02866595797240734, + 0.8251516278833151 + ], + "unique_experts": 62, + "load_cv": 1.049523426750795, + "normalized_load_entropy": 0.8977714887441257, + "max_load_share": 0.1053921568627451 + } + }, + "s0_x": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "5a85fc1dc88adc9914b442e394f6026f59954a00c82987c674eb44964e57d164", + "route_weight_sha256": "4de575690993ffc201e504086682627e028e2ba2e30ed8dbdef2e52ad4c5642f", + "loads": [ + 6, + 5, + 1, + 1, + 0, + 0, + 1, + 0, + 20, + 0, + 1, + 2, + 0, + 2, + 5, + 0, + 0, + 1, + 0, + 7, + 0, + 0, + 1, + 0, + 1, + 1, + 3, + 0, + 0, + 2, + 1, + 5, + 9, + 1, + 1, + 0, + 0, + 12, + 2, + 11, + 1, + 0, + 1, + 2, + 2, + 10, + 1, + 2, + 6, + 3, + 0, + 1, + 0, + 0, + 5, + 0, + 4, + 1, + 6, + 0, + 1, + 9, + 0, + 5 + ], + "weighted_loads": [ + 0.24080475233495235, + 0.3592688664793968, + 0.040187153965234756, + 0.06015612930059433, + 0.0, + 0.0, + 0.031742509454488754, + 0.0, + 2.351193118840456, + 0.0, + 0.07462494820356369, + 0.33327271416783333, + 0.0, + 0.08880138397216797, + 0.5260044559836388, + 0.0, + 0.0, + 0.030469387769699097, + 0.0, + 0.366268590092659, + 0.0, + 0.0, + 0.06160043552517891, + 0.0, + 0.07450193166732788, + 0.04441174119710922, + 0.18506768345832825, + 0.0, + 0.0, + 0.11528083309531212, + 0.12738554179668427, + 0.47478044033050537, + 0.7739748992025852, + 0.026719890534877777, + 0.045709770172834396, + 0.0, + 0.0, + 1.1494156941771507, + 0.08153685182332993, + 0.808029018342495, + 0.024468563497066498, + 0.0, + 0.02075955457985401, + 0.11367880180478096, + 0.0813920870423317, + 0.955004159361124, + 0.03856050595641136, + 0.20785493403673172, + 0.3726096972823143, + 0.14375300705432892, + 0.0, + 0.03917890787124634, + 0.0, + 0.0, + 0.711764371022582, + 0.0, + 0.1974148079752922, + 0.04398064315319061, + 1.0663226284086704, + 0.0, + 0.050962358713150024, + 0.5909616500139236, + 0.0, + 0.33075710386037827 + ], + "unique_experts": 42, + "load_cv": 1.4632103765368745, + "normalized_load_entropy": 0.7978674104291846, + "max_load_share": 0.12345679012345678 + }, + "full_input": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "3cc57a726f0de08c8a1342e0abfa0f919e8577f81c79c1de71e15e345bcd5d8b", + "route_weight_sha256": "14d8ba242f2acb08f822cf233d2789c9085394e01b75373343042e8983c9159c", + "loads": [ + 11, + 6, + 3, + 10, + 0, + 1, + 6, + 0, + 34, + 6, + 1, + 4, + 0, + 2, + 9, + 0, + 0, + 3, + 0, + 7, + 0, + 9, + 2, + 0, + 1, + 3, + 3, + 3, + 0, + 2, + 2, + 5, + 11, + 9, + 2, + 2, + 0, + 14, + 2, + 11, + 5, + 1, + 6, + 2, + 2, + 11, + 2, + 2, + 7, + 5, + 5, + 1, + 0, + 1, + 5, + 16, + 7, + 3, + 6, + 0, + 10, + 18, + 0, + 13 + ], + "weighted_loads": [ + 0.45726306829601526, + 0.4031626619398594, + 0.12221606820821762, + 1.1246934980154037, + 0.0, + 0.012603330425918102, + 0.39621078222990036, + 0.0, + 3.603029675781727, + 0.22536364197731018, + 0.07462494820356369, + 0.375744522549212, + 0.0, + 0.08880138397216797, + 1.0316840894520283, + 0.0, + 0.0, + 0.08948745205998421, + 0.0, + 0.366268590092659, + 0.0, + 0.7332278788089752, + 0.09117177128791809, + 0.0, + 0.07450193166732788, + 0.13050643540918827, + 0.18506768345832825, + 0.12984026223421097, + 0.0, + 0.11528083309531212, + 0.17241814360022545, + 0.47478044033050537, + 0.8443555645644665, + 0.3362197671085596, + 0.10367366299033165, + 0.0895383358001709, + 0.0, + 1.2254456393420696, + 0.08153685182332993, + 0.808029018342495, + 0.2195383422076702, + 0.07782252877950668, + 0.3504514042288065, + 0.11367880180478096, + 0.0813920870423317, + 0.9858187790960073, + 0.08159283921122551, + 0.20785493403673172, + 0.4247441664338112, + 0.39707861840724945, + 0.24445964395999908, + 0.03917890787124634, + 0.0, + 0.04347246512770653, + 0.711764371022582, + 1.3952518058940768, + 0.3174085170030594, + 0.09887927584350109, + 1.0663226284086704, + 0.0, + 1.3804807849228382, + 0.9295587744563818, + 0.0, + 0.6253482233732939 + ], + "unique_experts": 51, + "load_cv": 1.1691295502746664, + "normalized_load_entropy": 0.8623301476950682, + "max_load_share": 0.10897435897435898 + } + }, + "s1_x": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "4b481fd224f62f674f3ba4a749802200fa6125b2c5dd979b432a2a2e68b41bad", + "route_weight_sha256": "038c4695568ee85ccb3b27ce4744e8fdac08d550aed372462373d34a572b7721", + "loads": [ + 5, + 5, + 1, + 2, + 0, + 0, + 1, + 0, + 20, + 0, + 1, + 2, + 0, + 1, + 5, + 0, + 1, + 0, + 0, + 5, + 0, + 0, + 1, + 0, + 1, + 1, + 3, + 1, + 0, + 2, + 1, + 5, + 9, + 1, + 1, + 0, + 0, + 12, + 2, + 12, + 1, + 0, + 1, + 1, + 1, + 9, + 1, + 3, + 7, + 2, + 0, + 2, + 0, + 0, + 5, + 0, + 4, + 2, + 6, + 0, + 1, + 10, + 0, + 5 + ], + "weighted_loads": [ + 0.21429297141730785, + 0.38226939365267754, + 0.04001666232943535, + 0.06823633424937725, + 0.0, + 0.0, + 0.05393163114786148, + 0.0, + 2.2623025216162205, + 0.0, + 0.08790207654237747, + 0.3349826540797949, + 0.0, + 0.04170628637075424, + 0.5117500778287649, + 0.0, + 0.02711877040565014, + 0.0, + 0.0, + 0.2824903503060341, + 0.0, + 0.0, + 0.06302514672279358, + 0.0, + 0.07096592336893082, + 0.0578732006251812, + 0.16499731689691544, + 0.07252394407987595, + 0.0, + 0.10453266277909279, + 0.1275794953107834, + 0.4772373177111149, + 0.789135878905654, + 0.027290908619761467, + 0.04800824820995331, + 0.0, + 0.0, + 1.0307426750659943, + 0.07715259119868279, + 0.7567509040236473, + 0.030653933063149452, + 0.0, + 0.022914057597517967, + 0.1034616157412529, + 0.02849150449037552, + 0.8886559829115868, + 0.041240472346544266, + 0.21459812857210636, + 0.5024807453155518, + 0.088144950568676, + 0.0, + 0.07806790433824062, + 0.0, + 0.0, + 0.7100781854242086, + 0.0, + 0.20177352614700794, + 0.08840074390172958, + 1.0225688889622688, + 0.0, + 0.038618940860033035, + 0.7683316133916378, + 0.0, + 0.3223622627556324 + ], + "unique_experts": 43, + "load_cv": 1.4648760736983897, + "normalized_load_entropy": 0.8007835285939343, + "max_load_share": 0.12345679012345678 + }, + "full_input": { + "tokens": 68, + "top_k": 6, + "decisions": 408, + "ordered_route_sha256": "d58250d5e5a3ae4cada4681e1b41ad089ecaafa50e67191e4d0cc7d5b71006e8", + "route_weight_sha256": "12e0d13adfeedd3e2845ab2f499d8fe9b5028ddab219054f9234add08b1fbe7b", + "loads": [ + 10, + 10, + 1, + 13, + 0, + 1, + 7, + 1, + 42, + 10, + 1, + 6, + 3, + 1, + 9, + 4, + 4, + 3, + 1, + 5, + 2, + 14, + 2, + 1, + 1, + 2, + 3, + 2, + 1, + 2, + 1, + 5, + 10, + 10, + 8, + 5, + 2, + 15, + 2, + 13, + 13, + 1, + 6, + 3, + 1, + 9, + 2, + 5, + 10, + 5, + 11, + 5, + 5, + 3, + 5, + 24, + 8, + 3, + 7, + 0, + 16, + 22, + 1, + 10 + ], + "weighted_loads": [ + 0.4398857271298766, + 0.8318726159632206, + 0.04001666232943535, + 1.3632113747298717, + 0.0, + 0.012603330425918102, + 0.42711618542671204, + 0.043035559356212616, + 4.136667318642139, + 0.5003670305013657, + 0.08790207654237747, + 0.6169138075783849, + 0.13977450504899025, + 0.04170628637075424, + 0.9176308363676071, + 0.23606888577342033, + 0.1747858915477991, + 0.08548708446323872, + 0.039523474872112274, + 0.2824903503060341, + 0.0801499541848898, + 1.2076715603470802, + 0.10530956462025642, + 0.02853570505976677, + 0.07096592336893082, + 0.08343754149973392, + 0.16499731689691544, + 0.1206330806016922, + 0.08442115038633347, + 0.10453266277909279, + 0.1275794953107834, + 0.4772373177111149, + 0.840653071179986, + 0.3577220868319273, + 0.36709076911211014, + 0.23835491761565208, + 0.09103851020336151, + 1.1757991462945938, + 0.07715259119868279, + 0.7979725562036037, + 0.7293056230992079, + 0.02546614408493042, + 0.4375659767538309, + 0.24058707803487778, + 0.02849150449037552, + 0.8886559829115868, + 0.07541968300938606, + 0.28121938183903694, + 0.6354197785258293, + 0.6340622156858444, + 0.5288543310016394, + 0.2882841881364584, + 0.5482489429414272, + 0.12874608486890793, + 0.7100781854242086, + 2.058041482232511, + 0.4145748410373926, + 0.1208629235625267, + 1.0651350319385529, + 0.0, + 2.21317145973444, + 1.3538671173155308, + 0.02866595797240734, + 0.5791591927409172 + ], + "unique_experts": 62, + "load_cv": 1.0773613229659729, + "normalized_load_entropy": 0.892208252896599, + "max_load_share": 0.10294117647058823 + } + }, + "s0_period": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "97f194bfb6e345eebf70c6436475b48eb1d1cf6bd285409b24b6c619de0f3d45", + "route_weight_sha256": "97bc3923ff3a49496a1e2c9fe8ea754d6be26319d9af094cc5444d9fcc5dfd2f", + "loads": [ + 6, + 5, + 1, + 1, + 0, + 0, + 1, + 0, + 20, + 0, + 1, + 2, + 0, + 2, + 5, + 0, + 0, + 1, + 0, + 6, + 0, + 0, + 1, + 0, + 1, + 1, + 3, + 0, + 0, + 2, + 1, + 5, + 8, + 1, + 1, + 0, + 0, + 12, + 2, + 12, + 0, + 0, + 1, + 2, + 2, + 10, + 1, + 2, + 6, + 3, + 0, + 2, + 0, + 0, + 5, + 0, + 4, + 1, + 6, + 0, + 1, + 9, + 0, + 6 + ], + "weighted_loads": [ + 0.23629380203783512, + 0.34954990446567535, + 0.037455976009368896, + 0.05925128608942032, + 0.0, + 0.0, + 0.033123962581157684, + 0.0, + 2.318720515817404, + 0.0, + 0.07388224452733994, + 0.3269123509526253, + 0.0, + 0.0911233201622963, + 0.5199301782995462, + 0.0, + 0.0, + 0.03150752931833267, + 0.0, + 0.34057202003896236, + 0.0, + 0.0, + 0.059853821992874146, + 0.0, + 0.07712201774120331, + 0.05584714561700821, + 0.177042905241251, + 0.0, + 0.0, + 0.11764947697520256, + 0.129158154129982, + 0.4878527633845806, + 0.7526309825479984, + 0.024353981018066406, + 0.04495672881603241, + 0.0, + 0.0, + 1.156339768320322, + 0.08154822885990143, + 0.8305618967860937, + 0.0, + 0.0, + 0.022113561630249023, + 0.11447164043784142, + 0.08429870195686817, + 0.9432005733251572, + 0.03545283526182175, + 0.20876160636544228, + 0.37389291264116764, + 0.13797970861196518, + 0.0, + 0.06561353802680969, + 0.0, + 0.0, + 0.6991610303521156, + 0.0, + 0.20273089036345482, + 0.03867379575967789, + 1.0578390210866928, + 0.0, + 0.05893265828490257, + 0.5898953415453434, + 0.0, + 0.3665037713944912 + ], + "unique_experts": 41, + "load_cv": 1.4682017987564469, + "normalized_load_entropy": 0.795609280521287, + "max_load_share": 0.12345679012345678 + }, + "full_input": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "2ec5df527c22167918383b7cc51952027aeb9c694ce68b90d3c7f6c274a0e37d", + "route_weight_sha256": "6d8a23635edfdfb0c4d7758be80fcc851cccce6d92711727d82816d6dbde26c7", + "loads": [ + 11, + 6, + 3, + 9, + 0, + 1, + 5, + 0, + 34, + 5, + 1, + 4, + 0, + 2, + 10, + 0, + 0, + 3, + 0, + 6, + 0, + 9, + 2, + 0, + 1, + 2, + 3, + 3, + 0, + 3, + 1, + 5, + 10, + 7, + 2, + 3, + 0, + 15, + 2, + 13, + 5, + 1, + 6, + 2, + 2, + 11, + 2, + 2, + 8, + 5, + 6, + 2, + 0, + 1, + 5, + 15, + 7, + 3, + 6, + 0, + 11, + 17, + 0, + 14 + ], + "weighted_loads": [ + 0.4547033840790391, + 0.45387378334999084, + 0.11948489025235176, + 1.0398005098104477, + 0.0, + 0.012603330425918102, + 0.33871004357934, + 0.0, + 3.565141536295414, + 0.19437496177852154, + 0.07388224452733994, + 0.3702904852107167, + 0.0, + 0.0911233201622963, + 1.0297174397855997, + 0.0, + 0.0, + 0.10673075541853905, + 0.0, + 0.34057202003896236, + 0.0, + 0.7401058785617352, + 0.08942515775561333, + 0.0, + 0.07712201774120331, + 0.08211510442197323, + 0.177042905241251, + 0.12657030671834946, + 0.0, + 0.17908543348312378, + 0.129158154129982, + 0.4878527633845806, + 0.8230116479098797, + 0.2460972722619772, + 0.10292062163352966, + 0.14965444430708885, + 0.0, + 1.3034174963831902, + 0.08154822885990143, + 0.8640348706394434, + 0.25282713398337364, + 0.09609140455722809, + 0.30225812271237373, + 0.11447164043784142, + 0.08429870195686817, + 0.9740151930600405, + 0.0784851685166359, + 0.20876160636544228, + 0.4711617473512888, + 0.3123909682035446, + 0.3226049281656742, + 0.06561353802680969, + 0.0, + 0.04347246512770653, + 0.6991610303521156, + 1.2971454551443458, + 0.322724599391222, + 0.09428436122834682, + 1.0578390210866928, + 0.0, + 1.4398663714528084, + 0.8727250229567289, + 0.0, + 0.6800485532730818 + ], + "unique_experts": 51, + "load_cv": 1.1696917669699531, + "normalized_load_entropy": 0.8624557316439169, + "max_load_share": 0.10897435897435898 + } + }, + "s1_period": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "f847ef32577a91ca03a4926d9008d15ff17f7a71cb1894324de7ecceebdb9b5a", + "route_weight_sha256": "6c62012389538fc186956ab5090c07b78206e7578531d4c8b7213e2efd043d1c", + "loads": [ + 4, + 5, + 1, + 0, + 0, + 0, + 1, + 0, + 20, + 0, + 2, + 2, + 0, + 1, + 5, + 0, + 1, + 1, + 0, + 5, + 1, + 0, + 1, + 0, + 1, + 1, + 3, + 1, + 0, + 2, + 1, + 5, + 9, + 1, + 1, + 0, + 0, + 12, + 2, + 12, + 1, + 0, + 1, + 2, + 1, + 9, + 1, + 2, + 6, + 2, + 0, + 2, + 0, + 0, + 4, + 0, + 5, + 1, + 6, + 0, + 1, + 11, + 0, + 6 + ], + "weighted_loads": [ + 0.18168405070900917, + 0.39182135835289955, + 0.041072312742471695, + 0.0, + 0.0, + 0.0, + 0.049246568232774734, + 0.0, + 2.0822953954339027, + 0.0, + 0.11507777124643326, + 0.29556817188858986, + 0.0, + 0.041806358844041824, + 0.507472962141037, + 0.0, + 0.028605856001377106, + 0.02972123771905899, + 0.0, + 0.2960217073559761, + 0.027389200404286385, + 0.0, + 0.05988658219575882, + 0.0, + 0.07332590967416763, + 0.06807016581296921, + 0.15944046899676323, + 0.07559897005558014, + 0.0, + 0.10954350605607033, + 0.12709186971187592, + 0.46967728808522224, + 0.7880098726600409, + 0.025793572887778282, + 0.046153757721185684, + 0.0, + 0.0, + 1.0336039885878563, + 0.07639873772859573, + 0.7875121682882309, + 0.02854139544069767, + 0.0, + 0.022502925246953964, + 0.1330332849174738, + 0.02953709475696087, + 0.9135937467217445, + 0.040069833397865295, + 0.19650401175022125, + 0.5111644752323627, + 0.08404447510838509, + 0.0, + 0.08459165692329407, + 0.0, + 0.0, + 0.6824926808476448, + 0.0, + 0.2549184113740921, + 0.04567641019821167, + 1.0292615629732609, + 0.0, + 0.03762901946902275, + 0.791422912850976, + 0.0, + 0.3706865459680557 + ], + "unique_experts": 44, + "load_cv": 1.4698618394803282, + "normalized_load_entropy": 0.8026061994176481, + "max_load_share": 0.12345679012345678 + }, + "full_input": { + "tokens": 68, + "top_k": 6, + "decisions": 408, + "ordered_route_sha256": "480005c11ea9fa535f599ffd205030ffa81bb85687d9610610c420aba195965c", + "route_weight_sha256": "97508a13794348c4311cef6a582af591a873382d1389c24823a302630de5870e", + "loads": [ + 9, + 11, + 1, + 10, + 0, + 1, + 6, + 1, + 41, + 9, + 2, + 7, + 3, + 1, + 9, + 4, + 4, + 5, + 1, + 5, + 2, + 15, + 2, + 1, + 1, + 2, + 3, + 2, + 1, + 2, + 2, + 5, + 10, + 11, + 8, + 5, + 2, + 13, + 2, + 15, + 13, + 1, + 6, + 4, + 1, + 9, + 2, + 4, + 9, + 4, + 11, + 5, + 5, + 3, + 4, + 24, + 9, + 2, + 7, + 0, + 17, + 22, + 1, + 11 + ], + "weighted_loads": [ + 0.392171579413116, + 0.8942758701741695, + 0.041072312742471695, + 1.2456919495016336, + 0.0, + 0.012603330425918102, + 0.4003041610121727, + 0.043035559356212616, + 3.8838670440018177, + 0.4561002850532532, + 0.11507777124643326, + 0.6139992540702224, + 0.13977450504899025, + 0.041806358844041824, + 0.9718737583607435, + 0.23606888577342033, + 0.17627297714352608, + 0.1465736199170351, + 0.039523474872112274, + 0.2960217073559761, + 0.07684012688696384, + 1.2428014501929283, + 0.10217100009322166, + 0.027728457003831863, + 0.07332590967416763, + 0.09363450668752193, + 0.15944046899676323, + 0.1277368925511837, + 0.08442115038633347, + 0.10954350605607033, + 0.1699642650783062, + 0.46967728808522224, + 0.8395270649343729, + 0.39309255965054035, + 0.3652362786233425, + 0.21502559632062912, + 0.09103851020336151, + 1.0938025675714016, + 0.07639873772859573, + 0.9287458509206772, + 0.7383588440716267, + 0.02546614408493042, + 0.3908127136528492, + 0.27015874721109867, + 0.02953709475696087, + 0.9135937467217445, + 0.07424904406070709, + 0.26312526501715183, + 0.6441035084426403, + 0.5476241745054722, + 0.587110860273242, + 0.29480794072151184, + 0.5482489429414272, + 0.15112441033124924, + 0.6824926808476448, + 2.0240524848923087, + 0.4677197262644768, + 0.07425898127257824, + 1.071827705949545, + 0.0, + 2.2960946820676327, + 1.2603843193501234, + 0.02866595797240734, + 0.6264076605439186 + ], + "unique_experts": 62, + "load_cv": 1.0647979594027814, + "normalized_load_entropy": 0.894429642728871, + "max_load_share": 0.10049019607843138 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 27, + "ordered_topk_exact_tokens": 20, + "set_exact_tokens": 23, + "mean_set_jaccard": 0.9576719576719578, + "mean_token_weighted_tv": 0.015375131154777828, + "aggregate_load_tv": 0.024691358024691357 + }, + "system_bos": { + "tokens": 27, + "ordered_topk_exact_tokens": 19, + "set_exact_tokens": 22, + "mean_set_jaccard": 0.9470899470899471, + "mean_token_weighted_tv": 0.0191722447052598, + "aggregate_load_tv": 0.030864197530864196 + }, + "system_x": { + "tokens": 27, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.8800705467372135, + "mean_token_weighted_tv": 0.039040663934968134, + "aggregate_load_tv": 0.05555555555555555 + }, + "system_period": { + "tokens": 27, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.8539682539682539, + "mean_token_weighted_tv": 0.046922939415607184, + "aggregate_load_tv": 0.05555555555555555 + }, + "bos_at_s0": { + "tokens": 27, + "ordered_topk_exact_tokens": 18, + "set_exact_tokens": 20, + "mean_set_jaccard": 0.9259259259259259, + "mean_token_weighted_tv": 0.024160368954417883, + "aggregate_load_tv": 0.043209876543209874 + }, + "bos_at_s1": { + "tokens": 27, + "ordered_topk_exact_tokens": 18, + "set_exact_tokens": 20, + "mean_set_jaccard": 0.925925925925926, + "mean_token_weighted_tv": 0.024476277986886324, + "aggregate_load_tv": 0.043209876543209874 + }, + "x_at_s0": { + "tokens": 27, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.8862433862433862, + "mean_token_weighted_tv": 0.032511807391764944, + "aggregate_load_tv": 0.05555555555555555 + }, + "x_at_s1": { + "tokens": 27, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 12, + "mean_set_jaccard": 0.8192239858906525, + "mean_token_weighted_tv": 0.05489167391701981, + "aggregate_load_tv": 0.09876543209876543 + }, + "period_at_s0": { + "tokens": 27, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.8835978835978836, + "mean_token_weighted_tv": 0.03365885949245206, + "aggregate_load_tv": 0.04938271604938271 + }, + "period_at_s1": { + "tokens": 27, + "ordered_topk_exact_tokens": 7, + "set_exact_tokens": 11, + "mean_set_jaccard": 0.7957671957671958, + "mean_token_weighted_tv": 0.06529290263575536, + "aggregate_load_tv": 0.10493827160493827 + } + } + }, + "layer_23": { + "layer": 23, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "b1b404d1a93c195ad0bd5f7844b9f685e7e5340ca6ebc2919edc99129ba4b761", + "route_weight_sha256": "29c5be9e6ab6395aa0d80ba29f92dd5113c833640531666d520f9c2476200ca0", + "loads": [ + 7, + 4, + 0, + 0, + 0, + 4, + 1, + 3, + 0, + 1, + 3, + 15, + 1, + 7, + 3, + 0, + 0, + 0, + 0, + 0, + 4, + 1, + 2, + 2, + 7, + 1, + 1, + 0, + 4, + 1, + 1, + 0, + 3, + 0, + 1, + 0, + 10, + 2, + 2, + 0, + 2, + 1, + 20, + 1, + 2, + 2, + 5, + 1, + 3, + 0, + 1, + 3, + 7, + 5, + 0, + 2, + 1, + 5, + 2, + 3, + 2, + 0, + 2, + 1 + ], + "weighted_loads": [ + 0.29923238046467304, + 0.23633289337158203, + 0.0, + 0.0, + 0.0, + 0.2745874226093292, + 0.03178916499018669, + 0.1944122314453125, + 0.0, + 0.03887071833014488, + 0.218807490542531, + 1.2898398637771606, + 0.1776854544878006, + 0.5511129833757877, + 0.09390364959836006, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.4719521813094616, + 0.06639907509088516, + 0.28293178230524063, + 0.07298953086137772, + 0.3914027139544487, + 0.044520843774080276, + 0.039177682250738144, + 0.0, + 0.22875028103590012, + 0.03437219187617302, + 0.09693390876054764, + 0.0, + 0.14362836629152298, + 0.0, + 0.04034459590911865, + 0.0, + 0.9309423565864563, + 0.07811511680483818, + 0.1423025280237198, + 0.0, + 0.07478244975209236, + 0.0281416904181242, + 1.843963112682104, + 0.08073945343494415, + 0.09696704894304276, + 0.17536469548940659, + 0.2969612739980221, + 0.03194155916571617, + 0.13753250613808632, + 0.0, + 0.10561425983905792, + 0.133407324552536, + 0.5177839063107967, + 0.22238779067993164, + 0.0, + 0.08954252302646637, + 0.028952160850167274, + 0.22536560148000717, + 0.07957173511385918, + 0.15288813039660454, + 0.07890768721699715, + 0.0, + 0.07475772872567177, + 0.08621616661548615 + ], + "unique_experts": 47, + "load_cv": 1.3720376910629322, + "normalized_load_entropy": 0.8334109330560628, + "max_load_share": 0.12345679012345678 + }, + "full_input": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "11269820ad9e9c2504c202ada88f03476a21d4ce7d0fd883ec3597a8e7caa3d1", + "route_weight_sha256": "3e48b5cda5ad6c5acb0b73eed3d62d36284bfbceae7a4aa3376fc619f0c46eea", + "loads": [ + 12, + 7, + 0, + 9, + 5, + 6, + 5, + 8, + 2, + 8, + 3, + 17, + 3, + 11, + 5, + 0, + 6, + 0, + 0, + 0, + 4, + 2, + 4, + 13, + 10, + 1, + 1, + 0, + 4, + 1, + 1, + 0, + 6, + 4, + 1, + 1, + 11, + 2, + 6, + 1, + 9, + 1, + 22, + 1, + 2, + 8, + 17, + 5, + 4, + 0, + 2, + 4, + 7, + 5, + 10, + 4, + 1, + 15, + 3, + 3, + 3, + 0, + 5, + 1 + ], + "weighted_loads": [ + 0.4957343805581331, + 0.40432027354836464, + 0.0, + 0.2570168243255466, + 0.19740166142582893, + 0.3302321834489703, + 0.2374072838574648, + 0.47741439566016197, + 0.04924625006970018, + 0.29392855800688267, + 0.218807490542531, + 1.406235784292221, + 0.2285368861630559, + 0.7348880730569363, + 0.20601773634552956, + 0.0, + 0.21233952976763248, + 0.0, + 0.0, + 0.0, + 0.4719521813094616, + 0.10010775923728943, + 0.3488203063607216, + 1.5349930487573147, + 0.494172889739275, + 0.044520843774080276, + 0.039177682250738144, + 0.0, + 0.22875028103590012, + 0.03437219187617302, + 0.09693390876054764, + 0.0, + 0.27862847223877907, + 0.38731359248049557, + 0.04034459590911865, + 0.0311727412045002, + 0.9768620729446411, + 0.07811511680483818, + 0.31986202392727137, + 0.02447338216006756, + 0.4179513417184353, + 0.0281416904181242, + 1.8955554533749819, + 0.08073945343494415, + 0.09696704894304276, + 2.1755498871207237, + 1.2950415275990963, + 0.1291287282947451, + 0.17595156654715538, + 0.0, + 0.1473856344819069, + 0.22284456342458725, + 0.5177839063107967, + 0.22238779067993164, + 0.9172507598996162, + 0.18701710179448128, + 0.028952160850167274, + 1.165243275463581, + 0.13702237606048584, + 0.15288813039660454, + 0.11509368941187859, + 0.0, + 0.1699105091392994, + 0.08621616661548615 + ], + "unique_experts": 55, + "load_cv": 0.9780631345005463, + "normalized_load_entropy": 0.8898806506285214, + "max_load_share": 0.07051282051282051 + } + }, + "s1_eos": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "d5dc2d61c730a0f9d80decdb1d5fd67af86685281b68a22226122c7dd97a9288", + "route_weight_sha256": "3632c584ca4b6d6f6aabf205e796ac687e864f9d4d6fe04b4c83a86141a90216", + "loads": [ + 6, + 4, + 0, + 0, + 0, + 4, + 1, + 3, + 0, + 1, + 2, + 14, + 1, + 7, + 3, + 0, + 0, + 0, + 0, + 0, + 4, + 1, + 2, + 2, + 7, + 0, + 1, + 0, + 4, + 1, + 2, + 0, + 3, + 0, + 1, + 0, + 9, + 1, + 2, + 0, + 3, + 1, + 21, + 1, + 4, + 2, + 5, + 1, + 3, + 0, + 1, + 2, + 8, + 4, + 0, + 2, + 2, + 5, + 2, + 3, + 2, + 1, + 2, + 1 + ], + "weighted_loads": [ + 0.30248989537358284, + 0.24854589253664017, + 0.0, + 0.0, + 0.0, + 0.2713015638291836, + 0.034463513642549515, + 0.1881900355219841, + 0.0, + 0.04101720452308655, + 0.18746574223041534, + 1.2289961762726307, + 0.24358965456485748, + 0.5667474530637264, + 0.0907119307667017, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.46813494712114334, + 0.06516734510660172, + 0.2694631852209568, + 0.07711100205779076, + 0.3779820539057255, + 0.0, + 0.044107310473918915, + 0.0, + 0.233963031321764, + 0.034386273473501205, + 0.13255320861935616, + 0.0, + 0.14196449890732765, + 0.0, + 0.04277367144823074, + 0.0, + 0.8848980665206909, + 0.04984070360660553, + 0.14866921305656433, + 0.0, + 0.11399773508310318, + 0.028468022122979164, + 1.8268515970557928, + 0.07577153295278549, + 0.1664286106824875, + 0.16490115970373154, + 0.2959878519177437, + 0.03289306163787842, + 0.14112906903028488, + 0.0, + 0.06176724284887314, + 0.09139218181371689, + 0.5775108672678471, + 0.1785343550145626, + 0.0, + 0.09222960099577904, + 0.06218770705163479, + 0.21786039136350155, + 0.08013550937175751, + 0.14957238361239433, + 0.07785970717668533, + 0.042503342032432556, + 0.07366780936717987, + 0.08602257817983627 + ], + "unique_experts": 47, + "load_cv": 1.3684782844896173, + "normalized_load_entropy": 0.8358265337368108, + "max_load_share": 0.12962962962962962 + }, + "full_input": { + "tokens": 68, + "top_k": 6, + "decisions": 408, + "ordered_route_sha256": "5506786cfdc836cc173822dad28ac52cb647358a36d0a554e99db72ab7c51fe8", + "route_weight_sha256": "54e5345003de38e5356070e9749487888a12c0b245e0f2216e5f64140439f9c6", + "loads": [ + 12, + 9, + 7, + 8, + 2, + 5, + 11, + 11, + 3, + 5, + 4, + 16, + 4, + 12, + 4, + 3, + 6, + 1, + 2, + 0, + 5, + 1, + 4, + 18, + 9, + 0, + 1, + 0, + 4, + 2, + 2, + 0, + 5, + 12, + 1, + 0, + 15, + 2, + 9, + 0, + 12, + 1, + 24, + 1, + 6, + 10, + 22, + 5, + 9, + 3, + 1, + 13, + 14, + 6, + 10, + 3, + 2, + 24, + 5, + 4, + 5, + 2, + 8, + 3 + ], + "weighted_loads": [ + 0.6154792185407132, + 0.5703392848372459, + 0.3590974621474743, + 0.46964379237033427, + 0.07879393734037876, + 0.27647781278938055, + 0.5667759794741869, + 0.5142783839255571, + 0.0715396529994905, + 0.1958785392343998, + 0.28114986792206764, + 1.3268872797489166, + 0.3294460950419307, + 0.7775454986840487, + 0.18788584508001804, + 0.12065540812909603, + 0.18435319513082504, + 0.05859649181365967, + 0.0909026600420475, + 0.0, + 0.5159700736403465, + 0.06516734510660172, + 0.33642626740038395, + 2.1320853121578693, + 0.458512619137764, + 0.0, + 0.044107310473918915, + 0.0, + 0.233963031321764, + 0.08058612048625946, + 0.13255320861935616, + 0.0, + 0.22086310759186745, + 0.8954024006379768, + 0.04277367144823074, + 0.0, + 1.3167770504951477, + 0.09722848981618881, + 0.555272189900279, + 0.0, + 0.5183822959661484, + 0.028468022122979164, + 1.923759151250124, + 0.07577153295278549, + 0.26937107369303703, + 2.255475202575326, + 2.003119792789221, + 0.2606596043333411, + 0.4020642451941967, + 0.15101834759116173, + 0.06176724284887314, + 0.7395842298865318, + 1.2205210961401463, + 0.24729712679982185, + 0.9709307104349136, + 0.12346707656979561, + 0.06218770705163479, + 1.8398529421538115, + 0.23577138781547546, + 0.18667565658688545, + 0.18997495993971825, + 0.16845472157001495, + 0.31242793798446655, + 0.16384442523121834 + ], + "unique_experts": 58, + "load_cv": 0.9161291283312679, + "normalized_load_entropy": 0.9032389141264047, + "max_load_share": 0.058823529411764705 + } + }, + "s0_bos": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "abc5063cf891094d09e802978018997a38e126688fb679156ea521a75b87d7e4", + "route_weight_sha256": "3fc0c82dac27cec7bee00b9f6111a9e65dcd5f23f1e5b59140f44a8dfccdc864", + "loads": [ + 7, + 3, + 0, + 0, + 0, + 3, + 1, + 3, + 0, + 1, + 4, + 15, + 1, + 7, + 3, + 0, + 0, + 0, + 0, + 0, + 4, + 1, + 2, + 2, + 7, + 1, + 0, + 0, + 4, + 0, + 1, + 0, + 3, + 1, + 1, + 0, + 11, + 1, + 2, + 0, + 2, + 1, + 21, + 1, + 3, + 2, + 6, + 0, + 3, + 0, + 1, + 2, + 8, + 4, + 0, + 2, + 1, + 5, + 2, + 3, + 2, + 0, + 3, + 1 + ], + "weighted_loads": [ + 0.42100806534290314, + 0.18696994706988335, + 0.0, + 0.0, + 0.0, + 0.23485248535871506, + 0.03137601912021637, + 0.1973312348127365, + 0.0, + 0.0400577150285244, + 0.27642390318214893, + 1.316723920404911, + 0.14546816051006317, + 0.5814784616231918, + 0.10235459730029106, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.47915369272232056, + 0.06650986522436142, + 0.3101910315454006, + 0.07524727657437325, + 0.387341745197773, + 0.04703744128346443, + 0.0, + 0.0, + 0.24467644095420837, + 0.0, + 0.09866355359554291, + 0.0, + 0.14049164578318596, + 0.03840545564889908, + 0.046183113008737564, + 0.0, + 0.9881484992802143, + 0.0547744482755661, + 0.14493010193109512, + 0.0, + 0.06976426392793655, + 0.02930353954434395, + 1.8889774456620216, + 0.07997690141201019, + 0.1403200700879097, + 0.1708095781505108, + 0.33576514199376106, + 0.0, + 0.13135764375329018, + 0.0, + 0.06505516171455383, + 0.1028708852827549, + 0.6113817058503628, + 0.16336741298437119, + 0.0, + 0.08620665222406387, + 0.02964421734213829, + 0.2206711396574974, + 0.08240647614002228, + 0.14013391733169556, + 0.08035791292786598, + 0.0, + 0.11461976915597916, + 0.08719877153635025 + ], + "unique_experts": 45, + "load_cv": 1.434597649550252, + "normalized_load_entropy": 0.8202593328069677, + "max_load_share": 0.12962962962962962 + }, + "full_input": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "103243365826582377afaa0c51f6167ad2e6a3b8cbf86a2a90df3b1e21b9ef60", + "route_weight_sha256": "23c43bf739b43942dfd0e2ae29a4155e872f5f53f094d691169a8ea3fa2fd950", + "loads": [ + 10, + 6, + 0, + 8, + 5, + 5, + 4, + 9, + 0, + 7, + 4, + 17, + 4, + 11, + 5, + 0, + 6, + 0, + 0, + 1, + 4, + 1, + 5, + 14, + 10, + 1, + 1, + 0, + 4, + 0, + 1, + 0, + 5, + 4, + 1, + 1, + 11, + 1, + 5, + 2, + 9, + 1, + 24, + 2, + 3, + 7, + 17, + 2, + 4, + 0, + 2, + 4, + 8, + 5, + 10, + 5, + 1, + 16, + 5, + 4, + 2, + 0, + 6, + 2 + ], + "weighted_loads": [ + 0.550258481875062, + 0.35495732724666595, + 0.0, + 0.253464596811682, + 0.21626883000135422, + 0.29049724619835615, + 0.20083452574908733, + 0.47783397510647774, + 0.0, + 0.2534911911934614, + 0.27642390318214893, + 1.405033614486456, + 0.23312581796199083, + 0.7652535513043404, + 0.22640111669898033, + 0.0, + 0.1969060953706503, + 0.0, + 0.0, + 0.16563525795936584, + 0.47915369272232056, + 0.06650986522436142, + 0.4223702810704708, + 1.6748451441526413, + 0.49011192098259926, + 0.04703744128346443, + 0.1328754723072052, + 0.0, + 0.24467644095420837, + 0.0, + 0.09866355359554291, + 0.0, + 0.26461079344153404, + 0.4514540210366249, + 0.046183113008737564, + 0.0311727412045002, + 0.9881484992802143, + 0.0547744482755661, + 0.28874507639557123, + 0.07390341348946095, + 0.3863723687827587, + 0.02930353954434395, + 1.9884185399860144, + 0.1206921823322773, + 0.1403200700879097, + 1.1946293823421001, + 1.2961143478751183, + 0.0586008932441473, + 0.16977670416235924, + 0.0, + 0.12110431864857674, + 0.23000631108880043, + 0.6113817058503628, + 0.20375744998455048, + 0.9172507598996162, + 0.23112163692712784, + 0.02964421734213829, + 1.1536687277257442, + 0.23966266214847565, + 0.39006437361240387, + 0.08035791292786598, + 0.0, + 0.20977254956960678, + 0.1284276358783245 + ], + "unique_experts": 54, + "load_cv": 1.004591693546653, + "normalized_load_entropy": 0.886128072959354, + "max_load_share": 0.07692307692307693 + } + }, + "s1_bos": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "290a64e44673891efd8298e8d0e4514d403c472d10805d313e21601a9cb6c824", + "route_weight_sha256": "723313b5d909be21987cb86246df83432d2416c1acd92ea6575a9b3126c058af", + "loads": [ + 7, + 3, + 0, + 0, + 0, + 4, + 1, + 3, + 0, + 1, + 4, + 14, + 1, + 7, + 2, + 0, + 0, + 0, + 0, + 0, + 5, + 1, + 2, + 2, + 7, + 1, + 1, + 0, + 4, + 0, + 1, + 0, + 3, + 1, + 1, + 0, + 11, + 1, + 2, + 0, + 3, + 1, + 21, + 1, + 3, + 2, + 6, + 0, + 3, + 0, + 1, + 2, + 8, + 3, + 0, + 2, + 2, + 4, + 2, + 3, + 2, + 0, + 2, + 1 + ], + "weighted_loads": [ + 0.47085115686059, + 0.20310138911008835, + 0.0, + 0.0, + 0.0, + 0.28072112798690796, + 0.03265772759914398, + 0.19137955084443092, + 0.0, + 0.03621073067188263, + 0.2704380862414837, + 1.335298988968134, + 0.25391921401023865, + 0.600945208221674, + 0.06042376719415188, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.5097415260970592, + 0.06742101162672043, + 0.2575353793799877, + 0.07318883575499058, + 0.38060634583234787, + 0.04558185860514641, + 0.05439763888716698, + 0.0, + 0.25614747405052185, + 0.0, + 0.0963878184556961, + 0.0, + 0.1439153365790844, + 0.038478802889585495, + 0.04288757964968681, + 0.0, + 0.9832209795713425, + 0.05237818509340286, + 0.1478089541196823, + 0.0, + 0.09549829922616482, + 0.027256477624177933, + 1.907263170927763, + 0.08698242157697678, + 0.1450759805738926, + 0.1784561164677143, + 0.31684985011816025, + 0.0, + 0.14159350842237473, + 0.0, + 0.04233703389763832, + 0.10808401182293892, + 0.6226015165448189, + 0.12506700493395329, + 0.0, + 0.08765359967947006, + 0.070324482396245, + 0.19377054646611214, + 0.07887045294046402, + 0.1425013281404972, + 0.08341693878173828, + 0.0, + 0.06889202073216438, + 0.09150943160057068 + ], + "unique_experts": 46, + "load_cv": 1.4088686371563137, + "normalized_load_entropy": 0.8264890421973842, + "max_load_share": 0.12962962962962962 + }, + "full_input": { + "tokens": 68, + "top_k": 6, + "decisions": 408, + "ordered_route_sha256": "c94245be1488de00a1288b00459b1ea3553e8d18f4a7b38c8226c89ed560d8e2", + "route_weight_sha256": "be197272dc31fdc5c49a0b16fc619c6fc5d7b86907e546f874b1ddf52c4d6414", + "loads": [ + 12, + 8, + 6, + 7, + 4, + 5, + 11, + 13, + 1, + 6, + 6, + 15, + 3, + 12, + 4, + 3, + 7, + 1, + 2, + 0, + 6, + 1, + 5, + 19, + 9, + 1, + 1, + 0, + 4, + 1, + 1, + 0, + 5, + 12, + 1, + 0, + 17, + 2, + 8, + 1, + 11, + 1, + 24, + 1, + 5, + 7, + 22, + 3, + 9, + 3, + 1, + 13, + 14, + 8, + 10, + 5, + 2, + 24, + 5, + 4, + 4, + 1, + 8, + 3 + ], + "weighted_loads": [ + 0.8027880266308784, + 0.5248947814106941, + 0.3179001994431019, + 0.4661201019771397, + 0.16321493498981, + 0.28589737694710493, + 0.553998339921236, + 0.5973146837204695, + 0.0339733324944973, + 0.23084529489278793, + 0.364122211933136, + 1.3847214207053185, + 0.3012939663603902, + 0.8117432538419962, + 0.20592348091304302, + 0.12065540812909603, + 0.21837444975972176, + 0.05859649181365967, + 0.0909026600420475, + 0.0, + 0.5575766526162624, + 0.06742101162672043, + 0.36883495189249516, + 2.25135643966496, + 0.46113691106438637, + 0.04558185860514641, + 0.05439763888716698, + 0.0, + 0.25614747405052185, + 0.046199847012758255, + 0.0963878184556961, + 0.0, + 0.26800719276070595, + 0.9473258312791586, + 0.04288757964968681, + 0.0, + 1.4150999635457993, + 0.09976597130298615, + 0.5035698618739843, + 0.03181662783026695, + 0.46864776127040386, + 0.027256477624177933, + 1.9958713855594397, + 0.08698242157697678, + 0.24801844358444214, + 1.2192393522709608, + 1.9552598185837269, + 0.22407505847513676, + 0.40252868458628654, + 0.15101834759116173, + 0.04233703389763832, + 0.7613250091671944, + 1.265611745417118, + 0.3451488520950079, + 0.9709307104349136, + 0.23120934888720512, + 0.070324482396245, + 1.8075429312884808, + 0.2559727020561695, + 0.17746546491980553, + 0.15757815167307854, + 0.1259513795375824, + 0.30765214934945107, + 0.17446408048272133 + ], + "unique_experts": 60, + "load_cv": 0.9253157030585818, + "normalized_load_entropy": 0.9027690694279717, + "max_load_share": 0.058823529411764705 + } + }, + "s0_x": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "f2ea6ad7e58d10dbc354fe76156d28de6f93a48e2393b8da87601afde0a96e42", + "route_weight_sha256": "55f3d2ed3b2bb985949a9cd505e6365424975f812a97d5539624bff2cc0d26f1", + "loads": [ + 7, + 3, + 0, + 0, + 0, + 5, + 1, + 3, + 0, + 1, + 3, + 15, + 1, + 7, + 2, + 0, + 0, + 0, + 0, + 0, + 4, + 1, + 2, + 2, + 7, + 1, + 1, + 0, + 4, + 0, + 1, + 0, + 3, + 1, + 1, + 0, + 11, + 1, + 2, + 0, + 3, + 1, + 21, + 1, + 4, + 2, + 5, + 0, + 3, + 0, + 1, + 2, + 8, + 4, + 0, + 2, + 2, + 5, + 2, + 3, + 1, + 0, + 1, + 1 + ], + "weighted_loads": [ + 0.44536254927515984, + 0.2070809192955494, + 0.0, + 0.0, + 0.0, + 0.32569804042577744, + 0.032247092574834824, + 0.19604574516415596, + 0.0, + 0.03528828173875809, + 0.2363508678972721, + 1.2869107984006405, + 0.17218627035617828, + 0.6294785104691982, + 0.08599567413330078, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.4681554473936558, + 0.06041382625699043, + 0.32953934744000435, + 0.07155044004321098, + 0.3923262432217598, + 0.047877732664346695, + 0.04899151250720024, + 0.0, + 0.24678503349423409, + 0.0, + 0.09337596595287323, + 0.0, + 0.1310167983174324, + 0.038560815155506134, + 0.04084073379635811, + 0.0, + 0.9213738776743412, + 0.051641084253787994, + 0.14054576307535172, + 0.0, + 0.12120676785707474, + 0.028710313141345978, + 1.942769791930914, + 0.08368389308452606, + 0.16726665198802948, + 0.1565920002758503, + 0.3089134059846401, + 0.0, + 0.1379196085035801, + 0.0, + 0.04350246116518974, + 0.0979679487645626, + 0.6267994046211243, + 0.16010675393044949, + 0.0, + 0.08333015814423561, + 0.07299253530800343, + 0.2166583277285099, + 0.08022171631455421, + 0.14204805716872215, + 0.03488179296255112, + 0.0, + 0.036955855786800385, + 0.07985080033540726 + ], + "unique_experts": 46, + "load_cv": 1.4328967551105276, + "normalized_load_entropy": 0.822111461469293, + "max_load_share": 0.12962962962962962 + }, + "full_input": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "cb9794b1933a2e443e5a292768d57c846dcf41f97b74e4b5b7bd0f6d9769de1b", + "route_weight_sha256": "e1411396176f0545a886ec331f183343c196c33560c3708e58952cb23f84ab43", + "loads": [ + 11, + 6, + 0, + 10, + 5, + 7, + 6, + 9, + 0, + 7, + 3, + 15, + 2, + 11, + 5, + 1, + 7, + 0, + 0, + 0, + 4, + 1, + 3, + 14, + 10, + 1, + 1, + 0, + 4, + 0, + 1, + 0, + 5, + 5, + 1, + 1, + 12, + 1, + 6, + 2, + 10, + 1, + 24, + 1, + 4, + 8, + 18, + 2, + 4, + 0, + 1, + 4, + 8, + 4, + 11, + 4, + 2, + 15, + 4, + 3, + 2, + 0, + 4, + 1 + ], + "weighted_loads": [ + 0.6441789250820875, + 0.375068299472332, + 0.0, + 0.39538446301594377, + 0.19363300129771233, + 0.38134280126541853, + 0.2821553908288479, + 0.4588606171309948, + 0.0, + 0.23340838961303234, + 0.2363508678972721, + 1.2869107984006405, + 0.18239619303494692, + 0.8132536001503468, + 0.24427368864417076, + 0.037819694727659225, + 0.19980319030582905, + 0.0, + 0.0, + 0.0, + 0.4681554473936558, + 0.06041382625699043, + 0.34819089621305466, + 1.675281099975109, + 0.4950964190065861, + 0.047877732664346695, + 0.04899151250720024, + 0.0, + 0.24678503349423409, + 0.0, + 0.09337596595287323, + 0.0, + 0.2730567157268524, + 0.45329969748854637, + 0.04084073379635811, + 0.0311727412045002, + 0.9592334367334843, + 0.051641084253787994, + 0.3485308485105634, + 0.08068730495870113, + 0.38863374292850494, + 0.028710313141345978, + 2.031624099239707, + 0.08368389308452606, + 0.16726665198802948, + 1.2179403938353062, + 1.4234962090849876, + 0.0586008932441473, + 0.17633866891264915, + 0.0, + 0.04350246116518974, + 0.2252315729856491, + 0.6267994046211243, + 0.16010675393044949, + 1.0532723143696785, + 0.16849133372306824, + 0.07299253530800343, + 1.175220537930727, + 0.17538737878203392, + 0.14204805716872215, + 0.0760999284684658, + 0.0, + 0.132108636200428, + 0.07985080033540726 + ], + "unique_experts": 54, + "load_cv": 1.0253204627247285, + "normalized_load_entropy": 0.8802794291671879, + "max_load_share": 0.07692307692307693 + } + }, + "s1_x": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "807bb770905a5212442062f95b88f36ca7be9d0a807558788d6eeff8ab4fcfd7", + "route_weight_sha256": "ebd545f4722c1f078842afeb3a5fa31d4d29b9e5ea8b4cb28c5badd34b73e901", + "loads": [ + 8, + 3, + 0, + 0, + 0, + 5, + 1, + 3, + 0, + 0, + 3, + 14, + 1, + 7, + 2, + 0, + 1, + 0, + 0, + 0, + 6, + 1, + 2, + 1, + 6, + 0, + 1, + 0, + 4, + 1, + 1, + 0, + 4, + 1, + 1, + 0, + 10, + 1, + 2, + 0, + 4, + 1, + 21, + 2, + 3, + 2, + 5, + 1, + 3, + 0, + 1, + 2, + 9, + 3, + 0, + 2, + 1, + 4, + 1, + 4, + 1, + 1, + 0, + 1 + ], + "weighted_loads": [ + 0.5969794504344463, + 0.23111410066485405, + 0.0, + 0.0, + 0.0, + 0.34761369973421097, + 0.03514878451824188, + 0.16815175488591194, + 0.0, + 0.0, + 0.24831997603178024, + 1.1538034193217754, + 0.14420993626117706, + 0.6725725829601288, + 0.06206626258790493, + 0.0, + 0.030464675277471542, + 0.0, + 0.0, + 0.0, + 0.5342222601175308, + 0.06266113370656967, + 0.359747763723135, + 0.05461738631129265, + 0.3390997238457203, + 0.0, + 0.03153429552912712, + 0.0, + 0.2700619585812092, + 0.03094315156340599, + 0.08709342777729034, + 0.0, + 0.15317890420556068, + 0.04073954001069069, + 0.036032892763614655, + 0.0, + 0.8884755484759808, + 0.053139578551054, + 0.1383802928030491, + 0.0, + 0.17163114063441753, + 0.02921999804675579, + 1.928801767528057, + 0.12517105415463448, + 0.13996585831046104, + 0.1448102593421936, + 0.3003869242966175, + 0.027989402413368225, + 0.1405460610985756, + 0.0, + 0.05570610612630844, + 0.10050150007009506, + 0.6779417283833027, + 0.12286567687988281, + 0.0, + 0.08467678353190422, + 0.030441001057624817, + 0.18973977491259575, + 0.04652480408549309, + 0.17482498288154602, + 0.03599477559328079, + 0.04658088460564613, + 0.0, + 0.07681187987327576 + ], + "unique_experts": 47, + "load_cv": 1.4174968653252211, + "normalized_load_entropy": 0.8244298552401057, + "max_load_share": 0.12962962962962962 + }, + "full_input": { + "tokens": 68, + "top_k": 6, + "decisions": 408, + "ordered_route_sha256": "98972370a95054c3e15bf59e668ad79bea2a9571dd49ea918053a576bb11b92a", + "route_weight_sha256": "7550a2fb1dd2c8f5fa60ec9bb45930261eea80167e6af7751e2a4a63dba10327", + "loads": [ + 13, + 8, + 6, + 8, + 2, + 7, + 13, + 11, + 1, + 4, + 5, + 15, + 2, + 12, + 4, + 3, + 8, + 1, + 2, + 1, + 7, + 1, + 3, + 19, + 8, + 0, + 1, + 0, + 4, + 2, + 1, + 0, + 6, + 11, + 1, + 0, + 16, + 2, + 10, + 1, + 11, + 1, + 23, + 2, + 5, + 8, + 24, + 4, + 10, + 3, + 1, + 13, + 15, + 5, + 13, + 3, + 1, + 24, + 3, + 5, + 4, + 2, + 7, + 2 + ], + "weighted_loads": [ + 0.8963466435670853, + 0.5529074929654598, + 0.3179001994431019, + 0.5266626966185868, + 0.07879393734037876, + 0.38128817547112703, + 0.6522644329816103, + 0.4731362406164408, + 0.0339733324944973, + 0.14288174360990524, + 0.34200410172343254, + 1.1795344036072493, + 0.15444517228752375, + 0.883370628580451, + 0.19337345100939274, + 0.12065540812909603, + 0.21876709535717964, + 0.05859649181365967, + 0.0909026600420475, + 0.031278274953365326, + 0.582057386636734, + 0.06266113370656967, + 0.378197668120265, + 2.276722703129053, + 0.4196302890777588, + 0.0, + 0.03153429552912712, + 0.0, + 0.2700619585812092, + 0.07714299857616425, + 0.08709342777729034, + 0.0, + 0.2774561233818531, + 0.9474318567663431, + 0.036032892763614655, + 0.0, + 1.3203545324504375, + 0.10052736476063728, + 0.6021212413907051, + 0.0314958393573761, + 0.45262123085558414, + 0.02921999804675579, + 1.9813372176140547, + 0.12517105415463448, + 0.2429083213210106, + 1.207481525838375, + 2.218126794323325, + 0.252064460888505, + 0.4667507968842983, + 0.15101834759116173, + 0.05570610612630844, + 0.8251642994582653, + 1.3209519572556019, + 0.19162844866514206, + 1.1953311003744602, + 0.11591425910592079, + 0.030441001057624817, + 1.8417197950184345, + 0.1585405319929123, + 0.2090616635978222, + 0.14438623562455177, + 0.17253226414322853, + 0.2722320072352886, + 0.11612318828701973 + ], + "unique_experts": 60, + "load_cv": 0.9478927031585742, + "normalized_load_entropy": 0.8987266545880568, + "max_load_share": 0.058823529411764705 + } + }, + "s0_period": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "cc4119438094fce7f559d45095c5b4906810a3cb04a92cd6896dc106bf9d029b", + "route_weight_sha256": "d25f1c74b1a35e8132123a7b4723be67e42c108cc26445ae4d17ba8bc1531183", + "loads": [ + 8, + 3, + 0, + 0, + 0, + 5, + 1, + 3, + 0, + 0, + 3, + 15, + 1, + 7, + 1, + 0, + 0, + 0, + 0, + 0, + 6, + 1, + 2, + 2, + 6, + 1, + 1, + 0, + 4, + 1, + 1, + 0, + 3, + 1, + 1, + 0, + 10, + 1, + 2, + 0, + 4, + 0, + 22, + 2, + 3, + 2, + 6, + 0, + 3, + 0, + 1, + 2, + 8, + 3, + 0, + 2, + 2, + 5, + 1, + 3, + 2, + 0, + 0, + 1 + ], + "weighted_loads": [ + 0.543571725487709, + 0.20456891134381294, + 0.0, + 0.0, + 0.0, + 0.318978950381279, + 0.03446824848651886, + 0.2046358957886696, + 0.0, + 0.0, + 0.2733323723077774, + 1.2917855493724346, + 0.20705842971801758, + 0.6401628889143467, + 0.03620411083102226, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.5420685224235058, + 0.05948501452803612, + 0.31321316212415695, + 0.07384487800300121, + 0.35231784358620644, + 0.04743310436606407, + 0.043495722115039825, + 0.0, + 0.2521130293607712, + 0.03492283076047897, + 0.08858175575733185, + 0.0, + 0.13155150413513184, + 0.039204392582178116, + 0.039085038006305695, + 0.0, + 0.8859722316265106, + 0.05257079377770424, + 0.1400424912571907, + 0.0, + 0.14222359284758568, + 0.0, + 1.9922238513827324, + 0.12104729562997818, + 0.14680663123726845, + 0.15665291249752045, + 0.36356696486473083, + 0.0, + 0.1360507421195507, + 0.0, + 0.07033689320087433, + 0.10470588132739067, + 0.6126668564975262, + 0.1272825114428997, + 0.0, + 0.07871253043413162, + 0.06634927913546562, + 0.21718796528875828, + 0.04431508854031563, + 0.13751576840877533, + 0.07365469634532928, + 0.0, + 0.0, + 0.08126989006996155 + ], + "unique_experts": 44, + "load_cv": 1.4715200074920223, + "normalized_load_entropy": 0.8124345417085616, + "max_load_share": 0.13580246913580246 + }, + "full_input": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "7cac77634f1458256c1ce2de20aee39baa261abcf3ae4c2b8dd4baa91b8a437d", + "route_weight_sha256": "bd64aeb0f9fac729b644fea66e2fc6fcc444aebb42936892131d62347f0513c9", + "loads": [ + 12, + 6, + 1, + 8, + 7, + 7, + 6, + 9, + 0, + 6, + 3, + 17, + 2, + 11, + 3, + 1, + 5, + 0, + 0, + 0, + 6, + 1, + 3, + 14, + 9, + 1, + 1, + 0, + 4, + 1, + 1, + 0, + 5, + 5, + 1, + 1, + 10, + 1, + 7, + 1, + 11, + 0, + 26, + 2, + 3, + 7, + 17, + 2, + 4, + 0, + 1, + 4, + 8, + 4, + 12, + 4, + 2, + 16, + 3, + 3, + 3, + 0, + 3, + 1 + ], + "weighted_loads": [ + 0.7487189192324877, + 0.37255629152059555, + 0.04928414523601532, + 0.253464596811682, + 0.28633207827806473, + 0.3746237112209201, + 0.3280906770378351, + 0.4707939960062504, + 0.0, + 0.22552174516022205, + 0.2733323723077774, + 1.3723880350589752, + 0.2172683523967862, + 0.8239379785954952, + 0.15844840928912163, + 0.035969093441963196, + 0.1370417419821024, + 0.0, + 0.0, + 0.0, + 0.5420685224235058, + 0.05948501452803612, + 0.33186471089720726, + 1.728641839697957, + 0.4550880193710327, + 0.04743310436606407, + 0.043495722115039825, + 0.0, + 0.2521130293607712, + 0.03492283076047897, + 0.08858175575733185, + 0.0, + 0.2702455297112465, + 0.4768555946648121, + 0.039085038006305695, + 0.0311727412045002, + 0.8859722316265106, + 0.05257079377770424, + 0.48329093400388956, + 0.02447338216006756, + 0.447330167517066, + 0.0, + 2.129248997196555, + 0.12104729562997818, + 0.14680663123726845, + 1.1804727166891098, + 1.323916170746088, + 0.0586008932441473, + 0.17446980252861977, + 0.0, + 0.07033689320087433, + 0.23076283186674118, + 0.6126668564975262, + 0.1751963458955288, + 1.0046391636133194, + 0.16917698830366135, + 0.06634927913546562, + 1.2310958821326494, + 0.14564171060919762, + 0.13751576840877533, + 0.11820000037550926, + 0.0, + 0.09515278041362762, + 0.08126989006996155 + ], + "unique_experts": 55, + "load_cv": 1.0575174680667323, + "normalized_load_entropy": 0.8785362009745369, + "max_load_share": 0.08333333333333333 + } + }, + "s1_period": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "ac5737572ee2826aae0dccb15aa886420a2b819923dc482d6851f31d6093bfa8", + "route_weight_sha256": "679955c1aa819b52771b44533c80ed1dec183d64440469ec27682d6e49142c48", + "loads": [ + 8, + 3, + 0, + 0, + 0, + 4, + 1, + 3, + 0, + 0, + 5, + 14, + 1, + 7, + 1, + 0, + 0, + 0, + 0, + 0, + 6, + 1, + 2, + 1, + 5, + 0, + 1, + 0, + 4, + 0, + 1, + 0, + 3, + 1, + 1, + 0, + 11, + 1, + 2, + 0, + 4, + 0, + 21, + 2, + 3, + 3, + 5, + 0, + 2, + 1, + 1, + 2, + 9, + 4, + 0, + 2, + 1, + 5, + 1, + 4, + 1, + 2, + 0, + 2 + ], + "weighted_loads": [ + 0.6624212265014648, + 0.2372281476855278, + 0.0, + 0.0, + 0.0, + 0.29360098764300346, + 0.03557703271508217, + 0.17987136915326118, + 0.0, + 0.0, + 0.3896069470793009, + 1.219631977379322, + 0.12827984988689423, + 0.7174058184027672, + 0.03656225651502609, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.5412758179008961, + 0.06363304704427719, + 0.3181553855538368, + 0.039760444313287735, + 0.2994286008179188, + 0.0, + 0.02980164624750614, + 0.0, + 0.2680176608264446, + 0.0, + 0.09020422399044037, + 0.0, + 0.12049689516425133, + 0.04266004636883736, + 0.03893781825900078, + 0.0, + 0.9148274213075638, + 0.05085426941514015, + 0.1412677839398384, + 0.0, + 0.19313610158860683, + 0.0, + 1.9550120159983635, + 0.11882743611931801, + 0.1363615095615387, + 0.15900544449687004, + 0.2980559356510639, + 0.0, + 0.10121209546923637, + 0.0236541498452425, + 0.042855240404605865, + 0.10071869939565659, + 0.6521586664021015, + 0.16442134976387024, + 0.0, + 0.07791225612163544, + 0.028480496257543564, + 0.2204292006790638, + 0.04476460814476013, + 0.17003236711025238, + 0.034384291619062424, + 0.07520676963031292, + 0.0, + 0.1158340685069561 + ], + "unique_experts": 44, + "load_cv": 1.4396882759686527, + "normalized_load_entropy": 0.8143587798301059, + "max_load_share": 0.12962962962962962 + }, + "full_input": { + "tokens": 68, + "top_k": 6, + "decisions": 408, + "ordered_route_sha256": "6e275e2a8f8bf6faf4a752a3a95c32018a099592a43ce5162529d4c1b7fdcc97", + "route_weight_sha256": "a612024615e164ed6ba819f717c6207e820e253117b2860c25e7c23133aab576", + "loads": [ + 13, + 8, + 7, + 7, + 2, + 5, + 15, + 11, + 1, + 5, + 7, + 14, + 2, + 12, + 3, + 3, + 7, + 1, + 2, + 0, + 7, + 1, + 4, + 17, + 7, + 0, + 1, + 0, + 4, + 1, + 1, + 0, + 5, + 12, + 1, + 0, + 17, + 2, + 11, + 1, + 12, + 0, + 23, + 2, + 5, + 9, + 24, + 3, + 8, + 4, + 1, + 12, + 15, + 7, + 12, + 3, + 1, + 24, + 3, + 5, + 6, + 3, + 6, + 3 + ], + "weighted_loads": [ + 0.9647780321538448, + 0.5590215399861336, + 0.3575202152132988, + 0.4661201019771397, + 0.07879393734037876, + 0.29877723660320044, + 0.7409335114061832, + 0.47753396444022655, + 0.0339733324944973, + 0.17417730204761028, + 0.4832910727709532, + 1.219631977379322, + 0.1385150859132409, + 0.9282038640230894, + 0.16723885014653206, + 0.12065540812909603, + 0.196671262383461, + 0.05859649181365967, + 0.0909026600420475, + 0.0, + 0.5891109444200993, + 0.06363304704427719, + 0.3789906594902277, + 2.1712148375809193, + 0.3799591660499573, + 0.0, + 0.02980164624750614, + 0.0, + 0.2680176608264446, + 0.046199847012758255, + 0.09020422399044037, + 0.0, + 0.23559632524847984, + 0.9617687780410051, + 0.03893781825900078, + 0.0, + 1.3467064052820206, + 0.09824205562472343, + 0.7655985299497843, + 0.034835826605558395, + 0.4990201126784086, + 0.0, + 2.007547466084361, + 0.11882743611931801, + 0.23930397257208824, + 1.2276613619178534, + 2.0441524013876915, + 0.22407505847513676, + 0.3621472716331482, + 0.17467249743640423, + 0.042855240404605865, + 0.714785996824503, + 1.2951688952744007, + 0.2772396132349968, + 1.0798832327127457, + 0.10914973169565201, + 0.028480496257543564, + 1.898035954684019, + 0.16153407096862793, + 0.20519249141216278, + 0.1995610147714615, + 0.20115814916789532, + 0.23876012861728668, + 0.15514537692070007 + ], + "unique_experts": 58, + "load_cv": 0.9454559569600937, + "normalized_load_entropy": 0.8966476094942649, + "max_load_share": 0.058823529411764705 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 27, + "ordered_topk_exact_tokens": 17, + "set_exact_tokens": 18, + "mean_set_jaccard": 0.9047619047619047, + "mean_token_weighted_tv": 0.02359039553751548, + "aggregate_load_tv": 0.04938271604938271 + }, + "system_bos": { + "tokens": 27, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 22, + "mean_set_jaccard": 0.9391534391534393, + "mean_token_weighted_tv": 0.022638725944691233, + "aggregate_load_tv": 0.030864197530864196 + }, + "system_x": { + "tokens": 27, + "ordered_topk_exact_tokens": 6, + "set_exact_tokens": 13, + "mean_set_jaccard": 0.835978835978836, + "mean_token_weighted_tv": 0.04156107741787478, + "aggregate_load_tv": 0.07407407407407407 + }, + "system_period": { + "tokens": 27, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.865079365079365, + "mean_token_weighted_tv": 0.04031343968516147, + "aggregate_load_tv": 0.06790123456790123 + }, + "bos_at_s0": { + "tokens": 27, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.8756613756613757, + "mean_token_weighted_tv": 0.033036432022021875, + "aggregate_load_tv": 0.04938271604938271 + }, + "bos_at_s1": { + "tokens": 27, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8624338624338626, + "mean_token_weighted_tv": 0.03429201969669925, + "aggregate_load_tv": 0.05555555555555555 + }, + "x_at_s0": { + "tokens": 27, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.8756613756613758, + "mean_token_weighted_tv": 0.03731126807354115, + "aggregate_load_tv": 0.05555555555555555 + }, + "x_at_s1": { + "tokens": 27, + "ordered_topk_exact_tokens": 8, + "set_exact_tokens": 11, + "mean_set_jaccard": 0.8148148148148148, + "mean_token_weighted_tv": 0.05432514315126119, + "aggregate_load_tv": 0.08641975308641975 + }, + "period_at_s0": { + "tokens": 27, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 12, + "mean_set_jaccard": 0.8192239858906526, + "mean_token_weighted_tv": 0.047856612406947, + "aggregate_load_tv": 0.08641975308641975 + }, + "period_at_s1": { + "tokens": 27, + "ordered_topk_exact_tokens": 5, + "set_exact_tokens": 10, + "mean_set_jaccard": 0.7962962962962964, + "mean_token_weighted_tv": 0.06096490113823502, + "aggregate_load_tv": 0.1111111111111111 + } + } + }, + "layer_24": { + "layer": 24, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "87a77219f25bff561bdecbf7ce20d7749fa89a9e1dac5677b95f190dedb7749b", + "route_weight_sha256": "1e14f21922daf48ef5d770a586ae7fb07eda3f9c8c3c440b6b3b178e19033461", + "loads": [ + 0, + 0, + 4, + 2, + 1, + 0, + 0, + 11, + 1, + 0, + 0, + 0, + 0, + 0, + 5, + 0, + 1, + 0, + 4, + 16, + 13, + 6, + 0, + 6, + 23, + 1, + 1, + 1, + 9, + 1, + 1, + 0, + 0, + 3, + 0, + 6, + 2, + 2, + 1, + 0, + 4, + 0, + 5, + 0, + 3, + 1, + 0, + 5, + 0, + 0, + 3, + 0, + 0, + 1, + 0, + 2, + 0, + 1, + 0, + 1, + 0, + 1, + 7, + 7 + ], + "weighted_loads": [ + 0.0, + 0.0, + 0.26613761857151985, + 0.09754100441932678, + 0.04887641221284866, + 0.0, + 0.0, + 0.9729657061398029, + 0.03335130214691162, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.2493775263428688, + 0.0, + 2.986608024002635e-06, + 0.0, + 0.17173726856708527, + 1.454560101032257, + 0.7957532051950693, + 0.327729482203722, + 0.0, + 0.3325955756008625, + 1.6334595754742622, + 0.036826301366090775, + 4.15049044022453e-06, + 0.035220637917518616, + 0.7549796979874372, + 0.08457844704389572, + 0.058578573167324066, + 0.0, + 0.0, + 0.16548965087531542, + 0.0, + 0.4593849442899227, + 0.1295943222939968, + 0.12395352497696877, + 0.05129417032003403, + 0.0, + 0.2826441638171673, + 0.0, + 0.22444742545485497, + 0.0, + 0.25302741676568985, + 0.034868162125349045, + 0.0, + 0.36168408393859863, + 0.0, + 0.0, + 1.1068373918533325, + 0.0, + 0.0, + 4.301532044337364e-06, + 0.0, + 0.07539641857147217, + 0.0, + 0.043503452092409134, + 0.0, + 0.04207993671298027, + 0.0, + 3.9491937968705315e-06, + 0.9262949712574482, + 0.4423989746719599 + ], + "unique_experts": 37, + "load_cv": 1.6614458696226997, + "normalized_load_entropy": 0.7606986712680911, + "max_load_share": 0.1419753086419753 + }, + "full_input": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "49629226cabe56470e4eed60e7ab80aa84f490227ea35595f2067aaf19f88d98", + "route_weight_sha256": "c2e7ff2b0070fb05948aca00fc7cc3d2b20a930c673e135f8d7d3cf97f50718a", + "loads": [ + 0, + 0, + 6, + 2, + 2, + 4, + 0, + 12, + 10, + 0, + 10, + 0, + 1, + 0, + 7, + 0, + 1, + 0, + 4, + 17, + 14, + 6, + 5, + 6, + 31, + 1, + 2, + 1, + 16, + 7, + 1, + 2, + 1, + 7, + 6, + 7, + 4, + 5, + 2, + 0, + 4, + 1, + 10, + 0, + 3, + 3, + 0, + 11, + 0, + 0, + 11, + 6, + 4, + 5, + 0, + 2, + 0, + 1, + 8, + 1, + 1, + 19, + 12, + 10 + ], + "weighted_loads": [ + 0.0, + 0.0, + 0.3325559441000223, + 0.09754100441932678, + 0.08847304433584213, + 0.13129568111617118, + 0.0, + 1.029190506786108, + 0.417445810046047, + 0.0, + 0.3656304383184761, + 0.0, + 0.0027466181199997663, + 0.0, + 0.3078600559383631, + 0.0, + 2.986608024002635e-06, + 0.0, + 0.17173726856708527, + 1.5642358213663101, + 0.8299601208418608, + 0.327729482203722, + 0.27136921510100365, + 0.3325955756008625, + 1.935124481562525, + 0.036826301366090775, + 0.046038125227369164, + 0.035220637917518616, + 1.035097485408187, + 0.3391078971326351, + 0.058578573167324066, + 0.06640090420842171, + 0.028756173327565193, + 0.35029760523138975, + 0.20918644731864333, + 0.5017183348536491, + 0.286450807005167, + 1.0513789560645819, + 0.09444182738661766, + 0.0, + 0.2826441638171673, + 0.059488244354724884, + 0.4575271753128618, + 0.0, + 0.25302741676568985, + 0.12157809734344482, + 0.0, + 0.6949216107605025, + 0.0, + 0.0, + 1.522403597831726, + 0.4243881553411484, + 0.13161831721663475, + 0.176780096008315, + 0.0, + 0.07539641857147217, + 0.0, + 0.043503452092409134, + 0.27981828001793474, + 0.04207993671298027, + 0.03920998051762581, + 1.3452328400821898, + 1.043547205044888, + 2.427700323984027 + ], + "unique_experts": 49, + "load_cv": 1.180323003741939, + "normalized_load_entropy": 0.8506665160298239, + "max_load_share": 0.09935897435897435 + } + }, + "s1_eos": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "5908fb3a210f1d369d96fd21735179de1590aa3c1a2f48b939b85194a946a830", + "route_weight_sha256": "318b7d6b8eac65151f5e7bf1a1389b1405f88050d55f356d8c43f06f93d7c9f4", + "loads": [ + 0, + 0, + 5, + 2, + 1, + 0, + 0, + 11, + 1, + 0, + 0, + 0, + 0, + 0, + 5, + 0, + 0, + 0, + 4, + 16, + 15, + 5, + 0, + 6, + 20, + 0, + 1, + 1, + 10, + 2, + 1, + 0, + 0, + 3, + 0, + 6, + 1, + 2, + 1, + 1, + 4, + 0, + 4, + 1, + 4, + 3, + 0, + 4, + 0, + 0, + 3, + 0, + 0, + 1, + 0, + 2, + 0, + 1, + 0, + 0, + 1, + 1, + 6, + 7 + ], + "weighted_loads": [ + 0.0, + 0.0, + 0.3003282994031906, + 0.1002066396176815, + 0.045864783227443695, + 0.0, + 0.0, + 0.960569690912962, + 0.03449022397398949, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.24328359216451645, + 0.0, + 0.0, + 0.0, + 0.17360085807740688, + 1.4196429699659348, + 0.9097895063459873, + 0.28151610866189003, + 0.0, + 0.32150543853640556, + 1.4582085944712162, + 0.0, + 8.075273399299476e-06, + 0.034984830766916275, + 0.8119746316224337, + 0.11249245703220367, + 0.06664612144231796, + 0.0, + 0.0, + 0.16540822624756402, + 0.0, + 0.46642883494496346, + 0.0901266410946846, + 0.12346537783741951, + 0.0574534572660923, + 0.03446788713335991, + 0.30264003947377205, + 0.0, + 0.18579011783003807, + 0.044162869453430176, + 0.32217898964881897, + 0.06864812567027911, + 0.0, + 0.33863090723752975, + 0.0, + 0.0, + 1.1113555133342743, + 0.0, + 0.0, + 8.727688509679865e-06, + 0.0, + 0.07878225669264793, + 0.0, + 0.04250560700893402, + 0.0, + 0.0, + 0.02764253132045269, + 6.927643880771939e-06, + 0.8823001831769943, + 0.4424513131380081 + ], + "unique_experts": 37, + "load_cv": 1.607737350218786, + "normalized_load_entropy": 0.7669406970003759, + "max_load_share": 0.12345679012345678 + }, + "full_input": { + "tokens": 68, + "top_k": 6, + "decisions": 408, + "ordered_route_sha256": "db9919c7f44c0e5206551a243eb503a2ce89d361d7da3cc406019dba7f5d9f56", + "route_weight_sha256": "8d900e365c6aa5c7d6cb58fea35fb3a41cab99f92d32599e53c5528a6f7fc773", + "loads": [ + 0, + 0, + 6, + 3, + 4, + 8, + 0, + 12, + 11, + 3, + 9, + 2, + 3, + 0, + 7, + 0, + 0, + 0, + 5, + 20, + 20, + 5, + 9, + 7, + 31, + 0, + 1, + 1, + 28, + 7, + 1, + 3, + 0, + 9, + 5, + 8, + 9, + 5, + 2, + 1, + 5, + 7, + 10, + 3, + 6, + 4, + 0, + 11, + 0, + 0, + 12, + 14, + 7, + 5, + 3, + 4, + 0, + 2, + 15, + 0, + 4, + 23, + 16, + 12 + ], + "weighted_loads": [ + 0.0, + 0.0, + 0.3261354397982359, + 0.21303017064929008, + 0.14502006024122238, + 0.269825063762255, + 0.0, + 0.9977899566292763, + 0.6572625944390893, + 0.13117234036326408, + 0.36684017605148256, + 0.06701246462762356, + 0.06053226115182042, + 0.0, + 0.30478376150131226, + 0.0, + 0.0, + 0.0, + 0.20651802606880665, + 1.6252882927656174, + 1.1296613179147243, + 0.28151610866189003, + 0.5168842058628798, + 0.34686974063515663, + 1.8582754940725863, + 0.0, + 8.075273399299476e-06, + 0.034984830766916275, + 1.7194737829267979, + 0.3544425033032894, + 0.06664612144231796, + 0.13923172652721405, + 0.0, + 0.47251159563256806, + 0.1740437736734748, + 0.5690879113972187, + 0.7039898708462715, + 1.0625809989869595, + 0.10784748941659927, + 0.03446788713335991, + 0.41598083451390266, + 0.41717114113271236, + 0.44160131085664034, + 0.25162578746676445, + 0.41853688657283783, + 0.1287142854848753, + 0.0, + 0.8128632669104263, + 0.0, + 0.0, + 1.550286527723074, + 0.980985876172781, + 0.20760868676006794, + 0.2844696187266891, + 0.20342805236577988, + 0.17607518285512924, + 0.0, + 0.08269136771559715, + 0.6318664327845909, + 0.0, + 0.12438691221177578, + 2.057781152428106, + 1.3259832110488787, + 2.5085501484572887 + ], + "unique_experts": 50, + "load_cv": 1.0698410090748032, + "normalized_load_entropy": 0.8706581996241722, + "max_load_share": 0.07598039215686274 + } + }, + "s0_bos": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "3b2b52cd397dc60b4aff0b2444b523e9e06d6b385a6de2d320b77f5d7d5ac377", + "route_weight_sha256": "532d0de115cdfbe4fab2f257925e5b1943d5385301e9b485044a17e3dcfea9b5", + "loads": [ + 0, + 0, + 4, + 2, + 1, + 0, + 0, + 11, + 1, + 0, + 1, + 0, + 0, + 0, + 4, + 0, + 1, + 0, + 3, + 17, + 15, + 6, + 0, + 5, + 21, + 1, + 1, + 1, + 11, + 1, + 1, + 0, + 0, + 3, + 0, + 6, + 2, + 2, + 1, + 0, + 4, + 0, + 4, + 0, + 4, + 1, + 0, + 5, + 0, + 0, + 3, + 0, + 0, + 1, + 0, + 2, + 0, + 1, + 0, + 0, + 0, + 1, + 7, + 7 + ], + "weighted_loads": [ + 0.0, + 0.0, + 0.2739541418850422, + 0.10828207433223724, + 0.04569382965564728, + 0.0, + 0.0, + 1.0074781365692616, + 0.030696094036102295, + 0.0, + 2.209439799116808e-06, + 0.0, + 0.0, + 0.0, + 0.1962440311908722, + 0.0, + 0.02733844332396984, + 0.0, + 0.1474951170384884, + 1.4861502274870872, + 0.94978878647089, + 0.3228683192282915, + 0.0, + 0.3234870843589306, + 1.4076917879283428, + 0.038460712879896164, + 4.357012130640214e-06, + 0.036733776330947876, + 0.8486178778111935, + 0.08776406943798065, + 0.07111907750368118, + 0.0, + 0.0, + 0.16518595996512886, + 0.0, + 0.4799174331128597, + 0.13464486971497536, + 0.12257805839180946, + 0.05732138454914093, + 0.0, + 0.3126717396080494, + 0.0, + 0.19186552613973618, + 0.0, + 0.30523625016212463, + 0.03231734409928322, + 0.0, + 0.37080109864473343, + 0.0, + 0.0, + 1.10728232935071, + 0.0, + 0.0, + 5.948711077508051e-06, + 0.0, + 0.07612620666623116, + 0.0, + 0.05145537853240967, + 0.0, + 0.0, + 0.0, + 4.647995865525445e-06, + 0.9446094036102295, + 0.4516052659600973 + ], + "unique_experts": 37, + "load_cv": 1.670229388263569, + "normalized_load_entropy": 0.7580379108752333, + "max_load_share": 0.12962962962962962 + }, + "full_input": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "ddcafe64de8f5dcaa90805f2cdf2360c1c3ff24c4084893fda98483659273fa4", + "route_weight_sha256": "04be493f1207bc0542a1030c875752c9340c43c3e640dfcdb94cde5d5a28b1f3", + "loads": [ + 0, + 0, + 8, + 2, + 1, + 3, + 1, + 12, + 8, + 0, + 9, + 0, + 1, + 0, + 6, + 0, + 1, + 0, + 3, + 20, + 16, + 6, + 6, + 5, + 30, + 1, + 3, + 1, + 18, + 7, + 2, + 3, + 2, + 7, + 6, + 6, + 4, + 4, + 1, + 0, + 4, + 1, + 10, + 0, + 4, + 3, + 1, + 9, + 0, + 0, + 12, + 5, + 5, + 6, + 0, + 2, + 0, + 1, + 7, + 0, + 2, + 19, + 9, + 9 + ], + "weighted_loads": [ + 0.0, + 0.0, + 0.4035855997353792, + 0.10828207433223724, + 0.04569382965564728, + 0.09267169993836433, + 0.05974321439862251, + 1.0637029372155666, + 0.3773193322122097, + 0.0, + 0.3152211812491714, + 0.0, + 0.0027466181199997663, + 0.0, + 0.25472656078636646, + 0.0, + 0.02733844332396984, + 0.0, + 0.1474951170384884, + 1.6335702054202557, + 0.9839957021176815, + 0.3228683192282915, + 0.42715248093008995, + 0.3234870843589306, + 1.745059131179005, + 0.038460712879896164, + 0.49829152068696203, + 0.036733776330947876, + 1.1287356652319431, + 0.33365629613399506, + 0.10875270888209343, + 0.0930644441395998, + 0.09020975790917873, + 0.3499939143212032, + 0.21428614808246493, + 0.4799174331128597, + 0.27368824928998947, + 1.015078043565154, + 0.05732138454914093, + 0.0, + 0.3126717396080494, + 0.059488244354724884, + 0.47909531160257757, + 0.0, + 0.30523625016212463, + 0.14008647948503494, + 0.05988532304763794, + 0.6693053704220802, + 0.0, + 0.0, + 1.557853002101183, + 0.3464323543012142, + 0.17190055921673775, + 0.21532730886701756, + 0.0, + 0.07612620666623116, + 0.0, + 0.05145537853240967, + 0.2911202386021614, + 0.0, + 0.07697712630033493, + 1.3134308734420301, + 0.9890983739169315, + 1.467368820682168 + ], + "unique_experts": 50, + "load_cv": 1.1853255724437148, + "normalized_load_entropy": 0.8534395279894367, + "max_load_share": 0.09615384615384616 + } + }, + "s1_bos": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "e17bcc0d5f7968611ec69c977380348037841670f12f38f1e4f3ee1927e66638", + "route_weight_sha256": "aab235891c16dac2f928b944279b02fe59e8671901a49986b4156ef954120585", + "loads": [ + 0, + 0, + 4, + 2, + 1, + 0, + 0, + 12, + 1, + 0, + 0, + 0, + 0, + 0, + 4, + 0, + 0, + 0, + 3, + 17, + 14, + 5, + 0, + 6, + 20, + 1, + 1, + 1, + 11, + 2, + 1, + 0, + 0, + 3, + 0, + 5, + 2, + 2, + 1, + 0, + 4, + 0, + 4, + 0, + 4, + 1, + 1, + 5, + 1, + 0, + 3, + 0, + 0, + 1, + 0, + 2, + 0, + 1, + 0, + 1, + 0, + 1, + 7, + 7 + ], + "weighted_loads": [ + 0.0, + 0.0, + 0.275853518396616, + 0.10589442402124405, + 0.04259668290615082, + 0.0, + 0.0, + 1.044969879090786, + 0.032904110848903656, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.18761251494288445, + 0.0, + 0.0, + 0.0, + 0.1464414894580841, + 1.4792348630726337, + 0.8998972363770008, + 0.29458344355225563, + 0.0, + 0.36565764620900154, + 1.368102878332138, + 0.03672470897436142, + 1.0572248356766067e-05, + 0.035328209400177, + 0.8278539590537548, + 0.12425274215638638, + 0.07529252767562866, + 0.0, + 0.0, + 0.16345212293163058, + 0.0, + 0.44357476755976677, + 0.12935282289981842, + 0.12235982343554497, + 0.0658402219414711, + 0.0, + 0.3340356685221195, + 0.0, + 0.19501709565520287, + 0.0, + 0.3270235024392605, + 0.0313647985458374, + 0.03406403958797455, + 0.3685220032930374, + 6.384585049090674e-06, + 0.0, + 1.105664525181055, + 0.0, + 0.0, + 1.3436126209853683e-05, + 0.0, + 0.07522423937916756, + 0.0, + 0.05504081770777702, + 0.0, + 0.039686575531959534, + 0.0, + 1.0690384442568757e-05, + 0.9556835610419512, + 0.4349556863307953 + ], + "unique_experts": 38, + "load_cv": 1.630330937761086, + "normalized_load_entropy": 0.7663041931099809, + "max_load_share": 0.12345679012345678 + }, + "full_input": { + "tokens": 68, + "top_k": 6, + "decisions": 408, + "ordered_route_sha256": "a63e4abfeb1edf1eeaaec03a77dfec9ca51ae5c639abb976c5cb3d8e277de186", + "route_weight_sha256": "60c3aee3f0dcd57457c8cabaafe470164c65792a4e30583d9f481456c00d28a2", + "loads": [ + 0, + 0, + 7, + 3, + 3, + 6, + 0, + 13, + 10, + 3, + 8, + 2, + 3, + 0, + 6, + 0, + 0, + 0, + 4, + 23, + 19, + 5, + 10, + 7, + 32, + 1, + 3, + 2, + 29, + 6, + 1, + 4, + 0, + 9, + 5, + 7, + 12, + 4, + 1, + 0, + 5, + 8, + 10, + 3, + 5, + 3, + 1, + 11, + 1, + 0, + 13, + 13, + 8, + 6, + 3, + 4, + 0, + 1, + 14, + 1, + 2, + 24, + 14, + 10 + ], + "weighted_loads": [ + 0.0, + 0.0, + 0.36527968756854534, + 0.21871795505285263, + 0.10338087379932404, + 0.18231322255451232, + 0.0, + 1.0821901448071003, + 0.651296678930521, + 0.13117234036326408, + 0.361716435989365, + 0.06701246462762356, + 0.06053226115182042, + 0.0, + 0.24911268427968025, + 0.0, + 0.0, + 0.0, + 0.17935865744948387, + 1.7252943441271782, + 1.1197690479457378, + 0.29458344355225563, + 0.644768288359046, + 0.3910219483077526, + 1.8062354126013815, + 0.03672470897436142, + 0.0647618936982326, + 0.06767289713025093, + 1.735353110358119, + 0.30823698453605175, + 0.07529252767562866, + 0.17474113404750824, + 0.0, + 0.4705554923166346, + 0.180665354244411, + 0.546233844012022, + 0.7917405478656292, + 1.029234703630209, + 0.0658402219414711, + 0.0, + 0.44737646356225014, + 0.4730439316481352, + 0.5436930889263749, + 0.2744240500032902, + 0.36542344465851784, + 0.13343197479844093, + 0.03406403958797455, + 0.8814661439973861, + 6.384585049090674e-06, + 0.0, + 1.651990171521902, + 0.8839400671422482, + 0.2491340097039938, + 0.3397546177084223, + 0.20342805236577988, + 0.17251716554164886, + 0.0, + 0.05504081770777702, + 0.6424603816121817, + 0.039686575531959534, + 0.06508245319128036, + 2.0582690985993395, + 1.32943868834991, + 1.488367699086666 + ], + "unique_experts": 53, + "load_cv": 1.0940051948677114, + "normalized_load_entropy": 0.8716513048042468, + "max_load_share": 0.0784313725490196 + } + }, + "s0_x": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "6edef831affaf02fe5fe144f06b0281b54c6b8abad000b34ccd0d1d546b05f0a", + "route_weight_sha256": "8cc1ba76572b32a6922f6cb05fc902066fab6998bb93d618a245d105d91f8e57", + "loads": [ + 0, + 0, + 4, + 2, + 1, + 0, + 0, + 13, + 0, + 0, + 0, + 0, + 0, + 0, + 4, + 0, + 0, + 0, + 4, + 17, + 16, + 6, + 0, + 7, + 17, + 1, + 1, + 1, + 9, + 1, + 1, + 0, + 0, + 3, + 0, + 6, + 2, + 2, + 1, + 1, + 4, + 0, + 4, + 0, + 4, + 2, + 0, + 5, + 0, + 2, + 3, + 0, + 0, + 1, + 0, + 2, + 0, + 1, + 0, + 0, + 0, + 1, + 7, + 6 + ], + "weighted_loads": [ + 0.0, + 0.0, + 0.26778675988316536, + 0.0992518775165081, + 0.04416234791278839, + 0.0, + 0.0, + 1.0821590200066566, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.2046217918395996, + 0.0, + 0.0, + 0.0, + 0.17822271585464478, + 1.468163337558508, + 0.9572664499282837, + 0.34212183579802513, + 0.0, + 0.4004017859697342, + 1.2279426790773869, + 0.03917602449655533, + 2.3141706151363906e-06, + 0.04052579775452614, + 0.7853170931339264, + 0.08883129060268402, + 0.06504788249731064, + 0.0, + 0.0, + 0.1469133703440093, + 0.0, + 0.48449353501200676, + 0.14708173274993896, + 0.12126610428094864, + 0.0466209277510643, + 0.03315145522356033, + 0.30847321078181267, + 0.0, + 0.17753304541110992, + 0.0, + 0.335977029055357, + 0.03199536965894367, + 0.0, + 0.3731793686747551, + 0.0, + 0.09403352439403534, + 1.1163088083267212, + 0.0, + 0.0, + 3.2061675483419094e-06, + 0.0, + 0.08255577459931374, + 0.0, + 0.03898352012038231, + 0.0, + 0.0, + 0.0, + 2.2535114112542942e-06, + 0.9362796694040298, + 0.4169420748949051 + ], + "unique_experts": 36, + "load_cv": 1.6031804238519256, + "normalized_load_entropy": 0.7638839641105265, + "max_load_share": 0.10493827160493827 + }, + "full_input": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "27a36e1377f219f9212c2ea7a1fca2bb7688436017c4bad1048743cc364587b0", + "route_weight_sha256": "9ef79abb859ab8058738a06f818e17372c9b73b5d4b6653a39bac57d022c62f7", + "loads": [ + 0, + 0, + 7, + 2, + 1, + 4, + 0, + 14, + 8, + 0, + 9, + 0, + 3, + 0, + 6, + 0, + 0, + 0, + 4, + 19, + 17, + 6, + 5, + 7, + 25, + 1, + 3, + 1, + 17, + 6, + 1, + 1, + 3, + 7, + 7, + 7, + 4, + 5, + 2, + 1, + 4, + 2, + 8, + 0, + 4, + 4, + 0, + 10, + 0, + 2, + 11, + 5, + 5, + 6, + 0, + 2, + 0, + 1, + 8, + 0, + 2, + 19, + 8, + 8 + ], + "weighted_loads": [ + 0.0, + 0.0, + 0.3834573421627283, + 0.0992518775165081, + 0.04416234791278839, + 0.12244977813679725, + 0.0, + 1.1383838206529617, + 0.42801324650645256, + 0.0, + 0.36833902983926237, + 0.0, + 0.07137212413363159, + 0.0, + 0.2631043214350939, + 0.0, + 0.0, + 0.0, + 0.17822271585464478, + 1.562768168747425, + 0.9914733655750751, + 0.34212183579802513, + 0.27263019047677517, + 0.4004017859697342, + 1.5296075851656497, + 0.03917602449655533, + 0.0730978220904035, + 0.04052579775452614, + 1.1017117388546467, + 0.29040757194161415, + 0.06504788249731064, + 0.032193563878536224, + 0.11453382484614849, + 0.33172132470008364, + 0.2621930888853967, + 0.5217062942683697, + 0.2798258773982525, + 1.0528460927307606, + 0.0846102386713028, + 0.03315145522356033, + 0.30847321078181267, + 0.11523840576410294, + 0.30698352097533643, + 0.0, + 0.335977029055357, + 0.11772582174944546, + 0.0, + 0.726565369637683, + 0.0, + 0.09403352439403534, + 1.5009523779153824, + 0.36700860038399696, + 0.16931433230638504, + 0.23556214812788312, + 0.0, + 0.08255577459931374, + 0.0, + 0.03898352012038231, + 0.32694248855113983, + 0.0, + 0.08139311894774437, + 1.284480104864997, + 0.9379864596994594, + 1.4327056296169758 + ], + "unique_experts": 49, + "load_cv": 1.1073242503430352, + "normalized_load_entropy": 0.862419356868618, + "max_load_share": 0.08012820512820513 + } + }, + "s1_x": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "76d0e27a711d3f01837bce1ed6672913095edd772454d8971d7355938be42d9a", + "route_weight_sha256": "86b26ffd22cdc43026b02d5926fb5f8f4c6e017982f9532619f40c7c7ef06796", + "loads": [ + 0, + 0, + 5, + 3, + 0, + 0, + 1, + 11, + 1, + 0, + 0, + 0, + 0, + 0, + 3, + 0, + 1, + 0, + 3, + 18, + 15, + 6, + 0, + 7, + 18, + 0, + 1, + 1, + 9, + 1, + 1, + 1, + 0, + 2, + 0, + 5, + 2, + 2, + 1, + 1, + 5, + 0, + 6, + 1, + 4, + 2, + 0, + 5, + 0, + 0, + 3, + 0, + 0, + 1, + 0, + 1, + 0, + 1, + 0, + 1, + 0, + 0, + 6, + 7 + ], + "weighted_loads": [ + 0.0, + 0.0, + 0.3073476366698742, + 0.17987002059817314, + 0.0, + 0.0, + 0.03612834960222244, + 0.994152382016182, + 0.03276968374848366, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.14828220754861832, + 0.0, + 1.833132273532101e-06, + 0.0, + 0.13642297312617302, + 1.3876243863060154, + 1.006696566939354, + 0.3373274691402912, + 0.0, + 0.4102204069495201, + 1.1974166836589575, + 0.0, + 0.03390052914619446, + 0.0382184274494648, + 0.7856498397886753, + 0.09646958857774734, + 0.0710178092122078, + 1.924929847518797e-06, + 0.0, + 0.10092523915272977, + 0.0, + 0.4532337263226509, + 0.1319482885301113, + 0.11631008610129356, + 0.05229971930384636, + 0.03698701411485672, + 0.34078995138406754, + 0.0, + 0.2758888490498066, + 0.039418961852788925, + 0.3619862496852875, + 0.07007958367466927, + 0.0, + 0.3779547605663538, + 0.0, + 0.0, + 1.119159821420908, + 0.0, + 0.0, + 1.820119564399647e-06, + 0.0, + 0.04283946007490158, + 0.0, + 0.04346783831715584, + 0.0, + 0.03756798803806305, + 0.0, + 0.0, + 0.9047776181250811, + 0.42977054230868816 + ], + "unique_experts": 38, + "load_cv": 1.6031804238519256, + "normalized_load_entropy": 0.7679645708179822, + "max_load_share": 0.1111111111111111 + }, + "full_input": { + "tokens": 68, + "top_k": 6, + "decisions": 408, + "ordered_route_sha256": "4f3725294560bf18ac8eef4841b8ae941d3a988060ed9c862fa5ed995d1f8842", + "route_weight_sha256": "8932f20e9a5ed2431f24eaa8cd9e5e971d280f5786c0b8432fe1a60080ee541e", + "loads": [ + 0, + 0, + 6, + 4, + 2, + 7, + 1, + 13, + 11, + 3, + 7, + 2, + 3, + 0, + 5, + 0, + 2, + 0, + 4, + 23, + 22, + 6, + 9, + 8, + 29, + 0, + 3, + 1, + 28, + 6, + 1, + 4, + 0, + 9, + 5, + 8, + 12, + 5, + 1, + 1, + 6, + 7, + 11, + 3, + 5, + 3, + 0, + 10, + 0, + 0, + 11, + 13, + 8, + 7, + 3, + 3, + 0, + 1, + 16, + 1, + 3, + 23, + 13, + 10 + ], + "weighted_loads": [ + 0.0, + 0.0, + 0.33315477706491947, + 0.2926935516297817, + 0.06078419089317322, + 0.21338567521888763, + 0.03612834960222244, + 1.0747029446065426, + 0.7008492723107338, + 0.13117234036326408, + 0.31772297783754766, + 0.06701246462762356, + 0.06053226115182042, + 0.0, + 0.20978237688541412, + 0.0, + 0.03307865961528478, + 0.0, + 0.16934014111757278, + 1.6324515227033771, + 1.2909722216427326, + 0.3373274691402912, + 0.5090350471436977, + 0.4355847090482712, + 1.5919464477337897, + 0.0, + 0.1036267951130867, + 0.0382184274494648, + 1.734405169263482, + 0.3195750266313553, + 0.0710178092122078, + 0.13923365145706157, + 0.0, + 0.44661170092922475, + 0.16274872701615095, + 0.6143413707613945, + 0.8956790417432785, + 1.0613690838217735, + 0.05229971930384636, + 0.03698701411485672, + 0.45413074642419815, + 0.41717114113271236, + 0.4300647107884288, + 0.2468818798661232, + 0.40038619190454483, + 0.13014574348926544, + 0.0, + 0.8332078449893743, + 0.0, + 0.0, + 1.5492926202714443, + 0.909019447863102, + 0.25429792515933514, + 0.3638067751550125, + 0.20342805236577988, + 0.1401323862373829, + 0.0, + 0.04346783831715584, + 0.7095406111329794, + 0.03756798803806305, + 0.09608026966452599, + 2.027009343262762, + 1.27853274543304, + 1.483182555064559 + ], + "unique_experts": 53, + "load_cv": 1.0684025667313943, + "normalized_load_entropy": 0.8744088860925422, + "max_load_share": 0.07107843137254902 + } + }, + "s0_period": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "b421874345d0223ee2114a3a85a01467ccddc4d1abfaee9cb119d8f90402f5a6", + "route_weight_sha256": "34a325977075188b55f1ed368ca288110ef1c621dcbc2e736b779f864f37b7cd", + "loads": [ + 0, + 0, + 4, + 3, + 0, + 0, + 0, + 13, + 0, + 0, + 0, + 0, + 0, + 0, + 4, + 0, + 1, + 0, + 4, + 17, + 15, + 6, + 0, + 6, + 18, + 1, + 1, + 1, + 9, + 2, + 1, + 0, + 0, + 3, + 0, + 6, + 1, + 2, + 1, + 1, + 5, + 0, + 5, + 0, + 4, + 3, + 0, + 5, + 0, + 0, + 3, + 0, + 0, + 1, + 0, + 1, + 0, + 1, + 0, + 0, + 0, + 1, + 7, + 6 + ], + "weighted_loads": [ + 0.0, + 0.0, + 0.2744140774011612, + 0.1427612341940403, + 0.0, + 0.0, + 0.0, + 1.101797927170992, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.20166809484362602, + 0.0, + 0.025736860930919647, + 0.0, + 0.17970629036426544, + 1.473003901541233, + 0.9124176986515522, + 0.33929572999477386, + 0.0, + 0.411573838442564, + 1.246820481494069, + 0.03931349888443947, + 2.5144697701762198e-06, + 0.038988836109638214, + 0.7919564731419086, + 0.11891182139515877, + 0.0662144124507904, + 0.0, + 0.0, + 0.14752109559435667, + 0.0, + 0.49599883146584034, + 0.10656307637691498, + 0.12265578657388687, + 0.04706393554806709, + 0.03530491888523102, + 0.3753054179251194, + 0.0, + 0.22462673857808113, + 0.0, + 0.3330982141196728, + 0.0714007572587434, + 0.0, + 0.36340971663594246, + 0.0, + 0.0, + 1.1122698076069355, + 0.0, + 0.0, + 3.4399515698169125e-06, + 0.0, + 0.0430203340947628, + 0.0, + 0.03877202421426773, + 0.0, + 0.0, + 0.0, + 2.8368033326842124e-06, + 0.9496048018336296, + 0.4041152745485306 + ], + "unique_experts": 35, + "load_cv": 1.612281397013253, + "normalized_load_entropy": 0.7589842859603639, + "max_load_share": 0.1111111111111111 + }, + "full_input": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "f0a8434a343d5bc2f29f05d230c19b1f705e3aaddcb78ffa8aef0adc528ea4dd", + "route_weight_sha256": "fde92d8fe178ba6b1ba303e2a8ec5aae4a55ce5ea6bd0693734533ac6df53d28", + "loads": [ + 0, + 0, + 8, + 3, + 0, + 4, + 0, + 15, + 7, + 0, + 8, + 0, + 1, + 0, + 6, + 0, + 1, + 1, + 4, + 19, + 16, + 6, + 5, + 6, + 26, + 1, + 3, + 2, + 17, + 7, + 1, + 1, + 3, + 8, + 6, + 6, + 3, + 5, + 1, + 1, + 6, + 3, + 10, + 1, + 4, + 4, + 0, + 10, + 0, + 0, + 11, + 5, + 5, + 5, + 0, + 1, + 0, + 1, + 7, + 0, + 2, + 19, + 9, + 8 + ], + "weighted_loads": [ + 0.0, + 0.0, + 0.42494927905499935, + 0.1427612341940403, + 0.0, + 0.12886444490868598, + 0.0, + 1.1970276907086372, + 0.3466232381761074, + 0.0, + 0.3152189718093723, + 0.0, + 0.0027466181199997663, + 0.0, + 0.2601506244391203, + 0.0, + 0.025736860930919647, + 0.03323004022240639, + 0.17970629036426544, + 1.5791801996529102, + 0.9466246142983437, + 0.33929572999477386, + 0.30177347362041473, + 0.411573838442564, + 1.548485387582332, + 0.03931349888443947, + 0.07409619529857991, + 0.07948842644691467, + 1.1036166213452816, + 0.3204881027340889, + 0.0662144124507904, + 0.032193563878536224, + 0.1262046117335558, + 0.3685333023424846, + 0.21447688108310103, + 0.49599883146584034, + 0.2542202025651932, + 1.0513666793704033, + 0.04706393554806709, + 0.03530491888523102, + 0.4238096922636032, + 0.17247584089636803, + 0.41835704795084894, + 0.03853761777281761, + 0.3330982141196728, + 0.11941915688476001, + 0.0, + 0.7142949600238353, + 0.0, + 0.0, + 1.5591677986085415, + 0.40817857161164284, + 0.16663752868771553, + 0.1908262685126374, + 0.0, + 0.0430203340947628, + 0.0, + 0.03877202421426773, + 0.28812579810619354, + 0.0, + 0.07860913127660751, + 1.3215314978681363, + 0.9871071391971782, + 1.4198788292706013 + ], + "unique_experts": 50, + "load_cv": 1.1238260000415963, + "normalized_load_entropy": 0.860291244059403, + "max_load_share": 0.08333333333333333 + } + }, + "s1_period": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "eb4a309c935f4a435c926d3f3e84f60841831d5b7ac1657461ba19476a49f699", + "route_weight_sha256": "8fec822408de7343054c1366915c012bbf5375c35537a75adaacdb0ea98cd0e3", + "loads": [ + 0, + 0, + 6, + 3, + 0, + 0, + 1, + 15, + 0, + 0, + 0, + 0, + 0, + 0, + 2, + 0, + 0, + 0, + 4, + 18, + 16, + 6, + 0, + 7, + 14, + 0, + 0, + 1, + 8, + 1, + 1, + 1, + 0, + 3, + 0, + 5, + 3, + 2, + 1, + 1, + 5, + 0, + 7, + 0, + 4, + 2, + 0, + 5, + 0, + 1, + 3, + 0, + 0, + 1, + 0, + 1, + 0, + 1, + 0, + 1, + 0, + 0, + 6, + 6 + ], + "weighted_loads": [ + 0.0, + 0.0, + 0.34234496019780636, + 0.1820836253464222, + 0.0, + 0.0, + 0.0350547730922699, + 1.162608752027154, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.10554395243525505, + 0.0, + 0.0, + 0.0, + 0.16919974982738495, + 1.3862628529335552, + 1.0533096492290497, + 0.33700084313750267, + 0.0, + 0.4741010069847107, + 1.00174156203866, + 0.0, + 0.0, + 0.036064375191926956, + 0.7739461697638035, + 0.09366042166948318, + 0.08010119199752808, + 2.3487723410653416e-06, + 0.0, + 0.14291184475905538, + 0.0, + 0.4611511826515198, + 0.16202413849532604, + 0.11720635741949081, + 0.05272607505321503, + 0.035583022981882095, + 0.3564189784228802, + 0.0, + 0.28612040493987934, + 0.0, + 0.35534630715847015, + 0.08424883335828781, + 0.0, + 0.36197973787784576, + 0.0, + 0.055890537798404694, + 1.1160260178148746, + 0.0, + 0.0, + 1.6705653251847252e-06, + 0.0, + 0.043190862983465195, + 0.0, + 0.040052566677331924, + 0.0, + 0.03677290305495262, + 0.0, + 0.0, + 0.9172881692647934, + 0.39350246638059616 + ], + "unique_experts": 35, + "load_cv": 1.6107681390771855, + "normalized_load_entropy": 0.7581277595065173, + "max_load_share": 0.1111111111111111 + }, + "full_input": { + "tokens": 68, + "top_k": 6, + "decisions": 408, + "ordered_route_sha256": "aa51901ff4222d972c1a1e32fd4be717a7e48a0e316c9cdd492f7a2f65c1e40d", + "route_weight_sha256": "5e68189ae68095cea265691d0711b3b842f5f31a4eae92d175c9f91b4bf93320", + "loads": [ + 0, + 0, + 7, + 4, + 2, + 8, + 1, + 17, + 9, + 3, + 7, + 2, + 3, + 0, + 5, + 0, + 0, + 0, + 5, + 23, + 21, + 6, + 7, + 8, + 23, + 0, + 2, + 1, + 27, + 5, + 1, + 4, + 1, + 9, + 5, + 8, + 11, + 6, + 2, + 1, + 6, + 8, + 11, + 3, + 5, + 3, + 0, + 11, + 0, + 1, + 13, + 14, + 8, + 8, + 3, + 3, + 0, + 1, + 17, + 1, + 3, + 23, + 13, + 9 + ], + "weighted_loads": [ + 0.0, + 0.0, + 0.36815210059285164, + 0.2949071563780308, + 0.06078419089317322, + 0.2395466045709327, + 0.0350547730922699, + 1.2365570198744535, + 0.6183925680816174, + 0.13117234036326408, + 0.31772297783754766, + 0.06701246462762356, + 0.06053226115182042, + 0.0, + 0.19353973492980003, + 0.0, + 0.0, + 0.0, + 0.2021169178187847, + 1.5904593693579727, + 1.2731814607977867, + 0.33700084313750267, + 0.4408671949058771, + 0.49946530908346176, + 1.3278031260706484, + 0.0, + 0.07629578933119774, + 0.036064375191926956, + 1.7365799117833376, + 0.27764466404914856, + 0.08010119199752808, + 0.13923407529955512, + 0.03820163011550903, + 0.45001521414405943, + 0.17520240601152182, + 0.6038642786443233, + 0.7699241396039724, + 1.108680609613657, + 0.09272642433643341, + 0.035583022981882095, + 0.4697597734630108, + 0.4662621859461069, + 0.4006775603478445, + 0.2525850757956505, + 0.3937462493777275, + 0.144314993172884, + 0.0, + 0.8974726323504001, + 0.0, + 0.055890537798404694, + 1.625672411173582, + 0.9559275843203068, + 0.2542733196169138, + 0.39846823341758864, + 0.20342805236577988, + 0.1404837891459465, + 0.0, + 0.040052566677331924, + 0.7608003187924623, + 0.03677290305495262, + 0.0981021523475647, + 2.0646931692026556, + 1.2910432965727523, + 1.446914479136467 + ], + "unique_experts": 54, + "load_cv": 1.0295518112019668, + "normalized_load_entropy": 0.8793094714947673, + "max_load_share": 0.0661764705882353 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 27, + "ordered_topk_exact_tokens": 16, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.8862433862433863, + "mean_token_weighted_tv": 0.022266229240851015, + "aggregate_load_tv": 0.06790123456790123 + }, + "system_bos": { + "tokens": 27, + "ordered_topk_exact_tokens": 16, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.9153439153439153, + "mean_token_weighted_tv": 0.020091698772312663, + "aggregate_load_tv": 0.037037037037037035 + }, + "system_x": { + "tokens": 27, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 13, + "mean_set_jaccard": 0.8218694885361552, + "mean_token_weighted_tv": 0.03818527350833384, + "aggregate_load_tv": 0.08641975308641975 + }, + "system_period": { + "tokens": 27, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8403880070546736, + "mean_token_weighted_tv": 0.034383777946269824, + "aggregate_load_tv": 0.09259259259259259 + }, + "bos_at_s0": { + "tokens": 27, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.9074074074074076, + "mean_token_weighted_tv": 0.02657472179400126, + "aggregate_load_tv": 0.043209876543209874 + }, + "bos_at_s1": { + "tokens": 27, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.8756613756613758, + "mean_token_weighted_tv": 0.02859094214815101, + "aggregate_load_tv": 0.06172839506172839 + }, + "x_at_s0": { + "tokens": 27, + "ordered_topk_exact_tokens": 8, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.8650793650793652, + "mean_token_weighted_tv": 0.034322318747934295, + "aggregate_load_tv": 0.07407407407407407 + }, + "x_at_s1": { + "tokens": 27, + "ordered_topk_exact_tokens": 5, + "set_exact_tokens": 10, + "mean_set_jaccard": 0.7901234567901235, + "mean_token_weighted_tv": 0.047047856347024596, + "aggregate_load_tv": 0.08641975308641975 + }, + "period_at_s0": { + "tokens": 27, + "ordered_topk_exact_tokens": 8, + "set_exact_tokens": 12, + "mean_set_jaccard": 0.8333333333333334, + "mean_token_weighted_tv": 0.040658661090198486, + "aggregate_load_tv": 0.07407407407407407 + }, + "period_at_s1": { + "tokens": 27, + "ordered_topk_exact_tokens": 3, + "set_exact_tokens": 7, + "mean_set_jaccard": 0.7425044091710759, + "mean_token_weighted_tv": 0.05889482423427766, + "aggregate_load_tv": 0.13580246913580246 + } + } + }, + "layer_25": { + "layer": 25, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "4bdc951bcd65091b690822d4d987f7569fdec7a621a20115372792256e1cc97e", + "route_weight_sha256": "7405ff44ddc48a5148dc5f263dca0cc6912549cbd5cb12aec4555ba9c98c7929", + "loads": [ + 6, + 0, + 8, + 1, + 2, + 0, + 4, + 8, + 3, + 10, + 0, + 7, + 1, + 0, + 0, + 1, + 0, + 4, + 3, + 5, + 0, + 1, + 4, + 1, + 0, + 6, + 3, + 0, + 4, + 14, + 0, + 2, + 2, + 5, + 2, + 0, + 2, + 0, + 1, + 0, + 1, + 2, + 2, + 2, + 1, + 1, + 3, + 1, + 0, + 1, + 1, + 0, + 3, + 0, + 6, + 2, + 4, + 5, + 1, + 4, + 4, + 4, + 3, + 1 + ], + "weighted_loads": [ + 0.501550829038024, + 0.0, + 0.47528472170233727, + 0.0309189073741436, + 0.12952982634305954, + 0.0, + 0.2277146317064762, + 0.3999381624162197, + 0.2137029692530632, + 0.7282780092209578, + 0.0, + 0.3881368599832058, + 0.0819537341594696, + 0.0, + 0.0, + 0.048226241022348404, + 0.0, + 0.4096946492791176, + 0.13174081221222878, + 1.0294114500284195, + 0.0, + 0.04315732419490814, + 0.40496601164340973, + 0.04964049160480499, + 0.0, + 0.5032747741788626, + 0.15581699088215828, + 0.0, + 0.3923107385635376, + 0.6084925886243582, + 0.0, + 0.07834878005087376, + 0.10093702003359795, + 0.4582010842859745, + 0.05267619341611862, + 0.0, + 0.10730520263314247, + 0.0, + 0.028322886675596237, + 0.0, + 0.05776335299015045, + 0.06158455088734627, + 0.09001228213310242, + 0.1568889617919922, + 0.03844365105032921, + 0.044929713010787964, + 0.16012613475322723, + 0.10072457045316696, + 0.0, + 0.053021930158138275, + 0.04882026091217995, + 0.0, + 0.1493769884109497, + 0.0, + 0.3400689698755741, + 0.10993636772036552, + 0.17203499376773834, + 0.35728468745946884, + 0.03167062625288963, + 0.3247094042599201, + 0.2590808644890785, + 0.3819354623556137, + 0.2446388229727745, + 0.5136996507644653 + ], + "unique_experts": 48, + "load_cv": 1.0795941590429237, + "normalized_load_entropy": 0.867278183853862, + "max_load_share": 0.08641975308641975 + }, + "full_input": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "baac2d4720efebcf4ed235f61dda45f7980f2e0b8ecc885aab69141d21e52328", + "route_weight_sha256": "53f0818ffbc34de5d148a3166040ce7c6846259abf528c987385966e9e7ef5fd", + "loads": [ + 8, + 17, + 15, + 2, + 2, + 0, + 11, + 8, + 3, + 10, + 11, + 10, + 5, + 0, + 0, + 1, + 0, + 8, + 5, + 5, + 0, + 1, + 4, + 3, + 0, + 6, + 4, + 0, + 5, + 17, + 0, + 3, + 3, + 6, + 4, + 0, + 2, + 1, + 11, + 3, + 8, + 2, + 2, + 3, + 6, + 10, + 7, + 1, + 0, + 3, + 12, + 0, + 8, + 0, + 15, + 2, + 5, + 9, + 1, + 4, + 6, + 4, + 9, + 1 + ], + "weighted_loads": [ + 0.6096489373594522, + 1.2488158193882555, + 1.1179236322641373, + 0.08820664882659912, + 0.12952982634305954, + 0.0, + 0.7267075814306736, + 0.3999381624162197, + 0.2137029692530632, + 0.7282780092209578, + 1.0587569382041693, + 1.0046061766333878, + 0.3937217742204666, + 0.0, + 0.0, + 0.048226241022348404, + 0.0, + 0.5396118853241205, + 0.19755639508366585, + 1.0294114500284195, + 0.0, + 0.04315732419490814, + 0.40496601164340973, + 0.1434856504201889, + 0.0, + 0.5032747741788626, + 0.19723206385970116, + 0.0, + 0.4340987801551819, + 0.7155900131911039, + 0.0, + 0.16750133968889713, + 0.153554055839777, + 0.5179283618927002, + 0.1336972527205944, + 0.0, + 0.10730520263314247, + 0.037142448127269745, + 1.456319758668542, + 0.3413885496556759, + 0.34776260517537594, + 0.06158455088734627, + 0.09001228213310242, + 0.18958627805113792, + 0.3930039815604687, + 0.7894407976418734, + 0.29333913628943264, + 0.10072457045316696, + 0.0, + 0.13911153376102448, + 0.6939998492598534, + 0.0, + 0.41734805470332503, + 0.0, + 0.780580785125494, + 0.10993636772036552, + 0.2166551947593689, + 0.5595624670386314, + 0.03167062625288963, + 0.3247094042599201, + 0.3565598279237747, + 0.3819354623556137, + 0.6905506066977978, + 0.5136996507644653 + ], + "unique_experts": 52, + "load_cv": 0.9198662110077999, + "normalized_load_entropy": 0.8920645043584123, + "max_load_share": 0.05448717948717949 + } + }, + "s1_eos": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "bf2f8d8f3b2c41ab9c09cbe45c9634cf9a3df8d60c4476331b91535d08a426a4", + "route_weight_sha256": "3f9f6b04687a41fddd9c540463afc260bcca4f66149a898ad92213ca9657d538", + "loads": [ + 5, + 0, + 7, + 1, + 2, + 0, + 4, + 8, + 3, + 9, + 0, + 9, + 1, + 0, + 0, + 1, + 0, + 4, + 2, + 5, + 0, + 1, + 4, + 1, + 0, + 6, + 3, + 0, + 4, + 15, + 0, + 2, + 2, + 5, + 1, + 0, + 2, + 0, + 1, + 0, + 2, + 2, + 2, + 2, + 1, + 1, + 3, + 1, + 0, + 1, + 1, + 0, + 3, + 0, + 6, + 2, + 3, + 5, + 1, + 4, + 4, + 5, + 3, + 2 + ], + "weighted_loads": [ + 0.455892002210021, + 0.0, + 0.42611220479011536, + 0.03265431523323059, + 0.13329880684614182, + 0.0, + 0.23444123938679695, + 0.404007900506258, + 0.20499491319060326, + 0.6502266470342875, + 0.0, + 0.4536575600504875, + 0.0838291198015213, + 0.0, + 0.0, + 0.04416070878505707, + 0.0, + 0.40852998942136765, + 0.10104312002658844, + 0.9997090101242065, + 0.0, + 0.04131411761045456, + 0.4044055975973606, + 0.047535285353660583, + 0.0, + 0.5075008757412434, + 0.15948782861232758, + 0.0, + 0.39496204629540443, + 0.6496803108602762, + 0.0, + 0.07824322581291199, + 0.10917415469884872, + 0.45103083178400993, + 0.030653277412056923, + 0.0, + 0.11543887481093407, + 0.0, + 0.025242434814572334, + 0.0, + 0.0828114990144968, + 0.06228472292423248, + 0.09080895781517029, + 0.15398034080863, + 0.039342962205410004, + 0.04599754512310028, + 0.15224453061819077, + 0.11586400866508484, + 0.0, + 0.05450061336159706, + 0.04851336404681206, + 0.0, + 0.1580122970044613, + 0.0, + 0.3354763276875019, + 0.11081333458423615, + 0.14064934477210045, + 0.3711129315197468, + 0.0324956439435482, + 0.3073696605861187, + 0.2662851884961128, + 0.4085932970046997, + 0.249082051217556, + 0.5589699856936932 + ], + "unique_experts": 48, + "load_cv": 1.097516282590022, + "normalized_load_entropy": 0.866404454381685, + "max_load_share": 0.09259259259259259 + }, + "full_input": { + "tokens": 68, + "top_k": 6, + "decisions": 408, + "ordered_route_sha256": "d2c9d03602e2353ff113e5e8a1d3ab3ae127714423f77c15ed478b714e76adbc", + "route_weight_sha256": "bee2ff1d3670d0c0d20c5556c3ad7f5d6f3474bee441227b595da14ed115dcde", + "loads": [ + 8, + 23, + 18, + 2, + 2, + 1, + 12, + 8, + 5, + 10, + 23, + 13, + 9, + 0, + 0, + 2, + 0, + 11, + 4, + 6, + 3, + 8, + 4, + 6, + 0, + 6, + 4, + 0, + 6, + 18, + 0, + 5, + 7, + 6, + 2, + 0, + 3, + 6, + 10, + 5, + 10, + 3, + 3, + 3, + 9, + 15, + 6, + 1, + 0, + 3, + 14, + 0, + 10, + 7, + 18, + 3, + 5, + 11, + 1, + 5, + 8, + 6, + 8, + 3 + ], + "weighted_loads": [ + 0.7203839961439371, + 1.824957631295547, + 1.1694262474775314, + 0.09233541041612625, + 0.13329880684614182, + 0.03790271282196045, + 0.9563554413616657, + 0.404007900506258, + 0.3190384469926357, + 0.6787932049483061, + 2.076025515794754, + 1.1378818396478891, + 0.5793009623885155, + 0.0, + 0.0, + 0.0874502882361412, + 0.0, + 1.029131941497326, + 0.19466114044189453, + 1.0235670525580645, + 0.2564490884542465, + 0.6861180551350117, + 0.4044055975973606, + 0.2426576241850853, + 0.0, + 0.5075008757412434, + 0.1927185356616974, + 0.0, + 0.47182393446564674, + 0.7551013249903917, + 0.0, + 0.5530027449131012, + 0.3367221560329199, + 0.5013409070670605, + 0.08585402183234692, + 0.0, + 0.15712910890579224, + 0.2673142943531275, + 1.6782452370971441, + 0.4540484584867954, + 0.5073050316423178, + 0.09455179050564766, + 0.17729200422763824, + 0.18422339856624603, + 0.6561365872621536, + 1.283422440290451, + 0.23998894996475428, + 0.11586400866508484, + 0.0, + 0.14478213712573051, + 0.8051588125526905, + 0.0, + 0.5981044983491302, + 0.5073274672031403, + 1.1485143899917603, + 0.13717974536120892, + 0.22150810062885284, + 0.6593996174633503, + 0.0324956439435482, + 0.39347999915480614, + 0.5113029628992081, + 0.45174625515937805, + 0.6789724789559841, + 0.5838960893452168 + ], + "unique_experts": 55, + "load_cv": 0.8629678856731524, + "normalized_load_entropy": 0.9087199364853147, + "max_load_share": 0.056372549019607844 + } + }, + "s0_bos": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "43e572c5cb20466d9bcf2c8869c098fc8a460616a2c800a47319dd89280e0777", + "route_weight_sha256": "c689c901ad50deb1b36547660bfe0def6d62fb3f569bfc1b92082df5e8fabb2f", + "loads": [ + 5, + 0, + 6, + 1, + 2, + 0, + 4, + 8, + 3, + 9, + 0, + 9, + 1, + 0, + 0, + 1, + 0, + 4, + 2, + 5, + 0, + 1, + 4, + 1, + 0, + 6, + 3, + 0, + 4, + 14, + 0, + 2, + 2, + 5, + 1, + 0, + 2, + 0, + 1, + 0, + 2, + 2, + 2, + 2, + 1, + 1, + 3, + 1, + 0, + 1, + 1, + 0, + 3, + 0, + 6, + 3, + 5, + 5, + 1, + 4, + 4, + 4, + 3, + 2 + ], + "weighted_loads": [ + 0.46454585902392864, + 0.0, + 0.4019593149423599, + 0.03173006325960159, + 0.1379140168428421, + 0.0, + 0.24065107852220535, + 0.40511223301291466, + 0.18349315598607063, + 0.68488460034132, + 0.0, + 0.4533634912222624, + 0.09294385462999344, + 0.0, + 0.0, + 0.04859435185790062, + 0.0, + 0.3995341993868351, + 0.09972405806183815, + 1.0269666761159897, + 0.0, + 0.04677967727184296, + 0.3993498869240284, + 0.051144592463970184, + 0.0, + 0.5364372041076422, + 0.15689358487725258, + 0.0, + 0.40577514097094536, + 0.5691389795392752, + 0.0, + 0.09114672243595123, + 0.11261910200119019, + 0.459433414041996, + 0.030479853972792625, + 0.0, + 0.11267150938510895, + 0.0, + 0.02532879263162613, + 0.0, + 0.09054235555231571, + 0.06125510111451149, + 0.08821402862668037, + 0.1582237407565117, + 0.03996836766600609, + 0.04188229888677597, + 0.16865430027246475, + 0.11404797434806824, + 0.0, + 0.05903081223368645, + 0.04952935874462128, + 0.0, + 0.1608560010790825, + 0.0, + 0.3137122876942158, + 0.1510799489915371, + 0.21374350041151047, + 0.399073101580143, + 0.032267678529024124, + 0.31041285023093224, + 0.285488847643137, + 0.3806321993470192, + 0.2476361282169819, + 0.5764772146940231 + ], + "unique_experts": 48, + "load_cv": 1.063664614066766, + "normalized_load_entropy": 0.8699457089860035, + "max_load_share": 0.08641975308641975 + }, + "full_input": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "42c6ffb596500a09b859fe51e3f1ae81583ddbcde5622ea6e210f43cc78311bc", + "route_weight_sha256": "964fa0dec19fe8ddfa59f8048fa3b3293714a8827e5ccd74a2c31f50a18fd2df", + "loads": [ + 6, + 16, + 15, + 2, + 2, + 0, + 10, + 9, + 3, + 9, + 11, + 12, + 6, + 1, + 0, + 1, + 0, + 8, + 4, + 5, + 0, + 1, + 4, + 3, + 0, + 6, + 3, + 0, + 5, + 16, + 1, + 3, + 3, + 6, + 3, + 0, + 3, + 1, + 10, + 2, + 9, + 3, + 2, + 5, + 6, + 9, + 6, + 1, + 0, + 4, + 11, + 0, + 7, + 0, + 15, + 3, + 5, + 10, + 1, + 4, + 5, + 4, + 9, + 3 + ], + "weighted_loads": [ + 0.5184362102299929, + 1.1682964598294348, + 1.0536943525075912, + 0.15569838881492615, + 0.1379140168428421, + 0.0, + 0.6556532606482506, + 0.45372018218040466, + 0.18349315598607063, + 0.68488460034132, + 1.1332070510834455, + 1.1255997698754072, + 0.44810089096426964, + 0.0432264618575573, + 0.0, + 0.04859435185790062, + 0.0, + 0.529451435431838, + 0.15974100679159164, + 1.0269666761159897, + 0.0, + 0.04677967727184296, + 0.3993498869240284, + 0.1449897512793541, + 0.0, + 0.5364372041076422, + 0.15689358487725258, + 0.0, + 0.44756318256258965, + 0.6517802979797125, + 0.279623806476593, + 0.1802992820739746, + 0.16523613780736923, + 0.5191606916487217, + 0.16949295438826084, + 0.0, + 0.17236822098493576, + 0.06619702279567719, + 0.5438903328031301, + 0.4246882051229477, + 0.3795093894004822, + 0.10384609922766685, + 0.08821402862668037, + 0.25858333706855774, + 0.4099719002842903, + 0.7185078747570515, + 0.3213195130228996, + 0.11404797434806824, + 0.0, + 0.17396553233265877, + 0.6400213278830051, + 0.0, + 0.4246428534388542, + 0.0, + 0.7529874369502068, + 0.1510799489915371, + 0.21374350041151047, + 0.6160442270338535, + 0.032267678529024124, + 0.31041285023093224, + 0.33764098584651947, + 0.3806321993470192, + 0.6935479119420052, + 0.6078704856336117 + ], + "unique_experts": 54, + "load_cv": 0.8804248570968921, + "normalized_load_entropy": 0.9017628466946491, + "max_load_share": 0.05128205128205128 + } + }, + "s1_bos": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "2186d7ab28ab019f3e729be1d978537ce246de526b79ef699c7f466263e7d07d", + "route_weight_sha256": "e5beec95c7d1d8400c1c69e1f404abc93801febb0a42e54eaa84e06186b52d8a", + "loads": [ + 5, + 0, + 7, + 1, + 2, + 0, + 4, + 9, + 3, + 8, + 0, + 8, + 1, + 0, + 0, + 1, + 0, + 4, + 2, + 5, + 0, + 1, + 4, + 1, + 0, + 6, + 3, + 0, + 4, + 13, + 1, + 1, + 2, + 5, + 1, + 0, + 3, + 0, + 0, + 0, + 2, + 2, + 2, + 2, + 1, + 1, + 3, + 1, + 0, + 1, + 2, + 0, + 3, + 0, + 5, + 3, + 4, + 6, + 1, + 4, + 4, + 4, + 3, + 3 + ], + "weighted_loads": [ + 0.49251409992575645, + 0.0, + 0.4361076671630144, + 0.03349928557872772, + 0.14254923909902573, + 0.0, + 0.25452811270952225, + 0.43732402473688126, + 0.16616728529334068, + 0.6150026991963387, + 0.0, + 0.39663990028202534, + 0.09436342865228653, + 0.0, + 0.0, + 0.04548250138759613, + 0.0, + 0.41200271993875504, + 0.0958159901201725, + 1.0209965854883194, + 0.0, + 0.04171523079276085, + 0.3927709721028805, + 0.04822555556893349, + 0.0, + 0.5132504403591156, + 0.15622811019420624, + 0.0, + 0.39955243468284607, + 0.5389215089380741, + 0.02682528831064701, + 0.03406134620308876, + 0.12130287289619446, + 0.45490552484989166, + 0.030783887952566147, + 0.0, + 0.14268887415528297, + 0.0, + 0.0, + 0.0, + 0.08670152351260185, + 0.06290102191269398, + 0.08862311765551567, + 0.15494856610894203, + 0.04058462008833885, + 0.0473005548119545, + 0.16450093314051628, + 0.12095170468091965, + 0.0, + 0.060344696044921875, + 0.0951463133096695, + 0.0, + 0.1630811057984829, + 0.0, + 0.2782771475613117, + 0.16353436559438705, + 0.20575586333870888, + 0.45364971086382866, + 0.03383583948016167, + 0.3229655995965004, + 0.2923046872019768, + 0.3982248231768608, + 0.2529612258076668, + 0.6475867889821529 + ], + "unique_experts": 48, + "load_cv": 1.0286995829130017, + "normalized_load_entropy": 0.8737365871814631, + "max_load_share": 0.08024691358024691 + }, + "full_input": { + "tokens": 68, + "top_k": 6, + "decisions": 408, + "ordered_route_sha256": "3495d26df8ec587376e643dc3dc8d4c89c99d51fc878a392fef6490cd4b1b95d", + "route_weight_sha256": "4c566bb078d641f7f60b661421c518045eef0a298ad76907312f4d1601d01bef", + "loads": [ + 8, + 24, + 19, + 1, + 2, + 1, + 11, + 9, + 8, + 9, + 23, + 11, + 10, + 0, + 0, + 1, + 0, + 11, + 4, + 6, + 3, + 8, + 4, + 6, + 0, + 6, + 4, + 0, + 6, + 15, + 1, + 4, + 8, + 6, + 3, + 0, + 4, + 7, + 8, + 4, + 10, + 2, + 3, + 3, + 10, + 15, + 5, + 1, + 0, + 3, + 14, + 0, + 9, + 7, + 17, + 4, + 6, + 12, + 1, + 5, + 8, + 5, + 8, + 5 + ], + "weighted_loads": [ + 0.7362162545323372, + 1.7996272628661245, + 1.2473578844219446, + 0.03349928557872772, + 0.14254923909902573, + 0.03790271282196045, + 0.8480304405093193, + 0.43732402473688126, + 0.4159066155552864, + 0.6435692571103573, + 2.2316031120717525, + 1.0995164457708597, + 0.6612470112740993, + 0.0, + 0.0, + 0.04548250138759613, + 0.0, + 1.0326046720147133, + 0.18452563136816025, + 1.0448546279221773, + 0.2564490884542465, + 0.686519168317318, + 0.3927709721028805, + 0.2433478944003582, + 0.0, + 0.5132504403591156, + 0.18945881724357605, + 0.0, + 0.4764143228530884, + 0.6082218773663044, + 0.02682528831064701, + 0.508820865303278, + 0.398027615621686, + 0.5052156001329422, + 0.1479605846107006, + 0.0, + 0.18437910825014114, + 0.3215756881982088, + 0.7514205612242222, + 0.4451609030365944, + 0.4615354873239994, + 0.06290102191269398, + 0.17510616406798363, + 0.18519162386655807, + 0.7039860896766186, + 1.2136967182159424, + 0.2635146528482437, + 0.12095170468091965, + 0.0, + 0.14933449029922485, + 0.8174928165972233, + 0.0, + 0.5989776663482189, + 0.5073274672031403, + 1.0676928386092186, + 0.18990077637135983, + 0.29589102044701576, + 0.751222275197506, + 0.03383583948016167, + 0.40907593816518784, + 0.535600334405899, + 0.44137778133153915, + 0.6828516535460949, + 0.7068668007850647 + ], + "unique_experts": 56, + "load_cv": 0.8508538805391033, + "normalized_load_entropy": 0.9111765143102225, + "max_load_share": 0.058823529411764705 + } + }, + "s0_x": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "bd66aea3900ce6f942841da2444a980bfe56cc002bdfc038f72e6e891a570763", + "route_weight_sha256": "1d15ac731e70d4d44a2b2f322c1013b5149616235efdb5c78cc68da7e190af00", + "loads": [ + 5, + 0, + 8, + 1, + 2, + 0, + 4, + 8, + 3, + 8, + 0, + 9, + 1, + 0, + 0, + 0, + 0, + 4, + 2, + 5, + 0, + 1, + 4, + 1, + 0, + 6, + 3, + 0, + 4, + 13, + 1, + 2, + 2, + 5, + 1, + 0, + 2, + 0, + 0, + 0, + 2, + 1, + 2, + 2, + 1, + 1, + 3, + 2, + 0, + 1, + 1, + 0, + 4, + 0, + 6, + 3, + 4, + 5, + 0, + 4, + 4, + 5, + 3, + 3 + ], + "weighted_loads": [ + 0.4560551606118679, + 0.0, + 0.44322326220571995, + 0.03319206461310387, + 0.14718840643763542, + 0.0, + 0.24732065200805664, + 0.4194762706756592, + 0.1807691790163517, + 0.5682751629501581, + 0.0, + 0.4360162727534771, + 0.09289148449897766, + 0.0, + 0.0, + 0.0, + 0.0, + 0.38939789310097694, + 0.10056551173329353, + 1.0279583036899567, + 0.0, + 0.03793380782008171, + 0.40826835110783577, + 0.04853787645697594, + 0.0, + 0.5276951566338539, + 0.15288937091827393, + 0.0, + 0.3964502215385437, + 0.5519717875868082, + 0.029499704018235207, + 0.07433825358748436, + 0.10290808603167534, + 0.4545009322464466, + 0.02927497960627079, + 0.0, + 0.11559934914112091, + 0.0, + 0.0, + 0.0, + 0.08483028598129749, + 0.03067544661462307, + 0.08890722692012787, + 0.16168120503425598, + 0.03967028856277466, + 0.04311245307326317, + 0.16147244721651077, + 0.16280802711844444, + 0.0, + 0.06145374849438667, + 0.05010489746928215, + 0.0, + 0.19008410722017288, + 0.0, + 0.3175310231745243, + 0.16854337230324745, + 0.1973702646791935, + 0.4171745777130127, + 0.0, + 0.3076735846698284, + 0.2860807217657566, + 0.44799162074923515, + 0.2575484439730644, + 0.621019434183836 + ], + "unique_experts": 46, + "load_cv": 1.0567641625979367, + "normalized_load_entropy": 0.8650448371653039, + "max_load_share": 0.08024691358024691 + }, + "full_input": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "5049c0035f72f63dd2de2d75923d990f4887ed6af5f3ac7b1786c532ebe0af33", + "route_weight_sha256": "d8a38ae2509ee89f0b67ad07ca15249c6d3b998d5171b635b5fd18f5aec3e78a", + "loads": [ + 7, + 18, + 15, + 2, + 2, + 0, + 12, + 8, + 3, + 8, + 11, + 12, + 5, + 1, + 0, + 0, + 0, + 8, + 5, + 5, + 0, + 1, + 4, + 3, + 0, + 6, + 3, + 0, + 5, + 15, + 1, + 4, + 3, + 6, + 2, + 0, + 3, + 1, + 10, + 2, + 10, + 1, + 2, + 3, + 6, + 9, + 6, + 2, + 1, + 2, + 11, + 0, + 9, + 0, + 15, + 3, + 5, + 9, + 0, + 4, + 5, + 5, + 10, + 3 + ], + "weighted_loads": [ + 0.5461697466671467, + 1.336920473491773, + 0.9447886142879725, + 0.0678347535431385, + 0.14718840643763542, + 0.0, + 0.7850443571805954, + 0.4194762706756592, + 0.1807691790163517, + 0.5682751629501581, + 1.1179633978754282, + 1.1328164972364902, + 0.39234548434615135, + 0.044985584914684296, + 0.0, + 0.0, + 0.0, + 0.5193151291459799, + 0.18948004208505154, + 1.0279583036899567, + 0.0, + 0.03793380782008171, + 0.40826835110783577, + 0.14238303527235985, + 0.0, + 0.5276951566338539, + 0.15288937091827393, + 0.0, + 0.438238263130188, + 0.616725942119956, + 0.029499704018235207, + 0.25754189118742943, + 0.15552512183785439, + 0.5142282098531723, + 0.10645424760878086, + 0.0, + 0.17394939810037613, + 0.05322958156466484, + 0.6349997576326132, + 0.4026671200990677, + 0.45636942610144615, + 0.03067544661462307, + 0.08890722692012787, + 0.19437852129340172, + 0.4106856621801853, + 0.7377299964427948, + 0.3091869167983532, + 0.16280802711844444, + 0.04150460660457611, + 0.09403091296553612, + 0.640596866607666, + 0.0, + 0.5680197924375534, + 0.0, + 0.7755806148052216, + 0.16854337230324745, + 0.2417171709239483, + 0.5868453476577997, + 0.0, + 0.3076735846698284, + 0.3382328599691391, + 0.44799162074923515, + 0.741951085627079, + 0.621019434183836 + ], + "unique_experts": 53, + "load_cv": 0.9119702176296789, + "normalized_load_entropy": 0.895185461609887, + "max_load_share": 0.057692307692307696 + } + }, + "s1_x": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "38dd67448c90cd40f34549bb2d1cc533c1107f0239079ecfe823afeb6110bea8", + "route_weight_sha256": "437d6f609001a57432763cc5eca8b1c36fae84f9b2d9f4234d122a71167d8cf8", + "loads": [ + 6, + 0, + 7, + 1, + 2, + 0, + 4, + 9, + 3, + 9, + 1, + 6, + 1, + 0, + 0, + 1, + 0, + 4, + 1, + 5, + 0, + 1, + 4, + 1, + 0, + 5, + 3, + 0, + 4, + 14, + 1, + 2, + 2, + 5, + 1, + 0, + 3, + 0, + 0, + 0, + 3, + 2, + 2, + 2, + 1, + 0, + 3, + 2, + 0, + 1, + 2, + 0, + 3, + 0, + 5, + 3, + 3, + 5, + 1, + 4, + 4, + 4, + 3, + 3 + ], + "weighted_loads": [ + 0.5080511849373579, + 0.0, + 0.41744619607925415, + 0.034129753708839417, + 0.15444740280508995, + 0.0, + 0.2552764154970646, + 0.4824739210307598, + 0.12564941123127937, + 0.5742467530071735, + 0.02874940261244774, + 0.33025190234184265, + 0.09527764469385147, + 0.0, + 0.0, + 0.04042067378759384, + 0.0, + 0.4148007780313492, + 0.04953225329518318, + 1.0287530422210693, + 0.0, + 0.03582752123475075, + 0.39284835010766983, + 0.055446963757276535, + 0.0, + 0.4816374722868204, + 0.1522076241672039, + 0.0, + 0.3961656801402569, + 0.5735806599259377, + 0.028708869591355324, + 0.07144090533256531, + 0.11488362401723862, + 0.44899867847561836, + 0.027413679286837578, + 0.0, + 0.1543654501438141, + 0.0, + 0.0, + 0.0, + 0.13894793391227722, + 0.05682876892387867, + 0.08986082300543785, + 0.15634092316031456, + 0.03715662658214569, + 0.0, + 0.1472107470035553, + 0.18608449772000313, + 0.0, + 0.0570807047188282, + 0.09670847281813622, + 0.0, + 0.16536178067326546, + 0.0, + 0.27535004913806915, + 0.17530624568462372, + 0.19682000577449799, + 0.41872718557715416, + 0.030804099515080452, + 0.28094180300831795, + 0.30405812710523605, + 0.39581338688731194, + 0.2506563402712345, + 0.6523955650627613 + ], + "unique_experts": 48, + "load_cv": 1.035787018528359, + "normalized_load_entropy": 0.874923837114882, + "max_load_share": 0.08641975308641975 + }, + "full_input": { + "tokens": 68, + "top_k": 6, + "decisions": 408, + "ordered_route_sha256": "3aa059b0746148204ea4c2e10f357aa61c7e1a0f385fa4fbda2c95cb01c285af", + "route_weight_sha256": "0a6d1bc49db5cae5fc2f0cb43d25160d2ac592ebe80fe06885cd255980d73135", + "loads": [ + 8, + 25, + 18, + 1, + 2, + 1, + 14, + 9, + 5, + 10, + 25, + 9, + 8, + 0, + 0, + 1, + 0, + 12, + 3, + 6, + 3, + 8, + 4, + 7, + 0, + 5, + 4, + 0, + 6, + 16, + 1, + 6, + 7, + 6, + 3, + 0, + 4, + 6, + 9, + 4, + 11, + 2, + 3, + 3, + 11, + 13, + 5, + 2, + 0, + 2, + 16, + 0, + 11, + 7, + 17, + 4, + 4, + 11, + 1, + 5, + 7, + 5, + 8, + 4 + ], + "weighted_loads": [ + 0.7037342209368944, + 1.9096831602510065, + 1.0709661357104778, + 0.034129753708839417, + 0.15444740280508995, + 0.03790271282196045, + 1.1257446147501469, + 0.4824739210307598, + 0.23969294503331184, + 0.6028133109211922, + 2.2186101637780666, + 1.0074013024568558, + 0.5276522189378738, + 0.0, + 0.0, + 0.04042067378759384, + 0.0, + 1.0822170935571194, + 0.13931971043348312, + 1.0526110846549273, + 0.2564490884542465, + 0.6806314587593079, + 0.39284835010766983, + 0.2911475822329521, + 0.0, + 0.4816374722868204, + 0.18543833121657372, + 0.0, + 0.4730275683104992, + 0.6428810283541679, + 0.028708869591355324, + 0.6504100635647774, + 0.3424316253513098, + 0.4993087537586689, + 0.12418354861438274, + 0.0, + 0.19605568423867226, + 0.26228112168610096, + 0.8134624771773815, + 0.4423457086086273, + 0.5399203449487686, + 0.05682876892387867, + 0.1763438694179058, + 0.1865839809179306, + 0.7223343700170517, + 1.1420937590301037, + 0.27816833928227425, + 0.18608449772000313, + 0.0, + 0.08943329751491547, + 0.9601466506719589, + 0.0, + 0.7589506171643734, + 0.5073274672031403, + 1.1292703486979008, + 0.2016726564615965, + 0.2267063930630684, + 0.6819358728826046, + 0.030804099515080452, + 0.3670521415770054, + 0.4872084781527519, + 0.4389663450419903, + 0.6805467680096626, + 0.6773216687142849 + ], + "unique_experts": 56, + "load_cv": 0.8866995336937266, + "normalized_load_entropy": 0.9069376129595654, + "max_load_share": 0.061274509803921566 + } + }, + "s0_period": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "0a36251af375d9a88e26593d0f62513a21ebe5b045f6dc7406cb694a3d1f0686", + "route_weight_sha256": "9629bc2839507cc0ba0c3cd7fdcb49f2948ac71abbcad2a440e430bd522ad90e", + "loads": [ + 6, + 0, + 7, + 1, + 2, + 0, + 4, + 9, + 3, + 10, + 0, + 9, + 1, + 0, + 0, + 1, + 0, + 4, + 2, + 5, + 0, + 1, + 4, + 1, + 0, + 6, + 3, + 0, + 4, + 13, + 1, + 2, + 1, + 5, + 1, + 0, + 2, + 0, + 0, + 0, + 2, + 1, + 2, + 2, + 1, + 1, + 4, + 1, + 0, + 1, + 1, + 0, + 3, + 0, + 5, + 3, + 3, + 5, + 1, + 4, + 4, + 5, + 3, + 2 + ], + "weighted_loads": [ + 0.510868864133954, + 0.0, + 0.42181343026459217, + 0.034789279103279114, + 0.14758165180683136, + 0.0, + 0.2547443173825741, + 0.460904810577631, + 0.15550727769732475, + 0.6982262041419744, + 0.0, + 0.4373621940612793, + 0.09808901697397232, + 0.0, + 0.0, + 0.04335998743772507, + 0.0, + 0.4103922173380852, + 0.09866276010870934, + 1.0405970960855484, + 0.0, + 0.040849898010492325, + 0.40988558903336525, + 0.04977909475564957, + 0.0, + 0.5542599856853485, + 0.15315493941307068, + 0.0, + 0.39429857581853867, + 0.5248401928693056, + 0.02561887353658676, + 0.07513300888240337, + 0.057262204587459564, + 0.4506114274263382, + 0.02934448979794979, + 0.0, + 0.11036388948559761, + 0.0, + 0.0, + 0.0, + 0.08122772350907326, + 0.029913492500782013, + 0.08913515135645866, + 0.1593419499695301, + 0.03987877070903778, + 0.043158240616321564, + 0.19030800834298134, + 0.11995192617177963, + 0.0, + 0.06000668928027153, + 0.04788646847009659, + 0.0, + 0.1649017259478569, + 0.0, + 0.26859742030501366, + 0.16470805183053017, + 0.16234157979488373, + 0.42529547959566116, + 0.0323406346142292, + 0.29907581955194473, + 0.2921196259558201, + 0.4646364860236645, + 0.249062430113554, + 0.588178277015686 + ], + "unique_experts": 48, + "load_cv": 1.081850661380038, + "normalized_load_entropy": 0.86566202809508, + "max_load_share": 0.08024691358024691 + }, + "full_input": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "b554bf305181078688a1715d7d95f6797b16efd9fee8516ea0dcb9fccc841267", + "route_weight_sha256": "52b9f48a3134ea0d37dab2d52895a5bde38f48e0fd7065b8456de20e7e72df40", + "loads": [ + 8, + 18, + 15, + 1, + 2, + 0, + 10, + 9, + 3, + 10, + 12, + 12, + 6, + 1, + 0, + 2, + 0, + 8, + 4, + 5, + 0, + 1, + 4, + 3, + 0, + 6, + 3, + 0, + 5, + 16, + 1, + 3, + 2, + 6, + 3, + 0, + 3, + 1, + 9, + 2, + 9, + 1, + 2, + 3, + 6, + 10, + 7, + 1, + 0, + 2, + 11, + 0, + 8, + 0, + 14, + 3, + 3, + 10, + 1, + 4, + 6, + 5, + 9, + 3 + ], + "weighted_loads": [ + 0.6172276083379984, + 1.3725458530243486, + 0.9548848550766706, + 0.034789279103279114, + 0.14758165180683136, + 0.0, + 0.6697464995086193, + 0.460904810577631, + 0.15550727769732475, + 0.6982262041419744, + 1.1844806466251612, + 1.1288580819964409, + 0.4364343248307705, + 0.03849209100008011, + 0.0, + 0.08131551370024681, + 0.0, + 0.5403094533830881, + 0.15646987780928612, + 1.0405970960855484, + 0.0, + 0.040849898010492325, + 0.40988558903336525, + 0.14362425357103348, + 0.0, + 0.5542599856853485, + 0.15315493941307068, + 0.0, + 0.43608661741018295, + 0.6426906529814005, + 0.02561887353658676, + 0.16428556852042675, + 0.10987924039363861, + 0.5103387050330639, + 0.1377428900450468, + 0.0, + 0.18886645510792732, + 0.0493684858083725, + 0.518561540171504, + 0.4577599912881851, + 0.3917053695768118, + 0.029913492500782013, + 0.08913515135645866, + 0.19203926622867584, + 0.40390968322753906, + 0.8621300123631954, + 0.3413899578154087, + 0.11995192617177963, + 0.0, + 0.10590236634016037, + 0.6383784376084805, + 0.0, + 0.47040435671806335, + 0.0, + 0.6910270042717457, + 0.16470805183053017, + 0.16234157979488373, + 0.6239673979580402, + 0.0323406346142292, + 0.29907581955194473, + 0.391281571239233, + 0.4646364860236645, + 0.6949742138385773, + 0.710538886487484 + ], + "unique_experts": 54, + "load_cv": 0.917002807294752, + "normalized_load_entropy": 0.8949866916802388, + "max_load_share": 0.057692307692307696 + } + }, + "s1_period": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "6c55ca3c971fe58b32feeff30049264b9e21f74a35ec18915a4c9b5340208ae6", + "route_weight_sha256": "4d6a864992d2aca07bcc7f6510f956ca62bf5bdfd5860d9b0f85e2119e9ca269", + "loads": [ + 6, + 0, + 7, + 1, + 3, + 0, + 4, + 8, + 3, + 8, + 0, + 6, + 1, + 0, + 0, + 0, + 0, + 4, + 2, + 5, + 0, + 2, + 4, + 1, + 0, + 6, + 3, + 0, + 4, + 14, + 1, + 2, + 2, + 5, + 1, + 0, + 2, + 0, + 0, + 0, + 2, + 1, + 2, + 2, + 1, + 1, + 3, + 2, + 0, + 1, + 1, + 0, + 4, + 0, + 5, + 3, + 3, + 6, + 1, + 4, + 4, + 5, + 3, + 3 + ], + "weighted_loads": [ + 0.5065302439033985, + 0.0, + 0.4233187697827816, + 0.03971552848815918, + 0.1950458399951458, + 0.0, + 0.26550713181495667, + 0.47400257363915443, + 0.12188881635665894, + 0.5807484798133373, + 0.0, + 0.33832769095897675, + 0.09363122284412384, + 0.0, + 0.0, + 0.0, + 0.0, + 0.40942636132240295, + 0.08665359765291214, + 1.0436812192201614, + 0.0, + 0.06303703039884567, + 0.39849356934428215, + 0.05289293825626373, + 0.0, + 0.5641269870102406, + 0.15628283470869064, + 0.0, + 0.4083099104464054, + 0.5377782341092825, + 0.025321803987026215, + 0.06912843883037567, + 0.11593303084373474, + 0.4733373001217842, + 0.028492722660303116, + 0.0, + 0.1217724084854126, + 0.0, + 0.0, + 0.0, + 0.09171845763921738, + 0.026942487806081772, + 0.08749239146709442, + 0.15378718823194504, + 0.03663952648639679, + 0.0397929847240448, + 0.1368505209684372, + 0.17027434892952442, + 0.0, + 0.05963918939232826, + 0.050157200545072556, + 0.0, + 0.18643048033118248, + 0.0, + 0.24436163902282715, + 0.18461886048316956, + 0.21003861725330353, + 0.46691399440169334, + 0.031735893338918686, + 0.2723487690091133, + 0.3225887194275856, + 0.44225364178419113, + 0.2520748972892761, + 0.6670126691460609 + ], + "unique_experts": 47, + "load_cv": 1.0334299407618492, + "normalized_load_entropy": 0.8720004991478774, + "max_load_share": 0.08641975308641975 + }, + "full_input": { + "tokens": 68, + "top_k": 6, + "decisions": 408, + "ordered_route_sha256": "2334ae19a57587ad68d17b42c4d2943165ab2c3bfb489db34bb8efc3949b2424", + "route_weight_sha256": "51222242e5e71e16e5c2a22314c3906e103da29b0e8157d3debef8b684658398", + "loads": [ + 9, + 26, + 17, + 1, + 3, + 1, + 12, + 8, + 5, + 9, + 23, + 8, + 9, + 0, + 0, + 1, + 0, + 11, + 4, + 6, + 3, + 9, + 4, + 6, + 0, + 6, + 4, + 0, + 6, + 16, + 1, + 5, + 7, + 7, + 4, + 0, + 3, + 7, + 8, + 4, + 9, + 2, + 3, + 3, + 12, + 17, + 5, + 2, + 0, + 1, + 13, + 0, + 11, + 7, + 17, + 4, + 5, + 11, + 1, + 5, + 8, + 6, + 8, + 5 + ], + "weighted_loads": [ + 0.7695223018527031, + 2.028331868117675, + 1.0298812575638294, + 0.03971552848815918, + 0.1950458399951458, + 0.03790271282196045, + 0.9317605420947075, + 0.47400257363915443, + 0.2359323501586914, + 0.609315037727356, + 2.177707877010107, + 0.9780457988381386, + 0.5223079062998295, + 0.0, + 0.0, + 0.048597536981105804, + 0.0, + 1.0300283133983612, + 0.17768412083387375, + 1.0675392616540194, + 0.2564490884542465, + 0.7078409679234028, + 0.39849356934428215, + 0.24801527708768845, + 0.0, + 0.5641269870102406, + 0.18951354175806046, + 0.0, + 0.4851717986166477, + 0.6070786025375128, + 0.025321803987026215, + 0.5438879579305649, + 0.3434810321778059, + 0.563167642802, + 0.17396987974643707, + 0.0, + 0.16346264258027077, + 0.2872468885034323, + 0.7514205612242222, + 0.46811680495738983, + 0.4334644488990307, + 0.0691041350364685, + 0.17397543787956238, + 0.18403024598956108, + 0.8028039988130331, + 1.3279875945299864, + 0.25802940502762794, + 0.17027434892952442, + 0.0, + 0.05963918939232826, + 0.7725037038326263, + 0.0, + 0.6789029091596603, + 0.5073274672031403, + 1.021200530230999, + 0.21098527126014233, + 0.3051021322607994, + 0.6878993138670921, + 0.031735893338918686, + 0.35845910757780075, + 0.5508561283349991, + 0.4854065999388695, + 0.6819653250277042, + 0.9054297804832458 + ], + "unique_experts": 56, + "load_cv": 0.866524697803308, + "normalized_load_entropy": 0.9097613557720019, + "max_load_share": 0.06372549019607843 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 27, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.9153439153439153, + "mean_token_weighted_tv": 0.019452863717796625, + "aggregate_load_tv": 0.037037037037037035 + }, + "system_bos": { + "tokens": 27, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.8941798941798943, + "mean_token_weighted_tv": 0.02370523599286874, + "aggregate_load_tv": 0.043209876543209874 + }, + "system_x": { + "tokens": 27, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.8800705467372134, + "mean_token_weighted_tv": 0.03271632293170249, + "aggregate_load_tv": 0.06790123456790123 + }, + "system_period": { + "tokens": 27, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.9074074074074074, + "mean_token_weighted_tv": 0.03093550347343639, + "aggregate_load_tv": 0.04938271604938271 + }, + "bos_at_s0": { + "tokens": 27, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.8994708994708995, + "mean_token_weighted_tv": 0.026956443191954383, + "aggregate_load_tv": 0.037037037037037035 + }, + "bos_at_s1": { + "tokens": 27, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 18, + "mean_set_jaccard": 0.9047619047619047, + "mean_token_weighted_tv": 0.028415154320774256, + "aggregate_load_tv": 0.04938271604938271 + }, + "x_at_s0": { + "tokens": 27, + "ordered_topk_exact_tokens": 6, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.857142857142857, + "mean_token_weighted_tv": 0.03553101130657726, + "aggregate_load_tv": 0.06172839506172839 + }, + "x_at_s1": { + "tokens": 27, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.8721340388007056, + "mean_token_weighted_tv": 0.042963250850637756, + "aggregate_load_tv": 0.06172839506172839 + }, + "period_at_s0": { + "tokens": 27, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.8994708994708994, + "mean_token_weighted_tv": 0.032874864940014153, + "aggregate_load_tv": 0.05555555555555555 + }, + "period_at_s1": { + "tokens": 27, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.8800705467372134, + "mean_token_weighted_tv": 0.04669881336115025, + "aggregate_load_tv": 0.05555555555555555 + } + } + }, + "layer_26": { + "layer": 26, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "9966cdd8489b4c67729d906ee20df597423f0d435ae547ed5a1fdc89fa5f0726", + "route_weight_sha256": "92edcdfa1d712f92cbf6d7983c6133d23bb8da1ba354c71908930119780771ab", + "loads": [ + 1, + 1, + 2, + 1, + 4, + 0, + 0, + 1, + 3, + 2, + 3, + 2, + 0, + 7, + 6, + 6, + 2, + 4, + 6, + 0, + 0, + 3, + 0, + 0, + 5, + 3, + 2, + 1, + 1, + 2, + 2, + 2, + 3, + 0, + 3, + 4, + 9, + 1, + 3, + 1, + 3, + 1, + 5, + 2, + 0, + 16, + 1, + 0, + 0, + 0, + 1, + 0, + 0, + 1, + 2, + 0, + 8, + 2, + 4, + 6, + 0, + 2, + 9, + 3 + ], + "weighted_loads": [ + 0.09749194234609604, + 0.061244476586580276, + 0.06688918732106686, + 0.04612196236848831, + 0.33366600424051285, + 0.0, + 0.0, + 0.04683308303356171, + 0.29720185324549675, + 0.05906614102423191, + 0.20936879143118858, + 0.07812005467712879, + 0.0, + 0.8891152776777744, + 0.6236628405749798, + 0.7382183652371168, + 0.13152075558900833, + 0.35583943128585815, + 0.3295232988893986, + 0.0, + 0.0, + 0.3667312227189541, + 0.0, + 0.0, + 0.3016284257173538, + 0.2150009162724018, + 0.06827607937157154, + 0.10721798241138458, + 0.06370850652456284, + 0.051780613139271736, + 0.09526066109538078, + 0.17900219559669495, + 0.12947360426187515, + 0.0, + 0.08929478842765093, + 0.5183401256799698, + 0.5796638615429401, + 0.02841070480644703, + 0.21219104155898094, + 0.030164005234837532, + 0.24346039071679115, + 0.03793617710471153, + 0.16394236870110035, + 0.06912031769752502, + 0.0, + 1.6735797636210918, + 0.04738779738545418, + 0.0, + 0.0, + 0.0, + 0.07041575759649277, + 0.0, + 0.0, + 0.05952247977256775, + 0.10144596919417381, + 0.0, + 0.5282986704260111, + 0.0671798512339592, + 0.20904326438903809, + 0.39593867771327496, + 0.0, + 0.24205587059259415, + 0.5170907266438007, + 0.915145380422473 + ], + "unique_experts": 48, + "load_cv": 1.1260315090196118, + "normalized_load_entropy": 0.8644991743840451, + "max_load_share": 0.09876543209876543 + }, + "full_input": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "58e1b4ea93ca6713af5a4ac71a56dbcc5d29967cf0f15981224810087fc02b34", + "route_weight_sha256": "d2ffdb3d63c56667651a0ef4215a747d4dbc243548ef02dad7262f1b784ce315", + "loads": [ + 1, + 2, + 2, + 3, + 4, + 0, + 1, + 2, + 3, + 6, + 7, + 7, + 1, + 8, + 22, + 8, + 2, + 15, + 6, + 0, + 0, + 4, + 0, + 0, + 9, + 3, + 8, + 7, + 1, + 2, + 9, + 2, + 7, + 0, + 8, + 4, + 14, + 1, + 3, + 1, + 3, + 1, + 6, + 6, + 2, + 16, + 5, + 0, + 1, + 1, + 9, + 1, + 3, + 1, + 3, + 0, + 24, + 12, + 10, + 7, + 1, + 2, + 10, + 5 + ], + "weighted_loads": [ + 0.09749194234609604, + 0.10782567784190178, + 0.06688918732106686, + 0.12952100113034248, + 0.33366600424051285, + 0.0, + 0.037125829607248306, + 0.08770095184445381, + 0.29720185324549675, + 0.27667136676609516, + 0.5046278908848763, + 0.37818651483394206, + 0.20501627027988434, + 0.9503314457833767, + 1.3428920009173453, + 0.8365476820617914, + 0.13152075558900833, + 1.1160433419281617, + 0.3295232988893986, + 0.0, + 0.0, + 0.39939795434474945, + 0.0, + 0.0, + 0.5220635570585728, + 0.2150009162724018, + 0.9867795277386904, + 0.3553813714534044, + 0.06370850652456284, + 0.051780613139271736, + 0.9744636341929436, + 0.17900219559669495, + 0.27723378501832485, + 0.0, + 0.5506464364007115, + 0.5183401256799698, + 0.853558287024498, + 0.02841070480644703, + 0.21219104155898094, + 0.030164005234837532, + 0.24346039071679115, + 0.03793617710471153, + 0.19370479881763458, + 0.33298441395163536, + 0.07760751992464066, + 1.6735797636210918, + 0.2620193101465702, + 0.0, + 0.04228069633245468, + 0.9863508343696594, + 0.41978441178798676, + 0.07830802351236343, + 0.3515675514936447, + 0.05952247977256775, + 0.1487509086728096, + 0.0, + 1.6693104282021523, + 0.5150904688052833, + 0.4424370378255844, + 0.4457783829420805, + 0.000806942698545754, + 0.24205587059259415, + 0.5577881932258606, + 1.013300834223628 + ], + "unique_experts": 56, + "load_cv": 1.0424898128336473, + "normalized_load_entropy": 0.8830910609594411, + "max_load_share": 0.07692307692307693 + } + }, + "s1_eos": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "554c16a46aca2d6917238a7365d1817c867e5027c9688ba3e0f7916fefa053b1", + "route_weight_sha256": "7a4d58d53dab7f47b75d8bd0d25f8b84d8c7a4530d4876cd3d62cd90f3c6239a", + "loads": [ + 1, + 1, + 2, + 1, + 4, + 0, + 0, + 1, + 3, + 3, + 3, + 1, + 0, + 7, + 6, + 6, + 2, + 4, + 5, + 0, + 0, + 3, + 0, + 0, + 5, + 3, + 2, + 1, + 1, + 2, + 2, + 3, + 2, + 0, + 3, + 5, + 9, + 1, + 3, + 1, + 3, + 1, + 4, + 2, + 0, + 16, + 1, + 0, + 0, + 1, + 1, + 0, + 0, + 1, + 2, + 0, + 8, + 2, + 4, + 6, + 0, + 2, + 8, + 4 + ], + "weighted_loads": [ + 0.10169415920972824, + 0.060632359236478806, + 0.06715472973883152, + 0.04600633308291435, + 0.32356613501906395, + 0.0, + 0.0, + 0.043573275208473206, + 0.29621797427535057, + 0.0886810477823019, + 0.2000514231622219, + 0.055527135729789734, + 0.0, + 0.8781710006296635, + 0.6207553818821907, + 0.7562411744147539, + 0.12857620790600777, + 0.36300618946552277, + 0.30139478109776974, + 0.0, + 0.0, + 0.35369737446308136, + 0.0, + 0.0, + 0.3027704618871212, + 0.214495949447155, + 0.0683388989418745, + 0.11368048191070557, + 0.06143302097916603, + 0.053210762329399586, + 0.09923119097948074, + 0.2097785696387291, + 0.09552363306283951, + 0.0, + 0.08691662363708019, + 0.5495398081839085, + 0.6089432649314404, + 0.029521625488996506, + 0.21723498404026031, + 0.035426922142505646, + 0.2556918263435364, + 0.03942277282476425, + 0.13019616156816483, + 0.06747179292142391, + 0.0, + 1.6428462490439415, + 0.04670359939336777, + 0.0, + 0.0, + 0.032457396388053894, + 0.06606926023960114, + 0.0, + 0.0, + 0.062400829046964645, + 0.10593484714627266, + 0.0, + 0.5324496608227491, + 0.07010474987328053, + 0.20165730640292168, + 0.3902215827256441, + 0.0, + 0.24862797930836678, + 0.4948324793949723, + 0.9442498367279768 + ], + "unique_experts": 49, + "load_cv": 1.1063684791720763, + "normalized_load_entropy": 0.8690562315269165, + "max_load_share": 0.09876543209876543 + }, + "full_input": { + "tokens": 68, + "top_k": 6, + "decisions": 408, + "ordered_route_sha256": "665f80f566cce48c219c74433d7907cd45286e8c4c1dcb5f8dea59ba8c235eee", + "route_weight_sha256": "abdfb2a72fcd321a3fccae2c056983be84d27bcae2903243b8ff75afc143b55a", + "loads": [ + 2, + 2, + 2, + 3, + 7, + 0, + 1, + 2, + 3, + 9, + 10, + 8, + 1, + 8, + 22, + 11, + 2, + 11, + 6, + 0, + 0, + 9, + 7, + 0, + 12, + 5, + 14, + 12, + 1, + 5, + 11, + 4, + 8, + 0, + 11, + 5, + 22, + 6, + 6, + 2, + 4, + 1, + 5, + 7, + 1, + 17, + 5, + 1, + 1, + 4, + 9, + 1, + 8, + 3, + 5, + 2, + 27, + 12, + 14, + 9, + 3, + 2, + 11, + 6 + ], + "weighted_loads": [ + 0.14315666630864143, + 0.10913260653614998, + 0.06715472973883152, + 0.12003494054079056, + 0.5011587087064981, + 0.0, + 0.04275159537792206, + 0.12834211438894272, + 0.29621797427535057, + 0.44698373787105083, + 0.9331547245383263, + 0.6798676217440516, + 0.19941015541553497, + 0.9353173933923244, + 1.5021819813991897, + 1.0654345136135817, + 0.12857620790600777, + 1.0032404465600848, + 0.34673199616372585, + 0.0, + 0.0, + 0.7067907936871052, + 0.47848911955952644, + 0.0, + 0.6252630222588778, + 0.3186747767031193, + 1.548887437209487, + 0.5400776602327824, + 0.06143302097916603, + 0.15521071199327707, + 1.2050050720572472, + 0.28936339914798737, + 0.3390095606446266, + 0.0, + 0.6825618129223585, + 0.5495398081839085, + 1.2867563273757696, + 0.33028676360845566, + 0.4986327290534973, + 0.0695483572781086, + 0.2860697489231825, + 0.03942277282476425, + 0.17403186112642288, + 0.4112757761031389, + 0.05107070133090019, + 1.6602114103734493, + 0.29062753170728683, + 0.04142233356833458, + 0.0346110537648201, + 1.1696914955973625, + 0.3961186707019806, + 0.07851000875234604, + 0.7109083794057369, + 0.25232790783047676, + 0.3198515474796295, + 0.11560965329408646, + 2.2829276751726866, + 0.8468881375156343, + 0.7821034491062164, + 0.5547326281666756, + 0.24621075933100656, + 0.24862797930836678, + 0.6174478540197015, + 1.0340713430196047 + ], + "unique_experts": 59, + "load_cv": 0.8897295140814453, + "normalized_load_entropy": 0.9090379343706884, + "max_load_share": 0.0661764705882353 + } + }, + "s0_bos": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "b5cbf6b1b5927d8eb53c1785a62f40e64ccfa99a0d9b0fa0334b4e99596e835a", + "route_weight_sha256": "44c60179076bc2810c876d2daf53f258908444de076106a54aa18b8861041b12", + "loads": [ + 1, + 1, + 2, + 2, + 5, + 0, + 0, + 1, + 3, + 2, + 3, + 1, + 0, + 7, + 6, + 5, + 2, + 4, + 4, + 2, + 0, + 4, + 0, + 0, + 5, + 2, + 2, + 1, + 1, + 2, + 2, + 3, + 3, + 0, + 3, + 5, + 9, + 0, + 4, + 0, + 3, + 1, + 3, + 2, + 0, + 15, + 1, + 0, + 0, + 0, + 1, + 0, + 0, + 2, + 2, + 0, + 7, + 2, + 4, + 6, + 0, + 2, + 9, + 5 + ], + "weighted_loads": [ + 0.10330989956855774, + 0.06342396140098572, + 0.07423312962055206, + 0.08169887959957123, + 0.3757513239979744, + 0.0, + 0.0, + 0.047735437750816345, + 0.29834962263703346, + 0.05606832168996334, + 0.20157122611999512, + 0.052827101200819016, + 0.0, + 0.8934200406074524, + 0.6779628023505211, + 0.7406245358288288, + 0.13241074234247208, + 0.38974132388830185, + 0.25981879606842995, + 0.057174814864993095, + 0.0, + 0.3859517890959978, + 0.0, + 0.0, + 0.2887583374977112, + 0.19100218638777733, + 0.070129269734025, + 0.10291717201471329, + 0.06279300898313522, + 0.05328145623207092, + 0.10107816010713577, + 0.2113926112651825, + 0.1325963046401739, + 0.0, + 0.0909610353410244, + 0.5644439607858658, + 0.6318105310201645, + 0.0, + 0.2704003769904375, + 0.0, + 0.2532859370112419, + 0.03603764995932579, + 0.10402949899435043, + 0.07387961633503437, + 0.0, + 1.5790435429662466, + 0.046482544392347336, + 0.0, + 0.0, + 0.0, + 0.06638182699680328, + 0.0, + 0.0, + 0.08602781593799591, + 0.09794863685965538, + 0.0, + 0.47025109082460403, + 0.0713405329734087, + 0.21525033190846443, + 0.3522828705608845, + 0.0, + 0.24517754465341568, + 0.506973815150559, + 0.9839413575828075 + ], + "unique_experts": 47, + "load_cv": 1.081850661380038, + "normalized_load_entropy": 0.8680439894057934, + "max_load_share": 0.09259259259259259 + }, + "full_input": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "81f490e6fb9abf9c5f70a2bb4e37763411a08d4884352deb9a85eda031938547", + "route_weight_sha256": "0dbaeef209b0051b715efab85c6b632a4497a76287107a057e65f7389676d9a9", + "loads": [ + 2, + 2, + 2, + 3, + 5, + 1, + 0, + 3, + 3, + 7, + 6, + 5, + 1, + 8, + 19, + 7, + 2, + 13, + 4, + 2, + 0, + 5, + 1, + 0, + 9, + 2, + 8, + 8, + 1, + 2, + 10, + 3, + 6, + 1, + 9, + 5, + 15, + 0, + 4, + 0, + 3, + 2, + 6, + 5, + 3, + 15, + 4, + 0, + 1, + 0, + 10, + 1, + 3, + 2, + 3, + 0, + 22, + 11, + 10, + 7, + 0, + 2, + 10, + 8 + ], + "weighted_loads": [ + 0.13140486553311348, + 0.11466791108250618, + 0.07423312962055206, + 0.12785181775689125, + 0.3757513239979744, + 0.050440091639757156, + 0.0, + 0.14604966714978218, + 0.29834962263703346, + 0.3206744287163019, + 0.4390781372785568, + 0.3508451245725155, + 0.18649716675281525, + 0.9546362087130547, + 1.2763854041695595, + 0.8567950315773487, + 0.13241074234247208, + 0.9225468281656504, + 0.25981879606842995, + 0.057174814864993095, + 0.0, + 0.4186185207217932, + 0.03353482857346535, + 0.0, + 0.5046122930943966, + 0.19100218638777733, + 1.0575043503195047, + 0.4370021540671587, + 0.06279300898313522, + 0.05328145623207092, + 1.017999179661274, + 0.2113926112651825, + 0.24369212798774242, + 0.05485587939620018, + 0.5837200284004211, + 0.5644439607858658, + 0.9279181659221649, + 0.0, + 0.2704003769904375, + 0.0, + 0.2532859370112419, + 0.3170755170285702, + 0.25686001777648926, + 0.22767568193376064, + 0.1612430103123188, + 1.5790435429662466, + 0.297443937510252, + 0.0, + 0.07326094806194305, + 0.0, + 0.4501067139208317, + 0.06748293340206146, + 0.34907158464193344, + 0.08602781593799591, + 0.14525357633829117, + 0.0, + 1.6068748403340578, + 0.5144087001681328, + 0.44864410534501076, + 0.40212257578969, + 0.0, + 0.24517754465341568, + 0.5476712817326188, + 1.145224928855896 + ], + "unique_experts": 55, + "load_cv": 0.9692850344326052, + "normalized_load_entropy": 0.8928174878863966, + "max_load_share": 0.07051282051282051 + } + }, + "s1_bos": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "77b4ff4b3621a73e08d7198c9b3916cc19bf723c6362a0baf29d3b582fdbb025", + "route_weight_sha256": "e6d9ef4832c0d67559a7c3a790d48da6c77c86c6ac19d18a32e4704962cfb65a", + "loads": [ + 1, + 1, + 2, + 2, + 5, + 0, + 0, + 1, + 3, + 2, + 3, + 0, + 0, + 7, + 6, + 5, + 2, + 4, + 4, + 1, + 0, + 4, + 0, + 0, + 5, + 2, + 1, + 1, + 1, + 2, + 2, + 3, + 2, + 0, + 3, + 5, + 8, + 2, + 4, + 0, + 3, + 1, + 3, + 2, + 0, + 16, + 1, + 0, + 0, + 1, + 1, + 0, + 2, + 2, + 2, + 0, + 7, + 2, + 4, + 6, + 0, + 2, + 8, + 5 + ], + "weighted_loads": [ + 0.10198239237070084, + 0.06411836296319962, + 0.08156627416610718, + 0.08743790164589882, + 0.3779312763363123, + 0.0, + 0.0, + 0.044629376381635666, + 0.28997373580932617, + 0.05626645311713219, + 0.19767127931118011, + 0.0, + 0.0, + 0.9029412660747766, + 0.6569229140877724, + 0.774257231503725, + 0.1238584890961647, + 0.40611454099416733, + 0.25438742339611053, + 0.031015092507004738, + 0.0, + 0.3974284250289202, + 0.0, + 0.0, + 0.2866559140384197, + 0.19213884696364403, + 0.04308689758181572, + 0.11336816847324371, + 0.0577051006257534, + 0.05919336900115013, + 0.10390813648700714, + 0.20727917179465294, + 0.09687279537320137, + 0.0, + 0.08592323446646333, + 0.5713023487478495, + 0.6505825966596603, + 0.06465788744390011, + 0.28215375915169716, + 0.0, + 0.25479085743427277, + 0.04011017829179764, + 0.10260440595448017, + 0.07138273492455482, + 0.0, + 1.6378929018974304, + 0.04759509116411209, + 0.0, + 0.0, + 0.03354793041944504, + 0.06035755202174187, + 0.0, + 0.07855316065251827, + 0.09424402192234993, + 0.10321613401174545, + 0.0, + 0.45401808619499207, + 0.07574225962162018, + 0.22433635964989662, + 0.35291738249361515, + 0.0, + 0.24881558865308762, + 0.4656066168099642, + 0.9977363720536232 + ], + "unique_experts": 49, + "load_cv": 1.0750669456652184, + "normalized_load_entropy": 0.8746457347373294, + "max_load_share": 0.09876543209876543 + }, + "full_input": { + "tokens": 68, + "top_k": 6, + "decisions": 408, + "ordered_route_sha256": "e74031c4c99842915207bda7a1777c86fb801bacf8537b0b843fafc3cea757d1", + "route_weight_sha256": "902e657735be446ffe2727e6ef62b1b7f8519629985fd7f000ab51c0b8f9c9a6", + "loads": [ + 1, + 2, + 2, + 3, + 8, + 0, + 1, + 3, + 3, + 10, + 11, + 6, + 1, + 8, + 20, + 10, + 2, + 10, + 4, + 1, + 0, + 10, + 7, + 0, + 12, + 4, + 14, + 10, + 1, + 5, + 13, + 4, + 7, + 1, + 12, + 5, + 21, + 7, + 7, + 1, + 4, + 1, + 6, + 6, + 3, + 17, + 5, + 1, + 1, + 3, + 8, + 1, + 10, + 4, + 5, + 2, + 27, + 11, + 14, + 9, + 2, + 2, + 11, + 8 + ], + "weighted_loads": [ + 0.10198239237070084, + 0.11441527679562569, + 0.08156627416610718, + 0.12443548068404198, + 0.5555238500237465, + 0.0, + 0.036588627845048904, + 0.19632912054657936, + 0.28997373580932617, + 0.508353378623724, + 1.0603503324091434, + 0.6220686882734299, + 0.19060859084129333, + 0.9600876588374376, + 1.4232867062091827, + 1.0950878113508224, + 0.1238584890961647, + 0.8642922155559063, + 0.25438742339611053, + 0.031015092507004738, + 0.0, + 0.750521844252944, + 0.475126501172781, + 0.0, + 0.6072654705494642, + 0.2963176742196083, + 1.686606988310814, + 0.46377672255039215, + 0.0577051006257534, + 0.16119331866502762, + 1.3592169433832169, + 0.2868640013039112, + 0.2990480624139309, + 0.03955869376659393, + 0.7449210085906088, + 0.5713023487478495, + 1.3367861527949572, + 0.36542302556335926, + 0.5635515041649342, + 0.03412143513560295, + 0.2851687800139189, + 0.04011017829179764, + 0.22814923338592052, + 0.2672135680913925, + 0.12711970508098602, + 1.6552580632269382, + 0.393075916916132, + 0.04142233356833458, + 0.0346110537648201, + 0.18598783016204834, + 0.35144317522644997, + 0.06638738512992859, + 0.7689033839851618, + 0.28417110070586205, + 0.3171328343451023, + 0.11560965329408646, + 2.2541226968169212, + 0.8472114242613316, + 0.8047825023531914, + 0.5174284279346466, + 0.24527563899755478, + 0.24881558865308762, + 0.5882219914346933, + 1.168616883456707 + ], + "unique_experts": 61, + "load_cv": 0.8705087404087495, + "normalized_load_entropy": 0.9132754127277096, + "max_load_share": 0.0661764705882353 + } + }, + "s0_x": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "72f25f27b08b69107a21b45eac2ddd468e32f8b911eb8503047932d639e57c1d", + "route_weight_sha256": "f9ede45d0a01d6bef4b822cca85a35f4119051590844e6339216796569a44d29", + "loads": [ + 1, + 1, + 1, + 2, + 5, + 0, + 0, + 1, + 3, + 2, + 4, + 0, + 0, + 8, + 6, + 4, + 2, + 5, + 5, + 0, + 0, + 4, + 0, + 0, + 6, + 3, + 2, + 1, + 1, + 2, + 2, + 3, + 2, + 0, + 4, + 4, + 8, + 0, + 4, + 1, + 4, + 1, + 4, + 0, + 0, + 16, + 2, + 1, + 0, + 0, + 1, + 0, + 1, + 1, + 2, + 0, + 6, + 2, + 4, + 6, + 0, + 2, + 8, + 4 + ], + "weighted_loads": [ + 0.11184857040643692, + 0.0630076453089714, + 0.04148213565349579, + 0.08727397583425045, + 0.362505791708827, + 0.0, + 0.0, + 0.041426267474889755, + 0.2923138029873371, + 0.05827099271118641, + 0.22930889949202538, + 0.0, + 0.0, + 0.93682861328125, + 0.6625609546899796, + 0.7317595779895782, + 0.11951250955462456, + 0.4030449911952019, + 0.28742606937885284, + 0.0, + 0.0, + 0.4102907795459032, + 0.0, + 0.0, + 0.32022981345653534, + 0.2297587040811777, + 0.06987808644771576, + 0.11404555290937424, + 0.06355313956737518, + 0.057042570784687996, + 0.10612404718995094, + 0.2025277279317379, + 0.08806716650724411, + 0.0, + 0.12073044665157795, + 0.5299405455589294, + 0.6042952686548233, + 0.0, + 0.2985935043543577, + 0.02967962436378002, + 0.29309171810746193, + 0.03620891645550728, + 0.13028164580464363, + 0.0, + 0.0, + 1.610473657026887, + 0.0749401543289423, + 0.025842459872364998, + 0.0, + 0.0, + 0.07311739772558212, + 0.0, + 0.056433551013469696, + 0.054430123418569565, + 0.10047737509012222, + 0.0, + 0.4318363592028618, + 0.06490344926714897, + 0.20007751509547234, + 0.33954485319554806, + 0.0, + 0.25554144755005836, + 0.5241424618288875, + 0.9667009133845568 + ], + "unique_experts": 47, + "load_cv": 1.10416208339931, + "normalized_load_entropy": 0.8641183297532927, + "max_load_share": 0.09876543209876543 + }, + "full_input": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "29b75d3dbb408235efcfa7df8804a7f270cff458e5d7f1648de541521ad07920", + "route_weight_sha256": "cabf5f871d3aafb2f4a30c933f1cab058297c512c4b7af5fa5ff3554339e06fa", + "loads": [ + 1, + 2, + 1, + 4, + 5, + 0, + 0, + 3, + 3, + 5, + 8, + 6, + 1, + 9, + 20, + 6, + 2, + 16, + 5, + 0, + 0, + 5, + 0, + 0, + 10, + 3, + 8, + 8, + 1, + 3, + 8, + 3, + 4, + 0, + 9, + 4, + 14, + 0, + 4, + 1, + 4, + 1, + 5, + 5, + 1, + 16, + 5, + 1, + 0, + 0, + 10, + 1, + 4, + 1, + 3, + 0, + 26, + 13, + 10, + 7, + 0, + 2, + 9, + 6 + ], + "weighted_loads": [ + 0.11184857040643692, + 0.10831582173705101, + 0.04148213565349579, + 0.1745645198971033, + 0.362505791708827, + 0.0, + 0.0, + 0.14113914594054222, + 0.2923138029873371, + 0.24273950420320034, + 0.5295728780329227, + 0.44710617512464523, + 0.19261378049850464, + 0.9980447813868523, + 1.3642359301447868, + 0.8281611576676369, + 0.11951250955462456, + 1.0305111799389124, + 0.28742606937885284, + 0.0, + 0.0, + 0.44295751117169857, + 0.0, + 0.0, + 0.5380625836551189, + 0.2297587040811777, + 0.9560551829636097, + 0.39574037306010723, + 0.06355313956737518, + 0.10564889200031757, + 0.8607295863330364, + 0.2025277279317379, + 0.1698264628648758, + 0.0, + 0.5473957490175962, + 0.5299405455589294, + 0.9022175744175911, + 0.0, + 0.2985935043543577, + 0.02967962436378002, + 0.29309171810746193, + 0.03620891645550728, + 0.1972178779542446, + 0.24813254550099373, + 0.034370847046375275, + 1.610473657026887, + 0.33138437010347843, + 0.025842459872364998, + 0.0, + 0.0, + 0.45766082778573036, + 0.0684128925204277, + 0.3914273828268051, + 0.054430123418569565, + 0.147782314568758, + 0.0, + 1.7523718234151602, + 0.6471439208835363, + 0.43347128853201866, + 0.3893845584243536, + 0.0, + 0.25554144755005836, + 0.5648399284109473, + 1.0540567878633738 + ], + "unique_experts": 52, + "load_cv": 1.068034133315822, + "normalized_load_entropy": 0.8738052226410147, + "max_load_share": 0.08333333333333333 + } + }, + "s1_x": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "5d5f026df80fa7ee3fe7a073e438ad455c72929c33c45915105297ffc5b2b23f", + "route_weight_sha256": "13b07d5a074a048a1b949abb8b6dd0f3fb9010da075897b69f62085af12938ed", + "loads": [ + 1, + 1, + 2, + 2, + 4, + 0, + 0, + 1, + 3, + 3, + 3, + 0, + 0, + 7, + 6, + 5, + 2, + 4, + 3, + 0, + 1, + 5, + 0, + 0, + 4, + 3, + 1, + 1, + 1, + 2, + 2, + 3, + 2, + 0, + 4, + 4, + 8, + 1, + 4, + 1, + 4, + 1, + 2, + 1, + 0, + 15, + 1, + 1, + 0, + 2, + 1, + 0, + 3, + 3, + 2, + 0, + 6, + 2, + 4, + 6, + 0, + 2, + 8, + 4 + ], + "weighted_loads": [ + 0.11419062316417694, + 0.06419911980628967, + 0.08805440366268158, + 0.08715352974832058, + 0.36447348818182945, + 0.0, + 0.0, + 0.035678163170814514, + 0.28459110110998154, + 0.0852384939789772, + 0.1742112971842289, + 0.0, + 0.0, + 0.9034406878054142, + 0.6522125452756882, + 0.8238804340362549, + 0.1121545284986496, + 0.3761896565556526, + 0.21741126105189323, + 0.0, + 0.03787386789917946, + 0.42035272158682346, + 0.0, + 0.0, + 0.2594809979200363, + 0.22812714613974094, + 0.05619316175580025, + 0.11456260085105896, + 0.05993828922510147, + 0.06747312936931849, + 0.1020800732076168, + 0.18155739828944206, + 0.08603485859930515, + 0.0, + 0.11795951705425978, + 0.5547214671969414, + 0.5998008288443089, + 0.038015659898519516, + 0.34577469527721405, + 0.03333939611911774, + 0.3140718452632427, + 0.037909261882305145, + 0.06009761244058609, + 0.02729221247136593, + 0.0, + 1.477194556966424, + 0.04194168373942375, + 0.02648177742958069, + 0.0, + 0.060810524970293045, + 0.06444501131772995, + 0.0, + 0.10436925664544106, + 0.12721478566527367, + 0.10462671145796776, + 0.0, + 0.44151194021105766, + 0.06540385261178017, + 0.2269236519932747, + 0.3171745538711548, + 0.0, + 0.26043322309851646, + 0.5604279581457376, + 0.9771310985088348 + ], + "unique_experts": 51, + "load_cv": 1.0167774119448385, + "normalized_load_entropy": 0.885815999073679, + "max_load_share": 0.09259259259259259 + }, + "full_input": { + "tokens": 68, + "top_k": 6, + "decisions": 408, + "ordered_route_sha256": "3c89d73a43d79b86e4d49b62c539d90685b995b2705b9d59a62b2eaaa6df4e13", + "route_weight_sha256": "57db1de6a14ce3088e0ae9a7ff0f1b8bbabb468cbf7d794afc184de9af50f89e", + "loads": [ + 1, + 2, + 2, + 2, + 7, + 1, + 0, + 2, + 3, + 10, + 11, + 8, + 1, + 8, + 21, + 10, + 2, + 10, + 3, + 0, + 1, + 11, + 6, + 0, + 11, + 5, + 13, + 11, + 1, + 6, + 11, + 4, + 6, + 0, + 12, + 4, + 21, + 6, + 7, + 2, + 5, + 1, + 4, + 6, + 1, + 16, + 4, + 2, + 1, + 4, + 9, + 1, + 11, + 5, + 5, + 2, + 29, + 14, + 15, + 10, + 2, + 2, + 11, + 6 + ], + "weighted_loads": [ + 0.11419062316417694, + 0.11404453590512276, + 0.08805440366268158, + 0.08715352974832058, + 0.5420660618692636, + 0.029752032831311226, + 0.0, + 0.12044700235128403, + 0.28459110110998154, + 0.47619203478097916, + 1.0215222761034966, + 0.7804553210735321, + 0.16640423238277435, + 0.9605870805680752, + 1.5477466396987438, + 1.1390264555811882, + 0.1121545284986496, + 0.9033241011202335, + 0.21741126105189323, + 0.0, + 0.03787386789917946, + 0.7734461408108473, + 0.4399164244532585, + 0.0, + 0.5756298694759607, + 0.3323059733957052, + 1.5615097396075726, + 0.5025060288608074, + 0.05993828922510147, + 0.22653016913682222, + 1.131360288709402, + 0.26114222779870033, + 0.25882519967854023, + 0.0, + 0.6996118007227778, + 0.5547214671969414, + 1.2914890218526125, + 0.33878079801797867, + 0.627172440290451, + 0.06746083125472069, + 0.34444976784288883, + 0.037909261882305145, + 0.1320532839745283, + 0.28591678477823734, + 0.030563855543732643, + 1.4945597182959318, + 0.28953050449490547, + 0.06790411099791527, + 0.0346110537648201, + 0.21325042471289635, + 0.39062926545739174, + 0.06433937698602676, + 0.7836676687002182, + 0.3171418644487858, + 0.3185434117913246, + 0.11560965329408646, + 2.3201532885432243, + 1.0193732231855392, + 0.8721212334930897, + 0.5278559867292643, + 0.24527563899755478, + 0.26043322309851646, + 0.6830433327704668, + 1.0589142367243767 + ], + "unique_experts": 60, + "load_cv": 0.9047272152987708, + "normalized_load_entropy": 0.9076252146409931, + "max_load_share": 0.07107843137254902 + } + }, + "s0_period": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "4b553902145a4a842ef28f34a8124e7426625133fe5e0dc20687b74b369949bf", + "route_weight_sha256": "a8603658daf61e827471337784e4078fde58160711f9f9ea58b6a1fabffbb482", + "loads": [ + 1, + 1, + 1, + 2, + 6, + 0, + 0, + 1, + 3, + 2, + 4, + 0, + 1, + 7, + 6, + 4, + 2, + 4, + 5, + 1, + 0, + 4, + 0, + 0, + 6, + 2, + 1, + 1, + 1, + 2, + 2, + 3, + 2, + 0, + 4, + 4, + 8, + 0, + 4, + 1, + 4, + 1, + 4, + 1, + 0, + 14, + 1, + 1, + 0, + 1, + 1, + 0, + 2, + 2, + 2, + 0, + 6, + 1, + 4, + 6, + 0, + 2, + 8, + 5 + ], + "weighted_loads": [ + 0.10853700339794159, + 0.0623599998652935, + 0.03992331400513649, + 0.08349056169390678, + 0.43223883025348186, + 0.0, + 0.0, + 0.04070267826318741, + 0.2849021218717098, + 0.055001603439450264, + 0.23424634337425232, + 0.0, + 0.02877715229988098, + 0.8915186561644077, + 0.6665735319256783, + 0.7467918395996094, + 0.12103472277522087, + 0.38729602098464966, + 0.28658271953463554, + 0.02693074569106102, + 0.0, + 0.4126376733183861, + 0.0, + 0.0, + 0.3202472999691963, + 0.19829214736819267, + 0.044601116329431534, + 0.11086417734622955, + 0.06270410865545273, + 0.05919249542057514, + 0.1095031350851059, + 0.20893105119466782, + 0.09198582172393799, + 0.0, + 0.12049092724919319, + 0.5397815853357315, + 0.6152185909450054, + 0.0, + 0.2977235373109579, + 0.029984300956130028, + 0.2966778725385666, + 0.03598397225141525, + 0.13120616227388382, + 0.04463301599025726, + 0.0, + 1.5582311637699604, + 0.04604462534189224, + 0.025665350258350372, + 0.0, + 0.030153481289744377, + 0.06955389678478241, + 0.0, + 0.08019584231078625, + 0.08486330881714821, + 0.09988896176218987, + 0.0, + 0.41077519208192825, + 0.03739011287689209, + 0.22011689096689224, + 0.3465965576469898, + 0.0, + 0.2496657632291317, + 0.5098956720903516, + 1.0014545749872923 + ], + "unique_experts": 51, + "load_cv": 1.0263262281538728, + "normalized_load_entropy": 0.8804766626844283, + "max_load_share": 0.08641975308641975 + }, + "full_input": { + "tokens": 52, + "top_k": 6, + "decisions": 312, + "ordered_route_sha256": "f19b8e08f8e429e9dc54d4f4f7e4080bc52408868602b34df283053d8f3e1fa8", + "route_weight_sha256": "e274e384c925aef7c6919cc302ade7beccdaa1b45fd81a1f35fea97e52c309cb", + "loads": [ + 1, + 2, + 1, + 4, + 6, + 1, + 0, + 4, + 3, + 5, + 8, + 4, + 2, + 8, + 20, + 6, + 2, + 14, + 5, + 1, + 0, + 5, + 0, + 0, + 11, + 2, + 6, + 8, + 1, + 2, + 10, + 3, + 5, + 2, + 9, + 4, + 15, + 0, + 4, + 1, + 4, + 1, + 5, + 4, + 1, + 14, + 5, + 1, + 0, + 1, + 10, + 1, + 6, + 2, + 3, + 0, + 22, + 11, + 10, + 7, + 0, + 2, + 9, + 8 + ], + "weighted_loads": [ + 0.10853700339794159, + 0.10909700393676758, + 0.03992331400513649, + 0.15245342068374157, + 0.43223883025348186, + 0.04452765733003616, + 0.0, + 0.18675408884882927, + 0.2849021218717098, + 0.2394701149314642, + 0.5479171127080917, + 0.29801802337169647, + 0.21470770239830017, + 0.95273482427001, + 1.310484442859888, + 0.8415816053748131, + 0.12103472277522087, + 0.9844623897224665, + 0.28658271953463554, + 0.02693074569106102, + 0.0, + 0.44530440494418144, + 0.0, + 0.0, + 0.626493539661169, + 0.19829214736819267, + 0.8984052874147892, + 0.392169201746583, + 0.06270410865545273, + 0.05919249542057514, + 0.9373661428689957, + 0.20893105119466782, + 0.2075507491827011, + 0.08757324144244194, + 0.5500531904399395, + 0.5397815853357315, + 0.9666979089379311, + 0.0, + 0.2977235373109579, + 0.029984300956130028, + 0.2966778725385666, + 0.03598397225141525, + 0.18660130351781845, + 0.19842908158898354, + 0.03600253909826279, + 1.5582311637699604, + 0.3147151507437229, + 0.025665350258350372, + 0.0, + 0.030153481289744377, + 0.45457375422120094, + 0.06380103528499603, + 0.5014594551175833, + 0.08486330881714821, + 0.14719390124082565, + 0.0, + 1.6802685242146254, + 0.511681079864502, + 0.45351066440343857, + 0.39643626287579536, + 0.0, + 0.2496657632291317, + 0.5505931386724114, + 1.1728522572666407 + ], + "unique_experts": 56, + "load_cv": 0.9814184209745969, + "normalized_load_entropy": 0.8914813353194914, + "max_load_share": 0.07051282051282051 + } + }, + "s1_period": { + "target_content": { + "tokens": 27, + "top_k": 6, + "decisions": 162, + "ordered_route_sha256": "a6b63237fd88f85b4e59a291b8c40dbb32131394bb37515f2dd0720fcad43004", + "route_weight_sha256": "e701ad256a361ba2eb59608d0c58b89d11e13a84e8443771eb0c210670c19ccb", + "loads": [ + 1, + 1, + 1, + 2, + 6, + 0, + 0, + 1, + 3, + 2, + 3, + 0, + 0, + 6, + 6, + 4, + 2, + 4, + 3, + 0, + 1, + 5, + 0, + 0, + 4, + 2, + 1, + 1, + 1, + 2, + 2, + 3, + 2, + 0, + 4, + 4, + 8, + 2, + 4, + 1, + 4, + 2, + 2, + 1, + 0, + 15, + 1, + 1, + 0, + 1, + 2, + 0, + 3, + 3, + 2, + 0, + 6, + 1, + 4, + 6, + 0, + 2, + 8, + 6 + ], + "weighted_loads": [ + 0.11797541379928589, + 0.06542972475290298, + 0.052646808326244354, + 0.08653337135910988, + 0.48350755497813225, + 0.0, + 0.0, + 0.03248806670308113, + 0.27169014886021614, + 0.058821264654397964, + 0.17307593300938606, + 0.0, + 0.0, + 0.8553318455815315, + 0.6871625259518623, + 0.7634056508541107, + 0.10847872495651245, + 0.36368339881300926, + 0.22260016575455666, + 0.0, + 0.04323909431695938, + 0.47305523231625557, + 0.0, + 0.0, + 0.25618255138397217, + 0.20259184762835503, + 0.054051466286182404, + 0.11611129343509674, + 0.059120628982782364, + 0.07404875662177801, + 0.10465499386191368, + 0.18941766023635864, + 0.08982176519930363, + 0.0, + 0.12021513748914003, + 0.5491591393947601, + 0.6325049549341202, + 0.06721021793782711, + 0.3494103029370308, + 0.031383074820041656, + 0.3213897533714771, + 0.0633817296475172, + 0.058462582528591156, + 0.028023557737469673, + 0.0, + 1.4759854916483164, + 0.04523196443915367, + 0.027555283159017563, + 0.0, + 0.03823142126202583, + 0.09392362833023071, + 0.0, + 0.11000987887382507, + 0.12717575952410698, + 0.10247564688324928, + 0.0, + 0.3541637733578682, + 0.029891958460211754, + 0.2386995144188404, + 0.3062091376632452, + 0.0, + 0.2597658261656761, + 0.5510258758440614, + 1.055364215746522 + ], + "unique_experts": 51, + "load_cv": 1.0263262281538728, + "normalized_load_entropy": 0.8840069197734591, + "max_load_share": 0.09259259259259259 + }, + "full_input": { + "tokens": 68, + "top_k": 6, + "decisions": 408, + "ordered_route_sha256": "9920a92595653f7a0da02bbedaffebe35aaed5f99186644c8585ca5c1ee0ba3b", + "route_weight_sha256": "f66ee76f6266ce04c80c4c0148df37dbd7015aa1c9886d5829d373e4c3d705d2", + "loads": [ + 1, + 2, + 1, + 2, + 9, + 0, + 0, + 2, + 3, + 9, + 11, + 6, + 1, + 7, + 21, + 10, + 2, + 10, + 3, + 0, + 1, + 11, + 6, + 0, + 12, + 4, + 13, + 11, + 1, + 5, + 11, + 4, + 7, + 1, + 12, + 4, + 21, + 8, + 7, + 2, + 5, + 2, + 5, + 6, + 0, + 16, + 5, + 2, + 2, + 3, + 10, + 1, + 13, + 5, + 6, + 2, + 27, + 10, + 14, + 9, + 2, + 2, + 11, + 9 + ], + "weighted_loads": [ + 0.11797541379928589, + 0.11225687712430954, + 0.052646808326244354, + 0.08653337135910988, + 0.6611001286655664, + 0.0, + 0.0, + 0.11725690588355064, + 0.27169014886021614, + 0.45076247304677963, + 1.036645457148552, + 0.6220686882734299, + 0.17917129397392273, + 0.9124782383441925, + 1.5562387444078922, + 1.0945457238703966, + 0.10847872495651245, + 0.9284558519721031, + 0.22260016575455666, + 0.0, + 0.04323909431695938, + 0.8261486515402794, + 0.4399164244532585, + 0.0, + 0.6426945868879557, + 0.3067706748843193, + 1.5994422435760498, + 0.4980055168271065, + 0.059120628982782364, + 0.1760487062856555, + 1.1130527220666409, + 0.2690024897456169, + 0.2979569658637047, + 0.0291890986263752, + 0.6816473910585046, + 0.5491591393947601, + 1.3351880963891745, + 0.4036101158708334, + 0.6308080479502678, + 0.06550450995564461, + 0.35176767595112324, + 0.0633817296475172, + 0.16540552303195, + 0.29313854686915874, + 0.0, + 1.4933506529778242, + 0.30224819108843803, + 0.06897761672735214, + 0.0678303949534893, + 0.19067132100462914, + 0.4184844009578228, + 0.061163559556007385, + 0.8789853118360043, + 0.3171028383076191, + 0.3534494526684284, + 0.11560965329408646, + 2.249047953635454, + 0.8013611230999231, + 0.8191456571221352, + 0.47072018310427666, + 0.24527563899755478, + 0.2597658261656761, + 0.6736412504687905, + 1.2218059804290533 + ], + "unique_experts": 59, + "load_cv": 0.8819171036881969, + "normalized_load_entropy": 0.909055213431293, + "max_load_share": 0.0661764705882353 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 27, + "ordered_topk_exact_tokens": 19, + "set_exact_tokens": 22, + "mean_set_jaccard": 0.9470899470899471, + "mean_token_weighted_tv": 0.014504476985031808, + "aggregate_load_tv": 0.030864197530864196 + }, + "system_bos": { + "tokens": 27, + "ordered_topk_exact_tokens": 16, + "set_exact_tokens": 22, + "mean_set_jaccard": 0.9391534391534392, + "mean_token_weighted_tv": 0.01914038399613842, + "aggregate_load_tv": 0.037037037037037035 + }, + "system_x": { + "tokens": 27, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 13, + "mean_set_jaccard": 0.8439153439153438, + "mean_token_weighted_tv": 0.035617075946733905, + "aggregate_load_tv": 0.08024691358024691 + }, + "system_period": { + "tokens": 27, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 18, + "mean_set_jaccard": 0.8809523809523812, + "mean_token_weighted_tv": 0.034853002780841455, + "aggregate_load_tv": 0.06172839506172839 + }, + "bos_at_s0": { + "tokens": 27, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.8783068783068784, + "mean_token_weighted_tv": 0.02991544389752326, + "aggregate_load_tv": 0.06790123456790123 + }, + "bos_at_s1": { + "tokens": 27, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.8941798941798942, + "mean_token_weighted_tv": 0.028791727282589785, + "aggregate_load_tv": 0.06172839506172839 + }, + "x_at_s0": { + "tokens": 27, + "ordered_topk_exact_tokens": 8, + "set_exact_tokens": 11, + "mean_set_jaccard": 0.8148148148148148, + "mean_token_weighted_tv": 0.040166067959809745, + "aggregate_load_tv": 0.09259259259259259 + }, + "x_at_s1": { + "tokens": 27, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8465608465608466, + "mean_token_weighted_tv": 0.04586626827302906, + "aggregate_load_tv": 0.08641975308641975 + }, + "period_at_s0": { + "tokens": 27, + "ordered_topk_exact_tokens": 8, + "set_exact_tokens": 12, + "mean_set_jaccard": 0.795414462081129, + "mean_token_weighted_tv": 0.04539391453619356, + "aggregate_load_tv": 0.11728395061728394 + }, + "period_at_s1": { + "tokens": 27, + "ordered_topk_exact_tokens": 8, + "set_exact_tokens": 11, + "mean_set_jaccard": 0.791005291005291, + "mean_token_weighted_tv": 0.057848204082498945, + "aggregate_load_tv": 0.12345679012345678 + } + } + } + } + }, + { + "id": "HumanEval/31", + "domain": "code", + "label": "Python code", + "within_domain_index": 0, + "selection_rank": "004f4cfa62936a4a096e53df7d0ef3926c3ee97d32cf67a3c9bd64569f580e5c", + "source_text_sha256": "b7e32acf5a6b551a782eacfb4ecab09e59f0577a2da9642e292d2479af5bf50e", + "source_characters": 308, + "source_tokens": 120, + "content_token_ids_sha256": "d22768ea5348c0fe94bfddb93cbb9077aa4bc72a17b096b152e684ac5a485596", + "prompt_tokens_by_condition": { + "s0_eos": 145, + "s1_eos": 161, + "s0_bos": 145, + "s1_bos": 161, + "s0_x": 145, + "s1_x": 161, + "s0_period": 145, + "s1_period": 161 + }, + "batch_prompt_tokens": 161, + "content_tokens": 120, + "boundary_crossing_tokens_by_condition": { + "s0_eos": 0, + "s1_eos": 0, + "s0_bos": 0, + "s1_bos": 0, + "s0_x": 0, + "s1_x": 0, + "s0_period": 0, + "s1_period": 0 + }, + "forward_seconds": 0.8446108729986008, + "peak_cuda_memory_allocated_bytes": 27720056832, + "hidden_stages": { + "embedding": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3845a664d4654d8622af3183546fa1220955445321024cf065b452af5cd30210", + "mean": -0.0012909455690532923, + "std": 0.08326598256826401, + "rms": 0.08327598869800568, + "max_abs": 2.046875 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "94dd9dfaa8a8682825703d5a696149d0d78e440456bdf3a7416136bfb44977a1", + "mean": -0.0012299797963351011, + "std": 0.08360898494720459, + "rms": 0.08361802250146866, + "max_abs": 2.046875 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3845a664d4654d8622af3183546fa1220955445321024cf065b452af5cd30210", + "mean": -0.0012909455690532923, + "std": 0.08326598256826401, + "rms": 0.08327598869800568, + "max_abs": 2.046875 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a43d3f416a11e0146f0be31ab25e0fdef7b54db6e339ba3215389bc3cc494b90", + "mean": -0.0013260887935757637, + "std": 0.08594415336847305, + "rms": 0.08595438301563263, + "max_abs": 2.046875 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3845a664d4654d8622af3183546fa1220955445321024cf065b452af5cd30210", + "mean": -0.0012909455690532923, + "std": 0.08326598256826401, + "rms": 0.08327598869800568, + "max_abs": 2.046875 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8e6f24c31cc9135aae9b006750172da7945cc8cf3537949a526ea30ea315dd7b", + "mean": -0.0012194061418995261, + "std": 0.08345475047826767, + "rms": 0.08346366137266159, + "max_abs": 2.046875 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3845a664d4654d8622af3183546fa1220955445321024cf065b452af5cd30210", + "mean": -0.0012909455690532923, + "std": 0.08326598256826401, + "rms": 0.08327598869800568, + "max_abs": 2.046875 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0c96b3a86a152f344b2c8a6ffcf94f82faa674036fa3935b9d8e14338d16681e", + "mean": -0.0013165659038349986, + "std": 0.08580905199050903, + "rms": 0.08581914752721786, + "max_abs": 2.046875 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3845a664d4654d8622af3183546fa1220955445321024cf065b452af5cd30210", + "mean": -0.0012909455690532923, + "std": 0.08326598256826401, + "rms": 0.08327598869800568, + "max_abs": 2.046875 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "10ef4e5cb8ed2bfcd67e88a6d501af164e7512541776772f6f4cefdb00f55313", + "mean": -0.0012453540693968534, + "std": 0.08355861902236938, + "rms": 0.08356789499521255, + "max_abs": 2.046875 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3845a664d4654d8622af3183546fa1220955445321024cf065b452af5cd30210", + "mean": -0.0012909455690532923, + "std": 0.08326598256826401, + "rms": 0.08327598869800568, + "max_abs": 2.046875 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e412af17e035d1bd782c5f6ccba010220ea06031abd2febf975518a3af7632ac", + "mean": -0.0013399352319538593, + "std": 0.08590001612901688, + "rms": 0.08591046184301376, + "max_abs": 2.046875 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3845a664d4654d8622af3183546fa1220955445321024cf065b452af5cd30210", + "mean": -0.0012909455690532923, + "std": 0.08326598256826401, + "rms": 0.08327598869800568, + "max_abs": 2.046875 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b7fc50743ec7c7566ae628d57dd052ea7353d17e9654d687068724544f2d98a2", + "mean": -0.0012459136778488755, + "std": 0.08344011753797531, + "rms": 0.08344941586256027, + "max_abs": 2.046875 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3845a664d4654d8622af3183546fa1220955445321024cf065b452af5cd30210", + "mean": -0.0012909455690532923, + "std": 0.08326598256826401, + "rms": 0.08327598869800568, + "max_abs": 2.046875 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "98d6a219adb949b85ac84b7483dab65e50f821a4bfcd489b36969be692a19e5c", + "mean": -0.0013404391938820481, + "std": 0.08579620718955994, + "rms": 0.08580667525529861, + "max_abs": 2.046875 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 120, + "exact_hidden_rows": 120, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 1.0, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "system_bos": { + "tokens": 120, + "exact_hidden_rows": 120, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 1.0, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "system_x": { + "tokens": 120, + "exact_hidden_rows": 120, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 1.0, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "system_period": { + "tokens": 120, + "exact_hidden_rows": 120, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 1.0, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "bos_at_s0": { + "tokens": 120, + "exact_hidden_rows": 120, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 1.0, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "bos_at_s1": { + "tokens": 120, + "exact_hidden_rows": 120, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 1.0, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "x_at_s0": { + "tokens": 120, + "exact_hidden_rows": 120, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 1.0, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "x_at_s1": { + "tokens": 120, + "exact_hidden_rows": 120, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 1.0, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "period_at_s0": { + "tokens": 120, + "exact_hidden_rows": 120, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 1.0, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "period_at_s1": { + "tokens": 120, + "exact_hidden_rows": 120, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 1.0, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + } + } + }, + "layer_00": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "15c21d9b009f619bd26b96022ad93c10c86d50160db378449aa49c113d515d84", + "mean": -0.0016820330638438463, + "std": 0.0797344446182251, + "rms": 0.07975218445062637, + "max_abs": 2.375 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cf0b47defd84f75281ff4e18b648e301494a3743a8e612571bcc119a521c57b9", + "mean": -0.0016602742252871394, + "std": 0.08149036020040512, + "rms": 0.08150726556777954, + "max_abs": 2.4375 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4cf7251e1e338f74d91dca009f5566dcacd1126e98a35423682dd663119c9a9e", + "mean": -0.0016525754472240806, + "std": 0.07969988137483597, + "rms": 0.0797170102596283, + "max_abs": 2.40625 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2e4a49025bc02c10f748e73844a08f6f957a59c3b28486d0bcf5efbde9d457b5", + "mean": -0.0017032906180247664, + "std": 0.0832597091794014, + "rms": 0.083277128636837, + "max_abs": 2.4375 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f74c776392e3807c77227cb4f6656971621f3a30852538b6728672fede45b64c", + "mean": -0.0016710192430764437, + "std": 0.07977340370416641, + "rms": 0.07979089766740799, + "max_abs": 2.34375 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "641a14e75ed0af4d881aa382d6a0706f0ad871b3daba535930a0f78d51b14a65", + "mean": -0.0016373785911127925, + "std": 0.08129408955574036, + "rms": 0.08131057769060135, + "max_abs": 2.4375 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5726d9ff082e27b817c1b477167df3eb75cfb9dfd639ba057ebea39d90bb16f5", + "mean": -0.0016509669367223978, + "std": 0.07946538925170898, + "rms": 0.0794825330376625, + "max_abs": 2.328125 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "559bff6eac24d183ccc17e2896bc485bbee5b03ab6fe295fd41d7ec6a5de4070", + "mean": -0.0016898286994546652, + "std": 0.08288838714361191, + "rms": 0.082905612885952, + "max_abs": 2.4375 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fc8f0471f82b53d7a098ec0a77ab3413bd8f708ade2a67317d2ae6adfd7240e6", + "mean": -0.0016903626965358853, + "std": 0.0792163833975792, + "rms": 0.07923441380262375, + "max_abs": 2.328125 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "78b1192f051f6720502c976c00aa0ec5b5baa720d6c0c5a6a20c46037b55f43a", + "mean": -0.0016695386730134487, + "std": 0.08095725625753403, + "rms": 0.08097446709871292, + "max_abs": 2.4375 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "03f65b4a28f32ce1dbcfe3cab123e2ba9b27771d7742f8a7afa9e8f3674e1017", + "mean": -0.0016690022312104702, + "std": 0.07902012765407562, + "rms": 0.07903774827718735, + "max_abs": 2.3125 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "82f29b6188aa8d32122e4046099b8944af0ad1fe64841e6a7a919c9e4ab1a06f", + "mean": -0.0017205380136147141, + "std": 0.08268982172012329, + "rms": 0.0827077180147171, + "max_abs": 2.4375 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1ca6da8e4e81cb066b14dcdf58d4fc0f46fbe1dd64f987ab3f0574b6d2be6827", + "mean": -0.0016874190187081695, + "std": 0.07916779816150665, + "rms": 0.07918577641248703, + "max_abs": 2.3125 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4074ba049fc45a5a46aa730e90f6e22c4cc854131ba8a27dc04c83442fa5f3a4", + "mean": -0.0016667996533215046, + "std": 0.08073487132787704, + "rms": 0.08075207471847534, + "max_abs": 2.4375 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a99b31d54966577b0f4af511362c821eea95471dc9ac1050f0b51fdf663787b9", + "mean": -0.0016679217806085944, + "std": 0.07899153977632523, + "rms": 0.07900915294885635, + "max_abs": 2.3125 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "138d7cb4f554f77ef9c28f8164ced61572f32b9aed255b9b488dbb66b579cfcc", + "mean": -0.0017176688415929675, + "std": 0.08249164372682571, + "rms": 0.08250952512025833, + "max_abs": 2.4375 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9992483258247375, + "min_cosine_similarity": 0.9929951429367065, + "mean_relative_l2": 0.035730574280023575, + "max_abs_delta": 0.09375 + }, + "system_bos": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9989762902259827, + "min_cosine_similarity": 0.9856452345848083, + "mean_relative_l2": 0.040046218782663345, + "max_abs_delta": 0.109375 + }, + "system_x": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9990232586860657, + "min_cosine_similarity": 0.9861058592796326, + "mean_relative_l2": 0.03913084790110588, + "max_abs_delta": 0.0859375 + }, + "system_period": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9990537762641907, + "min_cosine_similarity": 0.9867596626281738, + "mean_relative_l2": 0.038613203912973404, + "max_abs_delta": 0.09375 + }, + "bos_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9914141297340393, + "min_cosine_similarity": 0.9366371035575867, + "mean_relative_l2": 0.12362813204526901, + "max_abs_delta": 0.17236328125 + }, + "bos_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9921147227287292, + "min_cosine_similarity": 0.9471429586410522, + "mean_relative_l2": 0.11935839802026749, + "max_abs_delta": 0.174560546875 + }, + "x_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9921921491622925, + "min_cosine_similarity": 0.9400553703308105, + "mean_relative_l2": 0.1168542131781578, + "max_abs_delta": 0.169921875 + }, + "x_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9926214218139648, + "min_cosine_similarity": 0.9498739242553711, + "mean_relative_l2": 0.11483903229236603, + "max_abs_delta": 0.1884765625 + }, + "period_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9923182129859924, + "min_cosine_similarity": 0.9416201114654541, + "mean_relative_l2": 0.11612545698881149, + "max_abs_delta": 0.1728515625 + }, + "period_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9926905035972595, + "min_cosine_similarity": 0.9503762722015381, + "mean_relative_l2": 0.11442249268293381, + "max_abs_delta": 0.1923828125 + } + } + }, + "layer_01": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "167ba8c71903d071832fb96287ff206969941e67523c8f01294ba90a6b3c30b1", + "mean": -0.0021684952080249786, + "std": 0.09699582308530807, + "rms": 0.09702005237340927, + "max_abs": 2.71875 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "26088c17342f798fc6bd4ee762315c0ee16673e562cbba84ab964eb73b537021", + "mean": -0.004024218302220106, + "std": 0.6682177186012268, + "rms": 0.6682298183441162, + "max_abs": 126.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9f6c7f4fcf75abf601b379fdb92022cecb348f46b632d31ba7287e0ccb3c6cd1", + "mean": -0.00212763505987823, + "std": 0.09707726538181305, + "rms": 0.09710057824850082, + "max_abs": 2.703125 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a549c6c74b87c33be75a6f4394bab39ab17504ddec44784b48d020957bb5036e", + "mean": -0.004017171449959278, + "std": 0.6560381650924683, + "rms": 0.6560505032539368, + "max_abs": 134.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "59cd576d9c372dcd3e42b71b737cd5a83d5645795e9f1e7b0f090d9b07bf90ab", + "mean": -0.0023029446601867676, + "std": 0.09653103351593018, + "rms": 0.09655849635601044, + "max_abs": 2.703125 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c07f83e07098361bc7ade6828b8d741ae3e6415efac5ac4ad67dbc1448e58c16", + "mean": -0.0021613857243210077, + "std": 0.10005394369363785, + "rms": 0.10007727891206741, + "max_abs": 4.71875 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bf6d23a9a878a9960266654904ea5167a016b71dd958544bc9e995e95740a3a1", + "mean": -0.0023097991943359375, + "std": 0.09536660462617874, + "rms": 0.0953945741057396, + "max_abs": 2.6875 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d3c39f09148a173d08e3802596f0cc18cc323d67b1d3da0f3014efa0b99e1a57", + "mean": -0.0022831251844763756, + "std": 0.10060692578554153, + "rms": 0.10063283145427704, + "max_abs": 4.71875 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a308532b3a9d286d2a5d05a70e3386616fc5696ac90210febcc128ca2fab1ab4", + "mean": -0.0022976661566644907, + "std": 0.09631709009408951, + "rms": 0.0963444858789444, + "max_abs": 2.71875 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1687f377695c027b178de7ed4a5fdb315b7cc7d023779dfade70789d9a638a79", + "mean": -0.0021630714181810617, + "std": 0.09992902725934982, + "rms": 0.09995243698358536, + "max_abs": 4.71875 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "42b27bcf363cf60a7647359f6d9d11151508a81a13bbc915ddf6820df92c4633", + "mean": -0.0022935091983526945, + "std": 0.09493054449558258, + "rms": 0.09495824575424194, + "max_abs": 2.6875 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f58ea9ba71c480180d965df162a7411e4cff98ef654e3f575b5b8bcaaa324577", + "mean": -0.0022787905763834715, + "std": 0.10034747421741486, + "rms": 0.10037334263324738, + "max_abs": 4.71875 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e19b8a57e65fdcce86ad9b70efea77be83d3f709f9d77fb52c5176c86d099596", + "mean": -0.0022950475104153156, + "std": 0.0962827205657959, + "rms": 0.0963100716471672, + "max_abs": 2.71875 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b1f50c0c4247637a2663fef3fe7433e76e5192ce1e6557eefc3c3263fa378a0c", + "mean": -0.002173067070543766, + "std": 0.09964649379253387, + "rms": 0.09967019408941269, + "max_abs": 4.71875 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3ab80f78b00b163d04da826f714472c8590b7e440e25b63ac35401f363f56c15", + "mean": -0.002295458922162652, + "std": 0.09492278099060059, + "rms": 0.09495052695274353, + "max_abs": 2.6875 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c235fb005b1f0306f7a4e9e0d7656ac58d8223fa581b0c577eabe21e5bc0c0c4", + "mean": -0.00228905794210732, + "std": 0.10012279450893402, + "rms": 0.10014896839857101, + "max_abs": 4.71875 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9986873865127563, + "min_cosine_similarity": 0.9894051551818848, + "mean_relative_l2": 0.04747851938009262, + "max_abs_delta": 0.0859375 + }, + "system_bos": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9972884058952332, + "min_cosine_similarity": 0.9788113236427307, + "mean_relative_l2": 0.06783948838710785, + "max_abs_delta": 0.14453125 + }, + "system_x": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9964033365249634, + "min_cosine_similarity": 0.9702984094619751, + "mean_relative_l2": 0.07596849650144577, + "max_abs_delta": 0.15625 + }, + "system_period": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.996476411819458, + "min_cosine_similarity": 0.9710217714309692, + "mean_relative_l2": 0.07541251927614212, + "max_abs_delta": 0.140625 + }, + "bos_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9905058741569519, + "min_cosine_similarity": 0.909178614616394, + "mean_relative_l2": 0.1300259381532669, + "max_abs_delta": 0.25390625 + }, + "bos_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9900594353675842, + "min_cosine_similarity": 0.9189020991325378, + "mean_relative_l2": 0.13394632935523987, + "max_abs_delta": 0.279296875 + }, + "x_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9909786581993103, + "min_cosine_similarity": 0.9034520387649536, + "mean_relative_l2": 0.12541528046131134, + "max_abs_delta": 0.33203125 + }, + "x_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9895553588867188, + "min_cosine_similarity": 0.9092744588851929, + "mean_relative_l2": 0.13586236536502838, + "max_abs_delta": 0.359375 + }, + "period_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9911417365074158, + "min_cosine_similarity": 0.9059762954711914, + "mean_relative_l2": 0.12451892346143723, + "max_abs_delta": 0.330078125 + }, + "period_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9896435141563416, + "min_cosine_similarity": 0.9081955552101135, + "mean_relative_l2": 0.1354791522026062, + "max_abs_delta": 0.34765625 + } + } + }, + "layer_02": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4ef71fe712fe6779e0533c466969940fa620df2190da671ac6b63040e356fc39", + "mean": -0.0015112865949049592, + "std": 0.11932197958230972, + "rms": 0.11933154612779617, + "max_abs": 3.6875 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8d8ff5b2880efaad616dd2ddfc0e3de52bad8c6a25ef3d6561f492d61bfad6c6", + "mean": -0.008008434437215328, + "std": 1.9945392608642578, + "rms": 1.9945552349090576, + "max_abs": 392.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1de9de822499a32f051b59143a3d39d7c10cca631fa5b6c048e21f2a5b7c82e4", + "mean": -0.0014224350452423096, + "std": 0.11890735477209091, + "rms": 0.118915855884552, + "max_abs": 3.59375 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "232079464d920bdaf4c9c0c9b9b18f24fa87258c701e86751462aecd354e8b37", + "mean": -0.008439896628260612, + "std": 2.1007487773895264, + "rms": 2.1007657051086426, + "max_abs": 436.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "003d2f2153f038e3d80a9a33e8f10228c2b847d44608f170793359b65aa959e8", + "mean": -0.0014955014921724796, + "std": 0.11837651580572128, + "rms": 0.11838596314191818, + "max_abs": 3.59375 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "75bddc76ec2d4eb332c9fe01bc187baf693c130346b6f1b70a02b37db0ec3792", + "mean": -0.0017043573316186666, + "std": 0.1815520077943802, + "rms": 0.18156000971794128, + "max_abs": 23.875 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4e87ec8ad06f61097cf89b58002c6727e40c4094ffd3766f306286f8a5564fa6", + "mean": -0.001330459606833756, + "std": 0.11720770597457886, + "rms": 0.11721525341272354, + "max_abs": 3.5 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5e41851a52952bc97b55aa427b2ce00756dd47eaf8ea55ab86b6d65efc2e093b", + "mean": -0.0016447032103314996, + "std": 0.17673099040985107, + "rms": 0.1767386496067047, + "max_abs": 23.875 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1fbc236aa6ce2918f068ab05ace9f15e3f4b877967c2cae05e01819035d1d311", + "mean": -0.0015288032591342926, + "std": 0.11767539381980896, + "rms": 0.11768531799316406, + "max_abs": 3.59375 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f91ea15e9a630b9def0d60eb67a8f07b28894a2ee4593bbaea19a12cbc7b3621", + "mean": -0.0017384202219545841, + "std": 0.18124587833881378, + "rms": 0.18125420808792114, + "max_abs": 23.875 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "493331d0aac3f474d4f85ed85b98fad6adaf18f57ceba100e29dbe0c39954d6f", + "mean": -0.0012920259032398462, + "std": 0.11640763282775879, + "rms": 0.11641480773687363, + "max_abs": 3.5 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3eca8e2ca8e145c72f7e21429f39b68ece6d31f79b703e5b62b7d37697dc7eb1", + "mean": -0.001620989409275353, + "std": 0.17639562487602234, + "rms": 0.17640307545661926, + "max_abs": 23.875 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ff6078d5fcb4bd851a7f4e893f96b41065ebaf288d563954b02c22c3dab14e74", + "mean": -0.0015012604417279363, + "std": 0.11757352948188782, + "rms": 0.11758311837911606, + "max_abs": 3.59375 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e3ac301b0ece0056f715a5bfe7a7ea4bf8a54e7c6f9c8566106a11848b004904", + "mean": -0.0017571097705513239, + "std": 0.1808808296918869, + "rms": 0.18088935315608978, + "max_abs": 23.875 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2a919c175e2dc56c838f3e111f66d77f829589845f18e82225eb8475cbf2b639", + "mean": -0.0012780845863744617, + "std": 0.1163748949766159, + "rms": 0.11638191342353821, + "max_abs": 3.5 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7e8189bbec53c749296e96dd28e231a5f567bd6225f2159792110de60d4c58fe", + "mean": -0.0016382408794015646, + "std": 0.1761268824338913, + "rms": 0.17613449692726135, + "max_abs": 23.875 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9983824491500854, + "min_cosine_similarity": 0.9869985580444336, + "mean_relative_l2": 0.05242134630680084, + "max_abs_delta": 0.1796875 + }, + "system_bos": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9966427087783813, + "min_cosine_similarity": 0.9732140898704529, + "mean_relative_l2": 0.0753265842795372, + "max_abs_delta": 0.234375 + }, + "system_x": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9953991174697876, + "min_cosine_similarity": 0.9647147059440613, + "mean_relative_l2": 0.08579857647418976, + "max_abs_delta": 0.34375 + }, + "system_period": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9954801201820374, + "min_cosine_similarity": 0.9630662798881531, + "mean_relative_l2": 0.08483520150184631, + "max_abs_delta": 0.3125 + }, + "bos_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9900804162025452, + "min_cosine_similarity": 0.8782408833503723, + "mean_relative_l2": 0.13223302364349365, + "max_abs_delta": 0.4296875 + }, + "bos_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9889125227928162, + "min_cosine_similarity": 0.8736003041267395, + "mean_relative_l2": 0.13947652280330658, + "max_abs_delta": 0.46484375 + }, + "x_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9895575046539307, + "min_cosine_similarity": 0.8481448888778687, + "mean_relative_l2": 0.1330052614212036, + "max_abs_delta": 0.5390625 + }, + "x_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9873100519180298, + "min_cosine_similarity": 0.833305835723877, + "mean_relative_l2": 0.1460101306438446, + "max_abs_delta": 0.5859375 + }, + "period_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9896276593208313, + "min_cosine_similarity": 0.8513838648796082, + "mean_relative_l2": 0.1332479566335678, + "max_abs_delta": 0.51953125 + }, + "period_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9873992204666138, + "min_cosine_similarity": 0.8320517539978027, + "mean_relative_l2": 0.1459140181541443, + "max_abs_delta": 0.5703125 + } + } + }, + "layer_03": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "99870ab3dae5d7abaf1a5fd92b831c33f566cdecfa83eece566be9f4a22a7770", + "mean": -0.0029331555124372244, + "std": 0.1463044434785843, + "rms": 0.14633384346961975, + "max_abs": 4.375 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c0fb7be51e90f85c5c2d7e4d672dc08ba6648b04a066d8bf300d467560ca4436", + "mean": -0.01144284289330244, + "std": 5.982513904571533, + "rms": 5.982524394989014, + "max_abs": 1136.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3bd64f3e27baa562d2b4a48d56443df3aa5f3110d5628fa6294a856dd3a52468", + "mean": -0.0028811548836529255, + "std": 0.146468386054039, + "rms": 0.1464967280626297, + "max_abs": 4.3125 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b7d5ff0897b0d95952c5c1e5ffab5d48683d330a740ed07690378f6c44989117", + "mean": -0.011804340407252312, + "std": 5.867950439453125, + "rms": 5.86796236038208, + "max_abs": 1136.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "143cb99f3bec82a26f783d34ccb28ad4f7fb156c7c04919409e9bf69d7396762", + "mean": -0.0029335517901927233, + "std": 0.1470070630311966, + "rms": 0.1470363289117813, + "max_abs": 4.4375 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "616708947bff129c2b69ad39da05f7f715cabc82d63c441b6f18dca3624c4aa1", + "mean": -0.004449775908142328, + "std": 5.336119174957275, + "rms": 5.336121082305908, + "max_abs": 1136.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "90580348c18643db971e88090972f6955ba3194c82f098d73fdd5a512cecca23", + "mean": -0.00294232415035367, + "std": 0.1462358683347702, + "rms": 0.14626547694206238, + "max_abs": 4.4375 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8e4ac915a5de453e2b8d075e27db1d93892b3182ab7904a6798a27525a50752b", + "mean": -0.004388304427266121, + "std": 5.0642409324646, + "rms": 5.064242839813232, + "max_abs": 1136.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2e4dbb932c9394e81b0f5097bc4f3b3970b78cec27e8aa42f2a6c5733542f09a", + "mean": -0.002977705094963312, + "std": 0.14568249881267548, + "rms": 0.1457129269838333, + "max_abs": 4.4375 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5374bd4840ee112888274ef63f4145160c5f69f1998f7da0171dd4f3a424a517", + "mean": -0.004526025149971247, + "std": 5.3360795974731445, + "rms": 5.336081504821777, + "max_abs": 1136.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1e0199da51c750232d9f6b90fe55741142d969e495eb2a0f49f35ca01612464c", + "mean": -0.002967537846416235, + "std": 0.14517690241336823, + "rms": 0.1452072411775589, + "max_abs": 4.4375 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3ccc5d7651ba3a8e80fb62a4ca3a2148df747fced177a0caf6311cfe19c2b492", + "mean": -0.00444272393360734, + "std": 5.064211368560791, + "rms": 5.064213752746582, + "max_abs": 1136.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "767cb75e5ba73cdf44900f0860df2dce914e1c8cae5584a3c7daaaa669f1c2a6", + "mean": -0.0029298460576683283, + "std": 0.14549694955348969, + "rms": 0.1455264538526535, + "max_abs": 4.4375 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ccd980dd49e5c6106e669927a5879c992ae499d1404306b1d8e50236fb86b25e", + "mean": -0.004491766449064016, + "std": 5.336068153381348, + "rms": 5.3360700607299805, + "max_abs": 1136.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "32cf3621f5499ef3389fed7726fbda45b453c3b15975e4ab937af4a91ff2dcb9", + "mean": -0.0029534564819186926, + "std": 0.14504902064800262, + "rms": 0.14507907629013062, + "max_abs": 4.4375 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "37b545a5457daec1bc653482fd642ac2770a3d4e15c9e7c67ad818a9c52c30fd", + "mean": -0.004436850547790527, + "std": 5.064201831817627, + "rms": 5.064204216003418, + "max_abs": 1136.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9983382821083069, + "min_cosine_similarity": 0.9837749004364014, + "mean_relative_l2": 0.05254834517836571, + "max_abs_delta": 0.1875 + }, + "system_bos": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9962104558944702, + "min_cosine_similarity": 0.9717061519622803, + "mean_relative_l2": 0.08078669011592865, + "max_abs_delta": 0.34375 + }, + "system_x": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.994558572769165, + "min_cosine_similarity": 0.9593248963356018, + "mean_relative_l2": 0.09386425465345383, + "max_abs_delta": 0.328125 + }, + "system_period": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.994634211063385, + "min_cosine_similarity": 0.9546582698822021, + "mean_relative_l2": 0.09287472814321518, + "max_abs_delta": 0.328125 + }, + "bos_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9909064769744873, + "min_cosine_similarity": 0.8843817710876465, + "mean_relative_l2": 0.12681564688682556, + "max_abs_delta": 0.4296875 + }, + "bos_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9893776774406433, + "min_cosine_similarity": 0.8797323107719421, + "mean_relative_l2": 0.135874405503273, + "max_abs_delta": 0.421875 + }, + "x_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9898075461387634, + "min_cosine_similarity": 0.8440771102905273, + "mean_relative_l2": 0.13030362129211426, + "max_abs_delta": 0.5625 + }, + "x_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9871000051498413, + "min_cosine_similarity": 0.8241028189659119, + "mean_relative_l2": 0.14482077956199646, + "max_abs_delta": 0.5546875 + }, + "period_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9899259209632874, + "min_cosine_similarity": 0.841137170791626, + "mean_relative_l2": 0.12939852476119995, + "max_abs_delta": 0.5546875 + }, + "period_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9868047833442688, + "min_cosine_similarity": 0.7981420755386353, + "mean_relative_l2": 0.1456574648618698, + "max_abs_delta": 0.515625 + } + } + }, + "layer_04": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0816d13e3ab8e2b6ad2f4bb90b828634a75319f83794a54de83e55a992aadf68", + "mean": -0.0033295631874352694, + "std": 0.1845930814743042, + "rms": 0.1846231073141098, + "max_abs": 5.4375 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e99b80d197ab14919003638c352cc3c13447ed7d1a1b350f042cc60fd701b338", + "mean": -0.01165094692260027, + "std": 6.24328088760376, + "rms": 6.243291854858398, + "max_abs": 1152.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7ef0fb078b987fbab3b5f6e3d36f5b6d868f296780867679a52061c1407926ed", + "mean": -0.0032741292379796505, + "std": 0.18494731187820435, + "rms": 0.18497627973556519, + "max_abs": 5.4375 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8445e6c402bf724aa3f2828e0203ff6ac898757a696dc69c1127d153c63f5b9b", + "mean": -0.012004503980278969, + "std": 6.107608795166016, + "rms": 6.1076202392578125, + "max_abs": 1152.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "82540aba4e1686c1236399b610bc5558083b8dc617df93200392b2402bff3c26", + "mean": -0.003215335076674819, + "std": 0.18667247891426086, + "rms": 0.18670016527175903, + "max_abs": 5.71875 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "30ad9cbdc38903e1e8f9d4a3e4a5437510eb7cf25be0df8a0c8734107ea7a2eb", + "mean": -0.004570687189698219, + "std": 5.5976738929748535, + "rms": 5.597675323486328, + "max_abs": 1152.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5a1d9f72182fe099c0d785a5f7e725d44b4702663717e4f0ae3149e794bd0eca", + "mean": -0.0032344588544219732, + "std": 0.18601073324680328, + "rms": 0.18603885173797607, + "max_abs": 5.6875 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3e2ff228ba4a7370784d5b8a7a44ea757b9e703738175e85a06158907b444069", + "mean": -0.004514893051236868, + "std": 5.3069891929626465, + "rms": 5.306991100311279, + "max_abs": 1152.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fcd2770a25e5a0a7f219636fdf9b3911b24e5f70f6208818ed7082e4cc388d2c", + "mean": -0.003151817014440894, + "std": 0.1854095160961151, + "rms": 0.18543630838394165, + "max_abs": 5.625 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5742e822233c16d4fdfd69dc5e4da7729b135c03c807343c95af0fde951bad25", + "mean": -0.004500248469412327, + "std": 5.5976176261901855, + "rms": 5.597619533538818, + "max_abs": 1152.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "30cf4f4557658d646d069641c1937978e60821f7a9f16dff0d1f6adec6de035c", + "mean": -0.0031878273002803326, + "std": 0.1845896989107132, + "rms": 0.18461723625659943, + "max_abs": 5.5 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7e975604300a10c85f59c0b6e6e997de01573a414c46aaed162042deef413fbd", + "mean": -0.004471927881240845, + "std": 5.3069305419921875, + "rms": 5.30693244934082, + "max_abs": 1152.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d529d1d967872df68723cf5f95ee3ca031423a0ff40d1dfb9f05c02ab9347444", + "mean": -0.003083505667746067, + "std": 0.1847812682390213, + "rms": 0.18480698764324188, + "max_abs": 5.625 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6fbb829723d2251ce55b5dbf2df96d4e616e46d90caba8a06681c15974fec8f3", + "mean": -0.004448816180229187, + "std": 5.597592353820801, + "rms": 5.597593784332275, + "max_abs": 1152.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "15df0af4ffe61fea496bcec14790a67280a0bf3d55ff6a92b5b6911c9e7ec24d", + "mean": -0.0031507345847785473, + "std": 0.18431010842323303, + "rms": 0.18433703482151031, + "max_abs": 5.46875 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "82496f24348552b0ca5ed7935e8c1424094a49d69892cbd66ec36e1506fdf308", + "mean": -0.004443534649908543, + "std": 5.306915283203125, + "rms": 5.306917190551758, + "max_abs": 1152.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9984533190727234, + "min_cosine_similarity": 0.984213650226593, + "mean_relative_l2": 0.05091942101716995, + "max_abs_delta": 0.1875 + }, + "system_bos": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9967383742332458, + "min_cosine_similarity": 0.9785153865814209, + "mean_relative_l2": 0.07553013414144516, + "max_abs_delta": 0.34375 + }, + "system_x": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9951408505439758, + "min_cosine_similarity": 0.9677678346633911, + "mean_relative_l2": 0.08929914981126785, + "max_abs_delta": 0.5 + }, + "system_period": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9950330257415771, + "min_cosine_similarity": 0.9638199210166931, + "mean_relative_l2": 0.0902729332447052, + "max_abs_delta": 0.46875 + }, + "bos_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9926145672798157, + "min_cosine_similarity": 0.8759467005729675, + "mean_relative_l2": 0.11384370177984238, + "max_abs_delta": 0.515625 + }, + "bos_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9913760423660278, + "min_cosine_similarity": 0.8738834261894226, + "mean_relative_l2": 0.1225535124540329, + "max_abs_delta": 0.625 + }, + "x_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9911342263221741, + "min_cosine_similarity": 0.8396112322807312, + "mean_relative_l2": 0.11984379589557648, + "max_abs_delta": 0.67578125 + }, + "x_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9886510372161865, + "min_cosine_similarity": 0.8222019672393799, + "mean_relative_l2": 0.135391965508461, + "max_abs_delta": 0.728515625 + }, + "period_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9910775423049927, + "min_cosine_similarity": 0.8321256637573242, + "mean_relative_l2": 0.119382344186306, + "max_abs_delta": 0.6728515625 + }, + "period_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9884218573570251, + "min_cosine_similarity": 0.811373770236969, + "mean_relative_l2": 0.13613420724868774, + "max_abs_delta": 0.7734375 + } + } + }, + "layer_05": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "83da5bf29a0f3a187aae4d498b6555f1fc77fede12758c00cc529c15165f5bae", + "mean": -0.0033702708315104246, + "std": 0.2114109843969345, + "rms": 0.2114378660917282, + "max_abs": 5.75 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ce5dc6e1ca0fef504b92f62e850925016fccb83b5a4e84b5ec2b73204ef67e1f", + "mean": -0.012672778218984604, + "std": 6.4335222244262695, + "rms": 6.433535099029541, + "max_abs": 1152.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cf818f0bc56351b5c514094d59d3b31248c3edb3747cff71052d6fb5c5f06ca3", + "mean": -0.003442069748416543, + "std": 0.21178632974624634, + "rms": 0.2118142992258072, + "max_abs": 5.75 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "891e6b0b6e18581ce2f095b6a4212047d7e098d8f0541b618d1603922f82a6a5", + "mean": -0.012940763495862484, + "std": 6.296599388122559, + "rms": 6.296612739562988, + "max_abs": 1152.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "edd06449b4c80ed4c929c81366d13e2b8de5fcfa325ba1985d92681690933732", + "mean": -0.003251973306760192, + "std": 0.21399691700935364, + "rms": 0.21402162313461304, + "max_abs": 5.8125 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8831a3dda3139c12fbcbb085b498742fa5392275452d57f3d6b5f4e2756c9416", + "mean": -0.004875590559095144, + "std": 5.69593620300293, + "rms": 5.695937633514404, + "max_abs": 1152.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1b6e1ecca875b112dc11b31e703bbbbea8b060b8ad2be263588bb6c34036bb0c", + "mean": -0.003374494146555662, + "std": 0.21309195458889008, + "rms": 0.21311867237091064, + "max_abs": 5.875 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "dfd9c97d7f34a5921565ea9b24d71e476efc942b6f4d99508d0664fa6aa855c2", + "mean": -0.004779654089361429, + "std": 5.399733066558838, + "rms": 5.399735450744629, + "max_abs": 1152.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cb16e8bf12fdb74aecc3962b28e80c1f308c1525088941d5a80d1092436e5fd5", + "mean": -0.003246534848585725, + "std": 0.21264909207820892, + "rms": 0.2126738578081131, + "max_abs": 5.875 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "69ade89f4642f151f9e2d7d00a4374a2619ac2520414f8ea746e6d2b34e003c9", + "mean": -0.0048303199000656605, + "std": 5.69587516784668, + "rms": 5.695876598358154, + "max_abs": 1152.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ca251aca24ee9e2333d2d1acbd89a1b919871d0502064e79880d33b131aa9eea", + "mean": -0.0034454097039997578, + "std": 0.21114054322242737, + "rms": 0.21116864681243896, + "max_abs": 5.9375 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7bda296adca246e2bf403b7056fc6b55ab6f7bb744ca150b731255f34c2a9143", + "mean": -0.004809088539332151, + "std": 5.399654388427734, + "rms": 5.399656295776367, + "max_abs": 1152.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1ad4deeb3a6a2101ae5da0f93ceb354e83fc0e0c0dc72a81f634e967d48f45de", + "mean": -0.0032046628184616566, + "std": 0.2123245894908905, + "rms": 0.21234877407550812, + "max_abs": 5.875 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "23b71c68e1ff6657120f2bb1f09f6c42c847d7bc8515a1a831f8196bdd518d20", + "mean": -0.004798743408173323, + "std": 5.695852279663086, + "rms": 5.695855140686035, + "max_abs": 1152.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5a959f26729b5e106254ec8ad43318f81619a8b1ec740a9603ddfe48b3998615", + "mean": -0.0034323828294873238, + "std": 0.2110147327184677, + "rms": 0.2110426425933838, + "max_abs": 5.875 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9fa1005d3b18d4b476a8c9d42ae09ed674ba58f7a93262afe6c5884acda8a1b4", + "mean": -0.004818226210772991, + "std": 5.3996405601501465, + "rms": 5.399642467498779, + "max_abs": 1152.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9978424310684204, + "min_cosine_similarity": 0.9735069274902344, + "mean_relative_l2": 0.05855262279510498, + "max_abs_delta": 0.171875 + }, + "system_bos": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9960113763809204, + "min_cosine_similarity": 0.974254846572876, + "mean_relative_l2": 0.08350419998168945, + "max_abs_delta": 0.2578125 + }, + "system_x": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9937772154808044, + "min_cosine_similarity": 0.9529705047607422, + "mean_relative_l2": 0.10182496160268784, + "max_abs_delta": 0.375 + }, + "system_period": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9935774207115173, + "min_cosine_similarity": 0.9511950612068176, + "mean_relative_l2": 0.10300026834011078, + "max_abs_delta": 0.390625 + }, + "bos_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9913778305053711, + "min_cosine_similarity": 0.8462784886360168, + "mean_relative_l2": 0.1211610808968544, + "max_abs_delta": 0.59375 + }, + "bos_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9901214241981506, + "min_cosine_similarity": 0.8403997421264648, + "mean_relative_l2": 0.1293526291847229, + "max_abs_delta": 0.6748046875 + }, + "x_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9897411465644836, + "min_cosine_similarity": 0.7938816547393799, + "mean_relative_l2": 0.1265544444322586, + "max_abs_delta": 0.78515625 + }, + "x_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9867379665374756, + "min_cosine_similarity": 0.7783113718032837, + "mean_relative_l2": 0.1446571797132492, + "max_abs_delta": 0.8857421875 + }, + "period_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9896782636642456, + "min_cosine_similarity": 0.7934666872024536, + "mean_relative_l2": 0.12641015648841858, + "max_abs_delta": 0.7734375 + }, + "period_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9863797426223755, + "min_cosine_similarity": 0.7635275721549988, + "mean_relative_l2": 0.14570672810077667, + "max_abs_delta": 0.9765625 + } + } + }, + "layer_06": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ba714ad817d74bc8cda8ca778d50f2c9fdd60ddcd5f0a0d13ab2822886bae282", + "mean": -0.0054723164066672325, + "std": 0.24953444302082062, + "rms": 0.24959442019462585, + "max_abs": 8.25 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "84ac0fce4ac0df9441b355a35fb7c85fa986da4521a49d3020dd45aca2a57144", + "mean": -0.014895536005496979, + "std": 6.551529407501221, + "rms": 6.5515456199646, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8bc30689b1459536555c7f04c57fb633468fab36b8f71ba1b2d55029680ca0b0", + "mean": -0.005571234505623579, + "std": 0.24949853122234344, + "rms": 0.24956072866916656, + "max_abs": 8.375 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "834e173c287332ba1c5b571d7b45624dfa63d106e360857ed20b2c5634875141", + "mean": -0.01509073842316866, + "std": 6.41166877746582, + "rms": 6.411685943603516, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ab6d9847cb0f0a3140d3521bcd77a85aeb0d5ab543eb4f323e38f00e958d9861", + "mean": -0.005127900745719671, + "std": 0.2511013150215149, + "rms": 0.2511536777019501, + "max_abs": 8.25 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "711d516a23dd523ea946ec25a75bf28f171572c7559a467d808561a265e8f8df", + "mean": -0.006733199581503868, + "std": 5.7882513999938965, + "rms": 5.78825569152832, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "426499fe516621b766703b8ef0bbd8df52e771bb1980140850d23b54a9eae6ab", + "mean": -0.005171023774892092, + "std": 0.24954044818878174, + "rms": 0.24959401786327362, + "max_abs": 8.5 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f65d044ce1de5246f6db686ecc70cb2500dcd30c8e0e31e350d19c02c4a178a5", + "mean": -0.0064871590584516525, + "std": 5.487412452697754, + "rms": 5.4874162673950195, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2fa13682adb84268d03fcf08ee14798b884047f11a036528500f33f774a6d222", + "mean": -0.005162886809557676, + "std": 0.2506379187107086, + "rms": 0.25069108605384827, + "max_abs": 8.375 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e455d8c4acdc70cc4965637eae713a7dc65a95c236ba5eb1891a38ecfa316b56", + "mean": -0.006676794029772282, + "std": 5.78821325302124, + "rms": 5.788217067718506, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e68e81ce1f2eb8248655768a43f19378d36a21daac0fe098dcf11db2c516a6e4", + "mean": -0.005214550998061895, + "std": 0.24742262065410614, + "rms": 0.24747756123542786, + "max_abs": 8.5 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a9d7c5579207d18490597c75835c6c143a921945e19abd04a14b9abde7e62637", + "mean": -0.006441834382712841, + "std": 5.487313270568848, + "rms": 5.487317085266113, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d20ecc4788df8db39ca5167804ce6ac1825f59cd3f505e14c03647528e8194df", + "mean": -0.005129902623593807, + "std": 0.2503950893878937, + "rms": 0.2504476308822632, + "max_abs": 8.375 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "450cbe9a857854f87133cf3ca0f0616ee0d1227f08409cbf1d68ee6f867f06eb", + "mean": -0.006631798110902309, + "std": 5.7881975173950195, + "rms": 5.788201332092285, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2f83382c2f5f941f346d204972e714736daa317bd0442eb7be8565732fc7b0eb", + "mean": -0.00523013761267066, + "std": 0.24731065332889557, + "rms": 0.24736595153808594, + "max_abs": 8.5 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f46685cdf76c352845dbf459376120be53d164e233c154f2add042bfe4497910", + "mean": -0.006468042265623808, + "std": 5.487300872802734, + "rms": 5.487304210662842, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9973993897438049, + "min_cosine_similarity": 0.9695373177528381, + "mean_relative_l2": 0.06388501077890396, + "max_abs_delta": 0.53125 + }, + "system_bos": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9956871271133423, + "min_cosine_similarity": 0.965466320514679, + "mean_relative_l2": 0.08623609691858292, + "max_abs_delta": 0.31640625 + }, + "system_x": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9931804537773132, + "min_cosine_similarity": 0.9415220618247986, + "mean_relative_l2": 0.10615639388561249, + "max_abs_delta": 0.625 + }, + "system_period": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9928277134895325, + "min_cosine_similarity": 0.9331812858581543, + "mean_relative_l2": 0.10833070427179337, + "max_abs_delta": 0.65625 + }, + "bos_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9917548298835754, + "min_cosine_similarity": 0.8513367176055908, + "mean_relative_l2": 0.11621774733066559, + "max_abs_delta": 0.671875 + }, + "bos_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9907488226890564, + "min_cosine_similarity": 0.8468590974807739, + "mean_relative_l2": 0.1229487881064415, + "max_abs_delta": 0.6015625 + }, + "x_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9901201128959656, + "min_cosine_similarity": 0.791101336479187, + "mean_relative_l2": 0.1225411593914032, + "max_abs_delta": 1.0283203125 + }, + "x_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9865378141403198, + "min_cosine_similarity": 0.7635641098022461, + "mean_relative_l2": 0.1436094343662262, + "max_abs_delta": 1.2236328125 + }, + "period_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9897991418838501, + "min_cosine_similarity": 0.7873644828796387, + "mean_relative_l2": 0.12371707707643509, + "max_abs_delta": 1.05859375 + }, + "period_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.985846221446991, + "min_cosine_similarity": 0.7453248500823975, + "mean_relative_l2": 0.1462986320257187, + "max_abs_delta": 1.3095703125 + } + } + }, + "layer_07": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "af18568c92b7445317dc4aa3d322c07cdf8094546d16aed0ddd1d02c4325c69b", + "mean": -0.005410752724856138, + "std": 0.26810064911842346, + "rms": 0.2681552469730377, + "max_abs": 8.0 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cbdcbb43719c8ab2c536adfa5b430dcd0645c3fb260c41608ab50924bfd32e42", + "mean": -0.014837984926998615, + "std": 6.571034908294678, + "rms": 6.571052074432373, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ea1f417b26eb867d87d9b6c60aafec11433c265d1dba0bc1745edc25b0536962", + "mean": -0.005444852635264397, + "std": 0.2681500315666199, + "rms": 0.26820528507232666, + "max_abs": 8.125 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "82c889d0ef5aba9ba76ee4623a6bcb396cdb38a4d565b2af602e5a2c6686b52a", + "mean": -0.015319956466555595, + "std": 6.431061267852783, + "rms": 6.431079864501953, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f4aa6b9c2d41ce0ac7e904480e4c7b3da9025f5a3a4a8d2a98c640f84ffd0765", + "mean": -0.00509340176358819, + "std": 0.26840803027153015, + "rms": 0.268456369638443, + "max_abs": 8.1875 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "20fba4af531b673bace0ade994a8bfb726f87e736362c524e715d30852b9aa95", + "mean": -0.006677522324025631, + "std": 5.7993292808532715, + "rms": 5.799333095550537, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f4417108eb6900a0e9299667a0bc3f93238a51acd52ef7e215900c79ed7aa9ba", + "mean": -0.005143130663782358, + "std": 0.26788055896759033, + "rms": 0.26792994141578674, + "max_abs": 8.5 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f41882ef64e6b55e433f3e005c326ada4e1caa34086883df4533be010d0a6fbb", + "mean": -0.006760559976100922, + "std": 5.498088359832764, + "rms": 5.4980926513671875, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7b1ab580f3d1fbd427463c537f9bf0eca212c0c55bb99e232069cc637913a9c1", + "mean": -0.0052030207589268684, + "std": 0.2677094638347626, + "rms": 0.2677600085735321, + "max_abs": 8.375 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "50ddd6626cc43ec6c27300eef513217e2c85c5ce6ab030d8391046f4401ee08d", + "mean": -0.006788918748497963, + "std": 5.799273490905762, + "rms": 5.799277305603027, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b46413cbc5af02d72b69fac76256eafe35d8a0a3f680d464a32bfdafe67bd8d7", + "mean": -0.005275106523185968, + "std": 0.2666165232658386, + "rms": 0.2666687071323395, + "max_abs": 8.4375 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0412b600a49c8fd1730c3bbe30b5d99c963f21822efa4f4cde00d9bcbc92caab", + "mean": -0.006853817962110043, + "std": 5.49800968170166, + "rms": 5.498014450073242, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9e565f7e007dd05bff44a42c4b69479279784ad1ee61cd3332d187312dc4ac3c", + "mean": -0.005186206661164761, + "std": 0.26802903413772583, + "rms": 0.2680791914463043, + "max_abs": 8.25 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "19d16bd49cd902c7d6073b5bae8a460e025ebdf845563d38657d277ebe3cddc6", + "mean": -0.006679329555481672, + "std": 5.799286365509033, + "rms": 5.799289703369141, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8b8af5a063f93120cb55a321b97e14b45b61cb13bb32454c850f2511f3a5b11d", + "mean": -0.005288091488182545, + "std": 0.26661089062690735, + "rms": 0.2666633427143097, + "max_abs": 8.5 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "97a515ffcb12de73b8ad617b9598e881c5d28fbfefed5b66e739044c6996ed97", + "mean": -0.006807987578213215, + "std": 5.498008728027344, + "rms": 5.498013019561768, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9968546032905579, + "min_cosine_similarity": 0.9607396721839905, + "mean_relative_l2": 0.07050050050020218, + "max_abs_delta": 0.421875 + }, + "system_bos": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9949911236763, + "min_cosine_similarity": 0.9547834396362305, + "mean_relative_l2": 0.09366963058710098, + "max_abs_delta": 0.453125 + }, + "system_x": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9920626878738403, + "min_cosine_similarity": 0.9217228889465332, + "mean_relative_l2": 0.1149388998746872, + "max_abs_delta": 0.625 + }, + "system_period": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9918118119239807, + "min_cosine_similarity": 0.9147390127182007, + "mean_relative_l2": 0.11610782891511917, + "max_abs_delta": 0.515625 + }, + "bos_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9911977052688599, + "min_cosine_similarity": 0.8554590940475464, + "mean_relative_l2": 0.12059303373098373, + "max_abs_delta": 0.724609375 + }, + "bos_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9901471734046936, + "min_cosine_similarity": 0.8522088527679443, + "mean_relative_l2": 0.12755833566188812, + "max_abs_delta": 0.8125 + }, + "x_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9893810749053955, + "min_cosine_similarity": 0.7994749546051025, + "mean_relative_l2": 0.12751545011997223, + "max_abs_delta": 1.171875 + }, + "x_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9856504201889038, + "min_cosine_similarity": 0.7593611478805542, + "mean_relative_l2": 0.15043093264102936, + "max_abs_delta": 1.3994140625 + }, + "period_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9889948964118958, + "min_cosine_similarity": 0.7880645394325256, + "mean_relative_l2": 0.12917488813400269, + "max_abs_delta": 1.125 + }, + "period_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9848023056983948, + "min_cosine_similarity": 0.7435626983642578, + "mean_relative_l2": 0.15364313125610352, + "max_abs_delta": 1.3994140625 + } + } + }, + "layer_08": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3d9213d82919defb9ae5252472523976ce9a08bd819b272447821e3f686b68e2", + "mean": -0.008099418133497238, + "std": 0.3092922866344452, + "rms": 0.3093983232975006, + "max_abs": 8.875 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c97958cdcbbb3a3e44cc5b410003404593cbced3f4cb6ce8cb1344025c49afbd", + "mean": -0.01713102124631405, + "std": 6.594311714172363, + "rms": 6.594334602355957, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "65c1536912e908bd4ce039ac85c9d30b93ed743fd06a586d4a4010d60e7ec47b", + "mean": -0.00805326085537672, + "std": 0.30933961272239685, + "rms": 0.309444397687912, + "max_abs": 8.9375 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b184feafea7a5b4838a560b3c2f64e90593194cf4f53f9701976b2e3338f18d5", + "mean": -0.017161119729280472, + "std": 6.4542083740234375, + "rms": 6.454231262207031, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7d0bb08246d0886efdc0871df019370feb92d4b3e517552ad000644a239fd716", + "mean": -0.00772115821018815, + "std": 0.3101637363433838, + "rms": 0.3102598190307617, + "max_abs": 8.6875 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d067d7fd346a5aa539b90c2322f5512db3caa883f3405cba62a9170353a133ac", + "mean": -0.008947106078267097, + "std": 5.812981605529785, + "rms": 5.812988758087158, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d66b84d129fd8ad70342a3f52b8157a1e2990970592bee0f98cce3c77e66093e", + "mean": -0.007850204594433308, + "std": 0.3095468580722809, + "rms": 0.3096463978290558, + "max_abs": 8.75 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "55c598fb7e85cb68f73aaba0db931756d02196f5b687d38b1f80cf7d6912ce89", + "mean": -0.008726689033210278, + "std": 5.511142730712891, + "rms": 5.511148929595947, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9b71a6fe01ee4bd9e4ddcfaf9def273e93950a3a8d692b6196c39437732639c1", + "mean": -0.007745738141238689, + "std": 0.3089451193809509, + "rms": 0.30904218554496765, + "max_abs": 8.75 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4f8d332b7f5144c196e667094f7de919f0094a0fad98972bde5eebcdb67cf627", + "mean": -0.008992215618491173, + "std": 5.812911033630371, + "rms": 5.812918186187744, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "02cb445581ea44bbd5df7a64952c0b744cd923b35b8be34fd34e9364da080a6a", + "mean": -0.007820380851626396, + "std": 0.3082142174243927, + "rms": 0.30831342935562134, + "max_abs": 8.75 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3c6cbeb0ef0afa400d8136d34fcbb1a781c3a6779b3f279b525faa56aa926520", + "mean": -0.008675776422023773, + "std": 5.511064052581787, + "rms": 5.511070251464844, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fbcbfc90a09227e1121ffde51a514048ee623c3b2bbebea9c5a197d47b924b86", + "mean": -0.007756037637591362, + "std": 0.309405654668808, + "rms": 0.30950286984443665, + "max_abs": 8.625 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e2108989aafea45f72be866fedf74727a1fb9f0b054f078fbfb18861f24484df", + "mean": -0.008979587815701962, + "std": 5.812935829162598, + "rms": 5.812942981719971, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1f8187e0713a1f9712ffafbfe33ea70efbe96540f87cb59522a4dd30bd48745e", + "mean": -0.007816416211426258, + "std": 0.3082292079925537, + "rms": 0.3083283007144928, + "max_abs": 8.75 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fe4c99a29281b6d9e7f63f8349684c7ae24fc27f717637276c76c52dd00bb172", + "mean": -0.008630302734673023, + "std": 5.511059284210205, + "rms": 5.511065483093262, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9962990283966064, + "min_cosine_similarity": 0.9561008214950562, + "mean_relative_l2": 0.07672285288572311, + "max_abs_delta": 0.78125 + }, + "system_bos": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9945675134658813, + "min_cosine_similarity": 0.9563450217247009, + "mean_relative_l2": 0.09788665175437927, + "max_abs_delta": 0.453125 + }, + "system_x": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9903958439826965, + "min_cosine_similarity": 0.9050072431564331, + "mean_relative_l2": 0.1261741816997528, + "max_abs_delta": 0.90625 + }, + "system_period": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9905568957328796, + "min_cosine_similarity": 0.9128532409667969, + "mean_relative_l2": 0.12577494978904724, + "max_abs_delta": 0.6875 + }, + "bos_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9905797243118286, + "min_cosine_similarity": 0.8215662240982056, + "mean_relative_l2": 0.12358910590410233, + "max_abs_delta": 0.84375 + }, + "bos_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9894116520881653, + "min_cosine_similarity": 0.833303689956665, + "mean_relative_l2": 0.13207286596298218, + "max_abs_delta": 0.828125 + }, + "x_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9886618852615356, + "min_cosine_similarity": 0.7691185474395752, + "mean_relative_l2": 0.13179834187030792, + "max_abs_delta": 1.3125 + }, + "x_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9841659665107727, + "min_cosine_similarity": 0.7058960795402527, + "mean_relative_l2": 0.15716606378555298, + "max_abs_delta": 1.466796875 + }, + "period_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9882243871688843, + "min_cosine_similarity": 0.7550930976867676, + "mean_relative_l2": 0.13371799886226654, + "max_abs_delta": 1.3125 + }, + "period_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9837052822113037, + "min_cosine_similarity": 0.7188242077827454, + "mean_relative_l2": 0.16021862626075745, + "max_abs_delta": 1.25 + } + } + }, + "layer_09": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4015ab44a354ea9b43ad8b2cb8294cd1d71c747e874abc7716674778c252d549", + "mean": -0.010052869096398354, + "std": 0.3536762297153473, + "rms": 0.3538190424442291, + "max_abs": 12.75 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3bc9a3aaf805ccdcc9616d536d5e3276bbf80981458df62c587078bf20a19aa4", + "mean": -0.01860995404422283, + "std": 6.596963405609131, + "rms": 6.596989154815674, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4d818bb4fb24739940599a51b20ef337f72649e68ac6a3b0b75fea6e810cbe8f", + "mean": -0.01005158107727766, + "std": 0.35322898626327515, + "rms": 0.3533719778060913, + "max_abs": 12.75 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d2d62291957b1e527b46c53ac13c601203979d9b032df874d751aecaa9343bdc", + "mean": -0.018904970958828926, + "std": 6.456790447235107, + "rms": 6.456817626953125, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4c19c7bc08a0241aa2713f1fe0d0064a4b54d9aa5539fe7809b733ce13e9a942", + "mean": -0.010105650871992111, + "std": 0.3545144200325012, + "rms": 0.35465842485427856, + "max_abs": 12.375 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fbf80a92bda67875ddb68be90f3bffcf80e74d30b376605190b78b695665fa68", + "mean": -0.010875839740037918, + "std": 5.815880298614502, + "rms": 5.815890789031982, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "26c40a48d215cd12452f6ea04668dd1c2bd9685ffd6b108ae647db2b34c8deee", + "mean": -0.010133879259228706, + "std": 0.3543327748775482, + "rms": 0.3544776439666748, + "max_abs": 12.4375 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b3efda45e41bdd79d4010de3faa850af53a8c1b603d62bd6bcd6d51335a4bed6", + "mean": -0.010805279947817326, + "std": 5.51416540145874, + "rms": 5.514175891876221, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c9de350680770d82bf803ab092906b652d9e8abb416b5e56ba33d0847504ab4a", + "mean": -0.01003274880349636, + "std": 0.353275865316391, + "rms": 0.3534182906150818, + "max_abs": 12.3125 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9360a10022086be27297879d77863827b2ec276fa5f7c9607e1e38668c31aa9f", + "mean": -0.01080628577619791, + "std": 5.815808296203613, + "rms": 5.815818786621094, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "beadc21a27e64e23a2445cb389cd2bb6a2da5ea6599304be9b5f324ffe67f98b", + "mean": -0.009756912477314472, + "std": 0.34943604469299316, + "rms": 0.34957224130630493, + "max_abs": 12.375 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ab8cab2f7268698a986b8e1efe32f7818cccfc720ab20db2e40f66d318b02f62", + "mean": -0.010487152263522148, + "std": 5.513895034790039, + "rms": 5.513905048370361, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6a8c4ab5305baebc8934acee96cc63aea03e78fb562dd8f4e1f5d8e1c8ed3bd1", + "mean": -0.010083918459713459, + "std": 0.35358119010925293, + "rms": 0.35372495651245117, + "max_abs": 12.3125 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "60f19a6c067d5a7254f5aa376adabae73143a4903f636cab510d9b66a50065b5", + "mean": -0.010770874097943306, + "std": 5.815806865692139, + "rms": 5.815817356109619, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cc0ec0cc09ae8b507450a63b3962edb63de23d6cfa6cd151f588f14c5af0ae01", + "mean": -0.010033532045781612, + "std": 0.35055258870124817, + "rms": 0.3506961464881897, + "max_abs": 12.375 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ea1f531fbdaa52cfe7028f38c331806dcaa97fed2f44089a6d24c7842d5f4fe0", + "mean": -0.010599631816148758, + "std": 5.513930320739746, + "rms": 5.513940334320068, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9959023594856262, + "min_cosine_similarity": 0.9523184895515442, + "mean_relative_l2": 0.08019878715276718, + "max_abs_delta": 1.1875 + }, + "system_bos": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9944630861282349, + "min_cosine_similarity": 0.9578201174736023, + "mean_relative_l2": 0.098923459649086, + "max_abs_delta": 0.671875 + }, + "system_x": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9890560507774353, + "min_cosine_similarity": 0.8811208605766296, + "mean_relative_l2": 0.13369061052799225, + "max_abs_delta": 1.84375 + }, + "system_period": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9897884130477905, + "min_cosine_similarity": 0.9060065150260925, + "mean_relative_l2": 0.13106176257133484, + "max_abs_delta": 1.5 + }, + "bos_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9906976819038391, + "min_cosine_similarity": 0.822358250617981, + "mean_relative_l2": 0.12243922054767609, + "max_abs_delta": 1.15625 + }, + "bos_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9896901845932007, + "min_cosine_similarity": 0.8394516706466675, + "mean_relative_l2": 0.12953799962997437, + "max_abs_delta": 1.0625 + }, + "x_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9887304306030273, + "min_cosine_similarity": 0.7790300846099854, + "mean_relative_l2": 0.13273048400878906, + "max_abs_delta": 1.640625 + }, + "x_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9835073351860046, + "min_cosine_similarity": 0.7049015164375305, + "mean_relative_l2": 0.1602490097284317, + "max_abs_delta": 2.25 + }, + "period_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9885224103927612, + "min_cosine_similarity": 0.7695350646972656, + "mean_relative_l2": 0.13360406458377838, + "max_abs_delta": 1.53125 + }, + "period_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9837006330490112, + "min_cosine_similarity": 0.7397642731666565, + "mean_relative_l2": 0.16122274100780487, + "max_abs_delta": 1.75 + } + } + }, + "layer_10": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c7799c8c6b0e94582f57f1b2b7ddcf7d444230955d4bc967aceeded17ae61c26", + "mean": -0.00905602890998125, + "std": 0.3913276493549347, + "rms": 0.39143243432044983, + "max_abs": 12.875 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1ce2d5e0ae613698b9ef404bbf384124224d3a9712f0a7e3640291bb9b37a269", + "mean": -0.018090441823005676, + "std": 6.604469299316406, + "rms": 6.604494571685791, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "247da41d4d347f49550de65ddc69fddf81c954513ae758b3a4f23efd64e3f471", + "mean": -0.009247297421097755, + "std": 0.39117708802223206, + "rms": 0.39128637313842773, + "max_abs": 12.875 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "182bd22e06fac9e34d4b981b8ef183e3fd21cdbd7513a6ad6d8416d13a3dc6af", + "mean": -0.018708616495132446, + "std": 6.464105606079102, + "rms": 6.464132308959961, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6f86032435319ab2855a2fcbb5f00a8509f0758b8f0a9bce5aaf23f4bd89cb20", + "mean": -0.009138401597738266, + "std": 0.39256101846694946, + "rms": 0.39266735315322876, + "max_abs": 12.5625 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8d6d78c04ef405167e08f1f8099edcf8bbb0a35be1ca2ecc234f765868ba0724", + "mean": -0.010420083068311214, + "std": 5.824099063873291, + "rms": 5.824108600616455, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ac7f8c94a6f9bbaee4fa66e4479c2e789dbbe4a6c8c03a1911224975bb223024", + "mean": -0.009181693196296692, + "std": 0.39240318536758423, + "rms": 0.3925105929374695, + "max_abs": 12.625 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a33cdc0da5ad335a1f15716ba0e85e9e14fc95824bb0ac5796afb7f8443e3fa5", + "mean": -0.010494597256183624, + "std": 5.522280216217041, + "rms": 5.522290229797363, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c0390f531cc4a8d7eb163234084dc8e38f4701dce78e516b7335e52ad13ec793", + "mean": -0.008967423811554909, + "std": 0.3929353952407837, + "rms": 0.39303767681121826, + "max_abs": 12.375 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cc1396a5c0b45f7f425cfe6187e815d3abcc35313837c81c4deeda28c72c6ace", + "mean": -0.010264492593705654, + "std": 5.824100494384766, + "rms": 5.8241095542907715, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "202faa60e63bb69f6d05e3577d2b4f10901a959ae5ecad46b4e88d87462505a0", + "mean": -0.008828120306134224, + "std": 0.3906964659690857, + "rms": 0.39079615473747253, + "max_abs": 12.625 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "58e1940b81da100bff4c5977376b4232d13626a166f1d2d12475e66a530172bf", + "mean": -0.010277580469846725, + "std": 5.522136688232422, + "rms": 5.522146224975586, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3689bb58a0a1af76e9a7be8e2014965454112054c77713d0475a51ab10844fce", + "mean": -0.009048908948898315, + "std": 0.3931964039802551, + "rms": 0.39330047369003296, + "max_abs": 12.375 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b4241308b960fc9fe5258150ea4b6a35919e93778cc5de798e69588303851508", + "mean": -0.010177936404943466, + "std": 5.824098110198975, + "rms": 5.8241071701049805, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a635a762a97908f9967d0c61d16e4befe4ddd8230986374df77b2f667bdb0234", + "mean": -0.009064764715731144, + "std": 0.3910786509513855, + "rms": 0.3911837041378021, + "max_abs": 12.625 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "57d3b8e3dc5098c3f5f14d5c197a1756697fa81ea7bf1ce8b69d9b758a121269", + "mean": -0.010344424284994602, + "std": 5.522141456604004, + "rms": 5.522150993347168, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9952959418296814, + "min_cosine_similarity": 0.9479648470878601, + "mean_relative_l2": 0.08702408522367477, + "max_abs_delta": 1.65625 + }, + "system_bos": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9938904047012329, + "min_cosine_similarity": 0.9553557634353638, + "mean_relative_l2": 0.10406490415334702, + "max_abs_delta": 0.75 + }, + "system_x": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9878267645835876, + "min_cosine_similarity": 0.8562027812004089, + "mean_relative_l2": 0.13981637358665466, + "max_abs_delta": 1.9375 + }, + "system_period": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9889928698539734, + "min_cosine_similarity": 0.8938796520233154, + "mean_relative_l2": 0.13602250814437866, + "max_abs_delta": 1.625 + }, + "bos_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9899073243141174, + "min_cosine_similarity": 0.819269061088562, + "mean_relative_l2": 0.1277962028980255, + "max_abs_delta": 1.4375 + }, + "bos_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9887844920158386, + "min_cosine_similarity": 0.8267806172370911, + "mean_relative_l2": 0.13544239103794098, + "max_abs_delta": 1.140625 + }, + "x_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9877427220344543, + "min_cosine_similarity": 0.7559151649475098, + "mean_relative_l2": 0.13914534449577332, + "max_abs_delta": 1.9375 + }, + "x_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.982143223285675, + "min_cosine_similarity": 0.6647459268569946, + "mean_relative_l2": 0.16774185001850128, + "max_abs_delta": 3.171875 + }, + "period_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9877141714096069, + "min_cosine_similarity": 0.7628154754638672, + "mean_relative_l2": 0.1400861144065857, + "max_abs_delta": 2.1875 + }, + "period_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9826672673225403, + "min_cosine_similarity": 0.7115603089332581, + "mean_relative_l2": 0.1678294986486435, + "max_abs_delta": 3.15625 + } + } + }, + "layer_11": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f35deef799aab3ada63dea446602681064bf01b59be3381813756fa520f9029a", + "mean": -0.008943726308643818, + "std": 0.4740235209465027, + "rms": 0.47410792112350464, + "max_abs": 17.5 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a90eb3762c4170946a534f53c8dc2e74ca2ef5faba28cedaa2cdce0c6ea42995", + "mean": -0.01771136373281479, + "std": 6.643701553344727, + "rms": 6.643725395202637, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "dbb54465ef53b790a1cbddd6377e9c71f2948061de9530e83637d2d6d2da93c4", + "mean": -0.008863595314323902, + "std": 0.4731079936027527, + "rms": 0.4731909930706024, + "max_abs": 17.5 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "50b2255aecb27e49de1e980c55726551a3947218ebe02dbf53317716838eada6", + "mean": -0.018233099952340126, + "std": 6.501692295074463, + "rms": 6.501718044281006, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3d8229f4571e2aa1684c799bfaf2f5783ecc30b08e064ec53ef4097d01ae8ab2", + "mean": -0.009108904749155045, + "std": 0.47425442934036255, + "rms": 0.47434189915657043, + "max_abs": 17.0 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d07e7da636dc0c31ba2f4d78e17ce061f148db5770e980e2d4ba06e3946c4c34", + "mean": -0.010070227086544037, + "std": 5.857249736785889, + "rms": 5.857258319854736, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f1e8f17b21d21b643c399138bf5270e889c408e865a63679d6869b8ae6234d8f", + "mean": -0.009017523378133774, + "std": 0.47424355149269104, + "rms": 0.47432926297187805, + "max_abs": 17.25 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "dd17b9c1b0a2063ecc2e9fc32fc2aee5825df29de3d24898c0f76bbdf99faba0", + "mean": -0.010165020823478699, + "std": 5.554215431213379, + "rms": 5.554224967956543, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fe0fc9b129543115d064bca1f0e80c2f1ca0491fc245467b5e07d6a55a35eb3f", + "mean": -0.00875498540699482, + "std": 0.4738638401031494, + "rms": 0.4739447236061096, + "max_abs": 16.75 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "95f5afae85d9772cf7ae8d65cca66310f96cfd8916457046d27044dc19de922e", + "mean": -0.00966077484190464, + "std": 5.857241153717041, + "rms": 5.857248306274414, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3a527f1662d6ff673dc775996b196f0c8e2d5ebfeede8cf07e2e14dc75960b3a", + "mean": -0.008314392529428005, + "std": 0.4701763391494751, + "rms": 0.47024986147880554, + "max_abs": 17.125 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f48ae95c909cd1c3199696fe4cd50915388c986e51ffc17577a6101fe85fb152", + "mean": -0.009582472033798695, + "std": 5.553869724273682, + "rms": 5.553878307342529, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "24717d93a218b69bfd155af2f33bfdd377d7fc571affd05064c3517f7199dd4c", + "mean": -0.008830484002828598, + "std": 0.47423943877220154, + "rms": 0.4743216037750244, + "max_abs": 16.875 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "64c3b9eb2a779e79ca7be17c47bf105ebd1f2cb7e4a3ed673567a28aebaeb03f", + "mean": -0.009619439952075481, + "std": 5.857229232788086, + "rms": 5.857236862182617, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6bc241b554b774b65f273524b2d6fb46831ac43378b34785cf425929e7d7eb6a", + "mean": -0.008478092029690742, + "std": 0.4711793065071106, + "rms": 0.4712555706501007, + "max_abs": 17.25 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d3479e36d958b91aaabad27561762f70a6b4141301609ed89739134a1b6faf32", + "mean": -0.009578198194503784, + "std": 5.553911209106445, + "rms": 5.553919315338135, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9950674772262573, + "min_cosine_similarity": 0.9581286907196045, + "mean_relative_l2": 0.08995695412158966, + "max_abs_delta": 1.8125 + }, + "system_bos": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9941762685775757, + "min_cosine_similarity": 0.9624383449554443, + "mean_relative_l2": 0.10154445469379425, + "max_abs_delta": 1.0625 + }, + "system_x": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.987549364566803, + "min_cosine_similarity": 0.8452041149139404, + "mean_relative_l2": 0.14196757972240448, + "max_abs_delta": 2.75 + }, + "system_period": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9888131618499756, + "min_cosine_similarity": 0.8801183104515076, + "mean_relative_l2": 0.13731782138347626, + "max_abs_delta": 3.09375 + }, + "bos_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9904552102088928, + "min_cosine_similarity": 0.8414124846458435, + "mean_relative_l2": 0.12392052263021469, + "max_abs_delta": 1.875 + }, + "bos_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9890885949134827, + "min_cosine_similarity": 0.8436937928199768, + "mean_relative_l2": 0.13286182284355164, + "max_abs_delta": 1.625 + }, + "x_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9882368445396423, + "min_cosine_similarity": 0.8020102381706238, + "mean_relative_l2": 0.1375115066766739, + "max_abs_delta": 2.3125 + }, + "x_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9831064939498901, + "min_cosine_similarity": 0.7076572775840759, + "mean_relative_l2": 0.1641848385334015, + "max_abs_delta": 3.75 + }, + "period_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.988261342048645, + "min_cosine_similarity": 0.8042546510696411, + "mean_relative_l2": 0.13794685900211334, + "max_abs_delta": 2.53125 + }, + "period_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9835032224655151, + "min_cosine_similarity": 0.7476828098297119, + "mean_relative_l2": 0.16470861434936523, + "max_abs_delta": 5.25 + } + } + }, + "layer_12": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2d08b994e2a26fa95dc33268b6bfd13d4d604b5abfb80b1db3fc982b4e988703", + "mean": -0.007370489649474621, + "std": 0.5172674059867859, + "rms": 0.517319917678833, + "max_abs": 16.125 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "986bdae125a7e8afad6db20d54748cddfd4a93b9cd1ff574a60ae45c7bae8692", + "mean": -0.016689790412783623, + "std": 6.691777229309082, + "rms": 6.691798210144043, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "88c12cdd800af2a2076aa78fc16dede45d3df0e03ed19ab605db04d326c71788", + "mean": -0.007435983046889305, + "std": 0.5176402926445007, + "rms": 0.5176936984062195, + "max_abs": 16.375 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0bb1eb633fc2e72073193b54b4897cd3ddc3fba401f26f8eba5b66cf3d7c69a0", + "mean": -0.01717302016913891, + "std": 6.5508856773376465, + "rms": 6.55090856552124, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5cd809ceac58c5283db13e31f4336d410b7c2aeef90ae4d233b8faa978f85bfc", + "mean": -0.0074784159660339355, + "std": 0.5191241502761841, + "rms": 0.5191779732704163, + "max_abs": 16.25 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "01fc84ab9726661d98fb36d43daf1ba4749d3deb2848dd7f2eeff6c8dea4157f", + "mean": -0.008859950117766857, + "std": 5.869991302490234, + "rms": 5.869997978210449, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fa6984115645cde59ed4fb64e32f5477855490ee57f3cd9597b4f25bd58e70d1", + "mean": -0.007634272798895836, + "std": 0.5193263292312622, + "rms": 0.5193824768066406, + "max_abs": 16.5 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "88a34a879de25eacbe69a5d35f2a8187e54c8479e84596e2edeeef13fe9631e8", + "mean": -0.00909951888024807, + "std": 5.566961765289307, + "rms": 5.566969871520996, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f3c31f97554ae343e12c3ca3a88664090052dfed54c18e77205293bc21691a7d", + "mean": -0.007106894161552191, + "std": 0.5191614627838135, + "rms": 0.5192101001739502, + "max_abs": 16.125 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e9949e6e4e80784569e1d36d743c16b8ba80d2a2a0a264160edc299f71297ec4", + "mean": -0.008630575612187386, + "std": 5.870023727416992, + "rms": 5.870030403137207, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3b50cfbb5f59b656b7c1b3561be27f66e3b214253e35b655077d466c33fe555f", + "mean": -0.006830776110291481, + "std": 0.5158758163452148, + "rms": 0.5159209966659546, + "max_abs": 15.75 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "910f37eba017f3ebae87afda1ab43d76d87e04021acb2c55bae6ed9121f34b6f", + "mean": -0.008499190211296082, + "std": 5.566551685333252, + "rms": 5.566558361053467, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f3c0cecac374bd97539bc50ab99022198246ce472e5ea369fbc0f51862b99640", + "mean": -0.007261274848133326, + "std": 0.5192340612411499, + "rms": 0.5192847847938538, + "max_abs": 16.125 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "50b4637b4675ab56ee61ee5f17d590ec981bcc590f502e2f114950167e2fc0ce", + "mean": -0.008549443446099758, + "std": 5.869989395141602, + "rms": 5.869996070861816, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f8a41dcfcc9900b25bae619b5c426fad79d0c1fad0c671fdb9ac381e2da9e6d4", + "mean": -0.006915900390595198, + "std": 0.5167550444602966, + "rms": 0.5168012976646423, + "max_abs": 16.125 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2cd8ab0316c07066486cf3cd87df11236a5fcf455dd5eb4b58b618cdc647158d", + "mean": -0.008349303156137466, + "std": 5.566613674163818, + "rms": 5.566619873046875, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9934678673744202, + "min_cosine_similarity": 0.9438053965568542, + "mean_relative_l2": 0.10353720188140869, + "max_abs_delta": 1.71875 + }, + "system_bos": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9928344488143921, + "min_cosine_similarity": 0.9462536573410034, + "mean_relative_l2": 0.11171888560056686, + "max_abs_delta": 1.5078125 + }, + "system_x": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9853382110595703, + "min_cosine_similarity": 0.8616455793380737, + "mean_relative_l2": 0.15554706752300262, + "max_abs_delta": 3.0 + }, + "system_period": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.986800491809845, + "min_cosine_similarity": 0.8735311031341553, + "mean_relative_l2": 0.14953891932964325, + "max_abs_delta": 2.3125 + }, + "bos_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.98886638879776, + "min_cosine_similarity": 0.8290928602218628, + "mean_relative_l2": 0.1342911273241043, + "max_abs_delta": 3.0625 + }, + "bos_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9873479008674622, + "min_cosine_similarity": 0.8306078910827637, + "mean_relative_l2": 0.14383506774902344, + "max_abs_delta": 2.5 + }, + "x_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9864038228988647, + "min_cosine_similarity": 0.8030509948730469, + "mean_relative_l2": 0.15012048184871674, + "max_abs_delta": 3.53125 + }, + "x_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9811983704566956, + "min_cosine_similarity": 0.728276789188385, + "mean_relative_l2": 0.17626675963401794, + "max_abs_delta": 2.875 + }, + "period_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9863563179969788, + "min_cosine_similarity": 0.8033896684646606, + "mean_relative_l2": 0.15005138516426086, + "max_abs_delta": 4.15625 + }, + "period_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9813544154167175, + "min_cosine_similarity": 0.7581796646118164, + "mean_relative_l2": 0.17815227806568146, + "max_abs_delta": 5.15625 + } + } + }, + "layer_13": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "85c82fcb1f56bfaae37626fc5292bd2210bbb76cfa3771c6a6dc672648039dfe", + "mean": -0.006891641300171614, + "std": 0.5377596020698547, + "rms": 0.5378037691116333, + "max_abs": 15.5625 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "aa667ef3cb3b780fcf1410b1480715b996a77bf1dbfa6f019ab05a7aef8bcd4d", + "mean": -0.016181770712137222, + "std": 6.697904586791992, + "rms": 6.6979241371154785, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "26107f206d94c7bcc7b727af08cc46ffe69529e43a136d1047d29fa4d8ba6318", + "mean": -0.006936195772141218, + "std": 0.5388057827949524, + "rms": 0.5388504266738892, + "max_abs": 15.625 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "00763c54049053f41764a8468c4a91ae922eb1dfbcfa31d78d1b5c57e36f051e", + "mean": -0.017193837091326714, + "std": 6.5573530197143555, + "rms": 6.557375907897949, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6fb2089348f57ee0fd930ccd0fb0ccf142e29d0503d1ab607965d4902e691acb", + "mean": -0.006881916429847479, + "std": 0.5407158732414246, + "rms": 0.5407596826553345, + "max_abs": 16.0 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "12492eb7b68757d7622776d9d4511046e2057f5f5c07d87ccc5b180bf40e9cd9", + "mean": -0.0082505838945508, + "std": 5.875687122344971, + "rms": 5.875693321228027, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "44a889318b1ad66d174f611bdc0b9cc5e53672fc649b52d2871a9a1ce84df881", + "mean": -0.007169527933001518, + "std": 0.540671706199646, + "rms": 0.5407192707061768, + "max_abs": 15.875 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0ddf312b7a764428395935701d9b90d521788f5a700344f904171dc4dee50b66", + "mean": -0.009114784188568592, + "std": 5.573025703430176, + "rms": 5.573033332824707, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2a01543e2a407d6ca96a6c8c4df7105bcd68956a4065d9ed8fe4a113dd440a53", + "mean": -0.006481939926743507, + "std": 0.5410265326499939, + "rms": 0.5410653948783875, + "max_abs": 14.9375 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "89df99696e822ffdbd550042a1728b15833fe6f18640fa693f6c0e65cf4a4bd8", + "mean": -0.008038334548473358, + "std": 5.875805854797363, + "rms": 5.87581205368042, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8a94aaf29f44dab92961f76e3d4b93a78d23fae39521e9d5118f14b6189f78b3", + "mean": -0.006087757647037506, + "std": 0.5371071100234985, + "rms": 0.5371416211128235, + "max_abs": 15.0 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "29d0f919b3b1880382f1fa18f9855f94e13e0c7d268350fdb84fec4d2562b845", + "mean": -0.008349314332008362, + "std": 5.572661399841309, + "rms": 5.572668075561523, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "33971c4603e6b8e11a0f58379a7cbf52e8c8c33b52990c390c1b1add0c66ffa8", + "mean": -0.006586673203855753, + "std": 0.5404843091964722, + "rms": 0.540524423122406, + "max_abs": 14.9375 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f3cb31a18e30e36a823e1ecb200c2157931a725dfd033c31a6cdffdc61bb354f", + "mean": -0.007897230796515942, + "std": 5.875696659088135, + "rms": 5.875702381134033, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e2295ac7d67e865dcd9162ae2805913ce42f35981aec89ef4fc0af2215588371", + "mean": -0.006171968299895525, + "std": 0.5377970337867737, + "rms": 0.5378324389457703, + "max_abs": 15.125 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7eba1d87f1c87cb74d3904573bad483a518337c369b09afd38bcb2de7674f7b0", + "mean": -0.008194846101105213, + "std": 5.572704315185547, + "rms": 5.5727105140686035, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9929083585739136, + "min_cosine_similarity": 0.9435856342315674, + "mean_relative_l2": 0.10849576443433762, + "max_abs_delta": 2.21875 + }, + "system_bos": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9922482371330261, + "min_cosine_similarity": 0.9369454979896545, + "mean_relative_l2": 0.11665882915258408, + "max_abs_delta": 1.796875 + }, + "system_x": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9841515421867371, + "min_cosine_similarity": 0.857749342918396, + "mean_relative_l2": 0.16273069381713867, + "max_abs_delta": 2.9375 + }, + "system_period": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.985641598701477, + "min_cosine_similarity": 0.8670910596847534, + "mean_relative_l2": 0.15686126053333282, + "max_abs_delta": 2.375 + }, + "bos_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9879648089408875, + "min_cosine_similarity": 0.8289228081703186, + "mean_relative_l2": 0.14082761108875275, + "max_abs_delta": 3.1875 + }, + "bos_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9865816235542297, + "min_cosine_similarity": 0.8222411274909973, + "mean_relative_l2": 0.14866408705711365, + "max_abs_delta": 3.8125 + }, + "x_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9852179884910583, + "min_cosine_similarity": 0.8006265759468079, + "mean_relative_l2": 0.15805014967918396, + "max_abs_delta": 4.3125 + }, + "x_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9802976250648499, + "min_cosine_similarity": 0.7358188629150391, + "mean_relative_l2": 0.1815502941608429, + "max_abs_delta": 3.0625 + }, + "period_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9851976037025452, + "min_cosine_similarity": 0.8027384281158447, + "mean_relative_l2": 0.1574414074420929, + "max_abs_delta": 5.15625 + }, + "period_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9803338646888733, + "min_cosine_similarity": 0.7641099691390991, + "mean_relative_l2": 0.18394580483436584, + "max_abs_delta": 5.65625 + } + } + }, + "layer_14": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "db464f9dade4995ff96fb2f421d0ae8b8bf6cbc87ffacaf0b8ac2227c688a75e", + "mean": -0.0064774928614497185, + "std": 0.5969075560569763, + "rms": 0.5969427227973938, + "max_abs": 18.875 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "012551db8ec21f820104636f4dd44934cc54bb743eceb1bfb388b8a9891ea725", + "mean": -0.01539967954158783, + "std": 6.714203834533691, + "rms": 6.714221477508545, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0c07e9fb24ebd9dcc9805310e1771c66812e01707733e979dc121500dfa1d5a0", + "mean": -0.006692484021186829, + "std": 0.5978907346725464, + "rms": 0.5979282259941101, + "max_abs": 19.0 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fca02665f225e98992efb2375fb2e6ef43b153510773a809eca2dc162fb8fa99", + "mean": -0.016782600432634354, + "std": 6.572651386260986, + "rms": 6.5726728439331055, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5adf67e1653ec166e21a7d7364dde3baf271d8e6788a63f6cb87bfc4f39110ba", + "mean": -0.0065245856530964375, + "std": 0.600875735282898, + "rms": 0.6009111404418945, + "max_abs": 19.25 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "712b41b26f32340295a72ac0cccc137fb3225357468d8f7cb668f9394005178b", + "mean": -0.007546135690063238, + "std": 5.893564224243164, + "rms": 5.893568992614746, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6f4e3e5207257d3eac801ddd2101f02aa226eb2b0e444a3aa0230a9ef720e2a4", + "mean": -0.006910219788551331, + "std": 0.6008901596069336, + "rms": 0.600929856300354, + "max_abs": 19.25 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "71dc74ed5832fb2519f681fb65f7cd7088cc99f0b253aa8400ba2d4cbacfbbcc", + "mean": -0.008657483384013176, + "std": 5.590353488922119, + "rms": 5.590360164642334, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d9ac991a5d373ca3a9fa5d7f782a677dae5b308a3216143ccbcef07e8247e116", + "mean": -0.006480485200881958, + "std": 0.6005047559738159, + "rms": 0.6005397439002991, + "max_abs": 18.875 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4afc7527a4cdb01b5fc47473a3a8e236d22fe083e28278f6daae2ae64bf31ede", + "mean": -0.0076141357421875, + "std": 5.893672943115234, + "rms": 5.893677711486816, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "882090ebe918ed8d98bd21bb3801bf9eacce600fe13bae771d328a2430b8bc60", + "mean": -0.006154352333396673, + "std": 0.5961741805076599, + "rms": 0.5962059497833252, + "max_abs": 17.375 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "42017c67dc2613dcea3cb413a90f7d534e51604c9f2445fc50a0b94e0cded2cf", + "mean": -0.008180370554327965, + "std": 5.5899200439453125, + "rms": 5.589926242828369, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9c673ed2301e618f07207ea2aac98110075b11c3c75f1b2fbce50e9b78ffec46", + "mean": -0.0064232321456074715, + "std": 0.6004361510276794, + "rms": 0.6004704833030701, + "max_abs": 18.75 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ddf559619779e5fe0c8209d6c19cb265ea8d72a99d7fcec222103b3e7c2c9199", + "mean": -0.007365036755800247, + "std": 5.893580436706543, + "rms": 5.893585205078125, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d5fee7469c00d1d04f9b8a22f62b50cefaa0e9d747fdfa5ef08e765f73456061", + "mean": -0.006131851579993963, + "std": 0.5973197817802429, + "rms": 0.5973512530326843, + "max_abs": 17.875 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "346dc81d0648d28693cd6c33285b0b0a9a2800696a6f32379a39c1d912793b77", + "mean": -0.00801373552531004, + "std": 5.589962005615234, + "rms": 5.589968681335449, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9921448826789856, + "min_cosine_similarity": 0.9377957582473755, + "mean_relative_l2": 0.11433806270360947, + "max_abs_delta": 2.0625 + }, + "system_bos": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9914420247077942, + "min_cosine_similarity": 0.9394263029098511, + "mean_relative_l2": 0.12306423485279083, + "max_abs_delta": 1.625 + }, + "system_x": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9824656248092651, + "min_cosine_similarity": 0.8509494662284851, + "mean_relative_l2": 0.17334458231925964, + "max_abs_delta": 4.8125 + }, + "system_period": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9838328957557678, + "min_cosine_similarity": 0.8464322686195374, + "mean_relative_l2": 0.16717354953289032, + "max_abs_delta": 3.875 + }, + "bos_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9873146414756775, + "min_cosine_similarity": 0.8215208649635315, + "mean_relative_l2": 0.14523044228553772, + "max_abs_delta": 3.0625 + }, + "bos_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9859821796417236, + "min_cosine_similarity": 0.8185500502586365, + "mean_relative_l2": 0.15279553830623627, + "max_abs_delta": 2.79638671875 + }, + "x_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.984286904335022, + "min_cosine_similarity": 0.7980663776397705, + "mean_relative_l2": 0.16404856741428375, + "max_abs_delta": 3.9375 + }, + "x_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9792242646217346, + "min_cosine_similarity": 0.7385540008544922, + "mean_relative_l2": 0.1881568878889084, + "max_abs_delta": 4.4375 + }, + "period_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9842832684516907, + "min_cosine_similarity": 0.7931340932846069, + "mean_relative_l2": 0.1632058024406433, + "max_abs_delta": 5.125 + }, + "period_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9791272878646851, + "min_cosine_similarity": 0.7553045749664307, + "mean_relative_l2": 0.19076697528362274, + "max_abs_delta": 5.71875 + } + } + }, + "layer_15": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ec485511aeb00c6d35704180090b48524e8952d3acbaeff494b55a4ac5501eab", + "mean": -0.006724955514073372, + "std": 0.648033082485199, + "rms": 0.6480679512023926, + "max_abs": 21.75 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5a3ec5cdc106c1c874406f68d88e49e874946e7392511a7a2cab4c4638d7e8c7", + "mean": -0.015203813090920448, + "std": 6.721960067749023, + "rms": 6.721977710723877, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c415fadefa113df3f9f03de69d674953fb49caf81345b1e6ed11d9c8a917045a", + "mean": -0.006944297347217798, + "std": 0.6472564935684204, + "rms": 0.6472936868667603, + "max_abs": 21.75 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b27d1e64fad4f6c31803d55bc8464aa2c9557aba51e1e201b8e1dc7cfc232f4f", + "mean": -0.01687755063176155, + "std": 6.580928802490234, + "rms": 6.580950736999512, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8021d62546ae1a18858ddfe735fb3d7020fdab4a0471e3f61eb55c0f56d8ddbf", + "mean": -0.0064333234913647175, + "std": 0.6503723859786987, + "rms": 0.6504042148590088, + "max_abs": 22.75 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "736502faceb7ac690115874b317a701160e2c615ad34a0f2639d9b1a4e907dbf", + "mean": -0.007131175138056278, + "std": 5.901774883270264, + "rms": 5.901779651641846, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3c8b38133825ebb2fff8e8cd7300fd3f919c8f53c35798b73fbe0ecbca1319cf", + "mean": -0.00710960803553462, + "std": 0.6499459147453308, + "rms": 0.6499847769737244, + "max_abs": 22.25 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ec5fd3d1ecfc9fa04b5cb027ef33de444c0b6953e9fa1996cd2e2a3a131032c8", + "mean": -0.008754786103963852, + "std": 5.599334716796875, + "rms": 5.599341869354248, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "06bf6243e3827d552a97bf36b6f11d9c8501e6fd260e0c2179b081a8cf6f3871", + "mean": -0.006528524216264486, + "std": 0.6518097519874573, + "rms": 0.651842474937439, + "max_abs": 21.125 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "77ab51582509c72d1ef60a38ba481d38a24a33799fa03aaa478dad1b11311a35", + "mean": -0.00726332189515233, + "std": 5.902050018310547, + "rms": 5.902054309844971, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d606c39b3d38f97230a164c36fe9bae6026b5649c829224047c42e115d80a7da", + "mean": -0.007106282282620668, + "std": 0.6476224064826965, + "rms": 0.6476614475250244, + "max_abs": 20.125 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3b0e3b403d5a114f7ea365d28d38ab9f746f68ce8411097b908f24d37d9614f8", + "mean": -0.008864578790962696, + "std": 5.599054336547852, + "rms": 5.599061489105225, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5cd485c0bc151112c6fa798a5d5074b1c7346ae8c7beea585917c6366cf6b8d2", + "mean": -0.006648648995906115, + "std": 0.6527009010314941, + "rms": 0.6527347564697266, + "max_abs": 21.375 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b414f03ae5b8865bc64c6298b1ff298e65810c3a3812eb3e69d10231ca4f00cb", + "mean": -0.007178900297731161, + "std": 5.902045249938965, + "rms": 5.902049541473389, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4e49a6cf9c97c6fe4b45cdc5bf99fa0d347492bc675e48149b47e94505e85aed", + "mean": -0.006821912247687578, + "std": 0.6496359705924988, + "rms": 0.6496717929840088, + "max_abs": 20.625 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "88adc21016267e51c233db1da5bdf434da69260274786c7405353b7619c89f69", + "mean": -0.008464382030069828, + "std": 5.5992112159729, + "rms": 5.599217414855957, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.991338849067688, + "min_cosine_similarity": 0.9377532005310059, + "mean_relative_l2": 0.12016589939594269, + "max_abs_delta": 2.375 + }, + "system_bos": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9906491637229919, + "min_cosine_similarity": 0.949435830116272, + "mean_relative_l2": 0.12903042137622833, + "max_abs_delta": 2.75 + }, + "system_x": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9798253178596497, + "min_cosine_similarity": 0.8306182622909546, + "mean_relative_l2": 0.1870489865541458, + "max_abs_delta": 6.5 + }, + "system_period": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9820050597190857, + "min_cosine_similarity": 0.8277722001075745, + "mean_relative_l2": 0.1773025393486023, + "max_abs_delta": 5.625 + }, + "bos_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.985901951789856, + "min_cosine_similarity": 0.8107340335845947, + "mean_relative_l2": 0.1524811089038849, + "max_abs_delta": 3.25 + }, + "bos_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9852179884910583, + "min_cosine_similarity": 0.8162121176719666, + "mean_relative_l2": 0.15757057070732117, + "max_abs_delta": 3.3828125 + }, + "x_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9832174777984619, + "min_cosine_similarity": 0.801020622253418, + "mean_relative_l2": 0.17020662128925323, + "max_abs_delta": 3.9375 + }, + "x_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9775341749191284, + "min_cosine_similarity": 0.7306162118911743, + "mean_relative_l2": 0.1972021758556366, + "max_abs_delta": 5.875 + }, + "period_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9830306768417358, + "min_cosine_similarity": 0.7917680740356445, + "mean_relative_l2": 0.1707243025302887, + "max_abs_delta": 4.4375 + }, + "period_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9769947528839111, + "min_cosine_similarity": 0.7366588711738586, + "mean_relative_l2": 0.20098890364170074, + "max_abs_delta": 6.46875 + } + } + }, + "layer_16": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4bc64d92fae87998c5e7cad5d0f012592f943369d70fa17e76e05b869d82d213", + "mean": -0.006356509868055582, + "std": 0.7209303379058838, + "rms": 0.7209583520889282, + "max_abs": 24.375 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f2716826ff4e87575dba52a8e49d0b8c26de7b99d02f3d5bd77f8135d45f4fd1", + "mean": -0.014777770265936852, + "std": 6.732377052307129, + "rms": 6.732393741607666, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d537c7d0b7a93b8ce232d234bfcc123beff7e21bc0f9fd5ce5046dc4fa834fcb", + "mean": -0.006633473560214043, + "std": 0.719999372959137, + "rms": 0.7200299501419067, + "max_abs": 24.25 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d987405f8d3a813249acf3a7fff33227b5d94e9c3cf05ded946a464dbd18bcd1", + "mean": -0.01632131077349186, + "std": 6.591464996337891, + "rms": 6.591485500335693, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "70f2d55151431145e0903269a0efef236f209431040be67751d5a54a75a46fa0", + "mean": -0.006081284023821354, + "std": 0.721713125705719, + "rms": 0.7217387557029724, + "max_abs": 25.5 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3ed540c09899ae8fe015af73dd3b90f43478ac9c1752139d03235c2f2f7804c4", + "mean": -0.0067258840426802635, + "std": 5.912608623504639, + "rms": 5.912611961364746, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e01b6467bba27d066ec75ee2634e32f06376214666111b86b28f8ca9a0e88963", + "mean": -0.007046000100672245, + "std": 0.7231893539428711, + "rms": 0.7232236862182617, + "max_abs": 24.75 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f36a88494e511b11495f5109f01c93f6163853f32d69c50d8b7d31c3bf10d4c2", + "mean": -0.0082992073148489, + "std": 5.611069202423096, + "rms": 5.611075401306152, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8f34d536e863f21e58914be27d9519eab67345bfdbef4e2b270fd2b7260d488d", + "mean": -0.005883449222892523, + "std": 0.7243444919586182, + "rms": 0.7243683338165283, + "max_abs": 24.625 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b376dfffcd23e24c98e76a06d083562bd95a9cd19f1815e86d9ce46cc48720d5", + "mean": -0.006633169017732143, + "std": 5.913179397583008, + "rms": 5.913182735443115, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c02b0700b18d560cb1d16b2a3f7dc5a8636bfe68c8da66d983d6496f6427e18c", + "mean": -0.00670438539236784, + "std": 0.720439612865448, + "rms": 0.7204707860946655, + "max_abs": 23.375 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9cbdaaa1cfc22082e4a99f1715d67fa8f83e0cd905bcc648d7267d2168ca7a08", + "mean": -0.008222810924053192, + "std": 5.610887050628662, + "rms": 5.610893249511719, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "33986ddf696cffdb552c997a8d7fd73a0a48c0ae04114dca8b56dce0f6d4cb48", + "mean": -0.00618144404143095, + "std": 0.7253277897834778, + "rms": 0.7253541350364685, + "max_abs": 24.75 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "51d47b4813a75f0a2534642da57d9486472df395acae4e989a1add76b1cdfc5c", + "mean": -0.006657739169895649, + "std": 5.913067817687988, + "rms": 5.913071155548096, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f1386c4d765fc1e6a16c647e90f917ee7f79b15366217914ff2bb521e77582ef", + "mean": -0.006532028783112764, + "std": 0.7229915261268616, + "rms": 0.7230210304260254, + "max_abs": 24.125 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7de186e854bd7f131526755773a5bfb9b05c58cbd23dd45aa8abeb3d75729c88", + "mean": -0.007825116626918316, + "std": 5.611011028289795, + "rms": 5.611016750335693, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.99094557762146, + "min_cosine_similarity": 0.9372300505638123, + "mean_relative_l2": 0.12416990101337433, + "max_abs_delta": 2.46875 + }, + "system_bos": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9899278283119202, + "min_cosine_similarity": 0.9555598497390747, + "mean_relative_l2": 0.13453572988510132, + "max_abs_delta": 3.6875 + }, + "system_x": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9780378341674805, + "min_cosine_similarity": 0.8218382596969604, + "mean_relative_l2": 0.19573016464710236, + "max_abs_delta": 7.375 + }, + "system_period": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9811236262321472, + "min_cosine_similarity": 0.8239721059799194, + "mean_relative_l2": 0.1824931651353836, + "max_abs_delta": 5.53125 + }, + "bos_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9854757189750671, + "min_cosine_similarity": 0.8086918592453003, + "mean_relative_l2": 0.1554218977689743, + "max_abs_delta": 3.25 + }, + "bos_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9845729470252991, + "min_cosine_similarity": 0.8114530444145203, + "mean_relative_l2": 0.1615600287914276, + "max_abs_delta": 3.798828125 + }, + "x_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9824448227882385, + "min_cosine_similarity": 0.8005750179290771, + "mean_relative_l2": 0.1751565784215927, + "max_abs_delta": 3.65625 + }, + "x_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9771867394447327, + "min_cosine_similarity": 0.727762758731842, + "mean_relative_l2": 0.19915279746055603, + "max_abs_delta": 6.25 + }, + "period_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9825619459152222, + "min_cosine_similarity": 0.7889223098754883, + "mean_relative_l2": 0.17383155226707458, + "max_abs_delta": 4.0625 + }, + "period_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9767546057701111, + "min_cosine_similarity": 0.7393003702163696, + "mean_relative_l2": 0.20269380509853363, + "max_abs_delta": 6.4375 + } + } + }, + "layer_17": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "87384b09edd4377128c2a8de3a34b23364bf8c57bccf03eb3491ca30f85de82c", + "mean": -0.004252369049936533, + "std": 0.8184552192687988, + "rms": 0.8184662461280823, + "max_abs": 27.625 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "617a21030209522eef07ed24bfb28c0f703c0afb2feb748b180bc3fdb25ecdcb", + "mean": -0.013345767743885517, + "std": 6.746331691741943, + "rms": 6.746345043182373, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "da912512e927e279420fd873514b785960de1223d179dc9d14481ccdcd42f232", + "mean": -0.004528460092842579, + "std": 0.817801296710968, + "rms": 0.8178138732910156, + "max_abs": 28.0 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ef37f97c8f26b0d308ad5d4efc91f47a8193178323e5f5dcfbb90adff8dd1bc8", + "mean": -0.015532582066953182, + "std": 6.606093883514404, + "rms": 6.606112003326416, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cac62eaf224dfb01ea7abae58613bf96ca1dcbc9b5374868e8984a42dc63926f", + "mean": -0.003911613952368498, + "std": 0.8188574910163879, + "rms": 0.8188668489456177, + "max_abs": 29.625 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6a3aa2bee03f01420538c01302980fa68d747e4aa416b8fca340f8d243b0aefe", + "mean": -0.005232864525169134, + "std": 5.9278740882873535, + "rms": 5.9278764724731445, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cdf61469179a301022016c640d48eaf3ef49603eb71e78240bb999527bd0f8d0", + "mean": -0.004853137768805027, + "std": 0.8199006915092468, + "rms": 0.8199149966239929, + "max_abs": 27.625 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "95bac4cb636a0b3ddbd1a47ace800d3643b2e547611e3bb57ce8865cf4893200", + "mean": -0.007468895986676216, + "std": 5.6276535987854, + "rms": 5.627658367156982, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "17eee28dd810b2c8ff47b37e18147e4e56f8aef6f2877a0c216d51fd0bf60b49", + "mean": -0.0035423128865659237, + "std": 0.8212191462516785, + "rms": 0.8212267756462097, + "max_abs": 28.875 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "caeb38900e63b2994715f768e7fae08151759961068f23b07300a1e840dd7fa7", + "mean": -0.005033585708588362, + "std": 5.9285430908203125, + "rms": 5.928544998168945, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4d7bf4f4af7afbdf80bcb23696f6bc6ee9a99376ed0ff9374cea32624e5cb2d7", + "mean": -0.004836700391024351, + "std": 0.8169070482254028, + "rms": 0.8169213533401489, + "max_abs": 27.125 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8f40b22da71fe7cf845ba4f63f71418fd52003c736ddf58e9ad96ab502e56c3f", + "mean": -0.007662551011890173, + "std": 5.6274919509887695, + "rms": 5.62749719619751, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d85f8d31716deba78d2170ecd6e26ee55d545bc428dc3e7cee0d3084eff06035", + "mean": -0.0038813191931694746, + "std": 0.8229590654373169, + "rms": 0.8229681849479675, + "max_abs": 29.0 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "514a1b9b8158680c8e1a0e23df9bb454a65b323d50f87125eecf10ffdd315cc7", + "mean": -0.0050419531762599945, + "std": 5.928488731384277, + "rms": 5.928490161895752, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d5d179597185bf7d5ef7ccfbfd95f3a5be41fc2d294609cfb174f77936ec33c3", + "mean": -0.004523523151874542, + "std": 0.819002091884613, + "rms": 0.8190146088600159, + "max_abs": 27.25 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ab569513794d0805a895644565273b22e7e87f61c6ab0ebe4e92520a96b3053f", + "mean": -0.007147695869207382, + "std": 5.627638339996338, + "rms": 5.62764310836792, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9916603565216064, + "min_cosine_similarity": 0.9412868022918701, + "mean_relative_l2": 0.11997140198945999, + "max_abs_delta": 2.5625 + }, + "system_bos": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.990578293800354, + "min_cosine_similarity": 0.9560781121253967, + "mean_relative_l2": 0.13057735562324524, + "max_abs_delta": 3.875 + }, + "system_x": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9791480302810669, + "min_cosine_similarity": 0.825799822807312, + "mean_relative_l2": 0.19145536422729492, + "max_abs_delta": 7.78125 + }, + "system_period": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9822043180465698, + "min_cosine_similarity": 0.833646297454834, + "mean_relative_l2": 0.17713861167430878, + "max_abs_delta": 5.875 + }, + "bos_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9866993427276611, + "min_cosine_similarity": 0.8093810081481934, + "mean_relative_l2": 0.1486467570066452, + "max_abs_delta": 3.875 + }, + "bos_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9859710335731506, + "min_cosine_similarity": 0.8151213526725769, + "mean_relative_l2": 0.15372566878795624, + "max_abs_delta": 4.1953125 + }, + "x_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9838444590568542, + "min_cosine_similarity": 0.8185834884643555, + "mean_relative_l2": 0.16857954859733582, + "max_abs_delta": 4.09375 + }, + "x_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9794542789459229, + "min_cosine_similarity": 0.7572557926177979, + "mean_relative_l2": 0.18997256457805634, + "max_abs_delta": 6.375 + }, + "period_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9839652180671692, + "min_cosine_similarity": 0.8035808801651001, + "mean_relative_l2": 0.16727662086486816, + "max_abs_delta": 3.4375 + }, + "period_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9790270328521729, + "min_cosine_similarity": 0.7745312452316284, + "mean_relative_l2": 0.1930469572544098, + "max_abs_delta": 4.25 + } + } + }, + "layer_18": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3117d8e432b3309cc3bc0b2576950ead0ceee3cca890ddbc00053cd9280e3863", + "mean": -0.0029638935811817646, + "std": 0.9155916571617126, + "rms": 0.9155964255332947, + "max_abs": 33.25 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "66e5fe70afaa8cb6c82251937b546f16daabd54f4682513f06cf14f4d886df45", + "mean": -0.01226869411766529, + "std": 6.764088153839111, + "rms": 6.76409912109375, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4c55aa4f54fcae5ec8327eb4e5cfc6aa72cb91bff48013cd39cfc5281f2c065e", + "mean": -0.003290749154984951, + "std": 0.9118579030036926, + "rms": 0.9118638038635254, + "max_abs": 33.25 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "332c76217dd60b049ca3fac12f23749b582b1d5fd7416259c429bd13bdafb4c7", + "mean": -0.01445729099214077, + "std": 6.62438440322876, + "rms": 6.624400615692139, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2e852d243022ac2689e40fcafa9424de3622c4c43664e6f365cf48848ec0bfa8", + "mean": -0.002497546374797821, + "std": 0.9147453308105469, + "rms": 0.9147487282752991, + "max_abs": 34.0 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "03cf95fcaabc803c4ffb7b6b9016b27ac4f2b9075d4f5b831d65ceef30564277", + "mean": -0.003943729214370251, + "std": 5.945600986480713, + "rms": 5.9456024169921875, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "68a8cf05adc811cdabce43ca8a3c98583e29889e185e96d7b32dbe9638a99e24", + "mean": -0.003428312484174967, + "std": 0.9145280718803406, + "rms": 0.9145344495773315, + "max_abs": 32.75 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9719bab33bd33119d93bf98d2a0be368c8b0a401da559c63ba5dacbf041be4e7", + "mean": -0.0061599863693118095, + "std": 5.646913528442383, + "rms": 5.646917343139648, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a1cce618bd1fc36b82583259ac0bf2a11ddf42a1cf35e206b20a718db347ed52", + "mean": -0.0019557583145797253, + "std": 0.9203752279281616, + "rms": 0.9203773140907288, + "max_abs": 32.5 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "523d2444daf6c6d52b51c5dc1ce0fa381f551cb10f202e76cdb5417082e6215a", + "mean": -0.0036895053926855326, + "std": 5.946865558624268, + "rms": 5.946866512298584, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6b40cb9ad93c9fa1fe1c0f536a87bca4254c2471ade21d8057efc3eafee33da5", + "mean": -0.0036321543157100677, + "std": 0.9125800728797913, + "rms": 0.9125872850418091, + "max_abs": 30.0 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "96aa66b46723d1889aa70902520a9f77c16b05e076985fcb1c8ab4fd4df61ee9", + "mean": -0.006530937273055315, + "std": 5.647012710571289, + "rms": 5.647017002105713, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f81ecbd4355f42d1d01ba1b1968b655401099fa39b841d30e4ca5078a58d6968", + "mean": -0.002434315625578165, + "std": 0.9218770265579224, + "rms": 0.9218801856040955, + "max_abs": 32.25 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1fe1d46dce91bb3c7b1f10fb5a5e0b207fbe4c4ed838942f7ffef1965e207039", + "mean": -0.0037977544125169516, + "std": 5.946796894073486, + "rms": 5.946798801422119, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b55c1199cfc5ad45840f8fdc239c0c14eafc5b2ee5d8782eb18fdf0220d2f646", + "mean": -0.0032431185245513916, + "std": 0.9153977036476135, + "rms": 0.915403425693512, + "max_abs": 30.25 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f5fa1c9c53c96d7ed884baf8051c822ebfd8d43fbfe18d2265eeb81c47903d2b", + "mean": -0.005976058542728424, + "std": 5.64717435836792, + "rms": 5.647177696228027, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9914354085922241, + "min_cosine_similarity": 0.9370853900909424, + "mean_relative_l2": 0.12194544821977615, + "max_abs_delta": 2.8125 + }, + "system_bos": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9905374050140381, + "min_cosine_similarity": 0.9551035165786743, + "mean_relative_l2": 0.1312474012374878, + "max_abs_delta": 4.625 + }, + "system_x": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9782482981681824, + "min_cosine_similarity": 0.8113369941711426, + "mean_relative_l2": 0.19616122543811798, + "max_abs_delta": 9.5 + }, + "system_period": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9812195897102356, + "min_cosine_similarity": 0.8171917200088501, + "mean_relative_l2": 0.18256187438964844, + "max_abs_delta": 7.5 + }, + "bos_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9862962365150452, + "min_cosine_similarity": 0.7979129552841187, + "mean_relative_l2": 0.1508438140153885, + "max_abs_delta": 4.34765625 + }, + "bos_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9855324029922485, + "min_cosine_similarity": 0.8053848743438721, + "mean_relative_l2": 0.15591831505298615, + "max_abs_delta": 5.66796875 + }, + "x_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9832770228385925, + "min_cosine_similarity": 0.808295726776123, + "mean_relative_l2": 0.171897754073143, + "max_abs_delta": 5.125 + }, + "x_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9788990020751953, + "min_cosine_similarity": 0.7485921382904053, + "mean_relative_l2": 0.19301411509513855, + "max_abs_delta": 8.25 + }, + "period_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9833097457885742, + "min_cosine_similarity": 0.786497950553894, + "mean_relative_l2": 0.17070554196834564, + "max_abs_delta": 4.3125 + }, + "period_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9782759547233582, + "min_cosine_similarity": 0.7623828053474426, + "mean_relative_l2": 0.19701920449733734, + "max_abs_delta": 6.0 + } + } + }, + "layer_19": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6cfaf7e8739b53ae55a18dfbd0eafa2d0b61e5fc1f82ac95e0330bc7ed97c0af", + "mean": -0.00040833279490470886, + "std": 1.0072084665298462, + "rms": 1.0072085857391357, + "max_abs": 31.625 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4895c68c8571f3fca6804843d3e0cd3aa9719512e76f5484dfb6bb0e30fcce1b", + "mean": -0.009812873788177967, + "std": 6.775091648101807, + "rms": 6.77509880065918, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "86e7a610f1fb2b3cfb09fe1f4767006259b098d8d4631fc605a73e5941cb2860", + "mean": -0.0006747120642103255, + "std": 1.0035367012023926, + "rms": 1.0035370588302612, + "max_abs": 31.375 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c4c313d63428dd453864bc7db3471522fe2782896ac0613b58064bddb4a342ab", + "mean": -0.011859847232699394, + "std": 6.636696815490723, + "rms": 6.636707305908203, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "69482fc13abd1c21ed7a2a5e87f9b13b83b1cb56b7730335e24839d6ae2dc46c", + "mean": 6.836366810603067e-05, + "std": 1.0081301927566528, + "rms": 1.0081301927566528, + "max_abs": 32.25 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c7c8e359a44af5524345394113b1488d2209dbd4c5e9aad9b4fc15098ae30b9f", + "mean": -0.0016446347581222653, + "std": 5.958713054656982, + "rms": 5.958714008331299, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e653b2972ea4c2718c12bbf4c8095d8010f4ba9cd223300d0647db453c37e58a", + "mean": -0.0009930796222761273, + "std": 1.0078554153442383, + "rms": 1.0078558921813965, + "max_abs": 30.875 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c96b9853157bd8c1478c3001cb38132fd1fe02a512184ca23136a98e7a68a0f2", + "mean": -0.003736198414117098, + "std": 5.661512851715088, + "rms": 5.6615142822265625, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "085ef46a2709ce79008e530f59b9d7d18c7fa8d686880a38a0583b7a36076c06", + "mean": 0.0009397336980327964, + "std": 1.0133718252182007, + "rms": 1.0133721828460693, + "max_abs": 30.75 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e3c8c3283e687ad9958dec9e8ef8038e4900ef57c065d1fef3c431717ac1ef59", + "mean": -0.0010466744424775243, + "std": 5.960222244262695, + "rms": 5.9602227210998535, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "502c6e585e2bcbe04549a93222fea0a20f4fc7e8f80868a623e4373726b9f9a5", + "mean": -0.0003825354215223342, + "std": 1.0064711570739746, + "rms": 1.0064711570739746, + "max_abs": 27.5 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c90b1a29b370c0b8eb7658a67c24fcc7d805ba1f01736a0ba910d6f5b1a0b7f7", + "mean": -0.0034006796777248383, + "std": 5.661690711975098, + "rms": 5.661692142486572, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3ec28a9a7de7450ce28ee9c0190a2ca895f4aad858516c6da29e19a43500c850", + "mean": 0.0003896969137713313, + "std": 1.014638066291809, + "rms": 1.0146381855010986, + "max_abs": 31.125 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "aef58acad127e765eb2732440483af66daaa7f0d6e8ce5e4fa5702ea1be34045", + "mean": -0.001324985409155488, + "std": 5.960019588470459, + "rms": 5.960020065307617, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1cc7f4ea7aa4b5710ce7079c94a65a7387c818cea86ca8f7d2703352f2c1d7a7", + "mean": -0.00015663541853427887, + "std": 1.0087145566940308, + "rms": 1.0087146759033203, + "max_abs": 27.625 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e31b166467f0a658104255afbbbb818e3fc128446d3c76bf818404c70ea5dd5e", + "mean": -0.0031146446708589792, + "std": 5.661899089813232, + "rms": 5.661899566650391, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9912023544311523, + "min_cosine_similarity": 0.9196348190307617, + "mean_relative_l2": 0.12268953025341034, + "max_abs_delta": 4.3125 + }, + "system_bos": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9908192157745361, + "min_cosine_similarity": 0.9554988145828247, + "mean_relative_l2": 0.12923207879066467, + "max_abs_delta": 4.09375 + }, + "system_x": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9779976010322571, + "min_cosine_similarity": 0.8026391267776489, + "mean_relative_l2": 0.19539542496204376, + "max_abs_delta": 9.0 + }, + "system_period": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9815052151679993, + "min_cosine_similarity": 0.8245733976364136, + "mean_relative_l2": 0.18055559694766998, + "max_abs_delta": 7.25 + }, + "bos_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9863967895507812, + "min_cosine_similarity": 0.8095982670783997, + "mean_relative_l2": 0.1506597399711609, + "max_abs_delta": 4.46875 + }, + "bos_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9855479001998901, + "min_cosine_similarity": 0.7604942321777344, + "mean_relative_l2": 0.15473221242427826, + "max_abs_delta": 8.0625 + }, + "x_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9835540652275085, + "min_cosine_similarity": 0.8231121897697449, + "mean_relative_l2": 0.17092253267765045, + "max_abs_delta": 4.25 + }, + "x_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.978813111782074, + "min_cosine_similarity": 0.7284961938858032, + "mean_relative_l2": 0.19287227094173431, + "max_abs_delta": 7.5 + }, + "period_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9835631251335144, + "min_cosine_similarity": 0.80123370885849, + "mean_relative_l2": 0.16984273493289948, + "max_abs_delta": 3.59375 + }, + "period_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9786208271980286, + "min_cosine_similarity": 0.773596465587616, + "mean_relative_l2": 0.19564390182495117, + "max_abs_delta": 5.375 + } + } + }, + "layer_20": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "64e65c15fe4db0dd0e8b32e7ffa050ec803d5fc0e71226b4ce8d6aec185a1390", + "mean": -6.619704072363675e-05, + "std": 1.1391370296478271, + "rms": 1.1391371488571167, + "max_abs": 33.0 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "aaeef5471858fbcefcc023db79fc3f22237200f68e21de1eaa9e7913f2bd17f3", + "mean": -0.009396261535584927, + "std": 6.996428966522217, + "rms": 6.996435165405273, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d6e83ae4682916d62edf72017d71f256c1b128f97a85e1206e1626a4c30aa661", + "mean": -0.0007526776171289384, + "std": 1.135659098625183, + "rms": 1.1356593370437622, + "max_abs": 33.0 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9cd15982f85d33a7cdeb50f045b1ed7da59435e5f6c26d7921f8e980286ed2f3", + "mean": -0.01184047944843769, + "std": 6.864344596862793, + "rms": 6.864354610443115, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6081ddc62928b0a7c07151da36fc6fa2bf7c6beca10b69b45789038b37f199f1", + "mean": 0.0008125434396788478, + "std": 1.1356253623962402, + "rms": 1.1356257200241089, + "max_abs": 33.0 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5ccd869b0b85f02417d8f33da737b9181831f4ceea593c156e075b9c303b97af", + "mean": -0.0013996714260429144, + "std": 5.982997894287109, + "rms": 5.982997894287109, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "049571c254fe4f1ebfee069504829a9b3b4c37881442284f7cb74c6795e41a4b", + "mean": -0.00033271548454649746, + "std": 1.1374146938323975, + "rms": 1.137414813041687, + "max_abs": 33.0 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "626e229b34d57b096d62602f9fbd3cb79ba3d56cb7dc64f103d8859b6b4659f6", + "mean": -0.0035432791337370872, + "std": 5.68858003616333, + "rms": 5.6885809898376465, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2e90c644f589c31341f05fac6546ea4e16652f10f5be3054304baa3734a43360", + "mean": 0.0015939985169097781, + "std": 1.1416343450546265, + "rms": 1.1416354179382324, + "max_abs": 32.25 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c2f6e213a50f0ed11a1ffc89f62d016d18b3cff87c26fdcff40540e35728e957", + "mean": -0.0008978650439530611, + "std": 5.984948635101318, + "rms": 5.984948635101318, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2dd4b70e59705cba874104f9c1e87193ed5a2188dd2f7be3d51787d28b738e11", + "mean": -0.0003788155736401677, + "std": 1.1413050889968872, + "rms": 1.1413050889968872, + "max_abs": 32.5 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c3c20f5b19ce8e96f05bf8a3cf2f39bc7ccaf327f3cb088a42777a6a2b343977", + "mean": -0.003717760555446148, + "std": 5.68973970413208, + "rms": 5.6897406578063965, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f7f79c016f1d21c3ae97cfdeb39cd7097c88ff606d904d1587a06da8071f194d", + "mean": 0.001008368912152946, + "std": 1.142338514328003, + "rms": 1.1423388719558716, + "max_abs": 32.5 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "066c405c341f45bf3fb6f88a2c2743bd62c07d6b7caea77ff2862141d09557d4", + "mean": -0.0011676972499117255, + "std": 5.984602451324463, + "rms": 5.984602451324463, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "57c6eb4b72d4dfd299fe2f87be33e8224690b59c948c145758a464776f75f8f9", + "mean": -0.00016898922331165522, + "std": 1.1437278985977173, + "rms": 1.1437278985977173, + "max_abs": 32.75 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a4fd70a6780a028d8e7a5b0edc95957c52f918eba619949d9b4c46de8532af19", + "mean": -0.003415843239054084, + "std": 5.689898490905762, + "rms": 5.689899921417236, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9913182854652405, + "min_cosine_similarity": 0.9228419065475464, + "mean_relative_l2": 0.12236925959587097, + "max_abs_delta": 3.75 + }, + "system_bos": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9910784363746643, + "min_cosine_similarity": 0.9563890099525452, + "mean_relative_l2": 0.1279716193675995, + "max_abs_delta": 3.65625 + }, + "system_x": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9781219363212585, + "min_cosine_similarity": 0.8021810054779053, + "mean_relative_l2": 0.19671876728534698, + "max_abs_delta": 8.5 + }, + "system_period": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9811972975730896, + "min_cosine_similarity": 0.8311020135879517, + "mean_relative_l2": 0.18325847387313843, + "max_abs_delta": 6.25 + }, + "bos_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9864248633384705, + "min_cosine_similarity": 0.8037635684013367, + "mean_relative_l2": 0.14967714250087738, + "max_abs_delta": 5.0625 + }, + "bos_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.985797107219696, + "min_cosine_similarity": 0.7711343169212341, + "mean_relative_l2": 0.15336890518665314, + "max_abs_delta": 6.625 + }, + "x_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9835584163665771, + "min_cosine_similarity": 0.819851279258728, + "mean_relative_l2": 0.17033018171787262, + "max_abs_delta": 5.875 + }, + "x_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9792053699493408, + "min_cosine_similarity": 0.7428033351898193, + "mean_relative_l2": 0.1924152821302414, + "max_abs_delta": 7.625 + }, + "period_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9834975600242615, + "min_cosine_similarity": 0.797880232334137, + "mean_relative_l2": 0.1695673018693924, + "max_abs_delta": 4.375 + }, + "period_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9788100123405457, + "min_cosine_similarity": 0.7848266959190369, + "mean_relative_l2": 0.19565683603286743, + "max_abs_delta": 5.125 + } + } + }, + "layer_21": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "597766baa6c6eaf7dbaa21f04a82244b15571522e18ba3692ab335d693d38830", + "mean": 0.0007591114845126867, + "std": 1.2280128002166748, + "rms": 1.228013038635254, + "max_abs": 43.25 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "405cd407db6d5d2e97c798e779a953e6fbc291ea07caf9d9ef594438cfe25484", + "mean": -0.008173257112503052, + "std": 7.07647705078125, + "rms": 7.076481342315674, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5c1f57ab6e41a91150f013c9d572a322a2aaac25ed911a0e2edf23b95558782c", + "mean": 0.00017496943473815918, + "std": 1.223218560218811, + "rms": 1.223218560218811, + "max_abs": 43.5 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b7524d339d5d0e43ee9f95b7e5a3ac24b44ba64dced5d0649a091d4c026b70a2", + "mean": -0.010267862118780613, + "std": 6.939786911010742, + "rms": 6.939794063568115, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e6f4713954674505478b94eb502b3c2034bd8a25950c26e704ed4bfe3502c2aa", + "mean": 0.001429885858669877, + "std": 1.2239335775375366, + "rms": 1.2239344120025635, + "max_abs": 43.5 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ce6f261808e9d39b592eb38761f64cd56ce648ff216bef7480683a16fa0c0193", + "mean": -0.000250521203270182, + "std": 5.986999034881592, + "rms": 5.98699951171875, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3eb59820119ed3cf6687051085c054f279279fc9fe22f3046d5b0be1ca904d70", + "mean": 0.0005847466527484357, + "std": 1.2226386070251465, + "rms": 1.222638726234436, + "max_abs": 42.5 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9b24a3a1b99d6af06a117ad14641771663b15ea47e4810f66413865c7f4ed545", + "mean": -0.0019176830537617207, + "std": 5.697463512420654, + "rms": 5.697463035583496, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "524498be1dda1d2bf4c41889e714b5bfdfb1e56c20e86a2da9b85dbc84afc27b", + "mean": 0.0018716971389949322, + "std": 1.2331973314285278, + "rms": 1.2331987619400024, + "max_abs": 43.5 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e2fc7b6118b8c86590ba26c2b698ed79e1170b659e1bfaf089ee61775e47f2d3", + "mean": -1.1921134500880726e-05, + "std": 5.990022659301758, + "rms": 5.990023136138916, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "20e90d440dae0e4e49c02cd9ef29aa92b6aa9b0c5f0fdcff8d9623155ddd6cd3", + "mean": -0.00020414900791365653, + "std": 1.2323098182678223, + "rms": 1.2323098182678223, + "max_abs": 44.25 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e77b6a9c2c8caa2f1197a4e2283b68a2ba8cd0332cd5d761d15fcff3e0a27ff0", + "mean": -0.002831811551004648, + "std": 5.700273036956787, + "rms": 5.700273513793945, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "df800639f1b03b25922faf30b19eb3c75bd1e274ed4977b3907654d6a54c3efe", + "mean": 0.001629166305065155, + "std": 1.232114553451538, + "rms": 1.232115626335144, + "max_abs": 43.5 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "65147f7acafb7c6837badcfaffa00597a78a1057fe71394436a373f9e540ef16", + "mean": -5.894262358197011e-05, + "std": 5.989010810852051, + "rms": 5.989011287689209, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bdf0e757daa3d3fe707238e9f882c26b5632024ba8a91766bd971a548551582a", + "mean": 0.00040294305654242635, + "std": 1.2325692176818848, + "rms": 1.2325693368911743, + "max_abs": 44.5 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bfcd81ecb4291414ebd8230c80f8b37f80736a9ca984ac03fa049f7d3a078d9b", + "mean": -0.0021836257074028254, + "std": 5.699563980102539, + "rms": 5.699564456939697, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9900075197219849, + "min_cosine_similarity": 0.921733021736145, + "mean_relative_l2": 0.1312360018491745, + "max_abs_delta": 4.8125 + }, + "system_bos": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9903119802474976, + "min_cosine_similarity": 0.9538143873214722, + "mean_relative_l2": 0.13416796922683716, + "max_abs_delta": 4.25 + }, + "system_x": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9748883843421936, + "min_cosine_similarity": 0.7974861860275269, + "mean_relative_l2": 0.21446923911571503, + "max_abs_delta": 8.375 + }, + "system_period": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9782419204711914, + "min_cosine_similarity": 0.8197733163833618, + "mean_relative_l2": 0.1987188756465912, + "max_abs_delta": 6.75 + }, + "bos_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9844158887863159, + "min_cosine_similarity": 0.8044752478599548, + "mean_relative_l2": 0.16079042851924896, + "max_abs_delta": 5.1640625 + }, + "bos_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9839255213737488, + "min_cosine_similarity": 0.7810292840003967, + "mean_relative_l2": 0.1639951765537262, + "max_abs_delta": 6.76171875 + }, + "x_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9815896153450012, + "min_cosine_similarity": 0.8194431066513062, + "mean_relative_l2": 0.18046972155570984, + "max_abs_delta": 7.0 + }, + "x_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9762860536575317, + "min_cosine_similarity": 0.7175919413566589, + "mean_relative_l2": 0.20632492005825043, + "max_abs_delta": 7.5625 + }, + "period_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9812567234039307, + "min_cosine_similarity": 0.79587322473526, + "mean_relative_l2": 0.18026603758335114, + "max_abs_delta": 5.0 + }, + "period_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9761062264442444, + "min_cosine_similarity": 0.7560526132583618, + "mean_relative_l2": 0.20827995240688324, + "max_abs_delta": 5.25 + } + } + }, + "layer_22": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "86c887928135eaa53747d42fd9e4941691cbb50ab789c6ac440b90933f163728", + "mean": 0.002660458441823721, + "std": 1.4022672176361084, + "rms": 1.402269721031189, + "max_abs": 57.75 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d71b6c02c7f8065aa6e1f6453fe6c9a1f09d049f7ad5a88bfb5a172fc270da76", + "mean": -0.006938389968127012, + "std": 7.108325004577637, + "rms": 7.108328342437744, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3989a9be816435a63465f876afdfb530bf28cd89427c37a3f3c6f450351be951", + "mean": 0.0020775676239281893, + "std": 1.3957394361495972, + "rms": 1.3957409858703613, + "max_abs": 58.0 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c0880329f7b5c70f630cbdc1b0188065ac7acf96b41d7c026050fccd4a527ea1", + "mean": -0.009352369233965874, + "std": 6.976192474365234, + "rms": 6.976198673248291, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "835216c0522a8177c27deade2d001a842269c4ea750305a361554ed7be73aac7", + "mean": 0.0027911560609936714, + "std": 1.3976187705993652, + "rms": 1.3976216316223145, + "max_abs": 57.0 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5c2d563d214a18329bb1d120e7ab56346f5a99c4fa7b2687627b20978c0eaeec", + "mean": 0.0005380245856940746, + "std": 6.024613857269287, + "rms": 6.024613857269287, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6f477d3d2783da69791e891c918d16e28df898ea236a8174289340a7747c39d0", + "mean": 0.002539257286116481, + "std": 1.3951526880264282, + "rms": 1.3951549530029297, + "max_abs": 57.0 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "568a007c327b59211ccb08ea03679800e10d081edbe9313bb5e77ad061a54a2b", + "mean": -0.000873350421898067, + "std": 5.742181301116943, + "rms": 5.742181301116943, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "de792c8b26a2ff0ca66e312465efd411d7c59366477ee218c304184667607da1", + "mean": 0.0035407799296081066, + "std": 1.407765507698059, + "rms": 1.407770037651062, + "max_abs": 58.25 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "88d2a38c1298d71a7a2a622036e8855cd1bfd0384e1071b546367518dae65116", + "mean": 0.0009808223694562912, + "std": 6.0284624099731445, + "rms": 6.0284624099731445, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1191542311aeda06cffd7decd7f671265b78c06e76acbfc2b7cb7ab963f57d0c", + "mean": 0.0027136621065437794, + "std": 1.4059938192367554, + "rms": 1.4059964418411255, + "max_abs": 58.0 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "dc59a4ebd08004054a51aa156f6e34b9ac4b0a2c1099de9002dd0e7ea5f92b44", + "mean": -0.0010207445593550801, + "std": 5.745940685272217, + "rms": 5.745941162109375, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "614ebc9edc1a0841401f55632607d5f5d0ce0a22d98c2e8141102956fdb7e66d", + "mean": 0.0032145814038813114, + "std": 1.4065526723861694, + "rms": 1.4065563678741455, + "max_abs": 58.5 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "521748294faf9fbbfed7387e9f839e7fe979e9a5d27b2a3c9506d69ed1510144", + "mean": 0.0008523131255060434, + "std": 6.02712869644165, + "rms": 6.02712869644165, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "efe2f7228a07b7a3f61d6b381ff3744c5553ea730b56241c6afc25eaa9f9719b", + "mean": 0.002831115387380123, + "std": 1.4043837785720825, + "rms": 1.4043866395950317, + "max_abs": 58.5 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8484261aa9f8ce6683bf1a6c1d766ad883d3aa7194bc9f273ad96f0916b883ff", + "mean": -0.0006942008621990681, + "std": 5.74462890625, + "rms": 5.74462890625, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9891149997711182, + "min_cosine_similarity": 0.9021190404891968, + "mean_relative_l2": 0.13615857064723969, + "max_abs_delta": 4.875 + }, + "system_bos": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9895832538604736, + "min_cosine_similarity": 0.9382409453392029, + "mean_relative_l2": 0.13861416280269623, + "max_abs_delta": 4.5 + }, + "system_x": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9734739661216736, + "min_cosine_similarity": 0.8010336756706238, + "mean_relative_l2": 0.21948152780532837, + "max_abs_delta": 9.25 + }, + "system_period": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.976317822933197, + "min_cosine_similarity": 0.8234201669692993, + "mean_relative_l2": 0.2057681679725647, + "max_abs_delta": 8.25 + }, + "bos_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9826012253761292, + "min_cosine_similarity": 0.7773544788360596, + "mean_relative_l2": 0.1676214635372162, + "max_abs_delta": 5.0 + }, + "bos_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9823434948921204, + "min_cosine_similarity": 0.7492807507514954, + "mean_relative_l2": 0.1706908643245697, + "max_abs_delta": 7.078125 + }, + "x_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9801297783851624, + "min_cosine_similarity": 0.8079295754432678, + "mean_relative_l2": 0.1862393170595169, + "max_abs_delta": 6.625 + }, + "x_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9750854969024658, + "min_cosine_similarity": 0.7017155289649963, + "mean_relative_l2": 0.21009759604930878, + "max_abs_delta": 7.5 + }, + "period_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9796330332756042, + "min_cosine_similarity": 0.790785014629364, + "mean_relative_l2": 0.18675732612609863, + "max_abs_delta": 5.125 + }, + "period_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9746748805046082, + "min_cosine_similarity": 0.7290488481521606, + "mean_relative_l2": 0.2122000753879547, + "max_abs_delta": 6.5 + } + } + }, + "layer_23": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "03ffef7cf9664c6eec1af397185f81b0708b3bd22de373f0e6bb98e99d8863bd", + "mean": -0.0013656506780534983, + "std": 1.7906979322433472, + "rms": 1.790698528289795, + "max_abs": 86.0 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c5cfa9cab8ee9a056df019932d18e32ab73d63c6025a27523826d3c84fc5c97b", + "mean": -0.010227539576590061, + "std": 7.1636481285095215, + "rms": 7.163655757904053, + "max_abs": 1160.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4513550e6daa11579e66d28b2c330d0fd6b289eeb764e37630db539567806858", + "mean": -0.0020028005819767714, + "std": 1.7794592380523682, + "rms": 1.7794603109359741, + "max_abs": 87.0 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a0f804bd38927f49738b4a68f09fcd941acaa98f76f51ffa5700ce705624a4bb", + "mean": -0.011590857990086079, + "std": 7.035829067230225, + "rms": 7.035838603973389, + "max_abs": 1160.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d429e1293788d5ef06532b4baf6965da706c64d75e67ad067449df4014f0e6b8", + "mean": -0.0008587942575104535, + "std": 1.7754795551300049, + "rms": 1.7754796743392944, + "max_abs": 85.5 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "55e0dd01836510e040030b468a9196cde5763cc3bb54f0348d1b7fd950224868", + "mean": -0.0025213167537003756, + "std": 6.095463275909424, + "rms": 6.09546422958374, + "max_abs": 1160.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1539ab55ab7673c9ed7589e6d159e2372c5b9bfdeb625f5e5509aa1fc3becb63", + "mean": -0.0017647978384047747, + "std": 1.7735382318496704, + "rms": 1.7735390663146973, + "max_abs": 85.0 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7463fe5a3f42cf41a4a8ab0a3646cc8d8ee33e6e34bc3c6e6f99f012843aa078", + "mean": -0.003265561070293188, + "std": 5.8244218826293945, + "rms": 5.824422836303711, + "max_abs": 1160.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "044e29e3f4fcd1ceb140b263e421e9564be4b62151f80e12bcb6904799a9daf3", + "mean": -1.546032763144467e-05, + "std": 1.791094422340393, + "rms": 1.7910943031311035, + "max_abs": 87.0 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8cf4ef4123a7269408f39a54bbc4f80deff89c96379cd1e596ed82ccd6e9d3e1", + "mean": -0.0018953015096485615, + "std": 6.102547645568848, + "rms": 6.102548122406006, + "max_abs": 1160.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9a3ba40b1c35dd7be4422c2e551ecdb4858785cca6b838c1b2fffc9b61ebef3f", + "mean": -0.001414250466041267, + "std": 1.792517900466919, + "rms": 1.7925184965133667, + "max_abs": 87.5 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "79a6973603c6c356188317b2f5bf3675aaccfd9af7d0ebd39b5698b8c36d811b", + "mean": -0.0034796844702214003, + "std": 5.832141876220703, + "rms": 5.832143306732178, + "max_abs": 1160.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "53c9652b51dddc888614514bdd087a830b3fba7c7f896b248338ec53934230e7", + "mean": -0.0010560093214735389, + "std": 1.786974549293518, + "rms": 1.7869749069213867, + "max_abs": 87.0 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d63c700b34c002872e9a9f0f9cf45eae7bf07d7ef9e42d80debe3a3e90a6ca3f", + "mean": -0.002863614819943905, + "std": 6.099540710449219, + "rms": 6.099541664123535, + "max_abs": 1160.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a803f96e8c5ca9630e325d3d3a31239f8fb17f03a1fd145551fa865ff9a52102", + "mean": -0.0010014551226049662, + "std": 1.7880672216415405, + "rms": 1.7880675792694092, + "max_abs": 87.5 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5bc54b1af495d31076b05ef8ca882850d4f4621663c88a41b8b60259934f1640", + "mean": -0.002969614928588271, + "std": 5.8294901847839355, + "rms": 5.829490661621094, + "max_abs": 1160.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9909952878952026, + "min_cosine_similarity": 0.9048349857330322, + "mean_relative_l2": 0.12419398874044418, + "max_abs_delta": 6.0 + }, + "system_bos": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9910327792167664, + "min_cosine_similarity": 0.9365152716636658, + "mean_relative_l2": 0.12885843217372894, + "max_abs_delta": 5.75 + }, + "system_x": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9779022932052612, + "min_cosine_similarity": 0.8401228785514832, + "mean_relative_l2": 0.2011079341173172, + "max_abs_delta": 11.375 + }, + "system_period": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9799156785011292, + "min_cosine_similarity": 0.8395296335220337, + "mean_relative_l2": 0.18986444175243378, + "max_abs_delta": 9.0 + }, + "bos_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.985281229019165, + "min_cosine_similarity": 0.8018611073493958, + "mean_relative_l2": 0.15328119695186615, + "max_abs_delta": 6.5 + }, + "bos_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.985038161277771, + "min_cosine_similarity": 0.7754008173942566, + "mean_relative_l2": 0.15704192221164703, + "max_abs_delta": 8.533203125 + }, + "x_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.983404815196991, + "min_cosine_similarity": 0.8433047533035278, + "mean_relative_l2": 0.17039446532726288, + "max_abs_delta": 12.0 + }, + "x_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9794017672538757, + "min_cosine_similarity": 0.7581173181533813, + "mean_relative_l2": 0.19208043813705444, + "max_abs_delta": 13.25 + }, + "period_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9828283786773682, + "min_cosine_similarity": 0.8207544684410095, + "mean_relative_l2": 0.17107883095741272, + "max_abs_delta": 7.25 + }, + "period_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9790235161781311, + "min_cosine_similarity": 0.7678470015525818, + "mean_relative_l2": 0.19370733201503754, + "max_abs_delta": 9.5 + } + } + }, + "layer_24": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0df01af315f3747a28e37ee7fa201899574ff7965044600626fa660ce17baa42", + "mean": -0.00772209744900465, + "std": 2.189871311187744, + "rms": 2.189884901046753, + "max_abs": 112.0 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cd19b39098d91dfe6786fb06fb642a521f70bf46e028e44eb103fb0e4335588b", + "mean": -0.016480326652526855, + "std": 6.823879718780518, + "rms": 6.82390022277832, + "max_abs": 1008.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "64ce863f558bd7e3420140db54e09a28a4cfdb5b4fa1aaf6fc23194aec3b4e79", + "mean": -0.007695630192756653, + "std": 2.1745245456695557, + "rms": 2.1745381355285645, + "max_abs": 114.0 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "27a99b1c9c8004a46330f66a5c5d1001ddaa6a7452ea5c2a1c381036697f056e", + "mean": -0.01635955460369587, + "std": 6.916172504425049, + "rms": 6.916192054748535, + "max_abs": 1120.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4f882893274803c2224438ac09116bdb7224da853a756a89412d26010a45faff", + "mean": -0.006530895829200745, + "std": 2.1704483032226562, + "rms": 2.1704583168029785, + "max_abs": 108.0 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cc9bdc14826156fc46501712d353e96a34006087f6d5a182eb76c887b4cde3b7", + "mean": -0.0072297449223697186, + "std": 4.508160591125488, + "rms": 4.508166790008545, + "max_abs": 840.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "24c4ad2d2f31f6c2fc596f25f3fe0da24fe9368f23fe69a485729db5d6a85eef", + "mean": -0.00797082670032978, + "std": 2.167836904525757, + "rms": 2.167851686477661, + "max_abs": 110.0 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9b77d16ea2f437b4d2970c746c639541f72737308439b4f4d17b1ffcb2b79818", + "mean": -0.007446059491485357, + "std": 4.370502471923828, + "rms": 4.370508670806885, + "max_abs": 840.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "26d4f4b950bc20271dfffd2ef1d9068b18bb12af9acb04e00bd5c8f4808c95ea", + "mean": -0.005263102240860462, + "std": 2.185624599456787, + "rms": 2.185631036758423, + "max_abs": 109.0 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8b650eed7f32d70a1eec10e74edaf5e2cc941a3bf9695c0e402da5a4b839694c", + "mean": -0.006349512841552496, + "std": 4.5202131271362305, + "rms": 4.5202178955078125, + "max_abs": 840.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3b4f039e532886ddca4264cfde11e30e1d9d7e5f8a4664b46bdd13fa9ccbeee0", + "mean": -0.006033560261130333, + "std": 2.188389778137207, + "rms": 2.1883981227874756, + "max_abs": 114.0 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b5ded469cfd5581728ea8e968999f3417c1ec539b9f3ee16fd72b43fc79fa630", + "mean": -0.006780874449759722, + "std": 4.384566307067871, + "rms": 4.384571552276611, + "max_abs": 840.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a230e6b852cfe90f974751150f27991e2dcc18eeba968e424fb0f7621bacd72b", + "mean": -0.0061782714910805225, + "std": 2.1822781562805176, + "rms": 2.1822867393493652, + "max_abs": 110.5 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "610091595f50ec2974d903812d38bf1b4ad7ddb1ab73e26c54aaa22401f8479d", + "mean": -0.007094665430486202, + "std": 4.515612602233887, + "rms": 4.515618324279785, + "max_abs": 840.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8665414f7a078ab56905d664251b926b9444cca7bc281683ece759388a78b4c2", + "mean": -0.006416297983378172, + "std": 2.1827139854431152, + "rms": 2.1827235221862793, + "max_abs": 114.0 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "68e3047f3ca3bf28a712d64b3aa4b647c3a131f8a40da02b2f47e31bbee94256", + "mean": -0.0067147258669137955, + "std": 4.379541397094727, + "rms": 4.379546165466309, + "max_abs": 840.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9921531677246094, + "min_cosine_similarity": 0.8978490233421326, + "mean_relative_l2": 0.11491286754608154, + "max_abs_delta": 10.5 + }, + "system_bos": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.992165744304657, + "min_cosine_similarity": 0.9381662607192993, + "mean_relative_l2": 0.11916067451238632, + "max_abs_delta": 6.5 + }, + "system_x": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9804480075836182, + "min_cosine_similarity": 0.8485447764396667, + "mean_relative_l2": 0.18777699768543243, + "max_abs_delta": 13.75 + }, + "system_period": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.982304573059082, + "min_cosine_similarity": 0.8435481190681458, + "mean_relative_l2": 0.17689841985702515, + "max_abs_delta": 11.0 + }, + "bos_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9874212145805359, + "min_cosine_similarity": 0.829734206199646, + "mean_relative_l2": 0.14109010994434357, + "max_abs_delta": 8.5 + }, + "bos_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9871169924736023, + "min_cosine_similarity": 0.8018876314163208, + "mean_relative_l2": 0.14521531760692596, + "max_abs_delta": 8.96875 + }, + "x_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9859378337860107, + "min_cosine_similarity": 0.8624839186668396, + "mean_relative_l2": 0.15623198449611664, + "max_abs_delta": 15.5 + }, + "x_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9818724393844604, + "min_cosine_similarity": 0.7701916694641113, + "mean_relative_l2": 0.1778736114501953, + "max_abs_delta": 15.0 + }, + "period_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9849936366081238, + "min_cosine_similarity": 0.8393317461013794, + "mean_relative_l2": 0.1588621884584427, + "max_abs_delta": 8.5 + }, + "period_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9821041822433472, + "min_cosine_similarity": 0.7772176861763, + "mean_relative_l2": 0.1778712123632431, + "max_abs_delta": 10.5 + } + } + }, + "layer_25": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "96e3851736cd1ac28972e57a6186efa68b87a2eaf3744fabc5646a5de160f0c9", + "mean": -0.028534075245261192, + "std": 3.0566868782043457, + "rms": 3.0568199157714844, + "max_abs": 154.0 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "aabf1b6527e30358101f406520a8cdf8d3dca44c8b0dd044a891824eb82b1a1c", + "mean": -0.035918742418289185, + "std": 5.621984004974365, + "rms": 5.622098445892334, + "max_abs": 872.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "58e52b18f2e4e3de9da4d380b7a300f6df8cb54101aa1d6022a8a3826a2392a2", + "mean": -0.026332447305321693, + "std": 3.0304386615753174, + "rms": 3.030553102493286, + "max_abs": 157.0 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "211a94e0497f5109146c9f59d99a5cc9de010ae50f4d785e065068815adbe7d5", + "mean": -0.03344067931175232, + "std": 5.839773654937744, + "rms": 5.839869022369385, + "max_abs": 984.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "298827b3d1f5177b353cf7cbc446c159a8257d841a0fc8d6bbcf591b9f5b5f16", + "mean": -0.02732292376458645, + "std": 3.0274863243103027, + "rms": 3.027609348297119, + "max_abs": 154.0 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7a5113d479240ab3d50fee01b06d4a09a6dbd6b877c2dfbd6edd02a98a20a576", + "mean": -0.02603749744594097, + "std": 3.2671377658843994, + "rms": 3.2672414779663086, + "max_abs": 248.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e010669b66bee04b17b80e896018ae31d72ff57aa16d31b628bccc647dac064f", + "mean": -0.027676647529006004, + "std": 3.0193893909454346, + "rms": 3.0195162296295166, + "max_abs": 152.0 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "405913fd7557a438a00386bb4a3828b7c22b48e279996fc0e856e38f29d693b6", + "mean": -0.024737650528550148, + "std": 3.312950372695923, + "rms": 3.3130428791046143, + "max_abs": 248.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7cc6bcd22754d4a1a9af9a9687171e3af227c2bef2418e20a192727eb9d5e354", + "mean": -0.026484748348593712, + "std": 3.045522928237915, + "rms": 3.045637845993042, + "max_abs": 153.0 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "446fe5571511580bd20a84c876d997f54e3a3f5c3563c936b430d24d40d33240", + "mean": -0.02597970888018608, + "std": 3.29736328125, + "rms": 3.2974655628204346, + "max_abs": 248.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0c2ad3dd7025b3a72eba9fc4013f4d08dca309ed7543dad8deb2245d732f07e2", + "mean": -0.023708289489150047, + "std": 3.046837091445923, + "rms": 3.046929359436035, + "max_abs": 158.0 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f55af45de4d46f4094abe3e6ef899c5db2f2bbefec6809bf73686ba1c214d463", + "mean": -0.022416124120354652, + "std": 3.3461215496063232, + "rms": 3.3461966514587402, + "max_abs": 248.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "32deba0f5a21881aa97acc428366af0865efef90c67b744f892c4afe4040c842", + "mean": -0.027347346767783165, + "std": 3.0408129692077637, + "rms": 3.040936231613159, + "max_abs": 153.0 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e05a5118a552bdb6d0c8a24083d2cc82dc5498444dc063661f3f2c3951ad8350", + "mean": -0.026454418897628784, + "std": 3.2853147983551025, + "rms": 3.285421371459961, + "max_abs": 248.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2f2a0ac7b7cdb52896673daccb1edf77aa0691eaa0456d584385b7a938269b39", + "mean": -0.02507527731359005, + "std": 3.0316083431243896, + "rms": 3.031712055206299, + "max_abs": 157.0 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9e0f08f8bcd2b3417ce2b859a0db1c3c9bc36b178983f3f9fc0ae0556b8ce71f", + "mean": -0.022972656413912773, + "std": 3.3284523487091064, + "rms": 3.328531503677368, + "max_abs": 248.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9944197535514832, + "min_cosine_similarity": 0.9148858189582825, + "mean_relative_l2": 0.09672293066978455, + "max_abs_delta": 25.0 + }, + "system_bos": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9944719076156616, + "min_cosine_similarity": 0.9463382959365845, + "mean_relative_l2": 0.10010607540607452, + "max_abs_delta": 16.5 + }, + "system_x": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9863780736923218, + "min_cosine_similarity": 0.8902704119682312, + "mean_relative_l2": 0.15696145594120026, + "max_abs_delta": 32.0 + }, + "system_period": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9875491857528687, + "min_cosine_similarity": 0.8883650302886963, + "mean_relative_l2": 0.14816734194755554, + "max_abs_delta": 22.0 + }, + "bos_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9917013645172119, + "min_cosine_similarity": 0.8762803673744202, + "mean_relative_l2": 0.11534354835748672, + "max_abs_delta": 19.5 + }, + "bos_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9914990067481995, + "min_cosine_similarity": 0.8516720533370972, + "mean_relative_l2": 0.11871366202831268, + "max_abs_delta": 18.0 + }, + "x_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9910302758216858, + "min_cosine_similarity": 0.9053568243980408, + "mean_relative_l2": 0.1258537918329239, + "max_abs_delta": 20.0 + }, + "x_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9881185293197632, + "min_cosine_similarity": 0.8335824012756348, + "mean_relative_l2": 0.1448013186454773, + "max_abs_delta": 26.5 + }, + "period_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9903810024261475, + "min_cosine_similarity": 0.889977753162384, + "mean_relative_l2": 0.12784257531166077, + "max_abs_delta": 15.5 + }, + "period_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9881221055984497, + "min_cosine_similarity": 0.8328220248222351, + "mean_relative_l2": 0.14509816467761993, + "max_abs_delta": 19.5 + } + } + }, + "layer_26": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fd632d48e9fca4859287649ab29f50a3efca1b4491fa311b2c10ea669bbf8bd5", + "mean": -0.0529097318649292, + "std": 3.60378360748291, + "rms": 3.6041722297668457, + "max_abs": 205.0 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "331d3ae05b954bd3d4a86e1900f27536ddcbc8727b15fe7b48a266550da7ed74", + "mean": -0.06080222874879837, + "std": 5.939528942108154, + "rms": 5.939839839935303, + "max_abs": 840.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "29c00c61f48e63ad4c2e7e5571bc91e867a4aff85bfdc42361577c509a8ee300", + "mean": -0.04467613995075226, + "std": 3.474006175994873, + "rms": 3.4742934703826904, + "max_abs": 196.0 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1292c96ac8e10a7e0233685573e51c93a7dbf465bd10ae9b5f4115bec9236a99", + "mean": -0.048482395708560944, + "std": 6.122309684753418, + "rms": 6.122501373291016, + "max_abs": 872.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0055472e935751963fa60ff6407ed006e26d8164d0eb80d35bde82e1131fbc3e", + "mean": -0.05127674713730812, + "std": 3.5262253284454346, + "rms": 3.5265982151031494, + "max_abs": 210.0 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d6e18e85aefb2acb56e876a82b2cccd4f9b8010f636cf10ee3763013975badb8", + "mean": -0.04936152324080467, + "std": 4.131270408630371, + "rms": 4.131565570831299, + "max_abs": 768.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0ff618d02fd0d79bb2d4f17ffd04a7965725d0d8d3fefa16957d20829d10ad70", + "mean": -0.04732527583837509, + "std": 3.509345054626465, + "rms": 3.5096640586853027, + "max_abs": 201.0 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9de5c88a7453f6cc807ac539e28b13472b7b5ee18821820f66fff37dc3b7c825", + "mean": -0.0394144132733345, + "std": 4.281216144561768, + "rms": 4.281397342681885, + "max_abs": 768.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6bc4142dba8a1fc48c9f0e6d3403f090a8bda748fb7ac58f4d384946a8bdc060", + "mean": -0.05012809485197067, + "std": 3.520751953125, + "rms": 3.521109104156494, + "max_abs": 204.0 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bedc301eb87bafb4f5137c6d2ac71290b98ca5a426e3f37c617b4cf46a9ec880", + "mean": -0.049224283546209335, + "std": 4.153073310852051, + "rms": 4.153365612030029, + "max_abs": 768.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0a8d167d5cdeb719f7667004e043f46d2bc5c7f9be3e43e585bd1d910e837d78", + "mean": -0.03650817647576332, + "std": 3.3716511726379395, + "rms": 3.3718488216400146, + "max_abs": 173.0 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cdd3a423e41c932238e32f638205713a000bfc280bcf18b248d7a00d7e63ad68", + "mean": -0.03199980780482292, + "std": 4.201714515686035, + "rms": 4.201836585998535, + "max_abs": 768.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c4b2fa880489f201e4c16205daf9dc108cc92bcc7e6b5331d2c5ceca4d0cfdfc", + "mean": -0.05065830424427986, + "std": 3.485380172729492, + "rms": 3.485748291015625, + "max_abs": 197.0 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "073be9cc609466f2341ea4f92b07aff919b62515054b6563f6bd7c0667a28461", + "mean": -0.049358248710632324, + "std": 4.110057830810547, + "rms": 4.110353946685791, + "max_abs": 768.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9befdaccf37843a0f9fdeed0d0f3d145d2aa1da962e0611abe21f59e0abe2b17", + "mean": -0.038316402584314346, + "std": 3.33180832862854, + "rms": 3.33202862739563, + "max_abs": 166.0 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "759356bd3b21b5ca3f36811fd8094eda4c82bf5d740926ec19d34f09ba0a5cf3", + "mean": -0.03296097368001938, + "std": 4.156240940093994, + "rms": 4.1563720703125, + "max_abs": 768.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9931437969207764, + "min_cosine_similarity": 0.8606462478637695, + "mean_relative_l2": 0.11132151633501053, + "max_abs_delta": 48.5 + }, + "system_bos": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.993356466293335, + "min_cosine_similarity": 0.9122872352600098, + "mean_relative_l2": 0.11617232114076614, + "max_abs_delta": 60.0 + }, + "system_x": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9824737310409546, + "min_cosine_similarity": 0.8540787100791931, + "mean_relative_l2": 0.1831197738647461, + "max_abs_delta": 49.75 + }, + "system_period": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9840459823608398, + "min_cosine_similarity": 0.8405369520187378, + "mean_relative_l2": 0.17087671160697937, + "max_abs_delta": 38.0 + }, + "bos_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9916240572929382, + "min_cosine_similarity": 0.8417094349861145, + "mean_relative_l2": 0.12060610204935074, + "max_abs_delta": 47.5 + }, + "bos_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9912880063056946, + "min_cosine_similarity": 0.7840648889541626, + "mean_relative_l2": 0.12562040984630585, + "max_abs_delta": 66.0 + }, + "x_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9912832975387573, + "min_cosine_similarity": 0.8810680508613586, + "mean_relative_l2": 0.13003578782081604, + "max_abs_delta": 41.5 + }, + "x_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9871243238449097, + "min_cosine_similarity": 0.7612038850784302, + "mean_relative_l2": 0.15846385061740875, + "max_abs_delta": 51.5 + }, + "period_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9904707670211792, + "min_cosine_similarity": 0.855854868888855, + "mean_relative_l2": 0.1330999881029129, + "max_abs_delta": 42.5 + }, + "period_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9871322512626648, + "min_cosine_similarity": 0.7613017559051514, + "mean_relative_l2": 0.1566789448261261, + "max_abs_delta": 31.0 + } + } + }, + "final_norm": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2258f9f22528ba9fe3754ad068d9d5860e2d0dc1086b655b67e45b0681f85ce6", + "mean": -0.0062897116877138615, + "std": 0.6498640179634094, + "rms": 0.6498944759368896, + "max_abs": 28.875 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "434617d6901dfb36686c9169c5a30fd1676ce9fe4213d7b1730e4c52e1221a52", + "mean": -0.005941891577094793, + "std": 0.6403380036354065, + "rms": 0.6403656005859375, + "max_abs": 28.875 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "eea21099a2449e96a87abc176f2ddfe070570c9c0afbbe157d50585d8171b572", + "mean": -0.0049651325680315495, + "std": 0.6413089632987976, + "rms": 0.6413281559944153, + "max_abs": 29.0 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b3bb27abbff105068f70c73eb0ddfb7414fd69ede37f0122057e47a826b015e6", + "mean": -0.0038818824104964733, + "std": 0.6200742125511169, + "rms": 0.6200863718986511, + "max_abs": 29.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "02e7b54645f3ed9e27db225cdce9d655d181089c1f900098b868ad2322b3d262", + "mean": -0.0063734157010912895, + "std": 0.6580918431282043, + "rms": 0.658122718334198, + "max_abs": 30.125 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4803381312eb19780d843708ad4a2a93891db2e3bf357857740cd4bbf0988fd5", + "mean": -0.005943065509200096, + "std": 0.6482219696044922, + "rms": 0.6482492089271545, + "max_abs": 30.125 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cc1b1a7d86e35a227da7078abce8123b879f67e5570e9c8641154af652de1daa", + "mean": -0.0055204578675329685, + "std": 0.6472740173339844, + "rms": 0.6472975611686707, + "max_abs": 29.375 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f43f0da7653b9bd1971e3ebce0945e65faae063eaf82d50dc4d3041e9604b4d9", + "mean": -0.004186516627669334, + "std": 0.6246031522750854, + "rms": 0.6246171593666077, + "max_abs": 29.375 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0cb0a53153b3e2951efacdc35400251daecfb11be6fcfc493047a1c5fe1a8501", + "mean": -0.006020864937454462, + "std": 0.6584575176239014, + "rms": 0.6584849953651428, + "max_abs": 29.0 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f142558c2537cf469f075833115a82088f0611f74f99a3a027678418a87afd66", + "mean": -0.0056747267954051495, + "std": 0.6468239426612854, + "rms": 0.6468487977981567, + "max_abs": 29.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d11d67de272f12f49d8cc92ce79b5ddacd79b8e93bb78a2e4120a7356d9ec253", + "mean": -0.003395716892555356, + "std": 0.6484001278877258, + "rms": 0.6484090685844421, + "max_abs": 29.125 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "318d0bc6cd44f45ba6f5c20fb80c613e8bcf71ef3c7790c50a6483506391c18d", + "mean": -0.002620035782456398, + "std": 0.6246103048324585, + "rms": 0.6246157884597778, + "max_abs": 29.125 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "121626c09d96d2dbff968f3738f2ac3158c0020a659a9b8ba37fd3fe0d33a92f", + "mean": -0.006262286100536585, + "std": 0.6609669327735901, + "rms": 0.6609965562820435, + "max_abs": 29.375 + }, + "full_input": { + "shape": [ + 145, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d249e307d07336c134ecdc945c3f2c96cee3be6ab21c6d772c3363169d464ed6", + "mean": -0.005903271026909351, + "std": 0.6500747799873352, + "rms": 0.6501016020774841, + "max_abs": 29.375 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 120, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "95af152dbdd0dc480f0823d486d0362741db2a875efa44fcb34d02822fb1e593", + "mean": -0.003921298775821924, + "std": 0.6484860777854919, + "rms": 0.6484979391098022, + "max_abs": 29.375 + }, + "full_input": { + "shape": [ + 161, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d2fcf6b66f74f470ae678e1302920d3513add0b84babd4bb7421e15891033a2f", + "mean": -0.002951346803456545, + "std": 0.626270592212677, + "rms": 0.626277506351471, + "max_abs": 29.375 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9908339381217957, + "min_cosine_similarity": 0.82728111743927, + "mean_relative_l2": 0.1211676299571991, + "max_abs_delta": 4.5625 + }, + "system_bos": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9916240572929382, + "min_cosine_similarity": 0.9215848445892334, + "mean_relative_l2": 0.12194666266441345, + "max_abs_delta": 3.90625 + }, + "system_x": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9766969680786133, + "min_cosine_similarity": 0.8458014130592346, + "mean_relative_l2": 0.19880062341690063, + "max_abs_delta": 4.75 + }, + "system_period": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9779573082923889, + "min_cosine_similarity": 0.8032277822494507, + "mean_relative_l2": 0.18966953456401825, + "max_abs_delta": 6.375 + }, + "bos_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9889870882034302, + "min_cosine_similarity": 0.8268148303031921, + "mean_relative_l2": 0.13356421887874603, + "max_abs_delta": 3.6875 + }, + "bos_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9875956177711487, + "min_cosine_similarity": 0.709216296672821, + "mean_relative_l2": 0.13841286301612854, + "max_abs_delta": 8.625 + }, + "x_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9886182546615601, + "min_cosine_similarity": 0.8768360614776611, + "mean_relative_l2": 0.14273907244205475, + "max_abs_delta": 4.375 + }, + "x_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9812825918197632, + "min_cosine_similarity": 0.6982291340827942, + "mean_relative_l2": 0.177516371011734, + "max_abs_delta": 4.328125 + }, + "period_at_s0": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9876015782356262, + "min_cosine_similarity": 0.844238817691803, + "mean_relative_l2": 0.14709360897541046, + "max_abs_delta": 4.375 + }, + "period_at_s1": { + "tokens": 120, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.981643557548523, + "min_cosine_similarity": 0.7093757390975952, + "mean_relative_l2": 0.17656183242797852, + "max_abs_delta": 4.5 + } + } + } + }, + "router_layers": { + "layer_01": { + "layer": 1, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "2cc7a06b9993c21210ed679e2f4baed981b433684ebbc2d5a5d301ea944da8ce", + "route_weight_sha256": "5c8965f75a558f0ddb43c5704fe2cc1876cf8cf7ccff17a9c3926f02612d5af0", + "loads": [ + 14, + 11, + 4, + 14, + 2, + 11, + 13, + 22, + 9, + 25, + 9, + 4, + 7, + 17, + 8, + 9, + 20, + 16, + 3, + 12, + 6, + 15, + 13, + 20, + 23, + 17, + 4, + 16, + 3, + 26, + 2, + 18, + 10, + 12, + 2, + 7, + 2, + 8, + 20, + 1, + 15, + 17, + 12, + 12, + 2, + 2, + 26, + 5, + 13, + 17, + 6, + 3, + 11, + 12, + 0, + 10, + 5, + 18, + 5, + 27, + 25, + 0, + 17, + 5 + ], + "weighted_loads": [ + 0.5679469518363476, + 0.40237841941416264, + 0.11145325005054474, + 0.44129003398120403, + 0.18250754475593567, + 1.3494640477001667, + 1.1453611087054014, + 0.5338057968765497, + 0.35869601741433144, + 1.4012542311102152, + 0.21536505781114101, + 0.11237002722918987, + 0.18396544083952904, + 1.1659924127161503, + 0.3140401616692543, + 0.29856228828430176, + 1.8350555133074522, + 0.6834687814116478, + 0.07870187796652317, + 0.33232406713068485, + 0.32075330056250095, + 0.5849972348660231, + 1.222094900906086, + 0.527368588373065, + 1.9134617447853088, + 1.137239571660757, + 0.17987398616969585, + 0.9647250529378653, + 0.08068988658487797, + 1.279383199289441, + 0.049817467108368874, + 1.690456137061119, + 0.4915318936109543, + 0.8856904413551092, + 0.050013964995741844, + 0.19922073557972908, + 0.10536514222621918, + 0.6301073133945465, + 1.3447177931666374, + 0.07802438735961914, + 1.1867067702114582, + 0.5869310572743416, + 0.46969401463866234, + 0.45393345691263676, + 0.05070186220109463, + 0.11098349839448929, + 0.8521265760064125, + 0.23570998944342136, + 0.4249950237572193, + 0.5074611399322748, + 0.16872961446642876, + 0.3283277153968811, + 0.42981624789536, + 0.5169896949082613, + 0.0, + 1.152165986597538, + 0.22529133409261703, + 0.637687012553215, + 0.12261231988668442, + 0.6576191615313292, + 1.26264588534832, + 0.0, + 1.7849888168275356, + 0.13268346153199673 + ], + "unique_experts": 62, + "load_cv": 0.6499762578759852, + "normalized_load_entropy": 0.943907121691214, + "max_load_share": 0.0375 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "7dd0454e6348e59d9b9fe09022a4fa88902f025f7b5e05924bec5c41e6880bed", + "route_weight_sha256": "5c8643712b89137be4bc77c6cff4f63d26e4acf2f6504ec5e30c7ddba945d82d", + "loads": [ + 15, + 11, + 6, + 16, + 4, + 11, + 15, + 24, + 26, + 26, + 11, + 4, + 7, + 17, + 9, + 18, + 20, + 18, + 3, + 13, + 9, + 15, + 14, + 21, + 23, + 21, + 17, + 17, + 3, + 26, + 2, + 23, + 12, + 14, + 2, + 7, + 2, + 8, + 21, + 4, + 15, + 27, + 12, + 18, + 3, + 13, + 26, + 6, + 13, + 17, + 7, + 4, + 15, + 13, + 3, + 14, + 9, + 25, + 6, + 38, + 26, + 3, + 17, + 5 + ], + "weighted_loads": [ + 0.6441837809979916, + 0.40237841941416264, + 0.21392204239964485, + 0.5042578168213367, + 0.23421544395387173, + 1.3494640477001667, + 1.2955046948045492, + 0.8019408974796534, + 1.2504451423883438, + 1.4229520075023174, + 0.37112400494515896, + 0.11237002722918987, + 0.18396544083952904, + 1.1659924127161503, + 0.34136123210191727, + 0.9158785082399845, + 1.8350555133074522, + 0.8465174287557602, + 0.07870187796652317, + 0.3559079710394144, + 0.7190611753612757, + 0.5849972348660231, + 1.2521628085523844, + 0.5526512395590544, + 1.9134617447853088, + 1.2840302884578705, + 0.9901130888611078, + 1.037128632888198, + 0.08068988658487797, + 1.279383199289441, + 0.049817467108368874, + 2.087146346049849, + 0.6254182793200016, + 1.2861557360738516, + 0.050013964995741844, + 0.19922073557972908, + 0.10536514222621918, + 0.6301073133945465, + 1.3708124570548534, + 0.2916167713701725, + 1.1867067702114582, + 0.9991538561880589, + 0.46969401463866234, + 0.585466081101913, + 1.0350197609513998, + 0.929694137244951, + 0.8521265760064125, + 0.2610649149864912, + 0.4249950237572193, + 0.5074611399322748, + 0.19514650478959084, + 0.3289334524888545, + 0.6690219547599554, + 0.542577750980854, + 0.045365917787421495, + 1.722456194460392, + 0.5419677868485451, + 1.0450896006077528, + 0.1461883019655943, + 1.3745005782693624, + 1.353470578789711, + 0.14136506617069244, + 1.7849888168275356, + 0.13268346153199673 + ], + "unique_experts": 64, + "load_cv": 0.5909029838916401, + "normalized_load_entropy": 0.9556683841154014, + "max_load_share": 0.04367816091954023 + } + }, + "s1_eos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "3945c807179b31457fd8521426d3e89422c067adb2cd6aa7bc50a385bb72a2b4", + "route_weight_sha256": "21beb38ebae426e01e893df7647980543fd389948ae471bfd98397e801bc7e61", + "loads": [ + 14, + 10, + 1, + 15, + 2, + 11, + 13, + 23, + 8, + 26, + 8, + 5, + 13, + 18, + 8, + 9, + 18, + 16, + 2, + 12, + 7, + 15, + 13, + 20, + 24, + 17, + 3, + 16, + 2, + 30, + 2, + 18, + 10, + 12, + 2, + 6, + 2, + 8, + 22, + 1, + 15, + 16, + 10, + 11, + 2, + 1, + 29, + 2, + 9, + 17, + 17, + 4, + 11, + 12, + 0, + 10, + 6, + 18, + 7, + 14, + 25, + 0, + 17, + 5 + ], + "weighted_loads": [ + 0.5602700896561146, + 0.36335914209485054, + 0.03930041939020157, + 0.45607468858361244, + 0.18334877118468285, + 1.3455431759357452, + 1.2129929028451443, + 0.5586464814841747, + 0.3327258713543415, + 1.3985159154981375, + 0.18760287202894688, + 0.13809985294938087, + 0.3360352348536253, + 1.1863836273550987, + 0.311576995998621, + 0.29712653532624245, + 1.7747021242976189, + 0.6879127006977797, + 0.05416589789092541, + 0.32871708273887634, + 0.346728703007102, + 0.5794721283018589, + 1.2283882778137922, + 0.5322329085320234, + 1.9489701706916094, + 1.1412649638950825, + 0.16787800937891006, + 0.9819095209240913, + 0.055350931361317635, + 1.4099044110625982, + 0.04966491274535656, + 1.6941117718815804, + 0.499390859156847, + 0.9491151161491871, + 0.05047762580215931, + 0.17281530424952507, + 0.10957290604710579, + 0.6114167869091034, + 1.386778585612774, + 0.07873490452766418, + 1.1265536844730377, + 0.5535780675709248, + 0.4185892269015312, + 0.4231111090630293, + 0.05948852002620697, + 0.0722905620932579, + 0.9535391051322222, + 0.17338226735591888, + 0.30369930155575275, + 0.5195599272847176, + 0.513827595859766, + 0.3364055473357439, + 0.4142016936093569, + 0.5223685409873724, + 0.0, + 1.1755864545702934, + 0.22723715007305145, + 0.6146338805556297, + 0.17965264059603214, + 0.33221655525267124, + 1.2755873650312424, + 0.0, + 1.7633574791252613, + 0.13276120088994503 + ], + "unique_experts": 62, + "load_cv": 0.6683312551921141, + "normalized_load_entropy": 0.9399869331325632, + "max_load_share": 0.041666666666666664 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "411ba9ae026dd3bf0849c83a3f3cd53e4e0397f543a3a0027f0b0d8b8b8a9fbd", + "route_weight_sha256": "f9ee52acc91c9fb26707b974646befcc330928df922d09750d7a23fc5d313445", + "loads": [ + 17, + 10, + 4, + 17, + 7, + 13, + 15, + 26, + 31, + 27, + 13, + 6, + 14, + 19, + 9, + 21, + 18, + 22, + 3, + 14, + 10, + 17, + 18, + 22, + 26, + 22, + 22, + 18, + 2, + 32, + 3, + 25, + 12, + 14, + 2, + 6, + 3, + 9, + 23, + 6, + 15, + 28, + 13, + 18, + 4, + 12, + 29, + 6, + 11, + 17, + 23, + 8, + 16, + 13, + 5, + 14, + 16, + 29, + 9, + 25, + 27, + 4, + 17, + 9 + ], + "weighted_loads": [ + 0.7529658935964108, + 0.36335914209485054, + 0.20514292269945145, + 0.5199362020939589, + 0.47369938902556896, + 1.482578631490469, + 1.3439201265573502, + 0.7960062455385923, + 1.6293821558356285, + 1.4200538396835327, + 0.5343395862728357, + 0.28467734530568123, + 0.36001991853117943, + 1.22638538479805, + 0.33740919828414917, + 1.0003693960607052, + 1.7747021242976189, + 0.9809248559176922, + 0.09312320686876774, + 0.418649036437273, + 0.7051873784512281, + 0.7838487289845943, + 1.4993659785250202, + 0.5923134963959455, + 2.020749669522047, + 1.3141884710639715, + 1.4436563532799482, + 1.0763333663344383, + 0.055350931361317635, + 1.5718601141124964, + 0.1357941087335348, + 2.3164884792349767, + 0.6200983598828316, + 1.3091545961797237, + 0.05047762580215931, + 0.17281530424952507, + 0.3704362101852894, + 0.6449513621628284, + 1.4117109961807728, + 0.41219867765903473, + 1.1265536844730377, + 1.1271875109523535, + 0.6259736027568579, + 0.6429530400782824, + 1.200370267033577, + 0.8400159756129142, + 0.9535391051322222, + 0.28176606554188766, + 0.45500470139086246, + 0.5195599272847176, + 0.8120528943836689, + 0.7012698259204626, + 0.7192390542477369, + 0.5464558806270361, + 0.09381738264346495, + 1.728387676179409, + 0.6984849609434605, + 1.25358235090971, + 0.254832373932004, + 1.0040660966187716, + 1.391320550814271, + 0.23237480223178864, + 1.7633574791252613, + 0.6253105234354734 + ], + "unique_experts": 64, + "load_cv": 0.5359040381680429, + "normalized_load_entropy": 0.9625990062310894, + "max_load_share": 0.033126293995859216 + } + }, + "s0_bos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "da33ce6a5d8e47f72468035c7737b5cc4aa05ef61280e509ecd5c36912888df0", + "route_weight_sha256": "0f48cffdb27dfb78d8cead212761567f75d970dbf7b9560e3095c80402290eba", + "loads": [ + 14, + 11, + 4, + 10, + 2, + 11, + 18, + 25, + 7, + 30, + 16, + 6, + 3, + 17, + 9, + 9, + 17, + 11, + 9, + 17, + 5, + 5, + 13, + 26, + 24, + 17, + 5, + 16, + 5, + 36, + 4, + 18, + 10, + 11, + 3, + 6, + 3, + 8, + 18, + 1, + 15, + 16, + 9, + 11, + 1, + 1, + 17, + 8, + 15, + 6, + 13, + 3, + 11, + 11, + 2, + 10, + 3, + 18, + 9, + 17, + 25, + 0, + 17, + 2 + ], + "weighted_loads": [ + 0.5845480710268021, + 0.3935520723462105, + 0.10952274687588215, + 0.32497902028262615, + 0.16030381619930267, + 1.2261311709880829, + 1.3788825292140245, + 0.6272710710763931, + 0.20746010914444923, + 1.6308671943843365, + 0.3919310048222542, + 0.15916570276021957, + 0.08002990111708641, + 1.236525872722268, + 0.3745379075407982, + 0.3209021706134081, + 1.770446166396141, + 0.4653962180018425, + 0.23399213142693043, + 0.45908794924616814, + 0.24517503567039967, + 0.29880837351083755, + 1.2526389006525278, + 0.6936705689877272, + 1.9059890136122704, + 1.1791225261986256, + 0.2036615703254938, + 0.9888875633478165, + 0.1316049937158823, + 1.6590223088860512, + 0.09979536943137646, + 1.7398498877882957, + 0.49203604832291603, + 0.8141404874622822, + 0.07369737699627876, + 0.16032102517783642, + 0.12334448844194412, + 0.6660283096134663, + 1.367194052785635, + 0.07483717799186707, + 1.2190156057476997, + 0.5578508377075195, + 0.39767491817474365, + 0.4227424468845129, + 0.02341206558048725, + 0.07510806620121002, + 0.5734189450740814, + 0.3108077645301819, + 0.48567785508930683, + 0.21329569816589355, + 0.3636471536010504, + 0.3289347067475319, + 0.4624677263200283, + 0.4737576190382242, + 0.0528855137526989, + 1.1519940048456192, + 0.1779274307191372, + 0.6436752788722515, + 0.23274415731430054, + 0.41841134428977966, + 1.2515175770968199, + 0.0, + 1.8215882554650307, + 0.07036860287189484 + ], + "unique_experts": 63, + "load_cv": 0.6756798131338121, + "normalized_load_entropy": 0.9435019815221208, + "max_load_share": 0.05 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "099d79948f3b2ebf459337bb11d46d0319ef23611a66a9fbea8121b99e142d41", + "route_weight_sha256": "7f4a036f1645ae1f2362c451243e0449afbdecd896cdb9535da884793b436cd4", + "loads": [ + 16, + 11, + 6, + 12, + 4, + 11, + 20, + 27, + 22, + 31, + 19, + 8, + 3, + 17, + 10, + 18, + 17, + 14, + 9, + 18, + 8, + 5, + 14, + 27, + 24, + 21, + 18, + 17, + 5, + 36, + 4, + 22, + 12, + 13, + 3, + 6, + 3, + 8, + 19, + 4, + 15, + 26, + 11, + 17, + 1, + 11, + 18, + 8, + 15, + 6, + 14, + 3, + 15, + 12, + 4, + 14, + 7, + 26, + 9, + 27, + 27, + 3, + 17, + 2 + ], + "weighted_loads": [ + 0.6999595742672682, + 0.3935520723462105, + 0.19481302984058857, + 0.3843768611550331, + 0.21201171539723873, + 1.2261311709880829, + 1.5309504959732294, + 0.8869980275630951, + 1.0239545553922653, + 1.6535251382738352, + 0.5767841953784227, + 0.21131913922727108, + 0.08002990111708641, + 1.236525872722268, + 0.4036781080067158, + 0.9382183905690908, + 1.770446166396141, + 0.6571473143994808, + 0.23399213142693043, + 0.48324617370963097, + 0.581864358857274, + 0.29880837351083755, + 1.2827068082988262, + 0.7200319543480873, + 1.9059890136122704, + 1.331718822941184, + 1.0115224532783031, + 1.0513669960200787, + 0.1316049937158823, + 1.6590223088860512, + 0.09979536943137646, + 2.138729065656662, + 0.6257886365056038, + 1.1870378740131855, + 0.07369737699627876, + 0.16032102517783642, + 0.12334448844194412, + 0.6660283096134663, + 1.3932997807860374, + 0.29375024139881134, + 1.2190156057476997, + 0.9700736366212368, + 0.4667718317359686, + 0.5790250077843666, + 0.02341206558048725, + 0.8933169320225716, + 0.599550286307931, + 0.3108077645301819, + 0.48567785508930683, + 0.21329569816589355, + 0.39006404392421246, + 0.3289347067475319, + 0.6886700540781021, + 0.4987222384661436, + 0.09779990278184414, + 1.7129367887973785, + 0.5191484577953815, + 1.1266128607094288, + 0.23274415731430054, + 1.1019768044352531, + 1.447328282520175, + 0.14109688997268677, + 1.8215882554650307, + 0.07036860287189484 + ], + "unique_experts": 64, + "load_cv": 0.5948961590769901, + "normalized_load_entropy": 0.9555392543359584, + "max_load_share": 0.041379310344827586 + } + }, + "s1_bos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "21b053801d348a3a71aa37a8dd88751d2184b9bc2657afd935e0cba0f210605a", + "route_weight_sha256": "00b69a1240defe7ca5d9e0b55c7d68c8167a98825edc6a856aa8a078fbdc2816", + "loads": [ + 15, + 12, + 1, + 12, + 2, + 11, + 18, + 26, + 5, + 28, + 13, + 6, + 4, + 21, + 9, + 10, + 16, + 10, + 10, + 11, + 5, + 6, + 13, + 24, + 24, + 17, + 8, + 16, + 3, + 40, + 4, + 18, + 10, + 11, + 3, + 6, + 2, + 8, + 18, + 1, + 15, + 16, + 10, + 10, + 3, + 1, + 17, + 7, + 14, + 10, + 18, + 3, + 13, + 10, + 6, + 10, + 3, + 18, + 2, + 14, + 25, + 0, + 17, + 1 + ], + "weighted_loads": [ + 0.5903918277472258, + 0.4197196736931801, + 0.03587479516863823, + 0.36270381323993206, + 0.16700602695345879, + 1.2664767391979694, + 1.3096275553107262, + 0.646973192691803, + 0.1548355184495449, + 1.5423059985041618, + 0.30963282845914364, + 0.16427534073591232, + 0.11092379502952099, + 1.3622665461152792, + 0.3810258526355028, + 0.3366921879351139, + 1.8065903186798096, + 0.40015120431780815, + 0.2592499628663063, + 0.300652202218771, + 0.25338233821094036, + 0.32897550985217094, + 1.2603277508169413, + 0.642432663589716, + 1.8422630168497562, + 1.2099578753113747, + 0.3170577585697174, + 1.0105567835271358, + 0.07705659233033657, + 1.7401694860309362, + 0.10049356706440449, + 1.713706523180008, + 0.4574391655623913, + 0.7765584960579872, + 0.07277762144804001, + 0.1577575635164976, + 0.11047539114952087, + 0.6446986831724644, + 1.349865697324276, + 0.07357874512672424, + 1.154948454350233, + 0.5711604468524456, + 0.4230085387825966, + 0.3864005245268345, + 0.09044491313397884, + 0.08032868057489395, + 0.5720716156065464, + 0.3044798318296671, + 0.46749706380069256, + 0.3267713636159897, + 0.6476886980235577, + 0.32284338772296906, + 0.4979051426053047, + 0.4487294405698776, + 0.14958704262971878, + 1.132478304207325, + 0.14661073498427868, + 0.6207427382469177, + 0.056496648117899895, + 0.33667800202965736, + 1.2900260239839554, + 0.0, + 1.7965905368328094, + 0.049486979842185974 + ], + "unique_experts": 63, + "load_cv": 0.6919287767529007, + "normalized_load_entropy": 0.9411470612897507, + "max_load_share": 0.05555555555555555 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "f3952f1f48c91c2f335be2a068aef87acd215a872b4a7a711c353334e0104e21", + "route_weight_sha256": "18ee149d9c556e2a81d7a6b59ad8d450658a8c748719d42274611daffb8968c4", + "loads": [ + 19, + 12, + 4, + 15, + 7, + 13, + 20, + 29, + 26, + 29, + 19, + 7, + 4, + 23, + 10, + 22, + 16, + 16, + 11, + 13, + 8, + 8, + 17, + 26, + 26, + 22, + 27, + 18, + 3, + 42, + 5, + 24, + 12, + 13, + 4, + 6, + 3, + 9, + 18, + 6, + 15, + 28, + 15, + 17, + 4, + 11, + 18, + 10, + 16, + 10, + 25, + 7, + 18, + 10, + 10, + 14, + 13, + 31, + 4, + 24, + 28, + 4, + 17, + 5 + ], + "weighted_loads": [ + 0.8228042293339968, + 0.4197196736931801, + 0.18823357671499252, + 0.4538951553404331, + 0.4573566447943449, + 1.4035121947526932, + 1.438252229243517, + 0.8750269878655672, + 1.374949622899294, + 1.564347255975008, + 0.690181065350771, + 0.3108528330922127, + 0.11092379502952099, + 1.4266289956867695, + 0.407568970695138, + 1.0399350486695766, + 1.8065903186798096, + 0.6815561149269342, + 0.29820727184414864, + 0.3913569748401642, + 0.5439854320138693, + 0.5333521105349064, + 1.5309946089982986, + 0.7030782233923674, + 1.914042515680194, + 1.3909095469862223, + 1.5902518425136805, + 1.1026249155402184, + 0.07705659233033657, + 1.9021251890808344, + 0.18662276305258274, + 2.337825581431389, + 0.5749203115701675, + 1.0992859899997711, + 0.09594865143299103, + 0.1577575635164976, + 0.37133869528770447, + 0.6782332584261894, + 1.349865697324276, + 0.41274333372712135, + 1.154948454350233, + 1.1447698902338743, + 0.6924668904393911, + 0.6053196080029011, + 0.24235930107533932, + 0.8475857712328434, + 0.6023162044584751, + 0.413266072049737, + 0.6188024636358023, + 0.3267713636159897, + 0.971497219055891, + 0.6877076663076878, + 0.788010086864233, + 0.4487294405698776, + 0.24298267997801304, + 1.6682136505842209, + 0.6325469855219126, + 1.360531521961093, + 0.13167638145387173, + 0.973943118005991, + 1.5083307940512896, + 0.23232804983854294, + 1.7965905368328094, + 0.5420363023877144 + ], + "unique_experts": 64, + "load_cv": 0.5645723953129863, + "normalized_load_entropy": 0.9611271910769135, + "max_load_share": 0.043478260869565216 + } + }, + "s0_x": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "30c98f9e2b8c2b104ad493755a1aa8c522b035ac2d0af3f278fd5318cb4b3bb8", + "route_weight_sha256": "c90953dee99b6c1c7f639e98802f542fcb2ab3f96ed0be4e22258bf1512b7cb8", + "loads": [ + 16, + 11, + 3, + 11, + 2, + 11, + 18, + 26, + 5, + 29, + 18, + 4, + 8, + 17, + 8, + 9, + 18, + 12, + 9, + 19, + 4, + 7, + 13, + 25, + 24, + 17, + 5, + 16, + 2, + 28, + 4, + 18, + 10, + 11, + 3, + 6, + 2, + 8, + 18, + 1, + 15, + 16, + 14, + 13, + 1, + 1, + 18, + 5, + 12, + 6, + 13, + 3, + 11, + 11, + 4, + 10, + 3, + 18, + 9, + 17, + 25, + 0, + 17, + 2 + ], + "weighted_loads": [ + 0.6347643919289112, + 0.393783962354064, + 0.08652477525174618, + 0.342652278020978, + 0.16708874329924583, + 1.2848307341337204, + 1.3774861060082912, + 0.6358066517859697, + 0.1529602985829115, + 1.5882034432142973, + 0.43991687148809433, + 0.11180732771754265, + 0.21301979385316372, + 1.2198542822152376, + 0.3436933644115925, + 0.31096036545932293, + 1.7443438600748777, + 0.5142470933496952, + 0.22548258304595947, + 0.51121043600142, + 0.21772822923958302, + 0.34685367718338966, + 1.2285550571978092, + 0.6863066628575325, + 1.9615147672593594, + 1.1710718236863613, + 0.20832344889640808, + 0.9882383216172457, + 0.054736435413360596, + 1.4118051286786795, + 0.09912765212357044, + 1.803399108350277, + 0.5010480061173439, + 0.8598717451095581, + 0.07140655629336834, + 0.16379735432565212, + 0.10132601857185364, + 0.6831302791833878, + 1.3162806369364262, + 0.07676252722740173, + 1.2906304895877838, + 0.555150717496872, + 0.5286448411643505, + 0.47055542282760143, + 0.02427959255874157, + 0.07368803769350052, + 0.6135657113045454, + 0.2315075807273388, + 0.41887407936155796, + 0.21232710033655167, + 0.3639860786497593, + 0.33406253159046173, + 0.44817509688436985, + 0.481603404507041, + 0.09865930862724781, + 1.1768535748124123, + 0.1638888269662857, + 0.6499402318149805, + 0.23685449361801147, + 0.4133993983268738, + 1.2528305537998676, + 0.0, + 1.830362681299448, + 0.06998912990093231 + ], + "unique_experts": 63, + "load_cv": 0.6547075494513882, + "normalized_load_entropy": 0.9442138305165836, + "max_load_share": 0.04027777777777778 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "b9c4e9c3ad9f0b17e9ca510051b979135d785d4a06bffe27894e8077c0bd1291", + "route_weight_sha256": "8fd33b84141a76cffa7c048da2ae54eff6fe0af19115866c969ec7686b0eddf7", + "loads": [ + 17, + 11, + 5, + 13, + 4, + 11, + 20, + 29, + 20, + 31, + 20, + 5, + 8, + 17, + 9, + 19, + 18, + 14, + 9, + 20, + 7, + 7, + 15, + 26, + 24, + 21, + 19, + 17, + 2, + 28, + 4, + 22, + 12, + 13, + 3, + 6, + 2, + 8, + 18, + 4, + 15, + 27, + 15, + 19, + 1, + 12, + 18, + 5, + 12, + 6, + 14, + 3, + 15, + 12, + 6, + 14, + 6, + 25, + 11, + 28, + 26, + 3, + 17, + 2 + ], + "weighted_loads": [ + 0.7267935611307621, + 0.393783962354064, + 0.18105394951999187, + 0.40098834224045277, + 0.2187966424971819, + 1.2848307341337204, + 1.5292422957718372, + 0.9347226954996586, + 0.9728973340243101, + 1.6369912195950747, + 0.599167175590992, + 0.13537499122321606, + 0.21301979385316372, + 1.2198542822152376, + 0.37309667095541954, + 1.0456227753311396, + 1.7443438600748777, + 0.6715675108134747, + 0.22548258304595947, + 0.5355278979986906, + 0.5486597437411547, + 0.34685367718338966, + 1.2894953526556492, + 0.7134735025465488, + 1.9615147672593594, + 1.3279622420668602, + 1.0464363619685173, + 1.0546336192637682, + 0.054736435413360596, + 1.4118051286786795, + 0.09912765212357044, + 2.204045906662941, + 0.6355406157672405, + 1.2421355098485947, + 0.07140655629336834, + 0.16379735432565212, + 0.10132601857185364, + 0.6831302791833878, + 1.3162806369364262, + 0.3195333406329155, + 1.2906304895877838, + 1.0232127979397774, + 0.5559441596269608, + 0.6313628237694502, + 0.02427959255874157, + 0.9256308749318123, + 0.6135657113045454, + 0.2315075807273388, + 0.41887407936155796, + 0.21232710033655167, + 0.39040296897292137, + 0.33406253159046173, + 0.6586286369711161, + 0.506192633882165, + 0.14357369765639305, + 1.7615858614444733, + 0.35615233331918716, + 1.0471533872187138, + 0.2877748943865299, + 1.1954618021845818, + 1.3436552472412586, + 0.13927479833364487, + 1.830362681299448, + 0.06998912990093231 + ], + "unique_experts": 64, + "load_cv": 0.5831246441720428, + "normalized_load_entropy": 0.955785693307735, + "max_load_share": 0.035632183908045977 + } + }, + "s1_x": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "0433e22673a3c25ef317a1bf0266387f003902cb1a6826aa34ad00f8827de110", + "route_weight_sha256": "410b1c5643f0916d314152978b6c52480b25eaaa6a87e535ee54f6f32b880476", + "loads": [ + 15, + 13, + 1, + 10, + 2, + 11, + 18, + 26, + 4, + 28, + 13, + 5, + 9, + 20, + 8, + 9, + 16, + 11, + 9, + 16, + 5, + 8, + 14, + 24, + 24, + 17, + 10, + 16, + 3, + 30, + 4, + 18, + 10, + 11, + 3, + 6, + 2, + 8, + 18, + 1, + 15, + 16, + 13, + 10, + 5, + 1, + 18, + 5, + 11, + 10, + 18, + 3, + 12, + 10, + 5, + 10, + 3, + 18, + 3, + 14, + 25, + 0, + 17, + 2 + ], + "weighted_loads": [ + 0.5909375250339508, + 0.44922732934355736, + 0.03564244508743286, + 0.3117449935525656, + 0.17229051142930984, + 1.3103119730949402, + 1.2835597805678844, + 0.6426978018134832, + 0.11652897112071514, + 1.5323838144540787, + 0.30466787703335285, + 0.13602652214467525, + 0.23758920095860958, + 1.3485508281737566, + 0.35565441846847534, + 0.31013195775449276, + 1.7960130870342255, + 0.42522745579481125, + 0.23360268212854862, + 0.4263807628303766, + 0.2486241403967142, + 0.3757421802729368, + 1.281320583075285, + 0.6516051348298788, + 1.8285759631544352, + 1.2129947617650032, + 0.37257929891347885, + 1.0171700716018677, + 0.0850085411220789, + 1.4425463732331991, + 0.1003043670207262, + 1.7523095160722733, + 0.44954997301101685, + 0.7693115994334221, + 0.07063564285635948, + 0.16086135245859623, + 0.10745459794998169, + 0.6556137278676033, + 1.3217782154679298, + 0.07377476990222931, + 1.2290244288742542, + 0.5658861827105284, + 0.49435452558100224, + 0.38758881762623787, + 0.14134281501173973, + 0.08252882957458496, + 0.6055423617362976, + 0.2515434008091688, + 0.3973313234746456, + 0.32442495226860046, + 0.6624279748648405, + 0.3270011618733406, + 0.46915814839303493, + 0.4544638730585575, + 0.1315388884395361, + 1.1436124071478844, + 0.13348872773349285, + 0.6340158674865961, + 0.08187672682106495, + 0.33266502618789673, + 1.30457379296422, + 0.0, + 1.7949716188013554, + 0.07084387540817261 + ], + "unique_experts": 63, + "load_cv": 0.6429100507328637, + "normalized_load_entropy": 0.9466091747857326, + "max_load_share": 0.041666666666666664 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "dfae391ac0182cb137cf11ddb64ea08a8c76b5526fcca132c2b38f85285226ed", + "route_weight_sha256": "1ccf0b859dd4b9a73d4cbb1c518752c03bba35cf7d872c19a03e80953c9c7657", + "loads": [ + 18, + 13, + 4, + 12, + 7, + 13, + 20, + 30, + 25, + 30, + 19, + 6, + 9, + 22, + 9, + 22, + 16, + 17, + 10, + 18, + 8, + 10, + 18, + 26, + 26, + 22, + 30, + 18, + 3, + 32, + 5, + 24, + 12, + 13, + 3, + 6, + 3, + 9, + 18, + 6, + 15, + 29, + 17, + 17, + 6, + 12, + 19, + 8, + 14, + 10, + 25, + 7, + 17, + 10, + 9, + 14, + 12, + 29, + 5, + 25, + 27, + 4, + 17, + 6 + ], + "weighted_loads": [ + 0.7968849390745163, + 0.44922732934355736, + 0.19523391500115395, + 0.37087636068463326, + 0.46264112927019596, + 1.447347428649664, + 1.4120807871222496, + 0.9081571102142334, + 1.337350470945239, + 1.5790937654674053, + 0.6845592185854912, + 0.2826040145009756, + 0.23758920095860958, + 1.4145005773752928, + 0.38269797526299953, + 1.1246868204325438, + 1.7960130870342255, + 0.7051058392971754, + 0.27255999110639095, + 0.5169987268745899, + 0.5391838271170855, + 0.5801187809556723, + 1.5519874412566423, + 0.7130790371447802, + 1.9003554619848728, + 1.3987004589289427, + 1.684067390859127, + 1.1106094159185886, + 0.0850085411220789, + 1.6045020762830973, + 0.18643356300890446, + 2.377511240541935, + 0.5660677440464497, + 1.0933217853307724, + 0.07063564285635948, + 0.16086135245859623, + 0.3683179020881653, + 0.6891483031213284, + 1.3217782154679298, + 0.43109679967164993, + 1.2290244288742542, + 1.2061109021306038, + 0.7279351670295, + 0.6067361272871494, + 0.2932572029531002, + 0.8843975029885769, + 0.6391941197216511, + 0.3603607099503279, + 0.5702899601310492, + 0.32442495226860046, + 0.9865031335502863, + 0.6918654404580593, + 0.7457212414592505, + 0.4544638730585575, + 0.22493452578783035, + 1.6916824132204056, + 0.4916799906641245, + 1.266165129840374, + 0.15705646015703678, + 1.064163126051426, + 1.4203069787472486, + 0.23081183806061745, + 1.7949716188013554, + 0.563393197953701 + ], + "unique_experts": 64, + "load_cv": 0.5361599350597639, + "normalized_load_entropy": 0.9641784926810205, + "max_load_share": 0.033126293995859216 + } + }, + "s0_period": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "3f60494aeeb60a2e4e6005e37ba3538832191bf56efed9fdeb3cfa2e348c0434", + "route_weight_sha256": "2071d8558bd060d967435b65942bee9fae556e9cc4a72ad2a672a88957d9aca8", + "loads": [ + 16, + 11, + 3, + 11, + 2, + 11, + 17, + 26, + 5, + 30, + 18, + 4, + 7, + 17, + 8, + 9, + 17, + 12, + 10, + 20, + 4, + 7, + 13, + 25, + 24, + 17, + 4, + 16, + 2, + 29, + 4, + 18, + 10, + 11, + 3, + 6, + 2, + 8, + 19, + 1, + 15, + 16, + 13, + 13, + 1, + 1, + 18, + 5, + 11, + 6, + 13, + 3, + 11, + 11, + 5, + 10, + 3, + 18, + 8, + 17, + 25, + 0, + 17, + 3 + ], + "weighted_loads": [ + 0.633251553401351, + 0.39483782835304737, + 0.08615628443658352, + 0.34182685799896717, + 0.1641293689608574, + 1.2887208983302116, + 1.3522569611668587, + 0.6415078528225422, + 0.1527540385723114, + 1.617429293692112, + 0.44135607406497, + 0.11072026565670967, + 0.18722344003617764, + 1.2165659349411726, + 0.34330733492970467, + 0.31136588752269745, + 1.7249959129840136, + 0.5139804817736149, + 0.24676339328289032, + 0.5367057900875807, + 0.21643717773258686, + 0.3474192749708891, + 1.2290359884500504, + 0.6855963710695505, + 1.9812207259237766, + 1.170167375355959, + 0.18439294584095478, + 0.9912314135581255, + 0.05489087663590908, + 1.433275444433093, + 0.09962060861289501, + 1.8249413073062897, + 0.49727344512939453, + 0.8590298406779766, + 0.07122991234064102, + 0.16347170807421207, + 0.10024572163820267, + 0.6863165646791458, + 1.3375648092478514, + 0.07669349759817123, + 1.2985720559954643, + 0.5518202148377895, + 0.5031903591006994, + 0.47236319817602634, + 0.024462098255753517, + 0.07459165900945663, + 0.6159308739006519, + 0.2297227941453457, + 0.3934578336775303, + 0.21421983651816845, + 0.3639106787741184, + 0.33178017288446426, + 0.4464336149394512, + 0.48043823428452015, + 0.12035017274320126, + 1.1697838604450226, + 0.16624287143349648, + 0.6478661149740219, + 0.20674220472574234, + 0.4131756071001291, + 1.2545140460133553, + 0.0, + 1.8266091905534267, + 0.09125514887273312 + ], + "unique_experts": 63, + "load_cv": 0.6607141665474892, + "normalized_load_entropy": 0.9439265442721672, + "max_load_share": 0.041666666666666664 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "ee0185b7593b183cebbf2a6e0beceaaff9a06f5e7bb9be25f19136d7c0f38f6d", + "route_weight_sha256": "0214dee48f372d3e5dbefb310fea413c11c428c03dd762ac0c98ee6495a5336f", + "loads": [ + 17, + 11, + 5, + 13, + 5, + 11, + 19, + 28, + 20, + 32, + 20, + 6, + 7, + 17, + 9, + 18, + 17, + 14, + 10, + 21, + 7, + 7, + 14, + 26, + 24, + 21, + 17, + 17, + 2, + 29, + 4, + 22, + 12, + 13, + 3, + 7, + 2, + 8, + 19, + 4, + 15, + 26, + 14, + 20, + 1, + 11, + 18, + 5, + 13, + 6, + 14, + 4, + 15, + 12, + 7, + 14, + 6, + 24, + 10, + 28, + 26, + 3, + 17, + 3 + ], + "weighted_loads": [ + 0.7267612274736166, + 0.39483782835304737, + 0.17163281328976154, + 0.4003230407834053, + 0.3381496127694845, + 1.2887208983302116, + 1.5038205906748772, + 0.8930784724652767, + 0.949678760021925, + 1.6655850186944008, + 0.6009360738098621, + 0.27147284895181656, + 0.18722344003617764, + 1.2165659349411726, + 0.3726579863578081, + 0.9286821074783802, + 1.7249959129840136, + 0.6708874069154263, + 0.24676339328289032, + 0.5611972156912088, + 0.5482394862920046, + 0.3474192749708891, + 1.2591038960963488, + 0.7126311343163252, + 1.9812207259237766, + 1.3267191667109728, + 0.9927727989852428, + 1.0570232961326838, + 0.05489087663590908, + 1.433275444433093, + 0.09962060861289501, + 2.2252502143383026, + 0.6312062107026577, + 1.2407044284045696, + 0.07122991234064102, + 0.1847931258380413, + 0.10024572163820267, + 0.6863165646791458, + 1.3375648092478514, + 0.29905445501208305, + 1.2985720559954643, + 0.9640430137515068, + 0.5305420383810997, + 0.6576199289411306, + 0.024462098255753517, + 0.8928005248308182, + 0.6159308739006519, + 0.2297227941453457, + 0.4383916761726141, + 0.21421983651816845, + 0.3903275690972805, + 0.3846188634634018, + 0.6707155220210552, + 0.5052355341613293, + 0.1652645617723465, + 1.7557821944355965, + 0.3588502071797848, + 1.0174804460257292, + 0.2579536996781826, + 1.1267981324344873, + 1.3453387394547462, + 0.1364193633198738, + 1.8266091905534267, + 0.09125514887273312 + ], + "unique_experts": 64, + "load_cv": 0.5743585115833549, + "normalized_load_entropy": 0.9576982605342746, + "max_load_share": 0.0367816091954023 + } + }, + "s1_period": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "5e2b9d1af5b3b5c8280d860e371476f103560ecba96a8acf19e38edf32d29485", + "route_weight_sha256": "69e6ee19cfe3e9e8015dd272d08cfd7ed878a9f9d9ea66dada83727c738c5be4", + "loads": [ + 15, + 13, + 1, + 10, + 2, + 11, + 18, + 27, + 5, + 28, + 13, + 4, + 6, + 20, + 8, + 9, + 16, + 11, + 11, + 17, + 4, + 8, + 14, + 24, + 24, + 17, + 8, + 16, + 2, + 32, + 4, + 18, + 10, + 11, + 3, + 6, + 2, + 8, + 18, + 1, + 15, + 16, + 12, + 10, + 6, + 1, + 19, + 5, + 11, + 10, + 18, + 3, + 12, + 10, + 5, + 10, + 3, + 18, + 3, + 14, + 25, + 0, + 17, + 2 + ], + "weighted_loads": [ + 0.5894939675927162, + 0.44898403994739056, + 0.035759326070547104, + 0.31288324855268, + 0.16997279226779938, + 1.3092401325702667, + 1.2874330785125494, + 0.6656135320663452, + 0.1410000380128622, + 1.5339084845036268, + 0.3058735057711601, + 0.10951701924204826, + 0.16315476782619953, + 1.3478983230888844, + 0.355450801551342, + 0.311232129111886, + 1.794830460101366, + 0.4232835341244936, + 0.27534501254558563, + 0.4508896954357624, + 0.22514385357499123, + 0.3770409841090441, + 1.2814965192228556, + 0.6523218359798193, + 1.8403810560703278, + 1.2127933651208878, + 0.3306182101368904, + 1.0174442268908024, + 0.05617431551218033, + 1.4947217851877213, + 0.10067501664161682, + 1.7642255276441574, + 0.4489230737090111, + 0.771549291908741, + 0.0709735918790102, + 0.16119994036853313, + 0.10728538408875465, + 0.657087005674839, + 1.3221425712108612, + 0.07399311661720276, + 1.2323597557842731, + 0.5622705947607756, + 0.47134321741759777, + 0.3883436471223831, + 0.1670647356659174, + 0.08223097026348114, + 0.6283826753497124, + 0.2519968319684267, + 0.39685082249343395, + 0.32447895035147667, + 0.6630433052778244, + 0.32470979541540146, + 0.467207670211792, + 0.45354199036955833, + 0.13388058729469776, + 1.1404027044773102, + 0.13482815027236938, + 0.6324043795466423, + 0.08171665482223034, + 0.33301445096731186, + 1.304905466735363, + 0.0, + 1.794711995869875, + 0.07082588970661163 + ], + "unique_experts": 63, + "load_cv": 0.6597792373023788, + "normalized_load_entropy": 0.9443319328621623, + "max_load_share": 0.044444444444444446 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "269434a92a5158c73c9d8f44fac46c4767a5269553d874943d5caeb696b4395d", + "route_weight_sha256": "4f59dce0ac10512f155d2177ef77f00a8893fde9b41f360a1685c602032d1d05", + "loads": [ + 18, + 13, + 4, + 12, + 8, + 13, + 20, + 30, + 25, + 29, + 19, + 7, + 6, + 22, + 9, + 21, + 16, + 17, + 12, + 19, + 7, + 10, + 18, + 26, + 26, + 22, + 28, + 18, + 2, + 34, + 6, + 24, + 12, + 13, + 3, + 6, + 4, + 9, + 18, + 6, + 15, + 29, + 16, + 17, + 7, + 11, + 19, + 8, + 14, + 10, + 25, + 8, + 18, + 10, + 9, + 14, + 12, + 29, + 5, + 24, + 27, + 4, + 17, + 6 + ], + "weighted_loads": [ + 0.795616589486599, + 0.44898403994739056, + 0.18509991094470024, + 0.3721482139080763, + 0.5805664006620646, + 1.4462755881249905, + 1.4156150538474321, + 0.8813068140298128, + 1.3206833768635988, + 1.5558220017701387, + 0.6860280334949493, + 0.42319807782769203, + 0.16315476782619953, + 1.4154376275837421, + 0.38247091323137283, + 1.0144749898463488, + 1.794830460101366, + 0.7037480175495148, + 0.31430232152342796, + 0.541730061173439, + 0.5144731067121029, + 0.5814175847917795, + 1.552163377404213, + 0.7138260547071695, + 1.9121605549007654, + 1.3976237587630749, + 1.6322875916957855, + 1.109859425574541, + 0.05617431551218033, + 1.6566774882376194, + 0.2076631709933281, + 2.3891906291246414, + 0.5654766745865345, + 1.095000684261322, + 0.0709735918790102, + 0.16119994036853313, + 0.390150748193264, + 0.6906215809285641, + 1.3221425712108612, + 0.4118760824203491, + 1.2323597557842731, + 1.171125415712595, + 0.7048613820225, + 0.6076486688107252, + 0.31897912360727787, + 0.8494880609214306, + 0.6283826753497124, + 0.3607750404626131, + 0.5703928899019957, + 0.32447895035147667, + 0.9871531184762716, + 0.7323151715099812, + 0.7775417491793633, + 0.45354199036955833, + 0.22727622464299202, + 1.6890014335513115, + 0.49657701700925827, + 1.2640812881290913, + 0.15689638815820217, + 0.9702795669436455, + 1.4206386525183916, + 0.22568901255726814, + 1.794711995869875, + 0.56337521225214 + ], + "unique_experts": 64, + "load_cv": 0.5319218942931869, + "normalized_load_entropy": 0.9647486013671321, + "max_load_share": 0.035196687370600416 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 120, + "ordered_topk_exact_tokens": 66, + "set_exact_tokens": 81, + "mean_set_jaccard": 0.8986111111111111, + "mean_token_weighted_tv": 0.013747024505088726, + "aggregate_load_tv": 0.05138888888888889 + }, + "system_bos": { + "tokens": 120, + "ordered_topk_exact_tokens": 62, + "set_exact_tokens": 73, + "mean_set_jaccard": 0.8845238095238097, + "mean_token_weighted_tv": 0.016122342149416605, + "aggregate_load_tv": 0.05277777777777777 + }, + "system_x": { + "tokens": 120, + "ordered_topk_exact_tokens": 63, + "set_exact_tokens": 76, + "mean_set_jaccard": 0.8880952380952382, + "mean_token_weighted_tv": 0.01739851621290048, + "aggregate_load_tv": 0.04583333333333334 + }, + "system_period": { + "tokens": 120, + "ordered_topk_exact_tokens": 61, + "set_exact_tokens": 78, + "mean_set_jaccard": 0.8964285714285716, + "mean_token_weighted_tv": 0.016591674384350576, + "aggregate_load_tv": 0.04583333333333334 + }, + "bos_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 38, + "set_exact_tokens": 50, + "mean_set_jaccard": 0.7898809523809526, + "mean_token_weighted_tv": 0.02837504371224592, + "aggregate_load_tv": 0.10555555555555556 + }, + "bos_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 37, + "set_exact_tokens": 48, + "mean_set_jaccard": 0.7904761904761906, + "mean_token_weighted_tv": 0.029401670419611038, + "aggregate_load_tv": 0.10416666666666667 + }, + "x_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 38, + "set_exact_tokens": 52, + "mean_set_jaccard": 0.8009920634920635, + "mean_token_weighted_tv": 0.02660441061016172, + "aggregate_load_tv": 0.09444444444444444 + }, + "x_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 39, + "set_exact_tokens": 52, + "mean_set_jaccard": 0.805357142857143, + "mean_token_weighted_tv": 0.028207638401848575, + "aggregate_load_tv": 0.09166666666666666 + }, + "period_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 40, + "set_exact_tokens": 54, + "mean_set_jaccard": 0.8057539682539684, + "mean_token_weighted_tv": 0.02609723649608592, + "aggregate_load_tv": 0.09444444444444444 + }, + "period_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 39, + "set_exact_tokens": 51, + "mean_set_jaccard": 0.8015873015873017, + "mean_token_weighted_tv": 0.02858272025672098, + "aggregate_load_tv": 0.09583333333333334 + } + } + }, + "layer_02": { + "layer": 2, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "0796d35c13895a639d627a8113e443f1417e4c92e2af638a51b40f10299d16d8", + "route_weight_sha256": "5c1af1a5f5da195f804d714bb9e76043e4c7204633ff6e9b4697f6918e7e636c", + "loads": [ + 2, + 3, + 12, + 12, + 6, + 5, + 16, + 3, + 8, + 13, + 13, + 3, + 21, + 15, + 18, + 10, + 4, + 11, + 20, + 8, + 20, + 7, + 17, + 7, + 17, + 10, + 5, + 25, + 3, + 11, + 7, + 4, + 0, + 7, + 18, + 10, + 3, + 15, + 20, + 11, + 2, + 17, + 21, + 10, + 4, + 1, + 10, + 23, + 16, + 5, + 6, + 7, + 14, + 5, + 25, + 21, + 27, + 25, + 14, + 7, + 9, + 8, + 18, + 5 + ], + "weighted_loads": [ + 0.24015315622091293, + 0.08368586748838425, + 0.3416844792664051, + 1.2220981772989035, + 0.20319033972918987, + 0.3597992677241564, + 0.45778802409768105, + 0.27577510103583336, + 0.39264052733778954, + 0.4050195384770632, + 0.36724967509508133, + 0.09740336798131466, + 1.1518415790051222, + 1.609072344377637, + 0.89149559289217, + 0.63857183419168, + 0.1647384762763977, + 0.6454557217657566, + 2.8846956118941307, + 0.38526030257344246, + 0.5659902561455965, + 0.5432693585753441, + 1.2421829272061586, + 0.19335724972188473, + 1.127868190407753, + 1.0603241100907326, + 0.23080486617982388, + 2.5840890370309353, + 0.08385523781180382, + 0.41783633455634117, + 0.3821190521121025, + 0.10992186889052391, + 0.0, + 0.2500811442732811, + 1.0312706641852856, + 0.5716202594339848, + 0.16727178171277046, + 1.1925664991140366, + 0.9209230151027441, + 0.5442380793392658, + 0.07451944425702095, + 0.5187977477908134, + 1.0593524314463139, + 0.36899126693606377, + 0.3204110786318779, + 0.2001168429851532, + 0.4602468591183424, + 1.3102382738143206, + 0.4640974532812834, + 0.14555958099663258, + 0.16245312802493572, + 0.42408648505806923, + 0.9163682274520397, + 0.13916509225964546, + 0.7089648675173521, + 0.5992522723972797, + 3.3203029222786427, + 2.6665992327034473, + 1.1735859829932451, + 0.3499726764857769, + 0.4017592165619135, + 0.3740241937339306, + 1.3704670015722513, + 0.3559075202792883 + ], + "unique_experts": 63, + "load_cv": 0.6190394789859609, + "normalized_load_entropy": 0.9514239886808524, + "max_load_share": 0.0375 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "f930e45daccdf11842a8d7d662d02d26e53d7fbdefde6bf89fc5aace696c887e", + "route_weight_sha256": "f8529e068057131e867465e25ce541dd64111e8fd66c3d3e31d390dc17b248eb", + "loads": [ + 2, + 13, + 12, + 14, + 6, + 5, + 17, + 5, + 10, + 13, + 16, + 3, + 21, + 17, + 26, + 10, + 4, + 12, + 21, + 12, + 22, + 16, + 17, + 7, + 20, + 10, + 6, + 27, + 6, + 11, + 7, + 7, + 0, + 8, + 23, + 24, + 3, + 15, + 22, + 11, + 2, + 17, + 27, + 10, + 4, + 1, + 13, + 27, + 17, + 5, + 6, + 13, + 14, + 6, + 25, + 21, + 27, + 33, + 22, + 10, + 19, + 11, + 23, + 16 + ], + "weighted_loads": [ + 0.24015315622091293, + 1.0307305678725243, + 0.3416844792664051, + 2.9240406211465597, + 0.20319033972918987, + 0.3597992677241564, + 0.47789593413472176, + 0.3736126758158207, + 0.47091787680983543, + 0.4050195384770632, + 0.4932226203382015, + 0.09740336798131466, + 1.1518415790051222, + 1.657111382111907, + 1.2154731042683125, + 0.63857183419168, + 0.1647384762763977, + 0.6461561881005764, + 2.886288966052234, + 1.134743321686983, + 0.8788912314921618, + 1.2384562343358994, + 1.2421829272061586, + 0.19335724972188473, + 1.290060866624117, + 1.0603241100907326, + 0.23165425390470773, + 2.793716836720705, + 0.3284633532166481, + 0.41783633455634117, + 0.3821190521121025, + 0.1748185160686262, + 0.0, + 0.2815597988665104, + 1.255359947681427, + 2.4699950590729713, + 0.16727178171277046, + 1.1925664991140366, + 0.9650933938100934, + 0.5442380793392658, + 0.07451944425702095, + 0.5187977477908134, + 1.7091131694614887, + 0.36899126693606377, + 0.3204110786318779, + 0.2001168429851532, + 0.5558457635343075, + 1.5522292833775282, + 0.489475941285491, + 0.14555958099663258, + 0.16245312802493572, + 1.2396550737321377, + 0.9163682274520397, + 0.14048329333309084, + 0.7089648675173521, + 0.5992522723972797, + 3.3203029222786427, + 3.158829253166914, + 1.5375626031309366, + 0.540041595697403, + 1.2310191951692104, + 0.5024873651564121, + 1.7416200172156096, + 1.1286110859364271 + ], + "unique_experts": 63, + "load_cv": 0.5797799592626819, + "normalized_load_entropy": 0.9558624798157953, + "max_load_share": 0.03793103448275862 + } + }, + "s1_eos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "ae2dcd71f1c40b94ca6f84bee8431289be23ba86193ed52f2008b66a8f39f0c6", + "route_weight_sha256": "4c904ee6565d91f7e54ca16ee32391f8095bde7823ff2a5b658c1aba55244dd1", + "loads": [ + 2, + 2, + 12, + 12, + 6, + 5, + 16, + 3, + 8, + 10, + 11, + 3, + 21, + 14, + 18, + 11, + 3, + 11, + 20, + 8, + 22, + 8, + 17, + 12, + 17, + 10, + 7, + 25, + 3, + 9, + 6, + 4, + 0, + 6, + 19, + 11, + 3, + 15, + 22, + 12, + 2, + 19, + 20, + 11, + 4, + 1, + 11, + 24, + 16, + 4, + 3, + 7, + 14, + 3, + 24, + 20, + 26, + 25, + 14, + 7, + 10, + 8, + 18, + 5 + ], + "weighted_loads": [ + 0.23678788542747498, + 0.0501058604568243, + 0.34447757713496685, + 1.259112348780036, + 0.1990949548780918, + 0.35877230390906334, + 0.46611382625997066, + 0.284016702324152, + 0.390264056622982, + 0.3072683494538069, + 0.3060030825436115, + 0.09796368330717087, + 1.128509657457471, + 1.5970209166407585, + 0.8986299335956573, + 0.6742545813322067, + 0.13572082109749317, + 0.6431766711175442, + 2.922409873455763, + 0.3842933885753155, + 0.6083454061299562, + 0.5658497735857964, + 1.2366514634341002, + 0.30997435562312603, + 1.1123907156288624, + 1.0401478856801987, + 0.2913203723728657, + 2.745521266013384, + 0.08427397534251213, + 0.37622336484491825, + 0.35656928084790707, + 0.11020200327038765, + 0.0, + 0.21580056473612785, + 1.0973910614848137, + 0.6114042811095715, + 0.16499074548482895, + 1.2304758448153734, + 1.001949867233634, + 0.5665261670947075, + 0.07439223304390907, + 0.560437636449933, + 1.0295227505266666, + 0.4056076053529978, + 0.31576675921678543, + 0.19618958234786987, + 0.4861088767647743, + 1.3448839914053679, + 0.46694936230778694, + 0.11204149574041367, + 0.08635181561112404, + 0.45084264501929283, + 0.8826348930597305, + 0.0887976847589016, + 0.6709761638194323, + 0.5725557338446379, + 3.2927533127367496, + 2.7370435558259487, + 1.166687311604619, + 0.3475979845970869, + 0.42068158462643623, + 0.37604432739317417, + 1.4082720559090376, + 0.39189333841204643 + ], + "unique_experts": 63, + "load_cv": 0.6312832316151907, + "normalized_load_entropy": 0.9486765671250889, + "max_load_share": 0.03611111111111111 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "80cef524ec76e047e7d33e8aebe60624cbd8d33a047d75e267fa5d7a1a869fe0", + "route_weight_sha256": "99db66ad4da3adc467e55fd66758696e1ea334a647bc5de78ee1d3e902ae05ba", + "loads": [ + 6, + 14, + 13, + 15, + 7, + 6, + 16, + 7, + 16, + 11, + 18, + 3, + 21, + 17, + 29, + 12, + 5, + 12, + 21, + 14, + 24, + 18, + 18, + 12, + 24, + 11, + 8, + 28, + 8, + 9, + 7, + 8, + 0, + 7, + 28, + 27, + 3, + 16, + 27, + 15, + 2, + 19, + 29, + 12, + 7, + 1, + 18, + 31, + 18, + 5, + 4, + 16, + 15, + 7, + 24, + 20, + 30, + 33, + 16, + 17, + 20, + 14, + 28, + 19 + ], + "weighted_loads": [ + 0.7558925822377205, + 1.080012246966362, + 0.3697854857891798, + 2.995944758877158, + 0.22935745865106583, + 0.500927459448576, + 0.46611382625997066, + 0.44667988270521164, + 1.0076128598302603, + 0.4238657783716917, + 0.6122314445674419, + 0.09796368330717087, + 1.128509657457471, + 1.6416457038139924, + 1.44779840297997, + 0.7070415653288364, + 0.19937482103705406, + 0.643761194718536, + 2.9237878568237647, + 1.174359330907464, + 0.8970246631652117, + 1.3382549732923508, + 1.2751312833279371, + 0.30997435562312603, + 1.4334522373974323, + 1.0904481634497643, + 0.2921409289119765, + 3.3528399877250195, + 0.33884489722549915, + 0.37622336484491825, + 0.39022372104227543, + 0.21433532610535622, + 0.0, + 0.24975315481424332, + 1.4638625420629978, + 2.284842800348997, + 0.16499074548482895, + 1.2723730709403753, + 1.140277860686183, + 0.9214287661015987, + 0.07439223304390907, + 0.560437636449933, + 2.1295265406370163, + 0.5873231235891581, + 0.964847557246685, + 0.19618958234786987, + 1.0896071083843708, + 1.7101471424102783, + 0.5359416268765926, + 0.15478964149951935, + 0.11264770105481148, + 1.578465960919857, + 1.0592430531978607, + 0.2738800341030583, + 0.6709761638194323, + 0.5725557338446379, + 3.546133805066347, + 3.1579737830907106, + 1.2779516149312258, + 0.8541398551315069, + 1.093026166781783, + 0.7833389062434435, + 2.2084450107067823, + 1.5890782736241817 + ], + "unique_experts": 63, + "load_cv": 0.5524149405518729, + "normalized_load_entropy": 0.9595903749450286, + "max_load_share": 0.034161490683229816 + } + }, + "s0_bos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "31b7aafb96fa34bb481e15493276da2675d3ce5b9f50dd8303bd7dc07d7a1d55", + "route_weight_sha256": "54c5d705359ddbd9e4d01e01f3a7713b71ca0b5b32ed999f704d8ecd73474412", + "loads": [ + 2, + 0, + 9, + 17, + 6, + 5, + 17, + 5, + 8, + 15, + 11, + 3, + 15, + 10, + 17, + 10, + 7, + 11, + 20, + 8, + 20, + 6, + 17, + 3, + 17, + 10, + 16, + 25, + 9, + 9, + 7, + 5, + 2, + 5, + 16, + 12, + 3, + 14, + 24, + 12, + 2, + 13, + 19, + 8, + 4, + 1, + 13, + 25, + 10, + 3, + 10, + 6, + 14, + 14, + 22, + 18, + 26, + 26, + 14, + 7, + 8, + 7, + 18, + 4 + ], + "weighted_loads": [ + 0.23261456191539764, + 0.0, + 0.2457865383476019, + 1.4718826580792665, + 0.19768139347434044, + 0.36618651263415813, + 0.4807483088225126, + 0.333560548722744, + 0.38791670091450214, + 0.44680137373507023, + 0.32032887637615204, + 0.0960632972419262, + 0.9709887094795704, + 1.459906430914998, + 0.7471576053649187, + 0.6321571134030819, + 0.24068265780806541, + 0.6856669187545776, + 2.8680323269218206, + 0.3925069235265255, + 0.5935286562889814, + 0.5326863005757332, + 1.2480902764946222, + 0.08391408063471317, + 1.0952872224152088, + 1.0286803506314754, + 0.5364505350589752, + 2.533911306411028, + 0.23757531493902206, + 0.3468622099608183, + 0.37783454544842243, + 0.13781939074397087, + 0.051087636500597, + 0.16927312687039375, + 0.9649182222783566, + 0.6568844188004732, + 0.16095226630568504, + 1.1801359839737415, + 1.0413183271884918, + 0.6226447001099586, + 0.07378690131008625, + 0.3872943390160799, + 1.0117802806198597, + 0.31813780404627323, + 0.32225379906594753, + 0.17694765329360962, + 0.5976194012910128, + 1.4452718067914248, + 0.29853575490415096, + 0.095358831807971, + 0.28629004396498203, + 0.3891234342008829, + 0.931422021239996, + 0.3808420952409506, + 0.6473406236618757, + 0.5334285404533148, + 3.2002784945070744, + 2.9145935345441103, + 1.252188578248024, + 0.42078614607453346, + 0.26405553333461285, + 0.2965402062982321, + 1.4811474457383156, + 0.23121461644768715 + ], + "unique_experts": 63, + "load_cv": 0.5997942033895902, + "normalized_load_entropy": 0.9539764339041797, + "max_load_share": 0.03611111111111111 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "6ef596478c12c5b1efec280cfeec62ec95432dadf1a96ffe30efc0bfa69b952a", + "route_weight_sha256": "171070bfe977dc57b70293cd2cd05218992ed3e78efb718ef010f3315b925776", + "loads": [ + 2, + 10, + 9, + 18, + 6, + 5, + 17, + 7, + 11, + 15, + 14, + 3, + 16, + 11, + 22, + 10, + 8, + 11, + 20, + 12, + 22, + 15, + 17, + 3, + 19, + 10, + 16, + 27, + 12, + 9, + 7, + 7, + 2, + 6, + 21, + 28, + 3, + 14, + 27, + 12, + 2, + 14, + 26, + 8, + 4, + 1, + 16, + 29, + 11, + 3, + 10, + 12, + 14, + 14, + 22, + 18, + 26, + 35, + 22, + 11, + 18, + 10, + 25, + 15 + ], + "weighted_loads": [ + 0.23261456191539764, + 0.94704470038414, + 0.2457865383476019, + 2.2011216450482607, + 0.19768139347434044, + 0.36618651263415813, + 0.4807483088225126, + 0.42930183559656143, + 0.4917508363723755, + 0.44680137373507023, + 0.44630182161927223, + 0.0960632972419262, + 1.00326394662261, + 1.4821674972772598, + 0.9643210489302874, + 0.6321571134030819, + 0.27071966975927353, + 0.6856669187545776, + 2.8680323269218206, + 1.0877231322228909, + 0.8844630848616362, + 1.2380988001823425, + 1.2480902764946222, + 0.08391408063471317, + 1.2108479551970959, + 1.0286803506314754, + 0.5364505350589752, + 2.747891116887331, + 0.5248488318175077, + 0.3468622099608183, + 0.37783454544842243, + 0.19959052838385105, + 0.051087636500597, + 0.20219573751091957, + 1.189007505774498, + 2.6689655017107725, + 0.16095226630568504, + 1.1801359839737415, + 1.1742198904976249, + 0.6226447001099586, + 0.07378690131008625, + 0.41217952594161034, + 1.7263300903141499, + 0.31813780404627323, + 0.32225379906594753, + 0.17694765329360962, + 0.6935835592448711, + 1.6879708338528872, + 0.3239142429083586, + 0.095358831807971, + 0.28629004396498203, + 1.1180932316929102, + 0.931422021239996, + 0.3808420952409506, + 0.6473406236618757, + 0.5334285404533148, + 3.2002784945070744, + 3.4182772133499384, + 1.6161651983857155, + 0.5845766011625528, + 1.0933155119419098, + 0.4203448388725519, + 2.013839727267623, + 1.201453309506178 + ], + "unique_experts": 64, + "load_cv": 0.5705180258409773, + "normalized_load_entropy": 0.9587634421040433, + "max_load_share": 0.040229885057471264 + } + }, + "s1_bos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "2d638c05b5dcd31db0c9e31a207d0031ae0027e116e92193ed5aec2a062b057d", + "route_weight_sha256": "e71fc991024bbe47627e74825b30d925d6fa764fb5364b688962fa4e116e46f5", + "loads": [ + 2, + 1, + 10, + 13, + 6, + 4, + 16, + 5, + 5, + 11, + 13, + 3, + 15, + 9, + 18, + 11, + 6, + 11, + 20, + 8, + 24, + 7, + 17, + 5, + 17, + 10, + 12, + 25, + 11, + 8, + 9, + 5, + 5, + 4, + 18, + 12, + 2, + 16, + 27, + 12, + 2, + 16, + 18, + 10, + 4, + 1, + 12, + 25, + 12, + 3, + 5, + 5, + 13, + 10, + 24, + 18, + 26, + 26, + 14, + 6, + 7, + 8, + 18, + 4 + ], + "weighted_loads": [ + 0.2391212061047554, + 0.027530204504728317, + 0.27416430227458477, + 1.304630359634757, + 0.19088713079690933, + 0.33711376041173935, + 0.45864194817841053, + 0.3291180394589901, + 0.30153219029307365, + 0.32874676398932934, + 0.3846998643130064, + 0.0946968775242567, + 0.974839324131608, + 1.4200385361909866, + 0.7675856351852417, + 0.6727375779300928, + 0.20980609208345413, + 0.6608801670372486, + 2.8767868857830763, + 0.39163046330213547, + 0.7083674762398005, + 0.5377984531223774, + 1.2312341332435608, + 0.13546213693916798, + 1.089484829455614, + 1.0285185314714909, + 0.42905772663652897, + 2.6768063344061375, + 0.3079846203327179, + 0.32217739149928093, + 0.4394416883587837, + 0.13684010691940784, + 0.13627628237009048, + 0.12612918764352798, + 1.0583277866244316, + 0.7044848278164864, + 0.12135056778788567, + 1.313116742298007, + 1.1348535064607859, + 0.605495385825634, + 0.07666481845080853, + 0.477686557918787, + 0.986077107489109, + 0.39875482954084873, + 0.33517496660351753, + 0.1983044445514679, + 0.5486494824290276, + 1.436266679316759, + 0.35161726735532284, + 0.08608900755643845, + 0.1539730466902256, + 0.36528245732188225, + 0.8704871144145727, + 0.27477937936782837, + 0.7014067005366087, + 0.5415143631398678, + 3.149830173701048, + 2.9294985346496105, + 1.2275700755417347, + 0.36738494224846363, + 0.2460738904774189, + 0.32646121084690094, + 1.443716622889042, + 0.26671465672552586 + ], + "unique_experts": 64, + "load_cv": 0.6198366969325045, + "normalized_load_entropy": 0.9528405784999587, + "max_load_share": 0.0375 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "b563aed1d7859793e6c794062f506c3e0317d83f1452089e7c5a55809a7c4efb", + "route_weight_sha256": "53484f35a9657134415ed7ad27256f1c516cd4cbb53b6b8e12885ec77cec40c2", + "loads": [ + 6, + 12, + 11, + 16, + 7, + 5, + 16, + 9, + 14, + 12, + 20, + 3, + 16, + 11, + 29, + 12, + 9, + 11, + 20, + 14, + 26, + 17, + 18, + 5, + 23, + 11, + 12, + 28, + 16, + 8, + 10, + 9, + 5, + 5, + 27, + 30, + 2, + 17, + 32, + 15, + 2, + 17, + 28, + 11, + 7, + 1, + 19, + 32, + 14, + 4, + 6, + 14, + 14, + 13, + 24, + 18, + 30, + 33, + 16, + 16, + 17, + 14, + 30, + 17 + ], + "weighted_loads": [ + 0.7582259029150009, + 1.0322188921272755, + 0.2994722109287977, + 2.098139839246869, + 0.22114963456988335, + 0.479268915951252, + 0.45864194817841053, + 0.4879407398402691, + 0.9530143421143293, + 0.44534419290721416, + 0.6909282263368368, + 0.0946968775242567, + 1.0024423617869616, + 1.4650327917188406, + 1.2930818013846874, + 0.7055245619267225, + 0.301892327144742, + 0.6608801670372486, + 2.8767868857830763, + 1.108882701024413, + 0.9831015411764383, + 1.332437727600336, + 1.2697139531373978, + 0.13546213693916798, + 1.368163987994194, + 1.0788188092410564, + 0.42905772663652897, + 3.285443101078272, + 0.6172726806253195, + 0.32217739149928093, + 0.4730961285531521, + 0.23846572823822498, + 0.13627628237009048, + 0.16168168932199478, + 1.4247992672026157, + 2.5127182342112064, + 0.12135056778788567, + 1.355013968423009, + 1.3572893794625998, + 0.9603979848325253, + 0.07666481845080853, + 0.5027394723147154, + 2.1394553538411856, + 0.580470347777009, + 0.9842557646334171, + 0.1983044445514679, + 1.1512063331902027, + 1.8001232240349054, + 0.42060953192412853, + 0.12883715331554413, + 0.18026893213391304, + 1.483167354017496, + 1.047095274552703, + 0.4587822575122118, + 0.7014067005366087, + 0.5415143631398678, + 3.4032106660306454, + 3.289542207494378, + 1.3388343788683414, + 0.8236237186938524, + 0.9184184726327658, + 0.7266918383538723, + 2.345006102696061, + 1.5637116748839617 + ], + "unique_experts": 64, + "load_cv": 0.5510475555097913, + "normalized_load_entropy": 0.9619651717536845, + "max_load_share": 0.034161490683229816 + } + }, + "s0_x": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "e6834da8710ee3d7d5ff88636afce7410d3a0deda8ffd1928b92abfa41ff31e5", + "route_weight_sha256": "4835e585d683ad6ca26ea7ef99dcaa584cbc6923fd95de26e8d05839cf801d4f", + "loads": [ + 2, + 1, + 10, + 19, + 6, + 5, + 17, + 3, + 8, + 16, + 11, + 3, + 17, + 11, + 18, + 10, + 8, + 11, + 21, + 8, + 21, + 6, + 17, + 3, + 17, + 10, + 15, + 25, + 4, + 8, + 7, + 5, + 2, + 4, + 17, + 12, + 1, + 14, + 24, + 16, + 2, + 12, + 19, + 8, + 4, + 1, + 13, + 26, + 10, + 2, + 11, + 6, + 14, + 15, + 21, + 16, + 26, + 26, + 14, + 7, + 4, + 7, + 18, + 5 + ], + "weighted_loads": [ + 0.24306192994117737, + 0.03444896265864372, + 0.2726187463849783, + 1.4948817193508148, + 0.1954805962741375, + 0.3632714468985796, + 0.47691685520112514, + 0.26394301280379295, + 0.4084911271929741, + 0.47293226048350334, + 0.3074532672762871, + 0.09655644372105598, + 1.0284093115478754, + 1.4469917342066765, + 0.7766752131283283, + 0.6365975812077522, + 0.2613102812319994, + 0.6904407180845737, + 2.875702414661646, + 0.395003966987133, + 0.6221261229366064, + 0.5308237057179213, + 1.2461340501904488, + 0.07607794553041458, + 1.1089825592935085, + 1.0161247998476028, + 0.509214710444212, + 2.4704722687602043, + 0.10755252465605736, + 0.32139396481215954, + 0.3743884973227978, + 0.13781531155109406, + 0.05073196068406105, + 0.15941817127168179, + 1.0258089378476143, + 0.646476749330759, + 0.08971681445837021, + 1.118319220840931, + 1.0371551606804132, + 0.7578340750187635, + 0.07274710386991501, + 0.360901253297925, + 0.9718076065182686, + 0.3177644573152065, + 0.309963621199131, + 0.17237810790538788, + 0.6080351900309324, + 1.4782003723084927, + 0.29589411057531834, + 0.07222888991236687, + 0.30473863892257214, + 0.38356427662074566, + 0.927248815074563, + 0.4053319953382015, + 0.6119134351611137, + 0.4660059083253145, + 3.193988297134638, + 2.7671021074056625, + 1.2302141673862934, + 0.4344647116959095, + 0.1375083103775978, + 0.30960482358932495, + 1.5154590010643005, + 0.24178391322493553 + ], + "unique_experts": 64, + "load_cv": 0.6259807120445899, + "normalized_load_entropy": 0.9497096350942642, + "max_load_share": 0.03611111111111111 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "cd1bcc336d4f6da223f93c52c2823266cf7be4ec0fcf6e53c0bd93473233e29a", + "route_weight_sha256": "bf73ee2e48cd173ebd21956670bb6198baa769de9e719326a242e1739f4529a7", + "loads": [ + 2, + 11, + 10, + 20, + 6, + 5, + 18, + 5, + 11, + 16, + 16, + 4, + 18, + 12, + 23, + 10, + 9, + 11, + 21, + 12, + 23, + 16, + 17, + 3, + 19, + 10, + 15, + 27, + 7, + 8, + 7, + 7, + 2, + 5, + 22, + 27, + 1, + 14, + 26, + 16, + 2, + 13, + 25, + 8, + 4, + 1, + 16, + 31, + 11, + 2, + 11, + 12, + 14, + 15, + 21, + 16, + 26, + 33, + 23, + 10, + 15, + 10, + 24, + 15 + ], + "weighted_loads": [ + 0.24306192994117737, + 0.9814936630427837, + 0.2726187463849783, + 2.224120706319809, + 0.1954805962741375, + 0.3632714468985796, + 0.5118871424347162, + 0.35946058109402657, + 0.5177073590457439, + 0.47293226048350334, + 0.5425144135951996, + 0.13175024092197418, + 1.0582462325692177, + 1.4680605083703995, + 0.9956888519227505, + 0.6365975812077522, + 0.2920214459300041, + 0.6904407180845737, + 2.875702414661646, + 1.108933337032795, + 0.9225555565208197, + 1.5339370425790548, + 1.2461340501904488, + 0.07607794553041458, + 1.225225791335106, + 1.0161247998476028, + 0.509214710444212, + 2.687149465084076, + 0.39392953738570213, + 0.32139396481215954, + 0.3743884973227978, + 0.19716721214354038, + 0.05073196068406105, + 0.18994312919676304, + 1.2498982213437557, + 2.603829398751259, + 0.08971681445837021, + 1.118319220840931, + 1.0813255393877625, + 0.7578340750187635, + 0.07274710386991501, + 0.38588421046733856, + 1.606250125914812, + 0.3177644573152065, + 0.309963621199131, + 0.17237810790538788, + 0.703805772587657, + 1.7525856830179691, + 0.32127259857952595, + 0.07222888991236687, + 0.30473863892257214, + 1.0565238129347563, + 0.927248815074563, + 0.4053319953382015, + 0.6119134351611137, + 0.4660059083253145, + 3.193988297134638, + 3.196355875581503, + 1.7235179208219051, + 0.5675682611763477, + 1.020406512543559, + 0.4340849742293358, + 2.005289427936077, + 0.9276858828961849 + ], + "unique_experts": 64, + "load_cv": 0.5775882083799027, + "normalized_load_entropy": 0.9566054972845576, + "max_load_share": 0.03793103448275862 + } + }, + "s1_x": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "7814df397e00ffe136fc2ddc3d99d447ace0e9fc5f55660fb6602fe25b7f21df", + "route_weight_sha256": "68ea4d5a591da021cc9e2a8f301b95ab657e63f80ebc7f55d19d0ed6ba64cd54", + "loads": [ + 2, + 1, + 12, + 12, + 6, + 4, + 16, + 4, + 8, + 10, + 13, + 3, + 15, + 9, + 18, + 11, + 6, + 11, + 20, + 8, + 24, + 7, + 17, + 7, + 17, + 10, + 9, + 25, + 12, + 8, + 10, + 5, + 2, + 4, + 18, + 12, + 2, + 14, + 26, + 12, + 2, + 19, + 18, + 11, + 4, + 1, + 12, + 26, + 10, + 3, + 7, + 6, + 13, + 9, + 22, + 17, + 26, + 26, + 14, + 6, + 8, + 8, + 18, + 4 + ], + "weighted_loads": [ + 0.24731077998876572, + 0.0309505183249712, + 0.3326617069542408, + 1.2637875489890575, + 0.18904796801507473, + 0.33372877165675163, + 0.4517535213381052, + 0.28985850512981415, + 0.4047852139919996, + 0.2992265820503235, + 0.36943925358355045, + 0.08523565158247948, + 0.986451979726553, + 1.391172043979168, + 0.7618893776088953, + 0.6670595314353704, + 0.2102812211960554, + 0.6606997027993202, + 2.8423601370304823, + 0.398384403437376, + 0.7074098624289036, + 0.5408845469355583, + 1.2383448351174593, + 0.18331510946154594, + 1.0906529650092125, + 1.0015116073191166, + 0.3386099115014076, + 2.642168127000332, + 0.31718385219573975, + 0.31870088167488575, + 0.46784734539687634, + 0.13829500414431095, + 0.054179683327674866, + 0.1245182678103447, + 1.0810809582471848, + 0.7114058192819357, + 0.11997845768928528, + 1.2124758753925562, + 1.110388120636344, + 0.5988004337996244, + 0.07711369544267654, + 0.5582079123705626, + 0.9716454409062862, + 0.4078632388263941, + 0.32539714872837067, + 0.1930016130208969, + 0.554445143789053, + 1.4772694073617458, + 0.2999173551797867, + 0.08761659450829029, + 0.2047137599438429, + 0.3940084110945463, + 0.8765347246080637, + 0.2509111054241657, + 0.6459284815937281, + 0.5141299366950989, + 3.1586070396006107, + 2.8225246965885162, + 1.2092688158154488, + 0.3753293454647064, + 0.2743168734014034, + 0.3350225128233433, + 1.4748790562152863, + 0.24889707006514072 + ], + "unique_experts": 64, + "load_cv": 0.6132286545131835, + "normalized_load_entropy": 0.953454575938455, + "max_load_share": 0.03611111111111111 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "6727a253c8748112bf8c917b4af877e1d27f61dcd717b3eb886eb10d415bd6fe", + "route_weight_sha256": "9afb89bdcc716a99fc6a5907e004c90dae171423ec248bfaca50dd624c8ba642", + "loads": [ + 6, + 12, + 13, + 14, + 7, + 5, + 16, + 8, + 17, + 11, + 22, + 4, + 16, + 11, + 27, + 12, + 9, + 11, + 20, + 14, + 26, + 18, + 18, + 7, + 23, + 11, + 9, + 28, + 17, + 8, + 11, + 9, + 3, + 5, + 27, + 30, + 2, + 15, + 30, + 15, + 2, + 20, + 27, + 12, + 7, + 1, + 19, + 34, + 12, + 4, + 8, + 14, + 14, + 12, + 22, + 17, + 30, + 33, + 17, + 16, + 19, + 14, + 29, + 16 + ], + "weighted_loads": [ + 0.7664154767990112, + 1.0356392059475183, + 0.35796961560845375, + 2.025031875818968, + 0.21931047178804874, + 0.47588392719626427, + 0.4517535213381052, + 0.44835837557911873, + 1.0596944987773895, + 0.4158240109682083, + 0.7894062157720327, + 0.12032514438033104, + 1.0130625888705254, + 1.4353315345942974, + 1.236398471519351, + 0.6998465154320002, + 0.3078104071319103, + 0.6606997027993202, + 2.8423601370304823, + 1.125798324123025, + 0.9832292981445789, + 1.616922453045845, + 1.2768246550112963, + 0.18331510946154594, + 1.3692254163324833, + 1.0518118850886822, + 0.3386099115014076, + 3.2553488463163376, + 0.6356103178113699, + 0.31870088167488575, + 0.5015017855912447, + 0.23941958881914616, + 0.0836279597133398, + 0.15895169228315353, + 1.4475524388253689, + 2.481532821431756, + 0.11997845768928528, + 1.254373101517558, + 1.2160450387746096, + 0.9537030328065157, + 0.07711369544267654, + 0.5831407085061073, + 2.0681107379496098, + 0.5895787570625544, + 0.9744779467582703, + 0.1930016130208969, + 1.1568357776850462, + 1.8686462473124266, + 0.3689096197485924, + 0.13036474026739597, + 0.23100964538753033, + 1.43367881141603, + 1.0531428847461939, + 0.43491398356854916, + 0.6459284815937281, + 0.5141299366950989, + 3.411987531930208, + 3.1826373916119337, + 1.426683448255062, + 0.8328782618045807, + 0.9927912186831236, + 0.7346752770245075, + 2.318491404876113, + 1.3105438183993101 + ], + "unique_experts": 64, + "load_cv": 0.5456694465572575, + "normalized_load_entropy": 0.9625596408453105, + "max_load_share": 0.035196687370600416 + } + }, + "s0_period": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "629741b084bd31edcd2b946d141e1161d65a5742566ca61c6bca82b8228d6c90", + "route_weight_sha256": "94dd82d2cac0e6c5abf8ce86c89177e063c53fe978654b3bbaef3d03eef0eb53", + "loads": [ + 2, + 0, + 10, + 17, + 6, + 5, + 18, + 3, + 8, + 16, + 11, + 3, + 16, + 11, + 18, + 10, + 8, + 11, + 21, + 8, + 21, + 6, + 18, + 4, + 17, + 10, + 14, + 25, + 4, + 8, + 8, + 5, + 2, + 5, + 18, + 13, + 3, + 14, + 23, + 15, + 2, + 13, + 19, + 7, + 4, + 1, + 13, + 26, + 10, + 1, + 12, + 6, + 14, + 13, + 21, + 17, + 25, + 25, + 14, + 7, + 5, + 7, + 18, + 5 + ], + "weighted_loads": [ + 0.2431756556034088, + 0.0, + 0.27466082759201527, + 1.4516453742980957, + 0.19528979621827602, + 0.36343400180339813, + 0.5098844915628433, + 0.2660922110080719, + 0.407468868419528, + 0.47296481393277645, + 0.30866789259016514, + 0.0962334405630827, + 1.0089431200176477, + 1.4433571305125952, + 0.7688223458826542, + 0.6441766545176506, + 0.26422937400639057, + 0.6899474486708641, + 2.876057820394635, + 0.3953796215355396, + 0.6205786652863026, + 0.5352968238294125, + 1.2720203343778849, + 0.10290133953094482, + 1.1063641160726547, + 1.017590269446373, + 0.48072313144803047, + 2.4498427659273148, + 0.10745933651924133, + 0.3234503008425236, + 0.3998389523476362, + 0.13759082555770874, + 0.050649942830204964, + 0.18297195807099342, + 1.0680240280926228, + 0.6803946699947119, + 0.16001677513122559, + 1.09577458165586, + 1.0008788760751486, + 0.7247008234262466, + 0.07262452319264412, + 0.38720946200191975, + 0.9763378463685513, + 0.28643864020705223, + 0.3114030696451664, + 0.17487141489982605, + 0.6070150621235371, + 1.4806428849697113, + 0.29703026823699474, + 0.040411245077848434, + 0.3302628342062235, + 0.38469613157212734, + 0.9236416537314653, + 0.3540460094809532, + 0.6165121104568243, + 0.4916658364236355, + 3.1546713821589947, + 2.7215354554355145, + 1.235073123127222, + 0.4310641195625067, + 0.1661242228001356, + 0.3153456263244152, + 1.5240104459226131, + 0.242308946326375 + ], + "unique_experts": 63, + "load_cv": 0.6130272988503876, + "normalized_load_entropy": 0.9509996577899266, + "max_load_share": 0.03611111111111111 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "f123aca707810e2d6445cd6e5526dcea58b7ec3abdf3dab16672d393e634b412", + "route_weight_sha256": "786fd4e0045fc016b598434dd79cdac7c833d713dcea675f45799c0f0a33e4fd", + "loads": [ + 3, + 10, + 10, + 19, + 6, + 5, + 18, + 5, + 12, + 16, + 14, + 3, + 16, + 12, + 23, + 11, + 8, + 11, + 21, + 12, + 23, + 15, + 18, + 4, + 20, + 10, + 14, + 27, + 7, + 8, + 8, + 7, + 2, + 7, + 23, + 27, + 3, + 14, + 26, + 15, + 2, + 14, + 25, + 7, + 4, + 1, + 17, + 31, + 12, + 1, + 12, + 12, + 14, + 13, + 21, + 17, + 25, + 32, + 22, + 10, + 17, + 10, + 24, + 14 + ], + "weighted_loads": [ + 0.5365572273731232, + 0.94704470038414, + 0.27466082759201527, + 2.2138860784471035, + 0.19528979621827602, + 0.36343400180339813, + 0.5098844915628433, + 0.3616713434457779, + 0.563336631283164, + 0.47296481393277645, + 0.43464083783328533, + 0.0962334405630827, + 1.0089431200176477, + 1.464350115507841, + 0.9877189788967371, + 0.6894974857568741, + 0.26422937400639057, + 0.6899474486708641, + 2.876057820394635, + 1.1345276273787022, + 0.8639829121530056, + 1.4081739895045757, + 1.2720203343778849, + 0.10290133953094482, + 1.2521033771336079, + 1.017590269446373, + 0.48072313144803047, + 2.6665476113557816, + 0.36304386146366596, + 0.3234503008425236, + 0.3998389523476362, + 0.19699722342193127, + 0.050649942830204964, + 0.26251397654414177, + 1.2921133115887642, + 2.5769323278218508, + 0.16001677513122559, + 1.09577458165586, + 1.1051549958065152, + 0.7247008234262466, + 0.07262452319264412, + 0.4124508034437895, + 1.615998487919569, + 0.28643864020705223, + 0.3114030696451664, + 0.17487141489982605, + 0.7286791577935219, + 1.7575110904872417, + 0.348460903391242, + 0.040411245077848434, + 0.3302628342062235, + 1.0397114176303148, + 0.9236416537314653, + 0.3540460094809532, + 0.6165121104568243, + 0.4916658364236355, + 3.1546713821589947, + 3.150589033961296, + 1.5990497432649136, + 0.5681727472692728, + 1.0554775781929493, + 0.43941501528024673, + 2.008614756166935, + 0.8826133590191603 + ], + "unique_experts": 64, + "load_cv": 0.5670989934141584, + "normalized_load_entropy": 0.958460179068926, + "max_load_share": 0.0367816091954023 + } + }, + "s1_period": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "eb9ceab96d05ab1d4a44afdc44f4aaa975053698ce713c5af617607cbcddaea2", + "route_weight_sha256": "8642446314e2d3726d9cf84e328686b5380d61a0defd77d56d19818afdbe7f8d", + "loads": [ + 2, + 1, + 13, + 11, + 6, + 4, + 16, + 3, + 8, + 10, + 14, + 4, + 15, + 9, + 18, + 11, + 6, + 11, + 20, + 8, + 23, + 7, + 17, + 7, + 17, + 10, + 9, + 25, + 11, + 8, + 10, + 5, + 2, + 4, + 18, + 12, + 2, + 14, + 26, + 12, + 2, + 20, + 18, + 11, + 4, + 1, + 12, + 26, + 11, + 4, + 7, + 6, + 13, + 8, + 23, + 15, + 26, + 26, + 14, + 6, + 9, + 7, + 18, + 4 + ], + "weighted_loads": [ + 0.2473708540201187, + 0.02544434554874897, + 0.3616761788725853, + 1.2367245852947235, + 0.1897849589586258, + 0.33257829025387764, + 0.45086707919836044, + 0.2587330713868141, + 0.40384544618427753, + 0.3000409696251154, + 0.3991992138326168, + 0.10781420953571796, + 0.9828442391008139, + 1.3884215280413628, + 0.7576620113104582, + 0.6719076130539179, + 0.20923318341374397, + 0.6600572168827057, + 2.843444647267461, + 0.3984726034104824, + 0.6824388578534126, + 0.5456734653562307, + 1.235723689198494, + 0.18296254612505436, + 1.0938524026423693, + 1.0016249865293503, + 0.3407798819243908, + 2.6530804000794888, + 0.2882487326860428, + 0.3200247064232826, + 0.4683903306722641, + 0.1380019336938858, + 0.053942834958434105, + 0.12370498850941658, + 1.0797914117574692, + 0.7125538568943739, + 0.12061319872736931, + 1.2023919094353914, + 1.1063628308475018, + 0.6016148719936609, + 0.07625695317983627, + 0.5834351945668459, + 0.9777402877807617, + 0.4110503513365984, + 0.3245181255042553, + 0.19364339113235474, + 0.553345263004303, + 1.4762681685388088, + 0.3359481729567051, + 0.11159430630505085, + 0.20574099756777287, + 0.38942965120077133, + 0.8741151206195354, + 0.22562702745199203, + 0.673274228349328, + 0.45545781031250954, + 3.162116650491953, + 2.792577400803566, + 1.2101499382406473, + 0.3775269165635109, + 0.3070542812347412, + 0.3157740868628025, + 1.4784468784928322, + 0.24975041672587395 + ], + "unique_experts": 64, + "load_cv": 0.6124228346453631, + "normalized_load_entropy": 0.9537174087098144, + "max_load_share": 0.03611111111111111 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "c50ae00cd9e3b781b7caa178f6571a95f6b59b70a9ada1855ed4092354c7561c", + "route_weight_sha256": "ef17515a6b495a380109fe08b7c27826d9fa5065ec7935e7170f1034e3f7a2a4", + "loads": [ + 7, + 12, + 14, + 14, + 7, + 5, + 16, + 7, + 18, + 11, + 21, + 4, + 15, + 11, + 27, + 13, + 9, + 11, + 20, + 14, + 25, + 17, + 18, + 7, + 23, + 11, + 9, + 28, + 16, + 8, + 11, + 9, + 2, + 6, + 27, + 28, + 2, + 15, + 32, + 15, + 2, + 21, + 27, + 12, + 7, + 1, + 20, + 34, + 14, + 5, + 8, + 14, + 14, + 11, + 23, + 15, + 30, + 33, + 16, + 16, + 21, + 13, + 29, + 15 + ], + "weighted_loads": [ + 1.0345168933272362, + 1.0301330331712961, + 0.38698408752679825, + 2.0330106876790524, + 0.2200474627315998, + 0.4747334457933903, + 0.45086707919836044, + 0.4174654074013233, + 1.102046225219965, + 0.4166383985430002, + 0.7054275758564472, + 0.10781420953571796, + 0.9828442391008139, + 1.4326743222773075, + 1.2324012871831656, + 0.7391627300530672, + 0.3056234288960695, + 0.6600572168827057, + 2.843444647267461, + 1.157396236434579, + 0.9159481376409531, + 1.4495434146374464, + 1.274203509092331, + 0.18296254612505436, + 1.3725559320300817, + 1.0519252642989159, + 0.3407798819243908, + 3.265839073807001, + 0.5660584326833487, + 0.3200247064232826, + 0.5020447708666325, + 0.2389985304325819, + 0.053942834958434105, + 0.19802318885922432, + 1.4462628923356533, + 2.384240983054042, + 0.12061319872736931, + 1.2442891355603933, + 1.3060900904238224, + 0.9565174710005522, + 0.07625695317983627, + 0.6084749791771173, + 2.0783094577491283, + 0.5927658695727587, + 0.9735989235341549, + 0.19364339113235474, + 1.1818379927426577, + 1.8723957668989897, + 0.4294525757431984, + 0.15434245206415653, + 0.2320368830114603, + 1.3915845453739166, + 1.0507232807576656, + 0.40962990559637547, + 0.673274228349328, + 0.45545781031250954, + 3.4154971428215504, + 3.1522585060447454, + 1.321414241567254, + 0.8591460362076759, + 1.0426136385649443, + 0.715440172702074, + 2.325325643643737, + 1.2559166476130486 + ], + "unique_experts": 64, + "load_cv": 0.5452922502185328, + "normalized_load_entropy": 0.962645821594754, + "max_load_share": 0.035196687370600416 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 120, + "ordered_topk_exact_tokens": 75, + "set_exact_tokens": 90, + "mean_set_jaccard": 0.9285714285714287, + "mean_token_weighted_tv": 0.011992934361721079, + "aggregate_load_tv": 0.030555555555555558 + }, + "system_bos": { + "tokens": 120, + "ordered_topk_exact_tokens": 59, + "set_exact_tokens": 73, + "mean_set_jaccard": 0.8724206349206349, + "mean_token_weighted_tv": 0.02019794857284675, + "aggregate_load_tv": 0.05138888888888889 + }, + "system_x": { + "tokens": 120, + "ordered_topk_exact_tokens": 50, + "set_exact_tokens": 64, + "mean_set_jaccard": 0.8496031746031747, + "mean_token_weighted_tv": 0.023251056865168113, + "aggregate_load_tv": 0.06527777777777777 + }, + "system_period": { + "tokens": 120, + "ordered_topk_exact_tokens": 54, + "set_exact_tokens": 66, + "mean_set_jaccard": 0.8547619047619048, + "mean_token_weighted_tv": 0.02285026522974173, + "aggregate_load_tv": 0.06944444444444443 + }, + "bos_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 35, + "set_exact_tokens": 50, + "mean_set_jaccard": 0.8037698412698414, + "mean_token_weighted_tv": 0.032514571615805225, + "aggregate_load_tv": 0.08194444444444444 + }, + "bos_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 39, + "set_exact_tokens": 58, + "mean_set_jaccard": 0.8363095238095238, + "mean_token_weighted_tv": 0.02810352366262426, + "aggregate_load_tv": 0.07222222222222222 + }, + "x_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 34, + "set_exact_tokens": 45, + "mean_set_jaccard": 0.7936507936507937, + "mean_token_weighted_tv": 0.03337920473422855, + "aggregate_load_tv": 0.08888888888888889 + }, + "x_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 39, + "set_exact_tokens": 63, + "mean_set_jaccard": 0.8468253968253969, + "mean_token_weighted_tv": 0.02729123526563247, + "aggregate_load_tv": 0.062499999999999986 + }, + "period_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 35, + "set_exact_tokens": 49, + "mean_set_jaccard": 0.8049603174603175, + "mean_token_weighted_tv": 0.03218741376573841, + "aggregate_load_tv": 0.08472222222222223 + }, + "period_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 39, + "set_exact_tokens": 63, + "mean_set_jaccard": 0.85, + "mean_token_weighted_tv": 0.026662039725730818, + "aggregate_load_tv": 0.062499999999999986 + } + } + }, + "layer_03": { + "layer": 3, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "48a1cd72552dfc6c8371363742b8bd67afcda740f6f6e9e13acff347c5310547", + "route_weight_sha256": "9d333087f43b2cd3fde7656486b00756476d890de18df2fec3fb9c4eac55dea6", + "loads": [ + 41, + 9, + 22, + 1, + 12, + 12, + 20, + 23, + 4, + 8, + 3, + 6, + 9, + 5, + 14, + 10, + 9, + 13, + 11, + 11, + 12, + 16, + 7, + 7, + 39, + 1, + 0, + 16, + 1, + 1, + 14, + 8, + 24, + 22, + 12, + 20, + 4, + 1, + 14, + 1, + 14, + 6, + 3, + 8, + 7, + 14, + 17, + 18, + 20, + 23, + 2, + 4, + 5, + 19, + 6, + 6, + 3, + 3, + 18, + 11, + 20, + 1, + 14, + 15 + ], + "weighted_loads": [ + 2.9735303334891796, + 0.5600190982222557, + 1.0158952232450247, + 0.04966268688440323, + 1.2561094909906387, + 0.9270350113511086, + 1.8196713514626026, + 1.8573023565113544, + 0.10867793299257755, + 0.7034178227186203, + 0.08249402977526188, + 0.17769421637058258, + 1.9283740781247616, + 0.18863710947334766, + 0.5628230907022953, + 0.43340738490223885, + 0.7561181988567114, + 0.6747679729014635, + 1.8050453066825867, + 0.6525390259921551, + 0.8406181950122118, + 1.6262878850102425, + 0.4544774480164051, + 0.21911749243736267, + 1.5515289269387722, + 0.035878486931324005, + 0.0, + 1.2113475631922483, + 0.029668983072042465, + 0.023371832445263863, + 0.640020627528429, + 0.21913886442780495, + 0.8208138197660446, + 1.9685477316379547, + 1.1701796278357506, + 1.8487159330397844, + 0.37701890617609024, + 0.02802000194787979, + 1.113825485110283, + 0.04672258719801903, + 0.4415907170623541, + 0.1956873033195734, + 0.10072007775306702, + 0.3375863842666149, + 0.28663409501314163, + 1.1106455456465483, + 1.5087545365095139, + 1.2830446921288967, + 1.3181722573935986, + 2.2106163911521435, + 0.057437583804130554, + 0.2642349563539028, + 0.20458629727363586, + 1.122143056243658, + 0.7277989275753498, + 0.3252504263073206, + 0.12075807526707649, + 0.08672227896749973, + 1.2624202985316515, + 0.3506986014544964, + 1.3806380741298199, + 0.06640779972076416, + 0.6568587776273489, + 0.6418935656547546 + ], + "unique_experts": 63, + "load_cv": 0.7531005867924686, + "normalized_load_entropy": 0.9322062403283615, + "max_load_share": 0.05694444444444444 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "b032f2432931d559cc660bf9d7ad20dae4bc65d0495232e8190ef55d37407f8b", + "route_weight_sha256": "1aae6cb0d25bfb29b1e37e82b12060a4f9b875d3e9fe9c8dea15f2e4cc4c1959", + "loads": [ + 51, + 9, + 22, + 11, + 14, + 16, + 20, + 32, + 4, + 14, + 5, + 7, + 11, + 10, + 20, + 10, + 9, + 13, + 11, + 11, + 14, + 19, + 12, + 8, + 39, + 3, + 0, + 22, + 1, + 4, + 16, + 8, + 24, + 22, + 21, + 20, + 4, + 1, + 14, + 1, + 14, + 7, + 13, + 8, + 7, + 14, + 31, + 18, + 26, + 33, + 2, + 4, + 6, + 19, + 10, + 8, + 3, + 4, + 18, + 11, + 25, + 1, + 18, + 17 + ], + "weighted_loads": [ + 4.471964420750737, + 0.5600190982222557, + 1.0158952232450247, + 0.6395021565258503, + 1.284787284792401, + 1.1104979366064072, + 1.8196713514626026, + 3.2940723411738873, + 0.10867793299257755, + 0.9752489833626896, + 0.155102351680398, + 0.17857304232893512, + 1.9404672095552087, + 0.6065067630261183, + 0.9169929809868336, + 0.43340738490223885, + 0.7561181988567114, + 0.6747679729014635, + 1.8050453066825867, + 0.6525390259921551, + 0.913546996191144, + 1.927041880786419, + 0.7958572916686535, + 0.24641070514917374, + 1.5515289269387722, + 0.049613302398938686, + 0.0, + 1.435378884896636, + 0.029668983072042465, + 0.19588742591440678, + 0.7491900362074375, + 0.21913886442780495, + 0.8208138197660446, + 1.9685477316379547, + 2.2041478641331196, + 1.8487159330397844, + 0.37701890617609024, + 0.02802000194787979, + 1.113825485110283, + 0.04672258719801903, + 0.4415907170623541, + 0.20715340040624142, + 0.6741370726376772, + 0.3375863842666149, + 0.28663409501314163, + 1.1106455456465483, + 3.3643239978700876, + 1.2830446921288967, + 1.9253598265349865, + 2.824691828340292, + 0.057437583804130554, + 0.2642349563539028, + 0.2193637676537037, + 1.122143056243658, + 2.559427287429571, + 0.41358662210404873, + 0.12075807526707649, + 0.09958782885223627, + 1.2624202985316515, + 0.3506986014544964, + 1.775510247796774, + 0.06640779972076416, + 1.101334234699607, + 0.7167316377162933 + ], + "unique_experts": 63, + "load_cv": 0.7199147055363272, + "normalized_load_entropy": 0.9390887551343505, + "max_load_share": 0.05862068965517241 + } + }, + "s1_eos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "c7886ab3d8222bef815cbd5c5e573806a0d4a3afd239cefc8db688ebab280464", + "route_weight_sha256": "f166181ca08717e65634519a743e8bbd0275d45aed45973096bfc175fbc4a926", + "loads": [ + 41, + 9, + 22, + 1, + 12, + 12, + 20, + 26, + 3, + 8, + 3, + 7, + 9, + 7, + 14, + 10, + 10, + 13, + 11, + 11, + 12, + 16, + 7, + 5, + 39, + 1, + 0, + 16, + 1, + 1, + 14, + 8, + 23, + 22, + 12, + 19, + 4, + 0, + 13, + 1, + 14, + 4, + 3, + 8, + 7, + 15, + 16, + 18, + 21, + 23, + 5, + 4, + 6, + 18, + 6, + 6, + 3, + 1, + 18, + 11, + 19, + 1, + 15, + 15 + ], + "weighted_loads": [ + 3.012529192492366, + 0.5499765016138554, + 1.0030912011861801, + 0.050386473536491394, + 1.258397787809372, + 0.9497644230723381, + 1.8009448163211346, + 1.9938315693289042, + 0.07402127422392368, + 0.6960960701107979, + 0.08191632851958275, + 0.20848184823989868, + 1.9528490919619799, + 0.2642189934849739, + 0.5627845171838999, + 0.43463018350303173, + 0.7970289904624224, + 0.6710406560450792, + 1.7973673325031996, + 0.6550252698361874, + 0.8650064095854759, + 1.6032694429159164, + 0.45417768880724907, + 0.15498420223593712, + 1.5361454095691442, + 0.03377045691013336, + 0.0, + 1.200853930786252, + 0.02939387783408165, + 0.024036919698119164, + 0.6258933078497648, + 0.22401538491249084, + 0.772152628749609, + 1.946387343108654, + 1.1705326978117228, + 1.83063255995512, + 0.36903489753603935, + 0.0, + 1.0708566289395094, + 0.04560460150241852, + 0.44679270312190056, + 0.13077795505523682, + 0.09770652651786804, + 0.33118104562163353, + 0.28219297528266907, + 1.148728372529149, + 1.5154354274272919, + 1.2732076868414879, + 1.3706701770424843, + 2.2129680924117565, + 0.15460705757141113, + 0.27044622227549553, + 0.23676338605582714, + 1.0698225758969784, + 0.7441520504653454, + 0.3227310720831156, + 0.12190216779708862, + 0.03175891935825348, + 1.249072477221489, + 0.35822728648781776, + 1.3286314606666565, + 0.06465829163789749, + 0.6818113029003143, + 0.6410064473748207 + ], + "unique_experts": 62, + "load_cv": 0.7573508083534211, + "normalized_load_entropy": 0.9304439926007582, + "max_load_share": 0.05694444444444444 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "8dcb872c24aedb5cf484e26baede96c81ab77bb1d594812e6dcd3dbfc1fd81e9", + "route_weight_sha256": "940228b983120b220b847db98ee49ed2b202b5efaf6422601c5a9941c99fec3b", + "loads": [ + 55, + 11, + 22, + 12, + 13, + 19, + 20, + 38, + 3, + 17, + 6, + 8, + 13, + 13, + 22, + 11, + 12, + 13, + 12, + 11, + 14, + 22, + 17, + 5, + 41, + 4, + 0, + 19, + 1, + 4, + 16, + 8, + 23, + 24, + 20, + 19, + 4, + 5, + 13, + 2, + 15, + 5, + 18, + 10, + 7, + 18, + 34, + 18, + 29, + 33, + 5, + 10, + 10, + 23, + 10, + 12, + 3, + 2, + 25, + 12, + 30, + 2, + 21, + 22 + ], + "weighted_loads": [ + 4.882939534261823, + 0.6238015405833721, + 1.0030912011861801, + 0.7082186825573444, + 1.2589347889879718, + 1.2796818017959595, + 1.8009448163211346, + 3.517942214384675, + 0.07402127422392368, + 1.1460926516447216, + 0.16688093729317188, + 0.20936067419825122, + 2.0418659364804626, + 0.7409087084233761, + 1.09877803735435, + 0.48373650945723057, + 1.0104253310710192, + 0.6710406560450792, + 1.8529709670692682, + 0.6550252698361874, + 0.9313906133174896, + 2.0057713203132153, + 1.303423535078764, + 0.15498420223593712, + 1.639542205259204, + 0.09086891991319135, + 0.0, + 1.297001937404275, + 0.02939387783408165, + 0.18750817887485027, + 0.7301569301635027, + 0.22401538491249084, + 0.772152628749609, + 2.01902811601758, + 2.0863964203745127, + 1.83063255995512, + 0.36903489753603935, + 0.4164501316845417, + 1.0708566289395094, + 0.09583360329270363, + 0.521952148526907, + 0.13959168177098036, + 0.8023434299975634, + 0.4048449583351612, + 0.28219297528266907, + 1.3911269288510084, + 3.9516530483961105, + 1.2732076868414879, + 2.2868089824914932, + 2.676720455288887, + 0.15460705757141113, + 1.0504911243915558, + 0.44895757269114256, + 1.7837501950562, + 2.6464453004300594, + 0.645211024209857, + 0.12190216779708862, + 0.04076500050723553, + 1.7360731475055218, + 0.3886727895587683, + 2.0124885477125645, + 0.11482996493577957, + 1.1515903137624264, + 1.0882937163114548 + ], + "unique_experts": 63, + "load_cv": 0.6939463211836849, + "normalized_load_entropy": 0.9434833684964449, + "max_load_share": 0.056935817805383024 + } + }, + "s0_bos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "48cd30826cbb0efdf2f5be3a4caca88ef3a886fe09448b11989ca22fcc20738c", + "route_weight_sha256": "74fe29792316f43a6d376cc4e9e70448cf649b2c89146232e9f171b922b7fa4b", + "loads": [ + 41, + 9, + 21, + 1, + 12, + 12, + 20, + 20, + 4, + 8, + 3, + 6, + 9, + 3, + 9, + 11, + 14, + 16, + 11, + 11, + 12, + 17, + 7, + 7, + 38, + 1, + 0, + 16, + 2, + 1, + 13, + 11, + 22, + 22, + 11, + 21, + 4, + 4, + 12, + 1, + 13, + 5, + 2, + 8, + 7, + 15, + 17, + 18, + 21, + 24, + 0, + 5, + 2, + 24, + 7, + 6, + 3, + 0, + 17, + 8, + 19, + 1, + 14, + 21 + ], + "weighted_loads": [ + 2.8395586982369423, + 0.5774818100035191, + 0.9962752144783735, + 0.05224820226430893, + 1.2996686920523643, + 0.9322002157568932, + 1.7671617418527603, + 1.613853994756937, + 0.10647578723728657, + 0.7187423706054688, + 0.08234639838337898, + 0.17413243651390076, + 2.032528053969145, + 0.13009032234549522, + 0.35519574396312237, + 0.4694667384028435, + 0.934276644140482, + 0.7670573126524687, + 1.9118248000741005, + 0.6419758275151253, + 0.7946540862321854, + 1.6815309450030327, + 0.4370188005268574, + 0.21877769567072392, + 1.4258469324558973, + 0.03439034894108772, + 0.0, + 1.3003870751708746, + 0.058648282662034035, + 0.022828150540590286, + 0.5691334176808596, + 0.2924155406653881, + 0.7304611299186945, + 1.8911627158522606, + 1.1361446771770716, + 1.8731875959783792, + 0.3696880452334881, + 0.11066543124616146, + 1.0488232523202896, + 0.04519684240221977, + 0.3823695834726095, + 0.1627287920564413, + 0.06485290452837944, + 0.33537303283810616, + 0.29018203914165497, + 1.1402939427644014, + 1.5102144367992878, + 1.2676658667623997, + 1.218788592144847, + 2.388688562437892, + 0.0, + 0.29061450995504856, + 0.10133979097008705, + 1.285869201645255, + 0.7996431328356266, + 0.33138759806752205, + 0.11568456888198853, + 0.0, + 1.16923582367599, + 0.24574616365134716, + 1.3103125654160976, + 0.06443727016448975, + 0.6727613154798746, + 0.8722747508436441 + ], + "unique_experts": 61, + "load_cv": 0.7661028522639199, + "normalized_load_entropy": 0.9273688473622212, + "max_load_share": 0.05694444444444444 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "6fc14e6a20f14870126b68c5aeebfc81d2c92592e0e25d14b390bfbb3fab9a72", + "route_weight_sha256": "19b373e408f02fe2ae55eb4f908d01fcab57935b8d3d76d0ebf78896ac32b773", + "loads": [ + 52, + 9, + 21, + 11, + 14, + 17, + 20, + 30, + 4, + 13, + 5, + 7, + 10, + 7, + 15, + 11, + 14, + 16, + 12, + 11, + 14, + 20, + 12, + 8, + 38, + 2, + 0, + 22, + 2, + 5, + 15, + 11, + 22, + 22, + 19, + 21, + 4, + 4, + 12, + 1, + 13, + 5, + 12, + 8, + 7, + 15, + 31, + 18, + 29, + 34, + 0, + 5, + 2, + 24, + 11, + 8, + 3, + 0, + 17, + 8, + 25, + 1, + 18, + 23 + ], + "weighted_loads": [ + 4.495144058018923, + 0.5774818100035191, + 0.9962752144783735, + 0.642087671905756, + 1.3283464858541265, + 1.172579288482666, + 1.7671617418527603, + 2.887048952281475, + 0.10647578723728657, + 0.9726883976254612, + 0.1549547202885151, + 0.1750112624722533, + 2.0330055374652147, + 0.5228236503899097, + 0.7276767995208502, + 0.4694667384028435, + 0.934276644140482, + 0.7670573126524687, + 1.9479543678462505, + 0.6419758275151253, + 0.8666570596396923, + 1.9867635071277618, + 0.7676300574094057, + 0.24607090838253498, + 1.4258469324558973, + 0.03492034581722692, + 0.0, + 1.5244183968752623, + 0.058648282662034035, + 0.23414642363786697, + 0.6733864601701498, + 0.2924155406653881, + 0.7304611299186945, + 1.8911627158522606, + 2.1330753099173307, + 1.8731875959783792, + 0.3696880452334881, + 0.11066543124616146, + 1.0488232523202896, + 0.04519684240221977, + 0.3823695834726095, + 0.1627287920564413, + 0.7316399961709976, + 0.33537303283810616, + 0.29018203914165497, + 1.1402939427644014, + 3.561153467744589, + 1.2676658667623997, + 1.9728293512016535, + 3.0027639996260405, + 0.0, + 0.29061450995504856, + 0.10133979097008705, + 1.285869201645255, + 1.959957929328084, + 0.41718271374702454, + 0.11568456888198853, + 0.0, + 1.16923582367599, + 0.24574616365134716, + 1.7149379029870033, + 0.06443727016448975, + 1.115144344046712, + 0.946892948821187 + ], + "unique_experts": 61, + "load_cv": 0.7369779357200202, + "normalized_load_entropy": 0.9343146146755784, + "max_load_share": 0.059770114942528735 + } + }, + "s1_bos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "ba5cec0bc9e6f6c9b1f9762c1e4dba4a149eddf7a3a83ad2926915823ccde532", + "route_weight_sha256": "72aa6c2555d5bf2f391162a96ed4df109dbbdae66eedeaf0be2cec02f88863d6", + "loads": [ + 41, + 9, + 20, + 1, + 12, + 12, + 19, + 23, + 2, + 8, + 3, + 8, + 9, + 3, + 10, + 12, + 13, + 13, + 10, + 11, + 12, + 16, + 7, + 6, + 38, + 1, + 0, + 16, + 4, + 1, + 12, + 11, + 24, + 22, + 11, + 20, + 4, + 1, + 13, + 1, + 19, + 6, + 2, + 8, + 7, + 15, + 18, + 18, + 22, + 23, + 0, + 5, + 3, + 21, + 8, + 6, + 3, + 1, + 16, + 9, + 18, + 1, + 12, + 20 + ], + "weighted_loads": [ + 2.7806765101850033, + 0.549952857196331, + 0.9531762413680553, + 0.05707442760467529, + 1.2240605279803276, + 0.9424621164798737, + 1.645594585686922, + 1.7329881377518177, + 0.0512051060795784, + 0.7142798528075218, + 0.08469760231673717, + 0.23824317380785942, + 2.0499393958598375, + 0.1305666770786047, + 0.40599888004362583, + 0.5054545775055885, + 0.8998335264623165, + 0.6761639397591352, + 1.808025673031807, + 0.6278293654322624, + 0.8195102177560329, + 1.5899779722094536, + 0.40348347648978233, + 0.19764544069766998, + 1.4337688572704792, + 0.035855941474437714, + 0.0, + 1.2718919795006514, + 0.10893830098211765, + 0.03219124302268028, + 0.5518426485359669, + 0.31157163716852665, + 0.8058197107166052, + 1.8711814992129803, + 1.1440004874020815, + 1.771754652261734, + 0.3611232526600361, + 0.027753032743930817, + 1.0652834977954626, + 0.04451587796211243, + 0.5661850925534964, + 0.1957527045160532, + 0.06280100718140602, + 0.32034796476364136, + 0.2864118963479996, + 1.1208416111767292, + 1.5660788975656033, + 1.2827670238912106, + 1.2554916702210903, + 2.3535903692245483, + 0.0, + 0.2936349678784609, + 0.1386807058006525, + 1.1465304270386696, + 0.8683540653437376, + 0.32208624854683876, + 0.11683686822652817, + 0.02585066668689251, + 1.0514092035591602, + 0.28730051033198833, + 1.225454619154334, + 0.0719996988773346, + 0.5881057530641556, + 0.8187927640974522 + ], + "unique_experts": 62, + "load_cv": 0.7619014550192785, + "normalized_load_entropy": 0.9284437015117382, + "max_load_share": 0.05694444444444444 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "c4ea21150c803c210d6e213551642785219d7a97c055eb13c7a582f0a8e751f1", + "route_weight_sha256": "14e0c34dcc7c666e30657a61c052403fc22ef9bbf1efe51542072a9555271853", + "loads": [ + 56, + 11, + 20, + 12, + 13, + 19, + 19, + 35, + 2, + 17, + 6, + 9, + 12, + 9, + 18, + 13, + 15, + 13, + 12, + 11, + 14, + 22, + 18, + 6, + 40, + 3, + 0, + 19, + 4, + 4, + 14, + 11, + 24, + 24, + 19, + 20, + 4, + 6, + 13, + 2, + 20, + 6, + 17, + 10, + 7, + 18, + 37, + 18, + 31, + 33, + 0, + 11, + 6, + 26, + 12, + 12, + 3, + 1, + 23, + 10, + 29, + 2, + 18, + 27 + ], + "weighted_loads": [ + 4.731910267844796, + 0.6237778961658478, + 0.9531762413680553, + 0.7149066366255283, + 1.2245975291589275, + 1.282401941716671, + 1.645594585686922, + 3.1098108552396297, + 0.0512051060795784, + 1.1744657254312187, + 0.1696622110903263, + 0.23912199976621196, + 2.1310378313064575, + 0.6372231747955084, + 0.959590969607234, + 0.5545609034597874, + 1.1132298670709133, + 0.6761639397591352, + 1.9000988230109215, + 0.6278293654322624, + 0.8898036107420921, + 2.0058250464498997, + 1.2613987047225237, + 0.19764544069766998, + 1.5371656529605389, + 0.08417025191010907, + 0.0, + 1.3680399861186743, + 0.10893830098211765, + 0.19341963157057762, + 0.6497881598770618, + 0.31157163716852665, + 0.8058197107166052, + 1.9438222721219063, + 2.06802230887115, + 1.771754652261734, + 0.3611232526600361, + 0.4442031644284725, + 1.0652834977954626, + 0.09474487975239754, + 0.6413445379585028, + 0.1957527045160532, + 0.8844338413327932, + 0.39401187747716904, + 0.2864118963479996, + 1.3632401674985886, + 4.022711839526892, + 1.2827670238912106, + 2.2639409452676773, + 2.817342732101679, + 0.0, + 1.0736798699945211, + 0.34048918448388577, + 1.8604580461978912, + 2.011079290881753, + 0.6411752738058567, + 0.11683686822652817, + 0.02585066668689251, + 1.538409873843193, + 0.31774601340293884, + 1.8778366167098284, + 0.12217137217521667, + 1.0904045961797237, + 1.2670372426509857 + ], + "unique_experts": 62, + "load_cv": 0.703662717279297, + "normalized_load_entropy": 0.940830026036923, + "max_load_share": 0.057971014492753624 + } + }, + "s0_x": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "528e9ea8e8c0e4377f29b634ee7dfe1569859378997991e550b508256ece99cd", + "route_weight_sha256": "c267bb8ddb6e99bbd85dedf22d68369ee05294cdacf01e437eb71d5b5f6662d1", + "loads": [ + 41, + 9, + 20, + 1, + 12, + 12, + 20, + 18, + 6, + 9, + 3, + 7, + 9, + 2, + 10, + 13, + 14, + 15, + 11, + 11, + 12, + 18, + 6, + 4, + 39, + 1, + 0, + 16, + 3, + 1, + 12, + 9, + 24, + 22, + 12, + 20, + 4, + 3, + 12, + 1, + 12, + 6, + 2, + 7, + 7, + 15, + 17, + 18, + 22, + 24, + 3, + 4, + 1, + 23, + 6, + 7, + 3, + 1, + 17, + 8, + 20, + 1, + 13, + 21 + ], + "weighted_loads": [ + 2.855106920003891, + 0.5812391005456448, + 0.9718931131064892, + 0.050652164965867996, + 1.2940376922488213, + 0.9327615648508072, + 1.8155572470277548, + 1.5689554773271084, + 0.15973549522459507, + 0.7558838110417128, + 0.08332188613712788, + 0.20206685923039913, + 2.0328078120946884, + 0.09686625003814697, + 0.3669307827949524, + 0.549579257145524, + 0.9383477885276079, + 0.7451345920562744, + 1.8967925757169724, + 0.6492264866828918, + 0.816377580165863, + 1.7881613560020924, + 0.33645258843898773, + 0.13256938569247723, + 1.484475526958704, + 0.034995611757040024, + 0.0, + 1.3144491706043482, + 0.08425329253077507, + 0.023130344226956367, + 0.539871096611023, + 0.24364188499748707, + 0.7967097535729408, + 1.8931609652936459, + 1.1471172217279673, + 1.805311907082796, + 0.35013774409890175, + 0.08546946570277214, + 1.0525836534798145, + 0.047264017164707184, + 0.354863278567791, + 0.19306223839521408, + 0.06431789696216583, + 0.29453833401203156, + 0.29072073474526405, + 1.1594011057168245, + 1.542173370718956, + 1.2471638359129429, + 1.2676549684256315, + 2.3739718049764633, + 0.0916812289506197, + 0.25471072643995285, + 0.078879714012146, + 1.2463099546730518, + 0.7368882931768894, + 0.3721721787005663, + 0.11296764016151428, + 0.026123065501451492, + 1.169319361448288, + 0.24553163163363934, + 1.3759593330323696, + 0.06391696631908417, + 0.6403293907642365, + 0.8689651675522327 + ], + "unique_experts": 63, + "load_cv": 0.767230066739203, + "normalized_load_entropy": 0.9292001557344507, + "max_load_share": 0.05694444444444444 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "9117eac08dfaca5dbc9a337fa4e2b45aa1a2fffb0787336fe7b1dd6087f226e0", + "route_weight_sha256": "e8e59b2c1fc70c73ada5a49c7b6cde6ce0463af224bb238badf9a2a40037a229", + "loads": [ + 50, + 9, + 20, + 12, + 15, + 16, + 20, + 28, + 6, + 14, + 5, + 8, + 10, + 6, + 16, + 13, + 14, + 15, + 11, + 11, + 13, + 21, + 11, + 5, + 39, + 2, + 1, + 23, + 3, + 5, + 14, + 9, + 24, + 22, + 21, + 20, + 5, + 3, + 12, + 1, + 12, + 6, + 12, + 7, + 7, + 15, + 31, + 18, + 28, + 35, + 3, + 4, + 1, + 23, + 10, + 9, + 3, + 1, + 17, + 8, + 26, + 1, + 17, + 23 + ], + "weighted_loads": [ + 4.2230994794517756, + 0.5812391005456448, + 0.9718931131064892, + 0.7743280231952667, + 1.3537475286284462, + 1.1299013495445251, + 1.8155572470277548, + 2.8446358293294907, + 0.15973549522459507, + 1.0319601076189429, + 0.15593020804226398, + 0.20294568518875167, + 2.0332852955907583, + 0.4876042455434799, + 0.7057199254631996, + 0.549579257145524, + 0.9383477885276079, + 0.7451345920562744, + 1.8967925757169724, + 0.6492264866828918, + 0.8433051481842995, + 2.0979268439114094, + 0.661595806479454, + 0.1598625984042883, + 1.484475526958704, + 0.03552560863317922, + 0.04225320741534233, + 1.5859185997396708, + 0.08425329253077507, + 0.24218209646642208, + 0.645064253360033, + 0.24364188499748707, + 0.7967097535729408, + 1.8931609652936459, + 2.2455326970666647, + 1.805311907082796, + 0.398285087198019, + 0.08546946570277214, + 1.0525836534798145, + 0.047264017164707184, + 0.354863278567791, + 0.19306223839521408, + 0.6895361877977848, + 0.29453833401203156, + 0.29072073474526405, + 1.1594011057168245, + 3.6069987136870623, + 1.2471638359129429, + 1.870374297723174, + 3.051307789981365, + 0.0916812289506197, + 0.25471072643995285, + 0.078879714012146, + 1.2463099546730518, + 1.875587608665228, + 0.46243628300726414, + 0.11296764016151428, + 0.026123065501451492, + 1.169319361448288, + 0.24553163163363934, + 1.8290462642908096, + 0.06391696631908417, + 1.081413172185421, + 0.9427895285189152 + ], + "unique_experts": 64, + "load_cv": 0.7266949926662702, + "normalized_load_entropy": 0.9381229715144432, + "max_load_share": 0.05747126436781609 + } + }, + "s1_x": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "77667b725ff7f6f2d3b0ddc4b86fc015de4d26125e1641cc2b167ed465dca514", + "route_weight_sha256": "c16ea49dbe6e495443eb53bf727484cfe1ca122197b5ee961bed887305ce10bf", + "loads": [ + 41, + 9, + 20, + 1, + 11, + 12, + 19, + 22, + 3, + 8, + 3, + 7, + 9, + 3, + 9, + 11, + 13, + 12, + 10, + 11, + 12, + 16, + 6, + 6, + 38, + 1, + 0, + 16, + 4, + 1, + 11, + 10, + 25, + 22, + 12, + 19, + 4, + 2, + 13, + 1, + 14, + 6, + 1, + 8, + 7, + 15, + 19, + 18, + 21, + 23, + 5, + 5, + 5, + 19, + 8, + 5, + 3, + 1, + 17, + 11, + 18, + 1, + 15, + 22 + ], + "weighted_loads": [ + 2.768812745809555, + 0.5575404949486256, + 0.9550581928342581, + 0.05844934284687042, + 1.1552823930978775, + 0.9699713885784149, + 1.6396694779396057, + 1.707932099699974, + 0.07950804382562637, + 0.7276055291295052, + 0.08289984613656998, + 0.2056321930140257, + 2.0347056426107883, + 0.13402300514280796, + 0.3624894358217716, + 0.4833297673612833, + 0.9026431944221258, + 0.6531884912401438, + 1.7975281365215778, + 0.6261020377278328, + 0.8280648365616798, + 1.6058656759560108, + 0.32826143503189087, + 0.20443272590637207, + 1.456594042479992, + 0.0357387512922287, + 0.0, + 1.2795624863356352, + 0.11037950962781906, + 0.03293830156326294, + 0.5266069993376732, + 0.2826633434742689, + 0.8460952583700418, + 1.8559087589383125, + 1.1685102321207523, + 1.7455127127468586, + 0.35216551646590233, + 0.05573873594403267, + 1.075443735346198, + 0.0477009043097496, + 0.41744414530694485, + 0.19406060688197613, + 0.03249785676598549, + 0.3111657239496708, + 0.28723182156682014, + 1.1411032602190971, + 1.6671109981834888, + 1.254841085523367, + 1.2622563857585192, + 2.3648597206920385, + 0.15574422851204872, + 0.2906825616955757, + 0.21052991226315498, + 1.0730437822639942, + 0.8324212208390236, + 0.2978702411055565, + 0.1137188971042633, + 0.02576839178800583, + 1.0987895876169205, + 0.33558468893170357, + 1.2562866676598787, + 0.07119113206863403, + 0.6711530573666096, + 0.8895944394171238 + ], + "unique_experts": 63, + "load_cv": 0.7494854201795579, + "normalized_load_entropy": 0.9326582515437869, + "max_load_share": 0.05694444444444444 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "17cb9631390c90b8d14349b1f83a6bbea50d768327a80980a8cf1696d90e6120", + "route_weight_sha256": "69a27ac9df5a771a791fabca664acf9fa37d52ac6fba3cb6ca7e49ec3eaa3e28", + "loads": [ + 54, + 11, + 20, + 13, + 13, + 19, + 19, + 34, + 3, + 17, + 6, + 8, + 12, + 9, + 17, + 12, + 15, + 12, + 11, + 11, + 13, + 22, + 16, + 6, + 40, + 3, + 1, + 20, + 4, + 5, + 13, + 10, + 25, + 24, + 20, + 19, + 5, + 7, + 13, + 2, + 15, + 6, + 16, + 10, + 7, + 18, + 37, + 18, + 29, + 34, + 5, + 11, + 8, + 24, + 12, + 11, + 3, + 1, + 24, + 12, + 29, + 2, + 21, + 29 + ], + "weighted_loads": [ + 4.451959516853094, + 0.6313655339181423, + 0.9550581928342581, + 0.8634184189140797, + 1.1864650683710352, + 1.283391784876585, + 1.6396694779396057, + 3.073616001754999, + 0.07950804382562637, + 1.2084848827216774, + 0.1678644549101591, + 0.20651101897237822, + 2.1158040780574083, + 0.6302699130028486, + 0.8911343924701214, + 0.5324360933154821, + 1.1160395350307226, + 0.6531884912401438, + 1.8531317710876465, + 0.6261020377278328, + 0.8602373376488686, + 2.0263638496398926, + 1.1652554124593735, + 0.20443272590637207, + 1.5599908381700516, + 0.08405306172790006, + 0.039264384657144547, + 1.4211796093732119, + 0.11037950962781906, + 0.23779546096920967, + 0.6248829886317253, + 0.2826633434742689, + 0.8460952583700418, + 1.9285495318472385, + 2.136410880833864, + 1.7455127127468586, + 0.3917930945754051, + 0.47218886762857437, + 1.075443735346198, + 0.09792990610003471, + 0.49260359071195126, + 0.19406060688197613, + 0.7686374578624964, + 0.38482963666319847, + 0.28723182156682014, + 1.3835018165409565, + 4.101512862369418, + 1.254841085523367, + 2.158953370526433, + 2.8877897653728724, + 0.15574422851204872, + 1.070727463811636, + 0.41233839094638824, + 1.7869714014232159, + 1.9542540293186903, + 0.6210874915122986, + 0.1137188971042633, + 0.02576839178800583, + 1.5857902579009533, + 0.3660301920026541, + 1.9616386499255896, + 0.12136280536651611, + 1.1574640423059464, + 1.3380725271999836 + ], + "unique_experts": 64, + "load_cv": 0.6829882250582683, + "normalized_load_entropy": 0.946456664330047, + "max_load_share": 0.055900621118012424 + } + }, + "s0_period": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "ae59981c06066925ced8610f36df0fb9350892eb548625072c464e6ba73175cc", + "route_weight_sha256": "31745479ac108eb9c363b0bbbf13b88604fbe94cf102f1228e65c52e3f511404", + "loads": [ + 41, + 9, + 19, + 1, + 12, + 12, + 20, + 19, + 5, + 9, + 3, + 7, + 9, + 2, + 9, + 12, + 14, + 15, + 11, + 11, + 12, + 18, + 7, + 6, + 39, + 1, + 0, + 16, + 3, + 1, + 12, + 10, + 24, + 22, + 12, + 20, + 4, + 3, + 12, + 1, + 12, + 6, + 2, + 8, + 7, + 15, + 17, + 18, + 21, + 24, + 2, + 4, + 2, + 23, + 6, + 6, + 3, + 1, + 17, + 8, + 19, + 1, + 14, + 21 + ], + "weighted_loads": [ + 2.8106828331947327, + 0.5797738842666149, + 0.9289662633091211, + 0.0521380677819252, + 1.2776380777359009, + 0.9399900659918785, + 1.8132321685552597, + 1.5865084417164326, + 0.12891944497823715, + 0.7527812141925097, + 0.08405915461480618, + 0.20592095702886581, + 2.03875382989645, + 0.09583523496985435, + 0.3445582892745733, + 0.5353290606290102, + 0.939543953165412, + 0.7448655273765326, + 1.89934585057199, + 0.6466561891138554, + 0.8249721936881542, + 1.7832312285900116, + 0.38970719650387764, + 0.19262145087122917, + 1.4734160602092743, + 0.0352608896791935, + 0.0, + 1.3113629650324583, + 0.08322971127927303, + 0.0235128253698349, + 0.5422479137778282, + 0.2681202869862318, + 0.8040334060788155, + 1.8831938803195953, + 1.1524993889033794, + 1.8184558656066656, + 0.3478135019540787, + 0.08427774533629417, + 1.0569769591093063, + 0.04746346175670624, + 0.3586826305836439, + 0.19429096579551697, + 0.06375402957201004, + 0.33489931002259254, + 0.2890346944332123, + 1.1579392738640308, + 1.5436005517840385, + 1.2501794882118702, + 1.224480526521802, + 2.3704637084156275, + 0.06028011627495289, + 0.25711704045534134, + 0.10772543214261532, + 1.2467713467776775, + 0.7284420803189278, + 0.33559899404644966, + 0.11340408772230148, + 0.025821037590503693, + 1.1537671368569136, + 0.24461226724088192, + 1.3140813373029232, + 0.06590340286493301, + 0.6646626591682434, + 0.8776012193411589 + ], + "unique_experts": 63, + "load_cv": 0.7623874132625974, + "normalized_load_entropy": 0.9302090401148154, + "max_load_share": 0.05694444444444444 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "5a2b5606bccc128d14a83af60e947c52ab06f0efdec90bee624b0c1226de6efa", + "route_weight_sha256": "bce5fc6278d06522b9e9e8fe30765b9215c293566b4976baa894ca8c4091f4ad", + "loads": [ + 50, + 10, + 19, + 12, + 15, + 16, + 20, + 29, + 5, + 15, + 5, + 8, + 10, + 6, + 15, + 12, + 14, + 15, + 11, + 11, + 13, + 21, + 13, + 7, + 39, + 2, + 0, + 22, + 3, + 5, + 14, + 10, + 24, + 22, + 20, + 20, + 4, + 3, + 12, + 1, + 12, + 6, + 12, + 8, + 7, + 16, + 31, + 18, + 27, + 34, + 2, + 4, + 2, + 23, + 10, + 8, + 3, + 1, + 18, + 8, + 25, + 1, + 18, + 23 + ], + "weighted_loads": [ + 4.103313691914082, + 0.727898370474577, + 0.9289662633091211, + 0.7121158428490162, + 1.3457924599060789, + 1.1382505409419537, + 1.8132321685552597, + 2.9212754033505917, + 0.12891944497823715, + 1.1857914889696985, + 0.15666747651994228, + 0.20679978298721835, + 2.03923131339252, + 0.4848583973944187, + 0.8081491980701685, + 0.5353290606290102, + 0.939543953165412, + 0.7448655273765326, + 1.89934585057199, + 0.6466561891138554, + 0.8518997617065907, + 2.0904211029410362, + 0.7705344781279564, + 0.21991466358304024, + 1.4734160602092743, + 0.03579088655533269, + 0.0, + 1.535394286736846, + 0.08322971127927303, + 0.23441231995821, + 0.648560494184494, + 0.2681202869862318, + 0.8040334060788155, + 1.8831938803195953, + 2.1494300216436386, + 1.8184558656066656, + 0.3478135019540787, + 0.08427774533629417, + 1.0569769591093063, + 0.04746346175670624, + 0.3586826305836439, + 0.19429096579551697, + 0.6920970343053341, + 0.33489931002259254, + 0.2890346944332123, + 1.2080059088766575, + 3.5805265195667744, + 1.2501794882118702, + 1.816254721954465, + 2.984539145603776, + 0.06028011627495289, + 0.25711704045534134, + 0.10772543214261532, + 1.2467713467776775, + 1.863451961427927, + 0.42387425154447556, + 0.11340408772230148, + 0.025821037590503693, + 1.1935316156595945, + 0.24461226724088192, + 1.7210049256682396, + 0.06590340286493301, + 1.1289751529693604, + 0.9515544343739748 + ], + "unique_experts": 63, + "load_cv": 0.7217914912199114, + "normalized_load_entropy": 0.9380637941355041, + "max_load_share": 0.05747126436781609 + } + }, + "s1_period": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "96931057030cd54445948fd87ab97beb0d2e3825ecab9572e099ac477310a23f", + "route_weight_sha256": "d5bb8a6b057e0ad1a817260970947bb084244de93f41009408650a89cbc6088d", + "loads": [ + 41, + 9, + 20, + 1, + 11, + 12, + 19, + 22, + 3, + 8, + 3, + 8, + 9, + 3, + 9, + 11, + 13, + 13, + 11, + 11, + 12, + 18, + 5, + 6, + 37, + 1, + 0, + 16, + 4, + 1, + 11, + 11, + 24, + 22, + 12, + 18, + 4, + 2, + 13, + 1, + 14, + 6, + 1, + 8, + 7, + 15, + 18, + 18, + 21, + 23, + 5, + 5, + 5, + 19, + 8, + 5, + 3, + 1, + 17, + 9, + 19, + 1, + 15, + 22 + ], + "weighted_loads": [ + 2.7600915618240833, + 0.5558300465345383, + 0.949227649718523, + 0.05863337218761444, + 1.1417452841997147, + 0.9673996977508068, + 1.645440150052309, + 1.6956724654883146, + 0.0791479405015707, + 0.7276413589715958, + 0.08305666595697403, + 0.23518115654587746, + 2.041905140504241, + 0.13067063875496387, + 0.3624115511775017, + 0.4858742840588093, + 0.8925689440220594, + 0.6818417310714722, + 1.8261088989675045, + 0.6316247321665287, + 0.8370823003351688, + 1.700060024857521, + 0.2679642103612423, + 0.20277891494333744, + 1.4251812752336264, + 0.03610125184059143, + 0.0, + 1.2825149446725845, + 0.11040329746901989, + 0.03217431157827377, + 0.5295316968113184, + 0.3099783807992935, + 0.8299733623862267, + 1.848384078592062, + 1.1754500027745962, + 1.7157242596149445, + 0.3446904197335243, + 0.05590159632265568, + 1.0771248508244753, + 0.047147080302238464, + 0.4189951941370964, + 0.19471843726933002, + 0.031581711024045944, + 0.3124603182077408, + 0.28501182049512863, + 1.1438758671283722, + 1.6140242740511894, + 1.2556434869766235, + 1.2518320940434933, + 2.3615876492112875, + 0.15443174168467522, + 0.28951202519237995, + 0.21175789088010788, + 1.074544394388795, + 0.8250544983893633, + 0.2926828656345606, + 0.11449131742119789, + 0.025649355724453926, + 1.0895421504974365, + 0.28431870602071285, + 1.298351138830185, + 0.07172789424657822, + 0.6724762227386236, + 0.8880773950368166 + ], + "unique_experts": 63, + "load_cv": 0.74436152108641, + "normalized_load_entropy": 0.933038584911847, + "max_load_share": 0.05694444444444444 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "72fbc2c282821ed3f90f04e40113934e1266687af426f1d8820453bffac6b446", + "route_weight_sha256": "7e17f9d6e6c5af7976d593b4dabbd31056d77c897dbcf38d5c906707eca5397f", + "loads": [ + 53, + 12, + 20, + 13, + 13, + 19, + 19, + 35, + 3, + 18, + 6, + 9, + 12, + 9, + 17, + 12, + 15, + 13, + 12, + 11, + 13, + 24, + 16, + 6, + 39, + 3, + 0, + 19, + 4, + 5, + 13, + 11, + 24, + 24, + 19, + 18, + 4, + 7, + 13, + 2, + 15, + 6, + 17, + 10, + 7, + 19, + 36, + 18, + 28, + 33, + 5, + 11, + 8, + 24, + 12, + 11, + 3, + 1, + 25, + 10, + 30, + 2, + 21, + 29 + ], + "weighted_loads": [ + 4.347212329506874, + 0.7381062433123589, + 0.949227649718523, + 0.7743858173489571, + 1.1796101486543193, + 1.2827462200075388, + 1.645440150052309, + 3.1483836974948645, + 0.0791479405015707, + 1.3343022970948368, + 0.16802127473056316, + 0.23605998250423, + 2.123003575950861, + 0.6219596806913614, + 0.9697512648999691, + 0.5349806100130081, + 1.1059652846306562, + 0.6818417310714722, + 1.8817125335335732, + 0.6316247321665287, + 0.8692548014223576, + 2.1155850030481815, + 1.1769449040293694, + 0.20277891494333744, + 1.528578070923686, + 0.08441556227626279, + 0.0, + 1.3786629512906075, + 0.11040329746901989, + 0.23004552349448204, + 0.6281975191086531, + 0.3099783807992935, + 0.8299733623862267, + 1.921024851500988, + 2.0518160443753004, + 1.7157242596149445, + 0.3446904197335243, + 0.4723517280071974, + 1.0771248508244753, + 0.09737608209252357, + 0.4941546395421028, + 0.19471843726933002, + 0.8603068497031927, + 0.38612423092126846, + 0.28501182049512863, + 1.4473029896616936, + 4.052860952913761, + 1.2556434869766235, + 2.103090949356556, + 2.825340012088418, + 0.15443174168467522, + 1.0695569273084402, + 0.41356636956334114, + 1.7884720135480165, + 1.9389545153826475, + 0.6143067162483931, + 0.11449131742119789, + 0.025649355724453926, + 1.625116739422083, + 0.31476420909166336, + 1.9595716409385204, + 0.1218995675444603, + 1.1675966996699572, + 1.3366686459630728 + ], + "unique_experts": 63, + "load_cv": 0.6770376277085569, + "normalized_load_entropy": 0.9461055303148409, + "max_load_share": 0.054865424430641824 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 120, + "ordered_topk_exact_tokens": 91, + "set_exact_tokens": 103, + "mean_set_jaccard": 0.9595238095238096, + "mean_token_weighted_tv": 0.008920497470535338, + "aggregate_load_tv": 0.01944444444444444 + }, + "system_bos": { + "tokens": 120, + "ordered_topk_exact_tokens": 72, + "set_exact_tokens": 88, + "mean_set_jaccard": 0.9220238095238095, + "mean_token_weighted_tv": 0.016106041544117034, + "aggregate_load_tv": 0.03472222222222223 + }, + "system_x": { + "tokens": 120, + "ordered_topk_exact_tokens": 55, + "set_exact_tokens": 78, + "mean_set_jaccard": 0.8982142857142857, + "mean_token_weighted_tv": 0.019931451650336385, + "aggregate_load_tv": 0.04305555555555554 + }, + "system_period": { + "tokens": 120, + "ordered_topk_exact_tokens": 63, + "set_exact_tokens": 84, + "mean_set_jaccard": 0.9142857142857144, + "mean_token_weighted_tv": 0.0180365322312961, + "aggregate_load_tv": 0.03333333333333333 + }, + "bos_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 70, + "set_exact_tokens": 80, + "mean_set_jaccard": 0.9029761904761905, + "mean_token_weighted_tv": 0.022159720965040226, + "aggregate_load_tv": 0.04722222222222222 + }, + "bos_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 57, + "set_exact_tokens": 72, + "mean_set_jaccard": 0.8821428571428572, + "mean_token_weighted_tv": 0.025116084166802465, + "aggregate_load_tv": 0.05138888888888889 + }, + "x_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 61, + "set_exact_tokens": 73, + "mean_set_jaccard": 0.8827380952380952, + "mean_token_weighted_tv": 0.025412059125180044, + "aggregate_load_tv": 0.05138888888888889 + }, + "x_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 59, + "set_exact_tokens": 72, + "mean_set_jaccard": 0.8821428571428572, + "mean_token_weighted_tv": 0.02639200636961808, + "aggregate_load_tv": 0.041666666666666664 + }, + "period_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 66, + "set_exact_tokens": 79, + "mean_set_jaccard": 0.8988095238095238, + "mean_token_weighted_tv": 0.023195832789254685, + "aggregate_load_tv": 0.04583333333333332 + }, + "period_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 60, + "set_exact_tokens": 72, + "mean_set_jaccard": 0.8789682539682541, + "mean_token_weighted_tv": 0.027115007614096007, + "aggregate_load_tv": 0.04444444444444445 + } + } + }, + "layer_04": { + "layer": 4, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "b5d535835ad376168d603951a89d25097ef97f0b205713221af34fbafd54bf76", + "route_weight_sha256": "364fdb9618113379d73fa838bf29774897431e98b4a11d95c3e891d1d81a9e7b", + "loads": [ + 19, + 33, + 19, + 19, + 5, + 2, + 5, + 2, + 12, + 18, + 16, + 8, + 9, + 39, + 7, + 9, + 3, + 2, + 20, + 5, + 0, + 22, + 11, + 3, + 3, + 11, + 4, + 12, + 4, + 9, + 5, + 22, + 2, + 7, + 5, + 11, + 8, + 3, + 2, + 10, + 25, + 16, + 10, + 9, + 15, + 19, + 7, + 4, + 24, + 11, + 0, + 13, + 5, + 8, + 22, + 2, + 23, + 4, + 10, + 12, + 52, + 2, + 0, + 21 + ], + "weighted_loads": [ + 0.5948474984616041, + 1.2120805475860834, + 0.8087329436093569, + 1.4218283332884312, + 0.25964265316724777, + 0.08250723592936993, + 0.24675439298152924, + 0.12345616891980171, + 0.577324204146862, + 0.9769761990755796, + 1.607380248606205, + 0.2800421006977558, + 0.40545323491096497, + 2.081604415550828, + 0.3106103725731373, + 0.283135112375021, + 0.4198652543127537, + 0.2775726094841957, + 0.8077341001480818, + 0.2706320881843567, + 0.0, + 0.7771177515387535, + 0.4957680068910122, + 0.1335948035120964, + 0.1835896521806717, + 0.4394654054194689, + 0.16786713153123856, + 0.7572445832192898, + 0.1232087928801775, + 0.595663346350193, + 0.2748544216156006, + 0.8513734303414822, + 0.049966758117079735, + 0.19772983342409134, + 0.3896147944033146, + 0.4568363018333912, + 0.25748647935688496, + 0.09165546484291553, + 0.147380743175745, + 0.39548750780522823, + 3.4203183129429817, + 1.2233309336006641, + 0.5441615972667933, + 0.24891564063727856, + 0.6501831077039242, + 1.0986883733421564, + 0.583993423730135, + 0.5649601072072983, + 1.5101707559078932, + 0.33611746318638325, + 0.0, + 0.45169105008244514, + 0.4032089039683342, + 0.3232569955289364, + 1.5433067586272955, + 0.13603109680116177, + 1.6159488018602133, + 0.1967928633093834, + 0.29932420514523983, + 0.7487113662064075, + 5.102794200181961, + 0.05280233360826969, + 0.0, + 2.0239849872887135 + ], + "unique_experts": 61, + "load_cv": 0.8655263152955754, + "normalized_load_entropy": 0.9186684445605915, + "max_load_share": 0.07222222222222222 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "a29a30c5456fa0d84da6e7ec1ab5e9b4bf4f5be90de814a34596d479ef5313c3", + "route_weight_sha256": "4c2e0ff2922b3147eac0d81e5fdfd264eb0496f7c3068da79e9d872f94ef55a7", + "loads": [ + 19, + 36, + 22, + 23, + 5, + 2, + 6, + 2, + 12, + 18, + 26, + 10, + 9, + 52, + 9, + 12, + 3, + 2, + 24, + 5, + 0, + 24, + 13, + 3, + 3, + 17, + 10, + 13, + 5, + 25, + 5, + 24, + 2, + 9, + 16, + 11, + 8, + 5, + 3, + 10, + 28, + 19, + 18, + 9, + 15, + 21, + 18, + 4, + 25, + 13, + 2, + 13, + 5, + 8, + 22, + 2, + 23, + 4, + 10, + 25, + 56, + 2, + 3, + 22 + ], + "weighted_loads": [ + 0.5948474984616041, + 1.3492665570229292, + 0.9552191309630871, + 1.692388942145044, + 0.25964265316724777, + 0.08250723592936993, + 0.30485666915774345, + 0.12345616891980171, + 0.577324204146862, + 0.9769761990755796, + 2.2673087436705828, + 0.30658108089119196, + 0.40545323491096497, + 3.0062676537781954, + 0.35704335756599903, + 0.4617164023220539, + 0.4198652543127537, + 0.2775726094841957, + 1.0224917450395878, + 0.2706320881843567, + 0.0, + 1.842398814857006, + 0.6058414429426193, + 0.1335948035120964, + 0.1835896521806717, + 0.8744148071855307, + 0.7055311128497124, + 0.7652043476700783, + 0.14851373806595802, + 1.8931635459885001, + 0.2748544216156006, + 0.8823093408718705, + 0.049966758117079735, + 0.2380133755505085, + 1.4408480503770988, + 0.4568363018333912, + 0.25748647935688496, + 0.17303336970508099, + 1.1441310979425907, + 0.39548750780522823, + 3.5607911236584187, + 1.4536441378295422, + 0.9021379761397839, + 0.24891564063727856, + 0.6501831077039242, + 1.2975424509495497, + 1.734056230634451, + 0.5649601072072983, + 1.5470150504261255, + 0.38648896291852, + 0.08656658977270126, + 0.45169105008244514, + 0.4032089039683342, + 0.3232569955289364, + 1.5433067586272955, + 0.13603109680116177, + 1.6159488018602133, + 0.1967928633093834, + 0.29932420514523983, + 1.4638352263718843, + 5.570596845034743, + 0.05280233360826969, + 0.21393197774887085, + 2.0604974813759327 + ], + "unique_experts": 63, + "load_cv": 0.8232549494846485, + "normalized_load_entropy": 0.9250340498562459, + "max_load_share": 0.06436781609195402 + } + }, + "s1_eos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "7eed15c7f3d2cf4aba4bd8331589a588cff9979613128ec2005bfff5c9694672", + "route_weight_sha256": "67e5910d9d933f5e01707224dc2a18b3742d9e81e672d09a5ec6fed5b1e83a8e", + "loads": [ + 17, + 32, + 19, + 19, + 5, + 2, + 5, + 3, + 12, + 18, + 16, + 7, + 8, + 40, + 7, + 9, + 3, + 2, + 20, + 4, + 0, + 26, + 11, + 4, + 3, + 11, + 4, + 12, + 5, + 8, + 5, + 21, + 1, + 8, + 7, + 10, + 9, + 5, + 2, + 9, + 25, + 16, + 10, + 10, + 11, + 19, + 7, + 4, + 24, + 10, + 2, + 14, + 5, + 7, + 21, + 2, + 24, + 4, + 10, + 12, + 52, + 2, + 0, + 20 + ], + "weighted_loads": [ + 0.5251895636320114, + 1.1952922083437443, + 0.8079914432018995, + 1.4384541101753712, + 0.2653878051787615, + 0.0817301981151104, + 0.24507454223930836, + 0.15650279819965363, + 0.5780511237680912, + 0.9625270403921604, + 1.599295251071453, + 0.24657403491437435, + 0.37983230501413345, + 2.0941905956715345, + 0.32057517394423485, + 0.2831718288362026, + 0.41114335134625435, + 0.28467945009469986, + 0.8178102914243937, + 0.22740333527326584, + 0.0, + 0.9029480200260878, + 0.48338125087320805, + 0.17280003800988197, + 0.18860004097223282, + 0.4399791248142719, + 0.16761675663292408, + 0.7498489916324615, + 0.15096281468868256, + 0.5387280620634556, + 0.2814495526254177, + 0.8033007606863976, + 0.021919189020991325, + 0.22828105464577675, + 0.41928120143711567, + 0.4264920949935913, + 0.29424554482102394, + 0.15537060983479023, + 0.14803286269307137, + 0.37332181818783283, + 3.3934114314615726, + 1.2094973362982273, + 0.5426643993705511, + 0.28006107173860073, + 0.5173091515898705, + 1.1342965569347143, + 0.5849097017198801, + 0.565761111676693, + 1.5110392291098833, + 0.3102154769003391, + 0.06099468097090721, + 0.48030656203627586, + 0.39923201501369476, + 0.2959445044398308, + 1.4664376117289066, + 0.13556212186813354, + 1.627404348924756, + 0.19253111630678177, + 0.2882087863981724, + 0.7621660549193621, + 5.14741787314415, + 0.05175585485994816, + 0.0, + 1.9795307293534279 + ], + "unique_experts": 62, + "load_cv": 0.8623825738636558, + "normalized_load_entropy": 0.9213030534407272, + "max_load_share": 0.07222222222222222 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "9f70b867be8eaffda05cc27c6bc7c9f218ad370122074533172d73a428be7e2e", + "route_weight_sha256": "765bf82571c1ed68f3726b89e93a0777fb4c96a012538510b7b7b57e4f2f5ff1", + "loads": [ + 17, + 34, + 23, + 28, + 5, + 2, + 8, + 3, + 12, + 26, + 25, + 9, + 9, + 54, + 10, + 13, + 5, + 4, + 27, + 6, + 1, + 29, + 16, + 5, + 3, + 21, + 13, + 13, + 6, + 28, + 5, + 23, + 1, + 10, + 22, + 10, + 10, + 9, + 5, + 12, + 28, + 22, + 19, + 10, + 13, + 22, + 17, + 8, + 24, + 13, + 5, + 14, + 9, + 11, + 27, + 2, + 29, + 6, + 10, + 26, + 59, + 4, + 4, + 22 + ], + "weighted_loads": [ + 0.5251895636320114, + 1.3113522827625275, + 1.0042016860097647, + 2.183284837024985, + 0.2653878051787615, + 0.0817301981151104, + 0.4584356863051653, + 0.15650279819965363, + 0.5780511237680912, + 2.007609184831381, + 2.1890717558562756, + 0.27297289203852415, + 0.4856988340616226, + 3.079157968983054, + 0.3954625129699707, + 0.5405933186411858, + 0.7724194265902042, + 0.3553504217416048, + 1.3718401950318366, + 0.31753384694457054, + 0.04928259924054146, + 1.999401355162263, + 0.8964177276939154, + 0.2665274403989315, + 0.18860004097223282, + 1.147435698658228, + 0.9798150304704905, + 0.7581187086179852, + 0.174996392801404, + 1.782159836962819, + 0.2814495526254177, + 0.8338825460523367, + 0.021919189020991325, + 0.2689584856852889, + 1.8258381203049794, + 0.4264920949935913, + 0.32146126963198185, + 0.3071280028671026, + 1.3361236788332462, + 0.585278095677495, + 3.553195543587208, + 1.5296585607284214, + 0.9722436424344778, + 0.28006107173860073, + 0.5869366023689508, + 1.2984661640657578, + 1.7740031015127897, + 0.9033478647470474, + 1.5110392291098833, + 0.396740447729826, + 0.19254491850733757, + 0.48030656203627586, + 0.8380507081747055, + 0.47980085015296936, + 2.016316805034876, + 0.13556212186813354, + 2.0508618894964457, + 0.26611250080168247, + 0.2882087863981724, + 1.5564687568694353, + 6.09008664637804, + 0.24802556075155735, + 0.2880217432975769, + 2.0598986595869064 + ], + "unique_experts": 64, + "load_cv": 0.7627791139294465, + "normalized_load_entropy": 0.9360820716454803, + "max_load_share": 0.061076604554865424 + } + }, + "s0_bos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "a30c1aaf8c55986335f66205db850f26907c88dfbd3b0338644b7297b5b8e06f", + "route_weight_sha256": "fd8ef9cb481087172ec83051b882b828b0557ec20963281751ae189a07ec6358", + "loads": [ + 18, + 40, + 18, + 19, + 5, + 2, + 4, + 2, + 10, + 18, + 16, + 8, + 10, + 41, + 8, + 7, + 3, + 2, + 16, + 2, + 0, + 24, + 11, + 3, + 4, + 11, + 4, + 12, + 5, + 7, + 6, + 23, + 2, + 8, + 5, + 8, + 12, + 6, + 3, + 11, + 25, + 16, + 9, + 7, + 11, + 18, + 8, + 4, + 23, + 11, + 0, + 10, + 6, + 8, + 22, + 2, + 21, + 4, + 11, + 14, + 52, + 2, + 1, + 21 + ], + "weighted_loads": [ + 0.5435185171663761, + 1.4703709967434406, + 0.7744362317025661, + 1.4009466841816902, + 0.26717203482985497, + 0.08602684363722801, + 0.2063458189368248, + 0.12158117443323135, + 0.45164929516613483, + 0.9117341227829456, + 1.5530018508434296, + 0.3003832958638668, + 0.43377319164574146, + 2.04357454739511, + 0.34370478615164757, + 0.2297682985663414, + 0.4035758264362812, + 0.2633157968521118, + 0.6303754635155201, + 0.14186635985970497, + 0.0, + 0.8138928823173046, + 0.49091254360973835, + 0.12879928573966026, + 0.2209800910204649, + 0.42982602678239346, + 0.16959374770522118, + 0.7762509472668171, + 0.14899646677076817, + 0.46343822963535786, + 0.31087008863687515, + 0.8960842005908489, + 0.050010452046990395, + 0.2239240575581789, + 0.29877424612641335, + 0.35395925119519234, + 0.3893934581428766, + 0.1837930902838707, + 0.17194479331374168, + 0.4204641245305538, + 3.5477224364876747, + 1.223383978009224, + 0.5313560515642166, + 0.19835341349244118, + 0.5135131813585758, + 1.0115710869431496, + 0.6054712533950806, + 0.5592815354466438, + 1.5199206732213497, + 0.3496409244835377, + 0.0, + 0.3565214481204748, + 0.42409433238208294, + 0.32929763197898865, + 1.488083578646183, + 0.13536708243191242, + 1.551411870867014, + 0.21916089206933975, + 0.33518560603260994, + 0.7669560723006725, + 5.085599780082703, + 0.05418878793716431, + 0.03000130131840706, + 2.0215073712170124 + ], + "unique_experts": 62, + "load_cv": 0.8872206567856502, + "normalized_load_entropy": 0.9182861382271118, + "max_load_share": 0.07222222222222222 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "8d5d6de1e378bc04266bfaeacee7423a5f19049edf0b12481ad83b20d8c87f7b", + "route_weight_sha256": "55f58e9f455c0b24f7ae7cc4716c0d377f6ea1a93f7d9e12c5a00f6a8b119853", + "loads": [ + 18, + 43, + 21, + 24, + 5, + 2, + 5, + 2, + 10, + 18, + 26, + 9, + 10, + 54, + 10, + 10, + 3, + 2, + 21, + 2, + 0, + 25, + 13, + 3, + 4, + 17, + 10, + 12, + 6, + 26, + 6, + 24, + 2, + 9, + 17, + 8, + 12, + 8, + 4, + 11, + 28, + 19, + 17, + 7, + 11, + 20, + 19, + 4, + 24, + 12, + 2, + 10, + 6, + 8, + 22, + 2, + 21, + 4, + 11, + 26, + 57, + 2, + 4, + 22 + ], + "weighted_loads": [ + 0.5435185171663761, + 1.6095970943570137, + 0.9226798806339502, + 1.7298582099901978, + 0.26717203482985497, + 0.08602684363722801, + 0.25882235914468765, + 0.12158117443323135, + 0.45164929516613483, + 0.9117341227829456, + 2.2129303459078074, + 0.31745059229433537, + 0.43377319164574146, + 2.9650542978197336, + 0.3901377711445093, + 0.40689051896333694, + 0.4035758264362812, + 0.2633157968521118, + 0.9888811459240969, + 0.14186635985970497, + 0.0, + 1.1035051457583904, + 0.6032496485859156, + 0.12879928573966026, + 0.2209800910204649, + 0.8745988141745329, + 0.723261158913374, + 0.7762509472668171, + 0.17427773959934711, + 1.9567552292719483, + 0.31087008863687515, + 0.9144811108708382, + 0.050010452046990395, + 0.24928545951843262, + 1.3784187377605122, + 0.35395925119519234, + 0.3893934581428766, + 0.2665373980998993, + 1.1686951480805874, + 0.4204641245305538, + 3.6881952472031116, + 1.4305262044072151, + 0.8893324304372072, + 0.19835341349244118, + 0.5135131813585758, + 1.290992122143507, + 1.7555340602993965, + 0.5592815354466438, + 1.556764967739582, + 0.3776405453681946, + 0.0888085700571537, + 0.3565214481204748, + 0.42409433238208294, + 0.32929763197898865, + 1.488083578646183, + 0.13536708243191242, + 1.551411870867014, + 0.21916089206933975, + 0.33518560603260994, + 1.458727540448308, + 5.750054837350035, + 0.05418878793716431, + 0.2404332496225834, + 2.0579249300062656 + ], + "unique_experts": 63, + "load_cv": 0.849539600041445, + "normalized_load_entropy": 0.9228808028350709, + "max_load_share": 0.06551724137931035 + } + }, + "s1_bos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "e685bb63f7faccf3b84a2f47208f5de31ed34b85e53231e824b13def84cbeca3", + "route_weight_sha256": "f19970ce1b2b3bc7acc98e5d9307f4095001d4a0e10579066413400a34f12765", + "loads": [ + 18, + 38, + 21, + 19, + 5, + 2, + 3, + 2, + 12, + 17, + 16, + 8, + 11, + 40, + 8, + 8, + 3, + 2, + 15, + 5, + 0, + 24, + 11, + 3, + 3, + 12, + 4, + 11, + 5, + 6, + 6, + 22, + 1, + 11, + 5, + 10, + 10, + 5, + 2, + 9, + 25, + 16, + 9, + 8, + 12, + 19, + 7, + 3, + 23, + 12, + 0, + 10, + 6, + 10, + 22, + 2, + 21, + 4, + 9, + 15, + 52, + 2, + 0, + 20 + ], + "weighted_loads": [ + 0.5407835524529219, + 1.368543529883027, + 0.8647386077791452, + 1.4133071415126324, + 0.2695129029452801, + 0.08673182129859924, + 0.15195604600012302, + 0.12367858737707138, + 0.5404754634946585, + 0.8653453383594751, + 1.5569779723882675, + 0.30047889798879623, + 0.47991594299674034, + 1.9991209991276264, + 0.34641624242067337, + 0.2600742019712925, + 0.39951182529330254, + 0.250972680747509, + 0.6025867220014334, + 0.2587142437696457, + 0.0, + 0.8136494625359774, + 0.48175649158656597, + 0.13377997279167175, + 0.1928657740354538, + 0.453553082421422, + 0.16891097649931908, + 0.7567636854946613, + 0.14563724398612976, + 0.4034723211079836, + 0.3116135150194168, + 0.8562782555818558, + 0.023954587057232857, + 0.31120670959353447, + 0.2813645005226135, + 0.4090009368956089, + 0.31720064021646976, + 0.15395832620561123, + 0.1375601403415203, + 0.38261656276881695, + 3.533011645078659, + 1.23615100979805, + 0.5256942696869373, + 0.22517071291804314, + 0.5509420242160559, + 1.047672402113676, + 0.562021417543292, + 0.5376359224319458, + 1.5218299962580204, + 0.3445918969810009, + 0.0, + 0.37927052937448025, + 0.4083237126469612, + 0.38647573813796043, + 1.4962756745517254, + 0.13394725508987904, + 1.5309225805103779, + 0.2126699946820736, + 0.28392404690384865, + 0.8034396134316921, + 5.164110034704208, + 0.05167717486619949, + 0.0, + 1.988326221704483 + ], + "unique_experts": 61, + "load_cv": 0.8796744627950883, + "normalized_load_entropy": 0.9171688562352747, + "max_load_share": 0.07222222222222222 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "219ae5cd6601058fb9e7e42decb50f1537a020ec6ec295c30e5f57cad31ee1a4", + "route_weight_sha256": "6bbac144fcf9864506374ba7d6ab298ac7d92061e62744b3c4bb0ffea27a121f", + "loads": [ + 18, + 40, + 25, + 29, + 5, + 2, + 6, + 2, + 12, + 25, + 25, + 9, + 12, + 54, + 11, + 12, + 5, + 4, + 23, + 7, + 1, + 26, + 16, + 4, + 3, + 22, + 13, + 11, + 6, + 28, + 6, + 23, + 1, + 12, + 21, + 10, + 11, + 9, + 5, + 12, + 28, + 22, + 18, + 8, + 14, + 22, + 18, + 7, + 23, + 14, + 3, + 10, + 10, + 14, + 28, + 2, + 26, + 6, + 9, + 28, + 60, + 4, + 4, + 22 + ], + "weighted_loads": [ + 0.5407835524529219, + 1.4886882398277521, + 1.0615435522049665, + 2.215618620830355, + 0.2695129029452801, + 0.08673182129859924, + 0.34742691554129124, + 0.12367858737707138, + 0.5404754634946585, + 1.9104274827986956, + 2.14675447717309, + 0.3175461944192648, + 0.5857824720442295, + 2.9773922078311443, + 0.4213035814464092, + 0.5272929556667805, + 0.7607879005372524, + 0.32164365239441395, + 1.288406026782468, + 0.3488447554409504, + 0.04928259924054146, + 1.143492056056857, + 0.8911715876311064, + 0.22750737518072128, + 0.1928657740354538, + 1.1411249805241823, + 1.010917067527771, + 0.7567636854946613, + 0.17021039314568043, + 1.7439474649727345, + 0.3116135150194168, + 0.874675165861845, + 0.023954587057232857, + 0.3365681115537882, + 1.67013688350562, + 0.4090009368956089, + 0.3444163650274277, + 0.30818271450698376, + 1.3256509564816952, + 0.5945728402584791, + 3.692795757204294, + 1.566743989562383, + 0.955273512750864, + 0.22517071291804314, + 0.6205694749951363, + 1.216950782953063, + 1.7993002738803625, + 0.8752226755023003, + 1.5218299962580204, + 0.40824464336037636, + 0.13229504972696304, + 0.37927052937448025, + 0.847142405807972, + 0.570332083851099, + 2.0461548678576946, + 0.13394725508987904, + 1.9543801210820675, + 0.2862513791769743, + 0.28392404690384865, + 1.5733584016561508, + 6.332439132034779, + 0.24794688075780869, + 0.29413288086652756, + 2.0699990876019 + ], + "unique_experts": 64, + "load_cv": 0.7765024083733214, + "normalized_load_entropy": 0.9338331853824722, + "max_load_share": 0.062111801242236024 + } + }, + "s0_x": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "7b90b196ea90ffcb1981c4c6af53dc273e00e972faadc061962a7e9cb00f4d8f", + "route_weight_sha256": "91fe3b245c9defc40b55fde4c005439b970af37dc5ed7f87e509f234ebc4610e", + "loads": [ + 18, + 39, + 19, + 19, + 5, + 2, + 4, + 2, + 10, + 18, + 16, + 8, + 11, + 41, + 8, + 7, + 3, + 2, + 17, + 3, + 0, + 23, + 11, + 3, + 3, + 13, + 4, + 11, + 4, + 7, + 5, + 23, + 1, + 7, + 5, + 9, + 9, + 4, + 2, + 10, + 25, + 16, + 9, + 7, + 12, + 19, + 8, + 3, + 25, + 11, + 0, + 11, + 6, + 9, + 22, + 2, + 21, + 4, + 14, + 14, + 52, + 2, + 1, + 21 + ], + "weighted_loads": [ + 0.5456726755946875, + 1.4235579036176205, + 0.8003389202058315, + 1.4766408577561378, + 0.26391814462840557, + 0.08637651801109314, + 0.19822147488594055, + 0.11715623363852501, + 0.4409191254526377, + 0.9141609445214272, + 1.5945607982575893, + 0.2873331606388092, + 0.46833116188645363, + 2.100943863391876, + 0.3454819284379482, + 0.2212143950164318, + 0.4011128582060337, + 0.2616063728928566, + 0.712024787440896, + 0.18018554896116257, + 0.0, + 0.7906677182763815, + 0.5024556405842304, + 0.12713168375194073, + 0.19092252850532532, + 0.47419508546590805, + 0.17396024987101555, + 0.7931480929255486, + 0.12030413746833801, + 0.3669274002313614, + 0.28251076489686966, + 0.8876315094530582, + 0.023131607100367546, + 0.20795810595154762, + 0.2893447056412697, + 0.40393567830324173, + 0.28398781456053257, + 0.11984572187066078, + 0.13204849883913994, + 0.395887752994895, + 3.5113702192902565, + 1.25000511854887, + 0.5433415323495865, + 0.19584229588508606, + 0.5583379175513983, + 1.0325669534504414, + 0.6213001478463411, + 0.5145752169191837, + 1.6256902366876602, + 0.35009455494582653, + 0.0, + 0.37355976179242134, + 0.4366771876811981, + 0.36551027186214924, + 1.484862893819809, + 0.14077556692063808, + 1.5350706279277802, + 0.22148987278342247, + 0.4257234204560518, + 0.7980953175574541, + 5.100810933858156, + 0.052123915404081345, + 0.029232719913125038, + 2.0365851167589426 + ], + "unique_experts": 62, + "load_cv": 0.895530741315995, + "normalized_load_entropy": 0.9152890381811618, + "max_load_share": 0.07222222222222222 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "451a08e2306d60d01aec5f435e7583a82566b3ad399846bf65d210aef42f7c84", + "route_weight_sha256": "1fec199b4848258c59ccefab7b88ad622307cb4aa9336908aec5111222720393", + "loads": [ + 18, + 43, + 23, + 23, + 5, + 2, + 4, + 2, + 10, + 18, + 27, + 9, + 11, + 53, + 10, + 10, + 3, + 2, + 21, + 3, + 0, + 24, + 13, + 3, + 3, + 19, + 10, + 11, + 5, + 24, + 5, + 24, + 1, + 8, + 15, + 9, + 9, + 6, + 3, + 10, + 29, + 19, + 18, + 7, + 12, + 21, + 21, + 3, + 27, + 12, + 2, + 11, + 6, + 9, + 22, + 2, + 21, + 4, + 14, + 27, + 56, + 2, + 4, + 22 + ], + "weighted_loads": [ + 0.5456726755946875, + 1.6062193401157856, + 0.9784552939236164, + 1.7559891433047596, + 0.26391814462840557, + 0.08637651801109314, + 0.19822147488594055, + 0.11715623363852501, + 0.4409191254526377, + 0.9141609445214272, + 2.4700950291007757, + 0.30440045706927776, + 0.46833116188645363, + 2.97939932346344, + 0.39191491343081, + 0.4086676277220249, + 0.4011128582060337, + 0.2616063728928566, + 0.9162986831215676, + 0.18018554896116257, + 0.0, + 1.0802799817174673, + 0.619950108230114, + 0.12713168375194073, + 0.19092252850532532, + 0.8541541025042534, + 0.7711114473640919, + 0.7931480929255486, + 0.14520223625004292, + 1.622550773434341, + 0.28251076489686966, + 0.9060284197330475, + 0.023131607100367546, + 0.23331950791180134, + 1.1415935845288914, + 0.40393567830324173, + 0.28398781456053257, + 0.2028529867529869, + 1.1287988536059856, + 0.395887752994895, + 3.7082427702844143, + 1.4667236879467964, + 0.9367896001785994, + 0.19584229588508606, + 0.5583379175513983, + 1.2826767191290855, + 2.0166598204523325, + 0.5145752169191837, + 1.705847181379795, + 0.37809417583048344, + 0.09049541503190994, + 0.37355976179242134, + 0.4366771876811981, + 0.36551027186214924, + 1.484862893819809, + 0.14077556692063808, + 1.5350706279277802, + 0.22148987278342247, + 0.4257234204560518, + 1.5720756091177464, + 5.564901684556389, + 0.052123915404081345, + 0.23086839728057384, + 2.0735630858689547 + ], + "unique_experts": 63, + "load_cv": 0.855688263647956, + "normalized_load_entropy": 0.9200893734804029, + "max_load_share": 0.06436781609195402 + } + }, + "s1_x": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "868df8b82ca389680989c88e0d2ab9c1f63cbc6fde85fb92f8e374e05add53a3", + "route_weight_sha256": "a410d08cd5c1fadd9bfc47a30baadc34177feaaa1385c41af699c7c1886717df", + "loads": [ + 18, + 37, + 20, + 19, + 5, + 2, + 3, + 2, + 12, + 17, + 16, + 8, + 10, + 41, + 7, + 6, + 3, + 2, + 16, + 5, + 0, + 24, + 11, + 3, + 3, + 12, + 4, + 11, + 6, + 3, + 6, + 21, + 1, + 8, + 5, + 10, + 11, + 2, + 2, + 12, + 25, + 16, + 9, + 9, + 15, + 19, + 9, + 3, + 24, + 13, + 0, + 10, + 5, + 9, + 22, + 2, + 21, + 4, + 10, + 16, + 52, + 2, + 0, + 21 + ], + "weighted_loads": [ + 0.5395677704364061, + 1.3386131338775158, + 0.8366766255348921, + 1.4805767312645912, + 0.2693957947194576, + 0.08723333477973938, + 0.1340077482163906, + 0.12059982493519783, + 0.5328426193445921, + 0.8805500976741314, + 1.5727487653493881, + 0.2912079617381096, + 0.45362272299826145, + 2.076804842799902, + 0.31934014335274696, + 0.19781452789902687, + 0.3885866068303585, + 0.24720213562250137, + 0.6774447523057461, + 0.26058144494891167, + 0.0, + 0.8197599686682224, + 0.4855774771422148, + 0.13152994588017464, + 0.19433395937085152, + 0.45502085983753204, + 0.17127511277794838, + 0.7817609086632729, + 0.17031168192625046, + 0.22468125820159912, + 0.3096255250275135, + 0.8245864734053612, + 0.02389407530426979, + 0.22863035276532173, + 0.26122596859931946, + 0.4173453710973263, + 0.3434318080544472, + 0.054339366033673286, + 0.13349632918834686, + 0.45351199992001057, + 3.5002922117710114, + 1.2653831727802753, + 0.5465067215263844, + 0.24833586066961288, + 0.6578380782157183, + 1.0637362785637379, + 0.6375241633504629, + 0.528916135430336, + 1.584462396800518, + 0.38544053211808205, + 0.0, + 0.3785107899457216, + 0.3902677968144417, + 0.35803219489753246, + 1.4861731361597776, + 0.13700921274721622, + 1.5239468030631542, + 0.21002816408872604, + 0.31901345029473305, + 0.8693145327270031, + 5.23457645252347, + 0.04901048541069031, + 0.0, + 2.0186503175646067 + ], + "unique_experts": 61, + "load_cv": 0.8895830622776931, + "normalized_load_entropy": 0.9143116769907513, + "max_load_share": 0.07222222222222222 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "0e96218c5cee28c5c426d64980da4500803ee72d0208450dbd3708da935235bb", + "route_weight_sha256": "103e7b7df948fbc64556eede0d9afd1a1dcdf87ee1ee2233162e9247b172205f", + "loads": [ + 18, + 40, + 25, + 28, + 5, + 2, + 5, + 2, + 12, + 25, + 26, + 9, + 11, + 54, + 10, + 10, + 5, + 4, + 23, + 7, + 1, + 26, + 16, + 4, + 3, + 22, + 13, + 11, + 6, + 22, + 6, + 22, + 1, + 9, + 20, + 10, + 13, + 6, + 6, + 15, + 29, + 22, + 19, + 9, + 17, + 22, + 21, + 7, + 24, + 15, + 3, + 10, + 9, + 13, + 28, + 2, + 26, + 6, + 10, + 30, + 60, + 4, + 4, + 23 + ], + "weighted_loads": [ + 0.5395677704364061, + 1.5039946772158146, + 1.0687058921903372, + 2.234689294564305, + 0.2693957947194576, + 0.08723333477973938, + 0.2793874032795429, + 0.12059982493519783, + 0.5328426193445921, + 1.9256322421133518, + 2.352406296879053, + 0.30827525816857815, + 0.5594892520457506, + 3.0135411471128464, + 0.3942274823784828, + 0.46792274340987206, + 0.7498626820743084, + 0.3178731072694063, + 1.209181296871975, + 0.35071195662021637, + 0.04928259924054146, + 1.1496025621891022, + 0.8957965392619371, + 0.22525734826922417, + 0.19433395937085152, + 1.089805979281664, + 1.052643034607172, + 0.7817609086632729, + 0.17031168192625046, + 1.3106309492141008, + 0.3096255250275135, + 0.8429833836853504, + 0.02389407530426979, + 0.25399175472557545, + 1.4527879726374522, + 0.4173453710973263, + 0.39619761891663074, + 0.2087175752967596, + 1.3739362359046936, + 0.6654682774096727, + 3.7137411236763, + 1.62671954286634, + 1.016318403184414, + 0.24833586066961288, + 0.7274655289947987, + 1.1895149363263045, + 2.0820034462958574, + 0.8665028885006905, + 1.584462396800518, + 0.4490932784974575, + 0.13350795209407806, + 0.3785107899457216, + 0.8290864899754524, + 0.541888540610671, + 2.036052329465747, + 0.13700921274721622, + 1.9474043436348438, + 0.28360954858362675, + 0.31901345029473305, + 1.73546976223588, + 6.227435555309057, + 0.2452801913022995, + 0.28165601566433907, + 2.0999455880373716 + ], + "unique_experts": 64, + "load_cv": 0.7796756192815824, + "normalized_load_entropy": 0.9330415615747102, + "max_load_share": 0.062111801242236024 + } + }, + "s0_period": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "7446a6d107fabbe2bc1d95e60cc92f96820b241767c8305346b7c86191a81f78", + "route_weight_sha256": "5e6a742be2599ca0e613ca7bcd96ec4dd0589fb6fe6310ed386b9fc1e7793fc2", + "loads": [ + 19, + 39, + 20, + 19, + 5, + 2, + 4, + 2, + 10, + 18, + 16, + 8, + 10, + 40, + 8, + 7, + 3, + 2, + 17, + 3, + 0, + 25, + 11, + 3, + 3, + 13, + 5, + 11, + 6, + 5, + 5, + 22, + 1, + 7, + 5, + 9, + 10, + 2, + 2, + 11, + 25, + 16, + 9, + 7, + 14, + 19, + 7, + 4, + 24, + 11, + 0, + 10, + 6, + 8, + 22, + 2, + 21, + 4, + 14, + 13, + 52, + 2, + 1, + 21 + ], + "weighted_loads": [ + 0.5803370233625174, + 1.4274602066725492, + 0.8365461193025112, + 1.4815132766962051, + 0.26266295835375786, + 0.08485572040081024, + 0.2000749073922634, + 0.11947935819625854, + 0.4425890017300844, + 0.9175791181623936, + 1.5818109884858131, + 0.29071614518761635, + 0.4400522857904434, + 2.057838486507535, + 0.34713305346667767, + 0.222990483045578, + 0.3995303809642792, + 0.26350655406713486, + 0.720872787758708, + 0.17976457625627518, + 0.0, + 0.850284319370985, + 0.5037262607365847, + 0.12741155549883842, + 0.19246888160705566, + 0.46831561625003815, + 0.19742021523416042, + 0.7871130704879761, + 0.17334256321191788, + 0.30633383989334106, + 0.28331029042601585, + 0.8603329788893461, + 0.02301575057208538, + 0.20915332064032555, + 0.2974950671195984, + 0.4005311578512192, + 0.3129497151821852, + 0.05655648000538349, + 0.1261121965944767, + 0.4246265646070242, + 3.4865626469254494, + 1.2395011074841022, + 0.5392493531107903, + 0.19628014788031578, + 0.6247018463909626, + 1.0343033000826836, + 0.5764137040823698, + 0.5596536435186863, + 1.5954464934766293, + 0.34899329394102097, + 0.0, + 0.3510715067386627, + 0.44078770838677883, + 0.32480537332594395, + 1.4833736810833216, + 0.13716137036681175, + 1.5408869255334139, + 0.22397232055664062, + 0.4264758825302124, + 0.7754840105772018, + 5.0683240480721, + 0.051975300535559654, + 0.02931743860244751, + 2.0221460964530706 + ], + "unique_experts": 62, + "load_cv": 0.8947032061865509, + "normalized_load_entropy": 0.9150467585580976, + "max_load_share": 0.07222222222222222 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "a274857758f8a7efec155a2d4499a4a6448c2ea606ded404e329aaa84c5dcdcd", + "route_weight_sha256": "fc97c1527d5136e689a66466eaacb25aeb2dec61f4aa13213fc23cd0691b9ba2", + "loads": [ + 19, + 43, + 23, + 23, + 5, + 2, + 4, + 2, + 10, + 18, + 26, + 9, + 10, + 52, + 10, + 10, + 3, + 2, + 21, + 3, + 0, + 26, + 14, + 3, + 3, + 19, + 12, + 11, + 6, + 23, + 5, + 23, + 1, + 8, + 15, + 9, + 11, + 4, + 3, + 11, + 28, + 19, + 17, + 7, + 14, + 21, + 19, + 4, + 26, + 12, + 2, + 11, + 7, + 8, + 22, + 2, + 21, + 4, + 14, + 26, + 56, + 2, + 4, + 22 + ], + "weighted_loads": [ + 0.5803370233625174, + 1.6185319554060698, + 0.9840870946645737, + 1.7626937568711583, + 0.26266295835375786, + 0.08485572040081024, + 0.2000749073922634, + 0.11947935819625854, + 0.4425890017300844, + 0.9175791181623936, + 2.241739483550191, + 0.3077834416180849, + 0.4400522857904434, + 2.9151206631213427, + 0.3935660384595394, + 0.39343398809432983, + 0.3995303809642792, + 0.26350655406713486, + 0.9255501249281224, + 0.17976457625627518, + 0.0, + 1.1398965828120708, + 0.6553888227790594, + 0.12741155549883842, + 0.19246888160705566, + 0.8307604566216469, + 1.0660717654973269, + 0.7871130704879761, + 0.17334256321191788, + 1.5859048729762435, + 0.28331029042601585, + 0.8787298891693354, + 0.02301575057208538, + 0.23451472260057926, + 1.1373077088210266, + 0.4005311578512192, + 0.33886877447366714, + 0.13981215842068195, + 1.1228625513613224, + 0.4246265646070242, + 3.6270354576408863, + 1.4471644014120102, + 0.8972257319837809, + 0.19628014788031578, + 0.6247018463909626, + 1.3073098324239254, + 1.886750852689147, + 0.5596536435186863, + 1.6869309023022652, + 0.37699291482567787, + 0.08952909708023071, + 0.476139634847641, + 0.505585765466094, + 0.32480537332594395, + 1.4833736810833216, + 0.13716137036681175, + 1.5408869255334139, + 0.22397232055664062, + 0.4264758825302124, + 1.553919667378068, + 5.52573484662571, + 0.051975300535559654, + 0.23001781851053238, + 2.0585697684437037 + ], + "unique_experts": 63, + "load_cv": 0.8439474655531322, + "normalized_load_entropy": 0.9218442909486408, + "max_load_share": 0.06436781609195402 + } + }, + "s1_period": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "8651c4e748e04d3f74f1165d42c711c6f8bd1349ff32b2c0812b1c38a3a76964", + "route_weight_sha256": "4d3d712c488dee50a28fb8d46b643fb0abd909ee2b3807658818e34b3b88b3f0", + "loads": [ + 18, + 37, + 20, + 19, + 5, + 2, + 3, + 2, + 13, + 17, + 16, + 8, + 11, + 41, + 7, + 6, + 3, + 2, + 17, + 5, + 0, + 22, + 11, + 3, + 3, + 12, + 4, + 11, + 6, + 4, + 6, + 21, + 1, + 7, + 5, + 11, + 11, + 2, + 2, + 12, + 25, + 16, + 9, + 9, + 15, + 19, + 9, + 3, + 24, + 10, + 0, + 9, + 5, + 10, + 22, + 2, + 22, + 4, + 11, + 15, + 52, + 2, + 0, + 21 + ], + "weighted_loads": [ + 0.5443859919905663, + 1.3405264895409346, + 0.8428569678217173, + 1.458411742001772, + 0.2674986757338047, + 0.0866457000374794, + 0.13280978240072727, + 0.12206156551837921, + 0.5706176683306694, + 0.88471470028162, + 1.569978304207325, + 0.29046815261244774, + 0.48205326683819294, + 2.0494433771818876, + 0.3203117251396179, + 0.19805744290351868, + 0.3905485011637211, + 0.24938064813613892, + 0.6935624349862337, + 0.2597472071647644, + 0.0, + 0.7492850515991449, + 0.48183547519147396, + 0.12943016178905964, + 0.1951378770172596, + 0.44621957652270794, + 0.17112579569220543, + 0.7883177176117897, + 0.1713197212666273, + 0.24863086454570293, + 0.31031204015016556, + 0.8333758357912302, + 0.02385145053267479, + 0.20741805247962475, + 0.2509947158396244, + 0.45123264752328396, + 0.34890837222337723, + 0.054353976622223854, + 0.12911343201994896, + 0.45520935766398907, + 3.4914200082421303, + 1.2550018802285194, + 0.5419218428432941, + 0.24974998645484447, + 0.6589989773929119, + 1.0636141076683998, + 0.6262423936277628, + 0.5307174436748028, + 1.5797588862478733, + 0.30153040401637554, + 0.0, + 0.3443421870470047, + 0.3854838125407696, + 0.38647864758968353, + 1.4847511891275644, + 0.13710592687129974, + 1.5429288260638714, + 0.21281953528523445, + 0.3459877874702215, + 0.8534811232239008, + 5.191874608397484, + 0.04831536486744881, + 0.0, + 2.002267984673381 + ], + "unique_experts": 61, + "load_cv": 0.8870814958316477, + "normalized_load_entropy": 0.9148609406433826, + "max_load_share": 0.07222222222222222 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "71f3ddb8d7348a721f89d30a94501c72204559693eb9c63a8eb82777b9d5c9e9", + "route_weight_sha256": "ce2ddf934e6551290775202e309099c23e4ce69f72469947a40e0860cecf9689", + "loads": [ + 18, + 40, + 23, + 28, + 5, + 2, + 5, + 2, + 13, + 25, + 25, + 9, + 12, + 54, + 10, + 10, + 5, + 4, + 24, + 7, + 1, + 24, + 17, + 4, + 3, + 22, + 14, + 11, + 6, + 23, + 6, + 22, + 1, + 8, + 19, + 11, + 14, + 7, + 6, + 15, + 28, + 22, + 18, + 9, + 17, + 22, + 20, + 7, + 24, + 12, + 3, + 10, + 10, + 14, + 28, + 2, + 27, + 6, + 11, + 29, + 60, + 4, + 4, + 24 + ], + "weighted_loads": [ + 0.5443859919905663, + 1.4943082127720118, + 1.0137400720268488, + 2.2133910387929063, + 0.2674986757338047, + 0.0866457000374794, + 0.2781894374638796, + 0.12206156551837921, + 0.5706176683306694, + 1.9297968447208405, + 2.1597548089921474, + 0.3075354490429163, + 0.5879197958856821, + 2.961148427799344, + 0.3951990641653538, + 0.47547831013798714, + 0.751824576407671, + 0.32005161978304386, + 1.2244287666399032, + 0.3498777188360691, + 0.04928259924054146, + 1.0791276451200247, + 0.9238789062947035, + 0.22315756417810917, + 0.1951378770172596, + 1.0521930176764727, + 1.3526185117661953, + 0.7883177176117897, + 0.1713197212666273, + 1.3222727999091148, + 0.31031204015016556, + 0.8517727460712194, + 0.02385145053267479, + 0.23277945443987846, + 1.3845185484969988, + 0.45123264752328396, + 0.42996908351778984, + 0.2507535759359598, + 1.3742941804230213, + 0.6671656351536512, + 3.6512041203677654, + 1.6288847970718052, + 0.9715010859072208, + 0.24974998645484447, + 0.7286264281719923, + 1.1915716877265368, + 1.9220986422151327, + 0.8683041967451572, + 1.5797588862478733, + 0.365183150395751, + 0.1325853355228901, + 0.44017499685287476, + 0.8769418373703957, + 0.5703349933028221, + 2.0346303824335337, + 0.13710592687129974, + 1.966386366635561, + 0.28640091978013515, + 0.3459877874702215, + 1.7759622801095247, + 6.183490257710218, + 0.244585070759058, + 0.29540183395147324, + 2.1138839591294527 + ], + "unique_experts": 64, + "load_cv": 0.773050064587867, + "normalized_load_entropy": 0.9341639334185575, + "max_load_share": 0.062111801242236024 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 120, + "ordered_topk_exact_tokens": 81, + "set_exact_tokens": 93, + "mean_set_jaccard": 0.9357142857142857, + "mean_token_weighted_tv": 0.010587781434878707, + "aggregate_load_tv": 0.026388888888888882 + }, + "system_bos": { + "tokens": 120, + "ordered_topk_exact_tokens": 73, + "set_exact_tokens": 87, + "mean_set_jaccard": 0.9178571428571429, + "mean_token_weighted_tv": 0.014256054729533693, + "aggregate_load_tv": 0.03194444444444444 + }, + "system_x": { + "tokens": 120, + "ordered_topk_exact_tokens": 58, + "set_exact_tokens": 80, + "mean_set_jaccard": 0.8994047619047618, + "mean_token_weighted_tv": 0.01758272882240514, + "aggregate_load_tv": 0.034722222222222224 + }, + "system_period": { + "tokens": 120, + "ordered_topk_exact_tokens": 62, + "set_exact_tokens": 81, + "mean_set_jaccard": 0.9017857142857143, + "mean_token_weighted_tv": 0.01770694488659501, + "aggregate_load_tv": 0.030555555555555555 + }, + "bos_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 48, + "set_exact_tokens": 75, + "mean_set_jaccard": 0.8910714285714286, + "mean_token_weighted_tv": 0.02050752176437527, + "aggregate_load_tv": 0.04583333333333332 + }, + "bos_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 47, + "set_exact_tokens": 71, + "mean_set_jaccard": 0.874404761904762, + "mean_token_weighted_tv": 0.022909036821996173, + "aggregate_load_tv": 0.04583333333333333 + }, + "x_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 53, + "set_exact_tokens": 80, + "mean_set_jaccard": 0.9011904761904762, + "mean_token_weighted_tv": 0.020835859553577998, + "aggregate_load_tv": 0.03888888888888888 + }, + "x_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 47, + "set_exact_tokens": 64, + "mean_set_jaccard": 0.8595238095238096, + "mean_token_weighted_tv": 0.02597381394201269, + "aggregate_load_tv": 0.05138888888888889 + }, + "period_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 50, + "set_exact_tokens": 77, + "mean_set_jaccard": 0.8958333333333334, + "mean_token_weighted_tv": 0.020808499112414818, + "aggregate_load_tv": 0.03888888888888888 + }, + "period_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 49, + "set_exact_tokens": 65, + "mean_set_jaccard": 0.8619047619047621, + "mean_token_weighted_tv": 0.02576748242136091, + "aggregate_load_tv": 0.05277777777777777 + } + } + }, + "layer_05": { + "layer": 5, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "e37694f70bfc2ccf1a747bc761026d357a30d2639763be4491d5d2a25dd3057a", + "route_weight_sha256": "ff99bd2b8602334ba140a05ceed345d06ee1ee0642764d2099c6d096b48297a7", + "loads": [ + 8, + 21, + 12, + 3, + 1, + 17, + 14, + 6, + 8, + 9, + 10, + 22, + 12, + 11, + 11, + 11, + 0, + 12, + 27, + 3, + 4, + 13, + 10, + 2, + 3, + 22, + 11, + 5, + 11, + 4, + 1, + 14, + 17, + 2, + 12, + 13, + 9, + 18, + 17, + 8, + 16, + 11, + 6, + 11, + 6, + 18, + 0, + 14, + 10, + 15, + 11, + 4, + 9, + 24, + 14, + 13, + 17, + 16, + 26, + 14, + 11, + 6, + 22, + 12 + ], + "weighted_loads": [ + 0.33145671896636486, + 1.9300042483955622, + 0.5273568406701088, + 0.18319487944245338, + 0.040905024856328964, + 0.7869300339370966, + 0.619601234793663, + 0.2660796046257019, + 0.36240994557738304, + 0.33525367081165314, + 0.5829746946692467, + 0.8907731305807829, + 0.7007823176681995, + 0.4548991434276104, + 0.5903252549469471, + 1.154179386794567, + 0.0, + 0.9173148758709431, + 1.3816826101392508, + 0.13270053640007973, + 0.13065281324088573, + 0.9222920797765255, + 0.36017660051584244, + 0.18674876168370247, + 0.304855614900589, + 1.7946840412914753, + 0.3784082382917404, + 0.3521083742380142, + 0.40055021084845066, + 0.3404914103448391, + 0.07142407447099686, + 0.4817032925784588, + 0.6078079808503389, + 0.08566275611519814, + 0.8556778728961945, + 0.9389603193849325, + 0.44564011320471764, + 1.9093955010175705, + 1.477932509034872, + 0.47108311392366886, + 2.0805729180574417, + 0.6134090572595596, + 0.2787764295935631, + 0.5625460930168629, + 0.3872599322348833, + 1.1517230048775673, + 0.0, + 0.5480634458363056, + 0.6194320283830166, + 0.5726357661187649, + 1.3376168124377728, + 0.15969195030629635, + 0.25667842850089073, + 1.372412672266364, + 0.4967724736779928, + 0.5662582777440548, + 0.9298074562102556, + 0.7859148476272821, + 1.0514930747449398, + 0.7861759103834629, + 1.2756524682044983, + 0.22880252823233604, + 0.9866696689277887, + 1.2358571626245975 + ], + "unique_experts": 62, + "load_cv": 0.5665577237325317, + "normalized_load_entropy": 0.9561804987237943, + "max_load_share": 0.0375 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "048934d0e3e7c2acc5fd215480841ede03982b206284add96b226373c3a720b0", + "route_weight_sha256": "6570a00cc30d1ca87e6c0d5817e664be28e1338b08ee3872ca3fd9c80c37c960", + "loads": [ + 8, + 22, + 12, + 3, + 2, + 19, + 16, + 8, + 9, + 10, + 21, + 22, + 15, + 11, + 11, + 24, + 2, + 18, + 36, + 4, + 6, + 14, + 10, + 2, + 3, + 30, + 11, + 5, + 11, + 4, + 1, + 14, + 17, + 2, + 12, + 17, + 9, + 18, + 28, + 16, + 21, + 19, + 13, + 12, + 7, + 18, + 0, + 16, + 10, + 18, + 19, + 4, + 11, + 33, + 17, + 22, + 17, + 16, + 26, + 15, + 11, + 6, + 22, + 14 + ], + "weighted_loads": [ + 0.33145671896636486, + 1.9335080492310226, + 0.5273568406701088, + 0.18319487944245338, + 0.042664221255108714, + 0.8551640938967466, + 0.6844742111861706, + 0.3081406482961029, + 0.36576366308145225, + 0.3397761592641473, + 1.242014404386282, + 0.8907731305807829, + 0.8830328062176704, + 0.4548991434276104, + 0.5903252549469471, + 3.330058973748237, + 0.1551738753914833, + 1.2145841009914875, + 2.136735050007701, + 0.14576051104813814, + 0.14611137541942298, + 0.9621457457542419, + 0.36017660051584244, + 0.18674876168370247, + 0.304855614900589, + 2.6985243186354637, + 0.3784082382917404, + 0.3521083742380142, + 0.40055021084845066, + 0.3404914103448391, + 0.07142407447099686, + 0.4817032925784588, + 0.6078079808503389, + 0.08566275611519814, + 0.8556778728961945, + 1.251700596883893, + 0.44564011320471764, + 1.9093955010175705, + 2.5803872980177402, + 1.137598155066371, + 2.287684343755245, + 1.439839668571949, + 0.7096249051392078, + 0.6060234382748604, + 0.4685765001922846, + 1.1517230048775673, + 0.0, + 0.5660214165691286, + 0.6194320283830166, + 0.7003642646595836, + 2.032379664480686, + 0.15969195030629635, + 1.8862001560628414, + 1.9673007037490606, + 0.5136248695198447, + 1.2567454017698765, + 0.9298074562102556, + 0.7859148476272821, + 1.0514930747449398, + 0.831958144903183, + 1.2756524682044983, + 0.22880252823233604, + 0.9866696689277887, + 2.1716306917369366 + ], + "unique_experts": 63, + "load_cv": 0.5855845242470583, + "normalized_load_entropy": 0.9548777994639698, + "max_load_share": 0.041379310344827586 + } + }, + "s1_eos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "c12e290d45745547529bada2d696ac44706d8aa4b02813e7a26f899ac565cb76", + "route_weight_sha256": "3e2c25122e1dbc3d90dd7ebb9cf024d365a6a9e71f0a222792ea72fdcc6dfd32", + "loads": [ + 5, + 21, + 13, + 3, + 1, + 19, + 16, + 6, + 8, + 12, + 12, + 22, + 12, + 12, + 11, + 11, + 0, + 13, + 26, + 1, + 5, + 13, + 9, + 2, + 3, + 22, + 10, + 6, + 7, + 5, + 1, + 14, + 15, + 4, + 12, + 13, + 9, + 18, + 17, + 8, + 16, + 11, + 7, + 10, + 5, + 18, + 0, + 12, + 9, + 14, + 13, + 4, + 9, + 25, + 15, + 13, + 17, + 16, + 25, + 14, + 11, + 6, + 21, + 12 + ], + "weighted_loads": [ + 0.23167496174573898, + 1.9332082439213991, + 0.5703660380095243, + 0.17947116121649742, + 0.042604632675647736, + 0.8655275199562311, + 0.6930379122495651, + 0.2598419673740864, + 0.37163378298282623, + 0.4212842006236315, + 0.6446211021393538, + 0.8688554186373949, + 0.6895081922411919, + 0.4879908263683319, + 0.5834639854729176, + 1.1530086994171143, + 0.0, + 0.9591902457177639, + 1.3658572044223547, + 0.0666765570640564, + 0.16575843282043934, + 0.9235521145164967, + 0.3269979488104582, + 0.18659083358943462, + 0.3035591319203377, + 1.7872548624873161, + 0.34637206979095936, + 0.37339499220252037, + 0.25129770673811436, + 0.37010951712727547, + 0.07143580168485641, + 0.4708334859460592, + 0.5385959297418594, + 0.13502016104757786, + 0.8392114639282227, + 0.9396459013223648, + 0.43925320729613304, + 1.9309323206543922, + 1.47029272839427, + 0.4635184481739998, + 2.0814766958355904, + 0.5962485894560814, + 0.3125940039753914, + 0.5284272991120815, + 0.34806692227721214, + 1.1186094731092453, + 0.0, + 0.49625111371278763, + 0.5899163298308849, + 0.545278899371624, + 1.4397087767720222, + 0.15598464012145996, + 0.26616781763732433, + 1.3917581010609865, + 0.5341893564909697, + 0.5621106661856174, + 0.9177280459553003, + 0.7784231957048178, + 1.0222602058202028, + 0.7774431593716145, + 1.2816277891397476, + 0.21300426125526428, + 0.9334420878440142, + 1.261434305459261 + ], + "unique_experts": 62, + "load_cv": 0.5654671399999766, + "normalized_load_entropy": 0.9559717009598425, + "max_load_share": 0.03611111111111111 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "38ff4589ed062d9968586afb0a1aea36fffdd72a784b8b5c84cc5f174a2c7025", + "route_weight_sha256": "88a101322214b88b15777291e6eecfd5717c865753e73ba6ec0ad00379c76fa0", + "loads": [ + 6, + 23, + 13, + 9, + 2, + 21, + 25, + 9, + 9, + 13, + 26, + 25, + 18, + 12, + 12, + 26, + 3, + 24, + 38, + 11, + 7, + 14, + 10, + 2, + 4, + 30, + 10, + 8, + 7, + 6, + 1, + 14, + 16, + 5, + 13, + 17, + 10, + 21, + 30, + 20, + 20, + 24, + 16, + 14, + 6, + 18, + 0, + 15, + 9, + 28, + 23, + 5, + 12, + 35, + 19, + 23, + 17, + 16, + 26, + 15, + 12, + 6, + 21, + 16 + ], + "weighted_loads": [ + 0.26819032058119774, + 1.9571511193644255, + 0.5703660380095243, + 0.5938602648675442, + 0.0443748285761103, + 0.9378772508352995, + 1.7123689576983452, + 0.35271147615276277, + 0.3749939876142889, + 0.4257125277072191, + 1.4883697424083948, + 1.2368390951305628, + 1.137366984039545, + 0.4879908263683319, + 0.616709228605032, + 3.80720777483657, + 0.23771418631076813, + 1.638440441340208, + 2.4596198070794344, + 0.9108814047649503, + 0.18110132007859647, + 0.9647279232740402, + 0.3648931700736284, + 0.18659083358943462, + 0.3795735314488411, + 2.504000334069133, + 0.34637206979095936, + 0.5470146648585796, + 0.25129770673811436, + 0.4187612347304821, + 0.07143580168485641, + 0.4708334859460592, + 0.6577169075608253, + 0.17815758846700191, + 0.873573899269104, + 1.3735445141792297, + 0.4845295026898384, + 2.0831911116838455, + 2.7476330660283566, + 1.582561917603016, + 2.2459793016314507, + 1.8393153920769691, + 0.9652947001159191, + 0.7696666680276394, + 0.410008329898119, + 1.1186094731092453, + 0.0, + 0.5467007861007005, + 0.5899163298308849, + 1.3556734574958682, + 2.552471876144409, + 0.20402033627033234, + 1.9317647088319063, + 2.1946702543646097, + 0.5882745925337076, + 1.1817839965224266, + 0.9177280459553003, + 0.7784231957048178, + 1.0928422305732965, + 0.824955802410841, + 1.327398370951414, + 0.21300426125526428, + 0.9334420878440142, + 2.4411798492074013 + ], + "unique_experts": 63, + "load_cv": 0.5665127467738419, + "normalized_load_entropy": 0.9581939251609896, + "max_load_share": 0.039337474120082816 + } + }, + "s0_bos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "86c034b8aecf6ca0949caa8dbcef5839d69d7285e7d056694e36f9292610f695", + "route_weight_sha256": "915db6b735f8ad9786be2970a8071231b90193065de8f7f06ffbd6a637a7e050", + "loads": [ + 7, + 21, + 15, + 4, + 5, + 17, + 17, + 7, + 10, + 11, + 12, + 19, + 12, + 10, + 10, + 13, + 0, + 14, + 25, + 3, + 5, + 11, + 8, + 3, + 3, + 23, + 10, + 8, + 10, + 5, + 1, + 16, + 15, + 4, + 12, + 11, + 9, + 18, + 16, + 7, + 17, + 11, + 7, + 11, + 5, + 18, + 0, + 9, + 10, + 13, + 11, + 4, + 8, + 23, + 15, + 11, + 17, + 17, + 23, + 14, + 10, + 5, + 21, + 13 + ], + "weighted_loads": [ + 0.27344679459929466, + 2.096665184944868, + 0.6789648309350014, + 0.2023527305573225, + 0.18948492035269737, + 0.7283984292298555, + 0.7083914838731289, + 0.2919630631804466, + 0.4594172313809395, + 0.4070798587054014, + 0.5939334705471992, + 0.7821052893996239, + 0.65018430352211, + 0.37242621555924416, + 0.5568449888378382, + 1.2644962277263403, + 0.0, + 1.0159394536167383, + 1.2624278794974089, + 0.13491766341030598, + 0.15727764181792736, + 0.9228812046349049, + 0.2913792058825493, + 0.20917297527194023, + 0.3176065534353256, + 1.8137616235762835, + 0.3277465011924505, + 0.460291376337409, + 0.3607812970876694, + 0.40152331069111824, + 0.06324875354766846, + 0.5332654025405645, + 0.5367913208901882, + 0.12880671955645084, + 0.8619313016533852, + 0.8146055247634649, + 0.4349389858543873, + 1.8071102052927017, + 1.4804913364350796, + 0.43204694613814354, + 2.127743747085333, + 0.5848956890404224, + 0.32135505974292755, + 0.5649933367967606, + 0.3504948429763317, + 1.1650821454823017, + 0.0, + 0.3903067298233509, + 0.6039706170558929, + 0.47010072506964207, + 1.1479651220142841, + 0.15215908363461494, + 0.23448406718671322, + 1.3598835058510303, + 0.5404823161661625, + 0.48554153740406036, + 0.9105258826166391, + 0.8086038921028376, + 0.9304327070713043, + 0.7718229275196791, + 1.2263507843017578, + 0.18976319953799248, + 0.9283612463623285, + 1.3088587950915098 + ], + "unique_experts": 62, + "load_cv": 0.5286834334831253, + "normalized_load_entropy": 0.96215092266709, + "max_load_share": 0.034722222222222224 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "0dfc5ecb81cdd3efba4c96791c5272c83d8af099c949e47c839d1c3efef47cd8", + "route_weight_sha256": "d1ffeb76b7c77b5c994447386244e20ad7223c69d1487b8b6bd9f25cbe07fbf6", + "loads": [ + 7, + 22, + 15, + 4, + 5, + 19, + 19, + 9, + 11, + 12, + 23, + 19, + 15, + 10, + 10, + 27, + 2, + 20, + 34, + 4, + 6, + 13, + 8, + 3, + 3, + 31, + 10, + 8, + 10, + 5, + 1, + 16, + 15, + 4, + 12, + 15, + 9, + 18, + 29, + 15, + 21, + 19, + 13, + 12, + 6, + 18, + 0, + 10, + 10, + 18, + 18, + 4, + 9, + 32, + 17, + 21, + 17, + 17, + 23, + 15, + 10, + 5, + 21, + 16 + ], + "weighted_loads": [ + 0.27344679459929466, + 2.1001689857803285, + 0.6789648309350014, + 0.2023527305573225, + 0.18948492035269737, + 0.7966324891895056, + 0.7783860713243484, + 0.33237094967626035, + 0.4627709488850087, + 0.4435246605426073, + 1.2878936864435673, + 0.7821052893996239, + 0.8393619991838932, + 0.37242621555924416, + 0.5568449888378382, + 3.4462236524559557, + 0.15730243176221848, + 1.3132086787372828, + 2.107025818899274, + 0.1479776380583644, + 0.169855784624815, + 1.0034001804888248, + 0.2913792058825493, + 0.20917297527194023, + 0.3176065534353256, + 2.717601900920272, + 0.3277465011924505, + 0.460291376337409, + 0.3607812970876694, + 0.40152331069111824, + 0.06324875354766846, + 0.5332654025405645, + 0.5367913208901882, + 0.12880671955645084, + 0.8619313016533852, + 1.1273458022624254, + 0.4349389858543873, + 1.8071102052927017, + 2.768804170191288, + 1.069190576672554, + 2.3041057623922825, + 1.417250145226717, + 0.7578750587999821, + 0.609663836658001, + 0.431811410933733, + 1.1650821454823017, + 0.0, + 0.40587938483804464, + 0.6039706170558929, + 0.6840856643393636, + 1.7541034780442715, + 0.15215908363461494, + 0.8993062283843756, + 1.9547715373337269, + 0.5554413916543126, + 1.1735921762883663, + 0.9105258826166391, + 0.8086038921028376, + 0.9304327070713043, + 0.8176051620393991, + 1.2263507843017578, + 0.18976319953799248, + 0.9283612463623285, + 2.2906069327145815 + ], + "unique_experts": 63, + "load_cv": 0.5715545413498294, + "normalized_load_entropy": 0.9579809947258322, + "max_load_share": 0.03908045977011494 + } + }, + "s1_bos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "579ff5ab1892b9727f3081fdc66fd9faa7a6e347a86346e9526ced91101edd72", + "route_weight_sha256": "37df0296c0630f112134ca0141e30dcfc296e35a85eef593538071a2bfd44482", + "loads": [ + 5, + 21, + 18, + 3, + 3, + 19, + 16, + 6, + 10, + 16, + 12, + 19, + 12, + 12, + 10, + 12, + 0, + 14, + 22, + 3, + 5, + 11, + 7, + 3, + 3, + 23, + 9, + 7, + 8, + 5, + 1, + 14, + 14, + 5, + 12, + 11, + 9, + 18, + 16, + 7, + 17, + 12, + 7, + 11, + 6, + 18, + 0, + 12, + 9, + 12, + 11, + 4, + 7, + 25, + 16, + 9, + 17, + 18, + 25, + 14, + 11, + 5, + 21, + 12 + ], + "weighted_loads": [ + 0.22432390041649342, + 2.0971068553626537, + 0.7950447350740433, + 0.17897935025393963, + 0.11725039407610893, + 0.8020446058362722, + 0.6971267312765121, + 0.25108735263347626, + 0.4631596729159355, + 0.5657095536589622, + 0.5851446893066168, + 0.7472276072949171, + 0.6462464518845081, + 0.45306023955345154, + 0.5539996735751629, + 1.2415710780769587, + 0.0, + 1.0053708739578724, + 1.1557597238570452, + 0.13917549885809422, + 0.16343829594552517, + 0.9244272708892822, + 0.2618419900536537, + 0.22733380272984505, + 0.31139998510479927, + 1.8501787967979908, + 0.289936363697052, + 0.4247097000479698, + 0.28573887050151825, + 0.3754286617040634, + 0.06348651647567749, + 0.45598311722278595, + 0.4887243080884218, + 0.16704361513257027, + 0.8483149390667677, + 0.8099475353956223, + 0.42738015577197075, + 1.8066245689988136, + 1.4288354106247425, + 0.4345043711364269, + 2.1009139511734247, + 0.6084741894155741, + 0.30040640011429787, + 0.563615083694458, + 0.3714288454502821, + 1.1849929317831993, + 0.0, + 0.4946338087320328, + 0.5833499506115913, + 0.42290996573865414, + 1.1670403964817524, + 0.15117663145065308, + 0.21428272500634193, + 1.4017222579568624, + 0.5895263962447643, + 0.42959800362586975, + 0.9143422357738018, + 0.8402013629674911, + 1.0069060288369656, + 0.7521488349884748, + 1.2648902162909508, + 0.17952463030815125, + 0.9201880563050508, + 1.2308503687381744 + ], + "unique_experts": 62, + "load_cv": 0.5490732933602593, + "normalized_load_entropy": 0.9593456126027482, + "max_load_share": 0.034722222222222224 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "a08d8ef0f6bef54ae7c4feb590b8144335022ed67acebeeacb0e97e018a41a03", + "route_weight_sha256": "c7de54fb8de1f99cf9bfecbcf2cbfb748d667e957cbe9f83eeb571f2c37bb1ee", + "loads": [ + 6, + 23, + 18, + 9, + 3, + 21, + 25, + 9, + 11, + 16, + 26, + 22, + 18, + 12, + 11, + 28, + 4, + 25, + 36, + 13, + 6, + 13, + 8, + 3, + 4, + 31, + 9, + 9, + 8, + 6, + 1, + 14, + 15, + 6, + 13, + 15, + 10, + 21, + 30, + 19, + 20, + 25, + 17, + 15, + 7, + 18, + 0, + 14, + 9, + 25, + 22, + 5, + 8, + 35, + 19, + 20, + 17, + 18, + 26, + 15, + 12, + 5, + 21, + 16 + ], + "weighted_loads": [ + 0.26083925925195217, + 2.12104973080568, + 0.7950447350740433, + 0.5933684539049864, + 0.11725039407610893, + 0.8743943367153406, + 1.7215652875602245, + 0.34289894602261484, + 0.4665198775473982, + 0.5657095536589622, + 1.4433889854699373, + 1.115211283788085, + 1.1025898344814777, + 0.45306023955345154, + 0.5872449167072773, + 3.961794296745211, + 0.2777559421956539, + 1.6846210695803165, + 2.420245023444295, + 0.9833803465589881, + 0.1760164387524128, + 1.0107365064322948, + 0.29973721131682396, + 0.22733380272984505, + 0.3874143846333027, + 2.5669242683798075, + 0.289936363697052, + 0.5983293727040291, + 0.28573887050151825, + 0.42408037930727005, + 0.06348651647567749, + 0.45598311722278595, + 0.6078452859073877, + 0.21018104255199432, + 0.882677374407649, + 1.2438461482524872, + 0.4726564511656761, + 1.958883360028267, + 2.854992836713791, + 1.5598808228969574, + 2.2299262266606092, + 1.8722898084670305, + 1.0184904336929321, + 0.8051622919738293, + 0.4333702530711889, + 1.1849929317831993, + 0.0, + 0.5426489440724254, + 0.5833499506115913, + 1.2061650278046727, + 2.261418502777815, + 0.19921232759952545, + 0.8791048862040043, + 2.2046344112604856, + 0.6416208483278751, + 1.0701902993023396, + 0.9143422357738018, + 0.8402013629674911, + 1.0774880535900593, + 0.7996614780277014, + 1.3106607981026173, + 0.17952463030815125, + 0.9201880563050508, + 2.4105959124863148 + ], + "unique_experts": 63, + "load_cv": 0.5546452083009502, + "normalized_load_entropy": 0.9600841553134787, + "max_load_share": 0.037267080745341616 + } + }, + "s0_x": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "c93c0c100827d0ad7dea4a6e601b9496d342de0d4d32e08fd05096563c6286b6", + "route_weight_sha256": "6aeac1b98b394f65753aedf280b51e43079bb56ccaa5b9cbdc0193b2c50e1371", + "loads": [ + 7, + 21, + 13, + 3, + 5, + 17, + 16, + 7, + 10, + 11, + 12, + 18, + 12, + 8, + 12, + 13, + 0, + 14, + 28, + 3, + 5, + 12, + 4, + 2, + 3, + 24, + 9, + 7, + 11, + 5, + 1, + 12, + 16, + 3, + 12, + 13, + 9, + 18, + 16, + 7, + 17, + 12, + 5, + 11, + 6, + 18, + 0, + 13, + 10, + 14, + 11, + 3, + 6, + 22, + 17, + 12, + 16, + 17, + 24, + 14, + 11, + 6, + 23, + 13 + ], + "weighted_loads": [ + 0.2713648993521929, + 2.0721912384033203, + 0.6021033562719822, + 0.17577793449163437, + 0.19142365455627441, + 0.7352096438407898, + 0.6864513717591763, + 0.29836731031537056, + 0.46896563470363617, + 0.4095072038471699, + 0.6007893066853285, + 0.7409668564796448, + 0.6578794904053211, + 0.3071908690035343, + 0.6295953560620546, + 1.266286313533783, + 0.0, + 0.9983374457806349, + 1.4118001461029053, + 0.13568819500505924, + 0.16059459373354912, + 0.9277268797159195, + 0.1532868631184101, + 0.18050702661275864, + 0.32078124955296516, + 1.8391475547105074, + 0.291966512799263, + 0.43338122218847275, + 0.3932893555611372, + 0.3820192515850067, + 0.06306549161672592, + 0.4112087246030569, + 0.5614600442349911, + 0.10227140970528126, + 0.870658278465271, + 0.9010782726109028, + 0.43893614038825035, + 1.7885850295424461, + 1.4951514601707458, + 0.4689551554620266, + 2.1199845746159554, + 0.6295153610408306, + 0.23781859129667282, + 0.5589675903320312, + 0.36849084310233593, + 1.146730825304985, + 0.0, + 0.5257661454379559, + 0.6167336665093899, + 0.5077599342912436, + 1.0822314843535423, + 0.11698411405086517, + 0.17827185057103634, + 1.3242220655083656, + 0.6080715972930193, + 0.5096376221626997, + 0.884552925825119, + 0.8099335134029388, + 0.9701236803084612, + 0.7864578273147345, + 1.2573067340999842, + 0.22525238245725632, + 0.9815286565572023, + 1.3364413250237703 + ], + "unique_experts": 62, + "load_cv": 0.5586580039989572, + "normalized_load_entropy": 0.9579237222411584, + "max_load_share": 0.03888888888888889 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "a8527ba336d88b96945fd575177fb297b25c156a8c130a2cbb2b1bc3cef1d0b6", + "route_weight_sha256": "606cdcdec2bb368e138ed0978f88b8187527ed1a0aea63d2049f62c2459dd912", + "loads": [ + 7, + 23, + 13, + 3, + 5, + 19, + 18, + 9, + 11, + 11, + 24, + 18, + 15, + 8, + 12, + 27, + 2, + 20, + 37, + 4, + 6, + 14, + 4, + 2, + 3, + 33, + 9, + 7, + 11, + 5, + 1, + 12, + 16, + 3, + 12, + 17, + 9, + 18, + 27, + 15, + 23, + 20, + 10, + 12, + 7, + 18, + 0, + 14, + 10, + 17, + 18, + 3, + 7, + 33, + 19, + 22, + 16, + 17, + 24, + 15, + 11, + 6, + 23, + 15 + ], + "weighted_loads": [ + 0.2713648993521929, + 2.112982669379562, + 0.6021033562719822, + 0.17577793449163437, + 0.19142365455627441, + 0.8034437038004398, + 0.7524248622357845, + 0.33767184405587614, + 0.4723193522077054, + 0.4095072038471699, + 1.405252704396844, + 0.7409668564796448, + 0.843164224177599, + 0.3071908690035343, + 0.6295953560620546, + 3.6208795201964676, + 0.1559682935476303, + 1.2956066709011793, + 2.1545385271310806, + 0.14874816965311766, + 0.17317273654043674, + 1.004104245454073, + 0.1532868631184101, + 0.18050702661275864, + 0.32078124955296516, + 2.8300873544067144, + 0.291966512799263, + 0.43338122218847275, + 0.3932893555611372, + 0.3820192515850067, + 0.06306549161672592, + 0.4112087246030569, + 0.5614600442349911, + 0.10227140970528126, + 0.870658278465271, + 1.2138185501098633, + 0.43893614038825035, + 1.7885850295424461, + 2.483801081776619, + 1.1260607428848743, + 2.410849440842867, + 1.4125340208411217, + 0.5818710960447788, + 0.5995715819299221, + 0.4498074110597372, + 1.146730825304985, + 0.0, + 0.5413388004526496, + 0.6167336665093899, + 0.6434770720079541, + 1.7122120596468449, + 0.11698411405086517, + 0.8430940117686987, + 2.0315475687384605, + 0.6230306727811694, + 1.2747722696512938, + 0.884552925825119, + 0.8099335134029388, + 0.9701236803084612, + 0.8322400618344545, + 1.2573067340999842, + 0.22525238245725632, + 0.9815286565572023, + 2.2722148541361094 + ], + "unique_experts": 63, + "load_cv": 0.6061602987944595, + "normalized_load_entropy": 0.9531267702298942, + "max_load_share": 0.04252873563218391 + } + }, + "s1_x": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "908028ad55ab766798c6d07c08fe9fcaedf2b6379a5b805c1387ef54aa7951a5", + "route_weight_sha256": "b511ff43ae9808c457764475d3e4d6354ad6076fc154ad6f70dc7bb2ac366060", + "loads": [ + 7, + 22, + 17, + 2, + 4, + 23, + 16, + 7, + 12, + 12, + 12, + 21, + 12, + 8, + 10, + 13, + 1, + 15, + 23, + 3, + 5, + 12, + 4, + 3, + 3, + 23, + 8, + 8, + 8, + 5, + 1, + 14, + 11, + 4, + 13, + 12, + 10, + 18, + 16, + 7, + 17, + 11, + 5, + 10, + 6, + 18, + 0, + 12, + 11, + 12, + 12, + 4, + 8, + 25, + 18, + 9, + 16, + 17, + 25, + 14, + 11, + 4, + 18, + 12 + ], + "weighted_loads": [ + 0.28295978158712387, + 2.1154697872698307, + 0.7589519768953323, + 0.14846241101622581, + 0.14767153561115265, + 0.9575637020170689, + 0.6878437735140324, + 0.2930304855108261, + 0.5377631075680256, + 0.44332109950482845, + 0.5897917933762074, + 0.8162528593093157, + 0.6445428803563118, + 0.3149062544107437, + 0.5581626296043396, + 1.2905666790902615, + 0.03372275456786156, + 1.0321937631815672, + 1.230255475267768, + 0.14030865393579006, + 0.16068768501281738, + 0.9406430684030056, + 0.1635083146393299, + 0.22464248910546303, + 0.31250613182783127, + 1.8404673337936401, + 0.25156187266111374, + 0.46086299046874046, + 0.2877489347010851, + 0.36707459948956966, + 0.06432068347930908, + 0.4649350307881832, + 0.3903472926467657, + 0.13881393149495125, + 0.8846565894782543, + 0.8619675654917955, + 0.4463612772524357, + 1.8042361959815025, + 1.4252585172653198, + 0.4415281917899847, + 2.0886288173496723, + 0.5587573237717152, + 0.2346388641744852, + 0.5261893980205059, + 0.36158676259219646, + 1.2114398069679737, + 0.0, + 0.4961794540286064, + 0.6620555408298969, + 0.4321374259889126, + 1.116416398435831, + 0.14809241518378258, + 0.23876262456178665, + 1.396866524592042, + 0.650368882343173, + 0.4495511520653963, + 0.8843705095350742, + 0.819429500028491, + 1.0235035195946693, + 0.753471851348877, + 1.2883576359599829, + 0.14675750955939293, + 0.8195995539426804, + 1.225848525762558 + ], + "unique_experts": 63, + "load_cv": 0.5604231205741552, + "normalized_load_entropy": 0.9586106660920786, + "max_load_share": 0.034722222222222224 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "eb495dcca916d556de2bfe5bdd06738732f00425c2df1e86729b3fdb3cae271c", + "route_weight_sha256": "0cebe69f828538b790687e6c18ac2ab37a67c3411831c2d489c0953065b84d73", + "loads": [ + 8, + 24, + 17, + 8, + 4, + 25, + 25, + 10, + 13, + 12, + 27, + 24, + 18, + 8, + 11, + 29, + 5, + 26, + 37, + 13, + 6, + 14, + 5, + 3, + 4, + 32, + 8, + 10, + 8, + 6, + 1, + 14, + 12, + 6, + 14, + 17, + 11, + 21, + 27, + 19, + 21, + 23, + 14, + 14, + 7, + 18, + 0, + 14, + 11, + 25, + 21, + 5, + 9, + 37, + 21, + 20, + 16, + 17, + 26, + 15, + 12, + 4, + 18, + 16 + ], + "weighted_loads": [ + 0.3194751404225826, + 2.139412662712857, + 0.7589519768953323, + 0.5628515146672726, + 0.14767153561115265, + 1.0299134328961372, + 1.7107841707766056, + 0.3833752123173326, + 0.5411233121994883, + 0.44332109950482845, + 1.5492147207260132, + 1.1842365358024836, + 1.098199587315321, + 0.3149062544107437, + 0.591407872736454, + 4.19787471788004, + 0.3213975355029106, + 1.7114439588040113, + 2.3726051840931177, + 0.9845135016366839, + 0.173265827819705, + 1.0232261568307877, + 0.20140353590250015, + 0.22464248910546303, + 0.3885205313563347, + 2.6353611927479506, + 0.25156187266111374, + 0.6344826631247997, + 0.2877489347010851, + 0.4157263170927763, + 0.06432068347930908, + 0.4649350307881832, + 0.5094682704657316, + 0.22663620859384537, + 0.9190190248191357, + 1.3417779710143805, + 0.49163757264614105, + 1.9564949870109558, + 2.500712715089321, + 1.5849024634808302, + 2.292117938399315, + 1.7350229509174824, + 0.8800391983240843, + 0.7644578069448471, + 0.4235281702131033, + 1.2114398069679737, + 0.0, + 0.544194589368999, + 0.6620555408298969, + 1.2117778798565269, + 2.139628864824772, + 0.19612811133265495, + 0.903584785759449, + 2.3094245810061693, + 0.7024633344262838, + 1.1612385641783476, + 0.8843705095350742, + 0.819429500028491, + 1.094085544347763, + 0.8009844943881035, + 1.3341282177716494, + 0.14675750955939293, + 0.8195995539426804, + 2.4055940695106983 + ], + "unique_experts": 63, + "load_cv": 0.5671177451406636, + "normalized_load_entropy": 0.9590125854678164, + "max_load_share": 0.038302277432712216 + } + }, + "s0_period": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "db985fd533443e4fae4d903d056e7274cc4a6270e2bb5b8e1beeb01fc3dfba0a", + "route_weight_sha256": "ad96a89cf4653667beca21cf1324c893964f2b4fdf37201f2a285f2c99ce1b7e", + "loads": [ + 7, + 21, + 15, + 3, + 6, + 17, + 14, + 7, + 10, + 11, + 12, + 20, + 12, + 7, + 10, + 13, + 0, + 14, + 28, + 3, + 4, + 12, + 6, + 2, + 3, + 24, + 10, + 7, + 12, + 5, + 1, + 11, + 15, + 3, + 12, + 13, + 9, + 18, + 16, + 8, + 18, + 12, + 4, + 11, + 6, + 18, + 0, + 12, + 11, + 13, + 11, + 4, + 6, + 23, + 17, + 11, + 17, + 17, + 24, + 14, + 11, + 6, + 20, + 13 + ], + "weighted_loads": [ + 0.28151199594140053, + 2.0578017868101597, + 0.6781122889369726, + 0.17983843386173248, + 0.2231352962553501, + 0.7320082448422909, + 0.6085194125771523, + 0.298294585198164, + 0.46619767881929874, + 0.4088208805769682, + 0.6041346937417984, + 0.815527530387044, + 0.6701609492301941, + 0.2630786560475826, + 0.5607649814337492, + 1.2551146857440472, + 0.0, + 0.987828379496932, + 1.4264727868139744, + 0.1308610662817955, + 0.12827230617403984, + 0.9330921359360218, + 0.2196849249303341, + 0.1803014539182186, + 0.3187498711049557, + 1.8436771109700203, + 0.3282498512417078, + 0.43200669437646866, + 0.4244107101112604, + 0.37923626601696014, + 0.06289162486791611, + 0.3720637783408165, + 0.5318442527204752, + 0.1016548927873373, + 0.8785437941551208, + 0.9049809463322163, + 0.4366402141749859, + 1.7784826904535294, + 1.4995112530887127, + 0.5101066213101149, + 2.146620126441121, + 0.6174111943691969, + 0.2011924535036087, + 0.5622379556298256, + 0.37488153018057346, + 1.1505169607698917, + 0.0, + 0.48600925877690315, + 0.6417623907327652, + 0.461522476747632, + 1.0500473156571388, + 0.1512055415660143, + 0.18179558217525482, + 1.3509763181209564, + 0.6111944802105427, + 0.49368453212082386, + 0.9047275688499212, + 0.8092278949916363, + 0.9712485074996948, + 0.7849632613360882, + 1.2561899088323116, + 0.22830931842327118, + 0.8903911411762238, + 1.3366701994091272 + ], + "unique_experts": 62, + "load_cv": 0.5548884884081677, + "normalized_load_entropy": 0.9585986591998773, + "max_load_share": 0.03888888888888889 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "a45d4f43e853901b93d987f0b356ab8a285c277688468af23742853abb600526", + "route_weight_sha256": "d318d45bdd71141a7a0d609a3c3e75d06588c8c6556a406ab45c27b276a4a8cb", + "loads": [ + 7, + 23, + 15, + 3, + 6, + 19, + 16, + 9, + 11, + 11, + 24, + 20, + 15, + 7, + 10, + 27, + 3, + 21, + 37, + 4, + 5, + 14, + 6, + 2, + 3, + 32, + 10, + 7, + 12, + 5, + 1, + 11, + 15, + 3, + 12, + 18, + 9, + 18, + 27, + 16, + 23, + 20, + 9, + 12, + 8, + 18, + 0, + 13, + 11, + 16, + 18, + 4, + 7, + 32, + 19, + 21, + 17, + 17, + 24, + 15, + 11, + 6, + 20, + 15 + ], + "weighted_loads": [ + 0.28151199594140053, + 2.099543613847345, + 0.6781122889369726, + 0.17983843386173248, + 0.2231352962553501, + 0.8002423048019409, + 0.6749274544417858, + 0.3377372936811298, + 0.46955139632336795, + 0.4088208805769682, + 1.4008229300379753, + 0.815527530387044, + 0.8559315241873264, + 0.2630786560475826, + 0.5607649814337492, + 3.4423955832608044, + 0.1950327418744564, + 1.3424456361681223, + 2.1204960346221924, + 0.14392104092985392, + 0.14085044898092747, + 1.0092100240290165, + 0.2196849249303341, + 0.1803014539182186, + 0.3187498711049557, + 2.7475173883140087, + 0.3282498512417078, + 0.43200669437646866, + 0.4244107101112604, + 0.37923626601696014, + 0.06289162486791611, + 0.3720637783408165, + 0.5318442527204752, + 0.1016548927873373, + 0.8785437941551208, + 1.2709129825234413, + 0.4366402141749859, + 1.7784826904535294, + 2.452962066978216, + 1.1719339545816183, + 2.3793124202638865, + 1.436058757826686, + 0.5532091930508614, + 0.6014461368322372, + 0.5118051152676344, + 1.1505169607698917, + 0.0, + 0.5015819137915969, + 0.6417623907327652, + 0.5982553670182824, + 1.6862001419067383, + 0.1512055415660143, + 0.8466177433729172, + 1.945864349603653, + 0.6261535556986928, + 1.385245868936181, + 0.9047275688499212, + 0.8092278949916363, + 0.9712485074996948, + 0.8307454958558083, + 1.2561899088323116, + 0.22830931842327118, + 0.8903911411762238, + 2.2724437285214663 + ], + "unique_experts": 63, + "load_cv": 0.5934731094294006, + "normalized_load_entropy": 0.9552081292957462, + "max_load_share": 0.04252873563218391 + } + }, + "s1_period": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "ce02133d2152030160e04548c4b14d06f8c3f5f8b6803e06f0db5e178c934084", + "route_weight_sha256": "d184ccdaca570b15b4515121741be4cad1ef5bec563c9f417661843e7b79427f", + "loads": [ + 6, + 22, + 18, + 2, + 4, + 22, + 16, + 7, + 10, + 12, + 14, + 21, + 12, + 8, + 10, + 13, + 1, + 15, + 25, + 3, + 5, + 12, + 5, + 3, + 3, + 23, + 8, + 8, + 7, + 4, + 1, + 11, + 13, + 4, + 13, + 12, + 9, + 18, + 16, + 7, + 18, + 10, + 4, + 10, + 6, + 18, + 0, + 11, + 10, + 10, + 12, + 4, + 8, + 25, + 18, + 9, + 16, + 19, + 26, + 14, + 11, + 6, + 20, + 12 + ], + "weighted_loads": [ + 0.27108361944556236, + 2.107979528605938, + 0.796884898096323, + 0.14941049367189407, + 0.14885910600423813, + 0.9160089921206236, + 0.6817771084606647, + 0.29266850650310516, + 0.46843935549259186, + 0.43852048739790916, + 0.6556763779371977, + 0.8305068034678698, + 0.6502574309706688, + 0.31323475390672684, + 0.5606738273054361, + 1.2991676330566406, + 0.033307429403066635, + 1.0237032752484083, + 1.286319274455309, + 0.14036565087735653, + 0.16041498817503452, + 0.94175860658288, + 0.1953638792037964, + 0.2236742302775383, + 0.31690795719623566, + 1.8395267128944397, + 0.2541487645357847, + 0.4568219259381294, + 0.2590419352054596, + 0.3336952142417431, + 0.06464488059282303, + 0.3628409132361412, + 0.449637807905674, + 0.13830373249948025, + 0.8890877943485975, + 0.8655753694474697, + 0.41249334067106247, + 1.8127467781305313, + 1.4160917773842812, + 0.4619644321501255, + 2.109628140926361, + 0.5362194683402777, + 0.1986105516552925, + 0.527464997023344, + 0.363240672275424, + 1.1992118433117867, + 0.0, + 0.4593214578926563, + 0.6245494149625301, + 0.3625563345849514, + 1.0930838286876678, + 0.1495368890464306, + 0.24042371846735477, + 1.3895030375570059, + 0.6454011388123035, + 0.46047220192849636, + 0.8790453150868416, + 0.8764709625393152, + 1.0660833567380905, + 0.7565134353935719, + 1.2888255659490824, + 0.2197999656200409, + 0.8741360381245613, + 1.23002939671278 + ], + "unique_experts": 63, + "load_cv": 0.5773502691896257, + "normalized_load_entropy": 0.9568622508216009, + "max_load_share": 0.03611111111111111 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "9d12992d3afa5bf900892ac52b4195bc9dc6a9465e1aab2c2c562417b913eb1b", + "route_weight_sha256": "6aee9666fcb47e891796428bff17a6b4b801b1ff7d165ce49a0aff1566a8f45e", + "loads": [ + 7, + 24, + 18, + 8, + 4, + 25, + 25, + 10, + 11, + 12, + 29, + 24, + 18, + 8, + 11, + 30, + 5, + 27, + 38, + 13, + 6, + 14, + 6, + 3, + 4, + 31, + 8, + 10, + 7, + 5, + 1, + 11, + 14, + 5, + 14, + 17, + 10, + 21, + 27, + 19, + 22, + 24, + 13, + 14, + 7, + 18, + 0, + 13, + 10, + 23, + 21, + 5, + 9, + 35, + 21, + 20, + 16, + 19, + 27, + 15, + 12, + 6, + 20, + 16 + ], + "weighted_loads": [ + 0.3075989782810211, + 2.1319224040489644, + 0.796884898096323, + 0.5637995973229408, + 0.14885910600423813, + 1.0331649538129568, + 1.7044322192668915, + 0.38286698958836496, + 0.47179956012405455, + 0.43852048739790916, + 1.6324859280139208, + 1.1984904799610376, + 1.1037626266479492, + 0.31323475390672684, + 0.5939190704375505, + 4.085271873045713, + 0.34284214302897453, + 1.7448770720511675, + 2.356534630060196, + 0.9845704985782504, + 0.17299313098192215, + 1.0250080116093159, + 0.23325910046696663, + 0.2236742302775383, + 0.3929223567247391, + 2.5562721844762564, + 0.2541487645357847, + 0.6304415985941887, + 0.2590419352054596, + 0.3823469318449497, + 0.06464488059282303, + 0.3628409132361412, + 0.5687587857246399, + 0.1814411599189043, + 0.9234502296894789, + 1.3784886337816715, + 0.45776963606476784, + 1.9650055691599846, + 2.4531310498714447, + 1.6044788993895054, + 2.2919697649776936, + 1.8713500816375017, + 0.8656031079590321, + 0.765221793204546, + 0.42518207989633083, + 1.1992118433117867, + 0.0, + 0.5073365932330489, + 0.6245494149625301, + 1.1428225813433528, + 2.110470537096262, + 0.19757258519530296, + 0.9052458796650171, + 2.192415190860629, + 0.6974955908954144, + 1.2635881695896387, + 0.8790453150868416, + 0.8764709625393152, + 1.1366653814911842, + 0.8040260784327984, + 1.3345961477607489, + 0.2197999656200409, + 0.8741360381245613, + 2.4097749404609203 + ], + "unique_experts": 63, + "load_cv": 0.5751633284923023, + "normalized_load_entropy": 0.957975512383182, + "max_load_share": 0.039337474120082816 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 120, + "ordered_topk_exact_tokens": 75, + "set_exact_tokens": 90, + "mean_set_jaccard": 0.9267857142857143, + "mean_token_weighted_tv": 0.012412985476354757, + "aggregate_load_tv": 0.03055555555555555 + }, + "system_bos": { + "tokens": 120, + "ordered_topk_exact_tokens": 67, + "set_exact_tokens": 78, + "mean_set_jaccard": 0.8964285714285716, + "mean_token_weighted_tv": 0.018144367448985576, + "aggregate_load_tv": 0.034722222222222224 + }, + "system_x": { + "tokens": 120, + "ordered_topk_exact_tokens": 57, + "set_exact_tokens": 70, + "mean_set_jaccard": 0.8706349206349207, + "mean_token_weighted_tv": 0.022693122550845147, + "aggregate_load_tv": 0.05 + }, + "system_period": { + "tokens": 120, + "ordered_topk_exact_tokens": 59, + "set_exact_tokens": 72, + "mean_set_jaccard": 0.8750000000000002, + "mean_token_weighted_tv": 0.022593362318972746, + "aggregate_load_tv": 0.04583333333333334 + }, + "bos_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 48, + "set_exact_tokens": 64, + "mean_set_jaccard": 0.8545634920634922, + "mean_token_weighted_tv": 0.027334638320220015, + "aggregate_load_tv": 0.05277777777777777 + }, + "bos_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 50, + "set_exact_tokens": 67, + "mean_set_jaccard": 0.868452380952381, + "mean_token_weighted_tv": 0.02689065277421226, + "aggregate_load_tv": 0.04027777777777777 + }, + "x_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 48, + "set_exact_tokens": 64, + "mean_set_jaccard": 0.8563492063492064, + "mean_token_weighted_tv": 0.02772324630059302, + "aggregate_load_tv": 0.048611111111111105 + }, + "x_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 47, + "set_exact_tokens": 62, + "mean_set_jaccard": 0.8498015873015875, + "mean_token_weighted_tv": 0.030799221837272246, + "aggregate_load_tv": 0.05694444444444443 + }, + "period_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 47, + "set_exact_tokens": 67, + "mean_set_jaccard": 0.8617063492063491, + "mean_token_weighted_tv": 0.02755402986270686, + "aggregate_load_tv": 0.049999999999999996 + }, + "period_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 47, + "set_exact_tokens": 67, + "mean_set_jaccard": 0.8595238095238096, + "mean_token_weighted_tv": 0.029987963599463305, + "aggregate_load_tv": 0.056944444444444436 + } + } + }, + "layer_06": { + "layer": 6, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "86fede81a49ee02f416ff1a04bdfa66f5535e99d3144d7007b3fd0c988418e34", + "route_weight_sha256": "d408416301a621e502362baf6315b530a4e3085989600f2122276514b0e7279d", + "loads": [ + 3, + 17, + 0, + 11, + 7, + 15, + 30, + 2, + 12, + 29, + 4, + 17, + 19, + 8, + 0, + 9, + 6, + 4, + 10, + 9, + 8, + 7, + 14, + 11, + 23, + 3, + 13, + 11, + 6, + 6, + 19, + 23, + 12, + 17, + 11, + 15, + 2, + 8, + 0, + 16, + 0, + 7, + 25, + 9, + 2, + 4, + 11, + 4, + 4, + 8, + 7, + 18, + 10, + 5, + 24, + 18, + 7, + 13, + 15, + 21, + 15, + 31, + 13, + 12 + ], + "weighted_loads": [ + 0.16927657835185528, + 0.7582750469446182, + 0.0, + 0.5040523242205381, + 0.380318745970726, + 0.5806421991437674, + 1.9914320819079876, + 0.12934782728552818, + 0.8417641967535019, + 3.1103152073919773, + 0.22218294255435467, + 1.3758558295667171, + 0.9806513655930758, + 0.302293099462986, + 0.0, + 0.3149898424744606, + 0.4167127013206482, + 0.22120716981589794, + 0.6436544060707092, + 0.6532730534672737, + 0.4444371722638607, + 0.31617625057697296, + 0.5456037931144238, + 1.677670143544674, + 1.004510935395956, + 0.15421197935938835, + 0.5700309462845325, + 0.9401838947087526, + 0.4664077013731003, + 0.30838625133037567, + 0.8886617869138718, + 2.971583556383848, + 0.5727523230016232, + 0.9445112459361553, + 0.6067840680480003, + 0.8768543228507042, + 0.3630230128765106, + 0.5972241126000881, + 0.0, + 0.7816207483410835, + 0.0, + 0.39931906573474407, + 0.9589376486837864, + 0.41415911354124546, + 0.06973008811473846, + 0.15635917149484158, + 0.8019977919757366, + 0.1970575489103794, + 0.165889423340559, + 0.3223097827285528, + 0.37167923897504807, + 1.743059504777193, + 0.41722923517227173, + 0.24385728314518929, + 1.059223322197795, + 1.275834646075964, + 0.7561737410724163, + 0.5639935061335564, + 0.8827855139970779, + 1.4979580249637365, + 1.0347976088523865, + 1.4019738845527172, + 0.4712132513523102, + 0.8937069997191429 + ], + "unique_experts": 60, + "load_cv": 0.6687006010369367, + "normalized_load_entropy": 0.9422951767404941, + "max_load_share": 0.043055555555555555 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "3f4781b85e768d772d42cf7c4f41a255d52321ddf6fa808eecf51de12ce11ab7", + "route_weight_sha256": "88d156e344752494828e299bfdb5025868b09152386547430c10ca8608f3c037", + "loads": [ + 3, + 20, + 0, + 11, + 8, + 15, + 38, + 2, + 12, + 29, + 4, + 22, + 19, + 10, + 2, + 10, + 11, + 5, + 10, + 17, + 9, + 10, + 16, + 12, + 23, + 4, + 13, + 11, + 6, + 9, + 19, + 23, + 16, + 17, + 12, + 21, + 2, + 17, + 0, + 25, + 0, + 12, + 27, + 9, + 2, + 9, + 24, + 6, + 8, + 8, + 14, + 25, + 10, + 5, + 24, + 28, + 17, + 13, + 15, + 30, + 15, + 31, + 13, + 12 + ], + "weighted_loads": [ + 0.16927657835185528, + 0.8290019487030804, + 0.0, + 0.5040523242205381, + 0.40880159474909306, + 0.5806421991437674, + 2.854076527059078, + 0.12934782728552818, + 0.8417641967535019, + 3.1103152073919773, + 0.22218294255435467, + 1.71401472017169, + 0.9806513655930758, + 0.33034363482147455, + 0.12423540651798248, + 0.34490807354450226, + 0.7520898021757603, + 0.22525387722998857, + 0.6436544060707092, + 1.1432586312294006, + 0.48876647278666496, + 0.455061711370945, + 2.039615910500288, + 1.7133846580982208, + 1.004510935395956, + 0.18154438212513924, + 0.5700309462845325, + 0.9401838947087526, + 0.4664077013731003, + 0.4743642508983612, + 0.8886617869138718, + 2.971583556383848, + 0.6970399040728807, + 0.9445112459361553, + 0.6413519978523254, + 1.4161104001104832, + 0.3630230128765106, + 1.3787988498806953, + 0.0, + 1.144493879750371, + 0.0, + 0.7964923549443483, + 1.016839986667037, + 0.41415911354124546, + 0.06973008811473846, + 0.29113548062741756, + 2.2972194589674473, + 0.2194048746023327, + 0.3807731680572033, + 0.3223097827285528, + 0.8557011596858501, + 2.0481223724782467, + 0.41722923517227173, + 0.24385728314518929, + 1.059223322197795, + 2.036972001194954, + 1.886936865746975, + 0.5639935061335564, + 0.8827855139970779, + 2.461243102326989, + 1.0347976088523865, + 1.4019738845527172, + 0.4712132513523102, + 0.8937069997191429 + ], + "unique_experts": 61, + "load_cv": 0.6279481925189203, + "normalized_load_entropy": 0.9480758568328769, + "max_load_share": 0.04367816091954023 + } + }, + "s1_eos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "6a22da2a4d5a712eecd40529cc0f53abc861b08e6afeee38da5cf44b2be4f6f1", + "route_weight_sha256": "4d8fcac972a1ef3a34a87cdc3cedc7dd60115e00b998a062e74b500f104cc76d", + "loads": [ + 3, + 20, + 0, + 11, + 7, + 16, + 29, + 2, + 12, + 28, + 4, + 18, + 18, + 6, + 0, + 7, + 6, + 3, + 11, + 9, + 9, + 7, + 13, + 12, + 24, + 2, + 11, + 12, + 6, + 6, + 21, + 23, + 13, + 18, + 11, + 15, + 2, + 8, + 0, + 16, + 1, + 7, + 26, + 7, + 2, + 4, + 10, + 5, + 5, + 9, + 5, + 18, + 9, + 6, + 25, + 17, + 7, + 14, + 13, + 21, + 14, + 31, + 14, + 11 + ], + "weighted_loads": [ + 0.16557887382805347, + 0.8529815785586834, + 0.0, + 0.5055857226252556, + 0.3719465844333172, + 0.6110811699181795, + 1.9851855020970106, + 0.12584633380174637, + 0.8339401260018349, + 2.9963611401617527, + 0.2230383213609457, + 1.4160177186131477, + 0.9360735081136227, + 0.24607692286372185, + 0.0, + 0.2443806566298008, + 0.40726449713110924, + 0.19112923927605152, + 0.675446629524231, + 0.6609438173472881, + 0.4773467443883419, + 0.3240519165992737, + 0.5183755196630955, + 1.697918277233839, + 1.0659544542431831, + 0.11158596351742744, + 0.5145989172160625, + 0.9511892274022102, + 0.46421996876597404, + 0.30509961023926735, + 0.9488456957042217, + 2.9823986887931824, + 0.6016619391739368, + 0.9679398499429226, + 0.6146039664745331, + 0.8778912983834743, + 0.369867205619812, + 0.5694379508495331, + 0.0, + 0.7605908252298832, + 0.02571023814380169, + 0.39518305845558643, + 1.0101024974137545, + 0.3439089674502611, + 0.06966151483356953, + 0.1564646176993847, + 0.7133126985281706, + 0.23609715327620506, + 0.2129884585738182, + 0.3619874492287636, + 0.287689495831728, + 1.7465275526046753, + 0.3721911646425724, + 0.30832740291953087, + 1.0966918226331472, + 1.2431155145168304, + 0.6940692141652107, + 0.5985357761383057, + 0.7859259843826294, + 1.5037144981324673, + 1.0008103512227535, + 1.4934089630842209, + 0.5122568793594837, + 0.8570201434195042 + ], + "unique_experts": 61, + "load_cv": 0.678778859968945, + "normalized_load_entropy": 0.9413774698336336, + "max_load_share": 0.043055555555555555 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "db991071e4393e1b36a6e4b918eca7ecd726eb9f1590f8ad7fd4c31b57a3adb9", + "route_weight_sha256": "d7c397e92906aa9d7aa8fec354fe729dfe74b90434126cc27832f4891515576f", + "loads": [ + 3, + 22, + 3, + 12, + 9, + 16, + 43, + 3, + 17, + 34, + 4, + 28, + 22, + 8, + 9, + 8, + 16, + 4, + 13, + 19, + 11, + 11, + 15, + 13, + 25, + 4, + 11, + 13, + 7, + 9, + 21, + 26, + 19, + 19, + 15, + 23, + 3, + 25, + 0, + 25, + 1, + 12, + 28, + 7, + 3, + 7, + 27, + 8, + 8, + 9, + 14, + 24, + 10, + 9, + 25, + 28, + 24, + 14, + 13, + 32, + 19, + 31, + 14, + 11 + ], + "weighted_loads": [ + 0.16557887382805347, + 0.8926096931099892, + 0.14279655739665031, + 0.5430577471852303, + 0.52335424721241, + 0.6110811699181795, + 3.232555480673909, + 0.1871124841272831, + 1.1722080446779728, + 3.6998253278434277, + 0.2230383213609457, + 2.054969049990177, + 1.2658794596791267, + 0.2744138017296791, + 0.6649857573211193, + 0.35579222068190575, + 1.1661518216133118, + 0.195205248426646, + 0.8226681016385555, + 1.3565491400659084, + 0.5692093372344971, + 0.5396365001797676, + 2.0103430785238743, + 1.733280509710312, + 1.098351564258337, + 0.18944400921463966, + 0.5145989172160625, + 0.9778522625565529, + 0.5008252859115601, + 0.4973152279853821, + 0.9488456957042217, + 3.1813714280724525, + 0.7883500084280968, + 1.0013886578381062, + 0.8720013722777367, + 1.6402857266366482, + 0.4045715220272541, + 1.8995558954775333, + 0.0, + 1.2379420511424541, + 0.02571023814380169, + 0.8081801999360323, + 1.0680545829236507, + 0.3439089674502611, + 0.15352759696543217, + 0.22357423463836312, + 2.532264430075884, + 0.28979408042505383, + 0.38439951837062836, + 0.3619874492287636, + 0.8905486166477203, + 1.9855327792465687, + 0.4093090146780014, + 0.47580496966838837, + 1.0966918226331472, + 2.2547468282282352, + 2.451021905988455, + 0.5985357761383057, + 0.7859259843826294, + 2.559540180489421, + 1.2651140838861465, + 1.4934089630842209, + 0.5122568793594837, + 0.8570201434195042 + ], + "unique_experts": 63, + "load_cv": 0.6135878947212337, + "normalized_load_entropy": 0.9525136173412377, + "max_load_share": 0.044513457556935816 + } + }, + "s0_bos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "4bc5c467c9ff65883f06c9b836d8b4c1f7cf8635aa094c5f0665752e738ffa30", + "route_weight_sha256": "1085a9ccf495d97adf02c19fc319471ea616adfe3d2216f279cfcc951993f8d7", + "loads": [ + 2, + 16, + 0, + 9, + 8, + 12, + 29, + 3, + 12, + 29, + 2, + 17, + 21, + 10, + 0, + 10, + 6, + 4, + 10, + 9, + 9, + 7, + 11, + 12, + 22, + 2, + 14, + 12, + 7, + 5, + 16, + 24, + 17, + 17, + 12, + 15, + 2, + 8, + 0, + 17, + 0, + 6, + 22, + 8, + 1, + 4, + 10, + 6, + 8, + 8, + 9, + 20, + 10, + 5, + 26, + 16, + 7, + 14, + 15, + 22, + 14, + 29, + 11, + 11 + ], + "weighted_loads": [ + 0.14060434326529503, + 0.7006412483751774, + 0.0, + 0.4065839871764183, + 0.4087030924856663, + 0.46731584519147873, + 1.8913913760334253, + 0.16514556296169758, + 0.8342298977077007, + 3.159437522292137, + 0.15243030339479446, + 1.378931999206543, + 1.0549060050398111, + 0.367612162604928, + 0.0, + 0.33931989781558514, + 0.4215547703206539, + 0.2182864397764206, + 0.6401842273771763, + 0.6393622644245625, + 0.4944013711065054, + 0.3165033087134361, + 0.42758438363671303, + 1.740096889436245, + 0.9073527455329895, + 0.10920913517475128, + 0.605062548071146, + 1.0202024802565575, + 0.5053890720009804, + 0.28485868126153946, + 0.780306052416563, + 3.0938469227403402, + 0.7419819179922342, + 0.9346718974411488, + 0.6360251810401678, + 0.8740442059934139, + 0.37246739864349365, + 0.5350119508802891, + 0.0, + 0.8530109506100416, + 0.0, + 0.33943140506744385, + 0.8471645954996347, + 0.3816697522997856, + 0.04037225991487503, + 0.15602238476276398, + 0.6715452205389738, + 0.2558231055736542, + 0.3238266110420227, + 0.31387233920395374, + 0.47944141924381256, + 1.8302515745162964, + 0.4007475096732378, + 0.224501583725214, + 1.1484838053584099, + 1.1490385830402374, + 0.778895664960146, + 0.5619045402854681, + 0.9134988561272621, + 1.551873316988349, + 1.0166444350033998, + 1.360652219504118, + 0.39629654213786125, + 0.8809319548308849 + ], + "unique_experts": 60, + "load_cv": 0.6592176432973923, + "normalized_load_entropy": 0.9426495121769933, + "max_load_share": 0.04027777777777778 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "541ff7ef10d9f00399b56c94a6656392f7312bf7358162546e8d38aed49177f6", + "route_weight_sha256": "03b31ab40b6273f4e36f8fdd0fc616ed131cb03f2d296ba0639438d9043c3eb2", + "loads": [ + 2, + 18, + 0, + 9, + 9, + 12, + 37, + 3, + 12, + 29, + 2, + 22, + 21, + 11, + 3, + 12, + 12, + 4, + 10, + 17, + 10, + 10, + 12, + 13, + 22, + 3, + 14, + 12, + 7, + 9, + 16, + 24, + 20, + 17, + 13, + 21, + 2, + 18, + 0, + 26, + 0, + 11, + 25, + 8, + 1, + 8, + 24, + 7, + 12, + 8, + 16, + 27, + 10, + 5, + 26, + 26, + 17, + 14, + 15, + 31, + 14, + 29, + 11, + 11 + ], + "weighted_loads": [ + 0.14060434326529503, + 0.7666404563933611, + 0.0, + 0.4065839871764183, + 0.4371859412640333, + 0.46731584519147873, + 2.855341235175729, + 0.16514556296169758, + 0.8342298977077007, + 3.159437522292137, + 0.15243030339479446, + 1.7193285450339317, + 1.0549060050398111, + 0.39071736112236977, + 0.185635793954134, + 0.41622654907405376, + 0.7844934463500977, + 0.2182864397764206, + 0.6401842273771763, + 1.1262464635074139, + 0.5387306716293097, + 0.4644068367779255, + 0.9737894274294376, + 1.7758114039897919, + 0.9073527455329895, + 0.13654153794050217, + 0.605062548071146, + 1.0202024802565575, + 0.5053890720009804, + 0.509525690227747, + 0.780306052416563, + 3.0938469227403402, + 0.8297290429472923, + 0.9346718974411488, + 0.6705931108444929, + 1.4247268736362457, + 0.37246739864349365, + 1.3533092513680458, + 0.0, + 1.2120529636740685, + 0.0, + 0.7366046942770481, + 0.9513100124895573, + 0.3816697522997856, + 0.04037225991487503, + 0.28677184134721756, + 2.28849988989532, + 0.2749243378639221, + 0.5456689149141312, + 0.31387233920395374, + 1.00159178301692, + 2.13531444221735, + 0.4007475096732378, + 0.224501583725214, + 1.1484838053584099, + 1.9101759381592274, + 1.8886969648301601, + 0.5619045402854681, + 0.9134988561272621, + 2.5151583943516016, + 1.0166444350033998, + 1.360652219504118, + 0.39629654213786125, + 0.8809319548308849 + ], + "unique_experts": 61, + "load_cv": 0.6272745636907351, + "normalized_load_entropy": 0.9472658928262725, + "max_load_share": 0.04252873563218391 + } + }, + "s1_bos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "9c72f7a984ad70baff4a78e3aa934cbc9ecb8831f68a61cbe81b080838a5a312", + "route_weight_sha256": "28b1f0c6e85aad2a343bfd2c3643d80e1edb6236f82707e8411a4bb4049cd0c8", + "loads": [ + 3, + 16, + 0, + 10, + 8, + 14, + 28, + 1, + 12, + 28, + 2, + 18, + 20, + 10, + 0, + 9, + 6, + 4, + 11, + 10, + 9, + 7, + 10, + 12, + 24, + 2, + 13, + 12, + 6, + 4, + 20, + 25, + 14, + 17, + 12, + 15, + 2, + 8, + 0, + 16, + 1, + 7, + 23, + 6, + 1, + 6, + 9, + 10, + 5, + 8, + 6, + 20, + 8, + 5, + 24, + 15, + 7, + 14, + 16, + 22, + 17, + 29, + 12, + 11 + ], + "weighted_loads": [ + 0.1806894727051258, + 0.7172547169029713, + 0.0, + 0.4505492802709341, + 0.3959517404437065, + 0.541455453261733, + 1.9070868697017431, + 0.09274046123027802, + 0.8626516908407211, + 3.1008323654532433, + 0.14583871513605118, + 1.3935556635260582, + 1.0026138946413994, + 0.36975950561463833, + 0.0, + 0.3175858948379755, + 0.4122180938720703, + 0.2198970429599285, + 0.6824134923517704, + 0.6990922354161739, + 0.49220383167266846, + 0.322946447879076, + 0.40097229927778244, + 1.721631322056055, + 1.0201168954372406, + 0.10782162845134735, + 0.5699596703052521, + 0.9598441161215305, + 0.4510630816221237, + 0.23908023536205292, + 0.8908451944589615, + 3.0682063456624746, + 0.6376462616026402, + 0.947114571928978, + 0.6631622556596994, + 0.8624111637473106, + 0.36345426738262177, + 0.5201450251042843, + 0.0, + 0.8072374910116196, + 0.026646813377738, + 0.37600049935281277, + 0.906872496008873, + 0.3207854926586151, + 0.03777880594134331, + 0.21470286697149277, + 0.6295763123780489, + 0.4010546803474426, + 0.21357791498303413, + 0.3071044012904167, + 0.34159597754478455, + 1.8481743708252907, + 0.3372560329735279, + 0.23851634189486504, + 1.0875744707882404, + 1.12829951941967, + 0.6915667578577995, + 0.5680903755128384, + 0.9071634840220213, + 1.5656307190656662, + 1.1400987766683102, + 1.4075740948319435, + 0.43639735877513885, + 0.85556685552001 + ], + "unique_experts": 61, + "load_cv": 0.6638830776128736, + "normalized_load_entropy": 0.9420787833241712, + "max_load_share": 0.04027777777777778 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "b352199449b83d1212eca8e7fd7b14793f32dec421d2104139e9115fb9e89836", + "route_weight_sha256": "9dc4586929a0f59b8dcb2ab11c740932f58e76d7d5f2259657189996f6651c78", + "loads": [ + 3, + 17, + 3, + 11, + 10, + 14, + 43, + 2, + 17, + 34, + 2, + 28, + 24, + 11, + 9, + 11, + 17, + 4, + 13, + 20, + 11, + 11, + 11, + 13, + 25, + 4, + 13, + 13, + 7, + 7, + 20, + 28, + 20, + 18, + 16, + 23, + 3, + 26, + 0, + 25, + 1, + 12, + 25, + 6, + 2, + 8, + 27, + 13, + 8, + 8, + 15, + 26, + 9, + 8, + 24, + 26, + 24, + 14, + 16, + 33, + 22, + 29, + 12, + 11 + ], + "weighted_loads": [ + 0.1806894727051258, + 0.7521290890872478, + 0.14279655739665031, + 0.4880213048309088, + 0.5473594032227993, + 0.541455453261733, + 3.227100344374776, + 0.15400661155581474, + 1.200919609516859, + 3.804296553134918, + 0.14583871513605118, + 2.032994471490383, + 1.3324198462069035, + 0.3928647041320801, + 0.6768676340579987, + 0.4808850232511759, + 1.1923381388187408, + 0.2198970429599285, + 0.829634964466095, + 1.3915592841804028, + 0.5840664245188236, + 0.5446643494069576, + 0.947177343070507, + 1.756993554532528, + 1.0525140054523945, + 0.18567967414855957, + 0.5699596703052521, + 0.9865071512758732, + 0.48766839876770973, + 0.43983784690499306, + 0.8908451944589615, + 3.267179084941745, + 0.8273029252886772, + 0.9805633798241615, + 0.920559661462903, + 1.6464222967624664, + 0.39815858379006386, + 1.9298945739865303, + 0.0, + 1.2845887169241905, + 0.026646813377738, + 0.7889976408332586, + 0.9648245815187693, + 0.3207854926586151, + 0.12164488807320595, + 0.2780288551002741, + 2.6186335422098637, + 0.5081977732479572, + 0.40477780625224113, + 0.3071044012904167, + 0.982777789235115, + 2.087179597467184, + 0.3743738830089569, + 0.40599390864372253, + 1.0875744707882404, + 2.139930833131075, + 2.4868066534399986, + 0.5680903755128384, + 0.9071634840220213, + 2.62145640142262, + 1.4044025093317032, + 1.4075740948319435, + 0.43639735877513885, + 0.85556685552001 + ], + "unique_experts": 63, + "load_cv": 0.6152622516756561, + "normalized_load_entropy": 0.951339258438475, + "max_load_share": 0.044513457556935816 + } + }, + "s0_x": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "298fa07b303951da12b77aca85b027fec8a597e88d8e91d47abc451ed2280baa", + "route_weight_sha256": "425841dfd8754c56c1465c29b697c67d0f24fe73a1decf7f4fddbbc2518dce83", + "loads": [ + 2, + 17, + 0, + 10, + 8, + 10, + 28, + 2, + 12, + 29, + 2, + 19, + 20, + 7, + 0, + 11, + 5, + 4, + 10, + 8, + 9, + 7, + 12, + 12, + 24, + 3, + 14, + 12, + 7, + 5, + 17, + 24, + 13, + 16, + 11, + 16, + 2, + 8, + 0, + 17, + 1, + 7, + 23, + 6, + 2, + 5, + 10, + 7, + 8, + 7, + 11, + 20, + 11, + 4, + 25, + 16, + 7, + 15, + 15, + 22, + 14, + 29, + 11, + 11 + ], + "weighted_loads": [ + 0.13804866746068, + 0.7276135981082916, + 0.0, + 0.43974165990948677, + 0.40385969169437885, + 0.414647463709116, + 1.9148607589304447, + 0.12592308782041073, + 0.8315595723688602, + 3.188414290547371, + 0.145326167345047, + 1.4365145564079285, + 1.0123728774487972, + 0.272089846432209, + 0.0, + 0.37949175387620926, + 0.3903471380472183, + 0.21375856548547745, + 0.6299042329192162, + 0.6089285425841808, + 0.4980841800570488, + 0.318078126758337, + 0.4712010771036148, + 1.7323574088513851, + 0.9883445911109447, + 0.14946982264518738, + 0.5910983588546515, + 1.010831568390131, + 0.47790983133018017, + 0.2787133567035198, + 0.7824776563793421, + 3.0845980420708656, + 0.610903549939394, + 0.885240763425827, + 0.6095869895070791, + 0.9282999485731125, + 0.37733425199985504, + 0.5694844387471676, + 0.0, + 0.8443335071206093, + 0.02848942019045353, + 0.3683635722845793, + 0.8597728777676821, + 0.322729604318738, + 0.06992796249687672, + 0.18203612975776196, + 0.6892387233674526, + 0.29344168677926064, + 0.32005922868847847, + 0.2921316400170326, + 0.563377171754837, + 1.8150583431124687, + 0.42959437519311905, + 0.18178239464759827, + 1.1133978478610516, + 1.1407400034368038, + 0.6490678042173386, + 0.5917512737214565, + 0.9359719976782799, + 1.5519969556480646, + 1.0105659049004316, + 1.3920879811048508, + 0.39965431950986385, + 0.8625272251665592 + ], + "unique_experts": 61, + "load_cv": 0.6590303389483074, + "normalized_load_entropy": 0.9437531329129331, + "max_load_share": 0.04027777777777778 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "527d337c02dfe818c22b331ffbc11ffb25726791bcacf1d491e9deee7c11a75a", + "route_weight_sha256": "ac506feae74deec89743df3ff5e8aba2733e8ee59795f00c25fca0de5eb58a76", + "loads": [ + 2, + 19, + 0, + 10, + 9, + 10, + 38, + 2, + 12, + 29, + 2, + 23, + 20, + 8, + 3, + 13, + 10, + 4, + 10, + 17, + 10, + 10, + 13, + 13, + 24, + 4, + 14, + 12, + 7, + 8, + 17, + 24, + 16, + 16, + 12, + 22, + 2, + 18, + 0, + 25, + 1, + 14, + 26, + 6, + 2, + 9, + 23, + 8, + 12, + 7, + 16, + 28, + 11, + 4, + 25, + 27, + 16, + 15, + 15, + 32, + 14, + 29, + 11, + 11 + ], + "weighted_loads": [ + 0.13804866746068, + 0.7936128061264753, + 0.0, + 0.43974165990948677, + 0.4323425404727459, + 0.414647463709116, + 3.1774619705975056, + 0.12592308782041073, + 0.8315595723688602, + 3.188414290547371, + 0.145326167345047, + 1.725748099386692, + 1.0123728774487972, + 0.29519504494965076, + 0.17780900746583939, + 0.4532201550900936, + 0.7109587825834751, + 0.21375856548547745, + 0.6299042329192162, + 1.1626330129802227, + 0.5424134805798531, + 0.4634172134101391, + 1.0174061208963394, + 1.768071923404932, + 0.9883445911109447, + 0.17680222541093826, + 0.5910983588546515, + 1.010831568390131, + 0.47790983133018017, + 0.448738731443882, + 0.7824776563793421, + 3.0845980420708656, + 0.6986506748944521, + 0.885240763425827, + 0.6441549193114042, + 1.5070702321827412, + 0.37733425199985504, + 1.3349427431821823, + 0.0, + 1.1609383579343557, + 0.02848942019045353, + 0.9043867979198694, + 0.9508978463709354, + 0.322729604318738, + 0.06992796249687672, + 0.31278558634221554, + 2.003276526927948, + 0.3125429190695286, + 0.5484285913407803, + 0.2921316400170326, + 0.9564600586891174, + 2.155453123152256, + 0.42959437519311905, + 0.18178239464759827, + 1.1133978478610516, + 1.9576033055782318, + 1.5953842848539352, + 0.5917512737214565, + 0.9359719976782799, + 2.5918353628367186, + 1.0105659049004316, + 1.3920879811048508, + 0.39965431950986385, + 0.8625272251665592 + ], + "unique_experts": 62, + "load_cv": 0.6366405088703365, + "normalized_load_entropy": 0.9470874898629275, + "max_load_share": 0.04367816091954023 + } + }, + "s1_x": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "1155ab34f1199354d9e0e9e1f24679b766d1eb78ff8a128770cd59e952fccf78", + "route_weight_sha256": "dd751bc788f97caa78bb7e761bee66613eb49a0cd77d24096c237733d43432e5", + "loads": [ + 3, + 16, + 0, + 7, + 7, + 11, + 29, + 1, + 12, + 31, + 2, + 19, + 20, + 8, + 0, + 10, + 5, + 4, + 10, + 10, + 9, + 7, + 11, + 12, + 27, + 2, + 12, + 12, + 6, + 5, + 19, + 23, + 13, + 18, + 12, + 16, + 2, + 9, + 0, + 16, + 1, + 9, + 21, + 5, + 1, + 7, + 9, + 9, + 6, + 7, + 7, + 20, + 9, + 4, + 24, + 17, + 6, + 13, + 17, + 22, + 15, + 30, + 14, + 11 + ], + "weighted_loads": [ + 0.17894592508673668, + 0.7154267951846123, + 0.0, + 0.3129001595079899, + 0.34258137457072735, + 0.45396504551172256, + 1.9832325000315905, + 0.092060387134552, + 0.8488673344254494, + 3.298839934170246, + 0.14379320666193962, + 1.4439787939190865, + 0.997604763135314, + 0.30283742770552635, + 0.0, + 0.3512555379420519, + 0.3686271384358406, + 0.21970101073384285, + 0.632808580994606, + 0.669637493789196, + 0.4880465753376484, + 0.3186609745025635, + 0.4395364858210087, + 1.6859660483896732, + 1.121884386986494, + 0.10885102674365044, + 0.5322524011135101, + 0.9432281199842691, + 0.4358002692461014, + 0.2835877053439617, + 0.8296318463981152, + 3.0133961215615273, + 0.6041124165058136, + 0.9788710065186024, + 0.6630893275141716, + 0.9069977048784494, + 0.35583655536174774, + 0.599109198898077, + 0.0, + 0.8292045332491398, + 0.025147074833512306, + 0.4470012839883566, + 0.830382639542222, + 0.2949784956872463, + 0.03623036667704582, + 0.24780231900513172, + 0.6312293447554111, + 0.36138387210667133, + 0.2545700781047344, + 0.27871449291706085, + 0.39271386340260506, + 1.855568666011095, + 0.37519338354468346, + 0.1895996443927288, + 1.0902637336403131, + 1.1854909639805555, + 0.5426596477627754, + 0.5252078287303448, + 0.9342122338712215, + 1.555479185655713, + 1.0417634677141905, + 1.4780099540948868, + 0.5073841251432896, + 0.8328172974288464 + ], + "unique_experts": 61, + "load_cv": 0.6829493049168581, + "normalized_load_entropy": 0.9400679362171076, + "max_load_share": 0.043055555555555555 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "992e3adf17b2ec3aa8d0734654ba6ae9e49269dcc77f3632a1e3f76fd9433f56", + "route_weight_sha256": "b378053f01883a674efb250c47777450c176295895e47b964297a40931db677c", + "loads": [ + 3, + 17, + 3, + 8, + 9, + 11, + 46, + 2, + 17, + 37, + 2, + 28, + 24, + 9, + 9, + 12, + 15, + 4, + 12, + 22, + 11, + 11, + 12, + 13, + 29, + 4, + 12, + 13, + 7, + 8, + 19, + 26, + 18, + 19, + 16, + 24, + 3, + 25, + 0, + 25, + 1, + 16, + 23, + 5, + 2, + 9, + 25, + 11, + 9, + 7, + 15, + 27, + 10, + 7, + 24, + 29, + 22, + 13, + 17, + 34, + 20, + 30, + 14, + 11 + ], + "weighted_loads": [ + 0.17894592508673668, + 0.7503011673688889, + 0.14279655739665031, + 0.35037218406796455, + 0.49398903734982014, + 0.45396504551172256, + 3.64734392054379, + 0.15332653746008873, + 1.1871352531015873, + 4.002304121851921, + 0.14379320666193962, + 2.0334096662700176, + 1.327410714700818, + 0.3259426262229681, + 0.6738354526460171, + 0.529629485681653, + 1.104296587407589, + 0.21970101073384285, + 0.7800300531089306, + 1.4674575552344322, + 0.5799091681838036, + 0.5389629974961281, + 0.9857415296137333, + 1.721328280866146, + 1.188500463962555, + 0.18670907244086266, + 0.5322524011135101, + 0.9698911551386118, + 0.4724055863916874, + 0.47582030296325684, + 0.8296318463981152, + 3.2123688608407974, + 0.7536118552088737, + 1.012319814413786, + 0.9204867333173752, + 1.6963213924318552, + 0.39054087176918983, + 1.844828113913536, + 0.0, + 1.3065557591617107, + 0.025147074833512306, + 0.9936958942562342, + 0.8883347250521183, + 0.2949784956872463, + 0.12009644880890846, + 0.31112830713391304, + 2.2830973360687494, + 0.4117903169244528, + 0.4481806866824627, + 0.27871449291706085, + 0.9585318304598331, + 2.123978292569518, + 0.41231123358011246, + 0.3570772111415863, + 1.0902637336403131, + 2.266201602295041, + 2.167231548577547, + 0.5252078287303448, + 0.9342122338712215, + 2.6823692806065083, + 1.3060672003775835, + 1.4780099540948868, + 0.5073841251432896, + 0.8328172974288464 + ], + "unique_experts": 63, + "load_cv": 0.6397448524577599, + "normalized_load_entropy": 0.9487322705620675, + "max_load_share": 0.047619047619047616 + } + }, + "s0_period": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "dbea24d8ba1e90393326fae58e8175c5e4ef6365c7477d016a43d4e374a0f227", + "route_weight_sha256": "818290b6ff5eccd42cc3c51cd4aaa6308c7b9fd9f5d99b06369f91f0c4362ca4", + "loads": [ + 2, + 15, + 0, + 12, + 8, + 11, + 28, + 2, + 12, + 28, + 2, + 19, + 19, + 8, + 0, + 10, + 5, + 3, + 10, + 9, + 8, + 7, + 12, + 12, + 24, + 3, + 12, + 12, + 7, + 4, + 16, + 24, + 13, + 16, + 11, + 16, + 2, + 9, + 0, + 17, + 0, + 7, + 25, + 7, + 1, + 5, + 9, + 7, + 8, + 7, + 12, + 20, + 11, + 4, + 25, + 17, + 7, + 16, + 16, + 22, + 14, + 29, + 12, + 11 + ], + "weighted_loads": [ + 0.13894792273640633, + 0.6650373674929142, + 0.0, + 0.5133124198764563, + 0.391980841755867, + 0.44325608015060425, + 1.8882644772529602, + 0.12449362128973007, + 0.8348781540989876, + 3.161350518465042, + 0.1453043483197689, + 1.4429969377815723, + 0.9759722109884024, + 0.29926998913288116, + 0.0, + 0.3445621635764837, + 0.3930673897266388, + 0.1831965409219265, + 0.6265360936522484, + 0.6453870199620724, + 0.47058670595288277, + 0.3125769756734371, + 0.46621351316571236, + 1.748042143881321, + 0.9889563545584679, + 0.15054817125201225, + 0.5218985080718994, + 1.0151908490806818, + 0.49033382162451744, + 0.24129613116383553, + 0.7500082515180111, + 3.095787089318037, + 0.6101055555045605, + 0.8914280459284782, + 0.6195664163678885, + 0.9174256846308708, + 0.3731520175933838, + 0.6439515799283981, + 0.0, + 0.8527864515781403, + 0.0, + 0.37571702525019646, + 0.9409321900457144, + 0.35157271288335323, + 0.03924062103033066, + 0.1803593747317791, + 0.6193002164363861, + 0.2877363823354244, + 0.31623018346726894, + 0.2899715304374695, + 0.6009251903742552, + 1.8215833380818367, + 0.4385494776070118, + 0.18020478263497353, + 1.1182850766927004, + 1.17701599560678, + 0.6501128152012825, + 0.622343298047781, + 0.9515203777700663, + 1.5620870105922222, + 1.0038798116147518, + 1.3836653381586075, + 0.42217445373535156, + 0.8686550483107567 + ], + "unique_experts": 60, + "load_cv": 0.6629526173411688, + "normalized_load_entropy": 0.9416966287454167, + "max_load_share": 0.04027777777777778 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "0f34fdde35b7edbd254b4b637f9e54ad28035e06b8314d638accfc726a65047d", + "route_weight_sha256": "270b3d55ab30fa052d415f9f1f39bfeed5e74f873f1b234a11b95c4582b3f134", + "loads": [ + 2, + 17, + 0, + 12, + 9, + 11, + 38, + 2, + 12, + 28, + 2, + 23, + 20, + 9, + 2, + 12, + 10, + 3, + 10, + 19, + 9, + 10, + 13, + 13, + 24, + 4, + 12, + 12, + 8, + 7, + 16, + 24, + 16, + 16, + 12, + 22, + 2, + 19, + 0, + 25, + 0, + 13, + 28, + 7, + 1, + 9, + 22, + 8, + 12, + 7, + 17, + 28, + 11, + 4, + 25, + 28, + 16, + 16, + 16, + 31, + 14, + 29, + 12, + 11 + ], + "weighted_loads": [ + 0.13894792273640633, + 0.7310365755110979, + 0.0, + 0.5133124198764563, + 0.42046369053423405, + 0.44325608015060425, + 3.015323616564274, + 0.12449362128973007, + 0.8348781540989876, + 3.161350518465042, + 0.1453043483197689, + 1.7277552671730518, + 1.0299938451498747, + 0.3223751876503229, + 0.13450777158141136, + 0.41223510541021824, + 0.7131468765437603, + 0.1831965409219265, + 0.6265360936522484, + 1.2879138514399529, + 0.514916006475687, + 0.4562564417719841, + 1.012418556958437, + 1.7837566584348679, + 0.9889563545584679, + 0.17788057401776314, + 0.5218985080718994, + 1.0151908490806818, + 0.5937790311872959, + 0.41232361644506454, + 0.7500082515180111, + 3.095787089318037, + 0.6978526804596186, + 0.8914280459284782, + 0.6541343461722136, + 1.490091446787119, + 0.3731520175933838, + 1.4929428771138191, + 0.0, + 1.1693913023918867, + 0.0, + 0.8291181325912476, + 1.0354060679674149, + 0.35157271288335323, + 0.03924062103033066, + 0.3111088313162327, + 1.9181944578886032, + 0.30683761462569237, + 0.5402663629502058, + 0.2899715304374695, + 0.9932196605950594, + 2.1606881991028786, + 0.4385494776070118, + 0.18020478263497353, + 1.1182850766927004, + 2.0853368882089853, + 1.5948770269751549, + 0.622343298047781, + 0.9515203777700663, + 2.525372087955475, + 1.0038798116147518, + 1.3836653381586075, + 0.42217445373535156, + 0.8686550483107567 + ], + "unique_experts": 61, + "load_cv": 0.6416676318125658, + "normalized_load_entropy": 0.9448942601092128, + "max_load_share": 0.04367816091954023 + } + }, + "s1_period": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "2f9060466443235c7feb237769d94b4891a0211ae759b93a3566f5f564f95407", + "route_weight_sha256": "0dba29ca304e75ed746a4e39c2191728f1b12ce5cd01ecd3607a39d71fe4dc58", + "loads": [ + 3, + 17, + 0, + 7, + 7, + 13, + 29, + 1, + 12, + 31, + 2, + 19, + 20, + 9, + 0, + 10, + 5, + 4, + 10, + 10, + 9, + 7, + 10, + 12, + 27, + 2, + 12, + 12, + 6, + 6, + 20, + 23, + 14, + 17, + 11, + 16, + 2, + 9, + 0, + 17, + 1, + 9, + 22, + 5, + 1, + 4, + 8, + 8, + 5, + 7, + 8, + 20, + 9, + 4, + 22, + 18, + 6, + 12, + 18, + 22, + 16, + 30, + 13, + 11 + ], + "weighted_loads": [ + 0.17765863612294197, + 0.7359462194144726, + 0.0, + 0.31546119041740894, + 0.34433550387620926, + 0.511008819565177, + 1.9899751152843237, + 0.090873584151268, + 0.8490643352270126, + 3.282368026673794, + 0.1375577487051487, + 1.4358383491635323, + 0.9915952701121569, + 0.3393902014940977, + 0.0, + 0.3528748992830515, + 0.3693489357829094, + 0.22436732798814774, + 0.6308597214519978, + 0.6771218106150627, + 0.4884282536804676, + 0.3167486861348152, + 0.40127139165997505, + 1.6967353783547878, + 1.1426033303141594, + 0.10875844210386276, + 0.519378624856472, + 0.9413511455059052, + 0.43207504972815514, + 0.32265036180615425, + 0.8756892085075378, + 3.014442775398493, + 0.6429244466125965, + 0.9323141537606716, + 0.630683058872819, + 0.921024402603507, + 0.36173732578754425, + 0.6144037581980228, + 0.0, + 0.8519307896494865, + 0.025110123679041862, + 0.44829636812210083, + 0.8783774003386497, + 0.29390330985188484, + 0.03597310185432434, + 0.14942406117916107, + 0.5638222601264715, + 0.3364027589559555, + 0.22014611586928368, + 0.2779680844396353, + 0.4087741747498512, + 1.84627865254879, + 0.3740391004830599, + 0.18998459726572037, + 1.0357640944421291, + 1.2062765937298536, + 0.5259953513741493, + 0.4800580069422722, + 0.9704563841223717, + 1.5626631565392017, + 1.0866399612277746, + 1.48110868409276, + 0.4754516128450632, + 0.8329625725746155 + ], + "unique_experts": 61, + "load_cv": 0.6888888888888889, + "normalized_load_entropy": 0.9389242873555649, + "max_load_share": 0.043055555555555555 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "0973ea9ca079da3333eccf1f0930eed02b690ee8b8e4fa33838196416f6596f3", + "route_weight_sha256": "d3d6fdd9a416ea0c9c25663630369b66a01f9658552e42787f25cc4d5450cfae", + "loads": [ + 3, + 18, + 3, + 8, + 9, + 13, + 45, + 2, + 17, + 37, + 2, + 28, + 25, + 10, + 9, + 12, + 15, + 4, + 12, + 22, + 11, + 12, + 11, + 13, + 29, + 4, + 12, + 13, + 8, + 9, + 20, + 26, + 19, + 18, + 15, + 24, + 3, + 26, + 0, + 26, + 1, + 15, + 24, + 5, + 2, + 6, + 24, + 10, + 8, + 7, + 15, + 27, + 10, + 7, + 22, + 30, + 22, + 12, + 18, + 33, + 21, + 30, + 13, + 11 + ], + "weighted_loads": [ + 0.17765863612294197, + 0.7708205915987492, + 0.14279655739665031, + 0.3529332149773836, + 0.49574316665530205, + 0.511008819565177, + 3.472061051055789, + 0.15213973447680473, + 1.1873322539031506, + 3.9858322143554688, + 0.1375577487051487, + 2.0223961882293224, + 1.384486025199294, + 0.36249540001153946, + 0.6750939339399338, + 0.5260495040565729, + 1.1026567667722702, + 0.22436732798814774, + 0.7780811935663223, + 1.5503367520868778, + 0.5802908465266228, + 0.5815736837685108, + 0.9474764354526997, + 1.7320976108312607, + 1.211077257990837, + 0.18661648780107498, + 0.519378624856472, + 0.9680141806602478, + 0.5935614332556725, + 0.5156645327806473, + 0.8756892085075378, + 3.213415514677763, + 0.7924238853156567, + 0.9657629616558552, + 0.8880804646760225, + 1.7169145327061415, + 0.39644164219498634, + 1.9792522825300694, + 0.0, + 1.3292820155620575, + 0.025110123679041862, + 0.9046107456088066, + 0.936329485848546, + 0.29390330985188484, + 0.11983918398618698, + 0.2127500493079424, + 2.180070783942938, + 0.38680920377373695, + 0.3852260485291481, + 0.2779680844396353, + 0.9134956486523151, + 2.119094967842102, + 0.4111569505184889, + 0.35746216401457787, + 1.0357640944421291, + 2.3498810548335314, + 2.1416160725057125, + 0.4800580069422722, + 0.9704563841223717, + 2.6184888388961554, + 1.3509436938911676, + 1.48110868409276, + 0.4754516128450632, + 0.8329625725746155 + ], + "unique_experts": 63, + "load_cv": 0.6402806578699599, + "normalized_load_entropy": 0.9483884070587275, + "max_load_share": 0.046583850931677016 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 120, + "ordered_topk_exact_tokens": 82, + "set_exact_tokens": 92, + "mean_set_jaccard": 0.931547619047619, + "mean_token_weighted_tv": 0.013633452689585586, + "aggregate_load_tv": 0.03194444444444445 + }, + "system_bos": { + "tokens": 120, + "ordered_topk_exact_tokens": 60, + "set_exact_tokens": 83, + "mean_set_jaccard": 0.9047619047619048, + "mean_token_weighted_tv": 0.019120929902419447, + "aggregate_load_tv": 0.03888888888888889 + }, + "system_x": { + "tokens": 120, + "ordered_topk_exact_tokens": 57, + "set_exact_tokens": 79, + "mean_set_jaccard": 0.8934523809523811, + "mean_token_weighted_tv": 0.021359127884109815, + "aggregate_load_tv": 0.04305555555555554 + }, + "system_period": { + "tokens": 120, + "ordered_topk_exact_tokens": 64, + "set_exact_tokens": 77, + "mean_set_jaccard": 0.8922619047619048, + "mean_token_weighted_tv": 0.02141882641396175, + "aggregate_load_tv": 0.05 + }, + "bos_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 52, + "set_exact_tokens": 69, + "mean_set_jaccard": 0.8678571428571428, + "mean_token_weighted_tv": 0.025860855743909877, + "aggregate_load_tv": 0.047222222222222214 + }, + "bos_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 61, + "set_exact_tokens": 75, + "mean_set_jaccard": 0.8857142857142857, + "mean_token_weighted_tv": 0.02334397144149989, + "aggregate_load_tv": 0.04722222222222222 + }, + "x_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 58, + "set_exact_tokens": 70, + "mean_set_jaccard": 0.8773809523809525, + "mean_token_weighted_tv": 0.02501189927570522, + "aggregate_load_tv": 0.05 + }, + "x_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 53, + "set_exact_tokens": 67, + "mean_set_jaccard": 0.8648809523809524, + "mean_token_weighted_tv": 0.027798288276729484, + "aggregate_load_tv": 0.05555555555555556 + }, + "period_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 54, + "set_exact_tokens": 67, + "mean_set_jaccard": 0.868452380952381, + "mean_token_weighted_tv": 0.026145953320277235, + "aggregate_load_tv": 0.05 + }, + "period_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 54, + "set_exact_tokens": 66, + "mean_set_jaccard": 0.8607142857142859, + "mean_token_weighted_tv": 0.028458954649977386, + "aggregate_load_tv": 0.05694444444444445 + } + } + }, + "layer_07": { + "layer": 7, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "c3197a1c0656b5fb4f18c6d62999173b70e3c6f2447320573bef56893c8f9fa6", + "route_weight_sha256": "8ff05e27439e429b0945d7b7a36621a868e32a73bbf1649c79e9d87b9e0c746d", + "loads": [ + 8, + 20, + 8, + 2, + 15, + 10, + 17, + 6, + 23, + 1, + 1, + 29, + 11, + 19, + 2, + 0, + 14, + 4, + 19, + 10, + 9, + 19, + 10, + 6, + 10, + 3, + 5, + 17, + 9, + 20, + 15, + 17, + 3, + 17, + 7, + 12, + 19, + 14, + 12, + 20, + 12, + 16, + 12, + 9, + 0, + 6, + 2, + 0, + 8, + 1, + 12, + 11, + 7, + 18, + 0, + 22, + 5, + 46, + 6, + 26, + 14, + 15, + 7, + 2 + ], + "weighted_loads": [ + 0.31622091867029667, + 1.5854934230446815, + 0.28274909779429436, + 0.06688567623496056, + 0.988752344623208, + 0.4825875014066696, + 1.121321301907301, + 0.40661565214395523, + 1.5207131039351225, + 0.03819750249385834, + 0.06154637038707733, + 2.3192342035472393, + 0.8814383950084448, + 1.4774867724627256, + 0.2876162827014923, + 0.0, + 1.2514591123908758, + 0.2507232315838337, + 0.7081363387405872, + 0.43243764340877533, + 1.1610890626907349, + 1.0989068895578384, + 0.5703156385570765, + 0.21644372679293156, + 1.034995662048459, + 0.16978885605931282, + 0.34376487135887146, + 1.0717369094491005, + 0.8865124098956585, + 1.2543000020086765, + 0.59311687014997, + 0.8049486204981804, + 0.15664523094892502, + 0.6614716481417418, + 0.2615384217351675, + 0.5630404986441135, + 1.9904358610510826, + 0.5015551447868347, + 0.6263569332659245, + 1.2538907043635845, + 0.5925059299916029, + 0.8999280538409948, + 0.7059653475880623, + 0.3090939912945032, + 0.0, + 0.22586225531995296, + 0.08336765691637993, + 0.0, + 0.42645883560180664, + 0.03729153797030449, + 0.7536548227071762, + 0.46822891756892204, + 0.36238517984747887, + 2.123723343014717, + 0.0, + 1.6529853865504265, + 0.2379273995757103, + 2.7554508186876774, + 0.30176325887441635, + 2.020252965390682, + 0.8369796574115753, + 1.3029130846261978, + 0.23521260358393192, + 0.06945262476801872 + ], + "unique_experts": 60, + "load_cv": 0.7353507603455244, + "normalized_load_entropy": 0.9325305185076058, + "max_load_share": 0.06388888888888888 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "8e2f06883e22d7da097b7da7be3634b0f6e554ea58e05726f15be5b52489f4e7", + "route_weight_sha256": "7be8a7c50e3c81b2be18460f7519aaa14cc10de00c24447f1ae1399968cc1f7a", + "loads": [ + 8, + 20, + 8, + 5, + 15, + 11, + 22, + 6, + 31, + 1, + 3, + 33, + 11, + 24, + 2, + 0, + 29, + 7, + 21, + 11, + 9, + 19, + 13, + 8, + 14, + 3, + 10, + 17, + 12, + 20, + 15, + 17, + 6, + 18, + 7, + 12, + 19, + 14, + 22, + 22, + 12, + 27, + 17, + 11, + 3, + 6, + 4, + 2, + 8, + 1, + 27, + 11, + 7, + 19, + 0, + 29, + 5, + 46, + 10, + 26, + 14, + 21, + 10, + 9 + ], + "weighted_loads": [ + 0.31622091867029667, + 1.5854934230446815, + 0.28274909779429436, + 0.1778382584452629, + 0.988752344623208, + 0.5244020521640778, + 1.5724844932556152, + 0.40661565214395523, + 2.1979858111590147, + 0.03819750249385834, + 0.13301312550902367, + 2.831191085278988, + 0.8814383950084448, + 1.761255118995905, + 0.2876162827014923, + 0.0, + 3.2714412603527308, + 0.41729579865932465, + 0.7495800396427512, + 0.484911497682333, + 1.1610890626907349, + 1.0989068895578384, + 0.7409308534115553, + 0.34514389373362064, + 1.1690530800260603, + 0.16978885605931282, + 0.7862635292112827, + 1.0717369094491005, + 0.9498217208310962, + 1.2543000020086765, + 0.59311687014997, + 0.8049486204981804, + 0.270710501819849, + 0.7113546784967184, + 0.2615384217351675, + 0.5630404986441135, + 1.9904358610510826, + 0.5015551447868347, + 1.561820212751627, + 1.344403125345707, + 0.5925059299916029, + 1.8265038300305605, + 1.0450661815702915, + 0.3411270650103688, + 1.4811897315084934, + 0.22586225531995296, + 0.17492415383458138, + 0.14160805195569992, + 0.42645883560180664, + 0.03729153797030449, + 1.9075298942625523, + 0.46822891756892204, + 0.36238517984747887, + 2.155885621905327, + 0.0, + 2.3073051422834396, + 0.2379273995757103, + 2.7554508186876774, + 0.3863937985152006, + 2.020252965390682, + 0.8369796574115753, + 1.5973530188202858, + 0.2838451210409403, + 0.3364030458033085 + ], + "unique_experts": 62, + "load_cv": 0.679429944544832, + "normalized_load_entropy": 0.9427147464777424, + "max_load_share": 0.052873563218390804 + } + }, + "s1_eos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "15f3049c10c9ea6cda027082a942bea8362e8f5f1eed1dd128caab120a659a12", + "route_weight_sha256": "a5bc6213c7a5cef11bac74dbadefe98857e6410d2359f21c2ef062046c86d6de", + "loads": [ + 6, + 21, + 7, + 2, + 15, + 10, + 16, + 6, + 22, + 1, + 2, + 28, + 10, + 18, + 2, + 0, + 15, + 4, + 20, + 10, + 9, + 19, + 9, + 9, + 11, + 3, + 5, + 18, + 9, + 21, + 15, + 18, + 3, + 14, + 7, + 12, + 19, + 15, + 11, + 20, + 11, + 15, + 11, + 11, + 0, + 5, + 3, + 0, + 8, + 1, + 12, + 10, + 7, + 18, + 0, + 22, + 4, + 45, + 6, + 27, + 15, + 15, + 10, + 2 + ], + "weighted_loads": [ + 0.247743371874094, + 1.726045973598957, + 0.24112964048981667, + 0.07065987586975098, + 0.9539737533777952, + 0.48668212816119194, + 1.082156203687191, + 0.4065673463046551, + 1.4408616721630096, + 0.03592413291335106, + 0.08978740684688091, + 2.2448635622859, + 0.8708523865789175, + 1.456426365301013, + 0.2847111225128174, + 0.0, + 1.2910850867629051, + 0.2683516014367342, + 0.7474431414157152, + 0.43589260429143906, + 1.1550316885113716, + 1.0966456308960915, + 0.5344590842723846, + 0.33667347580194473, + 1.0320899691432714, + 0.16621896252036095, + 0.336156640201807, + 1.1078812256455421, + 0.8909361436963081, + 1.2724642623215914, + 0.5906799994409084, + 0.8133167438209057, + 0.15592387318611145, + 0.5549806300550699, + 0.2632536254823208, + 0.5647556874901056, + 1.9578847736120224, + 0.5473025590181351, + 0.5916078705340624, + 1.2382920682430267, + 0.5601027458906174, + 0.8244651053100824, + 0.6532485783100128, + 0.382269399240613, + 0.0, + 0.18811024352908134, + 0.11501526087522507, + 0.0, + 0.41341044940054417, + 0.038089461624622345, + 0.747901227325201, + 0.42705471999943256, + 0.359345655888319, + 2.1733536273241043, + 0.0, + 1.6141491830348969, + 0.19879281520843506, + 2.745447413995862, + 0.2939005680382252, + 2.109640557318926, + 0.8788408115506172, + 1.2906180135905743, + 0.344399506226182, + 0.07130390033125877 + ], + "unique_experts": 60, + "load_cv": 0.7282653159188418, + "normalized_load_entropy": 0.9337434954031602, + "max_load_share": 0.0625 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "de7373304f49d205600a370ba3f2afe821749b09e1c2167b6e2158fde0e7505a", + "route_weight_sha256": "b0882ad0da68d02fd81205a30aa3cfda389da1bd8e3b4373d6fb0734143b10ed", + "loads": [ + 6, + 21, + 7, + 4, + 16, + 11, + 23, + 6, + 38, + 3, + 9, + 33, + 10, + 23, + 4, + 2, + 31, + 8, + 22, + 11, + 9, + 19, + 11, + 12, + 16, + 3, + 14, + 19, + 12, + 27, + 15, + 18, + 9, + 22, + 7, + 12, + 19, + 19, + 28, + 23, + 13, + 31, + 21, + 14, + 9, + 5, + 5, + 6, + 8, + 1, + 34, + 10, + 7, + 18, + 4, + 31, + 4, + 51, + 9, + 27, + 15, + 21, + 14, + 6 + ], + "weighted_loads": [ + 0.247743371874094, + 1.726045973598957, + 0.24112964048981667, + 0.13406683690845966, + 1.0011511463671923, + 0.5308548398315907, + 1.5411723628640175, + 0.4065673463046551, + 2.8361934423446655, + 0.13665545359253883, + 0.6539829988032579, + 2.826200410723686, + 0.8708523865789175, + 1.7655073758214712, + 0.35312917083501816, + 0.0975542888045311, + 3.7388477213680744, + 0.4876111913472414, + 0.7884940942749381, + 0.48724905773997307, + 1.1550316885113716, + 1.0966456308960915, + 0.6521857492625713, + 0.4983707256615162, + 1.187406221870333, + 0.16621896252036095, + 1.1244499348104, + 1.138577213510871, + 0.954465389251709, + 2.0485922191292048, + 0.5906799994409084, + 0.8133167438209057, + 0.5406072661280632, + 1.097732661291957, + 0.2632536254823208, + 0.5647556874901056, + 1.9578847736120224, + 0.7751512955874205, + 2.3603371288627386, + 1.378564652055502, + 0.7818005308508873, + 2.2076581176370382, + 1.4243651255965233, + 0.4548017354682088, + 2.0232541486620903, + 0.18811024352908134, + 0.219093419611454, + 0.3483641594648361, + 0.41341044940054417, + 0.038089461624622345, + 2.350735740736127, + 0.42705471999943256, + 0.359345655888319, + 2.1733536273241043, + 0.20651591941714287, + 2.3835666701197624, + 0.19879281520843506, + 3.2778456676751375, + 0.3511347584426403, + 2.109640557318926, + 0.8788408115506172, + 1.5798650365322828, + 0.4297655657865107, + 0.18585599772632122 + ], + "unique_experts": 64, + "load_cv": 0.6666248717014721, + "normalized_load_entropy": 0.9487940120941428, + "max_load_share": 0.052795031055900624 + } + }, + "s0_bos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "f1688d6806197bd9fa6129465f5ec6f0d9ab5ba49249ec48eeabeeb27b799528", + "route_weight_sha256": "43b2bc1a38d6bcfc24e10ddca60c651a87dbe0bd2dfdd68b57b5142265730f56", + "loads": [ + 6, + 21, + 7, + 1, + 15, + 10, + 16, + 7, + 24, + 1, + 2, + 30, + 10, + 18, + 3, + 0, + 14, + 2, + 18, + 12, + 9, + 19, + 10, + 4, + 10, + 3, + 7, + 17, + 13, + 20, + 14, + 14, + 3, + 18, + 11, + 10, + 19, + 14, + 9, + 19, + 11, + 14, + 10, + 13, + 0, + 7, + 3, + 0, + 6, + 0, + 12, + 10, + 7, + 18, + 0, + 22, + 7, + 43, + 6, + 28, + 18, + 16, + 7, + 2 + ], + "weighted_loads": [ + 0.2494385465979576, + 1.6249142065644264, + 0.244410939514637, + 0.035877976566553116, + 0.9552409462630749, + 0.4933459758758545, + 1.0232837088406086, + 0.4597401097416878, + 1.5986559204757214, + 0.037274278700351715, + 0.08557009883224964, + 2.3547657653689384, + 0.8367190323770046, + 1.4760871827602386, + 0.3351820595562458, + 0.0, + 1.1717743128538132, + 0.1715630143880844, + 0.7119361292570829, + 0.4986951909959316, + 1.1972737237811089, + 1.0800412744283676, + 0.5758769325911999, + 0.1437654234468937, + 1.0390357300639153, + 0.1701127476990223, + 0.4360322318971157, + 1.087120682001114, + 1.077912975102663, + 1.1903293915092945, + 0.5543717108666897, + 0.7019072361290455, + 0.15573415160179138, + 0.7062929794192314, + 0.3983837142586708, + 0.47630249336361885, + 1.9944844748824835, + 0.5166702326387167, + 0.5115613341331482, + 1.2220993749797344, + 0.5609044674783945, + 0.8135794475674629, + 0.617976289242506, + 0.4480959940701723, + 0.0, + 0.25543408654630184, + 0.11483312025666237, + 0.0, + 0.334796417504549, + 0.0, + 0.7612147592008114, + 0.43320353515446186, + 0.3655168376863003, + 2.1603173315525055, + 0.0, + 1.625196011736989, + 0.3298085629940033, + 2.6094044242054224, + 0.31170380860567093, + 2.1168153658509254, + 0.9887153562158346, + 1.328686662018299, + 0.24336343631148338, + 0.06853795796632767 + ], + "unique_experts": 59, + "load_cv": 0.7277565730583474, + "normalized_load_entropy": 0.9321938112201015, + "max_load_share": 0.059722222222222225 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "e4fdb8c1515414380c701e57eb455afd69ff18692211a017fcfbc6a112135d03", + "route_weight_sha256": "4d12d57fc960808d9ff500247d0bbf749096668ea3ea7dc0cd0afadad12dc969", + "loads": [ + 6, + 21, + 7, + 4, + 15, + 11, + 21, + 7, + 32, + 1, + 4, + 34, + 10, + 23, + 3, + 0, + 29, + 6, + 21, + 13, + 9, + 19, + 13, + 6, + 13, + 3, + 12, + 17, + 15, + 20, + 14, + 14, + 6, + 20, + 11, + 10, + 19, + 14, + 18, + 22, + 11, + 25, + 15, + 14, + 3, + 7, + 6, + 2, + 6, + 0, + 27, + 10, + 7, + 20, + 0, + 29, + 7, + 43, + 9, + 28, + 18, + 22, + 9, + 9 + ], + "weighted_loads": [ + 0.2494385465979576, + 1.6249142065644264, + 0.244410939514637, + 0.14683055877685547, + 0.9552409462630749, + 0.5351605266332626, + 1.5297717787325382, + 0.4597401097416878, + 2.2760647572577, + 0.037274278700351715, + 0.16252086125314236, + 2.911985404789448, + 0.8367190323770046, + 1.759855529293418, + 0.3351820595562458, + 0.0, + 3.276309046894312, + 0.37214968726038933, + 0.7942425282672048, + 0.5560387820005417, + 1.1972737237811089, + 1.0800412744283676, + 0.7464921474456787, + 0.27608897536993027, + 1.1660106386989355, + 0.1701127476990223, + 0.882422648370266, + 1.087120682001114, + 1.1280587781220675, + 1.1903293915092945, + 0.5543717108666897, + 0.7019072361290455, + 0.2697994224727154, + 0.7957967445254326, + 0.3983837142586708, + 0.47630249336361885, + 1.9944844748824835, + 0.5166702326387167, + 1.4369163513183594, + 1.350832972675562, + 0.5609044674783945, + 1.7167774699628353, + 0.9531304612755775, + 0.46570437401533127, + 0.6540647409856319, + 0.25543408654630184, + 0.2523018345236778, + 0.15278463810682297, + 0.334796417504549, + 0.0, + 2.020715221762657, + 0.43320353515446186, + 0.3655168376863003, + 2.2364519722759724, + 0.0, + 2.279515767470002, + 0.3298085629940033, + 2.6094044242054224, + 0.3812794927507639, + 2.1168153658509254, + 0.9887153562158346, + 1.623126596212387, + 0.28633988276124, + 0.33548837900161743 + ], + "unique_experts": 61, + "load_cv": 0.6709139378166661, + "normalized_load_entropy": 0.9431222555698092, + "max_load_share": 0.04942528735632184 + } + }, + "s1_bos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "6051e218155db9f6d4eda60b826e76141a91a5ebd83f958742cc18f6fbc17a13", + "route_weight_sha256": "628612171c845af7a3215257c9c7f025d9f3fc3227e9d52f3deec1538adf989e", + "loads": [ + 5, + 20, + 8, + 1, + 15, + 10, + 16, + 7, + 22, + 0, + 2, + 30, + 9, + 20, + 3, + 0, + 12, + 3, + 19, + 11, + 9, + 19, + 9, + 6, + 9, + 3, + 6, + 16, + 11, + 20, + 14, + 15, + 3, + 20, + 9, + 8, + 20, + 14, + 9, + 20, + 11, + 14, + 11, + 13, + 0, + 6, + 4, + 1, + 6, + 0, + 12, + 11, + 7, + 19, + 0, + 21, + 6, + 45, + 6, + 27, + 20, + 15, + 10, + 2 + ], + "weighted_loads": [ + 0.2088504247367382, + 1.639615897089243, + 0.2827910501509905, + 0.03497961536049843, + 0.9309544265270233, + 0.4901016354560852, + 1.004176564514637, + 0.4640805162489414, + 1.4939701817929745, + 0.0, + 0.0912993922829628, + 2.3674600161612034, + 0.8212270773947239, + 1.5380996391177177, + 0.3275076225399971, + 0.0, + 1.1019371263682842, + 0.20896798744797707, + 0.7676801849156618, + 0.4711197968572378, + 1.2111207246780396, + 1.0855070650577545, + 0.5398554392158985, + 0.2221882976591587, + 1.026182446628809, + 0.16531753540039062, + 0.36682136356830597, + 1.0338203720748425, + 1.0636363588273525, + 1.1652044001966715, + 0.5502042211592197, + 0.7062598951160908, + 0.15748251229524612, + 0.7504653315991163, + 0.33966824039816856, + 0.39972732216119766, + 2.006570518016815, + 0.5065866578370333, + 0.48876242712140083, + 1.2418447211384773, + 0.5681794285774231, + 0.7579451240599155, + 0.6547013521194458, + 0.4537926632910967, + 0.0, + 0.22237465903162956, + 0.14614682272076607, + 0.03842047601938248, + 0.32234968803822994, + 0.0, + 0.7449556812644005, + 0.468138936907053, + 0.3614101707935333, + 2.210811860859394, + 0.0, + 1.5989151857793331, + 0.30321548134088516, + 2.692542038857937, + 0.30694080144166946, + 2.0555845126509666, + 1.0478429775685072, + 1.314082819968462, + 0.35256909392774105, + 0.0689742136746645 + ], + "unique_experts": 59, + "load_cv": 0.7381993440832485, + "normalized_load_entropy": 0.9317422074667788, + "max_load_share": 0.0625 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "e8cdcb7ef1148c57ebd542bf82c4e1554e1fa5e3f95f7495aef55c6dfc4d12bc", + "route_weight_sha256": "4d7fcc9e047f0a09ececd29aa1a3d7a13916b753204ea924ee4a869c4e106c98", + "loads": [ + 5, + 20, + 8, + 3, + 16, + 11, + 25, + 7, + 38, + 2, + 9, + 35, + 9, + 25, + 5, + 2, + 28, + 7, + 22, + 12, + 9, + 19, + 11, + 10, + 13, + 3, + 15, + 17, + 13, + 26, + 14, + 15, + 9, + 28, + 9, + 8, + 20, + 18, + 26, + 23, + 13, + 30, + 21, + 15, + 9, + 6, + 7, + 7, + 6, + 0, + 34, + 11, + 7, + 19, + 4, + 30, + 6, + 51, + 8, + 27, + 20, + 21, + 13, + 6 + ], + "weighted_loads": [ + 0.2088504247367382, + 1.639615897089243, + 0.2827910501509905, + 0.09838657639920712, + 0.9781318195164204, + 0.5342743471264839, + 1.632597390562296, + 0.4640805162489414, + 2.886557348072529, + 0.10073132067918777, + 0.6575696505606174, + 2.98421748355031, + 0.8212270773947239, + 1.847180649638176, + 0.3959256708621979, + 0.0975542888045311, + 3.579932291060686, + 0.42428474873304367, + 0.8458833424374461, + 0.5259879324585199, + 1.2111207246780396, + 1.0855070650577545, + 0.6575821042060852, + 0.4387088939547539, + 1.1742924358695745, + 0.16531753540039062, + 1.1491285488009453, + 1.0645163599401712, + 1.1134478263556957, + 1.9413323570042849, + 0.5502042211592197, + 0.7062598951160908, + 0.5421659052371979, + 1.2932173628360033, + 0.33966824039816856, + 0.39972732216119766, + 2.006570518016815, + 0.7344353944063187, + 2.269259534776211, + 1.3859580382704735, + 0.789877213537693, + 2.1355410777032375, + 1.4313280582427979, + 0.5124612376093864, + 1.1846730522811413, + 0.22237465903162956, + 0.297802671790123, + 0.39417650178074837, + 0.32234968803822994, + 0.0, + 2.5006879325956106, + 0.468138936907053, + 0.3614101707935333, + 2.210811860859394, + 0.20651591941714287, + 2.3683326728641987, + 0.30321548134088516, + 3.2249402925372124, + 0.34864007867872715, + 2.0555845126509666, + 1.0478429775685072, + 1.6033298429101706, + 0.4323910027742386, + 0.18352631106972694 + ], + "unique_experts": 63, + "load_cv": 0.6699090423233625, + "normalized_load_entropy": 0.9476977631834536, + "max_load_share": 0.052795031055900624 + } + }, + "s0_x": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "022a4c924c4556dd078851e43bff7a2c7392e6c2a1ab904ba05238e1af6504fb", + "route_weight_sha256": "3d95c12ca894efe4301ef880f7d20bc9a1634d390a97a30b823d965c876bb851", + "loads": [ + 6, + 20, + 7, + 0, + 15, + 10, + 16, + 7, + 23, + 0, + 2, + 32, + 11, + 19, + 3, + 0, + 14, + 4, + 20, + 11, + 9, + 19, + 9, + 5, + 11, + 3, + 7, + 16, + 13, + 20, + 14, + 13, + 4, + 18, + 9, + 12, + 18, + 15, + 8, + 20, + 11, + 13, + 11, + 12, + 0, + 7, + 4, + 1, + 7, + 0, + 12, + 9, + 7, + 18, + 0, + 22, + 7, + 44, + 6, + 25, + 17, + 16, + 6, + 2 + ], + "weighted_loads": [ + 0.26289620250463486, + 1.5548306927084923, + 0.24479057267308235, + 0.0, + 0.939418513327837, + 0.4948785603046417, + 1.0253203064203262, + 0.4547976851463318, + 1.5778640247881413, + 0.0, + 0.0851221140474081, + 2.477578304708004, + 0.8543998338282108, + 1.5200024340301752, + 0.33028656244277954, + 0.0, + 1.2397829219698906, + 0.21995236724615097, + 0.7717966008931398, + 0.46384985372424126, + 1.2023536264896393, + 1.0748549290001392, + 0.5365784652531147, + 0.1743653230369091, + 1.0629821456968784, + 0.16628172993659973, + 0.4610256813466549, + 1.0448689833283424, + 1.1114233955740929, + 1.1871063746511936, + 0.5583116970956326, + 0.6416488587856293, + 0.19067485257983208, + 0.6998330019414425, + 0.3249715268611908, + 0.5507134310901165, + 1.974042620509863, + 0.5614710245281458, + 0.5009952001273632, + 1.2317783273756504, + 0.5801399238407612, + 0.7716987915337086, + 0.6553417816758156, + 0.40726453624665737, + 0.0, + 0.2505071274936199, + 0.14202279970049858, + 0.03801404684782028, + 0.388448316603899, + 0.0, + 0.7671386525034904, + 0.38624121993780136, + 0.35978658869862556, + 2.0518486201763153, + 0.0, + 1.6590517722070217, + 0.32694259844720364, + 2.619305219501257, + 0.3153757192194462, + 2.031952176243067, + 0.9677425026893616, + 1.3348728343844414, + 0.20417750999331474, + 0.06799276173114777 + ], + "unique_experts": 58, + "load_cv": 0.7263981834969401, + "normalized_load_entropy": 0.9328315265960396, + "max_load_share": 0.06111111111111111 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "5c68b38a50937459181896e69ca98efea8e29aeeb4917cf442644179ccab2c3d", + "route_weight_sha256": "41017ee06c465625f17b70b9d3667703eeec7625dcc350c6cc30b6458b13bc0b", + "loads": [ + 6, + 20, + 7, + 3, + 15, + 12, + 19, + 7, + 31, + 0, + 4, + 36, + 12, + 25, + 3, + 0, + 30, + 7, + 22, + 12, + 9, + 19, + 12, + 7, + 14, + 3, + 11, + 16, + 15, + 20, + 14, + 13, + 7, + 20, + 9, + 12, + 18, + 15, + 17, + 23, + 11, + 24, + 16, + 13, + 2, + 7, + 8, + 4, + 7, + 0, + 26, + 9, + 7, + 19, + 0, + 29, + 7, + 44, + 9, + 25, + 17, + 23, + 8, + 10 + ], + "weighted_loads": [ + 0.26289620250463486, + 1.5548306927084923, + 0.24479057267308235, + 0.11095258221030235, + 0.939418513327837, + 0.5929009355604649, + 1.3117404356598854, + 0.4547976851463318, + 2.254938941448927, + 0.0, + 0.16143535263836384, + 3.034261517226696, + 0.8913466930389404, + 1.8371665105223656, + 0.33028656244277954, + 0.0, + 3.6118958108127117, + 0.39540938660502434, + 0.8132403017953038, + 0.5198363624513149, + 1.2023536264896393, + 1.0748549290001392, + 0.7071936801075935, + 0.3106882609426975, + 1.1899570543318987, + 0.16628172993659973, + 0.8684028424322605, + 1.0448689833283424, + 1.1615691985934973, + 1.1871063746511936, + 0.5583116970956326, + 0.6416488587856293, + 0.3047401234507561, + 0.7896000668406487, + 0.3249715268611908, + 0.5507134310901165, + 1.974042620509863, + 0.5614710245281458, + 1.3521263115108013, + 1.3593249469995499, + 0.5801399238407612, + 1.6221003122627735, + 0.9893235564231873, + 0.42487291619181633, + 0.6039404906332493, + 0.2505071274936199, + 0.3127877153456211, + 0.23106934875249863, + 0.388448316603899, + 0.0, + 1.8191102929413319, + 0.38624121993780136, + 0.35978658869862556, + 2.084010899066925, + 0.0, + 2.313371527940035, + 0.32694259844720364, + 2.619305219501257, + 0.38495140336453915, + 2.031952176243067, + 0.9677425026893616, + 1.682226225733757, + 0.24715395644307137, + 0.414116308093071 + ], + "unique_experts": 60, + "load_cv": 0.6699049374214688, + "normalized_load_entropy": 0.9432023065936654, + "max_load_share": 0.05057471264367816 + } + }, + "s1_x": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "aed2f45d2e55238103496588c38cfbd6fc491a5dc097634c372d7af0dac32893", + "route_weight_sha256": "77863e74ba0bef9a560066a84dc8da67dff7cfdd0233f23169b8368c560055af", + "loads": [ + 6, + 20, + 7, + 0, + 16, + 10, + 16, + 7, + 22, + 0, + 2, + 31, + 10, + 19, + 3, + 0, + 13, + 3, + 19, + 10, + 9, + 19, + 9, + 6, + 10, + 3, + 7, + 15, + 11, + 18, + 14, + 14, + 3, + 20, + 8, + 9, + 19, + 14, + 10, + 18, + 11, + 15, + 11, + 13, + 0, + 6, + 4, + 1, + 7, + 0, + 12, + 12, + 7, + 19, + 0, + 21, + 8, + 46, + 6, + 27, + 18, + 16, + 9, + 1 + ], + "weighted_loads": [ + 0.23356585949659348, + 1.5856694467365742, + 0.24377425014972687, + 0.0, + 0.9451063219457865, + 0.49426207318902016, + 0.9757196232676506, + 0.4630515016615391, + 1.5273815393447876, + 0.0, + 0.0932464450597763, + 2.3737081214785576, + 0.8429884649813175, + 1.5158762000501156, + 0.3126254267990589, + 0.0, + 1.1769683510065079, + 0.1963022295385599, + 0.7671721447259188, + 0.436697393655777, + 1.2126804664731026, + 1.0527584161609411, + 0.54302728921175, + 0.2127104178071022, + 1.0384572073817253, + 0.16241127252578735, + 0.4662291668355465, + 0.9891563728451729, + 1.0658593773841858, + 1.0867930129170418, + 0.5596389696002007, + 0.6775338761508465, + 0.1607837714254856, + 0.7474270444363356, + 0.3044023234397173, + 0.45063894242048264, + 1.9588160030543804, + 0.5267743710428476, + 0.6046874932944775, + 1.141102485358715, + 0.5897512249648571, + 0.7963915783911943, + 0.6399616859853268, + 0.44572965800762177, + 0.0, + 0.22536839172244072, + 0.14043071866035461, + 0.05209977552294731, + 0.3672337643802166, + 0.0, + 0.7354176118969917, + 0.5022293198853731, + 0.3498062565922737, + 2.220335241407156, + 0.0, + 1.6254247948527336, + 0.3746309746056795, + 2.6580379102379084, + 0.30268871411681175, + 2.0857157558202744, + 1.0061539225280285, + 1.3366170339286327, + 0.31256759352982044, + 0.03794785216450691 + ], + "unique_experts": 58, + "load_cv": 0.7371952184621497, + "normalized_load_entropy": 0.9312682417283544, + "max_load_share": 0.06388888888888888 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "2e381ded41af6e3a70b22ed3c96bc67a3302c12567e87d8b1114bd008f1ca5a0", + "route_weight_sha256": "b5f42084c557a08a6ac2e96447146b0ba1696a3293a2ab5301583f965df62d23", + "loads": [ + 6, + 20, + 7, + 2, + 17, + 12, + 22, + 7, + 38, + 2, + 9, + 36, + 10, + 25, + 5, + 2, + 30, + 8, + 21, + 11, + 9, + 19, + 11, + 10, + 15, + 3, + 16, + 16, + 13, + 24, + 14, + 14, + 9, + 28, + 8, + 9, + 19, + 18, + 25, + 21, + 13, + 30, + 21, + 15, + 8, + 6, + 8, + 8, + 7, + 0, + 33, + 12, + 7, + 19, + 4, + 30, + 8, + 52, + 8, + 27, + 18, + 23, + 12, + 6 + ], + "weighted_loads": [ + 0.23356585949659348, + 1.5856694467365742, + 0.24377425014972687, + 0.06340696103870869, + 0.9922837149351835, + 0.5926335006952286, + 1.3299956247210503, + 0.4630515016615391, + 2.9246294870972633, + 0.10073132067918777, + 0.6596626602113247, + 3.012190319597721, + 0.8429884649813175, + 1.855927836149931, + 0.3810434751212597, + 0.0975542888045311, + 3.9181157164275646, + 0.4640749339014292, + 0.8082230975851417, + 0.4858342371881008, + 1.2126804664731026, + 1.0527584161609411, + 0.6607539542019367, + 0.41330716386437416, + 1.2205650005489588, + 0.16241127252578735, + 1.2376323007047176, + 1.0198523607105017, + 1.115670844912529, + 1.8629209697246552, + 0.5596389696002007, + 0.6775338761508465, + 0.5454671643674374, + 1.2901790756732225, + 0.3044023234397173, + 0.45063894242048264, + 1.9588160030543804, + 0.754623107612133, + 2.2235862091183662, + 1.2842951491475105, + 0.811449009925127, + 2.0546262841671705, + 1.4069242216646671, + 0.5043982323259115, + 1.1491810604929924, + 0.22536839172244072, + 0.3258587568998337, + 0.4665881246328354, + 0.3672337643802166, + 0.0, + 2.2521765511482954, + 0.5022293198853731, + 0.3498062565922737, + 2.220335241407156, + 0.20651591941714287, + 2.394842281937599, + 0.3746309746056795, + 3.190436163917184, + 0.34438799135386944, + 2.0857157558202744, + 1.0061539225280285, + 1.6790816616266966, + 0.392389502376318, + 0.22104511223733425 + ], + "unique_experts": 63, + "load_cv": 0.6651829482944365, + "normalized_load_entropy": 0.948790061442648, + "max_load_share": 0.053830227743271224 + } + }, + "s0_period": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "af8363751293347161abdc4588b05e2f12d965e0580e86f19fe4ad0b6411288b", + "route_weight_sha256": "f6bd0dc5763801e78f86dbde5a7e20dd51ae7c8bea476a52f67c377c1c22f7df", + "loads": [ + 5, + 21, + 7, + 0, + 15, + 10, + 14, + 7, + 23, + 0, + 2, + 32, + 11, + 19, + 3, + 0, + 14, + 3, + 20, + 11, + 9, + 19, + 8, + 3, + 10, + 3, + 8, + 16, + 12, + 21, + 14, + 14, + 4, + 21, + 9, + 10, + 18, + 14, + 10, + 20, + 11, + 15, + 10, + 12, + 0, + 7, + 4, + 1, + 6, + 0, + 13, + 10, + 7, + 19, + 0, + 22, + 7, + 43, + 6, + 26, + 18, + 15, + 7, + 1 + ], + "weighted_loads": [ + 0.22919007018208504, + 1.5671126917004585, + 0.24216199107468128, + 0.0, + 0.9391838908195496, + 0.4943770356476307, + 0.9157467633485794, + 0.4635515697300434, + 1.611611109226942, + 0.0, + 0.08422860689461231, + 2.4846570156514645, + 0.8639313280582428, + 1.500973779708147, + 0.3346361219882965, + 0.0, + 1.2136757597327232, + 0.1906151082366705, + 0.7760859616100788, + 0.4644008446484804, + 1.207418568432331, + 1.0842963512986898, + 0.5031220726668835, + 0.11288412287831306, + 1.048431048169732, + 0.16629204899072647, + 0.5289090722799301, + 1.040913861244917, + 1.0873711369931698, + 1.2418973445892334, + 0.5556376203894615, + 0.6837946623563766, + 0.1934965681284666, + 0.7872118074446917, + 0.32594681717455387, + 0.4845533948391676, + 1.941406723111868, + 0.5133498497307301, + 0.5779136158525944, + 1.233593549579382, + 0.5899185910820961, + 0.852798480540514, + 0.6231545805931091, + 0.4049059711396694, + 0.0, + 0.2502630986273289, + 0.1424483023583889, + 0.042368754744529724, + 0.34006864205002785, + 0.0, + 0.803070142865181, + 0.4269795399159193, + 0.36129388213157654, + 2.139023683965206, + 0.0, + 1.656953290104866, + 0.3314632661640644, + 2.581609632819891, + 0.3114894740283489, + 2.0405713580548763, + 1.0132859386503696, + 1.3077382817864418, + 0.23747244104743004, + 0.0369454063475132 + ], + "unique_experts": 58, + "load_cv": 0.7371952184621497, + "normalized_load_entropy": 0.9301015596836705, + "max_load_share": 0.059722222222222225 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "ed2c75a03c365413512e9ed8ea0f75d5834f3aef15d16ba45fda152fddcecb58", + "route_weight_sha256": "0ff2b8d0b8adb444d1fa0dbc31a78491989fe3de2b4dec3a9891dac56aae69a4", + "loads": [ + 5, + 21, + 7, + 3, + 15, + 11, + 17, + 7, + 32, + 0, + 4, + 36, + 12, + 24, + 3, + 0, + 30, + 6, + 22, + 12, + 9, + 19, + 12, + 5, + 13, + 3, + 12, + 16, + 14, + 21, + 14, + 14, + 7, + 23, + 9, + 10, + 18, + 14, + 20, + 23, + 11, + 27, + 15, + 13, + 2, + 7, + 6, + 4, + 6, + 0, + 29, + 10, + 7, + 20, + 0, + 29, + 7, + 43, + 9, + 26, + 18, + 21, + 9, + 8 + ], + "weighted_loads": [ + 0.22919007018208504, + 1.5671126917004585, + 0.24216199107468128, + 0.11095258221030235, + 0.9391838908195496, + 0.5361915864050388, + 1.2021668925881386, + 0.4635515697300434, + 2.373420286923647, + 0.0, + 0.15965541265904903, + 3.048960205167532, + 0.9002098888158798, + 1.7847421262413263, + 0.3346361219882965, + 0.0, + 3.5532924123108387, + 0.3588609751313925, + 0.8175296625122428, + 0.5212670248001814, + 1.207418568432331, + 1.0842963512986898, + 0.7170025706291199, + 0.24627794697880745, + 1.1754059568047523, + 0.16629204899072647, + 0.9326523914933205, + 1.040913861244917, + 1.1375169400125742, + 1.2418973445892334, + 0.5556376203894615, + 0.6837946623563766, + 0.3075618389993906, + 0.8722695875912905, + 0.32594681717455387, + 0.4845533948391676, + 1.941406723111868, + 0.5133498497307301, + 1.5358783565461636, + 1.3595885634422302, + 0.5899185910820961, + 1.7614733166992664, + 0.9551425315439701, + 0.4225143510848284, + 0.6039404906332493, + 0.2502630986273289, + 0.23707616701722145, + 0.22750097140669823, + 0.34006864205002785, + 0.0, + 2.187591928988695, + 0.4269795399159193, + 0.36129388213157654, + 2.171185962855816, + 0.0, + 2.311273045837879, + 0.3314632661640644, + 2.581609632819891, + 0.3810651581734419, + 2.0405713580548763, + 1.0132859386503696, + 1.6021782159805298, + 0.28044888749718666, + 0.30389582738280296 + ], + "unique_experts": 60, + "load_cv": 0.689191414954765, + "normalized_load_entropy": 0.940037638220539, + "max_load_share": 0.04942528735632184 + } + }, + "s1_period": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "c39d8da56f68a963df89b9ae070d0962159ef6908bc7fcaf61c36e1f4faf95be", + "route_weight_sha256": "e9ddbe9fa82401655be432a9345bf3ce8f7ad020660486831851af929207870b", + "loads": [ + 5, + 20, + 9, + 0, + 15, + 10, + 17, + 7, + 22, + 0, + 2, + 30, + 10, + 18, + 3, + 0, + 13, + 3, + 19, + 10, + 9, + 19, + 8, + 4, + 10, + 3, + 7, + 15, + 12, + 18, + 14, + 17, + 3, + 20, + 8, + 10, + 19, + 15, + 11, + 18, + 11, + 14, + 11, + 12, + 0, + 6, + 4, + 1, + 7, + 0, + 14, + 12, + 7, + 19, + 0, + 21, + 8, + 45, + 6, + 26, + 18, + 15, + 9, + 1 + ], + "weighted_loads": [ + 0.2002912238240242, + 1.5847879648208618, + 0.3102971985936165, + 0.0, + 0.9268424995243549, + 0.494735699146986, + 1.0042719542980194, + 0.4661705829203129, + 1.5274483263492584, + 0.0, + 0.09231285192072392, + 2.331754680722952, + 0.8512051980942488, + 1.4847045242786407, + 0.3186216652393341, + 0.0, + 1.1893777027726173, + 0.19047236070036888, + 0.767361830919981, + 0.43574273586273193, + 1.2141118571162224, + 1.050137521699071, + 0.5085423961281776, + 0.14434007555246353, + 1.0397118590772152, + 0.16210442036390305, + 0.4653303921222687, + 0.9892098344862461, + 1.1147107817232609, + 1.0870768651366234, + 0.5555285215377808, + 0.7876534592360258, + 0.16212011128664017, + 0.745610911399126, + 0.3036275636404753, + 0.4882541112601757, + 1.9462621957063675, + 0.5500370617955923, + 0.6379275619983673, + 1.140229545533657, + 0.5973763093352318, + 0.7668376639485359, + 0.6430474817752838, + 0.40546260215342045, + 0.0, + 0.22263756021857262, + 0.13967213965952396, + 0.049930207431316376, + 0.3645870294421911, + 0.0, + 0.8023616969585419, + 0.5018135849386454, + 0.35376686230301857, + 2.2132330127060413, + 0.0, + 1.6262591071426868, + 0.36863324232399464, + 2.6084138434380293, + 0.3049643225967884, + 2.045967012643814, + 1.0031859315931797, + 1.3073281049728394, + 0.3161604106426239, + 0.03755324333906174 + ], + "unique_experts": 58, + "load_cv": 0.728434817914834, + "normalized_load_entropy": 0.9316485106801486, + "max_load_share": 0.0625 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "3abda30d6ecea1d84f3eaaa7ce76001cc36b45cabab8ce31a7725c5653a26ad9", + "route_weight_sha256": "22b93fae4a38c7bb28c3a477bfbfe6d2a3db68851b55394544cb25a499b2281b", + "loads": [ + 5, + 20, + 9, + 2, + 16, + 11, + 23, + 7, + 39, + 2, + 9, + 35, + 10, + 23, + 5, + 2, + 30, + 8, + 21, + 11, + 9, + 19, + 11, + 7, + 14, + 3, + 16, + 16, + 14, + 24, + 14, + 17, + 10, + 28, + 8, + 10, + 19, + 19, + 28, + 21, + 13, + 30, + 21, + 14, + 8, + 6, + 6, + 8, + 7, + 0, + 37, + 12, + 7, + 19, + 4, + 30, + 8, + 51, + 8, + 26, + 18, + 21, + 12, + 5 + ], + "weighted_loads": [ + 0.2002912238240242, + 1.5847879648208618, + 0.3102971985936165, + 0.06340696103870869, + 0.974019892513752, + 0.5389084108173847, + 1.3570295311510563, + 0.4661705829203129, + 2.9759261943399906, + 0.10073132067918777, + 0.6595154237002134, + 2.94774467125535, + 0.8512051980942488, + 1.793785534799099, + 0.3870397135615349, + 0.0975542888045311, + 3.8493841774761677, + 0.45239825919270515, + 0.8084127837792039, + 0.4848617836833, + 1.2141118571162224, + 1.050137521699071, + 0.6587025783956051, + 0.3113086186349392, + 1.1878218483179808, + 0.16210442036390305, + 1.2311397194862366, + 1.019905822351575, + 1.164522249251604, + 1.8632048219442368, + 0.5555285215377808, + 0.7876534592360258, + 0.5798865556716919, + 1.288362942636013, + 0.3036275636404753, + 0.4882541112601757, + 1.9462621957063675, + 0.7778857983648777, + 2.3519605360925198, + 1.2839028276503086, + 0.8190740942955017, + 2.08262887224555, + 1.4113404527306557, + 0.4641311764717102, + 1.1491810604929924, + 0.22263756021857262, + 0.2437502983957529, + 0.44037899002432823, + 0.3645870294421911, + 0.0, + 2.7294767554849386, + 0.5018135849386454, + 0.35376686230301857, + 2.2132330127060413, + 0.20651591941714287, + 2.3956765942275524, + 0.36863324232399464, + 3.140812097117305, + 0.3466635998338461, + 2.045967012643814, + 1.0031859315931797, + 1.596575127914548, + 0.39598231948912144, + 0.15210534073412418 + ], + "unique_experts": 63, + "load_cv": 0.6734827667876272, + "normalized_load_entropy": 0.947398158065813, + "max_load_share": 0.052795031055900624 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 120, + "ordered_topk_exact_tokens": 77, + "set_exact_tokens": 92, + "mean_set_jaccard": 0.931547619047619, + "mean_token_weighted_tv": 0.014219435133660833, + "aggregate_load_tv": 0.027777777777777776 + }, + "system_bos": { + "tokens": 120, + "ordered_topk_exact_tokens": 65, + "set_exact_tokens": 81, + "mean_set_jaccard": 0.905357142857143, + "mean_token_weighted_tv": 0.01889765614954134, + "aggregate_load_tv": 0.033333333333333326 + }, + "system_x": { + "tokens": 120, + "ordered_topk_exact_tokens": 74, + "set_exact_tokens": 85, + "mean_set_jaccard": 0.9148809523809525, + "mean_token_weighted_tv": 0.01966124875470996, + "aggregate_load_tv": 0.033333333333333326 + }, + "system_period": { + "tokens": 120, + "ordered_topk_exact_tokens": 67, + "set_exact_tokens": 83, + "mean_set_jaccard": 0.9101190476190477, + "mean_token_weighted_tv": 0.020365842594765128, + "aggregate_load_tv": 0.030555555555555558 + }, + "bos_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 58, + "set_exact_tokens": 75, + "mean_set_jaccard": 0.880357142857143, + "mean_token_weighted_tv": 0.02511588075819115, + "aggregate_load_tv": 0.04722222222222222 + }, + "bos_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 54, + "set_exact_tokens": 69, + "mean_set_jaccard": 0.867857142857143, + "mean_token_weighted_tv": 0.027684388728812338, + "aggregate_load_tv": 0.04722222222222222 + }, + "x_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 56, + "set_exact_tokens": 69, + "mean_set_jaccard": 0.8696428571428572, + "mean_token_weighted_tv": 0.027693035430274904, + "aggregate_load_tv": 0.04583333333333332 + }, + "x_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 56, + "set_exact_tokens": 71, + "mean_set_jaccard": 0.8662698412698414, + "mean_token_weighted_tv": 0.030795923193606238, + "aggregate_load_tv": 0.048611111111111105 + }, + "period_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 52, + "set_exact_tokens": 69, + "mean_set_jaccard": 0.866468253968254, + "mean_token_weighted_tv": 0.02853703199264904, + "aggregate_load_tv": 0.05277777777777778 + }, + "period_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 53, + "set_exact_tokens": 70, + "mean_set_jaccard": 0.8638888888888889, + "mean_token_weighted_tv": 0.031011116760782897, + "aggregate_load_tv": 0.04861111111111111 + } + } + }, + "layer_08": { + "layer": 8, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "7dc99dfb8a45ca6c1c20182bd4d84d607c1b24f9feeef9aa584ded8b6a03aa37", + "route_weight_sha256": "ace187f382a6a18b9e97ea2a7ba51e985b732dae1e89426bcb9458b4a0f311d9", + "loads": [ + 10, + 19, + 1, + 9, + 17, + 0, + 23, + 11, + 34, + 1, + 13, + 11, + 21, + 7, + 17, + 15, + 12, + 18, + 5, + 4, + 15, + 3, + 3, + 5, + 19, + 5, + 11, + 8, + 6, + 1, + 29, + 1, + 19, + 20, + 2, + 3, + 5, + 0, + 0, + 16, + 23, + 28, + 14, + 8, + 5, + 9, + 9, + 10, + 24, + 8, + 9, + 18, + 6, + 23, + 4, + 20, + 20, + 4, + 15, + 24, + 7, + 6, + 0, + 7 + ], + "weighted_loads": [ + 0.5497009884566069, + 1.2502315752208233, + 0.026765134185552597, + 0.39464690908789635, + 0.714151818305254, + 0.0, + 1.436573252081871, + 0.6197429709136486, + 2.4017695747315884, + 0.04346784949302673, + 0.7079722657799721, + 0.9022647198289633, + 1.6798044741153717, + 0.39505984261631966, + 0.9150182455778122, + 0.7335178330540657, + 0.44759344309568405, + 0.9027543812990189, + 0.22638013772666454, + 0.1613595373928547, + 0.7911400943994522, + 0.1784168928861618, + 0.118282001465559, + 0.16316079534590244, + 1.412010584026575, + 0.26966648548841476, + 0.7704856917262077, + 0.38495891354978085, + 0.30911583453416824, + 0.054831843823194504, + 1.3172835055738688, + 0.057430535554885864, + 1.9797080773860216, + 0.8754284232854843, + 0.12434209138154984, + 0.1503307856619358, + 0.16186446696519852, + 0.0, + 0.0, + 0.8500004559755325, + 0.9103266447782516, + 1.1140923649072647, + 0.7279624156653881, + 0.3164135627448559, + 0.1853325068950653, + 0.5746280215680599, + 0.569041233509779, + 0.8641257882118225, + 1.4946033023297787, + 0.34955983981490135, + 1.3436108157038689, + 1.8086304552853107, + 0.6533062532544136, + 2.2812246903777122, + 0.13886631652712822, + 1.285444799810648, + 0.79210090264678, + 0.13082542456686497, + 0.7568228989839554, + 1.1622580587863922, + 0.3252297304570675, + 0.2240971028804779, + 0.0, + 0.3319115899503231 + ], + "unique_experts": 60, + "load_cv": 0.7329965556653619, + "normalized_load_entropy": 0.9296156976639893, + "max_load_share": 0.04722222222222222 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "c58a1e31dfc2120791b827fcedd2bf8b0e53eefe44b3b95d743fdab31496675b", + "route_weight_sha256": "8369f4219cc4ee6f603aa5720c85ecb97cf531a37e02a0c6221db3ff07fa658a", + "loads": [ + 10, + 25, + 2, + 9, + 19, + 0, + 28, + 12, + 44, + 1, + 14, + 14, + 28, + 13, + 17, + 16, + 12, + 21, + 5, + 4, + 15, + 3, + 5, + 5, + 19, + 18, + 11, + 8, + 6, + 1, + 31, + 1, + 23, + 35, + 2, + 3, + 5, + 0, + 0, + 22, + 30, + 28, + 14, + 8, + 5, + 16, + 16, + 14, + 24, + 11, + 11, + 18, + 17, + 23, + 8, + 28, + 20, + 4, + 19, + 24, + 7, + 6, + 2, + 10 + ], + "weighted_loads": [ + 0.5497009884566069, + 1.6179236192256212, + 0.03896896541118622, + 0.39464690908789635, + 0.7770801794249564, + 0.0, + 1.8084915727376938, + 0.6647202260792255, + 3.160272680222988, + 0.04346784949302673, + 0.752753235399723, + 0.993767824023962, + 2.0598006695508957, + 0.8233697712421417, + 0.9150182455778122, + 0.7741368301212788, + 0.44759344309568405, + 1.0675419233739376, + 0.22638013772666454, + 0.1613595373928547, + 0.7911400943994522, + 0.1784168928861618, + 0.1910877227783203, + 0.16316079534590244, + 1.412010584026575, + 1.134247250854969, + 0.7704856917262077, + 0.38495891354978085, + 0.30911583453416824, + 0.054831843823194504, + 1.3398982021026313, + 0.057430535554885864, + 2.1514990646392107, + 1.9868461545556784, + 0.12434209138154984, + 0.1503307856619358, + 0.16186446696519852, + 0.0, + 0.0, + 1.0127872438170016, + 1.2737516164779663, + 1.1140923649072647, + 0.7279624156653881, + 0.3164135627448559, + 0.1853325068950653, + 1.138821043074131, + 1.260153140872717, + 0.9850797103717923, + 1.4946033023297787, + 0.5173934288322926, + 1.4729627333581448, + 1.8086304552853107, + 1.3135127890855074, + 2.2812246903777122, + 1.7165680136531591, + 1.7979616019874811, + 0.79210090264678, + 0.13082542456686497, + 0.874002514174208, + 1.1622580587863922, + 0.3252297304570675, + 0.2240971028804779, + 0.08388438820838928, + 0.5380865894258022 + ], + "unique_experts": 61, + "load_cv": 0.722962008176237, + "normalized_load_entropy": 0.9319738613437384, + "max_load_share": 0.05057471264367816 + } + }, + "s1_eos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "aecd994236a00988b473bc0df7e042100de382b3e3b74823199ac713cbfbfa95", + "route_weight_sha256": "135509d77382f79ed834529d98166d7a96ba1e40bf6c91153a905ab5b7cfc4aa", + "loads": [ + 9, + 20, + 2, + 11, + 16, + 0, + 23, + 11, + 34, + 2, + 13, + 11, + 21, + 6, + 15, + 19, + 12, + 18, + 6, + 5, + 16, + 3, + 2, + 5, + 19, + 5, + 11, + 8, + 7, + 1, + 27, + 1, + 18, + 17, + 2, + 3, + 11, + 0, + 2, + 16, + 22, + 27, + 13, + 8, + 5, + 7, + 8, + 11, + 24, + 8, + 9, + 18, + 6, + 23, + 2, + 20, + 19, + 4, + 15, + 22, + 8, + 6, + 0, + 7 + ], + "weighted_loads": [ + 0.5011159405112267, + 1.256115972995758, + 0.05721361003816128, + 0.4830479081720114, + 0.6805706676095724, + 0.0, + 1.4095509722828865, + 0.6209449507296085, + 2.4000358656048775, + 0.07361441664397717, + 0.7074630279093981, + 0.8870425932109356, + 1.6485578641295433, + 0.3452949710190296, + 0.830216821283102, + 0.9265692494809628, + 0.45673393085598946, + 0.8705730177462101, + 0.2639961205422878, + 0.19032446295022964, + 0.8235503565520048, + 0.1691269539296627, + 0.08165084198117256, + 0.16553656943142414, + 1.534427359700203, + 0.2549440562725067, + 0.7683531567454338, + 0.3884963449090719, + 0.34080195613205433, + 0.05509902536869049, + 1.245569258928299, + 0.057904817163944244, + 1.9358364827930927, + 0.7508772574365139, + 0.12157338485121727, + 0.1615580953657627, + 0.3663325924426317, + 0.0, + 0.07721935212612152, + 0.8580722101032734, + 0.8750371597707272, + 1.1031643990427256, + 0.6845271922647953, + 0.3303321339190006, + 0.18271121755242348, + 0.46751974523067474, + 0.5116846859455109, + 0.9029021803289652, + 1.486287884414196, + 0.3531286418437958, + 1.328721959143877, + 1.8322026766836643, + 0.6538040656596422, + 2.2382109835743904, + 0.0802443940192461, + 1.296433001756668, + 0.781684510409832, + 0.12994654849171638, + 0.8276161551475525, + 1.1030330378562212, + 0.3505846783518791, + 0.22865695133805275, + 0.0, + 0.3248143121600151 + ], + "unique_experts": 61, + "load_cv": 0.7079792143143996, + "normalized_load_entropy": 0.9345804218554605, + "max_load_share": 0.04722222222222222 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "1306dff41c48b93adc7f232fa0b06a2bc8ce2ff8db641c793e050df698c02460", + "route_weight_sha256": "1ee68ec917a59a2a46365869808f19d7c8054d28cf5fe4469a0c3943ac852350", + "loads": [ + 10, + 26, + 12, + 13, + 16, + 1, + 34, + 12, + 48, + 2, + 17, + 15, + 30, + 12, + 15, + 20, + 12, + 32, + 7, + 5, + 16, + 3, + 3, + 9, + 19, + 18, + 11, + 10, + 7, + 1, + 29, + 1, + 21, + 37, + 2, + 3, + 11, + 0, + 8, + 21, + 35, + 27, + 15, + 8, + 5, + 20, + 22, + 15, + 27, + 13, + 13, + 18, + 15, + 29, + 6, + 31, + 19, + 4, + 18, + 24, + 8, + 10, + 3, + 12 + ], + "weighted_loads": [ + 0.5401260405778885, + 1.5745149068534374, + 0.6789267007261515, + 0.5842072870582342, + 0.6805706676095724, + 0.044180549681186676, + 2.281751587986946, + 0.6560790278017521, + 3.3831610195338726, + 0.07361441664397717, + 0.8873128946870565, + 1.0062737623229623, + 2.184785958379507, + 0.751694705337286, + 0.830216821283102, + 0.9700572714209557, + 0.45673393085598946, + 1.8736486434936523, + 0.3109086602926254, + 0.19032446295022964, + 0.8235503565520048, + 0.1691269539296627, + 0.12156085669994354, + 0.355471720919013, + 1.534427359700203, + 1.4589538872241974, + 0.7683531567454338, + 0.5085698682814837, + 0.34080195613205433, + 0.05509902536869049, + 1.2683765711262822, + 0.057904817163944244, + 2.0444965846836567, + 2.095148738473654, + 0.12157338485121727, + 0.1615580953657627, + 0.3663325924426317, + 0.0, + 0.47033146396279335, + 0.9743884261697531, + 1.4592404216527939, + 1.1031643990427256, + 0.8536198548972607, + 0.3303321339190006, + 0.18271121755242348, + 1.578016310930252, + 1.5255293808877468, + 1.0173612218350172, + 1.8004276677966118, + 0.6870936714112759, + 1.5568979196250439, + 1.8322026766836643, + 1.1782343797385693, + 2.914188340306282, + 1.664102977141738, + 2.041397836059332, + 0.781684510409832, + 0.12994654849171638, + 0.929908067220822, + 1.1755469534546137, + 0.3505846783518791, + 0.4168711490929127, + 0.13857794180512428, + 0.6203858628869057 + ], + "unique_experts": 63, + "load_cv": 0.6841921825036398, + "normalized_load_entropy": 0.9414293921790063, + "max_load_share": 0.049689440993788817 + } + }, + "s0_bos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "4b3ce36e441a7fe6a74d242f4ca96d4dbd97c07398c9dab138a09fffdb413e89", + "route_weight_sha256": "8f91096ecb27bfd911872215c0f48822e54e6f04a112486f1f5ed0fcc9c6cdda", + "loads": [ + 11, + 19, + 1, + 10, + 13, + 1, + 22, + 10, + 36, + 2, + 12, + 12, + 21, + 8, + 13, + 16, + 13, + 16, + 5, + 5, + 15, + 3, + 1, + 6, + 19, + 8, + 11, + 8, + 7, + 1, + 29, + 1, + 20, + 20, + 2, + 4, + 4, + 0, + 1, + 16, + 22, + 27, + 14, + 6, + 5, + 10, + 8, + 10, + 24, + 8, + 9, + 18, + 7, + 24, + 4, + 19, + 18, + 6, + 17, + 21, + 7, + 7, + 0, + 7 + ], + "weighted_loads": [ + 0.5673847142606974, + 1.2653314247727394, + 0.025292107835412025, + 0.42712501995265484, + 0.5464429222047329, + 0.039527151733636856, + 1.413222000002861, + 0.5921287201344967, + 2.4184257965534925, + 0.07453407347202301, + 0.6620497386902571, + 0.9669991303235292, + 1.651458039879799, + 0.4165154527872801, + 0.7589777857065201, + 0.7418746761977673, + 0.4782494939863682, + 0.8502740059047937, + 0.22157703898847103, + 0.18391112610697746, + 0.7697495277971029, + 0.18028616905212402, + 0.03762705251574516, + 0.19458133913576603, + 1.4647744074463844, + 0.45323972404003143, + 0.7820731289684772, + 0.391106391325593, + 0.3458509258925915, + 0.05467045679688454, + 1.3008390944451094, + 0.05678914859890938, + 2.0354682952165604, + 0.9147416204214096, + 0.12477236427366734, + 0.20664964616298676, + 0.12851826287806034, + 0.0, + 0.03528251498937607, + 0.8645073585212231, + 0.852740591391921, + 1.0887292064726353, + 0.750737838447094, + 0.23518916219472885, + 0.17576781660318375, + 0.6067568622529507, + 0.48692959919571877, + 0.9020399022847414, + 1.4783060923218727, + 0.35532450675964355, + 1.3048030883073807, + 1.8219959065318108, + 0.702350340783596, + 2.344692640006542, + 0.14225321263074875, + 1.257645420730114, + 0.7396632116287947, + 0.19928063824772835, + 0.8272246886044741, + 1.0727626886218786, + 0.31753039732575417, + 0.244580814614892, + 0.0, + 0.32864508032798767 + ], + "unique_experts": 62, + "load_cv": 0.71267189825887, + "normalized_load_entropy": 0.9350052678160408, + "max_load_share": 0.05 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "31b4c6f884e36ce678ed1ae0b56956a0aa446e690660a92c8d2fd761d7f454be", + "route_weight_sha256": "56a6df84236ee619d76f08863af7dc6072d4d2aa8567a3a3f8e0c4f37cc95cf0", + "loads": [ + 11, + 25, + 2, + 10, + 14, + 1, + 27, + 11, + 46, + 2, + 14, + 16, + 28, + 14, + 13, + 17, + 13, + 19, + 5, + 5, + 15, + 3, + 3, + 6, + 20, + 21, + 11, + 8, + 7, + 1, + 31, + 1, + 25, + 36, + 2, + 4, + 4, + 0, + 1, + 22, + 28, + 27, + 14, + 6, + 5, + 17, + 14, + 13, + 24, + 11, + 11, + 18, + 18, + 24, + 8, + 27, + 18, + 6, + 20, + 21, + 7, + 7, + 2, + 10 + ], + "weighted_loads": [ + 0.5673847142606974, + 1.6330234687775373, + 0.03749593906104565, + 0.42712501995265484, + 0.606560755521059, + 0.039527151733636856, + 1.774592500180006, + 0.6371059753000736, + 3.182690465822816, + 0.07453407347202301, + 0.7502603512257338, + 1.1002747416496277, + 2.031454235315323, + 0.8448253814131021, + 0.7589777857065201, + 0.7884332090616226, + 0.4782494939863682, + 1.0029816683381796, + 0.22157703898847103, + 0.18391112610697746, + 0.7697495277971029, + 0.18028616905212402, + 0.11043277382850647, + 0.19458133913576603, + 1.5111360400915146, + 1.3434059247374535, + 0.7820731289684772, + 0.391106391325593, + 0.3458509258925915, + 0.05467045679688454, + 1.3743206430226564, + 0.05678914859890938, + 2.265718687325716, + 2.0931176226586103, + 0.12477236427366734, + 0.20664964616298676, + 0.12851826287806034, + 0.0, + 0.03528251498937607, + 1.0833613881841302, + 1.2041597831994295, + 1.0887292064726353, + 0.750737838447094, + 0.23518916219472885, + 0.17576781660318375, + 1.1379313841462135, + 1.0644501261413097, + 1.0136237181723118, + 1.4783060923218727, + 0.5225115418434143, + 1.4341550059616566, + 1.8219959065318108, + 1.3625568766146898, + 2.344692640006542, + 0.8481702711433172, + 1.786994380876422, + 0.7396632116287947, + 0.19928063824772835, + 0.9413643795996904, + 1.0727626886218786, + 0.31753039732575417, + 0.244580814614892, + 0.08805491030216217, + 0.5348200798034668 + ], + "unique_experts": 63, + "load_cv": 0.7170903171305877, + "normalized_load_entropy": 0.935390974452817, + "max_load_share": 0.052873563218390804 + } + }, + "s1_bos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "0112ec8c8e0d9e89c82464c94a376f3272c1d5b991384c3f7b23dac3366a079b", + "route_weight_sha256": "7313c98fce501f2c597185ac07a092cbbbb2256b6871db87fe07918f4d975918", + "loads": [ + 11, + 21, + 2, + 10, + 14, + 0, + 23, + 10, + 37, + 2, + 12, + 12, + 21, + 7, + 12, + 19, + 13, + 21, + 5, + 7, + 14, + 3, + 2, + 7, + 19, + 9, + 11, + 8, + 7, + 1, + 27, + 1, + 20, + 15, + 2, + 3, + 6, + 0, + 0, + 16, + 21, + 26, + 14, + 5, + 4, + 7, + 9, + 10, + 23, + 7, + 9, + 18, + 7, + 23, + 4, + 20, + 18, + 5, + 16, + 22, + 8, + 7, + 0, + 7 + ], + "weighted_loads": [ + 0.5653036944568157, + 1.3142415583133698, + 0.0757058709859848, + 0.4250493664294481, + 0.5770677905529737, + 0.0, + 1.4533165842294693, + 0.6040216721594334, + 2.5671628955751657, + 0.07356510311365128, + 0.6536485459655523, + 0.9638186637312174, + 1.6308717355132103, + 0.40913236886262894, + 0.7202750742435455, + 0.9045167788863182, + 0.47694075107574463, + 0.9586363211274147, + 0.22829938121140003, + 0.23981621861457825, + 0.7444475684314966, + 0.1831762231886387, + 0.07718989625573158, + 0.22230824828147888, + 1.5117442049086094, + 0.4915693588554859, + 0.7826534956693649, + 0.4013231433928013, + 0.3449033237993717, + 0.05267208069562912, + 1.2406275644898415, + 0.05776247754693031, + 2.043300163000822, + 0.706799803301692, + 0.12202453054487705, + 0.16761144250631332, + 0.19400516897439957, + 0.0, + 0.0, + 0.8769860658794641, + 0.8217417150735855, + 1.0813063737004995, + 0.731592383235693, + 0.19745956733822823, + 0.1390742752701044, + 0.48063279688358307, + 0.4711872711777687, + 0.8999056704342365, + 1.4413217268884182, + 0.32290981337428093, + 1.3067132644355297, + 1.764935303479433, + 0.6911137886345387, + 2.2896345891058445, + 0.14173470064997673, + 1.270193088799715, + 0.7767405137419701, + 0.16203001700341702, + 0.8271036557853222, + 1.1342540215700865, + 0.3524829763919115, + 0.2511503994464874, + 0.0, + 0.32973121851682663 + ], + "unique_experts": 60, + "load_cv": 0.7147476460477952, + "normalized_load_entropy": 0.933667981275428, + "max_load_share": 0.05138888888888889 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "fe15fa08e56b4d714515550df9eeb7ca7cb75143b59f00129b613b26768ed229", + "route_weight_sha256": "3f9c9580d8698de8850d646b853450c9a55bb943c56119aab7591a1cccdab506", + "loads": [ + 12, + 27, + 12, + 12, + 15, + 1, + 34, + 11, + 51, + 2, + 16, + 15, + 30, + 13, + 12, + 21, + 13, + 36, + 6, + 7, + 15, + 3, + 3, + 11, + 19, + 21, + 11, + 10, + 7, + 1, + 30, + 1, + 23, + 35, + 2, + 3, + 6, + 0, + 6, + 21, + 32, + 26, + 16, + 5, + 4, + 21, + 23, + 13, + 26, + 13, + 13, + 18, + 16, + 29, + 7, + 31, + 18, + 5, + 18, + 23, + 8, + 11, + 3, + 13 + ], + "weighted_loads": [ + 0.6043137945234776, + 1.6326404921710491, + 0.697418961673975, + 0.5280347783118486, + 0.6232936661690474, + 0.044180549681186676, + 2.318457920104265, + 0.6391557492315769, + 3.5609644521027803, + 0.07356510311365128, + 0.8419529031962156, + 1.079884273931384, + 2.167099829763174, + 0.8155321031808853, + 0.7202750742435455, + 0.9836629219353199, + 0.47694075107574463, + 1.9983114823698997, + 0.27521192096173763, + 0.23981621861457825, + 0.7899464871734381, + 0.1831762231886387, + 0.11709991097450256, + 0.41224339976906776, + 1.5117442049086094, + 1.6627505235373974, + 0.7826534956693649, + 0.521396666765213, + 0.3449033237993717, + 0.05267208069562912, + 1.34411258995533, + 0.05776247754693031, + 2.151960264891386, + 2.1228642594069242, + 0.12202453054487705, + 0.16761144250631332, + 0.19400516897439957, + 0.0, + 0.39311211183667183, + 1.037246429361403, + 1.3669862411916256, + 1.0813063737004995, + 0.9006850458681583, + 0.19745956733822823, + 0.1390742752701044, + 1.6316494829952717, + 1.4485638029873371, + 1.005338003858924, + 1.755461510270834, + 0.6989317759871483, + 1.5348892249166965, + 1.764935303479433, + 1.2155441027134657, + 2.965611945837736, + 0.8106506168842316, + 2.026339467614889, + 0.7767405137419701, + 0.16203001700341702, + 0.9264929294586182, + 1.1674037631601095, + 0.3524829763919115, + 0.43936459720134735, + 0.14643215760588646, + 0.6775039359927177 + ], + "unique_experts": 63, + "load_cv": 0.6996551250438645, + "normalized_load_entropy": 0.9393553449756813, + "max_load_share": 0.052795031055900624 + } + }, + "s0_x": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "f62750fbd206d2e36f9cf069c5d226aaeb4f85f633cbe1e7adfa1b1a423fded8", + "route_weight_sha256": "e39c96b214982cace4401f8d3f9a09dd9379d04f03d8a0dafd4d0fa35cb2379c", + "loads": [ + 10, + 19, + 2, + 10, + 15, + 1, + 22, + 10, + 35, + 2, + 12, + 12, + 21, + 7, + 13, + 15, + 12, + 17, + 5, + 7, + 15, + 3, + 1, + 5, + 19, + 8, + 11, + 8, + 7, + 1, + 27, + 1, + 20, + 18, + 2, + 4, + 7, + 0, + 0, + 16, + 22, + 26, + 14, + 8, + 5, + 10, + 9, + 10, + 24, + 9, + 9, + 17, + 6, + 23, + 4, + 20, + 19, + 6, + 16, + 21, + 8, + 7, + 0, + 7 + ], + "weighted_loads": [ + 0.5536837354302406, + 1.2656077556312084, + 0.05305795185267925, + 0.4188569597899914, + 0.5953228883445263, + 0.040581174194812775, + 1.4228405058383942, + 0.594735587015748, + 2.5484581477940083, + 0.07344432920217514, + 0.6417033355683088, + 0.9586681239306927, + 1.6670535076409578, + 0.388256948441267, + 0.760140735656023, + 0.7040941156446934, + 0.44409552961587906, + 0.8377669900655746, + 0.22610127553343773, + 0.2420796938240528, + 0.7551651932299137, + 0.17900509387254715, + 0.03840840607881546, + 0.1614396870136261, + 1.3943525403738022, + 0.4292895719408989, + 0.7932655550539494, + 0.38458809442818165, + 0.3371039740741253, + 0.052330851554870605, + 1.2100908607244492, + 0.058381855487823486, + 2.056316899135709, + 0.7856856882572174, + 0.1302772369235754, + 0.20724767073988914, + 0.226254403591156, + 0.0, + 0.0, + 0.8620954863727093, + 0.862022852525115, + 1.1058945506811142, + 0.7542847879230976, + 0.31395305693149567, + 0.17019023932516575, + 0.6214958652853966, + 0.5049198269844055, + 0.8915414158254862, + 1.4874719642102718, + 0.3982769213616848, + 1.312525425106287, + 1.6039952635765076, + 0.6621424686163664, + 2.332087118178606, + 0.14101442508399487, + 1.307420652359724, + 0.7759030554443598, + 0.20008298009634018, + 0.8052244931459427, + 1.0650416184216738, + 0.3533948343247175, + 0.2459210306406021, + 0.0, + 0.3321162723004818 + ], + "unique_experts": 61, + "load_cv": 0.6913932971601798, + "normalized_load_entropy": 0.9374243973469297, + "max_load_share": 0.04861111111111111 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "a3ba1307f79c8ca19f0a1416c3d4f9c4326bb61d39bbfa1fa07b25c873780f31", + "route_weight_sha256": "3a1bb30d84d0ec045280ca46cd9b7a2766e52f5a058539ff806380c335ca2c5e", + "loads": [ + 10, + 26, + 4, + 10, + 16, + 1, + 28, + 11, + 46, + 2, + 13, + 15, + 28, + 14, + 13, + 16, + 12, + 20, + 5, + 7, + 15, + 3, + 3, + 5, + 19, + 22, + 11, + 8, + 7, + 1, + 29, + 1, + 26, + 33, + 2, + 4, + 7, + 0, + 0, + 21, + 26, + 26, + 14, + 8, + 5, + 16, + 16, + 13, + 24, + 13, + 12, + 17, + 17, + 23, + 6, + 28, + 19, + 6, + 19, + 21, + 8, + 7, + 2, + 10 + ], + "weighted_loads": [ + 0.5536837354302406, + 1.6858522985130548, + 0.10745498724281788, + 0.4188569597899914, + 0.6554407216608524, + 0.040581174194812775, + 1.8377646543085575, + 0.639712842181325, + 3.4030008167028427, + 0.07344432920217514, + 0.68472502194345, + 1.0501712281256914, + 2.047049703076482, + 0.9020306766033173, + 0.760140735656023, + 0.742150716483593, + 0.44409552961587906, + 0.9777696058154106, + 0.22610127553343773, + 0.2420796938240528, + 0.7551651932299137, + 0.17900509387254715, + 0.11121412739157677, + 0.1614396870136261, + 1.3943525403738022, + 1.4163604639470577, + 0.7932655550539494, + 0.38458809442818165, + 0.3371039740741253, + 0.052330851554870605, + 1.267183143645525, + 0.058381855487823486, + 2.33677732758224, + 1.7976859007030725, + 0.1302772369235754, + 0.20724767073988914, + 0.226254403591156, + 0.0, + 0.0, + 1.0236859442666173, + 1.1044487860053778, + 1.1058945506811142, + 0.7542847879230976, + 0.31395305693149567, + 0.17019023932516575, + 1.0912690572440624, + 1.1150876805186272, + 1.0031252317130566, + 1.4874719642102718, + 0.6206794120371342, + 1.4962171204388142, + 1.6039952635765076, + 1.3223490044474602, + 2.332087118178606, + 0.7648913972079754, + 1.8413844387978315, + 0.7759030554443598, + 0.20008298009634018, + 0.9193641841411591, + 1.0650416184216738, + 0.3533948343247175, + 0.2459210306406021, + 0.08859531953930855, + 0.5382912717759609 + ], + "unique_experts": 62, + "load_cv": 0.6990584990143954, + "normalized_load_entropy": 0.9377644199478518, + "max_load_share": 0.052873563218390804 + } + }, + "s1_x": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "54eb0c543d5317d8f38d733583e1e4a53ccc235cf17908532e83ea78c7e7fa04", + "route_weight_sha256": "37c50ffc685f9a659672b1c473fc1fa41792328443389c67efd95bae12cc510f", + "loads": [ + 11, + 21, + 2, + 10, + 13, + 0, + 23, + 12, + 38, + 2, + 11, + 12, + 21, + 7, + 12, + 18, + 9, + 16, + 6, + 4, + 14, + 3, + 2, + 5, + 19, + 9, + 11, + 9, + 6, + 1, + 25, + 1, + 21, + 13, + 2, + 4, + 8, + 0, + 2, + 17, + 24, + 27, + 14, + 7, + 3, + 8, + 8, + 10, + 23, + 9, + 9, + 18, + 5, + 23, + 5, + 21, + 20, + 5, + 16, + 22, + 9, + 7, + 0, + 7 + ], + "weighted_loads": [ + 0.5740311425179243, + 1.2869307938963175, + 0.07695655524730682, + 0.42017555609345436, + 0.5343309696763754, + 0.0, + 1.4485970959067345, + 0.666967598721385, + 2.7327770944684744, + 0.07323824986815453, + 0.6020282581448555, + 0.9442692305892706, + 1.6575264520943165, + 0.42551374807953835, + 0.7156622782349586, + 0.8455773293972015, + 0.33513022772967815, + 0.7511095479130745, + 0.26831694319844246, + 0.15058939345180988, + 0.7171769253909588, + 0.1876627914607525, + 0.07770891487598419, + 0.15929980762302876, + 1.438373539596796, + 0.4674205780029297, + 0.7873468212783337, + 0.43985507264733315, + 0.31318874284625053, + 0.052847977727651596, + 1.1364698223769665, + 0.059479132294654846, + 2.096104806289077, + 0.5718058999627829, + 0.12244253791868687, + 0.20601384714245796, + 0.2629880551248789, + 0.0, + 0.07426363602280617, + 0.913414865732193, + 0.9370520431548357, + 1.1591409239917994, + 0.7234818786382675, + 0.2723489813506603, + 0.09731223247945309, + 0.528527207672596, + 0.4399648979306221, + 0.8892729226499796, + 1.4433755576610565, + 0.39690883457660675, + 1.3103487566113472, + 1.6964237783104181, + 0.6116419248282909, + 2.2853860296308994, + 0.17051566764712334, + 1.3569341152906418, + 0.8381921220570803, + 0.16314531676471233, + 0.8135093562304974, + 1.1201655250042677, + 0.3969281781464815, + 0.25233427435159683, + 0.0, + 0.3245416320860386 + ], + "unique_experts": 61, + "load_cv": 0.7168173829461916, + "normalized_load_entropy": 0.934960330739456, + "max_load_share": 0.05277777777777778 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "68433fcead45313d7d88bc23732fbc303f98cd7a1fe7c8f6b225b3bb26537bfe", + "route_weight_sha256": "22d67b7a1a69ce8ddd1883d3d0c2827917ce361a9eb5dbdc6506ed9a07204ed3", + "loads": [ + 12, + 28, + 13, + 12, + 13, + 1, + 35, + 13, + 54, + 2, + 15, + 16, + 30, + 16, + 12, + 19, + 9, + 30, + 8, + 4, + 14, + 3, + 3, + 9, + 19, + 24, + 11, + 11, + 6, + 1, + 26, + 1, + 25, + 30, + 2, + 4, + 8, + 0, + 8, + 21, + 35, + 27, + 16, + 7, + 3, + 20, + 21, + 13, + 26, + 16, + 14, + 18, + 14, + 29, + 7, + 31, + 20, + 5, + 18, + 23, + 9, + 11, + 3, + 12 + ], + "weighted_loads": [ + 0.6130412425845861, + 1.6502460036426783, + 0.7359639815986156, + 0.5261078104376793, + 0.5343309696763754, + 0.044180549681186676, + 2.359366152435541, + 0.7021016757935286, + 3.8268251921981573, + 0.07323824986815453, + 0.7936044223606586, + 1.0985218677669764, + 2.1937545463442802, + 1.0043497756123543, + 0.7156622782349586, + 0.8807665705680847, + 0.33513022772967815, + 1.7479492165148258, + 0.35211535543203354, + 0.15058939345180988, + 0.7171769253909588, + 0.1876627914607525, + 0.11761892959475517, + 0.34923495911061764, + 1.438373539596796, + 1.8436135798692703, + 0.7873468212783337, + 0.5599285960197449, + 0.31318874284625053, + 0.052847977727651596, + 1.1526714786887169, + 0.059479132294654846, + 2.246196875348687, + 1.692371467128396, + 0.12244253791868687, + 0.20601384714245796, + 0.2629880551248789, + 0.0, + 0.467375747859478, + 1.0251272423192859, + 1.4348721224814653, + 1.1591409239917994, + 0.8925745412707329, + 0.2723489813506603, + 0.09731223247945309, + 1.5275287739932537, + 1.3206777907907963, + 0.994705256074667, + 1.7575153410434723, + 0.8228527754545212, + 1.610139161348343, + 1.6964237783104181, + 1.136072238907218, + 2.961363386362791, + 0.7940610460937023, + 2.0283991992473602, + 0.8381921220570803, + 0.16314531676471233, + 0.9128986299037933, + 1.1533152665942907, + 0.3969281781464815, + 0.44054847210645676, + 0.14987406134605408, + 0.6201131828129292 + ], + "unique_experts": 63, + "load_cv": 0.6958216051186416, + "normalized_load_entropy": 0.9403309825902164, + "max_load_share": 0.055900621118012424 + } + }, + "s0_period": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "ef37216305ccd2c4627a8e4c7e4067e5ec6eb87a51976da0b49252c069f81ff0", + "route_weight_sha256": "d6b250735199a98d919f6fd74ed29c22b5bd351401f24a49a0a5ac516a5bd17b", + "loads": [ + 10, + 19, + 1, + 9, + 13, + 1, + 23, + 10, + 36, + 1, + 12, + 12, + 21, + 7, + 14, + 16, + 11, + 19, + 5, + 6, + 15, + 3, + 1, + 5, + 19, + 8, + 11, + 8, + 7, + 1, + 27, + 1, + 20, + 18, + 2, + 4, + 9, + 0, + 1, + 16, + 22, + 26, + 14, + 8, + 5, + 10, + 8, + 10, + 24, + 10, + 9, + 17, + 5, + 24, + 4, + 20, + 16, + 7, + 16, + 22, + 7, + 7, + 0, + 7 + ], + "weighted_loads": [ + 0.5601838827133179, + 1.2657927237451077, + 0.026437966153025627, + 0.3777464907616377, + 0.5335948616266251, + 0.03999914601445198, + 1.4839471578598022, + 0.5919726584106684, + 2.505397230386734, + 0.04207644984126091, + 0.6502951271831989, + 0.9635506588965654, + 1.6810016985982656, + 0.39461902529001236, + 0.7985134236514568, + 0.7403686195611954, + 0.40246887132525444, + 0.9029645603150129, + 0.2216709554195404, + 0.2115374580025673, + 0.7581375278532505, + 0.1806378774344921, + 0.04140159860253334, + 0.16186237335205078, + 1.3989242278039455, + 0.43868498504161835, + 0.8002066351473331, + 0.3878981601446867, + 0.3415188789367676, + 0.052789848297834396, + 1.1815381608903408, + 0.05891604721546173, + 2.0530502926558256, + 0.7871186397969723, + 0.12791425175964832, + 0.21630793437361717, + 0.28931618109345436, + 0.0, + 0.038486674427986145, + 0.8418046347796917, + 0.8576560895889997, + 1.0869761500507593, + 0.762473039329052, + 0.3129259720444679, + 0.17376337572932243, + 0.637952771037817, + 0.4919612929224968, + 0.8884518295526505, + 1.4961459189653397, + 0.4148919489234686, + 1.3409585282206535, + 1.6863793395459652, + 0.6213635969907045, + 2.3776270784437656, + 0.13634059391915798, + 1.2985780872404575, + 0.6789147518575191, + 0.23045524582266808, + 0.7959383390843868, + 1.1057251188904047, + 0.31802913174033165, + 0.24197151511907578, + 0.0, + 0.3353332653641701 + ], + "unique_experts": 62, + "load_cv": 0.7034307462819739, + "normalized_load_entropy": 0.9360039634109194, + "max_load_share": 0.05 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "eb1f53dd5d341c6c4fa73d7f54e5eba6844b4f10022ee470dd83a0c8a68d8ae1", + "route_weight_sha256": "f26356f13001b72188816d5a0477ec1aba6ebdd6f10ded31828afd43ae098008", + "loads": [ + 10, + 25, + 2, + 9, + 14, + 1, + 31, + 11, + 47, + 1, + 13, + 15, + 28, + 15, + 14, + 16, + 11, + 22, + 5, + 6, + 15, + 3, + 3, + 5, + 19, + 23, + 11, + 8, + 7, + 1, + 29, + 1, + 25, + 33, + 2, + 4, + 9, + 0, + 1, + 20, + 25, + 26, + 14, + 8, + 5, + 16, + 16, + 13, + 24, + 15, + 11, + 17, + 16, + 24, + 6, + 28, + 16, + 7, + 19, + 22, + 7, + 7, + 2, + 11 + ], + "weighted_loads": [ + 0.5601838827133179, + 1.6334847677499056, + 0.03864179737865925, + 0.3777464907616377, + 0.5937126949429512, + 0.03999914601445198, + 2.051604811102152, + 0.6369499135762453, + 3.4062029123306274, + 0.04207644984126091, + 0.6941545307636261, + 1.0550537630915642, + 2.0609978940337896, + 0.9003564491868019, + 0.7985134236514568, + 0.7403686195611954, + 0.40246887132525444, + 1.0325224939733744, + 0.2216709554195404, + 0.2115374580025673, + 0.7581375278532505, + 0.1806378774344921, + 0.11420731991529465, + 0.16186237335205078, + 1.3989242278039455, + 1.462306622415781, + 0.8002066351473331, + 0.3878981601446867, + 0.3415188789367676, + 0.052789848297834396, + 1.2367039285600185, + 0.05891604721546173, + 2.298267086967826, + 1.8110673110932112, + 0.12791425175964832, + 0.21630793437361717, + 0.28931618109345436, + 0.0, + 0.038486674427986145, + 0.9634207049384713, + 1.0484195668250322, + 1.0869761500507593, + 0.762473039329052, + 0.3129259720444679, + 0.17376337572932243, + 1.1109494641423225, + 1.1583654060959816, + 1.0000356454402208, + 1.4961459189653397, + 0.6691294331103563, + 1.4703104458749294, + 1.6863793395459652, + 1.2815701328217983, + 2.3776270784437656, + 0.7602175660431385, + 1.8182833176106215, + 0.6789147518575191, + 0.23045524582266808, + 0.9100780300796032, + 1.1057251188904047, + 0.31802913174033165, + 0.24197151511907578, + 0.0861828364431858, + 0.6646069586277008 + ], + "unique_experts": 63, + "load_cv": 0.7091460330438253, + "normalized_load_entropy": 0.9365914029903857, + "max_load_share": 0.054022988505747126 + } + }, + "s1_period": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "f45da48db5b8020ce8122c40680607bd2d1b190a1807ddc39c16ce8b0204b038", + "route_weight_sha256": "23b34bb16c74097b60628f4d48af1a4fc7ae95d8a0b0d1a6cfca029d062a6f71", + "loads": [ + 11, + 20, + 2, + 11, + 13, + 0, + 23, + 12, + 37, + 2, + 11, + 11, + 21, + 7, + 12, + 18, + 10, + 18, + 6, + 6, + 14, + 3, + 2, + 5, + 19, + 8, + 11, + 9, + 6, + 1, + 26, + 1, + 21, + 12, + 2, + 4, + 7, + 0, + 1, + 17, + 22, + 29, + 14, + 6, + 5, + 7, + 8, + 9, + 23, + 8, + 9, + 19, + 6, + 23, + 3, + 21, + 20, + 5, + 18, + 22, + 9, + 7, + 0, + 7 + ], + "weighted_loads": [ + 0.5777442324906588, + 1.2563836853951216, + 0.07633663713932037, + 0.45116740092635155, + 0.5323534775525331, + 0.0, + 1.4533565826714039, + 0.6629728730767965, + 2.623196518048644, + 0.07380656152963638, + 0.6093758195638657, + 0.9099423438310623, + 1.6613509617745876, + 0.4242747873067856, + 0.710609957575798, + 0.845497377216816, + 0.36637409776449203, + 0.8143514432013035, + 0.2694032471626997, + 0.2103890161961317, + 0.7308641001582146, + 0.1862798072397709, + 0.077842116355896, + 0.15936910919845104, + 1.4568378739058971, + 0.42802098393440247, + 0.790956400334835, + 0.44107132963836193, + 0.3166590966284275, + 0.0519210547208786, + 1.15495116263628, + 0.05999954044818878, + 2.0998556036502123, + 0.5375724229961634, + 0.12124983221292496, + 0.20911840349435806, + 0.23530622571706772, + 0.0, + 0.03948099911212921, + 0.9086990132927895, + 0.8669129330664873, + 1.2297056633979082, + 0.729758370667696, + 0.23189371451735497, + 0.17263111658394337, + 0.486892893910408, + 0.44285353273153305, + 0.8618432693183422, + 1.4558309391140938, + 0.3508754260838032, + 1.3201692551374435, + 1.741243302822113, + 0.637526098638773, + 2.288613513112068, + 0.10899754986166954, + 1.3211978040635586, + 0.831851901486516, + 0.16368094086647034, + 0.894907183945179, + 1.1232569627463818, + 0.39538073912262917, + 0.24843620136380196, + 0.0, + 0.3246392197906971 + ], + "unique_experts": 61, + "load_cv": 0.7212814385385546, + "normalized_load_entropy": 0.9339706027462161, + "max_load_share": 0.05138888888888889 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "cf7f74bf2505de80180fdc3e076c3d5d45e9be8cccaadce73f6b45656cbe35dc", + "route_weight_sha256": "9184ea4b64816765a42641f3a3cf19efa7269595fece9ce33d98885403938dc9", + "loads": [ + 12, + 26, + 12, + 13, + 13, + 1, + 36, + 13, + 52, + 2, + 15, + 14, + 30, + 14, + 12, + 19, + 10, + 33, + 8, + 6, + 16, + 3, + 3, + 9, + 19, + 23, + 11, + 11, + 6, + 1, + 27, + 1, + 24, + 28, + 2, + 4, + 7, + 0, + 7, + 21, + 33, + 29, + 16, + 6, + 5, + 19, + 23, + 12, + 26, + 16, + 13, + 19, + 15, + 29, + 5, + 32, + 20, + 5, + 20, + 23, + 9, + 11, + 3, + 13 + ], + "weighted_loads": [ + 0.6167543325573206, + 1.574782619252801, + 0.6980497278273106, + 0.5616152659058571, + 0.5323534775525331, + 0.044180549681186676, + 2.4531785026192665, + 0.6981069501489401, + 3.6947957407683134, + 0.07380656152963638, + 0.8043266721069813, + 1.026007954031229, + 2.1975790560245514, + 0.8664065934717655, + 0.710609957575798, + 0.8802029862999916, + 0.36637409776449203, + 1.861587904393673, + 0.354904031381011, + 0.2103890161961317, + 0.8164950869977474, + 0.1862798072397709, + 0.11775213107466698, + 0.3493042606860399, + 1.4568378739058971, + 1.7763772457838058, + 0.790956400334835, + 0.5611448530107737, + 0.3166590966284275, + 0.0519210547208786, + 1.1711528189480305, + 0.05999954044818878, + 2.2085157055407763, + 1.6191087905317545, + 0.12124983221292496, + 0.20911840349435806, + 0.23530622571706772, + 0.0, + 0.43259311094880104, + 1.0208041770383716, + 1.3776369150727987, + 1.2297056633979082, + 0.8988510333001614, + 0.23189371451735497, + 0.17263111658394337, + 1.492928970605135, + 1.4695151560008526, + 0.9672756027430296, + 1.7699707224965096, + 0.8411378152668476, + 1.5483452156186104, + 1.741243302822113, + 1.1619564127177, + 2.96459086984396, + 0.7325429283082485, + 2.007725842297077, + 0.831851901486516, + 0.16368094086647034, + 0.994296457618475, + 1.1564067043364048, + 0.39538073912262917, + 0.4366503991186619, + 0.14939885213971138, + 0.6954811774194241 + ], + "unique_experts": 63, + "load_cv": 0.6914710939030151, + "normalized_load_entropy": 0.940818025544429, + "max_load_share": 0.053830227743271224 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 120, + "ordered_topk_exact_tokens": 75, + "set_exact_tokens": 86, + "mean_set_jaccard": 0.9172619047619048, + "mean_token_weighted_tv": 0.016499956736030677, + "aggregate_load_tv": 0.03194444444444444 + }, + "system_bos": { + "tokens": 120, + "ordered_topk_exact_tokens": 67, + "set_exact_tokens": 84, + "mean_set_jaccard": 0.9125, + "mean_token_weighted_tv": 0.017949151092519364, + "aggregate_load_tv": 0.03472222222222222 + }, + "system_x": { + "tokens": 120, + "ordered_topk_exact_tokens": 58, + "set_exact_tokens": 73, + "mean_set_jaccard": 0.8831349206349207, + "mean_token_weighted_tv": 0.02254296694106112, + "aggregate_load_tv": 0.041666666666666664 + }, + "system_period": { + "tokens": 120, + "ordered_topk_exact_tokens": 62, + "set_exact_tokens": 75, + "mean_set_jaccard": 0.8875, + "mean_token_weighted_tv": 0.02236341123158733, + "aggregate_load_tv": 0.043055555555555555 + }, + "bos_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 66, + "set_exact_tokens": 79, + "mean_set_jaccard": 0.8970238095238096, + "mean_token_weighted_tv": 0.022032512763204674, + "aggregate_load_tv": 0.037500000000000006 + }, + "bos_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 58, + "set_exact_tokens": 73, + "mean_set_jaccard": 0.8773809523809525, + "mean_token_weighted_tv": 0.025866110731537145, + "aggregate_load_tv": 0.04166666666666667 + }, + "x_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 54, + "set_exact_tokens": 72, + "mean_set_jaccard": 0.8839285714285715, + "mean_token_weighted_tv": 0.024435573047958313, + "aggregate_load_tv": 0.03333333333333334 + }, + "x_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 46, + "set_exact_tokens": 64, + "mean_set_jaccard": 0.8613095238095239, + "mean_token_weighted_tv": 0.029424445043938856, + "aggregate_load_tv": 0.04722222222222222 + }, + "period_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 55, + "set_exact_tokens": 73, + "mean_set_jaccard": 0.8845238095238096, + "mean_token_weighted_tv": 0.02444870612428834, + "aggregate_load_tv": 0.03888888888888889 + }, + "period_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 50, + "set_exact_tokens": 67, + "mean_set_jaccard": 0.868452380952381, + "mean_token_weighted_tv": 0.02860531855064134, + "aggregate_load_tv": 0.04166666666666667 + } + } + }, + "layer_09": { + "layer": 9, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "92bd45a232aa7ac76dba7718fe98548a32b8d8da4e8ef3a5fb8f20a05c8ac2fe", + "route_weight_sha256": "c5f876a64ab72911bab180fe1e2444688b24aceb5e623582b9a6a85b912845c3", + "loads": [ + 13, + 18, + 6, + 8, + 16, + 7, + 13, + 17, + 19, + 9, + 14, + 17, + 3, + 20, + 14, + 12, + 6, + 12, + 2, + 26, + 4, + 1, + 1, + 1, + 2, + 10, + 13, + 18, + 18, + 15, + 1, + 13, + 3, + 10, + 15, + 12, + 8, + 3, + 27, + 4, + 3, + 12, + 16, + 32, + 13, + 21, + 9, + 2, + 10, + 19, + 16, + 2, + 15, + 20, + 2, + 9, + 15, + 0, + 13, + 25, + 1, + 10, + 4, + 20 + ], + "weighted_loads": [ + 0.6657900642603636, + 0.926325723528862, + 0.3512663245201111, + 0.3694457896053791, + 0.7946268506348133, + 0.40535986237227917, + 0.5038588419556618, + 0.7921665478497744, + 1.5834077410399914, + 0.4225398562848568, + 1.1819078251719475, + 1.0861361287534237, + 0.11579215154051781, + 0.826549306511879, + 0.650144312530756, + 0.602097399532795, + 0.3549831733107567, + 0.45749546959996223, + 0.08585963770747185, + 1.6088330075144768, + 0.11548996716737747, + 0.07635612785816193, + 0.03376730531454086, + 0.05991088226437569, + 0.07912052795290947, + 0.35190763138234615, + 0.9226830080151558, + 2.01966592669487, + 1.6328223776072264, + 0.5661914385855198, + 0.03279963880777359, + 0.6663977093994617, + 0.11242785677313805, + 0.6976176276803017, + 1.1569012627005577, + 0.6543800868093967, + 0.3331381678581238, + 0.18730155751109123, + 1.601607322692871, + 0.15342524647712708, + 0.10826109163463116, + 0.7386986315250397, + 1.113730339333415, + 1.7254265826195478, + 0.6222993358969688, + 1.355391513556242, + 0.6905876211822033, + 0.17121294885873795, + 0.6832228973507881, + 0.7641574814915657, + 0.5405473336577415, + 0.1970454566180706, + 0.7340607084333897, + 1.5187960863113403, + 0.13324831426143646, + 0.39017398841679096, + 1.1817156448960304, + 0.0, + 0.8650748804211617, + 1.4449156150221825, + 0.06512411683797836, + 0.7389000132679939, + 0.1743374541401863, + 1.408967986702919 + ], + "unique_experts": 63, + "load_cv": 0.6590303389483074, + "normalized_load_entropy": 0.9413036089606887, + "max_load_share": 0.044444444444444446 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "b71cb1206e897790f14010de0b940d3b250c558e0cc6454f52526cca2be5d889", + "route_weight_sha256": "1afa27ab891f7d97ed3fe77921dd8ba29c156c2147f4d2fd3625e79aaa65d6c8", + "loads": [ + 20, + 21, + 6, + 8, + 18, + 7, + 13, + 17, + 21, + 9, + 25, + 17, + 6, + 23, + 14, + 12, + 7, + 13, + 2, + 36, + 4, + 1, + 5, + 4, + 5, + 11, + 13, + 19, + 18, + 15, + 2, + 19, + 5, + 10, + 24, + 19, + 8, + 3, + 30, + 4, + 3, + 23, + 16, + 32, + 18, + 30, + 20, + 2, + 13, + 19, + 20, + 3, + 15, + 24, + 2, + 14, + 20, + 0, + 15, + 29, + 1, + 10, + 6, + 21 + ], + "weighted_loads": [ + 1.1581283751875162, + 1.182391382753849, + 0.3512663245201111, + 0.3694457896053791, + 1.0255965031683445, + 0.40535986237227917, + 0.5038588419556618, + 0.7921665478497744, + 1.6801472827792168, + 0.4225398562848568, + 2.3434418961405754, + 1.0861361287534237, + 0.16995796281844378, + 0.8923694929108024, + 0.650144312530756, + 0.602097399532795, + 0.39626896753907204, + 0.4997183158993721, + 0.08585963770747185, + 2.685870300978422, + 0.11548996716737747, + 0.07635612785816193, + 1.5682888366281986, + 0.31013699248433113, + 0.20805726572871208, + 0.4298958759754896, + 0.9226830080151558, + 2.0326723884791136, + 1.6328223776072264, + 0.5661914385855198, + 0.07219161838293076, + 0.8543204921297729, + 0.1487796395085752, + 0.6976176276803017, + 1.6495501920580864, + 1.1151056177914143, + 0.3331381678581238, + 0.18730155751109123, + 1.7293261997401714, + 0.15342524647712708, + 0.10826109163463116, + 1.7806280441582203, + 1.113730339333415, + 1.7254265826195478, + 0.9309645569883287, + 2.1027886904776096, + 1.5211567543447018, + 0.17121294885873795, + 0.8623712435364723, + 0.7641574814915657, + 0.7415740713477135, + 0.2306773103773594, + 0.7340607084333897, + 1.6731388475745916, + 0.13324831426143646, + 0.6405310165137053, + 1.4235882721841335, + 0.0, + 0.9882507845759392, + 1.6176698133349419, + 0.06512411683797836, + 0.7389000132679939, + 0.23039048165082932, + 1.4450827986001968 + ], + "unique_experts": 63, + "load_cv": 0.6458706502202742, + "normalized_load_entropy": 0.9445400917755146, + "max_load_share": 0.041379310344827586 + } + }, + "s1_eos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "c309cb713deeb1fbd6e53f800056d4146603337ee2c09b64e119b93fc66cbb30", + "route_weight_sha256": "e15a2746ec7d4b10de981f91226c8a34f562c045ca759c67a5d49f1e5193580f", + "loads": [ + 11, + 17, + 5, + 9, + 17, + 7, + 11, + 17, + 19, + 9, + 16, + 17, + 3, + 20, + 13, + 11, + 6, + 14, + 2, + 26, + 3, + 1, + 1, + 1, + 4, + 14, + 13, + 18, + 16, + 16, + 2, + 13, + 4, + 10, + 16, + 13, + 7, + 3, + 28, + 4, + 3, + 12, + 13, + 32, + 14, + 22, + 10, + 2, + 10, + 20, + 12, + 2, + 15, + 20, + 1, + 7, + 14, + 0, + 13, + 25, + 1, + 10, + 4, + 21 + ], + "weighted_loads": [ + 0.6016185507178307, + 0.890912938863039, + 0.3153868578374386, + 0.39995647966861725, + 0.8455821685492992, + 0.4090630505234003, + 0.44519490748643875, + 0.8030597381293774, + 1.5818969793617725, + 0.417493000626564, + 1.247602453455329, + 1.0734102614223957, + 0.11222166568040848, + 0.8306574076414108, + 0.6384571678936481, + 0.5322441570460796, + 0.3489675968885422, + 0.5319134201854467, + 0.08574669435620308, + 1.580694392323494, + 0.09137000143527985, + 0.07469610124826431, + 0.03218501806259155, + 0.06133885681629181, + 0.1517893522977829, + 0.48473722115159035, + 0.9273722507059574, + 1.9952836818993092, + 1.519141085445881, + 0.5934356842190027, + 0.07006971165537834, + 0.6661835499107838, + 0.14183964021503925, + 0.6943338252604008, + 1.1599014792591333, + 0.6862151324748993, + 0.29603248462080956, + 0.19022183120250702, + 1.668501727283001, + 0.15062889829277992, + 0.10570117086172104, + 0.7192185446619987, + 0.9574609436094761, + 1.844817940145731, + 0.700364850461483, + 1.4355555139482021, + 0.7067042738199234, + 0.1702999770641327, + 0.6751959025859833, + 0.8069481067359447, + 0.4178869239985943, + 0.20175861194729805, + 0.7446604445576668, + 1.5171849951148033, + 0.09181759506464005, + 0.31286329589784145, + 1.1548122391104698, + 0.0, + 0.8574981391429901, + 1.4411914385855198, + 0.06494119018316269, + 0.7466077618300915, + 0.1707073599100113, + 1.4621709138154984 + ], + "unique_experts": 63, + "load_cv": 0.66332495807108, + "normalized_load_entropy": 0.941241387098821, + "max_load_share": 0.044444444444444446 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "a29a7f9a417db414d4be1cf836ddce6193fe489ffa081913c3c3b627a42a6aec", + "route_weight_sha256": "3be71823911ef3fb8a417a4234256376c8c91c21a5f8f47e2ad862b21c060f0c", + "loads": [ + 22, + 22, + 5, + 9, + 19, + 7, + 11, + 17, + 26, + 11, + 27, + 19, + 6, + 23, + 14, + 11, + 7, + 15, + 2, + 36, + 3, + 4, + 5, + 12, + 9, + 22, + 17, + 19, + 22, + 16, + 4, + 18, + 6, + 13, + 22, + 26, + 7, + 6, + 33, + 5, + 9, + 28, + 15, + 32, + 19, + 36, + 30, + 2, + 17, + 25, + 14, + 3, + 15, + 23, + 2, + 12, + 19, + 0, + 18, + 29, + 1, + 11, + 6, + 22 + ], + "weighted_loads": [ + 1.3173558451235294, + 1.2177711725234985, + 0.3153868578374386, + 0.39995647966861725, + 1.1019446663558483, + 0.4090630505234003, + 0.44519490748643875, + 0.8030597381293774, + 2.0002835616469383, + 0.5091408155858517, + 2.3343795258551836, + 1.169763457030058, + 0.16640874417498708, + 0.8856509367469698, + 0.6775803342461586, + 0.5322441570460796, + 0.395061980932951, + 0.5881210919469595, + 0.08574669435620308, + 2.7147715389728546, + 0.09137000143527985, + 0.20169567316770554, + 1.5657949931919575, + 0.8910573236644268, + 0.3404557667672634, + 0.9054024387151003, + 1.1825860999524593, + 2.0082901436835527, + 1.9404701255261898, + 0.5934356842190027, + 0.20763446390628815, + 0.814933521207422, + 0.18360683228820562, + 0.9168358519673347, + 1.457435367628932, + 1.5047839730978012, + 0.29603248462080956, + 0.3327501751482487, + 1.9229116663336754, + 0.21912937983870506, + 0.507123026996851, + 2.2514237724244595, + 1.0499145612120628, + 1.844817940145731, + 0.8828119616955519, + 2.5942575000226498, + 2.3538807183504105, + 0.1702999770641327, + 1.094025608152151, + 1.1355939991772175, + 0.5350702926516533, + 0.23490549996495247, + 0.7446604445576668, + 1.6657350063323975, + 0.13315699622035027, + 0.5545235015451908, + 1.3877316266298294, + 0.0, + 1.1363865733146667, + 1.6221013329923153, + 0.06494119018316269, + 0.7846008278429508, + 0.328158900141716, + 1.4981725625693798 + ], + "unique_experts": 63, + "load_cv": 0.6182646675626962, + "normalized_load_entropy": 0.9496012158920188, + "max_load_share": 0.037267080745341616 + } + }, + "s0_bos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "6321c15c6907644f68f1d6ce59129587d8079a3457f6baf47e706407de9d238b", + "route_weight_sha256": "fe44dfb0fc795b6fc55873e53acaa69507af6a979fe5f7d4c9b40caa0761ed8c", + "loads": [ + 11, + 19, + 5, + 9, + 16, + 10, + 14, + 16, + 19, + 9, + 17, + 19, + 2, + 20, + 15, + 10, + 8, + 13, + 2, + 25, + 5, + 1, + 1, + 2, + 3, + 5, + 14, + 18, + 17, + 11, + 2, + 11, + 4, + 10, + 15, + 13, + 6, + 3, + 24, + 2, + 3, + 11, + 18, + 32, + 16, + 21, + 11, + 2, + 10, + 20, + 13, + 2, + 15, + 18, + 2, + 7, + 16, + 0, + 13, + 27, + 3, + 10, + 4, + 20 + ], + "weighted_loads": [ + 0.5293778534978628, + 0.9697171859443188, + 0.3198116458952427, + 0.39211224392056465, + 0.7708967551589012, + 0.5041741393506527, + 0.5501188412308693, + 0.8066366128623486, + 1.5910489559173584, + 0.41994398832321167, + 1.2492910083383322, + 1.1675174050033092, + 0.07609857618808746, + 0.7937092185020447, + 0.7196085974574089, + 0.49377458542585373, + 0.40088164433836937, + 0.47403485141694546, + 0.091635562479496, + 1.5912007950246334, + 0.1531791966408491, + 0.0809064731001854, + 0.03527262434363365, + 0.10548781976103783, + 0.1125323511660099, + 0.1913079135119915, + 0.9486815482378006, + 2.0526588037610054, + 1.5944808833301067, + 0.4019370377063751, + 0.0739968866109848, + 0.5810054317116737, + 0.13948276080191135, + 0.700077474117279, + 1.1818061545491219, + 0.6709622405469418, + 0.26746273040771484, + 0.19662293046712875, + 1.5684966817498207, + 0.08761641383171082, + 0.11192431300878525, + 0.7442911267280579, + 1.2051304541528225, + 1.7688375040888786, + 0.7928092274814844, + 1.3785107657313347, + 0.7977881617844105, + 0.1704847663640976, + 0.6611348949372768, + 0.8015875294804573, + 0.4649526569992304, + 0.20358402281999588, + 0.7578152269124985, + 1.4141715541481972, + 0.13818096742033958, + 0.28263523802161217, + 1.2083500660955906, + 0.0, + 0.8628344237804413, + 1.5477877613157034, + 0.1342126466333866, + 0.7584805302321911, + 0.18251339346170425, + 1.4070353023707867 + ], + "unique_experts": 63, + "load_cv": 0.6562143582325956, + "normalized_load_entropy": 0.9427102895531463, + "max_load_share": 0.044444444444444446 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "221a6e3e2ce63375c4f6d4aa971d9671e8731f2efd6e5e5c1c44c815f22b1670", + "route_weight_sha256": "1ef828cd86294581043468744842fe7f56941af25a1967217ecdd8be5c4f4500", + "loads": [ + 19, + 22, + 5, + 9, + 19, + 10, + 14, + 16, + 21, + 9, + 28, + 19, + 4, + 24, + 15, + 10, + 9, + 17, + 2, + 35, + 5, + 1, + 4, + 5, + 6, + 6, + 14, + 19, + 17, + 11, + 3, + 16, + 4, + 10, + 24, + 20, + 6, + 3, + 26, + 3, + 3, + 21, + 18, + 32, + 19, + 30, + 22, + 2, + 13, + 20, + 19, + 3, + 15, + 22, + 2, + 12, + 21, + 0, + 15, + 31, + 3, + 10, + 6, + 21 + ], + "weighted_loads": [ + 1.0676460545510054, + 1.2162982858717442, + 0.3198116458952427, + 0.39211224392056465, + 1.0711068958044052, + 0.5041741393506527, + 0.5501188412308693, + 0.8066366128623486, + 1.6877884976565838, + 0.41994398832321167, + 2.41082507930696, + 1.1675174050033092, + 0.1228473037481308, + 0.962944864295423, + 0.7196085974574089, + 0.49377458542585373, + 0.4421674385666847, + 0.63268724642694, + 0.091635562479496, + 2.6393310874700546, + 0.1531791966408491, + 0.0809064731001854, + 0.6390511766076088, + 0.3965652398765087, + 0.24146908894181252, + 0.26929615810513496, + 0.9486815482378006, + 2.065665265545249, + 1.5944808833301067, + 0.4019370377063751, + 0.11338886618614197, + 0.766206075437367, + 0.13948276080191135, + 0.700077474117279, + 1.6744550839066505, + 1.1304963938891888, + 0.26746273040771484, + 0.19662293046712875, + 1.652040921151638, + 0.13309121131896973, + 0.11192431300878525, + 1.7457353994250298, + 1.2051304541528225, + 1.7688375040888786, + 1.0476703299209476, + 2.28891284763813, + 1.5879560373723507, + 0.1704847663640976, + 0.8364750854671001, + 0.8015875294804573, + 0.7468490339815617, + 0.23721587657928467, + 0.7578152269124985, + 1.575668090954423, + 0.13818096742033958, + 0.5380104556679726, + 1.4502226933836937, + 0.0, + 0.9773132838308811, + 1.7205419596284628, + 0.1342126466333866, + 0.7584805302321911, + 0.23856642097234726, + 1.4431501142680645 + ], + "unique_experts": 63, + "load_cv": 0.6482228722127269, + "normalized_load_entropy": 0.9445063473133402, + "max_load_share": 0.040229885057471264 + } + }, + "s1_bos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "3790ee6fb6274909bc5ee6d22aa285a5abf6872d9c22f624cf1be7d27c73aa18", + "route_weight_sha256": "d7ec882fbbfb5fe112d89270f34b6dd68608379906b1805590c76522a6eddfe5", + "loads": [ + 13, + 17, + 5, + 9, + 16, + 7, + 12, + 16, + 19, + 9, + 16, + 18, + 2, + 21, + 12, + 12, + 7, + 13, + 1, + 26, + 5, + 1, + 1, + 2, + 3, + 8, + 14, + 18, + 17, + 18, + 4, + 12, + 3, + 10, + 15, + 13, + 7, + 3, + 26, + 2, + 2, + 12, + 15, + 31, + 17, + 21, + 10, + 2, + 10, + 17, + 12, + 2, + 15, + 19, + 2, + 8, + 17, + 0, + 12, + 27, + 2, + 10, + 4, + 20 + ], + "weighted_loads": [ + 0.6333419103175402, + 0.8863617926836014, + 0.3223481625318527, + 0.37873586639761925, + 0.7835033349692822, + 0.41529903560876846, + 0.48613737151026726, + 0.7817941717803478, + 1.5947282165288925, + 0.4108522869646549, + 1.2562137376517057, + 1.150969361886382, + 0.07576383650302887, + 0.8359442260116339, + 0.6073012463748455, + 0.5498151890933514, + 0.3654813580214977, + 0.46107758209109306, + 0.04992539435625076, + 1.6400650963187218, + 0.15348426066339016, + 0.081894651055336, + 0.03315316140651703, + 0.11765070632100105, + 0.1114945113658905, + 0.2876929473131895, + 0.976698387414217, + 1.9328144565224648, + 1.6199477892369032, + 0.6645965538918972, + 0.14174873009324074, + 0.614349689334631, + 0.11268247291445732, + 0.7072304338216782, + 1.1682330332696438, + 0.6620040275156498, + 0.302958857268095, + 0.191510371863842, + 1.669068604707718, + 0.08382632210850716, + 0.08340142294764519, + 0.7611945420503616, + 1.0719663575291634, + 1.758690919727087, + 0.8431258760392666, + 1.3493723664432764, + 0.7457055449485779, + 0.18282298743724823, + 0.6519331559538841, + 0.6675367131829262, + 0.4487764425575733, + 0.20687220618128777, + 0.772663164883852, + 1.4663150757551193, + 0.13962727412581444, + 0.2977920062839985, + 1.251806814223528, + 0.0, + 0.8095166012644768, + 1.5510291755199432, + 0.09764891117811203, + 0.7661875039339066, + 0.1788308247923851, + 1.4477500915527344 + ], + "unique_experts": 63, + "load_cv": 0.6571543592276109, + "normalized_load_entropy": 0.9420973772372332, + "max_load_share": 0.043055555555555555 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "1061e913060b30bbae015b090f1837385534c768e0ac3d1f14607070d33c18b6", + "route_weight_sha256": "4602ac4d7e72cdd6e85dd75332f1095624750c8c2ec5ad0f2f8f0209dfeffd0d", + "loads": [ + 25, + 22, + 5, + 9, + 19, + 7, + 12, + 16, + 26, + 11, + 27, + 20, + 4, + 25, + 13, + 12, + 8, + 17, + 1, + 36, + 5, + 4, + 4, + 13, + 8, + 16, + 18, + 19, + 23, + 18, + 6, + 16, + 3, + 13, + 21, + 25, + 7, + 6, + 30, + 4, + 8, + 27, + 17, + 31, + 20, + 35, + 30, + 2, + 17, + 22, + 16, + 3, + 15, + 23, + 3, + 13, + 22, + 0, + 17, + 31, + 2, + 11, + 6, + 21 + ], + "weighted_loads": [ + 1.4291541669517756, + 1.223837275058031, + 0.3223481625318527, + 0.37873586639761925, + 1.1092418991029263, + 0.41529903560876846, + 0.48613737151026726, + 0.7817941717803478, + 2.0131147988140583, + 0.5025001019239426, + 2.3429908100515604, + 1.2473225574940443, + 0.1230299100279808, + 0.9795808428898454, + 0.646424412727356, + 0.5498151890933514, + 0.4115757420659065, + 0.6398809589445591, + 0.04992539435625076, + 2.7918244525790215, + 0.15348426066339016, + 0.20889422297477722, + 0.6370001770555973, + 0.9636832885444164, + 0.300160925835371, + 0.7083581648766994, + 1.231912236660719, + 1.9458209183067083, + 2.041276829317212, + 0.6645965538918972, + 0.27931348234415054, + 0.7602881761267781, + 0.11268247291445732, + 0.9297324605286121, + 1.4657669216394424, + 1.4405397474765778, + 0.302958857268095, + 0.33403871580958366, + 1.8720044419169426, + 0.20378855615854263, + 0.4848232790827751, + 2.2637053206562996, + 1.16441997513175, + 1.758690919727087, + 0.972599727101624, + 2.68779026158154, + 2.37983388453722, + 0.18282298743724823, + 1.070900846272707, + 0.9961826056241989, + 0.6369658838957548, + 0.24001909419894218, + 0.772663164883852, + 1.6541652046144009, + 0.18096667528152466, + 0.5412259940057993, + 1.4847262017428875, + 0.0, + 1.0877138301730156, + 1.7319390699267387, + 0.09764891117811203, + 0.8041805699467659, + 0.3362823650240898, + 1.4837517403066158 + ], + "unique_experts": 63, + "load_cv": 0.6126930334143971, + "normalized_load_entropy": 0.9499644413189525, + "max_load_share": 0.037267080745341616 + } + }, + "s0_x": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "1750ccf5bda74e5ba3c1a313eb733d452195ab569c71183b192c43653d4508db", + "route_weight_sha256": "ae0af8e532a460c752a736f2ca719ff80b2055c2e386b8e27062c8b37a5a030a", + "loads": [ + 12, + 18, + 6, + 9, + 15, + 8, + 16, + 16, + 19, + 9, + 17, + 19, + 3, + 17, + 15, + 11, + 7, + 13, + 1, + 25, + 5, + 1, + 1, + 1, + 1, + 8, + 13, + 18, + 18, + 17, + 1, + 12, + 4, + 11, + 15, + 14, + 6, + 3, + 27, + 2, + 2, + 12, + 18, + 31, + 17, + 21, + 10, + 2, + 10, + 17, + 11, + 2, + 16, + 18, + 2, + 6, + 16, + 0, + 12, + 29, + 2, + 10, + 3, + 19 + ], + "weighted_loads": [ + 0.5952556356787682, + 0.9226542450487614, + 0.3574395552277565, + 0.3868655413389206, + 0.7220322117209435, + 0.43726792372763157, + 0.636429026722908, + 0.7920999713242054, + 1.6237532123923302, + 0.42012618109583855, + 1.2445018012076616, + 1.201033253222704, + 0.10317914560437202, + 0.6844351068139076, + 0.7059142850339413, + 0.5211168862879276, + 0.37184983119368553, + 0.4569144118577242, + 0.052718404680490494, + 1.575425397604704, + 0.15509813278913498, + 0.07973551005125046, + 0.03557513654232025, + 0.06722506135702133, + 0.03496566787362099, + 0.2972438745200634, + 0.8962553776800632, + 1.857240378856659, + 1.6702821552753448, + 0.6403122395277023, + 0.04065472632646561, + 0.632337860763073, + 0.1403644196689129, + 0.7531333230435848, + 1.1973931081593037, + 0.7510735839605331, + 0.26529448106884956, + 0.18808912485837936, + 1.7342492938041687, + 0.08088230900466442, + 0.08339589461684227, + 0.7971361801028252, + 1.2145826108753681, + 1.7151139490306377, + 0.8185875248163939, + 1.3923638612031937, + 0.7158110775053501, + 0.1747349426150322, + 0.6696249544620514, + 0.6775354221463203, + 0.4062041901051998, + 0.20933562517166138, + 0.806155439466238, + 1.4387789145112038, + 0.14065895229578018, + 0.232040137052536, + 1.235969990491867, + 0.0, + 0.8090492486953735, + 1.6261359322816133, + 0.09867789968848228, + 0.7888957001268864, + 0.14844191074371338, + 1.3702230527997017 + ], + "unique_experts": 63, + "load_cv": 0.6723829009069897, + "normalized_load_entropy": 0.9383705265369834, + "max_load_share": 0.043055555555555555 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "3e0ae9220d827a0a2994e3880d6405384cf6a5e462b0d6119ab456d5e6df0174", + "route_weight_sha256": "2331af5dc9020090a39bf8fa3ebb5e3b9e8456fad7d7c85969a672974f929125", + "loads": [ + 21, + 21, + 6, + 9, + 17, + 8, + 16, + 16, + 21, + 9, + 29, + 19, + 5, + 21, + 15, + 11, + 9, + 14, + 1, + 35, + 5, + 1, + 4, + 4, + 4, + 11, + 13, + 19, + 18, + 17, + 2, + 17, + 4, + 11, + 25, + 20, + 6, + 3, + 31, + 2, + 2, + 22, + 18, + 31, + 20, + 29, + 21, + 2, + 13, + 17, + 15, + 3, + 16, + 21, + 2, + 11, + 21, + 0, + 14, + 35, + 2, + 10, + 5, + 20 + ], + "weighted_loads": [ + 1.259742371737957, + 1.174412090331316, + 0.3574395552277565, + 0.3868655413389206, + 0.9530570209026337, + 0.43726792372763157, + 0.636429026722908, + 0.7920999713242054, + 1.7204927541315556, + 0.42012618109583855, + 2.5561769772320986, + 1.201033253222704, + 0.14992787316441536, + 0.8263723505660892, + 0.7059142850339413, + 0.5211168862879276, + 0.4499090686440468, + 0.49913725815713406, + 0.052718404680490494, + 2.6375206261873245, + 0.15509813278913498, + 0.07973551005125046, + 0.6393536888062954, + 0.3245912045240402, + 0.1639024056494236, + 0.4472471922636032, + 0.8962553776800632, + 1.8702468406409025, + 1.6702821552753448, + 0.6403122395277023, + 0.08004670590162277, + 0.8175385044887662, + 0.1403644196689129, + 0.7531333230435848, + 1.7856591679155827, + 1.1673237681388855, + 0.26529448106884956, + 0.18808912485837936, + 1.8975806832313538, + 0.08088230900466442, + 0.08339589461684227, + 1.7344573847949505, + 1.2145826108753681, + 1.7151139490306377, + 1.073448627255857, + 2.0455652475357056, + 1.4788586497306824, + 0.1747349426150322, + 0.8427290692925453, + 0.6775354221463203, + 0.6092466227710247, + 0.24296747893095016, + 0.806155439466238, + 1.557061156257987, + 0.14065895229578018, + 0.47883013635873795, + 1.4778426177799702, + 0.0, + 0.9286304526031017, + 1.877912050113082, + 0.09867789968848228, + 0.7888957001268864, + 0.20449493825435638, + 1.4063378646969795 + ], + "unique_experts": 63, + "load_cv": 0.6658536461427907, + "normalized_load_entropy": 0.9410698382810863, + "max_load_share": 0.040229885057471264 + } + }, + "s1_x": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "179e152c891bbb868a55ebd51b029e792dbd82f80d629850bd33b5910e0a8353", + "route_weight_sha256": "986a76dc8c3f7e80eb3d8480695a2ab902250c8100664d8c5434334793a32ba5", + "loads": [ + 12, + 17, + 6, + 8, + 15, + 7, + 15, + 17, + 20, + 9, + 15, + 18, + 5, + 16, + 15, + 10, + 6, + 13, + 1, + 25, + 1, + 1, + 3, + 1, + 3, + 11, + 14, + 18, + 19, + 19, + 3, + 11, + 3, + 10, + 15, + 13, + 5, + 3, + 26, + 2, + 2, + 12, + 16, + 32, + 14, + 22, + 10, + 2, + 10, + 17, + 12, + 2, + 16, + 20, + 2, + 7, + 18, + 0, + 13, + 30, + 1, + 10, + 3, + 18 + ], + "weighted_loads": [ + 0.6510833874344826, + 0.8705407232046127, + 0.3560949098318815, + 0.3490413762629032, + 0.724789634346962, + 0.4130619838833809, + 0.5993860810995102, + 0.8062133751809597, + 1.6913263201713562, + 0.4022817015647888, + 1.2381427772343159, + 1.1714711636304855, + 0.17237972281873226, + 0.6382873244583607, + 0.7166776061058044, + 0.4628919027745724, + 0.33300843834877014, + 0.440886776894331, + 0.050177931785583496, + 1.6158906817436218, + 0.027732040733098984, + 0.08337179571390152, + 0.09477553330361843, + 0.05772911757230759, + 0.11129098758101463, + 0.4142912570387125, + 0.959538746625185, + 1.8793648220598698, + 1.7149582970887423, + 0.7090374417603016, + 0.11086531914770603, + 0.5756295882165432, + 0.10792141407728195, + 0.7068304978311062, + 1.1924772001802921, + 0.7223685346543789, + 0.21908028796315193, + 0.18038053810596466, + 1.753288622945547, + 0.08373860828578472, + 0.08245041966438293, + 0.7222557626664639, + 1.1141209285706282, + 1.7587447725236416, + 0.7095290273427963, + 1.445271821692586, + 0.6446692980825901, + 0.18908379971981049, + 0.6723334975540638, + 0.6805666051805019, + 0.4568655826151371, + 0.19941042363643646, + 0.8101644143462181, + 1.5242429003119469, + 0.14258883148431778, + 0.2622070014476776, + 1.2972548082470894, + 0.0, + 0.8192293830215931, + 1.6626866981387138, + 0.06396038830280304, + 0.7739127166569233, + 0.14192982763051987, + 1.3626065514981747 + ], + "unique_experts": 63, + "load_cv": 0.6762277357645751, + "normalized_load_entropy": 0.9388230838844186, + "max_load_share": 0.044444444444444446 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "6caf7f33e71f490dffdfcaa7540e38e9dc7250827ef23c6b23e79dd3dfc9bd8e", + "route_weight_sha256": "face766ace518eb8c097d187d0b7cf9e156849c74e4ee63f1fdc93bddcc138ef", + "loads": [ + 25, + 22, + 6, + 8, + 17, + 7, + 15, + 17, + 27, + 11, + 27, + 20, + 7, + 18, + 16, + 10, + 8, + 16, + 1, + 36, + 1, + 4, + 7, + 12, + 8, + 21, + 19, + 19, + 25, + 19, + 6, + 15, + 3, + 13, + 22, + 25, + 5, + 6, + 31, + 4, + 8, + 27, + 18, + 32, + 17, + 33, + 28, + 2, + 17, + 22, + 14, + 3, + 16, + 22, + 3, + 12, + 23, + 0, + 19, + 35, + 1, + 11, + 5, + 19 + ], + "weighted_loads": [ + 1.539417453110218, + 1.189837820827961, + 0.3560949098318815, + 0.3490413762629032, + 1.0053938180208206, + 0.4130619838833809, + 0.5993860810995102, + 0.8062133751809597, + 2.109712902456522, + 0.49392951652407646, + 2.4838875830173492, + 1.2678243592381477, + 0.2196457963436842, + 0.6903902618214488, + 0.7558007724583149, + 0.4628919027745724, + 0.4196549952030182, + 0.5882039666175842, + 0.050177931785583496, + 2.726963821798563, + 0.027732040733098984, + 0.21037136763334274, + 0.7371448148041964, + 0.909505195915699, + 0.29995740205049515, + 0.9136255905032158, + 1.2617780342698097, + 1.8923712838441133, + 2.136287337169051, + 0.7090374417603016, + 0.29342578910291195, + 0.7215680750086904, + 0.10792141407728195, + 0.9293325245380402, + 1.5500669740140438, + 1.4894341491162777, + 0.21908028796315193, + 0.3229088820517063, + 2.0159958712756634, + 0.19580180384218693, + 0.48387227579951286, + 2.0934252850711346, + 1.206574546173215, + 1.7587447725236416, + 0.8390028784051538, + 2.3907191958278418, + 2.135943677276373, + 0.18908379971981049, + 1.09756600856781, + 1.0092124976217747, + 0.5799507834017277, + 0.23255731165409088, + 0.8101644143462181, + 1.6243103817105293, + 0.183928232640028, + 0.4999512378126383, + 1.530174195766449, + 0.0, + 1.141955677419901, + 1.8958355262875557, + 0.06396038830280304, + 0.8119057826697826, + 0.2993813678622246, + 1.3986082002520561 + ], + "unique_experts": 63, + "load_cv": 0.6205898375419943, + "normalized_load_entropy": 0.9481185505975407, + "max_load_share": 0.037267080745341616 + } + }, + "s0_period": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "0fda43121e2830e4c0d18f8439a574c078a050fd23380c73b361e2966a7235ae", + "route_weight_sha256": "113dbfb33652be56dbfc0dce00b97e84e893ddc0d75e8fe9b6978b216b6a5eff", + "loads": [ + 11, + 18, + 6, + 9, + 16, + 8, + 15, + 16, + 19, + 9, + 17, + 19, + 4, + 18, + 14, + 11, + 6, + 13, + 1, + 25, + 4, + 1, + 1, + 1, + 2, + 9, + 14, + 18, + 18, + 18, + 2, + 11, + 4, + 11, + 15, + 14, + 7, + 3, + 26, + 2, + 2, + 12, + 18, + 31, + 15, + 21, + 10, + 2, + 10, + 14, + 10, + 2, + 15, + 19, + 2, + 6, + 16, + 1, + 13, + 30, + 2, + 10, + 3, + 20 + ], + "weighted_loads": [ + 0.5495786722749472, + 0.9296263121068478, + 0.3547377437353134, + 0.37861650437116623, + 0.7565705813467503, + 0.4400934800505638, + 0.598192973062396, + 0.8002243675291538, + 1.6221531815826893, + 0.42160489782691, + 1.2612894270569086, + 1.223574049770832, + 0.13591271825134754, + 0.7206000965088606, + 0.6549200266599655, + 0.5207656919956207, + 0.3434615060687065, + 0.4527404624968767, + 0.05407118797302246, + 1.5921195801347494, + 0.12598645873367786, + 0.0800539031624794, + 0.03393777832388878, + 0.07290607690811157, + 0.06557321548461914, + 0.33686842396855354, + 0.9309365339577198, + 1.91190917044878, + 1.6929640360176563, + 0.6772331651300192, + 0.07150845602154732, + 0.5916714295744896, + 0.14054846949875355, + 0.7560604698956013, + 1.2085632123053074, + 0.7560886964201927, + 0.3103633150458336, + 0.19162620976567268, + 1.715477753430605, + 0.08317061886191368, + 0.08450185135006905, + 0.781864982098341, + 1.215219646692276, + 1.7096474207937717, + 0.7468426115810871, + 1.3820522800087929, + 0.7031660228967667, + 0.17559998482465744, + 0.670017272233963, + 0.5541731342673302, + 0.37173259630799294, + 0.21311656013131142, + 0.7666849829256535, + 1.4704939797520638, + 0.1413743793964386, + 0.2307375967502594, + 1.23415058106184, + 0.03565119951963425, + 0.8523116819560528, + 1.63294243440032, + 0.09977525472640991, + 0.8062536418437958, + 0.14866169542074203, + 1.4148946925997734 + ], + "unique_experts": 64, + "load_cv": 0.6670369342134949, + "normalized_load_entropy": 0.9410103600401438, + "max_load_share": 0.043055555555555555 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "1c9bc318e89ba2ae315884076b8ae52d95a88554ac1eb705178b48bcdf10fee0", + "route_weight_sha256": "f9a755a26e9878d01a897db234e3361ca9dc71f4546d3172e6d27965e9760c46", + "loads": [ + 21, + 21, + 6, + 9, + 18, + 8, + 15, + 16, + 21, + 9, + 29, + 19, + 6, + 22, + 14, + 11, + 7, + 15, + 1, + 35, + 4, + 1, + 4, + 4, + 5, + 10, + 14, + 19, + 18, + 18, + 3, + 16, + 4, + 11, + 25, + 20, + 7, + 3, + 29, + 2, + 2, + 23, + 18, + 31, + 18, + 29, + 22, + 2, + 13, + 14, + 14, + 3, + 15, + 22, + 2, + 11, + 22, + 1, + 15, + 35, + 2, + 10, + 5, + 21 + ], + "weighted_loads": [ + 1.218989847227931, + 1.1820166073739529, + 0.3547377437353134, + 0.37861650437116623, + 0.9869780503213406, + 0.4400934800505638, + 0.598192973062396, + 0.8002243675291538, + 1.7188927233219147, + 0.42160489782691, + 2.5187397096306086, + 1.223574049770832, + 0.18266144581139088, + 0.8619981678202748, + 0.6549200266599655, + 0.5207656919956207, + 0.38474730029702187, + 0.546839902177453, + 0.05407118797302246, + 2.6600292567163706, + 0.12598645873367786, + 0.0800539031624794, + 0.6377163305878639, + 0.3403965085744858, + 0.19450995326042175, + 0.414856668561697, + 0.9309365339577198, + 1.9249156322330236, + 1.6929640360176563, + 0.6772331651300192, + 0.11090043559670448, + 0.7768720733001828, + 0.14054846949875355, + 0.7560604698956013, + 1.7578995674848557, + 1.164707787334919, + 0.3103633150458336, + 0.19162620976567268, + 1.8420150727033615, + 0.08317061886191368, + 0.08450185135006905, + 1.755551241338253, + 1.215219646692276, + 1.7096474207937717, + 1.0017037140205503, + 2.0509942062199116, + 1.5895737409591675, + 0.17559998482465744, + 0.8448404781520367, + 0.5541731342673302, + 0.5719769038259983, + 0.2467484138906002, + 0.7666849829256535, + 1.581011550500989, + 0.1413743793964386, + 0.4849000722169876, + 1.5141356997191906, + 0.03565119951963425, + 0.9741277880966663, + 1.8459471762180328, + 0.09977525472640991, + 0.8062536418437958, + 0.20471472293138504, + 1.4510095044970512 + ], + "unique_experts": 64, + "load_cv": 0.6625437314343018, + "normalized_load_entropy": 0.9425846861899302, + "max_load_share": 0.040229885057471264 + } + }, + "s1_period": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "17949f1eac79f4ea71800876d662b757733944ce3bf319d98d6c8e2418b99a3e", + "route_weight_sha256": "b35ab012e1eb30cdd9cee835169f1c592f6255866eee2d52fd2083a8d187a6fb", + "loads": [ + 12, + 17, + 5, + 8, + 15, + 7, + 15, + 17, + 20, + 9, + 15, + 18, + 4, + 17, + 13, + 12, + 6, + 15, + 1, + 26, + 3, + 1, + 0, + 1, + 3, + 13, + 15, + 18, + 18, + 16, + 2, + 11, + 3, + 11, + 15, + 13, + 5, + 3, + 28, + 1, + 2, + 11, + 16, + 32, + 13, + 20, + 10, + 2, + 11, + 19, + 12, + 2, + 15, + 20, + 2, + 8, + 17, + 0, + 13, + 29, + 1, + 10, + 3, + 20 + ], + "weighted_loads": [ + 0.6403657793998718, + 0.8694925308227539, + 0.3179149255156517, + 0.3410208970308304, + 0.7229959666728973, + 0.41312504932284355, + 0.6032919753342867, + 0.805811770260334, + 1.68580961227417, + 0.40720657631754875, + 1.2233480289578438, + 1.183712176978588, + 0.1369348969310522, + 0.6668276656419039, + 0.6391120105981827, + 0.5262356698513031, + 0.33819566294550896, + 0.5262046866118908, + 0.04990383982658386, + 1.6502872966229916, + 0.08719441294670105, + 0.08385913819074631, + 0.0, + 0.0648307353258133, + 0.11067552119493484, + 0.46876565739512444, + 0.9910589568316936, + 1.8801710307598114, + 1.6924031153321266, + 0.6082120463252068, + 0.07000658102333546, + 0.5742583945393562, + 0.11077874526381493, + 0.7469312697649002, + 1.18375576287508, + 0.6946184486150742, + 0.21913336217403412, + 0.18408113718032837, + 1.8306723609566689, + 0.05193227156996727, + 0.08293734863400459, + 0.6620957404375076, + 1.1214369554072618, + 1.7659773621708155, + 0.66879827901721, + 1.354191705584526, + 0.6656902246177197, + 0.18976490944623947, + 0.72114622220397, + 0.7515596002340317, + 0.45459034480154514, + 0.19997307658195496, + 0.7789036128669977, + 1.5257739201188087, + 0.14405081793665886, + 0.2785336822271347, + 1.2525956146419048, + 0.0, + 0.8310831598937511, + 1.6228025909513235, + 0.06466890126466751, + 0.7810552790760994, + 0.14555634185671806, + 1.446292757987976 + ], + "unique_experts": 62, + "load_cv": 0.6842135252595846, + "normalized_load_entropy": 0.9360413231682507, + "max_load_share": 0.044444444444444446 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "1f422639981c53f08950de1b098e621523c80d0586fdce5152b5e460dcdf5586", + "route_weight_sha256": "78b704bdba77679e5fb41d786909f956f681f2c6137028c9c3049a01cee651c8", + "loads": [ + 24, + 22, + 5, + 8, + 18, + 7, + 15, + 17, + 27, + 11, + 27, + 20, + 6, + 19, + 14, + 12, + 7, + 18, + 1, + 36, + 3, + 4, + 4, + 12, + 8, + 24, + 19, + 19, + 24, + 16, + 5, + 15, + 3, + 14, + 21, + 25, + 5, + 6, + 33, + 2, + 8, + 27, + 18, + 32, + 16, + 31, + 30, + 2, + 18, + 24, + 14, + 3, + 15, + 23, + 3, + 13, + 23, + 0, + 19, + 33, + 1, + 11, + 5, + 21 + ], + "weighted_loads": [ + 1.4315803796052933, + 1.1868567541241646, + 0.3179149255156517, + 0.3410208970308304, + 1.033286351710558, + 0.41312504932284355, + 0.6032919753342867, + 0.805811770260334, + 2.1041961945593357, + 0.4988543912768364, + 2.380872283130884, + 1.2800653725862503, + 0.18420097045600414, + 0.718930603004992, + 0.6782351769506931, + 0.5262356698513031, + 0.38429004698991776, + 0.6723121218383312, + 0.04990383982658386, + 2.7517416290938854, + 0.08719441294670105, + 0.21085871011018753, + 0.6423777788877487, + 0.9108729436993599, + 0.29934193566441536, + 1.0051492545753717, + 1.2462728060781956, + 1.893177492544055, + 2.1137321554124355, + 0.6082120463252068, + 0.2527133282274008, + 0.7201968813315034, + 0.11077874526381493, + 0.9694332964718342, + 1.4812896512448788, + 1.4656540043652058, + 0.21913336217403412, + 0.32660948112607, + 2.104151863604784, + 0.12043275311589241, + 0.4843592047691345, + 2.1285313852131367, + 1.2138905730098486, + 1.7659773621708155, + 0.7982721300795674, + 2.2861604504287243, + 2.38990193977952, + 0.18976490944623947, + 1.1428925916552544, + 1.0802054926753044, + 0.5732230935245752, + 0.23311996459960938, + 0.7789036128669977, + 1.6767439804971218, + 0.18539021909236908, + 0.5180851016193628, + 1.5279408618807793, + 0.0, + 1.154641605913639, + 1.803712485358119, + 0.06466890126466751, + 0.8190483450889587, + 0.3030078820884228, + 1.4822944067418575 + ], + "unique_experts": 63, + "load_cv": 0.6286056614163902, + "normalized_load_entropy": 0.9465292524259744, + "max_load_share": 0.037267080745341616 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 120, + "ordered_topk_exact_tokens": 69, + "set_exact_tokens": 86, + "mean_set_jaccard": 0.9154761904761906, + "mean_token_weighted_tv": 0.016550664495055874, + "aggregate_load_tv": 0.03194444444444445 + }, + "system_bos": { + "tokens": 120, + "ordered_topk_exact_tokens": 62, + "set_exact_tokens": 77, + "mean_set_jaccard": 0.8976190476190476, + "mean_token_weighted_tv": 0.01998994325598081, + "aggregate_load_tv": 0.03749999999999999 + }, + "system_x": { + "tokens": 120, + "ordered_topk_exact_tokens": 54, + "set_exact_tokens": 78, + "mean_set_jaccard": 0.8928571428571429, + "mean_token_weighted_tv": 0.023069637183410426, + "aggregate_load_tv": 0.0375 + }, + "system_period": { + "tokens": 120, + "ordered_topk_exact_tokens": 56, + "set_exact_tokens": 76, + "mean_set_jaccard": 0.8880952380952382, + "mean_token_weighted_tv": 0.023303305132625005, + "aggregate_load_tv": 0.03888888888888889 + }, + "bos_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 51, + "set_exact_tokens": 72, + "mean_set_jaccard": 0.8714285714285716, + "mean_token_weighted_tv": 0.02572553892775128, + "aggregate_load_tv": 0.048611111111111105 + }, + "bos_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 51, + "set_exact_tokens": 73, + "mean_set_jaccard": 0.8791666666666667, + "mean_token_weighted_tv": 0.02514995405605684, + "aggregate_load_tv": 0.04027777777777777 + }, + "x_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 48, + "set_exact_tokens": 66, + "mean_set_jaccard": 0.8543650793650795, + "mean_token_weighted_tv": 0.02929321301635355, + "aggregate_load_tv": 0.04722222222222222 + }, + "x_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 42, + "set_exact_tokens": 60, + "mean_set_jaccard": 0.842857142857143, + "mean_token_weighted_tv": 0.032124717440456155, + "aggregate_load_tv": 0.05 + }, + "period_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 45, + "set_exact_tokens": 64, + "mean_set_jaccard": 0.8496031746031746, + "mean_token_weighted_tv": 0.029921440710313617, + "aggregate_load_tv": 0.04583333333333333 + }, + "period_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 40, + "set_exact_tokens": 64, + "mean_set_jaccard": 0.8523809523809524, + "mean_token_weighted_tv": 0.03097124109044671, + "aggregate_load_tv": 0.038888888888888896 + } + } + }, + "layer_10": { + "layer": 10, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "065d9b448e3af59483c1a0d084813e76dc08ec5cfb24670e2dce099a840ac5f0", + "route_weight_sha256": "ce9783bbbf0e8558f38aedf111513756e07efad0023b12e94d0d348c5bf1f710", + "loads": [ + 7, + 23, + 1, + 28, + 7, + 32, + 19, + 4, + 11, + 8, + 3, + 18, + 8, + 3, + 7, + 22, + 13, + 25, + 10, + 8, + 9, + 18, + 10, + 20, + 8, + 6, + 5, + 2, + 14, + 9, + 11, + 7, + 21, + 11, + 2, + 2, + 19, + 19, + 2, + 2, + 9, + 9, + 3, + 5, + 34, + 21, + 18, + 5, + 3, + 13, + 24, + 14, + 1, + 11, + 0, + 7, + 10, + 20, + 6, + 17, + 11, + 5, + 13, + 7 + ], + "weighted_loads": [ + 0.2535592205822468, + 0.9722528457641602, + 0.03997979685664177, + 1.5178150460124016, + 0.5503806471824646, + 1.3806208111345768, + 0.9791834428906441, + 0.1528918519616127, + 0.49289496429264545, + 0.3244841266423464, + 0.1081017255783081, + 1.2376256361603737, + 0.7495066300034523, + 0.21409210935235023, + 0.3200632706284523, + 0.9803856071084738, + 0.6679258998483419, + 1.2666774857789278, + 0.47984935343265533, + 0.4123043492436409, + 0.3299430012702942, + 1.2798309586942196, + 0.4768473953008652, + 0.9506368357688189, + 0.39669371396303177, + 0.40870557725429535, + 0.2371083851903677, + 0.1374814696609974, + 0.7893038876354694, + 0.5127038769423962, + 0.6091416403651237, + 0.27848209999501705, + 2.335686970502138, + 0.4833781458437443, + 0.1720568872988224, + 0.07743331417441368, + 1.2937452904880047, + 2.052098084241152, + 0.1749708354473114, + 0.096627376973629, + 0.5275411643087864, + 0.5577169191092253, + 0.1069328598678112, + 0.2207743190228939, + 2.436294350773096, + 1.1702631302177906, + 2.1802348122000694, + 0.1956120766699314, + 0.10423499718308449, + 0.7138329111039639, + 1.4161171726882458, + 0.9159834124147892, + 0.04928548261523247, + 0.5483192503452301, + 0.0, + 0.44440992176532745, + 0.41808267310261726, + 1.8440230041742325, + 0.24806115217506886, + 0.7372543253004551, + 0.713078323751688, + 0.6814296059310436, + 0.5088301580399275, + 0.3493609130382538 + ], + "unique_experts": 63, + "load_cv": 0.7051836290054414, + "normalized_load_entropy": 0.9399923495343567, + "max_load_share": 0.04722222222222222 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "8148b1a6661f30d0eee679621d7ef839570dc7da75a4f17139ac8c720a4a51ce", + "route_weight_sha256": "98a26e73a3fc0dd1b25a7c241fa7004e96c02883b77b9ac547ac49fd4d8e31ae", + "loads": [ + 7, + 23, + 3, + 28, + 7, + 32, + 19, + 9, + 11, + 10, + 5, + 20, + 9, + 6, + 9, + 22, + 13, + 29, + 17, + 10, + 13, + 20, + 11, + 20, + 8, + 8, + 5, + 9, + 15, + 10, + 14, + 8, + 21, + 19, + 3, + 3, + 19, + 19, + 2, + 2, + 9, + 17, + 7, + 7, + 41, + 24, + 23, + 8, + 3, + 14, + 26, + 20, + 1, + 14, + 0, + 16, + 10, + 26, + 6, + 27, + 16, + 17, + 13, + 7 + ], + "weighted_loads": [ + 0.2535592205822468, + 0.9722528457641602, + 0.059035553596913815, + 1.5178150460124016, + 0.5503806471824646, + 1.3806208111345768, + 0.9791834428906441, + 0.3659893460571766, + 0.49289496429264545, + 0.34895429480820894, + 0.20416731759905815, + 1.3334640711545944, + 0.7822304032742977, + 1.6299104802310467, + 0.4871406778693199, + 0.9803856071084738, + 0.6679258998483419, + 1.5035252925008535, + 0.8643911923281848, + 0.5123367235064507, + 0.49761804938316345, + 1.3587736152112484, + 0.480580969247967, + 0.9506368357688189, + 0.39669371396303177, + 0.4723534621298313, + 0.2371083851903677, + 0.8027979247272015, + 0.8359390869736671, + 0.5556457526981831, + 0.9241819903254509, + 0.2922585690394044, + 2.335686970502138, + 0.8499940186738968, + 0.2018810659646988, + 0.11430719122290611, + 1.2937452904880047, + 2.052098084241152, + 0.1749708354473114, + 0.096627376973629, + 0.5275411643087864, + 1.5160058420151472, + 0.22074027452617884, + 0.3174554109573364, + 2.9643914587795734, + 1.3124355301260948, + 2.4162478260695934, + 0.324493708088994, + 0.10423499718308449, + 0.7685703821480274, + 1.5118323266506195, + 1.2143676951527596, + 0.04928548261523247, + 0.7055294625461102, + 0.0, + 1.036309465765953, + 0.41808267310261726, + 2.1945447102189064, + 0.24806115217506886, + 1.3714143745601177, + 1.0217319503426552, + 1.7212154157459736, + 0.5088301580399275, + 0.3493609130382538 + ], + "unique_experts": 63, + "load_cv": 0.6237599668419265, + "normalized_load_entropy": 0.9517209808037461, + "max_load_share": 0.047126436781609195 + } + }, + "s1_eos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "c171964c41bbf7d4ebf8923cd88509c7b78dcd97d8b3e39debef24833d3358b8", + "route_weight_sha256": "305e513772bbd4c2f165846976d83c3091ba12cdd94ae75d7aa8296f0003ac07", + "loads": [ + 5, + 24, + 2, + 26, + 7, + 36, + 20, + 2, + 8, + 9, + 3, + 18, + 8, + 3, + 7, + 24, + 11, + 26, + 10, + 8, + 12, + 18, + 9, + 18, + 7, + 6, + 5, + 1, + 14, + 9, + 11, + 6, + 20, + 12, + 2, + 2, + 18, + 17, + 2, + 2, + 11, + 11, + 5, + 5, + 34, + 22, + 18, + 5, + 2, + 13, + 24, + 13, + 1, + 11, + 0, + 8, + 13, + 20, + 7, + 17, + 12, + 5, + 8, + 7 + ], + "weighted_loads": [ + 0.16696146503090858, + 1.0078513137996197, + 0.08725006878376007, + 1.4706732407212257, + 0.5444621630012989, + 1.523584559559822, + 1.0077878404408693, + 0.07718315348029137, + 0.399230744689703, + 0.35128484666347504, + 0.11060962453484535, + 1.2035868801176548, + 0.7429428435862064, + 0.1963716596364975, + 0.32595209032297134, + 1.0873943343758583, + 0.5898151509463787, + 1.2984691355377436, + 0.48015647381544113, + 0.41368263959884644, + 0.4572739191353321, + 1.2746359407901764, + 0.42018261924386024, + 0.8844334091991186, + 0.31771257892251015, + 0.4093197211623192, + 0.24249811470508575, + 0.10893358290195465, + 0.7919573970139027, + 0.5011837929487228, + 0.5973469205200672, + 0.25386480055749416, + 2.258319456130266, + 0.5331771895289421, + 0.16979211941361427, + 0.07937623932957649, + 1.3395483195781708, + 1.9661953449249268, + 0.1761149913072586, + 0.09522103145718575, + 0.6054071709513664, + 0.6431692540645599, + 0.18819237500429153, + 0.23299586027860641, + 2.437708668410778, + 1.1956692337989807, + 2.180184803903103, + 0.19919079542160034, + 0.06013736315071583, + 0.7140776999294758, + 1.3941712640225887, + 0.87120496109128, + 0.04636076092720032, + 0.5498806610703468, + 0.0, + 0.4737076684832573, + 0.5286872293800116, + 1.8419623468071222, + 0.27093468979001045, + 0.7397367935627699, + 0.7329041846096516, + 0.6940015070140362, + 0.33097259514033794, + 0.3456876054406166 + ], + "unique_experts": 63, + "load_cv": 0.7228202652129152, + "normalized_load_entropy": 0.9376420153206791, + "max_load_share": 0.05 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "39b8c79a1739aba6df8a872d51b2854d8292e446d91e071cbcb2001710d17018", + "route_weight_sha256": "1bfc8e8baf740362b6b29cd0655ea3e8a5a0a0ec1b781fc5a05e0088146a276b", + "loads": [ + 5, + 24, + 5, + 26, + 11, + 36, + 20, + 4, + 8, + 11, + 5, + 22, + 12, + 5, + 11, + 24, + 11, + 31, + 16, + 9, + 13, + 20, + 10, + 18, + 8, + 9, + 7, + 22, + 14, + 12, + 20, + 7, + 25, + 29, + 4, + 4, + 20, + 19, + 3, + 2, + 12, + 25, + 9, + 7, + 40, + 27, + 23, + 8, + 10, + 15, + 28, + 26, + 2, + 15, + 0, + 21, + 14, + 27, + 7, + 33, + 24, + 15, + 8, + 8 + ], + "weighted_loads": [ + 0.16696146503090858, + 1.0078513137996197, + 0.14680627407506108, + 1.4706732407212257, + 0.7457410506904125, + 1.523584559559822, + 1.0077878404408693, + 0.16232037916779518, + 0.399230744689703, + 0.37641247920691967, + 0.18883591145277023, + 1.4244822897017002, + 0.9437987878918648, + 1.5711447149515152, + 0.6067052967846394, + 1.0873943343758583, + 0.5898151509463787, + 1.5814251955598593, + 0.8437075112015009, + 0.44662007316946983, + 0.4980062209069729, + 1.360391404479742, + 0.4240839071571827, + 0.8844334091991186, + 0.3595953993499279, + 0.7354701701551676, + 0.3127704281359911, + 1.389110952615738, + 0.7919573970139027, + 0.6338776797056198, + 1.3490937538444996, + 0.2676412696018815, + 2.750533666461706, + 1.3698145188391209, + 0.31170593202114105, + 0.24181940406560898, + 1.4240738302469254, + 2.0538019984960556, + 0.2126562036573887, + 0.09522103145718575, + 0.647454846650362, + 1.9913369715213776, + 0.28568465542048216, + 0.3007472865283489, + 2.8955096416175365, + 1.4585342332720757, + 2.45974500477314, + 0.3221354205161333, + 0.7076008673757315, + 0.8465597368776798, + 1.632794488221407, + 1.6398929618299007, + 0.11580006033182144, + 0.745848223567009, + 0.0, + 1.3467758297920227, + 0.6019306313246489, + 2.2287865970283747, + 0.27093468979001045, + 1.7755771894007921, + 1.5024688467383385, + 1.6028145849704742, + 0.33097259514033794, + 0.3814663738012314 + ], + "unique_experts": 63, + "load_cv": 0.6160420608786877, + "normalized_load_entropy": 0.9525664732667097, + "max_load_share": 0.041407867494824016 + } + }, + "s0_bos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "1d165c5fce6efc4d85d3c58e3e03242dd430ad47372d9a167b1044b0f26cfc28", + "route_weight_sha256": "07a842cef6cc2aa69a26db890d195249c809c9d0adac4f66c24d8a9db6806c6f", + "loads": [ + 5, + 23, + 3, + 27, + 7, + 31, + 20, + 4, + 11, + 7, + 2, + 18, + 8, + 4, + 7, + 22, + 12, + 27, + 13, + 8, + 13, + 17, + 9, + 18, + 6, + 6, + 5, + 2, + 10, + 11, + 11, + 6, + 21, + 11, + 2, + 2, + 19, + 18, + 2, + 2, + 10, + 9, + 9, + 5, + 33, + 22, + 18, + 5, + 3, + 11, + 24, + 14, + 1, + 10, + 0, + 7, + 11, + 21, + 6, + 14, + 10, + 6, + 11, + 10 + ], + "weighted_loads": [ + 0.1809465978294611, + 0.9298131670802832, + 0.100428007543087, + 1.503192225471139, + 0.5619480833411217, + 1.3397501464933157, + 1.0333780609071255, + 0.16558773443102837, + 0.4897645618766546, + 0.2974516376852989, + 0.0739879459142685, + 1.2559936791658401, + 0.7597723305225372, + 0.2302718684077263, + 0.3018115274608135, + 0.9614923000335693, + 0.6670908536761999, + 1.2729365155100822, + 0.6159971207380295, + 0.38171927630901337, + 0.4901152867823839, + 1.2253490798175335, + 0.40123194828629494, + 0.8576942570507526, + 0.27395087108016014, + 0.3934663124382496, + 0.2454191204160452, + 0.13071460649371147, + 0.6392885521054268, + 0.5665699653327465, + 0.5977894775569439, + 0.25531037524342537, + 2.3336369395256042, + 0.5032217428088188, + 0.18701865151524544, + 0.08213008940219879, + 1.3627558127045631, + 2.2259350270032883, + 0.18274477869272232, + 0.08478748798370361, + 0.5996222458779812, + 0.6032543182373047, + 0.3331849128007889, + 0.2328062392771244, + 2.3624235205352306, + 1.2085875123739243, + 2.2146891728043556, + 0.19410013779997826, + 0.10547562874853611, + 0.6187869608402252, + 1.427755381911993, + 0.9165543727576733, + 0.04914812371134758, + 0.5046543143689632, + 0.0, + 0.4783884473145008, + 0.4702937249094248, + 1.9046353790909052, + 0.24777907133102417, + 0.6348494198173285, + 0.7013460770249367, + 0.6971669904887676, + 0.4178703762590885, + 0.4604642167687416 + ], + "unique_experts": 63, + "load_cv": 0.6896053621859066, + "normalized_load_entropy": 0.9429816034676924, + "max_load_share": 0.04583333333333333 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "1c83da7c7b08f77c0c691bd4d2eac20935048be84234ee5d9327e7d545034f6c", + "route_weight_sha256": "b0b3d1d474d9a90ec69f3d54b43bdcc82ab828039f1506ce6375edbb21363d63", + "loads": [ + 5, + 24, + 4, + 27, + 7, + 31, + 20, + 9, + 11, + 8, + 4, + 19, + 9, + 7, + 10, + 22, + 12, + 31, + 19, + 10, + 18, + 19, + 9, + 18, + 6, + 8, + 5, + 10, + 11, + 12, + 14, + 7, + 21, + 19, + 3, + 3, + 19, + 18, + 2, + 2, + 10, + 18, + 13, + 7, + 39, + 25, + 23, + 8, + 3, + 14, + 26, + 19, + 1, + 13, + 0, + 15, + 11, + 27, + 6, + 25, + 15, + 18, + 11, + 10 + ], + "weighted_loads": [ + 0.1809465978294611, + 0.9662500526756048, + 0.11458953283727169, + 1.503192225471139, + 0.5619480833411217, + 1.3397501464933157, + 1.0333780609071255, + 0.37868522852659225, + 0.4897645618766546, + 0.3136936388909817, + 0.17005353793501854, + 1.3041346929967403, + 0.7924961037933826, + 0.7763305269181728, + 0.5381529033184052, + 0.9614923000335693, + 0.6670908536761999, + 1.507317915558815, + 1.0173657648265362, + 0.48085685446858406, + 0.7293649259954691, + 1.3042917363345623, + 0.40123194828629494, + 0.8576942570507526, + 0.27395087108016014, + 0.45711419731378555, + 0.2454191204160452, + 0.9169310964643955, + 0.6859237514436245, + 0.6095118410885334, + 0.9076265059411526, + 0.2690868442878127, + 2.3336369395256042, + 0.8836901113390923, + 0.21684283018112183, + 0.11900396645069122, + 1.3627558127045631, + 2.2259350270032883, + 0.18274477869272232, + 0.08478748798370361, + 0.5996222458779812, + 1.724258627742529, + 0.48845134675502777, + 0.3294873312115669, + 2.8907494619488716, + 1.3507599122822285, + 2.4507021866738796, + 0.32551675848662853, + 0.10547562874853611, + 0.7848381511867046, + 1.5234705358743668, + 1.1547545082867146, + 0.04914812371134758, + 0.6610877625644207, + 0.0, + 1.029051348567009, + 0.4702937249094248, + 2.255157085135579, + 0.24777907133102417, + 1.313087111338973, + 1.016859844326973, + 1.7369528003036976, + 0.4178703762590885, + 0.4604642167687416 + ], + "unique_experts": 63, + "load_cv": 0.6161219755938091, + "normalized_load_entropy": 0.9523916730208063, + "max_load_share": 0.04482758620689655 + } + }, + "s1_bos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "9933c73858d7e55e99b93df4468e8a017fad21903955da5405cc1f353e283947", + "route_weight_sha256": "e659355a63b369291ef32e7cca8c8e616f1dff385891ce48d21b2383c9642891", + "loads": [ + 6, + 23, + 2, + 26, + 7, + 32, + 20, + 2, + 9, + 9, + 3, + 18, + 8, + 3, + 7, + 24, + 12, + 27, + 13, + 8, + 10, + 18, + 8, + 19, + 6, + 6, + 5, + 2, + 10, + 9, + 11, + 4, + 20, + 11, + 2, + 2, + 19, + 18, + 2, + 2, + 12, + 9, + 12, + 5, + 34, + 22, + 18, + 6, + 2, + 13, + 24, + 13, + 1, + 11, + 0, + 7, + 10, + 21, + 7, + 16, + 10, + 5, + 9, + 10 + ], + "weighted_loads": [ + 0.21872051246464252, + 0.9384906142950058, + 0.08439161628484726, + 1.497438918799162, + 0.581933680921793, + 1.3657173831015825, + 1.0542610175907612, + 0.08443955332040787, + 0.41413281485438347, + 0.35265905782580376, + 0.11428768932819366, + 1.2165056057274342, + 0.7598416656255722, + 0.18882757797837257, + 0.3100360222160816, + 1.0318380426615477, + 0.6356692165136337, + 1.294062901288271, + 0.5948132686316967, + 0.3951771855354309, + 0.39582501351833344, + 1.2504229843616486, + 0.3490409776568413, + 0.8927644062787294, + 0.26781097799539566, + 0.40981970354914665, + 0.25219267420470715, + 0.1122376099228859, + 0.6255532838404179, + 0.4983055591583252, + 0.5882265157997608, + 0.17810090258717537, + 2.314032431691885, + 0.5106280148029327, + 0.18224311992526054, + 0.08057207986712456, + 1.421998631209135, + 2.196517463773489, + 0.18641458451747894, + 0.0881979875266552, + 0.6653271988034248, + 0.5657763313502073, + 0.4471294581890106, + 0.2395481951534748, + 2.438440317288041, + 1.2082982417196035, + 2.2387039102613926, + 0.22967836260795593, + 0.06062944605946541, + 0.6830309592187405, + 1.42742919921875, + 0.882468406111002, + 0.053386181592941284, + 0.53238969668746, + 0.0, + 0.4593808837234974, + 0.4369723070412874, + 1.9021669961512089, + 0.28080414049327374, + 0.7067591827362776, + 0.683145996183157, + 0.6758088283240795, + 0.3155659791082144, + 0.4852784387767315 + ], + "unique_experts": 63, + "load_cv": 0.7067575063906334, + "normalized_load_entropy": 0.9398851933060067, + "max_load_share": 0.04722222222222222 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "288ab42b5d8f2f24d1fb05d1d002b80d929b73709c3551bf97191db1b5b77c65", + "route_weight_sha256": "9aa5d2b4f3fb0024b3b7a51a262b8ae66818b811ea8f5b1338875b8193c70b9f", + "loads": [ + 6, + 23, + 4, + 26, + 11, + 32, + 20, + 4, + 9, + 10, + 5, + 22, + 12, + 5, + 12, + 24, + 12, + 31, + 18, + 10, + 12, + 20, + 8, + 19, + 7, + 9, + 7, + 24, + 10, + 12, + 20, + 5, + 25, + 29, + 4, + 4, + 21, + 20, + 3, + 2, + 13, + 24, + 14, + 7, + 40, + 27, + 23, + 9, + 10, + 17, + 28, + 25, + 2, + 15, + 0, + 19, + 11, + 28, + 7, + 33, + 22, + 15, + 9, + 11 + ], + "weighted_loads": [ + 0.21872051246464252, + 0.9384906142950058, + 0.13896151818335056, + 1.497438918799162, + 0.7832125686109066, + 1.3657173831015825, + 1.0542610175907612, + 0.16957677900791168, + 0.41413281485438347, + 0.3689010590314865, + 0.19251397624611855, + 1.4438399150967598, + 0.9606976099312305, + 0.6971881538629532, + 0.6631039045751095, + 1.0318380426615477, + 0.6356692165136337, + 1.5169906318187714, + 0.9942831881344318, + 0.4755127914249897, + 0.4922102428972721, + 1.3361784480512142, + 0.3490409776568413, + 0.8927644062787294, + 0.3096937984228134, + 0.735970152541995, + 0.3224649876356125, + 1.462990153580904, + 0.6255532838404179, + 0.6309994459152222, + 1.3380926810204983, + 0.1918773716315627, + 2.806246642023325, + 1.3850515075027943, + 0.3241569325327873, + 0.24301524460315704, + 1.5065241418778896, + 2.284124117344618, + 0.22295579686760902, + 0.0881979875266552, + 0.7073748745024204, + 2.1710107941180468, + 0.4929491989314556, + 0.3072996214032173, + 2.9714323971420527, + 1.4711632411926985, + 2.5182641111314297, + 0.35627647303044796, + 0.708092950284481, + 0.9152664877474308, + 1.6571980603039265, + 1.5824473798274994, + 0.12282548099756241, + 0.7364790327847004, + 0.0, + 1.3222836814820766, + 0.5102157089859247, + 2.2889912463724613, + 0.28080414049327374, + 1.8121519405394793, + 1.4521217830479145, + 1.5846219062805176, + 0.3155659791082144, + 0.5210572071373463 + ], + "unique_experts": 63, + "load_cv": 0.6063920297276629, + "normalized_load_entropy": 0.9534150404869333, + "max_load_share": 0.041407867494824016 + } + }, + "s0_x": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "cb1ce89395032abc48fdbeffe5d0addbe3cee32ad30be1973654151d21a3cf47", + "route_weight_sha256": "ae9f2abf4e355ef6f2f59db1cb781d90d0068b92ea598c402e3fba657315732f", + "loads": [ + 6, + 23, + 3, + 26, + 7, + 33, + 20, + 1, + 11, + 7, + 2, + 17, + 8, + 2, + 7, + 22, + 12, + 27, + 12, + 7, + 10, + 18, + 9, + 18, + 6, + 6, + 5, + 2, + 8, + 11, + 11, + 5, + 20, + 10, + 2, + 2, + 19, + 19, + 2, + 2, + 12, + 11, + 10, + 4, + 34, + 22, + 18, + 5, + 3, + 11, + 24, + 15, + 1, + 11, + 0, + 7, + 10, + 23, + 7, + 14, + 11, + 5, + 13, + 11 + ], + "weighted_loads": [ + 0.22056472301483154, + 0.9022554010152817, + 0.09997809492051601, + 1.491751465946436, + 0.571097370237112, + 1.3753307685256004, + 1.0673796869814396, + 0.040890149772167206, + 0.4947369899600744, + 0.2791485246270895, + 0.07342537865042686, + 1.2173211053013802, + 0.7723062187433243, + 0.15946872904896736, + 0.3036934807896614, + 0.9421020355075598, + 0.6617115084081888, + 1.3902142494916916, + 0.5471578612923622, + 0.31780778616666794, + 0.3864726200699806, + 1.2957410775125027, + 0.3968469500541687, + 0.8346251007169485, + 0.28404463827610016, + 0.3932587318122387, + 0.24654166400432587, + 0.08327514305710793, + 0.5402143634855747, + 0.5682849325239658, + 0.6131734699010849, + 0.22129233367741108, + 2.321000013500452, + 0.44711481407284737, + 0.19063861668109894, + 0.07642194256186485, + 1.3478623628616333, + 2.316803615540266, + 0.1816776990890503, + 0.08470043167471886, + 0.6671677120029926, + 0.6201145742088556, + 0.37946995347738266, + 0.1752432957291603, + 2.4788531735539436, + 1.2040651626884937, + 2.207623939961195, + 0.1948011964559555, + 0.10645580850541592, + 0.6241294965147972, + 1.4653612822294235, + 0.9764039888978004, + 0.047759946435689926, + 0.5480578318238258, + 0.0, + 0.4768623784184456, + 0.4411768987774849, + 1.9795350022614002, + 0.285552728921175, + 0.6225956045091152, + 0.7651402577757835, + 0.6711609177291393, + 0.4938339125365019, + 0.49664992094039917 + ], + "unique_experts": 63, + "load_cv": 0.7114582486036498, + "normalized_load_entropy": 0.9387752936550275, + "max_load_share": 0.04722222222222222 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "121085bd68db3640d4f5d7a67548410035ffb30446714f3c9d699420d0407330", + "route_weight_sha256": "aefd01f308f688f175f5044bb98473b8c406e647ff7c0545136e79f5e7860ee0", + "loads": [ + 6, + 24, + 4, + 26, + 7, + 33, + 20, + 7, + 11, + 8, + 5, + 18, + 9, + 4, + 9, + 22, + 12, + 32, + 17, + 8, + 14, + 20, + 9, + 18, + 6, + 8, + 5, + 7, + 9, + 12, + 14, + 6, + 20, + 19, + 3, + 3, + 19, + 19, + 2, + 2, + 12, + 19, + 13, + 6, + 41, + 26, + 24, + 9, + 3, + 13, + 27, + 21, + 1, + 14, + 0, + 14, + 10, + 30, + 7, + 25, + 16, + 18, + 13, + 11 + ], + "weighted_loads": [ + 0.22056472301483154, + 0.9491251893341541, + 0.1141396202147007, + 1.491751465946436, + 0.571097370237112, + 1.3753307685256004, + 1.0673796869814396, + 0.2927985228598118, + 0.4947369899600744, + 0.29539052583277225, + 0.20221396535634995, + 1.2654621191322803, + 0.8050299920141697, + 0.663509901612997, + 0.48016345500946045, + 0.9421020355075598, + 0.6617115084081888, + 1.671269167214632, + 0.8852333910763264, + 0.38145142048597336, + 0.5541476681828499, + 1.3746837340295315, + 0.3968469500541687, + 0.8346251007169485, + 0.28404463827610016, + 0.45690661668777466, + 0.24654166400432587, + 0.6175654083490372, + 0.5868495628237724, + 0.6112268082797527, + 0.930482916533947, + 0.23506880272179842, + 2.321000013500452, + 0.8590892069041729, + 0.22046279534697533, + 0.11329581961035728, + 1.3478623628616333, + 2.316803615540266, + 0.1816776990890503, + 0.08470043167471886, + 0.6671677120029926, + 1.4479757379740477, + 0.4852035716176033, + 0.27192438766360283, + 3.033823747187853, + 1.415488213300705, + 2.492874074727297, + 0.3623949456959963, + 0.10645580850541592, + 0.7125800512731075, + 1.5951576493680477, + 1.288113497197628, + 0.047759946435689926, + 0.711797472089529, + 0.0, + 0.9356555454432964, + 0.4411768987774849, + 2.393064234405756, + 0.285552728921175, + 1.3133460395038128, + 1.0742941051721573, + 1.797452513128519, + 0.4938339125365019, + 0.49664992094039917 + ], + "unique_experts": 63, + "load_cv": 0.6457397199871512, + "normalized_load_entropy": 0.9489023527007656, + "max_load_share": 0.047126436781609195 + } + }, + "s1_x": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "669bfe3f788fecd9d19070d1d73aa8534a7a519fdaf7e7ba50e76c84a6be0538", + "route_weight_sha256": "f506e11d121ca1687e50aa50a955803b9d7220de25b80222441a65419462c985", + "loads": [ + 6, + 22, + 1, + 25, + 7, + 31, + 22, + 1, + 11, + 7, + 2, + 17, + 8, + 3, + 6, + 26, + 12, + 31, + 10, + 7, + 10, + 18, + 8, + 17, + 6, + 6, + 5, + 0, + 10, + 12, + 11, + 4, + 21, + 10, + 2, + 2, + 19, + 18, + 2, + 2, + 14, + 9, + 7, + 4, + 36, + 23, + 18, + 6, + 2, + 12, + 24, + 15, + 1, + 12, + 1, + 6, + 8, + 22, + 7, + 17, + 13, + 5, + 10, + 10 + ], + "weighted_loads": [ + 0.2239956520497799, + 0.892236053943634, + 0.04551341384649277, + 1.5045759864151478, + 0.6012714691460133, + 1.2751369178295135, + 1.1374458894133568, + 0.04164547473192215, + 0.48215419240295887, + 0.265873771160841, + 0.07272296026349068, + 1.172788493335247, + 0.764351099729538, + 0.18656504526734352, + 0.2716086246073246, + 1.1066117230802774, + 0.6333880089223385, + 1.57602065987885, + 0.4594333581626415, + 0.34595050662755966, + 0.3794515132904053, + 1.2748456709086895, + 0.35651472210884094, + 0.8518574088811874, + 0.30305587500333786, + 0.39153678715229034, + 0.25097578577697277, + 0.0, + 0.641178160905838, + 0.6148207206279039, + 0.6006420962512493, + 0.17021659761667252, + 2.3712756112217903, + 0.4612849950790405, + 0.18654753267765045, + 0.08058880642056465, + 1.4067842327058315, + 2.223479814827442, + 0.17780520766973495, + 0.08886612951755524, + 0.7462578117847443, + 0.5030802823603153, + 0.2400897853076458, + 0.19442689791321754, + 2.5635752510279417, + 1.240826554596424, + 2.2468860670924187, + 0.22393693029880524, + 0.06003015860915184, + 0.6096345223486423, + 1.4664675295352936, + 0.9855844751000404, + 0.05183720961213112, + 0.5880885310471058, + 0.027190910652279854, + 0.40389832109212875, + 0.35039055719971657, + 1.9623635821044445, + 0.28865731321275234, + 0.7285623960196972, + 0.8193845599889755, + 0.6448366753757, + 0.39434940554201603, + 0.48935563676059246 + ], + "unique_experts": 63, + "load_cv": 0.7435317788587382, + "normalized_load_entropy": 0.9333857809987647, + "max_load_share": 0.05 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "aa0f0c8a4e4fa7edc57a6622285f09c69c03355ff52c02877ebed0557cdff466", + "route_weight_sha256": "df69be634cedfa1f8e4cb854dc2571780cb35867235371f463fdfa1dcd32c295", + "loads": [ + 7, + 23, + 3, + 25, + 11, + 31, + 22, + 4, + 11, + 8, + 5, + 21, + 12, + 4, + 11, + 26, + 12, + 36, + 14, + 8, + 11, + 20, + 8, + 17, + 7, + 9, + 7, + 18, + 10, + 15, + 21, + 5, + 26, + 28, + 4, + 4, + 21, + 20, + 3, + 2, + 15, + 23, + 9, + 6, + 41, + 29, + 24, + 10, + 10, + 16, + 30, + 28, + 2, + 16, + 1, + 16, + 9, + 30, + 7, + 33, + 24, + 16, + 10, + 11 + ], + "weighted_loads": [ + 0.2773294560611248, + 0.9418290928006172, + 0.10008331574499607, + 1.5045759864151478, + 0.8025503568351269, + 1.2751369178295135, + 1.1374458894133568, + 0.1770583800971508, + 0.48215419240295887, + 0.28211577236652374, + 0.19964022934436798, + 1.396943349391222, + 0.9652070440351963, + 0.6554673053324223, + 0.6195930354297161, + 1.1066117230802774, + 0.6333880089223385, + 1.839045798406005, + 0.7833251990377903, + 0.37977734953165054, + 0.42018381506204605, + 1.3606011345982552, + 0.35651472210884094, + 0.8518574088811874, + 0.3449386954307556, + 0.7176872361451387, + 0.3212480992078781, + 1.1134306490421295, + 0.641178160905838, + 0.7475146073848009, + 1.4047644399106503, + 0.18399306666105986, + 2.8634898215532303, + 1.3524872660636902, + 0.32846134528517723, + 0.24303197115659714, + 1.491309743374586, + 2.311086468398571, + 0.21434642001986504, + 0.08886612951755524, + 0.7883054874837399, + 1.7089324295520782, + 0.2859095260500908, + 0.26217832416296005, + 2.9898982401937246, + 1.5664160549640656, + 2.591903269290924, + 0.39430603943765163, + 0.7074936628341675, + 0.8208232596516609, + 1.8013754300773144, + 1.778917983174324, + 0.12127650901675224, + 0.7964467220008373, + 0.027190910652279854, + 1.0988202169537544, + 0.42363395914435387, + 2.3994813822209835, + 0.28865731321275234, + 1.7371631264686584, + 1.5515905730426311, + 1.6395341902971268, + 0.39434940554201603, + 0.5251344051212072 + ], + "unique_experts": 64, + "load_cv": 0.6325212713081574, + "normalized_load_entropy": 0.9508895526268286, + "max_load_share": 0.042443064182194616 + } + }, + "s0_period": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "f31fcf98e50f697e2ff0f5f073902c03ea14c325bbf43aaa83e477f960e98551", + "route_weight_sha256": "5e9d696f219fe9ce98c0fdabfa890596058377ace085ff5285fa42b794aa8a31", + "loads": [ + 6, + 21, + 3, + 25, + 7, + 32, + 20, + 1, + 11, + 7, + 2, + 17, + 8, + 2, + 6, + 22, + 13, + 28, + 11, + 7, + 9, + 17, + 8, + 17, + 6, + 6, + 5, + 1, + 12, + 10, + 13, + 6, + 21, + 10, + 2, + 2, + 19, + 19, + 2, + 2, + 11, + 12, + 7, + 4, + 35, + 23, + 18, + 6, + 3, + 11, + 24, + 14, + 1, + 11, + 0, + 7, + 11, + 23, + 7, + 15, + 11, + 6, + 13, + 11 + ], + "weighted_loads": [ + 0.21948718838393688, + 0.8249903228133917, + 0.11050811968743801, + 1.4633896127343178, + 0.5825086385011673, + 1.3389876428991556, + 1.0732011757791042, + 0.04319983348250389, + 0.4900978170335293, + 0.2781156040728092, + 0.07335324212908745, + 1.2273720502853394, + 0.7618488818407059, + 0.16068058088421822, + 0.2745601758360863, + 0.9431184586137533, + 0.6889791898429394, + 1.4051398057490587, + 0.5179586559534073, + 0.32495881989598274, + 0.3469890095293522, + 1.2516044527292252, + 0.36839069053530693, + 0.8070958126336336, + 0.2840195633471012, + 0.3917195424437523, + 0.250297624617815, + 0.04001937806606293, + 0.7039306350052357, + 0.5430975668132305, + 0.7099308744072914, + 0.2608078196644783, + 2.3805213049054146, + 0.44573308527469635, + 0.18961131945252419, + 0.0816943421959877, + 1.3301322013139725, + 2.3205064050853252, + 0.18356648087501526, + 0.0874486081302166, + 0.6221606805920601, + 0.7545022871345282, + 0.2535051479935646, + 0.17463016510009766, + 2.471588309854269, + 1.2528657652437687, + 2.2270196191966534, + 0.22378277778625488, + 0.10928365588188171, + 0.6286497116088867, + 1.4709546156227589, + 0.9342419654130936, + 0.04903147742152214, + 0.5499538779258728, + 0.0, + 0.4884267821907997, + 0.48542493022978306, + 1.9618214927613735, + 0.285173986107111, + 0.6327486932277679, + 0.7601468451321125, + 0.7055940106511116, + 0.48851531371474266, + 0.5056084543466568 + ], + "unique_experts": 63, + "load_cv": 0.7111111111111111, + "normalized_load_entropy": 0.9385562379739104, + "max_load_share": 0.04861111111111111 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "535f7d37f4ee8d306163805d44ba695acc81b9c44c1c69c7ca97093368b6aa05", + "route_weight_sha256": "263ea70fc274f8505b524a791b8ced64447ba1c141d65b0f1959d71c516ce6f7", + "loads": [ + 7, + 22, + 4, + 25, + 7, + 32, + 20, + 6, + 11, + 8, + 5, + 18, + 10, + 4, + 8, + 22, + 13, + 32, + 16, + 8, + 13, + 19, + 8, + 17, + 6, + 8, + 5, + 7, + 13, + 11, + 17, + 7, + 21, + 18, + 3, + 3, + 19, + 19, + 2, + 2, + 11, + 21, + 10, + 6, + 41, + 27, + 23, + 9, + 3, + 14, + 27, + 20, + 1, + 14, + 0, + 14, + 11, + 30, + 7, + 26, + 17, + 18, + 13, + 11 + ], + "weighted_loads": [ + 0.25170076824724674, + 0.8625316750258207, + 0.1246696449816227, + 1.4633896127343178, + 0.5825086385011673, + 1.3389876428991556, + 1.0732011757791042, + 0.2562973275780678, + 0.4900978170335293, + 0.294357605278492, + 0.20728975534439087, + 1.2755130641162395, + 0.8318100050091743, + 0.6647217534482479, + 0.4424775317311287, + 0.9431184586137533, + 0.6889791898429394, + 1.6594975274056196, + 0.8560341857373714, + 0.38860245421528816, + 0.5146640576422215, + 1.330547109246254, + 0.36839069053530693, + 0.8070958126336336, + 0.2840195633471012, + 0.45536742731928825, + 0.250297624617815, + 0.6140058189630508, + 0.7505658343434334, + 0.5860394425690174, + 1.104604534804821, + 0.27458428870886564, + 2.3805213049054146, + 0.8121072426438332, + 0.21943549811840057, + 0.11856821924448013, + 1.3301322013139725, + 2.3205064050853252, + 0.18356648087501526, + 0.0874486081302166, + 0.6221606805920601, + 1.669053727760911, + 0.35923876613378525, + 0.2713112570345402, + 2.982220608741045, + 1.438958290964365, + 2.4630326330661774, + 0.3528354112058878, + 0.10928365588188171, + 0.7699031308293343, + 1.5969652812927961, + 1.281907670199871, + 0.04903147742152214, + 0.7161760181188583, + 0.0, + 0.9593900367617607, + 0.48542493022978306, + 2.385813619941473, + 0.285173986107111, + 1.3288585841655731, + 1.1269937343895435, + 1.7453798204660416, + 0.48851531371474266, + 0.5056084543466568 + ], + "unique_experts": 63, + "load_cv": 0.6410084207571454, + "normalized_load_entropy": 0.9494791738686877, + "max_load_share": 0.047126436781609195 + } + }, + "s1_period": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "3bbac2a987d005cef5c2b264bfbf9a63ce75c87252c4d7852a060c7aba489406", + "route_weight_sha256": "01bbcf2ca9e844e88d97dc8f5bf8e816ea8333e9c5520b50fcb16d967cf85958", + "loads": [ + 6, + 22, + 1, + 27, + 7, + 32, + 21, + 0, + 9, + 6, + 3, + 18, + 8, + 2, + 6, + 25, + 12, + 30, + 11, + 6, + 10, + 18, + 8, + 19, + 6, + 6, + 5, + 1, + 11, + 11, + 13, + 4, + 21, + 10, + 2, + 2, + 19, + 19, + 2, + 2, + 13, + 9, + 5, + 4, + 36, + 23, + 18, + 5, + 2, + 12, + 24, + 15, + 1, + 13, + 1, + 6, + 9, + 23, + 7, + 16, + 13, + 5, + 9, + 10 + ], + "weighted_loads": [ + 0.20626159757375717, + 0.8738449644297361, + 0.04412861168384552, + 1.5577904488891363, + 0.6012028381228447, + 1.3560064658522606, + 1.11756332218647, + 0.0, + 0.4205161612480879, + 0.2245861403644085, + 0.12108566612005234, + 1.2221319898962975, + 0.7489623352885246, + 0.15550024434924126, + 0.2739723213016987, + 1.0636318735778332, + 0.6339549850672483, + 1.4833221603184938, + 0.48932164162397385, + 0.31635506451129913, + 0.3799634166061878, + 1.2853557094931602, + 0.35725534707307816, + 0.9146781023591757, + 0.28579458594322205, + 0.3839396946132183, + 0.2543153930455446, + 0.0341198705136776, + 0.6722803823649883, + 0.5790542792528868, + 0.7044081427156925, + 0.1727946661412716, + 2.3793101720511913, + 0.45343651808798313, + 0.18625978380441666, + 0.08086387813091278, + 1.4271606504917145, + 2.2333645541220903, + 0.1823531612753868, + 0.0914476104080677, + 0.6976276338100433, + 0.5180120151489973, + 0.16656923294067383, + 0.19308845698833466, + 2.5490508377552032, + 1.2455727308988571, + 2.253802914172411, + 0.18750399351119995, + 0.059904955327510834, + 0.6107664257287979, + 1.4815878495573997, + 0.9730142951011658, + 0.05214652791619301, + 0.6188543997704983, + 0.027792105451226234, + 0.3892454244196415, + 0.4001245051622391, + 1.986361563205719, + 0.28155997209250927, + 0.6607304457575083, + 0.8085708096623421, + 0.6452415511012077, + 0.350500775501132, + 0.48856809735298157 + ], + "unique_experts": 63, + "load_cv": 0.7542472332656506, + "normalized_load_entropy": 0.9315392811296817, + "max_load_share": 0.05 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "11ffdcd29dada6e7e366ced81b02751fb9be997e380f2e301f86d034fdb8d2af", + "route_weight_sha256": "169fe042d824c2e6440081cb2303981f5810b530ddc77ad9873d03c9a32a17ea", + "loads": [ + 8, + 22, + 3, + 28, + 11, + 32, + 21, + 2, + 9, + 7, + 6, + 22, + 12, + 3, + 11, + 25, + 12, + 35, + 15, + 6, + 11, + 20, + 8, + 19, + 7, + 9, + 7, + 19, + 11, + 14, + 24, + 5, + 26, + 27, + 4, + 4, + 21, + 21, + 3, + 2, + 14, + 23, + 7, + 6, + 41, + 29, + 23, + 9, + 10, + 16, + 28, + 29, + 2, + 18, + 1, + 17, + 10, + 31, + 7, + 33, + 24, + 16, + 9, + 11 + ], + "weighted_loads": [ + 0.29424037784338, + 0.8738449644297361, + 0.09869851358234882, + 1.6156614180654287, + 0.8024817258119583, + 1.3560064658522606, + 1.11756332218647, + 0.08513722568750381, + 0.4205161612480879, + 0.24082814157009125, + 0.23537563905119896, + 1.446007113903761, + 0.949818279594183, + 0.62440250441432, + 0.6259732656180859, + 1.0636318735778332, + 0.6339549850672483, + 1.7909185122698545, + 0.8132134824991226, + 0.31635506451129913, + 0.4206957183778286, + 1.371111173182726, + 0.35725534707307816, + 0.9146781023591757, + 0.3276774063706398, + 0.7100901436060667, + 0.32458770647644997, + 1.154060360044241, + 0.6722803823649883, + 0.7117481660097837, + 1.6175256632268429, + 0.18657113518565893, + 2.8715243823826313, + 1.2900738473981619, + 0.32817359641194344, + 0.24330704286694527, + 1.511686161160469, + 2.320971207693219, + 0.2188943736255169, + 0.0914476104080677, + 0.7396753095090389, + 1.7360219862312078, + 0.21238897368311882, + 0.26083988323807716, + 2.969045527279377, + 1.5464386157691479, + 2.533363115042448, + 0.36202271841466427, + 0.7073684595525265, + 0.8244652524590492, + 1.7341099046170712, + 1.8504987880587578, + 0.12158582732081413, + 0.8608006872236729, + 0.027792105451226234, + 1.1172570884227753, + 0.4733679071068764, + 2.5027073323726654, + 0.28155997209250927, + 1.6900452133268118, + 1.5447438769042492, + 1.6026502847671509, + 0.350500775501132, + 0.5243468657135963 + ], + "unique_experts": 64, + "load_cv": 0.6435926952186075, + "normalized_load_entropy": 0.9485184376589352, + "max_load_share": 0.042443064182194616 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 120, + "ordered_topk_exact_tokens": 71, + "set_exact_tokens": 81, + "mean_set_jaccard": 0.9017857142857143, + "mean_token_weighted_tv": 0.01827366465392212, + "aggregate_load_tv": 0.03888888888888888 + }, + "system_bos": { + "tokens": 120, + "ordered_topk_exact_tokens": 70, + "set_exact_tokens": 80, + "mean_set_jaccard": 0.8994047619047619, + "mean_token_weighted_tv": 0.019831444726636012, + "aggregate_load_tv": 0.030555555555555558 + }, + "system_x": { + "tokens": 120, + "ordered_topk_exact_tokens": 55, + "set_exact_tokens": 72, + "mean_set_jaccard": 0.8714285714285716, + "mean_token_weighted_tv": 0.02623437703587115, + "aggregate_load_tv": 0.04027777777777777 + }, + "system_period": { + "tokens": 120, + "ordered_topk_exact_tokens": 59, + "set_exact_tokens": 78, + "mean_set_jaccard": 0.8914682539682541, + "mean_token_weighted_tv": 0.02377464037078122, + "aggregate_load_tv": 0.0375 + }, + "bos_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 59, + "set_exact_tokens": 75, + "mean_set_jaccard": 0.8785714285714287, + "mean_token_weighted_tv": 0.025183640769682825, + "aggregate_load_tv": 0.040277777777777767 + }, + "bos_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 56, + "set_exact_tokens": 71, + "mean_set_jaccard": 0.8676587301587302, + "mean_token_weighted_tv": 0.02762276299763471, + "aggregate_load_tv": 0.034722222222222224 + }, + "x_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 56, + "set_exact_tokens": 73, + "mean_set_jaccard": 0.8738095238095238, + "mean_token_weighted_tv": 0.027410705845492583, + "aggregate_load_tv": 0.04583333333333332 + }, + "x_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 49, + "set_exact_tokens": 60, + "mean_set_jaccard": 0.8361111111111111, + "mean_token_weighted_tv": 0.035051394758435585, + "aggregate_load_tv": 0.05694444444444445 + }, + "period_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 56, + "set_exact_tokens": 72, + "mean_set_jaccard": 0.8678571428571428, + "mean_token_weighted_tv": 0.02807296342216432, + "aggregate_load_tv": 0.04583333333333333 + }, + "period_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 50, + "set_exact_tokens": 65, + "mean_set_jaccard": 0.8501984126984128, + "mean_token_weighted_tv": 0.03260590611025691, + "aggregate_load_tv": 0.052777777777777785 + } + } + }, + "layer_11": { + "layer": 11, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "a949bd59f9d8a7e07485f53d2e5fad2064f778bca4c8c8db19bf3aa1187cc96a", + "route_weight_sha256": "6e0a893efe38784f4b2af09bd8088e0a3a7759515acf7ae67cb5e943d04103a6", + "loads": [ + 6, + 13, + 7, + 4, + 9, + 24, + 2, + 16, + 12, + 14, + 2, + 3, + 17, + 1, + 8, + 4, + 11, + 1, + 7, + 2, + 3, + 1, + 10, + 20, + 9, + 15, + 3, + 13, + 10, + 22, + 15, + 31, + 8, + 13, + 17, + 7, + 12, + 13, + 1, + 7, + 37, + 12, + 8, + 16, + 15, + 15, + 5, + 22, + 10, + 4, + 1, + 3, + 19, + 0, + 0, + 2, + 13, + 21, + 27, + 14, + 29, + 27, + 7, + 20 + ], + "weighted_loads": [ + 0.3586372770369053, + 0.4996839240193367, + 0.3573813382536173, + 0.17110632732510567, + 0.47154393047094345, + 1.7649681270122528, + 0.10725095868110657, + 0.8843828625977039, + 0.6759634241461754, + 0.5820814464241266, + 0.07713515311479568, + 0.10878137685358524, + 0.8095170799642801, + 0.09544326364994049, + 0.3449493534862995, + 0.15755660459399223, + 0.46850474923849106, + 0.0323282890021801, + 0.32800936326384544, + 0.07611711509525776, + 0.1448785588145256, + 0.07436440140008926, + 0.3925178684294224, + 1.8413557820022106, + 0.37733713164925575, + 0.6259745657444, + 0.12392935901880264, + 0.5053174179047346, + 0.8253986984491348, + 1.2812113091349602, + 1.0283641424030066, + 2.027680139988661, + 0.29372335970401764, + 0.58406837657094, + 0.8284409306943417, + 0.4786788448691368, + 0.6891876794397831, + 1.013059824705124, + 0.03986414894461632, + 0.33041856437921524, + 1.7523110006004572, + 0.45999140851199627, + 0.46568910777568817, + 1.173721767961979, + 1.4316395930945873, + 1.2023333087563515, + 0.28431108966469765, + 1.047602340579033, + 0.3724140804260969, + 0.19745266065001488, + 0.042273182421922684, + 0.09161234460771084, + 0.860368087887764, + 0.0, + 0.0, + 0.07983178645372391, + 0.7823885269463062, + 1.2254597544670105, + 1.425720937550068, + 0.6398170161992311, + 1.2159674391150475, + 0.9902032632380724, + 0.33752384781837463, + 1.496788889169693 + ], + "unique_experts": 62, + "load_cv": 0.7470105028431827, + "normalized_load_entropy": 0.9299378521449432, + "max_load_share": 0.05138888888888889 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "55ee78b8189b3133d1247fcae405a4f63cdd332963424ac8a5a7bc71175a66bc", + "route_weight_sha256": "bf5daf458e93557d403be12f15242bd14009fde53f622ebacc6d45db75cc7a86", + "loads": [ + 6, + 14, + 8, + 4, + 14, + 24, + 2, + 16, + 16, + 16, + 5, + 6, + 17, + 1, + 8, + 10, + 15, + 3, + 19, + 2, + 4, + 1, + 11, + 26, + 9, + 16, + 4, + 14, + 17, + 22, + 21, + 38, + 9, + 13, + 21, + 8, + 12, + 13, + 1, + 7, + 46, + 12, + 8, + 38, + 18, + 15, + 5, + 30, + 10, + 6, + 1, + 4, + 19, + 0, + 6, + 4, + 13, + 21, + 30, + 14, + 29, + 32, + 16, + 20 + ], + "weighted_loads": [ + 0.3586372770369053, + 0.5346592217683792, + 0.4158483538776636, + 0.17110632732510567, + 0.7082350105047226, + 1.7649681270122528, + 0.10725095868110657, + 0.8843828625977039, + 0.9045185819268227, + 0.6397307850420475, + 0.14858444221317768, + 0.1626485465094447, + 0.8095170799642801, + 0.09544326364994049, + 0.3449493534862995, + 0.38825199007987976, + 0.9466012939810753, + 0.06221023295074701, + 2.3935395888984203, + 0.07611711509525776, + 0.17391844652593136, + 0.07436440140008926, + 0.3964449162594974, + 2.1215941458940506, + 0.37733713164925575, + 0.6653482057154179, + 0.1272953818552196, + 0.5179086187854409, + 1.312021341174841, + 1.2812113091349602, + 1.322625007480383, + 2.343834411352873, + 0.32988179102540016, + 0.58406837657094, + 1.0058310516178608, + 0.5575854554772377, + 0.6891876794397831, + 1.013059824705124, + 0.03986414894461632, + 0.33041856437921524, + 2.2099478635936975, + 0.45999140851199627, + 0.46568910777568817, + 3.4756079465150833, + 1.5871556401252747, + 1.2023333087563515, + 0.28431108966469765, + 1.6030784994363785, + 0.3724140804260969, + 0.2930527403950691, + 0.042273182421922684, + 0.1225266307592392, + 0.860368087887764, + 0.0, + 0.3153631202876568, + 0.1705813929438591, + 0.7823885269463062, + 1.2254597544670105, + 1.5592151992022991, + 0.6398170161992311, + 1.2159674391150475, + 1.217673433944583, + 0.8472646065056324, + 1.496788889169693 + ], + "unique_experts": 63, + "load_cv": 0.7308718101375545, + "normalized_load_entropy": 0.9360651883513332, + "max_load_share": 0.052873563218390804 + } + }, + "s1_eos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "ee42c55e4493214b16907ea2b96ed5ffc3cf89b4c6d04127946a970d6f9754d0", + "route_weight_sha256": "d55888dc75a7b4c41ae3f0d1ee4254ea44110558b0e222e60f4a354b029f836a", + "loads": [ + 5, + 15, + 6, + 7, + 8, + 23, + 2, + 16, + 12, + 12, + 2, + 4, + 16, + 1, + 8, + 3, + 11, + 2, + 6, + 2, + 1, + 1, + 11, + 20, + 11, + 14, + 4, + 14, + 10, + 23, + 15, + 31, + 9, + 13, + 18, + 7, + 12, + 15, + 2, + 5, + 40, + 12, + 5, + 15, + 15, + 16, + 4, + 21, + 10, + 4, + 1, + 4, + 18, + 0, + 1, + 1, + 13, + 21, + 28, + 13, + 31, + 26, + 4, + 20 + ], + "weighted_loads": [ + 0.3235558159649372, + 0.5788180287927389, + 0.31489307433366776, + 0.2998417690396309, + 0.4166535399854183, + 1.7382163479924202, + 0.10826390981674194, + 0.8637242503464222, + 0.6719288267195225, + 0.5029851421713829, + 0.0733634065836668, + 0.14554655365645885, + 0.7777125909924507, + 0.0940219834446907, + 0.3508598878979683, + 0.11736675351858139, + 0.48656013049185276, + 0.06376681849360466, + 0.3061161506921053, + 0.07504250295460224, + 0.0730389878153801, + 0.07435031235218048, + 0.41766574047505856, + 1.8287579827010632, + 0.4476815350353718, + 0.5902145840227604, + 0.1690102256834507, + 0.5379306729882956, + 0.8132740240544081, + 1.3451601788401604, + 1.0471595637500286, + 1.9947892911732197, + 0.34386463835835457, + 0.5845476947724819, + 0.870060171931982, + 0.4488009065389633, + 0.7134096622467041, + 1.350391898304224, + 0.07275083288550377, + 0.24174369126558304, + 1.8887683246284723, + 0.47289760410785675, + 0.27873048186302185, + 1.1181240528821945, + 1.419796109199524, + 1.2211595978587866, + 0.2434380203485489, + 0.9868424721062183, + 0.35568381659686565, + 0.1977267526090145, + 0.04236311838030815, + 0.1214886475354433, + 0.8196778930723667, + 0.0, + 0.03185733035206795, + 0.051079005002975464, + 0.7709413729608059, + 1.2214968316257, + 1.4465479739010334, + 0.5986692812293768, + 1.317174669355154, + 0.9453202839940786, + 0.1726897731423378, + 1.4804769791662693 + ], + "unique_experts": 63, + "load_cv": 0.7686769136190212, + "normalized_load_entropy": 0.927932967256202, + "max_load_share": 0.05555555555555555 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "c6172adb1c9219244e059b1bde3b647467238d0669a8cd2bc78e8fcfc5f50c31", + "route_weight_sha256": "bb76dbef52446058ae60f4d780c86edcfd99c6b586baf99daceaa97e3bf961e5", + "loads": [ + 7, + 16, + 7, + 7, + 20, + 27, + 2, + 18, + 22, + 12, + 6, + 7, + 16, + 1, + 8, + 4, + 28, + 4, + 17, + 3, + 2, + 2, + 14, + 25, + 11, + 15, + 7, + 16, + 22, + 23, + 23, + 37, + 10, + 13, + 23, + 10, + 12, + 15, + 2, + 6, + 49, + 12, + 5, + 42, + 17, + 16, + 5, + 34, + 10, + 7, + 1, + 4, + 18, + 5, + 24, + 8, + 19, + 22, + 30, + 17, + 31, + 34, + 15, + 21 + ], + "weighted_loads": [ + 0.47125810012221336, + 0.612270874902606, + 0.36230291798710823, + 0.2998417690396309, + 1.0271864868700504, + 1.8764856047928333, + 0.10826390981674194, + 0.9924764446914196, + 1.2514046616852283, + 0.5029851421713829, + 0.1875442424789071, + 0.1987175540998578, + 0.7777125909924507, + 0.0940219834446907, + 0.3508598878979683, + 0.15701625123620033, + 2.0779098961502314, + 0.09279062319546938, + 2.3615328278392553, + 0.11406147666275501, + 0.14680620282888412, + 0.14477288722991943, + 0.5302969871554524, + 2.046781685203314, + 0.4476815350353718, + 0.6300204284489155, + 0.24727301206439734, + 0.5883786315098405, + 1.656489884480834, + 1.3451601788401604, + 1.459684168919921, + 2.2566067539155483, + 0.3756387531757355, + 0.5845476947724819, + 1.1040614731609821, + 0.7418894395232201, + 0.7134096622467041, + 1.350391898304224, + 0.07275083288550377, + 0.288410983979702, + 2.3153672609478235, + 0.47289760410785675, + 0.27873048186302185, + 3.723897859454155, + 1.5436473824083805, + 1.2211595978587866, + 0.28998681902885437, + 1.944310013204813, + 0.35568381659686565, + 0.41789326444268227, + 0.04236311838030815, + 0.1214886475354433, + 0.8196778930723667, + 0.3039204850792885, + 1.3543490283191204, + 0.384005893021822, + 1.2419142313301563, + 1.2647408321499825, + 1.5483240187168121, + 0.7532054167240858, + 1.317174669355154, + 1.2956907600164413, + 0.7190182209014893, + 1.5233803428709507 + ], + "unique_experts": 64, + "load_cv": 0.7006347002486538, + "normalized_load_entropy": 0.9412730544867804, + "max_load_share": 0.050724637681159424 + } + }, + "s0_bos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "4d3acfcff58123913b0b63ebf820b6a86d43d4b1d9c61d50f21dd861794f0587", + "route_weight_sha256": "b474005dc3de5f81be8a271d28b3adfc4423edde118ea685bdb472418ab6bcd4", + "loads": [ + 6, + 13, + 7, + 2, + 8, + 24, + 3, + 16, + 12, + 12, + 2, + 3, + 15, + 2, + 8, + 5, + 11, + 1, + 7, + 2, + 3, + 1, + 11, + 20, + 11, + 12, + 3, + 14, + 11, + 24, + 16, + 31, + 10, + 14, + 17, + 6, + 12, + 16, + 2, + 5, + 39, + 14, + 7, + 17, + 15, + 15, + 4, + 21, + 9, + 3, + 1, + 5, + 16, + 0, + 1, + 0, + 12, + 19, + 27, + 15, + 28, + 24, + 7, + 23 + ], + "weighted_loads": [ + 0.3632477931678295, + 0.4777992460876703, + 0.3558160401880741, + 0.08790310844779015, + 0.40055980905890465, + 1.7764634564518929, + 0.15063805505633354, + 0.8842652812600136, + 0.6769511513411999, + 0.4769461303949356, + 0.07655815593898296, + 0.10881047323346138, + 0.7472729906439781, + 0.12377336248755455, + 0.3415180370211601, + 0.2048569805920124, + 0.48761814646422863, + 0.033909864723682404, + 0.32201828621327877, + 0.0751225147396326, + 0.14764248579740524, + 0.08224799484014511, + 0.4373130686581135, + 1.838558305054903, + 0.46242502331733704, + 0.5269375070929527, + 0.11855148896574974, + 0.5384620763361454, + 0.8617298733443022, + 1.3622639775276184, + 1.07789252884686, + 2.060599695891142, + 0.37540738843381405, + 0.6191999614238739, + 0.82543402351439, + 0.4611406549811363, + 0.7310568541288376, + 1.2084240689873695, + 0.07735320180654526, + 0.2504602260887623, + 1.850814489647746, + 0.5479212999343872, + 0.3790101893246174, + 1.22039457783103, + 1.439339704811573, + 1.2641074303537607, + 0.2291431427001953, + 0.9933238178491592, + 0.33505175821483135, + 0.16591964289546013, + 0.04495789483189583, + 0.14806845597922802, + 0.7725310139358044, + 0.0, + 0.04167691245675087, + 0.0, + 0.7571349292993546, + 1.1506566479802132, + 1.4221995640546083, + 0.686920253559947, + 1.1666120197623968, + 0.895701115950942, + 0.31974578090012074, + 1.6121084466576576 + ], + "unique_experts": 62, + "load_cv": 0.7498147919467995, + "normalized_load_entropy": 0.9299065953389165, + "max_load_share": 0.05416666666666667 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "8caba457d05e02b98d742abc90af0415f470ddc9f639c60e74dd81f596c31845", + "route_weight_sha256": "c216619c78f8ab2ff017ef426285dacb805fd836cff3af2fe70ccfb49c0cbcf8", + "loads": [ + 6, + 14, + 8, + 2, + 13, + 24, + 3, + 16, + 16, + 14, + 4, + 5, + 15, + 2, + 8, + 13, + 16, + 2, + 18, + 2, + 3, + 1, + 11, + 26, + 11, + 12, + 3, + 16, + 16, + 24, + 22, + 39, + 11, + 14, + 21, + 7, + 12, + 16, + 2, + 5, + 49, + 14, + 7, + 40, + 18, + 15, + 4, + 29, + 9, + 5, + 1, + 7, + 16, + 0, + 6, + 2, + 12, + 19, + 30, + 15, + 29, + 31, + 16, + 23 + ], + "weighted_loads": [ + 0.3632477931678295, + 0.5127745438367128, + 0.41428305581212044, + 0.08790310844779015, + 0.6259066872298717, + 1.7764634564518929, + 0.15063805505633354, + 0.8842652812600136, + 0.903082799166441, + 0.5345954690128565, + 0.142896031960845, + 0.15060594957321882, + 0.7472729906439781, + 0.12377336248755455, + 0.3415180370211601, + 0.5082447342574596, + 1.0384961795061827, + 0.04875359311699867, + 1.4915550407022238, + 0.0751225147396326, + 0.14764248579740524, + 0.08224799484014511, + 0.4373130686581135, + 2.118796668946743, + 0.46242502331733704, + 0.5269375070929527, + 0.11855148896574974, + 0.5968010379001498, + 1.2777644339948893, + 1.3622639775276184, + 1.3721533939242363, + 2.479594562202692, + 0.41156581975519657, + 0.6191999614238739, + 0.9997264612466097, + 0.5400472655892372, + 0.7310568541288376, + 1.2084240689873695, + 0.07735320180654526, + 0.2504602260887623, + 2.3800682928413153, + 0.5479212999343872, + 0.3790101893246174, + 3.6301495730876923, + 1.5948557518422604, + 1.2641074303537607, + 0.2291431427001953, + 1.5600174888968468, + 0.33505175821483135, + 0.2615197226405144, + 0.04495789483189583, + 0.21903911046683788, + 0.7725310139358044, + 0.0, + 0.33021071180701256, + 0.08594973757863045, + 0.7571349292993546, + 1.1506566479802132, + 1.5556938257068396, + 0.686920253559947, + 1.2055215369910002, + 1.2057077754288912, + 0.852736784145236, + 1.6121084466576576 + ], + "unique_experts": 63, + "load_cv": 0.7558954882563703, + "normalized_load_entropy": 0.9324145894988022, + "max_load_share": 0.05632183908045977 + } + }, + "s1_bos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "62d26052a8ac833198492b481660226b9642a5cc68fab21d13f2fc08d69759d3", + "route_weight_sha256": "31b980324cce7a81d36ca198b25fe48aff5c06c642e5db351f1a3adad98a8a1d", + "loads": [ + 5, + 13, + 6, + 3, + 7, + 24, + 4, + 15, + 12, + 11, + 2, + 4, + 16, + 2, + 8, + 5, + 10, + 1, + 6, + 2, + 2, + 1, + 10, + 20, + 10, + 12, + 3, + 14, + 10, + 24, + 15, + 31, + 10, + 14, + 19, + 7, + 12, + 16, + 3, + 5, + 42, + 16, + 6, + 18, + 15, + 16, + 4, + 22, + 7, + 4, + 1, + 5, + 16, + 0, + 2, + 0, + 13, + 19, + 27, + 15, + 30, + 23, + 1, + 24 + ], + "weighted_loads": [ + 0.3282773718237877, + 0.5194548685103655, + 0.31111765652894974, + 0.11879238486289978, + 0.3717804066836834, + 1.8127010948956013, + 0.19480721279978752, + 0.8388253450393677, + 0.6729234866797924, + 0.43513335660099983, + 0.07375214621424675, + 0.14353447407484055, + 0.7664106320589781, + 0.12184221111238003, + 0.3458956107497215, + 0.20330804586410522, + 0.4328889660537243, + 0.03461233153939247, + 0.3000340834259987, + 0.07935757376253605, + 0.11459024995565414, + 0.0828251913189888, + 0.398847421631217, + 1.8417947702109814, + 0.4064897485077381, + 0.5343018583953381, + 0.12344889715313911, + 0.535437935963273, + 0.8360295668244362, + 1.3773728758096695, + 1.052494041621685, + 2.036769237369299, + 0.37588960863649845, + 0.6051634829491377, + 0.9010236021131277, + 0.47063228860497475, + 0.7421167939901352, + 1.4663032814860344, + 0.11122914403676987, + 0.24986744299530983, + 1.9845446553081274, + 0.6305814199149609, + 0.3040861673653126, + 1.2717865463346243, + 1.4413571655750275, + 1.257092049345374, + 0.2455809786915779, + 1.0215762332081795, + 0.259286155924201, + 0.21111402288079262, + 0.0433640219271183, + 0.14989698491990566, + 0.7629966773092747, + 0.0, + 0.06618522852659225, + 0.0, + 0.7784412391483784, + 1.1434111632406712, + 1.4225824195891619, + 0.6467227600514889, + 1.2627786304801702, + 0.8522793482989073, + 0.044679563492536545, + 1.6457432582974434 + ], + "unique_experts": 62, + "load_cv": 0.7807878262560384, + "normalized_load_entropy": 0.9260824865473645, + "max_load_share": 0.058333333333333334 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "f2fd903e67851de18c03c9458d5625dd5f638b38729546e61a62b774485907e0", + "route_weight_sha256": "e5a0d5928f7e568c5ea4bc9dc75b0efa57a4504b4d90f0e92fb51b3a2ac0f96a", + "loads": [ + 7, + 14, + 7, + 3, + 18, + 28, + 4, + 17, + 22, + 12, + 5, + 6, + 16, + 2, + 8, + 7, + 27, + 2, + 16, + 3, + 3, + 2, + 12, + 25, + 10, + 13, + 5, + 16, + 21, + 24, + 23, + 37, + 11, + 14, + 23, + 11, + 12, + 16, + 3, + 6, + 50, + 16, + 6, + 46, + 17, + 16, + 5, + 36, + 7, + 7, + 1, + 6, + 16, + 5, + 25, + 7, + 19, + 20, + 29, + 19, + 31, + 33, + 13, + 25 + ], + "weighted_loads": [ + 0.47597965598106384, + 0.5529077146202326, + 0.3585275001823902, + 0.11879238486289978, + 0.9522750340402126, + 1.9509703516960144, + 0.19480721279978752, + 0.9675775393843651, + 1.2519843615591526, + 0.46869559586048126, + 0.18276939168572426, + 0.1853047562763095, + 0.7664106320589781, + 0.12184221111238003, + 0.3458956107497215, + 0.2745693363249302, + 2.06375689804554, + 0.04945605993270874, + 1.4573985449969769, + 0.11837654747068882, + 0.18835746496915817, + 0.15324776619672775, + 0.5076923836022615, + 2.059818472713232, + 0.4064897485077381, + 0.5752976350486279, + 0.1985471434891224, + 0.585885894484818, + 1.63521533831954, + 1.3773728758096695, + 1.4650186467915773, + 2.2985867001116276, + 0.40766372345387936, + 0.6051634829491377, + 1.098076531663537, + 0.7935929037630558, + 0.7421167939901352, + 1.4663032814860344, + 0.11122914403676987, + 0.2965347357094288, + 2.4266438987106085, + 0.6305814199149609, + 0.3040861673653126, + 4.192774711176753, + 1.565208438783884, + 1.257092049345374, + 0.2921297773718834, + 2.0106141418218613, + 0.259286155924201, + 0.4312805347144604, + 0.0433640219271183, + 0.1815450619906187, + 0.7629966773092747, + 0.3039204850792885, + 1.3965189531445503, + 0.3329268880188465, + 1.2494140975177288, + 1.1866551637649536, + 1.5243584644049406, + 0.8012588955461979, + 1.3042792100459337, + 1.295248880982399, + 0.6419581770896912, + 1.6886466220021248 + ], + "unique_experts": 64, + "load_cv": 0.7184205344589081, + "normalized_load_entropy": 0.9400313784736896, + "max_load_share": 0.051759834368530024 + } + }, + "s0_x": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "b21401ce99a2a3c027c1464ec973f21e1930351e73af5c4683f2b15abb6dee3d", + "route_weight_sha256": "6b66b6cf22a164781b98ef0a775e1a6897edfdc0edb84a81f702f554d2eece82", + "loads": [ + 6, + 10, + 7, + 0, + 8, + 24, + 5, + 15, + 15, + 11, + 3, + 3, + 18, + 2, + 9, + 7, + 10, + 1, + 8, + 2, + 2, + 1, + 11, + 21, + 10, + 15, + 3, + 12, + 11, + 24, + 16, + 31, + 7, + 12, + 17, + 8, + 12, + 15, + 3, + 7, + 34, + 13, + 7, + 16, + 15, + 19, + 4, + 20, + 10, + 4, + 1, + 6, + 15, + 0, + 1, + 2, + 14, + 19, + 27, + 10, + 29, + 20, + 7, + 25 + ], + "weighted_loads": [ + 0.37456169724464417, + 0.3707612957805395, + 0.3546139486134052, + 0.0, + 0.4036668185144663, + 1.81071325391531, + 0.23967844247817993, + 0.9083236344158649, + 0.7896219305694103, + 0.4453765582293272, + 0.11153789050877094, + 0.10917726345360279, + 0.8558082263916731, + 0.12375971302390099, + 0.3753282558172941, + 0.27365637943148613, + 0.45001217536628246, + 0.0363173745572567, + 0.35650962963700294, + 0.07463207840919495, + 0.12087045609951019, + 0.08149860799312592, + 0.43626586347818375, + 1.897761382162571, + 0.42869702726602554, + 0.648319760337472, + 0.11911261454224586, + 0.47612663358449936, + 0.8740498032420874, + 1.2919242084026337, + 1.0729821305721998, + 2.0927920006215572, + 0.25494300574064255, + 0.5416140407323837, + 0.8236779980361462, + 0.5560333728790283, + 0.7234227918088436, + 1.1375819966197014, + 0.11378411576151848, + 0.3326742388308048, + 1.5682805217802525, + 0.510152343660593, + 0.3758144937455654, + 1.153348794206977, + 1.4776695109903812, + 1.4101837929338217, + 0.24819263815879822, + 0.9789852574467659, + 0.36697496101260185, + 0.18966905400156975, + 0.043678656220436096, + 0.17627937905490398, + 0.7315150126814842, + 0.0, + 0.04617062211036682, + 0.06900745630264282, + 0.8335550054907799, + 1.1331900283694267, + 1.4308900870382786, + 0.48422159627079964, + 1.2122811563313007, + 0.7506674136966467, + 0.3231082893908024, + 1.7347103506326675 + ], + "unique_experts": 62, + "load_cv": 0.7212814385385546, + "normalized_load_entropy": 0.934404566703456, + "max_load_share": 0.04722222222222222 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "cdc1ef9621b6e5fd95a22465844fbf990dc10fdacb1386fa2e6780eecbf68a65", + "route_weight_sha256": "e887f6da41bef5592757ede5513260522d79eaac45e153f1eb0324aca36fc2fd", + "loads": [ + 6, + 11, + 8, + 0, + 13, + 24, + 5, + 15, + 19, + 13, + 5, + 5, + 18, + 2, + 9, + 13, + 14, + 3, + 20, + 2, + 2, + 1, + 11, + 27, + 10, + 15, + 3, + 13, + 18, + 24, + 22, + 40, + 8, + 12, + 22, + 10, + 12, + 15, + 3, + 7, + 41, + 13, + 7, + 38, + 18, + 19, + 4, + 28, + 10, + 8, + 1, + 7, + 15, + 1, + 7, + 3, + 14, + 19, + 31, + 10, + 30, + 25, + 16, + 25 + ], + "weighted_loads": [ + 0.37456169724464417, + 0.405736593529582, + 0.41308096423745155, + 0.0, + 0.6377024259418249, + 1.81071325391531, + 0.23967844247817993, + 0.9083236344158649, + 1.0156958475708961, + 0.5030258968472481, + 0.17787576653063297, + 0.15097273979336023, + 0.8558082263916731, + 0.12375971302390099, + 0.3753282558172941, + 0.5043517649173737, + 0.9016846846789122, + 0.08639486134052277, + 1.617929469794035, + 0.07463207840919495, + 0.12087045609951019, + 0.08149860799312592, + 0.43626586347818375, + 2.177999746054411, + 0.42869702726602554, + 0.648319760337472, + 0.11911261454224586, + 0.48871783446520567, + 1.3942340184003115, + 1.2919242084026337, + 1.3672429956495762, + 2.570434130728245, + 0.29110143706202507, + 0.5416140407323837, + 1.1086696162819862, + 0.6677940934896469, + 0.7234227918088436, + 1.1375819966197014, + 0.11378411576151848, + 0.3326742388308048, + 1.9039760529994965, + 0.510152343660593, + 0.3758144937455654, + 3.2716945987194777, + 1.6331855580210686, + 1.4101837929338217, + 0.24819263815879822, + 1.5587039180099964, + 0.36697496101260185, + 0.37542539462447166, + 0.043678656220436096, + 0.2114537227898836, + 0.7315150126814842, + 0.05517248436808586, + 0.3573870249092579, + 0.11254801973700523, + 0.8335550054907799, + 1.1331900283694267, + 1.6251091100275517, + 0.48422159627079964, + 1.2562364377081394, + 0.9905721116811037, + 0.8095434121787548, + 1.7347103506326675 + ], + "unique_experts": 63, + "load_cv": 0.716264439292025, + "normalized_load_entropy": 0.9376260562586437, + "max_load_share": 0.047126436781609195 + } + }, + "s1_x": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "2a81eaeeee7f3d5b5335441e59d1c9b5176c631f5f377263bac8aec0ab59c0a1", + "route_weight_sha256": "1fd6aecc8e7aacc2e6b0770a9c31d7b165ea95d2df50bdd12e4f823af21ef3b6", + "loads": [ + 6, + 13, + 4, + 3, + 9, + 24, + 4, + 15, + 15, + 14, + 4, + 4, + 17, + 2, + 8, + 6, + 11, + 1, + 8, + 2, + 2, + 1, + 10, + 22, + 11, + 14, + 4, + 13, + 11, + 24, + 15, + 31, + 8, + 12, + 16, + 8, + 12, + 15, + 4, + 5, + 35, + 9, + 4, + 16, + 16, + 18, + 4, + 21, + 8, + 4, + 1, + 6, + 17, + 0, + 1, + 0, + 13, + 18, + 27, + 15, + 26, + 23, + 3, + 27 + ], + "weighted_loads": [ + 0.3630104549229145, + 0.506224887445569, + 0.2514908201992512, + 0.11428124830126762, + 0.42226587422192097, + 1.8757333420217037, + 0.1962573006749153, + 0.8799289241433144, + 0.8136335350573063, + 0.5375815220177174, + 0.13460449129343033, + 0.14616872742772102, + 0.8409204035997391, + 0.12018951401114464, + 0.35460544377565384, + 0.24607070535421371, + 0.463420070707798, + 0.03509019315242767, + 0.36607344448566437, + 0.08190161362290382, + 0.11246321722865105, + 0.07835856825113297, + 0.38340376131236553, + 1.9392408914864063, + 0.47091384045779705, + 0.6229319199919701, + 0.16554275527596474, + 0.509089982137084, + 0.8121146019548178, + 1.3617579098790884, + 1.0623727776110172, + 2.0788246989250183, + 0.2987610660493374, + 0.532980065792799, + 0.7976205907762051, + 0.5089700780808926, + 0.7288399413228035, + 1.4162256494164467, + 0.15222061052918434, + 0.25175491720438004, + 1.6367094740271568, + 0.34792137518525124, + 0.20202410966157913, + 1.03504728525877, + 1.4790073558688164, + 1.3230470195412636, + 0.24634376540780067, + 1.057444240897894, + 0.29456084966659546, + 0.2080557979643345, + 0.04428902640938759, + 0.17722032219171524, + 0.7997509986162186, + 0.0, + 0.040598683059215546, + 0.0, + 0.7721777260303497, + 1.1113799065351486, + 1.4181877244263887, + 0.6677068639546633, + 1.1401347145438194, + 0.8270064424723387, + 0.13462721183896065, + 1.7725486066192389 + ], + "unique_experts": 62, + "load_cv": 0.7360220071857421, + "normalized_load_entropy": 0.9320439029612025, + "max_load_share": 0.04861111111111111 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "40ed98e10092932f926426119f586fb29eb67df95f45a0f4c9b5f3e8f404c363", + "route_weight_sha256": "6c9a6e9cccebebfa07d086623a8781a6d4c2d57f5aef6d902d206e23b6766329", + "loads": [ + 8, + 14, + 5, + 3, + 20, + 28, + 4, + 17, + 25, + 14, + 7, + 6, + 17, + 2, + 8, + 7, + 29, + 2, + 19, + 3, + 3, + 2, + 12, + 27, + 11, + 15, + 6, + 16, + 23, + 24, + 23, + 38, + 9, + 12, + 21, + 11, + 12, + 15, + 4, + 6, + 40, + 9, + 4, + 43, + 18, + 18, + 5, + 34, + 8, + 8, + 1, + 6, + 17, + 6, + 25, + 8, + 19, + 19, + 30, + 19, + 27, + 31, + 14, + 29 + ], + "weighted_loads": [ + 0.5107127390801907, + 0.5396777335554361, + 0.29890066385269165, + 0.11428124830126762, + 1.0027605015784502, + 2.014002598822117, + 0.1962573006749153, + 1.0086811184883118, + 1.3916617818176746, + 0.5375815220177174, + 0.24362173676490784, + 0.18793900962918997, + 0.8409204035997391, + 0.12018951401114464, + 0.35460544377565384, + 0.28572020307183266, + 2.056522663682699, + 0.04993392154574394, + 1.60127330198884, + 0.1209205873310566, + 0.18623043224215508, + 0.14878114312887192, + 0.4922487232834101, + 2.157264593988657, + 0.47091384045779705, + 0.6679069511592388, + 0.240641001611948, + 0.603605848737061, + 1.714181175455451, + 1.3617579098790884, + 1.4748973827809095, + 2.3899232745170593, + 0.3305351808667183, + 0.532980065792799, + 1.0654697120189667, + 0.8020586110651493, + 0.7288399413228035, + 1.4162256494164467, + 0.15222061052918434, + 0.298422209918499, + 1.8679153621196747, + 0.34792137518525124, + 0.20202410966157913, + 3.420689694583416, + 1.602858629077673, + 1.3230470195412636, + 0.29289256408810616, + 1.999940611422062, + 0.29456084966659546, + 0.47753096371889114, + 0.04428902640938759, + 0.17722032219171524, + 0.7997509986162186, + 0.3540714420378208, + 1.4062437545508146, + 0.3804982006549835, + 1.2431505843997002, + 1.154623907059431, + 1.5672331992536783, + 0.8222429994493723, + 1.180968914180994, + 1.196612410247326, + 0.7062494195997715, + 1.8513157907873392 + ], + "unique_experts": 64, + "load_cv": 0.6830886358939674, + "normalized_load_entropy": 0.9434314759440342, + "max_load_share": 0.044513457556935816 + } + }, + "s0_period": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "15bfb2528e0ad9d395460ebe05d1bc6f88113f00ed5f50d94bafd098b2a89ae1", + "route_weight_sha256": "ba4d65601b7d8ec6a0df8449cb57e93be9ebd28b04aa64ebce8bcd5462c690e6", + "loads": [ + 6, + 11, + 6, + 0, + 9, + 25, + 5, + 16, + 15, + 12, + 2, + 4, + 16, + 2, + 9, + 6, + 10, + 1, + 7, + 2, + 3, + 1, + 11, + 21, + 9, + 15, + 3, + 13, + 12, + 24, + 17, + 31, + 7, + 12, + 18, + 9, + 12, + 15, + 3, + 6, + 34, + 13, + 8, + 16, + 15, + 17, + 3, + 20, + 10, + 4, + 1, + 5, + 15, + 0, + 0, + 2, + 14, + 19, + 27, + 11, + 29, + 20, + 6, + 25 + ], + "weighted_loads": [ + 0.3760494031012058, + 0.41968410089612007, + 0.3300415277481079, + 0.0, + 0.4470357056707144, + 1.850026998668909, + 0.23836402595043182, + 0.9515318460762501, + 0.7905460819602013, + 0.46524957939982414, + 0.08273513987660408, + 0.14284681528806686, + 0.8077040668576956, + 0.12636267952620983, + 0.38254549726843834, + 0.24139348790049553, + 0.4603811800479889, + 0.03627168759703636, + 0.3310761135071516, + 0.07573200762271881, + 0.14874724298715591, + 0.08191703259944916, + 0.4263991601765156, + 1.905282448977232, + 0.3879614360630512, + 0.6590859889984131, + 0.1188390664756298, + 0.4953998699784279, + 0.9267255254089832, + 1.3384764268994331, + 1.1097678896039724, + 2.0687475875020027, + 0.2695943955332041, + 0.5504101328551769, + 0.8490681182593107, + 0.5894563272595406, + 0.7264974005520344, + 1.1292935349047184, + 0.11378725990653038, + 0.2927265390753746, + 1.548407819122076, + 0.5025849938392639, + 0.41474251076579094, + 1.1696949638426304, + 1.4683186151087284, + 1.3626747746020555, + 0.2080201469361782, + 0.9983934797346592, + 0.36515085957944393, + 0.18938118033111095, + 0.04486566409468651, + 0.15144573152065277, + 0.7308412864804268, + 0.0, + 0.0, + 0.0685972049832344, + 0.8512643203139305, + 1.1454750411212444, + 1.4417407885193825, + 0.5137387625873089, + 1.214898806065321, + 0.742757199332118, + 0.2771154157817364, + 1.7449471652507782 + ], + "unique_experts": 61, + "load_cv": 0.7274172134814626, + "normalized_load_entropy": 0.9323632200494342, + "max_load_share": 0.04722222222222222 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "b609329f8daab41fe2a63a9784ee85b7f3420fc3be8a12b03b940c6f47681765", + "route_weight_sha256": "b73eb6c6cc2a88dd530a17b89c61fefb358544bd46f7e2d64b07d24a2c581a4d", + "loads": [ + 6, + 12, + 7, + 0, + 15, + 25, + 5, + 16, + 19, + 14, + 4, + 6, + 16, + 2, + 9, + 13, + 15, + 2, + 19, + 2, + 3, + 1, + 11, + 27, + 9, + 15, + 3, + 14, + 20, + 24, + 23, + 40, + 8, + 12, + 22, + 12, + 12, + 15, + 3, + 6, + 41, + 13, + 8, + 39, + 18, + 17, + 3, + 28, + 10, + 7, + 1, + 6, + 15, + 0, + 6, + 4, + 14, + 19, + 30, + 11, + 30, + 25, + 13, + 25 + ], + "weighted_loads": [ + 0.3760494031012058, + 0.4546593986451626, + 0.38850854337215424, + 0.0, + 0.7576163113117218, + 1.850026998668909, + 0.23836402595043182, + 0.9515318460762501, + 1.0189109295606613, + 0.522898918017745, + 0.1490730158984661, + 0.1846422916278243, + 0.8077040668576956, + 0.12636267952620983, + 0.38254549726843834, + 0.5123425424098969, + 0.9537999592721462, + 0.05111541599035263, + 1.5429206099361181, + 0.07573200762271881, + 0.14874724298715591, + 0.08191703259944916, + 0.4263991601765156, + 2.185520812869072, + 0.3879614360630512, + 0.6590859889984131, + 0.1188390664756298, + 0.5079910708591342, + 1.4848448112607002, + 1.3384764268994331, + 1.4040287546813488, + 2.551110666245222, + 0.3057528268545866, + 0.5504101328551769, + 1.0459211226552725, + 0.8545107692480087, + 0.7264974005520344, + 1.1292935349047184, + 0.11378725990653038, + 0.2927265390753746, + 1.8873827494680882, + 0.5025849938392639, + 0.41474251076579094, + 3.3816590942442417, + 1.6238346621394157, + 1.3626747746020555, + 0.2080201469361782, + 1.5743501372635365, + 0.36515085957944393, + 0.33471050672233105, + 0.04486566409468651, + 0.18720969185233116, + 0.7308412864804268, + 0.0, + 0.3033130783587694, + 0.15079399570822716, + 0.8512643203139305, + 1.1454750411212444, + 1.5752350501716137, + 0.5137387625873089, + 1.2578973211348057, + 0.987368481233716, + 0.6911590024828911, + 1.7449471652507782 + ], + "unique_experts": 62, + "load_cv": 0.7224940289571368, + "normalized_load_entropy": 0.9357448870744906, + "max_load_share": 0.047126436781609195 + } + }, + "s1_period": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "db9e4eaea4ab93d90f742af15c0cebe4460552ae04d596886348deeeeda011df", + "route_weight_sha256": "8af5b8f30de5c9ab6b8d1f78ca9b662f4f7b4b26160264213ba24e41455b8dff", + "loads": [ + 6, + 14, + 6, + 2, + 8, + 24, + 4, + 15, + 15, + 12, + 3, + 4, + 17, + 2, + 9, + 5, + 9, + 1, + 7, + 2, + 2, + 1, + 10, + 21, + 13, + 15, + 4, + 12, + 12, + 24, + 15, + 31, + 8, + 12, + 16, + 8, + 12, + 15, + 4, + 5, + 38, + 11, + 4, + 17, + 15, + 17, + 4, + 22, + 8, + 4, + 1, + 5, + 17, + 0, + 1, + 1, + 13, + 18, + 27, + 13, + 32, + 17, + 3, + 27 + ], + "weighted_loads": [ + 0.3654249869287014, + 0.5488016027957201, + 0.3049914389848709, + 0.08248529210686684, + 0.38705536909401417, + 1.8907965570688248, + 0.19251513481140137, + 0.8956893160939217, + 0.7915269900113344, + 0.46020601131021976, + 0.10730326361954212, + 0.14793587662279606, + 0.8221000079065561, + 0.12071493268013, + 0.38196428306400776, + 0.20447863265872002, + 0.39680764079093933, + 0.031656987965106964, + 0.32828568667173386, + 0.08063609525561333, + 0.11223671212792397, + 0.07933102548122406, + 0.38155848905444145, + 1.9029913134872913, + 0.5187735296785831, + 0.6542327962815762, + 0.16648906469345093, + 0.4878883473575115, + 0.8873880133032799, + 1.3699971623718739, + 1.0510838739573956, + 2.0443406384438276, + 0.2945585176348686, + 0.5398852601647377, + 0.8076116517186165, + 0.5109512694180012, + 0.7239016145467758, + 1.4386932328343391, + 0.15445950999855995, + 0.25199441984295845, + 1.718769259750843, + 0.4305257350206375, + 0.20194363966584206, + 1.080637365579605, + 1.458429604768753, + 1.3228941094130278, + 0.24360327795147896, + 1.0671643316745758, + 0.2946328464895487, + 0.20574335008859634, + 0.04568503797054291, + 0.15197695046663284, + 0.8035068064928055, + 0.0, + 0.043306440114974976, + 0.05242734029889107, + 0.7874566316604614, + 1.1226214207708836, + 1.4264109637588263, + 0.5878928191959858, + 1.3577085509896278, + 0.5969090666621923, + 0.1324959173798561, + 1.7874161079525948 + ], + "unique_experts": 63, + "load_cv": 0.7575138021804138, + "normalized_load_entropy": 0.9305028214855494, + "max_load_share": 0.05277777777777778 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "b7d3cac54115ce9f35a79571e8afca9789c8968b83516414e070e44ece6703bc", + "route_weight_sha256": "57545ef19ae959fdf5fe35611ce678e3a490c793dd433ec9f11df73b6a519c1a", + "loads": [ + 8, + 15, + 7, + 2, + 20, + 30, + 4, + 17, + 25, + 12, + 6, + 6, + 17, + 2, + 10, + 7, + 26, + 2, + 17, + 3, + 3, + 2, + 12, + 26, + 13, + 16, + 6, + 14, + 25, + 24, + 23, + 37, + 9, + 12, + 21, + 13, + 12, + 15, + 4, + 6, + 42, + 11, + 4, + 44, + 17, + 17, + 5, + 35, + 8, + 8, + 1, + 6, + 17, + 5, + 24, + 8, + 19, + 19, + 29, + 17, + 33, + 25, + 14, + 29 + ], + "weighted_loads": [ + 0.5131272710859776, + 0.5822544489055872, + 0.3524012826383114, + 0.08248529210686684, + 1.0379277113825083, + 2.1018582340329885, + 0.19251513481140137, + 1.024441510438919, + 1.3703597132116556, + 0.46020601131021976, + 0.21632050909101963, + 0.189706158824265, + 0.8221000079065561, + 0.12071493268013, + 0.420678598806262, + 0.27783680334687233, + 1.9769108444452286, + 0.04650071635842323, + 1.485650148242712, + 0.1196550689637661, + 0.186003927141428, + 0.149753600358963, + 0.490403451025486, + 2.121015015989542, + 0.5187735296785831, + 0.6994500197470188, + 0.2415873110294342, + 0.5383363058790565, + 1.8630822971463203, + 1.3699971623718739, + 1.4636084791272879, + 2.3061581011861563, + 0.3263326324522495, + 0.5398852601647377, + 1.058574452996254, + 0.9355521984398365, + 0.7239016145467758, + 1.4386932328343391, + 0.15445950999855995, + 0.2986617125570774, + 1.9105193316936493, + 0.4305257350206375, + 0.20194363966584206, + 3.5147950388491154, + 1.5822808779776096, + 1.3228941094130278, + 0.29015207663178444, + 2.0200242549180984, + 0.2946328464895487, + 0.4613613970577717, + 0.04568503797054291, + 0.1909022331237793, + 0.8035068064928055, + 0.3039204850792885, + 1.3599355891346931, + 0.3853542283177376, + 1.2584294900298119, + 1.165865421295166, + 1.528187008574605, + 0.7424289546906948, + 1.3983291052281857, + 0.9739240221679211, + 0.6743025295436382, + 1.8650055304169655 + ], + "unique_experts": 64, + "load_cv": 0.6858941713020541, + "normalized_load_entropy": 0.9433253204441003, + "max_load_share": 0.045548654244306416 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 120, + "ordered_topk_exact_tokens": 68, + "set_exact_tokens": 80, + "mean_set_jaccard": 0.8958333333333334, + "mean_token_weighted_tv": 0.02005651082533101, + "aggregate_load_tv": 0.037500000000000006 + }, + "system_bos": { + "tokens": 120, + "ordered_topk_exact_tokens": 66, + "set_exact_tokens": 82, + "mean_set_jaccard": 0.9005952380952382, + "mean_token_weighted_tv": 0.0200897277565673, + "aggregate_load_tv": 0.030555555555555565 + }, + "system_x": { + "tokens": 120, + "ordered_topk_exact_tokens": 46, + "set_exact_tokens": 68, + "mean_set_jaccard": 0.860515873015873, + "mean_token_weighted_tv": 0.027514488638068237, + "aggregate_load_tv": 0.04722222222222222 + }, + "system_period": { + "tokens": 120, + "ordered_topk_exact_tokens": 49, + "set_exact_tokens": 69, + "mean_set_jaccard": 0.8642857142857143, + "mean_token_weighted_tv": 0.027114962491517267, + "aggregate_load_tv": 0.044444444444444446 + }, + "bos_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 47, + "set_exact_tokens": 67, + "mean_set_jaccard": 0.8688492063492064, + "mean_token_weighted_tv": 0.02465115146866689, + "aggregate_load_tv": 0.041666666666666664 + }, + "bos_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 44, + "set_exact_tokens": 62, + "mean_set_jaccard": 0.8498015873015875, + "mean_token_weighted_tv": 0.0275830566106985, + "aggregate_load_tv": 0.04444444444444446 + }, + "x_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 49, + "set_exact_tokens": 62, + "mean_set_jaccard": 0.851984126984127, + "mean_token_weighted_tv": 0.028678554079184928, + "aggregate_load_tv": 0.05694444444444444 + }, + "x_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 37, + "set_exact_tokens": 54, + "mean_set_jaccard": 0.8196428571428572, + "mean_token_weighted_tv": 0.033831537173440056, + "aggregate_load_tv": 0.058333333333333334 + }, + "period_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 47, + "set_exact_tokens": 63, + "mean_set_jaccard": 0.8557539682539682, + "mean_token_weighted_tv": 0.028395926176259915, + "aggregate_load_tv": 0.052777777777777785 + }, + "period_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 29, + "set_exact_tokens": 50, + "mean_set_jaccard": 0.8140873015873016, + "mean_token_weighted_tv": 0.034326822170987724, + "aggregate_load_tv": 0.05277777777777777 + } + } + }, + "layer_12": { + "layer": 12, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "0f7d702d68f7f0576b6c8003b2812947b51a0e8938694e63b00b4e5e92b005d5", + "route_weight_sha256": "efd5270252b46193f111f522d486e4b54863489071ff5dde9371ea2513f44623", + "loads": [ + 11, + 4, + 9, + 11, + 21, + 3, + 0, + 16, + 30, + 1, + 15, + 2, + 8, + 2, + 19, + 4, + 28, + 4, + 4, + 23, + 6, + 6, + 15, + 16, + 24, + 5, + 9, + 31, + 29, + 17, + 0, + 9, + 14, + 13, + 4, + 3, + 27, + 4, + 14, + 3, + 18, + 14, + 6, + 11, + 1, + 3, + 24, + 9, + 19, + 29, + 2, + 2, + 12, + 8, + 20, + 2, + 3, + 16, + 33, + 5, + 7, + 7, + 3, + 2 + ], + "weighted_loads": [ + 0.6110663786530495, + 0.1525006890296936, + 0.38875482976436615, + 0.47898178175091743, + 2.1181026846170425, + 0.11061875522136688, + 0.0, + 1.1788119710981846, + 2.307135634124279, + 0.030109988525509834, + 0.885820908471942, + 0.11058516427874565, + 0.341726578772068, + 0.0627374704927206, + 1.0472485590726137, + 0.31184694170951843, + 1.36256655305624, + 0.19813840463757515, + 0.3465038388967514, + 0.9978207815438509, + 0.2319425828754902, + 0.5132087543606758, + 0.721289923414588, + 1.4322194531559944, + 1.3242590613663197, + 0.20572549290955067, + 0.35104047134518623, + 2.9051488302648067, + 2.528356123715639, + 1.410098634660244, + 0.0, + 0.4393524508923292, + 0.9982990957796574, + 0.8316603768616915, + 0.22871886938810349, + 0.13495680317282677, + 1.341361090540886, + 0.25048332288861275, + 0.755743196234107, + 0.20463699474930763, + 1.82313278503716, + 0.6372338701039553, + 0.28484351374208927, + 0.6316476538777351, + 0.05011524260044098, + 0.14133560843765736, + 1.5866233371198177, + 0.42733941599726677, + 0.8213272579014301, + 1.44490921869874, + 0.14862307533621788, + 0.0903051383793354, + 0.5256696976721287, + 0.5427166633307934, + 1.5141380280256271, + 0.09450972080230713, + 0.10888439230620861, + 0.7422972097992897, + 2.3700872361660004, + 0.22783131897449493, + 0.32016629725694656, + 0.4203995615243912, + 0.15088955871760845, + 0.08125331625342369 + ], + "unique_experts": 62, + "load_cv": 0.8064554360721802, + "normalized_load_entropy": 0.9211266599321764, + "max_load_share": 0.04583333333333333 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "e269f5c55cf0c6148607265a7d1965ffa759729c19dbb9995dd113474d5c18c7", + "route_weight_sha256": "a6c72502f3568173e08d014c1d1b748ba971959a7328a7a2e742fe671ab74ca1", + "loads": [ + 11, + 4, + 9, + 16, + 25, + 4, + 0, + 19, + 35, + 1, + 15, + 2, + 14, + 2, + 19, + 4, + 32, + 4, + 4, + 23, + 7, + 6, + 16, + 22, + 24, + 5, + 10, + 38, + 44, + 29, + 3, + 14, + 15, + 15, + 4, + 10, + 27, + 8, + 29, + 3, + 18, + 19, + 11, + 11, + 3, + 4, + 24, + 15, + 22, + 29, + 3, + 2, + 12, + 8, + 20, + 2, + 6, + 16, + 36, + 8, + 7, + 11, + 6, + 5 + ], + "weighted_loads": [ + 0.6110663786530495, + 0.1525006890296936, + 0.38875482976436615, + 0.6045855819247663, + 3.739203054457903, + 0.11465597106143832, + 0.0, + 1.4098317585885525, + 2.668964756652713, + 0.030109988525509834, + 0.885820908471942, + 0.11058516427874565, + 0.6302770338952541, + 0.0627374704927206, + 1.0472485590726137, + 0.31184694170951843, + 1.5816428549587727, + 0.19813840463757515, + 0.3465038388967514, + 0.9978207815438509, + 0.23425349313765764, + 0.5132087543606758, + 0.7707258369773626, + 1.914823740720749, + 1.3242590613663197, + 0.20572549290955067, + 0.3837413191795349, + 3.305186279118061, + 4.368141315877438, + 3.0509800910949707, + 0.10624985676258802, + 0.6951498854905367, + 1.044480212032795, + 0.9344388451427221, + 0.22871886938810349, + 0.6322907954454422, + 1.341361090540886, + 0.36509413179010153, + 1.8647134136408567, + 0.20463699474930763, + 1.82313278503716, + 1.1539433617144823, + 0.6053911726921797, + 0.6316476538777351, + 0.1739216223359108, + 0.18070201016962528, + 1.5866233371198177, + 0.762887891381979, + 0.9628320895135403, + 1.44490921869874, + 0.1615621093660593, + 0.0903051383793354, + 0.5256696976721287, + 0.5427166633307934, + 1.5141380280256271, + 0.09450972080230713, + 0.21543731214478612, + 0.7422972097992897, + 2.5735537856817245, + 0.3212408535182476, + 0.32016629725694656, + 0.5762393362820148, + 0.271604185923934, + 0.1796669065952301 + ], + "unique_experts": 63, + "load_cv": 0.7700806305617544, + "normalized_load_entropy": 0.9294597710112645, + "max_load_share": 0.05057471264367816 + } + }, + "s1_eos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "4f99c9d007f9f1f7f3e9e4f6de4f3a8e9fea3b6175598b399e6c5334eb4c976e", + "route_weight_sha256": "179c55f75aa95a4aa9ee6102227d9f9b1668a24c9ac1fb7cfce26445e3017797", + "loads": [ + 10, + 3, + 11, + 12, + 20, + 2, + 0, + 16, + 29, + 1, + 14, + 2, + 8, + 1, + 18, + 4, + 27, + 4, + 4, + 30, + 4, + 6, + 15, + 16, + 26, + 6, + 13, + 31, + 30, + 17, + 0, + 8, + 13, + 12, + 4, + 3, + 26, + 5, + 12, + 3, + 18, + 14, + 6, + 10, + 1, + 2, + 24, + 8, + 20, + 30, + 2, + 1, + 11, + 7, + 20, + 3, + 2, + 18, + 33, + 5, + 7, + 7, + 3, + 2 + ], + "weighted_loads": [ + 0.5722712799906731, + 0.11147907748818398, + 0.45434946194291115, + 0.5201031006872654, + 2.1247927211225033, + 0.07137591391801834, + 0.0, + 1.1751081608235836, + 2.231386996805668, + 0.029734916985034943, + 0.8418256100267172, + 0.10861639678478241, + 0.34521685913205147, + 0.042183756828308105, + 1.061316303908825, + 0.3164439722895622, + 1.3369210436940193, + 0.19750484824180603, + 0.3489481993019581, + 1.2548286449164152, + 0.15444974973797798, + 0.5105474758893251, + 0.7278676480054855, + 1.419573713093996, + 1.4466535449028015, + 0.23638121783733368, + 0.49304725229740143, + 2.8877366110682487, + 2.503425182774663, + 1.3366807624697685, + 0.0, + 0.40384111925959587, + 0.9706580825150013, + 0.7884998135268688, + 0.21882743388414383, + 0.13606048375368118, + 1.350548580288887, + 0.27439360693097115, + 0.6636824775487185, + 0.20361941680312157, + 2.1123093012720346, + 0.6125423908233643, + 0.28440336138010025, + 0.5782742761075497, + 0.05131389945745468, + 0.09053744003176689, + 1.5915985405445099, + 0.43570784479379654, + 0.9066319428384304, + 1.5375788509845734, + 0.13766923546791077, + 0.06028365343809128, + 0.48859338089823723, + 0.48612911254167557, + 1.4923969693481922, + 0.13103223964571953, + 0.07984429225325584, + 0.8117316272109747, + 2.2968017160892487, + 0.23100407049059868, + 0.3044792711734772, + 0.42605171725153923, + 0.15140946581959724, + 0.08075958117842674 + ], + "unique_experts": 62, + "load_cv": 0.8314794192830981, + "normalized_load_entropy": 0.9160329096177354, + "max_load_share": 0.04583333333333333 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "4f7b86b5cc4564e90afb2184f672839d30459d34ca0957d306683e3430c78208", + "route_weight_sha256": "f633343fa17432d5c8c888cc3a7a603f86d0af5832e47dc0c63f88f14b3effe2", + "loads": [ + 14, + 3, + 11, + 15, + 24, + 3, + 0, + 23, + 36, + 4, + 15, + 2, + 11, + 1, + 18, + 4, + 32, + 6, + 5, + 30, + 5, + 8, + 18, + 22, + 26, + 6, + 16, + 38, + 47, + 34, + 11, + 12, + 17, + 17, + 9, + 11, + 26, + 9, + 31, + 3, + 18, + 25, + 13, + 12, + 14, + 6, + 27, + 15, + 26, + 30, + 4, + 1, + 11, + 10, + 20, + 3, + 5, + 24, + 36, + 9, + 9, + 15, + 8, + 2 + ], + "weighted_loads": [ + 0.7621684707701206, + 0.11147907748818398, + 0.45434946194291115, + 0.5750832802150398, + 3.7469081170856953, + 0.07528732484206557, + 0.0, + 1.576058205217123, + 2.741579409688711, + 0.34836242347955704, + 0.8859516736119986, + 0.10861639678478241, + 0.5058882310986519, + 0.042183756828308105, + 1.061316303908825, + 0.3164439722895622, + 1.6585531905293465, + 0.30951788648962975, + 0.38479216769337654, + 1.2548286449164152, + 0.1567793358117342, + 0.6003932561725378, + 0.8504197970032692, + 1.8779612109065056, + 1.4466535449028015, + 0.23638121783733368, + 0.6158125251531601, + 3.2410451471805573, + 4.648218089714646, + 3.774301927536726, + 0.8603563634678721, + 0.6117482054978609, + 1.1477953363209963, + 1.0882962830364704, + 0.4716068506240845, + 0.7431800365447998, + 1.350548580288887, + 0.44931217189878225, + 2.070804977789521, + 0.20361941680312157, + 2.1123093012720346, + 1.6331840604543686, + 0.698439821600914, + 0.6862645670771599, + 1.2663121297955513, + 0.3956359103322029, + 1.7196275778114796, + 0.8338706009089947, + 1.1928035095334053, + 1.5375788509845734, + 0.20291889272630215, + 0.06028365343809128, + 0.48859338089823723, + 0.643975805491209, + 1.4923969693481922, + 0.13103223964571953, + 0.16022138530388474, + 1.0732462089508772, + 2.4973202496767044, + 0.35462381690740585, + 0.3738456778228283, + 0.8308377303183079, + 0.3700997568666935, + 0.08075958117842674 + ], + "unique_experts": 63, + "load_cv": 0.7191838538830827, + "normalized_load_entropy": 0.9365035989376902, + "max_load_share": 0.048654244306418216 + } + }, + "s0_bos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "ed83944704a3c0d5f8549ad6d48f71b28486bb75ab18ae3eae5f5bdf34a7bb10", + "route_weight_sha256": "6f888d94fba5101f2cf339508e3680f8932e0555981b69485de6f3cda649908d", + "loads": [ + 10, + 4, + 10, + 11, + 18, + 4, + 0, + 16, + 28, + 2, + 16, + 3, + 6, + 2, + 19, + 4, + 25, + 4, + 4, + 27, + 5, + 7, + 15, + 16, + 23, + 5, + 10, + 31, + 28, + 17, + 0, + 10, + 14, + 13, + 4, + 3, + 26, + 4, + 11, + 3, + 19, + 17, + 5, + 11, + 1, + 2, + 24, + 9, + 19, + 30, + 2, + 1, + 11, + 8, + 20, + 2, + 4, + 19, + 32, + 6, + 8, + 7, + 3, + 2 + ], + "weighted_loads": [ + 0.5937302857637405, + 0.1520790159702301, + 0.43085111305117607, + 0.4685675296932459, + 2.059374062344432, + 0.14387921430170536, + 0.0, + 1.176611766219139, + 2.2774183433502913, + 0.05981617607176304, + 0.9449479673057795, + 0.14653140306472778, + 0.3054426144808531, + 0.07692233473062515, + 1.0607683546841145, + 0.3302662596106529, + 1.2510546520352364, + 0.19915186613798141, + 0.3457898236811161, + 1.1766883600503206, + 0.19987850449979305, + 0.57261679507792, + 0.7112868241965771, + 1.5079954899847507, + 1.3271040357649326, + 0.20780149474740028, + 0.37745556235313416, + 3.021287467330694, + 2.454451307654381, + 1.4185941256582737, + 0.0, + 0.4606708139181137, + 1.0615780428051949, + 0.8428976442664862, + 0.24240443110466003, + 0.1349191702902317, + 1.3325754702091217, + 0.2571725659072399, + 0.6195853427052498, + 0.22588635236024857, + 1.979898352175951, + 0.7907578982412815, + 0.2575463093817234, + 0.6496240757405758, + 0.050153881311416626, + 0.10955198109149933, + 1.6306775026023388, + 0.4946625679731369, + 0.8247348926961422, + 1.4562924019992352, + 0.1594335064291954, + 0.07121569663286209, + 0.4820232428610325, + 0.5424707271158695, + 1.583951860666275, + 0.08311403915286064, + 0.13628878816962242, + 0.8908775001764297, + 2.232876144349575, + 0.271913792937994, + 0.3551308549940586, + 0.4343964233994484, + 0.1535253580659628, + 0.07856885343790054 + ], + "unique_experts": 62, + "load_cv": 0.7950463919999252, + "normalized_load_entropy": 0.922742317394949, + "max_load_share": 0.044444444444444446 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "ebc8e03a72e0bd104d68eec529d9dc9708f015fcf1a075ba4a86702c08ab3c85", + "route_weight_sha256": "1c83de683bfde0054acf862aa4716eb328c35acd4194415be97f332fb1fcd041", + "loads": [ + 11, + 4, + 10, + 15, + 21, + 4, + 0, + 19, + 34, + 2, + 16, + 3, + 13, + 2, + 19, + 4, + 30, + 4, + 4, + 27, + 5, + 7, + 16, + 23, + 23, + 5, + 12, + 38, + 44, + 29, + 2, + 16, + 15, + 15, + 4, + 10, + 26, + 8, + 26, + 3, + 19, + 22, + 9, + 11, + 3, + 3, + 24, + 14, + 22, + 30, + 3, + 1, + 11, + 8, + 20, + 2, + 6, + 19, + 35, + 9, + 8, + 11, + 6, + 5 + ], + "weighted_loads": [ + 0.6488248743116856, + 0.1520790159702301, + 0.43085111305117607, + 0.5910843703895807, + 2.729867847636342, + 0.14387921430170536, + 0.0, + 1.4092474430799484, + 2.7264867536723614, + 0.05981617607176304, + 0.9449479673057795, + 0.14653140306472778, + 0.6843745317310095, + 0.07692233473062515, + 1.0607683546841145, + 0.3302662596106529, + 1.4684501513838768, + 0.19915186613798141, + 0.3457898236811161, + 1.1766883600503206, + 0.19987850449979305, + 0.57261679507792, + 0.7607227377593517, + 2.035326484590769, + 1.3271040357649326, + 0.20780149474740028, + 0.4530773349106312, + 3.4213249161839485, + 4.285515774041414, + 3.177993491292, + 0.06287556421011686, + 0.7788060717284679, + 1.1077591590583324, + 0.9369160439819098, + 0.24240443110466003, + 0.6322531625628471, + 1.3325754702091217, + 0.3717833748087287, + 1.7405078262090683, + 0.22588635236024857, + 1.979898352175951, + 1.2424347288906574, + 0.5340174995362759, + 0.6496240757405758, + 0.17140235751867294, + 0.14891838282346725, + 1.6306775026023388, + 0.7637936808168888, + 0.9538002796471119, + 1.4562924019992352, + 0.17237254045903683, + 0.07121569663286209, + 0.4820232428610325, + 0.5424707271158695, + 1.583951860666275, + 0.08311403915286064, + 0.23826274648308754, + 0.8908775001764297, + 2.4397084191441536, + 0.41782341338694096, + 0.3551308549940586, + 0.5902361981570721, + 0.2742399852722883, + 0.17698244377970695 + ], + "unique_experts": 63, + "load_cv": 0.7631318327872572, + "normalized_load_entropy": 0.9299082612847811, + "max_load_share": 0.05057471264367816 + } + }, + "s1_bos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "8c7383b84468ad0231464fe7504574ed665f7347a318f36899e96d9cfad0a24a", + "route_weight_sha256": "046eb449411b15965ea10a2e7373fa429e9be973b743db08a95285198083fd71", + "loads": [ + 11, + 3, + 11, + 9, + 18, + 3, + 0, + 16, + 29, + 1, + 16, + 2, + 9, + 1, + 19, + 4, + 26, + 4, + 4, + 31, + 5, + 7, + 13, + 16, + 24, + 6, + 8, + 30, + 29, + 16, + 0, + 13, + 14, + 13, + 4, + 4, + 26, + 4, + 11, + 3, + 19, + 16, + 7, + 10, + 1, + 2, + 24, + 7, + 18, + 32, + 2, + 1, + 11, + 7, + 21, + 2, + 3, + 18, + 32, + 6, + 6, + 7, + 3, + 2 + ], + "weighted_loads": [ + 0.6043025981634855, + 0.10759362205862999, + 0.464314803481102, + 0.3894801866263151, + 2.078065536916256, + 0.1097513884305954, + 0.0, + 1.1679146736860275, + 2.279999788850546, + 0.028456490486860275, + 0.9367461800575256, + 0.107241902500391, + 0.443630812689662, + 0.03430042415857315, + 1.076895885169506, + 0.3150860518217087, + 1.2864119056612253, + 0.20068268105387688, + 0.3501382879912853, + 1.29940433986485, + 0.1764877736568451, + 0.5795737784355879, + 0.6684290282428265, + 1.4589962735772133, + 1.4077355787158012, + 0.24159863218665123, + 0.3246365040540695, + 2.949005361646414, + 2.4970138631761074, + 1.3585829734802246, + 0.0, + 0.5793720129877329, + 1.0186984203755856, + 0.8123296461999416, + 0.24675867334008217, + 0.16365422867238522, + 1.39272128790617, + 0.24941246956586838, + 0.5682107377797365, + 0.2135162465274334, + 2.1894526295363903, + 0.769743712618947, + 0.3345816396176815, + 0.5871965549886227, + 0.04760908707976341, + 0.09184958972036839, + 1.6057748198509216, + 0.3832436352968216, + 0.8391263373196125, + 1.5876903217285872, + 0.14634082093834877, + 0.0680534765124321, + 0.48327813297510147, + 0.49345749616622925, + 1.5910607911646366, + 0.09107017144560814, + 0.11589770764112473, + 0.8306146562099457, + 2.2397174425423145, + 0.2795180678367615, + 0.27242570742964745, + 0.4292442239820957, + 0.15258801728487015, + 0.07786458358168602 + ], + "unique_experts": 62, + "load_cv": 0.8214711284122009, + "normalized_load_entropy": 0.9180471610933412, + "max_load_share": 0.044444444444444446 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "b1ee2a9b20f9ff5d3a848e5c53ae11b44d825bdd732dc311ccc7089685ea372e", + "route_weight_sha256": "8d18f51567e537ee589c1ce1808df8cbb65174e09058f145d301a1570e795f23", + "loads": [ + 15, + 3, + 11, + 11, + 21, + 3, + 0, + 23, + 36, + 4, + 17, + 2, + 13, + 1, + 19, + 4, + 34, + 6, + 5, + 31, + 5, + 9, + 16, + 22, + 24, + 6, + 11, + 37, + 46, + 34, + 11, + 18, + 18, + 18, + 9, + 12, + 26, + 8, + 30, + 3, + 19, + 27, + 13, + 13, + 14, + 6, + 26, + 15, + 24, + 32, + 4, + 1, + 11, + 10, + 21, + 2, + 4, + 24, + 35, + 10, + 8, + 15, + 8, + 2 + ], + "weighted_loads": [ + 0.7941997889429331, + 0.10759362205862999, + 0.464314803481102, + 0.4415199514478445, + 2.749693974852562, + 0.1097513884305954, + 0.0, + 1.5689379498362541, + 2.842059090733528, + 0.34708399698138237, + 0.980872243642807, + 0.107241902500391, + 0.7368195746093988, + 0.03430042415857315, + 1.076895885169506, + 0.3150860518217087, + 1.723055051639676, + 0.3126957193017006, + 0.3859822563827038, + 1.29940433986485, + 0.1764877736568451, + 0.6694195587188005, + 0.7909811772406101, + 1.9173837713897228, + 1.4077355787158012, + 0.24159863218665123, + 0.4474017769098282, + 3.3023138977587223, + 4.762248277664185, + 3.9751062355935574, + 0.8603563634678721, + 0.833156056702137, + 1.1958356741815805, + 1.1137063950300217, + 0.4995380900800228, + 0.7707737814635038, + 1.39272128790617, + 0.4243310345336795, + 2.0859175827354193, + 0.2135162465274334, + 2.1894526295363903, + 1.7695847023278475, + 0.7009264416992664, + 0.730757437646389, + 1.2566860504448414, + 0.3969480600208044, + 1.6952685490250587, + 0.8088467083871365, + 1.115941558033228, + 1.5876903217285872, + 0.21159047819674015, + 0.0680534765124321, + 0.48327813297510147, + 0.6513041891157627, + 1.5910607911646366, + 0.09107017144560814, + 0.14361100271344185, + 1.0921292379498482, + 2.4519845321774483, + 0.4371479172259569, + 0.34179211407899857, + 0.8340302370488644, + 0.3712783083319664, + 0.07786458358168602 + ], + "unique_experts": 63, + "load_cv": 0.7176564031473022, + "normalized_load_entropy": 0.9361054977163619, + "max_load_share": 0.047619047619047616 + } + }, + "s0_x": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "5218fbf4cbeae22f8219dc6e37bd29130a2b35c72e25464fbfaba81aedce2b9e", + "route_weight_sha256": "9c97a7e6e133b0027e4aed16bbb857d7fc88617c29858947ff94f1df6aa383d1", + "loads": [ + 9, + 3, + 10, + 12, + 21, + 2, + 0, + 17, + 30, + 1, + 15, + 2, + 4, + 1, + 18, + 4, + 24, + 4, + 5, + 28, + 6, + 9, + 14, + 16, + 22, + 5, + 10, + 31, + 30, + 17, + 0, + 8, + 15, + 13, + 5, + 4, + 22, + 4, + 13, + 3, + 17, + 16, + 6, + 10, + 1, + 3, + 24, + 8, + 16, + 29, + 2, + 1, + 11, + 7, + 21, + 3, + 2, + 23, + 35, + 6, + 9, + 7, + 4, + 2 + ], + "weighted_loads": [ + 0.5594722144305706, + 0.11730436608195305, + 0.43982965126633644, + 0.4896186776459217, + 2.168600967153907, + 0.07468758150935173, + 0.0, + 1.2543590851128101, + 2.4186817035079002, + 0.028180118650197983, + 0.9247710015624762, + 0.11224795505404472, + 0.19773617014288902, + 0.03395809233188629, + 1.0246776193380356, + 0.314847094938159, + 1.2091451957821846, + 0.20648819208145142, + 0.3770569898188114, + 1.1915544122457504, + 0.23338123597204685, + 0.6391055714339018, + 0.6775560807436705, + 1.4896303452551365, + 1.2817221283912659, + 0.21276108920574188, + 0.3864468913525343, + 3.0861247163265944, + 2.6177278719842434, + 1.3228085786104202, + 0.0, + 0.3988668266683817, + 1.1319903433322906, + 0.8625181466341019, + 0.27018488571047783, + 0.1663838680833578, + 1.1956784296780825, + 0.25518814846873283, + 0.6929600313305855, + 0.22768369317054749, + 1.7118011824786663, + 0.7545840349048376, + 0.30011963471770287, + 0.6583584882318974, + 0.04808974266052246, + 0.1396825797855854, + 1.6527543403208256, + 0.4604930765926838, + 0.7090425901114941, + 1.3902559094130993, + 0.17038366943597794, + 0.068669393658638, + 0.4861187972128391, + 0.5084373652935028, + 1.6656951792538166, + 0.1265179179608822, + 0.08282851800322533, + 1.0767694097012281, + 2.4675303362309933, + 0.2589627206325531, + 0.39002566412091255, + 0.43668584525585175, + 0.1795163620263338, + 0.07852867245674133 + ], + "unique_experts": 62, + "load_cv": 0.8133151181931156, + "normalized_load_entropy": 0.919461970439204, + "max_load_share": 0.04861111111111111 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "048c4a760d13f95990e35b9b909f53dbfca31554f49958f08774177e8cea22c1", + "route_weight_sha256": "ffc1b3661a4851edeb327d662ab555ac90ad06edcadb0d7cd62ae6f0f63e78ee", + "loads": [ + 9, + 3, + 10, + 16, + 24, + 2, + 0, + 20, + 36, + 1, + 15, + 2, + 10, + 1, + 18, + 4, + 27, + 4, + 5, + 28, + 6, + 9, + 15, + 24, + 22, + 5, + 11, + 39, + 48, + 28, + 3, + 13, + 16, + 15, + 5, + 12, + 22, + 8, + 27, + 3, + 17, + 21, + 11, + 10, + 3, + 5, + 24, + 13, + 19, + 29, + 3, + 1, + 11, + 7, + 21, + 3, + 4, + 23, + 38, + 8, + 9, + 12, + 7, + 5 + ], + "weighted_loads": [ + 0.5594722144305706, + 0.11730436608195305, + 0.43982965126633644, + 0.6121355183422565, + 2.839094752445817, + 0.07468758150935173, + 0.0, + 1.4899824000895023, + 2.808932254090905, + 0.028180118650197983, + 0.9247710015624762, + 0.11224795505404472, + 0.49374912679195404, + 0.03395809233188629, + 1.0246776193380356, + 0.314847094938159, + 1.354709055274725, + 0.20648819208145142, + 0.3770569898188114, + 1.1915544122457504, + 0.23338123597204685, + 0.6391055714339018, + 0.7269919943064451, + 2.1607878506183624, + 1.2817221283912659, + 0.21276108920574188, + 0.419147739186883, + 3.5426288936287165, + 4.762125834822655, + 2.819647867232561, + 0.11655731778591871, + 0.6618673894554377, + 1.1781714595854282, + 0.9545860663056374, + 0.27018488571047783, + 0.7397394347935915, + 1.1956784296780825, + 0.3697989573702216, + 1.6500609517097473, + 0.22768369317054749, + 1.7118011824786663, + 1.231890371069312, + 0.6184407770633698, + 0.6583584882318974, + 0.17897729575634003, + 0.23049018904566765, + 1.6527543403208256, + 0.7131933942437172, + 0.8438716419041157, + 1.3902559094130993, + 0.18332270346581936, + 0.068669393658638, + 0.4861187972128391, + 0.5084373652935028, + 1.6656951792538166, + 0.1265179179608822, + 0.18480247631669044, + 1.0767694097012281, + 2.6675127036869526, + 0.3439286220818758, + 0.39002566412091255, + 0.6639059595763683, + 0.30023098923265934, + 0.17694226279854774 + ], + "unique_experts": 63, + "load_cv": 0.7859480652118176, + "normalized_load_entropy": 0.9270937565340988, + "max_load_share": 0.05517241379310345 + } + }, + "s1_x": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "53a311598ec9a19f4626fcbfcab75d58099ae8582fc516a88d556ff524131036", + "route_weight_sha256": "e61e4a2236917952b44f8a7768aedab554be2818c8ce55c2218c03a4da67bed6", + "loads": [ + 11, + 3, + 10, + 10, + 18, + 3, + 0, + 16, + 31, + 1, + 17, + 2, + 5, + 1, + 18, + 5, + 24, + 4, + 4, + 28, + 4, + 7, + 13, + 16, + 24, + 5, + 9, + 33, + 29, + 16, + 1, + 9, + 14, + 13, + 4, + 5, + 25, + 4, + 12, + 3, + 17, + 15, + 7, + 10, + 1, + 2, + 25, + 8, + 22, + 30, + 2, + 2, + 11, + 7, + 23, + 3, + 2, + 18, + 33, + 5, + 7, + 7, + 3, + 3 + ], + "weighted_loads": [ + 0.6049109417945147, + 0.11060485988855362, + 0.41463977843523026, + 0.40401422418653965, + 2.1013402342796326, + 0.1026761643588543, + 0.0, + 1.2214978449046612, + 2.4283609203994274, + 0.030563637614250183, + 0.9595177061855793, + 0.1061176210641861, + 0.23700958862900734, + 0.03230869024991989, + 1.0287912525236607, + 0.3814840167760849, + 1.1970086321234703, + 0.20381790027022362, + 0.35539187490940094, + 1.1427315510809422, + 0.14895392768085003, + 0.54472173191607, + 0.6768403127789497, + 1.4465769864618778, + 1.4131045565009117, + 0.2134261578321457, + 0.35433570481836796, + 3.109936747699976, + 2.596209343522787, + 1.1558940634131432, + 0.03688614070415497, + 0.4203167147934437, + 0.990203507244587, + 0.7776469830423594, + 0.22150834277272224, + 0.20085223205387592, + 1.3705279342830181, + 0.2522832341492176, + 0.6228155605494976, + 0.20285531878471375, + 2.005760505795479, + 0.7025912087410688, + 0.3469640836119652, + 0.5609215572476387, + 0.048843879252672195, + 0.09228461794555187, + 1.6804290190339088, + 0.4162264000624418, + 0.9896839000284672, + 1.5211048368364573, + 0.14369599148631096, + 0.09705070964992046, + 0.4840549975633621, + 0.5000831186771393, + 1.7308945674449205, + 0.13323626294732094, + 0.08111051470041275, + 0.8669396601617336, + 2.400800071656704, + 0.22545136138796806, + 0.3105430919677019, + 0.43882938474416733, + 0.14273606054484844, + 0.1056537851691246 + ], + "unique_experts": 63, + "load_cv": 0.8237223552378061, + "normalized_load_entropy": 0.9193434402423672, + "max_load_share": 0.04583333333333333 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "a1a648932a63eb83b0c3a70f5143e1742e98453bb8fe54af52c531c9dcdf57ab", + "route_weight_sha256": "6960af1ea84caf4f95d9a106ba97ee6e0fee6673059f5d210d716da920978001", + "loads": [ + 15, + 3, + 10, + 12, + 21, + 3, + 0, + 23, + 38, + 4, + 18, + 2, + 8, + 1, + 18, + 5, + 29, + 6, + 5, + 28, + 4, + 10, + 16, + 23, + 24, + 5, + 12, + 41, + 48, + 31, + 13, + 13, + 18, + 17, + 9, + 14, + 25, + 9, + 30, + 3, + 17, + 26, + 15, + 12, + 14, + 7, + 28, + 14, + 27, + 30, + 4, + 2, + 11, + 10, + 23, + 3, + 3, + 27, + 35, + 8, + 9, + 16, + 8, + 3 + ], + "weighted_loads": [ + 0.7948081325739622, + 0.11060485988855362, + 0.41463977843523026, + 0.45605398900806904, + 2.7729686722159386, + 0.1026761643588543, + 0.0, + 1.6334216184914112, + 2.92582580819726, + 0.3491911441087723, + 1.0036437697708607, + 0.1061176210641861, + 0.3776663765311241, + 0.03230869024991989, + 1.0287912525236607, + 0.3814840167760849, + 1.4855769835412502, + 0.31583093851804733, + 0.3912358433008194, + 1.1427315510809422, + 0.14895392768085003, + 0.6650396101176739, + 0.7993924617767334, + 2.036151595413685, + 1.4131045565009117, + 0.2134261578321457, + 0.4771009776741266, + 3.537848223000765, + 5.06310386583209, + 3.2808787003159523, + 0.9436411028727889, + 0.6424681190401316, + 1.167340761050582, + 1.0216962080448866, + 0.4742877595126629, + 0.9081313777714968, + 1.3705279342830181, + 0.4582664826884866, + 1.8734334893524647, + 0.20285531878471375, + 2.005760505795479, + 1.7394921761006117, + 0.8373082242906094, + 0.6689118482172489, + 1.2499970123171806, + 0.4386180844157934, + 1.8116332776844501, + 0.7141819652169943, + 1.2110040448606014, + 1.5211048368364573, + 0.20894564874470234, + 0.09705070964992046, + 0.4840549975633621, + 0.6579298116266727, + 1.7308945674449205, + 0.13323626294732094, + 0.10882380977272987, + 1.257739495486021, + 2.577696770429611, + 0.3412484172731638, + 0.37990949861705303, + 0.8970591127872467, + 0.3614263515919447, + 0.1056537851691246 + ], + "unique_experts": 63, + "load_cv": 0.7221340957069443, + "normalized_load_entropy": 0.9365318981746524, + "max_load_share": 0.049689440993788817 + } + }, + "s0_period": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "c146b2a80496b0336eb52ebfa5c08f4e8673fa107555936cd58198d4d22f1d27", + "route_weight_sha256": "8f60a33cac047d6e38f723460d9622237f9b2611ee1582dcb96c27c51012a313", + "loads": [ + 10, + 3, + 10, + 10, + 20, + 2, + 0, + 17, + 29, + 1, + 16, + 2, + 5, + 2, + 18, + 3, + 22, + 4, + 5, + 26, + 5, + 9, + 15, + 16, + 21, + 5, + 11, + 32, + 29, + 18, + 1, + 9, + 15, + 13, + 4, + 3, + 25, + 4, + 14, + 3, + 17, + 15, + 7, + 9, + 1, + 3, + 24, + 8, + 17, + 30, + 2, + 1, + 11, + 7, + 22, + 3, + 1, + 22, + 34, + 6, + 10, + 7, + 3, + 3 + ], + "weighted_loads": [ + 0.6025878190994263, + 0.11716916039586067, + 0.43769480660557747, + 0.41459302976727486, + 2.1528949681669474, + 0.07043130323290825, + 0.0, + 1.2579310238361359, + 2.4456080961972475, + 0.029033692553639412, + 0.9690666850656271, + 0.11106298863887787, + 0.24491703510284424, + 0.06662852689623833, + 1.0110072195529938, + 0.28896579146385193, + 1.1191342175006866, + 0.20280999317765236, + 0.38107474334537983, + 1.0742547139525414, + 0.20055226236581802, + 0.6334006674587727, + 0.7030948735773563, + 1.487579483538866, + 1.224204309284687, + 0.21254632994532585, + 0.4319285824894905, + 3.1173434741795063, + 2.5644226167351007, + 1.376636829227209, + 0.023279227316379547, + 0.4263101574033499, + 1.113375511020422, + 0.8529867567121983, + 0.23580073192715645, + 0.14489684998989105, + 1.3034990690648556, + 0.25070933625102043, + 0.7187580857425928, + 0.22092274203896523, + 1.749642014503479, + 0.7368536405265331, + 0.32916337810456753, + 0.6065773107111454, + 0.04628133773803711, + 0.13965535908937454, + 1.6492663584649563, + 0.456671092659235, + 0.7676549889147282, + 1.4115316364914179, + 0.16553957015275955, + 0.06789520382881165, + 0.4950491413474083, + 0.5122909769415855, + 1.6922825686633587, + 0.1339876614511013, + 0.04801323637366295, + 1.030743332579732, + 2.432804364711046, + 0.25718915835022926, + 0.43722227960824966, + 0.4484070800244808, + 0.14543840661644936, + 0.10593622177839279 + ], + "unique_experts": 63, + "load_cv": 0.8067615493631709, + "normalized_load_entropy": 0.9207252484722058, + "max_load_share": 0.04722222222222222 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "6eaad347126b1ccd4a1ecfc96eeeccb90b5d504615dfda0ad2760701b3151288", + "route_weight_sha256": "8c825477eeb18a3ac41579f17c2ad7fb170b99fc4fe2622a697a414d97983a13", + "loads": [ + 10, + 3, + 10, + 14, + 23, + 2, + 0, + 20, + 35, + 1, + 16, + 2, + 11, + 2, + 18, + 3, + 25, + 4, + 5, + 26, + 5, + 9, + 16, + 24, + 21, + 5, + 12, + 40, + 47, + 29, + 3, + 14, + 16, + 15, + 4, + 11, + 25, + 8, + 28, + 3, + 17, + 21, + 12, + 9, + 3, + 4, + 24, + 14, + 19, + 30, + 3, + 1, + 11, + 7, + 22, + 3, + 3, + 22, + 37, + 8, + 10, + 12, + 7, + 6 + ], + "weighted_loads": [ + 0.6025878190994263, + 0.11716916039586067, + 0.43769480660557747, + 0.5371098704636097, + 2.8233887534588575, + 0.07043130323290825, + 0.0, + 1.4978220388293266, + 2.8455930277705193, + 0.029033692553639412, + 0.9690666850656271, + 0.11106298863887787, + 0.5468560084700584, + 0.06662852689623833, + 1.0110072195529938, + 0.28896579146385193, + 1.2670903280377388, + 0.20280999317765236, + 0.38107474334537983, + 1.0742547139525414, + 0.20055226236581802, + 0.6334006674587727, + 0.752530787140131, + 2.0704927891492844, + 1.224204309284687, + 0.21254632994532585, + 0.4646294303238392, + 3.554607428610325, + 4.782564276829362, + 2.8883898556232452, + 0.08615479152649641, + 0.6858308892697096, + 1.1595566272735596, + 0.9423737153410912, + 0.23580073192715645, + 0.6911731474101543, + 1.3034990690648556, + 0.3653201451525092, + 1.6746047381311655, + 0.22092274203896523, + 1.749642014503479, + 1.3047306574881077, + 0.6468340177088976, + 0.6065773107111454, + 0.17342349141836166, + 0.17902176082134247, + 1.6492663584649563, + 0.7397179324179888, + 0.8637836948037148, + 1.4115316364914179, + 0.17847860418260098, + 0.06789520382881165, + 0.4950491413474083, + 0.5122909769415855, + 1.6922825686633587, + 0.1339876614511013, + 0.14998719468712807, + 1.030743332579732, + 2.6259789653122425, + 0.34215505979955196, + 0.43722227960824966, + 0.657015010714531, + 0.314940195530653, + 0.2043498121201992 + ], + "unique_experts": 63, + "load_cv": 0.7824978045401701, + "normalized_load_entropy": 0.9271045764331027, + "max_load_share": 0.054022988505747126 + } + }, + "s1_period": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "f1a96f10b5d4d634f1ea53e3c2b1a2397061547efcc39cdf3787dc11913c1a18", + "route_weight_sha256": "df085efc0e42c9272fa1ff0ba8215f1b4da74702ce3bfa4ec10356a231371e0b", + "loads": [ + 10, + 3, + 11, + 10, + 18, + 2, + 0, + 17, + 31, + 1, + 16, + 2, + 6, + 0, + 18, + 5, + 23, + 4, + 4, + 25, + 5, + 7, + 14, + 17, + 24, + 5, + 10, + 32, + 29, + 16, + 0, + 11, + 14, + 12, + 4, + 5, + 25, + 4, + 14, + 3, + 17, + 16, + 6, + 11, + 1, + 2, + 25, + 7, + 19, + 31, + 2, + 2, + 11, + 7, + 23, + 2, + 2, + 21, + 33, + 6, + 6, + 7, + 3, + 3 + ], + "weighted_loads": [ + 0.5790975503623486, + 0.10833084583282471, + 0.4496662002056837, + 0.40982708148658276, + 2.0961502250283957, + 0.06926693767309189, + 0.0, + 1.2586392275989056, + 2.441268589347601, + 0.02903834730386734, + 0.9235689491033554, + 0.10776429623365402, + 0.29006683081388474, + 0.0, + 1.0112998336553574, + 0.37480466440320015, + 1.1586610898375511, + 0.20315416157245636, + 0.3559959642589092, + 1.0439008548855782, + 0.18900278583168983, + 0.5286353584378958, + 0.7072175107896328, + 1.4822292551398277, + 1.4279585778713226, + 0.2098344899713993, + 0.40221233293414116, + 3.0751951076090336, + 2.6024938262999058, + 1.08610101044178, + 0.0, + 0.49630846083164215, + 0.969839408993721, + 0.731840293854475, + 0.22883283719420433, + 0.1995009295642376, + 1.3914205953478813, + 0.24823657423257828, + 0.6716113090515137, + 0.2037782184779644, + 1.9989802613854408, + 0.7322251200675964, + 0.31837155297398567, + 0.5925104394555092, + 0.04761672392487526, + 0.09380500204861164, + 1.6955571100115776, + 0.35291519947350025, + 0.8281896449625492, + 1.5147396996617317, + 0.14287102594971657, + 0.09343797899782658, + 0.4883161596953869, + 0.5032783038914204, + 1.7245176769793034, + 0.09767095744609833, + 0.07503773272037506, + 0.997718958184123, + 2.4435270689427853, + 0.2567087560892105, + 0.2989324890077114, + 0.4546012133359909, + 0.14536897465586662, + 0.10625367797911167 + ], + "unique_experts": 61, + "load_cv": 0.8207193472275284, + "normalized_load_entropy": 0.9173110659616405, + "max_load_share": 0.04583333333333333 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "c0e67607ae9eb2989700eeca547217a071a4257cfc30c1718f17fbde9ab70893", + "route_weight_sha256": "11f967d3a56ccc5a80adaf29447182389d04ac003a2549a84daba2460e93232e", + "loads": [ + 14, + 3, + 11, + 12, + 21, + 2, + 0, + 24, + 38, + 4, + 17, + 2, + 8, + 0, + 18, + 5, + 27, + 6, + 5, + 25, + 5, + 9, + 17, + 24, + 24, + 5, + 13, + 40, + 48, + 32, + 12, + 15, + 18, + 16, + 9, + 14, + 25, + 8, + 33, + 3, + 17, + 28, + 14, + 13, + 14, + 6, + 28, + 13, + 25, + 31, + 4, + 2, + 11, + 10, + 23, + 2, + 3, + 30, + 36, + 9, + 8, + 16, + 8, + 3 + ], + "weighted_loads": [ + 0.7689947411417961, + 0.10833084583282471, + 0.4496662002056837, + 0.46186684630811214, + 2.7677786629647017, + 0.06926693767309189, + 0.0, + 1.671766210347414, + 2.9533964321017265, + 0.34766585379838943, + 0.9676950126886368, + 0.10776429623365402, + 0.3770649954676628, + 0.0, + 1.0112998336553574, + 0.37480466440320015, + 1.4150214083492756, + 0.3151671998202801, + 0.3918399326503277, + 1.0439008548855782, + 0.18900278583168983, + 0.6184811387211084, + 0.8297696597874165, + 1.9912651553750038, + 1.4279585778713226, + 0.2098344899713993, + 0.5249776057898998, + 3.4572883509099483, + 5.094859000295401, + 3.2399851009249687, + 0.8963988600298762, + 0.719143757596612, + 1.146976662799716, + 0.9758895188570023, + 0.481612253934145, + 0.8627959936857224, + 1.3914205953478813, + 0.4231551392003894, + 1.967499129474163, + 0.2037782184779644, + 1.9989802613854408, + 1.8771653175354004, + 0.8199650347232819, + 0.7005007304251194, + 1.2497736476361752, + 0.39890347234904766, + 1.8279115185141563, + 0.6431419681757689, + 1.0852258242666721, + 1.5147396996617317, + 0.20812068320810795, + 0.09343797899782658, + 0.4883161596953869, + 0.6611249968409538, + 1.7245176769793034, + 0.09767095744609833, + 0.10275102779269218, + 1.3800259660929441, + 2.6448505222797394, + 0.37250581197440624, + 0.36829889565706253, + 0.9164173603057861, + 0.3640592657029629, + 0.10625367797911167 + ], + "unique_experts": 62, + "load_cv": 0.7330683779935113, + "normalized_load_entropy": 0.9338459378406336, + "max_load_share": 0.049689440993788817 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 120, + "ordered_topk_exact_tokens": 68, + "set_exact_tokens": 80, + "mean_set_jaccard": 0.9011904761904763, + "mean_token_weighted_tv": 0.021521846911249063, + "aggregate_load_tv": 0.033333333333333326 + }, + "system_bos": { + "tokens": 120, + "ordered_topk_exact_tokens": 64, + "set_exact_tokens": 86, + "mean_set_jaccard": 0.9119047619047619, + "mean_token_weighted_tv": 0.02151459492743015, + "aggregate_load_tv": 0.03194444444444445 + }, + "system_x": { + "tokens": 120, + "ordered_topk_exact_tokens": 56, + "set_exact_tokens": 69, + "mean_set_jaccard": 0.867857142857143, + "mean_token_weighted_tv": 0.030430223086538415, + "aggregate_load_tv": 0.043055555555555555 + }, + "system_period": { + "tokens": 120, + "ordered_topk_exact_tokens": 61, + "set_exact_tokens": 75, + "mean_set_jaccard": 0.8875000000000001, + "mean_token_weighted_tv": 0.02757242354564369, + "aggregate_load_tv": 0.03472222222222222 + }, + "bos_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 53, + "set_exact_tokens": 83, + "mean_set_jaccard": 0.9029761904761905, + "mean_token_weighted_tv": 0.024787971811989943, + "aggregate_load_tv": 0.03194444444444444 + }, + "bos_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 50, + "set_exact_tokens": 75, + "mean_set_jaccard": 0.8803571428571428, + "mean_token_weighted_tv": 0.028519211965613068, + "aggregate_load_tv": 0.03611111111111111 + }, + "x_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 56, + "set_exact_tokens": 75, + "mean_set_jaccard": 0.8843253968253968, + "mean_token_weighted_tv": 0.029416865079353254, + "aggregate_load_tv": 0.047222222222222214 + }, + "x_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 54, + "set_exact_tokens": 70, + "mean_set_jaccard": 0.8688492063492064, + "mean_token_weighted_tv": 0.0322742586179326, + "aggregate_load_tv": 0.037499999999999985 + }, + "period_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 53, + "set_exact_tokens": 70, + "mean_set_jaccard": 0.8706349206349207, + "mean_token_weighted_tv": 0.03083067797900488, + "aggregate_load_tv": 0.04722222222222222 + }, + "period_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 48, + "set_exact_tokens": 69, + "mean_set_jaccard": 0.8642857142857142, + "mean_token_weighted_tv": 0.03369995024986565, + "aggregate_load_tv": 0.04444444444444444 + } + } + }, + "layer_13": { + "layer": 13, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "5af5a265dcc5e9fbf41c7e6a9835ddba91007f9ace9bcec2875487a2daa5e767", + "route_weight_sha256": "3396b58920cdb4ecde63b8065dd591b94b0833bd29aaf02123d02ffd99c08d06", + "loads": [ + 5, + 12, + 13, + 12, + 12, + 18, + 8, + 16, + 2, + 1, + 22, + 7, + 15, + 8, + 17, + 3, + 7, + 7, + 26, + 5, + 11, + 9, + 7, + 11, + 15, + 23, + 13, + 14, + 41, + 9, + 3, + 3, + 1, + 18, + 8, + 5, + 15, + 15, + 2, + 6, + 5, + 2, + 17, + 41, + 25, + 12, + 0, + 14, + 5, + 12, + 13, + 8, + 17, + 7, + 11, + 8, + 9, + 1, + 5, + 19, + 1, + 17, + 9, + 17 + ], + "weighted_loads": [ + 0.22749486938118935, + 0.6040535531938076, + 0.5934939365833998, + 0.5172182656824589, + 0.6189575046300888, + 0.7555956169962883, + 0.30315944366157055, + 0.6104489248245955, + 0.09257937222719193, + 0.038848381489515305, + 0.9294166043400764, + 0.26136748120188713, + 0.790971826761961, + 0.2836858630180359, + 0.913969848304987, + 0.10313552618026733, + 0.2950558103621006, + 0.5200159307569265, + 1.426549982279539, + 0.20734649524092674, + 0.4767494313418865, + 0.4540189392864704, + 0.30615684390068054, + 1.2468126378953457, + 0.5549521166831255, + 1.8007517717778683, + 2.208237651735544, + 0.7393585592508316, + 1.8097730856388807, + 0.7109942808747292, + 0.1013352982699871, + 0.3663356937468052, + 0.04027189686894417, + 0.9392349775880575, + 0.7113810330629349, + 0.428392194211483, + 0.9692228622734547, + 0.871741272509098, + 0.103467658162117, + 0.43298662453889847, + 0.2336634248495102, + 0.06462992168962955, + 0.8633991647511721, + 2.2784292809665203, + 1.5293938517570496, + 0.7275439854711294, + 0.0, + 0.46647932939231396, + 0.351652966812253, + 0.6392466500401497, + 0.8569842539727688, + 0.3547006491571665, + 0.6937181670218706, + 0.25759108550846577, + 0.4693129137158394, + 0.46150341257452965, + 0.4032076597213745, + 0.03897889330983162, + 0.20055120065808296, + 1.0383953526616096, + 0.08371175080537796, + 1.0213909931480885, + 0.4621741287410259, + 0.8478227164596319 + ], + "unique_experts": 63, + "load_cv": 0.7274172134814626, + "normalized_load_entropy": 0.9397437323954585, + "max_load_share": 0.05694444444444444 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "c928206dedd648c95070d9bec79ddb29f45b10e4151ecc0f3d28fa9113a3ca3c", + "route_weight_sha256": "73d82e632a49ea09eaba309253721c246129e537313765618d856443a94523b5", + "loads": [ + 5, + 16, + 13, + 12, + 12, + 20, + 25, + 16, + 2, + 4, + 32, + 13, + 15, + 8, + 18, + 9, + 7, + 10, + 29, + 6, + 11, + 12, + 7, + 12, + 17, + 23, + 17, + 14, + 41, + 24, + 4, + 3, + 1, + 24, + 9, + 5, + 19, + 16, + 2, + 7, + 5, + 4, + 20, + 43, + 35, + 22, + 2, + 16, + 6, + 12, + 14, + 8, + 19, + 10, + 13, + 8, + 12, + 1, + 11, + 23, + 1, + 18, + 9, + 18 + ], + "weighted_loads": [ + 0.22749486938118935, + 0.78210230730474, + 0.5934939365833998, + 0.5172182656824589, + 0.6189575046300888, + 0.8181961476802826, + 1.7914326712489128, + 0.6104489248245955, + 0.09257937222719193, + 0.15202832780778408, + 1.614433640614152, + 0.5061700195074081, + 0.790971826761961, + 0.2836858630180359, + 0.9593979939818382, + 0.41692861542105675, + 0.2950558103621006, + 0.592217331752181, + 1.6805868931114674, + 0.25240346044301987, + 0.4767494313418865, + 0.5622541587799788, + 0.30615684390068054, + 1.2814305499196053, + 0.5837807604111731, + 1.8007517717778683, + 2.3632719106972218, + 0.7393585592508316, + 1.8097730856388807, + 1.5077877417206764, + 0.14433042705059052, + 0.3663356937468052, + 0.04027189686894417, + 1.375997019931674, + 0.7341989334672689, + 0.428392194211483, + 1.1939844507724047, + 0.9053934849798679, + 0.103467658162117, + 0.4662848077714443, + 0.2336634248495102, + 0.18520966358482838, + 1.018906844779849, + 2.3759185075759888, + 2.352903164923191, + 1.7125399205833673, + 0.06462200544774532, + 1.6584222000092268, + 0.3836976867169142, + 0.6392466500401497, + 0.8956006653606892, + 0.3547006491571665, + 0.7720348034054041, + 0.3959642741829157, + 0.5582843869924545, + 0.46150341257452965, + 0.5687517486512661, + 0.03897889330983162, + 0.47954479791224003, + 1.2446605898439884, + 0.08371175080537796, + 1.050027098506689, + 0.4621741287410259, + 0.8861334528774023 + ], + "unique_experts": 64, + "load_cv": 0.6781842972787259, + "normalized_load_entropy": 0.945956573915231, + "max_load_share": 0.04942528735632184 + } + }, + "s1_eos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "856e2c0e3ac12f0db1e233cf8a6593961af2335f8344f74f2bb9bade7898c088", + "route_weight_sha256": "6b11018faaeb3a068a497ff81e14d7038011058ff44fbc04f6ca045a399d8663", + "loads": [ + 6, + 13, + 12, + 11, + 16, + 16, + 8, + 17, + 2, + 4, + 20, + 4, + 16, + 9, + 16, + 4, + 6, + 7, + 26, + 3, + 7, + 9, + 5, + 11, + 9, + 23, + 14, + 13, + 39, + 12, + 3, + 3, + 0, + 18, + 6, + 5, + 15, + 16, + 2, + 6, + 6, + 2, + 22, + 41, + 27, + 12, + 0, + 15, + 5, + 11, + 15, + 12, + 18, + 10, + 9, + 8, + 9, + 1, + 5, + 19, + 2, + 17, + 9, + 13 + ], + "weighted_loads": [ + 0.2685641925781965, + 0.6052417475730181, + 0.5820313822478056, + 0.4949515052139759, + 0.869695758447051, + 0.6977199055254459, + 0.3174721300601959, + 0.6302457805722952, + 0.09718365222215652, + 0.13658487796783447, + 0.839984767138958, + 0.16144630685448647, + 0.82897062972188, + 0.30560876056551933, + 0.8776920195668936, + 0.1286307293921709, + 0.2606826312839985, + 0.49857572093605995, + 1.4388223215937614, + 0.0995589941740036, + 0.3437028340995312, + 0.4426335543394089, + 0.22125902771949768, + 1.2169413566589355, + 0.3713454622775316, + 1.7640180513262749, + 2.4210164304822683, + 0.6924972552806139, + 1.759258421137929, + 0.814303033053875, + 0.10277897864580154, + 0.3557824566960335, + 0.0, + 0.9349484164267778, + 0.6365483589470387, + 0.41335326060652733, + 1.0314976163208485, + 0.891766170039773, + 0.10096630081534386, + 0.4310961216688156, + 0.24974416196346283, + 0.06051182374358177, + 1.049338947981596, + 2.233521644026041, + 1.6371418088674545, + 0.7177703753113747, + 0.0, + 0.492214260622859, + 0.31813104823231697, + 0.6527815386652946, + 1.0574104152619839, + 0.5515538603067398, + 0.7147085666656494, + 0.3614371493458748, + 0.378388486802578, + 0.4576673712581396, + 0.42691026255488396, + 0.040984731167554855, + 0.1937501784414053, + 1.0663460958749056, + 0.1132214218378067, + 1.0139690842479467, + 0.4509669356048107, + 0.6802573073655367 + ], + "unique_experts": 62, + "load_cv": 0.727586913055329, + "normalized_load_entropy": 0.9392918833253696, + "max_load_share": 0.05694444444444444 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "866da61d765fc0c36d64a5bc4cfc02856b00e2723f4943f3590cedb8fcf3f065", + "route_weight_sha256": "76b429da2457d37042c5e633bce956a85990e16115da561c6dace70ecc2ffbef", + "loads": [ + 11, + 17, + 12, + 11, + 16, + 18, + 36, + 17, + 2, + 7, + 30, + 18, + 16, + 9, + 17, + 11, + 6, + 10, + 30, + 7, + 7, + 14, + 5, + 16, + 12, + 23, + 18, + 13, + 39, + 30, + 11, + 4, + 0, + 28, + 9, + 6, + 20, + 17, + 3, + 8, + 7, + 8, + 31, + 43, + 43, + 23, + 2, + 18, + 7, + 15, + 16, + 12, + 20, + 12, + 11, + 10, + 12, + 12, + 12, + 23, + 3, + 19, + 9, + 14 + ], + "weighted_loads": [ + 0.46961636282503605, + 0.8099686820060015, + 0.5820313822478056, + 0.4949515052139759, + 0.869695758447051, + 0.7670201770961285, + 2.6753826066851616, + 0.6302457805722952, + 0.09718365222215652, + 0.27910985983908176, + 1.5167713053524494, + 0.9863987239077687, + 0.82897062972188, + 0.30560876056551933, + 0.9211261961609125, + 0.5103527028113604, + 0.2606826312839985, + 0.582670196890831, + 1.7241579852998257, + 0.2548851892352104, + 0.3437028340995312, + 0.6695149466395378, + 0.22125902771949768, + 1.4102033749222755, + 0.4462515483610332, + 1.7640180513262749, + 2.580318946391344, + 0.6924972552806139, + 1.759258421137929, + 2.219345051795244, + 0.5515238121151924, + 0.396709430962801, + 0.0, + 1.8132535684853792, + 0.8609763290733099, + 0.46750830486416817, + 1.3425658289343119, + 0.925131494179368, + 0.14327051118016243, + 0.511411976069212, + 0.2954569607973099, + 0.33805640414357185, + 1.7623561657965183, + 2.344396848231554, + 2.9044725447893143, + 1.6872664541006088, + 0.0760125033557415, + 1.7225109953433275, + 0.568746168166399, + 0.8570123352110386, + 1.0928907357156277, + 0.5515538603067398, + 0.7861067578196526, + 0.44140951707959175, + 0.4497038498520851, + 0.5284451488405466, + 0.584135364741087, + 0.7491213567554951, + 0.511073112487793, + 1.2629576046019793, + 0.14201884157955647, + 1.0961698796600103, + 0.4509669356048107, + 0.7329948712140322 + ], + "unique_experts": 63, + "load_cv": 0.639208597916215, + "normalized_load_entropy": 0.9528963812494825, + "max_load_share": 0.044513457556935816 + } + }, + "s0_bos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "97a0eca7699bde5ac83ec346ccc050906af6b02c64993c9e8c3096fe8f060f93", + "route_weight_sha256": "8cb57e7cba7b6cf3b38fb18e82721c41165a31779bd20f2fda777c29c7a18f46", + "loads": [ + 6, + 12, + 14, + 9, + 16, + 17, + 8, + 16, + 2, + 6, + 22, + 4, + 17, + 8, + 16, + 2, + 10, + 5, + 25, + 3, + 7, + 9, + 4, + 13, + 17, + 23, + 12, + 14, + 37, + 11, + 1, + 3, + 1, + 21, + 7, + 6, + 15, + 15, + 2, + 6, + 5, + 1, + 18, + 37, + 26, + 12, + 0, + 12, + 6, + 11, + 15, + 10, + 19, + 11, + 9, + 8, + 7, + 1, + 5, + 20, + 2, + 17, + 9, + 17 + ], + "weighted_loads": [ + 0.2693061586469412, + 0.6377247460186481, + 0.600134527310729, + 0.39773354306817055, + 0.7997229006141424, + 0.777094142511487, + 0.38087688758969307, + 0.6328877490013838, + 0.10206795483827591, + 0.2013687826693058, + 0.9688561093062162, + 0.1653173640370369, + 0.8469038493931293, + 0.2791956290602684, + 0.8877118937671185, + 0.06822893396019936, + 0.41132597625255585, + 0.4342352841049433, + 1.3183178417384624, + 0.11726922541856766, + 0.3263653740286827, + 0.46233562752604485, + 0.19711918756365776, + 1.3164562117308378, + 0.6342140566557646, + 1.849278051406145, + 2.2848131209611893, + 0.7447272408753633, + 1.754190281033516, + 0.6963583715260029, + 0.04772774875164032, + 0.3864006884396076, + 0.04409455135464668, + 1.0895516108721495, + 0.7315591536462307, + 0.4551267810165882, + 1.0054938849061728, + 0.8674175422638655, + 0.11448118835687637, + 0.441215593367815, + 0.24432793632149696, + 0.037510648369789124, + 0.9394872896373272, + 2.2525085266679525, + 1.5280739180743694, + 0.7304130904376507, + 0.0, + 0.4021895658224821, + 0.386696295812726, + 0.6600093245506287, + 1.036106899380684, + 0.4730945751070976, + 0.8243514150381088, + 0.3983542136847973, + 0.4103822037577629, + 0.48080727830529213, + 0.34876324236392975, + 0.038443248718976974, + 0.16450577229261398, + 1.1450369209051132, + 0.11783676594495773, + 1.0336070768535137, + 0.46702586114406586, + 0.8506931141018867 + ], + "unique_experts": 63, + "load_cv": 0.707455883543627, + "normalized_load_entropy": 0.9398466479291798, + "max_load_share": 0.05138888888888889 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "dbd1e08ff32e58e770c949f68287302c5bb8b47b7d3d386fbd10a7e01548cd1a", + "route_weight_sha256": "550a5940dd1fd4e4a471c2cefb4b08e1ff7aeb50adc57c05be28916a2f6066b0", + "loads": [ + 6, + 16, + 15, + 9, + 17, + 20, + 25, + 16, + 2, + 11, + 31, + 8, + 17, + 8, + 16, + 8, + 10, + 6, + 28, + 4, + 7, + 11, + 4, + 15, + 18, + 23, + 16, + 14, + 37, + 25, + 2, + 3, + 1, + 25, + 8, + 6, + 19, + 16, + 2, + 7, + 5, + 3, + 21, + 40, + 36, + 23, + 2, + 13, + 7, + 11, + 16, + 10, + 21, + 15, + 12, + 8, + 11, + 1, + 12, + 24, + 2, + 18, + 9, + 18 + ], + "weighted_loads": [ + 0.2693061586469412, + 0.8335260041058064, + 0.6714525353163481, + 0.39773354306817055, + 0.8507755007594824, + 0.8625787496566772, + 1.9311778601258993, + 0.6328877490013838, + 0.10206795483827591, + 0.43572661094367504, + 1.5309338606894016, + 0.35632708109915257, + 0.8469038493931293, + 0.2791956290602684, + 0.8877118937671185, + 0.38202202320098877, + 0.41132597625255585, + 0.46890379674732685, + 1.5613036789000034, + 0.16232619062066078, + 0.3263653740286827, + 0.5279342513531446, + 0.19711918756365776, + 1.3983595538884401, + 0.6573503408581018, + 1.849278051406145, + 2.439847379922867, + 0.7447272408753633, + 1.754190281033516, + 1.4426506906747818, + 0.09532293677330017, + 0.3864006884396076, + 0.04409455135464668, + 1.436764782294631, + 0.7543770540505648, + 0.4551267810165882, + 1.2354798130691051, + 0.9010697547346354, + 0.11448118835687637, + 0.47451377660036087, + 0.24432793632149696, + 0.1468891017138958, + 1.1098922602832317, + 2.43182528950274, + 2.39222127571702, + 1.7536502853035927, + 0.06462200544774532, + 0.7632962595671415, + 0.4187410157173872, + 0.6600093245506287, + 1.0747233107686043, + 0.4730945751070976, + 0.9026680514216423, + 0.6006998904049397, + 0.5374483726918697, + 0.48080727830529213, + 0.6286281086504459, + 0.038443248718976974, + 0.4835302550345659, + 1.351302158087492, + 0.11783676594495773, + 1.0622431822121143, + 0.46702586114406586, + 0.8890038505196571 + ], + "unique_experts": 64, + "load_cv": 0.6673757624038753, + "normalized_load_entropy": 0.9459284359660447, + "max_load_share": 0.04597701149425287 + } + }, + "s1_bos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "d6095704ebceac37c15e8a245f49909f8a55d513419fc1de82f26931e82c4924", + "route_weight_sha256": "7ec086c9cacd3edcdab6cebe1f581ea78854be3256c3489358440fb9086b954f", + "loads": [ + 6, + 11, + 10, + 10, + 17, + 17, + 12, + 18, + 2, + 5, + 22, + 4, + 14, + 9, + 17, + 1, + 8, + 6, + 22, + 1, + 6, + 9, + 5, + 12, + 14, + 23, + 12, + 13, + 41, + 14, + 3, + 3, + 1, + 20, + 6, + 6, + 15, + 16, + 2, + 7, + 5, + 1, + 21, + 42, + 26, + 11, + 0, + 10, + 7, + 13, + 15, + 10, + 18, + 7, + 9, + 8, + 9, + 1, + 5, + 21, + 2, + 17, + 9, + 13 + ], + "weighted_loads": [ + 0.281067181378603, + 0.5806541852653027, + 0.4797211643308401, + 0.45828530192375183, + 0.9491938967257738, + 0.763926163315773, + 0.46037086099386215, + 0.6917777024209499, + 0.10370872914791107, + 0.17554385773837566, + 0.9297459181398153, + 0.1582367978990078, + 0.7424960248172283, + 0.318920586258173, + 0.9390228874981403, + 0.033924348652362823, + 0.3427827786654234, + 0.4562116917222738, + 1.244853438809514, + 0.032015517354011536, + 0.2977660894393921, + 0.4392644427716732, + 0.23490753769874573, + 1.3137719295918941, + 0.5379560608416796, + 1.7848685942590237, + 2.29436819255352, + 0.7001215722411871, + 1.9043050203472376, + 0.7807402536273003, + 0.09811855480074883, + 0.35011250898241997, + 0.04364561662077904, + 1.0405408386141062, + 0.6844318136572838, + 0.44948361441493034, + 0.995554968714714, + 0.913144189864397, + 0.11657391116023064, + 0.48136141896247864, + 0.23256304673850536, + 0.0341341607272625, + 1.0308283735066652, + 2.485763266682625, + 1.5983705557882786, + 0.6997092962265015, + 0.0, + 0.34064807556569576, + 0.3733016047626734, + 0.7401049807667732, + 1.0709191001951694, + 0.4580036345869303, + 0.7448639385402203, + 0.26388463377952576, + 0.3818244803696871, + 0.47694335132837296, + 0.4441089779138565, + 0.03627758473157883, + 0.17348443903028965, + 1.1696849707514048, + 0.11935580894351006, + 1.017238076776266, + 0.45968688279390335, + 0.698338346555829 + ], + "unique_experts": 63, + "load_cv": 0.744527358566709, + "normalized_load_entropy": 0.9365680361651431, + "max_load_share": 0.058333333333333334 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "9a65e53044993376c8a49fee7652f533cdf397b4ba30f4cdc593f4b4f1952be8", + "route_weight_sha256": "7b9b095c8e781684a3af64673abfd04827da57a557bc0201320e37e169f234e9", + "loads": [ + 11, + 16, + 11, + 10, + 17, + 20, + 40, + 18, + 2, + 9, + 33, + 15, + 14, + 9, + 17, + 8, + 8, + 8, + 26, + 5, + 6, + 14, + 5, + 16, + 17, + 23, + 16, + 13, + 41, + 32, + 11, + 4, + 1, + 30, + 9, + 7, + 21, + 17, + 3, + 9, + 6, + 6, + 30, + 44, + 42, + 23, + 2, + 12, + 9, + 17, + 16, + 10, + 20, + 9, + 11, + 10, + 13, + 12, + 12, + 25, + 3, + 19, + 9, + 14 + ], + "weighted_loads": [ + 0.4821193516254425, + 0.8385561108589172, + 0.5282646920531988, + 0.45828530192375183, + 0.9491938967257738, + 0.8561418857425451, + 2.913045357912779, + 0.6917777024209499, + 0.10370872914791107, + 0.37586311250925064, + 1.643725549802184, + 0.9133400116115808, + 0.7424960248172283, + 0.318920586258173, + 0.9390228874981403, + 0.4156463220715523, + 0.3427827786654234, + 0.526623846963048, + 1.5201006773859262, + 0.18734171241521835, + 0.2977660894393921, + 0.6638590022921562, + 0.23490753769874573, + 1.4723236374557018, + 0.662635887041688, + 1.7848685942590237, + 2.453670708462596, + 0.7001215722411871, + 1.9043050203472376, + 2.2095285281538963, + 0.5490186996757984, + 0.39103948324918747, + 0.04364561662077904, + 1.9156991261988878, + 0.908859783783555, + 0.5036386586725712, + 1.369529152289033, + 0.9465095140039921, + 0.1588781215250492, + 0.561677273362875, + 0.2782758455723524, + 0.2726319804787636, + 1.7646004389971495, + 2.603289667516947, + 2.8933183290064335, + 1.7143335416913033, + 0.0760125033557415, + 0.741108501330018, + 0.6239167246967554, + 0.9443357773125172, + 1.1063994206488132, + 0.4580036345869303, + 0.8162621296942234, + 0.3438570015132427, + 0.4531398434191942, + 0.54772112891078, + 0.6415501683950424, + 0.744414210319519, + 0.4732155613601208, + 1.3662964794784784, + 0.14815322868525982, + 1.0994388721883297, + 0.45968688279390335, + 0.7510759104043245 + ], + "unique_experts": 64, + "load_cv": 0.6647703957192506, + "normalized_load_entropy": 0.9505953321300838, + "max_load_share": 0.045548654244306416 + } + }, + "s0_x": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "ce969427d567439c32d42b721853e9b9e8f8e247ab2d50bfc9e20ac726260c5e", + "route_weight_sha256": "e3602f6ac29b099f8427dd1f2fd5a631dddea90edc7100daf35196d43af82868", + "loads": [ + 6, + 13, + 11, + 10, + 14, + 16, + 7, + 16, + 4, + 5, + 22, + 4, + 15, + 8, + 16, + 3, + 11, + 6, + 26, + 3, + 5, + 10, + 5, + 13, + 17, + 24, + 12, + 13, + 38, + 13, + 3, + 3, + 1, + 20, + 6, + 7, + 15, + 16, + 2, + 6, + 6, + 2, + 19, + 35, + 26, + 11, + 0, + 10, + 6, + 12, + 13, + 10, + 18, + 8, + 9, + 7, + 10, + 1, + 6, + 19, + 2, + 17, + 10, + 18 + ], + "weighted_loads": [ + 0.2830009628087282, + 0.7031051553785801, + 0.49084980227053165, + 0.42942509055137634, + 0.6997170317918062, + 0.713805491104722, + 0.24773222766816616, + 0.6407816912978888, + 0.1794080212712288, + 0.15613054484128952, + 0.946873027831316, + 0.1627579964697361, + 0.8114072382450104, + 0.28003629483282566, + 0.9068717919290066, + 0.10373633727431297, + 0.45389004796743393, + 0.5011768359690905, + 1.4557625576853752, + 0.11453744396567345, + 0.24004748463630676, + 0.5198716297745705, + 0.23210356757044792, + 1.3630326502025127, + 0.6263473890721798, + 1.952613327652216, + 2.1808379739522934, + 0.6977822072803974, + 1.7009163815528154, + 0.7400119639933109, + 0.10665910132229328, + 0.3913428336381912, + 0.04064580053091049, + 1.132252337411046, + 0.7110390644520521, + 0.48454628698527813, + 1.0027612932026386, + 0.8823154084384441, + 0.11329096183180809, + 0.45329244434833527, + 0.2706895787268877, + 0.06942209973931313, + 0.9743168372660875, + 2.0819039326161146, + 1.642267121002078, + 0.6877037901431322, + 0.0, + 0.3430566396564245, + 0.397065045312047, + 0.7059908304363489, + 0.8771524950861931, + 0.4767284356057644, + 0.7417954187840223, + 0.2842095196247101, + 0.4192710258066654, + 0.4606447070837021, + 0.48337286338210106, + 0.03933523967862129, + 0.20475110225379467, + 1.1671476922929287, + 0.1207653172314167, + 1.0602042488753796, + 0.5055115185678005, + 0.893780954182148 + ], + "unique_experts": 63, + "load_cv": 0.6903210918670696, + "normalized_load_entropy": 0.9442622224072863, + "max_load_share": 0.05277777777777778 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "6bd6fc2313823914d7f6b1cf6a042a366ef4782dc2a4ae961449a5f82135ee6b", + "route_weight_sha256": "7316904379c2803b61c3f05a9ebebf79fab622e51dfaa1d0578045b836be3e91", + "loads": [ + 6, + 16, + 11, + 10, + 14, + 18, + 24, + 16, + 4, + 7, + 32, + 9, + 15, + 8, + 16, + 10, + 11, + 8, + 29, + 4, + 5, + 12, + 5, + 15, + 20, + 24, + 16, + 13, + 38, + 27, + 4, + 3, + 1, + 26, + 7, + 7, + 19, + 17, + 2, + 7, + 6, + 4, + 22, + 36, + 38, + 23, + 3, + 11, + 7, + 12, + 14, + 10, + 20, + 11, + 11, + 7, + 14, + 1, + 12, + 23, + 2, + 18, + 10, + 19 + ], + "weighted_loads": [ + 0.2830009628087282, + 0.8279535993933678, + 0.49084980227053165, + 0.42942509055137634, + 0.6997170317918062, + 0.7764060217887163, + 1.7010896764695644, + 0.6407816912978888, + 0.1794080212712288, + 0.23191755078732967, + 1.5230898801237345, + 0.42104764841496944, + 0.8114072382450104, + 0.28003629483282566, + 0.9068717919290066, + 0.6355045363306999, + 0.45389004796743393, + 0.5571680050343275, + 1.713270466774702, + 0.15959440916776657, + 0.24004748463630676, + 0.5879314485937357, + 0.23210356757044792, + 1.4434268772602081, + 0.740147553384304, + 1.952613327652216, + 2.335872232913971, + 0.6977822072803974, + 1.7009163815528154, + 1.4916686452925205, + 0.15657893382012844, + 0.3913428336381912, + 0.04064580053091049, + 1.5974037889391184, + 0.7338569648563862, + 0.48454628698527813, + 1.2307636756449938, + 0.915967620909214, + 0.11329096183180809, + 0.4865906275808811, + 0.2706895787268877, + 0.1873362772166729, + 1.1160584967583418, + 2.126943903043866, + 2.6410637740045786, + 1.9120926801115274, + 0.09344248846173286, + 0.704163333401084, + 0.4291097652167082, + 0.7059908304363489, + 0.9157689064741135, + 0.4767284356057644, + 0.8201120551675558, + 0.42258270829916, + 0.5082424990832806, + 0.4606447070837021, + 0.6798381041735411, + 0.03933523967862129, + 0.47484077140688896, + 1.3734129294753075, + 0.1207653172314167, + 1.0888403542339802, + 0.5055115185678005, + 0.9320916905999184 + ], + "unique_experts": 64, + "load_cv": 0.6608825576859384, + "normalized_load_entropy": 0.9485093628384907, + "max_load_share": 0.04367816091954023 + } + }, + "s1_x": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "e6b9b17a7dd5e83054cf266c73415b99f47554831a6feba773f3bdb8c9c31ee3", + "route_weight_sha256": "9fba195b85d80d102bd1f42e60a33a69bd54a8fbd6a9d6ad865adb73f57c3782", + "loads": [ + 5, + 11, + 10, + 11, + 16, + 15, + 11, + 18, + 4, + 6, + 19, + 4, + 15, + 9, + 16, + 3, + 7, + 7, + 26, + 1, + 5, + 10, + 5, + 12, + 16, + 24, + 12, + 13, + 40, + 14, + 3, + 3, + 1, + 21, + 6, + 6, + 15, + 16, + 2, + 7, + 5, + 1, + 18, + 37, + 30, + 11, + 0, + 10, + 7, + 14, + 13, + 12, + 14, + 8, + 8, + 8, + 10, + 1, + 5, + 21, + 2, + 17, + 9, + 14 + ], + "weighted_loads": [ + 0.23640147224068642, + 0.5731570105999708, + 0.4660562239587307, + 0.501822043210268, + 0.8816595748066902, + 0.6726798806339502, + 0.37282031029462814, + 0.7049146611243486, + 0.18803779408335686, + 0.1937361489981413, + 0.7963280491530895, + 0.1640770435333252, + 0.8070034738630056, + 0.3024568445980549, + 0.8960750065743923, + 0.09648670628666878, + 0.3054687827825546, + 0.5454255901277065, + 1.524654434993863, + 0.031076306477189064, + 0.23090815171599388, + 0.4765484370291233, + 0.23048484325408936, + 1.2821500040590763, + 0.5854072142392397, + 1.8663366921246052, + 2.2172688581049442, + 0.6879656780511141, + 1.762996133416891, + 0.7280868645757437, + 0.10627331770956516, + 0.33092212677001953, + 0.04022400826215744, + 1.0898515116423368, + 0.6461826134473085, + 0.43071578070521355, + 1.0109197497367859, + 0.8996001128107309, + 0.11100993305444717, + 0.4865637347102165, + 0.231418889015913, + 0.03374909982085228, + 0.9367788229137659, + 2.161511890590191, + 1.8887569233775139, + 0.6939150243997574, + 0.0, + 0.3359867073595524, + 0.3599731922149658, + 0.8061877600848675, + 0.9463017731904984, + 0.5616929195821285, + 0.5692004691809416, + 0.2914915569126606, + 0.3537744991481304, + 0.485587190836668, + 0.49634382501244545, + 0.04346210137009621, + 0.1800321228802204, + 1.1978304646909237, + 0.11586684733629227, + 1.0318388566374779, + 0.4468563497066498, + 0.7090159244835377 + ], + "unique_experts": 63, + "load_cv": 0.7193961802772731, + "normalized_load_entropy": 0.9403627383622798, + "max_load_share": 0.05555555555555555 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "e7800d93b2d15878c257d6624646d40019fef89bc2011f00262a99649abe089b", + "route_weight_sha256": "d3fd78aaa63aefb55af3d362f31d28d8183e7f0af383eb068a4f0711e540525c", + "loads": [ + 10, + 14, + 10, + 11, + 16, + 17, + 38, + 18, + 4, + 7, + 28, + 16, + 15, + 9, + 16, + 11, + 7, + 9, + 30, + 5, + 5, + 16, + 5, + 17, + 21, + 24, + 17, + 13, + 40, + 32, + 11, + 4, + 1, + 33, + 9, + 7, + 21, + 17, + 3, + 9, + 6, + 7, + 27, + 37, + 48, + 23, + 3, + 12, + 9, + 18, + 14, + 12, + 16, + 10, + 10, + 11, + 13, + 13, + 9, + 25, + 3, + 20, + 9, + 15 + ], + "weighted_loads": [ + 0.43745364248752594, + 0.7279484551399946, + 0.4660562239587307, + 0.501822043210268, + 0.8816595748066902, + 0.7419801522046328, + 2.5887779109179974, + 0.7049146611243486, + 0.18803779408335686, + 0.224333506077528, + 1.366872925311327, + 0.9412051141262054, + 0.8070034738630056, + 0.3024568445980549, + 0.8960750065743923, + 0.6186970360577106, + 0.3054687827825546, + 0.6158377453684807, + 1.8139931131154299, + 0.18640250153839588, + 0.23090815171599388, + 0.7350876852869987, + 0.23048484325408936, + 1.467231186106801, + 0.7776998486369848, + 1.8663366921246052, + 2.409614445641637, + 0.6879656780511141, + 1.762996133416891, + 2.1202158089727163, + 0.5690568890422583, + 0.37184910103678703, + 0.04022400826215744, + 2.0957423467189074, + 0.8706105835735798, + 0.4848708249628544, + 1.3486127723008394, + 0.932965436950326, + 0.15331414341926575, + 0.5668795891106129, + 0.27713168784976006, + 0.30831169337034225, + 1.645532900467515, + 2.161511890590191, + 3.3420740254223347, + 1.8064310476183891, + 0.12004737183451653, + 0.7364471331238747, + 0.6105883121490479, + 1.0104185566306114, + 0.9817820936441422, + 0.5616929195821285, + 0.6405986603349447, + 0.37146392464637756, + 0.42508986219763756, + 0.5987768806517124, + 0.6535689271986485, + 0.7857041992247105, + 0.31704585812985897, + 1.3944419734179974, + 0.14466426707804203, + 1.1495431140065193, + 0.4468563497066498, + 0.7617534883320332 + ], + "unique_experts": 64, + "load_cv": 0.6527980187718212, + "normalized_load_entropy": 0.9526604250641477, + "max_load_share": 0.049689440993788817 + } + }, + "s0_period": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "bd01ae258a7c74e9962a4d9d5589f5fff8bb096b5c201d4e2d94501ae494f675", + "route_weight_sha256": "4aa9ed1b424607219e0dc13042c29240e01812659808d1947698133a242faae0", + "loads": [ + 6, + 14, + 11, + 10, + 14, + 15, + 10, + 17, + 4, + 6, + 22, + 4, + 16, + 7, + 17, + 3, + 11, + 5, + 26, + 3, + 5, + 10, + 5, + 14, + 17, + 24, + 12, + 12, + 37, + 14, + 2, + 3, + 1, + 20, + 7, + 7, + 14, + 15, + 2, + 6, + 5, + 2, + 18, + 33, + 27, + 12, + 0, + 11, + 5, + 12, + 13, + 9, + 16, + 11, + 9, + 7, + 11, + 1, + 4, + 20, + 2, + 17, + 10, + 17 + ], + "weighted_loads": [ + 0.28151787258684635, + 0.7034935746341944, + 0.48705198988318443, + 0.42273862659931183, + 0.7003327514976263, + 0.6760206203907728, + 0.3596935123205185, + 0.6752369999885559, + 0.17451117932796478, + 0.1977142132818699, + 0.9348318353295326, + 0.15987267717719078, + 0.850744966417551, + 0.23805276677012444, + 0.9308791235089302, + 0.10445095971226692, + 0.46059458516538143, + 0.46700746938586235, + 1.456622725352645, + 0.11360139027237892, + 0.24795542657375336, + 0.5141782537102699, + 0.23620472475886345, + 1.3762919083237648, + 0.6397156193852425, + 1.9211203642189503, + 2.2069981321692467, + 0.648635745048523, + 1.6276828274130821, + 0.8681071437895298, + 0.07761822082102299, + 0.3790193945169449, + 0.04180004075169563, + 1.1209478788077831, + 0.7491745334118605, + 0.49471766129136086, + 0.9816860817372799, + 0.8607307244092226, + 0.11306997016072273, + 0.4515131562948227, + 0.24593142978847027, + 0.06854132562875748, + 0.9392396509647369, + 1.9739267565310001, + 1.688334109261632, + 0.7209986466914415, + 0.0, + 0.37072058767080307, + 0.3470451571047306, + 0.7071528751403093, + 0.8856869041919708, + 0.4157482050359249, + 0.6609206087887287, + 0.39209899492561817, + 0.4156915917992592, + 0.45587160997092724, + 0.5312643125653267, + 0.0377504825592041, + 0.1376013532280922, + 1.2089489940553904, + 0.11832575500011444, + 1.052695918828249, + 0.5017194412648678, + 0.850835045799613 + ], + "unique_experts": 63, + "load_cv": 0.6820448556987914, + "normalized_load_entropy": 0.944271116520048, + "max_load_share": 0.05138888888888889 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "12ea030ed30f9570ca1fa999dce295c6c3c6aebd1aeaf1db2449d652d468e194", + "route_weight_sha256": "e05e5c67bcff809b1828db8c8fa3da53e6733c997787c4215c291efddc18eb6c", + "loads": [ + 6, + 18, + 11, + 10, + 14, + 17, + 26, + 17, + 4, + 9, + 31, + 9, + 16, + 7, + 18, + 9, + 11, + 7, + 30, + 4, + 5, + 12, + 5, + 16, + 20, + 24, + 16, + 12, + 37, + 29, + 3, + 3, + 1, + 26, + 8, + 7, + 19, + 16, + 2, + 7, + 5, + 5, + 20, + 35, + 38, + 23, + 2, + 12, + 6, + 12, + 14, + 9, + 18, + 14, + 11, + 7, + 14, + 1, + 10, + 24, + 2, + 18, + 10, + 18 + ], + "weighted_loads": [ + 0.28151787258684635, + 1.0132294483482838, + 0.48705198988318443, + 0.42273862659931183, + 0.7003327514976263, + 0.7386211510747671, + 1.8250789884477854, + 0.6752369999885559, + 0.17451117932796478, + 0.3300941865891218, + 1.5376715417951345, + 0.4231759961694479, + 0.850744966417551, + 0.23805276677012444, + 0.962674044072628, + 0.41824404895305634, + 0.46059458516538143, + 0.5232179425656796, + 1.7351599521934986, + 0.15865835547447205, + 0.24795542657375336, + 0.5799369346350431, + 0.23620472475886345, + 1.452994741499424, + 0.8328118361532688, + 1.9211203642189503, + 2.3620323911309242, + 0.648635745048523, + 1.6276828274130821, + 1.674232255667448, + 0.12541685439646244, + 0.3790193945169449, + 0.04180004075169563, + 1.575703252106905, + 0.7719924338161945, + 0.49471766129136086, + 1.2684326637536287, + 0.8943829368799925, + 0.11306997016072273, + 0.48481133952736855, + 0.24593142978847027, + 0.23003292828798294, + 1.0297769233584404, + 2.0895640328526497, + 2.6186422798782587, + 1.7456575836986303, + 0.06462200544774532, + 0.7318272814154625, + 0.3790898770093918, + 0.7071528751403093, + 0.9243033155798912, + 0.4157482050359249, + 0.7392372451722622, + 0.5304721836000681, + 0.5046630650758743, + 0.45587160997092724, + 0.6968084014952183, + 0.0377504825592041, + 0.39876540936529636, + 1.4152142312377691, + 0.11832575500011444, + 1.0813320241868496, + 0.5017194412648678, + 0.8891457822173834 + ], + "unique_experts": 64, + "load_cv": 0.6644553098335653, + "normalized_load_entropy": 0.9473610366173532, + "max_load_share": 0.04367816091954023 + } + }, + "s1_period": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "a99717209003183068f136a497983bfad74f93c12d839c42efc7075bd02c4794", + "route_weight_sha256": "8bcca2d984e1ecd8aa763cddafcc028d6e13d731a68c1a0fc12a96637f08ca6b", + "loads": [ + 5, + 13, + 11, + 11, + 15, + 13, + 9, + 18, + 4, + 4, + 20, + 3, + 15, + 9, + 16, + 3, + 8, + 8, + 28, + 1, + 5, + 9, + 5, + 13, + 17, + 23, + 12, + 13, + 36, + 15, + 3, + 3, + 1, + 21, + 7, + 6, + 15, + 16, + 2, + 7, + 5, + 1, + 18, + 36, + 29, + 11, + 0, + 12, + 7, + 14, + 13, + 11, + 14, + 9, + 9, + 8, + 12, + 2, + 5, + 20, + 2, + 17, + 9, + 13 + ], + "weighted_loads": [ + 0.23746316507458687, + 0.6202776879072189, + 0.494093319401145, + 0.5024133399128914, + 0.8552416153252125, + 0.5865398216992617, + 0.3293579053133726, + 0.7002915367484093, + 0.1834482178092003, + 0.13471565395593643, + 0.7969367280602455, + 0.1284487396478653, + 0.794394962489605, + 0.30240994691848755, + 0.913035100325942, + 0.0947529524564743, + 0.3326662667095661, + 0.5814154520630836, + 1.5874888245016336, + 0.0299090463668108, + 0.2304931841790676, + 0.42415226995944977, + 0.22770104557275772, + 1.2686921060085297, + 0.6194740384817123, + 1.8571247197687626, + 2.230270303785801, + 0.6656965892761946, + 1.605543041601777, + 0.7839368171989918, + 0.10924961976706982, + 0.34152908995747566, + 0.04024570807814598, + 1.0927573274821043, + 0.6852193232625723, + 0.44129665195941925, + 1.0337247401475906, + 0.9009344261139631, + 0.1125626377761364, + 0.4904883988201618, + 0.2294889185577631, + 0.031082607805728912, + 0.9689577110111713, + 2.1021507270634174, + 1.8590226285159588, + 0.7005321308970451, + 0.0, + 0.39270535483956337, + 0.35172597505152225, + 0.7954165209084749, + 0.9185712710022926, + 0.5201699584722519, + 0.5645717456936836, + 0.3268940057605505, + 0.37824069149792194, + 0.47915564849972725, + 0.577917318791151, + 0.06853702664375305, + 0.1764924582093954, + 1.1807895973324776, + 0.11267346516251564, + 1.04386804997921, + 0.44971799850463867, + 0.68887759745121 + ], + "unique_experts": 63, + "load_cv": 0.6953105709849784, + "normalized_load_entropy": 0.9427148721338475, + "max_load_share": 0.05 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "37fa75644349cad9a47f9d6629f2648626037a25bd1b9e73c167516620cd33bd", + "route_weight_sha256": "30dbfc7a455e05f11a1db0f0e5dc557026109e23953106592a10d4520775fe99", + "loads": [ + 10, + 18, + 11, + 11, + 15, + 15, + 37, + 18, + 4, + 5, + 29, + 14, + 15, + 9, + 16, + 10, + 8, + 10, + 32, + 5, + 5, + 14, + 5, + 18, + 21, + 23, + 16, + 13, + 36, + 35, + 11, + 4, + 1, + 34, + 10, + 7, + 21, + 17, + 3, + 9, + 6, + 7, + 26, + 37, + 47, + 23, + 2, + 14, + 9, + 18, + 14, + 11, + 16, + 11, + 11, + 10, + 15, + 13, + 11, + 24, + 3, + 20, + 9, + 14 + ], + "weighted_loads": [ + 0.4385153353214264, + 0.9885248187929392, + 0.494093319401145, + 0.5024133399128914, + 0.8552416153252125, + 0.6558400932699442, + 2.5186288077384233, + 0.7002915367484093, + 0.1834482178092003, + 0.16531301103532314, + 1.410060029476881, + 0.887877045199275, + 0.794394962489605, + 0.30240994691848755, + 0.913035100325942, + 0.47647492587566376, + 0.3326662667095661, + 0.6518276073038578, + 1.8659391272813082, + 0.18523524142801762, + 0.2304931841790676, + 0.642080033197999, + 0.22770104557275772, + 1.4579002931714058, + 0.8699638843536377, + 1.8571247197687626, + 2.3895728196948767, + 0.6656965892761946, + 1.605543041601777, + 2.270150661468506, + 0.5654169600456953, + 0.38245606422424316, + 0.04024570807814598, + 2.1472447123378515, + 0.9096472933888435, + 0.4954516962170601, + 1.407229458913207, + 0.9342997502535582, + 0.15486684814095497, + 0.5708042532205582, + 0.27520171739161015, + 0.3048809766769409, + 1.6236392743885517, + 2.138541106134653, + 3.2847675420343876, + 1.7046638615429401, + 0.0760125033557415, + 0.7931657806038857, + 0.6023410949856043, + 0.9996473174542189, + 0.9540515914559364, + 0.5201699584722519, + 0.6359699368476868, + 0.40686637349426746, + 0.4495560545474291, + 0.5499334260821342, + 0.735142420977354, + 0.7766736522316933, + 0.40096745640039444, + 1.3774011060595512, + 0.1414708849042654, + 1.1569546237587929, + 0.44971799850463867, + 0.7416151612997055 + ], + "unique_experts": 64, + "load_cv": 0.6465696304941965, + "normalized_load_entropy": 0.9529355393094926, + "max_load_share": 0.048654244306418216 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 120, + "ordered_topk_exact_tokens": 55, + "set_exact_tokens": 71, + "mean_set_jaccard": 0.8730158730158731, + "mean_token_weighted_tv": 0.024744105253679056, + "aggregate_load_tv": 0.052777777777777785 + }, + "system_bos": { + "tokens": 120, + "ordered_topk_exact_tokens": 50, + "set_exact_tokens": 71, + "mean_set_jaccard": 0.869047619047619, + "mean_token_weighted_tv": 0.02568850830818216, + "aggregate_load_tv": 0.051388888888888894 + }, + "system_x": { + "tokens": 120, + "ordered_topk_exact_tokens": 37, + "set_exact_tokens": 59, + "mean_set_jaccard": 0.8308333333333333, + "mean_token_weighted_tv": 0.0346114988050734, + "aggregate_load_tv": 0.043055555555555555 + }, + "system_period": { + "tokens": 120, + "ordered_topk_exact_tokens": 36, + "set_exact_tokens": 55, + "mean_set_jaccard": 0.8259920634920636, + "mean_token_weighted_tv": 0.03548179341014475, + "aggregate_load_tv": 0.045833333333333344 + }, + "bos_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 38, + "set_exact_tokens": 65, + "mean_set_jaccard": 0.8462301587301587, + "mean_token_weighted_tv": 0.0321787379682064, + "aggregate_load_tv": 0.056944444444444436 + }, + "bos_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 48, + "set_exact_tokens": 74, + "mean_set_jaccard": 0.8690476190476191, + "mean_token_weighted_tv": 0.029110856377519666, + "aggregate_load_tv": 0.048611111111111105 + }, + "x_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 38, + "set_exact_tokens": 58, + "mean_set_jaccard": 0.830952380952381, + "mean_token_weighted_tv": 0.03601285573871185, + "aggregate_load_tv": 0.05972222222222222 + }, + "x_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 32, + "set_exact_tokens": 58, + "mean_set_jaccard": 0.833531746031746, + "mean_token_weighted_tv": 0.03594855268020183, + "aggregate_load_tv": 0.05555555555555555 + }, + "period_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 36, + "set_exact_tokens": 57, + "mean_set_jaccard": 0.8257936507936507, + "mean_token_weighted_tv": 0.035580220127788685, + "aggregate_load_tv": 0.06805555555555555 + }, + "period_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 32, + "set_exact_tokens": 56, + "mean_set_jaccard": 0.8230158730158731, + "mean_token_weighted_tv": 0.037849442839312054, + "aggregate_load_tv": 0.05694444444444445 + } + } + }, + "layer_14": { + "layer": 14, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "593b4af5f4c2c7589207645c9cf0bc31c7906667622f3db897da686c7856f9b4", + "route_weight_sha256": "ef23cf852569c31a3450dd1f5934da912d122f9adb72e66937d14b5fe2aa3536", + "loads": [ + 5, + 12, + 3, + 3, + 4, + 7, + 3, + 1, + 9, + 19, + 22, + 29, + 2, + 18, + 16, + 14, + 0, + 7, + 6, + 6, + 1, + 8, + 11, + 8, + 8, + 23, + 18, + 1, + 15, + 1, + 3, + 4, + 5, + 19, + 14, + 4, + 11, + 3, + 1, + 18, + 5, + 9, + 12, + 28, + 10, + 9, + 7, + 26, + 10, + 13, + 11, + 8, + 23, + 25, + 2, + 8, + 28, + 16, + 26, + 17, + 4, + 18, + 24, + 19 + ], + "weighted_loads": [ + 0.2958801444619894, + 0.34513710951432586, + 0.13655657321214676, + 0.08047125302255154, + 0.2692195847630501, + 0.31030688993632793, + 0.12185517698526382, + 0.0238494873046875, + 0.5353438444435596, + 1.1974450312554836, + 0.7907483666203916, + 2.0796793829649687, + 0.0647391602396965, + 1.2793085668236017, + 1.003191460389644, + 0.5669958386570215, + 0.0, + 0.245221309363842, + 0.2325402870774269, + 0.30955748073756695, + 0.12877047061920166, + 0.336858831346035, + 8.30287989974022, + 0.25355177745223045, + 0.29842781089246273, + 1.0957184098660946, + 3.360826374962926, + 0.029722066596150398, + 0.8716094866394997, + 0.02342246286571026, + 0.22276151925325394, + 0.1343940868973732, + 0.6876702215522528, + 1.5262725036591291, + 0.3918931824155152, + 0.12990008108317852, + 0.37328880559653044, + 0.22780084982514381, + 0.03419837728142738, + 0.7530435547232628, + 0.20564711093902588, + 0.3295048512518406, + 0.5329325143247843, + 2.105845347046852, + 0.34767283080145717, + 0.31635729782283306, + 0.23499739356338978, + 1.0729017052799463, + 0.7905635200440884, + 0.7945195510983467, + 0.7286451980471611, + 0.2629740722477436, + 2.0112545154988766, + 2.247076965868473, + 0.06381497718393803, + 0.10151831991970539, + 2.493139509111643, + 0.686361039057374, + 0.8763452316634357, + 0.720795651897788, + 0.2736438848078251, + 0.6665522214025259, + 1.518357357941568, + 0.6262900764122605 + ], + "unique_experts": 63, + "load_cv": 0.7200822998230956, + "normalized_load_entropy": 0.9345644899851399, + "max_load_share": 0.04027777777777778 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "910e2be148c234f503171f4d01f3aa45919839baee500941262934d6e5cf9201", + "route_weight_sha256": "033e1117c4ab137c85ea3fb13b9a34ba616ecda881dd261c5155a31aba899dc5", + "loads": [ + 11, + 12, + 3, + 5, + 4, + 17, + 3, + 3, + 9, + 28, + 25, + 32, + 2, + 18, + 16, + 18, + 0, + 7, + 11, + 7, + 1, + 8, + 11, + 19, + 9, + 26, + 24, + 6, + 23, + 1, + 6, + 11, + 5, + 26, + 14, + 4, + 12, + 4, + 3, + 18, + 5, + 9, + 14, + 29, + 11, + 9, + 12, + 29, + 10, + 15, + 15, + 12, + 29, + 31, + 2, + 12, + 28, + 17, + 26, + 27, + 4, + 19, + 24, + 19 + ], + "weighted_loads": [ + 0.9717843756079674, + 0.34513710951432586, + 0.13655657321214676, + 0.1591260451823473, + 0.2692195847630501, + 1.2232149969786406, + 0.12185517698526382, + 0.09668266773223877, + 0.5353438444435596, + 1.7210682556033134, + 0.8821582901291549, + 2.271256698295474, + 0.0647391602396965, + 1.2793085668236017, + 1.003191460389644, + 0.7258247416466475, + 0.0, + 0.245221309363842, + 0.5763235613703728, + 0.3494469281286001, + 0.12877047061920166, + 0.336858831346035, + 8.30287989974022, + 0.7237605787813663, + 0.3210414871573448, + 1.223482683300972, + 3.696913355961442, + 0.37828345596790314, + 2.0197044536471367, + 0.02342246286571026, + 0.42642273008823395, + 0.38945027347654104, + 0.6876702215522528, + 2.1899755019694567, + 0.3918931824155152, + 0.12990008108317852, + 0.4259084751829505, + 0.270910058170557, + 0.18095043674111366, + 0.7530435547232628, + 0.20564711093902588, + 0.3295048512518406, + 0.6461035069078207, + 2.1540847569704056, + 0.38040227768942714, + 0.31635729782283306, + 0.4974620882421732, + 1.2131951358169317, + 0.7905635200440884, + 0.8617727253586054, + 0.8837587237358093, + 1.5120569709688425, + 2.768738489598036, + 2.675373699516058, + 0.06381497718393803, + 0.4165965896099806, + 2.493139509111643, + 0.7227519433945417, + 0.8763452316634357, + 1.1695252675563097, + 0.2736438848078251, + 0.67155841877684, + 1.518357357941568, + 0.6262900764122605 + ], + "unique_experts": 63, + "load_cv": 0.6638187286689358, + "normalized_load_entropy": 0.943256880213463, + "max_load_share": 0.0367816091954023 + } + }, + "s1_eos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "24c6c4dc7eff4f955d1676f1728d2a631e2cabc1484d243e2aa07baac1afe8ce", + "route_weight_sha256": "afaf6b5d21d4f89d25da9a5fc9a5dd5413f13871ea1bc6ca7bad5238a7b56fab", + "loads": [ + 6, + 10, + 4, + 2, + 4, + 8, + 3, + 0, + 10, + 20, + 23, + 29, + 3, + 18, + 18, + 14, + 0, + 8, + 7, + 5, + 1, + 10, + 12, + 7, + 8, + 27, + 17, + 0, + 13, + 0, + 4, + 4, + 4, + 19, + 14, + 3, + 8, + 3, + 1, + 16, + 10, + 8, + 12, + 27, + 11, + 11, + 6, + 22, + 10, + 13, + 11, + 10, + 23, + 25, + 2, + 7, + 28, + 19, + 28, + 17, + 5, + 16, + 18, + 18 + ], + "weighted_loads": [ + 0.30200970359146595, + 0.2881334382109344, + 0.16517773270606995, + 0.05291359685361385, + 0.26233918219804764, + 0.352198151871562, + 0.11544176377356052, + 0.0, + 0.5688437260687351, + 1.3280255869030952, + 0.8195908139459789, + 2.0928285717964172, + 0.09814595058560371, + 1.203259153291583, + 0.9787205890752375, + 0.5550332758575678, + 0.0, + 0.2561721671372652, + 0.2632338423281908, + 0.2729335315525532, + 0.12774407863616943, + 0.384127140045166, + 8.823298275470734, + 0.2288326919078827, + 0.29773212410509586, + 1.162895143032074, + 3.3408697713166475, + 0.0, + 0.7914042882621288, + 0.0, + 0.2581340279430151, + 0.13393455743789673, + 0.6632869485765696, + 1.5807549729943275, + 0.37821950670331717, + 0.09710897132754326, + 0.3043164312839508, + 0.23587938398122787, + 0.03300771489739418, + 0.6686759926378727, + 0.38704466354101896, + 0.3103754594922066, + 0.5355786792933941, + 2.0667582526803017, + 0.3782704877667129, + 0.3776910025626421, + 0.20044423639774323, + 0.9468745235353708, + 0.79367152787745, + 0.7770139090716839, + 0.6901590451598167, + 0.33245743066072464, + 1.9752288646996021, + 2.221660127863288, + 0.06514155305922031, + 0.07877600705251098, + 2.4565530344843864, + 0.8249564692378044, + 0.8684687851928174, + 0.7173134852200747, + 0.3055771142244339, + 0.6019104421138763, + 1.3873773273080587, + 0.5642860624939203 + ], + "unique_experts": 60, + "load_cv": 0.7147476460477952, + "normalized_load_entropy": 0.933188622998701, + "max_load_share": 0.04027777777777778 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "3fcbca21d597bf3ef4399efb2f4bd0137b46475800b8f30b9de05932ac2eaf22", + "route_weight_sha256": "848340ebe7d5e04223f5b69d6e5aad6b2c38459c7931c5cbb75de45cc79f75c7", + "loads": [ + 14, + 11, + 4, + 5, + 8, + 24, + 3, + 4, + 12, + 32, + 23, + 32, + 9, + 18, + 18, + 19, + 0, + 8, + 14, + 9, + 3, + 14, + 12, + 17, + 13, + 31, + 22, + 8, + 26, + 1, + 9, + 8, + 6, + 30, + 15, + 4, + 8, + 6, + 4, + 17, + 10, + 8, + 14, + 28, + 13, + 11, + 12, + 25, + 12, + 14, + 26, + 13, + 31, + 34, + 4, + 11, + 29, + 21, + 29, + 33, + 8, + 18, + 20, + 21 + ], + "weighted_loads": [ + 1.0819956883788109, + 0.3398653599433601, + 0.16517773270606995, + 0.1685128454118967, + 0.4962496664375067, + 1.477637093514204, + 0.11544176377356052, + 0.16336096823215485, + 0.7354155071079731, + 2.15542758628726, + 0.8195908139459789, + 2.304135363548994, + 0.48523709550499916, + 1.203259153291583, + 0.9787205890752375, + 0.7685314994305372, + 0.0, + 0.2561721671372652, + 0.782630892470479, + 0.47465785034000874, + 0.3551996275782585, + 0.5355966333299875, + 8.823298275470734, + 0.650743106380105, + 0.540094893425703, + 1.3289473950862885, + 3.6926496531814337, + 0.3078938676044345, + 2.4229996353387833, + 0.049014948308467865, + 0.5099299382418394, + 0.251110078766942, + 0.7446742486208677, + 2.692492164671421, + 0.4271027585491538, + 0.17669055238366127, + 0.3043164312839508, + 0.5974640287458897, + 0.2508368007838726, + 0.7265288420021534, + 0.38704466354101896, + 0.3103754594922066, + 0.6318924315273762, + 2.111493080854416, + 0.4408576521091163, + 0.3776910025626421, + 0.5121320523321629, + 1.067758908495307, + 0.9236065056174994, + 0.8117742389440536, + 1.6334986966103315, + 1.548696929588914, + 2.7706919871270657, + 2.939498556777835, + 0.14739754237234592, + 0.3659959635697305, + 2.5088565461337566, + 0.906280655413866, + 0.9783984660170972, + 1.6601767968386412, + 0.5589705817401409, + 0.6483142608776689, + 1.489873444661498, + 0.6759651061147451 + ], + "unique_experts": 63, + "load_cv": 0.6084244688237892, + "normalized_load_entropy": 0.9533229816358862, + "max_load_share": 0.035196687370600416 + } + }, + "s0_bos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "4c1b90f2524b640122b6ff8cff62ebdbc84aafc4cb400632a676e84096db1347", + "route_weight_sha256": "3924f13cc8a8eae7f88d30a68231416fb20070706e11e2ab690cc71fad4d4c75", + "loads": [ + 5, + 12, + 3, + 3, + 4, + 8, + 3, + 0, + 10, + 20, + 24, + 30, + 3, + 17, + 19, + 13, + 0, + 11, + 7, + 4, + 2, + 8, + 12, + 8, + 5, + 23, + 18, + 0, + 17, + 1, + 3, + 4, + 4, + 19, + 11, + 3, + 9, + 3, + 1, + 19, + 8, + 8, + 10, + 28, + 8, + 11, + 8, + 23, + 10, + 14, + 12, + 12, + 21, + 25, + 2, + 6, + 28, + 15, + 29, + 20, + 4, + 15, + 20, + 17 + ], + "weighted_loads": [ + 0.29493018984794617, + 0.3420582110993564, + 0.14133332669734955, + 0.07795425318181515, + 0.2745995447039604, + 0.33411418460309505, + 0.12366428598761559, + 0.0, + 0.6098482441157103, + 1.2961731534451246, + 0.9166207627858967, + 2.1473666336387396, + 0.09617388248443604, + 1.292195025831461, + 1.07157694385387, + 0.5578066147863865, + 0.0, + 0.3336125276982784, + 0.24562732130289078, + 0.2446680460125208, + 0.16177216172218323, + 0.3219580724835396, + 8.795386046171188, + 0.26249457709491253, + 0.17068637162446976, + 1.0878351014107466, + 3.46236683242023, + 0.0, + 1.1340032927691936, + 0.022661957889795303, + 0.23097513616085052, + 0.13498197123408318, + 0.7178840488195419, + 1.5190865844488144, + 0.2749254594091326, + 0.10168037749826908, + 0.3195754922926426, + 0.23284702375531197, + 0.03212936222553253, + 0.7841003462672234, + 0.3292301641777158, + 0.3085930645465851, + 0.4789388123899698, + 2.1362376175820827, + 0.2603454766795039, + 0.35732936300337315, + 0.26453288830816746, + 0.9819009751081467, + 0.7926101982593536, + 0.8346305843442678, + 0.7864883355796337, + 0.37800317630171776, + 2.021535985171795, + 2.3288521114736795, + 0.079609714448452, + 0.05606314982287586, + 2.581832353025675, + 0.6606345977634192, + 0.9299959719646722, + 0.8647494222968817, + 0.2645872998982668, + 0.5675595942884684, + 1.4479619022458792, + 0.576431873254478 + ], + "unique_experts": 61, + "load_cv": 0.7246966159609035, + "normalized_load_entropy": 0.9325700440144411, + "max_load_share": 0.041666666666666664 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "58d9c0eeee71e33a251c6f68c0c9e8cd46863ab343e9478b6d452c68c58f1466", + "route_weight_sha256": "030946904012b18e2fb72d0c7febb3e360a721480f893bec7fc8ab4bb0518f14", + "loads": [ + 10, + 12, + 3, + 6, + 4, + 18, + 3, + 1, + 10, + 28, + 27, + 33, + 3, + 17, + 19, + 16, + 0, + 11, + 14, + 5, + 2, + 8, + 12, + 18, + 7, + 27, + 24, + 6, + 26, + 1, + 6, + 10, + 4, + 25, + 11, + 3, + 10, + 4, + 3, + 19, + 8, + 8, + 11, + 29, + 10, + 11, + 13, + 25, + 10, + 16, + 16, + 17, + 27, + 31, + 2, + 10, + 28, + 16, + 30, + 30, + 4, + 15, + 20, + 17 + ], + "weighted_loads": [ + 0.9254418630152941, + 0.3420582110993564, + 0.14133332669734955, + 0.2132484782487154, + 0.2745995447039604, + 1.2470222916454077, + 0.12366428598761559, + 0.033571481704711914, + 0.6098482441157103, + 1.7590263057500124, + 1.00803068629466, + 2.338943948969245, + 0.09617388248443604, + 1.292195025831461, + 1.07157694385387, + 0.6889851428568363, + 0.0, + 0.3336125276982784, + 0.7461631149053574, + 0.28455749340355396, + 0.16177216172218323, + 0.3219580724835396, + 8.795386046171188, + 0.7049830220639706, + 0.23488529585301876, + 1.2499653045088053, + 3.798453813418746, + 0.45041324198246, + 2.336050283163786, + 0.022661957889795303, + 0.43645720928907394, + 0.39012302458286285, + 0.7178840488195419, + 2.1384328827261925, + 0.2749254594091326, + 0.10168037749826908, + 0.37219516187906265, + 0.2759562321007252, + 0.1723906397819519, + 0.7841003462672234, + 0.3292301641777158, + 0.3085930645465851, + 0.5261393953114748, + 2.184477027505636, + 0.3705185456201434, + 0.35732936300337315, + 0.5106891635805368, + 1.067128524184227, + 0.7926101982593536, + 0.9018837586045265, + 0.9409709572792053, + 0.8636304289102554, + 2.779019959270954, + 2.7571488451212645, + 0.079609714448452, + 0.41363302688114345, + 2.581832353025675, + 0.7063681948930025, + 0.973769459174946, + 1.3134790379554033, + 0.2645872998982668, + 0.5675595942884684, + 1.4479619022458792, + 0.576431873254478 + ], + "unique_experts": 63, + "load_cv": 0.6717955700098008, + "normalized_load_entropy": 0.9422401341802724, + "max_load_share": 0.03793103448275862 + } + }, + "s1_bos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "14781c570734e59afd5a63d379054bc1efc5ddad4eed1e1d5f952cb0b4d41915", + "route_weight_sha256": "e1e1df92cb56111d19ff5e86ad0905d68807bbb7367c9c46b9bd0a17ff1778cd", + "loads": [ + 5, + 11, + 3, + 3, + 4, + 7, + 3, + 0, + 10, + 21, + 25, + 29, + 1, + 17, + 17, + 15, + 0, + 10, + 7, + 4, + 2, + 9, + 12, + 9, + 5, + 22, + 18, + 0, + 17, + 1, + 4, + 6, + 4, + 18, + 11, + 3, + 10, + 3, + 1, + 20, + 10, + 6, + 11, + 29, + 13, + 10, + 6, + 21, + 10, + 14, + 10, + 11, + 22, + 25, + 1, + 5, + 29, + 17, + 26, + 18, + 4, + 15, + 22, + 18 + ], + "weighted_loads": [ + 0.2944292835891247, + 0.3192442459985614, + 0.12960344552993774, + 0.07018681056797504, + 0.262795552611351, + 0.3101054597645998, + 0.11830195970833302, + 0.0, + 0.6047956086695194, + 1.3098979406058788, + 0.9452590374276042, + 2.1285985186696053, + 0.03159850835800171, + 1.210628867149353, + 1.0102297151461244, + 0.6021642498672009, + 0.0, + 0.2769890446215868, + 0.256454773247242, + 0.24318628758192062, + 0.16258887015283108, + 0.3466160483658314, + 8.814329966902733, + 0.28942176327109337, + 0.18724623136222363, + 1.0160078760236502, + 3.4362345319241285, + 0.0, + 1.048382369801402, + 0.02243892289698124, + 0.26704926788806915, + 0.21238379180431366, + 0.7109165228903294, + 1.5600628592073917, + 0.302363135619089, + 0.10268860124051571, + 0.3428619485348463, + 0.23702839389443398, + 0.03259226679801941, + 0.8254999499768019, + 0.3869686061516404, + 0.23072676733136177, + 0.507606353610754, + 2.1653359588235617, + 0.5023907041177154, + 0.34702642261981964, + 0.20347092673182487, + 0.9198864307254553, + 0.7980600968003273, + 0.8438740596175194, + 0.681079525500536, + 0.3553554806858301, + 2.015009667724371, + 2.2755677476525307, + 0.04045238345861435, + 0.04970482271164656, + 2.5452243518084288, + 0.7172693572938442, + 0.7882212318945676, + 0.7530561946332455, + 0.2658453732728958, + 0.5900253374129534, + 1.5025622360408306, + 0.6018441021442413 + ], + "unique_experts": 61, + "load_cv": 0.7246966159609035, + "normalized_load_entropy": 0.9314319381856234, + "max_load_share": 0.04027777777777778 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "37c453666e809cd73d5bfe142043ac1717c9e8753badd738cb2570e84956355e", + "route_weight_sha256": "ce736a6732b7daff6f87e12e066d0c754bc3c66161dedf47333e2f5201e71700", + "loads": [ + 13, + 12, + 3, + 6, + 8, + 23, + 3, + 4, + 12, + 33, + 25, + 32, + 7, + 17, + 17, + 20, + 0, + 10, + 14, + 8, + 4, + 12, + 12, + 18, + 10, + 26, + 23, + 8, + 31, + 2, + 9, + 10, + 6, + 29, + 12, + 4, + 10, + 6, + 4, + 21, + 10, + 6, + 12, + 30, + 16, + 11, + 11, + 24, + 12, + 15, + 25, + 15, + 30, + 34, + 3, + 9, + 30, + 20, + 27, + 34, + 7, + 16, + 24, + 21 + ], + "weighted_loads": [ + 1.0837447810918093, + 0.37097616773098707, + 0.12960344552993774, + 0.20606869645416737, + 0.49670603685081005, + 1.4355444014072418, + 0.11830195970833302, + 0.17537116631865501, + 0.7713673897087574, + 2.1201959662139416, + 0.9452590374276042, + 2.339905310422182, + 0.41868965327739716, + 1.210628867149353, + 1.0102297151461244, + 0.808316882699728, + 0.0, + 0.2769890446215868, + 0.7506926096975803, + 0.4449106063693762, + 0.39004441909492016, + 0.4489795174449682, + 8.814329966902733, + 0.6838536374270916, + 0.4296090006828308, + 1.173184022307396, + 3.7880144137889147, + 0.38390748389065266, + 2.8460761550813913, + 0.0714538712054491, + 0.52124098315835, + 0.3759193681180477, + 0.7923038229346275, + 2.688200768083334, + 0.35124638746492565, + 0.18227018229663372, + 0.3428619485348463, + 0.5986130386590958, + 0.2299356497824192, + 0.8833527993410826, + 0.3869686061516404, + 0.23072676733136177, + 0.5590410567820072, + 2.210070786997676, + 0.60584422852844, + 0.38862568885087967, + 0.46014345064759254, + 1.0363119561225176, + 0.9279950745403767, + 0.8786343894898891, + 1.6157179772853851, + 0.7852454744279385, + 2.8104727901518345, + 2.9934061765670776, + 0.12270837277173996, + 0.39906058739870787, + 2.597527863457799, + 0.8485056050121784, + 0.8981509127188474, + 1.695919506251812, + 0.5192388407886028, + 0.6316696014255285, + 1.60505835339427, + 0.7135231457650661 + ], + "unique_experts": 63, + "load_cv": 0.6177097656344956, + "normalized_load_entropy": 0.9522582265056738, + "max_load_share": 0.035196687370600416 + } + }, + "s0_x": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "5aeee7c341e15bcc71b681b2a61ba5caf1b6125a5c0df19b017cb3aa9f0a06ae", + "route_weight_sha256": "9cb525b7088fd5564677cdba795e58552c0c02462b44e34878947e5c7a9dc192", + "loads": [ + 4, + 13, + 4, + 5, + 4, + 7, + 3, + 1, + 10, + 21, + 21, + 30, + 3, + 17, + 16, + 15, + 0, + 8, + 8, + 5, + 2, + 8, + 12, + 9, + 5, + 24, + 18, + 0, + 15, + 1, + 4, + 4, + 4, + 19, + 13, + 6, + 9, + 3, + 1, + 17, + 6, + 9, + 11, + 29, + 10, + 6, + 6, + 23, + 11, + 15, + 10, + 11, + 24, + 26, + 1, + 6, + 28, + 18, + 27, + 20, + 2, + 18, + 20, + 14 + ], + "weighted_loads": [ + 0.26374299451708794, + 0.3601865107193589, + 0.16722266376018524, + 0.14586213789880276, + 0.2758505716919899, + 0.30542582273483276, + 0.12246041186153889, + 0.03191151097416878, + 0.6131617687642574, + 1.4253352265805006, + 0.7870048696640879, + 2.201589174568653, + 0.10048344917595387, + 1.3513262886554003, + 1.0357049559243023, + 0.6343941558152437, + 0.0, + 0.25841808039695024, + 0.2994523160159588, + 0.27195167168974876, + 0.1597637627273798, + 0.3148161880671978, + 8.524423122406006, + 0.2796698175370693, + 0.17792374826967716, + 1.139508694410324, + 3.479911919683218, + 0.0, + 0.9127573017030954, + 0.0237995907664299, + 0.2739035449922085, + 0.13672196120023727, + 0.7004892528057098, + 1.6318980902433395, + 0.3394214028958231, + 0.1908214259892702, + 0.27856160094961524, + 0.2433043196797371, + 0.032441142946481705, + 0.7042545229196548, + 0.21429582219570875, + 0.3555667884647846, + 0.521971307694912, + 2.2223907709121704, + 0.3541238403413445, + 0.2067029755562544, + 0.1972454972565174, + 0.968014856800437, + 0.8205892778933048, + 0.8769633248448372, + 0.7280010525137186, + 0.3645985648036003, + 2.192967988550663, + 2.4235620368272066, + 0.041735269129276276, + 0.05591695639304817, + 2.5854882672429085, + 0.7808304317295551, + 0.8385017118416727, + 0.834170987829566, + 0.21561693027615547, + 0.7153918389230967, + 1.4295961363241076, + 0.5086243599653244 + ], + "unique_experts": 62, + "load_cv": 0.7243558228002942, + "normalized_load_entropy": 0.9334413903872263, + "max_load_share": 0.041666666666666664 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "26a69eadaa842f8d2bfb0dddde8de1cf55fa06ea8b3b59d960c0361e7e059621", + "route_weight_sha256": "2cc519562b191b3ef6705a05a7b50e9d520e5a8c55f689deee9ab1107d675b54", + "loads": [ + 10, + 13, + 4, + 6, + 4, + 19, + 3, + 2, + 10, + 29, + 24, + 33, + 3, + 18, + 16, + 18, + 0, + 8, + 13, + 7, + 2, + 8, + 12, + 19, + 7, + 28, + 25, + 5, + 23, + 1, + 7, + 10, + 4, + 26, + 13, + 6, + 10, + 5, + 3, + 17, + 6, + 9, + 12, + 30, + 11, + 6, + 11, + 26, + 11, + 17, + 14, + 13, + 30, + 33, + 1, + 10, + 28, + 19, + 27, + 31, + 2, + 18, + 20, + 14 + ], + "weighted_loads": [ + 1.0012232195585966, + 0.3601865107193589, + 0.16722266376018524, + 0.18526491709053516, + 0.2758505716919899, + 1.356221441179514, + 0.12246041186153889, + 0.06548299267888069, + 0.6131617687642574, + 1.8201342765241861, + 0.8784147931728512, + 2.3931664898991585, + 0.10048344917595387, + 1.4089286047965288, + 1.0357049559243023, + 0.7410536129027605, + 0.0, + 0.25841808039695024, + 0.6206059791147709, + 0.38480379059910774, + 0.1597637627273798, + 0.3148161880671978, + 8.524423122406006, + 0.7221582625061274, + 0.24170862510800362, + 1.30084577947855, + 3.9240679033100605, + 0.3795173428952694, + 1.8911894131451845, + 0.0237995907664299, + 0.492714773863554, + 0.3867664970457554, + 0.7004892528057098, + 2.320755511522293, + 0.3394214028958231, + 0.1908214259892702, + 0.3311812705360353, + 0.36025475710630417, + 0.16796861216425896, + 0.7042545229196548, + 0.21429582219570875, + 0.3555667884647846, + 0.5691550970077515, + 2.270630180835724, + 0.38685328722931445, + 0.2067029755562544, + 0.46886516362428665, + 1.0967640783637762, + 0.8205892778933048, + 0.9442164991050959, + 0.8864858690649271, + 0.7287667579948902, + 2.9504519626498222, + 2.938146537169814, + 0.041735269129276276, + 0.3674555520992726, + 2.5854882672429085, + 0.8213742151856422, + 0.8385017118416727, + 1.3436575923115015, + 0.21561693027615547, + 0.7153918389230967, + 1.4295961363241076, + 0.5086243599653244 + ], + "unique_experts": 63, + "load_cv": 0.6806733122526163, + "normalized_load_entropy": 0.9414533866909247, + "max_load_share": 0.03793103448275862 + } + }, + "s1_x": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "e81c014747b5c6c43a12624cab17ae56acca0d862e3393bc0e17d084ce50942e", + "route_weight_sha256": "00e67d3dfa62796c187c854be1c75cdfd22046c64219aa416fdcc7f3a4a0e270", + "loads": [ + 4, + 11, + 4, + 4, + 4, + 10, + 3, + 2, + 9, + 19, + 24, + 31, + 3, + 17, + 18, + 13, + 0, + 9, + 9, + 4, + 2, + 8, + 12, + 10, + 6, + 27, + 18, + 0, + 16, + 1, + 4, + 4, + 4, + 21, + 13, + 4, + 7, + 3, + 0, + 15, + 9, + 7, + 9, + 30, + 11, + 6, + 7, + 20, + 10, + 15, + 11, + 9, + 21, + 28, + 1, + 5, + 30, + 18, + 24, + 17, + 4, + 17, + 20, + 18 + ], + "weighted_loads": [ + 0.26661104522645473, + 0.3117921072989702, + 0.15244739316403866, + 0.10013355687260628, + 0.2598404586315155, + 0.44119229912757874, + 0.11447632126510143, + 0.0582337211817503, + 0.538943275809288, + 1.3578115552663803, + 0.8908934290520847, + 2.243715323507786, + 0.10477796196937561, + 1.1719407066702843, + 0.9467284795828164, + 0.5514688994735479, + 0.0, + 0.26960993465036154, + 0.3213835842907429, + 0.2421443872153759, + 0.15913380682468414, + 0.29745172522962093, + 8.683214291930199, + 0.3104503024369478, + 0.21992651745676994, + 1.160279056057334, + 3.413727993145585, + 0.0, + 0.7698901183903217, + 0.022630443796515465, + 0.2753327190876007, + 0.14864647388458252, + 0.6772778984159231, + 1.7036014907062054, + 0.3912437101826072, + 0.1276355478912592, + 0.2549847327172756, + 0.230979785323143, + 0.0, + 0.6513535194098949, + 0.3033688464201987, + 0.2734188921749592, + 0.42547457106411457, + 2.2713691666722298, + 0.39835970662534237, + 0.21177074685692787, + 0.22896241955459118, + 0.8089430201798677, + 0.7504782509058714, + 0.8863693885505199, + 0.6971740443259478, + 0.27360931411385536, + 1.9659582320600748, + 2.448190128430724, + 0.03892018646001816, + 0.05030053574591875, + 2.6216332763433456, + 0.783522441983223, + 0.7304394135717303, + 0.7615055944770575, + 0.2651561051607132, + 0.7024607416242361, + 1.4071684461086988, + 0.6080008307471871 + ], + "unique_experts": 61, + "load_cv": 0.7348469228349533, + "normalized_load_entropy": 0.9321836298685349, + "max_load_share": 0.043055555555555555 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "403368eab62ccab3dc991f6a96add9df4c2d7a712f604d1fad929861970a7502", + "route_weight_sha256": "9689cfc86a8f16ac7e59b147ca0fa60340aea1e2d91c206ad9514c1a22115e06", + "loads": [ + 12, + 12, + 4, + 5, + 8, + 29, + 3, + 5, + 11, + 29, + 24, + 35, + 9, + 17, + 18, + 16, + 0, + 9, + 15, + 8, + 4, + 11, + 12, + 20, + 11, + 30, + 24, + 8, + 28, + 2, + 10, + 7, + 6, + 32, + 14, + 5, + 8, + 7, + 3, + 16, + 9, + 7, + 11, + 31, + 13, + 6, + 13, + 23, + 12, + 16, + 26, + 11, + 29, + 38, + 3, + 9, + 31, + 20, + 25, + 37, + 7, + 18, + 22, + 22 + ], + "weighted_loads": [ + 1.083064403384924, + 0.3635240290313959, + 0.15244739316403866, + 0.1396687589585781, + 0.49375094287097454, + 1.8011912647634745, + 0.11447632126510143, + 0.18430176563560963, + 0.705515056848526, + 1.9854242391884327, + 0.8908934290520847, + 2.5033979788422585, + 0.49186910688877106, + 1.1719407066702843, + 0.9467284795828164, + 0.6753893923014402, + 0.0, + 0.26960993465036154, + 0.7797871120274067, + 0.44386870600283146, + 0.3865893557667732, + 0.3998151943087578, + 8.683214291930199, + 0.7578300032764673, + 0.46228928677737713, + 1.2944729011505842, + 3.8691528644412756, + 0.3455065432935953, + 2.1274104192852974, + 0.07164539210498333, + 0.5454228036105633, + 0.2590988799929619, + 0.7586651984602213, + 2.848079077899456, + 0.4401269620284438, + 0.2072171289473772, + 0.29140555113554, + 0.6886127926409245, + 0.19062698259949684, + 0.7092063687741756, + 0.3033688464201987, + 0.2734188921749592, + 0.5329693090170622, + 2.316103994846344, + 0.4609468709677458, + 0.21177074685692787, + 0.5398879069834948, + 0.9193419236689806, + 0.8804132286459208, + 0.9211297184228897, + 1.639134282246232, + 0.6354355420917273, + 2.7614213544875383, + 3.2905613090842962, + 0.12117617577314377, + 0.30219797510653734, + 2.673936787992716, + 0.873847246170044, + 0.84036909439601, + 1.8636081162840128, + 0.5185495726764202, + 0.7441050056368113, + 1.5096645634621382, + 0.7508283397182822 + ], + "unique_experts": 63, + "load_cv": 0.6463574469586676, + "normalized_load_entropy": 0.9492377126772586, + "max_load_share": 0.039337474120082816 + } + }, + "s0_period": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "64e77ad891b08fe3fc0dab581eaf1ae4f92f54f007989ff036f15b5996695531", + "route_weight_sha256": "5b24f42ae74038bc45b87549614165b5647d4c288324b407701080cbe05a8770", + "loads": [ + 4, + 13, + 4, + 2, + 4, + 8, + 3, + 0, + 10, + 22, + 21, + 31, + 3, + 17, + 16, + 15, + 0, + 7, + 8, + 5, + 2, + 7, + 12, + 10, + 6, + 24, + 18, + 1, + 16, + 1, + 3, + 3, + 4, + 19, + 14, + 5, + 9, + 3, + 0, + 17, + 6, + 8, + 11, + 28, + 8, + 6, + 5, + 22, + 11, + 14, + 11, + 8, + 24, + 25, + 2, + 7, + 28, + 18, + 30, + 23, + 2, + 19, + 22, + 15 + ], + "weighted_loads": [ + 0.2752278037369251, + 0.36952299205586314, + 0.16999436728656292, + 0.052312154322862625, + 0.27720461413264275, + 0.3339289128780365, + 0.120772959664464, + 0.0, + 0.6077768504619598, + 1.4688179902732372, + 0.7465852242894471, + 2.2794954627752304, + 0.09572981856763363, + 1.3168537262827158, + 1.0246649263426661, + 0.6454848051071167, + 0.0, + 0.24408353120088577, + 0.29942123033106327, + 0.26342371106147766, + 0.1605952363461256, + 0.28655632212758064, + 8.671065114438534, + 0.30941617861390114, + 0.2331108059734106, + 1.1162381153553724, + 3.481242176145315, + 0.025685248896479607, + 0.9529169276356697, + 0.02457253262400627, + 0.23752634972333908, + 0.10601285845041275, + 0.6976746823638678, + 1.6614980567246675, + 0.3807285667862743, + 0.16136245243251324, + 0.32279360853135586, + 0.23404830694198608, + 0.0, + 0.7020026911050081, + 0.2111906949430704, + 0.323698241263628, + 0.5199873633682728, + 2.2295791301876307, + 0.2872246946208179, + 0.2011545803397894, + 0.16562796384096146, + 0.9215298760682344, + 0.8181238584220409, + 0.8526353444904089, + 0.7724838927388191, + 0.2635321654379368, + 2.2388036753982306, + 2.393664913251996, + 0.07810059562325478, + 0.06452999194152653, + 2.5941386371850967, + 0.7551445905119181, + 0.9615793586708605, + 0.931529002264142, + 0.21393360570073128, + 0.7391326036304235, + 1.4202312608249485, + 0.5147982109338045 + ], + "unique_experts": 61, + "load_cv": 0.7506375890690904, + "normalized_load_entropy": 0.9284007860933927, + "max_load_share": 0.043055555555555555 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "ab265271eb68ecb510c90dd9fe515659c79a6ec4a3806b30563f7b7d02ef91e9", + "route_weight_sha256": "ef7a5197686d43861c469eba3c1896f63e9a90e0044031adaab9f2945e587c15", + "loads": [ + 10, + 13, + 4, + 3, + 4, + 19, + 3, + 2, + 10, + 29, + 24, + 34, + 3, + 18, + 16, + 18, + 0, + 7, + 13, + 6, + 2, + 7, + 12, + 20, + 8, + 28, + 25, + 7, + 24, + 1, + 6, + 9, + 4, + 26, + 14, + 5, + 11, + 5, + 2, + 17, + 6, + 8, + 11, + 29, + 9, + 6, + 9, + 25, + 11, + 17, + 16, + 10, + 30, + 32, + 2, + 11, + 28, + 19, + 30, + 33, + 2, + 20, + 22, + 15 + ], + "weighted_loads": [ + 0.9540935326367617, + 0.36952299205586314, + 0.16999436728656292, + 0.09171493351459503, + 0.27720461413264275, + 1.3182339519262314, + 0.120772959664464, + 0.0729089081287384, + 0.6077768504619598, + 1.8224499225616455, + 0.8379951477982104, + 2.471072778105736, + 0.09572981856763363, + 1.370397562161088, + 1.0246649263426661, + 0.7553398571908474, + 0.0, + 0.24408353120088577, + 0.6621655318886042, + 0.30331315845251083, + 0.1605952363461256, + 0.28655632212758064, + 8.671065114438534, + 0.7519046235829592, + 0.3068815656006336, + 1.2684384267777205, + 3.8696656674146652, + 0.4579088445752859, + 2.047122046351433, + 0.02457253262400627, + 0.4497545138001442, + 0.3521578945219517, + 0.6976746823638678, + 2.3427991960197687, + 0.3807285667862743, + 0.16136245243251324, + 0.4191460330039263, + 0.33697863668203354, + 0.130578450858593, + 0.7020026911050081, + 0.2111906949430704, + 0.323698241263628, + 0.5199873633682728, + 2.277818540111184, + 0.31995414150878787, + 0.2011545803397894, + 0.37911590188741684, + 1.0727000180631876, + 0.8181238584220409, + 0.9661296233534813, + 0.9840006567537785, + 0.6277003586292267, + 2.99628764949739, + 2.9035846646875143, + 0.07810059562325478, + 0.4456149444449693, + 2.5941386371850967, + 0.7956863176077604, + 0.9615793586708605, + 1.3802586179226637, + 0.21393360570073128, + 0.7746902275830507, + 1.4202312608249485, + 0.5147982109338045 + ], + "unique_experts": 63, + "load_cv": 0.7008704928497066, + "normalized_load_entropy": 0.9382291900535162, + "max_load_share": 0.03908045977011494 + } + }, + "s1_period": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "17c28160929dfcce2899cc430d0462b0e56340b554755c3789cfa779ab10295e", + "route_weight_sha256": "aa051a17d2bb28e9e0f0033eff592ab27448cdb41b3a5ea3f90aeebd1fe24471", + "loads": [ + 4, + 11, + 4, + 5, + 3, + 9, + 3, + 2, + 10, + 21, + 24, + 30, + 2, + 18, + 19, + 14, + 0, + 8, + 11, + 4, + 2, + 8, + 12, + 9, + 5, + 24, + 18, + 1, + 16, + 1, + 4, + 5, + 3, + 22, + 13, + 4, + 8, + 3, + 0, + 17, + 9, + 6, + 9, + 30, + 11, + 6, + 3, + 18, + 10, + 14, + 12, + 10, + 22, + 27, + 1, + 5, + 29, + 20, + 25, + 17, + 4, + 17, + 19, + 19 + ], + "weighted_loads": [ + 0.2754078693687916, + 0.31008457858115435, + 0.1564444936811924, + 0.12328360229730606, + 0.2234847955405712, + 0.39606253430247307, + 0.11521310359239578, + 0.05872339569032192, + 0.5773289427161217, + 1.4017493538558483, + 0.8902730359695852, + 2.224209165200591, + 0.06540614180266857, + 1.2324784323573112, + 0.9756512651219964, + 0.5864184759557247, + 0.0, + 0.26184613443911076, + 0.39138627611100674, + 0.23784959316253662, + 0.16253669559955597, + 0.29943349957466125, + 8.663620099425316, + 0.28239094465970993, + 0.18608276173472404, + 1.043814778327942, + 3.4620549138635397, + 0.03422805666923523, + 0.8184454161673784, + 0.024022402241826057, + 0.2680191732943058, + 0.18257654085755348, + 0.6324802096933126, + 1.807497676461935, + 0.39174585067667067, + 0.13060743175446987, + 0.29576028883457184, + 0.22677448391914368, + 0.0, + 0.7133112046867609, + 0.2985525184776634, + 0.24307242780923843, + 0.42632419615983963, + 2.3119134418666363, + 0.4081396125257015, + 0.20871544256806374, + 0.11082593724131584, + 0.7263750229030848, + 0.7585541550070047, + 0.8430808801203966, + 0.7575661335140467, + 0.3114409036934376, + 2.0570537205785513, + 2.4450946263968945, + 0.04062143713235855, + 0.051738712936639786, + 2.59558292850852, + 0.8260080050677061, + 0.7753181420266628, + 0.7486063838005066, + 0.26121094822883606, + 0.7023634929209948, + 1.4033203069120646, + 0.6571856690570712 + ], + "unique_experts": 62, + "load_cv": 0.7361897232656642, + "normalized_load_entropy": 0.931412603073873, + "max_load_share": 0.041666666666666664 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "335c09526cd16ee4f4de6ebad893534259cace1b9e588ebde205e1d159a4cd23", + "route_weight_sha256": "078f1ed8c89bbfe01d48f15b0e806f4819887a36cbf5f0b3bcf3050fe4d1da7f", + "loads": [ + 12, + 12, + 4, + 7, + 8, + 26, + 3, + 6, + 12, + 32, + 24, + 33, + 8, + 18, + 19, + 17, + 0, + 8, + 17, + 8, + 4, + 11, + 12, + 18, + 12, + 27, + 24, + 8, + 29, + 2, + 10, + 9, + 5, + 32, + 14, + 5, + 8, + 7, + 3, + 18, + 9, + 6, + 10, + 32, + 13, + 6, + 8, + 21, + 12, + 16, + 27, + 12, + 30, + 38, + 3, + 9, + 30, + 23, + 26, + 34, + 7, + 18, + 21, + 23 + ], + "weighted_loads": [ + 1.0677047688513994, + 0.36181650031358004, + 0.1564444936811924, + 0.196450624614954, + 0.4980933237820864, + 1.574476519599557, + 0.11521310359239578, + 0.22690648399293423, + 0.7439007237553596, + 2.0975682325661182, + 0.8902730359695852, + 2.435515956953168, + 0.452497286722064, + 1.2324784323573112, + 0.9756512651219964, + 0.7119986973702908, + 0.0, + 0.26184613443911076, + 0.8579633440822363, + 0.4395739119499922, + 0.38999224454164505, + 0.4017969686537981, + 8.663620099425316, + 0.6768228188157082, + 0.5313894059509039, + 1.1650912165641785, + 3.861816206946969, + 0.3342126961797476, + 2.175819193944335, + 0.07303735055029392, + 0.536566898226738, + 0.3290258161723614, + 0.7138675097376108, + 2.8899937979876995, + 0.4406291025225073, + 0.21018901281058788, + 0.29576028883457184, + 0.6876260824501514, + 0.18850811943411827, + 0.7711640540510416, + 0.2985525184776634, + 0.24307242780923843, + 0.47775889933109283, + 2.3931744806468487, + 0.47072677686810493, + 0.20871544256806374, + 0.3880416266620159, + 0.8363657314330339, + 0.8884891327470541, + 0.9201582241803408, + 1.7088184896856546, + 0.6732671316713095, + 2.852516843006015, + 3.285697516053915, + 0.12287742644548416, + 0.37020590156316757, + 2.6478864401578903, + 0.9414743389934301, + 0.8852478228509426, + 1.7408157624304295, + 0.5146044157445431, + 0.7440077569335699, + 1.5058164242655039, + 0.8006183868274093 + ], + "unique_experts": 63, + "load_cv": 0.6397448524577599, + "normalized_load_entropy": 0.9498353922942686, + "max_load_share": 0.039337474120082816 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 120, + "ordered_topk_exact_tokens": 53, + "set_exact_tokens": 66, + "mean_set_jaccard": 0.8625, + "mean_token_weighted_tv": 0.02449358702288009, + "aggregate_load_tv": 0.04861111111111111 + }, + "system_bos": { + "tokens": 120, + "ordered_topk_exact_tokens": 52, + "set_exact_tokens": 70, + "mean_set_jaccard": 0.8648809523809524, + "mean_token_weighted_tv": 0.026743698406304854, + "aggregate_load_tv": 0.037500000000000006 + }, + "system_x": { + "tokens": 120, + "ordered_topk_exact_tokens": 36, + "set_exact_tokens": 51, + "mean_set_jaccard": 0.8232142857142857, + "mean_token_weighted_tv": 0.035080897027122165, + "aggregate_load_tv": 0.05138888888888889 + }, + "system_period": { + "tokens": 120, + "ordered_topk_exact_tokens": 39, + "set_exact_tokens": 50, + "mean_set_jaccard": 0.8065476190476192, + "mean_token_weighted_tv": 0.0355406503212483, + "aggregate_load_tv": 0.06388888888888888 + }, + "bos_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 44, + "set_exact_tokens": 59, + "mean_set_jaccard": 0.8337301587301588, + "mean_token_weighted_tv": 0.03183742598921526, + "aggregate_load_tv": 0.052777777777777785 + }, + "bos_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 43, + "set_exact_tokens": 58, + "mean_set_jaccard": 0.8335317460317462, + "mean_token_weighted_tv": 0.03164125016580025, + "aggregate_load_tv": 0.0513888888888889 + }, + "x_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 45, + "set_exact_tokens": 57, + "mean_set_jaccard": 0.8271825396825397, + "mean_token_weighted_tv": 0.03528795787521328, + "aggregate_load_tv": 0.05 + }, + "x_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 36, + "set_exact_tokens": 46, + "mean_set_jaccard": 0.8009920634920635, + "mean_token_weighted_tv": 0.03912509865573763, + "aggregate_load_tv": 0.05416666666666666 + }, + "period_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 47, + "set_exact_tokens": 60, + "mean_set_jaccard": 0.8365079365079366, + "mean_token_weighted_tv": 0.03377404538332485, + "aggregate_load_tv": 0.051388888888888894 + }, + "period_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 41, + "set_exact_tokens": 49, + "mean_set_jaccard": 0.7982142857142859, + "mean_token_weighted_tv": 0.04024170487731074, + "aggregate_load_tv": 0.05833333333333333 + } + } + }, + "layer_15": { + "layer": 15, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "2ff41f256805059c341a88049db58da6b117aa57633d9a460b3fae4f247a29d8", + "route_weight_sha256": "0e19bb8b4736b35dd5c778e6ff9b00703131d1ea40ffb31d53ef8a1e97b3c7e1", + "loads": [ + 10, + 5, + 0, + 18, + 11, + 4, + 16, + 11, + 10, + 14, + 15, + 4, + 12, + 4, + 10, + 14, + 39, + 10, + 9, + 27, + 8, + 1, + 19, + 8, + 3, + 3, + 17, + 5, + 11, + 14, + 11, + 2, + 15, + 14, + 6, + 7, + 20, + 7, + 19, + 10, + 4, + 15, + 3, + 3, + 28, + 2, + 2, + 7, + 16, + 12, + 25, + 23, + 8, + 6, + 27, + 7, + 10, + 13, + 19, + 16, + 9, + 6, + 4, + 12 + ], + "weighted_loads": [ + 0.4929641466587782, + 0.18078596331179142, + 0.0, + 0.6710964608937502, + 0.6264829859137535, + 0.15844660624861717, + 1.2782737910747528, + 0.45498608238995075, + 0.3346074353903532, + 0.804836418479681, + 1.8209916651248932, + 0.23081889003515244, + 0.46769114024937153, + 0.2950425297021866, + 0.4192698560655117, + 0.973545303568244, + 2.9645003397017717, + 0.3930188324302435, + 0.567196000367403, + 2.857667999342084, + 0.30975402891635895, + 0.07320359349250793, + 1.08748085424304, + 0.2521962318569422, + 0.09159285947680473, + 0.25032611563801765, + 1.2222561463713646, + 0.6256251931190491, + 0.3552248254418373, + 0.5652582235634327, + 0.3819407355040312, + 0.08466553688049316, + 0.8954994603991508, + 0.6230301596224308, + 0.2110348679125309, + 0.6224343329668045, + 0.8470903038978577, + 0.25823676958680153, + 1.0527378413826227, + 0.38829185627400875, + 0.1489871982485056, + 0.630333824083209, + 0.19244521111249924, + 0.21310445293784142, + 1.3073980379849672, + 0.06700682640075684, + 0.2691294774413109, + 0.236858943477273, + 0.9534718580543995, + 0.5730562563985586, + 1.7948187049478292, + 1.799134436994791, + 0.3103821221739054, + 0.3576320856809616, + 1.2448375187814236, + 0.22828912734985352, + 0.4576558992266655, + 1.2238544877618551, + 2.522946447134018, + 1.1195822767913342, + 0.4448377341032028, + 0.31367830745875835, + 0.26294804364442825, + 0.46955726481974125 + ], + "unique_experts": 63, + "load_cv": 0.6723829009069897, + "normalized_load_entropy": 0.9470439032721295, + "max_load_share": 0.05416666666666667 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "b4025a1bf65c1a5855ccc8d3d05c9d6a380b6043389a69e5919699e0cf68df94", + "route_weight_sha256": "bea5212309c6fe842c59f60d950be62db587ced52408f2ce7419a85c721c51dd", + "loads": [ + 13, + 5, + 0, + 18, + 17, + 7, + 22, + 12, + 17, + 15, + 20, + 5, + 17, + 4, + 19, + 15, + 46, + 13, + 9, + 30, + 8, + 1, + 19, + 13, + 8, + 4, + 27, + 5, + 13, + 14, + 15, + 2, + 20, + 16, + 6, + 7, + 25, + 7, + 19, + 11, + 10, + 16, + 3, + 6, + 28, + 2, + 2, + 8, + 17, + 21, + 31, + 25, + 14, + 6, + 29, + 11, + 10, + 13, + 20, + 17, + 9, + 8, + 4, + 16 + ], + "weighted_loads": [ + 0.6441642809659243, + 0.18078596331179142, + 0.0, + 0.6710964608937502, + 1.0018560141324997, + 0.23030989151448011, + 1.7153305634856224, + 0.49230548925697803, + 0.808184863999486, + 0.8363243229687214, + 2.0092464853078127, + 0.2610106039792299, + 0.8637993391603231, + 0.2950425297021866, + 0.7648032233119011, + 1.0037554446607828, + 3.703903490677476, + 0.4968885872513056, + 0.567196000367403, + 2.994241075590253, + 0.30975402891635895, + 0.07320359349250793, + 1.08748085424304, + 0.5221221204847097, + 0.22787520638667047, + 0.2788420785218477, + 1.8988447114825249, + 0.6256251931190491, + 0.4364565722644329, + 0.5652582235634327, + 0.5559629946947098, + 0.08466553688049316, + 1.2988228499889374, + 0.7113225348293781, + 0.2110348679125309, + 0.6224343329668045, + 1.5597207956016064, + 0.25823676958680153, + 1.0527378413826227, + 0.4334528613835573, + 0.4180897264741361, + 0.6345783779397607, + 0.19244521111249924, + 0.3380449563264847, + 1.3073980379849672, + 0.06700682640075684, + 0.2691294774413109, + 0.2713692430406809, + 0.9669651482254267, + 1.5270756762474775, + 2.116277936846018, + 1.879230048507452, + 0.49056374933570623, + 0.3576320856809616, + 1.320798922330141, + 1.8940123245120049, + 0.4576558992266655, + 1.2238544877618551, + 2.57096403837204, + 1.1482193619012833, + 0.4448377341032028, + 0.3902115374803543, + 0.26294804364442825, + 0.6426097042858601 + ], + "unique_experts": 63, + "load_cv": 0.6380998016378868, + "normalized_load_entropy": 0.9504946980123965, + "max_load_share": 0.052873563218390804 + } + }, + "s1_eos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "ad4ff0be1a2049ae02e7fae471b6448c2c5b6480c20c989c643a909d6df22b45", + "route_weight_sha256": "d0d8afd9889892c05cf335d37f38a0297af255588c9659b7a88693b643195ea6", + "loads": [ + 10, + 5, + 0, + 17, + 10, + 5, + 16, + 14, + 8, + 14, + 15, + 4, + 8, + 4, + 9, + 17, + 35, + 10, + 9, + 27, + 6, + 1, + 21, + 10, + 4, + 3, + 18, + 4, + 7, + 15, + 7, + 1, + 15, + 19, + 4, + 10, + 19, + 7, + 22, + 13, + 4, + 17, + 3, + 3, + 27, + 2, + 2, + 7, + 17, + 11, + 25, + 22, + 8, + 6, + 26, + 7, + 9, + 16, + 20, + 15, + 10, + 6, + 4, + 10 + ], + "weighted_loads": [ + 0.4905766732990742, + 0.1703975424170494, + 0.0, + 0.6343071460723877, + 0.5955424308776855, + 0.17669779062271118, + 1.2463445141911507, + 0.5917342305183411, + 0.27062081173062325, + 0.7912600357085466, + 1.7824131473898888, + 0.23581647127866745, + 0.3167957942932844, + 0.2663542181253433, + 0.3849750515073538, + 0.9561111479997635, + 2.794770609587431, + 0.4043727219104767, + 0.5629583410918713, + 2.8562742322683334, + 0.2384932078421116, + 0.07536355406045914, + 1.1276686005294323, + 0.30848605558276176, + 0.13529595360159874, + 0.25611273385584354, + 1.2807382810860872, + 0.586500272154808, + 0.23757361434400082, + 0.6067100204527378, + 0.2678503021597862, + 0.0508548729121685, + 0.8885526191443205, + 0.7783454265445471, + 0.1476706564426422, + 0.7982467301189899, + 0.8085527382791042, + 0.25263153575360775, + 1.4355880692601204, + 0.47503952495753765, + 0.153669947758317, + 0.7111924588680267, + 0.1871022805571556, + 0.21695438399910927, + 1.251910500228405, + 0.06696749292314053, + 0.2486514151096344, + 0.22813817858695984, + 0.9706752169877291, + 0.5670742709189653, + 1.7185847088694572, + 1.8445009030401707, + 0.3137496653944254, + 0.32323259860277176, + 1.219103204086423, + 0.23866579867899418, + 0.4420323148369789, + 1.3318846113979816, + 2.5417988412082195, + 1.0727044381201267, + 0.45328825525939465, + 0.328083872795105, + 0.26452528312802315, + 0.39455607533454895 + ], + "unique_experts": 63, + "load_cv": 0.6736669507210719, + "normalized_load_entropy": 0.94505682948543, + "max_load_share": 0.04861111111111111 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "696ef3f87418437e58fdcc5280a6835064cf66423c0253ef853743867ec70c5a", + "route_weight_sha256": "0c03900dc2cfd8ad34af941d095b978b4a30e55f98356d0f78979aba8c0d11e4", + "loads": [ + 30, + 6, + 0, + 17, + 19, + 10, + 28, + 14, + 19, + 15, + 20, + 8, + 14, + 5, + 15, + 26, + 47, + 14, + 10, + 31, + 7, + 2, + 21, + 15, + 8, + 4, + 28, + 6, + 12, + 16, + 14, + 5, + 20, + 22, + 6, + 10, + 25, + 7, + 23, + 15, + 10, + 19, + 3, + 5, + 27, + 3, + 2, + 9, + 20, + 24, + 33, + 24, + 11, + 7, + 28, + 11, + 9, + 22, + 22, + 19, + 10, + 13, + 6, + 15 + ], + "weighted_loads": [ + 1.7430384010076523, + 0.1962673645466566, + 0.0, + 0.6343071460723877, + 1.1239618547260761, + 0.38119054958224297, + 2.1817019023001194, + 0.5917342305183411, + 0.9083335101604462, + 0.8222853597253561, + 2.012143053114414, + 0.5697775855660439, + 0.8222696892917156, + 0.3463596925139427, + 0.5869683250784874, + 1.621869895607233, + 3.9720187336206436, + 0.5643362440168858, + 0.6141541339457035, + 3.1281647942960262, + 0.2681478913873434, + 0.15950175374746323, + 1.1276686005294323, + 0.5523371621966362, + 0.22829162143170834, + 0.2845659200102091, + 1.9840115029364824, + 0.7107974588871002, + 0.6211924497038126, + 0.6462109573185444, + 0.532532587647438, + 0.4967940077185631, + 1.2773390728980303, + 0.9117845930159092, + 0.2977934442460537, + 0.7982467301189899, + 1.4922417849302292, + 0.25263153575360775, + 1.4678689874708652, + 0.5582119803875685, + 0.39190292288549244, + 0.8043737770058215, + 0.1871022805571556, + 0.4962243586778641, + 1.251910500228405, + 0.10511546395719051, + 0.2486514151096344, + 0.29645100980997086, + 1.1113745905458927, + 2.3385232966393232, + 2.0920150242745876, + 1.913157396018505, + 0.39300438668578863, + 0.45587363094091415, + 1.2978141997009516, + 1.8861107844859362, + 0.4420323148369789, + 1.9917768500745296, + 2.6256759837269783, + 1.2410272397100925, + 0.45328825525939465, + 0.7059084437787533, + 0.3798456974327564, + 0.59355672262609 + ], + "unique_experts": 63, + "load_cv": 0.60774774433813, + "normalized_load_entropy": 0.95438911688798, + "max_load_share": 0.048654244306418216 + } + }, + "s0_bos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "d58c1aa285b042a9ab086f862ff9894f270585fa191f1a44ac7df9d087d627e8", + "route_weight_sha256": "046a099f273c22cdcae8c6e21bbb9f61d0289fc2bb70e203f4953b30fbb48df5", + "loads": [ + 11, + 5, + 2, + 20, + 10, + 3, + 17, + 13, + 10, + 14, + 15, + 5, + 10, + 4, + 10, + 14, + 31, + 8, + 8, + 27, + 7, + 1, + 18, + 9, + 4, + 3, + 18, + 4, + 9, + 13, + 10, + 1, + 15, + 18, + 3, + 8, + 20, + 7, + 13, + 10, + 3, + 12, + 3, + 3, + 29, + 2, + 2, + 8, + 20, + 15, + 24, + 23, + 10, + 6, + 30, + 9, + 10, + 14, + 20, + 15, + 12, + 5, + 4, + 13 + ], + "weighted_loads": [ + 0.5563603080809116, + 0.18083423003554344, + 0.07731408625841141, + 0.7335300464183092, + 0.5902715809643269, + 0.10699666291475296, + 1.357608050107956, + 0.5110460538417101, + 0.35639432445168495, + 0.8026453927159309, + 1.8628333695232868, + 0.25144627690315247, + 0.4104304015636444, + 0.30152153223752975, + 0.4226472731679678, + 0.9717773925513029, + 2.606512699276209, + 0.34141789749264717, + 0.5259337462484837, + 2.9314365461468697, + 0.31140606105327606, + 0.07361359149217606, + 1.0782376490533352, + 0.28232812136411667, + 0.1275527961552143, + 0.24815154634416103, + 1.2877799104899168, + 0.6087249144911766, + 0.29696905985474586, + 0.5421292595565319, + 0.37200650572776794, + 0.04860955476760864, + 0.8691216483712196, + 0.7983912751078606, + 0.13353588245809078, + 0.622110340744257, + 0.851998308673501, + 0.2646529208868742, + 0.9713487178087234, + 0.37999309971928596, + 0.11946916952729225, + 0.484240522608161, + 0.2057645618915558, + 0.21679913997650146, + 1.3438605219125748, + 0.06437702104449272, + 0.27718864381313324, + 0.27545977383852005, + 1.110679417848587, + 0.7414890211075544, + 1.933858124539256, + 1.8339907005429268, + 0.38897895254194736, + 0.3612750880420208, + 1.3164765927940607, + 0.29802992194890976, + 0.48967364244163036, + 1.3114526197314262, + 2.6040962915867567, + 1.067261341959238, + 0.5450967438519001, + 0.26635160855948925, + 0.2744035869836807, + 0.5051969289779663 + ], + "unique_experts": 64, + "load_cv": 0.6582805886043833, + "normalized_load_entropy": 0.9479709849225264, + "max_load_share": 0.043055555555555555 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "8967808d04cc85df3f55f32845067953f4d341c67742da78f712b47ae1fbfd96", + "route_weight_sha256": "fb1d756a522f923e410ae951ec29552ca7c9f43cf2c881101f9cf9a152099f0a", + "loads": [ + 14, + 5, + 2, + 20, + 15, + 5, + 22, + 14, + 16, + 15, + 20, + 6, + 15, + 4, + 18, + 15, + 38, + 11, + 8, + 30, + 7, + 1, + 18, + 14, + 9, + 4, + 28, + 4, + 12, + 13, + 16, + 1, + 20, + 20, + 3, + 9, + 26, + 7, + 13, + 11, + 9, + 12, + 3, + 6, + 29, + 2, + 2, + 9, + 21, + 23, + 31, + 26, + 16, + 7, + 34, + 11, + 10, + 14, + 21, + 16, + 12, + 7, + 4, + 16 + ], + "weighted_loads": [ + 0.7087051421403885, + 0.18083423003554344, + 0.07731408625841141, + 0.7335300464183092, + 0.9195530228316784, + 0.1781828422099352, + 1.6659929640591145, + 0.5483654607087374, + 0.7808082848787308, + 0.8341332972049713, + 2.0510881897062063, + 0.28163799084722996, + 0.7986455075442791, + 0.30152153223752975, + 0.7581274267286062, + 1.0019875336438417, + 3.357361126691103, + 0.44528765231370926, + 0.5259337462484837, + 3.0680096223950386, + 0.31140606105327606, + 0.07361359149217606, + 1.0782376490533352, + 0.5522540099918842, + 0.3212387394160032, + 0.2766675092279911, + 1.964368475601077, + 0.6087249144911766, + 0.4483063295483589, + 0.5421292595565319, + 0.6396368760615587, + 0.04860955476760864, + 1.2724450379610062, + 0.8866836503148079, + 0.13353588245809078, + 0.725041750818491, + 1.640495965257287, + 0.2646529208868742, + 0.9713487178087234, + 0.4208877421915531, + 0.44971562176942825, + 0.484240522608161, + 0.2057645618915558, + 0.33482031896710396, + 1.3438605219125748, + 0.06437702104449272, + 0.27718864381313324, + 0.30997007340192795, + 1.1241727080196142, + 1.6366150099784136, + 2.3125172704458237, + 1.9636228010058403, + 0.5691605797037482, + 0.42062027007341385, + 1.4899344649165869, + 0.9438571706414223, + 0.48967364244163036, + 1.3114526197314262, + 2.6521138828247786, + 1.0958984270691872, + 0.5450967438519001, + 0.3428848385810852, + 0.2744035869836807, + 0.6663651578128338 + ], + "unique_experts": 64, + "load_cv": 0.6339786436443839, + "normalized_load_entropy": 0.9504023341098695, + "max_load_share": 0.04367816091954023 + } + }, + "s1_bos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "62109a583a3c971ffe1b3780d1cf6fc6081195eadfbf3e737aac191aca8d3da8", + "route_weight_sha256": "4f6043339e139abcf7a0cd456d384c6dee5d3a897e7c8a2740b0c2af00d3925d", + "loads": [ + 12, + 7, + 1, + 19, + 9, + 4, + 16, + 11, + 6, + 14, + 15, + 4, + 11, + 4, + 9, + 15, + 33, + 10, + 6, + 28, + 6, + 1, + 19, + 10, + 4, + 4, + 18, + 4, + 9, + 14, + 12, + 1, + 15, + 16, + 3, + 9, + 20, + 8, + 19, + 11, + 3, + 15, + 4, + 3, + 27, + 2, + 2, + 7, + 20, + 14, + 22, + 19, + 12, + 6, + 27, + 6, + 9, + 15, + 20, + 16, + 10, + 5, + 4, + 15 + ], + "weighted_loads": [ + 0.6009590644389391, + 0.24754365347325802, + 0.03964785113930702, + 0.6911600586026907, + 0.5433266516774893, + 0.14714912325143814, + 1.3085145447403193, + 0.4527887646108866, + 0.20365138724446297, + 0.817457927390933, + 1.7927424386143684, + 0.23930395767092705, + 0.4496006667613983, + 0.2752739191055298, + 0.3847421854734421, + 0.9919949285686016, + 2.7472961395978928, + 0.40857802517712116, + 0.4380688928067684, + 2.8477367628365755, + 0.2658131942152977, + 0.07057841867208481, + 1.1036112420260906, + 0.3150254748761654, + 0.15426557324826717, + 0.281554089859128, + 1.3203131426125765, + 0.6164035424590111, + 0.2974533513188362, + 0.5599067714065313, + 0.42800163850188255, + 0.05166028067469597, + 0.8968275915831327, + 0.7299404218792915, + 0.1274180617183447, + 0.7845210433006287, + 0.8651900254189968, + 0.28060964681208134, + 1.3028249442577362, + 0.409070385619998, + 0.11383002065122128, + 0.6336608678102493, + 0.23763170279562473, + 0.220554880797863, + 1.259100079536438, + 0.06324926763772964, + 0.273763507604599, + 0.2404324971139431, + 1.0567911360412836, + 0.7219326887279749, + 1.803705520927906, + 1.775641418993473, + 0.44331688433885574, + 0.3192367423325777, + 1.2567929811775684, + 0.1984200906008482, + 0.4616456627845764, + 1.3409025222063065, + 2.5931105837225914, + 1.083956889808178, + 0.45700711011886597, + 0.28326566331088543, + 0.2699146382510662, + 0.5623009521514177 + ], + "unique_experts": 64, + "load_cv": 0.6499762578759852, + "normalized_load_entropy": 0.948424877207891, + "max_load_share": 0.04583333333333333 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "85fdb4c835603aae382a49137dcaea9adf5adb9acb71c58dff75df83ce649549", + "route_weight_sha256": "43cd3c8485f97acdc4926a8ad7171dcafbc967d688260bb6e3374b8a2dee21c3", + "loads": [ + 33, + 8, + 1, + 19, + 18, + 9, + 28, + 11, + 16, + 15, + 20, + 8, + 17, + 5, + 14, + 24, + 45, + 14, + 7, + 32, + 7, + 2, + 19, + 15, + 9, + 5, + 28, + 6, + 14, + 15, + 20, + 5, + 20, + 19, + 5, + 9, + 27, + 8, + 20, + 13, + 9, + 16, + 4, + 5, + 27, + 3, + 2, + 9, + 23, + 27, + 31, + 21, + 15, + 7, + 29, + 9, + 9, + 21, + 22, + 20, + 10, + 12, + 6, + 19 + ], + "weighted_loads": [ + 1.9075719248503447, + 0.2734134756028652, + 0.03964785113930702, + 0.6911600586026907, + 1.0068157967180014, + 0.39217126928269863, + 2.162628570571542, + 0.4527887646108866, + 0.7972509115934372, + 0.8484832514077425, + 2.022472344338894, + 0.5732650719583035, + 0.9425018522888422, + 0.3552793934941292, + 0.5752292983233929, + 1.6577536761760712, + 3.948185730725527, + 0.5685415472835302, + 0.48926468566060066, + 3.1196273248642683, + 0.2954678777605295, + 0.1547166183590889, + 1.1036112420260906, + 0.5588765814900398, + 0.3434170950204134, + 0.31000727601349354, + 2.0235863644629717, + 0.7407007291913033, + 0.681072186678648, + 0.5994077082723379, + 0.7399274632334709, + 0.49759941548109055, + 1.2856140453368425, + 0.8633795883506536, + 0.27754084952175617, + 0.7845210433006287, + 1.6028890050947666, + 0.28060964681208134, + 1.335105862468481, + 0.48905309848487377, + 0.5109588652849197, + 0.7226577550172806, + 0.23763170279562473, + 0.4998248554766178, + 1.259100079536438, + 0.10139723867177963, + 0.273763507604599, + 0.31262463703751564, + 1.1974905095994473, + 2.543690400198102, + 2.2176574803888798, + 1.8442979119718075, + 0.522571605630219, + 0.4518777746707201, + 1.3252471685409546, + 0.9126677941530943, + 0.4616456627845764, + 2.0007947608828545, + 2.67698772624135, + 1.2522796913981438, + 0.45700711011886597, + 0.6610902342945337, + 0.3852350525557995, + 0.7367656901478767 + ], + "unique_experts": 64, + "load_cv": 0.603671466656769, + "normalized_load_entropy": 0.955637009969141, + "max_load_share": 0.046583850931677016 + } + }, + "s0_x": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "508fd8473c9e96a2ea8873d860eb3514a6dac479145c69d9592351e2a8010539", + "route_weight_sha256": "780006240b714ac65543a30dd2359d11bd3f5d6fe661aa6a09476a35f0cc9525", + "loads": [ + 11, + 5, + 1, + 18, + 10, + 4, + 16, + 12, + 10, + 14, + 15, + 5, + 9, + 4, + 10, + 14, + 34, + 10, + 8, + 27, + 8, + 1, + 19, + 9, + 4, + 3, + 18, + 4, + 8, + 14, + 9, + 2, + 15, + 19, + 3, + 8, + 19, + 6, + 17, + 12, + 2, + 12, + 4, + 3, + 23, + 2, + 2, + 5, + 23, + 15, + 25, + 20, + 11, + 7, + 28, + 7, + 10, + 13, + 21, + 16, + 12, + 6, + 4, + 14 + ], + "weighted_loads": [ + 0.5331439264118671, + 0.18523332476615906, + 0.045533742755651474, + 0.687906788662076, + 0.6055620685219765, + 0.14167450927197933, + 1.4006202835589647, + 0.46619545109570026, + 0.359688276425004, + 0.8266615606844425, + 1.9294139593839645, + 0.25614979676902294, + 0.3307404275983572, + 0.2997419908642769, + 0.40796798281371593, + 1.1072861663997173, + 2.814723463729024, + 0.4205658920109272, + 0.5109954662621021, + 2.985346831381321, + 0.317212363705039, + 0.07512779533863068, + 1.145498814061284, + 0.2930781710892916, + 0.15194769762456417, + 0.2607839982956648, + 1.2839116882532835, + 0.6263907998800278, + 0.27852086909115314, + 0.5621189847588539, + 0.32471245527267456, + 0.08172423765063286, + 0.9022833779454231, + 0.8394734282046556, + 0.13562707602977753, + 0.64933642745018, + 0.7883975449949503, + 0.22638637945055962, + 1.0652874987572432, + 0.4296400472521782, + 0.09022252261638641, + 0.4966385215520859, + 0.24596774205565453, + 0.22665638104081154, + 1.1493958104401827, + 0.06861446425318718, + 0.30071599036455154, + 0.18502133712172508, + 1.2460301760584116, + 0.6272691506892443, + 2.0268894396722317, + 1.6130260229110718, + 0.41713323444128036, + 0.39697424694895744, + 1.2388971876353025, + 0.2457444667816162, + 0.484683021903038, + 1.293033305555582, + 2.711743127554655, + 1.1125546302646399, + 0.5494357049465179, + 0.31734289042651653, + 0.29035916179418564, + 0.5687879901379347 + ], + "unique_experts": 64, + "load_cv": 0.6531972647421809, + "normalized_load_entropy": 0.9484178764378755, + "max_load_share": 0.04722222222222222 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "6c910074cd91613c831f6f497cff6648e140b754312677196dce231d3824f43e", + "route_weight_sha256": "9636f00a59af2a0eecf8b75221668642e92775022f2e572c43665755f60a9951", + "loads": [ + 14, + 5, + 1, + 18, + 16, + 5, + 22, + 13, + 17, + 15, + 21, + 6, + 14, + 4, + 18, + 16, + 41, + 14, + 8, + 31, + 8, + 1, + 19, + 15, + 8, + 4, + 29, + 4, + 10, + 14, + 14, + 2, + 20, + 21, + 3, + 8, + 24, + 6, + 17, + 13, + 7, + 12, + 4, + 6, + 23, + 2, + 2, + 6, + 24, + 23, + 31, + 22, + 18, + 8, + 30, + 10, + 10, + 13, + 22, + 17, + 12, + 9, + 4, + 16 + ], + "weighted_loads": [ + 0.6419268883764744, + 0.18523332476615906, + 0.045533742755651474, + 0.687906788662076, + 0.9900054968893528, + 0.16041349619627, + 1.8591807056218386, + 0.5035148579627275, + 0.857106814160943, + 0.8581494651734829, + 2.1859497372061014, + 0.28634151071310043, + 0.7216364908963442, + 0.2997419908642769, + 0.7434481363743544, + 1.1720715388655663, + 3.577919216826558, + 0.5580862313508987, + 0.5109954662621021, + 3.1728168204426765, + 0.317212363705039, + 0.07512779533863068, + 1.145498814061284, + 0.6587335225194693, + 0.27565906569361687, + 0.28929996117949486, + 2.0766091030091047, + 0.6263907998800278, + 0.35975261591374874, + 0.5621189847588539, + 0.5417790915817022, + 0.08172423765063286, + 1.3056067675352097, + 0.927765803411603, + 0.13562707602977753, + 0.64933642745018, + 1.5150766726583242, + 0.22638637945055962, + 1.0652874987572432, + 0.4690353199839592, + 0.3576776757836342, + 0.4966385215520859, + 0.24596774205565453, + 0.3924931697547436, + 1.1493958104401827, + 0.06861446425318718, + 0.30071599036455154, + 0.21953163668513298, + 1.2595234662294388, + 1.4760601613670588, + 2.326767673715949, + 1.6931216344237328, + 0.6350670950487256, + 0.4318264313042164, + 1.3129942584782839, + 0.9401228614151478, + 0.484683021903038, + 1.293033305555582, + 2.759760718792677, + 1.141191715374589, + 0.5494357049465179, + 0.46134114265441895, + 0.29035916179418564, + 0.6703932080417871 + ], + "unique_experts": 64, + "load_cv": 0.6305014183793816, + "normalized_load_entropy": 0.9507381174953704, + "max_load_share": 0.047126436781609195 + } + }, + "s1_x": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "2307d71a2f4da78bf3ddb36fc375e526c14dc291ea2986f023310f59d96e43e3", + "route_weight_sha256": "de98f5dd7bf85824f48a36706459427673827119a14c7da97cfc4b0a87fcdc05", + "loads": [ + 12, + 4, + 0, + 17, + 9, + 6, + 16, + 12, + 9, + 13, + 15, + 4, + 10, + 4, + 10, + 15, + 38, + 9, + 8, + 29, + 4, + 1, + 21, + 9, + 4, + 3, + 18, + 5, + 10, + 14, + 14, + 2, + 15, + 15, + 4, + 10, + 18, + 5, + 22, + 8, + 3, + 18, + 3, + 3, + 25, + 2, + 2, + 4, + 23, + 16, + 24, + 19, + 8, + 6, + 27, + 7, + 8, + 12, + 20, + 15, + 9, + 6, + 5, + 13 + ], + "weighted_loads": [ + 0.6007391288876534, + 0.14128860086202621, + 0.0, + 0.6297330353409052, + 0.5436263792216778, + 0.22945430129766464, + 1.2950988300144672, + 0.4706358127295971, + 0.309331726282835, + 0.798702247440815, + 1.8297762461006641, + 0.23950998485088348, + 0.39876955561339855, + 0.235312569886446, + 0.4114422835409641, + 0.9789855368435383, + 3.1713216342031956, + 0.36527327448129654, + 0.47723234444856644, + 2.966890014708042, + 0.1763787791132927, + 0.07489537447690964, + 1.1508897859603167, + 0.2896317336708307, + 0.12856795638799667, + 0.2515092007815838, + 1.2937091961503029, + 0.6089017726480961, + 0.3380025699734688, + 0.5541591681540012, + 0.5002902448177338, + 0.0815255418419838, + 0.9670185912400484, + 0.6614348478615284, + 0.15439975075423717, + 0.8184745851904154, + 0.745564853772521, + 0.17860568687319756, + 1.3432946875691414, + 0.2805446907877922, + 0.1258060410618782, + 0.7559804283082485, + 0.20496290922164917, + 0.22818593680858612, + 1.1611858420073986, + 0.062163643538951874, + 0.26914411783218384, + 0.1400875523686409, + 1.1847963854670525, + 0.6342035736888647, + 1.8109794817864895, + 1.6853758692741394, + 0.318905234336853, + 0.319070965051651, + 1.2248625811189413, + 0.25615623965859413, + 0.4218807425349951, + 1.2297390848398209, + 2.6408536415547132, + 1.086192287504673, + 0.43009426072239876, + 0.3150822538882494, + 0.30520787462592125, + 0.47889771312475204 + ], + "unique_experts": 63, + "load_cv": 0.6888888888888889, + "normalized_load_entropy": 0.9436731789842802, + "max_load_share": 0.05277777777777778 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "bc190f283567345dbe9a19bfaeb9a4f03c6f1be21ac5b93d112dd5aa9b91b5ec", + "route_weight_sha256": "f35305224045bb504845641597eb5ff7854d252b8cffe7e158bacbfbcd82908c", + "loads": [ + 33, + 5, + 0, + 17, + 17, + 9, + 28, + 12, + 20, + 14, + 21, + 8, + 16, + 5, + 15, + 26, + 50, + 13, + 9, + 34, + 5, + 2, + 21, + 15, + 8, + 4, + 29, + 7, + 15, + 16, + 20, + 6, + 21, + 18, + 6, + 10, + 24, + 5, + 23, + 10, + 8, + 21, + 3, + 6, + 25, + 3, + 2, + 6, + 26, + 28, + 30, + 22, + 11, + 7, + 28, + 10, + 8, + 18, + 22, + 19, + 9, + 14, + 7, + 16 + ], + "weighted_loads": [ + 1.8626568466424942, + 0.16715842299163342, + 0.0, + 0.6297330353409052, + 0.9387221597135067, + 0.38073200173676014, + 2.243457417935133, + 0.4706358127295971, + 1.0162762179970741, + 0.8297275714576244, + 2.1122039444744587, + 0.5734710991382599, + 0.9093281328678131, + 0.3153180442750454, + 0.6019293963909149, + 1.711631402373314, + 4.3681586645543575, + 0.5252367965877056, + 0.5284281373023987, + 3.2914329394698143, + 0.2060334626585245, + 0.15903357416391373, + 1.1508897859603167, + 0.6083347406238317, + 0.2545410320162773, + 0.2799623869359493, + 2.1215032637119293, + 0.7331989593803883, + 0.7216214053332806, + 0.6198845151811838, + 0.7320777699351311, + 0.5274646766483784, + 1.406729957088828, + 0.7948740143328905, + 0.30452253855764866, + 0.8184745851904154, + 1.3734640795737505, + 0.17860568687319756, + 1.3755756057798862, + 0.3587599918246269, + 0.3766191992908716, + 0.91341432929039, + 0.20496290922164917, + 0.6343360505998135, + 1.1611858420073986, + 0.10031161457300186, + 0.26914411783218384, + 0.21820025891065598, + 1.325495759025216, + 2.295299319550395, + 2.0386539474129677, + 1.7888988070189953, + 0.39815995562821627, + 0.4517119973897934, + 1.2541351690888405, + 0.9325330406427383, + 0.4218807425349951, + 1.8896313235163689, + 2.724730784073472, + 1.2545150890946388, + 0.43009426072239876, + 0.7441990915685892, + 0.4205282889306545, + 0.5938137825578451 + ], + "unique_experts": 63, + "load_cv": 0.6393158848091067, + "normalized_load_entropy": 0.9504779982358004, + "max_load_share": 0.051759834368530024 + } + }, + "s0_period": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "32f9c881dad4560d60cbfbcc6feef066745d440aa4d4ce6b15847512d119a7fc", + "route_weight_sha256": "bd82f65d5e31100abd7968ca3157f1c57714f8a377a5ee26825178049b303c31", + "loads": [ + 11, + 5, + 1, + 19, + 10, + 4, + 17, + 11, + 8, + 14, + 15, + 5, + 8, + 4, + 10, + 15, + 37, + 9, + 8, + 27, + 5, + 1, + 19, + 8, + 4, + 3, + 18, + 4, + 9, + 14, + 8, + 2, + 15, + 16, + 3, + 8, + 19, + 8, + 17, + 10, + 3, + 12, + 3, + 3, + 28, + 2, + 2, + 6, + 23, + 15, + 24, + 20, + 10, + 7, + 29, + 7, + 10, + 13, + 21, + 16, + 12, + 6, + 4, + 15 + ], + "weighted_loads": [ + 0.5493924617767334, + 0.19289546832442284, + 0.0449560284614563, + 0.7012059558182955, + 0.6025832183659077, + 0.1445092298090458, + 1.4619858767837286, + 0.42654290795326233, + 0.2915849816054106, + 0.828985620290041, + 1.9184926897287369, + 0.2520534358918667, + 0.3057106863707304, + 0.3032544068992138, + 0.40510197170078754, + 1.0880828611552715, + 2.9707698691636324, + 0.3915273956954479, + 0.5046675875782967, + 2.9334687553346157, + 0.20511041581630707, + 0.07507627457380295, + 1.1605722978711128, + 0.2653287760913372, + 0.14966877177357674, + 0.25514739751815796, + 1.2882727310061455, + 0.6165861487388611, + 0.3179845530539751, + 0.558845516294241, + 0.2954665385186672, + 0.08258220925927162, + 0.9310703817754984, + 0.7215388659387827, + 0.1355010960251093, + 0.6705373600125313, + 0.8067677672952414, + 0.28546020202338696, + 1.038404744118452, + 0.36584183387458324, + 0.12017874792218208, + 0.5155109968036413, + 0.21168648451566696, + 0.22204333916306496, + 1.3016837872564793, + 0.06623842939734459, + 0.3041335344314575, + 0.20045720040798187, + 1.2494842913001776, + 0.6768173724412918, + 1.9705635514110327, + 1.6081190779805183, + 0.3770151901990175, + 0.39686364494264126, + 1.2781090289354324, + 0.25124585069715977, + 0.4758336562663317, + 1.3097736909985542, + 2.694622928276658, + 1.113332698121667, + 0.5602484811097383, + 0.32262133061885834, + 0.28248896077275276, + 0.5976831167936325 + ], + "unique_experts": 64, + "load_cv": 0.682768510921654, + "normalized_load_entropy": 0.9455177363063794, + "max_load_share": 0.05138888888888889 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "c21d8cdff92536e698bc4b6b852d5386cd8185004491754a07c5e567a845e6fc", + "route_weight_sha256": "0501e47c16c16f0fd7096b2ccb02e67085c3dbb3a5902edd13ee9ba36bd722a6", + "loads": [ + 13, + 5, + 1, + 19, + 16, + 5, + 24, + 12, + 15, + 15, + 20, + 7, + 13, + 4, + 18, + 16, + 44, + 13, + 8, + 30, + 5, + 1, + 19, + 14, + 7, + 4, + 29, + 4, + 11, + 14, + 13, + 2, + 20, + 18, + 3, + 8, + 25, + 8, + 17, + 11, + 9, + 13, + 3, + 5, + 28, + 2, + 2, + 7, + 24, + 23, + 31, + 22, + 16, + 7, + 31, + 10, + 10, + 13, + 23, + 17, + 12, + 9, + 4, + 18 + ], + "weighted_loads": [ + 0.6322768069803715, + 0.19289546832442284, + 0.0449560284614563, + 0.7012059558182955, + 1.017906814813614, + 0.16324821673333645, + 1.9074431117624044, + 0.4638623148202896, + 0.7880232539027929, + 0.8604735247790813, + 2.1067475099116564, + 0.3134760931134224, + 0.6742213983088732, + 0.3032544068992138, + 0.740582125261426, + 1.1182930022478104, + 3.740153545513749, + 0.5332614406943321, + 0.5046675875782967, + 3.0700418315827847, + 0.20511041581630707, + 0.07507627457380295, + 1.1605722978711128, + 0.6298139169812202, + 0.25593986362218857, + 0.28366336040198803, + 2.0064601749181747, + 0.6165861487388611, + 0.3992162998765707, + 0.558845516294241, + 0.5145735684782267, + 0.08258220925927162, + 1.334393771365285, + 0.80983124114573, + 0.1355010960251093, + 0.6705373600125313, + 1.6018239837139845, + 0.28546020202338696, + 1.038404744118452, + 0.40383577160537243, + 0.506186805665493, + 0.5578354764729738, + 0.21168648451566696, + 0.3070886619389057, + 1.3016837872564793, + 0.06623842939734459, + 0.3041335344314575, + 0.23496749997138977, + 1.2629775814712048, + 1.5372699908912182, + 2.2908560149371624, + 1.6882146894931793, + 0.5571968173608184, + 0.39686364494264126, + 1.3515077717602253, + 0.9543526489287615, + 0.4758336562663317, + 1.3097736909985542, + 2.792733894661069, + 1.141969783231616, + 0.5602484811097383, + 0.5411355067044497, + 0.28248896077275276, + 0.7246381863951683 + ], + "unique_experts": 64, + "load_cv": 0.6532902992451812, + "normalized_load_entropy": 0.948258615824872, + "max_load_share": 0.05057471264367816 + } + }, + "s1_period": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "d35318135cb95534319c61b05d2cf4dd71724c3f17aa3de325062f786536e002", + "route_weight_sha256": "674f9a28f00e43a4ca887d498bb2920068ff1ed2a51422aec6cde6393969c45e", + "loads": [ + 13, + 5, + 0, + 17, + 11, + 4, + 18, + 14, + 8, + 14, + 15, + 5, + 9, + 4, + 10, + 16, + 39, + 9, + 8, + 29, + 5, + 1, + 19, + 10, + 4, + 3, + 18, + 5, + 7, + 15, + 13, + 2, + 15, + 15, + 4, + 9, + 17, + 6, + 21, + 7, + 3, + 17, + 3, + 3, + 26, + 1, + 2, + 4, + 24, + 15, + 24, + 18, + 10, + 7, + 27, + 7, + 8, + 13, + 19, + 15, + 8, + 6, + 5, + 11 + ], + "weighted_loads": [ + 0.6267067678272724, + 0.17723890393972397, + 0.0, + 0.6451893206685781, + 0.617490541189909, + 0.16484935954213142, + 1.4419001005589962, + 0.5360838621854782, + 0.2853944916278124, + 0.8386828936636448, + 1.8523355312645435, + 0.26180974394083023, + 0.3521874789148569, + 0.24340976402163506, + 0.39950866997241974, + 1.0789213590323925, + 3.2572790402919054, + 0.3712627086788416, + 0.4856395535171032, + 2.9541401136666536, + 0.21021315827965736, + 0.0722660943865776, + 1.103349355980754, + 0.32467065565288067, + 0.13449596241116524, + 0.2488950751721859, + 1.3086853511631489, + 0.6069151684641838, + 0.24668936431407928, + 0.5751468539237976, + 0.4707185197621584, + 0.08310682885348797, + 1.0017896685749292, + 0.6466143801808357, + 0.15166234597563744, + 0.8172733895480633, + 0.7114687897264957, + 0.20846698246896267, + 1.2895279172807932, + 0.24788657762110233, + 0.12487277016043663, + 0.7451191432774067, + 0.20079396665096283, + 0.2260405495762825, + 1.1837740428745747, + 0.027833905071020126, + 0.267949141561985, + 0.14696689136326313, + 1.2025535013526678, + 0.6147842518985271, + 1.8672687858343124, + 1.6136190760880709, + 0.38159495778381824, + 0.3548365458846092, + 1.2156339548528194, + 0.26105951331555843, + 0.41656265780329704, + 1.2620129399001598, + 2.6286240480840206, + 1.0827299356460571, + 0.4058068562299013, + 0.3269125949591398, + 0.30346305668354034, + 0.40559457801282406 + ], + "unique_experts": 63, + "load_cv": 0.6926421055781644, + "normalized_load_entropy": 0.9431861662488213, + "max_load_share": 0.05416666666666667 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "bd508710f678048afc4d4a749b55811e145a23687004662f427a8f8fa4b3c355", + "route_weight_sha256": "762f3c4f72094a84dceb1343604bb25d7bc3d0a663f86b3412a77cf9edaaf2d9", + "loads": [ + 34, + 6, + 0, + 17, + 20, + 7, + 30, + 14, + 20, + 15, + 20, + 9, + 15, + 5, + 15, + 28, + 51, + 14, + 9, + 33, + 6, + 2, + 19, + 15, + 7, + 4, + 29, + 7, + 12, + 16, + 19, + 6, + 20, + 20, + 6, + 9, + 23, + 6, + 22, + 9, + 8, + 20, + 3, + 6, + 26, + 2, + 2, + 5, + 27, + 26, + 31, + 20, + 13, + 8, + 29, + 10, + 8, + 19, + 22, + 19, + 8, + 14, + 7, + 14 + ], + "weighted_loads": [ + 1.8698577284812927, + 0.20310872606933117, + 0.0, + 0.6451893206685781, + 1.0654554031789303, + 0.3161270599812269, + 2.434724058955908, + 0.5360838621854782, + 0.9952666442841291, + 0.8697082176804543, + 2.082065436989069, + 0.5957708582282066, + 0.8477436378598213, + 0.32341523841023445, + 0.5899957828223705, + 1.8532558493316174, + 4.450685920193791, + 0.5714137200266123, + 0.5368353463709354, + 3.2260306756943464, + 0.23986784182488918, + 0.1564042940735817, + 1.103349355980754, + 0.5685217622667551, + 0.22571774199604988, + 0.27734826132655144, + 2.0626014322042465, + 0.731212355196476, + 0.6303081996738911, + 0.6146477907896042, + 0.7025060448795557, + 0.5290459636598825, + 1.390576122328639, + 0.8370755091309547, + 0.3017851337790489, + 0.8172733895480633, + 1.4308931827545166, + 0.20846698246896267, + 1.321808835491538, + 0.3264761585742235, + 0.4561774153262377, + 0.9096072465181351, + 0.20079396665096283, + 0.5708246491849422, + 1.1837740428745747, + 0.06598187610507011, + 0.267949141561985, + 0.18104332871735096, + 1.3432528749108315, + 2.1900645457208157, + 2.144397597759962, + 1.6822755690664053, + 0.4608496790751815, + 0.4874775782227516, + 1.27824872918427, + 0.9418840985745192, + 0.41656265780329704, + 1.9219051785767078, + 2.7716933079063892, + 1.251052737236023, + 0.4058068562299013, + 0.8793534878641367, + 0.4187834709882736, + 0.5205106474459171 + ], + "unique_experts": 63, + "load_cv": 0.648687648612298, + "normalized_load_entropy": 0.9493900024531183, + "max_load_share": 0.052795031055900624 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 120, + "ordered_topk_exact_tokens": 50, + "set_exact_tokens": 66, + "mean_set_jaccard": 0.8625000000000002, + "mean_token_weighted_tv": 0.026252701661239067, + "aggregate_load_tv": 0.05 + }, + "system_bos": { + "tokens": 120, + "ordered_topk_exact_tokens": 47, + "set_exact_tokens": 63, + "mean_set_jaccard": 0.8450396825396825, + "mean_token_weighted_tv": 0.030847352075700957, + "aggregate_load_tv": 0.049999999999999996 + }, + "system_x": { + "tokens": 120, + "ordered_topk_exact_tokens": 45, + "set_exact_tokens": 55, + "mean_set_jaccard": 0.8160714285714284, + "mean_token_weighted_tv": 0.03901998446478198, + "aggregate_load_tv": 0.05555555555555556 + }, + "system_period": { + "tokens": 120, + "ordered_topk_exact_tokens": 34, + "set_exact_tokens": 50, + "mean_set_jaccard": 0.7930555555555556, + "mean_token_weighted_tv": 0.041069258276062705, + "aggregate_load_tv": 0.048611111111111126 + }, + "bos_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 47, + "set_exact_tokens": 63, + "mean_set_jaccard": 0.8361111111111114, + "mean_token_weighted_tv": 0.03304753254633397, + "aggregate_load_tv": 0.05416666666666667 + }, + "bos_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 39, + "set_exact_tokens": 65, + "mean_set_jaccard": 0.8476190476190476, + "mean_token_weighted_tv": 0.03179065483467033, + "aggregate_load_tv": 0.05416666666666667 + }, + "x_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 37, + "set_exact_tokens": 51, + "mean_set_jaccard": 0.7958333333333335, + "mean_token_weighted_tv": 0.0400648199642698, + "aggregate_load_tv": 0.05277777777777777 + }, + "x_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 32, + "set_exact_tokens": 50, + "mean_set_jaccard": 0.7952380952380953, + "mean_token_weighted_tv": 0.040544696625632544, + "aggregate_load_tv": 0.056944444444444436 + }, + "period_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 40, + "set_exact_tokens": 47, + "mean_set_jaccard": 0.7902777777777779, + "mean_token_weighted_tv": 0.04042991631819556, + "aggregate_load_tv": 0.048611111111111105 + }, + "period_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 30, + "set_exact_tokens": 47, + "mean_set_jaccard": 0.789484126984127, + "mean_token_weighted_tv": 0.04267135245415072, + "aggregate_load_tv": 0.05555555555555555 + } + } + }, + "layer_16": { + "layer": 16, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "5b9fba025e29333c3dda8f8e0fe7d2de0fa9169031364f5e168c61ea2a5dfaaa", + "route_weight_sha256": "d337b58bb42bb3ec22ffbb9619e435002afe2a4b97f9fa9750b13a028c6090d0", + "loads": [ + 23, + 1, + 10, + 21, + 13, + 19, + 8, + 2, + 14, + 6, + 33, + 9, + 13, + 14, + 30, + 19, + 20, + 9, + 27, + 5, + 20, + 13, + 0, + 1, + 15, + 3, + 10, + 18, + 2, + 8, + 9, + 11, + 8, + 10, + 29, + 4, + 17, + 2, + 4, + 7, + 9, + 12, + 10, + 20, + 11, + 8, + 9, + 6, + 5, + 4, + 7, + 6, + 11, + 4, + 15, + 25, + 4, + 8, + 5, + 12, + 11, + 8, + 23, + 0 + ], + "weighted_loads": [ + 1.5676376316696405, + 0.053238894790410995, + 0.5902511440217495, + 0.9720024541020393, + 0.7307365611195564, + 1.003183327615261, + 0.3074587807059288, + 0.07260502502322197, + 0.75080531463027, + 0.24231423065066338, + 2.2562085390090942, + 0.3577967118471861, + 0.5276598818600178, + 0.5394329261034727, + 3.189300201833248, + 3.8005725368857384, + 0.8584021609276533, + 0.5679484754800797, + 1.1431739535182714, + 0.28623564541339874, + 2.0173700656741858, + 0.9619432650506496, + 0.0, + 0.027126330882310867, + 0.739608776755631, + 0.19249634817242622, + 0.548772782087326, + 0.929935660213232, + 0.08000030741095543, + 0.35523952543735504, + 0.38262050598859787, + 0.6134483497589827, + 0.4211268164217472, + 0.3744899984449148, + 1.2408165708184242, + 0.15404083020985126, + 0.9475805386900902, + 0.14191586896777153, + 0.27688949555158615, + 0.3020678535103798, + 0.45361851155757904, + 0.8619177788496017, + 0.47022514417767525, + 1.1839692238718271, + 0.5209123883396387, + 0.6263540331274271, + 0.580273874104023, + 0.3801657147705555, + 0.4831846095621586, + 0.1699100397527218, + 0.5031372336670756, + 0.23946708999574184, + 0.48256664350628853, + 0.33913454413414, + 2.3726864233613014, + 1.4236347619444132, + 0.31505613774061203, + 0.3539612703025341, + 0.20606905221939087, + 0.8825822565704584, + 0.42354028671979904, + 0.29342178627848625, + 1.7132034208625555, + 0.0 + ], + "unique_experts": 62, + "load_cv": 0.6860155129081391, + "normalized_load_entropy": 0.9426328648986408, + "max_load_share": 0.04583333333333333 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "935279d4c67b80598100de4e7c453e5a5a7e38e36abbbbe1198bacbc5fa2f246", + "route_weight_sha256": "f076554dea8cd49263aaed6ac218acba0ad4854ba16bec895c3a186badcd240d", + "loads": [ + 23, + 1, + 10, + 21, + 13, + 27, + 12, + 2, + 14, + 9, + 37, + 9, + 13, + 15, + 30, + 25, + 30, + 12, + 33, + 7, + 31, + 15, + 2, + 1, + 20, + 3, + 16, + 18, + 2, + 8, + 11, + 11, + 9, + 18, + 29, + 4, + 17, + 11, + 4, + 7, + 11, + 21, + 13, + 22, + 14, + 9, + 9, + 7, + 5, + 4, + 7, + 8, + 12, + 15, + 15, + 35, + 4, + 8, + 5, + 12, + 15, + 10, + 23, + 6 + ], + "weighted_loads": [ + 1.5676376316696405, + 0.053238894790410995, + 0.5902511440217495, + 0.9720024541020393, + 0.7307365611195564, + 1.7866776771843433, + 0.49283889308571815, + 0.07260502502322197, + 0.75080531463027, + 1.6366969607770443, + 2.5245083309710026, + 0.3577967118471861, + 0.5276598818600178, + 0.5585065688937902, + 3.189300201833248, + 4.341886822134256, + 1.421599451918155, + 0.7964448500424623, + 1.7495179995894432, + 0.3281503820326179, + 2.976436721161008, + 1.0417430065572262, + 0.12129072472453117, + 0.027126330882310867, + 1.2058792943134904, + 0.19249634817242622, + 0.9278250262141228, + 0.929935660213232, + 0.08000030741095543, + 0.35523952543735504, + 0.4763243831694126, + 0.6134483497589827, + 0.4621869809925556, + 0.7544434741139412, + 1.2408165708184242, + 0.15404083020985126, + 0.9475805386900902, + 0.605149382725358, + 0.27688949555158615, + 0.3020678535103798, + 0.5463591068983078, + 1.7332518063485622, + 0.6007291227579117, + 1.3143170606344938, + 0.7035472635179758, + 0.6990286577492952, + 0.580273874104023, + 0.43181542307138443, + 0.4831846095621586, + 0.1699100397527218, + 0.5031372336670756, + 0.34097818098962307, + 0.5104866567999125, + 1.123495800420642, + 2.3726864233613014, + 2.2178259883075953, + 0.31505613774061203, + 0.3539612703025341, + 0.20606905221939087, + 0.8825822565704584, + 0.6562681458890438, + 0.342911031562835, + 1.7132034208625555, + 0.26112575083971024 + ], + "unique_experts": 64, + "load_cv": 0.6553579088085112, + "normalized_load_entropy": 0.9488938145168434, + "max_load_share": 0.04252873563218391 + } + }, + "s1_eos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "6cec01546c26a72fa8875cacbbabaed0ba1c7a465dcce376b77f2dfd417e9ae1", + "route_weight_sha256": "5e84012a0f176199de8a262e0b50835563170f8983ad2d33f57282cb3e2fda22", + "loads": [ + 23, + 1, + 10, + 19, + 12, + 15, + 9, + 2, + 14, + 5, + 33, + 8, + 15, + 15, + 30, + 19, + 17, + 9, + 26, + 6, + 21, + 13, + 0, + 2, + 15, + 3, + 12, + 21, + 1, + 9, + 7, + 11, + 7, + 11, + 29, + 5, + 16, + 3, + 4, + 5, + 13, + 12, + 11, + 18, + 10, + 8, + 8, + 6, + 5, + 8, + 7, + 3, + 14, + 4, + 16, + 26, + 4, + 8, + 3, + 12, + 11, + 8, + 22, + 0 + ], + "weighted_loads": [ + 1.5260547008365393, + 0.04897012934088707, + 0.6031461916863918, + 0.8945092298090458, + 0.7636936288326979, + 0.8931061122566462, + 0.3544183596968651, + 0.07459433376789093, + 0.743581760674715, + 0.20793204009532928, + 2.194024806842208, + 0.3108502943068743, + 0.6480030808597803, + 0.5948335155844688, + 3.169535495340824, + 3.656346295028925, + 0.6874792147427797, + 0.5545321367681026, + 1.0899770762771368, + 0.31701724603772163, + 2.0431077163666487, + 0.9365781284868717, + 0.0, + 0.07180938683450222, + 0.7255168296396732, + 0.19380685314536095, + 0.5837181117385626, + 1.135839581489563, + 0.0354195274412632, + 0.4052046462893486, + 0.303394565358758, + 0.6072965040802956, + 0.39846381545066833, + 0.40767221711575985, + 1.2858339454978704, + 0.16642592288553715, + 0.9108143728226423, + 0.18045414611697197, + 0.2752194292843342, + 0.2325783520936966, + 0.6340785995125771, + 0.9348408915102482, + 0.485878873616457, + 1.0930660162121058, + 0.45624048821628094, + 0.5931311082094908, + 0.5722030438482761, + 0.37851381301879883, + 0.46493031084537506, + 0.3039198648184538, + 0.48991939797997475, + 0.13807662948966026, + 0.6852986682206392, + 0.3482363186776638, + 2.498828452080488, + 1.408636910840869, + 0.3080291897058487, + 0.3417175877839327, + 0.12540224939584732, + 0.8680331241339445, + 0.4309699758887291, + 0.2987521328032017, + 1.5962288044393063, + 0.0 + ], + "unique_experts": 62, + "load_cv": 0.680776608090684, + "normalized_load_entropy": 0.9429588021895204, + "max_load_share": 0.04583333333333333 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "118415034c8566cdb5c5bc84ce8674e01da2316696b851b57c9be6c75ebb7875", + "route_weight_sha256": "de376cea7f2b5b16808b4922d6443358b5d30e6eca1e6c94c80d66cee718cc30", + "loads": [ + 23, + 4, + 10, + 21, + 12, + 24, + 14, + 3, + 14, + 9, + 40, + 9, + 15, + 18, + 31, + 29, + 28, + 18, + 36, + 8, + 32, + 15, + 3, + 3, + 28, + 3, + 24, + 21, + 1, + 9, + 11, + 11, + 12, + 18, + 30, + 7, + 16, + 12, + 6, + 8, + 16, + 27, + 15, + 22, + 13, + 12, + 9, + 12, + 7, + 12, + 13, + 5, + 14, + 16, + 16, + 36, + 6, + 8, + 3, + 14, + 15, + 9, + 25, + 5 + ], + "weighted_loads": [ + 1.5260547008365393, + 0.17220383137464523, + 0.6031461916863918, + 0.9855060242116451, + 0.7636936288326979, + 1.7663481403142214, + 0.607541311532259, + 0.0998199563473463, + 0.743581760674715, + 1.6083043031394482, + 2.4939862210303545, + 0.3413457050919533, + 0.6480030808597803, + 0.6872721891850233, + 3.221307598054409, + 4.722800869494677, + 1.186036376748234, + 1.2151820808649063, + 1.960067953914404, + 0.35439157229848206, + 2.99459071084857, + 1.025189783424139, + 0.11605549976229668, + 0.14933017455041409, + 1.7732916623353958, + 0.19380685314536095, + 1.897140821442008, + 1.135839581489563, + 0.0354195274412632, + 0.4052046462893486, + 0.45838987454771996, + 0.6072965040802956, + 0.616244126111269, + 0.6878636600449681, + 1.3212011959403753, + 0.2923585344105959, + 0.9108143728226423, + 0.6618150323629379, + 0.39865123480558395, + 0.4069894440472126, + 0.7383771073073149, + 2.801926851272583, + 0.6499217189848423, + 1.3110872339457273, + 0.5957680530846119, + 0.7909068446606398, + 0.602718897163868, + 0.6734971180558205, + 0.5613573119044304, + 0.4988346863538027, + 0.7480147406458855, + 0.2097802348434925, + 0.6852986682206392, + 1.4209113866090775, + 2.498828452080488, + 2.334611801430583, + 0.415760800242424, + 0.3417175877839327, + 0.12540224939584732, + 1.0988053977489471, + 0.6197722516953945, + 0.30061245360411704, + 1.9166569449007511, + 0.2396800620481372 + ], + "unique_experts": 64, + "load_cv": 0.609100441453571, + "normalized_load_entropy": 0.9556840364396553, + "max_load_share": 0.041407867494824016 + } + }, + "s0_bos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "726f42f7047f1a8a2912d3da14613073ca136bfdfbfc445ea27e9df1504e2f3a", + "route_weight_sha256": "ebde1efaf4dc434a1d25b2fc2a1d4910ab038eba06706e160d53ed72de2a7d4d", + "loads": [ + 22, + 1, + 12, + 16, + 17, + 15, + 6, + 2, + 14, + 5, + 32, + 10, + 10, + 13, + 31, + 19, + 21, + 8, + 25, + 6, + 19, + 13, + 0, + 2, + 18, + 3, + 14, + 14, + 1, + 10, + 10, + 10, + 8, + 8, + 24, + 4, + 18, + 4, + 4, + 9, + 13, + 12, + 11, + 20, + 8, + 9, + 8, + 7, + 6, + 8, + 8, + 5, + 11, + 4, + 17, + 24, + 4, + 6, + 4, + 12, + 12, + 6, + 27, + 0 + ], + "weighted_loads": [ + 1.5378126744180918, + 0.058009788393974304, + 0.6870082058012486, + 0.7761169821023941, + 0.9325336627662182, + 0.8866504710167646, + 0.23282499238848686, + 0.06607465445995331, + 0.7474490515887737, + 0.26796935871243477, + 2.2078580111265182, + 0.3992362264543772, + 0.3984608594328165, + 0.5174453053623438, + 3.224431235343218, + 4.073773447424173, + 0.8835441414266825, + 0.5626001469790936, + 1.0403478536754847, + 0.29562750831246376, + 2.024686958640814, + 0.9386589527130127, + 0.0, + 0.07873804867267609, + 0.808072442188859, + 0.1990862488746643, + 0.7221481073647738, + 0.8397645354270935, + 0.031214332208037376, + 0.4136902950704098, + 0.4222558066248894, + 0.6362972874194384, + 0.4731026440858841, + 0.3036553207784891, + 1.203950833529234, + 0.15525320544838905, + 1.0038854219019413, + 0.2077102717012167, + 0.29163535311818123, + 0.39566029235720634, + 0.6059104669839144, + 0.8909030389040709, + 0.5274957753717899, + 1.152929374948144, + 0.37881384417414665, + 0.7504856158047915, + 0.559762654826045, + 0.44298550859093666, + 0.5165926739573479, + 0.33278345316648483, + 0.5682859886437654, + 0.17877747118473053, + 0.49333168007433414, + 0.3460308760404587, + 2.4946864768862724, + 1.4058238696306944, + 0.3164675347507, + 0.26414722949266434, + 0.16878637298941612, + 0.8306305203586817, + 0.4491918068379164, + 0.2158325258642435, + 1.8586845360696316, + 0.0 + ], + "unique_experts": 62, + "load_cv": 0.6631388138389678, + "normalized_load_entropy": 0.9456842309806649, + "max_load_share": 0.044444444444444446 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "8cce9e0e721ac43d47cc5e11b3efa38243246c456c9cb05c96a5165046924641", + "route_weight_sha256": "3763f26b35274afacfdace65fbad8b902f0cd03ad70d3d992e8b958aa9459260", + "loads": [ + 22, + 1, + 12, + 16, + 17, + 24, + 10, + 2, + 14, + 8, + 37, + 11, + 11, + 15, + 31, + 25, + 29, + 11, + 31, + 8, + 30, + 15, + 2, + 2, + 22, + 3, + 20, + 14, + 1, + 10, + 12, + 10, + 9, + 15, + 25, + 4, + 18, + 12, + 4, + 9, + 15, + 22, + 14, + 22, + 11, + 10, + 8, + 8, + 6, + 9, + 9, + 7, + 11, + 15, + 17, + 34, + 4, + 6, + 4, + 12, + 14, + 8, + 27, + 5 + ], + "weighted_loads": [ + 1.5378126744180918, + 0.058009788393974304, + 0.6870082058012486, + 0.7761169821023941, + 0.9325336627662182, + 1.7105200979858637, + 0.41290655359625816, + 0.06607465445995331, + 0.7474490515887737, + 0.72889818623662, + 2.5285582058131695, + 0.4417997021228075, + 0.4742920119315386, + 0.5791579876095057, + 3.224431235343218, + 4.544519819319248, + 1.8161247912794352, + 0.8006935697048903, + 1.6193855218589306, + 0.36714867129921913, + 2.983753614127636, + 1.0184586942195892, + 0.12129072472453117, + 0.07873804867267609, + 1.2400143798440695, + 0.1990862488746643, + 1.1069125346839428, + 0.8397645354270935, + 0.031214332208037376, + 0.4136902950704098, + 0.5159596838057041, + 0.6362972874194384, + 0.5141628086566925, + 0.6713376063853502, + 1.3244600780308247, + 0.15525320544838905, + 1.0038854219019413, + 0.645694250240922, + 0.29163535311818123, + 0.39566029235720634, + 0.6986510623246431, + 1.7489537168294191, + 0.6677184961736202, + 1.2894843835383654, + 0.529690895229578, + 0.8231602404266596, + 0.559762654826045, + 0.48386789858341217, + 0.5165926739573479, + 0.3767188563942909, + 0.6149121392518282, + 0.28028856217861176, + 0.49333168007433414, + 1.1303921323269606, + 2.4946864768862724, + 2.2000150959938765, + 0.3164675347507, + 0.26414722949266434, + 0.16878637298941612, + 0.8306305203586817, + 0.5737619865685701, + 0.31081645004451275, + 1.8586845360696316, + 0.24679681472480297 + ], + "unique_experts": 64, + "load_cv": 0.6355771005626915, + "normalized_load_entropy": 0.9514072866197908, + "max_load_share": 0.04252873563218391 + } + }, + "s1_bos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "465935d16a5879e3d3ee9b8cf951b60ee24feb92ea81c6c8b75bdad1fefe14e9", + "route_weight_sha256": "bb90226b81a8e1af5b8ed5240c88fba1ad104124e79385556c5817a049bae4fc", + "loads": [ + 24, + 1, + 11, + 13, + 14, + 17, + 7, + 2, + 14, + 6, + 34, + 10, + 14, + 14, + 31, + 19, + 19, + 8, + 22, + 6, + 19, + 13, + 0, + 2, + 16, + 3, + 14, + 15, + 1, + 11, + 8, + 11, + 7, + 10, + 28, + 2, + 16, + 4, + 3, + 3, + 12, + 14, + 8, + 18, + 11, + 7, + 8, + 6, + 7, + 8, + 8, + 6, + 13, + 4, + 17, + 27, + 4, + 8, + 4, + 12, + 13, + 7, + 26, + 0 + ], + "weighted_loads": [ + 1.6536920052021742, + 0.05728195607662201, + 0.6608780547976494, + 0.6323707401752472, + 0.8716901149600744, + 0.9400244802236557, + 0.27143533900380135, + 0.07105225324630737, + 0.7363267708569765, + 0.3115180879831314, + 2.2581704556941986, + 0.38788577541708946, + 0.6214354708790779, + 0.5401599910110235, + 3.2227542251348495, + 3.898951880633831, + 0.8140800688415766, + 0.5047276206314564, + 0.9635105207562447, + 0.29753493517637253, + 1.9853446148335934, + 0.9480578191578388, + 0.0, + 0.08142244070768356, + 0.7745855990797281, + 0.20244987308979034, + 0.7030108086764812, + 0.9331799782812595, + 0.02939268946647644, + 0.4554784335196018, + 0.3394999224692583, + 0.6327208243310452, + 0.35945698246359825, + 0.3542256895452738, + 1.284525891765952, + 0.07826629281044006, + 0.8915260583162308, + 0.221120560541749, + 0.2416407261043787, + 0.13881685212254524, + 0.5554802808910608, + 0.9359921421855688, + 0.3946717120707035, + 1.0896359775215387, + 0.5131454356014729, + 0.6790024023503065, + 0.5721950232982635, + 0.3869229517877102, + 0.5623089633882046, + 0.3200453780591488, + 0.5571106448769569, + 0.2328171730041504, + 0.613959014415741, + 0.36354440823197365, + 2.5578412003815174, + 1.495788924396038, + 0.31412558257579803, + 0.3557605743408203, + 0.1597517654299736, + 0.8659929502755404, + 0.4856782555580139, + 0.263150354847312, + 1.832149464637041, + 0.0 + ], + "unique_experts": 62, + "load_cv": 0.680776608090684, + "normalized_load_entropy": 0.9430491546069137, + "max_load_share": 0.04722222222222222 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "f152d1c6428742afdd5242c0e6928a9756ab8782034d8d986426de761df47135", + "route_weight_sha256": "3a5c06ff92bc10bf9a8e98ee2a75e2dfc12f9db11d491015e70f0e68768da718", + "loads": [ + 24, + 4, + 11, + 15, + 14, + 25, + 12, + 3, + 14, + 10, + 42, + 11, + 14, + 17, + 32, + 29, + 29, + 17, + 32, + 6, + 30, + 15, + 3, + 3, + 27, + 3, + 26, + 15, + 1, + 11, + 12, + 11, + 12, + 19, + 30, + 4, + 16, + 14, + 5, + 6, + 15, + 30, + 11, + 21, + 17, + 11, + 9, + 12, + 9, + 12, + 14, + 8, + 13, + 16, + 17, + 37, + 6, + 8, + 4, + 13, + 18, + 7, + 29, + 5 + ], + "weighted_loads": [ + 1.6536920052021742, + 0.18051565811038017, + 0.6608780547976494, + 0.7233675345778465, + 0.8716901149600744, + 1.7675739899277687, + 0.5188416764140129, + 0.09627787582576275, + 0.7363267708569765, + 0.8089323192834854, + 2.6096102632582188, + 0.41838118620216846, + 0.6214354708790779, + 0.632598664611578, + 3.2745263278484344, + 4.9340935833752155, + 1.7311826329678297, + 1.1701009273529053, + 1.8523358758538961, + 0.29753493517637253, + 2.9368276093155146, + 1.0366694740951061, + 0.11605549976229668, + 0.15894322842359543, + 1.7473187167197466, + 0.20244987308979034, + 2.022018138319254, + 0.9331799782812595, + 0.02939268946647644, + 0.4554784335196018, + 0.4944952316582203, + 0.6327208243310452, + 0.5772372931241989, + 0.756763843819499, + 1.3647626545280218, + 0.2041989043354988, + 0.8915260583162308, + 0.7422272320836782, + 0.36507253162562847, + 0.31322794407606125, + 0.6597787886857986, + 2.795307656750083, + 0.5319517441093922, + 1.2788943406194448, + 0.7458282206207514, + 0.8767781388014555, + 0.6027108766138554, + 0.6819062568247318, + 0.6587359644472599, + 0.5149601995944977, + 0.8218975588679314, + 0.30452077835798264, + 0.613959014415741, + 1.4362194761633873, + 2.5578412003815174, + 2.421763814985752, + 0.42185719311237335, + 0.3557605743408203, + 0.1597517654299736, + 1.0735206622630358, + 0.7273719105869532, + 0.263150354847312, + 2.152577605098486, + 0.279148580506444 + ], + "unique_experts": 64, + "load_cv": 0.6180427665768252, + "normalized_load_entropy": 0.9546766805396305, + "max_load_share": 0.043478260869565216 + } + }, + "s0_x": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "2feb5de75eff8cb41f56428bbe27ede5d1897a03f1afdf5152446204cc30ab97", + "route_weight_sha256": "c98b76eddb136ab0b2a4002689e3c76251976e0bd88defb7d6ddbf0bb5ed3b42", + "loads": [ + 24, + 1, + 11, + 15, + 14, + 15, + 6, + 2, + 14, + 7, + 33, + 9, + 13, + 13, + 31, + 19, + 19, + 8, + 24, + 6, + 19, + 13, + 0, + 2, + 16, + 3, + 12, + 16, + 2, + 10, + 8, + 10, + 9, + 11, + 25, + 4, + 18, + 5, + 4, + 5, + 15, + 12, + 12, + 18, + 8, + 9, + 7, + 6, + 6, + 6, + 10, + 6, + 12, + 4, + 18, + 24, + 4, + 6, + 4, + 12, + 12, + 5, + 28, + 0 + ], + "weighted_loads": [ + 1.6358979679644108, + 0.05374499782919884, + 0.6044155620038509, + 0.7424756959080696, + 0.8662445098161697, + 0.8692344725131989, + 0.24676546454429626, + 0.07565166801214218, + 0.7484711837023497, + 0.3305685631930828, + 2.2960211783647537, + 0.362616702914238, + 0.5334395002573729, + 0.4998829234391451, + 3.268050916492939, + 4.203246023505926, + 0.784134354442358, + 0.5677403062582016, + 1.017945360392332, + 0.31127119064331055, + 2.1522155851125717, + 0.9387401379644871, + 0.0, + 0.07826096192002296, + 0.8040465014055371, + 0.18066084757447243, + 0.6645394321531057, + 0.9340590666979551, + 0.07190640456974506, + 0.41703339479863644, + 0.34465714544057846, + 0.5945358667522669, + 0.4917754717171192, + 0.4067356064915657, + 1.1696964986622334, + 0.15958450362086296, + 0.984858326613903, + 0.25282291881740093, + 0.2978425547480583, + 0.20961418375372887, + 0.6423665322363377, + 0.8746322840452194, + 0.5493221189826727, + 1.1301025487482548, + 0.3674907796084881, + 0.8152151275426149, + 0.5467242877930403, + 0.4001423716545105, + 0.5390487499535084, + 0.2605186142027378, + 0.6545145586133003, + 0.22737104259431362, + 0.5268511176109314, + 0.34714144095778465, + 2.5599557235836983, + 1.4599574599415064, + 0.31823720037937164, + 0.2622650135308504, + 0.17871101200580597, + 0.8741152454167604, + 0.4419149048626423, + 0.18127643689513206, + 1.9463223721832037, + 0.0 + ], + "unique_experts": 62, + "load_cv": 0.6662961933584423, + "normalized_load_entropy": 0.9459034020367814, + "max_load_share": 0.04583333333333333 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "cca4289acbf4295156a2cfa419c0ff47aa9c8f46dd001b6470511b9aed2c2864", + "route_weight_sha256": "57256317da56c84152c2fd12cf124295bbff3fb1239e7fee35a21a1b79dc040f", + "loads": [ + 24, + 1, + 11, + 15, + 14, + 24, + 10, + 2, + 14, + 8, + 38, + 9, + 13, + 14, + 31, + 25, + 26, + 13, + 30, + 7, + 32, + 16, + 2, + 2, + 22, + 3, + 17, + 16, + 2, + 10, + 11, + 10, + 11, + 15, + 25, + 4, + 18, + 14, + 4, + 5, + 17, + 21, + 15, + 20, + 11, + 10, + 7, + 7, + 6, + 6, + 11, + 8, + 13, + 16, + 18, + 35, + 4, + 6, + 4, + 12, + 15, + 6, + 28, + 6 + ], + "weighted_loads": [ + 1.6358979679644108, + 0.05374499782919884, + 0.6044155620038509, + 0.7424756959080696, + 0.8662445098161697, + 1.6789566855877638, + 0.43134651333093643, + 0.07565166801214218, + 0.7484711837023497, + 0.7087047509849072, + 2.604571860283613, + 0.362616702914238, + 0.5334395002573729, + 0.5189565662294626, + 3.268050916492939, + 4.771502796560526, + 1.1209655813872814, + 0.8685452323406935, + 1.6895993631333113, + 0.35073327645659447, + 3.4010146260261536, + 1.0522816590964794, + 0.12129072472453117, + 0.07826096192002296, + 1.3727038400247693, + 0.18066084757447243, + 1.0106607545167208, + 0.9340590666979551, + 0.07190640456974506, + 0.41703339479863644, + 0.4845593757927418, + 0.5945358667522669, + 0.6067187525331974, + 0.6403841935098171, + 1.1696964986622334, + 0.15958450362086296, + 0.984858326613903, + 0.7242717538028955, + 0.2978425547480583, + 0.20961418375372887, + 0.7351071275770664, + 1.6826984733343124, + 0.6827711295336485, + 1.2922561503946781, + 0.5296988412737846, + 0.8878897521644831, + 0.5467242877930403, + 0.44747720658779144, + 0.5390487499535084, + 0.2605186142027378, + 0.6903547421097755, + 0.32888213358819485, + 0.5557519420981407, + 1.2623563054949045, + 2.5599557235836983, + 2.366561906412244, + 0.31823720037937164, + 0.2622650135308504, + 0.17871101200580597, + 0.8741152454167604, + 0.6359474137425423, + 0.22893080115318298, + 1.9463223721832037, + 0.30489701591432095 + ], + "unique_experts": 64, + "load_cv": 0.6436412140463644, + "normalized_load_entropy": 0.9504283782969667, + "max_load_share": 0.04367816091954023 + } + }, + "s1_x": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "a0e5e3c8409644d8681a72d4ff3641b5f16b777d78e537ebf84452778029aeb6", + "route_weight_sha256": "3a19847482683e5cd32df339bd8fb07ef1ef8a9467843bef7a08cdaaa97276a3", + "loads": [ + 25, + 1, + 11, + 17, + 15, + 15, + 7, + 2, + 13, + 6, + 34, + 8, + 12, + 9, + 31, + 19, + 21, + 9, + 22, + 7, + 20, + 14, + 1, + 2, + 19, + 3, + 13, + 18, + 1, + 7, + 7, + 10, + 8, + 11, + 30, + 3, + 16, + 4, + 2, + 5, + 12, + 14, + 8, + 15, + 12, + 8, + 9, + 4, + 8, + 7, + 7, + 6, + 13, + 4, + 17, + 25, + 4, + 4, + 5, + 12, + 13, + 7, + 28, + 0 + ], + "weighted_loads": [ + 1.6369457356631756, + 0.05361403524875641, + 0.6026391945779324, + 0.8269100766628981, + 0.8915338609367609, + 0.8702008854597807, + 0.27630411460995674, + 0.0729810893535614, + 0.6963177509605885, + 0.2585717812180519, + 2.2902893777936697, + 0.35191576182842255, + 0.5176382586359978, + 0.4006496872752905, + 3.355448141694069, + 3.7390988431870937, + 0.8124873284250498, + 0.5267107803374529, + 0.9569250606000423, + 0.33693598955869675, + 2.0945936366915703, + 0.9673016807064414, + 0.03514968231320381, + 0.07915413752198219, + 0.9314722679555416, + 0.1865948922932148, + 0.6775258835405111, + 1.0666920021176338, + 0.02944229543209076, + 0.3325826935470104, + 0.28149775229394436, + 0.5879782401025295, + 0.36816033348441124, + 0.4261411502957344, + 1.3599684312939644, + 0.09161563031375408, + 0.8709108978509903, + 0.2045357394963503, + 0.1978170908987522, + 0.2164115272462368, + 0.5579563323408365, + 0.8583066519349813, + 0.36374909803271294, + 0.9499024786055088, + 0.520187733694911, + 0.695638082921505, + 0.5866571012884378, + 0.32020560279488564, + 0.6121225543320179, + 0.28868404030799866, + 0.5249964650720358, + 0.24064456671476364, + 0.6059780139476061, + 0.37329625710844994, + 2.562382198870182, + 1.4793489128351212, + 0.30247562751173973, + 0.1784286592155695, + 0.22587282210588455, + 0.9227336309850216, + 0.48247277922928333, + 0.2512834966182709, + 1.8699654377996922, + 0.0 + ], + "unique_experts": 63, + "load_cv": 0.6990293093344814, + "normalized_load_entropy": 0.9417119809477648, + "max_load_share": 0.04722222222222222 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "a40aab7202cee37bda5bf2418b44a09dfba176ba9e105e2e7fecb5a4b3adb48e", + "route_weight_sha256": "d9b95fe98e3c927b881af2d73fdddf4aa58096cfc1778dbd09e565af712e7ab9", + "loads": [ + 25, + 4, + 11, + 19, + 15, + 25, + 12, + 3, + 13, + 8, + 43, + 9, + 12, + 13, + 32, + 29, + 28, + 18, + 32, + 7, + 33, + 17, + 6, + 3, + 33, + 3, + 25, + 18, + 1, + 7, + 11, + 10, + 14, + 16, + 31, + 5, + 16, + 13, + 4, + 8, + 15, + 29, + 11, + 18, + 15, + 12, + 10, + 10, + 11, + 11, + 13, + 8, + 13, + 17, + 17, + 36, + 6, + 5, + 5, + 14, + 16, + 7, + 31, + 4 + ], + "weighted_loads": [ + 1.6369457356631756, + 0.17684773728251457, + 0.6026391945779324, + 0.9179068710654974, + 0.8915338609367609, + 1.7744971886277199, + 0.5373980551958084, + 0.09820671193301678, + 0.6963177509605885, + 0.6733633540570736, + 2.6718169525265694, + 0.38241117261350155, + 0.5176382586359978, + 0.5268550962209702, + 3.407220244407654, + 4.813001271337271, + 1.0736789982765913, + 1.1901571322232485, + 1.8287799190729856, + 0.33693598955869675, + 3.386057471856475, + 1.0924560828134418, + 0.2072731088846922, + 0.15667492523789406, + 2.1342902183532715, + 0.1865948922932148, + 1.9663270097225904, + 1.0666920021176338, + 0.02944229543209076, + 0.3325826935470104, + 0.43649306148290634, + 0.5879782401025295, + 0.6498100161552429, + 0.6445113513618708, + 1.3953356817364693, + 0.21754824183881283, + 0.8709108978509903, + 0.6858966257423162, + 0.321248896420002, + 0.3908226191997528, + 0.6622548401355743, + 2.5926516260951757, + 0.4947196952998638, + 1.1635751128196716, + 0.6497566364705563, + 0.893413819372654, + 0.6171729546040297, + 0.6151889078319073, + 0.739147499203682, + 0.48359886184334755, + 0.7752061206847429, + 0.3123481720685959, + 0.6059780139476061, + 1.5414138063788414, + 2.562382198870182, + 2.540835440158844, + 0.41020723804831505, + 0.24082610197365284, + 0.22587282210588455, + 1.1500554457306862, + 0.6109173353761435, + 0.2512834966182709, + 2.190393578261137, + 0.2359773200005293 + ], + "unique_experts": 64, + "load_cv": 0.6368437135018201, + "normalized_load_entropy": 0.9528417260719386, + "max_load_share": 0.044513457556935816 + } + }, + "s0_period": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "7e87e97d6292d68e2142b61031407ac1fee0cc3151d61dae23b18b6eedc73afc", + "route_weight_sha256": "21107da8175882a364ae6b422b05a0792a6a41e29a4ed82bbbc9bf0cd9a0281a", + "loads": [ + 25, + 1, + 13, + 15, + 15, + 14, + 6, + 2, + 14, + 7, + 32, + 10, + 9, + 12, + 31, + 19, + 20, + 9, + 26, + 6, + 19, + 13, + 0, + 1, + 18, + 3, + 10, + 13, + 2, + 9, + 8, + 10, + 9, + 10, + 24, + 4, + 17, + 5, + 4, + 6, + 11, + 12, + 10, + 20, + 9, + 9, + 7, + 6, + 7, + 7, + 10, + 4, + 12, + 4, + 19, + 26, + 4, + 8, + 5, + 11, + 11, + 9, + 28, + 0 + ], + "weighted_loads": [ + 1.6515150647610426, + 0.05312872305512428, + 0.6849721558392048, + 0.7397598177194595, + 0.8936638794839382, + 0.8302559219300747, + 0.2407625988125801, + 0.07153657451272011, + 0.7559647224843502, + 0.31109941005706787, + 2.260125854983926, + 0.41979755461215973, + 0.3768894299864769, + 0.48514724150300026, + 3.285544391721487, + 4.111841842532158, + 0.8139877747744322, + 0.5682023577392101, + 1.0884483363479376, + 0.3140176013112068, + 2.1296681091189384, + 0.9466653540730476, + 0.0, + 0.02883159928023815, + 0.8728202972561121, + 0.18606125563383102, + 0.6017305478453636, + 0.8069495819509029, + 0.07312973029911518, + 0.39172480814158916, + 0.3325858134776354, + 0.6155335567891598, + 0.4961773604154587, + 0.37491208873689175, + 1.0961941257119179, + 0.15286782942712307, + 0.9507185220718384, + 0.2462722845375538, + 0.2860915008932352, + 0.25301409140229225, + 0.5044785123318434, + 0.8649534936994314, + 0.48354915902018547, + 1.2104808241128922, + 0.42120775021612644, + 0.7784155029803514, + 0.5547545608133078, + 0.40252023190259933, + 0.5809409767389297, + 0.30275869742035866, + 0.6560148233547807, + 0.15399547666311264, + 0.49812357127666473, + 0.3463726304471493, + 2.641314236447215, + 1.5031489711254835, + 0.31349221989512444, + 0.33467704989016056, + 0.22936125099658966, + 0.8124046735465527, + 0.4061609823256731, + 0.303657665848732, + 1.9133240897208452, + 0.0 + ], + "unique_experts": 62, + "load_cv": 0.6709124061978012, + "normalized_load_entropy": 0.9455660787544728, + "max_load_share": 0.044444444444444446 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "0d4f68487be93b5f7a206a5cd0c4c02ec282d1aaa775e80bb532a08ab666eb06", + "route_weight_sha256": "0cb4ea869f801e91945f3d17789f2d64861ad6db17c1f67728a3ab1b7f0d7337", + "loads": [ + 25, + 1, + 13, + 15, + 15, + 24, + 10, + 2, + 14, + 8, + 38, + 11, + 9, + 14, + 31, + 25, + 27, + 14, + 32, + 7, + 32, + 15, + 3, + 1, + 24, + 3, + 15, + 13, + 2, + 9, + 11, + 10, + 10, + 15, + 24, + 4, + 17, + 13, + 4, + 6, + 13, + 21, + 12, + 22, + 13, + 10, + 7, + 7, + 7, + 7, + 10, + 6, + 13, + 15, + 19, + 37, + 4, + 8, + 5, + 11, + 14, + 10, + 28, + 5 + ], + "weighted_loads": [ + 1.6515150647610426, + 0.05312872305512428, + 0.6849721558392048, + 0.7397598177194595, + 0.8936638794839382, + 1.694322545081377, + 0.42774832621216774, + 0.07153657451272011, + 0.7559647224843502, + 0.6892355978488922, + 2.622632449492812, + 0.4466879069805145, + 0.3768894299864769, + 0.5481524355709553, + 3.285544391721487, + 4.66847737133503, + 1.2065968457609415, + 0.975684056058526, + 1.712816309183836, + 0.35347968712449074, + 3.2087989933788776, + 1.0264650955796242, + 0.1627531610429287, + 0.02883159928023815, + 1.4738602470606565, + 0.18606125563383102, + 0.9538055248558521, + 0.8069495819509029, + 0.07312973029911518, + 0.39172480814158916, + 0.49093384854495525, + 0.6155335567891598, + 0.5372375249862671, + 0.6478325147181749, + 1.0961941257119179, + 0.15286782942712307, + 0.9507185220718384, + 0.6842562630772591, + 0.2860915008932352, + 0.25301409140229225, + 0.5972191076725721, + 1.7110994402319193, + 0.5840872973203659, + 1.373806044459343, + 0.621276481077075, + 0.8510901276022196, + 0.5547545608133078, + 0.44111737981438637, + 0.5809409767389297, + 0.30275869742035866, + 0.6560148233547807, + 0.25550656765699387, + 0.5297869816422462, + 1.1307338867336512, + 2.641314236447215, + 2.3614006619900465, + 0.31349221989512444, + 0.33467704989016056, + 0.22936125099658966, + 0.8124046735465527, + 0.5923345182090998, + 0.3513120301067829, + 1.9133240897208452, + 0.25967890955507755 + ], + "unique_experts": 64, + "load_cv": 0.6534197165182069, + "normalized_load_entropy": 0.9499651400739038, + "max_load_share": 0.04367816091954023 + } + }, + "s1_period": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "9f7b4afccd72b8e659d7ea6ce784fb8c4d22891ac01353a3b39481bfd06f71bc", + "route_weight_sha256": "370415ff96c8555199ac66b6ff4025335966b5b247d3b27c1a0413cbd113664d", + "loads": [ + 26, + 1, + 11, + 15, + 15, + 16, + 7, + 2, + 13, + 8, + 33, + 7, + 13, + 11, + 31, + 19, + 18, + 10, + 25, + 8, + 20, + 13, + 0, + 2, + 18, + 3, + 11, + 18, + 1, + 7, + 6, + 10, + 7, + 10, + 26, + 3, + 16, + 4, + 3, + 5, + 13, + 14, + 8, + 15, + 12, + 8, + 9, + 5, + 7, + 8, + 9, + 6, + 12, + 4, + 19, + 27, + 4, + 5, + 4, + 12, + 12, + 5, + 29, + 1 + ], + "weighted_loads": [ + 1.6997356209903955, + 0.05333715304732323, + 0.6192389167845249, + 0.7222695760428905, + 0.9136905409395695, + 0.9184444639831781, + 0.2837887778878212, + 0.07306147739291191, + 0.7038799431174994, + 0.34078747406601906, + 2.2982484363019466, + 0.30739591270685196, + 0.5541294831782579, + 0.4597912784665823, + 3.3421392627060413, + 3.9143569320440292, + 0.7085277996957302, + 0.5386472772806883, + 1.0621013790369034, + 0.3718092516064644, + 2.0953032188117504, + 0.9544682651758194, + 0.0, + 0.07850524224340916, + 0.8847638461738825, + 0.1926048956811428, + 0.6138813830912113, + 1.061593959107995, + 0.029490962624549866, + 0.3317481391131878, + 0.25689690187573433, + 0.5926173720508814, + 0.3464280441403389, + 0.38372486643493176, + 1.1858276072889566, + 0.09196849167346954, + 0.8597967810928822, + 0.20642448775470257, + 0.2351660318672657, + 0.2205413170158863, + 0.5746248867362738, + 0.9058465287089348, + 0.35639055259525776, + 0.9804259706288576, + 0.5373773220926523, + 0.682138504460454, + 0.554824510589242, + 0.3400093615055084, + 0.5753388069570065, + 0.3253539800643921, + 0.5722391828894615, + 0.23399741761386395, + 0.5392594411969185, + 0.3645658381283283, + 2.642601627856493, + 1.5204963367432356, + 0.3052889034152031, + 0.22238079831004143, + 0.1887666955590248, + 0.921420831233263, + 0.44542386196553707, + 0.20005802065134048, + 1.9528148733079433, + 0.027732234448194504 + ], + "unique_experts": 63, + "load_cv": 0.6929984946450078, + "normalized_load_entropy": 0.9427774663758275, + "max_load_share": 0.04583333333333333 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "b7e91109ef2fba398d2b4b551f8fd16ef37cd48e449ffd6b47472602aac8d089", + "route_weight_sha256": "f03a7c01fae7dda2a5f5fe4103856bb0181b3271f912caf9c6931cd306164efa", + "loads": [ + 26, + 4, + 11, + 17, + 15, + 26, + 12, + 3, + 13, + 10, + 42, + 8, + 13, + 15, + 32, + 29, + 24, + 20, + 35, + 8, + 33, + 15, + 4, + 3, + 33, + 3, + 22, + 18, + 1, + 7, + 11, + 10, + 13, + 15, + 27, + 5, + 16, + 13, + 6, + 8, + 16, + 28, + 11, + 19, + 15, + 12, + 10, + 11, + 10, + 12, + 15, + 8, + 12, + 17, + 20, + 38, + 6, + 5, + 4, + 14, + 15, + 5, + 32, + 5 + ], + "weighted_loads": [ + 1.6997356209903955, + 0.1765708550810814, + 0.6192389167845249, + 0.8132663704454899, + 0.9136905409395695, + 1.8327449094504118, + 0.5384084358811378, + 0.09828709997236729, + 0.7038799431174994, + 0.7555790469050407, + 2.6848237738013268, + 0.33789132349193096, + 0.5541294831782579, + 0.5867811404168606, + 3.3939113654196262, + 4.921098560094833, + 0.9271881058812141, + 1.2768764402717352, + 1.9741939697414637, + 0.3718092516064644, + 3.1551264096051455, + 1.0430799201130867, + 0.1396521646529436, + 0.15602602995932102, + 2.14322223700583, + 0.1926048956811428, + 1.871717058122158, + 1.061593959107995, + 0.029490962624549866, + 0.3317481391131878, + 0.4739959482103586, + 0.5926173720508814, + 0.597303070127964, + 0.6035465896129608, + 1.2211948577314615, + 0.2179011031985283, + 0.8597967810928822, + 0.6877853740006685, + 0.4111253023147583, + 0.3949524089694023, + 0.6789233945310116, + 2.5662206411361694, + 0.48868718184530735, + 1.240267114713788, + 0.669083409011364, + 0.879914240911603, + 0.5853403639048338, + 0.6349926665425301, + 0.7135238870978355, + 0.520268801599741, + 0.8164159115403891, + 0.3057010229676962, + 0.5392594411969185, + 1.4930083900690079, + 2.6797971166670322, + 2.492384472861886, + 0.4130205139517784, + 0.22238079831004143, + 0.1887666955590248, + 1.1589267775416374, + 0.6148141901940107, + 0.20005802065134048, + 2.273243013769388, + 0.25965274684131145 + ], + "unique_experts": 64, + "load_cv": 0.6350102706254053, + "normalized_load_entropy": 0.9530422914292255, + "max_load_share": 0.043478260869565216 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 120, + "ordered_topk_exact_tokens": 53, + "set_exact_tokens": 68, + "mean_set_jaccard": 0.8601190476190477, + "mean_token_weighted_tv": 0.028740608133375645, + "aggregate_load_tv": 0.041666666666666664 + }, + "system_bos": { + "tokens": 120, + "ordered_topk_exact_tokens": 49, + "set_exact_tokens": 64, + "mean_set_jaccard": 0.8438492063492065, + "mean_token_weighted_tv": 0.032931089983321726, + "aggregate_load_tv": 0.05277777777777778 + }, + "system_x": { + "tokens": 120, + "ordered_topk_exact_tokens": 39, + "set_exact_tokens": 52, + "mean_set_jaccard": 0.7972222222222222, + "mean_token_weighted_tv": 0.04488731177989393, + "aggregate_load_tv": 0.05694444444444445 + }, + "system_period": { + "tokens": 120, + "ordered_topk_exact_tokens": 42, + "set_exact_tokens": 61, + "mean_set_jaccard": 0.8256746031746032, + "mean_token_weighted_tv": 0.0401256064302288, + "aggregate_load_tv": 0.055555555555555546 + }, + "bos_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 47, + "set_exact_tokens": 57, + "mean_set_jaccard": 0.828968253968254, + "mean_token_weighted_tv": 0.03666562970417241, + "aggregate_load_tv": 0.0638888888888889 + }, + "bos_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 42, + "set_exact_tokens": 58, + "mean_set_jaccard": 0.818452380952381, + "mean_token_weighted_tv": 0.038642561660769084, + "aggregate_load_tv": 0.052777777777777785 + }, + "x_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 40, + "set_exact_tokens": 57, + "mean_set_jaccard": 0.8267857142857143, + "mean_token_weighted_tv": 0.03909405026352033, + "aggregate_load_tv": 0.05972222222222223 + }, + "x_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 34, + "set_exact_tokens": 48, + "mean_set_jaccard": 0.7880952380952382, + "mean_token_weighted_tv": 0.04468746035126969, + "aggregate_load_tv": 0.0638888888888889 + }, + "period_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 40, + "set_exact_tokens": 57, + "mean_set_jaccard": 0.8307539682539683, + "mean_token_weighted_tv": 0.03762691638354833, + "aggregate_load_tv": 0.058333333333333334 + }, + "period_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 32, + "set_exact_tokens": 50, + "mean_set_jaccard": 0.7898809523809525, + "mean_token_weighted_tv": 0.04547759819154938, + "aggregate_load_tv": 0.0638888888888889 + } + } + }, + "layer_17": { + "layer": 17, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "a27d7d8d0c0c212f3f651673a103eb212999f37436eb245b662183c3e4393845", + "route_weight_sha256": "88289e05f44b38b6480169f42fb2c3b385f7fa84e2a3cbb96db68c09852ce8f3", + "loads": [ + 11, + 4, + 14, + 16, + 9, + 15, + 18, + 12, + 3, + 4, + 13, + 18, + 33, + 17, + 14, + 15, + 13, + 27, + 18, + 15, + 28, + 13, + 4, + 4, + 5, + 17, + 13, + 7, + 7, + 4, + 3, + 6, + 5, + 7, + 1, + 9, + 8, + 2, + 18, + 3, + 18, + 29, + 9, + 17, + 11, + 20, + 20, + 3, + 4, + 18, + 4, + 7, + 7, + 27, + 4, + 4, + 3, + 16, + 2, + 18, + 4, + 2, + 11, + 9 + ], + "weighted_loads": [ + 0.4173242226243019, + 0.14415550231933594, + 0.8199288789182901, + 2.0281429179012775, + 0.39456288143992424, + 1.3305089846253395, + 1.1788844652473927, + 0.924062579870224, + 0.12551714479923248, + 0.14530528336763382, + 0.7774615287780762, + 0.6797902341932058, + 1.460100907832384, + 1.2585498131811619, + 0.5668813772499561, + 0.6767470259219408, + 0.8103291168808937, + 4.949244340881705, + 2.1100601898506284, + 0.6489227619022131, + 1.6850224696099758, + 0.5015495456755161, + 0.13995016738772392, + 0.28472115099430084, + 0.21467962116003036, + 1.1129825599491596, + 0.7717365566641092, + 0.3706595189869404, + 0.3953067120164633, + 0.11861405707895756, + 0.12450564652681351, + 0.44339147582650185, + 0.17217476107180119, + 0.42569600977003574, + 0.04442623257637024, + 0.4795667193830013, + 0.5414371863007545, + 0.14610494300723076, + 1.816783171147108, + 0.18010634183883667, + 1.1895724385976791, + 1.469933770596981, + 0.5086755119264126, + 0.7473779562860727, + 0.4403731934726238, + 0.9090965930372477, + 1.0162664335221052, + 0.13200153224170208, + 0.14531791768968105, + 0.7087335344403982, + 0.2404860183596611, + 1.2906664200127125, + 0.42981570959091187, + 1.0594828929752111, + 0.1753578521311283, + 0.4074253514409065, + 0.1554207168519497, + 1.2871330194175243, + 0.14634720236063004, + 0.899540888145566, + 0.16733532398939133, + 0.06177998147904873, + 0.6467573530972004, + 0.6433036867529154 + ], + "unique_experts": 64, + "load_cv": 0.6764102780099743, + "normalized_load_entropy": 0.9453175332336642, + "max_load_share": 0.04583333333333333 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "3884710b0dfd163e9db95cfb2e24bdf8bcb906e40d2014c56488ce7467347505", + "route_weight_sha256": "7a3a76940e2817e29515b245c31ab8b099cde6eb66b4af2c8554b339b87933bb", + "loads": [ + 19, + 6, + 16, + 23, + 9, + 15, + 20, + 12, + 3, + 7, + 19, + 19, + 36, + 25, + 14, + 17, + 13, + 34, + 21, + 15, + 31, + 13, + 4, + 11, + 12, + 22, + 23, + 11, + 11, + 5, + 3, + 6, + 14, + 7, + 1, + 9, + 8, + 2, + 23, + 3, + 26, + 34, + 12, + 20, + 11, + 24, + 20, + 3, + 4, + 19, + 5, + 7, + 9, + 29, + 4, + 7, + 4, + 18, + 2, + 18, + 4, + 3, + 16, + 9 + ], + "weighted_loads": [ + 0.6748240701854229, + 0.22411436587572098, + 0.9188621062785387, + 2.6102234050631523, + 0.39456288143992424, + 1.3305089846253395, + 1.2782330103218555, + 0.924062579870224, + 0.12551714479923248, + 0.23420874774456024, + 1.1662407480180264, + 0.698262419551611, + 1.5594182219356298, + 1.8521555066108704, + 0.5668813772499561, + 0.765187980607152, + 0.8103291168808937, + 5.603804035112262, + 2.232100852765143, + 0.6489227619022131, + 1.9693229012191296, + 0.5015495456755161, + 0.13995016738772392, + 0.6028277315199375, + 0.7139082234352827, + 1.3636012524366379, + 2.5161948166787624, + 0.5452650431543589, + 0.5490193888545036, + 0.12386945122852921, + 0.12450564652681351, + 0.44339147582650185, + 0.5208611711859703, + 0.42569600977003574, + 0.04442623257637024, + 0.4795667193830013, + 0.5414371863007545, + 0.14610494300723076, + 2.0041359029710293, + 0.18010634183883667, + 2.105600018054247, + 1.6126876268535852, + 0.6862171292304993, + 0.8051897629629821, + 0.4403731934726238, + 1.7433887664228678, + 1.0162664335221052, + 0.13200153224170208, + 0.14531791768968105, + 0.7491706032305956, + 0.30613863468170166, + 1.2906664200127125, + 0.5924458354711533, + 1.1409507282078266, + 0.1753578521311283, + 0.5967053323984146, + 0.18636557459831238, + 1.3992080725729465, + 0.14634720236063004, + 0.899540888145566, + 0.16733532398939133, + 0.13158063404262066, + 1.0349798984825611, + 0.6433036867529154 + ], + "unique_experts": 64, + "load_cv": 0.6503065935462472, + "normalized_load_entropy": 0.9479495251539374, + "max_load_share": 0.041379310344827586 + } + }, + "s1_eos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "c1797934df1922fd8ea34c62f157bcf63f7e547e1f58ae02378c7e040ec25a58", + "route_weight_sha256": "145d100505a3c6c168cc2bfa55a756f6845e8d1a2f5a0f2d5753b890e041ef73", + "loads": [ + 10, + 4, + 13, + 17, + 9, + 16, + 17, + 12, + 3, + 5, + 13, + 13, + 40, + 18, + 17, + 17, + 12, + 27, + 18, + 14, + 30, + 12, + 4, + 3, + 7, + 15, + 14, + 8, + 9, + 6, + 2, + 5, + 4, + 6, + 1, + 9, + 8, + 1, + 17, + 3, + 18, + 26, + 10, + 19, + 11, + 18, + 19, + 3, + 3, + 18, + 4, + 8, + 7, + 26, + 3, + 6, + 4, + 16, + 2, + 15, + 3, + 0, + 12, + 10 + ], + "weighted_loads": [ + 0.36677078902721405, + 0.16871774196624756, + 0.7727953623980284, + 2.0443706288933754, + 0.38061296194791794, + 1.3322874829173088, + 1.123301163315773, + 0.9133152645081282, + 0.1294868364930153, + 0.18173096515238285, + 0.8113480787724257, + 0.5102932173758745, + 1.7909430228173733, + 1.2403957154601812, + 0.7132556941360235, + 0.7886192183941603, + 0.7942206971347332, + 5.029503086581826, + 2.0555878886952996, + 0.6469452790915966, + 1.7939883936196566, + 0.4681020714342594, + 0.14660555124282837, + 0.25628167390823364, + 0.27581605315208435, + 0.9976617898792028, + 0.7888664398342371, + 0.40299486741423607, + 0.45973808877170086, + 0.2061305269598961, + 0.10101965442299843, + 0.4091910645365715, + 0.143669705837965, + 0.38780444115400314, + 0.04212057590484619, + 0.46659107133746147, + 0.5371595472097397, + 0.09546719491481781, + 1.6905629504472017, + 0.17658157274127007, + 1.1735084876418114, + 1.3490980435162783, + 0.5151535645127296, + 0.8090504314750433, + 0.4236070644110441, + 0.8355082347989082, + 0.9590536411851645, + 0.13135552033782005, + 0.10576736554503441, + 0.7799931392073631, + 0.1965213194489479, + 1.2375419847667217, + 0.4229226913303137, + 1.0337295588105917, + 0.11863981932401657, + 0.41380568221211433, + 0.19736702740192413, + 1.297493152320385, + 0.14804696291685104, + 0.798214890062809, + 0.12164714187383652, + 0.0, + 0.6176292542368174, + 0.753868505358696 + ], + "unique_experts": 63, + "load_cv": 0.700088177867705, + "normalized_load_entropy": 0.9414938344538326, + "max_load_share": 0.05555555555555555 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "2dabb9154fbc2171bc1d5c893c405f9654ffeca0f84a843f58ac24986c5b9232", + "route_weight_sha256": "4e4eb4cc769404129c9b0e9cfe5f437ec81fc2be46a498edc5bc525b1ec5e451", + "loads": [ + 18, + 6, + 16, + 23, + 15, + 16, + 20, + 13, + 3, + 11, + 20, + 15, + 40, + 26, + 17, + 24, + 13, + 33, + 21, + 14, + 31, + 13, + 4, + 14, + 17, + 35, + 28, + 11, + 11, + 8, + 4, + 6, + 10, + 6, + 1, + 9, + 12, + 3, + 20, + 4, + 31, + 33, + 15, + 20, + 13, + 23, + 21, + 5, + 3, + 19, + 5, + 13, + 11, + 28, + 4, + 12, + 12, + 26, + 3, + 17, + 4, + 5, + 22, + 10 + ], + "weighted_loads": [ + 0.6744841206818819, + 0.24184667505323887, + 0.8770347312092781, + 2.6694709695875645, + 0.7757138013839722, + 1.3322874829173088, + 1.242293406277895, + 0.9704047460108995, + 0.1294868364930153, + 0.3703933022916317, + 1.3109735157340765, + 0.5771579034626484, + 1.7909430228173733, + 1.848846485838294, + 0.7132556941360235, + 1.1240932885557413, + 0.9299723915755749, + 5.596325980499387, + 2.166241784580052, + 0.6469452790915966, + 1.8615464139729738, + 0.5447760112583637, + 0.14660555124282837, + 1.0101646929979324, + 0.8801320777274668, + 2.2718411292880774, + 2.668609891086817, + 0.5331613346934319, + 0.546322463080287, + 0.29236388485878706, + 0.1956225223839283, + 0.44853489100933075, + 0.3256410202011466, + 0.38780444115400314, + 0.04212057590484619, + 0.46659107133746147, + 0.7649351134896278, + 0.16949701681733131, + 1.9858723860234022, + 0.21014640852808952, + 2.773740481585264, + 1.72732455143705, + 0.715602932497859, + 0.8278610166162252, + 0.6566719878464937, + 2.0461249202489853, + 1.180475203320384, + 0.26348163560032845, + 0.10576736554503441, + 0.821581955999136, + 0.3303626999258995, + 1.504694091156125, + 0.6749137807637453, + 1.1119640786200762, + 0.2079356610774994, + 0.8073945250362158, + 0.852343313395977, + 1.8497448489069939, + 0.17158378846943378, + 0.88753642141819, + 0.15723972022533417, + 0.2924683727324009, + 1.323783004656434, + 0.753868505358696 + ], + "unique_experts": 64, + "load_cv": 0.6086498764494946, + "normalized_load_entropy": 0.954167823141293, + "max_load_share": 0.041407867494824016 + } + }, + "s0_bos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "1b4d1e2dc82ad4a16fe09e2a36e3c6e5d38b23365bc0536e172f6f0a2c7f6e85", + "route_weight_sha256": "faa23c5cb7987055fcb99b4b654a4d64b1499c285a58b19d37ab19671c843f0a", + "loads": [ + 9, + 2, + 12, + 16, + 10, + 15, + 17, + 12, + 3, + 5, + 15, + 15, + 31, + 18, + 13, + 14, + 13, + 27, + 15, + 16, + 29, + 13, + 7, + 2, + 7, + 16, + 15, + 10, + 7, + 5, + 2, + 5, + 5, + 6, + 1, + 8, + 8, + 1, + 17, + 3, + 20, + 26, + 8, + 18, + 9, + 19, + 20, + 3, + 3, + 19, + 5, + 7, + 7, + 29, + 4, + 5, + 3, + 17, + 2, + 19, + 7, + 1, + 15, + 9 + ], + "weighted_loads": [ + 0.3347266651690006, + 0.06771205179393291, + 0.781441405415535, + 1.9518173802644014, + 0.4426484126597643, + 1.3687848635017872, + 1.1786022037267685, + 0.9256099592894316, + 0.12221234291791916, + 0.1869128905236721, + 0.8716010376811028, + 0.5989573150873184, + 1.364940108731389, + 1.2530707381665707, + 0.553320974111557, + 0.7012961693108082, + 0.7882270719856024, + 5.102278644219041, + 2.137560134753585, + 0.690341517329216, + 1.6818241365253925, + 0.5091203693300486, + 0.2642225604504347, + 0.23619269952178001, + 0.3057533986866474, + 1.096547044813633, + 0.9063526652753353, + 0.43636127933859825, + 0.37740871123969555, + 0.1792055033147335, + 0.10362885892391205, + 0.45986514165997505, + 0.16918286494910717, + 0.38473542034626007, + 0.048153940588235855, + 0.4517905246466398, + 0.5668787620961666, + 0.09410983324050903, + 1.825327167287469, + 0.192291721701622, + 1.2688733637332916, + 1.342474427074194, + 0.4837370328605175, + 0.7776322178542614, + 0.36703681387007236, + 0.8816985003650188, + 1.0254962015897036, + 0.12839144095778465, + 0.10126660391688347, + 0.7666223049163818, + 0.26533693075180054, + 1.364246129989624, + 0.41276731714606285, + 1.1113716941326857, + 0.15688185393810272, + 0.4591001085937023, + 0.15141547843813896, + 1.3204829599708319, + 0.14653895795345306, + 0.9336589463055134, + 0.27488692477345467, + 0.03218081220984459, + 0.8713380172848701, + 0.7248869352042675 + ], + "unique_experts": 64, + "load_cv": 0.6712803318663652, + "normalized_load_entropy": 0.9445495562979547, + "max_load_share": 0.043055555555555555 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "cfb97bfc94c30ae45f0d5893cdacf539966689457da2a5a702459833dd41aad6", + "route_weight_sha256": "248e2e46f12558d615f54bf808e0533af42ca135d1bd169425ee99f92d30885a", + "loads": [ + 16, + 4, + 13, + 23, + 10, + 15, + 19, + 12, + 3, + 8, + 21, + 16, + 35, + 26, + 13, + 16, + 13, + 34, + 18, + 17, + 32, + 14, + 7, + 9, + 14, + 21, + 23, + 13, + 11, + 5, + 2, + 5, + 14, + 6, + 1, + 8, + 8, + 1, + 22, + 3, + 28, + 30, + 11, + 20, + 9, + 23, + 20, + 3, + 3, + 21, + 6, + 7, + 9, + 31, + 5, + 8, + 4, + 19, + 2, + 20, + 7, + 2, + 22, + 9 + ], + "weighted_loads": [ + 0.608819030225277, + 0.15309369750320911, + 0.8387192338705063, + 2.533897867426276, + 0.4426484126597643, + 1.3687848635017872, + 1.2779507488012314, + 0.9256099592894316, + 0.12221234291791916, + 0.2758163549005985, + 1.260380256921053, + 0.6174295004457235, + 1.6322148814797401, + 1.8466764315962791, + 0.553320974111557, + 0.7858995646238327, + 0.7882270719856024, + 5.756838338449597, + 2.3947122413665056, + 0.7468156665563583, + 1.9809100069105625, + 0.5907766986638308, + 0.2642225604504347, + 0.5620305612683296, + 0.8254404459148645, + 1.3582960665225983, + 1.6268247701227665, + 0.5637395847588778, + 0.5299722701311111, + 0.1792055033147335, + 0.10362885892391205, + 0.45986514165997505, + 0.545179171487689, + 0.38473542034626007, + 0.048153940588235855, + 0.4517905246466398, + 0.5668787620961666, + 0.09410983324050903, + 2.0093079525977373, + 0.192291721701622, + 2.2077429741621017, + 1.4737578202039003, + 0.6551245506852865, + 0.8322703018784523, + 0.36703681387007236, + 1.5764810629189014, + 1.0254962015897036, + 0.12839144095778465, + 0.10126660391688347, + 0.9896412789821625, + 0.3309895470738411, + 1.364246129989624, + 0.5625328831374645, + 1.2113898526877165, + 0.23370687663555145, + 0.6526800282299519, + 0.18421617522835732, + 1.432558013126254, + 0.14653895795345306, + 0.9804143160581589, + 0.27488692477345467, + 0.13379929587244987, + 1.2732003591954708, + 0.7248869352042675 + ], + "unique_experts": 64, + "load_cv": 0.6509563885884375, + "normalized_load_entropy": 0.9470833375447795, + "max_load_share": 0.040229885057471264 + } + }, + "s1_bos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "a4868c05e3a0409627464bbed7138c30296b775f492acecaec2e79fe4644d03e", + "route_weight_sha256": "ab17b5d4451b6333855786b780089874771b5d19cc6dfbd9468ae7a09d46a905", + "loads": [ + 10, + 3, + 13, + 16, + 9, + 16, + 15, + 12, + 3, + 6, + 13, + 12, + 33, + 18, + 14, + 19, + 15, + 27, + 18, + 13, + 28, + 9, + 4, + 2, + 7, + 17, + 14, + 8, + 10, + 4, + 2, + 6, + 5, + 6, + 1, + 9, + 8, + 2, + 19, + 3, + 18, + 25, + 9, + 16, + 12, + 19, + 19, + 3, + 2, + 21, + 5, + 7, + 7, + 27, + 2, + 6, + 4, + 16, + 2, + 18, + 6, + 1, + 14, + 12 + ], + "weighted_loads": [ + 0.37828234396874905, + 0.10773984715342522, + 0.688613448292017, + 1.9622674137353897, + 0.4045643527060747, + 1.4018165059387684, + 1.1010114699602127, + 0.9244641065597534, + 0.1263326145708561, + 0.2251135241240263, + 0.7855369560420513, + 0.4655602443963289, + 1.444047348573804, + 1.2526791281998158, + 0.6169478762894869, + 0.8737773429602385, + 0.89641441591084, + 5.074110170826316, + 2.0518577052280307, + 0.6510847974568605, + 1.6380600184202194, + 0.37619861401617527, + 0.15934536419808865, + 0.22660068050026894, + 0.2915740869939327, + 1.052608821541071, + 0.8775827046483755, + 0.36504134722054005, + 0.4820392243564129, + 0.12428970821201801, + 0.10725631937384605, + 0.492234006524086, + 0.16600879840552807, + 0.3942675441503525, + 0.046517934650182724, + 0.46863595955073833, + 0.5691210441291332, + 0.12758177518844604, + 1.734806440770626, + 0.21028506010770798, + 1.2485403455793858, + 1.3338593542575836, + 0.5147953070700169, + 0.6984449103474617, + 0.46261759102344513, + 0.8825304973870516, + 0.9929667841643095, + 0.12613767199218273, + 0.07077806442975998, + 0.8764566164463758, + 0.22751747071743011, + 1.320661999285221, + 0.4179665148258209, + 1.0412764512002468, + 0.07107323594391346, + 0.4217304512858391, + 0.19437549263238907, + 1.286878228187561, + 0.14883573353290558, + 0.9133685547858477, + 0.23283319547772408, + 0.030435901135206223, + 0.7972737643867731, + 0.9179881662130356 + ], + "unique_experts": 64, + "load_cv": 0.6675919504799912, + "normalized_load_entropy": 0.9450442906263251, + "max_load_share": 0.04583333333333333 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "e262c9ec65967f25e470325d6bb35d1ab1078a2d87323a41c59318de85997d38", + "route_weight_sha256": "c145406dbaa0663366b19d954beebd2d4ba415f4c177b7ef93a7e6eeb824abe5", + "loads": [ + 17, + 8, + 16, + 22, + 15, + 16, + 18, + 13, + 3, + 12, + 20, + 14, + 35, + 26, + 14, + 25, + 16, + 33, + 21, + 13, + 29, + 10, + 4, + 13, + 16, + 37, + 26, + 11, + 10, + 5, + 4, + 7, + 11, + 6, + 1, + 9, + 12, + 4, + 22, + 4, + 32, + 31, + 14, + 17, + 14, + 24, + 21, + 5, + 2, + 23, + 7, + 12, + 11, + 28, + 3, + 13, + 12, + 26, + 3, + 20, + 7, + 6, + 25, + 12 + ], + "weighted_loads": [ + 0.6849753595888615, + 0.3357335012406111, + 0.7928528171032667, + 2.587367754429579, + 0.7996651921421289, + 1.4018165059387684, + 1.2200037129223347, + 0.9815535880625248, + 0.1263326145708561, + 0.4377027116715908, + 1.2851623930037022, + 0.5324249304831028, + 1.5533606763929129, + 1.8611298985779285, + 0.6169478762894869, + 1.1613227371126413, + 1.0321661103516817, + 5.6409330647438765, + 2.168500709347427, + 0.6510847974568605, + 1.7349740117788315, + 0.4528725538402796, + 0.15934536419808865, + 0.9951092712581158, + 0.8834367766976357, + 2.32380660623312, + 1.8325330708175898, + 0.4870378579944372, + 0.4820392243564129, + 0.205287242308259, + 0.20185918733477592, + 0.5315778329968452, + 0.3766794614493847, + 0.3942675441503525, + 0.046517934650182724, + 0.46863595955073833, + 0.7968966104090214, + 0.20161159709095955, + 2.0301158763468266, + 0.24384989589452744, + 2.9110450446605682, + 1.719272067770362, + 0.7192917969077826, + 0.7172554954886436, + 0.6956825144588947, + 2.187689470127225, + 1.214388346299529, + 0.2582637872546911, + 0.07077806442975998, + 0.956667935475707, + 0.41437358036637306, + 1.5878141056746244, + 0.6644065715372562, + 1.087182778865099, + 0.16036907769739628, + 0.8572097215801477, + 0.8528413064777851, + 1.83912992477417, + 0.17237255908548832, + 1.0026900861412287, + 0.2684257738292217, + 0.33032025396823883, + 1.5575367640703917, + 0.9179881662130356 + ], + "unique_experts": 64, + "load_cv": 0.5942822463089896, + "normalized_load_entropy": 0.9559177758069107, + "max_load_share": 0.038302277432712216 + } + }, + "s0_x": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "3099b7a2d597dec7910296fe3a529cdc563626f141e75dd677f5342b74d78069", + "route_weight_sha256": "f740a87ea56cb380a17e20aefd20d66a229d7c4521051784cae6256f3a7b51cb", + "loads": [ + 12, + 1, + 13, + 16, + 11, + 16, + 16, + 12, + 3, + 6, + 15, + 15, + 31, + 18, + 14, + 15, + 15, + 27, + 17, + 17, + 28, + 13, + 5, + 3, + 5, + 20, + 11, + 7, + 6, + 3, + 5, + 6, + 4, + 6, + 1, + 9, + 8, + 1, + 18, + 3, + 19, + 26, + 9, + 16, + 12, + 19, + 20, + 3, + 6, + 15, + 5, + 8, + 7, + 30, + 6, + 5, + 4, + 18, + 2, + 16, + 3, + 1, + 11, + 7 + ], + "weighted_loads": [ + 0.44515353068709373, + 0.03458606079220772, + 0.7182243969291449, + 1.9261474553495646, + 0.5218880921602249, + 1.4212339371442795, + 1.1615985874086618, + 0.9311699513345957, + 0.12786787003278732, + 0.2172339539974928, + 0.8335233367979527, + 0.6018294300884008, + 1.4101184736937284, + 1.265057273209095, + 0.5810521896928549, + 0.7208699211478233, + 0.8598666377365589, + 5.225971527397633, + 2.077045703306794, + 0.7483270280063152, + 1.6048017125576735, + 0.489197064191103, + 0.19341043382883072, + 0.2508594784885645, + 0.2535293810069561, + 1.3022868055850267, + 0.7013241276144981, + 0.3360886238515377, + 0.3576935064047575, + 0.09751657210290432, + 0.2219289466738701, + 0.5033681578934193, + 0.13732201606035233, + 0.3852923512458801, + 0.044594231992959976, + 0.47439378686249256, + 0.6294635124504566, + 0.08905069530010223, + 1.8938717059791088, + 0.19135648384690285, + 1.3739519827067852, + 1.4220576453953981, + 0.5133389718830585, + 0.7002352923154831, + 0.46427507139742374, + 0.8650795705616474, + 1.0307994820177555, + 0.1240853313356638, + 0.20854723826050758, + 0.6197149697691202, + 0.2631000988185406, + 1.4254861176013947, + 0.41427501291036606, + 1.1792340371757746, + 0.2489602342247963, + 0.4848977290093899, + 0.17642561718821526, + 1.4773935116827488, + 0.1500835344195366, + 0.783292431384325, + 0.11355116404592991, + 0.037047773599624634, + 0.7388059534132481, + 0.6139875687658787 + ], + "unique_experts": 64, + "load_cv": 0.6692542376166932, + "normalized_load_entropy": 0.9449767746158035, + "max_load_share": 0.043055555555555555 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "dfd6ac8bd1443b2cc68b6070b8cd13e7107728cc6c3d9f03241357826c5bba37", + "route_weight_sha256": "3c4f1895f730dfe09ba4eef4cc5d7ce4b8df9d030431e3be9e5621416147fa32", + "loads": [ + 18, + 2, + 15, + 24, + 11, + 16, + 18, + 12, + 3, + 10, + 22, + 16, + 33, + 27, + 14, + 17, + 15, + 35, + 20, + 17, + 30, + 14, + 5, + 11, + 12, + 27, + 18, + 10, + 10, + 3, + 5, + 6, + 12, + 6, + 1, + 9, + 8, + 1, + 23, + 3, + 27, + 30, + 12, + 18, + 12, + 23, + 20, + 3, + 7, + 16, + 7, + 8, + 10, + 31, + 7, + 9, + 5, + 20, + 2, + 16, + 3, + 2, + 16, + 7 + ], + "weighted_loads": [ + 0.6564007587730885, + 0.07056503742933273, + 0.8230905402451754, + 2.6590664219111204, + 0.5218880921602249, + 1.4212339371442795, + 1.2609471324831247, + 0.9311699513345957, + 0.12786787003278732, + 0.34971524961292744, + 1.3678975850343704, + 0.620301615446806, + 1.4744342379271984, + 1.89680315554142, + 0.5810521896928549, + 0.80803057923913, + 0.8598666377365589, + 5.925359815359116, + 2.3901504036039114, + 0.7483270280063152, + 1.8053005170077085, + 0.5294995084404945, + 0.19341043382883072, + 0.6238826178014278, + 0.776302071288228, + 1.6562222186475992, + 1.3117848485708237, + 0.4634669292718172, + 0.5128283016383648, + 0.09751657210290432, + 0.2219289466738701, + 0.5033681578934193, + 0.48190951347351074, + 0.3852923512458801, + 0.044594231992959976, + 0.47439378686249256, + 0.6294635124504566, + 0.08905069530010223, + 2.0805428121238947, + 0.19135648384690285, + 2.3099603224545717, + 1.5759621281176805, + 0.6902103088796139, + 0.754873376339674, + 0.46427507139742374, + 1.6654636822640896, + 1.0307994820177555, + 0.1240853313356638, + 0.24942653253674507, + 0.6521000023931265, + 0.395001869648695, + 1.4254861176013947, + 0.6015042383223772, + 1.224617538973689, + 0.29170970618724823, + 0.7158800177276134, + 0.20950434729456902, + 1.589468564838171, + 0.1500835344195366, + 0.783292431384325, + 0.11355116404592991, + 0.12817005813121796, + 1.0178428813815117, + 0.6139875687658787 + ], + "unique_experts": 64, + "load_cv": 0.6373042379970951, + "normalized_load_entropy": 0.9491134048751324, + "max_load_share": 0.040229885057471264 + } + }, + "s1_x": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "7d2a609278c7b8f5278dbc987ade657d51c4de9267f51d42c45cab96f3233109", + "route_weight_sha256": "dd3a981af2058d1fab427e96f0d90695608676b2eb2e5b4b0c52a10ad77c4270", + "loads": [ + 13, + 2, + 12, + 16, + 11, + 17, + 16, + 12, + 3, + 4, + 12, + 12, + 41, + 18, + 15, + 15, + 16, + 27, + 21, + 12, + 26, + 10, + 6, + 5, + 5, + 17, + 16, + 6, + 8, + 3, + 5, + 7, + 4, + 7, + 1, + 9, + 9, + 2, + 20, + 3, + 18, + 22, + 10, + 16, + 6, + 16, + 20, + 2, + 3, + 13, + 3, + 7, + 8, + 30, + 4, + 4, + 5, + 17, + 2, + 20, + 6, + 2, + 10, + 12 + ], + "weighted_loads": [ + 0.4518242496997118, + 0.08053143136203289, + 0.6717240046709776, + 1.9559807684272528, + 0.5145841427147388, + 1.4301120545715094, + 1.116403667256236, + 0.8942758943885565, + 0.12540526315569878, + 0.14702389389276505, + 0.7497295551002026, + 0.4680440314114094, + 1.7586668618023396, + 1.2832222282886505, + 0.6290688216686249, + 0.7325963824987411, + 1.1404103338718414, + 5.059059780091047, + 2.0815813168883324, + 0.5843938197940588, + 1.4409197140485048, + 0.39919982105493546, + 0.22391164302825928, + 0.32488297671079636, + 0.2147096022963524, + 1.0733167417347431, + 0.8456711452454329, + 0.30592814087867737, + 0.42948903515934944, + 0.08673147112131119, + 0.2088334895670414, + 0.5125184077769518, + 0.1409152541309595, + 0.4127642195671797, + 0.043466195464134216, + 0.4686113689094782, + 0.6383486166596413, + 0.1372193843126297, + 1.733166003599763, + 0.19443419948220253, + 1.3011326044797897, + 1.2297358810901642, + 0.5164017174392939, + 0.6710806004703045, + 0.22291559353470802, + 0.7585158236324787, + 0.9891972448676825, + 0.09493612870573997, + 0.09963083826005459, + 0.5513050220906734, + 0.1473981812596321, + 1.2535607554018497, + 0.45693623647093773, + 1.1259001344442368, + 0.14040136337280273, + 0.3130494859069586, + 0.23062528669834137, + 1.4257752299308777, + 0.1540103554725647, + 0.9690188653767109, + 0.2330608069896698, + 0.07585372403264046, + 0.5585028007626534, + 0.857979279011488 + ], + "unique_experts": 64, + "load_cv": 0.6979688344239737, + "normalized_load_entropy": 0.9437320573782079, + "max_load_share": 0.05694444444444444 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "734810a7ccfcc5e2a351cb30d7faef24d4e51cdde1998d12adec9e55b26657d7", + "route_weight_sha256": "83f15488a7c0bd306b639ea147a980165ae98f224e3353d42189cbc3e652da1e", + "loads": [ + 18, + 4, + 16, + 23, + 17, + 17, + 19, + 13, + 3, + 11, + 20, + 14, + 42, + 27, + 15, + 21, + 17, + 34, + 24, + 12, + 26, + 11, + 6, + 17, + 14, + 39, + 25, + 8, + 8, + 4, + 7, + 8, + 9, + 7, + 1, + 9, + 13, + 4, + 23, + 4, + 31, + 29, + 16, + 17, + 8, + 21, + 22, + 4, + 4, + 14, + 5, + 12, + 13, + 31, + 5, + 11, + 13, + 29, + 4, + 22, + 7, + 8, + 18, + 12 + ], + "weighted_loads": [ + 0.6621102653443813, + 0.1536603644490242, + 0.8223474621772766, + 2.7422610092908144, + 0.9096849821507931, + 1.4301120545715094, + 1.235395910218358, + 0.9513653758913279, + 0.12540526315569878, + 0.378828601911664, + 1.3892441280186176, + 0.5349087174981833, + 1.7944486178457737, + 1.9529357701539993, + 0.6290688216686249, + 1.0347320102155209, + 1.276162028312683, + 5.675079297274351, + 2.2098594158887863, + 0.5843938197940588, + 1.4409197140485048, + 0.47587376087903976, + 0.22391164302825928, + 1.1125644352287054, + 0.7918307594954967, + 2.4666929319500923, + 1.5778975058346987, + 0.38170522078871727, + 0.42948903515934944, + 0.16772900521755219, + 0.30343635752797127, + 0.551862234249711, + 0.3184469938278198, + 0.4127642195671797, + 0.043466195464134216, + 0.4686113689094782, + 0.8661241829395294, + 0.2112492062151432, + 2.0284754391759634, + 0.227999035269022, + 2.9190843254327774, + 1.6161258276551962, + 0.7611094862222672, + 0.6898911856114864, + 0.4559805169701576, + 1.9503752402961254, + 1.210618807002902, + 0.22706224396824837, + 0.13863406516611576, + 0.5914405547082424, + 0.36474768817424774, + 1.520712861791253, + 0.7319326475262642, + 1.1654713191092014, + 0.22969720512628555, + 0.7478640899062157, + 0.8887834250926971, + 2.112129397690296, + 0.22753027640283108, + 1.058340396732092, + 0.26865338534116745, + 0.40316069684922695, + 1.1060600578784943, + 0.857979279011488 + ], + "unique_experts": 64, + "load_cv": 0.6122451122855825, + "normalized_load_entropy": 0.9552064675036588, + "max_load_share": 0.043478260869565216 + } + }, + "s0_period": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "c20c83f721263a2b098ac7480185b721c387c834430a7eb13790906b31951abd", + "route_weight_sha256": "7c6e94e68259c02646c15b033950a466f62a14751e4bfd2c99b614a65bc48669", + "loads": [ + 13, + 3, + 12, + 16, + 12, + 16, + 17, + 12, + 3, + 4, + 14, + 16, + 35, + 19, + 12, + 17, + 14, + 27, + 14, + 19, + 25, + 13, + 6, + 3, + 5, + 20, + 13, + 7, + 4, + 3, + 4, + 6, + 4, + 6, + 1, + 9, + 8, + 1, + 18, + 3, + 19, + 27, + 10, + 16, + 12, + 22, + 19, + 2, + 3, + 15, + 5, + 8, + 7, + 27, + 5, + 5, + 4, + 18, + 2, + 17, + 3, + 0, + 13, + 7 + ], + "weighted_loads": [ + 0.4669851139187813, + 0.10761534050107002, + 0.6944387592375278, + 1.9161401577293873, + 0.5513086449354887, + 1.4190683513879776, + 1.184613535180688, + 0.9191422034054995, + 0.12597477436065674, + 0.14685810543596745, + 0.8190153930336237, + 0.6232190765440464, + 1.5253818817436695, + 1.2967726215720177, + 0.5050044097006321, + 0.7864106073975563, + 0.8486696481704712, + 5.306977096945047, + 1.9873580746352673, + 0.8065422810614109, + 1.5325049236416817, + 0.49626774340867996, + 0.20558510906994343, + 0.24834687262773514, + 0.23676177859306335, + 1.2728215120732784, + 0.749467670917511, + 0.3410581275820732, + 0.29859363473951817, + 0.09661290980875492, + 0.1817927397787571, + 0.4964003339409828, + 0.13821213692426682, + 0.37308092415332794, + 0.044188521802425385, + 0.479124341160059, + 0.6152527779340744, + 0.09580092877149582, + 1.854275207966566, + 0.18553759902715683, + 1.3794026896357536, + 1.4406688399612904, + 0.5538202933967113, + 0.6762964483350515, + 0.45845335349440575, + 0.9778887741267681, + 1.0148823037743568, + 0.09776465594768524, + 0.0973709337413311, + 0.6025276500731707, + 0.25726160779595375, + 1.4117198251187801, + 0.42686523124575615, + 1.0558195989578962, + 0.21043615229427814, + 0.4760436713695526, + 0.18105332180857658, + 1.453680308535695, + 0.14590981602668762, + 0.8279216177761555, + 0.11823368445038795, + 0.0, + 0.7733103856444359, + 0.5846751965582371 + ], + "unique_experts": 63, + "load_cv": 0.6876332643007023, + "normalized_load_entropy": 0.9412991986253294, + "max_load_share": 0.04861111111111111 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "c4e0d90930ceb63750955952449947ca67788df891d00dab226755dc11d4329f", + "route_weight_sha256": "0848798b78b1140a5f7937dd0515b9666bbe75fa75ad433044128afac1175774", + "loads": [ + 19, + 4, + 14, + 24, + 12, + 16, + 19, + 12, + 3, + 7, + 20, + 17, + 37, + 27, + 12, + 19, + 14, + 34, + 17, + 19, + 28, + 14, + 6, + 10, + 12, + 28, + 20, + 11, + 8, + 4, + 4, + 6, + 13, + 6, + 1, + 9, + 8, + 1, + 22, + 3, + 26, + 31, + 14, + 18, + 12, + 26, + 19, + 2, + 3, + 16, + 7, + 8, + 10, + 28, + 6, + 10, + 5, + 21, + 2, + 17, + 3, + 1, + 18, + 7 + ], + "weighted_loads": [ + 0.6787387989461422, + 0.14359431713819504, + 0.8178237266838551, + 2.5431173220276833, + 0.5513086449354887, + 1.4190683513879776, + 1.2839620802551508, + 0.9191422034054995, + 0.12597477436065674, + 0.23576156981289387, + 1.2077946122735739, + 0.6416912619024515, + 1.5896976459771395, + 1.8903783150017262, + 0.5050044097006321, + 0.8783894777297974, + 0.8486696481704712, + 5.961536791175604, + 2.328183613717556, + 0.8065422810614109, + 1.7833585664629936, + 0.5417206063866615, + 0.20558510906994343, + 0.5682813171297312, + 0.766918046399951, + 1.6726434603333473, + 1.3569658659398556, + 0.5053503196686506, + 0.45035799592733383, + 0.1325880866497755, + 0.1817927397787571, + 0.4964003339409828, + 0.5165318697690964, + 0.37308092415332794, + 0.044188521802425385, + 0.479124341160059, + 0.6152527779340744, + 0.09580092877149582, + 2.0100697837769985, + 0.18553759902715683, + 2.2717096358537674, + 1.6012354865670204, + 0.7821305692195892, + 0.7309345323592424, + 0.45845335349440575, + 1.8468626625835896, + 1.0148823037743568, + 0.09776465594768524, + 0.0973709337413311, + 0.6350443530827761, + 0.39188722893595695, + 1.4117198251187801, + 0.6150414422154427, + 1.1000852342694998, + 0.254972068592906, + 0.880649633705616, + 0.21273328736424446, + 1.6068830247968435, + 0.14590981602668762, + 0.8279216177761555, + 0.11823368445038795, + 0.0890924409031868, + 1.058511070907116, + 0.5846751965582371 + ], + "unique_experts": 64, + "load_cv": 0.6504366044870163, + "normalized_load_entropy": 0.9467125747617773, + "max_load_share": 0.04252873563218391 + } + }, + "s1_period": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "0c686c67e368eb4c5fb526633c4af303b42654001b24662d72d735f963b25932", + "route_weight_sha256": "635986f8b4738d98fd4a874be04a6d6ace917acdcee00e9d3bbfe84a9ce5ee12", + "loads": [ + 12, + 3, + 12, + 16, + 10, + 16, + 15, + 12, + 3, + 4, + 14, + 14, + 35, + 18, + 13, + 18, + 15, + 27, + 17, + 12, + 26, + 10, + 7, + 4, + 7, + 20, + 15, + 10, + 7, + 3, + 7, + 7, + 3, + 7, + 1, + 9, + 9, + 1, + 19, + 3, + 18, + 26, + 9, + 17, + 7, + 15, + 19, + 2, + 3, + 14, + 4, + 8, + 8, + 28, + 4, + 5, + 5, + 18, + 2, + 19, + 5, + 2, + 9, + 12 + ], + "weighted_loads": [ + 0.4211057871580124, + 0.12045466899871826, + 0.6799012757837772, + 1.9295947551727295, + 0.48461619578301907, + 1.3982757925987244, + 1.059000676497817, + 0.906029723584652, + 0.1255125179886818, + 0.14635007828474045, + 0.7984962165355682, + 0.5316104274243116, + 1.580164521932602, + 1.272497784346342, + 0.5528241638094187, + 0.8507462274283171, + 1.077008219435811, + 5.198712036013603, + 1.9862551297992468, + 0.5956764090806246, + 1.4801735524088144, + 0.40614741668105125, + 0.2434255536645651, + 0.2814506608992815, + 0.2747839502990246, + 1.2072020377963781, + 0.8617367036640644, + 0.44352220371365547, + 0.40116012282669544, + 0.08737139031291008, + 0.258663073182106, + 0.5006358548998833, + 0.10386020876467228, + 0.41785498335957527, + 0.043238647282123566, + 0.47224288806319237, + 0.6214158926159143, + 0.1016467809677124, + 1.717196648940444, + 0.19590016081929207, + 1.277804620563984, + 1.379675853997469, + 0.4723424483090639, + 0.7079743910580873, + 0.2577005885541439, + 0.7375871296972036, + 0.9662686754018068, + 0.09634047001600266, + 0.10159214958548546, + 0.5781912878155708, + 0.18224169313907623, + 1.2788029797375202, + 0.47270240634679794, + 1.0597553253173828, + 0.13544091768562794, + 0.3450796213001013, + 0.22759627178311348, + 1.464136315509677, + 0.15295445173978806, + 0.9252383001148701, + 0.19178229570388794, + 0.06476591899991035, + 0.535703282803297, + 0.8806192800402641 + ], + "unique_experts": 64, + "load_cv": 0.6609009936872468, + "normalized_load_entropy": 0.9475000467168628, + "max_load_share": 0.04861111111111111 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "47166a7134e2f5b6bb1d8be81b944139f0d62220f853506191166c72467da8d6", + "route_weight_sha256": "f6bdce611422e50a3d484f752b95ac67bf6307e63ff8db52c99037c2ee144a97", + "loads": [ + 18, + 5, + 16, + 23, + 16, + 16, + 18, + 13, + 3, + 10, + 21, + 16, + 36, + 26, + 13, + 25, + 16, + 33, + 20, + 12, + 26, + 11, + 7, + 14, + 16, + 43, + 25, + 12, + 8, + 4, + 9, + 8, + 8, + 7, + 1, + 9, + 13, + 3, + 22, + 4, + 32, + 33, + 16, + 18, + 9, + 20, + 21, + 4, + 3, + 14, + 6, + 13, + 13, + 29, + 5, + 15, + 13, + 31, + 3, + 21, + 6, + 7, + 16, + 12 + ], + "weighted_loads": [ + 0.6688483636826277, + 0.19358360208570957, + 0.8303073365241289, + 2.604829292744398, + 0.8797170352190733, + 1.3982757925987244, + 1.177992919459939, + 0.9631192050874233, + 0.1255125179886818, + 0.3329152949154377, + 1.298121653497219, + 0.5984751135110855, + 1.623351413756609, + 1.8809485547244549, + 0.5528241638094187, + 1.198304207995534, + 1.2127599138766527, + 5.765534929931164, + 2.1329788845032454, + 0.5956764090806246, + 1.4801735524088144, + 0.48282135650515556, + 0.2434255536645651, + 1.009734297171235, + 0.8613922894001007, + 2.700074413791299, + 1.6183263044804335, + 0.5192992836236954, + 0.43721470050513744, + 0.16836892440915108, + 0.3532659411430359, + 0.5399796813726425, + 0.2813919484615326, + 0.41785498335957527, + 0.043238647282123566, + 0.47224288806319237, + 0.8491914588958025, + 0.1756766028702259, + 2.0125060845166445, + 0.22946499660611153, + 2.899918779730797, + 1.7807411085814238, + 0.7628153674304485, + 0.7267849761992693, + 0.4907655119895935, + 2.1069964300841093, + 1.1876902375370264, + 0.22846658527851105, + 0.10159214958548546, + 0.5781912878155708, + 0.38967129588127136, + 1.5459550861269236, + 0.7416714206337929, + 1.1002391315996647, + 0.22473675943911076, + 1.0302765984088182, + 0.8802903555333614, + 2.203418767079711, + 0.1764912772923708, + 1.014559831470251, + 0.2273748740553856, + 0.3478188030421734, + 1.0118741244077682, + 0.8806192800402641 + ], + "unique_experts": 64, + "load_cv": 0.6085371830732675, + "normalized_load_entropy": 0.9555540026290755, + "max_load_share": 0.044513457556935816 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 120, + "ordered_topk_exact_tokens": 53, + "set_exact_tokens": 66, + "mean_set_jaccard": 0.8557539682539683, + "mean_token_weighted_tv": 0.029184376316455502, + "aggregate_load_tv": 0.04861111111111112 + }, + "system_bos": { + "tokens": 120, + "ordered_topk_exact_tokens": 47, + "set_exact_tokens": 63, + "mean_set_jaccard": 0.8375, + "mean_token_weighted_tv": 0.03362862051387007, + "aggregate_load_tv": 0.05277777777777777 + }, + "system_x": { + "tokens": 120, + "ordered_topk_exact_tokens": 38, + "set_exact_tokens": 53, + "mean_set_jaccard": 0.7998015873015873, + "mean_token_weighted_tv": 0.04529497013427317, + "aggregate_load_tv": 0.07083333333333333 + }, + "system_period": { + "tokens": 120, + "ordered_topk_exact_tokens": 38, + "set_exact_tokens": 53, + "mean_set_jaccard": 0.8099206349206349, + "mean_token_weighted_tv": 0.04140718416310847, + "aggregate_load_tv": 0.056944444444444436 + }, + "bos_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 37, + "set_exact_tokens": 61, + "mean_set_jaccard": 0.8402777777777779, + "mean_token_weighted_tv": 0.03367650043607379, + "aggregate_load_tv": 0.04861111111111112 + }, + "bos_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 48, + "set_exact_tokens": 71, + "mean_set_jaccard": 0.8566269841269841, + "mean_token_weighted_tv": 0.03346113801623384, + "aggregate_load_tv": 0.04444444444444444 + }, + "x_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 41, + "set_exact_tokens": 63, + "mean_set_jaccard": 0.8326190476190477, + "mean_token_weighted_tv": 0.038966516603250054, + "aggregate_load_tv": 0.04722222222222223 + }, + "x_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 37, + "set_exact_tokens": 55, + "mean_set_jaccard": 0.8018650793650794, + "mean_token_weighted_tv": 0.04391016163475191, + "aggregate_load_tv": 0.075 + }, + "period_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 40, + "set_exact_tokens": 63, + "mean_set_jaccard": 0.8314285714285715, + "mean_token_weighted_tv": 0.03775889975562071, + "aggregate_load_tv": 0.052777777777777785 + }, + "period_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 34, + "set_exact_tokens": 52, + "mean_set_jaccard": 0.7875793650793651, + "mean_token_weighted_tv": 0.04565474382058407, + "aggregate_load_tv": 0.06805555555555556 + } + } + }, + "layer_18": { + "layer": 18, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "6f1eb17f6655067883d703fdaae066e89a0e0f62516adfe0810ee977c108d0b6", + "route_weight_sha256": "70cbdc0ef276a1b861b95ce99154fcd4d3f0bcaf5db2544291b3c0a0572749bc", + "loads": [ + 23, + 6, + 2, + 25, + 13, + 3, + 37, + 2, + 12, + 7, + 6, + 13, + 19, + 15, + 4, + 22, + 3, + 1, + 24, + 11, + 6, + 17, + 15, + 29, + 30, + 10, + 12, + 9, + 1, + 2, + 8, + 8, + 14, + 7, + 14, + 20, + 14, + 23, + 8, + 24, + 8, + 6, + 10, + 4, + 6, + 1, + 20, + 2, + 2, + 14, + 19, + 4, + 15, + 20, + 11, + 2, + 3, + 12, + 4, + 7, + 6, + 13, + 10, + 2 + ], + "weighted_loads": [ + 3.2196283899247646, + 0.22432716563344002, + 0.11008379980921745, + 1.2683251425623894, + 1.7936094477772713, + 0.16970353573560715, + 4.554465543478727, + 0.07970201037824154, + 0.5211750641465187, + 0.37431324645876884, + 0.2749193888157606, + 0.5080602653324604, + 0.8288924396038055, + 3.7005968540906906, + 0.20927222073078156, + 0.8756016157567501, + 0.13543210923671722, + 0.03412821516394615, + 1.6606812085956335, + 0.6453425008803606, + 0.3863219190388918, + 1.23925500549376, + 2.1752352230250835, + 1.2602342534810305, + 1.2354688383638859, + 0.3831273131072521, + 0.5098349712789059, + 0.5285067334771156, + 0.03172531723976135, + 0.06139967404305935, + 0.4095450732856989, + 0.2649106550961733, + 0.5681976694613695, + 0.2638756297528744, + 1.1597401164472103, + 1.141593523323536, + 0.49961306154727936, + 1.0130710769444704, + 0.5702118128538132, + 0.9237371981143951, + 0.2801589425653219, + 0.2331608049571514, + 0.333551237359643, + 0.1365867182612419, + 0.18151444755494595, + 0.06601463258266449, + 1.4870469029992819, + 0.18819276243448257, + 0.07229974865913391, + 0.520992579869926, + 0.7077477276325226, + 0.18059152364730835, + 2.0593406669795513, + 1.0922079235315323, + 0.48905343655496836, + 0.07282860204577446, + 0.1183403842151165, + 0.9782919399440289, + 0.2934805043041706, + 0.5425113551318645, + 0.2597731947898865, + 0.482938589528203, + 0.5522437505424023, + 0.10234587267041206 + ], + "unique_experts": 64, + "load_cv": 0.7287737036358481, + "normalized_load_entropy": 0.9365130456927782, + "max_load_share": 0.05138888888888889 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "69073f5f3bb7165695511076581db1b6e07781faff5b0f3fa7c33df0433c55c7", + "route_weight_sha256": "b1e097e327dc9de0b4ef528a63077bc8ead0e6823ee164913b6149f0eaa8654d", + "loads": [ + 29, + 7, + 14, + 25, + 13, + 6, + 37, + 2, + 20, + 7, + 7, + 17, + 19, + 15, + 9, + 26, + 3, + 1, + 43, + 11, + 6, + 19, + 15, + 29, + 30, + 10, + 12, + 9, + 1, + 2, + 16, + 8, + 15, + 7, + 14, + 23, + 15, + 27, + 8, + 26, + 14, + 6, + 13, + 4, + 6, + 1, + 28, + 2, + 5, + 25, + 22, + 6, + 24, + 28, + 11, + 2, + 5, + 12, + 5, + 10, + 6, + 18, + 10, + 4 + ], + "weighted_loads": [ + 3.5931484140455723, + 0.2968345023691654, + 1.1542686820030212, + 1.2683251425623894, + 1.7936094477772713, + 0.24384455755352974, + 4.554465543478727, + 0.07970201037824154, + 0.9892649799585342, + 0.37431324645876884, + 0.28583881724625826, + 0.8952840752899647, + 0.8288924396038055, + 3.7005968540906906, + 1.0641648638993502, + 1.0084579102694988, + 0.13543210923671722, + 0.03412821516394615, + 2.7443451937288046, + 0.6453425008803606, + 0.3863219190388918, + 1.2923684120178223, + 2.1752352230250835, + 1.2602342534810305, + 1.2354688383638859, + 0.3831273131072521, + 0.5098349712789059, + 0.5285067334771156, + 0.03172531723976135, + 0.06139967404305935, + 0.7079455284401774, + 0.2649106550961733, + 0.609304154291749, + 0.2638756297528744, + 1.1597401164472103, + 1.2843441739678383, + 0.5231831893324852, + 1.1313712149858475, + 0.5702118128538132, + 0.9713433161377907, + 0.5496206004172564, + 0.2331608049571514, + 0.4160447586327791, + 0.1365867182612419, + 0.18151444755494595, + 0.06601463258266449, + 3.005920445546508, + 0.18819276243448257, + 0.21570257656276226, + 1.017582948319614, + 0.8091742172837257, + 0.34653623402118683, + 2.6661939471960068, + 1.6532895602285862, + 0.48905343655496836, + 0.07282860204577446, + 1.116326104849577, + 0.9782919399440289, + 0.32230351865291595, + 0.6892999168485403, + 0.2597731947898865, + 0.6394698955118656, + 0.5522437505424023, + 0.19467350840568542 + ], + "unique_experts": 64, + "load_cv": 0.7090267874593447, + "normalized_load_entropy": 0.9396438485809486, + "max_load_share": 0.04942528735632184 + } + }, + "s1_eos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "c0a182ec24bf7b2cd660792679518bfa33b4fe3fba096de8b79533ded6d16615", + "route_weight_sha256": "b510b603a8553e6be1a7fe97cead34336c79584c06c757b14d2fbb413fc1a3a9", + "loads": [ + 23, + 6, + 4, + 24, + 13, + 3, + 38, + 2, + 9, + 7, + 6, + 10, + 23, + 16, + 5, + 21, + 3, + 1, + 24, + 11, + 5, + 16, + 15, + 31, + 33, + 5, + 12, + 9, + 1, + 1, + 8, + 7, + 12, + 6, + 14, + 20, + 12, + 22, + 10, + 30, + 13, + 5, + 9, + 5, + 7, + 1, + 20, + 3, + 3, + 13, + 17, + 3, + 15, + 18, + 11, + 3, + 4, + 12, + 3, + 6, + 8, + 11, + 10, + 2 + ], + "weighted_loads": [ + 3.10011563077569, + 0.22993029095232487, + 0.1812981404364109, + 1.183645110577345, + 2.1628561168909073, + 0.1662624403834343, + 4.420553009957075, + 0.08109843358397484, + 0.39732950925827026, + 0.3797884024679661, + 0.27114019356667995, + 0.41035743057727814, + 0.9955703504383564, + 3.741813932545483, + 0.24264015443623066, + 0.8324093706905842, + 0.13519597984850407, + 0.038192469626665115, + 1.695205558091402, + 0.660233398899436, + 0.34700072929263115, + 1.115862362086773, + 2.152828572317958, + 1.336752900853753, + 1.3004528610035777, + 0.22119086980819702, + 0.5062802881002426, + 0.5294542796909809, + 0.02923371084034443, + 0.031067444011569023, + 0.36504311859607697, + 0.24129091762006283, + 0.501002473756671, + 0.2162976861000061, + 1.1792945731431246, + 1.1252093240618706, + 0.43129755184054375, + 1.01410211622715, + 0.6735622324049473, + 1.115716291591525, + 0.4470300152897835, + 0.18458066135644913, + 0.31094754859805107, + 0.18816423416137695, + 0.18784421496093273, + 0.06313508749008179, + 1.4596893992275, + 0.22001905925571918, + 0.11508050188422203, + 0.5279386350885034, + 0.6228930596262217, + 0.1575675830245018, + 2.040410328656435, + 1.0190548449754715, + 0.4989234823733568, + 0.11370181292295456, + 0.15648524090647697, + 0.8537986911833286, + 0.26920073106884956, + 0.4895828366279602, + 0.3301635943353176, + 0.42428212985396385, + 0.575949601829052, + 0.10435000248253345 + ], + "unique_experts": 64, + "load_cv": 0.7568616162633957, + "normalized_load_entropy": 0.9344657998623814, + "max_load_share": 0.05277777777777778 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "53e57201f45bae1fcca6b2436f3959cddb6e36f8232d71a3c25592cf90cdcd60", + "route_weight_sha256": "34f30bf5155fec2588ac5e55543f2713950e641634f3f57a3944a1231399f1a7", + "loads": [ + 30, + 9, + 17, + 24, + 14, + 7, + 39, + 4, + 19, + 8, + 7, + 14, + 23, + 17, + 14, + 23, + 3, + 10, + 47, + 12, + 5, + 19, + 16, + 31, + 33, + 5, + 12, + 9, + 1, + 2, + 18, + 9, + 14, + 7, + 18, + 34, + 13, + 30, + 11, + 32, + 18, + 5, + 12, + 10, + 7, + 1, + 38, + 6, + 6, + 26, + 19, + 6, + 24, + 30, + 13, + 4, + 7, + 17, + 5, + 10, + 8, + 16, + 10, + 8 + ], + "weighted_loads": [ + 3.504006426781416, + 0.3668764103204012, + 1.2373094279319048, + 1.183645110577345, + 2.2014978528022766, + 0.2875418346375227, + 4.45028131455183, + 0.1495074201375246, + 1.2361144497990608, + 0.41702791303396225, + 0.28289503511041403, + 0.7803925052285194, + 0.9955703504383564, + 3.7833213144913316, + 1.234092989936471, + 0.889990720897913, + 0.13519597984850407, + 0.609882703050971, + 3.509564721956849, + 0.7952444311231375, + 0.34700072929263115, + 1.206159157678485, + 2.1861119847744703, + 1.336752900853753, + 1.3004528610035777, + 0.22119086980819702, + 0.5062802881002426, + 0.5294542796909809, + 0.02923371084034443, + 0.06779333762824535, + 0.8953281519934535, + 0.4850758668035269, + 0.5910197179764509, + 0.2951313629746437, + 1.604954170063138, + 2.3627051021903753, + 0.4548416379839182, + 1.316880812868476, + 0.7098869904875755, + 1.1634743958711624, + 0.6479131896048784, + 0.18458066135644913, + 0.4034291170537472, + 0.6517210751771927, + 0.18784421496093273, + 0.06313508749008179, + 4.199488462880254, + 0.37254888750612736, + 0.21283747255802155, + 1.0907192351296544, + 0.6877068039029837, + 0.3530851863324642, + 2.630466839298606, + 1.758758120238781, + 0.6190957855433226, + 0.14887341111898422, + 1.169027827680111, + 1.0844077169895172, + 0.6034949719905853, + 0.7594584561884403, + 0.3301635943353176, + 0.590107386931777, + 0.575949601829052, + 0.3292074427008629 + ], + "unique_experts": 64, + "load_cv": 0.6855941273584678, + "normalized_load_entropy": 0.9458868154799639, + "max_load_share": 0.048654244306418216 + } + }, + "s0_bos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "202a819d097b85161fe1e5dbb3e8eae8c4224bcd85f0e65777a8f149691cddca", + "route_weight_sha256": "ad333ee2e2031578169933b49581a613db4043975ea5877a45f1a8320af2121d", + "loads": [ + 23, + 3, + 5, + 25, + 15, + 4, + 38, + 2, + 8, + 9, + 6, + 16, + 19, + 17, + 4, + 23, + 2, + 1, + 22, + 11, + 6, + 16, + 16, + 31, + 32, + 6, + 8, + 8, + 1, + 3, + 10, + 7, + 13, + 8, + 15, + 20, + 14, + 24, + 9, + 26, + 11, + 3, + 8, + 2, + 7, + 1, + 21, + 4, + 2, + 12, + 18, + 3, + 15, + 21, + 13, + 3, + 3, + 12, + 3, + 7, + 4, + 9, + 11, + 1 + ], + "weighted_loads": [ + 3.3454925902187824, + 0.11684859544038773, + 0.22334034740924835, + 1.3308234326541424, + 2.0998858362436295, + 0.2115599364042282, + 4.824892856180668, + 0.08592306822538376, + 0.3656393848359585, + 0.4107197429984808, + 0.2905659954994917, + 0.6351834181696177, + 0.8301728367805481, + 3.884608317166567, + 0.21321187168359756, + 0.9188068807125092, + 0.11082948744297028, + 0.03080967254936695, + 1.689113350585103, + 0.6662600375711918, + 0.38998107239603996, + 1.1096806395798922, + 2.183806836605072, + 1.3434905968606472, + 1.3178067337721586, + 0.26019036769866943, + 0.3435482829809189, + 0.5019194893538952, + 0.03005523607134819, + 0.09240692667663097, + 0.4253168050199747, + 0.24468664452433586, + 0.5502620860934258, + 0.27268941700458527, + 1.2170715127140284, + 1.2255576737225056, + 0.47877494618296623, + 1.106582660228014, + 0.6471691764891148, + 1.0073762815445662, + 0.3982209134846926, + 0.11774758249521255, + 0.2782858591526747, + 0.06800922006368637, + 0.18873822689056396, + 0.07225221395492554, + 1.5438973754644394, + 0.2720513083040714, + 0.06369318813085556, + 0.49847166053950787, + 0.6855019796639681, + 0.1578178908675909, + 2.0259875543415546, + 1.1786230728030205, + 0.5655816541984677, + 0.11531728319823742, + 0.11394423618912697, + 1.0089102126657963, + 0.24871687591075897, + 0.6166943907737732, + 0.17245080322027206, + 0.3566584177315235, + 0.6093905195593834, + 0.07766737043857574 + ], + "unique_experts": 64, + "load_cv": 0.7635201130048658, + "normalized_load_entropy": 0.9314150165038528, + "max_load_share": 0.05277777777777778 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "7a3b68d133b0a46e6000e4171f8f9dff44a1e083befa814068550613009861ae", + "route_weight_sha256": "ae6349229a32b27812582cfd20dfac07034e57c10693319f69f1dbd61c66a965", + "loads": [ + 29, + 4, + 16, + 25, + 15, + 6, + 38, + 2, + 16, + 9, + 6, + 19, + 21, + 17, + 9, + 28, + 2, + 1, + 41, + 11, + 6, + 18, + 16, + 32, + 32, + 6, + 9, + 8, + 1, + 3, + 16, + 7, + 13, + 9, + 15, + 24, + 14, + 28, + 9, + 30, + 18, + 4, + 12, + 2, + 7, + 1, + 30, + 4, + 5, + 23, + 20, + 5, + 24, + 28, + 13, + 3, + 4, + 12, + 4, + 9, + 4, + 13, + 11, + 3 + ], + "weighted_loads": [ + 3.71901261433959, + 0.18935593217611313, + 1.2409447021782398, + 1.3308234326541424, + 2.0998858362436295, + 0.25838824175298214, + 4.824892856180668, + 0.08592306822538376, + 0.833729300647974, + 0.4107197429984808, + 0.2905659954994917, + 0.8790676537901163, + 1.097682572901249, + 3.884608317166567, + 0.9439773764461279, + 1.075339226052165, + 0.11082948744297028, + 0.03080967254936695, + 2.786007361486554, + 0.6662600375711918, + 0.38998107239603996, + 1.1620991211384535, + 2.183806836605072, + 1.3919860646128654, + 1.3178067337721586, + 0.26019036769866943, + 0.3936239778995514, + 0.5019194893538952, + 0.03005523607134819, + 0.09240692667663097, + 0.6759632583707571, + 0.24468664452433586, + 0.5502620860934258, + 0.3382297456264496, + 1.2170715127140284, + 1.4296685978770256, + 0.47877494618296623, + 1.231974359601736, + 0.6471691764891148, + 1.2246933225542307, + 0.7526694405823946, + 0.18167250603437424, + 0.4356417804956436, + 0.06800922006368637, + 0.18873822689056396, + 0.07225221395492554, + 3.0157633274793625, + 0.2720513083040714, + 0.2070960160344839, + 0.973507896065712, + 0.7505457755178213, + 0.31244695000350475, + 2.63284083455801, + 1.6830751225352287, + 0.5655816541984677, + 0.11531728319823742, + 0.33708691969513893, + 1.0089102126657963, + 0.2775398902595043, + 0.7206238135695457, + 0.17245080322027206, + 0.48482757434248924, + 0.6093905195593834, + 0.1699950061738491 + ], + "unique_experts": 64, + "load_cv": 0.7397263940560403, + "normalized_load_entropy": 0.9343028286720101, + "max_load_share": 0.047126436781609195 + } + }, + "s1_bos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "c42786453df6ddc97f2c99e472a54cf0a5466e3f0268b80c4858a7c30372d6e7", + "route_weight_sha256": "96c6a8ab5980e1012a7412b178276283c2ea4ab8accdb1ec1f5781bdd6afecd0", + "loads": [ + 23, + 2, + 3, + 23, + 14, + 4, + 37, + 2, + 9, + 9, + 7, + 14, + 21, + 17, + 5, + 20, + 2, + 1, + 22, + 10, + 6, + 15, + 15, + 34, + 29, + 7, + 11, + 8, + 2, + 4, + 9, + 6, + 16, + 4, + 14, + 21, + 11, + 22, + 11, + 28, + 12, + 3, + 12, + 2, + 7, + 1, + 20, + 4, + 3, + 13, + 17, + 3, + 15, + 22, + 12, + 3, + 3, + 12, + 3, + 8, + 5, + 9, + 11, + 2 + ], + "weighted_loads": [ + 3.3365308698266745, + 0.07420780882239342, + 0.14522378891706467, + 1.1964843198657036, + 2.263347629457712, + 0.19802111014723778, + 4.544631848111749, + 0.08595663495361805, + 0.40293218195438385, + 0.4259483180940151, + 0.27318483497947454, + 0.5719986297190189, + 0.9321062304079533, + 3.864056565798819, + 0.23751648515462875, + 0.8137879520654678, + 0.10723762214183807, + 0.031658295542001724, + 1.756099872291088, + 0.6387803219258785, + 0.3903775215148926, + 1.1338588893413544, + 2.176889492198825, + 1.499402318149805, + 1.1857749186456203, + 0.2730199247598648, + 0.49477339908480644, + 0.5091739781200886, + 0.06857673078775406, + 0.11885030381381512, + 0.4076595399528742, + 0.19317015632987022, + 0.6608301997184753, + 0.1428222768008709, + 1.1947802416980267, + 1.1973512805998325, + 0.38494445476680994, + 1.0136832557618618, + 0.7639882452785969, + 1.0474434345960617, + 0.412649791687727, + 0.10900544747710228, + 0.398760624229908, + 0.07328920811414719, + 0.19435611180961132, + 0.066648468375206, + 1.5292630773037672, + 0.2779541593044996, + 0.10865103080868721, + 0.5555870793759823, + 0.6585803050547838, + 0.15549134649336338, + 2.0088476426899433, + 1.147112499922514, + 0.525812404230237, + 0.12273220904171467, + 0.10726232826709747, + 0.873086653649807, + 0.2637833505868912, + 0.6099054291844368, + 0.2087633330374956, + 0.3516468796879053, + 0.6185015216469765, + 0.11171112954616547 + ], + "unique_experts": 64, + "load_cv": 0.7488262420219665, + "normalized_load_entropy": 0.9343187114886344, + "max_load_share": 0.05138888888888889 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "2fd3d79939b0623ee3ede5415971d75ffed586b3398efe0b9e999b6a21c6877c", + "route_weight_sha256": "617a9a05100065e826c9957abed3ac412e8b891beb3d3b4e2917197f0b191b18", + "loads": [ + 30, + 5, + 14, + 23, + 15, + 7, + 38, + 4, + 19, + 10, + 7, + 18, + 21, + 18, + 14, + 24, + 2, + 10, + 45, + 11, + 6, + 17, + 16, + 34, + 29, + 7, + 11, + 8, + 2, + 5, + 19, + 8, + 17, + 5, + 18, + 34, + 11, + 30, + 12, + 31, + 18, + 4, + 16, + 7, + 7, + 1, + 39, + 7, + 6, + 27, + 20, + 6, + 24, + 34, + 14, + 4, + 5, + 17, + 5, + 12, + 6, + 13, + 11, + 8 + ], + "weighted_loads": [ + 3.7404216658324003, + 0.21115392819046974, + 1.140202671289444, + 1.1964843198657036, + 2.3019893653690815, + 0.2848647143691778, + 4.574360152706504, + 0.15436562150716782, + 1.2417171224951744, + 0.4631878286600113, + 0.27318483497947454, + 0.9194291792809963, + 0.9321062304079533, + 3.9055639477446675, + 1.3182948008179665, + 0.9362716265022755, + 0.10723762214183807, + 0.6033485289663076, + 3.607433995231986, + 0.77379135414958, + 0.3903775215148926, + 1.185214577242732, + 2.2101729046553373, + 1.499402318149805, + 1.1857749186456203, + 0.2730199247598648, + 0.49477339908480644, + 0.5091739781200886, + 0.06857673078775406, + 0.15557619743049145, + 0.9599939975887537, + 0.4369551055133343, + 0.7178446725010872, + 0.2216559536755085, + 1.62043983861804, + 2.4058392085134983, + 0.38494445476680994, + 1.3189171627163887, + 0.8003130033612251, + 1.1236764695495367, + 0.6549666207283735, + 0.15814179554581642, + 0.5482083447277546, + 0.5368460491299629, + 0.19435611180961132, + 0.066648468375206, + 4.236686499789357, + 0.4304839875549078, + 0.20640800148248672, + 1.161249190568924, + 0.7609359566122293, + 0.3449405264109373, + 2.598904153332114, + 1.8690752647817135, + 0.6459847074002028, + 0.15790380723774433, + 0.3682006560266018, + 1.1036956794559956, + 0.5980775915086269, + 0.9550367593765259, + 0.23696105554699898, + 0.4999516364187002, + 0.6185015216469765, + 0.3365685697644949 + ], + "unique_experts": 64, + "load_cv": 0.6875919471991867, + "normalized_load_entropy": 0.945420180887681, + "max_load_share": 0.046583850931677016 + } + }, + "s0_x": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "802f8cec7465c21610e22a762573fc8bb2bd237cfbf3e7d6ee6a2f61e7a59b64", + "route_weight_sha256": "e5aab473db49d73a76d361106859351ef8583116c37f6c885a40ac0ba8479eb5", + "loads": [ + 23, + 3, + 4, + 25, + 15, + 3, + 39, + 2, + 8, + 8, + 7, + 15, + 19, + 16, + 5, + 22, + 3, + 1, + 23, + 10, + 6, + 19, + 16, + 29, + 28, + 7, + 9, + 9, + 1, + 3, + 9, + 8, + 11, + 6, + 16, + 22, + 13, + 21, + 9, + 25, + 9, + 4, + 9, + 3, + 5, + 1, + 22, + 4, + 5, + 13, + 17, + 4, + 15, + 23, + 12, + 2, + 3, + 12, + 3, + 7, + 6, + 10, + 11, + 2 + ], + "weighted_loads": [ + 3.4231051877141, + 0.1042543463408947, + 0.1755297463387251, + 1.3144437223672867, + 1.9056673012673855, + 0.1764870397746563, + 5.13878457993269, + 0.07986507378518581, + 0.41242411360144615, + 0.37433057837188244, + 0.2948582097887993, + 0.6011491045355797, + 0.8154464978724718, + 3.9010360101237893, + 0.2443332877010107, + 0.8803258314728737, + 0.14167146757245064, + 0.035346563905477524, + 1.7310263961553574, + 0.6426164470613003, + 0.4064291939139366, + 1.379193127155304, + 2.2222803365439177, + 1.2820552214980125, + 1.1389419194310904, + 0.28797220438718796, + 0.38411133736371994, + 0.5290811061859131, + 0.031884048134088516, + 0.09439874812960625, + 0.35632009617984295, + 0.2654725592583418, + 0.4910975247621536, + 0.21534699760377407, + 1.2631065268069506, + 1.304144898429513, + 0.4482927583158016, + 0.9499097280204296, + 0.6405659392476082, + 0.9522444289177656, + 0.31465044245123863, + 0.15528689697384834, + 0.301227705553174, + 0.10367236658930779, + 0.15018786117434502, + 0.07936648279428482, + 1.7100462727248669, + 0.2873466294258833, + 0.16463573276996613, + 0.5153097128495574, + 0.6588170733302832, + 0.19220810756087303, + 2.0608243718743324, + 1.3255719188600779, + 0.5486533232033253, + 0.08042400889098644, + 0.11699897050857544, + 1.0272536389529705, + 0.24971510842442513, + 0.5781849399209023, + 0.253189779818058, + 0.4019307419657707, + 0.5845574513077736, + 0.09981954656541348 + ], + "unique_experts": 64, + "load_cv": 0.7410369778014696, + "normalized_load_entropy": 0.9359603647630952, + "max_load_share": 0.05416666666666667 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "2074d126fb0ff7b635f64c1751ceb676a845330596651eb2fe7ccac903570edb", + "route_weight_sha256": "76e5eef3e43e832e96307917f236b03253512acd2000bb721b5d641bbbebe926", + "loads": [ + 30, + 4, + 16, + 25, + 15, + 5, + 39, + 2, + 16, + 8, + 7, + 19, + 20, + 16, + 10, + 26, + 3, + 1, + 42, + 10, + 6, + 21, + 16, + 29, + 28, + 7, + 9, + 9, + 1, + 3, + 16, + 8, + 12, + 7, + 16, + 26, + 13, + 25, + 9, + 27, + 15, + 4, + 11, + 3, + 5, + 1, + 30, + 4, + 9, + 24, + 19, + 7, + 25, + 31, + 12, + 2, + 4, + 12, + 6, + 8, + 7, + 13, + 11, + 5 + ], + "weighted_loads": [ + 3.839188851416111, + 0.1767616830766201, + 1.3614404518157244, + 1.3144437223672867, + 1.9056673012673855, + 0.22331534512341022, + 5.13878457993269, + 0.07986507378518581, + 0.8805140294134617, + 0.37433057837188244, + 0.2948582097887993, + 0.9682936519384384, + 0.8614113572984934, + 3.9010360101237893, + 1.133995272219181, + 1.0058402735739946, + 0.14167146757245064, + 0.035346563905477524, + 2.920301169157028, + 0.6426164470613003, + 0.4064291939139366, + 1.4411987382918596, + 2.2222803365439177, + 1.2820552214980125, + 1.1389419194310904, + 0.28797220438718796, + 0.38411133736371994, + 0.5290811061859131, + 0.031884048134088516, + 0.09439874812960625, + 0.6175869982689619, + 0.2654725592583418, + 0.5203027781099081, + 0.2614676933735609, + 1.2631065268069506, + 1.4934693332761526, + 0.4482927583158016, + 1.070926770567894, + 0.6405659392476082, + 0.9998505469411612, + 0.5789200365543365, + 0.15528689697384834, + 0.35744718089699745, + 0.10367236658930779, + 0.15018786117434502, + 0.07936648279428482, + 3.230614271014929, + 0.2873466294258833, + 0.3484696876257658, + 1.0025440184399486, + 0.723214527592063, + 0.38377581909298897, + 2.7652009911835194, + 1.8880009483546019, + 0.5486533232033253, + 0.08042400889098644, + 0.3401416540145874, + 1.0272536389529705, + 0.37847037240862846, + 0.6153568848967552, + 0.2820683363825083, + 0.49303556606173515, + 0.5845574513077736, + 0.27271738834679127 + ], + "unique_experts": 64, + "load_cv": 0.7209709986326325, + "normalized_load_entropy": 0.9384304651030803, + "max_load_share": 0.04827586206896552 + } + }, + "s1_x": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "c86a349c710e7434c9bd941893c732fdbcecac5307ef73d2c7fb9762576b8b41", + "route_weight_sha256": "bec72c1c9a67357550214e8e355317204a3e72b40ce9db88c29a4b4d6ace022b", + "loads": [ + 22, + 2, + 4, + 25, + 15, + 4, + 38, + 2, + 11, + 8, + 7, + 11, + 25, + 17, + 4, + 16, + 2, + 1, + 22, + 10, + 6, + 19, + 15, + 32, + 30, + 4, + 12, + 9, + 1, + 1, + 9, + 8, + 9, + 6, + 14, + 23, + 12, + 19, + 10, + 24, + 11, + 3, + 11, + 5, + 7, + 1, + 21, + 4, + 8, + 11, + 18, + 5, + 15, + 22, + 11, + 3, + 4, + 12, + 3, + 7, + 7, + 10, + 11, + 1 + ], + "weighted_loads": [ + 3.226093541830778, + 0.0692785307765007, + 0.17168090865015984, + 1.1642731055617332, + 2.1720661967992783, + 0.17728622257709503, + 4.5909996051341295, + 0.08460518345236778, + 0.5318617690354586, + 0.379409346729517, + 0.27814603224396706, + 0.458791583776474, + 1.0592501424252987, + 3.799917459487915, + 0.2004137486219406, + 0.6384025383740664, + 0.10826743021607399, + 0.04201849550008774, + 1.7666978184133768, + 0.6208491679280996, + 0.3771604336798191, + 1.3684272076934576, + 2.183246873319149, + 1.3932103849947453, + 1.1881072903051972, + 0.16426423750817776, + 0.5070081762969494, + 0.5488408096134663, + 0.03445190191268921, + 0.03371644392609596, + 0.36328280717134476, + 0.2628473713994026, + 0.38543829694390297, + 0.20779568329453468, + 1.1839776039123535, + 1.2575474008917809, + 0.42057276982814074, + 0.8578807972371578, + 0.6989036612212658, + 0.9054025802761316, + 0.36749680899083614, + 0.11349419131875038, + 0.3961281590163708, + 0.18075627461075783, + 0.1915706992149353, + 0.06446783989667892, + 1.6074367873370647, + 0.27966331131756306, + 0.32920191437005997, + 0.45985051058232784, + 0.6690355334430933, + 0.2241827677935362, + 2.009600307792425, + 1.124047277495265, + 0.5165381263941526, + 0.12487772107124329, + 0.1487381048500538, + 0.800058513879776, + 0.2969329096376896, + 0.5098265893757343, + 0.31560782343149185, + 0.3718771543353796, + 0.6031646430492401, + 0.07376518845558167 + ], + "unique_experts": 64, + "load_cv": 0.7412035591181296, + "normalized_load_entropy": 0.935602160971526, + "max_load_share": 0.05277777777777778 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "306e6c198ac20ebe7d810131cf424ab95c105f2602089b5f95c97e6a58afe405", + "route_weight_sha256": "d54b869e8d1903b054c41fa0377b34208456288539e8ee23bf7333f40df93c30", + "loads": [ + 31, + 5, + 17, + 25, + 16, + 8, + 39, + 4, + 22, + 9, + 7, + 15, + 26, + 18, + 13, + 19, + 2, + 10, + 46, + 11, + 6, + 23, + 16, + 32, + 30, + 4, + 12, + 9, + 1, + 2, + 18, + 10, + 11, + 7, + 18, + 35, + 12, + 26, + 11, + 26, + 15, + 3, + 13, + 11, + 7, + 1, + 39, + 7, + 12, + 23, + 20, + 11, + 25, + 34, + 13, + 4, + 6, + 17, + 5, + 9, + 7, + 13, + 11, + 8 + ], + "weighted_loads": [ + 3.7906639613211155, + 0.20622465014457703, + 1.319849956780672, + 1.1642731055617332, + 2.2107079327106476, + 0.29993158020079136, + 4.620727909728885, + 0.15301417000591755, + 1.4106269720941782, + 0.41664885729551315, + 0.27814603224396706, + 0.7756147906184196, + 1.0973872914910316, + 3.8414248414337635, + 1.1545436531305313, + 0.7259394396096468, + 0.10826743021607399, + 0.6137087289243937, + 3.732519667595625, + 0.7558602001518011, + 0.3771604336798191, + 1.4899077378213406, + 2.2165302857756615, + 1.3932103849947453, + 1.1881072903051972, + 0.16426423750817776, + 0.5070081762969494, + 0.5488408096134663, + 0.03445190191268921, + 0.0704423375427723, + 0.840611606836319, + 0.5066323205828667, + 0.47839900478720665, + 0.2866293601691723, + 1.609637200832367, + 2.4381170384585857, + 0.42057276982814074, + 1.1397471874952316, + 0.735228419303894, + 0.953160684555769, + 0.5065604615956545, + 0.11349419131875038, + 0.4508366957306862, + 0.6926129423081875, + 0.1915706992149353, + 0.06446783989667892, + 4.220310837030411, + 0.43219313956797123, + 0.46624308824539185, + 0.9707211162894964, + 0.726733023300767, + 0.5844272468239069, + 2.675508363172412, + 1.8129485491663218, + 0.6367104295641184, + 0.16004931926727295, + 0.4096764326095581, + 1.0306675396859646, + 0.6312271505594254, + 0.6896544583141804, + 0.31560782343149185, + 0.4756027963012457, + 0.6031646430492401, + 0.36343262158334255 + ], + "unique_experts": 64, + "load_cv": 0.6816815382700019, + "normalized_load_entropy": 0.9459115060485984, + "max_load_share": 0.047619047619047616 + } + }, + "s0_period": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "9d92a68857a06eec11365bc10d5f9a6e512651e2ba5aed194efdccf53748d86b", + "route_weight_sha256": "368aec7350aca6b40191861ee72bd8896769e28b0b9c97e111fc790ac0a502dd", + "loads": [ + 22, + 2, + 3, + 24, + 15, + 3, + 39, + 2, + 10, + 8, + 7, + 14, + 17, + 16, + 4, + 22, + 4, + 1, + 24, + 10, + 6, + 18, + 16, + 31, + 31, + 8, + 8, + 9, + 2, + 3, + 9, + 7, + 11, + 5, + 15, + 21, + 12, + 22, + 9, + 24, + 13, + 3, + 12, + 2, + 6, + 1, + 23, + 4, + 4, + 11, + 16, + 4, + 15, + 25, + 14, + 2, + 3, + 12, + 3, + 6, + 5, + 9, + 11, + 2 + ], + "weighted_loads": [ + 3.408408284187317, + 0.0720067247748375, + 0.1430540569126606, + 1.2530952282249928, + 1.8816035017371178, + 0.16743409261107445, + 5.156449435278773, + 0.07984266988933086, + 0.47351385839283466, + 0.3758298493921757, + 0.31506337970495224, + 0.5762606933712959, + 0.7295345328748226, + 3.867340420372784, + 0.21739445626735687, + 0.8754160758107901, + 0.17503469809889793, + 0.03301272168755531, + 1.7834088373929262, + 0.6404070369899273, + 0.39106547459959984, + 1.3788034431636333, + 2.200000301003456, + 1.344250151887536, + 1.292647611349821, + 0.3203952480107546, + 0.33345625922083855, + 0.5314421616494656, + 0.06610418483614922, + 0.09055688232183456, + 0.35327207297086716, + 0.23869759030640125, + 0.4777126666158438, + 0.177801251411438, + 1.2362982742488384, + 1.232332605868578, + 0.4290401628240943, + 0.9995874017477036, + 0.6153031885623932, + 0.8978512994945049, + 0.4450455792248249, + 0.11565666273236275, + 0.3740631891414523, + 0.07190001383423805, + 0.17065266519784927, + 0.07627291232347488, + 1.7411081809550524, + 0.29280101507902145, + 0.15073467791080475, + 0.4548463439568877, + 0.6345446370542049, + 0.1883189007639885, + 2.0617205761373043, + 1.3748392462730408, + 0.5957281105220318, + 0.07428744807839394, + 0.11351985111832619, + 0.9967423342168331, + 0.23777562007308006, + 0.5216396041214466, + 0.22145196050405502, + 0.36460108309984207, + 0.5876105725765228, + 0.10168305970728397 + ], + "unique_experts": 64, + "load_cv": 0.7586537784494028, + "normalized_load_entropy": 0.9332413621588845, + "max_load_share": 0.05416666666666667 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "e1db50fb77077cc63b9a593cd5e73e88b4e6a00ee06bc1cfc48128c1ef7f5fae", + "route_weight_sha256": "960479bd5df29f2101fc810e243dce73ddd9f8b99752d946316e141c9726ce28", + "loads": [ + 29, + 3, + 14, + 24, + 15, + 5, + 39, + 2, + 18, + 8, + 7, + 18, + 17, + 16, + 9, + 28, + 4, + 1, + 44, + 10, + 6, + 21, + 16, + 31, + 31, + 8, + 8, + 9, + 2, + 3, + 15, + 8, + 12, + 6, + 15, + 24, + 12, + 26, + 9, + 26, + 19, + 3, + 14, + 2, + 6, + 1, + 32, + 4, + 7, + 22, + 19, + 6, + 25, + 34, + 14, + 2, + 4, + 13, + 5, + 7, + 5, + 12, + 11, + 4 + ], + "weighted_loads": [ + 3.8307204991579056, + 0.1445140615105629, + 1.160658411681652, + 1.2530952282249928, + 1.8816035017371178, + 0.21426239795982838, + 5.156449435278773, + 0.07984266988933086, + 0.9416037742048502, + 0.3758298493921757, + 0.31506337970495224, + 0.9382669255137444, + 0.7295345328748226, + 3.867340420372784, + 1.2062069792300463, + 1.074640516191721, + 0.17503469809889793, + 0.03301272168755531, + 3.034017449244857, + 0.6404070369899273, + 0.39106547459959984, + 1.4688774701207876, + 2.200000301003456, + 1.344250151887536, + 1.292647611349821, + 0.3203952480107546, + 0.33345625922083855, + 0.5314421616494656, + 0.06610418483614922, + 0.09055688232183456, + 0.5787179917097092, + 0.26591678708791733, + 0.5046317055821419, + 0.21767886728048325, + 1.2362982742488384, + 1.3854475356638432, + 0.4290401628240943, + 1.1201672945171595, + 0.6153031885623932, + 0.9454574175179005, + 0.7206110320985317, + 0.11565666273236275, + 0.43028266448527575, + 0.07190001383423805, + 0.17065266519784927, + 0.07627291232347488, + 3.435012901201844, + 0.29280101507902145, + 0.2941375058144331, + 0.9347231825813651, + 0.7348559126257896, + 0.3449617996811867, + 2.74253648519516, + 2.009109642356634, + 0.5957281105220318, + 0.07428744807839394, + 0.33666253462433815, + 1.0492454282939434, + 0.30282046645879745, + 0.5588115490972996, + 0.22145196050405502, + 0.45567597448825836, + 0.5876105725765228, + 0.19401069544255733 + ], + "unique_experts": 64, + "load_cv": 0.7493794499768207, + "normalized_load_entropy": 0.9344196887343768, + "max_load_share": 0.05057471264367816 + } + }, + "s1_period": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "d0de901bbd0efa222861dcf38372d3f1f70eb5e7d7a3ed158c9734dc62fd8fe3", + "route_weight_sha256": "a90a626aa34c8c90e52a3a70ed3a82ac5b0bbf216436636b26e1728398d2f1ea", + "loads": [ + 22, + 4, + 3, + 26, + 15, + 4, + 38, + 2, + 9, + 8, + 8, + 14, + 21, + 17, + 4, + 18, + 3, + 1, + 23, + 10, + 6, + 21, + 15, + 34, + 29, + 4, + 9, + 9, + 1, + 1, + 8, + 8, + 8, + 7, + 14, + 26, + 9, + 21, + 9, + 18, + 9, + 4, + 12, + 4, + 7, + 1, + 21, + 4, + 9, + 10, + 18, + 4, + 15, + 24, + 10, + 3, + 4, + 12, + 3, + 6, + 7, + 14, + 11, + 1 + ], + "weighted_loads": [ + 3.271227292716503, + 0.13236336968839169, + 0.13898360170423985, + 1.1847921796143055, + 2.0406065098941326, + 0.18632999435067177, + 4.634432235732675, + 0.08672134764492512, + 0.47304124012589455, + 0.3948099613189697, + 0.28425732534378767, + 0.5624597948044538, + 0.9353270567953587, + 3.820731271058321, + 0.19259090721607208, + 0.7229706533253193, + 0.14556081220507622, + 0.040488749742507935, + 1.8549850918352604, + 0.6285762079060078, + 0.36578348837792873, + 1.4965306483209133, + 2.1888915598392487, + 1.4342633988708258, + 1.1490294896066189, + 0.18301991000771523, + 0.3817037120461464, + 0.5527924820780754, + 0.03441223129630089, + 0.035031210631132126, + 0.320981340482831, + 0.2672063820064068, + 0.36849305406212807, + 0.23545770347118378, + 1.1771198399364948, + 1.312807634472847, + 0.3337822565808892, + 0.9355945251882076, + 0.6524605788290501, + 0.6901231333613396, + 0.31327773444354534, + 0.14869556948542595, + 0.43420420587062836, + 0.14968324825167656, + 0.1934883464127779, + 0.0654492974281311, + 1.610080774873495, + 0.2757857218384743, + 0.3636170458048582, + 0.441726453602314, + 0.6586240977048874, + 0.19833417609333992, + 2.068302385509014, + 1.2199690230190754, + 0.4815087132155895, + 0.12040848471224308, + 0.15282630547881126, + 0.8206972740590572, + 0.2815649062395096, + 0.48212237283587456, + 0.3201552592217922, + 0.5274773482233286, + 0.6020992808043957, + 0.0723637267947197 + ], + "unique_experts": 64, + "load_cv": 0.7514594852849297, + "normalized_load_entropy": 0.9348288027462133, + "max_load_share": 0.05277777777777778 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "8fc1c86632291d1b7b040b7150c46027bb5674c7baae1c52d036476adb8abe11", + "route_weight_sha256": "75f57de5cc1d590bd3b7a013b871dee7bae957559a94b447e86d72d00f57b814", + "loads": [ + 29, + 7, + 14, + 26, + 16, + 7, + 39, + 4, + 19, + 10, + 8, + 18, + 22, + 18, + 13, + 22, + 3, + 10, + 46, + 11, + 6, + 24, + 16, + 34, + 29, + 4, + 9, + 9, + 1, + 2, + 17, + 10, + 9, + 8, + 18, + 39, + 9, + 28, + 10, + 21, + 13, + 4, + 14, + 10, + 7, + 1, + 40, + 7, + 12, + 24, + 20, + 11, + 25, + 37, + 12, + 4, + 6, + 18, + 5, + 8, + 7, + 17, + 11, + 8 + ], + "weighted_loads": [ + 3.675118088722229, + 0.269309489056468, + 1.1339624840766191, + 1.1847921796143055, + 2.079248245805502, + 0.2731735985726118, + 4.66416054032743, + 0.15513033419847488, + 1.311826180666685, + 0.47932132333517075, + 0.28425732534378767, + 0.9030087348073721, + 0.9689669162034988, + 3.8622386530041695, + 1.2988385111093521, + 0.8423653412610292, + 0.14556081220507622, + 0.6121789831668139, + 3.7332120928913355, + 0.7635872401297092, + 0.36578348837792873, + 1.5978637915104628, + 2.222174972295761, + 1.4342633988708258, + 1.1490294896066189, + 0.18301991000771523, + 0.3817037120461464, + 0.5527924820780754, + 0.03441223129630089, + 0.07175710424780846, + 0.7877154964953661, + 0.5109913311898708, + 0.4255075268447399, + 0.3142913803458214, + 1.6027794368565083, + 2.5220652744174004, + 0.3337822565808892, + 1.213440366089344, + 0.6887853369116783, + 0.7645436301827431, + 0.46086148358881474, + 0.14869556948542595, + 0.48891274258494377, + 0.6402098871767521, + 0.1934883464127779, + 0.0654492974281311, + 4.322199992835522, + 0.42831555008888245, + 0.4613740164786577, + 1.0255896896123886, + 0.7217926345765591, + 0.6054124757647514, + 2.712906716391444, + 1.9550034254789352, + 0.6016810163855553, + 0.15558008290827274, + 0.4137646332383156, + 1.1136198937892914, + 0.6158591471612453, + 0.6619502417743206, + 0.3201552592217922, + 0.6359789576381445, + 0.6020992808043957, + 0.3294471222907305 + ], + "unique_experts": 64, + "load_cv": 0.6958216051186416, + "normalized_load_entropy": 0.9450232318082175, + "max_load_share": 0.047619047619047616 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 120, + "ordered_topk_exact_tokens": 51, + "set_exact_tokens": 60, + "mean_set_jaccard": 0.8410714285714286, + "mean_token_weighted_tv": 0.031264806798814486, + "aggregate_load_tv": 0.048611111111111105 + }, + "system_bos": { + "tokens": 120, + "ordered_topk_exact_tokens": 51, + "set_exact_tokens": 70, + "mean_set_jaccard": 0.8630952380952382, + "mean_token_weighted_tv": 0.030502361105754973, + "aggregate_load_tv": 0.045833333333333344 + }, + "system_x": { + "tokens": 120, + "ordered_topk_exact_tokens": 40, + "set_exact_tokens": 62, + "mean_set_jaccard": 0.8298412698412698, + "mean_token_weighted_tv": 0.04220429133468618, + "aggregate_load_tv": 0.05138888888888888 + }, + "system_period": { + "tokens": 120, + "ordered_topk_exact_tokens": 38, + "set_exact_tokens": 54, + "mean_set_jaccard": 0.8097222222222222, + "mean_token_weighted_tv": 0.04234418883764495, + "aggregate_load_tv": 0.06388888888888888 + }, + "bos_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 40, + "set_exact_tokens": 54, + "mean_set_jaccard": 0.8222222222222223, + "mean_token_weighted_tv": 0.03640634337983405, + "aggregate_load_tv": 0.05694444444444445 + }, + "bos_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 36, + "set_exact_tokens": 48, + "mean_set_jaccard": 0.8043650793650794, + "mean_token_weighted_tv": 0.03744130844715983, + "aggregate_load_tv": 0.05416666666666667 + }, + "x_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 33, + "set_exact_tokens": 52, + "mean_set_jaccard": 0.8148809523809525, + "mean_token_weighted_tv": 0.039962233315842845, + "aggregate_load_tv": 0.05 + }, + "x_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 31, + "set_exact_tokens": 48, + "mean_set_jaccard": 0.7936507936507937, + "mean_token_weighted_tv": 0.04457060838661467, + "aggregate_load_tv": 0.05555555555555555 + }, + "period_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 37, + "set_exact_tokens": 48, + "mean_set_jaccard": 0.8007936507936508, + "mean_token_weighted_tv": 0.04243848260181646, + "aggregate_load_tv": 0.061111111111111116 + }, + "period_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 30, + "set_exact_tokens": 45, + "mean_set_jaccard": 0.7794444444444444, + "mean_token_weighted_tv": 0.04847136823227629, + "aggregate_load_tv": 0.0736111111111111 + } + } + }, + "layer_19": { + "layer": 19, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "0a89838a6e8d0a73445aab942147c6b4ce3c47058b447185fce87338c4599dc9", + "route_weight_sha256": "02a9fb3be0c634e5fb26aec280522edb2843eca2f891cda3748bd82b305ee176", + "loads": [ + 9, + 18, + 21, + 16, + 11, + 9, + 10, + 8, + 1, + 27, + 21, + 15, + 13, + 15, + 8, + 23, + 4, + 13, + 14, + 16, + 4, + 2, + 8, + 5, + 5, + 6, + 12, + 5, + 20, + 11, + 5, + 15, + 19, + 0, + 21, + 21, + 16, + 15, + 5, + 8, + 14, + 9, + 4, + 4, + 16, + 16, + 5, + 6, + 10, + 2, + 14, + 9, + 4, + 30, + 21, + 8, + 2, + 5, + 6, + 2, + 25, + 6, + 13, + 14 + ], + "weighted_loads": [ + 0.3219405338168144, + 0.9421676564961672, + 0.7394840344786644, + 3.3504149578511715, + 0.7984423991292715, + 1.4974811673164368, + 0.46958984434604645, + 0.9223534241318703, + 0.04711252078413963, + 1.2958571463823318, + 0.7602732442319393, + 0.8030887842178345, + 0.7495476193726063, + 0.6279137283563614, + 0.27450719475746155, + 0.9133241679519415, + 0.16182973608374596, + 2.2211004681885242, + 0.4853784032166004, + 1.4363540057092905, + 0.29922767356038094, + 0.14404083788394928, + 0.2621261142194271, + 0.20577162876725197, + 0.2929293215274811, + 0.1520475409924984, + 1.3338590562343597, + 0.18264099396765232, + 0.9009461626410484, + 0.5826302859932184, + 0.18205245956778526, + 2.2711366340517998, + 1.251305403187871, + 0.0, + 1.8467048238962889, + 0.7939573880285025, + 0.8838213067501783, + 0.5253273136913776, + 0.4300251938402653, + 0.2496358435600996, + 0.5478749815374613, + 0.49612509086728096, + 0.1579349935054779, + 0.16271710768342018, + 1.344525357708335, + 0.6491985004395247, + 0.1716259066015482, + 0.3772985190153122, + 0.3761143945157528, + 0.20332038030028343, + 0.5161838103085756, + 0.2953225038945675, + 0.16000333800911903, + 2.458581741899252, + 1.1588260643184185, + 0.3257213607430458, + 0.04264160431921482, + 0.2768993526697159, + 0.33781730756163597, + 0.08061532117426395, + 1.0139461010694504, + 0.2332387249916792, + 0.7981773614883423, + 0.7234768476337194 + ], + "unique_experts": 63, + "load_cv": 0.6176418715416576, + "normalized_load_entropy": 0.9518690055185557, + "max_load_share": 0.041666666666666664 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "5a65de2da90c667aafda2d946dffb10d3f29ea98bd162a4f0e73705f7fd0b723", + "route_weight_sha256": "fc225319809ecc11ed80cb8174873d350461f238c048a5d6a17c2f68e87e9621", + "loads": [ + 11, + 19, + 24, + 16, + 16, + 10, + 20, + 8, + 1, + 31, + 21, + 16, + 20, + 18, + 12, + 23, + 7, + 13, + 14, + 23, + 4, + 2, + 13, + 14, + 13, + 6, + 12, + 7, + 20, + 16, + 13, + 15, + 20, + 0, + 21, + 22, + 18, + 22, + 6, + 9, + 18, + 13, + 12, + 5, + 17, + 16, + 5, + 9, + 11, + 2, + 14, + 9, + 4, + 32, + 27, + 8, + 2, + 5, + 12, + 2, + 27, + 10, + 20, + 14 + ], + "weighted_loads": [ + 0.36451805010437965, + 1.0282230768352747, + 0.8362005855888128, + 3.3504149578511715, + 1.5576231833547354, + 1.510655683465302, + 0.8801952116191387, + 0.9223534241318703, + 0.04711252078413963, + 1.5107044763863087, + 0.7602732442319393, + 0.8339045252650976, + 1.2288242653012276, + 0.7585539259016514, + 0.5181613769382238, + 0.9133241679519415, + 0.27297303080558777, + 2.2211004681885242, + 0.4853784032166004, + 1.7836801577359438, + 0.29922767356038094, + 0.14404083788394928, + 0.4441746175289154, + 0.5176620567217469, + 0.7611445742659271, + 0.1520475409924984, + 1.3338590562343597, + 0.2764300461858511, + 0.9009461626410484, + 0.7984317485243082, + 0.4711014926433563, + 2.2711366340517998, + 1.29041494615376, + 0.0, + 1.8467048238962889, + 0.85190718062222, + 0.9269273199606687, + 0.8662818260490894, + 0.473151009529829, + 0.2830283772200346, + 0.6565708830021322, + 0.8463409803807735, + 0.7663277238607407, + 0.21887043491005898, + 1.3552353084087372, + 0.6491985004395247, + 0.1716259066015482, + 0.6133431009948254, + 0.41409940645098686, + 0.20332038030028343, + 0.5161838103085756, + 0.2953225038945675, + 0.16000333800911903, + 2.6706197820603848, + 2.900185588747263, + 0.3257213607430458, + 0.04264160431921482, + 0.2768993526697159, + 0.590030625462532, + 0.08061532117426395, + 1.0906648971140385, + 0.4525549467653036, + 1.3307540342211723, + 0.7234768476337194 + ], + "unique_experts": 63, + "load_cv": 0.5470636494447397, + "normalized_load_entropy": 0.9595795518074662, + "max_load_share": 0.0367816091954023 + } + }, + "s1_eos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "bd359857974970dbe6d694de4de2d42420d901c34416bcb6f3f902faee1b4e0e", + "route_weight_sha256": "95a1f975c668b29dbe55b0efd5a32fbd2a620e0738fe36212a9fadc60bdb7043", + "loads": [ + 9, + 17, + 18, + 15, + 11, + 9, + 11, + 8, + 1, + 24, + 25, + 19, + 15, + 14, + 6, + 18, + 5, + 13, + 14, + 13, + 4, + 2, + 11, + 6, + 4, + 6, + 14, + 4, + 22, + 10, + 5, + 15, + 18, + 1, + 21, + 16, + 14, + 15, + 4, + 9, + 13, + 10, + 5, + 4, + 14, + 16, + 5, + 5, + 9, + 2, + 15, + 11, + 2, + 33, + 22, + 10, + 3, + 6, + 6, + 2, + 27, + 6, + 13, + 15 + ], + "weighted_loads": [ + 0.3154977597296238, + 0.8760762996971607, + 0.6601401586085558, + 3.2761328145861626, + 0.7820766679942608, + 1.5623520761728287, + 0.496663436293602, + 0.8824515417218208, + 0.04400377720594406, + 1.176257111132145, + 0.8956989198923111, + 0.94864621758461, + 0.807494992390275, + 0.5604174379259348, + 0.21622061170637608, + 0.7394816819578409, + 0.2004130743443966, + 2.7893457040190697, + 0.46792760491371155, + 1.3333305567502975, + 0.2941441647708416, + 0.1432286985218525, + 0.34475090354681015, + 0.2197132706642151, + 0.22510669752955437, + 0.1406238442286849, + 1.5906020067632198, + 0.15280377492308617, + 0.9672607071697712, + 0.5597987826913595, + 0.18011468648910522, + 2.2599263712763786, + 1.238511849194765, + 0.03185206279158592, + 1.8638878799974918, + 0.6494195591658354, + 0.8084057047963142, + 0.5160276740789413, + 0.40955720096826553, + 0.2415743349120021, + 0.521309008821845, + 0.5750128906220198, + 0.19806703180074692, + 0.14081192202866077, + 1.1607436966151, + 0.6421965938061476, + 0.17052247375249863, + 0.3473762534558773, + 0.3354285452514887, + 0.20038270205259323, + 0.548203619197011, + 0.36386884562671185, + 0.10252949222922325, + 2.26492459513247, + 1.2091791369020939, + 0.3912102784961462, + 0.07674027048051357, + 0.31877264380455017, + 0.3421233706176281, + 0.08478692546486855, + 1.1059462446719408, + 0.22138439863920212, + 0.7946858145296574, + 0.7558905277401209 + ], + "unique_experts": 64, + "load_cv": 0.617441955086658, + "normalized_load_entropy": 0.9529895648968643, + "max_load_share": 0.04583333333333333 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "ae4aae70b84646811fbb0fd61db1fa896de779b6e3007bf594939a98fd1664cb", + "route_weight_sha256": "3452a3c650ab9be386c55b03573add94d6df8ad07f5a025a4e27cbb12520adce", + "loads": [ + 12, + 21, + 20, + 15, + 23, + 11, + 25, + 8, + 1, + 29, + 26, + 26, + 26, + 16, + 16, + 20, + 7, + 18, + 15, + 23, + 7, + 3, + 18, + 13, + 16, + 6, + 14, + 6, + 23, + 12, + 10, + 15, + 21, + 1, + 21, + 16, + 18, + 19, + 5, + 12, + 18, + 19, + 14, + 4, + 15, + 16, + 5, + 15, + 10, + 3, + 20, + 11, + 5, + 44, + 27, + 10, + 5, + 8, + 15, + 4, + 30, + 15, + 22, + 17 + ], + "weighted_loads": [ + 0.3747180551290512, + 1.1471212208271027, + 0.7191254626959562, + 3.2761328145861626, + 2.1841845270246267, + 1.6514003546908498, + 1.1457422599196434, + 0.8824515417218208, + 0.04400377720594406, + 1.414842002093792, + 0.9617756232619286, + 1.671113908290863, + 1.4419527295976877, + 0.6291763000190258, + 0.8568718396127224, + 0.8474503289908171, + 0.5553135797381401, + 3.009529085829854, + 0.5657501742243767, + 1.859931230545044, + 0.5979742668569088, + 0.19709427282214165, + 0.621521444991231, + 0.4470957377925515, + 0.9842409649863839, + 0.1406238442286849, + 1.5906020067632198, + 0.2651320733129978, + 1.0064394734799862, + 0.6403577532619238, + 0.35560560412704945, + 2.2599263712763786, + 1.357386775314808, + 0.03185206279158592, + 1.8638878799974918, + 0.6494195591658354, + 0.9372025728225708, + 0.7047981936484575, + 0.45688172429800034, + 0.37634245958179235, + 0.6617414047941566, + 1.1467288825660944, + 0.9032593704760075, + 0.14081192202866077, + 1.1714536473155022, + 0.6421965938061476, + 0.17052247375249863, + 0.9933370985090733, + 0.3702352475374937, + 0.2458888329565525, + 0.8812576439231634, + 0.36386884562671185, + 0.24617082811892033, + 3.150418298318982, + 2.920571055263281, + 0.3912102784961462, + 0.1570552233606577, + 0.40810366719961166, + 0.7950597703456879, + 0.1490795537829399, + 1.2217924427241087, + 0.6096391566097736, + 1.5130769684910774, + 0.9203345533460379 + ], + "unique_experts": 64, + "load_cv": 0.5379478049333554, + "normalized_load_entropy": 0.9630583122625739, + "max_load_share": 0.045548654244306416 + } + }, + "s0_bos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "82c5939fa81e39c235e0ba96c0b7a29b7920b9bd3f826588cba891cd5106229a", + "route_weight_sha256": "cf1fd5b7097213085eb3110b7f26f4317b91b2028a95476add6eee15ecd20cce", + "loads": [ + 7, + 20, + 15, + 16, + 12, + 9, + 10, + 8, + 1, + 27, + 20, + 17, + 14, + 15, + 7, + 20, + 5, + 12, + 13, + 16, + 6, + 2, + 10, + 7, + 5, + 5, + 13, + 4, + 18, + 11, + 6, + 15, + 19, + 1, + 22, + 24, + 17, + 16, + 4, + 9, + 11, + 7, + 5, + 6, + 12, + 18, + 5, + 6, + 8, + 3, + 12, + 9, + 3, + 29, + 19, + 12, + 3, + 6, + 7, + 3, + 25, + 5, + 13, + 15 + ], + "weighted_loads": [ + 0.22297011129558086, + 1.0520674921572208, + 0.6109194625169039, + 3.4638867117464542, + 0.8139769341796637, + 1.500560749322176, + 0.448676822707057, + 0.9475132972002029, + 0.04270649701356888, + 1.326610542833805, + 0.7633811812847853, + 0.849054666236043, + 0.7858944348990917, + 0.6567998472601175, + 0.23300492577254772, + 0.7954909894615412, + 0.19288860820233822, + 2.4649326652288437, + 0.4459151066839695, + 1.4408562034368515, + 0.37758599780499935, + 0.15425004810094833, + 0.32233448699116707, + 0.24101450573652983, + 0.30746329203248024, + 0.1488491240888834, + 1.5395538471639156, + 0.137550450861454, + 0.8293935470283031, + 0.587162321433425, + 0.21999209374189377, + 2.3159599527716637, + 1.2535662185400724, + 0.03371751308441162, + 1.9825491961091757, + 0.9050645474344492, + 0.9064041506499052, + 0.6063026860356331, + 0.4508192427456379, + 0.26077207922935486, + 0.4448643010109663, + 0.458448376506567, + 0.1995873637497425, + 0.2788705490529537, + 1.4347335435450077, + 0.7496519573032856, + 0.1756721492856741, + 0.3624801244586706, + 0.306526405736804, + 0.24355116486549377, + 0.45197533443570137, + 0.2787594087421894, + 0.13517480716109276, + 2.5843310207128525, + 1.0406435746699572, + 0.4762195535004139, + 0.07951348274946213, + 0.3231331668794155, + 0.3894830197095871, + 0.10892365500330925, + 1.0027207173407078, + 0.20846922881901264, + 0.7472255434840918, + 0.7499102726578712 + ], + "unique_experts": 64, + "load_cv": 0.5937950762616617, + "normalized_load_entropy": 0.9567247276199765, + "max_load_share": 0.04027777777777778 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "efe7265e4937ab6dd2817ae3b345030f17e6a51097091102eae34acc4af8f550", + "route_weight_sha256": "549f4c846f2b70f872f05b576fe9b6b9a10aafc2c50424c6efc4702dad600d87", + "loads": [ + 9, + 21, + 16, + 16, + 16, + 10, + 18, + 8, + 1, + 30, + 21, + 18, + 22, + 20, + 11, + 20, + 8, + 13, + 13, + 23, + 6, + 2, + 15, + 13, + 13, + 5, + 14, + 7, + 18, + 16, + 14, + 15, + 20, + 1, + 22, + 26, + 17, + 24, + 5, + 9, + 14, + 11, + 14, + 7, + 13, + 19, + 5, + 9, + 11, + 3, + 12, + 10, + 3, + 31, + 24, + 12, + 4, + 6, + 13, + 3, + 27, + 8, + 20, + 15 + ], + "weighted_loads": [ + 0.2943203393369913, + 1.1381229124963284, + 0.6354924365878105, + 3.4638867117464542, + 1.4577834140509367, + 1.5137352654710412, + 0.7902145627886057, + 0.9475132972002029, + 0.04270649701356888, + 1.4940412491559982, + 0.8041961211711168, + 0.8798704072833061, + 1.29046999104321, + 0.8715614918619394, + 0.48855028860270977, + 0.7954909894615412, + 0.30403190292418003, + 3.219834491610527, + 0.4459151066839695, + 1.9597505442798138, + 0.37758599780499935, + 0.15425004810094833, + 0.5043829903006554, + 0.466391178779304, + 0.824129730463028, + 0.1488491240888834, + 1.57288421317935, + 0.30523235723376274, + 0.8293935470283031, + 0.7924191188067198, + 0.5147896818816662, + 2.3159599527716637, + 1.287029193714261, + 0.03371751308441162, + 1.9825491961091757, + 0.9818311147391796, + 0.9064041506499052, + 0.962610125541687, + 0.49394505843520164, + 0.26077207922935486, + 0.5452623292803764, + 0.7502022907137871, + 0.8391812574118376, + 0.3350238762795925, + 1.44544349424541, + 0.7746247127652168, + 0.1756721492856741, + 0.5945957023650408, + 0.4253871273249388, + 0.24355116486549377, + 0.45197533443570137, + 0.29419427644461393, + 0.13517480716109276, + 2.7722051218152046, + 1.8383915964514017, + 0.4762195535004139, + 0.11043834127485752, + 0.3231331668794155, + 0.6416963376104832, + 0.10892365500330925, + 1.079115729779005, + 0.39118816144764423, + 1.2798022162169218, + 0.7499102726578712 + ], + "unique_experts": 64, + "load_cv": 0.5257838645447541, + "normalized_load_entropy": 0.9637583744875349, + "max_load_share": 0.035632183908045977 + } + }, + "s1_bos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "e76b38be14159c2ceedc309a62b15c358bab2f1cf04e92f9c416c83ae6a8d7eb", + "route_weight_sha256": "2662dadbeaab085a4deb99152319208e8fb5d8a4c3241b837a14f05d857e722b", + "loads": [ + 6, + 19, + 18, + 16, + 10, + 9, + 11, + 8, + 1, + 26, + 19, + 17, + 14, + 16, + 8, + 19, + 5, + 12, + 10, + 16, + 4, + 2, + 9, + 7, + 4, + 7, + 12, + 3, + 18, + 7, + 5, + 15, + 18, + 0, + 23, + 26, + 16, + 18, + 6, + 9, + 10, + 10, + 4, + 6, + 14, + 18, + 6, + 5, + 8, + 3, + 12, + 8, + 3, + 32, + 22, + 14, + 4, + 6, + 8, + 2, + 24, + 4, + 13, + 15 + ], + "weighted_loads": [ + 0.21585243195295334, + 0.9719377961009741, + 0.6658118087798357, + 3.3662182111293077, + 0.7795867715030909, + 1.5557151958346367, + 0.46650955080986023, + 0.9295425992459059, + 0.04245677590370178, + 1.2709866017103195, + 0.7043321076780558, + 0.8757320046424866, + 0.7744626328349113, + 0.6567402873188257, + 0.27370964735746384, + 0.77603704854846, + 0.19838242419064045, + 2.7625164054334164, + 0.3376715648919344, + 1.4365314785391092, + 0.30877212807536125, + 0.15579911321401596, + 0.28137989714741707, + 0.25409541465342045, + 0.258746437728405, + 0.18946936167776585, + 1.7458385452628136, + 0.10359197109937668, + 0.818976417183876, + 0.45648398622870445, + 0.18433190509676933, + 2.2730710357427597, + 1.2378826513886452, + 0.0, + 1.9078424256294966, + 1.0054769348353148, + 0.8725071605294943, + 0.6923086494207382, + 0.5096345599740744, + 0.2495469469577074, + 0.41893566958606243, + 0.5497337970882654, + 0.1623336225748062, + 0.26125925965607166, + 1.4024877157062292, + 0.7297755889594555, + 0.2003590650856495, + 0.3364771455526352, + 0.3041079733520746, + 0.24166443943977356, + 0.4476487897336483, + 0.2588795395568013, + 0.1329108625650406, + 2.364265440031886, + 1.2019153889268637, + 0.5249269567430019, + 0.1053368840366602, + 0.32244834676384926, + 0.3966846242547035, + 0.08270759880542755, + 0.9842924531549215, + 0.15742737613618374, + 0.7731231022626162, + 0.7450353186577559 + ], + "unique_experts": 63, + "load_cv": 0.6208317797643996, + "normalized_load_entropy": 0.95236460805312, + "max_load_share": 0.044444444444444446 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "50b1295c0b6d7c310de5613026510de54e4b8af41dfdbead4142fe8a43c3070b", + "route_weight_sha256": "17b6211c629182104e3c396526fec8d19ba89e44378a93adb34fb96e5cc66a04", + "loads": [ + 7, + 23, + 22, + 16, + 22, + 11, + 22, + 8, + 1, + 33, + 20, + 24, + 25, + 20, + 18, + 21, + 7, + 17, + 11, + 27, + 7, + 3, + 16, + 12, + 15, + 7, + 12, + 5, + 19, + 10, + 12, + 15, + 21, + 0, + 23, + 28, + 19, + 21, + 7, + 12, + 14, + 19, + 13, + 6, + 15, + 18, + 6, + 15, + 9, + 4, + 17, + 8, + 6, + 43, + 26, + 14, + 6, + 8, + 18, + 4, + 26, + 13, + 22, + 17 + ], + "weighted_loads": [ + 0.23724133148789406, + 1.242982717230916, + 0.7904283460229635, + 3.3662182111293077, + 2.2430282719433308, + 1.6447634743526578, + 1.0218241065740585, + 0.9295425992459059, + 0.04245677590370178, + 1.6094700954854488, + 0.7704088110476732, + 1.5981996953487396, + 1.408920370042324, + 0.8039097189903259, + 0.9262860771268606, + 0.8840056955814362, + 0.553282929584384, + 2.9826997872442007, + 0.4354941342025995, + 2.192284731194377, + 0.6126022301614285, + 0.20966468751430511, + 0.5581504385918379, + 0.43121036514639854, + 1.0934080090373755, + 0.18946936167776585, + 1.7458385452628136, + 0.2314661666750908, + 0.858155183494091, + 0.5678686685860157, + 0.44378617219626904, + 2.2730710357427597, + 1.3597072139382362, + 0.0, + 1.9078424256294966, + 1.1050284299999475, + 0.9973880629986525, + 0.8550263047218323, + 0.5569590833038092, + 0.3942603524774313, + 0.5448875464498997, + 1.090696094557643, + 0.8675259612500668, + 0.26125925965607166, + 1.4131976664066315, + 0.7297755889594555, + 0.2003590650856495, + 0.9628707617521286, + 0.33891467563807964, + 0.28717057034373283, + 0.7807028144598007, + 0.2588795395568013, + 0.27655219845473766, + 3.1751782167702913, + 1.9717257004231215, + 0.5249269567430019, + 0.1856518369168043, + 0.41177937015891075, + 0.8919960781931877, + 0.14700022712349892, + 1.0656381901353598, + 0.5440958775579929, + 1.4915142562240362, + 0.9094793442636728 + ], + "unique_experts": 63, + "load_cv": 0.5399838363695857, + "normalized_load_entropy": 0.9626806908019142, + "max_load_share": 0.044513457556935816 + } + }, + "s0_x": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "c61ada1fca5a982a04a96a8c61bb7c3eed136d5b5548d467abff4b12b77bf630", + "route_weight_sha256": "bb797b35b87b1077a1df2177dd9c1745b26c0e3d25d78645e044638bdbcc1034", + "loads": [ + 6, + 20, + 14, + 16, + 11, + 9, + 10, + 8, + 1, + 26, + 19, + 17, + 14, + 14, + 9, + 21, + 4, + 12, + 11, + 15, + 6, + 2, + 11, + 7, + 4, + 7, + 13, + 3, + 20, + 12, + 3, + 15, + 19, + 0, + 22, + 26, + 17, + 16, + 6, + 7, + 14, + 6, + 5, + 4, + 14, + 17, + 6, + 9, + 8, + 3, + 10, + 10, + 5, + 30, + 19, + 11, + 1, + 4, + 10, + 2, + 25, + 7, + 14, + 13 + ], + "weighted_loads": [ + 0.2031293399631977, + 1.1012303791940212, + 0.5685070119798183, + 3.4198712073266506, + 0.8673081435263157, + 1.468906618654728, + 0.45109304040670395, + 0.952856320887804, + 0.04222476854920387, + 1.3000062014907598, + 0.6994323339313269, + 0.8606427609920502, + 0.8283768985420465, + 0.62408715672791, + 0.31031749583780766, + 0.8384310752153397, + 0.15677943639457226, + 1.9419357925653458, + 0.3902358990162611, + 1.4910916574299335, + 0.35667135566473007, + 0.1480441950261593, + 0.3531130328774452, + 0.2576940804719925, + 0.19106308929622173, + 0.21338574960827827, + 1.3266166672110558, + 0.09765112400054932, + 0.8739696778357029, + 0.6265562064945698, + 0.11949669197201729, + 2.331689417362213, + 1.2669121846556664, + 0.0, + 2.029608704149723, + 0.9991436041891575, + 0.930322676897049, + 0.5674948859959841, + 0.5108425971120596, + 0.2366793304681778, + 0.5404369309544563, + 0.3842354156076908, + 0.18949324265122414, + 0.17287038639187813, + 1.490907408297062, + 0.7426672168076038, + 0.21297212317585945, + 0.48652103170752525, + 0.307742714881897, + 0.24972057901322842, + 0.3959651105105877, + 0.3467116244137287, + 0.1810206137597561, + 2.6198895424604416, + 1.1060515381395817, + 0.45854389667510986, + 0.029507270082831383, + 0.2542671449482441, + 0.5060105249285698, + 0.07462138682603836, + 1.06479661911726, + 0.2916997130960226, + 0.8064977303147316, + 0.6609299294650555 + ], + "unique_experts": 63, + "load_cv": 0.608377725422392, + "normalized_load_entropy": 0.9530089288398897, + "max_load_share": 0.041666666666666664 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "cbaa13b9e8d9cd32be068c520aa4f3b609b22589ca620ccb8b603c3399a767ca", + "route_weight_sha256": "7854ff8fbbeee5b7b2ef015ad568d34bd7be14aeba32bf123d6feeead698d0a9", + "loads": [ + 9, + 21, + 15, + 16, + 16, + 11, + 19, + 8, + 1, + 29, + 19, + 18, + 23, + 17, + 14, + 21, + 7, + 12, + 11, + 21, + 6, + 2, + 17, + 14, + 10, + 7, + 13, + 5, + 20, + 17, + 9, + 15, + 20, + 0, + 23, + 27, + 17, + 23, + 7, + 9, + 18, + 9, + 14, + 6, + 15, + 17, + 6, + 14, + 9, + 3, + 10, + 10, + 5, + 33, + 24, + 11, + 2, + 4, + 17, + 2, + 26, + 11, + 22, + 13 + ], + "weighted_loads": [ + 0.3168141022324562, + 1.1872857995331287, + 0.593079986050725, + 3.4198712073266506, + 1.6933535747230053, + 1.5653833420947194, + 0.8472403325140476, + 0.952856320887804, + 0.04222476854920387, + 1.4662725422531366, + 0.6994323339313269, + 0.8914585020393133, + 1.47961556725204, + 0.747798902913928, + 0.6116579342633486, + 0.8384310752153397, + 0.26792273111641407, + 1.9419357925653458, + 0.3902358990162611, + 1.7790604084730148, + 0.35667135566473007, + 0.1480441950261593, + 0.5863359048962593, + 0.5173553302884102, + 0.5222437027841806, + 0.21338574960827827, + 1.3266166672110558, + 0.19958869740366936, + 0.8739696778357029, + 0.8360493257641792, + 0.32991473004221916, + 2.331689417362213, + 1.3081867881119251, + 0.0, + 2.073216989636421, + 1.057093396782875, + 0.930322676897049, + 0.837196359410882, + 0.5539684128016233, + 0.30314377322793007, + 0.6941964421421289, + 0.6553814895451069, + 0.9383646734058857, + 0.2690776474773884, + 1.5016173589974642, + 0.7426672168076038, + 0.21297212317585945, + 0.8355943113565445, + 0.34572772681713104, + 0.24972057901322842, + 0.3959651105105877, + 0.3467116244137287, + 0.1810206137597561, + 2.839012410491705, + 1.9037995599210262, + 0.45854389667510986, + 0.06654280237853527, + 0.2542671449482441, + 0.8053014539182186, + 0.07462138682603836, + 1.0999184176325798, + 0.5033406484872103, + 1.3869463168084621, + 0.6609299294650555 + ], + "unique_experts": 63, + "load_cv": 0.5386526253649236, + "normalized_load_entropy": 0.9611001619616726, + "max_load_share": 0.03793103448275862 + } + }, + "s1_x": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "a49bae868c6d7a6d233f3396e936466464c5cc76f06917f5b1987c0691ba7909", + "route_weight_sha256": "44c4a2284bbdd18767bc1e144f4d95addba87054259d092129a66bd5e6e6c812", + "loads": [ + 10, + 18, + 18, + 15, + 10, + 9, + 9, + 7, + 1, + 26, + 19, + 12, + 16, + 15, + 8, + 17, + 4, + 12, + 9, + 17, + 4, + 2, + 11, + 7, + 3, + 8, + 13, + 3, + 22, + 8, + 5, + 15, + 19, + 0, + 22, + 23, + 17, + 18, + 6, + 10, + 8, + 12, + 5, + 4, + 13, + 17, + 6, + 8, + 11, + 3, + 14, + 11, + 3, + 28, + 22, + 11, + 2, + 5, + 9, + 2, + 27, + 8, + 13, + 10 + ], + "weighted_loads": [ + 0.3617715109139681, + 0.869675051420927, + 0.6838808804750443, + 3.1463260650634766, + 0.8331184946000576, + 1.5797859467566013, + 0.417454419657588, + 0.8765666149556637, + 0.04019922390580177, + 1.2030571550130844, + 0.6878529321402311, + 0.6691694296896458, + 0.8020533565431833, + 0.5913332402706146, + 0.29737390764057636, + 0.7153485547751188, + 0.148012051358819, + 2.1040432043373585, + 0.29765327647328377, + 1.4991776645183563, + 0.3027109131217003, + 0.1509639024734497, + 0.34072355926036835, + 0.2574726864695549, + 0.1444865744560957, + 0.24279999732971191, + 1.5099721513688564, + 0.10418940708041191, + 0.9453207906335592, + 0.500114943832159, + 0.18053099885582924, + 2.223955951631069, + 1.2815332897007465, + 0.0, + 1.9353856015950441, + 0.8615938071161509, + 0.9093111623078585, + 0.6420016046613455, + 0.47729119658470154, + 0.3419609274715185, + 0.35437879525125027, + 0.6252639815211296, + 0.18041281402111053, + 0.14836492389440536, + 1.2286127544939518, + 0.7389037907123566, + 0.2101474180817604, + 0.469375092536211, + 0.4156584572046995, + 0.23628240264952183, + 0.5221865996718407, + 0.3875362668186426, + 0.1227814182639122, + 1.9320399276912212, + 1.2364982850849628, + 0.43773203156888485, + 0.05716082267463207, + 0.28615688532590866, + 0.42734505608677864, + 0.08229260891675949, + 1.1246812641620636, + 0.26325172558426857, + 0.7754930555820465, + 0.61397310718894 + ], + "unique_experts": 63, + "load_cv": 0.6004113816047243, + "normalized_load_entropy": 0.9542029086886565, + "max_load_share": 0.03888888888888889 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "7b83cc0c0169d725866347ec85149fad71a7659aab70aa41a56484d6ef2b32f9", + "route_weight_sha256": "562277c13b376786b98ac6933cece9da0c17f20f00cba5a3daaf08dbecd6b529", + "loads": [ + 12, + 23, + 21, + 15, + 22, + 12, + 20, + 7, + 1, + 31, + 20, + 19, + 29, + 17, + 19, + 19, + 6, + 18, + 10, + 25, + 7, + 3, + 20, + 12, + 12, + 8, + 13, + 5, + 23, + 10, + 10, + 15, + 23, + 0, + 22, + 23, + 20, + 20, + 7, + 12, + 11, + 21, + 16, + 5, + 14, + 17, + 6, + 20, + 12, + 4, + 19, + 11, + 6, + 39, + 26, + 11, + 4, + 7, + 19, + 4, + 29, + 19, + 23, + 12 + ], + "weighted_loads": [ + 0.4206301439553499, + 1.1865352354943752, + 0.7782212868332863, + 3.1463260650634766, + 2.188541939482093, + 1.712579251267016, + 0.9372680690139532, + 0.8765666149556637, + 0.04019922390580177, + 1.4595847874879837, + 0.7539296355098486, + 1.3916371203958988, + 1.5753991808742285, + 0.6549924556165934, + 1.0020780116319656, + 0.823317201808095, + 0.5029125567525625, + 2.3604460190981627, + 0.3954758457839489, + 1.899524874985218, + 0.6065410152077675, + 0.20482947677373886, + 0.6863475199788809, + 0.434587636962533, + 0.7558786049485207, + 0.24279999732971191, + 1.5099721513688564, + 0.24278144165873528, + 0.9844995569437742, + 0.582429364323616, + 0.3558564353734255, + 2.223955951631069, + 1.4449074566364288, + 0.0, + 1.9353856015950441, + 0.8615938071161509, + 1.0341920647770166, + 0.7381589654833078, + 0.5246157199144363, + 0.44327941350638866, + 0.44445547834038734, + 1.1090296283364296, + 1.1034940648823977, + 0.1849183775484562, + 1.239322705194354, + 0.7389037907123566, + 0.2101474180817604, + 1.2407693974673748, + 0.45046515949070454, + 0.2817885335534811, + 0.8552406243979931, + 0.3875362668186426, + 0.2664227541536093, + 2.762636099010706, + 2.0063085965812206, + 0.43773203156888485, + 0.1374757755547762, + 0.37548790872097015, + 0.9126971177756786, + 0.14658523723483086, + 1.2024877145886421, + 0.7632379122078419, + 1.5839566998183727, + 0.778417132794857 + ], + "unique_experts": 63, + "load_cv": 0.5280396140928509, + "normalized_load_entropy": 0.9631552380049541, + "max_load_share": 0.040372670807453416 + } + }, + "s0_period": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "9dd2a141b51b3560c441e543041ff4a08ca61dcb7e11be9a2a7bdc484c81830a", + "route_weight_sha256": "560e27ea81918187832ca05e4efc097542d21376f7cbb03601016c18923920ee", + "loads": [ + 6, + 19, + 14, + 16, + 10, + 9, + 7, + 8, + 1, + 25, + 22, + 18, + 13, + 14, + 10, + 23, + 4, + 12, + 11, + 15, + 6, + 2, + 8, + 7, + 3, + 7, + 12, + 3, + 19, + 11, + 3, + 15, + 20, + 0, + 22, + 26, + 17, + 16, + 6, + 6, + 11, + 9, + 4, + 5, + 15, + 19, + 5, + 8, + 9, + 3, + 13, + 11, + 4, + 28, + 19, + 13, + 0, + 5, + 9, + 2, + 26, + 9, + 13, + 14 + ], + "weighted_loads": [ + 0.20435143820941448, + 1.060489570721984, + 0.5639428086578846, + 3.4304630272090435, + 0.8190005235373974, + 1.489775512367487, + 0.35106347873806953, + 0.9575042091310024, + 0.04168751463294029, + 1.2710396591573954, + 0.8303029257804155, + 0.905578950420022, + 0.783906351774931, + 0.6177330762147903, + 0.3439915422350168, + 0.9216080848127604, + 0.14915171451866627, + 1.883980493992567, + 0.3799810912460089, + 1.5318071134388447, + 0.3659783024340868, + 0.15041068568825722, + 0.2638842221349478, + 0.24714233726263046, + 0.15343398973345757, + 0.2204504795372486, + 1.3544938825070858, + 0.10103301331400871, + 0.8270681872963905, + 0.5965463183820248, + 0.12306150794029236, + 2.3223481625318527, + 1.2899328339844942, + 0.0, + 2.026902474462986, + 1.014067942276597, + 0.9304983727633953, + 0.5655355658382177, + 0.5072156954556704, + 0.2024996131658554, + 0.4264016877859831, + 0.5156962461769581, + 0.16644656285643578, + 0.19004273787140846, + 1.5127266887575388, + 0.7954156026244164, + 0.18474585562944412, + 0.441028218716383, + 0.341189619153738, + 0.24708909727633, + 0.48205474577844143, + 0.38391862250864506, + 0.16263580322265625, + 2.4449392091482878, + 1.109669929370284, + 0.509301895275712, + 0.0, + 0.2903602607548237, + 0.45183708891272545, + 0.08115001395344734, + 1.054735160432756, + 0.3465223703533411, + 0.7738670706748962, + 0.6994963195174932 + ], + "unique_experts": 62, + "load_cv": 0.6180415104521503, + "normalized_load_entropy": 0.9506024032665272, + "max_load_share": 0.03888888888888889 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "1e48a2f77d4f8625abf2cfb6c5083f5b18ae4c1c20a160d6c1a4ea58dd0ee6b5", + "route_weight_sha256": "87585268de3c2131555d881470ed6069617eb90f6eb106571f016cf2c2add378", + "loads": [ + 9, + 20, + 16, + 16, + 15, + 11, + 15, + 8, + 1, + 28, + 22, + 19, + 21, + 16, + 15, + 23, + 8, + 12, + 12, + 21, + 6, + 2, + 13, + 14, + 10, + 7, + 12, + 5, + 19, + 17, + 10, + 15, + 21, + 0, + 23, + 27, + 18, + 23, + 7, + 6, + 15, + 12, + 12, + 6, + 16, + 19, + 5, + 13, + 10, + 3, + 13, + 11, + 4, + 31, + 24, + 13, + 1, + 5, + 15, + 2, + 28, + 14, + 21, + 14 + ], + "weighted_loads": [ + 0.32307211868464947, + 1.1465449910610914, + 0.6195754669606686, + 3.4304630272090435, + 1.6722782589495182, + 1.5758628034964204, + 0.6926012188196182, + 0.9575042091310024, + 0.04168751463294029, + 1.4504944924265146, + 0.8303029257804155, + 0.9363946914672852, + 1.328608714044094, + 0.6965816207230091, + 0.6533731836825609, + 0.9216080848127604, + 0.2890818063169718, + 1.883980493992567, + 0.42181761004030704, + 1.8320252597332, + 0.3659783024340868, + 0.15041068568825722, + 0.4459327254444361, + 0.5034265406429768, + 0.5299354046583176, + 0.2204504795372486, + 1.3544938825070858, + 0.21016477048397064, + 0.8270681872963905, + 0.836792353540659, + 0.3861590661108494, + 2.3223481625318527, + 1.3315328154712915, + 0.0, + 2.092536933720112, + 1.0720177348703146, + 0.9805458299815655, + 0.853797497227788, + 0.5503415111452341, + 0.2024996131658554, + 0.572936151176691, + 0.7693770080804825, + 0.7748392932116985, + 0.24619606509804726, + 1.523436639457941, + 0.7954156026244164, + 0.18474585562944412, + 0.8348325192928314, + 0.3791746310889721, + 0.24708909727633, + 0.48205474577844143, + 0.38391862250864506, + 0.16263580322265625, + 2.6851290706545115, + 1.9074179511517286, + 0.509301895275712, + 0.0352831669151783, + 0.2903602607548237, + 0.7040504068136215, + 0.08115001395344734, + 1.1228324798867106, + 0.6521209813654423, + 1.3446708247065544, + 0.6994963195174932 + ], + "unique_experts": 63, + "load_cv": 0.5332887416951165, + "normalized_load_entropy": 0.9611419416647823, + "max_load_share": 0.035632183908045977 + } + }, + "s1_period": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "1f575561998f090bdfb9b5e5f5bd568d86e207f2ddb484573e20940e9b5a5117", + "route_weight_sha256": "6f49ca2c80d604ffa1b640fab717f26c3fdb2ddc2abdecbcf09af8de30197cf0", + "loads": [ + 9, + 18, + 21, + 16, + 10, + 9, + 9, + 8, + 1, + 29, + 21, + 14, + 15, + 13, + 8, + 18, + 4, + 12, + 5, + 19, + 4, + 2, + 10, + 7, + 3, + 7, + 13, + 4, + 17, + 10, + 5, + 15, + 20, + 1, + 22, + 25, + 17, + 21, + 5, + 10, + 10, + 10, + 5, + 5, + 11, + 17, + 6, + 8, + 10, + 2, + 15, + 9, + 3, + 27, + 21, + 13, + 3, + 4, + 8, + 2, + 24, + 6, + 13, + 11 + ], + "weighted_loads": [ + 0.31814187578856945, + 0.9146368727087975, + 0.7486314699053764, + 3.245294703170657, + 0.7788278665393591, + 1.5871253311634064, + 0.41734449937939644, + 0.9026447366923094, + 0.041241466999053955, + 1.3227979838848114, + 0.7897394951432943, + 0.7368852011859417, + 0.787276366725564, + 0.5264109689742327, + 0.29917432367801666, + 0.7659406065940857, + 0.15245990827679634, + 1.9604979418218136, + 0.17240474559366703, + 1.6426441054791212, + 0.30410774424672127, + 0.15115240961313248, + 0.3188589233905077, + 0.25965921580791473, + 0.16308108158409595, + 0.21567440778017044, + 1.5603473335504532, + 0.14068861864507198, + 0.8103272020816803, + 0.5631771702319384, + 0.17150881327688694, + 2.268065731972456, + 1.3305017743259668, + 0.03375696390867233, + 1.9552211668342352, + 0.9350710976868868, + 0.8984887320548296, + 0.7436702530831099, + 0.4450025614351034, + 0.34506737999618053, + 0.44417874328792095, + 0.557997465133667, + 0.18200339935719967, + 0.1898456234484911, + 1.1498214732855558, + 0.7314968444406986, + 0.21718296594917774, + 0.4772850535809994, + 0.38532098568975925, + 0.20887599140405655, + 0.5497645828872919, + 0.3257761597633362, + 0.12738302536308765, + 1.9844449870288372, + 1.1749885641038418, + 0.49233067221939564, + 0.08907081745564938, + 0.2521844431757927, + 0.3715961165726185, + 0.08550013601779938, + 1.0197098720818758, + 0.20708634704351425, + 0.7608505040407181, + 0.6218439191579819 + ], + "unique_experts": 64, + "load_cv": 0.6150378890265799, + "normalized_load_entropy": 0.9532396891858566, + "max_load_share": 0.04027777777777778 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "c821accb3df3b65eea0921619d3eb5859b89cdc9f576521fc4559e16b8bb90a0", + "route_weight_sha256": "254e0f91988f4fe7deb82ac72fb4df65e88b78b408fbd7a9be3e2fe97a0a128c", + "loads": [ + 11, + 22, + 24, + 16, + 22, + 12, + 19, + 8, + 1, + 34, + 22, + 21, + 27, + 15, + 20, + 20, + 6, + 17, + 6, + 28, + 7, + 3, + 17, + 12, + 11, + 7, + 13, + 6, + 18, + 12, + 10, + 15, + 23, + 1, + 24, + 26, + 20, + 23, + 6, + 13, + 13, + 19, + 15, + 6, + 12, + 17, + 6, + 21, + 11, + 3, + 20, + 9, + 6, + 39, + 25, + 13, + 5, + 6, + 17, + 4, + 27, + 18, + 23, + 13 + ], + "weighted_loads": [ + 0.3744745422154665, + 1.1856817938387394, + 0.8442567475140095, + 3.245294703170657, + 2.243271067738533, + 1.7189525002613664, + 0.9044141881167889, + 0.9026447366923094, + 0.041241466999053955, + 1.5813413560390472, + 0.8558161985129118, + 1.4593528918921947, + 1.472271366044879, + 0.5912609659135342, + 1.0328848119825125, + 0.8739092536270618, + 0.5073604136705399, + 2.180681323632598, + 0.27022731490433216, + 2.0940739158540964, + 0.6079378463327885, + 0.20501798391342163, + 0.5956294648349285, + 0.43677416630089283, + 0.7102176025509834, + 0.21567440778017044, + 1.5603473335504532, + 0.27643527649343014, + 0.8495059683918953, + 0.645354924723506, + 0.3443153463304043, + 2.268065731972456, + 1.462721886113286, + 0.03375696390867233, + 2.057779824361205, + 0.9736854862421751, + 1.0233696345239878, + 0.8299992475658655, + 0.4923270847648382, + 0.4861272517591715, + 0.5357483513653278, + 1.039192721247673, + 0.9209570903331041, + 0.22182207368314266, + 1.160531423985958, + 0.7314968444406986, + 0.21718296594917774, + 1.3612437509000301, + 0.4201276879757643, + 0.2543821223080158, + 0.8828186076134443, + 0.3257761597633362, + 0.27102436125278473, + 2.890459395945072, + 1.9447988756000996, + 0.49233067221939564, + 0.1693857703357935, + 0.3415154665708542, + 0.8245325163006783, + 0.14979276433587074, + 1.143888233229518, + 0.7369937039911747, + 1.522579774260521, + 0.7862879447638988 + ], + "unique_experts": 64, + "load_cv": 0.5396026656556683, + "normalized_load_entropy": 0.9625407184615924, + "max_load_share": 0.040372670807453416 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 120, + "ordered_topk_exact_tokens": 44, + "set_exact_tokens": 61, + "mean_set_jaccard": 0.8438492063492063, + "mean_token_weighted_tv": 0.03187139752165725, + "aggregate_load_tv": 0.05277777777777777 + }, + "system_bos": { + "tokens": 120, + "ordered_topk_exact_tokens": 41, + "set_exact_tokens": 58, + "mean_set_jaccard": 0.8331349206349207, + "mean_token_weighted_tv": 0.03457147028918068, + "aggregate_load_tv": 0.04305555555555555 + }, + "system_x": { + "tokens": 120, + "ordered_topk_exact_tokens": 28, + "set_exact_tokens": 41, + "mean_set_jaccard": 0.7755952380952382, + "mean_token_weighted_tv": 0.04781695002845178, + "aggregate_load_tv": 0.0625 + }, + "system_period": { + "tokens": 120, + "ordered_topk_exact_tokens": 25, + "set_exact_tokens": 43, + "mean_set_jaccard": 0.7753968253968255, + "mean_token_weighted_tv": 0.04606304873789971, + "aggregate_load_tv": 0.06805555555555555 + }, + "bos_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 39, + "set_exact_tokens": 56, + "mean_set_jaccard": 0.814484126984127, + "mean_token_weighted_tv": 0.03914875479337449, + "aggregate_load_tv": 0.05277777777777778 + }, + "bos_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 39, + "set_exact_tokens": 55, + "mean_set_jaccard": 0.8025793650793652, + "mean_token_weighted_tv": 0.03906126206663127, + "aggregate_load_tv": 0.06666666666666665 + }, + "x_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 35, + "set_exact_tokens": 48, + "mean_set_jaccard": 0.7878571428571429, + "mean_token_weighted_tv": 0.04421513562556356, + "aggregate_load_tv": 0.05972222222222222 + }, + "x_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 29, + "set_exact_tokens": 46, + "mean_set_jaccard": 0.7661507936507939, + "mean_token_weighted_tv": 0.04741109615812699, + "aggregate_load_tv": 0.06944444444444445 + }, + "period_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 36, + "set_exact_tokens": 54, + "mean_set_jaccard": 0.7969047619047619, + "mean_token_weighted_tv": 0.04314451829607909, + "aggregate_load_tv": 0.05972222222222221 + }, + "period_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 27, + "set_exact_tokens": 41, + "mean_set_jaccard": 0.7461111111111111, + "mean_token_weighted_tv": 0.05004551339273652, + "aggregate_load_tv": 0.07777777777777778 + } + } + }, + "layer_20": { + "layer": 20, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "e402bed3f602482db4cc31cd98ece75085071e271e5a9c95e151d7938f30cb30", + "route_weight_sha256": "4534ecd4b89ab22ffec836c4d2cffbbe0fd624692d4e119035721ec45a476d76", + "loads": [ + 12, + 5, + 17, + 4, + 19, + 18, + 15, + 11, + 11, + 4, + 24, + 16, + 22, + 5, + 18, + 4, + 6, + 3, + 8, + 15, + 3, + 10, + 12, + 8, + 4, + 27, + 5, + 2, + 1, + 12, + 5, + 14, + 8, + 9, + 21, + 10, + 8, + 8, + 3, + 1, + 25, + 32, + 8, + 8, + 7, + 15, + 13, + 8, + 9, + 10, + 30, + 6, + 9, + 28, + 11, + 13, + 8, + 29, + 3, + 1, + 13, + 5, + 9, + 12 + ], + "weighted_loads": [ + 0.4725622162222862, + 0.17216630838811398, + 1.1500850692391396, + 0.1462128348648548, + 0.8458541911095381, + 0.9266767557710409, + 2.274138316512108, + 0.4770274702459574, + 0.8861145451664925, + 0.3612458575516939, + 1.3297212664037943, + 2.2109147142618895, + 1.9889121111482382, + 0.35965390130877495, + 0.7289100270718336, + 0.16524210944771767, + 0.30413063429296017, + 0.3641381114721298, + 0.44938623160123825, + 1.2518736571073532, + 0.1017273236066103, + 0.5223299786448479, + 0.614781741052866, + 0.3451124504208565, + 0.22325201705098152, + 1.474340546876192, + 0.16995512507855892, + 0.15564027801156044, + 0.03162746876478195, + 0.4859314113855362, + 0.2249436341226101, + 0.4728258829563856, + 0.4468521624803543, + 0.4192518778145313, + 1.0089172404259443, + 0.44190999306738377, + 0.28488072752952576, + 0.32109845243394375, + 0.08537077903747559, + 0.03663903474807739, + 0.9661792367696762, + 1.4077021032571793, + 0.6780068650841713, + 0.38428945094347, + 0.40931393951177597, + 0.6408389564603567, + 0.6930407173931599, + 0.29057490453124046, + 0.32104920595884323, + 0.3301402349025011, + 3.154301807284355, + 0.23344380781054497, + 0.32330645993351936, + 1.163423227146268, + 0.4884920883923769, + 1.3842664323747158, + 0.44392628222703934, + 1.4130098819732666, + 0.10914250463247299, + 0.039896368980407715, + 0.8862022869288921, + 0.17263506539165974, + 0.3375289160758257, + 0.440971277654171 + ], + "unique_experts": 64, + "load_cv": 0.6784150009988332, + "normalized_load_entropy": 0.9470088280057752, + "max_load_share": 0.044444444444444446 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "637892e1b3bd5de244ac0064d0c739b0d6102f172981a466827f8d4c93076a3b", + "route_weight_sha256": "63ee3a3c26c5bcf363999820acf7f94fb782f90a3dbedcbdfb1cbfb80bdad817", + "loads": [ + 12, + 7, + 17, + 12, + 27, + 22, + 20, + 16, + 11, + 4, + 24, + 17, + 26, + 5, + 18, + 11, + 6, + 3, + 18, + 15, + 8, + 10, + 19, + 8, + 4, + 35, + 6, + 2, + 1, + 14, + 6, + 14, + 8, + 10, + 22, + 10, + 10, + 10, + 6, + 1, + 28, + 35, + 10, + 11, + 14, + 15, + 13, + 9, + 10, + 11, + 38, + 6, + 10, + 35, + 11, + 16, + 9, + 34, + 4, + 1, + 25, + 9, + 9, + 12 + ], + "weighted_loads": [ + 0.4725622162222862, + 0.21684868447482586, + 1.1500850692391396, + 0.7504349909722805, + 1.2374954763799906, + 1.1191756837069988, + 2.4252949748188257, + 0.7980954572558403, + 0.8861145451664925, + 0.3612458575516939, + 1.3297212664037943, + 2.2537981886416674, + 2.1154288854449987, + 0.35965390130877495, + 0.7289100270718336, + 0.5245181955397129, + 0.30413063429296017, + 0.3641381114721298, + 1.340877115726471, + 1.2518736571073532, + 0.25203805416822433, + 0.5223299786448479, + 1.0003379806876183, + 0.3451124504208565, + 0.22325201705098152, + 2.0048728734254837, + 0.18739653937518597, + 0.15564027801156044, + 0.03162746876478195, + 0.5502358991652727, + 0.2513487245887518, + 0.4728258829563856, + 0.4468521624803543, + 0.44230711832642555, + 1.0549175385385752, + 0.44190999306738377, + 0.3319764882326126, + 0.3803672734647989, + 1.4339900743216276, + 0.03663903474807739, + 1.1262307539582253, + 1.5177636221051216, + 0.8614431545138359, + 0.48112189990933985, + 0.6437320802360773, + 0.6408389564603567, + 0.6930407173931599, + 0.33599333465099335, + 0.32269194070249796, + 0.36391269601881504, + 4.167603243142366, + 0.23344380781054497, + 0.3583922013640404, + 1.5138127505779266, + 0.4884920883923769, + 1.770709440112114, + 0.5066501349210739, + 1.5708925612270832, + 0.1479690931737423, + 0.039896368980407715, + 2.1439845808781683, + 0.4029520396143198, + 0.3375289160758257, + 0.440971277654171 + ], + "unique_experts": 64, + "load_cv": 0.6620330450025788, + "normalized_load_entropy": 0.9495581167880681, + "max_load_share": 0.04367816091954023 + } + }, + "s1_eos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "571cbdab119045a5943b7f123eee956759557885c306eda214fdcbfe4052c4b4", + "route_weight_sha256": "47c6639d18e388ba70dd58bab748b780f6de9a6323f716a063dce76571f9df42", + "loads": [ + 12, + 5, + 17, + 3, + 18, + 15, + 15, + 9, + 12, + 5, + 24, + 17, + 22, + 5, + 15, + 5, + 6, + 3, + 8, + 15, + 5, + 10, + 12, + 8, + 4, + 26, + 5, + 2, + 0, + 13, + 5, + 14, + 7, + 9, + 24, + 9, + 8, + 8, + 4, + 2, + 21, + 31, + 8, + 7, + 7, + 12, + 13, + 7, + 8, + 15, + 26, + 12, + 9, + 33, + 9, + 13, + 9, + 25, + 6, + 1, + 12, + 3, + 12, + 15 + ], + "weighted_loads": [ + 0.4676992688328028, + 0.17151307128369808, + 1.165938377380371, + 0.11481037363409996, + 0.8136862590909004, + 0.7973042223602533, + 2.2637196704745293, + 0.42253489047288895, + 0.8716456759721041, + 0.3967907689511776, + 1.3969950545579195, + 2.435537489131093, + 2.029702875763178, + 0.369926605373621, + 0.6159246284514666, + 0.2637996282428503, + 0.3063753843307495, + 0.36410462856292725, + 0.46442445181310177, + 1.1980984564870596, + 0.16215349175035954, + 0.5265050195157528, + 0.5857303515076637, + 0.34085896238684654, + 0.22657831013202667, + 1.4368542041629553, + 0.17135123908519745, + 0.14647328481078148, + 0.0, + 0.4972662925720215, + 0.23934095352888107, + 0.4872049205005169, + 0.40420023910701275, + 0.38586784340441227, + 1.1417737230658531, + 0.4239874705672264, + 0.2908779066056013, + 0.3178812861442566, + 0.12091481499373913, + 0.06369655579328537, + 0.8878673911094666, + 1.3821066245436668, + 0.6670811772346497, + 0.37587832659482956, + 0.3834101613610983, + 0.5546465031802654, + 0.6868076622486115, + 0.2574418429285288, + 0.2866597790271044, + 0.49846495129168034, + 2.8510692808777094, + 0.4102600887417793, + 0.307526633143425, + 1.2958779744803905, + 0.40737312473356724, + 1.2534227035939693, + 0.4813033137470484, + 1.2386056073009968, + 0.21162566915154457, + 0.04075126349925995, + 0.8597358092665672, + 0.11968113668262959, + 0.46819634176790714, + 0.5412092804908752 + ], + "unique_experts": 63, + "load_cv": 0.6524408113734754, + "normalized_load_entropy": 0.9502738734479513, + "max_load_share": 0.04583333333333333 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "e133f05679879c04246a129b36739ef8b5faddf8d29c69a12a4239356be8ffc2", + "route_weight_sha256": "ca40f5ea621480b49c41590623d12c1edea9e0598e0c688061cc7c48f0516bda", + "loads": [ + 17, + 7, + 17, + 14, + 26, + 24, + 17, + 19, + 12, + 7, + 26, + 17, + 24, + 6, + 16, + 20, + 11, + 3, + 18, + 16, + 10, + 11, + 23, + 10, + 5, + 40, + 6, + 4, + 0, + 17, + 5, + 15, + 8, + 10, + 27, + 11, + 11, + 14, + 7, + 7, + 26, + 32, + 10, + 13, + 19, + 13, + 13, + 7, + 10, + 20, + 39, + 12, + 10, + 41, + 10, + 23, + 10, + 32, + 8, + 2, + 25, + 5, + 13, + 15 + ], + "weighted_loads": [ + 0.6995084844529629, + 0.21579719334840775, + 1.165938377380371, + 0.8675916604697704, + 1.2268038019537926, + 1.1707936823368073, + 2.33157442137599, + 1.0527604166418314, + 0.8716456759721041, + 0.6287065483629704, + 1.4875114243477583, + 2.435537489131093, + 2.0945049077272415, + 0.6530289985239506, + 0.6758203785866499, + 1.1536275669932365, + 0.6170885935425758, + 0.36410462856292725, + 1.4425700809806585, + 1.2312048468738794, + 0.32088007405400276, + 0.5615700632333755, + 1.2323191985487938, + 0.5139174126088619, + 0.24662244878709316, + 2.3309715278446674, + 0.1887926533818245, + 0.20573738031089306, + 0.0, + 0.6214943956583738, + 0.23934095352888107, + 0.5179698318243027, + 0.45328095369040966, + 0.42890932224690914, + 1.2862395104020834, + 0.6035012602806091, + 0.3953844755887985, + 0.5365251023322344, + 1.4816456642001867, + 0.29439548030495644, + 1.1418765746057034, + 1.4315220527350903, + 0.8295841440558434, + 0.6062604081816971, + 1.1367584113031626, + 0.6272365711629391, + 0.6868076622486115, + 0.2574418429285288, + 0.32180636771954596, + 0.8105922695249319, + 4.471233295276761, + 0.4102600887417793, + 0.34241387248039246, + 1.6556168179959059, + 0.4345773346722126, + 2.2349818497896194, + 0.525750195607543, + 1.7711701337248087, + 0.28761183097958565, + 0.0687322448939085, + 2.276733997510746, + 0.2371202278882265, + 0.5254582744091749, + 0.5412092804908752 + ], + "unique_experts": 63, + "load_cv": 0.6031031379949428, + "normalized_load_entropy": 0.9573673775365064, + "max_load_share": 0.042443064182194616 + } + }, + "s0_bos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "cae6e9a4e86c7cb5b1203c489dc412ba6bdb0d5eabea70e64c585164458a88a7", + "route_weight_sha256": "937e090c3d22e2cbd5b9bb092f58d7e6e615459ed4ed64422dd07692b5bc2cc8", + "loads": [ + 10, + 5, + 20, + 3, + 16, + 18, + 15, + 9, + 11, + 4, + 24, + 15, + 22, + 6, + 15, + 6, + 6, + 3, + 8, + 15, + 5, + 10, + 11, + 8, + 3, + 27, + 5, + 2, + 0, + 10, + 3, + 15, + 8, + 10, + 26, + 11, + 6, + 7, + 4, + 1, + 22, + 37, + 8, + 6, + 9, + 14, + 14, + 6, + 9, + 15, + 27, + 7, + 9, + 26, + 10, + 14, + 9, + 26, + 5, + 1, + 12, + 4, + 11, + 16 + ], + "weighted_loads": [ + 0.41493006609380245, + 0.1781329233199358, + 1.2582187689840794, + 0.10506599396467209, + 0.7278301641345024, + 0.9310733713209629, + 2.3496974632143974, + 0.4386077858507633, + 0.9155207481235266, + 0.36177318543195724, + 1.3496067691594362, + 2.6636679247021675, + 2.0590447653084993, + 0.36237344332039356, + 0.6024829838424921, + 0.23774269223213196, + 0.34415311738848686, + 0.4044712632894516, + 0.4454013165086508, + 1.2570653483271599, + 0.16390507109463215, + 0.5187487229704857, + 0.5957485809922218, + 0.35730569809675217, + 0.2020998504012823, + 1.6493604462593794, + 0.18043450638651848, + 0.1662408858537674, + 0.0, + 0.37597544118762016, + 0.13895494863390923, + 0.4994103014469147, + 0.46445532515645027, + 0.514193020761013, + 1.223766952753067, + 0.4983414225280285, + 0.23070322163403034, + 0.28824565559625626, + 0.11542438715696335, + 0.037942104041576385, + 0.9263608548790216, + 1.6340044178068638, + 0.6543875634670258, + 0.3359790276736021, + 0.4964821878820658, + 0.6108600776642561, + 0.7245284263044596, + 0.233419144526124, + 0.2978431098163128, + 0.4913683608174324, + 2.8751335609704256, + 0.25385819002985954, + 0.3466881215572357, + 1.1336937304586172, + 0.47472409904003143, + 1.4793219584971666, + 0.4692678861320019, + 1.3368175886571407, + 0.18279759213328362, + 0.04082681983709335, + 0.8615530580282211, + 0.14407333731651306, + 0.36130508966743946, + 0.5420008208602667 + ], + "unique_experts": 63, + "load_cv": 0.6818638218918337, + "normalized_load_entropy": 0.9460436496124728, + "max_load_share": 0.05138888888888889 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "1be13380d66f226c246301c4abfd48b6ae006f76eaae16ee4b4e37506682082b", + "route_weight_sha256": "d9ed937bd0763b5ba667a4241ff0d4770f0cd07635be24cd51ba2d5238d7e17d", + "loads": [ + 10, + 6, + 20, + 11, + 24, + 22, + 20, + 14, + 11, + 4, + 24, + 16, + 26, + 6, + 16, + 14, + 6, + 3, + 18, + 15, + 9, + 10, + 20, + 8, + 3, + 35, + 8, + 2, + 0, + 12, + 6, + 16, + 8, + 11, + 27, + 11, + 8, + 9, + 5, + 1, + 25, + 40, + 10, + 8, + 17, + 14, + 15, + 8, + 9, + 15, + 35, + 7, + 10, + 32, + 10, + 17, + 9, + 30, + 6, + 1, + 23, + 7, + 11, + 16 + ], + "weighted_loads": [ + 0.41493006609380245, + 0.20224016346037388, + 1.2582187689840794, + 0.7092881500720978, + 1.119471449404955, + 1.1138902511447668, + 2.5008541215211153, + 0.7459454443305731, + 0.9155207481235266, + 0.36177318543195724, + 1.3496067691594362, + 3.3943585827946663, + 2.190246259793639, + 0.36237344332039356, + 0.6499714124947786, + 0.6757823638617992, + 0.34415311738848686, + 0.4044712632894516, + 1.3368922006338835, + 1.2570653483271599, + 0.31059117056429386, + 0.5187487229704857, + 1.0818578451871872, + 0.35730569809675217, + 0.2020998504012823, + 2.1748322639614344, + 0.27509608678519726, + 0.1662408858537674, + 0.0, + 0.4402799289673567, + 0.2642682623118162, + 0.5096907755360007, + 0.46445532515645027, + 0.5372482612729073, + 1.265687469393015, + 0.4983414225280285, + 0.2777989823371172, + 0.34751447662711143, + 0.4801841601729393, + 0.037942104041576385, + 1.084584429860115, + 1.720430531539023, + 0.8386463075876236, + 0.4528563413769007, + 0.766244787722826, + 0.6108600776642561, + 0.8587111923843622, + 0.2864995691925287, + 0.2978431098163128, + 0.4913683608174324, + 3.933469796553254, + 0.25385819002985954, + 0.3826495260000229, + 1.4130736514925957, + 0.47472409904003143, + 1.8715386521071196, + 0.4692678861320019, + 1.4579396098852158, + 0.22162418067455292, + 0.04082681983709335, + 2.1179567519575357, + 0.3523890748620033, + 0.36130508966743946, + 0.5420008208602667 + ], + "unique_experts": 63, + "load_cv": 0.6522540366397552, + "normalized_load_entropy": 0.9495875290023725, + "max_load_share": 0.04597701149425287 + } + }, + "s1_bos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "c8f9a9143a58f32fc2bc3c9265dd5fbbd6e1df80091ad9ced904c78d99e29bd0", + "route_weight_sha256": "3c62738320dc2ac8dfd66846762a6e5c125a6dd0c02d8fc856a0981b8a00611c", + "loads": [ + 13, + 5, + 18, + 3, + 16, + 11, + 15, + 9, + 11, + 3, + 27, + 17, + 22, + 7, + 12, + 3, + 6, + 3, + 6, + 14, + 3, + 11, + 11, + 9, + 5, + 29, + 6, + 2, + 0, + 11, + 5, + 15, + 8, + 12, + 25, + 11, + 6, + 7, + 7, + 3, + 22, + 33, + 8, + 9, + 8, + 12, + 16, + 7, + 7, + 13, + 27, + 10, + 9, + 28, + 10, + 13, + 9, + 28, + 2, + 1, + 13, + 2, + 14, + 12 + ], + "weighted_loads": [ + 0.5040916278958321, + 0.1846315022557974, + 1.1747764144092798, + 0.10370169393718243, + 0.7439189776778221, + 0.6510224286466837, + 2.3090600222349167, + 0.38256020843982697, + 0.865160271525383, + 0.33725705184042454, + 1.4856612719595432, + 2.918345808982849, + 1.9918214231729507, + 0.4173074457794428, + 0.4824991039931774, + 0.12384066730737686, + 0.3245600424706936, + 0.41511674225330353, + 0.40881169959902763, + 1.1851344220340252, + 0.09589962661266327, + 0.548362048342824, + 0.571476899087429, + 0.3666001781821251, + 0.26088525354862213, + 1.6366792526096106, + 0.2088268045336008, + 0.16039109602570534, + 0.0, + 0.41995276510715485, + 0.22473419830203056, + 0.5022739227861166, + 0.45703476667404175, + 0.5491917617619038, + 1.2151088155806065, + 0.4808639604598284, + 0.2119091972708702, + 0.28939603455364704, + 0.20952299796044827, + 0.09998692199587822, + 0.9298577699810266, + 1.5469426400959492, + 0.6587648317217827, + 0.4214260447770357, + 0.4340690840035677, + 0.5331932045519352, + 0.8391885720193386, + 0.2512423451989889, + 0.23984594270586967, + 0.4381622038781643, + 2.9348392989486456, + 0.3490654546767473, + 0.3362177312374115, + 1.1678466200828552, + 0.46372062154114246, + 1.3197710625827312, + 0.4877821411937475, + 1.287807585671544, + 0.07406581193208694, + 0.04107526317238808, + 0.9353303834795952, + 0.09236117824912071, + 0.5110939219594002, + 0.43636309914290905 + ], + "unique_experts": 63, + "load_cv": 0.6778688463408731, + "normalized_load_entropy": 0.9464302999847242, + "max_load_share": 0.04583333333333333 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "771cd748b2f7cd3c4513e2e12ec750692f569f8c7c544178168b5ad8bfd70c68", + "route_weight_sha256": "def9e75709d7a5f6ee15cbc57b62b4c998f564951b71470ac8f691758ba0223b", + "loads": [ + 17, + 6, + 18, + 14, + 24, + 21, + 17, + 19, + 11, + 5, + 29, + 18, + 24, + 8, + 13, + 18, + 11, + 3, + 16, + 15, + 8, + 12, + 23, + 11, + 6, + 43, + 9, + 4, + 0, + 15, + 5, + 16, + 9, + 12, + 27, + 13, + 9, + 13, + 9, + 8, + 27, + 36, + 10, + 15, + 20, + 13, + 16, + 7, + 7, + 18, + 40, + 10, + 10, + 37, + 11, + 23, + 11, + 35, + 3, + 2, + 25, + 4, + 15, + 12 + ], + "weighted_loads": [ + 0.700076250359416, + 0.20873874239623547, + 1.1747764144092798, + 0.8564829807728529, + 1.1570365205407143, + 1.0922869145870209, + 2.3769147731363773, + 0.9962148163467646, + 0.865160271525383, + 0.5691728312522173, + 1.576177641749382, + 2.9594767540693283, + 2.0566234551370144, + 0.7004098389297724, + 0.5423948541283607, + 1.0609233491122723, + 0.6352732516825199, + 0.41511674225330353, + 1.3869573287665844, + 1.218240812420845, + 0.2834402322769165, + 0.5834270920604467, + 1.2663576751947403, + 0.5396586284041405, + 0.2809293922036886, + 2.520627373829484, + 0.31315811537206173, + 0.21965519152581692, + 0.0, + 0.5177160054445267, + 0.22473419830203056, + 0.5330388341099024, + 0.5061154812574387, + 0.5491917617619038, + 1.2905244547873735, + 0.6603777501732111, + 0.3164157662540674, + 0.5212124437093735, + 0.6196557264775038, + 0.3568265028297901, + 1.1872012354433537, + 1.6820459961891174, + 0.8309688344597816, + 0.7429894749075174, + 1.187417333945632, + 0.6057832725346088, + 0.8391885720193386, + 0.2512423451989889, + 0.23984594270586967, + 0.7641056999564171, + 4.615253111347556, + 0.3490654546767473, + 0.3681325241923332, + 1.5696889963001013, + 0.4909248314797878, + 2.294963002204895, + 0.5696301031857729, + 1.820372112095356, + 0.11226532608270645, + 0.06905624456703663, + 2.350444847717881, + 0.23877232894301414, + 0.568355854600668, + 0.43636309914290905 + ], + "unique_experts": 63, + "load_cv": 0.6216940048390157, + "normalized_load_entropy": 0.9550289162792464, + "max_load_share": 0.044513457556935816 + } + }, + "s0_x": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "8e1e1ed602cc976588490e8dd6f1a9dde3333eef1c9a19dfde378a00d188a796", + "route_weight_sha256": "c006bb78509bb593a5ecaa28011a07f07b9f50226723e5d0146386963109c12f", + "loads": [ + 13, + 5, + 18, + 2, + 16, + 17, + 15, + 10, + 10, + 4, + 25, + 15, + 22, + 5, + 14, + 6, + 7, + 3, + 9, + 18, + 4, + 9, + 11, + 9, + 2, + 27, + 7, + 4, + 0, + 12, + 3, + 15, + 8, + 8, + 24, + 13, + 6, + 6, + 5, + 2, + 23, + 37, + 8, + 7, + 9, + 17, + 13, + 7, + 7, + 12, + 28, + 7, + 8, + 28, + 9, + 13, + 8, + 26, + 3, + 1, + 12, + 2, + 9, + 17 + ], + "weighted_loads": [ + 0.5228501446545124, + 0.177730031311512, + 1.202728908509016, + 0.07064508274197578, + 0.7343056350946426, + 0.8967696707695723, + 2.3535959273576736, + 0.4420957062393427, + 0.9598127938807011, + 0.3713616393506527, + 1.366851296275854, + 2.5363208167254925, + 2.0691595394164324, + 0.3357737883925438, + 0.5709949769079685, + 0.2330395020544529, + 0.41972020268440247, + 0.39726585894823074, + 0.47652761451900005, + 1.3629751075059175, + 0.12636173143982887, + 0.4955071955919266, + 0.553415959700942, + 0.3699935358017683, + 0.1858418956398964, + 1.5902567524462938, + 0.24964448809623718, + 0.23485404253005981, + 0.0, + 0.4830729756504297, + 0.12609325721859932, + 0.4955382961779833, + 0.47432356141507626, + 0.43144452199339867, + 1.1517593543976545, + 0.5699782446026802, + 0.23348559997975826, + 0.2774560432881117, + 0.1567699797451496, + 0.06850224547088146, + 0.9585661590099335, + 1.6501759327948093, + 0.6760934852063656, + 0.38019704073667526, + 0.5144089478999376, + 0.7170689571648836, + 0.7131972014904022, + 0.2603673581033945, + 0.2415558621287346, + 0.39280399680137634, + 3.129214545711875, + 0.2606004308909178, + 0.29929641634225845, + 1.1818765997886658, + 0.4465644285082817, + 1.4632295109331608, + 0.4063337314873934, + 1.3056854344904423, + 0.1113680973649025, + 0.04163770005106926, + 0.853756207972765, + 0.09211254492402077, + 0.31029765866696835, + 0.597036449238658 + ], + "unique_experts": 63, + "load_cv": 0.6940665638551741, + "normalized_load_entropy": 0.9441948419251752, + "max_load_share": 0.05138888888888889 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "bf421cde5207fa0a2e65f8a86b4a42d2a821010b3e4fa436a6b8c4e0c48f7961", + "route_weight_sha256": "67748534497dc04ce87be6dc1a54abb1bd2e9a339438bfb55c623a1d73beb134", + "loads": [ + 13, + 7, + 18, + 10, + 25, + 20, + 21, + 15, + 10, + 4, + 25, + 15, + 26, + 6, + 15, + 12, + 7, + 3, + 20, + 18, + 8, + 9, + 18, + 9, + 2, + 36, + 8, + 4, + 0, + 17, + 5, + 15, + 8, + 9, + 25, + 13, + 9, + 8, + 6, + 3, + 26, + 39, + 10, + 8, + 17, + 17, + 13, + 7, + 7, + 13, + 36, + 7, + 8, + 34, + 9, + 17, + 9, + 31, + 4, + 1, + 24, + 5, + 9, + 17 + ], + "weighted_loads": [ + 0.5228501446545124, + 0.2398996241390705, + 1.202728908509016, + 0.6748672388494015, + 1.2483852319419384, + 1.0002947002649307, + 2.542443310841918, + 0.7400208041071892, + 0.9598127938807011, + 0.3713616393506527, + 1.366851296275854, + 2.5363208167254925, + 2.2383644338697195, + 0.363006891682744, + 0.6086738519370556, + 0.5606452524662018, + 0.41972020268440247, + 0.39726585894823074, + 1.4674496706575155, + 1.3629751075059175, + 0.2809971757233143, + 0.4955071955919266, + 0.9498285185545683, + 0.3699935358017683, + 0.1858418956398964, + 2.130481457337737, + 0.2670859023928642, + 0.23485404253005981, + 0.0, + 0.6402848958969116, + 0.204441724345088, + 0.4955382961779833, + 0.47432356141507626, + 0.4544997625052929, + 1.1891279313713312, + 0.5699782446026802, + 0.3141834530979395, + 0.33672486431896687, + 0.5215297527611256, + 0.10687859170138836, + 1.0943483337759972, + 1.7252508886158466, + 0.860552329570055, + 0.41704021766781807, + 0.7988041415810585, + 0.7170689571648836, + 0.7131972014904022, + 0.2603673581033945, + 0.2415558621287346, + 0.43094929680228233, + 4.180462429299951, + 0.2606004308909178, + 0.29929641634225845, + 1.4752623792737722, + 0.4465644285082817, + 1.8938497267663479, + 0.4467639308422804, + 1.4810536280274391, + 0.1501946859061718, + 0.04163770005106926, + 2.294257028028369, + 0.30072973296046257, + 0.31029765866696835, + 0.597036449238658 + ], + "unique_experts": 63, + "load_cv": 0.6677557493461064, + "normalized_load_entropy": 0.9480492178093486, + "max_load_share": 0.04482758620689655 + } + }, + "s1_x": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "d7d0cedc99af3e588e143bf1144be885407dcea9b0157ee7f3f007667d7af27e", + "route_weight_sha256": "7b59c9bb6d7bf5158e7a6a9003770c591327c7529bd04fd1e56e4bb74a696b97", + "loads": [ + 11, + 2, + 17, + 3, + 20, + 16, + 15, + 7, + 10, + 3, + 27, + 18, + 22, + 6, + 11, + 5, + 6, + 3, + 8, + 16, + 2, + 10, + 12, + 7, + 2, + 29, + 6, + 3, + 0, + 9, + 6, + 15, + 8, + 6, + 22, + 10, + 3, + 7, + 7, + 3, + 24, + 32, + 8, + 6, + 11, + 12, + 18, + 6, + 7, + 15, + 33, + 13, + 7, + 27, + 9, + 14, + 9, + 26, + 3, + 1, + 13, + 3, + 14, + 16 + ], + "weighted_loads": [ + 0.4069037511944771, + 0.08755986392498016, + 1.0713652651757002, + 0.1007528118789196, + 0.9505688790231943, + 0.8482468742877245, + 2.3197511062026024, + 0.2919486090540886, + 0.8366556614637375, + 0.3180769048631191, + 1.461203282698989, + 2.8756957314908504, + 1.9677161909639835, + 0.4653718899935484, + 0.4537504781037569, + 0.26039091497659683, + 0.3070011232048273, + 0.4243900030851364, + 0.46758807823061943, + 1.1729802209883928, + 0.07904079183936119, + 0.5209642164409161, + 0.6252177637070417, + 0.30418921262025833, + 0.16748913004994392, + 1.4892762079834938, + 0.19369461946189404, + 0.19067686796188354, + 0.0, + 0.35932725481688976, + 0.2688848413527012, + 0.5019136033952236, + 0.4542166441679001, + 0.31741636991500854, + 1.0524711888283491, + 0.43286669068038464, + 0.12409369833767414, + 0.27973315864801407, + 0.20614667236804962, + 0.09902060404419899, + 1.0229221563786268, + 1.465420937165618, + 0.6387497801333666, + 0.33053182251751423, + 0.5057802610099316, + 0.5202728919684887, + 0.9128408581018448, + 0.20900113321840763, + 0.23842975869774818, + 0.48128332011401653, + 3.1301458943635225, + 0.448008781298995, + 0.24923967011272907, + 1.1168099883943796, + 0.4142875261604786, + 1.3044072799384594, + 0.4841781109571457, + 1.208628211170435, + 0.09816979803144932, + 0.04319583997130394, + 0.9159249309450388, + 0.12317807972431183, + 0.4973444379866123, + 0.5876388847827911 + ], + "unique_experts": 63, + "load_cv": 0.7100686803853536, + "normalized_load_entropy": 0.9410453505613535, + "max_load_share": 0.04583333333333333 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "1f017ac03bf3595282d7d2b7251801606b157ad219ca8e5c265ed50577cf1c7a", + "route_weight_sha256": "e914176ba43c973fbfb2f5c060b98c6c45c55beedc6b5ce417fb2675078dfee5", + "loads": [ + 15, + 3, + 17, + 15, + 30, + 27, + 18, + 17, + 10, + 5, + 29, + 18, + 25, + 7, + 12, + 19, + 12, + 3, + 20, + 17, + 6, + 11, + 23, + 9, + 3, + 43, + 7, + 6, + 0, + 13, + 6, + 17, + 9, + 6, + 24, + 12, + 6, + 13, + 9, + 7, + 28, + 34, + 10, + 10, + 24, + 13, + 18, + 6, + 7, + 19, + 46, + 13, + 7, + 35, + 10, + 24, + 11, + 34, + 4, + 2, + 26, + 5, + 15, + 16 + ], + "weighted_loads": [ + 0.602888373658061, + 0.11166710406541824, + 1.0713652651757002, + 0.8856314308941364, + 1.5150145757943392, + 1.2980575077235699, + 2.4252586886286736, + 0.873408729210496, + 0.8366556614637375, + 0.5499926842749119, + 1.5517196524888277, + 2.8756957314908504, + 2.0824548304080963, + 0.748474283143878, + 0.5136462282389402, + 1.1306893602013588, + 0.7527626026421785, + 0.4243900030851364, + 1.5876492224633694, + 1.2060866113752127, + 0.2355194240808487, + 0.5560292601585388, + 1.2678546290844679, + 0.4772476628422737, + 0.18753326870501041, + 2.350057192146778, + 0.21113603375852108, + 0.2835442926734686, + 0.0, + 0.4644694998860359, + 0.2688848413527012, + 0.5640850514173508, + 0.503297358751297, + 0.31741636991500854, + 1.1139945425093174, + 0.6123804803937674, + 0.22860026732087135, + 0.5069960821419954, + 0.6162794008851051, + 0.29681527614593506, + 1.2340588737279177, + 1.553291605785489, + 0.7948642615228891, + 0.5181173551827669, + 1.3051145747303963, + 0.5928629599511623, + 0.9128408581018448, + 0.20900113321840763, + 0.23842975869774818, + 0.7193304989486933, + 4.750694939866662, + 0.448008781298995, + 0.24923967011272907, + 1.4740842655301094, + 0.44149173609912395, + 2.2707031667232513, + 0.5678261481225491, + 1.7901874128729105, + 0.13636931218206882, + 0.07117682136595249, + 2.4233386926352978, + 0.24368487298488617, + 0.5546063706278801, + 0.5876388847827911 + ], + "unique_experts": 63, + "load_cv": 0.6659043002837131, + "normalized_load_entropy": 0.9483546073335407, + "max_load_share": 0.047619047619047616 + } + }, + "s0_period": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "274a6b7f035802f09fa9d574c766ed9679861dcc4ef4faf88632cc84d6544371", + "route_weight_sha256": "4cedecdcfc06b81968e06245cfa3d34b8bb12de05a274cff46e81a3f5985beab", + "loads": [ + 12, + 6, + 17, + 2, + 15, + 16, + 15, + 8, + 10, + 5, + 26, + 14, + 22, + 6, + 15, + 6, + 6, + 3, + 8, + 15, + 4, + 9, + 11, + 9, + 2, + 28, + 6, + 3, + 0, + 12, + 4, + 14, + 8, + 9, + 24, + 13, + 6, + 8, + 5, + 1, + 22, + 38, + 8, + 6, + 10, + 17, + 13, + 6, + 7, + 13, + 29, + 10, + 7, + 28, + 10, + 14, + 8, + 25, + 3, + 1, + 12, + 4, + 9, + 17 + ], + "weighted_loads": [ + 0.492515342310071, + 0.20020592212677002, + 1.1778205186128616, + 0.07493297383189201, + 0.7065838221460581, + 0.8407952077686787, + 2.346036970615387, + 0.38049541041255, + 0.893382016569376, + 0.389906520023942, + 1.395437404513359, + 2.4650598652660847, + 2.0464009810239077, + 0.34591154381632805, + 0.5898066125810146, + 0.23304262571036816, + 0.37990089505910873, + 0.38889114558696747, + 0.4493424966931343, + 1.2906250432133675, + 0.12788622453808784, + 0.5011667050421238, + 0.5515107456594706, + 0.368650758638978, + 0.1748848371207714, + 1.6548387669026852, + 0.2244657203555107, + 0.19872085377573967, + 0.0, + 0.48086218535900116, + 0.16279915161430836, + 0.4608247596770525, + 0.4987649545073509, + 0.44766826182603836, + 1.1679630652070045, + 0.5685200039297342, + 0.22618266567587852, + 0.3369482569396496, + 0.1508557815104723, + 0.03836359456181526, + 0.9471106249839067, + 1.7084327675402164, + 0.6666147299110889, + 0.3427661173045635, + 0.5548085290938616, + 0.7113899681717157, + 0.682618660852313, + 0.23841597512364388, + 0.23954109475016594, + 0.41923709213733673, + 3.223313305526972, + 0.35198776982724667, + 0.2572167180478573, + 1.1918054390698671, + 0.47792496904730797, + 1.4920647721737623, + 0.4180404879152775, + 1.2230832297354937, + 0.11501257680356503, + 0.04167582839727402, + 0.8614548277109861, + 0.14936927892267704, + 0.3077149298042059, + 0.5928737912327051 + ], + "unique_experts": 63, + "load_cv": 0.6937107235016874, + "normalized_load_entropy": 0.9449040972795887, + "max_load_share": 0.05277777777777778 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "cffaad3b6a1a136c2150f03860095dd5009f2b7933746ff44d1843cfd2ef9c28", + "route_weight_sha256": "0a0bc82d457b7626f98fc9fdcbe1c3258be1fc665746b79ab627ad6f90478604", + "loads": [ + 12, + 8, + 17, + 10, + 24, + 18, + 21, + 14, + 11, + 5, + 26, + 14, + 27, + 6, + 15, + 12, + 6, + 3, + 18, + 15, + 9, + 9, + 18, + 9, + 2, + 38, + 7, + 3, + 0, + 16, + 6, + 14, + 8, + 10, + 25, + 13, + 8, + 10, + 6, + 2, + 25, + 40, + 10, + 7, + 18, + 17, + 13, + 6, + 7, + 14, + 38, + 10, + 8, + 34, + 10, + 17, + 9, + 29, + 5, + 1, + 23, + 8, + 9, + 17 + ], + "weighted_loads": [ + 0.492515342310071, + 0.2663240097463131, + 1.1778205186128616, + 0.6791551299393177, + 1.1485530976206064, + 0.9151944052428007, + 2.551365112885833, + 0.8381850067526102, + 0.9367481209337711, + 0.389906520023942, + 1.395437404513359, + 2.4650598652660847, + 2.2761874180287123, + 0.34591154381632805, + 0.5898066125810146, + 0.5422426592558622, + 0.37990089505910873, + 0.38889114558696747, + 1.340833380818367, + 1.2906250432133675, + 0.3268227316439152, + 0.5011667050421238, + 0.9332242999225855, + 0.368650758638978, + 0.1748848371207714, + 2.249391321092844, + 0.24190713465213776, + 0.19872085377573967, + 0.0, + 0.6072397958487272, + 0.23969504982233047, + 0.4608247596770525, + 0.4987649545073509, + 0.4707235023379326, + 1.2065406441688538, + 0.5685200039297342, + 0.2732784263789654, + 0.39621707797050476, + 0.5156155545264482, + 0.07677203416824341, + 1.1031684894114733, + 1.7835077233612537, + 0.8461618982255459, + 0.37960929423570633, + 0.8331716954708099, + 0.7113899681717157, + 0.682618660852313, + 0.23841597512364388, + 0.23954109475016594, + 0.4789704382419586, + 4.323434706777334, + 0.35198776982724667, + 0.28664930909872055, + 1.4919615723192692, + 0.47792496904730797, + 1.8871806655079126, + 0.4658919684588909, + 1.3442052509635687, + 0.19110083021223545, + 0.04167582839727402, + 2.1178585216403008, + 0.39254134707152843, + 0.3077149298042059, + 0.5928737912327051 + ], + "unique_experts": 63, + "load_cv": 0.668008953890987, + "normalized_load_entropy": 0.9487850470604715, + "max_load_share": 0.04597701149425287 + } + }, + "s1_period": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "d264f8d4ba011c1c3f8525b253b82e8de298c9af0c76c0825bc27533a4f750e9", + "route_weight_sha256": "b97d3fad3efffeb09c2c8c5a61c06ed697c0a03252650dfc426ba989d7832379", + "loads": [ + 15, + 3, + 17, + 3, + 20, + 12, + 15, + 7, + 11, + 3, + 28, + 17, + 22, + 5, + 11, + 4, + 6, + 3, + 8, + 15, + 1, + 12, + 12, + 7, + 2, + 27, + 6, + 3, + 0, + 8, + 6, + 15, + 9, + 7, + 19, + 11, + 4, + 8, + 4, + 2, + 26, + 33, + 8, + 7, + 13, + 12, + 17, + 7, + 9, + 10, + 36, + 11, + 7, + 28, + 8, + 13, + 10, + 27, + 4, + 1, + 13, + 2, + 14, + 16 + ], + "weighted_loads": [ + 0.548895226791501, + 0.1257336214184761, + 1.1084691733121872, + 0.09479955211281776, + 0.972054636105895, + 0.7109367325901985, + 2.3175376132130623, + 0.2783379387110472, + 0.8865187298506498, + 0.32279644906520844, + 1.4927100911736488, + 2.860351223498583, + 1.9811268616467714, + 0.42812931537628174, + 0.4483827445656061, + 0.23094793781638145, + 0.33994121849536896, + 0.41766197234392166, + 0.45457810163497925, + 1.163409274071455, + 0.04087582603096962, + 0.5593778099864721, + 0.6029803454875946, + 0.3033989779651165, + 0.16742896661162376, + 1.54156144708395, + 0.1995591688901186, + 0.18350210040807724, + 0.0, + 0.31037038564682007, + 0.2553011439740658, + 0.5070368107408285, + 0.5093533899635077, + 0.3927065543830395, + 0.93513398244977, + 0.4664647337049246, + 0.1409210879355669, + 0.3199936356395483, + 0.12656120769679546, + 0.06542064435780048, + 1.0800395365804434, + 1.4710539691150188, + 0.6576777119189501, + 0.369018642231822, + 0.561724441125989, + 0.5275217033922672, + 0.9208398777991533, + 0.24605625309050083, + 0.3084326721727848, + 0.3326650708913803, + 3.3702934496104717, + 0.38699844293296337, + 0.2545985169708729, + 1.1497360039502382, + 0.3864551018923521, + 1.247809987515211, + 0.4928684886544943, + 1.224422212690115, + 0.13173691555857658, + 0.042712725698947906, + 0.9282371662557125, + 0.0896556843072176, + 0.4920907448977232, + 0.5764295216649771 + ], + "unique_experts": 63, + "load_cv": 0.7243558228002942, + "normalized_load_entropy": 0.9393521153287242, + "max_load_share": 0.05 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "358c04129f32defee0e7883788d05bb77debda60ab49280c1a8d761dbdaa06fb", + "route_weight_sha256": "dcd0614a2726f591eead4aa94a27102ca337837e4204a56e0ed9795e4eeead51", + "loads": [ + 19, + 4, + 17, + 14, + 29, + 22, + 18, + 19, + 11, + 5, + 30, + 17, + 27, + 6, + 12, + 17, + 11, + 3, + 18, + 16, + 6, + 13, + 23, + 9, + 3, + 42, + 7, + 5, + 0, + 11, + 6, + 16, + 10, + 7, + 20, + 13, + 7, + 15, + 6, + 7, + 31, + 35, + 10, + 11, + 27, + 13, + 17, + 7, + 9, + 15, + 49, + 11, + 7, + 37, + 9, + 24, + 11, + 34, + 5, + 2, + 26, + 4, + 15, + 16 + ], + "weighted_loads": [ + 0.744879849255085, + 0.14984086155891418, + 1.1084691733121872, + 0.8475808389484882, + 1.4248704705387354, + 1.1017453502863646, + 2.426011174917221, + 0.9511415492743254, + 0.8865187298506498, + 0.5547122284770012, + 1.5832264609634876, + 2.860351223498583, + 2.1931943017989397, + 0.7112317085266113, + 0.5082784947007895, + 1.0653852112591267, + 0.6506544277071953, + 0.41766197234392166, + 1.432723730802536, + 1.1965156644582748, + 0.2252512164413929, + 0.5944428537040949, + 1.2374674640595913, + 0.4764574281871319, + 0.18747310526669025, + 2.466302312910557, + 0.21700058318674564, + 0.24276619590818882, + 0.0, + 0.38414362259209156, + 0.2553011439740658, + 0.5378017220646143, + 0.5584341045469046, + 0.3927065543830395, + 0.9634574297815561, + 0.6459785234183073, + 0.24542765691876411, + 0.5960966385900974, + 0.536693936213851, + 0.2937102112919092, + 1.3248218093067408, + 1.5611970610916615, + 0.81109937466681, + 0.5566041748970747, + 1.3979537431150675, + 0.6001117713749409, + 0.9208398777991533, + 0.24605625309050083, + 0.3084326721727848, + 0.6384378187358379, + 5.014854114502668, + 0.38699844293296337, + 0.2545985169708729, + 1.5456243455410004, + 0.41365931183099747, + 2.255955919623375, + 0.5373153705149889, + 1.7569867391139269, + 0.1699364297091961, + 0.07069370709359646, + 2.381387570872903, + 0.20544707961380482, + 0.549352677538991, + 0.5764295216649771 + ], + "unique_experts": 63, + "load_cv": 0.6784543567570008, + "normalized_load_entropy": 0.947558793310568, + "max_load_share": 0.050724637681159424 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 120, + "ordered_topk_exact_tokens": 41, + "set_exact_tokens": 65, + "mean_set_jaccard": 0.8466269841269842, + "mean_token_weighted_tv": 0.03002014202841868, + "aggregate_load_tv": 0.05277777777777777 + }, + "system_bos": { + "tokens": 120, + "ordered_topk_exact_tokens": 40, + "set_exact_tokens": 54, + "mean_set_jaccard": 0.8218253968253968, + "mean_token_weighted_tv": 0.03464467157609761, + "aggregate_load_tv": 0.05972222222222223 + }, + "system_x": { + "tokens": 120, + "ordered_topk_exact_tokens": 31, + "set_exact_tokens": 49, + "mean_set_jaccard": 0.7936507936507938, + "mean_token_weighted_tv": 0.04560582474029313, + "aggregate_load_tv": 0.07361111111111111 + }, + "system_period": { + "tokens": 120, + "ordered_topk_exact_tokens": 30, + "set_exact_tokens": 44, + "mean_set_jaccard": 0.7777777777777778, + "mean_token_weighted_tv": 0.04609592334988217, + "aggregate_load_tv": 0.08055555555555555 + }, + "bos_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 36, + "set_exact_tokens": 56, + "mean_set_jaccard": 0.8192460317460318, + "mean_token_weighted_tv": 0.03639711029051493, + "aggregate_load_tv": 0.05694444444444446 + }, + "bos_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 41, + "set_exact_tokens": 59, + "mean_set_jaccard": 0.8301587301587303, + "mean_token_weighted_tv": 0.03550404072739184, + "aggregate_load_tv": 0.059722222222222225 + }, + "x_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 26, + "set_exact_tokens": 48, + "mean_set_jaccard": 0.7940476190476191, + "mean_token_weighted_tv": 0.04081969809873651, + "aggregate_load_tv": 0.059722222222222225 + }, + "x_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 24, + "set_exact_tokens": 44, + "mean_set_jaccard": 0.7742063492063492, + "mean_token_weighted_tv": 0.04520342031028122, + "aggregate_load_tv": 0.06805555555555555 + }, + "period_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 31, + "set_exact_tokens": 51, + "mean_set_jaccard": 0.7989682539682541, + "mean_token_weighted_tv": 0.04045701326491932, + "aggregate_load_tv": 0.06111111111111111 + }, + "period_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 25, + "set_exact_tokens": 46, + "mean_set_jaccard": 0.7694444444444445, + "mean_token_weighted_tv": 0.046623120356040694, + "aggregate_load_tv": 0.07638888888888888 + } + } + }, + "layer_21": { + "layer": 21, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "f7ef223ba5336cb92010d33e4bf9a6cb5e705777190ef47e26a78a342e294446", + "route_weight_sha256": "19ab25251258fa85c3ea0a8ea4d07980fc192436e9374532805198d49a3d75ea", + "loads": [ + 3, + 14, + 0, + 22, + 6, + 9, + 6, + 12, + 16, + 2, + 15, + 3, + 23, + 4, + 1, + 10, + 1, + 7, + 20, + 7, + 2, + 5, + 3, + 4, + 2, + 27, + 13, + 15, + 7, + 8, + 24, + 19, + 1, + 27, + 6, + 7, + 3, + 2, + 18, + 17, + 32, + 15, + 13, + 13, + 15, + 25, + 11, + 24, + 19, + 5, + 1, + 18, + 4, + 36, + 4, + 21, + 17, + 9, + 7, + 13, + 13, + 13, + 0, + 1 + ], + "weighted_loads": [ + 0.10174499824643135, + 0.5476890075951815, + 0.0, + 1.3364300951361656, + 0.18846751935780048, + 0.37659244425594807, + 0.22616206668317318, + 0.6935665346682072, + 0.6752655562013388, + 0.18359652906656265, + 0.766429241746664, + 0.10521675646305084, + 1.1643419098109007, + 0.18065265379846096, + 0.0423872247338295, + 0.3789893537759781, + 0.03029298037290573, + 0.25736639834940434, + 0.8316571284085512, + 0.23682641051709652, + 0.08206377178430557, + 0.25327272340655327, + 0.16641545668244362, + 0.41406240314245224, + 0.06718572229146957, + 2.052550109103322, + 0.7616236060857773, + 1.155970387160778, + 0.3506178557872772, + 0.5503216348588467, + 0.971830204129219, + 0.7223710492253304, + 0.05197259783744812, + 1.3034878764301538, + 0.22793905809521675, + 0.4160815328359604, + 0.12454204261302948, + 0.07604978606104851, + 1.5258368402719498, + 0.6532960403710604, + 1.2165255546569824, + 0.87019326351583, + 0.8685852233320475, + 1.0746501833200455, + 1.3300197944045067, + 0.9992226772010326, + 0.5858000926673412, + 1.1239287983626127, + 0.9464337378740311, + 0.20994333922863007, + 0.02973846159875393, + 1.0876337923109531, + 0.14087260514497757, + 1.936373582109809, + 0.13276096992194653, + 1.2719596959650517, + 1.009375547990203, + 0.47962211817502975, + 0.26639679819345474, + 0.6000805795192719, + 0.6320020295679569, + 0.5455432385206223, + 0.0, + 0.053121618926525116 + ], + "unique_experts": 62, + "load_cv": 0.7648125728601343, + "normalized_load_entropy": 0.9261601757355467, + "max_load_share": 0.05 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "235d896c9194661f8c71f11401be86b82193f908a118a8c83998625ef0156d24", + "route_weight_sha256": "049a62e427b40cf1c8030e06de692c88be684bd62d229b7c13b0158ff22890dc", + "loads": [ + 3, + 14, + 3, + 22, + 13, + 9, + 9, + 12, + 18, + 2, + 22, + 4, + 26, + 9, + 5, + 16, + 2, + 11, + 20, + 13, + 2, + 13, + 3, + 5, + 2, + 28, + 21, + 20, + 10, + 8, + 25, + 19, + 2, + 28, + 7, + 17, + 3, + 2, + 18, + 18, + 34, + 16, + 16, + 13, + 15, + 25, + 11, + 24, + 30, + 7, + 1, + 25, + 13, + 38, + 10, + 22, + 18, + 9, + 11, + 15, + 13, + 13, + 6, + 1 + ], + "weighted_loads": [ + 0.10174499824643135, + 0.5476890075951815, + 0.0729636789765209, + 1.3364300951361656, + 0.44979349710047245, + 0.37659244425594807, + 0.5192377772182226, + 0.6935665346682072, + 0.8102553468197584, + 0.18359652906656265, + 1.1407430060207844, + 0.15320613980293274, + 1.3032498564571142, + 0.4873016644269228, + 0.18895642459392548, + 0.5815605064854026, + 0.043555392883718014, + 0.3811024157330394, + 0.8316571284085512, + 1.8668316658586264, + 0.08206377178430557, + 0.719374546315521, + 0.16641545668244362, + 0.458419818431139, + 0.06718572229146957, + 2.0886182989925146, + 1.1412202529609203, + 1.5986560806632042, + 0.41406654892489314, + 0.5503216348588467, + 1.0065360851585865, + 0.7223710492253304, + 0.07480553351342678, + 1.3405857142060995, + 0.27820924669504166, + 0.9983044266700745, + 0.12454204261302948, + 0.07604978606104851, + 1.5258368402719498, + 0.6885799039155245, + 1.3130663745105267, + 0.9054009672254324, + 1.0573994535952806, + 1.0746501833200455, + 1.3300197944045067, + 0.9992226772010326, + 0.5858000926673412, + 1.1239287983626127, + 1.5271292626857758, + 0.3910697475075722, + 0.02973846159875393, + 1.4041459113359451, + 0.7238209508359432, + 1.9868291774764657, + 0.3764081858098507, + 1.4399703778326511, + 1.0500859748572111, + 0.47962211817502975, + 0.41618933714926243, + 0.6645790785551071, + 0.6320020295679569, + 0.5455432385206223, + 0.2899050638079643, + 0.053121618926525116 + ], + "unique_experts": 64, + "load_cv": 0.6477008944506837, + "normalized_load_entropy": 0.9460108548592167, + "max_load_share": 0.04367816091954023 + } + }, + "s1_eos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "b76fdcc392777efa88952d8041150fa80afeaa7fbf7d7048ffb6d0ca2fbdd30e", + "route_weight_sha256": "37bd654bda6a13478006d8d9aa812cd5e8ffb6cf05ddefefa3ea841c075bda32", + "loads": [ + 3, + 16, + 0, + 26, + 2, + 8, + 6, + 11, + 18, + 2, + 14, + 6, + 21, + 4, + 2, + 10, + 0, + 7, + 17, + 6, + 2, + 4, + 3, + 5, + 2, + 28, + 13, + 15, + 6, + 8, + 31, + 18, + 1, + 27, + 5, + 7, + 5, + 2, + 19, + 13, + 30, + 15, + 14, + 13, + 15, + 24, + 13, + 21, + 18, + 6, + 2, + 16, + 4, + 33, + 5, + 20, + 18, + 9, + 10, + 12, + 13, + 14, + 1, + 1 + ], + "weighted_loads": [ + 0.11109086498618126, + 0.6382325161248446, + 0.0, + 1.6454161573201418, + 0.056371914222836494, + 0.3498455844819546, + 0.22934378869831562, + 0.6843014992773533, + 0.7443054430186749, + 0.1737084649503231, + 0.6916607618331909, + 0.21940771117806435, + 1.1051478385925293, + 0.18604993261396885, + 0.07267644256353378, + 0.3742589261382818, + 0.0, + 0.26671858318150043, + 0.7317698914557695, + 0.19768905267119408, + 0.07665899768471718, + 0.21242660284042358, + 0.1694016121327877, + 0.40918242931365967, + 0.06912657618522644, + 1.97476907633245, + 0.7067090310156345, + 1.1786539014428854, + 0.31345059908926487, + 0.5163614843040705, + 1.1722018960863352, + 0.6572689153254032, + 0.04815308004617691, + 1.2552811913192272, + 0.19028080441057682, + 0.419744037091732, + 0.21619966998696327, + 0.07536076754331589, + 1.5335049405694008, + 0.4973535034805536, + 1.1950150206685066, + 0.8387604150921106, + 0.8936788849532604, + 1.0811639614403248, + 1.289587527513504, + 0.9685333408415318, + 0.6560249347239733, + 0.9632839523255825, + 0.8522913716733456, + 0.2523831017315388, + 0.061191679909825325, + 0.9814084619283676, + 0.13946125097572803, + 1.891877317801118, + 0.176306314766407, + 1.1480909883975983, + 1.0278087984770536, + 0.4625956788659096, + 0.36937449127435684, + 0.643733024597168, + 0.6369665004312992, + 0.5901046078652143, + 0.03270136937499046, + 0.051181480288505554 + ], + "unique_experts": 62, + "load_cv": 0.7545745265044287, + "normalized_load_entropy": 0.9285201553896804, + "max_load_share": 0.04583333333333333 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "fc0218cec9eb34efd7ffe382922b55174008f379c02f91b15809158174b2d596", + "route_weight_sha256": "1f227c2a3926114e47140d4d63764ee7bc239a81aa34ec02e116240e9e2f4bca", + "loads": [ + 11, + 17, + 3, + 26, + 2, + 9, + 12, + 12, + 21, + 4, + 24, + 7, + 26, + 14, + 10, + 14, + 1, + 16, + 19, + 11, + 3, + 13, + 5, + 10, + 3, + 30, + 21, + 25, + 9, + 9, + 37, + 18, + 2, + 31, + 5, + 22, + 6, + 3, + 20, + 15, + 33, + 17, + 22, + 14, + 16, + 25, + 13, + 21, + 29, + 9, + 3, + 26, + 14, + 35, + 17, + 29, + 22, + 9, + 13, + 15, + 14, + 15, + 7, + 2 + ], + "weighted_loads": [ + 0.6230109501630068, + 0.6857491377741098, + 0.6937812629621476, + 1.6454161573201418, + 0.056371914222836494, + 0.3654113467782736, + 0.49603777192533016, + 0.7660838253796101, + 0.8830241225659847, + 0.3220457583665848, + 1.191244650632143, + 0.2599537931382656, + 1.3553858175873756, + 0.7186072915792465, + 0.38444204814732075, + 0.5054624108597636, + 0.013262412510812283, + 0.5784724745899439, + 0.7868657223880291, + 1.764572847634554, + 0.12364298105239868, + 0.7092356095090508, + 0.22743930108845234, + 0.8960074000060558, + 0.10466313362121582, + 2.0460585709661245, + 0.9926245883107185, + 2.0943330470472574, + 0.34902938129380345, + 0.5651727225631475, + 1.4061536826193333, + 0.6572689153254032, + 0.07078684493899345, + 1.8490522913634777, + 0.19028080441057682, + 1.2728167101740837, + 0.2870911620557308, + 0.11605732515454292, + 1.5888602994382381, + 0.5797598417848349, + 1.307890560477972, + 0.9642723370343447, + 1.303730197250843, + 1.1236490495502949, + 1.348968181759119, + 1.028137180954218, + 0.6560249347239733, + 0.9632839523255825, + 1.6874951533973217, + 1.1647454723715782, + 0.1147730853408575, + 1.6898607797920704, + 0.7452138308435678, + 1.9372928338125348, + 0.893412908539176, + 1.7687896359711885, + 1.1871217992156744, + 0.4625956788659096, + 0.5129304938018322, + 0.8040764257311821, + 0.659387955442071, + 0.6526142116636038, + 0.29888003692030907, + 0.14150310307741165 + ], + "unique_experts": 64, + "load_cv": 0.6025342732684669, + "normalized_load_entropy": 0.953277544134185, + "max_load_share": 0.038302277432712216 + } + }, + "s0_bos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "853445e0dddac243487a51ea93c598f9b9b48a843339e2998cfc21dfc60c8d10", + "route_weight_sha256": "79258d12e0c27bbb94e74af04c5385de044511e8058fe9c3c38c10c01e81b99f", + "loads": [ + 2, + 15, + 0, + 25, + 4, + 8, + 7, + 13, + 22, + 2, + 14, + 7, + 21, + 5, + 2, + 8, + 0, + 6, + 19, + 6, + 3, + 7, + 3, + 3, + 2, + 25, + 15, + 15, + 8, + 8, + 28, + 24, + 1, + 27, + 3, + 7, + 2, + 1, + 19, + 18, + 32, + 15, + 13, + 13, + 15, + 22, + 10, + 24, + 16, + 4, + 2, + 17, + 4, + 29, + 4, + 19, + 16, + 9, + 7, + 11, + 13, + 18, + 1, + 1 + ], + "weighted_loads": [ + 0.07064146548509598, + 0.6189215444028378, + 0.0, + 1.5561408065259457, + 0.11772917956113815, + 0.3493598513305187, + 0.2878192849457264, + 0.7923496291041374, + 0.8815416414290667, + 0.196756973862648, + 0.7152026109397411, + 0.24511045962572098, + 1.1702591180801392, + 0.2073741853237152, + 0.07629968598484993, + 0.309963446110487, + 0.0, + 0.20976563729345798, + 0.7998522948473692, + 0.19991964101791382, + 0.11739926971495152, + 0.3169249966740608, + 0.1767653226852417, + 0.39076773822307587, + 0.07172239944338799, + 1.9096021205186844, + 0.8703485429286957, + 1.0989168249070644, + 0.37622053548693657, + 0.5534833669662476, + 1.1343953423202038, + 0.9037198685109615, + 0.05388488620519638, + 1.3187028709799051, + 0.11704137548804283, + 0.4160868525505066, + 0.11343783885240555, + 0.03616590052843094, + 1.5568990856409073, + 0.6825699508190155, + 1.2006828058511019, + 0.8819237425923347, + 0.8528887201100588, + 1.1666635796427727, + 1.4010716564953327, + 0.8798175640404224, + 0.5287048369646072, + 1.129464726895094, + 0.7596568241715431, + 0.1794588789343834, + 0.061356453225016594, + 1.033847365528345, + 0.1557229347527027, + 1.560909440740943, + 0.1480526365339756, + 1.1919281892478466, + 0.94461321644485, + 0.5372777432203293, + 0.2575059328228235, + 0.5482280403375626, + 0.6237962581217289, + 0.8037171214818954, + 0.03273938596248627, + 0.05161215364933014 + ], + "unique_experts": 62, + "load_cv": 0.7573508083534211, + "normalized_load_entropy": 0.9262391276453754, + "max_load_share": 0.044444444444444446 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "c964bbd3a707c0d79c1b5995e8a93e5aa50b1a97d5a9dac793482814d35a7bc2", + "route_weight_sha256": "31c7587b377389f3fd07eb59f10a995c8dabc413bc71745ce2ed9684336e247b", + "loads": [ + 2, + 16, + 2, + 26, + 9, + 8, + 9, + 13, + 25, + 2, + 20, + 8, + 23, + 10, + 6, + 13, + 1, + 9, + 20, + 9, + 3, + 15, + 3, + 4, + 2, + 26, + 23, + 20, + 10, + 8, + 29, + 27, + 2, + 27, + 4, + 17, + 2, + 1, + 19, + 22, + 38, + 16, + 16, + 13, + 15, + 24, + 10, + 24, + 27, + 7, + 2, + 24, + 13, + 30, + 8, + 20, + 17, + 9, + 10, + 13, + 13, + 18, + 7, + 1 + ], + "weighted_loads": [ + 0.07064146548509598, + 0.6562135070562363, + 0.07047116197645664, + 1.7734776549041271, + 0.30669502168893814, + 0.3493598513305187, + 0.5025705844163895, + 0.7923496291041374, + 1.0391363445669413, + 0.196756973862648, + 1.024239368736744, + 0.2889612577855587, + 1.2779645584523678, + 0.49208464100956917, + 0.22906814143061638, + 0.508708817884326, + 0.013262412510812283, + 0.33191332779824734, + 0.8515168633311987, + 0.8131786026060581, + 0.11739926971495152, + 0.8244183259084821, + 0.1767653226852417, + 0.4351251535117626, + 0.07172239944338799, + 1.945670310407877, + 1.2499451898038387, + 1.5312548391520977, + 0.43526702001690865, + 0.5534833669662476, + 1.173775628209114, + 1.1519568488001823, + 0.07671782188117504, + 1.3187028709799051, + 0.16731156408786774, + 0.9983097463846207, + 0.11343783885240555, + 0.03616590052843094, + 1.5568990856409073, + 0.8386751711368561, + 1.4767933674156666, + 0.9171314463019371, + 1.041702950373292, + 1.1666635796427727, + 1.4010716564953327, + 1.0369694605469704, + 0.5287048369646072, + 1.129464726895094, + 1.3366673365235329, + 0.38906656950712204, + 0.061356453225016594, + 1.350359484553337, + 0.7386712804436684, + 1.573922068811953, + 0.283653037622571, + 1.359938871115446, + 0.9853236433118582, + 0.5372777432203293, + 0.3498552404344082, + 0.6127265393733978, + 0.6237962581217289, + 0.8037171214818954, + 0.3372931517660618, + 0.05161215364933014 + ], + "unique_experts": 64, + "load_cv": 0.6607546021077965, + "normalized_load_entropy": 0.9428679171768325, + "max_load_share": 0.04367816091954023 + } + }, + "s1_bos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "ace90bbf989cfa4d2d0a4a08668eb853a4fc5572040bced6a5f76e06f5239f06", + "route_weight_sha256": "5c9d8a339c37efe35d4ba6af623b95b21d8377f04af2119b0177502a59913576", + "loads": [ + 3, + 14, + 0, + 27, + 5, + 8, + 8, + 12, + 15, + 2, + 14, + 10, + 22, + 5, + 1, + 9, + 1, + 6, + 20, + 8, + 3, + 5, + 3, + 5, + 2, + 24, + 15, + 14, + 7, + 7, + 27, + 20, + 1, + 26, + 3, + 7, + 5, + 1, + 19, + 15, + 31, + 15, + 15, + 13, + 15, + 23, + 12, + 22, + 16, + 4, + 2, + 18, + 2, + 27, + 6, + 18, + 17, + 10, + 7, + 12, + 14, + 19, + 2, + 1 + ], + "weighted_loads": [ + 0.10784529522061348, + 0.564949644729495, + 0.0, + 1.6985863093286753, + 0.16045528650283813, + 0.3458459936082363, + 0.32434594444930553, + 0.7386437505483627, + 0.6561782360076904, + 0.19155720993876457, + 0.709625905379653, + 0.36843824572861195, + 1.229576788842678, + 0.2156489472836256, + 0.0459924079477787, + 0.34283226914703846, + 0.02696117013692856, + 0.21049496345221996, + 0.8387090787291527, + 0.26730369962751865, + 0.1178971417248249, + 0.2596017401665449, + 0.18407297506928444, + 0.4330724664032459, + 0.07077678292989731, + 1.8333189971745014, + 0.8327549230307341, + 1.0412295684218407, + 0.32908521965146065, + 0.4860397204756737, + 1.0827941093593836, + 0.7300357464700937, + 0.05202861875295639, + 1.245773209258914, + 0.12868503481149673, + 0.43414582312107086, + 0.24168424680829048, + 0.03786096349358559, + 1.5388160571455956, + 0.5765418652445078, + 1.225421441718936, + 0.870967797935009, + 0.8728700764477253, + 1.1239679083228111, + 1.3464688584208488, + 0.9508669711649418, + 0.6612287778407335, + 0.9807450100779533, + 0.7224576938897371, + 0.1969185248017311, + 0.06527207046747208, + 1.067905679345131, + 0.07727638632059097, + 1.5052386242896318, + 0.2336769998073578, + 1.0706973876804113, + 0.9996259175240993, + 0.5987455770373344, + 0.2710843700915575, + 0.6317249536514282, + 0.6502027437090874, + 0.8361785393208265, + 0.06975258700549603, + 0.054810114204883575 + ], + "unique_experts": 63, + "load_cv": 0.7192245481192115, + "normalized_load_entropy": 0.9331807284219102, + "max_load_share": 0.043055555555555555 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "cc434f3c766574870e2c2c1a04e1e909f92fff479174f4d698593b14e9ef963e", + "route_weight_sha256": "5f5529f62efb31b152b967004c4df008c0a2d72853b66c104295b84a992452cd", + "loads": [ + 11, + 16, + 2, + 27, + 8, + 9, + 14, + 14, + 19, + 4, + 22, + 12, + 27, + 14, + 7, + 12, + 2, + 13, + 24, + 12, + 4, + 13, + 5, + 10, + 3, + 26, + 23, + 25, + 9, + 8, + 33, + 22, + 2, + 30, + 3, + 22, + 6, + 2, + 20, + 17, + 34, + 17, + 23, + 14, + 16, + 24, + 12, + 22, + 27, + 8, + 3, + 28, + 12, + 28, + 19, + 27, + 21, + 10, + 8, + 15, + 15, + 20, + 9, + 2 + ], + "weighted_loads": [ + 0.619765380397439, + 0.6476402040570974, + 0.691111484542489, + 1.6985863093286753, + 0.27520568668842316, + 0.3614117559045553, + 0.6322697382420301, + 0.8597522862255573, + 0.8440902642905712, + 0.33989450335502625, + 1.131511377170682, + 0.472769046202302, + 1.4812877923250198, + 0.6878379732370377, + 0.29377066902816296, + 0.4605187550187111, + 0.04022358264774084, + 0.4920224454253912, + 1.0101922359317541, + 0.8946576062589884, + 0.1648811250925064, + 0.7528452714905143, + 0.24211066402494907, + 0.9198974370956421, + 0.10631334036588669, + 1.904608491808176, + 1.118670480325818, + 1.9581517241895199, + 0.3603097256273031, + 0.5348509587347507, + 1.3212864138185978, + 0.865275913849473, + 0.07466238364577293, + 1.8395443093031645, + 0.12868503481149673, + 1.2872184962034225, + 0.31257573887705803, + 0.07855752110481262, + 1.594171416014433, + 0.6465795766562223, + 1.3509633708745241, + 0.996479719877243, + 1.282921388745308, + 1.1664529964327812, + 1.4058495126664639, + 1.010470811277628, + 0.6612287778407335, + 0.9807450100779533, + 1.5573887098580599, + 1.1918769143521786, + 0.11885347589850426, + 1.7763579972088337, + 0.6830289661884308, + 1.518251252360642, + 0.9983769152313471, + 1.681499157100916, + 1.15893891826272, + 0.5987455770373344, + 0.2960336711257696, + 0.7920683547854424, + 0.6726241987198591, + 0.898688143119216, + 0.4047131557017565, + 0.14513173699378967 + ], + "unique_experts": 64, + "load_cv": 0.5767114099724676, + "normalized_load_entropy": 0.9561939317840806, + "max_load_share": 0.035196687370600416 + } + }, + "s0_x": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "f2feff2f806612f9c349ed50289832fb57c7be21bf64c2155649a42b73fb11a7", + "route_weight_sha256": "39094e09a95510ea4b31cdb456230efe1835e5c407aad783162f82ab81305407", + "loads": [ + 3, + 13, + 0, + 22, + 5, + 9, + 7, + 13, + 15, + 2, + 15, + 9, + 23, + 5, + 1, + 8, + 2, + 7, + 18, + 8, + 2, + 4, + 3, + 5, + 2, + 24, + 17, + 14, + 7, + 8, + 29, + 23, + 3, + 25, + 6, + 7, + 5, + 1, + 19, + 19, + 27, + 14, + 12, + 13, + 15, + 19, + 12, + 23, + 16, + 5, + 1, + 18, + 2, + 31, + 5, + 22, + 17, + 10, + 8, + 12, + 12, + 17, + 0, + 1 + ], + "weighted_loads": [ + 0.11293882317841053, + 0.5166490878909826, + 0.0, + 1.3523921314626932, + 0.16118904761970043, + 0.38811079040169716, + 0.2842988669872284, + 0.7376685068011284, + 0.6341095305979252, + 0.18919406831264496, + 0.7347868140786886, + 0.31179723516106606, + 1.1755415499210358, + 0.21361217461526394, + 0.04785482957959175, + 0.3221100028604269, + 0.06055259890854359, + 0.25265468657016754, + 0.7702231537550688, + 0.2668850254267454, + 0.07414393313229084, + 0.2252563238143921, + 0.17161394655704498, + 0.4929595850408077, + 0.0716706644743681, + 1.9467177838087082, + 0.9138098265975714, + 1.1169375963509083, + 0.3448798842728138, + 0.5390456914901733, + 1.1590649727731943, + 0.8521764893084764, + 0.11198780499398708, + 1.197699397802353, + 0.23141976818442345, + 0.4062824733555317, + 0.23351481929421425, + 0.037863850593566895, + 1.6303292475640774, + 0.7349977008998394, + 1.0451832730323076, + 0.8187201507389545, + 0.8649552222341299, + 1.2195346243679523, + 1.362764660269022, + 0.812350045889616, + 0.6525390073657036, + 1.0873772948980331, + 0.7824771963059902, + 0.21209659427404404, + 0.03367946669459343, + 1.0350646004080772, + 0.08709384873509407, + 1.6103578433394432, + 0.1737046279013157, + 1.3176110479980707, + 0.9977277666330338, + 0.5528927929699421, + 0.2848028801381588, + 0.5472612418234348, + 0.5815348476171494, + 0.7513195462524891, + 0.0, + 0.05230442062020302 + ], + "unique_experts": 62, + "load_cv": 0.7164728420068226, + "normalized_load_entropy": 0.9330965683644984, + "max_load_share": 0.043055555555555555 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "26a1965f5cb5e31676d3f5dbc38d7bc9dfb44467f43ed2cb539f4f2ad5d9160f", + "route_weight_sha256": "644c79cbd86fbb7eae762625b9a16838e90b1925cf307223b6719ac7b98015f2", + "loads": [ + 3, + 13, + 2, + 22, + 11, + 9, + 10, + 13, + 17, + 2, + 23, + 10, + 26, + 9, + 5, + 12, + 4, + 12, + 19, + 12, + 2, + 10, + 3, + 6, + 2, + 25, + 25, + 19, + 10, + 8, + 30, + 24, + 4, + 25, + 7, + 18, + 5, + 1, + 19, + 20, + 30, + 15, + 18, + 13, + 15, + 19, + 12, + 23, + 29, + 8, + 1, + 25, + 12, + 32, + 10, + 25, + 19, + 10, + 9, + 14, + 12, + 17, + 4, + 1 + ], + "weighted_loads": [ + 0.11293882317841053, + 0.5166490878909826, + 0.07047116197645664, + 1.3523921314626932, + 0.39111769013106823, + 0.38811079040169716, + 0.5391629450023174, + 0.7376685068011284, + 0.7572160549461842, + 0.18919406831264496, + 1.1412120554596186, + 0.36019571498036385, + 1.316407322883606, + 0.4682535845786333, + 0.20299701765179634, + 0.4768807999789715, + 0.11776070762425661, + 0.43742308020591736, + 0.8079475443810225, + 0.9149126894772053, + 0.07414393313229084, + 0.6481442982330918, + 0.17161394655704498, + 0.5373170003294945, + 0.0716706644743681, + 1.9827859736979008, + 1.2934064734727144, + 1.5408941768109798, + 0.4492405317723751, + 0.5390456914901733, + 1.19483901001513, + 0.9164631012827158, + 0.13482074066996574, + 1.197699397802353, + 0.28168995678424835, + 1.0820292867720127, + 0.23351481929421425, + 0.037863850593566895, + 1.6303292475640774, + 0.7677494809031487, + 1.1569736208766699, + 0.8539278544485569, + 1.185050604864955, + 1.2195346243679523, + 1.362764660269022, + 0.812350045889616, + 0.6525390073657036, + 1.0873772948980331, + 1.4998611602932215, + 0.44568154960870743, + 0.03367946669459343, + 1.3515767194330692, + 0.8555539026856422, + 1.6233704714104533, + 0.3453883733600378, + 1.5520656891167164, + 1.081845298409462, + 0.5528927929699421, + 0.3094544466584921, + 0.6117597408592701, + 0.5815348476171494, + 0.7513195462524891, + 0.18814022094011307, + 0.05230442062020302 + ], + "unique_experts": 64, + "load_cv": 0.6180403228478495, + "normalized_load_entropy": 0.949874506749194, + "max_load_share": 0.0367816091954023 + } + }, + "s1_x": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "9e1cc0fe58fb3b6586c4f4d9109ea017d4df2f4dd78508d3f63db06b95f60b3a", + "route_weight_sha256": "9e914e7ec5afe29adcaef8c4080d47a892d77d2636577e8781486a9ada51a61d", + "loads": [ + 3, + 13, + 0, + 23, + 4, + 9, + 8, + 13, + 17, + 4, + 15, + 7, + 22, + 5, + 2, + 8, + 2, + 5, + 17, + 8, + 3, + 3, + 3, + 4, + 1, + 26, + 11, + 14, + 9, + 6, + 30, + 20, + 1, + 25, + 7, + 6, + 3, + 1, + 19, + 14, + 28, + 14, + 12, + 13, + 15, + 21, + 13, + 26, + 18, + 5, + 1, + 17, + 2, + 36, + 5, + 20, + 14, + 10, + 9, + 12, + 14, + 21, + 2, + 1 + ], + "weighted_loads": [ + 0.12075784429907799, + 0.479753689840436, + 0.0, + 1.350142927840352, + 0.12026635557413101, + 0.3680764175951481, + 0.35127207450568676, + 0.760904636234045, + 0.6727098822593689, + 0.2402210310101509, + 0.7379672415554523, + 0.28642333298921585, + 1.155267346650362, + 0.23408642411231995, + 0.07839363068342209, + 0.31206968799233437, + 0.06456245854496956, + 0.1720469743013382, + 0.7155181095004082, + 0.2639712020754814, + 0.11849617958068848, + 0.19335748627781868, + 0.1754102259874344, + 0.3979273550212383, + 0.03139413148164749, + 1.9016346875578165, + 0.6501043755561113, + 1.0629400126636028, + 0.3802208695560694, + 0.42469828575849533, + 1.1794532481580973, + 0.7150462716817856, + 0.0526479035615921, + 1.1274369172751904, + 0.26429107785224915, + 0.3805769830942154, + 0.15620151534676552, + 0.03997300565242767, + 1.4790456108748913, + 0.5121323242783546, + 1.2015390768647194, + 0.7662640120834112, + 0.7763880230486393, + 1.1401803381741047, + 1.2391319200396538, + 0.8557183034718037, + 0.736681129783392, + 1.1177333742380142, + 0.8596222214400768, + 0.22903957590460777, + 0.032282501459121704, + 1.0341314766556025, + 0.07685190066695213, + 2.0130112878978252, + 0.19153547659516335, + 1.1245899721980095, + 0.8845635615289211, + 0.5279200151562691, + 0.3133303038775921, + 0.6100653875619173, + 0.6697624921798706, + 0.948499534279108, + 0.07429361343383789, + 0.05399646982550621 + ], + "unique_experts": 63, + "load_cv": 0.7484964352488573, + "normalized_load_entropy": 0.930178518473008, + "max_load_share": 0.05 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "dceef46fe85d1acd73375d0ab0f896893b4c6f064379fc9aa16a027f58826d68", + "route_weight_sha256": "49de33d27d4b8d43c4c1164755e1469b99f8d8718f8bf465d479ff8e02f87c15", + "loads": [ + 12, + 14, + 2, + 23, + 5, + 10, + 12, + 14, + 19, + 6, + 25, + 8, + 29, + 15, + 10, + 11, + 3, + 11, + 20, + 12, + 4, + 10, + 5, + 11, + 2, + 30, + 19, + 24, + 11, + 7, + 36, + 20, + 2, + 29, + 7, + 22, + 4, + 2, + 20, + 16, + 30, + 17, + 23, + 14, + 16, + 22, + 13, + 26, + 32, + 8, + 2, + 27, + 13, + 37, + 17, + 30, + 18, + 10, + 10, + 15, + 15, + 22, + 5, + 2 + ], + "weighted_loads": [ + 0.6611719876527786, + 0.5272703114897013, + 0.691111484542489, + 1.350142927840352, + 0.15053179115056992, + 0.3836421798914671, + 0.4955614861100912, + 0.8426869623363018, + 0.7754745930433273, + 0.3885583244264126, + 1.2308527138084173, + 0.32895921543240547, + 1.4885983876883984, + 0.7480961438268423, + 0.3908285144716501, + 0.43461876176297665, + 0.07782487105578184, + 0.4083753116428852, + 0.819115387275815, + 0.8861578851938248, + 0.16548016294836998, + 0.6469454364851117, + 0.23344791494309902, + 0.9768984355032444, + 0.06693068891763687, + 2.063978213816881, + 0.9360199328511953, + 1.9075671695172787, + 0.41144537553191185, + 0.4735095240175724, + 1.4151529781520367, + 0.7150462716817856, + 0.07528166845440865, + 1.7212080173194408, + 0.26429107785224915, + 1.3007310256361961, + 0.22709300741553307, + 0.08066956326365471, + 1.5344009697437286, + 0.5942368805408478, + 1.277074858546257, + 0.9712317418307066, + 1.3558123223483562, + 1.1826654262840748, + 1.2985125742852688, + 0.9153221435844898, + 0.736681129783392, + 1.1177333742380142, + 1.955351386219263, + 1.131077580153942, + 0.08586390689015388, + 1.7425837945193052, + 0.8892565257847309, + 2.0260239159688354, + 0.8863086085766554, + 1.7928277757018805, + 1.0438765622675419, + 0.5279200151562691, + 0.3382796049118042, + 0.7704087886959314, + 0.6921839471906424, + 1.0110091380774975, + 0.19701732695102692, + 0.1443180926144123 + ], + "unique_experts": 64, + "load_cv": 0.6063920297276629, + "normalized_load_entropy": 0.9532242554158963, + "max_load_share": 0.038302277432712216 + } + }, + "s0_period": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "712434a54eb13ceb08cc234a6cad2665c20bf6c44995a3e831328665a995b489", + "route_weight_sha256": "81624bbbe7c9da30887a2bd5554b7a5aabc2a56d71a818cb646535be6d0d46da", + "loads": [ + 3, + 14, + 0, + 24, + 6, + 10, + 7, + 13, + 15, + 2, + 16, + 9, + 25, + 5, + 1, + 10, + 1, + 7, + 15, + 7, + 2, + 7, + 3, + 5, + 2, + 24, + 16, + 14, + 7, + 8, + 30, + 19, + 2, + 27, + 5, + 7, + 3, + 1, + 19, + 16, + 31, + 14, + 12, + 13, + 15, + 20, + 10, + 23, + 16, + 3, + 2, + 17, + 4, + 29, + 4, + 21, + 17, + 10, + 7, + 13, + 15, + 16, + 0, + 1 + ], + "weighted_loads": [ + 0.10541966557502747, + 0.554301830008626, + 0.0, + 1.4732864499092102, + 0.19067175313830376, + 0.41068604961037636, + 0.30377744883298874, + 0.760309137403965, + 0.6092447359114885, + 0.18670296296477318, + 0.7624475713819265, + 0.33659573271870613, + 1.280617056414485, + 0.22222253680229187, + 0.05122920125722885, + 0.39335239492356777, + 0.030601050704717636, + 0.23676453717052937, + 0.6652023773640394, + 0.2372029460966587, + 0.07526879385113716, + 0.3333307020366192, + 0.17410599067807198, + 0.49452192708849907, + 0.07069064676761627, + 1.9279017224907875, + 0.8751652967184782, + 1.0964146107435226, + 0.3235294446349144, + 0.528308616951108, + 1.1872543543577194, + 0.7389916758984327, + 0.08613330870866776, + 1.2770477291196585, + 0.19412092491984367, + 0.40085247717797756, + 0.1447250247001648, + 0.03767242655158043, + 1.598473072052002, + 0.6308234259486198, + 1.1779916230589151, + 0.8404853008687496, + 0.8347365371882915, + 1.2189090549945831, + 1.3611190132796764, + 0.8498539943248034, + 0.5545899514108896, + 1.0887846872210503, + 0.7806297894567251, + 0.15384292602539062, + 0.06544926390051842, + 1.0651497542858124, + 0.1478492822498083, + 1.5662310048937798, + 0.14247311651706696, + 1.3186344914138317, + 0.9730367083102465, + 0.5315573550760746, + 0.2632064074277878, + 0.6051813717931509, + 0.7070269882678986, + 0.695622343569994, + 0.0, + 0.05140496790409088 + ], + "unique_experts": 62, + "load_cv": 0.727586913055329, + "normalized_load_entropy": 0.931669246964714, + "max_load_share": 0.043055555555555555 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "9d7acbe2ad2733ad5743b0d5c3451880e51c6f93791eb1d86b6e78bb7affae8b", + "route_weight_sha256": "d9c479a295742d493f9852008417c857dcdc1c9261e0e3664b071083a31e8007", + "loads": [ + 3, + 14, + 2, + 24, + 13, + 10, + 11, + 13, + 17, + 2, + 22, + 10, + 28, + 11, + 5, + 15, + 2, + 11, + 17, + 11, + 2, + 13, + 3, + 6, + 2, + 25, + 24, + 19, + 10, + 8, + 31, + 20, + 3, + 27, + 6, + 18, + 3, + 1, + 19, + 18, + 33, + 15, + 16, + 13, + 15, + 21, + 10, + 23, + 28, + 5, + 2, + 25, + 13, + 30, + 9, + 25, + 18, + 10, + 8, + 16, + 15, + 16, + 4, + 1 + ], + "weighted_loads": [ + 0.10541966557502747, + 0.554301830008626, + 0.07047116197645664, + 1.4732864499092102, + 0.45067521184682846, + 0.41068604961037636, + 0.6236255653202534, + 0.760309137403965, + 0.7343334574252367, + 0.18670296296477318, + 1.080572148784995, + 0.38398123905062675, + 1.4266778323799372, + 0.5613001324236393, + 0.20285895839333534, + 0.5879709981381893, + 0.04386346321552992, + 0.39204283617436886, + 0.7387875374406576, + 0.8816647939383984, + 0.07526879385113716, + 0.7562186764553189, + 0.17410599067807198, + 0.5388793423771858, + 0.07069064676761627, + 1.96396991237998, + 1.2547619435936213, + 1.5109135061502457, + 0.4207201339304447, + 0.528308616951108, + 1.2238119132816792, + 0.80656941793859, + 0.10896624438464642, + 1.2770477291196585, + 0.24439111351966858, + 1.0446758139878511, + 0.1447250247001648, + 0.03767242655158043, + 1.598473072052002, + 0.7069721594452858, + 1.2563221212476492, + 0.875693004578352, + 1.0803922079503536, + 1.2189090549945831, + 1.3611190132796764, + 0.8915851507335901, + 0.5545899514108896, + 1.0887846872210503, + 1.447668882086873, + 0.39246125519275665, + 0.06544926390051842, + 1.4420171491801739, + 0.730797627940774, + 1.5792436329647899, + 0.31504438258707523, + 1.6276479046791792, + 1.0137471351772547, + 0.5315573550760746, + 0.28785797394812107, + 0.7581536751240492, + 0.7070269882678986, + 0.695622343569994, + 0.19921853207051754, + 0.05140496790409088 + ], + "unique_experts": 64, + "load_cv": 0.6287555944634065, + "normalized_load_entropy": 0.9477937841408461, + "max_load_share": 0.03793103448275862 + } + }, + "s1_period": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "b7c6c78a5f8d02ac87561815c8bf51ab314644efebc8a1f8b6aec4a979297718", + "route_weight_sha256": "3924d597e497a502d15a3b89fbec6051580c5daacf008f1e19421138d55eb145", + "loads": [ + 3, + 12, + 0, + 24, + 3, + 9, + 8, + 13, + 14, + 2, + 16, + 7, + 24, + 7, + 1, + 6, + 0, + 4, + 19, + 6, + 3, + 4, + 3, + 4, + 2, + 27, + 12, + 15, + 10, + 6, + 30, + 18, + 1, + 23, + 7, + 6, + 4, + 1, + 19, + 14, + 29, + 14, + 12, + 13, + 15, + 21, + 12, + 26, + 19, + 6, + 1, + 20, + 2, + 37, + 7, + 20, + 15, + 10, + 6, + 13, + 16, + 16, + 2, + 1 + ], + "weighted_loads": [ + 0.12317358888685703, + 0.4312824737280607, + 0.0, + 1.4223467521369457, + 0.08883446455001831, + 0.3752022311091423, + 0.3514272943139076, + 0.7627287060022354, + 0.571971956640482, + 0.17920030653476715, + 0.7674155738204718, + 0.2768363058567047, + 1.2907127104699612, + 0.3057469595223665, + 0.045243486762046814, + 0.23764048516750336, + 0.0, + 0.14809546992182732, + 0.7867792509496212, + 0.20477816462516785, + 0.1200290098786354, + 0.2209431566298008, + 0.17343009263277054, + 0.39494528621435165, + 0.0701487846672535, + 1.9923855140805244, + 0.6965309735387564, + 1.0293116979300976, + 0.4149256646633148, + 0.41636547073721886, + 1.1893155463039875, + 0.6649530213326216, + 0.05305827036499977, + 1.0415960066020489, + 0.26438574865460396, + 0.37873878702521324, + 0.19396138563752174, + 0.03980784863233566, + 1.4709077700972557, + 0.5103136263787746, + 1.2392582520842552, + 0.7920831181108952, + 0.7735695205628872, + 1.1474198885262012, + 1.2169360630214214, + 0.8353180680423975, + 0.7307590842247009, + 1.116186324506998, + 0.9112510997802019, + 0.25912272557616234, + 0.031730569899082184, + 1.2017052918672562, + 0.07796130329370499, + 2.0404528006911278, + 0.2670385129749775, + 1.1776840668171644, + 0.9566079787909985, + 0.5276490598917007, + 0.23245672695338726, + 0.6500980574637651, + 0.7340581528842449, + 0.7170704640448093, + 0.07596271857619286, + 0.05708479881286621 + ], + "unique_experts": 62, + "load_cv": 0.7646511348482334, + "normalized_load_entropy": 0.9265069681824443, + "max_load_share": 0.05138888888888889 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "da25a84fa3a92e773d85842c16307229381a07ded1f81f5a015cd9a7280ad80e", + "route_weight_sha256": "57c9066ef22f8c4f7ce48d3833afef78ce54d9326b300478d5ff0cdd012b4985", + "loads": [ + 11, + 13, + 2, + 24, + 4, + 10, + 13, + 14, + 17, + 4, + 24, + 8, + 29, + 17, + 9, + 8, + 2, + 9, + 23, + 10, + 4, + 12, + 5, + 11, + 3, + 29, + 20, + 24, + 12, + 7, + 36, + 18, + 2, + 27, + 7, + 23, + 5, + 3, + 20, + 17, + 32, + 16, + 23, + 14, + 16, + 22, + 12, + 26, + 32, + 9, + 2, + 31, + 12, + 38, + 20, + 31, + 19, + 10, + 7, + 17, + 17, + 17, + 5, + 2 + ], + "weighted_loads": [ + 0.6350936740636826, + 0.478799095377326, + 0.691111484542489, + 1.4223467521369457, + 0.12024735659360886, + 0.3907679934054613, + 0.5650795623660088, + 0.8445110321044922, + 0.7149928994476795, + 0.3275375999510288, + 1.1902477573603392, + 0.3170991837978363, + 1.5674642473459244, + 0.8292621858417988, + 0.3704759683459997, + 0.314589099958539, + 0.04964583273977041, + 0.35255278274416924, + 0.9348790999501944, + 0.829685814678669, + 0.1670129932463169, + 0.7064486900344491, + 0.23146778158843517, + 1.0000263154506683, + 0.10568534210324287, + 2.063675008714199, + 0.9824465308338404, + 1.8063553869724274, + 0.4461501706391573, + 0.46517670899629593, + 1.4298112783581018, + 0.6649530213326216, + 0.07569203525781631, + 1.6353671066462994, + 0.26438574865460396, + 1.3139198385179043, + 0.2648528777062893, + 0.10794435441493988, + 1.526263128966093, + 0.635882880538702, + 1.356835462152958, + 0.9175950400531292, + 1.3587678037583828, + 1.1899049766361713, + 1.2763167172670364, + 0.8949219081550837, + 0.7307590842247009, + 1.116186324506998, + 1.849514851346612, + 1.2623343728482723, + 0.08531197533011436, + 1.9728922583162785, + 0.6837138831615448, + 2.053465428762138, + 1.01623753644526, + 1.8909283205866814, + 1.1159209795296192, + 0.5276490598917007, + 0.2574060279875994, + 0.883508550003171, + 0.7564796078950167, + 0.7795800678431988, + 0.19808253645896912, + 0.1474064216017723 + ], + "unique_experts": 64, + "load_cv": 0.6237865381028086, + "normalized_load_entropy": 0.9509637159211075, + "max_load_share": 0.039337474120082816 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 120, + "ordered_topk_exact_tokens": 37, + "set_exact_tokens": 59, + "mean_set_jaccard": 0.8422619047619049, + "mean_token_weighted_tv": 0.02878655563108623, + "aggregate_load_tv": 0.05 + }, + "system_bos": { + "tokens": 120, + "ordered_topk_exact_tokens": 41, + "set_exact_tokens": 67, + "mean_set_jaccard": 0.8509920634920634, + "mean_token_weighted_tv": 0.03035648853207628, + "aggregate_load_tv": 0.04583333333333334 + }, + "system_x": { + "tokens": 120, + "ordered_topk_exact_tokens": 22, + "set_exact_tokens": 37, + "mean_set_jaccard": 0.7553571428571428, + "mean_token_weighted_tv": 0.04850915587351968, + "aggregate_load_tv": 0.05138888888888889 + }, + "system_period": { + "tokens": 120, + "ordered_topk_exact_tokens": 27, + "set_exact_tokens": 45, + "mean_set_jaccard": 0.7748809523809524, + "mean_token_weighted_tv": 0.04575048498809338, + "aggregate_load_tv": 0.06527777777777777 + }, + "bos_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 32, + "set_exact_tokens": 53, + "mean_set_jaccard": 0.8044444444444445, + "mean_token_weighted_tv": 0.03824764585588127, + "aggregate_load_tv": 0.058333333333333334 + }, + "bos_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 34, + "set_exact_tokens": 51, + "mean_set_jaccard": 0.8164682539682542, + "mean_token_weighted_tv": 0.03600699607438097, + "aggregate_load_tv": 0.058333333333333334 + }, + "x_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 23, + "set_exact_tokens": 39, + "mean_set_jaccard": 0.7686507936507937, + "mean_token_weighted_tv": 0.04231276123318821, + "aggregate_load_tv": 0.05694444444444444 + }, + "x_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 21, + "set_exact_tokens": 35, + "mean_set_jaccard": 0.752063492063492, + "mean_token_weighted_tv": 0.047796272377793984, + "aggregate_load_tv": 0.06249999999999999 + }, + "period_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 35, + "set_exact_tokens": 51, + "mean_set_jaccard": 0.7926587301587301, + "mean_token_weighted_tv": 0.04010361485028018, + "aggregate_load_tv": 0.05 + }, + "period_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 21, + "set_exact_tokens": 39, + "mean_set_jaccard": 0.7615873015873016, + "mean_token_weighted_tv": 0.047167102922685444, + "aggregate_load_tv": 0.06805555555555556 + } + } + }, + "layer_22": { + "layer": 22, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "ced67f1c981540bcc3e38c9cb51b26cc663f86792885c378d91dd9c2b0639efa", + "route_weight_sha256": "dce63d450567271fecb84f17cabcfbb14a243d31b32dfe1f397bef905264b480", + "loads": [ + 26, + 26, + 15, + 8, + 5, + 36, + 12, + 12, + 13, + 30, + 13, + 1, + 3, + 3, + 6, + 5, + 2, + 4, + 5, + 14, + 17, + 15, + 12, + 5, + 24, + 7, + 3, + 1, + 4, + 8, + 6, + 11, + 16, + 14, + 2, + 10, + 9, + 4, + 1, + 21, + 5, + 8, + 22, + 1, + 24, + 2, + 12, + 15, + 7, + 5, + 22, + 4, + 15, + 10, + 15, + 23, + 3, + 18, + 4, + 1, + 18, + 22, + 19, + 16 + ], + "weighted_loads": [ + 1.7894747853279114, + 1.0446774177253246, + 1.6771044954657555, + 0.7019319348037243, + 0.2281789593398571, + 1.475461058318615, + 0.34454462956637144, + 5.325028017163277, + 0.66593212261796, + 2.2438692282885313, + 0.6167082134634256, + 0.03603217005729675, + 0.17973461002111435, + 0.08162136934697628, + 0.3472505174577236, + 0.18159672245383263, + 0.11520401388406754, + 0.14430374279618263, + 0.24445149675011635, + 0.6874593179672956, + 0.6838085912168026, + 0.9170390609651804, + 0.5073962323367596, + 0.29426462203264236, + 0.9957581534981728, + 0.2662343271076679, + 0.09656380116939545, + 0.04082382097840309, + 0.29038335755467415, + 0.33269070088863373, + 0.22228511609137058, + 0.45914940163493156, + 0.5886402297765017, + 0.5786469355225563, + 0.038126745261251926, + 0.3568302094936371, + 0.49865059554576874, + 0.14166608452796936, + 0.11431803554296494, + 1.262410692870617, + 0.6090178936719894, + 0.5572057403624058, + 0.8785288538783789, + 0.03244692087173462, + 1.1782656162977219, + 0.074002955108881, + 0.6812673453241587, + 0.6330632120370865, + 0.3192418087273836, + 0.21366729587316513, + 0.8662638161331415, + 0.48488353937864304, + 0.7998729981482029, + 0.40748320519924164, + 0.7409706320613623, + 1.3621410839259624, + 0.1621887944638729, + 0.8658629953861237, + 0.2248545102775097, + 0.05713634938001633, + 1.531245930120349, + 1.1375873610377312, + 1.089877713471651, + 0.7860729992389679 + ], + "unique_experts": 64, + "load_cv": 0.7294510027631045, + "normalized_load_entropy": 0.935059575363401, + "max_load_share": 0.05 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "ea6fc7b85b489b37385f4dbc0522cbf63440b68865bea2712f16e96860167819", + "route_weight_sha256": "4ce009bf0aa898b1badb7104d6b98c8f08c937bb64abff2590d935b5f7c3b07f", + "loads": [ + 31, + 27, + 17, + 17, + 5, + 38, + 16, + 12, + 28, + 35, + 13, + 3, + 3, + 3, + 12, + 5, + 2, + 6, + 5, + 14, + 18, + 22, + 13, + 5, + 24, + 8, + 3, + 6, + 4, + 8, + 7, + 11, + 19, + 22, + 3, + 12, + 9, + 6, + 1, + 21, + 9, + 9, + 27, + 1, + 24, + 3, + 13, + 15, + 11, + 7, + 25, + 4, + 16, + 12, + 15, + 37, + 6, + 19, + 4, + 1, + 27, + 30, + 19, + 22 + ], + "weighted_loads": [ + 1.989384631626308, + 1.0900357477366924, + 1.7558531537652016, + 2.5794258303940296, + 0.2281789593398571, + 1.5463595343753695, + 0.5645446730777621, + 5.325028017163277, + 1.8814708665013313, + 2.4336067289114, + 0.6167082134634256, + 0.06549283675849438, + 0.17973461002111435, + 0.08162136934697628, + 1.3055055541917682, + 0.18159672245383263, + 0.11520401388406754, + 0.20326399244368076, + 0.24445149675011635, + 0.6874593179672956, + 0.7260145880281925, + 1.430146999657154, + 0.5376645755022764, + 0.29426462203264236, + 0.9957581534981728, + 0.29236460104584694, + 0.09656380116939545, + 0.22744047455489635, + 0.29038335755467415, + 0.33269070088863373, + 0.24547507241368294, + 0.45914940163493156, + 0.6638634367845953, + 0.8908722046762705, + 0.0959772216156125, + 0.4892624691128731, + 0.49865059554576874, + 0.2193137276917696, + 0.11431803554296494, + 1.262410692870617, + 0.8327703401446342, + 0.6003778874874115, + 1.1872202400118113, + 0.03244692087173462, + 1.1782656162977219, + 0.10153633542358875, + 0.7227532584220171, + 0.6330632120370865, + 0.4815408606082201, + 0.3996949978172779, + 1.0335081163793802, + 0.48488353937864304, + 0.9169849492609501, + 0.4702029135078192, + 0.7409706320613623, + 2.4889013678766787, + 0.29021403938531876, + 0.8915201015770435, + 0.2248545102775097, + 0.05713634938001633, + 2.7703732047230005, + 1.4187950361520052, + 1.089877713471651, + 1.0956287309527397 + ], + "unique_experts": 64, + "load_cv": 0.712476806565874, + "normalized_load_entropy": 0.9381979415015237, + "max_load_share": 0.04367816091954023 + } + }, + "s1_eos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "6bc1792c39a9ff03937a392c2096f8079a66b2d4321494f588e869bbb17ad744", + "route_weight_sha256": "29be9ea0891d590d67f1d2adb3f76ca8c7dff53e48cf66af2cc168885b6ce9c0", + "loads": [ + 27, + 23, + 15, + 8, + 6, + 32, + 13, + 12, + 14, + 32, + 14, + 1, + 3, + 6, + 7, + 5, + 2, + 5, + 3, + 15, + 17, + 13, + 10, + 5, + 21, + 12, + 1, + 1, + 4, + 9, + 6, + 10, + 18, + 12, + 0, + 12, + 7, + 3, + 1, + 19, + 6, + 8, + 20, + 3, + 29, + 2, + 10, + 16, + 4, + 5, + 22, + 4, + 14, + 11, + 16, + 22, + 2, + 18, + 4, + 1, + 17, + 23, + 22, + 17 + ], + "weighted_loads": [ + 1.8372098710387945, + 0.9297591913491488, + 1.6851417645812035, + 0.6840562205761671, + 0.24485160037875175, + 1.3090575877577066, + 0.38698090333491564, + 5.882295921444893, + 0.7350720204412937, + 2.2359921876341105, + 0.6824163123965263, + 0.035408347845077515, + 0.1802830882370472, + 0.15160507149994373, + 0.353118471801281, + 0.18115192838013172, + 0.11198179051280022, + 0.17582596838474274, + 0.1577741988003254, + 0.6795398760586977, + 0.6890946757048368, + 0.8243949022144079, + 0.42686646059155464, + 0.29183413088321686, + 0.9278678335249424, + 0.46779169887304306, + 0.03411111235618591, + 0.04098197817802429, + 0.2815477289259434, + 0.34637296199798584, + 0.22428098134696484, + 0.3892123494297266, + 0.6612704545259476, + 0.5079795774072409, + 0.0, + 0.4339065682142973, + 0.41700214333832264, + 0.10668801330029964, + 0.11360175162553787, + 1.1749393194913864, + 0.5710139703005552, + 0.5540774706751108, + 0.7813966237008572, + 0.10505392029881477, + 1.398718185722828, + 0.073704794049263, + 0.6105212420225143, + 0.6606932021677494, + 0.22028884664177895, + 0.2089198548346758, + 0.8480160506442189, + 0.45374399423599243, + 0.7431348543614149, + 0.4323265887796879, + 0.8214374333620071, + 1.3668243065476418, + 0.12338977307081223, + 0.8783941939473152, + 0.22610562667250633, + 0.05646299198269844, + 1.4989917986094952, + 1.1773282270878553, + 1.2511513084173203, + 0.8157369215041399 + ], + "unique_experts": 63, + "load_cv": 0.728434817914834, + "normalized_load_entropy": 0.9333454564458941, + "max_load_share": 0.044444444444444446 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "f5ddb6a87847c672d541bfe76e6e8c60d1720877a02c478a35c301360205a0fb", + "route_weight_sha256": "4cf54454fc1ffaa66b4e97e0f49e4177537e6031c8726c130ca701d0b05d739b", + "loads": [ + 29, + 29, + 15, + 19, + 6, + 34, + 18, + 13, + 36, + 41, + 14, + 6, + 6, + 6, + 12, + 9, + 5, + 7, + 4, + 15, + 19, + 27, + 11, + 5, + 21, + 13, + 1, + 5, + 5, + 9, + 8, + 10, + 20, + 23, + 8, + 17, + 9, + 6, + 1, + 20, + 17, + 9, + 25, + 5, + 29, + 3, + 11, + 18, + 8, + 7, + 32, + 7, + 20, + 13, + 16, + 43, + 6, + 19, + 7, + 1, + 32, + 33, + 22, + 21 + ], + "weighted_loads": [ + 1.9618672477081418, + 1.4259987752884626, + 1.6851417645812035, + 2.829592829570174, + 0.24485160037875175, + 1.370351959951222, + 0.6685666991397738, + 5.924262635409832, + 2.504409508779645, + 2.6929152086377144, + 0.6824163123965263, + 0.3375789299607277, + 0.32023414224386215, + 0.15160507149994373, + 1.1868005022406578, + 0.4159069340676069, + 0.25554654002189636, + 0.22600477188825607, + 0.1973729133605957, + 0.6795398760586977, + 0.776776323094964, + 1.8781921733170748, + 0.46942638978362083, + 0.29183413088321686, + 0.9278678335249424, + 0.49327101930975914, + 0.03411111235618591, + 0.18615266494452953, + 0.365129005163908, + 0.34637296199798584, + 0.3003326244652271, + 0.3892123494297266, + 0.7184917288832366, + 0.9234912246465683, + 0.34954579174518585, + 0.6590987239032984, + 0.5061491634696722, + 0.20464495941996574, + 0.11360175162553787, + 1.2152411304414272, + 1.2514771781861782, + 0.579479681327939, + 1.1185760982334614, + 0.23972006887197495, + 1.398718185722828, + 0.1115235835313797, + 0.6441440768539906, + 0.7287544570863247, + 0.389732476323843, + 0.6642582733184099, + 1.345061949454248, + 0.6546543128788471, + 1.4191001821309328, + 0.5265687964856625, + 0.8214374333620071, + 3.091174079105258, + 0.33813320100307465, + 0.9034082647413015, + 0.2962913843803108, + 0.05646299198269844, + 3.5733257681131363, + 1.5995287392288446, + 1.2511513084173203, + 1.0814261343330145 + ], + "unique_experts": 64, + "load_cv": 0.6826869039395228, + "normalized_load_entropy": 0.9448150834626851, + "max_load_share": 0.044513457556935816 + } + }, + "s0_bos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "6f473a63593d26777e881713e2a522c15379dc6cf247ba228c9e2b6ed4b5b1d5", + "route_weight_sha256": "f68058377b93d4127ab22bb9bfa4262302037f9032855bd19556cd797f2a5ca9", + "loads": [ + 26, + 23, + 15, + 9, + 7, + 29, + 13, + 12, + 14, + 29, + 12, + 2, + 3, + 6, + 8, + 6, + 2, + 5, + 3, + 13, + 14, + 15, + 12, + 4, + 29, + 10, + 1, + 2, + 5, + 6, + 5, + 11, + 14, + 12, + 0, + 11, + 7, + 2, + 2, + 21, + 5, + 7, + 24, + 1, + 30, + 2, + 11, + 17, + 8, + 4, + 24, + 6, + 14, + 10, + 15, + 22, + 3, + 19, + 4, + 1, + 19, + 17, + 20, + 17 + ], + "weighted_loads": [ + 1.9278044942766428, + 0.9482442159205675, + 1.7287993878126144, + 0.6821904014796019, + 0.3128908481448889, + 1.2346746008843184, + 0.3214761521667242, + 5.995657607913017, + 0.8001014925539494, + 2.135279305279255, + 0.6242406293749809, + 0.0730847716331482, + 0.18750938773155212, + 0.17136095464229584, + 0.40419597178697586, + 0.20716435834765434, + 0.11518890410661697, + 0.17666591703891754, + 0.17651710473001003, + 0.6030980441719294, + 0.5867528505623341, + 0.9193237293511629, + 0.5078683290630579, + 0.2720152921974659, + 1.1906987354159355, + 0.40771833434700966, + 0.03567640110850334, + 0.0826551578938961, + 0.3430216368287802, + 0.22160633094608784, + 0.1922460813075304, + 0.42265379801392555, + 0.49777971021831036, + 0.5781709086149931, + 0.0, + 0.3953316733241081, + 0.43722784146666527, + 0.07353116571903229, + 0.15814877673983574, + 1.336076132953167, + 0.6143933683633804, + 0.5799682810902596, + 0.9468281902372837, + 0.036943476647138596, + 1.4468738418072462, + 0.07645843550562859, + 0.6217360235750675, + 0.6686097141355276, + 0.36049605160951614, + 0.17439774423837662, + 0.8262304146774113, + 0.5756397470831871, + 0.7040139473974705, + 0.3862446956336498, + 0.7290363572537899, + 1.4690317250788212, + 0.16871848702430725, + 0.9038344770669937, + 0.24487464874982834, + 0.06104372814297676, + 1.5968083888292313, + 0.9270683787763119, + 1.1702992469072342, + 0.8210505954921246 + ], + "unique_experts": 63, + "load_cv": 0.7228202652129152, + "normalized_load_entropy": 0.9349878565190427, + "max_load_share": 0.041666666666666664 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "3377e2ab106ac91d2541eda85ac877e4a4b80ace4254eb82b2fb7c52b6e58274", + "route_weight_sha256": "b0d50d5a2df60624a0d66ed5836443d1ab9c1d3e44a4b21c104e8551615835d4", + "loads": [ + 30, + 24, + 17, + 17, + 7, + 30, + 16, + 13, + 27, + 34, + 13, + 3, + 3, + 6, + 11, + 7, + 2, + 6, + 3, + 13, + 15, + 22, + 13, + 4, + 30, + 11, + 1, + 8, + 5, + 7, + 6, + 11, + 16, + 21, + 1, + 15, + 7, + 5, + 2, + 21, + 9, + 8, + 29, + 1, + 30, + 3, + 12, + 17, + 13, + 6, + 26, + 6, + 15, + 12, + 15, + 35, + 6, + 21, + 4, + 1, + 29, + 25, + 20, + 24 + ], + "weighted_loads": [ + 2.0990659864619374, + 0.9966024029999971, + 1.8075480461120605, + 1.6688240971416235, + 0.3128908481448889, + 1.2472702832892537, + 0.5303127970546484, + 6.90795724093914, + 1.9414548352360725, + 2.3250168059021235, + 0.6456068716943264, + 0.08554018661379814, + 0.18750938773155212, + 0.17136095464229584, + 1.179686315357685, + 0.2503751926124096, + 0.11518890410661697, + 0.20235229097306728, + 0.17651710473001003, + 0.6030980441719294, + 0.6288692615926266, + 1.4350059740245342, + 0.5381366722285748, + 0.2720152921974659, + 1.1954840957187116, + 0.4338486082851887, + 0.03567640110850334, + 0.31262667663395405, + 0.3430216368287802, + 0.2683075424283743, + 0.2180566880851984, + 0.42265379801392555, + 0.5664590615779161, + 0.9230356179177761, + 0.05785047635436058, + 0.59212751314044, + 0.43722784146666527, + 0.21839114278554916, + 0.15814877673983574, + 1.336076132953167, + 0.8424300663173199, + 0.6609338894486427, + 1.1405376219190657, + 0.036943476647138596, + 1.4468738418072462, + 0.10399181582033634, + 0.663221936672926, + 0.6686097141355276, + 0.6381964311003685, + 0.3045929786749184, + 0.9499859106726944, + 0.5756397470831871, + 0.8181739412248135, + 0.4506554901599884, + 0.7290363572537899, + 2.603427010588348, + 0.2967437319457531, + 0.9384074108675122, + 0.24487464874982834, + 0.06104372814297676, + 2.8205299265682697, + 1.208276053890586, + 1.1702992469072342, + 1.11041696742177 + ], + "unique_experts": 64, + "load_cv": 0.6973630569423674, + "normalized_load_entropy": 0.9391348865587404, + "max_load_share": 0.040229885057471264 + } + }, + "s1_bos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "7ba33c83121bae3b89188dd8b782d78f26d028de3d418a4e6c62d70bdcbec7ee", + "route_weight_sha256": "9b7c258e86ca96eb9708199067927b8157a73c50a52e5d35e734cb84d02c1e7b", + "loads": [ + 26, + 23, + 15, + 8, + 5, + 30, + 13, + 12, + 14, + 31, + 15, + 4, + 3, + 4, + 7, + 4, + 2, + 3, + 2, + 14, + 16, + 14, + 13, + 6, + 25, + 13, + 2, + 3, + 4, + 9, + 6, + 10, + 20, + 11, + 1, + 12, + 8, + 3, + 2, + 19, + 5, + 8, + 18, + 0, + 27, + 2, + 11, + 15, + 7, + 5, + 21, + 5, + 13, + 12, + 14, + 22, + 3, + 18, + 5, + 1, + 18, + 20, + 21, + 17 + ], + "weighted_loads": [ + 1.8537765424698591, + 0.9276225566864014, + 1.7327230796217918, + 0.6962601477280259, + 0.2190711721777916, + 1.2207680121064186, + 0.31162832770496607, + 6.7535697519779205, + 0.788703478872776, + 2.1523764673620462, + 0.728349706158042, + 0.138570724055171, + 0.19000089541077614, + 0.09747762233018875, + 0.35042474418878555, + 0.14016959071159363, + 0.11547844111919403, + 0.10511057451367378, + 0.14917373657226562, + 0.6723475474864244, + 0.6896044388413429, + 0.8931874539703131, + 0.5147575996816158, + 0.34853967651724815, + 1.0390016827732325, + 0.5124779120087624, + 0.068910613656044, + 0.10099377483129501, + 0.3047148361802101, + 0.3365368600934744, + 0.23093044757843018, + 0.40357247553765774, + 0.6998630985617638, + 0.5104962885379791, + 0.010380596853792667, + 0.4545804001390934, + 0.4780351910740137, + 0.0985210295766592, + 0.15470995381474495, + 1.2137025706470013, + 0.5573298260569572, + 0.57691690325737, + 0.7534316033124924, + 0.0, + 1.416166752576828, + 0.07221101596951485, + 0.6290913000702858, + 0.5996530503034592, + 0.31148711778223515, + 0.20488781481981277, + 0.7495735948905349, + 0.5527595095336437, + 0.655367910861969, + 0.45856030471622944, + 0.7314775101840496, + 1.4565169624984264, + 0.17073190584778786, + 0.9198017492890358, + 0.2751903161406517, + 0.05942106619477272, + 1.5456695705652237, + 1.010752959176898, + 1.1298567838966846, + 0.7896602265536785 + ], + "unique_experts": 63, + "load_cv": 0.7002645002928325, + "normalized_load_entropy": 0.9382582362100278, + "max_load_share": 0.043055555555555555 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "2bca0feb5c001dfe1e98dce8bff9f78d69789eb627390bea32a27f05a0b6f69a", + "route_weight_sha256": "5c6cf2e7f82f7f71627edda6c38cda69a69a14bd2030d29571a0a9439696fed1", + "loads": [ + 28, + 28, + 15, + 18, + 5, + 31, + 17, + 13, + 35, + 40, + 15, + 10, + 6, + 4, + 11, + 9, + 5, + 5, + 3, + 14, + 18, + 26, + 15, + 6, + 25, + 14, + 2, + 8, + 5, + 9, + 7, + 10, + 21, + 23, + 9, + 19, + 10, + 6, + 2, + 20, + 16, + 9, + 23, + 2, + 27, + 2, + 12, + 17, + 12, + 8, + 30, + 8, + 20, + 16, + 14, + 42, + 7, + 19, + 6, + 1, + 34, + 30, + 21, + 23 + ], + "weighted_loads": [ + 1.9784339191392064, + 1.384838990867138, + 1.7327230796217918, + 1.9466159353032708, + 0.2190711721777916, + 1.233363694511354, + 0.5833851816132665, + 6.79553646594286, + 2.5017176512628794, + 2.60929948836565, + 0.728349706158042, + 0.5047978442162275, + 0.3299519494175911, + 0.09747762233018875, + 1.1008939817547798, + 0.41653991490602493, + 0.2590431906282902, + 0.15528937801718712, + 0.18877245113253593, + 0.6723475474864244, + 0.7826288789510727, + 1.8593846466392279, + 0.5924651995301247, + 0.34853967651724815, + 1.0390016827732325, + 0.5379572324454784, + 0.068910613656044, + 0.2924034520983696, + 0.38829611241817474, + 0.3365368600934744, + 0.2676506079733372, + 0.40357247553765774, + 0.7510026358067989, + 0.9571595247834921, + 0.3599263885989785, + 0.7726500928401947, + 0.5671822112053633, + 0.21533318795263767, + 0.15470995381474495, + 1.254004381597042, + 1.244231691583991, + 0.6023191139101982, + 1.0837581269443035, + 0.13466614857316017, + 1.416166752576828, + 0.07221101596951485, + 0.662714134901762, + 0.6677143052220345, + 0.6172603387385607, + 0.727222628891468, + 1.1987290354445577, + 0.7536698281764984, + 1.3569475281983614, + 0.6356768179684877, + 0.7314775101840496, + 3.1776592610403895, + 0.3854753337800503, + 0.9448158200830221, + 0.3167765885591507, + 0.05942106619477272, + 3.6678196899592876, + 1.4329534713178873, + 1.1298567838966846, + 1.1660660468041897 + ], + "unique_experts": 64, + "load_cv": 0.6569870699503267, + "normalized_load_entropy": 0.9476829647416214, + "max_load_share": 0.043478260869565216 + } + }, + "s0_x": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "f56d45c168a4169b396e225cad0c0d01df5dd1e33d0a9adcee6f99ad88276cba", + "route_weight_sha256": "a26ce13b9f96b2315f891a64277c9f61c856a7d3655fe183c4a7152e58123716", + "loads": [ + 26, + 24, + 15, + 9, + 7, + 32, + 9, + 12, + 10, + 28, + 13, + 2, + 3, + 4, + 8, + 6, + 2, + 4, + 3, + 14, + 14, + 16, + 14, + 5, + 26, + 12, + 1, + 3, + 4, + 6, + 6, + 9, + 17, + 7, + 4, + 11, + 9, + 1, + 1, + 21, + 6, + 8, + 22, + 1, + 30, + 2, + 12, + 17, + 10, + 3, + 21, + 6, + 19, + 10, + 15, + 24, + 3, + 17, + 4, + 1, + 18, + 17, + 23, + 13 + ], + "weighted_loads": [ + 1.8463490307331085, + 0.9883245062083006, + 1.7345082238316536, + 0.6809230139479041, + 0.31231650710105896, + 1.3144357204437256, + 0.22859941236674786, + 5.764329552650452, + 0.6243695579469204, + 2.2081408202648163, + 0.6549320425838232, + 0.06876305863261223, + 0.18318628147244453, + 0.10217436961829662, + 0.4248466342687607, + 0.20817971043288708, + 0.11856991052627563, + 0.13631650060415268, + 0.17262354493141174, + 0.6338842045515776, + 0.564043439924717, + 0.9799983147531748, + 0.5475976672023535, + 0.2958047427237034, + 1.1058836039155722, + 0.4983267765492201, + 0.03516734763979912, + 0.09994253143668175, + 0.3129703402519226, + 0.2257538828998804, + 0.22048314101994038, + 0.36889893375337124, + 0.60567213781178, + 0.3748781457543373, + 0.07943141274154186, + 0.4087841045111418, + 0.5002699699252844, + 0.04232574626803398, + 0.12436770647764206, + 1.3459011390805244, + 0.6648440025746822, + 0.58194175735116, + 0.8922052271664143, + 0.032123174518346786, + 1.4404879361391068, + 0.0742211639881134, + 0.653966449201107, + 0.6727426052093506, + 0.42716205678880215, + 0.14259270578622818, + 0.8907652664929628, + 0.5688393004238605, + 0.9451111927628517, + 0.3683473374694586, + 0.7151201516389847, + 1.6098488215357065, + 0.17100626230239868, + 0.8513439409434795, + 0.2522124946117401, + 0.06158149614930153, + 1.5038658566772938, + 0.9240661971271038, + 1.282204819843173, + 0.6733513250946999 + ], + "unique_experts": 64, + "load_cv": 0.7226494462892933, + "normalized_load_entropy": 0.9358857615832266, + "max_load_share": 0.044444444444444446 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "750b882fe4647d7fe128f12494af90adb681a65187ee19d283dd64d8828ef075", + "route_weight_sha256": "b07a15b5b452d22017be90a0e59f9300ad665e67693b07ffc5e58a8876ed1ba2", + "loads": [ + 31, + 25, + 17, + 18, + 7, + 33, + 13, + 12, + 24, + 33, + 13, + 3, + 3, + 4, + 12, + 6, + 2, + 6, + 3, + 14, + 15, + 24, + 16, + 5, + 26, + 13, + 1, + 7, + 4, + 6, + 7, + 9, + 19, + 17, + 5, + 13, + 9, + 4, + 1, + 21, + 10, + 9, + 27, + 1, + 30, + 3, + 13, + 17, + 12, + 5, + 24, + 6, + 21, + 12, + 15, + 39, + 6, + 18, + 4, + 1, + 27, + 26, + 23, + 20 + ], + "weighted_loads": [ + 2.0482658809050918, + 1.0309630613774061, + 1.8132568821310997, + 1.7501859506592155, + 0.31231650710105896, + 1.327031402848661, + 0.5084498580545187, + 5.764329552650452, + 1.8151534218341112, + 2.397878320887685, + 0.6549320425838232, + 0.08121847361326218, + 0.18318628147244453, + 0.10217436961829662, + 1.3382548466324806, + 0.20817971043288708, + 0.11856991052627563, + 0.19720580987632275, + 0.17262354493141174, + 0.6338842045515776, + 0.6046426594257355, + 1.5623866580426693, + 0.6003386434167624, + 0.2958047427237034, + 1.1058836039155722, + 0.5244570504873991, + 0.03516734763979912, + 0.23255661688745022, + 0.3129703402519226, + 0.2257538828998804, + 0.2623721305280924, + 0.36889893375337124, + 0.6743514891713858, + 0.7560503128916025, + 0.13728188909590244, + 0.49897767044603825, + 0.5002699699252844, + 0.13970196060836315, + 0.12436770647764206, + 1.3459011390805244, + 0.8999246135354042, + 0.6592571325600147, + 1.1858914718031883, + 0.032123174518346786, + 1.4404879361391068, + 0.10175454430282116, + 0.6954523622989655, + 0.6727426052093506, + 0.514690576121211, + 0.3955700173974037, + 1.0706217717379332, + 0.5688393004238605, + 1.0892814937978983, + 0.43116288632154465, + 0.7151201516389847, + 2.957960688509047, + 0.29903150722384453, + 0.8770010471343994, + 0.2522124946117401, + 0.06158149614930153, + 2.7263098433613777, + 1.2596719916909933, + 1.282204819843173, + 0.9365185350179672 + ], + "unique_experts": 64, + "load_cv": 0.6978478892821166, + "normalized_load_entropy": 0.9394000797184006, + "max_load_share": 0.04482758620689655 + } + }, + "s1_x": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "ba20b2867880c8a31d9d654683f603660ca7b8da0906956293b2fbe8add474cd", + "route_weight_sha256": "d4b5a50ac11ef1905159dd845bb46692164ba778ec213771551857c180d933e5", + "loads": [ + 26, + 24, + 15, + 10, + 6, + 27, + 10, + 12, + 14, + 26, + 19, + 2, + 3, + 6, + 5, + 2, + 3, + 3, + 2, + 13, + 17, + 15, + 11, + 6, + 28, + 10, + 1, + 1, + 4, + 8, + 6, + 13, + 20, + 10, + 4, + 8, + 8, + 4, + 1, + 21, + 6, + 7, + 21, + 1, + 25, + 1, + 11, + 19, + 6, + 4, + 19, + 6, + 19, + 10, + 14, + 25, + 2, + 18, + 5, + 1, + 19, + 21, + 23, + 13 + ], + "weighted_loads": [ + 1.633253950625658, + 0.9766918178647757, + 1.703788448125124, + 0.8787069311365485, + 0.23375625722110271, + 1.0798600912094116, + 0.26771787367761135, + 5.609464213252068, + 0.7450059819966555, + 2.0201016031205654, + 1.0102419964969158, + 0.07780095189809799, + 0.18558267503976822, + 0.14795821346342564, + 0.29859787225723267, + 0.07714224979281425, + 0.15047954954206944, + 0.10503869131207466, + 0.13470672070980072, + 0.6732100695371628, + 0.722059290856123, + 0.9274044632911682, + 0.4577925205230713, + 0.34165786392986774, + 1.1532111037522554, + 0.41463487409055233, + 0.030278515070676804, + 0.03977537527680397, + 0.30512121692299843, + 0.299177348613739, + 0.22899974696338177, + 0.4913244564086199, + 0.6859939526766539, + 0.45697420462965965, + 0.09775490686297417, + 0.30353947170078754, + 0.44771661795675755, + 0.1349076647311449, + 0.11869773268699646, + 1.2213766239583492, + 0.5576690882444382, + 0.4980071596801281, + 0.8348285742104053, + 0.034442681819200516, + 1.3363624140620232, + 0.039809487760066986, + 0.6405660733580589, + 0.774220772087574, + 0.2650468721985817, + 0.20231520384550095, + 0.8168023340404034, + 0.5600169524550438, + 0.8824453577399254, + 0.367268580943346, + 0.6933870613574982, + 1.4724149256944656, + 0.12086621299386024, + 0.9223842583596706, + 0.26196344941854477, + 0.05939066410064697, + 1.4689104333519936, + 1.1548546180129051, + 1.2811734471470118, + 0.6359860692173243 + ], + "unique_experts": 64, + "load_cv": 0.7159557197149784, + "normalized_load_entropy": 0.9347544744233821, + "max_load_share": 0.03888888888888889 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "b3e54f3ec1979c48fabb2da98172b53b94e45e8609169409c4cdc08124531b30", + "route_weight_sha256": "a249b6e7c91a7b0dde69766ef7f9cf4c35c916e52e0d5370382b881e90dc68a8", + "loads": [ + 28, + 29, + 15, + 21, + 6, + 29, + 15, + 13, + 36, + 36, + 19, + 6, + 6, + 6, + 9, + 6, + 6, + 5, + 3, + 13, + 19, + 29, + 12, + 6, + 28, + 11, + 1, + 2, + 5, + 8, + 7, + 13, + 21, + 22, + 12, + 13, + 10, + 6, + 1, + 22, + 17, + 8, + 26, + 3, + 25, + 2, + 12, + 21, + 9, + 7, + 30, + 9, + 25, + 14, + 14, + 49, + 6, + 19, + 6, + 1, + 34, + 33, + 23, + 18 + ], + "weighted_loads": [ + 1.7579113272950053, + 1.4339082520455122, + 1.703788448125124, + 2.179830997250974, + 0.23375625722110271, + 1.1212577866390347, + 0.578956538811326, + 5.651430927217007, + 2.490846026688814, + 2.522112900391221, + 1.0102419964969158, + 0.3627920188009739, + 0.3255337290465832, + 0.14795821346342564, + 0.9881802313029766, + 0.31189725548028946, + 0.2940442990511656, + 0.155217494815588, + 0.17430543527007103, + 0.6732100695371628, + 0.8143410906195641, + 2.0242259204387665, + 0.5003524497151375, + 0.34165786392986774, + 1.1532111037522554, + 0.4401141945272684, + 0.030278515070676804, + 0.07497569546103477, + 0.38870249316096306, + 0.299177348613739, + 0.2595936395227909, + 0.4913244564086199, + 0.737133489921689, + 0.8941298257559538, + 0.44730069860816, + 0.5388730447739363, + 0.5368636380881071, + 0.21201266162097454, + 0.11869773268699646, + 1.26167843490839, + 1.2677606549113989, + 0.5234093703329563, + 1.2306195944547653, + 0.1691088303923607, + 1.3363624140620232, + 0.06866776756942272, + 0.6741889081895351, + 0.8422820270061493, + 0.3980107344686985, + 0.7460448145866394, + 1.3439731057733297, + 0.7609272710978985, + 1.545762587338686, + 0.5267211049795151, + 0.6933870613574982, + 3.59194243978709, + 0.33560964092612267, + 0.947398329153657, + 0.30354972183704376, + 0.05939066410064697, + 3.4875095449388027, + 1.7400882579386234, + 1.2811734471470118, + 0.867496682330966 + ], + "unique_experts": 64, + "load_cv": 0.7012217885290972, + "normalized_load_entropy": 0.940914927970558, + "max_load_share": 0.050724637681159424 + } + }, + "s0_period": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "67720dee16ed6b74e77bc03bc129ddb397432425b964dd7c6b0ba503e897b2a7", + "route_weight_sha256": "161d8bc8ce1b36a62eb5e85a0cc8a724e0e3d7c8f2bf30ecd5ff71ad09cb6d0e", + "loads": [ + 26, + 23, + 15, + 7, + 7, + 32, + 8, + 12, + 13, + 29, + 12, + 0, + 3, + 4, + 7, + 6, + 2, + 6, + 4, + 13, + 15, + 15, + 13, + 6, + 27, + 12, + 2, + 2, + 4, + 7, + 6, + 9, + 17, + 7, + 6, + 10, + 8, + 3, + 2, + 19, + 6, + 8, + 19, + 1, + 27, + 1, + 13, + 17, + 8, + 4, + 21, + 6, + 21, + 9, + 17, + 25, + 3, + 18, + 4, + 1, + 19, + 17, + 22, + 14 + ], + "weighted_loads": [ + 1.907699246890843, + 0.9901620931923389, + 1.7492233850061893, + 0.6011363686993718, + 0.304840125143528, + 1.290679568424821, + 0.2270790608599782, + 5.642690345644951, + 0.7476437427103519, + 2.2170391343533993, + 0.5920483022928238, + 0.0, + 0.18217310681939125, + 0.10304254293441772, + 0.3969898670911789, + 0.2086073886603117, + 0.11627895385026932, + 0.21501954644918442, + 0.20491093583405018, + 0.6205753572285175, + 0.6111704632639885, + 0.9754838030785322, + 0.5413974262773991, + 0.3335623685270548, + 1.152251273393631, + 0.5022810287773609, + 0.06811794638633728, + 0.07207301445305347, + 0.3109716475009918, + 0.2589985094964504, + 0.2202459815889597, + 0.3710343539714813, + 0.5857629384845495, + 0.3987897112965584, + 0.1198923708871007, + 0.359412869438529, + 0.47089165076613426, + 0.10550027713179588, + 0.1547929346561432, + 1.2588638290762901, + 0.6379048824310303, + 0.5919395610690117, + 0.8025805354118347, + 0.03382329270243645, + 1.332966785877943, + 0.044825706630945206, + 0.7049157284200191, + 0.6708156112581491, + 0.35555864684283733, + 0.16727210581302643, + 0.862095127813518, + 0.5776780657470226, + 1.0010189805179834, + 0.34028773941099644, + 0.7621264439076185, + 1.580834649503231, + 0.1655469425022602, + 0.8690008446574211, + 0.25420546904206276, + 0.06038971617817879, + 1.584321979433298, + 0.9433891512453556, + 1.3080258443951607, + 0.7110146954655647 + ], + "unique_experts": 63, + "load_cv": 0.7116317538491518, + "normalized_load_entropy": 0.9376049241315684, + "max_load_share": 0.044444444444444446 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "1720e2c5b7c69804926505ec489aeb44800567315381a643b1bcdd2f65816142", + "route_weight_sha256": "58cdbd27a5bfc8b6d0b79851ae7de2965f7815edb6905596edfd2bf40506a740", + "loads": [ + 30, + 24, + 17, + 15, + 7, + 33, + 11, + 12, + 27, + 34, + 12, + 1, + 3, + 4, + 12, + 6, + 2, + 8, + 4, + 13, + 16, + 24, + 14, + 6, + 27, + 13, + 2, + 6, + 4, + 8, + 7, + 9, + 19, + 15, + 7, + 12, + 8, + 6, + 2, + 20, + 11, + 9, + 24, + 1, + 27, + 2, + 14, + 17, + 11, + 5, + 25, + 6, + 23, + 12, + 17, + 39, + 6, + 19, + 4, + 1, + 29, + 25, + 22, + 21 + ], + "weighted_loads": [ + 2.0789607390761375, + 1.0899586118757725, + 1.8279720433056355, + 1.5877700643613935, + 0.304840125143528, + 1.3032752508297563, + 0.4359157057479024, + 5.642690345644951, + 1.9306433461606503, + 2.406776634976268, + 0.5920483022928238, + 0.012455414980649948, + 0.18217310681939125, + 0.10304254293441772, + 1.2228024564683437, + 0.2086073886603117, + 0.11627895385026932, + 0.2880645450204611, + 0.20491093583405018, + 0.6205753572285175, + 0.6561925150454044, + 1.6062770634889603, + 0.5716657694429159, + 0.3335623685270548, + 1.152251273393631, + 0.5284113027155399, + 0.06811794638633728, + 0.21288179233670235, + 0.3109716475009918, + 0.3111995607614517, + 0.24768861941993237, + 0.3710343539714813, + 0.6544422898441553, + 0.6896114181727171, + 0.17774284724146128, + 0.4626281838864088, + 0.47089165076613426, + 0.22473962418735027, + 0.1547929346561432, + 1.2921058349311352, + 0.9293925985693932, + 0.6826853379607201, + 1.0608110129833221, + 0.03382329270243645, + 1.332966785877943, + 0.07235908694565296, + 0.7464016415178776, + 0.6708156112581491, + 0.4858450461179018, + 0.29333917796611786, + 1.1203818013891578, + 0.5776780657470226, + 1.1425481047481298, + 0.4642688874155283, + 0.7621264439076185, + 2.836274075321853, + 0.29357218742370605, + 0.894657950848341, + 0.25420546904206276, + 0.06038971617817879, + 2.8615515306591988, + 1.2245968263596296, + 1.3080258443951607, + 0.9906086660921574 + ], + "unique_experts": 64, + "load_cv": 0.6906621001690016, + "normalized_load_entropy": 0.9411679748894536, + "max_load_share": 0.04482758620689655 + } + }, + "s1_period": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "2970851f83c5dace1d8fda283c90febde16eb53392bd2f7f2daa782138678ba8", + "route_weight_sha256": "614374e91d821233f2d02266c1f0092c18c5a3087035b0b0b2b5f567ea7e989f", + "loads": [ + 27, + 25, + 15, + 9, + 5, + 29, + 11, + 12, + 13, + 27, + 19, + 2, + 3, + 5, + 7, + 6, + 3, + 2, + 2, + 13, + 20, + 15, + 10, + 5, + 21, + 8, + 2, + 1, + 4, + 8, + 7, + 9, + 22, + 12, + 5, + 10, + 8, + 2, + 1, + 21, + 6, + 8, + 18, + 1, + 26, + 2, + 12, + 16, + 7, + 4, + 19, + 6, + 17, + 8, + 14, + 26, + 2, + 20, + 5, + 1, + 20, + 20, + 22, + 14 + ], + "weighted_loads": [ + 1.771950414404273, + 1.0018381085246801, + 1.7177833952009678, + 0.8387283021584153, + 0.2045576386153698, + 1.1557584200054407, + 0.3038461431860924, + 5.574414491653442, + 0.7571427412331104, + 2.0605285447090864, + 0.9784633107483387, + 0.07611711695790291, + 0.18351490795612335, + 0.12901155278086662, + 0.37828391045331955, + 0.20149506069719791, + 0.1493167132139206, + 0.07308686152100563, + 0.13489718735218048, + 0.6764161083847284, + 0.804794292896986, + 0.88597715459764, + 0.42556451819837093, + 0.30491912737488747, + 0.904109351336956, + 0.33917966298758984, + 0.06694747135043144, + 0.04333816468715668, + 0.29365457966923714, + 0.3019944652915001, + 0.2603035606443882, + 0.38266751170158386, + 0.7539272233843803, + 0.5597573108971119, + 0.11784985568374395, + 0.35764562524855137, + 0.43935476429760456, + 0.0717349573969841, + 0.11182703077793121, + 1.2551644407212734, + 0.5646402351558208, + 0.5611907504498959, + 0.746892623603344, + 0.034652553498744965, + 1.3775906506925821, + 0.07606035098433495, + 0.6599593386054039, + 0.6875537671148777, + 0.30199497379362583, + 0.19145645573735237, + 0.8293337412178516, + 0.5557533353567123, + 0.8141961395740509, + 0.3162016347050667, + 0.6668417528271675, + 1.5050502717494965, + 0.12393783777952194, + 1.0003029461950064, + 0.2755659408867359, + 0.05947372317314148, + 1.5454185158014297, + 1.138111725449562, + 1.2328860871493816, + 0.6695971824228764 + ], + "unique_experts": 64, + "load_cv": 0.7109374788020618, + "normalized_load_entropy": 0.9365464807924545, + "max_load_share": 0.04027777777777778 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "2bd141dea19047c43866de82cd85ca48127bd36cde4e7f629b23a06d1a8698c3", + "route_weight_sha256": "32277d65137ff2ecc33a8b0eb2949ae5e3027621be4cfa9215e3ef84e8f48eb0", + "loads": [ + 29, + 30, + 15, + 19, + 5, + 30, + 15, + 13, + 34, + 36, + 19, + 6, + 6, + 5, + 11, + 10, + 6, + 4, + 3, + 13, + 22, + 29, + 11, + 5, + 21, + 9, + 2, + 3, + 5, + 8, + 9, + 9, + 23, + 25, + 13, + 15, + 10, + 3, + 1, + 24, + 19, + 9, + 23, + 3, + 26, + 2, + 13, + 18, + 10, + 7, + 31, + 9, + 23, + 12, + 14, + 50, + 6, + 21, + 6, + 1, + 36, + 31, + 22, + 18 + ], + "weighted_loads": [ + 1.8966077910736203, + 1.4590545427054167, + 1.7177833952009678, + 2.08908408973366, + 0.2045576386153698, + 1.168354102410376, + 0.5756029970943928, + 5.6163812056183815, + 2.482890360057354, + 2.5174515657126904, + 0.9784633107483387, + 0.3611081838607788, + 0.3234659619629383, + 0.12901155278086662, + 1.0785360410809517, + 0.4362500663846731, + 0.29288146272301674, + 0.12326566502451897, + 0.1744959019124508, + 0.6764161083847284, + 0.8969328589737415, + 1.968042304739356, + 0.4681244473904371, + 0.30491912737488747, + 0.904109351336956, + 0.3646589834243059, + 0.06694747135043144, + 0.10646318085491657, + 0.37723585590720177, + 0.3019944652915001, + 0.32397546619176865, + 0.38266751170158386, + 0.8050667606294155, + 1.0354389417916536, + 0.4673956474289298, + 0.5804591868072748, + 0.5285017844289541, + 0.10327690094709396, + 0.11182703077793121, + 1.39942841604352, + 1.3530142400413752, + 0.5865929611027241, + 1.1299682669341564, + 0.16931870207190514, + 1.3775906506925821, + 0.07606035098433495, + 0.6935821734368801, + 0.755615022033453, + 0.43882456235587597, + 0.6889628991484642, + 1.4303172286599874, + 0.756663653999567, + 1.4791649840772152, + 0.48691602796316147, + 0.6668417528271675, + 3.5237763775512576, + 0.33868126571178436, + 1.0253170169889927, + 0.3171522133052349, + 0.05947372317314148, + 3.6226841583848, + 1.6022134944796562, + 1.2328860871493816, + 0.8720097951591015 + ], + "unique_experts": 64, + "load_cv": 0.7031752093843299, + "normalized_load_entropy": 0.9408146531054118, + "max_load_share": 0.051759834368530024 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 120, + "ordered_topk_exact_tokens": 43, + "set_exact_tokens": 54, + "mean_set_jaccard": 0.8196428571428572, + "mean_token_weighted_tv": 0.035746852424927054, + "aggregate_load_tv": 0.054166666666666675 + }, + "system_bos": { + "tokens": 120, + "ordered_topk_exact_tokens": 35, + "set_exact_tokens": 51, + "mean_set_jaccard": 0.8047619047619049, + "mean_token_weighted_tv": 0.03801758057864693, + "aggregate_load_tv": 0.05833333333333333 + }, + "system_x": { + "tokens": 120, + "ordered_topk_exact_tokens": 21, + "set_exact_tokens": 36, + "mean_set_jaccard": 0.7565476190476191, + "mean_token_weighted_tv": 0.05094404101837426, + "aggregate_load_tv": 0.06527777777777778 + }, + "system_period": { + "tokens": 120, + "ordered_topk_exact_tokens": 25, + "set_exact_tokens": 36, + "mean_set_jaccard": 0.7597222222222224, + "mean_token_weighted_tv": 0.049043054944680385, + "aggregate_load_tv": 0.06527777777777778 + }, + "bos_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 32, + "set_exact_tokens": 47, + "mean_set_jaccard": 0.7912698412698413, + "mean_token_weighted_tv": 0.041596885663845264, + "aggregate_load_tv": 0.0611111111111111 + }, + "bos_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 30, + "set_exact_tokens": 47, + "mean_set_jaccard": 0.7880952380952382, + "mean_token_weighted_tv": 0.042450771162596844, + "aggregate_load_tv": 0.043055555555555555 + }, + "x_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 29, + "set_exact_tokens": 38, + "mean_set_jaccard": 0.7570238095238097, + "mean_token_weighted_tv": 0.04781413384480402, + "aggregate_load_tv": 0.06527777777777777 + }, + "x_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 21, + "set_exact_tokens": 37, + "mean_set_jaccard": 0.7549603174603176, + "mean_token_weighted_tv": 0.04971237146528438, + "aggregate_load_tv": 0.0763888888888889 + }, + "period_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 27, + "set_exact_tokens": 41, + "mean_set_jaccard": 0.7742063492063492, + "mean_token_weighted_tv": 0.0445534309411111, + "aggregate_load_tv": 0.06666666666666665 + }, + "period_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 22, + "set_exact_tokens": 37, + "mean_set_jaccard": 0.7486904761904764, + "mean_token_weighted_tv": 0.05143738678501298, + "aggregate_load_tv": 0.06944444444444445 + } + } + }, + "layer_23": { + "layer": 23, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "c023a32aa622513601fb17e39d42decdbdf95265ccffde6f43c03bf1c71ee0d7", + "route_weight_sha256": "997d2bf1d5d3dba41a73b84a3267a725695e577082caa15113324e6c53e8b18d", + "loads": [ + 17, + 4, + 22, + 6, + 19, + 9, + 20, + 12, + 17, + 9, + 7, + 1, + 16, + 6, + 11, + 17, + 17, + 2, + 3, + 6, + 12, + 15, + 3, + 23, + 10, + 25, + 21, + 7, + 2, + 1, + 12, + 2, + 7, + 8, + 16, + 15, + 13, + 3, + 9, + 14, + 10, + 2, + 32, + 7, + 1, + 6, + 14, + 13, + 7, + 16, + 3, + 3, + 6, + 7, + 11, + 15, + 18, + 26, + 5, + 15, + 26, + 4, + 24, + 10 + ], + "weighted_loads": [ + 0.7384043950587511, + 0.2755243293941021, + 0.7642805930227041, + 0.32818448543548584, + 0.7015974968671799, + 0.32948339357972145, + 1.0029281824827194, + 0.44422322139143944, + 0.7682785354554653, + 0.32825144566595554, + 0.5205785557627678, + 0.036239344626665115, + 0.8654272090643644, + 0.26364110596477985, + 0.5502388663589954, + 0.921227253973484, + 1.1012737825512886, + 0.16136287152767181, + 0.15995200723409653, + 0.43903998285532, + 0.6521309539675713, + 0.7757537178695202, + 0.1196201890707016, + 1.4664957839995623, + 0.36325121857225895, + 1.5471114721149206, + 1.552532272413373, + 0.37235964462161064, + 0.10664858669042587, + 0.08059599250555038, + 0.48602514155209064, + 0.06989680975675583, + 0.26266160793602467, + 0.30637555941939354, + 0.8733462374657393, + 1.2866562120616436, + 0.8174042738974094, + 0.09946686960756779, + 0.5110421609133482, + 0.5382878948003054, + 0.5489721912890673, + 0.1322832852602005, + 1.3243395872414112, + 0.43965838104486465, + 0.039839569479227066, + 0.2650163471698761, + 0.7178998664021492, + 1.0812446661293507, + 0.3473163805902004, + 0.6254512518644333, + 0.10710152238607407, + 0.14036141708493233, + 0.3082043547183275, + 0.2678673844784498, + 0.5917889848351479, + 0.8410633392632008, + 1.1142601147294044, + 1.3688580207526684, + 0.16875016130506992, + 0.9721879698336124, + 1.4355716649442911, + 0.25530487671494484, + 1.2684126291424036, + 0.3685532286763191 + ], + "unique_experts": 64, + "load_cv": 0.6522515609528521, + "normalized_load_entropy": 0.9468860730115419, + "max_load_share": 0.044444444444444446 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "3a342a36d4b81f38a6fab17b1e8c5d10d0b09f361829a214cdb3ce742ee593fd", + "route_weight_sha256": "0355ade6db3659f536cc503b32c2fc36c3ed85600a3bea47ac28a1f0daeeb244", + "loads": [ + 24, + 7, + 22, + 14, + 24, + 12, + 26, + 20, + 18, + 17, + 7, + 2, + 17, + 11, + 13, + 17, + 20, + 2, + 3, + 6, + 12, + 15, + 4, + 33, + 14, + 25, + 23, + 7, + 2, + 1, + 12, + 2, + 8, + 13, + 17, + 15, + 14, + 3, + 13, + 14, + 16, + 2, + 35, + 7, + 1, + 13, + 25, + 16, + 8, + 16, + 3, + 4, + 6, + 7, + 21, + 17, + 18, + 37, + 7, + 15, + 26, + 4, + 26, + 11 + ], + "weighted_loads": [ + 1.0027367761358619, + 0.45044103264808655, + 0.7642805930227041, + 0.5619729883037508, + 0.8923914954066277, + 0.4379913965240121, + 1.3725302331149578, + 0.805728867650032, + 0.7690218309289776, + 0.6022565346211195, + 0.5205785557627678, + 0.08391738310456276, + 0.8756288634613156, + 0.46995118632912636, + 0.6618057861924171, + 0.921227253973484, + 1.1529568149708211, + 0.16136287152767181, + 0.15995200723409653, + 0.43903998285532, + 0.6521309539675713, + 0.7757537178695202, + 0.1382133588194847, + 2.7419723253697157, + 0.5202882308512926, + 1.5471114721149206, + 1.6167619656771421, + 0.37235964462161064, + 0.10664858669042587, + 0.08059599250555038, + 0.48602514155209064, + 0.06989680975675583, + 0.3214873056858778, + 0.572055455762893, + 0.923036115244031, + 1.2866562120616436, + 0.8603208735585213, + 0.09946686960756779, + 0.6883519804105163, + 0.5382878948003054, + 0.8770379032939672, + 0.1322832852602005, + 1.4061710927635431, + 0.43965838104486465, + 0.039839569479227066, + 2.3316221572458744, + 1.675454143434763, + 1.1446685721166432, + 0.3879333920776844, + 0.6254512518644333, + 0.10710152238607407, + 0.22899114713072777, + 0.3082043547183275, + 0.2678673844784498, + 1.5047454163432121, + 0.941463690251112, + 1.1142601147294044, + 2.285506993532181, + 0.28602071292698383, + 0.9721879698336124, + 1.4355716649442911, + 0.25530487671494484, + 1.3448568508028984, + 0.40107231959700584 + ], + "unique_experts": 64, + "load_cv": 0.6371715474832368, + "normalized_load_entropy": 0.9481173095501905, + "max_load_share": 0.04252873563218391 + } + }, + "s1_eos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "bba88b0710c86a2c73d22598836f7cea5803b418059bbcfaadcd1fdc6928ae63", + "route_weight_sha256": "c5c13612f01ed7ad6f0b7f1fd356f0d8ff7e7993e684d10871b299477998c060", + "loads": [ + 16, + 2, + 22, + 8, + 15, + 7, + 18, + 13, + 21, + 9, + 8, + 2, + 14, + 6, + 12, + 16, + 17, + 3, + 3, + 5, + 12, + 16, + 3, + 21, + 11, + 25, + 24, + 7, + 2, + 1, + 10, + 1, + 5, + 9, + 17, + 15, + 11, + 3, + 8, + 13, + 11, + 2, + 35, + 7, + 1, + 6, + 14, + 14, + 7, + 13, + 3, + 3, + 6, + 7, + 12, + 15, + 16, + 28, + 6, + 17, + 26, + 3, + 25, + 12 + ], + "weighted_loads": [ + 0.661612406373024, + 0.19257675111293793, + 0.7943404652178288, + 0.43321456760168076, + 0.6266490668058395, + 0.2819466982036829, + 0.8669514320790768, + 0.4668295830488205, + 0.9371469095349312, + 0.3569979500025511, + 0.5508734304457903, + 0.06625356338918209, + 0.7839144635945559, + 0.24716544523835182, + 0.5592659935355186, + 0.8163853008300066, + 1.145180445164442, + 0.18221045657992363, + 0.16217806190252304, + 0.38817932084202766, + 0.6318408884108067, + 0.8377002850174904, + 0.12451490387320518, + 1.4254644885659218, + 0.4024698380380869, + 1.4580472186207771, + 1.687473712489009, + 0.3734753802418709, + 0.10026156529784203, + 0.07716134935617447, + 0.4080226216465235, + 0.029745975509285927, + 0.19495001807808876, + 0.344910629093647, + 0.9236686863005161, + 1.2876485772430897, + 0.7589442543685436, + 0.10447924211621284, + 0.4676462151110172, + 0.5145264808088541, + 0.6015326976776123, + 0.12921157106757164, + 1.4205808211117983, + 0.602719122543931, + 0.04354534298181534, + 0.26470979303121567, + 0.7426222618669271, + 1.0982449762523174, + 0.3243293557316065, + 0.5305959694087505, + 0.09329713135957718, + 0.12367813102900982, + 0.30469105392694473, + 0.2554008327424526, + 0.6321721356362104, + 0.8138282410800457, + 1.0725081712007523, + 1.4496763814240694, + 0.2017634529620409, + 1.0584610626101494, + 1.4185923747718334, + 0.22454482316970825, + 1.3629274982959032, + 0.4204989057034254 + ], + "unique_experts": 64, + "load_cv": 0.6736669507210719, + "normalized_load_entropy": 0.9444681571199957, + "max_load_share": 0.04861111111111111 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "946f8aa62d879a307907a86d44153161c6216265f2b15bfbc714e6a7fa366c23", + "route_weight_sha256": "bd9df455f92abece59418493eef9aed560875426c8dd7cc6c5cc2634bb89e1d7", + "loads": [ + 21, + 7, + 28, + 17, + 20, + 9, + 31, + 22, + 23, + 13, + 10, + 3, + 15, + 11, + 14, + 19, + 20, + 4, + 5, + 5, + 13, + 17, + 4, + 36, + 13, + 25, + 27, + 7, + 2, + 2, + 10, + 1, + 6, + 21, + 17, + 15, + 17, + 4, + 15, + 13, + 19, + 2, + 38, + 7, + 3, + 16, + 30, + 18, + 13, + 16, + 5, + 13, + 12, + 9, + 22, + 16, + 16, + 45, + 9, + 17, + 27, + 4, + 31, + 16 + ], + "weighted_loads": [ + 0.9466178589500487, + 0.5123811215162277, + 1.1101010330021381, + 0.9285688539966941, + 0.8404342792928219, + 0.3378199292346835, + 1.5874385833740234, + 0.8268598262220621, + 0.9731570490403101, + 0.5095068756490946, + 0.6414698977023363, + 0.10367034189403057, + 0.7941056881099939, + 0.45712602883577347, + 0.6940943971276283, + 0.9371944516897202, + 1.190589024219662, + 0.24155034497380257, + 0.253859993070364, + 0.38817932084202766, + 0.6797478124499321, + 0.864290326833725, + 0.14295715652406216, + 3.2970971390604973, + 0.47869825176894665, + 1.4580472186207771, + 1.7730115409940481, + 0.3734753802418709, + 0.10026156529784203, + 0.12170877680182457, + 0.4080226216465235, + 0.029745975509285927, + 0.2389032170176506, + 1.0276970349950716, + 0.9236686863005161, + 1.2876485772430897, + 1.194335613399744, + 0.15368784591555595, + 0.883300045505166, + 0.5145264808088541, + 1.0046814121305943, + 0.12921157106757164, + 1.5032601114362478, + 0.602719122543931, + 0.1457182765007019, + 2.432691091671586, + 2.3594151716679335, + 1.3239233228377998, + 0.5865813083946705, + 0.6825237050652504, + 0.14931166544556618, + 0.734704039990902, + 0.9455376975238323, + 0.3256612438708544, + 1.5975440870970488, + 0.8457502983510494, + 1.0725081712007523, + 2.971686292439699, + 0.3702148888260126, + 1.0584610626101494, + 1.4664329662919044, + 0.3498573899269104, + 1.586720198392868, + 0.5886362697929144 + ], + "unique_experts": 64, + "load_cv": 0.6290419328166346, + "normalized_load_entropy": 0.9515284120411177, + "max_load_share": 0.046583850931677016 + } + }, + "s0_bos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "13c474a16086eee318146472d5811c1a33ddee4bb088a8768ce185fc2a19f8d7", + "route_weight_sha256": "41d51af2a542585f40bb0749aded49d1b457284ef78ff761277263bb12320233", + "loads": [ + 18, + 3, + 19, + 7, + 16, + 7, + 18, + 12, + 15, + 9, + 7, + 2, + 17, + 6, + 12, + 17, + 17, + 3, + 3, + 6, + 13, + 16, + 3, + 23, + 12, + 23, + 23, + 7, + 2, + 1, + 11, + 2, + 5, + 11, + 14, + 15, + 13, + 4, + 8, + 12, + 10, + 2, + 35, + 7, + 0, + 7, + 14, + 14, + 9, + 12, + 2, + 6, + 5, + 9, + 11, + 17, + 17, + 28, + 5, + 15, + 24, + 3, + 29, + 7 + ], + "weighted_loads": [ + 0.8306028228253126, + 0.23616166785359383, + 0.7016364745795727, + 0.334117591381073, + 0.6380676496773958, + 0.28934963792562485, + 0.9144604057073593, + 0.4167201705276966, + 0.6942153088748455, + 0.3336369227617979, + 0.5103509835898876, + 0.06340599991381168, + 0.8280005566775799, + 0.2807601522654295, + 0.6265512965619564, + 0.9420688487589359, + 1.0951045155525208, + 0.19719223119318485, + 0.15900758653879166, + 0.4085419811308384, + 0.6998424492776394, + 0.8079551383852959, + 0.13583922758698463, + 1.4565815441310406, + 0.4375512842088938, + 1.4863121509552002, + 1.7218569368124008, + 0.3877392113208771, + 0.10805801302194595, + 0.08075913786888123, + 0.4214745834469795, + 0.07125252112746239, + 0.19291538931429386, + 0.4129231162369251, + 0.7693169191479683, + 1.3402869291603565, + 0.7796790711581707, + 0.14396314695477486, + 0.4795279800891876, + 0.46007897704839706, + 0.5640841294080019, + 0.1345558799803257, + 1.4277146700769663, + 0.6596846356987953, + 0.0, + 0.28963906690478325, + 0.7286654375493526, + 1.091480027884245, + 0.4174185059964657, + 0.49824579432606697, + 0.06852046214044094, + 0.2915830686688423, + 0.28103166818618774, + 0.35297943092882633, + 0.6002304684370756, + 0.9190201070159674, + 1.052500793710351, + 1.5266165845096111, + 0.16822911240160465, + 0.9622161909937859, + 1.3169124200940132, + 0.22534094378352165, + 1.5586444642394781, + 0.2466187383979559 + ], + "unique_experts": 63, + "load_cv": 0.6646265079439192, + "normalized_load_entropy": 0.9458345039385624, + "max_load_share": 0.04861111111111111 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "9f0a6ad2c41e2632e9a70b2aff1f997c9558e2d955757c2577082829c32f3439", + "route_weight_sha256": "ee6d45dd4e91335b9003854276b51c5229797509c6ea5bf248ea68928838837d", + "loads": [ + 23, + 6, + 19, + 14, + 22, + 10, + 24, + 20, + 15, + 16, + 7, + 2, + 19, + 11, + 13, + 17, + 20, + 3, + 3, + 7, + 13, + 16, + 4, + 34, + 16, + 23, + 25, + 7, + 2, + 1, + 11, + 2, + 6, + 14, + 14, + 15, + 13, + 5, + 11, + 12, + 16, + 2, + 39, + 8, + 0, + 13, + 25, + 16, + 10, + 13, + 3, + 7, + 5, + 9, + 21, + 20, + 17, + 40, + 8, + 16, + 24, + 3, + 31, + 9 + ], + "weighted_loads": [ + 1.022060323972255, + 0.4110783711075783, + 0.7016364745795727, + 0.5643538357689977, + 0.8968889396637678, + 0.4144693473353982, + 1.291139394044876, + 0.7474388964474201, + 0.6942153088748455, + 0.5716178100556135, + 0.5103509835898876, + 0.06340599991381168, + 0.8727703867480159, + 0.487070232629776, + 0.7000061683356762, + 0.9420688487589359, + 1.1467875479720533, + 0.19719223119318485, + 0.15900758653879166, + 0.5598841793835163, + 0.6998424492776394, + 0.8079551383852959, + 0.15443239733576775, + 2.8436797596514225, + 0.5959342289716005, + 1.4863121509552002, + 1.8911142107099295, + 0.3877392113208771, + 0.10805801302194595, + 0.08075913786888123, + 0.4214745834469795, + 0.07125252112746239, + 0.251741087064147, + 0.6526113115251064, + 0.7693169191479683, + 1.3402869291603565, + 0.7796790711581707, + 0.18427904695272446, + 0.6320331068709493, + 0.46007897704839706, + 0.8953715991228819, + 0.1345558799803257, + 1.5385187454521656, + 0.7221248783171177, + 0.0, + 1.3676328882575035, + 1.6862197145819664, + 1.1510894242674112, + 0.45803551748394966, + 0.5463537126779556, + 0.1209405567497015, + 0.38021279871463776, + 0.28103166818618774, + 0.35297943092882633, + 1.5131868999451399, + 1.0629117656499147, + 1.052500793710351, + 2.475531667470932, + 0.3447964619845152, + 1.193751759827137, + 1.3169124200940132, + 0.22534094378352165, + 1.635088685899973, + 0.32371368072927 + ], + "unique_experts": 63, + "load_cv": 0.6566468587502868, + "normalized_load_entropy": 0.9466050636365481, + "max_load_share": 0.04597701149425287 + } + }, + "s1_bos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "3bbd3c9f38619f496cabe52c107e1cee6260807ac04613f1655a53ea09a62c1f", + "route_weight_sha256": "4a5feb13527c3c7d95d0474ab69841c70caba4af3bf023511738f89becfb9255", + "loads": [ + 18, + 4, + 16, + 6, + 17, + 8, + 17, + 13, + 18, + 10, + 5, + 2, + 16, + 5, + 13, + 17, + 17, + 2, + 3, + 6, + 13, + 15, + 4, + 22, + 12, + 25, + 22, + 7, + 2, + 1, + 8, + 2, + 5, + 10, + 17, + 15, + 11, + 3, + 10, + 13, + 9, + 2, + 31, + 8, + 1, + 6, + 17, + 14, + 8, + 12, + 3, + 5, + 5, + 11, + 11, + 15, + 20, + 26, + 5, + 16, + 24, + 4, + 28, + 9 + ], + "weighted_loads": [ + 0.8446186576038599, + 0.2771543636918068, + 0.6206329353153706, + 0.335997574031353, + 0.6601006742566824, + 0.3203671332448721, + 0.8360632248222828, + 0.4591081514954567, + 0.7801102977246046, + 0.3793532978743315, + 0.435747642070055, + 0.06566832773387432, + 0.805124906823039, + 0.2200267519801855, + 0.6654207054525614, + 0.923811998218298, + 1.0593435540795326, + 0.16827255487442017, + 0.16358067840337753, + 0.44290560856461525, + 0.7017085291445255, + 0.8226659558713436, + 0.15115612745285034, + 1.451800711452961, + 0.42731352150440216, + 1.530204314738512, + 1.6796322725713253, + 0.3887288346886635, + 0.10564857348799706, + 0.0797778069972992, + 0.3359788488596678, + 0.053245995193719864, + 0.20647466368973255, + 0.3871210925281048, + 0.8829614818096161, + 1.304520409554243, + 0.6963523477315903, + 0.10134664736688137, + 0.5537883825600147, + 0.5033405125141144, + 0.5162679962813854, + 0.13573650270700455, + 1.310143131762743, + 0.7269675824791193, + 0.03554921597242355, + 0.25728829950094223, + 0.8355093970894814, + 1.1077583953738213, + 0.38027341663837433, + 0.5089378710836172, + 0.09928002581000328, + 0.20480993762612343, + 0.28808508068323135, + 0.4176630303263664, + 0.6208114698529243, + 0.8528812155127525, + 1.2675544526427984, + 1.3819246403872967, + 0.17284101620316505, + 1.1512105204164982, + 1.377974335104227, + 0.25755305401980877, + 1.5262236557900906, + 0.31942187063395977 + ], + "unique_experts": 64, + "load_cv": 0.6440611887195306, + "normalized_load_entropy": 0.9484613757701913, + "max_load_share": 0.043055555555555555 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "e36ee2777006ae2cb412a7d6a3acb9089198a42e9563e5f4c4aa9ed3834a984d", + "route_weight_sha256": "bbc9d9633ce89bddb0a92a8b0ed7c0e7e0b60324ab5389c4d27a70e7015f2527", + "loads": [ + 22, + 9, + 22, + 15, + 24, + 10, + 29, + 22, + 19, + 14, + 7, + 3, + 17, + 10, + 14, + 20, + 20, + 3, + 5, + 6, + 14, + 16, + 6, + 38, + 15, + 25, + 25, + 7, + 2, + 2, + 9, + 2, + 6, + 20, + 17, + 15, + 17, + 5, + 16, + 13, + 18, + 2, + 33, + 8, + 3, + 13, + 33, + 17, + 14, + 16, + 5, + 15, + 11, + 14, + 21, + 18, + 20, + 44, + 7, + 16, + 25, + 5, + 34, + 13 + ], + "weighted_loads": [ + 1.1392181483097374, + 0.5969587340950966, + 0.93639350309968, + 0.8556766612455249, + 0.9966012481600046, + 0.38960336428135633, + 1.5212888158857822, + 0.8187429308891296, + 0.8153978902846575, + 0.5394760947674513, + 0.526344109326601, + 0.11671248264610767, + 0.8153161313384771, + 0.42998733557760715, + 0.7633664105087519, + 1.0446211490780115, + 1.1047521331347525, + 0.2276124432682991, + 0.2552626095712185, + 0.44290560856461525, + 0.749615453183651, + 0.8492559976875782, + 0.2180441301316023, + 3.398906622081995, + 0.5514323152601719, + 1.530204314738512, + 1.7702715918421745, + 0.3887288346886635, + 0.10564857348799706, + 0.1243252344429493, + 0.3855013195425272, + 0.053245995193719864, + 0.2504278626292944, + 1.0137685891240835, + 0.8829614818096161, + 1.304520409554243, + 1.1317437067627907, + 0.19939696602523327, + 0.9109699819236994, + 0.5033405125141144, + 0.9802348017692566, + 0.13573650270700455, + 1.364282302558422, + 0.7269675824791193, + 0.13772214949131012, + 1.3614145945757627, + 2.4523023068904877, + 1.3297441992908716, + 0.6425253693014383, + 0.7044520806521177, + 0.15895340964198112, + 0.8158358465880156, + 0.9289317242801189, + 0.5561718177050352, + 1.5861834213137627, + 0.9950885884463787, + 1.2675544526427984, + 2.9131480548530817, + 0.30176928266882896, + 1.1512105204164982, + 1.425814926624298, + 0.3828656207770109, + 1.7500163558870554, + 0.5042387414723635 + ], + "unique_experts": 64, + "load_cv": 0.6107871000336351, + "normalized_load_entropy": 0.9544367742453772, + "max_load_share": 0.045548654244306416 + } + }, + "s0_x": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "db2a0861850c325611460ced33d2123b6d5e5db1438b8e1d0d2bc4db45e53f58", + "route_weight_sha256": "c40dcd4507ead2e9d28066c92d3e32661629466032cc85bed130f168d9c6cf51", + "loads": [ + 18, + 3, + 21, + 5, + 17, + 6, + 17, + 12, + 17, + 8, + 7, + 4, + 17, + 5, + 12, + 19, + 16, + 3, + 3, + 5, + 12, + 14, + 4, + 23, + 8, + 26, + 21, + 7, + 3, + 1, + 11, + 2, + 5, + 9, + 11, + 15, + 11, + 4, + 10, + 15, + 9, + 2, + 32, + 8, + 0, + 7, + 14, + 13, + 8, + 12, + 3, + 6, + 6, + 9, + 14, + 17, + 17, + 27, + 6, + 17, + 28, + 3, + 28, + 7 + ], + "weighted_loads": [ + 0.8322690464556217, + 0.23440850526094437, + 0.7864576950669289, + 0.3011273741722107, + 0.6504315137863159, + 0.24359990656375885, + 0.9709181003272533, + 0.424272695556283, + 0.7374842707067728, + 0.26408195309340954, + 0.5079827420413494, + 0.14433117397129536, + 0.7988674826920033, + 0.23606722988188267, + 0.6345125325024128, + 1.0407144166529179, + 1.0418958961963654, + 0.1988925337791443, + 0.15753373131155968, + 0.43891750276088715, + 0.6727683842182159, + 0.7364085167646408, + 0.15809861198067665, + 1.3964167833328247, + 0.3206075057387352, + 1.6140880789607763, + 1.6278559267520905, + 0.39625639095902443, + 0.14499292895197868, + 0.07905670255422592, + 0.40974159352481365, + 0.06689909100532532, + 0.20979014039039612, + 0.3232781272381544, + 0.6419907324016094, + 1.382553230971098, + 0.6546720713376999, + 0.13573667407035828, + 0.562298733741045, + 0.5556866098195314, + 0.5229966603219509, + 0.13074540719389915, + 1.3474498204886913, + 0.7061810288578272, + 0.0, + 0.2916499078273773, + 0.7510845027863979, + 1.0464454554021358, + 0.37519388273358345, + 0.49394598603248596, + 0.09727029502391815, + 0.2509099766612053, + 0.31095630303025246, + 0.36078461445868015, + 0.755644503980875, + 0.8791612535715103, + 1.0855372808873653, + 1.5004433952271938, + 0.19833210483193398, + 1.0338880494236946, + 1.5408294517546892, + 0.22927237302064896, + 1.4826271384954453, + 0.2463419772684574 + ], + "unique_experts": 63, + "load_cv": 0.6636970899141368, + "normalized_load_entropy": 0.9467017096625553, + "max_load_share": 0.044444444444444446 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "b12fbbe6236fd8a8cc911df842953aac41a854ec3fac92c0a658d3fc638757c8", + "route_weight_sha256": "9e5ca9409f12545cb9ba8776702d1b88a743f94bc9b3c3ddde4f754ff32beb9e", + "loads": [ + 24, + 6, + 21, + 15, + 22, + 9, + 24, + 20, + 17, + 14, + 7, + 4, + 18, + 10, + 14, + 19, + 20, + 3, + 3, + 5, + 12, + 14, + 5, + 34, + 12, + 26, + 23, + 7, + 3, + 1, + 11, + 2, + 6, + 13, + 11, + 15, + 12, + 4, + 14, + 15, + 15, + 2, + 34, + 8, + 0, + 14, + 27, + 15, + 9, + 12, + 3, + 7, + 6, + 9, + 25, + 19, + 17, + 38, + 8, + 17, + 28, + 3, + 32, + 7 + ], + "weighted_loads": [ + 1.097407462541014, + 0.4093252085149288, + 0.7864576950669289, + 0.6947267567738891, + 0.8499791920185089, + 0.36644498724490404, + 1.4023245386779308, + 0.7463154252618551, + 0.7374842707067728, + 0.4616424385458231, + 0.5079827420413494, + 0.14433117397129536, + 0.8090691370889544, + 0.44237731024622917, + 0.7523248232901096, + 1.0407144166529179, + 1.1256522997282445, + 0.1988925337791443, + 0.15753373131155968, + 0.43891750276088715, + 0.6727683842182159, + 0.7364085167646408, + 0.17669178172945976, + 2.750284381210804, + 0.47434408962726593, + 1.6140880789607763, + 1.6873737201094627, + 0.39625639095902443, + 0.14499292895197868, + 0.07905670255422592, + 0.40974159352481365, + 0.06689909100532532, + 0.26861583814024925, + 0.5900066513568163, + 0.6419907324016094, + 1.382553230971098, + 0.6940315626561642, + 0.13573667407035828, + 0.7722631925716996, + 0.5556866098195314, + 0.8037407547235489, + 0.13074540719389915, + 1.4001332316547632, + 0.7061810288578272, + 0.0, + 1.4148284010589123, + 1.8609580732882023, + 1.1060548517853022, + 0.41581089422106743, + 0.49394598603248596, + 0.09727029502391815, + 0.33953970670700073, + 0.31095630303025246, + 0.36078461445868015, + 1.8026291467249393, + 0.963961698114872, + 1.0855372808873653, + 2.4676400497555733, + 0.31908584758639336, + 1.0338880494236946, + 1.5408294517546892, + 0.22927237302064896, + 1.61643036454916, + 0.2463419772684574 + ], + "unique_experts": 63, + "load_cv": 0.6560027003543827, + "normalized_load_entropy": 0.9466916912281291, + "max_load_share": 0.04367816091954023 + } + }, + "s1_x": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "7cb984289594da12709e21164361ce02bdf71324c70dab9ea09523aa31d6428f", + "route_weight_sha256": "ad57ecb580de4bfbb1a66e14a050aad706ab410c1a448077645a78a880093a40", + "loads": [ + 17, + 2, + 22, + 10, + 18, + 7, + 19, + 11, + 18, + 4, + 7, + 5, + 14, + 4, + 10, + 17, + 17, + 2, + 3, + 6, + 11, + 15, + 4, + 23, + 8, + 27, + 23, + 7, + 2, + 1, + 7, + 3, + 3, + 11, + 14, + 14, + 11, + 3, + 11, + 13, + 9, + 2, + 35, + 9, + 1, + 7, + 16, + 14, + 7, + 13, + 4, + 0, + 5, + 9, + 14, + 17, + 17, + 26, + 5, + 16, + 26, + 3, + 29, + 12 + ], + "weighted_loads": [ + 0.7656193431466818, + 0.1825728639960289, + 0.7748546786606312, + 0.5679366756230593, + 0.6474913991987705, + 0.2840390708297491, + 0.9444869607686996, + 0.4108635224401951, + 0.7682122383266687, + 0.15015906654298306, + 0.49440364353358746, + 0.163388816639781, + 0.6827936992049217, + 0.18108592182397842, + 0.4943614602088928, + 0.8800188824534416, + 1.0607282333076, + 0.1665320135653019, + 0.16506362333893776, + 0.4689552038908005, + 0.5855555348098278, + 0.8127098437398672, + 0.13889389671385288, + 1.6221286337822676, + 0.29647237434983253, + 1.5400386285036802, + 1.681215114891529, + 0.3819158747792244, + 0.09966042265295982, + 0.07220329344272614, + 0.3097871784120798, + 0.08835114724934101, + 0.13322191685438156, + 0.42387158051133156, + 0.7395652234554291, + 1.2465662993490696, + 0.6489483043551445, + 0.09551328234374523, + 0.5838717129081488, + 0.48629553616046906, + 0.4800977762788534, + 0.1263432502746582, + 1.402623726055026, + 0.7792831249535084, + 0.03947565332055092, + 0.2817576713860035, + 0.8536477480083704, + 1.06626458466053, + 0.3107490502297878, + 0.5297227688133717, + 0.15366306900978088, + 0.0, + 0.2841704599559307, + 0.34134383127093315, + 0.7502007260918617, + 0.8358155321329832, + 1.0946234576404095, + 1.3202543295919895, + 0.1792930494993925, + 1.1231767944991589, + 1.3444989137351513, + 0.23311638832092285, + 1.577590560540557, + 0.4342929311096668 + ], + "unique_experts": 63, + "load_cv": 0.6926421055781644, + "normalized_load_entropy": 0.9411580866473314, + "max_load_share": 0.04861111111111111 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "ff4378e76f67cff4a2d84e5876ae07e3f8a9b09f2b729891d1f4e6bc42eb34fa", + "route_weight_sha256": "0be48da9978f839210157302b5e01a2fb3e99b71ee0c475065e502df3291bc3d", + "loads": [ + 21, + 7, + 29, + 20, + 22, + 8, + 32, + 20, + 19, + 7, + 9, + 5, + 15, + 9, + 11, + 20, + 20, + 3, + 5, + 7, + 12, + 17, + 5, + 40, + 10, + 27, + 24, + 7, + 2, + 2, + 7, + 3, + 5, + 21, + 14, + 14, + 18, + 4, + 19, + 13, + 16, + 2, + 37, + 9, + 3, + 15, + 34, + 17, + 14, + 16, + 6, + 11, + 11, + 11, + 27, + 18, + 17, + 43, + 7, + 16, + 28, + 4, + 37, + 14 + ], + "weighted_loads": [ + 1.0548980203457177, + 0.5023772343993187, + 1.1140447054058313, + 1.1603471199050546, + 0.8207857348024845, + 0.28920652996748686, + 1.6920851431787014, + 0.7502046637237072, + 0.8034998308867216, + 0.2647646386176348, + 0.5850001107901335, + 0.163388816639781, + 0.6929849237203598, + 0.39104650542140007, + 0.5923071652650833, + 1.0008280333131552, + 1.10613681236282, + 0.22587190195918083, + 0.2567455545067787, + 0.4991950783878565, + 0.6334624588489532, + 0.8937185164541006, + 0.15733614936470985, + 3.624242575839162, + 0.3727007880806923, + 1.5400386285036802, + 1.7077025584876537, + 0.3819158747792244, + 0.09966042265295982, + 0.11675072088837624, + 0.3097871784120798, + 0.08835114724934101, + 0.20572123304009438, + 1.0396717432886362, + 0.7395652234554291, + 1.2465662993490696, + 1.123404636979103, + 0.14472188614308834, + 1.04053789190948, + 0.48629553616046906, + 0.788592716678977, + 0.1263432502746582, + 1.4567628968507051, + 0.7792831249535084, + 0.14164858683943748, + 1.4266975056380033, + 2.709977241232991, + 1.2882503885775805, + 0.6206138338893652, + 0.6816505044698715, + 0.21100610122084618, + 0.6923276353627443, + 0.9250171035528183, + 0.4116042423993349, + 1.9782849363982677, + 0.8677375894039869, + 1.0946234576404095, + 2.8486329298466444, + 0.2856669183820486, + 1.1231767944991589, + 1.4386729672551155, + 0.358428955078125, + 1.8636589627712965, + 0.5390939302742481 + ], + "unique_experts": 64, + "load_cv": 0.6602153031990992, + "normalized_load_entropy": 0.9487134291965315, + "max_load_share": 0.044513457556935816 + } + }, + "s0_period": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "69c8f7a1a5d9f94a510866031c4865cafe895da49f5f97c539cc9e35a35f7581", + "route_weight_sha256": "9f1920ee03d88b292bf971b3306e95622c17c6fdfdec51773a2b513299806d18", + "loads": [ + 19, + 3, + 19, + 7, + 14, + 8, + 17, + 13, + 18, + 8, + 8, + 3, + 12, + 5, + 10, + 18, + 17, + 3, + 3, + 5, + 13, + 15, + 4, + 23, + 9, + 26, + 23, + 7, + 3, + 1, + 10, + 3, + 4, + 9, + 11, + 15, + 11, + 4, + 8, + 15, + 10, + 2, + 34, + 8, + 0, + 6, + 13, + 13, + 8, + 12, + 2, + 5, + 6, + 11, + 15, + 17, + 17, + 29, + 5, + 16, + 27, + 3, + 29, + 8 + ], + "weighted_loads": [ + 0.8745830617845058, + 0.21797634661197662, + 0.6837991625070572, + 0.3426240645349026, + 0.5439801756292582, + 0.3197183459997177, + 0.9484920836985111, + 0.45065202564001083, + 0.8355338349938393, + 0.2904201317578554, + 0.532623652368784, + 0.10510339587926865, + 0.6304656714200974, + 0.2375364936888218, + 0.5185408405959606, + 1.035333339124918, + 1.1072961930185556, + 0.20249516516923904, + 0.15951434895396233, + 0.4161685034632683, + 0.6918544732034206, + 0.8188688661903143, + 0.1693286933004856, + 1.4800236970186234, + 0.34513114392757416, + 1.5992142651230097, + 1.7037477772682905, + 0.38591529428958893, + 0.14401116222143173, + 0.07940170913934708, + 0.3978680055588484, + 0.08919893018901348, + 0.1726863533258438, + 0.3355834372341633, + 0.6533285826444626, + 1.3684750497341156, + 0.6416722387075424, + 0.1334332711994648, + 0.4923069104552269, + 0.5588170811533928, + 0.539730740711093, + 0.13537362590432167, + 1.3997107315808535, + 0.8706361018121243, + 0.0, + 0.2464013285934925, + 0.7141944244503975, + 1.0521935857832432, + 0.38027945160865784, + 0.49971913918852806, + 0.07221497222781181, + 0.2381930574774742, + 0.30844876542687416, + 0.4291946738958359, + 0.7686764504760504, + 0.8496894873678684, + 1.0690511167049408, + 1.6051553450524807, + 0.16740108281373978, + 0.9826191402971745, + 1.4916041493415833, + 0.22939858213067055, + 1.601829832419753, + 0.27876030653715134 + ], + "unique_experts": 63, + "load_cv": 0.6764102780099743, + "normalized_load_entropy": 0.9454011415363475, + "max_load_share": 0.04722222222222222 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "f68924ed98e6286c9aca5b7d1046fc46f6f8f52ea3c23c2603bd63572d55ceb2", + "route_weight_sha256": "2951332efdaea6c8b9446c68f56df2d3714b44e636b6f98971a4a924bbf4ff81", + "loads": [ + 25, + 6, + 20, + 15, + 19, + 11, + 25, + 20, + 18, + 16, + 8, + 4, + 13, + 10, + 11, + 18, + 20, + 3, + 3, + 5, + 13, + 15, + 5, + 34, + 12, + 26, + 25, + 7, + 3, + 1, + 10, + 3, + 5, + 13, + 11, + 15, + 11, + 4, + 13, + 15, + 16, + 2, + 37, + 8, + 0, + 12, + 24, + 15, + 9, + 12, + 3, + 6, + 6, + 12, + 26, + 19, + 17, + 41, + 7, + 16, + 27, + 3, + 31, + 10 + ], + "weighted_loads": [ + 1.134918682742864, + 0.3928930498659611, + 0.7278688661754131, + 0.5996367065235972, + 0.7476400900632143, + 0.43429938796907663, + 1.4525478817522526, + 0.7397095747292042, + 0.8355338349938393, + 0.582270672544837, + 0.532623652368784, + 0.14761297032237053, + 0.6406673258170485, + 0.4438465740531683, + 0.5919957123696804, + 1.035333339124918, + 1.1589792254380882, + 0.20249516516923904, + 0.15951434895396233, + 0.4161685034632683, + 0.6918544732034206, + 0.8188688661903143, + 0.18792186304926872, + 2.838927239179611, + 0.45289071649312973, + 1.5992142651230097, + 1.7631098926067352, + 0.38591529428958893, + 0.14401116222143173, + 0.07940170913934708, + 0.3978680055588484, + 0.08919893018901348, + 0.23151205107569695, + 0.6208454146981239, + 0.6533285826444626, + 1.3684750497341156, + 0.6416722387075424, + 0.1334332711994648, + 0.840833724476397, + 0.5588170811533928, + 0.8390249032527208, + 0.13537362590432167, + 1.4956544376909733, + 0.8706361018121243, + 0.0, + 1.3240941353142262, + 1.6717487014830112, + 1.1118029821664095, + 0.4208964630961418, + 0.49971913918852806, + 0.10215160064399242, + 0.32682278752326965, + 0.30844876542687416, + 0.4743991307914257, + 1.7326604444533587, + 0.9364100694656372, + 1.0690511167049408, + 2.6240088753402233, + 0.2861855551600456, + 0.9826191402971745, + 1.4916041493415833, + 0.22939858213067055, + 1.6782740540802479, + 0.3600879944860935 + ], + "unique_experts": 63, + "load_cv": 0.6657266460303158, + "normalized_load_entropy": 0.9463391290809443, + "max_load_share": 0.047126436781609195 + } + }, + "s1_period": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "3842d161d37a7f04b3713ed7b4dcabf18ed4562ddd18fbc98883b02bee6b5794", + "route_weight_sha256": "8db6b4ffb4ddefb084e998aa299e9c7ea61fa1f42f5f405a65f02aec8b5af5a8", + "loads": [ + 17, + 3, + 20, + 10, + 16, + 6, + 20, + 10, + 18, + 7, + 6, + 5, + 13, + 4, + 14, + 18, + 16, + 2, + 3, + 5, + 11, + 13, + 4, + 24, + 8, + 25, + 20, + 7, + 2, + 1, + 10, + 2, + 5, + 12, + 15, + 14, + 11, + 5, + 12, + 12, + 7, + 2, + 35, + 8, + 1, + 7, + 16, + 12, + 9, + 11, + 3, + 4, + 5, + 9, + 14, + 17, + 18, + 26, + 6, + 18, + 25, + 3, + 28, + 10 + ], + "weighted_loads": [ + 0.763108141720295, + 0.21520016714930534, + 0.6872893329709768, + 0.5783006716519594, + 0.6254364401102066, + 0.2673125918954611, + 0.9890255033969879, + 0.3595730811357498, + 0.7586908228695393, + 0.24148769117891788, + 0.46151773259043694, + 0.16617218777537346, + 0.6461924128234386, + 0.18593486957252026, + 0.6721183154731989, + 0.9090840350836515, + 1.0348542779684067, + 0.16811298951506615, + 0.16563548892736435, + 0.4207022748887539, + 0.5893735364079475, + 0.7158075161278248, + 0.1431014984846115, + 1.7118902206420898, + 0.305849963799119, + 1.4970804899930954, + 1.591374846175313, + 0.37771038338541985, + 0.10114530473947525, + 0.07572640478610992, + 0.3883251715451479, + 0.04997653514146805, + 0.19188028573989868, + 0.4651061110198498, + 0.7980365213006735, + 1.266517173498869, + 0.6427510790526867, + 0.156591534614563, + 0.6218587178736925, + 0.46140612848103046, + 0.4058101177215576, + 0.12601006776094437, + 1.4068800117820501, + 0.75718604773283, + 0.034281954169273376, + 0.28175804018974304, + 0.879045756533742, + 1.0329230837523937, + 0.37701945193111897, + 0.48529693111777306, + 0.13736876472830772, + 0.18406178057193756, + 0.2919464260339737, + 0.358716132119298, + 0.7513399589806795, + 0.8734336979687214, + 1.1749380454421043, + 1.3627294711768627, + 0.21031896024942398, + 1.1724207364022732, + 1.3167329784482718, + 0.23284054175019264, + 1.5686774626374245, + 0.3675250578671694 + ], + "unique_experts": 64, + "load_cv": 0.66332495807108, + "normalized_load_entropy": 0.9472069654061616, + "max_load_share": 0.04861111111111111 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "a937bee434542f5bbbd911d7d5d023a5aa2ebd0a39ed3e642ce1bf3cbdea7a57", + "route_weight_sha256": "a206a19bae48a8d7a4cc8696f259769367f556c69cb09add274ec668174754f2", + "loads": [ + 21, + 8, + 26, + 19, + 20, + 7, + 35, + 19, + 20, + 12, + 8, + 5, + 14, + 9, + 15, + 21, + 20, + 3, + 5, + 5, + 12, + 15, + 5, + 39, + 10, + 26, + 22, + 7, + 2, + 2, + 10, + 2, + 6, + 23, + 15, + 14, + 17, + 6, + 21, + 12, + 15, + 2, + 37, + 8, + 3, + 14, + 34, + 15, + 15, + 14, + 4, + 14, + 11, + 11, + 26, + 18, + 19, + 43, + 9, + 18, + 27, + 4, + 34, + 13 + ], + "weighted_loads": [ + 1.040475642774254, + 0.5350045375525951, + 1.0030499007552862, + 1.0998955825343728, + 0.79954843968153, + 0.27248005103319883, + 1.8337489608675241, + 0.6955462284386158, + 0.8311056010425091, + 0.42666169069707394, + 0.552114199846983, + 0.16617218777537346, + 0.6563836373388767, + 0.3958954531699419, + 0.7700640205293894, + 1.029893185943365, + 1.114371879491955, + 0.22745287790894508, + 0.2573174200952053, + 0.4207022748887539, + 0.637280460447073, + 0.8058243729174137, + 0.16154375113546848, + 3.635963086038828, + 0.38207837752997875, + 1.526402486488223, + 1.6416540630161762, + 0.37771038338541985, + 0.10114530473947525, + 0.12027383223176003, + 0.3883251715451479, + 0.04997653514146805, + 0.23583348467946053, + 1.184539457783103, + 0.7980365213006735, + 1.266517173498869, + 1.078142438083887, + 0.2058001384139061, + 1.256127204746008, + 0.46140612848103046, + 0.7437086813151836, + 0.12601006776094437, + 1.4610191825777292, + 0.75718604773283, + 0.13645488768815994, + 1.3858843352645636, + 2.5861743297427893, + 1.254908887669444, + 0.639271404594183, + 0.6372246667742729, + 0.16562403738498688, + 0.7950876895338297, + 0.9327930696308613, + 0.42897654324769974, + 1.8303655106574297, + 0.9053557552397251, + 1.2170253843069077, + 2.9632082860916853, + 0.35241235233843327, + 1.1724207364022732, + 1.4276663530617952, + 0.3581531085073948, + 1.7924701627343893, + 0.506347144022584 + ], + "unique_experts": 64, + "load_cv": 0.6452954827414737, + "normalized_load_entropy": 0.9504742799614899, + "max_load_share": 0.044513457556935816 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 120, + "ordered_topk_exact_tokens": 37, + "set_exact_tokens": 68, + "mean_set_jaccard": 0.8636904761904762, + "mean_token_weighted_tv": 0.028893535553167263, + "aggregate_load_tv": 0.04444444444444445 + }, + "system_bos": { + "tokens": 120, + "ordered_topk_exact_tokens": 36, + "set_exact_tokens": 54, + "mean_set_jaccard": 0.828968253968254, + "mean_token_weighted_tv": 0.03301111614176382, + "aggregate_load_tv": 0.04583333333333334 + }, + "system_x": { + "tokens": 120, + "ordered_topk_exact_tokens": 21, + "set_exact_tokens": 36, + "mean_set_jaccard": 0.7619047619047618, + "mean_token_weighted_tv": 0.04752759853533159, + "aggregate_load_tv": 0.05694444444444445 + }, + "system_period": { + "tokens": 120, + "ordered_topk_exact_tokens": 28, + "set_exact_tokens": 45, + "mean_set_jaccard": 0.790357142857143, + "mean_token_weighted_tv": 0.04402754112767677, + "aggregate_load_tv": 0.06111111111111111 + }, + "bos_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 29, + "set_exact_tokens": 57, + "mean_set_jaccard": 0.8311507936507937, + "mean_token_weighted_tv": 0.035967035118180016, + "aggregate_load_tv": 0.051388888888888894 + }, + "bos_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 27, + "set_exact_tokens": 53, + "mean_set_jaccard": 0.814484126984127, + "mean_token_weighted_tv": 0.037968585112442575, + "aggregate_load_tv": 0.05555555555555555 + }, + "x_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 24, + "set_exact_tokens": 44, + "mean_set_jaccard": 0.789484126984127, + "mean_token_weighted_tv": 0.04329888951809456, + "aggregate_load_tv": 0.05416666666666667 + }, + "x_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 17, + "set_exact_tokens": 38, + "mean_set_jaccard": 0.7694444444444445, + "mean_token_weighted_tv": 0.04674107547228535, + "aggregate_load_tv": 0.05694444444444444 + }, + "period_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 23, + "set_exact_tokens": 45, + "mean_set_jaccard": 0.7882936507936509, + "mean_token_weighted_tv": 0.04442584527811656, + "aggregate_load_tv": 0.0638888888888889 + }, + "period_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 16, + "set_exact_tokens": 37, + "mean_set_jaccard": 0.7656746031746031, + "mean_token_weighted_tv": 0.04786283618304878, + "aggregate_load_tv": 0.06527777777777777 + } + } + }, + "layer_24": { + "layer": 24, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "97491f08ab3834edcdc604fe4c896b1bdb2d1d3d51ca86eee826f5ee4735fa4e", + "route_weight_sha256": "404ea780fd4e525fa10f2bf8fbc811def8d64ffa5bf0b71979704ffeabdf5609", + "loads": [ + 8, + 24, + 17, + 14, + 8, + 12, + 22, + 14, + 10, + 5, + 6, + 9, + 3, + 2, + 13, + 8, + 0, + 19, + 11, + 6, + 22, + 2, + 25, + 20, + 8, + 8, + 12, + 12, + 4, + 17, + 16, + 12, + 13, + 17, + 26, + 6, + 14, + 8, + 21, + 3, + 12, + 22, + 6, + 6, + 6, + 15, + 3, + 9, + 10, + 1, + 22, + 15, + 11, + 18, + 8, + 5, + 2, + 7, + 14, + 3, + 9, + 28, + 1, + 10 + ], + "weighted_loads": [ + 0.29631622694432735, + 1.0164259988814592, + 0.5469763465225697, + 0.6092450451105833, + 0.28202610462903976, + 0.3993956856429577, + 1.1570882871747017, + 0.6119586080312729, + 0.7441208818927407, + 0.3167964071035385, + 0.27834340184926987, + 0.44253652542829514, + 0.10166743397712708, + 0.09602173790335655, + 0.5039248932152987, + 0.3275615144520998, + 0.0, + 0.7975462954491377, + 0.38527457788586617, + 0.1743819173425436, + 0.9821294099092484, + 0.07544968649744987, + 1.4521049484610558, + 1.8567888624966145, + 0.30124574713408947, + 0.23893514648079872, + 0.5788254933431745, + 3.7045846581459045, + 0.15005218982696533, + 0.6676584929227829, + 0.6026766784489155, + 0.4554264321923256, + 0.4698779918253422, + 1.5062298327684402, + 0.895596232265234, + 0.23741207271814346, + 0.48523218370974064, + 0.26792838983237743, + 0.6923436094075441, + 0.10733492486178875, + 0.609399015083909, + 0.7144855447113514, + 0.20548148453235626, + 0.2044488862156868, + 0.23538609966635704, + 0.5108354520052671, + 0.05282583460211754, + 0.3238808121532202, + 0.316188694909215, + 0.07846289128065109, + 0.7839291840791702, + 1.0821962021291256, + 0.36712461337447166, + 0.6911000600084662, + 0.7683878168463707, + 0.5742924213409424, + 0.06389185972511768, + 0.24153009615838528, + 0.6051692236214876, + 0.08478204347193241, + 0.34137988835573196, + 1.620703212916851, + 0.04405077546834946, + 0.36181688494980335 + ], + "unique_experts": 63, + "load_cv": 0.6138323251970281, + "normalized_load_entropy": 0.9518088451511976, + "max_load_share": 0.03888888888888889 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "6be1dc7c5fabac739129a251a4d58f8da7ea5fdac94fc59eacdeb43cc467e025", + "route_weight_sha256": "124a20d3f322caff133f1226840e7a44bd02d8ae159fcd4d7c1e43ef7189286d", + "loads": [ + 8, + 26, + 20, + 14, + 8, + 17, + 22, + 15, + 19, + 5, + 16, + 9, + 4, + 2, + 15, + 8, + 0, + 19, + 11, + 6, + 23, + 3, + 32, + 20, + 15, + 8, + 12, + 12, + 11, + 22, + 16, + 15, + 16, + 21, + 33, + 7, + 15, + 10, + 22, + 3, + 12, + 23, + 10, + 8, + 6, + 17, + 3, + 15, + 10, + 1, + 27, + 21, + 14, + 21, + 8, + 5, + 2, + 7, + 25, + 4, + 11, + 44, + 3, + 13 + ], + "weighted_loads": [ + 0.29631622694432735, + 1.0867395009845495, + 0.65345230512321, + 0.6092450451105833, + 0.28202610462903976, + 0.5463404089678079, + 1.1570882871747017, + 0.6699717305600643, + 1.128256204072386, + 0.3167964071035385, + 0.6503980823326856, + 0.44253652542829514, + 0.10441192425787449, + 0.09602173790335655, + 0.5698120053857565, + 0.3275615144520998, + 0.0, + 0.7975462954491377, + 0.38527457788586617, + 0.1743819173425436, + 1.0150375925004482, + 0.1270337477326393, + 1.9162553660571575, + 1.8567888624966145, + 0.5604345246683806, + 0.23893514648079872, + 0.5788254933431745, + 3.7045846581459045, + 0.43187202140688896, + 0.8664880990982056, + 0.6026766784489155, + 0.563393522053957, + 0.5721103698015213, + 1.6912665106356144, + 1.1269010920077562, + 0.2856471613049507, + 0.5754438508301973, + 1.177366217598319, + 0.7326289769262075, + 0.10733492486178875, + 0.609399015083909, + 0.7753058560192585, + 0.392028221860528, + 0.28457050770521164, + 0.23538609966635704, + 0.6057770531624556, + 0.05282583460211754, + 0.7014559260569513, + 0.316188694909215, + 0.07846289128065109, + 1.0084468312561512, + 1.4839256629347801, + 0.45190677233040333, + 0.8256463138386607, + 0.7683878168463707, + 0.5742924213409424, + 0.06389185972511768, + 0.24153009615838528, + 0.9725874204305001, + 0.12138141132891178, + 0.4039503037929535, + 2.7273913943208754, + 0.04695403226651251, + 2.343652529641986 + ], + "unique_experts": 63, + "load_cv": 0.6318410773661096, + "normalized_load_entropy": 0.9508378979924664, + "max_load_share": 0.05057471264367816 + } + }, + "s1_eos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "b98bff1462d9af97484ac836d2b0040f80007951a78cc5ce858221f796f9eb04", + "route_weight_sha256": "87498fda6537562fbe83be72cec2a1aab5706cb20bc774c0e64dbcb626e752a3", + "loads": [ + 9, + 24, + 10, + 10, + 8, + 11, + 23, + 15, + 11, + 5, + 6, + 10, + 3, + 2, + 11, + 9, + 0, + 21, + 10, + 7, + 19, + 2, + 23, + 20, + 9, + 4, + 11, + 13, + 5, + 17, + 15, + 13, + 20, + 16, + 26, + 7, + 16, + 10, + 20, + 4, + 12, + 21, + 5, + 9, + 6, + 20, + 5, + 8, + 10, + 1, + 23, + 11, + 9, + 19, + 9, + 5, + 2, + 6, + 12, + 7, + 10, + 26, + 1, + 8 + ], + "weighted_loads": [ + 0.33731476217508316, + 1.0030772015452385, + 0.3293263055384159, + 0.5058222897350788, + 0.2884956654161215, + 0.3678702600300312, + 1.3594370801001787, + 0.6434335056692362, + 0.7895240392535925, + 0.30659860745072365, + 0.27175584994256496, + 0.5081158727407455, + 0.10186848975718021, + 0.08926935866475105, + 0.42917650379240513, + 0.3674886506050825, + 0.0, + 0.8780700750648975, + 0.34216240979731083, + 0.2029501385986805, + 0.8904817216098309, + 0.07481667026877403, + 1.3623832426965237, + 1.8490015380084515, + 0.327799579128623, + 0.11316886357963085, + 0.5258588641881943, + 3.744302587583661, + 0.1782729271799326, + 0.6555157154798508, + 0.5442378800362349, + 0.47233045287430286, + 0.7013298869132996, + 1.4989175871014595, + 0.8981276340782642, + 0.28432318568229675, + 0.5560242831707001, + 0.32360665127635, + 0.6666258070617914, + 0.13453787565231323, + 0.5843268483877182, + 0.6996671259403229, + 0.16525868140161037, + 0.3071175906807184, + 0.23208318836987019, + 0.6748609188944101, + 0.11772661842405796, + 0.27573126181960106, + 0.3094757441431284, + 0.0781022161245346, + 0.844712333753705, + 0.8507801108062267, + 0.30146120116114616, + 0.7378445826470852, + 0.7827395051717758, + 0.5608680881559849, + 0.06323748454451561, + 0.2051149122416973, + 0.5392174441367388, + 0.20188533701002598, + 0.3706623613834381, + 1.6045409236103296, + 0.04617282375693321, + 0.287540253251791 + ], + "unique_experts": 63, + "load_cv": 0.5997942033895902, + "normalized_load_entropy": 0.9543247734528142, + "max_load_share": 0.03611111111111111 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "c2e5eafc2b362692326212c46b6235508aa0cc34e76bc0b7a0ba4195340e0e05", + "route_weight_sha256": "8247c5fb794486b453cf37fad3ac80afd60f3060202b9848137618c3c9adc208", + "loads": [ + 9, + 26, + 11, + 11, + 10, + 18, + 23, + 16, + 20, + 8, + 15, + 12, + 7, + 2, + 14, + 9, + 0, + 21, + 11, + 8, + 24, + 3, + 35, + 21, + 19, + 4, + 11, + 13, + 23, + 22, + 15, + 16, + 20, + 22, + 33, + 9, + 23, + 13, + 21, + 4, + 13, + 28, + 10, + 12, + 8, + 21, + 5, + 16, + 10, + 1, + 29, + 25, + 17, + 23, + 11, + 7, + 2, + 8, + 29, + 8, + 14, + 45, + 8, + 14 + ], + "weighted_loads": [ + 0.33731476217508316, + 1.0722293313592672, + 0.35389296524226665, + 0.6178894601762295, + 0.34861009567976, + 0.5820042055565864, + 1.3594370801001787, + 0.6824418511241674, + 1.3807623242028058, + 0.43739623948931694, + 0.6351434991229326, + 0.5749683380126953, + 0.1921035167761147, + 0.08926935866475105, + 0.5228650756180286, + 0.3674886506050825, + 0.0, + 0.8780700750648975, + 0.3735911678522825, + 0.23354666493833065, + 1.105764463543892, + 0.13638199865818024, + 2.113337619230151, + 1.8737819083034992, + 0.6900314285885543, + 0.11316886357963085, + 0.5258588641881943, + 3.744302587583661, + 1.1066087428480387, + 0.8790187928825617, + 0.5442378800362349, + 0.6117413733154535, + 0.7013298869132996, + 1.809959415346384, + 1.1540270233526826, + 0.3805633559823036, + 1.0737267844378948, + 1.2768020369112492, + 0.7170707043260336, + 0.13453787565231323, + 0.6960179209709167, + 1.114009354263544, + 0.3670501038432121, + 0.558804826810956, + 0.3260477762669325, + 0.73357286863029, + 0.11772661842405796, + 0.8108586758607998, + 0.3094757441431284, + 0.0781022161245346, + 1.105806851759553, + 1.8054837826639414, + 0.5312707778066397, + 1.0214267671108246, + 0.9570388570427895, + 0.6535716913640499, + 0.06323748454451561, + 0.28316744044423103, + 1.2175775835639797, + 0.2352170515805483, + 0.4928230717778206, + 3.4044685973785818, + 0.39587467804085463, + 2.395112194120884 + ], + "unique_experts": 63, + "load_cv": 0.5873169954324563, + "normalized_load_entropy": 0.9570006658274524, + "max_load_share": 0.046583850931677016 + } + }, + "s0_bos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "bc505bd7f1afc648bc58001597161641dabc0575067004b93500ffeb58fca1d5", + "route_weight_sha256": "8bab0d1b48a11456445cdebb299e1a18ede5cac2147460b2840abce179075d8e", + "loads": [ + 8, + 34, + 14, + 8, + 8, + 12, + 23, + 12, + 10, + 5, + 5, + 12, + 5, + 2, + 10, + 8, + 0, + 21, + 12, + 3, + 17, + 2, + 25, + 20, + 7, + 8, + 11, + 13, + 5, + 18, + 19, + 13, + 17, + 16, + 27, + 6, + 14, + 6, + 23, + 3, + 10, + 25, + 3, + 8, + 8, + 21, + 2, + 10, + 10, + 2, + 23, + 16, + 5, + 15, + 8, + 5, + 2, + 6, + 13, + 4, + 10, + 26, + 1, + 5 + ], + "weighted_loads": [ + 0.32034116238355637, + 1.3549121227115393, + 0.4614513535052538, + 0.3791858088225126, + 0.31137920916080475, + 0.3928155079483986, + 1.2730846609920263, + 0.5512930266559124, + 0.7256020400673151, + 0.3267846778035164, + 0.24341828748583794, + 0.5529071725904942, + 0.15951119735836983, + 0.09518197923898697, + 0.38958216086030006, + 0.32855888083577156, + 0.0, + 0.8698872122913599, + 0.4166537933051586, + 0.08903714455664158, + 0.8170484621077776, + 0.07003986835479736, + 1.4286076724529266, + 1.8749972842633724, + 0.2865716442465782, + 0.25575406663119793, + 0.4798496551811695, + 3.7141356337815523, + 0.1941073164343834, + 0.7199309710413218, + 0.6756253968924284, + 0.47413077764213085, + 0.6089343335479498, + 1.5169423185288906, + 0.9582605306059122, + 0.23218158073723316, + 0.4719736557453871, + 0.21283645741641521, + 0.7840018346905708, + 0.11358540318906307, + 0.5584197547286749, + 0.8146144095808268, + 0.15288925543427467, + 0.2638618517667055, + 0.30099783279001713, + 0.7382462676614523, + 0.055359404534101486, + 0.3632287085056305, + 0.3351994138211012, + 0.1150832399725914, + 0.8420075140893459, + 1.0887436736375093, + 0.1706647016108036, + 0.6076209302991629, + 0.779312003403902, + 0.6095397118479013, + 0.06697947904467583, + 0.21953075379133224, + 0.5833016354590654, + 0.11252901889383793, + 0.37166186422109604, + 1.5853025391697884, + 0.04392179101705551, + 0.19324695691466331 + ], + "unique_experts": 63, + "load_cv": 0.6743995957997119, + "normalized_load_entropy": 0.9448848554265517, + "max_load_share": 0.04722222222222222 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "ee92432d2d1c5c50a7ff97962b37500fef5fd1282ea35ac875fe828eeb486797", + "route_weight_sha256": "7a476a0173b52cce3e7bfa362694dd00b992d1c2b349c4ab9208bf8aec7e54f3", + "loads": [ + 8, + 36, + 17, + 8, + 8, + 17, + 24, + 13, + 18, + 5, + 13, + 12, + 6, + 2, + 12, + 8, + 0, + 21, + 12, + 3, + 18, + 3, + 34, + 20, + 15, + 8, + 12, + 13, + 12, + 23, + 20, + 18, + 20, + 20, + 32, + 6, + 15, + 8, + 23, + 3, + 10, + 26, + 8, + 8, + 9, + 23, + 3, + 14, + 10, + 2, + 30, + 22, + 8, + 18, + 8, + 5, + 2, + 7, + 23, + 5, + 12, + 42, + 2, + 7 + ], + "weighted_loads": [ + 0.32034116238355637, + 1.4216748420149088, + 0.5555603057146072, + 0.3791858088225126, + 0.31137920916080475, + 0.5463463563937694, + 1.3317379113286734, + 0.6093061491847038, + 1.1052165497094393, + 0.3267846778035164, + 0.5658311063889414, + 0.5529071725904942, + 0.16225568763911724, + 0.09518197923898697, + 0.4521765522658825, + 0.32855888083577156, + 0.0, + 0.8698872122913599, + 0.4166537933051586, + 0.08903714455664158, + 0.8499566446989775, + 0.11225331202149391, + 2.101169791072607, + 1.8749972842633724, + 0.5842675145249814, + 0.25575406663119793, + 0.9260292835533619, + 3.7141356337815523, + 0.475927148014307, + 0.9187605772167444, + 0.7109547797590494, + 0.6386370249092579, + 0.7372514698654413, + 1.7019789963960648, + 1.1108212023973465, + 0.23218158073723316, + 0.5621853228658438, + 1.1225754674524069, + 0.7840018346905708, + 0.11358540318906307, + 0.5584197547286749, + 0.8754347208887339, + 0.411892743781209, + 0.2638618517667055, + 0.3386927042156458, + 0.8487187307327986, + 0.11710254848003387, + 0.7125957029638812, + 0.3351994138211012, + 0.1150832399725914, + 1.1459700874984264, + 1.4695011675357819, + 0.25544686056673527, + 0.7421671841293573, + 0.779312003403902, + 0.6095397118479013, + 0.06697947904467583, + 0.2565750852227211, + 0.9407120700925589, + 0.14984898827970028, + 0.43423227965831757, + 2.709667316172272, + 0.04562763497233391, + 1.205719567835331 + ], + "unique_experts": 63, + "load_cv": 0.6704096274436724, + "normalized_load_entropy": 0.9461404609449076, + "max_load_share": 0.04827586206896552 + } + }, + "s1_bos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "267747eb9c2cee01b0debaf1bd95907d214aeb119f52ef4532323dfb9dc9ada9", + "route_weight_sha256": "4205e3a6bd0bb454f90d6bd798b4e077abc83b66ba5f799a4717175e0d79924f", + "loads": [ + 11, + 25, + 10, + 8, + 8, + 11, + 23, + 13, + 10, + 5, + 6, + 11, + 5, + 2, + 12, + 11, + 0, + 25, + 9, + 5, + 15, + 4, + 25, + 20, + 6, + 8, + 14, + 13, + 5, + 15, + 17, + 14, + 16, + 16, + 28, + 8, + 12, + 7, + 19, + 4, + 10, + 21, + 4, + 9, + 6, + 26, + 5, + 12, + 15, + 2, + 20, + 12, + 7, + 17, + 8, + 5, + 2, + 4, + 11, + 7, + 10, + 25, + 1, + 5 + ], + "weighted_loads": [ + 0.42519323341548443, + 1.077759811654687, + 0.32868717238307, + 0.39487460628151894, + 0.2882462665438652, + 0.36297178268432617, + 1.4878117106854916, + 0.5876923203468323, + 0.7559384368360043, + 0.32760781049728394, + 0.26459767296910286, + 0.5132186226546764, + 0.1589559931308031, + 0.09578396379947662, + 0.460408927872777, + 0.40920780785381794, + 0.0, + 0.9899052958935499, + 0.3138006702065468, + 0.14885137788951397, + 0.695033485069871, + 0.14332988858222961, + 1.4615479577332735, + 1.8801049403846264, + 0.24799109622836113, + 0.23718037083745003, + 0.6462601236999035, + 3.7847276516258717, + 0.19329637475311756, + 0.6769817601889372, + 0.647289602085948, + 0.4931086879223585, + 0.5587811674922705, + 1.51414380595088, + 0.984374301508069, + 0.30785554461181164, + 0.4142895918339491, + 0.23579704947769642, + 0.645991999655962, + 0.13902848400175571, + 0.5322079099714756, + 0.7352067492902279, + 0.21614815294742584, + 0.2955678179860115, + 0.23610410280525684, + 0.9211760126054287, + 0.13351907581090927, + 0.42145337350666523, + 0.4790989123284817, + 0.11655448004603386, + 0.7759228553622961, + 0.9280750416219234, + 0.22703572735190392, + 0.7043944112956524, + 0.7861232273280621, + 0.611487714573741, + 0.06554502435028553, + 0.15164410695433617, + 0.5243970733135939, + 0.20286605320870876, + 0.3745677974075079, + 1.4759529251605272, + 0.0402429960668087, + 0.19185991398990154 + ], + "unique_experts": 63, + "load_cv": 0.6142344427149001, + "normalized_load_entropy": 0.9538027185183975, + "max_load_share": 0.03888888888888889 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "a84cd3d8fcede1b15896c803cf9959b4921c5f6984ae42ee964d722dc9807f29", + "route_weight_sha256": "f855c74483ab11863920bba662ca1332579b60a91778711cebb78a287c218abd", + "loads": [ + 11, + 26, + 13, + 9, + 10, + 18, + 23, + 14, + 18, + 8, + 14, + 13, + 9, + 2, + 16, + 11, + 0, + 25, + 10, + 7, + 20, + 5, + 38, + 21, + 16, + 8, + 14, + 13, + 23, + 20, + 17, + 19, + 16, + 22, + 35, + 10, + 19, + 10, + 20, + 4, + 11, + 28, + 10, + 13, + 7, + 28, + 5, + 19, + 15, + 2, + 27, + 27, + 14, + 21, + 10, + 7, + 2, + 5, + 26, + 8, + 13, + 45, + 7, + 9 + ], + "weighted_loads": [ + 0.42519323341548443, + 1.108083626255393, + 0.41840617544949055, + 0.5069417767226696, + 0.3483606968075037, + 0.5806451991666108, + 1.4878117106854916, + 0.6267006658017635, + 1.3428580611944199, + 0.45840544253587723, + 0.6215522105339915, + 0.5800710879266262, + 0.2491910201497376, + 0.09578396379947662, + 0.5785612612962723, + 0.40920780785381794, + 0.0, + 0.9899052958935499, + 0.3452294282615185, + 0.21006340719759464, + 0.910316227003932, + 0.19781843945384026, + 2.3303557857871056, + 1.9048853106796741, + 0.6084909762721509, + 0.23718037083745003, + 0.6462601236999035, + 3.7847276516258717, + 1.1216321904212236, + 0.9004848375916481, + 0.647289602085948, + 0.7023970577865839, + 0.5587811674922705, + 1.8251856341958046, + 1.251218213699758, + 0.4040957149118185, + 0.9319920931011438, + 1.187307370826602, + 0.6890443153679371, + 0.13902848400175571, + 0.6438989825546741, + 1.149548977613449, + 0.5696153808385134, + 0.6342531554400921, + 0.27508159913122654, + 1.0261197052896023, + 0.13351907581090927, + 0.9772103744326159, + 0.4790989123284817, + 0.11655448004603386, + 1.1432701032608747, + 1.8732263278216124, + 0.42903777584433556, + 0.9879765957593918, + 0.9604225791990757, + 0.704191317781806, + 0.06554502435028553, + 0.19030891358852386, + 1.1453826744109392, + 0.24144735373556614, + 0.4634764362126589, + 3.2943425378762186, + 0.38865768536925316, + 1.2860246319323778 + ], + "unique_experts": 63, + "load_cv": 0.5902291725294045, + "normalized_load_entropy": 0.9578331417153407, + "max_load_share": 0.046583850931677016 + } + }, + "s0_x": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "c51a7876ca4d19e20b3d1d6f552099333ab7023750c2c3a64b59c97ff2aa4971", + "route_weight_sha256": "3bb3dddaa46bbb9638f8fba15d49f51b2a1d988e73e8ac4aae55a36aa51f0525", + "loads": [ + 11, + 36, + 11, + 9, + 7, + 18, + 21, + 13, + 11, + 5, + 5, + 10, + 2, + 2, + 13, + 8, + 0, + 19, + 11, + 3, + 16, + 3, + 24, + 20, + 9, + 8, + 14, + 13, + 5, + 17, + 21, + 11, + 16, + 17, + 25, + 7, + 12, + 6, + 16, + 3, + 10, + 23, + 2, + 8, + 8, + 25, + 1, + 9, + 10, + 2, + 22, + 17, + 5, + 17, + 8, + 6, + 2, + 6, + 12, + 5, + 12, + 25, + 1, + 6 + ], + "weighted_loads": [ + 0.4283352177590132, + 1.4006147123873234, + 0.363565256819129, + 0.40127274207770824, + 0.25547170639038086, + 0.6006966847926378, + 1.2380235400050879, + 0.5652534421533346, + 0.7645153310149908, + 0.3246097266674042, + 0.24702781252563, + 0.4857190363109112, + 0.07098192349076271, + 0.09535413980484009, + 0.4813253805041313, + 0.3400140143930912, + 0.0, + 0.8348078522831202, + 0.38931872695684433, + 0.0901228990405798, + 0.820456899702549, + 0.0979706458747387, + 1.312559586018324, + 1.9605964682996273, + 0.3441405314952135, + 0.24406775645911694, + 0.5917747989296913, + 4.022274147719145, + 0.1803454589098692, + 0.6595529336482286, + 0.7581316158175468, + 0.4031009841710329, + 0.5548931024968624, + 1.5713763423264027, + 0.8817301541566849, + 0.2587057389318943, + 0.40938569977879524, + 0.22682345658540726, + 0.5403381139039993, + 0.11113352701067924, + 0.5702447798103094, + 0.7790035121142864, + 0.07305636629462242, + 0.2596543338149786, + 0.3017828185111284, + 0.8544037230312824, + 0.014837571419775486, + 0.31928778626024723, + 0.3453689329326153, + 0.11289656348526478, + 0.8048062268644571, + 1.1486819088459015, + 0.16565280221402645, + 0.6802261453121901, + 0.7434941492974758, + 0.6051888819783926, + 0.06274782866239548, + 0.20479066483676434, + 0.5655967388302088, + 0.12816432304680347, + 0.45629297010600567, + 1.551506631076336, + 0.04341877996921539, + 0.23468809947371483 + ], + "unique_experts": 63, + "load_cv": 0.6638830776128736, + "normalized_load_entropy": 0.9456153463326753, + "max_load_share": 0.05 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "8691cb5dff9ad21ba6b49145b340880f5e9993eeb3d0eec0c439caca40dc460f", + "route_weight_sha256": "fc3db251fff125c4967d84b6f8ab6ca611ac4a541b8965f929a31e478e13f1d7", + "loads": [ + 11, + 37, + 13, + 9, + 7, + 24, + 21, + 15, + 20, + 5, + 14, + 10, + 3, + 2, + 16, + 8, + 0, + 19, + 11, + 3, + 17, + 4, + 31, + 20, + 16, + 9, + 14, + 13, + 12, + 22, + 21, + 13, + 19, + 21, + 32, + 8, + 14, + 9, + 17, + 3, + 11, + 24, + 5, + 9, + 8, + 27, + 1, + 14, + 10, + 2, + 27, + 23, + 9, + 21, + 8, + 6, + 2, + 7, + 23, + 5, + 14, + 41, + 2, + 8 + ], + "weighted_loads": [ + 0.4283352177590132, + 1.4363437928259373, + 0.43199095502495766, + 0.40127274207770824, + 0.25547170639038086, + 0.7783771187532693, + 1.2380235400050879, + 0.6570910979062319, + 1.2234974559396505, + 0.3246097266674042, + 0.6225770546589047, + 0.4857190363109112, + 0.07372641377151012, + 0.09535413980484009, + 0.5729802660644054, + 0.3400140143930912, + 0.0, + 0.8348078522831202, + 0.38931872695684433, + 0.0901228990405798, + 0.8533650822937489, + 0.13923325017094612, + 1.7573198024183512, + 1.9605964682996273, + 0.6033293090295047, + 0.28195846639573574, + 0.5917747989296913, + 4.022274147719145, + 0.4621652904897928, + 0.8583825398236513, + 0.7581316158175468, + 0.4806171488016844, + 0.6615798510611057, + 1.7564130201935768, + 1.112809183076024, + 0.29322459548711777, + 0.5425012707710266, + 1.1722525581717491, + 0.5787285342812538, + 0.11113352701067924, + 0.6051915343850851, + 0.8398238234221935, + 0.18066528625786304, + 0.30167519487440586, + 0.3017828185111284, + 0.938607681542635, + 0.014837571419775486, + 0.7032838164595887, + 0.3453689329326153, + 0.11289656348526478, + 0.984340438619256, + 1.5744084641337395, + 0.2843564301729202, + 0.8619742151349783, + 0.7434941492974758, + 0.6051888819783926, + 0.06274782866239548, + 0.2497044187039137, + 0.961204444989562, + 0.12816432304680347, + 0.5188633855432272, + 2.6694767945446074, + 0.04512462392449379, + 1.2471607103943825 + ], + "unique_experts": 63, + "load_cv": 0.6598582183154988, + "normalized_load_entropy": 0.9464714350045011, + "max_load_share": 0.047126436781609195 + } + }, + "s1_x": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "9fa844695eaca943f214776e8fb9f937c53c78b825307efbe0cc382125964e39", + "route_weight_sha256": "5ba8fe4d74273d3df1fe9e25f9ddf471a18fa889deebde02c4a178e3da064b6d", + "loads": [ + 12, + 29, + 13, + 10, + 6, + 16, + 21, + 16, + 11, + 5, + 6, + 10, + 4, + 2, + 12, + 9, + 0, + 24, + 9, + 5, + 14, + 3, + 25, + 20, + 10, + 5, + 14, + 13, + 4, + 15, + 19, + 12, + 10, + 16, + 28, + 10, + 16, + 8, + 16, + 3, + 10, + 18, + 3, + 9, + 10, + 23, + 1, + 7, + 14, + 1, + 22, + 13, + 7, + 13, + 8, + 5, + 2, + 5, + 13, + 5, + 10, + 32, + 1, + 7 + ], + "weighted_loads": [ + 0.4816133361309767, + 1.1689339242875576, + 0.41606881469488144, + 0.47248265892267227, + 0.19689211249351501, + 0.5336108431220055, + 1.4429980162531137, + 0.6837130654603243, + 0.8421763088554144, + 0.32242976874113083, + 0.27726867981255054, + 0.45802009478211403, + 0.13445588387548923, + 0.09048772975802422, + 0.4507484994828701, + 0.39368921890854836, + 0.0, + 0.9521104227751493, + 0.3034069277346134, + 0.14380355551838875, + 0.6810957714915276, + 0.1120637021958828, + 1.3052170928567648, + 1.8994485773146152, + 0.3677268512547016, + 0.16446991078555584, + 0.734980933368206, + 3.4849795382469893, + 0.1376688051968813, + 0.6074126325547695, + 0.6865799129009247, + 0.42138112895190716, + 0.361834516748786, + 1.4716657660901546, + 0.9794030170887709, + 0.37322578951716423, + 0.5355429910123348, + 0.2651420906186104, + 0.5442354492843151, + 0.11119834333658218, + 0.49730097874999046, + 0.5904424265027046, + 0.11301009356975555, + 0.2840927094221115, + 0.3499929551035166, + 0.803994370624423, + 0.044342294335365295, + 0.2404177151620388, + 0.45851648412644863, + 0.07796937972307205, + 0.8515034075826406, + 0.8840474467724562, + 0.22150429897010326, + 0.6301862746477127, + 0.6695017628371716, + 0.5586675927042961, + 0.06157358177006245, + 0.18784059211611748, + 0.5479857157915831, + 0.14038042910397053, + 0.3896648548543453, + 1.698379686102271, + 0.042729854583740234, + 0.2571040093898773 + ], + "unique_experts": 63, + "load_cv": 0.6469300723559839, + "normalized_load_entropy": 0.9482693148696664, + "max_load_share": 0.044444444444444446 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "462bce0ccd0fe77525f085916a9d554775d90696b09736f0ef88c6fba8035df4", + "route_weight_sha256": "472dd2b124c30916ca8d9d964ddbf6e935857b9954684ca10393027522c4d667", + "loads": [ + 12, + 29, + 14, + 11, + 8, + 23, + 21, + 17, + 21, + 8, + 13, + 12, + 9, + 2, + 15, + 9, + 0, + 24, + 10, + 6, + 21, + 4, + 37, + 21, + 19, + 5, + 14, + 13, + 23, + 20, + 19, + 16, + 10, + 23, + 35, + 13, + 25, + 12, + 16, + 3, + 11, + 25, + 7, + 12, + 11, + 24, + 1, + 14, + 14, + 1, + 28, + 28, + 14, + 17, + 10, + 7, + 2, + 6, + 30, + 5, + 15, + 53, + 7, + 11 + ], + "weighted_loads": [ + 0.4816133361309767, + 1.1689339242875576, + 0.4406354743987322, + 0.5845498293638229, + 0.2570065427571535, + 0.7462975636590272, + 1.4429980162531137, + 0.7227214109152555, + 1.5127680245786905, + 0.4532274007797241, + 0.5917172192130238, + 0.5248725600540638, + 0.2550154593773186, + 0.09048772975802422, + 0.5466224122792482, + 0.39368921890854836, + 0.0, + 0.9521104227751493, + 0.3348356857895851, + 0.1744000818580389, + 0.9611611217260361, + 0.15688535571098328, + 2.0141209810972214, + 1.924228947609663, + 0.6902056362014264, + 0.16446991078555584, + 0.734980933368206, + 3.4849795382469893, + 1.1083778198808432, + 0.8309157099574804, + 0.6865799129009247, + 0.5874299556016922, + 0.361834516748786, + 1.819739155471325, + 1.2265384634956717, + 0.5171836651861668, + 1.175921268761158, + 1.2568421922624111, + 0.5442354492843151, + 0.11119834333658218, + 0.608992051333189, + 1.0047846548259258, + 0.23371450789272785, + 0.5435990951955318, + 0.3889704514294863, + 0.8627063203603029, + 0.044342294335365295, + 0.7625098562566563, + 0.45851648412644863, + 0.07796937972307205, + 1.0988692361861467, + 1.8709730878472328, + 0.4235063474625349, + 0.9137684591114521, + 0.8438011147081852, + 0.6513711959123611, + 0.06157358177006245, + 0.22652686014771461, + 1.2639137860387564, + 0.14038042910397053, + 0.5473828092217445, + 3.5773133388720453, + 0.3911445438861847, + 1.360200971364975 + ], + "unique_experts": 63, + "load_cv": 0.6408160152794062, + "normalized_load_entropy": 0.9507252267070799, + "max_load_share": 0.054865424430641824 + } + }, + "s0_period": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "905bd8ea354df48723d4da768eb1a53c3804a459d8911f2f9cb0e94077cb69d7", + "route_weight_sha256": "8f6bcf14fce09384ccbe33506d096ff9aa8c2a029bc20590c016e922a86fca96", + "loads": [ + 12, + 33, + 12, + 8, + 4, + 17, + 19, + 12, + 11, + 5, + 6, + 12, + 2, + 2, + 12, + 10, + 0, + 20, + 9, + 5, + 16, + 2, + 26, + 20, + 8, + 9, + 11, + 13, + 5, + 18, + 20, + 11, + 15, + 16, + 26, + 6, + 16, + 7, + 19, + 3, + 11, + 24, + 3, + 7, + 9, + 22, + 3, + 8, + 12, + 1, + 21, + 17, + 5, + 15, + 8, + 5, + 2, + 5, + 12, + 6, + 12, + 27, + 1, + 6 + ], + "weighted_loads": [ + 0.45994197577238083, + 1.2970117647200823, + 0.3830791860818863, + 0.36741041764616966, + 0.15052065812051296, + 0.5697248186916113, + 1.1561287436634302, + 0.5399485118687153, + 0.7311932351440191, + 0.3255477584898472, + 0.279079157859087, + 0.5346932224929333, + 0.07485421001911163, + 0.09516515955328941, + 0.4449734725058079, + 0.40837923996150494, + 0.0, + 0.8489259462803602, + 0.33647106401622295, + 0.13752254284918308, + 0.7925079315900803, + 0.07179660350084305, + 1.4304444342851639, + 1.9246223866939545, + 0.3409379832446575, + 0.28300943225622177, + 0.5078437747433782, + 4.17704714089632, + 0.18425412103533745, + 0.7132095284759998, + 0.7632961627095938, + 0.3933720625936985, + 0.5297198854386806, + 1.529067326337099, + 0.9027360025793314, + 0.23530806973576546, + 0.5498974360525608, + 0.2492340411990881, + 0.6477453485131264, + 0.1144310962408781, + 0.5672168489545584, + 0.8192336596548557, + 0.09882485494017601, + 0.23175319097936153, + 0.34826498478651047, + 0.7360763736069202, + 0.05772183649241924, + 0.2899602372199297, + 0.39486912451684475, + 0.08085436373949051, + 0.764040956273675, + 1.1669091004878283, + 0.16355548612773418, + 0.6071720402687788, + 0.7619365006685257, + 0.5844320021569729, + 0.06418492645025253, + 0.18240732327103615, + 0.5712922923266888, + 0.1665138490498066, + 0.44780782982707024, + 1.6504829749464989, + 0.040974635630846024, + 0.21836131438612938 + ], + "unique_experts": 63, + "load_cv": 0.6545189544454729, + "normalized_load_entropy": 0.9467486482449375, + "max_load_share": 0.04583333333333333 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "9d139e5fec37c6e9fa979c30481225ecdd23094c13970cfd4f4a1ac9bcc43467", + "route_weight_sha256": "23afba32389cf2547cb303baa3a61dc8a7e8a11dcb908dcc78fc20fef2eeb43d", + "loads": [ + 12, + 34, + 15, + 8, + 4, + 23, + 19, + 14, + 19, + 5, + 14, + 12, + 3, + 2, + 15, + 10, + 0, + 21, + 9, + 5, + 17, + 2, + 33, + 20, + 15, + 9, + 11, + 13, + 13, + 23, + 20, + 13, + 18, + 21, + 32, + 6, + 17, + 10, + 19, + 3, + 12, + 27, + 7, + 9, + 9, + 23, + 3, + 13, + 12, + 1, + 26, + 24, + 8, + 18, + 8, + 5, + 2, + 6, + 22, + 7, + 14, + 43, + 3, + 9 + ], + "weighted_loads": [ + 0.45994197577238083, + 1.3338097874075174, + 0.4897500332444906, + 0.36741041764616966, + 0.15052065812051296, + 0.751277080969885, + 1.1561287436634302, + 0.6381881013512611, + 1.1108077447861433, + 0.3255477584898472, + 0.6014919767621905, + 0.5346932224929333, + 0.07759870029985905, + 0.09516515955328941, + 0.5355718284845352, + 0.40837923996150494, + 0.0, + 0.8824143912643194, + 0.33647106401622295, + 0.13752254284918308, + 0.8254161141812801, + 0.07179660350084305, + 1.8974878787994385, + 1.9246223866939545, + 0.6001267607789487, + 0.28300943225622177, + 0.5078437747433782, + 4.17704714089632, + 0.4971334505826235, + 0.9120391346514225, + 0.7632961627095938, + 0.462077796459198, + 0.645363062620163, + 1.7492306157946587, + 1.1070388220250607, + 0.23530806973576546, + 0.6401091031730175, + 1.1879894230514765, + 0.6477453485131264, + 0.1144310962408781, + 0.6128489430993795, + 0.9781616926193237, + 0.26281936652958393, + 0.31424187310039997, + 0.34826498478651047, + 0.7844867520034313, + 0.05772183649241924, + 0.6583444437710568, + 0.39486912451684475, + 0.08085436373949051, + 0.9949260782450438, + 1.683298958465457, + 0.24833764508366585, + 0.7417182940989733, + 0.7619365006685257, + 0.5844320021569729, + 0.06418492645025253, + 0.224061731249094, + 0.9300460238009691, + 0.2015627846121788, + 0.5103782452642918, + 2.7907648817636073, + 0.07845200970768929, + 1.2704184129834175 + ], + "unique_experts": 63, + "load_cv": 0.6552288743568843, + "normalized_load_entropy": 0.9474515434147053, + "max_load_share": 0.04942528735632184 + } + }, + "s1_period": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "36ccb8b1c7f71d1a259c3ce2bc600e8a31496ccfee5d3bca2422ff8b41da1628", + "route_weight_sha256": "c3f9384611d6e4fc175904cc8ce5d3330ea14bbf3a7ca12a9657804ecbfd1b19", + "loads": [ + 11, + 26, + 16, + 9, + 7, + 16, + 22, + 15, + 11, + 5, + 5, + 10, + 4, + 2, + 13, + 10, + 0, + 23, + 9, + 8, + 16, + 3, + 25, + 20, + 9, + 4, + 14, + 14, + 5, + 13, + 19, + 13, + 15, + 17, + 27, + 9, + 18, + 6, + 15, + 3, + 10, + 22, + 3, + 6, + 8, + 20, + 1, + 9, + 16, + 1, + 19, + 14, + 5, + 14, + 9, + 5, + 2, + 7, + 9, + 7, + 9, + 29, + 1, + 7 + ], + "weighted_loads": [ + 0.4515420850366354, + 1.0820289514958858, + 0.5179003030061722, + 0.4511253722012043, + 0.22487467341125011, + 0.5397287979722023, + 1.492445271462202, + 0.6435697488486767, + 0.835973596200347, + 0.32609955593943596, + 0.24332342855632305, + 0.4964223951101303, + 0.13204639963805676, + 0.09194381162524223, + 0.48861274868249893, + 0.43243877589702606, + 0.0, + 0.9245893768966198, + 0.3046891503036022, + 0.22892367094755173, + 0.7269779741764069, + 0.10932964459061623, + 1.2675009686499834, + 1.9158948957920074, + 0.3456914070993662, + 0.13699503988027573, + 0.7805105354636908, + 3.6153111178427935, + 0.1679394692182541, + 0.541942922398448, + 0.7203015517443419, + 0.4669678043574095, + 0.5170092713087797, + 1.5311222933232784, + 0.9448936618864536, + 0.3210226409137249, + 0.6017730180174112, + 0.2039725724607706, + 0.5224080216139555, + 0.10759700275957584, + 0.5138154067099094, + 0.7424311898648739, + 0.11343224346637726, + 0.19045849330723286, + 0.29768216237425804, + 0.7189691718667746, + 0.03927547484636307, + 0.3029510769993067, + 0.4985024221241474, + 0.0766674354672432, + 0.6878168303519487, + 0.9321823976933956, + 0.16191744804382324, + 0.6352362353354692, + 0.7198704779148102, + 0.5685929711908102, + 0.06218560039997101, + 0.2588135302066803, + 0.42398395761847496, + 0.1911764908581972, + 0.34294065833091736, + 1.6695542875677347, + 0.043859366327524185, + 0.2487844955176115 + ], + "unique_experts": 63, + "load_cv": 0.6259807120445899, + "normalized_load_entropy": 0.9500427740673043, + "max_load_share": 0.04027777777777778 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "ac79c92a722a3f393ed362e4d94f4c9cd94dd12df1038d12aef6d1701c0822cb", + "route_weight_sha256": "f1a9c1b06b161560e78ad8a0c4ff72d29012ac754a1a0b258015491c1120fac5", + "loads": [ + 11, + 26, + 17, + 10, + 9, + 23, + 22, + 17, + 19, + 8, + 12, + 12, + 8, + 2, + 18, + 10, + 0, + 23, + 10, + 10, + 21, + 4, + 35, + 21, + 19, + 4, + 14, + 14, + 24, + 18, + 19, + 16, + 15, + 23, + 34, + 11, + 25, + 11, + 15, + 3, + 11, + 30, + 7, + 9, + 9, + 22, + 1, + 16, + 16, + 1, + 26, + 31, + 12, + 19, + 11, + 7, + 2, + 8, + 26, + 8, + 13, + 50, + 7, + 11 + ], + "weighted_loads": [ + 0.4515420850366354, + 1.0820289514958858, + 0.5424669627100229, + 0.563192542642355, + 0.2849891036748886, + 0.7577949885744601, + 1.492445271462202, + 0.724188506603241, + 1.4228932205587626, + 0.45689718797802925, + 0.5577719679567963, + 0.5632748603820801, + 0.22228142665699124, + 0.09194381162524223, + 0.6430143248289824, + 0.43243877589702606, + 0.0, + 0.9245893768966198, + 0.3361179083585739, + 0.2950805891305208, + 0.9422607161104679, + 0.14921438694000244, + 1.909953836351633, + 1.9406752660870552, + 0.7067359655629843, + 0.13699503988027573, + 0.7805105354636908, + 3.6153111178427935, + 1.1472272463142872, + 0.7654459998011589, + 0.7203015517443419, + 0.6063787247985601, + 0.5170092713087797, + 1.842164121568203, + 1.1918507842347026, + 0.41726281121373177, + 1.119475519284606, + 1.2335989605635405, + 0.5224080216139555, + 0.10759700275957584, + 0.625506479293108, + 1.2049951665103436, + 0.22880578599870205, + 0.4495262186974287, + 0.33665965870022774, + 0.8169727269560099, + 0.03927547484636307, + 0.8465213755844161, + 0.4985024221241474, + 0.0766674354672432, + 1.012562122195959, + 2.0018077846616507, + 0.3639194965362549, + 0.9653953593224287, + 0.8941698297858238, + 0.6612965743988752, + 0.06218560039997101, + 0.2954678274691105, + 1.1240623407065868, + 0.22200993448495865, + 0.4685470499098301, + 3.5592644824646413, + 0.39227405562996864, + 1.3522840905934572 + ], + "unique_experts": 63, + "load_cv": 0.6159307200103137, + "normalized_load_entropy": 0.9534620165296307, + "max_load_share": 0.051759834368530024 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 120, + "ordered_topk_exact_tokens": 31, + "set_exact_tokens": 46, + "mean_set_jaccard": 0.792857142857143, + "mean_token_weighted_tv": 0.03442675633123145, + "aggregate_load_tv": 0.06111111111111111 + }, + "system_bos": { + "tokens": 120, + "ordered_topk_exact_tokens": 34, + "set_exact_tokens": 51, + "mean_set_jaccard": 0.8033730158730158, + "mean_token_weighted_tv": 0.03450079062798371, + "aggregate_load_tv": 0.07083333333333333 + }, + "system_x": { + "tokens": 120, + "ordered_topk_exact_tokens": 18, + "set_exact_tokens": 36, + "mean_set_jaccard": 0.7465079365079366, + "mean_token_weighted_tv": 0.04886851391832655, + "aggregate_load_tv": 0.07222222222222223 + }, + "system_period": { + "tokens": 120, + "ordered_topk_exact_tokens": 18, + "set_exact_tokens": 33, + "mean_set_jaccard": 0.7280555555555556, + "mean_token_weighted_tv": 0.051192756148520854, + "aggregate_load_tv": 0.06944444444444445 + }, + "bos_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 25, + "set_exact_tokens": 35, + "mean_set_jaccard": 0.7460317460317462, + "mean_token_weighted_tv": 0.042686873864537726, + "aggregate_load_tv": 0.07222222222222222 + }, + "bos_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 20, + "set_exact_tokens": 30, + "mean_set_jaccard": 0.7323412698412698, + "mean_token_weighted_tv": 0.044777853732618195, + "aggregate_load_tv": 0.06527777777777778 + }, + "x_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 23, + "set_exact_tokens": 35, + "mean_set_jaccard": 0.7274603174603176, + "mean_token_weighted_tv": 0.047331122068377834, + "aggregate_load_tv": 0.08611111111111111 + }, + "x_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 30, + "mean_set_jaccard": 0.711984126984127, + "mean_token_weighted_tv": 0.052342422803243, + "aggregate_load_tv": 0.08194444444444443 + }, + "period_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 26, + "set_exact_tokens": 36, + "mean_set_jaccard": 0.7281746031746031, + "mean_token_weighted_tv": 0.047463208832778034, + "aggregate_load_tv": 0.08472222222222223 + }, + "period_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 27, + "mean_set_jaccard": 0.6945238095238097, + "mean_token_weighted_tv": 0.05404848541753988, + "aggregate_load_tv": 0.07777777777777779 + } + } + }, + "layer_25": { + "layer": 25, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "1dcc51a938aadeeef19df65d1181b9ecdefc4a35fb0a92716d483adc2919f53b", + "route_weight_sha256": "9cbd9ba0f8038d7e1e68eec68de0748c026dadd19befc72dda3496769cf8477b", + "loads": [ + 20, + 28, + 10, + 13, + 14, + 9, + 6, + 9, + 18, + 8, + 31, + 2, + 11, + 7, + 0, + 1, + 7, + 9, + 7, + 20, + 6, + 6, + 10, + 6, + 13, + 16, + 23, + 1, + 18, + 4, + 16, + 3, + 18, + 19, + 20, + 4, + 10, + 32, + 12, + 23, + 18, + 8, + 6, + 6, + 18, + 29, + 7, + 2, + 7, + 11, + 19, + 5, + 5, + 5, + 14, + 6, + 0, + 23, + 0, + 9, + 7, + 3, + 17, + 5 + ], + "weighted_loads": [ + 0.9242538176476955, + 1.9571663215756416, + 0.3907656781375408, + 0.41090162470936775, + 0.47374056465923786, + 0.5463616251945496, + 0.2662404254078865, + 0.3115143198519945, + 0.6180561613291502, + 0.5623894110321999, + 2.304789809510112, + 0.09257010370492935, + 0.5791903622448444, + 0.2111568432301283, + 0.0, + 0.02758263610303402, + 0.5596645548939705, + 0.7353829443454742, + 0.5194906108081341, + 2.158819891512394, + 0.42596929147839546, + 0.22187263146042824, + 0.3861287534236908, + 0.44354716688394547, + 0.6682286895811558, + 1.852991808205843, + 0.8930769544094801, + 0.04151112586259842, + 1.4128478653728962, + 0.1262292116880417, + 1.2068306244909763, + 0.26948362588882446, + 0.7109490390866995, + 0.8007779773324728, + 0.6117878016084433, + 0.1928584761917591, + 0.598961777985096, + 1.4958775527775288, + 0.6947119552642107, + 1.7504380196332932, + 1.7991070412099361, + 0.3990899473428726, + 0.26489123702049255, + 0.23449768498539925, + 1.1373657435178757, + 1.6673603896051645, + 0.20911546982824802, + 0.07296162098646164, + 0.30471687763929367, + 0.3881857041269541, + 1.1476348154246807, + 0.2757948897778988, + 0.22411461919546127, + 0.18709420040249825, + 0.9062480013817549, + 0.2499875593930483, + 0.0, + 0.9222624357789755, + 0.0, + 0.7012204378843307, + 0.2635535057634115, + 0.0966005027294159, + 1.5418584160506725, + 0.16543146595358849 + ], + "unique_experts": 61, + "load_cv": 0.7039570693980959, + "normalized_load_entropy": 0.9382589594422877, + "max_load_share": 0.044444444444444446 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "9db27d5eab5c387d56e9b8d680214673f88670cbfcce80a922d317b9ef2d0f15", + "route_weight_sha256": "552ae3604bcd90ca5aae1a46e5f7de64d68e3e172579ab8eaaf1cadb5147bb80", + "loads": [ + 22, + 47, + 17, + 14, + 14, + 9, + 12, + 9, + 18, + 8, + 41, + 6, + 12, + 7, + 0, + 1, + 7, + 13, + 8, + 20, + 6, + 6, + 10, + 8, + 13, + 16, + 23, + 1, + 19, + 6, + 16, + 4, + 20, + 20, + 22, + 4, + 10, + 34, + 23, + 26, + 27, + 8, + 6, + 8, + 23, + 39, + 10, + 2, + 7, + 12, + 29, + 5, + 10, + 5, + 22, + 6, + 1, + 28, + 0, + 9, + 10, + 3, + 23, + 5 + ], + "weighted_loads": [ + 1.0235488414764404, + 3.441777723142877, + 0.924678098410368, + 0.47467179223895073, + 0.47374056465923786, + 0.5463616251945496, + 0.6742630079388618, + 0.3115143198519945, + 0.6180561613291502, + 0.5623894110321999, + 3.1953399162739515, + 0.7523441831581295, + 0.6441834755241871, + 0.2111568432301283, + 0.0, + 0.02758263610303402, + 0.5596645548939705, + 0.8637566026300192, + 0.546121908351779, + 2.158819891512394, + 0.42596929147839546, + 0.22187263146042824, + 0.3861287534236908, + 0.5356200709939003, + 0.6682286895811558, + 1.852991808205843, + 0.8930769544094801, + 0.04151112586259842, + 1.4552195817232132, + 0.19545742124319077, + 1.2068306244909763, + 0.35593704879283905, + 0.8379356395453215, + 0.8618154469877481, + 0.6985912527889013, + 0.1928584761917591, + 0.598961777985096, + 1.5789661183953285, + 2.1628469601273537, + 2.100800607353449, + 2.3210012447088957, + 0.3990899473428726, + 0.26489123702049255, + 0.3053704760968685, + 1.4826507847756147, + 2.4786267075687647, + 0.30082152131944895, + 0.07296162098646164, + 0.30471687763929367, + 0.4255922455340624, + 1.747794222086668, + 0.2757948897778988, + 0.4926629983820021, + 0.18709420040249825, + 1.2838346741627902, + 0.2499875593930483, + 0.04727427288889885, + 1.1604221761226654, + 0.0, + 0.7012204378843307, + 0.41448341496288776, + 0.0966005027294159, + 1.9891062285751104, + 0.16543146595358849 + ], + "unique_experts": 62, + "load_cv": 0.7546640112332818, + "normalized_load_entropy": 0.9335839931994793, + "max_load_share": 0.054022988505747126 + } + }, + "s1_eos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "130c9c4c55c6207b0a8cb1e81f7aac252d8a3aa6b748a107b45cb3851dc518b4", + "route_weight_sha256": "9225645d5372d69e57b8850e7c58054122a28288a7202559d84d33c053232a2f", + "loads": [ + 19, + 26, + 9, + 10, + 17, + 9, + 7, + 10, + 20, + 7, + 29, + 4, + 11, + 6, + 0, + 3, + 6, + 9, + 6, + 20, + 5, + 8, + 10, + 7, + 10, + 16, + 28, + 1, + 18, + 8, + 13, + 3, + 14, + 21, + 19, + 3, + 9, + 36, + 12, + 23, + 19, + 11, + 6, + 5, + 18, + 28, + 5, + 2, + 10, + 9, + 16, + 5, + 6, + 2, + 16, + 5, + 0, + 21, + 0, + 10, + 6, + 3, + 17, + 8 + ], + "weighted_loads": [ + 0.8925359398126602, + 1.844380259513855, + 0.36781787872314453, + 0.31187680549919605, + 0.5800855997949839, + 0.5581015311181545, + 0.34562045708298683, + 0.33832743018865585, + 0.6782860103994608, + 0.5221527479588985, + 2.211798071861267, + 0.15295742452144623, + 0.603804524987936, + 0.191654859110713, + 0.0, + 0.09203281812369823, + 0.4934663735330105, + 0.7298932746052742, + 0.4667951110750437, + 2.1131557784974575, + 0.3917462769895792, + 0.29281764663755894, + 0.3653539605438709, + 0.4870412554591894, + 0.5568569824099541, + 1.8608113639056683, + 1.0492273159325123, + 0.04024617001414299, + 1.3719473630189896, + 0.2409170549362898, + 1.2231689542531967, + 0.2658238001167774, + 0.5520873200148344, + 0.8499556444585323, + 0.6084929779171944, + 0.16184266284108162, + 0.5563055668026209, + 1.6280425172299147, + 0.7112989220768213, + 1.6568769719451666, + 1.7786847334355116, + 0.4913515243679285, + 0.2578398920595646, + 0.18721053004264832, + 1.145395565778017, + 1.5237006321549416, + 0.15211695805191994, + 0.06959997117519379, + 0.427438884973526, + 0.314469113945961, + 1.0011026877909899, + 0.28070175275206566, + 0.2656576447188854, + 0.08428734540939331, + 1.03721759095788, + 0.22890942357480526, + 0.0, + 0.9182989001274109, + 0.0, + 0.7111289482563734, + 0.24084319546818733, + 0.1019856221973896, + 1.609424315392971, + 0.2610887996852398 + ], + "unique_experts": 61, + "load_cv": 0.7085021585302159, + "normalized_load_entropy": 0.9387763864088302, + "max_load_share": 0.05 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "4875beca92f7b3c737988070a5ca369a4d47ac34b6e341de04edbeb780444cb5", + "route_weight_sha256": "dbe4d3e22a5e44c8491d3258f13d626d9d9d5d09ca5d6fb102915498463f3afc", + "loads": [ + 22, + 51, + 20, + 11, + 17, + 10, + 14, + 10, + 22, + 8, + 50, + 8, + 17, + 6, + 0, + 3, + 6, + 17, + 7, + 21, + 8, + 15, + 10, + 12, + 10, + 16, + 29, + 1, + 19, + 11, + 13, + 6, + 20, + 22, + 22, + 3, + 10, + 43, + 22, + 28, + 28, + 11, + 7, + 6, + 27, + 42, + 7, + 2, + 10, + 10, + 27, + 5, + 13, + 9, + 28, + 6, + 3, + 28, + 0, + 11, + 11, + 4, + 22, + 9 + ], + "weighted_loads": [ + 1.153544269502163, + 3.895058254012838, + 1.0043141674250364, + 0.38459126092493534, + 0.5800855997949839, + 0.5967814363539219, + 0.9365063831210136, + 0.33832743018865585, + 0.7921317722648382, + 0.5503794085234404, + 4.069988835602999, + 0.8773638559505343, + 0.9158813506364822, + 0.191654859110713, + 0.0, + 0.09203281812369823, + 0.4934663735330105, + 1.3784647956490517, + 0.5187079515308142, + 2.1368563026189804, + 0.6499799434095621, + 0.9312962852418423, + 0.3653539605438709, + 0.6793551575392485, + 0.5568569824099541, + 1.8608113639056683, + 1.08305025100708, + 0.04024617001414299, + 1.4174211733043194, + 0.3453335426747799, + 1.2231689542531967, + 0.7398728169500828, + 0.8512485716491938, + 0.8958786465227604, + 0.7564776875078678, + 0.16184266284108162, + 0.6008967068046331, + 1.9634409192949533, + 2.4006326626986265, + 2.113388678058982, + 2.314992355182767, + 0.4913515243679285, + 0.34464510157704353, + 0.21745236031711102, + 1.7803943678736687, + 2.7833920884877443, + 0.19461364997550845, + 0.06959997117519379, + 0.427438884973526, + 0.3595176376402378, + 1.6879575420171022, + 0.28070175275206566, + 0.7066169902682304, + 0.590185958892107, + 1.8152181792538613, + 0.2555602826178074, + 0.12963619083166122, + 1.2406094670295715, + 0.0, + 0.8006758447736502, + 0.5552641972899437, + 0.14462560787796974, + 2.0395953617990017, + 0.2867756150662899 + ], + "unique_experts": 62, + "load_cv": 0.7480712611312604, + "normalized_load_entropy": 0.936692175292594, + "max_load_share": 0.052795031055900624 + } + }, + "s0_bos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "9e6f2044a7492e9379123600d5a0554e1083cbb89cfed5709545a95e208c7b73", + "route_weight_sha256": "6b944de8dc8797eb2b3b3486f30fa0063db4c3bd8ffa8dcfa33b01de13dac55d", + "loads": [ + 20, + 30, + 16, + 14, + 20, + 9, + 7, + 10, + 20, + 8, + 29, + 3, + 11, + 6, + 0, + 6, + 6, + 8, + 7, + 19, + 7, + 4, + 12, + 7, + 13, + 16, + 24, + 1, + 18, + 5, + 14, + 3, + 15, + 17, + 16, + 4, + 9, + 32, + 11, + 21, + 18, + 11, + 4, + 2, + 16, + 28, + 7, + 2, + 6, + 11, + 20, + 5, + 6, + 3, + 15, + 5, + 1, + 19, + 0, + 12, + 6, + 3, + 16, + 6 + ], + "weighted_loads": [ + 0.9946123994886875, + 1.8942882101982832, + 0.6620324552059174, + 0.42330966144800186, + 0.6520587988197803, + 0.581153716892004, + 0.32687773182988167, + 0.3358093984425068, + 0.6669159941375256, + 0.5530808046460152, + 2.283939551562071, + 0.12261340394616127, + 0.650228925049305, + 0.18178137578070164, + 0.0, + 0.1653867419809103, + 0.5008750855922699, + 0.7458397075533867, + 0.5264721848070621, + 2.171091165393591, + 0.4587718043476343, + 0.17502666637301445, + 0.44377589225769043, + 0.49874212220311165, + 0.6700728591531515, + 1.8824870325624943, + 0.910020750015974, + 0.04536791518330574, + 1.427645580843091, + 0.16949498280882835, + 1.2699034437537193, + 0.27310583740472794, + 0.6112947091460228, + 0.6941134668886662, + 0.5217229146510363, + 0.19733630865812302, + 0.6293080747127533, + 1.476835709065199, + 0.6794943585991859, + 1.6741566359996796, + 1.8796894401311874, + 0.5012805741280317, + 0.1971127726137638, + 0.07613186165690422, + 1.0457386001944542, + 1.5907174572348595, + 0.2021563369780779, + 0.08262554183602333, + 0.26244427263736725, + 0.3964519500732422, + 1.2204249240458012, + 0.28633932396769524, + 0.23503564670681953, + 0.1166766881942749, + 0.9966260381042957, + 0.24272718280553818, + 0.03702462464570999, + 0.7587658856064081, + 0.0, + 0.7902722805738449, + 0.23820776864886284, + 0.1004772037267685, + 1.55260743573308, + 0.19137108325958252 + ], + "unique_experts": 62, + "load_cv": 0.6888888888888889, + "normalized_load_entropy": 0.9410319408550825, + "max_load_share": 0.044444444444444446 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "97dd5606c57b548831710bdccf4640c94a2bf129c8192bd1b3f56e80d80ed3e7", + "route_weight_sha256": "b88313b831dd7a7dbd80fd3767462fd9a97efe122922d4be4dd2ac96bbc3a70a", + "loads": [ + 21, + 48, + 24, + 15, + 20, + 9, + 13, + 11, + 20, + 8, + 39, + 6, + 14, + 6, + 0, + 6, + 6, + 12, + 8, + 19, + 7, + 4, + 12, + 9, + 13, + 16, + 24, + 1, + 19, + 8, + 15, + 4, + 17, + 18, + 18, + 4, + 10, + 33, + 21, + 23, + 27, + 12, + 4, + 4, + 21, + 36, + 9, + 2, + 6, + 13, + 30, + 5, + 10, + 3, + 24, + 5, + 2, + 25, + 0, + 12, + 8, + 3, + 22, + 6 + ], + "weighted_loads": [ + 1.042384434491396, + 3.300201457226649, + 1.2236360311508179, + 0.5572830066084862, + 0.6520587988197803, + 0.581153716892004, + 0.734900314360857, + 0.3765684552490711, + 0.6669159941375256, + 0.5530808046460152, + 3.235802672803402, + 0.7763213217258453, + 0.8135770075023174, + 0.18178137578070164, + 0.0, + 0.1653867419809103, + 0.5008750855922699, + 0.8742133658379316, + 0.553103482350707, + 2.171091165393591, + 0.4587718043476343, + 0.17502666637301445, + 0.44377589225769043, + 0.5908150263130665, + 0.6700728591531515, + 1.8824870325624943, + 0.910020750015974, + 0.04536791518330574, + 1.470017297193408, + 0.2687460742890835, + 1.550881765782833, + 0.3595592603087425, + 0.728129506111145, + 0.7551509365439415, + 0.6337105389684439, + 0.19733630865812302, + 0.6898286454379559, + 1.5298492424190044, + 1.2375239562243223, + 2.09850150346756, + 2.392136024311185, + 0.5577494669705629, + 0.1971127726137638, + 0.14224373549222946, + 1.3883622493594885, + 2.304240070283413, + 0.2925449628382921, + 0.08262554183602333, + 0.26244427263736725, + 0.47745581343770027, + 1.8205843307077885, + 0.28633932396769524, + 0.4993976652622223, + 0.1166766881942749, + 1.4247319351416081, + 0.24272718280553818, + 0.08641505986452103, + 1.0135502330958843, + 0.0, + 0.7902722805738449, + 0.35064174234867096, + 0.1004772037267685, + 1.9998552482575178, + 0.19137108325958252 + ], + "unique_experts": 62, + "load_cv": 0.7349098465079816, + "normalized_load_entropy": 0.9363318466030794, + "max_load_share": 0.05517241379310345 + } + }, + "s1_bos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "4922e0198e9f70f4e9b9c91b46f359d2b32e1716887c063eadb952493b02400f", + "route_weight_sha256": "0d05f486ceb4d9c702c9906409e72ab0309a09a19de8d2f4da3c98478fd69153", + "loads": [ + 21, + 26, + 13, + 14, + 16, + 10, + 7, + 12, + 18, + 8, + 28, + 2, + 11, + 8, + 0, + 4, + 6, + 8, + 7, + 20, + 6, + 5, + 11, + 7, + 12, + 16, + 25, + 1, + 18, + 5, + 14, + 2, + 13, + 18, + 20, + 4, + 10, + 37, + 12, + 22, + 19, + 11, + 4, + 4, + 15, + 25, + 8, + 2, + 7, + 9, + 19, + 5, + 8, + 3, + 15, + 5, + 0, + 20, + 0, + 9, + 5, + 4, + 16, + 10 + ], + "weighted_loads": [ + 0.9905453715473413, + 1.7808088194578886, + 0.6161128766834736, + 0.45633711479604244, + 0.5509641077369452, + 0.6147033851593733, + 0.32202356308698654, + 0.41228604689240456, + 0.6137393843382597, + 0.5350871365517378, + 2.1531444266438484, + 0.08749634772539139, + 0.6269327141344547, + 0.2672993838787079, + 0.0, + 0.12026121839880943, + 0.5058191865682602, + 0.7229217290878296, + 0.5518224202096462, + 2.197461862117052, + 0.4367822539061308, + 0.2230502888560295, + 0.39997575618326664, + 0.4630160927772522, + 0.6543517336249352, + 1.8673014491796494, + 0.963811133056879, + 0.04174595698714256, + 1.3709486592561007, + 0.17072818800807, + 1.5220938883721828, + 0.23824532330036163, + 0.5188914202153683, + 0.7098531015217304, + 0.6599534898996353, + 0.19150158762931824, + 0.6397062465548515, + 1.6066944673657417, + 0.7518409620970488, + 1.5993332955986261, + 1.7794903442263603, + 0.5063756369054317, + 0.2002347782254219, + 0.15525871142745018, + 0.9724960550665855, + 1.4403468389064074, + 0.2379705999046564, + 0.08041283115744591, + 0.3209526091814041, + 0.3297080919146538, + 1.1468094810843468, + 0.27683257311582565, + 0.3555131424218416, + 0.12148107960820198, + 1.029770027846098, + 0.24050240963697433, + 0.0, + 0.7964333333075047, + 0.0, + 0.7068811357021332, + 0.21259001269936562, + 0.14368966594338417, + 1.5841368064284325, + 0.3148339707404375 + ], + "unique_experts": 61, + "load_cv": 0.6865551869233515, + "normalized_load_entropy": 0.9411403193770821, + "max_load_share": 0.05138888888888889 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "8d951ca1507a60b92599b5a64f23de42a7ca7152e635cf8c058cb04b6479465e", + "route_weight_sha256": "3ca891d5b5f29d0b69c52bbb3773f55ee7c1d66ed685ddfdaf1468946553c72c", + "loads": [ + 23, + 51, + 25, + 15, + 16, + 11, + 14, + 12, + 21, + 9, + 50, + 5, + 18, + 8, + 0, + 4, + 6, + 16, + 8, + 21, + 9, + 12, + 11, + 12, + 12, + 16, + 26, + 1, + 19, + 7, + 14, + 5, + 20, + 19, + 23, + 4, + 11, + 44, + 21, + 26, + 28, + 11, + 5, + 6, + 24, + 39, + 9, + 2, + 7, + 11, + 30, + 5, + 14, + 10, + 27, + 6, + 3, + 27, + 0, + 10, + 9, + 5, + 21, + 12 + ], + "weighted_loads": [ + 1.18904915638268, + 3.7705243232194334, + 1.339128052815795, + 0.5061167385429144, + 0.5509641077369452, + 0.6533832903951406, + 0.9129094891250134, + 0.41228604689240456, + 0.7749952170997858, + 0.5633137971162796, + 4.116604272276163, + 0.7954136729240417, + 0.9934188835322857, + 0.2672993838787079, + 0.0, + 0.12026121839880943, + 0.5058191865682602, + 1.371493250131607, + 0.6037352606654167, + 2.221162386238575, + 0.6950159203261137, + 0.8615289274603128, + 0.39997575618326664, + 0.6553299948573112, + 0.6543517336249352, + 1.8673014491796494, + 0.9976340681314468, + 0.04174595698714256, + 1.4164224695414305, + 0.23790896125137806, + 1.5220938883721828, + 0.712294340133667, + 0.8702464550733566, + 0.7557761035859585, + 0.8169865347445011, + 0.19150158762931824, + 0.6842973865568638, + 1.9465252794325352, + 1.5402516294270754, + 2.0429539922624826, + 2.279986221343279, + 0.5063756369054317, + 0.28703998774290085, + 0.22140162251889706, + 1.6134135723114014, + 2.6602756325155497, + 0.2791340369731188, + 0.08041283115744591, + 0.3209526091814041, + 0.42057906463742256, + 1.8336643353104591, + 0.27683257311582565, + 0.7922969814389944, + 0.6273796930909157, + 1.8077706161420792, + 0.26715326867997646, + 0.15621837228536606, + 1.1303829234093428, + 0.0, + 0.7964280322194099, + 0.45851849764585495, + 0.1863296516239643, + 2.014307852834463, + 0.37429442442953587 + ], + "unique_experts": 62, + "load_cv": 0.7349371573126425, + "normalized_load_entropy": 0.9387069320154282, + "max_load_share": 0.052795031055900624 + } + }, + "s0_x": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "19fde3944d1a681b338fa02b14116a770a5ec56244542d844de60248278b8ef3", + "route_weight_sha256": "6f94d6e418b2356545029a33e1a94156bce7388725613d75c97106ba0ff4621c", + "loads": [ + 20, + 31, + 11, + 12, + 19, + 10, + 6, + 10, + 22, + 7, + 29, + 1, + 11, + 6, + 0, + 1, + 7, + 11, + 6, + 19, + 6, + 7, + 9, + 6, + 13, + 16, + 23, + 1, + 18, + 6, + 16, + 3, + 15, + 16, + 18, + 3, + 8, + 31, + 11, + 23, + 19, + 10, + 5, + 2, + 17, + 27, + 9, + 2, + 8, + 12, + 20, + 5, + 7, + 4, + 17, + 5, + 0, + 20, + 0, + 10, + 8, + 3, + 17, + 5 + ], + "weighted_loads": [ + 0.9736211150884628, + 1.9591039456427097, + 0.43590374663472176, + 0.3541375454515219, + 0.6481959335505962, + 0.5465931221842766, + 0.28849395364522934, + 0.34603751078248024, + 0.7470774799585342, + 0.49441252648830414, + 2.224917287006974, + 0.0500713549554348, + 0.6936248019337654, + 0.18327124416828156, + 0.0, + 0.037791669368743896, + 0.5469783805310726, + 0.8333680629730225, + 0.5341423060745001, + 2.2118423134088516, + 0.4430745095014572, + 0.25264893285930157, + 0.3446716256439686, + 0.44436854496598244, + 0.700890738517046, + 1.9274758510291576, + 0.8935630433261395, + 0.04362690821290016, + 1.4915240462869406, + 0.192397840321064, + 1.324612494558096, + 0.2637558728456497, + 0.5938489213585854, + 0.6640295125544071, + 0.5742923263460398, + 0.15651221200823784, + 0.6159368753433228, + 1.4529064800590277, + 0.6829886808991432, + 1.748663704842329, + 1.9325788095593452, + 0.5330278240144253, + 0.23109015822410583, + 0.07617339864373207, + 1.1325190290808678, + 1.496599953621626, + 0.26093030348420143, + 0.07933349907398224, + 0.3660319708287716, + 0.4274014327675104, + 1.1777067705988884, + 0.28026364371180534, + 0.28915987722575665, + 0.1560077704489231, + 1.0103101711720228, + 0.24595990777015686, + 0.0, + 0.8044657669961452, + 0.0, + 0.7344738133251667, + 0.3104030601680279, + 0.10159028321504593, + 1.5461234264075756, + 0.15617277100682259 + ], + "unique_experts": 61, + "load_cv": 0.7014975163406487, + "normalized_load_entropy": 0.9370896040777378, + "max_load_share": 0.043055555555555555 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "ed8dd9c2009f0fd8b79f0509f0cf4930674acea5c71924ac9913dfcbc2e69245", + "route_weight_sha256": "703f072ec44364ead139409ec3f9b1d9a9c1b611bcbaf013122610b686ec89d3", + "loads": [ + 22, + 51, + 17, + 13, + 19, + 10, + 14, + 10, + 22, + 7, + 39, + 4, + 13, + 6, + 0, + 1, + 7, + 15, + 8, + 19, + 6, + 7, + 9, + 8, + 13, + 16, + 23, + 1, + 19, + 9, + 16, + 5, + 17, + 17, + 19, + 3, + 9, + 32, + 22, + 25, + 29, + 10, + 5, + 3, + 22, + 35, + 11, + 2, + 9, + 12, + 30, + 5, + 12, + 4, + 26, + 5, + 0, + 25, + 0, + 10, + 10, + 3, + 24, + 5 + ], + "weighted_loads": [ + 1.0583518221974373, + 3.5282952098641545, + 0.8332776091992855, + 0.3884302992373705, + 0.6481959335505962, + 0.5465931221842766, + 0.821125689893961, + 0.34603751078248024, + 0.7470774799585342, + 0.49441252648830414, + 3.152645507827401, + 0.7097998633980751, + 0.8081619217991829, + 0.18327124416828156, + 0.0, + 0.037791669368743896, + 0.5469783805310726, + 0.9617417212575674, + 0.5881567522883415, + 2.2118423134088516, + 0.4430745095014572, + 0.25264893285930157, + 0.3446716256439686, + 0.5364414490759373, + 0.700890738517046, + 1.9274758510291576, + 0.8935630433261395, + 0.04362690821290016, + 1.5338957626372576, + 0.30475350841879845, + 1.324612494558096, + 0.4430526793003082, + 0.7142782732844353, + 0.7250669822096825, + 0.6234348099678755, + 0.15651221200823784, + 0.6779308095574379, + 1.5195309799164534, + 1.354707470163703, + 2.1594348661601543, + 2.4943798687309027, + 0.5330278240144253, + 0.23109015822410583, + 0.10870455577969551, + 1.4838155936449766, + 2.2356065176427364, + 0.35131892934441566, + 0.07933349907398224, + 0.40512100234627724, + 0.4274014327675104, + 1.7778661772608757, + 0.28026364371180534, + 0.666656019166112, + 0.1560077704489231, + 1.4579364589881152, + 0.24595990777015686, + 0.0, + 1.0112349763512611, + 0.0, + 0.7344738133251667, + 0.42638710141181946, + 0.10159028321504593, + 2.0328981820493937, + 0.15617277100682259 + ], + "unique_experts": 61, + "load_cv": 0.7567898492589206, + "normalized_load_entropy": 0.9316792316842963, + "max_load_share": 0.05862068965517241 + } + }, + "s1_x": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "323438440a6a6e617c572110ce0cea62d672225cdcada89a5769736c74e0f4dd", + "route_weight_sha256": "db2ec4c1f832f94befef7ffcc0211726ed6bd4aeea8b4df05dcebde41d123b40", + "loads": [ + 20, + 29, + 12, + 11, + 18, + 8, + 5, + 18, + 16, + 7, + 30, + 1, + 11, + 6, + 0, + 3, + 6, + 9, + 7, + 19, + 6, + 7, + 14, + 6, + 11, + 16, + 27, + 1, + 17, + 5, + 14, + 4, + 14, + 21, + 16, + 3, + 9, + 37, + 13, + 23, + 18, + 13, + 3, + 0, + 16, + 26, + 7, + 2, + 10, + 11, + 18, + 5, + 6, + 3, + 15, + 4, + 0, + 20, + 0, + 9, + 6, + 4, + 16, + 8 + ], + "weighted_loads": [ + 0.9289223570376635, + 1.9445183165371418, + 0.441071605309844, + 0.37673266790807247, + 0.6289340201765299, + 0.4676639176905155, + 0.259912583976984, + 0.6248585637658834, + 0.5691405292600393, + 0.5237806774675846, + 2.210751971229911, + 0.03902644291520119, + 0.6419913284480572, + 0.19798084907233715, + 0.0, + 0.08856347389519215, + 0.4911128878593445, + 0.7254570312798023, + 0.5162578150629997, + 2.1309651732444763, + 0.4314040932804346, + 0.276850663125515, + 0.5362604558467865, + 0.38013886101543903, + 0.5977317579090595, + 1.9005409255623817, + 1.0149977505207062, + 0.03941040858626366, + 1.3176433984190226, + 0.17843759804964066, + 1.5619243457913399, + 0.30505042523145676, + 0.5441340170800686, + 0.8424741756170988, + 0.5461710710078478, + 0.15110836178064346, + 0.5507284328341484, + 1.6389935705810785, + 0.7487127743661404, + 1.643258798867464, + 1.7674397006630898, + 0.6329725831747055, + 0.1634116806089878, + 0.0, + 1.0963652282953262, + 1.4101150464266539, + 0.21211343631148338, + 0.07697529718279839, + 0.4652963764965534, + 0.41922253742814064, + 1.0579345412552357, + 0.2678308039903641, + 0.308994410559535, + 0.1230081170797348, + 0.8278571330010891, + 0.21324973925948143, + 0.0, + 0.8340066038072109, + 0.0, + 0.6784692667424679, + 0.2465907782316208, + 0.14137974753975868, + 1.5565154068171978, + 0.2727379184216261 + ], + "unique_experts": 60, + "load_cv": 0.7233324799448798, + "normalized_load_entropy": 0.9339894750518756, + "max_load_share": 0.05138888888888889 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "cc06d5738bae492020a0109c5ad4b1acb7f45e9f9819d7a92e0f00a1037aece6", + "route_weight_sha256": "8d63cd2d97eb84ae04dbeff19aba0c4e887aa75a24f8b9effabe20de3b89aab6", + "loads": [ + 23, + 55, + 22, + 11, + 18, + 9, + 14, + 18, + 18, + 8, + 52, + 4, + 16, + 6, + 0, + 3, + 6, + 18, + 8, + 20, + 9, + 14, + 14, + 11, + 11, + 16, + 28, + 1, + 18, + 8, + 14, + 8, + 20, + 22, + 18, + 3, + 10, + 43, + 23, + 27, + 27, + 13, + 4, + 1, + 26, + 40, + 8, + 2, + 10, + 11, + 31, + 5, + 15, + 10, + 28, + 5, + 1, + 27, + 0, + 10, + 10, + 5, + 21, + 9 + ], + "weighted_loads": [ + 1.1646087672561407, + 4.042388105997816, + 0.9653600361198187, + 0.37673266790807247, + 0.6289340201765299, + 0.5063438229262829, + 1.0443539917469025, + 0.6248585637658834, + 0.6829862911254168, + 0.5520073380321264, + 4.147035358473659, + 0.7622235678136349, + 0.9159899465739727, + 0.19798084907233715, + 0.0, + 0.08856347389519215, + 0.4911128878593445, + 1.422298140823841, + 0.5681706555187702, + 2.154665697365999, + 0.6896377597004175, + 0.9153293017297983, + 0.5362604558467865, + 0.5724527630954981, + 0.5977317579090595, + 1.9005409255623817, + 1.048820685595274, + 0.03941040858626366, + 1.3631172087043524, + 0.2912744674831629, + 1.5619243457913399, + 0.8797642141580582, + 0.8325992077589035, + 0.8883971776813269, + 0.6515349876135588, + 0.15110836178064346, + 0.5953195728361607, + 1.9146459382027388, + 1.5995984822511673, + 2.096456680446863, + 2.3044252768158913, + 0.6329725831747055, + 0.25021689012646675, + 0.0302418302744627, + 1.7791568227112293, + 2.642243580892682, + 0.25327687337994576, + 0.07697529718279839, + 0.4652963764965534, + 0.41922253742814064, + 1.885483916848898, + 0.2678308039903641, + 0.9361990801990032, + 0.6289067305624485, + 1.685189752606675, + 0.23990059830248356, + 0.03093954175710678, + 1.1414723806083202, + 0.0, + 0.7680161632597446, + 0.48609087243676186, + 0.18401973322033882, + 1.9866864532232285, + 0.2984247338026762 + ], + "unique_experts": 62, + "load_cv": 0.7698495445648812, + "normalized_load_entropy": 0.9322016806665354, + "max_load_share": 0.056935817805383024 + } + }, + "s0_period": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "07fd0055ec42811f827f7abc1109479e80741243455ff43f88a8573650e4cf80", + "route_weight_sha256": "ab7682c1669b478d176c5b3b565d08a8cbcc53c792e9294d30cf2f438213c505", + "loads": [ + 21, + 30, + 11, + 15, + 17, + 10, + 7, + 14, + 22, + 8, + 30, + 2, + 11, + 4, + 0, + 2, + 6, + 8, + 7, + 19, + 6, + 7, + 11, + 6, + 14, + 16, + 21, + 1, + 18, + 5, + 15, + 3, + 14, + 16, + 15, + 4, + 8, + 32, + 10, + 23, + 19, + 9, + 5, + 1, + 18, + 31, + 11, + 2, + 6, + 9, + 20, + 5, + 6, + 4, + 17, + 5, + 0, + 20, + 0, + 10, + 8, + 3, + 16, + 6 + ], + "weighted_loads": [ + 0.9684174992144108, + 1.9237442035228014, + 0.4257518108934164, + 0.45083998143672943, + 0.5829865261912346, + 0.576220216229558, + 0.32983028143644333, + 0.4773276671767235, + 0.7558665387332439, + 0.5527289174497128, + 2.250145923346281, + 0.08185101300477982, + 0.7086176723241806, + 0.12429541163146496, + 0.0, + 0.06073358841240406, + 0.5130781754851341, + 0.7357359565794468, + 0.561725165694952, + 2.1869903169572353, + 0.4386786352843046, + 0.24773165956139565, + 0.42059873044490814, + 0.46047307178378105, + 0.7253492251038551, + 1.9214290753006935, + 0.8029223810881376, + 0.04469330981373787, + 1.4725957531481981, + 0.16733455285429955, + 1.3671325892210007, + 0.2628962844610214, + 0.5863794256001711, + 0.6729527078568935, + 0.4770306460559368, + 0.19306525960564613, + 0.5878426507115364, + 1.5323924161493778, + 0.6439665518701077, + 1.7863427698612213, + 2.041317917406559, + 0.47821930795907974, + 0.22771084308624268, + 0.04220746457576752, + 1.1788056455552578, + 1.6751220058649778, + 0.31169991940259933, + 0.07646903768181801, + 0.28547460585832596, + 0.3274513501673937, + 1.1953850574791431, + 0.28542404994368553, + 0.22936258651316166, + 0.15659190714359283, + 1.0760292317718267, + 0.24823345616459846, + 0.0, + 0.792926212772727, + 0.0, + 0.7173240762203932, + 0.31216736882925034, + 0.10360706597566605, + 1.5155077539384365, + 0.19113830663263798 + ], + "unique_experts": 61, + "load_cv": 0.7118052168020873, + "normalized_load_entropy": 0.9364612596688344, + "max_load_share": 0.044444444444444446 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "452f6d263484672a9963115c2d830eb9183478dac3cdb6067ac12db9771bf7da", + "route_weight_sha256": "02c8621967e064eb40a226ed837d19fd83a3e7b9c73474844cd7eaf6caae2965", + "loads": [ + 23, + 50, + 18, + 15, + 17, + 10, + 13, + 14, + 22, + 8, + 41, + 5, + 14, + 5, + 0, + 3, + 6, + 12, + 8, + 19, + 6, + 7, + 11, + 8, + 14, + 16, + 21, + 1, + 19, + 8, + 15, + 4, + 16, + 17, + 17, + 4, + 9, + 33, + 20, + 25, + 28, + 9, + 5, + 2, + 23, + 40, + 13, + 2, + 6, + 9, + 30, + 5, + 11, + 4, + 26, + 5, + 0, + 25, + 0, + 10, + 11, + 3, + 22, + 7 + ], + "weighted_loads": [ + 1.0634072683751583, + 3.530771397287026, + 0.8489505890756845, + 0.45083998143672943, + 0.5829865261912346, + 0.576220216229558, + 0.7378528639674187, + 0.4773276671767235, + 0.7558665387332439, + 0.5527289174497128, + 3.218141373246908, + 0.7480642907321453, + 0.8616881258785725, + 0.16078844852745533, + 0.0, + 0.10395951010286808, + 0.5130781754851341, + 0.8641096148639917, + 0.5883564632385969, + 2.1869903169572353, + 0.4386786352843046, + 0.24773165956139565, + 0.42059873044490814, + 0.5525459758937359, + 0.7253492251038551, + 1.9214290753006935, + 0.8029223810881376, + 0.04469330981373787, + 1.5149674694985151, + 0.27854593098163605, + 1.3671325892210007, + 0.349349707365036, + 0.6977250594645739, + 0.7339901775121689, + 0.5687256120145321, + 0.19306525960564613, + 0.6622132062911987, + 1.590385764837265, + 1.201996149495244, + 2.2421387434005737, + 2.5509773660451174, + 0.47821930795907974, + 0.22771084308624268, + 0.07473862171173096, + 1.532975785434246, + 2.5384752731770277, + 0.40208854526281357, + 0.07646903768181801, + 0.28547460585832596, + 0.3274513501673937, + 1.7955444641411304, + 0.28542404994368553, + 0.5325494352728128, + 0.15659190714359283, + 1.4960970885585994, + 0.24823345616459846, + 0.0, + 0.9860488995909691, + 0.0, + 0.7173240762203932, + 0.4556559547781944, + 0.10360706597566605, + 1.9627555664628744, + 0.32004023529589176 + ], + "unique_experts": 61, + "load_cv": 0.7656760043852574, + "normalized_load_entropy": 0.9314531774600305, + "max_load_share": 0.05747126436781609 + } + }, + "s1_period": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "07c71a6cadbc80e33ce0739ac4f32e92e2c363d293d0c52bccfb09a9552a48d1", + "route_weight_sha256": "e8c63ed3ae63e261f5bd5fe3ba31b17a1effcf252de6cf339c81a728993669b3", + "loads": [ + 20, + 30, + 12, + 12, + 19, + 9, + 5, + 19, + 17, + 8, + 29, + 2, + 12, + 5, + 0, + 2, + 5, + 8, + 6, + 20, + 6, + 8, + 14, + 6, + 10, + 16, + 23, + 1, + 17, + 6, + 13, + 4, + 14, + 23, + 15, + 3, + 8, + 38, + 13, + 22, + 17, + 13, + 3, + 2, + 17, + 26, + 7, + 2, + 9, + 11, + 18, + 5, + 9, + 2, + 15, + 4, + 1, + 19, + 0, + 9, + 5, + 4, + 16, + 6 + ], + "weighted_loads": [ + 0.9384015295654535, + 2.0300440713763237, + 0.4408023301512003, + 0.41462910361588, + 0.6539063900709152, + 0.5117571540176868, + 0.2577594220638275, + 0.647851750254631, + 0.609147822484374, + 0.5638710260391235, + 2.1586006581783295, + 0.0749627910554409, + 0.7167331501841545, + 0.17689947970211506, + 0.0, + 0.07367876544594765, + 0.44650720432400703, + 0.7200201489031315, + 0.518256114795804, + 2.15563553199172, + 0.4293150994926691, + 0.2916958723217249, + 0.5304239112883806, + 0.36994760297238827, + 0.5699735470116138, + 1.9160428829491138, + 0.8598722480237484, + 0.039227064698934555, + 1.3249020464718342, + 0.20648377761244774, + 1.6170510686933994, + 0.29261944256722927, + 0.5235518626868725, + 0.8932102527469397, + 0.4856120254844427, + 0.1501089408993721, + 0.5413929987698793, + 1.7225959822535515, + 0.7646515723317862, + 1.6617389060556889, + 1.7276521101593971, + 0.6400559693574905, + 0.16680640541017056, + 0.07346723228693008, + 1.1076583173125982, + 1.4286647588014603, + 0.2111988589167595, + 0.08104866370558739, + 0.4303537718951702, + 0.4139361809939146, + 1.069123575463891, + 0.26257022842764854, + 0.4340620469301939, + 0.09106600657105446, + 0.877369087189436, + 0.206308264285326, + 0.031214158982038498, + 0.7810167763382196, + 0.0, + 0.6985672228038311, + 0.2081371583044529, + 0.1403125450015068, + 1.5883824490010738, + 0.19315217807888985 + ], + "unique_experts": 62, + "load_cv": 0.7202537275840823, + "normalized_load_entropy": 0.9363124544418497, + "max_load_share": 0.05277777777777778 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "9c282efeec69edb79f281184a38f0d445862bd1ac41b60bab8225f6fe4ecc809", + "route_weight_sha256": "16f814f3109f857e75c3dbae850174ea54067430c93c46d058b445516680fe14", + "loads": [ + 23, + 56, + 21, + 12, + 19, + 10, + 12, + 19, + 19, + 9, + 51, + 5, + 18, + 5, + 0, + 3, + 5, + 16, + 8, + 21, + 9, + 15, + 14, + 11, + 10, + 16, + 24, + 1, + 18, + 9, + 13, + 7, + 20, + 24, + 18, + 3, + 9, + 45, + 22, + 27, + 26, + 13, + 4, + 3, + 27, + 41, + 8, + 2, + 9, + 11, + 29, + 5, + 16, + 9, + 28, + 5, + 3, + 26, + 0, + 10, + 10, + 5, + 21, + 8 + ], + "weighted_loads": [ + 1.2021977994590998, + 4.183459522435442, + 0.9435341320931911, + 0.41462910361588, + 0.6539063900709152, + 0.5504370592534542, + 0.8486453481018543, + 0.647851750254631, + 0.7229935843497515, + 0.5920976866036654, + 4.115191105753183, + 0.7883047722280025, + 1.0210332199931145, + 0.17689947970211506, + 0.0, + 0.110425665974617, + 0.44650720432400703, + 1.368591669946909, + 0.5955380126833916, + 2.179336056113243, + 0.687548765912652, + 0.9301745109260082, + 0.5304239112883806, + 0.5622615050524473, + 0.5699735470116138, + 1.9160428829491138, + 0.8936951830983162, + 0.039227064698934555, + 1.370375856757164, + 0.32146229036152363, + 1.6170510686933994, + 0.7666684594005346, + 0.7989779971539974, + 0.9391332548111677, + 0.6417432259768248, + 0.1501089408993721, + 0.5859841387718916, + 2.0334294140338898, + 1.5530622396618128, + 2.1533763371407986, + 2.2446810640394688, + 0.6400559693574905, + 0.2536116149276495, + 0.10370906256139278, + 1.8124562669545412, + 2.7173799742013216, + 0.25236229598522186, + 0.08104866370558739, + 0.4303537718951702, + 0.4139361809939146, + 1.7559784296900034, + 0.26257022842764854, + 0.9288621973246336, + 0.5969646200537682, + 1.7217844265978783, + 0.23295912332832813, + 0.10324422642588615, + 1.0811062939465046, + 0.0, + 0.7881141193211079, + 0.4832777604460716, + 0.18295253068208694, + 2.0185534954071045, + 0.44798463955521584 + ], + "unique_experts": 62, + "load_cv": 0.7694039749511095, + "normalized_load_entropy": 0.9336491386099065, + "max_load_share": 0.057971014492753624 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 120, + "ordered_topk_exact_tokens": 38, + "set_exact_tokens": 51, + "mean_set_jaccard": 0.8097222222222222, + "mean_token_weighted_tv": 0.03264821097254753, + "aggregate_load_tv": 0.05972222222222222 + }, + "system_bos": { + "tokens": 120, + "ordered_topk_exact_tokens": 41, + "set_exact_tokens": 62, + "mean_set_jaccard": 0.8434523809523811, + "mean_token_weighted_tv": 0.0302094003961732, + "aggregate_load_tv": 0.048611111111111105 + }, + "system_x": { + "tokens": 120, + "ordered_topk_exact_tokens": 27, + "set_exact_tokens": 40, + "mean_set_jaccard": 0.7781746031746032, + "mean_token_weighted_tv": 0.04559005604436, + "aggregate_load_tv": 0.06388888888888888 + }, + "system_period": { + "tokens": 120, + "ordered_topk_exact_tokens": 27, + "set_exact_tokens": 41, + "mean_set_jaccard": 0.7815476190476189, + "mean_token_weighted_tv": 0.04487147260612498, + "aggregate_load_tv": 0.06944444444444445 + }, + "bos_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 28, + "set_exact_tokens": 42, + "mean_set_jaccard": 0.7968253968253969, + "mean_token_weighted_tv": 0.037301088823005556, + "aggregate_load_tv": 0.05833333333333333 + }, + "bos_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 25, + "set_exact_tokens": 45, + "mean_set_jaccard": 0.8, + "mean_token_weighted_tv": 0.03717768428226312, + "aggregate_load_tv": 0.05416666666666667 + }, + "x_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 33, + "set_exact_tokens": 55, + "mean_set_jaccard": 0.818452380952381, + "mean_token_weighted_tv": 0.0364103766468664, + "aggregate_load_tv": 0.048611111111111105 + }, + "x_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 29, + "set_exact_tokens": 44, + "mean_set_jaccard": 0.7841269841269842, + "mean_token_weighted_tv": 0.04447236292374631, + "aggregate_load_tv": 0.05416666666666667 + }, + "period_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 34, + "set_exact_tokens": 51, + "mean_set_jaccard": 0.8053571428571428, + "mean_token_weighted_tv": 0.03860910851508379, + "aggregate_load_tv": 0.056944444444444436 + }, + "period_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 32, + "set_exact_tokens": 46, + "mean_set_jaccard": 0.7892857142857144, + "mean_token_weighted_tv": 0.04393474364187568, + "aggregate_load_tv": 0.06527777777777778 + } + } + }, + "layer_26": { + "layer": 26, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "a787ebf308c8e2e9b50d1eb087b5c4f07d5692f49a09640016e2c913c26f0608", + "route_weight_sha256": "6fb89e03bcb44d185fd51650eff0f1d2c8fc13566925a2994702844220912941", + "loads": [ + 6, + 2, + 20, + 11, + 17, + 7, + 5, + 7, + 2, + 16, + 4, + 9, + 6, + 10, + 37, + 9, + 10, + 22, + 16, + 2, + 15, + 18, + 6, + 0, + 19, + 7, + 14, + 26, + 1, + 19, + 12, + 8, + 26, + 8, + 13, + 9, + 23, + 6, + 5, + 6, + 3, + 8, + 15, + 10, + 22, + 11, + 6, + 0, + 11, + 6, + 13, + 8, + 26, + 7, + 4, + 5, + 25, + 11, + 4, + 4, + 13, + 19, + 22, + 8 + ], + "weighted_loads": [ + 0.22383596748113632, + 0.22213414683938026, + 1.24751802906394, + 0.5139574445784092, + 0.838592067360878, + 0.28042640164494514, + 0.2923030648380518, + 0.2873171903192997, + 0.06650637835264206, + 0.9060160927474499, + 0.327359426766634, + 0.4719855673611164, + 0.4097503498196602, + 0.39792921394109726, + 2.3090104442089796, + 0.39642439037561417, + 0.6524996235966682, + 0.7379139550030231, + 0.5700077209621668, + 0.06163522228598595, + 1.0974582992494106, + 1.766747223213315, + 0.21223843283951283, + 0.0, + 0.7858810294419527, + 0.3480347506701946, + 1.0511925723403692, + 1.778702599927783, + 0.04150642454624176, + 1.4821269698441029, + 0.6899617202579975, + 0.255537373945117, + 1.0560557954013348, + 0.2871853355318308, + 0.6111405938863754, + 0.4354107044637203, + 0.8540098574012518, + 0.2567175030708313, + 0.38118360191583633, + 0.2092190980911255, + 0.10144037194550037, + 1.159147348254919, + 0.5407281685620546, + 0.3759179301559925, + 0.9444838035851717, + 0.43116623908281326, + 0.18090044520795345, + 0.0, + 0.4175899662077427, + 0.2523105777800083, + 0.7340101823210716, + 0.30750116519629955, + 1.509240796789527, + 0.3192664608359337, + 0.236040897667408, + 0.18132930621504784, + 1.5534115079790354, + 0.5958259850740433, + 0.29304576851427555, + 0.17730136960744858, + 1.5739189200103283, + 0.7499291934072971, + 1.045703949406743, + 0.3928131014108658 + ], + "unique_experts": 62, + "load_cv": 0.6816827400079096, + "normalized_load_entropy": 0.9442379687701161, + "max_load_share": 0.05138888888888889 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "419215e3a70d4510be829935f848399b482023a09275e5c04b4e8d3a28d4fe16", + "route_weight_sha256": "12425569371e508edfd5637d7715230ebfd530524fa3012daedb54c9d8657456", + "loads": [ + 6, + 2, + 20, + 14, + 17, + 7, + 5, + 9, + 2, + 19, + 7, + 14, + 6, + 12, + 54, + 11, + 10, + 32, + 16, + 2, + 15, + 22, + 8, + 0, + 26, + 7, + 19, + 33, + 1, + 19, + 18, + 8, + 28, + 9, + 16, + 9, + 30, + 6, + 6, + 6, + 3, + 8, + 16, + 13, + 23, + 11, + 10, + 0, + 12, + 7, + 21, + 8, + 30, + 7, + 5, + 5, + 39, + 20, + 10, + 5, + 14, + 19, + 23, + 10 + ], + "weighted_loads": [ + 0.22383596748113632, + 0.22213414683938026, + 1.24751802906394, + 0.6227019689977169, + 0.838592067360878, + 0.28042640164494514, + 0.2923030648380518, + 0.3945254869759083, + 0.06650637835264206, + 1.0886160992085934, + 0.5370694696903229, + 0.7755287876352668, + 0.4097503498196602, + 0.5212418287992477, + 3.0535541745484807, + 0.4935073181986809, + 0.6524996235966682, + 1.2429207828827202, + 0.5700077209621668, + 0.06163522228598595, + 1.0974582992494106, + 2.043878113850951, + 0.31593612022697926, + 0.0, + 1.2174103427678347, + 0.3480347506701946, + 1.7591585498303175, + 2.0592729300260544, + 0.04150642454624176, + 1.4821269698441029, + 1.4289734810590744, + 0.255537373945117, + 1.129952721297741, + 0.3208568189293146, + 0.9006096795201302, + 0.4354107044637203, + 1.218057295307517, + 0.2567175030708313, + 0.4248766601085663, + 0.2092190980911255, + 0.10144037194550037, + 1.159147348254919, + 0.5920473914593458, + 0.5295698530972004, + 0.9873368944972754, + 0.43116623908281326, + 0.396332086995244, + 0.0, + 0.45306607335805893, + 1.2386770881712437, + 1.083499226719141, + 0.30750116519629955, + 1.9587203543633223, + 0.3192664608359337, + 0.28281141072511673, + 0.18132930621504784, + 2.5432421639561653, + 1.0126344594173133, + 0.5266897808760405, + 0.22144479677081108, + 1.5747274731402285, + 0.7499291934072971, + 1.0860253777354956, + 0.46798305958509445 + ], + "unique_experts": 62, + "load_cv": 0.7441709891491964, + "normalized_load_entropy": 0.9375331977701519, + "max_load_share": 0.06206896551724138 + } + }, + "s1_eos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "1a153fbf2303c218a527fbac0abf0290dada67154e70eafaff756c565fe6b256", + "route_weight_sha256": "3c68ff3c4c769f8a565e0a817e350c28bb4d406d252a0cd329f0051cffc244f8", + "loads": [ + 4, + 2, + 18, + 12, + 16, + 9, + 6, + 11, + 2, + 18, + 5, + 11, + 6, + 11, + 37, + 9, + 10, + 19, + 16, + 2, + 15, + 18, + 6, + 0, + 20, + 8, + 13, + 24, + 1, + 19, + 12, + 4, + 27, + 6, + 14, + 12, + 23, + 7, + 7, + 5, + 3, + 8, + 16, + 8, + 29, + 10, + 6, + 0, + 11, + 5, + 13, + 7, + 23, + 6, + 3, + 4, + 21, + 11, + 4, + 3, + 13, + 21, + 22, + 8 + ], + "weighted_loads": [ + 0.1659867838025093, + 0.21456709876656532, + 1.1303455214947462, + 0.5263170413672924, + 0.8075376525521278, + 0.35182180255651474, + 0.3035815339535475, + 0.4118716213852167, + 0.06873882375657558, + 1.004541378468275, + 0.37932517006993294, + 0.5769490823149681, + 0.4094550609588623, + 0.41207832284271717, + 2.2152935322374105, + 0.38766178488731384, + 0.6288396865129471, + 0.6386040654033422, + 0.581167459487915, + 0.06117400340735912, + 1.0937333889305592, + 1.7229117564857006, + 0.21860809065401554, + 0.0, + 0.783415649086237, + 0.35906299389898777, + 1.0775935277342796, + 1.7040016036480665, + 0.04022752121090889, + 1.4349327981472015, + 0.6635782439261675, + 0.12130650877952576, + 1.0893185958266258, + 0.23244812712073326, + 0.6611670628190041, + 0.5332559086382389, + 0.8632083013653755, + 0.2786631193011999, + 0.4165198467671871, + 0.1655142605304718, + 0.0971380602568388, + 1.147175621241331, + 0.5840309672057629, + 0.31453512981534004, + 1.2235966213047504, + 0.40011202171444893, + 0.17229986563324928, + 0.0, + 0.40516785345971584, + 0.1987767331302166, + 0.723532110452652, + 0.27497257478535175, + 1.3827962055802345, + 0.2685353010892868, + 0.20691151544451714, + 0.148936215788126, + 1.4721113592386246, + 0.6436619572341442, + 0.2908344268798828, + 0.14676481112837791, + 1.5015092827379704, + 0.8351343143731356, + 1.080619340762496, + 0.39922789856791496 + ], + "unique_experts": 62, + "load_cv": 0.687274093075205, + "normalized_load_entropy": 0.9426441535691443, + "max_load_share": 0.05138888888888889 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "bafd56967a7221cb6cb1908ad21fb73405911b20127ce38ac83f17a88edbd5a5", + "route_weight_sha256": "19bb0ec36f803cc51ae9b50508c9e721e34558636b14275b3984233edfc47628", + "loads": [ + 5, + 2, + 18, + 15, + 19, + 9, + 6, + 13, + 2, + 24, + 11, + 18, + 6, + 13, + 54, + 14, + 10, + 26, + 17, + 2, + 15, + 27, + 15, + 0, + 30, + 9, + 24, + 34, + 1, + 20, + 21, + 5, + 31, + 6, + 20, + 12, + 35, + 12, + 11, + 6, + 4, + 8, + 18, + 12, + 30, + 11, + 10, + 1, + 12, + 8, + 20, + 7, + 32, + 8, + 6, + 7, + 39, + 21, + 14, + 9, + 16, + 21, + 25, + 9 + ], + "weighted_loads": [ + 0.21719596907496452, + 0.21456709876656532, + 1.1303455214947462, + 0.6329412572085857, + 0.9871406443417072, + 0.35182180255651474, + 0.3035815339535475, + 0.5741902086883783, + 0.06873882375657558, + 1.3578542843461037, + 1.019587181508541, + 1.1899096353445202, + 0.4094550609588623, + 0.5166324470192194, + 3.1167350485920906, + 0.7020942009985447, + 0.6288396865129471, + 1.0190411263611168, + 0.6344558112323284, + 0.06117400340735912, + 1.0937333889305592, + 2.323998551815748, + 0.8404803331941366, + 0.0, + 1.2955690883100033, + 0.42886059172451496, + 2.3363488018512726, + 2.1022471152246, + 0.04022752121090889, + 1.4694021828472614, + 1.6672769207507372, + 0.2025914266705513, + 1.2649380266666412, + 0.23244812712073326, + 1.0965908467769623, + 0.5332559086382389, + 1.5304315574467182, + 0.5822907108813524, + 0.747280091047287, + 0.1990487091243267, + 0.12744013592600822, + 1.147175621241331, + 0.6810758411884308, + 0.5122386105358601, + 1.277370348572731, + 0.41781312972307205, + 0.43482426926493645, + 0.04207879677414894, + 0.4401967655867338, + 1.3345273435115814, + 1.012804388999939, + 0.27497257478535175, + 2.1829783618450165, + 0.45509224012494087, + 0.42144875228405, + 0.29537105932831764, + 3.1180108599364758, + 1.4167695781216025, + 0.8545805774629116, + 0.40491894632577896, + 1.7391133978380822, + 0.8351343143731356, + 1.2072610668838024, + 0.44397521391510963 + ], + "unique_experts": 63, + "load_cv": 0.6940451466609413, + "normalized_load_entropy": 0.9433550211709073, + "max_load_share": 0.055900621118012424 + } + }, + "s0_bos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "7065a3365317b4efc3258cd1a86f12630501aaed11f2ffc4679d4962fe7a8900", + "route_weight_sha256": "9e2ac549ab52b7df707edcb948358c26b7d0e1d0f7499971a64c0fa92b94c3e8", + "loads": [ + 5, + 2, + 19, + 12, + 20, + 8, + 6, + 10, + 3, + 17, + 5, + 12, + 6, + 12, + 37, + 12, + 8, + 19, + 17, + 4, + 15, + 19, + 4, + 0, + 14, + 7, + 13, + 24, + 1, + 19, + 11, + 4, + 27, + 8, + 12, + 10, + 21, + 5, + 5, + 7, + 2, + 9, + 17, + 16, + 18, + 11, + 6, + 0, + 11, + 5, + 13, + 9, + 26, + 5, + 5, + 8, + 25, + 11, + 3, + 4, + 13, + 14, + 20, + 9 + ], + "weighted_loads": [ + 0.1924922913312912, + 0.2092161402106285, + 1.2540380042046309, + 0.5451593995094299, + 0.9469438660889864, + 0.29982344061136246, + 0.3462362661957741, + 0.3765935320407152, + 0.10975414514541626, + 0.9539377056062222, + 0.38224292173981667, + 0.5888826567679644, + 0.4033334329724312, + 0.44375169463455677, + 2.3274679575115442, + 0.5155559591948986, + 0.5697803236544132, + 0.6478977166116238, + 0.6031903550028801, + 0.1380322016775608, + 1.1372565031051636, + 1.7615074701607227, + 0.15410145558416843, + 0.0, + 0.6011738739907742, + 0.3469509929418564, + 1.1492804139852524, + 1.6925249211490154, + 0.04548614099621773, + 1.4443258941173553, + 0.6368961799889803, + 0.12658006697893143, + 1.1618838086724281, + 0.28909814544022083, + 0.6290777418762445, + 0.46236586943268776, + 0.790095966309309, + 0.20788699761033058, + 0.40901617519557476, + 0.23385464772582054, + 0.07492662593722343, + 1.1871742270886898, + 0.6115637626498938, + 0.5943970214575529, + 0.772026065737009, + 0.427372831851244, + 0.1814166884869337, + 0.0, + 0.4210437424480915, + 0.21463729068636894, + 0.7306425608694553, + 0.35710149072110653, + 1.4871963523328304, + 0.24257368221879005, + 0.26664040610194206, + 0.29419197142124176, + 1.6747786309570074, + 0.6216179691255093, + 0.2584494352340698, + 0.18338720314204693, + 1.598539113998413, + 0.5860789120197296, + 0.9858519025146961, + 0.43834682554006577 + ], + "unique_experts": 62, + "load_cv": 0.6579053930261094, + "normalized_load_entropy": 0.9471534127327851, + "max_load_share": 0.05138888888888889 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "4f1aeeba7c70aa44536a4eee55396385926b3272a877db84b9b290d33a7dcc37", + "route_weight_sha256": "eaf56bf2fecf31c7458aea8dd1b3921a6ff368bc9ff4a088b11549a1ef3bd720", + "loads": [ + 6, + 2, + 19, + 14, + 20, + 9, + 6, + 12, + 3, + 22, + 8, + 16, + 6, + 14, + 51, + 14, + 8, + 27, + 17, + 4, + 15, + 23, + 7, + 0, + 21, + 7, + 18, + 33, + 1, + 19, + 19, + 4, + 28, + 8, + 16, + 10, + 27, + 5, + 5, + 7, + 2, + 10, + 19, + 19, + 21, + 11, + 9, + 0, + 12, + 5, + 21, + 9, + 30, + 5, + 7, + 8, + 39, + 19, + 9, + 5, + 13, + 14, + 21, + 11 + ], + "weighted_loads": [ + 0.22544283419847488, + 0.2092161402106285, + 1.2540380042046309, + 0.6275300309062004, + 0.9469438660889864, + 0.34987034276127815, + 0.3462362661957741, + 0.503673916682601, + 0.10975414514541626, + 1.2121138237416744, + 0.5799548961222172, + 0.8903782907873392, + 0.4033334329724312, + 0.5592021029442549, + 2.9604305755347013, + 0.6325903981924057, + 0.5697803236544132, + 1.0782226100564003, + 0.6031903550028801, + 0.1380322016775608, + 1.1372565031051636, + 2.037612035870552, + 0.2902821693569422, + 0.0, + 1.0215488448739052, + 0.3469509929418564, + 1.9434623643755913, + 2.1231884229928255, + 0.04548614099621773, + 1.4443258941173553, + 1.4609795529395342, + 0.12658006697893143, + 1.2000039704144, + 0.28909814544022083, + 0.9682019520550966, + 0.46236586943268776, + 1.1170232072472572, + 0.20788699761033058, + 0.40901617519557476, + 0.23385464772582054, + 0.07492662593722343, + 1.40055638179183, + 0.7298253867775202, + 0.7480489443987608, + 0.9323238618671894, + 0.427372831851244, + 0.3555725570768118, + 0.0, + 0.4940076656639576, + 0.21463729068636894, + 1.0801316052675247, + 0.35710149072110653, + 1.942517813295126, + 0.24257368221879005, + 0.3447942025959492, + 0.29419197142124176, + 2.672676119953394, + 1.0335806552320719, + 0.49209344759583473, + 0.22753063030540943, + 1.598539113998413, + 0.5860789120197296, + 1.0261733308434486, + 0.5430988632142544 + ], + "unique_experts": 62, + "load_cv": 0.7099801913503798, + "normalized_load_entropy": 0.9413905471581018, + "max_load_share": 0.05862068965517241 + } + }, + "s1_bos": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "07a51a0895f11890392d8989afe7104bde56acdb28a33a8ca931ad3d83c6757c", + "route_weight_sha256": "e2ffda03a7f4616824e047c39a25d91d5e150c796e37d41b70963c1915100166", + "loads": [ + 6, + 2, + 18, + 12, + 17, + 8, + 6, + 10, + 3, + 18, + 5, + 11, + 7, + 12, + 36, + 10, + 10, + 21, + 16, + 2, + 15, + 20, + 6, + 0, + 18, + 6, + 12, + 26, + 1, + 19, + 11, + 3, + 27, + 7, + 13, + 9, + 22, + 5, + 5, + 6, + 2, + 11, + 19, + 11, + 21, + 12, + 7, + 0, + 9, + 6, + 14, + 8, + 29, + 5, + 3, + 7, + 20, + 11, + 3, + 3, + 13, + 18, + 17, + 10 + ], + "weighted_loads": [ + 0.23794835805892944, + 0.19945675507187843, + 1.1444651652127504, + 0.5346266329288483, + 0.8272013515233994, + 0.31956394389271736, + 0.35268428921699524, + 0.36495334655046463, + 0.1100473403930664, + 0.956901678815484, + 0.40174800157546997, + 0.5824539661407471, + 0.431087426841259, + 0.4577275961637497, + 2.2757791001349688, + 0.4367194324731827, + 0.6587615944445133, + 0.7130939587950706, + 0.5928764641284943, + 0.0645885244011879, + 1.134772066026926, + 1.7946875132620335, + 0.2138044647872448, + 0.0, + 0.7331469468772411, + 0.3078291155397892, + 1.0165740065276623, + 1.8517037685960531, + 0.045282408595085144, + 1.4040673561394215, + 0.6173325330018997, + 0.0949308518320322, + 1.1392848081886768, + 0.2815664615482092, + 0.6651275008916855, + 0.408591665327549, + 0.7974371667951345, + 0.2124485783278942, + 0.3853013850748539, + 0.20662803016602993, + 0.07058753073215485, + 1.351962435990572, + 0.7098225262016058, + 0.43669154308736324, + 0.9496465921401978, + 0.45459411665797234, + 0.22203397937119007, + 0.0, + 0.3696265034377575, + 0.238812617957592, + 0.771754652261734, + 0.31197858043015003, + 1.5804513916373253, + 0.22519823163747787, + 0.2059819009155035, + 0.2736305966973305, + 1.413028784096241, + 0.6470574252307415, + 0.2586411312222481, + 0.15168887376785278, + 1.5844622664153576, + 0.7251438125967979, + 0.9056643377989531, + 0.4792401008307934 + ], + "unique_experts": 62, + "load_cv": 0.6721992649890745, + "normalized_load_entropy": 0.9444843729604999, + "max_load_share": 0.05 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "ed0f5861cd6c0a442d19776bef3a010b47091fdbd8cb4a9650573c11f27902b7", + "route_weight_sha256": "d337d71a71188ff15c2f75b16958af969c32c4a4457fbc2f06ff72f2ec6762cf", + "loads": [ + 6, + 2, + 18, + 13, + 20, + 8, + 6, + 12, + 3, + 26, + 12, + 17, + 7, + 15, + 50, + 16, + 10, + 27, + 17, + 2, + 15, + 29, + 15, + 0, + 28, + 7, + 24, + 35, + 1, + 20, + 22, + 4, + 30, + 8, + 20, + 9, + 34, + 10, + 8, + 7, + 3, + 11, + 22, + 15, + 24, + 13, + 10, + 1, + 10, + 8, + 21, + 8, + 38, + 7, + 6, + 11, + 38, + 20, + 13, + 9, + 15, + 18, + 20, + 12 + ], + "weighted_loads": [ + 0.23794835805892944, + 0.19945675507187843, + 1.1444651652127504, + 0.5676780007779598, + 1.0068043433129787, + 0.31956394389271736, + 0.35268428921699524, + 0.5457582026720047, + 0.1100473403930664, + 1.3913193959742785, + 1.0942728482186794, + 1.1931260079145432, + 0.431087426841259, + 0.616500161588192, + 3.0684062223881483, + 0.7960088290274143, + 0.6587615944445133, + 1.0985073000192642, + 0.6381025314331055, + 0.0645885244011879, + 1.134772066026926, + 2.3917697556316853, + 0.8214796148240566, + 0.0, + 1.2519068755209446, + 0.3776267133653164, + 2.4306739419698715, + 2.2085507921874523, + 0.045282408595085144, + 1.4385367408394814, + 1.7548214346170425, + 0.17621576972305775, + 1.2746121436357498, + 0.3286433946341276, + 1.182689629495144, + 0.408591665327549, + 1.4706818703562021, + 0.5160761699080467, + 0.6753012388944626, + 0.24016247875988483, + 0.10088960640132427, + 1.351962435990572, + 0.8540176618844271, + 0.6343950238078833, + 1.0853395909070969, + 0.47229522466659546, + 0.4444244932383299, + 0.04207879677414894, + 0.40465541556477547, + 0.38986290618777275, + 1.061026930809021, + 0.31197858043015003, + 2.3674821108579636, + 0.41175517067313194, + 0.42051913775503635, + 0.46695051342248917, + 3.0619377493858337, + 1.4148208983242512, + 0.8223872818052769, + 0.40984300896525383, + 1.8211400024592876, + 0.7251438125967979, + 1.0323060639202595, + 0.604765672236681 + ], + "unique_experts": 63, + "load_cv": 0.6777463624158325, + "normalized_load_entropy": 0.9453108062850226, + "max_load_share": 0.051759834368530024 + } + }, + "s0_x": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "67d382101c0038bf8e6a8e26bbd5a29ad90c38748586f63f389ca666b9b0cada", + "route_weight_sha256": "3473766fb0277bdfad5acea552a5f41dd83ba341755a2467281b4f015d227881", + "loads": [ + 5, + 2, + 22, + 15, + 20, + 8, + 6, + 7, + 2, + 15, + 5, + 11, + 8, + 11, + 37, + 11, + 8, + 19, + 15, + 2, + 15, + 20, + 5, + 0, + 14, + 7, + 13, + 25, + 1, + 19, + 12, + 5, + 27, + 7, + 11, + 10, + 22, + 4, + 7, + 7, + 3, + 9, + 16, + 14, + 22, + 9, + 4, + 0, + 10, + 6, + 13, + 8, + 30, + 5, + 5, + 6, + 24, + 11, + 3, + 5, + 13, + 19, + 19, + 6 + ], + "weighted_loads": [ + 0.17630678601562977, + 0.20672881603240967, + 1.365872697904706, + 0.664928637444973, + 0.9664675984531641, + 0.30954540707170963, + 0.35311695002019405, + 0.26113245636224747, + 0.07130406051874161, + 0.8576601184904575, + 0.41359366849064827, + 0.5649551898241043, + 0.4645754210650921, + 0.4043379873037338, + 2.212018856778741, + 0.47729554772377014, + 0.5857687219977379, + 0.6513774171471596, + 0.5200953725725412, + 0.05883808620274067, + 1.1775475181639194, + 1.834070559591055, + 0.1835576854646206, + 0.0, + 0.6027459967881441, + 0.3685241565108299, + 1.0271761491894722, + 1.7326261438429356, + 0.044504642486572266, + 1.4535351507365704, + 0.6954380329698324, + 0.1561315469443798, + 1.1384020633995533, + 0.26178206130862236, + 0.599413825199008, + 0.4601752310991287, + 0.8246952183544636, + 0.1696033589541912, + 0.44011699967086315, + 0.2569246031343937, + 0.10246627405285835, + 1.3657932467758656, + 0.5865695513784885, + 0.5319216437637806, + 0.9066469371318817, + 0.35507228411734104, + 0.12392856180667877, + 0.0, + 0.38286486826837063, + 0.2655344307422638, + 0.7302291393280029, + 0.3372296579182148, + 1.6285562757402658, + 0.23420501872897148, + 0.27833755873143673, + 0.23167428001761436, + 1.5849558506160975, + 0.6340489573776722, + 0.2674921825528145, + 0.22982408292591572, + 1.5465590097010136, + 0.7534630056470633, + 0.9503542333841324, + 0.31603794544935226 + ], + "unique_experts": 62, + "load_cv": 0.6888888888888889, + "normalized_load_entropy": 0.9431533249675306, + "max_load_share": 0.05138888888888889 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "291f0eea5e70461a7c6f83101bd5ceeb8088fb3005b2042d373f149adc5dcb86", + "route_weight_sha256": "9af49f3c323314fa9525250656e9a5b16796283f1d467f6c5f388c77c5c756c1", + "loads": [ + 5, + 2, + 22, + 16, + 20, + 8, + 6, + 9, + 2, + 19, + 9, + 17, + 8, + 13, + 52, + 13, + 8, + 29, + 15, + 2, + 15, + 24, + 7, + 0, + 21, + 7, + 18, + 33, + 1, + 19, + 18, + 5, + 28, + 7, + 14, + 10, + 28, + 4, + 7, + 7, + 3, + 9, + 17, + 19, + 23, + 9, + 7, + 0, + 10, + 6, + 22, + 8, + 34, + 5, + 6, + 7, + 42, + 20, + 9, + 6, + 13, + 19, + 21, + 7 + ], + "weighted_loads": [ + 0.17630678601562977, + 0.20672881603240967, + 1.365872697904706, + 0.7019354589283466, + 0.9664675984531641, + 0.30954540707170963, + 0.35311695002019405, + 0.3850533701479435, + 0.07130406051874161, + 1.075794454663992, + 0.6741055957973003, + 1.012103397399187, + 0.4645754210650921, + 0.5308252573013306, + 2.945168239995837, + 0.57366893440485, + 0.5857687219977379, + 1.2174928188323975, + 0.5200953725725412, + 0.05883808620274067, + 1.1775475181639194, + 2.1019897870719433, + 0.2720044255256653, + 0.0, + 1.0232860762625933, + 0.3685241565108299, + 1.7073541171848774, + 2.0468626227229834, + 0.044504642486572266, + 1.4535351507365704, + 1.364386910572648, + 0.1561315469443798, + 1.1765222251415253, + 0.26178206130862236, + 0.8632515724748373, + 0.4601752310991287, + 1.1398617327213287, + 0.1696033589541912, + 0.44011699967086315, + 0.2569246031343937, + 0.10246627405285835, + 1.3657932467758656, + 0.6291814595460892, + 0.7815417237579823, + 0.9421870857477188, + 0.35507228411734104, + 0.3028450272977352, + 0.0, + 0.38286486826837063, + 0.2655344307422638, + 1.1142084524035454, + 0.3372296579182148, + 2.0585337225347757, + 0.23420501872897148, + 0.32510807178914547, + 0.2668180838227272, + 2.7735103219747543, + 1.1554215718060732, + 0.5011361949145794, + 0.2739675100892782, + 1.5465590097010136, + 0.7534630056470633, + 1.0358005054295063, + 0.35920417308807373 + ], + "unique_experts": 62, + "load_cv": 0.7492666075574749, + "normalized_load_entropy": 0.9361446768246849, + "max_load_share": 0.059770114942528735 + } + }, + "s1_x": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "9a10ffe7dc225e27d1a663a9e096e2dd3947d43eb8d9d3933141aac89175ce1e", + "route_weight_sha256": "46b9259a95be60d78f798df39aaf513b85a0d57e688c77fab2fcd411ab44adad", + "loads": [ + 7, + 2, + 19, + 14, + 18, + 11, + 6, + 13, + 2, + 18, + 5, + 11, + 7, + 10, + 37, + 12, + 11, + 16, + 19, + 2, + 15, + 18, + 5, + 0, + 16, + 4, + 13, + 26, + 1, + 20, + 11, + 1, + 26, + 10, + 15, + 10, + 25, + 4, + 7, + 6, + 3, + 10, + 18, + 10, + 22, + 11, + 7, + 0, + 8, + 6, + 14, + 9, + 27, + 4, + 4, + 4, + 20, + 10, + 3, + 4, + 12, + 18, + 17, + 6 + ], + "weighted_loads": [ + 0.2626203875988722, + 0.1957753747701645, + 1.1471104510128498, + 0.6218157894909382, + 0.8586668223142624, + 0.43500886484980583, + 0.3250967226922512, + 0.4706618934869766, + 0.07151057943701744, + 0.9806017968803644, + 0.3841881975531578, + 0.5937885120511055, + 0.38800731860101223, + 0.35370689630508423, + 2.154520623385906, + 0.4930734261870384, + 0.7085641622543335, + 0.5465332809835672, + 0.6776076406240463, + 0.05726823769509792, + 1.109868261963129, + 1.7886519208550453, + 0.17579582333564758, + 0.0, + 0.656174236908555, + 0.253670372068882, + 0.9328831695020199, + 1.6692919172346592, + 0.04461042955517769, + 1.4362328555434942, + 0.6196118835359812, + 0.03986797481775284, + 1.1120831072330475, + 0.3819218650460243, + 0.654165817424655, + 0.4388028457760811, + 0.9359743781387806, + 0.17355386167764664, + 0.46118949726223946, + 0.21415033005177975, + 0.10143386013805866, + 1.3621079176664352, + 0.6867828667163849, + 0.3959901090711355, + 0.9349692203104496, + 0.4023991394788027, + 0.21575831435620785, + 0.0, + 0.3292385935783386, + 0.2271208092570305, + 0.7367672994732857, + 0.3290786277502775, + 1.530935475602746, + 0.18689293786883354, + 0.22556516528129578, + 0.16372568905353546, + 1.3445034138858318, + 0.6550936661660671, + 0.27511075884103775, + 0.18712756037712097, + 1.4331932440400124, + 0.7209831364452839, + 0.9054688978940248, + 0.3287912979722023 + ], + "unique_experts": 62, + "load_cv": 0.679324283005901, + "normalized_load_entropy": 0.9425338441993754, + "max_load_share": 0.05138888888888889 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "34c5b944d4ebd66019a2ff34562c2fd076f814ee74c7392cf5f75872966e2342", + "route_weight_sha256": "c15cab11a0bfa9fcc279fd29103c15ffca0de8defa203536b84eecb5224c2ee8", + "loads": [ + 7, + 2, + 19, + 14, + 21, + 11, + 6, + 15, + 2, + 25, + 12, + 19, + 7, + 12, + 53, + 17, + 11, + 22, + 19, + 2, + 15, + 27, + 13, + 0, + 26, + 5, + 25, + 37, + 1, + 22, + 20, + 2, + 29, + 11, + 21, + 10, + 37, + 9, + 10, + 7, + 4, + 10, + 20, + 14, + 22, + 12, + 10, + 1, + 10, + 8, + 21, + 9, + 36, + 6, + 7, + 8, + 40, + 21, + 14, + 11, + 14, + 18, + 20, + 7 + ], + "weighted_loads": [ + 0.2626203875988722, + 0.1957753747701645, + 1.1471104510128498, + 0.6218157894909382, + 1.0382698141038418, + 0.43500886484980583, + 0.3250967226922512, + 0.6360377445816994, + 0.07151057943701744, + 1.3706933353096247, + 1.071924202144146, + 1.3644034042954445, + 0.38800731860101223, + 0.46146073192358017, + 3.117569215595722, + 0.8067273907363415, + 0.7085641622543335, + 0.9464277792721987, + 0.6776076406240463, + 0.05726823769509792, + 1.109868261963129, + 2.3959895819425583, + 0.7083193473517895, + 0.0, + 1.17218360863626, + 0.3234679698944092, + 2.2251007929444313, + 2.101887134835124, + 0.04461042955517769, + 1.5567960608750582, + 1.5674365181475878, + 0.12115289270877838, + 1.2474104426801205, + 0.42326126992702484, + 1.086458494886756, + 0.4388028457760811, + 1.5987019017338753, + 0.47718145325779915, + 0.7511893510818481, + 0.24768477864563465, + 0.1317359358072281, + 1.3621079176664352, + 0.7773336470127106, + 0.5936935897916555, + 0.9349692203104496, + 0.4201002474874258, + 0.4354062993079424, + 0.04207879677414894, + 0.39326361007988453, + 0.3781710974872112, + 1.0260395780205727, + 0.3290786277502775, + 2.2778949830681086, + 0.3734498769044876, + 0.44010240212082863, + 0.348684836179018, + 3.0797274336218834, + 1.5834631584584713, + 0.9023916162550449, + 0.4908906780183315, + 1.6698709800839424, + 0.7209831364452839, + 1.0321106240153313, + 0.373538613319397 + ], + "unique_experts": 63, + "load_cv": 0.690677147696036, + "normalized_load_entropy": 0.9437350290098436, + "max_load_share": 0.054865424430641824 + } + }, + "s0_period": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "796fc7475ea538a7626fe344b4d17e7e050cbaa294fd0d3dd43b0f03d9ddf6a2", + "route_weight_sha256": "bfa6c81fc7a404248092d622f8f05839b260e01673454d0d9a00aa6e3bf86a5e", + "loads": [ + 2, + 2, + 20, + 13, + 20, + 11, + 6, + 8, + 2, + 16, + 5, + 12, + 7, + 12, + 35, + 12, + 8, + 17, + 17, + 3, + 15, + 19, + 7, + 0, + 16, + 6, + 13, + 26, + 1, + 19, + 12, + 4, + 27, + 10, + 13, + 10, + 20, + 5, + 6, + 7, + 3, + 8, + 17, + 15, + 24, + 10, + 3, + 0, + 8, + 6, + 13, + 10, + 27, + 5, + 4, + 7, + 24, + 11, + 3, + 5, + 13, + 16, + 18, + 6 + ], + "weighted_loads": [ + 0.08358530327677727, + 0.21079806238412857, + 1.3392558060586452, + 0.5724384300410748, + 0.9694876112043858, + 0.4120232071727514, + 0.34931956976652145, + 0.3077547512948513, + 0.07058298587799072, + 0.9257636778056622, + 0.41124793142080307, + 0.5851453132927418, + 0.44965655729174614, + 0.4395275916904211, + 2.1283503640443087, + 0.5213095955550671, + 0.587073564529419, + 0.6025509368628263, + 0.6019848976284266, + 0.09843853302299976, + 1.1552773900330067, + 1.843686394393444, + 0.25232228823006153, + 0.0, + 0.6704097483307123, + 0.3356432355940342, + 1.1060758084058762, + 1.8302637450397015, + 0.04581749811768532, + 1.428887713700533, + 0.7059592735022306, + 0.12590383924543858, + 1.1434251237660646, + 0.36293655820190907, + 0.653643948957324, + 0.46369951218366623, + 0.7399091403931379, + 0.19339404627680779, + 0.41481301933526993, + 0.24363186210393906, + 0.10188156552612782, + 1.3282107822597027, + 0.6373895518481731, + 0.5691362805664539, + 0.9540239069610834, + 0.3903831522911787, + 0.08452961035072803, + 0.0, + 0.34304826706647873, + 0.25065498426556587, + 0.7178334891796112, + 0.40159439109265804, + 1.5416006613522768, + 0.23346291854977608, + 0.23899110220372677, + 0.25582263991236687, + 1.6316055059432983, + 0.6217277571558952, + 0.2582401931285858, + 0.22874240949749947, + 1.5459990501403809, + 0.6298380233347416, + 0.9186761565506458, + 0.33610665798187256 + ], + "unique_experts": 62, + "load_cv": 0.6683312551921141, + "normalized_load_entropy": 0.9446501240912379, + "max_load_share": 0.04861111111111111 + }, + "full_input": { + "tokens": 145, + "top_k": 6, + "decisions": 870, + "ordered_route_sha256": "ff1884b7c10d1da94a5af06be49e0e8e19899ac266eb2ff8123d3c027528fae7", + "route_weight_sha256": "829ffdaa41e1bf72a398f29854f1958397a089f2751b262d6c4e886e4c55c265", + "loads": [ + 2, + 2, + 20, + 15, + 20, + 12, + 6, + 10, + 2, + 19, + 9, + 16, + 7, + 14, + 51, + 14, + 8, + 27, + 18, + 3, + 15, + 23, + 8, + 0, + 24, + 6, + 18, + 33, + 1, + 19, + 19, + 4, + 29, + 11, + 16, + 10, + 27, + 5, + 6, + 7, + 3, + 8, + 17, + 18, + 25, + 10, + 7, + 0, + 8, + 6, + 21, + 10, + 32, + 5, + 5, + 9, + 40, + 19, + 9, + 6, + 13, + 16, + 19, + 8 + ], + "weighted_loads": [ + 0.08358530327677727, + 0.21079806238412857, + 1.3392558060586452, + 0.6523872055113316, + 0.9694876112043858, + 0.45694088749587536, + 0.34931956976652145, + 0.4226590469479561, + 0.07058298587799072, + 1.1083636842668056, + 0.6852940991520882, + 0.8866409473121166, + 0.44965655729174614, + 0.5639238301664591, + 2.8372869323939085, + 0.6128852292895317, + 0.587073564529419, + 1.1684324834495783, + 0.6358697321265936, + 0.09843853302299976, + 1.1552773900330067, + 2.1188376992940903, + 0.29106065817177296, + 0.0, + 1.1941085178405046, + 0.3356432355940342, + 1.7812507189810276, + 2.110834075137973, + 0.04581749811768532, + 1.428887713700533, + 1.3975399937480688, + 0.12590383924543858, + 1.2197052035480738, + 0.4015518631786108, + 0.922506419941783, + 0.46369951218366623, + 1.1088876631110907, + 0.19339404627680779, + 0.41481301933526993, + 0.24363186210393906, + 0.10188156552612782, + 1.3282107822597027, + 0.6373895518481731, + 0.7227882035076618, + 0.9900589045137167, + 0.3903831522911787, + 0.294543145224452, + 0.0, + 0.34304826706647873, + 0.25065498426556587, + 1.0673225335776806, + 0.40159439109265804, + 2.061406834051013, + 0.23346291854977608, + 0.2857616152614355, + 0.32251930981874466, + 2.8050467129796743, + 1.0336904432624578, + 0.4918842054903507, + 0.27288583666086197, + 1.5459990501403809, + 0.6298380233347416, + 0.9589975848793983, + 0.46480368822813034 + ], + "unique_experts": 62, + "load_cv": 0.728670362209904, + "normalized_load_entropy": 0.9381894909437931, + "max_load_share": 0.05862068965517241 + } + }, + "s1_period": { + "target_content": { + "tokens": 120, + "top_k": 6, + "decisions": 720, + "ordered_route_sha256": "390f133c96348c8be728f7a8b1d2c599c4fc7ac850500790c037c378deda5788", + "route_weight_sha256": "3550f24bf6a4265e98a8581fa3c77cba0db8c7e212b4155da23a0bcc44d4990b", + "loads": [ + 5, + 2, + 21, + 15, + 19, + 11, + 7, + 11, + 2, + 17, + 5, + 11, + 6, + 10, + 37, + 12, + 11, + 19, + 16, + 2, + 15, + 18, + 5, + 0, + 15, + 4, + 12, + 27, + 1, + 20, + 12, + 2, + 25, + 11, + 14, + 10, + 25, + 5, + 6, + 5, + 3, + 9, + 16, + 10, + 20, + 11, + 4, + 0, + 14, + 6, + 14, + 8, + 30, + 4, + 3, + 6, + 20, + 10, + 3, + 4, + 12, + 20, + 17, + 5 + ], + "weighted_loads": [ + 0.1815052218735218, + 0.20073512196540833, + 1.262365210801363, + 0.648703183978796, + 0.8963585197925568, + 0.4064756352454424, + 0.36749469116330147, + 0.4216029793024063, + 0.07575955986976624, + 0.9770541712641716, + 0.39851436764001846, + 0.6033749356865883, + 0.3620556592941284, + 0.3656339105218649, + 2.1954364981502295, + 0.49458154663443565, + 0.6780847683548927, + 0.6499820798635483, + 0.5812829341739416, + 0.05738308094441891, + 1.1490373201668262, + 1.7831691466271877, + 0.18094414472579956, + 0.0, + 0.615427415817976, + 0.2551075667142868, + 0.9125979878008366, + 1.784250471740961, + 0.04396996647119522, + 1.4449695236980915, + 0.6460299510508776, + 0.07155051082372665, + 1.0987515468150377, + 0.4121042527258396, + 0.6470056232064962, + 0.430107980966568, + 0.948686558753252, + 0.20202418603003025, + 0.4335350729525089, + 0.17020734958350658, + 0.10461415350437164, + 1.1774940192699432, + 0.6019868850708008, + 0.39887543581426144, + 0.8788084462285042, + 0.407776415348053, + 0.13176333718001842, + 0.0, + 0.5257012136280537, + 0.22350680828094482, + 0.729795940220356, + 0.2980280928313732, + 1.6222297921776772, + 0.18232911452651024, + 0.19645697623491287, + 0.2305546421557665, + 1.382458958774805, + 0.6695355698466301, + 0.27594373375177383, + 0.20183895900845528, + 1.4231973141431808, + 0.7870606388896704, + 0.9056784976273775, + 0.3097259923815727 + ], + "unique_experts": 62, + "load_cv": 0.6926421055781644, + "normalized_load_entropy": 0.9409762060829259, + "max_load_share": 0.05138888888888889 + }, + "full_input": { + "tokens": 161, + "top_k": 6, + "decisions": 966, + "ordered_route_sha256": "e27cd756c5cb08b61883c9020c7c642cff9e49ace6c2618b43c8378113d4579b", + "route_weight_sha256": "90058c3a42daf154563e4fdc9ed692157e01cdf2eb43f0436ae1d4daf5fc5e9c", + "loads": [ + 5, + 2, + 21, + 16, + 22, + 12, + 7, + 13, + 2, + 24, + 12, + 17, + 6, + 12, + 52, + 17, + 11, + 25, + 16, + 2, + 15, + 27, + 13, + 0, + 26, + 5, + 23, + 37, + 1, + 21, + 21, + 3, + 28, + 11, + 20, + 10, + 37, + 10, + 9, + 6, + 4, + 9, + 19, + 15, + 21, + 12, + 8, + 1, + 16, + 8, + 22, + 8, + 40, + 6, + 7, + 10, + 40, + 19, + 13, + 10, + 14, + 20, + 20, + 7 + ], + "weighted_loads": [ + 0.1815052218735218, + 0.20073512196540833, + 1.262365210801363, + 0.6796027421951294, + 1.0759615115821362, + 0.4529524501413107, + 0.36749469116330147, + 0.5990800708532333, + 0.07575955986976624, + 1.3672842867672443, + 1.1195727549493313, + 1.2140469774603844, + 0.3620556592941284, + 0.46855258010327816, + 3.131455173715949, + 0.7968774028122425, + 0.6780847683548927, + 1.0760443136096, + 0.5812829341739416, + 0.05738308094441891, + 1.1490373201668262, + 2.393517628312111, + 0.7149737142026424, + 0.0, + 1.2150064557790756, + 0.324905164539814, + 2.1746339313685894, + 2.171907091513276, + 0.04396996647119522, + 1.4794389083981514, + 1.5883168149739504, + 0.1528354287147522, + 1.2340788822621107, + 0.4121042527258396, + 1.078114015981555, + 0.430107980966568, + 1.61808892339468, + 0.5056517776101828, + 0.7235349267721176, + 0.2037417981773615, + 0.13491622917354107, + 1.1774940192699432, + 0.7272662669420242, + 0.6273513399064541, + 0.9074873309582472, + 0.4254775233566761, + 0.3828277010470629, + 0.04207879677414894, + 0.595004003494978, + 0.37455709651112556, + 1.0606532655656338, + 0.2980280928313732, + 2.4233756065368652, + 0.3688860535621643, + 0.44840381294488907, + 0.4233641196042299, + 3.189145091921091, + 1.4372990429401398, + 0.8396898843348026, + 0.4599930942058563, + 1.659875050187111, + 0.7870606388896704, + 1.032320223748684, + 0.4352378249168396 + ], + "unique_experts": 63, + "load_cv": 0.6953285996949178, + "normalized_load_entropy": 0.9431331056845853, + "max_load_share": 0.053830227743271224 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 120, + "ordered_topk_exact_tokens": 36, + "set_exact_tokens": 53, + "mean_set_jaccard": 0.8226190476190477, + "mean_token_weighted_tv": 0.03145498926751315, + "aggregate_load_tv": 0.04722222222222222 + }, + "system_bos": { + "tokens": 120, + "ordered_topk_exact_tokens": 48, + "set_exact_tokens": 63, + "mean_set_jaccard": 0.8535714285714288, + "mean_token_weighted_tv": 0.027193675632588565, + "aggregate_load_tv": 0.05138888888888889 + }, + "system_x": { + "tokens": 120, + "ordered_topk_exact_tokens": 31, + "set_exact_tokens": 42, + "mean_set_jaccard": 0.7900793650793652, + "mean_token_weighted_tv": 0.042458145429069796, + "aggregate_load_tv": 0.06388888888888888 + }, + "system_period": { + "tokens": 120, + "ordered_topk_exact_tokens": 29, + "set_exact_tokens": 45, + "mean_set_jaccard": 0.7982142857142857, + "mean_token_weighted_tv": 0.040099396867056686, + "aggregate_load_tv": 0.06111111111111111 + }, + "bos_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 31, + "set_exact_tokens": 47, + "mean_set_jaccard": 0.7970238095238095, + "mean_token_weighted_tv": 0.036967079349172614, + "aggregate_load_tv": 0.05833333333333333 + }, + "bos_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 33, + "set_exact_tokens": 53, + "mean_set_jaccard": 0.8119047619047618, + "mean_token_weighted_tv": 0.03484784625470638, + "aggregate_load_tv": 0.05694444444444444 + }, + "x_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 29, + "set_exact_tokens": 48, + "mean_set_jaccard": 0.803968253968254, + "mean_token_weighted_tv": 0.036659784296837944, + "aggregate_load_tv": 0.05416666666666667 + }, + "x_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 25, + "set_exact_tokens": 42, + "mean_set_jaccard": 0.7847222222222222, + "mean_token_weighted_tv": 0.04248033003726353, + "aggregate_load_tv": 0.06805555555555556 + }, + "period_at_s0": { + "tokens": 120, + "ordered_topk_exact_tokens": 29, + "set_exact_tokens": 48, + "mean_set_jaccard": 0.8017857142857143, + "mean_token_weighted_tv": 0.037811204923006395, + "aggregate_load_tv": 0.06388888888888888 + }, + "period_at_s1": { + "tokens": 120, + "ordered_topk_exact_tokens": 21, + "set_exact_tokens": 38, + "mean_set_jaccard": 0.768452380952381, + "mean_token_weighted_tv": 0.04454296325178196, + "aggregate_load_tv": 0.06666666666666667 + } + } + } + } + }, + { + "id": "HumanEval/44", + "domain": "code", + "label": "Python code", + "within_domain_index": 1, + "selection_rank": "030cfc7acc71ac4484d25020b2f340973c6cd1e20c2bdb1b3be9d532032eaa24", + "source_text_sha256": "70a0af759ec21f43ca0d40f7b7a3ec39e32388c9b5416fe06e5c658ce89e6666", + "source_characters": 299, + "source_tokens": 108, + "content_token_ids_sha256": "5343fd5759da7a3acd6ab4c0bde9c7a2789e292eb4824dd8cd461571a0f1f5f2", + "prompt_tokens_by_condition": { + "s0_eos": 133, + "s1_eos": 149, + "s0_bos": 133, + "s1_bos": 149, + "s0_x": 133, + "s1_x": 149, + "s0_period": 133, + "s1_period": 149 + }, + "batch_prompt_tokens": 149, + "content_tokens": 108, + "boundary_crossing_tokens_by_condition": { + "s0_eos": 0, + "s1_eos": 0, + "s0_bos": 0, + "s1_bos": 0, + "s0_x": 0, + "s1_x": 0, + "s0_period": 0, + "s1_period": 0 + }, + "forward_seconds": 0.83665796299465, + "peak_cuda_memory_allocated_bytes": 27706466304, + "hidden_stages": { + "embedding": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c6c0d201c0042347a85de282fb7732c8b5aca6e928a3220526f037866ab5fb86", + "mean": -0.0007165613933466375, + "std": 0.08166781812906265, + "rms": 0.08167096227407455, + "max_abs": 2.046875 + }, + "full_input": { + "shape": [ + 133, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "376ec5ed39b63391be6b9d4f339f62b8e46971cfce4df5cd53039adb259e8d09", + "mean": -0.000758061942178756, + "std": 0.08235029131174088, + "rms": 0.08235377818346024, + "max_abs": 2.046875 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c6c0d201c0042347a85de282fb7732c8b5aca6e928a3220526f037866ab5fb86", + "mean": -0.0007165613933466375, + "std": 0.08166781812906265, + "rms": 0.08167096227407455, + "max_abs": 2.046875 + }, + "full_input": { + "shape": [ + 149, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "43f592050b3a6f54067f17a6d1aa8dddb5f66f3f0a4cdff63693f10ba21e299b", + "mean": -0.0009125870419666171, + "std": 0.08504077047109604, + "rms": 0.08504566550254822, + "max_abs": 2.046875 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c6c0d201c0042347a85de282fb7732c8b5aca6e928a3220526f037866ab5fb86", + "mean": -0.0007165613933466375, + "std": 0.08166781812906265, + "rms": 0.08167096227407455, + "max_abs": 2.046875 + }, + "full_input": { + "shape": [ + 133, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7830161805d79c9ce1a91c1510db36d0f858a8bf3a1a047e7970bc4beb2629bf", + "mean": -0.0007465341477654874, + "std": 0.0821794867515564, + "rms": 0.082182876765728, + "max_abs": 2.046875 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c6c0d201c0042347a85de282fb7732c8b5aca6e928a3220526f037866ab5fb86", + "mean": -0.0007165613933466375, + "std": 0.08166781812906265, + "rms": 0.08167096227407455, + "max_abs": 2.046875 + }, + "full_input": { + "shape": [ + 149, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a51fa8fc13f5c4f131b7d129d00c583e96959054e8ca2526d89613d0688d0e94", + "mean": -0.0009022970916703343, + "std": 0.08489317446947098, + "rms": 0.0848979651927948, + "max_abs": 2.046875 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c6c0d201c0042347a85de282fb7732c8b5aca6e928a3220526f037866ab5fb86", + "mean": -0.0007165613933466375, + "std": 0.08166781812906265, + "rms": 0.08167096227407455, + "max_abs": 2.046875 + }, + "full_input": { + "shape": [ + 133, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a3d8a135d12f51c43ba7d040b2a4cd0090bc8b3fa9c41f2321c4cc69a4f04fa1", + "mean": -0.0007748234202153981, + "std": 0.08229463547468185, + "rms": 0.08229828625917435, + "max_abs": 2.046875 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c6c0d201c0042347a85de282fb7732c8b5aca6e928a3220526f037866ab5fb86", + "mean": -0.0007165613933466375, + "std": 0.08166781812906265, + "rms": 0.08167096227407455, + "max_abs": 2.046875 + }, + "full_input": { + "shape": [ + 149, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5a7acfd162cf409369613259b220dde9fffd69ecd7f7cf9972ecb4956f66ac36", + "mean": -0.000927548564504832, + "std": 0.08499263972043991, + "rms": 0.08499770611524582, + "max_abs": 2.046875 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c6c0d201c0042347a85de282fb7732c8b5aca6e928a3220526f037866ab5fb86", + "mean": -0.0007165613933466375, + "std": 0.08166781812906265, + "rms": 0.08167096227407455, + "max_abs": 2.046875 + }, + "full_input": { + "shape": [ + 133, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ea064b41e5410951f020f1b257536758d4c0db7e99cf7380431a4431604348b2", + "mean": -0.0007754334365017712, + "std": 0.08216345310211182, + "rms": 0.0821671113371849, + "max_abs": 2.046875 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c6c0d201c0042347a85de282fb7732c8b5aca6e928a3220526f037866ab5fb86", + "mean": -0.0007165613933466375, + "std": 0.08166781812906265, + "rms": 0.08167096227407455, + "max_abs": 2.046875 + }, + "full_input": { + "shape": [ + 149, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e08debd445789d808a0d061560a5480020da14feb81ee217ee59c5b6eab863b8", + "mean": -0.0009280930971726775, + "std": 0.08487927168607712, + "rms": 0.08488434553146362, + "max_abs": 2.046875 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 108, + "exact_hidden_rows": 108, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999999403953552, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "system_bos": { + "tokens": 108, + "exact_hidden_rows": 108, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999999403953552, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "system_x": { + "tokens": 108, + "exact_hidden_rows": 108, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999999403953552, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "system_period": { + "tokens": 108, + "exact_hidden_rows": 108, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999999403953552, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "bos_at_s0": { + "tokens": 108, + "exact_hidden_rows": 108, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999999403953552, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "bos_at_s1": { + "tokens": 108, + "exact_hidden_rows": 108, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999999403953552, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "x_at_s0": { + "tokens": 108, + "exact_hidden_rows": 108, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999999403953552, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "x_at_s1": { + "tokens": 108, + "exact_hidden_rows": 108, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999999403953552, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "period_at_s0": { + "tokens": 108, + "exact_hidden_rows": 108, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999999403953552, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "period_at_s1": { + "tokens": 108, + "exact_hidden_rows": 108, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999999403953552, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + } + } + }, + "layer_00": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "44a301d237d0c638cca8c788460e96466fc0574c65e899378afcd2d65d9796a3", + "mean": -0.0012149142567068338, + "std": 0.07966171950101852, + "rms": 0.0796709805727005, + "max_abs": 2.46875 + }, + "full_input": { + "shape": [ + 133, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "13ea62351ea15dc8edf83bcadee83fc1f43108bc8e225e78bcc180eb392b0122", + "mean": -0.0012783193960785866, + "std": 0.08160499483346939, + "rms": 0.08161500841379166, + "max_abs": 2.46875 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "67a138c642a18c5ebafe8528cc5de127f051bce5e3fb139aae83ba18d7989cff", + "mean": -0.0011939340038225055, + "std": 0.07952089607715607, + "rms": 0.07952985912561417, + "max_abs": 2.4375 + }, + "full_input": { + "shape": [ + 149, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2e75650929e0ac9e0d0662a919391b81e28c76e54e5990daf75770dd56043bf3", + "mean": -0.0013739324640482664, + "std": 0.08342728763818741, + "rms": 0.08343859761953354, + "max_abs": 2.4375 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "03b8288d3ea6448fd2fc6826bb8b5859aa88a3a343408afc541f0bac3db5c688", + "mean": -0.0011860233498737216, + "std": 0.07961595803499222, + "rms": 0.07962478697299957, + "max_abs": 2.40625 + }, + "full_input": { + "shape": [ + 133, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "04d0f4117e132091b473cc51af05cf59fbef65f103e62d153800bb7fe40fb3c4", + "mean": -0.001239429460838437, + "std": 0.08132177591323853, + "rms": 0.08133121579885483, + "max_abs": 2.4375 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6fcd66b7d92f715f16ae327f9815adf7129162f63af275bb4cfd85ffc0a9ad32", + "mean": -0.0011805904796347022, + "std": 0.07918774336576462, + "rms": 0.07919654250144958, + "max_abs": 2.390625 + }, + "full_input": { + "shape": [ + 149, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3f3227bdee45d2456099e92225e1520440b8eb4ac8be47de861025fe917dea30", + "mean": -0.0013507119147107005, + "std": 0.08297666162252426, + "rms": 0.08298765122890472, + "max_abs": 2.4375 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "49588dcaa46293d1879960d746dcb9b6bff091bdb8575474b4966c706106a3b8", + "mean": -0.001203567604534328, + "std": 0.07907252758741379, + "rms": 0.079081691801548, + "max_abs": 2.40625 + }, + "full_input": { + "shape": [ + 133, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "61595a35d79cfd6a74ffd64d78623e9575d90999389f47e9ad9b6545c85f5d5d", + "mean": -0.0012712934985756874, + "std": 0.08101335167884827, + "rms": 0.08102332800626755, + "max_abs": 2.4375 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "83f15b04ca570e63ab5de3a03d104e1844a8478b4b291f38254d10e919d85b63", + "mean": -0.0011982832802459598, + "std": 0.07876840978860855, + "rms": 0.07877752184867859, + "max_abs": 2.390625 + }, + "full_input": { + "shape": [ + 149, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "eda728e099c9450a27fab65ecd7816ad36b886ed445804f8438143f5d762e62a", + "mean": -0.0013822675682604313, + "std": 0.08281398564577103, + "rms": 0.08282551169395447, + "max_abs": 2.4375 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0de6d25c7431dde40bb4d13472c00c9afedf4a4a6091fa9499acec05ffec81d4", + "mean": -0.0012015625834465027, + "std": 0.07904360443353653, + "rms": 0.07905273884534836, + "max_abs": 2.40625 + }, + "full_input": { + "shape": [ + 133, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ab31ec4e21280f2720de860aacbd98ac6a23b2a6002c627472148136455f0af9", + "mean": -0.0012692875461652875, + "std": 0.08079027384519577, + "rms": 0.08080024272203445, + "max_abs": 2.4375 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9a612a5cc6ae5953e0238049bd3815377dcf9c9c141fd9efc81b4ca0531471cc", + "mean": -0.0011956854723393917, + "std": 0.07874008268117905, + "rms": 0.0787491649389267, + "max_abs": 2.375 + }, + "full_input": { + "shape": [ + 149, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6a726f9e09576e95295f8c475fbca14709139d23ae2d06345e4988e0a7bc0921", + "mean": -0.001378093147650361, + "std": 0.0826028361916542, + "rms": 0.08261432498693466, + "max_abs": 2.4375 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9988788366317749, + "min_cosine_similarity": 0.9930042028427124, + "mean_relative_l2": 0.04585222899913788, + "max_abs_delta": 0.078125 + }, + "system_bos": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9985966682434082, + "min_cosine_similarity": 0.9856383800506592, + "mean_relative_l2": 0.049872737377882004, + "max_abs_delta": 0.109375 + }, + "system_x": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9986575245857239, + "min_cosine_similarity": 0.9861151576042175, + "mean_relative_l2": 0.048782601952552795, + "max_abs_delta": 0.0859375 + }, + "system_period": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9986873269081116, + "min_cosine_similarity": 0.986771285533905, + "mean_relative_l2": 0.0483732633292675, + "max_abs_delta": 0.0859375 + }, + "bos_at_s0": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9909853339195251, + "min_cosine_similarity": 0.9366599321365356, + "mean_relative_l2": 0.1272464394569397, + "max_abs_delta": 0.1845703125 + }, + "bos_at_s1": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9916287064552307, + "min_cosine_similarity": 0.9471362829208374, + "mean_relative_l2": 0.12358805537223816, + "max_abs_delta": 0.181640625 + }, + "x_at_s0": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9917876720428467, + "min_cosine_similarity": 0.9400572180747986, + "mean_relative_l2": 0.12044268101453781, + "max_abs_delta": 0.177734375 + }, + "x_at_s1": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9921451807022095, + "min_cosine_similarity": 0.9498701691627502, + "mean_relative_l2": 0.11916805058717728, + "max_abs_delta": 0.193359375 + }, + "period_at_s0": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.991909384727478, + "min_cosine_similarity": 0.9416124820709229, + "mean_relative_l2": 0.11979104578495026, + "max_abs_delta": 0.17578125 + }, + "period_at_s1": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9922162294387817, + "min_cosine_similarity": 0.950352668762207, + "mean_relative_l2": 0.11876903474330902, + "max_abs_delta": 0.1923828125 + } + } + }, + "layer_01": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bbbb0a8efb52ad9dbcff2101ca6d6f41e9b16b3232b2a054671d44a187da7a4c", + "mean": -0.0016428312519565225, + "std": 0.09604046493768692, + "rms": 0.09605451673269272, + "max_abs": 2.6875 + }, + "full_input": { + "shape": [ + 133, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a5eed466fa4ddc8f89f522ce2c0534f3cb421fe4156cb8c5e9ff253dde7da676", + "mean": -0.00376670784316957, + "std": 0.6974155902862549, + "rms": 0.6974257826805115, + "max_abs": 126.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "72242cf54a5ace64787078d92b447317e27ff1428c5d120e728ebcec319b1361", + "mean": -0.0016058735782280564, + "std": 0.09604056924581528, + "rms": 0.09605399519205093, + "max_abs": 2.65625 + }, + "full_input": { + "shape": [ + 149, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cfc1bcfa47a4876a7742d087b6e4c72880280f1b5c340fc02bdbefd0b48ca22d", + "mean": -0.0037960349582135677, + "std": 0.6834498643875122, + "rms": 0.6834603548049927, + "max_abs": 135.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "718a298b94eff72a95b8755b861d2e29768ab480e11dab4d3c27f02c160e6de9", + "mean": -0.0017295400612056255, + "std": 0.09554418176412582, + "rms": 0.09555983543395996, + "max_abs": 2.65625 + }, + "full_input": { + "shape": [ + 133, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4f072cef3d37d298cb464cd764cbfa1b2ce20d3fce4da806106152e39454a68b", + "mean": -0.0016811075620353222, + "std": 0.09967488050460815, + "rms": 0.0996890589594841, + "max_abs": 4.71875 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2516e77624c830ca19668532b2487e9e1799f6d38712618ed3dd03e9d0c5c01a", + "mean": -0.0017329498659819365, + "std": 0.09440694004297256, + "rms": 0.0944228395819664, + "max_abs": 2.625 + }, + "full_input": { + "shape": [ + 149, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3c714ad59170e92932ec085f921a884caab289bff44cd3b6ec40cebf36231ec6", + "mean": -0.0018603429198265076, + "std": 0.10040700435638428, + "rms": 0.10042423009872437, + "max_abs": 4.71875 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b543fa2e50cf1ee0e0cea102a17c2bd485c7bf60710aa35f70fd292da4da0f90", + "mean": -0.0017224515322595835, + "std": 0.09538079798221588, + "rms": 0.09539634734392166, + "max_abs": 2.671875 + }, + "full_input": { + "shape": [ + 133, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2db3ae200ef9d8f6194cd80562848a53bf3414259c863d8f6ae49257878dd5f7", + "mean": -0.0016828710213303566, + "std": 0.09961386024951935, + "rms": 0.09962807595729828, + "max_abs": 4.71875 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cd9f96bb913eaf7939dc8ba738b8c248c2be0f89a97c08676f4c5b0399e6712d", + "mean": -0.0017114432994276285, + "std": 0.09393354505300522, + "rms": 0.09394913166761398, + "max_abs": 2.640625 + }, + "full_input": { + "shape": [ + 149, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "46485d011901aecf705e98d2335b195fcada80d0fea3fd704d74b91d7fa998a3", + "mean": -0.0018536904826760292, + "std": 0.10014422982931137, + "rms": 0.10016138106584549, + "max_abs": 4.71875 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "39082f271ad0743d49c423ad3a326c2a4fafe0704af5aabf613bf5e6fb4ff6be", + "mean": -0.0017111391061916947, + "std": 0.09536228328943253, + "rms": 0.09537763148546219, + "max_abs": 2.671875 + }, + "full_input": { + "shape": [ + 133, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3af041bcf1b091bbab4906c07363ff0373abd2d0c4c4b68147d813b4fd49e285", + "mean": -0.0016870128456503153, + "std": 0.09931611269712448, + "rms": 0.09933044016361237, + "max_abs": 4.71875 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6884a0eaaf498a189abdb8006b7f8e53261a0cd99be753310378da505f61cff3", + "mean": -0.0017067519947886467, + "std": 0.09391245245933533, + "rms": 0.09392796456813812, + "max_abs": 2.625 + }, + "full_input": { + "shape": [ + 149, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "81039f2a33f25becf481e6aad53ce1e635d7bd28c497c9e58562ecc6e1c55b08", + "mean": -0.0018596822628751397, + "std": 0.09988553822040558, + "rms": 0.09990284591913223, + "max_abs": 4.71875 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9981815218925476, + "min_cosine_similarity": 0.9894090890884399, + "mean_relative_l2": 0.05705724284052849, + "max_abs_delta": 0.0859375 + }, + "system_bos": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9968696236610413, + "min_cosine_similarity": 0.9789316654205322, + "mean_relative_l2": 0.07332257181406021, + "max_abs_delta": 0.14453125 + }, + "system_x": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.995792031288147, + "min_cosine_similarity": 0.9602252244949341, + "mean_relative_l2": 0.08232828229665756, + "max_abs_delta": 0.1328125 + }, + "system_period": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9959298372268677, + "min_cosine_similarity": 0.9625669717788696, + "mean_relative_l2": 0.08181708306074142, + "max_abs_delta": 0.140625 + }, + "bos_at_s0": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.990593433380127, + "min_cosine_similarity": 0.90923672914505, + "mean_relative_l2": 0.12775345146656036, + "max_abs_delta": 0.251953125 + }, + "bos_at_s1": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9900843501091003, + "min_cosine_similarity": 0.9188243746757507, + "mean_relative_l2": 0.1320067197084427, + "max_abs_delta": 0.279296875 + }, + "x_at_s0": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9911634922027588, + "min_cosine_similarity": 0.9033320546150208, + "mean_relative_l2": 0.12242294102907181, + "max_abs_delta": 0.328125 + }, + "x_at_s1": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9894009232521057, + "min_cosine_similarity": 0.9095262289047241, + "mean_relative_l2": 0.13477221131324768, + "max_abs_delta": 0.357421875 + }, + "period_at_s0": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9912517070770264, + "min_cosine_similarity": 0.9056396484375, + "mean_relative_l2": 0.12221765518188477, + "max_abs_delta": 0.328125 + }, + "period_at_s1": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9895479679107666, + "min_cosine_similarity": 0.9082727432250977, + "mean_relative_l2": 0.13422347605228424, + "max_abs_delta": 0.34765625 + } + } + }, + "layer_02": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "22fe46daecdd05f1b3ffd0706b45813da301618e2747237a8b19af65b758c100", + "mean": -0.001743391971103847, + "std": 0.11791600286960602, + "rms": 0.1179288923740387, + "max_abs": 3.40625 + }, + "full_input": { + "shape": [ + 133, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4cb88b88527a033ee04c8f499bb70fdf538223c6efbca1bcd73ff4b4a42f5583", + "mean": -0.008797695860266685, + "std": 2.0835368633270264, + "rms": 2.0835554599761963, + "max_abs": 392.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "db59fd437be6cea0d98cad961b2dfb1bf54cfb4558793977f89d33f032a434be", + "mean": -0.0015988104278221726, + "std": 0.117453433573246, + "rms": 0.11746431142091751, + "max_abs": 3.34375 + }, + "full_input": { + "shape": [ + 149, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "da3255959ab26357da80461067446f8d019fd9a696d67f3e22726535c00bd117", + "mean": -0.009129035286605358, + "std": 2.1824023723602295, + "rms": 2.1824212074279785, + "max_abs": 436.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "66d16493462e6c9186e7e337850398412411b833fe0f933608e98862339144c4", + "mean": -0.0017641870072111487, + "std": 0.1172056794166565, + "rms": 0.11721895635128021, + "max_abs": 3.4375 + }, + "full_input": { + "shape": [ + 133, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4a39fa6676e8c9ac178f5f02030d5d783602fd38dc0d720db3894b100c4dc006", + "mean": -0.0019516131142154336, + "std": 0.18573260307312012, + "rms": 0.1857428401708603, + "max_abs": 23.875 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "65828ad8b051451aa72ed2d219401a186c025dbbc0a22ddcdedd7de27c1808f7", + "mean": -0.0015470532234758139, + "std": 0.11629899591207504, + "rms": 0.1163092851638794, + "max_abs": 3.359375 + }, + "full_input": { + "shape": [ + 149, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "817744ec8f0a523f5a803fdd6d9c1c0531a3ec2d9c8d218f82a0d7f89d0f1919", + "mean": -0.0018317298963665962, + "std": 0.18037691712379456, + "rms": 0.18038620054721832, + "max_abs": 23.875 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e1aaf985af78bc6b2f1a0e387e3f961f917eff4471e25292a497900a49267247", + "mean": -0.0017712885746732354, + "std": 0.11669748276472092, + "rms": 0.11671092361211777, + "max_abs": 3.4375 + }, + "full_input": { + "shape": [ + 133, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "41b996b42c910f50039e3c432a551ea581f3f8ccf40d510e20a6fd157dc5c65d", + "mean": -0.0019637441728264093, + "std": 0.1855592280626297, + "rms": 0.1855696141719818, + "max_abs": 23.875 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "edd31d56ab81e29b0745e7c7053c055f9697a1427f6926f538e3080b1676e3f1", + "mean": -0.001491212984547019, + "std": 0.11554086953401566, + "rms": 0.11555049568414688, + "max_abs": 3.375 + }, + "full_input": { + "shape": [ + 149, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f4b3c0d52391480c07e3a30180c888ca24e44d3396fab78ee3e09d249aa7e01e", + "mean": -0.0017954043578356504, + "std": 0.18008747696876526, + "rms": 0.18009643256664276, + "max_abs": 23.875 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "040b63c29502d3eb3c7e6a2af448b6bd826caaf817562f958940db06bffaa49a", + "mean": -0.0017303642816841602, + "std": 0.1166030764579773, + "rms": 0.1166159138083458, + "max_abs": 3.4375 + }, + "full_input": { + "shape": [ + 133, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6487c595c6001873d11d49f87cade1cf75e4ba9edfbc0a16480b3e23ec840e6a", + "mean": -0.0019754457753151655, + "std": 0.18518324196338654, + "rms": 0.18519377708435059, + "max_abs": 23.875 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "095d29ec41e66f2fbf457f6373d48da6c2081071a275d31517b04915032771e8", + "mean": -0.0014640901936218143, + "std": 0.11541303247213364, + "rms": 0.1154223158955574, + "max_abs": 3.34375 + }, + "full_input": { + "shape": [ + 149, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5a161a760b096ffad50d0fb5c0bb77d9d365ae3a4be66dd2fdde0a4b1b810ac0", + "mean": -0.0018062496092170477, + "std": 0.17976202070713043, + "rms": 0.17977109551429749, + "max_abs": 23.875 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9978113770484924, + "min_cosine_similarity": 0.9872506856918335, + "mean_relative_l2": 0.06223234534263611, + "max_abs_delta": 0.1796875 + }, + "system_bos": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.99620121717453, + "min_cosine_similarity": 0.9734393954277039, + "mean_relative_l2": 0.08011271059513092, + "max_abs_delta": 0.359375 + }, + "system_x": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9946997761726379, + "min_cosine_similarity": 0.9598324298858643, + "mean_relative_l2": 0.0925663635134697, + "max_abs_delta": 0.375 + }, + "system_period": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9948433041572571, + "min_cosine_similarity": 0.9604312181472778, + "mean_relative_l2": 0.09188422560691833, + "max_abs_delta": 0.421875 + }, + "bos_at_s0": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9907990097999573, + "min_cosine_similarity": 0.8791615962982178, + "mean_relative_l2": 0.12462128698825836, + "max_abs_delta": 0.4296875 + }, + "bos_at_s1": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9890843033790588, + "min_cosine_similarity": 0.8739595413208008, + "mean_relative_l2": 0.13596326112747192, + "max_abs_delta": 0.46484375 + }, + "x_at_s0": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.990448534488678, + "min_cosine_similarity": 0.8483028411865234, + "mean_relative_l2": 0.12378030270338058, + "max_abs_delta": 0.5390625 + }, + "x_at_s1": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9872738122940063, + "min_cosine_similarity": 0.8332988023757935, + "mean_relative_l2": 0.1427174061536789, + "max_abs_delta": 0.58203125 + }, + "period_at_s0": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9904570579528809, + "min_cosine_similarity": 0.8503392338752747, + "mean_relative_l2": 0.12456346303224564, + "max_abs_delta": 0.5234375 + }, + "period_at_s1": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9874752163887024, + "min_cosine_similarity": 0.8330625891685486, + "mean_relative_l2": 0.14229099452495575, + "max_abs_delta": 0.56640625 + } + } + }, + "layer_03": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "66c79e35ff41f8f751be255d318f88192645be6367a7750139dca5fe26c43c69", + "mean": -0.0026236698031425476, + "std": 0.14268021285533905, + "rms": 0.1427043378353119, + "max_abs": 4.375 + }, + "full_input": { + "shape": [ + 133, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "67b28806700a53617d65631d2a1b49fdb2ac1fdd21fda89ba67e01388656747f", + "mean": -0.012000068090856075, + "std": 6.2490434646606445, + "rms": 6.249054908752441, + "max_abs": 1136.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a98c1334e0e86a2a54d909e152c06cd4b59173d6cd757388d9917c740ad75df8", + "mean": -0.0025511637795716524, + "std": 0.14261631667613983, + "rms": 0.14263911545276642, + "max_abs": 4.375 + }, + "full_input": { + "shape": [ + 149, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6710dd90c30494bb322b9e75cad3a7bb4e59ee876cf3edbd76c75de46c3e4f59", + "mean": -0.012310650199651718, + "std": 6.100301265716553, + "rms": 6.100313186645508, + "max_abs": 1136.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7375589a52f9bc6c4c6a6c2ed91aba214ec3d161a658a3f89f08fe74ae1525e9", + "mean": -0.002743946388363838, + "std": 0.14273406565189362, + "rms": 0.14276044070720673, + "max_abs": 4.4375 + }, + "full_input": { + "shape": [ + 133, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ce9daa38fc6f0593194dfba472c4e8bbbeca294b089edc565c7b9a9ef176c9da", + "mean": -0.004455382004380226, + "std": 5.573277950286865, + "rms": 5.573279857635498, + "max_abs": 1136.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9fef71e07163857ebaae7315493d8b6e001eb2f621f66ee525b7c8d84847c27a", + "mean": -0.0026614819653332233, + "std": 0.14158675074577332, + "rms": 0.1416117548942566, + "max_abs": 4.4375 + }, + "full_input": { + "shape": [ + 149, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "54aff6d025714b64eb3545de6d2a49cd8b43010f31fb90217a3691ecee051c39", + "mean": -0.004320560488849878, + "std": 5.265756130218506, + "rms": 5.265758037567139, + "max_abs": 1136.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4e133e3ee95f511cacf58b23dceaa3589268c879323633904adab29d7095516a", + "mean": -0.0027955202385783195, + "std": 0.1416776180267334, + "rms": 0.1417052000761032, + "max_abs": 4.4375 + }, + "full_input": { + "shape": [ + 133, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cc6ae1155c4f51f557664d778ca8a1fddedc9a9f3d6bd19de96d38dbe86b8295", + "mean": -0.004540042020380497, + "std": 5.573246002197266, + "rms": 5.57324743270874, + "max_abs": 1136.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2469c29f120d0c8e864b0732d4a224e1ce866285368a5c6e3156e8d44156c70a", + "mean": -0.0027095514815300703, + "std": 0.1403629332780838, + "rms": 0.140389084815979, + "max_abs": 4.4375 + }, + "full_input": { + "shape": [ + 149, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3b11ae840b15549316ab9ff2ab8dc3e5ece6891818908cd1f5eb0e9f7f859f29", + "mean": -0.004392423201352358, + "std": 5.265725612640381, + "rms": 5.2657270431518555, + "max_abs": 1136.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bd2abc4ecd094a6fd2aedd43f9d023b9b009886b7b56744ae08bff98e36e30da", + "mean": -0.0027486812323331833, + "std": 0.14154593646526337, + "rms": 0.14157260954380035, + "max_abs": 4.4375 + }, + "full_input": { + "shape": [ + 133, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "297958e4725da920b304515031d6c3fa7ce8d4f74f251d92c4cdc2dc49e0a63b", + "mean": -0.004507156554609537, + "std": 5.573235988616943, + "rms": 5.573237419128418, + "max_abs": 1136.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "948c2fa845658278570d16c6a34f3636d8bbfcb50caeddbc398154c3cb3daa22", + "mean": -0.002663611201569438, + "std": 0.14019161462783813, + "rms": 0.1402169167995453, + "max_abs": 4.40625 + }, + "full_input": { + "shape": [ + 149, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2cca807c71da730c30399a56319653a005c22340a7e7027762a692e0475b7982", + "mean": -0.004364298656582832, + "std": 5.2657151222229, + "rms": 5.265717506408691, + "max_abs": 1136.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9976784586906433, + "min_cosine_similarity": 0.9841197729110718, + "mean_relative_l2": 0.06316612660884857, + "max_abs_delta": 0.203125 + }, + "system_bos": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9957602024078369, + "min_cosine_similarity": 0.9721050262451172, + "mean_relative_l2": 0.08395400643348694, + "max_abs_delta": 0.34375 + }, + "system_x": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.993924081325531, + "min_cosine_similarity": 0.9572187066078186, + "mean_relative_l2": 0.0978788509964943, + "max_abs_delta": 0.375 + }, + "system_period": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9941111207008362, + "min_cosine_similarity": 0.9542050361633301, + "mean_relative_l2": 0.09680088609457016, + "max_abs_delta": 0.484375 + }, + "bos_at_s0": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9915440678596497, + "min_cosine_similarity": 0.884749174118042, + "mean_relative_l2": 0.11816471815109253, + "max_abs_delta": 0.42578125 + }, + "bos_at_s1": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9892675876617432, + "min_cosine_similarity": 0.8801034688949585, + "mean_relative_l2": 0.13336274027824402, + "max_abs_delta": 0.453125 + }, + "x_at_s0": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.990596354007721, + "min_cosine_similarity": 0.8447141647338867, + "mean_relative_l2": 0.12028197944164276, + "max_abs_delta": 0.5625 + }, + "x_at_s1": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9865508079528809, + "min_cosine_similarity": 0.823072612285614, + "mean_relative_l2": 0.1435403674840927, + "max_abs_delta": 0.55859375 + }, + "period_at_s0": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9904715418815613, + "min_cosine_similarity": 0.8404965400695801, + "mean_relative_l2": 0.12121110409498215, + "max_abs_delta": 0.5546875 + }, + "period_at_s1": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9863746166229248, + "min_cosine_similarity": 0.7983856797218323, + "mean_relative_l2": 0.1440940499305725, + "max_abs_delta": 0.5234375 + } + } + }, + "layer_04": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "86c3ecd8b9c8e5f8d9c131ea97695aac5b10e82020a501d7df1907ac084d09f0", + "mean": -0.0025310043711215258, + "std": 0.18287299573421478, + "rms": 0.18289050459861755, + "max_abs": 5.625 + }, + "full_input": { + "shape": [ + 133, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7f1b233a694dae6717e9e6a615f577f4f4f4e82baeafc0f04b9cc363e574336e", + "mean": -0.011787517927587032, + "std": 6.521729946136475, + "rms": 6.521740436553955, + "max_abs": 1152.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2eb65570df84cbd1e247679577e991513caca6ab59c4f04d56dcd033e88b1add", + "mean": -0.0024724663235247135, + "std": 0.1830025166273117, + "rms": 0.18301920592784882, + "max_abs": 5.625 + }, + "full_input": { + "shape": [ + 149, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9b873cd99bcb69ebdb91b177b6730f6d7b2472aa43806d0af4eb4af197834a9e", + "mean": -0.012152701616287231, + "std": 6.349043846130371, + "rms": 6.34905481338501, + "max_abs": 1152.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "092e195332c971cf0d65748dd3749f593604a44b263b008fb05754e433fc099d", + "mean": -0.0026013103779405355, + "std": 0.18416069447994232, + "rms": 0.18417906761169434, + "max_abs": 5.75 + }, + "full_input": { + "shape": [ + 133, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "dd9b29ebccb234b52616d274f3ce5e2102e0b0758efce766d3ebf332f82eff0b", + "mean": -0.004202924203127623, + "std": 5.84637975692749, + "rms": 5.846380710601807, + "max_abs": 1152.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e9d94b3ad80030fd1e2bd46f8080a2c2469a507651019b3135fb4c9034d47466", + "mean": -0.002501205075532198, + "std": 0.18303461372852325, + "rms": 0.1830517053604126, + "max_abs": 5.6875 + }, + "full_input": { + "shape": [ + 149, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "45631549ce336fbd70cf08168edbc8603b7dc1384eb94347c20723f50e8355f8", + "mean": -0.004104937892407179, + "std": 5.518072605133057, + "rms": 5.518073081970215, + "max_abs": 1152.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fd41f3c7509ddbd15c5ad85dded33f44666b27a116811c1f99f846a50e8b2cc9", + "mean": -0.0025361194275319576, + "std": 0.18263165652751923, + "rms": 0.18264926970005035, + "max_abs": 5.625 + }, + "full_input": { + "shape": [ + 133, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3c90986d3d33b0a71b46acbbbebeea154a40a4d24d09bac6d8435d7869ed4e47", + "mean": -0.004128903150558472, + "std": 5.846318244934082, + "rms": 5.846320152282715, + "max_abs": 1152.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bec67a1420211892ad63ec55f6decb6043df694288cd6ef741c687b7bd2e610f", + "mean": -0.0024435350205749273, + "std": 0.18133746087551117, + "rms": 0.18135392665863037, + "max_abs": 5.46875 + }, + "full_input": { + "shape": [ + 149, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "107c88f1a58cd9e50b49571df8df80b7a08297d0f6548d17e1c1cefa1cfbfe0f", + "mean": -0.004055131692439318, + "std": 5.518008708953857, + "rms": 5.518009662628174, + "max_abs": 1152.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "39f4a982bbbd5a24c220639795a1b7f1657eefb9128746c56937d96b1d3934a5", + "mean": -0.0024175953585654497, + "std": 0.18218952417373657, + "rms": 0.18220555782318115, + "max_abs": 5.625 + }, + "full_input": { + "shape": [ + 133, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2d65b26075fdc52166a8351dc46d705d1a86be1a4e06f61d0d385a22f36c8c30", + "mean": -0.00403874134644866, + "std": 5.846298694610596, + "rms": 5.84630012512207, + "max_abs": 1152.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "eb596f807695867767f30f01a007f026ee601589729c9a177f0987e125022694", + "mean": -0.0023859490174800158, + "std": 0.18112166225910187, + "rms": 0.18113738298416138, + "max_abs": 5.5625 + }, + "full_input": { + "shape": [ + 149, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a8f5aa906e78619dde43ce82e70e32edd53b08801d584b73afcab8a47ca865c1", + "mean": -0.004011357203125954, + "std": 5.517995357513428, + "rms": 5.517995834350586, + "max_abs": 1152.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9979255199432373, + "min_cosine_similarity": 0.984811544418335, + "mean_relative_l2": 0.0592186413705349, + "max_abs_delta": 0.1875 + }, + "system_bos": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9961270093917847, + "min_cosine_similarity": 0.9742084741592407, + "mean_relative_l2": 0.08046741038560867, + "max_abs_delta": 0.28125 + }, + "system_x": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9946728348731995, + "min_cosine_similarity": 0.9626119136810303, + "mean_relative_l2": 0.093047134578228, + "max_abs_delta": 0.34375 + }, + "system_period": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.994720995426178, + "min_cosine_similarity": 0.9637421369552612, + "mean_relative_l2": 0.09275053441524506, + "max_abs_delta": 0.4375 + }, + "bos_at_s0": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9929943680763245, + "min_cosine_similarity": 0.8773085474967957, + "mean_relative_l2": 0.10659776628017426, + "max_abs_delta": 0.546875 + }, + "bos_at_s1": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9913530945777893, + "min_cosine_similarity": 0.8741344213485718, + "mean_relative_l2": 0.11918988823890686, + "max_abs_delta": 0.609375 + }, + "x_at_s0": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.991671085357666, + "min_cosine_similarity": 0.841090202331543, + "mean_relative_l2": 0.11123814433813095, + "max_abs_delta": 0.66796875 + }, + "x_at_s1": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9881867170333862, + "min_cosine_similarity": 0.8207407593727112, + "mean_relative_l2": 0.13408614695072174, + "max_abs_delta": 0.7255859375 + }, + "period_at_s0": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.991381049156189, + "min_cosine_similarity": 0.8328267335891724, + "mean_relative_l2": 0.11276119202375412, + "max_abs_delta": 0.681640625 + }, + "period_at_s1": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9881516695022583, + "min_cosine_similarity": 0.8105894327163696, + "mean_relative_l2": 0.13388697803020477, + "max_abs_delta": 0.7626953125 + } + } + }, + "layer_05": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "99956267eba8fa0a7525810ec7858df6edfecddde80abfc1eaaad28c9f3ce6ff", + "mean": -0.0023263776674866676, + "std": 0.20744043588638306, + "rms": 0.20745347440242767, + "max_abs": 6.21875 + }, + "full_input": { + "shape": [ + 133, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "82361bea71dd58d338aca405e4ab5ff36c1c7dd91e7c612f5ce13611caf3b59a", + "mean": -0.01270213257521391, + "std": 6.720791816711426, + "rms": 6.720804214477539, + "max_abs": 1152.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5ba6af4fd4fb2f4907a943619ef971da8a851c0256c189db40c34cdbd2217bd3", + "mean": -0.0023256922140717506, + "std": 0.20769496262073517, + "rms": 0.2077079713344574, + "max_abs": 6.25 + }, + "full_input": { + "shape": [ + 149, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9fabdbc7833f3c4c8faab858c74002f340dc98d3054e7d507d252cf975fbf3c9", + "mean": -0.01291737798601389, + "std": 6.544900894165039, + "rms": 6.5449137687683105, + "max_abs": 1152.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "19e6a194e3f1fdc8db89739bde749f821f2c50258a817d6dc62076cf060448dd", + "mean": -0.002365051070228219, + "std": 0.20965495705604553, + "rms": 0.20966829359531403, + "max_abs": 6.21875 + }, + "full_input": { + "shape": [ + 133, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1ab5eb3a602474295e94ecc535e039e682ad013cac9d6cae4fb960d05d1ea42e", + "mean": -0.004317117389291525, + "std": 5.9494309425354, + "rms": 5.949432373046875, + "max_abs": 1152.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "db83fef62ef81273424ec72017ec84271d5c477d425fc013ec691c4fb6d392b9", + "mean": -0.002304336056113243, + "std": 0.20871831476688385, + "rms": 0.2087310403585434, + "max_abs": 6.3125 + }, + "full_input": { + "shape": [ + 149, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "682cb5150f7f278c79b82aff6867fd325b059e30a79b545801a01d5a3e1c5b42", + "mean": -0.004139857366681099, + "std": 5.614323139190674, + "rms": 5.614324569702148, + "max_abs": 1152.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6f88f77b5ec56fb17687b8875310a8fab144801960b0513aa20ab787dad23464", + "mean": -0.0023517103400081396, + "std": 0.20794741809368134, + "rms": 0.20796070992946625, + "max_abs": 6.25 + }, + "full_input": { + "shape": [ + 133, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f0145fc8a7fa04d8aced45ee477ab5f9ac922c14b69b85059694366c288ceace", + "mean": -0.004260555375367403, + "std": 5.949360370635986, + "rms": 5.949362754821777, + "max_abs": 1152.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8f608140f70412962337c42df81a7db354bd160b6e7a49c6162cc981f6d0ede5", + "mean": -0.0024309849832206964, + "std": 0.20661842823028564, + "rms": 0.20663273334503174, + "max_abs": 6.3125 + }, + "full_input": { + "shape": [ + 149, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1ad71bad54233bc3c6c7e12ad3ca6ac8fdb5af583630ababb50da79e795a6d6d", + "mean": -0.004205660428851843, + "std": 5.61424446105957, + "rms": 5.614246845245361, + "max_abs": 1152.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ca32a8688c6bbb27c008f7af6f5febd019f649171873f814728d4740927cf1f6", + "mean": -0.002287473762407899, + "std": 0.20783360302448273, + "rms": 0.20784617960453033, + "max_abs": 6.25 + }, + "full_input": { + "shape": [ + 133, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fe68458ff29d1a6eaffa78d07e0ae64c99554dcdb899d48979deb21595b635d6", + "mean": -0.004213833715766668, + "std": 5.949344158172607, + "rms": 5.949345588684082, + "max_abs": 1152.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c5074311e7a347d9a9fb4b0e82da9fa1bd269dc5ee88560f0bb44a69b53d6aac", + "mean": -0.0023645830806344748, + "std": 0.20635060966014862, + "rms": 0.20636415481567383, + "max_abs": 6.3125 + }, + "full_input": { + "shape": [ + 149, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d437889f9349cb317da21f7d2fd61e3ea35915b0b45154c55fdb490b73368b9e", + "mean": -0.004171543288975954, + "std": 5.614226818084717, + "rms": 5.61422872543335, + "max_abs": 1152.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9973152875900269, + "min_cosine_similarity": 0.9745430946350098, + "mean_relative_l2": 0.06634976714849472, + "max_abs_delta": 0.21875 + }, + "system_bos": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9954978227615356, + "min_cosine_similarity": 0.9678006768226624, + "mean_relative_l2": 0.0868535116314888, + "max_abs_delta": 0.265625 + }, + "system_x": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9934706687927246, + "min_cosine_similarity": 0.9530702233314514, + "mean_relative_l2": 0.10351605713367462, + "max_abs_delta": 0.375 + }, + "system_period": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9932813048362732, + "min_cosine_similarity": 0.9506000876426697, + "mean_relative_l2": 0.10506826639175415, + "max_abs_delta": 0.484375 + }, + "bos_at_s0": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9918823838233948, + "min_cosine_similarity": 0.8472943902015686, + "mean_relative_l2": 0.1130136176943779, + "max_abs_delta": 0.610595703125 + }, + "bos_at_s1": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9900951981544495, + "min_cosine_similarity": 0.8404663801193237, + "mean_relative_l2": 0.1260252743959427, + "max_abs_delta": 0.671875 + }, + "x_at_s0": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.990285336971283, + "min_cosine_similarity": 0.7965741157531738, + "mean_relative_l2": 0.11755961924791336, + "max_abs_delta": 0.7890625 + }, + "x_at_s1": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9862445592880249, + "min_cosine_similarity": 0.7766889929771423, + "mean_relative_l2": 0.14340539276599884, + "max_abs_delta": 0.888671875 + }, + "period_at_s0": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9899561405181885, + "min_cosine_similarity": 0.7942100167274475, + "mean_relative_l2": 0.1194014698266983, + "max_abs_delta": 0.791015625 + }, + "period_at_s1": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9860997200012207, + "min_cosine_similarity": 0.762019693851471, + "mean_relative_l2": 0.14344823360443115, + "max_abs_delta": 0.9716796875 + } + } + }, + "layer_06": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b72e398db297795fd74d15779b36b1d8b5af73bc5737a8ef2f4b7e9ed03c1e71", + "mean": -0.004525769967585802, + "std": 0.2406071126461029, + "rms": 0.24064967036247253, + "max_abs": 8.25 + }, + "full_input": { + "shape": [ + 133, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7f306d0bcd7dc8586d1685b4fece73dbf3353a0a4b8af5580710333ed51110a8", + "mean": -0.01500630285590887, + "std": 6.843766689300537, + "rms": 6.843783378601074, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ef538c77f8345d02b821acf8a71094bacdfa235e5e51d942170fd87d35b98cb3", + "mean": -0.004538265988230705, + "std": 0.240270733833313, + "rms": 0.2403135746717453, + "max_abs": 8.25 + }, + "full_input": { + "shape": [ + 149, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b46df4582dac73964364cf7b57e2bbd827ed783f5e134dc9fe699028b1519ccb", + "mean": -0.015129140578210354, + "std": 6.664217472076416, + "rms": 6.664234638214111, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a2278afa8394bda5ac217b84f0f12edc9bc8d692629610578d525189c22eb24b", + "mean": -0.0044585647992789745, + "std": 0.24264800548553467, + "rms": 0.24268895387649536, + "max_abs": 8.25 + }, + "full_input": { + "shape": [ + 133, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8057eb9981d28a800ae313f0a6397c48887efdc3cf862ce4f8658cbb5d61f39c", + "mean": -0.0063297138549387455, + "std": 6.045544147491455, + "rms": 6.0455474853515625, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b2d0fedf4642292d7565ef1cca0b5acbadc96282f2f1c71827add6e848f93524", + "mean": -0.00441826693713665, + "std": 0.24146227538585663, + "rms": 0.24150268733501434, + "max_abs": 8.375 + }, + "full_input": { + "shape": [ + 149, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "97a7db3ab5e69f53bf45f91c857e48072424ec3a87897c34a95db1dd3851e371", + "mean": -0.00605528149753809, + "std": 5.705219268798828, + "rms": 5.7052226066589355, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6b85aaf8c06ca2b470ae63fdd46867474bd51f419df077399f011d0bb2daa697", + "mean": -0.004462988581508398, + "std": 0.24141256511211395, + "rms": 0.24145381152629852, + "max_abs": 8.375 + }, + "full_input": { + "shape": [ + 133, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2e9b113842f8b05da392584cbb3427aeb50b5750832c320b8246cb4f4e1246c7", + "mean": -0.006240274291485548, + "std": 6.045478820800781, + "rms": 6.0454816818237305, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5f619dfe8d671f909188a99aee421b542a5a8e6df3037c6a1e5376d226840c77", + "mean": -0.004403802566230297, + "std": 0.23944781720638275, + "rms": 0.23948833346366882, + "max_abs": 8.375 + }, + "full_input": { + "shape": [ + 149, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bcaa1cd19de90b61a3aaaa1b7dab7863603738e33ababdbb4da66bfecf42085c", + "mean": -0.005957239307463169, + "std": 5.705128192901611, + "rms": 5.705132007598877, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ddcfe8ea28d0b831947eb9c122523a8d31aa24b67d876f912617c56ce5a076b6", + "mean": -0.0044441670179367065, + "std": 0.24135369062423706, + "rms": 0.24139459431171417, + "max_abs": 8.3125 + }, + "full_input": { + "shape": [ + 133, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1f083eb91257d765cb6d966ec03880313d1cdc12c6813105c0b63b49f847d087", + "mean": -0.006210602354258299, + "std": 6.045469284057617, + "rms": 6.045472621917725, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ccecdcc8ce0ca64e3b2202ad150b6929ef4660a559641468abacf0aded480de4", + "mean": -0.004382240120321512, + "std": 0.23910070955753326, + "rms": 0.23914086818695068, + "max_abs": 8.3125 + }, + "full_input": { + "shape": [ + 149, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fb707d238ba1cf66efc410df8bf61e9af79a8ec0f14f1cb06ce673233e5ab9e1", + "mean": -0.0059523805975914, + "std": 5.7051100730896, + "rms": 5.705113410949707, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.996866762638092, + "min_cosine_similarity": 0.9704548120498657, + "mean_relative_l2": 0.0704820454120636, + "max_abs_delta": 0.546875 + }, + "system_bos": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9951687455177307, + "min_cosine_similarity": 0.9577631950378418, + "mean_relative_l2": 0.08935728669166565, + "max_abs_delta": 0.375 + }, + "system_x": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9928104877471924, + "min_cosine_similarity": 0.9416695833206177, + "mean_relative_l2": 0.10845448076725006, + "max_abs_delta": 0.625 + }, + "system_period": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9925311803817749, + "min_cosine_similarity": 0.9332876205444336, + "mean_relative_l2": 0.11058105528354645, + "max_abs_delta": 0.59375 + }, + "bos_at_s0": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.992435872554779, + "min_cosine_similarity": 0.8522210121154785, + "mean_relative_l2": 0.10775648057460785, + "max_abs_delta": 0.65625 + }, + "bos_at_s1": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.990336537361145, + "min_cosine_similarity": 0.8469876646995544, + "mean_relative_l2": 0.12317494302988052, + "max_abs_delta": 0.58935546875 + }, + "x_at_s0": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9904484152793884, + "min_cosine_similarity": 0.7934283018112183, + "mean_relative_l2": 0.1154196709394455, + "max_abs_delta": 1.0185546875 + }, + "x_at_s1": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.985759973526001, + "min_cosine_similarity": 0.7621628046035767, + "mean_relative_l2": 0.1442905217409134, + "max_abs_delta": 1.234375 + }, + "period_at_s0": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9898986220359802, + "min_cosine_similarity": 0.7878479957580566, + "mean_relative_l2": 0.11863764375448227, + "max_abs_delta": 1.0771484375 + }, + "period_at_s1": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9853633642196655, + "min_cosine_similarity": 0.7460344433784485, + "mean_relative_l2": 0.14509020745754242, + "max_abs_delta": 1.3056640625 + } + } + }, + "layer_07": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "257b79493ce069c414810933ec6e28c4ae9be52ae2f2be295211eec9ceee438e", + "mean": -0.006306880619376898, + "std": 0.260804146528244, + "rms": 0.26088038086891174, + "max_abs": 7.46875 + }, + "full_input": { + "shape": [ + 133, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "98df7f5eb723800e91a97cfad418fa69ddfc87a9f9c5a9730da05c0b100bea9c", + "mean": -0.01643405854701996, + "std": 6.864097595214844, + "rms": 6.86411714553833, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "27238eaa58ae84d65d3f656e468949930cdd7658e51089aa734ee54c878e1920", + "mean": -0.0063185435719788074, + "std": 0.2599773705005646, + "rms": 0.2600541412830353, + "max_abs": 7.40625 + }, + "full_input": { + "shape": [ + 149, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "40f0d455d4824932d21fcb15552e7324d366d49e9a9c71a5826296d9a96e764f", + "mean": -0.016749676316976547, + "std": 6.684310436248779, + "rms": 6.684330940246582, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "81e6966a8c32a6d1f151a1b7ef962025f85b8f46d6376a20fc4f2dc44d9a5376", + "mean": -0.006394477561116219, + "std": 0.261260449886322, + "rms": 0.2613387107849121, + "max_abs": 7.5 + }, + "full_input": { + "shape": [ + 133, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "aa43c1334d4f712472263fe18bf73b8f16735498ba3d84426e55525807e9d84e", + "mean": -0.007863310165703297, + "std": 6.057057857513428, + "rms": 6.057062149047852, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4373b2c3caea3d3988a0dbbdb1b669519f416316d370f44a5eb11e52cada5bad", + "mean": -0.0062717352993786335, + "std": 0.2599649131298065, + "rms": 0.2600405514240265, + "max_abs": 7.5625 + }, + "full_input": { + "shape": [ + 149, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "045dde0a889270fcb7a4bb8bc1d7cdfd5e1eb44d241f66a6ba65b2b5f06ab7f4", + "mean": -0.0077024707570672035, + "std": 5.716214656829834, + "rms": 5.716219425201416, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ff20f6b8f872517f1258ebd2d0052bd5f6aac20adaa3913926e1efb8340618d0", + "mean": -0.006372982170432806, + "std": 0.2595038115978241, + "rms": 0.2595820426940918, + "max_abs": 7.65625 + }, + "full_input": { + "shape": [ + 133, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2aceefd68c7c35de265bb4d3b08fa9913957152b7244f963f4087c038366d792", + "mean": -0.00787031464278698, + "std": 6.0569634437561035, + "rms": 6.0569682121276855, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5697e10607b373005f9554215ecd110b210705de06507da158b543794950eb6a", + "mean": -0.006296808365732431, + "std": 0.25858697295188904, + "rms": 0.2586636245250702, + "max_abs": 7.5 + }, + "full_input": { + "shape": [ + 149, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bfc9302f7ecfa6e7698be9d8c523fc87281e8bb87d323e6436b9f31aec00fc83", + "mean": -0.007713439408689737, + "std": 5.716135501861572, + "rms": 5.716140270233154, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2edb0f98070ba39a2dca8178d844a523f007d396b1a46b42f37e83e044b4747c", + "mean": -0.006370041985064745, + "std": 0.25927531719207764, + "rms": 0.25935354828834534, + "max_abs": 7.625 + }, + "full_input": { + "shape": [ + 133, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b45438d5ecb52ba471e726aae2e67cb2697c8186d6bb00862a7f12d0a828e85a", + "mean": -0.007768361363559961, + "std": 6.0569562911987305, + "rms": 6.0569610595703125, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5f1c21dc5d21204ae60dfe707fbdadd04b865cb2ba3e60116e45ab456564857f", + "mean": -0.006236874498426914, + "std": 0.25827834010124207, + "rms": 0.2583536207675934, + "max_abs": 7.4375 + }, + "full_input": { + "shape": [ + 149, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e8a70b5617278f9411fc0c9d4fac3a56b6a1967e4246851fed713f867a1e4242", + "mean": -0.0076282271184027195, + "std": 5.716125965118408, + "rms": 5.71613073348999, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9960845708847046, + "min_cosine_similarity": 0.9613151550292969, + "mean_relative_l2": 0.07916200906038284, + "max_abs_delta": 0.375 + }, + "system_bos": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9940945506095886, + "min_cosine_similarity": 0.9459973573684692, + "mean_relative_l2": 0.09904736280441284, + "max_abs_delta": 0.5625 + }, + "system_x": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9910793900489807, + "min_cosine_similarity": 0.923040509223938, + "mean_relative_l2": 0.12116199731826782, + "max_abs_delta": 0.5625 + }, + "system_period": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9909808039665222, + "min_cosine_similarity": 0.9184752106666565, + "mean_relative_l2": 0.12146815657615662, + "max_abs_delta": 0.46875 + }, + "bos_at_s0": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9916790127754211, + "min_cosine_similarity": 0.8569097518920898, + "mean_relative_l2": 0.11412122845649719, + "max_abs_delta": 0.65625 + }, + "bos_at_s1": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.989056408405304, + "min_cosine_similarity": 0.8524123430252075, + "mean_relative_l2": 0.13230235874652863, + "max_abs_delta": 0.646484375 + }, + "x_at_s0": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9892638325691223, + "min_cosine_similarity": 0.801023542881012, + "mean_relative_l2": 0.12456124275922775, + "max_abs_delta": 1.15625 + }, + "x_at_s1": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9840347766876221, + "min_cosine_similarity": 0.7570390701293945, + "mean_relative_l2": 0.15589392185211182, + "max_abs_delta": 1.4111328125 + }, + "period_at_s0": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.988792359828949, + "min_cosine_similarity": 0.7885200381278992, + "mean_relative_l2": 0.12672092020511627, + "max_abs_delta": 1.1875 + }, + "period_at_s1": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9833660125732422, + "min_cosine_similarity": 0.7436391115188599, + "mean_relative_l2": 0.15781839191913605, + "max_abs_delta": 1.404296875 + } + } + }, + "layer_08": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0e732afd227f180884e65c58645ee2173692ea0878a3c55cbcebc24c3e1152da", + "mean": -0.007304203696548939, + "std": 0.2944492697715759, + "rms": 0.29453983902931213, + "max_abs": 7.96875 + }, + "full_input": { + "shape": [ + 133, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c468a1b237e1ae3b785865d27e7c74d2dff16b8e6202fbc593a78b8faec8ce3a", + "mean": -0.017335472628474236, + "std": 6.887977600097656, + "rms": 6.887999534606934, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "89db855633fa0a66c90fb4c2b323499b8418cb106f2b215fac78a50422505e64", + "mean": -0.0072450595907866955, + "std": 0.2938867509365082, + "rms": 0.2939760386943817, + "max_abs": 8.0625 + }, + "full_input": { + "shape": [ + 149, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "498d00ea4fa55228da68c55fc9e9b3117572e91ff0872fb1d905bf0d05f9f566", + "mean": -0.017335565760731697, + "std": 6.7078986167907715, + "rms": 6.707920551300049, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a4e7540d2f8fb876cef905edddc22a2f7cb0f17eb2cfe732fffcf9019449c186", + "mean": -0.0075170197524130344, + "std": 0.2947767376899719, + "rms": 0.29487255215644836, + "max_abs": 8.0 + }, + "full_input": { + "shape": [ + 133, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a17a69c64fb49580f39d5bc43bb1e3567fa79f17b3bfa634f473c5574b43c2bd", + "mean": -0.008910353295505047, + "std": 6.070778846740723, + "rms": 6.0707855224609375, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3c9fb179d1e1679f574144ed294af98a5d5f9754bd87f001153a866e8dc334d1", + "mean": -0.007408067584037781, + "std": 0.29428526759147644, + "rms": 0.29437851905822754, + "max_abs": 8.25 + }, + "full_input": { + "shape": [ + 149, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "83247aa7ecf0d4355467304e9bf9dea954b6577cf35eb4f6ba868ffee58cde47", + "mean": -0.008513647131621838, + "std": 5.72929573059082, + "rms": 5.729301929473877, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b35d157d739de5fd1695392aaab544a23d18e282d434fc705f37103dd9220900", + "mean": -0.007389018312096596, + "std": 0.2939591109752655, + "rms": 0.29405197501182556, + "max_abs": 8.125 + }, + "full_input": { + "shape": [ + 133, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6109c91ee69aed4b8c86dcb7c0ba4eb4e83d582964a27df3b433ff3b9c75e797", + "mean": -0.00880354456603527, + "std": 6.0707268714904785, + "rms": 6.070733070373535, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "231cda5ff2d8707042432c80e98030bdf74f64c640e7104f57e87da10bca78a3", + "mean": -0.007122492883354425, + "std": 0.2932012975215912, + "rms": 0.29328781366348267, + "max_abs": 8.0 + }, + "full_input": { + "shape": [ + 149, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0cb7031632392ae9c2fef9d82bef607852d20842c0a0eff2d1179ce0c33ebc3e", + "mean": -0.008251789025962353, + "std": 5.729228496551514, + "rms": 5.729234218597412, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "853afdd0962d032e3427d939dd68bdbb8d37de32166705627a1a3d73f4c45819", + "mean": -0.007434376515448093, + "std": 0.29409658908843994, + "rms": 0.29419052600860596, + "max_abs": 8.125 + }, + "full_input": { + "shape": [ + 133, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fa014b5e5d40c6e3f065c53fecdcf3395639b511adcb67c85f6b16ae400c20b7", + "mean": -0.00882774218916893, + "std": 6.070734977722168, + "rms": 6.070741176605225, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "80e5bfa3b4882a4c20d3153a7aa0097e6e2cb4ebfffde7253fe03017b2b38074", + "mean": -0.007067153695970774, + "std": 0.2931218445301056, + "rms": 0.2932070195674896, + "max_abs": 8.0 + }, + "full_input": { + "shape": [ + 149, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "19796529eb84bcd03957239966481091c6f9d000d0335f022229321831074dfb", + "mean": -0.008191032335162163, + "std": 5.729221343994141, + "rms": 5.729227066040039, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9954270720481873, + "min_cosine_similarity": 0.9568846225738525, + "mean_relative_l2": 0.08632520586252213, + "max_abs_delta": 0.828125 + }, + "system_bos": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.993224561214447, + "min_cosine_similarity": 0.9484267234802246, + "mean_relative_l2": 0.10708433389663696, + "max_abs_delta": 0.625 + }, + "system_x": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9890403151512146, + "min_cosine_similarity": 0.9080296158790588, + "mean_relative_l2": 0.1345595121383667, + "max_abs_delta": 0.65625 + }, + "system_period": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9891809821128845, + "min_cosine_similarity": 0.9165610671043396, + "mean_relative_l2": 0.13429179787635803, + "max_abs_delta": 0.53125 + }, + "bos_at_s0": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9906072020530701, + "min_cosine_similarity": 0.8236758708953857, + "mean_relative_l2": 0.12138818949460983, + "max_abs_delta": 0.78125 + }, + "bos_at_s1": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9877367615699768, + "min_cosine_similarity": 0.8340035676956177, + "mean_relative_l2": 0.14045725762844086, + "max_abs_delta": 0.984375 + }, + "x_at_s0": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9878049492835999, + "min_cosine_similarity": 0.7699651122093201, + "mean_relative_l2": 0.13460908830165863, + "max_abs_delta": 1.28125 + }, + "x_at_s1": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9820519089698792, + "min_cosine_similarity": 0.7053045034408569, + "mean_relative_l2": 0.1658855676651001, + "max_abs_delta": 1.474609375 + }, + "period_at_s0": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9874141216278076, + "min_cosine_similarity": 0.7553329467773438, + "mean_relative_l2": 0.13644562661647797, + "max_abs_delta": 1.3125 + }, + "period_at_s1": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9817348122596741, + "min_cosine_similarity": 0.7168179750442505, + "mean_relative_l2": 0.16772118210792542, + "max_abs_delta": 1.34375 + } + } + }, + "layer_09": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "11d07522fc16eeefc33dbc6bb84d2b5af33904a08dce32f5ad20bad7629bda6d", + "mean": -0.009582527913153172, + "std": 0.3551591634750366, + "rms": 0.35528841614723206, + "max_abs": 11.75 + }, + "full_input": { + "shape": [ + 133, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6a90c3ee07a9841a8b239075666ffa4d8415990c427f79ba0ba038fd10f3b570", + "mean": -0.01900251768529415, + "std": 6.891132354736328, + "rms": 6.891158580780029, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9cc3afe670569b1ace4634371e6b1ac8f7cdc2c98a24e8d6bd4ed3a30938e523", + "mean": -0.009485846385359764, + "std": 0.35413625836372375, + "rms": 0.3542632758617401, + "max_abs": 11.625 + }, + "full_input": { + "shape": [ + 149, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d968ea25f8bc1ba39ca37c7265c7bfd1802b42c8fd3be18a29270cd2ee129c4a", + "mean": -0.01920691877603531, + "std": 6.710962295532227, + "rms": 6.710989952087402, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e15b9106306ae22c43fda175592e9aff20d926a7f7315176e8d981bbd7338b11", + "mean": -0.009848943911492825, + "std": 0.3558311462402344, + "rms": 0.3559674322605133, + "max_abs": 11.5 + }, + "full_input": { + "shape": [ + 133, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a16141c7646c71d37e9c1542409c1780649fe873ec3e688197e7f3a376648058", + "mean": -0.010697182267904282, + "std": 6.07427453994751, + "rms": 6.074283599853516, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f1584ab5ddd942bb96d66886c2d0256794988421f4d9fa396d3071e722c8526b", + "mean": -0.009711057879030704, + "std": 0.35508543252944946, + "rms": 0.35521820187568665, + "max_abs": 11.375 + }, + "full_input": { + "shape": [ + 149, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d0916208e1657e64488f4157239d0996dbf4ea98f194c24d3d14805daa9b7254", + "mean": -0.010553400963544846, + "std": 5.732849597930908, + "rms": 5.732859134674072, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "928cb3ccf99b877c256028fc3c8eda932396e30e6846202203355c17ed91a3f9", + "mean": -0.009824984706938267, + "std": 0.3540895879268646, + "rms": 0.35422584414482117, + "max_abs": 11.5 + }, + "full_input": { + "shape": [ + 133, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "57c06e787b4aac257a130ab8b0fa443108c804a8cdad16b90fe5624d89e9b751", + "mean": -0.01065178494900465, + "std": 6.07417631149292, + "rms": 6.074186325073242, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "492650d7585b3ca43711a9a4e31cbd07d7994337bb6d50b3bae68d827a2c5895", + "mean": -0.009376770816743374, + "std": 0.3511691987514496, + "rms": 0.3512943685054779, + "max_abs": 11.6875 + }, + "full_input": { + "shape": [ + 149, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f07ec373214a41a152185530f5c4586a6951f4fc90a14c75e73721b01f13e4f4", + "mean": -0.010252716951072216, + "std": 5.732634544372559, + "rms": 5.7326436042785645, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4e0de13d0b69bd531c955dffe66ce47f0807811ec41f49f8f6a696e9a0b72677", + "mean": -0.009907609783113003, + "std": 0.35396188497543335, + "rms": 0.3541004955768585, + "max_abs": 11.625 + }, + "full_input": { + "shape": [ + 133, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "aed1ac3c677ab3c3e3eda346fc23511becab460c9c43c5ca0d2f9c763b23b460", + "mean": -0.010641627013683319, + "std": 6.074151039123535, + "rms": 6.074160099029541, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c19c2d14b3d8264a7b6463e2700e9883ada7621e954627604e46492c425f90ba", + "mean": -0.009446586482226849, + "std": 0.3507295548915863, + "rms": 0.350856751203537, + "max_abs": 11.75 + }, + "full_input": { + "shape": [ + 149, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "20f566b229380e7b082544f21beb433a194c66b3a7e88c2f2c07a00a394b917c", + "mean": -0.010217169299721718, + "std": 5.732591152191162, + "rms": 5.732600212097168, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9956891536712646, + "min_cosine_similarity": 0.9529047608375549, + "mean_relative_l2": 0.08307310938835144, + "max_abs_delta": 1.296875 + }, + "system_bos": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9935257434844971, + "min_cosine_similarity": 0.9519410729408264, + "mean_relative_l2": 0.10438254475593567, + "max_abs_delta": 0.65625 + }, + "system_x": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9884343147277832, + "min_cosine_similarity": 0.884093165397644, + "mean_relative_l2": 0.1364714503288269, + "max_abs_delta": 1.4375 + }, + "system_period": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9894297122955322, + "min_cosine_similarity": 0.9064632058143616, + "mean_relative_l2": 0.13197852671146393, + "max_abs_delta": 1.0 + }, + "bos_at_s0": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.991430938243866, + "min_cosine_similarity": 0.824303150177002, + "mean_relative_l2": 0.11500339955091476, + "max_abs_delta": 1.09375 + }, + "bos_at_s1": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9884442090988159, + "min_cosine_similarity": 0.8407036662101746, + "mean_relative_l2": 0.13630078732967377, + "max_abs_delta": 1.234375 + }, + "x_at_s0": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9885335564613342, + "min_cosine_similarity": 0.7794516086578369, + "mean_relative_l2": 0.130902960896492, + "max_abs_delta": 1.59375 + }, + "x_at_s1": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9826285243034363, + "min_cosine_similarity": 0.7041728496551514, + "mean_relative_l2": 0.1627480536699295, + "max_abs_delta": 2.03125 + }, + "period_at_s0": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9884153008460999, + "min_cosine_similarity": 0.7701020836830139, + "mean_relative_l2": 0.13187094032764435, + "max_abs_delta": 1.5 + }, + "period_at_s1": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9828446507453918, + "min_cosine_similarity": 0.7388496994972229, + "mean_relative_l2": 0.16355770826339722, + "max_abs_delta": 1.84375 + } + } + }, + "layer_10": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3b0a4ca0d1596046d9a131c22812e734ab8c4fd1f0eff467bbdeff4c8e396c23", + "mean": -0.008324376307427883, + "std": 0.39516541361808777, + "rms": 0.39525309205055237, + "max_abs": 11.75 + }, + "full_input": { + "shape": [ + 133, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e23f715708b70728b828a5d7561bfdb264b3f96cedd62a1e390a64ab65a41df0", + "mean": -0.018358813598752022, + "std": 6.898882865905762, + "rms": 6.898906707763672, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5642680ee3cebafcc1f8ff7e846debe25ccb4e7d2c077e549bc314b486f8a1b2", + "mean": -0.008308627642691135, + "std": 0.3937564790248871, + "rms": 0.3938441276550293, + "max_abs": 11.875 + }, + "full_input": { + "shape": [ + 149, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "595451595c63374ea749bbad39c3dc202dd9374d2dadd9cfc5cf94c86ddf3f81", + "mean": -0.01880963146686554, + "std": 6.718459129333496, + "rms": 6.718485355377197, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f3b3a36ccbab8f8121b103ded3cbe9c6c653b155793787fcb12056cdf3543e2a", + "mean": -0.008440044708549976, + "std": 0.396121084690094, + "rms": 0.39621099829673767, + "max_abs": 11.6875 + }, + "full_input": { + "shape": [ + 133, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9c12bc2170109c24ccb310f77322da7c79f412441d13588ebbacf7ca04dbbae0", + "mean": -0.009957410395145416, + "std": 6.082747459411621, + "rms": 6.082755088806152, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d64b483d989af10a08aa48fd8b4377f96c03fc9826c09e841e498b79c604a151", + "mean": -0.008507531136274338, + "std": 0.39567598700523376, + "rms": 0.3957674205303192, + "max_abs": 11.625 + }, + "full_input": { + "shape": [ + 149, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1a449d8a90d7cb5a918599e030d223e95b109b899785cd612f7269266720d746", + "mean": -0.01012581679970026, + "std": 5.741209983825684, + "rms": 5.741218566894531, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8a7729cf5eee3a661a6f0dda82e0a0dc9130e1fc6358f04aa8f07b3eb3fd777f", + "mean": -0.00856303796172142, + "std": 0.3961873948574066, + "rms": 0.396279901266098, + "max_abs": 11.9375 + }, + "full_input": { + "shape": [ + 133, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e60526b68261621b9bb3293c7bf721a16778f11ffb61288c07c82c596de14419", + "mean": -0.010042836889624596, + "std": 6.082727909088135, + "rms": 6.082736015319824, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1e2a654a12280fffeb4ec6fec35ae8f65cbaa949e6efbab54c972959a164fbf1", + "mean": -0.008141503669321537, + "std": 0.39478692412376404, + "rms": 0.3948708474636078, + "max_abs": 11.875 + }, + "full_input": { + "shape": [ + 149, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e99561df31e1366c5c86041064483b92c8d46a4f691804f3f2968f3ad4a9b327", + "mean": -0.009883695282042027, + "std": 5.741110324859619, + "rms": 5.74111795425415, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9a89958135501efd1fc7798600de21264f889310cae4472ea8739e65f7d9927d", + "mean": -0.008604724891483784, + "std": 0.39595848321914673, + "rms": 0.39605194330215454, + "max_abs": 11.875 + }, + "full_input": { + "shape": [ + 133, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "dab70d419d0eddc45847a5f5712c87443a62dbabff5160d059ed89648f0d56a6", + "mean": -0.009906472638249397, + "std": 6.082701683044434, + "rms": 6.082709789276123, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "471528407c59f90fab91976de44fb32ba9d4a09098b611f3b71ad08a1e31d7c4", + "mean": -0.00827870424836874, + "std": 0.3943956196308136, + "rms": 0.39448249340057373, + "max_abs": 11.875 + }, + "full_input": { + "shape": [ + 149, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "96916e7286a5c168fae6fe83f0c80422031096747daa72e85158ee6b6675b95f", + "mean": -0.00988802220672369, + "std": 5.741067409515381, + "rms": 5.74107551574707, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9952036738395691, + "min_cosine_similarity": 0.9488546848297119, + "mean_relative_l2": 0.08882776647806168, + "max_abs_delta": 1.75 + }, + "system_bos": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9927375316619873, + "min_cosine_similarity": 0.948198139667511, + "mean_relative_l2": 0.11192434281110764, + "max_abs_delta": 0.9375 + }, + "system_x": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9872249960899353, + "min_cosine_similarity": 0.8574163317680359, + "mean_relative_l2": 0.14378468692302704, + "max_abs_delta": 1.5 + }, + "system_period": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9886682033538818, + "min_cosine_similarity": 0.8969444632530212, + "mean_relative_l2": 0.1371440589427948, + "max_abs_delta": 1.078125 + }, + "bos_at_s0": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9903886318206787, + "min_cosine_similarity": 0.8205410838127136, + "mean_relative_l2": 0.12199042737483978, + "max_abs_delta": 1.375 + }, + "bos_at_s1": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.987159252166748, + "min_cosine_similarity": 0.8276270627975464, + "mean_relative_l2": 0.14437247812747955, + "max_abs_delta": 1.15625 + }, + "x_at_s0": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9873194098472595, + "min_cosine_similarity": 0.7551437616348267, + "mean_relative_l2": 0.1392303705215454, + "max_abs_delta": 1.96875 + }, + "x_at_s1": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9808549284934998, + "min_cosine_similarity": 0.6632264852523804, + "mean_relative_l2": 0.1729194074869156, + "max_abs_delta": 3.25 + }, + "period_at_s0": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9875680208206177, + "min_cosine_similarity": 0.7638530731201172, + "mean_relative_l2": 0.13849899172782898, + "max_abs_delta": 2.15625 + }, + "period_at_s1": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9814818501472473, + "min_cosine_similarity": 0.7171512842178345, + "mean_relative_l2": 0.1723177284002304, + "max_abs_delta": 3.015625 + } + } + }, + "layer_11": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "64f4ed3dab2891cd8984eafd4b54715c9bd76fc805ef8a9953ff1fb104ad5a68", + "mean": -0.010363854467868805, + "std": 0.4904358685016632, + "rms": 0.490545392036438, + "max_abs": 17.0 + }, + "full_input": { + "shape": [ + 133, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "62d8336a021e0723e446e88fa686779ba9cad0b62e762fd74a598acb391bf813", + "mean": -0.019705841317772865, + "std": 6.9401350021362305, + "rms": 6.9401631355285645, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7b103f598e0380eb5bb5b8e37be7daefdd8e769507a04046ded69b9f5236ece4", + "mean": -0.010177386924624443, + "std": 0.487454354763031, + "rms": 0.48756057024002075, + "max_abs": 16.5 + }, + "full_input": { + "shape": [ + 149, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "68fbf1e2b79639496c1d6d516553e3ca711ce5cc5497e3901e8e499109be8bf6", + "mean": -0.019966816529631615, + "std": 6.757659912109375, + "rms": 6.757689952850342, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d18902eda5def11b885f6bbb79a562bd45b2b59026202e361da7f8a6303015ed", + "mean": -0.010620064102113247, + "std": 0.4917356073856354, + "rms": 0.49185025691986084, + "max_abs": 17.375 + }, + "full_input": { + "shape": [ + 133, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0946781a10b223010f2cf55d0edda974ed5a5efc37b52ee219b35cf00e9f085d", + "mean": -0.011386429890990257, + "std": 6.117771148681641, + "rms": 6.1177825927734375, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "af753bbc09218d19687e27740dd43e7c0e218d3e1e31619f4d51239b99790ca6", + "mean": -0.010636254213750362, + "std": 0.4905869960784912, + "rms": 0.4907023012638092, + "max_abs": 17.25 + }, + "full_input": { + "shape": [ + 149, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9baebf76b21d35279e8a7382ef3264df7413cf694eba7b29e876e60045927437", + "mean": -0.011440934613347054, + "std": 5.774714946746826, + "rms": 5.774726390838623, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "071cbb120346f28eb306f058ae690edc74a04fef4c5c539d36414bba1ca107a6", + "mean": -0.0106086740270257, + "std": 0.4924341142177582, + "rms": 0.4925483763217926, + "max_abs": 17.75 + }, + "full_input": { + "shape": [ + 133, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "85e1cb2842cdc0536ce1644c86d2be30ebc86b88ba6e547da1f478e27b3b8a8a", + "mean": -0.011245295405387878, + "std": 6.117828845977783, + "rms": 6.117839336395264, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4493609a92fe6440ca393a73332498d303c6d9fd52a21baac8c581d0d8eda349", + "mean": -0.010167235508561134, + "std": 0.48633870482444763, + "rms": 0.48644497990608215, + "max_abs": 17.0 + }, + "full_input": { + "shape": [ + 149, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d1c74d694d60f8b7afd1eb52ba15c2a9f9e06e7cddb690c15b850b63a12cf9b9", + "mean": -0.01104032900184393, + "std": 5.774368762969971, + "rms": 5.774379253387451, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "af7e9e45039f1c5d247a07f82642c2f85296fe091ec6ba962bc8871ce5ce0157", + "mean": -0.010744010098278522, + "std": 0.4916227161884308, + "rms": 0.49174007773399353, + "max_abs": 17.625 + }, + "full_input": { + "shape": [ + 133, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "eeeb5c61e4e1dfee70cf4975bb3e59f43b44b7ec9f84454d21de7e05aaafa6a9", + "mean": -0.011242358013987541, + "std": 6.117742538452148, + "rms": 6.117753028869629, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1e357f54431e5ec874de863ca884ee11ec97031b99c0409705600ac8df558d28", + "mean": -0.010264389216899872, + "std": 0.4869558811187744, + "rms": 0.48706403374671936, + "max_abs": 17.25 + }, + "full_input": { + "shape": [ + 149, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "03f70153173bd9804026eaf31ad4b89c935a0f86eb99ade3632ad4ab5a9ef678", + "mean": -0.011005489155650139, + "std": 5.774387836456299, + "rms": 5.7743988037109375, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9953422546386719, + "min_cosine_similarity": 0.9587591886520386, + "mean_relative_l2": 0.0883696898818016, + "max_abs_delta": 1.8125 + }, + "system_bos": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9936301708221436, + "min_cosine_similarity": 0.9550106525421143, + "mean_relative_l2": 0.10590539872646332, + "max_abs_delta": 1.375 + }, + "system_x": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9874746799468994, + "min_cosine_similarity": 0.8423388600349426, + "mean_relative_l2": 0.14133697748184204, + "max_abs_delta": 1.8125 + }, + "system_period": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9892678260803223, + "min_cosine_similarity": 0.891334056854248, + "mean_relative_l2": 0.13422292470932007, + "max_abs_delta": 2.875 + }, + "bos_at_s0": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9912915229797363, + "min_cosine_similarity": 0.8420587778091431, + "mean_relative_l2": 0.11581689864397049, + "max_abs_delta": 1.8125 + }, + "bos_at_s1": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9882239103317261, + "min_cosine_similarity": 0.8360347747802734, + "mean_relative_l2": 0.13801681995391846, + "max_abs_delta": 1.78125 + }, + "x_at_s0": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9889720678329468, + "min_cosine_similarity": 0.8004541993141174, + "mean_relative_l2": 0.13122212886810303, + "max_abs_delta": 2.40625 + }, + "x_at_s1": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9824268221855164, + "min_cosine_similarity": 0.7035845518112183, + "mean_relative_l2": 0.16680538654327393, + "max_abs_delta": 3.9375 + }, + "period_at_s0": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.988977313041687, + "min_cosine_similarity": 0.80535489320755, + "mean_relative_l2": 0.13117973506450653, + "max_abs_delta": 2.46875 + }, + "period_at_s1": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9830271601676941, + "min_cosine_similarity": 0.7553389668464661, + "mean_relative_l2": 0.1660485863685608, + "max_abs_delta": 5.09375 + } + } + }, + "layer_12": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cdddf15b66d033c4ca530c95a01ffc10d2d50bd2c9a838a98d6b00d1449b1166", + "mean": -0.007516040932387114, + "std": 0.5297848582267761, + "rms": 0.5298381447792053, + "max_abs": 17.0 + }, + "full_input": { + "shape": [ + 133, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ef848d7cefc1ba18464be39d840f905aaf47cb256044b5e223990221451fd42f", + "mean": -0.017724785953760147, + "std": 6.9898529052734375, + "rms": 6.989874839782715, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a3f0eed206720c894bd28df16a7cb18671b9b704ae51758aec17586d47d15321", + "mean": -0.007324380800127983, + "std": 0.5285590887069702, + "rms": 0.5286098122596741, + "max_abs": 16.75 + }, + "full_input": { + "shape": [ + 149, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7c1bbc9e21e8c8bfe539ed2e6b0764389a51914f0b731a4bb2626852b89c85a1", + "mean": -0.01798604242503643, + "std": 6.808385372161865, + "rms": 6.808409214019775, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "225c75b4c9c74b98cb4a40a0dfa9deb97f3a67a95d50eb0dc722f5b0c23ca799", + "mean": -0.00769668398424983, + "std": 0.5332050919532776, + "rms": 0.5332606434822083, + "max_abs": 16.75 + }, + "full_input": { + "shape": [ + 133, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a29f163e5af69501fbf12dab01f8b8de063ba0d4f32e731dc4eaf368b1084812", + "mean": -0.009170892648398876, + "std": 6.130582809448242, + "rms": 6.130589485168457, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "50fa3e68bae7ad9c119b134ed236a458c6b5efb05e2339d2aa85a19616b39a50", + "mean": -0.00770619697868824, + "std": 0.5336197018623352, + "rms": 0.5336753726005554, + "max_abs": 16.75 + }, + "full_input": { + "shape": [ + 149, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2882536adcfb6c842e7d0db73ce00c110c59939dfa95944c001cb09cd360be89", + "mean": -0.00934393797069788, + "std": 5.787596702575684, + "rms": 5.787603855133057, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "93e00fe5a32cb2ea3dbe716f94265ebda93ee5663c4a9edd80a82f67619c520d", + "mean": -0.007844206877052784, + "std": 0.5323508977890015, + "rms": 0.5324086546897888, + "max_abs": 16.5 + }, + "full_input": { + "shape": [ + 133, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e8db200ebc69dcbeb1f206b039baa4a72a6f6c3f92d19d98046727fa46bc9c3e", + "mean": -0.009371845982968807, + "std": 6.130552768707275, + "rms": 6.130559921264648, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "80deed07a5098167ba84864d0306eee91b209e33853dc44d1010ea4a726a1f4a", + "mean": -0.007285343948751688, + "std": 0.5293805599212646, + "rms": 0.5294306874275208, + "max_abs": 16.25 + }, + "full_input": { + "shape": [ + 149, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a24ad0c6f55eefcf5bcb1ec65aae60be327359af16cb0cf036a1e621241f488d", + "mean": -0.009060668759047985, + "std": 5.787164688110352, + "rms": 5.787171840667725, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "eb204b225dd6e1f5d7286c1c6d509bf777d386068ae4b551f8c3cb3eb9423384", + "mean": -0.007957431487739086, + "std": 0.5320019125938416, + "rms": 0.5320613980293274, + "max_abs": 16.625 + }, + "full_input": { + "shape": [ + 133, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "668c9b2404b1447acd54f984b644cc5809f2bef8147412277a6f58f66a3cddbf", + "mean": -0.009228477254509926, + "std": 6.130486965179443, + "rms": 6.130494117736816, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b73fefb3467e6b08c2ac215f7c098d30748ae3f94f401f1426e65b1f0a97f2bf", + "mean": -0.0073241801001131535, + "std": 0.5295266509056091, + "rms": 0.5295773148536682, + "max_abs": 16.375 + }, + "full_input": { + "shape": [ + 149, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1b8df85c7b6a7547142eab307486b19ef6affb16c4fdd629586aeefab19548d5", + "mean": -0.008906935341656208, + "std": 5.787179470062256, + "rms": 5.787186145782471, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9943382740020752, + "min_cosine_similarity": 0.9413161277770996, + "mean_relative_l2": 0.09618467837572098, + "max_abs_delta": 1.125 + }, + "system_bos": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9928015470504761, + "min_cosine_similarity": 0.9488094449043274, + "mean_relative_l2": 0.11353754997253418, + "max_abs_delta": 1.375 + }, + "system_x": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9862529635429382, + "min_cosine_similarity": 0.8551744222640991, + "mean_relative_l2": 0.15091225504875183, + "max_abs_delta": 2.0 + }, + "system_period": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9881330132484436, + "min_cosine_similarity": 0.8867369294166565, + "mean_relative_l2": 0.14287641644477844, + "max_abs_delta": 1.53125 + }, + "bos_at_s0": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9901924133300781, + "min_cosine_similarity": 0.8315284252166748, + "mean_relative_l2": 0.123775914311409, + "max_abs_delta": 3.0 + }, + "bos_at_s1": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9865028858184814, + "min_cosine_similarity": 0.8181314468383789, + "mean_relative_l2": 0.14818769693374634, + "max_abs_delta": 2.59375 + }, + "x_at_s0": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.987675130367279, + "min_cosine_similarity": 0.8022748231887817, + "mean_relative_l2": 0.1402961015701294, + "max_abs_delta": 3.5625 + }, + "x_at_s1": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.980944812297821, + "min_cosine_similarity": 0.7242011427879333, + "mean_relative_l2": 0.17680181562900543, + "max_abs_delta": 2.65625 + }, + "period_at_s0": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9876285195350647, + "min_cosine_similarity": 0.8030905723571777, + "mean_relative_l2": 0.1400047242641449, + "max_abs_delta": 4.03125 + }, + "period_at_s1": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9814040660858154, + "min_cosine_similarity": 0.7646390199661255, + "mean_relative_l2": 0.1760394275188446, + "max_abs_delta": 5.25 + } + } + }, + "layer_13": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4d545b12389a6d100eae66477d6ead310d0124ee0559c20bf90a48301fc84129", + "mean": -0.007759236264973879, + "std": 0.5506693720817566, + "rms": 0.5507240295410156, + "max_abs": 17.0 + }, + "full_input": { + "shape": [ + 133, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "03b92c599e58b24141412eebdc698f3a1a8a963989be9131150c2c8a2d479b8f", + "mean": -0.017811689525842667, + "std": 6.996166229248047, + "rms": 6.996189117431641, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fefbf2224b6f1f875ceb45e86481ecba78b53d9f5681f36f69e4736bbe8936da", + "mean": -0.0075187538750469685, + "std": 0.5494898557662964, + "rms": 0.5495412945747375, + "max_abs": 17.0 + }, + "full_input": { + "shape": [ + 149, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4d370be9cfa49eca4082caa0f06bc907a1869e08286f60c3bd0c12dd7b5eca11", + "mean": -0.018517646938562393, + "std": 6.814981460571289, + "rms": 6.815007209777832, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4183157c087e86b87b9e33b8d20ef41a76f1bb7caf709413f9c430efe92f7089", + "mean": -0.00804785918444395, + "std": 0.5529928803443909, + "rms": 0.5530514121055603, + "max_abs": 16.75 + }, + "full_input": { + "shape": [ + 133, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "eb6dee746df2a6d75c0879a6f0634eeeae9c3562b1c6e6f04b35f3bd2d92f922", + "mean": -0.00935710221529007, + "std": 6.136279582977295, + "rms": 6.136286735534668, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cf2a8e7f2d1077d27777299441643f84ba9667d1431297a220bd60658375db75", + "mean": -0.00796696450561285, + "std": 0.5539402365684509, + "rms": 0.5539975166320801, + "max_abs": 17.0 + }, + "full_input": { + "shape": [ + 149, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ff067de23b46a7271bcc14a628843317f72809cc3997ac31a40153fc031606ad", + "mean": -0.009861603379249573, + "std": 5.793717384338379, + "rms": 5.793725490570068, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5f6d3a819fae7b9d04a9d095ed2f1fe532ca96873e79ee7e76c7bb80179d7d92", + "mean": -0.008190406486392021, + "std": 0.5529066920280457, + "rms": 0.552967369556427, + "max_abs": 16.75 + }, + "full_input": { + "shape": [ + 133, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "81b52a146c7f03e08047eb94fa9dc5af659fd0685838a77463a5331568dd2517", + "mean": -0.009605666622519493, + "std": 6.13636589050293, + "rms": 6.136373043060303, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b14cf9cb316af5f9be60e977bd7d122539515b05d9eae8761127c3db26fad90d", + "mean": -0.007212174125015736, + "std": 0.5507005453109741, + "rms": 0.550747811794281, + "max_abs": 16.5 + }, + "full_input": { + "shape": [ + 149, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "dbb691baef11db83d4eb30c8f89a95e644d220e58959197cfd2328dce844526a", + "mean": -0.0093896659091115, + "std": 5.7934112548828125, + "rms": 5.7934184074401855, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "54c21831416ad1f6df7dd66dff857c8d855318651487897ebb5820242826f8a7", + "mean": -0.00813550129532814, + "std": 0.5518132448196411, + "rms": 0.5518732666969299, + "max_abs": 16.75 + }, + "full_input": { + "shape": [ + 133, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bfcb29b63267c461e4124c6c26f44c1486343710f73e438770de73e1f4dd2d59", + "mean": -0.009315017610788345, + "std": 6.136222839355469, + "rms": 6.136229991912842, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "63bfd494293d725d02c1157c6b1fd963c717842a2738a50f866dcb9e40819b65", + "mean": -0.007383532356470823, + "std": 0.5506424307823181, + "rms": 0.5506919622421265, + "max_abs": 16.625 + }, + "full_input": { + "shape": [ + 149, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "751a580c0ad270aa58cde4937057641ff476d6d4ac7aa4303037326af14017d5", + "mean": -0.009324243292212486, + "std": 5.793396949768066, + "rms": 5.793404579162598, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9940717220306396, + "min_cosine_similarity": 0.9360440373420715, + "mean_relative_l2": 0.0989857092499733, + "max_abs_delta": 1.5625 + }, + "system_bos": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9926159381866455, + "min_cosine_similarity": 0.9472287893295288, + "mean_relative_l2": 0.11557499319314957, + "max_abs_delta": 1.6875 + }, + "system_x": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9859387278556824, + "min_cosine_similarity": 0.8553375601768494, + "mean_relative_l2": 0.15391311049461365, + "max_abs_delta": 1.859375 + }, + "system_period": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9878711104393005, + "min_cosine_similarity": 0.884388267993927, + "mean_relative_l2": 0.14537857472896576, + "max_abs_delta": 1.203125 + }, + "bos_at_s0": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9899786710739136, + "min_cosine_similarity": 0.8315887451171875, + "mean_relative_l2": 0.1255188286304474, + "max_abs_delta": 3.125 + }, + "bos_at_s1": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9861510396003723, + "min_cosine_similarity": 0.803263247013092, + "mean_relative_l2": 0.14993126690387726, + "max_abs_delta": 3.9375 + }, + "x_at_s0": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9875094294548035, + "min_cosine_similarity": 0.7994771003723145, + "mean_relative_l2": 0.1418529599905014, + "max_abs_delta": 4.375 + }, + "x_at_s1": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9807261824607849, + "min_cosine_similarity": 0.7316586375236511, + "mean_relative_l2": 0.17865830659866333, + "max_abs_delta": 3.0 + }, + "period_at_s0": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9873833060264587, + "min_cosine_similarity": 0.8026708364486694, + "mean_relative_l2": 0.14202196896076202, + "max_abs_delta": 5.09375 + }, + "period_at_s1": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9811710715293884, + "min_cosine_similarity": 0.7713726758956909, + "mean_relative_l2": 0.1779802292585373, + "max_abs_delta": 5.75 + } + } + }, + "layer_14": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4fd63286ff3bde2a1802de895d4ef059774b6843907de8e6ce26f386ae624b77", + "mean": -0.006891749333590269, + "std": 0.637184202671051, + "rms": 0.6372214555740356, + "max_abs": 19.875 + }, + "full_input": { + "shape": [ + 133, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0019c0ddde58d64cb04565b4cf6314ff80aa612014d6449ac1c237b47aafd3d1", + "mean": -0.01671484485268593, + "std": 7.014805316925049, + "rms": 7.014825344085693, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "654fbc28f8e3aad6b38a7e6bd3baf2f118abadb224e1f6ac5e0016bb597891fb", + "mean": -0.006978957913815975, + "std": 0.6348848342895508, + "rms": 0.6349231600761414, + "max_abs": 20.0 + }, + "full_input": { + "shape": [ + 149, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "51110a3139d46cbd5b8fc42705f9535136b5f4c23a1b2b69c048790e7747b2ac", + "mean": -0.01795422099530697, + "std": 6.832544803619385, + "rms": 6.8325676918029785, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8325991522d13d5fdb2fabc045320d4fd4a88051478ddbcfeb8d72dd6485fcb1", + "mean": -0.007393047213554382, + "std": 0.6405999660491943, + "rms": 0.6406425833702087, + "max_abs": 19.75 + }, + "full_input": { + "shape": [ + 133, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d5c9de0aa6e7cff0f6d14ac488f32adf395cad160475f205d3a32275d0eac7b7", + "mean": -0.008442235179245472, + "std": 6.15679931640625, + "rms": 6.156805038452148, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "362f7b9937879220a04828f3965a7f855cd60659fa202aca20ff6a6de4160840", + "mean": -0.0075361584313213825, + "std": 0.6410493850708008, + "rms": 0.6410936117172241, + "max_abs": 20.0 + }, + "full_input": { + "shape": [ + 149, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c725267456e693fcfecaf5f4dcbf231578e5ff5a444203100dc3dedac244277a", + "mean": -0.009304774925112724, + "std": 5.813738822937012, + "rms": 5.813746452331543, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8570ace2c9e7b0a6f5b263131c73880c8a31ae7c6a26328c2cf82ddacda4664a", + "mean": -0.007642325945198536, + "std": 0.6398249864578247, + "rms": 0.6398706436157227, + "max_abs": 19.875 + }, + "full_input": { + "shape": [ + 133, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0f0a18c54cd8e6dfe901fffd808cd1a71917fd6a790ce25b35db2fc750d3b9f1", + "mean": -0.008775086142122746, + "std": 6.156871795654297, + "rms": 6.156877517700195, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8688012a75834ca4d6c0b965c8d1cdc3f03e9af72c58b4fd22244be737666507", + "mean": -0.00703057087957859, + "std": 0.6370465755462646, + "rms": 0.6370853185653687, + "max_abs": 19.5 + }, + "full_input": { + "shape": [ + 149, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c24bf2f19a45597096deceafc83535ee4ca0bf4dcda27a292f927e2961afa11a", + "mean": -0.00905746128410101, + "std": 5.813375473022461, + "rms": 5.813382625579834, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2bb2276e16cace4d97f7bef3f4947ed7fefbcec5bc70965637087ea756ea869e", + "mean": -0.007621054071933031, + "std": 0.6387104392051697, + "rms": 0.6387559175491333, + "max_abs": 19.625 + }, + "full_input": { + "shape": [ + 133, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "512f5b3b76683123a57d5046a5c08d5284c1e06bc765493984a4943d6b5e3b1d", + "mean": -0.008522379212081432, + "std": 6.156692028045654, + "rms": 6.156697750091553, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "772d300854c3672220339f0b434e5c455c2012a163ab6761b282279b2062b238", + "mean": -0.007067665457725525, + "std": 0.637493371963501, + "rms": 0.6375325322151184, + "max_abs": 19.625 + }, + "full_input": { + "shape": [ + 149, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "40b8b57663f62c297b4d90427ec3d48ec5551bdf1e69c714039599474f82af1e", + "mean": -0.00896438304334879, + "std": 5.813363075256348, + "rms": 5.8133697509765625, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9937669038772583, + "min_cosine_similarity": 0.938234269618988, + "mean_relative_l2": 0.10155743360519409, + "max_abs_delta": 1.5625 + }, + "system_bos": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9923810362815857, + "min_cosine_similarity": 0.9460240006446838, + "mean_relative_l2": 0.11778391897678375, + "max_abs_delta": 1.5 + }, + "system_x": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9850685000419617, + "min_cosine_similarity": 0.8478659391403198, + "mean_relative_l2": 0.15960685908794403, + "max_abs_delta": 2.0625 + }, + "system_period": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.987114667892456, + "min_cosine_similarity": 0.8665698170661926, + "mean_relative_l2": 0.1501666009426117, + "max_abs_delta": 1.25 + }, + "bos_at_s0": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9898121356964111, + "min_cosine_similarity": 0.8246140480041504, + "mean_relative_l2": 0.1265852004289627, + "max_abs_delta": 3.0 + }, + "bos_at_s1": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9859344959259033, + "min_cosine_similarity": 0.7996313571929932, + "mean_relative_l2": 0.15146483480930328, + "max_abs_delta": 3.12109375 + }, + "x_at_s0": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9876093864440918, + "min_cosine_similarity": 0.7969657182693481, + "mean_relative_l2": 0.14166171848773956, + "max_abs_delta": 4.0 + }, + "x_at_s1": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9806724786758423, + "min_cosine_similarity": 0.7344067096710205, + "mean_relative_l2": 0.18027591705322266, + "max_abs_delta": 3.25 + }, + "period_at_s0": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9874045252799988, + "min_cosine_similarity": 0.7937554717063904, + "mean_relative_l2": 0.1421077400445938, + "max_abs_delta": 4.875 + }, + "period_at_s1": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9808613061904907, + "min_cosine_similarity": 0.7647131681442261, + "mean_relative_l2": 0.18060007691383362, + "max_abs_delta": 5.6875 + } + } + }, + "layer_15": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9e1631a82595bf72287b3e00d1c0136b1594ffd6004dc90d8c7d0f3b14b55dd7", + "mean": -0.00774735864251852, + "std": 0.7080417275428772, + "rms": 0.7080841064453125, + "max_abs": 24.25 + }, + "full_input": { + "shape": [ + 133, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7698cf2eb1184c62ee973f582fe6ef3391fe32252d9bb7408543edcab0b73ac9", + "mean": -0.01702672615647316, + "std": 7.0244245529174805, + "rms": 7.024445533752441, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "033a99cf4affc8db3ab230f9bd9582efdd7c2f7f9c3c6f1c3251ff8e211a481b", + "mean": -0.008099802769720554, + "std": 0.7053362727165222, + "rms": 0.705382764339447, + "max_abs": 24.25 + }, + "full_input": { + "shape": [ + 149, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b60a0cb69b7b9e60e82c80d44a95b2009ec94672a3abf3da43033739d14847a0", + "mean": -0.018664047122001648, + "std": 6.842552661895752, + "rms": 6.842578411102295, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1cfd7dbe9c228090d0c78342766258afd1c2e057d4c3fc3d980587168e148547", + "mean": -0.008154348470270634, + "std": 0.7121220231056213, + "rms": 0.7121686935424805, + "max_abs": 24.25 + }, + "full_input": { + "shape": [ + 133, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3faa3e70d632383d88c4a0338dcd3437e12f34e2343df5c53595bae9e19215a5", + "mean": -0.008794217370450497, + "std": 6.1672587394714355, + "rms": 6.16726541519165, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "da65eb76b8bfa8fa7de14152babd9c98bd3c804d81fe3f89043f7c5e7f5723bf", + "mean": -0.008400382474064827, + "std": 0.7115901708602905, + "rms": 0.7116397023200989, + "max_abs": 24.5 + }, + "full_input": { + "shape": [ + 149, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f164bd5e473506b382737f67be9bd64d00b26faf0184484dfd3f3e30040a1f12", + "mean": -0.009921032004058361, + "std": 5.8247857093811035, + "rms": 5.824794292449951, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e1d06f456b0c1fd731418e55d20fed7cc047a458ba3d526897d643a6c6f62ec1", + "mean": -0.008822769857943058, + "std": 0.7123615145683289, + "rms": 0.7124161720275879, + "max_abs": 24.125 + }, + "full_input": { + "shape": [ + 133, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e755610b13439086579f89e907ef31a28a3dfd2bf8adf1fb5f17cf72e4d2e8ad", + "mean": -0.00946534238755703, + "std": 6.167413234710693, + "rms": 6.167420864105225, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5640a9411534b3a8e7755f1febac78875aa536cab1dec1b4c7cefb14cc965ac8", + "mean": -0.008728038519620895, + "std": 0.7089037299156189, + "rms": 0.7089574933052063, + "max_abs": 23.625 + }, + "full_input": { + "shape": [ + 149, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "906c6896907813632a45f05385ef7d6813e1100f3525a218ea3481e09b1214b9", + "mean": -0.010310268960893154, + "std": 5.8244781494140625, + "rms": 5.824487209320068, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c8883501d9a07b73f4dd2c2e3ed3f9a4f177e80c751c8f298d1ccf864cbec9a3", + "mean": -0.008832857944071293, + "std": 0.7112341523170471, + "rms": 0.7112889885902405, + "max_abs": 23.875 + }, + "full_input": { + "shape": [ + 133, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e558f2af336ab780254816e395290d813d0c70b212de76ea34e60f80c1a40cae", + "mean": -0.009224153123795986, + "std": 6.1672282218933105, + "rms": 6.167235374450684, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "dee48d61b23c01a4c1f08bc20c853412c569381c41900b2f5a36721884e9d33a", + "mean": -0.008701165206730366, + "std": 0.7102769613265991, + "rms": 0.7103303074836731, + "max_abs": 23.875 + }, + "full_input": { + "shape": [ + 149, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d14d8acd3790d134ffc6ef38232d624c52b7fcdffe27410a83e8698f1edabd10", + "mean": -0.010117325000464916, + "std": 5.824574947357178, + "rms": 5.824584007263184, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9937030673027039, + "min_cosine_similarity": 0.9378300905227661, + "mean_relative_l2": 0.10305389016866684, + "max_abs_delta": 1.5625 + }, + "system_bos": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9924101829528809, + "min_cosine_similarity": 0.947689414024353, + "mean_relative_l2": 0.11804774403572083, + "max_abs_delta": 1.328125 + }, + "system_x": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9844672679901123, + "min_cosine_similarity": 0.8280823230743408, + "mean_relative_l2": 0.1635698676109314, + "max_abs_delta": 2.625 + }, + "system_period": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9863010048866272, + "min_cosine_similarity": 0.8558962941169739, + "mean_relative_l2": 0.1549793928861618, + "max_abs_delta": 1.875 + }, + "bos_at_s0": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9899132251739502, + "min_cosine_similarity": 0.8135281205177307, + "mean_relative_l2": 0.1260402351617813, + "max_abs_delta": 3.1875 + }, + "bos_at_s1": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9861380457878113, + "min_cosine_similarity": 0.8006267547607422, + "mean_relative_l2": 0.1503439098596573, + "max_abs_delta": 3.7578125 + }, + "x_at_s0": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9877600073814392, + "min_cosine_similarity": 0.7990289330482483, + "mean_relative_l2": 0.14182263612747192, + "max_abs_delta": 4.125 + }, + "x_at_s1": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9807158708572388, + "min_cosine_similarity": 0.7285576462745667, + "mean_relative_l2": 0.181369811296463, + "max_abs_delta": 4.1875 + }, + "period_at_s0": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9873393774032593, + "min_cosine_similarity": 0.7916901111602783, + "mean_relative_l2": 0.14227606356143951, + "max_abs_delta": 4.375 + }, + "period_at_s1": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9807356595993042, + "min_cosine_similarity": 0.7504458427429199, + "mean_relative_l2": 0.18197816610336304, + "max_abs_delta": 6.25 + } + } + }, + "layer_16": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "df7825ef929e86a8821ff6a1a848b86e8b80e68c31afa4ccd50c26ac4fadcd7a", + "mean": -0.007910020649433136, + "std": 0.7930136322975159, + "rms": 0.7930530905723572, + "max_abs": 27.5 + }, + "full_input": { + "shape": [ + 133, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ccf440aba68857342a95f989218f73a8746d5c2dbfed94deff18e3eb6989b35d", + "mean": -0.017067451030015945, + "std": 7.036278247833252, + "rms": 7.036298751831055, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "dba0e350a5a9fef4c555264576fbdee7c4d04dfda4599666824d9bf241891eb8", + "mean": -0.008161738514900208, + "std": 0.7907406687736511, + "rms": 0.7907827496528625, + "max_abs": 27.625 + }, + "full_input": { + "shape": [ + 149, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cc4b5eab65d3d10703189c5c981aa35ff48b03c80e6abfad804385f7b0f46c31", + "mean": -0.01839440129697323, + "std": 6.854374408721924, + "rms": 6.854399681091309, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cb7b9d24ed347662e85438f968823d7bd5b56ae7e2c349ddc474b5479e9b5ac1", + "mean": -0.0084760133177042, + "std": 0.7944971919059753, + "rms": 0.7945424318313599, + "max_abs": 27.25 + }, + "full_input": { + "shape": [ + 133, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "83c6e1029117ce8e31c1ca20367c5f0f319231d57ea6058fe4ba90939338a1db", + "mean": -0.00898740254342556, + "std": 6.179587364196777, + "rms": 6.179593563079834, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2cb0365f0d1f5f846cf806bb5b862794aa9a6d5d0231407560937f0d7eca475d", + "mean": -0.008443019352853298, + "std": 0.7952490448951721, + "rms": 0.7952938675880432, + "max_abs": 27.75 + }, + "full_input": { + "shape": [ + 149, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "498f04580c68a9dfbd2f5835d0780c27e0068ebe696d1a4d498e5c23c76d621a", + "mean": -0.009571398608386517, + "std": 5.837817668914795, + "rms": 5.837825775146484, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a3a9bd5b5ded13dae0c4b06185103def621218c2f8935d818511a48abf359370", + "mean": -0.008928977884352207, + "std": 0.7961779236793518, + "rms": 0.7962279915809631, + "max_abs": 27.25 + }, + "full_input": { + "shape": [ + 133, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "420e82ced49eb9d1bf12c3e22a6ff32529bfcb7692666af7a879ec54a4f1524e", + "mean": -0.009519883431494236, + "std": 6.1800689697265625, + "rms": 6.180075645446777, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6755f64627ad5f3e77a058b2527067521f8532fd6ec9bdc043ddb4f053ea1389", + "mean": -0.008756495080888271, + "std": 0.7928688526153564, + "rms": 0.7929171919822693, + "max_abs": 26.875 + }, + "full_input": { + "shape": [ + 149, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6a7f7ea521c9a6de600d461fdf64a0969897592c1e32ec9f821d2abee6b11c1c", + "mean": -0.009995835833251476, + "std": 5.83767032623291, + "rms": 5.837679386138916, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "02b41c925d54a553192a36207dca25730a3b1b1184cd9916c70e5b13fc20de71", + "mean": -0.008931686170399189, + "std": 0.7942916750907898, + "rms": 0.7943419218063354, + "max_abs": 27.0 + }, + "full_input": { + "shape": [ + 133, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "722a5c9fc78c687aeb39a08a46d55ccf141bd21d906660be89ad6f33169813b0", + "mean": -0.009221692569553852, + "std": 6.17965030670166, + "rms": 6.179657459259033, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5338d32eca3829d947acecdd7dbdc26eacace4a57762fed52572d1e2e4dea780", + "mean": -0.00879028532654047, + "std": 0.7934703826904297, + "rms": 0.7935190796852112, + "max_abs": 27.375 + }, + "full_input": { + "shape": [ + 149, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2d9bdcffea6ea1bb0b64d77fb31775fa69fb6c2a44eec035286d75251d8885f5", + "mean": -0.00980381015688181, + "std": 5.837606430053711, + "rms": 5.8376145362854, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9934556484222412, + "min_cosine_similarity": 0.9374569654464722, + "mean_relative_l2": 0.10559213906526566, + "max_abs_delta": 2.125 + }, + "system_bos": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9920758605003357, + "min_cosine_similarity": 0.9460741877555847, + "mean_relative_l2": 0.12102397531270981, + "max_abs_delta": 1.3984375 + }, + "system_x": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9839195013046265, + "min_cosine_similarity": 0.819855272769928, + "mean_relative_l2": 0.16648665070533752, + "max_abs_delta": 2.5 + }, + "system_period": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.985863208770752, + "min_cosine_similarity": 0.8533304929733276, + "mean_relative_l2": 0.15719568729400635, + "max_abs_delta": 2.0 + }, + "bos_at_s0": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9896995425224304, + "min_cosine_similarity": 0.8115066289901733, + "mean_relative_l2": 0.12717531621456146, + "max_abs_delta": 2.9375 + }, + "bos_at_s1": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9856801629066467, + "min_cosine_similarity": 0.7993278503417969, + "mean_relative_l2": 0.1528143286705017, + "max_abs_delta": 4.234375 + }, + "x_at_s0": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9874763488769531, + "min_cosine_similarity": 0.7976986169815063, + "mean_relative_l2": 0.14329782128334045, + "max_abs_delta": 3.9375 + }, + "x_at_s1": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9804790616035461, + "min_cosine_similarity": 0.7268400192260742, + "mean_relative_l2": 0.18287140130996704, + "max_abs_delta": 4.4375 + }, + "period_at_s0": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9870308637619019, + "min_cosine_similarity": 0.7879745960235596, + "mean_relative_l2": 0.14360401034355164, + "max_abs_delta": 4.3125 + }, + "period_at_s1": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9805980920791626, + "min_cosine_similarity": 0.7532857656478882, + "mean_relative_l2": 0.18254365026950836, + "max_abs_delta": 5.9375 + } + } + }, + "layer_17": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6f65fa9a0f69f87d0fe71217474be6c138699271a17339ae3286b5f5c1e90297", + "mean": -0.010219123214483261, + "std": 0.8910019397735596, + "rms": 0.8910605907440186, + "max_abs": 31.5 + }, + "full_input": { + "shape": [ + 133, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "78072d6ca7418063e4fc1b13f07a60bd0c113d9f6df2389413c265f913faff1e", + "mean": -0.01928018406033516, + "std": 7.050634384155273, + "rms": 7.050660610198975, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "749a7afe3c5d2a8f32483ba6e7298c586c22a9407ee3fd390624f551824d48d4", + "mean": -0.010355156846344471, + "std": 0.8876256942749023, + "rms": 0.8876861333847046, + "max_abs": 30.5 + }, + "full_input": { + "shape": [ + 149, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ad7ef66316fb886e5fcebd838348b365366cce8b9da51b1fca86aadf4dfc8f9b", + "mean": -0.020779281854629517, + "std": 6.869293212890625, + "rms": 6.869324207305908, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5e0a9785794cf699d443752e460554f3670c6263cd4ad15bf7a4555d80565ecb", + "mean": -0.010786773636937141, + "std": 0.8923342227935791, + "rms": 0.8923994302749634, + "max_abs": 31.625 + }, + "full_input": { + "shape": [ + 133, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d3757e8a6815fdd9b217d0065f6d42160a9e16ea30ffec025abccd535ab117dc", + "mean": -0.011150374077260494, + "std": 6.195375442504883, + "rms": 6.195384979248047, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a1c2fa79b2079c03c6a1ccb7feb22f4eef5d6c9448924a2f049107400a593ca5", + "mean": -0.01055249385535717, + "std": 0.8920672535896301, + "rms": 0.89212965965271, + "max_abs": 30.5 + }, + "full_input": { + "shape": [ + 149, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "17382bac18d02c71adc81da859349ef04b2764437b63e7404d6a7e27bda5ee27", + "mean": -0.011915368027985096, + "std": 5.854851245880127, + "rms": 5.85486364364624, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "45d307011a7dc695a8973757d806b0b31fde56e876711a303cb6d8ae278a4658", + "mean": -0.011232412420213223, + "std": 0.8940700888633728, + "rms": 0.8941406011581421, + "max_abs": 31.5 + }, + "full_input": { + "shape": [ + 133, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1b2dce5c97947077146800258687d8ad891999e07955ce3efa206168bb67259f", + "mean": -0.011776537634432316, + "std": 6.195956230163574, + "rms": 6.195967197418213, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1c65babc479aea0629d4a3543e58d267301b8b905b09d0d8365e2133caab104a", + "mean": -0.010814807377755642, + "std": 0.8897328972816467, + "rms": 0.8897985816001892, + "max_abs": 30.5 + }, + "full_input": { + "shape": [ + 149, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "43d3a3b79151d5b3778d7e76135a9a48a0df67520d2f9194b79c97a12db55770", + "mean": -0.012378362938761711, + "std": 5.854767322540283, + "rms": 5.854780197143555, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f1ebd10bc1e74f5f88c604f094753a6871752e9876217365e9f4c9171179e2c6", + "mean": -0.011018846184015274, + "std": 0.8927086591720581, + "rms": 0.8927766680717468, + "max_abs": 31.5 + }, + "full_input": { + "shape": [ + 133, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "79f61af63b6918a946b24153a3d08c7ef59385c7276cd236938bda963ded39e1", + "mean": -0.011225942522287369, + "std": 6.195549011230469, + "rms": 6.195559501647949, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9379cbe46229a3dbe64afb6444cddd112147d5697d25cad4886b61490a5e2ef8", + "mean": -0.010760326869785786, + "std": 0.8901960253715515, + "rms": 0.8902609944343567, + "max_abs": 30.5 + }, + "full_input": { + "shape": [ + 149, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2091491d5363e224cd2cf5617c232736183d6a9cf6680719928a73600f488f84", + "mean": -0.012089992873370647, + "std": 5.8547163009643555, + "rms": 5.854728698730469, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9940213561058044, + "min_cosine_similarity": 0.9417691230773926, + "mean_relative_l2": 0.1011422798037529, + "max_abs_delta": 1.25 + }, + "system_bos": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9925419688224792, + "min_cosine_similarity": 0.9518071413040161, + "mean_relative_l2": 0.11743544787168503, + "max_abs_delta": 1.5234375 + }, + "system_x": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9849755167961121, + "min_cosine_similarity": 0.8251619338989258, + "mean_relative_l2": 0.16107898950576782, + "max_abs_delta": 2.71875 + }, + "system_period": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9868801236152649, + "min_cosine_similarity": 0.8594163656234741, + "mean_relative_l2": 0.15104416012763977, + "max_abs_delta": 2.375 + }, + "bos_at_s0": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9902417063713074, + "min_cosine_similarity": 0.8132799863815308, + "mean_relative_l2": 0.12315189093351364, + "max_abs_delta": 3.875 + }, + "bos_at_s1": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9865513443946838, + "min_cosine_similarity": 0.8115027546882629, + "mean_relative_l2": 0.1476193219423294, + "max_abs_delta": 4.703125 + }, + "x_at_s0": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9884064793586731, + "min_cosine_similarity": 0.8163037300109863, + "mean_relative_l2": 0.13846933841705322, + "max_abs_delta": 3.3125 + }, + "x_at_s1": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9820034503936768, + "min_cosine_similarity": 0.7576353549957275, + "mean_relative_l2": 0.17640523612499237, + "max_abs_delta": 5.75 + }, + "period_at_s0": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9878087639808655, + "min_cosine_similarity": 0.8026708364486694, + "mean_relative_l2": 0.13964276015758514, + "max_abs_delta": 3.75 + }, + "period_at_s1": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9821513295173645, + "min_cosine_similarity": 0.7830284237861633, + "mean_relative_l2": 0.17553287744522095, + "max_abs_delta": 3.9375 + } + } + }, + "layer_18": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "03c675a9106077fce21912f5928fc4e327b5eef0451e43d26ce5108e52748de8", + "mean": -0.011291827075183392, + "std": 0.9984515905380249, + "rms": 0.9985154867172241, + "max_abs": 35.75 + }, + "full_input": { + "shape": [ + 133, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "719c7c42245dd593f504fa003858769e2485211eb28d3d051461194f6bf0659c", + "mean": -0.020102545619010925, + "std": 7.070077896118164, + "rms": 7.070106029510498, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0d6e30cd2866c32dfd3a61cda4e1afa095a69a53ae28f014c6af4ecb8dc7f091", + "mean": -0.011294401250779629, + "std": 0.9924473762512207, + "rms": 0.9925116300582886, + "max_abs": 36.0 + }, + "full_input": { + "shape": [ + 149, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "db0acbcfa9c6634aa30affc4bc3d3c3a838dc9a070ed76daf57df918104ccec7", + "mean": -0.02132943458855152, + "std": 6.889091968536377, + "rms": 6.889124870300293, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "963d026a544dabf23e9f512d2fb720a7b4d294f835497a2b8054c4f6dba4cd98", + "mean": -0.012094826437532902, + "std": 0.9993481040000916, + "rms": 0.9994212985038757, + "max_abs": 35.0 + }, + "full_input": { + "shape": [ + 133, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c13d08f290312c288375e8c341c44e55555dc5d6bd752be050ac287fd29fb07a", + "mean": -0.012079864740371704, + "std": 6.215048789978027, + "rms": 6.215060234069824, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7961ae6653d9be0b54dbd2252dd34d077ab3e4792b9293de99a8a5904f4a6f01", + "mean": -0.011692667379975319, + "std": 0.9973689317703247, + "rms": 0.9974374771118164, + "max_abs": 35.5 + }, + "full_input": { + "shape": [ + 149, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "58afd38c2dacd603c9d69937b3b57cd01c9c51fecbd43f46a3e162124eb29423", + "mean": -0.012517997995018959, + "std": 5.875813007354736, + "rms": 5.875826358795166, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0582085755955f9563e0e815aa543dc0119d8939df7f034d16aad7fd98c73cad", + "mean": -0.01241189707070589, + "std": 1.0018306970596313, + "rms": 1.001907467842102, + "max_abs": 35.5 + }, + "full_input": { + "shape": [ + 133, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "540e5aebf81e05209f44365e8401cce2d1add5cd5cb32c84ba26cb3c30744016", + "mean": -0.012700413353741169, + "std": 6.215891361236572, + "rms": 6.2159037590026855, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "146b95bba3d00c8f36a7c17a8a64c014e0af07b0a7eb72b806ce302878da1fe4", + "mean": -0.011862623505294323, + "std": 0.9942684769630432, + "rms": 0.9943392276763916, + "max_abs": 34.5 + }, + "full_input": { + "shape": [ + 149, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cae10739beda09f9f8843c1aa27d42c368774d7236146db60ca53eaebcf6807c", + "mean": -0.012941204011440277, + "std": 5.875811576843262, + "rms": 5.875825881958008, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0ce62d2f212a6c0c82f2a4360fd9f4c52388414bad70d7af9b1eb4f4c7ea5452", + "mean": -0.012347398325800896, + "std": 1.0001369714736938, + "rms": 1.0002132654190063, + "max_abs": 35.5 + }, + "full_input": { + "shape": [ + 133, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8cb01c827e9798bc2513355cf4fa7db34096b5937319b74a4a6c5d786f819a07", + "mean": -0.012246686965227127, + "std": 6.215402126312256, + "rms": 6.215414047241211, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "82b393070661c50d5aadc9df016b071c413bad6a1dbb8d551cc07ffbe2c68428", + "mean": -0.011973121203482151, + "std": 0.994640052318573, + "rms": 0.9947120547294617, + "max_abs": 35.0 + }, + "full_input": { + "shape": [ + 149, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "be09fdd84e4c9ff1a736f1fbef67b174dbf8b3b5e2ebb24e783ab54208868df4", + "mean": -0.012814048677682877, + "std": 5.875622272491455, + "rms": 5.875636100769043, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9939612150192261, + "min_cosine_similarity": 0.9376024007797241, + "mean_relative_l2": 0.10153843462467194, + "max_abs_delta": 2.0 + }, + "system_bos": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9926872253417969, + "min_cosine_similarity": 0.9548196792602539, + "mean_relative_l2": 0.11638259887695312, + "max_abs_delta": 1.7578125 + }, + "system_x": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9848458170890808, + "min_cosine_similarity": 0.8107470273971558, + "mean_relative_l2": 0.16168557107448578, + "max_abs_delta": 3.34375 + }, + "system_period": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9863393306732178, + "min_cosine_similarity": 0.841382622718811, + "mean_relative_l2": 0.15322664380073547, + "max_abs_delta": 2.3359375 + }, + "bos_at_s0": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9901107549667358, + "min_cosine_similarity": 0.8013347387313843, + "mean_relative_l2": 0.1225133016705513, + "max_abs_delta": 4.0546875 + }, + "bos_at_s1": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9864568114280701, + "min_cosine_similarity": 0.7888829708099365, + "mean_relative_l2": 0.14704501628875732, + "max_abs_delta": 6.28125 + }, + "x_at_s0": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.988470196723938, + "min_cosine_similarity": 0.8052756786346436, + "mean_relative_l2": 0.13737529516220093, + "max_abs_delta": 5.375 + }, + "x_at_s1": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9816550612449646, + "min_cosine_similarity": 0.7490057945251465, + "mean_relative_l2": 0.1772604137659073, + "max_abs_delta": 7.625 + }, + "period_at_s0": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9876143932342529, + "min_cosine_similarity": 0.7864859700202942, + "mean_relative_l2": 0.13917580246925354, + "max_abs_delta": 3.625 + }, + "period_at_s1": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9815617799758911, + "min_cosine_similarity": 0.7691451907157898, + "mean_relative_l2": 0.17717617750167847, + "max_abs_delta": 4.0625 + } + } + }, + "layer_19": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8cf3caee67c30e6c1025793874392c01174488a97ee12359d8baba9c1fe10207", + "mean": -0.011211649514734745, + "std": 1.097960352897644, + "rms": 1.0980175733566284, + "max_abs": 31.0 + }, + "full_input": { + "shape": [ + 133, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7f026807f2401feddd84fb0a429ba0fe68f9860afb7044ed540333b8da935211", + "mean": -0.019654138013720512, + "std": 7.082335948944092, + "rms": 7.082363128662109, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c4ef4d0f2d9a5a32c106b8ad1f47431d809d29fad9101de203b1124f5e71615f", + "mean": -0.011023961007595062, + "std": 1.0918141603469849, + "rms": 1.091869831085205, + "max_abs": 31.0 + }, + "full_input": { + "shape": [ + 149, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "74fcf176a1704efe08cba240621e77edacef680b13683af00a2a0399adbed474", + "mean": -0.020443374291062355, + "std": 6.902561664581299, + "rms": 6.902591705322266, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "25aeb91ccd9185995ef788d7e39d80a1b760d33a19043452a10d1853fad8307c", + "mean": -0.012285614386200905, + "std": 1.1005295515060425, + "rms": 1.1005980968475342, + "max_abs": 31.25 + }, + "full_input": { + "shape": [ + 133, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1b7156d1aca744960ac8f8a29182bfa5d75b2f29330613bb8525083e159b8418", + "mean": -0.011984738521277905, + "std": 6.2295637130737305, + "rms": 6.229575157165527, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "04e704c449120aafa10871326b1d5fb3a9dced8ea55e4e0089836bf289018497", + "mean": -0.01164298690855503, + "std": 1.0983434915542603, + "rms": 1.098405122756958, + "max_abs": 31.0 + }, + "full_input": { + "shape": [ + 149, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bf1b8b0f05761ee5ea198020e787912b70e20b61f03e1de0e7a95c0e3406f496", + "mean": -0.011781151406466961, + "std": 5.891786098480225, + "rms": 5.89179801940918, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0bacffc7ba8b950e260681fc114e9c6365da4e8a203c895b3097248b3a9ec313", + "mean": -0.012373089790344238, + "std": 1.1016169786453247, + "rms": 1.1016864776611328, + "max_abs": 31.0 + }, + "full_input": { + "shape": [ + 133, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0c1d8292c97247b6f498a151864578f1697aaaa1321f845525f157f2ae67f409", + "mean": -0.012426130473613739, + "std": 6.230474948883057, + "rms": 6.23048734664917, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9da1fcb145d48a8a70c530a808cb8bf584c4b03d78952dee0ae69c3ce1693362", + "mean": -0.01126378308981657, + "std": 1.0963062047958374, + "rms": 1.096364140510559, + "max_abs": 30.0 + }, + "full_input": { + "shape": [ + 149, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "dd0827c9b2d64ec1531ae2c89cfda50a9c4ff77fddab66250d3ba7aacda42ae9", + "mean": -0.01176657248288393, + "std": 5.891885280609131, + "rms": 5.891897201538086, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b52acc2a8db47d1121e3e3df9db09669d969fd15f7ee4a06185ee3070c8a61d0", + "mean": -0.012347131967544556, + "std": 1.1005215644836426, + "rms": 1.100590705871582, + "max_abs": 30.875 + }, + "full_input": { + "shape": [ + 133, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b28361dbe381d449c41bd44f3cd445579310844f7aabe50ce7144ac95fbc06e5", + "mean": -0.01210307702422142, + "std": 6.229954719543457, + "rms": 6.229966163635254, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "13ecab9f7be55317102c41e33c6d27a0f83f3f2994d982b2e331db640d8c6e27", + "mean": -0.011551420204341412, + "std": 1.0969570875167847, + "rms": 1.0970178842544556, + "max_abs": 30.5 + }, + "full_input": { + "shape": [ + 149, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f37d012aeb5a343192b600ef4bca804607ec285f702261d14b82eb3b54821195", + "mean": -0.011964739300310612, + "std": 5.891836643218994, + "rms": 5.891848564147949, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9939160346984863, + "min_cosine_similarity": 0.9227044582366943, + "mean_relative_l2": 0.10123157501220703, + "max_abs_delta": 3.875 + }, + "system_bos": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9926449060440063, + "min_cosine_similarity": 0.9551963806152344, + "mean_relative_l2": 0.11661089211702347, + "max_abs_delta": 1.85546875 + }, + "system_x": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9841790795326233, + "min_cosine_similarity": 0.7999231815338135, + "mean_relative_l2": 0.16358909010887146, + "max_abs_delta": 3.375 + }, + "system_period": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9865277409553528, + "min_cosine_similarity": 0.8464992046356201, + "mean_relative_l2": 0.15254242718219757, + "max_abs_delta": 3.25 + }, + "bos_at_s0": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9903258085250854, + "min_cosine_similarity": 0.8118122220039368, + "mean_relative_l2": 0.12186487764120102, + "max_abs_delta": 4.171875 + }, + "bos_at_s1": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9862385988235474, + "min_cosine_similarity": 0.7461118698120117, + "mean_relative_l2": 0.1474413424730301, + "max_abs_delta": 7.75 + }, + "x_at_s0": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9886534810066223, + "min_cosine_similarity": 0.8196519613265991, + "mean_relative_l2": 0.1370696723461151, + "max_abs_delta": 3.875 + }, + "x_at_s1": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9811722040176392, + "min_cosine_similarity": 0.7260937690734863, + "mean_relative_l2": 0.17893418669700623, + "max_abs_delta": 5.0 + }, + "period_at_s0": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.987921953201294, + "min_cosine_similarity": 0.8023305535316467, + "mean_relative_l2": 0.13881392776966095, + "max_abs_delta": 3.515625 + }, + "period_at_s1": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9816647171974182, + "min_cosine_similarity": 0.7790340185165405, + "mean_relative_l2": 0.1765539050102234, + "max_abs_delta": 5.25 + } + } + }, + "layer_20": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6c16f74d13b0f9a5428d9f3d0315e74160c226b8b0aaad59a09fa2373aec25be", + "mean": -0.012013710103929043, + "std": 1.2474803924560547, + "rms": 1.2475383281707764, + "max_abs": 38.5 + }, + "full_input": { + "shape": [ + 133, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1da3dd03f1840db6177c570c751ff1d665d74b8d033809b6a28450b85e92fe91", + "mean": -0.02023252658545971, + "std": 7.314810276031494, + "rms": 7.314838409423828, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "76c10dc3e2bbb050f33aa54d21d6ecbcfe87bf0d218183e08ced44f7f442eb68", + "mean": -0.012088729999959469, + "std": 1.2408546209335327, + "rms": 1.2409133911132812, + "max_abs": 38.0 + }, + "full_input": { + "shape": [ + 149, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7309f67399ae60f0e174bf0c725430c6fd6ca1bab03a63ccde521e42e9cb1a44", + "mean": -0.021116675809025764, + "std": 7.140717506408691, + "rms": 7.140748500823975, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c07bc56654cf35da289b5d76258b5512e8a1b8d483a19d0d2c41e22de38acde7", + "mean": -0.012934118509292603, + "std": 1.2488349676132202, + "rms": 1.2489018440246582, + "max_abs": 37.5 + }, + "full_input": { + "shape": [ + 133, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1889fe69c0a7dbf4fa2c946184b1698a0e66cb77701aa95640973db8bf83ee7f", + "mean": -0.01288150716573, + "std": 6.257842540740967, + "rms": 6.25785493850708, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "641d919f1f6a48431b82e05b2bbb43e8591d8fb5540b330f29fef465a09f53a8", + "mean": -0.012349563650786877, + "std": 1.248324990272522, + "rms": 1.2483861446380615, + "max_abs": 37.5 + }, + "full_input": { + "shape": [ + 149, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ab66067735827b98d889a325f9622a5e6cde38d71e4e41cb02669f8851ec0c8c", + "mean": -0.012585285119712353, + "std": 5.9226508140563965, + "rms": 5.922663688659668, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4ae9a18afddf1513f422e185f53fa7261d988ae8ff1c2e34c96af04b8644370d", + "mean": -0.01325081754475832, + "std": 1.251428246498108, + "rms": 1.2514983415603638, + "max_abs": 37.75 + }, + "full_input": { + "shape": [ + 133, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "44f80c612a1458df76274b412de5742c6a05ab5bd53fc8e4544df2bf90b78895", + "mean": -0.01350038405507803, + "std": 6.259270668029785, + "rms": 6.259284973144531, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c640e0b92772e47d22e1b73c22773d21f8fb5e5cea7fa0e5f08547eb40b625ed", + "mean": -0.011756314896047115, + "std": 1.2486165761947632, + "rms": 1.2486720085144043, + "max_abs": 37.75 + }, + "full_input": { + "shape": [ + 149, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "890d9fb6c400a2e4e516808bed5e77a5b81b1999291493b2756cea59f02394b6", + "mean": -0.012426037341356277, + "std": 5.92335319519043, + "rms": 5.923366546630859, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c0b3a5b6863d6bee2ac0e19e831c844d8175561d25e5663ca8f6d6c25f470fc3", + "mean": -0.012956841848790646, + "std": 1.2504180669784546, + "rms": 1.2504851818084717, + "max_abs": 38.0 + }, + "full_input": { + "shape": [ + 133, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "494d9f0535a490aabce68623e1cf088d0853af190aef73b4642434440af90952", + "mean": -0.012930795550346375, + "std": 6.258671283721924, + "rms": 6.2586846351623535, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "02c08f9e8874706984514ba48024bd9ab80c676b103bf7dfb580473b90683c2f", + "mean": -0.012347289361059666, + "std": 1.2488656044006348, + "rms": 1.2489266395568848, + "max_abs": 37.75 + }, + "full_input": { + "shape": [ + 149, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ceb12364318afe0fd8fed375b075a149a57486f5db3cc99e9f20d6e69146c50e", + "mean": -0.012833972461521626, + "std": 5.923091411590576, + "rms": 5.923104763031006, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9940676093101501, + "min_cosine_similarity": 0.9259060621261597, + "mean_relative_l2": 0.09966182708740234, + "max_abs_delta": 3.3125 + }, + "system_bos": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9929981827735901, + "min_cosine_similarity": 0.9561792016029358, + "mean_relative_l2": 0.1136852353811264, + "max_abs_delta": 2.09375 + }, + "system_x": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9845008850097656, + "min_cosine_similarity": 0.800917387008667, + "mean_relative_l2": 0.1615568846464157, + "max_abs_delta": 4.5 + }, + "system_period": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9865780472755432, + "min_cosine_similarity": 0.8451546430587769, + "mean_relative_l2": 0.15152768790721893, + "max_abs_delta": 3.5 + }, + "bos_at_s0": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9906665682792664, + "min_cosine_similarity": 0.8062575459480286, + "mean_relative_l2": 0.11840993911027908, + "max_abs_delta": 4.734375 + }, + "bos_at_s1": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9869877696037292, + "min_cosine_similarity": 0.7579658031463623, + "mean_relative_l2": 0.14283229410648346, + "max_abs_delta": 6.76171875 + }, + "x_at_s0": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9890201091766357, + "min_cosine_similarity": 0.8185452222824097, + "mean_relative_l2": 0.1340123414993286, + "max_abs_delta": 6.0 + }, + "x_at_s1": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9819626212120056, + "min_cosine_similarity": 0.7412059307098389, + "mean_relative_l2": 0.17528590559959412, + "max_abs_delta": 6.8125 + }, + "period_at_s0": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9883114695549011, + "min_cosine_similarity": 0.7892312407493591, + "mean_relative_l2": 0.1354953497648239, + "max_abs_delta": 4.375 + }, + "period_at_s1": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9823139309883118, + "min_cosine_similarity": 0.7891784310340881, + "mean_relative_l2": 0.17316854000091553, + "max_abs_delta": 4.25 + } + } + }, + "layer_21": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "60a634869d13f23166e531949ea6ebd245e91cba92dc145a0719cc401c54bed6", + "mean": -0.010167773813009262, + "std": 1.361043095588684, + "rms": 1.3610811233520508, + "max_abs": 48.25 + }, + "full_input": { + "shape": [ + 133, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4576cd8fa73dfba71d32714b770335c7a8c11628dd3cd5aa675188a89a45729c", + "mean": -0.01823153719305992, + "std": 7.40177583694458, + "rms": 7.401798725128174, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "db97628629ee26cfc21efc9e9f1c0c2bee4d8d00752ce711d603ef5740491a85", + "mean": -0.010253868997097015, + "std": 1.354838252067566, + "rms": 1.35487699508667, + "max_abs": 47.75 + }, + "full_input": { + "shape": [ + 149, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f721bffcdb7a858754d76a1bb368d276761fd025f228dc1b038fb157f0db39f8", + "mean": -0.018925530835986137, + "std": 7.222630500793457, + "rms": 7.222654819488525, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "26cee7681431507c4ca97fc0acde04e040ed84f3a4618c3e95e3591de0777e5e", + "mean": -0.01132525596767664, + "std": 1.3646597862243652, + "rms": 1.3647067546844482, + "max_abs": 47.75 + }, + "full_input": { + "shape": [ + 133, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f24ddc30e2e7a34ec891538a4876a3115b3f07f839c238ba0951b5a975d22402", + "mean": -0.010997162200510502, + "std": 6.2667236328125, + "rms": 6.266733169555664, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bf7f1275cbabb0af74c8610075721b28937e341b6a620efd4383f3c2cc45b97d", + "mean": -0.0106267761439085, + "std": 1.3644869327545166, + "rms": 1.3645282983779907, + "max_abs": 47.5 + }, + "full_input": { + "shape": [ + 149, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "48130ea837e147b57880af4158870015b9d22a72057a8f1d71831af91add553f", + "mean": -0.01039744820445776, + "std": 5.936868667602539, + "rms": 5.936877250671387, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6d807d438406073d7b0666839538e4119463135752e33ca27688195612db1d11", + "mean": -0.012078880332410336, + "std": 1.3669276237487793, + "rms": 1.366981029510498, + "max_abs": 48.0 + }, + "full_input": { + "shape": [ + 133, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "dd8b3ef805a8b6f8d9e91abdb6481e61b7a5b0749a02a7830b8a80605a74bc4b", + "mean": -0.011918505653738976, + "std": 6.268595218658447, + "rms": 6.268606185913086, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "125e8196b8ad3ea44cf165f8ca6e86ba809c8efc3440bb4799c7784dab72d838", + "mean": -0.010821115225553513, + "std": 1.3671437501907349, + "rms": 1.3671865463256836, + "max_abs": 47.75 + }, + "full_input": { + "shape": [ + 149, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "43d1d139ed998a0c91a22dd007eb96e5fd9affdfc5658e737b753c3c4462a514", + "mean": -0.010974938049912453, + "std": 5.938665390014648, + "rms": 5.9386749267578125, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "acaa9251be557c08428438f83e2d619568d90e8c9ff252f479a3375cb07f3194", + "mean": -0.011575297452509403, + "std": 1.365088701248169, + "rms": 1.3651376962661743, + "max_abs": 48.0 + }, + "full_input": { + "shape": [ + 133, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8a07c8d323b4435d13e7365a2c141379c7aeece6e477bbd1c76b2a15c265c143", + "mean": -0.011229769326746464, + "std": 6.267423629760742, + "rms": 6.2674336433410645, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e0531cf78dea904fb73c8b03a471778b18bdb6e632bf06ef6ac391fbe1f83296", + "mean": -0.01122626755386591, + "std": 1.3643014430999756, + "rms": 1.3643475770950317, + "max_abs": 47.5 + }, + "full_input": { + "shape": [ + 149, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f96d5dc4fcfedf2bb878e4384d4a1cfda2c67c0c4ff46c0e637c20f57b076392", + "mean": -0.011156588792800903, + "std": 5.9373626708984375, + "rms": 5.937373161315918, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9935581684112549, + "min_cosine_similarity": 0.9235882759094238, + "mean_relative_l2": 0.10381551831960678, + "max_abs_delta": 4.8125 + }, + "system_bos": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9924202561378479, + "min_cosine_similarity": 0.9540565013885498, + "mean_relative_l2": 0.11847998201847076, + "max_abs_delta": 2.125 + }, + "system_x": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9831516742706299, + "min_cosine_similarity": 0.7943986058235168, + "mean_relative_l2": 0.1703723967075348, + "max_abs_delta": 7.125 + }, + "system_period": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9848668575286865, + "min_cosine_similarity": 0.8381193280220032, + "mean_relative_l2": 0.16140106320381165, + "max_abs_delta": 5.75 + }, + "bos_at_s0": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9901349544525146, + "min_cosine_similarity": 0.8066386580467224, + "mean_relative_l2": 0.12232670187950134, + "max_abs_delta": 4.890625 + }, + "bos_at_s1": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9862606525421143, + "min_cosine_similarity": 0.7672735452651978, + "mean_relative_l2": 0.14740370213985443, + "max_abs_delta": 7.09765625 + }, + "x_at_s0": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9883286952972412, + "min_cosine_similarity": 0.8170320391654968, + "mean_relative_l2": 0.13826461136341095, + "max_abs_delta": 7.25 + }, + "x_at_s1": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9806983470916748, + "min_cosine_similarity": 0.7176002264022827, + "mean_relative_l2": 0.18176229298114777, + "max_abs_delta": 8.0 + }, + "period_at_s0": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.987711489200592, + "min_cosine_similarity": 0.7860310077667236, + "mean_relative_l2": 0.1390840858221054, + "max_abs_delta": 5.25 + }, + "period_at_s1": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9809424877166748, + "min_cosine_similarity": 0.7642027735710144, + "mean_relative_l2": 0.1798078417778015, + "max_abs_delta": 5.0 + } + } + }, + "layer_22": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7abb19d018fce2057ec7d6c0fe7b05882599727990f1c5fd920d7edb3ed6d442", + "mean": -0.008561690337955952, + "std": 1.546005368232727, + "rms": 1.5460290908813477, + "max_abs": 61.5 + }, + "full_input": { + "shape": [ + 133, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8729cb7bdde4435308df97f4e9c314f2d86f88c4fcdedfaba53523bab4ccb507", + "mean": -0.017176562920212746, + "std": 7.4365973472595215, + "rms": 7.436616897583008, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cc57211e91ea4244afc1b29243b09bdbea44bcfd657148efab12968b34c24905", + "mean": -0.008739006705582142, + "std": 1.5370659828186035, + "rms": 1.5370908975601196, + "max_abs": 61.0 + }, + "full_input": { + "shape": [ + 149, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "419f78bde1e16341c249030c301519aff582db1759332db2bd60b8ad14511cf7", + "mean": -0.018312839791178703, + "std": 7.261689186096191, + "rms": 7.261712074279785, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d4029af55265d3c6c8e5980ee0f9af7fc78466dc54c49544bff686ecae7a9a3e", + "mean": -0.010426531545817852, + "std": 1.5477993488311768, + "rms": 1.5478345155715942, + "max_abs": 61.5 + }, + "full_input": { + "shape": [ + 133, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "25435a7e94b846d0fd5721fb44609439dd28551618f691394ab2c9e00888dd1e", + "mean": -0.010427170433104038, + "std": 6.307790756225586, + "rms": 6.307799339294434, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ecf6e536f3bf8b6f83b52cae0a889f6c6c9ce899b1c445d8ec9d50481f46ef2e", + "mean": -0.009497559629380703, + "std": 1.54622220993042, + "rms": 1.5462512969970703, + "max_abs": 61.0 + }, + "full_input": { + "shape": [ + 149, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5cc7f1aba2510e240630cd5d332fe20bba93a6a66aa176b476d89ecacca5590e", + "mean": -0.010042871348559856, + "std": 5.9850029945373535, + "rms": 5.985011577606201, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3a8b4a3e9f23cfe197ce71f8406b53bcecb5ab5c0cf68f219690789ee519b310", + "mean": -0.011280830018222332, + "std": 1.55357027053833, + "rms": 1.5536112785339355, + "max_abs": 62.0 + }, + "full_input": { + "shape": [ + 133, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8594f73f9f222d66a1bc1084ae8d065963981e0e2771f91cc4db55f65fea3ee1", + "mean": -0.011593404226005077, + "std": 6.3111419677734375, + "rms": 6.311152458190918, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "149f3b0d85bd3cd1b5f816a9697b8277feb5c07ee8cb6a77991e94406e1cf6ec", + "mean": -0.009731899946928024, + "std": 1.551283836364746, + "rms": 1.551314353942871, + "max_abs": 61.75 + }, + "full_input": { + "shape": [ + 149, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1f5fe3944305696761db20a2b1761688f2818892ecbd0d0e78d6484d9d1f9243", + "mean": -0.010432119481265545, + "std": 5.987829208374023, + "rms": 5.987838268280029, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1c940c3e3414b3735fd04d63c3eb225b7b7d5e0bd8925d902f0dff2c06c19579", + "mean": -0.010740863159298897, + "std": 1.5482192039489746, + "rms": 1.5482563972473145, + "max_abs": 62.0 + }, + "full_input": { + "shape": [ + 133, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c43ac93d17efb5afeed1914b3c61ee9b6c83bd638d9388ab3207e92b94ad8b59", + "mean": -0.01085018739104271, + "std": 6.30880069732666, + "rms": 6.308809757232666, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "86fd909eb0306bcc659efa57d77ac099103e96bb5dbe8db6c45dae7ea4287a05", + "mean": -0.010303616523742676, + "std": 1.547134280204773, + "rms": 1.547168493270874, + "max_abs": 62.0 + }, + "full_input": { + "shape": [ + 149, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1caa78478b0ba44a95737ab3da2c19dcc5e4ad9d7de38f1cc3aaff2fdf5ac71b", + "mean": -0.010744744911789894, + "std": 5.985884666442871, + "rms": 5.985893726348877, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9929064512252808, + "min_cosine_similarity": 0.9067883491516113, + "mean_relative_l2": 0.1065603643655777, + "max_abs_delta": 5.125 + }, + "system_bos": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9920249581336975, + "min_cosine_similarity": 0.9397161602973938, + "mean_relative_l2": 0.12042735517024994, + "max_abs_delta": 3.0 + }, + "system_x": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9830103516578674, + "min_cosine_similarity": 0.800011157989502, + "mean_relative_l2": 0.17081451416015625, + "max_abs_delta": 7.75 + }, + "system_period": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9843820929527283, + "min_cosine_similarity": 0.8415747284889221, + "mean_relative_l2": 0.1626986563205719, + "max_abs_delta": 7.0 + }, + "bos_at_s0": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9892251491546631, + "min_cosine_similarity": 0.7791241407394409, + "mean_relative_l2": 0.12444949895143509, + "max_abs_delta": 4.765625 + }, + "bos_at_s1": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9857586026191711, + "min_cosine_similarity": 0.7517611384391785, + "mean_relative_l2": 0.14795070886611938, + "max_abs_delta": 7.42578125 + }, + "x_at_s0": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9878273010253906, + "min_cosine_similarity": 0.8045340776443481, + "mean_relative_l2": 0.13912318646907806, + "max_abs_delta": 7.125 + }, + "x_at_s1": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9805446863174438, + "min_cosine_similarity": 0.7028411626815796, + "mean_relative_l2": 0.18134978413581848, + "max_abs_delta": 9.0 + }, + "period_at_s0": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9871574640274048, + "min_cosine_similarity": 0.7786445021629333, + "mean_relative_l2": 0.14014224708080292, + "max_abs_delta": 5.125 + }, + "period_at_s1": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9806836247444153, + "min_cosine_similarity": 0.7414791584014893, + "mean_relative_l2": 0.17928797006607056, + "max_abs_delta": 6.0 + } + } + }, + "layer_23": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ea75c4e7dcb6609d12c2726b92ff2faf933d8936f2379e9b83d5c3ddc55c327d", + "mean": -0.020519446581602097, + "std": 1.9600975513458252, + "rms": 1.960204839706421, + "max_abs": 94.0 + }, + "full_input": { + "shape": [ + 133, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fd21159475ec24e168c4803c5b775b6c41a84aeba76029a00f1c78c680fad5e2", + "mean": -0.026921771466732025, + "std": 7.498349666595459, + "rms": 7.498397350311279, + "max_abs": 1160.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e1e7599b92b3db08f78c48d9748b1e9841576ded28757b42ef9e92481194b6e2", + "mean": -0.021204808726906776, + "std": 1.9481236934661865, + "rms": 1.9482390880584717, + "max_abs": 94.0 + }, + "full_input": { + "shape": [ + 149, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "82caa8c464b312f199d82b7e671abae84c3b2ba2104a58104aa5c4fa7493ffe9", + "mean": -0.026444604620337486, + "std": 7.327391624450684, + "rms": 7.327439308166504, + "max_abs": 1160.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7936cfc8b78db2183e9dfbe42551944c48940b6ed742249a5435ba189fbcfad1", + "mean": -0.022475847974419594, + "std": 1.9583399295806885, + "rms": 1.9584687948226929, + "max_abs": 95.0 + }, + "full_input": { + "shape": [ + 133, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "28e66eb8342401fd2ff80b718f60e70a13435da3effff1bdabac5d0c53b4a70a", + "mean": -0.020303796976804733, + "std": 6.388372898101807, + "rms": 6.388404846191406, + "max_abs": 1160.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2ac284b6c2d237325960e559f3b3f75fa4d69f36c5d5d182447d42cd817885d1", + "mean": -0.021192805841565132, + "std": 1.9549733400344849, + "rms": 1.9550882577896118, + "max_abs": 94.0 + }, + "full_input": { + "shape": [ + 149, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e490d4d9b0cfb57e3eb3180fcc5bf00c1e5dadec69ea01a953e26979c060e9c7", + "mean": -0.017634376883506775, + "std": 6.076113700866699, + "rms": 6.076139450073242, + "max_abs": 1160.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1f62317f3ff9ed001415866b4177c6930c1d42ac1a2df26a34fdd459be5b57f7", + "mean": -0.023662924766540527, + "std": 1.9684587717056274, + "rms": 1.968601107597351, + "max_abs": 96.0 + }, + "full_input": { + "shape": [ + 133, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2c619a6e521a6d5a3af749bd08ab2706476cbcdc16a92e52394ca022ba35a2c7", + "mean": -0.021709144115447998, + "std": 6.394739627838135, + "rms": 6.394775867462158, + "max_abs": 1160.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5b1152088ff9a8170b08fe81beee9e06d1063853372367f794cfd1ab581adc51", + "mean": -0.02208840101957321, + "std": 1.9592708349227905, + "rms": 1.959395408630371, + "max_abs": 94.0 + }, + "full_input": { + "shape": [ + 149, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "649b8e8d5c4a7b809b9a2df83a4bc6c7f7f0aa8745a841d62888e69aaa8c85ad", + "mean": -0.018632443621754646, + "std": 6.0807108879089355, + "rms": 6.080739498138428, + "max_abs": 1160.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bdf8f459b3ddf29b7ee244cfde8f556117a68ecc85eaec65aa64dd4e257df3a6", + "mean": -0.02284872718155384, + "std": 1.9583849906921387, + "rms": 1.9585182666778564, + "max_abs": 95.5 + }, + "full_input": { + "shape": [ + 133, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6404f246ff2a0d37bff44de302f47d79cba1f90c179132e2d838fec03fc893e0", + "mean": -0.020909292623400688, + "std": 6.389956474304199, + "rms": 6.38999080657959, + "max_abs": 1160.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7433351082e63347281d5d72dd26695db652f769d8bf7d9ab37bc59270887aa1", + "mean": -0.02281118743121624, + "std": 1.9556695222854614, + "rms": 1.9558024406433105, + "max_abs": 95.0 + }, + "full_input": { + "shape": [ + 149, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5936ce6a91c2b8dbf540ade689e00af3a5aba279a05c34690be292b79a033c1f", + "mean": -0.01902603730559349, + "std": 6.077844619750977, + "rms": 6.077874660491943, + "max_abs": 1160.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9923791289329529, + "min_cosine_similarity": 0.8122758269309998, + "mean_relative_l2": 0.10221680998802185, + "max_abs_delta": 8.375 + }, + "system_bos": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9929690957069397, + "min_cosine_similarity": 0.9388070702552795, + "mean_relative_l2": 0.1121787428855896, + "max_abs_delta": 3.75 + }, + "system_x": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9856142401695251, + "min_cosine_similarity": 0.8363597989082336, + "mean_relative_l2": 0.15715640783309937, + "max_abs_delta": 11.25 + }, + "system_period": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9862077236175537, + "min_cosine_similarity": 0.8480823636054993, + "mean_relative_l2": 0.15133477747440338, + "max_abs_delta": 8.5 + }, + "bos_at_s0": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9891948699951172, + "min_cosine_similarity": 0.8032691478729248, + "mean_relative_l2": 0.11767508089542389, + "max_abs_delta": 6.875 + }, + "bos_at_s1": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9878467917442322, + "min_cosine_similarity": 0.776002049446106, + "mean_relative_l2": 0.13606774806976318, + "max_abs_delta": 8.7646484375 + }, + "x_at_s0": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9882554411888123, + "min_cosine_similarity": 0.8091328144073486, + "mean_relative_l2": 0.13136182725429535, + "max_abs_delta": 12.75 + }, + "x_at_s1": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9834538102149963, + "min_cosine_similarity": 0.7548834085464478, + "mean_relative_l2": 0.16760720312595367, + "max_abs_delta": 14.0 + }, + "period_at_s0": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.987468421459198, + "min_cosine_similarity": 0.8045957088470459, + "mean_relative_l2": 0.13269969820976257, + "max_abs_delta": 8.5 + }, + "period_at_s1": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9832072854042053, + "min_cosine_similarity": 0.7734541296958923, + "mean_relative_l2": 0.16632969677448273, + "max_abs_delta": 7.5 + } + } + }, + "layer_24": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "443de520cdf9767d1c30a08606c0c222027136f1820274fd2f608fb073a65281", + "mean": -0.03457396477460861, + "std": 3.225687026977539, + "rms": 3.225872278213501, + "max_abs": 338.0 + }, + "full_input": { + "shape": [ + 133, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "94ce3682bc7c2d5814429cf2b45b3679e1f67b25a112b514f017db7fbc16f7e1", + "mean": -0.039745572954416275, + "std": 7.413569927215576, + "rms": 7.413676738739014, + "max_abs": 1008.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "67af37e85f1dc9b98f43ed67c676a2690c354d4c1628271970a844cc2d531d27", + "mean": -0.033838070929050446, + "std": 2.384422540664673, + "rms": 2.384662628173828, + "max_abs": 114.5 + }, + "full_input": { + "shape": [ + 149, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a2caef1c216844dd0c79b32a3311d510d4c22da478817ee205c2cdcb97115c59", + "mean": -0.03648507595062256, + "std": 7.2101359367370605, + "rms": 7.210227966308594, + "max_abs": 1120.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "94be8a922b678d830354c8b05ba05518a7dcc6884f22b6f63b5d174e9920f029", + "mean": -0.034906450659036636, + "std": 2.400236129760742, + "rms": 2.4004900455474854, + "max_abs": 115.5 + }, + "full_input": { + "shape": [ + 133, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8d9a2db8fc6c806bb72bac7a48f1bd63046cde3568a0a3fb1d00c7f4795a2e28", + "mean": -0.03075874224305153, + "std": 4.754230976104736, + "rms": 4.754330635070801, + "max_abs": 840.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "48f260a992d06291d76976a7a29d5bf1cb605ac5b641555c47df389f8e8c8603", + "mean": -0.034115225076675415, + "std": 2.393026351928711, + "rms": 2.3932693004608154, + "max_abs": 114.5 + }, + "full_input": { + "shape": [ + 149, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8cb39fe9d92c16417fb75e558a8905a17188a81f6b4df13b0885ed34f6914a0c", + "mean": -0.026784146204590797, + "std": 4.585548400878906, + "rms": 4.585626602172852, + "max_abs": 840.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6c2c7b1bba23c479eb5e596f1e0cb2bff4ced1dc5a5b08f810875edd6eb30662", + "mean": -0.03656403720378876, + "std": 2.4098122119903564, + "rms": 2.4100897312164307, + "max_abs": 117.0 + }, + "full_input": { + "shape": [ + 133, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "30d50eb85f33dcc364095192c9fa9360fa4da56fbac75e5edcca45a329094eca", + "mean": -0.032608285546302795, + "std": 4.765179634094238, + "rms": 4.765291213989258, + "max_abs": 840.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "45e75dd3970ce3e3fbbbf5352103b63a3d3cf65e3bd8ea03ea854f2475ae2a66", + "mean": -0.03455491364002228, + "std": 2.398941993713379, + "rms": 2.399190902709961, + "max_abs": 115.0 + }, + "full_input": { + "shape": [ + 149, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "51b38e5f8f699469f2fe3870c848ff21c0bdc695c88de742744ea8940c7eba59", + "mean": -0.02764594927430153, + "std": 4.594601631164551, + "rms": 4.594684600830078, + "max_abs": 840.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bfb1726c5eb27b100209f5d5d97d2b559de0163ff6d1cd63ce27c44b011d20f0", + "mean": -0.035760633647441864, + "std": 2.3991284370422363, + "rms": 2.399394989013672, + "max_abs": 116.5 + }, + "full_input": { + "shape": [ + 133, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a2b7f98a76503f975e65ab5bb01f895e993084b7487c93a8ebd0be369affbb35", + "mean": -0.03162980452179909, + "std": 4.757100582122803, + "rms": 4.757205486297607, + "max_abs": 840.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "367ddd654c4bc7f10bb08e9347fe5fecfa47fedc77a893d554ef7920b22df311", + "mean": -0.03624947741627693, + "std": 2.3950202465057373, + "rms": 2.395294666290283, + "max_abs": 115.5 + }, + "full_input": { + "shape": [ + 149, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bdb11363dd198f3bbffea7943e8ddc3d72f5972fe83c194d0476aa95ae90da5c", + "mean": -0.028551992028951645, + "std": 4.589364528656006, + "rms": 4.589453220367432, + "max_abs": 840.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9859978556632996, + "min_cosine_similarity": 0.052593763917684555, + "mean_relative_l2": 0.09885559976100922, + "max_abs_delta": 336.8359375 + }, + "system_bos": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9939310550689697, + "min_cosine_similarity": 0.9411382079124451, + "mean_relative_l2": 0.10360995680093765, + "max_abs_delta": 4.0 + }, + "system_x": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9875487685203552, + "min_cosine_similarity": 0.8454877734184265, + "mean_relative_l2": 0.14498455822467804, + "max_abs_delta": 13.75 + }, + "system_period": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9877068996429443, + "min_cosine_similarity": 0.841835081577301, + "mean_relative_l2": 0.14076954126358032, + "max_abs_delta": 9.0 + }, + "bos_at_s0": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9835202097892761, + "min_cosine_similarity": 0.048049960285425186, + "mean_relative_l2": 0.1117367222905159, + "max_abs_delta": 336.8125 + }, + "bos_at_s1": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9896798729896545, + "min_cosine_similarity": 0.8026944994926453, + "mean_relative_l2": 0.1251896172761917, + "max_abs_delta": 9.13671875 + }, + "x_at_s0": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9825526475906372, + "min_cosine_similarity": 0.04989979416131973, + "mean_relative_l2": 0.12585175037384033, + "max_abs_delta": 336.828125 + }, + "x_at_s1": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9859123229980469, + "min_cosine_similarity": 0.7697513699531555, + "mean_relative_l2": 0.15390056371688843, + "max_abs_delta": 17.5 + }, + "period_at_s0": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9814968109130859, + "min_cosine_similarity": 0.04957924038171768, + "mean_relative_l2": 0.12816618382930756, + "max_abs_delta": 336.765625 + }, + "period_at_s1": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.985620379447937, + "min_cosine_similarity": 0.77928626537323, + "mean_relative_l2": 0.1528819352388382, + "max_abs_delta": 11.0 + } + } + }, + "layer_25": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3f7001f8756a71826e6c800e4f171e861dbebea8632a284dbea3304aeb09df7f", + "mean": -0.056597258895635605, + "std": 3.9902639389038086, + "rms": 3.9906651973724365, + "max_abs": 340.0 + }, + "full_input": { + "shape": [ + 133, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "54a5549e57740e0feafa4332d12871ae152ba5583bde0af40f880bd753e03371", + "mean": -0.06001086160540581, + "std": 6.245612621307373, + "rms": 6.245901107788086, + "max_abs": 872.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "da29898e2851ad58bcb506c1fe7913a795c9a881859f2116a2bda4976ef98b10", + "mean": -0.0543779693543911, + "std": 3.3080894947052, + "rms": 3.3085362911224365, + "max_abs": 162.0 + }, + "full_input": { + "shape": [ + 149, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "808bc7500cccc87fbf91e77b703594ffdb589f561008b1e465ae1152fb6d0ad5", + "mean": -0.054648905992507935, + "std": 6.112896919250488, + "rms": 6.113142013549805, + "max_abs": 984.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0ea9656bfa72becc225ec8912b5db7ff0fcf4575505406fbcf17ba6d0d65d640", + "mean": -0.05877641215920448, + "std": 3.340261459350586, + "rms": 3.3407785892486572, + "max_abs": 163.0 + }, + "full_input": { + "shape": [ + 133, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d104b8ae30df256381bae138942be1075c78cfd0bb402c15fbb4caaf9f7792b9", + "mean": -0.05192440748214722, + "std": 3.526637077331543, + "rms": 3.5270192623138428, + "max_abs": 248.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "383fd805d520f7ae25e951ec46850fb6a891b8d4c14bb792d04384fc0c245d4a", + "mean": -0.05585769936442375, + "std": 3.327802896499634, + "rms": 3.3282716274261475, + "max_abs": 162.0 + }, + "full_input": { + "shape": [ + 149, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8a26ca5bfc3a296a140ce1c0a6f04316e76d29f433f56cb457b65348cc65fbde", + "mean": -0.04520568624138832, + "std": 3.5439951419830322, + "rms": 3.544283390045166, + "max_abs": 248.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9e0eaf98b239a2dc4cdbe65ed9e36c237212209c0d7f92378663208e1f88ee65", + "mean": -0.061266351491212845, + "std": 3.351959705352783, + "rms": 3.3525195121765137, + "max_abs": 166.0 + }, + "full_input": { + "shape": [ + 133, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "af57a6a6e9db65721ad18f50b2d2ea70e09b8bebb446bc0ba50aaa201e141256", + "mean": -0.05500386282801628, + "std": 3.554351568222046, + "rms": 3.554776906967163, + "max_abs": 248.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2831d3313a8d7988c091a9c4e43a5208e395b9ba34fffa288aee893a3e3e7fe1", + "mean": -0.055039744824171066, + "std": 3.3246119022369385, + "rms": 3.3250672817230225, + "max_abs": 164.0 + }, + "full_input": { + "shape": [ + 149, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9d65452d09c7784dfe3386190cfb6e2d985424ab7dc52f46e40b11a8a0aa22bd", + "mean": -0.04500633850693703, + "std": 3.556990385055542, + "rms": 3.5572752952575684, + "max_abs": 248.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ef2d40ff879d81d20950b0b2d93c8c186a7ea6930239889efaa74febe091b7fc", + "mean": -0.0600346140563488, + "std": 3.335679531097412, + "rms": 3.3362197875976562, + "max_abs": 164.0 + }, + "full_input": { + "shape": [ + 133, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fe99164fba37bd7a1d6ec7191f735abfa961ed647dd96a3d60319eeeffccc1d0", + "mean": -0.053317103534936905, + "std": 3.5330004692077637, + "rms": 3.533402919769287, + "max_abs": 248.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bbc7c6e19e687b8f42b72ced9687a9735d5d9624f8eeb93aa2b434f62b138faa", + "mean": -0.057291027158498764, + "std": 3.3150827884674072, + "rms": 3.315577745437622, + "max_abs": 165.0 + }, + "full_input": { + "shape": [ + 149, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b94a0cdeef5746696f0b5528ce6acc305035388d9c846a70211816026e1bb2e1", + "mean": -0.04613971337676048, + "std": 3.5414254665374756, + "rms": 3.5417261123657227, + "max_abs": 248.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9877889156341553, + "min_cosine_similarity": 0.10699331760406494, + "mean_relative_l2": 0.08601680397987366, + "max_abs_delta": 338.359375 + }, + "system_bos": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9956170320510864, + "min_cosine_similarity": 0.9476728439331055, + "mean_relative_l2": 0.08762356638908386, + "max_abs_delta": 15.75 + }, + "system_x": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9907759428024292, + "min_cosine_similarity": 0.8884003758430481, + "mean_relative_l2": 0.12391885370016098, + "max_abs_delta": 32.25 + }, + "system_period": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9908819794654846, + "min_cosine_similarity": 0.884719967842102, + "mean_relative_l2": 0.12033091485500336, + "max_abs_delta": 18.25 + }, + "bos_at_s0": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9864697456359863, + "min_cosine_similarity": 0.10424312204122543, + "mean_relative_l2": 0.093660369515419, + "max_abs_delta": 338.375 + }, + "bos_at_s1": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9931260347366333, + "min_cosine_similarity": 0.852000892162323, + "mean_relative_l2": 0.10254868865013123, + "max_abs_delta": 16.5 + }, + "x_at_s0": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9860285520553589, + "min_cosine_similarity": 0.10551698505878448, + "mean_relative_l2": 0.10424399375915527, + "max_abs_delta": 338.3671875 + }, + "x_at_s1": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9905367493629456, + "min_cosine_similarity": 0.8333636522293091, + "mean_relative_l2": 0.12593284249305725, + "max_abs_delta": 27.0 + }, + "period_at_s0": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9853276610374451, + "min_cosine_similarity": 0.10542171448469162, + "mean_relative_l2": 0.10587653517723083, + "max_abs_delta": 338.28125 + }, + "period_at_s1": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9903486967086792, + "min_cosine_similarity": 0.837882936000824, + "mean_relative_l2": 0.12452181428670883, + "max_abs_delta": 15.5 + } + } + }, + "layer_26": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8ef996ea755cefa1a6905fdc4f749a5e54892899b927d84fc56f1d44aea64baa", + "mean": -0.087374247610569, + "std": 4.218669891357422, + "rms": 4.219574451446533, + "max_abs": 207.0 + }, + "full_input": { + "shape": [ + 133, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9aa517e3ba44306900440850d3736e90825a3005562cd85d235ce6725f10594e", + "mean": -0.09046366065740585, + "std": 6.42797327041626, + "rms": 6.428609848022461, + "max_abs": 840.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d538bfa9e74693cd2c3a700a30ab791f80f0fa79f5d836e1546310fa3c21fcf8", + "mean": -0.07994751632213593, + "std": 4.090029716491699, + "rms": 4.090811252593994, + "max_abs": 199.0 + }, + "full_input": { + "shape": [ + 149, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d4766298a45de76025603832199e02fdbc19f1c2ef1074ccd6e65d02fee0a553", + "mean": -0.07448796927928925, + "std": 6.555407524108887, + "rms": 6.555830478668213, + "max_abs": 868.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c2ccfd9c335e0fa47b6ba2a934c36fe34968084f2d9ea79cac578ea99edc17b0", + "mean": -0.09034762531518936, + "std": 4.182046413421631, + "rms": 4.1830220222473145, + "max_abs": 209.0 + }, + "full_input": { + "shape": [ + 133, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fabdf373bca4fd92a15d833f9940ff6bc24d95638148a198da6b357a0d99d4af", + "mean": -0.08144169300794601, + "std": 4.6558146476745605, + "rms": 4.656527042388916, + "max_abs": 776.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4d167fc892ba91313a0de8460a3e8ba0def3fc5ce3be4261831cebba6c41609a", + "mean": -0.0820268988609314, + "std": 4.146694660186768, + "rms": 4.147505760192871, + "max_abs": 202.0 + }, + "full_input": { + "shape": [ + 149, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e489fa134acbc8c7a2202e1b3f715b0204782a49af03d5a632673c794dda5b7d", + "mean": -0.06416406482458115, + "std": 4.739673137664795, + "rms": 4.740107536315918, + "max_abs": 776.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "675f0a83b0a7ddd6d54e2dbd191afc42d8a36a70850349e79f234f956164045e", + "mean": -0.09411799162626266, + "std": 4.184000492095947, + "rms": 4.185059547424316, + "max_abs": 205.0 + }, + "full_input": { + "shape": [ + 133, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "59a89cadf0da95315c846b7b155dbfe0f05dde83ce8cbc979c96a3f03dd7245b", + "mean": -0.08606334775686264, + "std": 4.683999061584473, + "rms": 4.684789657592773, + "max_abs": 776.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "802925e9ae2816d082a95920a63eb09f2e5d4c0547007e96d4023b0acacce53b", + "mean": -0.07667375355958939, + "std": 3.9966509342193604, + "rms": 3.9973862171173096, + "max_abs": 186.0 + }, + "full_input": { + "shape": [ + 149, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "007ba6ab2dcdc81eb265ae4baefee2ef52c60e4f1b43cc3101649a4bca9815f7", + "mean": -0.06064121797680855, + "std": 4.650725841522217, + "rms": 4.651121139526367, + "max_abs": 776.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "81f553d190b09047f09cf7be7ad94f580b79bdc6faad3c613a81e18b53f8d7a4", + "mean": -0.09263718873262405, + "std": 4.123202800750732, + "rms": 4.124243259429932, + "max_abs": 198.0 + }, + "full_input": { + "shape": [ + 133, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "38a8c2cbccdc1b4fa58f5bd735ced89c670327c0c85ef1972a9855495b6c127c", + "mean": -0.0839555412530899, + "std": 4.621490955352783, + "rms": 4.62225341796875, + "max_abs": 776.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "dc94d81cf2c52695eda6acaca0209206cb6fbbca9d18435cfffb36f211ba8a51", + "mean": -0.07965879887342453, + "std": 3.9694783687591553, + "rms": 3.9702773094177246, + "max_abs": 183.0 + }, + "full_input": { + "shape": [ + 149, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "df5e62898b57249c75ef8e7b66ad4057f0326285d93de5d2dc554239c3645ed2", + "mean": -0.0624602772295475, + "std": 4.610286235809326, + "rms": 4.610709190368652, + "max_abs": 776.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9927548766136169, + "min_cosine_similarity": 0.7350873947143555, + "mean_relative_l2": 0.09245190024375916, + "max_abs_delta": 60.25 + }, + "system_bos": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9950897097587585, + "min_cosine_similarity": 0.9203810095787048, + "mean_relative_l2": 0.09662677347660065, + "max_abs_delta": 56.5 + }, + "system_x": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.98873370885849, + "min_cosine_similarity": 0.8478570580482483, + "mean_relative_l2": 0.14530593156814575, + "max_abs_delta": 52.25 + }, + "system_period": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9880549907684326, + "min_cosine_similarity": 0.8046166300773621, + "mean_relative_l2": 0.14064085483551025, + "max_abs_delta": 31.5625 + }, + "bos_at_s0": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9923264980316162, + "min_cosine_similarity": 0.7190982699394226, + "mean_relative_l2": 0.0885261595249176, + "max_abs_delta": 66.5 + }, + "bos_at_s1": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9934337735176086, + "min_cosine_similarity": 0.7991906404495239, + "mean_relative_l2": 0.10446211695671082, + "max_abs_delta": 67.5 + }, + "x_at_s0": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9920945167541504, + "min_cosine_similarity": 0.7156803011894226, + "mean_relative_l2": 0.09821051359176636, + "max_abs_delta": 68.25 + }, + "x_at_s1": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.990602433681488, + "min_cosine_similarity": 0.7762996554374695, + "mean_relative_l2": 0.12950226664543152, + "max_abs_delta": 50.75 + }, + "period_at_s0": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9906611442565918, + "min_cosine_similarity": 0.7218101024627686, + "mean_relative_l2": 0.10224685072898865, + "max_abs_delta": 64.5 + }, + "period_at_s1": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9902738928794861, + "min_cosine_similarity": 0.7650101184844971, + "mean_relative_l2": 0.12473505735397339, + "max_abs_delta": 22.5 + } + } + }, + "final_norm": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1ca8ca22beeecc6a64c6725b5fc17732f97d36f9333bd5f07211ab316da5f045", + "mean": -0.010939775966107845, + "std": 0.6439961791038513, + "rms": 0.6440891027450562, + "max_abs": 28.375 + }, + "full_input": { + "shape": [ + 133, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e8ee41f3fad1016e59243dd534a9ecc308a691675a792510e425510c1884182a", + "mean": -0.009855445474386215, + "std": 0.6345518827438354, + "rms": 0.6346283555030823, + "max_abs": 28.375 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7e4ecdeb2c8a8ed1b97eb3e4b91dcb7a37ff9d65041ffe3d92d888f3d839f161", + "mean": -0.010114241391420364, + "std": 0.635567843914032, + "rms": 0.6356483101844788, + "max_abs": 28.375 + }, + "full_input": { + "shape": [ + 149, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2022a1b13e6e43d723ba2de895c491d359a4d70416a9cc7677e4478ecbb417f9", + "mean": -0.007564925588667393, + "std": 0.6136925220489502, + "rms": 0.6137391328811646, + "max_abs": 28.375 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "583bbbd7b8487cb1dfb494eeb7a580a26f63a23c4c5ebb10382ad36b95a586d1", + "mean": -0.01159554161131382, + "std": 0.6497219204902649, + "rms": 0.649825394153595, + "max_abs": 28.5 + }, + "full_input": { + "shape": [ + 133, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f82eeef559e2e6151a2f43a883efc680134722b783be19a39487312675ea5225", + "mean": -0.010234021581709385, + "std": 0.639911413192749, + "rms": 0.6399931907653809, + "max_abs": 28.5 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c9cf74ecf00fcb61c285d3594ff232dbf36b315fe822e900be2f61d9cde1b209", + "mean": -0.010281904600560665, + "std": 0.6384645700454712, + "rms": 0.6385473012924194, + "max_abs": 28.25 + }, + "full_input": { + "shape": [ + 149, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "875d9f2e53aaf475eba0ca2575a203d5d350cf26d24dd493d0ff41a414f6bddb", + "mean": -0.007606214378029108, + "std": 0.6160896420478821, + "rms": 0.6161365509033203, + "max_abs": 28.25 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f0bd45c71ac6374fa2b163b624fef3ec79541ef010f386abdfd951ff16aaf9e1", + "mean": -0.012174076400697231, + "std": 0.65024334192276, + "rms": 0.6503573060035706, + "max_abs": 28.25 + }, + "full_input": { + "shape": [ + 133, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "98abb634048dd674cdf63c6aa1bcc4a7867baee1dd6b1987c5887b3c4fc50ffb", + "mean": -0.010886000469326973, + "std": 0.6387721300125122, + "rms": 0.6388648152351379, + "max_abs": 28.25 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e298e988ebc711d701aa5b7ba71b5192ef86f56b0262d8d87148cf9c43110db8", + "mean": -0.009849573485553265, + "std": 0.6385246515274048, + "rms": 0.6386005878448486, + "max_abs": 29.375 + }, + "full_input": { + "shape": [ + 149, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c79a3a0c96af503a2528563ed9ed612d6a475fd3436a828ae79573da149147b7", + "mean": -0.007229297887533903, + "std": 0.6147016882896423, + "rms": 0.6147441864013672, + "max_abs": 29.375 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cd8c2da1b4dab2d1c568b3a07dd357934e8bbc7fab35b67657106956f9542c0c", + "mean": -0.01225302740931511, + "std": 0.6532217264175415, + "rms": 0.6533366441726685, + "max_abs": 29.0 + }, + "full_input": { + "shape": [ + 133, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5ddcf3a34ab89f028daf514e72cba0b06682de8ca09ba37b93356aac75c94d31", + "mean": -0.010836973786354065, + "std": 0.6422182321548462, + "rms": 0.6423096060752869, + "max_abs": 29.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 108, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8262cfba87caf749c2721df9114390bc5423bc0fefe043368ec7766c3dee03b9", + "mean": -0.010485122911632061, + "std": 0.6381266713142395, + "rms": 0.6382127404212952, + "max_abs": 28.875 + }, + "full_input": { + "shape": [ + 149, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0d4e784f743c7623435fa817da435d5914843823e445850b404e163310c9fc23", + "mean": -0.007632682099938393, + "std": 0.6159573197364807, + "rms": 0.6160045862197876, + "max_abs": 28.875 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9888795018196106, + "min_cosine_similarity": 0.4717719852924347, + "mean_relative_l2": 0.10382036864757538, + "max_abs_delta": 6.92578125 + }, + "system_bos": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9939159750938416, + "min_cosine_similarity": 0.9281231164932251, + "mean_relative_l2": 0.10288593173027039, + "max_abs_delta": 3.71875 + }, + "system_x": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9854225516319275, + "min_cosine_similarity": 0.8443814516067505, + "mean_relative_l2": 0.15315847098827362, + "max_abs_delta": 4.6875 + }, + "system_period": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9841111302375793, + "min_cosine_similarity": 0.7830619812011719, + "mean_relative_l2": 0.15258289873600006, + "max_abs_delta": 5.328125 + }, + "bos_at_s0": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9883126616477966, + "min_cosine_similarity": 0.45236197113990784, + "mean_relative_l2": 0.10244855284690857, + "max_abs_delta": 7.55078125 + }, + "bos_at_s1": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.990646481513977, + "min_cosine_similarity": 0.725895345211029, + "mean_relative_l2": 0.11150549352169037, + "max_abs_delta": 8.125 + }, + "x_at_s0": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9881702065467834, + "min_cosine_similarity": 0.4491940140724182, + "mean_relative_l2": 0.11095783114433289, + "max_abs_delta": 7.67578125 + }, + "x_at_s1": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9864886403083801, + "min_cosine_similarity": 0.7121009826660156, + "mean_relative_l2": 0.1422964483499527, + "max_abs_delta": 3.375 + }, + "period_at_s0": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9867519736289978, + "min_cosine_similarity": 0.454112708568573, + "mean_relative_l2": 0.11660094559192657, + "max_abs_delta": 7.39453125 + }, + "period_at_s1": { + "tokens": 108, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9862216711044312, + "min_cosine_similarity": 0.723862886428833, + "mean_relative_l2": 0.14167164266109467, + "max_abs_delta": 4.0625 + } + } + } + }, + "router_layers": { + "layer_01": { + "layer": 1, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "4b0e81163f41d768047e714a4d6b0c2175c7dadbeea3397391718dc81873c671", + "route_weight_sha256": "b0d444f1268ca982e1d229f1803fb351cc992286a08a5064e2f0a6c2364fdd4f", + "loads": [ + 13, + 14, + 6, + 5, + 7, + 3, + 17, + 12, + 15, + 13, + 2, + 9, + 12, + 14, + 3, + 4, + 17, + 20, + 7, + 13, + 7, + 9, + 4, + 14, + 24, + 13, + 6, + 9, + 3, + 6, + 6, + 12, + 17, + 12, + 7, + 16, + 1, + 12, + 10, + 4, + 20, + 14, + 6, + 11, + 9, + 6, + 17, + 6, + 5, + 9, + 11, + 7, + 14, + 6, + 0, + 14, + 8, + 12, + 11, + 12, + 19, + 2, + 18, + 13 + ], + "weighted_loads": [ + 0.7376818899065256, + 0.5106963682919741, + 0.24803373403847218, + 0.230065006762743, + 0.4733638297766447, + 0.31176505610346794, + 1.1695994064211845, + 0.28718719258904457, + 0.6021758522838354, + 0.6942062359303236, + 0.06341992504894733, + 0.308102298527956, + 0.3373417295515537, + 0.9318478796631098, + 0.08707133866846561, + 0.15178734436631203, + 0.6261376142501831, + 1.0881054010242224, + 0.20335815101861954, + 0.5120915398001671, + 0.6220426186919212, + 0.3522287495434284, + 0.0880697350949049, + 0.3725781310349703, + 2.370087757706642, + 0.9235872179269791, + 0.19404736906290054, + 0.5887964684516191, + 0.08142300695180893, + 0.31296055018901825, + 0.13047777116298676, + 1.1836329847574234, + 1.3231964968144894, + 0.5022417679429054, + 0.22274376638233662, + 0.5294265560805798, + 0.021968834102153778, + 0.8611103594303131, + 0.34284781478345394, + 0.27936137840151787, + 1.601122196763754, + 0.5591133255511522, + 0.29991246946156025, + 0.3319750390946865, + 0.25672521628439426, + 0.3511130213737488, + 0.527089761570096, + 0.17680756375193596, + 0.1440073549747467, + 0.3059546612203121, + 0.36914717592298985, + 0.7673599496483803, + 0.5367606729269028, + 0.2728826403617859, + 0.0, + 1.5587232299149036, + 0.3035975247621536, + 0.5106095597147942, + 0.3764371797442436, + 0.429188409820199, + 0.9095717761665583, + 0.09998024255037308, + 1.535456484183669, + 0.3305085562169552 + ], + "unique_experts": 63, + "load_cv": 0.5186654700641976, + "normalized_load_entropy": 0.9644178273540387, + "max_load_share": 0.037037037037037035 + }, + "full_input": { + "tokens": 133, + "top_k": 6, + "decisions": 798, + "ordered_route_sha256": "0d7bc5251162fa76fc6ec139551090a7602799af44bc64694972a53fd6e1aa47", + "route_weight_sha256": "439f754d7fd98bb0ccf339fc766bc6eb9ccb3ed736a1e0c556e0b14301aa0f7d", + "loads": [ + 14, + 14, + 8, + 7, + 9, + 3, + 19, + 14, + 32, + 14, + 4, + 9, + 12, + 14, + 4, + 13, + 17, + 22, + 7, + 13, + 10, + 10, + 5, + 14, + 24, + 17, + 19, + 10, + 3, + 6, + 6, + 17, + 19, + 14, + 7, + 16, + 1, + 12, + 11, + 7, + 20, + 24, + 6, + 17, + 10, + 17, + 17, + 8, + 5, + 9, + 12, + 8, + 18, + 7, + 3, + 18, + 12, + 19, + 11, + 23, + 20, + 6, + 18, + 13 + ], + "weighted_loads": [ + 0.813970984891057, + 0.5106963682919741, + 0.35043017752468586, + 0.2929729577153921, + 0.5251690316945314, + 0.31176505610346794, + 1.3403921537101269, + 0.5549651496112347, + 1.4942691922187805, + 0.7156635727733374, + 0.2165143582969904, + 0.308102298527956, + 0.3373417295515537, + 0.9318478796631098, + 0.11297501064836979, + 0.7688336223363876, + 0.6261376142501831, + 1.214146701619029, + 0.20335815101861954, + 0.5120915398001671, + 1.0171558037400246, + 0.3761836662888527, + 0.11821269243955612, + 0.3725781310349703, + 2.370087757706642, + 1.0706305913627148, + 1.003713458776474, + 0.661539101973176, + 0.08142300695180893, + 0.31296055018901825, + 0.13047777116298676, + 1.587184713978786, + 1.4636932760477066, + 0.9356812611222267, + 0.22274376638233662, + 0.5294265560805798, + 0.021968834102153778, + 0.8611103594303131, + 0.3686699829995632, + 0.4915859140455723, + 1.601122196763754, + 0.9709417391568422, + 0.29991246946156025, + 0.46412193949799985, + 1.241095745936036, + 1.170902973448392, + 0.527089761570096, + 0.23061508499085903, + 0.1440073549747467, + 0.3059546612203121, + 0.3949454855173826, + 0.7679637996479869, + 0.7737175934016705, + 0.29740336537361145, + 0.045380675146589056, + 2.1340500004589558, + 0.6205517500638962, + 0.9193077310919762, + 0.3764371797442436, + 1.1462093126028776, + 1.0004503298550844, + 0.2677612900733948, + 1.535456484183669, + 0.3305085562169552 + ], + "unique_experts": 64, + "load_cv": 0.49883501947630493, + "normalized_load_entropy": 0.9688809256842, + "max_load_share": 0.040100250626566414 + } + }, + "s1_eos": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "0c4cf8b115df7f5b651dedcecdcf59452f7d42e0028374fa6fdd2284553c8604", + "route_weight_sha256": "babce9d52167baf1587d6044395dc3bfcda64d6e983ebb251a86b82796b8b18a", + "loads": [ + 14, + 12, + 6, + 6, + 7, + 3, + 18, + 13, + 9, + 14, + 2, + 8, + 14, + 14, + 1, + 4, + 11, + 18, + 6, + 12, + 8, + 9, + 5, + 14, + 24, + 13, + 5, + 9, + 3, + 7, + 8, + 12, + 17, + 16, + 7, + 15, + 2, + 12, + 15, + 4, + 20, + 13, + 7, + 10, + 9, + 5, + 20, + 5, + 3, + 9, + 15, + 8, + 15, + 6, + 0, + 14, + 10, + 12, + 11, + 8, + 19, + 1, + 19, + 12 + ], + "weighted_loads": [ + 0.7916612774133682, + 0.4382767900824547, + 0.24684900790452957, + 0.25820067152380943, + 0.45862142741680145, + 0.30784842371940613, + 1.2620135508477688, + 0.31851369701325893, + 0.4326656609773636, + 0.7114685326814651, + 0.06037699244916439, + 0.2853191774338484, + 0.38890052400529385, + 0.9107021428644657, + 0.04264787584543228, + 0.1580962911248207, + 0.489853935316205, + 1.0149076972156763, + 0.1759882215410471, + 0.4766181744635105, + 0.6625580582767725, + 0.35488651879131794, + 0.11597555130720139, + 0.3755803909152746, + 2.4677407033741474, + 0.9088134355843067, + 0.17603198997676373, + 0.5694697555154562, + 0.08005533739924431, + 0.34388154558837414, + 0.1774937678128481, + 1.1768411546945572, + 1.3247958421707153, + 0.6976988781243563, + 0.22519681230187416, + 0.4917347654700279, + 0.04515328072011471, + 0.8139777760952711, + 0.46450124867260456, + 0.2832316495478153, + 1.5390023812651634, + 0.5081033278256655, + 0.2972857113927603, + 0.30206166580319405, + 0.2569110170006752, + 0.3102636784315109, + 0.5971028283238411, + 0.1544063575565815, + 0.09782588295638561, + 0.2933734245598316, + 0.5501233469694853, + 0.7662775162607431, + 0.5802945606410503, + 0.27524158731102943, + 0.0, + 1.601548109203577, + 0.3345796260982752, + 0.4789912588894367, + 0.37523860670626163, + 0.3178317155689001, + 0.9163031820207834, + 0.0752500593662262, + 1.5963912103325129, + 0.3104212488979101 + ], + "unique_experts": 63, + "load_cv": 0.5314381049390342, + "normalized_load_entropy": 0.9622105249824571, + "max_load_share": 0.037037037037037035 + }, + "full_input": { + "tokens": 149, + "top_k": 6, + "decisions": 894, + "ordered_route_sha256": "70ec932a59324af26d9f1d237e6d69af041cd355a9f158062349dd61bb5264a4", + "route_weight_sha256": "b3f9eaab97e71a6fa0459a2bebda3f4a49a657c48dbac3c27e1dddf8f7b0abd1", + "loads": [ + 17, + 12, + 9, + 8, + 12, + 5, + 20, + 16, + 32, + 15, + 7, + 9, + 14, + 15, + 1, + 16, + 11, + 24, + 7, + 13, + 11, + 12, + 10, + 15, + 26, + 18, + 24, + 11, + 3, + 9, + 9, + 19, + 19, + 18, + 7, + 15, + 3, + 13, + 15, + 9, + 20, + 25, + 11, + 17, + 11, + 16, + 20, + 10, + 5, + 9, + 23, + 12, + 20, + 6, + 5, + 18, + 20, + 23, + 13, + 19, + 21, + 6, + 19, + 16 + ], + "weighted_loads": [ + 0.9850502274930477, + 0.4382767900824547, + 0.4126119688153267, + 0.3225409612059593, + 0.7490570619702339, + 0.4451366066932678, + 1.414736058562994, + 0.5558829214423895, + 1.731074882671237, + 0.7326345965266228, + 0.4028219524770975, + 0.4321497958153486, + 0.38890052400529385, + 0.9506678283214569, + 0.04264787584543228, + 0.8622342385351658, + 0.489853935316205, + 1.2717057894915342, + 0.21503796614706516, + 0.5426867716014385, + 1.0196512956172228, + 0.5838943738490343, + 0.3871178424160462, + 0.4099206458777189, + 2.5395730659365654, + 1.082357969135046, + 1.453433958813548, + 0.6642662305384874, + 0.08005533739924431, + 0.5061623062938452, + 0.26345513947308064, + 1.8076548985263798, + 1.4534495808184147, + 1.0953510869294405, + 0.22519681230187416, + 0.4917347654700279, + 0.3040688540786505, + 0.8475985582917929, + 0.46450124867260456, + 0.6147578209638596, + 1.5390023812651634, + 1.0817452855408192, + 0.5306494534015656, + 0.5222562123090029, + 1.3980001136660576, + 1.0781098405714147, + 0.5971028283238411, + 0.290270908648381, + 0.2490694597363472, + 0.2933734245598316, + 0.9015751555562019, + 1.1312030088156462, + 0.8845809027552605, + 0.27524158731102943, + 0.09389883221592754, + 2.1601281873881817, + 0.8045476339757442, + 1.1189997140318155, + 0.45040648244321346, + 0.9896387811750174, + 1.0320898666977882, + 0.3332054279744625, + 1.5963912103325129, + 0.8027335535734892 + ], + "unique_experts": 64, + "load_cv": 0.4543480413694715, + "normalized_load_entropy": 0.9735437227847996, + "max_load_share": 0.035794183445190156 + } + }, + "s0_bos": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "10fcc2fb685672b6a5b1e46722f09367d9fed77377867bcbf971a1acbd964dfd", + "route_weight_sha256": "ef7614e1074b50907322be9f95e7d49fd746591c0801a31c59e48c70b1b79c6b", + "loads": [ + 13, + 13, + 7, + 5, + 7, + 3, + 18, + 18, + 7, + 14, + 7, + 12, + 9, + 13, + 7, + 3, + 9, + 18, + 9, + 15, + 7, + 4, + 2, + 16, + 24, + 12, + 5, + 9, + 2, + 13, + 11, + 12, + 17, + 9, + 7, + 14, + 2, + 12, + 11, + 4, + 21, + 13, + 8, + 9, + 16, + 5, + 9, + 10, + 4, + 6, + 15, + 7, + 16, + 6, + 3, + 14, + 9, + 12, + 10, + 9, + 19, + 3, + 17, + 7 + ], + "weighted_loads": [ + 0.7669449057430029, + 0.4906553216278553, + 0.27552227303385735, + 0.22849581576883793, + 0.44422445446252823, + 0.26620132103562355, + 1.2116106003522873, + 0.4390151984989643, + 0.2505482491105795, + 0.7494246829301119, + 0.18792074546217918, + 0.3802557084709406, + 0.2794972248375416, + 0.9465020038187504, + 0.2016358468681574, + 0.1446176953613758, + 0.4268259797245264, + 1.0419397875666618, + 0.2629998866468668, + 0.5478577669709921, + 0.5664760004729033, + 0.22780787199735641, + 0.057719215750694275, + 0.4304415136575699, + 2.163079794496298, + 0.9271392859518528, + 0.1741704810410738, + 0.5786319747567177, + 0.05725550465285778, + 0.5097885262221098, + 0.24708444438874722, + 1.2220570221543312, + 1.2845017053186893, + 0.35943716019392014, + 0.24048138968646526, + 0.44648827612400055, + 0.042222362011671066, + 0.8877750728279352, + 0.38026648946106434, + 0.2659647613763809, + 1.5611046757549047, + 0.4878793638199568, + 0.3408365771174431, + 0.28871819004416466, + 0.4506302084773779, + 0.30327488109469414, + 0.3225081618875265, + 0.2729261592030525, + 0.11946018412709236, + 0.23175420798361301, + 0.4970416035503149, + 0.7616507038474083, + 0.602510217577219, + 0.2687290124595165, + 0.07773595117032528, + 1.4804556146264076, + 0.35895552299916744, + 0.5000019669532776, + 0.3551343847066164, + 0.37409971840679646, + 0.9008197225630283, + 0.12262952141463757, + 1.5075929425656796, + 0.18268879130482674 + ], + "unique_experts": 64, + "load_cv": 0.5025464799271018, + "normalized_load_entropy": 0.9684417196671277, + "max_load_share": 0.037037037037037035 + }, + "full_input": { + "tokens": 133, + "top_k": 6, + "decisions": 798, + "ordered_route_sha256": "0bebba97d7679959b99effd23dfa03fb8f3a105c162e840d7c595ae498852387", + "route_weight_sha256": "bbd8cf8db8ee6552d3d9f75e45a7052b8be94fafbabde14f5aff4f13a4fa2721", + "loads": [ + 15, + 13, + 9, + 6, + 9, + 3, + 20, + 20, + 22, + 15, + 10, + 14, + 9, + 13, + 8, + 12, + 9, + 21, + 9, + 16, + 10, + 4, + 3, + 16, + 24, + 16, + 18, + 10, + 2, + 13, + 11, + 16, + 19, + 11, + 7, + 14, + 2, + 12, + 12, + 7, + 21, + 23, + 10, + 15, + 16, + 15, + 10, + 12, + 4, + 6, + 16, + 7, + 20, + 6, + 5, + 18, + 13, + 20, + 10, + 19, + 21, + 7, + 17, + 7 + ], + "weighted_loads": [ + 0.8825485669076443, + 0.4906553216278553, + 0.3608265407383442, + 0.2620295565575361, + 0.49602965638041496, + 0.26620132103562355, + 1.3795795254409313, + 0.6986408419907093, + 1.06746725179255, + 0.772157333791256, + 0.3710838742554188, + 0.432301664724946, + 0.2794972248375416, + 0.9465020038187504, + 0.230238176882267, + 0.7616639733314514, + 0.4268259797245264, + 1.2043900787830353, + 0.2629998866468668, + 0.572081733494997, + 0.904033837839961, + 0.22780787199735641, + 0.0878621730953455, + 0.4304415136575699, + 2.163079794496298, + 1.079987896606326, + 0.9824906513094902, + 0.6409523077309132, + 0.05725550465285778, + 0.5097885262221098, + 0.24708444438874722, + 1.6252390667796135, + 1.4221553206443787, + 0.7526497021317482, + 0.24048138968646526, + 0.44648827612400055, + 0.042222362011671066, + 0.8877750728279352, + 0.40665291994810104, + 0.483940701931715, + 1.5611046757549047, + 0.8997077774256468, + 0.410147113725543, + 0.4457491934299469, + 0.4506302084773779, + 1.1225655861198902, + 0.3486012667417526, + 0.32516026124358177, + 0.11946018412709236, + 0.23175420798361301, + 0.5228399131447077, + 0.7616507038474083, + 0.8266340270638466, + 0.2687290124595165, + 0.1226661317050457, + 2.0476638674736023, + 0.700062507763505, + 0.9835381396114826, + 0.3551343847066164, + 1.0577768925577402, + 1.096434760838747, + 0.28990461118519306, + 1.5075929425656796, + 0.18268879130482674 + ], + "unique_experts": 64, + "load_cv": 0.4536756236261113, + "normalized_load_entropy": 0.9732111260097541, + "max_load_share": 0.03007518796992481 + } + }, + "s1_bos": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "159dc2037022c7fff67ea992e6a656c2eea5911dd464c1a7c0a409f125bd6237", + "route_weight_sha256": "6b93c561884a0db1f369c0401ad15007ddb550a0bf6196214c5f90abd9b4bc96", + "loads": [ + 13, + 14, + 7, + 6, + 7, + 3, + 17, + 16, + 7, + 16, + 5, + 10, + 8, + 14, + 4, + 3, + 8, + 18, + 10, + 14, + 7, + 6, + 3, + 14, + 24, + 12, + 10, + 10, + 3, + 14, + 12, + 12, + 17, + 10, + 7, + 14, + 1, + 12, + 9, + 4, + 20, + 14, + 9, + 6, + 17, + 5, + 9, + 10, + 3, + 7, + 15, + 7, + 16, + 4, + 7, + 14, + 8, + 12, + 9, + 5, + 19, + 4, + 17, + 10 + ], + "weighted_loads": [ + 0.7785535752773285, + 0.5197880566120148, + 0.2764696963131428, + 0.2789611015468836, + 0.44619596377015114, + 0.27910325303673744, + 1.0697463024407625, + 0.3941470328718424, + 0.260442765429616, + 0.7815265227109194, + 0.14480961486697197, + 0.3329816199839115, + 0.2322122696787119, + 0.9806978553533554, + 0.11257646605372429, + 0.1445303037762642, + 0.41209000535309315, + 0.9863047301769257, + 0.28754741325974464, + 0.5399922598153353, + 0.5826046895235777, + 0.2739405445754528, + 0.06744314543902874, + 0.3791894447058439, + 2.136683154851198, + 0.9406912103295326, + 0.32036872766911983, + 0.5878070946782827, + 0.08287650533020496, + 0.5356867406517267, + 0.27995415776968, + 1.189015693962574, + 1.1758664026856422, + 0.3978697769343853, + 0.2409948743879795, + 0.43536226265132427, + 0.02370414137840271, + 0.8295439798384905, + 0.3263820242136717, + 0.26383161544799805, + 1.4479492846876383, + 0.5503809545189142, + 0.35764275677502155, + 0.20280206017196178, + 0.5004772916436195, + 0.3113485649228096, + 0.32173751294612885, + 0.2800609730184078, + 0.10271397978067398, + 0.24536040797829628, + 0.6334716472774744, + 0.7535881474614143, + 0.6384048108011484, + 0.2092888168990612, + 0.17916408367455006, + 1.4702058769762516, + 0.3011663667857647, + 0.4735417850315571, + 0.3037747945636511, + 0.2677233424037695, + 0.9254219811409712, + 0.14499493315815926, + 1.5349805690348148, + 0.2508184313774109 + ], + "unique_experts": 64, + "load_cv": 0.49490622846487514, + "normalized_load_entropy": 0.9693418187005435, + "max_load_share": 0.037037037037037035 + }, + "full_input": { + "tokens": 149, + "top_k": 6, + "decisions": 894, + "ordered_route_sha256": "72619ad7e9e2170e88cd1c84aa76fd0143eaf89dbc782b2ac8a1dfe22eb6df96", + "route_weight_sha256": "13a04845c3f5737cd7b4a3aea5defbaaaeb0ed708c041612240220d9f2c73858", + "loads": [ + 17, + 14, + 10, + 9, + 12, + 5, + 19, + 19, + 28, + 17, + 10, + 11, + 8, + 16, + 4, + 15, + 8, + 24, + 11, + 16, + 10, + 8, + 7, + 15, + 26, + 17, + 29, + 12, + 3, + 16, + 13, + 18, + 19, + 12, + 8, + 14, + 2, + 13, + 9, + 8, + 20, + 26, + 14, + 13, + 18, + 15, + 10, + 14, + 5, + 7, + 23, + 11, + 21, + 4, + 11, + 18, + 18, + 25, + 11, + 15, + 22, + 10, + 17, + 14 + ], + "weighted_loads": [ + 1.010555513203144, + 0.5197880566120148, + 0.4285741150379181, + 0.3709531780332327, + 0.7366315983235836, + 0.41639143601059914, + 1.2110039088875055, + 0.6222768519073725, + 1.481939049437642, + 0.8032954130321741, + 0.49861039221286774, + 0.47981223836541176, + 0.2322122696787119, + 1.044848971068859, + 0.11257646605372429, + 0.8486682511866093, + 0.41209000535309315, + 1.2434123158454895, + 0.3265971578657627, + 0.6303201504051685, + 0.8762798812240362, + 0.4785173796117306, + 0.3382766395807266, + 0.41352969966828823, + 2.208515517413616, + 1.1230433527380228, + 1.5955894198268652, + 0.6799694579094648, + 0.08287650533020496, + 0.6979675013571978, + 0.36591552942991257, + 1.820520356297493, + 1.2974087558686733, + 0.7374452613294125, + 0.26399639435112476, + 0.43536226265132427, + 0.2826197147369385, + 0.8631647620350122, + 0.3263820242136717, + 0.5633779615163803, + 1.4479492846876383, + 1.124022912234068, + 0.6280125733464956, + 0.42231511138379574, + 0.6525294110178947, + 1.0787303894758224, + 0.3518607076257467, + 0.41581980139017105, + 0.25395755656063557, + 0.24536040797829628, + 0.9874173570424318, + 1.1185136400163174, + 0.9278574306517839, + 0.2092888168990612, + 0.2726415451616049, + 2.011877041310072, + 0.787508575245738, + 1.214045101776719, + 0.3789426703006029, + 0.9048799257725477, + 1.143547784537077, + 0.4419896062463522, + 1.5349805690348148, + 0.74313073605299 + ], + "unique_experts": 64, + "load_cv": 0.44256304438586436, + "normalized_load_entropy": 0.9755223295556938, + "max_load_share": 0.03243847874720358 + } + }, + "s0_x": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "760d9ca4f8a438e1dc9d6d356b4731d42f986dc45b0212eeebdab64e21b22451", + "route_weight_sha256": "9b68e87d1b91c6fe5d476de6eb8c91523d32f67df9d97b50713d91b8cb2d59da", + "loads": [ + 14, + 12, + 6, + 5, + 7, + 3, + 18, + 11, + 7, + 13, + 6, + 7, + 10, + 14, + 7, + 3, + 11, + 19, + 10, + 18, + 7, + 7, + 2, + 17, + 24, + 12, + 6, + 9, + 3, + 7, + 11, + 12, + 17, + 11, + 7, + 15, + 1, + 12, + 10, + 4, + 20, + 14, + 14, + 12, + 14, + 5, + 9, + 8, + 3, + 5, + 15, + 7, + 15, + 5, + 5, + 14, + 8, + 12, + 12, + 8, + 19, + 2, + 16, + 11 + ], + "weighted_loads": [ + 0.8015655223280191, + 0.4643168933689594, + 0.24474303796887398, + 0.22352052852511406, + 0.45222536846995354, + 0.30050645396113396, + 1.2423491552472115, + 0.27177249640226364, + 0.25992164574563503, + 0.726778369396925, + 0.16245277039706707, + 0.2528508026152849, + 0.3022538051009178, + 0.9758367035537958, + 0.204477371647954, + 0.13976752012968063, + 0.47132827155292034, + 1.033742967993021, + 0.27863762341439724, + 0.6200787425041199, + 0.5470940545201302, + 0.2942786067724228, + 0.0557462964206934, + 0.4616063106805086, + 2.2399702072143555, + 0.9226423539221287, + 0.20073376968502998, + 0.5771434046328068, + 0.08068969286978245, + 0.35133820958435535, + 0.24951179139316082, + 1.2776948511600494, + 1.3402025811374187, + 0.45088598132133484, + 0.23300142399966717, + 0.47607053257524967, + 0.02229493111371994, + 0.9070043601095676, + 0.3464524671435356, + 0.26636379584670067, + 1.5944210700690746, + 0.5152342710644007, + 0.4811994358897209, + 0.36612499319016933, + 0.3870632126927376, + 0.2887974753975868, + 0.32886586897075176, + 0.22049515880644321, + 0.09940597228705883, + 0.20643210038542747, + 0.4945713300257921, + 0.7626095451414585, + 0.558513805270195, + 0.23545273579657078, + 0.12078039906919003, + 1.4955362901091576, + 0.31051772460341454, + 0.5101226381957531, + 0.4050104934722185, + 0.35450069420039654, + 0.8992945998907089, + 0.09739897772669792, + 1.4923438057303429, + 0.2866547293961048 + ], + "unique_experts": 64, + "load_cv": 0.5001142987784961, + "normalized_load_entropy": 0.9683427808014855, + "max_load_share": 0.037037037037037035 + }, + "full_input": { + "tokens": 133, + "top_k": 6, + "decisions": 798, + "ordered_route_sha256": "f671acf571f2618e04af0c7d7388ffe56bb4cee4c108e269a5764dd30744e0d1", + "route_weight_sha256": "aae639c825cee2f4d955bc6a5823c01253bbaf51386f27a32ccccb3cd52274cb", + "loads": [ + 15, + 12, + 8, + 6, + 9, + 3, + 20, + 14, + 22, + 15, + 8, + 8, + 10, + 14, + 8, + 13, + 11, + 21, + 10, + 19, + 10, + 7, + 4, + 19, + 24, + 16, + 20, + 10, + 3, + 7, + 11, + 16, + 19, + 13, + 7, + 15, + 1, + 12, + 10, + 7, + 20, + 25, + 15, + 18, + 14, + 16, + 9, + 10, + 3, + 5, + 16, + 7, + 19, + 5, + 7, + 18, + 11, + 19, + 12, + 19, + 20, + 6, + 16, + 11 + ], + "weighted_loads": [ + 0.893592806532979, + 0.4643168933689594, + 0.3391707241535187, + 0.2564922757446766, + 0.5040305703878403, + 0.30050645396113396, + 1.4111617915332317, + 0.5706345699727535, + 1.0803657453507185, + 0.7758326474577188, + 0.32026289217174053, + 0.2764217294752598, + 0.3022538051009178, + 0.9758367035537958, + 0.2332403864711523, + 0.8736596517264843, + 0.47132827155292034, + 1.1578625217080116, + 0.27863762341439724, + 0.6444666888564825, + 0.8787847831845284, + 0.2942786067724228, + 0.11674738861620426, + 0.5123125109821558, + 2.2399702072143555, + 1.0797586012631655, + 1.0398605652153492, + 0.643402423709631, + 0.08068969286978245, + 0.35133820958435535, + 0.24951179139316082, + 1.6824266165494919, + 1.4793535098433495, + 0.8572956323623657, + 0.23300142399966717, + 0.47607053257524967, + 0.02229493111371994, + 0.9070043601095676, + 0.3464524671435356, + 0.5068676806986332, + 1.5944210700690746, + 0.9829155746847391, + 0.5089255422353745, + 0.5276354681700468, + 0.3870632126927376, + 1.141674231737852, + 0.32886586897075176, + 0.27303529530763626, + 0.09940597228705883, + 0.20643210038542747, + 0.5203696396201849, + 0.7626095451414585, + 0.7674585692584515, + 0.23545273579657078, + 0.16571057960391045, + 2.083993174135685, + 0.5024792961776257, + 0.9079373925924301, + 0.4050104934722185, + 1.136780058965087, + 0.9901731535792351, + 0.26292671635746956, + 1.4923438057303429, + 0.2866547293961048 + ], + "unique_experts": 64, + "load_cv": 0.4583041026282263, + "normalized_load_entropy": 0.9727870418524768, + "max_load_share": 0.03132832080200501 + } + }, + "s1_x": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "0f2427d2a8c3928a7222a7398046ff386f165fa02d420d4fb47efabc7765f127", + "route_weight_sha256": "897d133d2a8bf430b9d377d43034c9a4c13695758b8d51a62f4dab5855920c70", + "loads": [ + 13, + 14, + 6, + 7, + 7, + 3, + 16, + 15, + 7, + 16, + 3, + 7, + 10, + 14, + 3, + 3, + 8, + 18, + 9, + 16, + 8, + 9, + 4, + 15, + 24, + 12, + 12, + 10, + 5, + 9, + 11, + 12, + 17, + 10, + 7, + 13, + 1, + 12, + 9, + 4, + 21, + 14, + 12, + 7, + 18, + 5, + 10, + 8, + 3, + 6, + 15, + 7, + 16, + 5, + 7, + 14, + 7, + 12, + 10, + 6, + 19, + 1, + 16, + 10 + ], + "weighted_loads": [ + 0.7815328426659107, + 0.5240094624459743, + 0.24478560499846935, + 0.29235650040209293, + 0.4542854707688093, + 0.2934872843325138, + 1.0185506846755743, + 0.37055609188973904, + 0.2605790924280882, + 0.7797080483287573, + 0.09654849767684937, + 0.25195940770208836, + 0.28195524401962757, + 1.003170559182763, + 0.09211415611207485, + 0.14111431315541267, + 0.4117540158331394, + 0.9524763990193605, + 0.2624086830765009, + 0.5901197195053101, + 0.5919248983263969, + 0.3450212702155113, + 0.09904976934194565, + 0.408029118552804, + 2.127367328852415, + 0.9405515231192112, + 0.38157088309526443, + 0.5930233802646399, + 0.13072510994970798, + 0.40196436643600464, + 0.25458998419344425, + 1.2184954732656479, + 1.1710529178380966, + 0.4000451397150755, + 0.23553872294723988, + 0.41746472753584385, + 0.02295825630426407, + 0.8375471159815788, + 0.3201772551983595, + 0.26313644647598267, + 1.5488177314400673, + 0.5535205062478781, + 0.42478765547275543, + 0.23241502046585083, + 0.5264924671500921, + 0.3069208934903145, + 0.3479766510426998, + 0.23159678280353546, + 0.10317249968647957, + 0.2190578579902649, + 0.6440718360245228, + 0.7539434805512428, + 0.627085093408823, + 0.23536813259124756, + 0.18550420925021172, + 1.4810238033533096, + 0.2583041489124298, + 0.48591921851038933, + 0.3307388164103031, + 0.291990177705884, + 0.9363447707146406, + 0.07335056364536285, + 1.5132354609668255, + 0.2565096579492092 + ], + "unique_experts": 64, + "load_cv": 0.49919917578162293, + "normalized_load_entropy": 0.9683119295568041, + "max_load_share": 0.037037037037037035 + }, + "full_input": { + "tokens": 149, + "top_k": 6, + "decisions": 894, + "ordered_route_sha256": "74fddbdd631f0f1c98a95f334859557d9f279c67cf0b1fe61590c92436f5d4cd", + "route_weight_sha256": "b6cb4dec42634232f3a5e645e6774cd26b7d915dcd41506f19b4cc4ed9e6b77f", + "loads": [ + 16, + 14, + 9, + 9, + 12, + 5, + 18, + 19, + 28, + 18, + 8, + 8, + 10, + 16, + 3, + 16, + 8, + 24, + 10, + 18, + 11, + 11, + 8, + 17, + 26, + 17, + 32, + 12, + 5, + 11, + 12, + 18, + 19, + 12, + 7, + 13, + 2, + 13, + 9, + 8, + 21, + 27, + 16, + 14, + 19, + 16, + 11, + 12, + 6, + 6, + 23, + 11, + 21, + 5, + 11, + 18, + 16, + 23, + 12, + 17, + 21, + 6, + 16, + 14 + ], + "weighted_loads": [ + 0.9877345189452171, + 0.5240094624459743, + 0.40431015379726887, + 0.3519966918975115, + 0.7447211053222418, + 0.4307754673063755, + 1.1597180869430304, + 0.6361757814884186, + 1.4824367482215166, + 0.8261174745857716, + 0.4511971212923527, + 0.3987900260835886, + 0.28195524401962757, + 1.069044353440404, + 0.09211415611207485, + 0.9563184380531311, + 0.4117540158331394, + 1.2072925921529531, + 0.30145842768251896, + 0.6806517839431763, + 0.8839640691876411, + 0.5495981052517891, + 0.36988326348364353, + 0.46875608153641224, + 2.199199691414833, + 1.1273675858974457, + 1.6953521482646465, + 0.6866101790219545, + 0.13072510994970798, + 0.5642451271414757, + 0.3405513558536768, + 1.8511194288730621, + 1.292383637279272, + 0.7415740471333265, + 0.23553872294723988, + 0.41746472753584385, + 0.28187382966279984, + 0.8711678981781006, + 0.3201772551983595, + 0.5810287222266197, + 1.5488177314400673, + 1.1936639919877052, + 0.6594319809228182, + 0.4518741276115179, + 0.6785445865243673, + 1.1089755669236183, + 0.3817092068493366, + 0.36746799387037754, + 0.27608214505016804, + 0.2190578579902649, + 0.9978801626712084, + 1.1188689731061459, + 0.9031551443040371, + 0.23536813259124756, + 0.27898167073726654, + 2.0344695150852203, + 0.6160857323557138, + 1.1187394671142101, + 0.40590669214725494, + 1.0233617965131998, + 1.0521314553916454, + 0.3425218276679516, + 1.5132354609668255, + 0.7488219626247883 + ], + "unique_experts": 64, + "load_cv": 0.4534659611988065, + "normalized_load_entropy": 0.9747609707959954, + "max_load_share": 0.035794183445190156 + } + }, + "s0_period": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "f24482e624ae47126f6591d284d8261899232f497d3acd43ba62fa962614140c", + "route_weight_sha256": "25e4b2ee57b5267cf5717f15225fb48d689a38fe033c4ef8518b0ea0126e7198", + "loads": [ + 14, + 12, + 6, + 5, + 7, + 3, + 18, + 11, + 6, + 13, + 8, + 6, + 10, + 14, + 6, + 4, + 10, + 19, + 10, + 17, + 7, + 7, + 2, + 17, + 24, + 12, + 6, + 9, + 3, + 7, + 11, + 12, + 17, + 11, + 7, + 15, + 1, + 12, + 10, + 4, + 20, + 14, + 13, + 12, + 15, + 5, + 9, + 8, + 3, + 5, + 15, + 7, + 15, + 6, + 5, + 14, + 8, + 12, + 12, + 8, + 19, + 3, + 16, + 11 + ], + "weighted_loads": [ + 0.7994848936796188, + 0.46494388952851295, + 0.24495321698486805, + 0.22619259543716908, + 0.44568759948015213, + 0.2999451160430908, + 1.2368245348334312, + 0.27278631180524826, + 0.2317204475402832, + 0.7278506848961115, + 0.2103770524263382, + 0.21892309375107288, + 0.30056558549404144, + 0.9732240419834852, + 0.17859007976949215, + 0.16672217473387718, + 0.45068765990436077, + 1.0267790742218494, + 0.2804006766527891, + 0.5976788382977247, + 0.5431319922208786, + 0.295601774007082, + 0.056068792939186096, + 0.4619067646563053, + 2.2483450025320053, + 0.9240524768829346, + 0.19981068186461926, + 0.5767708830535412, + 0.08095278404653072, + 0.35228666476905346, + 0.2492650207132101, + 1.2975343242287636, + 1.3288098759949207, + 0.4481785427778959, + 0.23284448496997356, + 0.4765123538672924, + 0.022528357803821564, + 0.9071776196360588, + 0.34800698421895504, + 0.2662731893360615, + 1.6019991897046566, + 0.5192894544452429, + 0.4567065741866827, + 0.36645673774182796, + 0.4141791220754385, + 0.29377357847988605, + 0.32990256138145924, + 0.22153430618345737, + 0.09912729635834694, + 0.20640068873763084, + 0.49457605741918087, + 0.7582322619855404, + 0.5582226943224669, + 0.26256426237523556, + 0.11871899478137493, + 1.4945519305765629, + 0.3123738653957844, + 0.5082840658724308, + 0.4028162285685539, + 0.3534649480134249, + 0.8999735563993454, + 0.12203419767320156, + 1.491329099982977, + 0.2864479199051857 + ], + "unique_experts": 64, + "load_cv": 0.4936728153859804, + "normalized_load_entropy": 0.9694584906659811, + "max_load_share": 0.037037037037037035 + }, + "full_input": { + "tokens": 133, + "top_k": 6, + "decisions": 798, + "ordered_route_sha256": "2fc2bf713e51e65ac98ef3ff20864ed2bc6a5aedefb357a69be36f5363e392e6", + "route_weight_sha256": "dfc4701262f360b72de97c36386c7ad4b7b318334ff91f61a6735bc895ebbea0", + "loads": [ + 15, + 12, + 8, + 6, + 10, + 3, + 20, + 13, + 21, + 15, + 11, + 8, + 10, + 14, + 7, + 13, + 10, + 21, + 10, + 18, + 10, + 7, + 3, + 18, + 24, + 16, + 19, + 10, + 3, + 7, + 11, + 16, + 19, + 13, + 7, + 16, + 1, + 12, + 10, + 7, + 20, + 24, + 14, + 19, + 15, + 15, + 9, + 10, + 5, + 5, + 16, + 8, + 19, + 6, + 7, + 18, + 11, + 18, + 12, + 19, + 20, + 7, + 16, + 11 + ], + "weighted_loads": [ + 0.8929465115070343, + 0.46494388952851295, + 0.33047534711658955, + 0.25904098711907864, + 0.6193823851644993, + 0.2999451160430908, + 1.4058732353150845, + 0.5241741389036179, + 1.028730908408761, + 0.7761372197419405, + 0.3922279868274927, + 0.3799591902643442, + 0.30056558549404144, + 0.9732240419834852, + 0.2072109617292881, + 0.7837684527039528, + 0.45068765990436077, + 1.1508089005947113, + 0.2804006766527891, + 0.6221026200801134, + 0.875689409673214, + 0.295601774007082, + 0.08621175028383732, + 0.48847645334899426, + 2.2483450025320053, + 1.0808099713176489, + 1.0091079622507095, + 0.6426031403243542, + 0.08095278404653072, + 0.35228666476905346, + 0.2492650207132101, + 1.7030643746256828, + 1.4677555337548256, + 0.8530554305762053, + 0.23284448496997356, + 0.49782013334333897, + 0.022528357803821564, + 0.9071776196360588, + 0.34800698421895504, + 0.48770565539598465, + 1.6019991897046566, + 0.9311178680509329, + 0.4844222739338875, + 0.5524969268590212, + 0.4141791220754385, + 1.1130642835050821, + 0.32990256138145924, + 0.2741791307926178, + 0.14415757730603218, + 0.20640068873763084, + 0.5203743670135736, + 0.8111441992223263, + 0.7805157247930765, + 0.26256426237523556, + 0.16364917531609535, + 2.0849020816385746, + 0.5046652033925056, + 0.8788781687617302, + 0.4028162285685539, + 1.0671976152807474, + 0.9908521100878716, + 0.28478115797042847, + 1.491329099982977, + 0.2864479199051857 + ], + "unique_experts": 64, + "load_cv": 0.44223339944314793, + "normalized_load_entropy": 0.9745820607108273, + "max_load_share": 0.03007518796992481 + } + }, + "s1_period": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "e935047515a002eb3c358cda95dd6ac4f5434b8a610a9ec767581269e63b8aff", + "route_weight_sha256": "8a14d5697812e774d5210f87ec0604f5590b767c5dd210fac1c9e064e6ec9a57", + "loads": [ + 13, + 14, + 6, + 6, + 7, + 3, + 17, + 15, + 7, + 16, + 3, + 6, + 10, + 14, + 3, + 4, + 8, + 18, + 10, + 16, + 7, + 9, + 4, + 15, + 24, + 12, + 12, + 10, + 5, + 9, + 10, + 12, + 17, + 9, + 7, + 15, + 1, + 12, + 9, + 5, + 21, + 14, + 12, + 7, + 17, + 5, + 10, + 8, + 3, + 6, + 15, + 7, + 16, + 4, + 7, + 14, + 7, + 12, + 10, + 6, + 19, + 1, + 17, + 10 + ], + "weighted_loads": [ + 0.7807184718549252, + 0.526227530092001, + 0.24609313160181046, + 0.2523595616221428, + 0.4490686431527138, + 0.29372521862387657, + 1.0524953417479992, + 0.371959226205945, + 0.2578332517296076, + 0.7792747560888529, + 0.0968780666589737, + 0.21957321278750896, + 0.2803050484508276, + 1.0051121730357409, + 0.09283753670752048, + 0.17041128687560558, + 0.41140202805399895, + 0.9435017891228199, + 0.28278040140867233, + 0.5919639598578215, + 0.5654673427343369, + 0.3454984165728092, + 0.09921220503747463, + 0.4077165648341179, + 2.1295975111424923, + 0.9400391429662704, + 0.381015345454216, + 0.5925399325788021, + 0.1308206431567669, + 0.4018911309540272, + 0.2328074797987938, + 1.2298887446522713, + 1.166613020002842, + 0.35116196796298027, + 0.23536819219589233, + 0.4664166085422039, + 0.02323341742157936, + 0.8373512178659439, + 0.3204633481800556, + 0.30905756726861, + 1.5537053607404232, + 0.5530281569808722, + 0.4250790048390627, + 0.23339332453906536, + 0.5025627668946981, + 0.3100094497203827, + 0.34880238957703114, + 0.23069087602198124, + 0.10335704497992992, + 0.219263456761837, + 0.6433522496372461, + 0.7506765946745872, + 0.6268898453563452, + 0.21142281778156757, + 0.18821628764271736, + 1.4830001816153526, + 0.26012324914336205, + 0.48605523258447647, + 0.33000832237303257, + 0.29088079556822777, + 0.9378532264381647, + 0.07315737754106522, + 1.5368770156055689, + 0.2557383179664612 + ], + "unique_experts": 64, + "load_cv": 0.5040606336442865, + "normalized_load_entropy": 0.9678802658037048, + "max_load_share": 0.037037037037037035 + }, + "full_input": { + "tokens": 149, + "top_k": 6, + "decisions": 894, + "ordered_route_sha256": "bbcc74f18c2bda950b124c2cc992f92a3f72496a1884f8442c2b48f493186067", + "route_weight_sha256": "451c46fa963827d603e1976c8a13c3e548ed9f8553a779bd07988b6d856e2eb1", + "loads": [ + 16, + 14, + 9, + 8, + 13, + 5, + 19, + 18, + 27, + 17, + 8, + 9, + 10, + 16, + 3, + 16, + 8, + 24, + 11, + 18, + 10, + 11, + 8, + 17, + 26, + 17, + 32, + 12, + 5, + 11, + 12, + 18, + 19, + 11, + 7, + 15, + 3, + 13, + 9, + 9, + 21, + 27, + 16, + 14, + 18, + 15, + 10, + 12, + 6, + 6, + 23, + 12, + 22, + 4, + 11, + 18, + 16, + 23, + 12, + 16, + 21, + 6, + 17, + 14 + ], + "weighted_loads": [ + 0.9871278926730156, + 0.526227530092001, + 0.39543491974473, + 0.31227969378232956, + 0.859917975962162, + 0.43101340159773827, + 1.1936789713799953, + 0.5876652095466852, + 1.4387500863522291, + 0.8008391782641411, + 0.4516388066112995, + 0.5338198971003294, + 0.2803050484508276, + 1.0725885946303606, + 0.09283753670752048, + 0.8745492342859507, + 0.41140202805399895, + 1.1985000893473625, + 0.3218301460146904, + 0.6825025733560324, + 0.8555597513914108, + 0.550075251609087, + 0.3700456991791725, + 0.46846530586481094, + 2.2014298737049103, + 1.1260420940816402, + 1.685348991304636, + 0.6851207427680492, + 0.1308206431567669, + 0.5641718916594982, + 0.33959587663412094, + 1.8629250302910805, + 1.2875236682593822, + 0.6915589831769466, + 0.23536819219589233, + 0.4664166085422039, + 0.3041497617959976, + 0.8709720000624657, + 0.3204633481800556, + 0.6077015735208988, + 1.5537053607404232, + 1.1619459837675095, + 0.6596100851893425, + 0.4527736734598875, + 0.6546148862689734, + 1.0773912742733955, + 0.34880238957703114, + 0.36659094505012035, + 0.2767986264079809, + 0.219263456761837, + 0.9973884727805853, + 1.1584477201104164, + 0.9374405890703201, + 0.21142281778156757, + 0.2816937491297722, + 2.0370022654533386, + 0.6214163471013308, + 1.1185125671327114, + 0.4051761981099844, + 0.928037378937006, + 1.0536399111151695, + 0.33743397891521454, + 1.5368770156055689, + 0.7480506226420403 + ], + "unique_experts": 64, + "load_cv": 0.4497423330070499, + "normalized_load_entropy": 0.9752366656016503, + "max_load_share": 0.035794183445190156 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 108, + "ordered_topk_exact_tokens": 53, + "set_exact_tokens": 66, + "mean_set_jaccard": 0.8833774250440917, + "mean_token_weighted_tv": 0.01670596636486826, + "aggregate_load_tv": 0.05401234567901235 + }, + "system_bos": { + "tokens": 108, + "ordered_topk_exact_tokens": 48, + "set_exact_tokens": 66, + "mean_set_jaccard": 0.882936507936508, + "mean_token_weighted_tv": 0.017885157286568924, + "aggregate_load_tv": 0.0478395061728395 + }, + "system_x": { + "tokens": 108, + "ordered_topk_exact_tokens": 49, + "set_exact_tokens": 61, + "mean_set_jaccard": 0.8657407407407407, + "mean_token_weighted_tv": 0.02108147873163775, + "aggregate_load_tv": 0.05709876543209877 + }, + "system_period": { + "tokens": 108, + "ordered_topk_exact_tokens": 51, + "set_exact_tokens": 61, + "mean_set_jaccard": 0.8697089947089948, + "mean_token_weighted_tv": 0.020678868810473768, + "aggregate_load_tv": 0.05555555555555555 + }, + "bos_at_s0": { + "tokens": 108, + "ordered_topk_exact_tokens": 36, + "set_exact_tokens": 46, + "mean_set_jaccard": 0.7901234567901235, + "mean_token_weighted_tv": 0.028818101510060607, + "aggregate_load_tv": 0.10185185185185185 + }, + "bos_at_s1": { + "tokens": 108, + "ordered_topk_exact_tokens": 35, + "set_exact_tokens": 43, + "mean_set_jaccard": 0.7936507936507936, + "mean_token_weighted_tv": 0.030234973524110736, + "aggregate_load_tv": 0.10185185185185186 + }, + "x_at_s0": { + "tokens": 108, + "ordered_topk_exact_tokens": 41, + "set_exact_tokens": 52, + "mean_set_jaccard": 0.8229717813051146, + "mean_token_weighted_tv": 0.02476486384316727, + "aggregate_load_tv": 0.08333333333333331 + }, + "x_at_s1": { + "tokens": 108, + "ordered_topk_exact_tokens": 32, + "set_exact_tokens": 43, + "mean_set_jaccard": 0.8046737213403882, + "mean_token_weighted_tv": 0.029385422356426716, + "aggregate_load_tv": 0.09259259259259259 + }, + "period_at_s0": { + "tokens": 108, + "ordered_topk_exact_tokens": 42, + "set_exact_tokens": 53, + "mean_set_jaccard": 0.8216490299823633, + "mean_token_weighted_tv": 0.02490050111103941, + "aggregate_load_tv": 0.08487654320987655 + }, + "period_at_s1": { + "tokens": 108, + "ordered_topk_exact_tokens": 34, + "set_exact_tokens": 45, + "mean_set_jaccard": 0.8143738977072311, + "mean_token_weighted_tv": 0.02850426205744346, + "aggregate_load_tv": 0.09104938271604937 + } + } + }, + "layer_02": { + "layer": 2, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "7329d50b5fa61d792951c57cda72fcf411002f41e3ae851141216ef32e08dc0e", + "route_weight_sha256": "6965ffdd4f615484e6fb64a07942bbdec54c88ff688d942354337507c83299bf", + "loads": [ + 5, + 16, + 7, + 12, + 3, + 3, + 13, + 6, + 12, + 7, + 8, + 5, + 2, + 9, + 8, + 9, + 10, + 7, + 8, + 6, + 12, + 7, + 16, + 11, + 7, + 13, + 11, + 20, + 11, + 16, + 12, + 16, + 8, + 11, + 10, + 17, + 17, + 18, + 18, + 10, + 8, + 12, + 15, + 1, + 7, + 8, + 7, + 22, + 8, + 6, + 19, + 4, + 8, + 7, + 9, + 9, + 2, + 16, + 17, + 16, + 8, + 5, + 12, + 5 + ], + "weighted_loads": [ + 0.5985029637813568, + 0.6710287481546402, + 0.24016651883721352, + 0.5263980515301228, + 0.08682337030768394, + 0.2263268381357193, + 0.5391488894820213, + 0.2297083791345358, + 0.7025315184146166, + 0.36523926816880703, + 0.19190730527043343, + 0.1739907432347536, + 0.09380299970507622, + 0.8937315177172422, + 0.4576984643936157, + 0.8127531222999096, + 0.36483181826770306, + 0.29403494484722614, + 0.5248845219612122, + 0.5574602074921131, + 0.32557753287255764, + 0.4283858947455883, + 1.9559774994850159, + 0.31007990427315235, + 0.24088630639016628, + 0.9450564105063677, + 1.3033359237015247, + 2.02223520539701, + 0.32145956158638, + 0.6032113991677761, + 1.018900852650404, + 0.6332514453679323, + 0.23887889459729195, + 1.1247071344405413, + 0.8095686621963978, + 1.1901332940906286, + 0.8696706332266331, + 1.2860718369483948, + 0.9477412216365337, + 1.081643931567669, + 0.930282361805439, + 0.33687145076692104, + 0.8558095395565033, + 0.028026500716805458, + 0.5505174957215786, + 0.43875507824122906, + 0.33041907474398613, + 1.4557492099702358, + 0.36135861836373806, + 0.30264986492693424, + 0.5349569134414196, + 0.24318809621036053, + 0.7002604436129332, + 0.4932916294783354, + 0.2251630201935768, + 0.3356678541749716, + 0.20882508903741837, + 1.6378116868436337, + 1.6449563540518284, + 0.9452492892742157, + 0.31329902820289135, + 0.2898422386497259, + 0.9615321774035692, + 0.36040459759533405 + ], + "unique_experts": 64, + "load_cv": 0.4763896637425861, + "normalized_load_entropy": 0.9716503223569357, + "max_load_share": 0.033950617283950615 + }, + "full_input": { + "tokens": 133, + "top_k": 6, + "decisions": 798, + "ordered_route_sha256": "c0e6d19e773b8d38affa37c65fed30ddb0af54ed862afe8545890659a779423b", + "route_weight_sha256": "6c465cadb9e0f9d4d43c997fdb8e0740e895edae60d2393ef7bde5e5a3e25612", + "loads": [ + 5, + 26, + 7, + 14, + 3, + 3, + 14, + 8, + 14, + 7, + 11, + 5, + 2, + 11, + 16, + 9, + 10, + 8, + 9, + 10, + 14, + 16, + 16, + 11, + 10, + 13, + 12, + 22, + 14, + 16, + 12, + 19, + 8, + 11, + 15, + 32, + 17, + 18, + 20, + 10, + 8, + 13, + 21, + 1, + 7, + 8, + 10, + 26, + 9, + 6, + 19, + 10, + 8, + 8, + 9, + 9, + 2, + 24, + 25, + 19, + 18, + 8, + 17, + 15 + ], + "weighted_loads": [ + 0.5985029637813568, + 1.6170691549777985, + 0.24016651883721352, + 2.228261459618807, + 0.08682337030768394, + 0.2263268381357193, + 0.5602418128401041, + 0.3256442379206419, + 0.7851744350045919, + 0.36523926816880703, + 0.3181817792356014, + 0.1739907432347536, + 0.09380299970507622, + 0.9417406935244799, + 0.7859273739159107, + 0.8127531222999096, + 0.36483181826770306, + 0.29473205242538825, + 0.5264717133250087, + 1.2932132668793201, + 0.6384812798351049, + 1.1241154223680496, + 1.9559774994850159, + 0.31007990427315235, + 0.39824831299483776, + 0.9450564105063677, + 1.3041815760661848, + 2.237879393622279, + 0.566734503954649, + 0.6032113991677761, + 1.018900852650404, + 0.6943753478117287, + 0.23887889459729195, + 1.1247071344405413, + 1.0340771041810513, + 3.125212728045881, + 0.8696706332266331, + 1.2860718369483948, + 0.9919937867671251, + 1.081643931567669, + 0.930282361805439, + 0.36293210089206696, + 1.5032591857016087, + 0.028026500716805458, + 0.5505174957215786, + 0.43875507824122906, + 0.42340586334466934, + 1.7008333876729012, + 0.3867391161620617, + 0.30264986492693424, + 0.5349569134414196, + 1.0677471961826086, + 0.7002604436129332, + 0.4946044133976102, + 0.2251630201935768, + 0.3356678541749716, + 0.20882508903741837, + 2.155364576727152, + 2.0086378529667854, + 1.136074885725975, + 1.1424491601064801, + 0.4127292726188898, + 1.3418824132531881, + 1.0820787083357573 + ], + "unique_experts": 64, + "load_cv": 0.5113703293073366, + "normalized_load_entropy": 0.9680465286744758, + "max_load_share": 0.040100250626566414 + } + }, + "s1_eos": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "a96f964fd6ca201ef72faa3c26b8cef375af62c4d37a83a6f3191e6a222d454c", + "route_weight_sha256": "a88451aade1e6dcb44f20b3c58eeac713d6318970550584f3fe023b6bca1ae29", + "loads": [ + 6, + 15, + 8, + 10, + 5, + 3, + 15, + 5, + 13, + 6, + 8, + 6, + 2, + 8, + 10, + 9, + 9, + 7, + 9, + 6, + 11, + 7, + 16, + 13, + 8, + 13, + 11, + 20, + 13, + 16, + 12, + 13, + 7, + 11, + 11, + 18, + 18, + 16, + 20, + 11, + 9, + 12, + 15, + 2, + 7, + 8, + 7, + 23, + 8, + 6, + 11, + 3, + 8, + 9, + 7, + 8, + 2, + 17, + 17, + 14, + 9, + 4, + 12, + 5 + ], + "weighted_loads": [ + 0.6389659475535154, + 0.6313356254249811, + 0.26885739155113697, + 0.4855959005653858, + 0.14401572197675705, + 0.22655050083994865, + 0.6032773889601231, + 0.1973161045461893, + 0.732032272964716, + 0.34660905227065086, + 0.19115890190005302, + 0.2095104716718197, + 0.09626342914998531, + 0.8815840147435665, + 0.5230349507182837, + 0.8352884370833635, + 0.335995277389884, + 0.2817216422408819, + 0.5743641406297684, + 0.5584187135100365, + 0.28586969897150993, + 0.43527563102543354, + 1.9665530249476433, + 0.3501824364066124, + 0.2656612768769264, + 0.9051657542586327, + 1.3534707799553871, + 2.183048188686371, + 0.3719206973910332, + 0.6005022302269936, + 1.0066888108849525, + 0.5642435401678085, + 0.20642321556806564, + 1.151201682165265, + 0.8240765798836946, + 1.1836067996919155, + 0.9347074050456285, + 1.243080735206604, + 0.9873126428574324, + 1.0831109434366226, + 1.0058187693357468, + 0.3366613890975714, + 0.8456530384719372, + 0.05684422515332699, + 0.51655712723732, + 0.44495267793536186, + 0.31852652691304684, + 1.5008337572216988, + 0.36136688478291035, + 0.3049724828451872, + 0.2886106800287962, + 0.23248691111803055, + 0.6882406044751406, + 0.5640801433473825, + 0.17954910174012184, + 0.30887752026319504, + 0.20918050408363342, + 1.7180590108036995, + 1.6624281778931618, + 0.8468875084072351, + 0.3347384836524725, + 0.248340530321002, + 0.9850878342986107, + 0.3954487778246403 + ], + "unique_experts": 64, + "load_cv": 0.4666927943564395, + "normalized_load_entropy": 0.9731941774774406, + "max_load_share": 0.035493827160493825 + }, + "full_input": { + "tokens": 149, + "top_k": 6, + "decisions": 894, + "ordered_route_sha256": "c2faf7e5cfb88a4e444f8107993248fcb3d4d6dc57c9f5fb9bdac2d1accfe903", + "route_weight_sha256": "3317c155918ec835c010056e26b39dbee3fd4ff85f9956867986bd9eae165010", + "loads": [ + 10, + 26, + 9, + 13, + 6, + 4, + 15, + 9, + 21, + 7, + 15, + 6, + 2, + 12, + 21, + 10, + 11, + 8, + 10, + 12, + 13, + 17, + 17, + 13, + 15, + 14, + 12, + 23, + 18, + 16, + 13, + 17, + 7, + 12, + 20, + 35, + 18, + 17, + 25, + 14, + 9, + 12, + 24, + 3, + 10, + 8, + 14, + 30, + 10, + 7, + 12, + 12, + 9, + 13, + 7, + 8, + 6, + 25, + 19, + 24, + 19, + 10, + 22, + 18 + ], + "weighted_loads": [ + 1.158639209344983, + 1.637397749349475, + 0.2942012622952461, + 2.222391229122877, + 0.17423538118600845, + 0.3677404336631298, + 0.6032773889601231, + 0.35824609361588955, + 1.3559235129505396, + 0.46297335252165794, + 0.4969331994652748, + 0.2095104716718197, + 0.09626342914998531, + 0.9512153219548054, + 1.0794734358787537, + 0.867978123947978, + 0.39995347522199154, + 0.28230405709473416, + 0.5757405235199258, + 1.3338870462030172, + 0.5745576433837414, + 1.2057029828429222, + 2.0050088837742805, + 0.3501824364066124, + 0.5796408616006374, + 0.9554169587790966, + 1.3542916416772641, + 2.791665807366371, + 0.6253173649311066, + 0.6005022302269936, + 1.0408786088228226, + 0.662291856482625, + 0.20642321556806564, + 1.176622012630105, + 1.1904007848352194, + 2.8990024412050843, + 0.9347074050456285, + 1.284973405301571, + 1.1251411493867636, + 1.4372251704335213, + 1.0058187693357468, + 0.3366613890975714, + 1.945565864443779, + 0.23767744563519955, + 1.165918156504631, + 0.44495267793536186, + 0.9181895703077316, + 1.8702033739537, + 0.42990340664982796, + 0.3481186758726835, + 0.3148166071623564, + 1.3790732063353062, + 0.8648554999381304, + 0.7484729466959834, + 0.17954910174012184, + 0.30887752026319504, + 0.46335479617118835, + 2.162651678547263, + 1.7734578624367714, + 1.354328889399767, + 1.0073302322998643, + 0.6506118085235357, + 1.796560799703002, + 1.5359001606702805 + ], + "unique_experts": 64, + "load_cv": 0.47367633744508064, + "normalized_load_entropy": 0.9733981702241803, + "max_load_share": 0.039149888143176735 + } + }, + "s0_bos": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "943374068570bc023278576c5dccae1bb7923ea7fb710d8bf821322684d17cfc", + "route_weight_sha256": "05a476a93fbd20c23f258a9cb27a9dbe7a0998fc4a8324d3cac708051ca3ce19", + "loads": [ + 4, + 13, + 6, + 13, + 5, + 2, + 13, + 5, + 12, + 9, + 8, + 4, + 1, + 7, + 10, + 8, + 10, + 7, + 8, + 6, + 13, + 6, + 16, + 6, + 7, + 13, + 11, + 22, + 16, + 11, + 12, + 14, + 7, + 11, + 10, + 19, + 17, + 17, + 22, + 9, + 7, + 9, + 13, + 2, + 8, + 8, + 8, + 23, + 9, + 7, + 19, + 4, + 8, + 9, + 8, + 7, + 2, + 18, + 20, + 15, + 10, + 5, + 12, + 7 + ], + "weighted_loads": [ + 0.5946953296661377, + 0.5875553637742996, + 0.21358059346675873, + 0.583713548257947, + 0.168702844530344, + 0.1905401423573494, + 0.5184020735323429, + 0.19033745303750038, + 0.6939925458282232, + 0.4121216107159853, + 0.18726160190999508, + 0.1448270808905363, + 0.0629335269331932, + 0.8374319467693567, + 0.44206421077251434, + 0.747255764901638, + 0.3603341728448868, + 0.29504914209246635, + 0.49530163779854774, + 0.5390854366123676, + 0.3616268504410982, + 0.39280704967677593, + 1.9659822024405003, + 0.15696813352406025, + 0.23546197265386581, + 0.9123798925429583, + 1.2610762231051922, + 2.009962549433112, + 0.4567746166139841, + 0.45234715193510056, + 1.001257497817278, + 0.5538181830197573, + 0.2166595719754696, + 1.0382404495030642, + 0.7658114619553089, + 1.2947176024317741, + 0.9053995683789253, + 1.3351380787789822, + 1.0625820588320494, + 0.9646104164421558, + 0.8187456354498863, + 0.2545940261334181, + 0.7720622271299362, + 0.05344237759709358, + 0.5991833470761776, + 0.461403738707304, + 0.3649713136255741, + 1.4779343474656343, + 0.4025778751820326, + 0.32873664796352386, + 0.544988140463829, + 0.26190710812807083, + 0.7036650851368904, + 0.5208846740424633, + 0.21090250834822655, + 0.2909377980977297, + 0.19739597290754318, + 1.7775492668151855, + 1.8028508108109236, + 1.0065991133451462, + 0.32177354767918587, + 0.2987362779676914, + 1.0476025864481926, + 0.3086535483598709 + ], + "unique_experts": 64, + "load_cv": 0.507676177653138, + "normalized_load_entropy": 0.9688038905317987, + "max_load_share": 0.035493827160493825 + }, + "full_input": { + "tokens": 133, + "top_k": 6, + "decisions": 798, + "ordered_route_sha256": "fba6d8a8f4943bbfe8a6406742e86c3780a6a723c5810aaf8f7832b28550d9d8", + "route_weight_sha256": "a2c3772027201f77b2f5f7225f070d1807516e9d357a1516971670be3d409119", + "loads": [ + 4, + 23, + 6, + 14, + 5, + 2, + 13, + 7, + 15, + 9, + 11, + 4, + 2, + 9, + 15, + 8, + 11, + 7, + 8, + 10, + 15, + 15, + 16, + 6, + 9, + 13, + 11, + 24, + 19, + 11, + 12, + 16, + 7, + 12, + 15, + 35, + 17, + 17, + 25, + 9, + 7, + 9, + 20, + 2, + 8, + 8, + 11, + 27, + 10, + 7, + 19, + 10, + 8, + 9, + 8, + 7, + 2, + 27, + 28, + 19, + 20, + 7, + 19, + 19 + ], + "weighted_loads": [ + 0.5946953296661377, + 1.5335957705974579, + 0.21358059346675873, + 1.3127496410161257, + 0.168702844530344, + 0.1905401423573494, + 0.5184020735323429, + 0.28328563645482063, + 0.8056667298078537, + 0.4121216107159853, + 0.3135360758751631, + 0.1448270808905363, + 0.09509700909256935, + 0.8840028401464224, + 0.6613338086754084, + 0.747255764901638, + 0.3902802839875221, + 0.29504914209246635, + 0.49530163779854774, + 1.2234793044626713, + 0.6523595619946718, + 1.0987855847924948, + 1.9659822024405003, + 0.15696813352406025, + 0.34642133116722107, + 0.9123798925429583, + 1.2610762231051922, + 2.2323946114629507, + 0.7448200285434723, + 0.45234715193510056, + 1.001257497817278, + 0.6097462568432093, + 0.2166595719754696, + 1.0637997165322304, + 0.9903199039399624, + 3.3057971531525254, + 0.9053995683789253, + 1.3351380787789822, + 1.1954346783459187, + 0.9646104164421558, + 0.8187456354498863, + 0.2545940261334181, + 1.4841146506369114, + 0.05344237759709358, + 0.5991833470761776, + 0.461403738707304, + 0.45765396021306515, + 1.7229818236082792, + 0.4279583729803562, + 0.32873664796352386, + 0.544988140463829, + 1.0083684585988522, + 0.7036650851368904, + 0.5208846740424633, + 0.21090250834822655, + 0.2909377980977297, + 0.19739597290754318, + 2.304561782628298, + 2.1665323097258806, + 1.1702463906258345, + 1.1509236795827746, + 0.3847195915877819, + 1.592782847583294, + 1.3190265335142612 + ], + "unique_experts": 64, + "load_cv": 0.5628282583472229, + "normalized_load_entropy": 0.96294420985169, + "max_load_share": 0.043859649122807015 + } + }, + "s1_bos": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "8b6ee2bf0e85447dad4a1243b63d4741fc547f07c6bb579f5249400094e1d0b4", + "route_weight_sha256": "df1b47a2ddeb854efe837bd05d7f159495a42856b0fc1e27479c62c8a8dde4e3", + "loads": [ + 4, + 13, + 7, + 10, + 4, + 2, + 13, + 5, + 11, + 9, + 8, + 5, + 1, + 7, + 9, + 8, + 10, + 7, + 8, + 6, + 12, + 6, + 17, + 7, + 5, + 13, + 11, + 22, + 13, + 11, + 12, + 12, + 9, + 11, + 10, + 19, + 17, + 17, + 23, + 10, + 8, + 12, + 13, + 3, + 10, + 8, + 7, + 23, + 11, + 6, + 16, + 3, + 7, + 9, + 12, + 9, + 2, + 20, + 19, + 15, + 8, + 5, + 12, + 6 + ], + "weighted_loads": [ + 0.6361450310796499, + 0.5876434799283743, + 0.2444857731461525, + 0.5021708868443966, + 0.12895568273961544, + 0.19240693747997284, + 0.521787166595459, + 0.1796319056302309, + 0.666684728115797, + 0.4100675415247679, + 0.18661844357848167, + 0.18366514705121517, + 0.06611829251050949, + 0.8352365866303444, + 0.39767573960125446, + 0.7740304246544838, + 0.352179815992713, + 0.2795686274766922, + 0.4985632225871086, + 0.5440914183855057, + 0.3255055155605078, + 0.40420076809823513, + 2.06583334133029, + 0.17878744564950466, + 0.18280434235930443, + 0.9120009373873472, + 1.22432242333889, + 2.1736851688474417, + 0.3669264707714319, + 0.46185360848903656, + 1.0320384353399277, + 0.5296505931764841, + 0.27409675903618336, + 1.1054756436496973, + 0.7792047820985317, + 1.287669224664569, + 0.9381279591470957, + 1.3716798536479473, + 1.062236724421382, + 0.9213280566036701, + 0.9517491608858109, + 0.33505358174443245, + 0.7751123458147049, + 0.08242926001548767, + 0.655137162655592, + 0.4580245390534401, + 0.3204990364611149, + 1.4724912215024233, + 0.45066401176154613, + 0.28993249498307705, + 0.44486580789089203, + 0.23559344187378883, + 0.660748016089201, + 0.5427720937877893, + 0.305962186306715, + 0.34246540255844593, + 0.1894553378224373, + 1.9127536304295063, + 1.7890748996287584, + 0.9794862065464258, + 0.2813931740820408, + 0.29330288618803024, + 1.0271800942718983, + 0.31741619296371937 + ], + "unique_experts": 64, + "load_cv": 0.5016357939237048, + "normalized_load_entropy": 0.9695354143062953, + "max_load_share": 0.035493827160493825 + }, + "full_input": { + "tokens": 149, + "top_k": 6, + "decisions": 894, + "ordered_route_sha256": "848df89793e4f6058c509fdcbc9090f18792785b602c714bb0c931ef39890efc", + "route_weight_sha256": "b873358cd15fbf31aa294174af45f3d6d1f0e761914ddd62803c4478d92678a8", + "loads": [ + 8, + 24, + 8, + 13, + 5, + 3, + 13, + 9, + 20, + 10, + 15, + 5, + 2, + 9, + 20, + 9, + 13, + 7, + 8, + 12, + 14, + 16, + 18, + 7, + 11, + 14, + 11, + 25, + 18, + 11, + 13, + 16, + 9, + 12, + 19, + 37, + 17, + 18, + 28, + 13, + 8, + 13, + 23, + 4, + 13, + 8, + 14, + 30, + 13, + 7, + 17, + 12, + 8, + 12, + 12, + 9, + 6, + 27, + 21, + 25, + 18, + 10, + 24, + 20 + ], + "weighted_loads": [ + 1.1558182928711176, + 1.593705603852868, + 0.26982964389026165, + 1.295925296843052, + 0.15917534194886684, + 0.333596870303154, + 0.521787166595459, + 0.3316922876983881, + 1.3241472486406565, + 0.526431841775775, + 0.49239274114370346, + 0.18366514705121517, + 0.09396243095397949, + 0.8782312870025635, + 0.920885106548667, + 0.8067201115190983, + 0.44480050913989544, + 0.2795686274766922, + 0.4985632225871086, + 1.253522438928485, + 0.5994654204696417, + 1.1971026249229908, + 2.104289200156927, + 0.17878744564950466, + 0.45778482034802437, + 0.9622521419078112, + 1.22432242333889, + 2.7927528750151396, + 0.676652854308486, + 0.46185360848903656, + 1.0662282332777977, + 0.62491799518466, + 0.27409675903618336, + 1.133342383429408, + 1.1455289870500565, + 3.10380722861737, + 0.9381279591470957, + 1.4135725237429142, + 1.2850884515792131, + 1.2754422836005688, + 0.9517491608858109, + 0.3600326422601938, + 1.933971367776394, + 0.26326248049736023, + 1.304498191922903, + 0.4580245390534401, + 0.9205479137599468, + 1.8374647162854671, + 0.5192005336284637, + 0.3330786880105734, + 0.4710717350244522, + 1.3681910447776318, + 0.8373629115521908, + 0.7260814364999533, + 0.305962186306715, + 0.34246540255844593, + 0.4436296299099922, + 2.302416590973735, + 1.900104584172368, + 1.4357917718589306, + 0.9539849227294326, + 0.6571070179343224, + 1.9394907839596272, + 1.6664307694882154 + ], + "unique_experts": 64, + "load_cv": 0.49919232695948657, + "normalized_load_entropy": 0.970921312645888, + "max_load_share": 0.04138702460850112 + } + }, + "s0_x": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "fb8133a49f8c672223a5eaf445ccb70c1477e323f8670b6f194e67371bbbff88", + "route_weight_sha256": "0d501feb11e41628d0838b2df7df4aa2f54c8aa3ba6d1f866fd4653e1f01c8e2", + "loads": [ + 5, + 13, + 5, + 12, + 4, + 2, + 13, + 5, + 13, + 8, + 7, + 4, + 2, + 8, + 12, + 8, + 13, + 7, + 9, + 6, + 13, + 6, + 16, + 6, + 7, + 13, + 11, + 20, + 11, + 12, + 13, + 15, + 8, + 11, + 11, + 19, + 18, + 18, + 23, + 11, + 8, + 12, + 13, + 2, + 9, + 8, + 10, + 23, + 9, + 7, + 11, + 3, + 9, + 8, + 8, + 4, + 2, + 18, + 20, + 16, + 7, + 5, + 12, + 6 + ], + "weighted_loads": [ + 0.6279806513339281, + 0.5718679036945105, + 0.1911107525229454, + 0.5593372862786055, + 0.13193648681044579, + 0.19291464984416962, + 0.5138990506529808, + 0.19273563846945763, + 0.750673471018672, + 0.3862116411328316, + 0.16275803744792938, + 0.1447678506374359, + 0.09095134772360325, + 0.8463760912418365, + 0.48655846528708935, + 0.7649067863821983, + 0.44070953503251076, + 0.29706774465739727, + 0.5141161605715752, + 0.5282643213868141, + 0.3669386971741915, + 0.38596557453274727, + 1.947671826928854, + 0.15808115899562836, + 0.23428913950920105, + 0.9130884073674679, + 1.2793410904705524, + 1.9139266833662987, + 0.314457630738616, + 0.47253703884780407, + 1.00886719673872, + 0.5782028846442699, + 0.24485099501907825, + 1.0549724791198969, + 0.7920577060431242, + 1.266288723796606, + 0.932483334094286, + 1.3458305969834328, + 1.0716688632965088, + 1.0556856263428926, + 0.8533683754503727, + 0.32900245860219, + 0.7642233427613974, + 0.051652444526553154, + 0.6191574912518263, + 0.45363473147153854, + 0.41950972378253937, + 1.4954356048256159, + 0.39153090864419937, + 0.32953725568950176, + 0.3155378419905901, + 0.23211635276675224, + 0.7411311753094196, + 0.49421557039022446, + 0.2079413216561079, + 0.2050091866403818, + 0.19225050508975983, + 1.6911691538989544, + 1.7676103115081787, + 1.0375559013336897, + 0.23751932941377163, + 0.3092060163617134, + 1.0807191841304302, + 0.26649958081543446 + ], + "unique_experts": 64, + "load_cv": 0.503455518619844, + "normalized_load_entropy": 0.9690533374685296, + "max_load_share": 0.035493827160493825 + }, + "full_input": { + "tokens": 133, + "top_k": 6, + "decisions": 798, + "ordered_route_sha256": "b4e7d9c736cdd86a6516670e77d3ba1c97f7a39a590f581203a87522aca08884", + "route_weight_sha256": "d085a72601acfbdf32bc91afb4ba4d282ae44b407eaa9f8a3ddeb1d17399efa8", + "loads": [ + 5, + 23, + 5, + 13, + 4, + 2, + 14, + 7, + 16, + 8, + 12, + 5, + 3, + 9, + 17, + 8, + 14, + 7, + 9, + 10, + 15, + 16, + 16, + 6, + 9, + 13, + 11, + 22, + 14, + 12, + 13, + 17, + 8, + 12, + 16, + 34, + 18, + 18, + 25, + 11, + 8, + 13, + 19, + 2, + 9, + 8, + 13, + 28, + 10, + 7, + 11, + 9, + 9, + 8, + 8, + 4, + 2, + 25, + 29, + 19, + 18, + 8, + 18, + 16 + ], + "weighted_loads": [ + 0.6279806513339281, + 1.5179083105176687, + 0.1911107525229454, + 1.2883733790367842, + 0.13193648681044579, + 0.19291464984416962, + 0.5487225241959095, + 0.28611909225583076, + 0.8665715027600527, + 0.3862116411328316, + 0.3978087119758129, + 0.17992271482944489, + 0.12043350003659725, + 0.8666826337575912, + 0.7082616351544857, + 0.7649067863821983, + 0.47137540578842163, + 0.29706774465739727, + 0.5141161605715752, + 1.2334009185433388, + 0.6672444064170122, + 1.388356026262045, + 1.947671826928854, + 0.15808115899562836, + 0.3444700948894024, + 0.9130884073674679, + 1.2793410904705524, + 2.1391105130314827, + 0.5994264967739582, + 0.47253703884780407, + 1.00886719673872, + 0.6322263814508915, + 0.24485099501907825, + 1.0792323872447014, + 1.0165661480277777, + 3.223792144097388, + 0.932483334094286, + 1.3458305969834328, + 1.1159214284271002, + 1.0556856263428926, + 0.8533683754503727, + 0.353347422555089, + 1.3951239753514528, + 0.051652444526553154, + 0.6191574912518263, + 0.45363473147153854, + 0.5118863843381405, + 1.772992393001914, + 0.416911406442523, + 0.32953725568950176, + 0.3155378419905901, + 0.9263210371136665, + 0.7411311753094196, + 0.49421557039022446, + 0.2079413216561079, + 0.2050091866403818, + 0.19225050508975983, + 2.1420391239225864, + 2.2597578205168247, + 1.170497065410018, + 1.1202706405892968, + 0.42873625829815865, + 1.5830501969903708, + 0.9486413616687059 + ], + "unique_experts": 64, + "load_cv": 0.5428307604722291, + "normalized_load_entropy": 0.9652379351445222, + "max_load_share": 0.042606516290726815 + } + }, + "s1_x": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "b8ac218212cdda12f137a7e537cbd54ca627a34375229da07692c5c0e6331744", + "route_weight_sha256": "0459a4a8d6b0b6684491d7844f3e11a25adbde39fb8c2d489446dbc3ec53ea28", + "loads": [ + 6, + 13, + 8, + 10, + 5, + 3, + 13, + 5, + 11, + 6, + 8, + 6, + 1, + 7, + 10, + 9, + 10, + 7, + 9, + 6, + 11, + 6, + 17, + 9, + 5, + 12, + 12, + 22, + 12, + 11, + 13, + 11, + 8, + 12, + 10, + 20, + 16, + 17, + 23, + 8, + 8, + 11, + 13, + 3, + 10, + 8, + 8, + 24, + 11, + 6, + 14, + 3, + 8, + 9, + 12, + 6, + 2, + 19, + 19, + 15, + 8, + 5, + 12, + 6 + ], + "weighted_loads": [ + 0.6973115671426058, + 0.570563480257988, + 0.26689294166862965, + 0.4915000591427088, + 0.1519899219274521, + 0.2283473163843155, + 0.5145607441663742, + 0.18115897104144096, + 0.6880861967802048, + 0.33221425116062164, + 0.1847072932869196, + 0.20580580830574036, + 0.0649963766336441, + 0.8291440270841122, + 0.4275866951793432, + 0.819994343444705, + 0.3495607525110245, + 0.279512170702219, + 0.5194510817527771, + 0.5417130254209042, + 0.3068285435438156, + 0.4016672112047672, + 2.062819119542837, + 0.23220140114426613, + 0.18419110588729382, + 0.8944773189723492, + 1.251410936936736, + 2.166307929903269, + 0.3371957689523697, + 0.45024233125150204, + 1.051637226715684, + 0.5069387573748827, + 0.24834512546658516, + 1.141359755769372, + 0.7830585576593876, + 1.3225677032023668, + 0.8967911582440138, + 1.3649107869714499, + 1.0558633729815483, + 0.8335905969142914, + 0.9554736949503422, + 0.31113350205123425, + 0.774479178711772, + 0.0810761284083128, + 0.6402750741690397, + 0.4518930986523628, + 0.3467861171811819, + 1.5162846054881811, + 0.4397238940000534, + 0.28471930138766766, + 0.3914729617536068, + 0.23292149230837822, + 0.6951276622712612, + 0.5465552099049091, + 0.30430503003299236, + 0.2673608884215355, + 0.19096455723047256, + 1.7966607194393873, + 1.767195325344801, + 0.9736569076776505, + 0.28020491637289524, + 0.30511251650750637, + 1.0602974332869053, + 0.3000086024403572 + ], + "unique_experts": 64, + "load_cv": 0.4921267019257963, + "normalized_load_entropy": 0.9712277929602045, + "max_load_share": 0.037037037037037035 + }, + "full_input": { + "tokens": 149, + "top_k": 6, + "decisions": 894, + "ordered_route_sha256": "176a9363b61d649e98b5d0ee3a9b1e53d326bba3949ec4c1b4469165fdd5d51e", + "route_weight_sha256": "ccff5b066c794325f17e8c26eda7c3013c585b72dc60fef99393486b3fa31963", + "loads": [ + 10, + 24, + 9, + 12, + 6, + 4, + 13, + 9, + 20, + 7, + 17, + 7, + 2, + 9, + 19, + 10, + 13, + 7, + 9, + 12, + 13, + 17, + 18, + 9, + 11, + 13, + 12, + 25, + 17, + 11, + 14, + 15, + 9, + 13, + 19, + 38, + 16, + 18, + 27, + 11, + 8, + 12, + 22, + 4, + 13, + 8, + 15, + 32, + 13, + 7, + 15, + 11, + 9, + 12, + 12, + 6, + 6, + 26, + 22, + 25, + 19, + 10, + 23, + 19 + ], + "weighted_loads": [ + 1.2169848289340734, + 1.5766256041824818, + 0.2922368124127388, + 1.2527366895228624, + 0.1822095811367035, + 0.36953724920749664, + 0.5145607441663742, + 0.33300337567925453, + 1.3501947280019522, + 0.4485785514116287, + 0.6049974244087934, + 0.24066860228776932, + 0.09119029529392719, + 0.8712604120373726, + 0.8983758110553026, + 0.8526840303093195, + 0.44757236167788506, + 0.279512170702219, + 0.5194510817527771, + 1.2655691746622324, + 0.5818828195333481, + 1.4765056539326906, + 2.1012749783694744, + 0.23220140114426613, + 0.4589154403656721, + 0.9447285234928131, + 1.251410936936736, + 2.791778925806284, + 0.6516857333481312, + 0.45024233125150204, + 1.085827024653554, + 0.6008236464112997, + 0.2775405962020159, + 1.1678024847060442, + 1.1493827626109123, + 3.0999690433964133, + 0.8967911582440138, + 1.4068034570664167, + 1.1615099273622036, + 1.18770482391119, + 0.9554736949503422, + 0.3358724359422922, + 1.8750768210738897, + 0.26190934889018536, + 1.2896361034363508, + 0.4518930986523628, + 0.9465158339589834, + 1.9094077330082655, + 0.508260415866971, + 0.327865494415164, + 0.417678888887167, + 1.2794699966907501, + 0.871742557734251, + 0.7298645526170731, + 0.30430503003299236, + 0.2673608884215355, + 0.4451388493180275, + 2.1841765865683556, + 1.9846470318734646, + 1.431762294843793, + 0.9994420940056443, + 0.6689166482537985, + 1.916321912780404, + 1.4098841026425362 + ], + "unique_experts": 64, + "load_cv": 0.49500404311235296, + "normalized_load_entropy": 0.9720072663132602, + "max_load_share": 0.042505592841163314 + } + }, + "s0_period": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "8cc92773fc595b0a82c085711db405f1a3eb66f27a2ca152cb411ab90dcbe44f", + "route_weight_sha256": "f2d625e1dfa79b2ab4c25ed4e767a1b1145cdfdad649acf73a416408a6b27908", + "loads": [ + 6, + 12, + 5, + 12, + 5, + 2, + 14, + 5, + 13, + 8, + 7, + 4, + 2, + 8, + 12, + 8, + 13, + 7, + 9, + 6, + 13, + 6, + 16, + 6, + 7, + 13, + 11, + 20, + 11, + 12, + 12, + 14, + 8, + 11, + 11, + 19, + 18, + 17, + 22, + 11, + 8, + 11, + 13, + 2, + 9, + 8, + 10, + 23, + 9, + 7, + 13, + 3, + 9, + 8, + 8, + 4, + 2, + 18, + 20, + 16, + 8, + 5, + 12, + 6 + ], + "weighted_loads": [ + 0.6821887101978064, + 0.5349078606814146, + 0.1893149260431528, + 0.5573787800967693, + 0.15583388321101665, + 0.19272887706756592, + 0.5373530723154545, + 0.19212793931365013, + 0.7455304954200983, + 0.38550860434770584, + 0.16223064437508583, + 0.14456231333315372, + 0.0921658668667078, + 0.8448240775614977, + 0.48232442140579224, + 0.7661765143275261, + 0.4421009961515665, + 0.2975624166429043, + 0.516210526227951, + 0.5258459262549877, + 0.3680200111120939, + 0.38721099123358727, + 1.9544129204005003, + 0.15739703178405762, + 0.23470244370400906, + 0.9113197978585958, + 1.2707387544214725, + 1.8941442016512156, + 0.3143438808619976, + 0.4722456745803356, + 0.9811444208025932, + 0.5521650090813637, + 0.24492787010967731, + 1.0472557973116636, + 0.7890546433627605, + 1.2681697811931372, + 0.9297608193010092, + 1.2895044274628162, + 1.0479303039610386, + 1.059014931321144, + 0.8528573997318745, + 0.30387481302022934, + 0.7615490201860666, + 0.05191345326602459, + 0.6197370011359453, + 0.452143382281065, + 0.41706753335893154, + 1.4966452475637197, + 0.3886388335376978, + 0.3289797306060791, + 0.3663447890430689, + 0.23312782496213913, + 0.7374368607997894, + 0.4921072795987129, + 0.2086532786488533, + 0.20518974587321281, + 0.19425803422927856, + 1.6698477938771248, + 1.772195179015398, + 1.0296687725931406, + 0.27053319104015827, + 0.3110016994178295, + 1.091329663991928, + 0.26449041068553925 + ], + "unique_experts": 64, + "load_cv": 0.49243631296738594, + "normalized_load_entropy": 0.9702974795296414, + "max_load_share": 0.035493827160493825 + }, + "full_input": { + "tokens": 133, + "top_k": 6, + "decisions": 798, + "ordered_route_sha256": "d51d12588b05d779a5dbe7ea254b89ca4bf06104f6ad447728f3672c2aad4d5b", + "route_weight_sha256": "1f3d9a42efd246b5e79735c3847a5cad6157330882efb1ffed503284cce717f3", + "loads": [ + 7, + 22, + 5, + 14, + 5, + 2, + 14, + 7, + 17, + 8, + 10, + 4, + 2, + 9, + 17, + 9, + 13, + 7, + 9, + 10, + 15, + 15, + 16, + 6, + 10, + 13, + 11, + 22, + 14, + 12, + 12, + 16, + 8, + 13, + 16, + 33, + 18, + 17, + 25, + 11, + 8, + 12, + 19, + 2, + 9, + 8, + 14, + 28, + 11, + 7, + 13, + 9, + 9, + 8, + 8, + 4, + 2, + 25, + 28, + 19, + 20, + 8, + 18, + 15 + ], + "weighted_loads": [ + 0.9765418972820044, + 1.4809482675045729, + 0.1893149260431528, + 1.319313120096922, + 0.15583388321101665, + 0.19272887706756592, + 0.5373530723154545, + 0.28494447469711304, + 0.9084446784108877, + 0.38550860434770584, + 0.28850511834025383, + 0.14456231333315372, + 0.0921658668667078, + 0.865072276443243, + 0.7043866869062185, + 0.8115280941128731, + 0.4421009961515665, + 0.2975624166429043, + 0.516210526227951, + 1.255326520651579, + 0.6101333033293486, + 1.261966709047556, + 1.9544129204005003, + 0.15739703178405762, + 0.3746081031858921, + 0.9113197978585958, + 1.2707387544214725, + 2.118772679939866, + 0.5698158349841833, + 0.4722456745803356, + 0.9811444208025932, + 0.6068677771836519, + 0.24492787010967731, + 1.1195854265242815, + 1.013563085347414, + 3.1641959687694907, + 0.9297608193010092, + 1.2895044274628162, + 1.151889717206359, + 1.059014931321144, + 0.8528573997318745, + 0.32776159420609474, + 1.398686746135354, + 0.05191345326602459, + 0.6197370011359453, + 0.452143382281065, + 0.535363094881177, + 1.7759722080081701, + 0.43989233672618866, + 0.3289797306060791, + 0.3663447890430689, + 0.9095817320048809, + 0.7374368607997894, + 0.4921072795987129, + 0.2086532786488533, + 0.20518974587321281, + 0.19425803422927856, + 2.120085220783949, + 2.135876677930355, + 1.166683780029416, + 1.1594494273886085, + 0.43029573932290077, + 1.58962681889534, + 0.9033800419420004 + ], + "unique_experts": 64, + "load_cv": 0.5327391775885671, + "normalized_load_entropy": 0.9660734265958747, + "max_load_share": 0.041353383458646614 + } + }, + "s1_period": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "f143600cd7e4ee756900cfa7e48f55f71104ff181d92c6a3c0a205776415b302", + "route_weight_sha256": "67b49e67b98ee0822bf5e9ee5556416e91e1673ab4c44f1e213d9e9b203259a8", + "loads": [ + 6, + 13, + 8, + 10, + 5, + 3, + 13, + 5, + 11, + 7, + 8, + 6, + 1, + 7, + 9, + 10, + 9, + 7, + 9, + 6, + 10, + 6, + 17, + 8, + 5, + 12, + 12, + 22, + 12, + 11, + 13, + 13, + 8, + 10, + 10, + 20, + 17, + 17, + 23, + 8, + 8, + 11, + 13, + 3, + 10, + 8, + 8, + 23, + 11, + 6, + 16, + 3, + 7, + 10, + 12, + 7, + 2, + 19, + 19, + 15, + 7, + 5, + 12, + 6 + ], + "weighted_loads": [ + 0.7093387953937054, + 0.5658166892826557, + 0.26524049043655396, + 0.49132210575044155, + 0.16440346091985703, + 0.22810672223567963, + 0.5228009037673473, + 0.18051566742360592, + 0.6849893182516098, + 0.3573692608624697, + 0.18300042860209942, + 0.20627514272928238, + 0.06598127633333206, + 0.8292214963585138, + 0.39371305890381336, + 0.8359895963221788, + 0.32432496920228004, + 0.28009569458663464, + 0.5222001317888498, + 0.540038712322712, + 0.27964893355965614, + 0.4019591622054577, + 2.0650144312530756, + 0.20711727626621723, + 0.18423732556402683, + 0.8946807868778706, + 1.245010020211339, + 2.1716767363250256, + 0.3369959220290184, + 0.4520726352930069, + 1.0524385254830122, + 0.5564926881343126, + 0.24730949848890305, + 1.0822825953364372, + 0.7847433649003506, + 1.319653818383813, + 0.9232357535511255, + 1.326263276860118, + 1.0548404082655907, + 0.8370850421488285, + 0.9471986778080463, + 0.3117575477808714, + 0.7763457372784615, + 0.0811610072851181, + 0.64485021866858, + 0.45976079627871513, + 0.33924911729991436, + 1.4795393515378237, + 0.43864435888826847, + 0.2851180490106344, + 0.44647239334881306, + 0.23403553664684296, + 0.6695848163217306, + 0.5747178327292204, + 0.30510530062019825, + 0.2970439773052931, + 0.19032030552625656, + 1.7847504038363695, + 1.772838992998004, + 0.9734076745808125, + 0.2591819129884243, + 0.3094373904168606, + 1.0624972358345985, + 0.3016809429973364 + ], + "unique_experts": 64, + "load_cv": 0.49336398031328604, + "normalized_load_entropy": 0.9710577775858893, + "max_load_share": 0.035493827160493825 + }, + "full_input": { + "tokens": 149, + "top_k": 6, + "decisions": 894, + "ordered_route_sha256": "d6fe769d9d4354f3e73d658e35ee2b61c3711732347ff7f6618b1dbb7dd2493a", + "route_weight_sha256": "640584feeda3eff14f4f90f2a1ca6469cffc4a5bcdcef27a52521e400f5e751f", + "loads": [ + 11, + 24, + 9, + 13, + 6, + 4, + 13, + 9, + 21, + 8, + 15, + 6, + 1, + 9, + 18, + 12, + 12, + 7, + 9, + 12, + 12, + 16, + 18, + 8, + 11, + 13, + 12, + 25, + 17, + 11, + 14, + 17, + 8, + 12, + 19, + 36, + 17, + 18, + 29, + 11, + 8, + 12, + 22, + 4, + 13, + 8, + 16, + 31, + 14, + 7, + 17, + 11, + 8, + 13, + 12, + 7, + 6, + 26, + 21, + 25, + 19, + 10, + 23, + 18 + ], + "weighted_loads": [ + 1.4962852150201797, + 1.5718788132071495, + 0.2905843611806631, + 1.2876803670078516, + 0.19462312012910843, + 0.3692966550588608, + 0.5228009037673473, + 0.33212891034781933, + 1.3905321825295687, + 0.47373356111347675, + 0.4887747261673212, + 0.20627514272928238, + 0.06598127633333206, + 0.8713520877063274, + 0.8648408688604832, + 0.9037467110902071, + 0.42123711854219437, + 0.28009569458663464, + 0.5222001317888498, + 1.29418989084661, + 0.5128064416348934, + 1.3044429067522287, + 2.103470290079713, + 0.20711727626621723, + 0.4585562329739332, + 0.9449319913983345, + 1.245010020211339, + 2.797062437981367, + 0.6156285591423512, + 0.4520726352930069, + 1.0866283234208822, + 0.6505122315138578, + 0.24730949848890305, + 1.1487775854766369, + 1.1510675698518753, + 2.9995639687404037, + 0.9232357535511255, + 1.3681559469550848, + 1.2551048342138529, + 1.1911992691457272, + 0.9471986778080463, + 0.33637143671512604, + 1.8818835616111755, + 0.26199422776699066, + 1.2942112479358912, + 0.45976079627871513, + 0.9647830128669739, + 1.8768380917608738, + 0.5316707715392113, + 0.32826424203813076, + 0.47267832048237324, + 1.244185570627451, + 0.8461997117847204, + 0.7580271754413843, + 0.30510530062019825, + 0.2970439773052931, + 0.4444945976138115, + 2.1717469803988934, + 1.8838686775416136, + 1.4549387898296118, + 0.9949230356141925, + 0.6732415221631527, + 1.9217080287635326, + 1.3586214240640402 + ], + "unique_experts": 64, + "load_cv": 0.49078001803244337, + "normalized_load_entropy": 0.971785516060703, + "max_load_share": 0.040268456375838924 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 108, + "ordered_topk_exact_tokens": 64, + "set_exact_tokens": 75, + "mean_set_jaccard": 0.9087301587301587, + "mean_token_weighted_tv": 0.015219089997656367, + "aggregate_load_tv": 0.04475308641975309 + }, + "system_bos": { + "tokens": 108, + "ordered_topk_exact_tokens": 48, + "set_exact_tokens": 70, + "mean_set_jaccard": 0.8935185185185185, + "mean_token_weighted_tv": 0.019168278771556087, + "aggregate_load_tv": 0.038580246913580245 + }, + "system_x": { + "tokens": 108, + "ordered_topk_exact_tokens": 50, + "set_exact_tokens": 62, + "mean_set_jaccard": 0.8703703703703705, + "mean_token_weighted_tv": 0.02271482438987328, + "aggregate_load_tv": 0.057098765432098755 + }, + "system_period": { + "tokens": 108, + "ordered_topk_exact_tokens": 49, + "set_exact_tokens": 61, + "mean_set_jaccard": 0.8641975308641976, + "mean_token_weighted_tv": 0.023280358899177775, + "aggregate_load_tv": 0.05709876543209876 + }, + "bos_at_s0": { + "tokens": 108, + "ordered_topk_exact_tokens": 46, + "set_exact_tokens": 62, + "mean_set_jaccard": 0.8589065255731922, + "mean_token_weighted_tv": 0.026775960155107355, + "aggregate_load_tv": 0.05864197530864197 + }, + "bos_at_s1": { + "tokens": 108, + "ordered_topk_exact_tokens": 40, + "set_exact_tokens": 53, + "mean_set_jaccard": 0.8445767195767196, + "mean_token_weighted_tv": 0.027867642791803787, + "aggregate_load_tv": 0.06327160493827161 + }, + "x_at_s0": { + "tokens": 108, + "ordered_topk_exact_tokens": 45, + "set_exact_tokens": 56, + "mean_set_jaccard": 0.8489858906525571, + "mean_token_weighted_tv": 0.02745836905065786, + "aggregate_load_tv": 0.06172839506172839 + }, + "x_at_s1": { + "tokens": 108, + "ordered_topk_exact_tokens": 39, + "set_exact_tokens": 53, + "mean_set_jaccard": 0.8465608465608467, + "mean_token_weighted_tv": 0.028039852269338788, + "aggregate_load_tv": 0.05864197530864197 + }, + "period_at_s0": { + "tokens": 108, + "ordered_topk_exact_tokens": 45, + "set_exact_tokens": 55, + "mean_set_jaccard": 0.8443562610229277, + "mean_token_weighted_tv": 0.02817136996977583, + "aggregate_load_tv": 0.06327160493827161 + }, + "period_at_s1": { + "tokens": 108, + "ordered_topk_exact_tokens": 38, + "set_exact_tokens": 52, + "mean_set_jaccard": 0.8439153439153441, + "mean_token_weighted_tv": 0.02825839589004991, + "aggregate_load_tv": 0.06172839506172839 + } + } + }, + "layer_03": { + "layer": 3, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "2092340e28b3060a77545c416ad67801a4b6e2b75bc67373eb233ffdd3f9f744", + "route_weight_sha256": "7d12eb7be1ae123e583ecf4a0eca734286ebc9eb6baba728ccf3757ee924b9d4", + "loads": [ + 22, + 19, + 7, + 4, + 3, + 11, + 1, + 19, + 6, + 16, + 2, + 10, + 5, + 7, + 8, + 20, + 3, + 12, + 7, + 3, + 17, + 10, + 10, + 7, + 23, + 5, + 12, + 20, + 18, + 8, + 6, + 7, + 11, + 1, + 22, + 6, + 20, + 3, + 14, + 9, + 9, + 7, + 0, + 17, + 3, + 14, + 15, + 15, + 15, + 21, + 7, + 7, + 5, + 2, + 13, + 6, + 7, + 3, + 7, + 5, + 20, + 9, + 20, + 7 + ], + "weighted_loads": [ + 1.4980499893426895, + 1.7834870666265488, + 0.2530986834317446, + 0.21851268038153648, + 0.12829679995775223, + 0.8085985109210014, + 0.07870091497898102, + 1.3363336753100157, + 0.3186578508466482, + 0.9708849638700485, + 0.05755140073597431, + 0.3174770101904869, + 0.6426191832870245, + 0.33502594754099846, + 0.30861011520028114, + 2.0012270994484425, + 0.2985718920826912, + 0.610553277656436, + 1.0090865269303322, + 0.30271167680621147, + 1.0807972587645054, + 0.937686201184988, + 0.6611163839697838, + 0.2078812848776579, + 1.0295512285083532, + 0.24427355453372002, + 0.6404386255890131, + 2.0121329464018345, + 0.6153888143599033, + 0.39310463704168797, + 0.2857317943125963, + 0.19045729003846645, + 0.43485930003225803, + 0.05935518816113472, + 1.2343746479600668, + 0.21230526454746723, + 1.9532858114689589, + 0.16587118804454803, + 1.1222476679831743, + 0.6394314132630825, + 0.3342455979436636, + 0.2078015599399805, + 0.0, + 1.6308818086981773, + 0.1279437206685543, + 1.2037081010639668, + 1.3885054215788841, + 1.1991242468357086, + 1.1651285886764526, + 2.2695120610296726, + 0.22160244174301624, + 0.24678905494511127, + 0.2761625051498413, + 0.19499284774065018, + 0.8535742275416851, + 0.4594733230769634, + 0.48695172742009163, + 0.08722699619829655, + 0.499261811375618, + 0.17099614441394806, + 1.133786017075181, + 0.7437401078641415, + 1.7478796299546957, + 0.27652082964777946 + ], + "unique_experts": 63, + "load_cv": 0.6242813273960757, + "normalized_load_entropy": 0.9508727669131357, + "max_load_share": 0.035493827160493825 + }, + "full_input": { + "tokens": 133, + "top_k": 6, + "decisions": 798, + "ordered_route_sha256": "9bae48ca92c33fa41a9750b0014e2755b95c7fc2f6d992a5e3145a0ee6613a2b", + "route_weight_sha256": "fe4eaf68aa45320252b34db289fe587b4a341e718cc3125c6b0a18eff38a7e7e", + "loads": [ + 32, + 19, + 7, + 14, + 5, + 15, + 1, + 28, + 6, + 22, + 3, + 11, + 7, + 12, + 14, + 20, + 3, + 12, + 7, + 3, + 19, + 13, + 15, + 8, + 23, + 7, + 12, + 27, + 18, + 11, + 8, + 7, + 11, + 1, + 31, + 6, + 20, + 3, + 14, + 9, + 9, + 8, + 9, + 17, + 3, + 14, + 29, + 15, + 21, + 31, + 7, + 7, + 6, + 2, + 18, + 8, + 7, + 4, + 7, + 5, + 25, + 9, + 24, + 9 + ], + "weighted_loads": [ + 2.9180514626204967, + 1.7834870666265488, + 0.2530986834317446, + 0.80799575522542, + 0.1569568898412399, + 0.9941566847264767, + 0.07870091497898102, + 2.741303751245141, + 0.3186578508466482, + 1.2311675109085627, + 0.09342492185533047, + 0.31835765164578333, + 0.6546762493380811, + 0.7553590312600136, + 0.6618524603545666, + 2.0012270994484425, + 0.2985718920826912, + 0.610553277656436, + 1.0090865269303322, + 0.30271167680621147, + 1.1538893263787031, + 1.252451729029417, + 1.0026576071977615, + 0.23523128032684326, + 1.0295512285083532, + 0.2579763362300582, + 0.6404386255890131, + 2.274205803871155, + 0.6153888143599033, + 0.583997206762433, + 0.3842666279524565, + 0.19045729003846645, + 0.43485930003225803, + 0.05935518816113472, + 2.2632347140461206, + 0.21230526454746723, + 1.9532858114689589, + 0.16587118804454803, + 1.1222476679831743, + 0.6394314132630825, + 0.3342455979436636, + 0.21924348082393408, + 0.5445624589920044, + 1.6308818086981773, + 0.1279437206685543, + 1.2037081010639668, + 3.2403751965612173, + 1.1991242468357086, + 1.7761227674782276, + 2.885701712220907, + 0.22160244174301624, + 0.24678905494511127, + 0.2909306036308408, + 0.19499284774065018, + 2.717662673443556, + 0.5548908486962318, + 0.48695172742009163, + 0.10005869250744581, + 0.499261811375618, + 0.17099614441394806, + 1.5303514171391726, + 0.7437401078641415, + 2.1929742451757193, + 0.3506510630249977 + ], + "unique_experts": 64, + "load_cv": 0.6507754192518899, + "normalized_load_entropy": 0.9498912320146591, + "max_load_share": 0.040100250626566414 + } + }, + "s1_eos": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "ddb10e46c0d3a4694c009c6381a06cfe31d9c284cc9d32c97d65eb8207607665", + "route_weight_sha256": "09e79c0eeec784c5d7cb79a1ffc393c1e1390c33cf59b7c16d3c44f7817fe9eb", + "loads": [ + 22, + 19, + 7, + 4, + 3, + 11, + 1, + 21, + 3, + 16, + 3, + 11, + 4, + 7, + 8, + 19, + 4, + 12, + 7, + 3, + 17, + 10, + 10, + 6, + 22, + 4, + 12, + 20, + 17, + 7, + 6, + 8, + 11, + 1, + 20, + 6, + 22, + 3, + 14, + 9, + 11, + 7, + 0, + 18, + 3, + 14, + 14, + 15, + 15, + 21, + 9, + 6, + 5, + 2, + 16, + 6, + 5, + 3, + 7, + 5, + 21, + 9, + 19, + 7 + ], + "weighted_loads": [ + 1.5615418553352356, + 1.7360705733299255, + 0.2586709838360548, + 0.217997957020998, + 0.12339610792696476, + 0.8243935499340296, + 0.08033371716737747, + 1.4067620616406202, + 0.24081411212682724, + 0.9528904482722282, + 0.07863671705126762, + 0.35359780862927437, + 0.615853413939476, + 0.35156305506825447, + 0.3028165400028229, + 2.0074708610773087, + 0.33548206463456154, + 0.6143558360636234, + 0.997667670249939, + 0.3043982982635498, + 1.079573929309845, + 0.9544689171016216, + 0.6562871485948563, + 0.18270493112504482, + 1.0144427176564932, + 0.20651700720191002, + 0.6291347239166498, + 1.9927780628204346, + 0.5904180482029915, + 0.3591879680752754, + 0.2821075804531574, + 0.21146224439144135, + 0.42928361892700195, + 0.057513996958732605, + 1.1843534614890814, + 0.16805254854261875, + 2.0497185457497835, + 0.16447238251566887, + 1.1263507455587387, + 0.6518623605370522, + 0.3813985623419285, + 0.20545239560306072, + 0.0, + 1.7038192711770535, + 0.12213025614619255, + 1.2111464366316795, + 1.3443775996565819, + 1.2085720859467983, + 1.1839671488851309, + 2.245577709749341, + 0.3015930149704218, + 0.20015931129455566, + 0.27901706099510193, + 0.19987909495830536, + 0.9456613715738058, + 0.45315809920430183, + 0.43469151854515076, + 0.08406127244234085, + 0.4797169528901577, + 0.17398952692747116, + 1.1343380026519299, + 0.7387199867516756, + 1.735407842323184, + 0.27459282986819744 + ], + "unique_experts": 63, + "load_cv": 0.6322868161630557, + "normalized_load_entropy": 0.9494661228920359, + "max_load_share": 0.033950617283950615 + }, + "full_input": { + "tokens": 149, + "top_k": 6, + "decisions": 894, + "ordered_route_sha256": "b1d39bca7064304d48ceaae5b88f141cd7817f636ad101f180722eae6b94cff2", + "route_weight_sha256": "d4a29bac1253adb1e5ef7aba36d975846c74460551765cb07ebb6518c8c6a6b1", + "loads": [ + 36, + 21, + 7, + 15, + 5, + 17, + 1, + 33, + 3, + 25, + 6, + 12, + 8, + 13, + 16, + 20, + 6, + 12, + 8, + 3, + 19, + 16, + 20, + 6, + 24, + 7, + 12, + 23, + 17, + 10, + 8, + 8, + 11, + 3, + 28, + 6, + 22, + 8, + 14, + 10, + 12, + 8, + 13, + 20, + 3, + 17, + 32, + 15, + 23, + 31, + 9, + 12, + 9, + 7, + 22, + 12, + 5, + 4, + 14, + 6, + 32, + 10, + 25, + 14 + ], + "weighted_loads": [ + 3.3641009777784348, + 1.810290353372693, + 0.2586709838360548, + 0.876392126083374, + 0.14564972853986546, + 1.1186987068504095, + 0.08033371716737747, + 2.907944329082966, + 0.24081411212682724, + 1.3930943392333575, + 0.1635696180164814, + 0.3544784500845708, + 0.7048776346200611, + 0.8316981941461563, + 0.835170041769743, + 2.0562063604593277, + 0.5488411299884319, + 0.6143558360636234, + 1.0526776276528835, + 0.3043982982635498, + 1.1459525153040886, + 1.381496336311102, + 1.507041160017252, + 0.18270493112504482, + 1.117830878123641, + 0.2638714423519559, + 0.6291347239166498, + 2.0893677100539207, + 0.5904180482029915, + 0.5409904457628727, + 0.37612780556082726, + 0.21146224439144135, + 0.42928361892700195, + 0.13057183474302292, + 2.09823658503592, + 0.16805254854261875, + 2.0497185457497835, + 0.581356706097722, + 1.1263507455587387, + 0.7021825946867466, + 0.45592760667204857, + 0.21428822353482246, + 0.6508358959108591, + 1.7773742824792862, + 0.12213025614619255, + 1.453208364546299, + 3.7738486602902412, + 1.2085720859467983, + 2.106388671323657, + 2.71169382147491, + 0.3015930149704218, + 0.977510679513216, + 0.49070153199136257, + 0.9155815690755844, + 2.917596710845828, + 0.7819144651293755, + 0.43469151854515076, + 0.09308610297739506, + 0.9658632576465607, + 0.20467518456280231, + 1.8158533107489347, + 0.7887401971966028, + 2.20539172552526, + 0.7216941956430674 + ], + "unique_experts": 64, + "load_cv": 0.6042712240750788, + "normalized_load_entropy": 0.9567322364343398, + "max_load_share": 0.040268456375838924 + } + }, + "s0_bos": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "8a610707344985d1f3a28cdbd4d7e6ea070994196c820c96ebc2c27c64c3f3b7", + "route_weight_sha256": "384be238203c4bfa63e7f1fea7718ccde943121cb3284055b073643490ae35c6", + "loads": [ + 22, + 19, + 5, + 5, + 2, + 11, + 1, + 18, + 6, + 16, + 2, + 12, + 4, + 8, + 6, + 18, + 5, + 11, + 7, + 3, + 17, + 11, + 10, + 5, + 21, + 5, + 12, + 20, + 16, + 8, + 6, + 8, + 12, + 2, + 21, + 6, + 20, + 3, + 13, + 10, + 11, + 6, + 1, + 18, + 3, + 15, + 15, + 15, + 15, + 21, + 8, + 7, + 4, + 2, + 10, + 6, + 6, + 3, + 6, + 6, + 23, + 9, + 22, + 9 + ], + "weighted_loads": [ + 1.4907889813184738, + 1.7687395066022873, + 0.1905600130558014, + 0.23501884378492832, + 0.09992384724318981, + 0.7822824809700251, + 0.0734500139951706, + 1.2021232470870018, + 0.31395526230335236, + 0.9856263604015112, + 0.05468830093741417, + 0.3935351949185133, + 0.635878399014473, + 0.3716667164117098, + 0.2357400767505169, + 1.9452646002173424, + 0.34650855883955956, + 0.5825733933597803, + 0.9932798445224762, + 0.29875561967492104, + 1.0773832350969315, + 0.9777363203465939, + 0.6390429884195328, + 0.15916183218359947, + 0.9321849830448627, + 0.23437250405550003, + 0.643801610916853, + 2.0124388970434666, + 0.5081515740603209, + 0.39255016297101974, + 0.27435298822820187, + 0.21241500973701477, + 0.4634076077491045, + 0.09730803966522217, + 1.1712796557694674, + 0.19758937880396843, + 1.8080174773931503, + 0.17387469485402107, + 1.1069370992481709, + 0.6663932893425226, + 0.39393686316907406, + 0.17427168786525726, + 0.018346590921282768, + 1.6674597933888435, + 0.12573961913585663, + 1.2469428069889545, + 1.4137842655181885, + 1.224567286670208, + 1.065481424331665, + 2.3367543146014214, + 0.2471268717199564, + 0.24126372672617435, + 0.22455960512161255, + 0.19005047529935837, + 0.7186767086386681, + 0.47014420479536057, + 0.4695368129760027, + 0.080367311835289, + 0.48165617510676384, + 0.20212478749454021, + 1.2613323964178562, + 0.7359737679362297, + 1.8346832916140556, + 0.3748257905244827 + ], + "unique_experts": 64, + "load_cv": 0.6208538746014893, + "normalized_load_entropy": 0.9522971554977474, + "max_load_share": 0.035493827160493825 + }, + "full_input": { + "tokens": 133, + "top_k": 6, + "decisions": 798, + "ordered_route_sha256": "e44010ed348b8265a696777b3801f3d3cfa4001c60bc52a31fe86f7053316a62", + "route_weight_sha256": "60c7f35b9df28c64baccda46c42a4b5d7ad5b1d6677b95257a34d37b16158983", + "loads": [ + 33, + 19, + 5, + 15, + 4, + 16, + 1, + 28, + 6, + 21, + 3, + 13, + 5, + 12, + 12, + 18, + 5, + 11, + 8, + 3, + 19, + 14, + 15, + 6, + 21, + 6, + 12, + 27, + 16, + 12, + 8, + 8, + 12, + 2, + 29, + 6, + 20, + 3, + 13, + 10, + 11, + 6, + 11, + 18, + 3, + 15, + 29, + 15, + 23, + 31, + 8, + 7, + 4, + 2, + 14, + 8, + 6, + 3, + 6, + 6, + 29, + 9, + 26, + 11 + ], + "weighted_loads": [ + 3.08299526758492, + 1.7687395066022873, + 0.1905600130558014, + 0.8245019186288118, + 0.12858393712667748, + 1.024098889902234, + 0.0734500139951706, + 2.455915529280901, + 0.31395526230335236, + 1.2316570717957802, + 0.09056182205677032, + 0.3944158363738097, + 0.6363584670179989, + 0.7682349923998117, + 0.6092754676938057, + 1.9452646002173424, + 0.34650855883955956, + 0.5825733933597803, + 1.029328789561987, + 0.29875561967492104, + 1.1491074841469526, + 1.2994601167738438, + 0.9712911769747734, + 0.18651182763278484, + 0.9321849830448627, + 0.23490354308160022, + 0.643801610916853, + 2.274511754512787, + 0.5081515740603209, + 0.6248999051749706, + 0.36957784183323383, + 0.21241500973701477, + 0.4634076077491045, + 0.09730803966522217, + 2.1631793286651373, + 0.19758937880396843, + 1.8080174773931503, + 0.17387469485402107, + 1.1069370992481709, + 0.6663932893425226, + 0.39393686316907406, + 0.17427168786525726, + 0.6823240052908659, + 1.6674597933888435, + 0.12573961913585663, + 1.2469428069889545, + 3.4600452184677124, + 1.224567286670208, + 1.8253167904913425, + 2.952943965792656, + 0.2471268717199564, + 0.24126372672617435, + 0.22455960512161255, + 0.19005047529935837, + 1.8834436312317848, + 0.5652369447052479, + 0.4695368129760027, + 0.080367311835289, + 0.48165617510676384, + 0.20212478749454021, + 1.6670759581029415, + 0.7359737679362297, + 2.2770362123847008, + 0.4475357308983803 + ], + "unique_experts": 64, + "load_cv": 0.6602809095982575, + "normalized_load_entropy": 0.9486017391061334, + "max_load_share": 0.041353383458646614 + } + }, + "s1_bos": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "0b12b25731374c51d789b8afe007f7577a89789a730d7867a8c1865745a0cd28", + "route_weight_sha256": "300157410bac9559b70b3328658091c484e862d239902671ca73d43422c77d56", + "loads": [ + 23, + 19, + 5, + 4, + 2, + 11, + 1, + 20, + 4, + 17, + 2, + 13, + 4, + 7, + 6, + 17, + 4, + 11, + 9, + 3, + 17, + 10, + 10, + 6, + 19, + 4, + 12, + 20, + 19, + 8, + 5, + 7, + 13, + 1, + 21, + 6, + 19, + 3, + 14, + 10, + 13, + 5, + 1, + 17, + 3, + 15, + 16, + 15, + 14, + 21, + 10, + 7, + 7, + 2, + 10, + 6, + 7, + 2, + 6, + 6, + 21, + 9, + 20, + 9 + ], + "weighted_loads": [ + 1.523209998384118, + 1.7037364430725574, + 0.19459793716669083, + 0.18962427601218224, + 0.08118714392185211, + 0.7866791374981403, + 0.0753042921423912, + 1.291721047833562, + 0.2704496309161186, + 1.0101130157709122, + 0.0558521393686533, + 0.42945003882050514, + 0.6341417133808136, + 0.34489185363054276, + 0.23144719190895557, + 1.9483973011374474, + 0.32754697278141975, + 0.584085563197732, + 1.0369177721440792, + 0.29613152146339417, + 1.0762379691004753, + 0.9279299937188625, + 0.6032637432217598, + 0.18308338895440102, + 0.8897849358618259, + 0.19444706663489342, + 0.6421899553388357, + 1.9756379202008247, + 0.6428125910460949, + 0.3708642013370991, + 0.24496294371783733, + 0.1899237185716629, + 0.5146201550960541, + 0.05277771130204201, + 1.2017901353538036, + 0.18932656571269035, + 1.749654658138752, + 0.17374348640441895, + 1.133526237681508, + 0.6798474062234163, + 0.44024630822241306, + 0.15591447241604328, + 0.018293781206011772, + 1.610677793622017, + 0.12695910036563873, + 1.230726983398199, + 1.3933587819337845, + 1.2372139394283295, + 1.0402533784508705, + 2.2394146844744682, + 0.3186374958604574, + 0.2552657015621662, + 0.32205223850905895, + 0.1950445994734764, + 0.6684757955372334, + 0.4475359171628952, + 0.48410250060260296, + 0.0551874004304409, + 0.4408399388194084, + 0.2032743375748396, + 1.1755186021327972, + 0.7339762225747108, + 1.7394270803779364, + 0.37089130096137524 + ], + "unique_experts": 64, + "load_cv": 0.6235484592184884, + "normalized_load_entropy": 0.9506194297844012, + "max_load_share": 0.035493827160493825 + }, + "full_input": { + "tokens": 149, + "top_k": 6, + "decisions": 894, + "ordered_route_sha256": "d5a48ec0af0557467ab163791fbf472a4cbd94240312fdb9794c4150e15c7b51", + "route_weight_sha256": "af30173362f915240e9c3b779c3ccbf813415b066f5f7e3649e05f5731d74f14", + "loads": [ + 38, + 21, + 5, + 15, + 4, + 17, + 1, + 32, + 4, + 26, + 5, + 14, + 7, + 13, + 14, + 18, + 6, + 11, + 11, + 3, + 19, + 16, + 21, + 6, + 21, + 6, + 12, + 23, + 19, + 11, + 7, + 7, + 13, + 3, + 29, + 6, + 19, + 8, + 14, + 11, + 14, + 5, + 15, + 19, + 3, + 18, + 35, + 15, + 23, + 31, + 10, + 13, + 10, + 7, + 15, + 12, + 7, + 2, + 13, + 7, + 32, + 10, + 26, + 16 + ], + "weighted_loads": [ + 3.4289980232715607, + 1.777956223115325, + 0.19459793716669083, + 0.8480184450745583, + 0.10344076453475282, + 1.08974514529109, + 0.0753042921423912, + 2.658760566264391, + 0.2704496309161186, + 1.464316570025403, + 0.14078504033386707, + 0.43033068027580157, + 0.7152033756428864, + 0.8535467647016048, + 0.7850321587175131, + 1.9971328005194664, + 0.5409060381352901, + 0.584085563197732, + 1.1282862201333046, + 0.29613152146339417, + 1.1465785540640354, + 1.3574571125209332, + 1.4670180343091488, + 0.18308338895440102, + 0.9931730963289738, + 0.243002156552393, + 0.6421899553388357, + 2.072227567434311, + 0.6428125910460949, + 0.5503205880522728, + 0.33244762010872364, + 0.1899237185716629, + 0.5146201550960541, + 0.12583554908633232, + 2.1240924410521984, + 0.18932656571269035, + 1.749654658138752, + 0.5906278099864721, + 1.133526237681508, + 0.7301676403731108, + 0.5147753525525331, + 0.15591447241604328, + 0.8156033083796501, + 1.6842328049242496, + 0.12695910036563873, + 1.4727889113128185, + 3.8417146131396294, + 1.2372139394283295, + 2.0561790205538273, + 2.705530796200037, + 0.3186374958604574, + 1.0326170697808266, + 0.5233333613723516, + 0.9107470735907555, + 1.85484279692173, + 0.7731149382889271, + 0.48410250060260296, + 0.0551874004304409, + 0.9269862435758114, + 0.23395999521017075, + 1.8248465601354837, + 0.7839964330196381, + 2.2415137011557817, + 0.8175751734524965 + ], + "unique_experts": 64, + "load_cv": 0.6154321348943285, + "normalized_load_entropy": 0.9550362366794891, + "max_load_share": 0.042505592841163314 + } + }, + "s0_x": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "ccef81433aa9243144f4b841f3fa021669e5c2b9f55ec047314457b1c234e3b4", + "route_weight_sha256": "5dd7e474a804539604925ece90f59aa6e4bd1e74414c6b9159e3f4414b645a73", + "loads": [ + 22, + 19, + 5, + 5, + 2, + 11, + 1, + 17, + 9, + 15, + 2, + 10, + 4, + 8, + 6, + 18, + 5, + 11, + 8, + 3, + 17, + 12, + 9, + 5, + 22, + 5, + 12, + 20, + 18, + 8, + 5, + 8, + 12, + 2, + 21, + 5, + 20, + 3, + 13, + 10, + 10, + 5, + 1, + 18, + 3, + 15, + 15, + 15, + 15, + 21, + 10, + 7, + 5, + 2, + 10, + 6, + 6, + 3, + 6, + 5, + 24, + 9, + 20, + 9 + ], + "weighted_loads": [ + 1.518478199839592, + 1.7611161805689335, + 0.19274643808603287, + 0.24303300492465496, + 0.09775983542203903, + 0.7792251165956259, + 0.07650523632764816, + 1.1848837528377771, + 0.3775585852563381, + 0.9601550325751305, + 0.05480731092393398, + 0.31769915856420994, + 0.6190528944134712, + 0.3645655196160078, + 0.24345015548169613, + 1.9421517681330442, + 0.34680869802832603, + 0.5842771474272013, + 1.0330115370452404, + 0.301251083612442, + 1.0775023438036442, + 1.049350205808878, + 0.5483104437589645, + 0.15866855904459953, + 0.9613288454711437, + 0.23066610097885132, + 0.6458203941583633, + 2.0274971406906843, + 0.5924265198409557, + 0.39525487646460533, + 0.24648652411997318, + 0.21380813047289848, + 0.46550206653773785, + 0.10140537843108177, + 1.1762419883161783, + 0.1643959078937769, + 1.720402443781495, + 0.1746109575033188, + 1.1112154629081488, + 0.6689510811120272, + 0.3579241372644901, + 0.1503638606518507, + 0.0182508435100317, + 1.6297699175775051, + 0.12780458107590675, + 1.2621765527874231, + 1.4340228661894798, + 1.2235336229205132, + 1.085838422179222, + 2.320919508114457, + 0.32680199667811394, + 0.24572273902595043, + 0.25608503073453903, + 0.19150792062282562, + 0.6950118616223335, + 0.47718988358974457, + 0.4732441324740648, + 0.08040124177932739, + 0.46495331078767776, + 0.16746548004448414, + 1.3510849997401237, + 0.7293995022773743, + 1.805190546438098, + 0.3777896221727133 + ], + "unique_experts": 64, + "load_cv": 0.6218350745413841, + "normalized_load_entropy": 0.9521621612866858, + "max_load_share": 0.037037037037037035 + }, + "full_input": { + "tokens": 133, + "top_k": 6, + "decisions": 798, + "ordered_route_sha256": "ea76850c4eeebc1dff8fae60700c290fae275f86868b5d8a899c9a29ccbb266c", + "route_weight_sha256": "2c58d12f7cd7c804071df0e6403554e7a37fc8672b5d1aecd01e0eb8a2eb1c2b", + "loads": [ + 31, + 19, + 5, + 16, + 5, + 15, + 1, + 27, + 9, + 20, + 3, + 11, + 5, + 12, + 12, + 18, + 5, + 11, + 8, + 3, + 18, + 15, + 14, + 6, + 22, + 6, + 13, + 28, + 18, + 12, + 7, + 8, + 12, + 2, + 30, + 5, + 21, + 3, + 13, + 10, + 10, + 5, + 11, + 18, + 3, + 15, + 29, + 15, + 21, + 32, + 10, + 7, + 5, + 2, + 14, + 8, + 6, + 3, + 6, + 5, + 30, + 9, + 24, + 11 + ], + "weighted_loads": [ + 2.808654148131609, + 1.7611161805689335, + 0.19274643808603287, + 0.9656409826129675, + 0.15739762893645093, + 0.9788903798907995, + 0.07650523632764816, + 2.4410174172371626, + 0.3775585852563381, + 1.2276857875403948, + 0.09068083204329014, + 0.31857980001950637, + 0.6195329624169972, + 0.7591301929205656, + 0.5838336888700724, + 1.9421517681330442, + 0.34680869802832603, + 0.5842771474272013, + 1.0330115370452404, + 0.301251083612442, + 1.1042102258652449, + 1.376931082457304, + 0.8770577274262905, + 0.1860185544937849, + 0.9613288454711437, + 0.2311971400049515, + 0.6878084726631641, + 2.337049713358283, + 0.5924265198409557, + 0.6348308101296425, + 0.3417109753936529, + 0.21380813047289848, + 0.46550206653773785, + 0.10140537843108177, + 2.269326312467456, + 0.1643959078937769, + 1.7687162067741156, + 0.1746109575033188, + 1.1112154629081488, + 0.6689510811120272, + 0.3579241372644901, + 0.1503638606518507, + 0.6420994009822607, + 1.6297699175775051, + 0.12780458107590675, + 1.2621765527874231, + 3.4943525288254023, + 1.2235336229205132, + 1.694857195019722, + 3.0009157229214907, + 0.32680199667811394, + 0.24572273902595043, + 0.25608503073453903, + 0.19150792062282562, + 1.8385055549442768, + 0.5776469297707081, + 0.4732441324740648, + 0.08040124177932739, + 0.46495331078767776, + 0.16746548004448414, + 1.8056364357471466, + 0.7293995022773743, + 2.246994448825717, + 0.451748738065362 + ], + "unique_experts": 64, + "load_cv": 0.6561583482600403, + "normalized_load_entropy": 0.9492085956110456, + "max_load_share": 0.040100250626566414 + } + }, + "s1_x": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "9b0e9c6ba46b8ee865cd976b9de0af7962d70b361e88d4cf2ceed93292c42513", + "route_weight_sha256": "4c5fb7edc9c130c6deee6f70cab9f66adb537c7660ba3f424fa34f1c2d001c54", + "loads": [ + 23, + 19, + 5, + 4, + 1, + 11, + 1, + 18, + 5, + 17, + 2, + 13, + 4, + 6, + 6, + 17, + 5, + 12, + 9, + 3, + 17, + 10, + 9, + 7, + 21, + 4, + 12, + 20, + 19, + 8, + 5, + 7, + 13, + 1, + 20, + 5, + 20, + 3, + 15, + 10, + 10, + 6, + 1, + 17, + 3, + 15, + 18, + 15, + 14, + 21, + 12, + 6, + 7, + 2, + 10, + 6, + 6, + 1, + 7, + 5, + 21, + 9, + 20, + 9 + ], + "weighted_loads": [ + 1.5183035153895617, + 1.695541586726904, + 0.1988031454384327, + 0.19080022908747196, + 0.025856725871562958, + 0.8096882831305265, + 0.07627435028553009, + 1.2306513842195272, + 0.29505137354135513, + 1.0361712388694286, + 0.055734485387802124, + 0.42606278508901596, + 0.6232990026473999, + 0.3151962123811245, + 0.24296684563159943, + 1.9482318703085184, + 0.3522985093295574, + 0.6259199734777212, + 1.0431716069579124, + 0.2991435080766678, + 1.087559413164854, + 0.9311506524682045, + 0.5300176739692688, + 0.21538567915558815, + 0.9557083640247583, + 0.19411134719848633, + 0.6399825625121593, + 1.9892399944365025, + 0.6537637375295162, + 0.37127150408923626, + 0.24415064044296741, + 0.18862505815923214, + 0.5231944341212511, + 0.05269746854901314, + 1.1799210458993912, + 0.16395176388323307, + 1.7207620106637478, + 0.17669246345758438, + 1.1582727786153555, + 0.6833780817687511, + 0.3481276426464319, + 0.1803988292813301, + 0.01866227574646473, + 1.6065117046236992, + 0.12722038850188255, + 1.2502415515482426, + 1.5008616335690022, + 1.2272708341479301, + 1.0612972863018513, + 2.2103453800082207, + 0.38651055842638016, + 0.2283971905708313, + 0.3306083120405674, + 0.19801075011491776, + 0.6310094855725765, + 0.4448901005089283, + 0.4634768217802048, + 0.03235708922147751, + 0.48409872129559517, + 0.16553436405956745, + 1.2136182766407728, + 0.7293659225106239, + 1.7550532352179289, + 0.377811711281538 + ], + "unique_experts": 64, + "load_cv": 0.6315632376507981, + "normalized_load_entropy": 0.9488699124557969, + "max_load_share": 0.035493827160493825 + }, + "full_input": { + "tokens": 149, + "top_k": 6, + "decisions": 894, + "ordered_route_sha256": "c502a46fe928f738b8ccef4590390b5e3c2664b1b0e628c97c0cb57686d45487", + "route_weight_sha256": "74dc1d9909b42be3309dd5e4421e97da644010d93edaccb75fc54e6393bd6b08", + "loads": [ + 36, + 21, + 5, + 16, + 4, + 17, + 1, + 30, + 5, + 26, + 5, + 14, + 7, + 12, + 14, + 18, + 7, + 12, + 10, + 3, + 18, + 16, + 19, + 7, + 23, + 6, + 13, + 24, + 19, + 12, + 7, + 7, + 13, + 3, + 28, + 5, + 21, + 8, + 15, + 11, + 11, + 6, + 15, + 19, + 3, + 18, + 36, + 15, + 22, + 32, + 12, + 12, + 10, + 7, + 15, + 12, + 6, + 1, + 14, + 6, + 32, + 10, + 26, + 16 + ], + "weighted_loads": [ + 3.1552980542182922, + 1.7697613667696714, + 0.1988031454384327, + 0.9966084863990545, + 0.07929251453606412, + 1.0865565743297338, + 0.07627435028553009, + 2.5892223976552486, + 0.29505137354135513, + 1.5112611770746298, + 0.1406673863530159, + 0.4269434265443124, + 0.7043606649094727, + 0.8148157335817814, + 0.7705865129828453, + 1.9969673696905375, + 0.5656575746834278, + 0.6259199734777212, + 1.098181564360857, + 0.2991435080766678, + 1.1196387633681297, + 1.3663329407572746, + 1.3769217617809772, + 0.21538567915558815, + 1.0590965244919062, + 0.2426664371159859, + 0.6791079230606556, + 2.130979299545288, + 0.6537637375295162, + 0.5936595480889082, + 0.33139323629438877, + 0.18862505815923214, + 0.5231944341212511, + 0.12575530633330345, + 2.1473031491041183, + 0.16395176388323307, + 1.7611647546291351, + 0.5935767870396376, + 1.1582727786153555, + 0.7336983159184456, + 0.422656686976552, + 0.1803988292813301, + 0.7305037267506123, + 1.680066715925932, + 0.12722038850188255, + 1.492303479462862, + 3.929122757166624, + 1.2272708341479301, + 1.9660983383655548, + 2.7357022911310196, + 0.38651055842638016, + 1.0057485587894917, + 0.5318894349038601, + 0.9137132242321968, + 1.793785771355033, + 0.7746992781758308, + 0.4634768217802048, + 0.03235708922147751, + 0.9702450260519981, + 0.1962200216948986, + 1.916056014597416, + 0.7793861329555511, + 2.2413517255336046, + 0.8248758539557457 + ], + "unique_experts": 64, + "load_cv": 0.6102053710170464, + "normalized_load_entropy": 0.9552376636828736, + "max_load_share": 0.040268456375838924 + } + }, + "s0_period": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "c44302f88853fb6d598deec6c5ce1142b8e3487f9efca8b84ad12d78c811efd8", + "route_weight_sha256": "9038faf61894a1f662b8f318f9208c573e992548379d4e638c6e24bc498f6a49", + "loads": [ + 22, + 19, + 6, + 5, + 2, + 10, + 1, + 18, + 10, + 15, + 2, + 12, + 4, + 8, + 6, + 18, + 5, + 11, + 8, + 3, + 17, + 12, + 10, + 6, + 22, + 5, + 12, + 20, + 15, + 8, + 5, + 8, + 12, + 2, + 21, + 5, + 20, + 3, + 13, + 10, + 10, + 5, + 1, + 18, + 3, + 15, + 15, + 15, + 15, + 21, + 10, + 6, + 5, + 2, + 9, + 6, + 6, + 3, + 6, + 5, + 23, + 9, + 20, + 9 + ], + "weighted_loads": [ + 1.4676773361861706, + 1.7547062896192074, + 0.219820749014616, + 0.23890537209808826, + 0.09998544864356518, + 0.7333466336131096, + 0.07613382488489151, + 1.222430508583784, + 0.4135143347084522, + 0.968901414424181, + 0.05509291589260101, + 0.38634826242923737, + 0.6172974333167076, + 0.3620595484972, + 0.24064289964735508, + 1.9455077461898327, + 0.3459705263376236, + 0.5851519126445055, + 1.0430980548262596, + 0.302942730486393, + 1.0816251710057259, + 1.0574877746403217, + 0.60164700075984, + 0.17972434125840664, + 0.9627869315445423, + 0.2363225445151329, + 0.6466688383370638, + 2.0211869422346354, + 0.5093384757637978, + 0.39748612977564335, + 0.24685166217386723, + 0.21373029239475727, + 0.46747272834181786, + 0.10004884749650955, + 1.1794756408780813, + 0.15694941952824593, + 1.7159943208098412, + 0.17192338034510612, + 1.1113310866057873, + 0.6687344368547201, + 0.3631494250148535, + 0.15203385427594185, + 0.018048081547021866, + 1.6399550549685955, + 0.12757990509271622, + 1.2510337084531784, + 1.4183676801621914, + 1.2204343490302563, + 1.0607623476535082, + 2.318669443950057, + 0.3252262994647026, + 0.21371584571897984, + 0.26007348485291004, + 0.19095613807439804, + 0.6536092069000006, + 0.46807389706373215, + 0.4710649084299803, + 0.08041915483772755, + 0.4634856879711151, + 0.167564507573843, + 1.287925161421299, + 0.73807143419981, + 1.792196411639452, + 0.38647985830903053 + ], + "unique_experts": 64, + "load_cv": 0.6144378833644101, + "normalized_load_entropy": 0.9530794366585694, + "max_load_share": 0.035493827160493825 + }, + "full_input": { + "tokens": 133, + "top_k": 6, + "decisions": 798, + "ordered_route_sha256": "388751a4ef195492d163ad2001f6e994ec31d05eb9687af04393645f1e32c877", + "route_weight_sha256": "55493d1681655873996f662acb335db549bc52fa39c324ed62fba3b31f0310a4", + "loads": [ + 31, + 20, + 6, + 16, + 5, + 14, + 1, + 28, + 10, + 21, + 3, + 13, + 5, + 12, + 12, + 18, + 5, + 11, + 8, + 3, + 18, + 15, + 16, + 7, + 22, + 6, + 12, + 27, + 15, + 12, + 7, + 8, + 12, + 2, + 29, + 5, + 20, + 3, + 13, + 10, + 10, + 5, + 11, + 18, + 3, + 16, + 29, + 15, + 21, + 31, + 10, + 6, + 5, + 2, + 13, + 8, + 6, + 3, + 7, + 5, + 29, + 9, + 24, + 11 + ], + "weighted_loads": [ + 2.687896365299821, + 1.902341928333044, + 0.219820749014616, + 0.8986051771789789, + 0.16851598693756387, + 0.9334949813783169, + 0.07613382488489151, + 2.536176685243845, + 0.4135143347084522, + 1.3932466328260489, + 0.09096643701195717, + 0.3872289038845338, + 0.6177775013202336, + 0.754142165184021, + 0.7064338866621256, + 1.9455077461898327, + 0.3459705263376236, + 0.5851519126445055, + 1.0430980548262596, + 0.302942730486393, + 1.1083330530673265, + 1.3818708397448063, + 0.9848292991518974, + 0.207074336707592, + 0.9627869315445423, + 0.2368535835412331, + 0.6466688383370638, + 2.2832597997039557, + 0.5093384757637978, + 0.6275615189224482, + 0.34265108220279217, + 0.21373029239475727, + 0.46747272834181786, + 0.10004884749650955, + 2.1713753137737513, + 0.15694941952824593, + 1.7159943208098412, + 0.17192338034510612, + 1.1113310866057873, + 0.6687344368547201, + 0.3631494250148535, + 0.15203385427594185, + 0.644784439355135, + 1.6399550549685955, + 0.12757990509271622, + 1.3011598736047745, + 3.449479326605797, + 1.2204343490302563, + 1.6565881203860044, + 2.9348590951412916, + 0.3252262994647026, + 0.21371584571897984, + 0.26007348485291004, + 0.19095613807439804, + 1.793379982933402, + 0.5667289793491364, + 0.4710649084299803, + 0.08041915483772755, + 0.5029573254287243, + 0.167564507573843, + 1.6962409242987633, + 0.73807143419981, + 2.256828974932432, + 0.4605141133069992 + ], + "unique_experts": 64, + "load_cv": 0.6453475920878621, + "normalized_load_entropy": 0.950567027663752, + "max_load_share": 0.03884711779448621 + } + }, + "s1_period": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "46cc75277148e46e4d1f1418a6f62486d2b9cd33fcb9438505cf1d7e21ce4a8b", + "route_weight_sha256": "105f429bb63b5cd157eb05688ea19a25882fe87a6250097a1a31120a324b78f6", + "loads": [ + 23, + 19, + 5, + 4, + 2, + 11, + 1, + 17, + 5, + 17, + 2, + 13, + 4, + 6, + 6, + 17, + 5, + 12, + 9, + 3, + 17, + 11, + 8, + 7, + 21, + 4, + 12, + 20, + 19, + 8, + 5, + 7, + 13, + 1, + 20, + 6, + 19, + 3, + 14, + 10, + 11, + 5, + 1, + 17, + 3, + 15, + 17, + 15, + 14, + 21, + 12, + 6, + 7, + 2, + 10, + 6, + 6, + 2, + 6, + 5, + 23, + 9, + 20, + 9 + ], + "weighted_loads": [ + 1.5090633742511272, + 1.6998853161931038, + 0.19630859419703484, + 0.1894564963877201, + 0.07782412320375443, + 0.8078464511781931, + 0.076195128262043, + 1.1913001518696547, + 0.29389641992747784, + 1.0431061517447233, + 0.05558008700609207, + 0.42675984278321266, + 0.6222874745726585, + 0.3141871504485607, + 0.2387813664972782, + 1.9449147898703814, + 0.35223926790058613, + 0.6244354769587517, + 1.0474020410329103, + 0.29911210387945175, + 1.0822775177657604, + 0.9854761436581612, + 0.4739139638841152, + 0.21472003869712353, + 0.947666248306632, + 0.19440272822976112, + 0.6396114192903042, + 1.9854387044906616, + 0.6541986893862486, + 0.3731750436127186, + 0.24528883211314678, + 0.18824076279997826, + 0.5241691656410694, + 0.0525892935693264, + 1.1840308215469122, + 0.18719732947647572, + 1.670873984694481, + 0.17640536278486252, + 1.140314156189561, + 0.6790515705943108, + 0.3921150956302881, + 0.15682178549468517, + 0.018709026277065277, + 1.6285957731306553, + 0.127130676060915, + 1.248191762715578, + 1.4599429108202457, + 1.2227732688188553, + 1.0517910793423653, + 2.2162388619035482, + 0.3829796202480793, + 0.22859527356922626, + 0.33219643495976925, + 0.19703028351068497, + 0.6257894523441792, + 0.4378855340182781, + 0.4610768295824528, + 0.05445809289813042, + 0.4310206323862076, + 0.16615596786141396, + 1.3028515558689833, + 0.7290574442595243, + 1.754867883399129, + 0.38459172658622265 + ], + "unique_experts": 64, + "load_cv": 0.6276900651301808, + "normalized_load_entropy": 0.9502512741473811, + "max_load_share": 0.035493827160493825 + }, + "full_input": { + "tokens": 149, + "top_k": 6, + "decisions": 894, + "ordered_route_sha256": "f1ea3574faab65bc1124b2fc76518a3ea1a330dc9a91847e4253f125c561df81", + "route_weight_sha256": "a55f77627c9c002cec5f1e0f8f372808fbd3e400af42d96ee9f4dcbb2401c84e", + "loads": [ + 35, + 22, + 5, + 16, + 5, + 17, + 1, + 30, + 5, + 27, + 5, + 14, + 7, + 12, + 14, + 18, + 7, + 12, + 10, + 3, + 18, + 17, + 19, + 7, + 23, + 6, + 12, + 23, + 19, + 12, + 7, + 7, + 13, + 3, + 27, + 6, + 19, + 8, + 14, + 11, + 12, + 5, + 16, + 19, + 3, + 19, + 35, + 15, + 21, + 31, + 12, + 12, + 10, + 7, + 15, + 12, + 6, + 2, + 14, + 6, + 34, + 10, + 26, + 16 + ], + "weighted_loads": [ + 3.05020073056221, + 1.8826534692198038, + 0.19630859419703484, + 0.9065282866358757, + 0.13687634392408654, + 1.086812511086464, + 0.076195128262043, + 2.6386082135140896, + 0.29389641992747784, + 1.6431570377317257, + 0.14051298797130585, + 0.4276404842385091, + 0.7033491368347313, + 0.8065402917563915, + 0.8472077883780003, + 1.9936502892524004, + 0.5655983332544565, + 0.6244354769587517, + 1.102411998435855, + 0.29911210387945175, + 1.114356867969036, + 1.4180101081728935, + 1.3920906037092209, + 0.21472003869712353, + 1.0510544087737799, + 0.2429578181472607, + 0.6396114192903042, + 2.082028351724148, + 0.6541986893862486, + 0.5888682492077351, + 0.33226256258785725, + 0.18824076279997826, + 0.5241691656410694, + 0.12564713135361671, + 2.0584093909710646, + 0.18719732947647572, + 1.670873984694481, + 0.5932896863669157, + 1.140314156189561, + 0.7293718047440052, + 0.4666441399604082, + 0.15682178549468517, + 0.822502912953496, + 1.702150784432888, + 0.127130676060915, + 1.5509657636284828, + 3.8913062028586864, + 1.2227732688188553, + 1.9112118631601334, + 2.682354973629117, + 0.3829796202480793, + 1.0059466417878866, + 0.5334775578230619, + 0.912732757627964, + 1.7814680375158787, + 0.7660155594348907, + 0.4610768295824528, + 0.05445809289813042, + 0.9651695676147938, + 0.1968416254967451, + 1.960727795958519, + 0.7790776547044516, + 2.2502579148858786, + 0.8312167432159185 + ], + "unique_experts": 64, + "load_cv": 0.6022801823522353, + "normalized_load_entropy": 0.9566331263589357, + "max_load_share": 0.039149888143176735 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 108, + "ordered_topk_exact_tokens": 75, + "set_exact_tokens": 84, + "mean_set_jaccard": 0.9325396825396827, + "mean_token_weighted_tv": 0.012505685134480396, + "aggregate_load_tv": 0.026234567901234566 + }, + "system_bos": { + "tokens": 108, + "ordered_topk_exact_tokens": 75, + "set_exact_tokens": 81, + "mean_set_jaccard": 0.9246031746031746, + "mean_token_weighted_tv": 0.0156461287945233, + "aggregate_load_tv": 0.033950617283950615 + }, + "system_x": { + "tokens": 108, + "ordered_topk_exact_tokens": 64, + "set_exact_tokens": 72, + "mean_set_jaccard": 0.8968253968253969, + "mean_token_weighted_tv": 0.020671323838609236, + "aggregate_load_tv": 0.037037037037037035 + }, + "system_period": { + "tokens": 108, + "ordered_topk_exact_tokens": 67, + "set_exact_tokens": 77, + "mean_set_jaccard": 0.9100529100529102, + "mean_token_weighted_tv": 0.018594963622658892, + "aggregate_load_tv": 0.035493827160493825 + }, + "bos_at_s0": { + "tokens": 108, + "ordered_topk_exact_tokens": 51, + "set_exact_tokens": 68, + "mean_set_jaccard": 0.8921957671957672, + "mean_token_weighted_tv": 0.02109355733005537, + "aggregate_load_tv": 0.038580246913580245 + }, + "bos_at_s1": { + "tokens": 108, + "ordered_topk_exact_tokens": 48, + "set_exact_tokens": 63, + "mean_set_jaccard": 0.8769841269841271, + "mean_token_weighted_tv": 0.023922785168030748, + "aggregate_load_tv": 0.046296296296296294 + }, + "x_at_s0": { + "tokens": 108, + "ordered_topk_exact_tokens": 54, + "set_exact_tokens": 66, + "mean_set_jaccard": 0.886904761904762, + "mean_token_weighted_tv": 0.02275005383072076, + "aggregate_load_tv": 0.04166666666666667 + }, + "x_at_s1": { + "tokens": 108, + "ordered_topk_exact_tokens": 47, + "set_exact_tokens": 60, + "mean_set_jaccard": 0.863095238095238, + "mean_token_weighted_tv": 0.026988113488726043, + "aggregate_load_tv": 0.04938271604938271 + }, + "period_at_s0": { + "tokens": 108, + "ordered_topk_exact_tokens": 55, + "set_exact_tokens": 68, + "mean_set_jaccard": 0.8921957671957672, + "mean_token_weighted_tv": 0.021966367632288625, + "aggregate_load_tv": 0.044753086419753084 + }, + "period_at_s1": { + "tokens": 108, + "ordered_topk_exact_tokens": 49, + "set_exact_tokens": 63, + "mean_set_jaccard": 0.8694885361552029, + "mean_token_weighted_tv": 0.026727021990895824, + "aggregate_load_tv": 0.05092592592592592 + } + } + }, + "layer_04": { + "layer": 4, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "3ed705cd2c53fefd737cedfe5c7e2d4c04b0ac5f87c4ad6f52f859ee2f80c0d9", + "route_weight_sha256": "c2eafcfa5e5f4bb9084448a498b990314c576ddab3a019a81316f032d2f51da9", + "loads": [ + 13, + 12, + 11, + 13, + 1, + 2, + 4, + 17, + 5, + 3, + 20, + 11, + 3, + 26, + 7, + 9, + 8, + 8, + 15, + 1, + 3, + 6, + 10, + 6, + 10, + 6, + 8, + 10, + 8, + 15, + 2, + 28, + 7, + 2, + 8, + 19, + 4, + 3, + 6, + 6, + 22, + 11, + 18, + 9, + 6, + 20, + 13, + 4, + 28, + 3, + 8, + 11, + 9, + 1, + 4, + 17, + 12, + 14, + 8, + 15, + 35, + 5, + 2, + 17 + ], + "weighted_loads": [ + 0.4286805223673582, + 0.4246350210160017, + 0.38112534768879414, + 1.0225130021572113, + 0.03165139630436897, + 0.10224489122629166, + 0.20070678927004337, + 1.228164592757821, + 0.264732887968421, + 0.14739755913615227, + 1.7891700752079487, + 0.3806278817355633, + 0.1035896334797144, + 1.1697358917444944, + 0.22455336712300777, + 0.27903334237635136, + 0.388653676956892, + 0.625854030251503, + 0.6083630938082933, + 0.07376539707183838, + 0.15500330366194248, + 0.19411606527864933, + 0.6111027244478464, + 0.32485732063651085, + 0.7322009578347206, + 0.390050346031785, + 0.5913558639585972, + 0.5625258143991232, + 0.2778007537126541, + 0.8033485822379589, + 0.08137575164437294, + 1.736149176955223, + 0.2169110793620348, + 0.07891223207116127, + 0.4848114773631096, + 0.86929134093225, + 0.118732500821352, + 0.11098978482186794, + 0.40583488158881664, + 0.37901098281145096, + 2.9151930771768093, + 0.9671363495290279, + 1.0209244284778833, + 0.40280143916606903, + 0.2460437286645174, + 1.1044902075082064, + 0.9005965925753117, + 0.19507074728608131, + 2.4664785154163837, + 0.10017192363739014, + 0.44791190326213837, + 0.4334845282137394, + 0.5259117670357227, + 0.031034229323267937, + 0.2944363243877888, + 1.135650809854269, + 0.5426350738853216, + 1.1181644201278687, + 0.5017075128853321, + 1.134440440684557, + 3.739917691797018, + 0.16884096339344978, + 0.09289945289492607, + 1.7009778693318367 + ], + "unique_experts": 64, + "load_cv": 0.7174316160872907, + "normalized_load_entropy": 0.9418144675006516, + "max_load_share": 0.05401234567901234 + }, + "full_input": { + "tokens": 133, + "top_k": 6, + "decisions": 798, + "ordered_route_sha256": "79edd80431d701e6a61ccaed377956383c411d360805fb9ccb1b7a68247c5251", + "route_weight_sha256": "57859ecb6ad64982d0cb94318be2b06a724fd0efd55a72e6f6bd56ebab4cda2b", + "loads": [ + 13, + 15, + 14, + 17, + 1, + 2, + 6, + 17, + 5, + 3, + 30, + 13, + 3, + 39, + 10, + 12, + 8, + 8, + 19, + 1, + 3, + 8, + 12, + 6, + 10, + 12, + 14, + 11, + 9, + 32, + 2, + 30, + 7, + 4, + 19, + 19, + 4, + 5, + 7, + 6, + 25, + 14, + 26, + 9, + 6, + 22, + 24, + 4, + 29, + 5, + 9, + 11, + 9, + 1, + 4, + 17, + 12, + 14, + 8, + 26, + 39, + 5, + 5, + 18 + ], + "weighted_loads": [ + 0.4286805223673582, + 0.5661782678216696, + 0.5251936763525009, + 1.2902943371445872, + 0.03165139630436897, + 0.10224489122629166, + 0.3046968039125204, + 1.228164592757821, + 0.264732887968421, + 0.14739755913615227, + 2.44556718878448, + 0.40710972994565964, + 0.1035896334797144, + 2.0842432994395494, + 0.2994816843420267, + 0.4551559407263994, + 0.388653676956892, + 0.625854030251503, + 0.8217813905794173, + 0.07376539707183838, + 0.15500330366194248, + 1.2589809689670801, + 0.730859799310565, + 0.32485732063651085, + 0.7322009578347206, + 0.8319341633468866, + 1.1245293952524662, + 0.5704890359193087, + 0.30193926207721233, + 2.1305879377177916, + 0.08137575164437294, + 1.767104915343225, + 0.2169110793620348, + 0.11918115522712469, + 1.5358005505113397, + 0.86929134093225, + 0.118732500821352, + 0.19210494495928288, + 1.4025204461067915, + 0.37901098281145096, + 3.055592693388462, + 1.1864813789725304, + 1.381668757647276, + 0.40280143916606903, + 0.2460437286645174, + 1.302283350378275, + 2.0495522394776344, + 0.19507074728608131, + 2.503412675112486, + 0.15052411332726479, + 0.4949124790728092, + 0.4334845282137394, + 0.5259117670357227, + 0.031034229323267937, + 0.2944363243877888, + 1.135650809854269, + 0.5426350738853216, + 1.1181644201278687, + 0.5017075128853321, + 1.785050518810749, + 4.210496447078185, + 0.16884096339344978, + 0.30416837334632874, + 1.7370856702327728 + ], + "unique_experts": 64, + "load_cv": 0.7422567155319736, + "normalized_load_entropy": 0.9374726511879287, + "max_load_share": 0.04887218045112782 + } + }, + "s1_eos": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "dadd511e5bcd1af756d19d22e88e761ae18d038ec2bd0a339f3c1182baffc1b5", + "route_weight_sha256": "a14b67fde043f0fab1aa949407e40192f08615872cf55676ed48de3e32253a6e", + "loads": [ + 14, + 9, + 9, + 13, + 1, + 2, + 4, + 17, + 4, + 2, + 19, + 12, + 3, + 27, + 8, + 9, + 8, + 9, + 14, + 1, + 3, + 5, + 10, + 6, + 11, + 6, + 9, + 11, + 9, + 15, + 2, + 28, + 8, + 3, + 8, + 18, + 4, + 3, + 6, + 7, + 22, + 11, + 18, + 10, + 5, + 20, + 12, + 4, + 28, + 3, + 9, + 11, + 9, + 1, + 4, + 17, + 10, + 14, + 8, + 16, + 36, + 4, + 2, + 17 + ], + "weighted_loads": [ + 0.45697958022356033, + 0.33731425553560257, + 0.30275902710855007, + 1.032545544207096, + 0.03203263506293297, + 0.10046753659844398, + 0.20070677436888218, + 1.2358189467340708, + 0.24299035221338272, + 0.1097995936870575, + 1.747088186442852, + 0.428871750831604, + 0.10596816055476665, + 1.20379520021379, + 0.25623576901853085, + 0.2874460928142071, + 0.3828852213919163, + 0.651323514059186, + 0.5925066284835339, + 0.07009771466255188, + 0.15945404209196568, + 0.14900281839072704, + 0.5946637932211161, + 0.3329332396388054, + 0.7618300393223763, + 0.3940410129725933, + 0.6156781632453203, + 0.5775994379073381, + 0.3143858313560486, + 0.7760498467832804, + 0.08298879861831665, + 1.7089359983801842, + 0.24841017834842205, + 0.10376398079097271, + 0.4696602448821068, + 0.8508293740451336, + 0.12551481276750565, + 0.11264495737850666, + 0.41089075058698654, + 0.39983952045440674, + 2.9291964024305344, + 0.9592479728162289, + 1.0221467819064856, + 0.4446414113044739, + 0.22234229743480682, + 1.1198655292391777, + 0.8637466132640839, + 0.1988176591694355, + 2.4440078642219305, + 0.10184028744697571, + 0.4805409274995327, + 0.43413105234503746, + 0.5033641215413809, + 0.032658424228429794, + 0.29679711535573006, + 1.149554144591093, + 0.4759939704090357, + 1.0925819166004658, + 0.49313658475875854, + 1.181077528744936, + 3.7550777047872543, + 0.14014184847474098, + 0.09646729752421379, + 1.7004369162023067 + ], + "unique_experts": 64, + "load_cv": 0.7237769484987582, + "normalized_load_entropy": 0.9410334450343404, + "max_load_share": 0.05555555555555555 + }, + "full_input": { + "tokens": 149, + "top_k": 6, + "decisions": 894, + "ordered_route_sha256": "cd9bc13cdbe3153e74cba68c1bd812fd434baeeee5e1567acfa7775aa5ad9cf8", + "route_weight_sha256": "62116ef5cf4e821bb5783ba78c25d9a9894e44fd2cf125367a6f44757b153f35", + "loads": [ + 14, + 11, + 14, + 22, + 1, + 2, + 8, + 17, + 4, + 11, + 28, + 14, + 4, + 41, + 11, + 13, + 10, + 11, + 21, + 3, + 4, + 8, + 15, + 7, + 11, + 16, + 18, + 12, + 9, + 35, + 2, + 30, + 8, + 5, + 23, + 18, + 5, + 6, + 10, + 10, + 25, + 17, + 27, + 10, + 6, + 23, + 22, + 8, + 29, + 6, + 11, + 11, + 13, + 5, + 10, + 17, + 15, + 16, + 8, + 29, + 43, + 6, + 6, + 19 + ], + "weighted_loads": [ + 0.45697958022356033, + 0.4563576653599739, + 0.5217256117612123, + 1.7687793399381917, + 0.03203263506293297, + 0.10046753659844398, + 0.46008759178221226, + 1.2358189467340708, + 0.24299035221338272, + 1.1849070340394974, + 2.336255507543683, + 0.45527807995676994, + 0.2108559813350439, + 2.1849609073251486, + 0.3310557473450899, + 0.5419706478714943, + 0.7473773397505283, + 0.7219056095927954, + 1.1393288227554876, + 0.1601044200360775, + 0.20855761133134365, + 1.2451527919620275, + 1.0142402108758688, + 0.4271215870976448, + 0.7618300393223763, + 1.10684809461236, + 1.4270485807210207, + 0.5858696456998587, + 0.3143858313560486, + 2.0227447133511305, + 0.08298879861831665, + 1.7395518384873867, + 0.24841017834842205, + 0.1444612331688404, + 1.876044630043907, + 0.8508293740451336, + 0.15276220440864563, + 0.23384512774646282, + 1.6338495798408985, + 0.6105452217161655, + 3.0904537960886955, + 1.2697108084976207, + 1.4534322004765272, + 0.4446414113044739, + 0.2605273947119713, + 1.2823065374686848, + 2.0506628528237343, + 0.5375490225851536, + 2.4737464915961027, + 0.1881801262497902, + 0.5731995068490505, + 0.43413105234503746, + 0.9379268642514944, + 0.21625450253486633, + 0.8471690081059933, + 1.149554144591093, + 0.9001835528761148, + 1.1655724123120308, + 0.49313658475875854, + 1.9399633593857288, + 4.702996354550123, + 0.33541299775242805, + 0.380249984562397, + 1.7797669395804405 + ], + "unique_experts": 64, + "load_cv": 0.6624304245989913, + "normalized_load_entropy": 0.9504784703840726, + "max_load_share": 0.04809843400447427 + } + }, + "s0_bos": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "d7c3069401ee7ed394c6bc2ceccec41ebbf4247e564a6fa1030216cb47f3de08", + "route_weight_sha256": "37bfeec934a3f75dc5ef76e8a0ad52ff764368f6250817acb3f363753a1071a6", + "loads": [ + 12, + 10, + 11, + 13, + 0, + 2, + 4, + 16, + 4, + 4, + 20, + 10, + 3, + 26, + 8, + 7, + 8, + 8, + 13, + 1, + 5, + 5, + 10, + 7, + 10, + 6, + 7, + 11, + 10, + 13, + 1, + 30, + 5, + 5, + 6, + 21, + 5, + 1, + 7, + 9, + 22, + 11, + 19, + 11, + 3, + 19, + 15, + 5, + 27, + 5, + 9, + 10, + 10, + 0, + 4, + 17, + 9, + 14, + 9, + 15, + 36, + 5, + 2, + 17 + ], + "weighted_loads": [ + 0.3796086460351944, + 0.3523216024041176, + 0.36496789939701557, + 1.0374297238886356, + 0.0, + 0.10739614814519882, + 0.1960160732269287, + 1.1541813090443611, + 0.2475530542433262, + 0.18223538249731064, + 1.7774760723114014, + 0.35478169843554497, + 0.0925409346818924, + 1.1460675578564405, + 0.26952928490936756, + 0.2189431693404913, + 0.39143146574497223, + 0.6265801340341568, + 0.5250071957707405, + 0.0763293132185936, + 0.2180050890892744, + 0.14983412064611912, + 0.6022637132555246, + 0.34252772107720375, + 0.755739338696003, + 0.3808854669332504, + 0.5525721050798893, + 0.5801062639802694, + 0.32405986450612545, + 0.6438613999634981, + 0.05631149560213089, + 1.796280825510621, + 0.16405356861650944, + 0.15220445208251476, + 0.3314781468361616, + 0.9526893384754658, + 0.14198772981762886, + 0.03766085207462311, + 0.4183780122548342, + 0.4664157032966614, + 2.9426515996456146, + 0.9822488985955715, + 1.0196040701121092, + 0.4709353521466255, + 0.1678757257759571, + 1.0800041239708662, + 0.9792977645993233, + 0.24189186096191406, + 2.423438884317875, + 0.16838095523416996, + 0.4825022555887699, + 0.4220454581081867, + 0.5526197385042906, + 0.0, + 0.2995698004961014, + 1.1318973116576672, + 0.42936866730451584, + 1.1136014088988304, + 0.501164548099041, + 1.0852111801505089, + 3.7423584572970867, + 0.18979320116341114, + 0.09423774480819702, + 1.7003578506410122 + ], + "unique_experts": 62, + "load_cv": 0.7281857828670927, + "normalized_load_entropy": 0.9388887996106224, + "max_load_share": 0.05555555555555555 + }, + "full_input": { + "tokens": 133, + "top_k": 6, + "decisions": 798, + "ordered_route_sha256": "78ba76f7ec902bb161022e419c5f4b5c44b9770045dadf6194827f05bb16d7bf", + "route_weight_sha256": "deb85e830b046a1c5a5a78ae2aae9c5e5c7cf2b424e24cd769e1ffe0f1f1fd2e", + "loads": [ + 12, + 13, + 14, + 18, + 0, + 2, + 6, + 16, + 4, + 4, + 30, + 11, + 3, + 39, + 11, + 10, + 8, + 8, + 18, + 1, + 5, + 6, + 12, + 7, + 10, + 12, + 13, + 11, + 11, + 32, + 1, + 31, + 5, + 6, + 18, + 21, + 5, + 3, + 8, + 9, + 25, + 14, + 27, + 11, + 3, + 21, + 26, + 5, + 28, + 6, + 10, + 10, + 10, + 0, + 4, + 17, + 9, + 14, + 9, + 26, + 41, + 5, + 5, + 18 + ], + "weighted_loads": [ + 0.3796086460351944, + 0.49372047930955887, + 0.5119214095175266, + 1.362314059457276, + 0.0, + 0.10739614814519882, + 0.29148926958441734, + 1.1541813090443611, + 0.2475530542433262, + 0.18223538249731064, + 2.4338731858879328, + 0.37183839082717896, + 0.0925409346818924, + 2.057965802028775, + 0.3444576021283865, + 0.3947598095983267, + 0.39143146574497223, + 0.6265801340341568, + 0.8714466013479978, + 0.0763293132185936, + 0.2180050890892744, + 0.43911474384367466, + 0.7202197816222906, + 0.34252772107720375, + 0.755739338696003, + 0.8303414136171341, + 1.104115143418312, + 0.5801062639802694, + 0.34886942990124226, + 2.1326091219088994, + 0.05631149560213089, + 1.8147001843899488, + 0.16405356861650944, + 0.17758259549736977, + 1.402970204508165, + 0.9526893384754658, + 0.14198772981762886, + 0.12000672519207001, + 1.415063576772809, + 0.4664157032966614, + 3.0830512158572674, + 1.18184644728899, + 1.3803483992815018, + 0.4709353521466255, + 0.1678757257759571, + 1.3582587838172913, + 2.128253411501646, + 0.24189186096191406, + 2.460373044013977, + 0.19639888033270836, + 0.5295028313994408, + 0.4220454581081867, + 0.5526197385042906, + 0.0, + 0.2995698004961014, + 1.1318973116576672, + 0.42936866730451584, + 1.1136014088988304, + 0.501164548099041, + 1.7468228451907635, + 4.411268166295486, + 0.18979320116341114, + 0.3073529563844204, + 1.7371194809675217 + ], + "unique_experts": 62, + "load_cv": 0.7550101914501124, + "normalized_load_entropy": 0.9343958162505094, + "max_load_share": 0.05137844611528822 + } + }, + "s1_bos": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "18719705f8a6e25080044fb0b2275de80f23fbdace5d28d5118c6669922e7911", + "route_weight_sha256": "e9d88ae9272b679535fc492a11896985f775e8372b5f06d6e2ba507117d9e71d", + "loads": [ + 14, + 8, + 8, + 13, + 1, + 2, + 2, + 17, + 3, + 3, + 20, + 11, + 3, + 26, + 8, + 9, + 8, + 9, + 12, + 1, + 3, + 5, + 10, + 6, + 11, + 6, + 8, + 11, + 8, + 10, + 1, + 29, + 7, + 6, + 7, + 19, + 5, + 3, + 7, + 9, + 22, + 11, + 18, + 11, + 5, + 20, + 11, + 6, + 28, + 4, + 8, + 10, + 9, + 1, + 5, + 17, + 9, + 15, + 9, + 16, + 37, + 7, + 2, + 18 + ], + "weighted_loads": [ + 0.43781634233891964, + 0.2875378616154194, + 0.28044468723237514, + 1.0292145386338234, + 0.030686596408486366, + 0.10743990167975426, + 0.12475169822573662, + 1.2320952825248241, + 0.2275082841515541, + 0.13743794709444046, + 1.7638418413698673, + 0.38575522042810917, + 0.09218400716781616, + 1.1455679964274168, + 0.26201536878943443, + 0.2803970221430063, + 0.40242670476436615, + 0.6697053592652082, + 0.4937617592513561, + 0.07592812180519104, + 0.15088997595012188, + 0.14678639359772205, + 0.5883176103234291, + 0.3211116772145033, + 0.7957664504647255, + 0.3827427178621292, + 0.5964402761310339, + 0.5905727930366993, + 0.27709818445146084, + 0.4884930942207575, + 0.06339652091264725, + 1.727724626660347, + 0.21551205404102802, + 0.19031750224530697, + 0.3405038099735975, + 0.8855644352734089, + 0.15057767555117607, + 0.10716477781534195, + 0.4309992026537657, + 0.45837143436074257, + 2.9845141395926476, + 0.9897309243679047, + 1.0042059645056725, + 0.49397719092667103, + 0.22983314655721188, + 1.1333313453942537, + 0.8467340711504221, + 0.2545267976820469, + 2.407305946573615, + 0.13948285952210426, + 0.4434584937989712, + 0.4391338676214218, + 0.501073032617569, + 0.031744908541440964, + 0.33829930052161217, + 1.145705308765173, + 0.42509729973971844, + 1.1450617834925652, + 0.4953283779323101, + 1.1476618219166994, + 3.804674604907632, + 0.2221077550202608, + 0.0941665768623352, + 1.7133501581847668 + ], + "unique_experts": 64, + "load_cv": 0.7248291033622566, + "normalized_load_entropy": 0.9418575149156718, + "max_load_share": 0.05709876543209876 + }, + "full_input": { + "tokens": 149, + "top_k": 6, + "decisions": 894, + "ordered_route_sha256": "0b87fdde0930b717b1249c29917658728a7a9636f1d60881edb28170a2b23cee", + "route_weight_sha256": "1e18f956c8032d1507c5c9883b79d81d1ad8d84afddabc9ac7321957a95116ba", + "loads": [ + 14, + 10, + 12, + 23, + 1, + 2, + 6, + 17, + 3, + 12, + 29, + 12, + 4, + 40, + 11, + 13, + 10, + 11, + 20, + 3, + 4, + 7, + 15, + 7, + 11, + 16, + 17, + 11, + 8, + 32, + 1, + 30, + 7, + 7, + 23, + 19, + 7, + 6, + 10, + 12, + 25, + 17, + 27, + 11, + 6, + 23, + 22, + 10, + 29, + 6, + 10, + 10, + 13, + 5, + 11, + 17, + 14, + 17, + 9, + 29, + 45, + 9, + 6, + 20 + ], + "weighted_loads": [ + 0.43781634233891964, + 0.40998801216483116, + 0.4754209592938423, + 1.823474707751302, + 0.030686596408486366, + 0.10743990167975426, + 0.36330756917595863, + 1.2320952825248241, + 0.2275082841515541, + 1.2125453874468803, + 2.3530091624706984, + 0.40281191281974316, + 0.19707182794809341, + 2.1188637260347605, + 0.3368353471159935, + 0.5445868913084269, + 0.7669188231229782, + 0.7402874547988176, + 1.1685650649305899, + 0.16593482717871666, + 0.19999354518949986, + 0.4765549246221781, + 0.9991958253085613, + 0.4153000246733427, + 0.7957664504647255, + 1.074985921382904, + 1.4362288694828749, + 0.5905727930366993, + 0.27709818445146084, + 1.8301882091909647, + 0.06339652091264725, + 1.7461439855396748, + 0.21551205404102802, + 0.21569564566016197, + 1.7191898124001455, + 0.8855644352734089, + 0.20385481975972652, + 0.23097869753837585, + 1.6202210802584887, + 0.6690771356225014, + 3.1457715332508087, + 1.319437812519027, + 1.4354913830757141, + 0.49397719092667103, + 0.26801824383437634, + 1.3029670216783416, + 2.0818678941577673, + 0.593258161097765, + 2.4370445739477873, + 0.20295763574540615, + 0.536117073148489, + 0.4391338676214218, + 0.9356357753276825, + 0.2153409868478775, + 0.8886711932718754, + 1.145705308765173, + 0.8492868822067976, + 1.2180522792041302, + 0.4953283779323101, + 1.9156658742576838, + 4.973745172843337, + 0.4173789042979479, + 0.3878636136651039, + 1.7940710932016373 + ], + "unique_experts": 64, + "load_cv": 0.6612204911931912, + "normalized_load_entropy": 0.950443021000291, + "max_load_share": 0.050335570469798654 + } + }, + "s0_x": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "2f7be2a242ee673a1800ca592bc6a954d4089323790644d58005778349c2b227", + "route_weight_sha256": "c3aca712aaf369e36f06baf4a1c11522f83a8f8dfa3944751742a04aba1701fc", + "loads": [ + 11, + 11, + 11, + 13, + 0, + 2, + 3, + 16, + 3, + 3, + 20, + 10, + 3, + 26, + 8, + 6, + 8, + 8, + 15, + 2, + 4, + 5, + 10, + 6, + 10, + 7, + 8, + 9, + 8, + 13, + 1, + 30, + 6, + 3, + 7, + 21, + 4, + 3, + 7, + 7, + 22, + 11, + 19, + 12, + 4, + 19, + 14, + 5, + 28, + 4, + 9, + 10, + 10, + 0, + 4, + 17, + 10, + 15, + 9, + 16, + 37, + 6, + 2, + 17 + ], + "weighted_loads": [ + 0.35308353416621685, + 0.37974877655506134, + 0.3679412007331848, + 1.097173921763897, + 0.0, + 0.10914327576756477, + 0.1457086894661188, + 1.1578006334602833, + 0.21666331216692924, + 0.1424015760421753, + 1.7916484698653221, + 0.348428376019001, + 0.09303549863398075, + 1.163956630975008, + 0.2642230838537216, + 0.19175808690488338, + 0.397189624607563, + 0.6365407910197973, + 0.6215047314763069, + 0.10764821991324425, + 0.18857458420097828, + 0.1459622997790575, + 0.6131197921931744, + 0.3121077287942171, + 0.7266077809035778, + 0.4016256369650364, + 0.5837105941027403, + 0.537486307322979, + 0.269988713786006, + 0.5631370265036821, + 0.0559348501265049, + 1.7815598472952843, + 0.19003458134829998, + 0.10220377147197723, + 0.35558988712728024, + 0.9726823139935732, + 0.11710917018353939, + 0.1043748501688242, + 0.41060011088848114, + 0.4038817957043648, + 2.96602601185441, + 1.007927231490612, + 1.0256880633533, + 0.4992075450718403, + 0.20325378328561783, + 1.0903057511895895, + 0.9586131237447262, + 0.24263738840818405, + 2.4685038700699806, + 0.13495849072933197, + 0.47450998425483704, + 0.40908158384263515, + 0.5581590756773949, + 0.0, + 0.2992950975894928, + 1.1365669704973698, + 0.4598478637635708, + 1.133407887071371, + 0.4845765791833401, + 1.1510991118848324, + 3.800469985231757, + 0.19548245333135128, + 0.09497475251555443, + 1.694330595433712 + ], + "unique_experts": 62, + "load_cv": 0.7424876520372787, + "normalized_load_entropy": 0.9375041842277663, + "max_load_share": 0.05709876543209876 + }, + "full_input": { + "tokens": 133, + "top_k": 6, + "decisions": 798, + "ordered_route_sha256": "c3e90fd4c5656781d4fe86bc473797d722a198b7dc7cee1a986851fbe27e28cb", + "route_weight_sha256": "8ef67e011017823cd3f687d82eecfeb7e664d93a548c8fe75ed0205aa87bda9c", + "loads": [ + 11, + 15, + 15, + 17, + 0, + 2, + 4, + 16, + 3, + 3, + 31, + 11, + 3, + 38, + 11, + 9, + 8, + 8, + 19, + 2, + 4, + 6, + 12, + 6, + 10, + 13, + 14, + 9, + 8, + 30, + 1, + 31, + 6, + 4, + 17, + 21, + 5, + 5, + 8, + 7, + 26, + 14, + 28, + 12, + 4, + 21, + 27, + 5, + 30, + 5, + 10, + 10, + 10, + 0, + 4, + 17, + 10, + 15, + 9, + 28, + 41, + 6, + 5, + 18 + ], + "weighted_loads": [ + 0.35308353416621685, + 0.5644657351076603, + 0.5447911825031042, + 1.3735447330982424, + 0.0, + 0.10914327576756477, + 0.18892004154622555, + 1.1578006334602833, + 0.21666331216692924, + 0.1424015760421753, + 2.663850711658597, + 0.365485068410635, + 0.09303549863398075, + 2.0345874689519405, + 0.33915140107274055, + 0.3783038277179003, + 0.397189624607563, + 0.6365407910197973, + 0.8168689974118024, + 0.10764821991324425, + 0.18857458420097828, + 0.43524292297661304, + 0.7368573360145092, + 0.3121077287942171, + 0.7266077809035778, + 0.7868663668632507, + 1.1763721946626902, + 0.537486307322979, + 0.269988713786006, + 1.8118218373856507, + 0.0559348501265049, + 1.799979206174612, + 0.19003458134829998, + 0.12758191488683224, + 1.200016042595962, + 0.9726823139935732, + 0.14175095036625862, + 0.18727353774011135, + 1.407285675406456, + 0.4038817957043648, + 3.1629538126289845, + 1.2161819338798523, + 1.4218363482505083, + 0.4992075450718403, + 0.20325378328561783, + 1.3401677086949348, + 2.3519081696867943, + 0.24263738840818405, + 2.5486163161695004, + 0.16297641582787037, + 0.5215105600655079, + 0.40908158384263515, + 0.5581590756773949, + 0.0, + 0.2992950975894928, + 1.1365669704973698, + 0.4598478637635708, + 1.133407887071371, + 0.4845765791833401, + 1.8954837620258331, + 4.265909851557808, + 0.19548245333135128, + 0.29810674861073494, + 1.7318335212767124 + ], + "unique_experts": 62, + "load_cv": 0.7687293285010075, + "normalized_load_entropy": 0.9321926880943399, + "max_load_share": 0.05137844611528822 + } + }, + "s1_x": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "72ea264f0a7efe238746f19d65dabb052296153a62b178bf6a64700e5c658442", + "route_weight_sha256": "306a054663f682386758def208cc522615cdd7153d5d1a89975c974075fb1086", + "loads": [ + 12, + 10, + 8, + 13, + 1, + 2, + 2, + 17, + 3, + 2, + 20, + 11, + 4, + 27, + 7, + 8, + 8, + 9, + 13, + 1, + 3, + 4, + 10, + 5, + 11, + 9, + 9, + 11, + 7, + 8, + 1, + 29, + 7, + 6, + 7, + 19, + 5, + 3, + 7, + 9, + 21, + 11, + 18, + 11, + 5, + 20, + 13, + 5, + 28, + 6, + 7, + 10, + 9, + 0, + 5, + 17, + 10, + 15, + 9, + 17, + 37, + 6, + 2, + 18 + ], + "weighted_loads": [ + 0.3876544516533613, + 0.3306837994605303, + 0.2961018979549408, + 1.0744281262159348, + 0.028947552666068077, + 0.1099293902516365, + 0.10476222634315491, + 1.2140017598867416, + 0.22385423630475998, + 0.10606520995497704, + 1.7958380430936813, + 0.37887271866202354, + 0.1325875259935856, + 1.2046271599829197, + 0.24186093173921108, + 0.24919450841844082, + 0.4070468470454216, + 0.6820353846997023, + 0.5577161852270365, + 0.07644510269165039, + 0.14833435975015163, + 0.12097087688744068, + 0.5932303071022034, + 0.2966044880449772, + 0.7877025566995144, + 0.4841055627912283, + 0.6291002631187439, + 0.5964707136154175, + 0.2502853348851204, + 0.37025326676666737, + 0.06386035680770874, + 1.6862087156623602, + 0.21138939633965492, + 0.18089621141552925, + 0.32243760861456394, + 0.9048188645392656, + 0.15001882053911686, + 0.10576966963708401, + 0.42988452315330505, + 0.4571446646004915, + 2.958332985639572, + 1.0313451066613197, + 1.015486916527152, + 0.4950162898749113, + 0.23262986168265343, + 1.1576608065515757, + 0.9307656418532133, + 0.22997930273413658, + 2.4333976563066244, + 0.19126435928046703, + 0.39723918214440346, + 0.43805130757391453, + 0.5098381787538528, + 0.0, + 0.33715760707855225, + 1.1439970582723618, + 0.45635896921157837, + 1.1558999884873629, + 0.47946130484342575, + 1.2055667787790298, + 3.8500400949269533, + 0.19387487322092056, + 0.09541339054703712, + 1.7077151890844107 + ], + "unique_experts": 63, + "load_cv": 0.731110235530515, + "normalized_load_entropy": 0.9398627554666881, + "max_load_share": 0.05709876543209876 + }, + "full_input": { + "tokens": 149, + "top_k": 6, + "decisions": 894, + "ordered_route_sha256": "305b2425bb3c727eb5895e3e45b9366ff8ccfaa4867b7b6ede15ae059357bcc5", + "route_weight_sha256": "10023d633154ef7dd0a7a7716ad14f5fef249c6a5769c1567eeeca4d5635d325", + "loads": [ + 12, + 13, + 12, + 22, + 1, + 2, + 5, + 17, + 3, + 11, + 30, + 12, + 5, + 40, + 10, + 12, + 10, + 11, + 20, + 3, + 4, + 6, + 15, + 6, + 11, + 19, + 18, + 11, + 7, + 27, + 1, + 30, + 7, + 7, + 22, + 19, + 8, + 6, + 11, + 12, + 25, + 17, + 28, + 11, + 6, + 23, + 25, + 9, + 29, + 8, + 9, + 10, + 13, + 4, + 11, + 17, + 15, + 17, + 9, + 31, + 45, + 8, + 6, + 20 + ], + "weighted_loads": [ + 0.3876544516533613, + 0.4987155329436064, + 0.5011872202157974, + 1.820283340959577, + 0.028947552666068077, + 0.1099293902516365, + 0.29232048243284225, + 1.2140017598867416, + 0.22385423630475998, + 1.181172650307417, + 2.5746269170194864, + 0.39592941105365753, + 0.23747534677386284, + 2.1357574202120304, + 0.31668091006577015, + 0.5168259274214506, + 0.7715389654040337, + 0.7526174802333117, + 1.079441419133218, + 0.166451808065176, + 0.1974379289895296, + 0.4507394079118967, + 1.0050601549446583, + 0.3907928355038166, + 0.7877025566995144, + 1.1222223844379187, + 1.5059874355793, + 0.5964707136154175, + 0.2502853348851204, + 1.4584861192852259, + 0.06386035680770874, + 1.704628074541688, + 0.21138939633965492, + 0.20627435483038425, + 1.4999976763210725, + 0.9048188645392656, + 0.23050569742918015, + 0.2301927413791418, + 1.6717446632683277, + 0.6678503658622503, + 3.1737253479659557, + 1.3951576980471145, + 1.487169062718749, + 0.4950162898749113, + 0.2708149589598179, + 1.2834086068614852, + 2.373803263530135, + 0.5687106661498547, + 2.4631362836807966, + 0.2547391355037689, + 0.4898977614939213, + 0.43805130757391453, + 0.9444009214639664, + 0.18359607830643654, + 0.8875294998288155, + 1.1439970582723618, + 0.8805485516786575, + 1.2288904841989279, + 0.47946130484342575, + 2.070090066641569, + 4.837582601234317, + 0.38914602249860764, + 0.37764622643589973, + 1.7884904388338327 + ], + "unique_experts": 64, + "load_cv": 0.6650845301522181, + "normalized_load_entropy": 0.9496448906668585, + "max_load_share": 0.050335570469798654 + } + }, + "s0_period": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "2237ad12d60aaf3378f964b7a96c86b355dc8bd6b34fb65a3df1c329aebae1b4", + "route_weight_sha256": "3a5fdbe0c9f457e3ac8fb690bf73fa6a6c04c5b9c28aa592853bd4dbbaa47b09", + "loads": [ + 11, + 11, + 10, + 13, + 0, + 2, + 4, + 16, + 3, + 4, + 20, + 9, + 3, + 26, + 8, + 7, + 8, + 8, + 14, + 2, + 4, + 5, + 11, + 6, + 10, + 7, + 9, + 9, + 8, + 13, + 1, + 30, + 6, + 3, + 7, + 21, + 3, + 2, + 7, + 7, + 22, + 11, + 19, + 12, + 5, + 20, + 14, + 5, + 27, + 4, + 8, + 10, + 10, + 0, + 4, + 17, + 10, + 15, + 9, + 16, + 36, + 7, + 2, + 17 + ], + "weighted_loads": [ + 0.356011925265193, + 0.38374914415180683, + 0.33700514398515224, + 1.092104010283947, + 0.0, + 0.1089223101735115, + 0.18918984569609165, + 1.164313182234764, + 0.2178574800491333, + 0.1794077679514885, + 1.7881765365600586, + 0.3179068975150585, + 0.09412841685116291, + 1.1606280729174614, + 0.26405200734734535, + 0.21854505501687527, + 0.3940030634403229, + 0.6314455661922693, + 0.5982894171029329, + 0.10920817777514458, + 0.1895743776112795, + 0.14584052190184593, + 0.6298780255019665, + 0.31425699032843113, + 0.7319153025746346, + 0.4038383923470974, + 0.6141341496258974, + 0.5331385284662247, + 0.27004954032599926, + 0.5498185455799103, + 0.05425015836954117, + 1.7691565174609423, + 0.19141347706317902, + 0.09813038632273674, + 0.3605028409510851, + 0.9729372784495354, + 0.09494934976100922, + 0.06831910088658333, + 0.40553389862179756, + 0.3940035905689001, + 2.953808695077896, + 1.0019664727151394, + 1.0243260376155376, + 0.5227101165801287, + 0.2372291125357151, + 1.1121513843536377, + 0.9484711419790983, + 0.24292533844709396, + 2.418576303869486, + 0.13339890725910664, + 0.43992697447538376, + 0.43023840710520744, + 0.5453104600310326, + 0.0, + 0.2983689568936825, + 1.1386383771896362, + 0.459513820707798, + 1.1388898007571697, + 0.4876548759639263, + 1.1510158367455006, + 3.7267807219177485, + 0.23162174969911575, + 0.09682225808501244, + 1.6896135751158 + ], + "unique_experts": 62, + "load_cv": 0.7321518520090241, + "normalized_load_entropy": 0.9387221811887178, + "max_load_share": 0.05555555555555555 + }, + "full_input": { + "tokens": 133, + "top_k": 6, + "decisions": 798, + "ordered_route_sha256": "a5d34849a4bb0044a8ea69ad3cd3f4f31771c37c573dbc012cc88dd7508ea462", + "route_weight_sha256": "bf57e303783e5f4767b9d890ad0e64c332584ba78ce45ce9ccd0fe5d8abcce99", + "loads": [ + 11, + 15, + 13, + 17, + 0, + 2, + 5, + 16, + 3, + 4, + 30, + 10, + 3, + 38, + 11, + 10, + 8, + 8, + 18, + 2, + 4, + 6, + 14, + 6, + 10, + 13, + 16, + 9, + 8, + 30, + 1, + 31, + 6, + 4, + 17, + 21, + 4, + 4, + 9, + 7, + 25, + 14, + 27, + 12, + 5, + 22, + 26, + 5, + 29, + 5, + 9, + 11, + 11, + 0, + 4, + 17, + 10, + 15, + 9, + 28, + 40, + 7, + 5, + 18 + ], + "weighted_loads": [ + 0.356011925265193, + 0.5779313016682863, + 0.4832535572350025, + 1.3718804596574046, + 0.0, + 0.1089223101735115, + 0.2319528218358755, + 1.164313182234764, + 0.2178574800491333, + 0.1794077679514885, + 2.44457365013659, + 0.3349635899066925, + 0.09412841685116291, + 2.0089481100440025, + 0.3389803245663643, + 0.38775660656392574, + 0.3940030634403229, + 0.6314455661922693, + 0.7939320069272071, + 0.10920817777514458, + 0.1895743776112795, + 0.4351211450994015, + 0.7887974269688129, + 0.31425699032843113, + 0.7319153025746346, + 0.7722117267549038, + 1.4782088156789541, + 0.5331385284662247, + 0.27004954032599926, + 1.7895292289904319, + 0.05425015836954117, + 1.78757587634027, + 0.19141347706317902, + 0.12350852973759174, + 1.190922426438192, + 0.9729372784495354, + 0.11983054876327515, + 0.15121473744511604, + 1.4362758845090866, + 0.3940035905689001, + 3.094208311289549, + 1.2016094252467155, + 1.3850703667849302, + 0.5227101165801287, + 0.2372291125357151, + 1.3815722037106752, + 2.257618011906743, + 0.24292533844709396, + 2.5095106549561024, + 0.16141683235764503, + 0.4869275502860546, + 0.5559388063848019, + 0.609813392162323, + 0.0, + 0.2983689568936825, + 1.1386383771896362, + 0.459513820707798, + 1.1388898007571697, + 0.4876548759639263, + 1.9003057852387428, + 4.1833548294671346, + 0.23162174969911575, + 0.29953665658831596, + 1.726922059431672 + ], + "unique_experts": 62, + "load_cv": 0.7528773665032761, + "normalized_load_entropy": 0.9343941083153304, + "max_load_share": 0.05012531328320802 + } + }, + "s1_period": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "9800f823792a2aa403a03cf476fc86623ad1f613fb283f6e67a5ca354507ea36", + "route_weight_sha256": "4d10b8438944bf7c9bc2f88dcb64fc741785c2add2c41a0245dc31bfec73f206", + "loads": [ + 14, + 7, + 8, + 13, + 0, + 2, + 2, + 18, + 3, + 2, + 20, + 10, + 3, + 27, + 6, + 9, + 8, + 9, + 13, + 1, + 3, + 4, + 11, + 5, + 11, + 8, + 9, + 10, + 7, + 8, + 1, + 29, + 8, + 5, + 7, + 19, + 6, + 4, + 7, + 9, + 22, + 11, + 19, + 12, + 5, + 20, + 11, + 7, + 28, + 5, + 8, + 11, + 9, + 1, + 5, + 17, + 9, + 15, + 8, + 17, + 37, + 5, + 2, + 18 + ], + "weighted_loads": [ + 0.43068827129900455, + 0.25796098820865154, + 0.2936964835971594, + 1.0558698289096355, + 0.0, + 0.1079293042421341, + 0.11385131254792213, + 1.2870371267199516, + 0.2239309512078762, + 0.10584888234734535, + 1.7868130393326283, + 0.3465530090034008, + 0.1073724664747715, + 1.1873216144740582, + 0.21508641727268696, + 0.2770497817546129, + 0.40407033264636993, + 0.6778479609638453, + 0.5583085138350725, + 0.07570134848356247, + 0.14864427782595158, + 0.11930053122341633, + 0.6089916881173849, + 0.2971460949629545, + 0.7981378063559532, + 0.42959944903850555, + 0.6356059331446886, + 0.5558223407715559, + 0.2507040798664093, + 0.3714877665042877, + 0.06364192813634872, + 1.7002061437815428, + 0.24332848191261292, + 0.15968036465346813, + 0.31586561538279057, + 0.8991307038813829, + 0.1819807067513466, + 0.13424206525087357, + 0.415272144600749, + 0.4517732597887516, + 2.9802855290472507, + 1.016851544380188, + 1.0416677109897137, + 0.5283733643591404, + 0.22890900075435638, + 1.1490314211696386, + 0.8542521111667156, + 0.2836507372558117, + 2.4389021061360836, + 0.15653360821306705, + 0.421714436262846, + 0.4731907919049263, + 0.5010111108422279, + 0.030996104702353477, + 0.33686699718236923, + 1.1501716412603855, + 0.42031317204236984, + 1.1558838430792093, + 0.4453508034348488, + 1.210096888244152, + 3.80351291783154, + 0.16846496053040028, + 0.09622983261942863, + 1.7046616561710835 + ], + "unique_experts": 63, + "load_cv": 0.7387834222408485, + "normalized_load_entropy": 0.9387568768975599, + "max_load_share": 0.05709876543209876 + }, + "full_input": { + "tokens": 149, + "top_k": 6, + "decisions": 894, + "ordered_route_sha256": "db747c5d355c27c391dd73066996f16b66377fad4df1ceac4fa77145cce12132", + "route_weight_sha256": "1a96719768866a7ccc1f869831e6a0e9fc9930c1ebb559d2e36adb5b639d14fd", + "loads": [ + 14, + 10, + 11, + 22, + 0, + 2, + 5, + 18, + 3, + 11, + 29, + 11, + 4, + 40, + 9, + 13, + 10, + 11, + 20, + 3, + 4, + 6, + 17, + 6, + 11, + 18, + 19, + 10, + 7, + 27, + 1, + 30, + 8, + 6, + 21, + 19, + 9, + 8, + 11, + 12, + 25, + 17, + 28, + 12, + 6, + 23, + 22, + 11, + 29, + 7, + 10, + 12, + 14, + 5, + 11, + 17, + 14, + 17, + 8, + 31, + 45, + 7, + 6, + 21 + ], + "weighted_loads": [ + 0.43068827129900455, + 0.4137315396219492, + 0.46434873156249523, + 1.8051990556705277, + 0.0, + 0.1079293042421341, + 0.30210986733436584, + 1.2870371267199516, + 0.2239309512078762, + 1.1809563226997852, + 2.3759803604334593, + 0.3636097013950348, + 0.21226028725504875, + 2.0931795202195644, + 0.289906395599246, + 0.5513445492833853, + 0.768562451004982, + 0.7484300564974546, + 1.0813174343493301, + 0.1657080538570881, + 0.19774784706532955, + 0.44906906224787235, + 1.053553195670247, + 0.39133444242179394, + 0.7981378063559532, + 1.0376999862492085, + 1.8127314615994692, + 0.5558223407715559, + 0.2507040798664093, + 1.4481232017278671, + 0.06364192813634872, + 1.7186255026608706, + 0.24332848191261292, + 0.18505850806832314, + 1.4388787084899377, + 0.8991307038813829, + 0.26444786228239536, + 0.3011866994202137, + 1.6619659196585417, + 0.6624789610505104, + 3.141542922705412, + 1.3921125712513458, + 1.4729531295597553, + 0.5283733643591404, + 0.26709409803152084, + 1.2760519073053729, + 2.1493526808917522, + 0.6223821006715298, + 2.468640733510256, + 0.22000838443636894, + 0.5143730156123638, + 0.5699885040521622, + 0.988278903067112, + 0.21459218300879002, + 0.8872388899326324, + 1.1501716412603855, + 0.844502754509449, + 1.2288743387907743, + 0.4453508034348488, + 2.130242772400379, + 4.79128878377378, + 0.36373610980808735, + 0.39140283688902855, + 1.81538256816566 + ], + "unique_experts": 63, + "load_cv": 0.6615837035568178, + "normalized_load_entropy": 0.9492763555481181, + "max_load_share": 0.050335570469798654 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 108, + "ordered_topk_exact_tokens": 79, + "set_exact_tokens": 89, + "mean_set_jaccard": 0.9457671957671957, + "mean_token_weighted_tv": 0.010693483183988266, + "aggregate_load_tv": 0.024691358024691357 + }, + "system_bos": { + "tokens": 108, + "ordered_topk_exact_tokens": 55, + "set_exact_tokens": 67, + "mean_set_jaccard": 0.8875661375661378, + "mean_token_weighted_tv": 0.01888742996379733, + "aggregate_load_tv": 0.04475308641975308 + }, + "system_x": { + "tokens": 108, + "ordered_topk_exact_tokens": 51, + "set_exact_tokens": 70, + "mean_set_jaccard": 0.8935185185185185, + "mean_token_weighted_tv": 0.018802752364771785, + "aggregate_load_tv": 0.044753086419753084 + }, + "system_period": { + "tokens": 108, + "ordered_topk_exact_tokens": 53, + "set_exact_tokens": 68, + "mean_set_jaccard": 0.8882275132275133, + "mean_token_weighted_tv": 0.019335177520083055, + "aggregate_load_tv": 0.05246913580246913 + }, + "bos_at_s0": { + "tokens": 108, + "ordered_topk_exact_tokens": 46, + "set_exact_tokens": 66, + "mean_set_jaccard": 0.8769841269841271, + "mean_token_weighted_tv": 0.02262881205900124, + "aggregate_load_tv": 0.04938271604938271 + }, + "bos_at_s1": { + "tokens": 108, + "ordered_topk_exact_tokens": 45, + "set_exact_tokens": 64, + "mean_set_jaccard": 0.8756613756613758, + "mean_token_weighted_tv": 0.02362896900417076, + "aggregate_load_tv": 0.035493827160493825 + }, + "x_at_s0": { + "tokens": 108, + "ordered_topk_exact_tokens": 48, + "set_exact_tokens": 65, + "mean_set_jaccard": 0.8842592592592593, + "mean_token_weighted_tv": 0.02237397177938234, + "aggregate_load_tv": 0.040123456790123455 + }, + "x_at_s1": { + "tokens": 108, + "ordered_topk_exact_tokens": 45, + "set_exact_tokens": 63, + "mean_set_jaccard": 0.8710317460317462, + "mean_token_weighted_tv": 0.025555291601146262, + "aggregate_load_tv": 0.044753086419753084 + }, + "period_at_s0": { + "tokens": 108, + "ordered_topk_exact_tokens": 46, + "set_exact_tokens": 64, + "mean_set_jaccard": 0.8796296296296297, + "mean_token_weighted_tv": 0.02299671788286004, + "aggregate_load_tv": 0.043209876543209874 + }, + "period_at_s1": { + "tokens": 108, + "ordered_topk_exact_tokens": 49, + "set_exact_tokens": 63, + "mean_set_jaccard": 0.8730158730158732, + "mean_token_weighted_tv": 0.024965867883077374, + "aggregate_load_tv": 0.044753086419753084 + } + } + }, + "layer_05": { + "layer": 5, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "02373cd3734a4b415e49b84592b53848c9f16842f78b320f50948304f686fe82", + "route_weight_sha256": "4b8b1872415ee40908b47cc484fcfb7ceae9de384c1efb898e21240ca95bf68e", + "loads": [ + 10, + 22, + 9, + 9, + 15, + 17, + 5, + 12, + 10, + 10, + 19, + 7, + 12, + 1, + 19, + 13, + 1, + 14, + 19, + 9, + 5, + 9, + 10, + 6, + 1, + 21, + 3, + 9, + 17, + 6, + 2, + 4, + 5, + 6, + 20, + 19, + 3, + 5, + 14, + 11, + 23, + 8, + 8, + 7, + 12, + 3, + 7, + 6, + 7, + 7, + 16, + 0, + 4, + 20, + 4, + 6, + 20, + 8, + 16, + 29, + 6, + 7, + 7, + 8 + ], + "weighted_loads": [ + 0.527841679751873, + 1.7860467825084925, + 0.4925074279308319, + 0.5174885801970959, + 0.9286114983260632, + 0.7539480570703745, + 0.22908535599708557, + 0.6688253842294216, + 0.3721515145152807, + 0.30531283654272556, + 1.2408053129911423, + 0.33749918825924397, + 0.8979309089481831, + 0.030501633882522583, + 1.7192823812365532, + 1.2235853001475334, + 0.04722076654434204, + 1.0701167471706867, + 1.339509816840291, + 0.47581648267805576, + 0.1483587808907032, + 0.62588706985116, + 0.8795280605554581, + 0.3841319717466831, + 0.03158387541770935, + 2.1197522319853306, + 0.11564367264509201, + 0.5250397752970457, + 1.0090589374303818, + 0.39437879621982574, + 0.16029557958245277, + 0.14029120653867722, + 0.1902221217751503, + 0.2509869784116745, + 1.7272163219749928, + 1.3637306541204453, + 0.12409161776304245, + 0.17279469966888428, + 1.181047186255455, + 0.6189747639000416, + 2.1388145927339792, + 0.4676898941397667, + 0.4013653267174959, + 0.5711461380124092, + 0.7870014682412148, + 0.25940823554992676, + 0.4518539533019066, + 0.2132748980075121, + 0.36951797641813755, + 0.27607917971909046, + 1.6125414744019508, + 0.0, + 0.12492106482386589, + 1.6023186407983303, + 0.14324959367513657, + 0.2814753130078316, + 1.038137748837471, + 0.48816355876624584, + 0.7649497855454683, + 1.9954951368272305, + 0.6352165266871452, + 0.3311636485159397, + 0.39566781371831894, + 1.0435267053544521 + ], + "unique_experts": 63, + "load_cv": 0.6305971747714634, + "normalized_load_entropy": 0.9512726151814349, + "max_load_share": 0.044753086419753084 + }, + "full_input": { + "tokens": 133, + "top_k": 6, + "decisions": 798, + "ordered_route_sha256": "39e54c9afad4a8d5614ea9880da28085cb92031399c234b871f382ad86397475", + "route_weight_sha256": "f5e6c8b51a53997503fe97af827cce235ae98998ca6f141c51b22e2faa156d70", + "loads": [ + 10, + 23, + 9, + 9, + 16, + 18, + 7, + 14, + 11, + 11, + 31, + 7, + 15, + 1, + 19, + 26, + 3, + 20, + 28, + 10, + 7, + 10, + 10, + 6, + 1, + 29, + 3, + 9, + 17, + 6, + 2, + 4, + 5, + 6, + 20, + 23, + 3, + 5, + 25, + 19, + 28, + 16, + 15, + 8, + 13, + 3, + 7, + 8, + 7, + 10, + 24, + 0, + 6, + 29, + 7, + 15, + 20, + 8, + 16, + 30, + 6, + 7, + 7, + 10 + ], + "weighted_loads": [ + 0.527841679751873, + 1.7895331820473075, + 0.4925074279308319, + 0.5174885801970959, + 0.9303788694087416, + 0.7903337124735117, + 0.30463357642292976, + 0.7069173802156001, + 0.37548610707744956, + 0.3098451313562691, + 1.9328676220029593, + 0.33749918825924397, + 1.079801369458437, + 0.030501633882522583, + 1.7192823812365532, + 3.4015929768793285, + 0.21048544347286224, + 1.3688705414533615, + 2.0888679679483175, + 0.48890160862356424, + 0.16383923846296966, + 0.6656180284917355, + 0.8795280605554581, + 0.3841319717466831, + 0.03158387541770935, + 3.015666291117668, + 0.11564367264509201, + 0.5250397752970457, + 1.0090589374303818, + 0.39437879621982574, + 0.16029557958245277, + 0.14029120653867722, + 0.1902221217751503, + 0.2509869784116745, + 1.7272163219749928, + 1.6758721582591534, + 0.12409161776304245, + 0.17279469966888428, + 2.2741364389657974, + 1.291615828871727, + 2.344768764451146, + 1.300457675009966, + 0.8334137741476297, + 0.6107434742152691, + 0.8684246018528938, + 0.25940823554992676, + 0.4518539533019066, + 0.23127207928337157, + 0.36951797641813755, + 0.41536741703748703, + 2.2925170995295048, + 0.0, + 1.753939252346754, + 2.1957876086235046, + 0.16012578655499965, + 0.9711285717785358, + 1.038137748837471, + 0.48816355876624584, + 0.7649497855454683, + 2.0416970998048782, + 0.6352165266871452, + 0.3311636485159397, + 0.39566781371831894, + 1.979573767632246 + ], + "unique_experts": 63, + "load_cv": 0.6646803658101678, + "normalized_load_entropy": 0.9461593870751168, + "max_load_share": 0.03884711779448621 + } + }, + "s1_eos": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "de5d36af0c10e66f8e114cf3f8015726c0d02a9f1f7049f70226cb5508c7bb95", + "route_weight_sha256": "507c6c9af073aa869dfbb85de5025f79f43c33d5d16857b80a3bd909cafb56da", + "loads": [ + 10, + 22, + 9, + 9, + 14, + 17, + 5, + 8, + 10, + 12, + 18, + 7, + 12, + 1, + 19, + 13, + 1, + 16, + 19, + 9, + 5, + 9, + 10, + 6, + 1, + 21, + 4, + 8, + 19, + 6, + 3, + 1, + 7, + 6, + 20, + 19, + 3, + 4, + 13, + 11, + 22, + 8, + 7, + 8, + 11, + 3, + 7, + 7, + 7, + 7, + 16, + 0, + 6, + 20, + 4, + 5, + 21, + 8, + 16, + 30, + 6, + 6, + 7, + 9 + ], + "weighted_loads": [ + 0.5161153711378574, + 1.8090036660432816, + 0.4812407046556473, + 0.5145958848297596, + 0.9144541267305613, + 0.7490688823163509, + 0.23019872978329659, + 0.5364749431610107, + 0.3713207319378853, + 0.37530050426721573, + 1.1856423616409302, + 0.34192604571580887, + 0.8845214135944843, + 0.030446305871009827, + 1.6988369282335043, + 1.2284267134964466, + 0.04992452263832092, + 1.1246919762343168, + 1.3388042580336332, + 0.474017096683383, + 0.14984174817800522, + 0.6217248030006886, + 0.8731101788580418, + 0.38693131878972054, + 0.031074371188879013, + 2.119638327509165, + 0.14272327348589897, + 0.48812995105981827, + 1.0737600959837437, + 0.40386977791786194, + 0.20074402913451195, + 0.03764259070158005, + 0.2571616657078266, + 0.2539444603025913, + 1.7209674790501595, + 1.3883029911667109, + 0.12770311161875725, + 0.1403549611568451, + 1.1534551866352558, + 0.6057170815765858, + 2.0945231318473816, + 0.4532719552516937, + 0.37072135135531425, + 0.6018529571592808, + 0.7402663417160511, + 0.2574220076203346, + 0.4506992772221565, + 0.2531930599361658, + 0.37458861246705055, + 0.2732712794095278, + 1.6305439751595259, + 0.0, + 0.18862596340477467, + 1.584153100848198, + 0.14151231199502945, + 0.23754309862852097, + 1.0723193977028131, + 0.4940609149634838, + 0.7761430498212576, + 1.9984172955155373, + 0.6403968706727028, + 0.2966688349843025, + 0.41325729712843895, + 1.056436438113451 + ], + "unique_experts": 63, + "load_cv": 0.637328864155077, + "normalized_load_entropy": 0.9502903943337172, + "max_load_share": 0.046296296296296294 + }, + "full_input": { + "tokens": 149, + "top_k": 6, + "decisions": 894, + "ordered_route_sha256": "1f314193575f6f450301c939234dbc99a024317d22bccdbf323a8b82e38364b7", + "route_weight_sha256": "56935bbb342f60f054db6085e573bc4e34161b9cecaad73d04b62376f6796b04", + "loads": [ + 11, + 23, + 9, + 15, + 15, + 19, + 14, + 11, + 11, + 13, + 33, + 10, + 17, + 1, + 20, + 28, + 4, + 27, + 31, + 19, + 7, + 10, + 11, + 6, + 2, + 29, + 4, + 10, + 19, + 8, + 3, + 1, + 8, + 7, + 21, + 23, + 4, + 7, + 26, + 23, + 25, + 21, + 17, + 11, + 12, + 3, + 7, + 10, + 7, + 21, + 26, + 2, + 9, + 30, + 8, + 15, + 21, + 8, + 17, + 31, + 7, + 6, + 7, + 13 + ], + "weighted_loads": [ + 0.552814420312643, + 1.8125652172602713, + 0.4812407046556473, + 0.9283454120159149, + 0.9162354856962338, + 0.8213810585439205, + 1.2507429830729961, + 0.6260013659484684, + 0.37466974812559783, + 0.379731229506433, + 2.07625406421721, + 0.7123669162392616, + 1.2926586382091045, + 0.030446305871009827, + 1.732926094904542, + 3.8735693781636655, + 0.29221629351377487, + 1.8032046537846327, + 2.4408086631447077, + 1.326508511789143, + 0.1652150982990861, + 0.6626212410628796, + 0.911386001855135, + 0.38693131878972054, + 0.10743876919150352, + 2.8371543306857347, + 0.14272327348589897, + 0.6616880968213081, + 1.0737600959837437, + 0.48943396285176277, + 0.20074402913451195, + 0.03764259070158005, + 0.37639446184039116, + 0.2966606914997101, + 1.7552517168223858, + 1.8233479280024767, + 0.17325353994965553, + 0.29115286096930504, + 2.422659955918789, + 1.7344302125275135, + 2.2202969640493393, + 1.7070442512631416, + 1.0569717958569527, + 0.801074180752039, + 0.8017694838345051, + 0.2574220076203346, + 0.4506992772221565, + 0.30444375728257, + 0.37458861246705055, + 1.0901965647935867, + 2.7410510797053576, + 0.06795927882194519, + 1.8547322694212198, + 2.3899397887289524, + 0.19681453052908182, + 0.852456197142601, + 1.0723193977028131, + 0.4940609149634838, + 0.8468645941466093, + 2.045806586742401, + 0.6860948763787746, + 0.2966688349843025, + 0.41325729712843895, + 2.233440291136503 + ], + "unique_experts": 64, + "load_cv": 0.6149114577533394, + "normalized_load_entropy": 0.9528193302728213, + "max_load_share": 0.03691275167785235 + } + }, + "s0_bos": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "c842bb3b2960857297ca9356b014e77eb3fd7c166384bf36b06b5d7a3111597e", + "route_weight_sha256": "b0204cfd93c166b01d46c535cbd258e6f3d282e88b382c260d732e750c7524e4", + "loads": [ + 8, + 22, + 13, + 9, + 14, + 19, + 5, + 12, + 10, + 8, + 18, + 6, + 12, + 1, + 19, + 14, + 1, + 15, + 18, + 9, + 5, + 9, + 11, + 7, + 1, + 21, + 3, + 11, + 19, + 6, + 2, + 4, + 5, + 7, + 22, + 17, + 3, + 3, + 14, + 12, + 23, + 8, + 8, + 8, + 11, + 3, + 8, + 8, + 7, + 6, + 13, + 0, + 3, + 19, + 3, + 5, + 19, + 8, + 16, + 29, + 6, + 6, + 7, + 9 + ], + "weighted_loads": [ + 0.45754803344607353, + 1.8075589649379253, + 0.6563967689871788, + 0.5234412364661694, + 0.9070426374673843, + 0.7990523595362902, + 0.2253832034766674, + 0.6813685707747936, + 0.3866726793348789, + 0.2440259549766779, + 1.2082534953951836, + 0.2991850096732378, + 0.873044066131115, + 0.03256877884268761, + 1.7232865560799837, + 1.2963461559265852, + 0.043723855167627335, + 1.1323034092783928, + 1.2964731380343437, + 0.4623571503907442, + 0.14693817868828773, + 0.6215047910809517, + 0.9185174368321896, + 0.41151369363069534, + 0.03209406137466431, + 2.162499524652958, + 0.11967363022267818, + 0.5968488771468401, + 1.0044731609523296, + 0.3898790590465069, + 0.1615753173828125, + 0.13814175873994827, + 0.1778862439095974, + 0.2731462884694338, + 1.8536394834518433, + 1.248614588752389, + 0.1241789199411869, + 0.0953690055757761, + 1.2144800685346127, + 0.6454281564801931, + 2.1661949194967747, + 0.45213529095053673, + 0.38844357430934906, + 0.6248395591974258, + 0.7750312499701977, + 0.2606814056634903, + 0.5157262645661831, + 0.28284565918147564, + 0.371997632086277, + 0.23933782055974007, + 1.2934731543064117, + 0.0, + 0.09834383055567741, + 1.6157726496458054, + 0.10765254124999046, + 0.2236907184123993, + 0.9997811317443848, + 0.5010151229798794, + 0.7710513733327389, + 1.9880815632641315, + 0.6087918542325497, + 0.29978176578879356, + 0.3990788459777832, + 1.0783315487205982 + ], + "unique_experts": 63, + "load_cv": 0.6356526252768395, + "normalized_load_entropy": 0.9499191399867621, + "max_load_share": 0.044753086419753084 + }, + "full_input": { + "tokens": 133, + "top_k": 6, + "decisions": 798, + "ordered_route_sha256": "7cb069b8854c973cdcf168a10f40d740db52761e6d1969f08d71344fa55852ea", + "route_weight_sha256": "db4688ae191dee995463118934aeceb23a38d864b94e3318433604e7c51ef427", + "loads": [ + 8, + 23, + 13, + 9, + 14, + 20, + 7, + 14, + 11, + 9, + 30, + 6, + 15, + 1, + 19, + 28, + 3, + 21, + 27, + 10, + 6, + 10, + 11, + 7, + 1, + 29, + 3, + 11, + 19, + 6, + 2, + 4, + 5, + 7, + 22, + 21, + 3, + 3, + 26, + 21, + 27, + 16, + 16, + 9, + 12, + 3, + 8, + 9, + 7, + 11, + 20, + 0, + 4, + 28, + 5, + 15, + 19, + 8, + 16, + 30, + 6, + 6, + 7, + 11 + ], + "weighted_loads": [ + 0.45754803344607353, + 1.8110453644767404, + 0.6563967689871788, + 0.5234412364661694, + 0.9070426374673843, + 0.8354380149394274, + 0.3020765334367752, + 0.7208130036015064, + 0.39000727189704776, + 0.2804571334272623, + 1.9349777977913618, + 0.2991850096732378, + 1.0578446052968502, + 0.03256877884268761, + 1.7232865560799837, + 3.4816461293958127, + 0.2078171707689762, + 1.4310572035610676, + 2.1404811777174473, + 0.4754422763362527, + 0.15952278953045607, + 0.663910273462534, + 0.9185174368321896, + 0.41151369363069534, + 0.03209406137466431, + 3.0584135837852955, + 0.11967363022267818, + 0.5968488771468401, + 1.0044731609523296, + 0.3898790590465069, + 0.1615753173828125, + 0.13814175873994827, + 0.1778862439095974, + 0.2731462884694338, + 1.8536394834518433, + 1.560756092891097, + 0.1241789199411869, + 0.0953690055757761, + 2.455482240766287, + 1.3362235818058252, + 2.3412894047796726, + 1.295006562024355, + 0.9048748798668385, + 0.6657993569970131, + 0.8564543835818768, + 0.2606814056634903, + 0.5157262645661831, + 0.29843859374523163, + 0.371997632086277, + 0.460471386089921, + 1.888526413589716, + 0.0, + 0.7628705911338329, + 2.2092416174709797, + 0.12261694110929966, + 0.9100874923169613, + 0.9997811317443848, + 0.5010151229798794, + 0.7710513733327389, + 2.0342835262417793, + 0.6087918542325497, + 0.29978176578879356, + 0.3990788459777832, + 2.014378610998392 + ], + "unique_experts": 63, + "load_cv": 0.6660398055344673, + "normalized_load_entropy": 0.9450702573166054, + "max_load_share": 0.03759398496240601 + } + }, + "s1_bos": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "01c644c04b544127dddd2c861c29b2678db2427704f23f2b44be30fb41201205", + "route_weight_sha256": "366265779672bab42f42236155ef2a6e8510558aaf3c12cef21690f8bc3b8243", + "loads": [ + 12, + 21, + 10, + 9, + 15, + 19, + 4, + 11, + 9, + 9, + 18, + 7, + 12, + 1, + 19, + 15, + 1, + 15, + 18, + 9, + 5, + 9, + 10, + 7, + 1, + 21, + 5, + 10, + 19, + 6, + 2, + 4, + 4, + 6, + 22, + 17, + 3, + 4, + 14, + 12, + 24, + 8, + 6, + 8, + 12, + 3, + 8, + 7, + 8, + 5, + 14, + 0, + 4, + 19, + 4, + 4, + 20, + 7, + 17, + 29, + 6, + 5, + 7, + 8 + ], + "weighted_loads": [ + 0.5782814789563417, + 1.7863614968955517, + 0.536736249923706, + 0.5344846062362194, + 0.9086713790893555, + 0.7914128769189119, + 0.1918223313987255, + 0.6833426058292389, + 0.34935031831264496, + 0.28436187468469143, + 1.2297153640538454, + 0.3468874655663967, + 0.8780852146446705, + 0.031327132135629654, + 1.7230858765542507, + 1.350342072546482, + 0.044976260513067245, + 1.118256125599146, + 1.2555069625377655, + 0.4874632600694895, + 0.14813661389052868, + 0.6251618303358555, + 0.8688279613852501, + 0.41162304393947124, + 0.03186831995844841, + 2.1519008353352547, + 0.1756481435149908, + 0.5631835199892521, + 0.9856327380985022, + 0.367548581212759, + 0.16538554802536964, + 0.13948806002736092, + 0.15714368969202042, + 0.2558266893029213, + 1.8065400216728449, + 1.2593478485941887, + 0.12121696770191193, + 0.1256525944918394, + 1.1950019970536232, + 0.6504726968705654, + 2.198672205209732, + 0.4527825638651848, + 0.3204971682280302, + 0.6367053687572479, + 0.8043782487511635, + 0.2619895786046982, + 0.5089601315557957, + 0.25053051486611366, + 0.3985478822141886, + 0.2067604809999466, + 1.3128603249788284, + 0.0, + 0.12638591788709164, + 1.5748708583414555, + 0.1452515721321106, + 0.1948209721595049, + 1.0480202473700047, + 0.4638419523835182, + 0.8117650710046291, + 2.000020742416382, + 0.622742086648941, + 0.24915650114417076, + 0.396631196141243, + 1.0039495341479778 + ], + "unique_experts": 63, + "load_cv": 0.6423313352754846, + "normalized_load_entropy": 0.9493950736857154, + "max_load_share": 0.044753086419753084 + }, + "full_input": { + "tokens": 149, + "top_k": 6, + "decisions": 894, + "ordered_route_sha256": "c3b80e2b25b965ca36c54701b7358643a3b607a301a3bed7c027922b1e8ace0f", + "route_weight_sha256": "e8659468e4a5582520d75cb31a7228321d74a99fd1375411bce87054c1497599", + "loads": [ + 13, + 22, + 10, + 15, + 15, + 21, + 13, + 13, + 10, + 9, + 33, + 10, + 17, + 2, + 20, + 31, + 5, + 26, + 32, + 19, + 6, + 10, + 11, + 7, + 2, + 29, + 5, + 12, + 19, + 8, + 2, + 4, + 5, + 7, + 23, + 21, + 4, + 7, + 28, + 24, + 26, + 21, + 17, + 12, + 13, + 3, + 8, + 9, + 8, + 18, + 25, + 2, + 5, + 29, + 7, + 15, + 20, + 7, + 18, + 30, + 7, + 5, + 7, + 12 + ], + "weighted_loads": [ + 0.6149805281311274, + 1.7899230481125414, + 0.536736249923706, + 0.9482341334223747, + 0.9086713790893555, + 0.8637250531464815, + 1.2129262685775757, + 0.7378036384470761, + 0.3526993345003575, + 0.28436187468469143, + 2.1286784783005714, + 0.7173283360898495, + 1.292206272482872, + 0.06707145646214485, + 1.7571750432252884, + 4.060761751141399, + 0.3259149231016636, + 1.7967688031494617, + 2.524236548691988, + 1.3399546751752496, + 0.160721224732697, + 0.6722925268113613, + 0.9071037843823433, + 0.41162304393947124, + 0.10823271796107292, + 2.8694168385118246, + 0.1756481435149908, + 0.736741665750742, + 0.9856327380985022, + 0.45311276614665985, + 0.16538554802536964, + 0.13948806002736092, + 0.27637648582458496, + 0.29854292050004005, + 1.8408242594450712, + 1.6943927854299545, + 0.1667673960328102, + 0.27645049430429935, + 2.6066142953932285, + 1.7793739512562752, + 2.2897492460906506, + 1.7233479544520378, + 1.0757885295897722, + 0.8729771077632904, + 0.8658813908696175, + 0.2619895786046982, + 0.5089601315557957, + 0.2993279453366995, + 0.3985478822141886, + 0.9943372886627913, + 2.404955968260765, + 0.06795927882194519, + 0.7909126784652472, + 2.38065754622221, + 0.19855007505975664, + 0.8311670664697886, + 1.0480202473700047, + 0.4638419523835182, + 0.8824866153299809, + 2.0474100336432457, + 0.6684400923550129, + 0.24915650114417076, + 0.396631196141243, + 2.18095338717103 + ], + "unique_experts": 64, + "load_cv": 0.6204858399327635, + "normalized_load_entropy": 0.9528905525383967, + "max_load_share": 0.03691275167785235 + } + }, + "s0_x": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "2342a313d1447e3ec085f7fc9c294d9d65d894e1f28ea023c3cc7780cc7c9f18", + "route_weight_sha256": "c5c0187cb2d48d5c23a85f0141ea9d192facbd2cce4b2080021ff303e7bdd809", + "loads": [ + 10, + 22, + 11, + 9, + 15, + 19, + 4, + 10, + 9, + 9, + 20, + 6, + 11, + 1, + 19, + 15, + 1, + 15, + 18, + 7, + 5, + 10, + 10, + 7, + 1, + 21, + 3, + 10, + 20, + 8, + 2, + 2, + 5, + 6, + 22, + 16, + 3, + 3, + 12, + 12, + 25, + 8, + 7, + 7, + 11, + 3, + 8, + 8, + 7, + 5, + 15, + 0, + 4, + 19, + 4, + 5, + 21, + 8, + 15, + 30, + 6, + 7, + 7, + 9 + ], + "weighted_loads": [ + 0.5267916116863489, + 1.806484878063202, + 0.5827872883528471, + 0.5212993696331978, + 0.9094484206289053, + 0.8097754158079624, + 0.19032959640026093, + 0.601070960983634, + 0.3526138700544834, + 0.27667534351348877, + 1.308189183473587, + 0.28830450773239136, + 0.8574806191027164, + 0.03247949853539467, + 1.724860180169344, + 1.3124455492943525, + 0.043669141829013824, + 1.0965230390429497, + 1.3511793203651905, + 0.4033309035003185, + 0.14589702896773815, + 0.6384757962077856, + 0.8926972113549709, + 0.4089603628963232, + 0.03281247615814209, + 2.172957118600607, + 0.11896300502121449, + 0.5681593455374241, + 1.0424559973180294, + 0.431533295661211, + 0.15987658873200417, + 0.07082057371735573, + 0.1773418579250574, + 0.2500975988805294, + 1.8784673940390348, + 1.2169460151344538, + 0.12214106693863869, + 0.09658091515302658, + 1.1506055481731892, + 0.6826458182185888, + 2.2270806431770325, + 0.46201898716390133, + 0.3427463788539171, + 0.5814331658184528, + 0.7550244331359863, + 0.26309728622436523, + 0.5059020817279816, + 0.2833823710680008, + 0.3671772610396147, + 0.2112894132733345, + 1.2950029596686363, + 0.0, + 0.12453506700694561, + 1.6108184196054935, + 0.14983852952718735, + 0.21741846203804016, + 1.0740989800542593, + 0.5014780107885599, + 0.7415276672691107, + 2.0023244842886925, + 0.6321942061185837, + 0.3249511159956455, + 0.39150042831897736, + 1.0725794583559036 + ], + "unique_experts": 63, + "load_cv": 0.6582690116922608, + "normalized_load_entropy": 0.9473202271586035, + "max_load_share": 0.046296296296296294 + }, + "full_input": { + "tokens": 133, + "top_k": 6, + "decisions": 798, + "ordered_route_sha256": "318af3513c0e1e8b1dd52f61fa4378eb365b2c172c80f34335005d8b9f0a9608", + "route_weight_sha256": "583d2080c3fcd9d194736024a9ce15a75e1fbb3bcd2ef1f9b38786b9ed7e7518", + "loads": [ + 10, + 24, + 11, + 9, + 15, + 20, + 6, + 12, + 10, + 9, + 33, + 6, + 14, + 1, + 19, + 29, + 3, + 21, + 27, + 8, + 6, + 11, + 10, + 7, + 1, + 30, + 3, + 10, + 20, + 8, + 2, + 2, + 5, + 6, + 22, + 20, + 3, + 3, + 23, + 20, + 31, + 16, + 13, + 8, + 12, + 3, + 8, + 9, + 7, + 8, + 22, + 0, + 5, + 30, + 6, + 15, + 21, + 8, + 15, + 31, + 6, + 7, + 7, + 11 + ], + "weighted_loads": [ + 0.5267916116863489, + 1.8472713278606534, + 0.5827872883528471, + 0.5212993696331978, + 0.9094484206289053, + 0.8461610712110996, + 0.26414480432868004, + 0.6381812014151365, + 0.35594846261665225, + 0.27667534351348877, + 2.1420258302241564, + 0.28830450773239136, + 1.0401067696511745, + 0.03247949853539467, + 1.724860180169344, + 3.671370235737413, + 0.20592252165079117, + 1.3952768333256245, + 2.0895428992807865, + 0.416416029445827, + 0.15848163980990648, + 0.6815131325274706, + 0.8926972113549709, + 0.4089603628963232, + 0.03281247615814209, + 3.1544584780931473, + 0.11896300502121449, + 0.5681593455374241, + 1.0424559973180294, + 0.431533295661211, + 0.15987658873200417, + 0.07082057371735573, + 0.1773418579250574, + 0.2500975988805294, + 1.8784673940390348, + 1.5290875192731619, + 0.12214106693863869, + 0.09658091515302658, + 2.127587240189314, + 1.345162084326148, + 2.516896527260542, + 1.2586715500801802, + 0.7218616548925638, + 0.6172447018325329, + 0.8364475667476654, + 0.26309728622436523, + 0.5059020817279816, + 0.2989753056317568, + 0.3671772610396147, + 0.35640658996999264, + 1.9090567268431187, + 0.0, + 0.7890618275851011, + 2.317644901573658, + 0.16480292938649654, + 0.9818093441426754, + 1.0740989800542593, + 0.5014780107885599, + 0.7415276672691107, + 2.0485264472663403, + 0.6321942061185837, + 0.3249511159956455, + 0.39150042831897736, + 2.0086265206336975 + ], + "unique_experts": 63, + "load_cv": 0.6972960778712993, + "normalized_load_entropy": 0.9414855275317758, + "max_load_share": 0.041353383458646614 + } + }, + "s1_x": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "2280258b85f82eab5eaa57553322aca254826e7d6e5ba7ce96d1045e1d3df8d0", + "route_weight_sha256": "be0ccfe65c4864d7589f99bff37022f7ba600a3069dda45e68ace47b9fd484c0", + "loads": [ + 11, + 21, + 10, + 9, + 15, + 19, + 4, + 10, + 10, + 9, + 18, + 7, + 12, + 1, + 19, + 15, + 1, + 15, + 18, + 9, + 5, + 10, + 10, + 6, + 1, + 21, + 4, + 11, + 20, + 6, + 2, + 4, + 5, + 6, + 22, + 17, + 3, + 3, + 13, + 12, + 24, + 7, + 6, + 7, + 12, + 3, + 8, + 8, + 7, + 5, + 13, + 0, + 6, + 19, + 4, + 4, + 21, + 8, + 16, + 29, + 6, + 6, + 7, + 8 + ], + "weighted_loads": [ + 0.5658132340759039, + 1.7777033634483814, + 0.5298038795590401, + 0.517714612185955, + 0.9108520913869143, + 0.8047138918191195, + 0.19291065260767937, + 0.6496576406061649, + 0.38008242286741734, + 0.2820698358118534, + 1.266119483858347, + 0.30701303482055664, + 0.8865457475185394, + 0.03132977709174156, + 1.7254894580692053, + 1.3545777685940266, + 0.04409017041325569, + 1.094813745468855, + 1.2898419573903084, + 0.4940220285207033, + 0.1796818096190691, + 0.6502821147441864, + 0.8655250445008278, + 0.3561780247837305, + 0.03358276188373566, + 2.1339105628430843, + 0.14736061915755272, + 0.5894109457731247, + 1.000978136435151, + 0.3519634045660496, + 0.16282935813069344, + 0.13644307479262352, + 0.18911711871623993, + 0.2513689771294594, + 1.7796621304005384, + 1.2619120702147484, + 0.1166587732732296, + 0.09202479384839535, + 1.1472738459706306, + 0.665728447958827, + 2.2175744771957397, + 0.3989458456635475, + 0.3071835581213236, + 0.5823019072413445, + 0.8019386492669582, + 0.26125381141901016, + 0.512939378619194, + 0.2928180508315563, + 0.3759436346590519, + 0.2115556225180626, + 1.2129791751503944, + 0.0, + 0.1895795315504074, + 1.554383311420679, + 0.14588556066155434, + 0.19631955213844776, + 1.0807106606662273, + 0.5135054104030132, + 0.7811024449765682, + 1.993534754961729, + 0.6399651542305946, + 0.2899317927658558, + 0.3909902349114418, + 0.997064646333456 + ], + "unique_experts": 63, + "load_cv": 0.6428057307133241, + "normalized_load_entropy": 0.9494631417452383, + "max_load_share": 0.044753086419753084 + }, + "full_input": { + "tokens": 149, + "top_k": 6, + "decisions": 894, + "ordered_route_sha256": "2009cdf330f34a59423293701b2e69bd0444024932a770ed063fabcdc77d8dc7", + "route_weight_sha256": "514670ffc735517b7ea29974cc6ca93079865bbaaeed8c71a5ca3ca67ae08b46", + "loads": [ + 12, + 22, + 10, + 15, + 15, + 21, + 13, + 12, + 11, + 9, + 34, + 10, + 17, + 2, + 20, + 31, + 5, + 26, + 32, + 19, + 6, + 11, + 11, + 6, + 2, + 30, + 4, + 13, + 20, + 8, + 2, + 4, + 6, + 8, + 23, + 22, + 4, + 6, + 24, + 24, + 27, + 19, + 16, + 11, + 13, + 3, + 8, + 10, + 7, + 18, + 22, + 2, + 7, + 31, + 7, + 15, + 21, + 8, + 17, + 30, + 7, + 6, + 7, + 12 + ], + "weighted_loads": [ + 0.6025122832506895, + 1.7812649146653712, + 0.5298038795590401, + 0.9314641393721104, + 0.9108520913869143, + 0.877026068046689, + 1.2118662260472775, + 0.7041186732240021, + 0.3834314390551299, + 0.2820698358118534, + 2.2698433566838503, + 0.6774539053440094, + 1.2988153211772442, + 0.06537051871418953, + 1.759578624740243, + 4.257407659199089, + 0.3341822773218155, + 1.7733264230191708, + 2.4333587139844894, + 1.3465134436264634, + 0.19226642046123743, + 0.6960754692554474, + 0.903800867497921, + 0.3561780247837305, + 0.10994715988636017, + 2.9292785990983248, + 0.14736061915755272, + 0.7629690915346146, + 1.000978136435151, + 0.4375275894999504, + 0.16282935813069344, + 0.13644307479262352, + 0.3083499148488045, + 0.3381502963602543, + 1.8139463681727648, + 1.7427771724760532, + 0.16220920160412788, + 0.2428226936608553, + 2.20861142501235, + 1.806837072595954, + 2.381507281213999, + 1.5838447660207748, + 0.9883490893989801, + 0.8160804100334644, + 0.8634417913854122, + 0.26125381141901016, + 0.512939378619194, + 0.34161548130214214, + 0.3759436346590519, + 0.9964872803539038, + 2.2206993401050568, + 0.06795927882194519, + 0.8541062921285629, + 2.4727713763713837, + 0.19918406358920038, + 0.905450502410531, + 1.0807106606662273, + 0.5135054104030132, + 0.8518239893019199, + 2.040924046188593, + 0.6856631599366665, + 0.2899317927658558, + 0.3909902349114418, + 2.1740684993565083 + ], + "unique_experts": 64, + "load_cv": 0.6181584946661528, + "normalized_load_entropy": 0.9535314754648646, + "max_load_share": 0.03803131991051454 + } + }, + "s0_period": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "6ccb82ac61a27164cb163aee18e620a619dec64a4fd8f930473f1cc35ad9439a", + "route_weight_sha256": "c4b8277a870f9ff367b1f9b14cbc45087dc56ff9008d857dbdbebf35f066814d", + "loads": [ + 9, + 22, + 11, + 9, + 15, + 20, + 4, + 10, + 9, + 8, + 18, + 6, + 12, + 1, + 19, + 15, + 1, + 15, + 18, + 9, + 5, + 9, + 11, + 8, + 1, + 21, + 3, + 11, + 19, + 8, + 2, + 3, + 5, + 6, + 22, + 16, + 3, + 3, + 13, + 12, + 24, + 8, + 6, + 7, + 11, + 3, + 7, + 8, + 7, + 5, + 15, + 0, + 4, + 19, + 4, + 5, + 21, + 8, + 15, + 30, + 6, + 7, + 7, + 9 + ], + "weighted_loads": [ + 0.4940965138375759, + 1.79312389716506, + 0.5809583608061075, + 0.518247663974762, + 0.897098109126091, + 0.8350861575454473, + 0.1895916871726513, + 0.5906566362828016, + 0.355376735329628, + 0.2423195205628872, + 1.239598374813795, + 0.28499478846788406, + 0.9096333347260952, + 0.03247452154755592, + 1.7004564516246319, + 1.3185167089104652, + 0.04463139921426773, + 1.0805690921843052, + 1.3666846565902233, + 0.4781311545521021, + 0.1462846454232931, + 0.6090930737555027, + 0.9249672554433346, + 0.44033983908593655, + 0.03336058557033539, + 2.158302668482065, + 0.12040702812373638, + 0.593874778598547, + 1.002378774806857, + 0.42589819990098476, + 0.15887786075472832, + 0.1029951386153698, + 0.17690754309296608, + 0.2491208277642727, + 1.8796641677618027, + 1.2323737349361181, + 0.12019576504826546, + 0.09660397656261921, + 1.1901442371308804, + 0.7026571314781904, + 2.1848400942981243, + 0.44578076899051666, + 0.3140702024102211, + 0.5794941894710064, + 0.7611574083566666, + 0.26083435118198395, + 0.46614889055490494, + 0.2856720145791769, + 0.369390320032835, + 0.20880945213139057, + 1.2698736321181059, + 0.0, + 0.1259070411324501, + 1.6165003180503845, + 0.1526607945561409, + 0.22307484224438667, + 1.0654153991490602, + 0.5021621026098728, + 0.7398655265569687, + 1.9973634704947472, + 0.6278953440487385, + 0.3215402252972126, + 0.38977575674653053, + 1.092912394553423 + ], + "unique_experts": 63, + "load_cv": 0.6505833148768098, + "normalized_load_entropy": 0.9483836357568162, + "max_load_share": 0.046296296296296294 + }, + "full_input": { + "tokens": 133, + "top_k": 6, + "decisions": 798, + "ordered_route_sha256": "edc8e14b0412bd2b72a68fb12512fd06f1b25f49e01812dd9b5497475bdc4ec0", + "route_weight_sha256": "a00379bd7974a3ba8e5e105eddd05e20250f16d4a3c0e631be91a401f6482e55", + "loads": [ + 9, + 24, + 11, + 9, + 15, + 21, + 6, + 12, + 10, + 8, + 31, + 6, + 15, + 1, + 19, + 29, + 4, + 22, + 27, + 10, + 6, + 10, + 11, + 8, + 1, + 29, + 3, + 11, + 19, + 8, + 2, + 3, + 5, + 6, + 22, + 21, + 3, + 3, + 24, + 20, + 29, + 16, + 12, + 8, + 13, + 3, + 7, + 9, + 7, + 8, + 22, + 0, + 5, + 28, + 6, + 15, + 21, + 8, + 15, + 31, + 6, + 7, + 7, + 11 + ], + "weighted_loads": [ + 0.4940965138375759, + 1.8340167561545968, + 0.5809583608061075, + 0.518247663974762, + 0.897098109126091, + 0.8714718129485846, + 0.2638922519981861, + 0.6282905556727201, + 0.3587113278917968, + 0.2423195205628872, + 2.0726916175335646, + 0.28499478846788406, + 1.0925645641982555, + 0.03247452154755592, + 1.7004564516246319, + 3.507616705726832, + 0.24637529626488686, + 1.4366083852946758, + 2.0527044720947742, + 0.49121628049761057, + 0.15886925626546144, + 0.6520718187093735, + 0.9249672554433346, + 0.44033983908593655, + 0.03336058557033539, + 3.0542167276144028, + 0.12040702812373638, + 0.593874778598547, + 1.002378774806857, + 0.42589819990098476, + 0.15887786075472832, + 0.1029951386153698, + 0.17690754309296608, + 0.2491208277642727, + 1.8796641677618027, + 1.5973656121641397, + 0.12019576504826546, + 0.09660397656261921, + 2.1341165713965893, + 1.3677463624626398, + 2.417075391858816, + 1.2833605781197548, + 0.7009058706462383, + 0.6147163808345795, + 0.8977414555847645, + 0.26083435118198395, + 0.46614889055490494, + 0.3012649491429329, + 0.369390320032835, + 0.35345400869846344, + 1.8762473370879889, + 0.0, + 0.7904338017106056, + 2.209969285875559, + 0.1676251944154501, + 1.1162376180291176, + 1.0654153991490602, + 0.5021621026098728, + 0.7398655265569687, + 2.043565433472395, + 0.6278953440487385, + 0.3215402252972126, + 0.38977575674653053, + 2.028959456831217 + ], + "unique_experts": 63, + "load_cv": 0.6806668724752445, + "normalized_load_entropy": 0.9437070136805462, + "max_load_share": 0.03884711779448621 + } + }, + "s1_period": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "4c857f4d2b6277dcfb91ec4ac71a4fb4cddce62bdd5c5e3aec5d47f76522888a", + "route_weight_sha256": "29e17812d125f7adfaefa5d1ef0b4e8a38fb83234903cb7a236deba73eaddb9a", + "loads": [ + 11, + 21, + 11, + 9, + 16, + 18, + 4, + 11, + 10, + 10, + 20, + 6, + 12, + 1, + 19, + 16, + 1, + 15, + 18, + 9, + 5, + 10, + 11, + 6, + 1, + 21, + 5, + 10, + 19, + 5, + 2, + 5, + 4, + 7, + 22, + 17, + 3, + 3, + 12, + 12, + 23, + 7, + 6, + 7, + 12, + 3, + 8, + 7, + 7, + 5, + 14, + 0, + 4, + 19, + 5, + 4, + 20, + 8, + 15, + 29, + 6, + 7, + 6, + 8 + ], + "weighted_loads": [ + 0.5662785097956657, + 1.7766390927135944, + 0.5686173532158136, + 0.528978731483221, + 0.94884442538023, + 0.7667460702359676, + 0.1939874105155468, + 0.6880506500601768, + 0.3808394819498062, + 0.31170819513499737, + 1.3334363792091608, + 0.2848426438868046, + 0.8976439088582993, + 0.03132756054401398, + 1.7088021226227283, + 1.4070466496050358, + 0.04530816897749901, + 1.0792272314429283, + 1.3050587698817253, + 0.4840862937271595, + 0.17652921751141548, + 0.6562135480344296, + 0.9147013239562511, + 0.3560727406293154, + 0.03396719694137573, + 2.139847308397293, + 0.17477798275649548, + 0.5658866129815578, + 0.9740611892193556, + 0.32033854350447655, + 0.16385576874017715, + 0.16899150423705578, + 0.15554962679743767, + 0.2728107701987028, + 1.8061637189239264, + 1.2656288631260395, + 0.12211810052394867, + 0.09114008769392967, + 1.099230334162712, + 0.6775826811790466, + 2.180627988651395, + 0.39430320635437965, + 0.31439621560275555, + 0.5870300941169262, + 0.803863599896431, + 0.2611743062734604, + 0.5116240233182907, + 0.2561723552644253, + 0.37219489738345146, + 0.20312759466469288, + 1.2302409335970879, + 0.0, + 0.12537325732409954, + 1.559279128909111, + 0.18273258954286575, + 0.19314946793019772, + 1.0516268368810415, + 0.49270346015691757, + 0.7434079982340336, + 2.001420710235834, + 0.6359598003327847, + 0.32355184108018875, + 0.35677647590637207, + 1.0107518434524536 + ], + "unique_experts": 63, + "load_cv": 0.6401922055537863, + "normalized_load_entropy": 0.949583976668004, + "max_load_share": 0.044753086419753084 + }, + "full_input": { + "tokens": 149, + "top_k": 6, + "decisions": 894, + "ordered_route_sha256": "9e843142727fc3fdd7225c90fcdfc0c8c596cf15a74e2698e869a5e6b7f932b6", + "route_weight_sha256": "0a4275a784c48e03bce2ff324a5e5a568dca862e6063d0af7a00f1f7c6978ea5", + "loads": [ + 12, + 22, + 11, + 15, + 16, + 21, + 13, + 14, + 11, + 10, + 36, + 9, + 17, + 1, + 20, + 33, + 5, + 27, + 31, + 19, + 6, + 11, + 12, + 6, + 2, + 29, + 5, + 12, + 19, + 7, + 2, + 5, + 5, + 8, + 23, + 22, + 4, + 6, + 23, + 24, + 26, + 20, + 16, + 10, + 14, + 3, + 8, + 9, + 7, + 18, + 23, + 2, + 6, + 29, + 8, + 15, + 20, + 8, + 16, + 30, + 7, + 7, + 6, + 12 + ], + "weighted_loads": [ + 0.6029775589704514, + 1.7802006439305842, + 0.5686173532158136, + 0.9427282586693764, + 0.94884442538023, + 0.8829536773264408, + 1.2133401185274124, + 0.776283931452781, + 0.38418849813751876, + 0.31170819513499737, + 2.351075626909733, + 0.6552835144102573, + 1.310533031821251, + 0.03132756054401398, + 1.742891289293766, + 4.18721924116835, + 0.3575270511209965, + 1.7999600432813168, + 2.3784767128527164, + 1.3365777088329196, + 0.1891138283535838, + 0.7014576755464077, + 0.9529771469533443, + 0.3560727406293154, + 0.11033159494400024, + 2.857363311573863, + 0.17477798275649548, + 0.7394447587430477, + 0.9740611892193556, + 0.4059027284383774, + 0.16385576874017715, + 0.16899150423705578, + 0.2747824229300022, + 0.31552700139582157, + 1.8404479566961527, + 1.7808285392820835, + 0.16766852885484695, + 0.24193798750638962, + 2.119609747081995, + 1.82037453353405, + 2.3225037697702646, + 1.6888017915189266, + 1.0148492138832808, + 0.7862513177096844, + 0.9105280302464962, + 0.2611743062734604, + 0.5116240233182907, + 0.3049697857350111, + 0.37219489738345146, + 0.988001361489296, + 2.2328123822808266, + 0.06795927882194519, + 0.824552496895194, + 2.3650658167898655, + 0.2360310924705118, + 0.9871274065226316, + 1.0516268368810415, + 0.49270346015691757, + 0.8141295425593853, + 2.048810001462698, + 0.6816578060388565, + 0.32355184108018875, + 0.35677647590637207, + 2.187755696475506 + ], + "unique_experts": 64, + "load_cv": 0.6200985556497262, + "normalized_load_entropy": 0.9530692504213715, + "max_load_share": 0.040268456375838924 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 108, + "ordered_topk_exact_tokens": 78, + "set_exact_tokens": 87, + "mean_set_jaccard": 0.9444444444444444, + "mean_token_weighted_tv": 0.01150225955751483, + "aggregate_load_tv": 0.026234567901234566 + }, + "system_bos": { + "tokens": 108, + "ordered_topk_exact_tokens": 73, + "set_exact_tokens": 82, + "mean_set_jaccard": 0.9292328042328043, + "mean_token_weighted_tv": 0.015414003162058416, + "aggregate_load_tv": 0.029320987654320986 + }, + "system_x": { + "tokens": 108, + "ordered_topk_exact_tokens": 69, + "set_exact_tokens": 81, + "mean_set_jaccard": 0.9265873015873015, + "mean_token_weighted_tv": 0.016833078668073372, + "aggregate_load_tv": 0.024691358024691357 + }, + "system_period": { + "tokens": 108, + "ordered_topk_exact_tokens": 60, + "set_exact_tokens": 78, + "mean_set_jaccard": 0.9206349206349208, + "mean_token_weighted_tv": 0.01763621947935058, + "aggregate_load_tv": 0.030864197530864196 + }, + "bos_at_s0": { + "tokens": 108, + "ordered_topk_exact_tokens": 61, + "set_exact_tokens": 79, + "mean_set_jaccard": 0.9133597883597884, + "mean_token_weighted_tv": 0.021013283791641395, + "aggregate_load_tv": 0.035493827160493825 + }, + "bos_at_s1": { + "tokens": 108, + "ordered_topk_exact_tokens": 60, + "set_exact_tokens": 75, + "mean_set_jaccard": 0.9126984126984128, + "mean_token_weighted_tv": 0.02207347153065105, + "aggregate_load_tv": 0.043209876543209874 + }, + "x_at_s0": { + "tokens": 108, + "ordered_topk_exact_tokens": 63, + "set_exact_tokens": 77, + "mean_set_jaccard": 0.9140211640211641, + "mean_token_weighted_tv": 0.020969564069269434, + "aggregate_load_tv": 0.041666666666666664 + }, + "x_at_s1": { + "tokens": 108, + "ordered_topk_exact_tokens": 52, + "set_exact_tokens": 69, + "mean_set_jaccard": 0.8948412698412698, + "mean_token_weighted_tv": 0.02532986751585095, + "aggregate_load_tv": 0.038580246913580245 + }, + "period_at_s0": { + "tokens": 108, + "ordered_topk_exact_tokens": 61, + "set_exact_tokens": 76, + "mean_set_jaccard": 0.9093915343915344, + "mean_token_weighted_tv": 0.021661561353270103, + "aggregate_load_tv": 0.040123456790123455 + }, + "period_at_s1": { + "tokens": 108, + "ordered_topk_exact_tokens": 47, + "set_exact_tokens": 67, + "mean_set_jaccard": 0.8875661375661378, + "mean_token_weighted_tv": 0.026465089000002655, + "aggregate_load_tv": 0.04938271604938271 + } + } + }, + "layer_06": { + "layer": 6, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "57ef4e2f663abc5433eccfe7cbbeb1c7418ea44be0f39c76bbfe3a2438139762", + "route_weight_sha256": "e7ae266d62ce7fa9e5c711f7812da0554c6b93090485dab9b1d78edc992c33c2", + "loads": [ + 4, + 14, + 3, + 3, + 24, + 0, + 30, + 12, + 5, + 13, + 6, + 20, + 16, + 6, + 1, + 6, + 10, + 9, + 8, + 12, + 12, + 5, + 14, + 17, + 5, + 27, + 9, + 4, + 13, + 7, + 5, + 7, + 1, + 16, + 13, + 18, + 3, + 12, + 3, + 14, + 4, + 8, + 10, + 3, + 8, + 8, + 13, + 12, + 3, + 10, + 7, + 20, + 1, + 1, + 8, + 19, + 11, + 15, + 6, + 20, + 11, + 12, + 9, + 22 + ], + "weighted_loads": [ + 0.17318537086248398, + 0.626079523935914, + 0.1940256841480732, + 0.11172903701663017, + 2.022420383989811, + 0.0, + 3.0096904076635838, + 0.6813725680112839, + 0.27985008992254734, + 1.1766049079596996, + 0.3552436865866184, + 1.4531119130551815, + 0.9824871234595776, + 0.20666171610355377, + 0.04015055671334267, + 0.1735264528542757, + 0.726456418633461, + 0.49243344739079475, + 0.5450049638748169, + 0.8433445245027542, + 0.7793947644531727, + 0.2196957916021347, + 0.6039930544793606, + 1.6740058697760105, + 0.1935288906097412, + 2.0925255492329597, + 0.3264472298324108, + 0.19392608851194382, + 0.6514376103878021, + 0.3293008357286453, + 0.2120352815836668, + 0.3655062112957239, + 0.02976839803159237, + 0.8599206302314997, + 0.7845055591315031, + 1.0308927930891514, + 0.3081870935857296, + 0.8116132616996765, + 0.1422092281281948, + 0.5364097133278847, + 0.2010713294148445, + 0.4924597293138504, + 0.42228539660573006, + 0.20749761536717415, + 0.38878799974918365, + 0.28289649076759815, + 0.9365759119391441, + 0.44368650764226913, + 0.14229096472263336, + 0.8429404962807894, + 0.3450523130595684, + 1.6572441831231117, + 0.027353806421160698, + 0.03889130428433418, + 0.370353315025568, + 1.7189730405807495, + 1.0950037203729153, + 0.8388626482337713, + 0.2082791682332754, + 1.6888882517814636, + 0.6383855994790792, + 0.4978070352226496, + 0.3109231684356928, + 1.6109746098518372 + ], + "unique_experts": 63, + "load_cv": 0.6496455366381664, + "normalized_load_entropy": 0.9479291445979207, + "max_load_share": 0.046296296296296294 + }, + "full_input": { + "tokens": 133, + "top_k": 6, + "decisions": 798, + "ordered_route_sha256": "df025692f6b9919e008745c2fecb258ef27c16f98f8cfe30a3527abf3747ecfb", + "route_weight_sha256": "42e48bfdb595fce52409b0bef20d3963c44310a7d400c68d62708704e452689a", + "loads": [ + 4, + 17, + 3, + 3, + 25, + 0, + 38, + 12, + 5, + 13, + 6, + 26, + 16, + 8, + 3, + 6, + 15, + 10, + 8, + 20, + 13, + 8, + 17, + 18, + 5, + 28, + 9, + 4, + 13, + 10, + 5, + 7, + 4, + 16, + 14, + 24, + 3, + 21, + 3, + 23, + 4, + 13, + 12, + 3, + 8, + 13, + 26, + 14, + 7, + 10, + 14, + 27, + 1, + 1, + 8, + 29, + 21, + 15, + 6, + 29, + 11, + 12, + 9, + 22 + ], + "weighted_loads": [ + 0.17318537086248398, + 0.6952435309067369, + 0.1940256841480732, + 0.11172903701663017, + 2.050811916589737, + 0.0, + 3.872520126402378, + 0.6813725680112839, + 0.27985008992254734, + 1.1766049079596996, + 0.3552436865866184, + 1.8148128893226385, + 0.9824871234595776, + 0.23464807635173202, + 0.17086098715662956, + 0.1735264528542757, + 1.0570799112319946, + 0.4964746139012277, + 0.5450049638748169, + 1.3348473124206066, + 0.8236396424472332, + 0.3688663970679045, + 2.1276189368218184, + 1.70976010710001, + 0.1935288906097412, + 2.1200928669422865, + 0.3264472298324108, + 0.19392608851194382, + 0.6514376103878021, + 0.5066508278250694, + 0.2120352815836668, + 0.3655062112957239, + 0.12750351801514626, + 0.8599206302314997, + 0.8190772850066423, + 1.5762275829911232, + 0.3081870935857296, + 1.5871763192117214, + 0.1422092281281948, + 0.8981030788272619, + 0.2010713294148445, + 0.8903822787106037, + 0.4802373833954334, + 0.20749761536717415, + 0.38878799974918365, + 0.4179841806180775, + 2.4651156570762396, + 0.4659802573733032, + 0.3584510013461113, + 0.8429404962807894, + 0.8388381525874138, + 1.96250369399786, + 0.027353806421160698, + 0.03889130428433418, + 0.370353315025568, + 2.4806475192308426, + 2.237579096108675, + 0.8388626482337713, + 0.2082791682332754, + 2.6548389941453934, + 0.6383855994790792, + 0.4978070352226496, + 0.3109231684356928, + 1.6109746098518372 + ], + "unique_experts": 63, + "load_cv": 0.6777073970633986, + "normalized_load_entropy": 0.9441152270631575, + "max_load_share": 0.047619047619047616 + } + }, + "s1_eos": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "8a0473b0706d90af368644e00c6ee2e4d2c85a23772fa30f9be2dbece4acdad9", + "route_weight_sha256": "aaec9c330d657e1dc4ab94cf07bafb7010c6afdccdc2ae3362a64eb22bf44098", + "loads": [ + 3, + 15, + 3, + 2, + 24, + 0, + 30, + 11, + 4, + 13, + 6, + 21, + 17, + 6, + 1, + 7, + 10, + 11, + 8, + 12, + 12, + 5, + 15, + 18, + 6, + 28, + 8, + 6, + 11, + 7, + 5, + 7, + 1, + 15, + 13, + 16, + 3, + 12, + 5, + 11, + 5, + 8, + 11, + 3, + 8, + 8, + 11, + 14, + 4, + 10, + 5, + 21, + 0, + 1, + 8, + 19, + 11, + 16, + 6, + 19, + 11, + 12, + 8, + 21 + ], + "weighted_loads": [ + 0.13475511968135834, + 0.6681166738271713, + 0.19465159252285957, + 0.07545282691717148, + 1.9874438885599375, + 0.0, + 2.9823701716959476, + 0.6607661675661802, + 0.2710380181670189, + 1.177523635327816, + 0.3621893972158432, + 1.472698174417019, + 1.017186637967825, + 0.20248985290527344, + 0.04038110747933388, + 0.2064934279769659, + 0.7041922956705093, + 0.5671391170471907, + 0.5501738451421261, + 0.8639839198440313, + 0.789263729006052, + 0.22280609607696533, + 0.6529160924255848, + 1.6802403181791306, + 0.2243483792990446, + 2.151930920779705, + 0.2942757122218609, + 0.29423168674111366, + 0.5834837034344673, + 0.3290647938847542, + 0.20837656036019325, + 0.3689187951385975, + 0.029796434566378593, + 0.8262304458767176, + 0.7902368567883968, + 0.9707918148487806, + 0.30523189902305603, + 0.781498372554779, + 0.21787596680223942, + 0.4312249142676592, + 0.23705751076340675, + 0.4910639077425003, + 0.44337274320423603, + 0.20428158715367317, + 0.38264141231775284, + 0.28772944025695324, + 0.7983562462031841, + 0.5332286115735769, + 0.18409746885299683, + 0.8488969523459673, + 0.25242312997579575, + 1.6939583607017994, + 0.0, + 0.039423733949661255, + 0.37317904829978943, + 1.7245087046176195, + 1.0041842870414257, + 0.8643241822719574, + 0.20869947224855423, + 1.6390182673931122, + 0.6340857651084661, + 0.5058603025972843, + 0.27709637209773064, + 1.5189789086580276 + ], + "unique_experts": 62, + "load_cv": 0.6529218677618446, + "normalized_load_entropy": 0.9469768470092438, + "max_load_share": 0.046296296296296294 + }, + "full_input": { + "tokens": 149, + "top_k": 6, + "decisions": 894, + "ordered_route_sha256": "1b46fb6a6d3d01269f6e47cd3298c46f1dfe4398264dde35a57a076dc910217d", + "route_weight_sha256": "a5cdae4a958d153e6b20796408bb86e6961941d2df296411a5c9f730afd209ac", + "loads": [ + 3, + 17, + 6, + 3, + 26, + 0, + 44, + 12, + 9, + 19, + 6, + 31, + 21, + 8, + 10, + 8, + 20, + 12, + 10, + 22, + 14, + 9, + 17, + 19, + 7, + 29, + 8, + 7, + 12, + 10, + 5, + 10, + 7, + 16, + 17, + 24, + 4, + 29, + 5, + 20, + 5, + 13, + 13, + 3, + 9, + 11, + 28, + 17, + 7, + 10, + 14, + 27, + 1, + 4, + 8, + 30, + 28, + 16, + 6, + 30, + 17, + 12, + 8, + 21 + ], + "weighted_loads": [ + 0.13475511968135834, + 0.707701024133712, + 0.3358440324664116, + 0.11280972138047218, + 2.1384279411286116, + 0.0, + 4.211884880438447, + 0.7225091028958559, + 0.6132259741425514, + 1.8853920251131058, + 0.3621893972158432, + 2.096440587192774, + 1.3469264693558216, + 0.23081450536847115, + 0.7117690481245518, + 0.3175643216818571, + 1.460351750254631, + 0.571250269189477, + 0.6987884379923344, + 1.5658736806362867, + 0.8814878165721893, + 0.4474352765828371, + 2.145956475287676, + 1.7155650779604912, + 0.25687252543866634, + 2.187461033463478, + 0.2942757122218609, + 0.32089604809880257, + 0.620744414627552, + 0.534098606556654, + 0.20837656036019325, + 0.5662549026310444, + 0.21389096975326538, + 0.8595886323601007, + 1.0508436858654022, + 1.7378596644848585, + 0.339456744492054, + 2.115021876990795, + 0.21787596680223942, + 0.9053017739206553, + 0.23705751076340675, + 0.9006196931004524, + 0.5012817997485399, + 0.20428158715367317, + 0.46688199043273926, + 0.3549506780691445, + 2.6397740561515093, + 0.586593913147226, + 0.35615817457437515, + 0.8488969523459673, + 0.862141452729702, + 1.9345045872032642, + 0.03675880655646324, + 0.20705947652459145, + 0.37317904829978943, + 2.7376285400241613, + 2.7782621681690216, + 0.8643241822719574, + 0.20869947224855423, + 2.6940668988972902, + 0.9392069149762392, + 0.5058603025972843, + 0.27709637209773064, + 1.5189789086580276 + ], + "unique_experts": 63, + "load_cv": 0.6461530202730276, + "normalized_load_entropy": 0.950390989691901, + "max_load_share": 0.049217002237136466 + } + }, + "s0_bos": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "dfb491d1d668d7a23e89ea922503115bcc828d0ee1de059f323c55475d92dc27", + "route_weight_sha256": "7a9d0c351fc8f0d171af429a18fadfaf59d16f3251132f8435deafd20d7213a4", + "loads": [ + 4, + 18, + 3, + 2, + 26, + 0, + 30, + 12, + 5, + 13, + 5, + 20, + 17, + 6, + 1, + 6, + 10, + 11, + 7, + 10, + 12, + 3, + 14, + 17, + 5, + 27, + 9, + 5, + 12, + 7, + 4, + 7, + 3, + 14, + 13, + 17, + 3, + 11, + 4, + 15, + 5, + 7, + 9, + 4, + 8, + 8, + 14, + 12, + 4, + 9, + 9, + 20, + 0, + 0, + 9, + 19, + 11, + 15, + 7, + 19, + 11, + 11, + 7, + 22 + ], + "weighted_loads": [ + 0.16859743744134903, + 0.7623158637434244, + 0.18791576102375984, + 0.07902085408568382, + 2.2037968058139086, + 0.0, + 2.953138466924429, + 0.6933902744203806, + 0.29680003970861435, + 1.2436721175909042, + 0.3178314119577408, + 1.4412952736020088, + 1.0473257713019848, + 0.211722144857049, + 0.036993999034166336, + 0.17273955419659615, + 0.7429562285542488, + 0.5711813289672136, + 0.49481305852532387, + 0.7635701969265938, + 0.7752203308045864, + 0.14035193622112274, + 0.5894803758710623, + 1.7274431698024273, + 0.18408024311065674, + 2.091315820813179, + 0.3209160678088665, + 0.22988120838999748, + 0.6207632459700108, + 0.34044820070266724, + 0.17320368438959122, + 0.3812691681087017, + 0.10618827864527702, + 0.7747365608811378, + 0.7701666988432407, + 0.9958902932703495, + 0.2982480600476265, + 0.7235964685678482, + 0.1665241103619337, + 0.5754849463701248, + 0.23521879315376282, + 0.4489108510315418, + 0.3877295106649399, + 0.24553771317005157, + 0.38300323486328125, + 0.2832425180822611, + 0.8891175054013729, + 0.4480448067188263, + 0.1799192987382412, + 0.8357008993625641, + 0.48203856125473976, + 1.6732060685753822, + 0.0, + 0.0, + 0.4009806662797928, + 1.6505799070000648, + 1.1292172372341156, + 0.8803894352167845, + 0.238045921549201, + 1.6443272680044174, + 0.6379530839622021, + 0.45507513731718063, + 0.23441375605762005, + 1.6710414253175259 + ], + "unique_experts": 61, + "load_cv": 0.6582690116922608, + "normalized_load_entropy": 0.945921341697589, + "max_load_share": 0.046296296296296294 + }, + "full_input": { + "tokens": 133, + "top_k": 6, + "decisions": 798, + "ordered_route_sha256": "88588db40668dac0381a7af4d2b6ff7daf2a21c652cb1393e88309a7deb0539b", + "route_weight_sha256": "d873adec4b1a83b3777f4d142c233fe21a1d27ef109c684dcaf11daba4f2313e", + "loads": [ + 4, + 20, + 3, + 2, + 27, + 0, + 38, + 12, + 5, + 13, + 5, + 26, + 17, + 7, + 4, + 7, + 16, + 11, + 7, + 18, + 13, + 6, + 16, + 18, + 5, + 28, + 9, + 5, + 12, + 11, + 4, + 7, + 5, + 14, + 14, + 23, + 3, + 21, + 4, + 24, + 5, + 12, + 12, + 4, + 8, + 12, + 28, + 13, + 8, + 9, + 16, + 27, + 0, + 0, + 9, + 29, + 21, + 15, + 7, + 28, + 11, + 11, + 7, + 22 + ], + "weighted_loads": [ + 0.16859743744134903, + 0.8267708420753479, + 0.18791576102375984, + 0.07902085408568382, + 2.2321883384138346, + 0.0, + 3.915845353156328, + 0.6933902744203806, + 0.29680003970861435, + 1.2436721175909042, + 0.3178314119577408, + 1.810442315414548, + 1.0473257713019848, + 0.23478607088327408, + 0.22101649641990662, + 0.2204740196466446, + 1.1029370427131653, + 0.5711813289672136, + 0.49481305852532387, + 1.252150934189558, + 0.8194652087986469, + 0.2959195952862501, + 1.1650645211338997, + 1.7631974071264267, + 0.18408024311065674, + 2.1188831385225058, + 0.3209160678088665, + 0.22988120838999748, + 0.6207632459700108, + 0.569802314043045, + 0.17320368438959122, + 0.3812691681087017, + 0.1668338757008314, + 0.7747365608811378, + 0.80473842471838, + 1.5515735186636448, + 0.2982480600476265, + 1.5442306511104107, + 0.1665241103619337, + 0.933532765135169, + 0.23521879315376282, + 0.8468334004282951, + 0.4921191595494747, + 0.24553771317005157, + 0.38300323486328125, + 0.4143184497952461, + 2.5282024797052145, + 0.4670991748571396, + 0.4055333770811558, + 0.8357008993625641, + 1.0112316496670246, + 1.9784655794501305, + 0.0, + 0.0, + 0.4009806662797928, + 2.412254385650158, + 2.2317916452884674, + 0.8803894352167845, + 0.238045921549201, + 2.610278010368347, + 0.6379530839622021, + 0.45507513731718063, + 0.23441375605762005, + 1.6710414253175259 + ], + "unique_experts": 61, + "load_cv": 0.6856686657647137, + "normalized_load_entropy": 0.9419585524701499, + "max_load_share": 0.047619047619047616 + } + }, + "s1_bos": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "4ac41fc1edd1c0241d7ed8816a8b17f258662a5e0abee1474ab327024fe90b84", + "route_weight_sha256": "cbf5b4b83b1ed713d9d3a8859c850543e5ae58010ead75901e882782ff93fa1f", + "loads": [ + 4, + 17, + 4, + 2, + 25, + 0, + 31, + 10, + 5, + 13, + 6, + 20, + 17, + 4, + 1, + 7, + 10, + 10, + 8, + 11, + 10, + 5, + 12, + 17, + 8, + 27, + 8, + 4, + 13, + 7, + 4, + 6, + 3, + 17, + 14, + 17, + 3, + 10, + 5, + 12, + 4, + 7, + 10, + 3, + 10, + 8, + 12, + 12, + 4, + 10, + 7, + 20, + 2, + 0, + 8, + 19, + 11, + 17, + 6, + 19, + 11, + 13, + 7, + 21 + ], + "weighted_loads": [ + 0.17242201417684555, + 0.7366581298410892, + 0.2436271719634533, + 0.07809150218963623, + 2.1386417523026466, + 0.0, + 3.001460015773773, + 0.6222113482654095, + 0.29271814599633217, + 1.2075082920491695, + 0.36703814938664436, + 1.4175356179475784, + 1.0449974834918976, + 0.13585668429732323, + 0.03829457238316536, + 0.2018515858799219, + 0.7373999431729317, + 0.544737596064806, + 0.5554118193686008, + 0.8230684921145439, + 0.6960944980382919, + 0.20942190289497375, + 0.5281827375292778, + 1.7034825570881367, + 0.2962444331496954, + 2.0737197771668434, + 0.29094989970326424, + 0.21970999613404274, + 0.6502571031451225, + 0.35225195810198784, + 0.1675940565764904, + 0.3216946665197611, + 0.10739785805344582, + 0.8802330829203129, + 0.8144741244614124, + 0.9852907694876194, + 0.2888132557272911, + 0.6673115864396095, + 0.20709089376032352, + 0.4736300352960825, + 0.20166388526558876, + 0.46773046627640724, + 0.39466159604489803, + 0.21712975949048996, + 0.44693633913993835, + 0.28308677300810814, + 0.8026582784950733, + 0.4639265649020672, + 0.18238958343863487, + 0.8627028372138739, + 0.3690255284309387, + 1.6861013025045395, + 0.05666254460811615, + 0.0, + 0.37272636964917183, + 1.6825533788651228, + 1.0243543647229671, + 0.9557122252881527, + 0.20924887247383595, + 1.6793447881937027, + 0.6274257004261017, + 0.5535595454275608, + 0.24215569719672203, + 1.5361901074647903 + ], + "unique_experts": 62, + "load_cv": 0.6519874531610318, + "normalized_load_entropy": 0.9483569865690537, + "max_load_share": 0.047839506172839504 + }, + "full_input": { + "tokens": 149, + "top_k": 6, + "decisions": 894, + "ordered_route_sha256": "fde133d709332f65b492c55fd52811ca00062676e72dca82d6fef24fe320241d", + "route_weight_sha256": "a176d17cbe62425bcd090fbe1676291d238e12b8585e6e1089684a42c0f12b97", + "loads": [ + 4, + 18, + 7, + 3, + 27, + 0, + 46, + 11, + 10, + 19, + 6, + 30, + 21, + 5, + 10, + 9, + 21, + 10, + 10, + 21, + 12, + 9, + 13, + 18, + 9, + 28, + 8, + 5, + 14, + 10, + 4, + 9, + 9, + 18, + 18, + 25, + 4, + 28, + 5, + 21, + 4, + 12, + 12, + 3, + 11, + 10, + 30, + 15, + 7, + 10, + 16, + 26, + 3, + 3, + 8, + 30, + 28, + 17, + 6, + 30, + 17, + 13, + 7, + 21 + ], + "weighted_loads": [ + 0.17242201417684555, + 0.7714314386248589, + 0.3848196119070053, + 0.11544839665293694, + 2.2896258048713207, + 0.0, + 4.305339781567454, + 0.6839542835950851, + 0.6349061019718647, + 1.9153766818344593, + 0.36703814938664436, + 2.0514696687459946, + 1.3747373148798943, + 0.15892061032354832, + 0.7170661054551601, + 0.364439370110631, + 1.526525817811489, + 0.544737596064806, + 0.7040264122188091, + 1.522530809044838, + 0.7883185856044292, + 0.4391478840261698, + 1.0759940072894096, + 1.7388073168694973, + 0.32876857928931713, + 2.1092498898506165, + 0.29094989970326424, + 0.24637435749173164, + 0.6875178143382072, + 0.5587350577116013, + 0.1675940565764904, + 0.519030774012208, + 0.29441489838063717, + 0.9135912694036961, + 1.0750809535384178, + 1.76831379160285, + 0.32303810119628906, + 2.0913404934108257, + 0.20709089376032352, + 0.9477068949490786, + 0.20166388526558876, + 0.8772862516343594, + 0.4525706525892019, + 0.21712975949048996, + 0.5311769172549248, + 0.34648930095136166, + 2.784890802577138, + 0.5711648259311914, + 0.37599219754338264, + 0.8627028372138739, + 1.017691008746624, + 1.9266475290060043, + 0.09342135116457939, + 0.1676357425749302, + 0.37272636964917183, + 2.6956732142716646, + 2.824291344732046, + 0.9557122252881527, + 0.20924887247383595, + 2.7343934196978807, + 0.9325468502938747, + 0.5535595454275608, + 0.24215569719672203, + 1.5361901074647903 + ], + "unique_experts": 63, + "load_cv": 0.6555038897739517, + "normalized_load_entropy": 0.9496783252319099, + "max_load_share": 0.05145413870246085 + } + }, + "s0_x": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "9cd9052a6c64c2bf0fa22b6a9a740d0438dc58f26726dea35788b1cec86de30e", + "route_weight_sha256": "41554c4d4de09960a9bdc3abafa2f38095ab5cbfd7ac3eaa4730d329820d20a9", + "loads": [ + 4, + 17, + 3, + 1, + 27, + 0, + 31, + 12, + 5, + 13, + 5, + 20, + 17, + 6, + 2, + 6, + 10, + 10, + 6, + 10, + 11, + 3, + 16, + 16, + 5, + 27, + 8, + 5, + 12, + 7, + 4, + 9, + 2, + 14, + 13, + 17, + 3, + 12, + 3, + 15, + 5, + 7, + 8, + 3, + 9, + 7, + 16, + 10, + 3, + 9, + 10, + 20, + 0, + 0, + 8, + 19, + 11, + 15, + 7, + 19, + 11, + 14, + 7, + 23 + ], + "weighted_loads": [ + 0.1662818342447281, + 0.7176769953221083, + 0.18830640986561775, + 0.04031400755047798, + 2.1508536506444216, + 0.0, + 3.0295545253902674, + 0.6924456544220448, + 0.2887458801269531, + 1.2453157044947147, + 0.3226071931421757, + 1.4321920610964298, + 1.0315809212625027, + 0.20901338942348957, + 0.07144591584801674, + 0.1732449233531952, + 0.7571690306067467, + 0.5101258624345064, + 0.4568784311413765, + 0.7610979191958904, + 0.7455225847661495, + 0.13771559670567513, + 0.6577647067606449, + 1.6543404273688793, + 0.18686815723776817, + 2.0623874813318253, + 0.28408825024962425, + 0.227113027125597, + 0.6158225350081921, + 0.3434016965329647, + 0.17762714251875877, + 0.4466495309025049, + 0.07000315934419632, + 0.7709606867283583, + 0.7719530519098043, + 1.0144965443760157, + 0.30811863020062447, + 0.7923990488052368, + 0.1582740806043148, + 0.5919401161372662, + 0.23461634293198586, + 0.4425585325807333, + 0.3429664298892021, + 0.21543557941913605, + 0.4260844700038433, + 0.2455651368945837, + 0.9873070884495974, + 0.35757635347545147, + 0.1417238563299179, + 0.8366231415420771, + 0.5435102246701717, + 1.6560234501957893, + 0.0, + 0.0, + 0.3616280369460583, + 1.638064544647932, + 0.9963415749371052, + 0.8825066164135933, + 0.23904074728488922, + 1.6330605149269104, + 0.627903962507844, + 0.5752902664244175, + 0.24205149337649345, + 1.6577039957046509 + ], + "unique_experts": 61, + "load_cv": 0.6792367754804405, + "normalized_load_entropy": 0.9425888003289572, + "max_load_share": 0.047839506172839504 + }, + "full_input": { + "tokens": 133, + "top_k": 6, + "decisions": 798, + "ordered_route_sha256": "194980c1c708a6ceadb0a7f21666db6b55a8b241c0016c43b3f6bee5e66bc926", + "route_weight_sha256": "1a4ceb4161e577e9f82cda372525e3c566a9cfbf99b30fc4bbd7b737a587d2da", + "loads": [ + 4, + 19, + 3, + 1, + 28, + 0, + 41, + 12, + 5, + 13, + 5, + 25, + 17, + 7, + 5, + 7, + 15, + 10, + 6, + 19, + 12, + 6, + 18, + 17, + 5, + 28, + 8, + 5, + 12, + 10, + 4, + 9, + 4, + 14, + 14, + 23, + 3, + 22, + 3, + 23, + 5, + 14, + 11, + 3, + 9, + 11, + 29, + 11, + 7, + 9, + 15, + 28, + 0, + 0, + 8, + 30, + 20, + 15, + 7, + 29, + 11, + 14, + 7, + 23 + ], + "weighted_loads": [ + 0.1662818342447281, + 0.7821319736540318, + 0.18830640986561775, + 0.04031400755047798, + 2.1792451832443476, + 0.0, + 4.291531709954143, + 0.6924456544220448, + 0.2887458801269531, + 1.2453157044947147, + 0.3226071931421757, + 1.7487531770020723, + 1.0315809212625027, + 0.23207731544971466, + 0.24674392864108086, + 0.21770388633012772, + 1.0849296227097511, + 0.5101258624345064, + 0.4568784311413765, + 1.3169105872511864, + 0.78976746276021, + 0.2923974525183439, + 1.2333488520234823, + 1.6900946646928787, + 0.18686815723776817, + 2.089954799041152, + 0.28408825024962425, + 0.227113027125597, + 0.6158225350081921, + 0.5162527896463871, + 0.17762714251875877, + 0.4466495309025049, + 0.1306487563997507, + 0.7709606867283583, + 0.8065247777849436, + 1.5954074058681726, + 0.30811863020062447, + 1.5717554539442062, + 0.1582740806043148, + 0.9071394186466932, + 0.23461634293198586, + 0.978442532941699, + 0.43364106491208076, + 0.21543557941913605, + 0.4260844700038433, + 0.37664106860756874, + 2.326625172048807, + 0.37663072161376476, + 0.37147510051727295, + 0.8366231415420771, + 0.9539412595331669, + 1.9963302239775658, + 0.0, + 0.0, + 0.3616280369460583, + 2.4557601772248745, + 1.9535276107490063, + 0.8825066164135933, + 0.23904074728488922, + 2.674392059445381, + 0.627903962507844, + 0.5752902664244175, + 0.24205149337649345, + 1.6577039957046509 + ], + "unique_experts": 61, + "load_cv": 0.7125512071468194, + "normalized_load_entropy": 0.9381504420271757, + "max_load_share": 0.05137844611528822 + } + }, + "s1_x": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "acd88c24460a60860740dee210185a99c2d85a66f1ef6ce6daadc8f15428b935", + "route_weight_sha256": "19b9b5494ad54573f6231e0fbb16d946821e1854f9148b650ca619582bde8c94", + "loads": [ + 4, + 17, + 4, + 2, + 25, + 0, + 31, + 10, + 5, + 13, + 6, + 19, + 17, + 4, + 1, + 6, + 9, + 8, + 7, + 10, + 11, + 4, + 14, + 17, + 6, + 27, + 7, + 4, + 14, + 6, + 5, + 6, + 3, + 16, + 13, + 17, + 3, + 12, + 4, + 13, + 5, + 8, + 11, + 3, + 9, + 7, + 13, + 13, + 5, + 10, + 10, + 21, + 0, + 0, + 9, + 19, + 10, + 17, + 7, + 19, + 12, + 14, + 6, + 20 + ], + "weighted_loads": [ + 0.16971353068947792, + 0.7343601528555155, + 0.2453974336385727, + 0.07563934847712517, + 2.0372259002178907, + 0.0, + 3.0354247204959393, + 0.606780581176281, + 0.29106210730969906, + 1.1822811849415302, + 0.370358619838953, + 1.3930323645472527, + 1.0381942093372345, + 0.13369746878743172, + 0.04198368266224861, + 0.170539366081357, + 0.6982688792049885, + 0.45175331830978394, + 0.4990435913205147, + 0.7695236504077911, + 0.7394874766469002, + 0.17466871812939644, + 0.5979286842048168, + 1.6816035769879818, + 0.23447541147470474, + 2.0622861236333847, + 0.25318175181746483, + 0.1913932040333748, + 0.6787552833557129, + 0.32052215933799744, + 0.2123185098171234, + 0.3177458345890045, + 0.10784461349248886, + 0.8275485131889582, + 0.7813085056841373, + 0.9758454822003841, + 0.30025892704725266, + 0.7896225862205029, + 0.17117739096283913, + 0.5141593180596828, + 0.22930989041924477, + 0.5084971897304058, + 0.41615671664476395, + 0.21957942843437195, + 0.40301891043782234, + 0.25715500116348267, + 0.8398073501884937, + 0.49720750376582146, + 0.21980907022953033, + 0.8620516043156385, + 0.5125965885818005, + 1.7081302143633366, + 0.0, + 0.0, + 0.40467941015958786, + 1.6792215686291456, + 0.8530978038907051, + 0.9607703126966953, + 0.23424471355974674, + 1.6577923595905304, + 0.6492772959172726, + 0.5902295857667923, + 0.20894360728561878, + 1.4839619062840939 + ], + "unique_experts": 61, + "load_cv": 0.6594256968431428, + "normalized_load_entropy": 0.9458036613507604, + "max_load_share": 0.047839506172839504 + }, + "full_input": { + "tokens": 149, + "top_k": 6, + "decisions": 894, + "ordered_route_sha256": "99bcc49073ad747c1c9fd4f5ac1d256ee518af41e74f4cc58d4ae0891a2f7a61", + "route_weight_sha256": "411c0f4c096027549f7d710bf60d60449d4950d886902f78480a8458436ec833", + "loads": [ + 4, + 18, + 7, + 3, + 27, + 0, + 48, + 11, + 10, + 19, + 6, + 28, + 21, + 5, + 10, + 8, + 19, + 8, + 9, + 22, + 13, + 8, + 15, + 18, + 8, + 28, + 7, + 5, + 15, + 9, + 5, + 9, + 8, + 17, + 17, + 25, + 4, + 28, + 4, + 22, + 5, + 15, + 13, + 3, + 10, + 9, + 29, + 15, + 8, + 10, + 18, + 28, + 1, + 3, + 9, + 31, + 26, + 17, + 7, + 31, + 18, + 14, + 6, + 20 + ], + "weighted_loads": [ + 0.16971353068947792, + 0.7691334616392851, + 0.3865898735821247, + 0.11299624294042587, + 2.188209952786565, + 0.0, + 4.681201869621873, + 0.6685235165059566, + 0.6332500632852316, + 1.89014957472682, + 0.370358619838953, + 1.9760600812733173, + 1.3679340407252312, + 0.1567613948136568, + 0.7160509265959263, + 0.3474701512604952, + 1.4445653706789017, + 0.45175331830978394, + 0.647658184170723, + 1.5715065747499466, + 0.8317115642130375, + 0.4019066598266363, + 1.1457399539649487, + 1.7169283367693424, + 0.30130063369870186, + 2.0978162363171577, + 0.25318175181746483, + 0.2180575653910637, + 0.7160159945487976, + 0.5177656374871731, + 0.2123185098171234, + 0.5150819420814514, + 0.25510757602751255, + 0.8609066996723413, + 1.0419153347611427, + 1.7594161219894886, + 0.3344837725162506, + 2.053376004099846, + 0.17117739096283913, + 0.9882361777126789, + 0.22930989041924477, + 1.050519123673439, + 0.47406577318906784, + 0.21957942843437195, + 0.48725948855280876, + 0.3205575291067362, + 2.4962457697838545, + 0.5472662281244993, + 0.41375792026519775, + 0.8620516043156385, + 1.08836704865098, + 1.9774571545422077, + 0.03675880655646324, + 0.1676357425749302, + 0.40467941015958786, + 2.7634642962366343, + 2.485910374671221, + 0.9607703126966953, + 0.23424471355974674, + 2.7853738982230425, + 0.9543984457850456, + 0.5902295857667923, + 0.20894360728561878, + 1.4839619062840939 + ], + "unique_experts": 63, + "load_cv": 0.6683274360607313, + "normalized_load_entropy": 0.9475146402465652, + "max_load_share": 0.053691275167785234 + } + }, + "s0_period": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "983935294a7746cd93102b8be76d762caad88a1c568c316055380746862cfcf2", + "route_weight_sha256": "f5bd39da807014d0d617aa98cf83d9d757f7d983504d953789f0d43cdefbab82", + "loads": [ + 4, + 16, + 4, + 2, + 27, + 0, + 31, + 12, + 5, + 13, + 5, + 20, + 17, + 5, + 1, + 6, + 10, + 10, + 7, + 10, + 10, + 3, + 13, + 16, + 5, + 27, + 8, + 4, + 12, + 6, + 4, + 10, + 2, + 16, + 13, + 17, + 3, + 13, + 3, + 14, + 5, + 7, + 8, + 3, + 9, + 7, + 16, + 10, + 4, + 9, + 11, + 21, + 0, + 0, + 8, + 19, + 11, + 15, + 7, + 19, + 11, + 13, + 7, + 24 + ], + "weighted_loads": [ + 0.16572828590869904, + 0.6872667316347361, + 0.23638088628649712, + 0.07585446536540985, + 2.131724575534463, + 0.0, + 3.0265723913908005, + 0.6911235675215721, + 0.28598692268133163, + 1.2385379076004028, + 0.3291127569973469, + 1.4419891722500324, + 1.0341833345592022, + 0.17041916213929653, + 0.03923484683036804, + 0.17500421218574047, + 0.7540127523243427, + 0.500199019908905, + 0.4879975877702236, + 0.7655935697257519, + 0.7021342441439629, + 0.13696245104074478, + 0.5578725785017014, + 1.669567670673132, + 0.17683590576052666, + 2.0615312550216913, + 0.28817885369062424, + 0.18615378811955452, + 0.6149158962070942, + 0.30065464973449707, + 0.17611494287848473, + 0.4769237283617258, + 0.06967717409133911, + 0.8423067219555378, + 0.7714279294013977, + 1.0061601158231497, + 0.3069451004266739, + 0.8679836802184582, + 0.15396754071116447, + 0.5737402755767107, + 0.23371481522917747, + 0.4448203332722187, + 0.34122034907341003, + 0.21165330335497856, + 0.42139187827706337, + 0.24337334372103214, + 0.9475452117621899, + 0.35989171266555786, + 0.17813638225197792, + 0.832009170204401, + 0.5849203877151012, + 1.6931104771792889, + 0.0, + 0.0, + 0.36851324141025543, + 1.6655449103564024, + 0.9921475350856781, + 0.8721568919718266, + 0.2367987483739853, + 1.6372466422617435, + 0.6328085903078318, + 0.5378044527024031, + 0.24277065321803093, + 1.703049760311842 + ], + "unique_experts": 61, + "load_cv": 0.6803578139977706, + "normalized_load_entropy": 0.9427503003828408, + "max_load_share": 0.047839506172839504 + }, + "full_input": { + "tokens": 133, + "top_k": 6, + "decisions": 798, + "ordered_route_sha256": "cb290904f4ed359b4520d03d209e7fb5055585c72f845c7fa900f26a99747762", + "route_weight_sha256": "7a7c9ffb6f3d7c7d3bf8fb440be4d8f07c5561170dc004f838e1cf8e16fb6b7b", + "loads": [ + 4, + 18, + 4, + 2, + 28, + 0, + 41, + 12, + 5, + 13, + 5, + 25, + 18, + 6, + 3, + 7, + 15, + 10, + 7, + 20, + 11, + 6, + 15, + 17, + 5, + 28, + 8, + 4, + 13, + 9, + 4, + 10, + 4, + 16, + 14, + 23, + 3, + 23, + 3, + 22, + 5, + 13, + 11, + 3, + 9, + 11, + 29, + 11, + 8, + 9, + 16, + 29, + 0, + 0, + 8, + 30, + 20, + 15, + 7, + 28, + 11, + 13, + 7, + 24 + ], + "weighted_loads": [ + 0.16572828590869904, + 0.7517217099666595, + 0.23638088628649712, + 0.07585446536540985, + 2.160116108134389, + 0.0, + 4.153460364788771, + 0.6911235675215721, + 0.28598692268133163, + 1.2385379076004028, + 0.3291127569973469, + 1.759066527709365, + 1.0872356072068214, + 0.19348308816552162, + 0.1727049984037876, + 0.21275499276816845, + 1.0792266987264156, + 0.500199019908905, + 0.4879975877702236, + 1.4092895910143852, + 0.7463791221380234, + 0.28915313072502613, + 1.1334567237645388, + 1.7053219079971313, + 0.17683590576052666, + 2.089098572731018, + 0.28817885369062424, + 0.18615378811955452, + 0.7205265946686268, + 0.47645100206136703, + 0.17611494287848473, + 0.4769237283617258, + 0.1303227711468935, + 0.8423067219555378, + 0.8059996552765369, + 1.5875269528478384, + 0.3069451004266739, + 1.7283895798027515, + 0.15396754071116447, + 0.8889395780861378, + 0.23371481522917747, + 0.8995070047676563, + 0.43543561175465584, + 0.21165330335497856, + 0.42139187827706337, + 0.3744492754340172, + 2.2676024716347456, + 0.37894608080387115, + 0.40382377430796623, + 0.832009170204401, + 0.997016329318285, + 2.0328264199197292, + 0.0, + 0.0, + 0.36851324141025543, + 2.5733141135424376, + 1.945580068975687, + 0.8721568919718266, + 0.2367987483739853, + 2.6031973846256733, + 0.6328085903078318, + 0.5378044527024031, + 0.24277065321803093, + 1.703049760311842 + ], + "unique_experts": 61, + "load_cv": 0.7142417433592492, + "normalized_load_entropy": 0.9381215368882656, + "max_load_share": 0.05137844611528822 + } + }, + "s1_period": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "1547da5145686b9e83cce98ea826a970ad32e0304cdfe2793f65bbc2e8efa9c6", + "route_weight_sha256": "e9cc85326f84bd0137a70ce4efe49ead3338be6bcabd833b79755ffb51181655", + "loads": [ + 3, + 14, + 4, + 2, + 27, + 0, + 31, + 11, + 4, + 13, + 6, + 21, + 17, + 5, + 1, + 6, + 9, + 9, + 7, + 11, + 10, + 5, + 12, + 16, + 6, + 27, + 7, + 6, + 13, + 6, + 5, + 7, + 3, + 19, + 14, + 17, + 3, + 12, + 4, + 13, + 4, + 7, + 10, + 3, + 9, + 6, + 14, + 11, + 5, + 11, + 8, + 21, + 0, + 0, + 9, + 19, + 10, + 16, + 6, + 19, + 12, + 15, + 7, + 20 + ], + "weighted_loads": [ + 0.1295238956809044, + 0.6457193270325661, + 0.2442762777209282, + 0.07459578290581703, + 2.127676758915186, + 0.0, + 3.0734954588115215, + 0.6353992354124784, + 0.26532165333628654, + 1.200553234666586, + 0.37501511722803116, + 1.4544824417680502, + 1.0282352678477764, + 0.16858558543026447, + 0.04199390858411789, + 0.17077211663126945, + 0.6939005628228188, + 0.4867209196090698, + 0.5041108168661594, + 0.8050881363451481, + 0.6949907094240189, + 0.20630812272429466, + 0.522252019494772, + 1.6401288323104382, + 0.23155634477734566, + 2.0952578596770763, + 0.25210700184106827, + 0.252652196213603, + 0.6455499865114689, + 0.31380368396639824, + 0.21466007828712463, + 0.35228030011057854, + 0.10815451294183731, + 0.9265503138303757, + 0.812154145911336, + 1.002109594643116, + 0.29951121285557747, + 0.8048940896987915, + 0.17399434372782707, + 0.5051900539547205, + 0.1992303878068924, + 0.46328726410865784, + 0.37824377603828907, + 0.2161305584013462, + 0.41046225652098656, + 0.22098329663276672, + 0.8507187813520432, + 0.43507319316267967, + 0.21616140007972717, + 0.8927667271345854, + 0.41812874004244804, + 1.7109188921749592, + 0.0, + 0.0, + 0.4021495096385479, + 1.7071103807538748, + 0.8345700576901436, + 0.9184161499142647, + 0.20570773258805275, + 1.6750976480543613, + 0.639501990750432, + 0.6184765510261059, + 0.24193158745765686, + 1.4693374074995518 + ], + "unique_experts": 61, + "load_cv": 0.6692906749841877, + "normalized_load_entropy": 0.9448804358502734, + "max_load_share": 0.047839506172839504 + }, + "full_input": { + "tokens": 149, + "top_k": 6, + "decisions": 894, + "ordered_route_sha256": "d1463d880b92dd3d873906788f16ca3aa0e0a9296078a2b3844d5801a6ca2dfb", + "route_weight_sha256": "3129e62ad6fa5ef4be7c8a476d0c84b84934b918a468647c4f6c969d04e6e277", + "loads": [ + 3, + 15, + 7, + 3, + 29, + 0, + 48, + 12, + 9, + 19, + 6, + 30, + 22, + 6, + 10, + 8, + 19, + 9, + 9, + 23, + 12, + 9, + 13, + 17, + 8, + 28, + 7, + 7, + 15, + 9, + 5, + 10, + 8, + 20, + 18, + 25, + 4, + 29, + 4, + 22, + 4, + 13, + 12, + 3, + 10, + 8, + 31, + 13, + 7, + 11, + 15, + 28, + 1, + 3, + 9, + 31, + 26, + 16, + 6, + 30, + 18, + 15, + 7, + 20 + ], + "weighted_loads": [ + 0.1295238956809044, + 0.6804926358163357, + 0.3854687176644802, + 0.11195267736911774, + 2.27866081148386, + 0.0, + 4.582404190674424, + 0.6971421707421541, + 0.6075096093118191, + 1.9084216244518757, + 0.37501511722803116, + 2.0359376687556505, + 1.4231986366212368, + 0.19164951145648956, + 0.7171303294599056, + 0.3350622020661831, + 1.4378300867974758, + 0.4867209196090698, + 0.6527254097163677, + 1.7035699374973774, + 0.7872147969901562, + 0.432650962844491, + 1.0700632892549038, + 1.6754535920917988, + 0.3002328425645828, + 2.1307879723608494, + 0.25210700184106827, + 0.2793165575712919, + 0.8040173687040806, + 0.5139989778399467, + 0.21466007828712463, + 0.5496164076030254, + 0.255417475476861, + 0.9599085003137589, + 1.0727609749883413, + 1.7965087443590164, + 0.3337360583245754, + 2.2056898921728134, + 0.17399434372782707, + 0.9792669136077166, + 0.1992303878068924, + 0.9161509945988655, + 0.43615283258259296, + 0.2161305584013462, + 0.494702834635973, + 0.28438582457602024, + 2.5291662644594908, + 0.48513191752135754, + 0.33561114966869354, + 0.8927667271345854, + 0.9283615350723267, + 1.9841221198439598, + 0.03675880655646324, + 0.1676357425749302, + 0.4021495096385479, + 2.854006553068757, + 2.458078496158123, + 0.9184161499142647, + 0.20570773258805275, + 2.7301462795585394, + 0.9446231406182051, + 0.6184765510261059, + 0.24193158745765686, + 1.4693374074995518 + ], + "unique_experts": 63, + "load_cv": 0.6794968276022185, + "normalized_load_entropy": 0.9462540171546702, + "max_load_share": 0.053691275167785234 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 108, + "ordered_topk_exact_tokens": 66, + "set_exact_tokens": 82, + "mean_set_jaccard": 0.9292328042328043, + "mean_token_weighted_tv": 0.014356726151028718, + "aggregate_load_tv": 0.032407407407407406 + }, + "system_bos": { + "tokens": 108, + "ordered_topk_exact_tokens": 62, + "set_exact_tokens": 77, + "mean_set_jaccard": 0.9140211640211641, + "mean_token_weighted_tv": 0.01834999666445785, + "aggregate_load_tv": 0.04166666666666666 + }, + "system_x": { + "tokens": 108, + "ordered_topk_exact_tokens": 53, + "set_exact_tokens": 69, + "mean_set_jaccard": 0.8908730158730159, + "mean_token_weighted_tv": 0.022658964153379202, + "aggregate_load_tv": 0.044753086419753084 + }, + "system_period": { + "tokens": 108, + "ordered_topk_exact_tokens": 54, + "set_exact_tokens": 72, + "mean_set_jaccard": 0.8988095238095238, + "mean_token_weighted_tv": 0.021710469508198677, + "aggregate_load_tv": 0.041666666666666664 + }, + "bos_at_s0": { + "tokens": 108, + "ordered_topk_exact_tokens": 59, + "set_exact_tokens": 75, + "mean_set_jaccard": 0.9126984126984127, + "mean_token_weighted_tv": 0.02097233784109078, + "aggregate_load_tv": 0.033950617283950615 + }, + "bos_at_s1": { + "tokens": 108, + "ordered_topk_exact_tokens": 47, + "set_exact_tokens": 67, + "mean_set_jaccard": 0.8875661375661378, + "mean_token_weighted_tv": 0.023839763469166227, + "aggregate_load_tv": 0.041666666666666664 + }, + "x_at_s0": { + "tokens": 108, + "ordered_topk_exact_tokens": 48, + "set_exact_tokens": 69, + "mean_set_jaccard": 0.8968253968253969, + "mean_token_weighted_tv": 0.02277795202098787, + "aggregate_load_tv": 0.044753086419753084 + }, + "x_at_s1": { + "tokens": 108, + "ordered_topk_exact_tokens": 40, + "set_exact_tokens": 59, + "mean_set_jaccard": 0.8644179894179894, + "mean_token_weighted_tv": 0.02785198778534929, + "aggregate_load_tv": 0.0478395061728395 + }, + "period_at_s0": { + "tokens": 108, + "ordered_topk_exact_tokens": 45, + "set_exact_tokens": 67, + "mean_set_jaccard": 0.8855820105820107, + "mean_token_weighted_tv": 0.024738239003690304, + "aggregate_load_tv": 0.044753086419753084 + }, + "period_at_s1": { + "tokens": 108, + "ordered_topk_exact_tokens": 45, + "set_exact_tokens": 64, + "mean_set_jaccard": 0.8776455026455027, + "mean_token_weighted_tv": 0.026480245033141087, + "aggregate_load_tv": 0.0478395061728395 + } + } + }, + "layer_07": { + "layer": 7, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "b060e1fc7ed4caf3e7328535410b0fca32d12e40e3fc0dcb94ed8359764ffe2f", + "route_weight_sha256": "95f6066c7fd7ddf9cf777385aed1af3948e00974c0b2b90135d7fa0802b3623c", + "loads": [ + 14, + 5, + 0, + 3, + 7, + 12, + 11, + 13, + 28, + 13, + 1, + 9, + 18, + 33, + 5, + 16, + 15, + 4, + 10, + 10, + 9, + 16, + 23, + 2, + 12, + 0, + 9, + 6, + 24, + 3, + 6, + 23, + 11, + 12, + 4, + 2, + 3, + 7, + 15, + 14, + 4, + 19, + 13, + 1, + 7, + 1, + 3, + 3, + 9, + 8, + 18, + 7, + 13, + 6, + 8, + 23, + 2, + 10, + 8, + 14, + 11, + 27, + 1, + 4 + ], + "weighted_loads": [ + 0.9291350282728672, + 0.2662939727306366, + 0.0, + 0.12932629883289337, + 0.45445870235562325, + 0.6110618971288204, + 0.909858763217926, + 0.7613076698035002, + 2.112019808962941, + 0.6900423020124435, + 0.061507198959589005, + 0.4628511406481266, + 1.4067317005246878, + 3.7690626736730337, + 0.232556764036417, + 1.9091693796217442, + 1.3874436654150486, + 0.24410650692880154, + 0.3741309754550457, + 0.4429456442594528, + 1.0951543916016817, + 1.0206649489700794, + 1.1274778191000223, + 0.06751699000597, + 0.7014896608889103, + 0.0, + 0.4857433419674635, + 0.3083940465003252, + 1.9639709144830704, + 0.1778157353401184, + 0.2655240725725889, + 1.3826005216687918, + 0.6413998585194349, + 0.4693558569997549, + 0.14350609481334686, + 0.08328507468104362, + 0.28890810906887054, + 0.22708996757864952, + 0.8130051381886005, + 0.8355438187718391, + 0.19603135623037815, + 1.2790171690285206, + 0.8827604316174984, + 0.03718927130103111, + 0.42320366948843, + 0.030688537284731865, + 0.1074066162109375, + 0.10893863067030907, + 0.4830707423388958, + 0.3621838726103306, + 1.1206556782126427, + 0.5391157306730747, + 0.7894672676920891, + 0.5551198162138462, + 0.4376989118754864, + 1.4618206657469273, + 0.08659771457314491, + 0.44447596184909344, + 0.3237178660929203, + 0.6971220672130585, + 0.7037363033741713, + 2.570173144340515, + 0.05607043206691742, + 0.19137092307209969 + ], + "unique_experts": 62, + "load_cv": 0.7333998390261307, + "normalized_load_entropy": 0.9344430530334248, + "max_load_share": 0.05092592592592592 + }, + "full_input": { + "tokens": 133, + "top_k": 6, + "decisions": 798, + "ordered_route_sha256": "a78114d9cfe51262effa380de6e8a052e572491be04d8336ce6d68e98085c304", + "route_weight_sha256": "ce5b048412c16dbb94faed6b22b0ecee8d3d047d42fd52cfbb780ee0fbcabf6e", + "loads": [ + 14, + 5, + 0, + 6, + 7, + 13, + 16, + 13, + 36, + 13, + 3, + 13, + 18, + 38, + 5, + 16, + 30, + 7, + 12, + 11, + 9, + 16, + 26, + 4, + 16, + 0, + 14, + 6, + 27, + 3, + 6, + 23, + 14, + 13, + 4, + 2, + 3, + 7, + 25, + 17, + 4, + 30, + 18, + 3, + 10, + 1, + 4, + 5, + 9, + 8, + 33, + 7, + 13, + 7, + 8, + 30, + 2, + 10, + 12, + 14, + 11, + 33, + 4, + 11 + ], + "weighted_loads": [ + 0.9291350282728672, + 0.2662939727306366, + 0.0, + 0.2397761344909668, + 0.45445870235562325, + 0.6531462147831917, + 1.3568149209022522, + 0.7613076698035002, + 2.7799626905471087, + 0.6900423020124435, + 0.13950993493199348, + 0.9899783954024315, + 1.4067317005246878, + 4.053489467129111, + 0.232556764036417, + 1.9091693796217442, + 3.414632525295019, + 0.4126948844641447, + 0.4155688975006342, + 0.49991000071167946, + 1.0951543916016817, + 1.0206649489700794, + 1.300166456028819, + 0.2047317773103714, + 0.8312814114615321, + 0.0, + 0.9417903702706099, + 0.3083940465003252, + 2.026980168186128, + 0.1778157353401184, + 0.2655240725725889, + 1.3826005216687918, + 0.7555294837802649, + 0.5194401312619448, + 0.14350609481334686, + 0.08328507468104362, + 0.28890810906887054, + 0.22708996757864952, + 1.7159200236201286, + 0.9628098346292973, + 0.19603135623037815, + 2.1951418928802013, + 1.2165463604032993, + 0.06911064591258764, + 1.9066199101507664, + 0.030688537284731865, + 0.16245249658823013, + 0.25927770510315895, + 0.4830707423388958, + 0.3621838726103306, + 2.2698496542871, + 0.5391157306730747, + 0.7894672676920891, + 0.5869044996798038, + 0.4376989118754864, + 2.1184183321893215, + 0.08659771457314491, + 0.44447596184909344, + 0.40833178255707026, + 0.6971220672130585, + 0.7037363033741713, + 2.865759789943695, + 0.10442247660830617, + 0.460866067558527 + ], + "unique_experts": 62, + "load_cv": 0.7555424569431501, + "normalized_load_entropy": 0.9336491033876457, + "max_load_share": 0.047619047619047616 + } + }, + "s1_eos": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "4eb267c1f368f89532e716f2575c0ac0ff25a7cfb7c97aa242c858f04194db46", + "route_weight_sha256": "a0b375edb84cdd12661d8b0e252ae84c9582f5db200f888213d87560d1724667", + "loads": [ + 13, + 5, + 0, + 2, + 7, + 14, + 11, + 13, + 29, + 12, + 3, + 9, + 19, + 33, + 5, + 16, + 15, + 4, + 10, + 11, + 9, + 18, + 23, + 1, + 12, + 0, + 10, + 6, + 24, + 3, + 6, + 23, + 10, + 11, + 3, + 2, + 3, + 7, + 15, + 14, + 4, + 18, + 13, + 1, + 7, + 0, + 4, + 3, + 11, + 8, + 17, + 7, + 13, + 5, + 7, + 23, + 2, + 10, + 6, + 14, + 9, + 27, + 2, + 6 + ], + "weighted_loads": [ + 0.8910500518977642, + 0.27178435400128365, + 0.0, + 0.09644989669322968, + 0.44519348815083504, + 0.6889812685549259, + 0.9129722528159618, + 0.7601255122572184, + 2.100379405543208, + 0.6387327499687672, + 0.12268366478383541, + 0.449198666960001, + 1.4635646175593138, + 3.724151497706771, + 0.2357279472053051, + 1.8757415376603603, + 1.3791974000632763, + 0.26361178420484066, + 0.3730370458215475, + 0.47688356414437294, + 1.0904660485684872, + 1.0993897654116154, + 1.1065900027751923, + 0.032572101801633835, + 0.70203697681427, + 0.0, + 0.5039430800825357, + 0.3270236849784851, + 1.9556431397795677, + 0.18243073672056198, + 0.26673687249422073, + 1.3851689286530018, + 0.599569283425808, + 0.4257048387080431, + 0.11456732824444771, + 0.08400806784629822, + 0.29029206931591034, + 0.2356905061751604, + 0.8325086981058121, + 0.8335361443459988, + 0.20593614503741264, + 1.1776399351656437, + 0.8738170526921749, + 0.03744324669241905, + 0.4390174113214016, + 0.0, + 0.14409732818603516, + 0.10990671440958977, + 0.5631450302898884, + 0.36429284512996674, + 1.0794385466724634, + 0.5601276233792305, + 0.7871890664100647, + 0.5256217680871487, + 0.4001227244734764, + 1.4327817596495152, + 0.08280584216117859, + 0.44696029275655746, + 0.25829196721315384, + 0.6877325735986233, + 0.6250497400760651, + 2.5334960706532, + 0.08272776007652283, + 0.26621649973094463 + ], + "unique_experts": 61, + "load_cv": 0.7389896999001079, + "normalized_load_entropy": 0.9333480342557089, + "max_load_share": 0.05092592592592592 + }, + "full_input": { + "tokens": 149, + "top_k": 6, + "decisions": 894, + "ordered_route_sha256": "724e2e8aaadd37e84570f00dbdfbb0d98450dc5a2dc3eee86cbb108b6b10a7f6", + "route_weight_sha256": "fa5da5c92fc34ab2d35d0c7e9fc92b828252350a94dd49962416ada02c8b144b", + "loads": [ + 13, + 5, + 0, + 4, + 8, + 15, + 18, + 13, + 45, + 14, + 10, + 14, + 19, + 38, + 7, + 18, + 31, + 8, + 12, + 12, + 9, + 18, + 25, + 4, + 17, + 0, + 19, + 6, + 27, + 9, + 6, + 23, + 16, + 19, + 3, + 2, + 3, + 11, + 32, + 17, + 6, + 34, + 23, + 4, + 17, + 0, + 6, + 9, + 11, + 8, + 39, + 7, + 13, + 5, + 11, + 32, + 2, + 16, + 9, + 14, + 9, + 33, + 6, + 10 + ], + "weighted_loads": [ + 0.8910500518977642, + 0.27178435400128365, + 0.0, + 0.15895128808915615, + 0.49198947474360466, + 0.7331399768590927, + 1.3718324676156044, + 0.7601255122572184, + 3.4953961689025164, + 0.740515973418951, + 0.690528592094779, + 1.0432844646275043, + 1.4635646175593138, + 4.032692046836019, + 0.3051983378827572, + 1.9729439169168472, + 3.812724255025387, + 0.4871190842241049, + 0.4140448458492756, + 0.5313450247049332, + 1.0904660485684872, + 1.0993897654116154, + 1.2252284735441208, + 0.20122076198458672, + 0.8557491642422974, + 0.0, + 1.3094868641346693, + 0.3270236849784851, + 2.0189716443419456, + 0.9635450690984726, + 0.26673687249422073, + 1.3851689286530018, + 0.9845714643597603, + 0.9674727972596884, + 0.11456732824444771, + 0.08400806784629822, + 0.29029206931591034, + 0.4640489500015974, + 2.5888318233191967, + 0.9752923958003521, + 0.4282017685472965, + 2.5561893843114376, + 1.6408945843577385, + 0.1095273895189166, + 2.4884410817176104, + 0.0, + 0.2499181404709816, + 0.4673902839422226, + 0.5631450302898884, + 0.36429284512996674, + 2.6808501668274403, + 0.5601276233792305, + 0.7871890664100647, + 0.5256217680871487, + 0.607853576540947, + 2.205072585493326, + 0.08280584216117859, + 0.9866523668169975, + 0.31540876626968384, + 0.6877325735986233, + 0.6250497400760651, + 2.828154558315873, + 0.16865804325789213, + 0.3813145626336336 + ], + "unique_experts": 61, + "load_cv": 0.7363917915019251, + "normalized_load_entropy": 0.9360854768674891, + "max_load_share": 0.050335570469798654 + } + }, + "s0_bos": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "7bb8d373429421c521d1117f0cd36be6cf193611d5fe1d7b4db4d6d7afabbd7c", + "route_weight_sha256": "94c38f49a22587e2b632591b175aed64ff5f9a1f664a6e122782f5533e3f89fd", + "loads": [ + 14, + 5, + 0, + 3, + 4, + 14, + 11, + 14, + 29, + 12, + 1, + 9, + 19, + 32, + 4, + 17, + 16, + 3, + 10, + 9, + 10, + 17, + 24, + 1, + 12, + 0, + 10, + 7, + 25, + 3, + 6, + 24, + 11, + 11, + 3, + 2, + 3, + 5, + 15, + 16, + 4, + 19, + 12, + 1, + 6, + 2, + 5, + 3, + 8, + 7, + 17, + 8, + 13, + 6, + 8, + 21, + 2, + 8, + 6, + 14, + 10, + 28, + 2, + 7 + ], + "weighted_loads": [ + 0.9380260482430458, + 0.24835940077900887, + 0.0, + 0.124683678150177, + 0.3541092723608017, + 0.6805277038365602, + 0.8648133352398872, + 0.7813345361500978, + 2.209834201261401, + 0.6225455477833748, + 0.06316040456295013, + 0.4599635750055313, + 1.47871476970613, + 3.7026694733649492, + 0.20806272700428963, + 1.9993325546383858, + 1.3642656356096268, + 0.20361707359552383, + 0.39498550817370415, + 0.42294926196336746, + 1.1163808517158031, + 1.0590917598456144, + 1.162025097757578, + 0.03303838521242142, + 0.6966666840016842, + 0.0, + 0.5821232218295336, + 0.3697594627737999, + 2.022034168243408, + 0.1759582981467247, + 0.2681529261171818, + 1.4329219702631235, + 0.670589055866003, + 0.42662086337804794, + 0.11709000542759895, + 0.08054058998823166, + 0.28678010031580925, + 0.17807133495807648, + 0.8223665188997984, + 0.9166768603026867, + 0.21058065444231033, + 1.2904382701963186, + 0.8790614455938339, + 0.03558603301644325, + 0.4000485800206661, + 0.06506318412721157, + 0.16966404393315315, + 0.10487344488501549, + 0.45586784183979034, + 0.31525018997490406, + 1.0721219778060913, + 0.5830708108842373, + 0.7825099416077137, + 0.5234338641166687, + 0.431923508644104, + 1.3939486555755138, + 0.08575387671589851, + 0.379631869494915, + 0.25153162330389023, + 0.6800614260137081, + 0.6619267072528601, + 2.629694513976574, + 0.07785584777593613, + 0.296544574201107 + ], + "unique_experts": 62, + "load_cv": 0.7494345783099353, + "normalized_load_entropy": 0.932359021640051, + "max_load_share": 0.04938271604938271 + }, + "full_input": { + "tokens": 133, + "top_k": 6, + "decisions": 798, + "ordered_route_sha256": "4cdcfef46921331d9f52ab4cc983a25098a6594944b4b930e650bc5cb4b787bf", + "route_weight_sha256": "c199a0b6b43a6ef4de9f17f23a942bad6147a5dcf6805c3cc6ccd46c79a1c417", + "loads": [ + 14, + 5, + 0, + 6, + 4, + 15, + 16, + 14, + 37, + 12, + 3, + 13, + 19, + 37, + 4, + 17, + 31, + 7, + 13, + 10, + 10, + 17, + 27, + 3, + 15, + 0, + 15, + 7, + 27, + 3, + 6, + 24, + 14, + 13, + 3, + 2, + 3, + 5, + 24, + 19, + 4, + 30, + 17, + 2, + 9, + 2, + 8, + 5, + 8, + 7, + 32, + 8, + 13, + 8, + 8, + 28, + 2, + 8, + 9, + 14, + 10, + 34, + 4, + 14 + ], + "weighted_loads": [ + 0.9380260482430458, + 0.24835940077900887, + 0.0, + 0.23513351380825043, + 0.3541092723608017, + 0.7226120214909315, + 1.3718652315437794, + 0.7813345361500978, + 2.88542359136045, + 0.6225455477833748, + 0.1420913226902485, + 1.0307592824101448, + 1.47871476970613, + 3.987096266821027, + 0.20806272700428963, + 1.9993325546383858, + 3.468314241617918, + 0.40251579135656357, + 0.4772701095789671, + 0.48295849934220314, + 1.1163808517158031, + 1.0590917598456144, + 1.3347137346863747, + 0.170180082321167, + 0.8194257114082575, + 0.0, + 1.0571772288531065, + 0.3697594627737999, + 2.0719798300415277, + 0.1759582981467247, + 0.2681529261171818, + 1.4329219702631235, + 0.784718681126833, + 0.5165362544357777, + 0.11709000542759895, + 0.08054058998823166, + 0.28678010031580925, + 0.17807133495807648, + 1.7157062236219645, + 1.0464989989995956, + 0.21058065444231033, + 2.1983741875737906, + 1.2082172855734825, + 0.05314349755644798, + 1.0547307506203651, + 0.06506318412721157, + 0.3060840219259262, + 0.26221202686429024, + 0.45586784183979034, + 0.31525018997490406, + 2.329034563153982, + 0.5830708108842373, + 0.7825099416077137, + 0.6000523641705513, + 0.431923508644104, + 2.050546322017908, + 0.08575387671589851, + 0.379631869494915, + 0.32120732218027115, + 0.6800614260137081, + 0.6619267072528601, + 2.925281159579754, + 0.1206073397770524, + 0.5660397186875343 + ], + "unique_experts": 62, + "load_cv": 0.7640082755089761, + "normalized_load_entropy": 0.9317594537793379, + "max_load_share": 0.046365914786967416 + } + }, + "s1_bos": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "25420e88ed397267531661cbc23c4a797cbe873f7e7ecfdb0184ee74cd1fede6", + "route_weight_sha256": "d0da483f465aba388f7f278b1a91c309c6c24e834656396858fda4517385d30d", + "loads": [ + 13, + 5, + 1, + 3, + 5, + 13, + 12, + 14, + 27, + 12, + 2, + 9, + 18, + 33, + 4, + 19, + 16, + 4, + 9, + 12, + 11, + 18, + 25, + 1, + 13, + 0, + 9, + 4, + 25, + 3, + 6, + 25, + 10, + 10, + 3, + 2, + 3, + 4, + 16, + 16, + 4, + 18, + 13, + 1, + 5, + 1, + 4, + 4, + 7, + 6, + 17, + 7, + 14, + 6, + 7, + 20, + 2, + 9, + 6, + 15, + 10, + 28, + 3, + 6 + ], + "weighted_loads": [ + 0.8923230469226837, + 0.24700459651648998, + 0.0321417860686779, + 0.1251724623143673, + 0.3790651112794876, + 0.6566597521305084, + 0.895268652588129, + 0.7804430145770311, + 2.0858951937407255, + 0.6670893114060163, + 0.08763252012431622, + 0.4624953605234623, + 1.4686768539249897, + 3.6924250666052103, + 0.19769098609685898, + 2.043857991695404, + 1.3787545878440142, + 0.24591126665472984, + 0.3445015698671341, + 0.528945941478014, + 1.1191530711948872, + 1.1115909107029438, + 1.1929212100803852, + 0.032351650297641754, + 0.7425019219517708, + 0.0, + 0.5110269170254469, + 0.24480801448225975, + 2.013387620449066, + 0.1536655519157648, + 0.26461610570549965, + 1.4626540821045637, + 0.640664841979742, + 0.3986670207232237, + 0.11855291202664375, + 0.08174372091889381, + 0.285361111164093, + 0.1374179981648922, + 0.867402533069253, + 0.9190639816224575, + 0.20881315879523754, + 1.1619261801242828, + 0.9235581681132317, + 0.0365501269698143, + 0.3942994065582752, + 0.0301071647554636, + 0.13717943243682384, + 0.14604702033102512, + 0.41942034289240837, + 0.2839505262672901, + 1.0543167777359486, + 0.5434493720531464, + 0.8247278388589621, + 0.5155191943049431, + 0.3926057405769825, + 1.3552045710384846, + 0.08438166230916977, + 0.4068929851055145, + 0.25336596369743347, + 0.698534682393074, + 0.6639774683862925, + 2.6547641456127167, + 0.11494147963821888, + 0.25712317042052746 + ], + "unique_experts": 63, + "load_cv": 0.756116148038645, + "normalized_load_entropy": 0.9323668436587951, + "max_load_share": 0.05092592592592592 + }, + "full_input": { + "tokens": 149, + "top_k": 6, + "decisions": 894, + "ordered_route_sha256": "418e5355e329d2fa0f9912d832eb4463f90b0731b90b9328981049e0428b4cdd", + "route_weight_sha256": "f90c7663cb45d2129d155373878216f35e1bd47d936232ec10f916d49ad95737", + "loads": [ + 13, + 5, + 1, + 5, + 6, + 14, + 21, + 14, + 43, + 14, + 9, + 14, + 18, + 38, + 6, + 21, + 32, + 8, + 12, + 13, + 11, + 18, + 27, + 5, + 17, + 0, + 18, + 4, + 27, + 9, + 6, + 25, + 16, + 18, + 3, + 2, + 3, + 8, + 33, + 19, + 6, + 34, + 23, + 3, + 15, + 1, + 7, + 10, + 7, + 6, + 39, + 7, + 14, + 6, + 11, + 29, + 2, + 15, + 8, + 15, + 10, + 34, + 6, + 10 + ], + "weighted_loads": [ + 0.8923230469226837, + 0.24700459651648998, + 0.0321417860686779, + 0.18767385371029377, + 0.42586109787225723, + 0.7008184604346752, + 1.5172912329435349, + 0.7804430145770311, + 3.4794854801148176, + 0.7688725348562002, + 0.6566779110580683, + 1.0856105647981167, + 1.4686768539249897, + 4.000965615734458, + 0.26716137677431107, + 2.141060370951891, + 3.845450507476926, + 0.46408943459391594, + 0.42267841286957264, + 0.5847516618669033, + 1.1191530711948872, + 1.1115909107029438, + 1.3115596808493137, + 0.2506522238254547, + 0.8890362661331892, + 0.0, + 1.310759088024497, + 0.24480801448225975, + 2.0631224904209375, + 0.9347798842936754, + 0.26461610570549965, + 1.4626540821045637, + 1.0256670229136944, + 0.940434979274869, + 0.11855291202664375, + 0.08174372091889381, + 0.285361111164093, + 0.3657764419913292, + 2.6328047830611467, + 1.0647492185235023, + 0.4310787823051214, + 2.5399215146899223, + 1.6973503269255161, + 0.09481382742524147, + 1.6041014287620783, + 0.0301071647554636, + 0.2906301524490118, + 0.5089004915207624, + 0.41942034289240837, + 0.2839505262672901, + 2.804157329723239, + 0.5434493720531464, + 0.8247278388589621, + 0.5155191943049431, + 0.600336592644453, + 2.1274953968822956, + 0.08438166230916977, + 0.9465850591659546, + 0.29502285085618496, + 0.698534682393074, + 0.6639774683862925, + 2.9494226332753897, + 0.19533538166433573, + 0.37222123332321644 + ], + "unique_experts": 63, + "load_cv": 0.7405124459060951, + "normalized_load_entropy": 0.9362248053386047, + "max_load_share": 0.04809843400447427 + } + }, + "s0_x": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "0e39f4514bbc989e9d0849f7acb68edf356c25d808d852c95eae3205e737b60e", + "route_weight_sha256": "f475022c26484dbca763f6f06407e84743d4eda00a45e77129bda28cb5bc00cc", + "loads": [ + 14, + 6, + 0, + 3, + 5, + 15, + 11, + 14, + 29, + 12, + 2, + 9, + 18, + 33, + 4, + 16, + 17, + 2, + 10, + 10, + 10, + 15, + 22, + 1, + 10, + 0, + 12, + 7, + 26, + 3, + 6, + 24, + 11, + 13, + 3, + 2, + 3, + 5, + 15, + 15, + 4, + 18, + 12, + 1, + 4, + 1, + 5, + 4, + 8, + 7, + 17, + 7, + 14, + 5, + 7, + 23, + 2, + 9, + 5, + 15, + 11, + 28, + 2, + 6 + ], + "weighted_loads": [ + 0.9170170538127422, + 0.2996326517313719, + 0.0, + 0.1193440817296505, + 0.3695029802620411, + 0.7278077974915504, + 0.8670652508735657, + 0.7787448354065418, + 2.209935739636421, + 0.622866865247488, + 0.0887580867856741, + 0.4635760523378849, + 1.464212965220213, + 3.712819553911686, + 0.2084079124033451, + 1.9276419468224049, + 1.4633680619299412, + 0.1662411093711853, + 0.3767637852579355, + 0.45449816063046455, + 1.0894153472036123, + 0.9800550974905491, + 1.0833312012255192, + 0.03217111900448799, + 0.62971331179142, + 0.0, + 0.6962796412408352, + 0.36895813792943954, + 2.083411566913128, + 0.1751178540289402, + 0.2568670827895403, + 1.4317719396203756, + 0.6739611756056547, + 0.5084836613386869, + 0.11427057534456253, + 0.08212745189666748, + 0.2794875130057335, + 0.1786029115319252, + 0.8527694828808308, + 0.8852887749671936, + 0.20384195260703564, + 1.232514128088951, + 0.8788208328187466, + 0.03621876612305641, + 0.3276215139776468, + 0.034599028527736664, + 0.16555839218199253, + 0.13444577902555466, + 0.4466617535799742, + 0.31329137459397316, + 1.0991590041667223, + 0.5454745516180992, + 0.8089391570538282, + 0.48805949464440346, + 0.394278634339571, + 1.4764694683253765, + 0.08677202090620995, + 0.4122823514044285, + 0.2052134908735752, + 0.7126792557537556, + 0.6838919520378113, + 2.6559246629476547, + 0.08135086670517921, + 0.24755013920366764 + ], + "unique_experts": 62, + "load_cv": 0.7565191950544953, + "normalized_load_entropy": 0.9311700923622891, + "max_load_share": 0.05092592592592592 + }, + "full_input": { + "tokens": 133, + "top_k": 6, + "decisions": 798, + "ordered_route_sha256": "b12113b3d5e37e17d73cae5efe9b66dffc044e8761c2d7c93194ca41e21ef24c", + "route_weight_sha256": "e4c8998a05a2c91113f0c2c7be9c02ced94763dde8ac00cef8dbc5d950d6a2ab", + "loads": [ + 14, + 6, + 0, + 6, + 5, + 17, + 14, + 14, + 37, + 12, + 4, + 13, + 19, + 39, + 4, + 16, + 33, + 5, + 12, + 11, + 10, + 15, + 25, + 3, + 13, + 0, + 16, + 7, + 28, + 3, + 6, + 24, + 14, + 15, + 3, + 2, + 3, + 5, + 24, + 18, + 4, + 29, + 17, + 2, + 6, + 1, + 9, + 7, + 8, + 7, + 31, + 7, + 14, + 6, + 7, + 30, + 2, + 9, + 8, + 15, + 11, + 35, + 4, + 14 + ], + "weighted_loads": [ + 0.9170170538127422, + 0.2996326517313719, + 0.0, + 0.22979391738772392, + 0.3695029802620411, + 0.8254973851144314, + 1.152526643127203, + 0.7787448354065418, + 2.8759864792227745, + 0.622866865247488, + 0.16722981445491314, + 1.0381065495312214, + 1.5006885714828968, + 4.03046715259552, + 0.2084079124033451, + 1.9276419468224049, + 3.8430883064866066, + 0.3433617390692234, + 0.418201707303524, + 0.5089880041778088, + 1.0894153472036123, + 0.9800550974905491, + 1.256019838154316, + 0.17239893600344658, + 0.7524723391979933, + 0.0, + 1.1185319013893604, + 0.36895813792943954, + 2.1333572287112474, + 0.1751178540289402, + 0.2568670827895403, + 1.4317719396203756, + 0.7880908008664846, + 0.5989051852375269, + 0.11427057534456253, + 0.08212745189666748, + 0.2794875130057335, + 0.1786029115319252, + 1.6750244535505772, + 1.0126104839146137, + 0.20384195260703564, + 2.0864309705793858, + 1.2060816921293736, + 0.05377623066306114, + 0.9329183455556631, + 0.034599028527736664, + 0.33440455608069897, + 0.33107949793338776, + 0.4466617535799742, + 0.31329137459397316, + 2.146773984655738, + 0.5454745516180992, + 0.8089391570538282, + 0.5198441781103611, + 0.394278634339571, + 2.1330671347677708, + 0.08677202090620995, + 0.4122823514044285, + 0.27488918974995613, + 0.7126792557537556, + 0.6838919520378113, + 3.004160262644291, + 0.12410235870629549, + 0.5960150081664324 + ], + "unique_experts": 62, + "load_cv": 0.7774394076632178, + "normalized_load_entropy": 0.9300197710788461, + "max_load_share": 0.04887218045112782 + } + }, + "s1_x": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "6a3d12661e231ad80f9baabef4c7c4c3e4f2175df742a67c7ead5bad81443e92", + "route_weight_sha256": "8fcee86cda6cb98cd6fd46b7d78e2e7c2e7cab01cdd1a7603041ce509602a818", + "loads": [ + 12, + 6, + 1, + 2, + 5, + 15, + 13, + 14, + 29, + 11, + 2, + 9, + 18, + 33, + 4, + 17, + 17, + 3, + 8, + 13, + 11, + 16, + 23, + 1, + 12, + 0, + 12, + 5, + 24, + 2, + 6, + 24, + 12, + 11, + 5, + 2, + 3, + 5, + 16, + 14, + 3, + 18, + 13, + 1, + 5, + 0, + 4, + 4, + 8, + 7, + 16, + 7, + 14, + 6, + 7, + 20, + 2, + 9, + 7, + 15, + 11, + 28, + 2, + 5 + ], + "weighted_loads": [ + 0.8227739781141281, + 0.2823396921157837, + 0.03221534565091133, + 0.0879720039665699, + 0.34976252913475037, + 0.7257313095033169, + 0.9317915625870228, + 0.7762394808232784, + 2.187864201143384, + 0.6471868194639683, + 0.08930176496505737, + 0.4497239254415035, + 1.4872222542762756, + 3.6319470666348934, + 0.19895390421152115, + 1.9188594110310078, + 1.4320628549903631, + 0.19830449856817722, + 0.29440089873969555, + 0.5802124422043562, + 1.1032468378543854, + 1.0207859687507153, + 1.136228434741497, + 0.03225615620613098, + 0.6956727225333452, + 0.0, + 0.6883296184241772, + 0.2857064828276634, + 1.9820645861327648, + 0.12498237937688828, + 0.25959781371057034, + 1.4354265313595533, + 0.6925728842616081, + 0.4274193923920393, + 0.1718710232526064, + 0.08067826181650162, + 0.2894301265478134, + 0.17617958784103394, + 0.9583322871476412, + 0.84053860232234, + 0.17680169641971588, + 1.1645972784608603, + 0.9216758720576763, + 0.036030568182468414, + 0.3928103242069483, + 0.0, + 0.13560009188950062, + 0.15693571232259274, + 0.44714025780558586, + 0.31380629912018776, + 1.0133653823286295, + 0.541150625795126, + 0.8252237141132355, + 0.5333612971007824, + 0.37829041853547096, + 1.3610503487288952, + 0.08212827518582344, + 0.39305800199508667, + 0.2917092479765415, + 0.7033156044781208, + 0.7095224559307098, + 2.6610797122120857, + 0.08533714339137077, + 0.2061424907296896 + ], + "unique_experts": 62, + "load_cv": 0.7488242066232469, + "normalized_load_entropy": 0.9317845428527485, + "max_load_share": 0.05092592592592592 + }, + "full_input": { + "tokens": 149, + "top_k": 6, + "decisions": 894, + "ordered_route_sha256": "15bd43c9741f813c5c95331754c40813ec4d11abec57d41646ca424b9f10f8a7", + "route_weight_sha256": "1fe6928169547451d0091d27a6ba811ffe6d74a94dbc6aa7629f6f397d2f681e", + "loads": [ + 12, + 6, + 1, + 4, + 6, + 17, + 19, + 14, + 45, + 13, + 9, + 14, + 18, + 39, + 6, + 19, + 34, + 8, + 10, + 14, + 11, + 16, + 25, + 5, + 17, + 0, + 21, + 5, + 26, + 8, + 6, + 24, + 18, + 19, + 5, + 2, + 3, + 9, + 31, + 17, + 5, + 33, + 23, + 3, + 14, + 0, + 8, + 11, + 8, + 7, + 37, + 7, + 14, + 6, + 11, + 29, + 2, + 15, + 9, + 15, + 11, + 35, + 5, + 10 + ], + "weighted_loads": [ + 0.8227739781141281, + 0.2823396921157837, + 0.03221534565091133, + 0.15047339536249638, + 0.39655851572752, + 0.8234827294945717, + 1.2816952355206013, + 0.7762394808232784, + 3.585033280774951, + 0.7489700429141521, + 0.6580337844789028, + 1.0938921682536602, + 1.4872222542762756, + 3.970208454877138, + 0.26842429488897324, + 2.0160617902874947, + 4.165196625515819, + 0.4701352138072252, + 0.33540869876742363, + 0.6305286083370447, + 1.1032468378543854, + 1.0207859687507153, + 1.2548669055104256, + 0.2359839491546154, + 0.8752606846392155, + 0.0, + 1.4719741642475128, + 0.2857064828276634, + 2.031799456104636, + 0.9060967117547989, + 0.25959781371057034, + 1.4354265313595533, + 1.0775750651955605, + 0.9691873509436846, + 0.1718710232526064, + 0.08067826181650162, + 0.2894301265478134, + 0.40453803166747093, + 2.5618525873869658, + 0.9839601591229439, + 0.39906731992959976, + 2.4230999927967787, + 1.6896077170968056, + 0.09429426863789558, + 1.5676173120737076, + 0.0, + 0.32302952371537685, + 0.5770927760750055, + 0.44714025780558586, + 0.31380629912018776, + 2.5234474651515484, + 0.541150625795126, + 0.8252237141132355, + 0.5333612971007824, + 0.5860212706029415, + 2.1333411745727062, + 0.08212827518582344, + 0.9327500760555267, + 0.333366135135293, + 0.7033156044781208, + 0.7095224559307098, + 3.008890910074115, + 0.16573104541748762, + 0.39140171743929386 + ], + "unique_experts": 62, + "load_cv": 0.7363917915019251, + "normalized_load_entropy": 0.9367297949628266, + "max_load_share": 0.050335570469798654 + } + }, + "s0_period": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "6eb5379cc41661eece8b6f68675832331731b5c824249e857384fed4102a3446", + "route_weight_sha256": "643c6f3f1b89051882712a124a00688fb4a226c8cc0e692cdb013a6cdd42ee5d", + "loads": [ + 14, + 5, + 0, + 3, + 5, + 14, + 11, + 14, + 28, + 12, + 2, + 9, + 19, + 35, + 4, + 16, + 17, + 3, + 9, + 10, + 10, + 16, + 23, + 1, + 9, + 0, + 14, + 7, + 24, + 3, + 6, + 23, + 12, + 11, + 3, + 2, + 3, + 5, + 16, + 15, + 3, + 18, + 12, + 1, + 4, + 1, + 4, + 4, + 8, + 7, + 17, + 7, + 14, + 6, + 7, + 22, + 2, + 9, + 6, + 15, + 11, + 28, + 3, + 6 + ], + "weighted_loads": [ + 0.9215369895100594, + 0.2551349811255932, + 0.0, + 0.11904049292206764, + 0.3679533079266548, + 0.7085806727409363, + 0.8364486452192068, + 0.7791444584727287, + 2.205713454633951, + 0.6117292921990156, + 0.09064871445298195, + 0.4680844582617283, + 1.4976270161569118, + 3.746785555034876, + 0.2064921073615551, + 1.9556987918913364, + 1.4507285468280315, + 0.19158761948347092, + 0.3482598438858986, + 0.467694740742445, + 1.1110379956662655, + 1.0287986136972904, + 1.1128309052437544, + 0.03207140043377876, + 0.588167816400528, + 0.0, + 0.7956258039921522, + 0.36451274529099464, + 1.9907325133681297, + 0.17844923213124275, + 0.2550676800310612, + 1.39099295809865, + 0.6894784104079008, + 0.4288156181573868, + 0.11243372038006783, + 0.08258184790611267, + 0.2792380005121231, + 0.17617710679769516, + 0.8904451690614223, + 0.8919615298509598, + 0.1779448688030243, + 1.2512895949184895, + 0.8813988976180553, + 0.03536263480782509, + 0.3322761729359627, + 0.03046976588666439, + 0.1300683133304119, + 0.14791368879377842, + 0.45301342755556107, + 0.32005154341459274, + 1.0785960517823696, + 0.5463017001748085, + 0.8133864980190992, + 0.5043157301843166, + 0.3959091678261757, + 1.4361664596945047, + 0.08598010987043381, + 0.4065634422004223, + 0.24236704409122467, + 0.7181712538003922, + 0.6951792668551207, + 2.6618753001093864, + 0.11556851118803024, + 0.24813865683972836 + ], + "unique_experts": 62, + "load_cv": 0.756116148038645, + "normalized_load_entropy": 0.9316504825295161, + "max_load_share": 0.05401234567901234 + }, + "full_input": { + "tokens": 133, + "top_k": 6, + "decisions": 798, + "ordered_route_sha256": "ff17be1a6eeeaeeb2889d4cf3ee55ad2dc9300ce67738c0a71efd2b78ac23a22", + "route_weight_sha256": "cbea4af45a5a546dc8794e6eb456986c3929df6c12a2a250a2daab7224f89791", + "loads": [ + 14, + 5, + 0, + 6, + 5, + 15, + 14, + 14, + 37, + 12, + 4, + 13, + 20, + 40, + 4, + 16, + 33, + 6, + 11, + 11, + 10, + 16, + 27, + 3, + 12, + 0, + 18, + 7, + 26, + 3, + 6, + 23, + 15, + 13, + 3, + 2, + 3, + 5, + 26, + 18, + 3, + 30, + 17, + 2, + 6, + 1, + 6, + 7, + 8, + 7, + 33, + 7, + 14, + 7, + 7, + 29, + 2, + 9, + 9, + 15, + 11, + 34, + 5, + 13 + ], + "weighted_loads": [ + 0.9215369895100594, + 0.2551349811255932, + 0.0, + 0.22949032858014107, + 0.3679533079266548, + 0.7506649903953075, + 1.1219100374728441, + 0.7791444584727287, + 2.960638526827097, + 0.6117292921990156, + 0.16884365677833557, + 1.0488266311585903, + 1.5339485593140125, + 4.0312123484909534, + 0.2064921073615551, + 1.9556987918913364, + 3.795224368572235, + 0.36165568977594376, + 0.3896977659314871, + 0.5233161523938179, + 1.1110379956662655, + 1.0287986136972904, + 1.3289744351059198, + 0.1703380085527897, + 0.7109268438071012, + 0.0, + 1.2173896338790655, + 0.36451274529099464, + 2.0406781751662493, + 0.17844923213124275, + 0.2550676800310612, + 1.39099295809865, + 0.8036080356687307, + 0.5134310126304626, + 0.11243372038006783, + 0.08258184790611267, + 0.2792380005121231, + 0.17617710679769516, + 1.8187851831316948, + 1.0189975798130035, + 0.1779448688030243, + 2.161908306181431, + 1.206045012921095, + 0.05292009934782982, + 0.937573004513979, + 0.03046976588666439, + 0.22260364145040512, + 0.3382177148014307, + 0.45301342755556107, + 0.32005154341459274, + 2.460761860013008, + 0.5463017001748085, + 0.8133864980190992, + 0.5361004136502743, + 0.3959091678261757, + 2.092764126136899, + 0.08598010987043381, + 0.4065634422004223, + 0.3120427429676056, + 0.7181712538003922, + 0.6951792668551207, + 2.9574619457125664, + 0.15832000318914652, + 0.5176338013261557 + ], + "unique_experts": 62, + "load_cv": 0.7868197425415145, + "normalized_load_entropy": 0.9287633678829676, + "max_load_share": 0.05012531328320802 + } + }, + "s1_period": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "d189f0f6abd34a42eb18b25013a4e2da0e404964738b73bbd7b9d475524d4088", + "route_weight_sha256": "037237de2e13f862d02e069d8d4e3773e4ec9a06bb0c1b543ab0152cb5a8d8ec", + "loads": [ + 13, + 6, + 0, + 3, + 5, + 15, + 13, + 14, + 28, + 11, + 2, + 9, + 18, + 33, + 4, + 18, + 17, + 3, + 9, + 12, + 12, + 17, + 23, + 0, + 11, + 0, + 12, + 4, + 24, + 2, + 5, + 23, + 11, + 10, + 4, + 2, + 3, + 5, + 16, + 14, + 4, + 18, + 13, + 2, + 6, + 0, + 4, + 4, + 8, + 7, + 17, + 7, + 14, + 6, + 7, + 20, + 2, + 9, + 8, + 15, + 10, + 28, + 2, + 6 + ], + "weighted_loads": [ + 0.8606503568589687, + 0.2865407094359398, + 0.0, + 0.12476504221558571, + 0.3499895762652159, + 0.7336761504411697, + 0.9201540891081095, + 0.7782821319997311, + 2.1678557693958282, + 0.6378746964037418, + 0.09112554602324963, + 0.4481240212917328, + 1.4971891269087791, + 3.655664388090372, + 0.19642102345824242, + 1.9825948625802994, + 1.4595443718135357, + 0.19572045467793941, + 0.33109550178050995, + 0.5345486663281918, + 1.1484487652778625, + 1.0667315237224102, + 1.1353752426803112, + 0.0, + 0.6584135144948959, + 0.0, + 0.6787837110459805, + 0.24091730266809464, + 1.9203000701963902, + 0.1251128576695919, + 0.2344643510878086, + 1.3938563987612724, + 0.6615817509591579, + 0.39845037646591663, + 0.1444341130554676, + 0.07904554530978203, + 0.29106271639466286, + 0.17448057048022747, + 0.9539935849606991, + 0.8385069519281387, + 0.20235550776124, + 1.175437357276678, + 0.920070119202137, + 0.0649071279913187, + 0.4303445741534233, + 0.0, + 0.132848983630538, + 0.16317375004291534, + 0.4504666291177273, + 0.3147154878824949, + 1.0605222061276436, + 0.5418229512870312, + 0.8272309582680464, + 0.5398149341344833, + 0.3807811141014099, + 1.3627283833920956, + 0.08368224278092384, + 0.3956357575953007, + 0.32894747518002987, + 0.7041249461472034, + 0.6763551458716393, + 2.6729739420115948, + 0.08469001203775406, + 0.2562235966324806 + ], + "unique_experts": 60, + "load_cv": 0.74576485484143, + "normalized_load_entropy": 0.93096232307862, + "max_load_share": 0.05092592592592592 + }, + "full_input": { + "tokens": 149, + "top_k": 6, + "decisions": 894, + "ordered_route_sha256": "a7dc6a2aa705467ac82df0bf7419b48491ef67618b02f4540904f7cccd722db9", + "route_weight_sha256": "d35fb423e12d4233f087d658225e783a913751d626fc980e811042214ce48efb", + "loads": [ + 13, + 6, + 0, + 5, + 6, + 16, + 20, + 14, + 45, + 13, + 9, + 14, + 18, + 38, + 6, + 20, + 34, + 8, + 11, + 13, + 12, + 17, + 26, + 3, + 15, + 0, + 21, + 4, + 26, + 8, + 5, + 23, + 18, + 18, + 4, + 2, + 3, + 9, + 32, + 17, + 6, + 35, + 23, + 4, + 15, + 0, + 6, + 10, + 8, + 7, + 40, + 7, + 14, + 6, + 11, + 29, + 2, + 15, + 10, + 15, + 10, + 34, + 5, + 10 + ], + "weighted_loads": [ + 0.8606503568589687, + 0.2865407094359398, + 0.0, + 0.18726643361151218, + 0.3967855628579855, + 0.7778348587453365, + 1.3105641473084688, + 0.7782821319997311, + 3.619003191590309, + 0.7396579198539257, + 0.6606311891227961, + 1.0495487451553345, + 1.4971891269087791, + 3.9642049372196198, + 0.2658914141356945, + 2.0797972418367863, + 4.142006438225508, + 0.4576441328972578, + 0.37210330180823803, + 0.5833746939897537, + 1.1484487652778625, + 1.0667315237224102, + 1.2867475748062134, + 0.17053736001253128, + 0.8049478586763144, + 0.0, + 1.4459860362112522, + 0.24091730266809464, + 1.9700349401682615, + 0.9062271900475025, + 0.2344643510878086, + 1.3938563987612724, + 1.0806706435978413, + 0.9402183350175619, + 0.1444341130554676, + 0.07904554530978203, + 0.29106271639466286, + 0.40283901430666447, + 2.636954963207245, + 0.9824787750840187, + 0.4246211312711239, + 2.536512413993478, + 1.6886365972459316, + 0.12317082844674587, + 1.6051515620201826, + 0.0, + 0.23866979591548443, + 0.5182106606662273, + 0.4504666291177273, + 0.3147154878824949, + 3.0072384122759104, + 0.5418229512870312, + 0.8272309582680464, + 0.5398149341344833, + 0.5885119661688805, + 2.1350192092359066, + 0.08368224278092384, + 0.9353278316557407, + 0.37060436233878136, + 0.7041249461472034, + 0.6763551458716393, + 2.9676324296742678, + 0.1650839140638709, + 0.3713216595351696 + ], + "unique_experts": 61, + "load_cv": 0.7507151340008134, + "normalized_load_entropy": 0.9338055049759006, + "max_load_share": 0.050335570469798654 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 108, + "ordered_topk_exact_tokens": 76, + "set_exact_tokens": 86, + "mean_set_jaccard": 0.939814814814815, + "mean_token_weighted_tv": 0.013581618175117506, + "aggregate_load_tv": 0.024691358024691357 + }, + "system_bos": { + "tokens": 108, + "ordered_topk_exact_tokens": 57, + "set_exact_tokens": 78, + "mean_set_jaccard": 0.9186507936507937, + "mean_token_weighted_tv": 0.01827526543530877, + "aggregate_load_tv": 0.035493827160493825 + }, + "system_x": { + "tokens": 108, + "ordered_topk_exact_tokens": 51, + "set_exact_tokens": 71, + "mean_set_jaccard": 0.8961640211640214, + "mean_token_weighted_tv": 0.022627825020915933, + "aggregate_load_tv": 0.033950617283950615 + }, + "system_period": { + "tokens": 108, + "ordered_topk_exact_tokens": 59, + "set_exact_tokens": 76, + "mean_set_jaccard": 0.9133597883597884, + "mean_token_weighted_tv": 0.02059225037831951, + "aggregate_load_tv": 0.032407407407407406 + }, + "bos_at_s0": { + "tokens": 108, + "ordered_topk_exact_tokens": 65, + "set_exact_tokens": 78, + "mean_set_jaccard": 0.9146825396825398, + "mean_token_weighted_tv": 0.020870911474857066, + "aggregate_load_tv": 0.038580246913580245 + }, + "bos_at_s1": { + "tokens": 108, + "ordered_topk_exact_tokens": 54, + "set_exact_tokens": 67, + "mean_set_jaccard": 0.8835978835978837, + "mean_token_weighted_tv": 0.02596339628238369, + "aggregate_load_tv": 0.043209876543209874 + }, + "x_at_s0": { + "tokens": 108, + "ordered_topk_exact_tokens": 60, + "set_exact_tokens": 67, + "mean_set_jaccard": 0.8855820105820106, + "mean_token_weighted_tv": 0.02529046672430855, + "aggregate_load_tv": 0.043209876543209874 + }, + "x_at_s1": { + "tokens": 108, + "ordered_topk_exact_tokens": 51, + "set_exact_tokens": 64, + "mean_set_jaccard": 0.8701499118165785, + "mean_token_weighted_tv": 0.03011286099165402, + "aggregate_load_tv": 0.044753086419753084 + }, + "period_at_s0": { + "tokens": 108, + "ordered_topk_exact_tokens": 62, + "set_exact_tokens": 73, + "mean_set_jaccard": 0.8959435626102292, + "mean_token_weighted_tv": 0.024968718195816985, + "aggregate_load_tv": 0.043209876543209874 + }, + "period_at_s1": { + "tokens": 108, + "ordered_topk_exact_tokens": 48, + "set_exact_tokens": 63, + "mean_set_jaccard": 0.8714726631393298, + "mean_token_weighted_tv": 0.029553120222839492, + "aggregate_load_tv": 0.043209876543209874 + } + } + }, + "layer_08": { + "layer": 8, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "f5f9e168afff6d53fe4b7589624de1a23aa0798a08bf842fcda9cc2c224fd7d0", + "route_weight_sha256": "ae0b6025289950eb6a679a1767669cfc112a3560c0ded9d1e98931ca580981b3", + "loads": [ + 4, + 41, + 7, + 10, + 7, + 3, + 27, + 23, + 28, + 8, + 14, + 21, + 13, + 9, + 3, + 5, + 11, + 13, + 8, + 3, + 11, + 1, + 4, + 3, + 5, + 8, + 11, + 14, + 9, + 4, + 7, + 2, + 20, + 11, + 8, + 3, + 15, + 19, + 2, + 5, + 19, + 12, + 3, + 4, + 22, + 17, + 12, + 10, + 16, + 8, + 16, + 9, + 5, + 9, + 2, + 22, + 4, + 0, + 6, + 8, + 5, + 5, + 2, + 12 + ], + "weighted_loads": [ + 0.28042933344841003, + 3.1529851779341698, + 0.366180457174778, + 0.4659962020814419, + 0.23481548763811588, + 0.12548595666885376, + 1.5091025345027447, + 1.5640951693058014, + 2.2691043820232153, + 0.40508607402443886, + 0.8068364039063454, + 1.4972711689770222, + 0.9950707443058491, + 0.5931230522692204, + 0.1303550750017166, + 0.2007133550941944, + 0.4537556581199169, + 0.6279286071658134, + 0.4386684484779835, + 0.21471141278743744, + 0.6539145670831203, + 0.03800983354449272, + 0.21543248742818832, + 0.1359136700630188, + 0.3245428428053856, + 0.4287305846810341, + 0.60540228523314, + 0.709917850792408, + 0.364552766084671, + 0.1970776990056038, + 0.33734358847141266, + 0.16955596953630447, + 2.0451710242778063, + 0.5535676069557667, + 0.45819828286767006, + 0.10004248842597008, + 0.5020354092121124, + 0.8560098968446255, + 0.0932508334517479, + 0.2113647349178791, + 0.7617880795150995, + 0.5101145394146442, + 0.14349408820271492, + 0.19145042821764946, + 1.1633938290178776, + 0.9496199525892735, + 0.6823388915508986, + 0.4207067135721445, + 0.7779276259243488, + 0.3249490298330784, + 1.484089694917202, + 0.6409534551203251, + 0.46378638967871666, + 0.6692369990050793, + 0.07014592736959457, + 1.3352736309170723, + 0.17283880710601807, + 0.0, + 0.21131947077810764, + 0.4058404080569744, + 0.3540121763944626, + 0.27293819561600685, + 0.08382395282387733, + 0.5212266352027655 + ], + "unique_experts": 63, + "load_cv": 0.7567206380603435, + "normalized_load_entropy": 0.9371994296965234, + "max_load_share": 0.06327160493827161 + }, + "full_input": { + "tokens": 133, + "top_k": 6, + "decisions": 798, + "ordered_route_sha256": "8fe73e6bcbfcc0e8c1a0e7ffb6927b8b3d66b6a4ef0dd984bbcaa361c4aa69fb", + "route_weight_sha256": "2ee1f8d080d8cf88f3e62b9d1529ca0702bc7d4c137a2491797d1c27d58b845c", + "loads": [ + 4, + 47, + 8, + 10, + 9, + 3, + 32, + 24, + 37, + 8, + 15, + 25, + 20, + 15, + 3, + 6, + 11, + 16, + 8, + 3, + 11, + 1, + 6, + 3, + 5, + 20, + 11, + 14, + 9, + 4, + 9, + 2, + 24, + 26, + 8, + 3, + 15, + 19, + 2, + 11, + 26, + 12, + 3, + 4, + 22, + 24, + 19, + 14, + 16, + 11, + 19, + 9, + 16, + 9, + 6, + 30, + 4, + 0, + 10, + 8, + 5, + 5, + 4, + 15 + ], + "weighted_loads": [ + 0.28042933344841003, + 3.521222922950983, + 0.3784426972270012, + 0.4659962020814419, + 0.29822265170514584, + 0.12548595666885376, + 1.8704735040664673, + 1.6099427193403244, + 2.9532345216721296, + 0.40508607402443886, + 0.8445646911859512, + 1.6303763268515468, + 1.377536840736866, + 1.0206074342131615, + 0.1303550750017166, + 0.2431536801159382, + 0.4537556581199169, + 0.7932906374335289, + 0.4386684484779835, + 0.21471141278743744, + 0.6539145670831203, + 0.03800983354449272, + 0.28861597552895546, + 0.1359136700630188, + 0.3245428428053856, + 1.2489525526762009, + 0.60540228523314, + 0.709917850792408, + 0.364552766084671, + 0.1970776990056038, + 0.3599536153487861, + 0.16955596953630447, + 2.2159181255847216, + 1.6632219459861517, + 0.45819828286767006, + 0.10004248842597008, + 0.5020354092121124, + 0.8560098968446255, + 0.0932508334517479, + 0.3747868565842509, + 1.1387926619499922, + 0.5101145394146442, + 0.14349408820271492, + 0.19145042821764946, + 1.1633938290178776, + 1.496792308986187, + 1.3793108817189932, + 0.541676658205688, + 0.7779276259243488, + 0.496655847877264, + 1.654808882623911, + 0.6409534551203251, + 1.1259723864495754, + 0.6692369990050793, + 1.6465983856469393, + 1.846293579787016, + 0.17283880710601807, + 0.0, + 0.3259031963534653, + 0.4058404080569744, + 0.3540121763944626, + 0.27293819561600685, + 0.1731802597641945, + 0.7270307559520006 + ], + "unique_experts": 63, + "load_cv": 0.7558084491250215, + "normalized_load_entropy": 0.9354343800895732, + "max_load_share": 0.05889724310776942 + } + }, + "s1_eos": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "baef8a42b4ab24a37757b7907d16e65d5f9193f9a12daf11f5a1130842f66adf", + "route_weight_sha256": "d92c4862426814598034d16ebb387e6a653649548a26d858b5c5f3b728faf902", + "loads": [ + 4, + 42, + 7, + 12, + 7, + 3, + 29, + 23, + 29, + 10, + 14, + 21, + 14, + 8, + 2, + 7, + 11, + 13, + 8, + 3, + 11, + 1, + 4, + 2, + 5, + 8, + 11, + 13, + 10, + 4, + 7, + 2, + 20, + 11, + 8, + 2, + 16, + 19, + 2, + 5, + 17, + 12, + 3, + 4, + 21, + 16, + 11, + 8, + 16, + 8, + 17, + 9, + 5, + 10, + 2, + 22, + 3, + 0, + 6, + 7, + 5, + 4, + 2, + 12 + ], + "weighted_loads": [ + 0.2836591601371765, + 3.205511473119259, + 0.3548344299197197, + 0.5644763633608818, + 0.23528094217181206, + 0.12303267419338226, + 1.5833109468221664, + 1.5701274760067463, + 2.30466983653605, + 0.49664973467588425, + 0.812126912176609, + 1.4926819689571857, + 1.0305810496211052, + 0.5349071398377419, + 0.09015771746635437, + 0.2902519479393959, + 0.45886586979031563, + 0.6025128569453955, + 0.4379744604229927, + 0.20837123319506645, + 0.667330626398325, + 0.03762328252196312, + 0.21213000640273094, + 0.09122282266616821, + 0.3553594723343849, + 0.428842656314373, + 0.6079029589891434, + 0.6627750359475613, + 0.3998216688632965, + 0.19878830015659332, + 0.34881483763456345, + 0.1676182635128498, + 2.0454760137945414, + 0.5342115052044392, + 0.4420520421117544, + 0.07257668301463127, + 0.5460373740643263, + 0.8697529733181, + 0.09146403521299362, + 0.2232738547027111, + 0.6986191365867853, + 0.5044891946017742, + 0.14369133487343788, + 0.183442372828722, + 1.11319575086236, + 0.8712852131575346, + 0.6161366403102875, + 0.3568620476871729, + 0.7598970122635365, + 0.3292972892522812, + 1.4832465797662735, + 0.629913654178381, + 0.46390166133642197, + 0.691064216196537, + 0.07150177657604218, + 1.3659301437437534, + 0.1306876689195633, + 0.0, + 0.22181813418865204, + 0.3692609518766403, + 0.3591846227645874, + 0.22829671949148178, + 0.086550273001194, + 0.5002957303076982 + ], + "unique_experts": 63, + "load_cv": 0.7754226541946768, + "normalized_load_entropy": 0.9340729583849701, + "max_load_share": 0.06481481481481481 + }, + "full_input": { + "tokens": 149, + "top_k": 6, + "decisions": 894, + "ordered_route_sha256": "eb95493baa531a953d971b1dcc5b14086f6b8b6d19036eda4094bc366a441663", + "route_weight_sha256": "dafa71cdd62d708025bc40bfd3803cfe6d9192f62a8bc03bc43e844d746b6b96", + "loads": [ + 5, + 47, + 17, + 13, + 8, + 4, + 40, + 23, + 43, + 10, + 17, + 26, + 23, + 14, + 2, + 8, + 11, + 27, + 9, + 3, + 11, + 1, + 5, + 6, + 5, + 20, + 11, + 15, + 11, + 4, + 9, + 2, + 24, + 31, + 8, + 2, + 16, + 19, + 8, + 10, + 30, + 12, + 5, + 4, + 21, + 29, + 26, + 12, + 20, + 13, + 21, + 9, + 14, + 16, + 6, + 32, + 3, + 0, + 9, + 9, + 5, + 8, + 5, + 17 + ], + "weighted_loads": [ + 0.32232459262013435, + 3.4857503958046436, + 0.9754416607320309, + 0.6204593740403652, + 0.27406033873558044, + 0.16773401573300362, + 2.4538127072155476, + 1.5701274760067463, + 3.2676437590271235, + 0.49664973467588425, + 0.9392278343439102, + 1.650422740029171, + 1.5652624741196632, + 0.941177885979414, + 0.09015771746635437, + 0.3359032832086086, + 0.45886586979031563, + 1.6050898898392916, + 0.4847661629319191, + 0.20837123319506645, + 0.667330626398325, + 0.03762328252196312, + 0.252544816583395, + 0.28045377507805824, + 0.3553594723343849, + 1.5923010930418968, + 0.6079029589891434, + 0.7831370085477829, + 0.44093120098114014, + 0.19878830015659332, + 0.3716307571157813, + 0.1676182635128498, + 2.1912999656051397, + 1.8889877535402775, + 0.4420520421117544, + 0.07257668301463127, + 0.5460373740643263, + 0.8697529733181, + 0.4838326573371887, + 0.3429773719981313, + 1.2941901255398989, + 0.5044891946017742, + 0.3123927228152752, + 0.183442372828722, + 1.11319575086236, + 1.9781242292374372, + 1.6784916184842587, + 0.4710072595626116, + 1.1092488653957844, + 0.6672678142786026, + 1.7016613446176052, + 0.629913654178381, + 0.9840807896107435, + 1.3684083372354507, + 1.6537650730460882, + 2.0778954960405827, + 0.1306876689195633, + 0.0, + 0.3260452658869326, + 0.4426291845738888, + 0.3591846227645874, + 0.41556238383054733, + 0.2265511006116867, + 0.798020089045167 + ], + "unique_experts": 63, + "load_cv": 0.7479366522775898, + "normalized_load_entropy": 0.9361581021104242, + "max_load_share": 0.052572706935123045 + } + }, + "s0_bos": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "9816e19b0a2d2b6a1d15567d1aac32408716a6878cb4da75ee56290089be5131", + "route_weight_sha256": "61101a103518ed93f4a78ba826e44044765db03ea9575aafbf4be4d2bb3c62db", + "loads": [ + 4, + 41, + 7, + 11, + 7, + 3, + 27, + 22, + 30, + 10, + 14, + 21, + 13, + 9, + 3, + 5, + 12, + 14, + 8, + 3, + 12, + 1, + 3, + 4, + 5, + 9, + 11, + 12, + 11, + 4, + 6, + 2, + 21, + 11, + 8, + 3, + 17, + 21, + 3, + 5, + 15, + 13, + 2, + 4, + 19, + 16, + 10, + 9, + 16, + 9, + 17, + 7, + 4, + 10, + 2, + 20, + 4, + 0, + 7, + 8, + 5, + 5, + 2, + 11 + ], + "weighted_loads": [ + 0.2862965017557144, + 3.2721793055534363, + 0.36504874378442764, + 0.5145861022174358, + 0.2408541850745678, + 0.13189348578453064, + 1.5435563065111637, + 1.5473519265651703, + 2.2902636136859655, + 0.5057748258113861, + 0.8137729652225971, + 1.4533489719033241, + 0.9801390618085861, + 0.5579645168036222, + 0.13295448571443558, + 0.20342610776424408, + 0.5046499520540237, + 0.6957152411341667, + 0.4424886666238308, + 0.2185850813984871, + 0.6846167407929897, + 0.03749072924256325, + 0.16785003617405891, + 0.17773528769612312, + 0.3232295699417591, + 0.5211256444454193, + 0.6123191025108099, + 0.6413650363683701, + 0.42503438889980316, + 0.20036393404006958, + 0.30268530920147896, + 0.17202968150377274, + 2.0991420205682516, + 0.5923560746014118, + 0.4606879875063896, + 0.10744551569223404, + 0.5585606973618269, + 0.9393649138510227, + 0.12751439586281776, + 0.21955325454473495, + 0.6273054722696543, + 0.5290476735681295, + 0.09251154586672783, + 0.18544583022594452, + 1.0321281924843788, + 0.9281997326761484, + 0.5600168835371733, + 0.39217436127364635, + 0.7727324962615967, + 0.3636785075068474, + 1.508693229407072, + 0.5260167047381401, + 0.42754198983311653, + 0.696758858859539, + 0.072453947737813, + 1.2465778775513172, + 0.1723945140838623, + 0.0, + 0.23436785489320755, + 0.41617732867598534, + 0.3710532933473587, + 0.2768848165869713, + 0.08977000787854195, + 0.5097668282687664 + ], + "unique_experts": 63, + "load_cv": 0.7549057158622443, + "normalized_load_entropy": 0.9374515363097702, + "max_load_share": 0.06327160493827161 + }, + "full_input": { + "tokens": 133, + "top_k": 6, + "decisions": 798, + "ordered_route_sha256": "dc4b538339d4566c8863de7b03fd890e4d34c8a65e35ff4848170c4106b6eed6", + "route_weight_sha256": "68df854f036128c683e09a54a90f6c4fd18229b19cf472f116c25fa4eac52b73", + "loads": [ + 4, + 47, + 8, + 11, + 8, + 3, + 32, + 23, + 39, + 10, + 14, + 25, + 20, + 15, + 3, + 7, + 12, + 18, + 8, + 3, + 12, + 1, + 5, + 4, + 6, + 22, + 11, + 12, + 11, + 4, + 8, + 2, + 26, + 27, + 8, + 3, + 17, + 21, + 3, + 11, + 20, + 13, + 2, + 4, + 19, + 23, + 17, + 12, + 16, + 12, + 20, + 7, + 15, + 10, + 6, + 28, + 4, + 0, + 10, + 8, + 5, + 5, + 4, + 14 + ], + "weighted_loads": [ + 0.2862965017557144, + 3.6404170505702496, + 0.37731098383665085, + 0.5145861022174358, + 0.3014442063868046, + 0.13189348578453064, + 1.9015455059707165, + 1.5931994765996933, + 3.0104355942457914, + 0.5057748258113861, + 0.8137729652225971, + 1.5966759426519275, + 1.362605158239603, + 0.9854488987475634, + 0.13295448571443558, + 0.2878834009170532, + 0.5046499520540237, + 0.8936482965946198, + 0.4424886666238308, + 0.2185850813984871, + 0.6846167407929897, + 0.03749072924256325, + 0.24103352427482605, + 0.17773528769612312, + 0.3689461946487427, + 1.4055068045854568, + 0.6123191025108099, + 0.6413650363683701, + 0.42503438889980316, + 0.20036393404006958, + 0.37517276033759117, + 0.17202968150377274, + 2.3281560260802507, + 1.7607730943709612, + 0.4606879875063896, + 0.10744551569223404, + 0.5585606973618269, + 0.9393649138510227, + 0.12751439586281776, + 0.43857886269688606, + 0.9457491654902697, + 0.5290476735681295, + 0.09251154586672783, + 0.18544583022594452, + 1.0321281924843788, + 1.4436988737434149, + 1.2000793535262346, + 0.5037617385387421, + 0.7727324962615967, + 0.5403482466936111, + 1.679412417113781, + 0.5260167047381401, + 1.0897279866039753, + 0.696758858859539, + 0.7780679874122143, + 1.76878796890378, + 0.1723945140838623, + 0.0, + 0.3459197208285332, + 0.41617732867598534, + 0.3710532933473587, + 0.2768848165869713, + 0.17984900623559952, + 0.7155709490180016 + ], + "unique_experts": 63, + "load_cv": 0.7511399870063495, + "normalized_load_entropy": 0.93653296119915, + "max_load_share": 0.05889724310776942 + } + }, + "s1_bos": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "3895c3097f6e4922f18ca11ec7089ee1476cecc3b09931af19e648ae701b7ee9", + "route_weight_sha256": "c0a5a81cc00a36aed1f0956269eaadb12c7845b4127f5ae607f9a82b35022482", + "loads": [ + 4, + 41, + 7, + 9, + 5, + 3, + 28, + 22, + 32, + 10, + 15, + 21, + 14, + 9, + 4, + 5, + 11, + 12, + 8, + 3, + 13, + 1, + 4, + 2, + 6, + 9, + 10, + 11, + 9, + 4, + 6, + 2, + 19, + 12, + 8, + 3, + 14, + 24, + 1, + 7, + 15, + 14, + 3, + 5, + 22, + 14, + 11, + 7, + 16, + 10, + 16, + 8, + 4, + 11, + 2, + 22, + 4, + 0, + 5, + 8, + 5, + 6, + 2, + 10 + ], + "weighted_loads": [ + 0.28605322539806366, + 3.291165269911289, + 0.3691771887242794, + 0.4534156061708927, + 0.1754590943455696, + 0.12875157967209816, + 1.5725334491580725, + 1.5539971888065338, + 2.4899843838065863, + 0.5048559829592705, + 0.8410991877317429, + 1.4635432362556458, + 1.0010876394808292, + 0.5892942398786545, + 0.16795173287391663, + 0.2094486467540264, + 0.45513270795345306, + 0.586710337549448, + 0.42204294353723526, + 0.21821730956435204, + 0.750969797372818, + 0.03807695209980011, + 0.21554240584373474, + 0.09060670807957649, + 0.376917727291584, + 0.5338871292769909, + 0.5850725993514061, + 0.6172083020210266, + 0.3666940964758396, + 0.19850951805710793, + 0.3064321018755436, + 0.16862742602825165, + 2.0336419884115458, + 0.570663483813405, + 0.4612141605466604, + 0.10739805921912193, + 0.47804562002420425, + 1.0199262406677008, + 0.05053248628973961, + 0.28590524569153786, + 0.6255412250757217, + 0.5679711457341909, + 0.1410515084862709, + 0.22979488037526608, + 1.1614561453461647, + 0.8160819076001644, + 0.539259135723114, + 0.32293721847236156, + 0.7662272751331329, + 0.39092722348868847, + 1.4769291616976261, + 0.5385438874363899, + 0.41299059242010117, + 0.7547564767301083, + 0.07413813658058643, + 1.325146447867155, + 0.16552747786045074, + 0.0, + 0.1865275539457798, + 0.42388147860765457, + 0.36641110479831696, + 0.299709215760231, + 0.08770647644996643, + 0.4698272943496704 + ], + "unique_experts": 63, + "load_cv": 0.7764048238780309, + "normalized_load_entropy": 0.9347536010030918, + "max_load_share": 0.06327160493827161 + }, + "full_input": { + "tokens": 149, + "top_k": 6, + "decisions": 894, + "ordered_route_sha256": "a71f03177206143fa3d05ec277c5efb2957e5c68b6d2ae60e67de3d7ee328d75", + "route_weight_sha256": "c7e93b575b1e828b1cfff932dc87f680f4b21ae839f4c8405b3eedc7e59ef4cf", + "loads": [ + 5, + 46, + 17, + 11, + 7, + 4, + 39, + 22, + 46, + 10, + 18, + 25, + 23, + 15, + 4, + 7, + 11, + 27, + 9, + 3, + 13, + 1, + 5, + 6, + 6, + 21, + 10, + 13, + 10, + 4, + 8, + 2, + 23, + 33, + 8, + 3, + 14, + 24, + 7, + 11, + 26, + 14, + 5, + 5, + 22, + 28, + 26, + 10, + 20, + 16, + 20, + 8, + 13, + 17, + 5, + 32, + 4, + 0, + 7, + 9, + 5, + 10, + 5, + 16 + ], + "weighted_loads": [ + 0.3247186578810215, + 3.571404192596674, + 0.9897844195365906, + 0.5501723811030388, + 0.26100945100188255, + 0.1734529212117195, + 2.4396227058023214, + 1.5539971888065338, + 3.48630209825933, + 0.5048559829592705, + 0.9715552404522896, + 1.62436583917588, + 1.5357690639793873, + 0.9955649860203266, + 0.16795173287391663, + 0.29045499861240387, + 0.45513270795345306, + 1.6245254129171371, + 0.46883464604616165, + 0.21821730956435204, + 0.750969797372818, + 0.03807695209980011, + 0.2559572160243988, + 0.2798376604914665, + 0.376917727291584, + 1.7021999023854733, + 0.5850725993514061, + 0.7375702746212482, + 0.40780362859368324, + 0.19850951805710793, + 0.3726619482040405, + 0.16862742602825165, + 2.179465940222144, + 2.029463706538081, + 0.4612141605466604, + 0.10739805921912193, + 0.47804562002420425, + 1.0199262406677008, + 0.4429011084139347, + 0.4110154453665018, + 1.1798710636794567, + 0.5679711457341909, + 0.3097528964281082, + 0.22979488037526608, + 1.1614561453461647, + 1.9526446498930454, + 1.569844800978899, + 0.428031250834465, + 1.1155791282653809, + 0.7737236712127924, + 1.6953439265489578, + 0.5385438874363899, + 0.9331697206944227, + 1.432100597769022, + 0.7428466752171516, + 2.0447031632065773, + 0.16552747786045074, + 0.0, + 0.2878374494612217, + 0.4570768028497696, + 0.36641110479831696, + 0.48697488009929657, + 0.23424404487013817, + 0.8198935836553574 + ], + "unique_experts": 63, + "load_cv": 0.7484717767227604, + "normalized_load_entropy": 0.9369669952326445, + "max_load_share": 0.05145413870246085 + } + }, + "s0_x": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "d75e2e6680dc733a8a88b57801ed99ab1fe01671eb566dfe34f5f18496ff3a76", + "route_weight_sha256": "0413586347b0b3443fe144a027eb754ee346171e3d3e6854c62c67307807b240", + "loads": [ + 4, + 40, + 6, + 10, + 6, + 3, + 28, + 21, + 30, + 11, + 13, + 21, + 14, + 8, + 3, + 5, + 11, + 15, + 9, + 3, + 10, + 1, + 4, + 2, + 5, + 10, + 10, + 14, + 11, + 4, + 6, + 2, + 21, + 10, + 8, + 3, + 13, + 21, + 2, + 6, + 18, + 9, + 2, + 5, + 21, + 17, + 11, + 9, + 16, + 10, + 16, + 7, + 5, + 11, + 2, + 23, + 4, + 0, + 7, + 8, + 5, + 5, + 2, + 11 + ], + "weighted_loads": [ + 0.2857010066509247, + 3.2829317413270473, + 0.31942955031991005, + 0.4621780812740326, + 0.20484374836087227, + 0.13141917437314987, + 1.5917794816195965, + 1.4956723302602768, + 2.475585136562586, + 0.5400162935256958, + 0.7643906064331532, + 1.4629309363663197, + 1.0335801057517529, + 0.5287432223558426, + 0.13505539670586586, + 0.2041589431464672, + 0.4507159125059843, + 0.6942358706146479, + 0.476878859102726, + 0.22352160513401031, + 0.5992097891867161, + 0.03926150128245354, + 0.2142561860382557, + 0.08928342536091805, + 0.3265538178384304, + 0.5463158451020718, + 0.5954934991896152, + 0.7150656022131443, + 0.43348645977675915, + 0.19900203496217728, + 0.2934209890663624, + 0.17382130771875381, + 2.089450506493449, + 0.49954039603471756, + 0.46485697478055954, + 0.1093515120446682, + 0.42547814175486565, + 0.9066037815064192, + 0.09129596129059792, + 0.2610660307109356, + 0.7214222010225058, + 0.39255909621715546, + 0.09113774821162224, + 0.2251918911933899, + 1.1017372943460941, + 1.0064006932079792, + 0.6018674802035093, + 0.389630526304245, + 0.7680166363716125, + 0.4099177364259958, + 1.4824601039290428, + 0.5353938639163971, + 0.4257704168558121, + 0.7278992608189583, + 0.07166961766779423, + 1.4153347574174404, + 0.1714048869907856, + 0.0, + 0.23417945206165314, + 0.4122873581945896, + 0.36161796376109123, + 0.26996922865509987, + 0.0914892666041851, + 0.5048983208835125 + ], + "unique_experts": 63, + "load_cv": 0.7625393366262844, + "normalized_load_entropy": 0.9359788865515771, + "max_load_share": 0.06172839506172839 + }, + "full_input": { + "tokens": 133, + "top_k": 6, + "decisions": 798, + "ordered_route_sha256": "f1e7e3800a093161df9a5531708abae8fa4e9aa667bf55a89e02adab2f906dc6", + "route_weight_sha256": "3f055a5e074baed3e48e75b7cbd32625be8a6666f2d15eabb2cafcff704d5e8d", + "loads": [ + 4, + 47, + 8, + 10, + 7, + 3, + 34, + 22, + 41, + 11, + 13, + 25, + 21, + 15, + 3, + 5, + 11, + 18, + 9, + 3, + 10, + 1, + 6, + 2, + 5, + 24, + 10, + 14, + 11, + 4, + 8, + 2, + 27, + 24, + 8, + 3, + 13, + 21, + 2, + 10, + 23, + 9, + 2, + 5, + 21, + 23, + 19, + 12, + 16, + 14, + 20, + 7, + 16, + 11, + 4, + 31, + 4, + 0, + 10, + 8, + 5, + 5, + 4, + 14 + ], + "weighted_loads": [ + 0.2857010066509247, + 3.7039957605302334, + 0.374158326536417, + 0.4621780812740326, + 0.26543376967310905, + 0.13141917437314987, + 1.9982596933841705, + 1.5415198802947998, + 3.312844406813383, + 0.5400162935256958, + 0.7643906064331532, + 1.600365529768169, + 1.4160462021827698, + 1.041512731462717, + 0.13505539670586586, + 0.2041589431464672, + 0.4507159125059843, + 0.8355620447546244, + 0.476878859102726, + 0.22352160513401031, + 0.5992097891867161, + 0.03926150128245354, + 0.2874396741390228, + 0.08928342536091805, + 0.3265538178384304, + 1.5294813700020313, + 0.5954934991896152, + 0.7150656022131443, + 0.43348645977675915, + 0.19900203496217728, + 0.3515561558306217, + 0.17382130771875381, + 2.36811170168221, + 1.461578806862235, + 0.46485697478055954, + 0.1093515120446682, + 0.42547814175486565, + 0.9066037815064192, + 0.09129596129059792, + 0.38291415199637413, + 1.015286298468709, + 0.39255909621715546, + 0.09113774821162224, + 0.2251918911933899, + 1.1017372943460941, + 1.4719963148236275, + 1.273588513955474, + 0.5012179035693407, + 0.7680166363716125, + 0.6431076843291521, + 1.7071221433579922, + 0.5353938639163971, + 1.0879564136266708, + 0.7278992608189583, + 0.6942854858934879, + 1.9436434991657734, + 0.1714048869907856, + 0.0, + 0.34573131799697876, + 0.4122873581945896, + 0.36161796376109123, + 0.26996922865509987, + 0.1839834824204445, + 0.7107024416327477 + ], + "unique_experts": 63, + "load_cv": 0.7838764065301965, + "normalized_load_entropy": 0.9312804496234932, + "max_load_share": 0.05889724310776942 + } + }, + "s1_x": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "27d5614738a91354e3df1fa9165bd01579f030ae4dab2e7e43d960e9bc107fd7", + "route_weight_sha256": "b123ee672638181d851f466cc722e235b6f0e7ce6c87178ea89d749d190ab4b9", + "loads": [ + 4, + 41, + 6, + 11, + 3, + 2, + 27, + 22, + 32, + 10, + 13, + 20, + 14, + 9, + 4, + 7, + 11, + 10, + 9, + 3, + 13, + 2, + 5, + 2, + 5, + 11, + 12, + 13, + 11, + 4, + 6, + 2, + 19, + 11, + 8, + 3, + 15, + 23, + 1, + 7, + 17, + 12, + 3, + 5, + 21, + 14, + 11, + 7, + 16, + 9, + 16, + 8, + 4, + 10, + 2, + 22, + 4, + 0, + 5, + 8, + 5, + 5, + 2, + 11 + ], + "weighted_loads": [ + 0.271439615637064, + 3.2362693324685097, + 0.3325600326061249, + 0.49981214106082916, + 0.10526483692228794, + 0.09346173331141472, + 1.5355641599744558, + 1.5585051104426384, + 2.604636635631323, + 0.5126302130520344, + 0.7649970762431622, + 1.4112156368792057, + 1.0215360037982464, + 0.5866629593074322, + 0.1685221530497074, + 0.2963525615632534, + 0.44818756356835365, + 0.4907578304409981, + 0.46532873064279556, + 0.21897195652127266, + 0.7367193475365639, + 0.07179991155862808, + 0.2528134845197201, + 0.08617744222283363, + 0.34489181265234947, + 0.599067535251379, + 0.6477219592779875, + 0.6922793202102184, + 0.4210054222494364, + 0.2010631486773491, + 0.2985643707215786, + 0.1723037026822567, + 2.045891046524048, + 0.4547613672912121, + 0.4662773944437504, + 0.11220340803265572, + 0.5014792326837778, + 0.9827388487756252, + 0.05093355104327202, + 0.2730890363454819, + 0.7191996090114117, + 0.4986503627151251, + 0.13682927563786507, + 0.23427892848849297, + 1.1340058147907257, + 0.8457858953624964, + 0.5444288365542889, + 0.3251195400953293, + 0.7616632357239723, + 0.38425569608807564, + 1.4918854385614395, + 0.5490996111184359, + 0.3887469582259655, + 0.69928764924407, + 0.06939245015382767, + 1.405280914157629, + 0.16824929229915142, + 0.0, + 0.1813435908406973, + 0.42298365384340286, + 0.3596278354525566, + 0.2670880816876888, + 0.08667145669460297, + 0.5099437013268471 + ], + "unique_experts": 63, + "load_cv": 0.7687106210399061, + "normalized_load_entropy": 0.9354965477250565, + "max_load_share": 0.06327160493827161 + }, + "full_input": { + "tokens": 149, + "top_k": 6, + "decisions": 894, + "ordered_route_sha256": "aed849048d597146b6b94652bbdea26c8280552272733be310e0b6e2929881dc", + "route_weight_sha256": "82c7bc0221c9cd8237771f5010a62463bd5ef9031148e3d133dc8ba446918971", + "loads": [ + 5, + 47, + 17, + 13, + 4, + 3, + 39, + 22, + 47, + 10, + 16, + 25, + 23, + 17, + 4, + 7, + 11, + 24, + 11, + 3, + 13, + 2, + 6, + 6, + 5, + 26, + 12, + 15, + 12, + 4, + 8, + 2, + 24, + 28, + 8, + 3, + 15, + 23, + 7, + 10, + 28, + 12, + 5, + 5, + 21, + 26, + 26, + 10, + 20, + 16, + 21, + 8, + 13, + 16, + 4, + 31, + 4, + 0, + 7, + 9, + 5, + 9, + 5, + 16 + ], + "weighted_loads": [ + 0.3101050481200218, + 3.5610216781497, + 0.9899799227714539, + 0.6000332795083523, + 0.14404423348605633, + 0.13816307485103607, + 2.4508667197078466, + 1.5585051104426384, + 3.6531619168817997, + 0.5126302130520344, + 0.8995936885476112, + 1.604984569363296, + 1.5562174282968044, + 1.1310378834605217, + 0.1685221530497074, + 0.2963525615632534, + 0.44818756356835365, + 1.4879976846277714, + 0.5470438301563263, + 0.21897195652127266, + 0.7367193475365639, + 0.07179991155862808, + 0.29322829470038414, + 0.27540839463472366, + 0.34489181265234947, + 1.9705452285706997, + 0.6477219592779875, + 0.8126412928104401, + 0.46211495436728, + 0.2010631486773491, + 0.35156939923763275, + 0.1723037026822567, + 2.2335973791778088, + 1.5823683552443981, + 0.4662773944437504, + 0.11220340803265572, + 0.5014792326837778, + 0.9827388487756252, + 0.4433021731674671, + 0.3495031464844942, + 1.2249514646828175, + 0.4986503627151251, + 0.3055306635797024, + 0.23427892848849297, + 1.1340058147907257, + 1.8400912079960108, + 1.517543975263834, + 0.43021357245743275, + 1.1110150888562202, + 0.8172677047550678, + 1.7830545790493488, + 0.5490996111184359, + 0.9089260865002871, + 1.3766317702829838, + 0.6918756943196058, + 2.0457329601049423, + 0.16824929229915142, + 0.0, + 0.2826534863561392, + 0.4561789780855179, + 0.3596278354525566, + 0.4543537460267544, + 0.23641879484057426, + 0.8076680600643158 + ], + "unique_experts": 63, + "load_cv": 0.7476153937567216, + "normalized_load_entropy": 0.9369213721734613, + "max_load_share": 0.052572706935123045 + } + }, + "s0_period": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "531e21aa6851b554d610b873f9ed2ab1b5d8f5b9974eafb44336f5132004d5ed", + "route_weight_sha256": "33185112bd8b056e671b362a146c5ebfe68c03b423ff0e1882e309722ebe7237", + "loads": [ + 4, + 41, + 7, + 10, + 6, + 3, + 29, + 21, + 30, + 10, + 14, + 21, + 13, + 8, + 2, + 4, + 11, + 14, + 9, + 3, + 9, + 1, + 3, + 3, + 5, + 10, + 10, + 12, + 11, + 4, + 6, + 2, + 21, + 9, + 8, + 3, + 16, + 21, + 2, + 5, + 17, + 12, + 2, + 5, + 23, + 18, + 12, + 9, + 16, + 10, + 16, + 8, + 3, + 10, + 2, + 23, + 4, + 0, + 6, + 8, + 5, + 5, + 2, + 11 + ], + "weighted_loads": [ + 0.277281928807497, + 3.32318926602602, + 0.36054205149412155, + 0.462379839271307, + 0.20544621907174587, + 0.12925422936677933, + 1.6245491076260805, + 1.4922441504895687, + 2.3961228877305984, + 0.49680711328983307, + 0.8035169467329979, + 1.4756861254572868, + 1.0153719708323479, + 0.5249039754271507, + 0.09246062487363815, + 0.16273337975144386, + 0.4503365810960531, + 0.6443528551608324, + 0.4796928372234106, + 0.22641608119010925, + 0.5433027632534504, + 0.040220923721790314, + 0.17368287593126297, + 0.13864238187670708, + 0.3171515353024006, + 0.5682918913662434, + 0.5941995941102505, + 0.6522603053599596, + 0.42302616499364376, + 0.20013220980763435, + 0.28615767136216164, + 0.1790710836648941, + 2.0941963586956263, + 0.43113094940781593, + 0.4661469031125307, + 0.10790650174021721, + 0.5284021385014057, + 0.9284726027399302, + 0.09166613593697548, + 0.20682776346802711, + 0.7074649091809988, + 0.4892831202596426, + 0.09459679201245308, + 0.22822817042469978, + 1.181976230815053, + 1.0512000285089016, + 0.6434328239411116, + 0.39048862271010876, + 0.7687923945486546, + 0.40410183370113373, + 1.4853618554770947, + 0.5539410710334778, + 0.354551300406456, + 0.6991808451712132, + 0.06992881745100021, + 1.4115186892449856, + 0.17121611163020134, + 0.0, + 0.20485638827085495, + 0.4130192995071411, + 0.35355933010578156, + 0.2719857916235924, + 0.08894698321819305, + 0.4982939511537552 + ], + "unique_experts": 63, + "load_cv": 0.783245527188242, + "normalized_load_entropy": 0.9328107255508052, + "max_load_share": 0.06327160493827161 + }, + "full_input": { + "tokens": 133, + "top_k": 6, + "decisions": 798, + "ordered_route_sha256": "d7c53ad83e32df3b7a56cc40fae1c365d4a7b91a1cd880277f77f54c9fad1879", + "route_weight_sha256": "9b3676fa1d5b671f63507b9c6b35c7fc666f89884a690d528d562c71d0d99138", + "loads": [ + 4, + 47, + 8, + 11, + 7, + 3, + 37, + 22, + 40, + 10, + 15, + 25, + 20, + 15, + 2, + 4, + 11, + 17, + 9, + 3, + 9, + 1, + 5, + 3, + 5, + 24, + 10, + 12, + 11, + 4, + 8, + 2, + 26, + 23, + 8, + 3, + 16, + 21, + 2, + 9, + 21, + 12, + 2, + 5, + 23, + 24, + 20, + 12, + 16, + 15, + 19, + 8, + 14, + 10, + 4, + 31, + 4, + 0, + 9, + 8, + 5, + 5, + 4, + 15 + ], + "weighted_loads": [ + 0.277281928807497, + 3.6914270110428333, + 0.37280429154634476, + 0.5014757588505745, + 0.26603624038398266, + 0.12925422936677933, + 2.1827213671058416, + 1.5380917005240917, + 3.246545009315014, + 0.49680711328983307, + 0.8430270813405514, + 1.6124179167672992, + 1.3978380672633648, + 0.9909290708601475, + 0.09246062487363815, + 0.16273337975144386, + 0.4503365810960531, + 0.774055128917098, + 0.4796928372234106, + 0.22641608119010925, + 0.5433027632534504, + 0.040220923721790314, + 0.2468663640320301, + 0.13864238187670708, + 0.3171515353024006, + 1.5447544306516647, + 0.5941995941102505, + 0.6522603053599596, + 0.42302616499364376, + 0.20013220980763435, + 0.34211091697216034, + 0.1790710836648941, + 2.3379645440727472, + 1.4053473602980375, + 0.4661469031125307, + 0.10790650174021721, + 0.5284021385014057, + 0.9284726027399302, + 0.09166613593697548, + 0.32867588475346565, + 0.9494944531470537, + 0.4892831202596426, + 0.09459679201245308, + 0.22822817042469978, + 1.181976230815053, + 1.5169351361691952, + 1.3217273969203234, + 0.5020759999752045, + 0.7687923945486546, + 0.6688739657402039, + 1.6560810431838036, + 0.5539410710334778, + 1.0167372971773148, + 0.6991808451712132, + 0.6925446856766939, + 1.929378692060709, + 0.17121611163020134, + 0.0, + 0.3164082542061806, + 0.4130192995071411, + 0.35355933010578156, + 0.2719857916235924, + 0.17886198684573174, + 0.8278983123600483 + ], + "unique_experts": 63, + "load_cv": 0.7884785071047306, + "normalized_load_entropy": 0.9304684193113091, + "max_load_share": 0.05889724310776942 + } + }, + "s1_period": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "73ca153e195537ac1c1558cc0cce5d203fe96144b4ace6e1602af490e161219b", + "route_weight_sha256": "7176dbb493f40ea2e1f41aca279d43f505a4dbf8c084da5a0feaca319be5ca25", + "loads": [ + 4, + 42, + 6, + 10, + 4, + 2, + 29, + 23, + 33, + 10, + 14, + 21, + 14, + 9, + 4, + 8, + 11, + 11, + 9, + 3, + 12, + 2, + 3, + 2, + 5, + 10, + 12, + 12, + 9, + 4, + 6, + 2, + 19, + 10, + 8, + 3, + 15, + 22, + 1, + 4, + 15, + 14, + 3, + 6, + 21, + 13, + 10, + 7, + 16, + 10, + 16, + 8, + 5, + 11, + 2, + 23, + 3, + 0, + 6, + 8, + 5, + 5, + 2, + 11 + ], + "weighted_loads": [ + 0.26993800327181816, + 3.2647017352283, + 0.3322279155254364, + 0.46657826751470566, + 0.13256221264600754, + 0.09079395607113838, + 1.6261147018522024, + 1.5883121229708195, + 2.5516233146190643, + 0.5065876692533493, + 0.7989383712410927, + 1.4487501196563244, + 1.0272515397518873, + 0.5720083490014076, + 0.16895924881100655, + 0.33521321415901184, + 0.4415396489202976, + 0.5121023636311293, + 0.46277088299393654, + 0.21623438596725464, + 0.688455231487751, + 0.0706307590007782, + 0.18013197928667068, + 0.08457298204302788, + 0.34805165231227875, + 0.5687884204089642, + 0.646961135789752, + 0.6650736145675182, + 0.3664870038628578, + 0.19670043513178825, + 0.28944753110408783, + 0.17527516186237335, + 2.0555261000990868, + 0.4251333475112915, + 0.4612903669476509, + 0.10281880386173725, + 0.507036741822958, + 0.9818528089672327, + 0.0513160303235054, + 0.15906943008303642, + 0.6552525535225868, + 0.5734431091696024, + 0.13501733168959618, + 0.2803618013858795, + 1.145732143893838, + 0.8060310520231724, + 0.5140796974301338, + 0.3199486695230007, + 0.7698420882225037, + 0.39854424074292183, + 1.4796094484627247, + 0.5721578039228916, + 0.4307743813842535, + 0.7361357100307941, + 0.0692258719354868, + 1.4362729415297508, + 0.12758458778262138, + 0.0, + 0.20811343006789684, + 0.4246630445122719, + 0.35360799357295036, + 0.26794129610061646, + 0.08703717961907387, + 0.5002641417086124 + ], + "unique_experts": 63, + "load_cv": 0.7900270002852423, + "normalized_load_entropy": 0.9330549095743955, + "max_load_share": 0.06481481481481481 + }, + "full_input": { + "tokens": 149, + "top_k": 6, + "decisions": 894, + "ordered_route_sha256": "fd4c421f963dcea5fc59b9cc81f61b48a07430966eb758136a66324bdf41abde", + "route_weight_sha256": "4615ee27c3872c738a4581c6afe08dfa56e935e29411eaeff1d5c79a31e489f8", + "loads": [ + 5, + 47, + 16, + 12, + 5, + 3, + 42, + 23, + 48, + 10, + 17, + 25, + 23, + 15, + 4, + 9, + 11, + 26, + 11, + 3, + 13, + 2, + 4, + 6, + 5, + 25, + 12, + 14, + 10, + 4, + 7, + 2, + 23, + 27, + 8, + 3, + 15, + 22, + 7, + 7, + 26, + 14, + 5, + 6, + 21, + 25, + 26, + 10, + 20, + 18, + 20, + 8, + 14, + 17, + 4, + 33, + 3, + 0, + 8, + 9, + 5, + 9, + 5, + 17 + ], + "weighted_loads": [ + 0.308603435754776, + 3.544940657913685, + 0.9528351463377476, + 0.5713417455554008, + 0.17134160920977592, + 0.13549529761075974, + 2.6447080690413713, + 1.5883121229708195, + 3.6165243797004223, + 0.5065876692533493, + 0.9361188486218452, + 1.6058685285970569, + 1.5619329642504454, + 0.9782790951430798, + 0.16895924881100655, + 0.37185218930244446, + 0.4415396489202976, + 1.5556690972298384, + 0.5466103553771973, + 0.21623438596725464, + 0.7281472645699978, + 0.0706307590007782, + 0.22054678946733475, + 0.2738039344549179, + 0.34805165231227875, + 1.9094153754413128, + 0.646961135789752, + 0.7854355871677399, + 0.40759653598070145, + 0.19670043513178825, + 0.30562858656048775, + 0.17527516186237335, + 2.201350051909685, + 1.5611285157501698, + 0.4612903669476509, + 0.10281880386173725, + 0.507036741822958, + 0.9818528089672327, + 0.4436846524477005, + 0.23622300662100315, + 1.1646459363400936, + 0.5734431091696024, + 0.3037187196314335, + 0.2803618013858795, + 1.145732143893838, + 1.8130277805030346, + 1.6122180297970772, + 0.4250427018851042, + 1.1191939413547516, + 0.8816792145371437, + 1.6980242133140564, + 0.5721578039228916, + 0.9509535096585751, + 1.4134798310697079, + 0.691709116101265, + 2.108301021158695, + 0.12758458778262138, + 0.0, + 0.30942332558333874, + 0.4578583687543869, + 0.35360799357295036, + 0.455206960439682, + 0.23550467938184738, + 0.8783338107168674 + ], + "unique_experts": 63, + "load_cv": 0.7602545478743111, + "normalized_load_entropy": 0.9353780720582199, + "max_load_share": 0.053691275167785234 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 108, + "ordered_topk_exact_tokens": 72, + "set_exact_tokens": 87, + "mean_set_jaccard": 0.9444444444444444, + "mean_token_weighted_tv": 0.012562915803519663, + "aggregate_load_tv": 0.023148148148148143 + }, + "system_bos": { + "tokens": 108, + "ordered_topk_exact_tokens": 61, + "set_exact_tokens": 75, + "mean_set_jaccard": 0.9067460317460319, + "mean_token_weighted_tv": 0.019124148896446935, + "aggregate_load_tv": 0.043209876543209874 + }, + "system_x": { + "tokens": 108, + "ordered_topk_exact_tokens": 47, + "set_exact_tokens": 64, + "mean_set_jaccard": 0.8796296296296298, + "mean_token_weighted_tv": 0.02337180737716456, + "aggregate_load_tv": 0.043209876543209874 + }, + "system_period": { + "tokens": 108, + "ordered_topk_exact_tokens": 51, + "set_exact_tokens": 61, + "mean_set_jaccard": 0.8716931216931217, + "mean_token_weighted_tv": 0.024904060574179446, + "aggregate_load_tv": 0.04475308641975308 + }, + "bos_at_s0": { + "tokens": 108, + "ordered_topk_exact_tokens": 58, + "set_exact_tokens": 70, + "mean_set_jaccard": 0.8915343915343916, + "mean_token_weighted_tv": 0.02239703787145791, + "aggregate_load_tv": 0.035493827160493825 + }, + "bos_at_s1": { + "tokens": 108, + "ordered_topk_exact_tokens": 56, + "set_exact_tokens": 67, + "mean_set_jaccard": 0.8816137566137565, + "mean_token_weighted_tv": 0.02459962743644913, + "aggregate_load_tv": 0.0478395061728395 + }, + "x_at_s0": { + "tokens": 108, + "ordered_topk_exact_tokens": 55, + "set_exact_tokens": 69, + "mean_set_jaccard": 0.8888888888888888, + "mean_token_weighted_tv": 0.023772835214104917, + "aggregate_load_tv": 0.03858024691358025 + }, + "x_at_s1": { + "tokens": 108, + "ordered_topk_exact_tokens": 43, + "set_exact_tokens": 58, + "mean_set_jaccard": 0.8617724867724869, + "mean_token_weighted_tv": 0.028194500866380555, + "aggregate_load_tv": 0.043209876543209874 + }, + "period_at_s0": { + "tokens": 108, + "ordered_topk_exact_tokens": 55, + "set_exact_tokens": 72, + "mean_set_jaccard": 0.8968253968253969, + "mean_token_weighted_tv": 0.023214334828986063, + "aggregate_load_tv": 0.035493827160493825 + }, + "period_at_s1": { + "tokens": 108, + "ordered_topk_exact_tokens": 45, + "set_exact_tokens": 60, + "mean_set_jaccard": 0.869047619047619, + "mean_token_weighted_tv": 0.027398507507448946, + "aggregate_load_tv": 0.043209876543209874 + } + } + }, + "layer_09": { + "layer": 9, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "c505245ff28f7dc1c826629d54ad6a5895bf774fb2b0dc36aac6b6dae9c43a9c", + "route_weight_sha256": "67e815aa6fb5e9cbcbb05f7f5d1f80f18efb98911530035f5cb515058679c22a", + "loads": [ + 12, + 18, + 5, + 4, + 5, + 6, + 5, + 21, + 9, + 2, + 24, + 25, + 5, + 7, + 4, + 8, + 4, + 5, + 1, + 22, + 4, + 5, + 11, + 3, + 0, + 5, + 28, + 8, + 5, + 2, + 4, + 1, + 6, + 13, + 38, + 16, + 13, + 2, + 21, + 0, + 1, + 16, + 4, + 3, + 12, + 17, + 14, + 4, + 12, + 4, + 7, + 15, + 11, + 28, + 4, + 8, + 31, + 2, + 15, + 28, + 5, + 19, + 3, + 8 + ], + "weighted_loads": [ + 0.663528636097908, + 1.0314528681337833, + 0.3400091230869293, + 0.16164518520236015, + 0.21088235825300217, + 0.2596302255988121, + 0.15446242317557335, + 0.8328178860247135, + 0.6055074334144592, + 0.12015285342931747, + 1.5791519936174154, + 1.770658215507865, + 0.16006690077483654, + 0.2607091758400202, + 0.21217764541506767, + 0.35473764315247536, + 0.24538245424628258, + 0.2233755737543106, + 0.054271869361400604, + 1.253278724849224, + 0.26761943846940994, + 0.33868303894996643, + 0.35326958633959293, + 0.12361020967364311, + 0.0, + 0.2166904006153345, + 2.381919089704752, + 0.5127548985183239, + 0.29250868409872055, + 0.11855361610651016, + 0.16246291995048523, + 0.042342353612184525, + 0.20705455727875233, + 0.7609621472656727, + 6.458663508296013, + 0.86647142842412, + 0.7578067258000374, + 0.07900938764214516, + 1.2417443748563528, + 0.0, + 0.054879479110240936, + 0.9556916356086731, + 0.16884693875908852, + 0.18207625299692154, + 0.5493449829518795, + 1.1020851843059063, + 0.9384175650775433, + 0.26541393622756004, + 0.8263719342648983, + 0.19466201588511467, + 0.27712780237197876, + 0.9426340460777283, + 0.5032659694552422, + 1.9135736897587776, + 0.2206479348242283, + 0.3512142840772867, + 1.9126781653612852, + 0.09682275727391243, + 1.0482145845890045, + 1.8430951088666916, + 0.2542681284248829, + 1.4387076571583748, + 0.11909323930740356, + 0.4195479117333889 + ], + "unique_experts": 62, + "load_cv": 0.8579136618810711, + "normalized_load_entropy": 0.9176791790845996, + "max_load_share": 0.05864197530864197 + }, + "full_input": { + "tokens": 133, + "top_k": 6, + "decisions": 798, + "ordered_route_sha256": "07cf9564e40f9540e05978d369883bfff0bd840e138c2533847f256bab0f0c99", + "route_weight_sha256": "13103c32b081dd10183bbba3cbfa811613c2d851bc3af41e4e1b269e7ec2cf81", + "loads": [ + 18, + 21, + 5, + 4, + 7, + 6, + 5, + 21, + 11, + 2, + 35, + 25, + 8, + 11, + 4, + 8, + 5, + 6, + 1, + 32, + 4, + 5, + 15, + 6, + 4, + 6, + 28, + 9, + 5, + 2, + 6, + 7, + 8, + 13, + 47, + 23, + 13, + 2, + 24, + 0, + 1, + 26, + 4, + 3, + 17, + 26, + 25, + 4, + 15, + 4, + 11, + 16, + 11, + 32, + 4, + 13, + 35, + 2, + 17, + 32, + 5, + 19, + 5, + 9 + ], + "weighted_loads": [ + 1.0928681045770645, + 1.2866453938186169, + 0.3400091230869293, + 0.16164518520236015, + 0.45939335227012634, + 0.2596302255988121, + 0.15446242317557335, + 0.8328178860247135, + 0.7013020887970924, + 0.12015285342931747, + 2.747007256373763, + 1.770658215507865, + 0.2135838307440281, + 0.3680158576462418, + 0.21217764541506767, + 0.35473764315247536, + 0.28626499325037, + 0.265835914760828, + 0.054271869361400604, + 2.334530420601368, + 0.26761943846940994, + 0.33868303894996643, + 1.8882542494684458, + 0.3671288266777992, + 0.16515657305717468, + 0.29408095963299274, + 2.381919089704752, + 0.5257757036015391, + 0.29250868409872055, + 0.11855361610651016, + 0.24841471761465073, + 0.22970683220773935, + 0.243285714648664, + 0.7609621472656727, + 6.953345000743866, + 1.3325289003551006, + 0.7578067258000374, + 0.07900938764214516, + 1.366045055910945, + 0.0, + 0.054879479110240936, + 1.9455429911613464, + 0.16884693875908852, + 0.18207625299692154, + 0.8588121426291764, + 1.8775146529078484, + 1.758340448141098, + 0.26541393622756004, + 1.0062170885503292, + 0.19466201588511467, + 0.4866805002093315, + 0.9764810875058174, + 0.5032659694552422, + 2.0681537110358477, + 0.2206479348242283, + 0.5987817831337452, + 2.1163473334163427, + 0.09682275727391243, + 1.1672261282801628, + 2.0173969231545925, + 0.2542681284248829, + 1.4387076571583748, + 0.17503407411277294, + 0.45575783401727676 + ], + "unique_experts": 63, + "load_cv": 0.8432941541929718, + "normalized_load_entropy": 0.9203436236879904, + "max_load_share": 0.05889724310776942 + } + }, + "s1_eos": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "6f157e90212eef42e9fb941a0befd950fce5e4dd4d208db921d97ca123570d0f", + "route_weight_sha256": "5fefea647f827dcc2a937f40b025f802e3d596208dbec8a0adce0f01a46220a7", + "loads": [ + 12, + 19, + 5, + 4, + 5, + 7, + 4, + 20, + 9, + 2, + 25, + 26, + 4, + 6, + 4, + 7, + 4, + 5, + 1, + 20, + 4, + 6, + 12, + 3, + 0, + 6, + 27, + 8, + 5, + 2, + 2, + 1, + 6, + 13, + 39, + 16, + 13, + 2, + 21, + 0, + 1, + 16, + 3, + 3, + 12, + 19, + 15, + 4, + 13, + 4, + 7, + 15, + 10, + 28, + 4, + 7, + 32, + 1, + 16, + 28, + 6, + 18, + 3, + 8 + ], + "weighted_loads": [ + 0.6678565330803394, + 1.0644052848219872, + 0.3321649245917797, + 0.15672948211431503, + 0.20725977048277855, + 0.2924749553203583, + 0.13282032310962677, + 0.7872104365378618, + 0.609879232943058, + 0.12443441152572632, + 1.6423082686960697, + 1.79294771887362, + 0.11776441521942616, + 0.2315518632531166, + 0.20938736572861671, + 0.3090648539364338, + 0.24551448225975037, + 0.2324805147945881, + 0.05312531441450119, + 1.16526672616601, + 0.26921576634049416, + 0.381772980093956, + 0.3889293372631073, + 0.13284587860107422, + 0.0, + 0.24907640926539898, + 2.3781064935028553, + 0.4833668153733015, + 0.2945108078420162, + 0.11991439014673233, + 0.08739690855145454, + 0.04009044170379639, + 0.21140970289707184, + 0.7653855867683887, + 6.483763260766864, + 0.8620403744280338, + 0.7570669315755367, + 0.07968696765601635, + 1.2542723342776299, + 0.0, + 0.0531654953956604, + 0.9302047714591026, + 0.13247961178421974, + 0.19205892086029053, + 0.5589526370167732, + 1.1848876625299454, + 0.970805823802948, + 0.2613435983657837, + 0.8588539808988571, + 0.1869337074458599, + 0.27581112273037434, + 0.9526894725859165, + 0.4532613977789879, + 1.9063131045550108, + 0.22335408255457878, + 0.3019201196730137, + 1.9530480653047562, + 0.06478888541460037, + 1.0768272653222084, + 1.8529482632875443, + 0.2840073090046644, + 1.3507971744984388, + 0.11619000509381294, + 0.41599949449300766 + ], + "unique_experts": 62, + "load_cv": 0.8739310756989921, + "normalized_load_entropy": 0.914262013092604, + "max_load_share": 0.06018518518518518 + }, + "full_input": { + "tokens": 149, + "top_k": 6, + "decisions": 894, + "ordered_route_sha256": "22ea7f9f8e91d7d4d92d6a8777b67d6bab711221107c644103af1eafbb323a3a", + "route_weight_sha256": "bc5d5ac443f36f5865748f5f3d39545044429760620ab3b31d9d6ce301105f88", + "loads": [ + 23, + 24, + 5, + 4, + 7, + 7, + 4, + 20, + 16, + 4, + 36, + 28, + 7, + 9, + 5, + 7, + 5, + 6, + 1, + 30, + 4, + 9, + 16, + 14, + 5, + 14, + 31, + 9, + 11, + 2, + 5, + 6, + 8, + 16, + 46, + 29, + 13, + 5, + 26, + 1, + 7, + 31, + 5, + 3, + 17, + 33, + 35, + 4, + 20, + 9, + 9, + 16, + 10, + 31, + 5, + 11, + 37, + 1, + 21, + 32, + 6, + 19, + 5, + 9 + ], + "weighted_loads": [ + 1.3738149777054787, + 1.3959878236055374, + 0.3321649245917797, + 0.15672948211431503, + 0.47617652639746666, + 0.2924749553203583, + 0.13282032310962677, + 0.7872104365378618, + 1.0260834284126759, + 0.21588478982448578, + 2.7342295981943607, + 1.88891944848001, + 0.17245113058015704, + 0.2858173097483814, + 0.24937935173511505, + 0.3090648539364338, + 0.29132502526044846, + 0.28822702541947365, + 0.05312531441450119, + 2.2987018451094627, + 0.26921576634049416, + 0.5086548253893852, + 1.922123495489359, + 0.9644950442016125, + 0.18876741081476212, + 0.6824082974344492, + 2.6308291479945183, + 0.49638762045651674, + 0.7205950580537319, + 0.11991439014673233, + 0.2718268819153309, + 0.18944888887926936, + 0.25366628007031977, + 0.9873821660876274, + 6.824689541012049, + 1.684692621231079, + 0.7570669315755367, + 0.2221978809684515, + 1.4981021508574486, + 0.06712242215871811, + 0.4560180529952049, + 2.4168589636683464, + 0.2246640995144844, + 0.19205892086029053, + 0.7437254851683974, + 2.3573262318968773, + 2.6256364844739437, + 0.2613435983657837, + 1.2737852334976196, + 0.5167160332202911, + 0.3958593886345625, + 0.9860184788703918, + 0.4532613977789879, + 2.0551369097083807, + 0.2641906477510929, + 0.4939337857067585, + 2.1856242194771767, + 0.06478888541460037, + 1.3523986116051674, + 2.03220696374774, + 0.2840073090046644, + 1.3890875224024057, + 0.27786494232714176, + 0.45200368016958237 + ], + "unique_experts": 64, + "load_cv": 0.7934457928529315, + "normalized_load_entropy": 0.9283500032029236, + "max_load_share": 0.05145413870246085 + } + }, + "s0_bos": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "6f0b120b9a10b1a0991a02faafe3f8e570c0325a9e13e26a3bb5b0ca04d46163", + "route_weight_sha256": "a4eefb83d2eaf13ec5d1207191523a432d8fae19ca3bb9a9f0485ce450aafc06", + "loads": [ + 11, + 18, + 5, + 4, + 5, + 8, + 6, + 17, + 9, + 2, + 24, + 28, + 2, + 7, + 4, + 8, + 4, + 4, + 1, + 23, + 4, + 5, + 8, + 4, + 0, + 6, + 30, + 7, + 5, + 4, + 3, + 2, + 6, + 13, + 40, + 14, + 13, + 2, + 21, + 1, + 1, + 15, + 3, + 3, + 12, + 18, + 13, + 4, + 13, + 2, + 8, + 14, + 11, + 28, + 4, + 7, + 31, + 2, + 16, + 27, + 7, + 20, + 3, + 8 + ], + "weighted_loads": [ + 0.5852003954350948, + 1.0336575880646706, + 0.342135202139616, + 0.16412315890192986, + 0.21454371511936188, + 0.32181595265865326, + 0.1959305927157402, + 0.7253628987818956, + 0.5975847467780113, + 0.12145398184657097, + 1.5857030544430017, + 1.8923149798065424, + 0.06180988997220993, + 0.26554666087031364, + 0.2074887380003929, + 0.3627474494278431, + 0.24668468907475471, + 0.18338242173194885, + 0.05292505398392677, + 1.324199803173542, + 0.2750524543225765, + 0.3431962877511978, + 0.2647876087576151, + 0.1680664923042059, + 0.0, + 0.24892997555434704, + 2.470447938889265, + 0.454314760863781, + 0.2825283445417881, + 0.20230215042829514, + 0.12788808345794678, + 0.07133593037724495, + 0.2067387904971838, + 0.750016987323761, + 6.704575877636671, + 0.786810390651226, + 0.7600111328065395, + 0.08346467837691307, + 1.235327497124672, + 0.02656453289091587, + 0.055895354598760605, + 0.9334200844168663, + 0.12655660137534142, + 0.17450812086462975, + 0.5614970028400421, + 1.1272758916020393, + 0.898065721616149, + 0.26793574541807175, + 0.8542151972651482, + 0.11863032355904579, + 0.31980045326054096, + 0.9164398908615112, + 0.511988865211606, + 1.9164741765707731, + 0.22611800953745842, + 0.2703797537833452, + 1.920034009963274, + 0.09370128810405731, + 1.0821960270404816, + 1.863474577665329, + 0.3115180656313896, + 1.5075576938688755, + 0.13300154730677605, + 0.4107736386358738 + ], + "unique_experts": 63, + "load_cv": 0.8753251839841073, + "normalized_load_entropy": 0.9168520338966634, + "max_load_share": 0.06172839506172839 + }, + "full_input": { + "tokens": 133, + "top_k": 6, + "decisions": 798, + "ordered_route_sha256": "0b9defd9094736b48770a6be4ab39a7a2ab3f4fe7b8988e32a5e3008e2567b27", + "route_weight_sha256": "96a7e066a6e1d7f16e556d18671f7e8cf01871b8b9822115fc0bbd5ed27d8f81", + "loads": [ + 18, + 21, + 5, + 4, + 8, + 8, + 6, + 17, + 11, + 2, + 35, + 28, + 4, + 11, + 4, + 8, + 5, + 8, + 1, + 33, + 4, + 5, + 12, + 7, + 4, + 7, + 30, + 8, + 5, + 4, + 4, + 7, + 6, + 13, + 49, + 21, + 13, + 2, + 23, + 2, + 1, + 25, + 3, + 3, + 15, + 27, + 24, + 4, + 16, + 2, + 14, + 15, + 11, + 32, + 4, + 12, + 35, + 2, + 18, + 31, + 7, + 20, + 5, + 9 + ], + "weighted_loads": [ + 1.0673699229955673, + 1.2736962586641312, + 0.342135202139616, + 0.16412315890192986, + 0.5242548510432243, + 0.32181595265865326, + 0.1959305927157402, + 0.7253628987818956, + 0.6933794021606445, + 0.12145398184657097, + 2.7535583171993494, + 1.8923149798065424, + 0.10793953761458397, + 0.4343539644032717, + 0.2074887380003929, + 0.3627474494278431, + 0.28756722807884216, + 0.3419003412127495, + 0.05292505398392677, + 2.3741689547896385, + 0.2750524543225765, + 0.3431962877511978, + 0.9101573172956705, + 0.4588064458221197, + 0.16515657305717468, + 0.32632053457200527, + 2.470447938889265, + 0.4673355659469962, + 0.2825283445417881, + 0.20230215042829514, + 0.1679651141166687, + 0.2559824828058481, + 0.2067387904971838, + 0.750016987323761, + 7.199257370084524, + 1.2431186251342297, + 0.7600111328065395, + 0.08346467837691307, + 1.3208800964057446, + 0.07235964946448803, + 0.055895354598760605, + 1.9221416041254997, + 0.12655660137534142, + 0.17450812086462975, + 0.8163595674559474, + 2.0705525800585747, + 1.6897108908742666, + 0.26793574541807175, + 1.026178389787674, + 0.11863032355904579, + 0.603468893095851, + 0.9502869322896004, + 0.511988865211606, + 2.0785794146358967, + 0.22611800953745842, + 0.5250446647405624, + 2.1237031780183315, + 0.09370128810405731, + 1.1927448883652687, + 2.03777639195323, + 0.3115180656313896, + 1.5075576938688755, + 0.18894238211214542, + 0.44698356091976166 + ], + "unique_experts": 64, + "load_cv": 0.851005449489653, + "normalized_load_entropy": 0.9208799939216973, + "max_load_share": 0.06140350877192982 + } + }, + "s1_bos": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "203886dc3e2bb92cbbd69ee27eaeefe74f30b5f35609976f1be58291c80a9853", + "route_weight_sha256": "9e518dfe2b2f78239123cc1cd64578d389ab6b0bc815a6feb4025a36984b6f2c", + "loads": [ + 11, + 17, + 5, + 4, + 6, + 8, + 7, + 17, + 9, + 2, + 25, + 27, + 3, + 7, + 4, + 8, + 4, + 6, + 1, + 23, + 4, + 6, + 7, + 4, + 0, + 7, + 30, + 7, + 4, + 3, + 3, + 1, + 5, + 14, + 40, + 13, + 12, + 2, + 20, + 0, + 1, + 16, + 3, + 3, + 11, + 17, + 13, + 4, + 13, + 3, + 8, + 14, + 12, + 29, + 4, + 6, + 33, + 2, + 16, + 29, + 7, + 19, + 2, + 7 + ], + "weighted_loads": [ + 0.6148492582142353, + 0.9864269010722637, + 0.3421940393745899, + 0.15644251182675362, + 0.2394370548427105, + 0.324529567733407, + 0.22076666355133057, + 0.7158637046813965, + 0.6112474054098129, + 0.12243810668587685, + 1.6664090659469366, + 1.7945640180259943, + 0.08945922926068306, + 0.2560109905898571, + 0.2071467489004135, + 0.3618057034909725, + 0.23561383411288261, + 0.27750860527157784, + 0.055935464799404144, + 1.2929813396185637, + 0.27557687275111675, + 0.3960384838283062, + 0.22692402824759483, + 0.19118018820881844, + 0.0, + 0.30010034516453743, + 2.5063485484570265, + 0.42998917400836945, + 0.2422122284770012, + 0.1679222360253334, + 0.13013974204659462, + 0.04076728969812393, + 0.17840898223221302, + 0.7966346070170403, + 6.676737546920776, + 0.7268268577754498, + 0.7276387140154839, + 0.08182811737060547, + 1.2346633821725845, + 0.0, + 0.055662427097558975, + 0.9376277327537537, + 0.12335105054080486, + 0.180488221347332, + 0.5286381095647812, + 1.1046427935361862, + 0.8838165067136288, + 0.2594654932618141, + 0.8390640877187252, + 0.14821182563900948, + 0.3102007061243057, + 0.8910938054323196, + 0.5360959731042385, + 2.017786342650652, + 0.22105074673891068, + 0.22597499378025532, + 1.9907027427107096, + 0.09886359423398972, + 1.0756333768367767, + 1.9224723652005196, + 0.3144831880927086, + 1.4201210774481297, + 0.08511004224419594, + 0.37810635566711426 + ], + "unique_experts": 62, + "load_cv": 0.8879453153753833, + "normalized_load_entropy": 0.9143091229616289, + "max_load_share": 0.06172839506172839 + }, + "full_input": { + "tokens": 149, + "top_k": 6, + "decisions": 894, + "ordered_route_sha256": "9f5e0752c841f1fb99c6afe60f03f867e41ac40e6cf198b250b884e5687cbd61", + "route_weight_sha256": "e54fe92a97b7676002e86223c47401cf740f1566b54253d65ebd5f4c0bae8e71", + "loads": [ + 22, + 22, + 5, + 4, + 9, + 8, + 7, + 17, + 16, + 4, + 36, + 29, + 5, + 11, + 5, + 8, + 5, + 10, + 1, + 33, + 4, + 9, + 10, + 15, + 5, + 15, + 34, + 8, + 10, + 3, + 6, + 5, + 5, + 17, + 47, + 25, + 12, + 5, + 24, + 2, + 7, + 31, + 5, + 3, + 14, + 31, + 33, + 4, + 20, + 8, + 12, + 15, + 12, + 33, + 5, + 10, + 38, + 2, + 21, + 33, + 7, + 20, + 4, + 8 + ], + "weighted_loads": [ + 1.3663268685340881, + 1.3172446377575397, + 0.3421940393745899, + 0.15644251182675362, + 0.5715543441474438, + 0.324529567733407, + 0.22076666355133057, + 0.7158637046813965, + 1.0274516008794308, + 0.2138884849846363, + 2.7583303954452276, + 1.8905357476323843, + 0.1372071783989668, + 0.40026132203638554, + 0.24713873490691185, + 0.3618057034909725, + 0.2814243771135807, + 0.4554825387895107, + 0.055935464799404144, + 2.4489379096776247, + 0.27557687275111675, + 0.5229203291237354, + 0.8307093381881714, + 1.0399362780153751, + 0.18876741081476212, + 0.7334322333335876, + 2.7590712029486895, + 0.4430099790915847, + 0.6682964786887169, + 0.1679222360253334, + 0.3120918981730938, + 0.18730690144002438, + 0.17840898223221302, + 1.018631186336279, + 7.017663827165961, + 1.5066249296069145, + 0.7276387140154839, + 0.22433903068304062, + 1.4316205941140652, + 0.11696704849600792, + 0.4585149846971035, + 2.4438985139131546, + 0.21553553827106953, + 0.180488221347332, + 0.6587643986567855, + 2.476705487817526, + 2.52916469424963, + 0.2594654932618141, + 1.2485893294215202, + 0.4779941514134407, + 0.49691369757056236, + 0.924422811716795, + 0.5360959731042385, + 2.205624036490917, + 0.2618873119354248, + 0.4192433822900057, + 2.22327889688313, + 0.09886359423398972, + 1.3497066907584667, + 2.101731065660715, + 0.3144831880927086, + 1.4584114253520966, + 0.24678497947752476, + 0.41411054134368896 + ], + "unique_experts": 64, + "load_cv": 0.7916271048712736, + "normalized_load_entropy": 0.9304142213176395, + "max_load_share": 0.052572706935123045 + } + }, + "s0_x": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "033ab325b4d4180a2bd4b0b7c2f34b95a94394f5161927de91645adcc68c2669", + "route_weight_sha256": "c17708d808cf66aed8cf48dee52bc93253cdbc349e8017567ec66120fd987cc9", + "loads": [ + 11, + 18, + 5, + 4, + 4, + 9, + 8, + 17, + 9, + 2, + 25, + 28, + 2, + 7, + 4, + 9, + 5, + 4, + 1, + 22, + 4, + 5, + 8, + 3, + 0, + 3, + 29, + 7, + 5, + 2, + 3, + 1, + 6, + 13, + 40, + 15, + 13, + 2, + 23, + 0, + 1, + 17, + 3, + 3, + 9, + 19, + 13, + 4, + 13, + 3, + 8, + 14, + 11, + 29, + 4, + 6, + 32, + 2, + 16, + 29, + 8, + 19, + 2, + 7 + ], + "weighted_loads": [ + 0.6130569279193878, + 1.0367570891976357, + 0.3485935516655445, + 0.15806705504655838, + 0.16802551597356796, + 0.35357455536723137, + 0.26010103337466717, + 0.7207594383507967, + 0.6026491075754166, + 0.12293598055839539, + 1.6359025966376066, + 1.8696628455072641, + 0.06258913315832615, + 0.2514696754515171, + 0.21429675817489624, + 0.40137189254164696, + 0.28399649634957314, + 0.15763149037957191, + 0.05632872134447098, + 1.274635462090373, + 0.27026710845530033, + 0.34796910732984543, + 0.26391277834773064, + 0.13142789155244827, + 0.0, + 0.14582466706633568, + 2.3939663991332054, + 0.46633316949009895, + 0.28393707051873207, + 0.12852760776877403, + 0.12714097648859024, + 0.040223319083452225, + 0.2085929811000824, + 0.7730154618620872, + 6.6694141291081905, + 0.8714131079614162, + 0.765732616186142, + 0.07878502458333969, + 1.3546648509800434, + 0.0, + 0.05581941455602646, + 1.036843191832304, + 0.13613222539424896, + 0.18042081966996193, + 0.43594343960285187, + 1.2252256497740746, + 0.8623787667602301, + 0.27403127774596214, + 0.8733939453959465, + 0.15767480991780758, + 0.3133600056171417, + 0.9180348552763462, + 0.5134630464017391, + 1.9692709036171436, + 0.2218228615820408, + 0.22419953346252441, + 1.9529827758669853, + 0.09461043030023575, + 1.0745365507900715, + 1.920658104121685, + 0.34453075379133224, + 1.4716029167175293, + 0.09204630553722382, + 0.3816215321421623 + ], + "unique_experts": 62, + "load_cv": 0.900388576380979, + "normalized_load_entropy": 0.9107253233194946, + "max_load_share": 0.06172839506172839 + }, + "full_input": { + "tokens": 133, + "top_k": 6, + "decisions": 798, + "ordered_route_sha256": "ca849359716e58c766c855f83fcc73e25fb0d336892438a68a213aa45cf43c0e", + "route_weight_sha256": "be817005565b692f227281322bd9417be9f80e05a241f03c6d4693eba8191563", + "loads": [ + 20, + 21, + 5, + 4, + 6, + 9, + 8, + 17, + 11, + 2, + 37, + 28, + 4, + 11, + 4, + 9, + 7, + 5, + 1, + 32, + 4, + 5, + 12, + 6, + 4, + 6, + 29, + 8, + 5, + 2, + 4, + 6, + 6, + 13, + 50, + 21, + 13, + 2, + 27, + 0, + 1, + 27, + 3, + 3, + 12, + 27, + 24, + 4, + 16, + 3, + 12, + 15, + 11, + 32, + 4, + 10, + 36, + 2, + 18, + 35, + 8, + 19, + 4, + 8 + ], + "weighted_loads": [ + 1.259964682161808, + 1.283924899995327, + 0.3485935516655445, + 0.15806705504655838, + 0.4055292531847954, + 0.35357455536723137, + 0.26010103337466717, + 0.7207594383507967, + 0.6984437629580498, + 0.12293598055839539, + 2.9535542111843824, + 1.8696628455072641, + 0.10871878080070019, + 0.3972593229264021, + 0.21429675817489624, + 0.40137189254164696, + 0.36170097440481186, + 0.20009183138608932, + 0.05632872134447098, + 2.3384059946984053, + 0.27026710845530033, + 0.34796910732984543, + 0.9118414893746376, + 0.38206037133932114, + 0.16515657305717468, + 0.29586921259760857, + 2.3939663991332054, + 0.4793539745733142, + 0.28393707051873207, + 0.12852760776877403, + 0.16721800714731216, + 0.2248698715120554, + 0.2085929811000824, + 0.7730154618620872, + 7.260190095752478, + 1.2933835573494434, + 0.765732616186142, + 0.07878502458333969, + 1.5206204615533352, + 0.0, + 0.05581941455602646, + 1.974985308945179, + 0.13613222539424896, + 0.18042081966996193, + 0.6908060042187572, + 1.9053474143147469, + 1.6203187759965658, + 0.27403127774596214, + 1.0484385006129742, + 0.15767480991780758, + 0.518335435539484, + 0.9518818967044353, + 0.5134630464017391, + 2.087607951834798, + 0.2218228615820408, + 0.42541893757879734, + 2.156651943922043, + 0.09461043030023575, + 1.1889095269143581, + 2.1731186993420124, + 0.34453075379133224, + 1.4716029167175293, + 0.1479871403425932, + 0.4178314544260502 + ], + "unique_experts": 63, + "load_cv": 0.8843638157864501, + "normalized_load_entropy": 0.9146345155462753, + "max_load_share": 0.06265664160401002 + } + }, + "s1_x": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "fa2f9e2357fdefe497c5bbbb85b236d1e3e32f568733ee7f96e6ae857810478c", + "route_weight_sha256": "a70c6ff1a185a4f6dcf24c70ec703b084cebbc54c25925cc19e930e373094457", + "loads": [ + 12, + 19, + 5, + 4, + 5, + 7, + 6, + 19, + 9, + 2, + 26, + 24, + 3, + 5, + 4, + 9, + 4, + 5, + 1, + 23, + 4, + 5, + 7, + 2, + 0, + 8, + 29, + 9, + 5, + 3, + 4, + 1, + 5, + 15, + 39, + 15, + 12, + 1, + 21, + 0, + 1, + 16, + 3, + 3, + 10, + 19, + 13, + 4, + 13, + 3, + 8, + 13, + 11, + 30, + 4, + 6, + 33, + 1, + 16, + 29, + 6, + 20, + 2, + 7 + ], + "weighted_loads": [ + 0.6939650550484657, + 1.0833907313644886, + 0.3483338765799999, + 0.1543358713388443, + 0.20780062675476074, + 0.29390448704361916, + 0.1872502975165844, + 0.7841087635606527, + 0.6328172944486141, + 0.12694188207387924, + 1.730782026425004, + 1.6928696185350418, + 0.09129259549081326, + 0.19991978630423546, + 0.21136195585131645, + 0.3947255052626133, + 0.23829743266105652, + 0.2024531587958336, + 0.058303430676460266, + 1.268105497583747, + 0.2734939195215702, + 0.37310293689370155, + 0.2264182548969984, + 0.09525872021913528, + 0.0, + 0.34827064722776413, + 2.3655522242188454, + 0.5134628489613533, + 0.2793213129043579, + 0.17064565792679787, + 0.15852025151252747, + 0.04182010143995285, + 0.17747729644179344, + 0.8284454233944416, + 6.696592129766941, + 0.8393971119076014, + 0.7191586047410965, + 0.05067399889230728, + 1.2967156320810318, + 0.0, + 0.05757013335824013, + 0.9150488935410976, + 0.12551538087427616, + 0.1804431825876236, + 0.45791877806186676, + 1.2673152200877666, + 0.8090106602758169, + 0.26985106617212296, + 0.8742555342614651, + 0.15183978527784348, + 0.31399540044367313, + 0.8467640019953251, + 0.4972082693129778, + 2.0901549849659204, + 0.22609266638755798, + 0.2128456085920334, + 1.9951344840228558, + 0.06463713198900223, + 1.0717120654881, + 1.9378695860505104, + 0.28332171589136124, + 1.4670240003615618, + 0.08808911964297295, + 0.3823542296886444 + ], + "unique_experts": 62, + "load_cv": 0.897845819040825, + "normalized_load_entropy": 0.9106497608524934, + "max_load_share": 0.06018518518518518 + }, + "full_input": { + "tokens": 149, + "top_k": 6, + "decisions": 894, + "ordered_route_sha256": "bd516d0e0e2333464fc418df1334bd289fe4630437ab0c93255e698e55b70a6b", + "route_weight_sha256": "9ac45b4de3b6b37c0956820d297966d310b94b08d3e50f7bf1d3f5a037743228", + "loads": [ + 25, + 24, + 5, + 4, + 7, + 7, + 6, + 19, + 16, + 4, + 38, + 26, + 5, + 7, + 5, + 9, + 6, + 8, + 1, + 34, + 4, + 8, + 11, + 13, + 5, + 18, + 34, + 10, + 11, + 3, + 7, + 5, + 5, + 18, + 47, + 27, + 12, + 4, + 26, + 2, + 7, + 31, + 5, + 3, + 13, + 30, + 32, + 4, + 20, + 8, + 10, + 14, + 11, + 32, + 5, + 10, + 38, + 1, + 21, + 34, + 6, + 21, + 4, + 8 + ], + "weighted_loads": [ + 1.5824531354010105, + 1.4108736962080002, + 0.3483338765799999, + 0.1543358713388443, + 0.47070328891277313, + 0.29390448704361916, + 0.1872502975165844, + 0.7841087635606527, + 1.049021489918232, + 0.2183922603726387, + 2.983237201347947, + 1.7888413481414318, + 0.13904054462909698, + 0.25127789564430714, + 0.2513539418578148, + 0.3947255052626133, + 0.32473982125520706, + 0.34973832592368126, + 0.058303430676460266, + 2.380010588094592, + 0.2734939195215702, + 0.4999847821891308, + 0.8699764776974916, + 0.9525492563843727, + 0.18876741081476212, + 0.8603026121854782, + 2.6642655953764915, + 0.5264836540445685, + 0.7054055631160736, + 0.17064565792679787, + 0.3464155085384846, + 0.1883597131818533, + 0.17747729644179344, + 1.0504420027136803, + 7.09825804643333, + 1.6090838517993689, + 0.7191586047410965, + 0.19318491220474243, + 1.5518360696732998, + 0.11052384972572327, + 0.46042269095778465, + 2.303761310875416, + 0.21769986860454082, + 0.1804431825876236, + 0.5880450671538711, + 2.2200257629156113, + 2.3594367187470198, + 0.26985106617212296, + 1.2976853884756565, + 0.4816221110522747, + 0.43227231688797474, + 0.8800930082798004, + 0.4972082693129778, + 2.1902600917965174, + 0.2669292315840721, + 0.39819447323679924, + 2.2277106381952763, + 0.06463713198900223, + 1.3499440141022205, + 2.1704542338848114, + 0.28332171589136124, + 1.5053143482655287, + 0.24976405687630177, + 0.4183584153652191 + ], + "unique_experts": 64, + "load_cv": 0.8086405097431539, + "normalized_load_entropy": 0.9270202823481972, + "max_load_share": 0.052572706935123045 + } + }, + "s0_period": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "2eeb9f96ecdf89a7bac8a79e4c36b6dcb4570ac92bcb7beb34e02a55212255ac", + "route_weight_sha256": "6f69a5531b85d9e3009c88532b9742fe961f3e879d1e95fdf641239830f4bfa5", + "loads": [ + 11, + 17, + 5, + 3, + 5, + 7, + 10, + 18, + 9, + 2, + 25, + 27, + 2, + 7, + 4, + 9, + 4, + 4, + 1, + 21, + 4, + 5, + 7, + 2, + 0, + 5, + 29, + 9, + 5, + 2, + 2, + 2, + 6, + 13, + 41, + 15, + 13, + 2, + 23, + 0, + 1, + 17, + 3, + 4, + 8, + 19, + 14, + 4, + 13, + 3, + 8, + 14, + 11, + 29, + 4, + 6, + 32, + 2, + 16, + 29, + 6, + 19, + 2, + 8 + ], + "weighted_loads": [ + 0.6184058859944344, + 0.9847752116620541, + 0.35097572579979897, + 0.12470771744847298, + 0.21004809066653252, + 0.2848818078637123, + 0.32479419372975826, + 0.7389764189720154, + 0.6098776534199715, + 0.12452368810772896, + 1.6462735757231712, + 1.8300013728439808, + 0.062145065516233444, + 0.25178762897849083, + 0.2079712487757206, + 0.40091269463300705, + 0.24601851776242256, + 0.1603321060538292, + 0.05596664175391197, + 1.2524340823292732, + 0.2745288982987404, + 0.34352024644613266, + 0.2327689416706562, + 0.10633018985390663, + 0.0, + 0.2070719674229622, + 2.41242172755301, + 0.5381015427410603, + 0.28506673872470856, + 0.12666785344481468, + 0.0894571803510189, + 0.07480143383145332, + 0.21035003662109375, + 0.7689297161996365, + 6.729299496859312, + 0.8756401091814041, + 0.7659336738288403, + 0.08275322616100311, + 1.336269624531269, + 0.0, + 0.05438294634222984, + 1.030271090567112, + 0.13089776039123535, + 0.21161572262644768, + 0.3657832629978657, + 1.2480640970170498, + 0.9080572668462992, + 0.27671103551983833, + 0.8727882504463196, + 0.16272349655628204, + 0.313668679445982, + 0.9080959148705006, + 0.5165097787976265, + 1.9704215377569199, + 0.22113021463155746, + 0.21589467115700245, + 1.9399058986455202, + 0.09870778396725655, + 1.0769033953547478, + 1.9073246475309134, + 0.2818632796406746, + 1.4659313708543777, + 0.09550425782799721, + 0.41638410836458206 + ], + "unique_experts": 62, + "load_cv": 0.9012345679012346, + "normalized_load_entropy": 0.91087150004683, + "max_load_share": 0.06327160493827161 + }, + "full_input": { + "tokens": 133, + "top_k": 6, + "decisions": 798, + "ordered_route_sha256": "668674566a8fed04b66dfd8baa7f2485431e98baea5b19f1a7ddf1c13bf29d4a", + "route_weight_sha256": "ab413bfc1a85d55925026fe85827f53a92be8bc9faa30289b076b6b54c8d32e1", + "loads": [ + 21, + 20, + 5, + 3, + 7, + 7, + 10, + 18, + 11, + 2, + 37, + 27, + 4, + 11, + 4, + 9, + 5, + 6, + 1, + 31, + 4, + 5, + 10, + 5, + 4, + 6, + 29, + 10, + 5, + 2, + 3, + 7, + 6, + 13, + 51, + 21, + 13, + 2, + 26, + 0, + 1, + 28, + 3, + 4, + 11, + 27, + 26, + 4, + 16, + 3, + 12, + 15, + 11, + 32, + 4, + 11, + 37, + 2, + 18, + 34, + 6, + 19, + 4, + 9 + ], + "weighted_loads": [ + 1.2733210697770119, + 1.2304169051349163, + 0.35097572579979897, + 0.12470771744847298, + 0.4441678710281849, + 0.2848818078637123, + 0.32479419372975826, + 0.7389764189720154, + 0.7056723088026047, + 0.12452368810772896, + 2.9105165153741837, + 1.8300013728439808, + 0.10827471315860748, + 0.397292522713542, + 0.2079712487757206, + 0.40091269463300705, + 0.28690105676651, + 0.25429118424654007, + 0.05596664175391197, + 2.3203443810343742, + 0.2745288982987404, + 0.34352024644613266, + 0.8366649188101292, + 0.36085203662514687, + 0.16515657305717468, + 0.2844625264406204, + 2.41242172755301, + 0.5511223478242755, + 0.28506673872470856, + 0.12666785344481468, + 0.12953421100974083, + 0.2594479862600565, + 0.21035003662109375, + 0.7689297161996365, + 7.281212218105793, + 1.2909297496080399, + 0.7659336738288403, + 0.08275322616100311, + 1.4651948101818562, + 0.0, + 0.05438294634222984, + 2.009496007114649, + 0.13089776039123535, + 0.21161572262644768, + 0.620645827613771, + 1.9369265586137772, + 1.7876614723354578, + 0.27671103551983833, + 1.0546418949961662, + 0.16272349655628204, + 0.5165998972952366, + 0.9419429562985897, + 0.5165097787976265, + 2.0812706481665373, + 0.22113021463155746, + 0.4636259600520134, + 2.182906625792384, + 0.09870778396725655, + 1.198243636637926, + 2.1222163420170546, + 0.2818632796406746, + 1.4659313708543777, + 0.15144509263336658, + 0.4525940306484699 + ], + "unique_experts": 63, + "load_cv": 0.8901407476134706, + "normalized_load_entropy": 0.9135901258379524, + "max_load_share": 0.06390977443609022 + } + }, + "s1_period": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "ea64c0de098a96919619ebd5a6c679bd53c06e00f039445c8f0121c533671e22", + "route_weight_sha256": "a38d6e8021d687180e9c802b17cc0bc6ff294125f74dd9e5b7dfeeb2723b42c2", + "loads": [ + 11, + 18, + 5, + 4, + 5, + 7, + 8, + 19, + 9, + 2, + 26, + 24, + 3, + 5, + 4, + 9, + 4, + 7, + 1, + 21, + 3, + 6, + 6, + 2, + 0, + 8, + 29, + 9, + 5, + 3, + 3, + 1, + 5, + 15, + 39, + 15, + 13, + 2, + 23, + 0, + 1, + 16, + 3, + 3, + 9, + 19, + 13, + 4, + 14, + 2, + 8, + 13, + 10, + 30, + 4, + 6, + 33, + 1, + 17, + 30, + 6, + 18, + 1, + 8 + ], + "weighted_loads": [ + 0.6770775839686394, + 1.0451085716485977, + 0.3446304276585579, + 0.15455109998583794, + 0.21199634298682213, + 0.2944551780819893, + 0.25523360818624496, + 0.7710213679820299, + 0.6331700496375561, + 0.12660666555166245, + 1.7513724192976952, + 1.6898063365370035, + 0.09302040748298168, + 0.18744836933910847, + 0.2102361060678959, + 0.3947010934352875, + 0.2439759373664856, + 0.2680574394762516, + 0.0584702230989933, + 1.1959277149289846, + 0.24182196706533432, + 0.4003981053829193, + 0.1970249656587839, + 0.10568367317318916, + 0.0, + 0.3459305129945278, + 2.414421822875738, + 0.5396101772785187, + 0.2803252190351486, + 0.16389141604304314, + 0.12596946209669113, + 0.04207518324255943, + 0.1744612418115139, + 0.8313734345138073, + 6.598423857241869, + 0.8328157234936953, + 0.7585803419351578, + 0.08501912280917168, + 1.354218915104866, + 0.0, + 0.05550255998969078, + 0.915050819516182, + 0.1306163463741541, + 0.17984794080257416, + 0.4129129499197006, + 1.2768244855105877, + 0.8153589330613613, + 0.2613244503736496, + 0.9184181094169617, + 0.11348739266395569, + 0.3098065908998251, + 0.8420766480267048, + 0.45049844682216644, + 2.091612773016095, + 0.2194266878068447, + 0.1994394212961197, + 2.015372186899185, + 0.06384158879518509, + 1.109918974339962, + 1.9799579698592424, + 0.2814153879880905, + 1.3739659301936626, + 0.048612330108881, + 0.41251955181360245 + ], + "unique_experts": 62, + "load_cv": 0.899033334105556, + "normalized_load_entropy": 0.9101437568099902, + "max_load_share": 0.06018518518518518 + }, + "full_input": { + "tokens": 149, + "top_k": 6, + "decisions": 894, + "ordered_route_sha256": "ccd62590d2517fb5dc352b86786106a90cc13a4488751177767a8dc4b43dab18", + "route_weight_sha256": "7878edfa18846cf2ffac26ffe36cde56cd96919569898ceda9ef282470bb62d1", + "loads": [ + 23, + 23, + 5, + 4, + 7, + 7, + 8, + 19, + 16, + 4, + 38, + 26, + 5, + 8, + 5, + 9, + 5, + 10, + 1, + 31, + 3, + 9, + 10, + 13, + 5, + 18, + 33, + 10, + 11, + 3, + 6, + 5, + 5, + 18, + 46, + 27, + 13, + 5, + 28, + 1, + 7, + 32, + 5, + 3, + 12, + 31, + 34, + 4, + 21, + 7, + 10, + 14, + 10, + 33, + 5, + 10, + 39, + 1, + 22, + 34, + 6, + 19, + 3, + 9 + ], + "weighted_loads": [ + 1.4632670879364014, + 1.3656240589916706, + 0.3446304276585579, + 0.15455109998583794, + 0.48048466071486473, + 0.2944551780819893, + 0.25523360818624496, + 0.7710213679820299, + 1.049374245107174, + 0.2180570438504219, + 2.9151230677962303, + 1.7857780661433935, + 0.1407683566212654, + 0.27158622816205025, + 0.2502280920743942, + 0.3947010934352875, + 0.2897864803671837, + 0.4183098189532757, + 0.0584702230989933, + 2.302605489268899, + 0.24182196706533432, + 0.5272799506783485, + 0.8417986985296011, + 0.9517498426139355, + 0.18876741081476212, + 0.8559633977711201, + 2.667144477367401, + 0.5526309823617339, + 0.7064094692468643, + 0.16389141604304314, + 0.3110945113003254, + 0.18861479498445988, + 0.1744612418115139, + 1.053370013833046, + 6.939350137487054, + 1.613406965509057, + 0.7585803419351578, + 0.22753003612160683, + 1.6193372085690498, + 0.06712242215871811, + 0.4583551175892353, + 2.402300391346216, + 0.22280083410441875, + 0.17984794080257416, + 0.5430392390117049, + 2.2445004358887672, + 2.606744207441807, + 0.2613244503736496, + 1.342677190899849, + 0.4432697184383869, + 0.4245860483497381, + 0.8754056543111801, + 0.45049844682216644, + 2.240643000230193, + 0.26026325300335884, + 0.3894982561469078, + 2.2881686948239803, + 0.06384158879518509, + 1.390044629573822, + 2.159216670319438, + 0.2814153879880905, + 1.4122562780976295, + 0.21028726734220982, + 0.44852373749017715 + ], + "unique_experts": 64, + "load_cv": 0.8104210183767513, + "normalized_load_entropy": 0.9261407535054118, + "max_load_share": 0.05145413870246085 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 108, + "ordered_topk_exact_tokens": 74, + "set_exact_tokens": 86, + "mean_set_jaccard": 0.9417989417989417, + "mean_token_weighted_tv": 0.013307618417052759, + "aggregate_load_tv": 0.023148148148148147 + }, + "system_bos": { + "tokens": 108, + "ordered_topk_exact_tokens": 69, + "set_exact_tokens": 80, + "mean_set_jaccard": 0.9239417989417992, + "mean_token_weighted_tv": 0.018408315040654055, + "aggregate_load_tv": 0.026234567901234566 + }, + "system_x": { + "tokens": 108, + "ordered_topk_exact_tokens": 53, + "set_exact_tokens": 70, + "mean_set_jaccard": 0.8974867724867726, + "mean_token_weighted_tv": 0.022977425018325448, + "aggregate_load_tv": 0.037037037037037035 + }, + "system_period": { + "tokens": 108, + "ordered_topk_exact_tokens": 61, + "set_exact_tokens": 79, + "mean_set_jaccard": 0.9193121693121695, + "mean_token_weighted_tv": 0.020268946170323977, + "aggregate_load_tv": 0.033950617283950615 + }, + "bos_at_s0": { + "tokens": 108, + "ordered_topk_exact_tokens": 62, + "set_exact_tokens": 78, + "mean_set_jaccard": 0.9166666666666666, + "mean_token_weighted_tv": 0.019144476417245135, + "aggregate_load_tv": 0.037037037037037035 + }, + "bos_at_s1": { + "tokens": 108, + "ordered_topk_exact_tokens": 54, + "set_exact_tokens": 65, + "mean_set_jaccard": 0.8743386243386243, + "mean_token_weighted_tv": 0.026842930621502024, + "aggregate_load_tv": 0.046296296296296294 + }, + "x_at_s0": { + "tokens": 108, + "ordered_topk_exact_tokens": 58, + "set_exact_tokens": 71, + "mean_set_jaccard": 0.8981481481481481, + "mean_token_weighted_tv": 0.022758448229136842, + "aggregate_load_tv": 0.04475308641975308 + }, + "x_at_s1": { + "tokens": 108, + "ordered_topk_exact_tokens": 48, + "set_exact_tokens": 63, + "mean_set_jaccard": 0.8690476190476191, + "mean_token_weighted_tv": 0.02967386778133611, + "aggregate_load_tv": 0.040123456790123455 + }, + "period_at_s0": { + "tokens": 108, + "ordered_topk_exact_tokens": 60, + "set_exact_tokens": 69, + "mean_set_jaccard": 0.8908730158730159, + "mean_token_weighted_tv": 0.02480920655997815, + "aggregate_load_tv": 0.04475308641975309 + }, + "period_at_s1": { + "tokens": 108, + "ordered_topk_exact_tokens": 50, + "set_exact_tokens": 62, + "mean_set_jaccard": 0.8723544973544974, + "mean_token_weighted_tv": 0.028910807903028198, + "aggregate_load_tv": 0.044753086419753084 + } + } + }, + "layer_10": { + "layer": 10, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "8900436097f0cfdca683622d2414179c702cd9b0aed891e47f6851e992bd8b18", + "route_weight_sha256": "9fe0562fa42921e9201a6a5c7ce1cbe5d5d4f6ccab3c94abecb262cdedf90502", + "loads": [ + 1, + 3, + 4, + 15, + 2, + 17, + 30, + 6, + 7, + 7, + 18, + 15, + 18, + 2, + 3, + 2, + 15, + 13, + 16, + 6, + 2, + 26, + 5, + 10, + 4, + 2, + 8, + 5, + 5, + 12, + 13, + 0, + 7, + 18, + 12, + 15, + 6, + 10, + 3, + 9, + 4, + 13, + 6, + 0, + 36, + 31, + 19, + 3, + 0, + 4, + 27, + 17, + 10, + 9, + 2, + 11, + 11, + 18, + 8, + 15, + 14, + 4, + 2, + 12 + ], + "weighted_loads": [ + 0.03014899604022503, + 0.1507703885436058, + 0.1419934593141079, + 0.8948847278952599, + 0.10704134777188301, + 0.6019763331860304, + 1.8278498388826847, + 0.20148351229727268, + 0.4084245376288891, + 0.2908706311136484, + 1.1138264387845993, + 0.9865970052778721, + 1.503587480634451, + 0.112271036952734, + 0.1593790054321289, + 0.10971519351005554, + 0.8191020768135786, + 0.6957002431154251, + 1.2637562192976475, + 0.26461441814899445, + 0.0773809589445591, + 1.9467718284577131, + 0.21974249556660652, + 0.4253406189382076, + 0.25191755220294, + 0.15871309489011765, + 0.5620317868888378, + 0.2698621042072773, + 0.22726906463503838, + 0.5321631953120232, + 0.7051128651946783, + 0.0, + 0.27096615731716156, + 0.8536705709993839, + 0.9125591479241848, + 0.9952885806560516, + 0.29372723028063774, + 0.9119480699300766, + 0.17239590361714363, + 0.4569648653268814, + 0.28652292490005493, + 0.7685108371078968, + 0.20414364151656628, + 0.0, + 2.4874669779092073, + 1.956550883129239, + 2.093408528715372, + 0.09989632852375507, + 0.0, + 0.23354479670524597, + 1.8809123113751411, + 0.816792331635952, + 0.6276396848261356, + 0.4145556315779686, + 0.0770658366382122, + 0.6658234484493732, + 0.41071467846632004, + 2.001646138727665, + 0.4129861257970333, + 0.6691867429763079, + 0.8713197484612465, + 0.4356759265065193, + 0.13109814748167992, + 0.8690215013921261 + ], + "unique_experts": 61, + "load_cv": 0.7900270002852423, + "normalized_load_entropy": 0.926297522563581, + "max_load_share": 0.05555555555555555 + }, + "full_input": { + "tokens": 133, + "top_k": 6, + "decisions": 798, + "ordered_route_sha256": "ec41da28c940f410439a376a24e884896dc4bcc12c5d3804065618ff45c19c41", + "route_weight_sha256": "56df503ab0edc5cf303b856b3b50c119fef919075bc7db3c8a4bb08d4eae2262", + "loads": [ + 1, + 3, + 6, + 15, + 2, + 17, + 30, + 10, + 7, + 9, + 20, + 16, + 19, + 5, + 5, + 2, + 15, + 16, + 23, + 8, + 6, + 28, + 6, + 10, + 4, + 4, + 8, + 12, + 6, + 13, + 16, + 1, + 7, + 26, + 13, + 16, + 6, + 10, + 3, + 9, + 4, + 22, + 10, + 2, + 43, + 33, + 25, + 6, + 0, + 6, + 29, + 23, + 10, + 12, + 2, + 20, + 11, + 24, + 8, + 26, + 19, + 16, + 2, + 12 + ], + "weighted_loads": [ + 0.03014899604022503, + 0.1507703885436058, + 0.1609987518750131, + 0.8948847278952599, + 0.10704134777188301, + 0.6019763331860304, + 1.8278498388826847, + 0.38041060976684093, + 0.4084245376288891, + 0.315284738317132, + 1.2101816646754742, + 1.034945759922266, + 1.536336351186037, + 1.528989765793085, + 0.34781287610530853, + 0.10971519351005554, + 0.8191020768135786, + 0.8672057054936886, + 1.6502248598262668, + 0.3796488754451275, + 0.24426396936178207, + 2.030058914795518, + 0.22345706587657332, + 0.4253406189382076, + 0.25191755220294, + 0.22243752889335155, + 0.5620317868888378, + 0.9413684941828251, + 0.2733451686799526, + 0.5748611316084862, + 0.9984387215226889, + 0.013768290169537067, + 0.27096615731716156, + 1.2235097885131836, + 0.9423753283917904, + 1.0322050862014294, + 0.29372723028063774, + 0.9119480699300766, + 0.17239590361714363, + 0.4569648653268814, + 0.28652292490005493, + 1.7804804518818855, + 0.31845863349735737, + 0.09793658554553986, + 3.0144396144896746, + 2.060392750427127, + 2.3616933450102806, + 0.2414791602641344, + 0.0, + 0.3262568265199661, + 1.9772556200623512, + 1.116463053971529, + 0.6276396848261356, + 0.5699531212449074, + 0.0770658366382122, + 1.264593094587326, + 0.41071467846632004, + 2.345786165446043, + 0.4129861257970333, + 1.3300989624112844, + 1.183454342186451, + 1.475046195089817, + 0.13109814748167992, + 0.8690215013921261 + ], + "unique_experts": 63, + "load_cv": 0.7354555347710384, + "normalized_load_entropy": 0.9355902167575316, + "max_load_share": 0.05388471177944862 + } + }, + "s1_eos": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "2db0b452cf9ac247caad7d8904cdc23d16aa83f44cdbd293a4f47df9372b6b50", + "route_weight_sha256": "ad6b324db528554e8e9562b4add4b02a4426b9fe896d2c6848220fdc18612299", + "loads": [ + 1, + 4, + 4, + 14, + 2, + 16, + 29, + 6, + 6, + 8, + 18, + 15, + 19, + 4, + 4, + 3, + 15, + 12, + 15, + 7, + 2, + 26, + 5, + 10, + 4, + 3, + 9, + 6, + 5, + 12, + 13, + 0, + 7, + 17, + 12, + 15, + 5, + 10, + 2, + 11, + 4, + 15, + 6, + 0, + 35, + 31, + 19, + 3, + 0, + 3, + 27, + 18, + 10, + 9, + 2, + 11, + 9, + 19, + 7, + 13, + 13, + 4, + 2, + 12 + ], + "weighted_loads": [ + 0.029483230784535408, + 0.19744310900568962, + 0.1388915702700615, + 0.8664894178509712, + 0.11119202896952629, + 0.574380200356245, + 1.8003775347024202, + 0.19741977006196976, + 0.37769198790192604, + 0.3278793543577194, + 1.1236769799143076, + 0.9734774678945541, + 1.548582810908556, + 0.1680174544453621, + 0.18718426674604416, + 0.1554713398218155, + 0.821017662063241, + 0.6327210888266563, + 1.2326602041721344, + 0.3155662529170513, + 0.07505905255675316, + 1.9804407563060522, + 0.21770376712083817, + 0.4116235487163067, + 0.2524426020681858, + 0.1918087974190712, + 0.5893559660762548, + 0.32012419030070305, + 0.22144941985607147, + 0.5304731018841267, + 0.7122706025838852, + 0.0, + 0.2587282154709101, + 0.8282696083188057, + 0.9140103794634342, + 0.9960699491202831, + 0.26837481558322906, + 0.9028234072029591, + 0.1307731382548809, + 0.5179375782608986, + 0.281363382935524, + 0.8459848389029503, + 0.2088784035295248, + 0.0, + 2.4852727726101875, + 1.9514242801815271, + 2.103843204677105, + 0.09058399684727192, + 0.0, + 0.1941978745162487, + 1.8956467024981976, + 0.8613421805202961, + 0.6210100911557674, + 0.39360128715634346, + 0.07610504701733589, + 0.6581197902560234, + 0.34535673074424267, + 2.0474331080913544, + 0.3651891276240349, + 0.5974731966853142, + 0.8029825687408447, + 0.4332192689180374, + 0.12787125259637833, + 0.8543667085468769 + ], + "unique_experts": 61, + "load_cv": 0.7744392388919602, + "normalized_load_entropy": 0.9292686417222983, + "max_load_share": 0.05401234567901234 + }, + "full_input": { + "tokens": 149, + "top_k": 6, + "decisions": 894, + "ordered_route_sha256": "1441ddc40f4f9d0190614c8a08e46f1f917f3aec6fc67d5ac6d5d84762281a61", + "route_weight_sha256": "76868e8f498f5943bcde8cc34506f4fd186a0ee8abe27ca761d0a043a93e5769", + "loads": [ + 1, + 4, + 7, + 14, + 6, + 16, + 29, + 7, + 6, + 10, + 20, + 18, + 23, + 6, + 7, + 3, + 15, + 17, + 21, + 8, + 3, + 28, + 6, + 10, + 5, + 6, + 10, + 27, + 5, + 15, + 22, + 1, + 12, + 33, + 14, + 17, + 8, + 13, + 3, + 11, + 5, + 30, + 10, + 2, + 41, + 36, + 25, + 6, + 8, + 6, + 31, + 32, + 11, + 13, + 2, + 23, + 10, + 26, + 7, + 30, + 24, + 14, + 2, + 13 + ], + "weighted_loads": [ + 0.029483230784535408, + 0.19744310900568962, + 0.1981520839035511, + 0.8664894178509712, + 0.31352435424923897, + 0.574380200356245, + 1.8003775347024202, + 0.236373383551836, + 0.37769198790192604, + 0.3530259719118476, + 1.201535290107131, + 1.1435498893260956, + 1.748401079326868, + 1.5429717674851418, + 0.45357611030340195, + 0.1554713398218155, + 0.821017662063241, + 0.9063033200800419, + 1.6038587791845202, + 0.3624686151742935, + 0.11740530282258987, + 2.065926807001233, + 0.22162670129910111, + 0.4116235487163067, + 0.2943991720676422, + 0.5141325835138559, + 0.6316900420933962, + 1.5961017105728388, + 0.22144941985607147, + 0.6633708737790585, + 1.4445790573954582, + 0.013768290169537067, + 0.7532783839851618, + 1.628997128456831, + 1.0556121375411749, + 1.1591445952653885, + 0.3825292531400919, + 1.029901959002018, + 0.16862154006958008, + 0.5179375782608986, + 0.32379744201898575, + 2.2334260307252407, + 0.3072355668991804, + 0.06748274154961109, + 2.965291954576969, + 2.213280702009797, + 2.4276307113468647, + 0.22390743531286716, + 0.6495137363672256, + 0.36742888763546944, + 2.1255223713815212, + 1.6730958558619022, + 0.6913667358458042, + 0.5890719965100288, + 0.07610504701733589, + 1.4948578402400017, + 0.4175343047827482, + 2.438211590051651, + 0.3651891276240349, + 1.664614275097847, + 1.5386088229715824, + 1.3312795758247375, + 0.12787125259637833, + 0.8905546367168427 + ], + "unique_experts": 64, + "load_cv": 0.7124041558663434, + "normalized_load_entropy": 0.9397122028327886, + "max_load_share": 0.04586129753914989 + } + }, + "s0_bos": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "a6f37e16a50713334610312b011b89d01222eeebb5b5bd6af5c496f8293348eb", + "route_weight_sha256": "95691a4af21b7dd57652cded853ff398f14b80f0062c1076b4122335e3bb31aa", + "loads": [ + 1, + 3, + 3, + 14, + 3, + 21, + 29, + 7, + 8, + 8, + 18, + 16, + 19, + 4, + 3, + 2, + 15, + 10, + 16, + 6, + 3, + 26, + 5, + 10, + 4, + 3, + 8, + 9, + 5, + 12, + 12, + 0, + 6, + 17, + 12, + 16, + 6, + 10, + 3, + 10, + 4, + 13, + 6, + 0, + 33, + 30, + 19, + 3, + 0, + 4, + 27, + 16, + 10, + 8, + 3, + 11, + 8, + 19, + 8, + 12, + 12, + 5, + 2, + 12 + ], + "weighted_loads": [ + 0.02911168895661831, + 0.15119954571127892, + 0.10762255638837814, + 0.8542452752590179, + 0.14074841141700745, + 0.7099209148436785, + 1.802709149196744, + 0.23442631028592587, + 0.43520551547408104, + 0.352021936327219, + 1.0910954754799604, + 1.0149675123393536, + 1.5462142508476973, + 0.16024399548768997, + 0.15289247408509254, + 0.10287618264555931, + 0.8375874385237694, + 0.5172169655561447, + 1.2791308853775263, + 0.2666618451476097, + 0.11370248347520828, + 1.9335691537708044, + 0.21859042346477509, + 0.4264997784048319, + 0.25901151448488235, + 0.19536088407039642, + 0.582603145390749, + 0.42267320677638054, + 0.2195422649383545, + 0.527826976031065, + 0.6507511101663113, + 0.0, + 0.21308529376983643, + 0.8196514006704092, + 0.9319958239793777, + 1.0391262732446194, + 0.3026213273406029, + 0.9102901183068752, + 0.16728419810533524, + 0.4839686807245016, + 0.29141609743237495, + 0.7838572300970554, + 0.2083289660513401, + 0.0, + 2.347228493541479, + 1.9496614839881659, + 2.085430011153221, + 0.09022380225360394, + 0.0, + 0.21953896433115005, + 1.9114136658608913, + 0.7566109783947468, + 0.6330250836908817, + 0.3808879368007183, + 0.11520130187273026, + 0.6966804005205631, + 0.3082796595990658, + 2.0718701668083668, + 0.41422370076179504, + 0.5788265466690063, + 0.7921094112098217, + 0.4890344813466072, + 0.12784693762660027, + 0.8662254475057125 + ], + "unique_experts": 61, + "load_cv": 0.7607382964446369, + "normalized_load_entropy": 0.9315941014130585, + "max_load_share": 0.05092592592592592 + }, + "full_input": { + "tokens": 133, + "top_k": 6, + "decisions": 798, + "ordered_route_sha256": "55b09631661f85951adf0acdf29df1e59c8ef15d6f6ab252c32564c5b74d829d", + "route_weight_sha256": "660148b6595397e6cf110b27df2f2769cb1da10b6279d446f079da184bbecd1c", + "loads": [ + 1, + 4, + 4, + 14, + 3, + 21, + 29, + 11, + 8, + 9, + 20, + 17, + 20, + 7, + 6, + 2, + 15, + 13, + 22, + 8, + 8, + 28, + 5, + 10, + 4, + 5, + 8, + 17, + 6, + 13, + 15, + 1, + 6, + 25, + 13, + 17, + 6, + 10, + 3, + 10, + 4, + 22, + 10, + 2, + 39, + 32, + 25, + 6, + 0, + 7, + 29, + 21, + 10, + 10, + 3, + 20, + 8, + 25, + 8, + 25, + 17, + 17, + 2, + 12 + ], + "weighted_loads": [ + 0.02911168895661831, + 0.18772611021995544, + 0.12176461517810822, + 0.8542452752590179, + 0.14074841141700745, + 0.7099209148436785, + 1.802709149196744, + 0.4133534077554941, + 0.43520551547408104, + 0.36824763752520084, + 1.1874507013708353, + 1.0633162669837475, + 1.5789631213992834, + 0.7072435356676579, + 0.39769867807626724, + 0.10287618264555931, + 0.8375874385237694, + 0.6900395750999451, + 1.6821120511740446, + 0.37132473662495613, + 0.35190339758992195, + 2.016856240108609, + 0.21859042346477509, + 0.4264997784048319, + 0.25901151448488235, + 0.25908531807363033, + 0.582603145390749, + 1.2113168314099312, + 0.26561836898326874, + 0.570524912327528, + 0.9478237889707088, + 0.013768290169537067, + 0.21308529376983643, + 1.202057296410203, + 0.9618120044469833, + 1.076042778789997, + 0.3026213273406029, + 0.9102901183068752, + 0.16728419810533524, + 0.4839686807245016, + 0.29141609743237495, + 1.9073632694780827, + 0.3636254984885454, + 0.09793658554553986, + 2.864335346966982, + 2.0535033512860537, + 2.3537148274481297, + 0.23252311907708645, + 0.0, + 0.39360911399126053, + 2.0077569745481014, + 0.9962415024638176, + 0.6330250836908817, + 0.4963328503072262, + 0.11520130187273026, + 1.3038222528994083, + 0.3082796595990658, + 2.416010193526745, + 0.41422370076179504, + 1.3286318443715572, + 1.109050638973713, + 1.528404749929905, + 0.12784693762660027, + 0.8662254475057125 + ], + "unique_experts": 63, + "load_cv": 0.7068868879140582, + "normalized_load_entropy": 0.9395378103990798, + "max_load_share": 0.04887218045112782 + } + }, + "s1_bos": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "35ae46498847374874f2401ba7f0ea98b524ca0557ebb05660e24865d8680178", + "route_weight_sha256": "559071eab8462e897a5902759711eeef1dbf5292db0222eea3c0aa65173c63e6", + "loads": [ + 0, + 4, + 4, + 15, + 2, + 17, + 29, + 6, + 6, + 8, + 21, + 16, + 19, + 2, + 3, + 4, + 17, + 13, + 17, + 6, + 3, + 27, + 5, + 11, + 5, + 2, + 7, + 7, + 4, + 12, + 13, + 0, + 8, + 16, + 12, + 16, + 6, + 10, + 3, + 11, + 4, + 11, + 5, + 1, + 33, + 30, + 19, + 2, + 0, + 3, + 27, + 17, + 10, + 9, + 2, + 11, + 7, + 19, + 7, + 12, + 12, + 4, + 3, + 13 + ], + "weighted_loads": [ + 0.0, + 0.19197289273142815, + 0.1388334147632122, + 0.9193383827805519, + 0.09937375038862228, + 0.5937519837170839, + 1.8194904625415802, + 0.20768111757934093, + 0.3648086339235306, + 0.32833546586334705, + 1.1995115671306849, + 1.0197893232107162, + 1.553998675197363, + 0.07968283072113991, + 0.14738624170422554, + 0.18763244524598122, + 0.9098011013120413, + 0.638336718082428, + 1.2833508159965277, + 0.2640050370246172, + 0.11402465403079987, + 1.9646387808024883, + 0.23106439039111137, + 0.44862539879977703, + 0.30673327669501305, + 0.17152594402432442, + 0.5321918651461601, + 0.3385767713189125, + 0.16462304443120956, + 0.5284894034266472, + 0.6948574371635914, + 0.0, + 0.30887539125978947, + 0.7524867467582226, + 0.9434313476085663, + 1.0764306001365185, + 0.3097666762769222, + 0.885496947914362, + 0.16529441252350807, + 0.5244871377944946, + 0.2931044213473797, + 0.6598155647516251, + 0.17072873748838902, + 0.03147849068045616, + 2.425619948655367, + 1.9833460617810488, + 2.0830063223838806, + 0.060659583657979965, + 0.0, + 0.17097842693328857, + 1.9527441672980785, + 0.820056576281786, + 0.6224203854799271, + 0.4106215685606003, + 0.07910307124257088, + 0.6808915622532368, + 0.26475599221885204, + 2.0848847664892673, + 0.3712282069027424, + 0.5822503380477428, + 0.792198896408081, + 0.4310305267572403, + 0.15094924345612526, + 0.8819278925657272 + ], + "unique_experts": 61, + "load_cv": 0.7762084893638592, + "normalized_load_entropy": 0.9282813050053756, + "max_load_share": 0.05092592592592592 + }, + "full_input": { + "tokens": 149, + "top_k": 6, + "decisions": 894, + "ordered_route_sha256": "6c1c0fe3884048b69f4cbb6ed42cbaf1368ab13aaf93bcddccead7ef2741b63c", + "route_weight_sha256": "3d70fda9b2cf747b0564a6b3797b2906baea374fa28112d11efd016acb1ced80", + "loads": [ + 0, + 4, + 6, + 15, + 6, + 17, + 29, + 7, + 6, + 9, + 23, + 19, + 23, + 4, + 7, + 4, + 17, + 17, + 22, + 8, + 5, + 29, + 5, + 11, + 6, + 5, + 8, + 29, + 4, + 15, + 22, + 1, + 13, + 33, + 14, + 18, + 9, + 13, + 4, + 11, + 5, + 27, + 7, + 3, + 39, + 35, + 25, + 5, + 8, + 7, + 30, + 30, + 11, + 13, + 2, + 24, + 8, + 26, + 7, + 30, + 23, + 14, + 3, + 14 + ], + "weighted_loads": [ + 0.0, + 0.19197289273142815, + 0.19308477640151978, + 0.9193383827805519, + 0.30170607566833496, + 0.5937519837170839, + 1.8194904625415802, + 0.2466347310692072, + 0.3648086339235306, + 0.3445611670613289, + 1.2773698773235083, + 1.1898617446422577, + 1.753816943615675, + 0.5885254740715027, + 0.47060202062129974, + 0.18763244524598122, + 0.9098011013120413, + 0.8587463535368443, + 1.6905197259038687, + 0.3532320987433195, + 0.2122351936995983, + 2.050124831497669, + 0.23106439039111137, + 0.44862539879977703, + 0.34868984669446945, + 0.49384973011910915, + 0.5745259411633015, + 1.688685929402709, + 0.16462304443120956, + 0.661387175321579, + 1.4249208085238934, + 0.013768290169537067, + 0.8034255597740412, + 1.590867467224598, + 1.085033105686307, + 1.2395052462816238, + 0.42392111383378506, + 1.0125754997134209, + 0.20314281433820724, + 0.5244871377944946, + 0.33553848043084145, + 2.305352170020342, + 0.21653041616082191, + 0.09896123223006725, + 2.9639385156333447, + 2.2452024836093187, + 2.4067938290536404, + 0.20251796022057533, + 0.6495137363672256, + 0.4142139106988907, + 2.1335814632475376, + 1.5625398457050323, + 0.6927770301699638, + 0.6201870664954185, + 0.07910307124257088, + 1.6015722453594208, + 0.3369335662573576, + 2.475663248449564, + 0.3712282069027424, + 1.7047206163406372, + 1.5241015367209911, + 1.3290908336639404, + 0.15094924345612526, + 0.918115820735693 + ], + "unique_experts": 63, + "load_cv": 0.7060815224293027, + "normalized_load_entropy": 0.9397280619156593, + "max_load_share": 0.0436241610738255 + } + }, + "s0_x": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "c45b103578611802b16da02c970d51e7d38ff82f5fb74be86c9d6315ca577b6d", + "route_weight_sha256": "fbbc6f901b1c080ddc1f452acf5681daa9b031e51f520b6ee0b60a874f80f711", + "loads": [ + 1, + 3, + 1, + 14, + 3, + 15, + 29, + 6, + 6, + 9, + 19, + 16, + 20, + 1, + 3, + 3, + 17, + 14, + 17, + 4, + 3, + 26, + 6, + 9, + 5, + 2, + 7, + 6, + 5, + 13, + 13, + 0, + 5, + 15, + 12, + 17, + 6, + 10, + 3, + 14, + 4, + 13, + 5, + 0, + 34, + 31, + 19, + 3, + 0, + 5, + 28, + 19, + 10, + 8, + 2, + 10, + 8, + 19, + 8, + 12, + 14, + 4, + 2, + 12 + ], + "weighted_loads": [ + 0.03167963773012161, + 0.1436789631843567, + 0.04169054701924324, + 0.8820302113890648, + 0.14065618440508842, + 0.5223978627473116, + 1.8572539556771517, + 0.19355821795761585, + 0.3465059883892536, + 0.37853618897497654, + 1.1135524492710829, + 1.0092225410044193, + 1.5956806987524033, + 0.047882646322250366, + 0.14877652376890182, + 0.16129853948950768, + 0.9088598731905222, + 0.7505237646400928, + 1.3162158001214266, + 0.18764536455273628, + 0.11199706420302391, + 1.963255064561963, + 0.2528456598520279, + 0.37562481313943863, + 0.29617494717240334, + 0.15522901341319084, + 0.539320420473814, + 0.26445993036031723, + 0.21734732389450073, + 0.5631780251860619, + 0.696243166923523, + 0.0, + 0.16428197734057903, + 0.7443650886416435, + 0.9106426686048508, + 1.0559961423277855, + 0.30060045421123505, + 0.9537812955677509, + 0.16985638812184334, + 0.617030955851078, + 0.26730483025312424, + 0.7140351757407188, + 0.17322853580117226, + 0.0, + 2.45107782818377, + 1.9882673360407352, + 2.0924478583037853, + 0.09202950820326805, + 0.0, + 0.26360969990491867, + 1.9898963309824467, + 0.8720696698874235, + 0.6375525183975697, + 0.38151513040065765, + 0.08131260424852371, + 0.6726307682693005, + 0.302873769775033, + 2.06398281827569, + 0.41905519366264343, + 0.5210051909089088, + 0.8829322308301926, + 0.43208830058574677, + 0.12679601460695267, + 0.8895608969032764 + ], + "unique_experts": 61, + "load_cv": 0.7934920476158723, + "normalized_load_entropy": 0.9246874595423431, + "max_load_share": 0.05246913580246913 + }, + "full_input": { + "tokens": 133, + "top_k": 6, + "decisions": 798, + "ordered_route_sha256": "680f044d2b957506c961a3f57a993e5368ab50c51bb8768306fcea83e249be20", + "route_weight_sha256": "97c27d76e4aed486e9771394fa7a3cbb5829f7a36e52aabeba1ba8c36d40f179", + "loads": [ + 2, + 4, + 2, + 14, + 3, + 15, + 29, + 11, + 6, + 10, + 21, + 17, + 21, + 3, + 5, + 3, + 17, + 17, + 22, + 6, + 7, + 28, + 6, + 9, + 5, + 4, + 7, + 11, + 6, + 14, + 16, + 1, + 5, + 24, + 13, + 18, + 6, + 10, + 3, + 14, + 4, + 21, + 8, + 2, + 41, + 34, + 26, + 7, + 0, + 7, + 31, + 24, + 10, + 11, + 2, + 18, + 8, + 26, + 8, + 25, + 19, + 17, + 2, + 12 + ], + "weighted_loads": [ + 0.06537346914410591, + 0.190799742937088, + 0.05583260580897331, + 0.8820302113890648, + 0.14065618440508842, + 0.5223978627473116, + 1.8572539556771517, + 0.41174191795289516, + 0.3465059883892536, + 0.3947618901729584, + 1.2099076751619577, + 1.0575712956488132, + 1.6284295693039894, + 0.5522404089570045, + 0.33120018243789673, + 0.16129853948950768, + 0.9088598731905222, + 0.9130226038396358, + 1.6553256642073393, + 0.29132697731256485, + 0.2788800746202469, + 2.046542150899768, + 0.2528456598520279, + 0.37562481313943863, + 0.29617494717240334, + 0.21895344741642475, + 0.539320420473814, + 0.8134362511336803, + 0.263423427939415, + 0.6058759614825249, + 0.9968406409025192, + 0.013768290169537067, + 0.16428197734057903, + 1.159911897033453, + 0.9404588490724564, + 1.0929126478731632, + 0.30060045421123505, + 0.9537812955677509, + 0.16985638812184334, + 0.617030955851078, + 0.26730483025312424, + 1.5435799732804298, + 0.27951805107295513, + 0.09793658554553986, + 2.9831104334443808, + 2.1621242314577103, + 2.410272654145956, + 0.26933857053518295, + 0.0, + 0.35610004886984825, + 2.1206047125160694, + 1.1501700673252344, + 0.6375525183975697, + 0.5482396185398102, + 0.08131260424852371, + 1.1870069615542889, + 0.302873769775033, + 2.471362814307213, + 0.41905519366264343, + 1.2839539125561714, + 1.1956344693899155, + 1.557772159576416, + 0.12679601460695267, + 0.8895608969032764 + ], + "unique_experts": 63, + "load_cv": 0.7399513279866097, + "normalized_load_entropy": 0.9346343005606967, + "max_load_share": 0.05137844611528822 + } + }, + "s1_x": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "0d22256cd8155a518565f837ed6a60e1548b1cc8a70a6e00bb16fb34a3e84e09", + "route_weight_sha256": "3ca4b806801ddb918101c3faf254f4d7024ec73c0ef76e9def4cbe29b6fbbcd0", + "loads": [ + 1, + 3, + 2, + 16, + 3, + 16, + 29, + 6, + 7, + 6, + 18, + 15, + 20, + 2, + 4, + 3, + 17, + 14, + 16, + 5, + 3, + 27, + 5, + 10, + 5, + 2, + 6, + 5, + 5, + 14, + 12, + 0, + 8, + 19, + 12, + 16, + 6, + 10, + 3, + 12, + 4, + 12, + 4, + 0, + 34, + 31, + 19, + 2, + 0, + 3, + 27, + 17, + 10, + 11, + 2, + 9, + 5, + 19, + 7, + 14, + 16, + 4, + 2, + 13 + ], + "weighted_loads": [ + 0.028729453682899475, + 0.14494586735963821, + 0.07240745797753334, + 0.9628219716250896, + 0.13544466346502304, + 0.5541950464248657, + 1.8678591456264257, + 0.19974614679813385, + 0.3959701284766197, + 0.26903286948800087, + 1.064324289560318, + 0.9957834854722023, + 1.6410174369812012, + 0.07904734089970589, + 0.177223052829504, + 0.1562950536608696, + 0.9283136557787657, + 0.7839847467839718, + 1.243529761210084, + 0.21650302410125732, + 0.11158987134695053, + 2.000633079558611, + 0.22425777465105057, + 0.4106750711798668, + 0.3074045144021511, + 0.16698026657104492, + 0.5056581497192383, + 0.2308850735425949, + 0.20576276630163193, + 0.6291706170886755, + 0.6831911616027355, + 0.0, + 0.30539386346936226, + 0.8288921564817429, + 0.9273797161877155, + 1.0759287141263485, + 0.3110991045832634, + 0.9223924912512302, + 0.17067526280879974, + 0.5686370134353638, + 0.2837568260729313, + 0.6202832907438278, + 0.13371452502906322, + 0.0, + 2.5390928760170937, + 2.027798755094409, + 2.072146099060774, + 0.062313877046108246, + 0.0, + 0.16834525763988495, + 2.013624891638756, + 0.8340981677174568, + 0.615058645606041, + 0.4781878627836704, + 0.07440542802214622, + 0.5658453889191151, + 0.18484888970851898, + 2.103371661156416, + 0.3728201314806938, + 0.6147055886685848, + 0.9753912799060345, + 0.43300461396574974, + 0.12103376165032387, + 0.877594631165266 + ], + "unique_experts": 61, + "load_cv": 0.7980887090811845, + "normalized_load_entropy": 0.9241137999988107, + "max_load_share": 0.05246913580246913 + }, + "full_input": { + "tokens": 149, + "top_k": 6, + "decisions": 894, + "ordered_route_sha256": "5d08ef8918b5252f7f35a961bc8a0d2f71824fe974fc189b850a1d12de8ccaf1", + "route_weight_sha256": "679091bb11d5cb7e0af2d9af12015cfec16d1cfd3866c3ec59ab982f1fa7d54e", + "loads": [ + 2, + 4, + 4, + 16, + 7, + 16, + 29, + 8, + 7, + 7, + 21, + 18, + 24, + 3, + 8, + 3, + 17, + 19, + 20, + 6, + 4, + 29, + 5, + 10, + 6, + 5, + 7, + 23, + 5, + 17, + 22, + 1, + 13, + 36, + 14, + 18, + 9, + 13, + 4, + 12, + 5, + 26, + 6, + 2, + 39, + 37, + 26, + 6, + 8, + 7, + 33, + 31, + 11, + 15, + 2, + 19, + 6, + 27, + 7, + 32, + 26, + 15, + 2, + 14 + ], + "weighted_loads": [ + 0.0814514309167862, + 0.19565121456980705, + 0.1266588196158409, + 0.9628219716250896, + 0.3377769887447357, + 0.5541950464248657, + 1.8678591456264257, + 0.2873358651995659, + 0.3959701284766197, + 0.2852585706859827, + 1.192740447819233, + 1.1658559069037437, + 1.8408357053995132, + 0.548479963093996, + 0.5008392445743084, + 0.1562950536608696, + 0.9283136557787657, + 1.0366855449974537, + 1.574749993160367, + 0.25440366193652153, + 0.15393612161278725, + 2.086119130253792, + 0.22425777465105057, + 0.4106750711798668, + 0.3493610844016075, + 0.48930405266582966, + 0.5479922257363796, + 1.3369050417095423, + 0.20576276630163193, + 0.7620683889836073, + 1.4832148253917694, + 0.013768290169537067, + 0.799944031983614, + 1.6849517151713371, + 1.0689814742654562, + 1.2390033602714539, + 0.42525354214012623, + 1.0494710430502892, + 0.20852366462349892, + 0.5686370134353638, + 0.32619088515639305, + 1.814223773777485, + 0.17951620370149612, + 0.06748274154961109, + 2.9766164422035217, + 2.3526856061071157, + 2.4611179679632187, + 0.2427249178290367, + 0.6495137363672256, + 0.38279296085238457, + 2.342145211994648, + 1.6705548092722893, + 0.6854152902960777, + 0.6855387724936008, + 0.07440542802214622, + 1.2781726866960526, + 0.25702646374702454, + 2.5460966676473618, + 0.3728201314806938, + 1.7001234367489815, + 1.667482577264309, + 1.416708778589964, + 0.12103376165032387, + 0.9137825593352318 + ], + "unique_experts": 64, + "load_cv": 0.7265391286405025, + "normalized_load_entropy": 0.9372559620859824, + "max_load_share": 0.0436241610738255 + } + }, + "s0_period": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "445b641686eec8ff365fce205935dd19fbd827cde71837aabbc3f5b93d8e5544", + "route_weight_sha256": "d67ed38ccd38c83e55ba90cd20e7caef4b44636703ec2876ca4e9a7b63c03773", + "loads": [ + 1, + 3, + 3, + 15, + 3, + 13, + 29, + 6, + 7, + 8, + 18, + 16, + 20, + 1, + 3, + 2, + 17, + 14, + 17, + 5, + 3, + 26, + 6, + 9, + 5, + 2, + 7, + 6, + 5, + 13, + 14, + 0, + 6, + 16, + 12, + 16, + 6, + 11, + 3, + 12, + 4, + 13, + 6, + 0, + 33, + 31, + 19, + 3, + 0, + 4, + 27, + 18, + 10, + 8, + 2, + 10, + 8, + 19, + 7, + 12, + 13, + 6, + 3, + 13 + ], + "weighted_loads": [ + 0.031178755685687065, + 0.14360634610056877, + 0.10580724850296974, + 0.9103360027074814, + 0.14108353853225708, + 0.4720618221908808, + 1.8464710544794798, + 0.19225447997450829, + 0.388431079685688, + 0.34679920226335526, + 1.0688535459339619, + 1.028731133788824, + 1.6100253723561764, + 0.04515710473060608, + 0.14800473302602768, + 0.11253798380494118, + 0.9163130540400743, + 0.753721222281456, + 1.2988237477838993, + 0.222495649009943, + 0.11120607331395149, + 1.961002727970481, + 0.2529993765056133, + 0.3974173106253147, + 0.30124539881944656, + 0.16024241596460342, + 0.5360765159130096, + 0.27247025817632675, + 0.2126668430864811, + 0.5657902136445045, + 0.7448776066303253, + 0.0, + 0.21285101771354675, + 0.789648724719882, + 0.909080233424902, + 1.0249117463827133, + 0.2998875714838505, + 0.9555500410497189, + 0.1739847995340824, + 0.5585052371025085, + 0.2888454645872116, + 0.7883022986352444, + 0.20443501323461533, + 0.0, + 2.412484411150217, + 2.002891080453992, + 2.0870733372867107, + 0.0905261617153883, + 0.0, + 0.21285927295684814, + 1.964274823665619, + 0.8305627480149269, + 0.6250492073595524, + 0.3762616813182831, + 0.08188337087631226, + 0.6763158775866032, + 0.30569289438426495, + 2.0662769079208374, + 0.3777640461921692, + 0.5198533479124308, + 0.8445859514176846, + 0.5284452922642231, + 0.15445488691329956, + 0.9102531038224697 + ], + "unique_experts": 61, + "load_cv": 0.7740455229341845, + "normalized_load_entropy": 0.9283803907278464, + "max_load_share": 0.05092592592592592 + }, + "full_input": { + "tokens": 133, + "top_k": 6, + "decisions": 798, + "ordered_route_sha256": "acc6e88848f90f784c5b8863c7cb45dedb3121ae45a559d98b7d2b0b3d4cb28a", + "route_weight_sha256": "fd8e4e9acfcbc10584e1d51744198b24af0aae91cdb978eb46ca4884c58e4135", + "loads": [ + 2, + 4, + 4, + 15, + 3, + 13, + 29, + 10, + 7, + 9, + 20, + 17, + 22, + 3, + 5, + 2, + 17, + 17, + 22, + 7, + 7, + 28, + 6, + 9, + 5, + 4, + 7, + 12, + 6, + 14, + 18, + 1, + 6, + 24, + 13, + 17, + 6, + 11, + 3, + 12, + 4, + 22, + 9, + 2, + 39, + 34, + 25, + 6, + 0, + 7, + 30, + 24, + 10, + 11, + 2, + 18, + 8, + 26, + 7, + 24, + 19, + 18, + 3, + 13 + ], + "weighted_loads": [ + 0.0632305946201086, + 0.18077655136585236, + 0.11994930729269981, + 0.9103360027074814, + 0.14108353853225708, + 0.4720618221908808, + 1.8464710544794798, + 0.37118157744407654, + 0.388431079685688, + 0.3630249034613371, + 1.1652087718248367, + 1.077079888433218, + 1.680384572595358, + 0.5495148673653603, + 0.32628215104341507, + 0.11253798380494118, + 0.9163130540400743, + 0.9478097856044769, + 1.637933611869812, + 0.32423369213938713, + 0.27808908373117447, + 2.0442898143082857, + 0.2529993765056133, + 0.3974173106253147, + 0.30124539881944656, + 0.22396684996783733, + 0.5360765159130096, + 0.8551218695938587, + 0.25874294713139534, + 0.6084881499409676, + 1.1253767609596252, + 0.013768290169537067, + 0.21285101771354675, + 1.1593020427972078, + 0.9388964138925076, + 1.061828251928091, + 0.2998875714838505, + 0.9555500410497189, + 0.1739847995340824, + 0.5585052371025085, + 0.2888454645872116, + 1.7027227319777012, + 0.3107245285063982, + 0.09793658554553986, + 2.908719230443239, + 2.1500122789293528, + 2.3553581535816193, + 0.23095118813216686, + 0.0, + 0.3564816266298294, + 2.0911960508674383, + 1.1785013563930988, + 0.6250492073595524, + 0.5408391281962395, + 0.08188337087631226, + 1.1996406838297844, + 0.30569289438426495, + 2.4840621165931225, + 0.3777640461921692, + 1.2423411589115858, + 1.2077940329909325, + 1.5678155608475208, + 0.15445488691329956, + 0.9102531038224697 + ], + "unique_experts": 63, + "load_cv": 0.7248569196123035, + "normalized_load_entropy": 0.9369263736567635, + "max_load_share": 0.04887218045112782 + } + }, + "s1_period": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "0851799e4bebfcb7be99a49c542a0c832dbe75f912f0c7fdd315161732de7db2", + "route_weight_sha256": "900f0cf212c60374c22a3b2e9155a309eb3afcaa8251fe3965778625e3d51cf4", + "loads": [ + 1, + 2, + 2, + 16, + 3, + 14, + 29, + 7, + 7, + 7, + 19, + 16, + 20, + 2, + 4, + 3, + 16, + 15, + 16, + 4, + 3, + 27, + 4, + 10, + 5, + 3, + 7, + 5, + 5, + 13, + 14, + 0, + 6, + 19, + 12, + 16, + 6, + 11, + 3, + 12, + 4, + 13, + 4, + 0, + 34, + 32, + 19, + 1, + 0, + 3, + 27, + 17, + 10, + 10, + 1, + 9, + 7, + 19, + 7, + 13, + 15, + 4, + 2, + 13 + ], + "weighted_loads": [ + 0.031482044607400894, + 0.09679628163576126, + 0.07127442583441734, + 0.956257626414299, + 0.13347871601581573, + 0.49359132908284664, + 1.8577263318002224, + 0.23864329792559147, + 0.3683955129235983, + 0.3216072767972946, + 1.1192937344312668, + 1.0357687771320343, + 1.6728316135704517, + 0.08412537723779678, + 0.16844797879457474, + 0.1590152569115162, + 0.8863359726965427, + 0.7777787819504738, + 1.2532203495502472, + 0.18394925445318222, + 0.11181150749325752, + 2.00403069332242, + 0.19205714762210846, + 0.4051155745983124, + 0.30688273906707764, + 0.1787275169044733, + 0.5376159399747849, + 0.214071623980999, + 0.21000298857688904, + 0.5760353021323681, + 0.7692230753600597, + 0.0, + 0.2324166465550661, + 0.8680811151862144, + 0.9314446151256561, + 1.0763117149472237, + 0.3079834096133709, + 0.9177904296666384, + 0.16873038560152054, + 0.5647834241390228, + 0.2771615758538246, + 0.6892820298671722, + 0.13635134138166904, + 0.0, + 2.54159751906991, + 2.0530166067183018, + 2.0810280181467533, + 0.027174651622772217, + 0.0, + 0.16982455924153328, + 2.027534279972315, + 0.8459185231477022, + 0.6149285063147545, + 0.4308454152196646, + 0.04588078707456589, + 0.5461303107440472, + 0.25452420115470886, + 2.1036924347281456, + 0.3731498681008816, + 0.5695175919681787, + 0.9210723266005516, + 0.4203825108706951, + 0.12136128544807434, + 0.8882507681846619 + ], + "unique_experts": 61, + "load_cv": 0.804745110505297, + "normalized_load_entropy": 0.9223337269002041, + "max_load_share": 0.05246913580246913 + }, + "full_input": { + "tokens": 149, + "top_k": 6, + "decisions": 894, + "ordered_route_sha256": "59eff1addfae8798916428bdefafdde485f1f3d9c32a23231145ae5a6099ccf7", + "route_weight_sha256": "202c0f902acd7684f737ca653038eecaf4351f860ef4c1c7621ca89bb3edb63f", + "loads": [ + 2, + 2, + 4, + 17, + 7, + 14, + 29, + 8, + 7, + 8, + 22, + 19, + 24, + 3, + 8, + 3, + 16, + 20, + 20, + 4, + 4, + 29, + 4, + 10, + 6, + 6, + 8, + 23, + 5, + 16, + 25, + 1, + 11, + 35, + 14, + 18, + 9, + 14, + 4, + 12, + 5, + 28, + 6, + 2, + 39, + 38, + 25, + 4, + 8, + 7, + 31, + 32, + 11, + 14, + 1, + 21, + 8, + 27, + 7, + 32, + 26, + 15, + 2, + 14 + ], + "weighted_loads": [ + 0.08231309056282043, + 0.09679628163576126, + 0.12552578747272491, + 1.0113658159971237, + 0.3358110412955284, + 0.49359132908284664, + 1.8577263318002224, + 0.2775969114154577, + 0.3683955129235983, + 0.33783297799527645, + 1.2363639436662197, + 1.2058411985635757, + 1.8726498819887638, + 0.553557999432087, + 0.4780488759279251, + 0.1590152569115162, + 0.8863359726965427, + 1.0922395884990692, + 1.5844405815005302, + 0.18394925445318222, + 0.15415775775909424, + 2.089516744017601, + 0.19205714762210846, + 0.4051155745983124, + 0.34883930906653404, + 0.501051302999258, + 0.5799500159919262, + 1.3250937778502703, + 0.21000298857688904, + 0.7089330740272999, + 1.6676162146031857, + 0.013768290169537067, + 0.7269668150693178, + 1.6688086353242397, + 1.0730463732033968, + 1.239386361092329, + 0.4221378471702337, + 1.0448689814656973, + 0.2065787874162197, + 0.5647834241390228, + 0.3195956349372864, + 1.9458564184606075, + 0.18215302005410194, + 0.06748274154961109, + 2.9612296037375927, + 2.3511000461876392, + 2.404815524816513, + 0.16348180174827576, + 0.6495137363672256, + 0.38527897000312805, + 2.2740899063646793, + 1.7601856533437967, + 0.6852851510047913, + 0.6437682900577784, + 0.04588078707456589, + 1.353681642562151, + 0.3267017751932144, + 2.626968093216419, + 0.3731498681008816, + 1.67560969106853, + 1.6531650461256504, + 1.3673097006976604, + 0.12136128544807434, + 0.9244386963546276 + ], + "unique_experts": 64, + "load_cv": 0.7373698170565339, + "normalized_load_entropy": 0.934500847167578, + "max_load_share": 0.0436241610738255 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 108, + "ordered_topk_exact_tokens": 74, + "set_exact_tokens": 84, + "mean_set_jaccard": 0.9345238095238095, + "mean_token_weighted_tv": 0.014001835577396883, + "aggregate_load_tv": 0.026234567901234566 + }, + "system_bos": { + "tokens": 108, + "ordered_topk_exact_tokens": 60, + "set_exact_tokens": 74, + "mean_set_jaccard": 0.9060846560846562, + "mean_token_weighted_tv": 0.01983766993335276, + "aggregate_load_tv": 0.040123456790123455 + }, + "system_x": { + "tokens": 108, + "ordered_topk_exact_tokens": 55, + "set_exact_tokens": 69, + "mean_set_jaccard": 0.8948412698412699, + "mean_token_weighted_tv": 0.023032273493569205, + "aggregate_load_tv": 0.040123456790123455 + }, + "system_period": { + "tokens": 108, + "ordered_topk_exact_tokens": 59, + "set_exact_tokens": 71, + "mean_set_jaccard": 0.8981481481481483, + "mean_token_weighted_tv": 0.02238052384927869, + "aggregate_load_tv": 0.032407407407407406 + }, + "bos_at_s0": { + "tokens": 108, + "ordered_topk_exact_tokens": 51, + "set_exact_tokens": 72, + "mean_set_jaccard": 0.8992504409171076, + "mean_token_weighted_tv": 0.020740536602076004, + "aggregate_load_tv": 0.035493827160493825 + }, + "bos_at_s1": { + "tokens": 108, + "ordered_topk_exact_tokens": 56, + "set_exact_tokens": 73, + "mean_set_jaccard": 0.8955026455026456, + "mean_token_weighted_tv": 0.023826845637005236, + "aggregate_load_tv": 0.037037037037037035 + }, + "x_at_s0": { + "tokens": 108, + "ordered_topk_exact_tokens": 50, + "set_exact_tokens": 67, + "mean_set_jaccard": 0.8835978835978836, + "mean_token_weighted_tv": 0.024900034587416384, + "aggregate_load_tv": 0.044753086419753084 + }, + "x_at_s1": { + "tokens": 108, + "ordered_topk_exact_tokens": 46, + "set_exact_tokens": 65, + "mean_set_jaccard": 0.8747795414462082, + "mean_token_weighted_tv": 0.029690019105112663, + "aggregate_load_tv": 0.04475308641975309 + }, + "period_at_s0": { + "tokens": 108, + "ordered_topk_exact_tokens": 50, + "set_exact_tokens": 71, + "mean_set_jaccard": 0.8981481481481481, + "mean_token_weighted_tv": 0.022529330311550036, + "aggregate_load_tv": 0.040123456790123455 + }, + "period_at_s1": { + "tokens": 108, + "ordered_topk_exact_tokens": 45, + "set_exact_tokens": 64, + "mean_set_jaccard": 0.8736772486772487, + "mean_token_weighted_tv": 0.029335481295776036, + "aggregate_load_tv": 0.046296296296296294 + } + } + }, + "layer_11": { + "layer": 11, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "d05fe51eb42d40920c8e0ff888e221db8e365c897e0fde83cb6983be8aefe8ca", + "route_weight_sha256": "e9cdbc297a91f26eed276ed6931990aab546c859931922a61d8265b7a4f0016d", + "loads": [ + 7, + 6, + 9, + 7, + 10, + 21, + 1, + 8, + 14, + 4, + 6, + 7, + 21, + 12, + 14, + 6, + 9, + 7, + 12, + 3, + 3, + 5, + 10, + 19, + 8, + 9, + 3, + 6, + 12, + 8, + 39, + 25, + 6, + 8, + 26, + 13, + 3, + 4, + 7, + 6, + 14, + 20, + 10, + 15, + 20, + 12, + 3, + 18, + 2, + 5, + 4, + 3, + 14, + 0, + 0, + 4, + 3, + 15, + 30, + 8, + 5, + 8, + 0, + 31 + ], + "weighted_loads": [ + 0.3026048243045807, + 0.21476265229284763, + 0.5315268859267235, + 0.26114197075366974, + 0.46940832026302814, + 1.3510680850595236, + 0.043989043682813644, + 0.46442608535289764, + 0.790411900728941, + 0.13807818479835987, + 0.18869619444012642, + 0.25910913571715355, + 1.5145475044846535, + 0.8927662558853626, + 0.7543396390974522, + 0.2142845094203949, + 0.370826767757535, + 0.23724685236811638, + 0.5753597766160965, + 0.1261521317064762, + 0.19293201714754105, + 0.2500688470900059, + 0.43155671283602715, + 1.9215367510914803, + 0.332728523761034, + 0.37658247351646423, + 0.10860945843160152, + 0.2591608203947544, + 0.8591984026134014, + 0.40193968638777733, + 2.9490983337163925, + 1.9263025037944317, + 0.19886440597474575, + 0.3018394894897938, + 1.3105798624455929, + 0.8324865363538265, + 0.1452106460928917, + 0.46317819133400917, + 0.3173214942216873, + 0.26716431230306625, + 0.638896606862545, + 0.7317196298390627, + 0.5334651321172714, + 1.0308508165180683, + 1.161277437582612, + 1.0089995041489601, + 0.09900497458875179, + 0.9714103601872921, + 0.06308087520301342, + 0.20407751575112343, + 0.25778481736779213, + 0.182294812053442, + 0.7064494006335735, + 0.0, + 0.0, + 0.13887516036629677, + 0.13474413380026817, + 0.9067212529480457, + 2.0832178592681885, + 0.3756464794278145, + 0.19912250339984894, + 0.25164075940847397, + 0.0, + 2.326278932392597 + ], + "unique_experts": 61, + "load_cv": 0.7869341496534957, + "normalized_load_entropy": 0.9312233055807111, + "max_load_share": 0.06018518518518518 + }, + "full_input": { + "tokens": 133, + "top_k": 6, + "decisions": 798, + "ordered_route_sha256": "edfe01b28a9fb9caa51939fb329692b754cf0a1a962b3461404aa57b956892c4", + "route_weight_sha256": "63849b8b736b3022087e6eabeac39faabbc1eaa20c4d14c439bc686dce6fbe7a", + "loads": [ + 7, + 7, + 10, + 7, + 15, + 21, + 1, + 8, + 18, + 6, + 9, + 10, + 21, + 12, + 14, + 11, + 14, + 9, + 24, + 3, + 3, + 5, + 11, + 24, + 8, + 10, + 4, + 7, + 19, + 8, + 45, + 33, + 8, + 8, + 30, + 14, + 3, + 4, + 7, + 6, + 23, + 20, + 10, + 37, + 23, + 12, + 3, + 26, + 2, + 7, + 4, + 4, + 14, + 0, + 6, + 6, + 3, + 15, + 33, + 8, + 5, + 13, + 9, + 31 + ], + "weighted_loads": [ + 0.3026048243045807, + 0.24506349489092827, + 0.589812234044075, + 0.26114197075366974, + 0.7061844989657402, + 1.3510680850595236, + 0.043989043682813644, + 0.46442608535289764, + 1.010556921362877, + 0.1957250777631998, + 0.26063060062006116, + 0.3129657609388232, + 1.5145475044846535, + 0.8927662558853626, + 0.7543396390974522, + 0.4162644222378731, + 0.8739681821316481, + 0.26705992966890335, + 2.6402506232261658, + 0.1261521317064762, + 0.19293201714754105, + 0.2500688470900059, + 0.4354845453053713, + 2.170376628637314, + 0.332728523761034, + 0.4157591573894024, + 0.11195299914106727, + 0.27175230998545885, + 1.325585849583149, + 0.40193968638777733, + 3.239255663007498, + 2.2792745418846607, + 0.2641405873000622, + 0.3018394894897938, + 1.4884617775678635, + 0.9112504087388515, + 0.1452106460928917, + 0.46317819133400917, + 0.3173214942216873, + 0.26716431230306625, + 1.1040357425808907, + 0.7317196298390627, + 0.5334651321172714, + 3.2869244441390038, + 1.3204881493002176, + 1.0089995041489601, + 0.09900497458875179, + 1.5242704004049301, + 0.06308087520301342, + 0.2995622642338276, + 0.25778481736779213, + 0.21064289286732674, + 0.7064494006335735, + 0.0, + 0.30204242933541536, + 0.22882196679711342, + 0.13474413380026817, + 0.9067212529480457, + 2.2200573943555355, + 0.3756464794278145, + 0.19912250339984894, + 0.49111747927963734, + 0.523795586079359, + 2.326278932392597 + ], + "unique_experts": 63, + "load_cv": 0.7699050684080879, + "normalized_load_entropy": 0.9352922099517896, + "max_load_share": 0.05639097744360902 + } + }, + "s1_eos": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "37b73eac95e94f10f3279d41d00e1ef7c4806c35459d0c5fbd528be6e7fc8fd3", + "route_weight_sha256": "775a305cd5ca2f09a2a4894c0cba8412c910ac9294892f10079f46f8377ba894", + "loads": [ + 6, + 4, + 10, + 7, + 8, + 23, + 1, + 8, + 15, + 6, + 6, + 9, + 22, + 13, + 16, + 5, + 8, + 10, + 12, + 3, + 4, + 4, + 11, + 19, + 8, + 10, + 3, + 6, + 11, + 8, + 39, + 26, + 5, + 8, + 24, + 14, + 3, + 3, + 7, + 7, + 15, + 19, + 10, + 15, + 20, + 12, + 2, + 18, + 1, + 5, + 4, + 3, + 11, + 0, + 0, + 3, + 2, + 14, + 30, + 9, + 4, + 7, + 1, + 31 + ], + "weighted_loads": [ + 0.2633676864206791, + 0.14493378065526485, + 0.5629036277532578, + 0.26453627832233906, + 0.4017176404595375, + 1.4440894536674023, + 0.043734364211559296, + 0.45855424739420414, + 0.8205341100692749, + 0.201778806746006, + 0.19030951894819736, + 0.3274009935557842, + 1.5225267093628645, + 0.935204803943634, + 0.8082277216017246, + 0.17637197114527225, + 0.35087037831544876, + 0.3554597795009613, + 0.5705268979072571, + 0.12611600011587143, + 0.2180124670267105, + 0.20792242884635925, + 0.4600040018558502, + 1.9139706641435623, + 0.32777243480086327, + 0.43051527440547943, + 0.11530084535479546, + 0.26473909243941307, + 0.8137048929929733, + 0.3890822120010853, + 2.9917308278381824, + 1.957064226269722, + 0.1665351204574108, + 0.29530514031648636, + 1.2500198613852262, + 0.836920402944088, + 0.13546770066022873, + 0.43662765622138977, + 0.30839717015624046, + 0.2969560753554106, + 0.6893267035484314, + 0.6917076464742422, + 0.5385027676820755, + 1.0027193687856197, + 1.183837529271841, + 1.0051521360874176, + 0.06001804955303669, + 0.9531624019145966, + 0.033201154321432114, + 0.21131492778658867, + 0.2551579587161541, + 0.18583553843200207, + 0.6050826162099838, + 0.0, + 0.0, + 0.121133241802454, + 0.09495077654719353, + 0.8763348311185837, + 2.061448261141777, + 0.43183377385139465, + 0.1665944792330265, + 0.22820918262004852, + 0.04072513058781624, + 2.3423482459038496 + ], + "unique_experts": 62, + "load_cv": 0.7982796622383808, + "normalized_load_entropy": 0.9288389322632847, + "max_load_share": 0.06018518518518518 + }, + "full_input": { + "tokens": 149, + "top_k": 6, + "decisions": 894, + "ordered_route_sha256": "728ca282b4757c0296488d2dc85a8054dbfe42052c8b41e3db6b1be7a5b36e2f", + "route_weight_sha256": "094ea6c0af27ec3d96463b1590e6c4ec157dc55cc03dfa637427b6dc958e5e42", + "loads": [ + 8, + 5, + 11, + 7, + 19, + 26, + 1, + 10, + 25, + 6, + 10, + 12, + 22, + 13, + 16, + 6, + 26, + 12, + 23, + 4, + 5, + 5, + 14, + 23, + 8, + 11, + 6, + 8, + 22, + 8, + 48, + 33, + 6, + 8, + 28, + 18, + 3, + 3, + 7, + 8, + 24, + 19, + 10, + 42, + 22, + 12, + 3, + 32, + 1, + 8, + 4, + 4, + 11, + 5, + 20, + 10, + 8, + 15, + 32, + 13, + 6, + 15, + 12, + 32 + ], + "weighted_loads": [ + 0.4110439829528332, + 0.17890035919845104, + 0.6096286550164223, + 0.26453627832233906, + 0.9808576628565788, + 1.5512699745595455, + 0.043734364211559296, + 0.5878325719386339, + 1.394016820937395, + 0.201778806746006, + 0.30385121144354343, + 0.38057398330420256, + 1.5225267093628645, + 0.935204803943634, + 0.8082277216017246, + 0.21722265891730785, + 1.9620587937533855, + 0.3845338337123394, + 2.6329518370330334, + 0.16499021276831627, + 0.29242880642414093, + 0.2797616124153137, + 0.576644470449537, + 2.094422150403261, + 0.32777243480086327, + 0.46934182196855545, + 0.19590354431420565, + 0.31584172789007425, + 1.5844501703977585, + 0.3890822120010853, + 3.4363650921732187, + 2.263292148709297, + 0.19851528108119965, + 0.29530514031648636, + 1.4556663278490305, + 1.1735883764922619, + 0.13546770066022873, + 0.43662765622138977, + 0.30839717015624046, + 0.34442691691219807, + 1.1252742670476437, + 0.6917076464742422, + 0.5385027676820755, + 3.598694197833538, + 1.316668190062046, + 1.0051521360874176, + 0.10625017993152142, + 1.9610438719391823, + 0.033201154321432114, + 0.43144891783595085, + 0.2551579587161541, + 0.21573279425501823, + 0.6050826162099838, + 0.304266769438982, + 1.1957955481484532, + 0.4549734592437744, + 0.56923046708107, + 0.919234175235033, + 2.1635412126779556, + 0.5860941149294376, + 0.24150016158819199, + 0.5881900601089001, + 0.6038304716348648, + 2.384034400805831 + ], + "unique_experts": 64, + "load_cv": 0.7258775294561195, + "normalized_load_entropy": 0.9414598691299979, + "max_load_share": 0.053691275167785234 + } + }, + "s0_bos": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "f912d7341ea6604edadd54636d0b16e00eb5225eda7b72a07f55cda23dc22019", + "route_weight_sha256": "c7beee090cc83a22beecd4269096f7aa89ae01cfae742746fbfe5ab7f6c44883", + "loads": [ + 6, + 6, + 10, + 6, + 10, + 23, + 1, + 9, + 14, + 5, + 5, + 6, + 22, + 14, + 16, + 5, + 7, + 9, + 13, + 2, + 4, + 6, + 11, + 19, + 8, + 9, + 2, + 6, + 13, + 7, + 38, + 26, + 6, + 8, + 25, + 14, + 3, + 3, + 9, + 7, + 15, + 21, + 8, + 12, + 20, + 14, + 2, + 18, + 0, + 4, + 5, + 3, + 15, + 0, + 1, + 1, + 3, + 14, + 30, + 7, + 4, + 5, + 1, + 32 + ], + "weighted_loads": [ + 0.2698221243917942, + 0.2136959247291088, + 0.5520684234797955, + 0.22205823473632336, + 0.44810944609344006, + 1.4055744279175997, + 0.045535389333963394, + 0.4902828112244606, + 0.7847192659974098, + 0.1535945888608694, + 0.1610742248594761, + 0.2173709012567997, + 1.5737382378429174, + 0.9738296493887901, + 0.8195010311901569, + 0.18068591691553593, + 0.3259759396314621, + 0.3060912285000086, + 0.6047608144581318, + 0.0978439673781395, + 0.23356748186051846, + 0.30748196318745613, + 0.46311189234256744, + 1.9120111465454102, + 0.34093304350972176, + 0.38184958323836327, + 0.07927320152521133, + 0.2592414431273937, + 0.907710500061512, + 0.34055429324507713, + 2.967358112335205, + 2.01354063116014, + 0.21171508729457855, + 0.30998824909329414, + 1.2747738230973482, + 0.884011659771204, + 0.15568234026432037, + 0.4019472673535347, + 0.36609228886663914, + 0.3098218534141779, + 0.6867241710424423, + 0.7965503334999084, + 0.46940887719392776, + 0.9475404191762209, + 1.197662029415369, + 1.1152597796171904, + 0.074746523052454, + 0.9304664358496666, + 0.0, + 0.1737433448433876, + 0.3050876520574093, + 0.18720879219472408, + 0.7759040743112564, + 0.0, + 0.04217031970620155, + 0.02993696555495262, + 0.13027304038405418, + 0.880458265542984, + 2.1023119129240513, + 0.3340933248400688, + 0.16714643128216267, + 0.17466977424919605, + 0.033790264278650284, + 2.392370978370309 + ], + "unique_experts": 62, + "load_cv": 0.8119102739485127, + "normalized_load_entropy": 0.9256396115846799, + "max_load_share": 0.05864197530864197 + }, + "full_input": { + "tokens": 133, + "top_k": 6, + "decisions": 798, + "ordered_route_sha256": "20f4dfaf777de86f8625465347851070335d0d297f8dc7bf0c5e8022a24508a0", + "route_weight_sha256": "ba9571bd659a4c5b1868bf588292d7a70cfcae1b5fb2cd6770a1ba31ed1f1a97", + "loads": [ + 6, + 7, + 11, + 6, + 14, + 23, + 1, + 9, + 18, + 8, + 7, + 8, + 22, + 14, + 16, + 12, + 13, + 10, + 24, + 2, + 4, + 6, + 11, + 24, + 8, + 9, + 2, + 8, + 19, + 7, + 44, + 35, + 8, + 8, + 29, + 15, + 3, + 3, + 9, + 7, + 25, + 21, + 8, + 35, + 23, + 14, + 2, + 26, + 0, + 6, + 5, + 4, + 15, + 0, + 6, + 3, + 3, + 14, + 33, + 7, + 5, + 11, + 10, + 32 + ], + "weighted_loads": [ + 0.2698221243917942, + 0.24399676732718945, + 0.610353771597147, + 0.22205823473632336, + 0.6443687863647938, + 1.4055744279175997, + 0.045535389333963394, + 0.4902828112244606, + 1.0040084086358547, + 0.24760824628174305, + 0.22791171353310347, + 0.25914094783365726, + 1.5737382378429174, + 0.9738296493887901, + 0.8195010311901569, + 0.45483011566102505, + 0.9096000790596008, + 0.32092767488211393, + 1.7733359672129154, + 0.0978439673781395, + 0.23356748186051846, + 0.30748196318745613, + 0.46311189234256744, + 2.1608510240912437, + 0.34093304350972176, + 0.38184958323836327, + 0.07927320152521133, + 0.31740204710513353, + 1.335476078093052, + 0.34055429324507713, + 3.2575154416263103, + 2.4670758079737425, + 0.276991268619895, + 0.30998824909329414, + 1.4497049655765295, + 0.962775532156229, + 0.15568234026432037, + 0.4019472673535347, + 0.36609228886663914, + 0.3098218534141779, + 1.2333355210721493, + 0.7965503334999084, + 0.46940887719392776, + 3.341485293582082, + 1.3568727411329746, + 1.1152597796171904, + 0.074746523052454, + 1.4903008043766022, + 0.0, + 0.26922809332609177, + 0.3050876520574093, + 0.218088798224926, + 0.7759040743112564, + 0.0, + 0.3167474428191781, + 0.11600863561034203, + 0.13027304038405418, + 0.880458265542984, + 2.2391514480113983, + 0.3340933248400688, + 0.2043053936213255, + 0.4556926190853119, + 0.5869457460939884, + 2.392370978370309 + ], + "unique_experts": 62, + "load_cv": 0.784517201549711, + "normalized_load_entropy": 0.9302301820701353, + "max_load_share": 0.05513784461152882 + } + }, + "s1_bos": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "b921fccd42b7e478faff6ba7fcb6227cb6c55028ba9e344c3333b29c8cbd6a53", + "route_weight_sha256": "52ef83a25be18565df4e0e0345f5cfbd2f4f990e1eeacc19b4bd7d8e58b50855", + "loads": [ + 7, + 6, + 10, + 4, + 8, + 24, + 1, + 9, + 14, + 3, + 5, + 8, + 21, + 14, + 17, + 3, + 9, + 7, + 12, + 3, + 4, + 5, + 9, + 19, + 7, + 9, + 2, + 6, + 12, + 6, + 39, + 26, + 5, + 8, + 25, + 14, + 3, + 3, + 8, + 7, + 16, + 20, + 9, + 13, + 21, + 14, + 1, + 19, + 1, + 5, + 5, + 3, + 15, + 0, + 2, + 1, + 4, + 15, + 30, + 9, + 4, + 4, + 1, + 34 + ], + "weighted_loads": [ + 0.3111611343920231, + 0.21525362506508827, + 0.564848568290472, + 0.14585067331790924, + 0.4075716994702816, + 1.4715946726500988, + 0.04420653358101845, + 0.4892024081200361, + 0.7899343185126781, + 0.08841624855995178, + 0.15791676938533783, + 0.2901592794805765, + 1.5320145823061466, + 0.9834562502801418, + 0.8517412580549717, + 0.11023739166557789, + 0.38267661444842815, + 0.24384016543626785, + 0.5625502094626427, + 0.1264176443219185, + 0.22763358056545258, + 0.25574972853064537, + 0.38287608325481415, + 1.9160673189908266, + 0.27500998228788376, + 0.38750679790973663, + 0.07792718149721622, + 0.2693423964083195, + 0.8615209981799126, + 0.2834366075694561, + 2.956583011895418, + 2.020190093666315, + 0.1704527549445629, + 0.3126251623034477, + 1.2946444395929575, + 0.8440394215285778, + 0.14641521498560905, + 0.4568600058555603, + 0.319460928440094, + 0.30585831217467785, + 0.7258405517786741, + 0.7573578171432018, + 0.5131410881876945, + 1.037300679832697, + 1.2263987716287374, + 1.122601430863142, + 0.037077490240335464, + 0.9618266150355339, + 0.029746146872639656, + 0.21051958203315735, + 0.2976281866431236, + 0.18619457632303238, + 0.7798123620450497, + 0.0, + 0.06789015419781208, + 0.02790278196334839, + 0.1706904135644436, + 0.9244864322245121, + 2.08678936958313, + 0.4078284241259098, + 0.16367055848240852, + 0.14498996920883656, + 0.0388646125793457, + 2.4758247639983892 + ], + "unique_experts": 63, + "load_cv": 0.8328530852110089, + "normalized_load_entropy": 0.923628931292127, + "max_load_share": 0.06018518518518518 + }, + "full_input": { + "tokens": 149, + "top_k": 6, + "decisions": 894, + "ordered_route_sha256": "f137a3d5e15deab98b1d3f4a267fe02b0ad5a6a63ade1a36db3e738af9e5ebf7", + "route_weight_sha256": "8cf4f8e8a2e5aa58139ce91d865ce9863c63525255539582897e1e92cc68d73a", + "loads": [ + 9, + 7, + 11, + 4, + 19, + 27, + 1, + 11, + 24, + 4, + 8, + 10, + 21, + 14, + 17, + 5, + 27, + 8, + 22, + 4, + 5, + 6, + 11, + 23, + 7, + 9, + 4, + 8, + 22, + 6, + 48, + 33, + 6, + 8, + 29, + 18, + 3, + 3, + 8, + 8, + 25, + 20, + 9, + 41, + 23, + 14, + 2, + 34, + 1, + 8, + 5, + 4, + 15, + 5, + 23, + 8, + 10, + 16, + 32, + 13, + 6, + 14, + 13, + 35 + ], + "weighted_loads": [ + 0.45883743092417717, + 0.24922020360827446, + 0.6115735955536366, + 0.14585067331790924, + 0.9867117218673229, + 1.578775193542242, + 0.04420653358101845, + 0.6184807326644659, + 1.364802997559309, + 0.1222279965877533, + 0.266300099901855, + 0.3319328594952822, + 1.5320145823061466, + 0.9834562502801418, + 0.8517412580549717, + 0.18240597657859325, + 2.039156647399068, + 0.2586766118183732, + 1.7271660007536411, + 0.16529185697436333, + 0.302049919962883, + 0.32758891209959984, + 0.4957219883799553, + 2.0965188052505255, + 0.27500998228788376, + 0.38750679790973663, + 0.15536189638078213, + 0.32044503185898066, + 1.5935120359063148, + 0.2834366075694561, + 3.4012172762304544, + 2.3264180161058903, + 0.20243291556835175, + 0.3126251623034477, + 1.4917061384767294, + 1.1807073950767517, + 0.14641521498560905, + 0.4568600058555603, + 0.319460928440094, + 0.35332915373146534, + 1.2176084239035845, + 0.7573578171432018, + 0.5131410881876945, + 3.956432055681944, + 1.3592294324189425, + 1.122601430863142, + 0.08330962061882019, + 2.000367794185877, + 0.029746146872639656, + 0.43065357208251953, + 0.2976281866431236, + 0.22006257250905037, + 0.7798123620450497, + 0.304266769438982, + 1.3109911819919944, + 0.3617429994046688, + 0.64497010409832, + 0.9673857763409615, + 2.1888823211193085, + 0.5620887652039528, + 0.24161896482110023, + 0.5916640739887953, + 0.653558112680912, + 2.5175109189003706 + ], + "unique_experts": 64, + "load_cv": 0.7503950650022084, + "normalized_load_entropy": 0.9369751592623913, + "max_load_share": 0.053691275167785234 + } + }, + "s0_x": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "b22b21641f5c3c5c096e620c3e3cdef312d3c8d01a30d15f95f0fabf3aa24e18", + "route_weight_sha256": "17af64ce09f7a92072ffdcd9578d2dd146ed279ccfca05878ef7a830320e173e", + "loads": [ + 7, + 7, + 10, + 5, + 9, + 24, + 1, + 8, + 16, + 3, + 7, + 9, + 22, + 14, + 16, + 4, + 6, + 6, + 13, + 2, + 3, + 6, + 11, + 19, + 7, + 8, + 2, + 6, + 13, + 6, + 38, + 26, + 5, + 8, + 25, + 14, + 3, + 3, + 9, + 7, + 15, + 19, + 8, + 14, + 21, + 15, + 2, + 19, + 0, + 5, + 5, + 4, + 15, + 0, + 1, + 2, + 4, + 15, + 31, + 7, + 3, + 4, + 0, + 31 + ], + "weighted_loads": [ + 0.30868928506970406, + 0.25458790361881256, + 0.5744311064481735, + 0.1852784864604473, + 0.42851338163018227, + 1.4657561015337706, + 0.046311236917972565, + 0.5038813017308712, + 0.8620763942599297, + 0.091773621737957, + 0.21899756789207458, + 0.3290175795555115, + 1.5700412672013044, + 0.9795857854187489, + 0.8256922475993633, + 0.15790129452943802, + 0.27639735117554665, + 0.19392192363739014, + 0.618861511349678, + 0.09792307391762733, + 0.19672062061727047, + 0.3096376322209835, + 0.43443541415035725, + 1.9119623228907585, + 0.2938544061034918, + 0.3586503937840462, + 0.08125869557261467, + 0.25564031302928925, + 0.9001188725233078, + 0.31449148431420326, + 2.979152373969555, + 2.0069178491830826, + 0.17828292213380337, + 0.3106217496097088, + 1.2594119440764189, + 0.918931856751442, + 0.15878668054938316, + 0.392919696867466, + 0.38000884279608727, + 0.30474438332021236, + 0.6612514890730381, + 0.7110023126006126, + 0.4648310951888561, + 0.9610134214162827, + 1.2144428342580795, + 1.1232276801019907, + 0.0779171921312809, + 0.985308151692152, + 0.0, + 0.1989203505218029, + 0.30088335648179054, + 0.21025331132113934, + 0.7769626919180155, + 0.0, + 0.04681537300348282, + 0.06695347651839256, + 0.18115928396582603, + 0.9241567477583885, + 2.1148511543869972, + 0.34081369265913963, + 0.12602827697992325, + 0.12562266923487186, + 0.0, + 2.3680364713072777 + ], + "unique_experts": 61, + "load_cv": 0.8234669701556688, + "normalized_load_entropy": 0.9227754263997806, + "max_load_share": 0.05864197530864197 + }, + "full_input": { + "tokens": 133, + "top_k": 6, + "decisions": 798, + "ordered_route_sha256": "c5d7c41a904bdb2bf898cbdbf13c15a6e89e5dedea6a100674bbf79c10fc875e", + "route_weight_sha256": "cf25d4b7c6978968ce2b61fb80fbce2194eccc6b007964ae911587f43add60d7", + "loads": [ + 7, + 8, + 11, + 5, + 13, + 24, + 1, + 8, + 20, + 5, + 9, + 11, + 22, + 14, + 16, + 9, + 11, + 8, + 25, + 2, + 4, + 6, + 11, + 24, + 7, + 8, + 2, + 7, + 20, + 6, + 44, + 36, + 7, + 8, + 30, + 15, + 3, + 3, + 9, + 7, + 22, + 19, + 8, + 36, + 24, + 15, + 2, + 27, + 0, + 9, + 5, + 5, + 15, + 1, + 6, + 4, + 4, + 15, + 35, + 7, + 4, + 9, + 9, + 31 + ], + "weighted_loads": [ + 0.30868928506970406, + 0.2848887462168932, + 0.632716454565525, + 0.1852784864604473, + 0.624772721901536, + 1.4657561015337706, + 0.046311236917972565, + 0.5038813017308712, + 1.0801145657896996, + 0.14942051470279694, + 0.28583505656570196, + 0.37078762613236904, + 1.5700412672013044, + 0.9795857854187489, + 0.8256922475993633, + 0.3598812073469162, + 0.7747757881879807, + 0.24382732901722193, + 1.8783706352114677, + 0.09792307391762733, + 0.22988850437104702, + 0.3096376322209835, + 0.43443541415035725, + 2.160802200436592, + 0.2938544061034918, + 0.3586503937840462, + 0.08125869557261467, + 0.2682318026199937, + 1.4011783972382545, + 0.31449148431420326, + 3.26930970326066, + 2.52169468998909, + 0.2435591034591198, + 0.3106217496097088, + 1.5321622546762228, + 0.997695729136467, + 0.15878668054938316, + 0.392919696867466, + 0.38000884279608727, + 0.30474438332021236, + 1.0052136555314064, + 0.7110023126006126, + 0.4648310951888561, + 3.0762409791350365, + 1.3736535459756851, + 1.1232276801019907, + 0.0779171921312809, + 1.5643043741583824, + 0.0, + 0.38481036201119423, + 0.30088335648179054, + 0.2426136415451765, + 0.7769626919180155, + 0.0542866475880146, + 0.3164754183962941, + 0.14778954163193703, + 0.18115928396582603, + 0.9241567477583885, + 2.311802413314581, + 0.34081369265913963, + 0.16629788279533386, + 0.367341760545969, + 0.4976681098341942, + 2.3680364713072777 + ], + "unique_experts": 63, + "load_cv": 0.798736289980478, + "normalized_load_entropy": 0.9294394575296577, + "max_load_share": 0.05513784461152882 + } + }, + "s1_x": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "dcfa55028b7b7c28f24bdeffc1eadf9acaef47023d01c0f18045966765286ade", + "route_weight_sha256": "c981628662ec0166724b3bdb5324cfe67fd922e6b651b0a03c9ebaa96296bc81", + "loads": [ + 7, + 9, + 10, + 4, + 10, + 23, + 1, + 9, + 16, + 2, + 6, + 11, + 22, + 13, + 17, + 4, + 9, + 5, + 12, + 2, + 3, + 6, + 10, + 19, + 8, + 10, + 3, + 7, + 12, + 6, + 38, + 25, + 4, + 8, + 22, + 14, + 3, + 3, + 6, + 7, + 13, + 18, + 8, + 14, + 21, + 14, + 1, + 19, + 3, + 5, + 5, + 3, + 14, + 0, + 0, + 2, + 4, + 15, + 31, + 7, + 5, + 5, + 1, + 34 + ], + "weighted_loads": [ + 0.313198309391737, + 0.3286888264119625, + 0.585238803178072, + 0.14727822318673134, + 0.47079787217080593, + 1.4780012033879757, + 0.04591882973909378, + 0.5332695357501507, + 0.8978793285787106, + 0.07068737223744392, + 0.1907034758478403, + 0.38901965506374836, + 1.595887403935194, + 0.9740915112197399, + 0.8529753088951111, + 0.13616158068180084, + 0.3690651562064886, + 0.17515900917351246, + 0.5840928331017494, + 0.10600879788398743, + 0.17570779472589493, + 0.305369284003973, + 0.4053732808679342, + 1.9199906568974257, + 0.3193895220756531, + 0.4644246809184551, + 0.11197933554649353, + 0.305967990309, + 0.8340351469814777, + 0.2896220460534096, + 2.895248943939805, + 1.9649463966488838, + 0.14259623922407627, + 0.3043774142861366, + 1.1617134530097246, + 0.848314106464386, + 0.14169637113809586, + 0.48957476764917374, + 0.25916674360632896, + 0.31183312460780144, + 0.5672497805207968, + 0.6527082398533821, + 0.46724607050418854, + 0.8874602913856506, + 1.2095274236053228, + 1.1228254325687885, + 0.038997143507003784, + 1.0284255482256413, + 0.09248008020222187, + 0.20885036140680313, + 0.3005688413977623, + 0.19273022189736366, + 0.7441351413726807, + 0.0, + 0.0, + 0.06814349815249443, + 0.17403999343514442, + 0.9271677322685719, + 2.105652906000614, + 0.3339001499116421, + 0.19115419872105122, + 0.1729426495730877, + 0.025006093084812164, + 2.520173041149974 + ], + "unique_experts": 62, + "load_cv": 0.81359804398002, + "normalized_load_entropy": 0.9258955258091218, + "max_load_share": 0.05864197530864197 + }, + "full_input": { + "tokens": 149, + "top_k": 6, + "decisions": 894, + "ordered_route_sha256": "127c73016d82cd01ea8368e0a35dc66c088edcc6212e6c4eef3ec5a4378d026c", + "route_weight_sha256": "1ba3705ec720f2f8efa669f70f9af5212ae41165c5febb6e6719a779f21248f0", + "loads": [ + 9, + 10, + 11, + 4, + 21, + 26, + 1, + 11, + 26, + 2, + 9, + 13, + 22, + 13, + 17, + 5, + 27, + 6, + 23, + 3, + 4, + 7, + 12, + 23, + 8, + 11, + 5, + 10, + 23, + 6, + 47, + 33, + 5, + 8, + 28, + 19, + 3, + 3, + 6, + 8, + 18, + 18, + 8, + 41, + 23, + 14, + 2, + 32, + 3, + 10, + 5, + 3, + 14, + 6, + 21, + 10, + 10, + 16, + 34, + 11, + 7, + 13, + 12, + 35 + ], + "weighted_loads": [ + 0.46087460592389107, + 0.3626554049551487, + 0.6319638304412365, + 0.14727822318673134, + 1.0499378945678473, + 1.585181724280119, + 0.04591882973909378, + 0.6625478602945805, + 1.4733489193022251, + 0.07068737223744392, + 0.29908680636435747, + 0.430793235078454, + 1.595887403935194, + 0.9740915112197399, + 0.8529753088951111, + 0.17701226845383644, + 1.948160471394658, + 0.1899954555556178, + 1.8264912776648998, + 0.14488301053643227, + 0.25012413412332535, + 0.3772084675729275, + 0.5182191859930754, + 2.1004421431571245, + 0.3193895220756531, + 0.5027577318251133, + 0.18941405043005943, + 0.4009524257853627, + 1.665186420083046, + 0.2896220460534096, + 3.3398832082748413, + 2.3210678435862064, + 0.1745763998478651, + 0.3043774142861366, + 1.462972892448306, + 1.216749094426632, + 0.14169637113809586, + 0.48957476764917374, + 0.25916674360632896, + 0.35930396616458893, + 0.796768868342042, + 0.6527082398533821, + 0.46724607050418854, + 3.2841065637767315, + 1.3423580843955278, + 1.1228254325687885, + 0.08522927388548851, + 1.9838869124650955, + 0.09248008020222187, + 0.5142852030694485, + 0.3005688413977623, + 0.19273022189736366, + 0.7441351413726807, + 0.3555064834654331, + 1.2439184347167611, + 0.4499194137752056, + 0.6483196839690208, + 0.9700670763850212, + 2.255096897482872, + 0.48816049098968506, + 0.2691142652183771, + 0.5448019728064537, + 0.6111165434122086, + 2.5618591960519552 + ], + "unique_experts": 64, + "load_cv": 0.7386718367846091, + "normalized_load_entropy": 0.938635121414218, + "max_load_share": 0.052572706935123045 + } + }, + "s0_period": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "514ad32a38c081d2b498e901bca446e884386f73d24a6033cc4e4deedc33e7c0", + "route_weight_sha256": "d4df868ba28ea5175650a82a645b227c8b974b35655ee59ad5d9efdb4f079c5e", + "loads": [ + 7, + 5, + 10, + 4, + 9, + 23, + 1, + 8, + 16, + 4, + 6, + 7, + 22, + 14, + 16, + 4, + 7, + 5, + 14, + 2, + 4, + 6, + 11, + 19, + 8, + 10, + 2, + 6, + 13, + 6, + 38, + 26, + 5, + 8, + 27, + 14, + 3, + 3, + 9, + 7, + 15, + 18, + 8, + 15, + 20, + 15, + 2, + 19, + 2, + 5, + 5, + 4, + 15, + 0, + 1, + 2, + 3, + 14, + 30, + 7, + 3, + 5, + 0, + 31 + ], + "weighted_loads": [ + 0.3127339668571949, + 0.18203395418822765, + 0.5888918116688728, + 0.14526064321398735, + 0.4334561228752136, + 1.4476943332701921, + 0.046124331653118134, + 0.4985354654490948, + 0.8665079846978188, + 0.12085096165537834, + 0.18656251765787601, + 0.26103828474879265, + 1.5668610017746687, + 0.9724827781319618, + 0.8148948326706886, + 0.15695935487747192, + 0.3239291198551655, + 0.1619936339557171, + 0.6512090060859919, + 0.0992276705801487, + 0.22500121407210827, + 0.30702609196305275, + 0.4508467372506857, + 1.9083624929189682, + 0.3405277207493782, + 0.4426974281668663, + 0.08012795448303223, + 0.25925343856215477, + 0.9505524821579456, + 0.30600927770137787, + 2.9599212780594826, + 1.980514120310545, + 0.17917305789887905, + 0.31147200241684914, + 1.31342569924891, + 0.8895333483815193, + 0.15976805612444878, + 0.39987484365701675, + 0.36975861340761185, + 0.3050926011055708, + 0.6451773438602686, + 0.6676610056310892, + 0.4692965894937515, + 1.0139658376574516, + 1.1771493516862392, + 1.1372944302856922, + 0.07692825049161911, + 0.9983056522905827, + 0.06577617861330509, + 0.19074030593037605, + 0.3021818734705448, + 0.2079368270933628, + 0.7755156606435776, + 0.0, + 0.03483450785279274, + 0.06686127558350563, + 0.13378551602363586, + 0.8817973658442497, + 2.120040852576494, + 0.3306894637644291, + 0.12625467777252197, + 0.17504266649484634, + 0.0, + 2.40895264595747 + ], + "unique_experts": 62, + "load_cv": 0.8178954111136734, + "normalized_load_entropy": 0.9249222163125681, + "max_load_share": 0.05864197530864197 + }, + "full_input": { + "tokens": 133, + "top_k": 6, + "decisions": 798, + "ordered_route_sha256": "b97d717493fbe28723846c1eb5bf0482db98aa82baecd48618fc34a327ea09ef", + "route_weight_sha256": "2e2a2e230987b086c1da48f1165eb6b94d4b587de0cdbd2d90bb48c05cb72eb7", + "loads": [ + 7, + 6, + 11, + 4, + 15, + 23, + 1, + 8, + 20, + 6, + 8, + 9, + 22, + 14, + 16, + 10, + 12, + 6, + 26, + 2, + 5, + 6, + 11, + 24, + 8, + 10, + 2, + 7, + 21, + 6, + 44, + 36, + 7, + 8, + 31, + 17, + 3, + 3, + 9, + 7, + 22, + 18, + 8, + 38, + 23, + 15, + 2, + 27, + 2, + 8, + 5, + 5, + 15, + 0, + 6, + 4, + 3, + 14, + 33, + 7, + 4, + 10, + 7, + 31 + ], + "weighted_loads": [ + 0.3127339668571949, + 0.2123347967863083, + 0.6471771597862244, + 0.14526064321398735, + 0.742910772562027, + 1.4476943332701921, + 0.046124331653118134, + 0.4985354654490948, + 1.0855755247175694, + 0.17849785462021828, + 0.2534000063315034, + 0.3028083313256502, + 1.5668610017746687, + 0.9724827781319618, + 0.8148948326706886, + 0.3996459059417248, + 0.8363633379340172, + 0.17683008033782244, + 1.8627283219248056, + 0.0992276705801487, + 0.2568086255341768, + 0.30702609196305275, + 0.4508467372506857, + 2.157202370464802, + 0.3405277207493782, + 0.4426974281668663, + 0.08012795448303223, + 0.2718449281528592, + 1.487995222210884, + 0.30600927770137787, + 3.250078607350588, + 2.5007284693419933, + 0.24444923922419548, + 0.31147200241684914, + 1.509567292407155, + 1.152592457830906, + 0.15976805612444878, + 0.39987484365701675, + 0.36975861340761185, + 0.3050926011055708, + 0.9882307816296816, + 0.6676610056310892, + 0.4692965894937515, + 3.2247580885887146, + 1.3363600634038448, + 1.1372944302856922, + 0.07692825049161911, + 1.5613818690180779, + 0.06577617861330509, + 0.33660146594047546, + 0.3021818734705448, + 0.241900522261858, + 0.7755156606435776, + 0.0, + 0.30702164117246866, + 0.14845485612750053, + 0.13378551602363586, + 0.8817973658442497, + 2.2568803876638412, + 0.3306894637644291, + 0.1664237566292286, + 0.4160529989749193, + 0.4231136105954647, + 2.40895264595747 + ], + "unique_experts": 63, + "load_cv": 0.8038786072510478, + "normalized_load_entropy": 0.9287932265657872, + "max_load_share": 0.05513784461152882 + } + }, + "s1_period": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "f63a150d2705b23109ba7f8e5723bd558bfe6ff58fe994dc869f4728228f162a", + "route_weight_sha256": "881838a3bc945fe0e1d2ec81e1b39509fa63d7ace5f09059080f3bff60713340", + "loads": [ + 7, + 6, + 10, + 4, + 9, + 23, + 1, + 8, + 17, + 1, + 3, + 8, + 22, + 13, + 19, + 5, + 9, + 6, + 12, + 2, + 3, + 6, + 9, + 19, + 7, + 10, + 3, + 6, + 15, + 7, + 37, + 26, + 6, + 8, + 22, + 14, + 3, + 3, + 5, + 7, + 13, + 16, + 8, + 14, + 22, + 15, + 1, + 19, + 3, + 4, + 5, + 4, + 15, + 0, + 2, + 2, + 4, + 15, + 31, + 9, + 6, + 5, + 1, + 33 + ], + "weighted_loads": [ + 0.30955058708786964, + 0.21317559480667114, + 0.601954884827137, + 0.14758525416254997, + 0.45025093108415604, + 1.4556342400610447, + 0.046020254492759705, + 0.48661645874381065, + 0.9147042203694582, + 0.027951586991548538, + 0.09574778378009796, + 0.30570992082357407, + 1.5803326424211264, + 0.9711715411394835, + 0.9333269707858562, + 0.18413966335356236, + 0.37282690219581127, + 0.206576531752944, + 0.5807527806609869, + 0.1028292067348957, + 0.17480255290865898, + 0.3019447363913059, + 0.39564456418156624, + 1.9239339232444763, + 0.2762259244918823, + 0.46580488234758377, + 0.11004140600562096, + 0.26371437311172485, + 0.9798966497182846, + 0.32898388616740704, + 2.8291532658040524, + 2.0190693959593773, + 0.20065679587423801, + 0.29727470502257347, + 1.1754114292562008, + 0.8365161903202534, + 0.1390957199037075, + 0.48713798075914383, + 0.21715329587459564, + 0.3119150847196579, + 0.5640216395258904, + 0.5923301689326763, + 0.4644267074763775, + 0.9316998980939388, + 1.2477580308914185, + 1.151369959115982, + 0.038205020129680634, + 0.9996034726500511, + 0.09325654804706573, + 0.16970088332891464, + 0.2989369370043278, + 0.211667250841856, + 0.7603964414447546, + 0.0, + 0.07532282173633575, + 0.07144209370017052, + 0.175591129809618, + 0.9261474385857582, + 2.1021618898957968, + 0.40108896791934967, + 0.2189898695796728, + 0.17587743513286114, + 0.025298699736595154, + 2.4814158622175455 + ], + "unique_experts": 63, + "load_cv": 0.81359804398002, + "normalized_load_entropy": 0.9263875158907261, + "max_load_share": 0.05709876543209876 + }, + "full_input": { + "tokens": 149, + "top_k": 6, + "decisions": 894, + "ordered_route_sha256": "e121faa8c7bc18774c37b3e12e0e4549a5aa99094d4a4d398ef4ef5586d81fd8", + "route_weight_sha256": "2b8b4a0a474e37a3fcd6f4e1ef45a5a38af98d1d550d0add1b7d42133069c42d", + "loads": [ + 9, + 7, + 11, + 4, + 21, + 27, + 1, + 10, + 27, + 1, + 6, + 10, + 22, + 13, + 20, + 7, + 27, + 7, + 22, + 3, + 4, + 7, + 11, + 23, + 7, + 11, + 5, + 8, + 27, + 7, + 46, + 34, + 7, + 8, + 28, + 20, + 3, + 3, + 5, + 8, + 19, + 16, + 8, + 41, + 24, + 15, + 2, + 33, + 3, + 8, + 5, + 4, + 15, + 5, + 22, + 9, + 10, + 16, + 33, + 13, + 8, + 13, + 11, + 34 + ], + "weighted_loads": [ + 0.4572268836200237, + 0.24714217334985733, + 0.6486799120903015, + 0.14758525416254997, + 1.0945502743124962, + 1.6070413812994957, + 0.046020254492759705, + 0.6158947832882404, + 1.48604984767735, + 0.027951586991548538, + 0.20413111429661512, + 0.3474835008382797, + 1.5803326424211264, + 0.9711715411394835, + 0.9732805043458939, + 0.25779095105826855, + 1.9731666129082441, + 0.22141297813504934, + 1.7453685719519854, + 0.14170341938734055, + 0.2492188923060894, + 0.3737839199602604, + 0.5084904693067074, + 2.104385409504175, + 0.2762259244918823, + 0.504753228276968, + 0.18747612088918686, + 0.31481700856238604, + 1.8730388060212135, + 0.32898388616740704, + 3.2737875301390886, + 2.363577224314213, + 0.23263695649802685, + 0.29727470502257347, + 1.4620631821453571, + 1.299442682415247, + 0.1390957199037075, + 0.48713798075914383, + 0.21715329587459564, + 0.3593859262764454, + 0.8210460059344769, + 0.5923301689326763, + 0.4644267074763775, + 3.3793171234428883, + 1.3805886916816235, + 1.151369959115982, + 0.08443715050816536, + 1.9975050203502178, + 0.09325654804706573, + 0.4310813546180725, + 0.2989369370043278, + 0.211667250841856, + 0.7603964414447546, + 0.304266769438982, + 1.2767209829762578, + 0.40528231114149094, + 0.6498708203434944, + 0.9690467827022076, + 2.2042548414319754, + 0.5553493089973927, + 0.29471334628760815, + 0.55221994407475, + 0.5466568656265736, + 2.523102017119527 + ], + "unique_experts": 64, + "load_cv": 0.7500748594250298, + "normalized_load_entropy": 0.9364140239205975, + "max_load_share": 0.05145413870246085 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 108, + "ordered_topk_exact_tokens": 62, + "set_exact_tokens": 75, + "mean_set_jaccard": 0.9087301587301588, + "mean_token_weighted_tv": 0.016454734899862496, + "aggregate_load_tv": 0.037037037037037035 + }, + "system_bos": { + "tokens": 108, + "ordered_topk_exact_tokens": 65, + "set_exact_tokens": 79, + "mean_set_jaccard": 0.9173280423280424, + "mean_token_weighted_tv": 0.017075064040168567, + "aggregate_load_tv": 0.035493827160493825 + }, + "system_x": { + "tokens": 108, + "ordered_topk_exact_tokens": 54, + "set_exact_tokens": 73, + "mean_set_jaccard": 0.8974867724867727, + "mean_token_weighted_tv": 0.02173047979293322, + "aggregate_load_tv": 0.038580246913580245 + }, + "system_period": { + "tokens": 108, + "ordered_topk_exact_tokens": 51, + "set_exact_tokens": 68, + "mean_set_jaccard": 0.8862433862433863, + "mean_token_weighted_tv": 0.02211306146690967, + "aggregate_load_tv": 0.046296296296296294 + }, + "bos_at_s0": { + "tokens": 108, + "ordered_topk_exact_tokens": 57, + "set_exact_tokens": 65, + "mean_set_jaccard": 0.8767636684303353, + "mean_token_weighted_tv": 0.022928161658691586, + "aggregate_load_tv": 0.047839506172839504 + }, + "bos_at_s1": { + "tokens": 108, + "ordered_topk_exact_tokens": 43, + "set_exact_tokens": 59, + "mean_set_jaccard": 0.8593474426807761, + "mean_token_weighted_tv": 0.026486767524922336, + "aggregate_load_tv": 0.0478395061728395 + }, + "x_at_s0": { + "tokens": 108, + "ordered_topk_exact_tokens": 55, + "set_exact_tokens": 66, + "mean_set_jaccard": 0.8758818342151676, + "mean_token_weighted_tv": 0.02424545768061998, + "aggregate_load_tv": 0.05555555555555555 + }, + "x_at_s1": { + "tokens": 108, + "ordered_topk_exact_tokens": 42, + "set_exact_tokens": 59, + "mean_set_jaccard": 0.8569223985890652, + "mean_token_weighted_tv": 0.02849482899290268, + "aggregate_load_tv": 0.055555555555555546 + }, + "period_at_s0": { + "tokens": 108, + "ordered_topk_exact_tokens": 52, + "set_exact_tokens": 64, + "mean_set_jaccard": 0.8721340388007056, + "mean_token_weighted_tv": 0.02488494271205531, + "aggregate_load_tv": 0.04938271604938271 + }, + "period_at_s1": { + "tokens": 108, + "ordered_topk_exact_tokens": 43, + "set_exact_tokens": 57, + "mean_set_jaccard": 0.8461199294532631, + "mean_token_weighted_tv": 0.029750410346659244, + "aggregate_load_tv": 0.0632716049382716 + } + } + }, + "layer_12": { + "layer": 12, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "6df4f9c93076afefd50d1a1f9db5c0a06e537ed95b9282ea143728b8b98a0951", + "route_weight_sha256": "18c5c12d00d5afa5bd6366775f1ab4eec633f5e1e0090b9c7b990f498937da21", + "loads": [ + 3, + 7, + 14, + 9, + 25, + 5, + 3, + 17, + 17, + 3, + 11, + 7, + 12, + 3, + 5, + 8, + 21, + 0, + 13, + 13, + 5, + 8, + 15, + 22, + 6, + 1, + 5, + 37, + 32, + 18, + 5, + 8, + 13, + 4, + 7, + 10, + 6, + 4, + 19, + 1, + 6, + 12, + 6, + 18, + 5, + 3, + 26, + 7, + 13, + 5, + 4, + 3, + 21, + 1, + 26, + 4, + 3, + 4, + 30, + 6, + 5, + 9, + 3, + 6 + ], + "weighted_loads": [ + 0.1445353925228119, + 0.3700781539082527, + 0.7207417767494917, + 0.3498199339956045, + 1.776164885610342, + 0.18858760222792625, + 0.12747382372617722, + 1.0930373184382915, + 0.9071105644106865, + 0.09468836896121502, + 0.5045228134840727, + 0.3234784547239542, + 0.47512216307222843, + 0.1260208748281002, + 0.33574574813246727, + 0.5773971267044544, + 1.016660375520587, + 0.0, + 1.1003221049904823, + 0.5427919458597898, + 0.3803433049470186, + 0.5027759335935116, + 0.7687787804752588, + 1.2047564536333084, + 0.45573295652866364, + 0.03614775463938713, + 0.22183800488710403, + 3.3761726301163435, + 2.4966086745262146, + 1.5875440426170826, + 0.2036944441497326, + 0.2901976313441992, + 0.877742238342762, + 0.17346149310469627, + 0.6023934595286846, + 0.4394165053963661, + 0.4366063140332699, + 0.16508211754262447, + 0.9108395874500275, + 0.07424633949995041, + 0.590092770755291, + 0.5724127292633057, + 0.28767151199281216, + 1.0096270442008972, + 0.1929926909506321, + 0.21258791908621788, + 2.043026342988014, + 0.2652294337749481, + 0.5702603980898857, + 0.2094075046479702, + 0.47087500989437103, + 0.13156646117568016, + 1.2262164521962404, + 0.07083966583013535, + 1.7003114689141512, + 0.16108015924692154, + 0.12506035901606083, + 0.17295201495289803, + 2.0997176319360733, + 0.21479507721960545, + 0.3002357427030802, + 0.5360695421695709, + 0.2241717204451561, + 0.3255460858345032 + ], + "unique_experts": 63, + "load_cv": 0.8178954111136734, + "normalized_load_entropy": 0.9274896525125033, + "max_load_share": 0.05709876543209876 + }, + "full_input": { + "tokens": 133, + "top_k": 6, + "decisions": 798, + "ordered_route_sha256": "02c94507f98ea8827778c12b0f5357c3b2f675411608c28fae0c84492f9f96e3", + "route_weight_sha256": "8fc30c7dc883b7ce6455fcca1b248ac7da914fd0329175d59444d3fe26aec6f3", + "loads": [ + 3, + 7, + 14, + 14, + 27, + 6, + 3, + 20, + 23, + 3, + 11, + 7, + 17, + 3, + 5, + 8, + 26, + 0, + 13, + 13, + 6, + 8, + 16, + 27, + 6, + 1, + 6, + 45, + 46, + 30, + 8, + 14, + 14, + 6, + 7, + 17, + 6, + 8, + 34, + 1, + 6, + 17, + 10, + 18, + 7, + 4, + 26, + 13, + 17, + 5, + 5, + 3, + 21, + 1, + 26, + 4, + 6, + 5, + 32, + 9, + 5, + 13, + 7, + 9 + ], + "weighted_loads": [ + 0.1445353925228119, + 0.3700781539082527, + 0.7207417767494917, + 0.47044701944105327, + 3.329083200544119, + 0.19267653860151768, + 0.12747382372617722, + 1.2963055334985256, + 1.2892661541700363, + 0.09468836896121502, + 0.5045228134840727, + 0.3234784547239542, + 0.7385121155530214, + 0.1260208748281002, + 0.33574574813246727, + 0.5773971267044544, + 1.2792232986539602, + 0.0, + 1.1003221049904823, + 0.5427919458597898, + 0.38266690191812813, + 0.5027759335935116, + 0.8186186570674181, + 1.6614733189344406, + 0.45573295652866364, + 0.03614775463938713, + 0.25467418506741524, + 3.7935606986284256, + 4.303101867437363, + 3.2393199801445007, + 0.3107219720259309, + 0.5995896104723215, + 0.9241409823298454, + 0.2686692364513874, + 0.6023934595286846, + 0.9358743168413639, + 0.4366063140332699, + 0.27891726791858673, + 2.03128007799387, + 0.07424633949995041, + 0.590092770755291, + 1.0954722166061401, + 0.5673299822956324, + 1.0096270442008972, + 0.30484333261847496, + 0.2518259063363075, + 2.043026342988014, + 0.6010564491152763, + 0.7525804191827774, + 0.2094075046479702, + 0.4837998300790787, + 0.13156646117568016, + 1.2262164521962404, + 0.07083966583013535, + 1.7003114689141512, + 0.16108015924692154, + 0.23182622389867902, + 0.20231704786419868, + 2.2435955181717873, + 0.3083105720579624, + 0.3002357427030802, + 0.692968524992466, + 0.37203176878392696, + 0.42008502408862114 + ], + "unique_experts": 63, + "load_cv": 0.8205829166748926, + "normalized_load_entropy": 0.9269568889400451, + "max_load_share": 0.05764411027568922 + } + }, + "s1_eos": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "2d1c21227f5f7f2b406dba5faf3a4afa0d6a9a3d3160bdba0d05ee9de0972c94", + "route_weight_sha256": "0ac35fc31f9c27cba41b0bb6114a7b1accde166d8ad5aee9c7dc9ea76cf526db", + "loads": [ + 3, + 7, + 15, + 10, + 24, + 6, + 3, + 18, + 15, + 4, + 12, + 5, + 13, + 2, + 5, + 8, + 20, + 1, + 13, + 14, + 5, + 8, + 14, + 22, + 6, + 2, + 7, + 36, + 32, + 18, + 6, + 7, + 13, + 2, + 8, + 8, + 8, + 3, + 19, + 1, + 6, + 12, + 6, + 18, + 5, + 3, + 26, + 7, + 13, + 4, + 4, + 2, + 21, + 2, + 26, + 4, + 3, + 5, + 30, + 6, + 3, + 9, + 4, + 6 + ], + "weighted_loads": [ + 0.1391572318971157, + 0.36249079555273056, + 0.7482178211212158, + 0.39022953622043133, + 1.7587569952011108, + 0.22080344334244728, + 0.13632328808307648, + 1.1525378860533237, + 0.8460553549230099, + 0.12454291619360447, + 0.5427489671856165, + 0.22828260622918606, + 0.5127829741686583, + 0.09575921669602394, + 0.3475196547806263, + 0.6120259091258049, + 0.9837628304958344, + 0.030275316908955574, + 1.1017830036580563, + 0.55933434702456, + 0.3681226223707199, + 0.49622518196702003, + 0.7538696639239788, + 1.1950741987675428, + 0.450232345610857, + 0.06825020536780357, + 0.30095481127500534, + 3.3195987977087498, + 2.529748857021332, + 1.4974560774862766, + 0.22861971147358418, + 0.2792082726955414, + 0.8623781837522984, + 0.09825995191931725, + 0.6605102494359016, + 0.3674475699663162, + 0.49028113298118114, + 0.11125890910625458, + 0.8941154330968857, + 0.07384364306926727, + 0.592497956007719, + 0.5592251718044281, + 0.2959875073283911, + 0.9994630590081215, + 0.18793904036283493, + 0.21467846632003784, + 2.0359153635799885, + 0.2731587402522564, + 0.5770454555749893, + 0.1820227950811386, + 0.4522690027952194, + 0.10343713499605656, + 1.2224313076585531, + 0.0963942389935255, + 1.6985875703394413, + 0.1609073393046856, + 0.12620952352881432, + 0.19558137096464634, + 2.109698563814163, + 0.21478349715471268, + 0.21722502261400223, + 0.5408882461488247, + 0.24748509749770164, + 0.3265894129872322 + ], + "unique_experts": 64, + "load_cv": 0.8077697680471897, + "normalized_load_entropy": 0.9295242811542039, + "max_load_share": 0.05555555555555555 + }, + "full_input": { + "tokens": 149, + "top_k": 6, + "decisions": 894, + "ordered_route_sha256": "34162793cee2e46488ebae2b092b617f2cbb08272d16bd3909a2004a7a70cc37", + "route_weight_sha256": "7aaf464b804b8ebe7d6887182641ed0c332145d32052e8f2cf79cf2696dc82e8", + "loads": [ + 7, + 7, + 15, + 13, + 28, + 7, + 3, + 25, + 22, + 7, + 13, + 5, + 17, + 2, + 5, + 8, + 26, + 3, + 14, + 14, + 6, + 10, + 16, + 28, + 6, + 2, + 10, + 43, + 48, + 35, + 17, + 14, + 17, + 7, + 13, + 14, + 8, + 7, + 38, + 1, + 6, + 23, + 13, + 20, + 18, + 7, + 29, + 14, + 20, + 4, + 6, + 2, + 21, + 5, + 26, + 5, + 6, + 9, + 32, + 10, + 5, + 17, + 9, + 6 + ], + "weighted_loads": [ + 0.32968800887465477, + 0.36249079555273056, + 0.7482178211212158, + 0.4488327407743782, + 3.378482796251774, + 0.2247341782785952, + 0.13632328808307648, + 1.535194594413042, + 1.371303927153349, + 0.44545249827206135, + 0.5844054352492094, + 0.22828260622918606, + 0.7087185364216566, + 0.09575921669602394, + 0.3475196547806263, + 0.6120259091258049, + 1.3530914336442947, + 0.14221561141312122, + 1.1373255252838135, + 0.55933434702456, + 0.3704563593491912, + 0.5869633257389069, + 0.8406890034675598, + 1.6521272864192724, + 0.450232345610857, + 0.06825020536780357, + 0.4234980009496212, + 3.6753556355834007, + 4.636061888188124, + 3.9494045935571194, + 1.0823023011907935, + 0.6078886948525906, + 1.040524760261178, + 0.3991596959531307, + 0.9160619713366032, + 0.8993713557720184, + 0.49028113298118114, + 0.28354430198669434, + 2.3032365888357162, + 0.07384364306926727, + 0.592497956007719, + 1.5811907164752483, + 0.6962987743318081, + 1.1105033345520496, + 1.3944914899766445, + 0.5265982188284397, + 2.15903914347291, + 0.6690090205520391, + 0.8996076472103596, + 0.1820227950811386, + 0.5178300142288208, + 0.10343713499605656, + 1.2224313076585531, + 0.25507435388863087, + 1.6985875703394413, + 0.19221414998173714, + 0.20585956750437617, + 0.38380659930408, + 2.2635217905044556, + 0.3362453645095229, + 0.2868427745997906, + 0.9439144283533096, + 0.4708208329975605, + 0.3265894129872322 + ], + "unique_experts": 64, + "load_cv": 0.745255266448095, + "normalized_load_entropy": 0.9387063551424274, + "max_load_share": 0.053691275167785234 + } + }, + "s0_bos": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "f7a0e78f632d314757f3f72962f506f16d3f649be388aa1ce7f68131d6747fa4", + "route_weight_sha256": "2de39354e49ede219c3a7d22032a0c4d0d7798ee3fa52647858a37d466508184", + "loads": [ + 3, + 7, + 15, + 8, + 17, + 5, + 3, + 17, + 15, + 3, + 12, + 6, + 14, + 1, + 4, + 8, + 22, + 1, + 12, + 16, + 5, + 8, + 15, + 22, + 7, + 2, + 6, + 37, + 33, + 19, + 3, + 9, + 14, + 3, + 8, + 10, + 7, + 3, + 18, + 1, + 7, + 14, + 5, + 18, + 5, + 3, + 26, + 6, + 11, + 6, + 4, + 3, + 22, + 1, + 26, + 5, + 4, + 4, + 32, + 4, + 4, + 9, + 4, + 6 + ], + "weighted_loads": [ + 0.14325041323900223, + 0.3821157105267048, + 0.7513123452663422, + 0.32440752536058426, + 1.5143068917095661, + 0.17805136367678642, + 0.13811440765857697, + 1.1262828074395657, + 0.8172052428126335, + 0.0913581196218729, + 0.5481568686664104, + 0.2908785417675972, + 0.5873922407627106, + 0.041330307722091675, + 0.291227575391531, + 0.5777560211718082, + 1.1061083748936653, + 0.032288867980241776, + 1.0832985825836658, + 0.6681071873754263, + 0.3752308376133442, + 0.4976978152990341, + 0.7957705203443766, + 1.1969602685421705, + 0.48885655030608177, + 0.0713815800845623, + 0.23664010874927044, + 3.4558033384382725, + 2.4852828420698643, + 1.5912515632808208, + 0.1296464465558529, + 0.3455886710435152, + 0.9420216493308544, + 0.1252087652683258, + 0.649366021156311, + 0.442225256934762, + 0.4734226353466511, + 0.12822585552930832, + 0.8335484769195318, + 0.07603055238723755, + 0.5654596332460642, + 0.6877515520900488, + 0.267720028758049, + 1.007827389985323, + 0.20208784192800522, + 0.2122335582971573, + 2.076570589095354, + 0.24710924923419952, + 0.5074685998260975, + 0.2591905780136585, + 0.45886368677020073, + 0.1392772626131773, + 1.2649985328316689, + 0.07281091064214706, + 1.7565014604479074, + 0.1975397691130638, + 0.15543986670672894, + 0.16498246416449547, + 2.208790138363838, + 0.14188003167510033, + 0.26856260001659393, + 0.551927799358964, + 0.23025729320943356, + 0.3338961564004421 + ], + "unique_experts": 64, + "load_cv": 0.8236520397096756, + "normalized_load_entropy": 0.9269879455411987, + "max_load_share": 0.05709876543209876 + }, + "full_input": { + "tokens": 133, + "top_k": 6, + "decisions": 798, + "ordered_route_sha256": "e0db897b060f1ece45ccd795397ee60a85098227c322fdb4b17a27fb789a166c", + "route_weight_sha256": "6cf48882099c48ce9e8fc61c18ecbfb272b95e0f9c28780006b82b9f00c9348b", + "loads": [ + 4, + 7, + 15, + 12, + 18, + 5, + 3, + 20, + 22, + 3, + 12, + 6, + 20, + 1, + 4, + 8, + 27, + 1, + 12, + 16, + 5, + 8, + 16, + 28, + 7, + 2, + 8, + 45, + 49, + 31, + 5, + 16, + 15, + 5, + 8, + 17, + 7, + 7, + 33, + 1, + 7, + 19, + 8, + 18, + 7, + 4, + 26, + 11, + 14, + 6, + 5, + 3, + 22, + 1, + 26, + 5, + 6, + 5, + 35, + 7, + 4, + 13, + 8, + 9 + ], + "weighted_loads": [ + 0.19806677848100662, + 0.3821157105267048, + 0.7513123452663422, + 0.441915662959218, + 2.117151666432619, + 0.17805136367678642, + 0.13811440765857697, + 1.3329177796840668, + 1.2944600135087967, + 0.0913581196218729, + 0.5481568686664104, + 0.2908785417675972, + 0.9394455142319202, + 0.041330307722091675, + 0.291227575391531, + 0.5777560211718082, + 1.3308457434177399, + 0.032288867980241776, + 1.0832985825836658, + 0.6681071873754263, + 0.3752308376133442, + 0.4976978152990341, + 0.8456103969365358, + 1.6986278798431158, + 0.48885655030608177, + 0.0713815800845623, + 0.31180492229759693, + 3.8731914069503546, + 4.330834165215492, + 3.382028039544821, + 0.19276770297437906, + 0.711956886574626, + 0.9884203933179379, + 0.21777250245213509, + 0.649366021156311, + 0.9386830683797598, + 0.4734226353466511, + 0.24206100590527058, + 1.9780152421444654, + 0.07603055238723755, + 0.5654596332460642, + 1.1493173856288195, + 0.5111488066613674, + 1.007827389985323, + 0.315163042396307, + 0.25147154554724693, + 2.076570589095354, + 0.5143886767327785, + 0.6464567482471466, + 0.2591905780136585, + 0.47178850695490837, + 0.1392772626131773, + 1.2649985328316689, + 0.07281091064214706, + 1.7565014604479074, + 0.1975397691130638, + 0.2575956676155329, + 0.1992083601653576, + 2.3920997455716133, + 0.28503743279725313, + 0.26856260001659393, + 0.708826782181859, + 0.3781173415482044, + 0.4284350946545601 + ], + "unique_experts": 64, + "load_cv": 0.8392323293163267, + "normalized_load_entropy": 0.9253121617446427, + "max_load_share": 0.06140350877192982 + } + }, + "s1_bos": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "4510afd82b9daace73c8c0827ef77c248c6b1661737af619dd74f9aa6a4a58e4", + "route_weight_sha256": "24f650b08e1079dd9bc8e79fe64325e08f102e67ad8db9add4ea2e33fb0a24f0", + "loads": [ + 3, + 5, + 16, + 8, + 21, + 4, + 3, + 17, + 14, + 3, + 12, + 8, + 14, + 2, + 4, + 7, + 21, + 1, + 13, + 15, + 5, + 8, + 16, + 23, + 6, + 1, + 7, + 38, + 33, + 18, + 5, + 9, + 14, + 5, + 7, + 9, + 6, + 2, + 17, + 1, + 6, + 14, + 5, + 18, + 5, + 3, + 26, + 7, + 13, + 5, + 5, + 3, + 21, + 1, + 26, + 5, + 3, + 2, + 31, + 6, + 3, + 9, + 4, + 6 + ], + "weighted_loads": [ + 0.14323049411177635, + 0.2973695993423462, + 0.7829578127712011, + 0.3130674120038748, + 1.6158809810876846, + 0.15424568206071854, + 0.13791949301958084, + 1.1252272091805935, + 0.7787114568054676, + 0.08833234757184982, + 0.5497953370213509, + 0.3494878299534321, + 0.591947365552187, + 0.08750443533062935, + 0.31030086800456047, + 0.5756820514798164, + 1.0393423195928335, + 0.03256918489933014, + 1.1218474730849266, + 0.6029265895485878, + 0.35292751155793667, + 0.47478748485445976, + 0.8313991688191891, + 1.2584934812039137, + 0.4496738463640213, + 0.03571556508541107, + 0.27222445234656334, + 3.4904131926596165, + 2.520760027691722, + 1.489838257431984, + 0.1945471465587616, + 0.3544322997331619, + 0.9686799515038729, + 0.20112586580216885, + 0.5903940983116627, + 0.38738654367625713, + 0.4376906752586365, + 0.08183016814291477, + 0.7695209309458733, + 0.07205662131309509, + 0.5511906631290913, + 0.7057608719915152, + 0.27804800495505333, + 0.973565511405468, + 0.18587502464652061, + 0.21307473629713058, + 2.045996643602848, + 0.2693461813032627, + 0.587098179385066, + 0.21336056292057037, + 0.49831054359674454, + 0.14165845327079296, + 1.2539497967809439, + 0.07131393253803253, + 1.7538733463734388, + 0.19173627346754074, + 0.11917475424706936, + 0.08707419782876968, + 2.194396622478962, + 0.20406079664826393, + 0.22954126447439194, + 0.5676887463778257, + 0.24673572182655334, + 0.3219197615981102 + ], + "unique_experts": 64, + "load_cv": 0.8308375979452464, + "normalized_load_entropy": 0.9253921446148334, + "max_load_share": 0.05864197530864197 + }, + "full_input": { + "tokens": 149, + "top_k": 6, + "decisions": 894, + "ordered_route_sha256": "ada93f233dc0b16fdf0b2b033b7e4819333dd13f6b1f6cac74b494ef95513608", + "route_weight_sha256": "5994eb2819e7d90157b708575324d2697bd3b37db121c76729b78d0822bddfce", + "loads": [ + 7, + 5, + 16, + 10, + 24, + 4, + 3, + 24, + 21, + 6, + 13, + 8, + 19, + 2, + 4, + 7, + 27, + 3, + 14, + 15, + 5, + 10, + 18, + 29, + 6, + 1, + 10, + 45, + 49, + 37, + 16, + 17, + 18, + 10, + 12, + 15, + 6, + 6, + 36, + 1, + 6, + 25, + 10, + 20, + 18, + 7, + 28, + 15, + 20, + 5, + 7, + 3, + 21, + 4, + 26, + 6, + 5, + 8, + 34, + 10, + 5, + 17, + 9, + 6 + ], + "weighted_loads": [ + 0.3337612710893154, + 0.2973695993423462, + 0.7829578127712011, + 0.36872609704732895, + 2.285377912223339, + 0.15424568206071854, + 0.13791949301958084, + 1.5096121318638325, + 1.3466727994382381, + 0.4092419296503067, + 0.5914518050849438, + 0.3494878299534321, + 0.9223602972924709, + 0.08750443533062935, + 0.31030086800456047, + 0.5756820514798164, + 1.3931470308452845, + 0.1445094794034958, + 1.1573899947106838, + 0.6029265895485878, + 0.35292751155793667, + 0.5655256286263466, + 0.9182185083627701, + 1.7155465688556433, + 0.4496738463640213, + 0.03571556508541107, + 0.3947676420211792, + 3.8461700305342674, + 4.734895953908563, + 4.185699008405209, + 1.048229736275971, + 0.7153586447238922, + 1.1468265280127525, + 0.49564301781356335, + 0.8459458202123642, + 0.9193103294819593, + 0.4376906752586365, + 0.25411556102335453, + 2.2804603539407253, + 0.07205662131309509, + 0.5511906631290913, + 1.712260590866208, + 0.6116570755839348, + 1.0846057869493961, + 1.4089277274906635, + 0.5249944888055325, + 2.1348146721720695, + 0.6925420369952917, + 0.9058842305094004, + 0.21336056292057037, + 0.5638715550303459, + 0.14165845327079296, + 1.2539497967809439, + 0.2299940474331379, + 1.7538733463734388, + 0.22304308414459229, + 0.1792922131717205, + 0.3598824627697468, + 2.383066363632679, + 0.3605692842975259, + 0.2991590164601803, + 0.9707149285823107, + 0.4700714573264122, + 0.3219197615981102 + ], + "unique_experts": 64, + "load_cv": 0.7655028575170362, + "normalized_load_entropy": 0.9352642520314727, + "max_load_share": 0.05480984340044743 + } + }, + "s0_x": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "adc15366890bae96abc1f4e57e545cd0169ee1040cb5ed665fc8fd2dc187c47c", + "route_weight_sha256": "42a80dca19758404fe5a3102e627f354310a50ea981dda377743bf7975e13033", + "loads": [ + 3, + 8, + 16, + 8, + 20, + 5, + 3, + 19, + 14, + 3, + 12, + 6, + 14, + 1, + 3, + 7, + 21, + 1, + 13, + 13, + 5, + 8, + 14, + 21, + 6, + 2, + 6, + 37, + 33, + 19, + 5, + 7, + 13, + 4, + 9, + 12, + 6, + 3, + 20, + 2, + 5, + 14, + 6, + 17, + 5, + 3, + 27, + 6, + 12, + 4, + 5, + 3, + 21, + 1, + 26, + 4, + 2, + 4, + 32, + 6, + 4, + 9, + 4, + 6 + ], + "weighted_loads": [ + 0.13759418576955795, + 0.4310361333191395, + 0.7923130579292774, + 0.315307067707181, + 1.6125387977808714, + 0.18335776403546333, + 0.12838417291641235, + 1.211422085762024, + 0.7653508502990007, + 0.0885371807962656, + 0.5512164384126663, + 0.28333628363907337, + 0.5480879284441471, + 0.0314793586730957, + 0.23894111812114716, + 0.547401700168848, + 1.025870691984892, + 0.03251933306455612, + 1.1265422627329826, + 0.5330371651798487, + 0.3916330821812153, + 0.48626554384827614, + 0.7663031220436096, + 1.154222859069705, + 0.4388697035610676, + 0.06823679432272911, + 0.255972295999527, + 3.449048064649105, + 2.5929376538842916, + 1.5043784119188786, + 0.19450338557362556, + 0.28318130038678646, + 0.8718389868736267, + 0.16337741166353226, + 0.6969842351973057, + 0.5132811162620783, + 0.4207444302737713, + 0.1182161495089531, + 0.9109070152044296, + 0.10406824387609959, + 0.471815038472414, + 0.6800985895097256, + 0.297631973400712, + 0.987139143049717, + 0.20350948348641396, + 0.21312806755304337, + 2.115743225440383, + 0.22866291366517544, + 0.5589501187205315, + 0.1847967654466629, + 0.4821084551513195, + 0.14150798693299294, + 1.2345398627221584, + 0.07302311062812805, + 1.7940349765121937, + 0.16060684248805046, + 0.08841355890035629, + 0.17010508105158806, + 2.282849233597517, + 0.20150945335626602, + 0.2475482076406479, + 0.5511342119425535, + 0.23513817228376865, + 0.3222481682896614 + ], + "unique_experts": 64, + "load_cv": 0.828449336780623, + "normalized_load_entropy": 0.9264258852699453, + "max_load_share": 0.05709876543209876 + }, + "full_input": { + "tokens": 133, + "top_k": 6, + "decisions": 798, + "ordered_route_sha256": "ff450f59d6f657de7301b21592b5741e1162b64c4ffb6c6b02a837deff691430", + "route_weight_sha256": "c4e601f0e2eb9fde98e0d6bedef0cfa772f31e3aed0099f78975652b4918a7db", + "loads": [ + 3, + 8, + 16, + 12, + 21, + 5, + 3, + 22, + 21, + 3, + 12, + 6, + 19, + 1, + 3, + 7, + 23, + 1, + 13, + 13, + 5, + 8, + 15, + 28, + 6, + 2, + 7, + 46, + 51, + 31, + 8, + 13, + 14, + 6, + 9, + 20, + 6, + 7, + 34, + 2, + 5, + 19, + 10, + 17, + 7, + 5, + 27, + 11, + 16, + 4, + 6, + 3, + 21, + 1, + 26, + 4, + 4, + 5, + 34, + 8, + 4, + 14, + 8, + 9 + ], + "weighted_loads": [ + 0.13759418576955795, + 0.4310361333191395, + 0.7923130579292774, + 0.43281520530581474, + 2.2153835725039244, + 0.18335776403546333, + 0.12838417291641235, + 1.427132673561573, + 1.1789199505001307, + 0.0885371807962656, + 0.5512164384126663, + 0.28333628363907337, + 0.8079985976219177, + 0.0314793586730957, + 0.23894111812114716, + 0.547401700168848, + 1.1400584429502487, + 0.03251933306455612, + 1.1265422627329826, + 0.5330371651798487, + 0.3916330821812153, + 0.48626554384827614, + 0.8161429986357689, + 1.799495393410325, + 0.4388697035610676, + 0.06823679432272911, + 0.2888084761798382, + 3.9241958539932966, + 4.73849848844111, + 3.0839199163019657, + 0.31130699161440134, + 0.5925658065825701, + 0.9182377308607101, + 0.2522270157933235, + 0.6969842351973057, + 1.0853838827461004, + 0.4207444302737713, + 0.23205129988491535, + 1.886533834040165, + 0.10406824387609959, + 0.471815038472414, + 1.1693003959953785, + 0.5725080128759146, + 0.987139143049717, + 0.32730772346258163, + 0.3039129860699177, + 2.115743225440383, + 0.4793782476335764, + 0.730284396559, + 0.1847967654466629, + 0.49503327533602715, + 0.14150798693299294, + 1.2345398627221584, + 0.07302311062812805, + 1.7940349765121937, + 0.16060684248805046, + 0.19056935980916023, + 0.2028159238398075, + 2.4296196214854717, + 0.28651172388345003, + 0.2475482076406479, + 0.7785210218280554, + 0.3829982206225395, + 0.4167871065437794 + ], + "unique_experts": 64, + "load_cv": 0.85206766686921, + "normalized_load_entropy": 0.9237101615682232, + "max_load_share": 0.06390977443609022 + } + }, + "s1_x": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "0e9f57873df3242185d7fc826444c650623e761f11d3594203893e5e1182ccb6", + "route_weight_sha256": "aa78b70fdecf679a110fc19467487e1542822b887c582cee6035cb0a184f7219", + "loads": [ + 3, + 6, + 16, + 7, + 21, + 4, + 3, + 19, + 14, + 3, + 12, + 6, + 13, + 3, + 4, + 7, + 20, + 0, + 14, + 12, + 5, + 9, + 15, + 23, + 6, + 1, + 7, + 38, + 34, + 18, + 6, + 6, + 12, + 4, + 7, + 8, + 7, + 3, + 20, + 2, + 6, + 14, + 6, + 19, + 7, + 3, + 27, + 7, + 13, + 4, + 5, + 2, + 21, + 2, + 26, + 6, + 3, + 3, + 33, + 2, + 3, + 9, + 3, + 6 + ], + "weighted_loads": [ + 0.13918235152959824, + 0.3391931727528572, + 0.8012344632297754, + 0.28313402459025383, + 1.624376216903329, + 0.15192725881934166, + 0.14139090478420258, + 1.2771720439195633, + 0.8122111354023218, + 0.08380146883428097, + 0.5531360469758511, + 0.28234818391501904, + 0.4937671162188053, + 0.12020021304488182, + 0.3189567066729069, + 0.5884873680770397, + 0.9143311996012926, + 0.0, + 1.1419999226927757, + 0.5075092613697052, + 0.35289102606475353, + 0.5063843131065369, + 0.8042104318737984, + 1.2196382116526365, + 0.44715963304042816, + 0.036548588424921036, + 0.27790127880871296, + 3.5260886438190937, + 2.683161126449704, + 1.3111912608146667, + 0.22110646963119507, + 0.2460520826280117, + 0.89783750846982, + 0.17114363610744476, + 0.6188145577907562, + 0.3743473682552576, + 0.4650436546653509, + 0.11804498359560966, + 0.8724220488220453, + 0.10343682765960693, + 0.5480152312666178, + 0.6566741783171892, + 0.3261176645755768, + 1.0042612254619598, + 0.2444099299609661, + 0.22130609303712845, + 2.1441539973020554, + 0.26597374491393566, + 0.6432889550924301, + 0.17946456372737885, + 0.4796218313276768, + 0.11181394010782242, + 1.2741800583899021, + 0.0999740157276392, + 1.8042790573090315, + 0.22330031171441078, + 0.11451340280473232, + 0.1268186867237091, + 2.420835530385375, + 0.06642929092049599, + 0.2358449101448059, + 0.5815288163721561, + 0.22129752859473228, + 0.3139592632651329 + ], + "unique_experts": 63, + "load_cv": 0.8502400209814072, + "normalized_load_entropy": 0.9228743883575654, + "max_load_share": 0.05864197530864197 + }, + "full_input": { + "tokens": 149, + "top_k": 6, + "decisions": 894, + "ordered_route_sha256": "dcf589a0ca43ff26ae2a4f6f8bb6753a6e1f1eedfcd4a4ba89b3ad2611261a87", + "route_weight_sha256": "2951b40491932968ed38e8124a6d70158138e8a0031d85c317bf98c9a621f047", + "loads": [ + 7, + 6, + 16, + 9, + 24, + 4, + 3, + 26, + 21, + 6, + 13, + 6, + 17, + 3, + 4, + 7, + 24, + 2, + 15, + 12, + 5, + 12, + 17, + 30, + 6, + 1, + 10, + 46, + 53, + 33, + 18, + 13, + 16, + 9, + 12, + 15, + 7, + 7, + 38, + 2, + 6, + 25, + 13, + 21, + 20, + 8, + 30, + 13, + 20, + 4, + 7, + 2, + 21, + 5, + 26, + 7, + 4, + 10, + 35, + 5, + 5, + 18, + 8, + 6 + ], + "weighted_loads": [ + 0.3297131285071373, + 0.3391931727528572, + 0.8012344632297754, + 0.338792709633708, + 2.2938731480389833, + 0.15192725881934166, + 0.14139090478420258, + 1.6754810884594917, + 1.2942610327154398, + 0.40471105091273785, + 0.594792515039444, + 0.28234818391501904, + 0.6684859618544579, + 0.12020021304488182, + 0.3189567066729069, + 0.5884873680770397, + 1.158297797665, + 0.11194029450416565, + 1.177542444318533, + 0.5075092613697052, + 0.35289102606475353, + 0.6290308460593224, + 0.8910297714173794, + 1.8100949134677649, + 0.44715963304042816, + 0.036548588424921036, + 0.4004444684833288, + 3.956191934645176, + 5.166165182366967, + 3.4686102271080017, + 1.112891980446875, + 0.5718027949333191, + 1.0759840849786997, + 0.45735183730721474, + 0.8743662796914577, + 1.0044400114566088, + 0.4650436546653509, + 0.2903303764760494, + 2.1257010307163, + 0.10343682765960693, + 0.5480152312666178, + 1.6874575521796942, + 0.7642909064888954, + 1.115301501005888, + 1.457688633352518, + 0.5745329111814499, + 2.2695035561919212, + 0.5601801835000515, + 0.9345679096877575, + 0.17946456372737885, + 0.5451828427612782, + 0.11181394010782242, + 1.2741800583899021, + 0.25865413062274456, + 1.8042790573090315, + 0.2546071223914623, + 0.1422368511557579, + 0.45118899643421173, + 2.603740168735385, + 0.1800401182845235, + 0.30546266213059425, + 1.0380135923624039, + 0.44463326409459114, + 0.3139592632651329 + ], + "unique_experts": 64, + "load_cv": 0.7871637336285767, + "normalized_load_entropy": 0.9330764241359275, + "max_load_share": 0.0592841163310962 + } + }, + "s0_period": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "0c00f0ed8001258dc0b8c396bfc51d1e2962fdf600ea14858b0fa513776836ac", + "route_weight_sha256": "b27000cbcb3a618b4b9c982fccd3d602fbc8e21af1afc6818726677c35e319e0", + "loads": [ + 3, + 7, + 16, + 8, + 20, + 5, + 4, + 18, + 16, + 3, + 12, + 6, + 12, + 1, + 3, + 7, + 20, + 1, + 12, + 12, + 5, + 8, + 15, + 21, + 6, + 1, + 7, + 37, + 34, + 19, + 5, + 7, + 13, + 4, + 8, + 11, + 6, + 2, + 20, + 2, + 5, + 14, + 6, + 18, + 5, + 3, + 27, + 7, + 12, + 5, + 5, + 3, + 23, + 1, + 26, + 5, + 2, + 4, + 33, + 5, + 3, + 9, + 4, + 6 + ], + "weighted_loads": [ + 0.1408287063241005, + 0.39756136760115623, + 0.7793441414833069, + 0.3104273732751608, + 1.6279992833733559, + 0.1849920190870762, + 0.16827454045414925, + 1.1885862089693546, + 0.8424047343432903, + 0.08795381709933281, + 0.5372025072574615, + 0.28187946788966656, + 0.4615869615226984, + 0.03953038528561592, + 0.26016491651535034, + 0.5518986657261848, + 0.978008322417736, + 0.032305944710969925, + 1.080874603241682, + 0.49100091122090816, + 0.3897658511996269, + 0.4935835860669613, + 0.8129243925213814, + 1.1654915884137154, + 0.4545985125005245, + 0.03644074499607086, + 0.29291121661663055, + 3.488482791930437, + 2.6196099910885096, + 1.5372581295669079, + 0.19679682329297066, + 0.283486807718873, + 0.8977776765823364, + 0.1591292917728424, + 0.6549437940120697, + 0.47361825965344906, + 0.42995740100741386, + 0.07504240237176418, + 0.9035970456898212, + 0.11004974320530891, + 0.4615999720990658, + 0.6851402688771486, + 0.3008056227117777, + 1.0045744553208351, + 0.20144832134246826, + 0.21431905031204224, + 2.122135676443577, + 0.2827265225350857, + 0.5598992742598057, + 0.22047214210033417, + 0.48570555076003075, + 0.13902645744383335, + 1.3087198976427317, + 0.07494323700666428, + 1.813351396471262, + 0.1902259700000286, + 0.08491194620728493, + 0.16957179084420204, + 2.3397698160260916, + 0.17020416259765625, + 0.24650855734944344, + 0.5555873531848192, + 0.23999663069844246, + 0.3198269195854664 + ], + "unique_experts": 64, + "load_cv": 0.8406854462337392, + "normalized_load_entropy": 0.9245116863643758, + "max_load_share": 0.05709876543209876 + }, + "full_input": { + "tokens": 133, + "top_k": 6, + "decisions": 798, + "ordered_route_sha256": "2fa4db477095d6f86775e705e1d4b5624e3791325410019d6d5dcaf6214a812c", + "route_weight_sha256": "6ead61d3847be513d70fb0ade4fc8be6c69b595374ba1f1d95aa58d4223d9a77", + "loads": [ + 3, + 7, + 16, + 12, + 21, + 5, + 4, + 21, + 23, + 3, + 12, + 6, + 17, + 1, + 3, + 7, + 24, + 1, + 12, + 12, + 5, + 8, + 16, + 28, + 6, + 1, + 8, + 46, + 51, + 30, + 7, + 13, + 14, + 6, + 8, + 19, + 6, + 6, + 34, + 2, + 5, + 20, + 10, + 18, + 7, + 4, + 27, + 13, + 15, + 5, + 6, + 3, + 23, + 1, + 26, + 5, + 4, + 4, + 36, + 7, + 3, + 14, + 9, + 9 + ], + "weighted_loads": [ + 0.1408287063241005, + 0.39756136760115623, + 0.7793441414833069, + 0.42793551087379456, + 2.230844058096409, + 0.1849920190870762, + 0.16827454045414925, + 1.4072055034339428, + 1.2472225409001112, + 0.08795381709933281, + 0.5372025072574615, + 0.28187946788966656, + 0.7392916399985552, + 0.03953038528561592, + 0.26016491651535034, + 0.5518986657261848, + 1.18318035826087, + 0.032305944710969925, + 1.080874603241682, + 0.49100091122090816, + 0.3897658511996269, + 0.4935835860669613, + 0.8627642691135406, + 1.7217318713665009, + 0.4545985125005245, + 0.03644074499607086, + 0.32574739679694176, + 3.944398580119014, + 4.790802916511893, + 3.0517261549830437, + 0.25991807971149683, + 0.5886408817023039, + 0.9441764205694199, + 0.2498774379491806, + 0.6549437940120697, + 1.01905451528728, + 0.42995740100741386, + 0.18887755274772644, + 1.8812014572322369, + 0.11004974320530891, + 0.4615999720990658, + 1.2630173731595278, + 0.575836693868041, + 1.0045744553208351, + 0.3281397856771946, + 0.2535570375621319, + 2.122135676443577, + 0.5663130506873131, + 0.6962273083627224, + 0.22047214210033417, + 0.4986303709447384, + 0.13902645744383335, + 1.3087198976427317, + 0.07494323700666428, + 1.813351396471262, + 0.1902259700000286, + 0.18706774711608887, + 0.16957179084420204, + 2.5162836145609617, + 0.25520643312484026, + 0.24650855734944344, + 0.7644794341176748, + 0.4363317135721445, + 0.41436585783958435 + ], + "unique_experts": 64, + "load_cv": 0.8622683087443535, + "normalized_load_entropy": 0.9216437493251896, + "max_load_share": 0.06390977443609022 + } + }, + "s1_period": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "6a62d9d7785e2c5e04da3639b7b2743e694038e044f53b961dc6dda813916a90", + "route_weight_sha256": "382649f5f0cb29464aad033408f460aebf1608d3469b0181e4fabf4753ab07d1", + "loads": [ + 3, + 6, + 16, + 8, + 21, + 4, + 4, + 19, + 14, + 3, + 12, + 6, + 14, + 2, + 3, + 7, + 20, + 0, + 13, + 12, + 5, + 9, + 16, + 22, + 5, + 1, + 8, + 38, + 34, + 18, + 5, + 8, + 13, + 4, + 8, + 8, + 7, + 3, + 18, + 2, + 5, + 16, + 7, + 19, + 6, + 3, + 26, + 7, + 11, + 4, + 5, + 2, + 21, + 2, + 26, + 6, + 2, + 3, + 32, + 4, + 3, + 9, + 4, + 6 + ], + "weighted_loads": [ + 0.14129101857542992, + 0.32875931635499, + 0.7896691784262657, + 0.3150988928973675, + 1.639307588338852, + 0.15119383484125137, + 0.17409221269190311, + 1.2660039849579334, + 0.8237119168043137, + 0.08453755266964436, + 0.536554116755724, + 0.2720730695873499, + 0.5493413992226124, + 0.09310489147901535, + 0.2692033052444458, + 0.5593198984861374, + 0.9355943202972412, + 0.0, + 1.106324303895235, + 0.4930072706192732, + 0.3609010837972164, + 0.5137219429016113, + 0.8204134181141853, + 1.2127809096127748, + 0.40836456045508385, + 0.03539760783314705, + 0.3044991195201874, + 3.517088083550334, + 2.6794804334640503, + 1.2852304801344872, + 0.19057365506887436, + 0.3078381400555372, + 0.9465932510793209, + 0.16257309541106224, + 0.65969243273139, + 0.37854945100843906, + 0.46607114002108574, + 0.11368894949555397, + 0.8109667599201202, + 0.1000212486833334, + 0.5223341546952724, + 0.7244841493666172, + 0.34578472562134266, + 0.9955559819936752, + 0.22166487202048302, + 0.22731082886457443, + 2.1192760840058327, + 0.26703276857733727, + 0.501415491104126, + 0.1753159500658512, + 0.47743551060557365, + 0.10896209999918938, + 1.2569088693708181, + 0.09912377968430519, + 1.8109376840293407, + 0.21951155364513397, + 0.07281125709414482, + 0.11993847787380219, + 2.397718660533428, + 0.11874271556735039, + 0.23476378619670868, + 0.5871845297515392, + 0.249331409111619, + 0.31748751178383827 + ], + "unique_experts": 63, + "load_cv": 0.8392337974991279, + "normalized_load_entropy": 0.9242250317698406, + "max_load_share": 0.05864197530864197 + }, + "full_input": { + "tokens": 149, + "top_k": 6, + "decisions": 894, + "ordered_route_sha256": "6d72c672f69fb09c2fe2f408347f3d842761eef996f0463a2f5249dd8b29b8a3", + "route_weight_sha256": "f50119b9e5e5f1efbb2e7a6e03d12e54b4c5bce01ce138cc63a6dfe75e876882", + "loads": [ + 7, + 6, + 16, + 10, + 24, + 4, + 4, + 27, + 21, + 6, + 13, + 6, + 18, + 2, + 3, + 7, + 24, + 2, + 14, + 12, + 5, + 11, + 18, + 29, + 5, + 1, + 11, + 45, + 53, + 33, + 16, + 15, + 17, + 9, + 13, + 15, + 7, + 7, + 37, + 2, + 5, + 28, + 15, + 21, + 19, + 7, + 29, + 14, + 17, + 4, + 7, + 2, + 21, + 5, + 26, + 7, + 3, + 9, + 34, + 7, + 5, + 18, + 10, + 6 + ], + "weighted_loads": [ + 0.331821795552969, + 0.32875931635499, + 0.7896691784262657, + 0.37075757794082165, + 2.3088045194745064, + 0.15119383484125137, + 0.17409221269190311, + 1.69316079095006, + 1.312832023948431, + 0.40544713474810123, + 0.5782105848193169, + 0.2720730695873499, + 0.7177151963114738, + 0.09310489147901535, + 0.2692033052444458, + 0.5593198984861374, + 1.2003319263458252, + 0.11194029450416565, + 1.1418668255209923, + 0.4930072706192732, + 0.3609010837972164, + 0.6044600866734982, + 0.9072327576577663, + 1.7205298598855734, + 0.40836456045508385, + 0.03539760783314705, + 0.42704230919480324, + 3.872844921424985, + 5.1758949384093285, + 3.4378415420651436, + 1.0442562447860837, + 0.6386206764727831, + 1.1247398275882006, + 0.44595667719841003, + 0.9152441546320915, + 0.9655225668102503, + 0.46607114002108574, + 0.28597434237599373, + 2.1178416088223457, + 0.1000212486833334, + 0.5223341546952724, + 1.8675775527954102, + 0.8279392551630735, + 1.1065962575376034, + 1.4440969116985798, + 0.5392305813729763, + 2.2429626174271107, + 0.5999087486416101, + 0.7744009383022785, + 0.1753159500658512, + 0.542996522039175, + 0.10896209999918938, + 1.2569088693708181, + 0.25780389457941055, + 1.8109376840293407, + 0.2508183643221855, + 0.1005347054451704, + 0.3969687446951866, + 2.558364264667034, + 0.2323535429313779, + 0.304381538182497, + 1.0457289554178715, + 0.5084171202033758, + 0.31748751178383827 + ], + "unique_experts": 64, + "load_cv": 0.7814462096398737, + "normalized_load_entropy": 0.9331308811908839, + "max_load_share": 0.0592841163310962 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 108, + "ordered_topk_exact_tokens": 61, + "set_exact_tokens": 71, + "mean_set_jaccard": 0.9001322751322753, + "mean_token_weighted_tv": 0.018968798806545912, + "aggregate_load_tv": 0.029320987654320986 + }, + "system_bos": { + "tokens": 108, + "ordered_topk_exact_tokens": 59, + "set_exact_tokens": 74, + "mean_set_jaccard": 0.9080687830687831, + "mean_token_weighted_tv": 0.020148004922601912, + "aggregate_load_tv": 0.035493827160493825 + }, + "system_x": { + "tokens": 108, + "ordered_topk_exact_tokens": 50, + "set_exact_tokens": 64, + "mean_set_jaccard": 0.8816137566137567, + "mean_token_weighted_tv": 0.02567256530056949, + "aggregate_load_tv": 0.040123456790123455 + }, + "system_period": { + "tokens": 108, + "ordered_topk_exact_tokens": 59, + "set_exact_tokens": 71, + "mean_set_jaccard": 0.8981481481481481, + "mean_token_weighted_tv": 0.023669283129964715, + "aggregate_load_tv": 0.032407407407407406 + }, + "bos_at_s0": { + "tokens": 108, + "ordered_topk_exact_tokens": 55, + "set_exact_tokens": 70, + "mean_set_jaccard": 0.8955026455026456, + "mean_token_weighted_tv": 0.022436052716026705, + "aggregate_load_tv": 0.043209876543209874 + }, + "bos_at_s1": { + "tokens": 108, + "ordered_topk_exact_tokens": 50, + "set_exact_tokens": 67, + "mean_set_jaccard": 0.8835978835978837, + "mean_token_weighted_tv": 0.025962448575430445, + "aggregate_load_tv": 0.041666666666666664 + }, + "x_at_s0": { + "tokens": 108, + "ordered_topk_exact_tokens": 52, + "set_exact_tokens": 68, + "mean_set_jaccard": 0.882716049382716, + "mean_token_weighted_tv": 0.02668134667220767, + "aggregate_load_tv": 0.040123456790123455 + }, + "x_at_s1": { + "tokens": 108, + "ordered_topk_exact_tokens": 47, + "set_exact_tokens": 66, + "mean_set_jaccard": 0.878968253968254, + "mean_token_weighted_tv": 0.028492503480433865, + "aggregate_load_tv": 0.043209876543209874 + }, + "period_at_s0": { + "tokens": 108, + "ordered_topk_exact_tokens": 53, + "set_exact_tokens": 66, + "mean_set_jaccard": 0.8758818342151675, + "mean_token_weighted_tv": 0.027959383498118433, + "aggregate_load_tv": 0.040123456790123455 + }, + "period_at_s1": { + "tokens": 108, + "ordered_topk_exact_tokens": 44, + "set_exact_tokens": 65, + "mean_set_jaccard": 0.8723544973544974, + "mean_token_weighted_tv": 0.02966442746455195, + "aggregate_load_tv": 0.044753086419753084 + } + } + }, + "layer_13": { + "layer": 13, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "c684243f496e314f08c4aa676c5ddb40e8cb9a0daa1203183faf20de11c5f7c3", + "route_weight_sha256": "d4449534d788d52f06ae640763aaa50a9d9da3f271fae3035ccc20790a1ed569", + "loads": [ + 3, + 14, + 7, + 5, + 3, + 12, + 6, + 18, + 5, + 8, + 14, + 7, + 12, + 3, + 12, + 5, + 13, + 21, + 18, + 10, + 3, + 13, + 9, + 15, + 4, + 21, + 6, + 2, + 20, + 13, + 0, + 7, + 2, + 20, + 8, + 11, + 13, + 26, + 10, + 19, + 4, + 0, + 14, + 19, + 29, + 7, + 3, + 10, + 3, + 5, + 5, + 3, + 5, + 8, + 2, + 20, + 4, + 0, + 13, + 18, + 3, + 29, + 8, + 18 + ], + "weighted_loads": [ + 0.2805221825838089, + 0.7459248788654804, + 0.22686858102679253, + 0.20328790321946144, + 0.2252611257135868, + 0.42953154258430004, + 0.20777375251054764, + 1.0679137725383043, + 0.20162215642631054, + 0.2814354207366705, + 0.6116500571370125, + 0.2799884285777807, + 0.5766507554799318, + 0.08900116756558418, + 0.5382569711655378, + 0.16898399963974953, + 0.6195365712046623, + 1.3176728747785091, + 1.149506114423275, + 0.5041666198521852, + 0.11998941004276276, + 0.6089184358716011, + 0.3469882793724537, + 1.305493876338005, + 0.15147012285888195, + 1.397456131875515, + 0.6836016029119492, + 0.11306968703866005, + 0.9025188311934471, + 0.8990437500178814, + 0.0, + 0.376200545579195, + 0.1227172501385212, + 1.2852711863815784, + 0.2559931315481663, + 0.6132940165698528, + 0.7957435846328735, + 1.5500885676592588, + 0.6650057397782803, + 1.1136581134051085, + 0.20701438561081886, + 0.0, + 0.5376699566841125, + 1.109861332923174, + 1.7235681936144829, + 0.43500196374952793, + 0.08753886446356773, + 0.316386079415679, + 0.18645082414150238, + 0.23253784887492657, + 0.4631469137966633, + 0.19818614423274994, + 0.1701696217060089, + 0.28375355526804924, + 0.06180959939956665, + 1.70350256934762, + 0.1560668833553791, + 0.0, + 0.4786225035786629, + 1.2393164075911045, + 0.18463540449738503, + 1.4739523250609636, + 0.41442493349313736, + 1.0964822322130203 + ], + "unique_experts": 61, + "load_cv": 0.7086677846205514, + "normalized_load_entropy": 0.9375351761046887, + "max_load_share": 0.044753086419753084 + }, + "full_input": { + "tokens": 133, + "top_k": 6, + "decisions": 798, + "ordered_route_sha256": "2c6c491025b18ed02d74f41bf3966d380deac196958e778d5f42c167eac486e0", + "route_weight_sha256": "22f051c61043d5a49935fafba7ca1b393111a8667adc71591f8bb790f54e84fa", + "loads": [ + 3, + 18, + 7, + 5, + 3, + 12, + 25, + 18, + 5, + 11, + 24, + 13, + 12, + 3, + 13, + 11, + 13, + 24, + 21, + 11, + 3, + 16, + 9, + 16, + 8, + 21, + 9, + 2, + 20, + 27, + 0, + 7, + 2, + 25, + 9, + 11, + 16, + 27, + 10, + 20, + 4, + 2, + 17, + 21, + 39, + 17, + 5, + 13, + 4, + 5, + 6, + 3, + 9, + 11, + 4, + 20, + 7, + 0, + 19, + 22, + 3, + 30, + 8, + 19 + ], + "weighted_loads": [ + 0.2805221825838089, + 0.9256023280322552, + 0.22686858102679253, + 0.20328790321946144, + 0.2252611257135868, + 0.42953154258430004, + 1.8167556263506413, + 1.0679137725383043, + 0.20162215642631054, + 0.39552850648760796, + 1.2724065091460943, + 0.5080807078629732, + 0.5766507554799318, + 0.08900116756558418, + 0.5836198087781668, + 0.47566116601228714, + 0.6195365712046623, + 1.3911159066483378, + 1.391073502600193, + 0.5492622274905443, + 0.11998941004276276, + 0.7042727749794722, + 0.3469882793724537, + 1.3380683474242687, + 0.25857615238055587, + 1.397456131875515, + 0.8096329979598522, + 0.11306968703866005, + 0.9025188311934471, + 1.6871535293757915, + 0.0, + 0.376200545579195, + 0.1227172501385212, + 1.6842549704015255, + 0.27881112694740295, + 0.6132940165698528, + 0.9657650012522936, + 1.5837121326476336, + 0.6650057397782803, + 1.149058809503913, + 0.20701438561081886, + 0.10778848081827164, + 0.6795509643852711, + 1.2064922451972961, + 2.502564739435911, + 1.4046628531068563, + 0.15462945774197578, + 1.5400858242064714, + 0.21852713450789452, + 0.23253784887492657, + 0.5013285987079144, + 0.19818614423274994, + 0.3143346793949604, + 0.42173848301172256, + 0.15039054118096828, + 1.70350256934762, + 0.32570749148726463, + 0.0, + 0.7546648290008307, + 1.436237372457981, + 0.18463540449738503, + 1.503743652254343, + 0.41442493349313736, + 1.1341200321912766 + ], + "unique_experts": 62, + "load_cv": 0.6778556777050601, + "normalized_load_entropy": 0.9420201040712192, + "max_load_share": 0.04887218045112782 + } + }, + "s1_eos": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "e4fedccde3a124efdef194d579f7b6cef0a25ed09941dc46eb23158aab23c38c", + "route_weight_sha256": "632a6ba7e1d7f89728b5320d6e71a6e95452fc1b4d42d3904e9a6f01af34d9bb", + "loads": [ + 3, + 15, + 6, + 4, + 3, + 12, + 6, + 18, + 6, + 7, + 13, + 6, + 12, + 2, + 12, + 4, + 14, + 22, + 16, + 11, + 5, + 13, + 11, + 15, + 4, + 22, + 7, + 2, + 19, + 12, + 0, + 7, + 2, + 20, + 9, + 10, + 15, + 26, + 9, + 20, + 4, + 0, + 14, + 17, + 29, + 9, + 5, + 8, + 2, + 4, + 5, + 3, + 4, + 8, + 2, + 20, + 5, + 0, + 15, + 18, + 3, + 26, + 8, + 19 + ], + "weighted_loads": [ + 0.28826406598091125, + 0.7572510149329901, + 0.1919638067483902, + 0.16243823617696762, + 0.2351965680718422, + 0.43564340099692345, + 0.21734544821083546, + 1.068034728989005, + 0.2225004881620407, + 0.2577880881726742, + 0.5582427158951759, + 0.2494324129074812, + 0.5588526856154203, + 0.05868978425860405, + 0.5396215934306383, + 0.14159290865063667, + 0.6437410991638899, + 1.3671736419200897, + 1.1177599672228098, + 0.539101030677557, + 0.20003348216414452, + 0.5998788215219975, + 0.4278177320957184, + 1.3031537905335426, + 0.15515937097370625, + 1.4527855291962624, + 0.6868342608213425, + 0.11904789507389069, + 0.887858472764492, + 0.8772004172205925, + 0.0, + 0.38904949836432934, + 0.12933401763439178, + 1.28907261043787, + 0.2679446954280138, + 0.5647762715816498, + 0.8736936692148447, + 1.5767291560769081, + 0.6210539657622576, + 1.1244480423629284, + 0.2069341577589512, + 0.0, + 0.5361699778586626, + 0.9799773264676332, + 1.7664852384477854, + 0.4939183797687292, + 0.14281536266207695, + 0.26693461276590824, + 0.13229110091924667, + 0.2191318105906248, + 0.4953196942806244, + 0.20512133091688156, + 0.13180342316627502, + 0.2866488918662071, + 0.06311300583183765, + 1.713493250310421, + 0.1984228529036045, + 0.0, + 0.512073028832674, + 1.235674249008298, + 0.18927468359470367, + 1.3843758925795555, + 0.41222951374948025, + 1.139563787728548 + ], + "unique_experts": 61, + "load_cv": 0.7028368062958165, + "normalized_load_entropy": 0.9376766907779627, + "max_load_share": 0.044753086419753084 + }, + "full_input": { + "tokens": 149, + "top_k": 6, + "decisions": 894, + "ordered_route_sha256": "8e2edfe614d460f2d22e9502f3a05ea1ba6ba1b8b6829f25652d121d81ea354d", + "route_weight_sha256": "39f84cc30813bf0711fd32eb21e5fcfc7bd8ce21d8e9f596384bd403fcb4ca53", + "loads": [ + 8, + 18, + 6, + 4, + 3, + 16, + 35, + 18, + 6, + 10, + 23, + 18, + 12, + 2, + 13, + 11, + 14, + 26, + 20, + 14, + 5, + 18, + 11, + 19, + 8, + 22, + 11, + 2, + 19, + 30, + 7, + 8, + 2, + 31, + 12, + 11, + 20, + 27, + 10, + 21, + 6, + 6, + 23, + 19, + 44, + 20, + 6, + 11, + 4, + 9, + 6, + 3, + 5, + 10, + 4, + 22, + 8, + 11, + 24, + 22, + 4, + 28, + 8, + 20 + ], + "weighted_loads": [ + 0.4914899989962578, + 0.9442710597068071, + 0.1919638067483902, + 0.16243823617696762, + 0.2351965680718422, + 0.5615933388471603, + 2.646213762462139, + 1.068034728989005, + 0.2225004881620407, + 0.40182854421436787, + 1.2304727006703615, + 0.9871476059779525, + 0.5588526856154203, + 0.05868978425860405, + 0.5832911115139723, + 0.503762774169445, + 0.6437410991638899, + 1.4751177849248052, + 1.4050703197717667, + 0.6621366143226624, + 0.20003348216414452, + 0.8297801855951548, + 0.4278177320957184, + 1.4598398841917515, + 0.2640999164432287, + 1.4527855291962624, + 0.845064664259553, + 0.11904789507389069, + 0.887858472764492, + 2.3026120886206627, + 0.4037847965955734, + 0.42844423465430737, + 0.12933401763439178, + 2.20435905829072, + 0.4940954688936472, + 0.6172542311251163, + 1.185773279517889, + 1.6100427992641926, + 0.6649391930550337, + 1.1661011688411236, + 0.2862100936472416, + 0.2661139592528343, + 1.2435378599911928, + 1.0893075559288263, + 2.9847807120531797, + 1.4571104031056166, + 0.18373947963118553, + 1.4964087884873152, + 0.3862713985145092, + 0.4647358600050211, + 0.531901266425848, + 0.20512133091688156, + 0.16922906413674355, + 0.3695514239370823, + 0.13410303741693497, + 1.7857805266976357, + 0.3523886352777481, + 0.7082201726734638, + 0.896809995174408, + 1.436383018270135, + 0.2183094061911106, + 1.4698424208909273, + 0.41222951374948025, + 1.1926876828074455 + ], + "unique_experts": 64, + "load_cv": 0.6434208271376974, + "normalized_load_entropy": 0.9510929682377662, + "max_load_share": 0.049217002237136466 + } + }, + "s0_bos": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "f3a996903af803126270febe0a874c48354cffe26e72e6a94daff0be2a3f9d96", + "route_weight_sha256": "068aaed3ba540a272befa6331d8e31d49a57f6db6ebeea38c4964a1ffa11543e", + "loads": [ + 3, + 15, + 8, + 4, + 3, + 12, + 8, + 18, + 5, + 7, + 13, + 9, + 12, + 2, + 10, + 4, + 12, + 19, + 15, + 11, + 5, + 13, + 9, + 15, + 4, + 20, + 6, + 2, + 20, + 13, + 0, + 7, + 2, + 20, + 9, + 11, + 14, + 26, + 9, + 19, + 4, + 0, + 13, + 20, + 29, + 9, + 4, + 10, + 3, + 4, + 4, + 3, + 7, + 7, + 2, + 20, + 6, + 0, + 11, + 20, + 3, + 28, + 9, + 18 + ], + "weighted_loads": [ + 0.2967102825641632, + 0.7920893859118223, + 0.264291537925601, + 0.17432941868901253, + 0.25045371800661087, + 0.43533215671777725, + 0.34994036704301834, + 1.0652194451540709, + 0.1961637530475855, + 0.2414001300930977, + 0.5764406993985176, + 0.33304405584931374, + 0.5910731069743633, + 0.06072387285530567, + 0.4691120218485594, + 0.1390548963099718, + 0.5814185068011284, + 1.2755702883005142, + 1.0351902898401022, + 0.5466052331030369, + 0.20439469814300537, + 0.6249650530517101, + 0.34952824003994465, + 1.3074148632586002, + 0.14377029426395893, + 1.3985505923628807, + 0.6431000400334597, + 0.13009478896856308, + 0.9200579449534416, + 0.7940085288137197, + 0.0, + 0.37877861969172955, + 0.117593914270401, + 1.3081936463713646, + 0.27334376238286495, + 0.6180212125182152, + 0.8098907675594091, + 1.5853949375450611, + 0.6358171831816435, + 1.1379050686955452, + 0.21261248365044594, + 0.0, + 0.4987393096089363, + 1.1868948470801115, + 1.6995303612202406, + 0.49576360546052456, + 0.1153429877012968, + 0.30773188918828964, + 0.1766957864165306, + 0.219627246260643, + 0.4086058922111988, + 0.20491264015436172, + 0.24613459780812263, + 0.2541841473430395, + 0.059147004038095474, + 1.7310985624790192, + 0.22495426423847675, + 0.0, + 0.36512262374162674, + 1.3328743278980255, + 0.17971650138497353, + 1.4596273321658373, + 0.4637654908001423, + 1.1444952692836523 + ], + "unique_experts": 61, + "load_cv": 0.6936689771792665, + "normalized_load_entropy": 0.9396513741807829, + "max_load_share": 0.044753086419753084 + }, + "full_input": { + "tokens": 133, + "top_k": 6, + "decisions": 798, + "ordered_route_sha256": "2a8d68cc046644d81d934e6fd31d9e46cc1cb994d02842431d6c6a3483653cc8", + "route_weight_sha256": "aedeadc03129117924b7dbbba8ad73dffcc83b92c468445650cb8602602e6b97", + "loads": [ + 3, + 19, + 9, + 4, + 4, + 13, + 26, + 18, + 5, + 12, + 22, + 13, + 12, + 2, + 10, + 10, + 12, + 20, + 18, + 12, + 5, + 15, + 9, + 17, + 7, + 20, + 9, + 2, + 20, + 26, + 0, + 7, + 2, + 23, + 10, + 11, + 17, + 27, + 9, + 20, + 4, + 3, + 16, + 23, + 39, + 20, + 6, + 12, + 4, + 4, + 5, + 3, + 11, + 11, + 4, + 20, + 11, + 0, + 18, + 24, + 3, + 29, + 9, + 19 + ], + "weighted_loads": [ + 0.2967102825641632, + 0.985531335696578, + 0.3336391281336546, + 0.17432941868901253, + 0.30108562484383583, + 0.46339937299489975, + 1.9493077918887138, + 1.0652194451540709, + 0.1961637530475855, + 0.4751577768474817, + 1.143628703430295, + 0.5203032959252596, + 0.5910731069743633, + 0.06072387285530567, + 0.4691120218485594, + 0.4457320626825094, + 0.5814185068011284, + 1.310545776039362, + 1.2547567766159773, + 0.591700840741396, + 0.20439469814300537, + 0.6827024109661579, + 0.34952824003994465, + 1.3935107216238976, + 0.2503552194684744, + 1.3985505923628807, + 0.7691314350813627, + 0.13009478896856308, + 0.9200579449534416, + 1.52725943736732, + 0.0, + 0.37877861969172955, + 0.117593914270401, + 1.6204099729657173, + 0.29616175778210163, + 0.6180212125182152, + 1.0019925609230995, + 1.6190185025334358, + 0.6358171831816435, + 1.1733057647943497, + 0.21261248365044594, + 0.1437901295721531, + 0.6565686762332916, + 1.367084177210927, + 2.5031751561909914, + 1.502976031973958, + 0.18243358097970486, + 0.7004031129181385, + 0.20877209678292274, + 0.219627246260643, + 0.4467875771224499, + 0.20491264015436172, + 0.3902996554970741, + 0.45469762571156025, + 0.1477279458194971, + 1.7310985624790192, + 0.5488239731639624, + 0.0, + 0.6843311153352261, + 1.5297952927649021, + 0.17971650138497353, + 1.4894186593592167, + 0.4637654908001423, + 1.1821330692619085 + ], + "unique_experts": 62, + "load_cv": 0.6622566938075534, + "normalized_load_entropy": 0.9443551651002376, + "max_load_share": 0.04887218045112782 + } + }, + "s1_bos": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "4e504c804832dace0689b1200dded64e4cd6591dff568b76eee9cc647bcb751f", + "route_weight_sha256": "0ec2dd82e0e634028a90e6866c56228b574ffe53d7558563832eb449500bbaa9", + "loads": [ + 3, + 15, + 9, + 4, + 3, + 13, + 9, + 18, + 5, + 8, + 12, + 8, + 12, + 1, + 9, + 6, + 13, + 23, + 15, + 10, + 4, + 13, + 10, + 15, + 4, + 21, + 5, + 2, + 19, + 12, + 0, + 7, + 2, + 21, + 7, + 10, + 13, + 28, + 9, + 19, + 4, + 0, + 16, + 20, + 29, + 8, + 3, + 8, + 4, + 4, + 4, + 3, + 5, + 7, + 2, + 21, + 5, + 0, + 12, + 18, + 3, + 26, + 10, + 19 + ], + "weighted_loads": [ + 0.30644475668668747, + 0.7683382015675306, + 0.29070829413831234, + 0.16077945753932, + 0.2629695162177086, + 0.4783514365553856, + 0.347714526578784, + 1.0394013337790966, + 0.21067819371819496, + 0.27422645315527916, + 0.5213503073900938, + 0.3068252466619015, + 0.563969187438488, + 0.028235333040356636, + 0.4423087928444147, + 0.19386428967118263, + 0.6043649669736624, + 1.411995792761445, + 0.9702101927250624, + 0.513956381008029, + 0.16224340349435806, + 0.620147317647934, + 0.38398095965385437, + 1.3013333976268768, + 0.1463239174336195, + 1.4274391271173954, + 0.5841252915561199, + 0.11992765218019485, + 0.8796230349689722, + 0.7348047662526369, + 0.0, + 0.38133806735277176, + 0.12443804740905762, + 1.3175042178481817, + 0.22291060723364353, + 0.5668213181197643, + 0.7797614634037018, + 1.6529085282236338, + 0.6237878277897835, + 1.1308809649199247, + 0.2212512120604515, + 0.0, + 0.584803394973278, + 1.2006159238517284, + 1.7564274333417416, + 0.4566764533519745, + 0.08696812391281128, + 0.24590345099568367, + 0.20067431591451168, + 0.23049770295619965, + 0.4286329858005047, + 0.22234510257840157, + 0.18306639418005943, + 0.24980420991778374, + 0.06281339004635811, + 1.8093772139400244, + 0.1987131629139185, + 0.0, + 0.39544669911265373, + 1.2513494715094566, + 0.1826542466878891, + 1.409862207248807, + 0.5128139555454254, + 1.1632083393633366 + ], + "unique_experts": 61, + "load_cv": 0.713383714231786, + "normalized_load_entropy": 0.9364957654004818, + "max_load_share": 0.044753086419753084 + }, + "full_input": { + "tokens": 149, + "top_k": 6, + "decisions": 894, + "ordered_route_sha256": "77ecd559bfc9dbe5c73c9582707beb679a6ebb5449b41c66e944537bb7b56872", + "route_weight_sha256": "321a7edea134d7f9efd4e49afcf5443fc6d92f6905c94b466f5411f5226d53fd", + "loads": [ + 8, + 19, + 10, + 4, + 3, + 17, + 40, + 18, + 5, + 12, + 23, + 18, + 12, + 1, + 9, + 13, + 13, + 25, + 19, + 13, + 4, + 17, + 10, + 18, + 8, + 21, + 9, + 2, + 19, + 30, + 8, + 8, + 2, + 30, + 10, + 11, + 19, + 29, + 10, + 20, + 6, + 5, + 25, + 22, + 44, + 20, + 4, + 10, + 6, + 9, + 5, + 3, + 6, + 9, + 5, + 23, + 9, + 11, + 21, + 22, + 4, + 28, + 10, + 20 + ], + "weighted_loads": [ + 0.509670689702034, + 1.0076409634202719, + 0.33890613727271557, + 0.16077945753932, + 0.2629695162177086, + 0.6067901402711868, + 2.94147639721632, + 1.0394013337790966, + 0.21067819371819496, + 0.4735777545720339, + 1.2387888059020042, + 0.9959883783012629, + 0.563969187438488, + 0.028235333040356636, + 0.4423087928444147, + 0.556034155189991, + 0.6043649669736624, + 1.483117951080203, + 1.2359104864299297, + 0.6369919646531343, + 0.16224340349435806, + 0.8163968753069639, + 0.38398095965385437, + 1.423017207533121, + 0.30731831304728985, + 1.4274391271173954, + 0.7423556949943304, + 0.11992765218019485, + 0.8796230349689722, + 2.1697507817298174, + 0.44312214106321335, + 0.4207328036427498, + 0.12443804740905762, + 2.163581958040595, + 0.4490613806992769, + 0.6192992776632309, + 1.1365132573992014, + 1.6862221714109182, + 0.6676730550825596, + 1.17253409139812, + 0.3005271479487419, + 0.2341301627457142, + 1.3105014562606812, + 1.3172857500612736, + 2.9969025179743767, + 1.4661165922880173, + 0.12789224088191986, + 0.6460420563817024, + 0.4546546135097742, + 0.47610175237059593, + 0.4652145579457283, + 0.22234510257840157, + 0.22049203515052795, + 0.3327067419886589, + 0.1573396511375904, + 1.881664490327239, + 0.39194545336067677, + 0.7082201726734638, + 0.7580201383680105, + 1.4520582407712936, + 0.21168896928429604, + 1.4953287355601788, + 0.5128139555454254, + 1.216332234442234 + ], + "unique_experts": 64, + "load_cv": 0.6589154968571909, + "normalized_load_entropy": 0.9492393050637653, + "max_load_share": 0.049217002237136466 + } + }, + "s0_x": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "0f6ae94eec252e98ef9504d5cc5f12f9b38c2170495020de99f25198ab2b2eae", + "route_weight_sha256": "7c3bd86850be02aeb8b8839474e03eaebab72ceb45365c04a800619928c0e309", + "loads": [ + 3, + 16, + 9, + 4, + 3, + 10, + 9, + 17, + 5, + 6, + 12, + 9, + 12, + 3, + 9, + 5, + 13, + 23, + 17, + 10, + 4, + 13, + 8, + 15, + 4, + 21, + 7, + 2, + 19, + 12, + 0, + 7, + 2, + 21, + 8, + 11, + 13, + 26, + 9, + 19, + 4, + 0, + 14, + 18, + 28, + 8, + 6, + 12, + 2, + 3, + 4, + 3, + 7, + 7, + 2, + 21, + 5, + 0, + 11, + 17, + 3, + 29, + 10, + 18 + ], + "weighted_loads": [ + 0.29721222072839737, + 0.8416417427361012, + 0.3073547389358282, + 0.15913999266922474, + 0.23200446367263794, + 0.3628038205206394, + 0.27201609313488007, + 1.0313040968030691, + 0.18896373733878136, + 0.20258158445358276, + 0.5274598356336355, + 0.33959968388080597, + 0.5908338278532028, + 0.0933191105723381, + 0.4393240325152874, + 0.15687299147248268, + 0.6089817378669977, + 1.4556080605834723, + 1.1342169716954231, + 0.5218004062771797, + 0.16094278916716576, + 0.6415444351732731, + 0.3197402022778988, + 1.3205124493688345, + 0.14063107781112194, + 1.4426349345594645, + 0.6740820184350014, + 0.13120748847723007, + 0.8498782925307751, + 0.7402158230543137, + 0.0, + 0.38064033165574074, + 0.11402755975723267, + 1.3916972242295742, + 0.24758759327232838, + 0.5880294740200043, + 0.7680304907262325, + 1.5736536849290133, + 0.6322578806430101, + 1.126862570643425, + 0.22022578865289688, + 0.0, + 0.5262635629624128, + 1.0524772051721811, + 1.7320513762533665, + 0.47551119700074196, + 0.17150979675352573, + 0.3642065618187189, + 0.14331518858671188, + 0.20249939523637295, + 0.3794330544769764, + 0.18594834581017494, + 0.23896405845880508, + 0.2571166642010212, + 0.061266062781214714, + 1.7785865496844053, + 0.1985441166907549, + 0.0, + 0.36597840674221516, + 1.2808490321040154, + 0.18323899805545807, + 1.4709327705204487, + 0.4956294558942318, + 1.1304052267223597 + ], + "unique_experts": 61, + "load_cv": 0.7006648703043314, + "normalized_load_entropy": 0.9388038926854887, + "max_load_share": 0.044753086419753084 + }, + "full_input": { + "tokens": 133, + "top_k": 6, + "decisions": 798, + "ordered_route_sha256": "27b957bb40d4cdc2c669eea1826c34c9f7c83dd333e8d6b9feca4dc6682f560c", + "route_weight_sha256": "b6cb5488befce52bf30aeaa337794e80e435012dcdceee63d181d782e8b7e8bd", + "loads": [ + 3, + 18, + 9, + 4, + 3, + 11, + 27, + 17, + 5, + 8, + 22, + 14, + 12, + 3, + 9, + 12, + 13, + 25, + 20, + 11, + 4, + 15, + 8, + 16, + 10, + 21, + 10, + 2, + 19, + 25, + 1, + 7, + 2, + 27, + 9, + 11, + 16, + 27, + 9, + 20, + 4, + 2, + 18, + 19, + 40, + 20, + 9, + 14, + 3, + 3, + 5, + 3, + 11, + 10, + 4, + 21, + 8, + 0, + 16, + 21, + 3, + 30, + 10, + 19 + ], + "weighted_loads": [ + 0.29721222072839737, + 0.9395203553140163, + 0.3073547389358282, + 0.15913999266922474, + 0.23200446367263794, + 0.3874069210141897, + 1.788601040840149, + 1.0313040968030691, + 0.18896373733878136, + 0.2790584210306406, + 1.0974944345653057, + 0.5861034858971834, + 0.5908338278532028, + 0.0933191105723381, + 0.4393240325152874, + 0.6829700842499733, + 0.6089817378669977, + 1.5162112396210432, + 1.3712067417800426, + 0.5668960139155388, + 0.16094278916716576, + 0.7015180140733719, + 0.3197402022778988, + 1.3914063181728125, + 0.367920333519578, + 1.4426349345594645, + 0.8001134134829044, + 0.13120748847723007, + 0.8498782925307751, + 1.5038131140172482, + 0.03587690368294716, + 0.38064033165574074, + 0.11402755975723267, + 1.8551945872604847, + 0.27040558867156506, + 0.5880294740200043, + 0.9462175648659468, + 1.607277249917388, + 0.6322578806430101, + 1.1622632667422295, + 0.22022578865289688, + 0.10743632912635803, + 0.6999195870012045, + 1.0974956955760717, + 2.6737125031650066, + 1.6792175993323326, + 0.26763301715254784, + 0.7568777855485678, + 0.17539149895310402, + 0.20249939523637295, + 0.41761473938822746, + 0.18594834581017494, + 0.3831291161477566, + 0.3951015919446945, + 0.14984700456261635, + 1.7785865496844053, + 0.3681847248226404, + 0.0, + 0.5946985725313425, + 1.477769996970892, + 0.18323899805545807, + 1.500724097713828, + 0.4956294558942318, + 1.1680430267006159 + ], + "unique_experts": 63, + "load_cv": 0.6781521417219477, + "normalized_load_entropy": 0.9428508507970288, + "max_load_share": 0.05012531328320802 + } + }, + "s1_x": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "e83944aa57537b7d24de33b994b73545dd8fdc274f6fd0eaa7336078c396128b", + "route_weight_sha256": "c76851000a3094a9d464bc4f4709db6389457c929396191d8017b08b70920435", + "loads": [ + 3, + 14, + 8, + 4, + 3, + 11, + 9, + 18, + 5, + 4, + 12, + 9, + 12, + 1, + 10, + 6, + 12, + 25, + 19, + 11, + 4, + 13, + 11, + 15, + 2, + 20, + 5, + 2, + 16, + 14, + 0, + 7, + 2, + 20, + 6, + 10, + 14, + 29, + 8, + 19, + 5, + 0, + 15, + 17, + 29, + 8, + 5, + 13, + 2, + 6, + 4, + 3, + 4, + 7, + 3, + 21, + 6, + 0, + 9, + 17, + 3, + 28, + 11, + 19 + ], + "weighted_loads": [ + 0.29914359748363495, + 0.7101926691830158, + 0.25387648679316044, + 0.14840135350823402, + 0.2847897782921791, + 0.4037708453834057, + 0.2691464889794588, + 1.0599978547543287, + 0.19264402613043785, + 0.15361937321722507, + 0.524920467287302, + 0.3314694333821535, + 0.5735555347055197, + 0.02769588492810726, + 0.4560983031988144, + 0.18599358387291431, + 0.5839925240725279, + 1.5301949307322502, + 1.2474264241755009, + 0.5507598388940096, + 0.15796241723001003, + 0.6292967684566975, + 0.41645410656929016, + 1.2657715007662773, + 0.08053835481405258, + 1.4234743490815163, + 0.5482294894754887, + 0.12901822477579117, + 0.7088537365198135, + 0.739909628406167, + 0.0, + 0.3885239791125059, + 0.12730013579130173, + 1.3073313627392054, + 0.21475298702716827, + 0.5235202666372061, + 0.7953546233475208, + 1.7173492927104235, + 0.5838160719722509, + 1.1309689227491617, + 0.2556554712355137, + 0.0, + 0.5769690312445164, + 0.9912541043013334, + 1.912024749442935, + 0.463773388415575, + 0.14086650498211384, + 0.4006279204040766, + 0.1353180781006813, + 0.31528746895492077, + 0.44521253928542137, + 0.22976698353886604, + 0.1221774835139513, + 0.25807493180036545, + 0.10179435275495052, + 1.7956501953303814, + 0.237816559150815, + 0.0, + 0.29854476265609264, + 1.2429830580949783, + 0.1812847964465618, + 1.491437241435051, + 0.5291365180164576, + 1.1697468012571335 + ], + "unique_experts": 61, + "load_cv": 0.7223013568548184, + "normalized_load_entropy": 0.9352611145158272, + "max_load_share": 0.044753086419753084 + }, + "full_input": { + "tokens": 149, + "top_k": 6, + "decisions": 894, + "ordered_route_sha256": "c4997525f2b559ae63b403f37800ec6a854b0f7b751b5ac921f326f246b61113", + "route_weight_sha256": "ea065dd4ebbbae2135e6fd9fcab385d71076e63a275f6164ca6885309299244d", + "loads": [ + 8, + 17, + 8, + 4, + 3, + 15, + 37, + 18, + 5, + 5, + 21, + 19, + 12, + 1, + 10, + 14, + 12, + 28, + 23, + 14, + 4, + 17, + 11, + 21, + 8, + 20, + 10, + 2, + 16, + 32, + 8, + 8, + 2, + 32, + 9, + 11, + 19, + 30, + 9, + 20, + 7, + 6, + 24, + 17, + 46, + 20, + 7, + 15, + 4, + 11, + 5, + 3, + 5, + 9, + 5, + 24, + 9, + 12, + 15, + 21, + 4, + 31, + 11, + 20 + ], + "weighted_loads": [ + 0.5023695304989815, + 0.8674797751009464, + 0.25387648679316044, + 0.14840135350823402, + 0.2847897782921791, + 0.5267532914876938, + 2.5444217659533024, + 1.0599978547543287, + 0.19264402613043785, + 0.18417702987790108, + 1.0967822019010782, + 1.0345982387661934, + 0.5735555347055197, + 0.02769588492810726, + 0.4560983031988144, + 0.6901102270931005, + 0.5839925240725279, + 1.6276844553649426, + 1.5612136889249086, + 0.673795422539115, + 0.15796241723001003, + 0.825225492939353, + 0.41645410656929016, + 1.5037211421877146, + 0.30667758360505104, + 1.4234743490815163, + 0.7391664516180754, + 0.12901822477579117, + 0.7088537365198135, + 2.137298407033086, + 0.45745232328772545, + 0.42791871540248394, + 0.12730013579130173, + 2.3039900045841932, + 0.44090376049280167, + 0.5759982261806726, + 1.0923146661370993, + 1.750662935897708, + 0.627701299265027, + 1.172622049227357, + 0.3349314071238041, + 0.2588885612785816, + 1.2901956848800182, + 0.9912541043013334, + 3.3124953787773848, + 1.5735063813626766, + 0.223972262814641, + 0.8007665257900953, + 0.38929837569594383, + 0.560891518369317, + 0.481794111430645, + 0.22976698353886604, + 0.15960312448441982, + 0.3409774638712406, + 0.17278438434004784, + 1.9075564816594124, + 0.3917823415249586, + 0.7433820478618145, + 0.5049535743892193, + 1.4436918273568153, + 0.21031951904296875, + 1.6111030858010054, + 0.5291365180164576, + 1.222870696336031 + ], + "unique_experts": 64, + "load_cv": 0.6720314747982263, + "normalized_load_entropy": 0.9478970278387873, + "max_load_share": 0.05145413870246085 + } + }, + "s0_period": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "2fe12d84cb325ab0faea05b9fb109d878f25a463e29fe3c4714d090409c59cff", + "route_weight_sha256": "25602e6294122161abd65a55606a8ad7ea0ac45cf1f6cb6e6770133707c72d9c", + "loads": [ + 3, + 15, + 9, + 5, + 3, + 10, + 9, + 17, + 5, + 7, + 13, + 9, + 12, + 3, + 10, + 4, + 13, + 21, + 16, + 11, + 4, + 13, + 9, + 15, + 4, + 20, + 7, + 2, + 18, + 11, + 0, + 7, + 2, + 21, + 8, + 11, + 14, + 26, + 8, + 20, + 4, + 0, + 15, + 19, + 28, + 7, + 6, + 10, + 3, + 4, + 5, + 3, + 5, + 7, + 2, + 20, + 6, + 0, + 11, + 18, + 3, + 29, + 10, + 18 + ], + "weighted_loads": [ + 0.29080788791179657, + 0.7777110189199448, + 0.3039484713226557, + 0.21611549332737923, + 0.2550334706902504, + 0.35887479968369007, + 0.2912532426416874, + 1.0224572457373142, + 0.17905023880302906, + 0.23562173917889595, + 0.547861997038126, + 0.33999403193593025, + 0.5897160600870848, + 0.09505618177354336, + 0.46818507835268974, + 0.13239027746021748, + 0.6120135113596916, + 1.3624819051474333, + 1.1004583425819874, + 0.5599015653133392, + 0.15685565769672394, + 0.6320868879556656, + 0.34713026881217957, + 1.316479992121458, + 0.1376078464090824, + 1.413684006780386, + 0.6430629119277, + 0.13627953827381134, + 0.7801224999129772, + 0.7754698600620031, + 0.0, + 0.38328458182513714, + 0.11493055149912834, + 1.3892809934914112, + 0.24750177189707756, + 0.5819414127618074, + 0.8046193439513445, + 1.6111490279436111, + 0.5898748114705086, + 1.176245167851448, + 0.2188653163611889, + 0.0, + 0.5538312382996082, + 1.1355258878320456, + 1.7476123981177807, + 0.44559559039771557, + 0.17106226459145546, + 0.31383020989596844, + 0.1804298534989357, + 0.22953641787171364, + 0.4157135486602783, + 0.2122783027589321, + 0.16640869341790676, + 0.2556144706904888, + 0.0603556539863348, + 1.7494387738406658, + 0.23035687766969204, + 0.0, + 0.36045014671981335, + 1.3063184767961502, + 0.18669208139181137, + 1.4689808432012796, + 0.4930573757737875, + 1.1303094625473022 + ], + "unique_experts": 61, + "load_cv": 0.6897026036278233, + "normalized_load_entropy": 0.9407030619728742, + "max_load_share": 0.044753086419753084 + }, + "full_input": { + "tokens": 133, + "top_k": 6, + "decisions": 798, + "ordered_route_sha256": "fa230eed0a3786066a76d68bc0b794e48457ce6f8454975719a743892ab15a5a", + "route_weight_sha256": "d6f4725f7f591824c160944f04bbe9293a1461e2cdb8645bbc3e487788ec9385", + "loads": [ + 3, + 19, + 9, + 5, + 3, + 11, + 26, + 17, + 5, + 9, + 22, + 14, + 12, + 3, + 11, + 10, + 13, + 23, + 20, + 12, + 4, + 14, + 9, + 16, + 8, + 20, + 10, + 2, + 18, + 25, + 1, + 7, + 2, + 27, + 9, + 11, + 18, + 27, + 8, + 21, + 4, + 4, + 18, + 21, + 39, + 19, + 8, + 12, + 4, + 4, + 6, + 3, + 9, + 10, + 4, + 20, + 9, + 0, + 16, + 22, + 3, + 30, + 10, + 19 + ], + "weighted_loads": [ + 0.29080788791179657, + 1.0790876634418964, + 0.3039484713226557, + 0.21611549332737923, + 0.2550334706902504, + 0.3835425414144993, + 1.8218133859336376, + 1.0224572457373142, + 0.17905023880302906, + 0.3120985757559538, + 1.1407730523496866, + 0.6008805502206087, + 0.5897160600870848, + 0.09505618177354336, + 0.49964267760515213, + 0.4390674438327551, + 0.6120135113596916, + 1.4235794190317392, + 1.3614552598446608, + 0.6049971729516983, + 0.15685565769672394, + 0.6715874373912811, + 0.34713026881217957, + 1.3623239174485207, + 0.36568964272737503, + 1.413684006780386, + 0.7690943069756031, + 0.13627953827381134, + 0.7801224999129772, + 1.5813831891864538, + 0.03713368996977806, + 0.38328458182513714, + 0.11493055149912834, + 1.848727349191904, + 0.27031976729631424, + 0.5819414127618074, + 1.0526982136070728, + 1.6447725929319859, + 0.5898748114705086, + 1.2116458639502525, + 0.2188653163611889, + 0.18906156346201897, + 0.6849992536008358, + 1.241597080603242, + 2.6160844154655933, + 1.492141818627715, + 0.2381528578698635, + 0.7065014336258173, + 0.21250616386532784, + 0.22953641787171364, + 0.4538952335715294, + 0.2122783027589321, + 0.31057375110685825, + 0.39359939843416214, + 0.14893659576773643, + 1.7494387738406658, + 0.39999748580157757, + 0.0, + 0.5771788824349642, + 1.5032394416630268, + 0.18669208139181137, + 1.498772170394659, + 0.4930573757737875, + 1.1679472625255585 + ], + "unique_experts": 63, + "load_cv": 0.663772525883908, + "normalized_load_entropy": 0.9455977594982702, + "max_load_share": 0.04887218045112782 + } + }, + "s1_period": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "b04ca0624ad83885cceab3b804c58492c00b434426def501ad6daff7546de663", + "route_weight_sha256": "4f7a32ba3021ea49c634ef243adb13d0c99dd454b6ec09c2f39a91c9326fbd40", + "loads": [ + 3, + 16, + 7, + 3, + 3, + 12, + 9, + 18, + 4, + 7, + 11, + 9, + 12, + 2, + 9, + 5, + 12, + 22, + 16, + 11, + 3, + 13, + 10, + 15, + 5, + 22, + 6, + 3, + 17, + 14, + 0, + 7, + 2, + 22, + 7, + 10, + 14, + 29, + 9, + 19, + 5, + 0, + 16, + 16, + 29, + 6, + 5, + 11, + 3, + 5, + 5, + 3, + 3, + 6, + 1, + 20, + 6, + 2, + 10, + 18, + 3, + 29, + 9, + 19 + ], + "weighted_loads": [ + 0.29501207917928696, + 0.7615400701761246, + 0.21768347173929214, + 0.10873376205563545, + 0.2824687957763672, + 0.4251564871519804, + 0.2734462358057499, + 1.0570111759006977, + 0.14960026741027832, + 0.24129785783588886, + 0.4644874446094036, + 0.3277731966227293, + 0.5558972451835871, + 0.05453329719603062, + 0.4290555529296398, + 0.1650046594440937, + 0.5885215643793344, + 1.3887912686914206, + 1.0882782451808453, + 0.5597733035683632, + 0.12618711963295937, + 0.6216388829052448, + 0.3780837543308735, + 1.2482971027493477, + 0.1751487459987402, + 1.4874255079776049, + 0.5875022932887077, + 0.1554491352289915, + 0.7463735267519951, + 0.7737370766699314, + 0.0, + 0.3828767891973257, + 0.12622029334306717, + 1.3636801205575466, + 0.23752397671341896, + 0.5286394730210304, + 0.8268295750021935, + 1.7280053570866585, + 0.5983308907598257, + 1.1475598327815533, + 0.2571129519492388, + 0.0, + 0.6195211298763752, + 0.9907069597393274, + 1.862376233562827, + 0.3918650336563587, + 0.14196993224322796, + 0.3391649052500725, + 0.19095627963542938, + 0.28152257204055786, + 0.4641525484621525, + 0.22792617604136467, + 0.09066663682460785, + 0.22946570627391338, + 0.032785385847091675, + 1.7895495854318142, + 0.25144433975219727, + 0.05518016219139099, + 0.3354317210614681, + 1.2895677462220192, + 0.18190017715096474, + 1.4875662960112095, + 0.47485785745084286, + 1.1704384628683329 + ], + "unique_experts": 62, + "load_cv": 0.71806867255387, + "normalized_load_entropy": 0.9377201003241228, + "max_load_share": 0.044753086419753084 + }, + "full_input": { + "tokens": 149, + "top_k": 6, + "decisions": 894, + "ordered_route_sha256": "70c19a3186ca69fd61bf7dcabe88bee54e38ab886905eb6e9631e4d647a640fb", + "route_weight_sha256": "29b8d403fcca6366ab98704cce37d65c4a2aa8ed724135927a35864ba7b6346c", + "loads": [ + 8, + 20, + 7, + 3, + 3, + 15, + 38, + 18, + 4, + 8, + 20, + 20, + 12, + 2, + 9, + 12, + 12, + 25, + 20, + 14, + 3, + 18, + 10, + 20, + 10, + 22, + 10, + 3, + 17, + 34, + 8, + 9, + 2, + 35, + 10, + 11, + 20, + 30, + 10, + 20, + 7, + 6, + 25, + 17, + 46, + 18, + 6, + 13, + 5, + 10, + 6, + 3, + 4, + 8, + 3, + 22, + 9, + 13, + 15, + 22, + 4, + 31, + 9, + 20 + ], + "weighted_loads": [ + 0.4982380121946335, + 1.1096194460988045, + 0.21768347173929214, + 0.10873376205563545, + 0.2824687957763672, + 0.5271969679743052, + 2.526846570894122, + 1.0570111759006977, + 0.14960026741027832, + 0.27185551449656487, + 1.089852062985301, + 1.0670253075659275, + 0.5558972451835871, + 0.05453329719603062, + 0.4290555529296398, + 0.5271745249629021, + 0.5885215643793344, + 1.4838377088308334, + 1.358416983857751, + 0.6828088872134686, + 0.12618711963295937, + 0.8393408879637718, + 0.3780837543308735, + 1.4441116899251938, + 0.46665838174521923, + 1.4874255079776049, + 0.7457326967269182, + 0.1554491352289915, + 0.7463735267519951, + 2.283260725438595, + 0.4549657851457596, + 0.4549806881695986, + 0.12622029334306717, + 2.4356246329844, + 0.46367475017905235, + 0.581117432564497, + 1.182452591136098, + 1.761319000273943, + 0.6422161180526018, + 1.1892129592597485, + 0.3363888878375292, + 0.2607317492365837, + 1.3189238719642162, + 1.0300752017647028, + 3.225162522867322, + 1.3873998410999775, + 0.18289404921233654, + 0.7393035106360912, + 0.4449365772306919, + 0.5271266214549541, + 0.5007341206073761, + 0.22792617604136467, + 0.12809227779507637, + 0.31236823834478855, + 0.10377541743218899, + 1.8618368618190289, + 0.40541012212634087, + 0.7634003348648548, + 0.5126561969518661, + 1.4902765154838562, + 0.21093489974737167, + 1.5730328243225813, + 0.47485785745084286, + 1.2235623579472303 + ], + "unique_experts": 64, + "load_cv": 0.6829058311050802, + "normalized_load_entropy": 0.9468104681482716, + "max_load_share": 0.05145413870246085 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 108, + "ordered_topk_exact_tokens": 60, + "set_exact_tokens": 75, + "mean_set_jaccard": 0.9067460317460319, + "mean_token_weighted_tv": 0.017306299647316337, + "aggregate_load_tv": 0.035493827160493825 + }, + "system_bos": { + "tokens": 108, + "ordered_topk_exact_tokens": 49, + "set_exact_tokens": 74, + "mean_set_jaccard": 0.9060846560846562, + "mean_token_weighted_tv": 0.018839313519290753, + "aggregate_load_tv": 0.037037037037037035 + }, + "system_x": { + "tokens": 108, + "ordered_topk_exact_tokens": 43, + "set_exact_tokens": 58, + "mean_set_jaccard": 0.8617724867724869, + "mean_token_weighted_tv": 0.027123456510404747, + "aggregate_load_tv": 0.04475308641975308 + }, + "system_period": { + "tokens": 108, + "ordered_topk_exact_tokens": 41, + "set_exact_tokens": 62, + "mean_set_jaccard": 0.8683862433862435, + "mean_token_weighted_tv": 0.025948738929367176, + "aggregate_load_tv": 0.041666666666666664 + }, + "bos_at_s0": { + "tokens": 108, + "ordered_topk_exact_tokens": 52, + "set_exact_tokens": 70, + "mean_set_jaccard": 0.8935185185185185, + "mean_token_weighted_tv": 0.02148881593408684, + "aggregate_load_tv": 0.033950617283950615 + }, + "bos_at_s1": { + "tokens": 108, + "ordered_topk_exact_tokens": 44, + "set_exact_tokens": 64, + "mean_set_jaccard": 0.8736772486772487, + "mean_token_weighted_tv": 0.02565907410139011, + "aggregate_load_tv": 0.041666666666666664 + }, + "x_at_s0": { + "tokens": 108, + "ordered_topk_exact_tokens": 48, + "set_exact_tokens": 69, + "mean_set_jaccard": 0.8888888888888888, + "mean_token_weighted_tv": 0.023752714032997137, + "aggregate_load_tv": 0.040123456790123455 + }, + "x_at_s1": { + "tokens": 108, + "ordered_topk_exact_tokens": 37, + "set_exact_tokens": 52, + "mean_set_jaccard": 0.8359788359788362, + "mean_token_weighted_tv": 0.0320954232097224, + "aggregate_load_tv": 0.05864197530864197 + }, + "period_at_s0": { + "tokens": 108, + "ordered_topk_exact_tokens": 52, + "set_exact_tokens": 72, + "mean_set_jaccard": 0.8968253968253969, + "mean_token_weighted_tv": 0.02274273364390764, + "aggregate_load_tv": 0.033950617283950615 + }, + "period_at_s1": { + "tokens": 108, + "ordered_topk_exact_tokens": 41, + "set_exact_tokens": 56, + "mean_set_jaccard": 0.8465608465608467, + "mean_token_weighted_tv": 0.030970208355467075, + "aggregate_load_tv": 0.050925925925925916 + } + } + }, + "layer_14": { + "layer": 14, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "df711cfdcbf76440bafa0e76fa47bfd67fcf42a1d79006ddb133d4106ece802a", + "route_weight_sha256": "d1b6ab89144cda5893bcfa228d7ef1ffb170c797477812201688e212c3e9ac1c", + "loads": [ + 4, + 6, + 1, + 3, + 4, + 18, + 4, + 4, + 7, + 16, + 11, + 31, + 3, + 12, + 14, + 15, + 2, + 4, + 7, + 2, + 15, + 2, + 5, + 17, + 3, + 20, + 33, + 4, + 16, + 7, + 6, + 6, + 5, + 17, + 5, + 12, + 11, + 10, + 7, + 5, + 7, + 8, + 7, + 36, + 2, + 6, + 2, + 11, + 3, + 15, + 22, + 5, + 15, + 38, + 5, + 4, + 29, + 11, + 8, + 14, + 2, + 8, + 8, + 8 + ], + "weighted_loads": [ + 0.3716416247189045, + 0.2994176051579416, + 0.03828677535057068, + 0.0862153060734272, + 0.21579047478735447, + 0.9052010383456945, + 0.21140025183558464, + 0.13682510145008564, + 0.3251309096813202, + 0.9697864111512899, + 0.3717520819045603, + 2.2555618565529585, + 0.10732405632734299, + 0.9100905768573284, + 0.9831148814409971, + 0.7109794076532125, + 0.057863958179950714, + 0.08553753048181534, + 0.2992154285311699, + 0.06514940038323402, + 1.322357527911663, + 0.07029945403337479, + 2.6160919964313507, + 0.8318904750049114, + 0.09680962190032005, + 0.9547065142542124, + 4.676948357373476, + 0.15134389698505402, + 0.9323708470910788, + 0.3488887418061495, + 0.3544035330414772, + 0.20013771019876003, + 0.15681619755923748, + 1.1616872027516365, + 0.1482017245143652, + 0.5684534776955843, + 0.3940496277064085, + 0.9905454851686954, + 0.3126681053545326, + 0.2188771441578865, + 0.21450128220021725, + 0.48562371730804443, + 0.31158571504056454, + 2.536272443830967, + 0.05121853994205594, + 0.2399282343685627, + 0.053735338151454926, + 0.4757489487528801, + 0.36078885942697525, + 0.6831384636461735, + 1.2597100269049406, + 0.16659808158874512, + 0.7228715214878321, + 4.370410304516554, + 0.26936062425374985, + 0.20399564877152443, + 2.981475392356515, + 0.3467440865933895, + 0.29268842772580683, + 0.6083189528435469, + 0.080081757158041, + 0.29612285643815994, + 0.40077562071383, + 0.2519250586628914 + ], + "unique_experts": 64, + "load_cv": 0.8385070307055275, + "normalized_load_entropy": 0.9285136642004492, + "max_load_share": 0.05864197530864197 + }, + "full_input": { + "tokens": 133, + "top_k": 6, + "decisions": 798, + "ordered_route_sha256": "20736c6b90067f2e1efc5e488b0986c9da9ad35b8be5f7c28ffbae7c9879b7aa", + "route_weight_sha256": "9d17985dc1ff46831aa3e1c8897cc6f7d6832a6453f410cde5cfef8303cf1c42", + "loads": [ + 12, + 6, + 1, + 5, + 4, + 28, + 4, + 6, + 7, + 25, + 13, + 34, + 3, + 12, + 14, + 19, + 2, + 4, + 12, + 3, + 15, + 2, + 5, + 28, + 4, + 23, + 39, + 10, + 24, + 7, + 8, + 11, + 5, + 24, + 5, + 12, + 12, + 11, + 9, + 5, + 7, + 8, + 9, + 37, + 4, + 6, + 8, + 13, + 3, + 15, + 25, + 8, + 21, + 44, + 5, + 8, + 30, + 12, + 8, + 25, + 3, + 9, + 8, + 9 + ], + "weighted_loads": [ + 1.0992592796683311, + 0.2994176051579416, + 0.03828677535057068, + 0.16518425196409225, + 0.21579047478735447, + 1.8094633538275957, + 0.21140025183558464, + 0.2097813319414854, + 0.3251309096813202, + 1.5146520230919123, + 0.43775666365399957, + 2.4474966507405043, + 0.10732405632734299, + 0.9100905768573284, + 0.9831148814409971, + 0.8673191908746958, + 0.057863958179950714, + 0.08553753048181534, + 0.6006331127136946, + 0.10500072315335274, + 1.322357527911663, + 0.07029945403337479, + 2.6160919964313507, + 1.298435989767313, + 0.11940568499267101, + 1.071421379223466, + 5.011688683182001, + 0.5466491570696235, + 2.0873423647135496, + 0.3488887418061495, + 0.5150004103779793, + 0.40054896008223295, + 0.15681619755923748, + 1.7353214919567108, + 0.1482017245143652, + 0.5684534776955843, + 0.44723414443433285, + 1.0336967147886753, + 0.43710215925239027, + 0.2188771441578865, + 0.21450128220021725, + 0.48562371730804443, + 0.42442293278872967, + 2.5845507457852364, + 0.11422367626801133, + 0.2399282343685627, + 0.34532310254871845, + 0.5624078139662743, + 0.36078885942697525, + 0.6831384636461735, + 1.366899674758315, + 1.3852998428046703, + 1.4558489862829447, + 4.799814771860838, + 0.26936062425374985, + 0.5275899432599545, + 3.0222281459718943, + 0.3835647851228714, + 0.29268842772580683, + 1.1090455260127783, + 0.10922145657241344, + 0.3011472439393401, + 0.40077562071383, + 0.2831941395998001 + ], + "unique_experts": 64, + "load_cv": 0.7988621061824859, + "normalized_load_entropy": 0.9324614414122285, + "max_load_share": 0.05513784461152882 + } + }, + "s1_eos": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "070b81d12c1da205cbf73ad751f7e1ae3cacfe5a13ac58a93433b9779d265c8d", + "route_weight_sha256": "d9e5cfdb04defc3e020f1ef2f575a250cbd3c26a47efef02de97845a90c23f93", + "loads": [ + 4, + 6, + 1, + 4, + 4, + 19, + 4, + 4, + 7, + 16, + 13, + 30, + 3, + 13, + 12, + 16, + 2, + 5, + 5, + 2, + 16, + 2, + 4, + 16, + 4, + 19, + 33, + 5, + 13, + 6, + 7, + 5, + 4, + 16, + 5, + 11, + 14, + 10, + 6, + 6, + 6, + 8, + 7, + 36, + 3, + 7, + 0, + 11, + 3, + 16, + 22, + 6, + 15, + 39, + 6, + 4, + 29, + 10, + 7, + 15, + 2, + 10, + 7, + 7 + ], + "weighted_loads": [ + 0.3411607164889574, + 0.29110445780679584, + 0.04267754778265953, + 0.11049970984458923, + 0.21446499042212963, + 0.9220370855182409, + 0.21360548958182335, + 0.13409624248743057, + 0.3319763317704201, + 1.0103632137179375, + 0.44753681775182486, + 2.2237799409776926, + 0.11132996901869774, + 0.9776859991252422, + 0.8916397113353014, + 0.7498951237648726, + 0.061040015891194344, + 0.11016372917219996, + 0.23915688693523407, + 0.06599697470664978, + 1.3678164966404438, + 0.07079663500189781, + 2.591385968029499, + 0.7982226926833391, + 0.1233956329524517, + 0.8974122628569603, + 4.6656260173767805, + 0.19522195495665073, + 0.8027884904295206, + 0.3206615634262562, + 0.38824421539902687, + 0.1818637140095234, + 0.12877518124878407, + 1.1621456742286682, + 0.1479124315083027, + 0.532957386225462, + 0.4711527805775404, + 1.022866129875183, + 0.30801259353756905, + 0.25595638155937195, + 0.1895107999444008, + 0.4869909230619669, + 0.3073586691170931, + 2.568643156439066, + 0.05523064895533025, + 0.29013038985431194, + 0.0, + 0.4877001568675041, + 0.36617276445031166, + 0.7107573822140694, + 1.2133419327437878, + 0.19340182654559612, + 0.7354558408260345, + 4.4595348332077265, + 0.28375706262886524, + 0.20305819064378738, + 3.0153798051178455, + 0.3224733229726553, + 0.24476980627514422, + 0.643864668905735, + 0.07880707085132599, + 0.34011172130703926, + 0.3638558704406023, + 0.225724162068218 + ], + "unique_experts": 63, + "load_cv": 0.8408667261164356, + "normalized_load_entropy": 0.9274278539494288, + "max_load_share": 0.06018518518518518 + }, + "full_input": { + "tokens": 149, + "top_k": 6, + "decisions": 894, + "ordered_route_sha256": "2218fa396a826680289e99bd8fcb178bad03bc080bd0eafacd6bd73ff42b0fe5", + "route_weight_sha256": "01a8477002fb9a26edbe6c5661794accb59b44f528e82754a6829c9c843b5fe4", + "loads": [ + 12, + 7, + 1, + 7, + 7, + 35, + 4, + 8, + 9, + 28, + 13, + 33, + 8, + 13, + 12, + 22, + 2, + 5, + 12, + 6, + 18, + 6, + 4, + 26, + 10, + 23, + 38, + 13, + 26, + 7, + 12, + 8, + 6, + 27, + 6, + 12, + 14, + 13, + 9, + 7, + 6, + 8, + 9, + 37, + 5, + 7, + 6, + 14, + 5, + 16, + 36, + 9, + 23, + 48, + 8, + 7, + 30, + 12, + 8, + 34, + 6, + 12, + 9, + 10 + ], + "weighted_loads": [ + 1.1229748521000147, + 0.3434254634194076, + 0.04267754778265953, + 0.22503603994846344, + 0.42218206636607647, + 2.072089582681656, + 0.21360548958182335, + 0.29824966564774513, + 0.5003063157200813, + 1.8482125289738178, + 0.44753681775182486, + 2.4414347391575575, + 0.4620017372071743, + 0.9776859991252422, + 0.8916397113353014, + 0.991822911426425, + 0.061040015891194344, + 0.11016372917219996, + 0.7164411600679159, + 0.26609956845641136, + 1.5951964259147644, + 0.21990932524204254, + 2.591385968029499, + 1.2116046603769064, + 0.40303833596408367, + 1.0576360765844584, + 5.028109962120652, + 0.5083316611126065, + 2.405561638996005, + 0.36952201277017593, + 0.6252665873616934, + 0.26961391791701317, + 0.2102056872099638, + 2.2222796753048897, + 0.19462336227297783, + 0.6123319007456303, + 0.4711527805775404, + 1.3778075985610485, + 0.5086450353264809, + 0.31408679112792015, + 0.1895107999444008, + 0.4869909230619669, + 0.40631298534572124, + 2.6131140775978565, + 0.12081046937964857, + 0.29013038985431194, + 0.3238385859876871, + 0.6041428633034229, + 0.49576572701334953, + 0.7107573822140694, + 2.098602395504713, + 1.4103809129446745, + 1.5488617233932018, + 5.137870443984866, + 0.3676860798150301, + 0.44255752861499786, + 3.066142611205578, + 0.4028346035629511, + 0.3533174640033394, + 1.702077217400074, + 0.36224563606083393, + 0.38636096101254225, + 0.4671055022627115, + 0.33424990018829703 + ], + "unique_experts": 64, + "load_cv": 0.7515679849397305, + "normalized_load_entropy": 0.9409930849472377, + "max_load_share": 0.053691275167785234 + } + }, + "s0_bos": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "260cc944b6c4972a5547224cf7fe0896c311409280ada812f2332e915ec95448", + "route_weight_sha256": "a8cef74ecbfdd4d40c4be8d8a3ac19372850103cc4bf7731cd0626268c6189fd", + "loads": [ + 4, + 7, + 1, + 5, + 4, + 14, + 4, + 3, + 7, + 16, + 11, + 30, + 3, + 11, + 13, + 16, + 2, + 3, + 5, + 2, + 15, + 2, + 4, + 18, + 3, + 20, + 33, + 6, + 17, + 6, + 6, + 6, + 4, + 14, + 5, + 12, + 12, + 10, + 5, + 5, + 7, + 8, + 9, + 40, + 3, + 5, + 2, + 13, + 3, + 15, + 21, + 4, + 13, + 41, + 5, + 4, + 29, + 11, + 10, + 16, + 2, + 9, + 7, + 7 + ], + "weighted_loads": [ + 0.3581003602594137, + 0.33853522315621376, + 0.04080597683787346, + 0.13834061287343502, + 0.21435408107936382, + 0.7576143629848957, + 0.22240419313311577, + 0.10440696217119694, + 0.33009750582277775, + 0.9434941224753857, + 0.3686973887961358, + 2.2182753197848797, + 0.10979383811354637, + 0.8805856592953205, + 1.037427119910717, + 0.7670433390885592, + 0.05660277046263218, + 0.0786450132727623, + 0.22341612726449966, + 0.059021469205617905, + 1.3796628024429083, + 0.08046501129865646, + 2.6252084001898766, + 0.8256412837654352, + 0.09474960155785084, + 0.9819887243211269, + 4.7585980370640755, + 0.20037737302482128, + 1.1238006744533777, + 0.31575269252061844, + 0.37194623053073883, + 0.19801361300051212, + 0.1347815953195095, + 1.0300378873944283, + 0.14918357878923416, + 0.568664837628603, + 0.40550727024674416, + 0.9942139908671379, + 0.2699568551033735, + 0.2270335666835308, + 0.20317869680002332, + 0.4903847686946392, + 0.3691554479300976, + 2.7470255196094513, + 0.0492563066072762, + 0.2186054941266775, + 0.05521002598106861, + 0.5528860427439213, + 0.38884948194026947, + 0.6731185745447874, + 1.1895476840436459, + 0.13118909858167171, + 0.6972798481583595, + 4.554724866524339, + 0.2600364722311497, + 0.2047879956662655, + 2.9791401401162148, + 0.35267898440361023, + 0.3077529687434435, + 0.6940943356603384, + 0.07976793870329857, + 0.3158768489956856, + 0.3624952454119921, + 0.20897112600505352 + ], + "unique_experts": 64, + "load_cv": 0.8685077697264967, + "normalized_load_entropy": 0.9254088056693719, + "max_load_share": 0.06327160493827161 + }, + "full_input": { + "tokens": 133, + "top_k": 6, + "decisions": 798, + "ordered_route_sha256": "e9853b3d7f8cb40b13aba1afe8965b753f15fffe0a8c36ccda89a310d2b8aa9e", + "route_weight_sha256": "f948e0612f6326dc379c4babdd2109a5330d333ca28b2a89c618b1817ceb6031", + "loads": [ + 11, + 7, + 1, + 8, + 4, + 24, + 4, + 4, + 7, + 24, + 13, + 33, + 3, + 12, + 13, + 18, + 2, + 3, + 12, + 3, + 15, + 2, + 4, + 28, + 5, + 24, + 39, + 12, + 26, + 6, + 9, + 10, + 4, + 21, + 5, + 12, + 13, + 11, + 7, + 5, + 7, + 8, + 10, + 41, + 6, + 5, + 8, + 15, + 3, + 15, + 23, + 7, + 19, + 47, + 5, + 8, + 30, + 12, + 11, + 27, + 3, + 9, + 7, + 8 + ], + "weighted_loads": [ + 1.0398234743624926, + 0.33853522315621376, + 0.04080597683787346, + 0.27465022169053555, + 0.21435408107936382, + 1.6618766784667969, + 0.22240419313311577, + 0.13800049386918545, + 0.33009750582277775, + 1.4501178041100502, + 0.434701970545575, + 2.4102101139724255, + 0.10979383811354637, + 0.9198203757405281, + 1.037427119910717, + 0.8678237814456224, + 0.05660277046263218, + 0.0786450132727623, + 0.6948795896023512, + 0.09887279197573662, + 1.3796628024429083, + 0.08046501129865646, + 2.6252084001898766, + 1.2645488269627094, + 0.1595192328095436, + 1.1415774319320917, + 5.0933383628726006, + 0.6514141224324703, + 2.338853904977441, + 0.31575269252061844, + 0.5700098536908627, + 0.3973898086696863, + 0.1347815953195095, + 1.6441240794956684, + 0.14918357878923416, + 0.568664837628603, + 0.4586917869746685, + 1.0373652204871178, + 0.4148964863270521, + 0.2270335666835308, + 0.20317869680002332, + 0.4903847686946392, + 0.4239477887749672, + 2.7953038215637207, + 0.18829922238364816, + 0.2186054941266775, + 0.3360758423805237, + 0.6395449079573154, + 0.38884948194026947, + 0.6731185745447874, + 1.263408649712801, + 0.5472938623279333, + 1.4302573129534721, + 4.984129333868623, + 0.2600364722311497, + 0.5576762445271015, + 3.019892893731594, + 0.3958894796669483, + 0.3507117684930563, + 1.1998590845614672, + 0.10853749327361584, + 0.3158768489956856, + 0.3624952454119921, + 0.24223578535020351 + ], + "unique_experts": 64, + "load_cv": 0.8140657981539927, + "normalized_load_entropy": 0.9309496065133431, + "max_load_share": 0.05889724310776942 + } + }, + "s1_bos": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "3370cc9ebbb6ccd777aa2e46e2d3201540be29c2d9d300bad2256298207c6947", + "route_weight_sha256": "ebc9ff5eec90934ed6ab6ff137b194b7930689fb690db0056bb28fcd1a399bb1", + "loads": [ + 4, + 6, + 1, + 4, + 4, + 15, + 4, + 5, + 8, + 14, + 12, + 31, + 3, + 11, + 13, + 16, + 3, + 5, + 6, + 2, + 14, + 2, + 4, + 15, + 3, + 20, + 34, + 4, + 17, + 6, + 6, + 5, + 5, + 16, + 5, + 12, + 13, + 10, + 6, + 5, + 7, + 7, + 7, + 39, + 3, + 9, + 0, + 14, + 4, + 14, + 20, + 5, + 14, + 41, + 4, + 5, + 29, + 12, + 6, + 15, + 2, + 9, + 7, + 6 + ], + "weighted_loads": [ + 0.34829443134367466, + 0.29281314741820097, + 0.048275288194417953, + 0.11704124137759209, + 0.212876845151186, + 0.7906839456409216, + 0.21103202551603317, + 0.1512640193104744, + 0.36422145925462246, + 0.8535166643559933, + 0.41559377196244895, + 2.276654489338398, + 0.10831128805875778, + 0.876374140381813, + 0.9811561014503241, + 0.7587122581899166, + 0.08698849193751812, + 0.11350573739036918, + 0.2514286767691374, + 0.0673890933394432, + 1.3261654525995255, + 0.07100030407309532, + 2.59533179551363, + 0.7528965026140213, + 0.10311657004058361, + 0.9603076092898846, + 4.743405120447278, + 0.1505145449191332, + 1.0287809036672115, + 0.3158772736787796, + 0.3771936893463135, + 0.17652925662696362, + 0.15817483514547348, + 1.1027524899691343, + 0.14890149235725403, + 0.5688636098057032, + 0.4371682368218899, + 0.9943111427128315, + 0.31793462485074997, + 0.22458254545927048, + 0.19327924004755914, + 0.440811350941658, + 0.30913111567497253, + 2.7600783184170723, + 0.053786814445629716, + 0.3477244768291712, + 0.0, + 0.6010346207767725, + 0.393112912774086, + 0.656979763880372, + 1.1531102247536182, + 0.16514332219958305, + 0.7291509788483381, + 4.636972244828939, + 0.2228705734014511, + 0.22778263315558434, + 2.9647749550640583, + 0.3657556027173996, + 0.19971054093912244, + 0.6400537919253111, + 0.07793658971786499, + 0.31962898187339306, + 0.3690884131938219, + 0.2112011332064867 + ], + "unique_experts": 63, + "load_cv": 0.8639329400948594, + "normalized_load_entropy": 0.925832176051536, + "max_load_share": 0.06327160493827161 + }, + "full_input": { + "tokens": 149, + "top_k": 6, + "decisions": 894, + "ordered_route_sha256": "7881a6b85c513a9350614d3bc70c4c5902027112c015b8a1e473f41ebe83e193", + "route_weight_sha256": "8bf8881308cbb2407bd7d505aaf9d887de78a4ee0eb05030bcefbf7d1d15900c", + "loads": [ + 12, + 7, + 1, + 7, + 7, + 31, + 4, + 8, + 10, + 26, + 12, + 34, + 8, + 11, + 13, + 21, + 3, + 5, + 14, + 6, + 16, + 5, + 4, + 24, + 9, + 24, + 39, + 12, + 31, + 7, + 11, + 8, + 7, + 27, + 6, + 13, + 13, + 13, + 9, + 6, + 7, + 7, + 8, + 40, + 5, + 10, + 6, + 18, + 6, + 14, + 34, + 9, + 22, + 50, + 6, + 8, + 30, + 15, + 7, + 35, + 5, + 10, + 9, + 9 + ], + "weighted_loads": [ + 1.1395541336387396, + 0.34513415303081274, + 0.048275288194417953, + 0.2516193985939026, + 0.42059392109513283, + 1.9407364428043365, + 0.21103202551603317, + 0.2777963764965534, + 0.5325514432042837, + 1.6665504984557629, + 0.41559377196244895, + 2.494309287518263, + 0.45898305624723434, + 0.876374140381813, + 0.9811561014503241, + 0.9608349539339542, + 0.08698849193751812, + 0.11350573739036918, + 0.7368993777781725, + 0.2674916870892048, + 1.553545381873846, + 0.1738014556467533, + 2.59533179551363, + 1.1387883014976978, + 0.3827592730522156, + 1.1230222526937723, + 5.10588906519115, + 0.5460694581270218, + 2.789303183555603, + 0.36473772302269936, + 0.6267895400524139, + 0.31387475691735744, + 0.2396053411066532, + 2.1974494960159063, + 0.19561242312192917, + 0.6482381243258715, + 0.4371682368218899, + 1.349252611398697, + 0.5243441388010979, + 0.2827129550278187, + 0.19327924004755914, + 0.440811350941658, + 0.36196620017290115, + 2.804549239575863, + 0.11936663486994803, + 0.38792010582983494, + 0.3139380905777216, + 0.75489810295403, + 0.5227058753371239, + 0.656979763880372, + 2.0325772538781166, + 0.596426397562027, + 1.5425568614155054, + 5.315307855606079, + 0.30679959058761597, + 0.539461474865675, + 3.0155377611517906, + 0.4956830069422722, + 0.30825819866731763, + 1.7341373581439257, + 0.3317733593285084, + 0.3610879313200712, + 0.47233804501593113, + 0.31972687132656574 + ], + "unique_experts": 64, + "load_cv": 0.7643513213569068, + "normalized_load_entropy": 0.9398229097175564, + "max_load_share": 0.05592841163310962 + } + }, + "s0_x": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "48fc70e28dc7bbdb9b8428cb44891459f71f9ac3dfdb516179ebd52f7686d71c", + "route_weight_sha256": "80782e5ae2ae2c7dcfb52f04a3a646208716ab04a115362003de5091c6d6d648", + "loads": [ + 3, + 6, + 1, + 4, + 4, + 19, + 4, + 4, + 8, + 17, + 12, + 29, + 3, + 12, + 13, + 16, + 3, + 4, + 8, + 2, + 15, + 2, + 4, + 17, + 3, + 20, + 35, + 3, + 16, + 6, + 6, + 6, + 6, + 16, + 3, + 11, + 12, + 10, + 6, + 5, + 6, + 8, + 8, + 38, + 3, + 5, + 0, + 12, + 3, + 15, + 21, + 6, + 13, + 39, + 5, + 4, + 29, + 10, + 7, + 16, + 2, + 9, + 8, + 7 + ], + "weighted_loads": [ + 0.3058417737483978, + 0.27899465477094054, + 0.0401899553835392, + 0.1140552219003439, + 0.21538252010941505, + 0.9428055863827467, + 0.22395221516489983, + 0.12474586255848408, + 0.35869183391332626, + 1.1148292496800423, + 0.4007206854876131, + 2.1633241828531027, + 0.11491762474179268, + 0.9247695803642273, + 1.0064084064215422, + 0.7949819248169661, + 0.08164894580841064, + 0.11538760084658861, + 0.31484249979257584, + 0.059967318549752235, + 1.3206590674817562, + 0.07505819015204906, + 2.659408949315548, + 0.787962943315506, + 0.09412344358861446, + 1.0104959607124329, + 4.81069927662611, + 0.12208092585206032, + 0.9262429568916559, + 0.3219166584312916, + 0.379347313195467, + 0.1963215209543705, + 0.18880494683980942, + 1.1486217603087425, + 0.08721252344548702, + 0.5467865020036697, + 0.40308795496821404, + 0.9719326533377171, + 0.28460609074682, + 0.21403148770332336, + 0.1714912406168878, + 0.4885862208902836, + 0.35290429927408695, + 2.713707320392132, + 0.050236127339303493, + 0.21284298412501812, + 0.0, + 0.5153782702982426, + 0.3881123214960098, + 0.675031989812851, + 1.2207905054092407, + 0.1929342206567526, + 0.6898804884403944, + 4.511479493230581, + 0.25108412094414234, + 0.20481301471590996, + 2.977533070370555, + 0.3166402280330658, + 0.20792673248797655, + 0.6900652460753918, + 0.07700241357088089, + 0.31570346653461456, + 0.3953301478177309, + 0.21311660669744015 + ], + "unique_experts": 63, + "load_cv": 0.8605744156959727, + "normalized_load_entropy": 0.9244481233806382, + "max_load_share": 0.06018518518518518 + }, + "full_input": { + "tokens": 133, + "top_k": 6, + "decisions": 798, + "ordered_route_sha256": "20ccc62591db0acfaaa6e97685ea106babbe68746f19db0b913e2d6bb3b748e4", + "route_weight_sha256": "611e3fef799200772688b2bf7ea2be3937c08c836cf2d02e1b8300e245fbe72f", + "loads": [ + 11, + 6, + 1, + 5, + 4, + 31, + 4, + 5, + 8, + 25, + 14, + 32, + 3, + 13, + 13, + 18, + 3, + 4, + 13, + 4, + 15, + 2, + 4, + 27, + 5, + 24, + 42, + 8, + 24, + 6, + 9, + 10, + 6, + 23, + 3, + 11, + 13, + 12, + 8, + 5, + 6, + 8, + 10, + 39, + 5, + 5, + 6, + 14, + 3, + 15, + 25, + 7, + 19, + 46, + 5, + 8, + 30, + 11, + 7, + 28, + 3, + 9, + 8, + 7 + ], + "weighted_loads": [ + 1.0941222123801708, + 0.27899465477094054, + 0.0401899553835392, + 0.153610123321414, + 0.21538252010941505, + 1.9826450552791357, + 0.22395221516489983, + 0.1583393942564726, + 0.35869183391332626, + 1.560081709176302, + 0.4667252672370523, + 2.3552589770406485, + 0.11491762474179268, + 0.9863856248557568, + 1.0064084064215422, + 0.8698096144944429, + 0.08164894580841064, + 0.11538760084658861, + 0.595933897420764, + 0.17385638691484928, + 1.3206590674817562, + 0.07505819015204906, + 2.659408949315548, + 1.2268704865127802, + 0.1577954739332199, + 1.1633011028170586, + 5.257313758134842, + 0.5040605310350657, + 1.905446009710431, + 0.3219166584312916, + 0.5854886062443256, + 0.3905503898859024, + 0.18880494683980942, + 1.7920995354652405, + 0.08721252344548702, + 0.5467865020036697, + 0.4562724716961384, + 1.0902931801974773, + 0.4214252969250083, + 0.21403148770332336, + 0.1714912406168878, + 0.4885862208902836, + 0.4435942079871893, + 2.761985622346401, + 0.11324126366525888, + 0.21284298412501812, + 0.29536052234470844, + 0.6020371355116367, + 0.3881123214960098, + 0.675031989812851, + 1.3636388704180717, + 0.5266003366559744, + 1.422857953235507, + 5.025701154023409, + 0.25108412094414234, + 0.5275717563927174, + 3.0182858239859343, + 0.3575625456869602, + 0.20792673248797655, + 1.2571409940719604, + 0.10951923951506615, + 0.31570346653461456, + 0.3953301478177309, + 0.21311660669744015 + ], + "unique_experts": 64, + "load_cv": 0.8308072214370581, + "normalized_load_entropy": 0.9285521938347593, + "max_load_share": 0.05764411027568922 + } + }, + "s1_x": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "011d701a38441a2e7a78467b039cc6a4f9b4efb2626bb20ba9f09b9beec573e1", + "route_weight_sha256": "b6798cf95daf1c043e54aa54dde3dfcb617a8f030cc9614cbd4f690aaf841b7e", + "loads": [ + 3, + 6, + 1, + 4, + 4, + 23, + 4, + 4, + 8, + 16, + 11, + 32, + 3, + 13, + 11, + 17, + 3, + 6, + 6, + 2, + 13, + 1, + 4, + 17, + 2, + 21, + 33, + 2, + 13, + 6, + 7, + 5, + 6, + 20, + 5, + 11, + 13, + 10, + 5, + 6, + 7, + 7, + 7, + 40, + 3, + 7, + 0, + 10, + 4, + 14, + 21, + 5, + 13, + 40, + 6, + 5, + 29, + 8, + 7, + 16, + 1, + 7, + 8, + 6 + ], + "weighted_loads": [ + 0.29547491669654846, + 0.27909900806844234, + 0.04730697721242905, + 0.11921356245875359, + 0.2164769284427166, + 1.0676351450383663, + 0.2189767174422741, + 0.13141002506017685, + 0.367654537782073, + 1.0001443326473236, + 0.3746068454347551, + 2.3489306289702654, + 0.11312439292669296, + 0.97407541051507, + 0.8737915307283401, + 0.8221854250878096, + 0.08808290027081966, + 0.1603782749734819, + 0.24744295328855515, + 0.06619364768266678, + 1.2595884315669537, + 0.04657606780529022, + 2.668858513236046, + 0.8091024532914162, + 0.06518757902085781, + 0.9704633690416813, + 4.644933829084039, + 0.09528515860438347, + 0.6478340215981007, + 0.3234313912689686, + 0.42907581478357315, + 0.16923609003424644, + 0.1792760044336319, + 1.3052874617278576, + 0.16368919052183628, + 0.538623683154583, + 0.43843898363411427, + 0.9799394309520721, + 0.2823441345244646, + 0.24699999950826168, + 0.18898174376226962, + 0.4391038753092289, + 0.29659177362918854, + 2.874170746654272, + 0.058554878924041986, + 0.29375793039798737, + 0.0, + 0.4195270240306854, + 0.3806024622172117, + 0.6483466159552336, + 1.2047765348106623, + 0.15823319740593433, + 0.7219749186187983, + 4.70696185156703, + 0.29054941050708294, + 0.2213793657720089, + 3.0206872541457415, + 0.2507816758006811, + 0.24768189154565334, + 0.7294336911290884, + 0.042748235166072845, + 0.26915282383561134, + 0.4003416132181883, + 0.20404578186571598 + ], + "unique_experts": 63, + "load_cv": 0.8896601592195788, + "normalized_load_entropy": 0.9202810814653832, + "max_load_share": 0.06172839506172839 + }, + "full_input": { + "tokens": 149, + "top_k": 6, + "decisions": 894, + "ordered_route_sha256": "30dc9904de6c20dae40cd12f39aae7d4dcae5b11b55e9373d61b3d04f69fa3cd", + "route_weight_sha256": "790d6d29b61ec7479a85c9e90fb830006ff5408a4e9c187430fa330487ae66e0", + "loads": [ + 11, + 7, + 1, + 5, + 7, + 43, + 4, + 7, + 10, + 27, + 11, + 36, + 8, + 13, + 11, + 21, + 3, + 6, + 12, + 6, + 15, + 4, + 4, + 27, + 8, + 25, + 39, + 10, + 25, + 7, + 13, + 8, + 8, + 31, + 6, + 12, + 14, + 14, + 8, + 7, + 7, + 7, + 9, + 41, + 5, + 7, + 5, + 13, + 6, + 14, + 34, + 7, + 21, + 50, + 8, + 8, + 30, + 10, + 8, + 38, + 5, + 8, + 10, + 9 + ], + "weighted_loads": [ + 1.1157378628849983, + 0.3314200136810541, + 0.04730697721242905, + 0.1583598479628563, + 0.42419400438666344, + 2.491091074422002, + 0.2189767174422741, + 0.2579423822462559, + 0.5359845217317343, + 1.6697801388800144, + 0.3746068454347551, + 2.6138862911611795, + 0.4637961611151695, + 0.97407541051507, + 0.8737915307283401, + 0.9779096189886332, + 0.08808290027081966, + 0.1603782749734819, + 0.6768714841455221, + 0.26629624143242836, + 1.4869683608412743, + 0.1493772193789482, + 2.668858513236046, + 1.2497430853545666, + 0.3448302820324898, + 1.1412266846746206, + 5.109081184491515, + 0.45114494673907757, + 1.9719769284129143, + 0.37229184061288834, + 0.6832380779087543, + 0.27588459104299545, + 0.26070651039481163, + 2.4294829331338406, + 0.21040012128651142, + 0.6179981976747513, + 0.47598288767039776, + 1.4295186884701252, + 0.4696826357394457, + 0.3051304090768099, + 0.18898174376226962, + 0.4391038753092289, + 0.40316107124090195, + 2.9186416678130627, + 0.1241346993483603, + 0.29375793039798737, + 0.2842139918357134, + 0.5390311516821384, + 0.5101954247802496, + 0.6483466159552336, + 2.0567726101726294, + 0.5215226132422686, + 1.5353808011859655, + 5.506692096590996, + 0.3744784276932478, + 0.43001431599259377, + 3.0714500602334738, + 0.33966552279889584, + 0.35622954927384853, + 1.9058046955615282, + 0.3274420462548733, + 0.3106117732822895, + 0.5035912450402975, + 0.312571519985795 + ], + "unique_experts": 64, + "load_cv": 0.8133798715291123, + "normalized_load_entropy": 0.9335917275961014, + "max_load_share": 0.05592841163310962 + } + }, + "s0_period": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "a08aa7b45a279af5576cb0020c67a0d02e1f866833a38824f7fabba9d4189943", + "route_weight_sha256": "4727d0fb54d9122fc1a40d695ec5f8232d607b517674307ed41d99af1922b45b", + "loads": [ + 3, + 6, + 1, + 3, + 4, + 18, + 4, + 6, + 7, + 17, + 12, + 30, + 4, + 12, + 13, + 17, + 2, + 3, + 6, + 2, + 15, + 2, + 4, + 17, + 2, + 19, + 34, + 4, + 16, + 6, + 7, + 6, + 5, + 18, + 3, + 12, + 12, + 10, + 5, + 4, + 6, + 8, + 6, + 41, + 3, + 5, + 1, + 10, + 3, + 15, + 21, + 4, + 14, + 39, + 6, + 4, + 29, + 11, + 8, + 17, + 2, + 9, + 8, + 7 + ], + "weighted_loads": [ + 0.31477829813957214, + 0.2927350616082549, + 0.04857131093740463, + 0.08724150992929935, + 0.215515261515975, + 0.9156201910227537, + 0.21199216321110725, + 0.18291909247636795, + 0.3289811033755541, + 1.1048660427331924, + 0.3968020754400641, + 2.214976329356432, + 0.15053053572773933, + 0.912441324442625, + 1.0013840850442648, + 0.8397578522562981, + 0.06305252760648727, + 0.07936097215861082, + 0.2534137051552534, + 0.059890519827604294, + 1.3413915652781725, + 0.07396765053272247, + 2.6524991504848003, + 0.8014527130872011, + 0.06554488651454449, + 0.9425528105348349, + 4.767267886549234, + 0.14345353841781616, + 0.9449437037110329, + 0.32216282188892365, + 0.4075033850967884, + 0.19470993615686893, + 0.15853473357856274, + 1.2835621573030949, + 0.10446569137275219, + 0.5778002757579088, + 0.41979074105620384, + 0.9907512962818146, + 0.27080761827528477, + 0.16926388069987297, + 0.18267570808529854, + 0.48417971655726433, + 0.28537745028734207, + 2.827506899833679, + 0.047804411966353655, + 0.20350243151187897, + 0.023910734802484512, + 0.4330299310386181, + 0.3789685592055321, + 0.6757938284426928, + 1.247687103226781, + 0.13099178299307823, + 0.7337924018502235, + 4.538962844759226, + 0.27480144053697586, + 0.20272336900234222, + 2.982198227196932, + 0.3454287610948086, + 0.2417844943702221, + 0.7248529475182295, + 0.07671774178743362, + 0.32178004272282124, + 0.399083299562335, + 0.19876174023374915 + ], + "unique_experts": 64, + "load_cv": 0.8815713894045532, + "normalized_load_entropy": 0.9218750977949347, + "max_load_share": 0.06327160493827161 + }, + "full_input": { + "tokens": 133, + "top_k": 6, + "decisions": 798, + "ordered_route_sha256": "a252ed8f2605de5d7bfb9bb47dddf8065759195c8bddbaa19dbf28a4e34906aa", + "route_weight_sha256": "b7c1e8d71c36fee44ad5a8b47d6889c0ebd27200f85715d845ba3381f1c3f8e4", + "loads": [ + 11, + 6, + 1, + 4, + 4, + 29, + 4, + 7, + 7, + 25, + 14, + 33, + 4, + 13, + 13, + 20, + 2, + 3, + 11, + 3, + 15, + 2, + 4, + 27, + 4, + 22, + 41, + 10, + 24, + 6, + 10, + 10, + 5, + 25, + 3, + 12, + 14, + 12, + 7, + 4, + 6, + 8, + 7, + 42, + 5, + 5, + 6, + 13, + 3, + 16, + 25, + 5, + 20, + 46, + 6, + 8, + 30, + 12, + 8, + 28, + 3, + 10, + 8, + 7 + ], + "weighted_loads": [ + 1.0441581010818481, + 0.2927350616082549, + 0.04857131093740463, + 0.12679641135036945, + 0.215515261515975, + 1.8909611273556948, + 0.21199216321110725, + 0.21651262417435646, + 0.3289811033755541, + 1.5335567817091942, + 0.4628066571895033, + 2.4069111235439777, + 0.15053053572773933, + 0.9657462500035763, + 1.0013840850442648, + 0.9494365528225899, + 0.06305252760648727, + 0.07936097215861082, + 0.5755257308483124, + 0.09974184259772301, + 1.3413915652781725, + 0.07396765053272247, + 2.6524991504848003, + 1.2403602562844753, + 0.13913455232977867, + 1.0718399491161108, + 5.155970625579357, + 0.5764808189123869, + 2.025262415409088, + 0.32216282188892365, + 0.6109259836375713, + 0.38872687704861164, + 0.15853473357856274, + 1.9046510495245457, + 0.10446569137275219, + 0.5778002757579088, + 0.5167083665728569, + 1.0954570919275284, + 0.39965430088341236, + 0.16926388069987297, + 0.18267570808529854, + 0.48417971655726433, + 0.3271993398666382, + 2.8757852017879486, + 0.11080954829230905, + 0.20350243151187897, + 0.26061942987143993, + 0.5877836383879185, + 0.3789685592055321, + 0.7224645521491766, + 1.4073772747069597, + 0.46465789899230003, + 1.4667698666453362, + 5.049306992441416, + 0.27480144053697586, + 0.5854340046644211, + 3.022950980812311, + 0.383737251162529, + 0.2417844943702221, + 1.2291948217898607, + 0.10688391141593456, + 0.35663251765072346, + 0.399083299562335, + 0.19876174023374915 + ], + "unique_experts": 64, + "load_cv": 0.8441279860505835, + "normalized_load_entropy": 0.9257000055534851, + "max_load_share": 0.05764411027568922 + } + }, + "s1_period": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "c6f14a734d7cfcf4484df2e329193b8757b27ec0e48bea8e2ad0fee79827dbc0", + "route_weight_sha256": "edd5b3213d67bdee2fdd8801abda3fc1a67ed9c16cf3ddc1868f1537ae842911", + "loads": [ + 3, + 6, + 1, + 4, + 4, + 19, + 4, + 5, + 8, + 16, + 11, + 33, + 3, + 11, + 12, + 18, + 2, + 7, + 5, + 2, + 14, + 1, + 4, + 16, + 3, + 20, + 33, + 3, + 14, + 6, + 7, + 5, + 5, + 19, + 6, + 11, + 12, + 10, + 5, + 5, + 5, + 7, + 7, + 43, + 3, + 6, + 0, + 11, + 3, + 15, + 24, + 6, + 14, + 42, + 5, + 4, + 29, + 8, + 5, + 15, + 1, + 8, + 8, + 6 + ], + "weighted_loads": [ + 0.29620446264743805, + 0.2698337188921869, + 0.04638879373669624, + 0.11558764427900314, + 0.21800189279019833, + 0.9331135898828506, + 0.21429189294576645, + 0.162869056686759, + 0.36180604435503483, + 1.0568518824875355, + 0.35233301809057593, + 2.397521672770381, + 0.1116659864783287, + 0.8924103304743767, + 0.9272875599563122, + 0.8654753118753433, + 0.06230051442980766, + 0.16998948343098164, + 0.21585165709257126, + 0.06228121928870678, + 1.2927818819880486, + 0.04388468340039253, + 2.7281560339033604, + 0.7788710724562407, + 0.0991898886859417, + 0.9503849018365145, + 4.604361934587359, + 0.11657365970313549, + 0.7416812554001808, + 0.32871539145708084, + 0.4126407243311405, + 0.16620499826967716, + 0.16125054098665714, + 1.3075470514595509, + 0.18720770254731178, + 0.5410550720989704, + 0.4180826507508755, + 0.9932639636099339, + 0.28143787011504173, + 0.20979019813239574, + 0.11777449236251414, + 0.44570909440517426, + 0.2841453514993191, + 2.970472076907754, + 0.0566843010019511, + 0.26694427244365215, + 0.0, + 0.47158849984407425, + 0.3617468550801277, + 0.6890496853739023, + 1.3116415180265903, + 0.1808401308953762, + 0.7582636941224337, + 4.762039871886373, + 0.24570858292281628, + 0.18996500596404076, + 3.0577053986489773, + 0.24804505705833435, + 0.176116528455168, + 0.6977165061980486, + 0.04149053245782852, + 0.30229019187390804, + 0.39524464681744576, + 0.20388925168663263 + ], + "unique_experts": 63, + "load_cv": 0.9199809146943868, + "normalized_load_entropy": 0.9167637329127377, + "max_load_share": 0.06635802469135803 + }, + "full_input": { + "tokens": 149, + "top_k": 6, + "decisions": 894, + "ordered_route_sha256": "fc3bbf89a5eff7fd9d0e5d78d8cebf6428bcc7f9eac161e3c92d00bcd725133c", + "route_weight_sha256": "49b12e75c2bcc3a497834f789e3a6512b3a61a59e4666e9bf664602c7664cbf7", + "loads": [ + 12, + 7, + 1, + 6, + 7, + 36, + 4, + 8, + 10, + 27, + 11, + 36, + 8, + 11, + 12, + 21, + 2, + 7, + 11, + 6, + 16, + 4, + 4, + 25, + 11, + 24, + 39, + 10, + 27, + 7, + 13, + 9, + 7, + 29, + 7, + 12, + 13, + 14, + 8, + 6, + 5, + 7, + 8, + 45, + 5, + 6, + 5, + 15, + 5, + 16, + 38, + 8, + 22, + 52, + 7, + 7, + 30, + 10, + 6, + 35, + 5, + 9, + 10, + 10 + ], + "weighted_loads": [ + 1.131295584142208, + 0.32215472450479865, + 0.04638879373669624, + 0.19024331495165825, + 0.42571896873414516, + 2.1420241836458445, + 0.21429189294576645, + 0.289401413872838, + 0.5301360283046961, + 1.771533913910389, + 0.35233301809057593, + 2.615176470950246, + 0.46233775466680527, + 0.8924103304743767, + 0.9272875599563122, + 0.9877721406519413, + 0.06230051442980766, + 0.16998948343098164, + 0.6469085793942213, + 0.26238381303846836, + 1.5201618112623692, + 0.14668583497405052, + 2.7281560339033604, + 1.1647628713399172, + 0.48121836595237255, + 1.1129712760448456, + 5.007480965927243, + 0.42357877269387245, + 2.0858295410871506, + 0.3775758408010006, + 0.6694195158779621, + 0.3075963892042637, + 0.24268104694783688, + 2.391645632684231, + 0.23391863331198692, + 0.6204295866191387, + 0.45391329750418663, + 1.4385165721178055, + 0.46594588831067085, + 0.26792060770094395, + 0.11777449236251414, + 0.44570909440517426, + 0.3369804359972477, + 3.0487472098320723, + 0.12226412142626941, + 0.26694427244365215, + 0.28196207992732525, + 0.6214196793735027, + 0.4913398176431656, + 0.7320737857371569, + 2.204957876354456, + 0.5441295467317104, + 1.571669576689601, + 5.521137727424502, + 0.32963760010898113, + 0.487356498837471, + 3.1084682047367096, + 0.33778809010982513, + 0.2846641861833632, + 1.796134291216731, + 0.3246875889599323, + 0.3437491413205862, + 0.498494278639555, + 0.34252503607422113 + ], + "unique_experts": 64, + "load_cv": 0.8160336665557552, + "normalized_load_entropy": 0.9328271417613898, + "max_load_share": 0.058165548098434 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 108, + "ordered_topk_exact_tokens": 52, + "set_exact_tokens": 70, + "mean_set_jaccard": 0.8935185185185185, + "mean_token_weighted_tv": 0.019311312126875337, + "aggregate_load_tv": 0.037037037037037035 + }, + "system_bos": { + "tokens": 108, + "ordered_topk_exact_tokens": 53, + "set_exact_tokens": 64, + "mean_set_jaccard": 0.8736772486772487, + "mean_token_weighted_tv": 0.022137475376776246, + "aggregate_load_tv": 0.040123456790123455 + }, + "system_x": { + "tokens": 108, + "ordered_topk_exact_tokens": 45, + "set_exact_tokens": 60, + "mean_set_jaccard": 0.8591269841269842, + "mean_token_weighted_tv": 0.029216409177967795, + "aggregate_load_tv": 0.046296296296296294 + }, + "system_period": { + "tokens": 108, + "ordered_topk_exact_tokens": 46, + "set_exact_tokens": 63, + "mean_set_jaccard": 0.8670634920634922, + "mean_token_weighted_tv": 0.027332209086226713, + "aggregate_load_tv": 0.0478395061728395 + }, + "bos_at_s0": { + "tokens": 108, + "ordered_topk_exact_tokens": 54, + "set_exact_tokens": 66, + "mean_set_jaccard": 0.878968253968254, + "mean_token_weighted_tv": 0.023605450301181042, + "aggregate_load_tv": 0.040123456790123455 + }, + "bos_at_s1": { + "tokens": 108, + "ordered_topk_exact_tokens": 52, + "set_exact_tokens": 64, + "mean_set_jaccard": 0.8677248677248678, + "mean_token_weighted_tv": 0.026574590421255886, + "aggregate_load_tv": 0.04475308641975309 + }, + "x_at_s0": { + "tokens": 108, + "ordered_topk_exact_tokens": 48, + "set_exact_tokens": 65, + "mean_set_jaccard": 0.8747795414462082, + "mean_token_weighted_tv": 0.024956012525190426, + "aggregate_load_tv": 0.033950617283950615 + }, + "x_at_s1": { + "tokens": 108, + "ordered_topk_exact_tokens": 44, + "set_exact_tokens": 61, + "mean_set_jaccard": 0.8578042328042328, + "mean_token_weighted_tv": 0.030386855507795525, + "aggregate_load_tv": 0.046296296296296294 + }, + "period_at_s0": { + "tokens": 108, + "ordered_topk_exact_tokens": 52, + "set_exact_tokens": 68, + "mean_set_jaccard": 0.8847001763668432, + "mean_token_weighted_tv": 0.023680053367839987, + "aggregate_load_tv": 0.03549382716049383 + }, + "period_at_s1": { + "tokens": 108, + "ordered_topk_exact_tokens": 46, + "set_exact_tokens": 61, + "mean_set_jaccard": 0.8518518518518519, + "mean_token_weighted_tv": 0.0316208402940969, + "aggregate_load_tv": 0.04475308641975309 + } + } + }, + "layer_15": { + "layer": 15, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "f085ad703b7e455911f9a0bd1022bd08983393c8d69f86a435feeae2acee3778", + "route_weight_sha256": "997a02fee44ce64be704491a641a0f80da734397a3678cb070dc5c9c83c17080", + "loads": [ + 17, + 15, + 5, + 13, + 6, + 12, + 16, + 5, + 6, + 20, + 16, + 8, + 5, + 5, + 8, + 14, + 27, + 13, + 7, + 29, + 2, + 5, + 5, + 28, + 7, + 7, + 20, + 9, + 5, + 14, + 12, + 8, + 21, + 5, + 0, + 8, + 15, + 3, + 11, + 8, + 6, + 8, + 13, + 4, + 17, + 1, + 1, + 7, + 20, + 5, + 14, + 5, + 1, + 2, + 16, + 8, + 0, + 3, + 21, + 23, + 5, + 12, + 2, + 14 + ], + "weighted_loads": [ + 0.7470268551260233, + 1.351975429803133, + 0.1770963203161955, + 0.5063600782305002, + 0.45143498480319977, + 0.5170944426208735, + 1.2587495353072882, + 0.16606629453599453, + 0.22183848917484283, + 1.0933204628527164, + 1.0818590242415667, + 0.34159022383391857, + 0.2046932615339756, + 0.22288070991635323, + 0.35743439570069313, + 1.371006727218628, + 2.6264069378376007, + 0.4226642958819866, + 0.3852067720144987, + 2.878557577729225, + 0.11413954198360443, + 0.34105342999100685, + 0.21319956332445145, + 2.7974027693271637, + 0.1875489205121994, + 0.35913582146167755, + 0.9854479003697634, + 0.6556213013827801, + 0.16080036386847496, + 0.4740706756711006, + 0.4855980947613716, + 0.28543949499726295, + 1.4294636584818363, + 0.2179899737238884, + 0.0, + 0.6679436583071947, + 0.5860224701464176, + 0.11338748410344124, + 0.8566164821386337, + 0.31494538858532906, + 0.1963250320404768, + 0.35250020772218704, + 1.3862176835536957, + 0.24265622720122337, + 0.6276783999055624, + 0.03204553574323654, + 0.09520170092582703, + 0.23991546593606472, + 1.7036563381552696, + 0.34667232632637024, + 0.6376498229801655, + 0.813466178253293, + 0.032308027148246765, + 0.08179521188139915, + 0.6597970500588417, + 0.31628165021538734, + 0.0, + 0.17347460612654686, + 3.1975735630840063, + 1.3946945909410715, + 0.22825398296117783, + 0.7580331638455391, + 0.0806353036314249, + 0.6048219986259937 + ], + "unique_experts": 62, + "load_cv": 0.6984861807316364, + "normalized_load_entropy": 0.9400247492757399, + "max_load_share": 0.044753086419753084 + }, + "full_input": { + "tokens": 133, + "top_k": 6, + "decisions": 798, + "ordered_route_sha256": "605ee79d6bb9309d0c15128b65dd1111396a6c71d26a4902e80a35f0a57fdc9c", + "route_weight_sha256": "27396f7396b8d2262638d5c90a698d32525ae8b3126a0a2df98a81496652155a", + "loads": [ + 20, + 15, + 5, + 13, + 12, + 15, + 22, + 7, + 13, + 21, + 20, + 9, + 10, + 5, + 18, + 15, + 34, + 14, + 7, + 31, + 2, + 5, + 5, + 34, + 10, + 8, + 30, + 9, + 9, + 14, + 17, + 8, + 26, + 7, + 0, + 8, + 20, + 3, + 11, + 9, + 12, + 9, + 13, + 7, + 17, + 1, + 1, + 8, + 21, + 14, + 20, + 7, + 6, + 2, + 18, + 12, + 0, + 3, + 22, + 23, + 5, + 15, + 2, + 19 + ], + "weighted_loads": [ + 0.9133570622652769, + 1.351975429803133, + 0.1770963203161955, + 0.5063600782305002, + 0.8394866865128279, + 0.5884454092010856, + 1.6930407006293535, + 0.23095392249524593, + 0.722644854336977, + 1.1247067339718342, + 1.2266833651810884, + 0.37170792557299137, + 0.5947917886078358, + 0.22288070991635323, + 0.735230840742588, + 1.4022094272077084, + 3.315768577158451, + 0.4582408517599106, + 0.3852067720144987, + 3.002073623239994, + 0.11413954198360443, + 0.34105342999100685, + 0.21319956332445145, + 3.1029220297932625, + 0.26399965304881334, + 0.3876001797616482, + 1.6459754463285208, + 0.6556213013827801, + 0.3007082547992468, + 0.4740706756711006, + 0.6927238926291466, + 0.28543949499726295, + 1.8310497011989355, + 0.3077499121427536, + 0.0, + 0.6679436583071947, + 1.3086056979373097, + 0.11338748410344124, + 0.8566164821386337, + 0.3590207099914551, + 0.4833126594312489, + 0.3567757052369416, + 1.3862176835536957, + 0.35756218433380127, + 0.6276783999055624, + 0.03204553574323654, + 0.09520170092582703, + 0.27429731003940105, + 1.7171401306986809, + 1.281953863799572, + 0.9444181062281132, + 0.9009819570928812, + 0.17897967714816332, + 0.08179521188139915, + 0.7297237887978554, + 1.9821233712136745, + 0.0, + 0.17347460612654686, + 3.2431453820317984, + 1.3946945909410715, + 0.22825398296117783, + 0.8757983557879925, + 0.0806353036314249, + 0.8128599766641855 + ], + "unique_experts": 62, + "load_cv": 0.6582991954019789, + "normalized_load_entropy": 0.9451790609554447, + "max_load_share": 0.042606516290726815 + } + }, + "s1_eos": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "8801ce61c364428006b03360380b2bc56c06dcf610f330fd981800e62ac77551", + "route_weight_sha256": "751b13c8889c5922f2bc1e0ecbd709fc29abd7322049a077b5df34f371563b3f", + "loads": [ + 19, + 14, + 5, + 15, + 7, + 16, + 15, + 4, + 7, + 18, + 18, + 6, + 3, + 5, + 9, + 14, + 27, + 10, + 6, + 30, + 3, + 5, + 5, + 31, + 6, + 7, + 21, + 8, + 5, + 12, + 12, + 9, + 22, + 6, + 0, + 8, + 14, + 5, + 11, + 8, + 6, + 7, + 13, + 5, + 17, + 1, + 1, + 4, + 22, + 5, + 15, + 5, + 1, + 2, + 12, + 8, + 2, + 3, + 21, + 22, + 4, + 12, + 3, + 11 + ], + "weighted_loads": [ + 0.810748104006052, + 1.3079606257379055, + 0.1827218346297741, + 0.5695837698876858, + 0.4813879542052746, + 0.6426326390355825, + 1.2480548974126577, + 0.13288663141429424, + 0.246468773111701, + 1.0676246378570795, + 1.1293914671987295, + 0.2899645082652569, + 0.1336190328001976, + 0.22771552577614784, + 0.38965907879173756, + 1.3926756456494331, + 2.6042754873633385, + 0.3303882014006376, + 0.3489651773124933, + 2.9152490328997374, + 0.15274571254849434, + 0.34361372515559196, + 0.19540468975901604, + 2.864190084859729, + 0.21429063379764557, + 0.3763820491731167, + 0.9995813351124525, + 0.6328619122505188, + 0.15489937365055084, + 0.41622912138700485, + 0.47228554263710976, + 0.3236188068985939, + 1.4303015787154436, + 0.2401927337050438, + 0.0, + 0.6855240575969219, + 0.5656844973564148, + 0.1846708208322525, + 0.907524885609746, + 0.3166034035384655, + 0.19959556497633457, + 0.32731614634394646, + 1.3889834601432085, + 0.2826138399541378, + 0.629508001729846, + 0.033007483929395676, + 0.09644649922847748, + 0.14429311826825142, + 1.741591053083539, + 0.35166480019688606, + 0.6755213104188442, + 0.8132018409669399, + 0.031119802966713905, + 0.08485772833228111, + 0.5269126147031784, + 0.30795659869909286, + 0.07368400692939758, + 0.16930595599114895, + 3.2093109879642725, + 1.3984793536365032, + 0.1880268193781376, + 0.7858068346977234, + 0.11478574573993683, + 0.5033150240778923 + ], + "unique_experts": 63, + "load_cv": 0.7178563832151423, + "normalized_load_entropy": 0.9398122357312904, + "max_load_share": 0.047839506172839504 + }, + "full_input": { + "tokens": 149, + "top_k": 6, + "decisions": 894, + "ordered_route_sha256": "fbbeefd1a1a03254340b0022c0aeff5f206ce46d6e35289db9b3c9b4e3d80bff", + "route_weight_sha256": "351d6a2f181859079af37897837dd80cfd80ff40cd16c34f6fe94cc4b9eb1376", + "loads": [ + 38, + 15, + 5, + 15, + 16, + 21, + 27, + 6, + 18, + 19, + 23, + 10, + 9, + 6, + 14, + 23, + 39, + 14, + 7, + 33, + 4, + 6, + 5, + 36, + 11, + 8, + 31, + 10, + 12, + 13, + 18, + 13, + 27, + 9, + 2, + 8, + 20, + 5, + 12, + 10, + 13, + 9, + 13, + 7, + 17, + 2, + 1, + 6, + 25, + 17, + 22, + 7, + 4, + 3, + 13, + 12, + 2, + 9, + 23, + 26, + 4, + 19, + 5, + 17 + ], + "weighted_loads": [ + 2.082350527867675, + 1.3351364731788635, + 0.1827218346297741, + 0.5695837698876858, + 1.0192453246563673, + 0.8481379793956876, + 2.173460593447089, + 0.2065234612673521, + 0.9050775188952684, + 1.0986319202929735, + 1.364178067073226, + 0.6234508454799652, + 0.6320480220019817, + 0.30903976038098335, + 0.5697897095233202, + 2.0384890623390675, + 3.7480009868741035, + 0.4938852544873953, + 0.3983092699199915, + 3.132722010836005, + 0.18131730519235134, + 0.4256559945642948, + 0.19540468975901604, + 3.1079497653990984, + 0.3443972875829786, + 0.4048639088869095, + 1.708789398893714, + 0.7571820206940174, + 0.61694610491395, + 0.45350664108991623, + 0.7027353513985872, + 0.7793874405324459, + 1.8282918352633715, + 0.37020780704915524, + 0.14968668296933174, + 0.6855240575969219, + 1.2520224647596478, + 0.1846708208322525, + 0.939780218526721, + 0.39560841396450996, + 0.47681064577773213, + 0.41950551560148597, + 1.3889834601432085, + 0.5555526129901409, + 0.629508001729846, + 0.07093360275030136, + 0.09644649922847748, + 0.21463855728507042, + 1.883911645039916, + 2.0755248181521893, + 1.014386286959052, + 0.882644284516573, + 0.1093475641682744, + 0.23279325291514397, + 0.5648448020219803, + 1.9562439695000648, + 0.07368400692939758, + 0.8334743212908506, + 3.2913059759885073, + 1.5692125968635082, + 0.1880268193781376, + 1.157210886478424, + 0.2319568246603012, + 0.731020437553525 + ], + "unique_experts": 64, + "load_cv": 0.6600083397299841, + "normalized_load_entropy": 0.9488780046700611, + "max_load_share": 0.0436241610738255 + } + }, + "s0_bos": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "8fb2033a48131d25c7299087db9ee9974d204fb2479ba6bd6cb2441c99abb2d8", + "route_weight_sha256": "163b3eda840040a02cb715ec7ddf2d79bc5f8dc702fb49cbf2799ec715529331", + "loads": [ + 19, + 16, + 5, + 16, + 7, + 10, + 14, + 4, + 7, + 23, + 15, + 7, + 3, + 5, + 8, + 14, + 27, + 11, + 6, + 30, + 2, + 5, + 5, + 30, + 3, + 7, + 19, + 8, + 6, + 10, + 11, + 5, + 22, + 6, + 0, + 11, + 14, + 5, + 7, + 8, + 7, + 10, + 13, + 4, + 17, + 1, + 1, + 9, + 20, + 5, + 15, + 5, + 2, + 2, + 17, + 6, + 2, + 4, + 21, + 22, + 5, + 12, + 3, + 14 + ], + "weighted_loads": [ + 0.8056551739573479, + 1.3869950510561466, + 0.18019447848200798, + 0.6083020213991404, + 0.5068026296794415, + 0.4176026005297899, + 1.256235122680664, + 0.13112605549395084, + 0.25822577252984047, + 1.2146076336503029, + 1.1027545724064112, + 0.3072748798877001, + 0.1336647868156433, + 0.23105499520897865, + 0.3535442389547825, + 1.3624782674014568, + 2.599327653646469, + 0.37676981650292873, + 0.38513029739260674, + 2.891724294051528, + 0.1166151836514473, + 0.34249232709407806, + 0.21613575890660286, + 2.8617953415960073, + 0.0999451968818903, + 0.3540421910583973, + 0.9492515604943037, + 0.665158573538065, + 0.18308589793741703, + 0.3649451248347759, + 0.43645442090928555, + 0.2079073265194893, + 1.4487821608781815, + 0.2485855408012867, + 0.0, + 0.7172842044383287, + 0.5603818316012621, + 0.17668935656547546, + 0.7354317717254162, + 0.3013544864952564, + 0.22144922241568565, + 0.3828062769025564, + 1.3840884510427713, + 0.2657996900379658, + 0.6180626694113016, + 0.03556597977876663, + 0.09414615482091904, + 0.2936524860560894, + 1.6625499408692122, + 0.39523090049624443, + 0.6879765503108501, + 0.7907903641462326, + 0.06786344945430756, + 0.08922703936696053, + 0.7096141185611486, + 0.2132139354944229, + 0.07469533011317253, + 0.18612602539360523, + 3.2268730141222477, + 1.408758107572794, + 0.23836179077625275, + 0.7756159100681543, + 0.12140839919447899, + 0.6123337596654892 + ], + "unique_experts": 63, + "load_cv": 0.7153039968825173, + "normalized_load_entropy": 0.9402023078273508, + "max_load_share": 0.046296296296296294 + }, + "full_input": { + "tokens": 133, + "top_k": 6, + "decisions": 798, + "ordered_route_sha256": "cdc0e0eb7d74a9622701af595bcc76e9fc7feccbafeca35c6dfb33b5fe6ab32d", + "route_weight_sha256": "074e3ce8062db09309ffdb764f0fd91ee5cbc4f1282045afaf40fad4a1ae85cd", + "loads": [ + 22, + 16, + 5, + 16, + 12, + 13, + 19, + 6, + 13, + 24, + 19, + 8, + 8, + 5, + 17, + 15, + 34, + 12, + 6, + 32, + 2, + 5, + 5, + 36, + 5, + 8, + 29, + 8, + 11, + 10, + 16, + 5, + 27, + 8, + 0, + 12, + 19, + 5, + 7, + 9, + 14, + 10, + 13, + 7, + 17, + 1, + 1, + 10, + 21, + 14, + 23, + 8, + 7, + 3, + 20, + 8, + 2, + 4, + 22, + 22, + 5, + 15, + 3, + 19 + ], + "weighted_loads": [ + 0.9656624905765057, + 1.3869950510561466, + 0.18019447848200798, + 0.6083020213991404, + 0.8320734705775976, + 0.5262467321008444, + 1.5698740854859352, + 0.19601368345320225, + 0.7108068987727165, + 1.2459939047694206, + 1.247578913345933, + 0.3373925816267729, + 0.5099319890141487, + 0.23105499520897865, + 0.7212760634720325, + 1.3936809673905373, + 3.322588872164488, + 0.4123463723808527, + 0.38513029739260674, + 3.015240339562297, + 0.1166151836514473, + 0.34249232709407806, + 0.21613575890660286, + 3.167314602062106, + 0.1852606050670147, + 0.3825065493583679, + 1.609779106453061, + 0.665158573538065, + 0.3918408565223217, + 0.3649451248347759, + 0.6645832192152739, + 0.2079073265194893, + 1.8503682035952806, + 0.3383454792201519, + 0.0, + 0.8050311896950006, + 1.3370993537828326, + 0.17668935656547546, + 0.7354317717254162, + 0.343691173940897, + 0.6326789483428001, + 0.3828062769025564, + 1.3840884510427713, + 0.382237795740366, + 0.6180626694113016, + 0.03556597977876663, + 0.09414615482091904, + 0.32803433015942574, + 1.6760337334126234, + 1.3158201910555363, + 1.1155206728726625, + 0.9294939525425434, + 0.2145350994542241, + 0.14685166627168655, + 0.8460407201200724, + 0.8585554957389832, + 0.07469533011317253, + 0.18612602539360523, + 3.2724448330700397, + 1.408758107572794, + 0.23836179077625275, + 0.8933811020106077, + 0.12140839919447899, + 0.8320454470813274 + ], + "unique_experts": 63, + "load_cv": 0.6708510586990564, + "normalized_load_entropy": 0.945671213709534, + "max_load_share": 0.045112781954887216 + } + }, + "s1_bos": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "a2223dc322771b586920878dc1dcf62c7edcca25faa0a81efe05ad287098d695", + "route_weight_sha256": "df32b4710c4f3bc2b64af231e31d54a0ae623a557978f88db14fe5a4d3afd3d3", + "loads": [ + 17, + 16, + 6, + 14, + 7, + 10, + 14, + 4, + 9, + 21, + 17, + 8, + 3, + 5, + 8, + 14, + 27, + 9, + 6, + 29, + 2, + 5, + 5, + 29, + 4, + 6, + 20, + 9, + 6, + 13, + 11, + 6, + 24, + 5, + 0, + 13, + 14, + 4, + 11, + 7, + 7, + 9, + 13, + 4, + 14, + 1, + 1, + 10, + 21, + 4, + 15, + 5, + 2, + 2, + 13, + 7, + 1, + 5, + 21, + 22, + 5, + 13, + 2, + 13 + ], + "weighted_loads": [ + 0.7779957577586174, + 1.4577988237142563, + 0.21095388941466808, + 0.5405380539596081, + 0.4809153489768505, + 0.4247021172195673, + 1.2324331924319267, + 0.13932640850543976, + 0.3148653954267502, + 1.1911728624254465, + 1.1215129140764475, + 0.3443421274423599, + 0.12860262021422386, + 0.21593730710446835, + 0.3524536620825529, + 1.40642948448658, + 2.6141789220273495, + 0.30936774984002113, + 0.37535394728183746, + 2.8360521718859673, + 0.12421135231852531, + 0.3339691460132599, + 0.2029830552637577, + 3.015979850664735, + 0.15670677088201046, + 0.3328895792365074, + 0.9685510247945786, + 0.6874774936586618, + 0.19091213680803776, + 0.4387042969465256, + 0.43034525215625763, + 0.22244898043572903, + 1.484841775149107, + 0.2137141115963459, + 0.0, + 0.8149597514420748, + 0.573904313147068, + 0.13334945775568485, + 0.923940347507596, + 0.27072563767433167, + 0.23911389149725437, + 0.36713019013404846, + 1.385750588029623, + 0.25293827429413795, + 0.5332160424441099, + 0.03407993167638779, + 0.09948714822530746, + 0.3311504665762186, + 1.651590509340167, + 0.3801235929131508, + 0.6809974182397127, + 0.8057379182428122, + 0.0644778199493885, + 0.08308142051100731, + 0.5503883957862854, + 0.25601600483059883, + 0.04718397557735443, + 0.2142793908715248, + 3.2777662109583616, + 1.3884916417300701, + 0.2165501695126295, + 0.8046483732759953, + 0.0798391867429018, + 0.5752905067056417 + ], + "unique_experts": 63, + "load_cv": 0.702619914821343, + "normalized_load_entropy": 0.941154837221052, + "max_load_share": 0.044753086419753084 + }, + "full_input": { + "tokens": 149, + "top_k": 6, + "decisions": 894, + "ordered_route_sha256": "118f803933e01b4d24c3cb22ea1b860ef2cedcd2593183ebbeb80377f0f0bb47", + "route_weight_sha256": "9cef1503b243e187c27acc38e2f93a015f839fdce8062bdf2a875ed316849c7e", + "loads": [ + 37, + 17, + 6, + 14, + 16, + 15, + 26, + 6, + 19, + 22, + 22, + 12, + 9, + 6, + 12, + 23, + 39, + 13, + 7, + 32, + 3, + 6, + 5, + 34, + 9, + 7, + 30, + 11, + 13, + 14, + 17, + 10, + 29, + 8, + 2, + 13, + 21, + 4, + 12, + 9, + 14, + 10, + 13, + 6, + 14, + 2, + 1, + 11, + 24, + 17, + 24, + 7, + 5, + 3, + 15, + 10, + 1, + 11, + 23, + 26, + 5, + 20, + 4, + 18 + ], + "weighted_loads": [ + 2.0976292323321104, + 1.4849746711552143, + 0.21095388941466808, + 0.5405380539596081, + 0.9344254601746798, + 0.6660614926367998, + 2.0736836530268192, + 0.20795008167624474, + 0.9167138710618019, + 1.2221801448613405, + 1.356299513950944, + 0.6778284646570683, + 0.6121977753937244, + 0.29726154170930386, + 0.5211534686386585, + 2.052242901176214, + 3.8039652183651924, + 0.4728648029267788, + 0.42469803988933563, + 3.053525149822235, + 0.15278294496238232, + 0.41601141542196274, + 0.2029830552637577, + 3.2597395312041044, + 0.34833158925175667, + 0.3613714389503002, + 1.67775908857584, + 0.8117976021021605, + 0.6529588680714369, + 0.47598181664943695, + 0.6772278342396021, + 0.678217614069581, + 1.8828320316970348, + 0.34372918494045734, + 0.14968668296933174, + 0.8149597514420748, + 1.3370590517297387, + 0.13334945775568485, + 0.956195680424571, + 0.3487424701452255, + 0.6504142880439758, + 0.45515792816877365, + 1.385750588029623, + 0.5258770473301411, + 0.5332160424441099, + 0.07200605049729347, + 0.09948714822530746, + 0.365204444155097, + 1.793911101296544, + 2.1609241738915443, + 1.1059127859771252, + 0.8751803617924452, + 0.142705581150949, + 0.23101694509387016, + 0.6162394173443317, + 0.9718068577349186, + 0.04718397557735443, + 0.8784477561712265, + 3.3597611989825964, + 1.5592248849570751, + 0.2165501695126295, + 1.176052425056696, + 0.19701026566326618, + 0.7794047947973013 + ], + "unique_experts": 64, + "load_cv": 0.6499834358935032, + "normalized_load_entropy": 0.9494956304102893, + "max_load_share": 0.0436241610738255 + } + }, + "s0_x": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "43a84bbd920620a11ccbfafeaca956a1d689776025c1977d3d8445360c40838c", + "route_weight_sha256": "df8144eb3a8b51a48f66f9db9b96dee4de2583c3b72a49adf65c959a18b5a939", + "loads": [ + 19, + 15, + 5, + 14, + 7, + 9, + 14, + 4, + 10, + 22, + 17, + 7, + 5, + 5, + 7, + 14, + 27, + 10, + 6, + 31, + 3, + 6, + 5, + 30, + 3, + 7, + 20, + 7, + 7, + 13, + 11, + 4, + 24, + 5, + 0, + 11, + 15, + 6, + 7, + 9, + 5, + 8, + 12, + 4, + 17, + 1, + 1, + 6, + 18, + 5, + 16, + 5, + 2, + 2, + 15, + 7, + 2, + 4, + 21, + 23, + 4, + 12, + 3, + 14 + ], + "weighted_loads": [ + 0.7934967242181301, + 1.3795263059437275, + 0.17740774154663086, + 0.5203805100172758, + 0.5132426060736179, + 0.3778106365352869, + 1.3030984550714493, + 0.13510901853442192, + 0.37509942427277565, + 1.1868908293545246, + 1.1605353709310293, + 0.3172160033136606, + 0.189485227689147, + 0.22805674374103546, + 0.34240563213825226, + 1.347015056759119, + 2.732906438410282, + 0.3213149383664131, + 0.3567201253026724, + 2.9504242222756147, + 0.1461227983236313, + 0.36521231941878796, + 0.2067723050713539, + 2.900851871818304, + 0.1248892992734909, + 0.34236158430576324, + 1.0024028941988945, + 0.6334410943090916, + 0.22010628506541252, + 0.4507748782634735, + 0.4389619529247284, + 0.17106017284095287, + 1.5146361589431763, + 0.2040044441819191, + 0.0, + 0.6856891252100468, + 0.5964760482311249, + 0.21145622432231903, + 0.7549031432718039, + 0.3353000544011593, + 0.17209115996956825, + 0.3307645954191685, + 1.3736011758446693, + 0.2731096036732197, + 0.6221212986856699, + 0.03431564196944237, + 0.0936519056558609, + 0.2052356917411089, + 1.6232198532670736, + 0.2833283320069313, + 0.7778371963649988, + 0.741874922066927, + 0.06570364534854889, + 0.09076195955276489, + 0.6332856044173241, + 0.2702461704611778, + 0.07561243325471878, + 0.19136623851954937, + 3.234267570078373, + 1.4533923882991076, + 0.1897821333259344, + 0.7672043051570654, + 0.1189009714871645, + 0.6332925595343113 + ], + "unique_experts": 63, + "load_cv": 0.7218792052367268, + "normalized_load_entropy": 0.9398870987049728, + "max_load_share": 0.047839506172839504 + }, + "full_input": { + "tokens": 133, + "top_k": 6, + "decisions": 798, + "ordered_route_sha256": "9cb69625a7ba03a1c30bddb695da38758a39b39d1251962dd1da52625d0f866d", + "route_weight_sha256": "53c37fa5efeb33ed9e26b05385931292c9777e9324c9b4656ae3245eceda4551", + "loads": [ + 21, + 15, + 5, + 14, + 13, + 10, + 20, + 6, + 17, + 23, + 22, + 8, + 10, + 5, + 16, + 15, + 34, + 11, + 6, + 34, + 3, + 6, + 5, + 37, + 5, + 8, + 32, + 7, + 11, + 13, + 16, + 4, + 29, + 7, + 0, + 11, + 20, + 7, + 7, + 10, + 11, + 8, + 12, + 7, + 17, + 1, + 1, + 7, + 19, + 14, + 23, + 7, + 8, + 3, + 15, + 10, + 2, + 4, + 22, + 23, + 4, + 16, + 3, + 18 + ], + "weighted_loads": [ + 0.8904553167521954, + 1.3795263059437275, + 0.17740774154663086, + 0.5203805100172758, + 0.9002004805952311, + 0.396568963304162, + 1.7469666972756386, + 0.19999664649367332, + 0.8908635526895523, + 1.2182771004736423, + 1.3740951176732779, + 0.3473337050527334, + 0.5686440262943506, + 0.22805674374103546, + 0.7101374566555023, + 1.3782177567481995, + 3.471462979912758, + 0.3568914942443371, + 0.3567201253026724, + 3.1228156108409166, + 0.1461227983236313, + 0.36521231941878796, + 0.2067723050713539, + 3.302782017737627, + 0.18682329915463924, + 0.37082594260573387, + 1.8167324550449848, + 0.6334410943090916, + 0.36001417599618435, + 0.4507748782634735, + 0.6498636044561863, + 0.17106017284095287, + 1.9162222016602755, + 0.2937643826007843, + 0.0, + 0.6856891252100468, + 1.3164665782824159, + 0.2421998418867588, + 0.7549031432718039, + 0.37360601872205734, + 0.4974356070160866, + 0.3307645954191685, + 1.3736011758446693, + 0.4394737221300602, + 0.6221212986856699, + 0.03431564196944237, + 0.0936519056558609, + 0.23961753584444523, + 1.6367036458104849, + 1.1330493278801441, + 1.1059789974242449, + 0.8293907009065151, + 0.2496916288509965, + 0.1253981553018093, + 0.6332856044173241, + 0.9656690768897533, + 0.07561243325471878, + 0.19136623851954937, + 3.279839389026165, + 1.4533923882991076, + 0.1897821333259344, + 0.9509482700377703, + 0.1189009714871645, + 0.7976963985711336 + ], + "unique_experts": 63, + "load_cv": 0.6904886989483288, + "normalized_load_entropy": 0.9439442657380573, + "max_load_share": 0.046365914786967416 + } + }, + "s1_x": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "24dd68307043d2c7605154d0df5ce39368619c4f2e73fc25063b3b3e747631b0", + "route_weight_sha256": "fe8f101809ab0c325f0cdd8ecef50cf0d0f0fb0f2fa76ea2a3fdf53629c9bba9", + "loads": [ + 18, + 15, + 6, + 12, + 6, + 12, + 17, + 3, + 8, + 22, + 16, + 7, + 4, + 4, + 7, + 15, + 29, + 9, + 6, + 30, + 2, + 5, + 5, + 30, + 5, + 6, + 21, + 10, + 8, + 11, + 11, + 6, + 23, + 5, + 0, + 10, + 14, + 2, + 8, + 6, + 7, + 9, + 12, + 3, + 16, + 1, + 1, + 4, + 22, + 5, + 18, + 5, + 1, + 2, + 12, + 10, + 1, + 4, + 21, + 24, + 5, + 13, + 3, + 15 + ], + "weighted_loads": [ + 0.8076617829501629, + 1.3699872829020023, + 0.21335132978856564, + 0.434559540823102, + 0.46644236147403717, + 0.5311244316399097, + 1.2913285288959742, + 0.10796787776052952, + 0.28852054476737976, + 1.2260536327958107, + 1.1061297692358494, + 0.3095301818102598, + 0.15883085504174232, + 0.19078642316162586, + 0.31255205906927586, + 1.4881168771535158, + 2.831054290756583, + 0.2945267017930746, + 0.3508194126188755, + 2.9168269336223602, + 0.12635284289717674, + 0.345040887594223, + 0.1924954615533352, + 3.161743452772498, + 0.16809757612645626, + 0.3186102155596018, + 1.0165177062153816, + 0.7497860379517078, + 0.259367810562253, + 0.39745872281491756, + 0.4564206004142761, + 0.2317903209477663, + 1.475212087854743, + 0.18958579376339912, + 0.0, + 0.7088417708873749, + 0.5382884033024311, + 0.06675318442285061, + 0.8497041501104832, + 0.23841216415166855, + 0.23363225907087326, + 0.3831283897161484, + 1.3729562610387802, + 0.2068871147930622, + 0.5861164592206478, + 0.0342978909611702, + 0.09965121001005173, + 0.11870305240154266, + 1.801502913236618, + 0.2545726001262665, + 0.7866734191775322, + 0.8158428557217121, + 0.03328437730669975, + 0.08415559306740761, + 0.5327228456735611, + 0.3993381131440401, + 0.042421385645866394, + 0.17813264206051826, + 3.2791494112461805, + 1.4437232725322247, + 0.213763028383255, + 0.8128258120268583, + 0.12370665371417999, + 0.6389317810535431 + ], + "unique_experts": 63, + "load_cv": 0.7449469057553377, + "normalized_load_entropy": 0.9348981998859356, + "max_load_share": 0.046296296296296294 + }, + "full_input": { + "tokens": 149, + "top_k": 6, + "decisions": 894, + "ordered_route_sha256": "0baef87879425a5818706883971b1decc4926db641e028f6eff52db5465d1f6c", + "route_weight_sha256": "457e1b28886e9df19f7d40ad44520f6f746a1b56096ab8b4691c1b22dab8e31d", + "loads": [ + 38, + 16, + 6, + 12, + 14, + 15, + 29, + 4, + 20, + 23, + 22, + 11, + 10, + 5, + 11, + 26, + 41, + 13, + 7, + 34, + 3, + 6, + 5, + 36, + 10, + 7, + 32, + 12, + 15, + 13, + 16, + 10, + 29, + 8, + 2, + 10, + 20, + 2, + 9, + 8, + 12, + 11, + 12, + 6, + 16, + 2, + 1, + 6, + 25, + 18, + 24, + 8, + 4, + 3, + 12, + 13, + 1, + 10, + 23, + 28, + 5, + 21, + 5, + 18 + ], + "weighted_loads": [ + 2.0782478731125593, + 1.3971631303429604, + 0.21335132978856564, + 0.434559540823102, + 0.8621921446174383, + 0.6820748075842857, + 2.2269177082926035, + 0.140915771946311, + 1.0222431272268295, + 1.2570609152317047, + 1.3949781209230423, + 0.6430165190249681, + 0.6492712683975697, + 0.2721106577664614, + 0.48125186562538147, + 2.205051129683852, + 4.020013520494103, + 0.45802375487983227, + 0.4001635052263737, + 3.184857912361622, + 0.15492443554103374, + 0.4270831570029259, + 0.1924954615533352, + 3.481933454051614, + 0.33575874753296375, + 0.3470920752733946, + 1.851077988743782, + 0.8741061463952065, + 0.7214145418256521, + 0.46012183651328087, + 0.6540804821997881, + 0.6875589545816183, + 1.9152114372700453, + 0.31960086710751057, + 0.14968668296933174, + 0.7088417708873749, + 1.1654238337650895, + 0.06675318442285061, + 0.8819594830274582, + 0.31184257194399834, + 0.48559161461889744, + 0.5059817284345627, + 1.3729562610387802, + 0.6067138500511646, + 0.5861164592206478, + 0.07222400978207588, + 0.09965121001005173, + 0.19349505752325058, + 1.943823505192995, + 1.901620963588357, + 1.0120051559060812, + 0.9196158200502396, + 0.11151213850826025, + 0.23209111765027046, + 0.5327228456735611, + 1.0837602112442255, + 0.042421385645866394, + 0.84230100736022, + 3.3611443992704153, + 1.6144565157592297, + 0.213763028383255, + 1.235175358131528, + 0.24087773263454437, + 0.7544032093137503 + ], + "unique_experts": 64, + "load_cv": 0.6971794507321122, + "normalized_load_entropy": 0.9430609704459508, + "max_load_share": 0.04586129753914989 + } + }, + "s0_period": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "426141c20c1d43749722c7192ee5dc58156db7580dc89dae1196fba2c52d6ee9", + "route_weight_sha256": "c5bdc7b9d6133315d9b5b370baf9dbebe44cbdc2352cddcc3ee562ad90b4fe16", + "loads": [ + 18, + 16, + 5, + 12, + 7, + 8, + 14, + 5, + 7, + 21, + 15, + 7, + 3, + 5, + 7, + 14, + 26, + 12, + 7, + 30, + 3, + 5, + 5, + 30, + 3, + 6, + 21, + 9, + 7, + 14, + 11, + 5, + 24, + 5, + 0, + 12, + 14, + 5, + 9, + 8, + 5, + 9, + 13, + 4, + 17, + 1, + 2, + 7, + 20, + 5, + 15, + 5, + 2, + 2, + 16, + 7, + 1, + 4, + 21, + 23, + 5, + 13, + 3, + 13 + ], + "weighted_loads": [ + 0.775419432669878, + 1.4273030906915665, + 0.17351270839571953, + 0.46397967264056206, + 0.5075688473880291, + 0.35968171060085297, + 1.305867288261652, + 0.15918612480163574, + 0.2713015042245388, + 1.1639717742800713, + 1.115357855334878, + 0.30860601365566254, + 0.131090696901083, + 0.21933414787054062, + 0.3288519401103258, + 1.425952348858118, + 2.6530914679169655, + 0.3894191384315491, + 0.3870288971811533, + 2.9329149425029755, + 0.13726727664470673, + 0.34753817692399025, + 0.21962862089276314, + 2.8953301031142473, + 0.12664202228188515, + 0.31057530269026756, + 1.0352408308535814, + 0.6934921573847532, + 0.22582760080695152, + 0.47367978654801846, + 0.4412994384765625, + 0.2066635899245739, + 1.5139896292239428, + 0.20437736809253693, + 0.0, + 0.7201183307915926, + 0.5598158743232489, + 0.17701706290245056, + 0.807522214949131, + 0.29789943993091583, + 0.17253943905234337, + 0.35745466127991676, + 1.4050460029393435, + 0.26711028441786766, + 0.6320977415889502, + 0.03476237133145332, + 0.12208166904747486, + 0.23725936189293861, + 1.7405989430844784, + 0.3327172063291073, + 0.7603181973099709, + 0.7940831035375595, + 0.06421713903546333, + 0.0881948359310627, + 0.6725201718509197, + 0.27539511770009995, + 0.043369781225919724, + 0.19181674160063267, + 3.285432865843177, + 1.4451052509248257, + 0.22880765050649643, + 0.7819172609597445, + 0.1222979985177517, + 0.5738843120634556 + ], + "unique_experts": 63, + "load_cv": 0.7138108901468525, + "normalized_load_entropy": 0.9406697090720333, + "max_load_share": 0.046296296296296294 + }, + "full_input": { + "tokens": 133, + "top_k": 6, + "decisions": 798, + "ordered_route_sha256": "046ed438b6d29bb1035ac3fa2f80862659a93855a7cfb7c3f5611fe1d1f65bee", + "route_weight_sha256": "dd2c26d15142c5bbc2ff6d5ffb5112defaa6aadf30caa1cb22767ab618a13860", + "loads": [ + 20, + 16, + 5, + 12, + 13, + 9, + 21, + 7, + 15, + 22, + 19, + 9, + 8, + 5, + 16, + 15, + 33, + 14, + 7, + 32, + 3, + 5, + 5, + 37, + 6, + 7, + 32, + 9, + 11, + 14, + 16, + 5, + 29, + 7, + 0, + 12, + 19, + 5, + 9, + 9, + 11, + 11, + 13, + 6, + 17, + 1, + 2, + 8, + 21, + 13, + 22, + 7, + 7, + 2, + 16, + 10, + 1, + 4, + 23, + 23, + 5, + 17, + 3, + 17 + ], + "weighted_loads": [ + 0.873785961419344, + 1.4273030906915665, + 0.17351270839571953, + 0.46397967264056206, + 0.9319395739585161, + 0.3784400373697281, + 1.74942771717906, + 0.22407375276088715, + 0.8324545286595821, + 1.195358045399189, + 1.2601821962743998, + 0.37148360162973404, + 0.48408203199505806, + 0.21933414787054062, + 0.6965837646275759, + 1.4571550488471985, + 3.376120187342167, + 0.45960358902812004, + 0.3870288971811533, + 3.0564309880137444, + 0.13726727664470673, + 0.34753817692399025, + 0.21962862089276314, + 3.2940493170171976, + 0.24103515408933163, + 0.3390396609902382, + 1.736775690689683, + 0.6934921573847532, + 0.36573549173772335, + 0.47367978654801846, + 0.6610258109867573, + 0.2066635899245739, + 1.915575671941042, + 0.29413730651140213, + 0.0, + 0.7201183307915926, + 1.299024342559278, + 0.17701706290245056, + 0.807522214949131, + 0.33640850707888603, + 0.5767511837184429, + 0.4351366050541401, + 1.4050460029393435, + 0.3510081060230732, + 0.6320977415889502, + 0.03476237133145332, + 0.12208166904747486, + 0.27164120599627495, + 1.7540827356278896, + 1.1087267026305199, + 1.0775070823729038, + 0.8815988823771477, + 0.2108887890353799, + 0.0881948359310627, + 0.6725201718509197, + 0.9799504764378071, + 0.043369781225919724, + 0.19181674160063267, + 3.3811474349349737, + 1.4451052509248257, + 0.22880765050649643, + 1.0383596923202276, + 0.1222979985177517, + 0.7394762691110373 + ], + "unique_experts": 63, + "load_cv": 0.6751816437606113, + "normalized_load_entropy": 0.9456601661052517, + "max_load_share": 0.046365914786967416 + } + }, + "s1_period": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "1216b63724d606d1540381527c4cfab824d4d79b4c9ffc27a1d7fc8948d7de5b", + "route_weight_sha256": "d28ce91b07a14a3c962a991004b2f5ee50b81faf2712acc10b646116bb868972", + "loads": [ + 19, + 16, + 7, + 10, + 7, + 11, + 16, + 3, + 5, + 23, + 17, + 7, + 3, + 5, + 5, + 15, + 30, + 9, + 6, + 29, + 2, + 5, + 5, + 32, + 5, + 6, + 21, + 9, + 7, + 10, + 12, + 6, + 22, + 6, + 0, + 9, + 16, + 4, + 9, + 11, + 5, + 9, + 13, + 3, + 13, + 1, + 1, + 4, + 22, + 6, + 17, + 6, + 2, + 2, + 11, + 11, + 1, + 3, + 21, + 24, + 5, + 12, + 3, + 13 + ], + "weighted_loads": [ + 0.8414262272417545, + 1.4191006980836391, + 0.22797713242471218, + 0.36777582578361034, + 0.48326392844319344, + 0.47672765888273716, + 1.3084491938352585, + 0.10465754196047783, + 0.1939861960709095, + 1.2550863064825535, + 1.121709892526269, + 0.3166197557002306, + 0.12622487545013428, + 0.2229122780263424, + 0.242857925593853, + 1.5293336510658264, + 2.871276257559657, + 0.2860608883202076, + 0.3555958066135645, + 2.926859550178051, + 0.12053469195961952, + 0.3455464579164982, + 0.1899115052074194, + 3.2062120866030455, + 0.17108951695263386, + 0.3204951286315918, + 1.0173548106104136, + 0.705792773514986, + 0.23674789257347584, + 0.35829862765967846, + 0.4898130428045988, + 0.22631848230957985, + 1.4544216766953468, + 0.22140073776245117, + 0.0, + 0.7065534014254808, + 0.604368569329381, + 0.12143661826848984, + 0.8613783940672874, + 0.38211140036582947, + 0.17556221596896648, + 0.3677489925175905, + 1.4090009834617376, + 0.21798521652817726, + 0.504810243844986, + 0.03342847898602486, + 0.09926760941743851, + 0.12037751823663712, + 1.8802274242043495, + 0.34169629216194153, + 0.8088345807045698, + 0.8103745076805353, + 0.06467248126864433, + 0.08234171941876411, + 0.49064832367002964, + 0.4252562653273344, + 0.04430524259805679, + 0.15733704902231693, + 3.2837311755865812, + 1.4485225081443787, + 0.2131658010184765, + 0.7773960418999195, + 0.12300737202167511, + 0.573321221396327 + ], + "unique_experts": 63, + "load_cv": 0.7488242066232469, + "normalized_load_entropy": 0.9354683622709509, + "max_load_share": 0.04938271604938271 + }, + "full_input": { + "tokens": 149, + "top_k": 6, + "decisions": 894, + "ordered_route_sha256": "0cdba54e954df46f868391ce4b4a3d2ff716c2f9e304b2725dc1af0065e3d1fd", + "route_weight_sha256": "ebaab0528dd07769075336cefc1f3f9b1842070bc7b295983f81ae00f1a3e11f", + "loads": [ + 39, + 17, + 7, + 10, + 16, + 14, + 28, + 4, + 17, + 24, + 23, + 11, + 9, + 6, + 9, + 26, + 42, + 14, + 7, + 32, + 3, + 6, + 5, + 37, + 9, + 7, + 32, + 11, + 14, + 12, + 17, + 10, + 27, + 10, + 2, + 9, + 22, + 4, + 10, + 13, + 11, + 12, + 13, + 6, + 13, + 2, + 1, + 5, + 25, + 18, + 24, + 8, + 5, + 3, + 11, + 14, + 1, + 9, + 24, + 28, + 5, + 20, + 5, + 16 + ], + "weighted_loads": [ + 2.0869632568210363, + 1.4462765455245972, + 0.22797713242471218, + 0.36777582578361034, + 0.9549314174801111, + 0.6276780348271132, + 2.2902747951447964, + 0.1376054361462593, + 0.8875480405986309, + 1.2860935889184475, + 1.3863969426602125, + 0.6501060929149389, + 0.6103587634861469, + 0.3042365126311779, + 0.4115577321499586, + 2.2536648251116276, + 4.061462556943297, + 0.4879043325781822, + 0.40493989922106266, + 3.144332528114319, + 0.14910628460347652, + 0.42758872732520103, + 0.1899115052074194, + 3.449971767142415, + 0.29749320447444916, + 0.3489769883453846, + 1.773044066503644, + 0.8301128819584846, + 0.698794623836875, + 0.4276487100869417, + 0.6874729245901108, + 0.6820871159434319, + 1.8524119332432747, + 0.3849520217627287, + 0.14968668296933174, + 0.7065534014254808, + 1.3559187268838286, + 0.12143661826848984, + 0.8936337269842625, + 0.4539867453277111, + 0.5327799916267395, + 0.5275977458804846, + 1.4090009834617376, + 0.5397989340126514, + 0.504810243844986, + 0.07135459780693054, + 0.09926760941743851, + 0.15443149581551552, + 2.0225480161607265, + 1.9327246062457561, + 1.0881726182997227, + 0.8798169512301683, + 0.14290024247020483, + 0.23027724400162697, + 0.49064832367002964, + 1.1155825424939394, + 0.04430524259805679, + 0.8215054143220186, + 3.4279662128537893, + 1.6192557513713837, + 0.2131658010184765, + 1.329088781028986, + 0.2401784509420395, + 0.6887926496565342 + ], + "unique_experts": 64, + "load_cv": 0.6947632507954031, + "normalized_load_entropy": 0.9442692965204503, + "max_load_share": 0.04697986577181208 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 108, + "ordered_topk_exact_tokens": 56, + "set_exact_tokens": 63, + "mean_set_jaccard": 0.8742063492063492, + "mean_token_weighted_tv": 0.022458389306578924, + "aggregate_load_tv": 0.0478395061728395 + }, + "system_bos": { + "tokens": 108, + "ordered_topk_exact_tokens": 50, + "set_exact_tokens": 69, + "mean_set_jaccard": 0.8897707231040565, + "mean_token_weighted_tv": 0.022236927645280957, + "aggregate_load_tv": 0.040123456790123455 + }, + "system_x": { + "tokens": 108, + "ordered_topk_exact_tokens": 43, + "set_exact_tokens": 57, + "mean_set_jaccard": 0.8531746031746033, + "mean_token_weighted_tv": 0.03127507565336095, + "aggregate_load_tv": 0.05555555555555555 + }, + "system_period": { + "tokens": 108, + "ordered_topk_exact_tokens": 42, + "set_exact_tokens": 56, + "mean_set_jaccard": 0.8450176366843034, + "mean_token_weighted_tv": 0.029995287906516482, + "aggregate_load_tv": 0.06172839506172839 + }, + "bos_at_s0": { + "tokens": 108, + "ordered_topk_exact_tokens": 48, + "set_exact_tokens": 64, + "mean_set_jaccard": 0.8736772486772487, + "mean_token_weighted_tv": 0.024217255905063614, + "aggregate_load_tv": 0.05246913580246913 + }, + "bos_at_s1": { + "tokens": 108, + "ordered_topk_exact_tokens": 49, + "set_exact_tokens": 61, + "mean_set_jaccard": 0.8539241622574956, + "mean_token_weighted_tv": 0.029701056381411576, + "aggregate_load_tv": 0.05709876543209876 + }, + "x_at_s0": { + "tokens": 108, + "ordered_topk_exact_tokens": 43, + "set_exact_tokens": 57, + "mean_set_jaccard": 0.85163139329806, + "mean_token_weighted_tv": 0.02961769602606418, + "aggregate_load_tv": 0.05555555555555555 + }, + "x_at_s1": { + "tokens": 108, + "ordered_topk_exact_tokens": 39, + "set_exact_tokens": 48, + "mean_set_jaccard": 0.8155643738977074, + "mean_token_weighted_tv": 0.03685669471613235, + "aggregate_load_tv": 0.06018518518518518 + }, + "period_at_s0": { + "tokens": 108, + "ordered_topk_exact_tokens": 44, + "set_exact_tokens": 62, + "mean_set_jaccard": 0.8636243386243386, + "mean_token_weighted_tv": 0.027895342541375646, + "aggregate_load_tv": 0.044753086419753084 + }, + "period_at_s1": { + "tokens": 108, + "ordered_topk_exact_tokens": 37, + "set_exact_tokens": 49, + "mean_set_jaccard": 0.817199775533109, + "mean_token_weighted_tv": 0.03676058935794841, + "aggregate_load_tv": 0.06172839506172839 + } + } + }, + "layer_16": { + "layer": 16, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "d32cdcaef8f4d367475571a3c0ca194a45479b07cfb883fcba64300fdbab97e1", + "route_weight_sha256": "b85e87e58b3be0d417ba8a23331cff242c4235f6c7241ee9b4dafff5d363cb80", + "loads": [ + 6, + 2, + 8, + 5, + 12, + 10, + 4, + 5, + 5, + 9, + 33, + 12, + 5, + 11, + 36, + 20, + 9, + 11, + 22, + 7, + 30, + 29, + 3, + 5, + 9, + 9, + 12, + 4, + 14, + 4, + 5, + 8, + 10, + 7, + 16, + 14, + 11, + 4, + 5, + 2, + 2, + 12, + 10, + 14, + 10, + 10, + 14, + 7, + 5, + 9, + 3, + 5, + 7, + 5, + 16, + 35, + 8, + 7, + 6, + 8, + 4, + 10, + 3, + 5 + ], + "weighted_loads": [ + 0.2954440973699093, + 0.07998917251825333, + 0.3769633937627077, + 0.27721741423010826, + 0.5289997179061174, + 0.37929197400808334, + 0.15428153052926064, + 0.2494092471897602, + 0.19718311540782452, + 0.3353410270065069, + 2.427557062357664, + 0.5260850843042135, + 0.14905760250985622, + 0.4272795785218477, + 4.80859287828207, + 2.173208687454462, + 0.43218131735920906, + 0.7325185090303421, + 0.8781995885074139, + 0.2525962647050619, + 3.28412495739758, + 1.6338610034435987, + 0.12577777728438377, + 0.3535941280424595, + 0.7527601346373558, + 0.5973551757633686, + 0.5780720263719559, + 0.7754072025418282, + 1.002148998901248, + 0.12012111954391003, + 0.18109453096985817, + 0.25668468698859215, + 0.37104650773108006, + 0.2824039123952389, + 0.6559939626604319, + 0.9556084368377924, + 0.6180382538586855, + 0.20300851203501225, + 0.1890101470053196, + 0.0724952183663845, + 0.06792635470628738, + 0.8129751645028591, + 0.3762005716562271, + 1.0508964862674475, + 0.37033696100115776, + 0.6212011445313692, + 0.6099254544824362, + 0.4833953268826008, + 0.46492451056838036, + 0.6819950360804796, + 0.1403004489839077, + 0.18703936412930489, + 0.4184418376535177, + 0.3776235915720463, + 1.6545098088681698, + 2.3616681955754757, + 0.5069015063345432, + 0.3241044580936432, + 0.24200554937124252, + 0.6113387532532215, + 0.1640102919191122, + 0.35761362314224243, + 0.11558103933930397, + 0.17856910452246666 + ], + "unique_experts": 64, + "load_cv": 0.7691070680085196, + "normalized_load_entropy": 0.9425977510806853, + "max_load_share": 0.05555555555555555 + }, + "full_input": { + "tokens": 133, + "top_k": 6, + "decisions": 798, + "ordered_route_sha256": "15a554ddaeb757c66a6329994ae5df9d848771c8b1e9b2fa63f109e6b448765e", + "route_weight_sha256": "09acb6252444259e0d2330b241cb1a5f385f5935f90188ebc16f03efb7678ac7", + "loads": [ + 6, + 2, + 8, + 5, + 12, + 18, + 9, + 5, + 5, + 12, + 37, + 12, + 5, + 12, + 36, + 26, + 19, + 14, + 28, + 8, + 41, + 31, + 5, + 5, + 14, + 9, + 19, + 4, + 14, + 4, + 7, + 8, + 11, + 14, + 16, + 14, + 11, + 14, + 5, + 2, + 4, + 20, + 12, + 16, + 14, + 11, + 14, + 7, + 5, + 9, + 3, + 7, + 7, + 16, + 16, + 45, + 8, + 7, + 6, + 8, + 8, + 13, + 3, + 12 + ], + "weighted_loads": [ + 0.2954440973699093, + 0.07998917251825333, + 0.3769633937627077, + 0.27721741423010826, + 0.5289997179061174, + 1.1538832783699036, + 0.3708999566733837, + 0.2494092471897602, + 0.19718311540782452, + 1.7310230787843466, + 2.692884925752878, + 0.5260850843042135, + 0.14905760250985622, + 0.44638353772461414, + 4.80859287828207, + 2.6955791115760803, + 0.9878229764290154, + 0.9438643604516983, + 1.4816371705383062, + 0.2550583176780492, + 4.253962347283959, + 1.7144237402826548, + 0.24939268454909325, + 0.3535941280424595, + 1.250071857124567, + 0.5973551757633686, + 1.016717268154025, + 0.7754072025418282, + 1.002148998901248, + 0.12012111954391003, + 0.27588714845478535, + 0.25668468698859215, + 0.4115170110017061, + 0.6095827305689454, + 0.6559939626604319, + 0.9556084368377924, + 0.6180382538586855, + 0.7039794009178877, + 0.1890101470053196, + 0.0724952183663845, + 0.14924564212560654, + 1.6582153253257275, + 0.4628216400742531, + 1.232505226507783, + 0.5711641609668732, + 0.6886157784610987, + 0.6099254544824362, + 0.4833953268826008, + 0.46492451056838036, + 0.6819950360804796, + 0.1403004489839077, + 0.2881264016032219, + 0.4184418376535177, + 1.1508472356945276, + 1.6545098088681698, + 3.1571326851844788, + 0.5069015063345432, + 0.3241044580936432, + 0.24200554937124252, + 0.6113387532532215, + 0.3934973422437906, + 0.455921484506689, + 0.11558103933930397, + 0.4804653562605381 + ], + "unique_experts": 64, + "load_cv": 0.7430686740319149, + "normalized_load_entropy": 0.9444192966296047, + "max_load_share": 0.05639097744360902 + } + }, + "s1_eos": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "ebec71c64fc63d1dc47790402fd27ec3992f2ff707d6bb17e02f1a0dcfa5ef0d", + "route_weight_sha256": "8a62276ef1b5275ca7de35585e75100c4aeb46c8a62ab87ab6fa05a7651b65f4", + "loads": [ + 5, + 2, + 10, + 5, + 10, + 10, + 3, + 6, + 4, + 8, + 33, + 11, + 5, + 9, + 36, + 20, + 8, + 12, + 19, + 8, + 33, + 28, + 3, + 5, + 10, + 9, + 11, + 4, + 12, + 6, + 6, + 7, + 9, + 9, + 17, + 14, + 13, + 5, + 5, + 2, + 2, + 12, + 9, + 12, + 10, + 10, + 15, + 8, + 4, + 9, + 3, + 5, + 8, + 5, + 15, + 34, + 9, + 7, + 6, + 9, + 5, + 12, + 3, + 4 + ], + "weighted_loads": [ + 0.26828115060925484, + 0.08605246245861053, + 0.43859834037721157, + 0.2687266729772091, + 0.43980567157268524, + 0.3875322975218296, + 0.12768372893333435, + 0.3040420338511467, + 0.17543355002999306, + 0.3109849486500025, + 2.4121633414179087, + 0.47397548519074917, + 0.1476377695798874, + 0.3639556895941496, + 4.868704652413726, + 2.198125448077917, + 0.34486051090061665, + 0.75807842053473, + 0.751469062641263, + 0.29203227162361145, + 3.41264677233994, + 1.6173024903982878, + 0.14520715177059174, + 0.3546294942498207, + 0.7737244237214327, + 0.6058029495179653, + 0.5276684779673815, + 0.8502183482050896, + 0.9230531863868237, + 0.1887591890990734, + 0.21653329581022263, + 0.22295991145074368, + 0.3426232747733593, + 0.35410977341234684, + 0.6660243775695562, + 0.9891598671674728, + 0.6547036543488503, + 0.21993977949023247, + 0.18882011994719505, + 0.0648582223802805, + 0.062328796833753586, + 0.8754667546600103, + 0.32690678909420967, + 0.9624117091298103, + 0.3887036629021168, + 0.6217372082173824, + 0.6491625644266605, + 0.5170536637306213, + 0.4304983802139759, + 0.646521681919694, + 0.13298450782895088, + 0.18618728779256344, + 0.47798153944313526, + 0.37179652228951454, + 1.6393776461482048, + 2.3287567384541035, + 0.5442512333393097, + 0.3344895914196968, + 0.24020222201943398, + 0.6290347389876842, + 0.19211349450051785, + 0.4778888300061226, + 0.1085687093436718, + 0.142051313072443 + ], + "unique_experts": 64, + "load_cv": 0.763737670529459, + "normalized_load_entropy": 0.9436060814807424, + "max_load_share": 0.05555555555555555 + }, + "full_input": { + "tokens": 149, + "top_k": 6, + "decisions": 894, + "ordered_route_sha256": "880c5d1b01517b2581a735e12a6cb4952400cd740977e417ff71220a847812df", + "route_weight_sha256": "ea256cd813d746c64832ad06e99916a891db2739883f40094445328bba26e1b8", + "loads": [ + 5, + 5, + 10, + 7, + 10, + 19, + 8, + 7, + 4, + 13, + 39, + 12, + 5, + 14, + 37, + 30, + 18, + 22, + 26, + 10, + 44, + 30, + 5, + 6, + 23, + 9, + 23, + 4, + 12, + 6, + 10, + 7, + 14, + 16, + 18, + 16, + 13, + 14, + 6, + 5, + 5, + 27, + 12, + 16, + 13, + 15, + 16, + 14, + 7, + 13, + 9, + 6, + 9, + 17, + 15, + 45, + 11, + 7, + 6, + 11, + 10, + 13, + 6, + 9 + ], + "weighted_loads": [ + 0.26828115060925484, + 0.2070162147283554, + 0.43859834037721157, + 0.3604850210249424, + 0.43980567157268524, + 1.2740531861782074, + 0.3816574029624462, + 0.32993747666478157, + 0.17543355002999306, + 1.7415194977074862, + 2.6895096506923437, + 0.5041529033333063, + 0.1476377695798874, + 0.5397606492042542, + 4.918926997110248, + 3.236318252980709, + 0.7846676032058895, + 1.4436543863266706, + 1.562822237610817, + 0.3299805261194706, + 4.335763160139322, + 1.7075678650289774, + 0.22978509217500687, + 0.43089261651039124, + 1.839033180847764, + 0.6058029495179653, + 1.838855542242527, + 0.8502183482050896, + 0.9230531863868237, + 0.1887591890990734, + 0.37301320396363735, + 0.22295991145074368, + 0.5630391426384449, + 0.6286751916632056, + 0.7019731234759092, + 1.1088617146015167, + 0.6547036543488503, + 0.7076800093054771, + 0.2817063368856907, + 0.24283223785459995, + 0.17082135006785393, + 2.724491810426116, + 0.4533980265259743, + 1.219189278781414, + 0.5317149125039577, + 0.8555737808346748, + 0.6807724200189114, + 0.8122907280921936, + 0.5554741285741329, + 0.8422611374408007, + 0.39150992035865784, + 0.21831649728119373, + 0.5117153469473124, + 1.449451144784689, + 1.6393776461482048, + 3.2713659405708313, + 0.6519581750035286, + 0.3344895914196968, + 0.24020222201943398, + 0.8527494668960571, + 0.4169787336140871, + 0.4797389750601724, + 0.43613000586628914, + 0.3734045624732971 + ], + "unique_experts": 64, + "load_cv": 0.6765442447245351, + "normalized_load_entropy": 0.9533650974824279, + "max_load_share": 0.050335570469798654 + } + }, + "s0_bos": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "233f6bc9337748f9b0ad5f781de33c82e4dd65b236d0e0aa7600a6efbe834bb1", + "route_weight_sha256": "17cdd03732e4ddd7ed715674e275a3bc2a961e81ba4e8c1d8b7cbc98d40fb6d1", + "loads": [ + 4, + 2, + 8, + 5, + 13, + 9, + 4, + 3, + 5, + 9, + 32, + 16, + 6, + 12, + 38, + 22, + 8, + 11, + 19, + 6, + 31, + 28, + 3, + 5, + 13, + 9, + 11, + 4, + 15, + 8, + 6, + 8, + 9, + 11, + 13, + 14, + 10, + 4, + 4, + 0, + 2, + 12, + 10, + 13, + 8, + 11, + 15, + 7, + 5, + 8, + 3, + 6, + 8, + 6, + 15, + 34, + 7, + 8, + 7, + 7, + 3, + 9, + 3, + 3 + ], + "weighted_loads": [ + 0.23382176086306572, + 0.08163408935070038, + 0.3669612593948841, + 0.25084328278899193, + 0.5818170458078384, + 0.37396599166095257, + 0.16264329850673676, + 0.16704252362251282, + 0.20523220859467983, + 0.3961757495999336, + 2.4034661538898945, + 0.6501870863139629, + 0.19275734201073647, + 0.44292907044291496, + 4.888874953612685, + 2.2921320032328367, + 0.4030346851795912, + 0.7610385492444038, + 0.7346522230654955, + 0.22319497354328632, + 3.257841605693102, + 1.5569519940763712, + 0.13373514264822006, + 0.33965053409338, + 0.8792570736259222, + 0.6160417273640633, + 0.5391350444406271, + 0.7535788044333458, + 1.0418673567473888, + 0.25222109630703926, + 0.20409995131194592, + 0.2523273956030607, + 0.3526127468794584, + 0.401764452457428, + 0.5363369416445494, + 1.035232950001955, + 0.5934770703315735, + 0.19481728225946426, + 0.15499305725097656, + 0.0, + 0.05940297804772854, + 0.7636277806013823, + 0.39631475508213043, + 1.0261623281985521, + 0.3309733346104622, + 0.6699388697743416, + 0.6455073151737452, + 0.4885375052690506, + 0.4710756801068783, + 0.6317440364509821, + 0.13501137495040894, + 0.21703303046524525, + 0.4424594044685364, + 0.3959761541336775, + 1.5985378548502922, + 2.3429253324866295, + 0.48023250699043274, + 0.3557695671916008, + 0.2755886223167181, + 0.5642876252532005, + 0.12477616220712662, + 0.32585665211081505, + 0.12574685364961624, + 0.11650973558425903 + ], + "unique_experts": 63, + "load_cv": 0.7771896659524514, + "normalized_load_entropy": 0.9395128057989486, + "max_load_share": 0.05864197530864197 + }, + "full_input": { + "tokens": 133, + "top_k": 6, + "decisions": 798, + "ordered_route_sha256": "1cbe4e4b3075baaeb37ac1a488e0d9daff69b6468c5a4df1fc9fbe9e13dfc1dd", + "route_weight_sha256": "5fa8aa193620261ea3c8b90e3467c315511f3e5324111edf8f8c43c1dbf9257d", + "loads": [ + 4, + 2, + 8, + 5, + 13, + 18, + 9, + 3, + 5, + 12, + 36, + 17, + 7, + 14, + 38, + 28, + 17, + 14, + 25, + 7, + 42, + 30, + 5, + 5, + 17, + 9, + 17, + 4, + 15, + 8, + 8, + 8, + 10, + 17, + 14, + 14, + 10, + 13, + 4, + 0, + 4, + 21, + 12, + 15, + 13, + 12, + 15, + 7, + 5, + 9, + 4, + 8, + 8, + 17, + 15, + 44, + 7, + 8, + 7, + 7, + 5, + 12, + 3, + 8 + ], + "weighted_loads": [ + 0.23382176086306572, + 0.08163408935070038, + 0.3669612593948841, + 0.25084328278899193, + 0.5818170458078384, + 1.1893775518983603, + 0.3817844092845917, + 0.16704252362251282, + 0.20523220859467983, + 0.8531584329903126, + 2.681898061186075, + 0.6890539601445198, + 0.2684813551604748, + 0.5019087754189968, + 4.888874953612685, + 2.7478354889899492, + 1.3830700442194939, + 0.9818265661597252, + 1.3036332316696644, + 0.253605879843235, + 4.227678995579481, + 1.6375147309154272, + 0.25735004991292953, + 0.33965053409338, + 1.3305834028869867, + 0.6160417273640633, + 0.9244407676160336, + 0.7535788044333458, + 1.0418673567473888, + 0.25222109630703926, + 0.2988925687968731, + 0.2523273956030607, + 0.3930832501500845, + 0.7249121889472008, + 0.6586641650646925, + 1.035232950001955, + 0.5934770703315735, + 0.670333556830883, + 0.15499305725097656, + 0.0, + 0.1407222654670477, + 1.6417445093393326, + 0.4944987818598747, + 1.2016473170369864, + 0.5488074850291014, + 0.737353503704071, + 0.6455073151737452, + 0.4885375052690506, + 0.4710756801068783, + 0.6756538134068251, + 0.17892120406031609, + 0.31812006793916225, + 0.4424594044685364, + 1.1691997982561588, + 1.5985378548502922, + 3.1383898220956326, + 0.48023250699043274, + 0.3557695671916008, + 0.2755886223167181, + 0.5642876252532005, + 0.2536797635257244, + 0.47446080669760704, + 0.12574685364961624, + 0.3711191192269325 + ], + "unique_experts": 63, + "load_cv": 0.7479219142256487, + "normalized_load_entropy": 0.9422375276724946, + "max_load_share": 0.05513784461152882 + } + }, + "s1_bos": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "a7d73e3fb813330baf938c56c6a148a4c52894d1f94a5b03134da062d97561fa", + "route_weight_sha256": "a58a2b8e7298c0fcaf98f57ff9397ebf3f442eaf57240679ca3ee35227858530", + "loads": [ + 6, + 2, + 6, + 5, + 11, + 10, + 3, + 5, + 6, + 9, + 32, + 15, + 6, + 11, + 38, + 22, + 8, + 11, + 20, + 5, + 32, + 29, + 4, + 4, + 11, + 9, + 10, + 4, + 13, + 7, + 7, + 6, + 7, + 11, + 13, + 16, + 10, + 5, + 5, + 2, + 1, + 12, + 10, + 13, + 9, + 10, + 15, + 8, + 5, + 8, + 2, + 5, + 8, + 6, + 15, + 34, + 8, + 9, + 7, + 9, + 4, + 8, + 3, + 3 + ], + "weighted_loads": [ + 0.2869169730693102, + 0.07974250614643097, + 0.3059432692825794, + 0.25641366839408875, + 0.485003761947155, + 0.4042770806699991, + 0.12117362767457962, + 0.248196829110384, + 0.23162508755922318, + 0.38414057716727257, + 2.4457018673419952, + 0.6158746480941772, + 0.19778400659561157, + 0.4202297180891037, + 4.964562691748142, + 2.351630238816142, + 0.39589788019657135, + 0.7529005780816078, + 0.7758701238781214, + 0.20272821933031082, + 3.2899784948676825, + 1.601176692172885, + 0.15616354905068874, + 0.2994611859321594, + 0.8535731192678213, + 0.6245434023439884, + 0.49873829632997513, + 0.8140321597456932, + 0.9635923001915216, + 0.2243894673883915, + 0.23728963546454906, + 0.19905642233788967, + 0.2540201637893915, + 0.3900050073862076, + 0.5520300734788179, + 1.0606346521526575, + 0.5480149760842323, + 0.2100095972418785, + 0.18947951681911945, + 0.07460768893361092, + 0.028563590720295906, + 0.7745317369699478, + 0.38524454459547997, + 0.9983292929828167, + 0.35445617139339447, + 0.6441927347332239, + 0.6446615774184465, + 0.526268158107996, + 0.46313904970884323, + 0.5953656416386366, + 0.09112919121980667, + 0.18749099038541317, + 0.47859182581305504, + 0.41942140832543373, + 1.6888717599213123, + 2.3546050656586885, + 0.5169258266687393, + 0.3998281992971897, + 0.27257304824888706, + 0.6220329627394676, + 0.15641911700367928, + 0.28817913867533207, + 0.12165893614292145, + 0.11528271809220314 + ], + "unique_experts": 64, + "load_cv": 0.7787569771807485, + "normalized_load_entropy": 0.9411124061382243, + "max_load_share": 0.05864197530864197 + }, + "full_input": { + "tokens": 149, + "top_k": 6, + "decisions": 894, + "ordered_route_sha256": "2b5faafd3e70afbb43cb03790c5f2d4d3b25b7bbb7e70413c7b4122b05cd6380", + "route_weight_sha256": "f44e8f188fff796928a49dac47302d775ee457ce5070cb08700a121df695d587", + "loads": [ + 6, + 5, + 6, + 7, + 11, + 19, + 9, + 6, + 6, + 14, + 38, + 16, + 6, + 14, + 39, + 32, + 18, + 20, + 28, + 5, + 43, + 31, + 6, + 5, + 22, + 9, + 22, + 4, + 13, + 7, + 11, + 6, + 12, + 19, + 15, + 18, + 10, + 15, + 6, + 5, + 4, + 28, + 12, + 17, + 15, + 15, + 16, + 14, + 8, + 12, + 8, + 6, + 9, + 18, + 15, + 45, + 10, + 9, + 7, + 10, + 9, + 9, + 6, + 8 + ], + "weighted_loads": [ + 0.2869169730693102, + 0.20070625841617584, + 0.3059432692825794, + 0.34817201644182205, + 0.485003761947155, + 1.2819356750696898, + 0.4190055578947067, + 0.27409227192401886, + 0.23162508755922318, + 0.9116544313728809, + 2.724709700793028, + 0.6460520662367344, + 0.19778400659561157, + 0.5112705659121275, + 5.014785036444664, + 3.3688003178685904, + 1.3046582210808992, + 1.407953355461359, + 1.595183838158846, + 0.20272821933031082, + 4.213094882667065, + 1.6914420668035746, + 0.24074148945510387, + 0.37572430819272995, + 1.830793185159564, + 0.6245434023439884, + 1.8282644916325808, + 0.8140321597456932, + 0.9635923001915216, + 0.2243894673883915, + 0.3937695436179638, + 0.19905642233788967, + 0.4744360316544771, + 0.7347676064819098, + 0.6321821715682745, + 1.1803364995867014, + 0.5480149760842323, + 0.7377176955342293, + 0.2823657337576151, + 0.2525817044079304, + 0.13705614395439625, + 2.6587680652737617, + 0.4788319654762745, + 1.2666484639048576, + 0.5895719602704048, + 0.8780293073505163, + 0.6762714330106974, + 0.8215052224695683, + 0.5881147980690002, + 0.7911050971597433, + 0.3569750376045704, + 0.21962019987404346, + 0.5115372724831104, + 1.4970760308206081, + 1.6888717599213123, + 3.2972142677754164, + 0.6246327683329582, + 0.3998281992971897, + 0.27257304824888706, + 0.8226425275206566, + 0.39892556704580784, + 0.3349082600325346, + 0.4492202326655388, + 0.3820519708096981 + ], + "unique_experts": 64, + "load_cv": 0.6896732886149809, + "normalized_load_entropy": 0.9514964070174806, + "max_load_share": 0.050335570469798654 + } + }, + "s0_x": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "390b94e83c43e7c235873be406cddd4522fde6d1b1cf0d22597b214895a801e4", + "route_weight_sha256": "ccbe61e05b6603192bc8f974600aec78b5b45eda1aa41ed9f686277c4bab4185", + "loads": [ + 5, + 2, + 8, + 6, + 13, + 9, + 3, + 5, + 5, + 8, + 33, + 14, + 6, + 12, + 37, + 22, + 9, + 11, + 19, + 7, + 33, + 28, + 3, + 5, + 11, + 9, + 12, + 4, + 14, + 6, + 7, + 7, + 8, + 8, + 15, + 15, + 11, + 5, + 4, + 1, + 1, + 10, + 11, + 12, + 8, + 9, + 15, + 7, + 6, + 8, + 3, + 6, + 6, + 6, + 15, + 34, + 8, + 10, + 7, + 9, + 3, + 8, + 3, + 3 + ], + "weighted_loads": [ + 0.2700968701392412, + 0.0847277082502842, + 0.3694646880030632, + 0.29288845881819725, + 0.5695191379636526, + 0.3681135028600693, + 0.12522099167108536, + 0.2514454424381256, + 0.21094940789043903, + 0.3650203738361597, + 2.4537480352446437, + 0.5783457271754742, + 0.1934454832226038, + 0.4500970132648945, + 4.848205551505089, + 2.357540199533105, + 0.3990336824208498, + 0.7574865780770779, + 0.741452157497406, + 0.25752102956175804, + 3.4649608433246613, + 1.5887789949774742, + 0.15011435747146606, + 0.3341224230825901, + 0.877311147749424, + 0.6068052500486374, + 0.5790302827954292, + 0.745497427880764, + 0.9957177732139826, + 0.18568133562803268, + 0.22730532474815845, + 0.22462810203433037, + 0.30518689565360546, + 0.2856246028095484, + 0.6165390834212303, + 1.0389579460024834, + 0.5901586636900902, + 0.22919769771397114, + 0.15991729125380516, + 0.038595050573349, + 0.03194073215126991, + 0.7016372065991163, + 0.44130163826048374, + 1.0160720851272345, + 0.3399212062358856, + 0.5791031178086996, + 0.6625383663922548, + 0.47206375375390053, + 0.4768806155771017, + 0.6085545588284731, + 0.13848157599568367, + 0.212820740416646, + 0.3634802885353565, + 0.40347227081656456, + 1.649936892092228, + 2.343095561489463, + 0.5380779169499874, + 0.41691087000072, + 0.28065985813736916, + 0.6389907971024513, + 0.1216854639351368, + 0.29210411943495274, + 0.13002610206604004, + 0.1147242821753025 + ], + "unique_experts": 64, + "load_cv": 0.7787569771807485, + "normalized_load_entropy": 0.9406527597457955, + "max_load_share": 0.05709876543209876 + }, + "full_input": { + "tokens": 133, + "top_k": 6, + "decisions": 798, + "ordered_route_sha256": "30288a9f9674d9f268277a06c8ac3bc8b5aef95bd8f0bf0b62b30866369f3458", + "route_weight_sha256": "e3d2856195974d6506d2884fc8d31eb985e1a95cb59391f46b3e3552023b8f7d", + "loads": [ + 5, + 2, + 8, + 6, + 13, + 17, + 8, + 5, + 5, + 9, + 37, + 15, + 6, + 13, + 37, + 28, + 16, + 16, + 25, + 7, + 46, + 31, + 5, + 5, + 17, + 9, + 19, + 4, + 14, + 6, + 10, + 7, + 10, + 12, + 15, + 15, + 11, + 15, + 4, + 1, + 3, + 18, + 14, + 14, + 11, + 10, + 15, + 7, + 6, + 8, + 4, + 8, + 6, + 18, + 15, + 45, + 8, + 10, + 7, + 9, + 6, + 10, + 3, + 9 + ], + "weighted_loads": [ + 0.2700968701392412, + 0.0847277082502842, + 0.3694646880030632, + 0.29288845881819725, + 0.5695191379636526, + 1.1427048072218895, + 0.351175956428051, + 0.2514454424381256, + 0.21094940789043903, + 0.7435445580631495, + 2.7201869590207934, + 0.6044967100024223, + 0.1934454832226038, + 0.4692009724676609, + 4.848205551505089, + 2.8940165173262358, + 0.735905796289444, + 1.0371342413127422, + 1.3980920817703009, + 0.25752102956175804, + 4.724219284951687, + 1.7041541375219822, + 0.27372926473617554, + 0.3341224230825901, + 1.463658757507801, + 0.6068052500486374, + 1.001237640157342, + 0.745497427880764, + 0.9957177732139826, + 0.18568133562803268, + 0.3691902719438076, + 0.22462810203433037, + 0.41864498518407345, + 0.5154453497380018, + 0.6165390834212303, + 1.0389579460024834, + 0.5901586636900902, + 0.7381564397364855, + 0.15991729125380516, + 0.038595050573349, + 0.11326001957058907, + 1.4755183104425669, + 0.5672964751720428, + 1.22271709702909, + 0.5049466527998447, + 0.6465177517384291, + 0.6625383663922548, + 0.47206375375390053, + 0.4768806155771017, + 0.6085545588284731, + 0.17323141545057297, + 0.313907777890563, + 0.3634802885353565, + 1.3080757576972246, + 1.649936892092228, + 3.2511392552405596, + 0.5380779169499874, + 0.41691087000072, + 0.28065985813736916, + 0.6389907971024513, + 0.321177713572979, + 0.38760305382311344, + 0.13002610206604004, + 0.4193643555045128 + ], + "unique_experts": 64, + "load_cv": 0.7642713213063002, + "normalized_load_entropy": 0.9423163689439618, + "max_load_share": 0.05764411027568922 + } + }, + "s1_x": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "a560df2d8e01b1afa0b44d0dde8b08899f0c3e180843d1125f60c1e31356e7d2", + "route_weight_sha256": "30b09a8fe3685178645eb4e22aeda3b9d1c12b965dc629dc494b494e57e8667c", + "loads": [ + 6, + 3, + 9, + 3, + 11, + 11, + 2, + 5, + 6, + 8, + 34, + 14, + 6, + 9, + 37, + 22, + 8, + 12, + 18, + 5, + 32, + 28, + 3, + 4, + 12, + 9, + 11, + 4, + 13, + 6, + 7, + 6, + 9, + 7, + 17, + 14, + 10, + 6, + 6, + 1, + 0, + 11, + 12, + 11, + 11, + 10, + 15, + 6, + 5, + 8, + 2, + 6, + 7, + 6, + 16, + 35, + 8, + 8, + 8, + 10, + 4, + 8, + 3, + 4 + ], + "weighted_loads": [ + 0.2915877252817154, + 0.10336446203291416, + 0.41330376267433167, + 0.1913343220949173, + 0.495395764708519, + 0.4371807910501957, + 0.08042138814926147, + 0.2602180428802967, + 0.24485348165035248, + 0.2832054831087589, + 2.5331859635189176, + 0.5734862703830004, + 0.1995163168758154, + 0.36976858228445053, + 4.98341366648674, + 2.3695707824081182, + 0.3371982090175152, + 0.7334118690341711, + 0.6898839548230171, + 0.19734786450862885, + 3.4017100986093283, + 1.5884718243032694, + 0.1512669175863266, + 0.3138454556465149, + 0.9335898011922836, + 0.6088436394929886, + 0.5525871030986309, + 0.8251240253448486, + 0.9530867040157318, + 0.1986037865281105, + 0.24489622376859188, + 0.1963699758052826, + 0.32166210003197193, + 0.26582360826432705, + 0.7012704703956842, + 0.9801514409482479, + 0.5366535559296608, + 0.24155406653881073, + 0.2218682151287794, + 0.04037327691912651, + 0.0, + 0.7374176867306232, + 0.4538616817444563, + 0.8958490565419197, + 0.4261733293533325, + 0.5806356687098742, + 0.6271972768008709, + 0.4252740517258644, + 0.4982847385108471, + 0.5749671943485737, + 0.0926712155342102, + 0.20929126627743244, + 0.44059584848582745, + 0.4175858497619629, + 1.649989167228341, + 2.421477260068059, + 0.530834648758173, + 0.377462025731802, + 0.32692402973771095, + 0.7114571183919907, + 0.15189136937260628, + 0.31326648592948914, + 0.1291956938803196, + 0.1443483941257 + ], + "unique_experts": 63, + "load_cv": 0.7863528858910706, + "normalized_load_entropy": 0.9386171465303355, + "max_load_share": 0.05709876543209876 + }, + "full_input": { + "tokens": 149, + "top_k": 6, + "decisions": 894, + "ordered_route_sha256": "fe1d34bacd2edbe64470ca2b31baa897616cb7300f2362c59c54d96e5fff3f94", + "route_weight_sha256": "5025802bd5565b5ba04ab8d435f227b8275dd8baeebb77d32303ebb05a8a76b8", + "loads": [ + 6, + 6, + 9, + 5, + 11, + 19, + 8, + 6, + 6, + 11, + 41, + 15, + 6, + 14, + 38, + 32, + 15, + 22, + 25, + 5, + 46, + 31, + 6, + 5, + 25, + 9, + 23, + 4, + 13, + 6, + 12, + 6, + 15, + 12, + 18, + 16, + 10, + 15, + 7, + 4, + 3, + 26, + 15, + 15, + 14, + 15, + 16, + 12, + 9, + 12, + 8, + 7, + 8, + 19, + 16, + 47, + 10, + 9, + 8, + 12, + 8, + 8, + 6, + 8 + ], + "weighted_loads": [ + 0.2915877252817154, + 0.22432821430265903, + 0.41330376267433167, + 0.2830926701426506, + 0.495395764708519, + 1.2663346454501152, + 0.3878309912979603, + 0.2861134856939316, + 0.24485348165035248, + 0.7275463454425335, + 2.837693908251822, + 0.6036636885255575, + 0.1995163168758154, + 0.5464782435446978, + 5.033636011183262, + 3.4064177814871073, + 0.5855175629258156, + 1.4252502229064703, + 1.475254787132144, + 0.19734786450862885, + 4.6999111622571945, + 1.717119062319398, + 0.2684831768274307, + 0.3901085779070854, + 2.103381410241127, + 0.6088436394929886, + 1.840678783133626, + 0.8251240253448486, + 0.9530867040157318, + 0.1986037865281105, + 0.4287800509482622, + 0.1963699758052826, + 0.607350567355752, + 0.4923143107444048, + 0.7372192163020372, + 1.0998532883822918, + 0.5366535559296608, + 0.7292942963540554, + 0.31475443206727505, + 0.21834729239344597, + 0.10849255323410034, + 2.4746063575148582, + 0.587630333378911, + 1.1787426099181175, + 0.5687078386545181, + 0.8144722413271666, + 0.6588071323931217, + 0.7205111160874367, + 0.6536168567836285, + 0.7707066498696804, + 0.3444849103689194, + 0.24142047576606274, + 0.47494435869157314, + 1.5921119153499603, + 1.649989167228341, + 3.4949683528393507, + 0.6385415904223919, + 0.44182441756129265, + 0.32692402973771095, + 0.9311417452991009, + 0.34171539545059204, + 0.31326648592948914, + 0.45675699040293694, + 0.36686326563358307 + ], + "unique_experts": 64, + "load_cv": 0.710716108657096, + "normalized_load_entropy": 0.949455268110206, + "max_load_share": 0.052572706935123045 + } + }, + "s0_period": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "8a66ae9f6130286db71cb04247de00b262bb43ec2174faa3a52e0ef429789f6b", + "route_weight_sha256": "7a9eeb862e6ee499cf5a97a4d01a26b9b4e5d0c69db7f86141a28efc5bd1dd08", + "loads": [ + 6, + 2, + 7, + 6, + 10, + 9, + 3, + 4, + 5, + 9, + 35, + 13, + 5, + 11, + 37, + 21, + 8, + 12, + 19, + 6, + 33, + 30, + 3, + 5, + 10, + 9, + 10, + 4, + 15, + 7, + 6, + 7, + 9, + 8, + 17, + 15, + 11, + 5, + 4, + 2, + 1, + 12, + 10, + 13, + 9, + 9, + 15, + 7, + 5, + 8, + 3, + 6, + 6, + 6, + 16, + 34, + 8, + 8, + 7, + 9, + 3, + 8, + 3, + 4 + ], + "weighted_loads": [ + 0.3089969512075186, + 0.08246065676212311, + 0.3297046832740307, + 0.30011026188731194, + 0.49520777352154255, + 0.36691361106932163, + 0.11103757470846176, + 0.20230190455913544, + 0.21168020740151405, + 0.3631574995815754, + 2.5047916686162353, + 0.536550510674715, + 0.14656798914074898, + 0.41789072565734386, + 4.864561537280679, + 2.333120860159397, + 0.3588538747280836, + 0.7927059680223465, + 0.7309243809431791, + 0.21618787944316864, + 3.4718146231025457, + 1.6343907956033945, + 0.14908887073397636, + 0.3455182649195194, + 0.8594770208001137, + 0.6115064136683941, + 0.518976703286171, + 0.7154806591570377, + 1.021737914532423, + 0.2169488314539194, + 0.20509888976812363, + 0.2223405335098505, + 0.3514852039515972, + 0.28478661365807056, + 0.6875333469361067, + 1.0170428361743689, + 0.6069000922143459, + 0.2331238817423582, + 0.15982816740870476, + 0.07693630456924438, + 0.03181068226695061, + 0.7606513127684593, + 0.40033642016351223, + 1.058045756071806, + 0.3728589788079262, + 0.5582491606473923, + 0.6565969735383987, + 0.4924250692129135, + 0.4555159844458103, + 0.6129887420684099, + 0.14101889356970787, + 0.21677367761731148, + 0.36383579671382904, + 0.40087693743407726, + 1.661973975598812, + 2.36556395329535, + 0.5277404375374317, + 0.35186670161783695, + 0.2767461743205786, + 0.6724180784076452, + 0.11906882002949715, + 0.29476811178028584, + 0.13326965644955635, + 0.14605220034718513 + ], + "unique_experts": 64, + "load_cv": 0.796176658636357, + "normalized_load_entropy": 0.9391634550489228, + "max_load_share": 0.05709876543209876 + }, + "full_input": { + "tokens": 133, + "top_k": 6, + "decisions": 798, + "ordered_route_sha256": "af72dc439957a5e92bf82375bce8aded0746deb0dd9feafc5ce350c4b4d69a51", + "route_weight_sha256": "03e77d7863bd13e487a3f868f4eda3b26eeb4f5a9f52e27b8c91a3e306b14293", + "loads": [ + 6, + 2, + 7, + 6, + 10, + 19, + 8, + 4, + 5, + 10, + 40, + 14, + 5, + 12, + 37, + 27, + 16, + 17, + 25, + 6, + 45, + 32, + 6, + 5, + 16, + 9, + 15, + 4, + 15, + 7, + 9, + 7, + 10, + 13, + 17, + 15, + 11, + 14, + 4, + 2, + 3, + 20, + 12, + 15, + 13, + 10, + 15, + 8, + 5, + 8, + 3, + 8, + 7, + 18, + 16, + 45, + 8, + 8, + 7, + 9, + 6, + 10, + 3, + 9 + ], + "weighted_loads": [ + 0.3089969512075186, + 0.08246065676212311, + 0.3297046832740307, + 0.30011026188731194, + 0.49520777352154255, + 1.2187195997685194, + 0.3394501358270645, + 0.20230190455913544, + 0.21168020740151405, + 0.7416816838085651, + 2.825871198438108, + 0.5622245240956545, + 0.14656798914074898, + 0.4369946848601103, + 4.864561537280679, + 2.854580160230398, + 0.8029762841761112, + 1.1787839718163013, + 1.3363347314298153, + 0.21618787944316864, + 4.52101038955152, + 1.7149535324424505, + 0.31393225863575935, + 0.3455182649195194, + 1.4785303063690662, + 0.6115064136683941, + 0.9011595118790865, + 0.7154806591570377, + 1.021737914532423, + 0.2169488314539194, + 0.3658443596214056, + 0.2223405335098505, + 0.3919557072222233, + 0.5559876170009375, + 0.6875333469361067, + 1.0170428361743689, + 0.6069000922143459, + 0.708640156313777, + 0.15982816740870476, + 0.07693630456924438, + 0.11312996968626976, + 1.5641678869724274, + 0.5022264551371336, + 1.25504145398736, + 0.5711456313729286, + 0.6256637945771217, + 0.6565969735383987, + 0.5318804644048214, + 0.4555159844458103, + 0.6129887420684099, + 0.14101889356970787, + 0.3178607150912285, + 0.39655226469039917, + 1.2140869908034801, + 1.661973975598812, + 3.2246279027312994, + 0.5277404375374317, + 0.35186670161783695, + 0.2767461743205786, + 0.6724180784076452, + 0.3085135370492935, + 0.38794189132750034, + 0.13326965644955635, + 0.4101042114198208 + ], + "unique_experts": 64, + "load_cv": 0.7738112995017828, + "normalized_load_entropy": 0.9412513792922196, + "max_load_share": 0.05639097744360902 + } + }, + "s1_period": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "72043a013bdf60f0c41dce74d429b3bcabcdf5dacd141aaee9a78bf6513c3547", + "route_weight_sha256": "7ac442b6c4ad7cc8e999bc022c4682c035288b20f924a9022f1b9847807c39cc", + "loads": [ + 6, + 3, + 8, + 4, + 10, + 9, + 3, + 5, + 6, + 9, + 33, + 13, + 7, + 9, + 36, + 21, + 7, + 12, + 17, + 7, + 33, + 29, + 3, + 4, + 10, + 9, + 10, + 4, + 13, + 7, + 7, + 7, + 8, + 8, + 15, + 14, + 10, + 6, + 6, + 1, + 2, + 11, + 13, + 13, + 12, + 9, + 15, + 7, + 5, + 7, + 2, + 5, + 7, + 6, + 17, + 35, + 8, + 9, + 8, + 11, + 4, + 7, + 3, + 3 + ], + "weighted_loads": [ + 0.2929827366024256, + 0.10672884248197079, + 0.37007867731153965, + 0.218042753636837, + 0.47835882380604744, + 0.3747701682150364, + 0.10881049931049347, + 0.2648547664284706, + 0.23688330501317978, + 0.34690213203430176, + 2.529985560104251, + 0.5481477733701468, + 0.2389029636979103, + 0.37026841565966606, + 4.999666307121515, + 2.430333510041237, + 0.3022495210170746, + 0.70558275654912, + 0.6438077874481678, + 0.2580004967749119, + 3.475565830245614, + 1.6226889081299305, + 0.1424159873276949, + 0.3146127946674824, + 0.8475158885121346, + 0.6218382157385349, + 0.516274206340313, + 0.7792635783553123, + 0.9631455801427364, + 0.21946185640990734, + 0.2382097728550434, + 0.21980522945523262, + 0.29399026930332184, + 0.27949328161776066, + 0.6203738879412413, + 0.986288296058774, + 0.5331993233412504, + 0.2508139442652464, + 0.2216099463403225, + 0.03751170635223389, + 0.057246094569563866, + 0.7524138055741787, + 0.4852657187730074, + 0.9847992211580276, + 0.4741745963692665, + 0.540778836235404, + 0.6475191526114941, + 0.4642414338886738, + 0.47481149807572365, + 0.5299259703606367, + 0.08972712978720665, + 0.18031089380383492, + 0.4301271792501211, + 0.41854145750403404, + 1.769218273460865, + 2.4190892428159714, + 0.5235442146658897, + 0.42477981001138687, + 0.32234255224466324, + 0.7647919096052647, + 0.15037793666124344, + 0.277744609862566, + 0.12735815346240997, + 0.11352301016449928 + ], + "unique_experts": 64, + "load_cv": 0.7728631716488661, + "normalized_load_entropy": 0.9423244426147417, + "max_load_share": 0.05555555555555555 + }, + "full_input": { + "tokens": 149, + "top_k": 6, + "decisions": 894, + "ordered_route_sha256": "1d2cc5e3831cb74372169b043519f652c38d63f420d57cfdd38cf58f0b14ed1d", + "route_weight_sha256": "4309419966664dfaaa9fbe90a18f71519733a9df6600dbafd86d6ca8b6d5853b", + "loads": [ + 6, + 6, + 8, + 6, + 10, + 18, + 9, + 6, + 6, + 12, + 40, + 14, + 7, + 13, + 37, + 31, + 13, + 23, + 24, + 7, + 45, + 31, + 6, + 5, + 24, + 9, + 22, + 4, + 13, + 7, + 12, + 7, + 14, + 13, + 16, + 16, + 10, + 15, + 8, + 4, + 5, + 27, + 16, + 17, + 15, + 14, + 16, + 13, + 9, + 11, + 8, + 6, + 7, + 19, + 18, + 47, + 10, + 9, + 8, + 13, + 9, + 7, + 6, + 7 + ], + "weighted_loads": [ + 0.2929827366024256, + 0.22769259475171566, + 0.37007867731153965, + 0.3098011016845703, + 0.47835882380604744, + 1.2414284460246563, + 0.4138445109128952, + 0.2907502092421055, + 0.23688330501317978, + 0.7912429943680763, + 2.8588659707456827, + 0.5783251915127039, + 0.2389029636979103, + 0.49724828265607357, + 5.049888651818037, + 3.401146996766329, + 0.5228565596044064, + 1.4749652333557606, + 1.471380950883031, + 0.2580004967749119, + 4.453177332878113, + 1.7129542827606201, + 0.25133031606674194, + 0.3908759169280529, + 2.08376257866621, + 0.6218382157385349, + 1.82345868088305, + 0.7792635783553123, + 0.9631455801427364, + 0.21946185640990734, + 0.4615082610398531, + 0.21980522945523262, + 0.5509611368179321, + 0.5069779362529516, + 0.6563226338475943, + 1.1059901434928179, + 0.5331993233412504, + 0.7385541740804911, + 0.36077891662716866, + 0.21548572182655334, + 0.1657386478036642, + 2.4800317138433456, + 0.627433417364955, + 1.257810078561306, + 0.6216004863381386, + 0.7746154088526964, + 0.6791290082037449, + 0.759478498250246, + 0.6346688382327557, + 0.7256654258817434, + 0.3402063921093941, + 0.2124401032924652, + 0.4301271792501211, + 1.55637663975358, + 1.8079716265201569, + 3.4102909453213215, + 0.6312511563301086, + 0.42477981001138687, + 0.32234255224466324, + 0.9947720877826214, + 0.39592835679650307, + 0.277744609862566, + 0.4549194499850273, + 0.33757008984684944 + ], + "unique_experts": 64, + "load_cv": 0.6924542697785367, + "normalized_load_entropy": 0.9522702299026188, + "max_load_share": 0.052572706935123045 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 108, + "ordered_topk_exact_tokens": 54, + "set_exact_tokens": 68, + "mean_set_jaccard": 0.8842592592592593, + "mean_token_weighted_tv": 0.022684915844971936, + "aggregate_load_tv": 0.040123456790123455 + }, + "system_bos": { + "tokens": 108, + "ordered_topk_exact_tokens": 48, + "set_exact_tokens": 67, + "mean_set_jaccard": 0.8816137566137568, + "mean_token_weighted_tv": 0.024192763742542377, + "aggregate_load_tv": 0.037037037037037035 + }, + "system_x": { + "tokens": 108, + "ordered_topk_exact_tokens": 38, + "set_exact_tokens": 58, + "mean_set_jaccard": 0.8558201058201059, + "mean_token_weighted_tv": 0.032613459439879214, + "aggregate_load_tv": 0.043209876543209874 + }, + "system_period": { + "tokens": 108, + "ordered_topk_exact_tokens": 31, + "set_exact_tokens": 57, + "mean_set_jaccard": 0.8531746031746031, + "mean_token_weighted_tv": 0.03151803722829317, + "aggregate_load_tv": 0.040123456790123455 + }, + "bos_at_s0": { + "tokens": 108, + "ordered_topk_exact_tokens": 43, + "set_exact_tokens": 63, + "mean_set_jaccard": 0.8650793650793651, + "mean_token_weighted_tv": 0.027493065731875873, + "aggregate_load_tv": 0.05092592592592593 + }, + "bos_at_s1": { + "tokens": 108, + "ordered_topk_exact_tokens": 38, + "set_exact_tokens": 58, + "mean_set_jaccard": 0.837610229276896, + "mean_token_weighted_tv": 0.03220170685435059, + "aggregate_load_tv": 0.05246913580246913 + }, + "x_at_s0": { + "tokens": 108, + "ordered_topk_exact_tokens": 39, + "set_exact_tokens": 59, + "mean_set_jaccard": 0.847442680776014, + "mean_token_weighted_tv": 0.030690053154507443, + "aggregate_load_tv": 0.0478395061728395 + }, + "x_at_s1": { + "tokens": 108, + "ordered_topk_exact_tokens": 26, + "set_exact_tokens": 49, + "mean_set_jaccard": 0.8177689594356261, + "mean_token_weighted_tv": 0.03891634292193447, + "aggregate_load_tv": 0.05092592592592592 + }, + "period_at_s0": { + "tokens": 108, + "ordered_topk_exact_tokens": 48, + "set_exact_tokens": 66, + "mean_set_jaccard": 0.8719135802469137, + "mean_token_weighted_tv": 0.028843572022634798, + "aggregate_load_tv": 0.041666666666666664 + }, + "period_at_s1": { + "tokens": 108, + "ordered_topk_exact_tokens": 28, + "set_exact_tokens": 52, + "mean_set_jaccard": 0.8281305114638449, + "mean_token_weighted_tv": 0.03733418288606184, + "aggregate_load_tv": 0.05246913580246913 + } + } + }, + "layer_17": { + "layer": 17, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "29c1e5288c7459883dfb193f35d0f528e4feaa91d634f0c3629edcc363a88cf1", + "route_weight_sha256": "566a0146de50e0a57e5894078f206bf2ac7b66ce9bd31cef9eb4b3a3ffd73231", + "loads": [ + 11, + 3, + 15, + 22, + 7, + 8, + 20, + 12, + 2, + 10, + 5, + 13, + 4, + 19, + 2, + 14, + 12, + 34, + 20, + 5, + 20, + 1, + 15, + 7, + 11, + 20, + 12, + 9, + 1, + 3, + 8, + 6, + 5, + 4, + 1, + 9, + 9, + 2, + 7, + 6, + 17, + 12, + 7, + 12, + 9, + 11, + 19, + 7, + 5, + 11, + 7, + 9, + 7, + 26, + 5, + 9, + 2, + 20, + 5, + 18, + 3, + 10, + 17, + 6 + ], + "weighted_loads": [ + 0.38944106735289097, + 0.11879319697618484, + 0.6648870762437582, + 2.2712536491453648, + 0.4262952320277691, + 0.3684995174407959, + 1.0539644844830036, + 0.6387943364679813, + 0.08109917864203453, + 0.35492769815027714, + 0.334671001881361, + 0.7057121209800243, + 0.17627419903874397, + 2.22239194996655, + 0.06740808486938477, + 0.6287441533058882, + 0.8391030021011829, + 4.201077988371253, + 1.6904745809733868, + 0.23221991583704948, + 1.6599118541926146, + 0.035448431968688965, + 1.3087313175201416, + 0.23208228312432766, + 0.4735622089356184, + 1.133751580491662, + 0.7141962572932243, + 0.30890643782913685, + 0.050375353544950485, + 0.072365278378129, + 0.5857400968670845, + 0.3333302214741707, + 0.15511539578437805, + 0.1900278814136982, + 0.06585965305566788, + 0.9796729609370232, + 0.5711495615541935, + 0.08812239393591881, + 0.3429270498454571, + 0.2264023032039404, + 1.0511125065386295, + 0.526169802993536, + 0.31158313900232315, + 0.5164457485079765, + 0.38456468284130096, + 0.5012545846402645, + 1.5563150215893984, + 0.3727754782885313, + 0.5142247900366783, + 0.5240285806357861, + 0.41201969236135483, + 0.7553449608385563, + 0.3522445596754551, + 1.0733334487304091, + 0.20824847556650639, + 0.6845430452376604, + 0.11476768553256989, + 1.5204886924475431, + 0.3066571019589901, + 0.847082057967782, + 0.14499009400606155, + 0.5664849355816841, + 0.8970752470195293, + 0.42885254323482513 + ], + "unique_experts": 64, + "load_cv": 0.6638027189516081, + "normalized_load_entropy": 0.9484899221857555, + "max_load_share": 0.05246913580246913 + }, + "full_input": { + "tokens": 133, + "top_k": 6, + "decisions": 798, + "ordered_route_sha256": "b5d24dda9db658a6bae76670c9413400feff00e131ea4a6533443d259dc28f51", + "route_weight_sha256": "83f3de4e23341e164d62106af307585bb204538308d4d7b1e95192d05189ebb9", + "loads": [ + 19, + 5, + 17, + 29, + 7, + 8, + 22, + 12, + 2, + 14, + 12, + 14, + 7, + 27, + 2, + 16, + 12, + 41, + 23, + 5, + 24, + 1, + 15, + 14, + 17, + 25, + 21, + 13, + 6, + 4, + 8, + 6, + 14, + 4, + 1, + 9, + 9, + 4, + 11, + 6, + 25, + 16, + 9, + 14, + 9, + 15, + 19, + 7, + 5, + 12, + 8, + 9, + 9, + 27, + 5, + 12, + 3, + 22, + 5, + 19, + 3, + 11, + 22, + 6 + ], + "weighted_loads": [ + 0.6479495456442237, + 0.19902993738651276, + 0.7597128804773092, + 2.8630946315824986, + 0.4262952320277691, + 0.3684995174407959, + 1.1503858491778374, + 0.6387943364679813, + 0.08109917864203453, + 0.4852269683033228, + 0.7657655365765095, + 0.724209051579237, + 0.2725354265421629, + 2.8174138981848955, + 0.06740808486938477, + 0.7148801404982805, + 0.8391030021011829, + 4.866042954847217, + 1.8125437032431364, + 0.23221991583704948, + 1.9713622480630875, + 0.035448431968688965, + 1.3087313175201416, + 0.5513967350125313, + 0.9559477549046278, + 1.3901756573468447, + 2.4244299940764904, + 0.4802398141473532, + 0.23528529331088066, + 0.07770017953589559, + 0.5857400968670845, + 0.3333302214741707, + 0.49043116765096784, + 0.1900278814136982, + 0.06585965305566788, + 0.9796729609370232, + 0.5711495615541935, + 0.17118727043271065, + 0.5035302508622408, + 0.2264023032039404, + 1.9018309824168682, + 0.6341242473572493, + 0.4531252346932888, + 0.5384397790767252, + 0.38456468284130096, + 1.3241660110652447, + 1.5563150215893984, + 0.3727754782885313, + 0.5142247900366783, + 0.5644957907497883, + 0.4786026254296303, + 0.7553449608385563, + 0.510315727442503, + 1.1131148403510451, + 0.20824847556650639, + 0.8816137593239546, + 0.16505498066544533, + 1.6323419008404016, + 0.3066571019589901, + 0.877856282517314, + 0.14499009400606155, + 0.6372495591640472, + 1.3151206374168396, + 0.42885254323482513 + ], + "unique_experts": 64, + "load_cv": 0.6482997656191509, + "normalized_load_entropy": 0.9504824259882357, + "max_load_share": 0.05137844611528822 + } + }, + "s1_eos": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "a42b2251d583b8fa25f5c8a2ba552e3660d94b11573bbe361fbc708afba6ea61", + "route_weight_sha256": "91bd3988fbedfb2ca32885163b585003e77b2e12dccb7cf87004ed6a1d761425", + "loads": [ + 9, + 2, + 13, + 22, + 6, + 8, + 20, + 14, + 2, + 10, + 5, + 13, + 6, + 19, + 3, + 13, + 14, + 35, + 22, + 5, + 20, + 2, + 16, + 7, + 13, + 20, + 10, + 7, + 2, + 5, + 8, + 5, + 6, + 5, + 1, + 10, + 8, + 2, + 6, + 5, + 16, + 11, + 7, + 11, + 9, + 13, + 17, + 8, + 5, + 12, + 7, + 9, + 7, + 26, + 5, + 8, + 2, + 20, + 7, + 18, + 1, + 8, + 17, + 5 + ], + "weighted_loads": [ + 0.3359593991190195, + 0.10215972363948822, + 0.5991162210702896, + 2.2247405163943768, + 0.38466673344373703, + 0.35849313624203205, + 1.069240102544427, + 0.7107957433909178, + 0.07901589572429657, + 0.3427662029862404, + 0.35007527470588684, + 0.6779441349208355, + 0.23971864581108093, + 2.222827071323991, + 0.12401783466339111, + 0.5962307043373585, + 0.9239318519830704, + 4.230137286707759, + 1.755735693499446, + 0.23115204833447933, + 1.6394175104796886, + 0.06993704289197922, + 1.3729254603385925, + 0.23194747604429722, + 0.5407608486711979, + 1.1090026199817657, + 0.6235109958797693, + 0.24521788954734802, + 0.1026655025780201, + 0.14559501595795155, + 0.6180598922073841, + 0.31492514722049236, + 0.18134947679936886, + 0.2223193719983101, + 0.0715610459446907, + 1.0184029154479504, + 0.5510034784674644, + 0.07423945143818855, + 0.32659840770065784, + 0.1971352230757475, + 1.029968237504363, + 0.4776890929788351, + 0.30556272715330124, + 0.46665590815246105, + 0.3716319724917412, + 0.5914872922003269, + 1.5207325611263514, + 0.41016774252057076, + 0.5107559151947498, + 0.5929503701627254, + 0.416573453694582, + 0.7271462790668011, + 0.35949357226490974, + 1.0886804573237896, + 0.20435018092393875, + 0.6554778125137091, + 0.12049976363778114, + 1.5237463936209679, + 0.3863410949707031, + 0.8641767110675573, + 0.05276741459965706, + 0.511617261916399, + 0.9008544310927391, + 0.4311116896569729 + ], + "unique_experts": 64, + "load_cv": 0.6683791448710698, + "normalized_load_entropy": 0.9488367216802264, + "max_load_share": 0.05401234567901234 + }, + "full_input": { + "tokens": 149, + "top_k": 6, + "decisions": 894, + "ordered_route_sha256": "2646afdc717db10e20a71c3affb7ecfabea00e8d1d22cf10dcbce151ad9f422f", + "route_weight_sha256": "7e90e37a24856029bbdee084ce04b3a347fc1a460328bd571bc96144fc614258", + "loads": [ + 17, + 3, + 15, + 29, + 12, + 8, + 23, + 15, + 2, + 15, + 12, + 15, + 6, + 27, + 3, + 20, + 16, + 43, + 25, + 5, + 21, + 3, + 16, + 17, + 23, + 39, + 22, + 9, + 4, + 7, + 10, + 6, + 11, + 5, + 1, + 10, + 12, + 6, + 12, + 6, + 29, + 18, + 10, + 12, + 11, + 18, + 19, + 10, + 5, + 13, + 8, + 15, + 11, + 27, + 6, + 15, + 10, + 31, + 8, + 21, + 2, + 13, + 26, + 5 + ], + "weighted_loads": [ + 0.6513428799808025, + 0.1444096677005291, + 0.6777918413281441, + 2.8798735439777374, + 0.774099588394165, + 0.35849313624203205, + 1.1889523956924677, + 0.7657817285507917, + 0.07901589572429657, + 0.5009967442601919, + 0.8454832471907139, + 0.7449083030223846, + 0.23971864581108093, + 2.845601225271821, + 0.12401783466339111, + 0.9193122647702694, + 1.0941122844815254, + 4.884066374972463, + 1.8655328713357449, + 0.23115204833447933, + 1.7073237039148808, + 0.1476830318570137, + 1.3729254603385925, + 0.9357349220663309, + 1.1443638771306723, + 2.3483442422002554, + 2.4275424238294363, + 0.33536138013005257, + 0.18378516472876072, + 0.23059747135266662, + 0.7143864817917347, + 0.3543992657214403, + 0.3408301309682429, + 0.2223193719983101, + 0.0715610459446907, + 1.0184029154479504, + 0.7779169343411922, + 0.23604032956063747, + 0.7150108646601439, + 0.23080879636108875, + 2.542437905445695, + 0.8465263061225414, + 0.4413924142718315, + 0.48542872071266174, + 0.6071102879941463, + 1.8124402351677418, + 1.735954524949193, + 0.5416247881948948, + 0.5107559151947498, + 0.6343586035072803, + 0.5528277345001698, + 1.0242342110723257, + 0.605762954801321, + 1.1313836202025414, + 0.2934098020195961, + 1.0930402167141438, + 0.7856077216565609, + 2.105014096945524, + 0.4100236799567938, + 0.9881255384534597, + 0.08788284659385681, + 0.8048811480402946, + 1.601539321243763, + 0.4311116896569729 + ], + "unique_experts": 64, + "load_cv": 0.6410518347367492, + "normalized_load_entropy": 0.9519928270045658, + "max_load_share": 0.04809843400447427 + } + }, + "s0_bos": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "d353bed78e6a6d837a69216ba75860f205dd083015cfa011c51c02297ebf8c69", + "route_weight_sha256": "4da61c04d550a0567dcfe042e2b6f29fa1f02d26f1c300e00f3d9b91a68831ac", + "loads": [ + 11, + 1, + 14, + 23, + 7, + 10, + 21, + 12, + 2, + 10, + 6, + 12, + 4, + 18, + 1, + 12, + 14, + 35, + 19, + 5, + 20, + 2, + 17, + 6, + 12, + 19, + 12, + 9, + 1, + 6, + 9, + 6, + 3, + 4, + 2, + 12, + 9, + 2, + 7, + 5, + 18, + 11, + 4, + 11, + 10, + 10, + 17, + 9, + 5, + 10, + 7, + 9, + 7, + 24, + 4, + 9, + 6, + 19, + 5, + 17, + 3, + 11, + 19, + 3 + ], + "weighted_loads": [ + 0.3738193530589342, + 0.043042659759521484, + 0.6535812225192785, + 2.271399736404419, + 0.4325490891933441, + 0.43642256036400795, + 1.1432695835828781, + 0.6615119837224483, + 0.08342236652970314, + 0.34567410685122013, + 0.37247708067297935, + 0.6796569041907787, + 0.1732955016195774, + 2.283575192093849, + 0.03173559531569481, + 0.5657237842679024, + 0.8699697162955999, + 4.197389869019389, + 1.6451640948653221, + 0.25405043363571167, + 1.6427252851426601, + 0.0668026003986597, + 1.419578991830349, + 0.19686522893607616, + 0.5050830505788326, + 1.0750488601624966, + 0.7645268179476261, + 0.3203570581972599, + 0.04755495861172676, + 0.19148722290992737, + 0.652284063398838, + 0.3394863195717335, + 0.09566160291433334, + 0.18873157911002636, + 0.10259677097201347, + 1.115337960422039, + 0.5996363796293736, + 0.0836331807076931, + 0.3186144568026066, + 0.1933327652513981, + 1.0584833975881338, + 0.46493424475193024, + 0.21066227182745934, + 0.43621896766126156, + 0.4243958927690983, + 0.4682348892092705, + 1.4349118024110794, + 0.4681778587400913, + 0.5300478339195251, + 0.49790428951382637, + 0.41312646120786667, + 0.7519794628024101, + 0.3682723306119442, + 0.9954246282577515, + 0.17051099613308907, + 0.7101774346083403, + 0.2986551932990551, + 1.484529748558998, + 0.3042728155851364, + 0.820642489939928, + 0.13480746001005173, + 0.6340636853128672, + 1.0393569394946098, + 0.30292487516999245 + ], + "unique_experts": 64, + "load_cv": 0.6626536740898589, + "normalized_load_entropy": 0.9484183709775525, + "max_load_share": 0.05401234567901234 + }, + "full_input": { + "tokens": 133, + "top_k": 6, + "decisions": 798, + "ordered_route_sha256": "f8c76efb63ffb4d4d9f4e8b53e988c4dc4baf3133112c9f890e60c45cc3d0464", + "route_weight_sha256": "1c02fb9fe944ca007b0f76b3da4c430145fb7644611af8b653d6a67e3729c58f", + "loads": [ + 18, + 3, + 15, + 30, + 7, + 10, + 23, + 12, + 2, + 14, + 13, + 13, + 8, + 26, + 1, + 14, + 14, + 42, + 22, + 6, + 24, + 3, + 17, + 13, + 18, + 24, + 20, + 12, + 5, + 6, + 9, + 6, + 10, + 4, + 2, + 12, + 9, + 4, + 11, + 5, + 26, + 15, + 6, + 12, + 10, + 14, + 17, + 9, + 5, + 12, + 8, + 9, + 9, + 26, + 5, + 12, + 7, + 21, + 5, + 19, + 3, + 12, + 26, + 3 + ], + "weighted_loads": [ + 0.6493525747209787, + 0.12804484739899635, + 0.7066806685179472, + 2.8632407188415527, + 0.4325490891933441, + 0.43642256036400795, + 1.2396909482777119, + 0.6615119837224483, + 0.08342236652970314, + 0.4759733770042658, + 0.8035716153681278, + 0.6981538347899914, + 0.43414860777556896, + 2.878597140312195, + 0.03173559531569481, + 0.6440047435462475, + 0.8699697162955999, + 4.862354835495353, + 1.9039447028189898, + 0.31025785207748413, + 1.9720176234841347, + 0.14747332967817783, + 1.419578991830349, + 0.5152633562684059, + 1.0043435879051685, + 1.33504044637084, + 1.481371358036995, + 0.44575387239456177, + 0.19841522350907326, + 0.19148722290992737, + 0.652284063398838, + 0.3394863195717335, + 0.3944552205502987, + 0.18873157911002636, + 0.10259677097201347, + 1.115337960422039, + 0.5996363796293736, + 0.16009489819407463, + 0.4792176578193903, + 0.1933327652513981, + 1.940468868240714, + 0.5948639884591103, + 0.34631868824362755, + 0.45499178022146225, + 0.4243958927690983, + 1.202098473906517, + 1.4349118024110794, + 0.4681778587400913, + 0.5300478339195251, + 0.7017057351768017, + 0.4797093942761421, + 0.7519794628024101, + 0.5123949162662029, + 1.0895422473549843, + 0.24565454199910164, + 0.9178168047219515, + 0.3365708030760288, + 1.5963829569518566, + 0.3042728155851364, + 0.8952136114239693, + 0.13480746001005173, + 0.7111809272319078, + 1.4904020987451077, + 0.30292487516999245 + ], + "unique_experts": 64, + "load_cv": 0.6464368035248117, + "normalized_load_entropy": 0.9517624355427808, + "max_load_share": 0.05263157894736842 + } + }, + "s1_bos": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "01fcac51c32649dd32e2da5d9f38b29165f96dd3917d74c9c3af0bd97647d733", + "route_weight_sha256": "a2e130f155e6a7f60511fb1e48959ddb09850f3947d64713505577236073892a", + "loads": [ + 12, + 2, + 15, + 22, + 8, + 10, + 19, + 13, + 2, + 11, + 5, + 12, + 4, + 18, + 2, + 12, + 12, + 36, + 19, + 5, + 20, + 2, + 16, + 5, + 13, + 20, + 13, + 9, + 2, + 3, + 8, + 6, + 4, + 4, + 1, + 13, + 8, + 1, + 6, + 5, + 16, + 12, + 6, + 10, + 9, + 12, + 16, + 9, + 5, + 12, + 7, + 9, + 7, + 24, + 4, + 8, + 4, + 19, + 5, + 22, + 3, + 9, + 18, + 4 + ], + "weighted_loads": [ + 0.4211609922349453, + 0.07401978597044945, + 0.6873706858605146, + 2.2391118817031384, + 0.4649356957525015, + 0.4305893089622259, + 1.0485978405922651, + 0.6959260385483503, + 0.0777936540544033, + 0.39965036138892174, + 0.3305119499564171, + 0.6310236342251301, + 0.18687521293759346, + 2.287315968424082, + 0.0857006385922432, + 0.5349589213728905, + 0.8148630410432816, + 4.192984515801072, + 1.6013368461281061, + 0.23906362615525723, + 1.6478735283017159, + 0.07085241004824638, + 1.3599310852587223, + 0.17404642328619957, + 0.5230018254369497, + 1.090360026806593, + 0.7720173466950655, + 0.3108441401273012, + 0.07496226206421852, + 0.08579680509865284, + 0.6238296702504158, + 0.3582501895725727, + 0.12536372058093548, + 0.1919940933585167, + 0.07076960057020187, + 1.1199652049690485, + 0.5669769048690796, + 0.04931079223752022, + 0.3086269460618496, + 0.18316133134067059, + 1.0038051158189774, + 0.5119330007582903, + 0.26935821026563644, + 0.3964564260095358, + 0.38455899618566036, + 0.5688010212033987, + 1.4086864925920963, + 0.4631686992943287, + 0.4971972554922104, + 0.5781311690807343, + 0.408299433067441, + 0.7288501970469952, + 0.368746280670166, + 1.0162525232881308, + 0.16596078500151634, + 0.6475611831992865, + 0.21714464202523232, + 1.4936846811324358, + 0.31543081998825073, + 0.9813796877861023, + 0.130669467151165, + 0.584684282541275, + 0.998135456815362, + 0.40506813675165176 + ], + "unique_experts": 64, + "load_cv": 0.6717910054524835, + "normalized_load_entropy": 0.9476397113137407, + "max_load_share": 0.05555555555555555 + }, + "full_input": { + "tokens": 149, + "top_k": 6, + "decisions": 894, + "ordered_route_sha256": "b09195fc83d7a2ccb82dead6864084ba7589079a90ff372343d914856845ffcc", + "route_weight_sha256": "f2692c8384527eb2da583bc20f6e7309a63c1c82fd3c5abee289d8bb01537b07", + "loads": [ + 19, + 6, + 17, + 29, + 14, + 10, + 22, + 14, + 2, + 17, + 12, + 14, + 6, + 26, + 2, + 18, + 14, + 44, + 22, + 5, + 21, + 3, + 16, + 15, + 22, + 38, + 24, + 11, + 3, + 4, + 10, + 7, + 8, + 4, + 1, + 13, + 12, + 5, + 10, + 6, + 30, + 18, + 10, + 11, + 11, + 17, + 18, + 11, + 5, + 14, + 9, + 15, + 11, + 25, + 5, + 14, + 12, + 30, + 6, + 25, + 4, + 14, + 29, + 4 + ], + "weighted_loads": [ + 0.7197357472032309, + 0.26935794949531555, + 0.7660463061183691, + 2.894244909286499, + 0.8543685507029295, + 0.4305893089622259, + 1.168310133740306, + 0.7509120237082243, + 0.0777936540544033, + 0.6129924226552248, + 0.8259199224412441, + 0.6979878023266792, + 0.29199131578207016, + 2.910090122371912, + 0.0857006385922432, + 0.8108182437717915, + 0.9850434735417366, + 4.846913604065776, + 1.7179792001843452, + 0.23906362615525723, + 1.7444885522127151, + 0.14859839901328087, + 1.3599310852587223, + 0.87927470728755, + 1.1267834287136793, + 2.29900168441236, + 1.6793134976178408, + 0.3975365813821554, + 0.10599067620933056, + 0.16561095602810383, + 0.7201562598347664, + 0.39772430807352066, + 0.2804124318063259, + 0.1919940933585167, + 0.07076960057020187, + 1.1199652049690485, + 0.7938903607428074, + 0.19800450839102268, + 0.6368913128972054, + 0.21683490462601185, + 2.605162553489208, + 0.8838798999786377, + 0.42777133733034134, + 0.4152292385697365, + 0.6200373116880655, + 1.8911741729825735, + 1.623908456414938, + 0.5946257449686527, + 0.4971972554922104, + 0.6585551276803017, + 0.6002462301403284, + 1.0259381290525198, + 0.6168329566717148, + 1.0600832682102919, + 0.2550204060971737, + 1.0571478940546513, + 0.881865855306387, + 2.074952384456992, + 0.3391134049743414, + 1.1016021892428398, + 0.16578489914536476, + 0.8787496127188206, + 1.8103281017392874, + 0.40506813675165176 + ], + "unique_experts": 64, + "load_cv": 0.6441671199859084, + "normalized_load_entropy": 0.9513279109490794, + "max_load_share": 0.049217002237136466 + } + }, + "s0_x": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "17e8d89f6661f351fd4d46c7bb62f271fb61a084cd6567b5c243b63f25b77da0", + "route_weight_sha256": "5fff9959f7f75618ad7a5e04a6e10e70cf9ce1047ac8729cb77f2a265b9995e4", + "loads": [ + 10, + 3, + 15, + 22, + 7, + 14, + 20, + 13, + 2, + 11, + 5, + 10, + 4, + 18, + 2, + 14, + 13, + 36, + 22, + 5, + 17, + 2, + 17, + 4, + 14, + 22, + 11, + 9, + 1, + 2, + 8, + 5, + 4, + 3, + 2, + 13, + 9, + 1, + 6, + 6, + 18, + 11, + 6, + 8, + 9, + 11, + 17, + 9, + 5, + 11, + 7, + 8, + 7, + 21, + 5, + 9, + 3, + 20, + 5, + 19, + 3, + 10, + 19, + 5 + ], + "weighted_loads": [ + 0.3416512534022331, + 0.11534062027931213, + 0.6606013271957636, + 2.270010219886899, + 0.4365389235317707, + 0.5781003255397081, + 1.1283769384026527, + 0.6709434855729342, + 0.08172693476080894, + 0.3791259992867708, + 0.3152215499430895, + 0.5711679607629776, + 0.1773781254887581, + 2.2811660654842854, + 0.0628497526049614, + 0.6134350392967463, + 0.8735892865806818, + 4.209599453955889, + 1.8123478703200817, + 0.25554797425866127, + 1.545952782034874, + 0.06905214861035347, + 1.4438174962997437, + 0.1358570009469986, + 0.5814576409757137, + 1.203066848218441, + 0.6804616302251816, + 0.3177804723381996, + 0.04730363190174103, + 0.052495077252388, + 0.6236690916121006, + 0.3211729694157839, + 0.12853468768298626, + 0.15961080603301525, + 0.10223369300365448, + 1.1170790866017342, + 0.5889597125351429, + 0.04699132218956947, + 0.32450099289417267, + 0.22233215533196926, + 1.2018000092357397, + 0.4798406958580017, + 0.2797105796635151, + 0.32481334172189236, + 0.38521094620227814, + 0.48503214307129383, + 1.4128675125539303, + 0.46272676438093185, + 0.5738976094871759, + 0.537666380405426, + 0.4355796631425619, + 0.6904569119215012, + 0.3589637726545334, + 0.8865683823823929, + 0.20458166301250458, + 0.6992258038371801, + 0.1649497840553522, + 1.5138993617147207, + 0.30138831958174706, + 0.9058267287909985, + 0.14194688200950623, + 0.5956077855080366, + 1.0463760122656822, + 0.32642910070717335 + ], + "unique_experts": 64, + "load_cv": 0.6787878416736431, + "normalized_load_entropy": 0.9463720785844467, + "max_load_share": 0.05555555555555555 + }, + "full_input": { + "tokens": 133, + "top_k": 6, + "decisions": 798, + "ordered_route_sha256": "a11b4d692788e66baccb6b3a4ccb7f514dff0c15eb5b77ee5d52d6969cd60f84", + "route_weight_sha256": "7af0a44e8d376ae7bc3e70a56f3da773a2a9b056aece6ddc31bfb80792df40fe", + "loads": [ + 16, + 4, + 18, + 30, + 7, + 14, + 22, + 13, + 2, + 16, + 13, + 11, + 6, + 27, + 2, + 15, + 13, + 44, + 25, + 5, + 20, + 3, + 17, + 12, + 20, + 28, + 18, + 12, + 5, + 4, + 8, + 5, + 11, + 3, + 2, + 13, + 9, + 3, + 11, + 6, + 25, + 14, + 8, + 9, + 9, + 15, + 17, + 9, + 6, + 12, + 9, + 8, + 9, + 22, + 6, + 13, + 4, + 22, + 5, + 20, + 3, + 11, + 24, + 5 + ], + "weighted_loads": [ + 0.5511644147336483, + 0.15164929628372192, + 0.7936228383332491, + 3.0110921878367662, + 0.4365389235317707, + 0.5781003255397081, + 1.2247983030974865, + 0.6709434855729342, + 0.08172693476080894, + 0.5539225284010172, + 0.8967973981052637, + 0.5896648913621902, + 0.23896204121410847, + 2.914197627454996, + 0.0628497526049614, + 0.6573658157140017, + 0.8735892865806818, + 4.9200477078557014, + 2.1134055014699697, + 0.25554797425866127, + 1.7812417447566986, + 0.11323314905166626, + 1.4438174962997437, + 0.5092499349266291, + 1.1108918152749538, + 1.5147881843149662, + 1.2916596680879593, + 0.4431772865355015, + 0.20151198282837868, + 0.1103803999722004, + 0.6236690916121006, + 0.3211729694157839, + 0.4273283053189516, + 0.15961080603301525, + 0.10223369300365448, + 1.1170790866017342, + 0.5889597125351429, + 0.12016931176185608, + 0.5143761616200209, + 0.22233215533196926, + 2.0358356665819883, + 0.5990797448903322, + 0.418428149074316, + 0.34358615428209305, + 0.38521094620227814, + 1.2813588548451662, + 1.4128675125539303, + 0.46272676438093185, + 0.6143756490200758, + 0.5755480900406837, + 0.5704525094479322, + 0.6904569119215012, + 0.5092055276036263, + 0.9230788499116898, + 0.24767784401774406, + 0.9310699421912432, + 0.2059041690081358, + 1.6257525701075792, + 0.30138831958174706, + 0.9326451681554317, + 0.14194688200950623, + 0.6718695219606161, + 1.3532689213752747, + 0.32642910070717335 + ], + "unique_experts": 64, + "load_cv": 0.6581465086926722, + "normalized_load_entropy": 0.9507091824176799, + "max_load_share": 0.05513784461152882 + } + }, + "s1_x": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "9a91accbbda385cdc5cb4c487daf9f9ddbc8a1f079fbafa15ba30afb92c8e6b1", + "route_weight_sha256": "33296e30818dc87e001146f5f04e1cfd23e58d03666134b7f1dff5f328f52859", + "loads": [ + 12, + 2, + 15, + 22, + 6, + 11, + 19, + 14, + 2, + 7, + 5, + 11, + 4, + 18, + 3, + 15, + 14, + 36, + 21, + 4, + 17, + 3, + 17, + 6, + 13, + 20, + 11, + 8, + 1, + 3, + 9, + 5, + 5, + 4, + 3, + 11, + 10, + 2, + 7, + 6, + 16, + 11, + 8, + 9, + 8, + 9, + 16, + 8, + 6, + 13, + 7, + 10, + 7, + 24, + 4, + 8, + 4, + 20, + 7, + 19, + 2, + 9, + 16, + 5 + ], + "weighted_loads": [ + 0.41237963549792767, + 0.0721829142421484, + 0.6825106833130121, + 2.247500464320183, + 0.4262157343327999, + 0.47181242518126965, + 1.0710128527134657, + 0.7624564524739981, + 0.08075739070773125, + 0.2594672776758671, + 0.3361731357872486, + 0.6151051968336105, + 0.1816965602338314, + 2.261978778988123, + 0.11800219863653183, + 0.652993394061923, + 0.9838268104940653, + 4.2355026714503765, + 1.7754666563123465, + 0.22642073780298233, + 1.526495000347495, + 0.10210216790437698, + 1.3850347734987736, + 0.210951155051589, + 0.507502069696784, + 1.1327142529189587, + 0.5930802226066589, + 0.27159907296299934, + 0.0370817631483078, + 0.07740485481917858, + 0.6440565288066864, + 0.3336262721568346, + 0.14962620101869106, + 0.19781075976788998, + 0.13346143253147602, + 1.027081310749054, + 0.6942098140716553, + 0.07221468165516853, + 0.37478269450366497, + 0.23340683244168758, + 1.1031003221869469, + 0.46427066810429096, + 0.3343163691461086, + 0.34663553163409233, + 0.34916457906365395, + 0.4296502638608217, + 1.3743816241621971, + 0.40607632510364056, + 0.537604596465826, + 0.6149570718407631, + 0.41122445464134216, + 0.7564099952578545, + 0.36237582191824913, + 1.0189264994114637, + 0.17285266518592834, + 0.6596163045614958, + 0.19161312654614449, + 1.5431622173637152, + 0.3918240964412689, + 0.919681241735816, + 0.09627849236130714, + 0.5599792040884495, + 0.9116146322339773, + 0.42446713149547577 + ], + "unique_experts": 64, + "load_cv": 0.6559495224091473, + "normalized_load_entropy": 0.9510716591667103, + "max_load_share": 0.05555555555555555 + }, + "full_input": { + "tokens": 149, + "top_k": 6, + "decisions": 894, + "ordered_route_sha256": "fb7ff22cf2dd45e34a965a4bd633800f46ebc39210223802dca8e6c9b11d75e2", + "route_weight_sha256": "b9c55f23de722b615524fa3062fc279641030bdb0c286069460ddd45f292906a", + "loads": [ + 18, + 3, + 18, + 30, + 12, + 11, + 22, + 15, + 2, + 13, + 13, + 13, + 5, + 27, + 3, + 21, + 16, + 45, + 25, + 4, + 17, + 4, + 17, + 17, + 22, + 41, + 19, + 9, + 3, + 4, + 11, + 6, + 9, + 4, + 3, + 11, + 14, + 4, + 11, + 7, + 29, + 18, + 12, + 10, + 10, + 14, + 18, + 10, + 7, + 13, + 9, + 16, + 11, + 25, + 5, + 16, + 12, + 33, + 9, + 21, + 3, + 15, + 24, + 5 + ], + "weighted_loads": [ + 0.6638392545282841, + 0.11443285830318928, + 0.8103666733950377, + 3.0672809071838856, + 0.8156485892832279, + 0.47181242518126965, + 1.1907251458615065, + 0.817442437633872, + 0.08075739070773125, + 0.45503261499106884, + 0.9724825993180275, + 0.6820693649351597, + 0.2201974205672741, + 2.9446396939456463, + 0.11800219863653183, + 0.9379128310829401, + 1.1540072429925203, + 4.940166153013706, + 1.9311134647578, + 0.22642073780298233, + 1.526495000347495, + 0.17984815686941147, + 1.3850347734987736, + 0.9403081573545933, + 1.0813242699950933, + 2.4825296942144632, + 1.2876329235732555, + 0.30617567151784897, + 0.10346618480980396, + 0.15721900574862957, + 0.740383118391037, + 0.37310039065778255, + 0.3046749122440815, + 0.19781075976788998, + 0.13346143253147602, + 1.027081310749054, + 0.9211232699453831, + 0.14584427513182163, + 0.7030470613390207, + 0.26708040572702885, + 2.667883913964033, + 0.8480879254639149, + 0.5073815658688545, + 0.365408344194293, + 0.5846428945660591, + 1.6302749756723642, + 1.5896035879850388, + 0.5375333707779646, + 0.5778631493449211, + 0.6149570718407631, + 0.636235810816288, + 1.053497927263379, + 0.5940552167594433, + 1.0563524160534143, + 0.2619122862815857, + 1.135782901197672, + 0.8582894541323185, + 2.2576605323702097, + 0.46781028248369694, + 1.0117832217365503, + 0.1313939243555069, + 0.8589360471814871, + 1.477859491482377, + 0.42446713149547577 + ], + "unique_experts": 64, + "load_cv": 0.6491204790433586, + "normalized_load_entropy": 0.9519166219458713, + "max_load_share": 0.050335570469798654 + } + }, + "s0_period": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "01caafcee2ebe690d5c06435982d35e7f8737ad3478ab7f39aba68eb44f4e4a6", + "route_weight_sha256": "8af9397e571ab46f5691fbc11144be530bffe92f6dfd6ed1d027ee19da7c584f", + "loads": [ + 10, + 1, + 13, + 23, + 7, + 9, + 18, + 13, + 2, + 10, + 4, + 12, + 5, + 18, + 2, + 15, + 13, + 36, + 19, + 5, + 18, + 2, + 16, + 4, + 15, + 21, + 13, + 8, + 1, + 4, + 9, + 6, + 3, + 4, + 2, + 12, + 9, + 2, + 7, + 6, + 18, + 10, + 5, + 8, + 9, + 11, + 16, + 9, + 6, + 10, + 7, + 9, + 7, + 23, + 5, + 10, + 4, + 20, + 5, + 21, + 3, + 10, + 21, + 4 + ], + "weighted_loads": [ + 0.3480102904140949, + 0.04481887444853783, + 0.6222263760864735, + 2.2888006921857595, + 0.45820084400475025, + 0.40593343414366245, + 1.0350920129567385, + 0.703436840325594, + 0.08180278912186623, + 0.3469171039760113, + 0.28757013380527496, + 0.6750602796673775, + 0.2204122170805931, + 2.2925139777362347, + 0.06532055139541626, + 0.6451069992035627, + 0.8573731984943151, + 4.289056561887264, + 1.7249821778386831, + 0.24772272258996964, + 1.6372605469077826, + 0.07015158608555794, + 1.4020135663449764, + 0.13722124882042408, + 0.6211513094604015, + 1.1703409906476736, + 0.7560655660927296, + 0.2662562970072031, + 0.03883982077240944, + 0.10536164231598377, + 0.6770237348973751, + 0.35414350777864456, + 0.09718969836831093, + 0.189345246180892, + 0.10487886890769005, + 1.1037659924477339, + 0.5866132415831089, + 0.07821080088615417, + 0.3452390730381012, + 0.22507538087666035, + 1.1671859379857779, + 0.4459258522838354, + 0.24853509664535522, + 0.33207824267446995, + 0.3920010104775429, + 0.47294796258211136, + 1.4012143686413765, + 0.45674658566713333, + 0.5904428791254759, + 0.4830712750554085, + 0.4168463610112667, + 0.7420869991183281, + 0.35464073717594147, + 0.9391221068799496, + 0.20695870369672775, + 0.729547917842865, + 0.2192745842039585, + 1.5151542760431767, + 0.29969697818160057, + 0.981706615537405, + 0.14582020416855812, + 0.6044636890292168, + 1.0804592780768871, + 0.2915674392133951 + ], + "unique_experts": 64, + "load_cv": 0.676087978770028, + "normalized_load_entropy": 0.947277408033556, + "max_load_share": 0.05555555555555555 + }, + "full_input": { + "tokens": 133, + "top_k": 6, + "decisions": 798, + "ordered_route_sha256": "d4e1158eeb7b05dc341bfb6df9448adc5009901c7556501e4fb0d0cdb68e773f", + "route_weight_sha256": "5036c046d1e31d5a6ff886d13dcc3d25ef3d848120ff84e5e423b123cc9e9437", + "loads": [ + 16, + 2, + 15, + 31, + 7, + 9, + 20, + 13, + 2, + 14, + 11, + 13, + 7, + 26, + 2, + 17, + 13, + 43, + 22, + 5, + 21, + 3, + 16, + 11, + 21, + 29, + 20, + 12, + 5, + 5, + 9, + 6, + 11, + 4, + 2, + 12, + 9, + 4, + 11, + 6, + 25, + 12, + 9, + 9, + 9, + 15, + 16, + 9, + 6, + 11, + 9, + 9, + 9, + 24, + 6, + 15, + 5, + 23, + 5, + 22, + 3, + 11, + 27, + 4 + ], + "weighted_loads": [ + 0.5592482872307301, + 0.08112755045294762, + 0.7420212663710117, + 2.9255469236522913, + 0.45820084400475025, + 0.40593343414366245, + 1.1315133776515722, + 0.703436840325594, + 0.08180278912186623, + 0.47721637412905693, + 0.7186646685004234, + 0.6935572102665901, + 0.2819961328059435, + 2.8875359259545803, + 0.06532055139541626, + 0.7229054477065802, + 0.8573731984943151, + 4.954021528363228, + 2.0704811215400696, + 0.24772272258996964, + 1.8865082543343306, + 0.11672251671552658, + 1.4020135663449764, + 0.4528690278530121, + 1.1415459625422955, + 1.5512149333953857, + 1.3625219352543354, + 0.4274242799729109, + 0.20011639967560768, + 0.14052915014326572, + 0.6770237348973751, + 0.35414350777864456, + 0.436955776065588, + 0.189345246180892, + 0.10487886890769005, + 1.1037659924477339, + 0.5866132415831089, + 0.1478339396417141, + 0.5058422740548849, + 0.22507538087666035, + 2.0024311896413565, + 0.5318123437464237, + 0.4670308567583561, + 0.35085105523467064, + 0.3920010104775429, + 1.3300855979323387, + 1.4012143686413765, + 0.45674658566713333, + 0.5904428791254759, + 0.5159924104809761, + 0.5542735569179058, + 0.7420869991183281, + 0.5095661282539368, + 0.9748070649802685, + 0.25029368326067924, + 1.120955128222704, + 0.257584061473608, + 1.6680795066058636, + 0.29969697818160057, + 1.0106251612305641, + 0.14582020416855812, + 0.6902236789464951, + 1.4360747933387756, + 0.2915674392133951 + ], + "unique_experts": 64, + "load_cv": 0.6602809095982575, + "normalized_load_entropy": 0.9507712556622455, + "max_load_share": 0.05388471177944862 + } + }, + "s1_period": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "ad88973584119b94ba1fac808fbe6c240a4ccbaccf81abfdaa328696e43ef402", + "route_weight_sha256": "a4b7cda210978c03157af1846ae0b5b0f05d1459d4efd466fd06d6fea4092f4b", + "loads": [ + 12, + 2, + 15, + 22, + 8, + 12, + 19, + 14, + 2, + 7, + 5, + 12, + 3, + 18, + 3, + 15, + 14, + 37, + 18, + 4, + 19, + 2, + 16, + 5, + 14, + 21, + 13, + 7, + 2, + 2, + 9, + 5, + 7, + 3, + 1, + 12, + 8, + 1, + 7, + 6, + 16, + 12, + 10, + 8, + 8, + 10, + 17, + 9, + 6, + 11, + 7, + 8, + 7, + 24, + 3, + 7, + 3, + 20, + 8, + 20, + 2, + 10, + 16, + 4 + ], + "weighted_loads": [ + 0.4084538705646992, + 0.08376045897603035, + 0.696536285802722, + 2.2585757356137037, + 0.48788800090551376, + 0.5090700015425682, + 1.0435300264507532, + 0.7549705188721418, + 0.0798586905002594, + 0.26422594860196114, + 0.3402726501226425, + 0.6503026634454727, + 0.1482500247657299, + 2.2657673843204975, + 0.11508670449256897, + 0.6276681981980801, + 1.0025506597012281, + 4.366142930462956, + 1.6620634142309427, + 0.23439711332321167, + 1.6305849235504866, + 0.07057483866810799, + 1.3410654924809933, + 0.1727953776717186, + 0.5282057803124189, + 1.2033319845795631, + 0.6853202767670155, + 0.23514435812830925, + 0.06628336198627949, + 0.05034179612994194, + 0.6518197357654572, + 0.3259243983775377, + 0.21253680065274239, + 0.16326078213751316, + 0.07490791380405426, + 1.0944094900041819, + 0.6000838167965412, + 0.0419422909617424, + 0.37347268126904964, + 0.23428552225232124, + 1.0574330557137728, + 0.48585304617881775, + 0.4022745918482542, + 0.32965702936053276, + 0.33603023178875446, + 0.48064784705638885, + 1.4624210093170404, + 0.4546903185546398, + 0.5670791231095791, + 0.5424730628728867, + 0.4151622485369444, + 0.6604757383465767, + 0.35740774497389793, + 1.0151022877544165, + 0.14294947870075703, + 0.6307434998452663, + 0.15406335145235062, + 1.5715907849371433, + 0.42830589413642883, + 0.9404285494238138, + 0.0939636304974556, + 0.5925699230283499, + 0.9294804725795984, + 0.3505523093044758 + ], + "unique_experts": 64, + "load_cv": 0.6787878416736431, + "normalized_load_entropy": 0.9462223756174841, + "max_load_share": 0.05709876543209876 + }, + "full_input": { + "tokens": 149, + "top_k": 6, + "decisions": 894, + "ordered_route_sha256": "8610aad47c80555f6c3fd045c675ca9b9dc20f25a82635d9c9a16140837f3aa6", + "route_weight_sha256": "2fae57428061ce64c819c2972f4ecdb61ef0c89fe48d94b1b42ac1a94ce51709", + "loads": [ + 18, + 3, + 18, + 30, + 14, + 12, + 22, + 15, + 2, + 12, + 12, + 14, + 4, + 26, + 3, + 22, + 16, + 45, + 22, + 4, + 19, + 3, + 16, + 15, + 24, + 43, + 22, + 8, + 4, + 3, + 11, + 6, + 11, + 3, + 1, + 12, + 12, + 3, + 11, + 7, + 29, + 19, + 15, + 9, + 10, + 15, + 19, + 11, + 6, + 11, + 9, + 14, + 11, + 25, + 4, + 17, + 11, + 34, + 9, + 22, + 3, + 15, + 24, + 4 + ], + "weighted_loads": [ + 0.6646164041012526, + 0.12601040303707123, + 0.8190693836659193, + 2.971441635861993, + 0.8773208558559418, + 0.5090700015425682, + 1.163242319598794, + 0.8099565040320158, + 0.0798586905002594, + 0.42245648987591267, + 0.8356806226074696, + 0.7172668315470219, + 0.18914373219013214, + 2.8885415382683277, + 0.11508670449256897, + 0.9515450410544872, + 1.1727310921996832, + 5.02007201872766, + 1.8455031607300043, + 0.23439711332321167, + 1.6305849235504866, + 0.14832082763314247, + 1.3410654924809933, + 0.8678532093763351, + 1.135832192376256, + 2.6407234091311693, + 1.408751718699932, + 0.2697209566831589, + 0.1345436554402113, + 0.13015594705939293, + 0.7481463253498077, + 0.3653985168784857, + 0.3675855118781328, + 0.16326078213751316, + 0.07490791380405426, + 1.0944094900041819, + 0.826997272670269, + 0.1155718844383955, + 0.7017370481044054, + 0.2679590955376625, + 2.574026284739375, + 0.8840739149600267, + 0.6201052535325289, + 0.34842984192073345, + 0.5715085472911596, + 1.8523637354373932, + 1.677642973139882, + 0.5861473642289639, + 0.5670791231095791, + 0.5424730628728867, + 0.614232650026679, + 0.9575636703521013, + 0.5857713967561722, + 1.0518354084342718, + 0.23200909979641438, + 1.3151138424873352, + 0.8154486194252968, + 2.3368251994252205, + 0.4519884791225195, + 1.0325305294245481, + 0.12907906249165535, + 0.860866816714406, + 1.4596436228603125, + 0.3505523093044758 + ], + "unique_experts": 64, + "load_cv": 0.672269744233374, + "normalized_load_entropy": 0.9473427879678894, + "max_load_share": 0.050335570469798654 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 108, + "ordered_topk_exact_tokens": 57, + "set_exact_tokens": 72, + "mean_set_jaccard": 0.9007936507936507, + "mean_token_weighted_tv": 0.020677743337324098, + "aggregate_load_tv": 0.040123456790123455 + }, + "system_bos": { + "tokens": 108, + "ordered_topk_exact_tokens": 38, + "set_exact_tokens": 59, + "mean_set_jaccard": 0.8604497354497356, + "mean_token_weighted_tv": 0.027222652540162758, + "aggregate_load_tv": 0.041666666666666664 + }, + "system_x": { + "tokens": 108, + "ordered_topk_exact_tokens": 42, + "set_exact_tokens": 55, + "mean_set_jaccard": 0.841931216931217, + "mean_token_weighted_tv": 0.03274084200772146, + "aggregate_load_tv": 0.04938271604938271 + }, + "system_period": { + "tokens": 108, + "ordered_topk_exact_tokens": 42, + "set_exact_tokens": 57, + "mean_set_jaccard": 0.8500881834215169, + "mean_token_weighted_tv": 0.03070473401910729, + "aggregate_load_tv": 0.054012345679012336 + }, + "bos_at_s0": { + "tokens": 108, + "ordered_topk_exact_tokens": 46, + "set_exact_tokens": 59, + "mean_set_jaccard": 0.8584656084656085, + "mean_token_weighted_tv": 0.028268024890200683, + "aggregate_load_tv": 0.047839506172839504 + }, + "bos_at_s1": { + "tokens": 108, + "ordered_topk_exact_tokens": 39, + "set_exact_tokens": 56, + "mean_set_jaccard": 0.8437830687830689, + "mean_token_weighted_tv": 0.032675826775461984, + "aggregate_load_tv": 0.04938271604938271 + }, + "x_at_s0": { + "tokens": 108, + "ordered_topk_exact_tokens": 37, + "set_exact_tokens": 51, + "mean_set_jaccard": 0.8314373897707232, + "mean_token_weighted_tv": 0.034158806924501225, + "aggregate_load_tv": 0.05092592592592593 + }, + "x_at_s1": { + "tokens": 108, + "ordered_topk_exact_tokens": 32, + "set_exact_tokens": 50, + "mean_set_jaccard": 0.8260582010582012, + "mean_token_weighted_tv": 0.036837528856402194, + "aggregate_load_tv": 0.04938271604938271 + }, + "period_at_s0": { + "tokens": 108, + "ordered_topk_exact_tokens": 43, + "set_exact_tokens": 61, + "mean_set_jaccard": 0.8559082892416227, + "mean_token_weighted_tv": 0.031091483960928465, + "aggregate_load_tv": 0.05555555555555555 + }, + "period_at_s1": { + "tokens": 108, + "ordered_topk_exact_tokens": 32, + "set_exact_tokens": 50, + "mean_set_jaccard": 0.8204144620811289, + "mean_token_weighted_tv": 0.03705053332399715, + "aggregate_load_tv": 0.06018518518518518 + } + } + }, + "layer_18": { + "layer": 18, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "e19c8fe8919fd16184bf44d30bfb28e5e92e9c30ffe88196ea9ae1a5b5f77425", + "route_weight_sha256": "ce4fb84002ea64a6453b5e09b5e335277e9c802aa31046212a84ff77dbb8c865", + "loads": [ + 36, + 13, + 3, + 10, + 18, + 5, + 47, + 15, + 6, + 19, + 1, + 11, + 8, + 16, + 8, + 14, + 10, + 5, + 22, + 13, + 2, + 9, + 21, + 15, + 16, + 2, + 2, + 16, + 5, + 1, + 7, + 15, + 5, + 11, + 5, + 11, + 8, + 7, + 6, + 11, + 7, + 3, + 5, + 1, + 2, + 1, + 18, + 8, + 7, + 4, + 5, + 7, + 22, + 14, + 3, + 12, + 13, + 15, + 3, + 10, + 7, + 9, + 3, + 14 + ], + "weighted_loads": [ + 3.2917091976851225, + 0.6052099373191595, + 0.20398284867405891, + 0.4285020958632231, + 1.8074912950396538, + 0.2072816751897335, + 5.250066131353378, + 1.2674171701073647, + 0.31459240429103374, + 1.1940470393747091, + 0.030673982575535774, + 0.3903509844094515, + 0.27867137268185616, + 2.484665220603347, + 0.4379512742161751, + 0.5250582844018936, + 0.5142909586429596, + 0.17661116644740105, + 1.425718193873763, + 1.1504403166472912, + 0.17550136893987656, + 0.5490248054265976, + 1.9665871541947126, + 0.6408090926706791, + 0.6085927076637745, + 0.07640961185097694, + 0.06461639516055584, + 0.9896145649254322, + 0.3744351379573345, + 0.03608207032084465, + 0.41584449633955956, + 0.45718204602599144, + 0.20565356314182281, + 0.4038484822958708, + 0.47957364097237587, + 0.7339634038507938, + 0.2928522974252701, + 0.23775575123727322, + 0.26172528974711895, + 0.39543982967734337, + 0.25176296569406986, + 0.11460944265127182, + 0.18769264593720436, + 0.08291060477495193, + 0.0520457848906517, + 0.03156549483537674, + 1.3995063565671444, + 0.34763629734516144, + 0.25853277184069157, + 0.132064925506711, + 0.18568340688943863, + 0.328276788815856, + 1.7909740377217531, + 0.7518421113491058, + 0.09431173093616962, + 0.537897028028965, + 0.4826883636415005, + 0.9426571354269981, + 0.20569727569818497, + 0.46297476813197136, + 0.2914892863482237, + 0.29232492111623287, + 0.14764946326613426, + 0.8502894509583712 + ], + "unique_experts": 64, + "load_cv": 0.7898340519369538, + "normalized_load_entropy": 0.9354931437098918, + "max_load_share": 0.07253086419753087 + }, + "full_input": { + "tokens": 133, + "top_k": 6, + "decisions": 798, + "ordered_route_sha256": "da74f053a872eb29a55b7556c6a0ae18c07923b3bad3ac187984d50a3d1adc79", + "route_weight_sha256": "db546bee5c9edc00b44a26b9711cb6a8018bd8725105688058f6dbf73542e82e", + "loads": [ + 42, + 14, + 15, + 10, + 18, + 8, + 47, + 15, + 14, + 19, + 2, + 15, + 8, + 16, + 13, + 19, + 10, + 5, + 39, + 13, + 2, + 10, + 21, + 16, + 18, + 2, + 2, + 16, + 5, + 1, + 15, + 15, + 5, + 11, + 5, + 14, + 9, + 9, + 6, + 13, + 13, + 3, + 9, + 1, + 2, + 1, + 26, + 8, + 9, + 16, + 8, + 9, + 31, + 22, + 3, + 12, + 15, + 15, + 4, + 13, + 7, + 15, + 3, + 16 + ], + "weighted_loads": [ + 3.675039479508996, + 0.677625073119998, + 1.2440086361020803, + 0.4285020958632231, + 1.8074912950396538, + 0.2861796747893095, + 5.250066131353378, + 1.2674171701073647, + 0.8067714814096689, + 1.1940470393747091, + 0.04169929213821888, + 0.7733424846082926, + 0.27867137268185616, + 2.484665220603347, + 1.3083662148565054, + 0.683786865323782, + 0.5142909586429596, + 0.17661116644740105, + 2.3935806546360254, + 1.1504403166472912, + 0.17550136893987656, + 0.574495630338788, + 1.9665871541947126, + 0.6672836299985647, + 0.6828953251242638, + 0.07640961185097694, + 0.06461639516055584, + 0.9896145649254322, + 0.3744351379573345, + 0.03608207032084465, + 0.7366934707388282, + 0.45718204602599144, + 0.20565356314182281, + 0.4038484822958708, + 0.47957364097237587, + 0.8981324508786201, + 0.3163976650685072, + 0.29857767559587955, + 0.26172528974711895, + 0.4431255515664816, + 0.510791851207614, + 0.11460944265127182, + 0.2996399328112602, + 0.08291060477495193, + 0.0520457848906517, + 0.03156549483537674, + 2.9191154576838017, + 0.34763629734516144, + 0.3682797532528639, + 0.6640598941594362, + 0.27921782433986664, + 0.4929696302860975, + 2.394041506573558, + 1.3092299588024616, + 0.09431173093616962, + 0.537897028028965, + 1.480486687272787, + 0.9426571354269981, + 0.2348844651132822, + 0.6108923256397247, + 0.2914892863482237, + 0.48738550581038, + 0.14764946326613426, + 0.9445263724774122 + ], + "unique_experts": 64, + "load_cv": 0.741172720526059, + "normalized_load_entropy": 0.9396530764353932, + "max_load_share": 0.05889724310776942 + } + }, + "s1_eos": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "62f3884f9862579f2ebfe0b0af064a36ce4ecb021cf4720a46a4e9543c4a101d", + "route_weight_sha256": "2a8738a27bc4a5edfa00db268369c7a1486be5f6ce3afc68a421efc8b34a60b4", + "loads": [ + 38, + 10, + 3, + 9, + 18, + 5, + 47, + 15, + 7, + 20, + 3, + 12, + 9, + 15, + 6, + 14, + 11, + 5, + 21, + 13, + 2, + 10, + 20, + 13, + 14, + 2, + 2, + 17, + 5, + 1, + 7, + 13, + 5, + 9, + 6, + 12, + 10, + 11, + 8, + 10, + 6, + 3, + 4, + 1, + 2, + 1, + 18, + 7, + 8, + 4, + 6, + 6, + 21, + 14, + 2, + 12, + 14, + 14, + 6, + 10, + 6, + 9, + 3, + 13 + ], + "weighted_loads": [ + 3.3502316679805517, + 0.48421789333224297, + 0.21745731681585312, + 0.4031259771436453, + 1.8869904894381762, + 0.20734285190701485, + 5.24582408554852, + 1.287563944235444, + 0.352076368406415, + 1.2477817852050066, + 0.09345652535557747, + 0.4167412016540766, + 0.3143754620105028, + 2.460046887397766, + 0.3797301985323429, + 0.5320293046534061, + 0.5575833488255739, + 0.1669332403689623, + 1.4473427589982748, + 1.1774308513849974, + 0.17291848361492157, + 0.5805013328790665, + 1.902229405939579, + 0.5454141981899738, + 0.5529980529099703, + 0.07362659648060799, + 0.06390256062150002, + 1.0545625928789377, + 0.37313819490373135, + 0.038830872625112534, + 0.38193462044000626, + 0.39778146520256996, + 0.20964250341057777, + 0.34083737060427666, + 0.5129654295742512, + 0.7829985599964857, + 0.35634090565145016, + 0.36567044630646706, + 0.35045069828629494, + 0.3630624655634165, + 0.20794771425426006, + 0.1120721772313118, + 0.15396489761769772, + 0.08330608159303665, + 0.05097937025129795, + 0.031736552715301514, + 1.3522564992308617, + 0.31607869267463684, + 0.2880072668194771, + 0.12851665169000626, + 0.21604006178677082, + 0.3079642467200756, + 1.7289258725941181, + 0.7599507700651884, + 0.06387961655855179, + 0.5347705539315939, + 0.5033158175647259, + 0.8932711854577065, + 0.2896012980490923, + 0.47914828173816204, + 0.24571855925023556, + 0.3073548339307308, + 0.14496589824557304, + 0.8297143522650003 + ], + "unique_experts": 64, + "load_cv": 0.7840235214472804, + "normalized_load_entropy": 0.9378271573910373, + "max_load_share": 0.07253086419753087 + }, + "full_input": { + "tokens": 149, + "top_k": 6, + "decisions": 894, + "ordered_route_sha256": "7f7483b9638395d8b7c676b33b698291972c9bcc55fd164ee51e8596441a015a", + "route_weight_sha256": "43f51c341cc124d0b6c9eeb66afc84a572502ed6dd827b08b080d33e9b44cb6c", + "loads": [ + 46, + 13, + 16, + 9, + 19, + 8, + 47, + 17, + 17, + 22, + 4, + 16, + 9, + 16, + 15, + 15, + 11, + 14, + 43, + 14, + 2, + 12, + 21, + 13, + 16, + 2, + 2, + 17, + 5, + 2, + 18, + 15, + 7, + 10, + 10, + 27, + 11, + 16, + 9, + 12, + 11, + 3, + 7, + 7, + 2, + 1, + 36, + 10, + 11, + 18, + 10, + 8, + 30, + 25, + 4, + 12, + 17, + 19, + 9, + 14, + 6, + 14, + 3, + 19 + ], + "weighted_loads": [ + 3.7686000391840935, + 0.6248014643788338, + 1.3026186469942331, + 0.4031259771436453, + 1.9257575813680887, + 0.29412532038986683, + 5.24582408554852, + 1.3552989903837442, + 1.2129068169742823, + 1.3101000301539898, + 0.10518419370055199, + 0.771889315918088, + 0.3143754620105028, + 2.5043326877057552, + 1.38837836869061, + 0.5645003095269203, + 0.5575833488255739, + 0.7402522135525942, + 3.202262345701456, + 1.3125069420784712, + 0.17291848361492157, + 0.6316167432814837, + 1.9360951706767082, + 0.5454141981899738, + 0.6324314381927252, + 0.07362659648060799, + 0.06390256062150002, + 1.0545625928789377, + 0.37313819490373135, + 0.07518719136714935, + 0.9690458374097943, + 0.6419714950025082, + 0.29573820158839226, + 0.4175928719341755, + 0.9349604360759258, + 2.090240666642785, + 0.3798237070441246, + 0.5861531272530556, + 0.38973622769117355, + 0.4108893610537052, + 0.40492616407573223, + 0.1120721772313118, + 0.24320678785443306, + 0.5745303779840469, + 0.05097937025129795, + 0.031736552715301514, + 4.078223712742329, + 0.4702216237783432, + 0.3858161736279726, + 0.7304309941828251, + 0.3254450373351574, + 0.46433693543076515, + 2.3199260886758566, + 1.4553500730544329, + 0.18302788585424423, + 0.5347705539315939, + 1.5143150463700294, + 1.1245833970606327, + 0.6557288132607937, + 0.751951590180397, + 0.24571855925023556, + 0.4951643068343401, + 0.14496589824557304, + 1.0623678844422102 + ], + "unique_experts": 64, + "load_cv": 0.703012792751574, + "normalized_load_entropy": 0.9461193027954251, + "max_load_share": 0.052572706935123045 + } + }, + "s0_bos": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "aed7cd8da805bdbf8fbdabf1767e1d4c6e3ef81aa10126a8d16c5d745ed6c058", + "route_weight_sha256": "c5d3e7f170aa6ddb409e902971be7e2819c91c6a69e81a56319256493a1fe246", + "loads": [ + 36, + 11, + 5, + 11, + 19, + 5, + 47, + 16, + 7, + 20, + 3, + 10, + 7, + 16, + 6, + 16, + 9, + 5, + 20, + 14, + 2, + 10, + 21, + 12, + 16, + 2, + 3, + 16, + 5, + 1, + 8, + 13, + 6, + 10, + 6, + 10, + 11, + 8, + 5, + 9, + 6, + 1, + 5, + 1, + 1, + 1, + 18, + 7, + 8, + 5, + 10, + 6, + 21, + 13, + 2, + 12, + 12, + 15, + 7, + 10, + 5, + 10, + 3, + 12 + ], + "weighted_loads": [ + 3.384906681254506, + 0.5306543782353401, + 0.25893381610512733, + 0.4937652386724949, + 1.8184461295604706, + 0.2029632329940796, + 5.347837917506695, + 1.3434074614197016, + 0.35796830244362354, + 1.2450990211218596, + 0.0845596008002758, + 0.34990804456174374, + 0.24797138944268227, + 2.5171915106475353, + 0.38526028767228127, + 0.5850948356091976, + 0.5091273058205843, + 0.17401313036680222, + 1.3825564328581095, + 1.1747407466173172, + 0.18458657711744308, + 0.5302829947322607, + 2.010251171886921, + 0.5636948235332966, + 0.5867024231702089, + 0.07293989136815071, + 0.1005837433040142, + 1.0302536934614182, + 0.3710862286388874, + 0.03476305305957794, + 0.39444725401699543, + 0.3979976885020733, + 0.23811478912830353, + 0.3500001132488251, + 0.48912566155195236, + 0.75196223706007, + 0.40586390905082226, + 0.28046231158077717, + 0.21777616441249847, + 0.32993083633482456, + 0.21372799016535282, + 0.0388120673596859, + 0.2025593612343073, + 0.08965706825256348, + 0.02807253785431385, + 0.03390268608927727, + 1.3463835902512074, + 0.30480656400322914, + 0.2960217148065567, + 0.16090643033385277, + 0.33408220671117306, + 0.31981199979782104, + 1.7214633040130138, + 0.7510114312171936, + 0.053366925567388535, + 0.5481453090906143, + 0.4284287057816982, + 0.9613772258162498, + 0.3173148948699236, + 0.47694510966539383, + 0.2223840393126011, + 0.3266496229916811, + 0.14050035923719406, + 0.7781483381986618 + ], + "unique_experts": 64, + "load_cv": 0.7771896659524514, + "normalized_load_entropy": 0.9379291866464285, + "max_load_share": 0.07253086419753087 + }, + "full_input": { + "tokens": 133, + "top_k": 6, + "decisions": 798, + "ordered_route_sha256": "3966ac4a57d188f917bdf461e57c348072b93a92a36b31d3e933be8c5585d2fe", + "route_weight_sha256": "7f267cbb436c9b2a10dbb90d1c685bdb508666575eead7ac5f7c0fa127fc6948", + "loads": [ + 42, + 12, + 16, + 11, + 19, + 7, + 47, + 16, + 15, + 20, + 3, + 13, + 9, + 16, + 11, + 19, + 9, + 5, + 40, + 14, + 2, + 11, + 21, + 13, + 18, + 2, + 4, + 16, + 5, + 1, + 14, + 13, + 6, + 11, + 6, + 14, + 11, + 10, + 5, + 13, + 13, + 2, + 10, + 1, + 1, + 1, + 27, + 7, + 10, + 16, + 13, + 8, + 30, + 20, + 2, + 12, + 13, + 15, + 8, + 12, + 5, + 15, + 3, + 14 + ], + "weighted_loads": [ + 3.7682369630783796, + 0.6030695140361786, + 1.2723641749471426, + 0.4937652386724949, + 1.8184461295604706, + 0.2514995392411947, + 5.347837917506695, + 1.3434074614197016, + 0.8501473795622587, + 1.2450990211218596, + 0.0845596008002758, + 0.5851384531706572, + 0.5138827674090862, + 2.5171915106475353, + 1.1726114880293608, + 0.6811108663678169, + 0.5091273058205843, + 0.17401313036680222, + 2.440462812781334, + 1.1747407466173172, + 0.18458657711744308, + 0.5557538196444511, + 2.010251171886921, + 0.612509872764349, + 0.6512674037367105, + 0.07293989136815071, + 0.1481589525938034, + 1.0302536934614182, + 0.3710862286388874, + 0.03476305305957794, + 0.6526401583105326, + 0.3979976885020733, + 0.23811478912830353, + 0.41394615173339844, + 0.48912566155195236, + 0.9649834148585796, + 0.40586390905082226, + 0.3412842359393835, + 0.21777616441249847, + 0.5403951592743397, + 0.5558016318827868, + 0.10373922064900398, + 0.3901810999959707, + 0.08965706825256348, + 0.02807253785431385, + 0.03390268608927727, + 2.875664211809635, + 0.30480656400322914, + 0.405768696218729, + 0.648581724613905, + 0.4286126587539911, + 0.4764733836054802, + 2.3245307728648186, + 1.2671159878373146, + 0.053366925567388535, + 0.5481453090906143, + 0.6518994532525539, + 0.9613772258162498, + 0.34650208428502083, + 0.5825245901942253, + 0.2223840393126011, + 0.49300286173820496, + 0.14050035923719406, + 0.8723852597177029 + ], + "unique_experts": 64, + "load_cv": 0.737502474615131, + "normalized_load_entropy": 0.9405251164067389, + "max_load_share": 0.05889724310776942 + } + }, + "s1_bos": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "c5502297fbe2d2094ac9b0599e73433e0bd53047a7c47669837200fa1fffdb0e", + "route_weight_sha256": "ed58ed7c41fc8df1cba93c25d53b929136c6604dcf68fd3481cb61e651ab37e5", + "loads": [ + 37, + 12, + 3, + 10, + 17, + 5, + 47, + 15, + 7, + 21, + 2, + 7, + 9, + 16, + 6, + 15, + 11, + 5, + 20, + 15, + 2, + 10, + 21, + 12, + 14, + 3, + 2, + 15, + 4, + 2, + 6, + 12, + 6, + 11, + 7, + 11, + 10, + 10, + 7, + 11, + 6, + 2, + 5, + 1, + 1, + 1, + 17, + 7, + 7, + 4, + 8, + 8, + 21, + 13, + 3, + 13, + 13, + 15, + 6, + 11, + 6, + 7, + 3, + 14 + ], + "weighted_loads": [ + 3.358667144551873, + 0.5737458057701588, + 0.22268978878855705, + 0.4451698288321495, + 1.8786827195435762, + 0.20249690301716328, + 5.533256182447076, + 1.2917658630758524, + 0.3548377715051174, + 1.2780178003013134, + 0.055520497262477875, + 0.24862801283597946, + 0.3395066410303116, + 2.5100380927324295, + 0.403801117092371, + 0.5678884163498878, + 0.5913532506674528, + 0.17876148223876953, + 1.4419352654367685, + 1.2351282387971878, + 0.19445902854204178, + 0.5402398277074099, + 1.9745769947767258, + 0.5547208730131388, + 0.5278136320412159, + 0.09826570190489292, + 0.06374078057706356, + 0.9634142816066742, + 0.34591876342892647, + 0.06814270280301571, + 0.33252547308802605, + 0.36938919872045517, + 0.2394379898905754, + 0.38608114048838615, + 0.5405458249151707, + 0.7278851568698883, + 0.36037263832986355, + 0.3395844418555498, + 0.2831592969596386, + 0.3984225504100323, + 0.19637776538729668, + 0.07900340855121613, + 0.19145420007407665, + 0.08180849999189377, + 0.027406997978687286, + 0.035306818783283234, + 1.2624295987188816, + 0.3149462155997753, + 0.2652024030685425, + 0.12438273057341576, + 0.27400231547653675, + 0.38349700905382633, + 1.7104477211833, + 0.708142502233386, + 0.0762869082391262, + 0.5676074959337711, + 0.4676256440579891, + 0.9467537645250559, + 0.2934879269450903, + 0.4925203863531351, + 0.258565466850996, + 0.22413328289985657, + 0.1324586533010006, + 0.832449359819293 + ], + "unique_experts": 64, + "load_cv": 0.7777777777777778, + "normalized_load_entropy": 0.938564254933849, + "max_load_share": 0.07253086419753087 + }, + "full_input": { + "tokens": 149, + "top_k": 6, + "decisions": 894, + "ordered_route_sha256": "5842f938f575581bc88273ac70e60af17128404c7c5738fd3823c8580d70c7bc", + "route_weight_sha256": "faf9ab20c5ef27b7f5be53439f10fba2d631b51474de83ca52698796b8cb975a", + "loads": [ + 45, + 15, + 14, + 10, + 18, + 9, + 47, + 17, + 17, + 23, + 2, + 11, + 9, + 17, + 15, + 17, + 11, + 14, + 43, + 16, + 2, + 12, + 22, + 12, + 16, + 3, + 2, + 15, + 5, + 3, + 16, + 14, + 7, + 12, + 11, + 25, + 10, + 15, + 8, + 13, + 12, + 3, + 9, + 7, + 1, + 1, + 36, + 10, + 10, + 18, + 11, + 10, + 30, + 24, + 5, + 13, + 15, + 20, + 9, + 15, + 6, + 13, + 3, + 20 + ], + "weighted_loads": [ + 3.777035515755415, + 0.7143293768167496, + 1.2470923345535994, + 0.4451698288321495, + 1.9174498114734888, + 0.3174244835972786, + 5.533256182447076, + 1.3595009092241526, + 1.2156682200729847, + 1.3403360452502966, + 0.055520497262477875, + 0.5727545619010925, + 0.3395066410303116, + 2.5543238930404186, + 1.5317669603973627, + 0.6325565688312054, + 0.5913532506674528, + 0.7520804554224014, + 3.2597639225423336, + 1.3702043294906616, + 0.19445902854204178, + 0.591355238109827, + 2.008442759513855, + 0.5547208730131388, + 0.5936150141060352, + 0.09826570190489292, + 0.06374078057706356, + 0.9634142816066742, + 0.37609600834548473, + 0.10449902154505253, + 0.9099149890244007, + 0.6135792285203934, + 0.2950697988271713, + 0.462836641818285, + 0.9625408314168453, + 2.0217795222997665, + 0.36037263832986355, + 0.5600671228021383, + 0.3224448263645172, + 0.446249445900321, + 0.43491654470562935, + 0.12306613475084305, + 0.3387128822505474, + 0.573032796382904, + 0.027406997978687286, + 0.035306818783283234, + 3.956591036170721, + 0.4690891467034817, + 0.363011309877038, + 0.7407606914639473, + 0.3575294800102711, + 0.5358695555478334, + 2.3014479372650385, + 1.4070141855627298, + 0.19543517753481865, + 0.5676074959337711, + 0.7274376079440117, + 1.1780659761279821, + 0.6596154421567917, + 0.8416210170835257, + 0.258565466850996, + 0.44480045326054096, + 0.1324586533010006, + 1.0651028919965029 + ], + "unique_experts": 64, + "load_cv": 0.6933787848665651, + "normalized_load_entropy": 0.9473171443937524, + "max_load_share": 0.052572706935123045 + } + }, + "s0_x": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "9a14ac759752d913d1cd70b0faa4dc014799609d048ab88a4db84f06a4afd681", + "route_weight_sha256": "a5b472cf51692a2724cb280206f9f033f87b3e99ec4a3d733fcc0839d7877984", + "loads": [ + 39, + 12, + 4, + 9, + 17, + 6, + 46, + 16, + 6, + 18, + 3, + 12, + 8, + 15, + 6, + 14, + 12, + 6, + 21, + 14, + 2, + 12, + 21, + 12, + 18, + 2, + 3, + 17, + 4, + 1, + 8, + 14, + 5, + 10, + 5, + 11, + 11, + 9, + 4, + 10, + 5, + 1, + 6, + 2, + 0, + 1, + 18, + 5, + 10, + 4, + 5, + 7, + 21, + 16, + 2, + 12, + 10, + 14, + 7, + 10, + 7, + 9, + 3, + 10 + ], + "weighted_loads": [ + 3.4966427627950907, + 0.559258483350277, + 0.22969673201441765, + 0.4113074578344822, + 1.6766198985278606, + 0.23409033194184303, + 5.252969112247229, + 1.3060119543224573, + 0.3373099323362112, + 1.1437482293695211, + 0.08924940228462219, + 0.41019115038216114, + 0.292986374348402, + 2.4570747315883636, + 0.38318749889731407, + 0.5261298380792141, + 0.6037509460002184, + 0.2032937165349722, + 1.4217847026884556, + 1.156978078186512, + 0.1900147870182991, + 0.6404516734182835, + 2.00796277821064, + 0.5421532206237316, + 0.6831349972635508, + 0.07491306215524673, + 0.10217265598475933, + 1.0573760196566582, + 0.33051228150725365, + 0.03638699650764465, + 0.3602883964776993, + 0.4056805148720741, + 0.2041841819882393, + 0.35970358178019524, + 0.47450165823102, + 0.777941582724452, + 0.388525502756238, + 0.302127743139863, + 0.1767143663018942, + 0.36049212887883186, + 0.1735102143138647, + 0.037230584770441055, + 0.2162406723946333, + 0.1191300731152296, + 0.0, + 0.03153789043426514, + 1.4311148785054684, + 0.2388315089046955, + 0.34752879850566387, + 0.12690178863704205, + 0.18440846726298332, + 0.36164461076259613, + 1.7659306898713112, + 0.8686498831957579, + 0.053396182134747505, + 0.5694665238261223, + 0.36667899787425995, + 0.9280750043690205, + 0.324853990226984, + 0.47594967298209667, + 0.2962568365037441, + 0.28821176290512085, + 0.14286531507968903, + 0.724498089402914 + ], + "unique_experts": 63, + "load_cv": 0.7913763215080171, + "normalized_load_entropy": 0.9350264137892305, + "max_load_share": 0.07098765432098765 + }, + "full_input": { + "tokens": 133, + "top_k": 6, + "decisions": 798, + "ordered_route_sha256": "d6d353c3f6e455a52467256a546f80879ce8b7ce0a748ded3171cabbbfc96547", + "route_weight_sha256": "93b43f9a7b6990fd5abd11c2f8503fe7ebe87bc02acff173b0c7965767980827", + "loads": [ + 46, + 13, + 17, + 9, + 17, + 8, + 46, + 16, + 14, + 18, + 3, + 16, + 9, + 15, + 11, + 18, + 12, + 6, + 41, + 14, + 2, + 13, + 21, + 12, + 18, + 2, + 3, + 17, + 4, + 1, + 14, + 14, + 5, + 11, + 5, + 16, + 11, + 11, + 4, + 12, + 11, + 1, + 9, + 2, + 0, + 1, + 26, + 5, + 13, + 16, + 7, + 10, + 31, + 24, + 2, + 12, + 11, + 14, + 10, + 11, + 7, + 14, + 3, + 13 + ], + "weighted_loads": [ + 3.9211853463202715, + 0.6316736191511154, + 1.4403033759444952, + 0.4113074578344822, + 1.6766198985278606, + 0.28262663818895817, + 5.252969112247229, + 1.3060119543224573, + 0.8294890094548464, + 1.1437482293695211, + 0.08924940228462219, + 0.7696737516671419, + 0.3397013135254383, + 2.4570747315883636, + 1.3037827257066965, + 0.6504637319594622, + 0.6037509460002184, + 0.2032937165349722, + 2.6033928487449884, + 1.156978078186512, + 0.1900147870182991, + 0.6659224983304739, + 2.00796277821064, + 0.5421532206237316, + 0.6831349972635508, + 0.07491306215524673, + 0.10217265598475933, + 1.0573760196566582, + 0.33051228150725365, + 0.03638699650764465, + 0.5917535573244095, + 0.4056805148720741, + 0.2041841819882393, + 0.40264979749917984, + 0.47450165823102, + 1.0110276341438293, + 0.388525502756238, + 0.36294966749846935, + 0.1767143663018942, + 0.4081778507679701, + 0.4247251432389021, + 0.037230584770441055, + 0.3028609175235033, + 0.1191300731152296, + 0.0, + 0.03153789043426514, + 2.999735500663519, + 0.2388315089046955, + 0.4982860554009676, + 0.6491143312305212, + 0.2421688362956047, + 0.5592240579426289, + 2.46693479642272, + 1.3918716590851545, + 0.053396182134747505, + 0.5694665238261223, + 0.5901497453451157, + 0.9280750043690205, + 0.45555237121880054, + 0.5128690581768751, + 0.2962568365037441, + 0.4368394035845995, + 0.14286531507968903, + 0.8986269906163216 + ], + "unique_experts": 63, + "load_cv": 0.7617687188924427, + "normalized_load_entropy": 0.9365394633684745, + "max_load_share": 0.05764411027568922 + } + }, + "s1_x": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "53534acbeb814e1b5b9ea571de9e07727dd9900b6e650cff053a9643e94f9fd6", + "route_weight_sha256": "4448779b14c71cc7332ad4f8a2c229efd97e7569f3ef1cc92d4a532e5f528bfb", + "loads": [ + 38, + 11, + 3, + 7, + 20, + 4, + 46, + 15, + 6, + 20, + 1, + 10, + 9, + 16, + 6, + 15, + 11, + 6, + 22, + 14, + 3, + 14, + 21, + 7, + 16, + 1, + 2, + 17, + 5, + 1, + 5, + 10, + 6, + 9, + 6, + 14, + 10, + 7, + 5, + 11, + 4, + 2, + 3, + 1, + 1, + 1, + 21, + 8, + 14, + 3, + 8, + 8, + 21, + 13, + 2, + 12, + 9, + 14, + 7, + 11, + 9, + 10, + 3, + 13 + ], + "weighted_loads": [ + 3.388600192964077, + 0.5189412459731102, + 0.19955356046557426, + 0.3202578295022249, + 1.8838177304714918, + 0.17773666232824326, + 5.4442350044846535, + 1.3081567324697971, + 0.3181540407240391, + 1.2385133597999811, + 0.033628277480602264, + 0.35094593092799187, + 0.35152097791433334, + 2.479331871494651, + 0.38494185358285904, + 0.550742119550705, + 0.6004630699753761, + 0.20253678038716316, + 1.4605206530541182, + 1.2120842263102531, + 0.21360298618674278, + 0.7514220271259546, + 1.9408053550869226, + 0.35091354697942734, + 0.6302232649177313, + 0.036001741886138916, + 0.06139798276126385, + 1.0460598766803741, + 0.368456594645977, + 0.04488420858979225, + 0.25748178735375404, + 0.28126284666359425, + 0.22680615074932575, + 0.32760854065418243, + 0.5060537606477737, + 0.8748315181583166, + 0.35135325230658054, + 0.24541426822543144, + 0.22547562792897224, + 0.4093196280300617, + 0.1280936263501644, + 0.08037906140089035, + 0.1176489032804966, + 0.07801935821771622, + 0.025654418393969536, + 0.03341778740286827, + 1.4404368232935667, + 0.3536191377788782, + 0.5313143189996481, + 0.09094776585698128, + 0.26867587491869926, + 0.39198218658566475, + 1.7242709770798683, + 0.6592273209244013, + 0.050682516768574715, + 0.5557682309299707, + 0.3294817376881838, + 0.9205224849283695, + 0.3525079321116209, + 0.5138573367148638, + 0.36472935415804386, + 0.3137354552745819, + 0.14318439364433289, + 0.7927828375250101 + ], + "unique_experts": 64, + "load_cv": 0.8062588576422566, + "normalized_load_entropy": 0.9317412780618523, + "max_load_share": 0.07098765432098765 + }, + "full_input": { + "tokens": 149, + "top_k": 6, + "decisions": 894, + "ordered_route_sha256": "639c688cd2ed5716339bcbc89a9769180deecf5e05d01033bc31aef21a1d126c", + "route_weight_sha256": "34504014d441ca079bd6fddac962a3fbf87ad3057ee9e10fe6bbd74b832cd0a2", + "loads": [ + 48, + 14, + 15, + 7, + 21, + 7, + 46, + 17, + 17, + 22, + 1, + 14, + 10, + 17, + 15, + 16, + 11, + 15, + 46, + 15, + 3, + 17, + 22, + 7, + 17, + 1, + 2, + 17, + 5, + 2, + 13, + 12, + 8, + 10, + 10, + 28, + 10, + 12, + 6, + 13, + 8, + 2, + 5, + 8, + 1, + 1, + 39, + 11, + 18, + 17, + 11, + 13, + 31, + 24, + 4, + 12, + 11, + 19, + 10, + 13, + 9, + 15, + 3, + 20 + ], + "weighted_loads": [ + 3.992786103859544, + 0.659524817019701, + 1.3461316507309675, + 0.3202578295022249, + 1.9225848224014044, + 0.26451913081109524, + 5.4442350044846535, + 1.3758917786180973, + 1.2207594141364098, + 1.3008316047489643, + 0.033628277480602264, + 0.6409052796661854, + 0.3901658356189728, + 2.52361767180264, + 1.3530341293662786, + 0.5832131244242191, + 0.6004630699753761, + 0.7758557535707951, + 3.394217513501644, + 1.347160317003727, + 0.21360298618674278, + 0.8392082937061787, + 1.9746711198240519, + 0.35091354697942734, + 0.6587491258978844, + 0.036001741886138916, + 0.06139798276126385, + 1.0460598766803741, + 0.368456594645977, + 0.08124052733182907, + 0.7086560688912868, + 0.5254528764635324, + 0.3136350028216839, + 0.40436404198408127, + 0.9280487671494484, + 2.1499691922217607, + 0.35135325230658054, + 0.46589694917201996, + 0.26476115733385086, + 0.45714652352035046, + 0.2700791619718075, + 0.08037906140089035, + 0.1717968676239252, + 0.6244386658072472, + 0.025654418393969536, + 0.03341778740286827, + 4.0924075450748205, + 0.5077620688825846, + 0.6640952080488205, + 0.6822181455790997, + 0.3507536668330431, + 0.6877130195498466, + 2.392782697454095, + 1.3231505770236254, + 0.16983078606426716, + 0.5557682309299707, + 0.5892937015742064, + 1.1518346965312958, + 0.7186354473233223, + 0.6960685532540083, + 0.36472935415804386, + 0.48418246023356915, + 0.14318439364433289, + 1.0900921653956175 + ], + "unique_experts": 64, + "load_cv": 0.7394302895345799, + "normalized_load_entropy": 0.9399857568813358, + "max_load_share": 0.053691275167785234 + } + }, + "s0_period": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "3e19612caadeddca716a93cc1da0c59c20d90f4bfb4304460ae210eb72c67ea4", + "route_weight_sha256": "a4d72c2a773e012263949cd29a712d829e805fc300d9c4713f3561ceda576bf5", + "loads": [ + 38, + 11, + 4, + 11, + 18, + 5, + 46, + 16, + 7, + 17, + 3, + 10, + 9, + 16, + 6, + 14, + 12, + 5, + 23, + 14, + 2, + 12, + 21, + 13, + 14, + 2, + 3, + 17, + 3, + 1, + 8, + 15, + 6, + 10, + 4, + 11, + 11, + 9, + 4, + 12, + 5, + 0, + 5, + 2, + 1, + 1, + 18, + 6, + 9, + 4, + 7, + 7, + 21, + 15, + 2, + 12, + 9, + 14, + 6, + 11, + 7, + 8, + 3, + 12 + ], + "weighted_loads": [ + 3.433761665597558, + 0.5307025909423828, + 0.22841981425881386, + 0.48285066708922386, + 1.7490302957594395, + 0.20275679975748062, + 5.313688522204757, + 1.3358585461974144, + 0.3734906129539013, + 1.1254250444471836, + 0.0868719257414341, + 0.34913033060729504, + 0.3211511503905058, + 2.518129341304302, + 0.38212084025144577, + 0.515682328492403, + 0.6058068070560694, + 0.17173657938838005, + 1.5271790251135826, + 1.1905326284468174, + 0.18739047646522522, + 0.6628437377512455, + 1.9910129606723785, + 0.5680411867797375, + 0.534366637468338, + 0.07329705357551575, + 0.09001697041094303, + 1.057892519980669, + 0.3068193607032299, + 0.03659399226307869, + 0.3723963852971792, + 0.45216653123497963, + 0.22811712697148323, + 0.36490566842257977, + 0.4584459476172924, + 0.7691642343997955, + 0.4110258426517248, + 0.2867913208901882, + 0.17585591599345207, + 0.4202939569950104, + 0.1744121965020895, + 0.0, + 0.18558865413069725, + 0.11611093394458294, + 0.027302581816911697, + 0.032329414039850235, + 1.4032282195985317, + 0.27644582465291023, + 0.322866452857852, + 0.12906982190907001, + 0.25095683336257935, + 0.3575604632496834, + 1.7570315152406693, + 0.8169745579361916, + 0.050424741581082344, + 0.5710176154971123, + 0.3399832956492901, + 0.9192866869270802, + 0.27977666817605495, + 0.5083840619772673, + 0.30381385050714016, + 0.2596456166356802, + 0.13997090980410576, + 0.7944192197173834 + ], + "unique_experts": 63, + "load_cv": 0.7892549238728203, + "normalized_load_entropy": 0.9348141981431778, + "max_load_share": 0.07098765432098765 + }, + "full_input": { + "tokens": 133, + "top_k": 6, + "decisions": 798, + "ordered_route_sha256": "27ead4caee204715cff5244e0247643e2f29ec81a44afde4e008f2477c8a5acf", + "route_weight_sha256": "5c7ab6d1b89e3a9077992c91988da0f28ef37994639d6d512e616d3405354d6c", + "loads": [ + 45, + 12, + 15, + 11, + 18, + 8, + 46, + 16, + 15, + 17, + 3, + 14, + 9, + 16, + 11, + 18, + 12, + 5, + 43, + 14, + 2, + 13, + 21, + 13, + 16, + 2, + 3, + 17, + 3, + 1, + 15, + 15, + 6, + 11, + 4, + 14, + 11, + 11, + 4, + 14, + 11, + 0, + 8, + 2, + 1, + 1, + 27, + 6, + 11, + 16, + 10, + 9, + 31, + 24, + 2, + 12, + 10, + 15, + 8, + 12, + 7, + 14, + 3, + 14 + ], + "weighted_loads": [ + 3.8663402032107115, + 0.6031177267432213, + 1.2418501731008291, + 0.48285066708922386, + 1.7490302957594395, + 0.28258861415088177, + 5.313688522204757, + 1.3358585461974144, + 0.8656696900725365, + 1.1254250444471836, + 0.0868719257414341, + 0.700445031747222, + 0.3211511503905058, + 2.518129341304302, + 1.3819580432027578, + 0.6524179615080357, + 0.6058068070560694, + 0.17173657938838005, + 2.7174411341547966, + 1.1905326284468174, + 0.18739047646522522, + 0.6883145626634359, + 1.9910129606723785, + 0.5680411867797375, + 0.5991775710135698, + 0.07329705357551575, + 0.09001697041094303, + 1.057892519980669, + 0.3068193607032299, + 0.03659399226307869, + 0.6385869011282921, + 0.45216653123497963, + 0.22811712697148323, + 0.40513201989233494, + 0.4584459476172924, + 0.9361552633345127, + 0.4110258426517248, + 0.34761324524879456, + 0.17585591599345207, + 0.4679796788841486, + 0.4414534196257591, + 0.0, + 0.27220889925956726, + 0.11611093394458294, + 0.027302581816911697, + 0.032329414039850235, + 3.1337707825005054, + 0.27644582465291023, + 0.4326134342700243, + 0.6421624161303043, + 0.3452601432800293, + 0.5172977074980736, + 2.43292423710227, + 1.4243243709206581, + 0.050424741581082344, + 0.5710176154971123, + 0.5634540431201458, + 0.9710142128169537, + 0.34892407432198524, + 0.5453034471720457, + 0.30381385050714016, + 0.4496692158281803, + 0.13997090980410576, + 0.8886561412364244 + ], + "unique_experts": 63, + "load_cv": 0.7665035658980615, + "normalized_load_entropy": 0.9358270827641166, + "max_load_share": 0.05764411027568922 + } + }, + "s1_period": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "b42090da16e6cecd6502bdef9ea279a89392220fded5d87336caa478dd819ff0", + "route_weight_sha256": "41a90e5e5200506d7ff09c0a6074cd83f91066821ca7e460d814225dec10a4f6", + "loads": [ + 37, + 11, + 3, + 9, + 24, + 6, + 46, + 16, + 8, + 20, + 1, + 7, + 7, + 16, + 7, + 14, + 11, + 8, + 23, + 14, + 2, + 15, + 21, + 6, + 16, + 1, + 3, + 16, + 5, + 1, + 5, + 8, + 4, + 7, + 7, + 16, + 10, + 6, + 7, + 10, + 3, + 2, + 3, + 1, + 1, + 1, + 20, + 7, + 13, + 4, + 7, + 7, + 22, + 13, + 2, + 12, + 11, + 14, + 6, + 11, + 10, + 9, + 3, + 12 + ], + "weighted_loads": [ + 3.3887358605861664, + 0.5013347174972296, + 0.19043751060962677, + 0.37244883365929127, + 1.9279045388102531, + 0.23661431670188904, + 5.620736686512828, + 1.3482704441994429, + 0.385944114997983, + 1.2260726876556873, + 0.03175334632396698, + 0.2519924473017454, + 0.2642570659518242, + 2.5040955059230328, + 0.4057827927172184, + 0.5273637287318707, + 0.5951038785278797, + 0.2809526864439249, + 1.5864270813763142, + 1.236980825662613, + 0.18694313615560532, + 0.8387860357761383, + 1.9669735301285982, + 0.3333758972585201, + 0.6123799793422222, + 0.036091722548007965, + 0.10277617536485195, + 0.9946282729506493, + 0.36597952619194984, + 0.042371731251478195, + 0.24796050786972046, + 0.23835502192378044, + 0.16500270180404186, + 0.25816105119884014, + 0.5409109182655811, + 0.9749186597764492, + 0.35784734040498734, + 0.21845603361725807, + 0.2727495804429054, + 0.3694315478205681, + 0.09582310169935226, + 0.07582204416394234, + 0.11756772920489311, + 0.07834398001432419, + 0.026676924899220467, + 0.03306613862514496, + 1.4099748097360134, + 0.3056709636002779, + 0.510911513119936, + 0.11901493556797504, + 0.2284739874303341, + 0.34795184805989265, + 1.7425776161253452, + 0.677264615893364, + 0.044932564720511436, + 0.565863486379385, + 0.38643473014235497, + 0.9377676211297512, + 0.33524085208773613, + 0.5277888439595699, + 0.38140882551670074, + 0.288152614608407, + 0.13946672901511192, + 0.8069569431245327 + ], + "unique_experts": 64, + "load_cv": 0.8134106869150189, + "normalized_load_entropy": 0.930682717608817, + "max_load_share": 0.07098765432098765 + }, + "full_input": { + "tokens": 149, + "top_k": 6, + "decisions": 894, + "ordered_route_sha256": "89e6f3acfdd7b8956478fbda05d5454fb1d6bb6b8d723f99c0f62e4190c5fadd", + "route_weight_sha256": "1e7cdbb6d9d5a188735eab21dda3f7d766608bf7f14a618cf01674d7098a857f", + "loads": [ + 45, + 14, + 14, + 9, + 25, + 9, + 46, + 18, + 18, + 23, + 1, + 11, + 8, + 17, + 16, + 17, + 11, + 17, + 46, + 15, + 2, + 18, + 22, + 6, + 16, + 1, + 3, + 16, + 5, + 2, + 13, + 11, + 5, + 8, + 11, + 30, + 10, + 11, + 8, + 12, + 8, + 2, + 5, + 7, + 1, + 1, + 39, + 10, + 16, + 18, + 10, + 13, + 32, + 25, + 4, + 12, + 13, + 20, + 9, + 13, + 10, + 14, + 3, + 19 + ], + "weighted_loads": [ + 3.807104231789708, + 0.6419182885438204, + 1.214840056374669, + 0.37244883365929127, + 1.9666716307401657, + 0.323396785184741, + 5.620736686512828, + 1.416005490347743, + 1.2467745635658503, + 1.3405796643346548, + 0.03175334632396698, + 0.6008816044777632, + 0.2970828413963318, + 2.548381306231022, + 1.515295872464776, + 0.6161781996488571, + 0.5951038785278797, + 0.8542716596275568, + 3.4433167669922113, + 1.3720569163560867, + 0.18694313615560532, + 0.931348355486989, + 2.0008392948657274, + 0.3333758972585201, + 0.6123799793422222, + 0.036091722548007965, + 0.10277617536485195, + 0.9946282729506493, + 0.36597952619194984, + 0.07872804999351501, + 0.695280946791172, + 0.5102444980293512, + 0.22063451074063778, + 0.334916552528739, + 0.9629059247672558, + 2.231742825359106, + 0.35784734040498734, + 0.4389387145638466, + 0.31203510984778404, + 0.4172584433108568, + 0.28275829553604126, + 0.07582204416394234, + 0.17171569354832172, + 0.5695682764053345, + 0.026676924899220467, + 0.03306613862514496, + 4.151999089866877, + 0.45981389470398426, + 0.6087204199284315, + 0.7202395889908075, + 0.30981904082000256, + 0.6932673715054989, + 2.3982145320624113, + 1.3931702077388763, + 0.16408083401620388, + 0.565863486379385, + 0.6462466940283775, + 1.2394974380731583, + 0.7013683672994375, + 0.7100000604987144, + 0.38140882551670074, + 0.4682967886328697, + 0.13946672901511192, + 1.0726519636809826 + ], + "unique_experts": 64, + "load_cv": 0.7441800069257344, + "normalized_load_entropy": 0.9386390743337095, + "max_load_share": 0.05145413870246085 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 108, + "ordered_topk_exact_tokens": 43, + "set_exact_tokens": 67, + "mean_set_jaccard": 0.8785273368606702, + "mean_token_weighted_tv": 0.02305137250503456, + "aggregate_load_tv": 0.041666666666666664 + }, + "system_bos": { + "tokens": 108, + "ordered_topk_exact_tokens": 46, + "set_exact_tokens": 59, + "mean_set_jaccard": 0.8624338624338626, + "mean_token_weighted_tv": 0.026061848021560797, + "aggregate_load_tv": 0.044753086419753084 + }, + "system_x": { + "tokens": 108, + "ordered_topk_exact_tokens": 29, + "set_exact_tokens": 48, + "mean_set_jaccard": 0.820326278659612, + "mean_token_weighted_tv": 0.03608355224477472, + "aggregate_load_tv": 0.06635802469135801 + }, + "system_period": { + "tokens": 108, + "ordered_topk_exact_tokens": 33, + "set_exact_tokens": 51, + "mean_set_jaccard": 0.8242945326278659, + "mean_token_weighted_tv": 0.03503365824171514, + "aggregate_load_tv": 0.07561728395061729 + }, + "bos_at_s0": { + "tokens": 108, + "ordered_topk_exact_tokens": 38, + "set_exact_tokens": 49, + "mean_set_jaccard": 0.8300264550264551, + "mean_token_weighted_tv": 0.030312606495701604, + "aggregate_load_tv": 0.05092592592592592 + }, + "bos_at_s1": { + "tokens": 108, + "ordered_topk_exact_tokens": 41, + "set_exact_tokens": 57, + "mean_set_jaccard": 0.8448853615520283, + "mean_token_weighted_tv": 0.030091814877879288, + "aggregate_load_tv": 0.040123456790123455 + }, + "x_at_s0": { + "tokens": 108, + "ordered_topk_exact_tokens": 38, + "set_exact_tokens": 54, + "mean_set_jaccard": 0.8302469135802469, + "mean_token_weighted_tv": 0.03212227698208557, + "aggregate_load_tv": 0.05709876543209876 + }, + "x_at_s1": { + "tokens": 108, + "ordered_topk_exact_tokens": 35, + "set_exact_tokens": 55, + "mean_set_jaccard": 0.8258377425044093, + "mean_token_weighted_tv": 0.036434513258023396, + "aggregate_load_tv": 0.0617283950617284 + }, + "period_at_s0": { + "tokens": 108, + "ordered_topk_exact_tokens": 37, + "set_exact_tokens": 51, + "mean_set_jaccard": 0.8333333333333334, + "mean_token_weighted_tv": 0.03129059785149164, + "aggregate_load_tv": 0.05555555555555556 + }, + "period_at_s1": { + "tokens": 108, + "ordered_topk_exact_tokens": 39, + "set_exact_tokens": 54, + "mean_set_jaccard": 0.8176807760141094, + "mean_token_weighted_tv": 0.039201130202316026, + "aggregate_load_tv": 0.07253086419753085 + } + } + }, + "layer_19": { + "layer": 19, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "5d0a8dab89f2bfcfcc6f0fc0a4fd9a189ce09e2ffcc68e27ae5a1d026cddba9d", + "route_weight_sha256": "54c951ccad1aa1ac910f5540b02005fcdaf5e94f8b22bc21cf8b1b20a42839ee", + "loads": [ + 14, + 7, + 11, + 20, + 9, + 9, + 6, + 10, + 6, + 16, + 3, + 8, + 8, + 9, + 12, + 12, + 2, + 6, + 7, + 12, + 10, + 8, + 4, + 10, + 6, + 4, + 5, + 4, + 6, + 3, + 5, + 21, + 41, + 5, + 31, + 7, + 5, + 18, + 7, + 7, + 17, + 2, + 5, + 4, + 8, + 9, + 7, + 12, + 4, + 4, + 15, + 10, + 6, + 23, + 29, + 9, + 3, + 11, + 7, + 11, + 19, + 8, + 28, + 3 + ], + "weighted_loads": [ + 0.5207487437874079, + 0.29614122584462166, + 0.4173322953283787, + 3.5255628507584333, + 0.3991041127592325, + 0.8239384572952986, + 0.2433958612382412, + 0.5851381868124008, + 0.35901481844484806, + 0.7766122613102198, + 0.06836879346519709, + 0.32274660281836987, + 0.5869641061872244, + 0.31277964264154434, + 0.5815724283456802, + 0.49565065279603004, + 0.05049518868327141, + 1.5537939388304949, + 0.26617928594350815, + 1.0291706435382366, + 0.7486969977617264, + 0.47249218448996544, + 0.10994992032647133, + 0.3060548333451152, + 0.4726513437926769, + 0.26543888449668884, + 0.7499989084899426, + 0.15472079813480377, + 0.24473533406853676, + 0.0859540943056345, + 0.17656928673386574, + 1.9234790783375502, + 2.9137533120810986, + 0.23191596381366253, + 3.437146982178092, + 0.27541325241327286, + 0.2554595321416855, + 0.6425839625298977, + 0.49350970052182674, + 0.3045476209372282, + 0.654275618493557, + 0.09226515889167786, + 0.15833024308085442, + 0.15045971982181072, + 0.520981595851481, + 0.28986306861042976, + 0.2914696987718344, + 0.6456465236842632, + 0.12365353293716908, + 0.3767825737595558, + 0.6611082479357719, + 0.3421823438256979, + 0.3800285588949919, + 1.7371760364621878, + 2.512615829706192, + 0.35588081181049347, + 0.12210714444518089, + 0.6179337613284588, + 0.3032551985234022, + 0.5082382634282112, + 0.868164075538516, + 0.5313794799149036, + 1.4693873841315508, + 0.09292691946029663 + ], + "unique_experts": 64, + "load_cv": 0.7422823464472796, + "normalized_load_entropy": 0.9460298584858361, + "max_load_share": 0.06327160493827161 + }, + "full_input": { + "tokens": 133, + "top_k": 6, + "decisions": 798, + "ordered_route_sha256": "1fd9f06475e96560590fc38b0d5198cdcb79daa1101e9d42d5f3037a6f07e09d", + "route_weight_sha256": "7fd7a69a70c20c05728c50180c360bf3f79ba17d48f276b725d16a88a53d38b6", + "loads": [ + 17, + 8, + 14, + 20, + 14, + 11, + 18, + 10, + 6, + 20, + 3, + 8, + 15, + 12, + 15, + 12, + 4, + 6, + 7, + 19, + 10, + 8, + 9, + 19, + 15, + 4, + 5, + 7, + 6, + 8, + 10, + 21, + 42, + 5, + 31, + 8, + 7, + 24, + 8, + 7, + 21, + 6, + 13, + 6, + 9, + 9, + 8, + 15, + 5, + 4, + 15, + 10, + 6, + 25, + 36, + 9, + 4, + 11, + 12, + 11, + 21, + 11, + 35, + 3 + ], + "weighted_loads": [ + 0.5961141143925488, + 0.3823746256530285, + 0.5138021782040596, + 3.5255628507584333, + 1.176523456349969, + 0.8664638949558139, + 0.721805720590055, + 0.5851381868124008, + 0.35901481844484806, + 1.0139516945928335, + 0.06836879346519709, + 0.32274660281836987, + 1.0739341583102942, + 0.4447484202682972, + 0.8006800971925259, + 0.49565065279603004, + 0.13092903047800064, + 1.5537939388304949, + 0.26617928594350815, + 1.3495141565799713, + 0.7486969977617264, + 0.47249218448996544, + 0.2898581176996231, + 0.6234291614964604, + 0.9788458519615233, + 0.26543888449668884, + 0.7499989084899426, + 0.2671566102653742, + 0.24473533406853676, + 0.2980191130191088, + 0.36383589543402195, + 1.9234790783375502, + 2.942200815305114, + 0.23191596381366253, + 3.437146982178092, + 0.3341222405433655, + 0.29881914565339684, + 0.9480622224509716, + 0.5348946247249842, + 0.3045476209372282, + 0.7557884659618139, + 0.42433740943670273, + 0.7489779479801655, + 0.238793121650815, + 0.531678581610322, + 0.28986306861042976, + 0.32493396289646626, + 0.8860572278499603, + 0.1593563500791788, + 0.3767825737595558, + 0.6611082479357719, + 0.3421823438256979, + 0.3800285588949919, + 1.950379891321063, + 4.285288132727146, + 0.35588081181049347, + 0.15302137471735477, + 0.6179337613284588, + 0.5298660956323147, + 0.5082382634282112, + 0.9394131470471621, + 0.713847178965807, + 2.0165210850536823, + 0.09292691946029663 + ], + "unique_experts": 64, + "load_cv": 0.6572296435258521, + "normalized_load_entropy": 0.9552048136722452, + "max_load_share": 0.05263157894736842 + } + }, + "s1_eos": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "f51adbe0ff1153c42f484d2698d2e781afb582b5290ec1cb2d3423ada0ac8c89", + "route_weight_sha256": "f92abbb524455f3e756903aff1c7a01b45c61d9bfb159bfde8c48ac45e20b2bd", + "loads": [ + 14, + 7, + 11, + 19, + 9, + 8, + 4, + 10, + 6, + 14, + 4, + 9, + 10, + 9, + 11, + 11, + 2, + 4, + 7, + 12, + 10, + 8, + 3, + 7, + 5, + 4, + 5, + 6, + 6, + 5, + 6, + 21, + 42, + 5, + 31, + 6, + 5, + 17, + 7, + 5, + 15, + 2, + 7, + 5, + 8, + 8, + 8, + 12, + 6, + 4, + 15, + 13, + 7, + 22, + 29, + 10, + 5, + 11, + 7, + 11, + 21, + 8, + 27, + 2 + ], + "weighted_loads": [ + 0.5318185593932867, + 0.2855453286319971, + 0.43038418143987656, + 3.43246703222394, + 0.40330400317907333, + 0.8026617765426636, + 0.18186618387699127, + 0.6034417971968651, + 0.372839979827404, + 0.6957312989979982, + 0.08458691742271185, + 0.38113005086779594, + 0.6935571320354939, + 0.31597808189690113, + 0.5478141661733389, + 0.45942830108106136, + 0.05141913890838623, + 1.4789606407284737, + 0.2564427237957716, + 1.0474177189171314, + 0.7502397019416094, + 0.4867611788213253, + 0.08389152027666569, + 0.2541473899036646, + 0.40795248188078403, + 0.2592116389423609, + 0.8847069293260574, + 0.2258080244064331, + 0.24877050146460533, + 0.14026707783341408, + 0.18759912438690662, + 1.9256871994584799, + 2.943716451525688, + 0.23470362275838852, + 3.4513431638479233, + 0.22530229575932026, + 0.25492756627500057, + 0.6080671027302742, + 0.5323182139545679, + 0.2665389534085989, + 0.6040494758635759, + 0.1369098164141178, + 0.2329564243555069, + 0.1710454197600484, + 0.504888379946351, + 0.2411528266966343, + 0.33458878099918365, + 0.6385432966053486, + 0.17792309075593948, + 0.3912203721702099, + 0.6667589843273163, + 0.461584011092782, + 0.4244622588157654, + 1.6857912503182888, + 2.4984683468937874, + 0.3717875247821212, + 0.18191950768232346, + 0.6352576911449432, + 0.30158013105392456, + 0.5180399492383003, + 0.9064192175865173, + 0.5159624088555574, + 1.4192137829959393, + 0.05553458444774151 + ], + "unique_experts": 64, + "load_cv": 0.7346457060153995, + "normalized_load_entropy": 0.9478336657014068, + "max_load_share": 0.06481481481481481 + }, + "full_input": { + "tokens": 149, + "top_k": 6, + "decisions": 894, + "ordered_route_sha256": "c017abc853fa601861de299e4525cb011fb3a46583aae167e514af6b7162d55e", + "route_weight_sha256": "cdfee0adc58f85854ec81ee74cba077eef82540fc090c06418783951c3eac4fd", + "loads": [ + 17, + 11, + 14, + 19, + 21, + 10, + 21, + 10, + 6, + 19, + 5, + 15, + 21, + 10, + 20, + 13, + 5, + 9, + 8, + 22, + 13, + 9, + 9, + 14, + 17, + 4, + 5, + 9, + 7, + 7, + 9, + 21, + 45, + 5, + 31, + 6, + 8, + 22, + 8, + 7, + 21, + 12, + 17, + 6, + 9, + 8, + 8, + 22, + 7, + 5, + 20, + 13, + 10, + 32, + 34, + 11, + 7, + 13, + 16, + 12, + 24, + 15, + 36, + 4 + ], + "weighted_loads": [ + 0.5926502454094589, + 0.5444885212928057, + 0.5213121380656958, + 3.43246703222394, + 1.8532218784093857, + 0.8932418571785092, + 0.945120326243341, + 0.6034417971968651, + 0.372839979827404, + 0.958435395732522, + 0.15143495704978704, + 1.0698773190379143, + 1.3202771432697773, + 0.36177938990294933, + 1.1552819684147835, + 0.568958668038249, + 0.4432852752506733, + 1.7052952907979488, + 0.3578046169131994, + 1.5296922735869884, + 1.051795208826661, + 0.5413020327687263, + 0.3184840511530638, + 0.4817909114062786, + 1.1756496191956103, + 0.2592116389423609, + 0.8847069293260574, + 0.3552012927830219, + 0.28802280500531197, + 0.23326124995946884, + 0.28473789617419243, + 1.9256871994584799, + 3.0574781503528357, + 0.23470362275838852, + 3.4513431638479233, + 0.22530229575932026, + 0.3397070332430303, + 0.826225508004427, + 0.5757809337228537, + 0.37006745859980583, + 0.7802244196645916, + 0.7382642142474651, + 0.9821226615458727, + 0.2092093462124467, + 0.5155853657051921, + 0.2411528266966343, + 0.33458878099918365, + 1.2864592373371124, + 0.2121916189789772, + 0.4369603395462036, + 1.0035141594707966, + 0.461584011092782, + 0.5677154287695885, + 2.5351451635360718, + 4.211604006588459, + 0.40185189340263605, + 0.26306401938199997, + 0.7234181202948093, + 0.7704805228859186, + 0.5525386966764927, + 1.0183679349720478, + 0.8391841445118189, + 2.1145109459757805, + 0.21985201723873615 + ], + "unique_experts": 64, + "load_cv": 0.6079703896860207, + "normalized_load_entropy": 0.9603848975932647, + "max_load_share": 0.050335570469798654 + } + }, + "s0_bos": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "e9c1f04d8b97fb71370a3f4861b4cea327f8e0693eed805ebaea8ed76b461f75", + "route_weight_sha256": "43c3d84d3ed5fcb7d99964cdbdc72bd71a9c98a2d99249850d9f2639b40591a0", + "loads": [ + 12, + 9, + 11, + 19, + 9, + 9, + 5, + 10, + 5, + 15, + 5, + 6, + 9, + 8, + 11, + 12, + 1, + 5, + 8, + 11, + 10, + 8, + 5, + 8, + 5, + 4, + 6, + 5, + 6, + 3, + 7, + 21, + 41, + 5, + 31, + 5, + 5, + 22, + 7, + 4, + 17, + 1, + 8, + 5, + 9, + 8, + 6, + 12, + 5, + 4, + 15, + 13, + 5, + 22, + 29, + 12, + 4, + 11, + 6, + 9, + 20, + 8, + 30, + 1 + ], + "weighted_loads": [ + 0.43008267506957054, + 0.35971057787537575, + 0.4130737856030464, + 3.5132459066808224, + 0.4020312502980232, + 0.8642148151993752, + 0.21425415202975273, + 0.5867495164275169, + 0.34803228825330734, + 0.7419254835695028, + 0.12380841001868248, + 0.2682126760482788, + 0.6134537197649479, + 0.2661603596061468, + 0.5768105573952198, + 0.4796640258282423, + 0.02123146690428257, + 1.4686475321650505, + 0.30914654955267906, + 0.988016415387392, + 0.7599989511072636, + 0.4835996627807617, + 0.16275452263653278, + 0.28185088373720646, + 0.43600707314908504, + 0.26161593571305275, + 0.7085879985243082, + 0.17126419208943844, + 0.2288052663207054, + 0.08717544749379158, + 0.22895469516515732, + 1.9134677816182375, + 2.9316444508731365, + 0.23456397466361523, + 3.430660344660282, + 0.22611899115145206, + 0.25428253039717674, + 0.8710175938904285, + 0.4889831766486168, + 0.22128360625356436, + 0.6400184240192175, + 0.05588158220052719, + 0.2534648720175028, + 0.246114831417799, + 0.5619750050827861, + 0.23233428318053484, + 0.2619233690202236, + 0.6670408956706524, + 0.14240497536957264, + 0.3701023906469345, + 0.6723627354949713, + 0.45298153907060623, + 0.3500829264521599, + 1.733675880357623, + 2.514606887474656, + 0.4559579901397228, + 0.1483117900788784, + 0.6421692743897438, + 0.28467918187379837, + 0.44938934966921806, + 0.8757971618324518, + 0.5151886735111475, + 1.583290172740817, + 0.03513096645474434 + ], + "unique_experts": 64, + "load_cv": 0.7583302557005538, + "normalized_load_entropy": 0.942914869404182, + "max_load_share": 0.06327160493827161 + }, + "full_input": { + "tokens": 133, + "top_k": 6, + "decisions": 798, + "ordered_route_sha256": "fee7d0c807fd00444d902d1171cc78c710ab32588c8d7ac22d56cb6e1b473fe9", + "route_weight_sha256": "0f2ca75d640b0fff1e8e4ea73346577fccf7171eed04afcfa863c28bcb46dd86", + "loads": [ + 14, + 10, + 12, + 19, + 13, + 11, + 16, + 10, + 5, + 18, + 6, + 6, + 17, + 13, + 14, + 12, + 3, + 6, + 8, + 18, + 10, + 8, + 10, + 14, + 14, + 4, + 7, + 8, + 6, + 8, + 14, + 21, + 41, + 5, + 31, + 7, + 5, + 28, + 8, + 4, + 20, + 5, + 16, + 7, + 10, + 9, + 7, + 15, + 8, + 4, + 15, + 14, + 5, + 25, + 35, + 12, + 5, + 11, + 11, + 9, + 22, + 11, + 37, + 1 + ], + "weighted_loads": [ + 0.501996673643589, + 0.4459439776837826, + 0.4375382326543331, + 3.5132459066808224, + 1.0816899463534355, + 0.9067402528598905, + 0.6530191218480468, + 0.5867495164275169, + 0.34803228825330734, + 0.9296652991324663, + 0.16565418988466263, + 0.2682126760482788, + 1.1318564750254154, + 0.4816784504801035, + 0.7968789637088776, + 0.4796640258282423, + 0.1016653086990118, + 2.2100182697176933, + 0.30914654955267906, + 1.489782065153122, + 0.7599989511072636, + 0.4835996627807617, + 0.34266272000968456, + 0.5133001878857613, + 0.9894435908645391, + 0.26161593571305275, + 0.7415966559201479, + 0.3179964069277048, + 0.2288052663207054, + 0.2909819483757019, + 0.4798337910324335, + 1.9134677816182375, + 2.9316444508731365, + 0.23456397466361523, + 3.430660344660282, + 0.3043022137135267, + 0.25428253039717674, + 1.163633093237877, + 0.5303681008517742, + 0.22128360625356436, + 0.7382378177717328, + 0.3637634925544262, + 0.8441125769168139, + 0.3344482332468033, + 0.5726719908416271, + 0.2572868065908551, + 0.2988917715847492, + 0.905477374792099, + 0.2583420295268297, + 0.3701023906469345, + 0.6723627354949713, + 0.4683473343029618, + 0.3500829264521599, + 1.9443172235041857, + 3.3437425512820482, + 0.4559579901397228, + 0.1795828491449356, + 0.6421692743897438, + 0.5112900789827108, + 0.44938934966921806, + 0.9522558059543371, + 0.6976563725620508, + 2.1304238736629486, + 0.03513096645474434 + ], + "unique_experts": 64, + "load_cv": 0.6576882358813605, + "normalized_load_entropy": 0.9546526265503849, + "max_load_share": 0.05137844611528822 + } + }, + "s1_bos": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "d80ea4b19c22e06faa89b0c2347c122c012e5d3bfde73803afe4e1cdfe9c4ae6", + "route_weight_sha256": "6bddd97d72a06ce7d8ba4345a891b3ad58cb090dc9b7fc483953d04867653640", + "loads": [ + 12, + 7, + 12, + 19, + 7, + 8, + 5, + 10, + 6, + 13, + 4, + 6, + 8, + 9, + 13, + 10, + 1, + 5, + 9, + 10, + 10, + 8, + 6, + 12, + 6, + 4, + 6, + 4, + 6, + 4, + 7, + 21, + 42, + 5, + 31, + 4, + 5, + 21, + 7, + 4, + 18, + 2, + 6, + 6, + 5, + 8, + 9, + 12, + 5, + 4, + 14, + 13, + 5, + 24, + 29, + 13, + 5, + 11, + 7, + 9, + 17, + 8, + 28, + 3 + ], + "weighted_loads": [ + 0.45050003565847874, + 0.2748648729175329, + 0.4485147427767515, + 3.502620154991746, + 0.33246517181396484, + 0.7999510690569878, + 0.21129954978823662, + 0.5869319029152393, + 0.3772732764482498, + 0.6610110215842724, + 0.09960458613932133, + 0.26823800429701805, + 0.635123573243618, + 0.294420113787055, + 0.641504431143403, + 0.41853196173906326, + 0.021716918796300888, + 1.2621294278651476, + 0.3228745684027672, + 0.9507326260209084, + 0.7244831677526236, + 0.47757816687226295, + 0.18218082003295422, + 0.3755475217476487, + 0.4635404050350189, + 0.2597615625709295, + 0.9494764972478151, + 0.1389361396431923, + 0.23294195905327797, + 0.12386494316160679, + 0.23111812211573124, + 1.9572450369596481, + 2.991857247427106, + 0.22880119271576405, + 3.428248379379511, + 0.17662031017243862, + 0.2814742401242256, + 0.8660532906651497, + 0.5023582279682159, + 0.23920158948749304, + 0.677899980917573, + 0.084014892578125, + 0.2227736208587885, + 0.259046608582139, + 0.40959202125668526, + 0.24929854273796082, + 0.35071885120123625, + 0.6639260798692703, + 0.16363711655139923, + 0.3613326456397772, + 0.6221967693418264, + 0.4581112554296851, + 0.3612555116415024, + 1.7954980786889791, + 2.557668909430504, + 0.45528377033770084, + 0.1752761323004961, + 0.6341600641608238, + 0.31212796829640865, + 0.4587940890341997, + 0.7779368776828051, + 0.5335726961493492, + 1.529034050181508, + 0.09631804190576077 + ], + "unique_experts": 64, + "load_cv": 0.7502476347772097, + "normalized_load_entropy": 0.9454952637381907, + "max_load_share": 0.06481481481481481 + }, + "full_input": { + "tokens": 149, + "top_k": 6, + "decisions": 894, + "ordered_route_sha256": "a4d88d5ecf2ca1273c64cfa8c0310bf4c798c068118f7f4f9b7e952c1569e537", + "route_weight_sha256": "56c827b5beaa7d96024d8d92c649871094552edcb18bf955d022fd1da498cad2", + "loads": [ + 14, + 11, + 14, + 19, + 19, + 10, + 18, + 10, + 6, + 20, + 5, + 12, + 19, + 12, + 22, + 12, + 4, + 10, + 10, + 21, + 13, + 9, + 12, + 17, + 18, + 4, + 6, + 6, + 7, + 6, + 13, + 21, + 45, + 5, + 31, + 5, + 8, + 25, + 8, + 8, + 23, + 11, + 16, + 8, + 6, + 8, + 10, + 22, + 6, + 5, + 19, + 13, + 8, + 33, + 33, + 13, + 9, + 13, + 17, + 10, + 19, + 15, + 37, + 5 + ], + "weighted_loads": [ + 0.5040224306285381, + 0.5338080655783415, + 0.507547814399004, + 3.502620154991746, + 1.8945825472474098, + 0.8905311496928334, + 0.848537209443748, + 0.5869319029152393, + 0.3772732764482498, + 0.9984320849180222, + 0.16645262576639652, + 0.9569852724671364, + 1.2618435844779015, + 0.41736997105181217, + 1.2498136647045612, + 0.5280623286962509, + 0.41358305513858795, + 1.4884640779346228, + 0.424236461520195, + 1.6816902942955494, + 1.0260386746376753, + 0.532119020819664, + 0.4167733509093523, + 0.5535577433183789, + 1.3262270148843527, + 0.2597615625709295, + 0.9494764972478151, + 0.25091249868273735, + 0.2721942625939846, + 0.21640165708959103, + 0.4437841400504112, + 1.9572450369596481, + 3.1077458448708057, + 0.22880119271576405, + 3.428248379379511, + 0.242123706266284, + 0.3975980170071125, + 1.0616365540772676, + 0.5458209477365017, + 0.41352597903460264, + 0.8410538742318749, + 0.63637750223279, + 0.9719398580491543, + 0.3318666387349367, + 0.4202890070155263, + 0.24929854273796082, + 0.38276787009090185, + 1.2947590611875057, + 0.19790564477443695, + 0.4070726130157709, + 0.9589519444853067, + 0.4581112554296851, + 0.5045086815953255, + 2.5424312222748995, + 3.329372689127922, + 0.45528377033770084, + 0.31477977335453033, + 0.7223204933106899, + 0.8228497803211212, + 0.4932928364723921, + 0.8505550939589739, + 0.8567944318056107, + 2.2243312131613493, + 0.2606354746967554 + ], + "unique_experts": 64, + "load_cv": 0.6058593463816135, + "normalized_load_entropy": 0.9607625391290228, + "max_load_share": 0.050335570469798654 + } + }, + "s0_x": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "51e59d135031eeb19aee5cdc591196d8c70e404366a3139b2178e6c5cafc8724", + "route_weight_sha256": "ed4e58fa7b49a2ad3841a7375ffb3a17b3a79b5e4d24518b04c76a798e241d00", + "loads": [ + 13, + 6, + 12, + 21, + 10, + 9, + 4, + 10, + 6, + 12, + 5, + 9, + 8, + 10, + 14, + 12, + 1, + 6, + 10, + 12, + 11, + 8, + 3, + 10, + 6, + 4, + 5, + 3, + 6, + 4, + 4, + 21, + 42, + 5, + 30, + 6, + 4, + 17, + 7, + 6, + 15, + 0, + 7, + 7, + 8, + 7, + 8, + 13, + 4, + 4, + 17, + 11, + 5, + 24, + 29, + 11, + 5, + 10, + 7, + 8, + 17, + 8, + 28, + 3 + ], + "weighted_loads": [ + 0.4847383052110672, + 0.27819414250552654, + 0.4331855997443199, + 3.5294393599033356, + 0.4541479963809252, + 0.8913075290620327, + 0.1854799948632717, + 0.5761166252195835, + 0.3797563649713993, + 0.6107357684522867, + 0.11743965838104486, + 0.36969204992055893, + 0.6112011838704348, + 0.33844023384153843, + 0.6576113179326057, + 0.4881292786449194, + 0.02117825299501419, + 1.2999174166470766, + 0.37004481442272663, + 1.0540564749389887, + 0.7840115465223789, + 0.4768845662474632, + 0.09715912863612175, + 0.35113503970205784, + 0.38241289369761944, + 0.2610306777060032, + 0.7137766666710377, + 0.10548828914761543, + 0.231141846626997, + 0.125198882073164, + 0.14087599888443947, + 1.9342111144214869, + 2.930826283991337, + 0.23003062792122364, + 3.430592415854335, + 0.2647900879383087, + 0.2282378301024437, + 0.6637076251208782, + 0.5304597429931164, + 0.3009961172938347, + 0.5633755549788475, + 0.0, + 0.22098387964069843, + 0.2426710231229663, + 0.540758403018117, + 0.2273355182260275, + 0.34279634803533554, + 0.7270258590579033, + 0.12708274461328983, + 0.3792954161763191, + 0.7316760327666998, + 0.404661163687706, + 0.3383190017193556, + 1.8844313994050026, + 2.480523906648159, + 0.4095929693430662, + 0.18053452484309673, + 0.5856924168765545, + 0.30760624073445797, + 0.41350680217146873, + 0.778346348553896, + 0.5052097216248512, + 1.516413265839219, + 0.09088527038693428 + ], + "unique_experts": 63, + "load_cv": 0.7467860313499562, + "normalized_load_entropy": 0.9439825300992146, + "max_load_share": 0.06481481481481481 + }, + "full_input": { + "tokens": 133, + "top_k": 6, + "decisions": 798, + "ordered_route_sha256": "b006d9b6e4c662462c5399f2eaf1fed8223c3df1f96463dd7422362d54630318", + "route_weight_sha256": "09d4bfeaec59ecca6a8e8104ba7c6803b26f7d0bf10127085b211d9bf50222b0", + "loads": [ + 16, + 7, + 14, + 21, + 15, + 12, + 15, + 10, + 6, + 15, + 5, + 9, + 17, + 13, + 19, + 12, + 3, + 6, + 10, + 18, + 11, + 8, + 9, + 16, + 12, + 4, + 5, + 5, + 6, + 9, + 11, + 21, + 43, + 5, + 31, + 7, + 4, + 23, + 8, + 7, + 19, + 3, + 16, + 9, + 9, + 7, + 9, + 17, + 5, + 4, + 17, + 11, + 5, + 28, + 35, + 11, + 6, + 10, + 13, + 8, + 18, + 11, + 36, + 3 + ], + "weighted_loads": [ + 0.599453691393137, + 0.3644275423139334, + 0.49398045986890793, + 3.5294393599033356, + 1.2846051175147295, + 1.0202186638489366, + 0.6420981483533978, + 0.5761166252195835, + 0.3797563649713993, + 0.7832123469561338, + 0.11743965838104486, + 0.36969204992055893, + 1.2694138307124376, + 0.45563151501119137, + 0.9494981206953526, + 0.4881292786449194, + 0.10161209478974342, + 1.2999174166470766, + 0.37004481442272663, + 1.3203156422823668, + 0.7840115465223789, + 0.4768845662474632, + 0.32705725729465485, + 0.5825843438506126, + 0.7107956018298864, + 0.2610306777060032, + 0.7137766666710377, + 0.20385479554533958, + 0.231141846626997, + 0.32143591344356537, + 0.384659331291914, + 1.9342111144214869, + 2.96597833186388, + 0.23003062792122364, + 3.4702091570943594, + 0.32349907606840134, + 0.2282378301024437, + 0.897401075810194, + 0.5718446671962738, + 0.33481115847826004, + 0.7150680376216769, + 0.285004623234272, + 0.9531861189752817, + 0.3310044249519706, + 0.551455388776958, + 0.2273355182260275, + 0.3752012476325035, + 1.044603157788515, + 0.16278556175529957, + 0.3792954161763191, + 0.7316760327666998, + 0.404661163687706, + 0.3383190017193556, + 2.1386899948120117, + 3.309659570455551, + 0.4095929693430662, + 0.21317295543849468, + 0.5856924168765545, + 0.5817336067557335, + 0.41350680217146873, + 0.8169761337339878, + 0.6876774206757545, + 2.110365003347397, + 0.09088527038693428 + ], + "unique_experts": 64, + "load_cv": 0.6627118074853722, + "normalized_load_entropy": 0.9542995477881504, + "max_load_share": 0.05388471177944862 + } + }, + "s1_x": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "6f559ef1094c9aae7aabce54b0481b6274f47bc6d6610a2ab280bd7df2c248dc", + "route_weight_sha256": "b99eed4ae17dcc613f2ebb42d49a1a5671abccc3439da0850ef4d6b26d9d1b40", + "loads": [ + 15, + 7, + 11, + 20, + 8, + 8, + 4, + 10, + 6, + 13, + 4, + 10, + 9, + 9, + 12, + 11, + 2, + 7, + 6, + 13, + 10, + 8, + 4, + 10, + 4, + 5, + 6, + 4, + 5, + 5, + 6, + 22, + 41, + 5, + 32, + 4, + 4, + 18, + 7, + 4, + 14, + 6, + 6, + 6, + 8, + 10, + 6, + 13, + 4, + 3, + 16, + 11, + 4, + 23, + 30, + 11, + 3, + 11, + 9, + 9, + 16, + 8, + 29, + 3 + ], + "weighted_loads": [ + 0.5760530065745115, + 0.33590046875178814, + 0.4033928010612726, + 3.4435036927461624, + 0.3759249225258827, + 0.8754753768444061, + 0.1762254759669304, + 0.6016260422766209, + 0.38718106970191, + 0.6395114865154028, + 0.08667135331779718, + 0.38299527764320374, + 0.7157000731676817, + 0.3091709092259407, + 0.6123533565551043, + 0.4428946506232023, + 0.05226454697549343, + 1.2515131011605263, + 0.20694235526025295, + 1.057973738759756, + 0.7539903670549393, + 0.46500756219029427, + 0.12637471221387386, + 0.33657138235867023, + 0.2697578966617584, + 0.3029847852885723, + 0.9713997710496187, + 0.13555180095136166, + 0.1959722675383091, + 0.14613108150660992, + 0.19255605898797512, + 1.934105034917593, + 2.9549249932169914, + 0.2368944212794304, + 3.465826894156635, + 0.18390176631510258, + 0.23980123177170753, + 0.6820014547556639, + 0.5244386345148087, + 0.24941029585897923, + 0.5497307814657688, + 0.2200025375932455, + 0.2268665563315153, + 0.19897702429443598, + 0.5279010804370046, + 0.2861363813281059, + 0.25686332397162914, + 0.7381010595709085, + 0.1413264013826847, + 0.3162813000380993, + 0.6653589680790901, + 0.42349356040358543, + 0.3238605707883835, + 1.8104187417775393, + 2.5093220453709364, + 0.4198371507227421, + 0.11347515508532524, + 0.6449065320193768, + 0.3652907721698284, + 0.4663645587861538, + 0.780501626431942, + 0.5300052762031555, + 1.546485235914588, + 0.09622498322278261 + ], + "unique_experts": 64, + "load_cv": 0.7490277191169142, + "normalized_load_entropy": 0.9458248513239207, + "max_load_share": 0.06327160493827161 + }, + "full_input": { + "tokens": 149, + "top_k": 6, + "decisions": 894, + "ordered_route_sha256": "108b0aa60cb2f4aefa7ae5d174e4b1e7a6505cfc24ddf97b552a9020acd14111", + "route_weight_sha256": "a938525fa5497fc1c14764d9b0476cc912e2e0c935a706f596b0578522171a7c", + "loads": [ + 16, + 12, + 14, + 20, + 20, + 11, + 17, + 10, + 6, + 18, + 5, + 16, + 22, + 10, + 23, + 13, + 5, + 13, + 7, + 20, + 13, + 9, + 11, + 15, + 13, + 5, + 6, + 6, + 6, + 7, + 10, + 22, + 45, + 5, + 33, + 5, + 6, + 24, + 8, + 6, + 18, + 15, + 17, + 8, + 9, + 10, + 6, + 25, + 5, + 4, + 21, + 11, + 7, + 33, + 34, + 11, + 5, + 13, + 19, + 10, + 18, + 18, + 39, + 5 + ], + "weighted_loads": [ + 0.5972674153745174, + 0.6384226586669683, + 0.5050815865397453, + 3.4435036927461624, + 1.7609175592660904, + 1.0128362821415067, + 0.777652638964355, + 0.6016260422766209, + 0.38718106970191, + 0.8854427020996809, + 0.15351939294487238, + 1.071742545813322, + 1.4752478208392859, + 0.35112325474619865, + 1.306461974978447, + 0.55242501758039, + 0.4441306833177805, + 1.5178304947912693, + 0.3083042483776808, + 1.4069148562848568, + 1.055545873939991, + 0.5195484161376953, + 0.39616011641919613, + 0.5145816039294004, + 0.8718855548650026, + 0.3029847852885723, + 0.9713997710496187, + 0.2624052967876196, + 0.23522457107901573, + 0.22537211887538433, + 0.32335854694247246, + 1.934105034917593, + 3.1094686072319746, + 0.2368944212794304, + 3.496981550939381, + 0.22756615094840527, + 0.3206694945693016, + 0.9188600890338421, + 0.5679013542830944, + 0.35293880105018616, + 0.6767721762880683, + 0.7317797932773829, + 1.1639373749494553, + 0.2716039242222905, + 0.5385980661958456, + 0.2861363813281059, + 0.25686332397162914, + 1.5036260280758142, + 0.17559492960572243, + 0.362021267414093, + 1.0021141432225704, + 0.42349356040358543, + 0.4671137407422066, + 2.6024942565709352, + 3.2810258250683546, + 0.4198371507227421, + 0.19461966678500175, + 0.7330669611692429, + 0.8660783749073744, + 0.5008633062243462, + 0.868598286062479, + 1.0054350085556507, + 2.3262140844017267, + 0.26054241601377726 + ], + "unique_experts": 64, + "load_cv": 0.6328803309672577, + "normalized_load_entropy": 0.9571274627029444, + "max_load_share": 0.050335570469798654 + } + }, + "s0_period": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "aa457cfcda36ec11c548dc964a1bba385c6670c5e1c19fede3963eca6b967c91", + "route_weight_sha256": "02de5c6cdfdb996eceeb73dc658533304c2c6201172cb08a07157f6f79da0f0b", + "loads": [ + 13, + 7, + 11, + 20, + 10, + 9, + 5, + 11, + 6, + 12, + 5, + 8, + 8, + 9, + 13, + 11, + 1, + 6, + 11, + 11, + 11, + 8, + 1, + 9, + 4, + 3, + 5, + 3, + 6, + 4, + 4, + 21, + 42, + 5, + 30, + 6, + 6, + 17, + 7, + 6, + 14, + 3, + 7, + 7, + 9, + 8, + 7, + 13, + 5, + 4, + 17, + 11, + 5, + 24, + 30, + 11, + 5, + 9, + 6, + 9, + 19, + 8, + 29, + 3 + ], + "weighted_loads": [ + 0.48895833268761635, + 0.3144397549331188, + 0.40947576612234116, + 3.494555601850152, + 0.457259688526392, + 0.8971897177398205, + 0.20194915682077408, + 0.6255428157746792, + 0.38112448528409004, + 0.6176157556474209, + 0.12738896533846855, + 0.34285556711256504, + 0.6161017771810293, + 0.3016869407147169, + 0.6219348199665546, + 0.437546206638217, + 0.02117147669196129, + 1.2298311237245798, + 0.40697912499308586, + 1.0972920320928097, + 0.7916123326867819, + 0.4792441837489605, + 0.03209501877427101, + 0.31633393466472626, + 0.3319043591618538, + 0.23916281573474407, + 0.7278956361114979, + 0.10760999098420143, + 0.23433255776762962, + 0.12846103869378567, + 0.14032015204429626, + 1.9385097194463015, + 2.9489816948771477, + 0.2313622497022152, + 3.429519411176443, + 0.26895084604620934, + 0.3109904620796442, + 0.6540871784090996, + 0.5362051241099834, + 0.29080566950142384, + 0.54223164729774, + 0.11780378594994545, + 0.2164315152913332, + 0.23731220606714487, + 0.5685390615835786, + 0.2572236694395542, + 0.30004988610744476, + 0.7109414786100388, + 0.14905001036822796, + 0.3756183311343193, + 0.7236517425626516, + 0.4179032929241657, + 0.3457572013139725, + 1.8777140509337187, + 2.488093923777342, + 0.4028554614633322, + 0.18334129825234413, + 0.5599340945482254, + 0.2627975642681122, + 0.4752083942294121, + 0.8641943745315075, + 0.5113178994506598, + 1.5556369833648205, + 0.08915022201836109 + ], + "unique_experts": 64, + "load_cv": 0.7504507612557596, + "normalized_load_entropy": 0.944823080334915, + "max_load_share": 0.06481481481481481 + }, + "full_input": { + "tokens": 133, + "top_k": 6, + "decisions": 798, + "ordered_route_sha256": "0e086b2f9772a4c9ff96b14ac2484f44a0980bdac3d64877a61f2c5fa03e747d", + "route_weight_sha256": "887d7047069938044a8dc19e291b4140843c7440b658153b4df199d71380c7f1", + "loads": [ + 16, + 8, + 13, + 20, + 15, + 12, + 15, + 11, + 6, + 15, + 5, + 8, + 16, + 12, + 18, + 11, + 3, + 6, + 11, + 17, + 11, + 8, + 6, + 16, + 11, + 3, + 5, + 5, + 6, + 9, + 10, + 21, + 43, + 5, + 31, + 7, + 7, + 23, + 8, + 7, + 18, + 6, + 15, + 9, + 10, + 8, + 8, + 19, + 6, + 4, + 17, + 11, + 5, + 27, + 36, + 11, + 6, + 9, + 11, + 9, + 20, + 13, + 37, + 3 + ], + "weighted_loads": [ + 0.6101026590913534, + 0.40067315474152565, + 0.4701860323548317, + 3.494555601850152, + 1.32504079118371, + 1.0138323539867997, + 0.6020742645487189, + 0.6255428157746792, + 0.38112448528409004, + 0.79450374096632, + 0.12738896533846855, + 0.34285556711256504, + 1.1648825351148844, + 0.4211472813040018, + 0.9278477430343628, + 0.437546206638217, + 0.10160531848669052, + 1.2298311237245798, + 0.40697912499308586, + 1.3727014251053333, + 0.7916123326867819, + 0.4792441837489605, + 0.2120032161474228, + 0.577861750498414, + 0.7051517963409424, + 0.23916281573474407, + 0.7278956361114979, + 0.2055719792842865, + 0.23433255776762962, + 0.3287632931023836, + 0.36108911223709583, + 1.9385097194463015, + 2.983123742043972, + 0.2313622497022152, + 3.4927199445664883, + 0.32765983417630196, + 0.36505809985101223, + 0.9091255851089954, + 0.5775900483131409, + 0.3215662743896246, + 0.6974406810477376, + 0.37186840549111366, + 0.8070792201906443, + 0.32564560789614916, + 0.5792360473424196, + 0.2572236694395542, + 0.33338966965675354, + 1.1344689205288887, + 0.1847528275102377, + 0.3756183311343193, + 0.7236517425626516, + 0.4179032929241657, + 0.3457572013139725, + 2.11837668530643, + 3.317229587584734, + 0.4028554614633322, + 0.2143908068537712, + 0.5599340945482254, + 0.48940846137702465, + 0.4752083942294121, + 0.9023420065641403, + 0.8119828701019287, + 2.140638953074813, + 0.08915022201836109 + ], + "unique_experts": 64, + "load_cv": 0.6610415254676502, + "normalized_load_entropy": 0.9553700964352976, + "max_load_share": 0.05388471177944862 + } + }, + "s1_period": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "6d17c165f577615fd5111d66e4825c5436fa923b8e82743451efd9041a6eaebb", + "route_weight_sha256": "63633ed32214c3e8d11b015c77e959936d5e244613cca118680e469dff4ac95d", + "loads": [ + 13, + 7, + 10, + 20, + 9, + 9, + 4, + 10, + 6, + 14, + 5, + 10, + 9, + 8, + 11, + 11, + 1, + 6, + 6, + 13, + 11, + 8, + 2, + 10, + 2, + 5, + 5, + 4, + 5, + 5, + 5, + 21, + 43, + 5, + 33, + 4, + 4, + 20, + 7, + 5, + 14, + 4, + 7, + 6, + 6, + 9, + 7, + 14, + 4, + 4, + 16, + 10, + 5, + 25, + 31, + 10, + 6, + 11, + 8, + 8, + 18, + 7, + 29, + 3 + ], + "weighted_loads": [ + 0.5052518285810947, + 0.3327945116907358, + 0.3767477348446846, + 3.5061844643205404, + 0.4134053848683834, + 0.8910530917346478, + 0.18237090110778809, + 0.5951902084052563, + 0.39322035014629364, + 0.6519547626376152, + 0.12091620545834303, + 0.3870152607560158, + 0.6855670977383852, + 0.26903409138321877, + 0.5965982284396887, + 0.44699631445109844, + 0.022286150604486465, + 1.0126764550805092, + 0.22893276065587997, + 1.121740199625492, + 0.7878630701452494, + 0.4644049033522606, + 0.06455568969249725, + 0.3305918462574482, + 0.2079184241592884, + 0.29300626926124096, + 0.9251203425228596, + 0.14374493435025215, + 0.1886048298329115, + 0.14240927901118994, + 0.16293179616332054, + 1.9372170623391867, + 3.0073476675897837, + 0.23361903987824917, + 3.5752312801778316, + 0.17021699994802475, + 0.2543416768312454, + 0.7055514100939035, + 0.5374254044145346, + 0.2607147414237261, + 0.5687054414302111, + 0.15499317459762096, + 0.23737329617142677, + 0.20127445459365845, + 0.46811896190047264, + 0.28663763217628, + 0.3055211789906025, + 0.7759392689913511, + 0.14791852608323097, + 0.3464291263371706, + 0.6694494150578976, + 0.3791450299322605, + 0.35825032740831375, + 2.0445102900266647, + 2.5986997447907925, + 0.3707408010959625, + 0.19783269241452217, + 0.6462519653141499, + 0.32865622267127037, + 0.4567669406533241, + 0.8214820027351379, + 0.4948607496917248, + 1.5815376434475183, + 0.0948689915239811 + ], + "unique_experts": 64, + "load_cv": 0.7838290952765421, + "normalized_load_entropy": 0.941195985627567, + "max_load_share": 0.06635802469135803 + }, + "full_input": { + "tokens": 149, + "top_k": 6, + "decisions": 894, + "ordered_route_sha256": "d597107cdad80a80947105afa54e0f5c4a885a12b4b5d222c4dca6f3a93e7eb3", + "route_weight_sha256": "37f649b8cad6cfaa15f3332cef01473ca2db11c2e320bd3afc6ecff1edd6f150", + "loads": [ + 14, + 11, + 13, + 20, + 21, + 12, + 16, + 10, + 6, + 19, + 6, + 16, + 21, + 9, + 23, + 13, + 4, + 11, + 7, + 22, + 14, + 9, + 8, + 15, + 11, + 5, + 5, + 6, + 6, + 7, + 10, + 21, + 46, + 5, + 34, + 5, + 7, + 23, + 8, + 8, + 19, + 13, + 18, + 7, + 7, + 9, + 7, + 27, + 5, + 5, + 21, + 10, + 8, + 36, + 35, + 10, + 8, + 13, + 17, + 9, + 21, + 18, + 39, + 5 + ], + "weighted_loads": [ + 0.5264662373811007, + 0.5917377043515444, + 0.474524786695838, + 3.5061844643205404, + 1.8734319247305393, + 1.0308798709884286, + 0.7510243570432067, + 0.5951902084052563, + 0.39322035014629364, + 0.8952744677662849, + 0.18776424508541822, + 1.075762528926134, + 1.3525695782154799, + 0.3102578930556774, + 1.3132763430476189, + 0.5565266814082861, + 0.41415228694677353, + 1.2390111051499844, + 0.3302946537733078, + 1.5559486635029316, + 1.089418577030301, + 0.5189457572996616, + 0.29914822056889534, + 0.5086020678281784, + 0.7935814764350653, + 0.29300626926124096, + 0.9251203425228596, + 0.2650616951286793, + 0.22785713337361813, + 0.2225570296868682, + 0.32773067243397236, + 1.9372170623391867, + 3.12823074683547, + 0.23361903987824917, + 3.634339239448309, + 0.21814807504415512, + 0.3682228960096836, + 0.8192781507968903, + 0.5808881241828203, + 0.40826986730098724, + 0.7460637660697103, + 0.6474067363888025, + 1.0198979508131742, + 0.23943838104605675, + 0.4788159476593137, + 0.28663763217628, + 0.3055211789906025, + 1.646563047543168, + 0.1821870543062687, + 0.39216909371316433, + 1.0062045902013779, + 0.3791450299322605, + 0.5015034973621368, + 2.9258293472230434, + 3.3704035244882107, + 0.3707408010959625, + 0.2789772041141987, + 0.734412394464016, + 0.7975566145032644, + 0.4912656880915165, + 0.9560947865247726, + 0.9952237047255039, + 2.320673258975148, + 0.25918642431497574 + ], + "unique_experts": 64, + "load_cv": 0.6542811475567258, + "normalized_load_entropy": 0.9552216949001778, + "max_load_share": 0.05145413870246085 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 108, + "ordered_topk_exact_tokens": 51, + "set_exact_tokens": 71, + "mean_set_jaccard": 0.8981481481481483, + "mean_token_weighted_tv": 0.020836214560808405, + "aggregate_load_tv": 0.03858024691358024 + }, + "system_bos": { + "tokens": 108, + "ordered_topk_exact_tokens": 44, + "set_exact_tokens": 58, + "mean_set_jaccard": 0.8617724867724869, + "mean_token_weighted_tv": 0.02666244401027345, + "aggregate_load_tv": 0.04166666666666666 + }, + "system_x": { + "tokens": 108, + "ordered_topk_exact_tokens": 37, + "set_exact_tokens": 50, + "mean_set_jaccard": 0.8227513227513228, + "mean_token_weighted_tv": 0.035176905316162715, + "aggregate_load_tv": 0.054012345679012336 + }, + "system_period": { + "tokens": 108, + "ordered_topk_exact_tokens": 33, + "set_exact_tokens": 49, + "mean_set_jaccard": 0.8284832451499119, + "mean_token_weighted_tv": 0.0341307849071368, + "aggregate_load_tv": 0.04783950617283951 + }, + "bos_at_s0": { + "tokens": 108, + "ordered_topk_exact_tokens": 48, + "set_exact_tokens": 63, + "mean_set_jaccard": 0.8675044091710759, + "mean_token_weighted_tv": 0.026121089829959802, + "aggregate_load_tv": 0.047839506172839504 + }, + "bos_at_s1": { + "tokens": 108, + "ordered_topk_exact_tokens": 36, + "set_exact_tokens": 53, + "mean_set_jaccard": 0.8378306878306879, + "mean_token_weighted_tv": 0.03222827136913246, + "aggregate_load_tv": 0.05246913580246913 + }, + "x_at_s0": { + "tokens": 108, + "ordered_topk_exact_tokens": 42, + "set_exact_tokens": 62, + "mean_set_jaccard": 0.8620811287477955, + "mean_token_weighted_tv": 0.02986987866030109, + "aggregate_load_tv": 0.046296296296296294 + }, + "x_at_s1": { + "tokens": 108, + "ordered_topk_exact_tokens": 30, + "set_exact_tokens": 44, + "mean_set_jaccard": 0.8057760141093474, + "mean_token_weighted_tv": 0.03890873444335604, + "aggregate_load_tv": 0.05246913580246913 + }, + "period_at_s0": { + "tokens": 108, + "ordered_topk_exact_tokens": 43, + "set_exact_tokens": 62, + "mean_set_jaccard": 0.8578042328042329, + "mean_token_weighted_tv": 0.030298390792234352, + "aggregate_load_tv": 0.04938271604938271 + }, + "period_at_s1": { + "tokens": 108, + "ordered_topk_exact_tokens": 28, + "set_exact_tokens": 48, + "mean_set_jaccard": 0.8108465608465609, + "mean_token_weighted_tv": 0.03962169416438512, + "aggregate_load_tv": 0.05401234567901235 + } + } + }, + "layer_20": { + "layer": 20, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "49b02a4fbdd7157d66e52ae38a0ade0c2d8c34619e691577bf9932b0f4f4597b", + "route_weight_sha256": "e54bcc97916e83bd82a55cc94c753b57f574d79e02c84822bd4ce72869f980ea", + "loads": [ + 12, + 10, + 14, + 6, + 30, + 10, + 19, + 8, + 21, + 2, + 10, + 11, + 18, + 7, + 10, + 3, + 7, + 10, + 13, + 18, + 3, + 17, + 11, + 18, + 4, + 24, + 24, + 22, + 4, + 13, + 6, + 12, + 13, + 8, + 9, + 0, + 8, + 18, + 13, + 6, + 17, + 11, + 5, + 4, + 10, + 3, + 8, + 5, + 8, + 3, + 24, + 3, + 3, + 5, + 6, + 8, + 9, + 13, + 7, + 4, + 7, + 3, + 8, + 2 + ], + "weighted_loads": [ + 0.39090701192617416, + 0.3544297330081463, + 0.8451460041105747, + 0.3090929538011551, + 2.0424058940261602, + 0.3620604146271944, + 2.3309185467660427, + 0.3169441260397434, + 1.5095605365931988, + 0.06631961278617382, + 0.4715396761894226, + 2.089334838092327, + 1.767855741083622, + 0.4982360117137432, + 0.33647641725838184, + 0.14041922613978386, + 0.3457252513617277, + 0.8597837407141924, + 0.7447695340961218, + 1.186148937791586, + 0.11079192906618118, + 0.8997648991644382, + 0.5921803750097752, + 1.1123680509626865, + 0.28451924584805965, + 1.2211874723434448, + 0.8709968868643045, + 1.6436469480395317, + 0.2891422249376774, + 0.39997550286352634, + 0.20620758458971977, + 0.36919861286878586, + 0.6927567105740309, + 0.7689674403518438, + 0.38592939637601376, + 0.0, + 0.2763668894767761, + 0.690538277849555, + 0.591912355273962, + 0.2583021707832813, + 0.6780516095459461, + 0.4127920977771282, + 0.21714498847723007, + 0.18807736970484257, + 0.5748355109244585, + 0.16578330844640732, + 0.5342416539788246, + 0.21395929157733917, + 0.3168914392590523, + 0.11810297518968582, + 2.3488107658922672, + 0.10738067701458931, + 0.10139420814812183, + 0.31918591260910034, + 0.37186533585190773, + 0.3569480571895838, + 0.3146196659654379, + 0.45711316354572773, + 0.24030779488384724, + 0.20155075192451477, + 0.5028250999748707, + 0.13321460410952568, + 0.36620052345097065, + 0.05287465453147888 + ], + "unique_experts": 63, + "load_cv": 0.6390007059065449, + "normalized_load_entropy": 0.9520239870077168, + "max_load_share": 0.046296296296296294 + }, + "full_input": { + "tokens": 133, + "top_k": 6, + "decisions": 798, + "ordered_route_sha256": "96582aba948ade5539b243fd7027a02838379e4329b0bd2da3790d0d18237475", + "route_weight_sha256": "d01c1878354f8cf7404036ebfc4250626d17f68c9f787478cfc03d2bb9c42601", + "loads": [ + 12, + 12, + 14, + 14, + 38, + 15, + 23, + 13, + 21, + 2, + 11, + 12, + 22, + 7, + 10, + 9, + 8, + 10, + 23, + 18, + 8, + 17, + 18, + 18, + 4, + 32, + 25, + 22, + 4, + 15, + 6, + 12, + 13, + 9, + 10, + 0, + 10, + 21, + 16, + 7, + 19, + 13, + 7, + 7, + 19, + 3, + 8, + 5, + 9, + 3, + 32, + 3, + 4, + 11, + 6, + 11, + 10, + 18, + 8, + 4, + 19, + 7, + 9, + 2 + ], + "weighted_loads": [ + 0.39090701192617416, + 0.39914158172905445, + 0.8451460041105747, + 0.8961742147803307, + 2.443328646942973, + 0.5905490219593048, + 2.444320388138294, + 0.651299711316824, + 1.5095605365931988, + 0.06631961278617382, + 0.5062872432172298, + 2.1344068944454193, + 1.901975205168128, + 0.4982360117137432, + 0.33647641725838184, + 0.46634479984641075, + 0.38183911703526974, + 0.8597837407141924, + 1.633020831272006, + 1.186148937791586, + 0.2656264556571841, + 0.8997648991644382, + 0.957347646355629, + 1.1123680509626865, + 0.28451924584805965, + 1.7172855325043201, + 0.8884397111833096, + 1.6436469480395317, + 0.2891422249376774, + 0.4661606512963772, + 0.20620758458971977, + 0.36919861286878586, + 0.6927567105740309, + 0.7920261453837156, + 0.43010917119681835, + 0.0, + 0.3233789335936308, + 0.7761659566313028, + 1.9399767220020294, + 0.30087199062108994, + 0.8209914043545723, + 0.48993368819355965, + 0.40037888288497925, + 0.2861712465528399, + 0.8736163880676031, + 0.16578330844640732, + 0.5342416539788246, + 0.21395929157733917, + 0.3185353387380019, + 0.11810297518968582, + 3.3276154175400734, + 0.10738067701458931, + 0.14117802120745182, + 0.639725960791111, + 0.37186533585190773, + 0.7532572131603956, + 0.3772164937108755, + 0.617447379976511, + 0.27836466766893864, + 0.20155075192451477, + 1.7738044337602332, + 0.37191642448306084, + 0.40104531683027744, + 0.05287465453147888 + ], + "unique_experts": 63, + "load_cv": 0.6186314593576853, + "normalized_load_entropy": 0.9546854784925948, + "max_load_share": 0.047619047619047616 + } + }, + "s1_eos": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "c490bdad5b17cae41768741021ed06c01e9576a0ea7852f21509b67e5cf5c2cb", + "route_weight_sha256": "878b384dd26cb1128bd996aa445b835b1000ea50a87a013449c2b4f4af13bebe", + "loads": [ + 11, + 12, + 14, + 7, + 30, + 8, + 18, + 9, + 22, + 1, + 10, + 11, + 17, + 9, + 9, + 3, + 7, + 10, + 13, + 17, + 3, + 16, + 11, + 17, + 4, + 24, + 24, + 22, + 5, + 11, + 6, + 16, + 13, + 9, + 9, + 0, + 6, + 19, + 12, + 6, + 15, + 12, + 5, + 4, + 11, + 4, + 7, + 5, + 9, + 2, + 25, + 3, + 3, + 5, + 8, + 8, + 9, + 12, + 8, + 5, + 5, + 1, + 8, + 3 + ], + "weighted_loads": [ + 0.3669445011764765, + 0.4159424938261509, + 0.8569363951683044, + 0.33450957015156746, + 2.0726788826286793, + 0.29695744439959526, + 2.3148136250674725, + 0.33089072816073895, + 1.5146779231727123, + 0.03865327686071396, + 0.4761425592005253, + 2.1378023754805326, + 1.73440583050251, + 0.558383671566844, + 0.28481200709939003, + 0.21847260743379593, + 0.3461213782429695, + 0.844893291592598, + 0.7264757137745619, + 1.1693843007087708, + 0.1144547238945961, + 0.8783977851271629, + 0.5939772073179483, + 1.1082908734679222, + 0.2924511097371578, + 1.2338093258440495, + 0.8936704359948635, + 1.6626731529831886, + 0.3141863625496626, + 0.3243226073682308, + 0.20768320746719837, + 0.4865850731730461, + 0.691795377060771, + 0.8069586101919413, + 0.4192114509642124, + 0.0, + 0.21736828051507473, + 0.7084034401923418, + 0.5748199950903654, + 0.25269457697868347, + 0.6166911367326975, + 0.45369046181440353, + 0.2143644094467163, + 0.1897495537996292, + 0.6274196058511734, + 0.19243941828608513, + 0.5088405162096024, + 0.21621843427419662, + 0.3542778678238392, + 0.08666649460792542, + 2.3560902513563633, + 0.1147453673183918, + 0.10128082893788815, + 0.31514376029372215, + 0.42442492581903934, + 0.3596268482506275, + 0.31542252749204636, + 0.4393286630511284, + 0.27276715636253357, + 0.2373608462512493, + 0.42275043949484825, + 0.05605996772646904, + 0.36581607908010483, + 0.08435434848070145 + ], + "unique_experts": 63, + "load_cv": 0.6390007059065449, + "normalized_load_entropy": 0.9513559709414322, + "max_load_share": 0.046296296296296294 + }, + "full_input": { + "tokens": 149, + "top_k": 6, + "decisions": 894, + "ordered_route_sha256": "154930a1c1e263af213c25ae81b7a1c0ecc223b8924432a534511ef27136b256", + "route_weight_sha256": "92f2bcc9a542e90ce06d73c1da41476c4c8b5f052c5d4274a89af0bd0c0fe845", + "loads": [ + 16, + 14, + 14, + 18, + 38, + 14, + 20, + 18, + 22, + 3, + 12, + 11, + 19, + 10, + 10, + 16, + 12, + 10, + 23, + 18, + 8, + 17, + 22, + 19, + 5, + 38, + 25, + 24, + 5, + 16, + 6, + 17, + 14, + 10, + 12, + 2, + 9, + 25, + 15, + 10, + 21, + 14, + 7, + 10, + 23, + 5, + 7, + 5, + 11, + 7, + 38, + 3, + 4, + 14, + 9, + 20, + 11, + 19, + 10, + 6, + 18, + 3, + 9, + 3 + ], + "weighted_loads": [ + 0.59855424053967, + 0.46032293513417244, + 0.8569363951683044, + 1.0974987260997295, + 2.485601980239153, + 0.5727160461246967, + 2.3845887146890163, + 0.9339999575167894, + 1.5146779231727123, + 0.27241993695497513, + 0.5722154341638088, + 2.1378023754805326, + 1.796595087274909, + 0.8381949346512556, + 0.34661534428596497, + 1.0083144828677177, + 0.6461964230984449, + 0.844893291592598, + 1.7057014387100935, + 1.2063774205744267, + 0.2714364326093346, + 0.9156723245978355, + 1.2176166009157896, + 1.279317483305931, + 0.3121298812329769, + 2.0901113264262676, + 0.9111132603138685, + 1.7239146418869495, + 0.3141863625496626, + 0.48505397886037827, + 0.20768320746719837, + 0.5168271381407976, + 0.7414333764463663, + 0.8502260949462652, + 0.5678079221397638, + 0.1783415861427784, + 0.3194862827658653, + 0.9145957920700312, + 1.9308075439184904, + 0.45053158327937126, + 0.9078569952398539, + 0.5430432707071304, + 0.38224276900291443, + 0.4193196389824152, + 1.3977201245725155, + 0.26582223549485207, + 0.5088405162096024, + 0.21621843427419662, + 0.389825317543, + 0.3964684382081032, + 3.9616142213344574, + 0.1147453673183918, + 0.13513821549713612, + 0.7232177592813969, + 0.4554947782307863, + 1.4547915607690811, + 0.39919212087988853, + 0.9754245299845934, + 0.3463686592876911, + 0.2655890788882971, + 1.8598206075839698, + 0.17346593365073204, + 0.42769092321395874, + 0.08435434848070145 + ], + "unique_experts": 64, + "load_cv": 0.5826827961035366, + "normalized_load_entropy": 0.9605605011683144, + "max_load_share": 0.042505592841163314 + } + }, + "s0_bos": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "7c16918cc195fe476cc0d0af4ca7f74cdc5fd1bc710cee67140744409d48254c", + "route_weight_sha256": "0d07a18c44e1e715361287ad7891ddb39be31119fbb54b58b897b43651495b2b", + "loads": [ + 10, + 10, + 13, + 7, + 29, + 7, + 20, + 9, + 21, + 1, + 9, + 10, + 19, + 8, + 9, + 2, + 8, + 9, + 14, + 19, + 2, + 15, + 12, + 17, + 4, + 27, + 23, + 22, + 5, + 10, + 5, + 13, + 14, + 9, + 10, + 1, + 7, + 18, + 12, + 6, + 14, + 12, + 6, + 5, + 10, + 3, + 9, + 4, + 8, + 3, + 26, + 2, + 3, + 7, + 6, + 8, + 8, + 15, + 7, + 5, + 7, + 3, + 9, + 2 + ], + "weighted_loads": [ + 0.3364230915904045, + 0.3618244845420122, + 0.814564784988761, + 0.316113980486989, + 2.0345255192369223, + 0.26742811128497124, + 2.373385429382324, + 0.36360057070851326, + 1.506537625566125, + 0.036261893808841705, + 0.4300299044698477, + 1.9473607540130615, + 1.8191343881189823, + 0.5003221221268177, + 0.3087233491241932, + 0.11027343943715096, + 0.3825051989406347, + 0.8843961358070374, + 0.7676877677440643, + 1.2463083676993847, + 0.07964927703142166, + 0.8330243360251188, + 0.6494111530482769, + 1.1019532531499863, + 0.28286648355424404, + 1.3912384770810604, + 0.8340592198073864, + 1.6882195472717285, + 0.32353303395211697, + 0.30595643259584904, + 0.17325546219944954, + 0.42374541983008385, + 0.704043123871088, + 0.8213468715548515, + 0.42774102836847305, + 0.02843627706170082, + 0.24456680193543434, + 0.7188780810683966, + 0.5595324039459229, + 0.2465491145849228, + 0.5993355549871922, + 0.439282413572073, + 0.2595901843160391, + 0.2105366848409176, + 0.5770369563251734, + 0.15751466527581215, + 0.5726922582834959, + 0.16864290088415146, + 0.3119347710162401, + 0.1138402409851551, + 2.375917738303542, + 0.06544121354818344, + 0.10323560982942581, + 0.35558838956058025, + 0.37192390486598015, + 0.3689440004527569, + 0.2817857675254345, + 0.5492523238062859, + 0.23825909942388535, + 0.23634007573127747, + 0.48909829556941986, + 0.13095232471823692, + 0.4141366370022297, + 0.0545346699655056 + ], + "unique_experts": 64, + "load_cv": 0.6482363255716087, + "normalized_load_entropy": 0.9512992628201479, + "max_load_share": 0.044753086419753084 + }, + "full_input": { + "tokens": 133, + "top_k": 6, + "decisions": 798, + "ordered_route_sha256": "6f9c88465a2f915b7b72741f7ec05eced55c71e6f2831f06b779d925d4e6cc4c", + "route_weight_sha256": "3f834bb29faa656a28c28a6a5c925fdd9a19f9c5d705e128e8d8df8d4f694d3b", + "loads": [ + 10, + 11, + 13, + 15, + 37, + 12, + 24, + 14, + 21, + 1, + 10, + 11, + 23, + 8, + 10, + 9, + 9, + 9, + 24, + 19, + 6, + 15, + 20, + 17, + 4, + 36, + 26, + 22, + 5, + 12, + 7, + 14, + 14, + 10, + 11, + 1, + 9, + 21, + 13, + 7, + 17, + 14, + 8, + 7, + 19, + 3, + 10, + 5, + 8, + 3, + 34, + 2, + 4, + 12, + 6, + 11, + 8, + 19, + 8, + 5, + 18, + 6, + 9, + 2 + ], + "weighted_loads": [ + 0.3364230915904045, + 0.3859892152249813, + 0.814564784988761, + 0.9031952414661646, + 2.435448272153735, + 0.4830344785004854, + 2.4867872707545757, + 0.6696377843618393, + 1.506537625566125, + 0.036261893808841705, + 0.46340437419712543, + 2.662032127380371, + 1.9564497265964746, + 0.5003221221268177, + 0.35399578511714935, + 0.5049562677741051, + 0.41861906461417675, + 0.8843961358070374, + 1.6559390649199486, + 1.2463083676993847, + 0.23788541741669178, + 0.8330243360251188, + 1.0784000121057034, + 1.1019532531499863, + 0.28286648355424404, + 1.918079663068056, + 0.9319879673421383, + 1.6882195472717285, + 0.32353303395211697, + 0.3721415810286999, + 0.2749064974486828, + 0.43476494029164314, + 0.704043123871088, + 0.8444055765867233, + 0.46988943219184875, + 0.02843627706170082, + 0.291578846052289, + 0.8045057598501444, + 0.9241536557674408, + 0.290452316403389, + 0.7927328199148178, + 0.49305753502994776, + 0.4460200350731611, + 0.32876674458384514, + 0.8814876917749643, + 0.15751466527581215, + 0.7091262321919203, + 0.17860677652060986, + 0.3119347710162401, + 0.1138402409851551, + 3.401294844225049, + 0.06544121354818344, + 0.13994576036930084, + 0.616229111328721, + 0.37192390486598015, + 0.7604795470833778, + 0.2817857675254345, + 0.6717751938849688, + 0.27631597220897675, + 0.23634007573127747, + 1.7587000876665115, + 0.34946293756365776, + 0.4141366370022297, + 0.0545346699655056 + ], + "unique_experts": 64, + "load_cv": 0.6405016767931893, + "normalized_load_entropy": 0.9530255376010119, + "max_load_share": 0.046365914786967416 + } + }, + "s1_bos": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "2063c86bf2d83adbb1093e615277bbdbdf5e8552bb6203fa3fe414615d7426ab", + "route_weight_sha256": "59559849907d20ff3cec65dedd61219dd99336854e0ede0079f1706fe519b1a3", + "loads": [ + 10, + 12, + 13, + 6, + 30, + 8, + 19, + 9, + 18, + 1, + 9, + 11, + 17, + 10, + 8, + 3, + 6, + 9, + 15, + 19, + 5, + 15, + 11, + 18, + 4, + 25, + 26, + 22, + 5, + 12, + 4, + 15, + 14, + 8, + 12, + 0, + 6, + 21, + 12, + 6, + 13, + 13, + 6, + 5, + 11, + 3, + 8, + 4, + 8, + 4, + 27, + 2, + 1, + 7, + 7, + 8, + 7, + 12, + 5, + 4, + 7, + 1, + 10, + 1 + ], + "weighted_loads": [ + 0.3281067833304405, + 0.43663071282207966, + 0.8130748867988586, + 0.31219157204031944, + 2.0756353680044413, + 0.29197062365710735, + 2.3769248705357313, + 0.3425971083343029, + 1.409095510840416, + 0.03526072949171066, + 0.44292611442506313, + 2.014904245734215, + 1.747192207723856, + 0.5907781291753054, + 0.2705075666308403, + 0.12675786577165127, + 0.3054588623344898, + 0.8733508009463549, + 0.8252940345555544, + 1.2444756980985403, + 0.17195086367428303, + 0.8649914115667343, + 0.5946351047605276, + 1.140699077397585, + 0.26837604492902756, + 1.2945380583405495, + 0.9558744411915541, + 1.664380468428135, + 0.32117117941379547, + 0.3716645576059818, + 0.139822730794549, + 0.48723526671528816, + 0.7002068292349577, + 0.7876191455870867, + 0.5327812414616346, + 0.0, + 0.22185379080474377, + 0.7999923843890429, + 0.5670222565531731, + 0.24831607937812805, + 0.5293881595134735, + 0.4701598957180977, + 0.2555724121630192, + 0.21631402894854546, + 0.617376996204257, + 0.1772342137992382, + 0.5324841104447842, + 0.1548977866768837, + 0.31369582936167717, + 0.14432280138134956, + 2.334719154983759, + 0.0697951503098011, + 0.035641998052597046, + 0.3605745770037174, + 0.4015539437532425, + 0.36565347015857697, + 0.24836630187928677, + 0.44767001271247864, + 0.18318378180265427, + 0.20290972664952278, + 0.48504602164030075, + 0.05628587305545807, + 0.46842642687261105, + 0.02334163896739483 + ], + "unique_experts": 63, + "load_cv": 0.667466369921643, + "normalized_load_entropy": 0.9467377965201244, + "max_load_share": 0.046296296296296294 + }, + "full_input": { + "tokens": 149, + "top_k": 6, + "decisions": 894, + "ordered_route_sha256": "386bee99291c16c86583f9f5280ed95da8f76ffcbe0fefec565d1833ded4ba1c", + "route_weight_sha256": "812f8a5642b1b3b257fe99700d344023b1547dd496d0c3c7cc5b7e7839fac327", + "loads": [ + 14, + 13, + 13, + 17, + 38, + 15, + 21, + 18, + 18, + 3, + 12, + 11, + 19, + 11, + 9, + 18, + 11, + 9, + 25, + 20, + 11, + 16, + 23, + 20, + 5, + 38, + 28, + 24, + 5, + 16, + 4, + 16, + 15, + 8, + 14, + 2, + 9, + 28, + 14, + 12, + 19, + 15, + 8, + 11, + 24, + 4, + 8, + 4, + 8, + 9, + 40, + 2, + 2, + 16, + 8, + 19, + 9, + 19, + 6, + 5, + 19, + 4, + 11, + 1 + ], + "weighted_loads": [ + 0.5241020321846008, + 0.46079544350504875, + 0.8130748867988586, + 1.0751807279884815, + 2.488558465614915, + 0.6341226678341627, + 2.446699960157275, + 0.9309402219951153, + 1.409095510840416, + 0.26902738958597183, + 0.5661734044551849, + 2.014904245734215, + 1.809381464496255, + 0.870589392259717, + 0.33231090381741524, + 1.0278422143310308, + 0.6055339071899652, + 0.8733508009463549, + 1.804519759491086, + 1.2814688179641962, + 0.41184796020388603, + 0.9022659510374069, + 1.2866854947060347, + 1.3117256872355938, + 0.28805481642484665, + 2.1073988042771816, + 1.0201705023646355, + 1.7256219573318958, + 0.32117117941379547, + 0.48136044293642044, + 0.139822730794549, + 0.5174773316830397, + 0.749844828620553, + 0.7876191455870867, + 0.6102112270891666, + 0.1783415861427784, + 0.32397179305553436, + 1.0490332413464785, + 0.9725052043795586, + 0.5410737581551075, + 0.8377219680696726, + 0.5715736225247383, + 0.4297117106616497, + 0.5387423783540726, + 1.4280931930989027, + 0.25061703100800514, + 0.5324841104447842, + 0.1548977866768837, + 0.31369582936167717, + 0.47410276904702187, + 3.9967971816658974, + 0.0697951503098011, + 0.07131274789571762, + 0.7571579478681087, + 0.43262379616498947, + 1.4077245071530342, + 0.33203338272869587, + 0.9837658796459436, + 0.21832584217190742, + 0.23113795928657055, + 1.9202277902513742, + 0.2524026334285736, + 0.530301271006465, + 0.02334163896739483 + ], + "unique_experts": 64, + "load_cv": 0.6162123256938081, + "normalized_load_entropy": 0.9549554770403587, + "max_load_share": 0.0447427293064877 + } + }, + "s0_x": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "b818dc0f423f7d7cb78c79e377bb2e4fd43a5839ba398ef8eaeadf5128fb4bfd", + "route_weight_sha256": "12bb626afd58a1364398ecd2c421be683b34496e2038917579e39eb6ea053cb9", + "loads": [ + 9, + 11, + 12, + 8, + 31, + 10, + 19, + 9, + 19, + 2, + 10, + 9, + 17, + 9, + 10, + 2, + 8, + 9, + 14, + 19, + 6, + 16, + 11, + 18, + 4, + 27, + 20, + 23, + 5, + 12, + 5, + 11, + 13, + 10, + 11, + 0, + 7, + 19, + 14, + 4, + 16, + 9, + 6, + 4, + 11, + 3, + 8, + 4, + 8, + 3, + 26, + 3, + 2, + 6, + 6, + 8, + 9, + 16, + 6, + 4, + 7, + 1, + 6, + 3 + ], + "weighted_loads": [ + 0.3082525935024023, + 0.38041785173118114, + 0.7658847868442535, + 0.35508223809301853, + 2.1659389697015285, + 0.3896928932517767, + 2.3591108042746782, + 0.3700984213501215, + 1.454403007403016, + 0.06350275874137878, + 0.48922876082360744, + 1.9390635713934898, + 1.7400025017559528, + 0.5510664116591215, + 0.31410024128854275, + 0.10111429542303085, + 0.43917475640773773, + 0.8226956017315388, + 0.7724178992211819, + 1.291918158531189, + 0.21487456932663918, + 0.8624663837254047, + 0.5754541009664536, + 1.103027567267418, + 0.2944204732775688, + 1.3351584449410439, + 0.7170462515205145, + 1.6927145794034004, + 0.3202232141047716, + 0.3981009777635336, + 0.18050090968608856, + 0.353197667747736, + 0.6435170080512762, + 0.8273637685924768, + 0.46833012998104095, + 0.0, + 0.2539014667272568, + 0.7565413806587458, + 0.6235872693359852, + 0.18451648950576782, + 0.6950952224433422, + 0.3388787768781185, + 0.24686672165989876, + 0.1783921830356121, + 0.6095310635864735, + 0.17247536033391953, + 0.5575479157269001, + 0.1733052246272564, + 0.3135779146105051, + 0.10742136463522911, + 2.508983790874481, + 0.1053297221660614, + 0.07359741255640984, + 0.31777709908783436, + 0.3544420562684536, + 0.3601650409400463, + 0.315859392285347, + 0.5671256706118584, + 0.2027732189744711, + 0.20609257370233536, + 0.4882989637553692, + 0.05146527290344238, + 0.3258701004087925, + 0.09182093478739262 + ], + "unique_experts": 63, + "load_cv": 0.6524548277394475, + "normalized_load_entropy": 0.9500973464009032, + "max_load_share": 0.047839506172839504 + }, + "full_input": { + "tokens": 133, + "top_k": 6, + "decisions": 798, + "ordered_route_sha256": "c4506fef5f63188624d752bd6af15f77fe3f6c25a5e163bb734b3a866a06b7bc", + "route_weight_sha256": "d71e694d04947641865f411e155ea83e01000a67b2cc59703cb53f50a50e38fa", + "loads": [ + 9, + 13, + 12, + 16, + 40, + 13, + 24, + 14, + 19, + 2, + 11, + 9, + 21, + 10, + 11, + 8, + 9, + 9, + 25, + 19, + 10, + 16, + 18, + 18, + 4, + 36, + 21, + 23, + 5, + 16, + 6, + 11, + 13, + 11, + 12, + 0, + 10, + 22, + 15, + 5, + 19, + 10, + 8, + 5, + 20, + 3, + 8, + 4, + 8, + 4, + 34, + 3, + 3, + 11, + 6, + 12, + 10, + 21, + 7, + 4, + 19, + 4, + 6, + 3 + ], + "weighted_loads": [ + 0.3082525935024023, + 0.44120705500245094, + 0.7658847868442535, + 0.9421634990721941, + 2.6880196072161198, + 0.4984925128519535, + 2.510586867108941, + 0.6702017616480589, + 1.454403007403016, + 0.06350275874137878, + 0.5252708699554205, + 1.9390635713934898, + 1.9158942457288504, + 0.5791090484708548, + 0.3510283101350069, + 0.4157547950744629, + 0.47528862208127975, + 0.8226956017315388, + 1.759597022086382, + 1.291918158531189, + 0.38132711686193943, + 0.8624663837254047, + 0.9369409047067165, + 1.103027567267418, + 0.2944204732775688, + 1.863075166940689, + 0.7344890758395195, + 1.6927145794034004, + 0.3202232141047716, + 0.5303093120455742, + 0.2338312268257141, + 0.353197667747736, + 0.6435170080512762, + 0.8504224736243486, + 0.5038548149168491, + 0.0, + 0.3348023872822523, + 0.8421690594404936, + 0.9882085211575031, + 0.24229014292359352, + 0.853674340993166, + 0.3801988884806633, + 0.4272148124873638, + 0.21527264639735222, + 0.9141071029007435, + 0.17247536033391953, + 0.5575479157269001, + 0.1733052246272564, + 0.3135779146105051, + 0.14551513642072678, + 3.533814188092947, + 0.1053297221660614, + 0.11141651123762131, + 0.5578051600605249, + 0.3544420562684536, + 0.7850312553346157, + 0.3594552278518677, + 0.7467020768672228, + 0.2408300917595625, + 0.20609257370233536, + 1.9433023147284985, + 0.26971688121557236, + 0.3258701004087925, + 0.09182093478739262 + ], + "unique_experts": 63, + "load_cv": 0.6570767082819017, + "normalized_load_entropy": 0.9504499104200002, + "max_load_share": 0.05012531328320802 + } + }, + "s1_x": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "59be5afc49d1c140f3e057183d74b79bc56ae0fb5f59273285ba95cc98726791", + "route_weight_sha256": "f3b1bee2425b8bdee9b5230e3aa75f9e6db79869659e39bbbbed7a29394dcdd8", + "loads": [ + 9, + 10, + 12, + 7, + 31, + 10, + 19, + 8, + 18, + 1, + 11, + 10, + 19, + 9, + 5, + 3, + 8, + 11, + 14, + 21, + 7, + 17, + 10, + 19, + 4, + 25, + 20, + 22, + 5, + 9, + 4, + 12, + 17, + 6, + 12, + 1, + 6, + 17, + 13, + 3, + 14, + 9, + 5, + 5, + 13, + 3, + 8, + 5, + 8, + 2, + 29, + 3, + 5, + 8, + 7, + 7, + 9, + 9, + 6, + 5, + 7, + 1, + 10, + 5 + ], + "weighted_loads": [ + 0.28877081722021103, + 0.3684127125889063, + 0.7615334074944258, + 0.3442603722214699, + 2.206188255921006, + 0.355037909001112, + 2.359988881275058, + 0.3297579251229763, + 1.411272119730711, + 0.030058279633522034, + 0.5098298117518425, + 2.034541267901659, + 1.8273388054221869, + 0.6201204657554626, + 0.16686054319143295, + 0.2119745947420597, + 0.408324284479022, + 0.9309626836329699, + 0.7934926748275757, + 1.36108404584229, + 0.2542153187096119, + 0.9510964285582304, + 0.5894994027912617, + 1.1183033846318722, + 0.25571098178625107, + 1.27075064368546, + 0.726660992950201, + 1.6925589106976986, + 0.30689483135938644, + 0.27519695088267326, + 0.14238366112113, + 0.4132141973823309, + 0.7634489238262177, + 0.7310385070741177, + 0.5068146735429764, + 0.03106701374053955, + 0.20354012958705425, + 0.7101970613002777, + 0.5972372367978096, + 0.15263906866312027, + 0.5876125898212194, + 0.3396453559398651, + 0.19764908775687218, + 0.21102654375135899, + 0.720818504691124, + 0.188322976231575, + 0.5382578168064356, + 0.20482276752591133, + 0.3068332504481077, + 0.05891705863177776, + 2.4428963512182236, + 0.1084495522081852, + 0.16118036583065987, + 0.36525955237448215, + 0.3904268480837345, + 0.30887371301651, + 0.310474157333374, + 0.3353138752281666, + 0.21505878120660782, + 0.24813736230134964, + 0.43500673584640026, + 0.05199975147843361, + 0.464974008500576, + 0.13625320047140121 + ], + "unique_experts": 64, + "load_cv": 0.6536218020715578, + "normalized_load_entropy": 0.9514634063851285, + "max_load_share": 0.047839506172839504 + }, + "full_input": { + "tokens": 149, + "top_k": 6, + "decisions": 894, + "ordered_route_sha256": "e25b2359d6068897e7f36e912d647cc2008b8a713ab7cf0f0dedf97562a29f56", + "route_weight_sha256": "17557a8cb804a3a3ddafe052a19bf5ddcd7acf7fbf6d4f5b574062e83a93914e", + "loads": [ + 13, + 11, + 12, + 19, + 41, + 18, + 22, + 17, + 18, + 3, + 13, + 10, + 22, + 10, + 6, + 17, + 14, + 11, + 25, + 22, + 11, + 19, + 21, + 21, + 6, + 39, + 21, + 25, + 5, + 13, + 4, + 13, + 18, + 6, + 14, + 3, + 9, + 24, + 15, + 7, + 19, + 11, + 7, + 9, + 27, + 4, + 8, + 5, + 8, + 6, + 42, + 3, + 5, + 16, + 8, + 18, + 11, + 17, + 7, + 6, + 20, + 3, + 11, + 5 + ], + "weighted_loads": [ + 0.48476606607437134, + 0.3925774432718754, + 0.7615334074944258, + 1.1391635239124298, + 2.7592969741672277, + 0.723968144506216, + 2.4699689839035273, + 0.8762160167098045, + 1.411272119730711, + 0.2638249397277832, + 0.605902686715126, + 2.034541267901659, + 1.9410206153988838, + 0.8999317288398743, + 0.2286638803780079, + 1.040429076179862, + 0.8434795625507832, + 0.9309626836329699, + 1.8822931721806526, + 1.3980771657079458, + 0.40795125253498554, + 1.0184617098420858, + 1.2193352282047272, + 1.289329994469881, + 0.3172680214047432, + 2.109674608334899, + 0.744103817269206, + 1.7881144545972347, + 0.30689483135938644, + 0.3848928362131119, + 0.14238366112113, + 0.4434562623500824, + 0.813086923211813, + 0.7310385070741177, + 0.5625622309744358, + 0.20940859988331795, + 0.30565813183784485, + 0.9570403769612312, + 1.002720184624195, + 0.35047607496380806, + 0.8243739753961563, + 0.43748684599995613, + 0.35468460246920586, + 0.3977773915976286, + 1.5718843452632427, + 0.26170579344034195, + 0.5382578168064356, + 0.20482276752591133, + 0.3068332504481077, + 0.2976230215281248, + 4.084127701818943, + 0.1084495522081852, + 0.16118036583065987, + 0.708857411518693, + 0.4214967004954815, + 1.3287431746721268, + 0.3975539468228817, + 0.9172668512910604, + 0.250200841575861, + 0.2763655949383974, + 1.9648810178041458, + 0.1769111528992653, + 0.5268488526344299, + 0.13625320047140121 + ], + "unique_experts": 64, + "load_cv": 0.6277988495391545, + "normalized_load_entropy": 0.9558677553330044, + "max_load_share": 0.04697986577181208 + } + }, + "s0_period": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "d44d47e7ae87035729d4477d45176c3c42a599330ffe9fd4462b08261630246b", + "route_weight_sha256": "4521293ba157b5fd147f1ec65904d7a63157c37a145cd4973a79a834361ba776", + "loads": [ + 11, + 10, + 13, + 6, + 30, + 10, + 20, + 9, + 19, + 2, + 10, + 11, + 18, + 8, + 8, + 3, + 8, + 9, + 14, + 19, + 5, + 17, + 10, + 18, + 4, + 26, + 20, + 22, + 5, + 12, + 5, + 13, + 13, + 10, + 12, + 1, + 6, + 18, + 13, + 5, + 17, + 8, + 6, + 5, + 12, + 3, + 7, + 4, + 8, + 1, + 26, + 3, + 2, + 7, + 6, + 8, + 7, + 14, + 7, + 5, + 7, + 1, + 6, + 5 + ], + "weighted_loads": [ + 0.36555990390479565, + 0.35702911764383316, + 0.7886093333363533, + 0.29422977939248085, + 2.1587636172771454, + 0.36821542866528034, + 2.398269034922123, + 0.37147224321961403, + 1.4311338737607002, + 0.0657118521630764, + 0.4875571243464947, + 1.895350594073534, + 1.8091454859822989, + 0.5167593657970428, + 0.2860008031129837, + 0.1386961117386818, + 0.42506882175803185, + 0.8319922648370266, + 0.7776608541607857, + 1.3048169147223234, + 0.18560739047825336, + 0.890163742005825, + 0.5434400402009487, + 1.1200256794691086, + 0.2877046465873718, + 1.3823459707200527, + 0.7290071621537209, + 1.652783613651991, + 0.32250875793397427, + 0.38638939522206783, + 0.1801547259092331, + 0.41703036427497864, + 0.6577586103230715, + 0.8207703270018101, + 0.506000179797411, + 0.02856622077524662, + 0.22377687692642212, + 0.7385085113346577, + 0.5954439826309681, + 0.221555070951581, + 0.723730307072401, + 0.29896179027855396, + 0.24046699330210686, + 0.20982665196061134, + 0.65041976980865, + 0.1820080764591694, + 0.5275781247764826, + 0.16096241027116776, + 0.3153885789215565, + 0.03616250678896904, + 2.5649942252784967, + 0.10179516673088074, + 0.06021173298358917, + 0.3293002415448427, + 0.35473524406552315, + 0.3597839027643204, + 0.25387561321258545, + 0.5099716857075691, + 0.23933272622525692, + 0.24208656512200832, + 0.4888368174433708, + 0.05665511637926102, + 0.32706743106245995, + 0.1333096120506525 + ], + "unique_experts": 64, + "load_cv": 0.6420940061207824, + "normalized_load_entropy": 0.9519931122357039, + "max_load_share": 0.046296296296296294 + }, + "full_input": { + "tokens": 133, + "top_k": 6, + "decisions": 798, + "ordered_route_sha256": "e3fe5b8860092c30b84b31fe11925409548bf6fd8ba30862d8121b88bcbb0bd3", + "route_weight_sha256": "37c6bd7d4a775172eaa6cf018321fe6a4a896931f45b27d9f6df80df27f4046f", + "loads": [ + 11, + 12, + 13, + 14, + 39, + 13, + 25, + 15, + 20, + 2, + 11, + 11, + 22, + 8, + 8, + 9, + 9, + 9, + 24, + 19, + 10, + 17, + 17, + 18, + 4, + 36, + 21, + 22, + 5, + 15, + 6, + 13, + 13, + 11, + 13, + 1, + 8, + 21, + 15, + 7, + 19, + 9, + 8, + 6, + 22, + 3, + 7, + 4, + 8, + 2, + 35, + 3, + 3, + 12, + 6, + 11, + 8, + 18, + 8, + 5, + 18, + 5, + 6, + 5 + ], + "weighted_loads": [ + 0.36555990390479565, + 0.42423137091100216, + 0.7886093333363533, + 0.8813110403716564, + 2.6085798777639866, + 0.47701504826545715, + 2.5666771456599236, + 0.8329258412122726, + 1.4743503704667091, + 0.0657118521630764, + 0.5242368839681149, + 1.895350594073534, + 1.9980619102716446, + 0.5167593657970428, + 0.2860008031129837, + 0.43779622204601765, + 0.46118268743157387, + 0.8319922648370266, + 1.66591215133667, + 1.3048169147223234, + 0.40536734461784363, + 0.890163742005825, + 0.9124777242541313, + 1.1200256794691086, + 0.2877046465873718, + 1.9582182578742504, + 0.7464499864727259, + 1.652783613651991, + 0.32250875793397427, + 0.48828936740756035, + 0.23356131091713905, + 0.41703036427497864, + 0.6577586103230715, + 0.8438290320336819, + 0.5408399812877178, + 0.02856622077524662, + 0.2707889210432768, + 0.8241361901164055, + 0.9857468865811825, + 0.3241014126688242, + 0.87104856595397, + 0.34028190188109875, + 0.4187041185796261, + 0.24670711532235146, + 0.9989909548312426, + 0.1820080764591694, + 0.5275781247764826, + 0.16096241027116776, + 0.3153885789215565, + 0.09443388134241104, + 3.627856718376279, + 0.10179516673088074, + 0.09424280375242233, + 0.5705131944268942, + 0.35473524406552315, + 0.7393360175192356, + 0.3022625260055065, + 0.632494555786252, + 0.2773895990103483, + 0.24208656512200832, + 1.7584386095404625, + 0.32344403862953186, + 0.32706743106245995, + 0.1333096120506525 + ], + "unique_experts": 64, + "load_cv": 0.6489195644700526, + "normalized_load_entropy": 0.952561906583854, + "max_load_share": 0.04887218045112782 + } + }, + "s1_period": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "4626d6dde4c0fd44f2683d7b2bbe6360382255c47a86b1ae95eeb1b630c811d7", + "route_weight_sha256": "52b45afdf4f538eae8c8629d58a00336fb4bd4b2bd0894c4747aadb577ffca69", + "loads": [ + 8, + 12, + 13, + 7, + 32, + 11, + 19, + 9, + 19, + 1, + 10, + 10, + 19, + 9, + 6, + 3, + 7, + 10, + 14, + 21, + 6, + 16, + 10, + 18, + 4, + 27, + 19, + 21, + 5, + 10, + 3, + 18, + 14, + 7, + 10, + 1, + 5, + 16, + 16, + 4, + 14, + 10, + 5, + 4, + 14, + 3, + 8, + 5, + 8, + 2, + 28, + 2, + 3, + 7, + 7, + 7, + 7, + 11, + 7, + 5, + 7, + 1, + 10, + 3 + ], + "weighted_loads": [ + 0.2620364371687174, + 0.4283543862402439, + 0.7993147596716881, + 0.33995814435184, + 2.259720850735903, + 0.3933158256113529, + 2.3837051652371883, + 0.357618261128664, + 1.4338887725025415, + 0.02881745994091034, + 0.501849764958024, + 1.8967502377927303, + 1.8495880458503962, + 0.6603447273373604, + 0.20327381789684296, + 0.16786564700305462, + 0.3781728222966194, + 0.8803427796810865, + 0.7982883490622044, + 1.3702153954654932, + 0.21823453903198242, + 0.9068568423390388, + 0.5326018445193768, + 1.1172188594937325, + 0.26260799169540405, + 1.4889751859009266, + 0.6985270325094461, + 1.6617372184991837, + 0.30970948189496994, + 0.29104447551071644, + 0.1105312742292881, + 0.5787841491401196, + 0.689171439036727, + 0.7566722724586725, + 0.4344482999294996, + 0.02923848107457161, + 0.18274489231407642, + 0.6535714752972126, + 0.7006774488836527, + 0.18691691383719444, + 0.585502602159977, + 0.3736946154385805, + 0.1956910453736782, + 0.1877385564148426, + 0.7336994465440512, + 0.18460467085242271, + 0.5143400449305773, + 0.21487784758210182, + 0.30877604335546494, + 0.05913153477013111, + 2.5550444088876247, + 0.07356374338269234, + 0.10353365913033485, + 0.3413013406097889, + 0.39369602128863335, + 0.2947190999984741, + 0.2515736538916826, + 0.40097684413194656, + 0.2441181093454361, + 0.24720017611980438, + 0.4605139456689358, + 0.05680511146783829, + 0.44819386675953865, + 0.09449790231883526 + ], + "unique_experts": 64, + "load_cv": 0.6708828725527667, + "normalized_load_entropy": 0.9482599520254366, + "max_load_share": 0.04938271604938271 + }, + "full_input": { + "tokens": 149, + "top_k": 6, + "decisions": 894, + "ordered_route_sha256": "d7b85c016a422be4fdb1417b709ef986326a22183fdaaff68944c1fa58e23e27", + "route_weight_sha256": "eea4b5e0d1807e6ff6a0998f4161da78d2a11b695acd303dac2705972da32baf", + "loads": [ + 12, + 13, + 13, + 18, + 41, + 18, + 22, + 19, + 19, + 3, + 13, + 10, + 23, + 10, + 7, + 14, + 12, + 10, + 24, + 22, + 11, + 17, + 21, + 20, + 5, + 41, + 20, + 23, + 5, + 14, + 3, + 19, + 15, + 7, + 11, + 3, + 8, + 26, + 18, + 9, + 21, + 12, + 7, + 8, + 27, + 4, + 8, + 5, + 8, + 7, + 41, + 2, + 4, + 16, + 8, + 19, + 8, + 18, + 8, + 6, + 20, + 4, + 11, + 3 + ], + "weighted_loads": [ + 0.4580316860228777, + 0.452519116923213, + 0.7993147596716881, + 1.102947300300002, + 2.7059522047638893, + 0.7046790234744549, + 2.4978110268712044, + 0.9991229325532913, + 1.4338887725025415, + 0.2625841200351715, + 0.6210370473563671, + 1.8967502377927303, + 2.0234472155570984, + 0.940155990421772, + 0.2650771550834179, + 0.9050809238106012, + 0.6782478671520948, + 0.8803427796810865, + 1.777514073997736, + 1.407208515331149, + 0.42076307348906994, + 0.9441313818097115, + 1.1510695070028305, + 1.2882454693317413, + 0.28228676319122314, + 2.361215475946665, + 0.7159698568284512, + 1.7229787074029446, + 0.30970948189496994, + 0.40074036084115505, + 0.1105312742292881, + 0.6090262141078711, + 0.7388094384223223, + 0.7566722724586725, + 0.46247609704732895, + 0.20758006721735, + 0.284862894564867, + 1.0218305382877588, + 1.1061603967100382, + 0.43404754996299744, + 0.9007473345845938, + 0.47526839561760426, + 0.34406621381640434, + 0.3744894042611122, + 1.545540301129222, + 0.25798748806118965, + 0.5143400449305773, + 0.21487784758210182, + 0.30877604335546494, + 0.38258557952940464, + 4.219650350511074, + 0.07356374338269234, + 0.13406923972070217, + 0.7190870698541403, + 0.4247658737003803, + 1.3323394507169724, + 0.2966769877821207, + 0.9370727110654116, + 0.27926016971468925, + 0.27542840875685215, + 1.9375654626637697, + 0.22481292858719826, + 0.5100687108933926, + 0.09449790231883526 + ], + "unique_experts": 64, + "load_cv": 0.6372933911766603, + "normalized_load_entropy": 0.9540880372358879, + "max_load_share": 0.04586129753914989 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 108, + "ordered_topk_exact_tokens": 54, + "set_exact_tokens": 69, + "mean_set_jaccard": 0.8908730158730159, + "mean_token_weighted_tv": 0.021074645203986653, + "aggregate_load_tv": 0.037037037037037035 + }, + "system_bos": { + "tokens": 108, + "ordered_topk_exact_tokens": 40, + "set_exact_tokens": 55, + "mean_set_jaccard": 0.851851851851852, + "mean_token_weighted_tv": 0.02582569712669485, + "aggregate_load_tv": 0.04783950617283951 + }, + "system_x": { + "tokens": 108, + "ordered_topk_exact_tokens": 29, + "set_exact_tokens": 53, + "mean_set_jaccard": 0.8193121693121694, + "mean_token_weighted_tv": 0.03690065002862226, + "aggregate_load_tv": 0.06018518518518519 + }, + "system_period": { + "tokens": 108, + "ordered_topk_exact_tokens": 27, + "set_exact_tokens": 48, + "mean_set_jaccard": 0.8258377425044091, + "mean_token_weighted_tv": 0.03415958368633357, + "aggregate_load_tv": 0.05709876543209877 + }, + "bos_at_s0": { + "tokens": 108, + "ordered_topk_exact_tokens": 41, + "set_exact_tokens": 61, + "mean_set_jaccard": 0.8606701940035274, + "mean_token_weighted_tv": 0.025929970304585166, + "aggregate_load_tv": 0.046296296296296294 + }, + "bos_at_s1": { + "tokens": 108, + "ordered_topk_exact_tokens": 39, + "set_exact_tokens": 54, + "mean_set_jaccard": 0.8373015873015873, + "mean_token_weighted_tv": 0.031055964520890957, + "aggregate_load_tv": 0.050925925925925916 + }, + "x_at_s0": { + "tokens": 108, + "ordered_topk_exact_tokens": 39, + "set_exact_tokens": 55, + "mean_set_jaccard": 0.8423721340388007, + "mean_token_weighted_tv": 0.031021725455368007, + "aggregate_load_tv": 0.05092592592592593 + }, + "x_at_s1": { + "tokens": 108, + "ordered_topk_exact_tokens": 27, + "set_exact_tokens": 46, + "mean_set_jaccard": 0.8028699695366363, + "mean_token_weighted_tv": 0.03807606231593699, + "aggregate_load_tv": 0.07716049382716049 + }, + "period_at_s0": { + "tokens": 108, + "ordered_topk_exact_tokens": 39, + "set_exact_tokens": 57, + "mean_set_jaccard": 0.8476631393298061, + "mean_token_weighted_tv": 0.03029552259034029, + "aggregate_load_tv": 0.0478395061728395 + }, + "period_at_s1": { + "tokens": 108, + "ordered_topk_exact_tokens": 29, + "set_exact_tokens": 47, + "mean_set_jaccard": 0.8117283950617284, + "mean_token_weighted_tv": 0.03918097953795007, + "aggregate_load_tv": 0.06481481481481481 + } + } + }, + "layer_21": { + "layer": 21, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "426dc48c6ceab46bc3c67992dbd46cc7990e091e4e9b2c8f95bd671ec3ece684", + "route_weight_sha256": "23b91c4ddf87a2ed146fc70b9bade2aeaf09469bed1cc0a9d237ef8d1ff2a450", + "loads": [ + 4, + 7, + 1, + 20, + 18, + 20, + 9, + 16, + 14, + 1, + 7, + 5, + 11, + 3, + 1, + 9, + 12, + 6, + 9, + 21, + 3, + 4, + 7, + 5, + 1, + 39, + 10, + 13, + 9, + 7, + 8, + 4, + 3, + 10, + 1, + 17, + 6, + 0, + 13, + 7, + 6, + 18, + 14, + 11, + 30, + 13, + 8, + 7, + 25, + 14, + 3, + 10, + 12, + 41, + 3, + 12, + 12, + 5, + 9, + 4, + 9, + 13, + 0, + 8 + ], + "weighted_loads": [ + 0.17500023171305656, + 0.2528801504522562, + 0.07363598048686981, + 1.2208064459264278, + 0.789408640936017, + 0.8064832109957933, + 0.4295092411339283, + 1.6021662577986717, + 0.5131533201783895, + 0.056780461221933365, + 0.2681814506649971, + 0.17975610680878162, + 0.540577407926321, + 0.13849516585469246, + 0.041498370468616486, + 0.34106030128896236, + 0.45332320407032967, + 0.22201308608055115, + 0.33897447772324085, + 0.7219067960977554, + 0.12215983681380749, + 0.1384467426687479, + 0.31098086573183537, + 0.26787509210407734, + 0.041209474205970764, + 2.5679198876023293, + 0.6142347063869238, + 0.8998761922121048, + 0.3422665372490883, + 0.4337342157959938, + 0.32554528675973415, + 0.1531026978045702, + 0.10340975224971771, + 0.411586944013834, + 0.048799484968185425, + 1.166106078773737, + 0.5016592405736446, + 0.0, + 0.9811741188168526, + 0.2421782035380602, + 0.21039526537060738, + 1.6153494119644165, + 0.9995099175721407, + 0.7838233187794685, + 2.3323329724371433, + 0.48710969276726246, + 0.41303183510899544, + 0.2556537538766861, + 1.296819169074297, + 0.6613190062344074, + 0.15115665830671787, + 0.6817163228988647, + 0.6716400422155857, + 2.6091543454676867, + 0.11453861743211746, + 0.7594424076378345, + 0.6200884468853474, + 0.25603580474853516, + 0.3319241087883711, + 0.1769417431205511, + 0.3496424965560436, + 0.528170146048069, + 0.0, + 0.5144401229918003 + ], + "unique_experts": 62, + "load_cv": 0.8049344845779279, + "normalized_load_entropy": 0.9300454092572507, + "max_load_share": 0.06327160493827161 + }, + "full_input": { + "tokens": 133, + "top_k": 6, + "decisions": 798, + "ordered_route_sha256": "7cae6a5e0243472d01df1ad80380ea769c55ade412f44a708042f18645d58725", + "route_weight_sha256": "ae53dd9c67d0bf89df705d47244bc1c7d6d77afe1dcd84ebde899650f09a51db", + "loads": [ + 4, + 7, + 4, + 20, + 25, + 20, + 12, + 16, + 16, + 1, + 14, + 5, + 13, + 7, + 3, + 15, + 13, + 10, + 11, + 26, + 3, + 14, + 7, + 6, + 1, + 40, + 19, + 18, + 12, + 7, + 9, + 4, + 4, + 11, + 3, + 26, + 6, + 0, + 13, + 7, + 8, + 18, + 18, + 11, + 30, + 13, + 8, + 7, + 36, + 17, + 3, + 17, + 22, + 42, + 9, + 13, + 13, + 5, + 14, + 5, + 10, + 13, + 6, + 8 + ], + "weighted_loads": [ + 0.17500023171305656, + 0.2528801504522562, + 0.1466382450889796, + 1.2208064459264278, + 1.0547386761754751, + 0.8064832109957933, + 0.7006700187921524, + 1.6021662577986717, + 0.648409167304635, + 0.056780461221933365, + 0.6472031511366367, + 0.17975610680878162, + 0.6521557979285717, + 0.4128260165452957, + 0.11593878827989101, + 0.5561158712953329, + 0.4665608648210764, + 0.3426293022930622, + 0.41710173338651657, + 2.3255964294075966, + 0.12215983681380749, + 0.6696348013356328, + 0.31098086573183537, + 0.31077405996620655, + 0.041209474205970764, + 2.6029052659869194, + 1.0158301200717688, + 1.3287465386092663, + 0.40469875652343035, + 0.4337342157959938, + 0.3705634791404009, + 0.1531026978045702, + 0.12628648057579994, + 0.455160167068243, + 0.128790944814682, + 1.7117141783237457, + 0.5016592405736446, + 0.0, + 0.9811741188168526, + 0.2421782035380602, + 0.2999545969069004, + 1.6153494119644165, + 1.2249704021960497, + 0.7838233187794685, + 2.3323329724371433, + 0.48710969276726246, + 0.41303183510899544, + 0.2556537538766861, + 1.8848530389368534, + 0.8869337365031242, + 0.15115665830671787, + 1.0080608017742634, + 1.3111028596758842, + 2.6221612598747015, + 0.36723015271127224, + 0.9319157190620899, + 0.661092359572649, + 0.25603580474853516, + 0.5139176603406668, + 0.21964739076793194, + 0.37193818390369415, + 0.528170146048069, + 0.3195297494530678, + 0.5144401229918003 + ], + "unique_experts": 63, + "load_cv": 0.7141010182000306, + "normalized_load_entropy": 0.9429064845791998, + "max_load_share": 0.05263157894736842 + } + }, + "s1_eos": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "10f8c4181db2b23ee7a305b9322514d9045a6f375d469d682a6f059e6ca5ff9a", + "route_weight_sha256": "2419576dc347d1ec2eb437fa9842c4d27173a0cd7ca544d5797d16f53adab1ba", + "loads": [ + 5, + 8, + 1, + 19, + 19, + 21, + 9, + 18, + 11, + 1, + 9, + 5, + 11, + 3, + 1, + 8, + 11, + 6, + 9, + 20, + 3, + 3, + 6, + 5, + 1, + 35, + 10, + 13, + 8, + 6, + 10, + 3, + 3, + 9, + 3, + 18, + 5, + 0, + 13, + 6, + 8, + 18, + 14, + 10, + 30, + 11, + 8, + 8, + 27, + 14, + 2, + 10, + 11, + 43, + 4, + 12, + 14, + 5, + 9, + 3, + 11, + 11, + 2, + 8 + ], + "weighted_loads": [ + 0.21746250987052917, + 0.28256038948893547, + 0.06887997686862946, + 1.2846067491918802, + 0.8103377837687731, + 0.8738942872732878, + 0.4368073418736458, + 1.657530378550291, + 0.42102475836873055, + 0.053885120898485184, + 0.34898990765213966, + 0.17701530829071999, + 0.5323843881487846, + 0.14880038052797318, + 0.04416395723819733, + 0.31642825715243816, + 0.4163308870047331, + 0.2396620400249958, + 0.3420174568891525, + 0.698154628276825, + 0.13059379160404205, + 0.09466904401779175, + 0.273616511374712, + 0.2708579748868942, + 0.0408674031496048, + 2.4219863936305046, + 0.6540290266275406, + 0.9541321024298668, + 0.2994475308805704, + 0.40560974553227425, + 0.3777908254414797, + 0.10876883566379547, + 0.0952239241451025, + 0.35125166922807693, + 0.11202359385788441, + 1.1744122579693794, + 0.4491677023470402, + 0.0, + 0.9784822296351194, + 0.21824031695723534, + 0.27519010938704014, + 1.5846560262143612, + 0.9903146177530289, + 0.7527406103909016, + 2.3333256877958775, + 0.4317964967340231, + 0.4251512251794338, + 0.2959294803440571, + 1.3687530886381865, + 0.6704148389399052, + 0.12167289108037949, + 0.70655931904912, + 0.622627854347229, + 2.701401675119996, + 0.15407761745154858, + 0.7140590958297253, + 0.703930614516139, + 0.23119167611002922, + 0.3190493620932102, + 0.15169579908251762, + 0.41601276211440563, + 0.45687344297766685, + 0.05492323450744152, + 0.5044697392731905 + ], + "unique_experts": 63, + "load_cv": 0.8007579095398284, + "normalized_load_entropy": 0.9321229475888924, + "max_load_share": 0.06635802469135803 + }, + "full_input": { + "tokens": 149, + "top_k": 6, + "decisions": 894, + "ordered_route_sha256": "33d94d07ac1fc99ef928c1299785ab25fcc911c1f61c6f0d937e362786fee660", + "route_weight_sha256": "e900083baa0aa5d990816e944145629c748089c35d8c3becd675363d7212b710", + "loads": [ + 13, + 9, + 4, + 19, + 19, + 21, + 14, + 19, + 15, + 3, + 19, + 5, + 15, + 13, + 8, + 12, + 12, + 16, + 13, + 24, + 4, + 15, + 8, + 10, + 2, + 37, + 18, + 23, + 11, + 7, + 14, + 3, + 4, + 13, + 3, + 34, + 6, + 1, + 14, + 7, + 9, + 20, + 22, + 11, + 31, + 12, + 8, + 8, + 38, + 18, + 3, + 20, + 21, + 45, + 17, + 20, + 18, + 5, + 13, + 7, + 12, + 12, + 8, + 9 + ], + "weighted_loads": [ + 0.7305920496582985, + 0.33105244114995, + 0.765869953436777, + 1.2846067491918802, + 0.8103377837687731, + 0.8738942872732878, + 0.6661384403705597, + 1.7404343523085117, + 0.5718366317451, + 0.19950056448578835, + 0.8473394438624382, + 0.17701530829071999, + 0.7422517910599709, + 0.6629846207797527, + 0.3141872398555279, + 0.4803430549800396, + 0.4295685477554798, + 0.578665504232049, + 0.47101082652807236, + 2.2400425001978874, + 0.17794686183333397, + 0.7081397953443229, + 0.3324743192642927, + 0.7576193511486053, + 0.07658674567937851, + 2.4936466552317142, + 0.9385946951806545, + 1.8490273728966713, + 0.3347940417006612, + 0.4544656537473202, + 0.5474474262446165, + 0.10876883566379547, + 0.11796712316572666, + 0.9489462152123451, + 0.11202359385788441, + 2.0644142106175423, + 0.5201586522161961, + 0.040625572204589844, + 1.0353403519839048, + 0.25649479031562805, + 0.3143238443881273, + 1.712076112627983, + 1.388105621561408, + 0.7973090894520283, + 2.397075306624174, + 0.489653991535306, + 0.4251512251794338, + 0.2959294803440571, + 2.171263789758086, + 1.6419192664325237, + 0.17365306243300438, + 1.4246882610023022, + 1.214144043624401, + 2.746823338791728, + 0.9320480562746525, + 1.2803669534623623, + 0.8630753271281719, + 0.23119167611002922, + 0.4884448517113924, + 0.3492869511246681, + 0.43839889764785767, + 0.5202155821025372, + 0.3558212872594595, + 0.5933064240962267 + ], + "unique_experts": 64, + "load_cv": 0.642424421411617, + "normalized_load_entropy": 0.9531291811517214, + "max_load_share": 0.050335570469798654 + } + }, + "s0_bos": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "d043227a4592bf4b30e6af05426c7d05239bc27f2aca89233f1a8bf3f0a4721e", + "route_weight_sha256": "93ea9c45dab92abd26bfa6e020c9d7a9d7cfca96393f5f7a4bb0d3775bdad749", + "loads": [ + 4, + 7, + 1, + 18, + 17, + 22, + 9, + 19, + 16, + 1, + 8, + 4, + 12, + 3, + 1, + 9, + 12, + 6, + 6, + 17, + 3, + 5, + 6, + 4, + 1, + 39, + 11, + 14, + 10, + 7, + 8, + 4, + 3, + 9, + 1, + 16, + 5, + 0, + 12, + 7, + 7, + 19, + 13, + 12, + 30, + 12, + 8, + 6, + 24, + 16, + 3, + 10, + 9, + 42, + 5, + 12, + 11, + 5, + 10, + 3, + 10, + 13, + 2, + 9 + ], + "weighted_loads": [ + 0.19194966182112694, + 0.26335130631923676, + 0.07270802557468414, + 1.1068847570568323, + 0.7711279504001141, + 0.8831019811332226, + 0.4492436908185482, + 1.6620414219796658, + 0.5963890161365271, + 0.051923882216215134, + 0.30385197699069977, + 0.1585186868906021, + 0.5792043618857861, + 0.14284439384937286, + 0.043672289699316025, + 0.3499658741056919, + 0.4527537655085325, + 0.2393413409590721, + 0.2519632950425148, + 0.5969515964388847, + 0.1445586420595646, + 0.16682862117886543, + 0.29386448487639427, + 0.24105897545814514, + 0.043471552431583405, + 2.6278401017189026, + 0.6822080034762621, + 0.8470085598528385, + 0.37097361497581005, + 0.4141514729708433, + 0.3110138587653637, + 0.1397989895194769, + 0.10581925138831139, + 0.38002315536141396, + 0.04547152668237686, + 1.1381881013512611, + 0.44819000363349915, + 0.0, + 0.9339434504508972, + 0.25159684382379055, + 0.2443347182124853, + 1.6927514523267746, + 0.9437239971011877, + 0.8237754590809345, + 2.431261073797941, + 0.4456542953848839, + 0.43515537679195404, + 0.2204709704965353, + 1.260062213987112, + 0.7304567415267229, + 0.16876108944416046, + 0.6977428533136845, + 0.5430622734129429, + 2.6217127833515406, + 0.20132258161902428, + 0.7474506571888924, + 0.5715382695198059, + 0.2478162683546543, + 0.35191860049963, + 0.14286363497376442, + 0.388772327452898, + 0.5227741356939077, + 0.06569866091012955, + 0.5424827374517918 + ], + "unique_experts": 63, + "load_cv": 0.8068257806170126, + "normalized_load_entropy": 0.9312466189803719, + "max_load_share": 0.06481481481481481 + }, + "full_input": { + "tokens": 133, + "top_k": 6, + "decisions": 798, + "ordered_route_sha256": "a041fb6775f6659ac2dbedf2debabeb3945c10ec318789d59dbbd54425b03b93", + "route_weight_sha256": "09bc09d32029f6c09d59cc22e24329b81050ed85e648902eefb8be08cadd43f0", + "loads": [ + 4, + 8, + 3, + 19, + 22, + 22, + 11, + 19, + 19, + 1, + 14, + 4, + 14, + 7, + 4, + 14, + 13, + 10, + 8, + 20, + 3, + 14, + 6, + 5, + 1, + 40, + 20, + 19, + 12, + 7, + 9, + 7, + 4, + 10, + 2, + 25, + 5, + 0, + 12, + 11, + 10, + 19, + 16, + 12, + 30, + 14, + 8, + 6, + 36, + 19, + 3, + 17, + 19, + 43, + 10, + 13, + 12, + 5, + 13, + 4, + 11, + 13, + 8, + 9 + ], + "weighted_loads": [ + 0.19194966182112694, + 0.30414389818906784, + 0.14320795238018036, + 1.323061103001237, + 0.9642350673675537, + 0.8831019811332226, + 0.6516082361340523, + 1.6620414219796658, + 0.7543770503252745, + 0.051923882216215134, + 0.6165441535413265, + 0.1585186868906021, + 0.6907827518880367, + 0.39057889208197594, + 0.15590795688331127, + 0.5584654211997986, + 0.46599142625927925, + 0.3861215692013502, + 0.3542339503765106, + 1.2212256789207458, + 0.1445586420595646, + 0.68749925121665, + 0.29386448487639427, + 0.28395794332027435, + 0.043471552431583405, + 2.6628254801034927, + 1.083803417161107, + 1.254794780164957, + 0.42898581083863974, + 0.4141514729708433, + 0.34816522523760796, + 0.3842896092683077, + 0.12869597971439362, + 0.42156798020005226, + 0.094411700963974, + 1.68379620090127, + 0.44819000363349915, + 0.0, + 0.9339434504508972, + 0.4015980549156666, + 0.41987122036516666, + 1.6927514523267746, + 1.134402459487319, + 0.8237754590809345, + 2.431261073797941, + 0.5987064316868782, + 0.43515537679195404, + 0.2204709704965353, + 1.8810716196894646, + 0.9586296435445547, + 0.16876108944416046, + 1.024087332189083, + 1.1825250908732414, + 2.6347196977585554, + 0.3832849692553282, + 0.9199239686131477, + 0.6125421822071075, + 0.2478162683546543, + 0.43999693915247917, + 0.18556928262114525, + 0.41106801480054855, + 0.5227741356939077, + 0.41204535588622093, + 0.5424827374517918 + ], + "unique_experts": 63, + "load_cv": 0.7074553606800777, + "normalized_load_entropy": 0.9435160131846859, + "max_load_share": 0.05388471177944862 + } + }, + "s1_bos": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "227334d57e74291c465821d6c5ec2a9e83ffd4e6e2fe884f5ce03a29f8265ff7", + "route_weight_sha256": "a755fbd066b6beea0c74142de20dad7df9c1a8ca596509fa4410ca50184dbec7", + "loads": [ + 5, + 7, + 1, + 18, + 19, + 15, + 11, + 19, + 13, + 1, + 8, + 5, + 12, + 3, + 1, + 10, + 11, + 6, + 5, + 21, + 3, + 3, + 6, + 4, + 1, + 38, + 10, + 14, + 10, + 7, + 10, + 2, + 2, + 9, + 1, + 16, + 6, + 0, + 13, + 7, + 8, + 19, + 15, + 11, + 30, + 10, + 8, + 7, + 26, + 15, + 5, + 10, + 8, + 43, + 5, + 11, + 13, + 5, + 9, + 4, + 10, + 12, + 2, + 9 + ], + "weighted_loads": [ + 0.23029767721891403, + 0.2532597500830889, + 0.07179024070501328, + 1.2623966298997402, + 0.8313820511102676, + 0.6439836453646421, + 0.5339633971452713, + 1.7213986646384, + 0.4927824530750513, + 0.04768190532922745, + 0.30305521190166473, + 0.18406725116074085, + 0.5155836790800095, + 0.1497606299817562, + 0.046750422567129135, + 0.38873231038451195, + 0.41344670578837395, + 0.242348937317729, + 0.21665646135807037, + 0.732240229845047, + 0.13509699515998363, + 0.10804343596100807, + 0.2732268422842026, + 0.23361944779753685, + 0.043400175869464874, + 2.6184201035648584, + 0.6820521391928196, + 0.850524365901947, + 0.384042177349329, + 0.4368320982903242, + 0.38435822539031506, + 0.07500322535634041, + 0.07151879370212555, + 0.3567781951278448, + 0.046708788722753525, + 1.134668467566371, + 0.486856073141098, + 0.0, + 0.9551781862974167, + 0.2557093631476164, + 0.2741806376725435, + 1.6560251042246819, + 1.0603956058621407, + 0.8175347447395325, + 2.397632410749793, + 0.39232502318918705, + 0.4144091308116913, + 0.2571219354867935, + 1.3686097972095013, + 0.7194970976561308, + 0.21860734187066555, + 0.6825285404920578, + 0.4809516370296478, + 2.682796623557806, + 0.19792359322309494, + 0.6793715246021748, + 0.6520302090793848, + 0.25635354965925217, + 0.3217798247933388, + 0.18109813705086708, + 0.4040131773799658, + 0.4754156358540058, + 0.06592319905757904, + 0.5393638387322426 + ], + "unique_experts": 63, + "load_cv": 0.8087126535882626, + "normalized_load_entropy": 0.9310081896540284, + "max_load_share": 0.06635802469135803 + }, + "full_input": { + "tokens": 149, + "top_k": 6, + "decisions": 894, + "ordered_route_sha256": "67b9cd6e73b1588c53916ececa24080bcfbfbb906cc2a9dc8ec2f5c1f8820bfd", + "route_weight_sha256": "6573215cae3495546a78c285628d26edbac4cdff24f167b74d617c2a5e18d940", + "loads": [ + 13, + 8, + 3, + 18, + 22, + 15, + 16, + 21, + 17, + 3, + 16, + 6, + 16, + 12, + 7, + 14, + 12, + 13, + 9, + 24, + 4, + 12, + 8, + 9, + 2, + 40, + 18, + 25, + 12, + 8, + 14, + 4, + 3, + 14, + 2, + 32, + 7, + 1, + 14, + 8, + 11, + 21, + 23, + 12, + 31, + 12, + 8, + 7, + 37, + 20, + 6, + 20, + 18, + 44, + 18, + 19, + 18, + 5, + 11, + 8, + 11, + 13, + 9, + 10 + ], + "weighted_loads": [ + 0.7434272170066833, + 0.30175180174410343, + 0.766102371737361, + 1.2623966298997402, + 0.9389684125781059, + 0.6439836453646421, + 0.8033334016799927, + 1.8411067929118872, + 0.6502737272530794, + 0.1932973489165306, + 0.7265530452132225, + 0.23815756104886532, + 0.7254510819911957, + 0.6048943549394608, + 0.2873603105545044, + 0.5703446008265018, + 0.4266843665391207, + 0.520129082724452, + 0.3955236077308655, + 1.3371604532003403, + 0.18245006538927555, + 0.6332949548959732, + 0.3320846501737833, + 0.720380824059248, + 0.07911951839923859, + 2.690080365166068, + 0.9666178077459335, + 1.7481620833277702, + 0.4150098254904151, + 0.48568800650537014, + 0.5492086131125689, + 0.2078920714557171, + 0.09426199272274971, + 0.9947268906980753, + 0.08029859140515327, + 2.024670420214534, + 0.5578470230102539, + 0.040625572204589844, + 1.012036308646202, + 0.28942246548831463, + 0.38091397657990456, + 1.7834451906383038, + 1.4581866096705198, + 0.8621032238006592, + 2.4613820295780897, + 0.4854028169065714, + 0.4144091308116913, + 0.2571219354867935, + 2.168883014470339, + 1.774810692295432, + 0.27058751322329044, + 1.40065748244524, + 1.07246782630682, + 2.695803537964821, + 0.9849229101091623, + 1.2456793822348118, + 0.8467770367860794, + 0.25635354965925217, + 0.37543530762195587, + 0.3786892890930176, + 0.4263993129134178, + 0.5387577749788761, + 0.4695080928504467, + 0.6282005235552788 + ], + "unique_experts": 64, + "load_cv": 0.6401768382227743, + "normalized_load_entropy": 0.9536306014705384, + "max_load_share": 0.049217002237136466 + } + }, + "s0_x": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "e32dd3d9a4ff951ae75c19462c5ded2b583b7f0df82fa9a220408f7916b5187f", + "route_weight_sha256": "b10b1012e21d88d54c071870a50bb8de9b25853302edc2724966872796e9b55e", + "loads": [ + 4, + 6, + 1, + 19, + 17, + 21, + 11, + 19, + 14, + 1, + 9, + 5, + 15, + 3, + 1, + 9, + 13, + 6, + 6, + 15, + 3, + 2, + 7, + 4, + 1, + 40, + 9, + 14, + 8, + 6, + 11, + 3, + 4, + 10, + 2, + 18, + 6, + 0, + 12, + 7, + 8, + 19, + 14, + 12, + 30, + 12, + 7, + 6, + 23, + 14, + 3, + 11, + 9, + 42, + 3, + 12, + 10, + 5, + 10, + 4, + 8, + 13, + 3, + 8 + ], + "weighted_loads": [ + 0.20485739782452583, + 0.22379708662629128, + 0.07605694234371185, + 1.0047473218291998, + 0.7636614516377449, + 0.8921030592173338, + 0.508470207452774, + 1.658807273954153, + 0.5308058001101017, + 0.05169203504920006, + 0.3231038209050894, + 0.18101432546973228, + 0.6672987453639507, + 0.1517394483089447, + 0.0417441725730896, + 0.3470204584300518, + 0.4891953133046627, + 0.21742520108819008, + 0.25195994041860104, + 0.5354432798922062, + 0.13314953446388245, + 0.07462674751877785, + 0.318024767562747, + 0.2352127768099308, + 0.04200444370508194, + 2.6775482520461082, + 0.5801877155900002, + 0.8809900656342506, + 0.29096162505447865, + 0.4042000360786915, + 0.3957364335656166, + 0.10483594611287117, + 0.1434454545378685, + 0.40565087646245956, + 0.07260766252875328, + 1.1694437377154827, + 0.49963754042983055, + 0.0, + 0.9542123191058636, + 0.2633208818733692, + 0.2824510224163532, + 1.6471438854932785, + 0.9686534516513348, + 0.8275046683847904, + 2.3219222370535135, + 0.4661227874457836, + 0.40050021186470985, + 0.21719450876116753, + 1.2624373268336058, + 0.6577177308499813, + 0.1696520857512951, + 0.7395964115858078, + 0.5669063478708267, + 2.564878672361374, + 0.11879663914442062, + 0.7628874890506268, + 0.5380604900419712, + 0.2709503024816513, + 0.35852538980543613, + 0.17223993688821793, + 0.3183577321469784, + 0.5470554865896702, + 0.09114477597177029, + 0.5049118846654892 + ], + "unique_experts": 63, + "load_cv": 0.8098426671626283, + "normalized_load_entropy": 0.9311464323850942, + "max_load_share": 0.06481481481481481 + }, + "full_input": { + "tokens": 133, + "top_k": 6, + "decisions": 798, + "ordered_route_sha256": "f9c235e93a84844a896189c166638f3a4a0b97ad0dc011af363ceb8875b4cb2f", + "route_weight_sha256": "6cf8a8245c44565c692dc788fccff936de345aa9ae4e01ba1b1864f87db5c1f6", + "loads": [ + 4, + 6, + 3, + 19, + 23, + 21, + 14, + 19, + 16, + 1, + 17, + 6, + 18, + 6, + 4, + 13, + 15, + 10, + 7, + 18, + 3, + 9, + 7, + 5, + 1, + 41, + 18, + 19, + 11, + 6, + 12, + 4, + 5, + 10, + 3, + 28, + 6, + 0, + 12, + 7, + 10, + 19, + 21, + 12, + 30, + 13, + 7, + 6, + 37, + 17, + 3, + 18, + 20, + 44, + 8, + 14, + 12, + 5, + 12, + 5, + 9, + 13, + 8, + 8 + ], + "weighted_loads": [ + 0.20485739782452583, + 0.22379708662629128, + 0.14655686914920807, + 1.0047473218291998, + 0.9979036711156368, + 0.8921030592173338, + 0.7580587342381477, + 1.658807273954153, + 0.653274804353714, + 0.05169203504920006, + 0.7299728635698557, + 0.22171732783317566, + 0.8122891299426556, + 0.3638843037188053, + 0.14492648281157017, + 0.5269183106720448, + 0.5450667720288038, + 0.36567993089556694, + 0.2982203532010317, + 1.1543259769678116, + 0.13314953446388245, + 0.5229509267956018, + 0.318024767562747, + 0.27811174467206, + 0.04200444370508194, + 2.7125336304306984, + 0.9817831292748451, + 1.3232707679271698, + 0.3923042668029666, + 0.4042000360786915, + 0.43122613057494164, + 0.16619940847158432, + 0.16632218286395073, + 0.40565087646245956, + 0.12154783681035042, + 1.809703715145588, + 0.49963754042983055, + 0.0, + 0.9542123191058636, + 0.2633208818733692, + 0.3601423352956772, + 1.6471438854932785, + 1.3377445600926876, + 0.8275046683847904, + 2.3219222370535135, + 0.49766747653484344, + 0.40050021186470985, + 0.21719450876116753, + 2.020857322961092, + 0.903681855648756, + 0.1696520857512951, + 1.0659408904612064, + 1.3951606191694736, + 2.6080561727285385, + 0.29587973840534687, + 0.9657040983438492, + 0.6245137490332127, + 0.2709503024816513, + 0.4132785443216562, + 0.21494558453559875, + 0.3406534194946289, + 0.5470554865896702, + 0.32947335205972195, + 0.5049118846654892 + ], + "unique_experts": 63, + "load_cv": 0.7313444679145243, + "normalized_load_entropy": 0.9408840064494552, + "max_load_share": 0.05513784461152882 + } + }, + "s1_x": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "060f018a1f487f62d71e056e214b10b1184088d692be1a211f377593f753d622", + "route_weight_sha256": "f85d64876688a4481465df455f4e4b78961ac6f52145d998ae684941e162e396", + "loads": [ + 7, + 5, + 1, + 19, + 19, + 19, + 10, + 16, + 12, + 2, + 8, + 5, + 13, + 2, + 2, + 8, + 11, + 4, + 5, + 20, + 3, + 3, + 7, + 6, + 2, + 39, + 8, + 13, + 10, + 8, + 10, + 1, + 3, + 9, + 4, + 17, + 6, + 0, + 12, + 4, + 5, + 19, + 15, + 12, + 30, + 11, + 9, + 6, + 28, + 16, + 4, + 10, + 9, + 41, + 5, + 11, + 12, + 5, + 8, + 3, + 8, + 15, + 4, + 9 + ], + "weighted_loads": [ + 0.3305308111011982, + 0.19280506670475006, + 0.06823654472827911, + 1.0876947101205587, + 0.7962726913392544, + 0.8134047891944647, + 0.5181725285947323, + 1.5779397413134575, + 0.44721536710858345, + 0.08028791472315788, + 0.29961176589131355, + 0.17256496846675873, + 0.5828863028436899, + 0.12430418655276299, + 0.08302592486143112, + 0.3175429105758667, + 0.39915112406015396, + 0.1616870053112507, + 0.20535696297883987, + 0.6876076962798834, + 0.13617118634283543, + 0.09642971307039261, + 0.3206116762012243, + 0.29736397229135036, + 0.0746910497546196, + 2.744616525247693, + 0.5574150532484055, + 0.8681807182729244, + 0.39831431210041046, + 0.47540090046823025, + 0.3773114662617445, + 0.03936676308512688, + 0.10124170780181885, + 0.3505352661013603, + 0.1361626349389553, + 1.1738095544278622, + 0.5406669452786446, + 0.0, + 0.9007700942456722, + 0.16299747303128242, + 0.18439148738980293, + 1.5837929230183363, + 1.0496442001312971, + 0.831406719982624, + 2.3058588169515133, + 0.4144721683114767, + 0.4539940394461155, + 0.21635132655501366, + 1.4150870479643345, + 0.758323710411787, + 0.1960875429213047, + 0.748378686606884, + 0.5277632884681225, + 2.7057410664856434, + 0.1816379576921463, + 0.7088179774582386, + 0.6402374543249607, + 0.27491777390241623, + 0.27899961546063423, + 0.13347842916846275, + 0.3491242825984955, + 0.59523531422019, + 0.12512686103582382, + 0.5317395217716694 + ], + "unique_experts": 63, + "load_cv": 0.8090895001388121, + "normalized_load_entropy": 0.9322762864258318, + "max_load_share": 0.06327160493827161 + }, + "full_input": { + "tokens": 149, + "top_k": 6, + "decisions": 894, + "ordered_route_sha256": "cae348ce243fc6fc1bc8ee544c2669a48b7da62661308209e718b4199bef9ab6", + "route_weight_sha256": "e3e4422293591cb07e1e60374f2fa68cacb1e777cb1b4d57ebb0138c8dab99af", + "loads": [ + 15, + 6, + 3, + 19, + 19, + 19, + 13, + 17, + 15, + 4, + 17, + 6, + 20, + 11, + 10, + 11, + 12, + 9, + 8, + 23, + 4, + 12, + 9, + 13, + 3, + 44, + 16, + 23, + 12, + 9, + 14, + 1, + 4, + 13, + 5, + 34, + 7, + 1, + 13, + 7, + 6, + 22, + 26, + 13, + 32, + 13, + 9, + 6, + 42, + 20, + 5, + 21, + 20, + 42, + 17, + 20, + 16, + 5, + 9, + 7, + 9, + 16, + 7, + 10 + ], + "weighted_loads": [ + 0.8436603508889675, + 0.24129711836576462, + 0.7625486757606268, + 1.0876947101205587, + 0.7962726913392544, + 0.8134047891944647, + 0.6293140053749084, + 1.6608437150716782, + 0.5622584521770477, + 0.22590335831046104, + 0.7603078745305538, + 0.21668918430805206, + 0.9180650990456343, + 0.569951668381691, + 0.381347743794322, + 0.44275497645139694, + 0.4123887848109007, + 0.3651983216404915, + 0.3132362477481365, + 1.2825810257345438, + 0.18352425657212734, + 0.6141799632459879, + 0.37946948409080505, + 0.8865180071443319, + 0.11041039228439331, + 2.937234576791525, + 0.8419807218015194, + 1.7375632338225842, + 0.42928196024149656, + 0.5242568086832762, + 0.5385098252445459, + 0.03936676308512688, + 0.12398490682244301, + 0.9482298120856285, + 0.16989630460739136, + 2.1322375498712063, + 0.6116578951478004, + 0.040625572204589844, + 0.9576282165944576, + 0.2767487093806267, + 0.22832556441426277, + 1.7849298808723688, + 1.6157443970441818, + 0.8759751990437508, + 2.4068878293037415, + 0.5076939892023802, + 0.4539940394461155, + 0.21635132655501366, + 2.480870299041271, + 1.697744745761156, + 0.2480677142739296, + 1.4946331419050694, + 1.313412118703127, + 2.7187479808926582, + 0.8896811064332724, + 1.3112734854221344, + 0.7993821669369936, + 0.27491777390241623, + 0.30394450575113297, + 0.33106958121061325, + 0.3715104181319475, + 0.6585774533450603, + 0.24887799471616745, + 0.6205762065947056 + ], + "unique_experts": 64, + "load_cv": 0.6755966929325393, + "normalized_load_entropy": 0.9498234899395922, + "max_load_share": 0.049217002237136466 + } + }, + "s0_period": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "cbbff3bae34414ec3928465de668701371bf69739f6b692eade3769910341c6e", + "route_weight_sha256": "161c164ba0369e85b939f67a6d3fcaa511ea8a09e775261e53dcbfc4eb17bc48", + "loads": [ + 4, + 6, + 1, + 19, + 19, + 20, + 10, + 18, + 13, + 1, + 10, + 4, + 14, + 3, + 1, + 12, + 12, + 4, + 7, + 17, + 3, + 3, + 5, + 4, + 1, + 40, + 8, + 15, + 9, + 7, + 11, + 3, + 4, + 10, + 2, + 18, + 5, + 0, + 12, + 7, + 9, + 18, + 15, + 10, + 30, + 11, + 7, + 6, + 23, + 15, + 3, + 10, + 11, + 42, + 5, + 12, + 12, + 5, + 8, + 4, + 7, + 12, + 3, + 8 + ], + "weighted_loads": [ + 0.20195242390036583, + 0.22782142832875252, + 0.07078977674245834, + 1.0790316313505173, + 0.8077331688255072, + 0.8692332375794649, + 0.4726803097873926, + 1.6261049136519432, + 0.5011565703898668, + 0.0516616553068161, + 0.35637801699340343, + 0.15887057781219482, + 0.6443537138402462, + 0.15363068878650665, + 0.04475924000144005, + 0.44918058067560196, + 0.45504848100245, + 0.15269440412521362, + 0.2813577763736248, + 0.5988745670765638, + 0.1372526790946722, + 0.11454145982861519, + 0.24959496408700943, + 0.24256039038300514, + 0.04336487501859665, + 2.706601394340396, + 0.5390226319432259, + 0.8934553973376751, + 0.3146804552525282, + 0.4383775442838669, + 0.3961974587291479, + 0.10949760302901268, + 0.13844037428498268, + 0.3960820399224758, + 0.07093240134418011, + 1.1911027431488037, + 0.4444079287350178, + 0.0, + 0.9398125447332859, + 0.248524883762002, + 0.30639526061713696, + 1.6096659116446972, + 1.0222992170602083, + 0.7701311856508255, + 2.3276047371327877, + 0.4248305782675743, + 0.3773742727935314, + 0.22486537881195545, + 1.2574900425970554, + 0.7200254257768393, + 0.1673586145043373, + 0.7180439345538616, + 0.643319983035326, + 2.599691728129983, + 0.18246371112763882, + 0.7634376864880323, + 0.606672840192914, + 0.2599087879061699, + 0.29415930435061455, + 0.18166065588593483, + 0.28569572418928146, + 0.5052273459732533, + 0.094057722017169, + 0.5061562526971102 + ], + "unique_experts": 63, + "load_cv": 0.810595134379233, + "normalized_load_entropy": 0.931121362704737, + "max_load_share": 0.06481481481481481 + }, + "full_input": { + "tokens": 133, + "top_k": 6, + "decisions": 798, + "ordered_route_sha256": "9037d114194b57d14575cce7259e4dbe6f490982d5f6dee9af282c00c61e3478", + "route_weight_sha256": "3a038c7d5f7a218fafa1fd8486351be1aba1590ef1f3fb99a59c896220ccc819", + "loads": [ + 4, + 6, + 3, + 19, + 26, + 20, + 13, + 18, + 15, + 1, + 16, + 5, + 17, + 8, + 5, + 17, + 14, + 7, + 8, + 20, + 3, + 9, + 5, + 5, + 1, + 41, + 17, + 20, + 12, + 7, + 12, + 4, + 5, + 10, + 4, + 28, + 5, + 0, + 12, + 8, + 11, + 18, + 20, + 10, + 30, + 13, + 7, + 6, + 36, + 18, + 3, + 18, + 21, + 43, + 10, + 14, + 13, + 5, + 10, + 6, + 8, + 12, + 8, + 8 + ], + "weighted_loads": [ + 0.20195242390036583, + 0.22782142832875252, + 0.14128970354795456, + 1.0790316313505173, + 1.076343985274434, + 0.8692332375794649, + 0.7582453992217779, + 1.6261049136519432, + 0.6301672961562872, + 0.0516616553068161, + 0.677158972248435, + 0.19920090958476067, + 0.7958856076002121, + 0.4542798772454262, + 0.17663776688277721, + 0.6633183844387531, + 0.5092730186879635, + 0.2713151313364506, + 0.33028583973646164, + 1.218280790373683, + 0.1372526790946722, + 0.5336702223867178, + 0.24959496408700943, + 0.28545935824513435, + 0.04336487501859665, + 2.741586772724986, + 0.9406180456280708, + 1.3080315105617046, + 0.41164817940443754, + 0.4383775442838669, + 0.4380456116050482, + 0.17819231376051903, + 0.1613171026110649, + 0.3960820399224758, + 0.14971204102039337, + 1.7941171675920486, + 0.4444079287350178, + 0.0, + 0.9398125447332859, + 0.2811758313328028, + 0.3830642569810152, + 1.6096659116446972, + 1.3017081450670958, + 0.7701311856508255, + 2.3276047371327877, + 0.49533261358737946, + 0.3773742727935314, + 0.22486537881195545, + 1.9666394293308258, + 0.99874965287745, + 0.1673586145043373, + 1.1094734370708466, + 1.2827828004956245, + 2.612698642536998, + 0.3545974977314472, + 1.011072350665927, + 0.6476767528802156, + 0.2599087879061699, + 0.34755575843155384, + 0.3042714409530163, + 0.307991411536932, + 0.5052273459732533, + 0.35252942703664303, + 0.5061562526971102 + ], + "unique_experts": 63, + "load_cv": 0.7263804755758295, + "normalized_load_entropy": 0.9415842828343719, + "max_load_share": 0.05388471177944862 + } + }, + "s1_period": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "e540083b1dc0bf27ab4b8b59875c14db59546f84261ea2341766a0dda1c7982c", + "route_weight_sha256": "08672952cff305fc31f5322fcec94276130a7d39b6ac8c42980085f6074eec39", + "loads": [ + 6, + 6, + 1, + 18, + 20, + 19, + 12, + 19, + 10, + 1, + 8, + 4, + 15, + 2, + 1, + 8, + 12, + 3, + 6, + 19, + 2, + 2, + 7, + 5, + 2, + 39, + 8, + 13, + 10, + 8, + 11, + 2, + 2, + 7, + 4, + 17, + 5, + 0, + 12, + 5, + 7, + 19, + 14, + 11, + 30, + 13, + 8, + 7, + 27, + 14, + 4, + 12, + 11, + 41, + 7, + 12, + 11, + 5, + 8, + 4, + 8, + 11, + 4, + 9 + ], + "weighted_loads": [ + 0.2997330352663994, + 0.23352881148457527, + 0.07112730294466019, + 1.1483246833086014, + 0.8524048365652561, + 0.7953236531466246, + 0.5818726811558008, + 1.6249645482748747, + 0.3705413155257702, + 0.045049481093883514, + 0.30035238713026047, + 0.14175555482506752, + 0.6983088124543428, + 0.12751329690217972, + 0.04672630876302719, + 0.3219209350645542, + 0.4326154347509146, + 0.13923168927431107, + 0.2367147784680128, + 0.661308778449893, + 0.09776720218360424, + 0.07981064915657043, + 0.30989707447588444, + 0.259049691259861, + 0.0753471702337265, + 2.8138621617108583, + 0.535263042896986, + 0.7839452307671309, + 0.39560028351843357, + 0.48244977556169033, + 0.4087620619684458, + 0.06859230250120163, + 0.07672938704490662, + 0.2846350409090519, + 0.13964302651584148, + 1.151311170309782, + 0.4832410663366318, + 0.0, + 0.9188761711120605, + 0.18113707192242146, + 0.23516033217310905, + 1.6063584629446268, + 0.9992076512426138, + 0.8157953303307295, + 2.2886640522629023, + 0.4768604692071676, + 0.4007469117641449, + 0.2632124926894903, + 1.4133500792086124, + 0.7033330872654915, + 0.1953816767781973, + 0.813053460791707, + 0.603228023275733, + 2.7084263768047094, + 0.2797546535730362, + 0.7974769361317158, + 0.6281311176717281, + 0.2646428123116493, + 0.2901181075721979, + 0.17164373025298119, + 0.34179721027612686, + 0.44561000540852547, + 0.12524160370230675, + 0.5351930186152458 + ], + "unique_experts": 63, + "load_cv": 0.8100308494974937, + "normalized_load_entropy": 0.9308852699031779, + "max_load_share": 0.06327160493827161 + }, + "full_input": { + "tokens": 149, + "top_k": 6, + "decisions": 894, + "ordered_route_sha256": "1834c18c0930e89ddbbbca5d93b5175a476d5e02bf8a8a98c0529914264b01f8", + "route_weight_sha256": "152b7753e55950bef3bcb685b0d1a03fa6e89d946a484f37d96d203aaec35f46", + "loads": [ + 14, + 7, + 3, + 18, + 21, + 19, + 16, + 20, + 13, + 3, + 16, + 5, + 20, + 12, + 8, + 11, + 14, + 8, + 10, + 23, + 3, + 11, + 9, + 12, + 3, + 41, + 16, + 23, + 12, + 9, + 15, + 2, + 3, + 11, + 4, + 35, + 6, + 1, + 13, + 8, + 8, + 21, + 25, + 12, + 31, + 15, + 8, + 7, + 40, + 18, + 5, + 23, + 21, + 42, + 20, + 22, + 15, + 5, + 10, + 9, + 9, + 12, + 8, + 10 + ], + "weighted_loads": [ + 0.8128625750541687, + 0.28202086314558983, + 0.7654394339770079, + 1.1483246833086014, + 0.8958032839000225, + 0.7953236531466246, + 0.7617724891752005, + 1.7078685220330954, + 0.48558440059423447, + 0.19066492468118668, + 0.7274057678878307, + 0.1853119470179081, + 0.9694868046790361, + 0.6191415302455425, + 0.33885085582733154, + 0.44423658400774, + 0.48051512241363525, + 0.34274300560355186, + 0.392540717497468, + 1.2930064909160137, + 0.14512027241289616, + 0.598734125494957, + 0.36875488236546516, + 0.8598719201982021, + 0.11106651276350021, + 2.885522423312068, + 0.8198287114501, + 1.6237461287528276, + 0.4265679316595197, + 0.5313056837767363, + 0.570984398946166, + 0.06859230250120163, + 0.09947258606553078, + 0.8823295868933201, + 0.13964302651584148, + 2.1285701729357243, + 0.5542320162057877, + 0.040625572204589844, + 0.975734293460846, + 0.29728982597589493, + 0.2745288200676441, + 1.7337785493582487, + 1.5818114019930363, + 0.8603638093918562, + 2.352413671091199, + 0.5693589989095926, + 0.4007469117641449, + 0.2632124926894903, + 2.320344254374504, + 1.749511994421482, + 0.24736184813082218, + 1.5885058026760817, + 1.194744212552905, + 2.7214332912117243, + 1.0415933337062597, + 1.4620225094258785, + 0.787275830283761, + 0.2646428123116493, + 0.34412437677383423, + 0.4466603025794029, + 0.3641833458095789, + 0.5089521445333958, + 0.2949613779783249, + 0.624029703438282 + ], + "unique_experts": 64, + "load_cv": 0.6642411923581315, + "normalized_load_entropy": 0.9505046767389128, + "max_load_share": 0.04697986577181208 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 108, + "ordered_topk_exact_tokens": 45, + "set_exact_tokens": 60, + "mean_set_jaccard": 0.8591269841269842, + "mean_token_weighted_tv": 0.0247571488186993, + "aggregate_load_tv": 0.04166666666666666 + }, + "system_bos": { + "tokens": 108, + "ordered_topk_exact_tokens": 41, + "set_exact_tokens": 59, + "mean_set_jaccard": 0.8549382716049384, + "mean_token_weighted_tv": 0.027150992942215117, + "aggregate_load_tv": 0.04166666666666667 + }, + "system_x": { + "tokens": 108, + "ordered_topk_exact_tokens": 37, + "set_exact_tokens": 53, + "mean_set_jaccard": 0.8272486772486772, + "mean_token_weighted_tv": 0.03463646853170185, + "aggregate_load_tv": 0.06327160493827161 + }, + "system_period": { + "tokens": 108, + "ordered_topk_exact_tokens": 29, + "set_exact_tokens": 43, + "mean_set_jaccard": 0.8046737213403881, + "mean_token_weighted_tv": 0.03713524900376797, + "aggregate_load_tv": 0.054012345679012336 + }, + "bos_at_s0": { + "tokens": 108, + "ordered_topk_exact_tokens": 44, + "set_exact_tokens": 60, + "mean_set_jaccard": 0.8528218694885361, + "mean_token_weighted_tv": 0.027227065327611787, + "aggregate_load_tv": 0.040123456790123455 + }, + "bos_at_s1": { + "tokens": 108, + "ordered_topk_exact_tokens": 35, + "set_exact_tokens": 57, + "mean_set_jaccard": 0.8346560846560847, + "mean_token_weighted_tv": 0.031734133854991305, + "aggregate_load_tv": 0.044753086419753084 + }, + "x_at_s0": { + "tokens": 108, + "ordered_topk_exact_tokens": 36, + "set_exact_tokens": 56, + "mean_set_jaccard": 0.8450176366843033, + "mean_token_weighted_tv": 0.02894181627952666, + "aggregate_load_tv": 0.0478395061728395 + }, + "x_at_s1": { + "tokens": 108, + "ordered_topk_exact_tokens": 32, + "set_exact_tokens": 48, + "mean_set_jaccard": 0.8037918871252206, + "mean_token_weighted_tv": 0.03961730517309021, + "aggregate_load_tv": 0.06018518518518518 + }, + "period_at_s0": { + "tokens": 108, + "ordered_topk_exact_tokens": 35, + "set_exact_tokens": 56, + "mean_set_jaccard": 0.8384038800705468, + "mean_token_weighted_tv": 0.030790955845818476, + "aggregate_load_tv": 0.05092592592592592 + }, + "period_at_s1": { + "tokens": 108, + "ordered_topk_exact_tokens": 27, + "set_exact_tokens": 44, + "mean_set_jaccard": 0.8002645502645502, + "mean_token_weighted_tv": 0.041015428611663754, + "aggregate_load_tv": 0.05864197530864197 + } + } + }, + "layer_22": { + "layer": 22, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "a9e87dd3a38bf3c22011c06392c607fc04afe4a4041cb3d3d01e036ebcb7039e", + "route_weight_sha256": "0066b534524fb1bac94d4808bee18652166e03b59e6b068c886899c4134d18c4", + "loads": [ + 10, + 8, + 19, + 5, + 11, + 12, + 7, + 9, + 17, + 18, + 6, + 3, + 9, + 4, + 9, + 6, + 9, + 7, + 3, + 17, + 19, + 18, + 2, + 10, + 9, + 6, + 1, + 2, + 6, + 5, + 13, + 6, + 21, + 17, + 3, + 4, + 5, + 5, + 2, + 34, + 8, + 9, + 7, + 4, + 12, + 1, + 27, + 15, + 9, + 8, + 9, + 2, + 11, + 8, + 8, + 16, + 5, + 14, + 8, + 0, + 21, + 40, + 17, + 12 + ], + "weighted_loads": [ + 0.5857506562024355, + 0.3311713971197605, + 2.0594865418970585, + 0.3506179638206959, + 0.38412235118448734, + 0.4986273869872093, + 0.19553478760644794, + 2.5506783984601498, + 0.8614709191024303, + 1.3021611645817757, + 0.3460852410644293, + 0.1331273838877678, + 0.4367154873907566, + 0.14545660559087992, + 0.4391659386456013, + 0.22215030528604984, + 0.5091624744236469, + 0.34347886592149734, + 0.11705617606639862, + 0.764276972040534, + 0.9771311096847057, + 1.2552843261510134, + 0.07734252884984016, + 0.6250359304249287, + 0.35472071915864944, + 0.21170633099973202, + 0.042210161685943604, + 0.05867806077003479, + 0.3802923373878002, + 0.19012168794870377, + 0.4551302082836628, + 0.24760884046554565, + 0.84284901432693, + 0.6548158098012209, + 0.0599548026220873, + 0.13163482770323753, + 0.36619284376502037, + 0.1800153311342001, + 0.08102964237332344, + 2.034304255619645, + 0.6174357458949089, + 0.5297257695347071, + 0.2837056443095207, + 0.24528316408395767, + 0.4178190864622593, + 0.04152359068393707, + 1.9660244155675173, + 0.7653429843485355, + 0.31482907570898533, + 0.48822861164808273, + 0.4142345245927572, + 0.08958924189209938, + 0.6644768565893173, + 0.3463686890900135, + 0.31604861468076706, + 0.8420825134962797, + 0.4020023085176945, + 0.6831239685416222, + 0.31159311532974243, + 0.0, + 1.6679880730807781, + 2.6763438675552607, + 0.7751783684361726, + 0.4404833912849426 + ], + "unique_experts": 63, + "load_cv": 0.7437182953989646, + "normalized_load_entropy": 0.9401643732789208, + "max_load_share": 0.06172839506172839 + }, + "full_input": { + "tokens": 133, + "top_k": 6, + "decisions": 798, + "ordered_route_sha256": "4dc6d013528a578fe3a206dc9d8a8925ac760c7656060f1de8d586d053cf707b", + "route_weight_sha256": "1bbe71c8085b3b14f66ce6947d8706bc2dc16b8c3babdb281bd1178f68cce7bd", + "loads": [ + 14, + 9, + 21, + 14, + 11, + 14, + 11, + 9, + 32, + 23, + 6, + 5, + 9, + 4, + 15, + 6, + 9, + 8, + 3, + 18, + 20, + 25, + 3, + 10, + 9, + 7, + 1, + 7, + 6, + 6, + 14, + 6, + 24, + 24, + 4, + 6, + 5, + 7, + 2, + 34, + 12, + 10, + 12, + 4, + 12, + 2, + 28, + 15, + 12, + 10, + 12, + 2, + 13, + 9, + 8, + 30, + 8, + 15, + 9, + 0, + 30, + 48, + 17, + 19 + ], + "weighted_loads": [ + 0.7579898312687874, + 0.3763521686196327, + 2.136101108044386, + 2.2204341553151608, + 0.38412235118448734, + 0.5653009712696075, + 0.4169434071518481, + 2.5506783984601498, + 2.122532040812075, + 1.4982192441821098, + 0.3460852410644293, + 0.16253095492720604, + 0.4367154873907566, + 0.14545660559087992, + 1.26096465671435, + 0.22215030528604984, + 0.5091624744236469, + 0.36925526335835457, + 0.11705617606639862, + 0.7942987885326147, + 1.0200697630643845, + 1.7641272731125355, + 0.10638962499797344, + 0.6250359304249287, + 0.35472071915864944, + 0.23789465613663197, + 0.042210161685943604, + 0.24045240879058838, + 0.3802923373878002, + 0.21574504859745502, + 0.4889775328338146, + 0.24760884046554565, + 0.9195304121822119, + 0.904094098135829, + 0.11968044110108167, + 0.26377325505018234, + 0.36619284376502037, + 0.2615328710526228, + 0.08102964237332344, + 2.034304255619645, + 0.8451431281864643, + 0.5739715527743101, + 0.6058519557118416, + 0.24528316408395767, + 0.4178190864622593, + 0.07223941572010517, + 2.0062231738120317, + 0.7653429843485355, + 0.4418194331228733, + 0.6775462105870247, + 0.5788856353610754, + 0.08958924189209938, + 0.8230980224907398, + 0.38957109674811363, + 0.31604861468076706, + 1.975382816977799, + 0.5233992356806993, + 0.7087325360625982, + 0.3394098300486803, + 0.0, + 2.89341414347291, + 2.9563229084014893, + 0.7751783684361726, + 0.7872015424072742 + ], + "unique_experts": 63, + "load_cv": 0.7353188695136382, + "normalized_load_entropy": 0.9407385251839072, + "max_load_share": 0.06015037593984962 + } + }, + "s1_eos": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "b29200cc98caa8cc8471b40e903612074d12602018d25623b665e53e22bface1", + "route_weight_sha256": "ca2f4459ca127fbb0dad99a6d5b3f51d18c353b207056121acf0fbdc7210b391", + "loads": [ + 12, + 7, + 20, + 6, + 11, + 14, + 5, + 10, + 16, + 19, + 5, + 3, + 8, + 4, + 10, + 6, + 9, + 6, + 2, + 13, + 18, + 18, + 2, + 10, + 12, + 6, + 3, + 0, + 6, + 4, + 13, + 6, + 19, + 15, + 4, + 3, + 5, + 5, + 2, + 36, + 8, + 10, + 8, + 8, + 11, + 1, + 26, + 17, + 7, + 9, + 7, + 2, + 11, + 8, + 11, + 17, + 4, + 13, + 7, + 0, + 21, + 39, + 17, + 13 + ], + "weighted_loads": [ + 0.6758955381810665, + 0.2817010208964348, + 2.060979278758168, + 0.38290337286889553, + 0.39564403146505356, + 0.5705806892365217, + 0.13666757545433939, + 2.6660382505506277, + 0.8557463400065899, + 1.3058522418141365, + 0.30993685964494944, + 0.12388795614242554, + 0.4075203128159046, + 0.13947192626073956, + 0.486245671287179, + 0.18812156468629837, + 0.5092264004051685, + 0.2965593859553337, + 0.0804743766784668, + 0.6373955085873604, + 0.9520730972290039, + 1.2540723010897636, + 0.07144847512245178, + 0.635314179584384, + 0.46609113179147243, + 0.21458040177822113, + 0.11428949236869812, + 0.0, + 0.37949085980653763, + 0.1488887332379818, + 0.46314832009375095, + 0.25529806315898895, + 0.7886426728218794, + 0.5993009191006422, + 0.07656711153686047, + 0.10174521058797836, + 0.37130676954984665, + 0.17251412197947502, + 0.0801863893866539, + 2.1071238350123167, + 0.6144152395427227, + 0.5423975791782141, + 0.32445575669407845, + 0.377435527741909, + 0.3898720070719719, + 0.04136862978339195, + 1.9670282024890184, + 0.8559377696365118, + 0.27223399467766285, + 0.5114532168954611, + 0.32733409851789474, + 0.08828183263540268, + 0.6449630204588175, + 0.33056778088212013, + 0.42756831645965576, + 0.8572375401854515, + 0.3691522479057312, + 0.6491166986525059, + 0.2914684396237135, + 0.0, + 1.6663955058902502, + 2.6457627341151237, + 0.7856390094384551, + 0.4667637776583433 + ], + "unique_experts": 62, + "load_cv": 0.7445375942377581, + "normalized_load_entropy": 0.9388374829924078, + "max_load_share": 0.06018518518518518 + }, + "full_input": { + "tokens": 149, + "top_k": 6, + "decisions": 894, + "ordered_route_sha256": "4b35ad0bac789fdc7ad0f1918f9070a9557c7d5a2068a1539671446716311a76", + "route_weight_sha256": "bb1337fe8da05e71488e1b6050c0cd9ce0a050b9d935ebda3790d828ac0dbdc6", + "loads": [ + 14, + 13, + 20, + 17, + 11, + 16, + 10, + 11, + 38, + 28, + 5, + 8, + 11, + 4, + 15, + 10, + 12, + 8, + 3, + 13, + 20, + 32, + 4, + 10, + 12, + 7, + 3, + 4, + 7, + 4, + 14, + 6, + 21, + 26, + 11, + 8, + 7, + 8, + 2, + 37, + 19, + 11, + 13, + 10, + 11, + 1, + 27, + 19, + 10, + 12, + 16, + 5, + 18, + 10, + 11, + 38, + 8, + 14, + 10, + 0, + 36, + 49, + 18, + 18 + ], + "weighted_loads": [ + 0.8028190471231937, + 0.7805651221424341, + 2.060979278758168, + 2.5202181339263916, + 0.39564403146505356, + 0.6330500934273005, + 0.4207054392900318, + 2.7078843396157026, + 2.6638106731697917, + 1.7685533799231052, + 0.30993685964494944, + 0.4288716111332178, + 0.5459806732833385, + 0.13947192626073956, + 1.3083725236356258, + 0.4252627044916153, + 0.6532534919679165, + 0.34647689014673233, + 0.12043706327676773, + 0.6373955085873604, + 1.042784683406353, + 2.3041583709418774, + 0.13777238689363003, + 0.635314179584384, + 0.46609113179147243, + 0.24007460474967957, + 0.11428949236869812, + 0.13346633315086365, + 0.46014779806137085, + 0.1488887332379818, + 0.5188761632889509, + 0.25529806315898895, + 0.8446073173545301, + 0.9948668126016855, + 0.395708404481411, + 0.32271382585167885, + 0.4614616557955742, + 0.2699119374155998, + 0.0801863893866539, + 2.149940913543105, + 1.3106698654592037, + 0.5677550006657839, + 0.6739973500370979, + 0.5126651078462601, + 0.3898720070719719, + 0.04136862978339195, + 2.001407014206052, + 0.923790505155921, + 0.3941515404731035, + 1.015922537073493, + 0.7869073692709208, + 0.2948872856795788, + 1.3693387899547815, + 0.4233718700706959, + 0.42756831645965576, + 2.540502688847482, + 0.5900628827512264, + 0.674376554787159, + 0.3623514580540359, + 0.0, + 3.712046118453145, + 3.062687426805496, + 0.8139493064954877, + 0.7620523534715176 + ], + "unique_experts": 63, + "load_cv": 0.7133028142830682, + "normalized_load_entropy": 0.9443831185814427, + "max_load_share": 0.05480984340044743 + } + }, + "s0_bos": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "19dcd87b34bc5a6cac41cd6d5d68e2651f0931dca4e7ad00830f159c4e555e1d", + "route_weight_sha256": "c58b2de70ef948c70e9061f0728bc8896a7b24320302eae9bcbe124db866d414", + "loads": [ + 11, + 8, + 19, + 6, + 9, + 12, + 6, + 10, + 20, + 17, + 6, + 1, + 9, + 5, + 10, + 7, + 9, + 7, + 3, + 15, + 18, + 17, + 2, + 10, + 8, + 7, + 2, + 1, + 5, + 5, + 11, + 6, + 20, + 15, + 3, + 7, + 5, + 4, + 2, + 33, + 8, + 9, + 8, + 4, + 13, + 3, + 27, + 15, + 8, + 7, + 8, + 3, + 12, + 9, + 9, + 16, + 4, + 16, + 9, + 1, + 20, + 38, + 18, + 12 + ], + "weighted_loads": [ + 0.6450194921344519, + 0.3453363720327616, + 2.0732450000941753, + 0.35092530213296413, + 0.3591950051486492, + 0.49921107292175293, + 0.16609533340670168, + 2.660999994724989, + 0.9844538141041994, + 1.2704189009964466, + 0.29980050353333354, + 0.06760188192129135, + 0.4438116252422333, + 0.15919909928925335, + 0.4473148174583912, + 0.23471666127443314, + 0.5300937555730343, + 0.3468730878084898, + 0.12507043778896332, + 0.6599562931805849, + 0.9463453367352486, + 1.2287151403725147, + 0.07345636934041977, + 0.6426073741167784, + 0.3339756093919277, + 0.2638375163078308, + 0.09464843198657036, + 0.04231603816151619, + 0.3554704934358597, + 0.1914420872926712, + 0.39187683165073395, + 0.2367602400481701, + 0.8131864499300718, + 0.609122134745121, + 0.060298948315903544, + 0.22325463593006134, + 0.3692621849477291, + 0.16366584971547127, + 0.07726823538541794, + 2.0807506293058395, + 0.6268512718379498, + 0.530807526782155, + 0.31380342692136765, + 0.22250504605472088, + 0.435466680675745, + 0.10348847135901451, + 1.8897493910044432, + 0.7267578337341547, + 0.3076596111059189, + 0.4624485597014427, + 0.35417881421744823, + 0.12613585963845253, + 0.6914633400738239, + 0.3980426862835884, + 0.3498323895037174, + 0.8279641382396221, + 0.38467273116111755, + 0.7124124504625797, + 0.3638080134987831, + 0.030920647084712982, + 1.688063831999898, + 2.6080070100724697, + 0.8346966607496142, + 0.4504620898514986 + ], + "unique_experts": 64, + "load_cv": 0.7153039968825173, + "normalized_load_entropy": 0.9446084238298926, + "max_load_share": 0.05864197530864197 + }, + "full_input": { + "tokens": 133, + "top_k": 6, + "decisions": 798, + "ordered_route_sha256": "6bc28a6b97d4f6ff38c47d79d6d1549c45f070a38e263c393b9ba665c0a87100", + "route_weight_sha256": "6ad241b0aa808af59da0713d4b8df64590bae6bdd90d9e6887c2eeaaf0c5a111", + "loads": [ + 15, + 9, + 21, + 14, + 9, + 13, + 9, + 11, + 33, + 22, + 7, + 2, + 9, + 5, + 13, + 8, + 9, + 8, + 3, + 15, + 19, + 24, + 3, + 10, + 9, + 8, + 2, + 6, + 5, + 7, + 12, + 6, + 22, + 22, + 4, + 11, + 5, + 7, + 2, + 33, + 12, + 10, + 13, + 4, + 13, + 4, + 28, + 15, + 13, + 9, + 10, + 3, + 14, + 10, + 9, + 29, + 7, + 18, + 10, + 1, + 30, + 46, + 18, + 20 + ], + "weighted_loads": [ + 0.8172586672008038, + 0.3919228706508875, + 2.1498595662415028, + 1.329862518236041, + 0.3591950051486492, + 0.5118116959929466, + 0.37635243893601, + 3.5851779393851757, + 2.1607032446190715, + 1.4664769805967808, + 0.3190145022235811, + 0.0800632257014513, + 0.4438116252422333, + 0.15919909928925335, + 1.2587569989264011, + 0.27826443687081337, + 0.5300937555730343, + 0.372649485245347, + 0.12507043778896332, + 0.6599562931805849, + 0.9828670546412468, + 1.7516021151095629, + 0.10250346548855305, + 0.6426073741167784, + 0.337977210059762, + 0.29002584144473076, + 0.09464843198657036, + 0.23260954208672047, + 0.3554704934358597, + 0.25813706405460835, + 0.4119705967605114, + 0.2367602400481701, + 0.8833243194967508, + 0.8576240241527557, + 0.12002458679489791, + 0.41647275909781456, + 0.3692621849477291, + 0.30270195193588734, + 0.07726823538541794, + 2.0807506293058395, + 0.8618280626833439, + 0.6121384892612696, + 0.5102706295438111, + 0.22250504605472088, + 0.435466680675745, + 0.1342042963951826, + 1.9299481492489576, + 0.7267578337341547, + 0.5764977484941483, + 0.5905033312737942, + 0.4751007165759802, + 0.12613585963845253, + 0.8314496800303459, + 0.44124509394168854, + 0.3498323895037174, + 1.9565521068871021, + 0.5060696583241224, + 0.7460200721397996, + 0.38528382778167725, + 0.030920647084712982, + 2.9362996350973845, + 2.8879860509186983, + 0.8346966607496142, + 0.7747221197932959 + ], + "unique_experts": 64, + "load_cv": 0.706033320551932, + "normalized_load_entropy": 0.9459480966464043, + "max_load_share": 0.05764411027568922 + } + }, + "s1_bos": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "d0e50de05cbaaf6424ed077bc99f14204956617f810df50dac809bec58a241a2", + "route_weight_sha256": "ecfa4f639b9d47099bd506959c3deac6fc8f6f5d45807a0b44adeae8934e039f", + "loads": [ + 11, + 8, + 19, + 6, + 11, + 13, + 5, + 9, + 21, + 17, + 5, + 3, + 9, + 5, + 9, + 10, + 9, + 6, + 3, + 15, + 19, + 18, + 4, + 9, + 9, + 7, + 2, + 3, + 5, + 5, + 10, + 6, + 18, + 15, + 4, + 5, + 5, + 3, + 1, + 33, + 8, + 9, + 7, + 5, + 9, + 3, + 28, + 14, + 7, + 8, + 9, + 2, + 12, + 10, + 11, + 17, + 4, + 14, + 8, + 1, + 20, + 37, + 18, + 12 + ], + "weighted_loads": [ + 0.6566287009045482, + 0.30211990885436535, + 2.099167622625828, + 0.3767336346209049, + 0.4116238821297884, + 0.531634921208024, + 0.1406972638797015, + 2.709667209535837, + 1.0122011378407478, + 1.2648569196462631, + 0.2868133271113038, + 0.128619983792305, + 0.44584049470722675, + 0.15218778885900974, + 0.4459535200148821, + 0.3406506609171629, + 0.5224045738577843, + 0.31531697884202003, + 0.11814521253108978, + 0.6607874408364296, + 1.019539339467883, + 1.261087603867054, + 0.14858412370085716, + 0.6259417980909348, + 0.37924048490822315, + 0.25486711971461773, + 0.09152912721037865, + 0.08695473708212376, + 0.3497955799102783, + 0.19444364309310913, + 0.3727734088897705, + 0.2423467729240656, + 0.7574055921286345, + 0.6097851954400539, + 0.07806767011061311, + 0.16002030484378338, + 0.3746611438691616, + 0.12315194308757782, + 0.04192858561873436, + 2.063495233654976, + 0.6138603910803795, + 0.5367328394204378, + 0.273890795186162, + 0.23835101909935474, + 0.3148021064698696, + 0.10126708447933197, + 1.987607054412365, + 0.7757341451942921, + 0.2759515047073364, + 0.4505311045795679, + 0.38051194325089455, + 0.07453536987304688, + 0.6638049818575382, + 0.41648688167333603, + 0.4309831988066435, + 0.8800638355314732, + 0.37500033527612686, + 0.660719895735383, + 0.3261199090629816, + 0.031249435618519783, + 1.6274829469621181, + 2.5809779278934, + 0.82377212587744, + 0.4458170738071203 + ], + "unique_experts": 64, + "load_cv": 0.7090978015197225, + "normalized_load_entropy": 0.9463678242070932, + "max_load_share": 0.05709876543209876 + }, + "full_input": { + "tokens": 149, + "top_k": 6, + "decisions": 894, + "ordered_route_sha256": "daa265e6e03cc998ae3bdd5d1ab63bc6f90ad38d1e34b6dd9fb416ea5cc6842a", + "route_weight_sha256": "ff571bfd97adaf94bbc79c6b46ffc5a925385e70cbca226427ba339ae4f235ae", + "loads": [ + 13, + 13, + 19, + 16, + 11, + 14, + 9, + 10, + 42, + 26, + 5, + 9, + 12, + 5, + 13, + 15, + 12, + 8, + 4, + 15, + 21, + 30, + 6, + 9, + 9, + 8, + 2, + 8, + 6, + 5, + 11, + 6, + 19, + 26, + 11, + 12, + 7, + 6, + 1, + 34, + 19, + 10, + 12, + 7, + 9, + 3, + 29, + 16, + 13, + 11, + 17, + 5, + 19, + 14, + 11, + 37, + 8, + 15, + 9, + 1, + 36, + 47, + 19, + 19 + ], + "weighted_loads": [ + 0.7835522098466754, + 0.7632674612104893, + 2.099167622625828, + 1.61908751539886, + 0.4116238821297884, + 0.5442355442792177, + 0.4148901260923594, + 2.751513298600912, + 2.7594083482399583, + 1.7275580577552319, + 0.2868133271113038, + 0.4977207090705633, + 0.5843008551746607, + 0.15218778885900974, + 1.274077594280243, + 0.6198812481015921, + 0.6664316654205322, + 0.36523448303341866, + 0.15810789912939072, + 0.6607874408364296, + 1.1108173374086618, + 2.2326631397008896, + 0.21819652244448662, + 0.6259417980909348, + 0.37924048490822315, + 0.28036132268607616, + 0.09152912721037865, + 0.27036335691809654, + 0.43045251816511154, + 0.19444364309310913, + 0.4101630486547947, + 0.2423467729240656, + 0.8072793390601873, + 1.0085664428770542, + 0.3972089630551636, + 0.474478492513299, + 0.46481603011488914, + 0.2398768700659275, + 0.04192858561873436, + 2.1063123121857643, + 1.3198911361396313, + 0.5620902609080076, + 0.6042169574648142, + 0.3735805992037058, + 0.3148021064698696, + 0.10126708447933197, + 2.0219858661293983, + 0.8435868807137012, + 0.6043229661881924, + 0.9951278138905764, + 0.7949805650860071, + 0.281140822917223, + 1.3849195968359709, + 0.5792971514165401, + 0.4309831988066435, + 2.5638133343309164, + 0.5959109701216221, + 0.6859797518700361, + 0.3695769850164652, + 0.031249435618519783, + 3.7363917008042336, + 2.9979026205837727, + 0.8520824229344726, + 0.8515344224870205 + ], + "unique_experts": 64, + "load_cv": 0.6957997924477757, + "normalized_load_entropy": 0.9481120734270128, + "max_load_share": 0.052572706935123045 + } + }, + "s0_x": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "fdf374853abe7a5aa899403d4b665a166f02e5b0d10a92b771e3c5f1c34ef947", + "route_weight_sha256": "84d045afe339a78f58fd7efb93159ceaecedc08a704cc94667f023d2b5b35146", + "loads": [ + 10, + 9, + 19, + 6, + 11, + 13, + 5, + 8, + 17, + 18, + 6, + 2, + 9, + 5, + 9, + 8, + 9, + 6, + 3, + 17, + 19, + 18, + 3, + 9, + 9, + 5, + 2, + 4, + 6, + 5, + 11, + 7, + 20, + 12, + 3, + 3, + 5, + 4, + 2, + 34, + 9, + 8, + 8, + 4, + 12, + 3, + 25, + 14, + 7, + 8, + 11, + 3, + 11, + 11, + 8, + 19, + 4, + 15, + 8, + 0, + 20, + 40, + 19, + 10 + ], + "weighted_loads": [ + 0.6221203785389662, + 0.3703691065311432, + 2.0797142386436462, + 0.3891617991030216, + 0.41187373362481594, + 0.5262624938040972, + 0.1665213741362095, + 2.2798974066972733, + 0.8568738736212254, + 1.2758414130657911, + 0.3500161711126566, + 0.09451981633901596, + 0.4356648847460747, + 0.1886561643332243, + 0.4088697098195553, + 0.26517002284526825, + 0.5275197923183441, + 0.31810627691447735, + 0.12388141080737114, + 0.7230425532907248, + 0.9687762875109911, + 1.2411362528800964, + 0.11349106580018997, + 0.5990049634128809, + 0.3774428740143776, + 0.17478601448237896, + 0.09340225160121918, + 0.11036458425223827, + 0.3808894157409668, + 0.19168120995163918, + 0.3833859860897064, + 0.2668039668351412, + 0.8065911997109652, + 0.49358760192990303, + 0.07840145006775856, + 0.10047548450529575, + 0.3751809671521187, + 0.15533000975847244, + 0.08050034940242767, + 2.080375449731946, + 0.6831742972135544, + 0.4994387738406658, + 0.30754617042839527, + 0.23139190673828125, + 0.42753637209534645, + 0.10387161560356617, + 1.8601176589727402, + 0.6834426037967205, + 0.27601129561662674, + 0.47406146116554737, + 0.5027965493500233, + 0.12182197719812393, + 0.6772810257971287, + 0.4463703017681837, + 0.3161722980439663, + 0.9993154928088188, + 0.37984148040413857, + 0.7179448120296001, + 0.33142280392348766, + 0.0, + 1.5842623747885227, + 2.6523995846509933, + 0.9424352180212736, + 0.38784450106322765 + ], + "unique_experts": 63, + "load_cv": 0.7288134391676762, + "normalized_load_entropy": 0.943693819118879, + "max_load_share": 0.06172839506172839 + }, + "full_input": { + "tokens": 133, + "top_k": 6, + "decisions": 798, + "ordered_route_sha256": "30309f5771cc08bc8d47d391371ecf11c4b8e2c07ea2374cf59af676845c2ae2", + "route_weight_sha256": "ba3a96242216b17c7d49a7bfe9fd73dff708e3065f1b86bc914fde95d1c0a587", + "loads": [ + 14, + 10, + 21, + 15, + 11, + 14, + 9, + 8, + 30, + 24, + 6, + 3, + 9, + 5, + 13, + 8, + 9, + 8, + 3, + 17, + 20, + 27, + 5, + 9, + 9, + 6, + 2, + 7, + 6, + 5, + 13, + 7, + 22, + 21, + 4, + 5, + 5, + 6, + 2, + 34, + 13, + 9, + 13, + 4, + 12, + 4, + 26, + 14, + 10, + 10, + 14, + 3, + 12, + 13, + 8, + 34, + 7, + 16, + 9, + 0, + 29, + 49, + 19, + 18 + ], + "weighted_loads": [ + 0.7943595536053181, + 0.4117824658751488, + 2.1563288047909737, + 1.4529596604406834, + 0.41187373362481594, + 0.5388631168752909, + 0.44803187623620033, + 2.2798974066972733, + 2.0634458726271987, + 1.5022601261734962, + 0.3500161711126566, + 0.10698116011917591, + 0.4356648847460747, + 0.1886561643332243, + 1.4668422602117062, + 0.26517002284526825, + 0.5275197923183441, + 0.3765524234622717, + 0.12388141080737114, + 0.7230425532907248, + 1.007858308032155, + 1.8720796909183264, + 0.1565354010090232, + 0.5990049634128809, + 0.3774428740143776, + 0.2009743396192789, + 0.09340225160121918, + 0.21065904013812542, + 0.3808894157409668, + 0.19168120995163918, + 0.44133448228240013, + 0.2668039668351412, + 0.8767290692776442, + 0.8184631634503603, + 0.13812708854675293, + 0.18862042017281055, + 0.3751809671521187, + 0.20972882211208344, + 0.08050034940242767, + 2.080375449731946, + 0.912186648696661, + 0.577748890966177, + 0.5981378927826881, + 0.23139190673828125, + 0.42753637209534645, + 0.13458744063973427, + 1.9003164172172546, + 0.6834426037967205, + 0.3886451795697212, + 0.7263743299990892, + 0.6786544807255268, + 0.12182197719812393, + 0.7980185337364674, + 0.5065378732979298, + 0.3161722980439663, + 2.3496056124567986, + 0.5012384075671434, + 0.7435533795505762, + 0.34980250895023346, + 0.0, + 2.8178268633782864, + 2.987970581278205, + 0.9424352180212736, + 0.687792444601655 + ], + "unique_experts": 63, + "load_cv": 0.7343615005738255, + "normalized_load_entropy": 0.9423017566728857, + "max_load_share": 0.06140350877192982 + } + }, + "s1_x": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "a82415fe7e7a9bde4e03e399d1aae68aeea897b137a535c6a54b489b78be60dd", + "route_weight_sha256": "fbe8904e0a1f72ad2c4ff622d99435b9ef6aa60c51b6bf011541ce9f3cc6ef6d", + "loads": [ + 8, + 10, + 19, + 6, + 9, + 11, + 2, + 10, + 20, + 16, + 6, + 1, + 9, + 4, + 7, + 7, + 9, + 6, + 3, + 15, + 19, + 19, + 2, + 10, + 9, + 9, + 1, + 0, + 6, + 4, + 14, + 6, + 19, + 14, + 4, + 2, + 5, + 5, + 2, + 37, + 11, + 9, + 7, + 6, + 11, + 3, + 28, + 17, + 5, + 8, + 9, + 3, + 11, + 10, + 11, + 20, + 3, + 16, + 8, + 0, + 18, + 42, + 18, + 9 + ], + "weighted_loads": [ + 0.5229342877864838, + 0.3862600363790989, + 2.052752122282982, + 0.5101969707757235, + 0.3269025906920433, + 0.4520796798169613, + 0.06212051957845688, + 2.60206544958055, + 0.9965565912425518, + 1.1931170858442783, + 0.37255104910582304, + 0.07111237943172455, + 0.4551119785755873, + 0.150176293682307, + 0.3811754696071148, + 0.2527179438620806, + 0.5109426975250244, + 0.31333161145448685, + 0.11549326032400131, + 0.6745286770164967, + 1.0397579986602068, + 1.3567940443754196, + 0.06805696710944176, + 0.6464995294809341, + 0.38087259978055954, + 0.3091624639928341, + 0.04120343551039696, + 0.0, + 0.3795269262045622, + 0.1612948328256607, + 0.48706549033522606, + 0.23152760416269302, + 0.7956658285111189, + 0.5382481869310141, + 0.07600258942693472, + 0.07005598768591881, + 0.3799116909503937, + 0.1895844005048275, + 0.07452882081270218, + 2.251479944214225, + 0.7210160437971354, + 0.5114003196358681, + 0.3009221851825714, + 0.30555693432688713, + 0.35959182120859623, + 0.1041344664990902, + 1.9875476323068142, + 0.8292219899594784, + 0.23756464198231697, + 0.43248312175273895, + 0.4090634509921074, + 0.12286704778671265, + 0.658648282289505, + 0.4075552113354206, + 0.4474771562963724, + 1.0352120287716389, + 0.3151366114616394, + 0.7288027126342058, + 0.3525316845625639, + 0.0, + 1.4350804910063744, + 2.796548431739211, + 0.8323099408298731, + 0.34683200530707836 + ], + "unique_experts": 62, + "load_cv": 0.7857711921466451, + "normalized_load_entropy": 0.9332856584616744, + "max_load_share": 0.06481481481481481 + }, + "full_input": { + "tokens": 149, + "top_k": 6, + "decisions": 894, + "ordered_route_sha256": "f39a1656805c7f640fb86e67e467985c1ddf27c923d5fd99f911f2783ec7d969", + "route_weight_sha256": "8eef8e33b04d489fe6e3b765fc14334c4270e5860eff12461867e0b46e61472c", + "loads": [ + 10, + 15, + 19, + 17, + 9, + 12, + 7, + 11, + 41, + 26, + 6, + 5, + 12, + 4, + 11, + 11, + 12, + 8, + 4, + 15, + 21, + 33, + 4, + 10, + 9, + 11, + 1, + 2, + 7, + 4, + 15, + 6, + 20, + 25, + 11, + 7, + 7, + 8, + 2, + 38, + 23, + 10, + 12, + 8, + 11, + 3, + 29, + 19, + 8, + 11, + 18, + 6, + 18, + 14, + 11, + 44, + 7, + 17, + 9, + 0, + 33, + 54, + 19, + 14 + ], + "weighted_loads": [ + 0.649857796728611, + 0.8474075887352228, + 2.052752122282982, + 1.8001479394733906, + 0.3269025906920433, + 0.464680302888155, + 0.37526603043079376, + 2.643911538645625, + 2.763982563279569, + 1.7011895887553692, + 0.37255104910582304, + 0.3588667195290327, + 0.5935723390430212, + 0.150176293682307, + 1.0960334520787, + 0.4898590836673975, + 0.6549697890877724, + 0.36324911564588547, + 0.15545594692230225, + 0.6745286770164967, + 1.1300375256687403, + 2.473191909492016, + 0.13640473783016205, + 0.6464995294809341, + 0.38087259978055954, + 0.3584427274763584, + 0.04120343551039696, + 0.06746337935328484, + 0.4601838644593954, + 0.1612948328256607, + 0.5126823633909225, + 0.23152760416269302, + 0.8455395754426718, + 0.9396981950849295, + 0.39514388237148523, + 0.30087440088391304, + 0.4700665771961212, + 0.29109274968504906, + 0.07452882081270218, + 2.2942970227450132, + 1.463034650310874, + 0.5367577411234379, + 0.7077632285654545, + 0.4407865144312382, + 0.35959182120859623, + 0.1041344664990902, + 2.0219264440238476, + 0.8970747254788876, + 0.36119053699076176, + 0.9797286540269852, + 0.8655953351408243, + 0.32947250083088875, + 1.375282572582364, + 0.5608649346977472, + 0.4474771562963724, + 3.138578588142991, + 0.5360472463071346, + 0.7540625687688589, + 0.3959887605160475, + 0.0, + 3.420294765383005, + 3.367463080212474, + 0.8606202378869057, + 0.576404694467783 + ], + "unique_experts": 63, + "load_cv": 0.7675921337455313, + "normalized_load_entropy": 0.9380034848658538, + "max_load_share": 0.06040268456375839 + } + }, + "s0_period": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "41933a99bd264e2365789d17b391552289a74dda3a093d0e7c9aec099b15d43d", + "route_weight_sha256": "8b7e668fc2236c6be169fcccd690becfe9f2452080caacbdda2659f1d995a16a", + "loads": [ + 10, + 9, + 19, + 4, + 10, + 13, + 6, + 9, + 17, + 18, + 6, + 1, + 9, + 5, + 9, + 10, + 9, + 8, + 3, + 17, + 19, + 17, + 3, + 9, + 10, + 3, + 2, + 5, + 6, + 4, + 11, + 8, + 18, + 14, + 1, + 5, + 5, + 4, + 2, + 34, + 9, + 8, + 7, + 6, + 12, + 2, + 25, + 16, + 7, + 8, + 10, + 4, + 12, + 9, + 10, + 19, + 4, + 14, + 8, + 0, + 20, + 37, + 19, + 10 + ], + "weighted_loads": [ + 0.6113858949393034, + 0.38122380897402763, + 2.0806690640747547, + 0.2868122458457947, + 0.38921840861439705, + 0.5326799601316452, + 0.18947255238890648, + 2.585817366838455, + 0.9173582568764687, + 1.2943773046135902, + 0.30344510544091463, + 0.061694271862506866, + 0.4363266285508871, + 0.16497264709323645, + 0.41349051520228386, + 0.3516897205263376, + 0.5200950875878334, + 0.3736468479037285, + 0.12505552172660828, + 0.7151003871113062, + 0.9763412196189165, + 1.2292077727615833, + 0.10619874112308025, + 0.5954597741365433, + 0.4014712870121002, + 0.10957356169819832, + 0.07645640149712563, + 0.13261049054563046, + 0.37652698904275894, + 0.1577277686446905, + 0.38260099850595, + 0.3012333121150732, + 0.7449558153748512, + 0.5380846206098795, + 0.002577861538156867, + 0.1667056940495968, + 0.3748362101614475, + 0.1670176312327385, + 0.07687205076217651, + 2.0834778007119894, + 0.6556236501783133, + 0.5020540095865726, + 0.2839950658380985, + 0.2970272656530142, + 0.41143504716455936, + 0.0748802125453949, + 1.8641309440135956, + 0.7558689620345831, + 0.2881721816956997, + 0.45104771584738046, + 0.48933047242462635, + 0.14541728980839252, + 0.7159966640174389, + 0.4030592776834965, + 0.3776349537074566, + 1.022916978225112, + 0.36925968900322914, + 0.664872694760561, + 0.3271764814853668, + 0.0, + 1.5990342982113361, + 2.5710043124854565, + 0.9094894491136074, + 0.39955211989581585 + ], + "unique_experts": 63, + "load_cv": 0.7097423383607313, + "normalized_load_entropy": 0.9441678410665786, + "max_load_share": 0.05709876543209876 + }, + "full_input": { + "tokens": 133, + "top_k": 6, + "decisions": 798, + "ordered_route_sha256": "00c3311933a46f2b15384e109b57911b76818266017edd21507445ac91b033c8", + "route_weight_sha256": "6ae0461cbff56986086dc4bbbb17d34f004e3276d77adc29b7ca0e7ecff561e7", + "loads": [ + 14, + 10, + 22, + 12, + 10, + 14, + 9, + 9, + 30, + 23, + 6, + 2, + 9, + 5, + 14, + 10, + 9, + 10, + 3, + 17, + 20, + 26, + 5, + 9, + 11, + 4, + 2, + 8, + 6, + 5, + 12, + 8, + 20, + 21, + 2, + 7, + 5, + 6, + 2, + 34, + 14, + 9, + 12, + 6, + 12, + 3, + 26, + 16, + 10, + 9, + 14, + 4, + 14, + 12, + 10, + 33, + 7, + 15, + 9, + 0, + 30, + 45, + 19, + 18 + ], + "weighted_loads": [ + 0.7836250700056553, + 0.48139119520783424, + 2.186442092061043, + 1.2657494619488716, + 0.38921840861439705, + 0.5452805832028389, + 0.3997296579182148, + 2.585817366838455, + 2.1143110571429133, + 1.4904353842139244, + 0.30344510544091463, + 0.07415561564266682, + 0.4363266285508871, + 0.16497264709323645, + 1.4112065397202969, + 0.3516897205263376, + 0.5200950875878334, + 0.4530782140791416, + 0.12505552172660828, + 0.7151003871113062, + 1.0147043522447348, + 1.8543916400521994, + 0.15500850044190884, + 0.5954597741365433, + 0.43300846964120865, + 0.13576188683509827, + 0.07645640149712563, + 0.23406854644417763, + 0.37652698904275894, + 0.20592727698385715, + 0.4007526710629463, + 0.3012333121150732, + 0.8150936849415302, + 0.7812056355178356, + 0.06230350001715124, + 0.27150243520736694, + 0.3748362101614475, + 0.2578447796404362, + 0.07687205076217651, + 2.0834778007119894, + 0.9473997019231319, + 0.5934381373226643, + 0.536810614168644, + 0.2970272656530142, + 0.41143504716455936, + 0.105596037581563, + 1.90432970225811, + 0.7558689620345831, + 0.41096117347478867, + 0.5755660656141117, + 0.7416059318929911, + 0.14541728980839252, + 0.8611750658601522, + 0.5207663234323263, + 0.3776349537074566, + 2.286239581182599, + 0.490656616166234, + 0.6904812622815371, + 0.3450865689665079, + 0.0, + 2.8601941503584385, + 2.850983353331685, + 0.9094894491136074, + 0.7211192827671766 + ], + "unique_experts": 63, + "load_cv": 0.7075974075118692, + "normalized_load_entropy": 0.9445639751322179, + "max_load_share": 0.05639097744360902 + } + }, + "s1_period": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "252a7a22c06b9d7fadc52d28e402458c449e861b9f9f6dc8ba634e3eea00f406", + "route_weight_sha256": "c8e18020455702694604e0ac70a143efcb77e7ff48ef0bd1e704e77cc2bee5e6", + "loads": [ + 9, + 9, + 19, + 5, + 10, + 12, + 2, + 10, + 20, + 16, + 6, + 2, + 9, + 4, + 9, + 8, + 9, + 6, + 3, + 15, + 20, + 18, + 1, + 11, + 10, + 5, + 1, + 1, + 6, + 3, + 12, + 7, + 21, + 13, + 3, + 3, + 5, + 4, + 1, + 36, + 10, + 9, + 7, + 6, + 13, + 4, + 29, + 17, + 5, + 8, + 8, + 2, + 11, + 9, + 12, + 20, + 4, + 14, + 8, + 0, + 18, + 42, + 18, + 10 + ], + "weighted_loads": [ + 0.5678096991032362, + 0.3530930243432522, + 2.0680609438568354, + 0.48841533437371254, + 0.37190146185457706, + 0.47796738520264626, + 0.0668785460293293, + 2.3807306736707687, + 0.9885739292949438, + 1.2329575009644032, + 0.3091628011316061, + 0.09258478879928589, + 0.4538480192422867, + 0.14969635661691427, + 0.4713297076523304, + 0.2783881835639477, + 0.5089442171156406, + 0.3177397660911083, + 0.11749112978577614, + 0.6937741469591856, + 1.0755718164145947, + 1.2716673500835896, + 0.0371839739382267, + 0.6475652828812599, + 0.43105342611670494, + 0.1770648304373026, + 0.03912397101521492, + 0.029413601383566856, + 0.3813379891216755, + 0.12027571350336075, + 0.41993661783635616, + 0.2636268548667431, + 0.8614467866718769, + 0.4932396300137043, + 0.04339315416291356, + 0.09285368956625462, + 0.37641147151589394, + 0.15645152889192104, + 0.04182657226920128, + 2.191261474043131, + 0.7092058844864368, + 0.505393834784627, + 0.28629945404827595, + 0.3050109390169382, + 0.4468487612903118, + 0.13163230568170547, + 2.0447479505091906, + 0.82896569930017, + 0.23380972631275654, + 0.4401611750945449, + 0.37226988933980465, + 0.07575725764036179, + 0.6482101045548916, + 0.38302495516836643, + 0.4718150459229946, + 1.1215286925435066, + 0.3686540611088276, + 0.6840679105371237, + 0.34477661550045013, + 0.0, + 1.4381524249911308, + 2.8111057244241238, + 0.8572553601115942, + 0.39393820241093636 + ], + "unique_experts": 63, + "load_cv": 0.7879019696596963, + "normalized_load_entropy": 0.9331103810898682, + "max_load_share": 0.06481481481481481 + }, + "full_input": { + "tokens": 149, + "top_k": 6, + "decisions": 894, + "ordered_route_sha256": "750f18524725410832b67f1886250825da4ba47833fa487f5c5b8a093463b097", + "route_weight_sha256": "a5d53085f29dc766ab95f3183b91680556a989b68b2b0ddebee28c49caab79d5", + "loads": [ + 11, + 15, + 19, + 15, + 10, + 13, + 6, + 11, + 41, + 25, + 6, + 6, + 12, + 4, + 13, + 12, + 12, + 8, + 4, + 15, + 22, + 33, + 3, + 11, + 10, + 6, + 1, + 3, + 7, + 3, + 14, + 7, + 22, + 25, + 10, + 8, + 7, + 6, + 1, + 39, + 22, + 10, + 12, + 8, + 13, + 4, + 30, + 19, + 8, + 10, + 18, + 5, + 18, + 13, + 12, + 43, + 8, + 15, + 9, + 0, + 34, + 53, + 19, + 15 + ], + "weighted_loads": [ + 0.6947332080453634, + 0.8680739682167768, + 2.0680609438568354, + 1.7307692151516676, + 0.37190146185457706, + 0.49056800827383995, + 0.34107140824198723, + 2.4225767627358437, + 2.730130880139768, + 1.6956586390733719, + 0.3091628011316061, + 0.38033912889659405, + 0.5923083797097206, + 0.14969635661691427, + 1.203115725889802, + 0.5155293233692646, + 0.6529713086783886, + 0.36765727028250694, + 0.15745381638407707, + 0.6937741469591856, + 1.1616582721471786, + 2.413073055446148, + 0.10685351490974426, + 0.6475652828812599, + 0.43105342611670494, + 0.20255903340876102, + 0.03912397101521492, + 0.09441915899515152, + 0.4619949273765087, + 0.12027571350336075, + 0.4919402878731489, + 0.2636268548667431, + 0.9113205336034298, + 0.9363891594111919, + 0.3625344471074641, + 0.30763869173824787, + 0.4665663577616215, + 0.21282082982361317, + 0.04182657226920128, + 2.3311023712158203, + 1.4653783738613129, + 0.5307512562721968, + 0.6630739141255617, + 0.44024051912128925, + 0.4468487612903118, + 0.13163230568170547, + 2.079126762226224, + 0.8968184348195791, + 0.3605686593800783, + 0.9058768516406417, + 0.9084096662700176, + 0.2823627106845379, + 1.3805882818996906, + 0.5600207094103098, + 0.4718150459229946, + 3.0836879033595324, + 0.5895646959543228, + 0.7093277666717768, + 0.3882336914539337, + 0.0, + 3.485241487622261, + 3.2688749842345715, + 0.8855656571686268, + 0.6240771170705557 + ], + "unique_experts": 63, + "load_cv": 0.7676964483010724, + "normalized_load_entropy": 0.9373189293657854, + "max_load_share": 0.0592841163310962 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 108, + "ordered_topk_exact_tokens": 47, + "set_exact_tokens": 62, + "mean_set_jaccard": 0.8636243386243387, + "mean_token_weighted_tv": 0.024615715212011884, + "aggregate_load_tv": 0.0478395061728395 + }, + "system_bos": { + "tokens": 108, + "ordered_topk_exact_tokens": 46, + "set_exact_tokens": 56, + "mean_set_jaccard": 0.8624338624338626, + "mean_token_weighted_tv": 0.02543628962572526, + "aggregate_load_tv": 0.038580246913580245 + }, + "system_x": { + "tokens": 108, + "ordered_topk_exact_tokens": 40, + "set_exact_tokens": 51, + "mean_set_jaccard": 0.8317901234567903, + "mean_token_weighted_tv": 0.0359752576699032, + "aggregate_load_tv": 0.06172839506172839 + }, + "system_period": { + "tokens": 108, + "ordered_topk_exact_tokens": 36, + "set_exact_tokens": 48, + "mean_set_jaccard": 0.8179012345679012, + "mean_token_weighted_tv": 0.03673660592014332, + "aggregate_load_tv": 0.05864197530864197 + }, + "bos_at_s0": { + "tokens": 108, + "ordered_topk_exact_tokens": 43, + "set_exact_tokens": 55, + "mean_set_jaccard": 0.8498677248677249, + "mean_token_weighted_tv": 0.026755935044127033, + "aggregate_load_tv": 0.041666666666666664 + }, + "bos_at_s1": { + "tokens": 108, + "ordered_topk_exact_tokens": 36, + "set_exact_tokens": 45, + "mean_set_jaccard": 0.8111552028218696, + "mean_token_weighted_tv": 0.03331076558593109, + "aggregate_load_tv": 0.05864197530864197 + }, + "x_at_s0": { + "tokens": 108, + "ordered_topk_exact_tokens": 45, + "set_exact_tokens": 60, + "mean_set_jaccard": 0.8508377425044092, + "mean_token_weighted_tv": 0.02993815123260935, + "aggregate_load_tv": 0.041666666666666664 + }, + "x_at_s1": { + "tokens": 108, + "ordered_topk_exact_tokens": 32, + "set_exact_tokens": 39, + "mean_set_jaccard": 0.7925485008818342, + "mean_token_weighted_tv": 0.03949249375727959, + "aggregate_load_tv": 0.06635802469135803 + }, + "period_at_s0": { + "tokens": 108, + "ordered_topk_exact_tokens": 42, + "set_exact_tokens": 51, + "mean_set_jaccard": 0.8357583774250442, + "mean_token_weighted_tv": 0.029210177909893293, + "aggregate_load_tv": 0.05246913580246913 + }, + "period_at_s1": { + "tokens": 108, + "ordered_topk_exact_tokens": 32, + "set_exact_tokens": 42, + "mean_set_jaccard": 0.7952821869488538, + "mean_token_weighted_tv": 0.04072594005265273, + "aggregate_load_tv": 0.06481481481481481 + } + } + }, + "layer_23": { + "layer": 23, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "f983d0e918dbcf51c5ff5bfc615dbc31d086c5f7a1f976babd04fa4381c4e8e9", + "route_weight_sha256": "c8de3dc9778513424d22276543021c01df5b01718c43e099d5df262c01faedd1", + "loads": [ + 13, + 7, + 28, + 6, + 19, + 3, + 18, + 9, + 8, + 8, + 14, + 6, + 13, + 8, + 14, + 2, + 8, + 5, + 8, + 5, + 9, + 7, + 6, + 21, + 9, + 27, + 11, + 13, + 2, + 3, + 20, + 4, + 3, + 8, + 8, + 39, + 12, + 1, + 12, + 4, + 14, + 2, + 14, + 6, + 2, + 3, + 26, + 1, + 4, + 21, + 8, + 3, + 7, + 6, + 21, + 11, + 10, + 23, + 0, + 10, + 17, + 1, + 13, + 4 + ], + "weighted_loads": [ + 0.5199880041182041, + 0.46421097218990326, + 1.1829675883054733, + 0.27035279385745525, + 0.7385531291365623, + 0.10854841396212578, + 1.014523435384035, + 0.30349668487906456, + 0.3726567476987839, + 0.3435458689928055, + 0.6464394778013229, + 0.2293979786336422, + 0.6522283237427473, + 0.5204844251275063, + 0.9101799912750721, + 0.1151637639850378, + 0.41066032089293003, + 0.31773310899734497, + 0.3845728896558285, + 0.26965481229126453, + 0.5984544679522514, + 0.30858913995325565, + 0.31297094374895096, + 1.453031899407506, + 0.31894768960773945, + 1.7766968049108982, + 0.7771538272500038, + 0.6927094254642725, + 0.10563427582383156, + 0.14588308334350586, + 1.0578874461352825, + 0.15532858297228813, + 0.1069015134125948, + 0.28878957964479923, + 0.3125324919819832, + 2.5667820926755667, + 0.5619529709219933, + 0.03303778916597366, + 0.7563121132552624, + 0.1363601479679346, + 0.7483701426535845, + 0.09645113162696362, + 0.5294733047485352, + 1.43799714371562, + 0.08310908824205399, + 0.12398398295044899, + 1.4594923928380013, + 0.05769247189164162, + 0.261288870126009, + 0.8176806140691042, + 0.3080555088818073, + 0.11360390670597553, + 0.5065489001572132, + 0.20333573408424854, + 1.1737566404044628, + 0.5658504888415337, + 0.5968883577734232, + 1.769348980858922, + 0.0, + 0.7386678736656904, + 0.8623588066548109, + 0.08045385777950287, + 0.5428916588425636, + 0.15438349172472954 + ], + "unique_experts": 63, + "load_cv": 0.7635380788180853, + "normalized_load_entropy": 0.9344483632443499, + "max_load_share": 0.06018518518518518 + }, + "full_input": { + "tokens": 133, + "top_k": 6, + "decisions": 798, + "ordered_route_sha256": "d996857c2372e71083cd6b0e4d4eb2d6dedf9d57110077aee588a6fb521dfc19", + "route_weight_sha256": "df83c6a7d497faf9ff8ad9bb3e0c6fd8e0bfcba93c2b782d9e791542dfe7f632", + "loads": [ + 18, + 10, + 28, + 14, + 25, + 6, + 24, + 16, + 9, + 17, + 14, + 7, + 14, + 13, + 16, + 2, + 11, + 5, + 8, + 5, + 9, + 7, + 7, + 32, + 13, + 27, + 11, + 13, + 2, + 3, + 20, + 4, + 5, + 13, + 8, + 39, + 13, + 1, + 16, + 5, + 20, + 2, + 15, + 6, + 2, + 11, + 37, + 4, + 5, + 21, + 9, + 4, + 7, + 7, + 31, + 13, + 10, + 34, + 2, + 10, + 17, + 1, + 16, + 4 + ], + "weighted_loads": [ + 0.7212683244142681, + 0.632709912955761, + 1.1829675883054733, + 0.5035962057299912, + 0.9855930861085653, + 0.21627691248431802, + 1.411001518368721, + 0.6368395499885082, + 0.3734022490680218, + 0.645941499620676, + 0.6464394778013229, + 0.27751775458455086, + 0.6625024396926165, + 0.7310386691242456, + 1.0195945464074612, + 0.1151637639850378, + 0.46194060845300555, + 0.31773310899734497, + 0.3845728896558285, + 0.26965481229126453, + 0.5984544679522514, + 0.30858913995325565, + 0.3316344115883112, + 2.7229763623327017, + 0.4634092431515455, + 1.7766968049108982, + 0.7771538272500038, + 0.6927094254642725, + 0.10563427582383156, + 0.14588308334350586, + 1.0578874461352825, + 0.15532858297228813, + 0.19517243467271328, + 0.5789873864268884, + 0.3125324919819832, + 2.5667820926755667, + 0.6090297661721706, + 0.03303778916597366, + 0.9461794681847095, + 0.16064609214663506, + 1.0830110926181078, + 0.09645113162696362, + 0.5540969837456942, + 1.43799714371562, + 0.08310908824205399, + 2.2028042264282703, + 2.414992142468691, + 0.1205957077909261, + 0.300333958119154, + 0.8176806140691042, + 0.33183953911066055, + 0.2019771058112383, + 0.5065489001572132, + 0.2353097815066576, + 2.0992795191705227, + 0.6605527214705944, + 0.5968883577734232, + 2.7376329451799393, + 0.11722566559910774, + 0.7386678736656904, + 0.8623588066548109, + 0.08045385777950287, + 0.6432277653366327, + 0.15438349172472954 + ], + "unique_experts": 64, + "load_cv": 0.7339508173150454, + "normalized_load_entropy": 0.9387167726077361, + "max_load_share": 0.04887218045112782 + } + }, + "s1_eos": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "241805e8314584baacb4f66813b6d006adfec12c9b67a2e82f1e0a6bd3951c10", + "route_weight_sha256": "633475d5b518807724eec4d58cf221dabf1f5201e9597394e6f5ea91c912dc46", + "loads": [ + 12, + 7, + 27, + 7, + 18, + 3, + 17, + 7, + 9, + 6, + 15, + 6, + 13, + 8, + 14, + 2, + 7, + 5, + 7, + 6, + 12, + 6, + 6, + 21, + 9, + 28, + 13, + 13, + 2, + 3, + 21, + 4, + 3, + 9, + 6, + 39, + 13, + 1, + 12, + 5, + 14, + 2, + 14, + 6, + 3, + 4, + 25, + 2, + 4, + 18, + 8, + 2, + 7, + 5, + 22, + 8, + 10, + 25, + 3, + 10, + 17, + 1, + 11, + 5 + ], + "weighted_loads": [ + 0.5049029532819986, + 0.48015113174915314, + 1.1193829514086246, + 0.3111734427511692, + 0.7323087770491838, + 0.11140511184930801, + 0.9707033783197403, + 0.2501252815127373, + 0.4265224151313305, + 0.27601457200944424, + 0.7095243651419878, + 0.22629143670201302, + 0.6075343489646912, + 0.5202497560530901, + 0.9368183109909296, + 0.11500618979334831, + 0.3836190104484558, + 0.31627902016043663, + 0.3505060225725174, + 0.30495359003543854, + 0.7162769138813019, + 0.2774693965911865, + 0.3178134188055992, + 1.5072656869888306, + 0.3117091841995716, + 1.798298828303814, + 0.8472944684326649, + 0.6924599707126617, + 0.10685785114765167, + 0.15089533478021622, + 1.053335266187787, + 0.170816196128726, + 0.11219282448291779, + 0.3245454505085945, + 0.24451367184519768, + 2.5068201534450054, + 0.5824840199202299, + 0.03343997895717621, + 0.7685682941228151, + 0.16337712295353413, + 0.7317630909383297, + 0.09787246957421303, + 0.5271049775183201, + 1.3001900911331177, + 0.11401420086622238, + 0.15893675945699215, + 1.4680608063936234, + 0.08935721777379513, + 0.26797205582261086, + 0.694482434540987, + 0.3026506379246712, + 0.0826099794358015, + 0.4937906824052334, + 0.15562213584780693, + 1.2028043530881405, + 0.46139154583215714, + 0.6094368230551481, + 1.8335034120827913, + 0.0938618890941143, + 0.7713276222348213, + 0.8651866689324379, + 0.07732231914997101, + 0.4804359972476959, + 0.19133134931325912 + ], + "unique_experts": 64, + "load_cv": 0.7563176983948939, + "normalized_load_entropy": 0.9378783807898317, + "max_load_share": 0.06018518518518518 + }, + "full_input": { + "tokens": 149, + "top_k": 6, + "decisions": 894, + "ordered_route_sha256": "28cc9eb2dc4e67f01588ef61d30be74cea7123e1e6482084da9b532245b8da9b", + "route_weight_sha256": "7dfcae14894638961abb11ad24eaf21c9a449151d4e99644a20fdf28261a2d83", + "loads": [ + 18, + 12, + 33, + 16, + 23, + 6, + 30, + 17, + 11, + 10, + 17, + 8, + 14, + 13, + 16, + 5, + 11, + 6, + 9, + 6, + 13, + 6, + 7, + 36, + 12, + 28, + 13, + 13, + 2, + 4, + 21, + 4, + 4, + 21, + 6, + 39, + 19, + 2, + 19, + 6, + 22, + 2, + 16, + 6, + 5, + 13, + 41, + 6, + 10, + 21, + 9, + 12, + 13, + 7, + 32, + 9, + 10, + 42, + 7, + 10, + 19, + 2, + 18, + 6 + ], + "weighted_loads": [ + 0.8226334729697555, + 0.8044714368879795, + 1.4395132400095463, + 0.805336503777653, + 0.9324823897331953, + 0.19682667264714837, + 1.722713179886341, + 0.6266037579625845, + 0.46215330762788653, + 0.43122632429003716, + 0.8016648758202791, + 0.29446908831596375, + 0.6177649684250355, + 0.7327641732990742, + 1.0720500778406858, + 0.23753272742033005, + 0.46142592234537005, + 0.3751394674181938, + 0.4413449689745903, + 0.30495359003543854, + 0.76399752125144, + 0.2774693965911865, + 0.3362203873693943, + 3.3367163091897964, + 0.43164199590682983, + 1.798298828303814, + 0.8472944684326649, + 0.6924599707126617, + 0.10685785114765167, + 0.19656617939472198, + 1.053335266187787, + 0.170816196128726, + 0.1558135449886322, + 1.0477677325252444, + 0.24451367184519768, + 2.5068201534450054, + 1.0199643913656473, + 0.08085508272051811, + 1.192700881510973, + 0.1866227649152279, + 1.1249207276850939, + 0.09787246957421303, + 0.5799930617213249, + 1.3001900911331177, + 0.21654415875673294, + 2.3004475589841604, + 3.0858393609523773, + 0.319821939105168, + 0.5342052299529314, + 0.8453351557254791, + 0.32776717841625214, + 0.6932578962296247, + 1.1304993405938148, + 0.2168815154582262, + 2.1617112644016743, + 0.4884473439306021, + 0.6094368230551481, + 3.379940552636981, + 0.30813950300216675, + 0.7713276222348213, + 0.940427653491497, + 0.20282918214797974, + 0.7503409422934055, + 0.2312990128993988 + ], + "unique_experts": 64, + "load_cv": 0.7023290319330298, + "normalized_load_entropy": 0.9457143879342318, + "max_load_share": 0.04697986577181208 + } + }, + "s0_bos": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "1c0169a81359c17f69770d2c4d948b7f66ed2c576dc800db20010e3a51c49057", + "route_weight_sha256": "a8ebc608b801f785c96e9eff5a50f29e7bcfd46bf1140a7759c309fccdf67443", + "loads": [ + 14, + 7, + 27, + 6, + 16, + 3, + 18, + 10, + 10, + 10, + 12, + 6, + 10, + 7, + 14, + 2, + 6, + 7, + 7, + 5, + 9, + 8, + 6, + 21, + 10, + 28, + 10, + 12, + 2, + 3, + 22, + 5, + 2, + 8, + 6, + 40, + 13, + 1, + 12, + 6, + 13, + 1, + 14, + 4, + 1, + 4, + 23, + 2, + 4, + 21, + 10, + 4, + 7, + 6, + 21, + 9, + 13, + 24, + 0, + 9, + 17, + 1, + 15, + 4 + ], + "weighted_loads": [ + 0.5497573465108871, + 0.4835997372865677, + 1.1494789831340313, + 0.24932189844548702, + 0.6194655653089285, + 0.11612371169030666, + 1.00474439188838, + 0.318039508536458, + 0.4686373248696327, + 0.4125084672123194, + 0.5694772191345692, + 0.2191842570900917, + 0.5011836979538202, + 0.4943544417619705, + 0.923902640119195, + 0.11089685745537281, + 0.3605751618742943, + 0.38780030980706215, + 0.34533843770623207, + 0.2554943673312664, + 0.6116106770932674, + 0.330054959282279, + 0.3168496899306774, + 1.5166982971131802, + 0.3543535079807043, + 1.814502289518714, + 0.80610391497612, + 0.6569018047302961, + 0.10594405978918076, + 0.14482900872826576, + 1.1818540431559086, + 0.1911451444029808, + 0.0746491439640522, + 0.2674584165215492, + 0.24817495420575142, + 2.5567824244499207, + 0.6126155965030193, + 0.03462490066885948, + 0.7530435025691986, + 0.1941323522478342, + 0.7210779655724764, + 0.07238654047250748, + 0.5299638751894236, + 1.255571085959673, + 0.04667908698320389, + 0.15479469671845436, + 1.3684967942535877, + 0.0833682045340538, + 0.2622922845184803, + 0.8474166914820671, + 0.38765962049365044, + 0.1715819537639618, + 0.5000570379197598, + 0.20129903964698315, + 1.153233390301466, + 0.5071592517197132, + 0.7222186233848333, + 1.8867118135094643, + 0.0, + 0.6879026293754578, + 0.8160359282046556, + 0.07925868779420853, + 0.6117429751902819, + 0.15840132161974907 + ], + "unique_experts": 63, + "load_cv": 0.7631387387913873, + "normalized_load_entropy": 0.9345014998683702, + "max_load_share": 0.06172839506172839 + }, + "full_input": { + "tokens": 133, + "top_k": 6, + "decisions": 798, + "ordered_route_sha256": "b1044868828c45dacea485cf1b3e60c467f898c23fc700e6b5ec53648eacf476", + "route_weight_sha256": "e583288f1fb1f092e7e1b15363a2e7bf0206d62e9261ae98c700bc31d5de8d59", + "loads": [ + 17, + 10, + 27, + 13, + 22, + 6, + 24, + 17, + 10, + 19, + 12, + 6, + 12, + 12, + 15, + 2, + 9, + 7, + 7, + 6, + 9, + 8, + 8, + 33, + 14, + 28, + 11, + 12, + 2, + 3, + 22, + 5, + 3, + 11, + 6, + 40, + 13, + 1, + 15, + 7, + 20, + 1, + 15, + 5, + 1, + 11, + 34, + 4, + 5, + 22, + 11, + 5, + 7, + 6, + 31, + 12, + 13, + 36, + 4, + 10, + 17, + 1, + 17, + 6 + ], + "weighted_loads": [ + 0.6770811593160033, + 0.6520986780524254, + 1.1494789831340313, + 0.47900971909984946, + 0.8819613978266716, + 0.22425054805353284, + 1.3998473659157753, + 0.6299757994711399, + 0.4686373248696327, + 0.7162445988506079, + 0.5694772191345692, + 0.2191842570900917, + 0.5420291032642126, + 0.7049086857587099, + 0.9948066640645266, + 0.11089685745537281, + 0.4118554494343698, + 0.38780030980706215, + 0.34533843770623207, + 0.4314223937690258, + 0.6116106770932674, + 0.330054959282279, + 0.37550084851682186, + 2.9219789542257786, + 0.5058468114584684, + 1.814502289518714, + 0.9325003325939178, + 0.6569018047302961, + 0.10594405978918076, + 0.14482900872826576, + 1.1818540431559086, + 0.1911451444029808, + 0.12829932942986488, + 0.5091535337269306, + 0.24817495420575142, + 2.5567824244499207, + 0.6126155965030193, + 0.03462490066885948, + 0.918191984295845, + 0.21841829642653465, + 1.0909472052007914, + 0.07238654047250748, + 0.5545875541865826, + 1.3007650449872017, + 0.04667908698320389, + 1.2677068673074245, + 2.3239965438842773, + 0.14245464280247688, + 0.3013373725116253, + 0.8975853770971298, + 0.4441564455628395, + 0.25995515286922455, + 0.5000570379197598, + 0.20129903964698315, + 2.078756269067526, + 0.6461524199694395, + 0.7222186233848333, + 2.857575638219714, + 0.20441938191652298, + 0.943089097738266, + 0.8160359282046556, + 0.07925868779420853, + 0.6810033600777388, + 0.2322953473776579 + ], + "unique_experts": 64, + "load_cv": 0.7336769007624165, + "normalized_load_entropy": 0.9388854863017653, + "max_load_share": 0.05012531328320802 + } + }, + "s1_bos": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "3e67af17341a353f2689b8eec34dc913332bbdf29ef703d367dfa415f8807d02", + "route_weight_sha256": "1fb2ad6e82df2d199f13b1a3270663e76ab3fa4c74b776f7732b35ba50ca6b16", + "loads": [ + 16, + 7, + 28, + 7, + 15, + 4, + 18, + 9, + 9, + 8, + 13, + 5, + 14, + 7, + 15, + 2, + 7, + 6, + 10, + 6, + 11, + 8, + 6, + 22, + 8, + 28, + 11, + 11, + 1, + 3, + 19, + 4, + 2, + 10, + 6, + 38, + 11, + 0, + 11, + 3, + 14, + 2, + 14, + 6, + 2, + 4, + 25, + 3, + 4, + 20, + 9, + 3, + 7, + 4, + 21, + 8, + 12, + 26, + 2, + 8, + 16, + 1, + 13, + 5 + ], + "weighted_loads": [ + 0.6128053143620491, + 0.46972741931676865, + 1.1999211180955172, + 0.30511152744293213, + 0.5839397106319666, + 0.14419370144605637, + 1.001118902117014, + 0.30242778919637203, + 0.41127692721784115, + 0.33883112482726574, + 0.6203879080712795, + 0.1913017388433218, + 0.6261482257395983, + 0.5057503171265125, + 0.9856724292039871, + 0.11285976320505142, + 0.38104258477687836, + 0.34293785132467747, + 0.4528554007411003, + 0.2723527615889907, + 0.6856585443019867, + 0.3508503772318363, + 0.3147616647183895, + 1.5680188238620758, + 0.28247221000492573, + 1.7861060723662376, + 0.7838153913617134, + 0.6301752179861069, + 0.06886634975671768, + 0.15828116610646248, + 1.0230324734002352, + 0.16379202157258987, + 0.07744138687849045, + 0.3427321258932352, + 0.2502062991261482, + 2.544127417728305, + 0.5231863707304001, + 0.0, + 0.7282474935054779, + 0.09231962263584137, + 0.7714698314666748, + 0.09672589227557182, + 0.523283900693059, + 1.5042862705886364, + 0.08028354495763779, + 0.16219918802380562, + 1.4688422977924347, + 0.11210940405726433, + 0.26528073847293854, + 0.7989801932126284, + 0.3370315246284008, + 0.11363381147384644, + 0.49500951915979385, + 0.13907059654593468, + 1.1420538276433945, + 0.4601793475449085, + 0.6949443612247705, + 1.8860841020941734, + 0.07271777465939522, + 0.6263775881379843, + 0.7845179960131645, + 0.0761794000864029, + 0.5214695297181606, + 0.20037207379937172 + ], + "unique_experts": 63, + "load_cv": 0.7585312177434881, + "normalized_load_entropy": 0.9357100914742001, + "max_load_share": 0.05864197530864197 + }, + "full_input": { + "tokens": 149, + "top_k": 6, + "decisions": 894, + "ordered_route_sha256": "6fb6b715f1f1af0eeebd7c324e5ce45d4328a0cd865d005bdf7296c39c09f965", + "route_weight_sha256": "5eb4b7a608133abe654b095771f8418dbb8c62a31c3169a3e48f6f8ca5956f40", + "loads": [ + 21, + 12, + 34, + 15, + 21, + 7, + 30, + 19, + 10, + 12, + 15, + 7, + 15, + 12, + 16, + 5, + 11, + 7, + 12, + 6, + 12, + 8, + 8, + 38, + 11, + 28, + 11, + 11, + 1, + 4, + 20, + 4, + 3, + 20, + 6, + 38, + 17, + 2, + 17, + 4, + 23, + 2, + 16, + 6, + 4, + 11, + 42, + 6, + 10, + 23, + 9, + 13, + 13, + 8, + 31, + 11, + 12, + 44, + 6, + 8, + 18, + 2, + 19, + 7 + ], + "weighted_loads": [ + 0.9297719849273562, + 0.794047724455595, + 1.5200514066964388, + 0.7957433215342462, + 0.831191061064601, + 0.25169539684429765, + 1.7099554613232613, + 0.6980329733341932, + 0.44618486426770687, + 0.5001059770584106, + 0.7125284187495708, + 0.2735892590135336, + 0.6363788451999426, + 0.7182647343724966, + 1.0822508856654167, + 0.23538630083203316, + 0.4588494966737926, + 0.40179829858243465, + 0.5436943471431732, + 0.2723527615889907, + 0.7333791516721249, + 0.3508503772318363, + 0.3826344572007656, + 3.4918610379099846, + 0.4149193521589041, + 1.7861060723662376, + 0.7838153913617134, + 0.6301752179861069, + 0.06886634975671768, + 0.20395201072096825, + 1.072438744828105, + 0.16379202157258987, + 0.12106210738420486, + 0.9815509617328644, + 0.2502062991261482, + 2.544127417728305, + 0.9606667421758175, + 0.0941576138138771, + 1.095496067777276, + 0.11556526459753513, + 1.2468114029616117, + 0.09672589227557182, + 0.5761719848960638, + 1.5042862705886364, + 0.18281350284814835, + 1.2817750331014395, + 3.111159412190318, + 0.33885515481233597, + 0.5315139126032591, + 0.9498329143971205, + 0.3370315246284008, + 0.7242817282676697, + 1.1317181773483753, + 0.31794552505016327, + 2.1009607389569283, + 0.596294891089201, + 0.6949443612247705, + 3.426839806139469, + 0.29740162193775177, + 0.6263775881379843, + 0.8597589805722237, + 0.20168626308441162, + 0.7566677816212177, + 0.2954973578453064 + ], + "unique_experts": 64, + "load_cv": 0.7161038531635845, + "normalized_load_entropy": 0.9437269536309255, + "max_load_share": 0.049217002237136466 + } + }, + "s0_x": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "fd25bc40b6eef8ca3e9e2cc3b9faf5158dcd28637cbdaf3ca79d5f4193bd4ca9", + "route_weight_sha256": "300bf76c1ad5a05f5b9d970b323ed78337c50b93bab897be066301b67f382ac6", + "loads": [ + 14, + 7, + 28, + 4, + 18, + 3, + 18, + 8, + 8, + 10, + 11, + 5, + 12, + 8, + 13, + 2, + 7, + 8, + 9, + 4, + 10, + 6, + 6, + 22, + 13, + 27, + 10, + 13, + 2, + 3, + 20, + 4, + 2, + 8, + 6, + 38, + 14, + 1, + 12, + 5, + 13, + 2, + 13, + 5, + 2, + 4, + 24, + 2, + 4, + 19, + 10, + 4, + 7, + 6, + 21, + 9, + 10, + 24, + 1, + 9, + 19, + 1, + 14, + 6 + ], + "weighted_loads": [ + 0.5437492206692696, + 0.474612295627594, + 1.1892335508018732, + 0.20538687333464622, + 0.6964236758649349, + 0.1118090059608221, + 1.051201704889536, + 0.2664926964789629, + 0.3823109306395054, + 0.3945463038980961, + 0.53597342222929, + 0.18873888067901134, + 0.5823912881314754, + 0.5244020558893681, + 0.8910284414887428, + 0.1155012771487236, + 0.39780522510409355, + 0.4289075694978237, + 0.4082031548023224, + 0.2114802598953247, + 0.6453979834914207, + 0.23306182771921158, + 0.3223315179347992, + 1.5056409388780594, + 0.43343489430844784, + 1.7418507263064384, + 0.8564998432993889, + 0.6930990125983953, + 0.11005308479070663, + 0.14213254116475582, + 1.076881978660822, + 0.17013124376535416, + 0.07467220351099968, + 0.2725558076053858, + 0.24453281238675117, + 2.4598836041986942, + 0.6592114623636007, + 0.035506390035152435, + 0.7555168531835079, + 0.15479787811636925, + 0.6432613506913185, + 0.09397885389626026, + 0.4931799713522196, + 1.3730212282389402, + 0.08334429934620857, + 0.15904794819653034, + 1.4172394461929798, + 0.08165399171411991, + 0.26484987139701843, + 0.7640515603125095, + 0.3628972452133894, + 0.1518461462110281, + 0.4837130308151245, + 0.1950298696756363, + 1.1918629743158817, + 0.5347878411412239, + 0.6126714795827866, + 1.9281825385987759, + 0.032124072313308716, + 0.7387977596372366, + 0.9193467255681753, + 0.07845190912485123, + 0.5823704041540623, + 0.23525363579392433 + ], + "unique_experts": 64, + "load_cv": 0.7500444532881005, + "normalized_load_entropy": 0.9373342196952512, + "max_load_share": 0.05864197530864197 + }, + "full_input": { + "tokens": 133, + "top_k": 6, + "decisions": 798, + "ordered_route_sha256": "429585312f8db5bec71198937c8618da550ffc6f3b86bd8a4526bc5e5b4782ca", + "route_weight_sha256": "73d0dd550c31b2e3aa710b3719cbed5000bfeed4c61c4b9b03a6fe619c55e9f3", + "loads": [ + 19, + 10, + 28, + 14, + 23, + 6, + 25, + 15, + 8, + 19, + 11, + 5, + 13, + 13, + 15, + 2, + 11, + 8, + 9, + 4, + 10, + 6, + 7, + 34, + 17, + 27, + 10, + 13, + 2, + 3, + 20, + 4, + 3, + 11, + 6, + 38, + 15, + 1, + 16, + 6, + 19, + 2, + 14, + 5, + 2, + 11, + 37, + 4, + 5, + 20, + 10, + 5, + 7, + 6, + 32, + 11, + 10, + 36, + 4, + 9, + 19, + 1, + 16, + 6 + ], + "weighted_loads": [ + 0.7656948426738381, + 0.6431112363934517, + 1.1892335508018732, + 0.6035822848789394, + 0.891814449802041, + 0.23136967839673162, + 1.515298891812563, + 0.5606069192290306, + 0.3823109306395054, + 0.6812412720173597, + 0.53597342222929, + 0.18873888067901134, + 0.5926654040813446, + 0.7349562998861074, + 1.0058642625808716, + 0.1155012771487236, + 0.47903959220275283, + 0.4289075694978237, + 0.4082031548023224, + 0.2114802598953247, + 0.6453979834914207, + 0.23306182771921158, + 0.34099498577415943, + 2.8510587364435196, + 0.5826891604810953, + 1.7418507263064384, + 0.8564998432993889, + 0.6930990125983953, + 0.11005308479070663, + 0.14213254116475582, + 1.076881978660822, + 0.17013124376535416, + 0.12832238897681236, + 0.498900955542922, + 0.24453281238675117, + 2.4598836041986942, + 0.700411120429635, + 0.035506390035152435, + 0.9650946296751499, + 0.1790838222950697, + 0.9280728548765182, + 0.09397885389626026, + 0.5178036503493786, + 1.3730212282389402, + 0.08334429934620857, + 1.2871620506048203, + 2.5257205590605736, + 0.140740429982543, + 0.3038949593901634, + 0.8075457066297531, + 0.3628972452133894, + 0.24021934531629086, + 0.4837130308151245, + 0.1950298696756363, + 2.2524056769907475, + 0.6129981391131878, + 0.6126714795827866, + 2.9655688758939505, + 0.18684733286499977, + 0.7387977596372366, + 0.9193467255681753, + 0.07845190912485123, + 0.6516307890415192, + 0.23525363579392433 + ], + "unique_experts": 64, + "load_cv": 0.7457688177835888, + "normalized_load_entropy": 0.9375216741695862, + "max_load_share": 0.047619047619047616 + } + }, + "s1_x": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "8e05f232b5820c4a5779bb9b5a690b7bc87bc61c18679ff78eb6f5867a572903", + "route_weight_sha256": "0063401d4ea1618a6de04c10de25e4ae4309d253f53b61c8c806fef5c87d4413", + "loads": [ + 15, + 7, + 28, + 5, + 15, + 3, + 19, + 6, + 10, + 9, + 13, + 7, + 15, + 8, + 14, + 2, + 7, + 6, + 10, + 5, + 11, + 7, + 6, + 22, + 8, + 28, + 11, + 13, + 2, + 3, + 20, + 4, + 2, + 9, + 6, + 40, + 12, + 1, + 13, + 6, + 14, + 1, + 11, + 6, + 2, + 6, + 26, + 2, + 4, + 14, + 7, + 3, + 6, + 3, + 21, + 9, + 9, + 23, + 3, + 9, + 22, + 1, + 12, + 6 + ], + "weighted_loads": [ + 0.5698733665049076, + 0.4302498288452625, + 1.1948386449366808, + 0.3242648746818304, + 0.5681157000362873, + 0.12057457864284515, + 1.0928306505084038, + 0.23188117519021034, + 0.47275928035378456, + 0.37948393262922764, + 0.6582822948694229, + 0.2575174979865551, + 0.6736785927787423, + 0.5302280858159065, + 0.9010539054870605, + 0.11188844218850136, + 0.40652760304510593, + 0.34976962581276894, + 0.47073471918702126, + 0.22421470377594233, + 0.7066760361194611, + 0.2843157835304737, + 0.3129677288234234, + 1.6427871603518724, + 0.28426353074610233, + 1.7425628267228603, + 0.7914491379633546, + 0.6934051178395748, + 0.09203813225030899, + 0.14424738474190235, + 1.0357468072324991, + 0.14179801661521196, + 0.07706560008227825, + 0.32084136456251144, + 0.24103378131985664, + 2.5301528833806515, + 0.5739993955940008, + 0.031210055574774742, + 0.8363174647092819, + 0.19302883744239807, + 0.6840850859880447, + 0.0726613774895668, + 0.4111746121197939, + 1.6921460162848234, + 0.08214680477976799, + 0.22045493870973587, + 1.5680035073310137, + 0.10952800884842873, + 0.2501748092472553, + 0.578917596489191, + 0.2713336627930403, + 0.12413386814296246, + 0.44343843311071396, + 0.1198471263051033, + 1.1988843120634556, + 0.49285550974309444, + 0.5674346759915352, + 1.70272496342659, + 0.10260787233710289, + 0.7035075584426522, + 0.9564677029848099, + 0.07595925033092499, + 0.4769867043942213, + 0.22462754882872105 + ], + "unique_experts": 64, + "load_cv": 0.7665264975938463, + "normalized_load_entropy": 0.9362440391779893, + "max_load_share": 0.06172839506172839 + }, + "full_input": { + "tokens": 149, + "top_k": 6, + "decisions": 894, + "ordered_route_sha256": "799231e6464b258379ca9cb5ffbf8481dadc68eb94027a24f1ba25203c904eea", + "route_weight_sha256": "46881816410c4e6636ee15cd4c50c31f975ac8fe0c4c103e0ab304a38f6dfc21", + "loads": [ + 20, + 12, + 34, + 15, + 19, + 6, + 32, + 16, + 11, + 12, + 15, + 8, + 16, + 13, + 15, + 5, + 12, + 7, + 12, + 6, + 12, + 8, + 7, + 39, + 10, + 28, + 11, + 13, + 2, + 4, + 20, + 4, + 3, + 19, + 6, + 40, + 18, + 2, + 21, + 7, + 21, + 1, + 13, + 6, + 4, + 12, + 45, + 5, + 11, + 17, + 7, + 14, + 12, + 4, + 34, + 9, + 9, + 41, + 6, + 9, + 25, + 2, + 19, + 8 + ], + "weighted_loads": [ + 0.8810879467055202, + 0.7545701339840889, + 1.5149689335376024, + 0.895925575401634, + 0.7344416975975037, + 0.20635382318869233, + 1.8656464703381062, + 0.5854292996227741, + 0.5076672174036503, + 0.4962381273508072, + 0.7504228055477142, + 0.28886550664901733, + 0.6839092122390866, + 0.7427425030618906, + 0.9976323619484901, + 0.2344149798154831, + 0.521529698278755, + 0.4086300730705261, + 0.5615736655890942, + 0.2555779376998544, + 0.7543966434895992, + 0.3477436415851116, + 0.3313746973872185, + 3.604569850489497, + 0.36447941325604916, + 1.7425628267228603, + 0.7914491379633546, + 0.6934051178395748, + 0.09203813225030899, + 0.18991822935640812, + 1.0357468072324991, + 0.14179801661521196, + 0.12068632058799267, + 0.9515774454921484, + 0.24103378131985664, + 2.5301528833806515, + 1.0114797670394182, + 0.07862515933811665, + 1.297726396471262, + 0.21627447940409184, + 0.9814128112047911, + 0.0726613774895668, + 0.46406269632279873, + 1.6921460162848234, + 0.18467676267027855, + 1.2904000971466303, + 3.464015046134591, + 0.33627375960350037, + 0.5870162937790155, + 0.7297703176736832, + 0.2713336627930403, + 0.8348386492580175, + 1.0801470912992954, + 0.15115167200565338, + 2.395659115165472, + 0.49285550974309444, + 0.5674346759915352, + 3.2761011868715286, + 0.2509450726211071, + 0.7035075584426522, + 1.0787591114640236, + 0.20146611332893372, + 0.7477342057973146, + 0.31900240294635296 + ], + "unique_experts": 64, + "load_cv": 0.7362830418020989, + "normalized_load_entropy": 0.9412278370054956, + "max_load_share": 0.050335570469798654 + } + }, + "s0_period": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "fd5a583e99f7e4b813c86d1f7b20a81a10c868002c98aedf0e938d13849ac95b", + "route_weight_sha256": "881403ee4c44e53b8bc6d8b202581fc7d6f789f9bf2b0c65b37603b0800b51d4", + "loads": [ + 14, + 7, + 30, + 5, + 19, + 3, + 18, + 9, + 10, + 11, + 14, + 5, + 10, + 8, + 13, + 2, + 7, + 7, + 9, + 4, + 10, + 5, + 6, + 21, + 9, + 28, + 9, + 13, + 2, + 3, + 19, + 5, + 3, + 9, + 6, + 39, + 14, + 1, + 12, + 4, + 13, + 2, + 14, + 6, + 2, + 2, + 24, + 2, + 4, + 20, + 8, + 5, + 7, + 3, + 21, + 8, + 11, + 24, + 0, + 9, + 18, + 1, + 14, + 7 + ], + "weighted_loads": [ + 0.5597000177949667, + 0.4753667898476124, + 1.2492868397384882, + 0.21775725111365318, + 0.7318699471652508, + 0.11126741953194141, + 1.029905654489994, + 0.2951707374304533, + 0.4432920143008232, + 0.44624633714556694, + 0.633328003808856, + 0.18636523373425007, + 0.45075750164687634, + 0.5295960213989019, + 0.9184396639466286, + 0.116669911891222, + 0.3993275724351406, + 0.3913709223270416, + 0.4100484047085047, + 0.22429336234927177, + 0.6634720489382744, + 0.20518784411251545, + 0.31772973015904427, + 1.545026183128357, + 0.3215700015425682, + 1.766127934679389, + 0.8003303296864033, + 0.6921664290130138, + 0.10766656324267387, + 0.14602365717291832, + 1.083805238828063, + 0.17508392222225666, + 0.10887077637016773, + 0.3135975319892168, + 0.24916817247867584, + 2.523763047531247, + 0.6303770542144775, + 0.03572535887360573, + 0.7575941160321236, + 0.12424219585955143, + 0.6682456489652395, + 0.09486982226371765, + 0.5270677506923676, + 1.58827786706388, + 0.08101945370435715, + 0.09149111807346344, + 1.4219526574015617, + 0.08495007827877998, + 0.2661750428378582, + 0.8228512518107891, + 0.2904307022690773, + 0.18073274195194244, + 0.5084821134805679, + 0.11531109362840652, + 1.2013979777693748, + 0.5030669681727886, + 0.5970476604998112, + 1.9327089246362448, + 0.0, + 0.7146175820380449, + 0.832520398311317, + 0.07984927296638489, + 0.5821878369897604, + 0.26655192486941814 + ], + "unique_experts": 63, + "load_cv": 0.7697013555933995, + "normalized_load_entropy": 0.9339247655955094, + "max_load_share": 0.06018518518518518 + }, + "full_input": { + "tokens": 133, + "top_k": 6, + "decisions": 798, + "ordered_route_sha256": "019797e0e04713e0459cc558a454c43d698f6b4f3039cee060dd7a62f113d29a", + "route_weight_sha256": "0dda41a44cd2554dd2c1159e36560e29e0205b2c848e8731ed43f8f4a2c67331", + "loads": [ + 19, + 10, + 31, + 13, + 25, + 6, + 26, + 16, + 10, + 20, + 14, + 5, + 11, + 13, + 14, + 2, + 10, + 7, + 9, + 4, + 10, + 5, + 7, + 33, + 13, + 28, + 9, + 13, + 2, + 3, + 19, + 5, + 4, + 13, + 6, + 39, + 14, + 1, + 17, + 5, + 19, + 2, + 16, + 6, + 2, + 8, + 35, + 4, + 5, + 21, + 8, + 6, + 7, + 5, + 32, + 10, + 11, + 36, + 3, + 9, + 18, + 1, + 16, + 7 + ], + "weighted_loads": [ + 0.7935853013768792, + 0.6438657306134701, + 1.2958623114973307, + 0.47221006779000163, + 0.983246898278594, + 0.23417580919340253, + 1.5675436817109585, + 0.5952109526842833, + 0.4432920143008232, + 0.7552050426602364, + 0.633328003808856, + 0.18636523373425007, + 0.4610316175967455, + 0.7401502653956413, + 0.9893436878919601, + 0.116669911891222, + 0.45060785999521613, + 0.3913709223270416, + 0.4100484047085047, + 0.22429336234927177, + 0.6634720489382744, + 0.20518784411251545, + 0.3363931979984045, + 2.905934862792492, + 0.4664277359843254, + 1.766127934679389, + 0.8003303296864033, + 0.6921664290130138, + 0.10766656324267387, + 0.14602365717291832, + 1.083805238828063, + 0.17508392222225666, + 0.16252096183598042, + 0.5857033524662256, + 0.24916817247867584, + 2.523763047531247, + 0.6303770542144775, + 0.03572535887360573, + 1.1027670986950397, + 0.14852814003825188, + 0.9849489722400904, + 0.09486982226371765, + 0.5946219433099031, + 1.58827786706388, + 0.08101945370435715, + 1.1886274497956038, + 2.3774524070322514, + 0.14403651654720306, + 0.3052201308310032, + 0.8652671687304974, + 0.2904307022690773, + 0.2691059410572052, + 0.5084821134805679, + 0.18929590098559856, + 2.1746255047619343, + 0.5836455468088388, + 0.5970476604998112, + 2.98792777210474, + 0.14713811501860619, + 0.7146175820380449, + 0.832520398311317, + 0.07984927296638489, + 0.6514482218772173, + 0.26655192486941814 + ], + "unique_experts": 64, + "load_cv": 0.7552763710845279, + "normalized_load_entropy": 0.9362546086624776, + "max_load_share": 0.04887218045112782 + } + }, + "s1_period": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "0187b73e1ca74800a5c2a18092807fff69f7d9e34a257230f0e714399eb8716f", + "route_weight_sha256": "05f362fffc221fd4cf6cb0cb2a7f6a45423b9ee61edf931d0c8a3e76282da4a9", + "loads": [ + 15, + 7, + 29, + 4, + 15, + 3, + 18, + 5, + 7, + 8, + 15, + 9, + 12, + 8, + 15, + 2, + 7, + 6, + 10, + 5, + 13, + 8, + 6, + 23, + 9, + 30, + 9, + 12, + 2, + 3, + 19, + 4, + 3, + 13, + 6, + 39, + 11, + 1, + 12, + 4, + 14, + 3, + 12, + 7, + 3, + 4, + 26, + 3, + 4, + 16, + 8, + 3, + 6, + 3, + 22, + 8, + 9, + 23, + 2, + 9, + 19, + 1, + 10, + 6 + ], + "weighted_loads": [ + 0.5849457532167435, + 0.4432042744010687, + 1.213874151930213, + 0.31842369213700294, + 0.5853239167481661, + 0.11591165512800217, + 1.0405875369906425, + 0.17387630231678486, + 0.34679645113646984, + 0.33684453181922436, + 0.7397466227412224, + 0.31077714264392853, + 0.5461409697309136, + 0.5414469987154007, + 0.9611675590276718, + 0.11371289007365704, + 0.40222910791635513, + 0.3503403812646866, + 0.46903568133711815, + 0.21640790160745382, + 0.7731133513152599, + 0.3327259514480829, + 0.3178503029048443, + 1.676814867183566, + 0.32257517985999584, + 1.809800874441862, + 0.7265203967690468, + 0.6617149394005537, + 0.09714241325855255, + 0.14883531257510185, + 1.065206566825509, + 0.15022991131991148, + 0.1037222184240818, + 0.4324758052825928, + 0.25175851210951805, + 2.5376793779432774, + 0.5142961069941521, + 0.03283356502652168, + 0.7685060668736696, + 0.13089283555746078, + 0.6938074044883251, + 0.12404706329107285, + 0.45269561745226383, + 1.6638338789343834, + 0.11791160702705383, + 0.17391331493854523, + 1.5736874174326658, + 0.1308784168213606, + 0.25319867581129074, + 0.640908619388938, + 0.29455895349383354, + 0.1418173648416996, + 0.4786747172474861, + 0.11514404974877834, + 1.2089390493929386, + 0.46829838678240776, + 0.6137577071785927, + 1.7586952280253172, + 0.0737554132938385, + 0.6601511565968394, + 0.8814749252051115, + 0.07599128037691116, + 0.40954745560884476, + 0.2283660415560007 + ], + "unique_experts": 64, + "load_cv": 0.7679171130905672, + "normalized_load_entropy": 0.9368732275938355, + "max_load_share": 0.06018518518518518 + }, + "full_input": { + "tokens": 149, + "top_k": 6, + "decisions": 894, + "ordered_route_sha256": "ea97e9f6ed54fa9ca54a2c0cb08a99ecdc4ef338381ff96c89281d795d447f3a", + "route_weight_sha256": "18f9d33803acc02c34ac2ab1cc0637d1d4386e944cdb77d35b9d80627c28c79b", + "loads": [ + 20, + 12, + 36, + 14, + 19, + 6, + 33, + 15, + 8, + 12, + 17, + 10, + 13, + 13, + 16, + 5, + 12, + 7, + 12, + 6, + 14, + 9, + 7, + 38, + 11, + 30, + 10, + 12, + 2, + 4, + 19, + 4, + 4, + 24, + 6, + 39, + 17, + 2, + 21, + 5, + 22, + 3, + 14, + 7, + 5, + 9, + 44, + 6, + 10, + 19, + 8, + 13, + 12, + 5, + 34, + 8, + 9, + 41, + 4, + 9, + 22, + 2, + 16, + 8 + ], + "weighted_loads": [ + 0.8894285662099719, + 0.7675245795398951, + 1.5723115634173155, + 0.8686968884430826, + 0.7450433801859617, + 0.19843851635232568, + 1.9195659458637238, + 0.530349412932992, + 0.38170438818633556, + 0.488315686583519, + 0.8318871334195137, + 0.34212515130639076, + 0.556371589191258, + 0.7539614159613848, + 1.0577460154891014, + 0.23623942770063877, + 0.5139492149464786, + 0.40920082852244377, + 0.559874627739191, + 0.24987741094082594, + 0.8208339586853981, + 0.40364583767950535, + 0.3362572714686394, + 3.565342927351594, + 0.40279106236994267, + 1.809800874441862, + 0.749446552246809, + 0.6617149394005537, + 0.09714241325855255, + 0.19450615718960762, + 1.065206566825509, + 0.15022991131991148, + 0.14734293892979622, + 1.148128679022193, + 0.25175851210951805, + 2.5376793779432774, + 0.9517764784395695, + 0.08024866878986359, + 1.387023027986288, + 0.15413847751915455, + 1.02814213745296, + 0.12404706329107285, + 0.5055837016552687, + 1.6638338789343834, + 0.2204415649175644, + 1.2206993978470564, + 3.2688280288130045, + 0.35762416757643223, + 0.5194318499416113, + 0.7917613405734301, + 0.29455895349383354, + 0.7524652816355228, + 1.1153833754360676, + 0.18901419453322887, + 2.2770276814699173, + 0.46829838678240776, + 0.6137577071785927, + 3.413324823603034, + 0.19294608384370804, + 0.6601511565968394, + 1.0328006204217672, + 0.2014981433749199, + 0.6447457075119019, + 0.32638942636549473 + ], + "unique_experts": 64, + "load_cv": 0.735412465271594, + "normalized_load_entropy": 0.9421521783993847, + "max_load_share": 0.049217002237136466 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 108, + "ordered_topk_exact_tokens": 56, + "set_exact_tokens": 71, + "mean_set_jaccard": 0.8981481481481481, + "mean_token_weighted_tv": 0.020997584935415675, + "aggregate_load_tv": 0.037037037037037035 + }, + "system_bos": { + "tokens": 108, + "ordered_topk_exact_tokens": 43, + "set_exact_tokens": 62, + "mean_set_jaccard": 0.8683862433862435, + "mean_token_weighted_tv": 0.026009294191478856, + "aggregate_load_tv": 0.054012345679012336 + }, + "system_x": { + "tokens": 108, + "ordered_topk_exact_tokens": 38, + "set_exact_tokens": 55, + "mean_set_jaccard": 0.833994708994709, + "mean_token_weighted_tv": 0.03403726462016089, + "aggregate_load_tv": 0.05401234567901235 + }, + "system_period": { + "tokens": 108, + "ordered_topk_exact_tokens": 41, + "set_exact_tokens": 60, + "mean_set_jaccard": 0.8441358024691359, + "mean_token_weighted_tv": 0.03261986197645052, + "aggregate_load_tv": 0.060185185185185175 + }, + "bos_at_s0": { + "tokens": 108, + "ordered_topk_exact_tokens": 46, + "set_exact_tokens": 66, + "mean_set_jaccard": 0.8710317460317462, + "mean_token_weighted_tv": 0.02572072788003694, + "aggregate_load_tv": 0.04475308641975309 + }, + "bos_at_s1": { + "tokens": 108, + "ordered_topk_exact_tokens": 46, + "set_exact_tokens": 58, + "mean_set_jaccard": 0.8562610229276897, + "mean_token_weighted_tv": 0.02819725348941844, + "aggregate_load_tv": 0.04783950617283951 + }, + "x_at_s0": { + "tokens": 108, + "ordered_topk_exact_tokens": 42, + "set_exact_tokens": 61, + "mean_set_jaccard": 0.851851851851852, + "mean_token_weighted_tv": 0.02938723165748848, + "aggregate_load_tv": 0.043209876543209874 + }, + "x_at_s1": { + "tokens": 108, + "ordered_topk_exact_tokens": 40, + "set_exact_tokens": 55, + "mean_set_jaccard": 0.8423721340388007, + "mean_token_weighted_tv": 0.0341349951017441, + "aggregate_load_tv": 0.05246913580246913 + }, + "period_at_s0": { + "tokens": 108, + "ordered_topk_exact_tokens": 36, + "set_exact_tokens": 61, + "mean_set_jaccard": 0.8586860670194004, + "mean_token_weighted_tv": 0.029365303464820264, + "aggregate_load_tv": 0.041666666666666664 + }, + "period_at_s1": { + "tokens": 108, + "ordered_topk_exact_tokens": 34, + "set_exact_tokens": 54, + "mean_set_jaccard": 0.8326719576719578, + "mean_token_weighted_tv": 0.035699363625435916, + "aggregate_load_tv": 0.05401234567901234 + } + } + }, + "layer_24": { + "layer": 24, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "bb072ccb30b14b7ae2b9cf89e6a8cc3f959f8441e9526a85a32551086d370e6a", + "route_weight_sha256": "2b9683a933375b62ffe2ebcbc7e52f7d61509e4dd90665af0596706f76a95765", + "loads": [ + 10, + 27, + 4, + 14, + 9, + 5, + 8, + 17, + 7, + 10, + 4, + 5, + 13, + 8, + 9, + 9, + 7, + 7, + 6, + 11, + 7, + 3, + 19, + 17, + 20, + 7, + 12, + 6, + 9, + 8, + 16, + 10, + 7, + 22, + 13, + 6, + 8, + 12, + 6, + 9, + 9, + 19, + 3, + 4, + 10, + 13, + 3, + 10, + 7, + 2, + 14, + 17, + 15, + 9, + 12, + 7, + 8, + 5, + 12, + 6, + 12, + 19, + 4, + 21 + ], + "weighted_loads": [ + 0.37707291170954704, + 1.047566307708621, + 0.13193304277956486, + 0.6495131962001324, + 0.36629200354218483, + 0.18122961185872555, + 0.65872697904706, + 0.8336652126163244, + 0.29648351296782494, + 0.6130320504307747, + 0.12556611001491547, + 0.12725361436605453, + 0.6548937894403934, + 0.3839895334094763, + 0.4573238790035248, + 0.3813199270516634, + 0.21041671000421047, + 0.2766336016356945, + 0.1809978485107422, + 0.36148611083626747, + 0.2782771475613117, + 0.1617659442126751, + 1.187981728464365, + 1.0827067494392395, + 0.6682926267385483, + 0.23168172501027584, + 0.5151881477795541, + 1.6368168164044619, + 0.44292207807302475, + 0.34343271143734455, + 0.7313873595558107, + 0.3613600470125675, + 0.21731759048998356, + 2.2806160040199757, + 0.38179737492464483, + 0.2108580283820629, + 0.35409088619053364, + 0.40452590584754944, + 0.1998569294810295, + 0.3337805364280939, + 0.4002493191510439, + 0.6340899728238583, + 0.10258051007986069, + 0.16019820421934128, + 0.3763011619448662, + 0.4472293481230736, + 0.08418180607259274, + 0.35909532755613327, + 0.28399253636598587, + 0.1385965459048748, + 1.400120934471488, + 0.8480508215725422, + 0.499032948166132, + 0.3559020748361945, + 1.0813551470637321, + 0.3223523758351803, + 0.32126845605671406, + 0.17990985326468945, + 0.9630934186279774, + 0.17957917042076588, + 0.42975274473428726, + 1.2003240287303925, + 0.12848505191504955, + 0.8012472740374506 + ], + "unique_experts": 64, + "load_cv": 0.5227633422158057, + "normalized_load_entropy": 0.9686547543017573, + "max_load_share": 0.041666666666666664 + }, + "full_input": { + "tokens": 133, + "top_k": 6, + "decisions": 798, + "ordered_route_sha256": "d4d44d30e3d2a7325a285d18bf7a4e56c8a535ac582d5f216d7d70d09548cbf8", + "route_weight_sha256": "ca8cdd3afcef15b391cee6b34935e44ba73423fc3105eb9e33163ddbbeb44ea7", + "loads": [ + 10, + 28, + 7, + 14, + 9, + 9, + 8, + 18, + 15, + 10, + 15, + 5, + 14, + 8, + 13, + 9, + 7, + 7, + 6, + 11, + 8, + 4, + 27, + 17, + 28, + 7, + 12, + 6, + 16, + 14, + 16, + 13, + 8, + 25, + 20, + 7, + 9, + 15, + 6, + 9, + 9, + 20, + 7, + 6, + 10, + 15, + 3, + 16, + 7, + 2, + 20, + 23, + 20, + 12, + 12, + 7, + 8, + 5, + 22, + 7, + 13, + 34, + 6, + 24 + ], + "weighted_loads": [ + 0.37707291170954704, + 1.0778489094227552, + 0.23724528402090073, + 0.6495131962001324, + 0.36629200354218483, + 0.30687035096343607, + 0.65872697904706, + 0.8886872064322233, + 0.6503338185139, + 0.6130320504307747, + 0.5230156693141907, + 0.12725361436605453, + 0.6576513254549354, + 0.3839895334094763, + 0.5755358263850212, + 0.3813199270516634, + 0.21041671000421047, + 0.2766336016356945, + 0.1809978485107422, + 0.36148611083626747, + 0.31312867999076843, + 0.20129498466849327, + 1.7501414828002453, + 1.0827067494392395, + 0.973929122556001, + 0.23168172501027584, + 0.5151881477795541, + 1.6368168164044619, + 0.7241748087108135, + 0.5747193451970816, + 0.7313873595558107, + 0.4669105336070061, + 0.2461936380714178, + 2.4370547756552696, + 0.608025117078796, + 0.2584695592522621, + 0.44436112977564335, + 1.345615141093731, + 0.1998569294810295, + 0.3337805364280939, + 0.4002493191510439, + 0.6944764405488968, + 0.28749982733279467, + 0.2372310273349285, + 0.3763011619448662, + 0.5421959087252617, + 0.08418180607259274, + 0.7406429512193426, + 0.28399253636598587, + 0.1385965459048748, + 1.6592326890677214, + 1.246787080541253, + 0.6510611362755299, + 0.4936752011999488, + 1.0813551470637321, + 0.3223523758351803, + 0.32126845605671406, + 0.17990985326468945, + 1.2812123680487275, + 0.2197971437126398, + 0.46903612092137337, + 2.2621977236121893, + 0.13138858042657375, + 2.7865144326351583 + ], + "unique_experts": 64, + "load_cv": 0.5538280060336506, + "normalized_load_entropy": 0.9654952187221921, + "max_load_share": 0.042606516290726815 + } + }, + "s1_eos": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "05df719e74589ea0848ba56d2423945a7b34c7e8947a6d2e59c1ff52f6702307", + "route_weight_sha256": "8d5f0ab4b8e8bdd2ee4edcdaf898ec354f33cfce2f80e573912ab3bdf7f7b260", + "loads": [ + 10, + 27, + 2, + 15, + 9, + 4, + 9, + 16, + 9, + 10, + 4, + 4, + 15, + 8, + 9, + 8, + 5, + 8, + 6, + 12, + 9, + 3, + 19, + 17, + 20, + 6, + 13, + 5, + 8, + 7, + 15, + 11, + 6, + 23, + 12, + 7, + 9, + 12, + 5, + 9, + 10, + 20, + 3, + 4, + 8, + 14, + 2, + 10, + 7, + 2, + 15, + 14, + 16, + 9, + 13, + 7, + 7, + 2, + 13, + 8, + 11, + 20, + 4, + 23 + ], + "weighted_loads": [ + 0.379536522552371, + 1.0465207640081644, + 0.06839824095368385, + 0.7012267149984837, + 0.36519367806613445, + 0.151642844080925, + 0.892144588753581, + 0.7933859396725893, + 0.3457439714111388, + 0.6042726710438728, + 0.1225934810936451, + 0.1168934553861618, + 0.7444663383066654, + 0.3806916791945696, + 0.4565160647034645, + 0.3382214941084385, + 0.14755590446293354, + 0.3070247173309326, + 0.19019309058785439, + 0.3920969981700182, + 0.343630651012063, + 0.16429846733808517, + 1.140642350539565, + 1.093406917527318, + 0.685491943731904, + 0.19868160225450993, + 0.6539581757970154, + 1.5969998333603144, + 0.4041960798203945, + 0.3338106479495764, + 0.7889779359102249, + 0.39951168932020664, + 0.19282198138535023, + 2.3498388826847076, + 0.40428432635962963, + 0.25375405326485634, + 0.3997082505375147, + 0.401119839400053, + 0.16618595272302628, + 0.32944174855947495, + 0.42676015198230743, + 0.666863027960062, + 0.08273372799158096, + 0.14586918242275715, + 0.3106969762593508, + 0.4876846317201853, + 0.05567239597439766, + 0.35933974012732506, + 0.2863750923424959, + 0.1349666565656662, + 0.5432537365704775, + 0.764898132532835, + 0.5279783271253109, + 0.36782330740243196, + 1.1050071995705366, + 0.33664139173924923, + 0.294838422909379, + 0.0808185301721096, + 1.0293127372860909, + 0.2391657680273056, + 0.3860792052000761, + 1.3017428014427423, + 0.13117078319191933, + 0.8902419824153185 + ], + "unique_experts": 64, + "load_cv": 0.5569256083278993, + "normalized_load_entropy": 0.963349788264581, + "max_load_share": 0.041666666666666664 + }, + "full_input": { + "tokens": 149, + "top_k": 6, + "decisions": 894, + "ordered_route_sha256": "3e1f0efe9c097cb6baafd8105a7d17f6488a08269926f4a0cbc2aea2d8d5768b", + "route_weight_sha256": "dc446055bd221dd7377e7ba3a634eb29a074d0f6c40e092a23a1cf55b7783f36", + "loads": [ + 10, + 27, + 3, + 16, + 11, + 12, + 9, + 17, + 18, + 13, + 13, + 6, + 18, + 8, + 12, + 8, + 6, + 8, + 7, + 14, + 14, + 4, + 31, + 18, + 31, + 6, + 13, + 5, + 26, + 12, + 15, + 14, + 6, + 29, + 18, + 9, + 16, + 16, + 6, + 9, + 11, + 28, + 8, + 7, + 10, + 15, + 2, + 18, + 7, + 2, + 21, + 28, + 24, + 13, + 15, + 9, + 7, + 3, + 28, + 9, + 16, + 39, + 11, + 29 + ], + "weighted_loads": [ + 0.379536522552371, + 1.0465207640081644, + 0.09385746158659458, + 0.8132445178925991, + 0.4254048056900501, + 0.3984819467877969, + 0.892144588753581, + 0.8330057766288519, + 0.9414925663731992, + 0.7342650555074215, + 0.4826978368218988, + 0.18328855745494366, + 0.8062955760397017, + 0.3806916791945696, + 0.5560684688389301, + 0.3382214941084385, + 0.17633727379143238, + 0.3070247173309326, + 0.22277192771434784, + 0.4503364022821188, + 0.5585635546594858, + 0.21117520332336426, + 1.9177473112940788, + 1.118156099691987, + 1.0870856367982924, + 0.19868160225450993, + 0.6539581757970154, + 1.5969998333603144, + 1.3274343721568584, + 0.5525002181529999, + 0.7889779359102249, + 0.5390207935124636, + 0.19282198138535023, + 2.6607159208506346, + 0.6157068475149572, + 0.35525108873844147, + 0.9238930437713861, + 1.3803973011672497, + 0.2183806076645851, + 0.32944174855947495, + 0.5400082245469093, + 1.120337538421154, + 0.2872283011674881, + 0.3967204559594393, + 0.40411008708178997, + 0.5464077424257994, + 0.05567239597439766, + 0.9308688538148999, + 0.2863750923424959, + 0.1349666565656662, + 0.8077150359749794, + 1.7203240282833576, + 0.7673905156552792, + 0.6553682656958699, + 1.2830469775944948, + 0.4308831784874201, + 0.294838422909379, + 0.12217262759804726, + 1.6233423724770546, + 0.277530275285244, + 0.5434052012860775, + 3.0637874375097454, + 0.4786536789033562, + 2.991993958130479 + ], + "unique_experts": 64, + "load_cv": 0.5923597724740797, + "normalized_load_entropy": 0.9594797029898272, + "max_load_share": 0.0436241610738255 + } + }, + "s0_bos": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "6f94acc08365038d48503bd33c754ba1bc1e58e80bf9abd282c2573ca89bc5b3", + "route_weight_sha256": "fc90f3b8030b09bb4d5e701b8d65a5abda565230dd82bb7aca4b4d1a9f755686", + "loads": [ + 13, + 25, + 5, + 12, + 8, + 4, + 8, + 18, + 4, + 9, + 3, + 5, + 12, + 8, + 9, + 11, + 7, + 7, + 4, + 13, + 9, + 3, + 19, + 16, + 22, + 7, + 12, + 6, + 10, + 10, + 14, + 9, + 6, + 23, + 12, + 7, + 9, + 10, + 7, + 9, + 8, + 20, + 4, + 4, + 12, + 14, + 3, + 12, + 7, + 3, + 12, + 18, + 15, + 9, + 12, + 6, + 9, + 5, + 12, + 8, + 12, + 19, + 3, + 16 + ], + "weighted_loads": [ + 0.464353010058403, + 1.0136291459202766, + 0.16864673048257828, + 0.5962704103440046, + 0.32535097375512123, + 0.1537353526800871, + 0.8943136148154736, + 0.8888813219964504, + 0.1933216080069542, + 0.5893890634179115, + 0.10295581258833408, + 0.11450867727398872, + 0.6506472453474998, + 0.3814479559659958, + 0.466330885887146, + 0.4285625386983156, + 0.21245712041854858, + 0.27491262555122375, + 0.13243565522134304, + 0.416493970900774, + 0.32943175733089447, + 0.17296065390110016, + 1.1466329768300056, + 1.0555439554154873, + 0.7412177417427301, + 0.2285953089594841, + 0.5456463149748743, + 1.7567267715930939, + 0.5032060872763395, + 0.4096191991120577, + 0.69598881714046, + 0.3470073211938143, + 0.17197182960808277, + 2.2834977135062218, + 0.4045523479580879, + 0.2499370314180851, + 0.4038954470306635, + 0.358779214322567, + 0.22442519292235374, + 0.3374319300055504, + 0.38027845695614815, + 0.6930419094860554, + 0.18367531895637512, + 0.1474958322942257, + 0.44997707195580006, + 0.482721708714962, + 0.07915312796831131, + 0.42617188207805157, + 0.2766771037131548, + 0.16110319271683693, + 0.4507608786225319, + 0.8708414640277624, + 0.4805062487721443, + 0.3350498261861503, + 1.1061996743083, + 0.29967636428773403, + 0.3650768958032131, + 0.19002439826726913, + 0.9903004765510559, + 0.23181718215346336, + 0.41794407553970814, + 1.2285490781068802, + 0.10005839169025421, + 0.6853699628263712 + ], + "unique_experts": 64, + "load_cv": 0.5157184833137142, + "normalized_load_entropy": 0.9689804161846853, + "max_load_share": 0.038580246913580245 + }, + "full_input": { + "tokens": 133, + "top_k": 6, + "decisions": 798, + "ordered_route_sha256": "94f35e64aae05b3755134778b04f2ac39bf7b61f460db60fb1742685b7fe4c99", + "route_weight_sha256": "6b214f495b343059b528a85bb99efc5b3560262b1f28cdfdbf0c8cc232d8e2ca", + "loads": [ + 13, + 27, + 8, + 12, + 8, + 8, + 9, + 19, + 11, + 9, + 11, + 5, + 13, + 8, + 13, + 11, + 7, + 7, + 4, + 13, + 10, + 3, + 28, + 16, + 31, + 7, + 13, + 6, + 17, + 16, + 15, + 13, + 8, + 26, + 19, + 7, + 10, + 13, + 7, + 9, + 8, + 21, + 9, + 4, + 13, + 16, + 4, + 16, + 7, + 3, + 19, + 24, + 19, + 12, + 12, + 6, + 9, + 6, + 21, + 9, + 13, + 35, + 4, + 18 + ], + "weighted_loads": [ + 0.464353010058403, + 1.0787372346967459, + 0.2605227567255497, + 0.5962704103440046, + 0.32535097375512123, + 0.27825675008352846, + 0.9503386802971363, + 0.9439033158123493, + 0.5427161157131195, + 0.5893890634179115, + 0.42036232142709196, + 0.11450867727398872, + 0.6534047813620418, + 0.3814479559659958, + 0.5890569668263197, + 0.4285625386983156, + 0.21245712041854858, + 0.27491262555122375, + 0.13243565522134304, + 0.416493970900774, + 0.3642832897603512, + 0.17296065390110016, + 1.8562831729650497, + 1.0555439554154873, + 1.0842529595829546, + 0.2285953089594841, + 1.0131256035529077, + 1.7567267715930939, + 0.7844588179141283, + 0.6409058328717947, + 0.7334262486547232, + 0.4869640842080116, + 0.25908623822033405, + 2.4399364851415157, + 0.6071475413627923, + 0.2499370314180851, + 0.4941656906157732, + 1.300067987293005, + 0.22442519292235374, + 0.3374319300055504, + 0.38027845695614815, + 0.7534283772110939, + 0.4425048353150487, + 0.1474958322942257, + 0.48764204047620296, + 0.5890435948967934, + 0.14218268543481827, + 0.7738121497677639, + 0.2766771037131548, + 0.16110319271683693, + 0.7491408251225948, + 1.2473216820508242, + 0.5942845400422812, + 0.4728229525499046, + 1.1061996743083, + 0.29967636428773403, + 0.3650768958032131, + 0.22732659056782722, + 1.3071656227111816, + 0.2719893120229244, + 0.45722745172679424, + 2.319060420617461, + 0.10176587535534054, + 1.7009625937789679 + ], + "unique_experts": 64, + "load_cv": 0.5567239176358748, + "normalized_load_entropy": 0.9654886873701546, + "max_load_share": 0.043859649122807015 + } + }, + "s1_bos": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "7694a4c2bba7beb77dc93507affb066aaf35fd7573585f7efcf09e5e96707bdd", + "route_weight_sha256": "db431495b01c9e139591348d394cbefe2e7f64eb94fafa0a4773978e7d521f13", + "loads": [ + 13, + 30, + 4, + 12, + 7, + 5, + 10, + 18, + 9, + 9, + 3, + 5, + 13, + 8, + 9, + 11, + 8, + 7, + 5, + 16, + 7, + 3, + 18, + 16, + 20, + 7, + 10, + 5, + 9, + 8, + 14, + 8, + 6, + 22, + 15, + 7, + 10, + 10, + 6, + 9, + 7, + 18, + 6, + 3, + 13, + 13, + 2, + 9, + 8, + 3, + 13, + 15, + 15, + 9, + 12, + 7, + 8, + 4, + 12, + 6, + 11, + 18, + 4, + 20 + ], + "weighted_loads": [ + 0.45900142192840576, + 1.1527522504329681, + 0.1358166392892599, + 0.6000040639191866, + 0.29311549849808216, + 0.17487608082592487, + 0.8143769819289446, + 0.8888732902705669, + 0.3345094444230199, + 0.5772995576262474, + 0.09657043032348156, + 0.11530812969431281, + 0.6743895094841719, + 0.3806359264999628, + 0.46322882920503616, + 0.4209363851696253, + 0.23706179857254028, + 0.27466518990695477, + 0.16894961334764957, + 0.5160555876791477, + 0.28098441660404205, + 0.17341084778308868, + 1.0992263667285442, + 1.0892452392727137, + 0.6715112775564194, + 0.22679168730974197, + 0.5006149914115667, + 1.7335983030498028, + 0.46963260881602764, + 0.35288920998573303, + 0.6915410719811916, + 0.318410562351346, + 0.20765282772481441, + 2.243912745267153, + 0.49924968369305134, + 0.2739318385720253, + 0.4370167087763548, + 0.35806272365152836, + 0.19559397920966148, + 0.32823667116463184, + 0.32512444630265236, + 0.6254559364169836, + 0.26425106823444366, + 0.0945358108729124, + 0.48451290652155876, + 0.44732185639441013, + 0.05166800506412983, + 0.3224149066954851, + 0.3061726354062557, + 0.160733662545681, + 0.47758717834949493, + 0.819549074396491, + 0.49885034188628197, + 0.36914818175137043, + 1.1252241283655167, + 0.3348938561975956, + 0.31424366496503353, + 0.1536442544311285, + 0.984415341168642, + 0.1764213778078556, + 0.3936142064630985, + 1.2044235784560442, + 0.13780243135988712, + 0.7882151938974857 + ], + "unique_experts": 64, + "load_cv": 0.5305770110356617, + "normalized_load_entropy": 0.9679395806261278, + "max_load_share": 0.046296296296296294 + }, + "full_input": { + "tokens": 149, + "top_k": 6, + "decisions": 894, + "ordered_route_sha256": "a0872a499f0532bbdbf7bc15bbc834d0f9e074c0bc3c076fe289fe51d219492f", + "route_weight_sha256": "12bfa0617f517742b3bb02694ead9cfc0884a47d2fc223d9b4accc653cda52e3", + "loads": [ + 13, + 30, + 7, + 13, + 9, + 13, + 10, + 19, + 17, + 12, + 11, + 7, + 16, + 8, + 12, + 11, + 9, + 7, + 6, + 19, + 12, + 4, + 31, + 17, + 30, + 7, + 10, + 5, + 27, + 13, + 14, + 13, + 6, + 28, + 21, + 9, + 17, + 14, + 7, + 9, + 8, + 25, + 13, + 7, + 14, + 15, + 2, + 16, + 8, + 3, + 20, + 29, + 23, + 13, + 14, + 9, + 8, + 5, + 26, + 7, + 15, + 38, + 10, + 23 + ], + "weighted_loads": [ + 0.45900142192840576, + 1.1527522504329681, + 0.22764093056321144, + 0.712021866813302, + 0.35332662612199783, + 0.4210971019929275, + 0.8143769819289446, + 0.9284931272268295, + 0.925915458239615, + 0.7072919420897961, + 0.45075859664939344, + 0.18170323176309466, + 0.7362187472172081, + 0.3806359264999628, + 0.5618106238543987, + 0.4209363851696253, + 0.2658431679010391, + 0.27466518990695477, + 0.20152845047414303, + 0.6048702523112297, + 0.49591732025146484, + 0.21293773874640465, + 1.996692480519414, + 1.1139944214373827, + 1.0380243216641247, + 0.22679168730974197, + 0.5006149914115667, + 1.7335983030498028, + 1.3928709011524916, + 0.5715787801891565, + 0.6915410719811916, + 0.5349865164607763, + 0.20765282772481441, + 2.5547897834330797, + 0.7179393931291997, + 0.37542887404561043, + 0.9612015020102262, + 1.3345369976013899, + 0.24082350730895996, + 0.32823667116463184, + 0.43837251886725426, + 1.0445528496056795, + 0.6542910411953926, + 0.4188514929264784, + 0.5230315215885639, + 0.5552407819777727, + 0.05166800506412983, + 0.8857472065137699, + 0.3061726354062557, + 0.160733662545681, + 0.8492163121700287, + 1.7260628286749125, + 0.7322498690336943, + 0.6566931400448084, + 1.3032639063894749, + 0.42913564294576645, + 0.31424366496503353, + 0.18943453393876553, + 1.5825793705880642, + 0.21605949103832245, + 0.516244625672698, + 2.975517853628844, + 0.4839982750127092, + 1.8417994491755962 + ], + "unique_experts": 64, + "load_cv": 0.5601201804602417, + "normalized_load_entropy": 0.9644807830361811, + "max_load_share": 0.042505592841163314 + } + }, + "s0_x": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "bb66e04a69d302124f5c06524c6bec3381ad1fc7c5e347d2ed7c9893866a631b", + "route_weight_sha256": "2ea919f9e641349d30553750c754fe749393bfee6d0a227f1d2a5ab32b641ba6", + "loads": [ + 13, + 24, + 4, + 13, + 8, + 5, + 9, + 18, + 6, + 10, + 3, + 4, + 12, + 8, + 11, + 11, + 6, + 8, + 6, + 13, + 10, + 3, + 19, + 16, + 19, + 7, + 12, + 6, + 9, + 10, + 14, + 9, + 4, + 23, + 15, + 6, + 9, + 11, + 9, + 8, + 8, + 19, + 1, + 5, + 10, + 11, + 3, + 12, + 7, + 2, + 16, + 18, + 15, + 9, + 12, + 7, + 9, + 4, + 13, + 4, + 13, + 19, + 4, + 16 + ], + "weighted_loads": [ + 0.46554018929600716, + 0.986131576821208, + 0.13140925951302052, + 0.6261509917676449, + 0.3425652775913477, + 0.2008204385638237, + 1.0498701930046082, + 0.8829937595874071, + 0.2537069283425808, + 0.6100593917071819, + 0.10386870428919792, + 0.12115618400275707, + 0.6427386980503798, + 0.38184626772999763, + 0.5171419810503721, + 0.4274232033640146, + 0.17223412729799747, + 0.3057572375983, + 0.19666021689772606, + 0.41932873614132404, + 0.3763622362166643, + 0.15708709880709648, + 1.0897647123783827, + 1.0776350535452366, + 0.6500666011124849, + 0.2302837073802948, + 0.6146995737217367, + 1.777995714917779, + 0.4779840223491192, + 0.4222209472209215, + 0.6932047151494771, + 0.3361758925020695, + 0.1376559492200613, + 2.3184920512139797, + 0.4932868704199791, + 0.22037041932344437, + 0.3881715051829815, + 0.385977815836668, + 0.27896089665591717, + 0.31062361784279346, + 0.38489630073308945, + 0.6519065368920565, + 0.02967621386051178, + 0.18119295313954353, + 0.38484067656099796, + 0.3752669170498848, + 0.06520821340382099, + 0.41518234834074974, + 0.276823652908206, + 0.13324714452028275, + 0.5599406808614731, + 0.8890050649642944, + 0.48264995962381363, + 0.3805684596300125, + 1.0523600690066814, + 0.32592891342937946, + 0.36118143424391747, + 0.1378761138767004, + 0.9571888912469149, + 0.11665706522762775, + 0.47561817057430744, + 1.2215980645269156, + 0.13669008016586304, + 0.6560471002012491 + ], + "unique_experts": 64, + "load_cv": 0.5160139393581819, + "normalized_load_entropy": 0.9674076274052273, + "max_load_share": 0.037037037037037035 + }, + "full_input": { + "tokens": 133, + "top_k": 6, + "decisions": 798, + "ordered_route_sha256": "0183803ab7924e612070073f80a1015076e7cadaf7b130197e784921de05d038", + "route_weight_sha256": "c1eae5fb7fdf0fd772ab459a97590b091369a544993a3428d035ce642b6c7fd8", + "loads": [ + 13, + 24, + 6, + 13, + 8, + 10, + 9, + 20, + 14, + 10, + 12, + 4, + 13, + 8, + 15, + 11, + 6, + 8, + 6, + 13, + 11, + 4, + 26, + 16, + 27, + 7, + 12, + 6, + 17, + 16, + 14, + 12, + 6, + 26, + 23, + 7, + 11, + 14, + 10, + 8, + 9, + 20, + 4, + 5, + 10, + 13, + 3, + 17, + 7, + 2, + 21, + 24, + 20, + 13, + 12, + 7, + 9, + 5, + 23, + 5, + 15, + 35, + 5, + 18 + ], + "weighted_loads": [ + 0.46554018929600716, + 0.986131576821208, + 0.19769538193941116, + 0.6261509917676449, + 0.3425652775913477, + 0.3525246944045648, + 1.0498701930046082, + 0.9716189410537481, + 0.6847727335989475, + 0.6100593917071819, + 0.47451080358587205, + 0.12115618400275707, + 0.6454962340649217, + 0.38184626772999763, + 0.6434649117290974, + 0.4274232033640146, + 0.17223412729799747, + 0.3057572375983, + 0.19666021689772606, + 0.41932873614132404, + 0.411213768646121, + 0.2002267763018608, + 1.5637951139360666, + 1.0776350535452366, + 0.9557030969299376, + 0.2302837073802948, + 0.6146995737217367, + 1.777995714917779, + 0.7952398844063282, + 0.6535075809806585, + 0.6932047151494771, + 0.4482939876616001, + 0.20607646368443966, + 2.4749308228492737, + 0.7441720184870064, + 0.25681471824645996, + 0.5198490880429745, + 1.325738389045, + 0.3172592017799616, + 0.31062361784279346, + 0.4189823307096958, + 0.712293004617095, + 0.1280233832076192, + 0.18119295313954353, + 0.38484067656099796, + 0.4575222544372082, + 0.06520821340382099, + 0.8187106318073347, + 0.276823652908206, + 0.13324714452028275, + 0.7378504239022732, + 1.3056043088436127, + 0.6323784161359072, + 0.5677148438990116, + 1.0523600690066814, + 0.32592891342937946, + 0.36118143424391747, + 0.17234227992594242, + 1.313878994435072, + 0.15251186303794384, + 0.5477497819811106, + 2.3146515116095543, + 0.13839756383094937, + 1.6716397311538458 + ], + "unique_experts": 64, + "load_cv": 0.5534649516836012, + "normalized_load_entropy": 0.9647105702306558, + "max_load_share": 0.043859649122807015 + } + }, + "s1_x": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "e091c99918f9939511e1846d479057e9604d444b9170a67ff5d8cf2d57ead8ab", + "route_weight_sha256": "ba1cd328c613624b1e0355de7378efab90e03c83c244e791fe398e2d6714bcb4", + "loads": [ + 13, + 27, + 4, + 11, + 7, + 5, + 9, + 19, + 5, + 10, + 5, + 5, + 12, + 7, + 10, + 12, + 7, + 8, + 5, + 13, + 9, + 3, + 20, + 16, + 19, + 6, + 12, + 5, + 11, + 8, + 16, + 10, + 5, + 22, + 13, + 10, + 11, + 10, + 7, + 8, + 8, + 15, + 2, + 3, + 13, + 16, + 3, + 10, + 9, + 2, + 16, + 17, + 12, + 8, + 11, + 7, + 7, + 3, + 14, + 4, + 10, + 20, + 4, + 19 + ], + "weighted_loads": [ + 0.4673326015472412, + 1.0616773292422295, + 0.12617739662528038, + 0.5899190995842218, + 0.32364157028496265, + 0.18493482656776905, + 0.9497151933610439, + 0.9197603426873684, + 0.26556876488029957, + 0.609932441264391, + 0.15857403352856636, + 0.12544138450175524, + 0.6544220130890608, + 0.34344588965177536, + 0.47700202092528343, + 0.46708210930228233, + 0.20990299247205257, + 0.3113246448338032, + 0.14692857302725315, + 0.4141552224755287, + 0.38147794269025326, + 0.1537589505314827, + 1.028848433867097, + 1.1148906759917736, + 0.6833978518843651, + 0.1936008632183075, + 0.6207986958324909, + 1.8010455071926117, + 0.49999208375811577, + 0.341528894379735, + 0.792888815049082, + 0.36807756498456, + 0.18302150815725327, + 2.325136300176382, + 0.4217573534697294, + 0.3854328617453575, + 0.46465926244854927, + 0.3539716601371765, + 0.2158300206065178, + 0.3021504655480385, + 0.3671384397894144, + 0.5169201176613569, + 0.06246650218963623, + 0.08989367540925741, + 0.4686721973121166, + 0.5527543090283871, + 0.06534284632652998, + 0.36131004989147186, + 0.3390731271356344, + 0.12373986095190048, + 0.5588824413716793, + 0.8709584660828114, + 0.394316878169775, + 0.3575406987220049, + 0.9868220128118992, + 0.33246905356645584, + 0.28765929862856865, + 0.11608528345823288, + 1.0306091029196978, + 0.11087854020297527, + 0.3591632694005966, + 1.2703265622258186, + 0.14065047726035118, + 0.7278622314333916 + ], + "unique_experts": 64, + "load_cv": 0.5331561205355354, + "normalized_load_entropy": 0.9662516569329539, + "max_load_share": 0.041666666666666664 + }, + "full_input": { + "tokens": 149, + "top_k": 6, + "decisions": 894, + "ordered_route_sha256": "030ae7334c6d4bb57f941022edb528aa248cb869be0de17a0893d08f446ccc5d", + "route_weight_sha256": "0d79a8f6c0aee8d3ce6eb21eddb418e7770352abcddc3dcbf8b334224b382cc5", + "loads": [ + 13, + 27, + 5, + 12, + 9, + 14, + 9, + 20, + 14, + 13, + 12, + 7, + 16, + 7, + 13, + 12, + 9, + 8, + 6, + 15, + 16, + 4, + 31, + 17, + 28, + 6, + 12, + 5, + 31, + 14, + 16, + 15, + 5, + 29, + 20, + 13, + 20, + 14, + 7, + 8, + 9, + 22, + 7, + 6, + 14, + 17, + 3, + 16, + 9, + 2, + 20, + 31, + 20, + 12, + 13, + 9, + 7, + 4, + 28, + 4, + 15, + 41, + 10, + 23 + ], + "weighted_loads": [ + 0.4673326015472412, + 1.0616773292422295, + 0.1516366172581911, + 0.7019369024783373, + 0.3838526979088783, + 0.4557201195275411, + 0.9497151933610439, + 0.959380179643631, + 0.9027360510081053, + 0.7399248257279396, + 0.46885396889410913, + 0.1918364865705371, + 0.7459519025869668, + 0.34344588965177536, + 0.5819707252085209, + 0.46708210930228233, + 0.27410211227834225, + 0.3113246448338032, + 0.1795074101537466, + 0.4723946265876293, + 0.6577105838805437, + 0.18884320557117462, + 1.7181853204965591, + 1.1396398581564426, + 1.0102424253709614, + 0.1936008632183075, + 0.6207986958324909, + 1.8010455071926117, + 1.5009973645210266, + 0.5919374078512192, + 0.792888815049082, + 0.5644440092146397, + 0.18302150815725327, + 2.675399700179696, + 0.6658669016323984, + 0.5411511808633804, + 1.10994478687644, + 1.338091403245926, + 0.2158300206065178, + 0.3021504655480385, + 0.4803865123540163, + 0.9360170308500528, + 0.21322946064174175, + 0.3532175412401557, + 0.5071908123791218, + 0.6114774197340012, + 0.06534284632652998, + 0.8539826750056818, + 0.3390731271356344, + 0.12373986095190048, + 0.744850892573595, + 1.8225460052490234, + 0.633794816210866, + 0.6450856570154428, + 1.1648617908358574, + 0.4267108403146267, + 0.28765929862856865, + 0.15783169865608215, + 1.636982137337327, + 0.11087854020297527, + 0.5234076548367739, + 3.1054881564341486, + 0.48684632091317326, + 1.81943978369236 + ], + "unique_experts": 64, + "load_cv": 0.5835067767827694, + "normalized_load_entropy": 0.9612201621613651, + "max_load_share": 0.04586129753914989 + } + }, + "s0_period": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "ffd3b20a999edef6c5781099114014243f025a9384c12ec688d478e40082f5e3", + "route_weight_sha256": "765cf90b7e68bd7a225b4b11bcc7304b0c11946d4a203b916d5a0431c8aff955", + "loads": [ + 10, + 24, + 6, + 14, + 10, + 5, + 9, + 19, + 5, + 10, + 3, + 4, + 17, + 8, + 10, + 11, + 6, + 8, + 6, + 13, + 8, + 3, + 18, + 15, + 17, + 7, + 11, + 5, + 10, + 10, + 14, + 9, + 5, + 23, + 13, + 6, + 10, + 11, + 8, + 8, + 8, + 20, + 2, + 5, + 12, + 10, + 2, + 11, + 8, + 2, + 13, + 19, + 17, + 7, + 12, + 6, + 10, + 4, + 12, + 7, + 11, + 20, + 4, + 17 + ], + "weighted_loads": [ + 0.36267344281077385, + 1.0024841912090778, + 0.18718989379703999, + 0.6708891466259956, + 0.39921016432344913, + 0.19030349142849445, + 1.0114026926457882, + 0.9073077961802483, + 0.2436881810426712, + 0.6114976145327091, + 0.10372599959373474, + 0.07988708652555943, + 0.7855627182871103, + 0.3892975654453039, + 0.4802707079797983, + 0.4444656502455473, + 0.17340305261313915, + 0.30903785303235054, + 0.19909809716045856, + 0.4156270734965801, + 0.3131809215992689, + 0.15265248715877533, + 1.0952939130365849, + 1.0547631867229939, + 0.5997254084795713, + 0.22939042001962662, + 0.5441913139075041, + 1.738011673092842, + 0.502457994967699, + 0.4158992152661085, + 0.6995952725410461, + 0.3313140943646431, + 0.16766869649291039, + 2.356091570109129, + 0.431631900370121, + 0.2357434630393982, + 0.4342030752450228, + 0.3843027614057064, + 0.25032635405659676, + 0.3141326531767845, + 0.3916250392794609, + 0.6856586057692766, + 0.056037502363324165, + 0.1628656256943941, + 0.4445594511926174, + 0.3505978472530842, + 0.05621308274567127, + 0.38940759375691414, + 0.30094247683882713, + 0.12802578881382942, + 0.46094177290797234, + 0.9320312030613422, + 0.5241603944450617, + 0.30591647233814, + 1.0420113764703274, + 0.29116468131542206, + 0.3936711214482784, + 0.1490656789392233, + 0.9693740047514439, + 0.20011519640684128, + 0.4101357739418745, + 1.2632312010973692, + 0.1343209221959114, + 0.6840559616684914 + ], + "unique_experts": 64, + "load_cv": 0.5160139393581819, + "normalized_load_entropy": 0.9680786947499606, + "max_load_share": 0.037037037037037035 + }, + "full_input": { + "tokens": 133, + "top_k": 6, + "decisions": 798, + "ordered_route_sha256": "39524f7ae73fffe7e6d8c4395a3712ffaf1c7eb8d23f8b0185569c4c4517c9ec", + "route_weight_sha256": "11fbbad67f4b44098faf8c1419f45cafa03cb284fab7e934e589777005fb3df4", + "loads": [ + 11, + 24, + 9, + 14, + 10, + 10, + 9, + 21, + 12, + 10, + 11, + 4, + 18, + 8, + 15, + 11, + 6, + 8, + 6, + 13, + 9, + 4, + 25, + 15, + 26, + 7, + 11, + 5, + 18, + 16, + 14, + 11, + 7, + 27, + 20, + 6, + 11, + 14, + 8, + 8, + 9, + 23, + 7, + 6, + 12, + 11, + 2, + 16, + 8, + 2, + 19, + 26, + 20, + 10, + 12, + 6, + 10, + 5, + 21, + 8, + 13, + 36, + 5, + 19 + ], + "weighted_loads": [ + 0.3995588421821594, + 1.0024841912090778, + 0.29165245965123177, + 0.6708891466259956, + 0.39921016432344913, + 0.34846581367310137, + 1.0114026926457882, + 1.0021361894905567, + 0.5930826887488365, + 0.6114976145327091, + 0.4211325084324926, + 0.07988708652555943, + 0.7883202543016523, + 0.3892975654453039, + 0.6418865006417036, + 0.4444656502455473, + 0.17340305261313915, + 0.30903785303235054, + 0.19909809716045856, + 0.4156270734965801, + 0.3480324540287256, + 0.19637606665492058, + 1.5817159675061703, + 1.0547631867229939, + 0.9400310018099844, + 0.22939042001962662, + 0.5441913139075041, + 1.738011673092842, + 0.8138316515833139, + 0.6471858490258455, + 0.6995952725410461, + 0.40857188776135445, + 0.24685750156641006, + 2.5472860746085644, + 0.6597671960480511, + 0.2357434630393982, + 0.5244733188301325, + 1.322840515524149, + 0.25032635405659676, + 0.3141326531767845, + 0.43672263994812965, + 0.8451232519000769, + 0.24621687922626734, + 0.1997900065034628, + 0.4445594511926174, + 0.3986187241971493, + 0.05621308274567127, + 0.7677058047847822, + 0.30094247683882713, + 0.12802578881382942, + 0.725665707141161, + 1.4309218414127827, + 0.6097602564841509, + 0.4436895987018943, + 1.0420113764703274, + 0.29116468131542206, + 0.3936711214482784, + 0.1809252593666315, + 1.2884788550436497, + 0.23968106135725975, + 0.48054600693285465, + 2.3694606870412827, + 0.13602840586099774, + 1.699648592621088 + ], + "unique_experts": 64, + "load_cv": 0.5514638803713259, + "normalized_load_entropy": 0.9654584385451056, + "max_load_share": 0.045112781954887216 + } + }, + "s1_period": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "1c8b0f388ec2b504164eb8e931ee2df6e670fd927069e716608aaab5e502d4fe", + "route_weight_sha256": "052812735b9fccdd7577b6f8d2e7837ca1dcb06186841cf7ac6f4fcbc398780f", + "loads": [ + 14, + 29, + 4, + 14, + 8, + 5, + 9, + 19, + 6, + 9, + 4, + 4, + 15, + 7, + 10, + 11, + 7, + 8, + 3, + 13, + 11, + 3, + 20, + 16, + 19, + 6, + 11, + 4, + 10, + 9, + 18, + 12, + 7, + 22, + 12, + 7, + 13, + 9, + 6, + 8, + 8, + 16, + 1, + 2, + 11, + 17, + 3, + 10, + 8, + 2, + 12, + 17, + 13, + 9, + 11, + 6, + 9, + 4, + 15, + 6, + 7, + 20, + 4, + 15 + ], + "weighted_loads": [ + 0.4970628898590803, + 1.128799857571721, + 0.1309705264866352, + 0.6852430552244186, + 0.3516122382134199, + 0.17979848757386208, + 0.8052315823733807, + 0.9318878185003996, + 0.3070964307989925, + 0.5719536691904068, + 0.14207486808300018, + 0.11504555121064186, + 0.7425820510834455, + 0.35735103115439415, + 0.45846907049417496, + 0.4223257899284363, + 0.2016627974808216, + 0.32287437841296196, + 0.10043154284358025, + 0.41560396924614906, + 0.398361599072814, + 0.15171075612306595, + 1.020828802138567, + 1.1464503332972527, + 0.6738841254264116, + 0.18790449760854244, + 0.5808520466089249, + 1.760360199958086, + 0.46999424137175083, + 0.36800661869347095, + 0.8622864263597876, + 0.4269065782427788, + 0.25110578164458275, + 2.3424204401671886, + 0.40995694138109684, + 0.27380071952939034, + 0.5238387007266283, + 0.32514182291924953, + 0.191653810441494, + 0.306875754147768, + 0.3675030004233122, + 0.5547938793897629, + 0.026496244594454765, + 0.07318700850009918, + 0.4005710929632187, + 0.5777230802923441, + 0.05458112806081772, + 0.35817812755703926, + 0.3113576825708151, + 0.1261908933520317, + 0.43417292460799217, + 0.9265148583799601, + 0.4334402345120907, + 0.40007805777713656, + 1.0159729942679405, + 0.30735395662486553, + 0.3457123897969723, + 0.14299190789461136, + 1.0903625469654799, + 0.1655309796333313, + 0.2524583451449871, + 1.3148332368582487, + 0.1402713730931282, + 0.6054541785269976 + ], + "unique_experts": 64, + "load_cv": 0.5519775038545224, + "normalized_load_entropy": 0.9635617684125765, + "max_load_share": 0.044753086419753084 + }, + "full_input": { + "tokens": 149, + "top_k": 6, + "decisions": 894, + "ordered_route_sha256": "48051cad55f4be5aefec7d128918a0a4349e5d8fb6e9f7611c1be78648c2105f", + "route_weight_sha256": "dc7800d2208b24b159f56ee351d9b8d4f765948c72204cac03f2d6b55ed4c97f", + "loads": [ + 14, + 29, + 5, + 15, + 10, + 14, + 9, + 21, + 14, + 12, + 11, + 6, + 19, + 7, + 13, + 11, + 8, + 8, + 4, + 17, + 16, + 4, + 31, + 17, + 28, + 6, + 11, + 4, + 30, + 14, + 18, + 15, + 7, + 28, + 18, + 9, + 20, + 14, + 7, + 8, + 9, + 24, + 5, + 6, + 12, + 18, + 3, + 17, + 8, + 2, + 18, + 31, + 20, + 14, + 13, + 8, + 9, + 5, + 30, + 7, + 12, + 41, + 10, + 20 + ], + "weighted_loads": [ + 0.4970628898590803, + 1.128799857571721, + 0.15642974711954594, + 0.7972608581185341, + 0.4118233658373356, + 0.4493454828625545, + 0.8052315823733807, + 1.0095666255801916, + 0.8985024446155876, + 0.7019460536539555, + 0.45235480344854295, + 0.1814406532794237, + 0.8305770182050765, + 0.35735103115439415, + 0.566628023982048, + 0.4223257899284363, + 0.23044416680932045, + 0.32287437841296196, + 0.1330103799700737, + 0.5405513606965542, + 0.6132945027202368, + 0.18256912380456924, + 1.7357209865003824, + 1.1711995154619217, + 1.000728698913008, + 0.18790449760854244, + 0.5808520466089249, + 1.760360199958086, + 1.4837488252669573, + 0.5866961888968945, + 0.8622864263597876, + 0.5664156824350357, + 0.25110578164458275, + 2.6532974783331156, + 0.6243894076906145, + 0.37529775500297546, + 1.0480234939604998, + 1.3549548517912626, + 0.2310098633170128, + 0.306875754147768, + 0.4807510729879141, + 1.0215372517704964, + 0.14412852935492992, + 0.37922416999936104, + 0.43908970803022385, + 0.6364461909979582, + 0.05458112806081772, + 0.8986119880573824, + 0.3113576825708151, + 0.1261908933520317, + 0.730423541739583, + 1.9024144802242517, + 0.6329109091311693, + 0.7343714418821037, + 1.1940127722918987, + 0.4015957433730364, + 0.3457123897969723, + 0.1795361079275608, + 1.7193866576999426, + 0.19670302420854568, + 0.4165413249284029, + 3.1668713646940887, + 0.4864672167459503, + 1.7331219352781773 + ], + "unique_experts": 64, + "load_cv": 0.5911418810496953, + "normalized_load_entropy": 0.9602603465292103, + "max_load_share": 0.04586129753914989 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 108, + "ordered_topk_exact_tokens": 34, + "set_exact_tokens": 57, + "mean_set_jaccard": 0.8571428571428572, + "mean_token_weighted_tv": 0.028119280437412845, + "aggregate_load_tv": 0.041666666666666664 + }, + "system_bos": { + "tokens": 108, + "ordered_topk_exact_tokens": 30, + "set_exact_tokens": 49, + "mean_set_jaccard": 0.828042328042328, + "mean_token_weighted_tv": 0.025935302714868966, + "aggregate_load_tv": 0.05246913580246913 + }, + "system_x": { + "tokens": 108, + "ordered_topk_exact_tokens": 23, + "set_exact_tokens": 36, + "mean_set_jaccard": 0.780952380952381, + "mean_token_weighted_tv": 0.0356313761235301, + "aggregate_load_tv": 0.05864197530864197 + }, + "system_period": { + "tokens": 108, + "ordered_topk_exact_tokens": 26, + "set_exact_tokens": 40, + "mean_set_jaccard": 0.7797178130511464, + "mean_token_weighted_tv": 0.03737861794824884, + "aggregate_load_tv": 0.07098765432098765 + }, + "bos_at_s0": { + "tokens": 108, + "ordered_topk_exact_tokens": 33, + "set_exact_tokens": 53, + "mean_set_jaccard": 0.8390652557319224, + "mean_token_weighted_tv": 0.031991945138778885, + "aggregate_load_tv": 0.04938271604938271 + }, + "bos_at_s1": { + "tokens": 108, + "ordered_topk_exact_tokens": 35, + "set_exact_tokens": 55, + "mean_set_jaccard": 0.8309082892416226, + "mean_token_weighted_tv": 0.02879521275948112, + "aggregate_load_tv": 0.06944444444444445 + }, + "x_at_s0": { + "tokens": 108, + "ordered_topk_exact_tokens": 37, + "set_exact_tokens": 54, + "mean_set_jaccard": 0.8361992945326279, + "mean_token_weighted_tv": 0.03356401557404617, + "aggregate_load_tv": 0.05092592592592593 + }, + "x_at_s1": { + "tokens": 108, + "ordered_topk_exact_tokens": 19, + "set_exact_tokens": 38, + "mean_set_jaccard": 0.765299823633157, + "mean_token_weighted_tv": 0.03944308020786762, + "aggregate_load_tv": 0.07561728395061727 + }, + "period_at_s0": { + "tokens": 108, + "ordered_topk_exact_tokens": 34, + "set_exact_tokens": 52, + "mean_set_jaccard": 0.8328924162257495, + "mean_token_weighted_tv": 0.03456986967487157, + "aggregate_load_tv": 0.06018518518518518 + }, + "period_at_s1": { + "tokens": 108, + "ordered_topk_exact_tokens": 28, + "set_exact_tokens": 40, + "mean_set_jaccard": 0.7678571428571429, + "mean_token_weighted_tv": 0.039526667243249165, + "aggregate_load_tv": 0.08179012345679011 + } + } + }, + "layer_25": { + "layer": 25, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "d0a77c37e68eac28874bc24809b177c428ef4fddc745f70825ba0306b67406b8", + "route_weight_sha256": "2b6d08f2ff485a6d84fcaabf1fab067320d57e13a371406b0781d3944e5b2213", + "loads": [ + 8, + 27, + 7, + 5, + 9, + 12, + 10, + 11, + 8, + 5, + 25, + 4, + 11, + 7, + 6, + 9, + 5, + 13, + 9, + 17, + 12, + 4, + 16, + 9, + 3, + 21, + 14, + 7, + 17, + 3, + 8, + 16, + 1, + 22, + 12, + 6, + 15, + 17, + 8, + 19, + 11, + 7, + 10, + 2, + 16, + 21, + 6, + 8, + 6, + 5, + 10, + 10, + 5, + 2, + 7, + 9, + 13, + 16, + 1, + 7, + 3, + 4, + 19, + 12 + ], + "weighted_loads": [ + 0.37361058220267296, + 2.0265242345631123, + 0.26174815744161606, + 0.19889913871884346, + 0.3267287611961365, + 0.6814870964735746, + 0.5135807879269123, + 0.34655674174427986, + 0.26223087683320045, + 0.16466204077005386, + 1.728776190429926, + 0.17525170743465424, + 0.5199616048485041, + 0.2895049285143614, + 0.2576894350349903, + 0.37029009498655796, + 0.2042730189859867, + 1.3193281888961792, + 0.3695128206163645, + 1.737745938822627, + 0.7018796503543854, + 0.16330484487116337, + 0.5993390958756208, + 0.4683082550764084, + 0.15942533686757088, + 1.9393236096948385, + 0.46108116395771503, + 0.37851469218730927, + 0.889048870652914, + 0.0771331749856472, + 1.0671153590083122, + 1.302070826292038, + 0.03605430945754051, + 0.854013005271554, + 0.34891687519848347, + 0.2811365928500891, + 1.2033965829759836, + 0.734850263223052, + 0.32609269209206104, + 1.987267218530178, + 1.0437171254307032, + 0.3761430699378252, + 0.3581295683979988, + 0.07664752751588821, + 0.9974332172423601, + 1.5244715418666601, + 0.2163631897419691, + 0.29902709275484085, + 0.1979551464319229, + 0.19988925009965897, + 0.5427960120141506, + 0.4465881995856762, + 0.2153307292610407, + 0.09233373589813709, + 0.4438550993800163, + 0.9721774719655514, + 0.4310890566557646, + 0.7632059324532747, + 0.024629779160022736, + 0.4407555013895035, + 0.10208160057663918, + 0.14877190813422203, + 1.7910770252346992, + 0.858227975666523 + ], + "unique_experts": 64, + "load_cv": 0.5846953203068948, + "normalized_load_entropy": 0.9591399002927095, + "max_load_share": 0.041666666666666664 + }, + "full_input": { + "tokens": 133, + "top_k": 6, + "decisions": 798, + "ordered_route_sha256": "2a4cdfe6dd191ecc7867f2f0702c4a56d48ecaa67c2de9457dd82b39f94f79eb", + "route_weight_sha256": "9e179cd9956f998facfd3e7080f0f94544f3ea610bfd4f2a2cf45a705aa98ef7", + "loads": [ + 10, + 46, + 15, + 6, + 9, + 12, + 16, + 11, + 8, + 5, + 35, + 8, + 12, + 7, + 6, + 9, + 5, + 17, + 10, + 17, + 12, + 4, + 16, + 11, + 3, + 21, + 14, + 7, + 18, + 6, + 8, + 18, + 3, + 23, + 13, + 6, + 15, + 18, + 19, + 22, + 21, + 7, + 10, + 4, + 21, + 31, + 9, + 8, + 6, + 6, + 20, + 10, + 11, + 2, + 15, + 9, + 14, + 20, + 1, + 7, + 6, + 4, + 23, + 12 + ], + "weighted_loads": [ + 0.4777187295258045, + 3.4881227375008166, + 0.8038574792444706, + 0.2561951354146004, + 0.3267287611961365, + 0.6814870964735746, + 0.9260121397674084, + 0.34655674174427986, + 0.26223087683320045, + 0.16466204077005386, + 2.633508834987879, + 0.8640433195978403, + 0.5824829358607531, + 0.2895049285143614, + 0.2576894350349903, + 0.37029009498655796, + 0.2042730189859867, + 1.4480549488216639, + 0.395670335739851, + 1.737745938822627, + 0.7018796503543854, + 0.16330484487116337, + 0.5993390958756208, + 0.561520267277956, + 0.15942533686757088, + 1.9393236096948385, + 0.46108116395771503, + 0.37851469218730927, + 0.9310560114681721, + 0.18169992417097092, + 1.0671153590083122, + 1.4242644719779491, + 0.15504813566803932, + 0.9135539922863245, + 0.40062867291271687, + 0.2811365928500891, + 1.2033965829759836, + 0.7812254671007395, + 1.7859951592981815, + 2.338305078446865, + 1.5476524271070957, + 0.3761430699378252, + 0.3581295683979988, + 0.14810598641633987, + 1.3494452945888042, + 2.3503958266228437, + 0.30701264820527285, + 0.29902709275484085, + 0.1979551464319229, + 0.2368496097624302, + 1.1542116701602936, + 0.4465881995856762, + 0.5242641400545835, + 0.09233373589813709, + 0.8313919017091393, + 0.9721774719655514, + 0.4795688409358263, + 0.97932861559093, + 0.024629779160022736, + 0.4407555013895035, + 0.24829994142055511, + 0.14877190813422203, + 2.1645361483097076, + 0.858227975666523 + ], + "unique_experts": 64, + "load_cv": 0.6469030470163157, + "normalized_load_entropy": 0.9547666717633086, + "max_load_share": 0.05764411027568922 + } + }, + "s1_eos": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "362db5484f985e90a2cf6e8637eb733e878302b79f6e26c57a12e83795a54d6b", + "route_weight_sha256": "a8c2b4f8a725ba3631f1ea480282389c7faeb41dc6a3b0bf8ec82bf0b58ac938", + "loads": [ + 9, + 27, + 8, + 5, + 10, + 12, + 12, + 10, + 7, + 5, + 26, + 4, + 11, + 7, + 6, + 10, + 5, + 13, + 8, + 19, + 12, + 2, + 13, + 9, + 3, + 20, + 11, + 7, + 16, + 4, + 8, + 16, + 1, + 24, + 14, + 6, + 14, + 22, + 7, + 19, + 11, + 7, + 9, + 4, + 15, + 20, + 6, + 5, + 5, + 5, + 10, + 10, + 7, + 2, + 8, + 9, + 9, + 16, + 1, + 8, + 3, + 5, + 18, + 13 + ], + "weighted_loads": [ + 0.39695232547819614, + 1.9867677353322506, + 0.2990836352109909, + 0.19751030951738358, + 0.3692977223545313, + 0.6939354445785284, + 0.5939606614410877, + 0.32987552508711815, + 0.22929679788649082, + 0.17990129441022873, + 1.7423275746405125, + 0.17015331238508224, + 0.5458226222544909, + 0.2989541385322809, + 0.27069409005343914, + 0.3915554042905569, + 0.2022733222693205, + 1.3160224370658398, + 0.3520252425223589, + 1.8313384614884853, + 0.7034858502447605, + 0.10405543260276318, + 0.5112408827990294, + 0.4568351712077856, + 0.15460282191634178, + 1.920453418046236, + 0.382824182510376, + 0.3717518635094166, + 0.8771993927657604, + 0.10987774282693863, + 1.189137302339077, + 1.3264642395079136, + 0.03723379597067833, + 0.9219817649573088, + 0.4190259613096714, + 0.28270415030419827, + 1.1681898199021816, + 0.9021426010876894, + 0.2931992467492819, + 1.9426662009209394, + 1.0427974462509155, + 0.3733959440141916, + 0.3161180168390274, + 0.1535591222345829, + 0.9629633575677872, + 1.4508296512067318, + 0.21695906296372414, + 0.19727374240756035, + 0.18149658292531967, + 0.20081839337944984, + 0.5563981905579567, + 0.4538516625761986, + 0.2636909820139408, + 0.09306764975190163, + 0.47622162848711014, + 0.952890656888485, + 0.3089779131114483, + 0.7410246077924967, + 0.02386675402522087, + 0.4678988140076399, + 0.09978943131864071, + 0.18458018824458122, + 1.7269669845700264, + 0.46456019952893257 + ], + "unique_experts": 64, + "load_cv": 0.5940055172207115, + "normalized_load_entropy": 0.95869879953838, + "max_load_share": 0.041666666666666664 + }, + "full_input": { + "tokens": 149, + "top_k": 6, + "decisions": 894, + "ordered_route_sha256": "0033c38025047afc6877db889958b8da89ec7a87b58cf7284025d1be6371201b", + "route_weight_sha256": "2c484b6790259c93dd9d03d63334dfdae8e227ef032c7065bba05b2ce1f302dc", + "loads": [ + 12, + 52, + 19, + 6, + 10, + 13, + 18, + 10, + 9, + 6, + 48, + 8, + 17, + 7, + 6, + 11, + 5, + 21, + 9, + 20, + 15, + 9, + 13, + 14, + 3, + 20, + 11, + 7, + 17, + 7, + 8, + 19, + 7, + 25, + 16, + 6, + 14, + 29, + 17, + 24, + 21, + 7, + 10, + 5, + 24, + 34, + 8, + 5, + 5, + 6, + 22, + 10, + 14, + 9, + 20, + 10, + 12, + 21, + 1, + 9, + 8, + 6, + 23, + 16 + ], + "weighted_loads": [ + 0.6580547373741865, + 4.01812955038622, + 0.9285718724131584, + 0.2716830149292946, + 0.3692977223545313, + 0.7321705427020788, + 1.1488080248236656, + 0.32987552508711815, + 0.34440565668046474, + 0.2087230570614338, + 3.6597371473908424, + 0.8853097595274448, + 0.8620739560574293, + 0.2989541385322809, + 0.27069409005343914, + 0.4329150300472975, + 0.2022733222693205, + 1.9619165360927582, + 0.40557695366442204, + 1.8567901961505413, + 0.9603095911443233, + 0.7473290711641312, + 0.5112408827990294, + 0.6521640624850988, + 0.15460282191634178, + 1.920453418046236, + 0.382824182510376, + 0.3717518635094166, + 0.9229038991034031, + 0.2170824632048607, + 1.189137302339077, + 1.7955457456409931, + 0.3364172801375389, + 0.9691034536808729, + 0.5231978185474873, + 0.28270415030419827, + 1.1681898199021816, + 1.2216614037752151, + 1.9796284157782793, + 2.390523375943303, + 1.5801655799150467, + 0.3733959440141916, + 0.4027223438024521, + 0.18382674641907215, + 1.6104078758507967, + 2.710205202922225, + 0.25998201314359903, + 0.19727374240756035, + 0.18149658292531967, + 0.24519571289420128, + 1.2627942636609077, + 0.4538516625761986, + 0.7038253545761108, + 0.6001136712729931, + 1.2596981981769204, + 0.9794956613332033, + 0.44362736120820045, + 1.0058905463665724, + 0.02386675402522087, + 0.5540856998413801, + 0.3998973537236452, + 0.22779086604714394, + 2.1607286985963583, + 0.5675387419760227 + ], + "unique_experts": 64, + "load_cv": 0.6736975911819546, + "normalized_load_entropy": 0.953601384691427, + "max_load_share": 0.058165548098434 + } + }, + "s0_bos": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "f51d454d3b6773a51bcb68922b32c20a3a821d62c61896154c26742fc92acb4c", + "route_weight_sha256": "ff0791a2402ab3c02c3fe923473bf2ae2f560d00db760345676dee392d1d5477", + "loads": [ + 9, + 27, + 10, + 5, + 12, + 12, + 10, + 9, + 7, + 6, + 26, + 4, + 10, + 6, + 6, + 11, + 5, + 15, + 9, + 17, + 12, + 2, + 17, + 8, + 3, + 19, + 9, + 6, + 18, + 3, + 8, + 16, + 1, + 22, + 14, + 6, + 14, + 21, + 7, + 19, + 13, + 7, + 10, + 2, + 14, + 20, + 5, + 9, + 4, + 6, + 9, + 11, + 4, + 2, + 9, + 8, + 13, + 14, + 1, + 9, + 4, + 4, + 18, + 11 + ], + "weighted_loads": [ + 0.397938733920455, + 2.021010184660554, + 0.3823306057602167, + 0.20369941741228104, + 0.42572843842208385, + 0.7152473479509354, + 0.5049421042203903, + 0.3132321946322918, + 0.23227638565003872, + 0.2062714509665966, + 1.8147398456931114, + 0.16915863379836082, + 0.5049700941890478, + 0.26215201430022717, + 0.24984242394566536, + 0.4315199926495552, + 0.2011963091790676, + 1.387073926627636, + 0.37650064937770367, + 1.7832469306886196, + 0.6916640289127827, + 0.09150023385882378, + 0.6285233534872532, + 0.4245995841920376, + 0.15823270753026009, + 1.8991937264800072, + 0.33167665638029575, + 0.34582292288541794, + 0.9637172538787127, + 0.07964304275810719, + 1.1565739512443542, + 1.2656723745167255, + 0.03751073032617569, + 0.8892061188817024, + 0.41531181521713734, + 0.28389082103967667, + 1.1739910505712032, + 0.8858316037803888, + 0.2777366191148758, + 2.0189351476728916, + 1.149601310491562, + 0.3835826702415943, + 0.35332030057907104, + 0.08171622082591057, + 0.8951953090727329, + 1.4999317917972803, + 0.17541157826781273, + 0.31401177495718, + 0.1373704932630062, + 0.2137178983539343, + 0.533772736787796, + 0.46170517429709435, + 0.17634067870676517, + 0.09517034702003002, + 0.5192704647779465, + 0.9566127508878708, + 0.45824410766363144, + 0.6697370819747448, + 0.02326485887169838, + 0.49732745066285133, + 0.14192911610007286, + 0.15125034749507904, + 1.79008973762393, + 0.37883527763187885 + ], + "unique_experts": 64, + "load_cv": 0.5927211794645829, + "normalized_load_entropy": 0.9577217892720108, + "max_load_share": 0.041666666666666664 + }, + "full_input": { + "tokens": 133, + "top_k": 6, + "decisions": 798, + "ordered_route_sha256": "23ccaf369d510dde00a599e3fa6de41a8dbcb2465c8dad3dfc71c76bc117e01c", + "route_weight_sha256": "d8e2072f918f021a864f054e4e090a18d8a68fb6b1e2fe8b2fd99b0c34c0727e", + "loads": [ + 10, + 45, + 18, + 6, + 12, + 12, + 16, + 10, + 7, + 6, + 36, + 7, + 14, + 6, + 6, + 11, + 5, + 19, + 10, + 17, + 12, + 2, + 17, + 10, + 3, + 19, + 9, + 6, + 19, + 4, + 9, + 17, + 3, + 23, + 16, + 6, + 15, + 22, + 17, + 21, + 23, + 8, + 10, + 5, + 18, + 28, + 7, + 9, + 4, + 8, + 19, + 11, + 9, + 2, + 18, + 8, + 14, + 20, + 1, + 9, + 6, + 4, + 22, + 12 + ], + "weighted_loads": [ + 0.45063157193362713, + 3.393602300900966, + 0.9174818228930235, + 0.3228675425052643, + 0.42572843842208385, + 0.7152473479509354, + 0.9173734560608864, + 0.3610083982348442, + 0.23227638565003872, + 0.2062714509665966, + 2.7748024873435497, + 0.8272736333310604, + 0.7052100393921137, + 0.26215201430022717, + 0.24984242394566536, + 0.4315199926495552, + 0.2011963091790676, + 1.5158006865531206, + 0.4026581645011902, + 1.7832469306886196, + 0.6916640289127827, + 0.09150023385882378, + 0.6285233534872532, + 0.5178115963935852, + 0.15823270753026009, + 1.8991937264800072, + 0.33167665638029575, + 0.34582292288541794, + 1.0057243946939707, + 0.11303669400513172, + 1.4609255492687225, + 1.3507882244884968, + 0.15730615705251694, + 0.9487471058964729, + 0.5124799888581038, + 0.28389082103967667, + 1.2322227992117405, + 0.939563388004899, + 0.8281361032277346, + 2.4414181001484394, + 1.6609329525381327, + 0.42806655541062355, + 0.35332030057907104, + 0.18789632990956306, + 1.2102555818855762, + 2.2229150775820017, + 0.26473651081323624, + 0.31401177495718, + 0.1373704932630062, + 0.297467989847064, + 1.145188394933939, + 0.46170517429709435, + 0.48108219914138317, + 0.09517034702003002, + 0.9585642302408814, + 0.9566127508878708, + 0.5108657702803612, + 0.9326732028275728, + 0.02326485887169838, + 0.49732745066285133, + 0.24555691331624985, + 0.15125034749507904, + 2.1635488606989384, + 0.41056145913898945 + ], + "unique_experts": 64, + "load_cv": 0.6467476698655005, + "normalized_load_entropy": 0.9535770451272615, + "max_load_share": 0.05639097744360902 + } + }, + "s1_bos": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "89967ab39c170577af704c63fde21819aba75913e00b512278922dbba36de064", + "route_weight_sha256": "c783a97ba0be33d3959738d10564410a51b390b431fc2a3cf899f86d68b7f04c", + "loads": [ + 11, + 26, + 9, + 4, + 11, + 12, + 11, + 8, + 7, + 6, + 25, + 4, + 10, + 6, + 7, + 11, + 4, + 15, + 9, + 18, + 12, + 5, + 14, + 9, + 3, + 20, + 12, + 6, + 19, + 5, + 8, + 17, + 1, + 19, + 11, + 5, + 14, + 20, + 5, + 20, + 10, + 7, + 11, + 4, + 15, + 20, + 5, + 6, + 5, + 6, + 10, + 10, + 7, + 2, + 7, + 9, + 13, + 15, + 0, + 7, + 5, + 5, + 18, + 12 + ], + "weighted_loads": [ + 0.4694237858057022, + 2.027023173868656, + 0.40687163919210434, + 0.16016222909092903, + 0.4003955405205488, + 0.7041875571012497, + 0.5591483376920223, + 0.2815345600247383, + 0.23438774421811104, + 0.2020149603486061, + 1.7227965258061886, + 0.16685836389660835, + 0.5266712233424187, + 0.2745130993425846, + 0.28891536965966225, + 0.42426435090601444, + 0.16724352166056633, + 1.404700331389904, + 0.38116523809731007, + 1.900485273450613, + 0.7083022557199001, + 0.18303838185966015, + 0.5307852532714605, + 0.4602466654032469, + 0.1469744499772787, + 1.8912272285670042, + 0.41340426728129387, + 0.349851381033659, + 0.9906688425689936, + 0.13500024378299713, + 1.0429761372506618, + 1.3824594542384148, + 0.0354023203253746, + 0.7719685360789299, + 0.33478590846061707, + 0.25676434114575386, + 1.156529989093542, + 0.8728319350630045, + 0.22726672887802124, + 1.9732226245105267, + 1.041776105761528, + 0.38823578506708145, + 0.3782537318766117, + 0.15756266564130783, + 0.9340665675699711, + 1.4648861922323704, + 0.18137127161026, + 0.23057700134813786, + 0.16698532551527023, + 0.20884603820741177, + 0.5670541040599346, + 0.444332679733634, + 0.2482106052339077, + 0.09433050267398357, + 0.41562139242887497, + 1.0095602739602327, + 0.46483088470995426, + 0.72364092618227, + 0.0, + 0.451755840331316, + 0.17086576484143734, + 0.18252353742718697, + 1.752412747591734, + 0.41882155276834965 + ], + "unique_experts": 63, + "load_cv": 0.5712461877165074, + "normalized_load_entropy": 0.9604240401966407, + "max_load_share": 0.040123456790123455 + }, + "full_input": { + "tokens": 149, + "top_k": 6, + "decisions": 894, + "ordered_route_sha256": "320b2d00101bf2885882ee7716fd3f294db9f6731b242ada3dbac041d81054f4", + "route_weight_sha256": "75eda122b8778d67357d250fadb5a428e08690ca24dc45f4aa5e545a5350f914", + "loads": [ + 13, + 51, + 21, + 5, + 11, + 13, + 17, + 8, + 11, + 7, + 48, + 7, + 18, + 8, + 7, + 11, + 4, + 23, + 10, + 19, + 15, + 12, + 14, + 14, + 3, + 20, + 12, + 6, + 20, + 7, + 8, + 20, + 8, + 20, + 13, + 5, + 14, + 27, + 14, + 24, + 19, + 7, + 12, + 5, + 23, + 34, + 6, + 6, + 5, + 8, + 22, + 10, + 13, + 9, + 19, + 10, + 15, + 21, + 0, + 8, + 9, + 6, + 23, + 16 + ], + "weighted_loads": [ + 0.6662244461476803, + 3.9849621658213437, + 1.1386950351297855, + 0.21615630015730858, + 0.4003955405205488, + 0.7424226552248001, + 1.1139957010746002, + 0.2815345600247383, + 0.43462272360920906, + 0.23083672299981117, + 3.732383269816637, + 0.863390002399683, + 0.9262125268578529, + 0.3640166446566582, + 0.28891536965966225, + 0.42426435090601444, + 0.16724352166056633, + 2.0505944304168224, + 0.4347169492393732, + 1.925937008112669, + 0.965125996619463, + 0.8263120204210281, + 0.5307852532714605, + 0.6555755566805601, + 0.1469744499772787, + 1.8912272285670042, + 0.41340426728129387, + 0.349851381033659, + 1.0363733489066362, + 0.20569036155939102, + 1.0429761372506618, + 1.8515409603714943, + 0.3861399181187153, + 0.819090224802494, + 0.44149716198444366, + 0.25676434114575386, + 1.156529989093542, + 1.2054192870855331, + 1.012890424579382, + 2.409153465181589, + 1.5341029278934002, + 0.38823578506708145, + 0.4648580588400364, + 0.18783028982579708, + 1.54720364138484, + 2.6782273836433887, + 0.22306152805685997, + 0.23057700134813786, + 0.16698532551527023, + 0.29886644147336483, + 1.2734501771628857, + 0.444332679733634, + 0.6841668076813221, + 0.601376524195075, + 1.1990979621186852, + 1.036165278404951, + 0.5677959751337767, + 1.0394511260092258, + 0.0, + 0.5379427261650562, + 0.40678456239402294, + 0.22573421522974968, + 2.186174461618066, + 0.5559678319841623 + ], + "unique_experts": 63, + "load_cv": 0.6604934672632153, + "normalized_load_entropy": 0.9542722572549798, + "max_load_share": 0.05704697986577181 + } + }, + "s0_x": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "9b0e84129ebdbd8a6b8836ba49b5d8d4279ec1a61a0926a50a6364842ea6b833", + "route_weight_sha256": "8a04c843c55a73715bba2cfd4e60f4d927440d0a4137f2e9a8ecd6a88a3aefb1", + "loads": [ + 10, + 27, + 5, + 5, + 11, + 12, + 11, + 7, + 9, + 6, + 25, + 4, + 10, + 6, + 6, + 9, + 5, + 13, + 8, + 19, + 12, + 4, + 14, + 9, + 3, + 20, + 9, + 6, + 20, + 5, + 8, + 17, + 1, + 20, + 11, + 4, + 15, + 22, + 7, + 20, + 12, + 7, + 11, + 3, + 15, + 23, + 4, + 7, + 6, + 6, + 9, + 10, + 6, + 2, + 10, + 9, + 9, + 14, + 1, + 10, + 5, + 5, + 18, + 11 + ], + "weighted_loads": [ + 0.43462537601590157, + 2.058004293590784, + 0.16998019069433212, + 0.20919473096728325, + 0.4095842894166708, + 0.70323146879673, + 0.5355019643902779, + 0.24622639454901218, + 0.3012794516980648, + 0.2045952957123518, + 1.7243794798851013, + 0.16698257252573967, + 0.49962493404746056, + 0.2651271391659975, + 0.24974875524640083, + 0.3725812640041113, + 0.1993405520915985, + 1.3245025984942913, + 0.3279798645526171, + 1.8915210235863924, + 0.6892158389091492, + 0.14614757150411606, + 0.5560987237840891, + 0.4332888014614582, + 0.15434933826327324, + 1.9354513976722956, + 0.3266540616750717, + 0.347573883831501, + 1.0331453457474709, + 0.13625591807067394, + 1.3663633987307549, + 1.3076284416019917, + 0.0352945402264595, + 0.8068612385541201, + 0.33973992243409157, + 0.23010136559605598, + 1.2057035472244024, + 0.9014589823782444, + 0.30295808240771294, + 2.0020689964294434, + 1.1750568710267544, + 0.41441373713314533, + 0.378480639308691, + 0.12041599303483963, + 0.9731435552239418, + 1.5743170082569122, + 0.13185269385576248, + 0.24165471643209457, + 0.2014053910970688, + 0.21157014183700085, + 0.5164054930210114, + 0.43370736204087734, + 0.25285595655441284, + 0.09651792980730534, + 0.5466515999287367, + 0.9590634107589722, + 0.3238799199461937, + 0.6842963509261608, + 0.023829787969589233, + 0.526969475671649, + 0.16849696449935436, + 0.18473491817712784, + 1.7522991560399532, + 0.3827542793005705 + ], + "unique_experts": 64, + "load_cv": 0.5932352482337759, + "normalized_load_entropy": 0.9591551449811445, + "max_load_share": 0.041666666666666664 + }, + "full_input": { + "tokens": 133, + "top_k": 6, + "decisions": 798, + "ordered_route_sha256": "e467224238e5c1b2d3aea543dd1797e9de506f9c6f08d1c715ec2eb1056c7c0a", + "route_weight_sha256": "e24bc16891359672ac392f9337983da345d72d46f9f1692c643365bad59c604b", + "loads": [ + 12, + 47, + 12, + 6, + 11, + 12, + 19, + 7, + 9, + 6, + 35, + 7, + 11, + 6, + 6, + 9, + 5, + 17, + 10, + 19, + 12, + 4, + 15, + 11, + 3, + 20, + 9, + 6, + 21, + 7, + 8, + 19, + 3, + 21, + 12, + 4, + 16, + 23, + 18, + 22, + 23, + 7, + 11, + 4, + 20, + 32, + 6, + 7, + 7, + 6, + 19, + 10, + 12, + 2, + 19, + 9, + 9, + 18, + 1, + 10, + 7, + 5, + 23, + 11 + ], + "weighted_loads": [ + 0.5250990279018879, + 3.6120895580388606, + 0.5761180706322193, + 0.24222662672400475, + 0.4095842894166708, + 0.70323146879673, + 1.0707643665373325, + 0.24622639454901218, + 0.3012794516980648, + 0.2045952957123518, + 2.6449605599045753, + 0.8339606858789921, + 0.5621462650597095, + 0.2651271391659975, + 0.24974875524640083, + 0.3725812640041113, + 0.1993405520915985, + 1.453229358419776, + 0.38074308820068836, + 1.8915210235863924, + 0.6892158389091492, + 0.14614757150411606, + 0.6065660137683153, + 0.5265008136630058, + 0.15434933826327324, + 1.9354513976722956, + 0.3266540616750717, + 0.347573883831501, + 1.0751524865627289, + 0.2003478817641735, + 1.3663633987307549, + 1.4843238927423954, + 0.16963999718427658, + 0.8664022255688906, + 0.38445962220430374, + 0.23010136559605598, + 1.2680233996361494, + 0.9704543314874172, + 0.9683054517954588, + 2.407844617962837, + 1.7663707304745913, + 0.41441373713314533, + 0.378480639308691, + 0.15334809571504593, + 1.3280188795179129, + 2.359514281153679, + 0.221177626401186, + 0.24165471643209457, + 0.24331536516547203, + 0.21157014183700085, + 1.1278211511671543, + 0.43370736204087734, + 0.6712101809680462, + 0.09651792980730534, + 1.0034975549206138, + 0.9590634107589722, + 0.3238799199461937, + 0.8593933451920748, + 0.023829787969589233, + 0.526969475671649, + 0.2786244098097086, + 0.18473491817712784, + 2.164421647787094, + 0.3827542793005705 + ], + "unique_experts": 64, + "load_cv": 0.6678480872974492, + "normalized_load_entropy": 0.9522615144394515, + "max_load_share": 0.05889724310776942 + } + }, + "s1_x": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "58a950b038d424b045dbcbb05283c47b0478779080990feed9917c01a2e47b8d", + "route_weight_sha256": "9d5a2a99f4fe608e4811d18ef7fd54a00c8db7f17ada04f9c9fc0e3ce8c1de55", + "loads": [ + 8, + 28, + 9, + 5, + 13, + 12, + 11, + 7, + 8, + 5, + 26, + 4, + 9, + 6, + 7, + 8, + 4, + 16, + 9, + 19, + 11, + 6, + 15, + 7, + 4, + 20, + 11, + 7, + 19, + 4, + 8, + 18, + 1, + 20, + 8, + 4, + 16, + 22, + 5, + 20, + 12, + 6, + 11, + 2, + 15, + 23, + 5, + 6, + 5, + 5, + 8, + 10, + 8, + 2, + 6, + 9, + 8, + 15, + 1, + 7, + 5, + 8, + 19, + 12 + ], + "weighted_loads": [ + 0.3439549598842859, + 2.0955906119197607, + 0.32210729643702507, + 0.20488851517438889, + 0.4671361166983843, + 0.6785720270127058, + 0.5608973186463118, + 0.24912277795374393, + 0.2574242055416107, + 0.17551585845649242, + 1.7604553885757923, + 0.14588751830160618, + 0.5133974477648735, + 0.26232611760497093, + 0.2710805479437113, + 0.34028192050755024, + 0.1670074537396431, + 1.4797452241182327, + 0.3621660228818655, + 1.8746850043535233, + 0.6807266809046268, + 0.21026415936648846, + 0.5792842600494623, + 0.35552388802170753, + 0.17653624899685383, + 1.9544345084577799, + 0.3940122164785862, + 0.3930494487285614, + 0.9647648651152849, + 0.12353017367422581, + 1.2795860022306442, + 1.361299555748701, + 0.03523017093539238, + 0.7518488969653845, + 0.2485331930220127, + 0.2300250269472599, + 1.2249863259494305, + 0.9046286027878523, + 0.2581972572952509, + 1.9679244980216026, + 1.152054563164711, + 0.39758313819766045, + 0.38451857306063175, + 0.0786043219268322, + 0.9800085350871086, + 1.4968442171812057, + 0.16422687657177448, + 0.2271247487515211, + 0.15647104009985924, + 0.1940816454589367, + 0.4801359362900257, + 0.4298805296421051, + 0.3391118049621582, + 0.09070571139454842, + 0.39880653470754623, + 1.0172184817492962, + 0.2886404413729906, + 0.7431118357926607, + 0.022548682987689972, + 0.4509398676455021, + 0.16221784241497517, + 0.3117313086986542, + 1.7703761141747236, + 0.4293015506118536 + ], + "unique_experts": 64, + "load_cv": 0.6149337977981368, + "normalized_load_entropy": 0.9565715048342105, + "max_load_share": 0.043209876543209874 + }, + "full_input": { + "tokens": 149, + "top_k": 6, + "decisions": 894, + "ordered_route_sha256": "a191a4e9707d2a046c23e2f604d583e4a1c052e1c56500086b9d02fad5ae0510", + "route_weight_sha256": "8c80662e89529c7f3d97b137658c2cf1585d425a57919c61cb6d4590b541d82a", + "loads": [ + 10, + 54, + 20, + 5, + 13, + 13, + 19, + 7, + 10, + 6, + 49, + 7, + 14, + 6, + 7, + 8, + 4, + 25, + 10, + 20, + 14, + 14, + 15, + 13, + 4, + 20, + 11, + 7, + 20, + 7, + 8, + 22, + 7, + 21, + 10, + 4, + 16, + 28, + 15, + 24, + 22, + 6, + 12, + 3, + 25, + 37, + 6, + 6, + 5, + 5, + 22, + 10, + 16, + 9, + 19, + 10, + 9, + 20, + 1, + 8, + 8, + 9, + 24, + 15 + ], + "weighted_loads": [ + 0.540755620226264, + 4.180435358081013, + 0.884267333894968, + 0.20488851517438889, + 0.4671361166983843, + 0.7168071251362562, + 1.3174506071954966, + 0.24912277795374393, + 0.37253306433558464, + 0.2043376211076975, + 3.760357294231653, + 0.8408346679061651, + 0.7866902984678745, + 0.26232611760497093, + 0.2710805479437113, + 0.34028192050755024, + 0.1670074537396431, + 2.172572862356901, + 0.41571773402392864, + 1.9001367390155792, + 0.9375504218041897, + 0.9049650877714157, + 0.5792842600494623, + 0.5900485217571259, + 0.17653624899685383, + 1.9544345084577799, + 0.3940122164785862, + 0.3930494487285614, + 1.0104693714529276, + 0.2422893512994051, + 1.2795860022306442, + 1.9348359070718288, + 0.3226656839251518, + 0.7989705856889486, + 0.3539697267115116, + 0.2300250269472599, + 1.2249863259494305, + 1.1735090799629688, + 1.1015722583979368, + 2.410022258758545, + 1.7160035036504269, + 0.39758313819766045, + 0.47112290002405643, + 0.10887194611132145, + 1.663988972082734, + 2.7296634316444397, + 0.20591713301837444, + 0.2271247487515211, + 0.15647104009985924, + 0.1940816454589367, + 1.3276676945388317, + 0.4298805296421051, + 0.9362920001149178, + 0.5977517329156399, + 1.2864732379093766, + 1.0438234861940145, + 0.3182188402861357, + 0.9904236104339361, + 0.022548682987689972, + 0.5371267534792423, + 0.34159174747765064, + 0.3549419865012169, + 2.2041378282010555, + 0.5322800930589437 + ], + "unique_experts": 64, + "load_cv": 0.7075543121308125, + "normalized_load_entropy": 0.9489470197849532, + "max_load_share": 0.06040268456375839 + } + }, + "s0_period": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "2e421768b5f732bcd2ab204235cf1656ea8f4c4c3719623bf12987ebaf033832", + "route_weight_sha256": "cc1381a9f7bec6fc99e6165c80977d8b927f310b5d4517567ce964c1ee210f26", + "loads": [ + 12, + 27, + 7, + 5, + 12, + 12, + 10, + 6, + 7, + 6, + 25, + 5, + 10, + 6, + 6, + 11, + 6, + 15, + 8, + 18, + 12, + 3, + 14, + 9, + 4, + 20, + 10, + 6, + 19, + 5, + 6, + 16, + 0, + 20, + 12, + 5, + 15, + 21, + 7, + 20, + 12, + 7, + 9, + 2, + 15, + 22, + 4, + 8, + 5, + 6, + 9, + 10, + 5, + 2, + 9, + 9, + 12, + 15, + 1, + 10, + 4, + 5, + 18, + 11 + ], + "weighted_loads": [ + 0.4958244860172272, + 2.0166350565850735, + 0.22959503903985023, + 0.20584853738546371, + 0.43504870869219303, + 0.7149148769676685, + 0.49374522641301155, + 0.22357364371418953, + 0.23763456754386425, + 0.2130720652639866, + 1.7680735737085342, + 0.20732662826776505, + 0.5257288534194231, + 0.25680854730308056, + 0.2445964366197586, + 0.434387793764472, + 0.24677927792072296, + 1.4128072038292885, + 0.3462673258036375, + 1.849518347531557, + 0.6928361319005489, + 0.11738710477948189, + 0.5598542988300323, + 0.43389120511710644, + 0.18065041303634644, + 1.9391365516930819, + 0.35493352822959423, + 0.3547800350934267, + 0.999174578115344, + 0.13617283292114735, + 1.1664615720510483, + 1.2764556296169758, + 0.0, + 0.8342569153755903, + 0.3558071255683899, + 0.2664828337728977, + 1.2111236676573753, + 0.8741609044373035, + 0.289984367787838, + 2.0161098148673773, + 1.2079557739198208, + 0.39089555852115154, + 0.32953193970024586, + 0.08249865844845772, + 0.9575499966740608, + 1.5427046790719032, + 0.13820182718336582, + 0.26923294737935066, + 0.16500892117619514, + 0.2107973899692297, + 0.5211674720048904, + 0.4402225948870182, + 0.20746403001248837, + 0.09861630015075207, + 0.537751067429781, + 0.9724519569426775, + 0.4351204540580511, + 0.7162090130150318, + 0.023854641243815422, + 0.5215894114226103, + 0.14573781192302704, + 0.1789822280406952, + 1.7613200433552265, + 0.39091035537421703 + ], + "unique_experts": 63, + "load_cv": 0.5904023309243626, + "normalized_load_entropy": 0.9580361048808771, + "max_load_share": 0.041666666666666664 + }, + "full_input": { + "tokens": 133, + "top_k": 6, + "decisions": 798, + "ordered_route_sha256": "cb749962d7a77f25beddf308281e62326636a51ddb259574f88c264615c1789e", + "route_weight_sha256": "05d542fb4da63d5b6f05d797bb9d8dcc92a9cb9c529bb1e771944b3a82976112", + "loads": [ + 14, + 47, + 15, + 5, + 12, + 12, + 16, + 6, + 7, + 6, + 36, + 8, + 13, + 7, + 6, + 12, + 6, + 19, + 9, + 18, + 12, + 3, + 14, + 11, + 4, + 20, + 10, + 6, + 20, + 7, + 6, + 17, + 2, + 22, + 14, + 5, + 16, + 22, + 17, + 22, + 22, + 7, + 9, + 3, + 20, + 31, + 6, + 8, + 5, + 6, + 19, + 10, + 11, + 2, + 18, + 9, + 12, + 19, + 1, + 10, + 7, + 5, + 22, + 12 + ], + "weighted_loads": [ + 0.5962180905044079, + 3.5904919975437224, + 0.6599178351461887, + 0.20584853738546371, + 0.43504870869219303, + 0.7149148769676685, + 0.9061765782535076, + 0.22357364371418953, + 0.23763456754386425, + 0.2130720652639866, + 2.7175312228500843, + 0.8836758732795715, + 0.6786443796008825, + 0.2935974504798651, + 0.2445964366197586, + 0.4838403519243002, + 0.24677927792072296, + 1.5415339637547731, + 0.372424840927124, + 1.849518347531557, + 0.6928361319005489, + 0.11738710477948189, + 0.5598542988300323, + 0.5271032173186541, + 0.18065041303634644, + 1.9391365516930819, + 0.35493352822959423, + 0.3547800350934267, + 1.041181718930602, + 0.20219594053924084, + 1.1664615720510483, + 1.361571479588747, + 0.12504269927740097, + 0.9424987938255072, + 0.4447471797466278, + 0.2664828337728977, + 1.2883826345205307, + 0.939083855599165, + 0.8403838519006968, + 2.4729675110429525, + 1.7348584216088057, + 0.39089555852115154, + 0.32953193970024586, + 0.11543076112866402, + 1.3137291464954615, + 2.4013536237180233, + 0.22752675972878933, + 0.26923294737935066, + 0.16500892117619514, + 0.2107973899692297, + 1.1325831301510334, + 0.4402225948870182, + 0.5482242126017809, + 0.09861630015075207, + 0.9634000333026052, + 0.9724519569426775, + 0.4351204540580511, + 0.8891450949013233, + 0.023854641243815422, + 0.5215894114226103, + 0.2981576733291149, + 0.1789822280406952, + 2.134779166430235, + 0.5313625019043684 + ], + "unique_experts": 64, + "load_cv": 0.6643778903368623, + "normalized_load_entropy": 0.9521102284849644, + "max_load_share": 0.05889724310776942 + } + }, + "s1_period": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "519ec864f861bea0707beaab45f8ef15223acf9537b20086b1c69457c332a340", + "route_weight_sha256": "677eff15552b6c47db1630416b49ee22e2ebdf7726139850619e9b96d8cf5365", + "loads": [ + 9, + 28, + 5, + 6, + 12, + 12, + 12, + 6, + 11, + 6, + 25, + 5, + 10, + 6, + 5, + 9, + 5, + 15, + 9, + 19, + 13, + 4, + 14, + 7, + 3, + 21, + 11, + 7, + 19, + 4, + 9, + 18, + 0, + 21, + 8, + 4, + 16, + 19, + 6, + 22, + 11, + 7, + 11, + 2, + 15, + 22, + 6, + 7, + 5, + 4, + 8, + 10, + 6, + 2, + 7, + 9, + 9, + 16, + 1, + 8, + 4, + 7, + 19, + 11 + ], + "weighted_loads": [ + 0.3673621118068695, + 2.1178111620247364, + 0.17327694036066532, + 0.2443760447204113, + 0.44843779131770134, + 0.7008325140923262, + 0.5893884059041739, + 0.23417522385716438, + 0.36055169254541397, + 0.22094528004527092, + 1.7338584512472153, + 0.18867361918091774, + 0.5619469955563545, + 0.25928341783583164, + 0.22990570962429047, + 0.3606331627815962, + 0.200304402038455, + 1.4451766349375248, + 0.35526787489652634, + 1.9556941278278828, + 0.7454847358167171, + 0.14830506779253483, + 0.5497218109667301, + 0.36411566473543644, + 0.15070838667452335, + 2.0084227062761784, + 0.3917160350829363, + 0.38463628850877285, + 0.9975780993700027, + 0.11242582462728024, + 1.1283649504184723, + 1.3907923996448517, + 0.0, + 0.8039907161146402, + 0.2520213071256876, + 0.23521097004413605, + 1.2143817227333784, + 0.7965979855507612, + 0.3117482513189316, + 2.041127411648631, + 1.0850339345633984, + 0.3937267027795315, + 0.38239328749477863, + 0.07932880148291588, + 0.9783086758106947, + 1.4570118486881256, + 0.19935430027544498, + 0.25686259008944035, + 0.1592747252434492, + 0.15738648176193237, + 0.4699493497610092, + 0.43573631532490253, + 0.28326102159917355, + 0.0902144555002451, + 0.4158129282295704, + 0.9916691519320011, + 0.3269628621637821, + 0.744680792093277, + 0.02266363613307476, + 0.47299386747181416, + 0.14054838195443153, + 0.265288520604372, + 1.7914801631122828, + 0.3961185794323683 + ], + "unique_experts": 63, + "load_cv": 0.6144378833644101, + "normalized_load_entropy": 0.9552698738457397, + "max_load_share": 0.043209876543209874 + }, + "full_input": { + "tokens": 149, + "top_k": 6, + "decisions": 894, + "ordered_route_sha256": "3460dba676b92e5346194a9df7033bf18752a89b087590bb2ca228febdaeee4a", + "route_weight_sha256": "1185075530944d3748e83c0386e6208899cd5fda69e441d3a89bad09a2bd387e", + "loads": [ + 12, + 54, + 15, + 6, + 12, + 13, + 18, + 6, + 13, + 7, + 48, + 8, + 16, + 6, + 5, + 10, + 5, + 23, + 10, + 20, + 16, + 12, + 14, + 12, + 3, + 21, + 11, + 7, + 20, + 7, + 9, + 21, + 6, + 22, + 11, + 4, + 16, + 26, + 15, + 27, + 20, + 7, + 12, + 3, + 26, + 37, + 7, + 7, + 5, + 4, + 20, + 10, + 13, + 9, + 20, + 10, + 11, + 21, + 1, + 9, + 8, + 8, + 24, + 15 + ], + "weighted_loads": [ + 0.6277783624827862, + 4.259774793405086, + 0.7186774145811796, + 0.2443760447204113, + 0.44843779131770134, + 0.7390676122158766, + 1.1442357692867517, + 0.23417522385716438, + 0.4756605513393879, + 0.24976704269647598, + 3.779186934232712, + 0.8868310824036598, + 0.8734478279948235, + 0.25928341783583164, + 0.22990570962429047, + 0.4078628923743963, + 0.200304402038455, + 2.091070733964443, + 0.4088195860385895, + 1.9811458624899387, + 1.00230847671628, + 0.8427208997309208, + 0.5497218109667301, + 0.5594445560127497, + 0.15070838667452335, + 2.0084227062761784, + 0.3917160350829363, + 0.38463628850877285, + 1.0432826057076454, + 0.23598130978643894, + 1.1283649504184723, + 1.8598739057779312, + 0.27999989688396454, + 0.8511124048382044, + 0.4021155145019293, + 0.23521097004413605, + 1.2143817227333784, + 1.0902781076729298, + 1.0973719470202923, + 2.5256923511624336, + 1.5874676406383514, + 0.3937267027795315, + 0.4689976144582033, + 0.10959642566740513, + 1.7103351950645447, + 2.749062029644847, + 0.24104455672204494, + 0.25686259008944035, + 0.1592747252434492, + 0.15738648176193237, + 1.1763454228639603, + 0.43573631532490253, + 0.7772065605968237, + 0.5972604770213366, + 1.2410530867055058, + 1.0182741563767195, + 0.4159422554075718, + 0.9896647147834301, + 0.02266363613307476, + 0.5591807533055544, + 0.3681785315275192, + 0.30849919840693474, + 2.2252418771386147, + 0.7169703226536512 + ], + "unique_experts": 64, + "load_cv": 0.6957997924477757, + "normalized_load_entropy": 0.9505778220371418, + "max_load_share": 0.06040268456375839 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 108, + "ordered_topk_exact_tokens": 52, + "set_exact_tokens": 66, + "mean_set_jaccard": 0.8801587301587303, + "mean_token_weighted_tv": 0.024243061387635493, + "aggregate_load_tv": 0.04166666666666666 + }, + "system_bos": { + "tokens": 108, + "ordered_topk_exact_tokens": 52, + "set_exact_tokens": 68, + "mean_set_jaccard": 0.8862433862433863, + "mean_token_weighted_tv": 0.022126759937102045, + "aggregate_load_tv": 0.04938271604938271 + }, + "system_x": { + "tokens": 108, + "ordered_topk_exact_tokens": 42, + "set_exact_tokens": 53, + "mean_set_jaccard": 0.8370811287477956, + "mean_token_weighted_tv": 0.03189237605504416, + "aggregate_load_tv": 0.0478395061728395 + }, + "system_period": { + "tokens": 108, + "ordered_topk_exact_tokens": 43, + "set_exact_tokens": 58, + "mean_set_jaccard": 0.8542768959435627, + "mean_token_weighted_tv": 0.030950908376662818, + "aggregate_load_tv": 0.050925925925925916 + }, + "bos_at_s0": { + "tokens": 108, + "ordered_topk_exact_tokens": 47, + "set_exact_tokens": 64, + "mean_set_jaccard": 0.8689153439153439, + "mean_token_weighted_tv": 0.02729095728136599, + "aggregate_load_tv": 0.047839506172839504 + }, + "bos_at_s1": { + "tokens": 108, + "ordered_topk_exact_tokens": 42, + "set_exact_tokens": 57, + "mean_set_jaccard": 0.8511904761904764, + "mean_token_weighted_tv": 0.028397393067953764, + "aggregate_load_tv": 0.047839506172839504 + }, + "x_at_s0": { + "tokens": 108, + "ordered_topk_exact_tokens": 46, + "set_exact_tokens": 57, + "mean_set_jaccard": 0.8528218694885362, + "mean_token_weighted_tv": 0.029740945289463357, + "aggregate_load_tv": 0.05709876543209877 + }, + "x_at_s1": { + "tokens": 108, + "ordered_topk_exact_tokens": 38, + "set_exact_tokens": 54, + "mean_set_jaccard": 0.8353174603174603, + "mean_token_weighted_tv": 0.03317337571125892, + "aggregate_load_tv": 0.06172839506172839 + }, + "period_at_s0": { + "tokens": 108, + "ordered_topk_exact_tokens": 43, + "set_exact_tokens": 57, + "mean_set_jaccard": 0.8444444444444446, + "mean_token_weighted_tv": 0.03207222717227759, + "aggregate_load_tv": 0.05401234567901234 + }, + "period_at_s1": { + "tokens": 108, + "ordered_topk_exact_tokens": 36, + "set_exact_tokens": 48, + "mean_set_jaccard": 0.8234126984126986, + "mean_token_weighted_tv": 0.034992232651415246, + "aggregate_load_tv": 0.06018518518518518 + } + } + }, + "layer_26": { + "layer": 26, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "d0e438c5ed62a7cb6ed356549543e85e6e5ff592d6ee87eec058e4988bbbf816", + "route_weight_sha256": "ca6bf39036bf7216c5fdaf162ba7bc434a5550e0c1e842b9f3d42cc03d1ef2a4", + "loads": [ + 2, + 2, + 10, + 12, + 10, + 5, + 7, + 4, + 4, + 10, + 12, + 7, + 8, + 27, + 18, + 12, + 12, + 12, + 19, + 11, + 10, + 11, + 7, + 10, + 19, + 11, + 14, + 15, + 5, + 21, + 9, + 4, + 14, + 9, + 14, + 6, + 13, + 15, + 4, + 2, + 9, + 7, + 13, + 4, + 9, + 13, + 3, + 3, + 8, + 8, + 20, + 8, + 20, + 7, + 6, + 2, + 13, + 9, + 14, + 5, + 13, + 8, + 24, + 5 + ], + "weighted_loads": [ + 0.04850985761731863, + 0.09976261854171753, + 0.5519418120384216, + 0.5125571452081203, + 0.47900111228227615, + 0.170837027952075, + 0.3737531956285238, + 0.1655469387769699, + 0.16120443120598793, + 0.65540761500597, + 0.5685512255877256, + 0.3951612189412117, + 0.42875006049871445, + 1.2297300342470407, + 1.1074588671326637, + 0.5615715533494949, + 1.1181041300296783, + 0.44789588265120983, + 0.7331706415861845, + 0.4866433534771204, + 0.5357857793569565, + 1.2854405492544174, + 0.27945531718432903, + 0.4328443855047226, + 0.8248288091272116, + 0.8040283843874931, + 1.0000124890357256, + 1.501102400943637, + 0.2504519186913967, + 1.0865941625088453, + 0.5624067299067974, + 0.13338147476315498, + 0.557577945291996, + 0.36778638884425163, + 0.9073985368013382, + 0.29602300375699997, + 0.505393173545599, + 0.6368924602866173, + 0.14424217864871025, + 0.1721085160970688, + 0.38239885866642, + 0.6581854000687599, + 0.40741822496056557, + 0.15112826600670815, + 0.344237731769681, + 0.5238301400095224, + 0.09474615380167961, + 0.0879154410213232, + 0.3710728194564581, + 0.4461839012801647, + 1.1100032292306423, + 0.31108186952769756, + 1.0663223285228014, + 0.2561878114938736, + 0.23368153348565102, + 0.06833574548363686, + 1.1233283430337906, + 0.4111787136644125, + 0.827237443998456, + 0.2077481783926487, + 1.2252039946615696, + 0.3906586095690727, + 1.4243102259933949, + 0.9785864315927029 + ], + "unique_experts": 64, + "load_cv": 0.545030618633188, + "normalized_load_entropy": 0.9645142866383436, + "max_load_share": 0.041666666666666664 + }, + "full_input": { + "tokens": 133, + "top_k": 6, + "decisions": 798, + "ordered_route_sha256": "9d81aafbca9c17aa142ebb345c228542a959328166b2fe3ca41c2207bb47ff11", + "route_weight_sha256": "cd45da5cb7bce172d5a72e5e7ec9147b724889697f04ea3dfdac055d73e6d1be", + "loads": [ + 2, + 2, + 10, + 15, + 10, + 5, + 7, + 6, + 4, + 14, + 15, + 12, + 8, + 29, + 33, + 14, + 12, + 21, + 19, + 11, + 10, + 14, + 9, + 10, + 26, + 11, + 19, + 22, + 5, + 21, + 16, + 4, + 17, + 10, + 17, + 6, + 20, + 15, + 5, + 2, + 9, + 7, + 14, + 7, + 10, + 13, + 7, + 3, + 9, + 9, + 28, + 8, + 25, + 7, + 7, + 2, + 27, + 18, + 20, + 6, + 14, + 8, + 25, + 7 + ], + "weighted_loads": [ + 0.04850985761731863, + 0.09976261854171753, + 0.5519418120384216, + 0.6150986831635237, + 0.47900111228227615, + 0.170837027952075, + 0.3737531956285238, + 0.3001613989472389, + 0.16120443120598793, + 0.8809074610471725, + 0.7911180835217237, + 0.6977916893083602, + 0.42875006049871445, + 1.3410687576979399, + 1.796273649611976, + 0.6609378829598427, + 1.1181041300296783, + 0.9244131316663697, + 0.7331706415861845, + 0.4866433534771204, + 0.5357857793569565, + 1.4730594530701637, + 0.373010678216815, + 0.4328443855047226, + 1.2426270935684443, + 0.8040283843874931, + 1.7104901690036058, + 1.7836246136575937, + 0.2504519186913967, + 1.0865941625088453, + 1.3407117798924446, + 0.13338147476315498, + 0.6626064106822014, + 0.39952362701296806, + 1.193259373307228, + 0.29602300375699997, + 0.8843179680407047, + 0.6368924602866173, + 0.18555863201618195, + 0.1721085160970688, + 0.38239885866642, + 0.6581854000687599, + 0.4571371488273144, + 0.3033493161201477, + 0.38707283698022366, + 0.5238301400095224, + 0.30017977952957153, + 0.0879154410213232, + 0.40578225441277027, + 1.432443778961897, + 1.458264321088791, + 0.31108186952769756, + 1.5400897730141878, + 0.2561878114938736, + 0.2808707766234875, + 0.06833574548363686, + 2.124375367537141, + 0.836136416066438, + 1.0626835469156504, + 0.2556671276688576, + 1.2260156773263589, + 0.3906586095690727, + 1.4647341705858707, + 1.0555089712142944 + ], + "unique_experts": 64, + "load_cv": 0.5946085577410052, + "normalized_load_entropy": 0.9581406713232873, + "max_load_share": 0.041353383458646614 + } + }, + "s1_eos": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "644870450c5cb1c0b76330dd2400e5f81eb79f17b597b0bd65c432ad02b7100d", + "route_weight_sha256": "22f2469ccd984a4a368ea435ff1f8aefc2bcd6ab8baf9a8a4c90bcef40dabf91", + "loads": [ + 3, + 2, + 10, + 10, + 11, + 2, + 7, + 4, + 4, + 12, + 12, + 7, + 8, + 26, + 18, + 12, + 12, + 12, + 20, + 10, + 11, + 11, + 8, + 10, + 18, + 11, + 13, + 17, + 3, + 21, + 9, + 0, + 13, + 9, + 15, + 7, + 11, + 12, + 5, + 3, + 7, + 7, + 16, + 6, + 11, + 13, + 3, + 3, + 9, + 8, + 20, + 9, + 20, + 6, + 7, + 1, + 12, + 9, + 13, + 8, + 13, + 10, + 24, + 4 + ], + "weighted_loads": [ + 0.105140820145607, + 0.10136530175805092, + 0.546876696869731, + 0.44920428842306137, + 0.4961285777390003, + 0.07991675660014153, + 0.37566170655190945, + 0.1628568209707737, + 0.1633227840065956, + 0.7279833108186722, + 0.5940989628434181, + 0.4047092068940401, + 0.44070010259747505, + 1.218041667714715, + 1.1450674217194319, + 0.569280868396163, + 1.130771517753601, + 0.45683961547911167, + 0.7326807975769043, + 0.45855614729225636, + 0.5629988051950932, + 1.2621320113539696, + 0.3143281787633896, + 0.4346685875207186, + 0.7763385679572821, + 0.8058725371956825, + 1.008579172194004, + 1.5627762377262115, + 0.1909002773463726, + 1.114187441766262, + 0.5574596151709557, + 0.0, + 0.5158047843724489, + 0.36368553526699543, + 0.992741858586669, + 0.33263540267944336, + 0.4421876147389412, + 0.5491806007921696, + 0.17696924321353436, + 0.19291356019675732, + 0.3006633035838604, + 0.8262599743902683, + 0.5358107723295689, + 0.20528167113661766, + 0.4275711290538311, + 0.49893597327172756, + 0.09114719554781914, + 0.08900500647723675, + 0.4293345008045435, + 0.4563931655138731, + 1.0976284015923738, + 0.3427458330988884, + 1.052634783089161, + 0.22637725062668324, + 0.26939164847135544, + 0.03494220972061157, + 1.114637166261673, + 0.415785463526845, + 0.8052234426140785, + 0.3105484787374735, + 1.2064170390367508, + 0.46227626129984856, + 1.4702634066343307, + 0.20366564765572548 + ], + "unique_experts": 63, + "load_cv": 0.5497640513138844, + "normalized_load_entropy": 0.96171988354474, + "max_load_share": 0.040123456790123455 + }, + "full_input": { + "tokens": 149, + "top_k": 6, + "decisions": 894, + "ordered_route_sha256": "cca4ba75e83ceb3fe9e90c2f7da5011ab3c23b9b1c404f9161b1c2214d52a8c4", + "route_weight_sha256": "30ff6d167631009653ecbf99db53416b3047481ecb04450b3bed4071f60553f0", + "loads": [ + 4, + 2, + 10, + 13, + 14, + 2, + 7, + 6, + 4, + 19, + 18, + 14, + 8, + 27, + 32, + 17, + 12, + 19, + 21, + 10, + 11, + 19, + 17, + 10, + 27, + 13, + 24, + 27, + 3, + 24, + 19, + 1, + 18, + 9, + 21, + 7, + 24, + 17, + 8, + 4, + 8, + 7, + 18, + 10, + 13, + 14, + 7, + 4, + 10, + 11, + 27, + 9, + 30, + 8, + 10, + 3, + 30, + 17, + 23, + 15, + 16, + 10, + 27, + 5 + ], + "weighted_loads": [ + 0.15097549930214882, + 0.10136530175805092, + 0.546876696869731, + 0.5554216764867306, + 0.6714963931590319, + 0.07991675660014153, + 0.37566170655190945, + 0.325412604957819, + 0.1633227840065956, + 1.1281246915459633, + 1.251273050904274, + 1.022005069302395, + 0.44070010259747505, + 1.2722578290849924, + 1.9202720930916257, + 0.8767875637859106, + 1.130771517753601, + 0.8642824111739174, + 0.787192951887846, + 0.45855614729225636, + 0.5629988051950932, + 1.7723790127784014, + 0.9050949737429619, + 0.4346685875207186, + 1.2689180169254541, + 0.9123906083405018, + 2.292222782969475, + 1.9561181124299765, + 0.1909002773463726, + 1.2171748653054237, + 1.5879126116633415, + 0.08003956824541092, + 0.7167069725692272, + 0.36368553526699543, + 1.4229538086801767, + 0.33263540267944336, + 1.1665519997477531, + 0.8540051318705082, + 0.4687398988753557, + 0.22847447358071804, + 0.3318632747977972, + 0.8262599743902683, + 0.6245856434106827, + 0.40582576021552086, + 0.519789282232523, + 0.5162336975336075, + 0.3466220907866955, + 0.1310404036194086, + 0.4647244904190302, + 1.594835227355361, + 1.3813239727169275, + 0.3427458330988884, + 1.8949152417480946, + 0.41723225079476833, + 0.48573851585388184, + 0.14819232374429703, + 2.76643231138587, + 1.1204510987736285, + 1.3815192207694054, + 0.6041038166731596, + 1.440969088289421, + 0.46227626129984856, + 1.59452411159873, + 0.24904796853661537 + ], + "unique_experts": 64, + "load_cv": 0.5743779801761434, + "normalized_load_entropy": 0.9584605160423639, + "max_load_share": 0.035794183445190156 + } + }, + "s0_bos": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "5c9f95f3210f00841d36718debc658d88fed15839495924a1cc2503bbc3f4cdf", + "route_weight_sha256": "568a3551549a558496b9e6d39fa29508c860036a6c838d2ee615c589ddb4fe59", + "loads": [ + 2, + 2, + 11, + 13, + 8, + 6, + 7, + 3, + 3, + 11, + 12, + 6, + 8, + 29, + 16, + 11, + 12, + 13, + 21, + 11, + 11, + 11, + 9, + 9, + 18, + 10, + 12, + 15, + 5, + 22, + 10, + 4, + 14, + 10, + 13, + 6, + 14, + 14, + 3, + 4, + 9, + 6, + 11, + 4, + 9, + 10, + 5, + 3, + 10, + 7, + 21, + 8, + 21, + 8, + 6, + 1, + 14, + 8, + 14, + 4, + 13, + 10, + 23, + 4 + ], + "weighted_loads": [ + 0.06480176001787186, + 0.09769680723547935, + 0.5754112917929888, + 0.5346036348491907, + 0.3977031856775284, + 0.21438093855977058, + 0.3780782110989094, + 0.1274760104715824, + 0.12702107802033424, + 0.6702689081430435, + 0.6000138781964779, + 0.33189474418759346, + 0.4248914383351803, + 1.3100648671388626, + 1.0373101234436035, + 0.5366451647132635, + 1.1078772023320198, + 0.47854205034673214, + 0.7975578140467405, + 0.4888935126364231, + 0.5596993733197451, + 1.25343307107687, + 0.350116228684783, + 0.40402873791754246, + 0.7825852651149035, + 0.7948932610452175, + 1.0527297370135784, + 1.433113519102335, + 0.2707008011639118, + 1.1222176756709814, + 0.5723380446434021, + 0.13951201550662518, + 0.5559861101210117, + 0.41949816793203354, + 0.8501639775931835, + 0.3057549484074116, + 0.5543628260493279, + 0.5784089043736458, + 0.11425755172967911, + 0.2577188666909933, + 0.3703473322093487, + 0.7549079582095146, + 0.36079277470707893, + 0.1375978048890829, + 0.34145844355225563, + 0.42466478794813156, + 0.14601147547364235, + 0.08732113428413868, + 0.468571649864316, + 0.42074472084641457, + 1.1459930669516325, + 0.3157281521707773, + 1.1233553998172283, + 0.28344874270260334, + 0.2383823934942484, + 0.044278983026742935, + 1.1787812020629644, + 0.3518262840807438, + 0.8148227129131556, + 0.17285199090838432, + 1.2692801244556904, + 0.45114980079233646, + 1.405368510633707, + 0.21261603198945522 + ], + "unique_experts": 64, + "load_cv": 0.5593832473683551, + "normalized_load_entropy": 0.9629417877146395, + "max_load_share": 0.044753086419753084 + }, + "full_input": { + "tokens": 133, + "top_k": 6, + "decisions": 798, + "ordered_route_sha256": "fb3e980a140505b5b2e1ddd22500cc7307865c90c7d6ac45d44c177d6a85c934", + "route_weight_sha256": "13947509d12f101a058e461e892c3faeeb3bc81e0146e19014a977d20d67c4de", + "loads": [ + 3, + 2, + 11, + 14, + 8, + 7, + 7, + 5, + 3, + 16, + 14, + 10, + 8, + 31, + 29, + 13, + 12, + 21, + 21, + 11, + 11, + 15, + 12, + 9, + 25, + 10, + 17, + 23, + 5, + 22, + 18, + 4, + 17, + 10, + 17, + 6, + 20, + 14, + 3, + 4, + 9, + 7, + 13, + 7, + 12, + 10, + 8, + 3, + 11, + 7, + 29, + 8, + 26, + 8, + 8, + 2, + 28, + 16, + 20, + 5, + 13, + 10, + 24, + 6 + ], + "weighted_loads": [ + 0.09060237184166908, + 0.09769680723547935, + 0.5754112917929888, + 0.579993886873126, + 0.3977031856775284, + 0.26311958208680153, + 0.3780782110989094, + 0.2628301940858364, + 0.12702107802033424, + 0.9355855733156204, + 0.7528506256639957, + 0.632461654022336, + 0.4248914383351803, + 1.4251064471900463, + 1.6417128592729568, + 0.6530387084931135, + 1.1078772023320198, + 0.932508060708642, + 0.7975578140467405, + 0.4888935126364231, + 0.5596993733197451, + 1.4744718708097935, + 0.48132130689918995, + 0.40402873791754246, + 1.1964540015906096, + 0.7948932610452175, + 1.8351769261062145, + 1.8072583004832268, + 0.2707008011639118, + 1.1222176756709814, + 1.3953009136021137, + 0.13951201550662518, + 0.6650023199617863, + 0.41949816793203354, + 1.1855647526681423, + 0.3057549484074116, + 0.885233711451292, + 0.5784089043736458, + 0.11425755172967911, + 0.2577188666909933, + 0.3703473322093487, + 1.0540286526083946, + 0.4604240208864212, + 0.28981885500252247, + 0.49894924461841583, + 0.42466478794813156, + 0.31407231092453003, + 0.08732113428413868, + 0.5380507353693247, + 0.42074472084641457, + 1.494254158809781, + 0.3157281521707773, + 1.5966419391334057, + 0.28344874270260334, + 0.3236804697662592, + 0.07858724892139435, + 2.1846811920404434, + 0.7719060070812702, + 1.05026881583035, + 0.2207709401845932, + 1.2692801244556904, + 0.45114980079233646, + 1.445792455226183, + 0.3254381474107504 + ], + "unique_experts": 64, + "load_cv": 0.5932548413949311, + "normalized_load_entropy": 0.9584822295398503, + "max_load_share": 0.03884711779448621 + } + }, + "s1_bos": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "15943c61ef4cfe81400dd6fa3c72433d947e4d59ac5cf1627cc957cb36ce925c", + "route_weight_sha256": "5fdd19bed15c2cd1c65338e3768c787a6c0d9d18724865a8ecf0ebddb3653764", + "loads": [ + 2, + 2, + 12, + 12, + 10, + 7, + 6, + 3, + 2, + 11, + 11, + 6, + 8, + 31, + 19, + 11, + 13, + 13, + 19, + 10, + 11, + 12, + 9, + 11, + 16, + 11, + 13, + 15, + 5, + 24, + 8, + 2, + 15, + 11, + 15, + 7, + 11, + 12, + 4, + 3, + 8, + 7, + 12, + 5, + 10, + 12, + 2, + 2, + 9, + 7, + 20, + 6, + 21, + 6, + 6, + 2, + 12, + 8, + 13, + 6, + 13, + 10, + 23, + 5 + ], + "weighted_loads": [ + 0.06533299759030342, + 0.09811954572796822, + 0.6257123798131943, + 0.49188351817429066, + 0.4738881941884756, + 0.2481671255081892, + 0.33525314182043076, + 0.12384791299700737, + 0.08586249500513077, + 0.6877616830170155, + 0.604412917047739, + 0.3544566482305527, + 0.4389338307082653, + 1.4074237290769815, + 1.135478300973773, + 0.5365970842540264, + 1.1610364820808172, + 0.4855051226913929, + 0.7290645148605108, + 0.45270221307873726, + 0.5573003832250834, + 1.3044566251337528, + 0.3370931278914213, + 0.45378516986966133, + 0.6924102585762739, + 0.8402737267315388, + 1.031744945794344, + 1.399952258914709, + 0.2630215585231781, + 1.2519748844206333, + 0.5384797342121601, + 0.06348178163170815, + 0.5858887825161219, + 0.46664949133992195, + 0.9479511678218842, + 0.33576262183487415, + 0.4394999146461487, + 0.5175289772450924, + 0.14946418441832066, + 0.21188944950699806, + 0.34233149513602257, + 0.6738589741289616, + 0.3961267787963152, + 0.16899638809263706, + 0.3644758053123951, + 0.4807038586586714, + 0.06549464352428913, + 0.05909494496881962, + 0.42837120592594147, + 0.39039971493184566, + 1.1070824228227139, + 0.25708967819809914, + 1.1077766139060259, + 0.21887341141700745, + 0.24061878956854343, + 0.09192758798599243, + 1.0928575675934553, + 0.3767954483628273, + 0.8151911236345768, + 0.23333892971277237, + 1.234150044620037, + 0.46306913904845715, + 1.4130641855299473, + 0.24877788498997688 + ], + "unique_experts": 64, + "load_cv": 0.5773502691896257, + "normalized_load_entropy": 0.9605500691560663, + "max_load_share": 0.047839506172839504 + }, + "full_input": { + "tokens": 149, + "top_k": 6, + "decisions": 894, + "ordered_route_sha256": "ed94811dcb13cc51415fe18ceff89856c3a20ca5d5aa479940a3d4f668a290ac", + "route_weight_sha256": "256c2711d4d1aacf29a7481e459f60ce9652f7ab4d0c7bd886461b19b6af752f", + "loads": [ + 2, + 2, + 12, + 14, + 13, + 7, + 6, + 5, + 2, + 19, + 18, + 12, + 8, + 33, + 31, + 16, + 13, + 18, + 20, + 10, + 11, + 19, + 18, + 11, + 25, + 13, + 25, + 24, + 5, + 27, + 20, + 3, + 20, + 12, + 22, + 7, + 23, + 17, + 7, + 4, + 9, + 7, + 15, + 9, + 13, + 13, + 6, + 3, + 10, + 9, + 27, + 6, + 31, + 8, + 9, + 6, + 30, + 15, + 23, + 13, + 15, + 10, + 26, + 7 + ], + "weighted_loads": [ + 0.06533299759030342, + 0.09811954572796822, + 0.6257123798131943, + 0.5654089245945215, + 0.6492560096085072, + 0.2481671255081892, + 0.33525314182043076, + 0.3103077970445156, + 0.08586249500513077, + 1.1319306641817093, + 1.3131727203726768, + 0.9694641716778278, + 0.4389338307082653, + 1.5239684004336596, + 1.8369188774377108, + 0.8538856543600559, + 1.1610364820808172, + 0.8404521904885769, + 0.7729001846164465, + 0.45270221307873726, + 0.5573003832250834, + 1.7901832778006792, + 0.9142486732453108, + 0.45378516986966133, + 1.1940165627747774, + 0.946791797876358, + 2.4667170718312263, + 1.7501970995217562, + 0.2630215585231781, + 1.354962307959795, + 1.7064110040664673, + 0.14352134987711906, + 0.7760297786444426, + 0.5133359655737877, + 1.4611200578510761, + 0.33576262183487415, + 1.1312272511422634, + 0.822353508323431, + 0.441234840080142, + 0.24745036289095879, + 0.3735314663499594, + 0.6738589741289616, + 0.5337807592004538, + 0.36954047717154026, + 0.49948663264513016, + 0.4980015829205513, + 0.32654249854385853, + 0.10113034211099148, + 0.46376119554042816, + 0.5441798400133848, + 1.3907779939472675, + 0.25708967819809914, + 1.9288136195391417, + 0.40972841158509254, + 0.45696565695106983, + 0.2761448472738266, + 2.7507964726537466, + 1.076104275882244, + 1.3914869017899036, + 0.5268942676484585, + 1.4677656069397926, + 0.46306913904845715, + 1.5373248904943466, + 0.3777277059853077 + ], + "unique_experts": 64, + "load_cv": 0.5771595299676651, + "normalized_load_entropy": 0.9592745460322798, + "max_load_share": 0.03691275167785235 + } + }, + "s0_x": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "8fe6bce3430ae91e2458e30e2978cac53d0fc3e95f7cf0d4354d866b750b46ef", + "route_weight_sha256": "db6f5c9bf1a6ecf36251eb2d3ced186fb274feba741f957d51ad893c7b1332f7", + "loads": [ + 2, + 2, + 11, + 12, + 10, + 7, + 7, + 4, + 4, + 11, + 12, + 7, + 8, + 28, + 16, + 9, + 12, + 10, + 20, + 12, + 11, + 12, + 7, + 11, + 16, + 10, + 12, + 17, + 5, + 21, + 10, + 4, + 15, + 10, + 13, + 8, + 15, + 13, + 3, + 4, + 8, + 6, + 13, + 5, + 8, + 12, + 4, + 2, + 10, + 8, + 20, + 8, + 22, + 5, + 6, + 2, + 13, + 8, + 14, + 4, + 13, + 9, + 24, + 3 + ], + "weighted_loads": [ + 0.06723902747035027, + 0.09729291498661041, + 0.5998589284718037, + 0.5097793024033308, + 0.4762124828994274, + 0.2494601123034954, + 0.36695644818246365, + 0.15735525637865067, + 0.17521055042743683, + 0.6672373786568642, + 0.6010731812566519, + 0.3735744524747133, + 0.4118133969604969, + 1.287565091624856, + 1.008161325007677, + 0.48264913633465767, + 1.1042713597416878, + 0.37679078057408333, + 0.7570562101900578, + 0.5158761329948902, + 0.5537675898522139, + 1.298201434314251, + 0.2812082879245281, + 0.4659021757543087, + 0.7355611212551594, + 0.7882883101701736, + 0.9543738663196564, + 1.7016814071685076, + 0.25278051011264324, + 1.1220040358603, + 0.5780758317559958, + 0.13962397538125515, + 0.6125379037111998, + 0.40127796307206154, + 0.842999080196023, + 0.369857095181942, + 0.5863318722695112, + 0.5442146621644497, + 0.11274603009223938, + 0.24678254313766956, + 0.3362312763929367, + 0.6670884899795055, + 0.4294316563755274, + 0.1743356790393591, + 0.2937714345753193, + 0.48253898695111275, + 0.11522316560149193, + 0.058316538110375404, + 0.46166463382542133, + 0.45638992823660374, + 1.1011546645313501, + 0.30369010381400585, + 1.1282258592545986, + 0.18546975031495094, + 0.23541605658829212, + 0.07286429218947887, + 1.1159766241908073, + 0.3768349979072809, + 0.822595926001668, + 0.1835133172571659, + 1.2542426250874996, + 0.4217982403934002, + 1.448103915899992, + 0.16748570650815964 + ], + "unique_experts": 64, + "load_cv": 0.5508718893166199, + "normalized_load_entropy": 0.9640275156222307, + "max_load_share": 0.043209876543209874 + }, + "full_input": { + "tokens": 133, + "top_k": 6, + "decisions": 798, + "ordered_route_sha256": "4e05aac3662e12403b23905b042ed3c7f4d93a15ce5ee9956e9811acad04f320", + "route_weight_sha256": "0430418774225b5c4a9ee7c8f52c2a40db887dbffc40217fe72723eeb644c7a2", + "loads": [ + 2, + 2, + 11, + 13, + 10, + 7, + 7, + 6, + 4, + 15, + 15, + 13, + 8, + 30, + 30, + 11, + 12, + 19, + 20, + 12, + 11, + 16, + 8, + 11, + 23, + 10, + 17, + 25, + 5, + 22, + 16, + 4, + 17, + 10, + 16, + 8, + 22, + 13, + 3, + 4, + 8, + 6, + 14, + 10, + 9, + 12, + 7, + 2, + 10, + 8, + 28, + 8, + 27, + 5, + 8, + 4, + 31, + 17, + 20, + 5, + 13, + 9, + 25, + 4 + ], + "weighted_loads": [ + 0.06723902747035027, + 0.09729291498661041, + 0.5998589284718037, + 0.5454902183264494, + 0.4762124828994274, + 0.2494601123034954, + 0.36695644818246365, + 0.2879882901906967, + 0.17521055042743683, + 0.89348478987813, + 0.8067191559821367, + 0.8217258788645267, + 0.4118133969604969, + 1.427587455138564, + 1.7216222919523716, + 0.5794878266751766, + 1.1042713597416878, + 0.9205703586339951, + 0.7570562101900578, + 0.5158761329948902, + 0.5537675898522139, + 1.5292857587337494, + 0.35615018382668495, + 0.4659021757543087, + 1.1497343853116035, + 0.7882883101701736, + 1.6252907812595367, + 2.018220530822873, + 0.25278051011264324, + 1.169274028390646, + 1.2290970403701067, + 0.13962397538125515, + 0.6822259817272425, + 0.40127796307206154, + 1.0986120868474245, + 0.369857095181942, + 0.9449821133166552, + 0.5442146621644497, + 0.11274603009223938, + 0.24678254313766956, + 0.3362312763929367, + 0.6670884899795055, + 0.4685765076428652, + 0.42343669198453426, + 0.3285076506435871, + 0.48253898695111275, + 0.301761232316494, + 0.058316538110375404, + 0.46166463382542133, + 0.45638992823660374, + 1.4494157563894987, + 0.30369010381400585, + 1.5767620541155338, + 0.18546975031495094, + 0.31859694607555866, + 0.15158606879413128, + 2.3052733670920134, + 0.9066801089793444, + 1.0580420289188623, + 0.2314322665333748, + 1.2542426250874996, + 0.4217982403934002, + 1.4885278604924679, + 0.2123541161417961 + ], + "unique_experts": 64, + "load_cv": 0.6023333877643182, + "normalized_load_entropy": 0.9575014410576554, + "max_load_share": 0.03884711779448621 + } + }, + "s1_x": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "30c5992bb57fc506e276fd712955c28588f38e68c3d22e73f3c44019c4d54b78", + "route_weight_sha256": "5dfe5791fbbadc5a76b2214785d5b6bf5777cdb4cd86882245b7f798a0861d8a", + "loads": [ + 2, + 2, + 11, + 11, + 11, + 9, + 7, + 2, + 3, + 12, + 12, + 7, + 10, + 30, + 17, + 12, + 13, + 10, + 20, + 9, + 11, + 12, + 8, + 11, + 17, + 11, + 13, + 17, + 5, + 24, + 9, + 2, + 13, + 11, + 16, + 7, + 16, + 10, + 5, + 2, + 8, + 6, + 8, + 5, + 8, + 12, + 2, + 3, + 8, + 6, + 21, + 7, + 21, + 5, + 6, + 2, + 12, + 8, + 13, + 6, + 13, + 10, + 24, + 4 + ], + "weighted_loads": [ + 0.06918076425790787, + 0.1010449007153511, + 0.5874104704707861, + 0.4795525912195444, + 0.5108719523996115, + 0.31131134182214737, + 0.36475574038922787, + 0.09233634918928146, + 0.1265944056212902, + 0.735610343515873, + 0.6684299279004335, + 0.40707181580364704, + 0.48094188421964645, + 1.3370083589106798, + 1.070600850507617, + 0.5746635496616364, + 1.160794511437416, + 0.38611369021236897, + 0.7596494872123003, + 0.416702751070261, + 0.5659450311213732, + 1.3215261287987232, + 0.3046758081763983, + 0.4530045557767153, + 0.7396191917359829, + 0.8541042767465115, + 0.9164976067841053, + 1.7590655852109194, + 0.2699633911252022, + 1.2486979234963655, + 0.5653679147362709, + 0.07258728891611099, + 0.5269948337227106, + 0.42452725023031235, + 0.9933670703321695, + 0.34338645823299885, + 0.6014827247709036, + 0.44999680295586586, + 0.1798111256211996, + 0.1770581118762493, + 0.32066400721669197, + 0.5958081521093845, + 0.2724572289735079, + 0.17110398411750793, + 0.29484080523252487, + 0.49201684445142746, + 0.06951791793107986, + 0.08088870532810688, + 0.37392647936940193, + 0.41699714586138725, + 1.1189437992870808, + 0.26217982545495033, + 1.058553447946906, + 0.1946056354790926, + 0.24209238588809967, + 0.09195167943835258, + 1.1019492447376251, + 0.40776320546865463, + 0.8365666717290878, + 0.24951492249965668, + 1.194798283278942, + 0.4720051698386669, + 1.4560993127524853, + 0.21276017650961876 + ], + "unique_experts": 64, + "load_cv": 0.5839127698955787, + "normalized_load_entropy": 0.9597430029502432, + "max_load_share": 0.046296296296296294 + }, + "full_input": { + "tokens": 149, + "top_k": 6, + "decisions": 894, + "ordered_route_sha256": "7b0202e2d34c786aa05ad88b4ef1683ac8631d1871ed0de7002c2721fc52169c", + "route_weight_sha256": "9ada8bdadc628d1b79e6b59941a0ce66c000a88bc8afef952f7b9a946589cea2", + "loads": [ + 2, + 2, + 11, + 12, + 14, + 9, + 7, + 4, + 3, + 19, + 19, + 15, + 10, + 32, + 31, + 17, + 13, + 16, + 20, + 9, + 11, + 19, + 14, + 11, + 26, + 13, + 25, + 28, + 5, + 28, + 18, + 3, + 18, + 11, + 22, + 7, + 28, + 15, + 8, + 3, + 9, + 6, + 10, + 9, + 8, + 13, + 5, + 4, + 11, + 8, + 28, + 7, + 31, + 7, + 9, + 6, + 33, + 17, + 24, + 14, + 15, + 10, + 27, + 5 + ], + "weighted_loads": [ + 0.06918076425790787, + 0.1010449007153511, + 0.5874104704707861, + 0.5146982278674841, + 0.686239767819643, + 0.31131134182214737, + 0.36475574038922787, + 0.25426705181598663, + 0.1265944056212902, + 1.137640468776226, + 1.3735221344977617, + 1.1746088024228811, + 0.48094188421964645, + 1.4403129760175943, + 1.9208550620824099, + 0.8830209411680698, + 1.160794511437416, + 0.8000936005264521, + 0.7596494872123003, + 0.416702751070261, + 0.5659450311213732, + 1.825882950797677, + 0.7490449864417315, + 0.4530045557767153, + 1.2375926971435547, + 0.9606223478913307, + 2.2487144879996777, + 2.1820781007409096, + 0.2699633911252022, + 1.4130108561366796, + 1.5162558853626251, + 0.1526268571615219, + 0.7177305221557617, + 0.42452725023031235, + 1.423082796856761, + 0.34338645823299885, + 1.2837474700063467, + 0.7548213340342045, + 0.471581781283021, + 0.21261902526021004, + 0.3518639784306288, + 0.5958081521093845, + 0.36092362739145756, + 0.37164807319641113, + 0.29484080523252487, + 0.5093145687133074, + 0.28549350053071976, + 0.12292410247027874, + 0.4819545615464449, + 0.5707772709429264, + 1.4026393704116344, + 0.26217982545495033, + 1.8505045343190432, + 0.3854606356471777, + 0.45843925327062607, + 0.27149610966444016, + 2.8881804160773754, + 1.2571534998714924, + 1.4763993248343468, + 0.5889849625527859, + 1.4284138455986977, + 0.4720051698386669, + 1.5803600177168846, + 0.25814249739050865 + ], + "unique_experts": 64, + "load_cv": 0.6045362008493131, + "normalized_load_entropy": 0.956375537066885, + "max_load_share": 0.03691275167785235 + } + }, + "s0_period": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "ac4758228bbda53ae0f76e01a510a34cad15528d19cacb85f625c1339d46888e", + "route_weight_sha256": "56db4d434eac8ec07c7b74a7b8b83b6b4c2239193518861037d85e1955b98c1f", + "loads": [ + 2, + 2, + 10, + 12, + 10, + 7, + 8, + 3, + 4, + 11, + 12, + 6, + 9, + 28, + 16, + 10, + 13, + 11, + 20, + 11, + 11, + 12, + 7, + 11, + 16, + 10, + 11, + 17, + 4, + 22, + 10, + 5, + 16, + 10, + 15, + 6, + 13, + 13, + 3, + 4, + 9, + 7, + 12, + 4, + 8, + 12, + 3, + 2, + 9, + 7, + 20, + 6, + 22, + 6, + 6, + 3, + 14, + 8, + 14, + 5, + 13, + 9, + 24, + 4 + ], + "weighted_loads": [ + 0.06748179718852043, + 0.10050306469202042, + 0.5525634866207838, + 0.49698125571012497, + 0.4661316033452749, + 0.2577096112072468, + 0.3916915189474821, + 0.12329495884478092, + 0.17306149750947952, + 0.6720842458307743, + 0.6158817708492279, + 0.3458377905189991, + 0.45513479597866535, + 1.2862077951431274, + 1.0340119190514088, + 0.5082568451762199, + 1.1311786491423845, + 0.41567906737327576, + 0.7647594194859266, + 0.4804424997419119, + 0.5657042190432549, + 1.2875697761774063, + 0.2833317182958126, + 0.46938843466341496, + 0.7428135965019464, + 0.7874814905226231, + 0.9682565033435822, + 1.5549129508435726, + 0.22809185832738876, + 1.1606960594654083, + 0.600548529997468, + 0.17835098318755627, + 0.6352252587676048, + 0.4007602632045746, + 0.927413446828723, + 0.31016561575233936, + 0.5026946049183607, + 0.5379451047629118, + 0.12034443765878677, + 0.25017185881733894, + 0.3735462501645088, + 0.7732780501246452, + 0.38383917696774006, + 0.14616460911929607, + 0.2989824377000332, + 0.4929797798395157, + 0.09080378524959087, + 0.05900113098323345, + 0.4333703834563494, + 0.4216414652764797, + 1.1049686204642057, + 0.2593392785638571, + 1.1347535233944654, + 0.22173646464943886, + 0.23193267360329628, + 0.12426060810685158, + 1.1628040131181479, + 0.36814139038324356, + 0.8199671451002359, + 0.21783087402582169, + 1.2505071237683296, + 0.4319281205534935, + 1.4535957053303719, + 0.20496629737317562 + ], + "unique_experts": 64, + "load_cv": 0.55665186753558, + "normalized_load_entropy": 0.9635081667199527, + "max_load_share": 0.043209876543209874 + }, + "full_input": { + "tokens": 133, + "top_k": 6, + "decisions": 798, + "ordered_route_sha256": "71b29111a55f57fbca919e6ada1100c581cf74bf60fd33f09f3c33603a334aaa", + "route_weight_sha256": "6ae6a170600858929e3171845a20b83ad381e5cf3c9c6dc498006303636a2ef7", + "loads": [ + 2, + 2, + 10, + 13, + 10, + 8, + 8, + 5, + 4, + 15, + 15, + 10, + 9, + 30, + 29, + 11, + 13, + 20, + 20, + 11, + 11, + 15, + 9, + 11, + 24, + 10, + 16, + 25, + 4, + 22, + 17, + 5, + 19, + 11, + 18, + 6, + 20, + 13, + 3, + 4, + 9, + 7, + 13, + 7, + 9, + 13, + 7, + 2, + 10, + 7, + 28, + 6, + 28, + 6, + 8, + 5, + 30, + 16, + 20, + 6, + 13, + 9, + 25, + 6 + ], + "weighted_loads": [ + 0.06748179718852043, + 0.10050306469202042, + 0.5525634866207838, + 0.5388690531253815, + 0.4661316033452749, + 0.2999122440814972, + 0.3916915189474821, + 0.24712406285107136, + 0.17306149750947952, + 0.900969609618187, + 0.8270361348986626, + 0.6464047003537416, + 0.45513479597866535, + 1.4219148494303226, + 1.638414654880762, + 0.5681536570191383, + 1.1311786491423845, + 0.9555864855647087, + 0.7647594194859266, + 0.4804424997419119, + 0.5657042190432549, + 1.4771234020590782, + 0.379375122487545, + 0.46938843466341496, + 1.2663507964462042, + 0.7874814905226231, + 1.6426624916493893, + 1.8685214258730412, + 0.22809185832738876, + 1.1606960594654083, + 1.292146211490035, + 0.17835098318755627, + 0.7412256840616465, + 0.44229090213775635, + 1.1988477315753698, + 0.31016561575233936, + 0.8819663282483816, + 0.5379451047629118, + 0.12034443765878677, + 0.25017185881733894, + 0.3735462501645088, + 0.7732780501246452, + 0.4286623168736696, + 0.29838565923273563, + 0.3362898826599121, + 0.5236269980669022, + 0.3202194180339575, + 0.05900113098323345, + 0.4723236132413149, + 0.4216414652764797, + 1.4532297123223543, + 0.2593392785638571, + 1.6595820542424917, + 0.22173646464943886, + 0.3151972107589245, + 0.1999322809278965, + 2.3458858095109463, + 0.78822111338377, + 1.0554132480174303, + 0.26574982330203056, + 1.2505071237683296, + 0.4319281205534935, + 1.4940196499228477, + 0.3397386949509382 + ], + "unique_experts": 64, + "load_cv": 0.5986513402973208, + "normalized_load_entropy": 0.9582005304237391, + "max_load_share": 0.03759398496240601 + } + }, + "s1_period": { + "target_content": { + "tokens": 108, + "top_k": 6, + "decisions": 648, + "ordered_route_sha256": "9da73b71cab762a039211fd363e4a51b779184d888d3b8864ede1fadbadec5ba", + "route_weight_sha256": "6591fccc6357b1f134e37381b41ef9b92a31e66f6d1bbc5b38a0a34d138a7d2b", + "loads": [ + 2, + 2, + 10, + 11, + 11, + 5, + 7, + 2, + 3, + 11, + 12, + 6, + 10, + 33, + 19, + 13, + 13, + 12, + 19, + 9, + 11, + 12, + 7, + 12, + 16, + 11, + 13, + 16, + 5, + 24, + 9, + 2, + 13, + 11, + 17, + 6, + 15, + 12, + 6, + 2, + 8, + 7, + 7, + 5, + 8, + 9, + 2, + 2, + 9, + 6, + 20, + 7, + 19, + 5, + 6, + 2, + 14, + 8, + 15, + 7, + 13, + 10, + 25, + 4 + ], + "weighted_loads": [ + 0.06788955256342888, + 0.09902415424585342, + 0.5755817517638206, + 0.45417409017682076, + 0.5043021459132433, + 0.18352922424674034, + 0.37043471075594425, + 0.09333055838942528, + 0.13090137764811516, + 0.6967664286494255, + 0.6630725245922804, + 0.41757580265402794, + 0.47122493013739586, + 1.4725324865430593, + 1.136665789410472, + 0.597882179543376, + 1.1705150827765465, + 0.45960696786642075, + 0.7124906573444605, + 0.41518743708729744, + 0.5735207181423903, + 1.3430260121822357, + 0.2796563692390919, + 0.49577718414366245, + 0.6938920095562935, + 0.8562856875360012, + 0.9362451583147049, + 1.4112842865288258, + 0.259704802185297, + 1.2997672725468874, + 0.5528543666005135, + 0.07672189921140671, + 0.5403789505362511, + 0.42869535833597183, + 1.0396085381507874, + 0.32002663239836693, + 0.590669946745038, + 0.5050215031951666, + 0.2033236175775528, + 0.1751982644200325, + 0.3305486813187599, + 0.5460224896669388, + 0.2448709886521101, + 0.17238527163863182, + 0.283024275675416, + 0.38289663568139076, + 0.06821587681770325, + 0.05674878694117069, + 0.4145959187299013, + 0.42518873512744904, + 1.0733735393732786, + 0.25526459887623787, + 1.0314020030200481, + 0.19312914460897446, + 0.23696573078632355, + 0.08533868566155434, + 1.1821875646710396, + 0.44289598800241947, + 0.8991069439798594, + 0.2705100905150175, + 1.2391687594354153, + 0.46560702100396156, + 1.5127611551433802, + 0.2154872566461563 + ], + "unique_experts": 64, + "load_cv": 0.6044341562910444, + "normalized_load_entropy": 0.9574794530162993, + "max_load_share": 0.05092592592592592 + }, + "full_input": { + "tokens": 149, + "top_k": 6, + "decisions": 894, + "ordered_route_sha256": "981d93b3f2fab90254a4ed5dcf84b4807606275222488f3f4932c44ffa507efe", + "route_weight_sha256": "af1b4ca20339ab412ff54fd8eff617122fce400ec4fdcc6a0d653f7324005c2e", + "loads": [ + 2, + 2, + 10, + 11, + 14, + 6, + 7, + 4, + 3, + 18, + 19, + 12, + 10, + 35, + 32, + 18, + 13, + 18, + 19, + 9, + 11, + 19, + 13, + 12, + 26, + 13, + 25, + 27, + 5, + 27, + 19, + 3, + 18, + 12, + 23, + 6, + 28, + 18, + 9, + 3, + 9, + 7, + 9, + 9, + 8, + 10, + 6, + 3, + 12, + 8, + 27, + 7, + 30, + 7, + 10, + 6, + 34, + 15, + 25, + 14, + 15, + 10, + 28, + 6 + ], + "weighted_loads": [ + 0.06788955256342888, + 0.09902415424585342, + 0.5755817517638206, + 0.45417409017682076, + 0.6796699613332748, + 0.22773223742842674, + 0.37043471075594425, + 0.2549402378499508, + 0.13090137764811516, + 1.1014622561633587, + 1.383403753861785, + 1.032583326101303, + 0.47122493013739586, + 1.5805148165673018, + 1.9318103808909655, + 0.898942107334733, + 1.1705150827765465, + 0.9315741285681725, + 0.7124906573444605, + 0.41518743708729744, + 0.5735207181423903, + 1.8431761171668768, + 0.724025547504425, + 0.49577718414366245, + 1.2787879183888435, + 0.9628037586808205, + 2.2615063786506653, + 1.8267567995935678, + 0.259704802185297, + 1.402754696086049, + 1.5316701270639896, + 0.15676146745681763, + 0.7321226727217436, + 0.45776334404945374, + 1.471057552844286, + 0.32002663239836693, + 1.3243333082646132, + 0.8420157339423895, + 0.49509427323937416, + 0.21075917780399323, + 0.3617486525326967, + 0.5460224896669388, + 0.321384122595191, + 0.372929360717535, + 0.283024275675416, + 0.4001943599432707, + 0.3414047621190548, + 0.09878418408334255, + 0.5321795661002398, + 0.5789688602089882, + 1.3570691104978323, + 0.25526459887623787, + 1.8836282975971699, + 0.38398414477705956, + 0.48653846606612206, + 0.2682851776480675, + 3.010694310069084, + 1.1422048155218363, + 1.4754027221351862, + 0.5640654284507036, + 1.4727843217551708, + 0.46560702100396156, + 1.6370218601077795, + 0.34235506504774094 + ], + "unique_experts": 64, + "load_cv": 0.6168617309148698, + "normalized_load_entropy": 0.954960023824147, + "max_load_share": 0.039149888143176735 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 108, + "ordered_topk_exact_tokens": 51, + "set_exact_tokens": 61, + "mean_set_jaccard": 0.857583774250441, + "mean_token_weighted_tv": 0.02770436555578339, + "aggregate_load_tv": 0.043209876543209874 + }, + "system_bos": { + "tokens": 108, + "ordered_topk_exact_tokens": 41, + "set_exact_tokens": 56, + "mean_set_jaccard": 0.8544973544973546, + "mean_token_weighted_tv": 0.02482633839395863, + "aggregate_load_tv": 0.05092592592592592 + }, + "system_x": { + "tokens": 108, + "ordered_topk_exact_tokens": 34, + "set_exact_tokens": 56, + "mean_set_jaccard": 0.8505291005291006, + "mean_token_weighted_tv": 0.029679807584249863, + "aggregate_load_tv": 0.050925925925925916 + }, + "system_period": { + "tokens": 108, + "ordered_topk_exact_tokens": 26, + "set_exact_tokens": 54, + "mean_set_jaccard": 0.8412698412698413, + "mean_token_weighted_tv": 0.03234892307470242, + "aggregate_load_tv": 0.05555555555555555 + }, + "bos_at_s0": { + "tokens": 108, + "ordered_topk_exact_tokens": 52, + "set_exact_tokens": 63, + "mean_set_jaccard": 0.8644179894179894, + "mean_token_weighted_tv": 0.02869570724821339, + "aggregate_load_tv": 0.043209876543209874 + }, + "bos_at_s1": { + "tokens": 108, + "ordered_topk_exact_tokens": 42, + "set_exact_tokens": 57, + "mean_set_jaccard": 0.8377425044091711, + "mean_token_weighted_tv": 0.0290961979922873, + "aggregate_load_tv": 0.054012345679012336 + }, + "x_at_s0": { + "tokens": 108, + "ordered_topk_exact_tokens": 54, + "set_exact_tokens": 66, + "mean_set_jaccard": 0.8763227513227513, + "mean_token_weighted_tv": 0.027587204848209188, + "aggregate_load_tv": 0.043209876543209874 + }, + "x_at_s1": { + "tokens": 108, + "ordered_topk_exact_tokens": 36, + "set_exact_tokens": 53, + "mean_set_jaccard": 0.8390652557319224, + "mean_token_weighted_tv": 0.03288120111554033, + "aggregate_load_tv": 0.05709876543209876 + }, + "period_at_s0": { + "tokens": 108, + "ordered_topk_exact_tokens": 42, + "set_exact_tokens": 58, + "mean_set_jaccard": 0.8452380952380953, + "mean_token_weighted_tv": 0.03168231100965015, + "aggregate_load_tv": 0.043209876543209874 + }, + "period_at_s1": { + "tokens": 108, + "ordered_topk_exact_tokens": 42, + "set_exact_tokens": 56, + "mean_set_jaccard": 0.8355379188712523, + "mean_token_weighted_tv": 0.03419336217834994, + "aggregate_load_tv": 0.06481481481481481 + } + } + } + } + }, + { + "id": "HumanEval/133", + "domain": "code", + "label": "Python code", + "within_domain_index": 2, + "selection_rank": "03661faa70d0db8ba0c1d391356f9c7cdb8f50ccbeedc0911f6b2a3be0190ed3", + "source_text_sha256": "8c46f1b09d1a8179497c272a2597766eb2a53fbd00cb8cdd8a8446e547103a13", + "source_characters": 466, + "source_tokens": 166, + "content_token_ids_sha256": "d9f876e3ac32a3f92a85e04db7e4b065951a1b97636049b0c85a8fdea09100db", + "prompt_tokens_by_condition": { + "s0_eos": 191, + "s1_eos": 207, + "s0_bos": 191, + "s1_bos": 207, + "s0_x": 191, + "s1_x": 207, + "s0_period": 191, + "s1_period": 207 + }, + "batch_prompt_tokens": 207, + "content_tokens": 166, + "boundary_crossing_tokens_by_condition": { + "s0_eos": 0, + "s1_eos": 0, + "s0_bos": 0, + "s1_bos": 0, + "s0_x": 0, + "s1_x": 0, + "s0_period": 0, + "s1_period": 0 + }, + "forward_seconds": 0.9575460019987077, + "peak_cuda_memory_allocated_bytes": 27786528256, + "hidden_stages": { + "embedding": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8df58391d15fcb98515d2ed9011c7504be48e08598f03c8354e23c9fefc1b1b6", + "mean": -0.0007786780479364097, + "std": 0.08182535320520401, + "rms": 0.08182906359434128, + "max_abs": 2.046875 + }, + "full_input": { + "shape": [ + 191, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "00009dfad9801b501ee438504b2e9f3e5583936cb7ba91dfe35e9050843b2a78", + "mean": -0.0007994459010660648, + "std": 0.08227977901697159, + "rms": 0.08228365331888199, + "max_abs": 2.046875 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8df58391d15fcb98515d2ed9011c7504be48e08598f03c8354e23c9fefc1b1b6", + "mean": -0.0007786780479364097, + "std": 0.08182535320520401, + "rms": 0.08182906359434128, + "max_abs": 2.046875 + }, + "full_input": { + "shape": [ + 207, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b7b01baf2c751ca6010b497849f9ff715cc8cf9d293e1d0296b862fd420fcdd4", + "mean": -0.0009074752451851964, + "std": 0.08423199504613876, + "rms": 0.08423688262701035, + "max_abs": 2.046875 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8df58391d15fcb98515d2ed9011c7504be48e08598f03c8354e23c9fefc1b1b6", + "mean": -0.0007786780479364097, + "std": 0.08182535320520401, + "rms": 0.08182906359434128, + "max_abs": 2.046875 + }, + "full_input": { + "shape": [ + 191, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7cda56a73fc4496517173aa77991839cf596ffbdc1a77ab119c917bee6525f30", + "mean": -0.0007914187153801322, + "std": 0.08216077834367752, + "rms": 0.08216459304094315, + "max_abs": 2.046875 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8df58391d15fcb98515d2ed9011c7504be48e08598f03c8354e23c9fefc1b1b6", + "mean": -0.0007786780479364097, + "std": 0.08182535320520401, + "rms": 0.08182906359434128, + "max_abs": 2.046875 + }, + "full_input": { + "shape": [ + 207, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e58a5b5a27865716602ec85072c4b5328ee105e9f50ee505d0e28b1df30440a1", + "mean": -0.0009000684949569404, + "std": 0.08412475883960724, + "rms": 0.08412957191467285, + "max_abs": 2.046875 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8df58391d15fcb98515d2ed9011c7504be48e08598f03c8354e23c9fefc1b1b6", + "mean": -0.0007786780479364097, + "std": 0.08182535320520401, + "rms": 0.08182906359434128, + "max_abs": 2.046875 + }, + "full_input": { + "shape": [ + 191, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e1a4acf073a250752a87370757030ad6fc8cc67d83845f1ed9d731b76b3b9323", + "mean": -0.0008111174684017897, + "std": 0.082240991294384, + "rms": 0.08224499225616455, + "max_abs": 2.046875 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8df58391d15fcb98515d2ed9011c7504be48e08598f03c8354e23c9fefc1b1b6", + "mean": -0.0007786780479364097, + "std": 0.08182535320520401, + "rms": 0.08182906359434128, + "max_abs": 2.046875 + }, + "full_input": { + "shape": [ + 207, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "450d3ddc69657e7bfcf22f4e49a6d5bb0cbe609d4f3a2050f1504a956e466e06", + "mean": -0.0009182447101920843, + "std": 0.0841970220208168, + "rms": 0.08420202881097794, + "max_abs": 2.046875 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8df58391d15fcb98515d2ed9011c7504be48e08598f03c8354e23c9fefc1b1b6", + "mean": -0.0007786780479364097, + "std": 0.08182535320520401, + "rms": 0.08182906359434128, + "max_abs": 2.046875 + }, + "full_input": { + "shape": [ + 191, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d8ae2762b33cf807837eab712cdca10366413194036e7e53dd04a5ee6c5acedb", + "mean": -0.0008115422679111362, + "std": 0.08214960247278214, + "rms": 0.08215361088514328, + "max_abs": 2.046875 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8df58391d15fcb98515d2ed9011c7504be48e08598f03c8354e23c9fefc1b1b6", + "mean": -0.0007786780479364097, + "std": 0.08182535320520401, + "rms": 0.08182906359434128, + "max_abs": 2.046875 + }, + "full_input": { + "shape": [ + 207, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "89ac85eea7d408870446c9a4e6a803161ea9606b4175c27a782b9b18c1fb1b88", + "mean": -0.0009186366223730147, + "std": 0.08411466330289841, + "rms": 0.08411967754364014, + "max_abs": 2.046875 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 166, + "exact_hidden_rows": 166, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999999403953552, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "system_bos": { + "tokens": 166, + "exact_hidden_rows": 166, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999999403953552, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "system_x": { + "tokens": 166, + "exact_hidden_rows": 166, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999999403953552, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "system_period": { + "tokens": 166, + "exact_hidden_rows": 166, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999999403953552, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "bos_at_s0": { + "tokens": 166, + "exact_hidden_rows": 166, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999999403953552, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "bos_at_s1": { + "tokens": 166, + "exact_hidden_rows": 166, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999999403953552, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "x_at_s0": { + "tokens": 166, + "exact_hidden_rows": 166, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999999403953552, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "x_at_s1": { + "tokens": 166, + "exact_hidden_rows": 166, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999999403953552, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "period_at_s0": { + "tokens": 166, + "exact_hidden_rows": 166, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999999403953552, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "period_at_s1": { + "tokens": 166, + "exact_hidden_rows": 166, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999999403953552, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + } + } + }, + "layer_00": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2f13d69fe1b48a56bd5cb03fb344fd07a941d21926e379b0e3d3a55f3ae7e767", + "mean": -0.0010779483709484339, + "std": 0.0793178528547287, + "rms": 0.07932517677545547, + "max_abs": 2.4375 + }, + "full_input": { + "shape": [ + 191, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a411c44131d1f18dd959c5c0a291830d4bf712201b1848aa1a6df643a269745f", + "mean": -0.0011390403378754854, + "std": 0.08071647584438324, + "rms": 0.08072451502084732, + "max_abs": 2.4375 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "dfb1618fdde229ba6da93a1fcd4d61f3e86bfac365d741ca596b7db7bce87cb6", + "mean": -0.0010662423446774483, + "std": 0.07919520884752274, + "rms": 0.07920239120721817, + "max_abs": 2.4375 + }, + "full_input": { + "shape": [ + 207, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e68b275e80d6fa03c6a2f4ef89cfe12b8b3b29f6c018125dae3a6c2040c2d616", + "mean": -0.001220647944137454, + "std": 0.08209862560033798, + "rms": 0.08210770040750504, + "max_abs": 2.4375 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6e6e6b2fdd62afb37c1b0c2b0b92f86da92fb3862da67b7ae9fff84cc3638353", + "mean": -0.0010623109992593527, + "std": 0.07935061305761337, + "rms": 0.07935772836208344, + "max_abs": 2.390625 + }, + "full_input": { + "shape": [ + 191, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "aadaeeefb9a8a74b8f7e4fcfeb32724c604325486d22d5d89b0823bb9ee0032a", + "mean": -0.0011144921882078052, + "std": 0.0805688127875328, + "rms": 0.08057651668787003, + "max_abs": 2.4375 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1dc2be5ce050be285d3c99764a73e6a4ab0564b2342db7f2df2b911714a436ec", + "mean": -0.001062597963027656, + "std": 0.07904121279716492, + "rms": 0.07904835790395737, + "max_abs": 2.390625 + }, + "full_input": { + "shape": [ + 207, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c33be956ad175d0014161b74a2dbe85272e9d5ea35828de28952303b4cf0243a", + "mean": -0.0012077855644747615, + "std": 0.08181950449943542, + "rms": 0.08182842284440994, + "max_abs": 2.4375 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bcc578fe5d111d67264a3d75d4d38efcf55006234d9327a4a7782eb788b536b9", + "mean": -0.001080336864106357, + "std": 0.07890687137842178, + "rms": 0.07891426980495453, + "max_abs": 2.390625 + }, + "full_input": { + "shape": [ + 191, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b58658b54095eccf9075ad75fdc28782ab5fb35538c5f70976d5d99e4cdfce29", + "mean": -0.0011424425756558776, + "std": 0.08027957379817963, + "rms": 0.08028770238161087, + "max_abs": 2.4375 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "945cbe4eb139e529b512bbfd12fe2eb2874f8e67574ca17d889d2e1f264b2612", + "mean": -0.0010807556100189686, + "std": 0.07867316156625748, + "rms": 0.07868058234453201, + "max_abs": 2.390625 + }, + "full_input": { + "shape": [ + 207, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "206baad747990175dd7665081d694823260044c89578954b653d22e3d4b8bdc2", + "mean": -0.0012358523672446609, + "std": 0.08162876218557358, + "rms": 0.08163811266422272, + "max_abs": 2.4375 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f1c4001a1b2db0608f03b7d362c7eb26dfbaa0919a5f02adff0bc2122419b052", + "mean": -0.001077794935554266, + "std": 0.07889223098754883, + "rms": 0.07889959216117859, + "max_abs": 2.390625 + }, + "full_input": { + "shape": [ + 191, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5dcf9a9c24b60674a9198444c128313a1a134d401a30a7475e0feecec7936aeb", + "mean": -0.0011399852810427547, + "std": 0.08012749999761581, + "rms": 0.08013560622930527, + "max_abs": 2.4375 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8006d8faea7aa574a905429e93c0cd24425cdd0c4d6fcdfd05e2856282626ae6", + "mean": -0.0010786858620122075, + "std": 0.07867085188627243, + "rms": 0.07867824286222458, + "max_abs": 2.375 + }, + "full_input": { + "shape": [ + 207, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b9d6f35549384d4096792a23ca1d36be19fb2f72393740778e1fe10169ed4c71", + "mean": -0.0012326415162533522, + "std": 0.0814884752035141, + "rms": 0.08149780333042145, + "max_abs": 2.4375 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9993635416030884, + "min_cosine_similarity": 0.9929966926574707, + "mean_relative_l2": 0.03305913135409355, + "max_abs_delta": 0.1640625 + }, + "system_bos": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9991463422775269, + "min_cosine_similarity": 0.9853025078773499, + "mean_relative_l2": 0.03648839518427849, + "max_abs_delta": 0.171875 + }, + "system_x": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9991960525512695, + "min_cosine_similarity": 0.9858115315437317, + "mean_relative_l2": 0.03547566756606102, + "max_abs_delta": 0.171875 + }, + "system_period": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9992159008979797, + "min_cosine_similarity": 0.9864873886108398, + "mean_relative_l2": 0.0351877398788929, + "max_abs_delta": 0.1796875 + }, + "bos_at_s0": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9924496412277222, + "min_cosine_similarity": 0.9364101886749268, + "mean_relative_l2": 0.11699093133211136, + "max_abs_delta": 0.182403564453125 + }, + "bos_at_s1": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9929278492927551, + "min_cosine_similarity": 0.946679949760437, + "mean_relative_l2": 0.11408091336488724, + "max_abs_delta": 0.1796875 + }, + "x_at_s0": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9931037425994873, + "min_cosine_similarity": 0.9397907257080078, + "mean_relative_l2": 0.11118569225072861, + "max_abs_delta": 0.193359375 + }, + "x_at_s1": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9933745861053467, + "min_cosine_similarity": 0.9494681358337402, + "mean_relative_l2": 0.1100262999534607, + "max_abs_delta": 0.203125 + }, + "period_at_s0": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9931831955909729, + "min_cosine_similarity": 0.9413118958473206, + "mean_relative_l2": 0.1107519119977951, + "max_abs_delta": 0.19140625 + }, + "period_at_s1": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9934167265892029, + "min_cosine_similarity": 0.9498564004898071, + "mean_relative_l2": 0.10977545380592346, + "max_abs_delta": 0.201171875 + } + } + }, + "layer_01": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e15b4f2bc52b4e6ba3a0e3ca739c33c3f3599fe08afcb30be803f9e532c9333a", + "mean": -0.0016103220405057073, + "std": 0.09462593495845795, + "rms": 0.09463963657617569, + "max_abs": 2.75 + }, + "full_input": { + "shape": [ + 191, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3fbb079754ea0b10963193bc09fc773d44f353c7bb97737db8b3dd28e382d7f2", + "mean": -0.0031034178100526333, + "std": 0.58478182554245, + "rms": 0.584790050983429, + "max_abs": 126.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b770fdcae7fb37dbf83280617d897ecc16c8271cb8dc1433159fb465daf50225", + "mean": -0.0015768656739965081, + "std": 0.09452488273382187, + "rms": 0.09453802555799484, + "max_abs": 2.71875 + }, + "full_input": { + "shape": [ + 207, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3e955c50d252b1da73dccf13ea392602ea366ac406ef849f86e40016d0cd3d23", + "mean": -0.003161607077345252, + "std": 0.5816667079925537, + "rms": 0.5816752910614014, + "max_abs": 135.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1227a56bd25b2a16ce983ea8edb648fbe84cf629549de1f078b03eb10dfbcba4", + "mean": -0.0017309142276644707, + "std": 0.09427213668823242, + "rms": 0.09428802877664566, + "max_abs": 2.6875 + }, + "full_input": { + "shape": [ + 191, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "828e3ee255f6e2db94d77a555eee08e13796f08ce122521eb85dde6ba6e1bc32", + "mean": -0.0017005131812766194, + "std": 0.0973372682929039, + "rms": 0.09735212475061417, + "max_abs": 4.6875 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b3877b479cf554d6e233c957a4ae5f80ed30184b3ce8c190431a3ffc5e2852bd", + "mean": -0.0017286211950704455, + "std": 0.09331203997135162, + "rms": 0.09332805126905441, + "max_abs": 2.6875 + }, + "full_input": { + "shape": [ + 207, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b68e84ad74583b30fbe636e79934c644efd053c0b4a413e8906db7c697f5b876", + "mean": -0.001823627739213407, + "std": 0.09790860861539841, + "rms": 0.0979255884885788, + "max_abs": 4.6875 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ad1b6009431cb7e3b84d48b0644fe6eabe3b5092deefee9b8d40358206f15f9f", + "mean": -0.0017153286607936025, + "std": 0.09413596987724304, + "rms": 0.09415160119533539, + "max_abs": 2.703125 + }, + "full_input": { + "shape": [ + 191, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5af009d01273dc1d04ed1b692f3a665ffce210a02e5c3b9841f6a02644b49ab9", + "mean": -0.0016913083381950855, + "std": 0.09725537151098251, + "rms": 0.09727008640766144, + "max_abs": 4.6875 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8d337b0f0a3c4ff38ccd02123a444d4be5457c8780c43b9afa72558205f5e2b6", + "mean": -0.0017010937444865704, + "std": 0.0928882360458374, + "rms": 0.09290380775928497, + "max_abs": 2.6875 + }, + "full_input": { + "shape": [ + 207, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b957ca0fbb737b45b9db41cb5c6568943deb33a120f6987af24f6cd0c7b00582", + "mean": -0.0018080982845276594, + "std": 0.09762514382600784, + "rms": 0.09764188528060913, + "max_abs": 4.6875 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "79cd6feacb2c31ee0f4a00a12f959fbe89186da5698fdbe2426595706049cfca", + "mean": -0.0017105016158893704, + "std": 0.09412508457899094, + "rms": 0.09414061903953552, + "max_abs": 2.6875 + }, + "full_input": { + "shape": [ + 191, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3a8484f6804241bd079a0e88a9887b394b40452be69552754993118032fd0211", + "mean": -0.001696942956186831, + "std": 0.09704829752445221, + "rms": 0.09706313908100128, + "max_abs": 4.6875 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "25aa854f7a62ddffd7c7aaa5a3cfe219f387dd74e6db41faabff44b87f451652", + "mean": -0.0016994801117107272, + "std": 0.09287645667791367, + "rms": 0.09289200603961945, + "max_abs": 2.65625 + }, + "full_input": { + "shape": [ + 207, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9d102b5a1dee40474373f62450e2b8ef22c86d80ef356c976ace73bf7b298523", + "mean": -0.0018134551355615258, + "std": 0.09743747860193253, + "rms": 0.09745434671640396, + "max_abs": 4.6875 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9988123178482056, + "min_cosine_similarity": 0.9892250299453735, + "mean_relative_l2": 0.04386323317885399, + "max_abs_delta": 0.2109375 + }, + "system_bos": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9976625442504883, + "min_cosine_similarity": 0.9773950576782227, + "mean_relative_l2": 0.060035280883312225, + "max_abs_delta": 0.1796875 + }, + "system_x": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9967586398124695, + "min_cosine_similarity": 0.9616672992706299, + "mean_relative_l2": 0.06862205266952515, + "max_abs_delta": 0.2109375 + }, + "system_period": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9967588186264038, + "min_cosine_similarity": 0.9612433910369873, + "mean_relative_l2": 0.06843288987874985, + "max_abs_delta": 0.21875 + }, + "bos_at_s0": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9920879602432251, + "min_cosine_similarity": 0.9069550037384033, + "mean_relative_l2": 0.11774644255638123, + "max_abs_delta": 0.259765625 + }, + "bos_at_s1": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9917129874229431, + "min_cosine_similarity": 0.9182588458061218, + "mean_relative_l2": 0.1211697906255722, + "max_abs_delta": 0.28125 + }, + "x_at_s0": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9926059246063232, + "min_cosine_similarity": 0.9015737771987915, + "mean_relative_l2": 0.11264050751924515, + "max_abs_delta": 0.3359375 + }, + "x_at_s1": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9913867115974426, + "min_cosine_similarity": 0.9087306261062622, + "mean_relative_l2": 0.12188714742660522, + "max_abs_delta": 0.359375 + }, + "period_at_s0": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9926972985267639, + "min_cosine_similarity": 0.9034013152122498, + "mean_relative_l2": 0.1122116670012474, + "max_abs_delta": 0.33203125 + }, + "period_at_s1": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9913960695266724, + "min_cosine_similarity": 0.907025158405304, + "mean_relative_l2": 0.12173452973365784, + "max_abs_delta": 0.34765625 + } + } + }, + "layer_02": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f363b22d39385729e83dcda777dccfc7e2fe6f3729c2e31e0493f4cb6904535f", + "mean": -0.001718204584904015, + "std": 0.11721572279930115, + "rms": 0.11722832173109055, + "max_abs": 3.5625 + }, + "full_input": { + "shape": [ + 191, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "74210c8e6cf432af92f5bdb466af03c8d4785cfeb8ffbec687d7838b6e173c88", + "mean": -0.006639060098677874, + "std": 1.7409908771514893, + "rms": 1.741003394126892, + "max_abs": 392.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d5c5af3bcb503a03bd4c5a187583b8e225e852bf6faa7decd48670d345a8ccf0", + "mean": -0.0016483691288158298, + "std": 0.11673516035079956, + "rms": 0.11674679815769196, + "max_abs": 3.484375 + }, + "full_input": { + "shape": [ + 207, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "afd62da44c6d0ee95150ced1c07af0133dcac8ed56585ff7cfd2b532c4b73f42", + "mean": -0.007048208266496658, + "std": 1.8492759466171265, + "rms": 1.8492892980575562, + "max_abs": 436.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0685febc50774f18e05c1c0492b0e4ad0db412b8e23a927ce92bdcdd77a22ce9", + "mean": -0.0017186913173645735, + "std": 0.11694562435150146, + "rms": 0.11695825308561325, + "max_abs": 3.59375 + }, + "full_input": { + "shape": [ + 191, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "138b7c66840eade68117d6e075c61496d6b7f7c2f9f8ba3da33937d0384d319c", + "mean": -0.0018539881566539407, + "std": 0.16722458600997925, + "rms": 0.1672348529100418, + "max_abs": 23.75 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1456f1ccc5c5d6a6b86485f69bb3f577efefefbb488fff84f6db436c1bcb02d4", + "mean": -0.0015656868927180767, + "std": 0.11591524630784988, + "rms": 0.11592582613229752, + "max_abs": 3.5 + }, + "full_input": { + "shape": [ + 207, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c2d2d70c2afa16dcbab49d05130191ce6abbf59976116dd358eeff521647e5b2", + "mean": -0.0017650184454396367, + "std": 0.1642594188451767, + "rms": 0.1642688810825348, + "max_abs": 23.75 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d313a2ced8180739641e0c7e72a378b966daf482849f44f1485303d0d7480aa3", + "mean": -0.0017299582250416279, + "std": 0.11637375503778458, + "rms": 0.11638661473989487, + "max_abs": 3.59375 + }, + "full_input": { + "shape": [ + 191, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "765a67e1d398b9eff8b2e396bc0ff00aca311da471431b5156ba1b63d4078642", + "mean": -0.0018670704448595643, + "std": 0.16691850125789642, + "rms": 0.1669289469718933, + "max_abs": 23.75 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "51261323313771ae95b66e8f61c24b81f45cb5f6fc5d7baea844f13d2665bdcd", + "mean": -0.001527390442788601, + "std": 0.11508882790803909, + "rms": 0.11509896069765091, + "max_abs": 3.484375 + }, + "full_input": { + "shape": [ + 207, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b6c3924aa175b912785f9fa5638c6feddbda5f1f9a915fc39150277b78e3711f", + "mean": -0.0017377990297973156, + "std": 0.16383983194828033, + "rms": 0.16384902596473694, + "max_abs": 23.75 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3d2b2cfa854f7d51857dace7b4d82de88425771152ca2850dada8429472356d9", + "mean": -0.0017137796385213733, + "std": 0.11635822057723999, + "rms": 0.11637084186077118, + "max_abs": 3.5625 + }, + "full_input": { + "shape": [ + 191, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5e392410198b9a6ddc8108c814359ac17c4a80d11c4e308139e6317d2263a731", + "mean": -0.0018843179568648338, + "std": 0.16667628288269043, + "rms": 0.16668693721294403, + "max_abs": 23.75 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a40a5a9d7864dc79d19b0a3f373b33801ee0e1139bc79998032834d029ac89dd", + "mean": -0.0015129290986806154, + "std": 0.11502692103385925, + "rms": 0.11503687500953674, + "max_abs": 3.484375 + }, + "full_input": { + "shape": [ + 207, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "334306f6a4c7147d356d06370ecf028f2b84629773cc7605baae7dcc5b3936fa", + "mean": -0.0017485911957919598, + "std": 0.16359512507915497, + "rms": 0.1636044681072235, + "max_abs": 23.75 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9986089468002319, + "min_cosine_similarity": 0.9872465133666992, + "mean_relative_l2": 0.047975268214941025, + "max_abs_delta": 0.3125 + }, + "system_bos": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9973056316375732, + "min_cosine_similarity": 0.9730252623558044, + "mean_relative_l2": 0.06519214063882828, + "max_abs_delta": 0.3125 + }, + "system_x": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9960942268371582, + "min_cosine_similarity": 0.9628655910491943, + "mean_relative_l2": 0.07639181613922119, + "max_abs_delta": 0.421875 + }, + "system_period": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9960879683494568, + "min_cosine_similarity": 0.9619033336639404, + "mean_relative_l2": 0.07625582069158554, + "max_abs_delta": 0.4375 + }, + "bos_at_s0": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9920854568481445, + "min_cosine_similarity": 0.8742923736572266, + "mean_relative_l2": 0.11672338098287582, + "max_abs_delta": 0.4375 + }, + "bos_at_s1": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9908128976821899, + "min_cosine_similarity": 0.872806966304779, + "mean_relative_l2": 0.12610045075416565, + "max_abs_delta": 0.4609375 + }, + "x_at_s0": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9919336438179016, + "min_cosine_similarity": 0.8444966077804565, + "mean_relative_l2": 0.11498904973268509, + "max_abs_delta": 0.546875 + }, + "x_at_s1": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.98957759141922, + "min_cosine_similarity": 0.8324297070503235, + "mean_relative_l2": 0.13095466792583466, + "max_abs_delta": 0.578125 + }, + "period_at_s0": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9919913411140442, + "min_cosine_similarity": 0.8462765216827393, + "mean_relative_l2": 0.11522960662841797, + "max_abs_delta": 0.5234375 + }, + "period_at_s1": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.989534318447113, + "min_cosine_similarity": 0.829754114151001, + "mean_relative_l2": 0.13152797520160675, + "max_abs_delta": 0.5625 + } + } + }, + "layer_03": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b30a49a55e7f19ee10999b4b04f7e2a1d9d49fb3f9b76a73b9aed1c03633bf1d", + "mean": -0.002085799816995859, + "std": 0.14501002430915833, + "rms": 0.14502502977848053, + "max_abs": 4.4375 + }, + "full_input": { + "shape": [ + 191, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ed12d436a6d8ffc698a4a54843db0f9f20af8f8eeb755512d7afb0b6e7ed0352", + "mean": -0.008680382743477821, + "std": 5.214129447937012, + "rms": 5.214137077331543, + "max_abs": 1136.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d07a0ed6dd3b05d2e9c7e18378b78e05dde878de31259dcd7023da6d565052d0", + "mean": -0.002031683921813965, + "std": 0.14485175907611847, + "rms": 0.1448660045862198, + "max_abs": 4.40625 + }, + "full_input": { + "shape": [ + 207, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0a6a3eaac91bdcff96aee5402de15cc9e2bbd3108236358f966911a2f2acec29", + "mean": -0.009130708873271942, + "std": 5.171659469604492, + "rms": 5.171667575836182, + "max_abs": 1136.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "686f7bc7ef84d480ab8a1d4f1267dbc4a680fccb6665d17fac156934f50e2bcc", + "mean": -0.002148343250155449, + "std": 0.1455087810754776, + "rms": 0.14552465081214905, + "max_abs": 4.5 + }, + "full_input": { + "shape": [ + 191, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "281fe660a2c3b350a9a469865994126288fc9be8ee83b8ecc50d8616cc71b8f4", + "mean": -0.003407865995541215, + "std": 4.649864673614502, + "rms": 4.649866580963135, + "max_abs": 1136.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1eac1cb12aa845197bdbe3f9edac3e5bc52598a7e8703ff4d3f561a3daf0abf2", + "mean": -0.002099341945722699, + "std": 0.14495517313480377, + "rms": 0.1449703872203827, + "max_abs": 4.4375 + }, + "full_input": { + "shape": [ + 207, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "185892481941757ff879f41738d731305b3dd5f478a448478a1a4a4a5490bf7c", + "mean": -0.003394302213564515, + "std": 4.466731548309326, + "rms": 4.466732978820801, + "max_abs": 1136.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "48a65d5e8cf4fa1bae86452df26ca47f9bb9d087be62084b7e75972e52102867", + "mean": -0.0021495535038411617, + "std": 0.14433063566684723, + "rms": 0.14434663951396942, + "max_abs": 4.4375 + }, + "full_input": { + "shape": [ + 191, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a57236d1e8ff3bafd2ce58c193cada49e71ba6c85e671608806d70746279d690", + "mean": -0.0034360296558588743, + "std": 4.649824142456055, + "rms": 4.6498260498046875, + "max_abs": 1136.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4de9848165d8243e60560f9630155ee8b52bf85959103eec9849a14b2c9ea007", + "mean": -0.0021081415470689535, + "std": 0.1438232660293579, + "rms": 0.14383871853351593, + "max_abs": 4.4375 + }, + "full_input": { + "shape": [ + 207, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "908ed3fb4cf217be52c3b3000a515f7590d33cb0710e02c77619f19296889d9d", + "mean": -0.003428522264584899, + "std": 4.466695785522461, + "rms": 4.466696739196777, + "max_abs": 1136.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a0f4d264ab8bad4a829571a9f1ce33af79533e5be8ec7ea156bccec0cdbd3984", + "mean": -0.0021192035637795925, + "std": 0.14425162971019745, + "rms": 0.14426720142364502, + "max_abs": 4.4375 + }, + "full_input": { + "shape": [ + 191, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6c5bdc23c9a6e49d696ed25edf6a49dd8dae4bae7754bd790c4da88cfb20ddd9", + "mean": -0.00341508025303483, + "std": 4.649815559387207, + "rms": 4.649816989898682, + "max_abs": 1136.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d1783adcf2283e5b5fb6c60882cecf9acdc5787d45527611490e2fa5d5d5484a", + "mean": -0.0020840184297412634, + "std": 0.1436404287815094, + "rms": 0.14365555346012115, + "max_abs": 4.40625 + }, + "full_input": { + "shape": [ + 207, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a57fa9e698d350e229ae795da1ffd98964ce29aba79f754228a548f7a78f4f6d", + "mean": -0.0034121540375053883, + "std": 4.466684818267822, + "rms": 4.466686248779297, + "max_abs": 1136.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9985541105270386, + "min_cosine_similarity": 0.9842674732208252, + "mean_relative_l2": 0.048502061516046524, + "max_abs_delta": 0.3125 + }, + "system_bos": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9970719814300537, + "min_cosine_similarity": 0.971909761428833, + "mean_relative_l2": 0.06844402104616165, + "max_abs_delta": 0.3125 + }, + "system_x": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9957424402236938, + "min_cosine_similarity": 0.9585716128349304, + "mean_relative_l2": 0.07979226112365723, + "max_abs_delta": 0.3125 + }, + "system_period": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9957211017608643, + "min_cosine_similarity": 0.9545067548751831, + "mean_relative_l2": 0.08009873330593109, + "max_abs_delta": 0.375 + }, + "bos_at_s0": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9928579926490784, + "min_cosine_similarity": 0.8813953995704651, + "mean_relative_l2": 0.11046509444713593, + "max_abs_delta": 0.4375 + }, + "bos_at_s1": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9914057850837708, + "min_cosine_similarity": 0.8783010244369507, + "mean_relative_l2": 0.1209021508693695, + "max_abs_delta": 0.4375 + }, + "x_at_s0": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9923321008682251, + "min_cosine_similarity": 0.841529130935669, + "mean_relative_l2": 0.11033450812101364, + "max_abs_delta": 0.5703125 + }, + "x_at_s1": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9898162484169006, + "min_cosine_similarity": 0.8230034112930298, + "mean_relative_l2": 0.12691178917884827, + "max_abs_delta": 0.5390625 + }, + "period_at_s0": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9924184083938599, + "min_cosine_similarity": 0.8377500772476196, + "mean_relative_l2": 0.10984504967927933, + "max_abs_delta": 0.55859375 + }, + "period_at_s1": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9894744753837585, + "min_cosine_similarity": 0.7963885068893433, + "mean_relative_l2": 0.1284162700176239, + "max_abs_delta": 0.50390625 + } + } + }, + "layer_04": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1d1f424f2ba1d76781cc053340140b98bb658f224c64836f2c1a5727f5d9d79d", + "mean": -0.0029932374600321054, + "std": 0.17892910540103912, + "rms": 0.1789541393518448, + "max_abs": 5.4375 + }, + "full_input": { + "shape": [ + 191, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f9080fda01fde6286c30af046cd21e8003fe0a4cdabbad395b8ae7c81b7643eb", + "mean": -0.009379442781209946, + "std": 5.442996978759766, + "rms": 5.443005084991455, + "max_abs": 1152.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4d112592afdcd4ecc9b4ac36e955e7d7e53f10d247f495af44f734f76c31d5f8", + "mean": -0.0029380887281149626, + "std": 0.17925797402858734, + "rms": 0.1792820543050766, + "max_abs": 5.375 + }, + "full_input": { + "shape": [ + 207, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a0622f2fd1f7dbd50bd848d0c71597df7ee0fe90b820de937c39b3661726616b", + "mean": -0.009792063385248184, + "std": 5.382800102233887, + "rms": 5.382809162139893, + "max_abs": 1152.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "af0a41d46f50e94b7a86169f0da2deb493c6bad2233269cec73c26588640cadd", + "mean": -0.0029458089265972376, + "std": 0.18034209311008453, + "rms": 0.1803661435842514, + "max_abs": 5.65625 + }, + "full_input": { + "shape": [ + 191, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4897bfd93a1ad8c1e4f5f5bbbd2ded01494e240bb6bfcc48b9065e896cfc0baa", + "mean": -0.0040128519758582115, + "std": 4.879645347595215, + "rms": 4.879647254943848, + "max_abs": 1152.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "72c02b7da319d671b4e8bb0e4b3e41202c8c14dfdb9728b4a2f3754da7617526", + "mean": -0.002878975123167038, + "std": 0.18032728135585785, + "rms": 0.18035025894641876, + "max_abs": 5.4375 + }, + "full_input": { + "shape": [ + 207, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3b929516dd754a86428054c6e49906df7db616ea88e59f0df322288b7f9fcf04", + "mean": -0.003952736966311932, + "std": 4.680878162384033, + "rms": 4.680879592895508, + "max_abs": 1152.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6891928b1a158a4ffa1ed2f58eb4068183d75099dfe3ed830147b75b989bf46c", + "mean": -0.002878044731914997, + "std": 0.17872504889965057, + "rms": 0.178748220205307, + "max_abs": 5.53125 + }, + "full_input": { + "shape": [ + 191, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "75adb56970876944ba93b90b698c44137fa2f542e2ab1ef6170d47dc841a431c", + "mean": -0.00393572635948658, + "std": 4.879575252532959, + "rms": 4.879576683044434, + "max_abs": 1152.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bd7a426ba7f1bd078fbf9313bf3f7954b7c4e41625b7b933c6fe4717720cb9f3", + "mean": -0.0028822633903473616, + "std": 0.17894697189331055, + "rms": 0.17897017300128937, + "max_abs": 5.40625 + }, + "full_input": { + "shape": [ + 207, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "de0fcdb010d173734d8646a93a3fd171377a9f88c02d56be840cc1670001591c", + "mean": -0.0039451029151678085, + "std": 4.680815696716309, + "rms": 4.680817127227783, + "max_abs": 1152.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1ae52457f98e1e73ecc059cfcc13ae23f5af17711d76c56cbac00717c2f6dc59", + "mean": -0.0027930783107876778, + "std": 0.17838869988918304, + "rms": 0.17841055989265442, + "max_abs": 5.46875 + }, + "full_input": { + "shape": [ + 191, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ed717aaf26d2c77c09cb0fea003549b9e6e8ef2a4d0241e45f10b0f5201f6ba0", + "mean": -0.003867080435156822, + "std": 4.879557132720947, + "rms": 4.87955904006958, + "max_abs": 1152.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f7b238d9a3aba75e723df7adc499bb963248bdb2f0d7727734df22bf0a4647cb", + "mean": -0.0028293670620769262, + "std": 0.17860080301761627, + "rms": 0.17862321436405182, + "max_abs": 5.375 + }, + "full_input": { + "shape": [ + 207, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6137ce39a8e477fd67e79df19b3dd716295ac26023c502385370ccb99e4eab98", + "mean": -0.003901085117831826, + "std": 4.680798053741455, + "rms": 4.68079948425293, + "max_abs": 1152.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9985509514808655, + "min_cosine_similarity": 0.9832475185394287, + "mean_relative_l2": 0.046847712248563766, + "max_abs_delta": 0.21875 + }, + "system_bos": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9971469044685364, + "min_cosine_similarity": 0.9736438393592834, + "mean_relative_l2": 0.06750045716762543, + "max_abs_delta": 0.25 + }, + "system_x": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9961726069450378, + "min_cosine_similarity": 0.9682910442352295, + "mean_relative_l2": 0.07667293399572372, + "max_abs_delta": 0.34375 + }, + "system_period": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9960929155349731, + "min_cosine_similarity": 0.9636954665184021, + "mean_relative_l2": 0.07743115723133087, + "max_abs_delta": 0.40625 + }, + "bos_at_s0": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9941724538803101, + "min_cosine_similarity": 0.8733357191085815, + "mean_relative_l2": 0.0983896404504776, + "max_abs_delta": 0.53125 + }, + "bos_at_s1": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9925186634063721, + "min_cosine_similarity": 0.8720151782035828, + "mean_relative_l2": 0.11170345544815063, + "max_abs_delta": 0.625 + }, + "x_at_s0": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9931871294975281, + "min_cosine_similarity": 0.8373217582702637, + "mean_relative_l2": 0.10212962329387665, + "max_abs_delta": 0.68359375 + }, + "x_at_s1": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9906358122825623, + "min_cosine_similarity": 0.8210610747337341, + "mean_relative_l2": 0.12048918008804321, + "max_abs_delta": 0.7099609375 + }, + "period_at_s0": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.993065595626831, + "min_cosine_similarity": 0.8282961249351501, + "mean_relative_l2": 0.10275830328464508, + "max_abs_delta": 0.6826171875 + }, + "period_at_s1": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9903365969657898, + "min_cosine_similarity": 0.8095430135726929, + "mean_relative_l2": 0.12217184901237488, + "max_abs_delta": 0.755859375 + } + } + }, + "layer_05": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bfd6f0f0e29e0f49e3667533cdd32320694695c9d3c253ece731fdfeb2bef3c3", + "mean": -0.003506262553855777, + "std": 0.20907603204250336, + "rms": 0.20910543203353882, + "max_abs": 6.375 + }, + "full_input": { + "shape": [ + 191, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "452d4a8141d0dac7ba0b487b7f2995a55b766163b2bffa350c02db67957ed934", + "mean": -0.010595892556011677, + "std": 5.6093339920043945, + "rms": 5.609343528747559, + "max_abs": 1152.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a0883943eb3daa96a033a3b4798c6f06dfd5c4af85dbbbab6a5683aa27eac013", + "mean": -0.00353788654319942, + "std": 0.20925267040729523, + "rms": 0.20928257703781128, + "max_abs": 6.40625 + }, + "full_input": { + "shape": [ + 207, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6a2b3791f1a6e79454a3846d990efb0636b8048d74eda6a2344c95d144b5cf05", + "mean": -0.010917780920863152, + "std": 5.549511432647705, + "rms": 5.549522399902344, + "max_abs": 1152.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "91242e847577fc7d50426a483b04e0d3f42c90d99f9930638cefea35c1d283ea", + "mean": -0.0036110433284193277, + "std": 0.21161174774169922, + "rms": 0.2116425484418869, + "max_abs": 6.4375 + }, + "full_input": { + "shape": [ + 191, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "abdd2fc0c2ecc27835c1d361cab48604e729d511953b99bc2a96157b9fc07867", + "mean": -0.004826842341572046, + "std": 4.965778350830078, + "rms": 4.965780735015869, + "max_abs": 1152.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3571ba1f232d978d452efb2fd257a3821820d0e57f549dc0da53f319ed90706a", + "mean": -0.003648169804364443, + "std": 0.21148987114429474, + "rms": 0.21152134239673615, + "max_abs": 6.4375 + }, + "full_input": { + "shape": [ + 207, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b685414d02e6d42a22a1a2fe3037b05b75a5411fc7fada14e4bb375cd45fc292", + "mean": -0.004710496868938208, + "std": 4.762945175170898, + "rms": 4.7629475593566895, + "max_abs": 1152.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f4a159bbbf8a427d3de8bacd93860b4f814c645cbe918749a2bff297dae5614c", + "mean": -0.0036412847694009542, + "std": 0.2102997601032257, + "rms": 0.2103312909603119, + "max_abs": 6.5 + }, + "full_input": { + "shape": [ + 191, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "920462cfdbef171f56091fba8fcb850266bbcf716502af95aeb378333c4cf13a", + "mean": -0.004818806424736977, + "std": 4.965713024139404, + "rms": 4.965714931488037, + "max_abs": 1152.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "db7488177957ec3fdc60395470b1678f29e31c83a5e4c38f2bbcc3abde134a9b", + "mean": -0.003743247827515006, + "std": 0.20984552800655365, + "rms": 0.20987890660762787, + "max_abs": 6.46875 + }, + "full_input": { + "shape": [ + 207, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "68be6f7b72cacb60b5e0e6f7eb93bcab927d5e94afc7689f97bfe3a0603fbe70", + "mean": -0.004765022546052933, + "std": 4.7628679275512695, + "rms": 4.762870788574219, + "max_abs": 1152.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2e2ca558aff55388c89de11aa84cf34d63115901b984465b3d64445c480b17b8", + "mean": -0.0035949244629591703, + "std": 0.21007762849330902, + "rms": 0.21010838449001312, + "max_abs": 6.46875 + }, + "full_input": { + "shape": [ + 191, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e712f07dcf8b85e312917b38da9e4a5f607bdbebf1100d52ac4edefb64f53e37", + "mean": -0.004782580770552158, + "std": 4.965692520141602, + "rms": 4.965694904327393, + "max_abs": 1152.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ec0a46ab83fa38334986a4fd8db6e6342c0d3d333052017ddc66b5fb57317e49", + "mean": -0.0037266332656145096, + "std": 0.20971214771270752, + "rms": 0.20974525809288025, + "max_abs": 6.4375 + }, + "full_input": { + "shape": [ + 207, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "32eea7a5aeabd221684266c29275c7674b70b0423a3f489d5c1116f2cac9715f", + "mean": -0.004762393422424793, + "std": 4.762853622436523, + "rms": 4.7628560066223145, + "max_abs": 1152.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9981797933578491, + "min_cosine_similarity": 0.97452712059021, + "mean_relative_l2": 0.052421167492866516, + "max_abs_delta": 0.21875 + }, + "system_bos": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9965628385543823, + "min_cosine_similarity": 0.9674021005630493, + "mean_relative_l2": 0.07464031875133514, + "max_abs_delta": 0.3125 + }, + "system_x": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9949698448181152, + "min_cosine_similarity": 0.9521560668945312, + "mean_relative_l2": 0.08806294947862625, + "max_abs_delta": 0.40625 + }, + "system_period": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9947538375854492, + "min_cosine_similarity": 0.9505116939544678, + "mean_relative_l2": 0.08987873792648315, + "max_abs_delta": 0.34375 + }, + "bos_at_s0": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9935011267662048, + "min_cosine_similarity": 0.8443320393562317, + "mean_relative_l2": 0.10286872088909149, + "max_abs_delta": 0.61083984375 + }, + "bos_at_s1": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9917768239974976, + "min_cosine_similarity": 0.838960587978363, + "mean_relative_l2": 0.11612328886985779, + "max_abs_delta": 0.67626953125 + }, + "x_at_s0": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9923231601715088, + "min_cosine_similarity": 0.7923447489738464, + "mean_relative_l2": 0.10649363696575165, + "max_abs_delta": 0.80859375 + }, + "x_at_s1": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9892793297767639, + "min_cosine_similarity": 0.7783047556877136, + "mean_relative_l2": 0.12820501625537872, + "max_abs_delta": 0.865234375 + }, + "period_at_s0": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9921883940696716, + "min_cosine_similarity": 0.7896591424942017, + "mean_relative_l2": 0.10726294666528702, + "max_abs_delta": 0.791015625 + }, + "period_at_s1": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9888807535171509, + "min_cosine_similarity": 0.7625468969345093, + "mean_relative_l2": 0.13004295527935028, + "max_abs_delta": 0.95703125 + } + } + }, + "layer_06": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8ed9dde4bb32027632ff4c361254cb6db47e998069ea47a1e267d6fc8cc1d6f5", + "mean": -0.005593635141849518, + "std": 0.24556101858615875, + "rms": 0.24562472105026245, + "max_abs": 8.1875 + }, + "full_input": { + "shape": [ + 191, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9cce7fec5a1706d45fe13916ec9d1a1280900222e61b38839c0ee9da9fd9d52b", + "mean": -0.012764197774231434, + "std": 5.7124104499816895, + "rms": 5.712424278259277, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "346079f52b15cd82d350e383e4405d3d7bcb002bb459086e7d4076fe32bcdc82", + "mean": -0.005672016646713018, + "std": 0.24546276032924652, + "rms": 0.24552826583385468, + "max_abs": 8.1875 + }, + "full_input": { + "shape": [ + 207, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2001d5b5e27dac3940bc603f902ea5053753c79dfbc34fd7defe6f1b1b25d175", + "mean": -0.013048265129327774, + "std": 5.650933742523193, + "rms": 5.650948524475098, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "55fa126748656f106966149e418a78dcfcfbe803cff2d6488726a561f6c66218", + "mean": -0.00546441413462162, + "std": 0.24765606224536896, + "rms": 0.24771632254123688, + "max_abs": 8.25 + }, + "full_input": { + "shape": [ + 191, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "31b40d7baab6d85eac822b5c68f6fd5d840005ac520a0b8683aa317091cbea3c", + "mean": -0.006637600250542164, + "std": 5.046529769897461, + "rms": 5.046534061431885, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "09151d266386d0e4e9da0233b3982c01718091a648efbe6ac49bd730866972c3", + "mean": -0.005581356585025787, + "std": 0.24810805916786194, + "rms": 0.24817080795764923, + "max_abs": 8.375 + }, + "full_input": { + "shape": [ + 207, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "77cc5a50778f0f9b6914e54d4b9d38b8dd6d7b7a0e016f0ab0ecc0ed09aed4a5", + "mean": -0.006522485055029392, + "std": 4.84063196182251, + "rms": 4.840636253356934, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2b98d09f15fc39be2e23f371c9fc41799e815119c1155b5bb225838f7ef4459c", + "mean": -0.005501848179847002, + "std": 0.2471541464328766, + "rms": 0.2472153753042221, + "max_abs": 8.375 + }, + "full_input": { + "shape": [ + 191, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7102131814fad998d17e0c9e2a56a4330afe679a4f584913c4b07efa9ef4601a", + "mean": -0.006600831635296345, + "std": 5.04649019241333, + "rms": 5.046494007110596, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3dfb26f8e0c445cf2c4b34b859dfc905bcd475875505a8f8e5125caaa61e214c", + "mean": -0.005569749511778355, + "std": 0.2465217262506485, + "rms": 0.24658463895320892, + "max_abs": 8.3125 + }, + "full_input": { + "shape": [ + 207, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "956ad5cbdcc8c0af5727766b4f3b1131b4c3164f7b6bf77e224dac4e3c462832", + "mean": -0.006448098924010992, + "std": 4.840543270111084, + "rms": 4.840547561645508, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "382d0baccab7239f7b18f2cace3627d83af0b5e51a334427fcb3c946d6d6f597", + "mean": -0.0054960730485618114, + "std": 0.2468155324459076, + "rms": 0.24687670171260834, + "max_abs": 8.3125 + }, + "full_input": { + "shape": [ + 191, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "679a0964661c5baaff067d0e74dd325550f512fd759807d3ee77a55658187c37", + "mean": -0.006585695315152407, + "std": 5.046468734741211, + "rms": 5.046472549438477, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9ef95fc6fe9f1c5feea0e76cedb529a29a83e811ecae50df1145fbeccd1e8a5b", + "mean": -0.005612503737211227, + "std": 0.24637505412101746, + "rms": 0.24643899500370026, + "max_abs": 8.3125 + }, + "full_input": { + "shape": [ + 207, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "dad581a9e38318c8d3f7565bf2b39ca01257152942f681b5495936d4f5fbfb67", + "mean": -0.006488170474767685, + "std": 4.840531349182129, + "rms": 4.840536117553711, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9981734752655029, + "min_cosine_similarity": 0.9706003069877625, + "mean_relative_l2": 0.05200707167387009, + "max_abs_delta": 0.46875 + }, + "system_bos": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9965282678604126, + "min_cosine_similarity": 0.9572898149490356, + "mean_relative_l2": 0.07407692819833755, + "max_abs_delta": 0.3125 + }, + "system_x": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9946539998054504, + "min_cosine_similarity": 0.9408526420593262, + "mean_relative_l2": 0.08971500396728516, + "max_abs_delta": 0.625 + }, + "system_period": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9942802786827087, + "min_cosine_similarity": 0.9290980100631714, + "mean_relative_l2": 0.09236984699964523, + "max_abs_delta": 0.5625 + }, + "bos_at_s0": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9941561818122864, + "min_cosine_similarity": 0.8491359353065491, + "mean_relative_l2": 0.09520626068115234, + "max_abs_delta": 0.6953125 + }, + "bos_at_s1": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9925882816314697, + "min_cosine_similarity": 0.8455129861831665, + "mean_relative_l2": 0.10833963006734848, + "max_abs_delta": 0.6025390625 + }, + "x_at_s0": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.992796003818512, + "min_cosine_similarity": 0.7898464202880859, + "mean_relative_l2": 0.10064712166786194, + "max_abs_delta": 1.0302734375 + }, + "x_at_s1": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9895767569541931, + "min_cosine_similarity": 0.7639490962028503, + "mean_relative_l2": 0.1236603856086731, + "max_abs_delta": 1.2041015625 + }, + "period_at_s0": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9925867915153503, + "min_cosine_similarity": 0.7840647101402283, + "mean_relative_l2": 0.1019667536020279, + "max_abs_delta": 1.07421875 + }, + "period_at_s1": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9888760447502136, + "min_cosine_similarity": 0.7470107674598694, + "mean_relative_l2": 0.1274181455373764, + "max_abs_delta": 1.271484375 + } + } + }, + "layer_07": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2ada0fb5646c03a6805ac4c3adb0c1561fbb0d854962b5c657c0f540b38515e3", + "mean": -0.005161989014595747, + "std": 0.26040637493133545, + "rms": 0.26045751571655273, + "max_abs": 7.75 + }, + "full_input": { + "shape": [ + 191, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1b3e44db8ef791f38b1e9cbc459aaae811df8c7c30f2d3c1494f44bbd217bf84", + "mean": -0.012353803031146526, + "std": 5.729115962982178, + "rms": 5.729129314422607, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0cfd0a1b398e45399b91d8c9acb78dce23f4bf111bf62066049ab8f8d5bd192c", + "mean": -0.005253104493021965, + "std": 0.260448157787323, + "rms": 0.2605011463165283, + "max_abs": 7.8125 + }, + "full_input": { + "shape": [ + 207, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d6e8b19b067660bf11ab921dd9c0801d8e1094892900be4054d056957a3bfa64", + "mean": -0.012951977550983429, + "std": 5.668078422546387, + "rms": 5.668093681335449, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e399913f391617abbbcdbd21162b75ccbf6866f45acd7b33bce4ae44f13df889", + "mean": -0.005046426318585873, + "std": 0.2619800567626953, + "rms": 0.26202866435050964, + "max_abs": 7.6875 + }, + "full_input": { + "shape": [ + 191, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "14222eb3936d5a5b0835083a4ed3033e65287be24030c0cd471955cda021b348", + "mean": -0.006225903052836657, + "std": 5.056278705596924, + "rms": 5.0562825202941895, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fc4dddfef6f6d99c40cafbb6ce955b8732368d2167a2cd0edcffa992de545fd7", + "mean": -0.005150330252945423, + "std": 0.26265332102775574, + "rms": 0.2627038061618805, + "max_abs": 7.71875 + }, + "full_input": { + "shape": [ + 207, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fa37b4dcffa652e1c04d1b197e4cd32268b2ecd36cb7055518ed251c106d0cf3", + "mean": -0.0064003667794167995, + "std": 4.850093841552734, + "rms": 4.850098609924316, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "07a3acca3997d73ffa4a49d03ed15459d2c5cfc53f35ff538da94f6cfac3ea24", + "mean": -0.005059277638792992, + "std": 0.2615344822406769, + "rms": 0.2615833878517151, + "max_abs": 7.75 + }, + "full_input": { + "shape": [ + 191, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6f23eb1e9945bfc83a8ee4a2bdb7c954d690f7b797ef802aab1cab2176f56786", + "mean": -0.006252818275243044, + "std": 5.056230068206787, + "rms": 5.056233882904053, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8c81f616b12158d401a1a2f70be2e42f70e6df22e6708a0e2731f04f80122ecc", + "mean": -0.005165069829672575, + "std": 0.26148173213005066, + "rms": 0.2615327537059784, + "max_abs": 7.78125 + }, + "full_input": { + "shape": [ + 207, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7f1e5266346ba565e9f019d38d312cbf75eaff4a9a30ad7e527e50119cd86c32", + "mean": -0.006413641851395369, + "std": 4.850013256072998, + "rms": 4.85001802444458, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "017efe901737b2906f95a4b8abf0537b5454c444a2b96289053a8db43347a9e4", + "mean": -0.0050469813868403435, + "std": 0.26111581921577454, + "rms": 0.2611646056175232, + "max_abs": 7.6875 + }, + "full_input": { + "shape": [ + 191, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6c14dce2ce08697e8a43ee3693f90d6ee5b39ceaf41893a3c0a0d39012baac67", + "mean": -0.006174279842525721, + "std": 5.056211948394775, + "rms": 5.056215763092041, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f6f4b5aca44ca2be2afd78380a30f43dfb3185743ba31027198fedaa3a372d79", + "mean": -0.005191117525100708, + "std": 0.2614455819129944, + "rms": 0.2614971101284027, + "max_abs": 7.78125 + }, + "full_input": { + "shape": [ + 207, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "dd7c32413db2585005bca33fc00eaf4f8c30e424872eedb5aaedd4dcad7a4796", + "mean": -0.006398020777851343, + "std": 4.850012302398682, + "rms": 4.8500165939331055, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9977064728736877, + "min_cosine_similarity": 0.960174560546875, + "mean_relative_l2": 0.05818668752908707, + "max_abs_delta": 0.359375 + }, + "system_bos": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9962272047996521, + "min_cosine_similarity": 0.9464178085327148, + "mean_relative_l2": 0.07728465646505356, + "max_abs_delta": 0.515625 + }, + "system_x": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9937715530395508, + "min_cosine_similarity": 0.920746922492981, + "mean_relative_l2": 0.0973040834069252, + "max_abs_delta": 0.71875 + }, + "system_period": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9935815930366516, + "min_cosine_similarity": 0.9131268262863159, + "mean_relative_l2": 0.0979401096701622, + "max_abs_delta": 0.59375 + }, + "bos_at_s0": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9938495755195618, + "min_cosine_similarity": 0.8546761274337769, + "mean_relative_l2": 0.09745004028081894, + "max_abs_delta": 0.71875 + }, + "bos_at_s1": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9920201897621155, + "min_cosine_similarity": 0.8511776328086853, + "mean_relative_l2": 0.11287792772054672, + "max_abs_delta": 0.6953125 + }, + "x_at_s0": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9921615123748779, + "min_cosine_similarity": 0.7982734441757202, + "mean_relative_l2": 0.10520364344120026, + "max_abs_delta": 1.1875 + }, + "x_at_s1": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9886712431907654, + "min_cosine_similarity": 0.7595561146736145, + "mean_relative_l2": 0.13118334114551544, + "max_abs_delta": 1.384765625 + }, + "period_at_s0": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9919341802597046, + "min_cosine_similarity": 0.784881055355072, + "mean_relative_l2": 0.10641469061374664, + "max_abs_delta": 1.21875 + }, + "period_at_s1": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9878770112991333, + "min_cosine_similarity": 0.7449827194213867, + "mean_relative_l2": 0.13483186066150665, + "max_abs_delta": 1.369140625 + } + } + }, + "layer_08": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "532b0aed9b42729ef3edacbf801ab0b97dd7bf218975916e1574dd22d91afd72", + "mean": -0.0062038954347372055, + "std": 0.2958637475967407, + "rms": 0.2959287762641907, + "max_abs": 8.125 + }, + "full_input": { + "shape": [ + 191, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a7056d0bef448708caed71d92298eb529ec1272d80981b19a6fd09028b853c3b", + "mean": -0.013336356729269028, + "std": 5.749619007110596, + "rms": 5.749634265899658, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3f0ab3393ced2e612fbb9ec7646c7cde927064472064929a079baa82c560e347", + "mean": -0.0062567065469920635, + "std": 0.2957320213317871, + "rms": 0.2957982122898102, + "max_abs": 8.125 + }, + "full_input": { + "shape": [ + 207, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "80e16e3e7c8312e49593956851947e5f368ea7f9a42e245c42b79d4aba05edd6", + "mean": -0.013701798394322395, + "std": 5.688668251037598, + "rms": 5.688684463500977, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "df4a8175c3a13f9ba068248dd9a75c43d1bfd674046db97ef513c31dbd33198d", + "mean": -0.006241678260266781, + "std": 0.29777148365974426, + "rms": 0.29783686995506287, + "max_abs": 8.1875 + }, + "full_input": { + "shape": [ + 191, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "86077d6a5bb01b45616c01eef6925c58a4c988dd99de3b73125930208772ad26", + "mean": -0.0073868934996426105, + "std": 5.068424224853516, + "rms": 5.068429470062256, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fdba6839fe5554b6596cd5ea03e2afc7f7831858c930767ed5b7ac96af347716", + "mean": -0.006332085933536291, + "std": 0.29852402210235596, + "rms": 0.29859116673469543, + "max_abs": 8.3125 + }, + "full_input": { + "shape": [ + 207, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "33274545115f903247e3186b634d8d27af9c8daba11d63203cb3c01ac426bb88", + "mean": -0.00734904408454895, + "std": 4.86182975769043, + "rms": 4.86183500289917, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "522659eaf2e3ecee87fc4e347c74bc5668d24a2bbcd4395899ad283d7ca17e9e", + "mean": -0.006254269275814295, + "std": 0.2975432872772217, + "rms": 0.29760900139808655, + "max_abs": 8.3125 + }, + "full_input": { + "shape": [ + 191, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ae181076d9573b4c95efe438a2c77c0cc5509f8d76b5953b05930491a7cd587e", + "mean": -0.007407026831060648, + "std": 5.068395614624023, + "rms": 5.068400859832764, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4845fc2f73930f5979d99d0a2965ccf87e1a101e65501e313c4290c1b218a473", + "mean": -0.006106362212449312, + "std": 0.2970554232597351, + "rms": 0.2971181869506836, + "max_abs": 8.25 + }, + "full_input": { + "shape": [ + 207, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4f0b726ffa66fa58f61ad317224a9c582c38a30a4bdf890bb765c63efe4d62f4", + "mean": -0.0071375127881765366, + "std": 4.86173677444458, + "rms": 4.86174201965332, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c9952bf3a47600cefcbb314b7d71c920fb5a9ac42b33e8d4f4c37f09f76820c1", + "mean": -0.006254781968891621, + "std": 0.2974010109901428, + "rms": 0.29746678471565247, + "max_abs": 8.25 + }, + "full_input": { + "shape": [ + 191, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f3e55c4b5a93770db89e086759af148fcb77acffe8e9942e7b7b29d2a8b8ded0", + "mean": -0.007402107585221529, + "std": 5.068391799926758, + "rms": 5.068397045135498, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5aea9ea5ff96dd75d0e4a218e0ce8050b0087606118f41a4cc45ed5b13004302", + "mean": -0.006085834000259638, + "std": 0.29728934168815613, + "rms": 0.2973516285419464, + "max_abs": 8.25 + }, + "full_input": { + "shape": [ + 207, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f7a49c78369cdb5b59d053360da2fcd554735afe249c06d6efeb3061e3cfb6e3", + "mean": -0.007100832182914019, + "std": 4.861744403839111, + "rms": 4.861749172210693, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9970306158065796, + "min_cosine_similarity": 0.9575564861297607, + "mean_relative_l2": 0.06672509014606476, + "max_abs_delta": 0.609375 + }, + "system_bos": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9957705736160278, + "min_cosine_similarity": 0.9485523700714111, + "mean_relative_l2": 0.08282803744077682, + "max_abs_delta": 0.46875 + }, + "system_x": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.992495596408844, + "min_cosine_similarity": 0.9044903516769409, + "mean_relative_l2": 0.10639868676662445, + "max_abs_delta": 0.890625 + }, + "system_period": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9926803708076477, + "min_cosine_similarity": 0.913588285446167, + "mean_relative_l2": 0.10504493117332458, + "max_abs_delta": 0.84375 + }, + "bos_at_s0": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.993259847164154, + "min_cosine_similarity": 0.8219609260559082, + "mean_relative_l2": 0.1014699786901474, + "max_abs_delta": 0.875 + }, + "bos_at_s1": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9915058016777039, + "min_cosine_similarity": 0.8315977454185486, + "mean_relative_l2": 0.11649644374847412, + "max_abs_delta": 0.9375 + }, + "x_at_s0": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9914718270301819, + "min_cosine_similarity": 0.7682008743286133, + "mean_relative_l2": 0.10991045087575912, + "max_abs_delta": 1.328125 + }, + "x_at_s1": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9874916672706604, + "min_cosine_similarity": 0.7060887813568115, + "mean_relative_l2": 0.1371793895959854, + "max_abs_delta": 1.44921875 + }, + "period_at_s0": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9912391304969788, + "min_cosine_similarity": 0.7537052631378174, + "mean_relative_l2": 0.11134392023086548, + "max_abs_delta": 1.375 + }, + "period_at_s1": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9869036674499512, + "min_cosine_similarity": 0.7180443406105042, + "mean_relative_l2": 0.14130324125289917, + "max_abs_delta": 1.3125 + } + } + }, + "layer_09": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "657a9f965d3c8f6e72dc760a53351db2c7b11c6298955982022cf2cca8c1658c", + "mean": -0.009363594464957714, + "std": 0.3463321030139923, + "rms": 0.34645867347717285, + "max_abs": 11.4375 + }, + "full_input": { + "shape": [ + 191, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "24703edc01230b517aee5fb4089f74e431aea4d8a96b61920ff4376ed7fa626a", + "mean": -0.01595168374478817, + "std": 5.752752304077148, + "rms": 5.752774238586426, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5512dedf6fca6d55077fee88969f59f56c1f0e64971e940907ad07651c7a992e", + "mean": -0.009361060336232185, + "std": 0.3451164960861206, + "rms": 0.3452434539794922, + "max_abs": 11.625 + }, + "full_input": { + "shape": [ + 207, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ccb6b26815bc163dd634f742760ba9791d2d4c1c8a6907603ff7a096048d3ec6", + "mean": -0.016390912234783173, + "std": 5.691684246063232, + "rms": 5.691707611083984, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d1f0a13354f7c4b34a07cef6b2bc98b22d1146a3c34af1d1baafda35e8592b76", + "mean": -0.009369864128530025, + "std": 0.3472791910171509, + "rms": 0.3474055826663971, + "max_abs": 11.1875 + }, + "full_input": { + "shape": [ + 191, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5728c6929c9f412937eccfdd4257d4584b89aeea32f7914ad40781128c40d195", + "mean": -0.010040746070444584, + "std": 5.071861743927002, + "rms": 5.071871280670166, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "72ae34d5b435d52a1c160de41055a21990e670e92cf7e797d5f08b52dfd1588a", + "mean": -0.009405757300555706, + "std": 0.3482777178287506, + "rms": 0.3484047055244446, + "max_abs": 11.5 + }, + "full_input": { + "shape": [ + 207, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c05f7565b0dc0498cc3db2099e49563aa9899486462d86bb8a6d4a77b1bc35b5", + "mean": -0.010095863603055477, + "std": 4.865372657775879, + "rms": 4.865382194519043, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "56ddc3b88a5a4d5d3f3910a05d34ba59110c202fcf3b1ee1376b15f4f41d869e", + "mean": -0.00932804960757494, + "std": 0.3462958037853241, + "rms": 0.34642142057418823, + "max_abs": 11.125 + }, + "full_input": { + "shape": [ + 191, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "36b94aa0140afb0972f88fd1bea0c443dd5ada10ce4636c540a2eb80be5bbeca", + "mean": -0.009993942454457283, + "std": 5.071787357330322, + "rms": 5.0717973709106445, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bc08b4564c50bc4d481d2b927f1ca0e72fc6610b8ffa346a95c3e242c21f50c5", + "mean": -0.009055648930370808, + "std": 0.3431451916694641, + "rms": 0.3432646691799164, + "max_abs": 11.125 + }, + "full_input": { + "shape": [ + 207, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e8aea486ae3908a06b8678f39133fb9fcea9862fa4f9b84c3635e2a8e162f05d", + "mean": -0.009796401485800743, + "std": 4.865047454833984, + "rms": 4.86505651473999, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "023ce9baee58cfe7d74002749217795406a4d6c7cbe6a521d55a82aa67588425", + "mean": -0.009342057630419731, + "std": 0.3460477888584137, + "rms": 0.34617385268211365, + "max_abs": 11.125 + }, + "full_input": { + "shape": [ + 191, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "695b20ed45be0aaf699904f481455e9e586ce2fd66d380610265b9887ac4af93", + "mean": -0.009959002025425434, + "std": 5.07175874710083, + "rms": 5.0717692375183105, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d3d8fce89e7076636bc77733e0a17626d74adce5214a405f13f7df55aea12ec8", + "mean": -0.009156424552202225, + "std": 0.34383144974708557, + "rms": 0.34395334124565125, + "max_abs": 11.1875 + }, + "full_input": { + "shape": [ + 207, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "89cb83fdbf00132afd95f14a65a6a6a0dc86dd016dc2791461545fbfd503401d", + "mean": -0.009812369011342525, + "std": 4.8650641441345215, + "rms": 4.865074157714844, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9970207810401917, + "min_cosine_similarity": 0.9541566371917725, + "mean_relative_l2": 0.06725779920816422, + "max_abs_delta": 1.0625 + }, + "system_bos": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9960069060325623, + "min_cosine_similarity": 0.9522345066070557, + "mean_relative_l2": 0.0803036317229271, + "max_abs_delta": 0.53125 + }, + "system_x": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9919301271438599, + "min_cosine_similarity": 0.8809446096420288, + "mean_relative_l2": 0.10799243301153183, + "max_abs_delta": 1.875 + }, + "system_period": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9925642013549805, + "min_cosine_similarity": 0.9041125178337097, + "mean_relative_l2": 0.10519018769264221, + "max_abs_delta": 1.8125 + }, + "bos_at_s0": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9934408068656921, + "min_cosine_similarity": 0.8228926062583923, + "mean_relative_l2": 0.0988519936800003, + "max_abs_delta": 1.15625 + }, + "bos_at_s1": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9918604493141174, + "min_cosine_similarity": 0.838053286075592, + "mean_relative_l2": 0.11282562464475632, + "max_abs_delta": 1.25 + }, + "x_at_s0": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9917203783988953, + "min_cosine_similarity": 0.776892900466919, + "mean_relative_l2": 0.10795296728610992, + "max_abs_delta": 1.625 + }, + "x_at_s1": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.987281322479248, + "min_cosine_similarity": 0.7059687376022339, + "mean_relative_l2": 0.13625271618366241, + "max_abs_delta": 2.0625 + }, + "period_at_s0": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.991576611995697, + "min_cosine_similarity": 0.7683274149894714, + "mean_relative_l2": 0.10914450883865356, + "max_abs_delta": 1.5625 + }, + "period_at_s1": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9873712658882141, + "min_cosine_similarity": 0.737822949886322, + "mean_relative_l2": 0.13762016594409943, + "max_abs_delta": 1.96875 + } + } + }, + "layer_10": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b1d575a3ae4b5a028c1772b08423b288d8155edf01f826b68ce00c3cdb980274", + "mean": -0.00903304759413004, + "std": 0.39512842893600464, + "rms": 0.3952316641807556, + "max_abs": 12.25 + }, + "full_input": { + "shape": [ + 191, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0aa9ac7b9315d16eff0e20e24b13a6bac5c5c6b47c4ec0cc9b12e52175d22368", + "mean": -0.01589435525238514, + "std": 5.760497093200684, + "rms": 5.760518550872803, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1546654a43498d0f53dcadfd7e9198abb98d9df628ebe1d134576d25ac2740c4", + "mean": -0.009040109813213348, + "std": 0.3941366970539093, + "rms": 0.3942403495311737, + "max_abs": 12.25 + }, + "full_input": { + "shape": [ + 207, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2ded3fb1e47b2b07dc6f4e92826e8fe0ad6fcea20b4814c61cae39794ebea291", + "mean": -0.01642380841076374, + "std": 5.699240684509277, + "rms": 5.699265003204346, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "137c663f8e95edc88e4ebc11bacf356747a05a4cfdc1d6541aa63c4a6076063e", + "mean": -0.00893322378396988, + "std": 0.3964788019657135, + "rms": 0.39657944440841675, + "max_abs": 12.375 + }, + "full_input": { + "shape": [ + 191, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8e03970a744fa6b89137e74f2d59b632276af6e21183972c909a0705d21084a0", + "mean": -0.00991373136639595, + "std": 5.08038854598999, + "rms": 5.080398082733154, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "17a6e11010e5692a21263c97266ed673a91838a10203c508ffe6b6b083ec7b3c", + "mean": -0.008976205252110958, + "std": 0.3969503343105316, + "rms": 0.39705178141593933, + "max_abs": 12.5 + }, + "full_input": { + "shape": [ + 207, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f5b924bdc52d2225f863b65ac25a0563bf099d9a1a502f3f34490d2e3ddd272a", + "mean": -0.010042696259915829, + "std": 4.8738112449646, + "rms": 4.873822212219238, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e1f43e92f1a493a92a3d7564c60c0556064652c02af060799bc17beb50cc723d", + "mean": -0.008845387026667595, + "std": 0.3968437612056732, + "rms": 0.3969423472881317, + "max_abs": 12.5 + }, + "full_input": { + "shape": [ + 191, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e78baf7e347f8185aa82e960f53b6063b93bc3e18003e4d18e94bbb2d44520ab", + "mean": -0.009827589616179466, + "std": 5.080386638641357, + "rms": 5.0803961753845215, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e453c13812c354ed375e2590c8352da9eb788d2e37fc1426af33a58dcbdd5080", + "mean": -0.008763674646615982, + "std": 0.39519020915031433, + "rms": 0.3952873945236206, + "max_abs": 12.375 + }, + "full_input": { + "shape": [ + 207, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "38ac1d133c77783b8bdb026d68857b8e2c7baf8e27db17df657c986f5eadfe0f", + "mean": -0.009907412342727184, + "std": 4.873646259307861, + "rms": 4.873656272888184, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bc3882eee916cb6cee6ef4b64d3caa617f5e726b82e8544586a397050aeee90f", + "mean": -0.008906577713787556, + "std": 0.3964870572090149, + "rms": 0.396587073802948, + "max_abs": 12.375 + }, + "full_input": { + "shape": [ + 191, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0368049adae06c4c2a382d88c0cbce3c1bf406d80b7124e96c0781b578ed8590", + "mean": -0.009781887754797935, + "std": 5.080350875854492, + "rms": 5.0803608894348145, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ab4a0b7bad6dfd97e8fc39c46fc5e714f788f60d6a1eaa62b9ddb43df6d98027", + "mean": -0.008871927857398987, + "std": 0.3953557014465332, + "rms": 0.3954552412033081, + "max_abs": 12.5 + }, + "full_input": { + "shape": [ + 207, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e5f2bb9650e540b8f71660800074a385abf4c5afff8c68579c125bcd954a1fbb", + "mean": -0.009919472970068455, + "std": 4.873638153076172, + "rms": 4.873648643493652, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9967415928840637, + "min_cosine_similarity": 0.9501529932022095, + "mean_relative_l2": 0.07133723795413971, + "max_abs_delta": 1.5 + }, + "system_bos": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9956765174865723, + "min_cosine_similarity": 0.9488137364387512, + "mean_relative_l2": 0.08452122658491135, + "max_abs_delta": 0.84375 + }, + "system_x": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9912184476852417, + "min_cosine_similarity": 0.8556828498840332, + "mean_relative_l2": 0.11422894150018692, + "max_abs_delta": 1.53125 + }, + "system_period": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.992110550403595, + "min_cosine_similarity": 0.8979881405830383, + "mean_relative_l2": 0.10954423993825912, + "max_abs_delta": 1.28125 + }, + "bos_at_s0": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.993029773235321, + "min_cosine_similarity": 0.8193748593330383, + "mean_relative_l2": 0.10277349501848221, + "max_abs_delta": 1.4375 + }, + "bos_at_s1": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.991146981716156, + "min_cosine_similarity": 0.8243003487586975, + "mean_relative_l2": 0.11823388934135437, + "max_abs_delta": 1.21875 + }, + "x_at_s0": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9912117719650269, + "min_cosine_similarity": 0.7543936967849731, + "mean_relative_l2": 0.112564317882061, + "max_abs_delta": 1.875 + }, + "x_at_s1": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9862368702888489, + "min_cosine_similarity": 0.6635634899139404, + "mean_relative_l2": 0.14348351955413818, + "max_abs_delta": 3.28125 + }, + "period_at_s0": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.991287112236023, + "min_cosine_similarity": 0.7628891468048096, + "mean_relative_l2": 0.11303482204675674, + "max_abs_delta": 2.03125 + }, + "period_at_s1": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.98667973279953, + "min_cosine_similarity": 0.7138789892196655, + "mean_relative_l2": 0.14306378364562988, + "max_abs_delta": 3.1875 + } + } + }, + "layer_11": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "48bb804bc1a2318573a463ca789038cc730d91526a5438617b738888a0d094a6", + "mean": -0.01042486447840929, + "std": 0.49617502093315125, + "rms": 0.49628451466560364, + "max_abs": 18.25 + }, + "full_input": { + "shape": [ + 191, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b8dcf29c16883421188441fd6512af35464fb5b96ce567e92953c322d9934c6a", + "mean": -0.01695867069065571, + "std": 5.797542095184326, + "rms": 5.7975664138793945, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f1aae15f11bec5250c1a9eccef8e7806831f2fdb8811c4725313ef09b58e057f", + "mean": -0.010266846977174282, + "std": 0.49445289373397827, + "rms": 0.4945594370365143, + "max_abs": 18.0 + }, + "full_input": { + "shape": [ + 207, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "28cdb7cee3e89d1a3a571c15bbe5cbe45867bfd47af751d138527ff6e7e73dbd", + "mean": -0.017260637134313583, + "std": 5.734996795654297, + "rms": 5.73502254486084, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a3f3761ff7e19e3f75152ed8f481c2172562f47d0eaa34bef22f9b3df75ae92d", + "mean": -0.010450526140630245, + "std": 0.4979805052280426, + "rms": 0.49809014797210693, + "max_abs": 18.0 + }, + "full_input": { + "shape": [ + 191, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f014e85b25b3e86eceb4559a31eeeaf4f5e17b4e6e03955d2d578c70773adf7f", + "mean": -0.011065760627388954, + "std": 5.112625598907471, + "rms": 5.112637042999268, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "97714a328ff9d59e74fc297c6cfc8c6146e3433a849e740fbae5ebaa57af7bf6", + "mean": -0.010449445806443691, + "std": 0.49888721108436584, + "rms": 0.4989966154098511, + "max_abs": 18.0 + }, + "full_input": { + "shape": [ + 207, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6f3632c3cab363ef4420a30bbc0d6c6cc3c79eeb702dcc3e6de7fad9b990d167", + "mean": -0.011061303317546844, + "std": 4.905178070068359, + "rms": 4.905190467834473, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "316697a6ec15577ce5e4364f9a8b8a2db620a18777ca1bd81f05eca2bfca24bc", + "mean": -0.010094459168612957, + "std": 0.4975905120372772, + "rms": 0.49769285321235657, + "max_abs": 18.25 + }, + "full_input": { + "shape": [ + 191, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f7707b5eb21530782e89a473f8d9d24ebdb523cdf91a140710b6e0dc5e45b7e1", + "mean": -0.010671580210328102, + "std": 5.112593173980713, + "rms": 5.112604141235352, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4e74892703f93a80c31a764a9f0da3082ff97835d9c0e1f0261c9200340c4178", + "mean": -0.009902162477374077, + "std": 0.4947696030139923, + "rms": 0.494868665933609, + "max_abs": 18.25 + }, + "full_input": { + "shape": [ + 207, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0cbb6d327c0b2b844199b4bf4301c4ae3ee829f8cb71afba6e54822fa8d58d0d", + "mean": -0.010549699887633324, + "std": 4.904763698577881, + "rms": 4.904775142669678, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "34793f055041c758069e00a8f7605f14713e4d7c03db0e7c26c96067677d1ce4", + "mean": -0.010181565769016743, + "std": 0.4971715211868286, + "rms": 0.4972757399082184, + "max_abs": 18.375 + }, + "full_input": { + "shape": [ + 191, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9e07b1f0de9dd4a3fd225768664e5174a62065455b28580b6883bf6b494c573c", + "mean": -0.01068239938467741, + "std": 5.112522602081299, + "rms": 5.1125335693359375, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "eaf7aaa76bb476c33fab3bbafc0a01251a35cecf478de16c24cd05487f0ce512", + "mean": -0.009945264086127281, + "std": 0.49504441022872925, + "rms": 0.4951442778110504, + "max_abs": 18.125 + }, + "full_input": { + "shape": [ + 207, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "611121d189c7de270b44b2d5f84b79b9a9a68f4035ffb23241a7f2df078ab8da", + "mean": -0.010540449991822243, + "std": 4.904767036437988, + "rms": 4.904778480529785, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9970334768295288, + "min_cosine_similarity": 0.9585492014884949, + "mean_relative_l2": 0.06894682347774506, + "max_abs_delta": 1.875 + }, + "system_bos": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.996263325214386, + "min_cosine_similarity": 0.9566338062286377, + "mean_relative_l2": 0.0793127790093422, + "max_abs_delta": 0.875 + }, + "system_x": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9920012950897217, + "min_cosine_similarity": 0.8435630202293396, + "mean_relative_l2": 0.10858626663684845, + "max_abs_delta": 1.75 + }, + "system_period": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9928160309791565, + "min_cosine_similarity": 0.8858695030212402, + "mean_relative_l2": 0.10461334139108658, + "max_abs_delta": 2.96875 + }, + "bos_at_s0": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9938257336616516, + "min_cosine_similarity": 0.8417024612426758, + "mean_relative_l2": 0.09604593366384506, + "max_abs_delta": 1.8125 + }, + "bos_at_s1": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9922415614128113, + "min_cosine_similarity": 0.8351023197174072, + "mean_relative_l2": 0.10971827805042267, + "max_abs_delta": 1.96875 + }, + "x_at_s0": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.992539644241333, + "min_cosine_similarity": 0.7996678352355957, + "mean_relative_l2": 0.1043940857052803, + "max_abs_delta": 2.28125 + }, + "x_at_s1": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9879987835884094, + "min_cosine_similarity": 0.7066153287887573, + "mean_relative_l2": 0.13395066559314728, + "max_abs_delta": 3.96875 + }, + "period_at_s0": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9924147129058838, + "min_cosine_similarity": 0.8026623725891113, + "mean_relative_l2": 0.10547526180744171, + "max_abs_delta": 2.40625 + }, + "period_at_s1": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9884514808654785, + "min_cosine_similarity": 0.7522157430648804, + "mean_relative_l2": 0.13296309113502502, + "max_abs_delta": 5.3125 + } + } + }, + "layer_12": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1505120a48789296d5697c93a95ca5751dd81de66a4d4d22bbc48ec18857cea3", + "mean": -0.0097705302760005, + "std": 0.5393249988555908, + "rms": 0.5394134521484375, + "max_abs": 16.25 + }, + "full_input": { + "shape": [ + 191, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "204cc97cbff912ca903c9819bbbef6cd56d14c46170be36d5c6d060997a6f760", + "mean": -0.016592886298894882, + "std": 5.840438365936279, + "rms": 5.8404622077941895, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c399f13ba1bb100d48696cd6baf20ade6d07a3902ed1eec7600845f0b59a89aa", + "mean": -0.00971551425755024, + "std": 0.5377762317657471, + "rms": 0.5378639698028564, + "max_abs": 16.25 + }, + "full_input": { + "shape": [ + 207, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d03965dd4199b3c1e0444cbae523d8db731b6c6d2e53206e0077d9b4cd7d86a6", + "mean": -0.01680615544319153, + "std": 5.779162406921387, + "rms": 5.779187202453613, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "69adf609cfa4310ecad68747600295c369657c76bae641ab51af64a5418ddd33", + "mean": -0.009786389768123627, + "std": 0.5418205857276917, + "rms": 0.5419089198112488, + "max_abs": 16.375 + }, + "full_input": { + "shape": [ + 191, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "dd2221428e01bff44ada65d1a65dc8f291a591eb473005e9d9955de0f988dd5e", + "mean": -0.010578523389995098, + "std": 5.124855995178223, + "rms": 5.1248674392700195, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cd5c230df579de13e69109078a1a3bc02d996cac1a82d2c5aafbf8b2220c44ac", + "mean": -0.009658190421760082, + "std": 0.543476939201355, + "rms": 0.5435628294944763, + "max_abs": 16.625 + }, + "full_input": { + "shape": [ + 207, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6819f6ac552af972a537fd8f1384237247982749b180eee97a85c55ad9f6a53f", + "mean": -0.010384170338511467, + "std": 4.917566776275635, + "rms": 4.917578220367432, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "425b579af49120a5b02786d0d982b093f5f2de6c45b7cbade360a80db06c9dd2", + "mean": -0.009410016238689423, + "std": 0.5410323143005371, + "rms": 0.5411141514778137, + "max_abs": 16.25 + }, + "full_input": { + "shape": [ + 191, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2cb3b02ac0cff1aa8063ba5681def5b3ae184556cce3cb98c0202136b340305d", + "mean": -0.010277078486979008, + "std": 5.124795436859131, + "rms": 5.124805927276611, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "35b8c4fbcf1e800bbf9aab7d9a792e65913267aa0b6242df2bf33d64e5ad0a70", + "mean": -0.00917776208370924, + "std": 0.540339469909668, + "rms": 0.5404173731803894, + "max_abs": 16.125 + }, + "full_input": { + "shape": [ + 207, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9b75ff7ad243189956f4c3491dac0f4e7defd50d4b56f9555ae06e3b50f57d3e", + "mean": -0.00997652392834425, + "std": 4.917145729064941, + "rms": 4.917155742645264, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b4ed0f2ed66f5e6d7e2bb4f9a487c63452a11488de5d80dbd259f9d43397d58a", + "mean": -0.00945114903151989, + "std": 0.5407733917236328, + "rms": 0.5408560037612915, + "max_abs": 16.5 + }, + "full_input": { + "shape": [ + 191, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fdcfd1604b8ed0e0eeb00ca78dce73023abf11840ff3acd6dddee35075be84a3", + "mean": -0.010178026743233204, + "std": 5.124734878540039, + "rms": 5.1247453689575195, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "94114d5754695c574865a473453da6dd6fb4a86e78dca38203ae989ab99baac7", + "mean": -0.009193303063511848, + "std": 0.5409498810768127, + "rms": 0.5410280227661133, + "max_abs": 16.25 + }, + "full_input": { + "shape": [ + 207, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7bb0a5a461429b4ae96eeb93a2d37f69b0aee5ade70ac4b8799de47ba7cc24c5", + "mean": -0.009875600226223469, + "std": 4.917204856872559, + "rms": 4.917214870452881, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9964771270751953, + "min_cosine_similarity": 0.943325400352478, + "mean_relative_l2": 0.07548391073942184, + "max_abs_delta": 1.0 + }, + "system_bos": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9956310391426086, + "min_cosine_similarity": 0.9515220522880554, + "mean_relative_l2": 0.08703529089689255, + "max_abs_delta": 1.03125 + }, + "system_x": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9911350011825562, + "min_cosine_similarity": 0.8612486720085144, + "mean_relative_l2": 0.1181427389383316, + "max_abs_delta": 1.921875 + }, + "system_period": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9919107556343079, + "min_cosine_similarity": 0.882003903388977, + "mean_relative_l2": 0.11375284940004349, + "max_abs_delta": 1.46875 + }, + "bos_at_s0": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9929893016815186, + "min_cosine_similarity": 0.8304338455200195, + "mean_relative_l2": 0.10387992858886719, + "max_abs_delta": 3.0 + }, + "bos_at_s1": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9912322759628296, + "min_cosine_similarity": 0.8173269033432007, + "mean_relative_l2": 0.11885275691747665, + "max_abs_delta": 2.75 + }, + "x_at_s0": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9917200207710266, + "min_cosine_similarity": 0.8008989095687866, + "mean_relative_l2": 0.11223570257425308, + "max_abs_delta": 3.40625 + }, + "x_at_s1": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9870015382766724, + "min_cosine_similarity": 0.7275605797767639, + "mean_relative_l2": 0.14357982575893402, + "max_abs_delta": 2.6875 + }, + "period_at_s0": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9915427565574646, + "min_cosine_similarity": 0.8018701076507568, + "mean_relative_l2": 0.11353374272584915, + "max_abs_delta": 4.0625 + }, + "period_at_s1": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9874449372291565, + "min_cosine_similarity": 0.7630560398101807, + "mean_relative_l2": 0.14244593679904938, + "max_abs_delta": 5.40625 + } + } + }, + "layer_13": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "86fee4805d51f8da24aa4c043845d78fb2aafa8808473de987a07eb544691a9a", + "mean": -0.00914273876696825, + "std": 0.5619811415672302, + "rms": 0.5620554685592651, + "max_abs": 15.9375 + }, + "full_input": { + "shape": [ + 191, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f0d1c488abf6758c267c01e09dec191a1d5653142b5c410cc7209a747003ebf0", + "mean": -0.0160273015499115, + "std": 5.8464674949646, + "rms": 5.846489906311035, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b24b4f5946519180a7ff969be1713af4ec677d83af41981a47f43d829b320a67", + "mean": -0.009123697876930237, + "std": 0.5606505274772644, + "rms": 0.5607247948646545, + "max_abs": 16.125 + }, + "full_input": { + "shape": [ + 207, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7d0f17c0c7656b8bbdc02acb5c93e7a8d8edd6636ae69e116ecf10a965e82321", + "mean": -0.016642559319734573, + "std": 5.785467624664307, + "rms": 5.785491943359375, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "74ec52e4063fb082010ed2f0708c29ba94914cbeabf9ac678b68eef401de6961", + "mean": -0.00907953642308712, + "std": 0.5649692416191101, + "rms": 0.5650421380996704, + "max_abs": 16.125 + }, + "full_input": { + "shape": [ + 191, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9668446457b8c6caa8fb3e63be2f2c0a436e31a6e7e4d55232739aa8a6966d98", + "mean": -0.009948472492396832, + "std": 5.130593299865723, + "rms": 5.130603313446045, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a6a79adfc0f9c88fa44b32cfc8a1c62e27451f09878f23203dd4f99a944dcc33", + "mean": -0.0090698953717947, + "std": 0.5668717622756958, + "rms": 0.5669443607330322, + "max_abs": 16.375 + }, + "full_input": { + "shape": [ + 207, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a497a83bc7a283cc0983ed9e379302e168da60c7e2f97d713270834ed35004fd", + "mean": -0.010198569856584072, + "std": 4.923684120178223, + "rms": 4.923695087432861, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6d5053b02d89b444c3f95520304d4bf583c2942cc77dc5a2aeafaf3ffc237118", + "mean": -0.008772733621299267, + "std": 0.5649611353874207, + "rms": 0.5650292038917542, + "max_abs": 16.0 + }, + "full_input": { + "shape": [ + 191, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7a4561a0ee811f0e6e611342831d4106cf8ef72a9142572e3b682d183fb6b262", + "mean": -0.00975154247134924, + "std": 5.130661964416504, + "rms": 5.13067102432251, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "15b8017495e4608fa63cb3667d24866091ac177c3f96036fdfc1cd5d643e35f5", + "mean": -0.008614210411906242, + "std": 0.5652804374694824, + "rms": 0.5653460621833801, + "max_abs": 16.375 + }, + "full_input": { + "shape": [ + 207, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a27666e4f669962e2aadb9743fd8ee9ed6a545dc2c3d7fd8822cb0c1d9da7b1e", + "mean": -0.009828593581914902, + "std": 4.923445701599121, + "rms": 4.923455715179443, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9bfcc39c2014e59e4946f26359073db98d11b1f70a84f3cbd4463c695f2cb764", + "mean": -0.008684616535902023, + "std": 0.564419150352478, + "rms": 0.5644859671592712, + "max_abs": 16.375 + }, + "full_input": { + "shape": [ + 191, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ef35a9486db163b7220f023799c70a95cdb4719bc3a65fccdfc5d15672db70c1", + "mean": -0.009518684819340706, + "std": 5.130548477172852, + "rms": 5.130557537078857, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6d0bf59fb5e69f477c4e422506bc28de25720f8d081f087e8b877096ca448c96", + "mean": -0.008490268141031265, + "std": 0.5660092234611511, + "rms": 0.5660728216171265, + "max_abs": 16.375 + }, + "full_input": { + "shape": [ + 207, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bd09a417552bf80b749db3c0678db12cec1aba256df8a96baed8354837e4c8d8", + "mean": -0.009624973870813847, + "std": 4.923506736755371, + "rms": 4.923516750335693, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9964345097541809, + "min_cosine_similarity": 0.94277024269104, + "mean_relative_l2": 0.07633062452077866, + "max_abs_delta": 1.59375 + }, + "system_bos": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9954467415809631, + "min_cosine_similarity": 0.9504384994506836, + "mean_relative_l2": 0.0895240306854248, + "max_abs_delta": 0.9375 + }, + "system_x": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9909669160842896, + "min_cosine_similarity": 0.8603855967521667, + "mean_relative_l2": 0.12068403512239456, + "max_abs_delta": 1.75 + }, + "system_period": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9917348623275757, + "min_cosine_similarity": 0.8767372965812683, + "mean_relative_l2": 0.1164541244506836, + "max_abs_delta": 1.1875 + }, + "bos_at_s0": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9925481677055359, + "min_cosine_similarity": 0.8297345042228699, + "mean_relative_l2": 0.10769142955541611, + "max_abs_delta": 3.125 + }, + "bos_at_s1": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.990872323513031, + "min_cosine_similarity": 0.802158534526825, + "mean_relative_l2": 0.12155702710151672, + "max_abs_delta": 4.15625 + }, + "x_at_s0": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9915027618408203, + "min_cosine_similarity": 0.7988754510879517, + "mean_relative_l2": 0.1144576370716095, + "max_abs_delta": 4.125 + }, + "x_at_s1": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.986635684967041, + "min_cosine_similarity": 0.7352243065834045, + "mean_relative_l2": 0.14671684801578522, + "max_abs_delta": 3.15625 + }, + "period_at_s0": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.991272509098053, + "min_cosine_similarity": 0.8006058931350708, + "mean_relative_l2": 0.11597832292318344, + "max_abs_delta": 5.125 + }, + "period_at_s1": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9871453642845154, + "min_cosine_similarity": 0.7697157859802246, + "mean_relative_l2": 0.14531195163726807, + "max_abs_delta": 5.9375 + } + } + }, + "layer_14": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "decfc315de33938381072db29d4bd6c943e692c27596e8ef26d116f0bf883329", + "mean": -0.008178711868822575, + "std": 0.6251102685928345, + "rms": 0.6251637935638428, + "max_abs": 20.25 + }, + "full_input": { + "shape": [ + 191, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "60d9e712af9edb85cb02b77e580041bf92e0a1c9126d704713b1eae66fc864cd", + "mean": -0.014910106547176838, + "std": 5.862569332122803, + "rms": 5.862588405609131, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "92397346e5ac4b531ab4e863a7a919230ad69c6bd46c7acccca67de1c1a44521", + "mean": -0.008368784561753273, + "std": 0.6235645413398743, + "rms": 0.6236206889152527, + "max_abs": 20.5 + }, + "full_input": { + "shape": [ + 207, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "acfd8987f1f8f5038db496f5c722af68da5f2ae48161688bd06dcfcea2ea31e6", + "mean": -0.015923433005809784, + "std": 5.8007683753967285, + "rms": 5.800790309906006, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "319bb85ee15fb0dd6c849452faec49412027cf53ae0ed66d5790bd15a522f04c", + "mean": -0.008342331275343895, + "std": 0.628329873085022, + "rms": 0.6283852458000183, + "max_abs": 19.875 + }, + "full_input": { + "shape": [ + 191, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "70179f89bbc2eaab69342895e6acb736b32214f476324f5ac118fb61e8089442", + "mean": -0.009037800133228302, + "std": 5.148282527923584, + "rms": 5.148290634155273, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "30120d0d3060a33d2537966d8813e6b28ef0b2e79bb6492765e1b9fcf477d3ec", + "mean": -0.008635211735963821, + "std": 0.6307529211044312, + "rms": 0.6308119893074036, + "max_abs": 20.25 + }, + "full_input": { + "shape": [ + 207, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e637a99da35c7445444487ee9acef3b6ee69c4f17b8ff741c50a421ca09fa008", + "mean": -0.009696404449641705, + "std": 4.94110107421875, + "rms": 4.941111087799072, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d23185331c4534f2002465d277ab23f9ec55d73cee7e7069185806ab392cfd58", + "mean": -0.008045041002333164, + "std": 0.6287447214126587, + "rms": 0.6287961602210999, + "max_abs": 19.5 + }, + "full_input": { + "shape": [ + 191, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5c4f85e8419f58baf72c070dec86bf76d45ab1530bf0353db14a0ec755869c94", + "mean": -0.008857187815010548, + "std": 5.14842414855957, + "rms": 5.14843225479126, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7a2a6e15c50838974456ddfc54dc17d226df646f58b30467fe0115eb5300c01d", + "mean": -0.008260483853518963, + "std": 0.6288357377052307, + "rms": 0.6288899779319763, + "max_abs": 19.75 + }, + "full_input": { + "shape": [ + 207, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "417d38076f704b4b53d67d682d66b0efd506f56507b397222fcbcd741bd6394b", + "mean": -0.00942353904247284, + "std": 4.940844535827637, + "rms": 4.940853595733643, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9bc98712bac17f11230c2944d71528b1aab23da6065c2f5d7075e8506c7446c1", + "mean": -0.007965627126395702, + "std": 0.6283344626426697, + "rms": 0.6283849477767944, + "max_abs": 19.75 + }, + "full_input": { + "shape": [ + 191, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "26b7767f52974c52f44b73f1392a5528af73f37add259630c490c161e497af4a", + "mean": -0.00864061526954174, + "std": 5.148301601409912, + "rms": 5.148308753967285, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "66736f6e17876414b15be064eee35acffaf351c7c641d8c816e2549ad044e137", + "mean": -0.008003237657248974, + "std": 0.62959885597229, + "rms": 0.6296496987342834, + "max_abs": 19.625 + }, + "full_input": { + "shape": [ + 207, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "135829b76ef0e17e8a294899666d9a89a860648670e53c0f218ddf4e548efc7a", + "mean": -0.00915981363505125, + "std": 4.940885543823242, + "rms": 4.94089412689209, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9959438443183899, + "min_cosine_similarity": 0.9367271661758423, + "mean_relative_l2": 0.08137177675962448, + "max_abs_delta": 1.5625 + }, + "system_bos": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.995143473148346, + "min_cosine_similarity": 0.9487024545669556, + "mean_relative_l2": 0.09251764416694641, + "max_abs_delta": 1.083984375 + }, + "system_x": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9906943440437317, + "min_cosine_similarity": 0.8522878885269165, + "mean_relative_l2": 0.12302543222904205, + "max_abs_delta": 1.734375 + }, + "system_period": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9913197755813599, + "min_cosine_similarity": 0.8585500717163086, + "mean_relative_l2": 0.11944976449012756, + "max_abs_delta": 1.1875 + }, + "bos_at_s0": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9922968745231628, + "min_cosine_similarity": 0.8220509886741638, + "mean_relative_l2": 0.10971139371395111, + "max_abs_delta": 3.0625 + }, + "bos_at_s1": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9907016158103943, + "min_cosine_similarity": 0.7996530532836914, + "mean_relative_l2": 0.12275481224060059, + "max_abs_delta": 3.126953125 + }, + "x_at_s0": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9913144111633301, + "min_cosine_similarity": 0.79546719789505, + "mean_relative_l2": 0.11617272347211838, + "max_abs_delta": 3.9375 + }, + "x_at_s1": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.986466646194458, + "min_cosine_similarity": 0.7366304397583008, + "mean_relative_l2": 0.14877085387706757, + "max_abs_delta": 3.28125 + }, + "period_at_s0": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9908835291862488, + "min_cosine_similarity": 0.7905187010765076, + "mean_relative_l2": 0.11892624199390411, + "max_abs_delta": 5.1875 + }, + "period_at_s1": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9868830442428589, + "min_cosine_similarity": 0.7626725435256958, + "mean_relative_l2": 0.14746050536632538, + "max_abs_delta": 5.84375 + } + } + }, + "layer_15": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7dd042a9d43f9fd7b51a712a254b180f88fc203009163c56c8271fd1fa376e9d", + "mean": -0.01112977322191, + "std": 0.6939530968666077, + "rms": 0.6940423250198364, + "max_abs": 23.5 + }, + "full_input": { + "shape": [ + 191, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4798087b556150acd703ddcef69e9db3ec7ce4bd37621782b0e8736fc45e83de", + "mean": -0.01722552627325058, + "std": 5.872654914855957, + "rms": 5.872679710388184, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "87d4a46dc0464be71b3d58d25e2929a5ef5d258f5e39802145a7712c4e5a829c", + "mean": -0.01139996387064457, + "std": 0.691508948802948, + "rms": 0.6916029453277588, + "max_abs": 23.625 + }, + "full_input": { + "shape": [ + 207, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "96c6eacad3af12c3b4d2c36a554dbeee2fd907d6a22ce23be253288862bbfe57", + "mean": -0.018307140097022057, + "std": 5.81110954284668, + "rms": 5.81113862991333, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c17fd51b0fff37de000d6069f880cef724a3a2d644b3089286fb304192f55561", + "mean": -0.011265451088547707, + "std": 0.6976025104522705, + "rms": 0.6976934671401978, + "max_abs": 23.5 + }, + "full_input": { + "shape": [ + 191, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9647ad020ec91c4ade381b50ab785a83b48a0c6845b4f5782758a534fe385c93", + "mean": -0.011380400508642197, + "std": 5.159417152404785, + "rms": 5.159430027008057, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0f78133fa51da84960057c947f570fc79dbc97883e052553d93c0cd20ecb9800", + "mean": -0.011488525196909904, + "std": 0.6997746229171753, + "rms": 0.69986891746521, + "max_abs": 23.75 + }, + "full_input": { + "shape": [ + 207, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "72bfb55e06a27db0b6287bb03c4d67517149258c0ad84f2909df0d6fe3c2e356", + "mean": -0.011983714066445827, + "std": 4.952833652496338, + "rms": 4.952847957611084, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a684d7332f1c951fc497d2f8fe064defb7852c7754fd18b1d2d0c4a9685e684d", + "mean": -0.011119108647108078, + "std": 0.6984490752220154, + "rms": 0.6985375881195068, + "max_abs": 23.5 + }, + "full_input": { + "shape": [ + 191, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4cfae5085a403971cf65fdbe1b3aba30b26d0dbcf73f64a6194c82b9211deaa8", + "mean": -0.011291210539638996, + "std": 5.159607887268066, + "rms": 5.1596198081970215, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "248c33d91a4af06a6c05addfd3b16f9605f6e70cdf55918d3183f36d00d200c2", + "mean": -0.011521105654537678, + "std": 0.697640597820282, + "rms": 0.6977357864379883, + "max_abs": 23.0 + }, + "full_input": { + "shape": [ + 207, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "24ed6649add89be94e030bd65050ff8cae1254e8f63a4d05497f8b8ff27fd132", + "mean": -0.012043176218867302, + "std": 4.952509880065918, + "rms": 4.952524662017822, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "570c67faf7dc99186c22090186d77d1b8bf5e92357755498c64424d808d3e86f", + "mean": -0.01114148274064064, + "std": 0.6984163522720337, + "rms": 0.6985052227973938, + "max_abs": 23.25 + }, + "full_input": { + "shape": [ + 191, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cc140f625c6d36532995b5fd65d3126c34cec741638afe2cc8183c8aa25465e6", + "mean": -0.011141824536025524, + "std": 5.1595234870910645, + "rms": 5.1595354080200195, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c8cf3eee6c4acdb32ad0bf9d43d8a829a5fe3b59cd4d5ca034a69542ff7b4e83", + "mean": -0.011230548843741417, + "std": 0.6984428763389587, + "rms": 0.6985331773757935, + "max_abs": 22.875 + }, + "full_input": { + "shape": [ + 207, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2801b9efc606e278d8c95b91b4e2b180a203184b3895c049bf1f4097acb5ab34", + "mean": -0.01168594229966402, + "std": 4.952585220336914, + "rms": 4.952598571777344, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9957920908927917, + "min_cosine_similarity": 0.936312198638916, + "mean_relative_l2": 0.08359380066394806, + "max_abs_delta": 2.0625 + }, + "system_bos": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9950942993164062, + "min_cosine_similarity": 0.9500854015350342, + "mean_relative_l2": 0.0933355763554573, + "max_abs_delta": 1.75 + }, + "system_x": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9905011057853699, + "min_cosine_similarity": 0.8342971801757812, + "mean_relative_l2": 0.124797523021698, + "max_abs_delta": 1.90625 + }, + "system_period": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9911136627197266, + "min_cosine_similarity": 0.8432071805000305, + "mean_relative_l2": 0.1213543638586998, + "max_abs_delta": 1.8125 + }, + "bos_at_s0": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9921300411224365, + "min_cosine_similarity": 0.8105512857437134, + "mean_relative_l2": 0.1111663207411766, + "max_abs_delta": 3.25 + }, + "bos_at_s1": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9905833005905151, + "min_cosine_similarity": 0.7993083000183105, + "mean_relative_l2": 0.12369126081466675, + "max_abs_delta": 3.8046875 + }, + "x_at_s0": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9913357496261597, + "min_cosine_similarity": 0.7975017428398132, + "mean_relative_l2": 0.11708090454339981, + "max_abs_delta": 4.0625 + }, + "x_at_s1": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9865353107452393, + "min_cosine_similarity": 0.730867862701416, + "mean_relative_l2": 0.14930790662765503, + "max_abs_delta": 3.875 + }, + "period_at_s0": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9907759428024292, + "min_cosine_similarity": 0.7887592315673828, + "mean_relative_l2": 0.12022057175636292, + "max_abs_delta": 4.625 + }, + "period_at_s1": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9868037104606628, + "min_cosine_similarity": 0.7480893731117249, + "mean_relative_l2": 0.1481114774942398, + "max_abs_delta": 6.28125 + } + } + }, + "layer_16": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7b839cf2031da87d55b5201e4f07b50c6ac2fdbf14b3d9c0edc7155438706fc6", + "mean": -0.011143643409013748, + "std": 0.7713997960090637, + "rms": 0.7714802622795105, + "max_abs": 26.75 + }, + "full_input": { + "shape": [ + 191, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "63ab2ec34851d3418e5a40038cc21b76a2685addcdaf77d86121d0989ed324d8", + "mean": -0.017135614529252052, + "std": 5.88472843170166, + "rms": 5.884753227233887, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4bfe588426e112c6f242a5bd7971364f2ea62b48886913c1ac2b74ff0f3429db", + "mean": -0.01156702172011137, + "std": 0.770716667175293, + "rms": 0.7708034515380859, + "max_abs": 27.125 + }, + "full_input": { + "shape": [ + 207, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f37f521cb5e8e77063b1d4957a1a940dc04fa712463d6220503c482d7615ddaf", + "mean": -0.01816490665078163, + "std": 5.823408126831055, + "rms": 5.8234357833862305, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2e3f609f63654887a4339a58a8d8f12c60f697570b964008e81be663a8b8a9bc", + "mean": -0.01153015997260809, + "std": 0.7743378281593323, + "rms": 0.7744236588478088, + "max_abs": 26.75 + }, + "full_input": { + "shape": [ + 191, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2c7b8cf330728f6f8cc912ac1eaec63b39e724dc0c293f1a0899fe6f3ec41dab", + "mean": -0.011512702330946922, + "std": 5.172353744506836, + "rms": 5.172366142272949, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9128987942d06e88171fc26d463b05e178b7673283fa5d9947cee88cd8cd2346", + "mean": -0.011701944284141064, + "std": 0.7773934006690979, + "rms": 0.7774814963340759, + "max_abs": 27.0 + }, + "full_input": { + "shape": [ + 207, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "dd4ab3c94ae65b90070345795a4f813294ba7a42ed487d608134fa777c4fe392", + "mean": -0.011828369460999966, + "std": 4.966515064239502, + "rms": 4.966529369354248, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "efa9532de3c75d8452d7f4201912f2a682dcbee88eeceaeed22422d98ee7073e", + "mean": -0.011291461065411568, + "std": 0.7770411372184753, + "rms": 0.777123212814331, + "max_abs": 26.5 + }, + "full_input": { + "shape": [ + 191, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b43d8d9b6f4a73a4780bb4004c7648f86804237665539ab5f5ab098c26182fb3", + "mean": -0.01138164009898901, + "std": 5.172922611236572, + "rms": 5.172934532165527, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9b58e4a97392c57c3ca5057498bf181103b69cb1a8b104255b44b79329c0e281", + "mean": -0.011453414335846901, + "std": 0.7773348093032837, + "rms": 0.7774191498756409, + "max_abs": 26.25 + }, + "full_input": { + "shape": [ + 207, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "746ce8c6c5544f0a4499baf102e4c4f94b0f011d857676ab4e30b70f637d6de6", + "mean": -0.011692141182720661, + "std": 4.9665656089782715, + "rms": 4.966579437255859, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6cbe9a7ca11b5e7bc6642cc58d0564396630fbd9566290f3ce5a074559543502", + "mean": -0.011324206367135048, + "std": 0.7770693898200989, + "rms": 0.777151882648468, + "max_abs": 26.375 + }, + "full_input": { + "shape": [ + 191, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "80532708f0893adb4a6b7089305f28437fcd871a92c58e6375657e920b01b479", + "mean": -0.011222380213439465, + "std": 5.1727423667907715, + "rms": 5.172754287719727, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0481ca925ac2c0517a82e7b08dbbe5fd7bedd25c666ec8df51d1ac036f87eea0", + "mean": -0.01143306028097868, + "std": 0.7779061198234558, + "rms": 0.7779901623725891, + "max_abs": 26.25 + }, + "full_input": { + "shape": [ + 207, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1c854a46fe9f72b502a80d9a384df74aac51cdb60b90533ad4579db751835816", + "mean": -0.011534040793776512, + "std": 4.966524124145508, + "rms": 4.9665374755859375, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9955195188522339, + "min_cosine_similarity": 0.9358845353126526, + "mean_relative_l2": 0.0870063528418541, + "max_abs_delta": 2.0625 + }, + "system_bos": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9946199059486389, + "min_cosine_similarity": 0.9483661651611328, + "mean_relative_l2": 0.09791679680347443, + "max_abs_delta": 2.125 + }, + "system_x": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9897111654281616, + "min_cosine_similarity": 0.8240647315979004, + "mean_relative_l2": 0.1304043084383011, + "max_abs_delta": 2.140625 + }, + "system_period": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9906678795814514, + "min_cosine_similarity": 0.8391283750534058, + "mean_relative_l2": 0.12470881640911102, + "max_abs_delta": 1.875 + }, + "bos_at_s0": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9915676116943359, + "min_cosine_similarity": 0.8078362345695496, + "mean_relative_l2": 0.11539365351200104, + "max_abs_delta": 3.0 + }, + "bos_at_s1": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9900897145271301, + "min_cosine_similarity": 0.7975926995277405, + "mean_relative_l2": 0.12679874897003174, + "max_abs_delta": 4.28125 + }, + "x_at_s0": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9907318353652954, + "min_cosine_similarity": 0.7965201735496521, + "mean_relative_l2": 0.12140416353940964, + "max_abs_delta": 3.9375 + }, + "x_at_s1": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9858359098434448, + "min_cosine_similarity": 0.725967526435852, + "mean_relative_l2": 0.15355314314365387, + "max_abs_delta": 4.4375 + }, + "period_at_s0": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9902083873748779, + "min_cosine_similarity": 0.7848330140113831, + "mean_relative_l2": 0.12429076433181763, + "max_abs_delta": 4.25 + }, + "period_at_s1": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9863818287849426, + "min_cosine_similarity": 0.7512215375900269, + "mean_relative_l2": 0.1508355438709259, + "max_abs_delta": 5.9375 + } + } + }, + "layer_17": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bd2965d773e0a4ec1c71644c4a8d97793242842a41eab2cf6c4bce92296b9044", + "mean": -0.011374691501259804, + "std": 0.8742327094078064, + "rms": 0.8743067383766174, + "max_abs": 32.0 + }, + "full_input": { + "shape": [ + 191, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ef62b7dcaf291e96f00abf4a1de10d7efa07ee0a699b64300c333a3cbb9ea30a", + "mean": -0.01758028194308281, + "std": 5.901322364807129, + "rms": 5.90134859085083, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8020240449e1e2fe2d44a593354fb8a936186c525f5734c5cf7ab4465fa3094b", + "mean": -0.011543196626007557, + "std": 0.8730112314224243, + "rms": 0.8730875253677368, + "max_abs": 32.5 + }, + "full_input": { + "shape": [ + 207, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "01f70d23c82b0ab5a936104f20264637b273a9b10edc6042a30ddc696ebd4e29", + "mean": -0.018765028566122055, + "std": 5.840296745300293, + "rms": 5.840326309204102, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8c86779133ba7a40b2d52c0aa03913e9cc2989409306ea760efe84d6505fbe11", + "mean": -0.011652598157525063, + "std": 0.8771127462387085, + "rms": 0.877190113067627, + "max_abs": 32.0 + }, + "full_input": { + "shape": [ + 191, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fcdc7a84894782951c180448aa9cac48c2485b5e5dc63cc9b325effe91e3303d", + "mean": -0.011833636090159416, + "std": 5.190837860107422, + "rms": 5.190851211547852, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3e018358d0893336949680eb40af7b39169875bc658aa9cfbc5cbe8c7b445580", + "mean": -0.011509764939546585, + "std": 0.8800219297409058, + "rms": 0.8800972104072571, + "max_abs": 32.25 + }, + "full_input": { + "shape": [ + 207, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fe44d1429b1692c03b22348dc2e8dc59d81345f5c800cccc612e9bf411cb165e", + "mean": -0.012319753877818584, + "std": 4.986064910888672, + "rms": 4.986080646514893, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8ade96581b19600376b0314c43c209504c37103f28c8f0c381c3fc28e9a87a8a", + "mean": -0.011420882306993008, + "std": 0.8798238635063171, + "rms": 0.8798980116844177, + "max_abs": 31.125 + }, + "full_input": { + "shape": [ + 191, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "aef34c127401694c610c8bb616ebaa829f4ffe6d2995ffd38cca7287daf06950", + "mean": -0.011769204400479794, + "std": 5.191521644592285, + "rms": 5.191534996032715, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "02e79510f6aec59ef1fb2f8ec515d05edfec8192bb687e4c47c9d8468037338b", + "mean": -0.011332618072628975, + "std": 0.8801969885826111, + "rms": 0.8802699446678162, + "max_abs": 30.75 + }, + "full_input": { + "shape": [ + 207, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e3577e99aa6f94c09f4d7a84904071cb665f9049f3e24e75c7047fabe3fa2a26", + "mean": -0.01224446389824152, + "std": 4.986184120178223, + "rms": 4.986199378967285, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7c2b6bd2665616977cdd0222b0f62b6d679c44a03715a559f3753f01e7345b96", + "mean": -0.011333858594298363, + "std": 0.8797046542167664, + "rms": 0.8797776103019714, + "max_abs": 31.125 + }, + "full_input": { + "shape": [ + 191, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ddf1f62d50e81db96fa6db4a23e3a3577201f40c215862676147213166874559", + "mean": -0.011442572809755802, + "std": 5.191273212432861, + "rms": 5.191286087036133, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3eb5757af1c07c253a3b38e172bcc9dbb293c3775e6dfe79c1b32b1d9d0388cd", + "mean": -0.01112627238035202, + "std": 0.880041778087616, + "rms": 0.8801121115684509, + "max_abs": 31.25 + }, + "full_input": { + "shape": [ + 207, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3f02388132dc7ba4a8d331e5f062db2555465954e0fb96a2dbcf5744b512bf84", + "mean": -0.01191417034715414, + "std": 4.986085414886475, + "rms": 4.9860992431640625, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9957224130630493, + "min_cosine_similarity": 0.9404958486557007, + "mean_relative_l2": 0.08502992987632751, + "max_abs_delta": 1.375 + }, + "system_bos": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9948896765708923, + "min_cosine_similarity": 0.9537850618362427, + "mean_relative_l2": 0.09575315564870834, + "max_abs_delta": 1.625 + }, + "system_x": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9902464151382446, + "min_cosine_similarity": 0.8282907605171204, + "mean_relative_l2": 0.12756308913230896, + "max_abs_delta": 2.46875 + }, + "system_period": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9910916090011597, + "min_cosine_similarity": 0.8449746370315552, + "mean_relative_l2": 0.12204411625862122, + "max_abs_delta": 2.125 + }, + "bos_at_s0": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.991897702217102, + "min_cosine_similarity": 0.8089398741722107, + "mean_relative_l2": 0.1129668727517128, + "max_abs_delta": 4.0 + }, + "bos_at_s1": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9904804229736328, + "min_cosine_similarity": 0.809995174407959, + "mean_relative_l2": 0.12439773976802826, + "max_abs_delta": 4.75 + }, + "x_at_s0": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9910815358161926, + "min_cosine_similarity": 0.8142254948616028, + "mean_relative_l2": 0.11957135051488876, + "max_abs_delta": 3.5 + }, + "x_at_s1": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9866865873336792, + "min_cosine_similarity": 0.7572681903839111, + "mean_relative_l2": 0.1499335765838623, + "max_abs_delta": 5.5625 + }, + "period_at_s0": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9905337691307068, + "min_cosine_similarity": 0.7986687421798706, + "mean_relative_l2": 0.1225501000881195, + "max_abs_delta": 3.75 + }, + "period_at_s1": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9872063994407654, + "min_cosine_similarity": 0.7815252542495728, + "mean_relative_l2": 0.14699506759643555, + "max_abs_delta": 3.8125 + } + } + }, + "layer_18": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f58ed9cf448012b88d5d4e9f7313bd2e025d5af5d07816a133ead1c561497d4e", + "mean": -0.010330318473279476, + "std": 0.9847422242164612, + "rms": 0.9847964644432068, + "max_abs": 34.75 + }, + "full_input": { + "shape": [ + 191, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1470667e556a6608c3944b3fa1d30e64c851af73689e6f474451d6852fa14492", + "mean": -0.016608575358986855, + "std": 5.922906398773193, + "rms": 5.922929763793945, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2c311585786eb345e269dd79e0ea9aafc7b0bdfe50b44fd44aadf163c4e97d41", + "mean": -0.01053792703896761, + "std": 0.9811347126960754, + "rms": 0.9811912775039673, + "max_abs": 35.25 + }, + "full_input": { + "shape": [ + 207, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "12fed20af38ec137c514b693069f4c9e0c1fb4cb295cc06738306a8db521c145", + "mean": -0.01784535124897957, + "std": 5.8620381355285645, + "rms": 5.862064838409424, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3972ae57dcbe33b7cdff6fcf3c1cb4ca8c98a0c50400aacee6059a3e7c5f9416", + "mean": -0.010792981833219528, + "std": 0.9877496957778931, + "rms": 0.9878086447715759, + "max_abs": 34.5 + }, + "full_input": { + "shape": [ + 191, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bd60492b7542d6728ef67f911279682c122fa03005e7bb3c2b48599a9bb5604c", + "mean": -0.010972961783409119, + "std": 5.213492393493652, + "rms": 5.213503837585449, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "dee02ad4cafba940370b6cb83cee1f0ff9c27729ea0d2f3ed0afd4781363a5d0", + "mean": -0.010615249164402485, + "std": 0.9890620708465576, + "rms": 0.9891189932823181, + "max_abs": 34.5 + }, + "full_input": { + "shape": [ + 207, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1503ce7de1bd1d12d9537c51ceb1b60ba212b8b9df113f82752ef6aaf1385983", + "mean": -0.011438685469329357, + "std": 5.009796619415283, + "rms": 5.0098090171813965, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7fa4a1401413d6c210f22200a84f2cab0cc12f9efde43c09720a8d22a94bc106", + "mean": -0.010670497082173824, + "std": 0.991410493850708, + "rms": 0.9914678335189819, + "max_abs": 35.5 + }, + "full_input": { + "shape": [ + 191, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1244c48cfdb65d1d2942aaa61a9039199b75fbf1adb37c1d746e286689ad265e", + "mean": -0.011068730615079403, + "std": 5.214455604553223, + "rms": 5.214467525482178, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "03cc80010d87617b881a7a26944cf317d154c4126e10b62cdb0a517eaae6158d", + "mean": -0.010711485520005226, + "std": 0.99053955078125, + "rms": 0.9905974864959717, + "max_abs": 35.0 + }, + "full_input": { + "shape": [ + 207, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3e2b8138027e7cf57e7814c21df0acce4e1e253574da5c87a85185f559fcec1a", + "mean": -0.011614113114774227, + "std": 5.010228157043457, + "rms": 5.010241508483887, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "708a8f8638d3c65a5503c43ef2559566ca7dae5d21cb4aa61081c486a7163543", + "mean": -0.010735859163105488, + "std": 0.9909066557884216, + "rms": 0.9909647703170776, + "max_abs": 35.25 + }, + "full_input": { + "shape": [ + 191, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d51fdb926ca93ca712b53e92c1fd36f9e7b6f14b5af28c88fea027488712701e", + "mean": -0.010859002359211445, + "std": 5.214096546173096, + "rms": 5.214107990264893, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "47105dc533548c4579bdc033dd161f5ecfb8ea0ce2f15fca1d09df3ecc669903", + "mean": -0.010581081733107567, + "std": 0.9896425008773804, + "rms": 0.9896990656852722, + "max_abs": 35.0 + }, + "full_input": { + "shape": [ + 207, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9f10794bf5c0f79fe065fb2b549ebc98c9e7f9f358fdabacb065390f756eba6b", + "mean": -0.011368483304977417, + "std": 5.009909152984619, + "rms": 5.009922027587891, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9955862760543823, + "min_cosine_similarity": 0.936861515045166, + "mean_relative_l2": 0.08604979515075684, + "max_abs_delta": 2.0 + }, + "system_bos": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9947952628135681, + "min_cosine_similarity": 0.9563056230545044, + "mean_relative_l2": 0.0965859517455101, + "max_abs_delta": 1.875 + }, + "system_x": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9899702668190002, + "min_cosine_similarity": 0.8113113641738892, + "mean_relative_l2": 0.1291833221912384, + "max_abs_delta": 3.21875 + }, + "system_period": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9906773567199707, + "min_cosine_similarity": 0.8304237723350525, + "mean_relative_l2": 0.1243266686797142, + "max_abs_delta": 2.29296875 + }, + "bos_at_s0": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9915279746055603, + "min_cosine_similarity": 0.7965599298477173, + "mean_relative_l2": 0.11447705328464508, + "max_abs_delta": 4.3671875 + }, + "bos_at_s1": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9901872873306274, + "min_cosine_similarity": 0.7879695296287537, + "mean_relative_l2": 0.12557612359523773, + "max_abs_delta": 6.34765625 + }, + "x_at_s0": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9908134937286377, + "min_cosine_similarity": 0.8014004826545715, + "mean_relative_l2": 0.12091805785894394, + "max_abs_delta": 5.25 + }, + "x_at_s1": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9862489104270935, + "min_cosine_similarity": 0.7484297752380371, + "mean_relative_l2": 0.15190434455871582, + "max_abs_delta": 7.5 + }, + "period_at_s0": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.990156888961792, + "min_cosine_similarity": 0.780464231967926, + "mean_relative_l2": 0.12389875948429108, + "max_abs_delta": 3.875 + }, + "period_at_s1": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9867669343948364, + "min_cosine_similarity": 0.7676287889480591, + "mean_relative_l2": 0.14879055321216583, + "max_abs_delta": 4.0 + } + } + }, + "layer_19": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6de81ef38837e036cf0138f567deb820e5a3b0baa1b43e65985649ce01423ba2", + "mean": -0.009866932407021523, + "std": 1.0847692489624023, + "rms": 1.084814190864563, + "max_abs": 33.0 + }, + "full_input": { + "shape": [ + 191, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5e39d8e770010f98c9d3fc2f1b3d70745256d7474a9a3a747b07eb52c3ac216a", + "mean": -0.015808209776878357, + "std": 5.938413143157959, + "rms": 5.93843412399292, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4bdf130e8c828dc2c01d5222ec335a770878ba3f530252693316d7f1a80f7461", + "mean": -0.009903525933623314, + "std": 1.0808180570602417, + "rms": 1.080863356590271, + "max_abs": 33.25 + }, + "full_input": { + "shape": [ + 207, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c8d862e6895429bfd8fa82c26e274eaaad3b99cbcd8e2763c244d9883670da06", + "mean": -0.0166998952627182, + "std": 5.878252983093262, + "rms": 5.878276348114014, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5b1ff11aba5b63e153cac12462a1178de53ff1328e77f49f602639dd3439fd34", + "mean": -0.010684313252568245, + "std": 1.0877323150634766, + "rms": 1.087784767150879, + "max_abs": 33.0 + }, + "full_input": { + "shape": [ + 191, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9cb382793c46977de280e337e22b0b259c0769a68d1d5f926d95c8b874324c69", + "mean": -0.010557073168456554, + "std": 5.231415748596191, + "rms": 5.23142671585083, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2a955aa2a11985f69a5d4047d36515841821738662a5b7113d05b17be2d34106", + "mean": -0.01043468713760376, + "std": 1.0886130332946777, + "rms": 1.088663101196289, + "max_abs": 33.0 + }, + "full_input": { + "shape": [ + 207, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "af56122fe7d561cc146921b0706c4dcde1c5f76800de6488c784c6b81b0638bd", + "mean": -0.010646075010299683, + "std": 5.028810501098633, + "rms": 5.028820991516113, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "77d7d6ed86a3d4a2c9d629f314755d8e2bc1c11cda5480525c5b23eb068f4359", + "mean": -0.010464070364832878, + "std": 1.0921974182128906, + "rms": 1.092247486114502, + "max_abs": 31.625 + }, + "full_input": { + "shape": [ + 191, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0bdca2bc457b4bbefce92b45c9abdfd9fbd7d1a43ca9d1c67ecfac6f855ae80a", + "mean": -0.010536490939557552, + "std": 5.232770919799805, + "rms": 5.232781887054443, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9c59f00dc407e7da4c6aa437168556d0f5d45bc13d54699703716a2dc4afc3b6", + "mean": -0.010204730555415154, + "std": 1.0908421277999878, + "rms": 1.090889811515808, + "max_abs": 31.5 + }, + "full_input": { + "shape": [ + 207, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3571129cb0f0c504feca9bd312dc224348f8f97d45b17ef8ec02790089e43c95", + "mean": -0.010525009594857693, + "std": 5.02939510345459, + "rms": 5.02940559387207, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1c13c339242e9542b1d58c39a61defc3b61162cd02f52c45f816d287f928e8ad", + "mean": -0.010623949579894543, + "std": 1.0919463634490967, + "rms": 1.0919979810714722, + "max_abs": 31.625 + }, + "full_input": { + "shape": [ + 191, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e91d03c93365172108fec04ee8824e1be9c8d804fd6f514c04ce5c15fa677d4f", + "mean": -0.010507010854780674, + "std": 5.2323102951049805, + "rms": 5.232321262359619, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "89fec3f4e90136248c58704791e9eac8034373b0d835ddb40618e6164d9e229f", + "mean": -0.010251167230308056, + "std": 1.0907020568847656, + "rms": 1.0907500982284546, + "max_abs": 31.875 + }, + "full_input": { + "shape": [ + 207, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3407e9def6b8c03dcdf964c5eafcf78bed3159d668bd49187bb76fae9388201c", + "mean": -0.010584388859570026, + "std": 5.029236316680908, + "rms": 5.029247283935547, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9954598546028137, + "min_cosine_similarity": 0.9161366820335388, + "mean_relative_l2": 0.08684888482093811, + "max_abs_delta": 3.9375 + }, + "system_bos": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9946736693382263, + "min_cosine_similarity": 0.9569274187088013, + "mean_relative_l2": 0.09795241802930832, + "max_abs_delta": 1.75 + }, + "system_x": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9895972609519958, + "min_cosine_similarity": 0.8014808893203735, + "mean_relative_l2": 0.13047358393669128, + "max_abs_delta": 3.5 + }, + "system_period": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9905055165290833, + "min_cosine_similarity": 0.8346513509750366, + "mean_relative_l2": 0.1253986656665802, + "max_abs_delta": 3.5 + }, + "bos_at_s0": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9914535284042358, + "min_cosine_similarity": 0.8083646297454834, + "mean_relative_l2": 0.11528228968381882, + "max_abs_delta": 4.4921875 + }, + "bos_at_s1": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9898863434791565, + "min_cosine_similarity": 0.7374249696731567, + "mean_relative_l2": 0.1261313557624817, + "max_abs_delta": 8.1875 + }, + "x_at_s0": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9907371997833252, + "min_cosine_similarity": 0.816777229309082, + "mean_relative_l2": 0.12231434136629105, + "max_abs_delta": 4.125 + }, + "x_at_s1": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9860681891441345, + "min_cosine_similarity": 0.7276667952537537, + "mean_relative_l2": 0.15223681926727295, + "max_abs_delta": 5.1875 + }, + "period_at_s0": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9901048541069031, + "min_cosine_similarity": 0.7966018319129944, + "mean_relative_l2": 0.12524273991584778, + "max_abs_delta": 3.375 + }, + "period_at_s1": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9867019653320312, + "min_cosine_similarity": 0.7773090600967407, + "mean_relative_l2": 0.14909350872039795, + "max_abs_delta": 4.5625 + } + } + }, + "layer_20": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "aa289f384e4cf03aacbec309fa539d4a57f000f0808c29d5dee782907adc00e5", + "mean": -0.010851149447262287, + "std": 1.232250690460205, + "rms": 1.232298493385315, + "max_abs": 38.25 + }, + "full_input": { + "shape": [ + 191, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "71441964c70f98f07e31558ebcefd7266376a4ee1c131fbae2b2ff5f18a35e4b", + "mean": -0.016519753262400627, + "std": 6.139850616455078, + "rms": 6.1398725509643555, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d6c6880c1e8bf744f3529f71c254b871bdf28418a333a2bd928368562330e7d5", + "mean": -0.01125307660549879, + "std": 1.2289893627166748, + "rms": 1.2290409803390503, + "max_abs": 38.0 + }, + "full_input": { + "shape": [ + 207, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2c58b6862381cede5519f5e62f66b3c8df347419f33f79c698216150e26c764c", + "mean": -0.017668871209025383, + "std": 6.085938930511475, + "rms": 6.085964679718018, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1e2a5a5177c3af563450d22d99b33bc9313d12493de8e5580e23f50aca4b35e9", + "mean": -0.011695540510118008, + "std": 1.2342610359191895, + "rms": 1.2343164682388306, + "max_abs": 38.0 + }, + "full_input": { + "shape": [ + 191, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0385c6e1202fa5670521b97bc33a8f1f0822599a30a104b00c39bb52a35e8c08", + "mean": -0.011646528728306293, + "std": 5.264127254486084, + "rms": 5.264139652252197, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0a39ced74a62a8c5c026db75dc30795c8ccea0a407894561ba83c7eecaec05a9", + "mean": -0.011470446363091469, + "std": 1.2365962266921997, + "rms": 1.236649513244629, + "max_abs": 38.0 + }, + "full_input": { + "shape": [ + 207, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d539c5967a7f8d66c612d7e14d747b785f985995c28d4c7d9d59195868c79a9b", + "mean": -0.011624964885413647, + "std": 5.063823699951172, + "rms": 5.06383752822876, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4211600c4e298327f68a5fcaa38a7538cb8c07c9689a2117e6141f3e46ac530e", + "mean": -0.011708209291100502, + "std": 1.2411051988601685, + "rms": 1.2411603927612305, + "max_abs": 38.0 + }, + "full_input": { + "shape": [ + 191, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "79245794168e02793f78e4286b1f2a1ce731a0ef81ed187423c1aadfecae5a6a", + "mean": -0.011870346963405609, + "std": 5.266289710998535, + "rms": 5.266303062438965, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5e576a25d80dc6e06f6ed1e02d39d75b6123bb547f01f25c14d1308b1a828213", + "mean": -0.011401590891182423, + "std": 1.2398675680160522, + "rms": 1.2399200201034546, + "max_abs": 38.25 + }, + "full_input": { + "shape": [ + 207, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "aaa47a58c6ef1d4c38bdbe6bced50966c510c35ff00d33d2c3d1870b4e5376a8", + "mean": -0.01169912051409483, + "std": 5.064879894256592, + "rms": 5.0648932456970215, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5916a230c02c8ad3f236d78393593c3fcb7f51754af08fe9adb015da0f9a9d0d", + "mean": -0.011747014708817005, + "std": 1.2402582168579102, + "rms": 1.2403138875961304, + "max_abs": 37.75 + }, + "full_input": { + "shape": [ + 191, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "98e5031dd48858eb71c0cd24df9773cc3d1cb14be90129048e4bc3fe9ff76929", + "mean": -0.0116758206859231, + "std": 5.265635013580322, + "rms": 5.2656474113464355, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c5bd8bb9a3b6dc3a2905b4cbaf4f2d6ac2adf6285841a71b43e89f1b35759a61", + "mean": -0.01162677351385355, + "std": 1.2399743795394897, + "rms": 1.2400288581848145, + "max_abs": 38.0 + }, + "full_input": { + "shape": [ + 207, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b3c81fa7912f9a26422b30221c8495ebfde6e2d4f75f536d14fe8877716b7dfb", + "mean": -0.011851651594042778, + "std": 5.064614772796631, + "rms": 5.064628601074219, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.995535135269165, + "min_cosine_similarity": 0.9191782474517822, + "mean_relative_l2": 0.0859830379486084, + "max_abs_delta": 3.1875 + }, + "system_bos": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9948276281356812, + "min_cosine_similarity": 0.9558911323547363, + "mean_relative_l2": 0.09660180658102036, + "max_abs_delta": 2.0 + }, + "system_x": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9897181391716003, + "min_cosine_similarity": 0.8033589124679565, + "mean_relative_l2": 0.12962834537029266, + "max_abs_delta": 4.625 + }, + "system_period": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9905456304550171, + "min_cosine_similarity": 0.8392207026481628, + "mean_relative_l2": 0.12479454278945923, + "max_abs_delta": 3.5 + }, + "bos_at_s0": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9915428757667542, + "min_cosine_similarity": 0.8001704216003418, + "mean_relative_l2": 0.11371040344238281, + "max_abs_delta": 5.109375 + }, + "bos_at_s1": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9902790188789368, + "min_cosine_similarity": 0.751909613609314, + "mean_relative_l2": 0.12341377884149551, + "max_abs_delta": 6.900390625 + }, + "x_at_s0": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9909811615943909, + "min_cosine_similarity": 0.8115670680999756, + "mean_relative_l2": 0.12035541981458664, + "max_abs_delta": 5.125 + }, + "x_at_s1": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9864322543144226, + "min_cosine_similarity": 0.7410493493080139, + "mean_relative_l2": 0.15024079382419586, + "max_abs_delta": 6.3125 + }, + "period_at_s0": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9903690218925476, + "min_cosine_similarity": 0.7909113168716431, + "mean_relative_l2": 0.12324830889701843, + "max_abs_delta": 3.625 + }, + "period_at_s1": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9870232343673706, + "min_cosine_similarity": 0.7870354652404785, + "mean_relative_l2": 0.1471485048532486, + "max_abs_delta": 4.046875 + } + } + }, + "layer_21": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "962b14d496b275c3c36ee9a74102fb4dc2f6eea9ecb5f92273efbed0cb0aa97f", + "mean": -0.009790950454771519, + "std": 1.3191637992858887, + "rms": 1.319200038909912, + "max_abs": 47.25 + }, + "full_input": { + "shape": [ + 191, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ad5ed6402919f4f2d0737529fd4aeb3ef13391b4db2c001460b7f081651c5afe", + "mean": -0.015254915691912174, + "std": 6.2139787673950195, + "rms": 6.213997840881348, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9e58b928a5f996e6235582c7b560e0eb9fd90137f5f02bb4fe660046fc8ccdf2", + "mean": -0.010572554543614388, + "std": 1.316596269607544, + "rms": 1.3166385889053345, + "max_abs": 47.0 + }, + "full_input": { + "shape": [ + 207, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "86093fa92c09340482732eae23c07cba3b87af00bb7492000bbe0375ab9e4046", + "mean": -0.016524584963917732, + "std": 6.1568603515625, + "rms": 6.1568827629089355, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "63545da16809d434c99866b51b4ba2abda53fb44d4ae7904f5cc0606c1db91b7", + "mean": -0.010771664790809155, + "std": 1.3218146562576294, + "rms": 1.321858525276184, + "max_abs": 47.25 + }, + "full_input": { + "shape": [ + 191, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0ac9c7f300cde671d3779bb6ed239bac29d3bb27027e894ba542bdeb0f945f99", + "mean": -0.010444315150380135, + "std": 5.273636817932129, + "rms": 5.273647308349609, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "122d4c84ba55c00ac5cb50b406e7dd3bd537f61c3da83a45c8eb922cc24ed335", + "mean": -0.010462393052875996, + "std": 1.322648048400879, + "rms": 1.322689414024353, + "max_abs": 46.75 + }, + "full_input": { + "shape": [ + 207, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "16a4e01a2ea354d36ff702bc598afd7f34bb12e46ba52a6520eedbd4b903cd76", + "mean": -0.010139400139451027, + "std": 5.0774993896484375, + "rms": 5.07750940322876, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "57a8206ce9f90bcef3153d404dd3711a9793f7438a4f02b9a7f2f9d733bf5472", + "mean": -0.010998201556503773, + "std": 1.3303489685058594, + "rms": 1.3303943872451782, + "max_abs": 47.25 + }, + "full_input": { + "shape": [ + 191, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fcbbcc24e52f29f54da3915290c679537c8baeddc4258450fc1ba648e4b2b580", + "mean": -0.010865261778235435, + "std": 5.276626110076904, + "rms": 5.276636600494385, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b743d29c1a56cf6ffa8c2b74aa44c29ea36041bdc4639e1f86ca2e9c4430dae6", + "mean": -0.010926373302936554, + "std": 1.3328888416290283, + "rms": 1.3329335451126099, + "max_abs": 48.0 + }, + "full_input": { + "shape": [ + 207, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1fc21e20414557639b76f25b5249961bef4cdf8f045d711e227a11638a4c6a73", + "mean": -0.010787447914481163, + "std": 5.080623149871826, + "rms": 5.080634117126465, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "35d1109cba70da6478d19ff0a3e4638aa0339a6b0333fb7531be75e183499c3b", + "mean": -0.011051304638385773, + "std": 1.3279966115951538, + "rms": 1.3280425071716309, + "max_abs": 47.0 + }, + "full_input": { + "shape": [ + 191, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8d6d7860499dd176462090ede9fd0fdbb1ce3b46a3d125f1f5f6d365248dee46", + "mean": -0.010724182240664959, + "std": 5.275275707244873, + "rms": 5.275286674499512, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5c0bf14f66fc3b7662a13d74c7cc1138dc1bfc26d8c1b44e20080f5a9e2ee3f9", + "mean": -0.011295639909803867, + "std": 1.3303327560424805, + "rms": 1.3303807973861694, + "max_abs": 47.5 + }, + "full_input": { + "shape": [ + 207, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b3ff1ba9e5047b8c83c1abc28d4dbf5f400ab6ce60a72cacdb1fa6def00cfccf", + "mean": -0.010961390100419521, + "std": 5.079334259033203, + "rms": 5.079345703125, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9950240850448608, + "min_cosine_similarity": 0.9191587567329407, + "mean_relative_l2": 0.09130926430225372, + "max_abs_delta": 3.75 + }, + "system_bos": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9943320751190186, + "min_cosine_similarity": 0.9527982473373413, + "mean_relative_l2": 0.10138897597789764, + "max_abs_delta": 2.375 + }, + "system_x": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9887715578079224, + "min_cosine_similarity": 0.7967665195465088, + "mean_relative_l2": 0.1371321827173233, + "max_abs_delta": 7.125 + }, + "system_period": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9896135330200195, + "min_cosine_similarity": 0.8323458433151245, + "mean_relative_l2": 0.1318705976009369, + "max_abs_delta": 5.5 + }, + "bos_at_s0": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9907916188240051, + "min_cosine_similarity": 0.8015124797821045, + "mean_relative_l2": 0.11911218613386154, + "max_abs_delta": 5.3359375 + }, + "bos_at_s1": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9895890951156616, + "min_cosine_similarity": 0.7665745615959167, + "mean_relative_l2": 0.12866118550300598, + "max_abs_delta": 7.23828125 + }, + "x_at_s0": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9902496337890625, + "min_cosine_similarity": 0.8091665506362915, + "mean_relative_l2": 0.12558679282665253, + "max_abs_delta": 6.375 + }, + "x_at_s1": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9854142665863037, + "min_cosine_similarity": 0.7207702398300171, + "mean_relative_l2": 0.15665511786937714, + "max_abs_delta": 8.0 + }, + "period_at_s0": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9895461797714233, + "min_cosine_similarity": 0.7879803776741028, + "mean_relative_l2": 0.1287519782781601, + "max_abs_delta": 4.125 + }, + "period_at_s1": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.98610919713974, + "min_cosine_similarity": 0.7650275230407715, + "mean_relative_l2": 0.1524585634469986, + "max_abs_delta": 4.390625 + } + } + }, + "layer_22": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "309620dbf0302b3549bcb1c581447f40e4a3768113bb7b0b11cbc8cfe6b2843d", + "mean": -0.008317721076309681, + "std": 1.5042603015899658, + "rms": 1.5042833089828491, + "max_abs": 63.0 + }, + "full_input": { + "shape": [ + 191, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "35755bafc4febf1ddd708640121e18046297e2a8d9bc36350b37df61b75adebe", + "mean": -0.014054781757295132, + "std": 6.255012035369873, + "rms": 6.255027770996094, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "52dcc86d163e2b6b3e4fdfbd4b3d6a6d44f7db4a4859c89f610c8fc950981547", + "mean": -0.009003478102385998, + "std": 1.501258373260498, + "rms": 1.5012853145599365, + "max_abs": 62.75 + }, + "full_input": { + "shape": [ + 207, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1419c967dd5d6144baac36a1d0f96b1d2a28f97dc0a308a20aba41202e3e5cfc", + "mean": -0.015426103956997395, + "std": 6.201620578765869, + "rms": 6.201639652252197, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c074787e124178861a39451e13af56ba77ab7b6e1d83f0b713aed304fa9e26fc", + "mean": -0.009998458437621593, + "std": 1.5060160160064697, + "rms": 1.5060491561889648, + "max_abs": 63.0 + }, + "full_input": { + "shape": [ + 191, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "439dd2c877f0fa3db3a01dfb604a7439ba466040dc9c13426b27fce7ad694ecc", + "mean": -0.009799284860491753, + "std": 5.322103977203369, + "rms": 5.322112560272217, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "040fc5e7e2da527893e1bfdac4ffa43fc5848dc55b5978cc380222c4cc02b53f", + "mean": -0.00917067565023899, + "std": 1.5048030614852905, + "rms": 1.5048309564590454, + "max_abs": 62.5 + }, + "full_input": { + "shape": [ + 207, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d6c201e3a81b007ade327b94269184a643d8362e5c6d310ad412be7b92c7db5a", + "mean": -0.009257553145289421, + "std": 5.131374359130859, + "rms": 5.131382942199707, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "959a8749baea6694c8558e66fe2d08dbd791decdf92c59ea47f2af8a0f100d05", + "mean": -0.01011507399380207, + "std": 1.5175378322601318, + "rms": 1.5175714492797852, + "max_abs": 63.0 + }, + "full_input": { + "shape": [ + 191, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "70011727dda78053f54160ec91b62de8848efcbe2cca28aaefa40e88e8dcc1eb", + "mean": -0.010218285955488682, + "std": 5.3265156745910645, + "rms": 5.3265252113342285, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fee003005011e7e425a9696606eac6704983ccf58151fb34c353985c854076ba", + "mean": -0.009691947139799595, + "std": 1.5189766883850098, + "rms": 1.519007682800293, + "max_abs": 64.0 + }, + "full_input": { + "shape": [ + 207, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "db28516176982c1d8dbdf38f7dd3114577424b9409de824a2bcd93603e36ac1a", + "mean": -0.009904339909553528, + "std": 5.136153221130371, + "rms": 5.136162757873535, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f60bccf4a4f66d5e1dc4b7a75180ddbac8177206f543092cbc122383e2eda26a", + "mean": -0.009860868565738201, + "std": 1.5137169361114502, + "rms": 1.513749122619629, + "max_abs": 63.0 + }, + "full_input": { + "shape": [ + 191, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8594f0453f05a3c2c83d09f75b04cbda2b30f839bab23382e4e425dfb9795a3e", + "mean": -0.00985779520124197, + "std": 5.324344158172607, + "rms": 5.324353218078613, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7e1fd5a7586bbd1461a3b2d3f0feba0e5da6848e6cadaebdc930d703c5b1568b", + "mean": -0.010212874971330166, + "std": 1.5157452821731567, + "rms": 1.5157796144485474, + "max_abs": 63.75 + }, + "full_input": { + "shape": [ + 207, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6d20d91865292a7c385c54b0f9e9a33c38591b5c848b0521c53aa3ee275c18ad", + "mean": -0.01018050592392683, + "std": 5.134383201599121, + "rms": 5.134393215179443, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9946370124816895, + "min_cosine_similarity": 0.9056744575500488, + "mean_relative_l2": 0.09329602867364883, + "max_abs_delta": 3.625 + }, + "system_bos": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9938313961029053, + "min_cosine_similarity": 0.9360103607177734, + "mean_relative_l2": 0.10430192202329636, + "max_abs_delta": 3.125 + }, + "system_x": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9883115887641907, + "min_cosine_similarity": 0.803712785243988, + "mean_relative_l2": 0.13920308649539948, + "max_abs_delta": 7.75 + }, + "system_period": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9889051914215088, + "min_cosine_similarity": 0.8365955352783203, + "mean_relative_l2": 0.13479727506637573, + "max_abs_delta": 6.5 + }, + "bos_at_s0": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9900331497192383, + "min_cosine_similarity": 0.7709226608276367, + "mean_relative_l2": 0.12166646122932434, + "max_abs_delta": 5.046875 + }, + "bos_at_s1": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9890437126159668, + "min_cosine_similarity": 0.7533285617828369, + "mean_relative_l2": 0.13021475076675415, + "max_abs_delta": 7.623046875 + }, + "x_at_s0": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.989854097366333, + "min_cosine_similarity": 0.7946691513061523, + "mean_relative_l2": 0.12717948853969574, + "max_abs_delta": 6.125 + }, + "x_at_s1": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9850448966026306, + "min_cosine_similarity": 0.7124488949775696, + "mean_relative_l2": 0.15784195065498352, + "max_abs_delta": 7.625 + }, + "period_at_s0": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.989044725894928, + "min_cosine_similarity": 0.7811382412910461, + "mean_relative_l2": 0.13094452023506165, + "max_abs_delta": 3.875 + }, + "period_at_s1": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9857050180435181, + "min_cosine_similarity": 0.7451325058937073, + "mean_relative_l2": 0.1533811241388321, + "max_abs_delta": 5.0 + } + } + }, + "layer_23": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "32d16b315e67f2b654c8e649d1b56b790480ea1bbd624a5f24b56586f6316e4f", + "mean": -0.01423864345997572, + "std": 1.9083178043365479, + "rms": 1.9083707332611084, + "max_abs": 92.0 + }, + "full_input": { + "shape": [ + 191, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c2874c3215f397da93f19c2add8f770fba5281159fe8ec66be8eb807d5dfc0c3", + "mean": -0.01905077137053013, + "std": 6.3357648849487305, + "rms": 6.335793495178223, + "max_abs": 1160.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3f809135137ae57a39923c1cc7fbadf79b2169c828731f787e8c8b295b4cab29", + "mean": -0.01515968143939972, + "std": 1.9079114198684692, + "rms": 1.9079716205596924, + "max_abs": 92.5 + }, + "full_input": { + "shape": [ + 207, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "06c92152c8ce160c872ed79a228106c4d8ffbc6e2fce83c410ba30b9468c4cb7", + "mean": -0.019516052678227425, + "std": 6.2859272956848145, + "rms": 6.285957336425781, + "max_abs": 1160.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "577ebe7ce40a98f6551ba3d2ecb3e5f4b1929e03f0992249993353c8d16782f1", + "mean": -0.016242507845163345, + "std": 1.9050971269607544, + "rms": 1.9051663875579834, + "max_abs": 91.0 + }, + "full_input": { + "shape": [ + 191, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "854496a1971e03b9c1675a2acfbe28fbf275662f650c2d033da4c118c11d92c4", + "mean": -0.01505021657794714, + "std": 5.4227142333984375, + "rms": 5.422735214233398, + "max_abs": 1160.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c87e913fb279d408a28459d30331952fc84248b9177b7fbacfecd7ccf48e2c9e", + "mean": -0.014676795341074467, + "std": 1.9049118757247925, + "rms": 1.904968500137329, + "max_abs": 91.5 + }, + "full_input": { + "shape": [ + 207, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4e1730c3a5a0f97b643b2c84ad98f638b6445da8a27aa0a56e2a11d083595d21", + "mean": -0.012813231907784939, + "std": 5.240945816040039, + "rms": 5.240962028503418, + "max_abs": 1160.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "04cbb8c52ff6e1685bfb06fe612047046de4d7139383f30909c4156da3138f2d", + "mean": -0.0162147618830204, + "std": 1.92478346824646, + "rms": 1.9248517751693726, + "max_abs": 92.5 + }, + "full_input": { + "shape": [ + 191, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8d50c2c1e1142bfe35572813b22ce04c4e96a464c9665536276d316990ae2fb3", + "mean": -0.015244293957948685, + "std": 5.431538105010986, + "rms": 5.431559085845947, + "max_abs": 1160.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "caebe3873d87b8bafa0ba5549c1b62359c997a0a9d0e44eeb199dda94dd5a3f5", + "mean": -0.015436625108122826, + "std": 1.9263948202133179, + "rms": 1.9264565706253052, + "max_abs": 93.0 + }, + "full_input": { + "shape": [ + 207, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8b49295d1f8ac2048b9e5630dd7fc01c6ce3600eefa1bb54b376eae11796e379", + "mean": -0.013664490543305874, + "std": 5.250099182128906, + "rms": 5.25011682510376, + "max_abs": 1160.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "65b03cfe58f5eb91e54b5209d2f215a1c498f5886ef1f17b69defe9aaa979c1b", + "mean": -0.016037678346037865, + "std": 1.9170156717300415, + "rms": 1.917082667350769, + "max_abs": 92.0 + }, + "full_input": { + "shape": [ + 191, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "22831e583917a62df89226f8e687850ec83b3b332619aedef30e8c41f5644771", + "mean": -0.01512974128127098, + "std": 5.4270920753479, + "rms": 5.427112579345703, + "max_abs": 1160.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ba10b4bcd0e458a4e4cb565394f71e3a48e1e07c4f4720e4a82d85b292aac74a", + "mean": -0.015753421932458878, + "std": 1.9213792085647583, + "rms": 1.9214435815811157, + "max_abs": 93.0 + }, + "full_input": { + "shape": [ + 207, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2412b9fa33593b645ee3d4c200f35bc4f016c3b6cd8cb75c01d112883981f64a", + "mean": -0.013842432759702206, + "std": 5.246911525726318, + "rms": 5.246930122375488, + "max_abs": 1160.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9953533411026001, + "min_cosine_similarity": 0.9073652029037476, + "mean_relative_l2": 0.08615337312221527, + "max_abs_delta": 7.0 + }, + "system_bos": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9945972561836243, + "min_cosine_similarity": 0.9346668720245361, + "mean_relative_l2": 0.09698827564716339, + "max_abs_delta": 8.25 + }, + "system_x": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.99013352394104, + "min_cosine_similarity": 0.8331593871116638, + "mean_relative_l2": 0.12733763456344604, + "max_abs_delta": 12.25 + }, + "system_period": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.99033123254776, + "min_cosine_similarity": 0.8457823991775513, + "mean_relative_l2": 0.12487386167049408, + "max_abs_delta": 8.0 + }, + "bos_at_s0": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9913849234580994, + "min_cosine_similarity": 0.7943363785743713, + "mean_relative_l2": 0.11202975362539291, + "max_abs_delta": 5.75 + }, + "bos_at_s1": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9906273484230042, + "min_cosine_similarity": 0.7788833975791931, + "mean_relative_l2": 0.11986352503299713, + "max_abs_delta": 9.0625 + }, + "x_at_s0": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9913532137870789, + "min_cosine_similarity": 0.826556921005249, + "mean_relative_l2": 0.11732079833745956, + "max_abs_delta": 10.0 + }, + "x_at_s1": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9873396158218384, + "min_cosine_similarity": 0.7644997835159302, + "mean_relative_l2": 0.14538007974624634, + "max_abs_delta": 13.75 + }, + "period_at_s0": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9905834197998047, + "min_cosine_similarity": 0.8090097904205322, + "mean_relative_l2": 0.1210184320807457, + "max_abs_delta": 9.5 + }, + "period_at_s1": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9876745939254761, + "min_cosine_similarity": 0.7772510647773743, + "mean_relative_l2": 0.14169681072235107, + "max_abs_delta": 7.75 + } + } + }, + "layer_24": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5a8d5c8f622136e4d0e578dc9c4b34a372ce40fd83adba384f1026129818e8dd", + "mean": -0.025014856830239296, + "std": 2.3605613708496094, + "rms": 2.360694169998169, + "max_abs": 112.0 + }, + "full_input": { + "shape": [ + 191, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9ca82c6a00a43c4a4315ec08df753ee39d41e4ceadfbae7d46f8300b4c2afc7c", + "mean": -0.02921263501048088, + "std": 6.098196983337402, + "rms": 6.098267078399658, + "max_abs": 1008.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "832497476b74124326d69705be018d222a8afc717d4261e3fdfc3a6d91169d2b", + "mean": -0.025935543701052666, + "std": 2.3587472438812256, + "rms": 2.3588898181915283, + "max_abs": 112.0 + }, + "full_input": { + "shape": [ + 207, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a06699c26a6f84b39a89a4e8ecb50dfdc0b7e3058efa8c4f55ce1879ce2b768b", + "mean": -0.02863675355911255, + "std": 6.230261325836182, + "rms": 6.230327129364014, + "max_abs": 1120.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a230f8bea0a1e2504110e594002d5205e6bfa25822a609bc0f1410590dd2ea62", + "mean": -0.027137691155076027, + "std": 2.3560233116149902, + "rms": 2.356179714202881, + "max_abs": 111.0 + }, + "full_input": { + "shape": [ + 191, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3436a20cf5d521b54a51f5b250f2ed12cb19f5a373053b1e4f84055861e530fe", + "mean": -0.024503787979483604, + "std": 4.159430027008057, + "rms": 4.159502029418945, + "max_abs": 840.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ac4bac1e3969556be565aadb45304702a4e2918ab7ac3d68ca6ddc8e88deb1d6", + "mean": -0.026089582592248917, + "std": 2.3565351963043213, + "rms": 2.3566794395446777, + "max_abs": 111.5 + }, + "full_input": { + "shape": [ + 207, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "05787c38fe30a751494da679c920ec827af8d06aa6e3c0be0c770074bce5b8f8", + "mean": -0.02167026326060295, + "std": 4.072795867919922, + "rms": 4.072854042053223, + "max_abs": 840.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bef93a9571bf12dd1ad15eb5e6d636ece14e0288bc0e62d9411b05af9ae084c8", + "mean": -0.027398256585001945, + "std": 2.3796699047088623, + "rms": 2.3798277378082275, + "max_abs": 112.0 + }, + "full_input": { + "shape": [ + 191, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8e9b8bd96bb125a641543fd08a1080412b7ed0ee26ae5f754aafea4a4db01e4a", + "mean": -0.025002749636769295, + "std": 4.176080703735352, + "rms": 4.1761555671691895, + "max_abs": 840.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0d5ea9161bb15b233710500814acb64ab07858a1d93aeb073df2ee3801a0b757", + "mean": -0.026731887832283974, + "std": 2.380951166152954, + "rms": 2.381101131439209, + "max_abs": 114.0 + }, + "full_input": { + "shape": [ + 207, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f5a0bcca70e89a583e36c23198d8065edc6800dd47fad853bea103d82aa5b6aa", + "mean": -0.02258593775331974, + "std": 4.089608669281006, + "rms": 4.0896711349487305, + "max_abs": 840.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "549f68916d53eef591f8eb602b93d8a3255b33202f877fc0f84fa4014164c307", + "mean": -0.027296077460050583, + "std": 2.371114730834961, + "rms": 2.3712716102600098, + "max_abs": 111.0 + }, + "full_input": { + "shape": [ + 191, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "46692341155e9a836f65fbd74b2c35283bfbad76246596657612eb3401011c43", + "mean": -0.02487226575613022, + "std": 4.168726921081543, + "rms": 4.168801307678223, + "max_abs": 840.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "478de3d2df923a9cca510592c1685f990831f2c84a5bf3b7ae6bc9a3576fc8b8", + "mean": -0.027279334142804146, + "std": 2.375635862350464, + "rms": 2.3757925033569336, + "max_abs": 113.5 + }, + "full_input": { + "shape": [ + 207, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "074d85da58a1fefa9bd34507452b8c541c80939754b4715c8e972f62179c0dc8", + "mean": -0.022782813757658005, + "std": 4.083986282348633, + "rms": 4.084050178527832, + "max_abs": 840.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9960311651229858, + "min_cosine_similarity": 0.9059139490127563, + "mean_relative_l2": 0.07855089008808136, + "max_abs_delta": 9.0 + }, + "system_bos": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9954252243041992, + "min_cosine_similarity": 0.9359561800956726, + "mean_relative_l2": 0.08836019039154053, + "max_abs_delta": 9.5 + }, + "system_x": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9914979338645935, + "min_cosine_similarity": 0.8325155377388, + "mean_relative_l2": 0.1160585805773735, + "max_abs_delta": 14.875 + }, + "system_period": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9917002320289612, + "min_cosine_similarity": 0.845373272895813, + "mean_relative_l2": 0.11370695382356644, + "max_abs_delta": 9.0 + }, + "bos_at_s0": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9927395582199097, + "min_cosine_similarity": 0.8216480612754822, + "mean_relative_l2": 0.10182363539934158, + "max_abs_delta": 6.90625 + }, + "bos_at_s1": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9921961426734924, + "min_cosine_similarity": 0.8070507645606995, + "mean_relative_l2": 0.10883789509534836, + "max_abs_delta": 9.32421875 + }, + "x_at_s0": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9926486015319824, + "min_cosine_similarity": 0.8389967083930969, + "mean_relative_l2": 0.10730098932981491, + "max_abs_delta": 12.25 + }, + "x_at_s1": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9893032908439636, + "min_cosine_similarity": 0.7804325222969055, + "mean_relative_l2": 0.13245564699172974, + "max_abs_delta": 15.75 + }, + "period_at_s0": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9919645190238953, + "min_cosine_similarity": 0.823904275894165, + "mean_relative_l2": 0.11075927317142487, + "max_abs_delta": 10.5 + }, + "period_at_s1": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.989557683467865, + "min_cosine_similarity": 0.7851435542106628, + "mean_relative_l2": 0.12901155650615692, + "max_abs_delta": 9.25 + } + } + }, + "layer_25": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "347239b0622c0ed0e339b05f3014a18778c6ce78e23bca578add062c3d82d158", + "mean": -0.05991430580615997, + "std": 3.294149875640869, + "rms": 3.2946949005126953, + "max_abs": 156.0 + }, + "full_input": { + "shape": [ + 191, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3510c2b042ca1d3a251b98c34e9bed53b027527db0412a049e8256018e0cb0e3", + "mean": -0.06119316816329956, + "std": 5.249830722808838, + "rms": 5.250187397003174, + "max_abs": 872.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3e1195553005b4668dd18831727e18a4b0d328059687884e43034286ad9c0e3f", + "mean": -0.05912187695503235, + "std": 3.2918779850006104, + "rms": 3.2924091815948486, + "max_abs": 156.0 + }, + "full_input": { + "shape": [ + 207, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "72e9c878e06cc5a94b676344da09a30bc6438ef3f18b093aff2aa7a7a79c2bfa", + "mean": -0.05780871585011482, + "std": 5.458672523498535, + "rms": 5.458978652954102, + "max_abs": 984.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7b3f5b16c4bbe069073d4d2d24fbb67cd1780b9d941f5e2cba96decf8d5df159", + "mean": -0.06303270161151886, + "std": 3.2880072593688965, + "rms": 3.28861141204834, + "max_abs": 154.0 + }, + "full_input": { + "shape": [ + 191, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4925289fd6206adf346c44a94d7e9f3f179dce3151ff241de8b2a4d816c5a06b", + "mean": -0.056901197880506516, + "std": 3.4280853271484375, + "rms": 3.4285573959350586, + "max_abs": 248.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1b087faa0fa7406a3706febdd355f39fce3e433c43f168c91b43f06485e0eb7f", + "mean": -0.06073499098420143, + "std": 3.2899463176727295, + "rms": 3.2905068397521973, + "max_abs": 155.0 + }, + "full_input": { + "shape": [ + 207, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "274bbaea818b3f3a499ab42e874e73ba8d01394a76a2b0af9ea6ad6b2e274859", + "mean": -0.0514616034924984, + "std": 3.4542176723480225, + "rms": 3.4546010494232178, + "max_abs": 248.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1dd2a45cd63c86beb0434c4a26463117d806bc48f4a0ebd78dfc2fae05700b33", + "mean": -0.06368144601583481, + "std": 3.319416046142578, + "rms": 3.3200266361236572, + "max_abs": 156.0 + }, + "full_input": { + "shape": [ + 191, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2148f185e298bcee45900c0d24d73257efc0166edb4dfdf386e2f48b7cd16bb3", + "mean": -0.058126214891672134, + "std": 3.467114210128784, + "rms": 3.4676012992858887, + "max_abs": 248.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "13dd692e372d11a7b54afcf84cd370ab2792a11dad447ba662a57b7b6bfd8a1d", + "mean": -0.060436736792325974, + "std": 3.3209197521209717, + "rms": 3.321469783782959, + "max_abs": 159.0 + }, + "full_input": { + "shape": [ + 207, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bb40f21286d1675c21f0a6335ad881ece366826c7afeaba80f4f750428a6b4ba", + "mean": -0.051499057561159134, + "std": 3.489886522293091, + "rms": 3.4902665615081787, + "max_abs": 248.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6d945f0429853c7fe73e151598251e8de3e623746cae3ae921102619a85fe7df", + "mean": -0.06307926774024963, + "std": 3.307201862335205, + "rms": 3.307803153991699, + "max_abs": 156.0 + }, + "full_input": { + "shape": [ + 191, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "560e8094dbf0cc952b943e07875992add11cb7d83e7cfb4e12b0b0247df6581f", + "mean": -0.05728160962462425, + "std": 3.450122833251953, + "rms": 3.4505982398986816, + "max_abs": 248.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fb065dd062e1b99d78b368cbf917afe832bd5c45a9ea39343c9fa7beab23ca8a", + "mean": -0.0614151731133461, + "std": 3.3103997707366943, + "rms": 3.310969352722168, + "max_abs": 158.0 + }, + "full_input": { + "shape": [ + 207, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8f2be6f4a164e07c466bea7f617ab22ec0ef224d7aa9bbcdbee2ebe01f3980fb", + "mean": -0.051915038377046585, + "std": 3.474508762359619, + "rms": 3.4748966693878174, + "max_abs": 248.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9971156120300293, + "min_cosine_similarity": 0.9219872951507568, + "mean_relative_l2": 0.06589993834495544, + "max_abs_delta": 21.5 + }, + "system_bos": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9967198967933655, + "min_cosine_similarity": 0.942978024482727, + "mean_relative_l2": 0.07444307953119278, + "max_abs_delta": 17.0 + }, + "system_x": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9936404228210449, + "min_cosine_similarity": 0.8772534132003784, + "mean_relative_l2": 0.09877914935350418, + "max_abs_delta": 32.75 + }, + "system_period": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9938440918922424, + "min_cosine_similarity": 0.8870720267295837, + "mean_relative_l2": 0.09686804562807083, + "max_abs_delta": 19.5 + }, + "bos_at_s0": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9951416254043579, + "min_cosine_similarity": 0.8692431449890137, + "mean_relative_l2": 0.08301039040088654, + "max_abs_delta": 17.0 + }, + "bos_at_s1": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9948364496231079, + "min_cosine_similarity": 0.8574255704879761, + "mean_relative_l2": 0.0885712206363678, + "max_abs_delta": 18.0 + }, + "x_at_s0": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9951594471931458, + "min_cosine_similarity": 0.8859909772872925, + "mean_relative_l2": 0.08716568350791931, + "max_abs_delta": 17.0 + }, + "x_at_s1": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9929159879684448, + "min_cosine_similarity": 0.8438965082168579, + "mean_relative_l2": 0.10750669240951538, + "max_abs_delta": 25.5 + }, + "period_at_s0": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.994743824005127, + "min_cosine_similarity": 0.87750244140625, + "mean_relative_l2": 0.08950729668140411, + "max_abs_delta": 13.5 + }, + "period_at_s1": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9930915236473083, + "min_cosine_similarity": 0.8441163301467896, + "mean_relative_l2": 0.10433642566204071, + "max_abs_delta": 16.0 + } + } + }, + "layer_26": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "084ba173564b760f63d00350402e714f010f6118535e248abce96e0080f073fd", + "mean": -0.09795445203781128, + "std": 3.9311869144439697, + "rms": 3.9324071407318115, + "max_abs": 210.0 + }, + "full_input": { + "shape": [ + 191, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9373a782801ba4c6c836f5e71f3daf87752d2f48843c106d3d84dd41aba292e5", + "mean": -0.09833060204982758, + "std": 5.6653571128845215, + "rms": 5.666210174560547, + "max_abs": 840.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bdc8983d42249b06190191bf65f2bd4f5a213dd710cb8e664908c75e78829b7d", + "mean": -0.0943726897239685, + "std": 3.9012458324432373, + "rms": 3.9023871421813965, + "max_abs": 204.0 + }, + "full_input": { + "shape": [ + 207, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5ae5006fbebfd85f7a335ccc25aa243b11c23cc70e42ea73e179e86b9441d78f", + "mean": -0.08737306296825409, + "std": 5.854646682739258, + "rms": 5.8552985191345215, + "max_abs": 868.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e6b508757eef8eacfe810d272ab11d4c0c194b6dce27c7145c5a69cf9beaeb6e", + "mean": -0.10129088908433914, + "std": 3.907221794128418, + "rms": 3.908534526824951, + "max_abs": 216.0 + }, + "full_input": { + "shape": [ + 191, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f77568c35b06937fc6f24a51ea3162a1c7fd690af14b131054f86c37d4053b9d", + "mean": -0.09320476651191711, + "std": 4.29544734954834, + "rms": 4.2964582443237305, + "max_abs": 772.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1d346aabd1486e194e31e38dbc3df9394c7cb79e83243f0071d09fcd5e549e9c", + "mean": -0.09621002525091171, + "std": 3.916591167449951, + "rms": 3.9177727699279785, + "max_abs": 219.0 + }, + "full_input": { + "shape": [ + 207, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8b12a21482557cacd745ae1d037b9ed6da55a92b026f069c2c698ca0795d989a", + "mean": -0.08015232533216476, + "std": 4.4081268310546875, + "rms": 4.408855438232422, + "max_abs": 772.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "511a77c98447f59294e7bb7de0156884119801449045ed35e3d9f662cca43325", + "mean": -0.10388246923685074, + "std": 3.973973035812378, + "rms": 3.9753308296203613, + "max_abs": 210.0 + }, + "full_input": { + "shape": [ + 191, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "efa0f6a43c97c3f75d210d162931d88b106ff3298e968adf6616aab4a10afecc", + "mean": -0.09647905826568604, + "std": 4.369853496551514, + "rms": 4.370918273925781, + "max_abs": 772.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3818747bbce3e843d88f7a647d1d1e426bf2a925398cd26236a66bc603eb7ba6", + "mean": -0.09534141421318054, + "std": 3.9337198734283447, + "rms": 3.934875011444092, + "max_abs": 208.0 + }, + "full_input": { + "shape": [ + 207, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e5d2d9b9b10c8892fedde8bbc82313d3e72d99d9b3a13c6afc0d3ddadee800ab", + "mean": -0.07970137149095535, + "std": 4.428462505340576, + "rms": 4.429179668426514, + "max_abs": 772.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "69079f968fd8df0d9e3c438b7e2634adca17204346df6227465023f2e857e579", + "mean": -0.10299796611070633, + "std": 3.9456827640533447, + "rms": 3.9470267295837402, + "max_abs": 206.0 + }, + "full_input": { + "shape": [ + 191, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d811825e8c7f201586ae87ec8f8fba523b12aab6f7dd95773a66adc992ae90a0", + "mean": -0.0952318012714386, + "std": 4.334572792053223, + "rms": 4.335618495941162, + "max_abs": 772.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "997baafc1cc61ffca48b160c029dd70059564a4c98d426d13207c5ccc097f371", + "mean": -0.09607645869255066, + "std": 3.905357837677002, + "rms": 3.9065394401550293, + "max_abs": 210.0 + }, + "full_input": { + "shape": [ + 207, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "780152b849d986445f29da42661b24131fc4db7eaafa2dc06c001f9c25bb4d0d", + "mean": -0.07994632422924042, + "std": 4.389400482177734, + "rms": 4.390128135681152, + "max_abs": 772.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9961990118026733, + "min_cosine_similarity": 0.877068281173706, + "mean_relative_l2": 0.07400589436292648, + "max_abs_delta": 44.0 + }, + "system_bos": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9957569241523743, + "min_cosine_similarity": 0.9007121920585632, + "mean_relative_l2": 0.08561338484287262, + "max_abs_delta": 66.25 + }, + "system_x": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9911648035049438, + "min_cosine_similarity": 0.8203883767127991, + "mean_relative_l2": 0.11516609787940979, + "max_abs_delta": 56.25 + }, + "system_period": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9913867712020874, + "min_cosine_similarity": 0.8203397393226624, + "mean_relative_l2": 0.11158061027526855, + "max_abs_delta": 35.0 + }, + "bos_at_s0": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9948522448539734, + "min_cosine_similarity": 0.8349138498306274, + "mean_relative_l2": 0.0860966369509697, + "max_abs_delta": 42.75 + }, + "bos_at_s1": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9944119453430176, + "min_cosine_similarity": 0.7930562496185303, + "mean_relative_l2": 0.09579098224639893, + "max_abs_delta": 68.0 + }, + "x_at_s0": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9950240850448608, + "min_cosine_similarity": 0.8480580449104309, + "mean_relative_l2": 0.08930160105228424, + "max_abs_delta": 40.75 + }, + "x_at_s1": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9926846027374268, + "min_cosine_similarity": 0.777983546257019, + "mean_relative_l2": 0.1110641285777092, + "max_abs_delta": 50.0 + }, + "period_at_s0": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9944776296615601, + "min_cosine_similarity": 0.8275623321533203, + "mean_relative_l2": 0.09181112796068192, + "max_abs_delta": 41.75 + }, + "period_at_s1": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9928320646286011, + "min_cosine_similarity": 0.7691435217857361, + "mean_relative_l2": 0.10493471473455429, + "max_abs_delta": 27.0 + } + } + }, + "final_norm": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "478f747f46fbc3ee0f0f9637e2acaecef736efe8d88561d8d84c47f4430dab6f", + "mean": -0.015239916741847992, + "std": 0.6601940989494324, + "rms": 0.6603699922561646, + "max_abs": 26.875 + }, + "full_input": { + "shape": [ + 191, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8ed64ee5fa277abe66a26c7da6444eec34ec7f21b01f97da9c22c6f5489618a8", + "mean": -0.013864930719137192, + "std": 0.65309077501297, + "rms": 0.6532379388809204, + "max_abs": 26.875 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5c28d94c0532adb04f0f021b5515d391aa619d12318d9203b45aef1ffe1c2097", + "mean": -0.014630635268986225, + "std": 0.651890218257904, + "rms": 0.6520544290542603, + "max_abs": 27.125 + }, + "full_input": { + "shape": [ + 207, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c82d37b997e9c8eaec2df4334a979ff445a0a4b6e937c51f56d6b56a032b1b59", + "mean": -0.011845408007502556, + "std": 0.6343142986297607, + "rms": 0.6344248652458191, + "max_abs": 27.125 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e6453db406582d3a5f29362f6123a0ca1184a58d02c2a010e3d0ee8e255a1c85", + "mean": -0.016072919592261314, + "std": 0.6682398319244385, + "rms": 0.6684330701828003, + "max_abs": 27.375 + }, + "full_input": { + "shape": [ + 191, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1445bd85966957769584da4f25819f633c8e90a96e26bac379d24b3d28ac3d9f", + "mean": -0.014438514597713947, + "std": 0.6607347726821899, + "rms": 0.6608924865722656, + "max_abs": 27.375 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8ca43d64fbf663c57b8d443f4fad884218aa3c8c177b47ea2d2b5b79c137aa3d", + "mean": -0.015034244395792484, + "std": 0.6571108102798462, + "rms": 0.6572827100753784, + "max_abs": 27.125 + }, + "full_input": { + "shape": [ + 207, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a3ac37c1ae5d7a541fbf8e7a98783fda6fed9c73a916616d479930ebfeceeb48", + "mean": -0.012031330727040768, + "std": 0.6388821601867676, + "rms": 0.6389954686164856, + "max_abs": 27.125 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ac6a2e416b24fed8618e655a763a3e92dc177fc0c85ecb9f3f8d318896510fee", + "mean": -0.016202930361032486, + "std": 0.6669421792030334, + "rms": 0.6671389937400818, + "max_abs": 27.125 + }, + "full_input": { + "shape": [ + 191, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ef7c12998f1db72dc5f9d007bd7a3a026d7db2781221e59749f988e3ca52b3a3", + "mean": -0.014679711312055588, + "std": 0.6583166718482971, + "rms": 0.6584802865982056, + "max_abs": 27.125 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fbf131d0fb0d457a028878a51f75811c8848b96da5ba75f595d5095d03b5fa7f", + "mean": -0.01467401534318924, + "std": 0.6514555811882019, + "rms": 0.6516207456588745, + "max_abs": 27.75 + }, + "full_input": { + "shape": [ + 207, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "303efd3cbd2252967ed8acb00b80a3ca82e94cfbcfd5227d641c8c23fe2d282c", + "mean": -0.011726097203791142, + "std": 0.6323225498199463, + "rms": 0.6324312090873718, + "max_abs": 27.75 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "de57313c22b2eba7d2b20d3e428deb6d9a3d29cf4cff718b773a8ebd75ea3846", + "mean": -0.016172556206583977, + "std": 0.6675847768783569, + "rms": 0.6677806377410889, + "max_abs": 27.375 + }, + "full_input": { + "shape": [ + 191, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e4fc9fbe2df13636cdf7695d5202cda33a610ec2da1bb0cf31990ffa4244cc52", + "mean": -0.01462212111800909, + "std": 0.6596120595932007, + "rms": 0.659774124622345, + "max_abs": 27.375 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 166, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f8859fbef102dc99bae2cff459fc91fc5d43b7b4bfafc39ca44885dc8283a6e0", + "mean": -0.014893172308802605, + "std": 0.6520770192146301, + "rms": 0.6522470712661743, + "max_abs": 27.5 + }, + "full_input": { + "shape": [ + 207, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7703ffe20c9e73e748e12c32b8d4926e5bf8e2a7d5fd1501ebf584cfac1c22f5", + "mean": -0.011830909177660942, + "std": 0.634032666683197, + "rms": 0.634143054485321, + "max_abs": 27.5 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9952326416969299, + "min_cosine_similarity": 0.8427136540412903, + "mean_relative_l2": 0.08103286474943161, + "max_abs_delta": 4.375 + }, + "system_bos": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9951611161231995, + "min_cosine_similarity": 0.908925473690033, + "mean_relative_l2": 0.08803810924291611, + "max_abs_delta": 4.4375 + }, + "system_x": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9896944165229797, + "min_cosine_similarity": 0.8235447406768799, + "mean_relative_l2": 0.12071046233177185, + "max_abs_delta": 4.5625 + }, + "system_period": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9893286824226379, + "min_cosine_similarity": 0.7885647416114807, + "mean_relative_l2": 0.11981981247663498, + "max_abs_delta": 5.90625 + }, + "bos_at_s0": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9937807321548462, + "min_cosine_similarity": 0.8124243021011353, + "mean_relative_l2": 0.09300308674573898, + "max_abs_delta": 3.75 + }, + "bos_at_s1": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9924723505973816, + "min_cosine_similarity": 0.7169622778892517, + "mean_relative_l2": 0.10057966411113739, + "max_abs_delta": 8.125 + }, + "x_at_s0": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9940905570983887, + "min_cosine_similarity": 0.846792459487915, + "mean_relative_l2": 0.09389947354793549, + "max_abs_delta": 5.125 + }, + "x_at_s1": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9901272058486938, + "min_cosine_similarity": 0.7158522605895996, + "mean_relative_l2": 0.11830132454633713, + "max_abs_delta": 3.125 + }, + "period_at_s0": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9934262037277222, + "min_cosine_similarity": 0.8136864900588989, + "mean_relative_l2": 0.09804416447877884, + "max_abs_delta": 4.625 + }, + "period_at_s1": { + "tokens": 166, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9905627369880676, + "min_cosine_similarity": 0.7277560830116272, + "mean_relative_l2": 0.11502669006586075, + "max_abs_delta": 4.0 + } + } + } + }, + "router_layers": { + "layer_01": { + "layer": 1, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "5bf6ca9de06398d65767e02e02a0d1fd255b745f162c0cfbe3ce52cde26a170b", + "route_weight_sha256": "64158e51a4401eeef2f298f01a3e6902b234e6325f21a572897065285db50831", + "loads": [ + 18, + 17, + 11, + 16, + 14, + 25, + 26, + 12, + 15, + 20, + 12, + 16, + 18, + 28, + 9, + 13, + 13, + 22, + 10, + 11, + 12, + 19, + 8, + 17, + 44, + 10, + 4, + 20, + 17, + 23, + 6, + 14, + 15, + 6, + 15, + 27, + 7, + 26, + 14, + 10, + 28, + 17, + 16, + 10, + 17, + 14, + 13, + 16, + 6, + 8, + 6, + 17, + 24, + 20, + 1, + 11, + 9, + 13, + 30, + 20, + 10, + 8, + 17, + 25 + ], + "weighted_loads": [ + 0.895217452198267, + 0.5554175302386284, + 0.5511654429137707, + 1.0578349605202675, + 0.8554329313337803, + 1.545421987771988, + 1.3549789190292358, + 0.2919810339808464, + 0.5430187657475471, + 0.9228251092135906, + 0.6036579478532076, + 0.9015872217714787, + 0.5598793290555477, + 1.5525830313563347, + 0.21389281563460827, + 0.5271146036684513, + 0.4368745293468237, + 1.0256046298891306, + 0.2871317360550165, + 0.27568127773702145, + 0.8833437077701092, + 1.672946134582162, + 0.22735939733684063, + 0.6839062813669443, + 3.366184663027525, + 0.8559425342828035, + 0.19556324183940887, + 1.2708171475678682, + 0.49147288128733635, + 0.7752507217228413, + 0.1491369903087616, + 1.4233028143644333, + 0.8359386250376701, + 0.3774968273937702, + 0.6761255096644163, + 0.9327811021357775, + 0.2649072948843241, + 1.4319112971425056, + 1.0299539137631655, + 0.6251896750181913, + 1.306455323472619, + 0.610951753333211, + 0.7706996835768223, + 0.47417037561535835, + 0.5688222106546164, + 0.5490775424987078, + 0.8615623079240322, + 1.0205048155039549, + 0.21362258307635784, + 0.39836573973298073, + 0.1805442627519369, + 1.8861101604998112, + 1.2151290122419596, + 0.8675944339483976, + 0.02295629307627678, + 0.8593772724270821, + 0.630108742043376, + 0.5275932159274817, + 0.851522533223033, + 0.5496656820178032, + 0.5018770918250084, + 0.3490635082125664, + 1.2102696225047112, + 1.062803028151393 + ], + "unique_experts": 64, + "load_cv": 0.47340182568285677, + "normalized_load_entropy": 0.9735344013785225, + "max_load_share": 0.04417670682730924 + }, + "full_input": { + "tokens": 191, + "top_k": 6, + "decisions": 1146, + "ordered_route_sha256": "45c6e82931d337a0350ddde53f1833c755969be6001a764e2a8f351a062b8681", + "route_weight_sha256": "01ed7c847e0701d90504195dc30f45fb45649e1234422037521cbff83ba9c673", + "loads": [ + 19, + 17, + 13, + 18, + 16, + 25, + 28, + 14, + 32, + 21, + 15, + 16, + 18, + 28, + 10, + 22, + 13, + 24, + 10, + 11, + 15, + 20, + 9, + 17, + 44, + 14, + 16, + 21, + 17, + 24, + 6, + 19, + 17, + 8, + 15, + 27, + 7, + 26, + 14, + 13, + 28, + 27, + 17, + 16, + 18, + 25, + 13, + 17, + 6, + 8, + 8, + 18, + 28, + 20, + 4, + 15, + 14, + 20, + 30, + 31, + 11, + 11, + 17, + 25 + ], + "weighted_loads": [ + 0.9707376919686794, + 0.5554175302386284, + 0.6538412235677242, + 1.1181024312973022, + 0.9070172868669033, + 1.545421987771988, + 1.5198740847408772, + 0.5603765100240707, + 1.4363012854009867, + 0.9450584296137094, + 0.783480491489172, + 0.9015872217714787, + 0.5598793290555477, + 1.5525830313563347, + 0.24047786742448807, + 1.1425078213214874, + 0.4368745293468237, + 1.150995222851634, + 0.2871317360550165, + 0.27568127773702145, + 1.2857134081423283, + 1.6974180657416582, + 0.25751083344221115, + 0.6839062813669443, + 3.366184663027525, + 1.0082304626703262, + 0.983729962259531, + 1.3430849332362413, + 0.49147288128733635, + 0.7998749148100615, + 0.1491369903087616, + 1.8413333180942573, + 0.9739299342036247, + 0.8073678947985172, + 0.6761255096644163, + 0.9327811021357775, + 0.2649072948843241, + 1.4319112971425056, + 1.0299539137631655, + 0.8395974133163691, + 1.306455323472619, + 1.0230335425585508, + 0.7954302411526442, + 0.6074011762684677, + 1.553164904937148, + 1.3700709289405495, + 0.8615623079240322, + 1.0467959586530924, + 0.21362258307635784, + 0.39836573973298073, + 0.2313672248274088, + 1.8867174995830283, + 1.4600477535277605, + 0.8675944339483976, + 0.06814795354148373, + 1.4288260415196419, + 0.9686407595872879, + 0.9375556390732527, + 0.851522533223033, + 1.2661254182457924, + 0.5926240906119347, + 0.4903898984193802, + 1.2102696225047112, + 1.062803028151393 + ], + "unique_experts": 64, + "load_cv": 0.4165988176074821, + "normalized_load_entropy": 0.9792785582360536, + "max_load_share": 0.038394415357766144 + } + }, + "s1_eos": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "df102c7a890b82b3dc01adf3d06aaeb90b4a0dabc1171251cd2709a565e07399", + "route_weight_sha256": "15502a52fce3ade34bf3409353cb7a7e545d91ad2938abb227df37e489eb90a1", + "loads": [ + 18, + 17, + 11, + 18, + 14, + 25, + 25, + 10, + 13, + 20, + 10, + 16, + 15, + 28, + 6, + 13, + 12, + 21, + 11, + 14, + 13, + 19, + 10, + 17, + 45, + 11, + 4, + 19, + 19, + 26, + 8, + 14, + 16, + 10, + 17, + 27, + 6, + 26, + 13, + 9, + 28, + 15, + 16, + 9, + 14, + 12, + 18, + 16, + 8, + 8, + 14, + 18, + 23, + 18, + 0, + 11, + 11, + 13, + 33, + 12, + 10, + 6, + 17, + 20 + ], + "weighted_loads": [ + 0.904315734282136, + 0.5338477920740843, + 0.5606702081859112, + 1.1092580258846283, + 0.8288780227303505, + 1.555240884423256, + 1.3707485981285572, + 0.23994620144367218, + 0.47567328438162804, + 0.9319260194897652, + 0.5633148103952408, + 0.9191724192351103, + 0.47664705477654934, + 1.551700422540307, + 0.14995476976037025, + 0.5363035332411528, + 0.41541643254458904, + 0.9834788553416729, + 0.3000479843467474, + 0.3530374877154827, + 0.9123045764863491, + 1.667077386751771, + 0.2782248090952635, + 0.6868995353579521, + 3.44631627202034, + 0.8670936524868011, + 0.20599648356437683, + 1.2309378869831562, + 0.5467718988656998, + 0.8724440261721611, + 0.2010001689195633, + 1.4259606897830963, + 0.8718209229409695, + 0.5479608029127121, + 0.7488995492458344, + 0.9202959313988686, + 0.2467590495944023, + 1.3907672949135303, + 1.0021296069025993, + 0.5827194638550282, + 1.2779556326568127, + 0.566227737814188, + 0.7701646871864796, + 0.4521498754620552, + 0.47256447933614254, + 0.4769555311650038, + 0.9650160651654005, + 1.0276519693434238, + 0.2568870335817337, + 0.42223289981484413, + 0.42760809883475304, + 1.8792050946503878, + 1.182576209306717, + 0.8292650114744902, + 0.0, + 0.8756673038005829, + 0.7006295341998339, + 0.5011243186891079, + 0.9206644222140312, + 0.33269529789686203, + 0.5028611719608307, + 0.3077998664230108, + 1.2083578184247017, + 0.9524784982204437 + ], + "unique_experts": 63, + "load_cv": 0.47217371482058196, + "normalized_load_entropy": 0.9736549191516691, + "max_load_share": 0.045180722891566265 + }, + "full_input": { + "tokens": 207, + "top_k": 6, + "decisions": 1242, + "ordered_route_sha256": "8eef31e9f2f53577106f8b9ea6b14f6615a4a10f7765e698126ae4452c70c7c6", + "route_weight_sha256": "cb65469047853e289bca60c41142aa886fd1a93b66495574dd97ee397aa2e31e", + "loads": [ + 21, + 17, + 14, + 20, + 19, + 27, + 27, + 13, + 36, + 21, + 16, + 17, + 15, + 29, + 7, + 25, + 12, + 27, + 12, + 15, + 16, + 23, + 15, + 18, + 47, + 15, + 22, + 21, + 19, + 28, + 9, + 21, + 18, + 12, + 17, + 27, + 7, + 27, + 13, + 14, + 28, + 27, + 19, + 16, + 16, + 23, + 18, + 20, + 10, + 8, + 22, + 22, + 28, + 18, + 5, + 15, + 22, + 25, + 35, + 23, + 12, + 10, + 17, + 24 + ], + "weighted_loads": [ + 1.097396893426776, + 0.5338477920740843, + 0.7264307327568531, + 1.170393742620945, + 1.119743026793003, + 1.6926478929817677, + 1.5153623893857002, + 0.4770082700997591, + 1.7872976325452328, + 0.9538901317864656, + 0.9341561142355204, + 1.0631293337792158, + 0.47664705477654934, + 1.591648643836379, + 0.1754627302289009, + 1.2379828412085772, + 0.41541643254458904, + 1.240006534382701, + 0.3393621873110533, + 0.4190234951674938, + 1.2716324888169765, + 1.9216046500951052, + 0.5494135852786712, + 0.7213802188634872, + 3.5180261246860027, + 1.0158493276685476, + 1.4667916502803564, + 1.325226854532957, + 0.5467718988656998, + 1.0351002477109432, + 0.2868741899728775, + 2.0706504228292033, + 0.9964842982590199, + 0.935351237654686, + 0.7488995492458344, + 0.9202959313988686, + 0.5049719735980034, + 1.4244225658476353, + 1.0021296069025993, + 0.9154438003897667, + 1.2779556326568127, + 1.1378076653927565, + 0.9775053653866053, + 0.6741385869681835, + 1.614411136135459, + 1.2442376553663053, + 0.9650160651654005, + 1.135839215334272, + 0.4085946995764971, + 0.42223289981484413, + 0.7805263567715883, + 2.2447544168680906, + 1.4942084215581417, + 0.8292650114744902, + 0.09306681371526793, + 1.4290341436862946, + 1.1925291400402784, + 1.1749026607722044, + 0.9960764981806278, + 1.003775890916586, + 0.618412571027875, + 0.53999631293118, + 1.2083578184247017, + 1.4441414400935173 + ], + "unique_experts": 64, + "load_cv": 0.38461374897350004, + "normalized_load_entropy": 0.9824757179934703, + "max_load_share": 0.03784219001610306 + } + }, + "s0_bos": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "45351ae2a6f0acae61e037862de5e032b1fac51542b4fb6bb4efa77423bf8929", + "route_weight_sha256": "da4ef132188652167e79bb87c838d832fede216873ec4e9a09572e5988f4c8cd", + "loads": [ + 19, + 17, + 11, + 15, + 12, + 24, + 26, + 16, + 12, + 20, + 13, + 20, + 20, + 27, + 12, + 13, + 10, + 21, + 14, + 10, + 11, + 12, + 10, + 20, + 43, + 11, + 5, + 19, + 18, + 29, + 12, + 14, + 17, + 6, + 16, + 20, + 7, + 25, + 11, + 10, + 26, + 13, + 18, + 11, + 20, + 11, + 11, + 17, + 8, + 7, + 13, + 17, + 24, + 19, + 6, + 11, + 8, + 13, + 19, + 13, + 10, + 10, + 17, + 26 + ], + "weighted_loads": [ + 0.9613331500440836, + 0.5344059467315674, + 0.5475089773535728, + 1.016312038525939, + 0.7823058627545834, + 1.396984025835991, + 1.3808399699628353, + 0.3821449540555477, + 0.35538733191788197, + 0.9595254920423031, + 0.6284888871014118, + 1.0112711358815432, + 0.6325870268046856, + 1.6065357197076082, + 0.29157808795571327, + 0.557248555123806, + 0.35830998234450817, + 1.0653512254357338, + 0.4058690778911114, + 0.2481658849865198, + 0.7984145656228065, + 1.4576470870524645, + 0.28710303641855717, + 0.7847805041819811, + 3.315134957432747, + 0.9095930997282267, + 0.21447938680648804, + 1.2904727198183537, + 0.5114468671381474, + 0.9876592643558979, + 0.30614478699862957, + 1.4668704867362976, + 0.9768340289592743, + 0.3670290745794773, + 0.7325308620929718, + 0.7214684803038836, + 0.2607266753911972, + 1.4279280938208103, + 0.9991965647786856, + 0.6109295729547739, + 1.219352349638939, + 0.4657396152615547, + 0.8370084445923567, + 0.4942156709730625, + 0.6723980698734522, + 0.4499516859650612, + 0.8204190190881491, + 1.0407603867352009, + 0.25938984006643295, + 0.39188808389008045, + 0.3580626640468836, + 1.8984448909759521, + 1.2968536764383316, + 0.8186675515025854, + 0.1550604272633791, + 0.8562399856746197, + 0.5868358332663774, + 0.531775338575244, + 0.5687221474945545, + 0.3679011929780245, + 0.4989747926592827, + 0.39338566921651363, + 1.2202191650867462, + 1.0914222691208124 + ], + "unique_experts": 64, + "load_cv": 0.4292306651296937, + "normalized_load_entropy": 0.9793970688581874, + "max_load_share": 0.04317269076305221 + }, + "full_input": { + "tokens": 191, + "top_k": 6, + "decisions": 1146, + "ordered_route_sha256": "fce442af3ecdf654fae27b2b84d1a1364d6a868641f1b219f91d8b99b99d36df", + "route_weight_sha256": "6bcc0ae97c74a3d783c45f75dc1c55787ce0c12a0a823fe2b02ec32df1d1d4b8", + "loads": [ + 21, + 17, + 13, + 17, + 14, + 24, + 28, + 18, + 27, + 21, + 16, + 22, + 20, + 27, + 13, + 22, + 10, + 24, + 14, + 10, + 14, + 13, + 11, + 20, + 43, + 15, + 17, + 20, + 18, + 29, + 12, + 18, + 19, + 8, + 16, + 20, + 7, + 25, + 12, + 13, + 26, + 23, + 20, + 17, + 20, + 21, + 12, + 18, + 8, + 7, + 16, + 17, + 28, + 19, + 8, + 15, + 12, + 21, + 19, + 23, + 12, + 13, + 17, + 26 + ], + "weighted_loads": [ + 1.076993441209197, + 0.5344059467315674, + 0.632629856467247, + 1.0724611338227987, + 0.8338902182877064, + 1.396984025835991, + 1.5456556677818298, + 0.6422063075006008, + 1.1733112502843142, + 0.982517883181572, + 0.8132936432957649, + 1.063400562852621, + 0.6325870268046856, + 1.6065357197076082, + 0.3191727865487337, + 1.1726417727768421, + 0.35830998234450817, + 1.230162512511015, + 0.4058690778911114, + 0.2481658849865198, + 1.1350661739706993, + 1.480843534693122, + 0.3172544725239277, + 0.7847805041819811, + 3.315134957432747, + 1.0678925067186356, + 1.0026461072266102, + 1.352808441966772, + 0.5114468671381474, + 0.9876592643558979, + 0.30614478699862957, + 1.8852852210402489, + 1.1158255860209465, + 0.7563492096960545, + 0.7325308620929718, + 0.7214684803038836, + 0.2607266753911972, + 1.4279280938208103, + 1.0238312259316444, + 0.8300391677767038, + 1.219352349638939, + 0.8778214044868946, + 0.9058957807719707, + 0.6523933839052916, + 0.6723980698734522, + 1.2704441361129284, + 0.84640833735466, + 1.067023403942585, + 0.25938984006643295, + 0.39188808389008045, + 0.42884843051433563, + 1.8984448909759521, + 1.5270482785999775, + 0.8186675515025854, + 0.1998026929795742, + 1.4230716563761234, + 0.9286808725446463, + 1.0187978353351355, + 0.5687221474945545, + 1.0511257592588663, + 0.694751463830471, + 0.5344507526606321, + 1.2202191650867462, + 1.0914222691208124 + ], + "unique_experts": 64, + "load_cv": 0.35659793097084447, + "normalized_load_entropy": 0.9851085761147822, + "max_load_share": 0.037521815008726006 + } + }, + "s1_bos": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "b2730eec39df10ce872105e4e70beaae88e65a031ab1976bab9be96e555ea52c", + "route_weight_sha256": "4476945fbad96c6ba3188d4fe34d469e8d03d51a98e585013ae562c033596a2a", + "loads": [ + 19, + 17, + 12, + 15, + 12, + 24, + 27, + 15, + 8, + 20, + 12, + 19, + 15, + 28, + 7, + 13, + 9, + 19, + 13, + 12, + 11, + 14, + 10, + 19, + 43, + 11, + 9, + 19, + 15, + 29, + 14, + 14, + 15, + 5, + 18, + 20, + 7, + 26, + 12, + 8, + 26, + 17, + 18, + 9, + 23, + 13, + 12, + 19, + 8, + 6, + 19, + 17, + 24, + 15, + 12, + 11, + 8, + 15, + 15, + 9, + 10, + 15, + 17, + 23 + ], + "weighted_loads": [ + 0.9474128745496273, + 0.5223479475826025, + 0.5917460732161999, + 1.0246263947337866, + 0.7785643637180328, + 1.43966830894351, + 1.3426850773394108, + 0.36277214996516705, + 0.24140731245279312, + 0.9577007163316011, + 0.6077270302921534, + 1.003204733133316, + 0.5033722408115864, + 1.6574343256652355, + 0.16391199082136154, + 0.5729136988520622, + 0.34679718501865864, + 0.9309943169355392, + 0.3818700611591339, + 0.2923786584287882, + 0.8049942776560783, + 1.5153011213988066, + 0.28406623005867004, + 0.7619659919291735, + 3.2106638438999653, + 0.9159909673035145, + 0.3723955135792494, + 1.2807130869477987, + 0.43156856670975685, + 0.9954663421958685, + 0.3604787178337574, + 1.4472295194864273, + 0.8084426783025265, + 0.28837738558650017, + 0.7862195950001478, + 0.7084981892257929, + 0.27061690762639046, + 1.3874972816556692, + 1.003214856609702, + 0.5174837317317724, + 1.1476463563740253, + 0.6225044056773186, + 0.8306374177336693, + 0.43887166678905487, + 0.778471577912569, + 0.546166630461812, + 0.8463213760405779, + 1.1018538102507591, + 0.2678591888397932, + 0.37744250521063805, + 0.6312625203281641, + 1.8972326293587685, + 1.293294996023178, + 0.7097633648663759, + 0.29675150103867054, + 0.840043231844902, + 0.5846857689321041, + 0.5553485322743654, + 0.438771678134799, + 0.26265633665025234, + 0.5065044537186623, + 0.5141937993466854, + 1.204317346215248, + 1.0353752449154854 + ], + "unique_experts": 64, + "load_cv": 0.4269701526262577, + "normalized_load_entropy": 0.9796735932064857, + "max_load_share": 0.04317269076305221 + }, + "full_input": { + "tokens": 207, + "top_k": 6, + "decisions": 1242, + "ordered_route_sha256": "2ed31c1bd22acdb410add71629a4ff09afade440e21f4cb8d8d7c2ef5d942de2", + "route_weight_sha256": "4273a7ab9058769c04ab42cea240fbc9aca9df5f340be7532e5f865ee12feebd", + "loads": [ + 23, + 17, + 15, + 18, + 17, + 26, + 29, + 18, + 29, + 21, + 18, + 20, + 15, + 30, + 8, + 25, + 9, + 25, + 14, + 13, + 14, + 17, + 14, + 20, + 45, + 16, + 28, + 21, + 15, + 31, + 15, + 20, + 17, + 7, + 19, + 20, + 8, + 27, + 12, + 13, + 26, + 29, + 23, + 16, + 24, + 23, + 13, + 22, + 10, + 6, + 27, + 21, + 29, + 15, + 16, + 15, + 18, + 28, + 17, + 19, + 13, + 19, + 17, + 27 + ], + "weighted_loads": [ + 1.179913954809308, + 0.5223479475826025, + 0.7444189302623272, + 1.113014828413725, + 1.0694293677806854, + 1.5770753175020218, + 1.48309825360775, + 0.5903919041156769, + 1.4756120089441538, + 0.9798289593309164, + 0.9860576931387186, + 1.1471616476774216, + 0.5033722408115864, + 1.7217621114104986, + 0.18924586661159992, + 1.2745930068194866, + 0.34679718501865864, + 1.1911544185131788, + 0.4211842641234398, + 0.3583646658807993, + 1.0980961695313454, + 1.74350605905056, + 0.5549490470439196, + 0.7964466754347086, + 3.282373696565628, + 1.1025262959301472, + 1.65095822699368, + 1.37208585254848, + 0.43156856670975685, + 1.1581225637346506, + 0.4463527388870716, + 2.0934655591845512, + 0.9314735345542431, + 0.6254826597869396, + 0.8091827016323805, + 0.7084981892257929, + 0.5288298316299915, + 1.4211525525897741, + 1.003214856609702, + 0.8565755877643824, + 1.1476463563740253, + 1.194084333255887, + 1.0996584817767143, + 0.6599601171910763, + 0.9312119968235493, + 1.31298672221601, + 0.8767016939818859, + 1.21026680059731, + 0.4195668548345566, + 0.37744250521063805, + 0.9860636219382286, + 2.2627819515764713, + 1.5872472412884235, + 0.7097633648663759, + 0.38940056413412094, + 1.3830715268850327, + 1.069523148238659, + 1.3026598133146763, + 0.5141837541013956, + 0.8992146831005812, + 0.7245985735207796, + 0.7463395707309246, + 1.204317346215248, + 1.527038186788559 + ], + "unique_experts": 64, + "load_cv": 0.35906212133339355, + "normalized_load_entropy": 0.984635422115496, + "max_load_share": 0.036231884057971016 + } + }, + "s0_x": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "684fc8fa10a293ef4e8fe03413c6f0a4d91b99068fd9c3fc8407403fe192719c", + "route_weight_sha256": "db4ece2f64056419acd04be407e14e2b79c1e673e18b4b13cbfa3e32c7d53231", + "loads": [ + 18, + 17, + 11, + 14, + 12, + 24, + 25, + 14, + 13, + 20, + 12, + 16, + 21, + 27, + 10, + 12, + 11, + 24, + 14, + 14, + 11, + 14, + 11, + 19, + 44, + 11, + 7, + 19, + 20, + 26, + 11, + 14, + 17, + 6, + 14, + 20, + 5, + 25, + 11, + 10, + 26, + 13, + 21, + 13, + 19, + 11, + 11, + 18, + 7, + 7, + 11, + 17, + 23, + 18, + 7, + 11, + 8, + 13, + 24, + 10, + 10, + 10, + 17, + 27 + ], + "weighted_loads": [ + 0.9266686458140612, + 0.5304499194025993, + 0.5488510578870773, + 0.9733520951122046, + 0.7981561049818993, + 1.4774415083229542, + 1.3428716361522675, + 0.33535705506801605, + 0.3933762554079294, + 0.9501067288219929, + 0.602881046012044, + 0.8926869686692953, + 0.6723051145672798, + 1.6102638132870197, + 0.2535746842622757, + 0.5127482302486897, + 0.3747959230095148, + 1.163300359621644, + 0.4002686869353056, + 0.35562591440975666, + 0.7779648527503014, + 1.5086773000657558, + 0.30792274326086044, + 0.7524258233606815, + 3.4535311236977577, + 0.9104156345129013, + 0.2649661172181368, + 1.287206606939435, + 0.5640459153801203, + 0.8901555668562651, + 0.2834269106388092, + 1.525423839688301, + 0.9859632030129433, + 0.37825479730963707, + 0.6740311123430729, + 0.7235129345208406, + 0.21275665052235126, + 1.4554321821779013, + 0.9821833856403828, + 0.6140238866209984, + 1.2384710051119328, + 0.46911686658859253, + 0.9077590443193913, + 0.5413502361625433, + 0.6390189863741398, + 0.4468259643763304, + 0.8226028401404619, + 1.0483659729361534, + 0.24013391509652138, + 0.38441201113164425, + 0.31061647087335587, + 1.9069723561406136, + 1.2387825436890125, + 0.7887877821922302, + 0.1741089280694723, + 0.8696889914572239, + 0.5673535466194153, + 0.5402074232697487, + 0.694392854347825, + 0.2920233737677336, + 0.5000085234642029, + 0.38714805617928505, + 1.2303268052637577, + 1.1230393555015326 + ], + "unique_experts": 64, + "load_cv": 0.4350530321559106, + "normalized_load_entropy": 0.9789733128352894, + "max_load_share": 0.04417670682730924 + }, + "full_input": { + "tokens": 191, + "top_k": 6, + "decisions": 1146, + "ordered_route_sha256": "90ff2844ec8e0a59c582f0ef190b7297aadd52916d846edb82730651c0bfce9d", + "route_weight_sha256": "aec62085de7e017eb1084783c6cff3a046dd6aa3ac54e617dbe00d06d414100a", + "loads": [ + 19, + 17, + 13, + 16, + 14, + 24, + 27, + 17, + 28, + 22, + 15, + 17, + 21, + 27, + 11, + 22, + 11, + 26, + 14, + 14, + 14, + 14, + 13, + 20, + 44, + 15, + 20, + 20, + 20, + 26, + 11, + 18, + 19, + 8, + 14, + 20, + 5, + 25, + 11, + 13, + 26, + 24, + 23, + 19, + 19, + 22, + 11, + 19, + 7, + 7, + 13, + 17, + 27, + 18, + 9, + 15, + 12, + 20, + 24, + 21, + 11, + 13, + 17, + 27 + ], + "weighted_loads": [ + 1.0185357797890902, + 0.5304499194025993, + 0.643471498042345, + 1.0284279752522707, + 0.8497404605150223, + 1.4774415083229542, + 1.5079731829464436, + 0.6349903624504805, + 1.2144006323069334, + 0.9992888737469912, + 0.7871825583279133, + 0.9162002392113209, + 0.6723051145672798, + 1.6102638132870197, + 0.2817578427493572, + 1.2459617853164673, + 0.3747959230095148, + 1.2926951367408037, + 0.4002686869353056, + 0.35562591440975666, + 1.1100099980831146, + 1.5086773000657558, + 0.36897167935967445, + 0.7776662204414606, + 3.4535311236977577, + 1.0734044928103685, + 1.083034936338663, + 1.3536294344812632, + 0.5640459153801203, + 0.8901555668562651, + 0.2834269106388092, + 1.9459887817502022, + 1.1249647960066795, + 0.7736603133380413, + 0.6740311123430729, + 0.7235129345208406, + 0.21275665052235126, + 1.4554321821779013, + 0.9821833856403828, + 0.8577588871121407, + 1.2384710051119328, + 0.9366278275847435, + 0.9578786920756102, + 0.7037128489464521, + 0.6390189863741398, + 1.3010880630463362, + 0.8226028401404619, + 1.0744379572570324, + 0.24013391509652138, + 0.38441201113164425, + 0.3613465577363968, + 1.9069723561406136, + 1.4537761770188808, + 0.7887877821922302, + 0.21885119378566742, + 1.4545485563576221, + 0.7798996474593878, + 0.9419868253171444, + 0.694392854347825, + 1.073374381288886, + 0.5907555222511292, + 0.5262509249150753, + 1.2303268052637577, + 1.1230393555015326 + ], + "unique_experts": 64, + "load_cv": 0.3659057887284315, + "normalized_load_entropy": 0.984203805585452, + "max_load_share": 0.038394415357766144 + } + }, + "s1_x": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "0900498fd0c7da36f9ec231452ee7a98d0217fadc4bdb3d296e5311ec9d0bc69", + "route_weight_sha256": "ba8c9633f5f6d9b895b68a7af29bef6f94f0ae818eeeed658ee949793337781b", + "loads": [ + 18, + 16, + 12, + 15, + 12, + 25, + 25, + 13, + 10, + 19, + 12, + 18, + 14, + 28, + 6, + 13, + 9, + 21, + 12, + 12, + 13, + 14, + 13, + 19, + 43, + 11, + 15, + 19, + 16, + 27, + 13, + 14, + 14, + 5, + 17, + 20, + 4, + 26, + 11, + 9, + 25, + 16, + 20, + 10, + 22, + 13, + 15, + 18, + 6, + 6, + 17, + 17, + 23, + 16, + 12, + 11, + 8, + 16, + 17, + 8, + 10, + 13, + 17, + 27 + ], + "weighted_loads": [ + 0.9153524395078421, + 0.4997305143624544, + 0.5906727835536003, + 1.0092718601226807, + 0.7932509277015924, + 1.5143844410777092, + 1.2361759077757597, + 0.3154654987156391, + 0.28675309754908085, + 0.9292697831988335, + 0.6041437834501266, + 0.9660926219075918, + 0.46571459621191025, + 1.6997880805283785, + 0.14891019277274609, + 0.5671502612531185, + 0.3478383310139179, + 1.0005343053489923, + 0.35344065353274345, + 0.2997899018228054, + 0.8336135316640139, + 1.5235418360680342, + 0.3648535683751106, + 0.7589390948414803, + 3.175177861005068, + 0.9225254580378532, + 0.5355594586580992, + 1.2845148853957653, + 0.45494120940566063, + 0.9265908561646938, + 0.3401961326599121, + 1.4818173870444298, + 0.7559292875230312, + 0.2837861105799675, + 0.7488783895969391, + 0.7085593547672033, + 0.1992310993373394, + 1.398761449381709, + 0.9702335689216852, + 0.5589953381568193, + 1.1447072252631187, + 0.6081573367118835, + 0.8756938632577658, + 0.4616407174617052, + 0.7528154440224171, + 0.5510171763598919, + 0.9126849565654993, + 1.0686527080833912, + 0.22588591277599335, + 0.3727182988077402, + 0.5885785445570946, + 1.8996903970837593, + 1.2489119097590446, + 0.7342216167598963, + 0.29880523309111595, + 0.8401534222066402, + 0.5689383409917355, + 0.5970237869769335, + 0.4923842642456293, + 0.23697110638022423, + 0.5183542147278786, + 0.46435070782899857, + 1.204763513058424, + 1.1292176563292742 + ], + "unique_experts": 64, + "load_cv": 0.42378517850215636, + "normalized_load_entropy": 0.9795948278630146, + "max_load_share": 0.04317269076305221 + }, + "full_input": { + "tokens": 207, + "top_k": 6, + "decisions": 1242, + "ordered_route_sha256": "570e452d14f88d4d76aa2e2410ec1ff88aa5c89e274d05cb5052dbea52b59276", + "route_weight_sha256": "42408ce381aed2bac8dcff44f839047c03f07cbc60fba0ff1d2aaaac810ee170", + "loads": [ + 21, + 16, + 15, + 16, + 17, + 27, + 27, + 17, + 31, + 21, + 18, + 19, + 14, + 30, + 7, + 26, + 9, + 27, + 13, + 13, + 16, + 17, + 17, + 21, + 45, + 16, + 35, + 21, + 16, + 29, + 14, + 20, + 16, + 7, + 17, + 20, + 5, + 27, + 11, + 14, + 25, + 29, + 24, + 17, + 23, + 24, + 16, + 21, + 9, + 6, + 25, + 21, + 28, + 16, + 16, + 15, + 17, + 27, + 19, + 19, + 12, + 17, + 17, + 31 + ], + "weighted_loads": [ + 1.1221384350210428, + 0.4997305143624544, + 0.750640869140625, + 1.0401293393224478, + 1.084115931764245, + 1.651791449636221, + 1.3758512157946825, + 0.5809154622256756, + 1.5213656350970268, + 0.9762104991823435, + 0.9813572783023119, + 1.1100495364516973, + 0.46571459621191025, + 1.7658671997487545, + 0.17440268583595753, + 1.3791833519935608, + 0.3478383310139179, + 1.2607486508786678, + 0.39275485649704933, + 0.3657759092748165, + 1.1258871275931597, + 1.751842088997364, + 0.6357363853603601, + 0.8184007816016674, + 3.2468877136707306, + 1.113888293504715, + 1.8525615017861128, + 1.37787014991045, + 0.45494120940566063, + 1.089247077703476, + 0.4260701537132263, + 2.129440277814865, + 0.8779990635812283, + 0.6228393688797951, + 0.7488783895969391, + 0.7085593547672033, + 0.4574440233409405, + 1.432416720315814, + 0.9702335689216852, + 0.9160060118883848, + 1.1447072252631187, + 1.2460719961673021, + 1.108807859942317, + 0.6825450658798218, + 0.9055558629333973, + 1.3525387458503246, + 0.9462911058217287, + 1.176998395472765, + 0.39911460503935814, + 0.3727182988077402, + 0.9436955470591784, + 2.265239719301462, + 1.5299793370068073, + 0.7342216167598963, + 0.39145429618656635, + 1.3946800269186497, + 0.9251247979700565, + 1.2362823728471994, + 0.5677963402122259, + 0.9679329879581928, + 0.6339056137949228, + 0.694782480597496, + 1.204763513058424, + 1.6208805982023478 + ], + "unique_experts": 64, + "load_cv": 0.37599523443077754, + "normalized_load_entropy": 0.9829902289312359, + "max_load_share": 0.036231884057971016 + } + }, + "s0_period": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "ebb249cae356bc3412acfe3ed773b4d1c93781d33f4f9055aa1aacc733318a23", + "route_weight_sha256": "4a189e960b44bc9affe706bdd169d348b8625740d864046e42afa07851699cf8", + "loads": [ + 18, + 17, + 11, + 14, + 12, + 24, + 25, + 14, + 13, + 20, + 13, + 16, + 19, + 27, + 9, + 12, + 11, + 23, + 14, + 14, + 11, + 14, + 10, + 20, + 44, + 11, + 7, + 19, + 20, + 26, + 11, + 14, + 17, + 6, + 16, + 20, + 5, + 25, + 12, + 10, + 26, + 13, + 21, + 13, + 18, + 11, + 11, + 18, + 7, + 7, + 11, + 17, + 23, + 18, + 8, + 11, + 8, + 13, + 24, + 10, + 10, + 10, + 17, + 27 + ], + "weighted_loads": [ + 0.9257469326257706, + 0.5310950316488743, + 0.5451988615095615, + 0.975894583389163, + 0.7910184729844332, + 1.4759462364017963, + 1.3473386950790882, + 0.3363782986998558, + 0.3912640828639269, + 0.952846460044384, + 0.6292400136590004, + 0.8910412807017565, + 0.6256042718887329, + 1.6071247961372137, + 0.2264929600059986, + 0.5134948566555977, + 0.37598710507154465, + 1.1262938436120749, + 0.4011442642658949, + 0.35576677322387695, + 0.7775545306503773, + 1.513143215328455, + 0.2845644224435091, + 0.7753080353140831, + 3.4756242111325264, + 0.9082055613398552, + 0.26668258756399155, + 1.2878650724887848, + 0.5641124155372381, + 0.8912204634398222, + 0.2843494154512882, + 1.5441146194934845, + 0.983198419213295, + 0.37615814432501793, + 0.7146689537912607, + 0.724222507327795, + 0.2107406985014677, + 1.4530294425785542, + 1.0093513131141663, + 0.6154215820133686, + 1.245245173573494, + 0.4658179599791765, + 0.906828148290515, + 0.5413243118673563, + 0.6152021586894989, + 0.4471831601113081, + 0.8252464663237333, + 1.050071382895112, + 0.2394783366471529, + 0.3809018302708864, + 0.31105176359415054, + 1.901148822158575, + 1.2381382510066032, + 0.7891274988651276, + 0.19535979069769382, + 0.8654743395745754, + 0.5662709884345531, + 0.5383981969207525, + 0.6905426941812038, + 0.2917825859040022, + 0.5001495145261288, + 0.38745913840830326, + 1.2274336963891983, + 1.1227581556886435 + ], + "unique_experts": 64, + "load_cv": 0.43192766416665945, + "normalized_load_entropy": 0.9792872618584629, + "max_load_share": 0.04417670682730924 + }, + "full_input": { + "tokens": 191, + "top_k": 6, + "decisions": 1146, + "ordered_route_sha256": "09789b6d0fcc9e3c71085845c22420197278856c55789820d1862d2ddcb28243", + "route_weight_sha256": "43d44a50db491923e6de2603e7ab8e0d6cc04e688b9f838b0f34c34a51b8bcff", + "loads": [ + 19, + 17, + 13, + 16, + 15, + 24, + 27, + 16, + 28, + 22, + 16, + 18, + 19, + 28, + 10, + 21, + 11, + 25, + 14, + 14, + 14, + 14, + 11, + 21, + 44, + 15, + 19, + 20, + 20, + 26, + 11, + 18, + 19, + 8, + 16, + 21, + 5, + 25, + 12, + 13, + 26, + 23, + 23, + 20, + 18, + 21, + 11, + 19, + 8, + 7, + 13, + 18, + 27, + 18, + 10, + 15, + 12, + 19, + 24, + 21, + 11, + 13, + 17, + 27 + ], + "weighted_loads": [ + 1.0195352584123611, + 0.5310950316488743, + 0.630760170519352, + 1.030879681929946, + 0.9640968162566423, + 1.4759462364017963, + 1.5124135538935661, + 0.5883694291114807, + 1.189131060615182, + 1.0012022852897644, + 0.8136817216873169, + 1.0519818756729364, + 0.6256042718887329, + 1.6310188584029675, + 0.2547588665038347, + 1.1288880743086338, + 0.37598710507154465, + 1.2554011922329664, + 0.4011442642658949, + 0.35576677322387695, + 1.1074972562491894, + 1.513143215328455, + 0.3147158585488796, + 0.800522455945611, + 3.4756242111325264, + 1.0706750135868788, + 1.0548493079841137, + 1.3536864817142487, + 0.5641124155372381, + 0.8912204634398222, + 0.2843494154512882, + 1.9650298207998276, + 1.1216386780142784, + 0.7696717046201229, + 0.7146689537912607, + 0.7454838585108519, + 0.2107406985014677, + 1.4530294425785542, + 1.0093513131141663, + 0.8385706767439842, + 1.245245173573494, + 0.8778997492045164, + 0.956980062648654, + 0.7281751334667206, + 0.6152021586894989, + 1.2676756102591753, + 0.8252464663237333, + 1.076178003102541, + 0.2605705223977566, + 0.3809018302708864, + 0.3618552703410387, + 1.9541308470070362, + 1.466572217643261, + 0.7891274988651276, + 0.24010205641388893, + 1.4537171386182308, + 0.7796269729733467, + 0.9125950168818235, + 0.6905426941812038, + 1.0049305018037558, + 0.590896513313055, + 0.5237708035856485, + 1.2274336963891983, + 1.1227581556886435 + ], + "unique_experts": 64, + "load_cv": 0.3620229453815178, + "normalized_load_entropy": 0.9846059345214925, + "max_load_share": 0.038394415357766144 + } + }, + "s1_period": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "7876f5fbdd21c483ed00d50f5344e3b4352ad28cdeb7b1124b2a9e122414ffbe", + "route_weight_sha256": "dcb5bcea3a29a5ad771ebb212efe6aebad171b407d67c1f4f8ec1b9c01669c7b", + "loads": [ + 18, + 17, + 12, + 15, + 12, + 25, + 25, + 13, + 10, + 19, + 12, + 18, + 14, + 28, + 6, + 13, + 10, + 21, + 14, + 12, + 12, + 16, + 13, + 19, + 43, + 11, + 13, + 19, + 17, + 27, + 14, + 14, + 14, + 5, + 18, + 20, + 4, + 26, + 11, + 9, + 25, + 16, + 18, + 10, + 22, + 14, + 15, + 17, + 6, + 6, + 17, + 17, + 23, + 14, + 12, + 11, + 8, + 16, + 17, + 7, + 10, + 12, + 17, + 27 + ], + "weighted_loads": [ + 0.9142221249639988, + 0.5246418453752995, + 0.5897123105823994, + 1.0080227944999933, + 0.7874311916530132, + 1.511146767064929, + 1.2373821940273046, + 0.31602858752012253, + 0.28770703822374344, + 0.930767148733139, + 0.6060530245304108, + 0.9640603940933943, + 0.46577377058565617, + 1.6989219058305025, + 0.1489863283932209, + 0.5666572526097298, + 0.3685548845678568, + 0.9933923557400703, + 0.3951887357980013, + 0.29919242672622204, + 0.8094521425664425, + 1.567397527396679, + 0.36477377638220787, + 0.7593975905328989, + 3.1861948259174824, + 0.9207523055374622, + 0.4918177016079426, + 1.282789722084999, + 0.4853657018393278, + 0.9267062451690435, + 0.3610547799617052, + 1.4923007041215897, + 0.7561646848917007, + 0.28010061010718346, + 0.7737675607204437, + 0.7087450549006462, + 0.19816073961555958, + 1.3987830113619566, + 0.970768267288804, + 0.5593537371605635, + 1.1485533732920885, + 0.6043016444891691, + 0.8246343396604061, + 0.46222319826483727, + 0.7541638407856226, + 0.5813867580145597, + 0.9143210556358099, + 1.0451785661280155, + 0.22582480311393738, + 0.3733171559870243, + 0.5873336214572191, + 1.8953682258725166, + 1.2493250221014023, + 0.6849205102771521, + 0.3007679972797632, + 0.8389498293399811, + 0.5664690528064966, + 0.5959838088601828, + 0.4919875953346491, + 0.21671876311302185, + 0.518193457275629, + 0.44382270611822605, + 1.2054630666971207, + 1.1303067579865456 + ], + "unique_experts": 64, + "load_cv": 0.4233282260696854, + "normalized_load_entropy": 0.9796043302200317, + "max_load_share": 0.04317269076305221 + }, + "full_input": { + "tokens": 207, + "top_k": 6, + "decisions": 1242, + "ordered_route_sha256": "d3bb8a7c395d184cb0e1a2b0caf5bdb00817d811b0a05a55e4cb1480880f43b5", + "route_weight_sha256": "6dd2466e3305afac4653ec431caf6a882dc2bc00601575ef0f8add298a55708e", + "loads": [ + 21, + 17, + 15, + 16, + 18, + 27, + 27, + 16, + 30, + 20, + 18, + 22, + 14, + 30, + 7, + 25, + 10, + 27, + 15, + 13, + 15, + 19, + 17, + 21, + 45, + 16, + 33, + 21, + 17, + 29, + 16, + 20, + 16, + 7, + 18, + 20, + 6, + 27, + 11, + 13, + 25, + 29, + 22, + 17, + 23, + 24, + 15, + 20, + 8, + 6, + 25, + 22, + 29, + 14, + 16, + 15, + 17, + 27, + 19, + 17, + 12, + 17, + 17, + 31 + ], + "weighted_loads": [ + 1.1209594905376434, + 0.5246418453752995, + 0.7394133545458317, + 1.0388053469359875, + 1.1982299722731113, + 1.6485537756234407, + 1.376815164461732, + 0.5315319243818521, + 1.4812076520174742, + 0.9528808519244194, + 0.9836670160293579, + 1.2997743356972933, + 0.46577377058565617, + 1.766378128901124, + 0.1743530072271824, + 1.2683365605771542, + 0.3685548845678568, + 1.2530477661639452, + 0.43450293876230717, + 0.36517843417823315, + 1.101514209061861, + 1.7956439033150673, + 0.6356565933674574, + 0.8186596538871527, + 3.257904678583145, + 1.1111038941890001, + 1.7990914825350046, + 1.3748237378895283, + 0.4853657018393278, + 1.0893624667078257, + 0.46786120533943176, + 2.1399818882346153, + 0.8778202161192894, + 0.6175867579877377, + 0.7737675607204437, + 0.7087450549006462, + 0.4784204941242933, + 1.4324382822960615, + 0.970768267288804, + 0.8575961906462908, + 1.1485533732920885, + 1.210980087518692, + 1.0577955693006516, + 0.6832701731473207, + 0.9069042596966028, + 1.3482068497687578, + 0.9143210556358099, + 1.1534782908856869, + 0.37753246910870075, + 0.3733171559870243, + 0.9422805234789848, + 2.3038202598690987, + 1.5647725090384483, + 0.6849205102771521, + 0.3934170603752136, + 1.3935060054063797, + 0.9265242572873831, + 1.2346414346247911, + 0.5673996713012457, + 0.8532771095633507, + 0.6337448563426733, + 0.7088778857141733, + 1.2054630666971207, + 1.6219696998596191 + ], + "unique_experts": 64, + "load_cv": 0.369539781400069, + "normalized_load_entropy": 0.9835727019558455, + "max_load_share": 0.036231884057971016 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 166, + "ordered_topk_exact_tokens": 96, + "set_exact_tokens": 112, + "mean_set_jaccard": 0.9008892713711992, + "mean_token_weighted_tv": 0.013164520791047308, + "aggregate_load_tv": 0.04618473895582329 + }, + "system_bos": { + "tokens": 166, + "ordered_topk_exact_tokens": 92, + "set_exact_tokens": 109, + "mean_set_jaccard": 0.8980206540447503, + "mean_token_weighted_tv": 0.01501389533977013, + "aggregate_load_tv": 0.04819277108433735 + }, + "system_x": { + "tokens": 166, + "ordered_topk_exact_tokens": 82, + "set_exact_tokens": 101, + "mean_set_jaccard": 0.880665519219736, + "mean_token_weighted_tv": 0.018236754372356886, + "aggregate_load_tv": 0.05522088353413654 + }, + "system_period": { + "tokens": 166, + "ordered_topk_exact_tokens": 83, + "set_exact_tokens": 102, + "mean_set_jaccard": 0.8810958118187033, + "mean_token_weighted_tv": 0.018185038332748843, + "aggregate_load_tv": 0.055220883534136546 + }, + "bos_at_s0": { + "tokens": 166, + "ordered_topk_exact_tokens": 69, + "set_exact_tokens": 84, + "mean_set_jaccard": 0.8326161790017212, + "mean_token_weighted_tv": 0.023129466404936398, + "aggregate_load_tv": 0.06626506024096385 + }, + "bos_at_s1": { + "tokens": 166, + "ordered_topk_exact_tokens": 52, + "set_exact_tokens": 69, + "mean_set_jaccard": 0.822289156626506, + "mean_token_weighted_tv": 0.024605345828122044, + "aggregate_load_tv": 0.08433734939759038 + }, + "x_at_s0": { + "tokens": 166, + "ordered_topk_exact_tokens": 70, + "set_exact_tokens": 86, + "mean_set_jaccard": 0.8419391853126793, + "mean_token_weighted_tv": 0.021685503103422474, + "aggregate_load_tv": 0.06526104417670682 + }, + "x_at_s1": { + "tokens": 166, + "ordered_topk_exact_tokens": 60, + "set_exact_tokens": 76, + "mean_set_jaccard": 0.8278829604130808, + "mean_token_weighted_tv": 0.024357546743633877, + "aggregate_load_tv": 0.08032128514056226 + }, + "period_at_s0": { + "tokens": 166, + "ordered_topk_exact_tokens": 73, + "set_exact_tokens": 89, + "mean_set_jaccard": 0.847102696500287, + "mean_token_weighted_tv": 0.02121503136109516, + "aggregate_load_tv": 0.06325301204819275 + }, + "period_at_s1": { + "tokens": 166, + "ordered_topk_exact_tokens": 60, + "set_exact_tokens": 76, + "mean_set_jaccard": 0.8294606999426277, + "mean_token_weighted_tv": 0.0242539935419897, + "aggregate_load_tv": 0.07931726907630522 + } + } + }, + "layer_02": { + "layer": 2, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "3df36b0ce76454e1e41065402b57198ef2eada774b259bcc3cf030a226b0c237", + "route_weight_sha256": "9ca46278fe65a7f623033fe878dc32f1daea820f28c683e794058cca1af26868", + "loads": [ + 14, + 12, + 12, + 9, + 9, + 9, + 8, + 9, + 14, + 11, + 5, + 7, + 14, + 22, + 7, + 15, + 11, + 22, + 19, + 16, + 21, + 18, + 21, + 17, + 23, + 18, + 15, + 15, + 8, + 37, + 18, + 11, + 0, + 17, + 15, + 12, + 4, + 31, + 24, + 7, + 12, + 18, + 13, + 10, + 20, + 13, + 15, + 27, + 22, + 7, + 22, + 13, + 15, + 22, + 12, + 15, + 21, + 29, + 30, + 23, + 16, + 18, + 15, + 11 + ], + "weighted_loads": [ + 1.4388893079012632, + 0.5624729618430138, + 0.48935388028621674, + 0.37589162215590477, + 0.32144719921052456, + 0.7291077468544245, + 0.3544075842946768, + 1.0330132991075516, + 0.7415360901504755, + 0.6117799784988165, + 0.16392988339066505, + 0.2213238701224327, + 0.6383287087082863, + 0.9322893060743809, + 0.28443538025021553, + 0.9382043052464724, + 0.3750933036208153, + 0.9799084216356277, + 1.0369712263345718, + 0.7144653182476759, + 0.7295663841068745, + 1.0983862429857254, + 1.957766117528081, + 0.5517729390412569, + 1.6733009926974773, + 1.2251669894903898, + 0.8816656023263931, + 2.19116173684597, + 0.22970872186124325, + 1.3231633733958006, + 1.8722462728619576, + 0.8037228025496006, + 0.0, + 0.6678036637604237, + 2.194852814078331, + 0.9205122664570808, + 0.16828356496989727, + 1.7901367861777544, + 1.0150376856327057, + 0.5715531278401613, + 0.6234226431697607, + 0.75172233954072, + 0.9096636902540922, + 0.387151962146163, + 1.6978152729570866, + 1.285695157945156, + 0.6834049802273512, + 1.588215807452798, + 0.9019505623728037, + 0.23786183632910252, + 0.5618924852460623, + 1.184947159141302, + 0.8365028221160173, + 1.027041282504797, + 0.3386356234550476, + 0.9395559038966894, + 1.3936255741864443, + 2.008832897990942, + 2.471623096615076, + 1.6111810058355331, + 0.9248753916472197, + 1.28962854295969, + 1.1771664954721928, + 1.0479964800179005 + ], + "unique_experts": 63, + "load_cv": 0.4425513301433134, + "normalized_load_entropy": 0.9753432915117946, + "max_load_share": 0.03714859437751004 + }, + "full_input": { + "tokens": 191, + "top_k": 6, + "decisions": 1146, + "ordered_route_sha256": "994935d321cde1c4d8ed6b675bf831520cac368925af9b705506b9a75ce69507", + "route_weight_sha256": "e17df897ee3f606ff2633f4f91eb41b7445d2479fc0579357b0916bffa6c0b8e", + "loads": [ + 14, + 22, + 12, + 11, + 9, + 9, + 8, + 11, + 16, + 11, + 8, + 7, + 14, + 22, + 15, + 15, + 11, + 23, + 20, + 20, + 23, + 27, + 21, + 17, + 26, + 18, + 16, + 17, + 11, + 37, + 18, + 13, + 0, + 18, + 20, + 27, + 4, + 31, + 27, + 7, + 12, + 18, + 19, + 12, + 20, + 13, + 18, + 31, + 23, + 7, + 22, + 20, + 15, + 23, + 12, + 15, + 21, + 37, + 38, + 26, + 26, + 21, + 21, + 20 + ], + "weighted_loads": [ + 1.4388893079012632, + 1.5132364593446255, + 0.48935388028621674, + 2.0749125443398952, + 0.32144719921052456, + 0.7291077468544245, + 0.3544075842946768, + 1.1283052787184715, + 0.8199068885296583, + 0.6117799784988165, + 0.28898022323846817, + 0.2213238701224327, + 0.6383287087082863, + 0.9322893060743809, + 0.6143422890454531, + 0.9382043052464724, + 0.3750933036208153, + 0.9806053047650494, + 1.0385581351583824, + 1.450194327160716, + 1.0424061454832554, + 1.7891582399606705, + 1.957766117528081, + 0.5517729390412569, + 1.8340178541839123, + 1.2251669894903898, + 0.8825055715278722, + 2.4393428787589073, + 0.4756607133895159, + 1.3231633733958006, + 1.8722462728619576, + 0.824288425501436, + 0.0, + 0.7041492350399494, + 2.41909159719944, + 2.8585961805656552, + 0.16828356496989727, + 1.7901367861777544, + 1.082828083075583, + 0.5715531278401613, + 0.6234226431697607, + 0.75172233954072, + 1.5606959108263254, + 0.4365121852606535, + 1.6978152729570866, + 1.285695157945156, + 0.7774254120886326, + 1.834223309531808, + 0.9274296835064888, + 0.23786183632910252, + 0.5618924852460623, + 2.0312780514359474, + 0.8365028221160173, + 1.028357916045934, + 0.3386356234550476, + 0.9395559038966894, + 1.3936255741864443, + 2.5120533108711243, + 2.836296286433935, + 1.7982162646949291, + 1.7581826066598296, + 1.4111290015280247, + 1.5831609014421701, + 1.791591128334403 + ], + "unique_experts": 63, + "load_cv": 0.43401495774919635, + "normalized_load_entropy": 0.9757991028801918, + "max_load_share": 0.03315881326352531 + } + }, + "s1_eos": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "e66768c04a0c3a7da161c58eb16f7779bdae4776505850182d51c631887650b8", + "route_weight_sha256": "ecccd5d7a6eac89d8d9a9474b313262cfda26e583606dcaaea23866b91424fdc", + "loads": [ + 14, + 10, + 13, + 8, + 9, + 10, + 9, + 9, + 14, + 9, + 4, + 7, + 13, + 17, + 7, + 15, + 10, + 22, + 20, + 16, + 20, + 18, + 20, + 20, + 23, + 17, + 15, + 15, + 8, + 35, + 18, + 10, + 0, + 18, + 15, + 11, + 3, + 31, + 30, + 6, + 13, + 19, + 14, + 13, + 20, + 13, + 15, + 26, + 25, + 7, + 20, + 14, + 15, + 21, + 11, + 15, + 22, + 29, + 30, + 23, + 17, + 18, + 15, + 12 + ], + "weighted_loads": [ + 1.4574701115489006, + 0.49038988910615444, + 0.5215916819870472, + 0.3377976845949888, + 0.32980964705348015, + 0.7582182586193085, + 0.3840800207108259, + 1.0320584997534752, + 0.7440768051892519, + 0.571829304099083, + 0.13362349383533, + 0.22542374767363071, + 0.6109309569001198, + 0.8118171524256468, + 0.30429715290665627, + 0.9664694759994745, + 0.34407609328627586, + 0.9551541171967983, + 1.087873324751854, + 0.7240425925701857, + 0.703993882983923, + 1.0880498308688402, + 1.9298597797751427, + 0.6183136347681284, + 1.6670586727559566, + 1.1971998922526836, + 0.8885621763765812, + 2.30416339635849, + 0.22791356965899467, + 1.2537923231720924, + 1.8920477367937565, + 0.8214234597980976, + 0.0, + 0.6973816137760878, + 2.190597653388977, + 0.8878049962222576, + 0.14248076640069485, + 1.7736878264695406, + 1.1567468587309122, + 0.5274589397013187, + 0.6753550209105015, + 0.8045615237206221, + 0.9273218028247356, + 0.48194844648241997, + 1.6690261606127024, + 1.283064104616642, + 0.6789502408355474, + 1.580806577578187, + 0.9908304587006569, + 0.23374274745583534, + 0.5123954173177481, + 1.2727048769593239, + 0.8152765240520239, + 0.9934352356940508, + 0.3191877920180559, + 0.9316395130008459, + 1.410641735419631, + 1.965528355911374, + 2.4733463134616613, + 1.6076048593968153, + 0.9336045887321234, + 1.2812865562736988, + 1.2057922948151827, + 1.1236528474837542 + ], + "unique_experts": 63, + "load_cv": 0.4507842054650716, + "normalized_load_entropy": 0.9740581644517639, + "max_load_share": 0.035140562248995984 + }, + "full_input": { + "tokens": 207, + "top_k": 6, + "decisions": 1242, + "ordered_route_sha256": "38c100f76871af0c4ed7d3b47e998b758a5b38da5b2f3396e661b5fd4b4de307", + "route_weight_sha256": "f0bc29270df007283850c6ddc356f5e882649228348c67ff37cca6697a15b48c", + "loads": [ + 18, + 21, + 14, + 11, + 10, + 11, + 9, + 13, + 22, + 10, + 11, + 7, + 13, + 19, + 18, + 16, + 12, + 23, + 21, + 22, + 22, + 29, + 21, + 20, + 30, + 18, + 16, + 18, + 13, + 35, + 19, + 13, + 0, + 19, + 24, + 28, + 3, + 32, + 35, + 9, + 13, + 19, + 23, + 16, + 23, + 13, + 22, + 33, + 27, + 8, + 21, + 24, + 16, + 25, + 11, + 15, + 27, + 37, + 32, + 31, + 27, + 24, + 25, + 25 + ], + "weighted_loads": [ + 1.976932406425476, + 1.4990716706961393, + 0.5467983745038509, + 2.0712031107395887, + 0.3602110520005226, + 0.8988326191902161, + 0.3840800207108259, + 1.1920795626938343, + 1.3629853539168835, + 0.6888130754232407, + 0.4397523049265146, + 0.22542374767363071, + 0.6109309569001198, + 0.8367185723036528, + 0.8583595957607031, + 0.9984776731580496, + 0.407789496704936, + 0.955741455196403, + 1.089259178028442, + 1.502013210207224, + 0.9927414618432522, + 1.8827323075383902, + 1.9681435599923134, + 0.6183136347681284, + 1.987998878583312, + 1.247315526008606, + 0.8893909143516794, + 2.940712183713913, + 0.47519201040267944, + 1.2537923231720924, + 1.925570610910654, + 0.8826144766062498, + 0.0, + 0.7348202411085367, + 2.5574035812169313, + 2.602338765747845, + 0.14248076640069485, + 1.8153049517422915, + 1.296604374423623, + 0.8820095174014568, + 0.6753550209105015, + 0.8045615237206221, + 2.0275478214025497, + 0.7116284091025591, + 2.31452096439898, + 1.283064104616642, + 1.2819924354553223, + 1.9485653545707464, + 1.0596152786165476, + 0.27708158269524574, + 0.5389421340078115, + 2.444856356829405, + 0.991639157757163, + 1.1782464577117935, + 0.3191877920180559, + 0.9316395130008459, + 1.6947683934122324, + 2.3995048869401217, + 2.584354443475604, + 2.0654587745666504, + 1.610830000601709, + 1.6812223233282566, + 2.0213193260133266, + 2.3110250905156136 + ], + "unique_experts": 63, + "load_cv": 0.41381730114433374, + "normalized_load_entropy": 0.9770582687088181, + "max_load_share": 0.029790660225442835 + } + }, + "s0_bos": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "d0bd06413c4998b2de3f95c2babd2a9096fef45223048bfd652c08c95832d32f", + "route_weight_sha256": "ebbd1458d2ff6391748907b51331773242189b68f1c65418358fb03bb309e535", + "loads": [ + 10, + 14, + 13, + 18, + 6, + 9, + 7, + 9, + 14, + 12, + 3, + 6, + 12, + 13, + 6, + 16, + 12, + 22, + 19, + 17, + 22, + 18, + 21, + 13, + 22, + 17, + 14, + 15, + 16, + 31, + 18, + 11, + 0, + 16, + 15, + 12, + 3, + 32, + 29, + 8, + 11, + 14, + 14, + 11, + 19, + 13, + 16, + 29, + 24, + 5, + 25, + 14, + 15, + 21, + 13, + 18, + 22, + 31, + 30, + 23, + 15, + 17, + 15, + 10 + ], + "weighted_loads": [ + 1.3250761851668358, + 0.6212319452315569, + 0.5101857166737318, + 0.6455567423254251, + 0.2231628242880106, + 0.7230626884847879, + 0.3114112298935652, + 0.9785719066858292, + 0.7320351880043745, + 0.6359747610986233, + 0.11276878044009209, + 0.19066734798252583, + 0.5949413664638996, + 0.6892952732741833, + 0.21963652223348618, + 0.9619199708104134, + 0.4093382265418768, + 1.0011155027896166, + 1.0141659677028656, + 0.7293430436402559, + 0.7728890143334866, + 1.119190027937293, + 1.9744888916611671, + 0.4307234287261963, + 1.636828325688839, + 1.139737781137228, + 0.8440125212073326, + 2.0972764045000076, + 0.44302568957209587, + 1.1172771491110325, + 1.818964933976531, + 0.8097627758979797, + 0.0, + 0.601986575871706, + 2.2245110906660557, + 0.9299778677523136, + 0.14828666672110558, + 1.820596469566226, + 1.1029414366930723, + 0.5885003060102463, + 0.5745943617075682, + 0.6045069228857756, + 0.9767340403050184, + 0.42597615346312523, + 1.655834048986435, + 1.3177172876894474, + 0.7403128799051046, + 1.7152041159570217, + 0.9717975854873657, + 0.16893265210092068, + 0.6560149192810059, + 1.1428319029510021, + 0.8637011703103781, + 0.9869042634963989, + 0.3831038363277912, + 1.0620165597647429, + 1.4637140482664108, + 2.3255747985094786, + 2.6265227757394314, + 1.6653611734509468, + 0.834530409425497, + 1.3063024170696735, + 1.2854261361062527, + 0.9104016162455082 + ], + "unique_experts": 63, + "load_cv": 0.4540639756314372, + "normalized_load_entropy": 0.973298338842331, + "max_load_share": 0.0321285140562249 + }, + "full_input": { + "tokens": 191, + "top_k": 6, + "decisions": 1146, + "ordered_route_sha256": "312343d79c2ad4084b9d034ec4db7a7786680faebc443d13dd95aa66f9e08e97", + "route_weight_sha256": "65dbf749d02ec2a9c7e75d2923bd3acdf51fa8b74872cae3f863b990b141a01f", + "loads": [ + 10, + 24, + 13, + 19, + 6, + 9, + 7, + 11, + 17, + 12, + 6, + 6, + 13, + 13, + 11, + 16, + 13, + 22, + 19, + 21, + 24, + 27, + 21, + 13, + 24, + 17, + 14, + 17, + 19, + 31, + 18, + 11, + 0, + 19, + 20, + 28, + 3, + 32, + 33, + 8, + 11, + 14, + 21, + 13, + 19, + 13, + 19, + 33, + 25, + 5, + 25, + 22, + 15, + 21, + 13, + 18, + 22, + 40, + 38, + 26, + 25, + 19, + 22, + 20 + ], + "weighted_loads": [ + 1.3250761851668358, + 1.5719954427331686, + 0.5101857166737318, + 1.3717227522283792, + 0.2231628242880106, + 0.7230626884847879, + 0.3114112298935652, + 1.0714952498674393, + 0.8345207870006561, + 0.6359747610986233, + 0.2378191202878952, + 0.19066734798252583, + 0.6268382556736469, + 0.6892952732741833, + 0.44136451929807663, + 0.9619199708104134, + 0.43927688524127007, + 1.0011155027896166, + 1.0141659677028656, + 1.4116198141127825, + 1.0641800723969936, + 1.820402977988124, + 1.9744888916611671, + 0.4307234287261963, + 1.7500370368361473, + 1.139737781137228, + 0.8440125212073326, + 2.360880173742771, + 0.7302201706916094, + 1.1172771491110325, + 1.818964933976531, + 0.8097627758979797, + 0.0, + 0.7012438103556633, + 2.4487498737871647, + 2.943915323354304, + 0.14828666672110558, + 1.820596469566226, + 1.25980359967798, + 0.5885003060102463, + 0.5745943617075682, + 0.6045069228857756, + 1.6942766550928354, + 0.4715939424932003, + 1.655834048986435, + 1.3177172876894474, + 0.8339497931301594, + 1.9625938422977924, + 0.9972767066210508, + 0.16893265210092068, + 0.6560149192810059, + 1.9505557175725698, + 0.8637011703103781, + 0.9869042634963989, + 0.3831038363277912, + 1.0620165597647429, + 1.4637140482664108, + 2.8468974102288485, + 2.9911959655582905, + 1.7992576472461224, + 1.667837624438107, + 1.3922003991901875, + 1.8356378003954887, + 1.8816948924213648 + ], + "unique_experts": 63, + "load_cv": 0.4582639166852004, + "normalized_load_entropy": 0.9727004948445407, + "max_load_share": 0.034904013961605584 + } + }, + "s1_bos": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "24b86b8e635ead4167c7d4b537c492a6ff61e3be83030cb4a7825efc2297c0a6", + "route_weight_sha256": "4f966bc5c8d510d4137643a69a18d03930a62f42cf2598e9bb9be483eb74ce4d", + "loads": [ + 10, + 13, + 12, + 15, + 6, + 9, + 5, + 9, + 14, + 12, + 3, + 6, + 12, + 14, + 6, + 16, + 12, + 22, + 19, + 18, + 20, + 18, + 21, + 15, + 22, + 17, + 15, + 15, + 16, + 32, + 18, + 7, + 1, + 15, + 15, + 14, + 2, + 31, + 29, + 8, + 14, + 17, + 14, + 11, + 21, + 13, + 15, + 28, + 23, + 5, + 24, + 12, + 15, + 22, + 15, + 17, + 22, + 33, + 30, + 22, + 16, + 17, + 16, + 10 + ], + "weighted_loads": [ + 1.3400041684508324, + 0.5871017146855593, + 0.5083743631839752, + 0.5519343670457602, + 0.22498081997036934, + 0.7237035296857357, + 0.25141219049692154, + 0.9489700384438038, + 0.7331732008606195, + 0.6418224833905697, + 0.1076840553432703, + 0.19850276038050652, + 0.5973102692514658, + 0.7078363746404648, + 0.21439689584076405, + 1.0029694586992264, + 0.3983890265226364, + 0.9833655171096325, + 1.0209360532462597, + 0.7742321044206619, + 0.7311560679227114, + 1.1207969784736633, + 2.0138885602355003, + 0.48097880743443966, + 1.599784780293703, + 1.1828855201601982, + 0.8743135556578636, + 2.237078309059143, + 0.4531011749058962, + 1.1347621530294418, + 1.8917638212442398, + 0.6983051616698503, + 0.02395780198276043, + 0.5682849697768688, + 2.2176048923283815, + 1.0667699202895164, + 0.12256823480129242, + 1.8279881663620472, + 1.0988633297383785, + 0.575709868222475, + 0.7032167725265026, + 0.7098759729415178, + 0.9703109227120876, + 0.4334645327180624, + 1.7900590226054192, + 1.3233594931662083, + 0.6881511863321066, + 1.7026652991771698, + 0.9506293144077063, + 0.1700306572020054, + 0.6367511395365, + 1.1321273427456617, + 0.8207828272134066, + 1.0010245312005281, + 0.4293018989264965, + 1.0395613610744476, + 1.4209159631282091, + 2.4035343788564205, + 2.6425384171307087, + 1.6259940043091774, + 0.8664866760373116, + 1.2865098975598812, + 1.3087103199213743, + 0.9745445121079683 + ], + "unique_experts": 64, + "load_cv": 0.457884165202737, + "normalized_load_entropy": 0.97307464694974, + "max_load_share": 0.03313253012048193 + }, + "full_input": { + "tokens": 207, + "top_k": 6, + "decisions": 1242, + "ordered_route_sha256": "c401828ec45f5b9028bcc0f25c544f6a3ae4d2eea554572fd38d965d8965cc01", + "route_weight_sha256": "4682aecc0b077c08127b3e3ef0e6668ebf2d101eba5ec5b3594a49e4ab16f3df", + "loads": [ + 14, + 24, + 13, + 18, + 7, + 10, + 5, + 13, + 23, + 13, + 10, + 6, + 13, + 15, + 17, + 17, + 15, + 22, + 19, + 24, + 22, + 29, + 22, + 15, + 28, + 18, + 15, + 18, + 21, + 32, + 19, + 9, + 1, + 18, + 24, + 32, + 2, + 32, + 34, + 11, + 14, + 17, + 24, + 14, + 24, + 13, + 22, + 35, + 25, + 6, + 25, + 22, + 16, + 25, + 15, + 17, + 27, + 40, + 32, + 30, + 26, + 22, + 28, + 23 + ], + "weighted_loads": [ + 1.8594664633274078, + 1.5957834962755442, + 0.533581055700779, + 1.3422774467617273, + 0.2553822249174118, + 0.8643178902566433, + 0.25141219049692154, + 1.1056654043495655, + 1.3829723671078682, + 0.7588062547147274, + 0.4138128664344549, + 0.19850276038050652, + 0.6250370666384697, + 0.7320347987115383, + 0.745271772146225, + 1.0349776558578014, + 0.4906109366565943, + 0.9833655171096325, + 1.0209360532462597, + 1.4865766819566488, + 1.0057942736893892, + 1.938473992049694, + 2.052172340452671, + 0.48097880743443966, + 1.878906385973096, + 1.2330011539161205, + 0.8743135556578636, + 2.895011246204376, + 0.7613587882369757, + 1.1347621530294418, + 1.9252866953611374, + 0.7411268670111895, + 0.02395780198276043, + 0.6669509820640087, + 2.584410820156336, + 2.875629504211247, + 0.12256823480129242, + 1.869605291634798, + 1.3195422366261482, + 0.9302604459226131, + 0.7032167725265026, + 0.7098759729415178, + 2.1273448020219803, + 0.6602763328701258, + 2.435553826391697, + 1.3233594931662083, + 1.291676914319396, + 2.072747714817524, + 1.019414134323597, + 0.2133694924414158, + 0.6632978562265635, + 2.292593641206622, + 0.9971454609185457, + 1.1847418863326311, + 0.4293018989264965, + 1.0395613610744476, + 1.7050426211208105, + 2.78760938718915, + 2.7535465471446514, + 2.0322376657277346, + 1.543712087906897, + 1.6496030651032925, + 2.22944812849164, + 2.2939829602837563 + ], + "unique_experts": 64, + "load_cv": 0.4266520754504422, + "normalized_load_entropy": 0.9756780606737205, + "max_load_share": 0.0322061191626409 + } + }, + "s0_x": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "203ed0a22b2c9f208b866de837992eff20b09858369ad669fb46f0706401b69a", + "route_weight_sha256": "ae0cd5e0a72c5599a0bb6291de8b9a7e22af926d21266a37e532fd91c28fd577", + "loads": [ + 12, + 12, + 14, + 18, + 8, + 9, + 7, + 9, + 14, + 11, + 4, + 6, + 12, + 14, + 7, + 16, + 12, + 22, + 21, + 17, + 23, + 18, + 21, + 16, + 22, + 17, + 14, + 15, + 12, + 30, + 18, + 9, + 0, + 16, + 15, + 12, + 3, + 32, + 26, + 8, + 11, + 12, + 14, + 11, + 19, + 13, + 16, + 29, + 24, + 5, + 25, + 13, + 15, + 24, + 13, + 16, + 22, + 30, + 31, + 23, + 14, + 18, + 16, + 10 + ], + "weighted_loads": [ + 1.3807650599628687, + 0.5548749137669802, + 0.5481769759207964, + 0.6432776898145676, + 0.2826674059033394, + 0.7105009146034718, + 0.30277393013238907, + 0.980421356856823, + 0.7483137398958206, + 0.6108386348932981, + 0.1348399631679058, + 0.19300304539501667, + 0.6036887634545565, + 0.71602463722229, + 0.2589840926229954, + 0.9625185672193766, + 0.40950664319097996, + 1.0030861441046, + 1.0611822716891766, + 0.7307185642421246, + 0.7961387187242508, + 1.0952312778681517, + 1.9447510596364737, + 0.5056907776743174, + 1.6033245138823986, + 1.1358659528195858, + 0.8346138186752796, + 2.049401491880417, + 0.32501623034477234, + 1.071514368057251, + 1.81455572322011, + 0.7427795492112637, + 0.0, + 0.6153876148164272, + 2.2172055579721928, + 0.9165633879601955, + 0.14756744168698788, + 1.7429515831172466, + 0.9977338686585426, + 0.5828744359314442, + 0.5743897464126348, + 0.5515006687492132, + 0.9576766043901443, + 0.42110067792236805, + 1.6524240151047707, + 1.295466497540474, + 0.7536121383309364, + 1.7126894425600767, + 0.9642314426600933, + 0.17044119723141193, + 0.6559739988297224, + 1.1130285058170557, + 0.8664484824985266, + 1.0547062326222658, + 0.3789920527487993, + 0.9929120130836964, + 1.4492103084921837, + 2.226345034316182, + 2.6071588434278965, + 1.6710231341421604, + 0.7963871844112873, + 1.3483352102339268, + 1.330031780526042, + 0.8910327348858118 + ], + "unique_experts": 63, + "load_cv": 0.44906351195970523, + "normalized_load_entropy": 0.9740412697504842, + "max_load_share": 0.0321285140562249 + }, + "full_input": { + "tokens": 191, + "top_k": 6, + "decisions": 1146, + "ordered_route_sha256": "54047e5abd3c3831240c2de0ae35d75d6817f66e311ad014e752b33c32e08064", + "route_weight_sha256": "5b422908dd1e19d670624959954771ab75a173214f86b8faae425e4c5d26751d", + "loads": [ + 12, + 22, + 14, + 19, + 8, + 9, + 8, + 11, + 17, + 11, + 9, + 7, + 13, + 14, + 12, + 16, + 13, + 22, + 21, + 21, + 25, + 28, + 21, + 16, + 24, + 17, + 14, + 17, + 15, + 30, + 18, + 9, + 0, + 19, + 20, + 27, + 3, + 32, + 29, + 8, + 11, + 12, + 20, + 13, + 19, + 13, + 19, + 34, + 25, + 5, + 25, + 20, + 15, + 24, + 13, + 16, + 22, + 37, + 40, + 26, + 25, + 20, + 22, + 19 + ], + "weighted_loads": [ + 1.3807650599628687, + 1.5056384112685919, + 0.5481769759207964, + 1.3694436997175217, + 0.2826674059033394, + 0.7105009146034718, + 0.33754704520106316, + 1.073149025440216, + 0.8543138392269611, + 0.6108386348932981, + 0.36869610473513603, + 0.22817161493003368, + 0.6330919452011585, + 0.71602463722229, + 0.48047645948827267, + 0.9625185672193766, + 0.44055983796715736, + 1.0030861441046, + 1.0611822716891766, + 1.4370307587087154, + 1.0963738858699799, + 2.0945327561348677, + 1.9447510596364737, + 0.5056907776743174, + 1.718939483165741, + 1.1358659528195858, + 0.8346138186752796, + 2.3187161907553673, + 0.6110056433826685, + 1.071514368057251, + 1.81455572322011, + 0.7427795492112637, + 0.0, + 0.7098621930927038, + 2.4414443410933018, + 2.8761786529794335, + 0.14756744168698788, + 1.7429515831172466, + 1.06552426610142, + 0.5828744359314442, + 0.5743897464126348, + 0.5515006687492132, + 1.59590470418334, + 0.46693187579512596, + 1.6524240151047707, + 1.295466497540474, + 0.8479873389005661, + 1.9947584997862577, + 0.9897105637937784, + 0.17044119723141193, + 0.6559739988297224, + 1.8161232750862837, + 0.8664484824985266, + 1.0547062326222658, + 0.3789920527487993, + 0.9929120130836964, + 1.4492103084921837, + 2.672112265601754, + 3.1009425036609173, + 1.8040954396128654, + 1.6833105245605111, + 1.4342331923544407, + 1.8385181538760662, + 1.5708708185702562 + ], + "unique_experts": 63, + "load_cv": 0.44312635579548, + "normalized_load_entropy": 0.9745939245905486, + "max_load_share": 0.034904013961605584 + } + }, + "s1_x": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "225fdcf53ad3796c97d9786faf5b8fc91ce2da85ce2e6cd4623aa1ee9666abb7", + "route_weight_sha256": "79b02a3f9d4bf19cc374145a54d4854738994637d2c7a3fb3b594a249fc63116", + "loads": [ + 11, + 14, + 14, + 15, + 7, + 9, + 4, + 9, + 14, + 11, + 4, + 7, + 12, + 15, + 6, + 16, + 12, + 22, + 19, + 16, + 21, + 18, + 21, + 18, + 22, + 17, + 14, + 15, + 16, + 31, + 18, + 7, + 0, + 15, + 14, + 14, + 2, + 31, + 29, + 8, + 13, + 14, + 14, + 11, + 20, + 13, + 15, + 29, + 23, + 4, + 25, + 12, + 15, + 24, + 15, + 15, + 22, + 32, + 31, + 22, + 16, + 17, + 16, + 10 + ], + "weighted_loads": [ + 1.3656665477901697, + 0.591390797868371, + 0.5673507004976273, + 0.5519056506454945, + 0.25564054772257805, + 0.706393176689744, + 0.22054826468229294, + 0.9286455735564232, + 0.7484561931341887, + 0.6177570037543774, + 0.1312193889170885, + 0.22763038612902164, + 0.597249124199152, + 0.7364435642957687, + 0.20975767262279987, + 1.010127805173397, + 0.3987191468477249, + 0.9777512531727552, + 1.0073024183511734, + 0.7218409851193428, + 0.7573565877974033, + 1.1011782865971327, + 2.009180687367916, + 0.5645924974232912, + 1.5735471658408642, + 1.1779776737093925, + 0.8505636304616928, + 2.206314094364643, + 0.44507462345063686, + 1.0873632412403822, + 1.9065707307308912, + 0.6988575346767902, + 0.0, + 0.5736273676156998, + 2.169398784637451, + 1.0815408937633038, + 0.12010584771633148, + 1.7741336971521378, + 1.089480573311448, + 0.5719638466835022, + 0.6747392825782299, + 0.6312311720103025, + 0.9705954436212778, + 0.4320085383951664, + 1.7771388441324234, + 1.296648308634758, + 0.7004480808973312, + 1.7337239664047956, + 0.9390549063682556, + 0.14214877597987652, + 0.6731685996055603, + 1.0967459883540869, + 0.8182902205735445, + 1.055822130292654, + 0.42779912799596786, + 0.9838424995541573, + 1.3953426256775856, + 2.274596881121397, + 2.6450130436569452, + 1.652483206242323, + 0.8625764213502407, + 1.291041985154152, + 1.3330727089196444, + 0.9504821300506592 + ], + "unique_experts": 63, + "load_cv": 0.46069351230732564, + "normalized_load_entropy": 0.9721972969003639, + "max_load_share": 0.0321285140562249 + }, + "full_input": { + "tokens": 207, + "top_k": 6, + "decisions": 1242, + "ordered_route_sha256": "17a9a6412b5bdbd2ffecf0aee2df442a7958f20a1e71ed67b24c9c30167667ee", + "route_weight_sha256": "d53cc87517dfaff5add0dcf70ce9d2c30812a392881db6170accee3529f802c8", + "loads": [ + 15, + 25, + 15, + 17, + 8, + 10, + 4, + 13, + 23, + 12, + 13, + 8, + 13, + 16, + 15, + 17, + 15, + 22, + 19, + 22, + 23, + 30, + 22, + 18, + 28, + 18, + 14, + 18, + 21, + 31, + 19, + 9, + 1, + 18, + 23, + 32, + 2, + 32, + 33, + 11, + 13, + 14, + 23, + 14, + 23, + 13, + 22, + 37, + 25, + 5, + 26, + 21, + 16, + 27, + 15, + 15, + 27, + 39, + 34, + 30, + 27, + 22, + 27, + 22 + ], + "weighted_loads": [ + 1.8851288426667452, + 1.600072579458356, + 0.592557393014431, + 1.3099359013140202, + 0.2860419526696205, + 0.8470075372606516, + 0.22054826468229294, + 1.0845933593809605, + 1.4020270556211472, + 0.7347407750785351, + 0.5515995118767023, + 0.26274714432656765, + 0.623567009344697, + 0.7606419883668423, + 0.6890450399369001, + 1.0421360023319721, + 0.4963300805538893, + 0.9777512531727552, + 1.0073024183511734, + 1.4476259481161833, + 1.033749584108591, + 2.199653720483184, + 2.047464467585087, + 0.5645924974232912, + 1.8526339214295149, + 1.2280933074653149, + 0.8505636304616928, + 2.867625392973423, + 0.7598579954355955, + 1.0873632412403822, + 1.9400936048477888, + 0.7416792400181293, + 0.029483815655112267, + 0.6698513310402632, + 2.5362047124654055, + 2.8514106394723058, + 0.12010584771633148, + 1.8157508224248886, + 1.195843568071723, + 0.9265144243836403, + 0.6747392825782299, + 0.6312311720103025, + 2.069844489917159, + 0.6591746397316456, + 2.422633647918701, + 1.296648308634758, + 1.3038857858628035, + 2.132050236687064, + 1.0078397262841463, + 0.18548761121928692, + 0.6997153162956238, + 2.177194492891431, + 0.9946528542786837, + 1.239539485424757, + 0.42779912799596786, + 0.9838424995541573, + 1.679469283670187, + 2.656991347670555, + 2.8625730890780687, + 2.0598420780152082, + 1.586086560972035, + 1.6541351526975632, + 2.1955725513398647, + 2.0227809119969606 + ], + "unique_experts": 64, + "load_cv": 0.4277204221267741, + "normalized_load_entropy": 0.9756485202755648, + "max_load_share": 0.03140096618357488 + } + }, + "s0_period": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "551ac5bc41666c91ab6f27a70b165f79ac1d7158115810e0db76d2cf16bea3a9", + "route_weight_sha256": "573c8ae28f79f6d8c405d80a501b68323160f97f461df9bb2c03eb876380a0ee", + "loads": [ + 12, + 11, + 14, + 15, + 7, + 9, + 7, + 9, + 14, + 12, + 3, + 6, + 12, + 14, + 8, + 17, + 12, + 22, + 20, + 17, + 22, + 18, + 21, + 15, + 22, + 17, + 14, + 15, + 13, + 30, + 18, + 9, + 0, + 16, + 15, + 12, + 3, + 32, + 26, + 9, + 11, + 13, + 14, + 11, + 19, + 13, + 16, + 29, + 22, + 5, + 25, + 13, + 15, + 24, + 15, + 17, + 22, + 30, + 32, + 23, + 15, + 18, + 16, + 10 + ], + "weighted_loads": [ + 1.3941827528178692, + 0.524509834125638, + 0.5484071001410484, + 0.562119871377945, + 0.25257618725299835, + 0.709143903106451, + 0.30444302037358284, + 0.976164422929287, + 0.7484118472784758, + 0.6363082751631737, + 0.10825010016560555, + 0.19405620358884335, + 0.6054668240249157, + 0.7169136889278889, + 0.27283180318772793, + 0.9846986290067434, + 0.4148789681494236, + 1.002692760899663, + 1.0285318456590176, + 0.7292548660188913, + 0.7736937496811152, + 1.1009777784347534, + 1.957919793203473, + 0.48119284212589264, + 1.6081450954079628, + 1.141923911869526, + 0.8345452323555946, + 2.026427298784256, + 0.355455344542861, + 1.0731761362403631, + 1.8176845647394657, + 0.7398671712726355, + 0.0, + 0.6157090831547976, + 2.224815145134926, + 0.9059242159128189, + 0.14747732691466808, + 1.7366264630109072, + 0.9909034557640553, + 0.6109204087406397, + 0.5780559536069632, + 0.5746635608375072, + 0.9618475679308176, + 0.4201287478208542, + 1.6509850397706032, + 1.2985888421535492, + 0.7558603398501873, + 1.7192217968404293, + 0.9156562201678753, + 0.16933645494282246, + 0.6578099206089973, + 1.1177152656018734, + 0.865420762449503, + 1.053724993020296, + 0.4278456773608923, + 1.02340198867023, + 1.451334534212947, + 2.201928298920393, + 2.639331130310893, + 1.6645717304199934, + 0.8291675820946693, + 1.3445177525281906, + 1.3416800778359175, + 0.8945041038095951 + ], + "unique_experts": 63, + "load_cv": 0.446614514728003, + "normalized_load_entropy": 0.9741868254986856, + "max_load_share": 0.0321285140562249 + }, + "full_input": { + "tokens": 191, + "top_k": 6, + "decisions": 1146, + "ordered_route_sha256": "e695228647fb921506be4613c12a5eb74d57c401274c4cfdd10949984c588121", + "route_weight_sha256": "db85ea273a3495c29e183fb7ebed8b196c5792bd740d1b98970ce84101e62a19", + "loads": [ + 13, + 21, + 14, + 17, + 7, + 9, + 7, + 11, + 18, + 12, + 6, + 6, + 12, + 14, + 13, + 18, + 12, + 22, + 20, + 21, + 24, + 27, + 21, + 15, + 25, + 17, + 14, + 17, + 16, + 30, + 18, + 9, + 0, + 20, + 20, + 26, + 3, + 32, + 30, + 9, + 11, + 13, + 20, + 13, + 19, + 13, + 20, + 34, + 24, + 5, + 25, + 20, + 15, + 24, + 15, + 17, + 22, + 37, + 40, + 26, + 27, + 20, + 22, + 18 + ], + "weighted_loads": [ + 1.6867441050708294, + 1.4752733316272497, + 0.5484071001410484, + 1.3209013901650906, + 0.25257618725299835, + 0.709143903106451, + 0.30444302037358284, + 1.0686668641865253, + 0.8999012243002653, + 0.6363082751631737, + 0.23330044001340866, + 0.19405620358884335, + 0.6054668240249157, + 0.7169136889278889, + 0.4944893792271614, + 1.030210530385375, + 0.4148789681494236, + 1.002692760899663, + 1.0285318456590176, + 1.460262844339013, + 1.017059126868844, + 1.970830649137497, + 1.957919793203473, + 0.48119284212589264, + 1.7535733692348003, + 1.141923911869526, + 0.8345452323555946, + 2.295896716415882, + 0.6112843621522188, + 1.0731761362403631, + 1.8176845647394657, + 0.7398671712726355, + 0.0, + 0.7595960926264524, + 2.449053928256035, + 2.8046751441434026, + 0.14747732691466808, + 1.7366264630109072, + 1.118360654450953, + 0.6109204087406397, + 0.5780559536069632, + 0.5746635608375072, + 1.6047449614852667, + 0.46645726077258587, + 1.6509850397706032, + 1.2985888421535492, + 0.875621922314167, + 2.0047616586089134, + 0.9674239754676819, + 0.16933645494282246, + 0.6578099206089973, + 1.7988483980298042, + 0.865420762449503, + 1.053724993020296, + 0.4278456773608923, + 1.02340198867023, + 1.451334534212947, + 2.647629525512457, + 3.004004320129752, + 1.8004238661378622, + 1.722481400705874, + 1.4304157346487045, + 1.8442466706037521, + 1.5294163338840008 + ], + "unique_experts": 63, + "load_cv": 0.44641333275127326, + "normalized_load_entropy": 0.9739528280251878, + "max_load_share": 0.034904013961605584 + } + }, + "s1_period": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "2400b3a36b70530808b89ad733defd2a0a7e407946e8ce33b311ca2abbbfe2f3", + "route_weight_sha256": "726a34ba62581e00a4c51c0c36e891440a712c7fa8630e432ea5c558f8ce6844", + "loads": [ + 11, + 13, + 14, + 14, + 7, + 9, + 4, + 9, + 14, + 11, + 4, + 7, + 11, + 15, + 6, + 16, + 12, + 22, + 18, + 16, + 22, + 18, + 21, + 18, + 22, + 17, + 14, + 15, + 15, + 32, + 18, + 7, + 0, + 15, + 14, + 14, + 2, + 31, + 28, + 10, + 13, + 16, + 14, + 11, + 20, + 13, + 15, + 29, + 24, + 4, + 24, + 12, + 15, + 23, + 15, + 16, + 22, + 32, + 31, + 22, + 16, + 17, + 16, + 10 + ], + "weighted_loads": [ + 1.3723196033388376, + 0.5620466694235802, + 0.5677734166383743, + 0.5262491554021835, + 0.2552885599434376, + 0.7077754270285368, + 0.221561249345541, + 0.9292857572436333, + 0.750280074775219, + 0.6182747911661863, + 0.13111247681081295, + 0.2278613355010748, + 0.569905661046505, + 0.736940436065197, + 0.205945935100317, + 1.0105701424181461, + 0.39857358671724796, + 0.9711964391171932, + 0.9782962128520012, + 0.7229659743607044, + 0.7828876096755266, + 1.1041867416352034, + 2.0142751932144165, + 0.5625367518514395, + 1.5644262991845608, + 1.1826942395418882, + 0.8522446248680353, + 2.2111694291234016, + 0.4183316510170698, + 1.119828598573804, + 1.906999396160245, + 0.7004780732095242, + 0.0, + 0.5714067369699478, + 2.169230490922928, + 1.0735537465661764, + 0.12064871564507484, + 1.7665000073611736, + 1.0584386307746172, + 0.6381747201085091, + 0.6773193776607513, + 0.6881602630019188, + 0.9681840669363737, + 0.43536484986543655, + 1.7666902989149094, + 1.291936732828617, + 0.6971231289207935, + 1.7341666836291552, + 0.9673779103904963, + 0.14121547900140285, + 0.6436726748943329, + 1.0939676780253649, + 0.8176506459712982, + 1.0301633663475513, + 0.42896540090441704, + 1.0067254975438118, + 1.3946746587753296, + 2.256125772371888, + 2.6449927873909473, + 1.6475334614515305, + 0.8585958294570446, + 1.2845548167824745, + 1.3403926696628332, + 0.9553610756993294 + ], + "unique_experts": 63, + "load_cv": 0.45929098675320607, + "normalized_load_entropy": 0.9724053252052185, + "max_load_share": 0.0321285140562249 + }, + "full_input": { + "tokens": 207, + "top_k": 6, + "decisions": 1242, + "ordered_route_sha256": "90774387a7f14d8e25e69f3ceb6554c74104e14bd6546a41e3f49ec3bcf8e3b5", + "route_weight_sha256": "75e7e7270bfde63e9a6c163375702dba499a6192183b3a76a7225d1d06509792", + "loads": [ + 16, + 24, + 15, + 17, + 8, + 10, + 4, + 13, + 24, + 12, + 11, + 7, + 11, + 16, + 15, + 18, + 15, + 22, + 18, + 22, + 24, + 29, + 22, + 18, + 28, + 18, + 14, + 18, + 20, + 32, + 19, + 9, + 0, + 19, + 23, + 30, + 2, + 32, + 34, + 13, + 13, + 16, + 23, + 14, + 23, + 13, + 23, + 37, + 27, + 5, + 25, + 21, + 16, + 26, + 15, + 16, + 27, + 39, + 33, + 30, + 28, + 22, + 27, + 21 + ], + "weighted_loads": [ + 2.161089899018407, + 1.570728451013565, + 0.5929801091551781, + 1.3196611478924751, + 0.28568996489048004, + 0.8483897875994444, + 0.221561249345541, + 1.0802520290017128, + 1.4476002808660269, + 0.735258562490344, + 0.43724128790199757, + 0.2278613355010748, + 0.569905661046505, + 0.7611388601362705, + 0.6795663852244616, + 1.0776698850095272, + 0.49486780539155006, + 0.9711964391171932, + 0.9782962128520012, + 1.4797588977962732, + 1.0164121929556131, + 2.031415117904544, + 2.052558973431587, + 0.5625367518514395, + 1.8426698613911867, + 1.2328098732978106, + 0.8522446248680353, + 2.8716497644782066, + 0.6956554520875216, + 1.119828598573804, + 1.9405222702771425, + 0.7432997785508633, + 0.0, + 0.7066717874258757, + 2.536036418750882, + 2.748221072368324, + 0.12064871564507484, + 1.8081171326339245, + 1.2583162914961576, + 0.9927252978086472, + 0.6773193776607513, + 0.6881602630019188, + 2.075579294934869, + 0.6627333126962185, + 2.412185102701187, + 1.291936732828617, + 1.3270869459956884, + 2.1363442447036505, + 1.0604492891579866, + 0.18455431424081326, + 0.6702193915843964, + 2.1298603024333715, + 0.9940132796764374, + 1.2138807214796543, + 0.42896540090441704, + 1.0067254975438118, + 1.678801316767931, + 2.6480490136891603, + 2.75600091740489, + 2.0798526648432016, + 1.5990031203255057, + 1.6476479843258858, + 2.2072550505399704, + 1.9756182711571455 + ], + "unique_experts": 63, + "load_cv": 0.4293662747538174, + "normalized_load_entropy": 0.9747911007421401, + "max_load_share": 0.03140096618357488 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 166, + "ordered_topk_exact_tokens": 108, + "set_exact_tokens": 128, + "mean_set_jaccard": 0.9323006310958118, + "mean_token_weighted_tv": 0.011081505953951413, + "aggregate_load_tv": 0.02710843373493976 + }, + "system_bos": { + "tokens": 166, + "ordered_topk_exact_tokens": 109, + "set_exact_tokens": 127, + "mean_set_jaccard": 0.9315834767641998, + "mean_token_weighted_tv": 0.013537548471197307, + "aggregate_load_tv": 0.024096385542168672 + }, + "system_x": { + "tokens": 166, + "ordered_topk_exact_tokens": 99, + "set_exact_tokens": 126, + "mean_set_jaccard": 0.9285714285714287, + "mean_token_weighted_tv": 0.015075402816824884, + "aggregate_load_tv": 0.02710843373493975 + }, + "system_period": { + "tokens": 166, + "ordered_topk_exact_tokens": 95, + "set_exact_tokens": 122, + "mean_set_jaccard": 0.9229776247848536, + "mean_token_weighted_tv": 0.015698794802897667, + "aggregate_load_tv": 0.028112449799196783 + }, + "bos_at_s0": { + "tokens": 166, + "ordered_topk_exact_tokens": 73, + "set_exact_tokens": 94, + "mean_set_jaccard": 0.8618760757314973, + "mean_token_weighted_tv": 0.02501117537381599, + "aggregate_load_tv": 0.05020080321285139 + }, + "bos_at_s1": { + "tokens": 166, + "ordered_topk_exact_tokens": 75, + "set_exact_tokens": 100, + "mean_set_jaccard": 0.8689041881812967, + "mean_token_weighted_tv": 0.02470858722745654, + "aggregate_load_tv": 0.053212851405622486 + }, + "x_at_s0": { + "tokens": 166, + "ordered_topk_exact_tokens": 77, + "set_exact_tokens": 99, + "mean_set_jaccard": 0.8756454388984509, + "mean_token_weighted_tv": 0.022899861088448978, + "aggregate_load_tv": 0.04417670682730923 + }, + "x_at_s1": { + "tokens": 166, + "ordered_topk_exact_tokens": 72, + "set_exact_tokens": 96, + "mean_set_jaccard": 0.8658921399885255, + "mean_token_weighted_tv": 0.02498398995565542, + "aggregate_load_tv": 0.052208835341365445 + }, + "period_at_s0": { + "tokens": 166, + "ordered_topk_exact_tokens": 76, + "set_exact_tokens": 96, + "mean_set_jaccard": 0.8666092943201377, + "mean_token_weighted_tv": 0.023962028891252107, + "aggregate_load_tv": 0.046184738955823285 + }, + "period_at_s1": { + "tokens": 166, + "ordered_topk_exact_tokens": 73, + "set_exact_tokens": 96, + "mean_set_jaccard": 0.8684738955823292, + "mean_token_weighted_tv": 0.024592307979712284, + "aggregate_load_tv": 0.05120481927710843 + } + } + }, + "layer_03": { + "layer": 3, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "4423a8becf6ae1cd0c352555f915653c76609348609fa615a2cb0cee52fee565", + "route_weight_sha256": "3697a1e90ae98be72147e74a802ffac47ab1f0238adde06b71070aa9cb5e07c9", + "loads": [ + 18, + 28, + 9, + 10, + 17, + 15, + 11, + 22, + 16, + 17, + 9, + 17, + 7, + 25, + 13, + 16, + 21, + 13, + 19, + 19, + 17, + 12, + 13, + 14, + 12, + 17, + 11, + 31, + 15, + 14, + 20, + 10, + 10, + 21, + 9, + 26, + 17, + 14, + 23, + 6, + 6, + 11, + 7, + 13, + 16, + 12, + 18, + 19, + 19, + 26, + 13, + 14, + 17, + 14, + 25, + 13, + 7, + 13, + 23, + 13, + 25, + 11, + 25, + 2 + ], + "weighted_loads": [ + 1.425124879926443, + 2.7225856371223927, + 0.284602589905262, + 0.7823557704687119, + 1.0193175040185452, + 1.2201712187379599, + 0.681293647736311, + 1.2646731920540333, + 0.5330955442041159, + 1.3561806939542294, + 0.309687040746212, + 0.6162763368338346, + 0.640675351023674, + 1.836299465969205, + 0.6347858179360628, + 0.5932933613657951, + 1.077930610626936, + 0.5650718230754137, + 1.7839463502168655, + 1.7024692706763744, + 1.0937318671494722, + 0.9523100890219212, + 0.9877341631799936, + 0.4287371374666691, + 0.687665892764926, + 0.6601129155606031, + 0.7012062072753906, + 3.4035648219287395, + 0.9518603216856718, + 0.6772479265928268, + 1.548393676057458, + 0.30860143154859543, + 0.45303880982100964, + 1.347547112032771, + 0.2728436402976513, + 0.9110347721725702, + 1.836925022304058, + 1.0543557051569223, + 1.676435373723507, + 0.3689071200788021, + 0.20524206012487411, + 0.35130421817302704, + 0.37458672001957893, + 0.821073804050684, + 1.07448492012918, + 1.2815144285559654, + 1.5101251397281885, + 1.3802746385335922, + 1.5696001686155796, + 2.233260579407215, + 0.41415017656981945, + 0.8735995255410671, + 2.0341656766831875, + 0.9959614966064692, + 2.1629689522087574, + 0.7031192015856504, + 0.7114507723599672, + 0.3977574612945318, + 1.8892226330935955, + 1.2174419332295656, + 1.2614257037639618, + 0.6522084549069405, + 1.7514285240322351, + 0.06802940182387829 + ], + "unique_experts": 64, + "load_cv": 0.38249717890395735, + "normalized_load_entropy": 0.9818660563171818, + "max_load_share": 0.03112449799196787 + }, + "full_input": { + "tokens": 191, + "top_k": 6, + "decisions": 1146, + "ordered_route_sha256": "7c8a709a3d9a0fee6df6f412b7d744bfd21343ae6019dc2dd06314ace73f4e88", + "route_weight_sha256": "68d0e24586ba0154995ecc5c51c614d711fbdc074b348b770fe37e4f5f810881", + "loads": [ + 28, + 28, + 9, + 20, + 19, + 19, + 11, + 31, + 16, + 23, + 11, + 18, + 9, + 30, + 19, + 16, + 21, + 13, + 19, + 19, + 19, + 15, + 19, + 14, + 12, + 19, + 11, + 37, + 15, + 17, + 22, + 10, + 10, + 21, + 18, + 26, + 17, + 14, + 23, + 6, + 6, + 12, + 17, + 14, + 16, + 12, + 31, + 19, + 25, + 36, + 13, + 14, + 18, + 14, + 29, + 15, + 7, + 14, + 23, + 13, + 30, + 11, + 29, + 4 + ], + "weighted_loads": [ + 2.9545056466013193, + 2.7225856371223927, + 0.284602589905262, + 1.3701923079788685, + 1.0478689025621861, + 1.4394976403564215, + 0.681293647736311, + 2.7072961404919624, + 0.5330955442041159, + 1.6262693300959654, + 0.38240446150302887, + 0.6171581451199017, + 0.6527188285253942, + 2.250080430880189, + 0.9851922187954187, + 0.5932933613657951, + 1.077930610626936, + 0.5650718230754137, + 1.7839463502168655, + 1.7024692706763744, + 1.166545506566763, + 1.2377152480185032, + 1.3864794690161943, + 0.4287371374666691, + 0.687665892764926, + 0.6738210525363684, + 0.7012062072753906, + 3.6268382389098406, + 0.9518603216856718, + 0.8665756471455097, + 1.6463866215199232, + 0.30860143154859543, + 0.45303880982100964, + 1.347547112032771, + 1.3089331276714802, + 0.9110347721725702, + 1.836925022304058, + 1.0543557051569223, + 1.676435373723507, + 0.3689071200788021, + 0.20524206012487411, + 0.36271512415260077, + 0.9506641607731581, + 0.8484381604939699, + 1.07448492012918, + 1.2815144285559654, + 3.332868753001094, + 1.3802746385335922, + 2.1880274564027786, + 2.849745124578476, + 0.41415017656981945, + 0.8735995255410671, + 2.048922300338745, + 0.9959614966064692, + 3.994079876691103, + 0.7814754005521536, + 0.7114507723599672, + 0.4105578428134322, + 1.8892226330935955, + 1.2174419332295656, + 1.6566281467676163, + 0.6522084549069405, + 2.19301681406796, + 0.14393716491758823 + ], + "unique_experts": 64, + "load_cv": 0.4070135801133139, + "normalized_load_entropy": 0.9801932692724916, + "max_load_share": 0.03228621291448516 + } + }, + "s1_eos": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "c318bea27fd27e89895984939f0be48b6a784f47d3e213975f50e0effc8caeca", + "route_weight_sha256": "90ab267bcc87755a942f49d0e6eab847a10c925c66ecf700fcf1eb921976666a", + "loads": [ + 18, + 28, + 9, + 10, + 17, + 15, + 11, + 23, + 12, + 17, + 9, + 20, + 7, + 26, + 12, + 16, + 23, + 13, + 19, + 19, + 17, + 12, + 13, + 11, + 13, + 17, + 11, + 31, + 15, + 13, + 20, + 8, + 9, + 21, + 8, + 28, + 17, + 14, + 23, + 6, + 10, + 11, + 7, + 14, + 16, + 12, + 17, + 19, + 21, + 27, + 12, + 14, + 17, + 15, + 25, + 12, + 8, + 10, + 23, + 13, + 24, + 11, + 25, + 2 + ], + "weighted_loads": [ + 1.5021937415003777, + 2.6584226563572884, + 0.2836862448602915, + 0.7611759789288044, + 0.9840711243450642, + 1.2293661776930094, + 0.656213779002428, + 1.3137091733515263, + 0.42212208919227123, + 1.347763380035758, + 0.3112540077418089, + 0.7215506955981255, + 0.6507677435874939, + 1.8909546490758657, + 0.5977103095501661, + 0.5979000460356474, + 1.140435365960002, + 0.560417789965868, + 1.7611968722194433, + 1.7071468234062195, + 1.1004959307610989, + 0.947274349629879, + 0.9819847550243139, + 0.33936502411961555, + 0.7017674278467894, + 0.655588187277317, + 0.6918074190616608, + 3.3708102889358997, + 0.9418246280401945, + 0.6591058652848005, + 1.5467754639685154, + 0.2639581486582756, + 0.42809830605983734, + 1.3466101083904505, + 0.24678898230195045, + 0.9612659886479378, + 1.7886436805129051, + 1.057771448045969, + 1.6643440295010805, + 0.36405181139707565, + 0.3176400065422058, + 0.3483946155756712, + 0.387623792514205, + 0.8682141043245792, + 1.0718821790069342, + 1.279241669923067, + 1.4753069560974836, + 1.3966229893267155, + 1.6539730746299028, + 2.264065135270357, + 0.4069085791707039, + 0.881838895380497, + 2.0384906958788633, + 1.011850392445922, + 2.165757730603218, + 0.653815807774663, + 0.7476276624947786, + 0.30741064064204693, + 1.8640840537846088, + 1.208341734483838, + 1.204354140907526, + 0.6494269520044327, + 1.6990973725914955, + 0.0609049778431654 + ], + "unique_experts": 64, + "load_cv": 0.39754979307044713, + "normalized_load_entropy": 0.9807114692691323, + "max_load_share": 0.03112449799196787 + }, + "full_input": { + "tokens": 207, + "top_k": 6, + "decisions": 1242, + "ordered_route_sha256": "d803573d67deab7b5e05f2c60d49f654e923c24920bd5b4c92ba1bb9dcc7d799", + "route_weight_sha256": "0b79993a9d4878005dd79f9cb54e63b892fe48d0dedc8b7894fd0e7c6c8f9110", + "loads": [ + 32, + 30, + 9, + 21, + 18, + 21, + 11, + 35, + 12, + 26, + 14, + 21, + 11, + 32, + 20, + 17, + 25, + 13, + 20, + 19, + 19, + 18, + 24, + 11, + 15, + 20, + 11, + 33, + 15, + 16, + 22, + 8, + 9, + 23, + 16, + 28, + 17, + 19, + 23, + 7, + 11, + 12, + 22, + 16, + 16, + 15, + 34, + 19, + 29, + 37, + 12, + 20, + 21, + 20, + 30, + 18, + 8, + 11, + 30, + 14, + 34, + 12, + 31, + 9 + ], + "weighted_loads": [ + 3.428375506773591, + 2.7326010558754206, + 0.2836862448602915, + 1.4172542467713356, + 0.9846080306451768, + 1.55321148596704, + 0.656213779002428, + 2.846093062311411, + 0.42212208919227123, + 1.7942098740604706, + 0.454110462218523, + 0.7224325038841926, + 0.7403532820753753, + 2.358924360945821, + 1.1290522459894419, + 0.6466467250138521, + 1.3544071968644857, + 0.560417789965868, + 1.8168482761830091, + 1.7071468234062195, + 1.1669977456331253, + 1.3347498662769794, + 1.8837835285812616, + 0.33936502411961555, + 0.8029993008822203, + 0.7114773076027632, + 0.6918074190616608, + 3.4377483427524567, + 0.9418246280401945, + 0.8373359683901072, + 1.6402242444455624, + 0.2639581486582756, + 0.42809830605983734, + 1.4193527940660715, + 1.1682181023061275, + 0.9612659886479378, + 1.7886436805129051, + 1.4735692664980888, + 1.6643440295010805, + 0.41440221667289734, + 0.39204709231853485, + 0.3572435975074768, + 1.092855654656887, + 0.937789972871542, + 1.0718821790069342, + 1.5210220366716385, + 3.896327329799533, + 1.3966229893267155, + 2.5780990999192, + 2.7294759154319763, + 0.4069085791707039, + 1.6568078845739365, + 2.24874329008162, + 1.7291219141334295, + 4.110222361981869, + 0.9657215233892202, + 0.7476276624947786, + 0.31648814119398594, + 2.3494325093925, + 1.2388897873461246, + 1.8583664689213037, + 0.6994914971292019, + 2.16726241633296, + 0.5039397086948156 + ], + "unique_experts": 64, + "load_cv": 0.40067505873901377, + "normalized_load_entropy": 0.9808792452081919, + "max_load_share": 0.029790660225442835 + } + }, + "s0_bos": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "0655e4b142f59fbf2fde53bcb9a259df09975418f410d80a966d3f7d63df9975", + "route_weight_sha256": "118bbaa6946f820afed761a7887f30e662bedb20b8682ec8b82d9f26269a2fcc", + "loads": [ + 18, + 28, + 8, + 11, + 17, + 16, + 7, + 21, + 14, + 17, + 8, + 15, + 7, + 24, + 14, + 19, + 20, + 15, + 19, + 19, + 17, + 13, + 13, + 14, + 12, + 17, + 11, + 31, + 15, + 15, + 21, + 7, + 11, + 20, + 13, + 31, + 17, + 14, + 23, + 5, + 9, + 12, + 9, + 13, + 16, + 12, + 17, + 18, + 23, + 27, + 7, + 13, + 16, + 12, + 25, + 15, + 8, + 7, + 21, + 12, + 28, + 11, + 24, + 4 + ], + "weighted_loads": [ + 1.4918346963822842, + 2.6946911327540874, + 0.25365722738206387, + 0.8169848136603832, + 1.0655970983207226, + 1.2772406730800867, + 0.5255216285586357, + 1.1509323567152023, + 0.47040750086307526, + 1.3936025146394968, + 0.27116018161177635, + 0.5996111929416656, + 0.6655316650867462, + 1.8087488915771246, + 0.6518257446587086, + 0.6850922051817179, + 1.041177324950695, + 0.6292495559900999, + 1.8280152156949043, + 1.6947355065494776, + 1.0460664797574282, + 0.9750845097005367, + 0.9722848478704691, + 0.41810243763029575, + 0.6736198626458645, + 0.6691267509013414, + 0.7071971781551838, + 3.4535006023943424, + 0.990753935649991, + 0.7332804203033447, + 1.5019306633621454, + 0.23441175185143948, + 0.464145228266716, + 1.362887717783451, + 0.38882713206112385, + 1.0174213368445635, + 1.857095519080758, + 1.0331898890435696, + 1.7050766963511705, + 0.3170819841325283, + 0.279833996668458, + 0.3813376184552908, + 0.44131219759583473, + 0.7796545550227165, + 1.0317093171179295, + 1.3004975784569979, + 1.4777810536324978, + 1.3259362168610096, + 1.5606451723724604, + 2.3903925586491823, + 0.22534110955893993, + 0.8378384932875633, + 2.0029985308647156, + 0.9009597711265087, + 2.1517117843031883, + 0.7705345954746008, + 0.7347330264747143, + 0.21775180101394653, + 1.8354918099939823, + 1.1878961063921452, + 1.366210650652647, + 0.6552949324250221, + 1.7443439550697803, + 0.1385972686111927 + ], + "unique_experts": 64, + "load_cv": 0.4022284339792521, + "normalized_load_entropy": 0.9804869903894776, + "max_load_share": 0.03112449799196787 + }, + "full_input": { + "tokens": 191, + "top_k": 6, + "decisions": 1146, + "ordered_route_sha256": "e80af9273c501ce83804fc96e61e3c7fa69d5787812e051a968a759517e4de36", + "route_weight_sha256": "2823742d4c5a67127ed8acc8c0aeab9f7667d66bb3990c18791aa516fc1ccf66", + "loads": [ + 29, + 28, + 8, + 21, + 19, + 21, + 7, + 30, + 14, + 22, + 11, + 16, + 8, + 28, + 20, + 19, + 20, + 15, + 20, + 19, + 19, + 16, + 20, + 14, + 12, + 18, + 11, + 37, + 15, + 19, + 23, + 7, + 11, + 20, + 21, + 31, + 17, + 14, + 23, + 5, + 9, + 12, + 20, + 14, + 16, + 12, + 30, + 18, + 31, + 37, + 7, + 13, + 16, + 12, + 28, + 17, + 8, + 7, + 21, + 12, + 33, + 11, + 28, + 6 + ], + "weighted_loads": [ + 3.182479163631797, + 2.6946911327540874, + 0.25365722738206387, + 1.4048213511705399, + 1.0941484968643636, + 1.5605219583958387, + 0.5255216285586357, + 2.423363771289587, + 0.47040750086307526, + 1.6465820063021965, + 0.3760199099779129, + 0.6004930012277327, + 0.6660081711597741, + 2.19548181258142, + 1.0208580009639263, + 0.6850922051817179, + 1.041177324950695, + 0.6292495559900999, + 1.8645938895642757, + 1.6947355065494776, + 1.1176734864711761, + 1.2641587145626545, + 1.387365199625492, + 0.41810243763029575, + 0.6736198626458645, + 0.6696572192013264, + 0.7071971781551838, + 3.6767740193754435, + 0.990753935649991, + 0.9532027170062065, + 1.5991294030100107, + 0.23441175185143948, + 0.464145228266716, + 1.362887717783451, + 1.3883420247584581, + 1.0174213368445635, + 1.857095519080758, + 1.0331898890435696, + 1.7050766963511705, + 0.3170819841325283, + 0.279833996668458, + 0.3813376184552908, + 1.1371428724378347, + 0.8070189114660025, + 1.0317093171179295, + 1.3004975784569979, + 3.497674286365509, + 1.3259362168610096, + 2.337701542302966, + 3.006877103820443, + 0.22534110955893993, + 0.8378384932875633, + 2.0029985308647156, + 0.9009597711265087, + 3.2830248549580574, + 0.8433841969817877, + 0.7347330264747143, + 0.21775180101394653, + 1.8354918099939823, + 1.1878961063921452, + 1.7396967634558678, + 0.6552949324250221, + 2.187557179480791, + 0.21494802832603455 + ], + "unique_experts": 64, + "load_cv": 0.4361430781748087, + "normalized_load_entropy": 0.9771297033621716, + "max_load_share": 0.03228621291448516 + } + }, + "s1_bos": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "5e3d6f5a4f2f86be6c61dbd50c896620ab9d9d9131ad6bee2d89dad6c78cb4a5", + "route_weight_sha256": "eb49184b47101a4b234eda0d7b926f948d2c42158cd12a24c19615f166445aba", + "loads": [ + 19, + 28, + 8, + 11, + 15, + 16, + 11, + 22, + 13, + 18, + 9, + 17, + 7, + 25, + 14, + 19, + 20, + 16, + 19, + 19, + 15, + 12, + 12, + 9, + 10, + 17, + 11, + 31, + 17, + 14, + 20, + 8, + 9, + 20, + 12, + 27, + 17, + 13, + 23, + 5, + 11, + 14, + 12, + 13, + 16, + 12, + 18, + 18, + 23, + 27, + 8, + 13, + 16, + 13, + 25, + 14, + 8, + 11, + 20, + 13, + 27, + 11, + 24, + 1 + ], + "weighted_loads": [ + 1.5456922817975283, + 2.6412143893539906, + 0.25130673684179783, + 0.8151645101606846, + 0.9611923173069954, + 1.2803626582026482, + 0.6183321587741375, + 1.2153669372200966, + 0.4460242800414562, + 1.4355933610349894, + 0.302663778886199, + 0.6714673843234777, + 0.6600002758204937, + 1.8273365255445242, + 0.6294919587671757, + 0.6807849742472172, + 1.0356682669371367, + 0.6539336703717709, + 1.8215287253260612, + 1.654323287308216, + 1.0060723908245564, + 0.944572426378727, + 0.911887489259243, + 0.2804259806871414, + 0.6062791589647532, + 0.6812455300241709, + 0.6871384084224701, + 3.4249846674501896, + 1.0451292283833027, + 0.7398080565035343, + 1.4731267113238573, + 0.2605342883616686, + 0.39684091694653034, + 1.3217786885797977, + 0.3654323723167181, + 0.9055001121014357, + 1.8264238312840462, + 1.0462224148213863, + 1.6862644404172897, + 0.3199850618839264, + 0.33432886376976967, + 0.4356412701308727, + 0.5587872639298439, + 0.7818566188216209, + 1.0181459989398718, + 1.3022458218038082, + 1.512435358017683, + 1.3446112424135208, + 1.5712594110518694, + 2.376817075535655, + 0.2530136965215206, + 0.8733083866536617, + 2.0005444809794426, + 0.8976048342883587, + 2.237440377473831, + 0.7130546402186155, + 0.7264074254781008, + 0.3262152187526226, + 1.6990672014653683, + 1.2250807136297226, + 1.3272589650005102, + 0.6506645642220974, + 1.6661077104508877, + 0.047952160239219666 + ], + "unique_experts": 64, + "load_cv": 0.3905093345392044, + "normalized_load_entropy": 0.9809479730465516, + "max_load_share": 0.03112449799196787 + }, + "full_input": { + "tokens": 207, + "top_k": 6, + "decisions": 1242, + "ordered_route_sha256": "5331c1744022547991250b2eae913865f8f9542138c5675ab64453e76f431881", + "route_weight_sha256": "65809830664af8f985b386a46766a14306a63f61b94998ca693124f0c3d19ff8", + "loads": [ + 34, + 30, + 8, + 22, + 16, + 22, + 11, + 34, + 13, + 27, + 14, + 18, + 10, + 31, + 22, + 20, + 22, + 16, + 21, + 19, + 17, + 18, + 24, + 9, + 12, + 19, + 11, + 33, + 17, + 17, + 22, + 8, + 9, + 22, + 20, + 27, + 17, + 18, + 23, + 6, + 12, + 14, + 28, + 15, + 16, + 15, + 36, + 18, + 32, + 37, + 8, + 19, + 19, + 18, + 29, + 20, + 8, + 11, + 27, + 14, + 37, + 12, + 30, + 8 + ], + "weighted_loads": [ + 3.589585915207863, + 2.7153927888721228, + 0.25130673684179783, + 1.4712427780032158, + 0.961729223607108, + 1.6249005421996117, + 0.6183321587741375, + 2.632806032896042, + 0.4460242800414562, + 1.8950548160937615, + 0.44552023336291313, + 0.6723491926095448, + 0.7416435559280217, + 2.321206694468856, + 1.1770818047225475, + 0.7295316532254219, + 1.2496400978416204, + 0.6539336703717709, + 1.9138705395162106, + 1.654323287308216, + 1.0765573866665363, + 1.3396068401634693, + 1.825262013822794, + 0.2804259806871414, + 0.7075110320001841, + 0.7282859720289707, + 0.6871384084224701, + 3.4919227212667465, + 1.0451292283833027, + 0.9088424444198608, + 1.5651239324361086, + 0.2605342883616686, + 0.39684091694653034, + 1.3945213742554188, + 1.2950219344347715, + 0.9055001121014357, + 1.8264238312840462, + 1.4620202332735062, + 1.6862644404172897, + 0.3703354671597481, + 0.4087359495460987, + 0.4356412701308727, + 1.4046528041362762, + 0.8514324873685837, + 1.0181459989398718, + 1.5440261885523796, + 3.952333353459835, + 1.3446112424135208, + 2.5982654113322496, + 2.842227855697274, + 0.2530136965215206, + 1.6482773758471012, + 2.200401473790407, + 1.6148763559758663, + 3.39133869856596, + 1.0171538796275854, + 0.7264074254781008, + 0.3262152187526226, + 2.1844156570732594, + 1.2556287664920092, + 1.9506659731268883, + 0.7007291093468666, + 2.166557405143976, + 0.49205703288316727 + ], + "unique_experts": 64, + "load_cv": 0.41681425190847776, + "normalized_load_entropy": 0.9791446052337518, + "max_load_share": 0.029790660225442835 + } + }, + "s0_x": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "4370d1447e531fae8edf2420d9ec7dc72941913147d8c0226d83f9da99640c19", + "route_weight_sha256": "b96d2dc32e079bb18f752385b97bb097cc38b02d51c9e6dd868d40c9a11a327e", + "loads": [ + 18, + 29, + 8, + 11, + 17, + 16, + 7, + 21, + 16, + 17, + 9, + 15, + 7, + 24, + 15, + 19, + 21, + 14, + 18, + 19, + 17, + 14, + 11, + 14, + 11, + 17, + 11, + 31, + 14, + 15, + 22, + 9, + 11, + 20, + 9, + 28, + 17, + 14, + 23, + 5, + 7, + 12, + 8, + 13, + 15, + 12, + 17, + 18, + 24, + 27, + 10, + 13, + 16, + 13, + 25, + 16, + 9, + 8, + 21, + 12, + 27, + 11, + 24, + 4 + ], + "weighted_loads": [ + 1.5093982461839914, + 2.749072879552841, + 0.25637780502438545, + 0.8098415061831474, + 1.0582353472709656, + 1.2731526140123606, + 0.5417652260512114, + 1.15728272870183, + 0.524469381198287, + 1.4216436222195625, + 0.2940380834043026, + 0.5994198974221945, + 0.6587267033755779, + 1.7804891113191843, + 0.6804813500493765, + 0.6937653906643391, + 1.075516451150179, + 0.5949437730014324, + 1.8341493159532547, + 1.6936853751540184, + 1.0547154173254967, + 1.0416270717978477, + 0.8488441146910191, + 0.42277707532048225, + 0.616593100130558, + 0.6656084060668945, + 0.7045244723558426, + 3.4272350668907166, + 0.9500270169228315, + 0.7319815792143345, + 1.534026799723506, + 0.28666521050035954, + 0.46227996051311493, + 1.3672167677432299, + 0.2837782334536314, + 0.9297545962035656, + 1.8031584117561579, + 1.039138713851571, + 1.7061662748456001, + 0.31316009908914566, + 0.23448443226516247, + 0.37619302421808243, + 0.40157815255224705, + 0.780113935470581, + 1.024630457162857, + 1.300461696460843, + 1.4863463938236237, + 1.3305489793419838, + 1.6222448572516441, + 2.367443947121501, + 0.31096548959612846, + 0.842156644910574, + 2.0040759071707726, + 0.9343805518001318, + 2.127298265695572, + 0.8004158306866884, + 0.7534348852932453, + 0.25065372698009014, + 1.8677225075662136, + 1.1832932960242033, + 1.3886951319873333, + 0.6502680070698261, + 1.7246323488652706, + 0.13870635442435741 + ], + "unique_experts": 64, + "load_cv": 0.3962494120562127, + "normalized_load_entropy": 0.9810520742331753, + "max_load_share": 0.03112449799196787 + }, + "full_input": { + "tokens": 191, + "top_k": 6, + "decisions": 1146, + "ordered_route_sha256": "f3a3c258ac15d290ed8eaeeabe33e69b4d023cab3b3348985bfa394b2292fd2f", + "route_weight_sha256": "922233c166e2b7b2e94c4cd6a8ae2b4630d2f9263fdb8c3828212c3b4f7a489b", + "loads": [ + 27, + 29, + 8, + 22, + 20, + 20, + 7, + 31, + 16, + 22, + 11, + 16, + 8, + 28, + 21, + 19, + 21, + 14, + 18, + 19, + 18, + 17, + 17, + 14, + 11, + 18, + 12, + 38, + 14, + 19, + 24, + 9, + 11, + 20, + 18, + 28, + 18, + 14, + 23, + 5, + 7, + 12, + 18, + 14, + 15, + 13, + 30, + 18, + 30, + 38, + 10, + 13, + 16, + 13, + 28, + 18, + 9, + 8, + 21, + 12, + 33, + 11, + 28, + 6 + ], + "weighted_loads": [ + 2.9064157847315073, + 2.749072879552841, + 0.25637780502438545, + 1.5317015014588833, + 1.117913457332179, + 1.5143512543290854, + 0.5417652260512114, + 2.4584408812224865, + 0.524469381198287, + 1.6990459382650442, + 0.36675550416111946, + 0.6003017057082616, + 0.6592032094486058, + 2.168496759608388, + 1.01563117839396, + 0.6937653906643391, + 1.075516451150179, + 0.5949437730014324, + 1.8341493159532547, + 1.6936853751540184, + 1.0814759861677885, + 1.334476299583912, + 1.2283845692873, + 0.42277707532048225, + 0.616593100130558, + 0.6661388743668795, + 0.7466851957142353, + 3.6981957647949457, + 0.9500270169228315, + 0.9616535156965256, + 1.6317996811121702, + 0.28666521050035954, + 0.46227996051311493, + 1.3672167677432299, + 1.3843969609588385, + 0.9297545962035656, + 1.8511070851236582, + 1.039138713851571, + 1.7061662748456001, + 0.31316009908914566, + 0.23448443226516247, + 0.37619302421808243, + 1.027527080848813, + 0.807478291913867, + 1.024630457162857, + 1.3271086886525154, + 3.5171303786337376, + 1.3305489793419838, + 2.2440040186047554, + 3.0473812501877546, + 0.31096548959612846, + 0.842156644910574, + 2.0040759071707726, + 0.9343805518001318, + 3.2360740937292576, + 0.8765952046960592, + 0.7534348852932453, + 0.25065372698009014, + 1.8677225075662136, + 1.1832932960242033, + 1.8424156866967678, + 0.6502680070698261, + 2.1695293597877026, + 0.21501425839960575 + ], + "unique_experts": 64, + "load_cv": 0.42927325622441626, + "normalized_load_entropy": 0.978155972661908, + "max_load_share": 0.03315881326352531 + } + }, + "s1_x": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "5848353052f595fbe94beebde5a3bb526f65c87cbaf7d6b907fd25e141da40c9", + "route_weight_sha256": "0eea04bda18303915364cbfa7346308fdf0c1a96e7913bf049deac8ec6212411", + "loads": [ + 19, + 28, + 10, + 10, + 17, + 16, + 10, + 22, + 12, + 18, + 9, + 17, + 7, + 25, + 14, + 19, + 20, + 16, + 19, + 19, + 14, + 12, + 11, + 11, + 10, + 17, + 11, + 31, + 15, + 14, + 20, + 9, + 9, + 20, + 11, + 26, + 17, + 13, + 23, + 5, + 10, + 11, + 12, + 13, + 15, + 12, + 19, + 18, + 23, + 27, + 8, + 14, + 16, + 13, + 25, + 14, + 8, + 12, + 22, + 12, + 29, + 11, + 24, + 2 + ], + "weighted_loads": [ + 1.5301567241549492, + 2.65829836204648, + 0.30594463273882866, + 0.7811149172484875, + 0.9761379603296518, + 1.2962247915565968, + 0.5911255497485399, + 1.2287648655474186, + 0.41436032950878143, + 1.4663664232939482, + 0.2987923752516508, + 0.671490915119648, + 0.6554166302084923, + 1.8043709192425013, + 0.6305706799030304, + 0.6885490827262402, + 1.0404432211071253, + 0.6504392269998789, + 1.835618820041418, + 1.6568872444331646, + 0.9747933372855186, + 0.9449620507657528, + 0.8373490087687969, + 0.3398508056998253, + 0.5981817934662104, + 0.6833748202770948, + 0.6841877177357674, + 3.421755515038967, + 0.9975646492093801, + 0.7454831413924694, + 1.4767776746302843, + 0.2815896160900593, + 0.39339892752468586, + 1.3274214342236519, + 0.33328064903616905, + 0.889328857883811, + 1.8054779693484306, + 1.0292778760194778, + 1.6916712708771229, + 0.3256263956427574, + 0.32291641645133495, + 0.35439740121364594, + 0.5639434531331062, + 0.7911900505423546, + 1.0017898008227348, + 1.3002062253654003, + 1.5676284432411194, + 1.3400671929121017, + 1.6087746992707253, + 2.354333197697997, + 0.257708678022027, + 0.909251919016242, + 2.0492974370718002, + 0.8941730856895447, + 2.1788253113627434, + 0.7125255726277828, + 0.718817749992013, + 0.35859520733356476, + 1.7928595170378685, + 1.181892964988947, + 1.43658984079957, + 0.6518738530576229, + 1.6667450293898582, + 0.08584894984960556 + ], + "unique_experts": 64, + "load_cv": 0.39314376911401544, + "normalized_load_entropy": 0.9811935626448226, + "max_load_share": 0.03112449799196787 + }, + "full_input": { + "tokens": 207, + "top_k": 6, + "decisions": 1242, + "ordered_route_sha256": "8ea9a4196776d031c131db8295a73ed564b0ace886a7050911c0fd1b2cc1ebdf", + "route_weight_sha256": "c868f89f76eb3c3480c8c86e5f5fb2de629bb1541762d99bfc7c50618c378bab", + "loads": [ + 32, + 30, + 10, + 22, + 19, + 21, + 10, + 34, + 12, + 27, + 14, + 18, + 10, + 31, + 22, + 20, + 22, + 16, + 20, + 19, + 15, + 18, + 22, + 12, + 12, + 19, + 12, + 34, + 15, + 18, + 22, + 9, + 9, + 22, + 19, + 26, + 18, + 18, + 23, + 6, + 11, + 11, + 28, + 15, + 15, + 15, + 36, + 18, + 31, + 38, + 8, + 20, + 19, + 18, + 29, + 20, + 8, + 12, + 29, + 13, + 39, + 12, + 30, + 9 + ], + "weighted_loads": [ + 3.3010505195707083, + 2.7324767615646124, + 0.30594463273882866, + 1.584263652563095, + 1.0075305129867047, + 1.5945116952061653, + 0.5911255497485399, + 2.6400539949536324, + 0.41436032950878143, + 1.9462104763952084, + 0.44164882972836494, + 0.6723727234057151, + 0.7370599103160203, + 2.2889167349785566, + 1.1529122665524483, + 0.7372957617044449, + 1.254415052011609, + 0.6504392269998789, + 1.891270224004984, + 1.6568872444331646, + 1.0069034211337566, + 1.3412544876337051, + 1.7321045249700546, + 0.3600342124700546, + 0.6994136665016413, + 0.7304152622818947, + 0.7232865504920483, + 3.533607356250286, + 0.9975646492093801, + 0.9592308476567268, + 1.569171478971839, + 0.2815896160900593, + 0.39339892752468586, + 1.400164119899273, + 1.3076599799096584, + 0.889328857883811, + 1.845715206116438, + 1.4450756944715977, + 1.6916712708771229, + 0.3759768009185791, + 0.397323502227664, + 0.35439740121364594, + 1.3262807335704565, + 0.8607659190893173, + 1.0017898008227348, + 1.5419865921139717, + 3.9821711778640747, + 1.3400671929121017, + 2.525131966918707, + 2.8786714915186167, + 0.257708678022027, + 1.6842209082096815, + 2.249154429882765, + 1.6114446073770523, + 3.311854563653469, + 1.0198462791740894, + 0.718817749992013, + 0.35859520733356476, + 2.2782079726457596, + 1.2124410178512335, + 2.113024855032563, + 0.7019383981823921, + 2.1513116285204887, + 0.5299149639904499 + ], + "unique_experts": 64, + "load_cv": 0.41711276266830816, + "normalized_load_entropy": 0.9794192618781608, + "max_load_share": 0.03140096618357488 + } + }, + "s0_period": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "3c597da06e44dff09267af14bfc3dc93ec3b5abb3221c557b9d2acbf740fa050", + "route_weight_sha256": "402753f8de327fcf2f03bd2fba3346b76a6cc696bbdc1eb37bee77c437f16e23", + "loads": [ + 18, + 29, + 8, + 11, + 17, + 16, + 9, + 20, + 17, + 17, + 8, + 16, + 7, + 24, + 14, + 19, + 21, + 16, + 18, + 19, + 17, + 14, + 12, + 12, + 10, + 17, + 11, + 31, + 14, + 15, + 22, + 9, + 11, + 20, + 11, + 28, + 17, + 14, + 23, + 5, + 7, + 12, + 7, + 13, + 15, + 12, + 17, + 18, + 24, + 27, + 10, + 13, + 16, + 13, + 25, + 16, + 9, + 7, + 21, + 12, + 26, + 11, + 24, + 4 + ], + "weighted_loads": [ + 1.4449771642684937, + 2.72940181940794, + 0.25633387826383114, + 0.8076531738042831, + 1.0620128139853477, + 1.2755709495395422, + 0.5980052854865789, + 1.1164442971348763, + 0.5574225038290024, + 1.4192925728857517, + 0.276323975995183, + 0.6277262810617685, + 0.6599037498235703, + 1.7853990141302347, + 0.6461553126573563, + 0.6939973030239344, + 1.0787769462913275, + 0.6514924671500921, + 1.8395714685320854, + 1.695868093520403, + 1.0591357536613941, + 1.0530026853084564, + 0.8971274755895138, + 0.36791375651955605, + 0.5907324757426977, + 0.6661576051265001, + 0.7022915482521057, + 3.417776543647051, + 0.9464990049600601, + 0.7332005631178617, + 1.5346932467073202, + 0.2874361630529165, + 0.4670463427901268, + 1.364742809906602, + 0.3327146079391241, + 0.9274147301912308, + 1.8014843743294477, + 1.0301593896001577, + 1.7075578048825264, + 0.3174699582159519, + 0.22250527888536453, + 0.3759724386036396, + 0.3741287291049957, + 0.7857746221125126, + 1.0206557363271713, + 1.3071500323712826, + 1.4803463406860828, + 1.3310548812150955, + 1.59551783464849, + 2.3644285779446363, + 0.3073761649429798, + 0.8411351330578327, + 2.0077842324972153, + 0.9324521850794554, + 2.1086861230432987, + 0.7943308260291815, + 0.7550214342772961, + 0.2213056180626154, + 1.8516266234219074, + 1.1779944710433483, + 1.3219336029142141, + 0.6530761457979679, + 1.7344339545816183, + 0.1406517866998911 + ], + "unique_experts": 64, + "load_cv": 0.39429079932418243, + "normalized_load_entropy": 0.981163630414662, + "max_load_share": 0.03112449799196787 + }, + "full_input": { + "tokens": 191, + "top_k": 6, + "decisions": 1146, + "ordered_route_sha256": "087d5dba1b5da33f1315569a05667883ede0afd45977059a9121975f42876d95", + "route_weight_sha256": "079347f99205bd76bc5d5ee667095766db792ecba8e3aed1b6608856103eeb1a", + "loads": [ + 27, + 30, + 8, + 22, + 20, + 20, + 9, + 30, + 17, + 23, + 10, + 17, + 8, + 28, + 20, + 19, + 21, + 16, + 18, + 19, + 18, + 17, + 19, + 12, + 10, + 18, + 11, + 37, + 14, + 19, + 24, + 9, + 11, + 20, + 19, + 28, + 17, + 14, + 23, + 5, + 7, + 12, + 17, + 14, + 15, + 14, + 30, + 18, + 30, + 37, + 10, + 13, + 16, + 13, + 28, + 18, + 9, + 7, + 22, + 12, + 32, + 11, + 28, + 6 + ], + "weighted_loads": [ + 2.7682490423321724, + 2.8752708211541176, + 0.25633387826383114, + 1.4658698923885822, + 1.1305598940234631, + 1.519893055781722, + 0.5980052854865789, + 2.4730139672756195, + 0.5574225038290024, + 1.8521900482592173, + 0.34904139675199986, + 0.6286080893478356, + 0.6603802558965981, + 2.1701480094343424, + 1.10726198554039, + 0.6939973030239344, + 1.0787769462913275, + 0.6514924671500921, + 1.8395714685320854, + 1.695868093520403, + 1.085896322503686, + 1.3446603491902351, + 1.332956600934267, + 0.36791375651955605, + 0.5907324757426977, + 0.6666880734264851, + 0.7022915482521057, + 3.641049960628152, + 0.9464990049600601, + 0.954694701358676, + 1.6327709052711725, + 0.2874361630529165, + 0.4670463427901268, + 1.364742809906602, + 1.3322295006364584, + 0.9274147301912308, + 1.8014843743294477, + 1.0301593896001577, + 1.7075578048825264, + 0.3174699582159519, + 0.22250527888536453, + 0.3759724386036396, + 1.0044612884521484, + 0.8131389785557985, + 1.0206557363271713, + 1.3842102270573378, + 3.481770358979702, + 1.3310548812150955, + 2.211332568898797, + 2.980913123115897, + 0.3073761649429798, + 0.8411351330578327, + 2.0077842324972153, + 0.9324521850794554, + 3.2131657488644123, + 0.8693861979991198, + 0.7550214342772961, + 0.2213056180626154, + 1.890748307108879, + 1.1779944710433483, + 1.731572600081563, + 0.6530761457979679, + 2.194893693551421, + 0.21694925986230373 + ], + "unique_experts": 64, + "load_cv": 0.4248228608664341, + "normalized_load_entropy": 0.9783947070016424, + "max_load_share": 0.03228621291448516 + } + }, + "s1_period": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "c1115ec579a5a23c0ef5b1067f79a490d4cacb3e363016775915a0f278dc8a64", + "route_weight_sha256": "ba0f88bd5355e446d6112ecb6b0b42efe53552054377d1508c110a37edf3162f", + "loads": [ + 19, + 29, + 9, + 11, + 17, + 16, + 10, + 22, + 12, + 18, + 8, + 18, + 7, + 25, + 14, + 18, + 20, + 16, + 19, + 19, + 14, + 14, + 10, + 10, + 9, + 18, + 11, + 31, + 15, + 14, + 20, + 9, + 9, + 20, + 11, + 25, + 17, + 13, + 23, + 5, + 11, + 11, + 12, + 13, + 15, + 12, + 18, + 18, + 23, + 27, + 9, + 14, + 16, + 13, + 25, + 15, + 8, + 14, + 20, + 11, + 29, + 11, + 24, + 2 + ], + "weighted_loads": [ + 1.503190141171217, + 2.694362062960863, + 0.2824126407504082, + 0.8144879229366779, + 1.0020729936659336, + 1.2947887871414423, + 0.5915356688201427, + 1.2133462205529213, + 0.4125000908970833, + 1.4718803018331528, + 0.27186226285994053, + 0.7010192479938269, + 0.6558573022484779, + 1.8033910859376192, + 0.6294891182333231, + 0.6580757237970829, + 1.0439127031713724, + 0.6510864030569792, + 1.8554727640002966, + 1.6572589427232742, + 0.9812200516462326, + 1.0398929305374622, + 0.776002686470747, + 0.3119815196841955, + 0.5718814991414547, + 0.7115848995745182, + 0.6721782721579075, + 3.4158919230103493, + 0.999684015288949, + 0.7467757295817137, + 1.476139146834612, + 0.28075783140957355, + 0.39961927756667137, + 1.3212773706763983, + 0.3344445042312145, + 0.8584442660212517, + 1.7890288196504116, + 1.0314897671341896, + 1.6881745345890522, + 0.33020490035414696, + 0.35148688964545727, + 0.35413190536201, + 0.5628879740834236, + 0.7973530367016792, + 0.9971096143126488, + 1.3058990985155106, + 1.5160836465656757, + 1.3446697629988194, + 1.5911061465740204, + 2.3490443900227547, + 0.28025930374860764, + 0.9082879219204187, + 2.0504154413938522, + 0.894225487485528, + 2.1637422908097506, + 0.7383496183902025, + 0.7098968271166086, + 0.4205215610563755, + 1.7037685811519623, + 1.146078610792756, + 1.4454258661717176, + 0.6509838812053204, + 1.6701040882617235, + 0.0875597707927227 + ], + "unique_experts": 64, + "load_cv": 0.3923224086239673, + "normalized_load_entropy": 0.981218214394791, + "max_load_share": 0.03112449799196787 + }, + "full_input": { + "tokens": 207, + "top_k": 6, + "decisions": 1242, + "ordered_route_sha256": "9ef10ee71d60758d899edaf46d58365db40a028bf9a66c7b3273681aeccfc778", + "route_weight_sha256": "7cc678000ed25a2ab541a044e6c248c34cbf7d2768c0999a7195c4cb354beae3", + "loads": [ + 31, + 32, + 9, + 23, + 19, + 22, + 10, + 35, + 12, + 28, + 13, + 19, + 10, + 31, + 22, + 19, + 22, + 16, + 20, + 19, + 15, + 20, + 22, + 10, + 11, + 20, + 11, + 33, + 15, + 18, + 22, + 9, + 9, + 22, + 18, + 25, + 17, + 18, + 23, + 6, + 12, + 11, + 29, + 15, + 15, + 16, + 35, + 18, + 30, + 37, + 9, + 20, + 19, + 18, + 29, + 21, + 8, + 14, + 28, + 12, + 39, + 12, + 30, + 9 + ], + "weighted_loads": [ + 3.1714824438095093, + 2.8771074023097754, + 0.2824126407504082, + 1.5298093557357788, + 1.0391667063813657, + 1.6150186005979776, + 0.5915356688201427, + 2.707776416093111, + 0.4125000908970833, + 2.07805922703119, + 0.41471871733665466, + 0.701901056279894, + 0.7375005823560059, + 2.280395308509469, + 1.2365138363093138, + 0.7068224027752876, + 1.2578845340758562, + 0.6510864030569792, + 1.9111241679638624, + 1.6572589427232742, + 1.0133301354944706, + 1.4348097071051598, + 1.7444103471934795, + 0.3119815196841955, + 0.6731133721768856, + 0.758625341579318, + 0.6721782721579075, + 3.482829976826906, + 0.999684015288949, + 0.9555268567055464, + 1.5643501989543438, + 0.28075783140957355, + 0.39961927756667137, + 1.3940200563520193, + 1.2167348749935627, + 0.8584442660212517, + 1.7890288196504116, + 1.4472875855863094, + 1.6881745345890522, + 0.38055530562996864, + 0.4258939754217863, + 0.35413190536201, + 1.41643126308918, + 0.866928905248642, + 0.9971096143126488, + 1.6088778004050255, + 3.9379401989281178, + 1.3446697629988194, + 2.4619900211691856, + 2.814455170184374, + 0.28025930374860764, + 1.6832569111138582, + 2.250272434204817, + 1.6114970091730356, + 3.28812494315207, + 1.0447695720940828, + 0.7098968271166086, + 0.4205215610563755, + 2.23793463781476, + 1.1766266636550426, + 2.076947897672653, + 0.7010484263300896, + 2.1640316415578127, + 0.5309893563389778 + ], + "unique_experts": 64, + "load_cv": 0.41671470080272255, + "normalized_load_entropy": 0.9793160745008761, + "max_load_share": 0.03140096618357488 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 166, + "ordered_topk_exact_tokens": 123, + "set_exact_tokens": 137, + "mean_set_jaccard": 0.9500860585197936, + "mean_token_weighted_tv": 0.009671734971364579, + "aggregate_load_tv": 0.020080321285140555 + }, + "system_bos": { + "tokens": 166, + "ordered_topk_exact_tokens": 104, + "set_exact_tokens": 121, + "mean_set_jaccard": 0.9225473321858864, + "mean_token_weighted_tv": 0.014243623875754785, + "aggregate_load_tv": 0.030120481927710843 + }, + "system_x": { + "tokens": 166, + "ordered_topk_exact_tokens": 97, + "set_exact_tokens": 115, + "mean_set_jaccard": 0.9096385542168675, + "mean_token_weighted_tv": 0.016773132051913494, + "aggregate_load_tv": 0.034136546184738964 + }, + "system_period": { + "tokens": 166, + "ordered_topk_exact_tokens": 94, + "set_exact_tokens": 113, + "mean_set_jaccard": 0.9087779690189329, + "mean_token_weighted_tv": 0.01660779413082693, + "aggregate_load_tv": 0.03313253012048194 + }, + "bos_at_s0": { + "tokens": 166, + "ordered_topk_exact_tokens": 78, + "set_exact_tokens": 101, + "mean_set_jaccard": 0.8842512908777969, + "mean_token_weighted_tv": 0.0220324291219284, + "aggregate_load_tv": 0.040160642570281124 + }, + "bos_at_s1": { + "tokens": 166, + "ordered_topk_exact_tokens": 83, + "set_exact_tokens": 96, + "mean_set_jaccard": 0.8756454388984508, + "mean_token_weighted_tv": 0.02407828343650663, + "aggregate_load_tv": 0.03815261044176707 + }, + "x_at_s0": { + "tokens": 166, + "ordered_topk_exact_tokens": 86, + "set_exact_tokens": 104, + "mean_set_jaccard": 0.8894148020654046, + "mean_token_weighted_tv": 0.02168486067037805, + "aggregate_load_tv": 0.03514056224899599 + }, + "x_at_s1": { + "tokens": 166, + "ordered_topk_exact_tokens": 85, + "set_exact_tokens": 97, + "mean_set_jaccard": 0.8760757314974181, + "mean_token_weighted_tv": 0.02438517707029739, + "aggregate_load_tv": 0.035140562248995984 + }, + "period_at_s0": { + "tokens": 166, + "ordered_topk_exact_tokens": 89, + "set_exact_tokens": 108, + "mean_set_jaccard": 0.8962994836488813, + "mean_token_weighted_tv": 0.020730312509709095, + "aggregate_load_tv": 0.037148594377510044 + }, + "period_at_s1": { + "tokens": 166, + "ordered_topk_exact_tokens": 83, + "set_exact_tokens": 94, + "mean_set_jaccard": 0.8686173264486519, + "mean_token_weighted_tv": 0.025574606231761624, + "aggregate_load_tv": 0.04116465863453815 + } + } + }, + "layer_04": { + "layer": 4, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "49ad3e7559f8c05952ffdf96f61504fb46612368b8889d76b5e81202b35808ed", + "route_weight_sha256": "a82e7e5bc9e2fb1ba894b12fbe2fa9b25664bff9565d0c7e4f8781a7f6878769", + "loads": [ + 13, + 23, + 17, + 17, + 6, + 21, + 9, + 16, + 18, + 17, + 29, + 6, + 6, + 39, + 10, + 3, + 15, + 16, + 22, + 8, + 8, + 12, + 16, + 19, + 11, + 28, + 18, + 7, + 9, + 9, + 12, + 25, + 11, + 12, + 9, + 11, + 16, + 12, + 28, + 20, + 31, + 29, + 23, + 8, + 9, + 15, + 16, + 14, + 30, + 15, + 15, + 9, + 17, + 11, + 9, + 17, + 21, + 18, + 10, + 18, + 32, + 11, + 0, + 14 + ], + "weighted_loads": [ + 0.4953160881996155, + 0.7263909094035625, + 0.8438688199967146, + 1.3719006907194853, + 0.567534789443016, + 1.031493078917265, + 0.39900318160653114, + 1.094028890132904, + 1.4058056958019733, + 0.9429776221513748, + 2.6225841734558344, + 0.25349943339824677, + 0.2231010589748621, + 1.7194065414369106, + 0.31802091374993324, + 0.11336184665560722, + 1.3806293122470379, + 1.3249832354485989, + 1.1731038428843021, + 0.5358447879552841, + 0.57192138209939, + 0.4626362696290016, + 0.9482929967343807, + 1.2078467458486557, + 0.883844431489706, + 1.650953784584999, + 1.424288708716631, + 0.3489129450172186, + 0.4840471111238003, + 0.5575880911201239, + 0.9577946029603481, + 1.2520894799381495, + 0.3680218104273081, + 0.3670498691499233, + 0.5587123222649097, + 0.7394434008747339, + 0.5179035924375057, + 0.3579947967082262, + 2.5326004959642887, + 0.9704815354198217, + 3.576419124379754, + 2.1645282339304686, + 1.8498571328818798, + 0.2876525092869997, + 0.38231043703854084, + 0.9228580053895712, + 0.8597093261778355, + 1.0124384704977274, + 2.169921763241291, + 0.448419664055109, + 0.7321249321103096, + 0.6222077067941427, + 0.94751819036901, + 0.45940351486206055, + 0.47283317148685455, + 1.3815464675426483, + 0.7205586954951286, + 1.343345196917653, + 0.6753614153712988, + 1.316638806834817, + 3.5387444384396076, + 0.592116741463542, + 0.0, + 1.5191170237958431 + ], + "unique_experts": 63, + "load_cv": 0.49211128145007016, + "normalized_load_entropy": 0.9705714340194952, + "max_load_share": 0.0391566265060241 + }, + "full_input": { + "tokens": 191, + "top_k": 6, + "decisions": 1146, + "ordered_route_sha256": "4e24978d6927009b395a016710bffe5e575669e947e29246e9c4634921835074", + "route_weight_sha256": "2d915ee39de4fbd2423bd6c17589b0beeaaef434b9e23afd4249744f1691ccbf", + "loads": [ + 13, + 26, + 20, + 21, + 6, + 21, + 11, + 16, + 18, + 17, + 39, + 8, + 6, + 52, + 12, + 6, + 15, + 16, + 26, + 8, + 8, + 14, + 18, + 19, + 11, + 34, + 24, + 8, + 9, + 26, + 12, + 27, + 12, + 14, + 20, + 11, + 16, + 14, + 29, + 20, + 34, + 32, + 31, + 8, + 9, + 17, + 27, + 14, + 31, + 17, + 16, + 9, + 17, + 11, + 9, + 17, + 21, + 18, + 10, + 30, + 36, + 11, + 3, + 15 + ], + "weighted_loads": [ + 0.4953160881996155, + 0.8694262206554413, + 0.9941400848329067, + 1.64924894325668, + 0.567534789443016, + 1.031493078917265, + 0.495299581438303, + 1.094028890132904, + 1.4058056958019733, + 0.9429776221513748, + 3.2810791060328484, + 0.28001868538558483, + 0.2231010589748621, + 2.6329948268830776, + 0.36456286907196045, + 0.29001206159591675, + 1.3806293122470379, + 1.3249832354485989, + 1.3636867029999848, + 0.5358447879552841, + 0.57192138209939, + 1.5272556021809578, + 1.022963460534811, + 1.2078467458486557, + 0.883844431489706, + 2.108889400959015, + 1.9551558308303356, + 0.3568902490660548, + 0.4840471111238003, + 1.894802127382718, + 0.9577946029603481, + 1.283036301843822, + 0.39154661633074284, + 0.40729388035833836, + 1.59361653009546, + 0.7394434008747339, + 0.5179035924375057, + 0.4367100615054369, + 3.5296035148203373, + 0.9704815354198217, + 3.7173438388854265, + 2.381453761830926, + 2.207880450412631, + 0.2876525092869997, + 0.38231043703854084, + 1.1205564979463816, + 2.0062664933502674, + 1.0124384704977274, + 2.206717010587454, + 0.49873712472617626, + 0.7788811214268208, + 0.6222077067941427, + 0.94751819036901, + 0.45940351486206055, + 0.47283317148685455, + 1.3815464675426483, + 0.7205586954951286, + 1.343345196917653, + 0.6753614153712988, + 1.9984852969646454, + 3.980014049622696, + 0.592116741463542, + 0.2133628986775875, + 1.5596215054392815 + ], + "unique_experts": 64, + "load_cv": 0.5264579495489585, + "normalized_load_entropy": 0.9687276594568435, + "max_load_share": 0.04537521815008726 + } + }, + "s1_eos": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "911857b9a03ae7873303f1eb078196f540d84f6c0511ce57923ad48ca4c762df", + "route_weight_sha256": "12454eb387bbf25565b282ac3f28c2d48986c32a4c8cc1d73730a50aa95be9ef", + "loads": [ + 14, + 22, + 18, + 17, + 6, + 19, + 8, + 16, + 18, + 19, + 29, + 5, + 7, + 40, + 9, + 4, + 15, + 16, + 24, + 8, + 8, + 9, + 16, + 19, + 11, + 28, + 19, + 7, + 9, + 10, + 12, + 25, + 11, + 16, + 9, + 11, + 16, + 13, + 28, + 19, + 31, + 29, + 24, + 7, + 8, + 15, + 16, + 12, + 28, + 14, + 15, + 9, + 18, + 10, + 9, + 17, + 21, + 18, + 10, + 17, + 33, + 11, + 0, + 14 + ], + "weighted_loads": [ + 0.5258013512939215, + 0.705019548535347, + 0.8729757908731699, + 1.3709889743477106, + 0.558427419513464, + 0.9737813454121351, + 0.36825719848275185, + 1.0926653854548931, + 1.3953720293939114, + 1.0202059298753738, + 2.6196068730205297, + 0.2328675277531147, + 0.24850226193666458, + 1.7416605167090893, + 0.2914090361446142, + 0.14173981919884682, + 1.3572024889290333, + 1.327937861904502, + 1.243568180128932, + 0.5257339328527451, + 0.5570999793708324, + 0.36155175417661667, + 0.9298803918063641, + 1.2089345436543226, + 0.8887525796890259, + 1.677698627114296, + 1.4472205322235823, + 0.3417660612612963, + 0.486302986741066, + 0.5658729765564203, + 0.9465568736195564, + 1.24139603972435, + 0.3628622628748417, + 0.5074076093733311, + 0.5499201007187366, + 0.751037048175931, + 0.5276156663894653, + 0.38852184265851974, + 2.5439065266400576, + 0.9406695310026407, + 3.585665175691247, + 2.1359883043915033, + 1.8955300003290176, + 0.2523548863828182, + 0.34630575589835644, + 0.9352522995322943, + 0.8595494441688061, + 0.942886121571064, + 2.102330854162574, + 0.41755593940615654, + 0.7421836294233799, + 0.6192683130502701, + 0.9657436683773994, + 0.4285412263125181, + 0.4712429493665695, + 1.3744414411485195, + 0.7072473410516977, + 1.332671158015728, + 0.6950586680322886, + 1.3068485707044601, + 3.5776846650987864, + 0.5805836115032434, + 0.0, + 1.5236541107296944 + ], + "unique_experts": 63, + "load_cv": 0.49901113485358173, + "normalized_load_entropy": 0.9698633634358562, + "max_load_share": 0.040160642570281124 + }, + "full_input": { + "tokens": 207, + "top_k": 6, + "decisions": 1242, + "ordered_route_sha256": "fdc26271d3c79de055f398f69fa74c144e9ba57e35f2081325e7e23ed0475f33", + "route_weight_sha256": "a3e60aab22c4286cb5f2ac7ea5635509def556efce9ae142ce71a9bd775ce9ee", + "loads": [ + 14, + 24, + 22, + 26, + 6, + 19, + 12, + 16, + 18, + 27, + 38, + 7, + 8, + 55, + 12, + 8, + 17, + 18, + 31, + 11, + 9, + 12, + 21, + 20, + 11, + 38, + 27, + 8, + 9, + 32, + 12, + 28, + 11, + 18, + 24, + 11, + 16, + 15, + 31, + 22, + 34, + 35, + 33, + 7, + 10, + 18, + 26, + 16, + 29, + 17, + 17, + 9, + 22, + 14, + 15, + 17, + 26, + 20, + 10, + 30, + 40, + 13, + 4, + 16 + ], + "weighted_loads": [ + 0.5258013512939215, + 0.8243960030376911, + 1.069670457392931, + 2.118350110249594, + 0.558427419513464, + 0.9737813454121351, + 0.6221561282873154, + 1.0926653854548931, + 1.3953720293939114, + 2.064810149371624, + 3.2082442604005337, + 0.2593243597075343, + 0.3484741672873497, + 2.7621628269553185, + 0.36625945940613747, + 0.3960186578333378, + 1.7200049497187138, + 1.3985226713120937, + 1.7737530111626256, + 0.6541018895804882, + 0.6059534773230553, + 1.4573180302977562, + 1.3061430156230927, + 1.3013491313904524, + 0.8887525796890259, + 2.4068917967379093, + 2.1999288629740477, + 0.35007541067898273, + 0.486302986741066, + 1.8773012813180685, + 0.9465568736195564, + 1.296039218083024, + 0.3628622628748417, + 0.5480519235134125, + 1.948856413102476, + 0.751037048175931, + 0.5276156663894653, + 0.47079769149422646, + 3.7321797031909227, + 1.1525794919580221, + 3.7460206653922796, + 2.443275014797109, + 2.3225084990262985, + 0.2523548863828182, + 0.4157147500663996, + 1.0978415525169112, + 2.060635793954134, + 1.279472641646862, + 2.132193647325039, + 0.504468547180295, + 0.8340507410466671, + 0.6192683130502701, + 1.4052836745977402, + 0.6102609988301992, + 1.0214749947190285, + 1.3744414411485195, + 1.1272420082241297, + 1.405924141407013, + 0.6950586680322886, + 2.063320053741336, + 4.509838214144111, + 0.7769597787410021, + 0.2865332290530205, + 1.6088184341788292 + ], + "unique_experts": 64, + "load_cv": 0.5143081275209435, + "normalized_load_entropy": 0.9697347912325509, + "max_load_share": 0.04428341384863124 + } + }, + "s0_bos": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "03c602bfb504d546a22ed6166da460686f181afefed9b9ff4051e73205952d34", + "route_weight_sha256": "6d26423ed19b9fd08595f7b3a058e791e39c1921ca2b9e817f332476460d0df9", + "loads": [ + 14, + 24, + 18, + 16, + 6, + 23, + 5, + 16, + 18, + 17, + 28, + 7, + 7, + 39, + 11, + 4, + 14, + 15, + 22, + 9, + 8, + 11, + 16, + 22, + 12, + 26, + 18, + 6, + 9, + 12, + 12, + 25, + 12, + 13, + 8, + 10, + 16, + 9, + 27, + 19, + 31, + 28, + 23, + 8, + 9, + 15, + 18, + 15, + 30, + 13, + 14, + 8, + 18, + 10, + 9, + 17, + 19, + 18, + 11, + 18, + 35, + 10, + 0, + 15 + ], + "weighted_loads": [ + 0.5192038863897324, + 0.7331298217177391, + 0.8747940715402365, + 1.3698929399251938, + 0.5708083584904671, + 1.1095875054597855, + 0.2603475973010063, + 1.0862098466604948, + 1.4070117250084877, + 0.9374027960002422, + 2.5966393761336803, + 0.3043246455490589, + 0.25657737255096436, + 1.7717838659882545, + 0.3508138954639435, + 0.12465750053524971, + 1.3333462700247765, + 1.2866950556635857, + 1.1118912156671286, + 0.5588872171938419, + 0.5875087976455688, + 0.437707019969821, + 0.9350696057081223, + 1.3493991140276194, + 0.9134622700512409, + 1.5730275977402925, + 1.4436635076999664, + 0.3198350891470909, + 0.48312319815158844, + 0.5479327663779259, + 0.9501545615494251, + 1.2636405546218157, + 0.3876813817769289, + 0.4062964543700218, + 0.4172462597489357, + 0.6614441946148872, + 0.5059162899851799, + 0.27612546645104885, + 2.3713826704770327, + 0.9278808776289225, + 3.6265899632126093, + 2.1924586575478315, + 1.8281781636178493, + 0.29497968405485153, + 0.3773649949580431, + 0.9459229987114668, + 0.9329075664281845, + 1.062535673379898, + 2.1979343965649605, + 0.38972195237874985, + 0.7017966136336327, + 0.6181426160037518, + 0.9442790262401104, + 0.4265034180134535, + 0.4928589388728142, + 1.3845533393323421, + 0.6471056006848812, + 1.3829845134168863, + 0.7120184190571308, + 1.341280983760953, + 3.588451625779271, + 0.5391198247671127, + 0.0, + 1.617603674530983 + ], + "unique_experts": 63, + "load_cv": 0.4974572851860429, + "normalized_load_entropy": 0.9699907184927118, + "max_load_share": 0.0391566265060241 + }, + "full_input": { + "tokens": 191, + "top_k": 6, + "decisions": 1146, + "ordered_route_sha256": "a06d3c1992340b8c2c97e7b67b53c76c88ce021e37c31b8da2af86bdc01d7f14", + "route_weight_sha256": "8f219d8038457436a0d2acd66a7ec9e7e2df4e6c701bdbaaaa6eb0189776d4cb", + "loads": [ + 14, + 27, + 21, + 21, + 6, + 23, + 6, + 16, + 18, + 17, + 38, + 8, + 7, + 52, + 13, + 7, + 14, + 15, + 27, + 9, + 8, + 12, + 18, + 22, + 12, + 32, + 24, + 6, + 9, + 31, + 12, + 27, + 12, + 14, + 20, + 10, + 16, + 11, + 28, + 19, + 34, + 31, + 31, + 8, + 9, + 17, + 29, + 15, + 31, + 14, + 16, + 8, + 18, + 10, + 9, + 17, + 19, + 18, + 11, + 30, + 40, + 10, + 3, + 16 + ], + "weighted_loads": [ + 0.5192038863897324, + 0.8752870261669159, + 1.02319797873497, + 1.7198482030653395, + 0.5708083584904671, + 1.1095875054597855, + 0.31300462037324905, + 1.0862098466604948, + 1.4070117250084877, + 0.9374027960002422, + 3.2551343087106943, + 0.32139679603278637, + 0.25657737255096436, + 2.680489454418421, + 0.3973558507859707, + 0.30007268860936165, + 1.3333462700247765, + 1.2866950556635857, + 1.4529600235109683, + 0.5588872171938419, + 0.5875087976455688, + 0.7273174952715635, + 1.0106087625026703, + 1.3493991140276194, + 0.9134622700512409, + 2.0374029148370028, + 1.9917202331125736, + 0.3198350891470909, + 0.48312319815158844, + 2.0471100605791435, + 0.9501545615494251, + 1.305681997910142, + 0.3876813817769289, + 0.43164014630019665, + 1.4998481420625467, + 0.6614441946148872, + 0.5059162899851799, + 0.3571892511099577, + 3.3683856893330812, + 0.9278808776289225, + 3.7675146777182817, + 2.3937339019030333, + 2.1862014811486006, + 0.29497968405485153, + 0.3773649949580431, + 1.220045791938901, + 2.0794647336006165, + 1.062535673379898, + 2.2347296439111233, + 0.41771675646305084, + 0.7871613688766956, + 0.6181426160037518, + 0.9442790262401104, + 0.4265034180134535, + 0.4928589388728142, + 1.3845533393323421, + 0.6471056006848812, + 1.3829845134168863, + 0.7120184190571308, + 2.0327274203300476, + 4.242135218519252, + 0.5391198247671127, + 0.21366038918495178, + 1.658035010099411 + ], + "unique_experts": 64, + "load_cv": 0.5434023653609702, + "normalized_load_entropy": 0.9665433336532028, + "max_load_share": 0.04537521815008726 + } + }, + "s1_bos": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "f1a90677086c889051e297868274cfb6b0f883bcd4346ba89042fcfd20b9b1a9", + "route_weight_sha256": "1907c9f31d9f980df9087d5c3c2c6175cd4c8a8755062d5a0cce395dfcf83210", + "loads": [ + 17, + 22, + 20, + 15, + 6, + 21, + 5, + 16, + 18, + 18, + 28, + 8, + 7, + 39, + 11, + 3, + 14, + 16, + 19, + 11, + 8, + 7, + 16, + 20, + 12, + 24, + 19, + 8, + 9, + 6, + 12, + 25, + 11, + 18, + 8, + 11, + 15, + 11, + 27, + 19, + 31, + 28, + 24, + 7, + 9, + 16, + 18, + 14, + 30, + 15, + 14, + 9, + 17, + 9, + 9, + 17, + 19, + 18, + 11, + 19, + 36, + 10, + 0, + 16 + ], + "weighted_loads": [ + 0.6181413251906633, + 0.6849302183836699, + 0.9162031430751085, + 1.3019585572183132, + 0.5713210515677929, + 1.0322048924863338, + 0.25334229320287704, + 1.0974041894078255, + 1.396488606929779, + 0.9636067003011703, + 2.620094947516918, + 0.3547083344310522, + 0.24668130092322826, + 1.7424593102186918, + 0.3466953728348017, + 0.10743032954633236, + 1.337719762697816, + 1.3182538729161024, + 0.99297477863729, + 0.6247445475310087, + 0.5593289509415627, + 0.2751554027199745, + 0.9143723510205746, + 1.305718306452036, + 0.9032019227743149, + 1.4967251531779766, + 1.4496754873543978, + 0.3618920147418976, + 0.4887588620185852, + 0.34031689912080765, + 0.9416497014462948, + 1.245032986626029, + 0.3477856069803238, + 0.5975761469453573, + 0.39944320917129517, + 0.7211126182228327, + 0.4628906399011612, + 0.33356037735939026, + 2.400531245395541, + 0.9384019076824188, + 3.6122411247342825, + 2.1844658125191927, + 1.9131466168910265, + 0.2542041428387165, + 0.3628453742712736, + 1.0231657791882753, + 0.9137206058949232, + 1.02905666641891, + 2.242852771654725, + 0.46796721778810024, + 0.714961439371109, + 0.6642281804233789, + 0.8833868782967329, + 0.40493146143853664, + 0.49660126119852066, + 1.3743506893515587, + 0.6380905956029892, + 1.3685769587755203, + 0.7193340007215738, + 1.3922267481684685, + 3.6705872733145952, + 0.5410361271351576, + 0.0, + 1.6257724557071924 + ], + "unique_experts": 63, + "load_cv": 0.49771659700931536, + "normalized_load_entropy": 0.969635781368204, + "max_load_share": 0.0391566265060241 + }, + "full_input": { + "tokens": 207, + "top_k": 6, + "decisions": 1242, + "ordered_route_sha256": "e826dc538ca0c9a1ee238de301234e86405b6a3004dc9c045f39d4ca79105bac", + "route_weight_sha256": "e8daa1c5577a9584f295791703d7fab080f94e2525ae9b5d3e1e0737eb3ebcb8", + "loads": [ + 17, + 24, + 24, + 25, + 6, + 21, + 8, + 16, + 18, + 26, + 37, + 9, + 8, + 53, + 14, + 7, + 16, + 18, + 27, + 13, + 9, + 9, + 21, + 21, + 12, + 34, + 28, + 8, + 9, + 29, + 12, + 27, + 11, + 19, + 24, + 11, + 15, + 14, + 30, + 22, + 34, + 34, + 33, + 7, + 11, + 19, + 29, + 18, + 31, + 17, + 17, + 9, + 21, + 13, + 15, + 17, + 24, + 20, + 11, + 32, + 44, + 12, + 4, + 18 + ], + "weighted_loads": [ + 0.6181413251906633, + 0.8041989784687757, + 1.109266359359026, + 2.112837215187028, + 0.5713210515677929, + 1.0322048924863338, + 0.44889480993151665, + 1.0974041894078255, + 1.396488606929779, + 2.0082109197974205, + 3.208732334896922, + 0.37178048491477966, + 0.3466532062739134, + 2.7075429912656546, + 0.4215457960963249, + 0.37048924900591373, + 1.7005222234874964, + 1.3888386823236942, + 1.6669240235642064, + 0.7150150965899229, + 0.6081824488937855, + 0.6049005463719368, + 1.2898032739758492, + 1.3981328941881657, + 0.9032019227743149, + 2.2023483850061893, + 2.2826848458498716, + 0.3618920147418976, + 0.4887588620185852, + 1.7135362960398197, + 0.9416497014462948, + 1.288451550528407, + 0.3477856069803238, + 0.6229198388755322, + 1.7958591317001265, + 0.7211126182228327, + 0.4628906399011612, + 0.4551079049706459, + 3.5888044219464064, + 1.1503118686378002, + 3.772596614435315, + 2.5107109797390876, + 2.3401251155883074, + 0.2542041428387165, + 0.43225436843931675, + 1.19189895974705, + 2.1628741156309843, + 1.365643186494708, + 2.27271556481719, + 0.5320093687623739, + 0.8439784795045853, + 0.6642281804233789, + 1.3229268845170736, + 0.5866512339562178, + 1.0468333065509796, + 1.3743506893515587, + 1.0580852627754211, + 1.4418299421668053, + 0.7193340007215738, + 2.1607066597789526, + 4.836281394585967, + 0.7374122943729162, + 0.29673508182168007, + 1.7140007261186838 + ], + "unique_experts": 64, + "load_cv": 0.5055206695186475, + "normalized_load_entropy": 0.9704319003587589, + "max_load_share": 0.0426731078904992 + } + }, + "s0_x": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "78c84871f48fd63567cf7e35dded7c44b9d2da30420b908dee16a625322fec5d", + "route_weight_sha256": "223c66d29c01c39696a4da4e17db8a96ec4b391532fb67d1cdddd92b472c9a77", + "loads": [ + 13, + 24, + 17, + 16, + 6, + 23, + 6, + 16, + 18, + 16, + 28, + 6, + 7, + 38, + 11, + 3, + 14, + 16, + 22, + 9, + 8, + 12, + 16, + 22, + 11, + 26, + 18, + 7, + 9, + 8, + 12, + 24, + 11, + 16, + 9, + 10, + 17, + 12, + 26, + 19, + 31, + 29, + 24, + 8, + 9, + 15, + 17, + 15, + 31, + 14, + 14, + 8, + 18, + 9, + 9, + 17, + 18, + 18, + 10, + 21, + 34, + 10, + 0, + 15 + ], + "weighted_loads": [ + 0.4932786524295807, + 0.7557886000722647, + 0.839334387332201, + 1.4441842548549175, + 0.5624522678554058, + 1.0975573025643826, + 0.29378633946180344, + 1.0621560998260975, + 1.4100280851125717, + 0.9073562808334827, + 2.635206565260887, + 0.2624349631369114, + 0.25434012711048126, + 1.7489896453917027, + 0.35247134976089, + 0.1070209126919508, + 1.3413394317030907, + 1.320927657186985, + 1.1604176089167595, + 0.5566627234220505, + 0.5823846347630024, + 0.46234360709786415, + 0.9625771678984165, + 1.3549196533858776, + 0.8641131483018398, + 1.5902775265276432, + 1.4576354678720236, + 0.35080761089921, + 0.4832392856478691, + 0.3537126947194338, + 0.9483078978955746, + 1.234492426738143, + 0.35306423529982567, + 0.5011942964047194, + 0.4379686862230301, + 0.6785817332565784, + 0.5354814566671848, + 0.35526185669004917, + 2.3668192140758038, + 0.9393563028424978, + 3.6157522555440664, + 2.248750103637576, + 1.8661147635430098, + 0.29222491569817066, + 0.3780039045959711, + 0.9462772086262703, + 0.8997131865471601, + 1.0637002885341644, + 2.2541188690811396, + 0.417945159599185, + 0.6774437874555588, + 0.6125118508934975, + 0.9628597367554903, + 0.3953790869563818, + 0.4845377095043659, + 1.3854965493083, + 0.6118473522365093, + 1.3731277100741863, + 0.6815406735986471, + 1.438383737578988, + 3.5348233822733164, + 0.528975922614336, + 0.0, + 1.6109235659241676 + ], + "unique_experts": 63, + "load_cv": 0.49654862737313005, + "normalized_load_entropy": 0.9698237488418393, + "max_load_share": 0.03815261044176707 + }, + "full_input": { + "tokens": 191, + "top_k": 6, + "decisions": 1146, + "ordered_route_sha256": "1e82cebb19aa17e79b76d214d0873f49e41985c6a1c729698e8025974af63230", + "route_weight_sha256": "2df8a703d5c0a1dce660cb59f753cbf5d2cadc3fcc8c541859a070050b7c0661", + "loads": [ + 13, + 28, + 21, + 20, + 6, + 23, + 6, + 16, + 18, + 16, + 39, + 7, + 7, + 50, + 13, + 6, + 14, + 16, + 26, + 9, + 8, + 13, + 18, + 22, + 11, + 32, + 24, + 7, + 9, + 25, + 12, + 25, + 11, + 17, + 19, + 10, + 18, + 14, + 27, + 19, + 35, + 32, + 33, + 8, + 9, + 17, + 30, + 15, + 33, + 15, + 16, + 8, + 18, + 9, + 9, + 17, + 18, + 18, + 10, + 34, + 38, + 10, + 3, + 16 + ], + "weighted_loads": [ + 0.4932786524295807, + 0.9423518124967813, + 1.018570812419057, + 1.740218861552421, + 0.5624522678554058, + 1.0975573025643826, + 0.29378633946180344, + 1.0621560998260975, + 1.4100280851125717, + 0.9073562808334827, + 3.5106004755944014, + 0.27950711362063885, + 0.25434012711048126, + 2.6157472394406796, + 0.3990133050829172, + 0.29375419951975346, + 1.3413394317030907, + 1.320927657186985, + 1.3479028230940457, + 0.5566627234220505, + 0.5823846347630024, + 0.7519540823996067, + 1.0420984774827957, + 1.3549196533858776, + 0.8641131483018398, + 1.9900390766561031, + 2.049724670127034, + 0.35080761089921, + 0.4832392856478691, + 1.6173957887804136, + 0.9483078978955746, + 1.2528832033276558, + 0.35306423529982567, + 0.5265379883348942, + 1.294002637063386, + 0.6785817332565784, + 0.5581372492015362, + 0.43727358989417553, + 3.3638222329318523, + 0.9393563028424978, + 3.813834773376584, + 2.4580571856349707, + 2.259597282856703, + 0.29222491569817066, + 0.3780039045959711, + 1.1945199333131313, + 2.291575660929084, + 1.0637002885341644, + 2.334124954417348, + 0.445939963683486, + 0.7637216597795486, + 0.6125118508934975, + 0.9628597367554903, + 0.3953790869563818, + 0.4845377095043659, + 1.3854965493083, + 0.6118473522365093, + 1.3731277100741863, + 0.6815406735986471, + 2.2172434963285923, + 3.9892266310635023, + 0.528975922614336, + 0.2056121602654457, + 1.6520912423729897 + ], + "unique_experts": 64, + "load_cv": 0.5420555160231643, + "normalized_load_entropy": 0.9664672373003498, + "max_load_share": 0.04363001745200698 + } + }, + "s1_x": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "6dca9d7b2b8e4326f3e337d3fc876851a61d13b0e822f6ba502ed77f9691c257", + "route_weight_sha256": "2ec9ce6b3d41df2dfbc4b66d6b188a04f2002f8348e792f71b510a174d071cf1", + "loads": [ + 14, + 21, + 20, + 16, + 6, + 23, + 4, + 16, + 18, + 18, + 28, + 7, + 8, + 39, + 10, + 4, + 14, + 16, + 20, + 9, + 8, + 11, + 16, + 19, + 12, + 24, + 20, + 9, + 9, + 5, + 12, + 24, + 13, + 15, + 9, + 13, + 15, + 12, + 27, + 19, + 31, + 29, + 24, + 6, + 8, + 16, + 18, + 13, + 31, + 15, + 14, + 8, + 17, + 9, + 9, + 18, + 17, + 18, + 10, + 21, + 36, + 10, + 0, + 15 + ], + "weighted_loads": [ + 0.5339057799428701, + 0.65277967043221, + 0.9268533680588007, + 1.3916605561971664, + 0.5581059567630291, + 1.0880747642368078, + 0.19494380801916122, + 1.0804237220436335, + 1.3923419006168842, + 0.9719632975757122, + 2.652490608394146, + 0.325095497071743, + 0.27541637420654297, + 1.7656832337379456, + 0.32416819781064987, + 0.1345288548618555, + 1.3498320169746876, + 1.3083207663148642, + 1.0687657948583364, + 0.5402099527418613, + 0.5566233061254025, + 0.40436200983822346, + 0.9270615614950657, + 1.2635734099894762, + 0.8971123285591602, + 1.4992584567517042, + 1.4816896598786116, + 0.4054771978408098, + 0.49372729659080505, + 0.24304921180009842, + 0.9311771132051945, + 1.2075271178036928, + 0.40497596003115177, + 0.5069382879883051, + 0.4075806140899658, + 0.8018758613616228, + 0.46811207942664623, + 0.3572258446365595, + 2.3769440911710262, + 0.9437459539622068, + 3.568703383207321, + 2.27005478926003, + 1.9167942982167006, + 0.2253853864967823, + 0.33851164393126965, + 1.0255791060626507, + 0.9106370601803064, + 1.0019583962857723, + 2.318001640960574, + 0.4669097512960434, + 0.6955124512314796, + 0.640236446633935, + 0.8974233847111464, + 0.4036840833723545, + 0.4903496280312538, + 1.4156111925840378, + 0.5704826265573502, + 1.360801711678505, + 0.6928024124354124, + 1.4507616963237524, + 3.708333518356085, + 0.5349307041615248, + 0.0, + 1.58960940875113 + ], + "unique_experts": 63, + "load_cv": 0.5015901875500678, + "normalized_load_entropy": 0.9692733576599367, + "max_load_share": 0.0391566265060241 + }, + "full_input": { + "tokens": 207, + "top_k": 6, + "decisions": 1242, + "ordered_route_sha256": "b72c79596b889898ac989f3e7873223627391749e01dba7e49b76cb8609791e8", + "route_weight_sha256": "7add46692dbfbfefef77bf21521f80d84d9e6b71aa2b6eff6a8822ee0e5f1d3d", + "loads": [ + 14, + 24, + 25, + 25, + 6, + 23, + 6, + 16, + 18, + 26, + 38, + 8, + 9, + 52, + 13, + 8, + 16, + 18, + 27, + 11, + 9, + 13, + 21, + 20, + 12, + 34, + 29, + 9, + 9, + 25, + 12, + 25, + 13, + 16, + 24, + 13, + 16, + 15, + 31, + 22, + 35, + 35, + 34, + 6, + 10, + 19, + 30, + 17, + 32, + 17, + 17, + 8, + 21, + 13, + 15, + 18, + 22, + 20, + 10, + 35, + 44, + 12, + 4, + 17 + ], + "weighted_loads": [ + 0.5339057799428701, + 0.818359388038516, + 1.1557515934109688, + 2.152504136087373, + 0.5581059567630291, + 1.0880747642368078, + 0.34089629352092743, + 1.0804237220436335, + 1.3923419006168842, + 2.0165675170719624, + 3.429859323427081, + 0.34216764755547047, + 0.3753882795572281, + 2.689328219741583, + 0.3990186210721731, + 0.4020403306931257, + 1.712634477764368, + 1.378905575722456, + 1.59272141897236, + 0.6304805018007755, + 0.6054768040776253, + 0.7341071534901857, + 1.3045147359371185, + 1.355987997725606, + 0.8971123285591602, + 2.1508755665272474, + 2.3500636722892523, + 0.4054771978408098, + 0.49372729659080505, + 1.3608383983373642, + 0.9311771132051945, + 1.2259178943932056, + 0.40497596003115177, + 0.5322819799184799, + 1.6077650410297792, + 0.8018758613616228, + 0.49254282750189304, + 0.4796775858849287, + 3.6173237897455692, + 1.1556559149175882, + 3.7834449522197247, + 2.633533175030607, + 2.383802542462945, + 0.2253853864967823, + 0.4079206380993128, + 1.1538570346892811, + 2.3680420834571123, + 1.3385449163615704, + 2.3478644341230392, + 0.5309519022703171, + 0.8247865736484528, + 0.640236446633935, + 1.336963390931487, + 0.5854038558900356, + 1.0405816733837128, + 1.4156111925840378, + 0.9904772937297821, + 1.4340546950697899, + 0.6928024124354124, + 2.3123418502509594, + 4.701332479715347, + 0.7313068713992834, + 0.2849387973546982, + 1.6762635428458452 + ], + "unique_experts": 64, + "load_cv": 0.512368383626453, + "normalized_load_entropy": 0.9696519320196584, + "max_load_share": 0.04186795491143317 + } + }, + "s0_period": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "471f50f662177e6042ead6b6709cf8cc946000f7e13fddedc1a11722b37c6bf8", + "route_weight_sha256": "30986baf2aedd617c65b188c38f6339c64771207440c6fdca0fa22253320f9d5", + "loads": [ + 15, + 24, + 19, + 16, + 6, + 23, + 5, + 16, + 18, + 17, + 28, + 6, + 7, + 38, + 11, + 4, + 14, + 16, + 22, + 9, + 8, + 9, + 16, + 22, + 11, + 26, + 18, + 6, + 9, + 7, + 12, + 26, + 11, + 14, + 9, + 10, + 16, + 10, + 27, + 19, + 31, + 29, + 24, + 8, + 9, + 16, + 17, + 15, + 31, + 14, + 14, + 8, + 18, + 10, + 9, + 17, + 18, + 18, + 10, + 20, + 34, + 10, + 0, + 16 + ], + "weighted_loads": [ + 0.5471595600247383, + 0.7610602509230375, + 0.8952311910688877, + 1.4540851525962353, + 0.5582276806235313, + 1.0972597301006317, + 0.2560973949730396, + 1.0710398592054844, + 1.410078551620245, + 0.9570562280714512, + 2.625681534409523, + 0.26417925022542477, + 0.256177868694067, + 1.7479072716087103, + 0.353307930752635, + 0.14243048802018166, + 1.348057184368372, + 1.3147896099835634, + 1.1781836468726397, + 0.557763434946537, + 0.5798161923885345, + 0.365826353430748, + 0.9600935615599155, + 1.3502593226730824, + 0.8606505542993546, + 1.590672081336379, + 1.4383453745394945, + 0.3240252286195755, + 0.4867089092731476, + 0.3227428235113621, + 0.9481765665113926, + 1.2855625059455633, + 0.35520085506141186, + 0.4405063893646002, + 0.4532204829156399, + 0.6835786886513233, + 0.5133686251938343, + 0.30246451683342457, + 2.4030417036265135, + 0.933557165786624, + 3.6111921202391386, + 2.241942897439003, + 1.869849668815732, + 0.2947309035807848, + 0.379483575001359, + 0.9661776907742023, + 0.8909036349505186, + 1.058939691632986, + 2.240851217880845, + 0.42143307998776436, + 0.6800898797810078, + 0.629354152828455, + 0.9675977639853954, + 0.4209500029683113, + 0.4812959637492895, + 1.3841572441160679, + 0.6135275661945343, + 1.3830642104148865, + 0.6842820569872856, + 1.4104079566895962, + 3.5212899819016457, + 0.52578504383564, + 0.0, + 1.6356858164072037 + ], + "unique_experts": 63, + "load_cv": 0.504411915143794, + "normalized_load_entropy": 0.968884220477343, + "max_load_share": 0.03815261044176707 + }, + "full_input": { + "tokens": 191, + "top_k": 6, + "decisions": 1146, + "ordered_route_sha256": "05f0b28ea58023f42d4fd5db8dfdee0d5642aa9cdef481aeafab6dcd5c81f46e", + "route_weight_sha256": "b04d248a55e013aaaf8cad49754d19749efa34d99677540ae16baef85fbb5290", + "loads": [ + 15, + 28, + 22, + 20, + 6, + 23, + 5, + 16, + 18, + 17, + 38, + 7, + 7, + 50, + 13, + 7, + 14, + 16, + 26, + 9, + 8, + 10, + 19, + 22, + 11, + 32, + 25, + 6, + 9, + 25, + 12, + 27, + 11, + 15, + 19, + 10, + 17, + 12, + 28, + 19, + 34, + 32, + 32, + 8, + 9, + 18, + 29, + 15, + 33, + 15, + 16, + 9, + 19, + 10, + 9, + 17, + 18, + 18, + 10, + 33, + 38, + 10, + 3, + 17 + ], + "weighted_loads": [ + 0.5471595600247383, + 0.9561048727482557, + 1.0435256212949753, + 1.7536422447883524, + 0.5582276806235313, + 1.0972597301006317, + 0.2560973949730396, + 1.0710398592054844, + 1.410078551620245, + 0.9570562280714512, + 3.284176466986537, + 0.2812514007091522, + 0.256177868694067, + 2.591314500197768, + 0.3998498860746622, + 0.311239767819643, + 1.348057184368372, + 1.3147896099835634, + 1.3682808855955955, + 0.557763434946537, + 0.5798161923885345, + 0.6554368287324905, + 1.0763037018477917, + 1.3502593226730824, + 0.8606505542993546, + 1.9730345644056797, + 2.2978158090263605, + 0.3240252286195755, + 0.4867089092731476, + 1.6094758607214317, + 0.9481765665113926, + 1.3039532825350761, + 0.35520085506141186, + 0.465850081294775, + 1.2975737226952333, + 0.6835786886513233, + 0.5368130840361118, + 0.384581433609128, + 3.400044722482562, + 0.933557165786624, + 3.752116834744811, + 2.44446362555027, + 2.2278729863464832, + 0.2947309035807848, + 0.379483575001359, + 1.2385794147849083, + 2.1987019013613462, + 1.058939691632986, + 2.33158471994102, + 0.44942788407206535, + 0.7653850987553596, + 0.7517089806497097, + 1.0328971408307552, + 0.4209500029683113, + 0.4812959637492895, + 1.3841572441160679, + 0.6135275661945343, + 1.3830642104148865, + 0.6842820569872856, + 2.1898080091923475, + 3.975529861811083, + 0.52578504383564, + 0.20512893795967102, + 1.6770366989076138 + ], + "unique_experts": 64, + "load_cv": 0.5398032994247767, + "normalized_load_entropy": 0.9664792851000807, + "max_load_share": 0.04363001745200698 + } + }, + "s1_period": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "e96e8bff3f6dc32c0376c7cab655b87413ad2e782c5cc0b3d79de113234e8bcd", + "route_weight_sha256": "5c879cda7e445b56b7e42a19245d9346bf084f1278fba7e3264ad0f9c9e9f33f", + "loads": [ + 14, + 23, + 20, + 16, + 6, + 23, + 4, + 16, + 18, + 18, + 28, + 7, + 7, + 40, + 10, + 4, + 14, + 16, + 20, + 9, + 8, + 9, + 16, + 19, + 12, + 25, + 20, + 8, + 9, + 4, + 12, + 25, + 13, + 17, + 9, + 11, + 15, + 12, + 27, + 20, + 31, + 29, + 25, + 6, + 8, + 16, + 17, + 13, + 30, + 15, + 15, + 8, + 16, + 9, + 9, + 18, + 17, + 18, + 10, + 20, + 36, + 10, + 0, + 16 + ], + "weighted_loads": [ + 0.5339522585272789, + 0.7258819323033094, + 0.9151169378310442, + 1.3722526095807552, + 0.5544973462820053, + 1.0821464788168669, + 0.20507927238941193, + 1.0872876141220331, + 1.3870598562061787, + 0.979141142219305, + 2.649110537022352, + 0.30495649948716164, + 0.24542057141661644, + 1.7790869493037462, + 0.3258661665022373, + 0.13515033945441246, + 1.351412683725357, + 1.30866046436131, + 1.0663517639040947, + 0.5378921627998352, + 0.5534157976508141, + 0.3517235815525055, + 0.9189953841269016, + 1.256769234314561, + 0.8882703557610512, + 1.5311585050076246, + 1.4730161931365728, + 0.35855413414537907, + 0.4925352670252323, + 0.21807063929736614, + 0.9307705797255039, + 1.2321485038846731, + 0.4073088951408863, + 0.5750641375780106, + 0.3984053414314985, + 0.7323504909873009, + 0.4739678390324116, + 0.3555150479078293, + 2.362561624497175, + 0.9674287773668766, + 3.569085970520973, + 2.2555864192545414, + 1.9549808036535978, + 0.22482806257903576, + 0.3343937527388334, + 1.0289036184549332, + 0.8742213677614927, + 1.000185091048479, + 2.2802046965807676, + 0.4698901157826185, + 0.7310522627085447, + 0.6497151087969542, + 0.8639057762920856, + 0.4027291964739561, + 0.488420519977808, + 1.4165320992469788, + 0.5710258819162846, + 1.3613125514239073, + 0.6907963361591101, + 1.4396804366260767, + 3.672585690394044, + 0.5330326780676842, + 0.0, + 1.6122600231319666 + ], + "unique_experts": 63, + "load_cv": 0.5129097405913795, + "normalized_load_entropy": 0.9678118288720395, + "max_load_share": 0.040160642570281124 + }, + "full_input": { + "tokens": 207, + "top_k": 6, + "decisions": 1242, + "ordered_route_sha256": "0b3c6022d4a2103b54ab7b96508a153cd77448de3273e71c1ead8f97303cdad0", + "route_weight_sha256": "5411aee3ed9bce3a81db71b73e6c6bcc37de4af19a8c45fc5704e0c574c8cba2", + "loads": [ + 14, + 26, + 24, + 25, + 6, + 23, + 7, + 16, + 18, + 26, + 37, + 8, + 8, + 53, + 13, + 8, + 16, + 18, + 27, + 11, + 9, + 11, + 22, + 20, + 12, + 35, + 30, + 8, + 9, + 24, + 12, + 26, + 13, + 18, + 23, + 11, + 16, + 16, + 31, + 23, + 34, + 35, + 34, + 6, + 10, + 19, + 28, + 17, + 31, + 17, + 17, + 9, + 21, + 13, + 15, + 18, + 22, + 20, + 10, + 34, + 44, + 12, + 4, + 19 + ], + "weighted_loads": [ + 0.5339522585272789, + 0.879645885899663, + 1.108714947476983, + 2.1345649000722915, + 0.5544973462820053, + 1.0821464788168669, + 0.38835434243083, + 1.0872876141220331, + 1.3870598562061787, + 2.023745361715555, + 3.237747924402356, + 0.3220286499708891, + 0.34539247676730156, + 2.6768891345709562, + 0.40071658976376057, + 0.4068882651627064, + 1.7142151445150375, + 1.3792452737689018, + 1.5910730022296775, + 0.6281627118587494, + 0.6022692956030369, + 0.6814687252044678, + 1.3304018788039684, + 1.3491838220506907, + 0.8882703557610512, + 2.1533675119280815, + 2.642660139128566, + 0.35855413414537907, + 0.4925352670252323, + 1.3236593659967184, + 0.9307705797255039, + 1.250539280474186, + 0.4073088951408863, + 0.6004078295081854, + 1.5412664205941837, + 0.7323504909873009, + 0.49913907982409, + 0.5199858732521534, + 3.6087339781224728, + 1.179338738322258, + 3.729441460222006, + 2.631039810294169, + 2.3819593023508787, + 0.22482806257903576, + 0.40380274690687656, + 1.1562006781459786, + 2.1833328511565924, + 1.3367716111242771, + 2.3100674897432327, + 0.5339322667568922, + 0.8229193743318319, + 0.7461798172444105, + 1.356196328997612, + 0.5844489689916372, + 1.038652565330267, + 1.4165320992469788, + 0.9910205490887165, + 1.4345655348151922, + 0.6907963361591101, + 2.3585248962044716, + 4.669074842706323, + 0.7294088453054428, + 0.29462476819753647, + 1.7293067425489426 + ], + "unique_experts": 64, + "load_cv": 0.5126112530239153, + "normalized_load_entropy": 0.9695975598392736, + "max_load_share": 0.0426731078904992 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 166, + "ordered_topk_exact_tokens": 124, + "set_exact_tokens": 140, + "mean_set_jaccard": 0.9552495697074012, + "mean_token_weighted_tv": 0.008604757364345602, + "aggregate_load_tv": 0.019076305220883532 + }, + "system_bos": { + "tokens": 166, + "ordered_topk_exact_tokens": 99, + "set_exact_tokens": 120, + "mean_set_jaccard": 0.9195352839931155, + "mean_token_weighted_tv": 0.0147321407896388, + "aggregate_load_tv": 0.029116465863453813 + }, + "system_x": { + "tokens": 166, + "ordered_topk_exact_tokens": 110, + "set_exact_tokens": 128, + "mean_set_jaccard": 0.9333046471600689, + "mean_token_weighted_tv": 0.01414544132526919, + "aggregate_load_tv": 0.027108433734939756 + }, + "system_period": { + "tokens": 166, + "ordered_topk_exact_tokens": 106, + "set_exact_tokens": 128, + "mean_set_jaccard": 0.9333046471600689, + "mean_token_weighted_tv": 0.014300709231251693, + "aggregate_load_tv": 0.025100401606425696 + }, + "bos_at_s0": { + "tokens": 166, + "ordered_topk_exact_tokens": 91, + "set_exact_tokens": 112, + "mean_set_jaccard": 0.9044750430292599, + "mean_token_weighted_tv": 0.018581123203488, + "aggregate_load_tv": 0.02811244979919679 + }, + "bos_at_s1": { + "tokens": 166, + "ordered_topk_exact_tokens": 77, + "set_exact_tokens": 96, + "mean_set_jaccard": 0.8769363166953528, + "mean_token_weighted_tv": 0.022422791537211603, + "aggregate_load_tv": 0.03714859437751003 + }, + "x_at_s0": { + "tokens": 166, + "ordered_topk_exact_tokens": 94, + "set_exact_tokens": 115, + "mean_set_jaccard": 0.9096385542168675, + "mean_token_weighted_tv": 0.018276099861790258, + "aggregate_load_tv": 0.025100401606425713 + }, + "x_at_s1": { + "tokens": 166, + "ordered_topk_exact_tokens": 80, + "set_exact_tokens": 99, + "mean_set_jaccard": 0.8833907056798623, + "mean_token_weighted_tv": 0.022459488148879575, + "aggregate_load_tv": 0.03815261044176706 + }, + "period_at_s0": { + "tokens": 166, + "ordered_topk_exact_tokens": 97, + "set_exact_tokens": 116, + "mean_set_jaccard": 0.9126506024096386, + "mean_token_weighted_tv": 0.017957934189632714, + "aggregate_load_tv": 0.02911646586345382 + }, + "period_at_s1": { + "tokens": 166, + "ordered_topk_exact_tokens": 80, + "set_exact_tokens": 102, + "mean_set_jaccard": 0.8885542168674698, + "mean_token_weighted_tv": 0.021619677397770334, + "aggregate_load_tv": 0.03413654618473895 + } + } + }, + "layer_05": { + "layer": 5, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "93ab3548e2ecb85c4c3e416472a94609392bf3410c7dcd9f2afaa760e20258c1", + "route_weight_sha256": "3d7eaf67e887c8dbbf2767a2da279290ae8401c9a3b9004cbe96bc89600a8333", + "loads": [ + 14, + 34, + 14, + 9, + 4, + 26, + 8, + 4, + 20, + 16, + 27, + 17, + 15, + 6, + 33, + 12, + 7, + 21, + 26, + 25, + 10, + 14, + 8, + 8, + 2, + 29, + 18, + 18, + 25, + 18, + 16, + 5, + 18, + 0, + 12, + 22, + 19, + 8, + 22, + 15, + 34, + 11, + 13, + 11, + 7, + 17, + 1, + 7, + 6, + 30, + 23, + 19, + 11, + 19, + 14, + 30, + 21, + 7, + 16, + 26, + 15, + 8, + 14, + 11 + ], + "weighted_loads": [ + 0.722089271992445, + 2.3864896781742573, + 0.5441326964646578, + 0.569379985332489, + 0.3716104291379452, + 1.0414355751127005, + 0.49803582578897476, + 0.1427396573126316, + 0.7222742438316345, + 0.587032550945878, + 2.3796900808811188, + 0.8105989173054695, + 1.079850621521473, + 0.2676362060010433, + 2.230684196576476, + 1.4159158244729042, + 0.3952239267528057, + 1.587121557444334, + 2.117488918825984, + 1.6935459021478891, + 0.3998690787702799, + 0.928431786596775, + 0.46302435733377934, + 0.41799172200262547, + 0.1573948673903942, + 3.1997074596583843, + 0.9489885456860065, + 1.2066673208028078, + 1.4287161342799664, + 1.3804020956158638, + 0.9804684929549694, + 0.18482251837849617, + 0.6323473919183016, + 0.0, + 1.061018604785204, + 1.830083368346095, + 1.0715433731675148, + 0.32930050790309906, + 1.5509644709527493, + 0.9579908363521099, + 2.4281614162027836, + 0.7889193184673786, + 0.6693040505051613, + 0.6297075375914574, + 0.5142129398882389, + 1.1271434258669615, + 0.04442908242344856, + 0.26013767533004284, + 0.43707871437072754, + 2.8758923821151257, + 2.112395290285349, + 2.117728542536497, + 0.3665182627737522, + 1.1758860647678375, + 0.4644487965852022, + 1.3861620370298624, + 1.1113522835075855, + 0.25114468671381474, + 1.0242361705750227, + 1.3645244408398867, + 1.335025779902935, + 0.31868502125144005, + 0.7066668402403593, + 1.046423751860857 + ], + "unique_experts": 63, + "load_cv": 0.5375978678873037, + "normalized_load_entropy": 0.9623601091900913, + "max_load_share": 0.03413654618473896 + }, + "full_input": { + "tokens": 191, + "top_k": 6, + "decisions": 1146, + "ordered_route_sha256": "7e6ac6adffd79de5d713a61b7c1d8cb0462ba546e0382d1fb7e1c3ca0b4ea7b7", + "route_weight_sha256": "7cfc9dd429b717081b7d7fe7b1246e0b37574340cfca22454a74ca1ba9fd6b06", + "loads": [ + 14, + 35, + 14, + 9, + 5, + 28, + 9, + 7, + 21, + 17, + 38, + 17, + 18, + 6, + 33, + 25, + 9, + 27, + 35, + 26, + 12, + 14, + 8, + 8, + 2, + 37, + 18, + 18, + 25, + 19, + 16, + 5, + 18, + 0, + 12, + 26, + 19, + 8, + 33, + 23, + 39, + 19, + 20, + 12, + 8, + 17, + 1, + 9, + 6, + 33, + 31, + 19, + 13, + 27, + 17, + 40, + 21, + 7, + 16, + 27, + 15, + 8, + 14, + 13 + ], + "weighted_loads": [ + 0.722089271992445, + 2.390001863008365, + 0.5441326964646578, + 0.569379985332489, + 0.37337438843678683, + 1.1088994909077883, + 0.5490371659398079, + 0.2140150349587202, + 0.725627155508846, + 0.5915612983517349, + 3.0372644513845444, + 0.8105989173054695, + 1.2709272429347038, + 0.2676362060010433, + 2.230684196576476, + 3.599836536217481, + 0.5683414526283741, + 1.8836930058896542, + 2.8772538881748915, + 1.7066265037283301, + 0.4153411462903023, + 0.928431786596775, + 0.46302435733377934, + 0.41799172200262547, + 0.1573948673903942, + 4.100436124950647, + 0.9489885456860065, + 1.2066673208028078, + 1.4287161342799664, + 1.4154703728854656, + 0.9804684929549694, + 0.18482251837849617, + 0.6323473919183016, + 0.0, + 1.061018604785204, + 2.141228010877967, + 1.0715433731675148, + 0.32930050790309906, + 2.6304920837283134, + 1.5838031768798828, + 2.634666569530964, + 1.6151482462882996, + 1.1270023584365845, + 0.6730604469776154, + 0.5954592190682888, + 1.1271434258669615, + 0.04442908242344856, + 0.27811528043821454, + 0.43707871437072754, + 3.017946273088455, + 2.818165447562933, + 2.117728542536497, + 1.9955098070204258, + 1.7147615812718868, + 0.48132141353562474, + 2.127479875460267, + 1.1113522835075855, + 0.25114468671381474, + 1.0242361705750227, + 1.4107545707374811, + 1.335025779902935, + 0.31868502125144005, + 0.7066668402403593, + 1.9829097613692284 + ], + "unique_experts": 63, + "load_cv": 0.5641696991854743, + "normalized_load_entropy": 0.9592499152524754, + "max_load_share": 0.034904013961605584 + } + }, + "s1_eos": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "5c2b135e7cedc74860f65428542fafdf9b7aace32310f88eff1234a09b2c961a", + "route_weight_sha256": "08795d6e794f56482591c44a2c4dfcddadf0769b0fd7279a850e06f80886b4b8", + "loads": [ + 14, + 33, + 13, + 10, + 5, + 25, + 8, + 4, + 21, + 17, + 27, + 14, + 15, + 6, + 27, + 12, + 7, + 21, + 26, + 26, + 13, + 14, + 8, + 7, + 2, + 29, + 18, + 18, + 25, + 19, + 15, + 4, + 19, + 1, + 12, + 22, + 17, + 10, + 22, + 15, + 33, + 11, + 14, + 11, + 7, + 17, + 1, + 8, + 7, + 30, + 23, + 19, + 11, + 19, + 18, + 29, + 23, + 6, + 16, + 25, + 15, + 8, + 13, + 11 + ], + "weighted_loads": [ + 0.7075533661991358, + 2.3392036352306604, + 0.5011102091521025, + 0.610721567645669, + 0.40850328654050827, + 1.0024088770151138, + 0.4933091402053833, + 0.1416599415242672, + 0.7554569821804762, + 0.6289321798831224, + 2.3396391049027443, + 0.7118633147329092, + 1.0649239234626293, + 0.2648123800754547, + 2.0319744255393744, + 1.4278380759060383, + 0.41616884246468544, + 1.588150355964899, + 2.116039890795946, + 1.7636927459388971, + 0.5002162903547287, + 0.9253969937562943, + 0.46970779076218605, + 0.3836951106786728, + 0.15683750435709953, + 3.192587323486805, + 0.956221355125308, + 1.183412654325366, + 1.422252457588911, + 1.4159007966518402, + 0.9460576325654984, + 0.14672521501779556, + 0.6590026803314686, + 0.028490541502833366, + 1.0518816597759724, + 1.814168769866228, + 0.9758224338293076, + 0.39133897237479687, + 1.5679653007537127, + 0.9464198462665081, + 2.3890614081174135, + 0.7793179340660572, + 0.6905072443187237, + 0.6343479044735432, + 0.5064386837184429, + 1.1106201242655516, + 0.04434465989470482, + 0.2980258632451296, + 0.4692756310105324, + 2.8605997636914253, + 2.1481421887874603, + 2.1108667999505997, + 0.36117987520992756, + 1.173638118430972, + 0.595503544434905, + 1.3335081227123737, + 1.1671571116894484, + 0.22887446731328964, + 1.0269225239753723, + 1.3285869341343641, + 1.3334772773087025, + 0.3097354955971241, + 0.6687545757740736, + 1.0370800197124481 + ], + "unique_experts": 64, + "load_cv": 0.5169191113272563, + "normalized_load_entropy": 0.9651373546535229, + "max_load_share": 0.03313253012048193 + }, + "full_input": { + "tokens": 207, + "top_k": 6, + "decisions": 1242, + "ordered_route_sha256": "2224b387f19b263094ac614aa7104164916842f3cead6c9af5046896f4d00283", + "route_weight_sha256": "d050df8e5ec8e024660f1f8afde6e1f32f653fce2cdf64dc2ab89b4f3a70eb9d", + "loads": [ + 15, + 35, + 13, + 16, + 6, + 27, + 17, + 7, + 22, + 18, + 41, + 17, + 20, + 6, + 28, + 27, + 10, + 32, + 38, + 36, + 15, + 14, + 9, + 7, + 3, + 37, + 18, + 20, + 25, + 22, + 15, + 4, + 20, + 2, + 13, + 26, + 18, + 13, + 34, + 27, + 37, + 24, + 25, + 15, + 8, + 17, + 1, + 11, + 7, + 44, + 33, + 20, + 13, + 29, + 22, + 39, + 23, + 6, + 17, + 26, + 16, + 8, + 13, + 15 + ], + "weighted_loads": [ + 0.7441491987556219, + 2.3633053994271904, + 0.5011102091521025, + 1.0289628449827433, + 0.4102766814175993, + 1.0762281473726034, + 1.523018755018711, + 0.23246233421377838, + 0.7588246732484549, + 0.6333635896444321, + 3.1806189455091953, + 1.0814452897757292, + 1.4815268851816654, + 0.2648123800754547, + 2.06732558645308, + 4.0596058228984475, + 0.6710388548672199, + 2.267321612685919, + 3.2221722453832626, + 2.602825860492885, + 0.5155871117021888, + 0.9253969937562943, + 0.5074668861925602, + 0.3836951106786728, + 0.2336234711110592, + 3.9126697443425655, + 0.956221355125308, + 1.3579480852931738, + 1.422252457588911, + 1.537763960659504, + 0.9460576325654984, + 0.14672521501779556, + 0.7776505835354328, + 0.07163596712052822, + 1.0862006060779095, + 2.248515333980322, + 1.0213108770549297, + 0.5439199972897768, + 2.788346452638507, + 2.026387181133032, + 2.551033480092883, + 2.0122286416590214, + 1.443946398794651, + 0.8764197304844856, + 0.5676517300307751, + 1.1106201242655516, + 0.04434465989470482, + 0.3488854211755097, + 0.4692756310105324, + 3.6796627305448055, + 3.2909889854490757, + 2.1587746664881706, + 1.9899422992020845, + 1.9796921778470278, + 0.6500331868883222, + 1.946735206991434, + 1.1671571116894484, + 0.22887446731328964, + 1.0970218256115913, + 1.3765892665833235, + 1.3792737983167171, + 0.3097354955971241, + 0.6687545757740736, + 2.2143493071198463 + ], + "unique_experts": 64, + "load_cv": 0.5427256672607873, + "normalized_load_entropy": 0.9624809014510269, + "max_load_share": 0.03542673107890499 + } + }, + "s0_bos": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "99f3bf78425b2244fc0b022f15d043d6b2bc867dc32b5bf6a456b297c5cb2b72", + "route_weight_sha256": "ea1168523aad24858c96537d9150f209e3c83cee1351ddf9d93d9cbe5b285825", + "loads": [ + 14, + 34, + 12, + 10, + 5, + 32, + 8, + 4, + 22, + 17, + 29, + 13, + 15, + 6, + 32, + 13, + 8, + 21, + 25, + 26, + 13, + 14, + 7, + 6, + 2, + 29, + 20, + 19, + 23, + 18, + 15, + 4, + 16, + 1, + 12, + 21, + 17, + 8, + 21, + 15, + 33, + 12, + 12, + 12, + 6, + 16, + 1, + 8, + 7, + 29, + 19, + 19, + 13, + 20, + 17, + 26, + 20, + 7, + 15, + 27, + 14, + 9, + 14, + 13 + ], + "weighted_loads": [ + 0.7184966914355755, + 2.41192289814353, + 0.4741850644350052, + 0.6066882703453302, + 0.39803658053278923, + 1.2520720567554235, + 0.4884982630610466, + 0.1618332825601101, + 0.8157074376940727, + 0.6297988388687372, + 2.4310055151581764, + 0.6735155023634434, + 1.0474646054208279, + 0.25929000973701477, + 2.1935193110257387, + 1.532315844669938, + 0.42654559202492237, + 1.5968200750648975, + 2.0250992216169834, + 1.80011735111475, + 0.503605654463172, + 0.9495392814278603, + 0.4317917861044407, + 0.34326450526714325, + 0.14827054738998413, + 3.221793193370104, + 1.018183121457696, + 1.2679652404040098, + 1.36267526820302, + 1.38675931468606, + 0.9228517301380634, + 0.14422347024083138, + 0.5545970387756824, + 0.029195943847298622, + 1.0686527341604233, + 1.7437379881739616, + 0.9785658791661263, + 0.3296043761074543, + 1.553528368473053, + 0.9314306266605854, + 2.420369889587164, + 0.7852030657231808, + 0.6286533046513796, + 0.6830355599522591, + 0.48201271146535873, + 1.070606555789709, + 0.045094478875398636, + 0.2826984878629446, + 0.4675622619688511, + 2.8017646819353104, + 1.7660080138593912, + 2.0940537489950657, + 0.4358173292130232, + 1.2356445714831352, + 0.5687350127846003, + 1.2522040642797947, + 1.0690467730164528, + 0.25447179190814495, + 1.0124711617827415, + 1.4072555862367153, + 1.2991335839033127, + 0.3469842132180929, + 0.7016691844910383, + 1.098965061828494 + ], + "unique_experts": 64, + "load_cv": 0.5296182359770303, + "normalized_load_entropy": 0.9640648774340602, + "max_load_share": 0.03413654618473896 + }, + "full_input": { + "tokens": 191, + "top_k": 6, + "decisions": 1146, + "ordered_route_sha256": "d873d605090c16a8cd250348062334981af45c9ac4426c2cffa6139fcfdc26f3", + "route_weight_sha256": "a43a3c8c36d898f97db9e0b2376d2054085c58acf9a7930b9a09a123a15835c0", + "loads": [ + 14, + 35, + 12, + 10, + 5, + 34, + 9, + 7, + 23, + 18, + 40, + 13, + 18, + 6, + 32, + 27, + 10, + 27, + 34, + 27, + 14, + 14, + 7, + 6, + 2, + 37, + 20, + 19, + 23, + 18, + 15, + 4, + 16, + 1, + 12, + 25, + 17, + 8, + 34, + 24, + 37, + 20, + 20, + 13, + 7, + 16, + 1, + 9, + 7, + 34, + 26, + 19, + 14, + 28, + 19, + 37, + 20, + 7, + 15, + 28, + 14, + 9, + 14, + 15 + ], + "weighted_loads": [ + 0.7184966914355755, + 2.4154350829776376, + 0.4741850644350052, + 0.6066882703453302, + 0.39803658053278923, + 1.3195359725505114, + 0.5375108309090137, + 0.2316214945167303, + 0.8190603493712842, + 0.6673975642770529, + 3.118635732680559, + 0.6735155023634434, + 1.2469257451593876, + 0.25929000973701477, + 2.1935193110257387, + 3.7227670126594603, + 0.6004122514277697, + 1.8933915235102177, + 2.8717227578163147, + 1.813197952695191, + 0.5161860631778836, + 0.9495392814278603, + 0.4317917861044407, + 0.34326450526714325, + 0.14827054738998413, + 4.122521858662367, + 1.018183121457696, + 1.2679652404040098, + 1.36267526820302, + 1.38675931468606, + 0.9228517301380634, + 0.14422347024083138, + 0.5545970387756824, + 0.029195943847298622, + 1.0686527341604233, + 2.0548826307058334, + 0.9785658791661263, + 0.3296043761074543, + 2.810172863304615, + 1.5896755121648312, + 2.596124906092882, + 1.6202639415860176, + 1.1676226574927568, + 0.73014235496521, + 0.5632589906454086, + 1.070606555789709, + 0.045094478875398636, + 0.29827703069895506, + 0.4675622619688511, + 3.021713312715292, + 2.3992045428603888, + 2.0940537489950657, + 1.1002466958016157, + 1.7745200879871845, + 0.5837077517062426, + 1.99286949634552, + 1.0690467730164528, + 0.25447179190814495, + 1.0124711617827415, + 1.4534857161343098, + 1.2991335839033127, + 0.3469842132180929, + 0.7016691844910383, + 2.0354510713368654 + ], + "unique_experts": 64, + "load_cv": 0.565119053692923, + "normalized_load_entropy": 0.9594859083445525, + "max_load_share": 0.034904013961605584 + } + }, + "s1_bos": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "db55d6c78010a4e04659abd18d905f576672943b8e123237c914218d79423f23", + "route_weight_sha256": "08ea002f78b6ae2a0f97494fd91a7f9870eb93960ef40606322cb0f5dc173e17", + "loads": [ + 13, + 34, + 10, + 10, + 6, + 30, + 8, + 4, + 23, + 18, + 29, + 13, + 15, + 6, + 31, + 14, + 6, + 21, + 25, + 24, + 14, + 15, + 7, + 6, + 2, + 29, + 18, + 19, + 23, + 19, + 16, + 5, + 14, + 1, + 11, + 21, + 19, + 9, + 21, + 14, + 33, + 12, + 12, + 12, + 7, + 17, + 2, + 8, + 7, + 30, + 17, + 19, + 13, + 19, + 22, + 25, + 19, + 6, + 17, + 26, + 14, + 9, + 14, + 13 + ], + "weighted_loads": [ + 0.7102295141667128, + 2.3912853077054024, + 0.40587800182402134, + 0.6089052148163319, + 0.45443506725132465, + 1.1698140799999237, + 0.4939851015806198, + 0.15668439120054245, + 0.8556449022144079, + 0.6820134185254574, + 2.3960284423083067, + 0.6871513742953539, + 1.0451910980045795, + 0.2574925795197487, + 2.1918664425611496, + 1.6264780852943659, + 0.34921760857105255, + 1.6079449653625488, + 1.9577208012342453, + 1.7008183542639017, + 0.543276209384203, + 0.9921205826103687, + 0.4310471937060356, + 0.340657114982605, + 0.15013883262872696, + 3.1915332041680813, + 0.9658092819154263, + 1.2644931338727474, + 1.305930444970727, + 1.3918604739010334, + 0.9794694893062115, + 0.17838984914124012, + 0.4721972178667784, + 0.029994113370776176, + 1.0202015452086926, + 1.7672463450580835, + 1.1061432547867298, + 0.3562583290040493, + 1.554105481132865, + 0.8652304038405418, + 2.4216367602348328, + 0.786633275449276, + 0.631605502218008, + 0.6978652253746986, + 0.5078145489096642, + 1.0809001680463552, + 0.07713392376899719, + 0.292679900303483, + 0.4666660614311695, + 2.7064472176134586, + 1.688998967409134, + 2.1524946950376034, + 0.43835628405213356, + 1.1977777294814587, + 0.7388773020356894, + 1.1773589085787535, + 1.026926413178444, + 0.2238124068826437, + 1.06608048081398, + 1.3764442130923271, + 1.3193941004574299, + 0.3600971568375826, + 0.7074808087199926, + 1.108344092965126 + ], + "unique_experts": 64, + "load_cv": 0.5213928020455739, + "normalized_load_entropy": 0.9652952577902436, + "max_load_share": 0.03413654618473896 + }, + "full_input": { + "tokens": 207, + "top_k": 6, + "decisions": 1242, + "ordered_route_sha256": "2ab318be053081d10ddef378823759c9910a15e69a5663928926712128280b66", + "route_weight_sha256": "e20f1f41132e61dbb0423773b6b6366886a65bd8a46e8e269633ea20b091f9b6", + "loads": [ + 14, + 36, + 10, + 16, + 6, + 32, + 17, + 7, + 24, + 18, + 43, + 16, + 20, + 6, + 32, + 30, + 10, + 32, + 39, + 34, + 15, + 15, + 8, + 6, + 3, + 37, + 18, + 21, + 23, + 21, + 16, + 5, + 15, + 2, + 12, + 25, + 20, + 12, + 35, + 26, + 36, + 25, + 24, + 16, + 8, + 17, + 2, + 10, + 7, + 43, + 28, + 20, + 14, + 29, + 25, + 36, + 19, + 6, + 18, + 27, + 15, + 9, + 14, + 17 + ], + "weighted_loads": [ + 0.7468253467231989, + 2.4153870719019324, + 0.40587800182402134, + 1.0271464921534061, + 0.45443506725132465, + 1.2436333503574133, + 1.5203934609889984, + 0.24737648549489677, + 0.8590125932823867, + 0.6820134185254574, + 3.254638621583581, + 1.0567333493381739, + 1.4713986590504646, + 0.2574925795197487, + 2.2272176034748554, + 4.323459516279399, + 0.6421614065766335, + 2.2871162220835686, + 3.2274659648537636, + 2.5399514688178897, + 0.5558566180989146, + 0.9921205826103687, + 0.46880628913640976, + 0.340657114982605, + 0.22692479938268661, + 3.911615625023842, + 0.9658092819154263, + 1.4390285648405552, + 1.305930444970727, + 1.4781113602221012, + 0.9794694893062115, + 0.17838984914124012, + 0.5908451210707426, + 0.07313953898847103, + 1.0545204915106297, + 2.2015929091721773, + 1.151631698012352, + 0.5088393539190292, + 2.9567709881812334, + 1.9661360494792461, + 2.5497337095439434, + 2.044003590941429, + 1.4487790167331696, + 0.9423261545598507, + 0.5690275952219963, + 1.0809001680463552, + 0.07713392376899719, + 0.34109298791736364, + 0.4666660614311695, + 3.4916750714182854, + 2.8297711052000523, + 2.2004025615751743, + 1.102785650640726, + 2.0038317888975143, + 0.7914126883260906, + 1.810494678094983, + 1.026926413178444, + 0.2238124068826437, + 1.1361797824501991, + 1.4244465455412865, + 1.3651906214654446, + 0.3600971568375826, + 0.7074808087199926, + 2.2856133803725243 + ], + "unique_experts": 64, + "load_cv": 0.5460789448204454, + "normalized_load_entropy": 0.9623392664155849, + "max_load_share": 0.03462157809983897 + } + }, + "s0_x": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "9613fa5e2afeddb3a1a2bff50c05942f46ce07737c14b0e1937895ac477260a5", + "route_weight_sha256": "155f037c11d20203467a8f7c7a4addca32edf17b346dd6e148e39d8a61aa17b4", + "loads": [ + 14, + 34, + 12, + 9, + 6, + 30, + 8, + 5, + 23, + 16, + 29, + 14, + 15, + 6, + 35, + 14, + 8, + 21, + 25, + 26, + 14, + 14, + 9, + 8, + 2, + 29, + 19, + 19, + 24, + 18, + 15, + 5, + 16, + 1, + 12, + 20, + 16, + 7, + 22, + 15, + 33, + 12, + 10, + 12, + 6, + 16, + 1, + 8, + 7, + 31, + 20, + 19, + 11, + 19, + 16, + 27, + 19, + 7, + 16, + 26, + 14, + 6, + 13, + 12 + ], + "weighted_loads": [ + 0.7260273490101099, + 2.4133946131914854, + 0.4676712956279516, + 0.555336244404316, + 0.43628119118511677, + 1.1848096791654825, + 0.4855305887758732, + 0.18720605969429016, + 0.8360249027609825, + 0.577420424669981, + 2.4369434136897326, + 0.7206339668482542, + 1.0727055482566357, + 0.2570664621889591, + 2.2743868604302406, + 1.599254421889782, + 0.42326991632580757, + 1.5936278365552425, + 2.0675351470708847, + 1.8066310845315456, + 0.5330089088529348, + 0.9318811744451523, + 0.47423719987273216, + 0.4120188094675541, + 0.1463889516890049, + 3.2186017371714115, + 0.9772840309888124, + 1.267245214432478, + 1.3785057496279478, + 1.3650516010820866, + 0.9138054735958576, + 0.18475227802991867, + 0.5536484513431787, + 0.029219862073659897, + 1.0554922260344028, + 1.7469721008092165, + 0.9224817641079426, + 0.2991325221955776, + 1.56552947871387, + 0.9592373222112656, + 2.4337994642555714, + 0.7998357359319925, + 0.5517211966216564, + 0.6865838840603828, + 0.47071007266640663, + 1.0796917416155338, + 0.044860921800136566, + 0.2884122058749199, + 0.4653123263269663, + 2.8829584047198296, + 1.7344546914100647, + 2.0758063197135925, + 0.36514283902943134, + 1.1885100416839123, + 0.5383317228406668, + 1.2714701686054468, + 1.0265973471105099, + 0.2483005877584219, + 1.0308737996965647, + 1.3757840041071177, + 1.3126297816634178, + 0.2621785495430231, + 0.6665835957974195, + 1.0848550200462341 + ], + "unique_experts": 64, + "load_cv": 0.535192361696542, + "normalized_load_entropy": 0.9639316262574424, + "max_load_share": 0.035140562248995984 + }, + "full_input": { + "tokens": 191, + "top_k": 6, + "decisions": 1146, + "ordered_route_sha256": "af0e83adf5264b089855c0180692bffe058d51296323241f1a36c330b1aef07b", + "route_weight_sha256": "9e0757f007f893d30f189cdaa19fb6a55da315906dc377ec9d22768c4a8c3105", + "loads": [ + 14, + 36, + 12, + 9, + 6, + 32, + 9, + 8, + 24, + 16, + 41, + 14, + 18, + 6, + 35, + 28, + 10, + 27, + 34, + 27, + 15, + 14, + 9, + 8, + 2, + 38, + 19, + 19, + 24, + 18, + 15, + 5, + 16, + 1, + 12, + 24, + 16, + 7, + 32, + 23, + 39, + 21, + 16, + 13, + 7, + 16, + 1, + 9, + 7, + 34, + 27, + 19, + 12, + 29, + 18, + 39, + 19, + 7, + 16, + 27, + 14, + 6, + 13, + 14 + ], + "weighted_loads": [ + 0.7260273490101099, + 2.4534419828560203, + 0.4676712956279516, + 0.555336244404316, + 0.43628119118511677, + 1.2522735949605703, + 0.5320123769342899, + 0.25650098733603954, + 0.839377814438194, + 0.577420424669981, + 3.23877508379519, + 0.7206339668482542, + 1.269590325653553, + 0.2570664621889591, + 2.2743868604302406, + 3.971164532471448, + 0.5968160144984722, + 1.8901992850005627, + 2.8055980689823627, + 1.8197116861119866, + 0.5455893175676465, + 0.9318811744451523, + 0.47423719987273216, + 0.4120188094675541, + 0.1463889516890049, + 4.204367283731699, + 0.9772840309888124, + 1.267245214432478, + 1.3785057496279478, + 1.3650516010820866, + 0.9138054735958576, + 0.18475227802991867, + 0.5536484513431787, + 0.029219862073659897, + 1.0554922260344028, + 2.0581167433410883, + 0.9224817641079426, + 0.2991325221955776, + 2.480643330141902, + 1.5894534327089787, + 2.7257480956614017, + 1.6269018296152353, + 0.9515320211648941, + 0.7306007891893387, + 0.5519563518464565, + 1.0796917416155338, + 0.044860921800136566, + 0.30399074871093035, + 0.4653123263269663, + 3.0250117257237434, + 2.366797111928463, + 2.0758063197135925, + 1.0295722056180239, + 1.8409282267093658, + 0.5533044617623091, + 2.1255635861307383, + 1.0265973471105099, + 0.2483005877584219, + 1.0308737996965647, + 1.422014134004712, + 1.3126297816634178, + 0.2621785495430231, + 0.6665835957974195, + 2.0213410295546055 + ], + "unique_experts": 64, + "load_cv": 0.5758818541752769, + "normalized_load_entropy": 0.9587934605568708, + "max_load_share": 0.03577661431064572 + } + }, + "s1_x": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "a690fe68a335ad3a017d29faefe8684e33e90dabef449eaa6b73307d8a60778f", + "route_weight_sha256": "80bba99c8e7e097c32bbdfa8e173d5510508c83091974eb9ff581cf1963b1213", + "loads": [ + 13, + 33, + 9, + 9, + 6, + 32, + 8, + 4, + 25, + 18, + 29, + 12, + 15, + 5, + 35, + 14, + 6, + 21, + 25, + 26, + 14, + 15, + 7, + 6, + 2, + 29, + 18, + 19, + 22, + 19, + 15, + 5, + 13, + 1, + 12, + 21, + 17, + 8, + 21, + 15, + 34, + 11, + 12, + 12, + 7, + 17, + 2, + 7, + 7, + 30, + 18, + 20, + 12, + 19, + 23, + 26, + 19, + 6, + 18, + 26, + 14, + 7, + 13, + 12 + ], + "weighted_loads": [ + 0.7131969165056944, + 2.3566241674125195, + 0.39789697155356407, + 0.5657276604324579, + 0.45697941072285175, + 1.2479512449353933, + 0.48558390513062477, + 0.14613540843129158, + 0.9301940873265266, + 0.6793229356408119, + 2.4198561552911997, + 0.6530546732246876, + 1.0514568276703358, + 0.21857092902064323, + 2.326979162171483, + 1.648618120700121, + 0.343580886721611, + 1.6022483594715595, + 1.9925858676433563, + 1.7809605617076159, + 0.5511191189289093, + 1.0032186955213547, + 0.4220152348279953, + 0.3411768861114979, + 0.15145350620150566, + 3.16854041069746, + 0.9521614518016577, + 1.2739132344722748, + 1.2193626165390015, + 1.3710280302911997, + 0.9300955645740032, + 0.17797030694782734, + 0.43707435578107834, + 0.03050139546394348, + 1.0506399869918823, + 1.8120205271989107, + 1.0423855241388083, + 0.3224830124527216, + 1.5515543669462204, + 0.915186695754528, + 2.4741897229105234, + 0.750315461307764, + 0.6191501785069704, + 0.6873425096273422, + 0.5026860237121582, + 1.103172741830349, + 0.08259650319814682, + 0.26772506535053253, + 0.4635849632322788, + 2.6850122287869453, + 1.6472303867340088, + 2.1924498230218887, + 0.40352725610136986, + 1.1756648272275925, + 0.7527574095875025, + 1.2009357791393995, + 1.015586007386446, + 0.22267015650868416, + 1.086379086598754, + 1.3775387238711119, + 1.324559137225151, + 0.2995029613375664, + 0.6736793853342533, + 1.0888401865959167 + ], + "unique_experts": 64, + "load_cv": 0.5472320457434103, + "normalized_load_entropy": 0.9622927966305659, + "max_load_share": 0.035140562248995984 + }, + "full_input": { + "tokens": 207, + "top_k": 6, + "decisions": 1242, + "ordered_route_sha256": "87172dcfc33e89aafa8bf3965cb942fc4460065afcc3c4f4bfd8b2a462641df1", + "route_weight_sha256": "c462b5b42f703b4f66defc9a66fdae36b427cd169f17de57b85ea513e7d27dea", + "loads": [ + 14, + 35, + 9, + 15, + 6, + 34, + 17, + 7, + 26, + 18, + 44, + 15, + 20, + 5, + 36, + 30, + 10, + 32, + 39, + 36, + 15, + 15, + 8, + 6, + 3, + 38, + 18, + 21, + 22, + 21, + 15, + 5, + 14, + 3, + 13, + 26, + 18, + 11, + 32, + 27, + 38, + 23, + 23, + 16, + 8, + 17, + 2, + 9, + 7, + 43, + 27, + 21, + 13, + 31, + 26, + 37, + 19, + 6, + 19, + 27, + 15, + 7, + 13, + 16 + ], + "weighted_loads": [ + 0.7497927490621805, + 2.3807259316090494, + 0.39789697155356407, + 0.9839689377695322, + 0.45697941072285175, + 1.321770515292883, + 1.5111805349588394, + 0.2352490711491555, + 0.9335617783945054, + 0.6793229356408119, + 3.3796331491321325, + 1.0226366482675076, + 1.4761458560824394, + 0.21857092902064323, + 2.362330323085189, + 4.528989509679377, + 0.646642230451107, + 2.2814196161925793, + 3.132271934300661, + 2.620093676261604, + 0.563699527643621, + 1.0032186955213547, + 0.45977433025836945, + 0.3411768861114979, + 0.22823947295546532, + 3.9671976156532764, + 0.9521614518016577, + 1.4484486654400826, + 1.2193626165390015, + 1.4572789166122675, + 0.9300955645740032, + 0.17797030694782734, + 0.5557222589850426, + 0.11794615164399147, + 1.0849589332938194, + 2.292708935216069, + 1.0878739673644304, + 0.47506403736770153, + 2.6003590002655983, + 2.0360189601778984, + 2.676653465256095, + 1.9237680844962597, + 1.359468610957265, + 0.9296384006738663, + 0.5638990700244904, + 1.103172741830349, + 0.08259650319814682, + 0.31613815296441317, + 0.4635849632322788, + 3.4664342030882835, + 2.6830281764268875, + 2.2403576895594597, + 1.0679566226899624, + 2.094455223530531, + 0.8052927958779037, + 1.908897852525115, + 1.015586007386446, + 0.22267015650868416, + 1.156478388234973, + 1.4255410563200712, + 1.3703556582331657, + 0.2995029613375664, + 0.6736793853342533, + 2.266109474003315 + ], + "unique_experts": 64, + "load_cv": 0.564974187369069, + "normalized_load_entropy": 0.9601800962184976, + "max_load_share": 0.03542673107890499 + } + }, + "s0_period": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "6a63ad7badedb76c96569f58bb1f91ac969fe585f18f206fa9c163b927225650", + "route_weight_sha256": "d4c2b8d6234e2c2f7552757e028d991adc379797d466ba6f582ff3b841e54811", + "loads": [ + 14, + 35, + 11, + 9, + 6, + 29, + 8, + 5, + 22, + 17, + 29, + 12, + 15, + 6, + 33, + 14, + 8, + 21, + 25, + 26, + 14, + 14, + 9, + 8, + 2, + 29, + 18, + 19, + 24, + 18, + 16, + 5, + 17, + 1, + 12, + 21, + 17, + 9, + 21, + 15, + 33, + 12, + 11, + 12, + 6, + 16, + 1, + 7, + 7, + 31, + 19, + 17, + 12, + 19, + 17, + 27, + 20, + 6, + 16, + 26, + 14, + 6, + 13, + 14 + ], + "weighted_loads": [ + 0.7269099876284599, + 2.4243367724120617, + 0.42770584113895893, + 0.5570117179304361, + 0.4313200693577528, + 1.1556545365601778, + 0.48723669722676277, + 0.1875055506825447, + 0.7907658256590366, + 0.6214226111769676, + 2.431014932692051, + 0.6522024609148502, + 1.0847403891384602, + 0.2568528614938259, + 2.2075230088084936, + 1.58865986764431, + 0.4236079230904579, + 1.58669164031744, + 2.0903630293905735, + 1.8145952634513378, + 0.5322299804538488, + 0.9324362352490425, + 0.48173599131405354, + 0.4122801572084427, + 0.14393417164683342, + 3.1997925639152527, + 0.9514104668051004, + 1.2783272340893745, + 1.379941176623106, + 1.3570688534528017, + 0.9592350386083126, + 0.18736150488257408, + 0.5837717931717634, + 0.02918062172830105, + 1.0622784458100796, + 1.7920938730239868, + 0.9546317011117935, + 0.3617365173995495, + 1.5472995005548, + 0.9827061556279659, + 2.4257371574640274, + 0.7912424206733704, + 0.586486641317606, + 0.6873412616550922, + 0.47254373133182526, + 1.0666398294270039, + 0.04499554634094238, + 0.2586161084473133, + 0.46423424035310745, + 2.8603660352528095, + 1.6460927054286003, + 2.021146424114704, + 0.4018330480903387, + 1.185267684981227, + 0.5702789109200239, + 1.2808551713824272, + 1.0539077818393707, + 0.22599083557724953, + 1.0344954300671816, + 1.3672861903905869, + 1.3051246888935566, + 0.2626872733235359, + 0.6683903820812702, + 1.1272963620722294 + ], + "unique_experts": 64, + "load_cv": 0.5294964076388892, + "normalized_load_entropy": 0.9644581800220494, + "max_load_share": 0.035140562248995984 + }, + "full_input": { + "tokens": 191, + "top_k": 6, + "decisions": 1146, + "ordered_route_sha256": "85f9c2e390db90f56e901d6326a93d95a60dd7aa53b5663e5b46807a52281692", + "route_weight_sha256": "6162c11d987b5b943f3c9a15ea70f8b544093fe1e0d372d5943b529f3c5784dd", + "loads": [ + 14, + 37, + 11, + 9, + 6, + 31, + 9, + 8, + 23, + 17, + 41, + 12, + 18, + 6, + 33, + 28, + 11, + 28, + 34, + 27, + 15, + 14, + 9, + 8, + 2, + 37, + 18, + 19, + 24, + 18, + 16, + 5, + 17, + 1, + 12, + 26, + 17, + 9, + 31, + 23, + 38, + 21, + 17, + 13, + 8, + 16, + 1, + 8, + 7, + 34, + 26, + 17, + 13, + 27, + 19, + 39, + 20, + 6, + 16, + 27, + 14, + 6, + 13, + 16 + ], + "weighted_loads": [ + 0.7269099876284599, + 2.4655892138835043, + 0.42770584113895893, + 0.5570117179304361, + 0.4313200693577528, + 1.2231184523552656, + 0.5349331460893154, + 0.25660294480621815, + 0.7941187373362482, + 0.6214226111769676, + 3.2218205220997334, + 0.6522024609148502, + 1.283899411559105, + 0.2568528614938259, + 2.2075230088084936, + 3.784487806726247, + 0.6364181749522686, + 1.9402332603931427, + 2.777213491499424, + 1.8276758650317788, + 0.5448103891685605, + 0.9324362352490425, + 0.48173599131405354, + 0.4122801572084427, + 0.14393417164683342, + 4.100521229207516, + 0.9514104668051004, + 1.2783272340893745, + 1.379941176623106, + 1.3570688534528017, + 0.9592350386083126, + 0.18736150488257408, + 0.5837717931717634, + 0.02918062172830105, + 1.0622784458100796, + 2.1561746038496494, + 0.9546317011117935, + 0.3617365173995495, + 2.427161853760481, + 1.6164557673037052, + 2.659427981823683, + 1.6563162542879581, + 0.9939373061060905, + 0.7314509861171246, + 0.6095210015773773, + 1.0666398294270039, + 0.04499554634094238, + 0.27419465128332376, + 0.46423424035310745, + 3.003203384578228, + 2.2813123129308224, + 2.021146424114704, + 1.0662624146789312, + 1.7241432014852762, + 0.5852516498416662, + 2.25663223862648, + 1.0539077818393707, + 0.22599083557724953, + 1.0344954300671816, + 1.4135163202881813, + 1.3051246888935566, + 0.2626872733235359, + 0.6683903820812702, + 2.0637823715806007 + ], + "unique_experts": 64, + "load_cv": 0.5664970929235151, + "normalized_load_entropy": 0.9598328708930923, + "max_load_share": 0.03577661431064572 + } + }, + "s1_period": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "0657d84049a49dfe4431fef9a058ab2f0d5e911782bc877307c64cb068d555c3", + "route_weight_sha256": "703734b1c116aa98f69cbe00c79872186a9f2a2da8adf1c3a3e5c936d1ba9bb0", + "loads": [ + 13, + 35, + 9, + 9, + 6, + 31, + 8, + 4, + 23, + 15, + 30, + 13, + 15, + 5, + 37, + 14, + 6, + 21, + 26, + 26, + 15, + 15, + 7, + 6, + 2, + 29, + 18, + 19, + 21, + 18, + 15, + 5, + 14, + 1, + 11, + 21, + 19, + 8, + 20, + 15, + 33, + 11, + 12, + 12, + 7, + 16, + 3, + 7, + 7, + 30, + 18, + 20, + 11, + 19, + 26, + 25, + 19, + 6, + 18, + 25, + 14, + 7, + 13, + 12 + ], + "weighted_loads": [ + 0.7089541722089052, + 2.4016847666352987, + 0.3979058861732483, + 0.5660880580544472, + 0.4586288798600435, + 1.209486747160554, + 0.4851808696985245, + 0.1511753350496292, + 0.851089084520936, + 0.566592937335372, + 2.460437597706914, + 0.6828350927680731, + 1.0574377961456776, + 0.21817681565880775, + 2.3847392704337835, + 1.6715304479002953, + 0.3440299890935421, + 1.6017651073634624, + 2.032640164718032, + 1.7812030892819166, + 0.5768984779715538, + 1.0011406764388084, + 0.42213868349790573, + 0.3347001001238823, + 0.15199653431773186, + 3.1623270362615585, + 0.9595525003969669, + 1.275843659415841, + 1.197668019682169, + 1.3265944123268127, + 0.9298627525568008, + 0.1787522304803133, + 0.47117340937256813, + 0.03036920726299286, + 1.0102944858372211, + 1.8027399722486734, + 1.111274840310216, + 0.3192874062806368, + 1.507998425513506, + 0.9259127900004387, + 2.43696366623044, + 0.74661585688591, + 0.622995974496007, + 0.6834606900811195, + 0.501666747033596, + 1.0749921351671219, + 0.11834551393985748, + 0.2651830203831196, + 0.46666983515024185, + 2.687543388456106, + 1.6137846857309341, + 2.1915971115231514, + 0.3772309981286526, + 1.1920235604047775, + 0.8719808403402567, + 1.1645288448780775, + 1.0085277371108532, + 0.22146882116794586, + 1.0846382956951857, + 1.3406097367405891, + 1.321138173341751, + 0.28796095959842205, + 0.6725123319774866, + 1.0971402246505022 + ], + "unique_experts": 64, + "load_cv": 0.55122585017779, + "normalized_load_entropy": 0.9622845681839457, + "max_load_share": 0.03714859437751004 + }, + "full_input": { + "tokens": 207, + "top_k": 6, + "decisions": 1242, + "ordered_route_sha256": "269fbc6bdbe61e7404ced26c57939f2466e41806cc0fd26da3252310035dcfcc", + "route_weight_sha256": "30c2ff33dd327748bb10a000aae594362d221444a32fc9a58a38b068dbdf8a9d", + "loads": [ + 14, + 37, + 9, + 15, + 6, + 34, + 17, + 6, + 24, + 15, + 45, + 16, + 20, + 6, + 38, + 31, + 10, + 33, + 39, + 36, + 16, + 15, + 8, + 6, + 3, + 37, + 18, + 21, + 21, + 20, + 15, + 5, + 15, + 2, + 12, + 26, + 20, + 11, + 31, + 27, + 37, + 24, + 22, + 16, + 9, + 16, + 3, + 9, + 7, + 43, + 27, + 21, + 12, + 29, + 29, + 37, + 19, + 6, + 19, + 26, + 15, + 7, + 13, + 16 + ], + "weighted_loads": [ + 0.7455500047653913, + 2.4257865308318287, + 0.3979058861732483, + 0.9843293353915215, + 0.4586288798600435, + 1.3274268694221973, + 1.511700589209795, + 0.20622864621691406, + 0.8544567755889148, + 0.566592937335372, + 3.4351126309484243, + 1.052417067810893, + 1.4829020276665688, + 0.2522077187895775, + 2.4200904313474894, + 4.436578121967614, + 0.6670352630317211, + 2.323284912854433, + 3.100365759804845, + 2.6203362038359046, + 0.5894788866862655, + 1.0011406764388084, + 0.4598977789282799, + 0.3347001001238823, + 0.2287825010716915, + 3.882409457117319, + 0.9595525003969669, + 1.4503790903836489, + 1.197668019682169, + 1.4128452986478806, + 0.9298627525568008, + 0.1787522304803133, + 0.5898213125765324, + 0.07351463288068771, + 1.0446134321391582, + 2.317061038687825, + 1.1567632835358381, + 0.4718684311956167, + 2.5153487138450146, + 2.0436547100543976, + 2.6163046061992645, + 2.0324655920267105, + 1.3484880235046148, + 0.9255958721041679, + 0.6081572361290455, + 1.0749921351671219, + 0.11834551393985748, + 0.3135961079970002, + 0.46666983515024185, + 3.469253920018673, + 2.641880054026842, + 2.2395049780607224, + 1.041660364717245, + 1.9980776198208332, + 0.9245162266306579, + 1.9919821415096521, + 1.0085277371108532, + 0.22146882116794586, + 1.1547375973314047, + 1.3886120691895485, + 1.3669346943497658, + 0.28796095959842205, + 0.6725123319774866, + 2.2744095120579004 + ], + "unique_experts": 64, + "load_cv": 0.5687800333145105, + "normalized_load_entropy": 0.9598859603151734, + "max_load_share": 0.036231884057971016 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 166, + "ordered_topk_exact_tokens": 126, + "set_exact_tokens": 139, + "mean_set_jaccard": 0.9535283993115318, + "mean_token_weighted_tv": 0.009547509382063725, + "aggregate_load_tv": 0.022088353413654623 + }, + "system_bos": { + "tokens": 166, + "ordered_topk_exact_tokens": 111, + "set_exact_tokens": 131, + "mean_set_jaccard": 0.9384681583476764, + "mean_token_weighted_tv": 0.013961040392428278, + "aggregate_load_tv": 0.023092369477911642 + }, + "system_x": { + "tokens": 166, + "ordered_topk_exact_tokens": 100, + "set_exact_tokens": 122, + "mean_set_jaccard": 0.9229776247848538, + "mean_token_weighted_tv": 0.016850547393761486, + "aggregate_load_tv": 0.029116465863453816 + }, + "system_period": { + "tokens": 166, + "ordered_topk_exact_tokens": 100, + "set_exact_tokens": 118, + "mean_set_jaccard": 0.916092943201377, + "mean_token_weighted_tv": 0.01772748600377376, + "aggregate_load_tv": 0.03313253012048192 + }, + "bos_at_s0": { + "tokens": 166, + "ordered_topk_exact_tokens": 91, + "set_exact_tokens": 111, + "mean_set_jaccard": 0.9027538726333906, + "mean_token_weighted_tv": 0.020100989754884, + "aggregate_load_tv": 0.037148594377510044 + }, + "bos_at_s1": { + "tokens": 166, + "ordered_topk_exact_tokens": 83, + "set_exact_tokens": 107, + "mean_set_jaccard": 0.895869191049914, + "mean_token_weighted_tv": 0.022299839654959828, + "aggregate_load_tv": 0.040160642570281124 + }, + "x_at_s0": { + "tokens": 166, + "ordered_topk_exact_tokens": 91, + "set_exact_tokens": 112, + "mean_set_jaccard": 0.9044750430292599, + "mean_token_weighted_tv": 0.020424743794488262, + "aggregate_load_tv": 0.03413654618473895 + }, + "x_at_s1": { + "tokens": 166, + "ordered_topk_exact_tokens": 83, + "set_exact_tokens": 103, + "mean_set_jaccard": 0.8889845094664373, + "mean_token_weighted_tv": 0.024158167955746133, + "aggregate_load_tv": 0.04317269076305221 + }, + "period_at_s0": { + "tokens": 166, + "ordered_topk_exact_tokens": 88, + "set_exact_tokens": 110, + "mean_set_jaccard": 0.9036144578313253, + "mean_token_weighted_tv": 0.02052871672526361, + "aggregate_load_tv": 0.035140562248995984 + }, + "period_at_s1": { + "tokens": 166, + "ordered_topk_exact_tokens": 81, + "set_exact_tokens": 98, + "mean_set_jaccard": 0.8790877796901895, + "mean_token_weighted_tv": 0.02550258171037737, + "aggregate_load_tv": 0.04819277108433735 + } + } + }, + "layer_06": { + "layer": 6, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "d7784a9583ce00bab073b842b2bfc6cc39006ac222c525b05e2cd64ad0e2ab55", + "route_weight_sha256": "4ccb0b81b02acc0fb3372c2643131d1c907ead9f437c5e367c981fbd8fc13e89", + "loads": [ + 27, + 13, + 8, + 9, + 23, + 7, + 51, + 11, + 6, + 22, + 17, + 24, + 20, + 7, + 11, + 19, + 14, + 11, + 9, + 22, + 6, + 9, + 12, + 18, + 6, + 23, + 15, + 9, + 20, + 14, + 9, + 21, + 16, + 22, + 18, + 24, + 15, + 20, + 12, + 25, + 17, + 6, + 12, + 14, + 9, + 13, + 15, + 7, + 12, + 18, + 11, + 38, + 19, + 0, + 13, + 20, + 21, + 5, + 18, + 31, + 7, + 23, + 2, + 20 + ], + "weighted_loads": [ + 1.482601823285222, + 0.5390245616436005, + 0.5494559668004513, + 0.3901743870228529, + 1.9064618684351444, + 0.24805057235062122, + 3.8563739582896233, + 0.7489888034760952, + 0.44614361971616745, + 1.4050398487597704, + 1.3111913837492466, + 1.8235171996057034, + 1.3683421313762665, + 0.22190348990261555, + 0.49701917357742786, + 0.8395148664712906, + 1.0517379269003868, + 0.4596700258553028, + 0.536170981824398, + 1.7465257123112679, + 0.29898086935281754, + 0.3594122566282749, + 0.5045348014682531, + 1.454598169773817, + 0.22539536654949188, + 1.9069740250706673, + 0.5977241788059473, + 0.45132131688296795, + 1.1990569829940796, + 0.8423839919269085, + 0.32377275079488754, + 0.9541864674538374, + 0.5418103337287903, + 1.0384872816503048, + 1.2887659203261137, + 1.425634579733014, + 1.5950820744037628, + 1.4775488339364529, + 0.45420515164732933, + 1.0337787941098213, + 0.8312189653515816, + 0.3858173228800297, + 0.44093276746571064, + 0.5775092579424381, + 0.4658493846654892, + 0.5648576188832521, + 1.4183366112411022, + 0.2925149127840996, + 0.5454428289085627, + 1.5983873158693314, + 0.5451553985476494, + 3.419689793139696, + 1.3943995349109173, + 0.0, + 0.6947926301509142, + 1.2319340351969004, + 1.9132026955485344, + 0.3079591803252697, + 0.9036833290010691, + 2.5553404297679663, + 0.2964168395847082, + 0.7698181830346584, + 0.07038643956184387, + 0.9870845340192318 + ], + "unique_experts": 63, + "load_cv": 0.5408283298183961, + "normalized_load_entropy": 0.965830387548554, + "max_load_share": 0.05120481927710843 + }, + "full_input": { + "tokens": 191, + "top_k": 6, + "decisions": 1146, + "ordered_route_sha256": "1cf727276dfc8d058b7bfe1ea5b359f980a61fe5fbfe5d69600f7c96e2877741", + "route_weight_sha256": "4434d66b2359c8ceae0f63e045bcfc681fd3999a8fe8ca033eb418b8fa3aeae6", + "loads": [ + 27, + 16, + 8, + 9, + 24, + 7, + 59, + 11, + 6, + 22, + 17, + 30, + 20, + 9, + 13, + 19, + 19, + 12, + 9, + 30, + 7, + 12, + 15, + 19, + 6, + 24, + 15, + 9, + 20, + 17, + 9, + 21, + 19, + 22, + 19, + 30, + 15, + 29, + 12, + 34, + 17, + 11, + 14, + 14, + 9, + 18, + 28, + 9, + 16, + 18, + 18, + 45, + 19, + 0, + 13, + 30, + 31, + 5, + 18, + 40, + 7, + 23, + 2, + 20 + ], + "weighted_loads": [ + 1.482601823285222, + 0.6102971481159329, + 0.5494559668004513, + 0.3901743870228529, + 1.934984415769577, + 0.24805057235062122, + 4.723193522542715, + 0.7489888034760952, + 0.44614361971616745, + 1.4050398487597704, + 1.3111913837492466, + 2.1636585406959057, + 1.3683421313762665, + 0.24993119575083256, + 0.6288835611194372, + 0.8395148664712906, + 1.4000296369194984, + 0.46370585775002837, + 0.536170981824398, + 2.240625496953726, + 0.3431031368672848, + 0.5170611888170242, + 2.0264876540750265, + 1.4903067648410797, + 0.22539536654949188, + 1.9344994239509106, + 0.5977241788059473, + 0.45132131688296795, + 1.1990569829940796, + 1.0212029181420803, + 0.32377275079488754, + 0.9541864674538374, + 0.6386231072247028, + 1.0384872816503048, + 1.3235503379255533, + 1.981139613315463, + 1.5950820744037628, + 2.2688945308327675, + 0.45420515164732933, + 1.400703376159072, + 0.8312189653515816, + 0.7808770202100277, + 0.49898582696914673, + 0.5775092579424381, + 0.4658493846654892, + 0.6999424234963953, + 2.9629981629550457, + 0.3148417684715241, + 0.7550504263490438, + 1.5983873158693314, + 1.0335941575467587, + 3.72630924731493, + 1.3943995349109173, + 0.0, + 0.6947926301509142, + 1.991880727931857, + 3.101566579192877, + 0.3079591803252697, + 0.9036833290010691, + 3.5190105792135, + 0.2964168395847082, + 0.7698181830346584, + 0.07038643956184387, + 0.9870845340192318 + ], + "unique_experts": 63, + "load_cv": 0.573337608665992, + "normalized_load_entropy": 0.9621630374578132, + "max_load_share": 0.05148342059336824 + } + }, + "s1_eos": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "a34a318746bbdf6140ab92a6af6927a502c0d966f799b0554bc8557c45725f3e", + "route_weight_sha256": "ead67bf1f7554dd9008ab79bc8d8c9ac5c038bdd16c26e36c739d6ca6638a786", + "loads": [ + 27, + 15, + 8, + 9, + 23, + 6, + 51, + 11, + 6, + 22, + 17, + 24, + 20, + 5, + 11, + 19, + 14, + 9, + 9, + 22, + 6, + 10, + 11, + 18, + 4, + 24, + 15, + 10, + 20, + 13, + 8, + 21, + 17, + 21, + 18, + 24, + 14, + 20, + 13, + 24, + 18, + 6, + 14, + 14, + 10, + 13, + 16, + 9, + 12, + 18, + 11, + 38, + 19, + 0, + 14, + 20, + 20, + 5, + 16, + 31, + 7, + 23, + 3, + 20 + ], + "weighted_loads": [ + 1.461026819422841, + 0.6100635901093483, + 0.5430349223315716, + 0.38857328332960606, + 1.8611910194158554, + 0.2222070898860693, + 3.842819295823574, + 0.7484218589961529, + 0.45380908995866776, + 1.3937578480690718, + 1.318459339439869, + 1.8354157954454422, + 1.3644946031272411, + 0.15691019780933857, + 0.4911240432411432, + 0.8423391841351986, + 1.0371941737830639, + 0.39561184868216515, + 0.5465091988444328, + 1.7297350764274597, + 0.2971269376575947, + 0.39298840425908566, + 0.4608283471316099, + 1.4679690077900887, + 0.14599550887942314, + 1.9563261028379202, + 0.6017458327114582, + 0.4745844677090645, + 1.1915133353322744, + 0.8155207075178623, + 0.30610230192542076, + 0.9622932244092226, + 0.5768608711659908, + 1.0104829668998718, + 1.2701949179172516, + 1.395901009440422, + 1.5680001005530357, + 1.426165847107768, + 0.4851517453789711, + 0.9754251688718796, + 0.8661803156137466, + 0.38757746294140816, + 0.5244130771607161, + 0.5728882867842913, + 0.493521386757493, + 0.5673684477806091, + 1.3843695353716612, + 0.3743223734200001, + 0.5451053977012634, + 1.608062170445919, + 0.5188099034130573, + 3.4335117004811764, + 1.4033453725278378, + 0.0, + 0.7221746146678925, + 1.235253082588315, + 1.766196671873331, + 0.3064889721572399, + 0.8337201420217752, + 2.560256076976657, + 0.30087620578706264, + 0.7812220733612776, + 0.10976787842810154, + 0.9729590211063623 + ], + "unique_experts": 63, + "load_cv": 0.5411860797036023, + "normalized_load_entropy": 0.9656255460357969, + "max_load_share": 0.05120481927710843 + }, + "full_input": { + "tokens": 207, + "top_k": 6, + "decisions": 1242, + "ordered_route_sha256": "8886144751b9a56738dd49b384301d58b4b309bf78c1c3ab288ab18c987b6c46", + "route_weight_sha256": "0735c548533bdc584c29af5795c0261f2a0bec568adc727f6ceed79acea9f01f", + "loads": [ + 27, + 17, + 11, + 10, + 25, + 6, + 65, + 12, + 11, + 28, + 17, + 34, + 24, + 7, + 20, + 20, + 24, + 10, + 11, + 32, + 8, + 14, + 13, + 19, + 5, + 25, + 15, + 11, + 21, + 16, + 8, + 24, + 23, + 22, + 22, + 32, + 15, + 37, + 13, + 33, + 18, + 12, + 16, + 14, + 11, + 17, + 32, + 11, + 15, + 18, + 20, + 44, + 20, + 3, + 14, + 31, + 37, + 5, + 16, + 42, + 13, + 23, + 3, + 20 + ], + "weighted_loads": [ + 1.461026819422841, + 0.64976776111871, + 0.6862688809633255, + 0.42572115547955036, + 2.01212689653039, + 0.2222070898860693, + 5.080942720174789, + 0.8098809756338596, + 0.791658915579319, + 2.100188894197345, + 1.318459339439869, + 2.44256704300642, + 1.6950217261910439, + 0.18522793613374233, + 1.1647949907928705, + 0.9527129344642162, + 1.7997959218919277, + 0.39968847017735243, + 0.6948965527117252, + 2.430574331432581, + 0.3901077136397362, + 0.6234969664365053, + 1.9525899719446898, + 1.5032480657100677, + 0.1787591278553009, + 1.9917205478996038, + 0.6017458327114582, + 0.5014583468437195, + 1.229117626324296, + 1.0175107568502426, + 0.30610230192542076, + 1.1626464556902647, + 0.7626955937594175, + 1.04492162540555, + 1.5290623977780342, + 2.1601140834391117, + 1.6028504148125648, + 2.7869353722780943, + 0.4851517453789711, + 1.4468581303954124, + 0.8661803156137466, + 0.8298707939684391, + 0.5823939219117165, + 0.5728882867842913, + 0.5781187284737825, + 0.665910198353231, + 3.2413408663123846, + 0.3967028586193919, + 0.7164373472332954, + 1.608062170445919, + 1.128997553139925, + 3.6744785457849503, + 1.4405178651213646, + 0.16851449385285378, + 0.7221746146678925, + 2.24341937340796, + 3.5443293005228043, + 0.3064889721572399, + 0.8337201420217752, + 3.6144465673714876, + 0.6077523808926344, + 0.7812220733612776, + 0.10976787842810154, + 0.9729590211063623 + ], + "unique_experts": 64, + "load_cv": 0.5654146308390584, + "normalized_load_entropy": 0.9644560075388423, + "max_load_share": 0.05233494363929147 + } + }, + "s0_bos": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "9a5915afcc0f78b61bf216ed53e50f82aca4bed6578d9369b72268ac3a4c46e9", + "route_weight_sha256": "826adf257861e02bee3fcf6838b456d21194576621babf9f251e2903ad4e0dd6", + "loads": [ + 27, + 17, + 8, + 8, + 24, + 7, + 49, + 12, + 6, + 21, + 17, + 24, + 20, + 4, + 11, + 19, + 14, + 12, + 9, + 21, + 6, + 10, + 14, + 18, + 6, + 22, + 14, + 7, + 21, + 13, + 6, + 21, + 19, + 17, + 17, + 25, + 13, + 19, + 12, + 27, + 17, + 6, + 13, + 13, + 13, + 14, + 15, + 6, + 13, + 17, + 13, + 38, + 19, + 0, + 13, + 21, + 20, + 5, + 17, + 31, + 7, + 26, + 1, + 21 + ], + "weighted_loads": [ + 1.4726102203130722, + 0.7027705740183592, + 0.5481357276439667, + 0.35009303502738476, + 1.9655833672732115, + 0.24625004269182682, + 3.7639551050961018, + 0.7953448425978422, + 0.4490882009267807, + 1.3452930375933647, + 1.3628802709281445, + 1.8345842100679874, + 1.3784229271113873, + 0.12589121609926224, + 0.5114665571600199, + 0.8330009132623672, + 1.0542509332299232, + 0.47761666774749756, + 0.5256474278867245, + 1.6820017024874687, + 0.32943473756313324, + 0.39142376743257046, + 0.5701544415205717, + 1.441818905994296, + 0.21398768946528435, + 1.8020188752561808, + 0.5300438068807125, + 0.4041904751211405, + 1.2377438340336084, + 0.8329753130674362, + 0.21907411515712738, + 0.9362480696290731, + 0.643482631072402, + 0.85669588111341, + 1.2564789690077305, + 1.4891479704529047, + 1.5345316380262375, + 1.345151610672474, + 0.4438484851270914, + 1.1403395608067513, + 0.8149512335658073, + 0.37707730755209923, + 0.46249912679195404, + 0.5445117838680744, + 0.6088653951883316, + 0.6087868716567755, + 1.2976076267659664, + 0.23859340324997902, + 0.56273471750319, + 1.551770158112049, + 0.6426301188766956, + 3.442754240706563, + 1.387668166309595, + 0.0, + 0.7040899135172367, + 1.222381243482232, + 1.8529239371418953, + 0.3163585066795349, + 0.867644215002656, + 2.5784616488963366, + 0.2902606874704361, + 0.8873739559203386, + 0.03728155791759491, + 1.0261982772499323 + ], + "unique_experts": 63, + "load_cv": 0.5427336042342301, + "normalized_load_entropy": 0.9643606595604536, + "max_load_share": 0.04919678714859438 + }, + "full_input": { + "tokens": 191, + "top_k": 6, + "decisions": 1146, + "ordered_route_sha256": "59531d6993e33de59e26dfca70cee56c19ce09c8ad865aa34b99b6a564ab756b", + "route_weight_sha256": "d762b649995d35705c45037adba60656fa047e8df91999847dae8d04e7bfd80b", + "loads": [ + 27, + 19, + 8, + 8, + 25, + 7, + 57, + 12, + 6, + 21, + 17, + 30, + 20, + 5, + 14, + 20, + 19, + 12, + 9, + 29, + 7, + 13, + 16, + 19, + 6, + 23, + 14, + 7, + 21, + 17, + 6, + 21, + 21, + 17, + 18, + 31, + 13, + 29, + 12, + 37, + 17, + 11, + 16, + 13, + 13, + 18, + 29, + 7, + 17, + 17, + 20, + 45, + 19, + 0, + 13, + 31, + 30, + 5, + 17, + 40, + 7, + 26, + 1, + 21 + ], + "weighted_loads": [ + 1.4726102203130722, + 0.7693137098103762, + 0.5481357276439667, + 0.35009303502738476, + 1.994105914607644, + 0.24625004269182682, + 4.731154080480337, + 0.7953448425978422, + 0.4490882009267807, + 1.3452930375933647, + 1.3628802709281445, + 2.1894900165498257, + 1.3784229271113873, + 0.14899692870676517, + 0.6950461138039827, + 0.8801434934139252, + 1.393953736871481, + 0.47761666774749756, + 0.5256474278867245, + 2.174142587929964, + 0.3735570050776005, + 0.554373798891902, + 1.1440709214657545, + 1.4775275010615587, + 0.21398768946528435, + 1.829544274136424, + 0.5300438068807125, + 0.4041904751211405, + 1.2377438340336084, + 1.0592868402600288, + 0.21907411515712738, + 0.9362480696290731, + 0.7039793524891138, + 0.85669588111341, + 1.29126338660717, + 2.049924349412322, + 1.5345316380262375, + 2.1867628917098045, + 0.4438484851270914, + 1.5459240358322859, + 0.8149512335658073, + 0.7721370048820972, + 0.569086479023099, + 0.5445117838680744, + 0.6088653951883316, + 0.7398622278124094, + 2.959506966173649, + 0.2576871160417795, + 0.7796410229057074, + 1.551770158112049, + 1.1670445911586285, + 3.749373694881797, + 1.387668166309595, + 0.0, + 0.7040899135172367, + 1.9823279362171888, + 2.998014375567436, + 0.3163585066795349, + 0.867644215002656, + 3.5421317983418703, + 0.2902606874704361, + 0.8873739559203386, + 0.03728155791759491, + 1.0261982772499323 + ], + "unique_experts": 63, + "load_cv": 0.5824448821630235, + "normalized_load_entropy": 0.9597522703500609, + "max_load_share": 0.049738219895287955 + } + }, + "s1_bos": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "cc41cda060bbd3bcfe1201d73f57574cc34492072bc4370a4d0c21501116f738", + "route_weight_sha256": "bed69c4702180ab9a7fbc60bbdde21d6cb134e1b668a7ea6ee715d106d65b5b1", + "loads": [ + 27, + 19, + 8, + 8, + 26, + 10, + 48, + 13, + 7, + 21, + 16, + 24, + 21, + 5, + 10, + 19, + 14, + 12, + 9, + 23, + 7, + 10, + 13, + 17, + 5, + 23, + 14, + 9, + 20, + 15, + 5, + 20, + 19, + 17, + 17, + 24, + 13, + 19, + 12, + 25, + 14, + 7, + 15, + 14, + 11, + 15, + 15, + 7, + 13, + 18, + 11, + 38, + 18, + 0, + 12, + 21, + 20, + 5, + 14, + 31, + 8, + 23, + 2, + 20 + ], + "weighted_loads": [ + 1.4707585573196411, + 0.7504197210073471, + 0.5439426004886627, + 0.35868485644459724, + 2.0291031822562218, + 0.34940530732274055, + 3.792813118547201, + 0.8233657814562321, + 0.4910496398806572, + 1.36435491964221, + 1.3423492461442947, + 1.839080810546875, + 1.4232171028852463, + 0.15470384061336517, + 0.4867301397025585, + 0.8327370714396238, + 1.059348452836275, + 0.4879246670752764, + 0.5349174700677395, + 1.799039836972952, + 0.35609790682792664, + 0.39194604381918907, + 0.5395331159234047, + 1.4449288677424192, + 0.18801583722233772, + 1.8789166919887066, + 0.5427988208830357, + 0.42103584855794907, + 1.2237178981304169, + 0.9204814098775387, + 0.190976332873106, + 0.9006025735288858, + 0.6380256023257971, + 0.8859992995858192, + 1.2776749581098557, + 1.4120829682797194, + 1.5477398857474327, + 1.3438981361687183, + 0.4454495385289192, + 1.0635381247848272, + 0.7001541331410408, + 0.40902479365468025, + 0.5306573491543531, + 0.5903633814305067, + 0.5202765949070454, + 0.6310356389731169, + 1.2994568720459938, + 0.2853063568472862, + 0.5723009798675776, + 1.5911370068788528, + 0.5258700177073479, + 3.4722823314368725, + 1.371999841183424, + 0.0, + 0.6674631554633379, + 1.2313266899436712, + 1.7434881962835789, + 0.30875375494360924, + 0.7761046197265387, + 2.588993865996599, + 0.3199413139373064, + 0.7887108959257603, + 0.06511619314551353, + 0.97788299433887 + ], + "unique_experts": 63, + "load_cv": 0.5266865781781781, + "normalized_load_entropy": 0.9668707652516878, + "max_load_share": 0.04819277108433735 + }, + "full_input": { + "tokens": 207, + "top_k": 6, + "decisions": 1242, + "ordered_route_sha256": "dec9de5f8d3abd008de3e38a130005bbe5b958024137b5d7a80d59a5b71ed583", + "route_weight_sha256": "adec27c6f45ce26c1785f5f4a2b014c6a124a3d00bca81d7b50b7cf72e12d34a", + "loads": [ + 27, + 20, + 11, + 9, + 28, + 10, + 63, + 14, + 12, + 27, + 16, + 34, + 25, + 6, + 19, + 21, + 24, + 12, + 11, + 33, + 9, + 14, + 14, + 18, + 6, + 24, + 14, + 10, + 21, + 18, + 5, + 23, + 25, + 18, + 21, + 32, + 14, + 37, + 12, + 35, + 14, + 13, + 17, + 14, + 12, + 18, + 32, + 9, + 16, + 18, + 20, + 44, + 19, + 3, + 12, + 32, + 37, + 5, + 14, + 42, + 14, + 23, + 2, + 20 + ], + "weighted_loads": [ + 1.4707585573196411, + 0.7853617183864117, + 0.6871765591204166, + 0.39583272859454155, + 2.180039059370756, + 0.34940530732274055, + 5.098654966801405, + 0.8848248980939388, + 0.8288994655013084, + 2.070785965770483, + 1.3423492461442947, + 2.465731106698513, + 1.753744225949049, + 0.1778095532208681, + 1.1655441485345364, + 0.9957308191806078, + 1.8141052462160587, + 0.4879246670752764, + 0.6833048239350319, + 2.495938614010811, + 0.44907868281006813, + 0.6265874281525612, + 1.0854572430253029, + 1.4802079256623983, + 0.22077945619821548, + 1.9143111370503902, + 0.5427988208830357, + 0.44790972769260406, + 1.2613221891224384, + 1.12470593303442, + 0.190976332873106, + 1.100955804809928, + 0.8269361890852451, + 0.9204379580914974, + 1.5365424379706383, + 2.1978582981973886, + 1.5825902000069618, + 2.801496736705303, + 0.4454495385289192, + 1.5748134795576334, + 0.7001541331410408, + 0.8513181246817112, + 0.5886381939053535, + 0.5903633814305067, + 0.6048739366233349, + 0.7257950846105814, + 3.311665318906307, + 0.361449358984828, + 0.7592375557869673, + 1.5911370068788528, + 1.1839879341423512, + 3.7132491767406464, + 1.4091723337769508, + 0.16851449385285378, + 0.6674631554633379, + 2.239492980763316, + 3.5612124018371105, + 0.30875375494360924, + 0.7761046197265387, + 3.64318435639143, + 0.6268174890428782, + 0.7887108959257603, + 0.06511619314551353, + 0.97788299433887 + ], + "unique_experts": 64, + "load_cv": 0.5647538368232442, + "normalized_load_entropy": 0.9640491632434564, + "max_load_share": 0.050724637681159424 + } + }, + "s0_x": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "0b6722c3f5b23c9757ed335794864c5a0e2961f7aa705e8bec3ae63f2841ef71", + "route_weight_sha256": "d1bca2d2b56b55a1c13bce93a22dd0a555fd9452621dcee9ead9872a47a64a31", + "loads": [ + 27, + 19, + 8, + 8, + 24, + 6, + 49, + 11, + 6, + 21, + 17, + 25, + 20, + 6, + 10, + 18, + 13, + 10, + 9, + 21, + 7, + 10, + 13, + 18, + 5, + 22, + 16, + 9, + 21, + 13, + 5, + 20, + 20, + 16, + 16, + 25, + 13, + 19, + 13, + 24, + 18, + 6, + 12, + 14, + 12, + 14, + 15, + 7, + 13, + 18, + 13, + 38, + 19, + 0, + 13, + 22, + 20, + 5, + 18, + 31, + 6, + 25, + 2, + 22 + ], + "weighted_loads": [ + 1.4579810351133347, + 0.7550999447703362, + 0.541761975735426, + 0.35047003626823425, + 1.9064736030995846, + 0.20943675935268402, + 3.7959106750786304, + 0.7552766893059015, + 0.4429239071905613, + 1.3540963307023048, + 1.3356368318200111, + 1.852847158908844, + 1.3847738355398178, + 0.18190890736877918, + 0.4726023096591234, + 0.8190913423895836, + 1.0374393574893475, + 0.40731596015393734, + 0.5299445316195488, + 1.6854935437440872, + 0.35554969869554043, + 0.39171300642192364, + 0.530445996671915, + 1.445420691743493, + 0.1801939569413662, + 1.7662585619837046, + 0.605949180200696, + 0.4404338449239731, + 1.2387668788433075, + 0.8207510560750961, + 0.19020900130271912, + 0.9025725927203894, + 0.67979396879673, + 0.8121935445815325, + 1.2218468505889177, + 1.4958908651024103, + 1.5465484820306301, + 1.3819341883063316, + 0.48355166241526604, + 1.0325150173157454, + 0.8621080219745636, + 0.37546586990356445, + 0.43702678196132183, + 0.5848355032503605, + 0.5614469684660435, + 0.5987237188965082, + 1.3120075166225433, + 0.27802787348628044, + 0.5733302868902683, + 1.603324756026268, + 0.6566964276134968, + 3.408521853387356, + 1.3941227905452251, + 0.0, + 0.6951239444315434, + 1.2669843845069408, + 1.7084577977657318, + 0.3126119524240494, + 0.9066153727471828, + 2.5809279792010784, + 0.2634939216077328, + 0.8725613951683044, + 0.06771494820713997, + 1.0336360931396484 + ], + "unique_experts": 63, + "load_cv": 0.5401121191683816, + "normalized_load_entropy": 0.9650335645546608, + "max_load_share": 0.04919678714859438 + }, + "full_input": { + "tokens": 191, + "top_k": 6, + "decisions": 1146, + "ordered_route_sha256": "404eb2a65eb331525967697a4e2a80c30b56232b2164a2ceeab4dc6c0d56c921", + "route_weight_sha256": "f1d236e0b7ee1c6bbfd7ec5695c570e5cda376cf5a26e3077b043a93d3b623bf", + "loads": [ + 27, + 21, + 8, + 8, + 25, + 6, + 59, + 11, + 6, + 21, + 17, + 30, + 20, + 7, + 13, + 19, + 18, + 10, + 9, + 30, + 8, + 13, + 15, + 19, + 5, + 23, + 16, + 9, + 21, + 16, + 5, + 20, + 22, + 16, + 17, + 31, + 13, + 29, + 13, + 32, + 18, + 13, + 15, + 14, + 12, + 18, + 28, + 8, + 17, + 18, + 18, + 46, + 19, + 0, + 13, + 33, + 29, + 5, + 18, + 41, + 6, + 25, + 2, + 22 + ], + "weighted_loads": [ + 1.4579810351133347, + 0.8216430805623531, + 0.541761975735426, + 0.35047003626823425, + 1.9349961504340172, + 0.20943675935268402, + 5.061036638915539, + 0.7552766893059015, + 0.4429239071905613, + 1.3540963307023048, + 1.3356368318200111, + 2.1463652588427067, + 1.3847738355398178, + 0.20501461997628212, + 0.6493166256695986, + 0.8631465919315815, + 1.374167986214161, + 0.40731596015393734, + 0.5299445316195488, + 2.243325788527727, + 0.39967196621000767, + 0.553555017337203, + 1.1043624766170979, + 1.4811292868107557, + 0.1801939569413662, + 1.7937839608639479, + 0.605949180200696, + 0.4404338449239731, + 1.2387668788433075, + 0.9931560158729553, + 0.19020900130271912, + 0.9025725927203894, + 0.7402906902134418, + 0.8121935445815325, + 1.2566312681883574, + 2.0870002675801516, + 1.5465484820306301, + 2.190918818116188, + 0.48355166241526604, + 1.352441482245922, + 0.8621080219745636, + 0.9093455485999584, + 0.5288521274924278, + 0.5848355032503605, + 0.5614469684660435, + 0.7297990750521421, + 2.703517362475395, + 0.29712158627808094, + 0.7935348078608513, + 1.603324756026268, + 1.0496694296598434, + 3.749904293566942, + 1.3941227905452251, + 0.0, + 0.6951239444315434, + 2.0823191218078136, + 2.7042266242206097, + 0.3126119524240494, + 0.9066153727471828, + 3.6182964332401752, + 0.2634939216077328, + 0.8725613951683044, + 0.06771494820713997, + 1.0336360931396484 + ], + "unique_experts": 63, + "load_cv": 0.5856156102234805, + "normalized_load_entropy": 0.9600901033098626, + "max_load_share": 0.05148342059336824 + } + }, + "s1_x": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "52c255dc2845a0a5f4af373a6b8ad8de88aa17ce62a80bfca79c3634b4c29cd1", + "route_weight_sha256": "0200696480aaf015b62f2411139b07b8f6247850526a1144ef3c15075d68daa4", + "loads": [ + 27, + 18, + 8, + 9, + 26, + 7, + 48, + 11, + 7, + 21, + 16, + 26, + 21, + 5, + 10, + 20, + 13, + 10, + 9, + 22, + 6, + 9, + 12, + 18, + 7, + 23, + 15, + 9, + 22, + 13, + 7, + 19, + 17, + 19, + 16, + 24, + 13, + 22, + 12, + 24, + 14, + 8, + 13, + 15, + 10, + 14, + 17, + 7, + 13, + 18, + 11, + 38, + 19, + 0, + 12, + 21, + 19, + 5, + 14, + 33, + 7, + 25, + 2, + 20 + ], + "weighted_loads": [ + 1.4773169662803411, + 0.7279817312955856, + 0.52732078358531, + 0.39698092080652714, + 1.922269968315959, + 0.245919955894351, + 3.829875746741891, + 0.7539482489228249, + 0.47945592924952507, + 1.3417658917605877, + 1.3361529186367989, + 1.927620816975832, + 1.419639978557825, + 0.15003926493227482, + 0.4729493819177151, + 0.8643393348902464, + 1.0278301015496254, + 0.4263627417385578, + 0.5281652584671974, + 1.7275050804018974, + 0.33505095541477203, + 0.36228569224476814, + 0.5026194173842669, + 1.4627144187688828, + 0.2730093486607075, + 1.8180096186697483, + 0.565648790448904, + 0.39991212263703346, + 1.3023057505488396, + 0.8392054848372936, + 0.2609357461333275, + 0.8506360594183207, + 0.5760333649814129, + 0.9534515310078859, + 1.2548230215907097, + 1.420449137687683, + 1.572268359363079, + 1.531754806637764, + 0.44831898994743824, + 1.0524091143161058, + 0.7088909894227982, + 0.45722848176956177, + 0.46552792377769947, + 0.6237722504884005, + 0.47944651544094086, + 0.6003226991742849, + 1.3852139487862587, + 0.28803884610533714, + 0.5953334383666515, + 1.6031888015568256, + 0.5308088511228561, + 3.4717484191060066, + 1.41932437941432, + 0.0, + 0.661763122305274, + 1.2430993858724833, + 1.5629740953445435, + 0.3033469282090664, + 0.7761112172156572, + 2.630236353725195, + 0.28878821618855, + 0.8688508123159409, + 0.06647386960685253, + 0.9468147177249193 + ], + "unique_experts": 63, + "load_cv": 0.5386768411110399, + "normalized_load_entropy": 0.9657036264616372, + "max_load_share": 0.04819277108433735 + }, + "full_input": { + "tokens": 207, + "top_k": 6, + "decisions": 1242, + "ordered_route_sha256": "4549e0e97f61c1b2cd938f9386d441679ca4b75876214ba8caa459d6b45ddedb", + "route_weight_sha256": "e90dbf9b99b86d59e60c41ad758f7ecd799437ee87c97c140ccfd30c02dd6dca", + "loads": [ + 27, + 19, + 11, + 10, + 28, + 7, + 65, + 12, + 12, + 27, + 16, + 35, + 25, + 6, + 19, + 22, + 23, + 10, + 11, + 34, + 8, + 13, + 13, + 19, + 9, + 24, + 15, + 10, + 23, + 16, + 7, + 22, + 22, + 20, + 20, + 32, + 14, + 38, + 12, + 33, + 14, + 16, + 15, + 15, + 11, + 17, + 32, + 8, + 16, + 18, + 19, + 45, + 20, + 3, + 12, + 33, + 35, + 5, + 14, + 45, + 13, + 25, + 2, + 20 + ], + "weighted_loads": [ + 1.4773169662803411, + 0.7629237286746502, + 0.6705547422170639, + 0.43412879295647144, + 2.0732058454304934, + 0.245919955894351, + 5.479864219203591, + 0.8154073655605316, + 0.8173057548701763, + 2.0481969378888607, + 1.3361529186367989, + 2.498222265392542, + 1.7501671016216278, + 0.17314497753977776, + 1.1486883200705051, + 1.0417486634105444, + 1.7731757499277592, + 0.4263627417385578, + 0.6765526123344898, + 2.5293917320668697, + 0.42803173139691353, + 0.5957343876361847, + 1.048543544486165, + 1.4979934766888618, + 0.33972933888435364, + 1.853404063731432, + 0.565648790448904, + 0.42678600177168846, + 1.3399100415408611, + 1.0378084257245064, + 0.2609357461333275, + 1.0509892906993628, + 0.725937319919467, + 0.9878901895135641, + 1.5136905014514923, + 2.2094594724476337, + 1.6071186736226082, + 2.8400766514241695, + 0.44831898994743824, + 1.5238420758396387, + 0.7088909894227982, + 1.0324373915791512, + 0.5235087685286999, + 0.6237722504884005, + 0.5640438571572304, + 0.6950821448117495, + 3.091707430779934, + 0.30713255889713764, + 0.7808050625026226, + 1.6031888015568256, + 1.1060381941497326, + 3.7422333359718323, + 1.4564968720078468, + 0.16851449385285378, + 0.661763122305274, + 2.3213482070714235, + 3.216136619448662, + 0.3033469282090664, + 0.7761112172156572, + 3.75647946447134, + 0.5956643912941217, + 0.8688508123159409, + 0.06647386960685253, + 0.9468147177249193 + ], + "unique_experts": 64, + "load_cv": 0.5796184396958697, + "normalized_load_entropy": 0.9628218402431253, + "max_load_share": 0.05233494363929147 + } + }, + "s0_period": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "3e91a7015a1e875f11737830f7f5e5dded3a9b395020cae5993f42f1048a0cb3", + "route_weight_sha256": "bfb1a3bcecec978844a5770e55f6a6ad2cc87e94e5188fab502c1798c039b742", + "loads": [ + 27, + 18, + 7, + 8, + 23, + 6, + 48, + 11, + 6, + 21, + 17, + 24, + 20, + 5, + 10, + 18, + 14, + 11, + 9, + 21, + 7, + 8, + 14, + 18, + 7, + 22, + 15, + 9, + 21, + 13, + 6, + 21, + 20, + 16, + 17, + 24, + 13, + 20, + 13, + 26, + 17, + 6, + 13, + 14, + 9, + 14, + 17, + 6, + 13, + 18, + 13, + 38, + 19, + 0, + 13, + 22, + 20, + 5, + 18, + 31, + 7, + 25, + 2, + 22 + ], + "weighted_loads": [ + 1.4560337401926517, + 0.7196966037154198, + 0.5074346512556076, + 0.3533477783203125, + 1.881300412118435, + 0.2097722925245762, + 3.767952539026737, + 0.7548775915056467, + 0.4377387687563896, + 1.3696054965257645, + 1.337043333798647, + 1.827547077089548, + 1.387526635080576, + 0.1518748700618744, + 0.47408081218600273, + 0.8128526899963617, + 1.080664373934269, + 0.43476998060941696, + 0.5267550460994244, + 1.6898281052708626, + 0.35321446880698204, + 0.3227720707654953, + 0.5641866326332092, + 1.4537385441362858, + 0.2662524916231632, + 1.7663512080907822, + 0.573512427508831, + 0.44103070721030235, + 1.2389513775706291, + 0.8151068799197674, + 0.22472280263900757, + 0.9439653940498829, + 0.6810775753110647, + 0.8083331380039454, + 1.2561650108546019, + 1.4374839272350073, + 1.5460066832602024, + 1.481464073061943, + 0.4832576308399439, + 1.0934296790510416, + 0.8375950828194618, + 0.37546760961413383, + 0.4628171771764755, + 0.577871311455965, + 0.44612469524145126, + 0.5974344182759523, + 1.3512930497527122, + 0.23748810216784477, + 0.5766418129205704, + 1.613835897296667, + 0.6637641377747059, + 3.4072404988110065, + 1.403848871588707, + 0.0, + 0.7015415802598, + 1.2798788379877806, + 1.7207424007356167, + 0.3174847736954689, + 0.9015391264110804, + 2.5774848219007254, + 0.292029345408082, + 0.8669191692024469, + 0.07139196991920471, + 1.0386334471404552 + ], + "unique_experts": 63, + "load_cv": 0.5366369593510252, + "normalized_load_entropy": 0.965268679692619, + "max_load_share": 0.04819277108433735 + }, + "full_input": { + "tokens": 191, + "top_k": 6, + "decisions": 1146, + "ordered_route_sha256": "8fb494bb7b7e180a02fce858b39e3fd526ec975959b92229367fcbf05a38bb1d", + "route_weight_sha256": "e3bf347be35cd15bd731af2f3062c0c0e8442fceb2ee530912882f32eca031bc", + "loads": [ + 27, + 20, + 7, + 8, + 24, + 6, + 58, + 11, + 6, + 21, + 17, + 29, + 21, + 6, + 12, + 19, + 19, + 11, + 9, + 31, + 8, + 11, + 16, + 19, + 7, + 23, + 15, + 9, + 22, + 16, + 6, + 21, + 22, + 16, + 18, + 30, + 13, + 30, + 13, + 34, + 17, + 12, + 16, + 14, + 9, + 18, + 30, + 7, + 17, + 18, + 18, + 46, + 19, + 0, + 13, + 33, + 29, + 5, + 18, + 40, + 7, + 25, + 2, + 22 + ], + "weighted_loads": [ + 1.4560337401926517, + 0.7862397395074368, + 0.5074346512556076, + 0.3533477783203125, + 1.9098229594528675, + 0.2097722925245762, + 4.899966396391392, + 0.7548775915056467, + 0.4377387687563896, + 1.3696054965257645, + 1.337043333798647, + 2.121363341808319, + 1.4408523924648762, + 0.17498058266937733, + 0.6075660176575184, + 0.8501324113458395, + 1.4180134944617748, + 0.43476998060941696, + 0.5267550460994244, + 2.3405600003898144, + 0.3973367363214493, + 0.482658252120018, + 1.138103112578392, + 1.4894471392035484, + 0.2662524916231632, + 1.7938766069710255, + 0.573512427508831, + 0.44103070721030235, + 1.3451901376247406, + 0.987576138228178, + 0.22472280263900757, + 0.9439653940498829, + 0.7415742967277765, + 0.8083331380039454, + 1.2909494284540415, + 2.024824498221278, + 1.5460066832602024, + 2.3726508617401123, + 0.4832576308399439, + 1.4133561439812183, + 0.8375950828194618, + 0.8270289301872253, + 0.5566434655338526, + 0.577871311455965, + 0.44612469524145126, + 0.7285097744315863, + 2.7250862792134285, + 0.25658181495964527, + 0.7910014949738979, + 1.613835897296667, + 1.0574880987405777, + 3.7478358820080757, + 1.403848871588707, + 0.0, + 0.7015415802598, + 2.1871774960309267, + 2.7173606641590595, + 0.3174847736954689, + 0.9015391264110804, + 3.541154971346259, + 0.292029345408082, + 0.8669191692024469, + 0.07139196991920471, + 1.0386334471404552 + ], + "unique_experts": 63, + "load_cv": 0.5863640608654954, + "normalized_load_entropy": 0.9598713573908906, + "max_load_share": 0.0506108202443281 + } + }, + "s1_period": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "87ef47cb573add33081acf4bbeb4997cf55ea9270e4638f3e07bcb2cadc19681", + "route_weight_sha256": "77609f56bf4fcc86976eff09d7803a3e56d041a070462a6903f9d55143345f71", + "loads": [ + 27, + 19, + 8, + 9, + 27, + 6, + 49, + 11, + 7, + 21, + 16, + 26, + 21, + 4, + 10, + 20, + 13, + 12, + 10, + 23, + 6, + 8, + 13, + 18, + 7, + 24, + 15, + 10, + 22, + 13, + 5, + 20, + 18, + 16, + 16, + 24, + 13, + 21, + 13, + 24, + 14, + 7, + 13, + 15, + 9, + 13, + 18, + 7, + 13, + 18, + 11, + 37, + 19, + 0, + 12, + 20, + 19, + 5, + 14, + 33, + 7, + 25, + 2, + 20 + ], + "weighted_loads": [ + 1.4635680578649044, + 0.7503580264747143, + 0.5272325612604618, + 0.40016888454556465, + 1.9801504351198673, + 0.21603348292410374, + 3.874317977577448, + 0.7572411336004734, + 0.4778856039047241, + 1.3645781874656677, + 1.3411897979676723, + 1.9240737073123455, + 1.4141384363174438, + 0.1180623359978199, + 0.4735008627176285, + 0.855627303943038, + 1.0240196250379086, + 0.47789232805371284, + 0.5618999004364014, + 1.75710529088974, + 0.334940604865551, + 0.32905212603509426, + 0.5343889035284519, + 1.473456071689725, + 0.27150970324873924, + 1.845249129459262, + 0.5711755193769932, + 0.4333484582602978, + 1.2966884449124336, + 0.8337768875062466, + 0.19551696628332138, + 0.8901583142578602, + 0.6102052368223667, + 0.8334790784865618, + 1.2544765286147594, + 1.419102769345045, + 1.5808549784123898, + 1.530718594789505, + 0.4846975151449442, + 1.0465300865471363, + 0.7116326913237572, + 0.41345688700675964, + 0.46685529686510563, + 0.6236206516623497, + 0.4464745335280895, + 0.5714976117014885, + 1.4027230143547058, + 0.28592633828520775, + 0.5937528740614653, + 1.602476641535759, + 0.5255798511207104, + 3.4183712396770716, + 1.4121164344251156, + 0.0, + 0.6607548613101244, + 1.2293570898473263, + 1.538133218884468, + 0.30398285016417503, + 0.7816128470003605, + 2.6401952989399433, + 0.288820942863822, + 0.8684238474816084, + 0.06481982208788395, + 0.9484214466065168 + ], + "unique_experts": 63, + "load_cv": 0.5465242271179953, + "normalized_load_entropy": 0.9644634264773707, + "max_load_share": 0.04919678714859438 + }, + "full_input": { + "tokens": 207, + "top_k": 6, + "decisions": 1242, + "ordered_route_sha256": "ded40aa84f6904caab4ee152d8edcf178549ab86b94b862e6de0f207e3e3f698", + "route_weight_sha256": "0c9eb9fa1f8958344cac6add6f74555f34be1064affe77de3a7c03a87d2cfa42", + "loads": [ + 27, + 20, + 11, + 10, + 29, + 6, + 66, + 12, + 12, + 27, + 16, + 35, + 26, + 5, + 19, + 22, + 23, + 12, + 12, + 35, + 8, + 12, + 14, + 19, + 9, + 25, + 15, + 11, + 24, + 16, + 5, + 23, + 23, + 17, + 20, + 32, + 14, + 38, + 13, + 33, + 14, + 14, + 15, + 15, + 10, + 16, + 34, + 8, + 15, + 18, + 18, + 44, + 20, + 3, + 12, + 32, + 35, + 5, + 14, + 44, + 13, + 25, + 2, + 20 + ], + "weighted_loads": [ + 1.4635680578649044, + 0.7853000238537788, + 0.6704665198922157, + 0.43731675669550896, + 2.1310863122344017, + 0.21603348292410374, + 5.386139910668135, + 0.8187002502381802, + 0.8157354295253754, + 2.0710092335939407, + 1.3411897979676723, + 2.4913694448769093, + 1.8098118789494038, + 0.14116804860532284, + 1.153489664196968, + 1.0195071008056402, + 1.7661624662578106, + 0.47789232805371284, + 0.7102872543036938, + 2.6555203944444656, + 0.4279213808476925, + 0.5569765027612448, + 1.0803130306303501, + 1.508735129609704, + 0.33965132012963295, + 1.8806435745209455, + 0.5711755193769932, + 0.4602223373949528, + 1.4563369117677212, + 1.033531203866005, + 0.19551696628332138, + 1.0905115455389023, + 0.7601091917604208, + 0.86791773699224, + 1.513344008475542, + 2.2154049798846245, + 1.6157052926719189, + 2.9842613711953163, + 0.4846975151449442, + 1.5179630480706692, + 0.7116326913237572, + 0.8989489898085594, + 0.524836141616106, + 0.6236206516623497, + 0.531071875244379, + 0.666257057338953, + 3.1341569162905216, + 0.30502005107700825, + 0.7042124029248953, + 1.602476641535759, + 1.0360159128904343, + 3.6919882986694574, + 1.4492889270186424, + 0.16851449385285378, + 0.6607548613101244, + 2.3703763373196125, + 3.1823927350342274, + 0.30398285016417503, + 0.7816128470003605, + 3.694385789334774, + 0.5956971179693937, + 0.8684238474816084, + 0.06481982208788395, + 0.9484214466065168 + ], + "unique_experts": 64, + "load_cv": 0.5865913833920315, + "normalized_load_entropy": 0.9616897343424284, + "max_load_share": 0.05314009661835749 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 166, + "ordered_topk_exact_tokens": 129, + "set_exact_tokens": 144, + "mean_set_jaccard": 0.9621342512908778, + "mean_token_weighted_tv": 0.00868206990164626, + "aggregate_load_tv": 0.016064257028112452 + }, + "system_bos": { + "tokens": 166, + "ordered_topk_exact_tokens": 108, + "set_exact_tokens": 126, + "mean_set_jaccard": 0.9298623063683304, + "mean_token_weighted_tv": 0.013877575201577091, + "aggregate_load_tv": 0.028112449799196783 + }, + "system_x": { + "tokens": 166, + "ordered_topk_exact_tokens": 99, + "set_exact_tokens": 121, + "mean_set_jaccard": 0.9186746987951807, + "mean_token_weighted_tv": 0.01681932585358799, + "aggregate_load_tv": 0.03112449799196787 + }, + "system_period": { + "tokens": 166, + "ordered_topk_exact_tokens": 96, + "set_exact_tokens": 119, + "mean_set_jaccard": 0.9165232358003442, + "mean_token_weighted_tv": 0.016853549444756234, + "aggregate_load_tv": 0.02911646586345382 + }, + "bos_at_s0": { + "tokens": 166, + "ordered_topk_exact_tokens": 92, + "set_exact_tokens": 119, + "mean_set_jaccard": 0.9152323580034425, + "mean_token_weighted_tv": 0.017599365836660188, + "aggregate_load_tv": 0.031124497991967863 + }, + "bos_at_s1": { + "tokens": 166, + "ordered_topk_exact_tokens": 84, + "set_exact_tokens": 112, + "mean_set_jaccard": 0.8980206540447503, + "mean_token_weighted_tv": 0.020413215064544635, + "aggregate_load_tv": 0.036144578313253004 + }, + "x_at_s0": { + "tokens": 166, + "ordered_topk_exact_tokens": 97, + "set_exact_tokens": 122, + "mean_set_jaccard": 0.9216867469879518, + "mean_token_weighted_tv": 0.017240475728569262, + "aggregate_load_tv": 0.03313253012048192 + }, + "x_at_s1": { + "tokens": 166, + "ordered_topk_exact_tokens": 79, + "set_exact_tokens": 113, + "mean_set_jaccard": 0.9010327022375214, + "mean_token_weighted_tv": 0.02162095715841615, + "aggregate_load_tv": 0.0321285140562249 + }, + "period_at_s0": { + "tokens": 166, + "ordered_topk_exact_tokens": 97, + "set_exact_tokens": 119, + "mean_set_jaccard": 0.9139414802065405, + "mean_token_weighted_tv": 0.01809407229793359, + "aggregate_load_tv": 0.02911646586345381 + }, + "period_at_s1": { + "tokens": 166, + "ordered_topk_exact_tokens": 74, + "set_exact_tokens": 105, + "mean_set_jaccard": 0.8885542168674698, + "mean_token_weighted_tv": 0.022939749286476387, + "aggregate_load_tv": 0.03614457831325302 + } + } + }, + "layer_07": { + "layer": 7, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "0cc69a5ee22a4ad7920c9eb142ee24c221e1f00298fb269326b0990cd32c7eb8", + "route_weight_sha256": "c4d9800690e32374f608f864a3b09ee049024b429290f08d6e0931151529850b", + "loads": [ + 7, + 16, + 11, + 5, + 23, + 22, + 11, + 13, + 36, + 6, + 17, + 14, + 24, + 35, + 13, + 17, + 25, + 4, + 11, + 11, + 14, + 14, + 37, + 4, + 24, + 5, + 11, + 4, + 25, + 7, + 18, + 0, + 16, + 21, + 21, + 7, + 6, + 0, + 16, + 26, + 8, + 27, + 17, + 24, + 9, + 16, + 9, + 4, + 22, + 20, + 21, + 22, + 16, + 13, + 9, + 43, + 1, + 10, + 11, + 24, + 23, + 35, + 6, + 9 + ], + "weighted_loads": [ + 0.31949659809470177, + 0.7437025289982557, + 0.6906428914517164, + 0.19447747059166431, + 1.8155019450932741, + 1.1197559237480164, + 0.7779160216450691, + 0.8975479062646627, + 2.5891824681311846, + 0.30596571043133736, + 1.0121334064751863, + 0.7393027395009995, + 1.9474768117070198, + 2.7350072041153908, + 1.0415338948369026, + 1.4582417011260986, + 1.7765087354928255, + 0.2642946019768715, + 0.41914190724492073, + 0.46483292430639267, + 0.8539405539631844, + 0.9135384559631348, + 1.8905383758246899, + 0.14501833729445934, + 1.1697096563875675, + 0.21965161338448524, + 0.6244519017636776, + 0.23772701807320118, + 2.1079784221947193, + 0.4037731662392616, + 0.9148147348314524, + 0.0, + 1.3615348152816296, + 1.754353104159236, + 0.8280627205967903, + 0.5108778309077024, + 0.33740782365202904, + 0.0, + 0.9693491458892822, + 1.3838652931153774, + 0.26566596888005733, + 1.885919839143753, + 1.2508468329906464, + 0.7928887978196144, + 0.4782874174416065, + 1.2284742593765259, + 0.33813660219311714, + 0.16081268712878227, + 1.5927418880164623, + 1.219655655324459, + 0.9976578429341316, + 1.4509805850684643, + 1.2104215919971466, + 0.7286428287625313, + 0.611567210406065, + 3.172179814428091, + 0.030946800485253334, + 0.37651977874338627, + 0.9042929634451866, + 1.5116439908742905, + 1.6996795739978552, + 2.3692257665097713, + 0.2037601601332426, + 0.3399753272533417 + ], + "unique_experts": 62, + "load_cv": 0.612011825754461, + "normalized_load_entropy": 0.9525275627798128, + "max_load_share": 0.04317269076305221 + }, + "full_input": { + "tokens": 191, + "top_k": 6, + "decisions": 1146, + "ordered_route_sha256": "772e610321c57a2048c86d69c2dfdbdaa6af398183901ad4f411cb2cc56cdfd2", + "route_weight_sha256": "91d96ba7ad9f01cd0e74a847377196188e04b49eef0698fa49fc7bc8a34cd638", + "loads": [ + 7, + 16, + 11, + 8, + 23, + 23, + 16, + 13, + 44, + 6, + 19, + 18, + 24, + 40, + 13, + 17, + 40, + 7, + 13, + 11, + 14, + 14, + 40, + 6, + 29, + 5, + 16, + 4, + 28, + 7, + 18, + 0, + 19, + 22, + 21, + 7, + 6, + 0, + 26, + 29, + 8, + 38, + 22, + 26, + 12, + 16, + 10, + 6, + 22, + 20, + 37, + 22, + 16, + 14, + 9, + 50, + 1, + 10, + 15, + 24, + 23, + 41, + 8, + 16 + ], + "weighted_loads": [ + 0.31949659809470177, + 0.7437025289982557, + 0.6906428914517164, + 0.3055472131818533, + 1.8155019450932741, + 1.160945761948824, + 1.2270162254571915, + 0.8975479062646627, + 3.211899532005191, + 0.30596571043133736, + 1.0928240846842527, + 1.2902545630931854, + 1.9474768117070198, + 3.018977750092745, + 1.0415338948369026, + 1.4582417011260986, + 3.7979823034256697, + 0.46020231768488884, + 0.4606359926983714, + 0.46483292430639267, + 0.8539405539631844, + 0.9135384559631348, + 2.06305643171072, + 0.29123940877616405, + 1.3300156868062913, + 0.21965161338448524, + 1.0347431935369968, + 0.23772701807320118, + 2.171285018324852, + 0.4037731662392616, + 0.9148147348314524, + 0.0, + 1.4765621796250343, + 1.8042940068989992, + 0.8280627205967903, + 0.5108778309077024, + 0.33740782365202904, + 0.0, + 1.841457039117813, + 1.5133694745600224, + 0.26566596888005733, + 2.7813225090503693, + 1.5972352474927902, + 0.8248762553557754, + 1.959887284785509, + 1.2284742593765259, + 0.39271702989935875, + 0.3098536878824234, + 1.5927418880164623, + 1.219655655324459, + 2.191611321642995, + 1.4509805850684643, + 1.2104215919971466, + 0.7588862404227257, + 0.611567210406065, + 3.8285281248390675, + 0.030946800485253334, + 0.37651977874338627, + 0.9895806359127164, + 1.5116439908742905, + 1.6996795739978552, + 2.666858773678541, + 0.2240770636126399, + 0.6078286711126566 + ], + "unique_experts": 62, + "load_cv": 0.6359598507457217, + "normalized_load_entropy": 0.9503960606404535, + "max_load_share": 0.04363001745200698 + } + }, + "s1_eos": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "eb308f1fdeaca9a68c7b5390484185d7d83d1a492db1eb7687a4235194e84c26", + "route_weight_sha256": "6eafc84d298daa2e3b38f2d1268fadb7942ac444c92ed43a96266c5ff053da17", + "loads": [ + 5, + 17, + 11, + 6, + 23, + 22, + 12, + 13, + 36, + 6, + 18, + 13, + 24, + 34, + 12, + 17, + 25, + 4, + 13, + 11, + 14, + 14, + 37, + 3, + 24, + 4, + 9, + 5, + 25, + 8, + 19, + 0, + 16, + 21, + 25, + 6, + 6, + 0, + 16, + 25, + 9, + 27, + 16, + 22, + 8, + 16, + 8, + 4, + 22, + 20, + 18, + 22, + 16, + 13, + 10, + 43, + 2, + 10, + 14, + 24, + 23, + 35, + 7, + 8 + ], + "weighted_loads": [ + 0.23630333691835403, + 0.7942563146352768, + 0.6997222024947405, + 0.23799434304237366, + 1.786417031660676, + 1.096853144466877, + 0.8383251428604126, + 0.8875074181705713, + 2.536455376073718, + 0.29744819924235344, + 1.0463707093149424, + 0.6793133579194546, + 1.9384517669677734, + 2.67223715595901, + 0.9953135251998901, + 1.4745078310370445, + 1.7749743219465017, + 0.28327640891075134, + 0.5002466849982738, + 0.47911423072218895, + 0.8505700714886189, + 0.909875363111496, + 1.8846368342638016, + 0.1100512407720089, + 1.1804648954421282, + 0.17346327006816864, + 0.5413499101996422, + 0.26558260805904865, + 2.1239744666963816, + 0.4503994919359684, + 0.9431509207934141, + 0.0, + 1.3441191148012877, + 1.7564970143139362, + 0.987239945679903, + 0.5069902446120977, + 0.3288954943418503, + 0.0, + 0.9835274536162615, + 1.3296820260584354, + 0.2846426609903574, + 1.8227749541401863, + 1.1987114064395428, + 0.7448498122394085, + 0.4485941156744957, + 1.2244687899947166, + 0.31067658960819244, + 0.15880299732089043, + 1.5947290603071451, + 1.2163231410086155, + 0.8656286280602217, + 1.4474282041192055, + 1.1922769714146852, + 0.770218001678586, + 0.6479491777718067, + 3.1597001515328884, + 0.07570572942495346, + 0.37916023656725883, + 1.0301736779510975, + 1.5020325370132923, + 1.6885874066501856, + 2.3524888269603252, + 0.23217103630304337, + 0.2964286580681801 + ], + "unique_experts": 62, + "load_cv": 0.6101114092348392, + "normalized_load_entropy": 0.9528026923319645, + "max_load_share": 0.04317269076305221 + }, + "full_input": { + "tokens": 207, + "top_k": 6, + "decisions": 1242, + "ordered_route_sha256": "6602284c3e328ce741635a7f44007c88cac618427135d02795905f84ca4183a1", + "route_weight_sha256": "e2b3effd5695fad421939bb91a5876e841e3ae87aa5aefbfe4e4818ce3528333", + "loads": [ + 5, + 17, + 11, + 9, + 24, + 23, + 19, + 13, + 52, + 8, + 26, + 18, + 24, + 40, + 14, + 18, + 41, + 8, + 15, + 11, + 14, + 14, + 39, + 6, + 29, + 4, + 18, + 5, + 28, + 14, + 19, + 0, + 22, + 29, + 25, + 6, + 6, + 4, + 33, + 28, + 11, + 43, + 26, + 25, + 18, + 16, + 11, + 10, + 22, + 20, + 40, + 22, + 16, + 13, + 14, + 51, + 2, + 16, + 17, + 24, + 23, + 41, + 11, + 11 + ], + "weighted_loads": [ + 0.23630333691835403, + 0.7942563146352768, + 0.6997222024947405, + 0.3305093739181757, + 1.8323840219527483, + 1.1408523991703987, + 1.2945838402956724, + 0.8875074181705713, + 3.873578852042556, + 0.3995863050222397, + 1.659744756296277, + 1.2901576310396194, + 1.9384517669677734, + 3.0067966654896736, + 1.063495695590973, + 1.5264256820082664, + 4.200989304110408, + 0.5255396030843258, + 0.5413394561037421, + 0.47911423072218895, + 0.8505700714886189, + 0.909875363111496, + 2.0066259503364563, + 0.28738684207201004, + 1.3353311568498611, + 0.17346327006816864, + 1.3109660521149635, + 0.26558260805904865, + 2.1875069607049227, + 1.221240270882845, + 0.9431509207934141, + 0.0, + 1.7294184621423483, + 2.3000166937708855, + 0.987239945679903, + 0.5069902446120977, + 0.3288954943418503, + 0.2280987948179245, + 2.722010811790824, + 1.4748768210411072, + 0.5049617756158113, + 3.177756629884243, + 1.9701577201485634, + 0.8167326394468546, + 2.498257752507925, + 1.2244687899947166, + 0.4460494201630354, + 0.5112225878983736, + 1.5947290603071451, + 1.2163231410086155, + 2.4659030213952065, + 1.4474282041192055, + 1.1922769714146852, + 0.770218001678586, + 0.8540583625435829, + 3.9000465162098408, + 0.07570572942495346, + 0.9207288585603237, + 1.087239139713347, + 1.5020325370132923, + 1.6885874066501856, + 2.6455493420362473, + 0.3153647715225816, + 0.3853578772395849 + ], + "unique_experts": 63, + "load_cv": 0.6059352586786336, + "normalized_load_entropy": 0.9558222646760293, + "max_load_share": 0.04186795491143317 + } + }, + "s0_bos": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "dccaf4bcb0e1145e17d85c8a42ff38d47f981fe620533f1cd1fcf83200d48754", + "route_weight_sha256": "56cf7b11750d29ba2c8352f770ac746868b38f1bec9ea5869a4d7c73d56afd86", + "loads": [ + 6, + 17, + 12, + 5, + 21, + 21, + 12, + 13, + 37, + 5, + 17, + 14, + 24, + 33, + 13, + 17, + 25, + 4, + 9, + 14, + 15, + 15, + 39, + 4, + 24, + 6, + 12, + 4, + 24, + 7, + 18, + 1, + 16, + 21, + 23, + 6, + 7, + 1, + 14, + 25, + 9, + 27, + 16, + 22, + 8, + 14, + 7, + 4, + 22, + 21, + 20, + 21, + 17, + 13, + 9, + 43, + 2, + 11, + 11, + 25, + 23, + 34, + 7, + 9 + ], + "weighted_loads": [ + 0.2708595208823681, + 0.7846816945821047, + 0.7594606522470713, + 0.18653792142868042, + 1.824628509581089, + 1.099327426403761, + 0.8019340448081493, + 0.8811257909983397, + 2.6948483008891344, + 0.2701280526816845, + 0.9941984638571739, + 0.69681391492486, + 1.9885946549475193, + 2.6474363766610622, + 1.029270350933075, + 1.4100157544016838, + 1.7136223204433918, + 0.25011351704597473, + 0.3364991098642349, + 0.587744414806366, + 0.877221841365099, + 0.9522443301975727, + 1.9647200051695108, + 0.14780563861131668, + 1.1848514582961798, + 0.250784557312727, + 0.7145559899508953, + 0.23221522942185402, + 2.138064196333289, + 0.3977874219417572, + 0.9080995842814445, + 0.031226735562086105, + 1.3631220012903214, + 1.8221696559339762, + 0.8815914653241634, + 0.48331256583333015, + 0.36525788344442844, + 0.03718801960349083, + 0.8967604115605354, + 1.355041140690446, + 0.29433595947921276, + 1.8575108759105206, + 1.2488986402750015, + 0.7388698067516088, + 0.4448324702680111, + 1.135692648589611, + 0.2685301676392555, + 0.15588386729359627, + 1.6088962368667126, + 1.267420943826437, + 0.9555070195347071, + 1.464968841522932, + 1.2477742284536362, + 0.7136037386953831, + 0.6102734431624413, + 3.229079518467188, + 0.07572371140122414, + 0.40866326354444027, + 0.9760892614722252, + 1.5378814861178398, + 1.7215190269052982, + 2.348012275993824, + 0.227494977414608, + 0.34252961724996567 + ], + "unique_experts": 64, + "load_cv": 0.604587762428272, + "normalized_load_entropy": 0.955223271710411, + "max_load_share": 0.04317269076305221 + }, + "full_input": { + "tokens": 191, + "top_k": 6, + "decisions": 1146, + "ordered_route_sha256": "f213021df6f22a9f9f7913d2678841d1d02e91545757a572164a1234f9b70f69", + "route_weight_sha256": "6786cccc8f6edc8569cafcf23d34c2bd6c84e139b07e1e2c8951a283e36547b5", + "loads": [ + 6, + 17, + 12, + 8, + 21, + 22, + 18, + 13, + 45, + 5, + 19, + 18, + 24, + 38, + 13, + 17, + 40, + 7, + 12, + 14, + 15, + 15, + 42, + 6, + 28, + 6, + 17, + 4, + 26, + 7, + 18, + 1, + 19, + 23, + 23, + 6, + 7, + 1, + 23, + 28, + 9, + 38, + 21, + 23, + 11, + 14, + 10, + 6, + 22, + 21, + 36, + 21, + 17, + 15, + 9, + 50, + 2, + 11, + 14, + 25, + 23, + 40, + 8, + 16 + ], + "weighted_loads": [ + 0.2708595208823681, + 0.7846816945821047, + 0.7594606522470713, + 0.2976076640188694, + 1.824628509581089, + 1.1405172646045685, + 1.3491090089082718, + 0.8811257909983397, + 3.319315755739808, + 0.2701280526816845, + 1.0741452984511852, + 1.282004315406084, + 1.9885946549475193, + 2.9314069226384163, + 1.029270350933075, + 1.4100157544016838, + 3.8100947625935078, + 0.44469185546040535, + 0.4196013128384948, + 0.587744414806366, + 0.877221841365099, + 0.9522443301975727, + 2.137238061055541, + 0.2927152290940285, + 1.3381038811057806, + 0.250784557312727, + 1.1272471994161606, + 0.23221522942185402, + 2.188266731798649, + 0.3977874219417572, + 0.9080995842814445, + 0.031226735562086105, + 1.4781493656337261, + 1.910162391141057, + 0.8815914653241634, + 0.48331256583333015, + 0.36525788344442844, + 0.03718801960349083, + 1.763610601425171, + 1.4848069306463003, + 0.29433595947921276, + 2.741879738867283, + 1.5909153893589973, + 0.7564669717103243, + 1.0995576232671738, + 1.135692648589611, + 0.4064716473221779, + 0.3054059259593487, + 1.6088962368667126, + 1.267420943826437, + 2.2670806646347046, + 1.464968841522932, + 1.2477742284536362, + 0.7889585308730602, + 0.6102734431624413, + 3.8854278288781643, + 0.07572371140122414, + 0.40866326354444027, + 1.0464327223598957, + 1.5378814861178398, + 1.7215190269052982, + 2.645645283162594, + 0.24219201505184174, + 0.6103829611092806 + ], + "unique_experts": 64, + "load_cv": 0.623422722468415, + "normalized_load_entropy": 0.9536986940526826, + "max_load_share": 0.04363001745200698 + } + }, + "s1_bos": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "d6307fb7d80590c0126ddf793d86ca62185b6a1ffad1986a3bb99329a985c8d7", + "route_weight_sha256": "08efca45c12ee37c8941e6d60682ed19da7ba0393d6ecd98444440a1f2744152", + "loads": [ + 6, + 17, + 12, + 6, + 23, + 22, + 12, + 13, + 37, + 5, + 17, + 13, + 24, + 34, + 12, + 17, + 25, + 3, + 12, + 14, + 13, + 16, + 39, + 3, + 23, + 6, + 11, + 3, + 25, + 7, + 18, + 0, + 15, + 22, + 22, + 7, + 7, + 0, + 14, + 27, + 8, + 26, + 16, + 22, + 9, + 14, + 8, + 5, + 22, + 20, + 18, + 21, + 18, + 13, + 9, + 43, + 2, + 10, + 13, + 25, + 23, + 34, + 6, + 9 + ], + "weighted_loads": [ + 0.27843327447772026, + 0.7885650601238012, + 0.7659599930047989, + 0.21491128951311111, + 1.8892676215618849, + 1.1248634830117226, + 0.7780259996652603, + 0.8952725660055876, + 2.6456726379692554, + 0.2755177728831768, + 1.003414697945118, + 0.672858040779829, + 2.0500839948654175, + 2.685504224151373, + 1.0086411610245705, + 1.3880382552742958, + 1.7518544886261225, + 0.2279527708888054, + 0.43170096911489964, + 0.5821400210261345, + 0.8144005350768566, + 0.9865394979715347, + 1.971886333078146, + 0.12227150425314903, + 1.1662144679576159, + 0.25290256552398205, + 0.6506602689623833, + 0.20373619347810745, + 2.2088996414095163, + 0.40744897350668907, + 0.9264703579246998, + 0.0, + 1.3216922134160995, + 1.7957623060792685, + 0.8604071922600269, + 0.5422294307500124, + 0.37304922938346863, + 0.0, + 0.8876822981983423, + 1.3985008019953966, + 0.2642957717180252, + 1.731935566291213, + 1.2469871379435062, + 0.739167207852006, + 0.4893307387828827, + 1.1365557760000229, + 0.3074229434132576, + 0.1951654851436615, + 1.639535304158926, + 1.2364255748689175, + 0.8730821684002876, + 1.4413327760994434, + 1.2796081937849522, + 0.7260167114436626, + 0.601223312318325, + 3.232758205384016, + 0.07405009865760803, + 0.3809813503175974, + 1.0767905376851559, + 1.5201318077743053, + 1.7331554219126701, + 2.3299473598599434, + 0.1986157689243555, + 0.3355579599738121 + ], + "unique_experts": 62, + "load_cv": 0.6119064019001402, + "normalized_load_entropy": 0.9527523949731213, + "max_load_share": 0.04317269076305221 + }, + "full_input": { + "tokens": 207, + "top_k": 6, + "decisions": 1242, + "ordered_route_sha256": "3f690de703cd1a29806ca915575b84703c856eafebfab19b6a54aa1ef9d87454", + "route_weight_sha256": "23d875c421254d14ac7bffb81999c9861ff1726527f4e0bc2f144a3d3d3945de", + "loads": [ + 6, + 17, + 12, + 9, + 24, + 23, + 21, + 13, + 53, + 7, + 25, + 18, + 24, + 40, + 14, + 18, + 41, + 7, + 15, + 14, + 13, + 16, + 41, + 7, + 27, + 6, + 20, + 3, + 27, + 13, + 18, + 0, + 21, + 30, + 22, + 7, + 7, + 4, + 31, + 30, + 10, + 42, + 26, + 24, + 19, + 14, + 12, + 11, + 22, + 20, + 40, + 21, + 18, + 13, + 13, + 51, + 2, + 16, + 15, + 25, + 23, + 40, + 9, + 12 + ], + "weighted_loads": [ + 0.27843327447772026, + 0.7885650601238012, + 0.7659599930047989, + 0.30742632038891315, + 1.9352346118539572, + 1.1688627377152443, + 1.3991638850420713, + 0.8952725660055876, + 3.9955646209418774, + 0.37765587866306305, + 1.6161480098962784, + 1.3191979490220547, + 2.0500839948654175, + 3.0200637336820364, + 1.0768233314156532, + 1.4399561062455177, + 4.206721594557166, + 0.4684731885790825, + 0.5102068530395627, + 0.5821400210261345, + 0.8144005350768566, + 0.9865394979715347, + 2.0938754491508007, + 0.3478592820465565, + 1.3139027953147888, + 0.25290256552398205, + 1.4061271101236343, + 0.20373619347810745, + 2.258739037439227, + 1.1782897524535656, + 0.9264703579246998, + 0.0, + 1.7069915607571602, + 2.3392819855362177, + 0.8604071922600269, + 0.5422294307500124, + 0.37304922938346863, + 0.2280987948179245, + 2.6464635860174894, + 1.5438373554497957, + 0.48461488634347916, + 3.0872929077595472, + 2.022528789937496, + 0.7971537318080664, + 1.69996377825737, + 1.1365557760000229, + 0.4904311280697584, + 0.5500078853219748, + 1.639535304158926, + 1.2364255748689175, + 2.63395101390779, + 1.4413327760994434, + 1.2796081937849522, + 0.7260167114436626, + 0.8073324970901012, + 3.9731045700609684, + 0.07405009865760803, + 0.9225499723106623, + 1.1184583865106106, + 1.5201318077743053, + 1.7331554219126701, + 2.6230078749358654, + 0.27628917805850506, + 0.42448717914521694 + ], + "unique_experts": 63, + "load_cv": 0.6027773354892796, + "normalized_load_entropy": 0.9565034011964133, + "max_load_share": 0.0426731078904992 + } + }, + "s0_x": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "c1b87ab129dc13f92a81d0045718595dc5a2d1d39e487770d9f85a9aa2885598", + "route_weight_sha256": "b9e9bef8b79af6819f90085c1309e170405920837a6426accf632c92b728232a", + "loads": [ + 6, + 16, + 12, + 4, + 20, + 21, + 11, + 13, + 38, + 4, + 15, + 14, + 24, + 33, + 13, + 17, + 26, + 4, + 12, + 13, + 15, + 16, + 38, + 4, + 25, + 7, + 13, + 4, + 24, + 7, + 18, + 2, + 16, + 20, + 21, + 7, + 6, + 1, + 13, + 27, + 10, + 27, + 16, + 22, + 9, + 13, + 9, + 5, + 21, + 20, + 19, + 21, + 17, + 13, + 9, + 44, + 2, + 10, + 12, + 25, + 24, + 35, + 6, + 7 + ], + "weighted_loads": [ + 0.2724274508655071, + 0.7423273250460625, + 0.7547822222113609, + 0.1511824131011963, + 1.7545677199959755, + 1.0961434692144394, + 0.7486073449254036, + 0.8832618948072195, + 2.7079419642686844, + 0.23732812330126762, + 0.9191841427236795, + 0.7305233217775822, + 2.0032714046537876, + 2.6981811560690403, + 1.017850974574685, + 1.430757213383913, + 1.8321538977324963, + 0.2406650111079216, + 0.43147172778844833, + 0.5443594940006733, + 0.875101525336504, + 0.9866907857358456, + 1.9231116622686386, + 0.14756074734032154, + 1.2227471433579922, + 0.2795141637325287, + 0.7892300393432379, + 0.2205559592694044, + 2.0899275057017803, + 0.41080766543745995, + 0.908245000988245, + 0.058684464544057846, + 1.3793370015919209, + 1.8436519615352154, + 0.8029607255011797, + 0.49888470582664013, + 0.3157682828605175, + 0.0364416278898716, + 0.8855869844555855, + 1.4078328032046556, + 0.33145022578537464, + 1.8472428508102894, + 1.2491905130445957, + 0.7322355601936579, + 0.4860481955111027, + 1.092905182391405, + 0.33803611993789673, + 0.19161870330572128, + 1.5835811123251915, + 1.2162035517394543, + 0.9225501697510481, + 1.4659666903316975, + 1.2609996795654297, + 0.7147108595818281, + 0.5967842601239681, + 3.2778477296233177, + 0.077640850096941, + 0.37389439530670643, + 1.0329806692898273, + 1.5303635895252228, + 1.7647216077893972, + 2.4314871206879616, + 0.20092111267149448, + 0.261636171489954 + ], + "unique_experts": 64, + "load_cv": 0.6078867476454279, + "normalized_load_entropy": 0.9554174480983643, + "max_load_share": 0.04417670682730924 + }, + "full_input": { + "tokens": 191, + "top_k": 6, + "decisions": 1146, + "ordered_route_sha256": "a6553c0584bdea107b51a5e079e554cd02e9309ad9dfe0b3bf68662a07937a97", + "route_weight_sha256": "5e3b4cc24f0ae8d7214defc992bba34c637bd6788e9d08212622baa228f9716f", + "loads": [ + 6, + 16, + 12, + 7, + 20, + 23, + 14, + 13, + 46, + 4, + 17, + 18, + 25, + 39, + 13, + 17, + 42, + 7, + 14, + 13, + 15, + 16, + 41, + 6, + 29, + 7, + 17, + 4, + 26, + 7, + 18, + 2, + 19, + 22, + 21, + 7, + 6, + 1, + 22, + 30, + 10, + 38, + 21, + 23, + 11, + 13, + 13, + 8, + 21, + 20, + 34, + 21, + 17, + 14, + 9, + 51, + 2, + 10, + 15, + 25, + 24, + 42, + 7, + 15 + ], + "weighted_loads": [ + 0.2724274508655071, + 0.7423273250460625, + 0.7547822222113609, + 0.26225215569138527, + 1.7545677199959755, + 1.1913571767508984, + 1.0353858321905136, + 0.8832618948072195, + 3.315809354186058, + 0.23732812330126762, + 0.9980206470936537, + 1.3160640709102154, + 2.0410416275262833, + 3.0169565118849277, + 1.017850974574685, + 1.430757213383913, + 4.206540543586016, + 0.44731681793928146, + 0.472965813241899, + 0.5443594940006733, + 0.875101525336504, + 0.9866907857358456, + 2.095629718154669, + 0.2964697275310755, + 1.375999566167593, + 0.2795141637325287, + 1.1385589074343443, + 0.2205559592694044, + 2.14013004116714, + 0.41080766543745995, + 0.908245000988245, + 0.058684464544057846, + 1.4943643659353256, + 1.9333761371672153, + 0.8029607255011797, + 0.49888470582664013, + 0.3157682828605175, + 0.0364416278898716, + 1.687848974019289, + 1.5365503709763288, + 0.33145022578537464, + 2.6700695008039474, + 1.5904626473784447, + 0.7498327251523733, + 1.0898273922502995, + 1.092905182391405, + 0.5056679137051105, + 0.3872861936688423, + 1.5835811123251915, + 1.2162035517394543, + 2.034606948494911, + 1.4659666903316975, + 1.2609996795654297, + 0.7449542712420225, + 0.5967842601239681, + 3.934196040034294, + 0.077640850096941, + 0.37389439530670643, + 1.1033241301774979, + 1.5303635895252228, + 1.7647216077893972, + 2.7814043797552586, + 0.21561815030872822, + 0.610496437177062 + ], + "unique_experts": 64, + "load_cv": 0.632039799207884, + "normalized_load_entropy": 0.9533767366038554, + "max_load_share": 0.04450261780104712 + } + }, + "s1_x": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "8d1743e1770ca3c33771a7e3760d972907b2e2ef966d84d6ff1e540572568bad", + "route_weight_sha256": "5ab795f4ca8bdbbc5fc30ae4d027ece537c78582ca80ce43f0f704f9af9e8fd2", + "loads": [ + 7, + 16, + 12, + 7, + 20, + 22, + 12, + 13, + 38, + 4, + 15, + 13, + 24, + 32, + 12, + 15, + 27, + 4, + 13, + 12, + 16, + 15, + 40, + 3, + 25, + 6, + 12, + 4, + 22, + 6, + 18, + 2, + 15, + 21, + 21, + 7, + 7, + 1, + 17, + 25, + 8, + 27, + 16, + 20, + 9, + 15, + 8, + 5, + 21, + 19, + 18, + 22, + 18, + 13, + 9, + 43, + 1, + 11, + 13, + 24, + 26, + 35, + 6, + 8 + ], + "weighted_loads": [ + 0.3225135765969753, + 0.7670445423573256, + 0.7767053432762623, + 0.2547485679388046, + 1.7877208404242992, + 1.1262404546141624, + 0.7680640928447247, + 0.8996983896940947, + 2.698443667963147, + 0.25240178406238556, + 0.9247182253748178, + 0.6468239799141884, + 2.055419337004423, + 2.6414829939603806, + 0.9875413402915001, + 1.2872585877776146, + 1.8381685018539429, + 0.2397584728896618, + 0.46196721121668816, + 0.5150714181363583, + 0.9086969532072544, + 0.9349453747272491, + 2.0098333060741425, + 0.12324131280183792, + 1.2311019897460938, + 0.2528484780341387, + 0.7602506130933762, + 0.22888548858463764, + 2.091905767098069, + 0.36937708780169487, + 0.9238591678440571, + 0.06201280653476715, + 1.335958855226636, + 1.772502664476633, + 0.801500529050827, + 0.5127595569938421, + 0.36253500171005726, + 0.037824034690856934, + 1.0862942803651094, + 1.3145822081714869, + 0.26309551671147346, + 1.7823194302618504, + 1.2409116439521313, + 0.6682134978473186, + 0.47215456143021584, + 1.1808252073824406, + 0.3051495887339115, + 0.20999279990792274, + 1.6119738295674324, + 1.1694604456424713, + 0.8610350452363491, + 1.4719426445662975, + 1.2880034018307924, + 0.7473614402115345, + 0.5921627953648567, + 3.259051598608494, + 0.03150071203708649, + 0.41389109566807747, + 1.09288914129138, + 1.484375525265932, + 1.8226396851241589, + 2.4064527712762356, + 0.19821158051490784, + 0.30296577885746956 + ], + "unique_experts": 64, + "load_cv": 0.6063991057759562, + "normalized_load_entropy": 0.9553578536228104, + "max_load_share": 0.04317269076305221 + }, + "full_input": { + "tokens": 207, + "top_k": 6, + "decisions": 1242, + "ordered_route_sha256": "5a61a85e3b1c50ded10d0d597ae5e685b85268953f29618c659b1820c2576373", + "route_weight_sha256": "1a28f7d2e861415e71c03284b8810be27cada02fa1ba25b5ab6470245fd68f43", + "loads": [ + 7, + 16, + 12, + 10, + 21, + 24, + 18, + 13, + 54, + 6, + 23, + 18, + 24, + 39, + 14, + 16, + 44, + 9, + 15, + 12, + 16, + 15, + 42, + 7, + 30, + 6, + 21, + 4, + 24, + 12, + 18, + 2, + 21, + 29, + 21, + 7, + 7, + 5, + 32, + 28, + 10, + 42, + 26, + 22, + 18, + 15, + 13, + 12, + 21, + 19, + 39, + 22, + 18, + 13, + 13, + 51, + 1, + 17, + 15, + 24, + 26, + 42, + 9, + 12 + ], + "weighted_loads": [ + 0.3225135765969753, + 0.7670445423573256, + 0.7767053432762623, + 0.34726359881460667, + 1.8336878307163715, + 1.223871637135744, + 1.1199404764920473, + 0.8996983896940947, + 4.0463244933635, + 0.3545398898422718, + 1.5355426166206598, + 1.3105952367186546, + 2.055419337004423, + 3.006295345723629, + 1.0557235106825829, + 1.3391764387488365, + 4.562483821064234, + 0.5369303859770298, + 0.5030599823221564, + 0.5150714181363583, + 0.9086969532072544, + 0.9349453747272491, + 2.131822422146797, + 0.3317001685500145, + 1.4114641044288874, + 0.2528484780341387, + 1.4984460398554802, + 0.22888548858463764, + 2.14174516312778, + 1.1402178667485714, + 0.9238591678440571, + 0.06201280653476715, + 1.7212582025676966, + 2.3160223439335823, + 0.801500529050827, + 0.5127595569938421, + 0.36253500171005726, + 0.26592282950878143, + 2.705022042617202, + 1.4583162050694227, + 0.4834146313369274, + 3.017015255987644, + 2.0130387656390667, + 0.7262000218033791, + 1.6471110954880714, + 1.1808252073824406, + 0.5219534691423178, + 0.6305599007755518, + 1.6119738295674324, + 1.1694604456424713, + 2.3885097820311785, + 1.4719426445662975, + 1.2880034018307924, + 0.7473614402115345, + 0.7982719801366329, + 3.999397963285446, + 0.03150071203708649, + 0.9554597176611423, + 1.1345569901168346, + 1.484375525265932, + 1.8226396851241589, + 2.7526557706296444, + 0.2758849896490574, + 0.4611968044191599 + ], + "unique_experts": 64, + "load_cv": 0.6041523737915665, + "normalized_load_entropy": 0.9578213275617228, + "max_load_share": 0.043478260869565216 + } + }, + "s0_period": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "cb485d0be140207087a5b44cda220d66f9f4cab2c90d0a6eafa44df3e817ce04", + "route_weight_sha256": "aad42725e679742f4811075063e431cf7e37c9e071ee1475ee803eff4ece12ad", + "loads": [ + 6, + 17, + 12, + 4, + 20, + 21, + 10, + 13, + 38, + 4, + 16, + 14, + 24, + 33, + 13, + 17, + 26, + 4, + 11, + 12, + 15, + 17, + 38, + 4, + 25, + 7, + 13, + 5, + 23, + 7, + 18, + 2, + 16, + 21, + 22, + 7, + 6, + 1, + 14, + 27, + 8, + 27, + 16, + 21, + 9, + 14, + 7, + 5, + 21, + 20, + 17, + 21, + 18, + 13, + 9, + 43, + 2, + 10, + 13, + 25, + 26, + 35, + 6, + 7 + ], + "weighted_loads": [ + 0.27168967202305794, + 0.7912470865994692, + 0.7575677763670683, + 0.14778037555515766, + 1.7418326810002327, + 1.0965264402329922, + 0.6890091672539711, + 0.8857578206807375, + 2.74755372852087, + 0.2351151742041111, + 0.971662012860179, + 0.7331836000084877, + 1.9848958030343056, + 2.689384501427412, + 1.0121886879205704, + 1.4304328821599483, + 1.7931102272123098, + 0.24427738040685654, + 0.4057588092982769, + 0.5034650564193726, + 0.879929430782795, + 1.0274984687566757, + 1.9138196967542171, + 0.15525712259113789, + 1.2231841497123241, + 0.28195323050022125, + 0.8256257716566324, + 0.2514887358993292, + 2.04473558627069, + 0.4010317027568817, + 0.9170784540474415, + 0.05919529311358929, + 1.378233302384615, + 1.8662455100566149, + 0.8164988234639168, + 0.4913547243922949, + 0.3175301421433687, + 0.03716667369008064, + 0.9306748062372208, + 1.4081724304705858, + 0.26957812905311584, + 1.8750389628112316, + 1.2553225196897984, + 0.6970812119543552, + 0.4833531603217125, + 1.131612617522478, + 0.2712027244269848, + 0.19738809019327164, + 1.5656646825373173, + 1.2173698730766773, + 0.8581740278750658, + 1.453728049993515, + 1.2942512668669224, + 0.7245234418660402, + 0.5943730622529984, + 3.2351161018013954, + 0.07514418102800846, + 0.3681454509496689, + 1.065552033483982, + 1.5255351290106773, + 1.8272921368479729, + 2.422325123101473, + 0.1990044079720974, + 0.26486167684197426 + ], + "unique_experts": 64, + "load_cv": 0.6088411693991543, + "normalized_load_entropy": 0.955097030623266, + "max_load_share": 0.04317269076305221 + }, + "full_input": { + "tokens": 191, + "top_k": 6, + "decisions": 1146, + "ordered_route_sha256": "79f542821ea02f48781e16f008e2686f9d81c98b4a8907335651f79a34754e24", + "route_weight_sha256": "1a6df9738ccc7f27a589dbf9dd6fb7c1887f963a9b126b55f5cdd7b77909a65d", + "loads": [ + 6, + 17, + 12, + 7, + 20, + 22, + 14, + 13, + 47, + 4, + 18, + 18, + 25, + 38, + 13, + 17, + 42, + 7, + 13, + 12, + 15, + 17, + 42, + 6, + 29, + 7, + 17, + 5, + 25, + 7, + 18, + 2, + 19, + 23, + 22, + 7, + 6, + 1, + 24, + 30, + 8, + 39, + 21, + 22, + 11, + 14, + 9, + 7, + 21, + 20, + 34, + 21, + 18, + 14, + 9, + 50, + 2, + 10, + 16, + 25, + 26, + 41, + 7, + 14 + ], + "weighted_loads": [ + 0.27168967202305794, + 0.7912470865994692, + 0.7575677763670683, + 0.25885011814534664, + 1.7418326810002327, + 1.1377162784337997, + 1.0171661265194416, + 0.8857578206807375, + 3.441632177680731, + 0.2351151742041111, + 1.0491812881082296, + 1.3222145065665245, + 2.020971443504095, + 2.973355047404766, + 1.0121886879205704, + 1.4304328821599483, + 4.134897096082568, + 0.4438108131289482, + 0.4472528947517276, + 0.5034650564193726, + 0.879929430782795, + 1.0274984687566757, + 2.130159270018339, + 0.3027615789324045, + 1.376436572521925, + 0.28195323050022125, + 1.1792210061103106, + 0.2514887358993292, + 2.0949381217360497, + 0.4010317027568817, + 0.9170784540474415, + 0.05919529311358929, + 1.4932606667280197, + 1.9515276793390512, + 0.8164988234639168, + 0.4913547243922949, + 0.3175301421433687, + 0.03716667369008064, + 1.841318428516388, + 1.5360180903226137, + 0.26957812905311584, + 2.7556171156466007, + 1.6009186804294586, + 0.7146783769130707, + 1.0871323570609093, + 1.131612617522478, + 0.3632609248161316, + 0.34358328953385353, + 1.5656646825373173, + 1.2173698730766773, + 2.3166251182556152, + 1.453728049993515, + 1.2942512668669224, + 0.7547668535262346, + 0.5943730622529984, + 3.891464412212372, + 0.07514418102800846, + 0.3681454509496689, + 1.1358954943716526, + 1.5255351290106773, + 1.8272921368479729, + 2.7199581302702427, + 0.21370144560933113, + 0.5327150207012892 + ], + "unique_experts": 64, + "load_cv": 0.6364194458468597, + "normalized_load_entropy": 0.952591819499791, + "max_load_share": 0.04363001745200698 + } + }, + "s1_period": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "beaca96305d7c3fca2e6b1762332e68f6b89ff85bcc7d85780a4bca3937d4410", + "route_weight_sha256": "8a8495c7db514dcfde879b1994f744780c7eb842a17ea2754d575680fbf95389", + "loads": [ + 6, + 17, + 12, + 7, + 21, + 22, + 12, + 13, + 38, + 4, + 16, + 13, + 25, + 32, + 12, + 16, + 27, + 4, + 14, + 11, + 15, + 17, + 40, + 3, + 25, + 6, + 12, + 5, + 22, + 6, + 18, + 1, + 15, + 21, + 20, + 7, + 6, + 1, + 16, + 26, + 8, + 26, + 16, + 20, + 9, + 15, + 8, + 5, + 20, + 19, + 17, + 23, + 18, + 13, + 9, + 43, + 2, + 10, + 13, + 24, + 26, + 34, + 6, + 8 + ], + "weighted_loads": [ + 0.27805618569254875, + 0.7998443283140659, + 0.7807371616363525, + 0.2554002571851015, + 1.8000648859888315, + 1.1273573487997055, + 0.7450498677790165, + 0.9045059289783239, + 2.7153441458940506, + 0.2542097754776478, + 0.9559959508478642, + 0.6542489491403103, + 2.0819777715951204, + 2.6614230051636696, + 0.987955030053854, + 1.3572011403739452, + 1.86217500269413, + 0.23632848635315895, + 0.49694032594561577, + 0.4744301214814186, + 0.8826623372733593, + 1.0217926278710365, + 1.992202015593648, + 0.12480393052101135, + 1.2362830564379692, + 0.25288727693259716, + 0.7493827976286411, + 0.2651316970586777, + 2.0751246605068445, + 0.37103280425071716, + 0.9224649555981159, + 0.031174588948488235, + 1.3364653084427118, + 1.7492934186011553, + 0.7731187809258699, + 0.5146185364574194, + 0.33105339109897614, + 0.03409076854586601, + 1.0403894986957312, + 1.3374982010573149, + 0.26328496262431145, + 1.7621342167258263, + 1.241283655166626, + 0.6610490176826715, + 0.47269871830940247, + 1.176618941128254, + 0.3034354094415903, + 0.21483438834547997, + 1.5731135085225105, + 1.1754858195781708, + 0.8469225279986858, + 1.4965673126280308, + 1.285458603873849, + 0.7494544666260481, + 0.5851743780076504, + 3.2628720961511135, + 0.07762406766414642, + 0.3834512531757355, + 1.0907099843025208, + 1.4750958494842052, + 1.822917629033327, + 2.3480838797986507, + 0.19541729800403118, + 0.30355485901236534 + ], + "unique_experts": 64, + "load_cv": 0.6068245184512651, + "normalized_load_entropy": 0.9551877510506037, + "max_load_share": 0.04317269076305221 + }, + "full_input": { + "tokens": 207, + "top_k": 6, + "decisions": 1242, + "ordered_route_sha256": "1b437a964b5c105370b7dcc906d62e002fbfcabee1fa53e8327517fdbb289976", + "route_weight_sha256": "3f3f23f25fbae122e40c918a68e2d659a41ea6b1d7b05ec7b4c62005f8c493f5", + "loads": [ + 6, + 17, + 12, + 10, + 22, + 23, + 19, + 13, + 55, + 6, + 24, + 18, + 25, + 38, + 14, + 17, + 44, + 9, + 16, + 11, + 15, + 17, + 43, + 6, + 29, + 6, + 21, + 5, + 24, + 12, + 18, + 1, + 22, + 29, + 20, + 7, + 6, + 5, + 32, + 29, + 10, + 43, + 26, + 22, + 18, + 15, + 11, + 11, + 20, + 19, + 40, + 23, + 18, + 13, + 13, + 51, + 2, + 16, + 15, + 24, + 26, + 40, + 9, + 11 + ], + "weighted_loads": [ + 0.27805618569254875, + 0.7998443283140659, + 0.7807371616363525, + 0.34791528806090355, + 1.8460318762809038, + 1.1713566035032272, + 1.1387172807008028, + 0.9045059289783239, + 4.119755458086729, + 0.356347881257534, + 1.5681360848248005, + 1.2629639133810997, + 2.0819777715951204, + 2.995982514694333, + 1.0561372004449368, + 1.4091189913451672, + 4.53237496688962, + 0.5240774415433407, + 0.538033097051084, + 0.4744301214814186, + 0.8826623372733593, + 1.0217926278710365, + 2.1463443394750357, + 0.29747817292809486, + 1.3839713837951422, + 0.25288727693259716, + 1.4802023619413376, + 0.2651316970586777, + 2.1249640565365553, + 1.1418735831975937, + 0.9224649555981159, + 0.031174588948488235, + 1.7549030538648367, + 2.2928130980581045, + 0.7731187809258699, + 0.5146185364574194, + 0.33105339109897614, + 0.2621895633637905, + 2.736363450065255, + 1.48375060595572, + 0.4836040772497654, + 3.1039434038102627, + 2.011956360191107, + 0.719035541638732, + 1.647655252367258, + 1.176618941128254, + 0.43880823999643326, + 0.5714523214846849, + 1.5731135085225105, + 1.1754858195781708, + 2.811377754434943, + 1.4965673126280308, + 1.285458603873849, + 0.7494544666260481, + 0.7912835627794266, + 4.003218460828066, + 0.07762406766414642, + 0.9250198751688004, + 1.1323778331279755, + 1.4750958494842052, + 1.822917629033327, + 2.6411443948745728, + 0.27309070713818073, + 0.3924840781837702 + ], + "unique_experts": 64, + "load_cv": 0.6109811483590394, + "normalized_load_entropy": 0.9567895685960517, + "max_load_share": 0.04428341384863124 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 166, + "ordered_topk_exact_tokens": 118, + "set_exact_tokens": 138, + "mean_set_jaccard": 0.9518072289156626, + "mean_token_weighted_tv": 0.010641474254339575, + "aggregate_load_tv": 0.020080321285140566 + }, + "system_bos": { + "tokens": 166, + "ordered_topk_exact_tokens": 117, + "set_exact_tokens": 138, + "mean_set_jaccard": 0.9492254733218589, + "mean_token_weighted_tv": 0.01239735762173512, + "aggregate_load_tv": 0.020080321285140562 + }, + "system_x": { + "tokens": 166, + "ordered_topk_exact_tokens": 102, + "set_exact_tokens": 121, + "mean_set_jaccard": 0.9212564543889846, + "mean_token_weighted_tv": 0.017305710145373302, + "aggregate_load_tv": 0.026104417670682726 + }, + "system_period": { + "tokens": 166, + "ordered_topk_exact_tokens": 98, + "set_exact_tokens": 126, + "mean_set_jaccard": 0.9311531841652324, + "mean_token_weighted_tv": 0.016516023618449647, + "aggregate_load_tv": 0.02108433734939759 + }, + "bos_at_s0": { + "tokens": 166, + "ordered_topk_exact_tokens": 106, + "set_exact_tokens": 130, + "mean_set_jaccard": 0.9328743545611016, + "mean_token_weighted_tv": 0.016304516244724572, + "aggregate_load_tv": 0.025100401606425706 + }, + "bos_at_s1": { + "tokens": 166, + "ordered_topk_exact_tokens": 96, + "set_exact_tokens": 123, + "mean_set_jaccard": 0.9195352839931155, + "mean_token_weighted_tv": 0.01951143558484962, + "aggregate_load_tv": 0.025100401606425703 + }, + "x_at_s0": { + "tokens": 166, + "ordered_topk_exact_tokens": 99, + "set_exact_tokens": 119, + "mean_set_jaccard": 0.9126506024096386, + "mean_token_weighted_tv": 0.01990691553352468, + "aggregate_load_tv": 0.02911646586345382 + }, + "x_at_s1": { + "tokens": 166, + "ordered_topk_exact_tokens": 86, + "set_exact_tokens": 108, + "mean_set_jaccard": 0.8914228341939185, + "mean_token_weighted_tv": 0.02438266203368464, + "aggregate_load_tv": 0.035140562248996 + }, + "period_at_s0": { + "tokens": 166, + "ordered_topk_exact_tokens": 96, + "set_exact_tokens": 118, + "mean_set_jaccard": 0.9073436603557086, + "mean_token_weighted_tv": 0.021175898241260684, + "aggregate_load_tv": 0.03212851405622491 + }, + "period_at_s1": { + "tokens": 166, + "ordered_topk_exact_tokens": 86, + "set_exact_tokens": 113, + "mean_set_jaccard": 0.9026104417670683, + "mean_token_weighted_tv": 0.0231758244672274, + "aggregate_load_tv": 0.034136546184738964 + } + } + }, + "layer_08": { + "layer": 8, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "13abfc72b6e71909b269fbdd37fa7d14d6883f0d76f5495cb963cfc131288f7a", + "route_weight_sha256": "b7e3e915bce817f045d5024729cc2d1421ec2e87e57584a9989404be4671d5cb", + "loads": [ + 21, + 39, + 5, + 14, + 3, + 7, + 29, + 26, + 45, + 8, + 18, + 13, + 29, + 9, + 6, + 17, + 6, + 22, + 25, + 5, + 17, + 17, + 27, + 8, + 9, + 28, + 23, + 17, + 13, + 7, + 10, + 17, + 36, + 22, + 14, + 7, + 33, + 25, + 10, + 7, + 14, + 14, + 12, + 1, + 5, + 21, + 10, + 23, + 23, + 17, + 16, + 9, + 9, + 12, + 6, + 20, + 17, + 4, + 4, + 5, + 14, + 10, + 15, + 21 + ], + "weighted_loads": [ + 0.8284538183361292, + 2.609589174389839, + 0.22508427500724792, + 0.7075127884745598, + 0.09477674774825573, + 0.36488066241145134, + 1.7628401517868042, + 1.3784006051719189, + 3.43021403811872, + 0.41598215512931347, + 1.0352301895618439, + 0.8415038622915745, + 2.583738222718239, + 0.5424905084073544, + 0.3560611456632614, + 0.7821462899446487, + 0.22862939909100533, + 1.4592885076999664, + 1.2773204613476992, + 0.1916169933974743, + 0.7919003441929817, + 0.947116669267416, + 1.6535474862903357, + 0.31780405156314373, + 0.5115318447351456, + 1.4544007554650307, + 1.1383727230131626, + 0.8886164724826813, + 0.4561357442289591, + 0.34504384547472, + 0.31714245676994324, + 1.2571988198906183, + 3.4527353532612324, + 1.0618493910878897, + 1.0606097020208836, + 0.24186814948916435, + 1.237626003101468, + 1.8342465534806252, + 0.7881333455443382, + 0.23799331858754158, + 0.5434514358639717, + 0.5969399120658636, + 0.49903199449181557, + 0.06874307990074158, + 0.1830710582435131, + 1.3859101850539446, + 0.6196797899901867, + 1.1707774884998798, + 1.2371509745717049, + 0.86351178586483, + 1.0163320247083902, + 0.4088844619691372, + 0.676790677011013, + 0.8903973773121834, + 0.21510592475533485, + 1.535694632679224, + 0.6827391982078552, + 0.23481931909918785, + 0.17673324421048164, + 0.18497462198138237, + 0.8490408677607775, + 0.5013826172798872, + 0.8815462775528431, + 1.0606225319206715 + ], + "unique_experts": 64, + "load_cv": 0.5990131828912681, + "normalized_load_entropy": 0.9577487577182344, + "max_load_share": 0.045180722891566265 + }, + "full_input": { + "tokens": 191, + "top_k": 6, + "decisions": 1146, + "ordered_route_sha256": "38d46718a851cd8ff33bd56ec79b15ad7efc0964a720008df4048f4b71211b38", + "route_weight_sha256": "27ec4f7aa2a18d041d13cc1ee8351e9e98aef89621f4241c6dc5d27b2e455110", + "loads": [ + 21, + 45, + 7, + 15, + 5, + 7, + 33, + 27, + 54, + 8, + 18, + 15, + 35, + 14, + 6, + 19, + 6, + 25, + 25, + 5, + 17, + 17, + 29, + 8, + 9, + 40, + 23, + 17, + 13, + 7, + 13, + 17, + 40, + 38, + 14, + 7, + 33, + 25, + 10, + 13, + 21, + 14, + 12, + 1, + 5, + 28, + 18, + 27, + 23, + 20, + 19, + 9, + 20, + 12, + 10, + 28, + 17, + 4, + 8, + 5, + 14, + 10, + 17, + 24 + ], + "weighted_loads": [ + 0.8284538183361292, + 2.9784227032214403, + 0.2638252228498459, + 0.7522660531103611, + 0.15920661762356758, + 0.36488066241145134, + 2.071284770965576, + 1.4240254946053028, + 4.109876489266753, + 0.41598215512931347, + 1.0352301895618439, + 0.9065625118091702, + 2.919523596763611, + 0.9291378073394299, + 0.3560611456632614, + 0.8642382062971592, + 0.22862939909100533, + 1.6239315420389175, + 1.2773204613476992, + 0.1916169933974743, + 0.7919003441929817, + 0.947116669267416, + 1.7262550350278616, + 0.31780405156314373, + 0.5115318447351456, + 2.2881024293601513, + 1.1383727230131626, + 0.8886164724826813, + 0.4561357442289591, + 0.34504384547472, + 0.38715610932558775, + 1.2571988198906183, + 3.6253275610506535, + 2.2448113337159157, + 1.0606097020208836, + 0.24186814948916435, + 1.237626003101468, + 1.8342465534806252, + 0.7881333455443382, + 0.4013318200595677, + 0.9196636453270912, + 0.5969399120658636, + 0.49903199449181557, + 0.06874307990074158, + 0.1830710582435131, + 1.955900015309453, + 1.4043048731982708, + 1.2949222018942237, + 1.2371509745717049, + 1.0199207849800587, + 1.1866013538092375, + 0.4088844619691372, + 1.3342417478561401, + 0.8903973773121834, + 1.791558189317584, + 2.01730196736753, + 0.6827391982078552, + 0.23481931909918785, + 0.2940847408026457, + 0.18497462198138237, + 0.8490408677607775, + 0.5013826172798872, + 0.9734658114612103, + 1.2661196291446686 + ], + "unique_experts": 64, + "load_cv": 0.6124610224088577, + "normalized_load_entropy": 0.9566512111465942, + "max_load_share": 0.04712041884816754 + } + }, + "s1_eos": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "b5241232ca0d605c78f82f0b07e45dfaa53e1b74f5d8916ff1ec62c09b214102", + "route_weight_sha256": "36cc943a645398e6cdecc17454a609d149d1b34cab030177f949a81cc19ef08a", + "loads": [ + 22, + 39, + 5, + 15, + 2, + 7, + 30, + 27, + 44, + 9, + 18, + 15, + 30, + 9, + 6, + 18, + 5, + 21, + 24, + 5, + 16, + 17, + 27, + 8, + 9, + 27, + 22, + 16, + 13, + 7, + 11, + 15, + 36, + 24, + 14, + 5, + 31, + 25, + 10, + 8, + 19, + 14, + 11, + 1, + 5, + 19, + 9, + 21, + 23, + 17, + 15, + 10, + 8, + 12, + 7, + 20, + 16, + 4, + 6, + 5, + 14, + 13, + 14, + 21 + ], + "weighted_loads": [ + 0.8640267364680767, + 2.604574967175722, + 0.23070822283625603, + 0.7488450706005096, + 0.06668662279844284, + 0.3770831748843193, + 1.772112499922514, + 1.4227027110755444, + 3.3566706888377666, + 0.44217601232230663, + 1.039644230157137, + 0.9075158387422562, + 2.599671620875597, + 0.5365686006844044, + 0.3544027991592884, + 0.827652096748352, + 0.19806846976280212, + 1.3675579838454723, + 1.2369600385427475, + 0.1911030001938343, + 0.7645731419324875, + 0.935073833912611, + 1.6374480165541172, + 0.32024309039115906, + 0.5377242788672447, + 1.4312783870846033, + 1.10257925465703, + 0.8563498724251986, + 0.45816457085311413, + 0.34597141668200493, + 0.3575274106115103, + 1.17861607670784, + 3.4677856788039207, + 1.1005927957594395, + 1.048976480960846, + 0.1775585301220417, + 1.189013009890914, + 1.8161267191171646, + 0.7920508682727814, + 0.2710444927215576, + 0.7045152261853218, + 0.5894845016300678, + 0.4552095867693424, + 0.06298629194498062, + 0.1820697821676731, + 1.2640708908438683, + 0.5504730883985758, + 1.0990642569959164, + 1.2466990537941456, + 0.8844124116003513, + 1.0057968311011791, + 0.47688769921660423, + 0.6208680160343647, + 0.8928885422646999, + 0.23869940266013145, + 1.5283678583800793, + 0.6536081228405237, + 0.2371242418885231, + 0.2586670480668545, + 0.18272319249808788, + 0.8348627369850874, + 0.5931396074593067, + 0.8510377109050751, + 1.0482843834906816 + ], + "unique_experts": 64, + "load_cv": 0.5917531338514749, + "normalized_load_entropy": 0.9583851534440765, + "max_load_share": 0.04417670682730924 + }, + "full_input": { + "tokens": 207, + "top_k": 6, + "decisions": 1242, + "ordered_route_sha256": "355e55d1248f049521181eb0f625bd4e46124552f50370f2e735edb884d6d019", + "route_weight_sha256": "2962ebf5ee07fcf0c2e4b8a7df21205e7fcb1ee6d6e6132dcf9fce4f928308d3", + "loads": [ + 23, + 44, + 15, + 16, + 3, + 8, + 40, + 28, + 58, + 9, + 20, + 19, + 39, + 15, + 6, + 20, + 5, + 35, + 25, + 5, + 16, + 17, + 28, + 12, + 9, + 39, + 22, + 18, + 14, + 7, + 14, + 15, + 39, + 46, + 14, + 5, + 31, + 25, + 16, + 12, + 32, + 14, + 13, + 1, + 5, + 32, + 25, + 25, + 26, + 22, + 19, + 10, + 17, + 18, + 11, + 30, + 16, + 4, + 9, + 7, + 14, + 17, + 17, + 26 + ], + "weighted_loads": [ + 0.9021012112498283, + 2.8829215355217457, + 0.8499089740216732, + 0.8041381724178791, + 0.10541070625185966, + 0.42112474888563156, + 2.592744518071413, + 1.4577578119933605, + 4.334727264940739, + 0.44217601232230663, + 1.1266019716858864, + 1.0251634023152292, + 3.134397763758898, + 0.9446883909404278, + 0.3544027991592884, + 0.9172606915235519, + 0.19806846976280212, + 2.3663617707788944, + 1.2840091809630394, + 0.1911030001938343, + 0.7645731419324875, + 0.935073833912611, + 1.677153754979372, + 0.5075514130294323, + 0.5377242788672447, + 2.5967564713209867, + 1.10257925465703, + 0.9764192868024111, + 0.5006637033075094, + 0.34597141668200493, + 0.42348938528448343, + 1.17861607670784, + 3.5768304243683815, + 2.5641741175204515, + 1.048976480960846, + 0.1775585301220417, + 1.189013009890914, + 1.8161267191171646, + 1.1907020770013332, + 0.3500670753419399, + 1.304685216397047, + 0.5894845016300678, + 0.6237751543521881, + 0.06298629194498062, + 0.1820697821676731, + 2.401480872184038, + 1.703050995245576, + 1.2137559494003654, + 1.5619251690804958, + 1.209220889955759, + 1.2238021604716778, + 0.47688769921660423, + 1.1496268659830093, + 1.56247903034091, + 1.8224932607263327, + 2.2117100805044174, + 0.6536081228405237, + 0.2371242418885231, + 0.36225263634696603, + 0.2565339971333742, + 0.8348627369850874, + 0.7795420251786709, + 0.996205285191536, + 1.339260233566165 + ], + "unique_experts": 64, + "load_cv": 0.6034652462808195, + "normalized_load_entropy": 0.9570872574039135, + "max_load_share": 0.04669887278582931 + } + }, + "s0_bos": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "cf7fb350c429a74240e9ffe012234cfd0f135f5322cdd02e7371cb8806cfb20c", + "route_weight_sha256": "e7da5b15c0f20a75fb4deb108b25491fbb86fa0c0e095e2b2a01d7bb2979ab4d", + "loads": [ + 24, + 39, + 5, + 14, + 0, + 7, + 29, + 26, + 43, + 9, + 18, + 14, + 31, + 9, + 6, + 19, + 5, + 21, + 26, + 5, + 16, + 17, + 27, + 6, + 10, + 28, + 23, + 13, + 12, + 7, + 9, + 16, + 36, + 22, + 14, + 5, + 29, + 23, + 12, + 9, + 16, + 15, + 12, + 1, + 3, + 24, + 11, + 26, + 23, + 17, + 15, + 8, + 9, + 11, + 6, + 20, + 18, + 4, + 6, + 5, + 13, + 12, + 15, + 22 + ], + "weighted_loads": [ + 0.9581534396857023, + 2.6081564128398895, + 0.22787349298596382, + 0.7165662385523319, + 0.0, + 0.3580423854291439, + 1.7854953072965145, + 1.378588642925024, + 3.2354540079832077, + 0.4408493470400572, + 1.0440750271081924, + 0.8735532760620117, + 2.6663738526403904, + 0.5481975730508566, + 0.3505031168460846, + 0.8588759042322636, + 0.1918688714504242, + 1.4773583225905895, + 1.2983094193041325, + 0.18827994912862778, + 0.7562562748789787, + 0.964549483731389, + 1.6440025698393583, + 0.2513930033892393, + 0.5451729688793421, + 1.5779265519231558, + 1.1773079317063093, + 0.7971087358891964, + 0.4326993804425001, + 0.33971063792705536, + 0.3070662245154381, + 1.2490924391895533, + 3.4717849045991898, + 1.090850854292512, + 1.0503485724329948, + 0.17606492899358273, + 1.13695259205997, + 1.768809923902154, + 0.8685863427817822, + 0.30668799579143524, + 0.597011711448431, + 0.6241511981934309, + 0.4984128773212433, + 0.07246755808591843, + 0.11805291846394539, + 1.5136700011789799, + 0.607862452045083, + 1.300766160711646, + 1.2485934104770422, + 0.9076906703412533, + 0.9690705593675375, + 0.3594680726528168, + 0.6847331896424294, + 0.8196137472987175, + 0.21187367849051952, + 1.5228849649429321, + 0.6932630464434624, + 0.2340134158730507, + 0.2381688766181469, + 0.1841333992779255, + 0.8353804089128971, + 0.56039959192276, + 0.8692117817699909, + 1.092038756236434 + ], + "unique_experts": 63, + "load_cv": 0.6028779973154622, + "normalized_load_entropy": 0.9552534038657535, + "max_load_share": 0.04317269076305221 + }, + "full_input": { + "tokens": 191, + "top_k": 6, + "decisions": 1146, + "ordered_route_sha256": "72888530208856e64719c2da9de8defda542a6caace3f341018dbb3e457d28bc", + "route_weight_sha256": "0d4881e6085f225f2b30a610e7a3ed3cd8fae00ecc3f62517c817ac412fcf5e5", + "loads": [ + 24, + 45, + 7, + 15, + 1, + 7, + 33, + 27, + 52, + 9, + 18, + 17, + 37, + 14, + 6, + 22, + 5, + 24, + 26, + 5, + 16, + 17, + 29, + 6, + 11, + 41, + 23, + 13, + 12, + 7, + 12, + 16, + 41, + 38, + 14, + 5, + 29, + 23, + 12, + 14, + 22, + 15, + 12, + 1, + 3, + 31, + 19, + 29, + 23, + 20, + 18, + 8, + 20, + 11, + 10, + 28, + 18, + 4, + 9, + 5, + 13, + 12, + 17, + 25 + ], + "weighted_loads": [ + 0.9581534396857023, + 2.9769899416714907, + 0.2666144408285618, + 0.7613195031881332, + 0.06161164492368698, + 0.3580423854291439, + 2.0906553119421005, + 1.424213532358408, + 3.9349601678550243, + 0.4408493470400572, + 1.0440750271081924, + 0.9828986013308167, + 3.0021592266857624, + 0.9348448719829321, + 0.3505031168460846, + 0.9850713647902012, + 0.1918688714504242, + 1.6279724650084972, + 1.2983094193041325, + 0.18827994912862778, + 0.7562562748789787, + 0.964549483731389, + 1.7167101185768843, + 0.2513930033892393, + 0.59177858941257, + 2.4823226425796747, + 1.1773079317063093, + 0.7971087358891964, + 0.4326993804425001, + 0.33971063792705536, + 0.4276068117469549, + 1.2490924391895533, + 3.7020029351115227, + 2.288919895887375, + 1.0503485724329948, + 0.17606492899358273, + 1.13695259205997, + 1.768809923902154, + 0.8685863427817822, + 0.48460218869149685, + 0.9576325044035912, + 0.6241511981934309, + 0.4984128773212433, + 0.07246755808591843, + 0.11805291846394539, + 2.0543745942413807, + 1.3175340164452791, + 1.4154969034716487, + 1.2485934104770422, + 1.064306691288948, + 1.1393398884683847, + 0.3594680726528168, + 1.3421842604875565, + 0.8196137472987175, + 0.918857503682375, + 2.026363054290414, + 0.6932630464434624, + 0.2340134158730507, + 0.35247163847088814, + 0.1841333992779255, + 0.8353804089128971, + 0.56039959192276, + 0.9645927026867867, + 1.297535853460431 + ], + "unique_experts": 64, + "load_cv": 0.6243600319310464, + "normalized_load_entropy": 0.95338100542598, + "max_load_share": 0.04537521815008726 + } + }, + "s1_bos": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "6bda66005dad3ae638894d0d600e65984f26d49878d5866fd8b480e53cb7e319", + "route_weight_sha256": "1fccbbdd68d914680fe428d205ad453a5b8633444404331ae7b7428722599265", + "loads": [ + 23, + 40, + 5, + 14, + 1, + 6, + 29, + 26, + 43, + 8, + 18, + 14, + 30, + 9, + 6, + 21, + 7, + 21, + 26, + 5, + 17, + 17, + 27, + 6, + 9, + 28, + 24, + 17, + 12, + 7, + 10, + 16, + 36, + 22, + 13, + 7, + 30, + 24, + 11, + 8, + 21, + 15, + 12, + 1, + 2, + 20, + 11, + 24, + 23, + 15, + 15, + 8, + 8, + 11, + 7, + 19, + 17, + 4, + 4, + 5, + 13, + 12, + 14, + 22 + ], + "weighted_loads": [ + 0.9166834149509668, + 2.647167455404997, + 0.24342581257224083, + 0.7063105292618275, + 0.028294047340750694, + 0.3163003474473953, + 1.782652547582984, + 1.3954392038285732, + 3.3626559376716614, + 0.4099174924194813, + 1.0469283685088158, + 0.9123600646853447, + 2.6043756771832705, + 0.5682970006018877, + 0.35405030846595764, + 0.9279855266213417, + 0.2617293857038021, + 1.424236848950386, + 1.3160953782498837, + 0.18140116706490517, + 0.7946417145431042, + 0.975183118134737, + 1.6626853849738836, + 0.23734985664486885, + 0.5261272266507149, + 1.591143410652876, + 1.2215068433433771, + 0.9665007703006268, + 0.43358285538852215, + 0.3353429362177849, + 0.3334148321300745, + 1.2784383408725262, + 3.491040464490652, + 1.058921616524458, + 0.9953911826014519, + 0.24761718325316906, + 1.1638953313231468, + 1.8584875129163265, + 0.8348419517278671, + 0.2776485700160265, + 0.7572637721896172, + 0.6281238030642271, + 0.4993574172258377, + 0.07339871674776077, + 0.08788309246301651, + 1.3597610741853714, + 0.5600571986287832, + 1.228465186432004, + 1.2469325046986341, + 0.8161649368703365, + 1.0081043895334005, + 0.35859573632478714, + 0.643617857247591, + 0.8169434741139412, + 0.24366175942122936, + 1.5001860111951828, + 0.6506160497665405, + 0.23771826177835464, + 0.1721627041697502, + 0.18638047203421593, + 0.8379715867340565, + 0.5695767439901829, + 0.8379861637949944, + 1.0846351105719805 + ], + "unique_experts": 64, + "load_cv": 0.6040539806949056, + "normalized_load_entropy": 0.9555643564400292, + "max_load_share": 0.04317269076305221 + }, + "full_input": { + "tokens": 207, + "top_k": 6, + "decisions": 1242, + "ordered_route_sha256": "0139dd18c24db045e7496b3d9b9a4ac0570da06f085f42ccf570fc92d58d5c49", + "route_weight_sha256": "4b2c71dcad5b8e8ec859da43d67fa815e53429ad29842308aafb38831c9c587e", + "loads": [ + 24, + 45, + 15, + 15, + 3, + 7, + 39, + 27, + 57, + 8, + 20, + 17, + 39, + 15, + 6, + 24, + 7, + 36, + 27, + 5, + 17, + 17, + 28, + 10, + 9, + 40, + 24, + 19, + 13, + 7, + 13, + 16, + 39, + 45, + 13, + 7, + 30, + 24, + 17, + 12, + 32, + 15, + 14, + 1, + 2, + 34, + 27, + 27, + 26, + 21, + 19, + 8, + 17, + 17, + 10, + 29, + 17, + 4, + 6, + 6, + 13, + 16, + 17, + 28 + ], + "weighted_loads": [ + 0.9547578897327185, + 2.9255140237510204, + 0.862626563757658, + 0.7616036310791969, + 0.11331593059003353, + 0.3603419214487076, + 2.604213560000062, + 1.4304943047463894, + 4.364222936332226, + 0.4099174924194813, + 1.1338861100375652, + 1.0268465960398316, + 3.1391018200665712, + 0.9764167908579111, + 0.35405030846595764, + 1.0517211183905602, + 0.2617293857038021, + 2.4617600478231907, + 1.3631445206701756, + 0.18140116706490517, + 0.7946417145431042, + 0.975183118134737, + 1.7023911233991385, + 0.4246581792831421, + 0.5261272266507149, + 2.772417973726988, + 1.2215068433433771, + 1.0865701846778393, + 0.47608198784291744, + 0.3353429362177849, + 0.44588838517665863, + 1.2784383408725262, + 3.600085210055113, + 2.6168508883565664, + 0.9953911826014519, + 0.24761718325316906, + 1.1638953313231468, + 1.8584875129163265, + 1.233493160456419, + 0.4051503222435713, + 1.309848964214325, + 0.6281238030642271, + 0.6679229848086834, + 0.07339871674776077, + 0.08788309246301651, + 2.5226271227002144, + 1.6646831948310137, + 1.3340998208150268, + 1.5621586199849844, + 1.1783476807177067, + 1.2261097189038992, + 0.35859573632478714, + 1.1723767071962357, + 1.4865339621901512, + 0.9134470783174038, + 2.1990817338228226, + 0.6506160497665405, + 0.23771826177835464, + 0.2728388123214245, + 0.21990862116217613, + 0.8379715867340565, + 0.755979161709547, + 0.9891484826803207, + 1.427342215552926 + ], + "unique_experts": 64, + "load_cv": 0.6148396142073587, + "normalized_load_entropy": 0.9546318914153242, + "max_load_share": 0.04589371980676329 + } + }, + "s0_x": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "f776aaef8c324be36fdaa08187a97c5caff9ea74c4456c21a56c495d636feab9", + "route_weight_sha256": "a3c1d78877bc351773c6abca25ee74a637fd7fe758a35af194bb526cc800cb5b", + "loads": [ + 20, + 39, + 5, + 13, + 1, + 7, + 30, + 26, + 45, + 9, + 19, + 13, + 32, + 9, + 6, + 21, + 6, + 19, + 26, + 5, + 17, + 17, + 29, + 7, + 9, + 29, + 23, + 14, + 13, + 7, + 6, + 16, + 36, + 22, + 15, + 5, + 30, + 24, + 11, + 8, + 18, + 14, + 10, + 1, + 3, + 21, + 11, + 24, + 24, + 19, + 14, + 8, + 8, + 11, + 7, + 21, + 18, + 4, + 4, + 5, + 14, + 11, + 15, + 22 + ], + "weighted_loads": [ + 0.8187142256647348, + 2.6359374783933163, + 0.2269260548055172, + 0.6687515787780285, + 0.0294988751411438, + 0.36557791754603386, + 1.8527650106698275, + 1.3918138854205608, + 3.438178924843669, + 0.4350659251213074, + 1.0770542956888676, + 0.859702218323946, + 2.709257708862424, + 0.5532230492681265, + 0.33951808884739876, + 0.9120455663651228, + 0.2231032308191061, + 1.3389841988682747, + 1.3083088397979736, + 0.1835596039891243, + 0.7961701601743698, + 0.9779326971620321, + 1.6950811445713043, + 0.28036139719188213, + 0.5091142989695072, + 1.5540519710630178, + 1.1622986998409033, + 0.8304980210959911, + 0.4593349024653435, + 0.3345195706933737, + 0.2037000823765993, + 1.2619976494461298, + 3.4944134764373302, + 1.0190503187477589, + 1.0827520154416561, + 0.1811995729804039, + 1.1565139889717102, + 1.8004556093364954, + 0.8490620888769627, + 0.26835853792726994, + 0.658093124628067, + 0.5905800089240074, + 0.4267931394279003, + 0.06713329255580902, + 0.11655017733573914, + 1.4734726287424564, + 0.6025056783109903, + 1.2295942325145006, + 1.2880042921751738, + 0.9690529759973288, + 0.959861233830452, + 0.36300309002399445, + 0.632045079022646, + 0.8180685974657536, + 0.24657378531992435, + 1.6266509741544724, + 0.6987314261496067, + 0.23191983252763748, + 0.1718977615237236, + 0.18254012800753117, + 0.8829078674316406, + 0.5364411044865847, + 0.8936470914632082, + 1.0975878201425076 + ], + "unique_experts": 64, + "load_cv": 0.6179912579870921, + "normalized_load_entropy": 0.9540399877771129, + "max_load_share": 0.045180722891566265 + }, + "full_input": { + "tokens": 191, + "top_k": 6, + "decisions": 1146, + "ordered_route_sha256": "9341d24123e003f1c221ae3f65d3ac5eeec0201386e54856fdbc97410f8b3c3c", + "route_weight_sha256": "8d1a7548575061f12fdd0b4199296aeadf9260a3d1a63b041b54decb17d0a8b6", + "loads": [ + 20, + 46, + 8, + 14, + 2, + 7, + 36, + 27, + 55, + 9, + 19, + 15, + 38, + 15, + 6, + 22, + 6, + 22, + 26, + 5, + 17, + 17, + 31, + 7, + 9, + 43, + 23, + 14, + 13, + 7, + 8, + 16, + 42, + 37, + 15, + 5, + 30, + 24, + 11, + 13, + 23, + 14, + 10, + 1, + 3, + 27, + 19, + 27, + 24, + 23, + 18, + 8, + 19, + 11, + 9, + 29, + 18, + 4, + 7, + 5, + 14, + 11, + 17, + 25 + ], + "weighted_loads": [ + 0.8187142256647348, + 3.058494133874774, + 0.30739346146583557, + 0.7135048434138298, + 0.09111052006483078, + 0.36557791754603386, + 2.2402318250387907, + 1.4374387748539448, + 4.227354684844613, + 0.4350659251213074, + 1.0770542956888676, + 0.9247608678415418, + 3.045043082907796, + 1.0248958673328161, + 0.33951808884739876, + 0.9576103072613478, + 0.2231032308191061, + 1.480306126177311, + 1.3083088397979736, + 0.1835596039891243, + 0.7961701601743698, + 0.9779326971620321, + 1.7677886933088303, + 0.28036139719188213, + 0.5091142989695072, + 2.551199918612838, + 1.1622986998409033, + 0.8304980210959911, + 0.4593349024653435, + 0.3345195706933737, + 0.26726875081658363, + 1.2619976494461298, + 3.7734403535723686, + 2.037410655990243, + 1.0827520154416561, + 0.1811995729804039, + 1.1565139889717102, + 1.8004556093364954, + 0.8490620888769627, + 0.43336645513772964, + 0.9473094195127487, + 0.5905800089240074, + 0.4267931394279003, + 0.06713329255580902, + 0.11655017733573914, + 1.961290419101715, + 1.3160040508955717, + 1.3443249752745032, + 1.2880042921751738, + 1.1732086148113012, + 1.1835774704813957, + 0.36300309002399445, + 1.289496149867773, + 0.8180685974657536, + 0.8699181079864502, + 2.128222154453397, + 0.6987314261496067, + 0.23191983252763748, + 0.28620052337646484, + 0.18254012800753117, + 0.8829078674316406, + 0.5364411044865847, + 0.9911527428776026, + 1.3030849173665047 + ], + "unique_experts": 64, + "load_cv": 0.6459199741131587, + "normalized_load_entropy": 0.9514028988054948, + "max_load_share": 0.04799301919720768 + } + }, + "s1_x": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "37d120973464b7adcf423cc47c5e843fdd666f21cedbf7d87b37535d15a51c8a", + "route_weight_sha256": "90b40fcddcb0e27e01b882b7cee35bf16a92b4a3831d41af300c635dc177acc2", + "loads": [ + 24, + 40, + 5, + 13, + 2, + 6, + 28, + 26, + 47, + 8, + 18, + 13, + 33, + 9, + 6, + 21, + 7, + 19, + 27, + 5, + 17, + 16, + 25, + 6, + 9, + 31, + 21, + 16, + 12, + 5, + 8, + 16, + 36, + 20, + 14, + 9, + 29, + 25, + 10, + 9, + 17, + 16, + 11, + 1, + 3, + 20, + 10, + 23, + 23, + 16, + 17, + 9, + 8, + 11, + 7, + 21, + 16, + 4, + 4, + 5, + 13, + 14, + 14, + 22 + ], + "weighted_loads": [ + 0.9518982917070389, + 2.630468253046274, + 0.25624825060367584, + 0.6512731723487377, + 0.060965269804000854, + 0.32702337950468063, + 1.7253761291503906, + 1.3977778926491737, + 3.6014686673879623, + 0.40522281266748905, + 1.0380153432488441, + 0.8792959973216057, + 2.6963906679302454, + 0.5689445044845343, + 0.33878258615732193, + 0.9249854609370232, + 0.25970716774463654, + 1.2783165462315083, + 1.3748259954154491, + 0.1832103431224823, + 0.8026474192738533, + 0.9410565979778767, + 1.5613141767680645, + 0.26533826254308224, + 0.5309547744691372, + 1.617097057402134, + 1.1086354739964008, + 0.9397194646298885, + 0.4331098534166813, + 0.2566489167511463, + 0.2617532406002283, + 1.2797949947416782, + 3.505800724029541, + 0.901141420006752, + 1.0520066656172276, + 0.32094197534024715, + 1.1534091010689735, + 1.9065384902060032, + 0.8265286087989807, + 0.30571502074599266, + 0.6360155735164881, + 0.6668065544217825, + 0.45906203612685204, + 0.07032804936170578, + 0.11475100927054882, + 1.3862433955073357, + 0.5565382335335016, + 1.1892007794231176, + 1.2530423309653997, + 0.8489171471446753, + 1.0810654759407043, + 0.40560903027653694, + 0.6094621084630489, + 0.7987924925982952, + 0.23853787407279015, + 1.6181979551911354, + 0.6337541025131941, + 0.22847134619951248, + 0.17482144758105278, + 0.184201467782259, + 0.8475356064736843, + 0.6549052614718676, + 0.8570143096148968, + 1.0953145753592253 + ], + "unique_experts": 64, + "load_cv": 0.6166326318387184, + "normalized_load_entropy": 0.9551984044760674, + "max_load_share": 0.04718875502008032 + }, + "full_input": { + "tokens": 207, + "top_k": 6, + "decisions": 1242, + "ordered_route_sha256": "41d40127cbcef1d84c6821e456c26e215c34a771dceffc354a8b65e7543ca232", + "route_weight_sha256": "7bdef56b626bd2f21d00d3fe895dc3860f6c05840e3c847683e1cbfe11db9da5", + "loads": [ + 25, + 46, + 16, + 15, + 3, + 7, + 40, + 27, + 62, + 8, + 21, + 17, + 42, + 17, + 6, + 22, + 7, + 33, + 28, + 5, + 17, + 16, + 26, + 10, + 9, + 46, + 21, + 18, + 13, + 5, + 10, + 16, + 40, + 39, + 14, + 9, + 29, + 25, + 16, + 12, + 28, + 16, + 13, + 1, + 3, + 33, + 25, + 26, + 26, + 22, + 22, + 9, + 17, + 17, + 9, + 30, + 16, + 4, + 6, + 6, + 13, + 18, + 17, + 27 + ], + "weighted_loads": [ + 0.9899727664887905, + 2.952865656465292, + 0.9128012470901012, + 0.7442283220589161, + 0.09968935325741768, + 0.3710649535059929, + 2.6380524411797523, + 1.43283299356699, + 4.66105879098177, + 0.40522281266748905, + 1.1618023067712784, + 1.0315590994432569, + 3.231116810813546, + 1.1138057094067335, + 0.33878258615732193, + 0.9708137586712837, + 0.25970716774463654, + 2.2727814950048923, + 1.421875137835741, + 0.1832103431224823, + 0.8026474192738533, + 0.9410565979778767, + 1.6010199151933193, + 0.4526465851813555, + 0.5309547744691372, + 3.001458838582039, + 1.1086354739964008, + 1.059788879007101, + 0.4756089858710766, + 0.2566489167511463, + 0.32201818749308586, + 1.2797949947416782, + 3.6570351906120777, + 2.1121737379580736, + 1.0520066656172276, + 0.32094197534024715, + 1.1534091010689735, + 1.9065384902060032, + 1.2251798175275326, + 0.3861218988895416, + 1.1430098954588175, + 0.6668065544217825, + 0.6276276037096977, + 0.07032804936170578, + 0.11475100927054882, + 2.4467733576893806, + 1.5887786354869604, + 1.2948354138061404, + 1.56826844625175, + 1.2182506490498781, + 1.3710299283266068, + 0.40560903027653694, + 1.1382209584116936, + 1.4683829806745052, + 0.8617359157651663, + 2.220859546214342, + 0.6337541025131941, + 0.22847134619951248, + 0.27549755573272705, + 0.2177296169102192, + 0.8475356064736843, + 0.8413076791912317, + 1.010741237550974, + 1.3862904254347086 + ], + "unique_experts": 64, + "load_cv": 0.6281246040826802, + "normalized_load_entropy": 0.9538416574463942, + "max_load_share": 0.0499194847020934 + } + }, + "s0_period": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "dda087ab3eebe88a79d93dcb67fdb96ccdbead45c8900bf65ddfc883b95ccb7c", + "route_weight_sha256": "037c82d2b225b03f68fd06c00353e79fc50afef7503bbd064d6d1671da40a5cc", + "loads": [ + 23, + 39, + 5, + 13, + 1, + 7, + 30, + 26, + 46, + 9, + 19, + 13, + 32, + 9, + 6, + 21, + 6, + 22, + 26, + 5, + 16, + 17, + 29, + 6, + 10, + 29, + 23, + 15, + 11, + 7, + 7, + 16, + 36, + 19, + 15, + 6, + 30, + 25, + 10, + 8, + 17, + 14, + 10, + 1, + 3, + 20, + 11, + 25, + 23, + 16, + 15, + 8, + 8, + 11, + 7, + 20, + 18, + 4, + 5, + 5, + 14, + 11, + 15, + 22 + ], + "weighted_loads": [ + 0.9011297859251499, + 2.6301770843565464, + 0.22995567321777344, + 0.6703647971153259, + 0.02891351468861103, + 0.3598959483206272, + 1.8552100714296103, + 1.3881508279591799, + 3.409353617578745, + 0.43359708972275257, + 1.0853923074901104, + 0.8544475063681602, + 2.7200778611004353, + 0.5539982449263334, + 0.33584970235824585, + 0.9207361675798893, + 0.22263220511376858, + 1.4316362049430609, + 1.3241268135607243, + 0.186806321144104, + 0.7666329480707645, + 0.9685875494033098, + 1.69718923792243, + 0.25472401827573776, + 0.5355797987431288, + 1.5761045888066292, + 1.1634728647768497, + 0.8544857501983643, + 0.4071503337472677, + 0.3368288464844227, + 0.2271834760904312, + 1.2633600365370512, + 3.4832338131964207, + 0.894219309091568, + 1.0847920216619968, + 0.2141878865659237, + 1.1644805297255516, + 1.861297907307744, + 0.8116907626390457, + 0.26964167691767216, + 0.6218770239502192, + 0.5992953274399042, + 0.4268716871738434, + 0.06828594207763672, + 0.11806720122694969, + 1.4456859044730663, + 0.6317769400775433, + 1.2579863592982292, + 1.2516340222209692, + 0.8722165133804083, + 0.9874543864279985, + 0.3630969673395157, + 0.6128535084426403, + 0.8036895617842674, + 0.24601440131664276, + 1.5767701417207718, + 0.6971911825239658, + 0.22942706942558289, + 0.2053946927189827, + 0.18178113922476768, + 0.8876426443457603, + 0.5392198041081429, + 0.8846421018242836, + 1.100203288719058 + ], + "unique_experts": 64, + "load_cv": 0.6202836922255706, + "normalized_load_entropy": 0.9541712038040916, + "max_load_share": 0.04618473895582329 + }, + "full_input": { + "tokens": 191, + "top_k": 6, + "decisions": 1146, + "ordered_route_sha256": "1d8a0a241b3fd4498523b69902bf3e5d95d77055bf120319e3478c4714e8d492", + "route_weight_sha256": "6f3e5779d6950595abf3eb4ee06b0b9ea4337360346f2f9279c376e9093d9531", + "loads": [ + 23, + 45, + 7, + 14, + 2, + 7, + 37, + 27, + 56, + 9, + 19, + 16, + 38, + 15, + 6, + 22, + 6, + 26, + 26, + 5, + 16, + 17, + 31, + 6, + 10, + 43, + 23, + 15, + 11, + 7, + 9, + 16, + 41, + 34, + 15, + 6, + 30, + 25, + 10, + 12, + 21, + 14, + 10, + 1, + 3, + 26, + 20, + 28, + 23, + 21, + 18, + 8, + 19, + 11, + 9, + 28, + 18, + 4, + 8, + 5, + 14, + 11, + 17, + 26 + ], + "weighted_loads": [ + 0.9011297859251499, + 2.9990106131881475, + 0.2686966210603714, + 0.7151180617511272, + 0.09052515961229801, + 0.3598959483206272, + 2.3502603974193335, + 1.4337757173925638, + 4.26172323897481, + 0.43359708972275257, + 1.0853923074901104, + 0.9617599481716752, + 3.0558632351458073, + 0.9789429474622011, + 0.33584970235824585, + 0.9641485959291458, + 0.22263220511376858, + 1.6065194252878428, + 1.3241268135607243, + 0.186806321144104, + 0.7666329480707645, + 0.9685875494033098, + 1.769896786659956, + 0.25472401827573776, + 0.5355797987431288, + 2.5687866657972336, + 1.1634728647768497, + 0.8544857501983643, + 0.4071503337472677, + 0.3368288464844227, + 0.2893445659428835, + 1.2633600365370512, + 3.730183158069849, + 1.9274676833301783, + 1.0847920216619968, + 0.2141878865659237, + 1.1644805297255516, + 1.861297907307744, + 0.8116907626390457, + 0.39199258014559746, + 0.8604523483663797, + 0.5992953274399042, + 0.4268716871738434, + 0.06828594207763672, + 0.11806720122694969, + 1.9336907304823399, + 1.3953000530600548, + 1.3727171020582318, + 1.2516340222209692, + 1.109947694465518, + 1.1577237155288458, + 0.3630969673395157, + 1.2703045792877674, + 0.8036895617842674, + 0.8693587239831686, + 2.071447955444455, + 0.6971911825239658, + 0.22942706942558289, + 0.31969745457172394, + 0.18178113922476768, + 0.8876426443457603, + 0.5392198041081429, + 0.9802124574780464, + 1.429485509172082 + ], + "unique_experts": 64, + "load_cv": 0.6438797295664607, + "normalized_load_entropy": 0.9516468709016792, + "max_load_share": 0.04886561954624782 + } + }, + "s1_period": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "68a15da9b56dc82e392791382a95fbc656a574c5965f875b1f1dab38051e1206", + "route_weight_sha256": "c88a20942dc7d096180c8cb0d51f15cfbc0e568d108106def0827ca682bcfb1f", + "loads": [ + 23, + 40, + 5, + 14, + 1, + 7, + 29, + 27, + 48, + 8, + 18, + 13, + 33, + 9, + 6, + 22, + 6, + 20, + 26, + 5, + 17, + 16, + 26, + 5, + 9, + 30, + 23, + 18, + 11, + 5, + 7, + 16, + 36, + 18, + 14, + 9, + 29, + 24, + 10, + 7, + 18, + 16, + 11, + 1, + 3, + 19, + 9, + 23, + 23, + 16, + 16, + 9, + 8, + 11, + 7, + 21, + 18, + 4, + 4, + 5, + 13, + 15, + 14, + 22 + ], + "weighted_loads": [ + 0.9233895521610975, + 2.631725074723363, + 0.2560768872499466, + 0.6966136246919632, + 0.027849741280078888, + 0.3695210628211498, + 1.7635727431625128, + 1.4174754824489355, + 3.551892688497901, + 0.41120248287916183, + 1.0410270057618618, + 0.8777365274727345, + 2.704764474183321, + 0.5653244461864233, + 0.34021755307912827, + 0.9625255074352026, + 0.2199488915503025, + 1.303439162671566, + 1.3390868417918682, + 0.18425607681274414, + 0.8084225170314312, + 0.9449217207729816, + 1.5921233631670475, + 0.2314421944320202, + 0.5377948582172394, + 1.6030416004359722, + 1.1695383917540312, + 1.009263925254345, + 0.4120827428996563, + 0.256573598831892, + 0.22756575793027878, + 1.2905259393155575, + 3.497259095311165, + 0.8314995244145393, + 1.0519575998187065, + 0.31882596760988235, + 1.1497223228216171, + 1.8780912887305021, + 0.8236235454678535, + 0.24755026772618294, + 0.6652974132448435, + 0.667091341689229, + 0.4618696831166744, + 0.06938814371824265, + 0.11606564000248909, + 1.345220509916544, + 0.5125080533325672, + 1.1910804063081741, + 1.2508906442672014, + 0.8375501800328493, + 1.0564964413642883, + 0.40600091218948364, + 0.6064642332494259, + 0.7869719658046961, + 0.2387620061635971, + 1.5907490774989128, + 0.7044507991522551, + 0.23153377324342728, + 0.17289774119853973, + 0.1845716666430235, + 0.8450614735484123, + 0.6822605617344379, + 0.8546331971883774, + 1.0958427730947733 + ], + "unique_experts": 64, + "load_cv": 0.6265961216237114, + "normalized_load_entropy": 0.9533267512404142, + "max_load_share": 0.04819277108433735 + }, + "full_input": { + "tokens": 207, + "top_k": 6, + "decisions": 1242, + "ordered_route_sha256": "eb1d529a69d30ae6b6d1e5b1277d7fabb36844bb1b08f793ef704c319bfe15a8", + "route_weight_sha256": "bc24a7e0ff693aa9ba63a72c22e46c346ea6f75ebae541b7435d7741e5820911", + "loads": [ + 24, + 45, + 15, + 16, + 2, + 8, + 42, + 28, + 62, + 8, + 22, + 16, + 42, + 15, + 6, + 23, + 6, + 35, + 28, + 5, + 17, + 16, + 27, + 9, + 9, + 45, + 23, + 20, + 12, + 5, + 9, + 16, + 39, + 36, + 14, + 9, + 29, + 24, + 16, + 10, + 29, + 16, + 13, + 1, + 3, + 31, + 26, + 26, + 26, + 24, + 20, + 9, + 17, + 17, + 9, + 31, + 18, + 4, + 6, + 6, + 13, + 19, + 17, + 28 + ], + "weighted_loads": [ + 0.9614640269428492, + 2.9100716430693865, + 0.8752776384353638, + 0.7929668426513672, + 0.06657382473349571, + 0.4135626368224621, + 2.783582342788577, + 1.4525305833667517, + 4.590812748298049, + 0.41120248287916183, + 1.2137456983327866, + 0.9922230588272214, + 3.239490617066622, + 0.9734442364424467, + 0.34021755307912827, + 1.0059592258185148, + 0.2199488915503025, + 2.346630919724703, + 1.4213320277631283, + 0.18425607681274414, + 0.8084225170314312, + 0.9449217207729816, + 1.6318291015923023, + 0.4187505170702934, + 0.5377948582172394, + 2.960718620568514, + 1.1695383917540312, + 1.1293333396315575, + 0.4545818753540516, + 0.256573598831892, + 0.28564990498125553, + 1.2905259393155575, + 3.6063038408756256, + 2.0139368157833815, + 1.0519575998187065, + 0.31882596760988235, + 1.1497223228216171, + 1.8780912887305021, + 1.2222747541964054, + 0.32641178742051125, + 1.176650756970048, + 0.667091341689229, + 0.6304352506995201, + 0.06938814371824265, + 0.11606564000248909, + 2.378278464078903, + 1.6954609900712967, + 1.296715040691197, + 1.5661167595535517, + 1.3042676988989115, + 1.274501770734787, + 0.40600091218948364, + 1.1352230831980705, + 1.456562453880906, + 0.8619600478559732, + 2.236517284065485, + 0.7044507991522551, + 0.23153377324342728, + 0.273573849350214, + 0.2180998157709837, + 0.8450614735484123, + 0.8686629794538021, + 1.0065157935023308, + 1.46562591008842 + ], + "unique_experts": 64, + "load_cv": 0.630695400872688, + "normalized_load_entropy": 0.9528812257299432, + "max_load_share": 0.0499194847020934 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 166, + "ordered_topk_exact_tokens": 113, + "set_exact_tokens": 131, + "mean_set_jaccard": 0.9384681583476764, + "mean_token_weighted_tv": 0.011837475590901562, + "aggregate_load_tv": 0.02510040160642571 + }, + "system_bos": { + "tokens": 166, + "ordered_topk_exact_tokens": 103, + "set_exact_tokens": 124, + "mean_set_jaccard": 0.927710843373494, + "mean_token_weighted_tv": 0.014339825879019427, + "aggregate_load_tv": 0.02309236947791165 + }, + "system_x": { + "tokens": 166, + "ordered_topk_exact_tokens": 92, + "set_exact_tokens": 111, + "mean_set_jaccard": 0.9027538726333906, + "mean_token_weighted_tv": 0.01847166731863855, + "aggregate_load_tv": 0.03313253012048193 + }, + "system_period": { + "tokens": 166, + "ordered_topk_exact_tokens": 106, + "set_exact_tokens": 123, + "mean_set_jaccard": 0.9246987951807228, + "mean_token_weighted_tv": 0.015704563897417253, + "aggregate_load_tv": 0.026104417670682736 + }, + "bos_at_s0": { + "tokens": 166, + "ordered_topk_exact_tokens": 99, + "set_exact_tokens": 120, + "mean_set_jaccard": 0.9156626506024096, + "mean_token_weighted_tv": 0.01688504286379699, + "aggregate_load_tv": 0.031124497991967877 + }, + "bos_at_s1": { + "tokens": 166, + "ordered_topk_exact_tokens": 88, + "set_exact_tokens": 115, + "mean_set_jaccard": 0.9122203098106711, + "mean_token_weighted_tv": 0.019482528100755202, + "aggregate_load_tv": 0.030120481927710843 + }, + "x_at_s0": { + "tokens": 166, + "ordered_topk_exact_tokens": 102, + "set_exact_tokens": 122, + "mean_set_jaccard": 0.9203958691910499, + "mean_token_weighted_tv": 0.016958017261272454, + "aggregate_load_tv": 0.031124497991967877 + }, + "x_at_s1": { + "tokens": 166, + "ordered_topk_exact_tokens": 79, + "set_exact_tokens": 105, + "mean_set_jaccard": 0.8937177280550774, + "mean_token_weighted_tv": 0.02260323458474623, + "aggregate_load_tv": 0.0391566265060241 + }, + "period_at_s0": { + "tokens": 166, + "ordered_topk_exact_tokens": 100, + "set_exact_tokens": 118, + "mean_set_jaccard": 0.9109294320137694, + "mean_token_weighted_tv": 0.018134974857724934, + "aggregate_load_tv": 0.031124497991967877 + }, + "period_at_s1": { + "tokens": 166, + "ordered_topk_exact_tokens": 76, + "set_exact_tokens": 102, + "mean_set_jaccard": 0.887263339070568, + "mean_token_weighted_tv": 0.023453562778521734, + "aggregate_load_tv": 0.0391566265060241 + } + } + }, + "layer_09": { + "layer": 9, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "679859bf88cadbcd9342a808924b7757c5a2aeb066b5d59be58f1213b2d2d8ec", + "route_weight_sha256": "e95a746574b0cd83c4f3c3baa6b1228634c603d40a0108fec62ba87924cc48ca", + "loads": [ + 19, + 25, + 5, + 2, + 10, + 12, + 8, + 3, + 30, + 4, + 35, + 19, + 14, + 28, + 7, + 7, + 4, + 27, + 7, + 39, + 6, + 11, + 12, + 13, + 6, + 8, + 32, + 8, + 16, + 1, + 12, + 16, + 15, + 28, + 32, + 21, + 5, + 9, + 30, + 11, + 7, + 22, + 16, + 8, + 17, + 24, + 25, + 13, + 15, + 4, + 7, + 9, + 27, + 26, + 7, + 7, + 42, + 6, + 21, + 53, + 11, + 19, + 12, + 1 + ], + "weighted_loads": [ + 1.0335713773965836, + 1.4060128927230835, + 0.1963392123579979, + 0.08495572581887245, + 0.5298663936555386, + 0.5715108476579189, + 0.3452422320842743, + 0.13041245378553867, + 2.3178921565413475, + 0.1930127926170826, + 2.1020449846982956, + 1.6008077412843704, + 0.4859654475003481, + 1.0415703430771828, + 0.4072892554104328, + 0.264723714441061, + 0.1497855819761753, + 1.1539959870278835, + 0.41123755648732185, + 2.6751812044531107, + 0.3615495637059212, + 0.7879687324166298, + 0.5046684835106134, + 0.8381787724792957, + 0.20788345113396645, + 0.38609321787953377, + 2.3886824399232864, + 0.3820464015007019, + 1.395711813122034, + 0.036905210465192795, + 0.5637500658631325, + 0.7301423884928226, + 0.4805976804345846, + 1.9630699194967747, + 2.2181930039077997, + 1.267481368035078, + 0.25492119789123535, + 0.49289434030652046, + 1.870768703520298, + 0.9056231379508972, + 0.41380665823817253, + 1.3673281893134117, + 0.7785083837807178, + 0.5608590692281723, + 0.8344804160296917, + 1.6991542726755142, + 1.7855425365269184, + 0.9124550074338913, + 1.0664532259106636, + 0.19089093059301376, + 0.2984665036201477, + 0.542930606752634, + 1.4938662946224213, + 1.40163647942245, + 0.4152182750403881, + 0.3424740694463253, + 2.9746415615081787, + 0.24263008683919907, + 1.3525708727538586, + 3.8138109855353832, + 0.7339663542807102, + 1.6088031753897667, + 0.4720063488930464, + 0.06560323387384415 + ], + "unique_experts": 64, + "load_cv": 0.7050795295208245, + "normalized_load_entropy": 0.943124279659296, + "max_load_share": 0.05321285140562249 + }, + "full_input": { + "tokens": 191, + "top_k": 6, + "decisions": 1146, + "ordered_route_sha256": "0a5905180811c320458035135690a6b9546b9801b8f91faf27b5577c435fea8d", + "route_weight_sha256": "65f36b53d74b01becb3e4c84dde140fb5eab318c7d288ffa99a5061f8e85d379", + "loads": [ + 26, + 28, + 5, + 2, + 12, + 12, + 8, + 3, + 32, + 4, + 46, + 19, + 17, + 32, + 7, + 7, + 5, + 28, + 7, + 50, + 6, + 11, + 16, + 17, + 9, + 9, + 32, + 9, + 16, + 1, + 13, + 22, + 17, + 28, + 41, + 28, + 5, + 9, + 33, + 11, + 7, + 32, + 16, + 8, + 21, + 33, + 37, + 13, + 17, + 4, + 11, + 10, + 27, + 30, + 7, + 12, + 47, + 6, + 22, + 57, + 11, + 19, + 14, + 2 + ], + "weighted_loads": [ + 1.516066551208496, + 1.6083175987005234, + 0.1963392123579979, + 0.08495572581887245, + 0.7746681235730648, + 0.5715108476579189, + 0.3452422320842743, + 0.13041245378553867, + 2.4128196723759174, + 0.1930127926170826, + 3.2740384712815285, + 1.6008077412843704, + 0.539868856780231, + 1.1564306649379432, + 0.4072892554104328, + 0.264723714441061, + 0.19044924154877663, + 1.1963713988661766, + 0.41123755648732185, + 3.804080070927739, + 0.3615495637059212, + 0.7879687324166298, + 2.039870547130704, + 1.1295430399477482, + 0.3384428285062313, + 0.462593961507082, + 2.3886824399232864, + 0.39506158139556646, + 1.395711813122034, + 0.036905210465192795, + 0.6073918044567108, + 0.9190252237021923, + 0.5182414695154876, + 1.9630699194967747, + 2.7102474570274353, + 1.7182784043252468, + 0.25492119789123535, + 0.49289434030652046, + 1.9987608157098293, + 0.9056231379508972, + 0.41380665823817253, + 2.352135770022869, + 0.7785083837807178, + 0.5608590692281723, + 1.1041213814169168, + 2.5691500082612038, + 2.680492542684078, + 0.9124550074338913, + 1.1788432337343693, + 0.19089093059301376, + 0.4956696517765522, + 0.5765758343040943, + 1.4938662946224213, + 1.556503040716052, + 0.4152182750403881, + 0.591922715306282, + 3.2190727405250072, + 0.24263008683919907, + 1.4062518440186977, + 3.9867290258407593, + 0.7339663542807102, + 1.6088031753897667, + 0.5279877427965403, + 0.10194392129778862 + ], + "unique_experts": 64, + "load_cv": 0.726051733529348, + "normalized_load_entropy": 0.9394869593717369, + "max_load_share": 0.049738219895287955 + } + }, + "s1_eos": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "cf4e6f65325529dd04d230a7c8f44d93552b09490722ddc3f2139245b10cd035", + "route_weight_sha256": "e5f632035fd4239b527a6f58f473f6e98b5d8c93f47788a20e12d980d18bd2e4", + "loads": [ + 18, + 25, + 5, + 3, + 10, + 10, + 8, + 3, + 31, + 4, + 35, + 19, + 13, + 33, + 7, + 6, + 5, + 26, + 7, + 39, + 7, + 11, + 11, + 14, + 6, + 10, + 30, + 8, + 16, + 1, + 12, + 14, + 17, + 28, + 29, + 20, + 5, + 8, + 30, + 10, + 7, + 21, + 16, + 8, + 17, + 27, + 26, + 13, + 14, + 6, + 8, + 9, + 27, + 24, + 6, + 5, + 43, + 7, + 20, + 54, + 11, + 19, + 13, + 1 + ], + "weighted_loads": [ + 1.0098755732178688, + 1.387857524678111, + 0.19420997984707355, + 0.1260346807539463, + 0.5401949547231197, + 0.5081474184989929, + 0.35360217466950417, + 0.1290267761796713, + 2.346245437860489, + 0.193092979490757, + 2.1035019867122173, + 1.5823737382888794, + 0.4413423612713814, + 1.218037348240614, + 0.42218709364533424, + 0.22705907188355923, + 0.1832578219473362, + 1.1452103666961193, + 0.406503327190876, + 2.6735901180654764, + 0.4062873423099518, + 0.7773018255829811, + 0.46888099052011967, + 0.8708264157176018, + 0.20605401135981083, + 0.4703946113586426, + 2.378803465515375, + 0.41593408584594727, + 1.4114075936377048, + 0.03554314747452736, + 0.5713158845901489, + 0.6614143345504999, + 0.5467409230768681, + 1.9682938754558563, + 2.082295808941126, + 1.206588290631771, + 0.2631196491420269, + 0.4536738954484463, + 1.8712509721517563, + 0.8881836980581284, + 0.4059877507388592, + 1.2871496230363846, + 0.7744375132024288, + 0.578972477465868, + 0.8448156677186489, + 1.833967037498951, + 1.827307939529419, + 0.9080680124461651, + 0.9996495544910431, + 0.2594455350190401, + 0.33240221813321114, + 0.5510589703917503, + 1.4773483574390411, + 1.3399792816489935, + 0.3726062439382076, + 0.22413445077836514, + 2.9948281832039356, + 0.2674111630767584, + 1.3033961951732635, + 3.8548784870654345, + 0.7190539501607418, + 1.572391889989376, + 0.50496338121593, + 0.06397107243537903 + ], + "unique_experts": 64, + "load_cv": 0.7094579560777887, + "normalized_load_entropy": 0.9433596443232842, + "max_load_share": 0.05421686746987952 + }, + "full_input": { + "tokens": 207, + "top_k": 6, + "decisions": 1242, + "ordered_route_sha256": "937def809fac52a92ad098d5d017c126ca0a06db7839f6c4496aee60b59c140f", + "route_weight_sha256": "dbab22f3ff0e7b73164b388cd986eeccb9ab1b0880e69f0a23af54b78925aafa", + "loads": [ + 29, + 30, + 5, + 3, + 12, + 10, + 8, + 3, + 38, + 6, + 46, + 21, + 16, + 36, + 8, + 6, + 6, + 27, + 7, + 49, + 7, + 14, + 15, + 26, + 11, + 18, + 34, + 9, + 22, + 1, + 15, + 19, + 19, + 31, + 35, + 33, + 5, + 11, + 35, + 11, + 13, + 36, + 18, + 8, + 22, + 41, + 47, + 13, + 20, + 11, + 10, + 10, + 27, + 27, + 7, + 10, + 48, + 7, + 24, + 58, + 11, + 20, + 15, + 2 + ], + "weighted_loads": [ + 1.7181862406432629, + 1.670976122841239, + 0.19420997984707355, + 0.1260346807539463, + 0.804873276501894, + 0.5081474184989929, + 0.35360217466950417, + 0.1290267761796713, + 2.7667970694601536, + 0.2834352217614651, + 3.181986588984728, + 1.6775827668607235, + 0.49586800020188093, + 1.272327192593366, + 0.46078163385391235, + 0.22705907188355923, + 0.22991371899843216, + 1.2009006775915623, + 0.406503327190876, + 3.7998547423630953, + 0.4062873423099518, + 0.9046525061130524, + 2.00301163084805, + 1.7597725540399551, + 0.3969100620597601, + 0.9065303392708302, + 2.631890829652548, + 0.4289492657408118, + 1.8372097536921501, + 0.03554314747452736, + 0.7532176375389099, + 0.8073062545154244, + 0.5887586111202836, + 2.1906274370849133, + 2.388026451691985, + 2.015750426799059, + 0.2631196491420269, + 0.5934398360550404, + 2.117943651974201, + 0.9555127844214439, + 0.8093487396836281, + 2.7624896690249443, + 0.866970133036375, + 0.578972477465868, + 1.031543512828648, + 3.1089695543050766, + 3.5550685934722424, + 0.9080680124461651, + 1.347208522260189, + 0.5862032938748598, + 0.4439867399632931, + 0.5847819298505783, + 1.4773483574390411, + 1.488582106307149, + 0.4140649475157261, + 0.45379092544317245, + 3.2313009090721607, + 0.2674111630767584, + 1.5177214294672012, + 4.0386199820786715, + 0.7190539501607418, + 1.6106393933296204, + 0.664412472397089, + 0.0999797135591507 + ], + "unique_experts": 64, + "load_cv": 0.6963507406828053, + "normalized_load_entropy": 0.9433844948038792, + "max_load_share": 0.04669887278582931 + } + }, + "s0_bos": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "6d797fc60d01e18d51423315557b316abbafe6930bb4a364dcc0a54367742908", + "route_weight_sha256": "ac60de3993ec700de01a0850a52ac2e0807328e4fe2e5cb7cd7b1ca139f6a1ef", + "loads": [ + 18, + 26, + 5, + 3, + 9, + 12, + 11, + 3, + 30, + 4, + 36, + 19, + 12, + 28, + 7, + 6, + 4, + 27, + 7, + 42, + 6, + 11, + 12, + 15, + 6, + 9, + 32, + 7, + 16, + 0, + 13, + 15, + 16, + 28, + 31, + 21, + 5, + 8, + 31, + 10, + 7, + 21, + 17, + 8, + 18, + 27, + 25, + 14, + 15, + 6, + 8, + 7, + 25, + 21, + 7, + 5, + 43, + 5, + 19, + 54, + 11, + 19, + 12, + 1 + ], + "weighted_loads": [ + 0.9502912946045399, + 1.4385955147445202, + 0.19118676707148552, + 0.11793797090649605, + 0.49086667969822884, + 0.5746283270418644, + 0.43989595770835876, + 0.1320416647940874, + 2.309776149690151, + 0.19945229589939117, + 2.1168757528066635, + 1.5978799648582935, + 0.4114221855998039, + 1.0614577420055866, + 0.4076344296336174, + 0.22715160623192787, + 0.14851170405745506, + 1.142406404018402, + 0.4031297340989113, + 2.8315363209694624, + 0.36222294345498085, + 0.7884269170463085, + 0.49706521071493626, + 0.9416048675775528, + 0.20717592537403107, + 0.3901488222181797, + 2.4457765370607376, + 0.35220934450626373, + 1.372497009113431, + 0.0, + 0.6220407150685787, + 0.6798006743192673, + 0.5193984434008598, + 1.9443885758519173, + 2.2079811338335276, + 1.2460126243531704, + 0.2553092651069164, + 0.4725882261991501, + 1.9480363056063652, + 0.8514756988734007, + 0.41884761676192284, + 1.3501978889107704, + 0.8558900952339172, + 0.5621277838945389, + 0.8736863918602467, + 1.8360364250838757, + 1.8170370161533356, + 0.9711478240787983, + 1.0741184540092945, + 0.25983493216335773, + 0.35260849818587303, + 0.4545375779271126, + 1.4463109225034714, + 1.209663549438119, + 0.413729265332222, + 0.2058271337300539, + 3.0495902560651302, + 0.21805514208972454, + 1.2843339554965496, + 3.904702167958021, + 0.7263024002313614, + 1.6062373667955399, + 0.4941618088632822, + 0.06223982572555542 + ], + "unique_experts": 63, + "load_cv": 0.7184041891292142, + "normalized_load_entropy": 0.9412052437358815, + "max_load_share": 0.05421686746987952 + }, + "full_input": { + "tokens": 191, + "top_k": 6, + "decisions": 1146, + "ordered_route_sha256": "126445757cc151d6c4c2ec26122a411ebadaf9358a365fe2b2dffba71e192a76", + "route_weight_sha256": "4b40a71ff65fb5bef05ba2cb04c485868853035511735ce5e2818fef82787016", + "loads": [ + 26, + 29, + 5, + 3, + 12, + 12, + 11, + 3, + 32, + 4, + 47, + 19, + 14, + 32, + 7, + 6, + 5, + 31, + 7, + 53, + 6, + 11, + 15, + 19, + 9, + 10, + 32, + 8, + 16, + 0, + 14, + 20, + 16, + 28, + 40, + 28, + 5, + 8, + 33, + 11, + 7, + 31, + 17, + 8, + 21, + 36, + 37, + 14, + 17, + 6, + 14, + 8, + 25, + 25, + 7, + 9, + 48, + 5, + 20, + 58, + 11, + 19, + 14, + 2 + ], + "weighted_loads": [ + 1.4942656867206097, + 1.6348588541150093, + 0.19118676707148552, + 0.11793797090649605, + 0.7959095872938633, + 0.5746283270418644, + 0.43989595770835876, + 0.1320416647940874, + 2.404703665524721, + 0.19945229589939117, + 3.2888692393898964, + 1.5978799648582935, + 0.4579459931701422, + 1.2316446201875806, + 0.4076344296336174, + 0.22715160623192787, + 0.18917536363005638, + 1.2982228994369507, + 0.4031297340989113, + 3.941506626084447, + 0.36222294345498085, + 0.7884269170463085, + 1.1011388916522264, + 1.2673940435051918, + 0.33773530274629593, + 0.4666495658457279, + 2.4457765370607376, + 0.3652245244011283, + 1.372497009113431, + 0.0, + 0.6650116145610809, + 0.8659640233963728, + 0.5193984434008598, + 1.9443885758519173, + 2.700035586953163, + 1.6902381777763367, + 0.2553092651069164, + 0.4725882261991501, + 2.0344002097845078, + 0.8968199733644724, + 0.41884761676192284, + 2.324616491794586, + 0.8558900952339172, + 0.5621277838945389, + 1.1356572797521949, + 2.838306348770857, + 2.6981924697756767, + 0.9711478240787983, + 1.1861821562051773, + 0.25983493216335773, + 0.62789436429739, + 0.48818280547857285, + 1.4463109225034714, + 1.3717628587037325, + 0.413729265332222, + 0.40885339491069317, + 3.2940214350819588, + 0.21805514208972454, + 1.3380149267613888, + 4.077620208263397, + 0.7263024002313614, + 1.6062373667955399, + 0.5501432027667761, + 0.0985805131494999 + ], + "unique_experts": 63, + "load_cv": 0.7387601734486151, + "normalized_load_entropy": 0.9378696542618107, + "max_load_share": 0.0506108202443281 + } + }, + "s1_bos": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "9b071a96b9c6518806e7f18ad59da4b34183f3e1d0c1faa3f360d1937e0c410c", + "route_weight_sha256": "383186148ff90d2c459f1d0ef2b4e3ff27dd8aedbc7fd47324e1b45fc01391ef", + "loads": [ + 19, + 26, + 5, + 2, + 9, + 10, + 7, + 2, + 29, + 4, + 36, + 19, + 12, + 30, + 7, + 8, + 4, + 24, + 7, + 42, + 6, + 11, + 13, + 16, + 6, + 9, + 30, + 7, + 16, + 1, + 13, + 16, + 15, + 29, + 31, + 21, + 6, + 8, + 31, + 10, + 8, + 20, + 18, + 8, + 16, + 28, + 25, + 13, + 16, + 6, + 8, + 9, + 25, + 22, + 7, + 5, + 43, + 4, + 20, + 54, + 12, + 19, + 12, + 1 + ], + "weighted_loads": [ + 0.9934717770665884, + 1.4572949465364218, + 0.19174852967262268, + 0.08312203735113144, + 0.4873429052531719, + 0.5035111419856548, + 0.29183184914290905, + 0.10372857376933098, + 2.2575088180601597, + 0.19886472076177597, + 2.1199578903615475, + 1.5906651802361012, + 0.4029204733669758, + 1.1270566824823618, + 0.39863013848662376, + 0.2992806900292635, + 0.1483786776661873, + 1.047329343855381, + 0.4060816466808319, + 2.807736409828067, + 0.3776099495589733, + 0.789690013974905, + 0.5074367187917233, + 0.9815849885344505, + 0.20421117171645164, + 0.3944138213992119, + 2.3773749247193336, + 0.34064140170812607, + 1.3913663811981678, + 0.03649793565273285, + 0.6059536933898926, + 0.7304298095405102, + 0.4738787431269884, + 2.00193727388978, + 2.210444090887904, + 1.2600877173244953, + 0.29372698813676834, + 0.4761752299964428, + 1.9403933696448803, + 0.8480053786188364, + 0.4630965366959572, + 1.2932179756462574, + 0.8983733355998993, + 0.5513132400810719, + 0.7875298224389553, + 1.872749738395214, + 1.83091676607728, + 0.9553206562995911, + 1.103753700852394, + 0.2785214651376009, + 0.3515934869647026, + 0.5349865481257439, + 1.4650942161679268, + 1.2932016011327505, + 0.409554198384285, + 0.20662620477378368, + 3.078124813735485, + 0.17037797719240189, + 1.3097361288964748, + 3.9242152236402035, + 0.7738748826086521, + 1.6356010735034943, + 0.48285265266895294, + 0.06559408456087112 + ], + "unique_experts": 64, + "load_cv": 0.7171458404546087, + "normalized_load_entropy": 0.941616323417894, + "max_load_share": 0.05421686746987952 + }, + "full_input": { + "tokens": 207, + "top_k": 6, + "decisions": 1242, + "ordered_route_sha256": "4bf464e01c5f02c28dc46b6b03e83885253629060a70eec033368f8b673c6715", + "route_weight_sha256": "1d4a1382b490706acea13e811fa9f95ce1ade5ba5cf6e95fdbd7dc2ef1541ae4", + "loads": [ + 31, + 31, + 5, + 2, + 12, + 10, + 7, + 2, + 36, + 6, + 47, + 21, + 14, + 33, + 8, + 8, + 5, + 28, + 7, + 53, + 6, + 14, + 16, + 27, + 11, + 17, + 34, + 8, + 22, + 1, + 16, + 20, + 15, + 32, + 37, + 33, + 6, + 11, + 35, + 12, + 14, + 35, + 20, + 8, + 19, + 42, + 46, + 13, + 22, + 11, + 12, + 10, + 25, + 26, + 8, + 10, + 48, + 4, + 24, + 58, + 12, + 20, + 14, + 2 + ], + "weighted_loads": [ + 1.790940823033452, + 1.7453687842935324, + 0.19174852967262268, + 0.08312203735113144, + 0.8222037255764008, + 0.5035111419856548, + 0.29183184914290905, + 0.10372857376933098, + 2.6780604496598244, + 0.28920696303248405, + 3.198442492634058, + 1.6858742088079453, + 0.45049817487597466, + 1.2307675099000335, + 0.4372246786952019, + 0.2992806900292635, + 0.19503457471728325, + 1.225237537175417, + 0.4060816466808319, + 4.012602994218469, + 0.3776099495589733, + 0.9170406945049763, + 1.1120317317545414, + 1.8299070000648499, + 0.3950672224164009, + 0.8305495493113995, + 2.6304622888565063, + 0.3536565816029906, + 1.817168541252613, + 0.03649793565273285, + 0.7896924428641796, + 0.8735010009258986, + 0.4738787431269884, + 2.224270835518837, + 2.5161747336387634, + 2.0287699475884438, + 0.29372698813676834, + 0.6159411706030369, + 2.1408153437078, + 0.9648871030658484, + 0.8664575256407261, + 2.7902209870517254, + 0.9909059554338455, + 0.5513132400810719, + 0.9184961123391986, + 3.280156496912241, + 3.5622161589562893, + 0.9553206562995911, + 1.4531716331839561, + 0.6052792239934206, + 0.5371661186218262, + 0.5687095075845718, + 1.4650942161679268, + 1.4815109502524137, + 0.45101290196180344, + 0.4315888285636902, + 3.31459753960371, + 0.17037797719240189, + 1.5240613631904125, + 4.1079567186534405, + 0.7738748826086521, + 1.6738485768437386, + 0.642301743850112, + 0.10160272568464279 + ], + "unique_experts": 64, + "load_cv": 0.7068179320508144, + "normalized_load_entropy": 0.9414431291306348, + "max_load_share": 0.04669887278582931 + } + }, + "s0_x": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "3e6651b8256469b338c2bb1ec859d6e2944274b9a6d3510f9b6bd1153cac930c", + "route_weight_sha256": "807b9611b7e4ff0494eb30a9a09825284364a1347acc436847ce31a97382093b", + "loads": [ + 20, + 26, + 5, + 3, + 9, + 13, + 8, + 2, + 31, + 4, + 36, + 19, + 12, + 27, + 7, + 6, + 4, + 22, + 7, + 41, + 6, + 11, + 15, + 13, + 6, + 9, + 31, + 8, + 16, + 0, + 13, + 16, + 13, + 30, + 31, + 22, + 5, + 8, + 33, + 9, + 7, + 22, + 17, + 8, + 14, + 28, + 25, + 14, + 16, + 5, + 8, + 8, + 25, + 22, + 7, + 6, + 44, + 5, + 19, + 55, + 11, + 21, + 11, + 1 + ], + "weighted_loads": [ + 1.0651563443243504, + 1.4673203770071268, + 0.19384828954935074, + 0.11041173152625561, + 0.4804910980165005, + 0.6275931689888239, + 0.3486737683415413, + 0.10360046476125717, + 2.3854736611247063, + 0.1940944343805313, + 2.1357996333390474, + 1.608246024698019, + 0.40601425617933273, + 1.0057899598032236, + 0.4057648703455925, + 0.2340267077088356, + 0.14831969514489174, + 0.9720554631203413, + 0.4102570526301861, + 2.7494901586323977, + 0.3605191707611084, + 0.8062967769801617, + 0.5979290027171373, + 0.8597155436873436, + 0.20383806340396404, + 0.4175381772220135, + 2.3940750919282436, + 0.37842369452118874, + 1.3755416199564934, + 0.0, + 0.614592619240284, + 0.7229042053222656, + 0.4266610462218523, + 2.037056613713503, + 2.2427168041467667, + 1.3464685194194317, + 0.25311117619276047, + 0.4689171463251114, + 2.049680793657899, + 0.820102222263813, + 0.4186084233224392, + 1.4204019829630852, + 0.8473804630339146, + 0.5501258559525013, + 0.6922038309276104, + 1.9018008895218372, + 1.7677491456270218, + 0.9940184392035007, + 1.1335132457315922, + 0.23321282677352428, + 0.35244543105363846, + 0.5063152648508549, + 1.4560324884951115, + 1.247049979865551, + 0.4163941368460655, + 0.2555420808494091, + 3.1016558706760406, + 0.21521336399018764, + 1.2801280990242958, + 3.970902794972062, + 0.7288097217679024, + 1.7160119861364365, + 0.456220431253314, + 0.06162506341934204 + ], + "unique_experts": 63, + "load_cv": 0.7281269588774065, + "normalized_load_entropy": 0.9397818526780993, + "max_load_share": 0.055220883534136546 + }, + "full_input": { + "tokens": 191, + "top_k": 6, + "decisions": 1146, + "ordered_route_sha256": "a4c89554b747a63056de3391914a09976792b69dfc54e35df19f340ead064aa4", + "route_weight_sha256": "f0cb88eda40b98f562ff9940ef39afbf16826b343ee649c4aa8ae091e7122df6", + "loads": [ + 29, + 29, + 5, + 3, + 11, + 13, + 8, + 2, + 33, + 4, + 48, + 19, + 14, + 30, + 7, + 6, + 6, + 24, + 7, + 52, + 6, + 11, + 18, + 17, + 9, + 12, + 31, + 9, + 16, + 0, + 14, + 21, + 13, + 30, + 41, + 28, + 5, + 8, + 37, + 9, + 7, + 32, + 17, + 8, + 17, + 36, + 37, + 14, + 18, + 5, + 12, + 9, + 25, + 24, + 7, + 11, + 49, + 5, + 20, + 61, + 11, + 21, + 13, + 2 + ], + "weighted_loads": [ + 1.725740224123001, + 1.6725148651748896, + 0.19384828954935074, + 0.11041173152625561, + 0.7275086008012295, + 0.6275931689888239, + 0.3486737683415413, + 0.10360046476125717, + 2.480401176959276, + 0.1940944343805313, + 3.457903975620866, + 1.608246024698019, + 0.452538063749671, + 1.107921707443893, + 0.4057648703455925, + 0.2340267077088356, + 0.2255553863942623, + 1.0568392481654882, + 0.4102570526301861, + 3.87105961330235, + 0.3605191707611084, + 0.8062967769801617, + 1.2020026836544275, + 1.1449187360703945, + 0.3343974407762289, + 0.5657483674585819, + 2.3940750919282436, + 0.3914388744160533, + 1.3755416199564934, + 0.0, + 0.6616993583738804, + 0.9090675543993711, + 0.4266610462218523, + 2.037056613713503, + 2.830249672755599, + 1.7584381401538849, + 0.25311117619276047, + 0.4689171463251114, + 2.2163196485489607, + 0.820102222263813, + 0.4186084233224392, + 2.3487117141485214, + 0.8473804630339146, + 0.5501258559525013, + 0.9541747188195586, + 2.6305814124643803, + 2.6301580257713795, + 0.9940184392035007, + 1.238254550844431, + 0.23321282677352428, + 0.5505431145429611, + 0.5399604924023151, + 1.4560324884951115, + 1.3230411559343338, + 0.4163941368460655, + 0.5069195628166199, + 3.346087049692869, + 0.21521336399018764, + 1.333809070289135, + 4.220608124509454, + 0.7288097217679024, + 1.7160119861364365, + 0.5122018251568079, + 0.09796575084328651 + ], + "unique_experts": 63, + "load_cv": 0.7542962542021936, + "normalized_load_entropy": 0.93590672017104, + "max_load_share": 0.053228621291448515 + } + }, + "s1_x": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "dd12c5c3929cbe399938d09ab488a2d3b0d00204bc943bbd1ee1b4d53bebb409", + "route_weight_sha256": "16a5883f2e7c13229d125b7c343779162cd7da934ac1cd46a467f7d19a0dd83a", + "loads": [ + 20, + 25, + 5, + 4, + 9, + 11, + 9, + 2, + 30, + 3, + 36, + 19, + 10, + 27, + 7, + 6, + 5, + 23, + 8, + 41, + 6, + 11, + 15, + 12, + 6, + 15, + 30, + 7, + 15, + 1, + 11, + 16, + 13, + 30, + 29, + 22, + 5, + 8, + 32, + 10, + 7, + 20, + 17, + 8, + 14, + 30, + 25, + 14, + 17, + 5, + 8, + 9, + 24, + 22, + 7, + 4, + 43, + 5, + 21, + 55, + 12, + 22, + 12, + 1 + ], + "weighted_loads": [ + 1.1106045581400394, + 1.4122499208897352, + 0.1978143397718668, + 0.14347776398062706, + 0.48059412837028503, + 0.5421261303126812, + 0.3604427110403776, + 0.10590909421443939, + 2.3121051602065563, + 0.16229192912578583, + 2.143027352169156, + 1.5802037082612514, + 0.34639223478734493, + 0.9800645001232624, + 0.4200451858341694, + 0.2340561393648386, + 0.18275722116231918, + 1.0335343889892101, + 0.451738853007555, + 2.7292337398976088, + 0.3790830969810486, + 0.7890767492353916, + 0.5747965946793556, + 0.7971972208470106, + 0.20608602091670036, + 0.6726035140454769, + 2.422671429812908, + 0.3636508397758007, + 1.3288135342299938, + 0.03585149347782135, + 0.5293777920305729, + 0.7516414187848568, + 0.41267222352325916, + 2.0450500268489122, + 2.123260710388422, + 1.330434400588274, + 0.25430551916360855, + 0.46445826441049576, + 2.008825846016407, + 0.8335020001977682, + 0.42254044860601425, + 1.2867714241147041, + 0.86906548589468, + 0.5619000941514969, + 0.7006463073194027, + 2.0603311881422997, + 1.7309091612696648, + 0.9929884187877178, + 1.1753497272729874, + 0.2341519221663475, + 0.35875385999679565, + 0.5446105971932411, + 1.435511451214552, + 1.2769555691629648, + 0.41558346152305603, + 0.1494054440408945, + 3.0692974254488945, + 0.2093837410211563, + 1.342116266489029, + 3.9892078023403883, + 0.7800210900604725, + 1.783257119357586, + 0.4808766804635525, + 0.0684378370642662 + ], + "unique_experts": 64, + "load_cv": 0.7181347286043239, + "normalized_load_entropy": 0.941748252362233, + "max_load_share": 0.055220883534136546 + }, + "full_input": { + "tokens": 207, + "top_k": 6, + "decisions": 1242, + "ordered_route_sha256": "b4ead660cc38fb03c05f0ee2128c1539bf5bbb433c9850334d827f40e3ef07a6", + "route_weight_sha256": "09b3629c870d951b5e17fa10f4aab94622dc0e3d0fb809917959361d256ffefb", + "loads": [ + 33, + 30, + 5, + 4, + 11, + 11, + 9, + 2, + 38, + 5, + 48, + 21, + 12, + 29, + 8, + 6, + 7, + 25, + 8, + 53, + 6, + 14, + 19, + 23, + 11, + 25, + 35, + 8, + 21, + 1, + 14, + 20, + 13, + 33, + 36, + 34, + 5, + 11, + 37, + 12, + 13, + 35, + 19, + 8, + 17, + 41, + 45, + 14, + 23, + 10, + 10, + 10, + 24, + 24, + 8, + 9, + 48, + 5, + 25, + 60, + 12, + 23, + 14, + 2 + ], + "weighted_loads": [ + 1.99882185831666, + 1.6905788984149694, + 0.1978143397718668, + 0.14347776398062706, + 0.7600014954805374, + 0.5421261303126812, + 0.3604427110403776, + 0.10590909421443939, + 2.773991137742996, + 0.2526341713964939, + 3.382366070523858, + 1.6754127368330956, + 0.3939699362963438, + 1.031461295671761, + 0.4586397260427475, + 0.2340561393648386, + 0.2701183743774891, + 1.1366102397441864, + 0.451738853007555, + 3.8986253198236227, + 0.3790830969810486, + 0.9164274297654629, + 1.2212025709450245, + 1.648210996761918, + 0.3969420716166496, + 1.1862406395375729, + 2.7227506414055824, + 0.37666601967066526, + 1.754615694284439, + 0.03585149347782135, + 0.7187251932919025, + 0.8947126101702452, + 0.41267222352325916, + 2.267383588477969, + 2.4895172584801912, + 2.0868497379124165, + 0.25430551916360855, + 0.6042242050170898, + 2.2679926976561546, + 0.9441392179578543, + 0.8259014375507832, + 2.6512732915580273, + 0.9615981057286263, + 0.5619000941514969, + 0.831612597219646, + 3.028557099401951, + 3.3790023885667324, + 0.9929884187877178, + 1.523457482457161, + 0.5609096810221672, + 0.4747890830039978, + 0.5783335566520691, + 1.435511451214552, + 1.37763668037951, + 0.4570421651005745, + 0.3767264038324356, + 3.3057701513171196, + 0.2093837410211563, + 1.5564415007829666, + 4.2264742236584425, + 0.7800210900604725, + 1.8215046226978302, + 0.6403257716447115, + 0.10444647818803787 + ], + "unique_experts": 64, + "load_cv": 0.7122560009282374, + "normalized_load_entropy": 0.9413206258340368, + "max_load_share": 0.04830917874396135 + } + }, + "s0_period": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "6618bf857551b8c90da34aeb21e91357817e4cab3d817e139b4078d2cf73f4ca", + "route_weight_sha256": "b129670aed279699fbc08af1bc04a4487fef86437b3b9268babaaa17c9102fb2", + "loads": [ + 20, + 26, + 5, + 3, + 10, + 11, + 6, + 2, + 31, + 4, + 36, + 19, + 11, + 29, + 7, + 6, + 4, + 25, + 7, + 41, + 6, + 11, + 13, + 14, + 6, + 7, + 32, + 8, + 16, + 1, + 13, + 15, + 14, + 28, + 30, + 22, + 5, + 8, + 33, + 9, + 7, + 22, + 17, + 8, + 15, + 28, + 25, + 14, + 16, + 5, + 8, + 9, + 25, + 22, + 7, + 6, + 44, + 5, + 19, + 55, + 12, + 20, + 12, + 1 + ], + "weighted_loads": [ + 1.0621876921504736, + 1.4736957624554634, + 0.19410388730466366, + 0.10994736477732658, + 0.5226746611297131, + 0.5622022338211536, + 0.26363782212138176, + 0.10196579992771149, + 2.384588923305273, + 0.1950012966990471, + 2.1353957690298557, + 1.5993121415376663, + 0.3742753379046917, + 1.0629365108907223, + 0.40241629257798195, + 0.23245497606694698, + 0.1483706645667553, + 1.0649582892656326, + 0.4183086268603802, + 2.774619610980153, + 0.3662257492542267, + 0.8015134185552597, + 0.521018959581852, + 0.9014716111123562, + 0.2069453615695238, + 0.3568331114947796, + 2.4476547054946423, + 0.3800370506942272, + 1.3800424300134182, + 0.035443395376205444, + 0.620569683611393, + 0.6743473913520575, + 0.4467280190438032, + 1.983260203152895, + 2.177596192806959, + 1.3568199053406715, + 0.25630513206124306, + 0.4711943082511425, + 2.047381240874529, + 0.8051878716796637, + 0.42031485214829445, + 1.418425913900137, + 0.8409910909831524, + 0.5489202290773392, + 0.7218824028968811, + 1.8745718076825142, + 1.749123141169548, + 0.9973973520100117, + 1.129872351884842, + 0.23137733526527882, + 0.35200995579361916, + 0.5447741858661175, + 1.454963780939579, + 1.267183791846037, + 0.41858289390802383, + 0.2541272211819887, + 3.0882413536310196, + 0.21468706242740154, + 1.2907772026956081, + 3.957682315260172, + 0.7718477137386799, + 1.690077941864729, + 0.49707878939807415, + 0.06202898919582367 + ], + "unique_experts": 64, + "load_cv": 0.7301620110040724, + "normalized_load_entropy": 0.9399994365800075, + "max_load_share": 0.055220883534136546 + }, + "full_input": { + "tokens": 191, + "top_k": 6, + "decisions": 1146, + "ordered_route_sha256": "309050a1a87215c3bc538226477b386f2a084cb93f4c74aeb088f9d0788119c7", + "route_weight_sha256": "346716db5417d75adc3beb6396a0a12546527a3a4686d8937629a750bdacc1a1", + "loads": [ + 30, + 29, + 5, + 3, + 12, + 11, + 6, + 2, + 33, + 4, + 48, + 19, + 13, + 32, + 7, + 6, + 5, + 27, + 7, + 52, + 6, + 11, + 16, + 18, + 9, + 8, + 32, + 9, + 16, + 1, + 14, + 20, + 14, + 28, + 40, + 28, + 5, + 8, + 36, + 9, + 7, + 33, + 17, + 8, + 18, + 36, + 38, + 14, + 18, + 5, + 12, + 10, + 25, + 25, + 7, + 11, + 50, + 5, + 20, + 60, + 12, + 20, + 14, + 2 + ], + "weighted_loads": [ + 1.7298951428383589, + 1.6805866062641144, + 0.19410388730466366, + 0.10994736477732658, + 0.7600347809493542, + 0.5622022338211536, + 0.26363782212138176, + 0.10196579992771149, + 2.479516439139843, + 0.1950012966990471, + 3.4014951549470425, + 1.5993121415376663, + 0.42079914547502995, + 1.1675450587645173, + 0.40241629257798195, + 0.23245497606694698, + 0.1890343241393566, + 1.1584369875490665, + 0.4183086268603802, + 3.8994258400052786, + 0.3662257492542267, + 0.8015134185552597, + 1.1250926405191422, + 1.184114333242178, + 0.3375047389417887, + 0.4333338551223278, + 2.4476547054946423, + 0.3930522305890918, + 1.3800424300134182, + 0.035443395376205444, + 0.664931945502758, + 0.860510740429163, + 0.4467280190438032, + 1.983260203152895, + 2.7264846432954073, + 1.7751755081117153, + 0.25630513206124306, + 0.4711943082511425, + 2.17711678519845, + 0.8051878716796637, + 0.42031485214829445, + 2.4046245217323303, + 0.8409910909831524, + 0.5489202290773392, + 0.9838532907888293, + 2.612501185387373, + 2.728007949888706, + 0.9973973520100117, + 1.2359786853194237, + 0.23137733526527882, + 0.5480418018996716, + 0.5784194134175777, + 1.454963780939579, + 1.3776208385825157, + 0.41858289390802383, + 0.5065510664135218, + 3.3708809576928616, + 0.21468706242740154, + 1.3444581739604473, + 4.1706337705254555, + 0.7718477137386799, + 1.690077941864729, + 0.553060183301568, + 0.09836967661976814 + ], + "unique_experts": 64, + "load_cv": 0.7588693743894596, + "normalized_load_entropy": 0.9353814914954054, + "max_load_share": 0.05235602094240838 + } + }, + "s1_period": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "6916fcad048c8e0dea09cc411347f5c46a72881ff63b79d10febe74db95f36e9", + "route_weight_sha256": "e1e36eabf408b65a20a3856be999399856bef4df9b6e9a8a5584f96dce8acc07", + "loads": [ + 20, + 24, + 5, + 3, + 9, + 10, + 8, + 2, + 30, + 3, + 36, + 19, + 10, + 26, + 7, + 6, + 5, + 25, + 7, + 40, + 6, + 11, + 15, + 13, + 6, + 12, + 32, + 8, + 15, + 1, + 12, + 17, + 13, + 29, + 29, + 21, + 5, + 8, + 33, + 9, + 7, + 22, + 17, + 8, + 15, + 31, + 25, + 14, + 16, + 5, + 8, + 10, + 24, + 23, + 7, + 5, + 42, + 6, + 20, + 55, + 12, + 22, + 11, + 1 + ], + "weighted_loads": [ + 1.1054555047303438, + 1.382527256384492, + 0.1925130020827055, + 0.10805637389421463, + 0.4749213941395283, + 0.5018597543239594, + 0.3287476971745491, + 0.10490315780043602, + 2.314932454377413, + 0.16019397974014282, + 2.1468255519866943, + 1.588612712919712, + 0.3442046884447336, + 0.9426192361861467, + 0.4202898107469082, + 0.2320357859134674, + 0.1825609840452671, + 1.1338335406035185, + 0.4081823080778122, + 2.700860619544983, + 0.3787924274802208, + 0.7979369685053825, + 0.5649737603962421, + 0.8546884655952454, + 0.20567220821976662, + 0.540696956217289, + 2.4885971806943417, + 0.39970846474170685, + 1.3501813746988773, + 0.036432377994060516, + 0.5705880708992481, + 0.7774865739047527, + 0.40430337004363537, + 2.0094313472509384, + 2.1414202451705933, + 1.2745068334043026, + 0.2613264471292496, + 0.4674251303076744, + 2.0515488907694817, + 0.8004805408418179, + 0.4238327629864216, + 1.3458629697561264, + 0.8667230159044266, + 0.5688829571008682, + 0.720737636089325, + 2.0920165181159973, + 1.724715618416667, + 0.9972910396754742, + 1.124562568962574, + 0.23189286328852177, + 0.3549366258084774, + 0.5914458930492401, + 1.4326554723083973, + 1.317696375772357, + 0.41401384957134724, + 0.17398421466350555, + 3.0242262147367, + 0.24125936441123486, + 1.3044455908238888, + 3.9988953229039907, + 0.7798170298337936, + 1.780213337391615, + 0.4415355660021305, + 0.06470667570829391 + ], + "unique_experts": 64, + "load_cv": 0.7186735486221834, + "normalized_load_entropy": 0.9415580719220776, + "max_load_share": 0.055220883534136546 + }, + "full_input": { + "tokens": 207, + "top_k": 6, + "decisions": 1242, + "ordered_route_sha256": "24afcece912ab7f30befdcfefb9c2f4e9e3a301e2952bd07e45f6a0a2bd32acf", + "route_weight_sha256": "31012a47b7ec080a957750c1c60108016822d6700f6a448327a3f697b9fe10f4", + "loads": [ + 32, + 29, + 5, + 3, + 11, + 10, + 8, + 2, + 37, + 5, + 48, + 21, + 12, + 29, + 8, + 6, + 6, + 28, + 7, + 51, + 6, + 14, + 19, + 24, + 11, + 22, + 36, + 9, + 21, + 1, + 15, + 21, + 13, + 32, + 35, + 33, + 5, + 11, + 38, + 10, + 13, + 38, + 19, + 8, + 18, + 43, + 47, + 14, + 22, + 10, + 10, + 11, + 24, + 26, + 8, + 10, + 48, + 6, + 24, + 59, + 12, + 23, + 13, + 2 + ], + "weighted_loads": [ + 1.8886220660060644, + 1.6583977993577719, + 0.1925130020827055, + 0.10805637389421463, + 0.7513669766485691, + 0.5018597543239594, + 0.3287476971745491, + 0.10490315780043602, + 2.7354840859770775, + 0.2505362220108509, + 3.2968126609921455, + 1.6838217414915562, + 0.3917823899537325, + 1.0268369494006038, + 0.4588843509554863, + 0.2320357859134674, + 0.22921688109636307, + 1.2830828335136175, + 0.4081823080778122, + 3.8602498918771744, + 0.3787924274802208, + 0.9252876490354538, + 1.2094243094325066, + 1.6929809376597404, + 0.3965282589197159, + 1.0537625811994076, + 2.7416845448315144, + 0.4127236446365714, + 1.7759835347533226, + 0.036432377994060516, + 0.7570123597979546, + 0.9205577652901411, + 0.40430337004363537, + 2.2317649088799953, + 2.4471508879214525, + 2.048301078379154, + 0.2613264471292496, + 0.6071910709142685, + 2.3256960846483707, + 0.8678096272051334, + 0.8271937519311905, + 2.8199421502649784, + 0.9592556357383728, + 0.5688829571008682, + 0.8517039259895682, + 3.0660766400396824, + 3.5942967627197504, + 0.9972910396754742, + 1.4773936346173286, + 0.5586506221443415, + 0.46665412187576294, + 0.6251688525080681, + 1.4326554723083973, + 1.4671191591769457, + 0.4554725531488657, + 0.40936495549976826, + 3.3011784106492996, + 0.24125936441123486, + 1.5187708251178265, + 4.182636817917228, + 0.7798170298337936, + 1.8184608407318592, + 0.6009846571832895, + 0.10071531683206558 + ], + "unique_experts": 64, + "load_cv": 0.7148144339133266, + "normalized_load_entropy": 0.9406042162214038, + "max_load_share": 0.04750402576489533 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 166, + "ordered_topk_exact_tokens": 114, + "set_exact_tokens": 136, + "mean_set_jaccard": 0.9483648881239244, + "mean_token_weighted_tv": 0.01175245377852256, + "aggregate_load_tv": 0.025100401606425703 + }, + "system_bos": { + "tokens": 166, + "ordered_topk_exact_tokens": 110, + "set_exact_tokens": 132, + "mean_set_jaccard": 0.9414802065404475, + "mean_token_weighted_tv": 0.013792545529059976, + "aggregate_load_tv": 0.02008032128514056 + }, + "system_x": { + "tokens": 166, + "ordered_topk_exact_tokens": 105, + "set_exact_tokens": 130, + "mean_set_jaccard": 0.9354561101549055, + "mean_token_weighted_tv": 0.016173647441732955, + "aggregate_load_tv": 0.022088353413654616 + }, + "system_period": { + "tokens": 166, + "ordered_topk_exact_tokens": 105, + "set_exact_tokens": 129, + "mean_set_jaccard": 0.93631669535284, + "mean_token_weighted_tv": 0.015618909638464809, + "aggregate_load_tv": 0.02208835341365462 + }, + "bos_at_s0": { + "tokens": 166, + "ordered_topk_exact_tokens": 91, + "set_exact_tokens": 125, + "mean_set_jaccard": 0.9294320137693631, + "mean_token_weighted_tv": 0.01630599352991186, + "aggregate_load_tv": 0.02610441767068273 + }, + "bos_at_s1": { + "tokens": 166, + "ordered_topk_exact_tokens": 94, + "set_exact_tokens": 123, + "mean_set_jaccard": 0.9195352839931153, + "mean_token_weighted_tv": 0.019402215290949286, + "aggregate_load_tv": 0.029116465863453803 + }, + "x_at_s0": { + "tokens": 166, + "ordered_topk_exact_tokens": 90, + "set_exact_tokens": 119, + "mean_set_jaccard": 0.9178141135972462, + "mean_token_weighted_tv": 0.018468335916075003, + "aggregate_load_tv": 0.03413654618473895 + }, + "x_at_s1": { + "tokens": 166, + "ordered_topk_exact_tokens": 83, + "set_exact_tokens": 108, + "mean_set_jaccard": 0.8924268502581757, + "mean_token_weighted_tv": 0.023593784781195313, + "aggregate_load_tv": 0.041164658634538144 + }, + "period_at_s0": { + "tokens": 166, + "ordered_topk_exact_tokens": 90, + "set_exact_tokens": 116, + "mean_set_jaccard": 0.9126506024096386, + "mean_token_weighted_tv": 0.019369143397962474, + "aggregate_load_tv": 0.030120481927710836 + }, + "period_at_s1": { + "tokens": 166, + "ordered_topk_exact_tokens": 76, + "set_exact_tokens": 111, + "mean_set_jaccard": 0.900172117039587, + "mean_token_weighted_tv": 0.02249846007697374, + "aggregate_load_tv": 0.03614457831325302 + } + } + }, + "layer_10": { + "layer": 10, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "b8f17ca0b38bd6fac10d5a1f1c1a378c4a58ab39657f58b6b3193dfca6979028", + "route_weight_sha256": "3a27cbebf3a957400719220fe788ed6e5a2c59ad86da7c189c2437085ca4ff76", + "loads": [ + 5, + 7, + 8, + 25, + 4, + 24, + 30, + 10, + 7, + 22, + 9, + 20, + 29, + 15, + 10, + 9, + 9, + 39, + 16, + 21, + 5, + 39, + 9, + 8, + 3, + 10, + 16, + 9, + 4, + 15, + 20, + 16, + 5, + 15, + 11, + 16, + 12, + 20, + 10, + 6, + 11, + 17, + 16, + 3, + 36, + 27, + 38, + 11, + 8, + 0, + 35, + 28, + 9, + 11, + 5, + 18, + 13, + 35, + 8, + 30, + 24, + 8, + 12, + 25 + ], + "weighted_loads": [ + 0.22216164134442806, + 0.3415503352880478, + 0.3443727530539036, + 1.3855577539652586, + 0.20529255643486977, + 0.9533648323267698, + 2.051471909508109, + 0.30612145364284515, + 0.28014474362134933, + 1.1333369184285402, + 0.4737672097980976, + 1.317370716482401, + 3.615511156618595, + 1.2531930897384882, + 0.46093451976776123, + 0.2792222537100315, + 0.506362322717905, + 2.290345450863242, + 0.537763312458992, + 0.9717303793877363, + 0.18485273979604244, + 2.2839345298707485, + 0.5257235374301672, + 0.33506880700588226, + 0.1446656920015812, + 1.0599002204835415, + 1.2686147019267082, + 0.4257405586540699, + 0.13434995338320732, + 0.6904469914734364, + 1.0841581020504236, + 0.7163368239998817, + 0.21847389079630375, + 0.7162740845233202, + 0.9665275067090988, + 1.1379559859633446, + 0.6292955651879311, + 2.0849675871431828, + 0.5865724645555019, + 0.31786033511161804, + 0.616453405469656, + 0.9949288740754128, + 0.6621800363063812, + 0.08391464501619339, + 2.426373152062297, + 1.6097822673618793, + 4.965463686734438, + 0.5631287973374128, + 0.4460820611566305, + 0.0, + 2.3137912787497044, + 2.1858523823320866, + 0.5338334199041128, + 0.4870445393025875, + 0.24034636095166206, + 1.2439233921468258, + 0.5751030407845974, + 3.4003725480288267, + 0.41135337576270103, + 1.3444765619933605, + 1.5921171270310879, + 0.6800226755440235, + 0.5961541831493378, + 1.6155211739242077 + ], + "unique_experts": 63, + "load_cv": 0.6431598700742263, + "normalized_load_entropy": 0.9514000996405708, + "max_load_share": 0.0391566265060241 + }, + "full_input": { + "tokens": 191, + "top_k": 6, + "decisions": 1146, + "ordered_route_sha256": "97309f4b871744771d87b0eb974c835393dca0c31cc81618268f7bbc6941b4da", + "route_weight_sha256": "7e30f0357fbee437753a7841d3ea3f437e83313f041565715ea5318cc85bc6a2", + "loads": [ + 5, + 7, + 10, + 25, + 4, + 24, + 30, + 14, + 7, + 24, + 11, + 21, + 30, + 18, + 12, + 9, + 9, + 42, + 23, + 23, + 7, + 42, + 10, + 8, + 3, + 12, + 16, + 16, + 5, + 16, + 23, + 17, + 5, + 23, + 12, + 17, + 12, + 20, + 10, + 6, + 11, + 27, + 20, + 5, + 43, + 29, + 43, + 14, + 8, + 2, + 37, + 35, + 9, + 12, + 5, + 28, + 13, + 42, + 8, + 41, + 29, + 20, + 12, + 25 + ], + "weighted_loads": [ + 0.22216164134442806, + 0.3415503352880478, + 0.36338778818026185, + 1.3855577539652586, + 0.20529255643486977, + 0.9533648323267698, + 2.051471909508109, + 0.48042086139321327, + 0.28014474362134933, + 1.1577318161725998, + 0.5716460570693016, + 1.3616646192967892, + 3.648273106664419, + 2.6693490017205477, + 0.6499189361929893, + 0.2792222537100315, + 0.506362322717905, + 2.4799422416836023, + 0.9275344246998429, + 1.0800899099558592, + 0.2630553897470236, + 2.4016059152781963, + 0.5294369286857545, + 0.33506880700588226, + 0.1446656920015812, + 1.1232935115695, + 1.2686147019267082, + 1.1325794011354446, + 0.18084688857197762, + 0.7321362644433975, + 1.3718809131532907, + 0.7301226621493697, + 0.21847389079630375, + 1.0792844239622355, + 0.9963849950581789, + 1.1750914491713047, + 0.6292955651879311, + 2.0849675871431828, + 0.5865724645555019, + 0.31786033511161804, + 0.616453405469656, + 2.10230116173625, + 0.775531773455441, + 0.182712160050869, + 2.9350555073469877, + 1.7130293771624565, + 5.2020744532346725, + 0.7033740859478712, + 0.4460820611566305, + 0.10336704552173615, + 2.406377788633108, + 2.529634650796652, + 0.5338334199041128, + 0.5594509728252888, + 0.24034636095166206, + 1.9295157305896282, + 0.5751030407845974, + 3.791545318439603, + 0.41135337576270103, + 2.0135686807334423, + 1.9249366447329521, + 1.7139498218894005, + 0.5961541831493378, + 1.6155211739242077 + ], + "unique_experts": 64, + "load_cv": 0.6362662843664773, + "normalized_load_entropy": 0.9525067072159369, + "max_load_share": 0.037521815008726006 + } + }, + "s1_eos": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "d9815688b6457ada2c24df1aaec3513c05af4c730efba5c48ebafaa52b5730e8", + "route_weight_sha256": "eec87034e7c0a295f0ddb4aa1b9e2f02ed226e96590625109c0c8d1efaf44604", + "loads": [ + 5, + 7, + 9, + 24, + 4, + 27, + 29, + 10, + 6, + 22, + 10, + 19, + 29, + 16, + 10, + 7, + 10, + 39, + 15, + 23, + 6, + 39, + 10, + 8, + 3, + 11, + 16, + 7, + 5, + 14, + 21, + 15, + 5, + 14, + 11, + 16, + 12, + 21, + 9, + 7, + 11, + 15, + 15, + 4, + 35, + 27, + 38, + 13, + 8, + 0, + 36, + 28, + 10, + 12, + 4, + 18, + 11, + 35, + 9, + 29, + 24, + 7, + 12, + 24 + ], + "weighted_loads": [ + 0.2205581720918417, + 0.3463239446282387, + 0.3809013646095991, + 1.3591575529426336, + 0.20550015568733215, + 1.0368333272635937, + 2.062885405495763, + 0.3078843969851732, + 0.26252999156713486, + 1.1142441052943468, + 0.5037912391126156, + 1.2713586576282978, + 3.5651807375252247, + 1.2739237695932388, + 0.4656786322593689, + 0.23498297855257988, + 0.5252157710492611, + 2.2935680877417326, + 0.5052414834499359, + 1.054916936904192, + 0.2059697713702917, + 2.294167233631015, + 0.567865327000618, + 0.32855715975165367, + 0.14527246728539467, + 1.093185618519783, + 1.2510549761354923, + 0.3589157424867153, + 0.1922653578221798, + 0.6545974910259247, + 1.1242935378104448, + 0.6625038851052523, + 0.21827354282140732, + 0.6826818361878395, + 0.957908995449543, + 1.1275069378316402, + 0.6407129466533661, + 2.0936102718114853, + 0.5464589037001133, + 0.3443171437829733, + 0.6326583083719015, + 0.8751025572419167, + 0.6291747651994228, + 0.12096008285880089, + 2.364157024770975, + 1.5994279272854328, + 4.969732783734798, + 0.6087670996785164, + 0.4431716352701187, + 0.0, + 2.355307111516595, + 2.185817290097475, + 0.5527968965470791, + 0.5409294925630093, + 0.21189605630934238, + 1.2164072655141354, + 0.5071156062185764, + 3.4156285766512156, + 0.44974526204168797, + 1.3292858563363552, + 1.5544518269598484, + 0.6331924870610237, + 0.5925043988972902, + 1.5548708327114582 + ], + "unique_experts": 63, + "load_cv": 0.6410499081649652, + "normalized_load_entropy": 0.9519112260283543, + "max_load_share": 0.0391566265060241 + }, + "full_input": { + "tokens": 207, + "top_k": 6, + "decisions": 1242, + "ordered_route_sha256": "b73a865109972caa355387f6abe52ddf094ea51881392803fa0ae8cd331e1ff8", + "route_weight_sha256": "d25d659d838f54c601121a8f0b9041e89780d2ad4c9eebb650ebd5ce8c562d47", + "loads": [ + 5, + 7, + 11, + 24, + 8, + 27, + 29, + 12, + 6, + 24, + 13, + 22, + 33, + 18, + 14, + 7, + 10, + 44, + 21, + 24, + 7, + 40, + 11, + 8, + 4, + 14, + 17, + 28, + 5, + 17, + 30, + 16, + 10, + 30, + 13, + 18, + 15, + 24, + 10, + 7, + 12, + 31, + 19, + 6, + 41, + 32, + 43, + 16, + 16, + 3, + 39, + 42, + 11, + 14, + 4, + 32, + 12, + 42, + 9, + 46, + 35, + 17, + 12, + 25 + ], + "weighted_loads": [ + 0.2205581720918417, + 0.3463239446282387, + 0.40005760127678514, + 1.3591575529426336, + 0.40920793637633324, + 1.0368333272635937, + 2.062885405495763, + 0.3915294539183378, + 0.26252999156713486, + 1.139327671378851, + 0.6178365983068943, + 1.4409231282770634, + 3.763819210231304, + 2.6486364752054214, + 0.7489065676927567, + 0.23498297855257988, + 0.5252157710492611, + 2.581488350406289, + 0.8677585059776902, + 1.1042557433247566, + 0.2457802351564169, + 2.3427823837846518, + 0.5717760939151049, + 0.32855715975165367, + 0.1867598332464695, + 1.4125244356691837, + 1.2929653860628605, + 1.6608932185918093, + 0.1922653578221798, + 0.7876525856554508, + 1.868793973699212, + 0.6762897232547402, + 0.7061038538813591, + 1.4824515134096146, + 1.1005460228770971, + 1.2919335588812828, + 0.7549055572599173, + 2.2210210412740707, + 0.5827009156346321, + 0.3443171437829733, + 0.6753382664173841, + 2.3320307210087776, + 0.7274280488491058, + 0.18958288617432117, + 2.8254043981432915, + 1.8586999736726284, + 5.250373288989067, + 0.7491776384413242, + 1.0891837887465954, + 0.1796659454703331, + 2.536353414878249, + 3.0105146057903767, + 0.622041929513216, + 0.651600793004036, + 0.21189605630934238, + 2.1793294809758663, + 0.5804048888385296, + 3.814233811572194, + 0.44974526204168797, + 2.3934152647852898, + 2.3091162852942944, + 1.5333763100206852, + 0.5925043988972902, + 1.5903499200940132 + ], + "unique_experts": 64, + "load_cv": 0.6131502939537885, + "normalized_load_entropy": 0.9554607693730692, + "max_load_share": 0.037037037037037035 + } + }, + "s0_bos": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "36e3a47a14088fce277bc6d29b5bb5714caf2da58c951731179542dfc59a91d3", + "route_weight_sha256": "aed456f0a8cf2d8b2795c61244a24d0ccb3002c2cd741e29a6333eb14ff3b8e3", + "loads": [ + 5, + 7, + 7, + 26, + 5, + 26, + 28, + 10, + 6, + 20, + 10, + 20, + 29, + 14, + 10, + 8, + 10, + 39, + 18, + 21, + 4, + 39, + 9, + 9, + 3, + 11, + 16, + 12, + 4, + 13, + 20, + 18, + 5, + 13, + 10, + 16, + 13, + 22, + 10, + 7, + 11, + 15, + 16, + 4, + 36, + 28, + 38, + 12, + 9, + 0, + 36, + 28, + 8, + 12, + 4, + 18, + 12, + 34, + 8, + 26, + 25, + 8, + 12, + 23 + ], + "weighted_loads": [ + 0.2239009402692318, + 0.34553783759474754, + 0.291286364197731, + 1.4287253636866808, + 0.25435810163617134, + 1.0035386681556702, + 2.0238397270441055, + 0.3100609555840492, + 0.24570510163903236, + 1.0738493911921978, + 0.5199667476117611, + 1.3355460949242115, + 3.644830282777548, + 1.3615490291267633, + 0.44642427936196327, + 0.25377834029495716, + 0.5438848324120045, + 2.2635101806372404, + 0.5960789062082767, + 0.9404193237423897, + 0.16027308255434036, + 2.3260839376598597, + 0.5235672108829021, + 0.38306394405663013, + 0.14963151142001152, + 1.1248911172151566, + 1.2700826823711395, + 0.5365289822220802, + 0.13376262970268726, + 0.626801423728466, + 1.0904502905905247, + 0.8032074049115181, + 0.2184076365083456, + 0.6223779339343309, + 0.9573301784694195, + 1.1385010816156864, + 0.6296040825545788, + 2.2092234324663877, + 0.5912583582103252, + 0.34734266623854637, + 0.6078591216355562, + 0.9381262585520744, + 0.6606894470751286, + 0.1216934323310852, + 2.399425569921732, + 1.6176366060972214, + 4.9303845949471, + 0.5860277581959963, + 0.4780401326715946, + 0.0, + 2.3258630726486444, + 2.2138670552521944, + 0.4862784072756767, + 0.5418879352509975, + 0.2075206208974123, + 1.28223966807127, + 0.5501966830343008, + 3.3875930290669203, + 0.41129725985229015, + 1.248602718114853, + 1.6858033910393715, + 0.7153749354183674, + 0.6169083174318075, + 1.5514296852052212 + ], + "unique_experts": 63, + "load_cv": 0.6372141225952783, + "normalized_load_entropy": 0.9522390999335163, + "max_load_share": 0.0391566265060241 + }, + "full_input": { + "tokens": 191, + "top_k": 6, + "decisions": 1146, + "ordered_route_sha256": "65c34d8a3b659545fdef25c6ea1bc4d24a524b887d7a0fceeda362d954a668c1", + "route_weight_sha256": "267527e7bebe202d331aa8b1952f8a607e1bc23de08d9743fc2dae193c913b35", + "loads": [ + 5, + 8, + 8, + 26, + 5, + 26, + 28, + 14, + 6, + 21, + 12, + 21, + 30, + 17, + 13, + 8, + 10, + 42, + 24, + 23, + 7, + 42, + 9, + 9, + 3, + 13, + 16, + 20, + 5, + 14, + 23, + 19, + 5, + 21, + 11, + 17, + 13, + 22, + 10, + 7, + 11, + 25, + 20, + 6, + 42, + 30, + 43, + 15, + 9, + 3, + 38, + 34, + 8, + 13, + 4, + 28, + 12, + 41, + 8, + 38, + 30, + 20, + 12, + 23 + ], + "weighted_loads": [ + 0.2239009402692318, + 0.3834575228393078, + 0.30545108765363693, + 1.4287253636866808, + 0.25435810163617134, + 1.0035386681556702, + 2.0238397270441055, + 0.48436036333441734, + 0.24570510163903236, + 1.0900592152029276, + 0.6178455948829651, + 1.3798399977385998, + 3.677592232823372, + 1.9067273158580065, + 0.6939348094165325, + 0.25377834029495716, + 0.5438848324120045, + 2.460615551099181, + 1.001990009099245, + 1.0454409420490265, + 0.3100712224841118, + 2.4437553230673075, + 0.5235672108829021, + 0.38306394405663013, + 0.14963151142001152, + 1.188284408301115, + 1.2700826823711395, + 1.3408187851309776, + 0.18025956489145756, + 0.6684906966984272, + 1.3681143894791603, + 0.8169932430610061, + 0.2184076365083456, + 0.9972264971584082, + 0.9871876668184996, + 1.1756365448236465, + 0.6296040825545788, + 2.2092234324663877, + 0.5912583582103252, + 0.34734266623854637, + 0.6078591216355562, + 2.1552611105144024, + 0.8182710856199265, + 0.2204909473657608, + 2.912789475172758, + 1.7208837158977985, + 5.166995361447334, + 0.7261543739587069, + 0.4780401326715946, + 0.17996567115187645, + 2.4184495825320482, + 2.4963260237127542, + 0.4862784072756767, + 0.6072019748389721, + 0.2075206208974123, + 1.9690598286688328, + 0.5501966830343008, + 3.7787657994776964, + 0.41129725985229015, + 1.9614400677382946, + 2.018190775066614, + 1.7493020817637444, + 0.6169083174318075, + 1.5514296852052212 + ], + "unique_experts": 64, + "load_cv": 0.6239696574327027, + "normalized_load_entropy": 0.9542506995525083, + "max_load_share": 0.037521815008726006 + } + }, + "s1_bos": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "b34a484611be24abb97eb4c4045f77a5cfe89fc5708f0c7e97ba0a674c9410a9", + "route_weight_sha256": "13669d3446c7e246ae9bc8e378b5264bffa3376b7b7e877e8fc7798f8686ff6c", + "loads": [ + 5, + 7, + 8, + 26, + 4, + 26, + 27, + 10, + 5, + 22, + 10, + 20, + 29, + 13, + 10, + 8, + 9, + 41, + 16, + 23, + 4, + 40, + 9, + 9, + 3, + 14, + 16, + 10, + 4, + 15, + 19, + 18, + 5, + 12, + 11, + 16, + 10, + 22, + 10, + 7, + 11, + 16, + 16, + 4, + 37, + 27, + 38, + 12, + 8, + 0, + 34, + 29, + 10, + 13, + 4, + 19, + 10, + 34, + 8, + 27, + 25, + 7, + 11, + 23 + ], + "weighted_loads": [ + 0.2215493582189083, + 0.3539033494889736, + 0.3337219301611185, + 1.4421638119965792, + 0.21580371633172035, + 0.9946712739765644, + 1.9892454575747252, + 0.3103027157485485, + 0.21272407472133636, + 1.1434903256595135, + 0.5126804169267416, + 1.305162575095892, + 3.686382260173559, + 1.2809010483324528, + 0.4509034566581249, + 0.2518024183809757, + 0.49559707194566727, + 2.345306335017085, + 0.5512199215590954, + 1.0266644656658173, + 0.16103440150618553, + 2.365876968950033, + 0.5028994120657444, + 0.38125710003077984, + 0.14675347879529, + 1.2527403347194195, + 1.275724645704031, + 0.4366376344114542, + 0.13628442771732807, + 0.690893642604351, + 1.0452885646373034, + 0.8131463173776865, + 0.22368050925433636, + 0.6024595312774181, + 1.0072977766394615, + 1.156230054795742, + 0.5049872137606144, + 2.1803647354245186, + 0.6043560840189457, + 0.3443944901227951, + 0.6063348650932312, + 0.9192262273281813, + 0.6509617995470762, + 0.12511452846229076, + 2.5198530107736588, + 1.5863614454865456, + 4.9136225916445255, + 0.5642467513680458, + 0.44145763851702213, + 0.0, + 2.3050600215792656, + 2.24942927993834, + 0.548538088798523, + 0.5921338945627213, + 0.2118965219706297, + 1.278430212289095, + 0.4806879460811615, + 3.3821596447378397, + 0.4177681840956211, + 1.247129861265421, + 1.6495887637138367, + 0.668707761913538, + 0.5809244234114885, + 1.552755430340767 + ], + "unique_experts": 63, + "load_cv": 0.6487528869932856, + "normalized_load_entropy": 0.950579439781073, + "max_load_share": 0.04116465863453815 + }, + "full_input": { + "tokens": 207, + "top_k": 6, + "decisions": 1242, + "ordered_route_sha256": "fb1c3f4a60707055beaf1663035fd89247c4f78e3c46d4bf466089dbbfd14004", + "route_weight_sha256": "4b3240e55a1004c283d8e36811b2b7fea2b8e5a6ad36db9d30a8c739da5ebe34", + "loads": [ + 5, + 7, + 9, + 26, + 8, + 26, + 27, + 13, + 5, + 23, + 13, + 23, + 33, + 15, + 15, + 8, + 9, + 45, + 21, + 25, + 6, + 41, + 9, + 9, + 4, + 17, + 17, + 32, + 4, + 18, + 28, + 19, + 10, + 29, + 13, + 18, + 13, + 25, + 11, + 7, + 12, + 33, + 18, + 6, + 43, + 32, + 43, + 15, + 16, + 4, + 37, + 42, + 11, + 15, + 4, + 33, + 11, + 41, + 8, + 44, + 36, + 17, + 11, + 24 + ], + "weighted_loads": [ + 0.2215493582189083, + 0.3539033494889736, + 0.3478866536170244, + 1.4421638119965792, + 0.41951149702072144, + 0.9946712739765644, + 1.9892454575747252, + 0.4305744282901287, + 0.21272407472133636, + 1.1597001496702433, + 0.6267257761210203, + 1.4747270457446575, + 3.8850207328796387, + 1.7894873544573784, + 0.8035775870084763, + 0.2518024183809757, + 0.49559707194566727, + 2.589239524677396, + 0.949173104017973, + 1.1143289506435394, + 0.2556125707924366, + 2.41449211910367, + 0.5028994120657444, + 0.38125710003077984, + 0.18824084475636482, + 1.5720791518688202, + 1.3176350556313992, + 1.8001948110759258, + 0.13628442771732807, + 0.8239487372338772, + 1.7830232102423906, + 0.8269321555271745, + 0.7115108203142881, + 1.4400011040270329, + 1.1499348040670156, + 1.3206566758453846, + 0.6191798243671656, + 2.307775504887104, + 0.6405980959534645, + 0.3443944901227951, + 0.6490148231387138, + 2.633096007630229, + 0.6967715751379728, + 0.19373733177781105, + 3.0403668619692326, + 1.8456334918737411, + 5.194263096898794, + 0.7068424560129642, + 1.0874697919934988, + 0.2445789985358715, + 2.48610632494092, + 3.0027453247457743, + 0.6177831217646599, + 0.6997909508645535, + 0.2118965219706297, + 2.265391416847706, + 0.5539772287011147, + 3.7807648796588182, + 0.4177681840956211, + 2.3496012799441814, + 2.3979247622191906, + 1.5688915848731995, + 0.5809244234114885, + 1.588234517723322 + ], + "unique_experts": 64, + "load_cv": 0.6196121697901658, + "normalized_load_entropy": 0.9543243891927902, + "max_load_share": 0.036231884057971016 + } + }, + "s0_x": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "af4603d19f77b4d77de854b5a44affb0ccfae08dca16c5ed49fdf73d567dd911", + "route_weight_sha256": "a15a37ac677bf460c4e912eed1aaa9d066d7c753a301b118e0250300727eed05", + "loads": [ + 5, + 7, + 8, + 26, + 5, + 26, + 30, + 10, + 6, + 20, + 8, + 21, + 29, + 14, + 10, + 7, + 10, + 42, + 15, + 23, + 4, + 39, + 9, + 8, + 3, + 10, + 16, + 9, + 4, + 14, + 20, + 19, + 5, + 15, + 9, + 16, + 13, + 22, + 10, + 7, + 10, + 16, + 17, + 3, + 34, + 28, + 38, + 12, + 7, + 0, + 37, + 29, + 7, + 16, + 4, + 18, + 10, + 34, + 9, + 24, + 26, + 7, + 11, + 25 + ], + "weighted_loads": [ + 0.21854070201516151, + 0.3396698348224163, + 0.3338052723556757, + 1.4642114490270615, + 0.25559309870004654, + 1.0113734193146229, + 2.0943565368652344, + 0.31597351655364037, + 0.24227281473577023, + 1.0330328065901995, + 0.4531554840505123, + 1.399777539074421, + 3.6502139754593372, + 1.2806538101285696, + 0.45673276111483574, + 0.2223871536552906, + 0.5379436872899532, + 2.473190763965249, + 0.5062084086239338, + 1.0274249110370874, + 0.14931457675993443, + 2.325344504788518, + 0.5201343037188053, + 0.332493482157588, + 0.1445240043103695, + 1.0740657709538937, + 1.2750157192349434, + 0.36446314863860607, + 0.13573921844363213, + 0.6619121488183737, + 1.1124820448458195, + 0.8229139298200607, + 0.21836849302053452, + 0.6603997405618429, + 0.9170235171914101, + 1.1329165659844875, + 0.6200219355523586, + 2.192799363285303, + 0.5926967971026897, + 0.3501995801925659, + 0.5740615651011467, + 0.9077525604516268, + 0.6876400094479322, + 0.082838986068964, + 2.412856427952647, + 1.6315012089908123, + 4.939552325755358, + 0.5676014125347137, + 0.4222996085882187, + 0.0, + 2.402556598186493, + 2.2584240064024925, + 0.4647345505654812, + 0.7169731929898262, + 0.20938737876713276, + 1.2721593379974365, + 0.4795013777911663, + 3.4134901873767376, + 0.45876520685851574, + 1.1357115246355534, + 1.7625272646546364, + 0.6675090603530407, + 0.592124979943037, + 1.666542336344719 + ], + "unique_experts": 63, + "load_cv": 0.6584263555793621, + "normalized_load_entropy": 0.9489905272054484, + "max_load_share": 0.04216867469879518 + }, + "full_input": { + "tokens": 191, + "top_k": 6, + "decisions": 1146, + "ordered_route_sha256": "4eea5c43da4786b302bb443127afffb23cf21a496f9a9fd0aa007b6079a7d354", + "route_weight_sha256": "d26926ea8e76a16e1facd08511aa75a2af26233aa6849bdbd8cf4e4c092b0e46", + "loads": [ + 5, + 8, + 9, + 26, + 5, + 26, + 30, + 15, + 6, + 21, + 10, + 22, + 30, + 16, + 12, + 7, + 10, + 46, + 20, + 25, + 6, + 42, + 9, + 8, + 3, + 12, + 16, + 14, + 5, + 15, + 23, + 20, + 5, + 24, + 10, + 17, + 13, + 22, + 10, + 7, + 10, + 25, + 20, + 5, + 41, + 31, + 44, + 16, + 7, + 2, + 40, + 36, + 7, + 17, + 4, + 27, + 10, + 42, + 9, + 36, + 31, + 20, + 11, + 25 + ], + "weighted_loads": [ + 0.21854070201516151, + 0.3871974013745785, + 0.3479699958115816, + 1.4642114490270615, + 0.25559309870004654, + 1.0113734193146229, + 2.0943565368652344, + 0.5295195318758488, + 0.24227281473577023, + 1.0492426306009293, + 0.5510343313217163, + 1.4440714418888092, + 3.6829759255051613, + 1.7844417225569487, + 0.6523502878844738, + 0.2223871536552906, + 0.5379436872899532, + 2.709254080429673, + 0.8468167074024677, + 1.1297021489590406, + 0.22751722671091557, + 2.4430158901959658, + 0.5201343037188053, + 0.332493482157588, + 0.1445240043103695, + 1.1374590620398521, + 1.2750157192349434, + 0.9308663737028837, + 0.18223615363240242, + 0.7036014217883348, + 1.3949578553438187, + 0.8366997679695487, + 0.21836849302053452, + 1.068314215168357, + 0.9468810055404902, + 1.1700520291924477, + 0.6200219355523586, + 2.192799363285303, + 0.5926967971026897, + 0.3501995801925659, + 0.5740615651011467, + 1.8505084197968245, + 0.792956979945302, + 0.1816365011036396, + 2.945469142869115, + 1.8052775412797928, + 5.225239872932434, + 0.7448631748557091, + 0.4222996085882187, + 0.10339391976594925, + 2.5295802392065525, + 2.6141091361641884, + 0.4647345505654812, + 0.7781604006886482, + 0.20938737876713276, + 1.861424844712019, + 0.4795013777911663, + 3.866307631134987, + 0.45876520685851574, + 1.8541838452219963, + 2.083237014710903, + 1.788119412958622, + 0.592124979943037, + 1.666542336344719 + ], + "unique_experts": 64, + "load_cv": 0.6506556658626195, + "normalized_load_entropy": 0.9502770211129686, + "max_load_share": 0.04013961605584642 + } + }, + "s1_x": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "138f947894ad5eeee3cd64fbec9201b3275101dc789926099f099017c0642be7", + "route_weight_sha256": "5917d6fe3d8d64f6b5fe8583c24f7fb5d62da394d5416c31dcdcb71dd5e791ef", + "loads": [ + 6, + 6, + 7, + 27, + 4, + 26, + 30, + 12, + 5, + 21, + 8, + 19, + 29, + 13, + 12, + 7, + 9, + 41, + 15, + 22, + 4, + 39, + 9, + 7, + 3, + 13, + 16, + 8, + 4, + 15, + 19, + 17, + 5, + 13, + 11, + 16, + 12, + 23, + 10, + 8, + 11, + 15, + 16, + 3, + 36, + 27, + 38, + 11, + 8, + 0, + 37, + 29, + 9, + 15, + 4, + 18, + 9, + 33, + 9, + 27, + 27, + 7, + 11, + 25 + ], + "weighted_loads": [ + 0.26896560937166214, + 0.306671179831028, + 0.288802495226264, + 1.4893398024141788, + 0.21734686940908432, + 0.9972798824310303, + 2.107486829161644, + 0.3543587438762188, + 0.2145862989127636, + 1.064522197470069, + 0.4481866583228111, + 1.2777665741741657, + 3.655030269175768, + 1.2149706035852432, + 0.5440143160521984, + 0.22940602153539658, + 0.4866825193166733, + 2.452356005087495, + 0.4999437537044287, + 0.9730316158384085, + 0.1474162247031927, + 2.317102985456586, + 0.5011989437043667, + 0.2919935956597328, + 0.14297904819250107, + 1.1845941226929426, + 1.2830595038831234, + 0.3138338904827833, + 0.1363282296806574, + 0.7288999073207378, + 1.0586077328771353, + 0.7682105842977762, + 0.2209455855190754, + 0.6117516793310642, + 0.9982355833053589, + 1.1444778144359589, + 0.5880890749394894, + 2.2142849639058113, + 0.5901518985629082, + 0.3817587345838547, + 0.6005484014749527, + 0.7679062634706497, + 0.6481608152389526, + 0.0827161855995655, + 2.547228453680873, + 1.6125748790800571, + 4.904362767934799, + 0.513489244505763, + 0.4353938680142164, + 0.0, + 2.440663892775774, + 2.256724888458848, + 0.5205277726054192, + 0.7000946961343288, + 0.20451089553534985, + 1.2230603843927383, + 0.4458061754703522, + 3.4181049317121506, + 0.45615464076399803, + 1.257745647802949, + 1.7843728810548782, + 0.6678241118788719, + 0.5741041153669357, + 1.61646169424057 + ], + "unique_experts": 63, + "load_cv": 0.659405465166044, + "normalized_load_entropy": 0.948834245356525, + "max_load_share": 0.04116465863453815 + }, + "full_input": { + "tokens": 207, + "top_k": 6, + "decisions": 1242, + "ordered_route_sha256": "3366c89a0af05b7ab84766d22444de3c3cfa209d20e545ec99b857ac4a7f4fb3", + "route_weight_sha256": "a0a3eeabc1cde0a4bf0ecfd3f98e05b4fa75678ca443f455ae9bcde2ad73a1c8", + "loads": [ + 7, + 7, + 8, + 27, + 8, + 26, + 30, + 15, + 5, + 22, + 12, + 22, + 33, + 14, + 17, + 7, + 9, + 46, + 19, + 23, + 5, + 40, + 9, + 7, + 4, + 16, + 17, + 26, + 4, + 18, + 29, + 18, + 10, + 30, + 13, + 18, + 15, + 26, + 11, + 8, + 12, + 31, + 18, + 5, + 41, + 33, + 44, + 15, + 16, + 4, + 43, + 43, + 10, + 18, + 4, + 29, + 10, + 41, + 9, + 43, + 37, + 18, + 11, + 26 + ], + "weighted_loads": [ + 0.32353831082582474, + 0.3563125245273113, + 0.3029672186821699, + 1.4893398024141788, + 0.4210546500980854, + 0.9972798824310303, + 2.107486829161644, + 0.4879862926900387, + 0.2145862989127636, + 1.0807320214807987, + 0.6119702607393265, + 1.4473310448229313, + 3.8536687418818474, + 1.6838604360818863, + 0.900581106543541, + 0.22940602153539658, + 0.4866825193166733, + 2.7260604854673147, + 0.822129612788558, + 1.0139098707586527, + 0.1872266884893179, + 2.365718135610223, + 0.5011989437043667, + 0.2919935956597328, + 0.1844664141535759, + 1.5039329398423433, + 1.3249699138104916, + 1.4416796267032623, + 0.1363282296806574, + 0.861955001950264, + 1.86019198410213, + 0.7819964224472642, + 0.7087758965790272, + 1.4666526541113853, + 1.140872610732913, + 1.3089044354856014, + 0.7022816855460405, + 2.3416957333683968, + 0.626393910497427, + 0.3817587345838547, + 0.6432283595204353, + 2.072245292365551, + 0.6939705908298492, + 0.1513389889150858, + 2.9601546619087458, + 1.9351531900465488, + 5.250135704874992, + 0.6947751212865114, + 1.081406021490693, + 0.22034860029816628, + 2.765908446162939, + 3.101062985137105, + 0.5897728055715561, + 0.8415437377989292, + 0.20451089553534985, + 1.9884731844067574, + 0.5190954580903053, + 3.869376454502344, + 0.45615464076399803, + 2.2694731932133436, + 2.484236404299736, + 1.6543232016265392, + 0.5741041153669357, + 1.651940781623125 + ], + "unique_experts": 64, + "load_cv": 0.6249460290823471, + "normalized_load_entropy": 0.9536161748697808, + "max_load_share": 0.037037037037037035 + } + }, + "s0_period": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "1e3c95835ff8312f864437c3d10e0972f893b117503b2310091e94302f2375d5", + "route_weight_sha256": "fde50bc649de4e360e1eb691d672c4ac8dec87cb208fac232ef9abac062349d1", + "loads": [ + 5, + 6, + 10, + 26, + 5, + 25, + 28, + 10, + 7, + 22, + 8, + 19, + 29, + 13, + 10, + 8, + 10, + 42, + 16, + 23, + 4, + 39, + 9, + 8, + 3, + 10, + 16, + 8, + 4, + 15, + 21, + 19, + 5, + 14, + 9, + 16, + 11, + 22, + 10, + 7, + 10, + 16, + 17, + 3, + 35, + 28, + 38, + 13, + 7, + 0, + 38, + 28, + 8, + 13, + 4, + 17, + 10, + 34, + 9, + 26, + 26, + 8, + 11, + 25 + ], + "weighted_loads": [ + 0.2202894203364849, + 0.29574763774871826, + 0.4099509250372648, + 1.443772029131651, + 0.25281456112861633, + 0.9920376036316156, + 2.0544557720422745, + 0.31738873198628426, + 0.28150747530162334, + 1.1092829015105963, + 0.4516121856868267, + 1.321589034050703, + 3.6455070674419403, + 1.222552053630352, + 0.4570615701377392, + 0.2532891556620598, + 0.541155494749546, + 2.46921050734818, + 0.5341182891279459, + 1.0325423646718264, + 0.1492979396134615, + 2.3277024794369936, + 0.5099128261208534, + 0.3349208924919367, + 0.14454114064574242, + 1.0539605468511581, + 1.2747054137289524, + 0.3267977498471737, + 0.1393081657588482, + 0.7093415036797523, + 1.1685826480388641, + 0.8259314205497503, + 0.21826276741921902, + 0.6449591293931007, + 0.9084831885993481, + 1.1474192515015602, + 0.5612176805734634, + 2.1788043305277824, + 0.5999409034848213, + 0.34982072561979294, + 0.5740279443562031, + 0.9858845453709364, + 0.6863381490111351, + 0.083987507969141, + 2.4515163358300924, + 1.6301018074154854, + 4.897259972989559, + 0.5951550826430321, + 0.43292444199323654, + 0.0, + 2.4476020857691765, + 2.2168430890887976, + 0.4951255936175585, + 0.5812443420290947, + 0.21012981608510017, + 1.2300209067761898, + 0.4843367002904415, + 3.4037843141704798, + 0.4551594406366348, + 1.1843181028962135, + 1.7567001804709435, + 0.7086189799010754, + 0.5925102531909943, + 1.6527175456285477 + ], + "unique_experts": 63, + "load_cv": 0.6578381903324896, + "normalized_load_entropy": 0.9493506892450233, + "max_load_share": 0.04216867469879518 + }, + "full_input": { + "tokens": 191, + "top_k": 6, + "decisions": 1146, + "ordered_route_sha256": "9645401fc38c091e21c6ef524858616a2014b1ccf16f5c856bd49e7d5111a9a7", + "route_weight_sha256": "47a25cd32bdd121ba2ff1c17b6bd6541d3c5fb64b439b906b9aa609facaaf3bb", + "loads": [ + 6, + 7, + 11, + 26, + 5, + 25, + 28, + 14, + 7, + 23, + 10, + 20, + 31, + 15, + 12, + 8, + 10, + 45, + 21, + 25, + 6, + 42, + 9, + 8, + 3, + 12, + 16, + 14, + 5, + 16, + 25, + 20, + 5, + 22, + 10, + 17, + 11, + 22, + 10, + 7, + 10, + 26, + 20, + 5, + 41, + 31, + 43, + 16, + 7, + 3, + 41, + 35, + 8, + 14, + 4, + 26, + 10, + 42, + 9, + 38, + 32, + 20, + 11, + 25 + ], + "weighted_loads": [ + 0.2505408599972725, + 0.33155397698283195, + 0.42411564849317074, + 1.443772029131651, + 0.25281456112861633, + 0.9920376036316156, + 2.0544557720422745, + 0.4916881397366524, + 0.28150747530162334, + 1.125492725521326, + 0.5494910329580307, + 1.3658829368650913, + 3.7153013609349728, + 1.726339966058731, + 0.6495269797742367, + 0.2532891556620598, + 0.541155494749546, + 2.6806433480232954, + 0.8747265879064798, + 1.136348394677043, + 0.22750058956444263, + 2.4453738648444414, + 0.5099128261208534, + 0.3349208924919367, + 0.14454114064574242, + 1.1173538379371166, + 1.2747054137289524, + 0.916168961673975, + 0.18580510094761848, + 0.7510307766497135, + 1.5285365283489227, + 0.8397172586992383, + 0.21826276741921902, + 1.0084914043545723, + 0.9383406769484282, + 1.1845547147095203, + 0.5612176805734634, + 2.1788043305277824, + 0.5999409034848213, + 0.34982072561979294, + 0.5740279443562031, + 2.015963329002261, + 0.7916551195085049, + 0.1827850230038166, + 2.9412884917110205, + 1.7765113338828087, + 5.133870739489794, + 0.7357844039797783, + 0.43292444199323654, + 0.15900367125868797, + 2.570578245446086, + 2.611790841445327, + 0.4951255936175585, + 0.6401618085801601, + 0.21012981608510017, + 1.8360500261187553, + 0.4843367002904415, + 3.8719498571008444, + 0.4551594406366348, + 1.8982947170734406, + 2.134279500693083, + 1.7425461262464523, + 0.5925102531909943, + 1.6527175456285477 + ], + "unique_experts": 64, + "load_cv": 0.6468246837755577, + "normalized_load_entropy": 0.951313862187013, + "max_load_share": 0.03926701570680628 + } + }, + "s1_period": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "267077fa8e1d80bd53cd2df79965aedeae30e82fa3ebe2da84a9202c9f99ca9f", + "route_weight_sha256": "6ac65795dc4dd3465cb1a2b2a2444441bf40b63a021c3e93e7ae77c2131efb74", + "loads": [ + 6, + 6, + 8, + 27, + 4, + 25, + 29, + 10, + 5, + 20, + 12, + 20, + 29, + 13, + 11, + 7, + 10, + 43, + 17, + 21, + 5, + 40, + 8, + 8, + 3, + 13, + 16, + 7, + 4, + 17, + 20, + 16, + 5, + 14, + 11, + 16, + 11, + 23, + 9, + 8, + 10, + 15, + 15, + 3, + 37, + 27, + 38, + 12, + 8, + 0, + 37, + 28, + 10, + 12, + 4, + 18, + 9, + 33, + 8, + 27, + 26, + 7, + 10, + 25 + ], + "weighted_loads": [ + 0.26778095215559006, + 0.3050438314676285, + 0.3270223028957844, + 1.4940773528069258, + 0.21692977100610733, + 0.9692173730581999, + 2.1021278854459524, + 0.3125562686473131, + 0.22350890189409256, + 1.0200575813651085, + 0.5978057533502579, + 1.329261526465416, + 3.67547195404768, + 1.2126697562634945, + 0.49394265562295914, + 0.22645439580082893, + 0.5264888890087605, + 2.479208454489708, + 0.5471683498471975, + 0.9308512192219496, + 0.1919111330062151, + 2.3544264752417803, + 0.4677073135972023, + 0.3288576453924179, + 0.13996407017111778, + 1.1623264700174332, + 1.2726628743112087, + 0.2864099219441414, + 0.13702474907040596, + 0.7825048379600048, + 1.1200567204505205, + 0.728927917778492, + 0.21989662759006023, + 0.6715025678277016, + 0.9955439455807209, + 1.1752851270139217, + 0.5485251694917679, + 2.206678930670023, + 0.5629231482744217, + 0.3835491631180048, + 0.5666374899446964, + 0.8184915594756603, + 0.6223991978913546, + 0.08377699926495552, + 2.569457907229662, + 1.5980464220046997, + 4.8730221055448055, + 0.5620831809937954, + 0.43764852173626423, + 0.0, + 2.4447948150336742, + 2.214926226064563, + 0.5575054492801428, + 0.5582804828882217, + 0.20596123859286308, + 1.2085037603974342, + 0.44646255671977997, + 3.410215273499489, + 0.42215682566165924, + 1.214554663747549, + 1.7268591597676277, + 0.6762846149504185, + 0.5435679778456688, + 1.6148929186165333 + ], + "unique_experts": 63, + "load_cv": 0.6635019479413888, + "normalized_load_entropy": 0.9487304584280967, + "max_load_share": 0.04317269076305221 + }, + "full_input": { + "tokens": 207, + "top_k": 6, + "decisions": 1242, + "ordered_route_sha256": "079204e0eed35d38b81fb2b816ad18830895a3d804b01c394c942b35e2f8537b", + "route_weight_sha256": "3ffe9e35ef92959d058af7b37e2ee798f94388c08ca7fc6738c2ddb4463e63b9", + "loads": [ + 7, + 6, + 9, + 28, + 8, + 25, + 29, + 12, + 5, + 21, + 15, + 23, + 33, + 14, + 16, + 7, + 10, + 48, + 21, + 22, + 6, + 41, + 8, + 8, + 4, + 16, + 17, + 25, + 4, + 20, + 31, + 17, + 10, + 30, + 13, + 18, + 14, + 26, + 10, + 8, + 11, + 32, + 17, + 5, + 42, + 33, + 43, + 15, + 16, + 4, + 41, + 43, + 11, + 16, + 4, + 30, + 10, + 41, + 8, + 44, + 37, + 18, + 10, + 26 + ], + "weighted_loads": [ + 0.31936265528202057, + 0.3050438314676285, + 0.3411870263516903, + 1.5492931697517633, + 0.4206375516951084, + 0.9692173730581999, + 2.1021278854459524, + 0.3962013255804777, + 0.22350890189409256, + 1.0362674053758383, + 0.7118511125445366, + 1.4988259971141815, + 3.8741104267537594, + 1.6815595887601376, + 0.8309377878904343, + 0.22645439580082893, + 0.5264888890087605, + 2.8109780699014664, + 0.8693542089313269, + 0.9707587901502848, + 0.23172159679234028, + 2.403041625395417, + 0.4677073135972023, + 0.3288576453924179, + 0.1814514361321926, + 1.4816652871668339, + 1.314573284238577, + 1.4138831812888384, + 0.13702474907040596, + 0.915559932589531, + 2.01720161549747, + 0.74271375592798, + 0.707726938650012, + 1.4712722450494766, + 1.138180973008275, + 1.3397117480635643, + 0.662717780098319, + 2.3340897001326084, + 0.5991651602089405, + 0.3835491631180048, + 0.6093174479901791, + 2.1871086582541466, + 0.6682089734822512, + 0.1523998025804758, + 2.9793802946805954, + 1.893990732729435, + 5.153662610799074, + 0.6965145617723465, + 1.083660675212741, + 0.21982161700725555, + 2.6939752250909805, + 3.1396758388727903, + 0.6267504822462797, + 0.7344798259437084, + 0.20596123859286308, + 2.0311689116060734, + 0.5197518393397331, + 3.941107712686062, + 0.42215682566165924, + 2.24382546171546, + 2.4673190116882324, + 1.6259995624423027, + 0.5435679778456688, + 1.6503720059990883 + ], + "unique_experts": 64, + "load_cv": 0.631681382989702, + "normalized_load_entropy": 0.9528708404293764, + "max_load_share": 0.03864734299516908 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 166, + "ordered_topk_exact_tokens": 118, + "set_exact_tokens": 136, + "mean_set_jaccard": 0.9470740103270224, + "mean_token_weighted_tv": 0.011129650298550904, + "aggregate_load_tv": 0.023092369477911635 + }, + "system_bos": { + "tokens": 166, + "ordered_topk_exact_tokens": 106, + "set_exact_tokens": 129, + "mean_set_jaccard": 0.93631669535284, + "mean_token_weighted_tv": 0.014030507171010396, + "aggregate_load_tv": 0.022088353413654616 + }, + "system_x": { + "tokens": 166, + "ordered_topk_exact_tokens": 95, + "set_exact_tokens": 114, + "mean_set_jaccard": 0.9066265060240963, + "mean_token_weighted_tv": 0.01876848566357091, + "aggregate_load_tv": 0.0251004016064257 + }, + "system_period": { + "tokens": 166, + "ordered_topk_exact_tokens": 97, + "set_exact_tokens": 118, + "mean_set_jaccard": 0.9160929432013768, + "mean_token_weighted_tv": 0.017355259631322808, + "aggregate_load_tv": 0.02911646586345382 + }, + "bos_at_s0": { + "tokens": 166, + "ordered_topk_exact_tokens": 97, + "set_exact_tokens": 122, + "mean_set_jaccard": 0.9216867469879518, + "mean_token_weighted_tv": 0.01704699725069734, + "aggregate_load_tv": 0.02610441767068273 + }, + "bos_at_s1": { + "tokens": 166, + "ordered_topk_exact_tokens": 88, + "set_exact_tokens": 111, + "mean_set_jaccard": 0.9027538726333907, + "mean_token_weighted_tv": 0.020731305338846272, + "aggregate_load_tv": 0.02911646586345381 + }, + "x_at_s0": { + "tokens": 166, + "ordered_topk_exact_tokens": 98, + "set_exact_tokens": 120, + "mean_set_jaccard": 0.9169535283993115, + "mean_token_weighted_tv": 0.018546964406563216, + "aggregate_load_tv": 0.03212851405622489 + }, + "x_at_s1": { + "tokens": 166, + "ordered_topk_exact_tokens": 75, + "set_exact_tokens": 96, + "mean_set_jaccard": 0.8707687894434881, + "mean_token_weighted_tv": 0.026277010946209173, + "aggregate_load_tv": 0.0321285140562249 + }, + "period_at_s0": { + "tokens": 166, + "ordered_topk_exact_tokens": 93, + "set_exact_tokens": 113, + "mean_set_jaccard": 0.9074870912220311, + "mean_token_weighted_tv": 0.01944386946172061, + "aggregate_load_tv": 0.030120481927710843 + }, + "period_at_s1": { + "tokens": 166, + "ordered_topk_exact_tokens": 75, + "set_exact_tokens": 102, + "mean_set_jaccard": 0.8823866896156053, + "mean_token_weighted_tv": 0.024935544653604907, + "aggregate_load_tv": 0.03012048192771084 + } + } + }, + "layer_11": { + "layer": 11, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "79e8f24247d6a13d13fb336b32acf9ac87721e888a084aab6dbf72f37f443e4c", + "route_weight_sha256": "e07c496f7af12b15eecf2474d129d1f3dd2b184b2c98508f8b47b4b78b581142", + "loads": [ + 7, + 8, + 5, + 11, + 21, + 32, + 14, + 11, + 21, + 3, + 23, + 14, + 27, + 12, + 13, + 14, + 18, + 16, + 20, + 6, + 12, + 3, + 18, + 35, + 19, + 8, + 14, + 8, + 18, + 6, + 43, + 55, + 9, + 13, + 38, + 24, + 5, + 13, + 4, + 10, + 20, + 20, + 8, + 31, + 36, + 14, + 11, + 24, + 0, + 7, + 7, + 9, + 11, + 2, + 11, + 1, + 4, + 15, + 27, + 13, + 10, + 19, + 4, + 41 + ], + "weighted_loads": [ + 0.3683219887316227, + 0.37613778933882713, + 0.19868933223187923, + 0.4510631822049618, + 1.8775243908166885, + 2.120361428707838, + 1.1044623218476772, + 0.5526412799954414, + 1.245627835392952, + 0.12406181544065475, + 1.4170534517616034, + 0.49803415685892105, + 2.0113776456564665, + 0.7203820571303368, + 0.6543632112443447, + 0.6066195070743561, + 0.9841295853257179, + 0.642615232616663, + 0.84607127122581, + 0.3338208384811878, + 0.6841885820031166, + 0.273630253970623, + 0.9144980553537607, + 3.3803099431097507, + 0.9914661161601543, + 0.4745566248893738, + 0.552740603685379, + 0.2880569361150265, + 1.3198113441467285, + 0.2402346432209015, + 3.6079607605934143, + 3.4258031565696, + 0.43454501777887344, + 0.5076739154756069, + 1.913607444614172, + 1.935309026390314, + 0.3286728151142597, + 0.9874978549778461, + 0.2071036361157894, + 0.48809530586004257, + 0.9072986580431461, + 0.7845177371054888, + 0.5325606688857079, + 1.972718195989728, + 2.1021952889859676, + 1.080192744731903, + 0.5719924475997686, + 1.426525741815567, + 0.0, + 0.4465515539050102, + 0.34809206426143646, + 0.7541932370513678, + 0.5368510819971561, + 0.1015491895377636, + 0.5009339414536953, + 0.044707730412483215, + 0.17051882669329643, + 0.9196139052510262, + 1.6215462945401669, + 0.5005969852209091, + 0.6022223718464375, + 0.7510963622480631, + 0.1733805350959301, + 2.9031151570379734 + ], + "unique_experts": 63, + "load_cv": 0.7142612902989374, + "normalized_load_entropy": 0.9426424271058401, + "max_load_share": 0.055220883534136546 + }, + "full_input": { + "tokens": 191, + "top_k": 6, + "decisions": 1146, + "ordered_route_sha256": "70511fb4418b06c57da34d45cb458e7a8755ae90bf9d68f47b4a91208917dc84", + "route_weight_sha256": "4802b7d4c2f822eaab7881a70a68102ae08dcea3857d80838a8cad338392de05", + "loads": [ + 7, + 9, + 6, + 11, + 26, + 32, + 14, + 11, + 26, + 5, + 26, + 17, + 27, + 12, + 13, + 20, + 23, + 18, + 31, + 6, + 12, + 3, + 19, + 40, + 19, + 8, + 15, + 10, + 25, + 6, + 49, + 62, + 11, + 13, + 42, + 26, + 5, + 13, + 4, + 10, + 29, + 20, + 8, + 54, + 39, + 14, + 11, + 32, + 0, + 8, + 7, + 10, + 11, + 2, + 16, + 3, + 4, + 15, + 30, + 13, + 10, + 24, + 13, + 41 + ], + "weighted_loads": [ + 0.3683219887316227, + 0.4100976884365082, + 0.25740800611674786, + 0.4510631822049618, + 2.1139927580952644, + 2.120361428707838, + 1.1044623218476772, + 0.5526412799954414, + 1.5111823230981827, + 0.18254131264984608, + 1.488455107435584, + 0.5519422814249992, + 2.0113776456564665, + 0.7203820571303368, + 0.6543632112443447, + 0.8380962666124105, + 1.5344313904643059, + 0.672462061047554, + 2.873138105496764, + 0.3338208384811878, + 0.6841885820031166, + 0.273630253970623, + 0.9184108828194439, + 3.626093629747629, + 0.9914661161601543, + 0.4745566248893738, + 0.5560840186662972, + 0.3331455662846565, + 1.797997858375311, + 0.2402346432209015, + 3.894593557342887, + 3.746694954112172, + 0.5013296753168106, + 0.5076739154756069, + 2.0907890051603317, + 2.05140208825469, + 0.3286728151142597, + 0.9874978549778461, + 0.2071036361157894, + 0.48809530586004257, + 1.3873135037720203, + 0.7845177371054888, + 0.5325606688857079, + 4.330974446609616, + 2.25891138240695, + 1.080192744731903, + 0.5719924475997686, + 1.9929444640874863, + 0.0, + 0.5035311505198479, + 0.34809206426143646, + 0.7839574404060841, + 0.5368510819971561, + 0.1015491895377636, + 0.775529838167131, + 0.12845657020807266, + 0.17051882669329643, + 0.9196139052510262, + 1.7535694018006325, + 0.5005969852209091, + 0.6022223718464375, + 0.9824226405471563, + 0.6984922960400581, + 2.9031151570379734 + ], + "unique_experts": 63, + "load_cv": 0.7345926839501212, + "normalized_load_entropy": 0.9399907899485648, + "max_load_share": 0.05410122164048865 + } + }, + "s1_eos": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "63660601a2a4dae4748e794194c520938e8a3d6be92c6ffc70caa7d2120b3d4c", + "route_weight_sha256": "c4358f7e1be0a354f1ddcd0b7da6339f60577630d2471acea2fbea6f055998f2", + "loads": [ + 7, + 7, + 5, + 12, + 21, + 32, + 14, + 11, + 22, + 3, + 20, + 14, + 28, + 12, + 12, + 14, + 18, + 16, + 19, + 6, + 13, + 3, + 20, + 35, + 21, + 8, + 14, + 7, + 18, + 7, + 43, + 54, + 8, + 13, + 37, + 24, + 5, + 13, + 4, + 10, + 22, + 20, + 8, + 29, + 36, + 14, + 9, + 24, + 0, + 7, + 7, + 9, + 11, + 2, + 11, + 2, + 4, + 15, + 30, + 13, + 11, + 17, + 4, + 41 + ], + "weighted_loads": [ + 0.36290666088461876, + 0.34092288836836815, + 0.19970771856606007, + 0.4887911453843117, + 1.8552241493016481, + 2.1060707978904247, + 1.101497571915388, + 0.5524631924927235, + 1.2660655602812767, + 0.12083479762077332, + 1.303692126646638, + 0.49147871881723404, + 2.042822692543268, + 0.7259833253920078, + 0.6222812347114086, + 0.608771339058876, + 0.9717179927974939, + 0.638515867292881, + 0.8048993051052094, + 0.3278472274541855, + 0.7134544048458338, + 0.2722446098923683, + 0.9851436354219913, + 3.386084370315075, + 1.050310391932726, + 0.48153897374868393, + 0.5521202925592661, + 0.2546975500881672, + 1.2935523744672537, + 0.2763861399143934, + 3.594529002904892, + 3.35519490391016, + 0.39889363572001457, + 0.5079465992748737, + 1.8387567792087793, + 1.8779091238975525, + 0.3212028332054615, + 1.0126298554241657, + 0.2031909078359604, + 0.4907217286527157, + 0.949080727994442, + 0.8003485538065434, + 0.5331244021654129, + 1.8592977561056614, + 2.08599816262722, + 1.0829316210001707, + 0.5236060433089733, + 1.3760988600552082, + 0.0, + 0.44688110053539276, + 0.34776241332292557, + 0.7501066531985998, + 0.533504182472825, + 0.1009225882589817, + 0.518965095281601, + 0.09042555466294289, + 0.16718143597245216, + 0.9065067805349827, + 1.7193636018782854, + 0.5059548523277044, + 0.632767092436552, + 0.681324603036046, + 0.1708032563328743, + 2.909756373614073 + ], + "unique_experts": 63, + "load_cv": 0.7114557297081747, + "normalized_load_entropy": 0.9430524630729783, + "max_load_share": 0.05421686746987952 + }, + "full_input": { + "tokens": 207, + "top_k": 6, + "decisions": 1242, + "ordered_route_sha256": "ca59b5dd6d599e1bf7126f6434e126552634b103e8ca0cdbb1abe973cafe5007", + "route_weight_sha256": "6997d2dc0e8b7c1a96668976c9f4eb2faa458ad43d55addb20605696aa785c4c", + "loads": [ + 9, + 8, + 6, + 12, + 32, + 35, + 14, + 13, + 32, + 3, + 26, + 17, + 28, + 12, + 12, + 15, + 36, + 18, + 30, + 7, + 14, + 4, + 23, + 40, + 21, + 8, + 17, + 10, + 29, + 7, + 51, + 61, + 9, + 13, + 41, + 28, + 5, + 13, + 4, + 11, + 30, + 20, + 8, + 56, + 38, + 14, + 10, + 38, + 0, + 10, + 7, + 9, + 11, + 7, + 33, + 9, + 10, + 16, + 32, + 17, + 12, + 25, + 14, + 42 + ], + "weighted_loads": [ + 0.5112700201570988, + 0.373440220952034, + 0.24886582605540752, + 0.4887911453843117, + 2.434336209669709, + 2.212929129600525, + 1.101497571915388, + 0.6824540235102177, + 1.840753298252821, + 0.12083479762077332, + 1.4987167185172439, + 0.5446509681642056, + 2.042822692543268, + 0.7259833253920078, + 0.6222812347114086, + 0.6477206125855446, + 2.620172528550029, + 0.6675680410116911, + 2.8577715903520584, + 0.3663334660232067, + 0.7859777007251978, + 0.34470275044441223, + 1.1008844398893416, + 3.6078203581273556, + 1.050310391932726, + 0.48153897374868393, + 0.6308101473841816, + 0.3389761261641979, + 2.0889616552740335, + 0.2763861399143934, + 4.003936043009162, + 3.6577861830592155, + 0.4315048158168793, + 0.5079465992748737, + 2.042851997539401, + 2.2031349148601294, + 0.3212028332054615, + 1.0126298554241657, + 0.2031909078359604, + 0.5374596752226353, + 1.3559868037700653, + 0.8003485538065434, + 0.5331244021654129, + 4.473311252892017, + 2.218927077949047, + 1.0829316210001707, + 0.569695670157671, + 2.3840488120913506, + 0.0, + 0.6643740423023701, + 0.34776241332292557, + 0.7501066531985998, + 0.533504182472825, + 0.402212455868721, + 1.8045170968398452, + 0.42593617364764214, + 0.6337701790034771, + 0.9495627284049988, + 1.8220585156232119, + 0.6609102375805378, + 0.6707071550190449, + 1.0474185831844807, + 0.7021456770598888, + 2.9512636326253414 + ], + "unique_experts": 63, + "load_cv": 0.7010418487039749, + "normalized_load_entropy": 0.9442759181275608, + "max_load_share": 0.04911433172302738 + } + }, + "s0_bos": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "5c04add5fa59b56d6a2a4765bd528de13eb66b52664fd2f8e4f4496e96ddf09b", + "route_weight_sha256": "190f952afd9a0586a9078c5e2ecfe47b3b09e5b635062582c78276500d8031d1", + "loads": [ + 7, + 8, + 5, + 12, + 21, + 32, + 13, + 12, + 21, + 3, + 23, + 12, + 28, + 13, + 12, + 14, + 17, + 15, + 19, + 6, + 15, + 3, + 17, + 35, + 22, + 8, + 11, + 9, + 19, + 7, + 43, + 53, + 10, + 14, + 39, + 24, + 5, + 13, + 4, + 10, + 22, + 20, + 7, + 30, + 36, + 15, + 11, + 23, + 1, + 6, + 7, + 9, + 13, + 3, + 8, + 0, + 3, + 15, + 29, + 14, + 11, + 15, + 4, + 40 + ], + "weighted_loads": [ + 0.3775629252195358, + 0.37690094113349915, + 0.21017558872699738, + 0.49530645087361336, + 1.894398681819439, + 2.1179143749177456, + 1.0979057475924492, + 0.6058408617973328, + 1.266405738890171, + 0.11920823529362679, + 1.4162961579859257, + 0.4384968262165785, + 1.9984134137630463, + 0.7769446112215519, + 0.6034851111471653, + 0.6191567238420248, + 1.0025741308927536, + 0.6136041339486837, + 0.7957278452813625, + 0.33206895366311073, + 0.8225726056843996, + 0.28780876845121384, + 0.892207195982337, + 3.390912029892206, + 1.0868544317781925, + 0.4765121601521969, + 0.445475609973073, + 0.32297708839178085, + 1.4016014225780964, + 0.2813984453678131, + 3.671637300401926, + 3.3930388428270817, + 0.4778194911777973, + 0.54124472476542, + 1.9424081798642874, + 1.9639952629804611, + 0.3325280696153641, + 0.9408190809190273, + 0.20513805747032166, + 0.49355085752904415, + 0.9726328924298286, + 0.7964520547538996, + 0.4896537736058235, + 1.969206927344203, + 2.1280409656465054, + 1.1666094735264778, + 0.5863371584564447, + 1.3720253705978394, + 0.039960358291864395, + 0.41090964525938034, + 0.35310693830251694, + 0.7632762473076582, + 0.6052735112607479, + 0.13937028497457504, + 0.3998449072241783, + 0.0, + 0.12347829714417458, + 0.8898955695331097, + 1.7092820331454277, + 0.5284654665738344, + 0.6260001864284277, + 0.6106662191450596, + 0.16154424101114273, + 2.847284635528922 + ], + "unique_experts": 63, + "load_cv": 0.7094579560777887, + "normalized_load_entropy": 0.9429903409293412, + "max_load_share": 0.05321285140562249 + }, + "full_input": { + "tokens": 191, + "top_k": 6, + "decisions": 1146, + "ordered_route_sha256": "a35fe3e4c5f4228c1317e58f50f86bc2273a60ce310fb93255981ad6148a63db", + "route_weight_sha256": "a596db3a747e040872ee6df4183bd1080f33ed0a64a33453b47b336115e87a2e", + "loads": [ + 7, + 9, + 6, + 12, + 25, + 32, + 13, + 12, + 26, + 6, + 25, + 14, + 28, + 13, + 12, + 22, + 22, + 16, + 29, + 6, + 16, + 3, + 17, + 40, + 22, + 8, + 11, + 11, + 25, + 7, + 49, + 61, + 12, + 14, + 43, + 26, + 5, + 13, + 4, + 10, + 32, + 20, + 7, + 54, + 39, + 15, + 11, + 31, + 1, + 7, + 7, + 10, + 13, + 3, + 13, + 2, + 3, + 15, + 32, + 14, + 11, + 21, + 13, + 40 + ], + "weighted_loads": [ + 0.3775629252195358, + 0.4108608402311802, + 0.268894262611866, + 0.49530645087361336, + 2.090814672410488, + 2.1179143749177456, + 1.0979057475924492, + 0.6058408617973328, + 1.5267079435288906, + 0.2135662343353033, + 1.4826112100854516, + 0.4803768265992403, + 1.9984134137630463, + 0.7769446112215519, + 0.6034851111471653, + 0.9240848384797573, + 1.5885107107460499, + 0.6284441938623786, + 1.9262652434408665, + 0.33206895366311073, + 0.8599014449864626, + 0.28780876845121384, + 0.892207195982337, + 3.6366957165300846, + 1.0868544317781925, + 0.4765121601521969, + 0.445475609973073, + 0.38268933072686195, + 1.8376249372959137, + 0.2813984453678131, + 3.9582700971513987, + 3.8125793375074863, + 0.5446041487157345, + 0.54124472476542, + 2.1131561379879713, + 2.0804003849625587, + 0.3325280696153641, + 0.9408190809190273, + 0.20513805747032166, + 0.49355085752904415, + 1.5156008526682854, + 0.7964520547538996, + 0.4896537736058235, + 4.434909218922257, + 2.2847570590674877, + 1.1666094735264778, + 0.5863371584564447, + 1.9329507313668728, + 0.039960358291864395, + 0.467889241874218, + 0.35310693830251694, + 0.7937246486544609, + 0.6052735112607479, + 0.13937028497457504, + 0.6760894944891334, + 0.07930071651935577, + 0.12347829714417458, + 0.8898955695331097, + 1.8413051404058933, + 0.5284654665738344, + 0.6260001864284277, + 0.8909110203385353, + 0.7020578533411026, + 2.847284635528922 + ], + "unique_experts": 64, + "load_cv": 0.7304681320684073, + "normalized_load_entropy": 0.9411414010011117, + "max_load_share": 0.053228621291448515 + } + }, + "s1_bos": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "bb39fe6559a782df65cda78713f4193f4ad29dd46e6e45a1accc4f861337ecdf", + "route_weight_sha256": "d92deef7ab466c390f16aedc1b17a74c3bcaa75845815107a896b2403b32b661", + "loads": [ + 7, + 7, + 5, + 10, + 20, + 32, + 13, + 11, + 22, + 3, + 23, + 14, + 28, + 13, + 13, + 14, + 15, + 17, + 19, + 6, + 15, + 3, + 18, + 35, + 21, + 8, + 13, + 7, + 20, + 7, + 43, + 52, + 8, + 14, + 40, + 23, + 5, + 13, + 4, + 10, + 22, + 21, + 6, + 31, + 36, + 13, + 11, + 24, + 0, + 7, + 7, + 9, + 15, + 2, + 8, + 1, + 4, + 14, + 27, + 18, + 9, + 14, + 4, + 42 + ], + "weighted_loads": [ + 0.3803682513535023, + 0.33826133608818054, + 0.20897244848310947, + 0.4096331261098385, + 1.8474897053092718, + 2.1091143675148487, + 1.091369368135929, + 0.5684624500572681, + 1.2857543677091599, + 0.11000843159854412, + 1.401767797768116, + 0.5001498926430941, + 2.03258341178298, + 0.7764076441526413, + 0.63837905600667, + 0.6245440598577261, + 0.9122909065335989, + 0.6693907417356968, + 0.8030011896044016, + 0.3276085928082466, + 0.8104783948510885, + 0.28928574174642563, + 0.9176982287317514, + 3.413780827075243, + 1.0412169769406319, + 0.48966437205672264, + 0.5293171163648367, + 0.2568974494934082, + 1.4321099296212196, + 0.2886853851377964, + 3.5827422961592674, + 3.348617123439908, + 0.4127103928476572, + 0.546904819086194, + 1.9982342198491096, + 1.845700714737177, + 0.33047405257821083, + 0.9227673672139645, + 0.20106076076626778, + 0.4905105922371149, + 0.9426178373396397, + 0.8509304728358984, + 0.46312570199370384, + 2.0270553417503834, + 2.1146291196346283, + 1.1165889892727137, + 0.5741520933806896, + 1.4125990644097328, + 0.0, + 0.4413205049932003, + 0.35163526982069016, + 0.7565126195549965, + 0.6618695724755526, + 0.10175804048776627, + 0.38802168518304825, + 0.04299897700548172, + 0.16618367284536362, + 0.865044891834259, + 1.651810061186552, + 0.6523761954158545, + 0.5628497488796711, + 0.5860993377864361, + 0.1683339588344097, + 2.9849167987704277 + ], + "unique_experts": 63, + "load_cv": 0.7170558739069184, + "normalized_load_entropy": 0.9415355421500766, + "max_load_share": 0.05220883534136546 + }, + "full_input": { + "tokens": 207, + "top_k": 6, + "decisions": 1242, + "ordered_route_sha256": "524df586142b32669c23ea112e648424d91f97bf856235ff549ad1187cce385f", + "route_weight_sha256": "5203604cf693b9e383f3d5f6f46e12bd5ffb9d1adc9da173895c7cff8aa2350d", + "loads": [ + 9, + 8, + 6, + 10, + 31, + 35, + 13, + 13, + 32, + 4, + 27, + 16, + 28, + 13, + 13, + 16, + 33, + 18, + 29, + 7, + 17, + 4, + 20, + 40, + 21, + 8, + 15, + 9, + 30, + 7, + 51, + 59, + 9, + 14, + 44, + 26, + 5, + 13, + 4, + 11, + 31, + 21, + 6, + 59, + 38, + 13, + 12, + 39, + 0, + 10, + 7, + 10, + 15, + 7, + 29, + 8, + 10, + 15, + 29, + 22, + 11, + 24, + 15, + 43 + ], + "weighted_loads": [ + 0.5287316106259823, + 0.3707786686718464, + 0.25813055597245693, + 0.4096331261098385, + 2.426601765677333, + 2.215972699224949, + 1.091369368135929, + 0.6984532810747623, + 1.8668085485696793, + 0.14417138136923313, + 1.5486320639029145, + 0.5419174805283546, + 2.03258341178298, + 0.7764076441526413, + 0.63837905600667, + 0.6949341837316751, + 2.609087700024247, + 0.6842308016493917, + 1.9577390644699335, + 0.36609483137726784, + 0.9240471292287111, + 0.36174388229846954, + 1.0296657364815474, + 3.6355168148875237, + 1.0412169769406319, + 0.48966437205672264, + 0.6048407573252916, + 0.3081152178347111, + 2.1691458970308304, + 0.2886853851377964, + 3.9921493362635374, + 3.6512084025889635, + 0.4453215729445219, + 0.546904819086194, + 2.1949524395167828, + 2.143350277096033, + 0.33047405257821083, + 0.9227673672139645, + 0.20106076076626778, + 0.5372485388070345, + 1.4317394085228443, + 0.8509304728358984, + 0.46312570199370384, + 4.934610731899738, + 2.2475580349564552, + 1.1165889892727137, + 0.6202417202293873, + 2.4447092041373253, + 0.0, + 0.6588134467601776, + 0.35163526982069016, + 0.7863687928766012, + 0.6618695724755526, + 0.40304790809750557, + 1.642513989470899, + 0.37850959599018097, + 0.6327724158763885, + 0.9081008397042751, + 1.7545049749314785, + 0.8073315806686878, + 0.6375687681138515, + 1.0363275241106749, + 0.7341570779681206, + 3.0264240577816963 + ], + "unique_experts": 63, + "load_cv": 0.7003312993771086, + "normalized_load_entropy": 0.944636172844781, + "max_load_share": 0.04750402576489533 + } + }, + "s0_x": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "07cddb896527c006850d77b332aab479dac7ed58d39428f53fcbcb0ffe796384", + "route_weight_sha256": "00bbe8aee3ed511ca5ef111fe855b93e030af7d7c0b2eafaf150ab56564e7bc2", + "loads": [ + 7, + 6, + 5, + 10, + 22, + 32, + 13, + 13, + 24, + 3, + 23, + 13, + 28, + 13, + 13, + 14, + 17, + 15, + 19, + 6, + 13, + 3, + 18, + 35, + 21, + 7, + 10, + 7, + 19, + 8, + 43, + 54, + 10, + 12, + 36, + 24, + 5, + 13, + 4, + 10, + 17, + 22, + 8, + 29, + 36, + 14, + 11, + 24, + 1, + 6, + 7, + 10, + 13, + 3, + 10, + 1, + 4, + 16, + 29, + 14, + 12, + 14, + 3, + 44 + ], + "weighted_loads": [ + 0.3705601990222931, + 0.30683086439967155, + 0.2103370912373066, + 0.40881430730223656, + 1.9312059599906206, + 2.1152899116277695, + 1.0954147540032864, + 0.6628509126603603, + 1.3829057291150093, + 0.11633586883544922, + 1.4111492037773132, + 0.47724637389183044, + 1.9715038929134607, + 0.783267181366682, + 0.6441188603639603, + 0.617009412497282, + 0.9808095749467611, + 0.5918784607201815, + 0.8086231984198093, + 0.3370080068707466, + 0.7589151747524738, + 0.29635532200336456, + 0.9084620699286461, + 3.3918943479657173, + 1.0608988087624311, + 0.45758116990327835, + 0.3949225675314665, + 0.25302841141819954, + 1.3965049348771572, + 0.30056672543287277, + 3.7034819535911083, + 3.416661651805043, + 0.4674101285636425, + 0.4827083609998226, + 1.861308604478836, + 1.9892172738909721, + 0.3411806523799896, + 0.8954949378967285, + 0.20409546792507172, + 0.49840822257101536, + 0.751416090875864, + 0.8787933476269245, + 0.525336142629385, + 1.867594888433814, + 2.117388751357794, + 1.1204353589564562, + 0.58488829433918, + 1.4419855289161205, + 0.02742783911526203, + 0.3996095694601536, + 0.3457826338708401, + 0.7974334731698036, + 0.6022056508809328, + 0.13797691836953163, + 0.49327195063233376, + 0.036296650767326355, + 0.16894356161355972, + 0.9232335984706879, + 1.7046192735433578, + 0.5218257773667574, + 0.6679288987070322, + 0.5885674171149731, + 0.12604112550616264, + 3.0646761022508144 + ], + "unique_experts": 64, + "load_cv": 0.717325739699345, + "normalized_load_entropy": 0.9428070909438003, + "max_load_share": 0.05421686746987952 + }, + "full_input": { + "tokens": 191, + "top_k": 6, + "decisions": 1146, + "ordered_route_sha256": "a20933e0973bf30c40d6a7fbfacda4c8a702c0174e95d4ce94cc6bc278cc09be", + "route_weight_sha256": "11d974de50b39e6d13756e2267470629d237f0b01c193a945b82bb29a06f7778", + "loads": [ + 7, + 7, + 6, + 10, + 27, + 32, + 13, + 13, + 29, + 5, + 25, + 15, + 28, + 13, + 13, + 20, + 21, + 17, + 30, + 6, + 14, + 3, + 18, + 40, + 21, + 7, + 10, + 8, + 26, + 8, + 49, + 63, + 12, + 12, + 41, + 25, + 5, + 13, + 4, + 10, + 25, + 22, + 8, + 52, + 39, + 14, + 11, + 32, + 1, + 9, + 7, + 11, + 13, + 4, + 15, + 2, + 4, + 16, + 33, + 14, + 13, + 19, + 12, + 44 + ], + "weighted_loads": [ + 0.3705601990222931, + 0.3407907634973526, + 0.2690557651221752, + 0.40881430730223656, + 2.165379771962762, + 2.1152899116277695, + 1.0954147540032864, + 0.6628509126603603, + 1.643772341310978, + 0.17481536604464054, + 1.4774642558768392, + 0.5191263742744923, + 1.9715038929134607, + 0.783267181366682, + 0.6441188603639603, + 0.8484861720353365, + 1.4771289099007845, + 0.6416514730080962, + 2.0299910865724087, + 0.3370080068707466, + 0.8008645698428154, + 0.29635532200336456, + 0.9084620699286461, + 3.6376780346035957, + 1.0608988087624311, + 0.45758116990327835, + 0.3949225675314665, + 0.2656235583126545, + 1.9035743400454521, + 0.30056672543287277, + 3.990114750340581, + 3.8958576265722513, + 0.5341947861015797, + 0.4827083609998226, + 2.1462841108441353, + 2.067688249051571, + 0.3411806523799896, + 0.8954949378967285, + 0.20409546792507172, + 0.49840822257101536, + 1.1356126330792904, + 0.8787933476269245, + 0.525336142629385, + 4.055180227383971, + 2.274104844778776, + 1.1204353589564562, + 0.58488829433918, + 2.0134460143744946, + 0.02742783911526203, + 0.5479925014078617, + 0.3457826338708401, + 0.8311808295547962, + 0.6022056508809328, + 0.190781120210886, + 0.7591237602755427, + 0.07257607206702232, + 0.16894356161355972, + 0.9232335984706879, + 1.896105695515871, + 0.5218257773667574, + 0.7016000431030989, + 0.8285379447042942, + 0.6172221377491951, + 3.0646761022508144 + ], + "unique_experts": 64, + "load_cv": 0.7347253485102742, + "normalized_load_entropy": 0.9409505362299775, + "max_load_share": 0.0549738219895288 + } + }, + "s1_x": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "ad24644de2adcc73df376e782bcceaf8e5c1cb045381b93cc5a600181bdd0967", + "route_weight_sha256": "e1186ea3732e6db367a222f57562419dfa7445df418e0eb7075be18316a239fe", + "loads": [ + 6, + 9, + 5, + 10, + 22, + 31, + 15, + 13, + 24, + 4, + 23, + 15, + 28, + 13, + 12, + 14, + 18, + 13, + 19, + 6, + 13, + 3, + 18, + 35, + 23, + 11, + 13, + 8, + 19, + 8, + 43, + 53, + 9, + 14, + 38, + 23, + 4, + 13, + 4, + 10, + 15, + 18, + 6, + 29, + 36, + 15, + 10, + 24, + 0, + 7, + 7, + 9, + 14, + 3, + 9, + 0, + 4, + 18, + 29, + 12, + 9, + 13, + 3, + 44 + ], + "weighted_loads": [ + 0.34088873490691185, + 0.4164103791117668, + 0.21169794164597988, + 0.4081948697566986, + 1.9344077035784721, + 2.086881048977375, + 1.1688368916511536, + 0.6586092561483383, + 1.4073024466633797, + 0.16498670354485512, + 1.417980384081602, + 0.5367072336375713, + 1.998973747715354, + 0.8015710823237896, + 0.6162781491875648, + 0.6377703603357077, + 0.991712536662817, + 0.49308608658611774, + 0.808573791757226, + 0.3338213860988617, + 0.7439408581703901, + 0.2943205237388611, + 0.8878014702349901, + 3.4339795224368572, + 1.151486774906516, + 0.6193428598344326, + 0.5363132655620575, + 0.29189150780439377, + 1.3792610801756382, + 0.3164020888507366, + 3.5903351567685604, + 3.3822255544364452, + 0.43330243043601513, + 0.5474679619073868, + 1.8799904622137547, + 1.8556626960635185, + 0.2807329557836056, + 0.8977254815399647, + 0.20303142815828323, + 0.5023604929447174, + 0.661148376762867, + 0.7443932984024286, + 0.44770776107907295, + 1.7632512599229813, + 2.1114889346063137, + 1.1983899883925915, + 0.5537381879985332, + 1.4665680676698685, + 0.0, + 0.43886207044124603, + 0.35116853192448616, + 0.760206937789917, + 0.6410615555942059, + 0.14012987539172173, + 0.43981434404850006, + 0.0, + 0.16586507856845856, + 0.9986818209290504, + 1.7145731449127197, + 0.45880036801099777, + 0.5606010481715202, + 0.5270514953881502, + 0.12538810446858406, + 3.109917737543583 + ], + "unique_experts": 62, + "load_cv": 0.7166958947815203, + "normalized_load_entropy": 0.9415816276079768, + "max_load_share": 0.05321285140562249 + }, + "full_input": { + "tokens": 207, + "top_k": 6, + "decisions": 1242, + "ordered_route_sha256": "39cee0bf3e67e0b9b06c0526d40200b83aeac88b7da5d015153aab0743c96949", + "route_weight_sha256": "f0f7bab2c918678f86ebbb6654ff7162be82b40a6774f920be6a78f298221676", + "loads": [ + 8, + 10, + 6, + 10, + 33, + 34, + 15, + 15, + 34, + 5, + 26, + 17, + 28, + 13, + 12, + 15, + 36, + 14, + 30, + 7, + 14, + 4, + 20, + 40, + 23, + 11, + 15, + 11, + 30, + 8, + 51, + 61, + 10, + 14, + 44, + 26, + 4, + 13, + 4, + 11, + 20, + 18, + 6, + 56, + 38, + 15, + 11, + 37, + 0, + 12, + 7, + 9, + 14, + 9, + 32, + 8, + 10, + 19, + 32, + 16, + 12, + 21, + 13, + 45 + ], + "weighted_loads": [ + 0.48925209417939186, + 0.44892771169543266, + 0.26085604913532734, + 0.4081948697566986, + 2.513519763946533, + 2.193739380687475, + 1.1688368916511536, + 0.7886000871658325, + 1.991082925349474, + 0.20232507959008217, + 1.5288236113265157, + 0.5784748215228319, + 1.998973747715354, + 0.8015710823237896, + 0.6162781491875648, + 0.6767196338623762, + 2.6201289407908916, + 0.5079261464998126, + 2.0413588527590036, + 0.3723076246678829, + 0.8164641540497541, + 0.366778664290905, + 0.999768977984786, + 3.655715510249138, + 1.151486774906516, + 0.6193428598344326, + 0.6118369065225124, + 0.3872964084148407, + 2.218304380774498, + 0.3164020888507366, + 3.9997421968728304, + 3.7347600385546684, + 0.46591361053287983, + 0.5474679619073868, + 2.188755352050066, + 2.1533122584223747, + 0.2807329557836056, + 0.8977254815399647, + 0.20303142815828323, + 0.549098439514637, + 0.9030091725289822, + 0.7443932984024286, + 0.44770776107907295, + 4.1746371909976006, + 2.2444178499281406, + 1.1983899883925915, + 0.5998278148472309, + 2.4131204932928085, + 0.0, + 0.7413355074822903, + 0.35116853192448616, + 0.760206937789917, + 0.6410615555942059, + 0.4914226308465004, + 1.7612894242629409, + 0.38322269171476364, + 0.6324538215994835, + 1.0417377687990665, + 1.864458505064249, + 0.6137557532638311, + 0.6729648150503635, + 0.9005896784365177, + 0.6730748489499092, + 3.1514249965548515 + ], + "unique_experts": 63, + "load_cv": 0.69789813081957, + "normalized_load_entropy": 0.9456634312186616, + "max_load_share": 0.04911433172302738 + } + }, + "s0_period": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "2fb6ea7ed4980f7c71b63db2e909a47e1feea2199319e7ece4209acc8d5d63c6", + "route_weight_sha256": "dfd45924f4da889cd3f9b99a3587caa315f881a6a520c0cd65775f38b4298b06", + "loads": [ + 7, + 7, + 5, + 11, + 22, + 31, + 14, + 13, + 24, + 2, + 22, + 12, + 28, + 13, + 13, + 14, + 15, + 14, + 19, + 6, + 15, + 3, + 19, + 35, + 21, + 8, + 11, + 8, + 19, + 8, + 43, + 54, + 10, + 13, + 39, + 24, + 5, + 13, + 4, + 10, + 17, + 19, + 8, + 30, + 36, + 16, + 11, + 24, + 1, + 6, + 7, + 9, + 13, + 3, + 9, + 0, + 4, + 16, + 30, + 14, + 10, + 13, + 3, + 43 + ], + "weighted_loads": [ + 0.37099942937493324, + 0.3471160866320133, + 0.21209904924035072, + 0.44380560144782066, + 1.9358931686729193, + 2.0695760995149612, + 1.1402507610619068, + 0.6663122177124023, + 1.3755556549876928, + 0.07877276837825775, + 1.397977825254202, + 0.4509468078613281, + 2.003509908914566, + 0.7871307171881199, + 0.6395741403102875, + 0.612933287397027, + 0.9304597321897745, + 0.5674040168523788, + 0.8099726662039757, + 0.33980274572968483, + 0.834350548684597, + 0.29414625465869904, + 0.9474765118211508, + 3.402148712426424, + 1.051534365862608, + 0.4841769319027662, + 0.4359728991985321, + 0.2854251489043236, + 1.4312523566186428, + 0.3058333061635494, + 3.6572386398911476, + 3.40438842587173, + 0.467995960265398, + 0.5169919468462467, + 1.946618977934122, + 1.9703511409461498, + 0.3384886495769024, + 0.9185676015913486, + 0.2084001898765564, + 0.4944521635770798, + 0.7474500797688961, + 0.7798184435814619, + 0.5278918333351612, + 1.89645204693079, + 2.10874605178833, + 1.2059399504214525, + 0.5859922729432583, + 1.4451918974518776, + 0.027780726552009583, + 0.3943016082048416, + 0.3484428860247135, + 0.7783627975732088, + 0.596978759393096, + 0.13918694108724594, + 0.4454371780157089, + 0.0, + 0.1694243773818016, + 0.9155988544225693, + 1.7483475282788277, + 0.5273013468831778, + 0.586226686835289, + 0.5357480421662331, + 0.12538720667362213, + 3.0252062790095806 + ], + "unique_experts": 63, + "load_cv": 0.7210037822989905, + "normalized_load_entropy": 0.9415918208686006, + "max_load_share": 0.05421686746987952 + }, + "full_input": { + "tokens": 191, + "top_k": 6, + "decisions": 1146, + "ordered_route_sha256": "bbf9236fbd29ad6cc6aa36b2824f8f19a857812f995bab11629cb3b0ff3cf058", + "route_weight_sha256": "8629a012282b30d6c4faace4cba8f71fd2896dd97e2a7cbd64eb479484547e70", + "loads": [ + 7, + 8, + 6, + 11, + 28, + 31, + 14, + 13, + 29, + 4, + 25, + 14, + 28, + 13, + 13, + 21, + 20, + 15, + 30, + 6, + 16, + 3, + 19, + 40, + 21, + 8, + 11, + 10, + 27, + 8, + 49, + 63, + 12, + 13, + 43, + 26, + 5, + 13, + 4, + 10, + 25, + 19, + 8, + 54, + 39, + 16, + 11, + 32, + 1, + 8, + 7, + 10, + 13, + 3, + 13, + 2, + 4, + 16, + 33, + 14, + 10, + 18, + 10, + 43 + ], + "weighted_loads": [ + 0.37099942937493324, + 0.38107598572969437, + 0.27081772312521935, + 0.44380560144782066, + 2.2457037661224604, + 2.0695760995149612, + 1.1402507610619068, + 0.6663122177124023, + 1.6389640737324953, + 0.13725226558744907, + 1.4994616666808724, + 0.49282680824398994, + 2.003509908914566, + 0.7871307171881199, + 0.6395741403102875, + 0.8848390094935894, + 1.471970809623599, + 0.5822440767660737, + 1.9817310459911823, + 0.33980274572968483, + 0.8756088316440582, + 0.29414625465869904, + 0.9474765118211508, + 3.6479323990643024, + 1.051534365862608, + 0.4841769319027662, + 0.4359728991985321, + 0.32909357734024525, + 1.977435253560543, + 0.3058333061635494, + 3.9438714366406202, + 3.8924846965819597, + 0.5347806178033352, + 0.5169919468462467, + 2.145951636135578, + 2.201706897467375, + 0.3384886495769024, + 0.9185676015913486, + 0.2084001898765564, + 0.4944521635770798, + 1.1278191581368446, + 0.7798184435814619, + 0.5278918333351612, + 4.167098354548216, + 2.2654621452093124, + 1.2059399504214525, + 0.5859922729432583, + 2.009037312120199, + 0.027780726552009583, + 0.5027736760675907, + 0.3484428860247135, + 0.8143800850957632, + 0.596978759393096, + 0.13918694108724594, + 0.6818108400329947, + 0.07800384610891342, + 0.1694243773818016, + 0.9155988544225693, + 1.8803706355392933, + 0.5273013468831778, + 0.586226686835289, + 0.7801005057990551, + 0.5454988293349743, + 3.0252062790095806 + ], + "unique_experts": 64, + "load_cv": 0.7423136853765784, + "normalized_load_entropy": 0.9398606748766996, + "max_load_share": 0.0549738219895288 + } + }, + "s1_period": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "2af2462b30050bbe5d95d106e4a9ece41bcf049b60461eb242976877f638e233", + "route_weight_sha256": "0b2535c1b182cb910fd0cca0193d0931dbde94880c6b4691ef9f884a1e0fc41b", + "loads": [ + 6, + 6, + 5, + 10, + 22, + 31, + 14, + 13, + 25, + 2, + 24, + 14, + 28, + 13, + 13, + 14, + 18, + 15, + 19, + 6, + 15, + 3, + 18, + 35, + 23, + 10, + 12, + 8, + 20, + 9, + 43, + 53, + 9, + 14, + 36, + 22, + 4, + 13, + 4, + 10, + 16, + 18, + 6, + 29, + 36, + 14, + 10, + 25, + 1, + 7, + 7, + 9, + 12, + 3, + 9, + 1, + 4, + 18, + 30, + 12, + 9, + 14, + 3, + 44 + ], + "weighted_loads": [ + 0.34421292692422867, + 0.300530381500721, + 0.21233130618929863, + 0.40746788680553436, + 1.9628004729747772, + 2.0704577080905437, + 1.138285506516695, + 0.6716284155845642, + 1.40491733700037, + 0.08170340955257416, + 1.459958128631115, + 0.5091816894710064, + 2.014202382415533, + 0.794764019548893, + 0.6346488557755947, + 0.6250917408615351, + 0.9867944214493036, + 0.5577353592962027, + 0.8214553613215685, + 0.3346337340772152, + 0.8299131728708744, + 0.2986823320388794, + 0.8965045381337404, + 3.4218867756426334, + 1.1313265524804592, + 0.6030209194868803, + 0.49529455974698067, + 0.2907615303993225, + 1.4446533545851707, + 0.3482073135674, + 3.5360963083803654, + 3.379971105605364, + 0.4301031082868576, + 0.5467510111629963, + 1.8309775851666927, + 1.8396736718714237, + 0.27996233850717545, + 0.8865244295448065, + 0.20279179513454437, + 0.5032917391508818, + 0.6788777504116297, + 0.7415191065520048, + 0.4499429799616337, + 1.7770018130540848, + 2.1009638719260693, + 1.1762581020593643, + 0.5506081283092499, + 1.4787373095750809, + 0.02624724805355072, + 0.43848787620663643, + 0.3516494669020176, + 0.7650875244289637, + 0.5557472538203001, + 0.1381673626601696, + 0.43709999322891235, + 0.04429124668240547, + 0.16854136064648628, + 1.000608466565609, + 1.733712051063776, + 0.4671538434922695, + 0.5671116076409817, + 0.5572119858115911, + 0.12064627185463905, + 3.11044642329216 + ], + "unique_experts": 64, + "load_cv": 0.7176854029050214, + "normalized_load_entropy": 0.942082545311579, + "max_load_share": 0.05321285140562249 + }, + "full_input": { + "tokens": 207, + "top_k": 6, + "decisions": 1242, + "ordered_route_sha256": "3c706180dbf9f98a1b78258346e55c34c9367d71faef6f223a9c6c61eb53c4c8", + "route_weight_sha256": "9978f67a77c7ff43dd80b1d40e33f02c5e5ca9fc86ee822470d595a0dd819525", + "loads": [ + 8, + 7, + 6, + 10, + 34, + 35, + 14, + 15, + 35, + 2, + 28, + 16, + 28, + 13, + 14, + 16, + 36, + 16, + 29, + 7, + 16, + 4, + 20, + 40, + 23, + 10, + 14, + 11, + 32, + 9, + 51, + 61, + 10, + 14, + 42, + 26, + 4, + 13, + 4, + 11, + 23, + 18, + 6, + 56, + 38, + 14, + 11, + 39, + 1, + 11, + 7, + 9, + 12, + 8, + 31, + 8, + 10, + 19, + 32, + 16, + 10, + 22, + 12, + 45 + ], + "weighted_loads": [ + 0.4925762861967087, + 0.3330477140843868, + 0.2614894136786461, + 0.40746788680553436, + 2.606644757091999, + 2.2204842567443848, + 1.138285506516695, + 0.8016192466020584, + 1.989813681691885, + 0.08170340955257416, + 1.6116200732067227, + 0.550949277356267, + 2.014202382415533, + 0.794764019548893, + 0.6749502010643482, + 0.6962038073688745, + 2.6400869097560644, + 0.5725754192098975, + 1.9761932361871004, + 0.3731199726462364, + 0.9024364687502384, + 0.3711404725909233, + 1.0084720458835363, + 3.643622763454914, + 1.1313265524804592, + 0.6030209194868803, + 0.5708182007074356, + 0.37326523661613464, + 2.3509793654084206, + 0.3482073135674, + 3.9455033484846354, + 3.7213488779962063, + 0.4627142883837223, + 0.5467510111629963, + 2.1234797090291977, + 2.230597395449877, + 0.27996233850717545, + 0.8865244295448065, + 0.20279179513454437, + 0.5500296857208014, + 0.9747800417244434, + 0.7415191065520048, + 0.4499429799616337, + 4.225707590579987, + 2.233892787247896, + 1.1762581020593643, + 0.5966977551579475, + 2.480326469987631, + 0.02624724805355072, + 0.6972885802388191, + 0.3516494669020176, + 0.7650875244289637, + 0.5557472538203001, + 0.4394572302699089, + 1.7137641897425056, + 0.3798018656671047, + 0.6351301036775112, + 1.043664414435625, + 1.8364069648087025, + 0.6221092287451029, + 0.6050516702234745, + 0.9309948310256004, + 0.6085058823227882, + 3.1519536823034286 + ], + "unique_experts": 64, + "load_cv": 0.7071700371495659, + "normalized_load_entropy": 0.9439581653360022, + "max_load_share": 0.04911433172302738 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 166, + "ordered_topk_exact_tokens": 118, + "set_exact_tokens": 138, + "mean_set_jaccard": 0.9518072289156626, + "mean_token_weighted_tv": 0.010770678239683789, + "aggregate_load_tv": 0.01606425702811245 + }, + "system_bos": { + "tokens": 166, + "ordered_topk_exact_tokens": 108, + "set_exact_tokens": 121, + "mean_set_jaccard": 0.9212564543889846, + "mean_token_weighted_tv": 0.015267455456666199, + "aggregate_load_tv": 0.025100401606425703 + }, + "system_x": { + "tokens": 166, + "ordered_topk_exact_tokens": 100, + "set_exact_tokens": 118, + "mean_set_jaccard": 0.9135111876075731, + "mean_token_weighted_tv": 0.01801894662946642, + "aggregate_load_tv": 0.02811244979919679 + }, + "system_period": { + "tokens": 166, + "ordered_topk_exact_tokens": 102, + "set_exact_tokens": 119, + "mean_set_jaccard": 0.917814113597246, + "mean_token_weighted_tv": 0.016868955932602465, + "aggregate_load_tv": 0.024096385542168676 + }, + "bos_at_s0": { + "tokens": 166, + "ordered_topk_exact_tokens": 95, + "set_exact_tokens": 115, + "mean_set_jaccard": 0.902180149168101, + "mean_token_weighted_tv": 0.01898012587980154, + "aggregate_load_tv": 0.027108433734939753 + }, + "bos_at_s1": { + "tokens": 166, + "ordered_topk_exact_tokens": 95, + "set_exact_tokens": 111, + "mean_set_jaccard": 0.8978772231784279, + "mean_token_weighted_tv": 0.020642163641526396, + "aggregate_load_tv": 0.02911646586345382 + }, + "x_at_s0": { + "tokens": 166, + "ordered_topk_exact_tokens": 95, + "set_exact_tokens": 115, + "mean_set_jaccard": 0.9086345381526103, + "mean_token_weighted_tv": 0.01882352440404784, + "aggregate_load_tv": 0.03112449799196787 + }, + "x_at_s1": { + "tokens": 166, + "ordered_topk_exact_tokens": 88, + "set_exact_tokens": 109, + "mean_set_jaccard": 0.8941480206540449, + "mean_token_weighted_tv": 0.022785216379147696, + "aggregate_load_tv": 0.037148594377510044 + }, + "period_at_s0": { + "tokens": 166, + "ordered_topk_exact_tokens": 96, + "set_exact_tokens": 114, + "mean_set_jaccard": 0.90223752151463, + "mean_token_weighted_tv": 0.019888438357332026, + "aggregate_load_tv": 0.0321285140562249 + }, + "period_at_s1": { + "tokens": 166, + "ordered_topk_exact_tokens": 92, + "set_exact_tokens": 109, + "mean_set_jaccard": 0.8931440045897877, + "mean_token_weighted_tv": 0.02279097484761333, + "aggregate_load_tv": 0.03614457831325301 + } + } + }, + "layer_12": { + "layer": 12, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "8f121ad09ea93f276652f408b8bd25032bb2147c5cab8a5c3c091899a9b344cf", + "route_weight_sha256": "6ac8d4dc9dc8f6e9bb70443fbe6f3855258b1cd944e059a0226a0451c181781e", + "loads": [ + 9, + 7, + 19, + 18, + 21, + 11, + 3, + 24, + 21, + 3, + 9, + 7, + 28, + 5, + 11, + 16, + 23, + 13, + 15, + 7, + 11, + 5, + 11, + 37, + 11, + 8, + 8, + 47, + 51, + 26, + 11, + 10, + 20, + 16, + 10, + 6, + 15, + 18, + 23, + 5, + 6, + 19, + 15, + 23, + 11, + 1, + 38, + 21, + 18, + 6, + 11, + 5, + 16, + 5, + 36, + 0, + 10, + 17, + 44, + 17, + 17, + 16, + 18, + 7 + ], + "weighted_loads": [ + 0.46291313506662846, + 0.42321566119790077, + 1.0407731384038925, + 0.610081858932972, + 2.5066530406475067, + 0.46178661845624447, + 0.10546943731606007, + 1.7228437885642052, + 1.2640759162604809, + 0.08860164135694504, + 0.3572324048727751, + 0.3625037856400013, + 1.2871895339339972, + 0.33865227922797203, + 0.6118408590555191, + 1.1589966975152493, + 1.0722509752959013, + 0.892815550789237, + 0.9071019813418388, + 0.29803709872066975, + 1.1456554867327213, + 0.2329634204506874, + 0.4430400561541319, + 2.3378871306777, + 0.8355237990617752, + 0.4036014676094055, + 0.25238397531211376, + 6.413300659507513, + 4.751577699556947, + 2.5271313712000847, + 0.9025547727942467, + 0.363934887573123, + 1.4231935869902372, + 0.981138676404953, + 0.5826886668801308, + 0.2937581855803728, + 1.2656490840017796, + 0.6929915193468332, + 1.2221097499132156, + 0.2710226885974407, + 0.2507762461900711, + 0.8250546287745237, + 0.7120593879371881, + 1.461501656100154, + 0.5717088617384434, + 0.02974851056933403, + 3.5755190551280975, + 1.016025085002184, + 0.8873431757092476, + 0.2988758906722069, + 1.2648256868124008, + 0.38302692025899887, + 0.90515679679811, + 0.2841512858867645, + 3.469594968482852, + 0.0, + 0.402204068377614, + 0.7017376720905304, + 2.802348244935274, + 0.622331416234374, + 0.9292453676462173, + 0.6225758008658886, + 1.3555112201720476, + 0.2786997891962528 + ], + "unique_experts": 63, + "load_cv": 0.693733688951743, + "normalized_load_entropy": 0.946668420410899, + "max_load_share": 0.05120481927710843 + }, + "full_input": { + "tokens": 191, + "top_k": 6, + "decisions": 1146, + "ordered_route_sha256": "a62e0e1f853801b61814277315973fc2879d54638ba93267643c402d7afd59af", + "route_weight_sha256": "54695af86cab8dec203fd0ef9a55eacdbaee58a8ef91ac076796639c6dc860f8", + "loads": [ + 9, + 7, + 19, + 24, + 25, + 12, + 3, + 27, + 26, + 3, + 9, + 7, + 33, + 5, + 11, + 16, + 28, + 13, + 15, + 7, + 12, + 5, + 12, + 44, + 11, + 8, + 9, + 53, + 65, + 38, + 14, + 15, + 21, + 18, + 10, + 13, + 15, + 22, + 38, + 5, + 6, + 24, + 19, + 23, + 13, + 2, + 38, + 27, + 21, + 6, + 12, + 5, + 16, + 5, + 36, + 0, + 13, + 17, + 46, + 20, + 17, + 20, + 23, + 10 + ], + "weighted_loads": [ + 0.46291313506662846, + 0.42321566119790077, + 1.0407731384038925, + 0.7627729608211666, + 4.125276740640402, + 0.46584883192554116, + 0.10546943731606007, + 1.9189434610307217, + 1.660528227686882, + 0.08860164135694504, + 0.3572324048727751, + 0.3625037856400013, + 1.5554489213973284, + 0.33865227922797203, + 0.6118408590555191, + 1.1589966975152493, + 1.3563313577324152, + 0.892815550789237, + 0.9071019813418388, + 0.29803709872066975, + 1.1479577061254531, + 0.2329634204506874, + 0.48809309117496014, + 2.8555279467254877, + 0.8355237990617752, + 0.4036014676094055, + 0.2851973529905081, + 6.77119792252779, + 6.564177876338363, + 4.299581665545702, + 1.0064879460260272, + 0.6327933762222528, + 1.4696496706455946, + 1.0865276157855988, + 0.5826886668801308, + 0.7793737631291151, + 1.2656490840017796, + 0.8070812877267599, + 2.3863979764282703, + 0.2710226885974407, + 0.2507762461900711, + 1.3424910586327314, + 0.995799919590354, + 1.461501656100154, + 0.6861013472080231, + 0.067192442715168, + 3.5755190551280975, + 1.3483994472771883, + 1.0262945294380188, + 0.2988758906722069, + 1.277764487080276, + 0.38302692025899887, + 0.90515679679811, + 0.2841512858867645, + 3.469594968482852, + 0.0, + 0.5052529275417328, + 0.7017376720905304, + 2.9329963624477386, + 0.7157111736014485, + 0.9292453676462173, + 0.7798054739832878, + 1.5455411802977324, + 0.375867135822773 + ], + "unique_experts": 63, + "load_cv": 0.7178844410597391, + "normalized_load_entropy": 0.9429735935202496, + "max_load_share": 0.056719022687609075 + } + }, + "s1_eos": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "7f69e9032afe88bd17bd623a89cac8cf9601e63cfbe56edbda8ee58acd4c412b", + "route_weight_sha256": "d0d108ad435bf7e27dd4918b292d052a5ca806b2f495679ab3d0d06d60b8bd5c", + "loads": [ + 9, + 7, + 21, + 17, + 22, + 12, + 3, + 25, + 20, + 3, + 9, + 7, + 26, + 5, + 11, + 16, + 24, + 13, + 16, + 8, + 11, + 5, + 10, + 36, + 12, + 8, + 7, + 47, + 52, + 27, + 11, + 11, + 19, + 15, + 10, + 6, + 15, + 18, + 23, + 5, + 5, + 20, + 13, + 22, + 11, + 2, + 38, + 21, + 17, + 7, + 10, + 6, + 16, + 5, + 36, + 0, + 9, + 19, + 43, + 14, + 19, + 16, + 18, + 7 + ], + "weighted_loads": [ + 0.43786217644810677, + 0.42252134531736374, + 1.070426657795906, + 0.593447232618928, + 2.543654540553689, + 0.4837819803506136, + 0.10375397466123104, + 1.735099945217371, + 1.2386290784925222, + 0.08814948610961437, + 0.35468630120158195, + 0.3562811613082886, + 1.1873149387538433, + 0.3426362872123718, + 0.6123433038592339, + 1.158816635608673, + 1.0791874919086695, + 0.8949836678802967, + 0.9309701733291149, + 0.32352581061422825, + 1.15365694090724, + 0.23753056675195694, + 0.4151680953800678, + 2.2763568311929703, + 0.8739022612571716, + 0.40605226159095764, + 0.2244501505047083, + 6.440658373758197, + 4.7523981016129255, + 2.464440703392029, + 0.9306229967623949, + 0.3945499323308468, + 1.383194088935852, + 0.9315002933144569, + 0.5803373586386442, + 0.280299024656415, + 1.2638463489711285, + 0.6926307752728462, + 1.1937866546213627, + 0.27237677574157715, + 0.24489932134747505, + 0.8381966203451157, + 0.643393412232399, + 1.4029048960655928, + 0.5811290815472603, + 0.053958192467689514, + 3.5981904976069927, + 0.9967196732759476, + 0.8728700652718544, + 0.33646440878510475, + 1.221523143351078, + 0.42583541572093964, + 0.9099178742617369, + 0.2828379459679127, + 3.4378314316272736, + 0.0, + 0.3699358459562063, + 0.7791333328932524, + 2.7749150302261114, + 0.5244060903787613, + 1.011906934902072, + 0.6479980256408453, + 1.3207578212022781, + 0.28034370206296444 + ], + "unique_experts": 63, + "load_cv": 0.6922441392714508, + "normalized_load_entropy": 0.9472917085329426, + "max_load_share": 0.05220883534136546 + }, + "full_input": { + "tokens": 207, + "top_k": 6, + "decisions": 1242, + "ordered_route_sha256": "7fef50e783fb10a7043317fa1039c8467cd1f9cd508e7895935878ae0791c4d1", + "route_weight_sha256": "22c99c7ac48fc824e6ef9189e4f6a195b4684a02b172b3e2bf6a038ad75f412e", + "loads": [ + 13, + 7, + 21, + 21, + 26, + 13, + 3, + 32, + 27, + 6, + 10, + 7, + 30, + 5, + 11, + 16, + 30, + 15, + 17, + 8, + 12, + 7, + 12, + 42, + 12, + 8, + 10, + 54, + 68, + 44, + 22, + 15, + 23, + 20, + 15, + 14, + 15, + 22, + 42, + 5, + 5, + 31, + 19, + 24, + 24, + 6, + 40, + 29, + 24, + 7, + 12, + 6, + 16, + 8, + 36, + 0, + 12, + 25, + 45, + 18, + 21, + 24, + 23, + 7 + ], + "weighted_loads": [ + 0.6298641674220562, + 0.42252134531736374, + 1.070426657795906, + 0.6795842342544347, + 4.165160598233342, + 0.4877258846536279, + 0.10375397466123104, + 2.10791177675128, + 1.7883303444832563, + 0.4076609667390585, + 0.39726249501109123, + 0.3562811613082886, + 1.38276556879282, + 0.3426362872123718, + 0.6123433038592339, + 1.158816635608673, + 1.4654937218874693, + 1.0100099109113216, + 0.9662978537380695, + 0.32352581061422825, + 1.155996204353869, + 0.3283919356763363, + 0.5037874020636082, + 2.7394837848842144, + 0.8739022612571716, + 0.40605226159095764, + 0.3431352321058512, + 6.795866636559367, + 6.844431819394231, + 5.067524999380112, + 1.7934673996642232, + 0.6270612701773643, + 1.5606966856867075, + 1.2362044714391232, + 0.8361535016447306, + 0.8852266613394022, + 1.2638463489711285, + 0.8663733601570129, + 2.6095070838928223, + 0.27237677574157715, + 0.24489932134747505, + 1.839481197297573, + 1.0239633917808533, + 1.5132540296763182, + 1.7969835959374905, + 0.3601676970720291, + 3.6879161447286606, + 1.4330821391195059, + 1.1979017741978168, + 0.33646440878510475, + 1.2864564275369048, + 0.42583541572093964, + 0.9099178742617369, + 0.4373292326927185, + 3.4378314316272736, + 0.0, + 0.4489188091829419, + 1.0334543082863092, + 2.912989040836692, + 0.6423386689275503, + 1.0811396688222885, + 1.0397768523544073, + 1.5380929075181484, + 0.28034370206296444 + ], + "unique_experts": 63, + "load_cv": 0.6792800407525007, + "normalized_load_entropy": 0.9481355603225698, + "max_load_share": 0.05475040257648953 + } + }, + "s0_bos": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "8a7034e213facd8b24c4bf9254773822b54aa72a4a987e8cfae2fbcdeff7766f", + "route_weight_sha256": "b688f08fb25d848addf856ded8f48d184e25c4b5daf7511e276f84e0c8e15568", + "loads": [ + 9, + 7, + 20, + 18, + 20, + 11, + 3, + 24, + 21, + 2, + 9, + 7, + 29, + 5, + 10, + 17, + 23, + 12, + 16, + 8, + 15, + 4, + 9, + 38, + 11, + 9, + 7, + 47, + 49, + 26, + 9, + 12, + 19, + 15, + 10, + 5, + 16, + 17, + 23, + 5, + 7, + 22, + 17, + 23, + 11, + 1, + 37, + 23, + 17, + 7, + 11, + 5, + 16, + 5, + 35, + 1, + 8, + 18, + 44, + 15, + 15, + 15, + 18, + 8 + ], + "weighted_loads": [ + 0.48138955421745777, + 0.43023303151130676, + 1.0961309522390366, + 0.6186427865177393, + 2.4885386768728495, + 0.4729383625090122, + 0.11227690428495407, + 1.766657691448927, + 1.274962367489934, + 0.05939529463648796, + 0.3676770180463791, + 0.39136161282658577, + 1.3753636665642262, + 0.3534006215631962, + 0.5435992069542408, + 1.2222566474229097, + 1.100042948499322, + 0.870473500341177, + 0.95603371784091, + 0.34258918836712837, + 1.3300521839410067, + 0.19786149263381958, + 0.37986976467072964, + 2.358917297795415, + 0.8171222917735577, + 0.46585389971733093, + 0.22696732357144356, + 6.494270810857415, + 4.659149000421166, + 2.500731859356165, + 0.8619681149721146, + 0.44350483268499374, + 1.4119148254394531, + 0.9306115992367268, + 0.6046173553913832, + 0.2548079639673233, + 1.2581092044711113, + 0.6644205376505852, + 1.168898230418563, + 0.29158759117126465, + 0.29594893008470535, + 0.9997555501759052, + 0.7958365231752396, + 1.472068078815937, + 0.5747109912335873, + 0.027815040200948715, + 3.5454930514097214, + 1.0887065380811691, + 0.8551207967102528, + 0.31768398359417915, + 1.2530405186116695, + 0.38625019043684006, + 0.8936701007187366, + 0.29491743445396423, + 3.4279304910451174, + 0.02126007154583931, + 0.33232197538018227, + 0.7332006357610226, + 2.759854059666395, + 0.5822672136127949, + 0.8205881677567959, + 0.6307147964835167, + 1.3852326590567827, + 0.30313348583877087 + ], + "unique_experts": 64, + "load_cv": 0.6895361290205361, + "normalized_load_entropy": 0.9471705072377752, + "max_load_share": 0.04919678714859438 + }, + "full_input": { + "tokens": 191, + "top_k": 6, + "decisions": 1146, + "ordered_route_sha256": "3b713192bdd8d19289a735eb64c15949ab3e58a281caee5f673c2395ef1bab59", + "route_weight_sha256": "22b6c1df6cf66cd228af9871940fedee9c5262e112d57251ce56b6bd90a41b01", + "loads": [ + 10, + 7, + 20, + 23, + 23, + 11, + 3, + 27, + 27, + 2, + 9, + 7, + 35, + 5, + 10, + 17, + 29, + 12, + 16, + 8, + 15, + 4, + 10, + 46, + 11, + 9, + 9, + 53, + 64, + 38, + 11, + 18, + 20, + 17, + 10, + 12, + 16, + 21, + 38, + 5, + 7, + 27, + 20, + 23, + 13, + 2, + 38, + 27, + 21, + 7, + 12, + 5, + 16, + 5, + 35, + 1, + 10, + 18, + 46, + 18, + 15, + 19, + 22, + 11 + ], + "weighted_loads": [ + 0.5387709531933069, + 0.43023303151130676, + 1.0961309522390366, + 0.7692312560975552, + 3.1566350664943457, + 0.4729383625090122, + 0.11227690428495407, + 1.97888557985425, + 1.7427510377019644, + 0.05939529463648796, + 0.3676770180463791, + 0.39136161282658577, + 1.728702049702406, + 0.3534006215631962, + 0.5435992069542408, + 1.2222566474229097, + 1.3818459901958704, + 0.870473500341177, + 0.95603371784091, + 0.34258918836712837, + 1.3300521839410067, + 0.19786149263381958, + 0.4249227996915579, + 2.9183713123202324, + 0.8171222917735577, + 0.46585389971733093, + 0.3024987280368805, + 6.852168073877692, + 6.466111717745662, + 4.33439464494586, + 0.9250546721741557, + 0.758201714605093, + 1.4583709090948105, + 1.0328124687075615, + 0.6046173553913832, + 0.7404235415160656, + 1.2581092044711113, + 0.7785103060305119, + 2.3456956166774035, + 0.29158759117126465, + 0.29594893008470535, + 1.4571281671524048, + 1.043273203074932, + 1.472068078815937, + 0.6933779716491699, + 0.06525897234678268, + 3.5845741629600525, + 1.3059317339211702, + 1.032214917242527, + 0.31768398359417915, + 1.2659793188795447, + 0.38625019043684006, + 0.8936701007187366, + 0.29491743445396423, + 3.4279304910451174, + 0.02126007154583931, + 0.4307853654026985, + 0.7332006357610226, + 2.8860289976000786, + 0.726237153634429, + 0.8205881677567959, + 0.7879444696009159, + 1.5346209686249495, + 0.400300832465291 + ], + "unique_experts": 64, + "load_cv": 0.720729856295809, + "normalized_load_entropy": 0.9429426544474393, + "max_load_share": 0.055846422338568937 + } + }, + "s1_bos": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "a22f0cf00bd25679373696f321c951c7774511e2e2cc55a445684c09ab68b4a0", + "route_weight_sha256": "07c84e5d7326fa15e3650e67aee494a13a203a062baec388e7ecedb77e902e1d", + "loads": [ + 9, + 7, + 20, + 17, + 20, + 13, + 3, + 25, + 21, + 2, + 10, + 6, + 27, + 5, + 11, + 18, + 24, + 14, + 17, + 8, + 14, + 5, + 9, + 38, + 11, + 9, + 7, + 46, + 51, + 27, + 9, + 13, + 19, + 15, + 11, + 6, + 15, + 17, + 22, + 5, + 5, + 20, + 15, + 24, + 9, + 2, + 37, + 22, + 18, + 7, + 11, + 5, + 16, + 6, + 35, + 0, + 8, + 17, + 44, + 15, + 15, + 14, + 18, + 7 + ], + "weighted_loads": [ + 0.49220228381454945, + 0.4213644564151764, + 1.0860840678215027, + 0.570667989552021, + 2.5060046818107367, + 0.5444479323923588, + 0.11164150014519691, + 1.7947163619101048, + 1.2975447662174702, + 0.05931610427796841, + 0.397039569914341, + 0.346423726528883, + 1.3380993753671646, + 0.3431969881057739, + 0.6040719151496887, + 1.304260142147541, + 1.1053712591528893, + 0.9313197210431099, + 0.9929217379540205, + 0.33658745512366295, + 1.2672794237732887, + 0.22846785932779312, + 0.37795216403901577, + 2.3590634800493717, + 0.8141194358468056, + 0.4459160789847374, + 0.2176554910838604, + 6.462998520582914, + 4.7008455116301775, + 2.474217861890793, + 0.8668269328773022, + 0.46095664240419865, + 1.3983615599572659, + 0.9251947477459908, + 0.621128099039197, + 0.2972995564341545, + 1.2292552068829536, + 0.6604577004909515, + 1.065481998026371, + 0.2915521375834942, + 0.22225255332887173, + 0.9378936272114515, + 0.7195369675755501, + 1.4892995655536652, + 0.4795285928994417, + 0.05875840410590172, + 3.5597119443118572, + 1.0462431237101555, + 0.9202821478247643, + 0.3214807827025652, + 1.2430563494563103, + 0.38413112983107567, + 0.8981281369924545, + 0.3318220488727093, + 3.544866219162941, + 0.0, + 0.33235005661845207, + 0.6923805866390467, + 2.835041292011738, + 0.5825810767710209, + 0.8653225973248482, + 0.6064157225191593, + 1.36437464132905, + 0.2688219826668501 + ], + "unique_experts": 63, + "load_cv": 0.690657972767865, + "normalized_load_entropy": 0.9469837955714739, + "max_load_share": 0.05120481927710843 + }, + "full_input": { + "tokens": 207, + "top_k": 6, + "decisions": 1242, + "ordered_route_sha256": "80e1907efbd129fc03edeaf3fa78e83947cd3c3de67616c615e9202f45fbdf6b", + "route_weight_sha256": "86edf158a461591f5c728af3ab6d443afe58f39a29e933580de661ca76279e4e", + "loads": [ + 13, + 7, + 20, + 19, + 23, + 13, + 3, + 32, + 28, + 5, + 11, + 6, + 32, + 5, + 11, + 18, + 31, + 16, + 18, + 8, + 14, + 7, + 11, + 44, + 11, + 9, + 10, + 53, + 67, + 46, + 20, + 18, + 23, + 20, + 16, + 14, + 15, + 21, + 41, + 5, + 5, + 31, + 20, + 26, + 22, + 6, + 39, + 30, + 26, + 7, + 13, + 5, + 16, + 9, + 35, + 0, + 10, + 23, + 46, + 19, + 17, + 22, + 24, + 7 + ], + "weighted_loads": [ + 0.6842042747884989, + 0.4213644564151764, + 1.0860840678215027, + 0.6220917105674744, + 3.1772767435759306, + 0.5444479323923588, + 0.11164150014519691, + 2.184083789587021, + 1.9122508354485035, + 0.37882758490741253, + 0.43961576372385025, + 0.346423726528883, + 1.6678047701716423, + 0.3431969881057739, + 0.6040719151496887, + 1.304260142147541, + 1.5410293191671371, + 1.0463459640741348, + 1.0282494183629751, + 0.33658745512366295, + 1.2672794237732887, + 0.31932922825217247, + 0.4665714707225561, + 2.822190433740616, + 0.8141194358468056, + 0.4459160789847374, + 0.3363405726850033, + 6.818206783384085, + 6.90021294914186, + 5.201716009527445, + 1.7296713357791305, + 0.7277562115341425, + 1.5758641567081213, + 1.2260218746960163, + 0.8769442420452833, + 0.9022271931171417, + 1.2292552068829536, + 0.8342002853751183, + 2.5744585059583187, + 0.2915521375834942, + 0.22225255332887173, + 1.9278609063476324, + 1.0649115517735481, + 1.5996486991643906, + 1.6944141890853643, + 0.3649679087102413, + 3.649437591433525, + 1.4704505410045385, + 1.2793722599744797, + 0.3214807827025652, + 1.307989633642137, + 0.38413112983107567, + 0.8981281369924545, + 0.4863133355975151, + 3.544866219162941, + 0.0, + 0.3920778650790453, + 0.9467015620321035, + 2.987464927136898, + 0.7336050812155008, + 0.9345553312450647, + 0.9981945492327213, + 1.6076452229171991, + 0.2688219826668501 + ], + "unique_experts": 63, + "load_cv": 0.6803175818368828, + "normalized_load_entropy": 0.9477467511165549, + "max_load_share": 0.05394524959742351 + } + }, + "s0_x": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "bbcb23af678b5bf4bb3869c762c65aaefc787b04165afda5ade8273399773bf1", + "route_weight_sha256": "7b112ef9269e6bb26081f703b13061acc4ab6e356aac1f8e61a6ff4eb35b34b3", + "loads": [ + 9, + 7, + 20, + 16, + 20, + 10, + 3, + 25, + 21, + 2, + 10, + 7, + 29, + 5, + 9, + 18, + 23, + 14, + 15, + 7, + 12, + 5, + 9, + 38, + 11, + 10, + 6, + 47, + 50, + 28, + 10, + 12, + 19, + 15, + 9, + 7, + 16, + 18, + 21, + 6, + 5, + 22, + 18, + 26, + 11, + 1, + 37, + 21, + 16, + 7, + 11, + 5, + 16, + 5, + 34, + 1, + 9, + 18, + 45, + 14, + 14, + 15, + 18, + 8 + ], + "weighted_loads": [ + 0.4684294033795595, + 0.43265504017472267, + 1.0831643138080835, + 0.5390184223651886, + 2.4713388346135616, + 0.42159066163003445, + 0.11165449023246765, + 1.8535323850810528, + 1.2828997131437063, + 0.05923714302480221, + 0.40889330208301544, + 0.38258998468518257, + 1.3015565611422062, + 0.3562420792877674, + 0.4801941327750683, + 1.2784387674182653, + 1.0466204602271318, + 0.937798660248518, + 0.9560411833226681, + 0.3019849956035614, + 1.2222804874181747, + 0.23191700503230095, + 0.375561248511076, + 2.3908960446715355, + 0.8207506723701954, + 0.5099889412522316, + 0.19929490238428116, + 6.450095070526004, + 4.789934558793902, + 2.475638974457979, + 0.8803281765431166, + 0.4321887996047735, + 1.3688654135912657, + 0.934862807393074, + 0.5666032712906599, + 0.3154532164335251, + 1.2465127483010292, + 0.6922662910073996, + 1.091677412390709, + 0.3113864529877901, + 0.20504752732813358, + 0.9857806898653507, + 0.8336933199316263, + 1.5423473697155714, + 0.5759172700345516, + 0.027768703177571297, + 3.582582026720047, + 0.9906937591731548, + 0.8291373588144779, + 0.3149031400680542, + 1.297726172953844, + 0.39215247705578804, + 0.9170061573386192, + 0.29414280876517296, + 3.46316403336823, + 0.02212735265493393, + 0.3710080422461033, + 0.7250278815627098, + 2.9106494821608067, + 0.5488681942224503, + 0.7986284606158733, + 0.6446327809244394, + 1.3696360029280186, + 0.30819951742887497 + ], + "unique_experts": 64, + "load_cv": 0.6960547288898407, + "normalized_load_entropy": 0.9467136070719074, + "max_load_share": 0.050200803212851405 + }, + "full_input": { + "tokens": 191, + "top_k": 6, + "decisions": 1146, + "ordered_route_sha256": "736fa1d0351ceb119c88a82376c74d9140a27c244a0b5f0dd36bca74ab10e5f1", + "route_weight_sha256": "b33cc8a461cd4a3a1e653bed3f9fd8e44f454dbf797fe40c78e7b5a0c8407f2d", + "loads": [ + 9, + 7, + 20, + 20, + 23, + 10, + 3, + 28, + 27, + 2, + 10, + 7, + 34, + 5, + 9, + 18, + 26, + 14, + 15, + 7, + 12, + 5, + 10, + 47, + 11, + 10, + 7, + 54, + 68, + 39, + 13, + 17, + 20, + 17, + 9, + 15, + 16, + 22, + 35, + 6, + 5, + 27, + 22, + 26, + 13, + 3, + 37, + 27, + 20, + 7, + 12, + 5, + 16, + 5, + 34, + 1, + 11, + 18, + 47, + 16, + 14, + 20, + 22, + 11 + ], + "weighted_loads": [ + 0.4684294033795595, + 0.43265504017472267, + 1.0831643138080835, + 0.6596126407384872, + 3.139435224235058, + 0.42159066163003445, + 0.11165449023246765, + 2.0656803362071514, + 1.705613611266017, + 0.05923714302480221, + 0.40889330208301544, + 0.38258998468518257, + 1.5802632421255112, + 0.3562420792877674, + 0.4801941327750683, + 1.2784387674182653, + 1.2137278262525797, + 0.937798660248518, + 0.9560411833226681, + 0.3019849956035614, + 1.2222804874181747, + 0.23191700503230095, + 0.4206142835319042, + 3.1027569491416216, + 0.8207506723701954, + 0.5099889412522316, + 0.23210828006267548, + 6.86438955925405, + 6.95015455596149, + 4.051399674266577, + 0.9945685425773263, + 0.6970094013959169, + 1.415321497246623, + 1.0287553630769253, + 0.5666032712906599, + 0.8754852525889874, + 1.2465127483010292, + 0.8063560593873262, + 2.097247403115034, + 0.3113864529877901, + 0.20504752732813358, + 1.4682586453855038, + 1.120712773874402, + 1.5423473697155714, + 0.6955037117004395, + 0.11661973409354687, + 3.582582026720047, + 1.2627467438578606, + 1.0147450156509876, + 0.3149031400680542, + 1.3106649732217193, + 0.39215247705578804, + 0.9170061573386192, + 0.29414280876517296, + 3.46316403336823, + 0.02212735265493393, + 0.46947143226861954, + 0.7250278815627098, + 3.0341713167726994, + 0.6337907146662474, + 0.7986284606158733, + 0.8749328386038542, + 1.5190243124961853, + 0.4053668640553951 + ], + "unique_experts": 64, + "load_cv": 0.7343272829277423, + "normalized_load_entropy": 0.9419818525942363, + "max_load_share": 0.059336823734729496 + } + }, + "s1_x": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "229f1405294300bb7db37bb0f1431edabbca374613d974ecd33a5a0ea5699e80", + "route_weight_sha256": "f9bcf610ca1a11c62bec46248d7b23048fab21cdcd52455e10d503227ad26109", + "loads": [ + 9, + 7, + 21, + 14, + 21, + 12, + 3, + 25, + 20, + 2, + 10, + 6, + 23, + 5, + 11, + 19, + 23, + 12, + 17, + 8, + 11, + 5, + 8, + 39, + 11, + 10, + 7, + 46, + 54, + 26, + 11, + 11, + 18, + 15, + 10, + 6, + 16, + 18, + 24, + 6, + 3, + 24, + 15, + 23, + 9, + 1, + 37, + 22, + 19, + 4, + 13, + 5, + 16, + 6, + 35, + 0, + 10, + 20, + 46, + 13, + 17, + 15, + 17, + 6 + ], + "weighted_loads": [ + 0.48232719115912914, + 0.41911526024341583, + 1.117424612864852, + 0.4764157421886921, + 2.5700685139745474, + 0.4876661989837885, + 0.10982501693069935, + 1.8578018732368946, + 1.2574294619262218, + 0.058308737352490425, + 0.4197319019585848, + 0.34715327247977257, + 1.1155332867056131, + 0.3352571874856949, + 0.590251162648201, + 1.3826616145670414, + 1.0271921642124653, + 0.9019740093499422, + 1.0455051138997078, + 0.3190605454146862, + 1.189575120806694, + 0.24024366214871407, + 0.34153413213789463, + 2.4044483974575996, + 0.8103425055742264, + 0.49829641729593277, + 0.21793855726718903, + 6.38839559070766, + 4.974777836352587, + 2.3827101662755013, + 0.9643579125404358, + 0.3756874520331621, + 1.3606701642274857, + 0.9220010526478291, + 0.5758999977260828, + 0.2865995317697525, + 1.2380697093904018, + 0.6948375105857849, + 1.1745826620608568, + 0.33716754987835884, + 0.136906947940588, + 1.0134493447840214, + 0.7324372790753841, + 1.4659483507275581, + 0.5100207403302193, + 0.02895597368478775, + 3.6397947147488594, + 1.042682483792305, + 0.9325160551816225, + 0.1921180672943592, + 1.3191141597926617, + 0.37776678055524826, + 0.9138067718595266, + 0.3359341584146023, + 3.572599768638611, + 0.0, + 0.39277805760502815, + 0.7904768362641335, + 3.0119705256074667, + 0.49259256944060326, + 0.9233495779335499, + 0.6445969250053167, + 1.3253185134381056, + 0.2431058306246996 + ], + "unique_experts": 63, + "load_cv": 0.7139902662422681, + "normalized_load_entropy": 0.9434560553809667, + "max_load_share": 0.05421686746987952 + }, + "full_input": { + "tokens": 207, + "top_k": 6, + "decisions": 1242, + "ordered_route_sha256": "f39a3321cae8ea7a9abab33fc251c9777f66a5a38b166aac8e9a475ec230c544", + "route_weight_sha256": "eb4a376e6b50a4d3ab20106a6ae1deafc26ea573eb63ee6aa60b555d956e230d", + "loads": [ + 13, + 7, + 21, + 16, + 25, + 12, + 3, + 32, + 27, + 5, + 11, + 6, + 27, + 5, + 11, + 19, + 28, + 14, + 18, + 8, + 11, + 8, + 10, + 46, + 11, + 10, + 10, + 54, + 73, + 41, + 23, + 15, + 22, + 20, + 15, + 15, + 16, + 22, + 42, + 6, + 3, + 35, + 21, + 25, + 22, + 6, + 40, + 29, + 26, + 4, + 15, + 5, + 16, + 9, + 35, + 0, + 11, + 27, + 48, + 16, + 19, + 24, + 22, + 6 + ], + "weighted_loads": [ + 0.6743291821330786, + 0.41911526024341583, + 1.117424612864852, + 0.5278394632041454, + 3.270557951182127, + 0.4876661989837885, + 0.10982501693069935, + 2.258835256099701, + 1.7935302965342999, + 0.37782021798193455, + 0.46230809576809406, + 0.34715327247977257, + 1.296389764174819, + 0.3352571874856949, + 0.590251162648201, + 1.3826616145670414, + 1.3535954281687737, + 1.0170002523809671, + 1.0808327943086624, + 0.3190605454146862, + 1.189575120806694, + 0.36346687749028206, + 0.430153438821435, + 2.9987577088177204, + 0.8103425055742264, + 0.49829641729593277, + 0.3366236388683319, + 6.819627268239856, + 7.446277156472206, + 4.5631792694330215, + 1.8664094684645534, + 0.6167567130178213, + 1.538172760978341, + 1.2107631750404835, + 0.8317161407321692, + 0.9897245243191719, + 1.2380697093904018, + 0.8685800954699516, + 2.412875408306718, + 0.33716754987835884, + 0.136906947940588, + 2.0253235436975956, + 1.146265771239996, + 1.5762974843382835, + 1.7049269899725914, + 0.37602436169981956, + 3.776464305818081, + 1.3793167602270842, + 1.2403554674237967, + 0.1921180672943592, + 1.3840474439784884, + 0.37776678055524826, + 0.9138067718595266, + 0.4904254451394081, + 3.572599768638611, + 0.0, + 0.42054598219692707, + 1.0906710401177406, + 3.1810799334198236, + 0.6026522312313318, + 0.9925823118537664, + 1.0895632933825254, + 1.5426535997539759, + 0.2431058306246996 + ], + "unique_experts": 63, + "load_cv": 0.7067005246996402, + "normalized_load_entropy": 0.9445405244672707, + "max_load_share": 0.05877616747181964 + } + }, + "s0_period": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "94925fab04bfa9afe3f90694c46d70aafa9a7e8dc45a197369a65b952f728818", + "route_weight_sha256": "c8521674630132840fa53f8025826453532e2987e9a5b38c2a98a23b8b648c68", + "loads": [ + 9, + 7, + 21, + 15, + 19, + 10, + 3, + 25, + 21, + 3, + 9, + 7, + 25, + 5, + 9, + 18, + 22, + 14, + 16, + 8, + 13, + 4, + 9, + 38, + 11, + 10, + 7, + 47, + 51, + 28, + 10, + 11, + 20, + 15, + 9, + 6, + 16, + 18, + 21, + 5, + 5, + 23, + 18, + 24, + 11, + 2, + 37, + 24, + 16, + 7, + 11, + 5, + 16, + 5, + 34, + 1, + 9, + 19, + 45, + 15, + 14, + 16, + 17, + 7 + ], + "weighted_loads": [ + 0.4739117007702589, + 0.4363522194325924, + 1.122441090643406, + 0.516019981354475, + 2.4275083988904953, + 0.4180644806474447, + 0.11232385598123074, + 1.8683427721261978, + 1.2887649051845074, + 0.08016246370971203, + 0.37628029473125935, + 0.3763301521539688, + 1.1822927482426167, + 0.3532371520996094, + 0.4792570434510708, + 1.3219978138804436, + 0.9935435652732849, + 0.9445878490805626, + 0.9838022217154503, + 0.32297261990606785, + 1.2572807036340237, + 0.19924145564436913, + 0.37586444802582264, + 2.384728679433465, + 0.8185244202613831, + 0.5197194702923298, + 0.2177269384264946, + 6.445932833477855, + 4.7587630320340395, + 2.4918172135949135, + 0.8829342275857925, + 0.4040483180433512, + 1.4093479234725237, + 0.9363101162016392, + 0.5734377652406693, + 0.2903241962194443, + 1.2644015811383724, + 0.7052107974886894, + 1.1090566888451576, + 0.28871234878897667, + 0.20080609433352947, + 1.0191933326423168, + 0.8370151221752167, + 1.4955999087542295, + 0.59135533683002, + 0.05874554254114628, + 3.5722828544676304, + 1.1434446182101965, + 0.8056994881480932, + 0.3116974476724863, + 1.3025948628783226, + 0.39870769903063774, + 0.9071888029575348, + 0.3001428097486496, + 3.4326195493340492, + 0.021511543542146683, + 0.37046855315566063, + 0.7780056111514568, + 2.876745780929923, + 0.5860553085803986, + 0.8161866553127766, + 0.671684643253684, + 1.3502889201045036, + 0.28105954453349113 + ], + "unique_experts": 64, + "load_cv": 0.6957766129147427, + "normalized_load_entropy": 0.9471826855384213, + "max_load_share": 0.05120481927710843 + }, + "full_input": { + "tokens": 191, + "top_k": 6, + "decisions": 1146, + "ordered_route_sha256": "3e8f376d240071738d9df8c8585707f267339be038318c9b70fabfbd438545e4", + "route_weight_sha256": "a15267c2fb49a502f2c74d152555bad7b2d11eeb267f6c414d5aaf9c77d3d337", + "loads": [ + 9, + 7, + 21, + 19, + 22, + 10, + 3, + 28, + 27, + 3, + 9, + 7, + 30, + 5, + 9, + 18, + 27, + 14, + 16, + 8, + 13, + 4, + 10, + 47, + 11, + 10, + 8, + 54, + 68, + 40, + 12, + 16, + 21, + 16, + 9, + 14, + 16, + 22, + 35, + 5, + 5, + 29, + 22, + 24, + 13, + 3, + 37, + 30, + 19, + 7, + 12, + 5, + 16, + 5, + 34, + 1, + 11, + 19, + 47, + 17, + 14, + 21, + 22, + 10 + ], + "weighted_loads": [ + 0.4739117007702589, + 0.4363522194325924, + 1.122441090643406, + 0.6366141997277737, + 3.0956047885119915, + 0.4180644806474447, + 0.11232385598123074, + 2.087724193930626, + 1.713809359818697, + 0.08016246370971203, + 0.37628029473125935, + 0.3763301521539688, + 1.4644506350159645, + 0.3532371520996094, + 0.4792570434510708, + 1.3219978138804436, + 1.2714885473251343, + 0.9445878490805626, + 0.9838022217154503, + 0.32297261990606785, + 1.2572807036340237, + 0.19924145564436913, + 0.4209174830466509, + 3.00824761018157, + 0.8185244202613831, + 0.5197194702923298, + 0.2505403161048889, + 6.842423727735877, + 6.9295150730758905, + 4.107770744711161, + 0.9460207847878337, + 0.6764852982014418, + 1.455804007127881, + 0.9769200496375561, + 0.5734377652406693, + 0.8220186084508896, + 1.2644015811383724, + 0.8193005658686161, + 2.1120406799018383, + 0.28871234878897667, + 0.20080609433352947, + 1.6028368957340717, + 1.123942892998457, + 1.4955999087542295, + 0.7062198091298342, + 0.09618947468698025, + 3.5722828544676304, + 1.4205536060035229, + 0.9573640394955873, + 0.3116974476724863, + 1.3155336631461978, + 0.39870769903063774, + 0.9071888029575348, + 0.3001428097486496, + 3.4326195493340492, + 0.021511543542146683, + 0.4689319431781769, + 0.7780056111514568, + 3.0038471799343824, + 0.6709778290241957, + 0.8161866553127766, + 0.8853086996823549, + 1.550053182989359, + 0.3782268911600113 + ], + "unique_experts": 64, + "load_cv": 0.7356533305552634, + "normalized_load_entropy": 0.941837737132954, + "max_load_share": 0.059336823734729496 + } + }, + "s1_period": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "c358bb1cc4051812eb7169103f32ec6234edf51a5663d9460f76ea7024e2e978", + "route_weight_sha256": "24225e7c3fc328c4c64f635116aa626afbbe11207f6477fa5121db404b944171", + "loads": [ + 9, + 7, + 20, + 14, + 21, + 12, + 3, + 26, + 21, + 2, + 10, + 8, + 25, + 5, + 10, + 18, + 23, + 12, + 17, + 6, + 11, + 5, + 8, + 38, + 11, + 10, + 8, + 46, + 53, + 27, + 11, + 9, + 19, + 15, + 10, + 5, + 15, + 18, + 24, + 7, + 5, + 23, + 17, + 23, + 10, + 1, + 37, + 24, + 16, + 4, + 13, + 5, + 15, + 5, + 35, + 1, + 9, + 22, + 46, + 12, + 16, + 15, + 17, + 6 + ], + "weighted_loads": [ + 0.49972668290138245, + 0.4269101470708847, + 1.0843856167048216, + 0.48461559042334557, + 2.5242766942828894, + 0.48196536861360073, + 0.10902272909879684, + 1.8857801668345928, + 1.3001886419951916, + 0.057983286678791046, + 0.4178742319345474, + 0.394222442060709, + 1.1780503150075674, + 0.3412586748600006, + 0.5310999974608421, + 1.3568842317909002, + 1.0141567010432482, + 0.8944610133767128, + 1.025629822164774, + 0.26209573075175285, + 1.215067820623517, + 0.24125580117106438, + 0.33852189406752586, + 2.381624009460211, + 0.7989302165806293, + 0.5136941075325012, + 0.24991424567997456, + 6.424851851537824, + 4.890238728374243, + 2.4048586282879114, + 0.937001071870327, + 0.3285174332559109, + 1.378958910703659, + 0.9121148996055126, + 0.5922710690647364, + 0.25394846498966217, + 1.2083656191825867, + 0.6979165896773338, + 1.1508515160530806, + 0.3612846862524748, + 0.21021677181124687, + 1.011858867481351, + 0.78626942448318, + 1.4626228716224432, + 0.5634783655405045, + 0.02795981615781784, + 3.6230935007333755, + 1.1230014953762293, + 0.782799793407321, + 0.1910877786576748, + 1.3268843814730644, + 0.3626514934003353, + 0.8955543898046017, + 0.3029145896434784, + 3.537228614091873, + 0.021988386288285255, + 0.35477697663009167, + 0.8471815343946218, + 2.99864299595356, + 0.4703613668680191, + 0.8681059163063765, + 0.6531116478145123, + 1.330653229728341, + 0.24419939704239368 + ], + "unique_experts": 64, + "load_cv": 0.7115464043275912, + "normalized_load_entropy": 0.9444530085733301, + "max_load_share": 0.05321285140562249 + }, + "full_input": { + "tokens": 207, + "top_k": 6, + "decisions": 1242, + "ordered_route_sha256": "3d50064576ad8c5397b47762017d77c9b1e6db2926fcca59644017e26d847211", + "route_weight_sha256": "4519e055e11927f5b29bebc8a4a88b0d2793c39485a22b78022deaf80afaa67f", + "loads": [ + 13, + 7, + 20, + 16, + 24, + 12, + 3, + 34, + 28, + 5, + 11, + 8, + 29, + 5, + 10, + 18, + 28, + 14, + 18, + 6, + 11, + 7, + 10, + 45, + 11, + 10, + 11, + 53, + 72, + 42, + 22, + 13, + 23, + 20, + 15, + 14, + 15, + 22, + 43, + 7, + 5, + 35, + 25, + 25, + 23, + 5, + 40, + 31, + 23, + 4, + 15, + 5, + 15, + 8, + 35, + 1, + 10, + 28, + 48, + 15, + 18, + 24, + 23, + 6 + ], + "weighted_loads": [ + 0.6917286738753319, + 0.4269101470708847, + 1.0843856167048216, + 0.5360393114387989, + 3.1955487560480833, + 0.48196536861360073, + 0.10902272909879684, + 2.323183970525861, + 1.8247951492667198, + 0.37749476730823517, + 0.4604504257440567, + 0.394222442060709, + 1.3467757236212492, + 0.3412586748600006, + 0.5310999974608421, + 1.3568842317909002, + 1.35387952812016, + 1.0094872564077377, + 1.0609575025737286, + 0.26209573075175285, + 1.215067820623517, + 0.3321171700954437, + 0.4271412007510662, + 2.8941107280552387, + 0.7989302165806293, + 0.5136941075325012, + 0.36859932728111744, + 6.780060114338994, + 7.377623897045851, + 4.57154312543571, + 1.7998454747721553, + 0.5704695954918861, + 1.5564615074545145, + 1.1998672150075436, + 0.8480872120708227, + 0.9142595380544662, + 1.2083656191825867, + 0.8716591745615005, + 2.4397548716515303, + 0.3612846862524748, + 0.21021677181124687, + 2.1342809814959764, + 1.2852075174450874, + 1.5729720052331686, + 1.7672256082296371, + 0.33416932076215744, + 3.7591892071068287, + 1.4576231054961681, + 1.1045986358076334, + 0.1910877786576748, + 1.3918176656588912, + 0.3626514934003353, + 0.8955543898046017, + 0.4574058763682842, + 3.537228614091873, + 0.021988386288285255, + 0.3825449012219906, + 1.1015025097876787, + 3.1611371375620365, + 0.5804210286587477, + 0.937338650226593, + 1.0994962863624096, + 1.5838860478252172, + 0.24419939704239368 + ], + "unique_experts": 64, + "load_cv": 0.7081667175416981, + "normalized_load_entropy": 0.9447654079191855, + "max_load_share": 0.057971014492753624 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 166, + "ordered_topk_exact_tokens": 109, + "set_exact_tokens": 131, + "mean_set_jaccard": 0.9371772805507744, + "mean_token_weighted_tv": 0.013251538775547082, + "aggregate_load_tv": 0.020080321285140555 + }, + "system_bos": { + "tokens": 166, + "ordered_topk_exact_tokens": 103, + "set_exact_tokens": 130, + "mean_set_jaccard": 0.9380378657487092, + "mean_token_weighted_tv": 0.014519538573292365, + "aggregate_load_tv": 0.021084337349397585 + }, + "system_x": { + "tokens": 166, + "ordered_topk_exact_tokens": 91, + "set_exact_tokens": 103, + "mean_set_jaccard": 0.8864027538726336, + "mean_token_weighted_tv": 0.022111400608422167, + "aggregate_load_tv": 0.03815261044176707 + }, + "system_period": { + "tokens": 166, + "ordered_topk_exact_tokens": 95, + "set_exact_tokens": 114, + "mean_set_jaccard": 0.9069133677567414, + "mean_token_weighted_tv": 0.02016997764290995, + "aggregate_load_tv": 0.030120481927710836 + }, + "bos_at_s0": { + "tokens": 166, + "ordered_topk_exact_tokens": 89, + "set_exact_tokens": 124, + "mean_set_jaccard": 0.9212564543889846, + "mean_token_weighted_tv": 0.01806371399279998, + "aggregate_load_tv": 0.02610441767068273 + }, + "bos_at_s1": { + "tokens": 166, + "ordered_topk_exact_tokens": 85, + "set_exact_tokens": 115, + "mean_set_jaccard": 0.9070567986230638, + "mean_token_weighted_tv": 0.02124118929482009, + "aggregate_load_tv": 0.02710843373493976 + }, + "x_at_s0": { + "tokens": 166, + "ordered_topk_exact_tokens": 87, + "set_exact_tokens": 116, + "mean_set_jaccard": 0.9051921973608721, + "mean_token_weighted_tv": 0.020389887133994734, + "aggregate_load_tv": 0.032128514056224904 + }, + "x_at_s1": { + "tokens": 166, + "ordered_topk_exact_tokens": 82, + "set_exact_tokens": 104, + "mean_set_jaccard": 0.8855421686746988, + "mean_token_weighted_tv": 0.025786433155726957, + "aggregate_load_tv": 0.034136546184738964 + }, + "period_at_s0": { + "tokens": 166, + "ordered_topk_exact_tokens": 81, + "set_exact_tokens": 111, + "mean_set_jaccard": 0.896586345381526, + "mean_token_weighted_tv": 0.021698821324810207, + "aggregate_load_tv": 0.03413654618473896 + }, + "period_at_s1": { + "tokens": 166, + "ordered_topk_exact_tokens": 80, + "set_exact_tokens": 102, + "mean_set_jaccard": 0.8810958118187036, + "mean_token_weighted_tv": 0.026753370953072984, + "aggregate_load_tv": 0.03714859437751005 + } + } + }, + "layer_13": { + "layer": 13, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "4f3a2297908c2ad57ffcc03f131a7ae4d7804dc1d50bdd5f6280feb1dc9383e1", + "route_weight_sha256": "b226be257456f78b6339c8a1722566887c12c017806cd3aea2e2a33a009e8412", + "loads": [ + 6, + 32, + 9, + 13, + 10, + 8, + 26, + 19, + 11, + 20, + 22, + 6, + 21, + 14, + 28, + 6, + 15, + 22, + 26, + 8, + 3, + 21, + 10, + 25, + 26, + 30, + 0, + 5, + 27, + 22, + 1, + 7, + 12, + 30, + 6, + 16, + 21, + 28, + 17, + 33, + 18, + 5, + 20, + 26, + 39, + 7, + 2, + 4, + 7, + 2, + 13, + 12, + 22, + 8, + 17, + 24, + 3, + 3, + 13, + 29, + 3, + 33, + 11, + 13 + ], + "weighted_loads": [ + 0.2627149932086468, + 2.5580794531852007, + 0.6438737586140633, + 0.7053273469209671, + 0.4775487445294857, + 0.29704893939197063, + 1.0841359198093414, + 1.540697369724512, + 0.6302214786410332, + 1.1706723477691412, + 1.0610405467450619, + 0.3564573936164379, + 1.1454894375056028, + 0.5437926761806011, + 1.6176819298416376, + 0.3667944483458996, + 1.323551505804062, + 1.0862296391278505, + 2.1842718105763197, + 0.3319222144782543, + 0.17347881570458412, + 1.1533984690904617, + 0.5115184914320707, + 2.2099086195230484, + 1.1619528234004974, + 2.4249562732875347, + 0.0, + 0.20239508710801601, + 1.4624935127794743, + 1.5432530250400305, + 0.04227977991104126, + 0.4849484506994486, + 0.7599017899483442, + 2.1024694591760635, + 0.33914757892489433, + 1.0461821723729372, + 1.2373417243361473, + 1.307910418137908, + 1.2749755159020424, + 1.9827040154486895, + 1.0390594433993101, + 0.20134704560041428, + 1.0343811511993408, + 1.3758060950785875, + 2.3607232999056578, + 0.39589534886181355, + 0.12939739599823952, + 0.11516427807509899, + 0.5023957192897797, + 0.060484204441308975, + 0.8403611220419407, + 0.8928619399666786, + 0.913940642029047, + 0.3011981938034296, + 0.6192792654037476, + 1.696806263178587, + 0.1272057108581066, + 0.18833960220217705, + 0.4765087906271219, + 1.862009136006236, + 0.20755377784371376, + 1.8230798672884703, + 0.44538604840636253, + 1.0170391164720058 + ], + "unique_experts": 63, + "load_cv": 0.6296773816343221, + "normalized_load_entropy": 0.9477558725522777, + "max_load_share": 0.0391566265060241 + }, + "full_input": { + "tokens": 191, + "top_k": 6, + "decisions": 1146, + "ordered_route_sha256": "b66ef66fc186a1abea084aabe1d6d1db9d28fb3d846346aeee7b313f31ec3d9c", + "route_weight_sha256": "d9059346401f7700a1873826feefec4f22d46acdd08810cf6d6bca9cab136f20", + "loads": [ + 6, + 36, + 9, + 13, + 10, + 9, + 44, + 19, + 11, + 23, + 32, + 12, + 21, + 14, + 29, + 12, + 15, + 24, + 29, + 9, + 3, + 23, + 10, + 26, + 29, + 30, + 3, + 5, + 27, + 37, + 2, + 7, + 12, + 36, + 7, + 16, + 25, + 29, + 17, + 34, + 18, + 7, + 23, + 28, + 49, + 17, + 4, + 6, + 8, + 2, + 14, + 12, + 25, + 11, + 19, + 24, + 6, + 3, + 20, + 33, + 3, + 34, + 11, + 14 + ], + "weighted_loads": [ + 0.2627149932086468, + 2.7388324104249477, + 0.6438737586140633, + 0.7053273469209671, + 0.4775487445294857, + 0.32806537859141827, + 2.678525786846876, + 1.540697369724512, + 0.6302214786410332, + 1.2832649312913418, + 1.7356396820396185, + 0.5946049680933356, + 1.1454894375056028, + 0.5437926761806011, + 1.6631893645972013, + 0.6756448820233345, + 1.323551505804062, + 1.134277361445129, + 2.3552076760679483, + 0.3742506876587868, + 0.17347881570458412, + 1.2257804162800312, + 0.5115184914320707, + 2.2569984011352062, + 1.2347788610495627, + 2.4249562732875347, + 0.12495648115873337, + 0.20239508710801601, + 1.4624935127794743, + 2.478866321966052, + 0.08200780674815178, + 0.4849484506994486, + 0.7599017899483442, + 2.540301527827978, + 0.36197996139526367, + 1.0461821723729372, + 1.4892282616347075, + 1.3415541741997004, + 1.2749755159020424, + 2.0181157384067774, + 1.0390594433993101, + 0.32918089255690575, + 1.175800383090973, + 1.4722906444221735, + 3.0725161898881197, + 1.3671170715242624, + 0.19533016718924046, + 1.3072080593556166, + 0.5342849940061569, + 0.060484204441308975, + 0.8772323168814182, + 0.8928619399666786, + 1.025120247155428, + 0.4377078805118799, + 0.7072169240564108, + 1.696806263178587, + 0.2939455509185791, + 0.18833960220217705, + 0.7761648818850517, + 2.0677235666662455, + 0.20755377784371376, + 1.8517616298049688, + 0.44538604840636253, + 1.0553359724581242 + ], + "unique_experts": 64, + "load_cv": 0.6295676968322982, + "normalized_load_entropy": 0.9508306302208107, + "max_load_share": 0.04275741710296684 + } + }, + "s1_eos": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "4893c0d4e74504806b039ed380189dd35072585ec053173553b6a7bc8d084f8a", + "route_weight_sha256": "48f0c0881b39eb238b37ed7446dc55ccda00f052e2832a212fd4e725dcfc37a7", + "loads": [ + 6, + 32, + 9, + 13, + 12, + 9, + 29, + 19, + 11, + 21, + 22, + 6, + 21, + 14, + 29, + 6, + 14, + 23, + 26, + 8, + 4, + 21, + 9, + 26, + 25, + 30, + 1, + 3, + 25, + 21, + 1, + 7, + 12, + 30, + 6, + 16, + 22, + 28, + 17, + 35, + 17, + 5, + 20, + 25, + 39, + 8, + 2, + 4, + 7, + 1, + 13, + 12, + 22, + 8, + 16, + 24, + 3, + 3, + 10, + 28, + 3, + 33, + 11, + 13 + ], + "weighted_loads": [ + 0.2552552558481693, + 2.5073418468236923, + 0.6595072541385889, + 0.7140551395714283, + 0.5559455528855324, + 0.34596587531268597, + 1.198289342224598, + 1.5222800858318806, + 0.6375373378396034, + 1.1838113218545914, + 1.0320390108972788, + 0.3621077314019203, + 1.1479131449013948, + 0.5397649109363556, + 1.6361969020217657, + 0.364884652197361, + 1.2368072960525751, + 1.1147094871848822, + 2.197430109605193, + 0.32897377759218216, + 0.22279947251081467, + 1.1381414607167244, + 0.4708853457123041, + 2.2403356097638607, + 1.105780528858304, + 2.3938727471977472, + 0.023809777572751045, + 0.12604553811252117, + 1.4125031866133213, + 1.481169143691659, + 0.04153905063867569, + 0.48934439942240715, + 0.7445492073893547, + 2.1071799509227276, + 0.3352280054241419, + 1.048258574679494, + 1.2391539197415113, + 1.3333069384098053, + 1.2714326083660126, + 2.0177551228553057, + 1.0136081203818321, + 0.19411859661340714, + 1.0122080892324448, + 1.3162006251513958, + 2.3874399941414595, + 0.4194572474807501, + 0.135369710624218, + 0.11423917673528194, + 0.49574752151966095, + 0.03595713526010513, + 0.8594411425292492, + 0.8917669765651226, + 0.9017869718372822, + 0.29529029689729214, + 0.5899059046059847, + 1.6568502020090818, + 0.1296520847827196, + 0.19871345162391663, + 0.3784937206655741, + 1.8074672054499388, + 0.20558900386095047, + 1.8227124214172363, + 0.43917604349553585, + 1.004753379151225 + ], + "unique_experts": 64, + "load_cv": 0.635389089338244, + "normalized_load_entropy": 0.9473882518645915, + "max_load_share": 0.0391566265060241 + }, + "full_input": { + "tokens": 207, + "top_k": 6, + "decisions": 1242, + "ordered_route_sha256": "56b22ff1049f5536026df8285e3447cf1c05b61bbb2398d9d1cc8b33b8166c57", + "route_weight_sha256": "e4749e570dfdcaacbbdbe790010be9ab11dec7bf5ce9fb4c943db1d33c4f132f", + "loads": [ + 11, + 35, + 9, + 13, + 12, + 11, + 58, + 19, + 11, + 25, + 32, + 18, + 21, + 14, + 30, + 13, + 14, + 26, + 30, + 11, + 4, + 27, + 9, + 30, + 29, + 30, + 5, + 3, + 25, + 40, + 8, + 8, + 12, + 41, + 9, + 17, + 27, + 29, + 18, + 36, + 19, + 10, + 28, + 27, + 55, + 19, + 4, + 7, + 9, + 6, + 14, + 12, + 23, + 10, + 18, + 26, + 6, + 14, + 19, + 32, + 4, + 35, + 11, + 14 + ], + "weighted_loads": [ + 0.45915642008185387, + 2.6967420168220997, + 0.6595072541385889, + 0.7140551395714283, + 0.5559455528855324, + 0.4130346942692995, + 3.6047886479645967, + 1.5222800858318806, + 0.6375373378396034, + 1.3512733839452267, + 1.706025192514062, + 1.109633093699813, + 1.1479131449013948, + 0.5397649109363556, + 1.6799823362380266, + 0.7408368661999702, + 1.2368072960525751, + 1.1995506696403027, + 2.4113519079983234, + 0.4517550878226757, + 0.22279947251081467, + 1.408257894217968, + 0.4708853457123041, + 2.405565433204174, + 1.2291936166584492, + 2.3938727471977472, + 0.18220042623579502, + 0.12604553811252117, + 1.4125031866133213, + 3.0110704097896814, + 0.42958392202854156, + 0.5298769064247608, + 0.7445492073893547, + 3.037475064396858, + 0.5612108614295721, + 1.0991582181304693, + 1.5961133986711502, + 1.3666946031153202, + 1.3153156526386738, + 2.0605615098029375, + 1.0904871560633183, + 0.4384569004178047, + 1.6746592205017805, + 1.4273551106452942, + 3.5949461925774813, + 1.4003816153854132, + 0.20871367678046227, + 1.3431135434657335, + 0.7494376748800278, + 0.2865179255604744, + 0.8964486345648766, + 0.8917669765651226, + 0.9372874610126019, + 0.3742617014795542, + 0.6614759601652622, + 1.7295862901955843, + 0.2815310340374708, + 0.9034729786217213, + 0.7657431717962027, + 2.005773378536105, + 0.23439292795956135, + 1.9058376718312502, + 0.43917604349553585, + 1.0573163535445929 + ], + "unique_experts": 64, + "load_cv": 0.6145021216839258, + "normalized_load_entropy": 0.9565223319224058, + "max_load_share": 0.04669887278582931 + } + }, + "s0_bos": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "ec7bb421c6e2ac6357eb2c3ac9684d8bd320a6bd32918df4e7b631b6e4374e9d", + "route_weight_sha256": "d05b419d6c793e7869dfb48db63635426aec0d972048c44e1bb7ecb4584f543e", + "loads": [ + 6, + 31, + 10, + 14, + 11, + 11, + 29, + 19, + 11, + 19, + 22, + 6, + 22, + 15, + 29, + 4, + 14, + 23, + 26, + 7, + 3, + 21, + 9, + 27, + 26, + 29, + 0, + 3, + 22, + 21, + 1, + 7, + 12, + 34, + 6, + 16, + 21, + 29, + 17, + 34, + 18, + 6, + 19, + 25, + 39, + 8, + 2, + 3, + 7, + 2, + 11, + 12, + 24, + 9, + 14, + 23, + 4, + 2, + 8, + 29, + 5, + 34, + 11, + 14 + ], + "weighted_loads": [ + 0.26463684625923634, + 2.543759571388364, + 0.6435672789812088, + 0.7672904096543789, + 0.49351272359490395, + 0.39946274645626545, + 1.2746483720839024, + 1.5648908205330372, + 0.6238345876336098, + 1.1298831850290298, + 1.0455271434038877, + 0.3549683801829815, + 1.1943618785589933, + 0.584739476442337, + 1.6557187028229237, + 0.2750684767961502, + 1.3131668381392956, + 1.1508840415626764, + 2.0930282045155764, + 0.2915348131209612, + 0.18140899762511253, + 1.194662056863308, + 0.4638092778623104, + 2.3790503665804863, + 1.188516540452838, + 2.439924666658044, + 0.0, + 0.1401859149336815, + 1.3021231088787317, + 1.464000778272748, + 0.03946338966488838, + 0.4728038161993027, + 0.7504666112363338, + 2.2259573452174664, + 0.326729292050004, + 1.0692538768053055, + 1.2424794621765614, + 1.359527027234435, + 1.306652195751667, + 2.0207861717790365, + 1.079408099874854, + 0.23831212893128395, + 1.0311194341629744, + 1.3225299902260303, + 2.354599729180336, + 0.42477752454578876, + 0.13721637055277824, + 0.08189574256539345, + 0.5052821859717369, + 0.08695914968848228, + 0.7450972069054842, + 0.8532247170805931, + 0.9751963242888451, + 0.328150050714612, + 0.5312002319842577, + 1.6878812722861767, + 0.16765760071575642, + 0.14325371757149696, + 0.2832044903188944, + 1.9578090887516737, + 0.2939770855009556, + 1.8433688282966614, + 0.4628768917173147, + 1.033788539469242 + ], + "unique_experts": 63, + "load_cv": 0.6426581265254743, + "normalized_load_entropy": 0.9459695086065074, + "max_load_share": 0.0391566265060241 + }, + "full_input": { + "tokens": 191, + "top_k": 6, + "decisions": 1146, + "ordered_route_sha256": "7e2df0d916ec86c7cf4d2e0bf340f10782bf502731666fb85f1b019c30494167", + "route_weight_sha256": "3705d0a5987b00242503b39407868b930b1451239d28903db873b7525abbf13b", + "loads": [ + 6, + 35, + 11, + 14, + 12, + 12, + 46, + 19, + 11, + 24, + 31, + 10, + 22, + 15, + 29, + 10, + 14, + 24, + 29, + 8, + 3, + 23, + 9, + 29, + 27, + 29, + 3, + 3, + 22, + 36, + 2, + 7, + 12, + 38, + 7, + 16, + 25, + 30, + 17, + 35, + 18, + 8, + 22, + 28, + 49, + 18, + 4, + 4, + 8, + 2, + 12, + 12, + 27, + 13, + 17, + 23, + 9, + 2, + 16, + 33, + 5, + 35, + 11, + 15 + ], + "weighted_loads": [ + 0.26463684625923634, + 2.7394683193415403, + 0.711451530456543, + 0.7672904096543789, + 0.5432495102286339, + 0.4304791856557131, + 2.8392219729721546, + 1.5648908205330372, + 0.6238345876336098, + 1.3656532485038042, + 1.6195116601884365, + 0.54108115285635, + 1.1943618785589933, + 0.584739476442337, + 1.6557187028229237, + 0.5839189104735851, + 1.3131668381392956, + 1.1859323810786009, + 2.2660204973071814, + 0.33386328630149364, + 0.18140899762511253, + 1.270518522709608, + 0.4638092778623104, + 2.467236664146185, + 1.2116307746618986, + 2.439924666658044, + 0.12495648115873337, + 0.1401859149336815, + 1.3021231088787317, + 2.389732101932168, + 0.08051439374685287, + 0.4728038161993027, + 0.7504666112363338, + 2.579729311168194, + 0.34956167452037334, + 1.0692538768053055, + 1.4986358750611544, + 1.3931707832962275, + 1.306652195751667, + 2.0561978947371244, + 1.079408099874854, + 0.36911430209875107, + 1.1905998829752207, + 1.4950481168925762, + 3.099420201033354, + 1.3959992472082376, + 0.20314914174377918, + 0.442887756973505, + 0.5371714606881142, + 0.08695914968848228, + 0.7819684017449617, + 0.8532247170805931, + 1.086375929415226, + 0.5293792877346277, + 0.6565961427986622, + 1.6878812722861767, + 0.4889573287218809, + 0.14325371757149696, + 0.6415880490094423, + 2.163523519411683, + 0.2939770855009556, + 1.87205059081316, + 0.4628768917173147, + 1.0720853954553604 + ], + "unique_experts": 64, + "load_cv": 0.6333491789226554, + "normalized_load_entropy": 0.950391343074393, + "max_load_share": 0.04275741710296684 + } + }, + "s1_bos": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "1966f7628b06b2b50bfcbcb9fbbb248ffbcd4fb11c3fd2cb30ddbccb2b71c24f", + "route_weight_sha256": "335c031435cfe7ff1796b262d2295e36b33eb6f6023ed74c300fce1b6d14ce58", + "loads": [ + 5, + 30, + 9, + 14, + 9, + 12, + 28, + 20, + 10, + 21, + 24, + 6, + 21, + 12, + 29, + 5, + 17, + 23, + 26, + 7, + 5, + 21, + 10, + 27, + 25, + 27, + 0, + 5, + 23, + 20, + 1, + 7, + 12, + 33, + 7, + 15, + 20, + 29, + 17, + 35, + 19, + 6, + 20, + 25, + 39, + 9, + 2, + 4, + 6, + 2, + 10, + 11, + 21, + 9, + 13, + 24, + 5, + 3, + 10, + 29, + 4, + 34, + 10, + 14 + ], + "weighted_loads": [ + 0.20312758162617683, + 2.4652887284755707, + 0.6021783202886581, + 0.7632941082119942, + 0.4148564077913761, + 0.434395344927907, + 1.157690890133381, + 1.6067972090095282, + 0.5611663311719894, + 1.172657622024417, + 1.1187404859811068, + 0.3527072574943304, + 1.1577442400157452, + 0.4791519157588482, + 1.6357119735330343, + 0.31183696165680885, + 1.4098165817558765, + 1.1692724507302046, + 2.133120747283101, + 0.29173994809389114, + 0.26052072271704674, + 1.152587041258812, + 0.5171693675220013, + 2.378505090251565, + 1.1351182740181684, + 2.346940513700247, + 0.0, + 0.19671802408993244, + 1.3787256479263306, + 1.3708941508084536, + 0.040675681084394455, + 0.464709984138608, + 0.7810227014124393, + 2.169089486822486, + 0.36325015500187874, + 1.0261889453977346, + 1.1976375710219145, + 1.3913562465459108, + 1.2658198960125446, + 2.0350079778581858, + 1.1018537636846304, + 0.2255770843476057, + 1.0469136219471693, + 1.318175869062543, + 2.388182671740651, + 0.4837719239294529, + 0.1405295394361019, + 0.11410261876881123, + 0.46418723091483116, + 0.09499403089284897, + 0.7275218740105629, + 0.8062057681381702, + 0.8947267755866051, + 0.3275112584233284, + 0.5237631630152464, + 1.6846382804214954, + 0.17721614800393581, + 0.18171199038624763, + 0.3690655119717121, + 1.9626777991652489, + 0.26415368542075157, + 1.8588506188243628, + 0.4273504037410021, + 1.0461879204958677 + ], + "unique_experts": 63, + "load_cv": 0.6318253228998035, + "normalized_load_entropy": 0.9484536672840711, + "max_load_share": 0.0391566265060241 + }, + "full_input": { + "tokens": 207, + "top_k": 6, + "decisions": 1242, + "ordered_route_sha256": "66ad4025c24de638a1784927770f53799c31898092cffd8e2af5282aaac2db75", + "route_weight_sha256": "9d23f4034b7bace055e3b37c446433e65158731c4b5c2d9db543f504840481b2", + "loads": [ + 10, + 34, + 10, + 14, + 9, + 14, + 56, + 20, + 10, + 25, + 35, + 16, + 21, + 12, + 29, + 12, + 17, + 25, + 30, + 10, + 5, + 26, + 10, + 32, + 29, + 27, + 4, + 5, + 23, + 39, + 9, + 8, + 12, + 44, + 10, + 16, + 26, + 30, + 18, + 36, + 21, + 10, + 28, + 27, + 55, + 21, + 4, + 6, + 8, + 7, + 11, + 11, + 22, + 11, + 15, + 26, + 9, + 14, + 19, + 33, + 5, + 36, + 10, + 15 + ], + "weighted_loads": [ + 0.4070287458598614, + 2.70425808057189, + 0.648701548576355, + 0.7632941082119942, + 0.4148564077913761, + 0.5014641638845205, + 3.609972169622779, + 1.6067972090095282, + 0.5611663311719894, + 1.3729521688073874, + 1.835579825565219, + 1.0530648846179247, + 1.1577442400157452, + 0.4791519157588482, + 1.6357119735330343, + 0.6877891756594181, + 1.4098165817558765, + 1.2404320519417524, + 2.34554286301136, + 0.4145212583243847, + 0.26052072271704674, + 1.3916598968207836, + 0.5171693675220013, + 2.570217987522483, + 1.31390287168324, + 2.346940513700247, + 0.15839064866304398, + 0.19671802408993244, + 1.3787256479263306, + 2.8864614758640528, + 0.4679613448679447, + 0.5052424911409616, + 0.7810227014124393, + 3.0835606176406145, + 0.589233011007309, + 1.07708858884871, + 1.6102370657026768, + 1.4247439112514257, + 1.3097029402852058, + 2.0778143648058176, + 1.1787327993661165, + 0.4349245820194483, + 1.7219448201358318, + 1.4344192761927843, + 3.5993620734661818, + 1.509215347468853, + 0.2138735055923462, + 0.5135521274060011, + 0.717877384275198, + 0.34555482119321823, + 0.7645293660461903, + 0.8062057681381702, + 0.9302272647619247, + 0.40648266300559044, + 0.5953332185745239, + 1.757374368607998, + 0.36764041520655155, + 0.8864715173840523, + 0.7506358735263348, + 2.1609839722514153, + 0.29295760951936245, + 1.9419758692383766, + 0.4273504037410021, + 1.0987508948892355 + ], + "unique_experts": 64, + "load_cv": 0.6117954792225815, + "normalized_load_entropy": 0.9573942961060532, + "max_load_share": 0.04508856682769726 + } + }, + "s0_x": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "873d4cadba99ca4c5eabb58fca3c24236856685c9c5f5b6c23d487a11d385f03", + "route_weight_sha256": "3564696d69bffbf3ebdfa81f60831c9edc526c2525c5156fe23bc0df0f63ae46", + "loads": [ + 5, + 31, + 8, + 14, + 8, + 9, + 27, + 20, + 10, + 19, + 22, + 6, + 21, + 14, + 28, + 5, + 15, + 26, + 24, + 7, + 3, + 21, + 9, + 28, + 26, + 30, + 1, + 6, + 24, + 24, + 1, + 7, + 12, + 35, + 7, + 15, + 20, + 29, + 17, + 34, + 18, + 6, + 18, + 26, + 39, + 9, + 2, + 3, + 7, + 1, + 11, + 12, + 21, + 8, + 14, + 24, + 5, + 3, + 10, + 30, + 4, + 32, + 12, + 13 + ], + "weighted_loads": [ + 0.2210442591458559, + 2.5425903275609016, + 0.5680384300649166, + 0.7728447206318378, + 0.3549572639167309, + 0.34539517015218735, + 1.1157883238047361, + 1.5967492312192917, + 0.5637498870491982, + 1.1315073035657406, + 1.056373979896307, + 0.3569786883890629, + 1.1584618352353573, + 0.5443427059799433, + 1.6164447516202927, + 0.3264892101287842, + 1.3992548305541277, + 1.2959880139678717, + 2.089198224246502, + 0.2992838844656944, + 0.1818508468568325, + 1.2043528519570827, + 0.46597268618643284, + 2.438834799453616, + 1.1715996861457825, + 2.468695502728224, + 0.023690558969974518, + 0.24768423661589622, + 1.3345100209116936, + 1.5331051349639893, + 0.0387251116335392, + 0.4747181721031666, + 0.7402280196547508, + 2.2866994235664606, + 0.3564314227551222, + 1.0309091843664646, + 1.1895500496029854, + 1.3310896083712578, + 1.3028287626802921, + 2.0566896237432957, + 1.0586257968097925, + 0.25458092242479324, + 0.9537496063858271, + 1.3771334774792194, + 2.4124644324183464, + 0.4548335541039705, + 0.1266816481947899, + 0.08309347368776798, + 0.5337549187242985, + 0.040466323494911194, + 0.7408406157046556, + 0.8304827325046062, + 0.8714438211172819, + 0.2943982481956482, + 0.5357141606509686, + 1.7800153903663158, + 0.19485141336917877, + 0.17505360394716263, + 0.34836195781826973, + 1.9795437306165695, + 0.2598276436328888, + 1.7723901513963938, + 0.4845560882240534, + 0.9904826916754246 + ], + "unique_experts": 64, + "load_cv": 0.641854521035547, + "normalized_load_entropy": 0.947066358518368, + "max_load_share": 0.0391566265060241 + }, + "full_input": { + "tokens": 191, + "top_k": 6, + "decisions": 1146, + "ordered_route_sha256": "a9c30aa0db689621ff36b93a6200b826e71400973e32c20b1f2ffde8e33fbd29", + "route_weight_sha256": "07ab08bcdf667d919b35335a9bfde316923cce841e2f3c2dd03e64e8eb1bf01b", + "loads": [ + 5, + 33, + 8, + 14, + 8, + 10, + 45, + 20, + 10, + 21, + 32, + 11, + 21, + 14, + 28, + 12, + 15, + 27, + 26, + 8, + 3, + 23, + 9, + 31, + 30, + 30, + 4, + 6, + 24, + 39, + 2, + 7, + 12, + 41, + 8, + 15, + 24, + 30, + 17, + 35, + 18, + 8, + 21, + 27, + 51, + 21, + 5, + 4, + 8, + 1, + 12, + 12, + 24, + 11, + 16, + 24, + 9, + 3, + 16, + 34, + 4, + 33, + 12, + 14 + ], + "weighted_loads": [ + 0.2210442591458559, + 2.643229316920042, + 0.5680384300649166, + 0.7728447206318378, + 0.3549572639167309, + 0.376411609351635, + 2.61369395442307, + 1.5967492312192917, + 0.5637498870491982, + 1.2078934032469988, + 1.634408699348569, + 0.6113834530115128, + 1.1584618352353573, + 0.5443427059799433, + 1.6164447516202927, + 0.8566363416612148, + 1.3992548305541277, + 1.3310363534837961, + 2.234337020665407, + 0.3416123576462269, + 0.1818508468568325, + 1.277267001569271, + 0.46597268618643284, + 2.565646657720208, + 1.3363206163048744, + 2.468695502728224, + 0.14864704012870789, + 0.24768423661589622, + 1.3345100209116936, + 2.4980851113796234, + 0.08258668333292007, + 0.4747181721031666, + 0.7402280196547508, + 2.754149792715907, + 0.3792638052254915, + 1.0309091843664646, + 1.4586688186973333, + 1.3647333644330502, + 1.3028287626802921, + 2.0921013467013836, + 1.0586257968097925, + 0.37549809738993645, + 1.08752959407866, + 1.4225666634738445, + 3.312477506697178, + 1.6663705985993147, + 0.22006181254982948, + 0.44408548809587955, + 0.5656441934406757, + 0.040466323494911194, + 0.7777118105441332, + 0.8304827325046062, + 0.9826234262436628, + 0.4309079349040985, + 0.6236518193036318, + 1.7800153903663158, + 0.39255084097385406, + 0.17505360394716263, + 0.610368961468339, + 2.185258161276579, + 0.2598276436328888, + 1.8010719139128923, + 0.4845560882240534, + 1.028779547661543 + ], + "unique_experts": 64, + "load_cv": 0.6452406094017089, + "normalized_load_entropy": 0.9493640789657392, + "max_load_share": 0.04450261780104712 + } + }, + "s1_x": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "80a03c368e00d9e9f184be200faba649284566f6296bdad6f51d8184cfc62f43", + "route_weight_sha256": "2875800b2dd6a69c450d767ab2de42120a4fe2d8df1ac98d511f8f834a6ade05", + "loads": [ + 5, + 30, + 10, + 13, + 10, + 9, + 28, + 20, + 10, + 22, + 21, + 6, + 21, + 14, + 28, + 5, + 16, + 26, + 26, + 6, + 4, + 22, + 10, + 28, + 25, + 29, + 1, + 6, + 22, + 24, + 1, + 7, + 12, + 34, + 6, + 14, + 20, + 30, + 17, + 35, + 18, + 7, + 18, + 20, + 39, + 10, + 3, + 4, + 8, + 1, + 9, + 12, + 19, + 8, + 14, + 25, + 6, + 2, + 8, + 31, + 3, + 33, + 12, + 13 + ], + "weighted_loads": [ + 0.205419035628438, + 2.4181123692542315, + 0.6487814113497734, + 0.712259765714407, + 0.43627009727060795, + 0.339502714574337, + 1.1451786253601313, + 1.5733149908483028, + 0.5517325736582279, + 1.2464099135249853, + 1.0356868021190166, + 0.35335261188447475, + 1.1540876850485802, + 0.5286920703947544, + 1.622662866488099, + 0.30421430990099907, + 1.393948907032609, + 1.3432807233184576, + 2.314256126061082, + 0.2585752233862877, + 0.2242959477007389, + 1.2030833754688501, + 0.5083258170634508, + 2.5009618140757084, + 1.1150851659476757, + 2.4478542506694794, + 0.027728335931897163, + 0.24476885236799717, + 1.315429812297225, + 1.4974476154893637, + 0.04157459735870361, + 0.46354618296027184, + 0.7728230338543653, + 2.2751497868448496, + 0.3211903851479292, + 1.0107290782034397, + 1.1744494047015905, + 1.4177935048937798, + 1.2798372581601143, + 2.071454467251897, + 1.076593915000558, + 0.27024002373218536, + 0.9276832640171051, + 1.1083962097764015, + 2.51855849288404, + 0.5097509901970625, + 0.1593032106757164, + 0.12200314551591873, + 0.544045265763998, + 0.04364995285868645, + 0.7117922566831112, + 0.8466184958815575, + 0.835283113643527, + 0.29866995103657246, + 0.5507109593600035, + 1.7502308674156666, + 0.22599546425044537, + 0.14036652818322182, + 0.2894526980817318, + 2.0235722698271275, + 0.2001449353992939, + 1.8113258574157953, + 0.4866230096668005, + 0.9970837496221066 + ], + "unique_experts": 64, + "load_cv": 0.6379224476951715, + "normalized_load_entropy": 0.9480212168145423, + "max_load_share": 0.0391566265060241 + }, + "full_input": { + "tokens": 207, + "top_k": 6, + "decisions": 1242, + "ordered_route_sha256": "c2d4a74ee18d50af1acd5d06df739e8290dee8450bfc25003914e05491465ade", + "route_weight_sha256": "77bf8f4bc257b893ac3174af6e9eef730816fd2c355b70b7397583e299dabaa6", + "loads": [ + 10, + 33, + 10, + 13, + 10, + 11, + 57, + 20, + 10, + 23, + 30, + 16, + 21, + 14, + 28, + 13, + 16, + 28, + 30, + 9, + 4, + 28, + 10, + 33, + 30, + 29, + 6, + 6, + 22, + 44, + 9, + 8, + 12, + 47, + 9, + 15, + 25, + 31, + 18, + 36, + 20, + 12, + 27, + 20, + 57, + 22, + 6, + 6, + 10, + 6, + 10, + 12, + 20, + 10, + 16, + 28, + 9, + 13, + 13, + 35, + 4, + 36, + 12, + 14 + ], + "weighted_loads": [ + 0.40932019986212254, + 2.5750191938132048, + 0.6487814113497734, + 0.712259765714407, + 0.43627009727060795, + 0.40657153353095055, + 3.430682834237814, + 1.5733149908483028, + 0.5517325736582279, + 1.2768464591354132, + 1.6180512346327305, + 1.0661208387464285, + 1.1540876850485802, + 0.5286920703947544, + 1.622662866488099, + 0.8219172470271587, + 1.393948907032609, + 1.4144403245300055, + 2.56350140273571, + 0.38135653361678123, + 0.2242959477007389, + 1.4759294167160988, + 0.5083258170634508, + 2.7111991494894028, + 1.3243712037801743, + 2.4478542506694794, + 0.21841326169669628, + 0.24476885236799717, + 1.315429812297225, + 2.9631369803100824, + 0.48205288872122765, + 0.5040786899626255, + 0.7728230338543653, + 3.317293433472514, + 0.5471732411533594, + 1.0616287216544151, + 1.5326322093605995, + 1.4511811695992947, + 1.3237203024327755, + 2.1142608541995287, + 1.153472950682044, + 0.4851340614259243, + 1.639395808801055, + 1.1083962097764015, + 3.9080125968903303, + 1.6341227870434523, + 0.2757086791098118, + 0.5214526541531086, + 0.7977354191243649, + 0.2942107431590557, + 0.7487997487187386, + 0.8466184958815575, + 0.8707836028188467, + 0.3776413556188345, + 0.622281014919281, + 1.8635152839124203, + 0.37787441350519657, + 0.8451260551810265, + 0.46746378019452095, + 2.221878442913294, + 0.22894885949790478, + 1.929601963609457, + 0.4866230096668005, + 1.0496467240154743 + ], + "unique_experts": 64, + "load_cv": 0.6293783552868112, + "normalized_load_entropy": 0.9561779068315875, + "max_load_share": 0.04589371980676329 + } + }, + "s0_period": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "68207483ee31d3c9f0e7b46bc745f3922b45a7ca7006910e58e61a2f0a087f5a", + "route_weight_sha256": "1c02e72693ad99075023f402908e8f89df93c34465a5ff262282f8dd616c119f", + "loads": [ + 5, + 34, + 8, + 14, + 9, + 10, + 28, + 20, + 11, + 19, + 22, + 6, + 21, + 16, + 29, + 6, + 15, + 23, + 25, + 7, + 3, + 21, + 10, + 28, + 26, + 30, + 1, + 6, + 20, + 23, + 1, + 7, + 12, + 34, + 7, + 15, + 20, + 28, + 17, + 33, + 18, + 6, + 18, + 26, + 40, + 9, + 2, + 3, + 7, + 1, + 11, + 12, + 20, + 8, + 13, + 24, + 5, + 2, + 11, + 28, + 5, + 32, + 11, + 14 + ], + "weighted_loads": [ + 0.21937454864382744, + 2.617011709138751, + 0.5733948312699795, + 0.7738100253045559, + 0.3776782341301441, + 0.37227631732821465, + 1.148274602368474, + 1.5961217526346445, + 0.5985347833484411, + 1.1298895347863436, + 1.0471620578318834, + 0.3577885441482067, + 1.1595639735460281, + 0.6057476233690977, + 1.6394369322806597, + 0.35344990901649, + 1.3916003704071045, + 1.1906048022210598, + 2.156643720343709, + 0.29990117251873016, + 0.18210655450820923, + 1.1957483254373074, + 0.5038732048124075, + 2.4687308836728334, + 1.1726466659456491, + 2.4406199380755424, + 0.024451518431305885, + 0.2330361194908619, + 1.2164238058030605, + 1.6244001239538193, + 0.03883904963731766, + 0.4639490507543087, + 0.7422257792204618, + 2.27294678427279, + 0.36309922486543655, + 1.0163395684212446, + 1.2050870303064585, + 1.3297814559191465, + 1.297906544059515, + 2.0216767862439156, + 1.0687400046736002, + 0.24947992339730263, + 0.9356420300900936, + 1.3705596942454576, + 2.467364463955164, + 0.45471398159861565, + 0.12927645444869995, + 0.08331972174346447, + 0.5216649584472179, + 0.04128769412636757, + 0.7466351184993982, + 0.840981051325798, + 0.8478735517710447, + 0.29764129780232906, + 0.5052448138594627, + 1.785346319898963, + 0.1951950155198574, + 0.13959278538823128, + 0.3848420847207308, + 1.9169046878814697, + 0.2973499521613121, + 1.7556527014821768, + 0.4561212696135044, + 1.0194613728672266 + ], + "unique_experts": 64, + "load_cv": 0.6349828140527526, + "normalized_load_entropy": 0.9481945963533764, + "max_load_share": 0.040160642570281124 + }, + "full_input": { + "tokens": 191, + "top_k": 6, + "decisions": 1146, + "ordered_route_sha256": "bff06b2f411a8a43b79b7059fc359d564aa020763a02ce8fd44905fc3a4b5248", + "route_weight_sha256": "979421a527ccaf109bc85ddd709b4351cf667d18ea5968e4853d6e0d6145423f", + "loads": [ + 5, + 37, + 8, + 14, + 9, + 11, + 45, + 20, + 11, + 21, + 31, + 11, + 21, + 16, + 30, + 12, + 15, + 24, + 28, + 8, + 3, + 23, + 10, + 31, + 29, + 30, + 4, + 6, + 20, + 39, + 2, + 7, + 12, + 41, + 8, + 15, + 25, + 29, + 17, + 34, + 18, + 9, + 21, + 28, + 51, + 20, + 4, + 4, + 8, + 1, + 12, + 12, + 23, + 11, + 15, + 24, + 8, + 2, + 17, + 32, + 5, + 33, + 11, + 15 + ], + "weighted_loads": [ + 0.21937454864382744, + 2.9008377473801374, + 0.5733948312699795, + 0.7738100253045559, + 0.3776782341301441, + 0.4032927565276623, + 2.6889353711158037, + 1.5961217526346445, + 0.5985347833484411, + 1.2062756344676018, + 1.6413685753941536, + 0.6153177507221699, + 1.1595639735460281, + 0.6057476233690977, + 1.672991657629609, + 0.6623003426939249, + 1.3916003704071045, + 1.2256531417369843, + 2.3290616925805807, + 0.3422296456992626, + 0.18210655450820923, + 1.2708493508398533, + 0.5038732048124075, + 2.608693005517125, + 1.3606834504753351, + 2.4406199380755424, + 0.14940799959003925, + 0.2330361194908619, + 1.2164238058030605, + 2.6245905943214893, + 0.08600445836782455, + 0.4639490507543087, + 0.7422257792204618, + 2.7716902289539576, + 0.3859316073358059, + 1.0163395684212446, + 1.5422908701002598, + 1.363425211980939, + 1.297906544059515, + 2.0570885092020035, + 1.0687400046736002, + 0.40704726055264473, + 1.0635000206530094, + 1.4772963356226683, + 3.2793059945106506, + 1.4653574638068676, + 0.1952092256397009, + 0.44431173615157604, + 0.5535542331635952, + 0.04128769412636757, + 0.7835063133388758, + 0.840981051325798, + 0.9590531568974257, + 0.4341509845107794, + 0.593182472512126, + 1.785346319898963, + 0.3619348555803299, + 0.13959278538823128, + 0.6366917844861746, + 2.122619118541479, + 0.2973499521613121, + 1.7843344639986753, + 0.4561212696135044, + 1.057758228853345 + ], + "unique_experts": 64, + "load_cv": 0.643349721100293, + "normalized_load_entropy": 0.9495850694514774, + "max_load_share": 0.04450261780104712 + } + }, + "s1_period": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "777070efb0982270e6522e8b96132f1068deb090abb2bc72bde94fcfecd01692", + "route_weight_sha256": "88f9b2c3c4bcb3a6cda4784e13f5690b5f610bf59c14aa3bab701650b867839c", + "loads": [ + 5, + 35, + 10, + 13, + 9, + 10, + 26, + 20, + 10, + 21, + 20, + 6, + 21, + 14, + 28, + 6, + 14, + 26, + 26, + 8, + 4, + 21, + 10, + 31, + 26, + 29, + 1, + 6, + 20, + 24, + 2, + 7, + 12, + 34, + 7, + 15, + 21, + 30, + 17, + 34, + 18, + 6, + 17, + 21, + 41, + 10, + 3, + 3, + 6, + 1, + 9, + 12, + 19, + 8, + 14, + 24, + 4, + 3, + 9, + 29, + 4, + 33, + 10, + 13 + ], + "weighted_loads": [ + 0.20873952843248844, + 2.5882260091602802, + 0.6585361585021019, + 0.7079148571938276, + 0.3883632719516754, + 0.3665605466812849, + 1.067773075774312, + 1.576473606750369, + 0.5451308637857437, + 1.2158682122826576, + 0.9679934773594141, + 0.3547121323645115, + 1.156580064445734, + 0.5384126398712397, + 1.6244290918111801, + 0.3325151167809963, + 1.3017827700823545, + 1.3011669386178255, + 2.250526061281562, + 0.33220086991786957, + 0.2315441071987152, + 1.1785141807049513, + 0.49809831008315086, + 2.5826574359089136, + 1.162885870784521, + 2.4252192452549934, + 0.027445754036307335, + 0.24124877341091633, + 1.2226127088069916, + 1.5683826748281717, + 0.06927656941115856, + 0.4556269012391567, + 0.7675476633012295, + 2.2637598253786564, + 0.3568205200135708, + 1.0335769802331924, + 1.2075869739055634, + 1.4559856075793505, + 1.2862323597073555, + 2.05233446508646, + 1.0883494727313519, + 0.23591448925435543, + 0.914007468149066, + 1.1754828430712223, + 2.5722884498536587, + 0.5170806553214788, + 0.16053964756429195, + 0.08541095070540905, + 0.4736348632723093, + 0.0463230162858963, + 0.6929385811090469, + 0.8359778933227062, + 0.8333307188004255, + 0.3027846794575453, + 0.5458041932433844, + 1.7188760992139578, + 0.1546038817614317, + 0.17102208361029625, + 0.32245663180947304, + 1.9747146926820278, + 0.25623827427625656, + 1.7924691587686539, + 0.42395492270588875, + 0.9895071797072887 + ], + "unique_experts": 64, + "load_cv": 0.6451629422189004, + "normalized_load_entropy": 0.9479318452484945, + "max_load_share": 0.04116465863453815 + }, + "full_input": { + "tokens": 207, + "top_k": 6, + "decisions": 1242, + "ordered_route_sha256": "839f52e3d41152cc9a8a4583e08b908b3a6ef4f4c97b0914f04178b7dbbb650d", + "route_weight_sha256": "67c8baca0f39d56588d95b4a349142afd1f282a5e4b4629c3e7e6ef541b60ef3", + "loads": [ + 10, + 39, + 10, + 13, + 9, + 12, + 53, + 20, + 10, + 22, + 29, + 17, + 21, + 14, + 28, + 13, + 14, + 28, + 30, + 11, + 4, + 27, + 10, + 36, + 30, + 29, + 5, + 6, + 20, + 45, + 10, + 9, + 12, + 48, + 10, + 16, + 27, + 31, + 18, + 35, + 20, + 12, + 25, + 22, + 59, + 22, + 5, + 5, + 8, + 6, + 10, + 12, + 20, + 10, + 16, + 26, + 7, + 14, + 15, + 33, + 5, + 35, + 10, + 14 + ], + "weighted_loads": [ + 0.412640692666173, + 2.9388762414455414, + 0.6585361585021019, + 0.7079148571938276, + 0.3883632719516754, + 0.43362936563789845, + 3.225083537399769, + 1.576473606750369, + 0.5451308637857437, + 1.2463047578930855, + 1.5895306896418333, + 1.1024647317826748, + 1.156580064445734, + 0.5384126398712397, + 1.6244290918111801, + 0.7084673307836056, + 1.3017827700823545, + 1.3723265398293734, + 2.476413246244192, + 0.4549821801483631, + 0.2315441071987152, + 1.4515867736190557, + 0.49809831008315086, + 2.7986736092716455, + 1.4427779391407967, + 2.4252192452549934, + 0.1858364026993513, + 0.24124877341091633, + 1.2226127088069916, + 3.113839277997613, + 0.5101792942732573, + 0.5300683937966824, + 0.7675476633012295, + 3.366340797394514, + 0.582803376019001, + 1.0844766236841679, + 1.6230263616889715, + 1.4893732722848654, + 1.3301154039800167, + 2.095140852034092, + 1.165228508412838, + 0.4887834582477808, + 1.5624215379357338, + 1.2139292806386948, + 3.9316937383264303, + 1.529034286737442, + 0.23388361372053623, + 0.4848604593425989, + 0.7273250166326761, + 0.29688380658626556, + 0.7299460731446743, + 0.8359778933227062, + 0.8688312079757452, + 0.3817560840398073, + 0.6173742488026619, + 1.7916121874004602, + 0.3064828310161829, + 0.8757816106081009, + 0.546448215842247, + 2.173020865768194, + 0.28504219837486744, + 1.8755944091826677, + 0.42395492270588875, + 1.0420701541006565 + ], + "unique_experts": 64, + "load_cv": 0.6333212753720019, + "normalized_load_entropy": 0.9554485700678703, + "max_load_share": 0.04750402576489533 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 166, + "ordered_topk_exact_tokens": 119, + "set_exact_tokens": 144, + "mean_set_jaccard": 0.9608433734939759, + "mean_token_weighted_tv": 0.010516694068055913, + "aggregate_load_tv": 0.016064257028112452 + }, + "system_bos": { + "tokens": 166, + "ordered_topk_exact_tokens": 98, + "set_exact_tokens": 119, + "mean_set_jaccard": 0.9178141135972463, + "mean_token_weighted_tv": 0.01713724895548749, + "aggregate_load_tv": 0.027108433734939763 + }, + "system_x": { + "tokens": 166, + "ordered_topk_exact_tokens": 91, + "set_exact_tokens": 119, + "mean_set_jaccard": 0.9100688468158349, + "mean_token_weighted_tv": 0.020598563741533512, + "aggregate_load_tv": 0.025100401606425696 + }, + "system_period": { + "tokens": 166, + "ordered_topk_exact_tokens": 86, + "set_exact_tokens": 110, + "mean_set_jaccard": 0.897160068846816, + "mean_token_weighted_tv": 0.021855699936354375, + "aggregate_load_tv": 0.02710843373493976 + }, + "bos_at_s0": { + "tokens": 166, + "ordered_topk_exact_tokens": 92, + "set_exact_tokens": 112, + "mean_set_jaccard": 0.9031841652323579, + "mean_token_weighted_tv": 0.020952194631772947, + "aggregate_load_tv": 0.031124497991967877 + }, + "bos_at_s1": { + "tokens": 166, + "ordered_topk_exact_tokens": 86, + "set_exact_tokens": 107, + "mean_set_jaccard": 0.8894148020654045, + "mean_token_weighted_tv": 0.023577124430203295, + "aggregate_load_tv": 0.032128514056224904 + }, + "x_at_s0": { + "tokens": 166, + "ordered_topk_exact_tokens": 84, + "set_exact_tokens": 113, + "mean_set_jaccard": 0.9023235800344234, + "mean_token_weighted_tv": 0.021597853934684073, + "aggregate_load_tv": 0.03112449799196787 + }, + "x_at_s1": { + "tokens": 166, + "ordered_topk_exact_tokens": 77, + "set_exact_tokens": 102, + "mean_set_jaccard": 0.8749282845668388, + "mean_token_weighted_tv": 0.028489238778914672, + "aggregate_load_tv": 0.0391566265060241 + }, + "period_at_s0": { + "tokens": 166, + "ordered_topk_exact_tokens": 81, + "set_exact_tokens": 107, + "mean_set_jaccard": 0.8919965576592084, + "mean_token_weighted_tv": 0.022370770343590574, + "aggregate_load_tv": 0.032128514056224904 + }, + "period_at_s1": { + "tokens": 166, + "ordered_topk_exact_tokens": 78, + "set_exact_tokens": 99, + "mean_set_jaccard": 0.8671830177854275, + "mean_token_weighted_tv": 0.029302194035690593, + "aggregate_load_tv": 0.040160642570281124 + } + } + }, + "layer_14": { + "layer": 14, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "4951ddee7adb6c2e1d65da738b4a70ab2b1c7e1f4a96881eb5bbbe8015e53057", + "route_weight_sha256": "3f698bc61e295ad98ab4f7cef418b6d087467926c4e992e0576f36c014b7be9e", + "loads": [ + 6, + 10, + 10, + 13, + 8, + 21, + 8, + 23, + 8, + 16, + 9, + 37, + 12, + 32, + 11, + 17, + 16, + 9, + 17, + 8, + 12, + 8, + 0, + 18, + 10, + 20, + 49, + 6, + 18, + 8, + 18, + 7, + 2, + 19, + 3, + 3, + 20, + 16, + 7, + 19, + 14, + 11, + 14, + 43, + 3, + 10, + 16, + 25, + 8, + 27, + 35, + 17, + 22, + 52, + 12, + 5, + 47, + 23, + 3, + 16, + 12, + 9, + 10, + 8 + ], + "weighted_loads": [ + 0.6666236743330956, + 0.651397954672575, + 0.6304743327200413, + 0.473746120929718, + 0.4724166262894869, + 1.190696433186531, + 0.7300787828862667, + 0.9819097798317671, + 0.3629886358976364, + 1.176103238016367, + 0.47953199222683907, + 2.174478217959404, + 0.7218459583818913, + 2.0748527981340885, + 0.9402068369090557, + 0.7067184094339609, + 0.6625339835882187, + 0.43135692179203033, + 0.709708284586668, + 0.5727460142225027, + 0.8900193572044373, + 0.5005414634943008, + 0.0, + 0.8209813237190247, + 0.3608371578156948, + 1.0920736659318209, + 8.152359476312995, + 0.25370023027062416, + 1.0926841162145138, + 0.34556389786303043, + 0.8252596706151962, + 0.2584951426833868, + 0.30346620082855225, + 1.5657313987612724, + 0.12558700889348984, + 0.1446811817586422, + 0.9690600037574768, + 1.0919551700353622, + 0.38118426874279976, + 0.9660753775388002, + 0.9574968479573727, + 0.6271815970540047, + 0.931131724268198, + 2.8611650969833136, + 0.12358758598566055, + 0.3828828055411577, + 0.5547093022614717, + 1.2830939292907715, + 0.39513909816741943, + 1.2371291052550077, + 2.1462278477847576, + 0.6423626728355885, + 1.972858801484108, + 4.735374551266432, + 0.6002904083579779, + 0.20392212644219398, + 4.894248224794865, + 0.9862812049686909, + 0.12754620984196663, + 0.7022725231945515, + 0.6082964204251766, + 0.37904518097639084, + 0.7828137874603271, + 0.30424346402287483 + ], + "unique_experts": 63, + "load_cv": 0.7241287939877079, + "normalized_load_entropy": 0.9440381181380049, + "max_load_share": 0.05220883534136546 + }, + "full_input": { + "tokens": 191, + "top_k": 6, + "decisions": 1146, + "ordered_route_sha256": "ecc80c70acb607f2c707620aff1b1984bcb51470a73480c96eef5626c30ee359", + "route_weight_sha256": "a88f4cb7aa7145a43897aafd5c5ef1b1e39e179df553021ed02b370b6720dfa3", + "loads": [ + 14, + 10, + 10, + 15, + 8, + 31, + 8, + 25, + 8, + 25, + 11, + 40, + 12, + 32, + 11, + 21, + 16, + 9, + 21, + 9, + 12, + 9, + 0, + 29, + 11, + 23, + 55, + 11, + 27, + 8, + 20, + 12, + 2, + 26, + 3, + 3, + 21, + 18, + 9, + 19, + 14, + 11, + 16, + 43, + 5, + 10, + 21, + 28, + 9, + 27, + 38, + 23, + 28, + 59, + 12, + 8, + 48, + 24, + 3, + 25, + 12, + 10, + 10, + 8 + ], + "weighted_loads": [ + 1.396988594904542, + 0.651397954672575, + 0.6304743327200413, + 0.552512876689434, + 0.4724166262894869, + 2.1181821189820766, + 0.7300787828862667, + 1.0548849906772375, + 0.3629886358976364, + 1.7412167228758335, + 0.5428234934806824, + 2.3603080175817013, + 0.7218459583818913, + 2.0748527981340885, + 0.9402068369090557, + 0.8622918631881475, + 0.6625339835882187, + 0.43135692179203033, + 0.9744301959872246, + 0.6125968154519796, + 0.8900193572044373, + 0.5369918644428253, + 0.0, + 1.2922541461884975, + 0.3834759537130594, + 1.2210257574915886, + 8.495474983006716, + 0.5938955238088965, + 2.3335872553288937, + 0.34556389786303043, + 0.9890938177704811, + 0.4603459006175399, + 0.30346620082855225, + 2.201574672013521, + 0.12558700889348984, + 0.1446811817586422, + 1.0198406241834164, + 1.1878693327307701, + 0.5417711921036243, + 0.9660753775388002, + 0.9574968479573727, + 0.6271815970540047, + 1.0496449396014214, + 2.8611650969833136, + 0.1855778992176056, + 0.3828828055411577, + 0.8168768417090178, + 1.418499356135726, + 0.4170316159725189, + 1.2371291052550077, + 2.2663477063179016, + 1.9440722297877073, + 2.72385510802269, + 5.212433706969023, + 0.6002904083579779, + 0.47732262685894966, + 4.934264961630106, + 1.0222554542124271, + 0.12754620984196663, + 1.106414508074522, + 0.6082964204251766, + 0.38405069475993514, + 0.7828137874603271, + 0.30424346402287483 + ], + "unique_experts": 63, + "load_cv": 0.6934378793496625, + "normalized_load_entropy": 0.9464699295913015, + "max_load_share": 0.05148342059336824 + } + }, + "s1_eos": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "1220769d65a7e0e8635b4aa0e5e891b9010fbb6dc3478977869ba394d83f5f09", + "route_weight_sha256": "772147f4884dc9706729b58727c6f0e0a57d085d9944f9969de3f53f1e1bb0de", + "loads": [ + 6, + 9, + 10, + 11, + 7, + 23, + 9, + 23, + 6, + 17, + 9, + 35, + 13, + 32, + 14, + 15, + 19, + 9, + 17, + 8, + 11, + 9, + 1, + 19, + 7, + 21, + 49, + 5, + 16, + 7, + 22, + 7, + 3, + 17, + 2, + 3, + 21, + 16, + 6, + 16, + 15, + 12, + 16, + 45, + 4, + 9, + 14, + 26, + 7, + 26, + 37, + 20, + 22, + 51, + 11, + 5, + 45, + 21, + 3, + 17, + 14, + 9, + 10, + 7 + ], + "weighted_loads": [ + 0.6397367622703314, + 0.5891616567969322, + 0.6191229075193405, + 0.40242092311382294, + 0.43890297412872314, + 1.2573028281331062, + 0.7510338723659515, + 0.9850849900394678, + 0.2916474975645542, + 1.2130289673805237, + 0.4809572286903858, + 2.0890706796199083, + 0.7338533140718937, + 2.101280441507697, + 1.0404906906187534, + 0.6408647149801254, + 0.7328428421169519, + 0.40928270295262337, + 0.7309966459870338, + 0.5740089658647776, + 0.8374076150357723, + 0.5372898392379284, + 0.0545111820101738, + 0.8601981308311224, + 0.26328144036233425, + 1.1008633375167847, + 8.040538711473346, + 0.21263891831040382, + 1.02865931391716, + 0.3123970180749893, + 0.9858309477567673, + 0.26450804993510246, + 0.32375550642609596, + 1.4898101761937141, + 0.08953025564551353, + 0.14343297481536865, + 0.9740077592432499, + 1.0852886475622654, + 0.3396642655134201, + 0.847541905939579, + 1.0281592905521393, + 0.6783250123262405, + 0.9641581661999226, + 2.983108116313815, + 0.15950750932097435, + 0.3561764322221279, + 0.5004560574889183, + 1.311469279229641, + 0.35052451118826866, + 1.193164724856615, + 2.1164778601378202, + 0.742721501737833, + 1.947302721440792, + 4.644778223708272, + 0.5777790732681751, + 0.20822566002607346, + 4.802635412663221, + 0.9263726994395256, + 0.12294063717126846, + 0.7431674487888813, + 0.6816638596355915, + 0.38241273909807205, + 0.7977331951260567, + 0.2792694941163063 + ], + "unique_experts": 64, + "load_cv": 0.7281269588774065, + "normalized_load_entropy": 0.9433555654983837, + "max_load_share": 0.05120481927710843 + }, + "full_input": { + "tokens": 207, + "top_k": 6, + "decisions": 1242, + "ordered_route_sha256": "82d63b3f53be1cf58f2ec4856913cb3882dd699f5cecd5fabc223a6fc7809da1", + "route_weight_sha256": "d4581d2a75f9e4852df49c9ae7474dac1e2739674ea9361313a5000ca9dc8172", + "loads": [ + 14, + 10, + 10, + 14, + 10, + 39, + 9, + 27, + 8, + 29, + 9, + 38, + 18, + 32, + 14, + 20, + 19, + 9, + 24, + 12, + 13, + 14, + 1, + 29, + 13, + 26, + 54, + 12, + 30, + 8, + 26, + 10, + 5, + 28, + 3, + 4, + 22, + 19, + 9, + 17, + 15, + 12, + 18, + 46, + 6, + 9, + 20, + 29, + 10, + 26, + 51, + 23, + 30, + 60, + 13, + 8, + 46, + 23, + 4, + 35, + 17, + 11, + 12, + 10 + ], + "weighted_loads": [ + 1.420923413708806, + 0.6413003280758858, + 0.6191229075193405, + 0.5167722143232822, + 0.6476299688220024, + 2.3867111820727587, + 0.7510338723659515, + 1.1501507107168436, + 0.459498081356287, + 2.065239328891039, + 0.4809572286903858, + 2.30134523101151, + 1.0929588824510574, + 2.101280441507697, + 1.0404906906187534, + 0.8549471087753773, + 0.7328428421169519, + 0.40928270295262337, + 1.1809125114232302, + 0.7745934408158064, + 1.0669961012899876, + 0.7318172100931406, + 0.0545111820101738, + 1.2801772113889456, + 0.546748548746109, + 1.2957136668264866, + 8.383100779727101, + 0.4763388130813837, + 2.7250375226140022, + 0.36093681678175926, + 1.1978367734700441, + 0.3514975681900978, + 0.4028760604560375, + 2.635014120489359, + 0.13682370632886887, + 0.2235630303621292, + 1.0141481682658195, + 1.4365696161985397, + 0.5792443007230759, + 0.9057355746626854, + 1.0281592905521393, + 0.6783250123262405, + 1.062103882431984, + 3.027539299800992, + 0.2213930357247591, + 0.3561764322221279, + 0.8307630605995655, + 1.4333162978291512, + 0.4967467933893204, + 1.193164724856615, + 3.016853777691722, + 1.9554787166416645, + 2.730800796300173, + 5.3450479451566935, + 0.6600152477622032, + 0.44890664517879486, + 4.856115527451038, + 1.0065067559480667, + 0.22996456176042557, + 1.7731084264814854, + 0.9330871775746346, + 0.4274278120137751, + 0.9004241898655891, + 0.3872077390551567 + ], + "unique_experts": 64, + "load_cv": 0.6663923914782748, + "normalized_load_entropy": 0.9505794228117576, + "max_load_share": 0.04830917874396135 + } + }, + "s0_bos": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "e8849e5f196c867a2020445fda41d9727c747ab6aaf454de9e3fec369bbb61ce", + "route_weight_sha256": "8e1d1d6a5f9c4113ca617cd2bf3c934aa0c77d9a930661aa75cde93a76a199c3", + "loads": [ + 6, + 8, + 9, + 13, + 6, + 20, + 9, + 20, + 9, + 15, + 10, + 38, + 12, + 32, + 11, + 16, + 17, + 9, + 14, + 8, + 12, + 11, + 2, + 20, + 7, + 22, + 49, + 10, + 20, + 8, + 21, + 3, + 2, + 19, + 2, + 3, + 22, + 15, + 7, + 18, + 14, + 13, + 16, + 43, + 3, + 6, + 13, + 23, + 8, + 25, + 39, + 20, + 23, + 50, + 11, + 3, + 47, + 22, + 3, + 17, + 14, + 9, + 10, + 9 + ], + "weighted_loads": [ + 0.678396275267005, + 0.5652571469545364, + 0.5930071510374546, + 0.45872708782553673, + 0.4109075553715229, + 1.1651215925812721, + 0.7759929709136486, + 0.8500186018645763, + 0.41575414687395096, + 1.0779416784644127, + 0.5081458613276482, + 2.2593417912721634, + 0.7113994769752026, + 2.109439978376031, + 0.9933314807713032, + 0.663552563637495, + 0.6930624935775995, + 0.39729833975434303, + 0.558311702683568, + 0.5713050402700901, + 0.8990826159715652, + 0.6431873589754105, + 0.11647165194153786, + 0.9276180360466242, + 0.2729091141372919, + 1.1964511778205633, + 8.235689042136073, + 0.38597079552710056, + 1.4060881417244673, + 0.3443050906062126, + 0.9583140276372433, + 0.12112867832183838, + 0.31266411766409874, + 1.5450505688786507, + 0.09000442549586296, + 0.1468784622848034, + 1.0246409475803375, + 1.0450443364679813, + 0.3857202082872391, + 0.9207258895039558, + 0.9350709952414036, + 0.7155245617032051, + 1.0105565637350082, + 2.9262447245419025, + 0.11197521910071373, + 0.2558877281844616, + 0.4496786370873451, + 1.2112940698862076, + 0.38409584388136864, + 1.196133041754365, + 2.3796427454799414, + 0.7498688455671072, + 2.095893155783415, + 4.7784711718559265, + 0.582724817097187, + 0.11746036633849144, + 4.891698380932212, + 0.9366096388548613, + 0.12058735266327858, + 0.7478614151477814, + 0.7021051049232483, + 0.3665471486747265, + 0.8250953629612923, + 0.3292113859206438 + ], + "unique_experts": 64, + "load_cv": 0.7317507126735843, + "normalized_load_entropy": 0.942628927755394, + "max_load_share": 0.050200803212851405 + }, + "full_input": { + "tokens": 191, + "top_k": 6, + "decisions": 1146, + "ordered_route_sha256": "382fc5af78e808f8577026aa5cfdd45967d6c843246dfc56d7c25f51cf53b2a0", + "route_weight_sha256": "c3ca686089004de331338dd88d7ed0e54c3fd35ad7e632d4beef501127a589a2", + "loads": [ + 13, + 8, + 9, + 16, + 6, + 30, + 9, + 21, + 9, + 23, + 12, + 41, + 12, + 32, + 11, + 19, + 17, + 9, + 20, + 9, + 12, + 12, + 2, + 30, + 9, + 25, + 55, + 15, + 29, + 8, + 23, + 8, + 2, + 25, + 2, + 3, + 23, + 18, + 9, + 18, + 14, + 13, + 17, + 43, + 6, + 6, + 18, + 25, + 8, + 25, + 41, + 27, + 29, + 57, + 11, + 7, + 48, + 23, + 4, + 27, + 14, + 9, + 10, + 10 + ], + "weighted_loads": [ + 1.361728809773922, + 0.5652571469545364, + 0.5930071510374546, + 0.594602894037962, + 0.4109075553715229, + 2.0926072783768177, + 0.7759929709136486, + 0.8836059831082821, + 0.41575414687395096, + 1.6180666275322437, + 0.5714373625814915, + 2.4451715908944607, + 0.7113994769752026, + 2.109439978376031, + 0.9933314807713032, + 0.7947466894984245, + 0.6930624935775995, + 0.39729833975434303, + 0.9821990560740232, + 0.611155841499567, + 0.8990826159715652, + 0.6787700578570366, + 0.11647165194153786, + 1.3712521139532328, + 0.33935774490237236, + 1.3453296218067408, + 8.578804548829794, + 0.7798058092594147, + 2.619828110560775, + 0.3443050906062126, + 1.118459302932024, + 0.3577522709965706, + 0.31266411766409874, + 2.188170462846756, + 0.09000442549586296, + 0.1468784622848034, + 1.075421568006277, + 1.203415472060442, + 0.5657820999622345, + 0.9207258895039558, + 0.9350709952414036, + 0.7155245617032051, + 1.0670685432851315, + 2.9262447245419025, + 0.25551363453269005, + 0.2558877281844616, + 0.6996242366731167, + 1.2968743536621332, + 0.38409584388136864, + 1.196133041754365, + 2.4699644576758146, + 1.2893407214432955, + 2.8468894623219967, + 5.2555303275585175, + 0.582724817097187, + 0.48752104863524437, + 4.931715117767453, + 0.9804278332740068, + 0.16495703905820847, + 1.1861017532646656, + 0.7021051049232483, + 0.3665471486747265, + 0.8250953629612923, + 0.35556696727871895 + ], + "unique_experts": 64, + "load_cv": 0.6955429454566223, + "normalized_load_entropy": 0.946579072146904, + "max_load_share": 0.049738219895287955 + } + }, + "s1_bos": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "0a8339c19c15c3f12db332c81e15212779b9dafbd8a09058d3736cf1ca346e02", + "route_weight_sha256": "7b8b4f8fc97a099f0a1c85dd33ca891b90f7c035096bd9ba87ceb0b2f08d8276", + "loads": [ + 6, + 10, + 10, + 12, + 6, + 19, + 9, + 24, + 8, + 14, + 9, + 39, + 12, + 34, + 11, + 14, + 17, + 6, + 15, + 9, + 12, + 10, + 1, + 20, + 7, + 22, + 49, + 7, + 22, + 8, + 21, + 6, + 3, + 19, + 2, + 3, + 26, + 16, + 6, + 17, + 14, + 12, + 16, + 45, + 4, + 6, + 12, + 24, + 8, + 24, + 36, + 18, + 22, + 51, + 11, + 4, + 45, + 22, + 3, + 17, + 12, + 9, + 11, + 9 + ], + "weighted_loads": [ + 0.6689264662563801, + 0.6268841214478016, + 0.6333731412887573, + 0.4393746070563793, + 0.4078059270977974, + 1.1253826189786196, + 0.7865159716457129, + 1.0189614742994308, + 0.37188043631613255, + 1.0061094909906387, + 0.48371385410428047, + 2.3060493264347315, + 0.6849976498633623, + 2.2198034413158894, + 0.9540586583316326, + 0.6035019084811211, + 0.6921895872801542, + 0.2977397032082081, + 0.5859856251627207, + 0.61005549877882, + 0.9174814783036709, + 0.6007570438086987, + 0.06983916461467743, + 0.9407545980066061, + 0.27289893850684166, + 1.18459115549922, + 8.12683281302452, + 0.2800256945192814, + 1.3542746491730213, + 0.3433950785547495, + 0.9713281355798244, + 0.22092976048588753, + 0.3270449750125408, + 1.5169620960950851, + 0.08820712938904762, + 0.14149430394172668, + 1.1505204737186432, + 1.0849129371345043, + 0.33655060455203056, + 0.9130911864340305, + 0.9428192712366581, + 0.6602532044053078, + 0.9878072813153267, + 3.0225560814142227, + 0.1587618999183178, + 0.25906671211123466, + 0.45108968764543533, + 1.2540407069027424, + 0.3869302310049534, + 1.1312213074415922, + 2.1723148487508297, + 0.6745341885834932, + 2.052978314459324, + 4.812101664021611, + 0.5588998813182116, + 0.16541393287479877, + 4.808835102245212, + 0.9212600793689489, + 0.12435091659426689, + 0.721978671848774, + 0.5799938570708036, + 0.37474123015999794, + 0.8419525772333145, + 0.3338792324066162 + ], + "unique_experts": 64, + "load_cv": 0.7381587284686, + "normalized_load_entropy": 0.9421286723255086, + "max_load_share": 0.05120481927710843 + }, + "full_input": { + "tokens": 207, + "top_k": 6, + "decisions": 1242, + "ordered_route_sha256": "d273cce10f68c1c8365fe4074f40be290e862cbeae41f7960f7e3a45d2852c4c", + "route_weight_sha256": "b11cee37823d94212703984ede8a95f74d8e1d8ed27ce8451cad2f7b92539f3b", + "loads": [ + 14, + 11, + 10, + 15, + 9, + 35, + 9, + 27, + 10, + 26, + 9, + 42, + 17, + 34, + 11, + 19, + 17, + 6, + 22, + 13, + 14, + 14, + 1, + 29, + 13, + 26, + 54, + 14, + 37, + 9, + 26, + 9, + 5, + 30, + 3, + 4, + 26, + 19, + 9, + 18, + 14, + 12, + 17, + 46, + 6, + 7, + 18, + 28, + 10, + 24, + 50, + 22, + 30, + 60, + 13, + 7, + 46, + 25, + 4, + 35, + 15, + 10, + 13, + 14 + ], + "weighted_loads": [ + 1.476646913215518, + 0.6790227927267551, + 0.6333731412887573, + 0.5737338438630104, + 0.6165329217910767, + 2.254790972918272, + 0.7865159716457129, + 1.1465690582990646, + 0.5397310201078653, + 1.8292501792311668, + 0.48371385410428047, + 2.518323877826333, + 1.044103218242526, + 2.2198034413158894, + 0.9540586583316326, + 0.8053042348474264, + 0.6921895872801542, + 0.2977397032082081, + 1.0086683258414268, + 0.8106399737298489, + 1.1470699645578861, + 0.7446466777473688, + 0.06983916461467743, + 1.3331358525902033, + 0.5563660468906164, + 1.3636367954313755, + 8.469394881278276, + 0.6200353298336267, + 3.200128510594368, + 0.39193487726151943, + 1.2184005714952946, + 0.35511282458901405, + 0.4061655290424824, + 2.6453492641448975, + 0.13550058007240295, + 0.22162435948848724, + 1.1505204737186432, + 1.4361939057707787, + 0.5630682148039341, + 0.9712848551571369, + 0.9428192712366581, + 0.6602532044053078, + 1.040741253644228, + 3.0669872649013996, + 0.22064742632210255, + 0.2996705733239651, + 0.7745366767048836, + 1.4134795852005482, + 0.5105013698339462, + 1.1312213074415922, + 3.066941361874342, + 1.1017274986952543, + 2.8364763893187046, + 5.512371385470033, + 0.6411360558122396, + 0.4749776516109705, + 4.862315217033029, + 1.051670664921403, + 0.231374841183424, + 1.751919649541378, + 0.8314171750098467, + 0.414994478225708, + 0.944643571972847, + 0.5047680139541626 + ], + "unique_experts": 64, + "load_cv": 0.6743145384181487, + "normalized_load_entropy": 0.9493093099275578, + "max_load_share": 0.04830917874396135 + } + }, + "s0_x": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "3a834332c0df2d9a6f2e478ee357ab7610c24c38892592805741866af5e02001", + "route_weight_sha256": "3504fe65e0ac840fdf6c7fab07c688f07b301d1f29b7c011f711c5aff927da83", + "loads": [ + 5, + 9, + 9, + 12, + 6, + 21, + 9, + 22, + 9, + 16, + 8, + 37, + 12, + 30, + 12, + 17, + 17, + 7, + 16, + 9, + 13, + 11, + 0, + 20, + 7, + 22, + 49, + 7, + 20, + 8, + 21, + 3, + 2, + 18, + 1, + 3, + 22, + 15, + 7, + 18, + 14, + 13, + 17, + 46, + 3, + 7, + 11, + 24, + 8, + 25, + 39, + 19, + 23, + 52, + 11, + 4, + 47, + 21, + 3, + 18, + 14, + 8, + 10, + 9 + ], + "weighted_loads": [ + 0.660362396389246, + 0.6179884076118469, + 0.6056362204253674, + 0.446680823341012, + 0.4153946153819561, + 1.1870890967547894, + 0.7889193929731846, + 0.9196277894079685, + 0.40529812313616276, + 1.226686991751194, + 0.43539343029260635, + 2.2556184232234955, + 0.6773806288838387, + 2.0378588046878576, + 0.9782602973282337, + 0.7331238649785519, + 0.7076251711696386, + 0.33087284304201603, + 0.6425180453807116, + 0.5955957174301147, + 0.9386039972305298, + 0.6332297250628471, + 0.0, + 0.9333682656288147, + 0.27430382557213306, + 1.2067494057118893, + 8.323095586150885, + 0.2902142368257046, + 1.2368253003805876, + 0.3443610891699791, + 0.9615794010460377, + 0.12277550622820854, + 0.3071446120738983, + 1.5946793481707573, + 0.06310322880744934, + 0.1453290991485119, + 1.049976097419858, + 1.0669419430196285, + 0.3901391327381134, + 0.9161640182137489, + 0.8879545591771603, + 0.7021245919167995, + 1.0463528279215097, + 3.067740498110652, + 0.11707621067762375, + 0.27952160872519016, + 0.3887510970234871, + 1.2317387834191322, + 0.3931434750556946, + 1.2045647110790014, + 2.393046662211418, + 0.7249549776315689, + 2.0744565576314926, + 4.883810622617602, + 0.5606449842453003, + 0.16125237569212914, + 4.8644381035119295, + 0.9132540076971054, + 0.119172602891922, + 0.7721349466592073, + 0.6916408371180296, + 0.34101438894867897, + 0.8031391948461533, + 0.33255722001194954 + ], + "unique_experts": 63, + "load_cv": 0.7488317702776065, + "normalized_load_entropy": 0.9390075492463056, + "max_load_share": 0.05220883534136546 + }, + "full_input": { + "tokens": 191, + "top_k": 6, + "decisions": 1146, + "ordered_route_sha256": "199832996a1902d199397a72afd3cbafdc73ed71bc1a44a23ff63dcf3e4381a9", + "route_weight_sha256": "8240569b7338feb6a68f0fa520f34d214262261490768e648745ed9ab7708be3", + "loads": [ + 13, + 9, + 9, + 13, + 6, + 33, + 9, + 23, + 9, + 24, + 10, + 40, + 12, + 31, + 12, + 19, + 17, + 7, + 20, + 11, + 13, + 12, + 0, + 30, + 9, + 26, + 56, + 11, + 28, + 8, + 23, + 7, + 2, + 25, + 1, + 3, + 23, + 19, + 9, + 18, + 14, + 13, + 19, + 46, + 5, + 7, + 16, + 26, + 8, + 25, + 42, + 23, + 29, + 60, + 11, + 8, + 48, + 22, + 3, + 29, + 14, + 8, + 10, + 10 + ], + "weighted_loads": [ + 1.4616424217820168, + 0.6179884076118469, + 0.6056362204253674, + 0.4865816403180361, + 0.4153946153819561, + 2.2532682605087757, + 0.7889193929731846, + 0.9532151706516743, + 0.40529812313616276, + 1.6828602775931358, + 0.49868493154644966, + 2.4414482228457928, + 0.6773806288838387, + 2.0948946569114923, + 0.9782602973282337, + 0.8090127520263195, + 0.7076251711696386, + 0.33087284304201603, + 0.883520407602191, + 0.7097259908914566, + 0.9386039972305298, + 0.6634436640888453, + 0.0, + 1.3770023435354233, + 0.338297326117754, + 1.3794489558786154, + 8.778219299390912, + 0.6177240703254938, + 2.2753980737179518, + 0.3443610891699791, + 1.1152946539223194, + 0.3261176533997059, + 0.3071446120738983, + 2.3006880059838295, + 0.06310322880744934, + 0.1453290991485119, + 1.1007567178457975, + 1.2751709558069706, + 0.562012068927288, + 0.9161640182137489, + 0.8879545591771603, + 0.7021245919167995, + 1.1478741969913244, + 3.067740498110652, + 0.1790665239095688, + 0.27952160872519016, + 0.6543445512652397, + 1.3173190671950579, + 0.3931434750556946, + 1.2045647110790014, + 2.5263652727007866, + 1.1417423114180565, + 2.8254528641700745, + 5.44863928668201, + 0.5606449842453003, + 0.4844723306596279, + 4.904454840347171, + 0.9550900310277939, + 0.119172602891922, + 1.2761614006012678, + 0.6916408371180296, + 0.34101438894867897, + 0.8031391948461533, + 0.3564996775239706 + ], + "unique_experts": 63, + "load_cv": 0.7214732296654767, + "normalized_load_entropy": 0.9419176772212773, + "max_load_share": 0.05235602094240838 + } + }, + "s1_x": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "ff1ea0315c874318cb9af8b7d35b8e54f3f6d7b50bbe88d5677e665dd001c13b", + "route_weight_sha256": "20faa9ccd762551d7cdb8631ea8d734c9adc371448ded5e048178105248098e7", + "loads": [ + 5, + 10, + 10, + 10, + 6, + 23, + 7, + 24, + 9, + 16, + 9, + 37, + 16, + 32, + 11, + 16, + 17, + 8, + 16, + 10, + 11, + 11, + 1, + 19, + 9, + 22, + 49, + 6, + 17, + 8, + 21, + 5, + 3, + 19, + 2, + 3, + 21, + 15, + 5, + 18, + 14, + 13, + 16, + 46, + 3, + 5, + 12, + 23, + 9, + 26, + 38, + 17, + 24, + 53, + 10, + 3, + 45, + 21, + 3, + 18, + 11, + 10, + 10, + 9 + ], + "weighted_loads": [ + 0.6567226462066174, + 0.6196145601570606, + 0.637559674680233, + 0.3619411513209343, + 0.41392672434449196, + 1.3050900250673294, + 0.7143795676529408, + 0.9961928371340036, + 0.3976155910640955, + 1.1307457350194454, + 0.48389265686273575, + 2.263376349583268, + 0.8453747145831585, + 2.113921197131276, + 0.9257167391479015, + 0.6986872665584087, + 0.6898821275681257, + 0.376331876963377, + 0.6566171981394291, + 0.6337962001562119, + 0.8418741002678871, + 0.6334200799465179, + 0.052707698196172714, + 0.9056472275406122, + 0.34011280350387096, + 1.203555591404438, + 8.249142428860068, + 0.23994932137429714, + 0.9863851629197598, + 0.35827379301190376, + 0.9769642166793346, + 0.19074654206633568, + 0.34089359641075134, + 1.566408958286047, + 0.08493170700967312, + 0.13925906270742416, + 1.0247229002416134, + 1.0458321459591389, + 0.30459458008408546, + 0.9123697727918625, + 0.9199975691735744, + 0.6973404698073864, + 0.9920666478574276, + 3.1534149684011936, + 0.11694897525012493, + 0.21016083657741547, + 0.42758383601903915, + 1.2175659574568272, + 0.42528699710965157, + 1.2275089789181948, + 2.2597222588956356, + 0.6404693126678467, + 2.1039604414254427, + 5.041373141109943, + 0.5088243167847395, + 0.12179271318018436, + 4.807987183332443, + 0.8959491532295942, + 0.12106762453913689, + 0.8068293239921331, + 0.5777590125799179, + 0.4177835062146187, + 0.8235434219241142, + 0.3605054020881653 + ], + "unique_experts": 64, + "load_cv": 0.7457237650816281, + "normalized_load_entropy": 0.9406902210761526, + "max_load_share": 0.05321285140562249 + }, + "full_input": { + "tokens": 207, + "top_k": 6, + "decisions": 1242, + "ordered_route_sha256": "7547f2fa982beb447fc6f2e83e4ae9a0d126fd4a42c0aa203daa7e940ec2acc7", + "route_weight_sha256": "2455362a490c7aabb3cbe1f9ec89dd7114fba03d40b5f85fc9392bb76fd5e8c0", + "loads": [ + 15, + 11, + 10, + 11, + 9, + 42, + 7, + 27, + 11, + 26, + 9, + 41, + 21, + 32, + 11, + 19, + 17, + 8, + 23, + 14, + 13, + 14, + 1, + 29, + 15, + 27, + 55, + 13, + 29, + 9, + 27, + 7, + 5, + 30, + 3, + 4, + 22, + 19, + 8, + 19, + 14, + 13, + 18, + 47, + 5, + 5, + 18, + 26, + 11, + 26, + 52, + 19, + 32, + 63, + 12, + 6, + 46, + 23, + 4, + 40, + 14, + 11, + 12, + 12 + ], + "weighted_loads": [ + 1.5574613604694605, + 0.6717532314360142, + 0.637559674680233, + 0.4013829305768013, + 0.6226537190377712, + 2.666337503120303, + 0.7143795676529408, + 1.1238004211336374, + 0.5654661748558283, + 1.738182496279478, + 0.48389265686273575, + 2.5243989024311304, + 1.2044802829623222, + 2.113921197131276, + 0.9257167391479015, + 0.8223700076341629, + 0.6898821275681257, + 0.376331876963377, + 1.09417431242764, + 0.8343806751072407, + 1.0714625865221024, + 0.736254284158349, + 0.052707698196172714, + 1.3528109733015299, + 0.6235799118876457, + 1.4137709457427263, + 8.695597359910607, + 0.5347941480576992, + 2.3352158963680267, + 0.4068135917186737, + 1.2351099196821451, + 0.2669424004852772, + 0.4200141504406929, + 2.6971621476113796, + 0.13222515769302845, + 0.21938911825418472, + 1.0625956915318966, + 1.4964926317334175, + 0.5100187100470066, + 0.9705634415149689, + 0.9199975691735744, + 0.6973404698073864, + 1.1025413610041142, + 3.1978461518883705, + 0.17883450165390968, + 0.21016083657741547, + 0.7550183907151222, + 1.3386636935174465, + 0.5488581359386444, + 1.2275089789181948, + 3.1526959240436554, + 0.9991113990545273, + 2.8874585162848234, + 5.864549092948437, + 0.5910604912787676, + 0.3401860762387514, + 4.86146729812026, + 0.9845294635742903, + 0.228091549128294, + 2.0045391153544188, + 0.829182330518961, + 0.45803675428032875, + 0.9262344166636467, + 0.4684436470270157 + ], + "unique_experts": 64, + "load_cv": 0.6995607231765162, + "normalized_load_entropy": 0.9460221642890385, + "max_load_share": 0.050724637681159424 + } + }, + "s0_period": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "5195e4d39d7664021d0f8e3fb6ed1bc28231c5eae447a067b407a74b03bd1745", + "route_weight_sha256": "76a249babe50e342972d1023db8909a9e7d07d8f3cf7c7b94b1c0d1b3f7efa15", + "loads": [ + 5, + 9, + 9, + 11, + 6, + 20, + 9, + 20, + 9, + 16, + 8, + 38, + 12, + 31, + 12, + 17, + 17, + 8, + 15, + 9, + 12, + 12, + 0, + 20, + 7, + 21, + 49, + 7, + 18, + 8, + 21, + 3, + 2, + 19, + 1, + 3, + 22, + 15, + 7, + 18, + 14, + 14, + 17, + 46, + 2, + 7, + 12, + 23, + 9, + 26, + 41, + 19, + 24, + 51, + 10, + 2, + 46, + 22, + 3, + 18, + 14, + 11, + 10, + 9 + ], + "weighted_loads": [ + 0.6516549736261368, + 0.617526862770319, + 0.6126669459044933, + 0.4016589503735304, + 0.41933442279696465, + 1.1769979428499937, + 0.800004867836833, + 0.8651636522263288, + 0.3965081423521042, + 1.2589740827679634, + 0.4315180741250515, + 2.2741684578359127, + 0.6889533810317516, + 2.04829147644341, + 0.9415419660508633, + 0.7189447209239006, + 0.7149414699524641, + 0.3724140524864197, + 0.5981196779757738, + 0.594421461224556, + 0.9032481499016285, + 0.6830610297620296, + 0.0, + 0.9394036512821913, + 0.26616984605789185, + 1.1837290618568659, + 8.28603713400662, + 0.28741697408258915, + 1.1979334373027086, + 0.35007237643003464, + 0.958110861480236, + 0.1223740503191948, + 0.31036732718348503, + 1.6514350362122059, + 0.06329967081546783, + 0.1447260081768036, + 1.0411529242992401, + 1.0653266087174416, + 0.385687418282032, + 0.9282622318714857, + 0.8899537660181522, + 0.755675408989191, + 1.05613680370152, + 3.083237560465932, + 0.07179127633571625, + 0.27978526428341866, + 0.4241129606962204, + 1.207017671316862, + 0.418692821636796, + 1.2389555145055056, + 2.482699055224657, + 0.7133284918963909, + 2.067317532375455, + 4.865424754098058, + 0.5227099377661943, + 0.07318645715713501, + 4.838250396773219, + 0.9479712229222059, + 0.12225881963968277, + 0.7750573828816414, + 0.6975513882935047, + 0.44739047810435295, + 0.7983594611287117, + 0.33594030514359474 + ], + "unique_experts": 63, + "load_cv": 0.7502089728922309, + "normalized_load_entropy": 0.9382707155920265, + "max_load_share": 0.05120481927710843 + }, + "full_input": { + "tokens": 191, + "top_k": 6, + "decisions": 1146, + "ordered_route_sha256": "6d1d4dafbaab8be4aa894bd46efeee2389f9c0a42574b408e57026d705b541ba", + "route_weight_sha256": "c9d4491a2454315c1c020ca68461d177e9445f62f06730ba641f085ef28cb0ff", + "loads": [ + 13, + 9, + 9, + 12, + 6, + 31, + 9, + 21, + 9, + 24, + 10, + 41, + 12, + 32, + 12, + 19, + 17, + 8, + 19, + 10, + 12, + 13, + 0, + 30, + 10, + 24, + 56, + 13, + 26, + 8, + 24, + 7, + 2, + 26, + 1, + 3, + 23, + 18, + 9, + 18, + 14, + 14, + 18, + 46, + 4, + 7, + 15, + 26, + 9, + 27, + 45, + 23, + 30, + 59, + 10, + 6, + 47, + 23, + 3, + 30, + 14, + 11, + 10, + 9 + ], + "weighted_loads": [ + 1.3906886726617813, + 0.617526862770319, + 0.6126669459044933, + 0.44155976735055447, + 0.41933442279696465, + 2.174482712522149, + 0.800004867836833, + 0.8987510334700346, + 0.3965081423521042, + 1.7147750593721867, + 0.4948095753788948, + 2.45999825745821, + 0.6889533810317516, + 2.0990837644785643, + 0.9415419660508633, + 0.790278285741806, + 0.7149414699524641, + 0.3724140524864197, + 0.8656213190406561, + 0.6342722624540329, + 0.9032481499016285, + 0.7165729105472565, + 0.0, + 1.3830377291887999, + 0.37585640512406826, + 1.328464275225997, + 8.684343062341213, + 0.7018873803317547, + 2.339019300416112, + 0.35007237643003464, + 1.1386230140924454, + 0.31767023354768753, + 0.31036732718348503, + 2.3380178548395634, + 0.06329967081546783, + 0.1447260081768036, + 1.0919335447251797, + 1.2166810147464275, + 0.5538960844278336, + 0.9282622318714857, + 0.8899537660181522, + 0.755675408989191, + 1.1012739334255457, + 3.083237560465932, + 0.13378158956766129, + 0.27978526428341866, + 0.5861189551651478, + 1.3571557607501745, + 0.418692821636796, + 1.286402290686965, + 2.661247044801712, + 1.1301158256828785, + 2.8183138389140368, + 5.42993682064116, + 0.5227099377661943, + 0.44839757680892944, + 4.87826713360846, + 0.987456051632762, + 0.12225881963968277, + 1.313944410532713, + 0.6975513882935047, + 0.44739047810435295, + 0.7983594611287117, + 0.33594030514359474 + ], + "unique_experts": 63, + "load_cv": 0.7230924825289964, + "normalized_load_entropy": 0.9416073965711326, + "max_load_share": 0.05148342059336824 + } + }, + "s1_period": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "a8ef4a263e105bfc6d21ee0f2674350fcbf477c36bce07fa101fba1824edf2df", + "route_weight_sha256": "132c9feb9ae0bf03c5a46ffc96ec0dd43374579da61b19898a1a7f7b8b825be4", + "loads": [ + 5, + 9, + 9, + 10, + 6, + 22, + 7, + 24, + 9, + 17, + 9, + 39, + 13, + 31, + 12, + 16, + 17, + 8, + 17, + 9, + 13, + 11, + 1, + 19, + 8, + 22, + 50, + 6, + 17, + 8, + 22, + 5, + 3, + 18, + 1, + 3, + 20, + 15, + 6, + 17, + 14, + 11, + 17, + 46, + 1, + 5, + 11, + 23, + 9, + 26, + 41, + 17, + 24, + 53, + 10, + 5, + 47, + 21, + 3, + 18, + 13, + 10, + 10, + 7 + ], + "weighted_loads": [ + 0.6636580564081669, + 0.5617067962884903, + 0.5958412177860737, + 0.35754450410604477, + 0.4181498736143112, + 1.2717460468411446, + 0.7135855741798878, + 1.0123642906546593, + 0.3961296658962965, + 1.2234156019985676, + 0.47633086517453194, + 2.3494465220719576, + 0.7213840149343014, + 2.1130892764776945, + 0.9161313269287348, + 0.7074289508163929, + 0.6960240583866835, + 0.3730706498026848, + 0.6994068901985884, + 0.6081882156431675, + 0.933834757655859, + 0.6458732672035694, + 0.06168210133910179, + 0.9077251814305782, + 0.29753618128597736, + 1.2457992285490036, + 8.197246085852385, + 0.23963727988302708, + 1.054269053041935, + 0.3547796830534935, + 1.0092546045780182, + 0.19762225449085236, + 0.33067572489380836, + 1.586453765630722, + 0.0589120090007782, + 0.14115577563643456, + 0.9848007820546627, + 1.046686541289091, + 0.34706520661711693, + 0.9110912885516882, + 0.9020767584443092, + 0.6132207699120045, + 1.0293533131480217, + 3.196553409099579, + 0.04366539791226387, + 0.20763834193348885, + 0.39498106203973293, + 1.2250835187733173, + 0.41781151480972767, + 1.2300348058342934, + 2.4171070214360952, + 0.6362907588481903, + 2.107161045074463, + 5.001489836722612, + 0.5202328823506832, + 0.20690842159092426, + 4.869953507557511, + 0.888409985229373, + 0.12337082996964455, + 0.8136158864945173, + 0.6453395802527666, + 0.4226739890873432, + 0.8172101639211178, + 0.28770479187369347 + ], + "unique_experts": 64, + "load_cv": 0.7655317987228809, + "normalized_load_entropy": 0.9376354191287424, + "max_load_share": 0.05321285140562249 + }, + "full_input": { + "tokens": 207, + "top_k": 6, + "decisions": 1242, + "ordered_route_sha256": "2cc191bcf5720d99d2311f2e320eecb6078ef79cbffc540217da8a70c9de48b9", + "route_weight_sha256": "a1ffb5a8c1ba0745c33e42aa607e37e4a37db0884b6aaf4d766385ef678cc53c", + "loads": [ + 14, + 10, + 9, + 12, + 10, + 39, + 7, + 27, + 11, + 29, + 9, + 42, + 18, + 31, + 12, + 19, + 17, + 8, + 24, + 13, + 15, + 14, + 1, + 28, + 16, + 27, + 55, + 12, + 30, + 9, + 29, + 7, + 5, + 28, + 2, + 4, + 20, + 19, + 9, + 18, + 14, + 11, + 19, + 47, + 3, + 5, + 16, + 27, + 11, + 27, + 56, + 19, + 32, + 63, + 12, + 8, + 48, + 23, + 4, + 39, + 16, + 11, + 12, + 10 + ], + "weighted_loads": [ + 1.5120359938591719, + 0.6138454675674438, + 0.5958412177860737, + 0.4330015145242214, + 0.6673172786831856, + 2.459507403895259, + 0.7135855741798878, + 1.139971874654293, + 0.5639802496880293, + 1.9415307268500328, + 0.47633086517453194, + 2.561721073463559, + 1.0804895833134651, + 2.1130892764776945, + 0.9161313269287348, + 0.8303192034363747, + 0.6960240583866835, + 0.3730706498026848, + 1.1420385167002678, + 0.8087726905941963, + 1.1634232439100742, + 0.7487074714154005, + 0.06168210133910179, + 1.3001064360141754, + 0.6811689399182796, + 1.447794521227479, + 8.53980815410614, + 0.49089424312114716, + 2.422870460897684, + 0.40331948176026344, + 1.3086855206638575, + 0.27381811290979385, + 0.4097962789237499, + 2.669681929051876, + 0.10620545968413353, + 0.22128583118319511, + 0.9848007820546627, + 1.4903753623366356, + 0.5565175451338291, + 0.9692849572747946, + 0.9020767584443092, + 0.6132207699120045, + 1.1159729361534119, + 3.2409845925867558, + 0.10555092431604862, + 0.20763834193348885, + 0.6792627330869436, + 1.381263967603445, + 0.5413826536387205, + 1.2711988613009453, + 3.350003680214286, + 0.9949328452348709, + 2.8906591199338436, + 5.781146299093962, + 0.6024690568447113, + 0.5135797951370478, + 4.923433622345328, + 0.977021774277091, + 0.23039475455880165, + 1.9738494735211134, + 0.8967628981918097, + 0.4629272371530533, + 0.9199011586606503, + 0.39564303681254387 + ], + "unique_experts": 64, + "load_cv": 0.7109733320048041, + "normalized_load_entropy": 0.9443045725020086, + "max_load_share": 0.050724637681159424 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 166, + "ordered_topk_exact_tokens": 95, + "set_exact_tokens": 114, + "mean_set_jaccard": 0.9066265060240963, + "mean_token_weighted_tv": 0.01798164760357285, + "aggregate_load_tv": 0.03714859437751004 + }, + "system_bos": { + "tokens": 166, + "ordered_topk_exact_tokens": 97, + "set_exact_tokens": 118, + "mean_set_jaccard": 0.9122203098106711, + "mean_token_weighted_tv": 0.018836591274937593, + "aggregate_load_tv": 0.03012048192771084 + }, + "system_x": { + "tokens": 166, + "ordered_topk_exact_tokens": 99, + "set_exact_tokens": 116, + "mean_set_jaccard": 0.9049053356282273, + "mean_token_weighted_tv": 0.02227572506540511, + "aggregate_load_tv": 0.03012048192771085 + }, + "system_period": { + "tokens": 166, + "ordered_topk_exact_tokens": 91, + "set_exact_tokens": 121, + "mean_set_jaccard": 0.9186746987951807, + "mean_token_weighted_tv": 0.02031786528314991, + "aggregate_load_tv": 0.027108433734939767 + }, + "bos_at_s0": { + "tokens": 166, + "ordered_topk_exact_tokens": 88, + "set_exact_tokens": 107, + "mean_set_jaccard": 0.8907056798623064, + "mean_token_weighted_tv": 0.023453102256339717, + "aggregate_load_tv": 0.04116465863453815 + }, + "bos_at_s1": { + "tokens": 166, + "ordered_topk_exact_tokens": 84, + "set_exact_tokens": 104, + "mean_set_jaccard": 0.8868330464716006, + "mean_token_weighted_tv": 0.024567007732364428, + "aggregate_load_tv": 0.03815261044176707 + }, + "x_at_s0": { + "tokens": 166, + "ordered_topk_exact_tokens": 87, + "set_exact_tokens": 113, + "mean_set_jaccard": 0.8964429145152037, + "mean_token_weighted_tv": 0.022947345776146794, + "aggregate_load_tv": 0.04116465863453815 + }, + "x_at_s1": { + "tokens": 166, + "ordered_topk_exact_tokens": 81, + "set_exact_tokens": 102, + "mean_set_jaccard": 0.8756454388984509, + "mean_token_weighted_tv": 0.029495505038200014, + "aggregate_load_tv": 0.03815261044176707 + }, + "period_at_s0": { + "tokens": 166, + "ordered_topk_exact_tokens": 87, + "set_exact_tokens": 109, + "mean_set_jaccard": 0.8879804934021801, + "mean_token_weighted_tv": 0.02445775482534285, + "aggregate_load_tv": 0.04618473895582329 + }, + "period_at_s1": { + "tokens": 166, + "ordered_topk_exact_tokens": 77, + "set_exact_tokens": 96, + "mean_set_jaccard": 0.8730636833046471, + "mean_token_weighted_tv": 0.029226191796317517, + "aggregate_load_tv": 0.03815261044176707 + } + } + }, + "layer_15": { + "layer": 15, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "c72bfffa3f58be363a98814e48aebf78de7318dcaa30825ea04938c9cee242e2", + "route_weight_sha256": "0bc177cb642ef771f81cbd73c92cdd8c0d1e03ff69f646464816c1b607bdcf11", + "loads": [ + 21, + 11, + 8, + 2, + 13, + 4, + 26, + 4, + 14, + 25, + 38, + 11, + 15, + 9, + 26, + 22, + 30, + 6, + 11, + 44, + 8, + 7, + 11, + 23, + 10, + 15, + 31, + 10, + 9, + 23, + 8, + 23, + 9, + 24, + 4, + 17, + 5, + 12, + 12, + 18, + 22, + 16, + 14, + 13, + 13, + 7, + 12, + 18, + 21, + 14, + 37, + 12, + 10, + 9, + 6, + 14, + 7, + 2, + 44, + 37, + 8, + 4, + 8, + 29 + ], + "weighted_loads": [ + 1.0191156417131424, + 0.718246579170227, + 0.4998874329030514, + 0.06450371630489826, + 0.7283997349441051, + 0.1360773630440235, + 2.3138134237378836, + 0.1277957186102867, + 0.5194913744926453, + 1.3952010944485664, + 2.95294520445168, + 0.8834682758897543, + 0.840134933590889, + 0.5370691660791636, + 1.4218563474714756, + 1.1026151236146688, + 3.454829318448901, + 0.2178043108433485, + 0.4680420644581318, + 5.365803372114897, + 0.391146969050169, + 0.4018397368490696, + 0.47331247478723526, + 0.9430570732802153, + 0.4008512105792761, + 1.4438612274825573, + 1.4714720770716667, + 0.5042582135647535, + 0.3437441363930702, + 1.3281764667481184, + 0.288532093167305, + 0.965421250090003, + 0.7962269186973572, + 2.3555188067257404, + 0.11978946998715401, + 1.13194770924747, + 0.22605431079864502, + 0.5921514015644789, + 0.6594633124768734, + 0.7948328256607056, + 0.8882681839168072, + 0.7235206291079521, + 1.2287076711654663, + 0.7409332673996687, + 0.5406418908387423, + 0.7243733033537865, + 1.0117049664258957, + 0.7352820169180632, + 1.416275106370449, + 1.0560211315751076, + 3.702704530209303, + 1.536174550652504, + 0.6179139278829098, + 0.3443308100104332, + 0.22611578926444054, + 0.6306910160928965, + 0.4272146373987198, + 0.07631575129926205, + 5.447352739050984, + 2.1637539342045784, + 0.33330754935741425, + 0.2084919698536396, + 0.7012093663215637, + 1.0886664297431707 + ], + "unique_experts": 64, + "load_cv": 0.6475584500714443, + "normalized_load_entropy": 0.9531081891014089, + "max_load_share": 0.04417670682730924 + }, + "full_input": { + "tokens": 191, + "top_k": 6, + "decisions": 1146, + "ordered_route_sha256": "104dad6ec5116de52c0a344fb6abee1163700a7ab3746fa05967b58c66976669", + "route_weight_sha256": "67eb584881b580c556043602fc551cfac93efdeae5a97e2e18e55d9ea86d90ea", + "loads": [ + 26, + 11, + 8, + 2, + 19, + 7, + 33, + 5, + 20, + 26, + 42, + 12, + 20, + 9, + 36, + 23, + 37, + 8, + 11, + 45, + 8, + 7, + 11, + 29, + 15, + 16, + 41, + 10, + 12, + 23, + 12, + 23, + 14, + 26, + 4, + 17, + 10, + 12, + 13, + 19, + 28, + 17, + 14, + 16, + 13, + 7, + 12, + 19, + 22, + 24, + 41, + 14, + 15, + 9, + 6, + 20, + 7, + 2, + 45, + 38, + 8, + 6, + 8, + 33 + ], + "weighted_loads": [ + 1.237756121903658, + 0.718246579170227, + 0.4998874329030514, + 0.06450371630489826, + 1.1121587119996548, + 0.20855705253779888, + 2.826117506250739, + 0.1621221788227558, + 0.9512180089950562, + 1.4266675971448421, + 3.1012069787830114, + 0.9136675838381052, + 1.2825948111712933, + 0.5370691660791636, + 1.7970481617376208, + 1.142330875620246, + 4.172426266595721, + 0.29132872633636, + 0.4680420644581318, + 5.445069316774607, + 0.391146969050169, + 0.4018397368490696, + 0.47331247478723526, + 1.2569834087044, + 0.5404339591041207, + 1.4722885601222515, + 2.1133873984217644, + 0.5042582135647535, + 0.45681300573050976, + 1.3281764667481184, + 0.46152082458138466, + 0.965421250090003, + 1.2133822441101074, + 2.442910797894001, + 0.11978946998715401, + 1.13194770924747, + 0.9607765721157193, + 0.5921514015644789, + 0.6905544269829988, + 0.8349443785846233, + 1.142666860949248, + 0.7277636420913041, + 1.2287076711654663, + 0.8837634865194559, + 0.5406418908387423, + 0.7243733033537865, + 1.0117049664258957, + 0.769697530195117, + 1.429768386296928, + 2.233449935913086, + 3.946623668074608, + 1.623011402785778, + 0.7668247604742646, + 0.3443308100104332, + 0.22611578926444054, + 2.3596072923392057, + 0.4272146373987198, + 0.07631575129926205, + 5.492394192144275, + 2.192483529448509, + 0.33330754935741425, + 0.2935098446905613, + 0.7012093663215637, + 1.2676367405802011 + ], + "unique_experts": 64, + "load_cv": 0.6272412521806963, + "normalized_load_entropy": 0.9547244065130848, + "max_load_share": 0.03926701570680628 + } + }, + "s1_eos": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "7aa986c2870f7b7a9d83d59ad388ef28fad877ea43e0b17ca8e94ecdd5e52a88", + "route_weight_sha256": "c85788217159e657edb064ddd766f4f5db200b122593094de7003d607e836e65", + "loads": [ + 21, + 11, + 8, + 1, + 12, + 4, + 27, + 5, + 14, + 25, + 38, + 11, + 14, + 9, + 25, + 22, + 29, + 5, + 11, + 44, + 8, + 7, + 10, + 22, + 15, + 17, + 33, + 9, + 8, + 19, + 7, + 22, + 9, + 23, + 3, + 16, + 8, + 12, + 11, + 19, + 20, + 19, + 14, + 12, + 14, + 7, + 13, + 18, + 19, + 15, + 35, + 13, + 11, + 10, + 5, + 16, + 8, + 2, + 45, + 37, + 8, + 5, + 8, + 28 + ], + "weighted_loads": [ + 0.9953086879104376, + 0.7377192713320255, + 0.5053295567631721, + 0.0292588509619236, + 0.7309073433279991, + 0.1178267914801836, + 2.3476269375532866, + 0.15135697461664677, + 0.5135678313672543, + 1.387631669640541, + 2.917446993291378, + 0.8748673535883427, + 0.8249387592077255, + 0.5217586550861597, + 1.3875371720641851, + 1.1105803102254868, + 3.382887475192547, + 0.17460603639483452, + 0.46736840158700943, + 5.351832430809736, + 0.37389006093144417, + 0.3995994031429291, + 0.4308150429278612, + 0.9032519347965717, + 0.5859810430556536, + 1.4943787194788456, + 1.543605538085103, + 0.46020763739943504, + 0.3016250878572464, + 1.202046686783433, + 0.2504775710403919, + 0.9224959015846252, + 0.7937202118337154, + 2.237627863883972, + 0.08929046615958214, + 1.109516592696309, + 0.3165576867759228, + 0.5925678182393312, + 0.6113492622971535, + 0.8066757787019014, + 0.8131584636867046, + 0.8206578176468611, + 1.1903120130300522, + 0.7083861120045185, + 0.5664912946522236, + 0.7127480767667294, + 1.0496273711323738, + 0.7267437931150198, + 1.3202251140028238, + 1.0844409633427858, + 3.6077764574438334, + 1.5930421352386475, + 0.664962287992239, + 0.36067887768149376, + 0.18718363344669342, + 0.6946420390158892, + 0.4487966150045395, + 0.07584357261657715, + 5.438688352704048, + 2.158042911440134, + 0.3454297184944153, + 0.24781145714223385, + 0.6695038452744484, + 1.0287981126457453 + ], + "unique_experts": 64, + "load_cv": 0.6405465118737649, + "normalized_load_entropy": 0.9538201053581096, + "max_load_share": 0.045180722891566265 + }, + "full_input": { + "tokens": 207, + "top_k": 6, + "decisions": 1242, + "ordered_route_sha256": "473eb975a104173340090b2f53f3080ccdb0dc79195c4ff92224193900ce072e", + "route_weight_sha256": "663b31ff5b253ca93a1d465eb53546dbe269404445d7ba750c4fec42402427b0", + "loads": [ + 42, + 12, + 8, + 1, + 20, + 9, + 39, + 5, + 25, + 26, + 43, + 15, + 20, + 10, + 30, + 32, + 41, + 9, + 12, + 48, + 9, + 8, + 10, + 27, + 19, + 18, + 43, + 11, + 14, + 20, + 13, + 26, + 14, + 25, + 5, + 16, + 14, + 12, + 13, + 21, + 26, + 21, + 14, + 15, + 14, + 8, + 13, + 19, + 22, + 29, + 41, + 15, + 14, + 11, + 5, + 22, + 8, + 8, + 47, + 41, + 8, + 12, + 10, + 34 + ], + "weighted_loads": [ + 2.2929730638861656, + 0.7644690312445164, + 0.5053295567631721, + 0.0292588509619236, + 1.2416831403970718, + 0.3252063887193799, + 3.299582976847887, + 0.15135697461664677, + 1.1578746419399977, + 1.4186521153897047, + 3.1516819894313812, + 1.205497244372964, + 1.3282951563596725, + 0.6041784826666117, + 1.5575813604518771, + 1.780201816931367, + 4.577688306570053, + 0.33263131976127625, + 0.5183323211967945, + 5.618122715502977, + 0.40279906056821346, + 0.48161254823207855, + 0.4308150429278612, + 1.1472652107477188, + 0.6850326196290553, + 1.522892501205206, + 2.243233712390065, + 0.5854128897190094, + 0.7161912247538567, + 1.2390906941145658, + 0.47752177342772484, + 1.3579204641282558, + 1.1964235417544842, + 2.3522795028984547, + 0.23987865447998047, + 1.109516592696309, + 1.0461078183725476, + 0.5925678182393312, + 0.6761586032807827, + 0.8875545989722013, + 1.049540929729119, + 0.9091565641574562, + 1.1903120130300522, + 1.0251178070902824, + 0.5664912946522236, + 0.752135906368494, + 1.0496273711323738, + 0.7609297800809145, + 1.463380073197186, + 3.0635509584099054, + 3.9178247172385454, + 1.6602536961436272, + 0.745381566695869, + 0.508752029389143, + 0.18718363344669342, + 2.417961360886693, + 0.4487966150045395, + 0.7404757291078568, + 5.521899826824665, + 2.32810640335083, + 0.3454297184944153, + 0.6242983881384134, + 0.7897405251860619, + 1.2621733918786049 + ], + "unique_experts": 64, + "load_cv": 0.6075080645350613, + "normalized_load_entropy": 0.9577939231705541, + "max_load_share": 0.03864734299516908 + } + }, + "s0_bos": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "962a3ae9657602353ba749dbc26641dd1446094b43486e2d2825553f6bfb5aa8", + "route_weight_sha256": "6bfde0d553af6ed60c11e9178ed5fbba7854a1f24b20a9a2e5346798db82a0c0", + "loads": [ + 22, + 11, + 8, + 2, + 13, + 3, + 25, + 4, + 14, + 26, + 38, + 11, + 15, + 9, + 26, + 20, + 30, + 7, + 10, + 47, + 8, + 8, + 10, + 23, + 10, + 16, + 31, + 12, + 11, + 21, + 6, + 21, + 9, + 26, + 2, + 17, + 7, + 12, + 13, + 18, + 20, + 12, + 14, + 13, + 12, + 6, + 13, + 15, + 20, + 15, + 36, + 13, + 11, + 11, + 7, + 14, + 7, + 2, + 45, + 38, + 7, + 4, + 9, + 30 + ], + "weighted_loads": [ + 1.1178224794566631, + 0.7082565948367119, + 0.505119651556015, + 0.06606614217162132, + 0.7742706183344126, + 0.08827493898570538, + 2.3373472541570663, + 0.12905616499483585, + 0.5090243555605412, + 1.4575403165072203, + 2.9787802072241902, + 0.9159135930240154, + 0.8369408324360847, + 0.5483367703855038, + 1.4449985083192587, + 1.0454868208616972, + 3.455235540866852, + 0.23744025453925133, + 0.4553870018571615, + 5.488344356417656, + 0.38419857434928417, + 0.44070287980139256, + 0.426648011431098, + 0.9137579184025526, + 0.404089979827404, + 1.4988755211234093, + 1.486295623704791, + 0.5773413609713316, + 0.4240816254168749, + 1.3452164232730865, + 0.23922947980463505, + 0.9060603193938732, + 0.8266198989003897, + 2.4211196694523096, + 0.06017921678721905, + 1.048957683146, + 0.28802231326699257, + 0.620091438293457, + 0.6913836449384689, + 0.7743095867335796, + 0.7918180022388697, + 0.5584135465323925, + 1.2576742209494114, + 0.7552302032709122, + 0.5185284484177828, + 0.683536633849144, + 1.0746046416461468, + 0.6446053944528103, + 1.3772288747131824, + 1.088253552094102, + 3.8307855166494846, + 1.3676448203623295, + 0.6410921290516853, + 0.38501689583063126, + 0.2617011908441782, + 0.6486950553953648, + 0.40795568376779556, + 0.07450372166931629, + 5.50153511017561, + 2.2915378138422966, + 0.31618232652544975, + 0.22062591835856438, + 0.7641439437866211, + 1.1219020672142506 + ], + "unique_experts": 64, + "load_cv": 0.6569549551282273, + "normalized_load_entropy": 0.9521282974350862, + "max_load_share": 0.04718875502008032 + }, + "full_input": { + "tokens": 191, + "top_k": 6, + "decisions": 1146, + "ordered_route_sha256": "fe554aa658d90447a956f196b8273df95e7c18831150af87690ae7b3882bca8a", + "route_weight_sha256": "d74c4765f4f8a006fe3908eeae9083509a75af5c14f566f8c2c81a3ca0eb60b8", + "loads": [ + 27, + 11, + 8, + 2, + 18, + 5, + 31, + 5, + 19, + 27, + 42, + 12, + 20, + 9, + 35, + 21, + 37, + 9, + 10, + 48, + 8, + 8, + 10, + 29, + 14, + 17, + 41, + 12, + 15, + 21, + 11, + 21, + 14, + 28, + 2, + 18, + 13, + 12, + 14, + 19, + 27, + 12, + 14, + 16, + 12, + 6, + 13, + 16, + 21, + 24, + 41, + 16, + 16, + 12, + 9, + 18, + 7, + 2, + 46, + 39, + 7, + 6, + 9, + 34 + ], + "weighted_loads": [ + 1.3318456523120403, + 0.7082565948367119, + 0.505119651556015, + 0.06606614217162132, + 1.0819769706577063, + 0.15940217301249504, + 2.720829926431179, + 0.16338262520730495, + 0.9086982384324074, + 1.489006819203496, + 3.1270419815555215, + 0.9461129009723663, + 1.2801828272640705, + 0.5483367703855038, + 1.810155576094985, + 1.0852025728672743, + 4.202732779085636, + 0.3109646700322628, + 0.4553870018571615, + 5.567610301077366, + 0.38419857434928417, + 0.44070287980139256, + 0.426648011431098, + 1.2276842538267374, + 0.5625023748725653, + 1.5273028537631035, + 2.1282109450548887, + 0.5773413609713316, + 0.6084842011332512, + 1.3452164232730865, + 0.4687292594462633, + 0.9060603193938732, + 1.24377522431314, + 2.50851166062057, + 0.06017921678721905, + 1.158224143087864, + 1.097739634104073, + 0.620091438293457, + 0.7224747594445944, + 0.8129686787724495, + 1.1433059964329004, + 0.5584135465323925, + 1.2576742209494114, + 0.9087360054254532, + 0.5185284484177828, + 0.683536633849144, + 1.0746046416461468, + 0.6790209077298641, + 1.3907221546396613, + 2.1221415009349585, + 4.157476395368576, + 1.5061480589210987, + 0.7900029616430402, + 0.4473956301808357, + 0.3670609947293997, + 1.363599106669426, + 0.40795568376779556, + 0.07450372166931629, + 5.5465765632689, + 2.3202674090862274, + 0.31618232652544975, + 0.30564379319548607, + 0.7641439437866211, + 1.312162447720766 + ], + "unique_experts": 64, + "load_cv": 0.6328103506859286, + "normalized_load_entropy": 0.9541425013578121, + "max_load_share": 0.041884816753926704 + } + }, + "s1_bos": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "18fd6fefb9a20452d24fcd92e74d27675baa67c40e83e46cd61b214809bc3e86", + "route_weight_sha256": "07495f1a02ceb2a8b4447e8a26817980bb97290c2a2f35ed288f97db31124527", + "loads": [ + 21, + 12, + 8, + 2, + 13, + 4, + 24, + 5, + 15, + 25, + 38, + 12, + 15, + 9, + 25, + 18, + 30, + 7, + 12, + 45, + 8, + 7, + 10, + 23, + 13, + 15, + 33, + 12, + 8, + 22, + 7, + 20, + 9, + 25, + 4, + 16, + 8, + 12, + 11, + 21, + 22, + 14, + 14, + 12, + 11, + 8, + 12, + 15, + 23, + 15, + 37, + 12, + 11, + 9, + 6, + 15, + 6, + 1, + 45, + 37, + 7, + 4, + 9, + 27 + ], + "weighted_loads": [ + 1.0430917460471392, + 0.743032731115818, + 0.5056785382330418, + 0.06629820168018341, + 0.7737067900598049, + 0.12038627825677395, + 2.2953178621828556, + 0.1646190620958805, + 0.5399062782526016, + 1.485735233873129, + 2.9783561527729034, + 0.9504876397550106, + 0.820266954600811, + 0.5451391004025936, + 1.37298265658319, + 1.0319481007754803, + 3.441594298928976, + 0.2399140652269125, + 0.5198698341846466, + 5.492142703384161, + 0.36308110505342484, + 0.39820863492786884, + 0.41707673110067844, + 0.9184984397143126, + 0.5175076592713594, + 1.4363765604794025, + 1.5487498417496681, + 0.5690768919885159, + 0.33366152085363865, + 1.3245431315153837, + 0.2337619625031948, + 0.8554227668792009, + 0.8103871680796146, + 2.3294516056776047, + 0.12384099699556828, + 1.0921254213899374, + 0.3229437656700611, + 0.5789917279034853, + 0.5919976010918617, + 0.8981789611279964, + 0.8718566410243511, + 0.6543184705078602, + 1.228857472538948, + 0.7139279339462519, + 0.45929728634655476, + 0.7604965008795261, + 1.025081705302, + 0.6301336381584406, + 1.4557172935456038, + 1.0887583196163177, + 3.746275909245014, + 1.3929351791739464, + 0.646424975246191, + 0.326566593721509, + 0.2205737568438053, + 0.6701225079596043, + 0.3880083002150059, + 0.04532705992460251, + 5.476420355960727, + 2.2061859108507633, + 0.3142496198415756, + 0.2243541143834591, + 0.7491312362253666, + 1.0064005572348833 + ], + "unique_experts": 64, + "load_cv": 0.6462619855436393, + "normalized_load_entropy": 0.9536466011927609, + "max_load_share": 0.045180722891566265 + }, + "full_input": { + "tokens": 207, + "top_k": 6, + "decisions": 1242, + "ordered_route_sha256": "cfe989e005605db5ef882b2add2dcd6859fb26211b5af4369d0261b03f1a9d90", + "route_weight_sha256": "9542a8b7f9147b493ac40ffe75fb5b18b8c32b0070542dbc2689d3b0378fe854", + "loads": [ + 43, + 13, + 8, + 2, + 20, + 9, + 36, + 5, + 25, + 26, + 43, + 16, + 21, + 10, + 29, + 28, + 42, + 11, + 13, + 49, + 9, + 8, + 10, + 28, + 18, + 16, + 43, + 14, + 14, + 23, + 13, + 24, + 14, + 27, + 6, + 16, + 15, + 12, + 13, + 23, + 28, + 16, + 14, + 15, + 11, + 9, + 12, + 16, + 26, + 30, + 44, + 14, + 14, + 10, + 6, + 20, + 6, + 7, + 47, + 41, + 7, + 11, + 11, + 32 + ], + "weighted_loads": [ + 2.4031128343194723, + 0.7697824910283089, + 0.5056785382330418, + 0.06629820168018341, + 1.1654674522578716, + 0.3628905229270458, + 3.166265206411481, + 0.1646190620958805, + 1.1281442176550627, + 1.5167556796222925, + 3.2125911489129066, + 1.2811175305396318, + 1.3219468630850315, + 0.6275589279830456, + 1.5315727554261684, + 1.7015696074813604, + 4.651026241481304, + 0.3979393485933542, + 0.5708337537944317, + 5.758432988077402, + 0.39199010469019413, + 0.4802217800170183, + 0.41707673110067844, + 1.1625117156654596, + 0.7304816637188196, + 1.4648903422057629, + 2.2483780160546303, + 0.6942821443080902, + 0.7482276577502489, + 1.3615871388465166, + 0.4608061648905277, + 1.2908473294228315, + 1.2130904980003834, + 2.444103244692087, + 0.2744291853159666, + 1.0921254213899374, + 1.116787158884108, + 0.5789917279034853, + 0.656806942075491, + 0.9768592417240143, + 1.2323089316487312, + 0.7829718180000782, + 1.228857472538948, + 1.0260202642530203, + 0.45929728634655476, + 0.7998843304812908, + 1.025081705302, + 0.6643196251243353, + 1.598872252739966, + 3.056086700409651, + 4.094366043806076, + 1.460146740078926, + 0.726844253949821, + 0.4746397454291582, + 0.2205737568438053, + 1.4576173312962055, + 0.3880083002150059, + 0.7099592164158821, + 5.559631830081344, + 2.3762494027614594, + 0.3142496198415756, + 0.6008410453796387, + 0.8693679161369801, + 1.206450579687953 + ], + "unique_experts": 64, + "load_cv": 0.6115241560899309, + "normalized_load_entropy": 0.9578229357809366, + "max_load_share": 0.039452495974235106 + } + }, + "s0_x": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "d1631890a7c0925b03e5e2b7937760c5ff6076d86a3fb0208ebfe22e878b286e", + "route_weight_sha256": "4291c98f95e3bd567d812f9ce6c835af20cfae1a98bd04dea91acfc4f44b8f1a", + "loads": [ + 21, + 11, + 8, + 2, + 14, + 4, + 27, + 4, + 14, + 25, + 38, + 12, + 14, + 10, + 27, + 20, + 30, + 4, + 9, + 45, + 8, + 8, + 10, + 21, + 11, + 16, + 32, + 12, + 11, + 23, + 4, + 23, + 9, + 25, + 4, + 16, + 6, + 12, + 13, + 17, + 20, + 15, + 14, + 14, + 10, + 6, + 13, + 15, + 22, + 15, + 38, + 12, + 11, + 10, + 6, + 14, + 7, + 2, + 44, + 36, + 7, + 4, + 9, + 32 + ], + "weighted_loads": [ + 1.0538704451173544, + 0.7121842131018639, + 0.496608916670084, + 0.06748851388692856, + 0.8235257975757122, + 0.10808873549103737, + 2.471365373581648, + 0.1295368429273367, + 0.5451783388853073, + 1.4790586736053228, + 3.0286378245800734, + 0.9506486356258392, + 0.7779406234622002, + 0.5682240035384893, + 1.4578128326684237, + 1.0737585593014956, + 3.5935631468892097, + 0.15442941710352898, + 0.4094596114009619, + 5.359356934204698, + 0.37619223818182945, + 0.4360383339226246, + 0.42756236903369427, + 0.8416740205138922, + 0.4482978153973818, + 1.5000967904925346, + 1.5418433714658022, + 0.5725970845669508, + 0.41388154961168766, + 1.3744738213717937, + 0.15427519753575325, + 0.9420033469796181, + 0.8202563282102346, + 2.387750204652548, + 0.12160128727555275, + 1.0437020901590586, + 0.24612756073474884, + 0.6092387083917856, + 0.6796277593821287, + 0.7673019897192717, + 0.7969521004706621, + 0.6716626361012459, + 1.2575023882091045, + 0.8007030375301838, + 0.42619725316762924, + 0.684398952871561, + 1.1028725430369377, + 0.6200305856764317, + 1.4570281021296978, + 1.03593579120934, + 3.9388706237077713, + 1.296401221305132, + 0.6366682313382626, + 0.34973972104489803, + 0.22578726336359978, + 0.636272119358182, + 0.41459970921278, + 0.07586506009101868, + 5.478866769000888, + 2.2582937721163034, + 0.31049951165914536, + 0.2122250609099865, + 0.7654113285243511, + 1.223371608182788 + ], + "unique_experts": 64, + "load_cv": 0.6584263555793621, + "normalized_load_entropy": 0.9515106632961187, + "max_load_share": 0.045180722891566265 + }, + "full_input": { + "tokens": 191, + "top_k": 6, + "decisions": 1146, + "ordered_route_sha256": "11fd904b189eec6d3c0f0176ea06e233d1eaa3609537c15edcbe80704df1d936", + "route_weight_sha256": "fe8b23de761745af7b7848e5fdde60a9b2648695b3e6bbd48f2c970fc7efa0a8", + "loads": [ + 25, + 11, + 8, + 2, + 20, + 5, + 34, + 5, + 20, + 26, + 43, + 13, + 19, + 10, + 36, + 21, + 37, + 6, + 9, + 47, + 8, + 8, + 10, + 28, + 15, + 17, + 43, + 12, + 14, + 23, + 9, + 23, + 14, + 27, + 4, + 16, + 11, + 12, + 14, + 17, + 26, + 16, + 14, + 18, + 10, + 6, + 13, + 17, + 23, + 23, + 42, + 14, + 17, + 11, + 6, + 19, + 7, + 2, + 45, + 37, + 7, + 7, + 9, + 35 + ], + "weighted_loads": [ + 1.2054582107812166, + 0.7121842131018639, + 0.496608916670084, + 0.06748851388692856, + 1.2105164788663387, + 0.12682952173054218, + 2.995448637753725, + 0.1638633031398058, + 0.9973577298223972, + 1.5105251763015985, + 3.244554268196225, + 0.9808479435741901, + 1.2112916521728039, + 0.5682240035384893, + 1.82296990044415, + 1.1134743113070726, + 4.369156647473574, + 0.22795383259654045, + 0.4094596114009619, + 5.4886992406100035, + 0.37619223818182945, + 0.4360383339226246, + 0.42756236903369427, + 1.2593626249581575, + 0.5713489018380642, + 1.5285241231322289, + 2.299243228510022, + 0.5725970845669508, + 0.5269504189491272, + 1.3744738213717937, + 0.3708999380469322, + 0.9420033469796181, + 1.2374116536229849, + 2.4751421958208084, + 0.12160128727555275, + 1.0437020901590586, + 1.0115605490282178, + 0.6092387083917856, + 0.7107188738882542, + 0.7673019897192717, + 1.068605637177825, + 0.7099014446139336, + 1.2575023882091045, + 1.0127120837569237, + 0.42619725316762924, + 0.684398952871561, + 1.1028725430369377, + 0.6853234674781561, + 1.4705213820561767, + 2.008870555087924, + 4.16511083394289, + 1.383238073438406, + 0.824540407396853, + 0.38656565360724926, + 0.22578726336359978, + 1.3989578876644373, + 0.41459970921278, + 0.07586506009101868, + 5.523908222094178, + 2.2870233673602343, + 0.31049951165914536, + 0.3669857494533062, + 0.7654113285243511, + 1.3544863760471344 + ], + "unique_experts": 64, + "load_cv": 0.6401604553542036, + "normalized_load_entropy": 0.9531636009012696, + "max_load_share": 0.04101221640488656 + } + }, + "s1_x": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "ee2c5be1039ee3e49c3044f3b23c2564410afcc5f0a30307264feae40f1c0ad1", + "route_weight_sha256": "597b994e537192c5433888dcf5559a25ba206f4bb6ba7f99b5b798e8795d3e75", + "loads": [ + 21, + 12, + 8, + 1, + 14, + 3, + 25, + 4, + 17, + 28, + 38, + 11, + 14, + 9, + 26, + 20, + 31, + 7, + 11, + 44, + 7, + 8, + 10, + 22, + 13, + 17, + 34, + 12, + 7, + 19, + 3, + 19, + 9, + 23, + 4, + 17, + 7, + 11, + 13, + 20, + 20, + 17, + 14, + 14, + 11, + 7, + 13, + 14, + 23, + 14, + 39, + 12, + 11, + 10, + 6, + 16, + 6, + 1, + 45, + 37, + 7, + 5, + 9, + 26 + ], + "weighted_loads": [ + 1.0302603337913752, + 0.7493370845913887, + 0.5014755763113499, + 0.0320233590900898, + 0.8258937373757362, + 0.08253313787281513, + 2.404438192024827, + 0.1353621818125248, + 0.6251073330640793, + 1.6211269292980433, + 3.0725959222763777, + 0.8720272835344076, + 0.7515904158353806, + 0.5316773727536201, + 1.4285527877509594, + 1.1358642615377903, + 3.6465316228568554, + 0.24663940630853176, + 0.48023296147584915, + 5.4631823524832726, + 0.3267618678510189, + 0.4428395926952362, + 0.4037690069526434, + 0.9073340184986591, + 0.5086907856166363, + 1.5336830113083124, + 1.5906046982854605, + 0.568971898406744, + 0.28400130942463875, + 1.2647256217896938, + 0.12051770836114883, + 0.8142680358141661, + 0.8193701859563589, + 2.3098851647228003, + 0.11396508105099201, + 1.1446762699633837, + 0.27281734347343445, + 0.5436384305357933, + 0.6451975740492344, + 0.8454335127025843, + 0.7979479916393757, + 0.7597064953297377, + 1.2267892323434353, + 0.7975446991622448, + 0.45266225934028625, + 0.7104498259723186, + 1.101023767143488, + 0.5750079024583101, + 1.4904000218957663, + 0.964886637404561, + 3.8515210691839457, + 1.3597108237445354, + 0.6549883037805557, + 0.35392772033810616, + 0.22103122621774673, + 0.7118351999670267, + 0.3849190026521683, + 0.042576443403959274, + 5.548865774646401, + 2.284284073859453, + 0.31492577120661736, + 0.2664600573480129, + 0.7307051196694374, + 1.0069775488227606 + ], + "unique_experts": 64, + "load_cv": 0.658622293940454, + "normalized_load_entropy": 0.9508336061817865, + "max_load_share": 0.045180722891566265 + }, + "full_input": { + "tokens": 207, + "top_k": 6, + "decisions": 1242, + "ordered_route_sha256": "ce808f5cb9b0562023da6d9a4894c2458258f2a4a94c8cd266575e6eb594fa51", + "route_weight_sha256": "cc07ef439935c2ef8009f88d3a7428065437cbfbf9ccb1ba6dcceec8e1a0e421", + "loads": [ + 42, + 13, + 8, + 1, + 21, + 6, + 37, + 4, + 28, + 29, + 44, + 15, + 20, + 10, + 30, + 32, + 43, + 11, + 12, + 49, + 8, + 9, + 10, + 28, + 16, + 18, + 45, + 14, + 13, + 21, + 9, + 23, + 15, + 25, + 6, + 17, + 13, + 11, + 15, + 22, + 25, + 19, + 14, + 17, + 11, + 8, + 13, + 16, + 27, + 27, + 44, + 15, + 14, + 11, + 6, + 20, + 6, + 7, + 47, + 41, + 7, + 13, + 11, + 30 + ], + "weighted_loads": [ + 2.319671381264925, + 0.7760868445038795, + 0.5014755763113499, + 0.0320233590900898, + 1.2164062336087227, + 0.2355601117014885, + 3.4025369100272655, + 0.1353621818125248, + 1.3012780752032995, + 1.6521473750472069, + 3.3600271698087454, + 1.2026571743190289, + 1.2437127530574799, + 0.6140972003340721, + 1.5871428865939379, + 1.861668849363923, + 4.872366428375244, + 0.4046646896749735, + 0.5311968810856342, + 5.781074076890945, + 0.3556708674877882, + 0.5248527377843857, + 0.4037690069526434, + 1.2267151102423668, + 0.6066249497234821, + 1.5621967930346727, + 2.419100468978286, + 0.6941771507263184, + 0.698567446321249, + 1.3283388130366802, + 0.34756191074848175, + 1.2496925983577967, + 1.264409275725484, + 2.4245368037372828, + 0.26455326937139034, + 1.1446762699633837, + 0.9350427919998765, + 0.5436384305357933, + 0.7100069150328636, + 0.9218116942793131, + 1.0389336198568344, + 0.8844193983823061, + 1.2267892323434353, + 1.2024693228304386, + 0.45266225934028625, + 0.7498376555740833, + 1.101023767143488, + 0.6499403547495604, + 1.66810189653188, + 2.662676176056266, + 4.045940602198243, + 1.4628556855022907, + 0.7354075824841857, + 0.5020008720457554, + 0.22103122621774673, + 1.4234625287353992, + 0.3849190026521683, + 0.7072085998952389, + 5.632077248767018, + 2.4543475657701492, + 0.31492577120661736, + 0.6934490948915482, + 0.8509417995810509, + 1.1469859816133976 + ], + "unique_experts": 64, + "load_cv": 0.6236168412473838, + "normalized_load_entropy": 0.9556064680113863, + "max_load_share": 0.039452495974235106 + } + }, + "s0_period": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "6d02681041ccece618e87a1a55af13b748d38524862e35bf374c0a751893c4c3", + "route_weight_sha256": "cedb237ea96028c26514dcaaaf5ebc916595aaedec314cd97002b4dbd89dcc86", + "loads": [ + 21, + 10, + 8, + 2, + 13, + 2, + 28, + 4, + 16, + 27, + 38, + 12, + 14, + 9, + 26, + 20, + 31, + 5, + 11, + 45, + 7, + 8, + 11, + 21, + 10, + 16, + 32, + 12, + 10, + 22, + 5, + 21, + 9, + 24, + 5, + 16, + 7, + 11, + 13, + 17, + 22, + 15, + 13, + 14, + 11, + 7, + 13, + 16, + 23, + 15, + 38, + 12, + 10, + 9, + 6, + 13, + 7, + 1, + 45, + 37, + 7, + 4, + 9, + 30 + ], + "weighted_loads": [ + 1.0830949991941452, + 0.6720075532793999, + 0.49958550184965134, + 0.06708228215575218, + 0.7769255992025137, + 0.0532624926418066, + 2.5125955808907747, + 0.12759988196194172, + 0.6008821353316307, + 1.5402539800852537, + 3.0267772004008293, + 0.9523335117846727, + 0.7617291286587715, + 0.5449534505605698, + 1.3973634000867605, + 1.1171927321702242, + 3.64355156943202, + 0.17520691454410553, + 0.4642950613051653, + 5.392878923565149, + 0.3453959822654724, + 0.43952788785099983, + 0.46521638706326485, + 0.8231615666300058, + 0.4226935897022486, + 1.5040766894817352, + 1.547829670831561, + 0.5662717223167419, + 0.38596415892243385, + 1.340267363935709, + 0.17429841309785843, + 0.8940750397741795, + 0.8192734569311142, + 2.3714686073362827, + 0.14359132386744022, + 1.020628234371543, + 0.27307160198688507, + 0.5810226537287235, + 0.6731827799230814, + 0.7695509400218725, + 0.8498182818293571, + 0.669361324980855, + 1.2083710618317127, + 0.8019655104726553, + 0.44779096357524395, + 0.7225409336388111, + 1.0982654504477978, + 0.6632811799645424, + 1.493267035111785, + 1.086804462596774, + 3.906370325013995, + 1.2817060388624668, + 0.6021139919757843, + 0.3197064474225044, + 0.2312830239534378, + 0.6109584253281355, + 0.41342898830771446, + 0.044461604207754135, + 5.545550111681223, + 2.352983947843313, + 0.32432085275650024, + 0.21853088587522507, + 0.7862700298428535, + 1.1415472961962223 + ], + "unique_experts": 64, + "load_cv": 0.664376479501202, + "normalized_load_entropy": 0.9504976369416621, + "max_load_share": 0.045180722891566265 + }, + "full_input": { + "tokens": 191, + "top_k": 6, + "decisions": 1146, + "ordered_route_sha256": "3e3e97944037f971f6bdbab9c0e47d22d77a5188b1ff918bfc35a1894281cb13", + "route_weight_sha256": "d04dfb46c24aab5c3ec423a41b33126a8b09b272323ea229055ae3764cfaa665", + "loads": [ + 25, + 10, + 8, + 2, + 19, + 4, + 37, + 5, + 23, + 28, + 42, + 13, + 19, + 9, + 35, + 21, + 38, + 7, + 11, + 46, + 7, + 8, + 11, + 28, + 13, + 17, + 43, + 12, + 13, + 22, + 10, + 21, + 14, + 26, + 5, + 16, + 12, + 11, + 14, + 17, + 28, + 17, + 13, + 17, + 11, + 7, + 13, + 17, + 25, + 23, + 42, + 14, + 15, + 9, + 6, + 18, + 7, + 1, + 47, + 38, + 7, + 7, + 9, + 33 + ], + "weighted_loads": [ + 1.2348501924425364, + 0.6720075532793999, + 0.49958550184965134, + 0.06708228215575218, + 1.2248882558196783, + 0.1039234884083271, + 3.052840419113636, + 0.16192634217441082, + 1.078984621912241, + 1.5717204827815294, + 3.1750389747321606, + 0.9825328197330236, + 1.1637750826776028, + 0.5449534505605698, + 1.7625204678624868, + 1.1569084841758013, + 4.411870047450066, + 0.248731330037117, + 0.4642950613051653, + 5.472144868224859, + 0.3453959822654724, + 0.43952788785099983, + 0.46521638706326485, + 1.2280367221683264, + 0.5268485136330128, + 1.5325040221214294, + 2.232905948534608, + 0.5662717223167419, + 0.4990330282598734, + 1.340267363935709, + 0.39587627723813057, + 0.8940750397741795, + 1.2364287823438644, + 2.4588605985045433, + 0.14359132386744022, + 1.020628234371543, + 1.047199253924191, + 0.5810226537287235, + 0.7042738944292068, + 0.7695509400218725, + 1.2002321779727936, + 0.7511991951614618, + 1.2083710618317127, + 0.9280165992677212, + 0.44779096357524395, + 0.7225409336388111, + 1.0982654504477978, + 0.6976966932415962, + 1.5354585153982043, + 2.0782718639820814, + 4.130121821537614, + 1.368542890995741, + 0.7510248245671391, + 0.3197064474225044, + 0.2312830239534378, + 1.3784255106002092, + 0.41342898830771446, + 0.044461604207754135, + 5.643929824233055, + 2.381713543087244, + 0.32432085275650024, + 0.451289065182209, + 0.7862700298428535, + 1.2691023647785187 + ], + "unique_experts": 64, + "load_cv": 0.6475023864655677, + "normalized_load_entropy": 0.9520535636278914, + "max_load_share": 0.04101221640488656 + } + }, + "s1_period": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "7467ff54c7df4f29be7511850f86240c55a153d760669810131847ed7d402fa0", + "route_weight_sha256": "0f4a002ba92328ef05904c39f43e0970ab7adb5015aa6a6b78582e47d8ca8a46", + "loads": [ + 22, + 12, + 8, + 1, + 12, + 4, + 27, + 3, + 16, + 27, + 38, + 11, + 14, + 9, + 25, + 20, + 32, + 8, + 12, + 44, + 8, + 8, + 9, + 22, + 12, + 15, + 33, + 12, + 8, + 19, + 5, + 20, + 9, + 24, + 4, + 17, + 6, + 9, + 12, + 21, + 22, + 20, + 13, + 14, + 9, + 8, + 13, + 13, + 25, + 15, + 37, + 12, + 9, + 10, + 3, + 15, + 6, + 2, + 45, + 38, + 7, + 5, + 9, + 28 + ], + "weighted_loads": [ + 1.0514911152422428, + 0.7574245613068342, + 0.49668218940496445, + 0.03207891434431076, + 0.7569246180355549, + 0.1185427624732256, + 2.5375711992383003, + 0.09417814202606678, + 0.5965551547706127, + 1.5856467131525278, + 3.0749573186039925, + 0.8851225432008505, + 0.7650625444948673, + 0.5322943888604641, + 1.354562109336257, + 1.1637655198574066, + 3.686520516872406, + 0.27650779485702515, + 0.5214543100446463, + 5.469971474260092, + 0.3645654618740082, + 0.4382712319493294, + 0.38795700296759605, + 0.8976477105170488, + 0.47096930630505085, + 1.4520284831523895, + 1.5633548889309168, + 0.5765857975929976, + 0.3289976492524147, + 1.2378365211188793, + 0.17457274347543716, + 0.8475709687918425, + 0.8284304831176996, + 2.3410427197813988, + 0.11718230694532394, + 1.0669098235666752, + 0.2337142415344715, + 0.4894125312566757, + 0.62011294439435, + 0.8987301178276539, + 0.8629708494991064, + 0.8725292161107063, + 1.170220747590065, + 0.7859388925135136, + 0.36934554390609264, + 0.7528467625379562, + 1.0973008386790752, + 0.541836267337203, + 1.5775876175612211, + 1.0866285488009453, + 3.822041278705001, + 1.2859312184154987, + 0.5904930345714092, + 0.3573400527238846, + 0.11969171091914177, + 0.6889180485159159, + 0.3853849694132805, + 0.07284137979149818, + 5.555566340684891, + 2.3205258417874575, + 0.3143973536789417, + 0.2638870142400265, + 0.7411624863743782, + 1.0536204148083925 + ], + "unique_experts": 64, + "load_cv": 0.6661220981916142, + "normalized_load_entropy": 0.9499383805970902, + "max_load_share": 0.045180722891566265 + }, + "full_input": { + "tokens": 207, + "top_k": 6, + "decisions": 1242, + "ordered_route_sha256": "bd246bd3fb935f58202858655074ed022d54518f015b3b5c942667aa05e907fe", + "route_weight_sha256": "ad145e56d4b24ef900d5ae10c453510b2895ebc3d809dd857d266a9a7d5121a5", + "loads": [ + 43, + 13, + 8, + 1, + 21, + 7, + 39, + 3, + 28, + 28, + 44, + 15, + 20, + 10, + 29, + 32, + 44, + 12, + 13, + 48, + 9, + 9, + 9, + 27, + 16, + 16, + 44, + 14, + 14, + 20, + 11, + 24, + 14, + 27, + 6, + 17, + 12, + 9, + 14, + 22, + 27, + 22, + 13, + 17, + 9, + 9, + 13, + 15, + 29, + 27, + 45, + 14, + 12, + 11, + 3, + 18, + 6, + 8, + 48, + 42, + 7, + 13, + 11, + 31 + ], + "weighted_loads": [ + 2.3278843630105257, + 0.7841743212193251, + 0.49668218940496445, + 0.03207891434431076, + 1.2657143101096153, + 0.27156973630189896, + 3.5470504257827997, + 0.09417814202606678, + 1.2858780976384878, + 1.6166671589016914, + 3.338101463392377, + 1.2157524339854717, + 1.2391544505953789, + 0.6147142164409161, + 1.5131522081792355, + 1.9039211515337229, + 4.905603088438511, + 0.4345330782234669, + 0.5724182296544313, + 5.736261758953333, + 0.3934744615107775, + 0.5202843770384789, + 0.38795700296759605, + 1.141660986468196, + 0.594492107629776, + 1.4805422648787498, + 2.311376953497529, + 0.7017910499125719, + 0.743563786149025, + 1.2748805284500122, + 0.4016169458627701, + 1.282995531335473, + 1.2311338130384684, + 2.488917540758848, + 0.2677704952657223, + 1.0669098235666752, + 1.012448732741177, + 0.4894125312566757, + 0.6849222853779793, + 0.9349083192646503, + 1.1634747181087732, + 0.9995420016348362, + 1.170220747590065, + 1.1071443371474743, + 0.36934554390609264, + 0.7922345921397209, + 1.0973008386790752, + 0.6112620998173952, + 1.760663797147572, + 2.7443363070487976, + 4.1156564727425575, + 1.3531427793204784, + 0.6709123132750392, + 0.5054132044315338, + 0.11969171091914177, + 1.381158860400319, + 0.3853849694132805, + 0.7374735362827778, + 5.701383225619793, + 2.4905893336981535, + 0.3143973536789417, + 0.8088500499725342, + 0.8613991662859917, + 1.1689160950481892 + ], + "unique_experts": 64, + "load_cv": 0.6375001776390281, + "normalized_load_entropy": 0.9534057329672816, + "max_load_share": 0.03864734299516908 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 166, + "ordered_topk_exact_tokens": 93, + "set_exact_tokens": 118, + "mean_set_jaccard": 0.9148020654044751, + "mean_token_weighted_tv": 0.016810856428535945, + "aggregate_load_tv": 0.02911646586345381 + }, + "system_bos": { + "tokens": 166, + "ordered_topk_exact_tokens": 90, + "set_exact_tokens": 118, + "mean_set_jaccard": 0.9148020654044753, + "mean_token_weighted_tv": 0.01864283007614494, + "aggregate_load_tv": 0.03112449799196787 + }, + "system_x": { + "tokens": 166, + "ordered_topk_exact_tokens": 81, + "set_exact_tokens": 112, + "mean_set_jaccard": 0.9034710269650029, + "mean_token_weighted_tv": 0.022349184126514626, + "aggregate_load_tv": 0.035140562248995984 + }, + "system_period": { + "tokens": 166, + "ordered_topk_exact_tokens": 76, + "set_exact_tokens": 106, + "mean_set_jaccard": 0.891853126792886, + "mean_token_weighted_tv": 0.022915795120040338, + "aggregate_load_tv": 0.03413654618473896 + }, + "bos_at_s0": { + "tokens": 166, + "ordered_topk_exact_tokens": 88, + "set_exact_tokens": 114, + "mean_set_jaccard": 0.9092082616179002, + "mean_token_weighted_tv": 0.021086264965517156, + "aggregate_load_tv": 0.02811244979919678 + }, + "bos_at_s1": { + "tokens": 166, + "ordered_topk_exact_tokens": 79, + "set_exact_tokens": 102, + "mean_set_jaccard": 0.8798049340218014, + "mean_token_weighted_tv": 0.025633777155125714, + "aggregate_load_tv": 0.03413654618473895 + }, + "x_at_s0": { + "tokens": 166, + "ordered_topk_exact_tokens": 94, + "set_exact_tokens": 120, + "mean_set_jaccard": 0.9156626506024096, + "mean_token_weighted_tv": 0.021562139217528593, + "aggregate_load_tv": 0.02811244979919679 + }, + "x_at_s1": { + "tokens": 166, + "ordered_topk_exact_tokens": 64, + "set_exact_tokens": 96, + "mean_set_jaccard": 0.8691910499139415, + "mean_token_weighted_tv": 0.029414497355156274, + "aggregate_load_tv": 0.036144578313253004 + }, + "period_at_s0": { + "tokens": 166, + "ordered_topk_exact_tokens": 82, + "set_exact_tokens": 111, + "mean_set_jaccard": 0.898881239242685, + "mean_token_weighted_tv": 0.02407510594902448, + "aggregate_load_tv": 0.028112449799196786 + }, + "period_at_s1": { + "tokens": 166, + "ordered_topk_exact_tokens": 61, + "set_exact_tokens": 93, + "mean_set_jaccard": 0.8607286288009182, + "mean_token_weighted_tv": 0.031184914151588118, + "aggregate_load_tv": 0.0391566265060241 + } + } + }, + "layer_16": { + "layer": 16, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "6ec01953d60cd3203f6c6fce0eb367a4a1e16351c3171b24f8357e2ee4b2710b", + "route_weight_sha256": "ec114f471c0383d704387c1b9b428413380330447e4636816df3dda15571e3d6", + "loads": [ + 12, + 10, + 8, + 9, + 11, + 29, + 12, + 7, + 14, + 7, + 50, + 27, + 7, + 13, + 49, + 35, + 22, + 17, + 14, + 7, + 35, + 38, + 1, + 8, + 24, + 13, + 22, + 9, + 10, + 2, + 13, + 16, + 4, + 9, + 19, + 16, + 14, + 12, + 18, + 7, + 4, + 23, + 19, + 13, + 12, + 9, + 26, + 14, + 15, + 15, + 10, + 4, + 6, + 10, + 22, + 46, + 12, + 17, + 17, + 16, + 6, + 19, + 9, + 2 + ], + "weighted_loads": [ + 0.6280934456735849, + 0.5712468065321445, + 0.36233395896852016, + 0.60403005592525, + 0.4414168503135443, + 1.7508910410106182, + 0.5779018215835094, + 0.5720073245465755, + 0.8423656243830919, + 0.2815386541187763, + 4.523262623697519, + 1.1948375012725592, + 0.28387062437832355, + 0.49183461628854275, + 5.283044191077352, + 4.81545727327466, + 0.9934555608779192, + 0.8431822918355465, + 0.5679623335599899, + 0.27369918674230576, + 4.662618268281221, + 2.3195427991449833, + 0.04616204649209976, + 0.3608402870595455, + 1.2820862233638763, + 0.9647228233516216, + 1.67026331089437, + 0.7456956170499325, + 0.5922192744910717, + 0.05820309743285179, + 0.5869940835982561, + 0.6163744367659092, + 0.3253280371427536, + 0.3346152678132057, + 0.8810938708484173, + 2.0349330194294453, + 0.7095408327877522, + 0.5418339483439922, + 1.009150441735983, + 0.2964446973055601, + 0.16445058211684227, + 1.6779877953231335, + 0.8540160413831472, + 0.9736261945217848, + 0.5242880024015903, + 0.5898767895996571, + 2.526675518602133, + 0.9527136720716953, + 1.5640306547284126, + 0.5655403733253479, + 0.5087048001587391, + 0.18423372507095337, + 0.31081928312778473, + 0.7774146385490894, + 1.9429359659552574, + 3.054536847397685, + 0.6231764163821936, + 0.883562782779336, + 0.9718460459262133, + 1.1720281187444925, + 0.21585823968052864, + 0.8435846455395222, + 0.45309135876595974, + 0.06662719324231148 + ], + "unique_experts": 64, + "load_cv": 0.6869113685698554, + "normalized_load_entropy": 0.9497942216961446, + "max_load_share": 0.050200803212851405 + }, + "full_input": { + "tokens": 191, + "top_k": 6, + "decisions": 1146, + "ordered_route_sha256": "2f1f7d23f44db544c045fc450f69318882fd49228626eaf332eb872f969a4b4b", + "route_weight_sha256": "29ad9f633c93b6b36c6ae00e07a7e53f7ab171c7b1ee0da8db647226af95ea92", + "loads": [ + 12, + 10, + 8, + 9, + 11, + 38, + 15, + 7, + 14, + 10, + 55, + 27, + 7, + 14, + 49, + 41, + 31, + 19, + 19, + 9, + 47, + 40, + 3, + 8, + 30, + 13, + 29, + 9, + 10, + 2, + 14, + 16, + 5, + 16, + 19, + 16, + 14, + 21, + 18, + 7, + 5, + 33, + 21, + 15, + 17, + 10, + 26, + 15, + 15, + 16, + 10, + 6, + 6, + 21, + 22, + 56, + 12, + 17, + 17, + 16, + 10, + 20, + 9, + 9 + ], + "weighted_loads": [ + 0.6280934456735849, + 0.5712468065321445, + 0.36233395896852016, + 0.60403005592525, + 0.4414168503135443, + 2.5698849614709616, + 0.7098650559782982, + 0.5720073245465755, + 0.8423656243830919, + 1.6774337403476238, + 4.8293677400797606, + 1.1948375012725592, + 0.28387062437832355, + 0.5109249446541071, + 5.283044191077352, + 5.357462078332901, + 1.5260008708573878, + 1.0449026711285114, + 1.1666470728814602, + 0.3159418504219502, + 5.630693743005395, + 2.3971220795065165, + 0.18164778500795364, + 0.3608402870595455, + 1.8518349155783653, + 0.9647228233516216, + 2.1246852837502956, + 0.7456956170499325, + 0.5922192744910717, + 0.05820309743285179, + 0.6626713592559099, + 0.6163744367659092, + 0.36519190296530724, + 0.6480105053633451, + 0.8810938708484173, + 2.0349330194294453, + 0.7095408327877522, + 1.0176065564155579, + 1.009150441735983, + 0.2964446973055601, + 0.2084970436990261, + 2.810929972678423, + 0.9332468342036009, + 1.0819685105234385, + 0.7279384788125753, + 0.6620783917605877, + 2.526675518602133, + 0.9987627826631069, + 1.5640306547284126, + 0.5827769860625267, + 0.5087048001587391, + 0.28001995757222176, + 0.31081928312778473, + 1.5527665335685015, + 1.9429359659552574, + 3.853767415508628, + 0.6231764163821936, + 0.883562782779336, + 0.9718460459262133, + 1.1720281187444925, + 0.451741736382246, + 0.8454191439086571, + 0.45309135876595974, + 0.3721161773428321 + ], + "unique_experts": 64, + "load_cv": 0.6843123100965197, + "normalized_load_entropy": 0.951046415506473, + "max_load_share": 0.04886561954624782 + } + }, + "s1_eos": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "593c909169e80290997057610e4a8e3179d7ada5b27dfd51679e4597db76bd5f", + "route_weight_sha256": "317093331705440e6156cce6253f335a8efaf0307bea1f18b3451f2a03c61c4c", + "loads": [ + 12, + 10, + 8, + 10, + 10, + 29, + 10, + 8, + 14, + 6, + 49, + 29, + 7, + 12, + 52, + 37, + 19, + 20, + 12, + 8, + 35, + 39, + 1, + 7, + 24, + 13, + 21, + 9, + 10, + 2, + 13, + 17, + 4, + 10, + 21, + 17, + 14, + 12, + 18, + 5, + 4, + 22, + 21, + 11, + 10, + 7, + 28, + 14, + 15, + 15, + 10, + 4, + 7, + 11, + 21, + 45, + 12, + 18, + 16, + 16, + 5, + 20, + 9, + 1 + ], + "weighted_loads": [ + 0.6284793484956026, + 0.5751770101487637, + 0.3693064730614424, + 0.6406383402645588, + 0.40810108557343483, + 1.7985665332525969, + 0.5010241195559502, + 0.5875698123127222, + 0.8517024982720613, + 0.2524052783846855, + 4.433077936992049, + 1.2310295552015305, + 0.2892631031572819, + 0.451042290776968, + 5.393612721934915, + 4.873974222689867, + 0.8179912231862545, + 0.9303671754896641, + 0.5041291322559118, + 0.3154766485095024, + 4.617148391902447, + 2.3257654067128897, + 0.04997732862830162, + 0.3265538550913334, + 1.266903966665268, + 0.966645635664463, + 1.6206581257283688, + 0.7250820063054562, + 0.5897864811122417, + 0.06189040280878544, + 0.5861878786236048, + 0.6401909366250038, + 0.32326367124915123, + 0.3804759308695793, + 1.0247618705034256, + 2.0474828742444515, + 0.6815205253660679, + 0.5213401522487402, + 0.9981616660952568, + 0.20413516648113728, + 0.15963903814554214, + 1.6887240931391716, + 0.9148157611489296, + 0.8589861374348402, + 0.43793581798672676, + 0.5055323801934719, + 2.5528689064085484, + 0.924828689545393, + 1.52819855324924, + 0.5505411606281996, + 0.48345716670155525, + 0.1924852915108204, + 0.3500996492803097, + 0.8048070035874844, + 1.9141181241720915, + 3.0241434294730425, + 0.619080189615488, + 0.9335812050849199, + 0.9282659236341715, + 1.1390790566802025, + 0.18785185366868973, + 0.8968993593007326, + 0.4513129945844412, + 0.033610064536333084 + ], + "unique_experts": 64, + "load_cv": 0.7076369040005057, + "normalized_load_entropy": 0.9464943856182243, + "max_load_share": 0.05220883534136546 + }, + "full_input": { + "tokens": 207, + "top_k": 6, + "decisions": 1242, + "ordered_route_sha256": "ad4deac818c286d07a54b3c556de39811117b3b4ed458633df77fee0080ac24f", + "route_weight_sha256": "8b2d20821f5230c4db78b5ab8084d54724c055dab23e1032dc53c6ef58986ae7", + "loads": [ + 12, + 13, + 8, + 12, + 10, + 38, + 15, + 9, + 14, + 10, + 55, + 31, + 7, + 15, + 53, + 47, + 29, + 29, + 21, + 9, + 46, + 41, + 4, + 8, + 37, + 13, + 34, + 9, + 10, + 2, + 16, + 17, + 9, + 16, + 22, + 19, + 14, + 21, + 20, + 8, + 7, + 37, + 25, + 15, + 13, + 12, + 29, + 21, + 18, + 19, + 16, + 5, + 7, + 23, + 21, + 56, + 14, + 18, + 16, + 17, + 9, + 21, + 12, + 8 + ], + "weighted_loads": [ + 0.6284793484956026, + 0.695466160774231, + 0.3693064730614424, + 0.7299351543188095, + 0.40810108557343483, + 2.6747592706233263, + 0.747912835329771, + 0.6125981640070677, + 0.8517024982720613, + 1.65083596855402, + 4.731544565409422, + 1.2878468055278063, + 0.2892631031572819, + 0.5424568559974432, + 5.446975959464908, + 5.939167205244303, + 1.269885296933353, + 1.6262995228171349, + 1.406030161306262, + 0.31794597464613616, + 5.553866043686867, + 2.416795874014497, + 0.16576403751969337, + 0.4019913338124752, + 2.3422909267246723, + 0.966645635664463, + 2.9827180709689856, + 0.7250820063054562, + 0.5897864811122417, + 0.06189040280878544, + 0.7264346275478601, + 0.6401909366250038, + 0.5448494739830494, + 0.6151584242470562, + 1.0598079152405262, + 2.165351942181587, + 0.6815205253660679, + 1.0041673593223095, + 1.120218250900507, + 0.3811125662177801, + 0.2697273753583431, + 3.705888845026493, + 1.0530062839388847, + 1.0632696580141783, + 0.5588753875344992, + 0.7424967437982559, + 2.582960117608309, + 1.2533940114080906, + 1.6546307988464832, + 0.7261272836476564, + 0.7456458285450935, + 0.2325204461812973, + 0.3500996492803097, + 1.8753740657120943, + 1.9141181241720915, + 3.9654794726520777, + 0.7273069657385349, + 0.9335812050849199, + 0.9282659236341715, + 1.3368476554751396, + 0.37918679788708687, + 0.8987535071792081, + 0.7834797855466604, + 0.34852934442460537 + ], + "unique_experts": 64, + "load_cv": 0.6571764955235998, + "normalized_load_entropy": 0.9536724058582248, + "max_load_share": 0.04508856682769726 + } + }, + "s0_bos": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "40eff392c25e14115848af7d0a2f2c764721c910be5f976e0cd258d7b01d033a", + "route_weight_sha256": "8ede3be59624d5d8a4558471f1593cf430eb6962297ff6d414381dc33225b32c", + "loads": [ + 12, + 11, + 7, + 8, + 10, + 28, + 10, + 7, + 14, + 7, + 49, + 26, + 7, + 11, + 50, + 36, + 20, + 19, + 13, + 7, + 34, + 38, + 1, + 8, + 24, + 14, + 26, + 10, + 10, + 2, + 12, + 18, + 4, + 10, + 19, + 15, + 15, + 12, + 18, + 5, + 4, + 23, + 18, + 11, + 10, + 8, + 28, + 14, + 16, + 12, + 9, + 5, + 8, + 11, + 23, + 44, + 11, + 21, + 20, + 16, + 4, + 20, + 10, + 3 + ], + "weighted_loads": [ + 0.6351128835231066, + 0.6019122060388327, + 0.3075857125222683, + 0.6132428534328938, + 0.418447257950902, + 1.772070212289691, + 0.5075245201587677, + 0.5823131464421749, + 0.8658502716571093, + 0.3457183614373207, + 4.642329370602965, + 1.151473417878151, + 0.29133101366460323, + 0.4228574614971876, + 5.348585670813918, + 5.0031833574175835, + 0.8997032511979342, + 0.9417005218565464, + 0.5314298756420612, + 0.26921907626092434, + 4.7575907446444035, + 2.430648308247328, + 0.048595085740089417, + 0.3594096265733242, + 1.2524290159344673, + 0.9952044952660799, + 1.865673542022705, + 0.6415042988955975, + 0.6253266781568527, + 0.06856427900493145, + 0.5244838744401932, + 0.6838688421994448, + 0.3598723579198122, + 0.37650302052497864, + 0.9275946021080017, + 2.045743003487587, + 0.7187844514846802, + 0.5330816842615604, + 1.0137382335960865, + 0.1964122448116541, + 0.16162604838609695, + 1.6945199463516474, + 0.8099522199481726, + 0.9027427230030298, + 0.431685172021389, + 0.5854549035429955, + 2.6105335503816605, + 0.9650236181914806, + 1.5960886105895042, + 0.48274097219109535, + 0.49412452057003975, + 0.20845884643495083, + 0.37156532518565655, + 0.7929757293313742, + 1.9595203269273043, + 3.035468904301524, + 0.5938409697264433, + 1.0038348566740751, + 1.084507741034031, + 1.189280616119504, + 0.1494508534669876, + 0.8612697497010231, + 0.503429725766182, + 0.08570874109864235 + ], + "unique_experts": 64, + "load_cv": 0.6916847311413459, + "normalized_load_entropy": 0.9486860205155522, + "max_load_share": 0.050200803212851405 + }, + "full_input": { + "tokens": 191, + "top_k": 6, + "decisions": 1146, + "ordered_route_sha256": "6f68fefc10a1eafd038cbcbe71a8ed2dda582ee5046cfd1690f869e452cac2a9", + "route_weight_sha256": "c485c5f389ebe9273d9e999cd3cf01602106afebf644c35bccca54254dd313b4", + "loads": [ + 12, + 11, + 8, + 8, + 10, + 38, + 14, + 7, + 14, + 10, + 54, + 27, + 9, + 12, + 50, + 42, + 28, + 21, + 18, + 9, + 46, + 40, + 3, + 8, + 29, + 14, + 32, + 10, + 10, + 2, + 13, + 18, + 5, + 15, + 20, + 15, + 15, + 20, + 18, + 5, + 5, + 33, + 20, + 13, + 15, + 9, + 28, + 15, + 16, + 14, + 10, + 7, + 8, + 22, + 23, + 54, + 11, + 21, + 20, + 16, + 7, + 21, + 10, + 8 + ], + "weighted_loads": [ + 0.6351128835231066, + 0.6019122060388327, + 0.3512309156358242, + 0.6132428534328938, + 0.418447257950902, + 2.6319107338786125, + 0.6815754808485508, + 0.5823131464421749, + 0.8658502716571093, + 0.8033028207719326, + 4.941911049187183, + 1.193612940609455, + 0.4087639916688204, + 0.44194778986275196, + 5.348585670813918, + 5.48063500970602, + 1.8403139505535364, + 1.1392472796142101, + 1.062484048306942, + 0.3408092316240072, + 5.725666219368577, + 2.508227588608861, + 0.1840808242559433, + 0.3594096265733242, + 1.770570058375597, + 0.9952044952660799, + 2.257328325882554, + 0.6415042988955975, + 0.6253266781568527, + 0.06856427900493145, + 0.600161150097847, + 0.6838688421994448, + 0.39973622374236584, + 0.6518556084483862, + 1.0382773950695992, + 2.045743003487587, + 0.7187844514846802, + 0.9837099574506283, + 1.0137382335960865, + 0.1964122448116541, + 0.2056725099682808, + 2.7720439303666353, + 0.9014122989028692, + 1.0181771349161863, + 0.6316906698048115, + 0.6576565057039261, + 2.6105335503816605, + 1.0068630501627922, + 1.5960886105895042, + 0.5432223714888096, + 0.5406816154718399, + 0.3042450789362192, + 0.37156532518565655, + 1.5683276243507862, + 1.9595203269273043, + 3.834699472412467, + 0.5938409697264433, + 1.0038348566740751, + 1.084507741034031, + 1.189280616119504, + 0.32720232754945755, + 0.9086332842707634, + 0.503429725766182, + 0.3416951783001423 + ], + "unique_experts": 64, + "load_cv": 0.6833146074365215, + "normalized_load_entropy": 0.9506625540243131, + "max_load_share": 0.04712041884816754 + } + }, + "s1_bos": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "cb782c37bbc350f243a1edc2015f8a231185fa98d25dd59a7247772857be81f7", + "route_weight_sha256": "4ab4318d1b4aa7c7a1bd607cfc68ef150d89f615def03f289f32b2cc39235272", + "loads": [ + 13, + 10, + 7, + 6, + 10, + 28, + 13, + 7, + 15, + 7, + 48, + 25, + 8, + 10, + 50, + 38, + 20, + 18, + 11, + 8, + 35, + 39, + 1, + 7, + 23, + 14, + 25, + 9, + 10, + 2, + 10, + 17, + 6, + 11, + 20, + 16, + 13, + 14, + 18, + 6, + 4, + 22, + 18, + 12, + 11, + 7, + 28, + 15, + 15, + 15, + 9, + 5, + 7, + 11, + 21, + 45, + 10, + 19, + 19, + 18, + 3, + 21, + 12, + 1 + ], + "weighted_loads": [ + 0.6797129493206739, + 0.5718965753912926, + 0.3273336850106716, + 0.5246700458228588, + 0.4192617852240801, + 1.8159850500524044, + 0.6239647716283798, + 0.5765830315649509, + 0.8763763681054115, + 0.3503773882985115, + 4.532473431900144, + 1.122494462877512, + 0.32100024074316025, + 0.3827210273593664, + 5.292477920651436, + 5.074840534478426, + 0.8831988554447889, + 0.8944201283156872, + 0.4515892472118139, + 0.3053804188966751, + 4.680360712110996, + 2.3634445313364267, + 0.04772390425205231, + 0.318672988563776, + 1.251723200082779, + 0.9909183010458946, + 1.8691221848130226, + 0.6508318707346916, + 0.6010507456958294, + 0.059270212426781654, + 0.49707453325390816, + 0.6582899633795023, + 0.410616684705019, + 0.39268979988992214, + 0.9681026097387075, + 2.0585875809192657, + 0.6201668325811625, + 0.6014856938272715, + 1.0019890014082193, + 0.24237214215099812, + 0.15881582722067833, + 1.5960601959377527, + 0.8140801377594471, + 0.888305339962244, + 0.4682950899004936, + 0.5270234905183315, + 2.640771433711052, + 0.9822576753795147, + 1.5179050993174314, + 0.5378826968371868, + 0.4656848572194576, + 0.2233178596943617, + 0.34321366995573044, + 0.7989951595664024, + 1.85649692453444, + 3.0708699952811003, + 0.543989134952426, + 0.9645976275205612, + 1.056657250970602, + 1.214050181210041, + 0.11703968420624733, + 0.8937258664518595, + 0.5609911438077688, + 0.03221159800887108 + ], + "unique_experts": 64, + "load_cv": 0.6962400778207003, + "normalized_load_entropy": 0.9476006866493357, + "max_load_share": 0.050200803212851405 + }, + "full_input": { + "tokens": 207, + "top_k": 6, + "decisions": 1242, + "ordered_route_sha256": "c2c42cb10e091168293487c02184871e9a5cd2561f8c6427c5ea425f8d697b3a", + "route_weight_sha256": "c8078c7938032140e081ae55f6a0bdf38603746a9863521c4d9a85c061491b1d", + "loads": [ + 13, + 13, + 7, + 8, + 10, + 37, + 18, + 8, + 15, + 11, + 54, + 26, + 8, + 13, + 51, + 48, + 29, + 26, + 20, + 8, + 46, + 41, + 4, + 8, + 34, + 14, + 38, + 9, + 10, + 2, + 13, + 17, + 11, + 20, + 22, + 18, + 13, + 24, + 20, + 9, + 7, + 38, + 21, + 16, + 17, + 12, + 29, + 21, + 18, + 19, + 15, + 6, + 7, + 23, + 21, + 56, + 12, + 19, + 19, + 19, + 8, + 21, + 15, + 7 + ], + "weighted_loads": [ + 0.6797129493206739, + 0.6921857260167599, + 0.3273336850106716, + 0.6139668598771095, + 0.4192617852240801, + 2.693979375064373, + 0.8765573240816593, + 0.6016113832592964, + 0.8763763681054115, + 0.8455859459936619, + 4.8100688979029655, + 1.1539760008454323, + 0.32100024074316025, + 0.4741355925798416, + 5.345841158181429, + 6.111847430467606, + 1.7558950018137693, + 1.5455603078007698, + 1.341480953618884, + 0.3053804188966751, + 5.617078363895416, + 2.454474998638034, + 0.16351061314344406, + 0.39411046728491783, + 2.237425319850445, + 0.9909183010458946, + 3.24779131449759, + 0.6508318707346916, + 0.6010507456958294, + 0.059270212426781654, + 0.6373212821781635, + 0.6582899633795023, + 0.6322024874389172, + 0.7644956819713116, + 1.044755069538951, + 2.1764566488564014, + 0.6201668325811625, + 1.1247093230485916, + 1.1240455862134695, + 0.41934954188764095, + 0.2689041644334793, + 3.621165418997407, + 0.9379200711846352, + 1.0937119014561176, + 0.6952833831310272, + 0.7639878541231155, + 2.6708626449108124, + 1.2761432453989983, + 1.6443373449146748, + 0.7134688198566437, + 0.7347615920007229, + 0.2633530143648386, + 0.34321366995573044, + 1.8695622216910124, + 1.85649692453444, + 4.0122060384601355, + 0.6522159110754728, + 0.9645976275205612, + 1.056657250970602, + 1.4118187800049782, + 0.3667437322437763, + 0.8937258664518595, + 0.8931579347699881, + 0.3376221992075443 + ], + "unique_experts": 64, + "load_cv": 0.6487894527896145, + "normalized_load_entropy": 0.9545275216334789, + "max_load_share": 0.04508856682769726 + } + }, + "s0_x": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "c344dcaac309a8ebae79eb716773cc0a0d4fb0d55607f6f233e9398c06fc4824", + "route_weight_sha256": "4fb43a47633d4e598e60d91fc252ec56a0f1e4dfc618ce8dde19a217d88ae982", + "loads": [ + 12, + 11, + 7, + 8, + 9, + 27, + 11, + 7, + 14, + 7, + 53, + 23, + 8, + 11, + 53, + 37, + 20, + 19, + 13, + 6, + 37, + 40, + 1, + 8, + 25, + 13, + 26, + 8, + 11, + 3, + 11, + 17, + 6, + 9, + 16, + 15, + 14, + 14, + 18, + 9, + 5, + 24, + 19, + 11, + 9, + 7, + 26, + 14, + 15, + 13, + 10, + 5, + 5, + 10, + 23, + 46, + 12, + 18, + 19, + 16, + 4, + 17, + 9, + 2 + ], + "weighted_loads": [ + 0.6315930709242821, + 0.5876035541296005, + 0.3077035117894411, + 0.6227671131491661, + 0.38061811961233616, + 1.7260925266891718, + 0.5269812308251858, + 0.577743336558342, + 0.8734947629272938, + 0.32158923521637917, + 4.851629227399826, + 1.0353637244552374, + 0.3284580949693918, + 0.4252985455095768, + 5.319684844464064, + 5.038177110254765, + 0.8869917280972004, + 0.9294425081461668, + 0.5480719283223152, + 0.23927311785519123, + 4.887598279863596, + 2.4705248065292835, + 0.0529150664806366, + 0.3555086478590965, + 1.384623322635889, + 0.972643481567502, + 1.9387647211551666, + 0.5572712831199169, + 0.645850894972682, + 0.09324284456670284, + 0.5105411112308502, + 0.6543926652520895, + 0.382557837292552, + 0.3201901912689209, + 0.7673242427408695, + 2.014114197343588, + 0.6979481354355812, + 0.6035860422998667, + 1.0017798878252506, + 0.35727306827902794, + 0.1940323319286108, + 1.7713375147432089, + 0.8506761379539967, + 0.9138884972780943, + 0.38658738508820534, + 0.5511727035045624, + 2.614161789417267, + 0.9748188555240631, + 1.590266402810812, + 0.47264844737946987, + 0.5690044686198235, + 0.21394838951528072, + 0.26821989193558693, + 0.7765828147530556, + 1.9131617657840252, + 3.1557395104318857, + 0.6308374907821417, + 0.8924224693328142, + 1.0603724978864193, + 1.1380172409117222, + 0.1441287100315094, + 0.7415767703205347, + 0.47301134653389454, + 0.0691954605281353 + ], + "unique_experts": 64, + "load_cv": 0.7238614644745873, + "normalized_load_entropy": 0.9461955105073945, + "max_load_share": 0.05321285140562249 + }, + "full_input": { + "tokens": 191, + "top_k": 6, + "decisions": 1146, + "ordered_route_sha256": "4c5942bb35344a3263eb1048369020ef0764c1818259f89662005d25ce96b7c5", + "route_weight_sha256": "6e22f1e8537d5f628edcb48f633a11778067a33f7ef4e528548a0e225d384604", + "loads": [ + 12, + 11, + 7, + 8, + 9, + 37, + 14, + 7, + 14, + 8, + 58, + 23, + 8, + 12, + 53, + 43, + 27, + 22, + 19, + 7, + 51, + 43, + 3, + 8, + 32, + 13, + 33, + 8, + 11, + 3, + 13, + 17, + 8, + 12, + 16, + 15, + 14, + 23, + 18, + 9, + 6, + 34, + 22, + 13, + 12, + 8, + 26, + 15, + 15, + 14, + 11, + 7, + 5, + 22, + 23, + 57, + 12, + 18, + 19, + 16, + 8, + 17, + 9, + 8 + ], + "weighted_loads": [ + 0.6315930709242821, + 0.5876035541296005, + 0.3077035117894411, + 0.6227671131491661, + 0.38061811961233616, + 2.5707589648663998, + 0.6589444652199745, + 0.577743336558342, + 0.8734947629272938, + 0.6997362412512302, + 5.147813173010945, + 1.0353637244552374, + 0.3284580949693918, + 0.44438887387514114, + 5.319684844464064, + 5.61144395172596, + 1.2388690449297428, + 1.1679801549762487, + 1.216062817722559, + 0.27905198745429516, + 6.1488106194883585, + 2.584148159250617, + 0.18840080499649048, + 0.3555086478590965, + 2.0440211184322834, + 0.972643481567502, + 2.381652193143964, + 0.5572712831199169, + 0.645850894972682, + 0.09324284456670284, + 0.6313674412667751, + 0.6543926652520895, + 0.49762468226253986, + 0.49413678608834743, + 0.7673242427408695, + 2.014114197343588, + 0.6979481354355812, + 1.089353846386075, + 1.0017798878252506, + 0.35727306827902794, + 0.23807879351079464, + 2.876623524352908, + 0.958752041682601, + 1.0350444596260786, + 0.5314898900687695, + 0.623374305665493, + 2.614161789417267, + 1.0258510932326317, + 1.590266402810812, + 0.4898850601166487, + 0.6030039973556995, + 0.3097346220165491, + 0.26821989193558693, + 1.682282229885459, + 1.9131617657840252, + 4.062392266467214, + 0.6308374907821417, + 0.8924224693328142, + 1.0603724978864193, + 1.1380172409117222, + 0.3944205716252327, + 0.7415767703205347, + 0.47301134653389454, + 0.37432557344436646 + ], + "unique_experts": 64, + "load_cv": 0.7283301923437544, + "normalized_load_entropy": 0.9463593563536662, + "max_load_share": 0.0506108202443281 + } + }, + "s1_x": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "4cebe3805a8711501adfef1ba02719e521833bf1b5c0d875e8e9c1b711e47a07", + "route_weight_sha256": "3c461e7ccb6e7859294992571b39f6b434c1f1b31ce55fbfe064ee983ccb097a", + "loads": [ + 12, + 10, + 6, + 8, + 7, + 27, + 13, + 7, + 14, + 5, + 55, + 21, + 9, + 7, + 53, + 39, + 21, + 20, + 12, + 5, + 37, + 40, + 3, + 8, + 24, + 14, + 25, + 7, + 10, + 4, + 10, + 17, + 8, + 9, + 22, + 16, + 13, + 12, + 18, + 6, + 4, + 21, + 20, + 13, + 8, + 9, + 28, + 15, + 14, + 13, + 10, + 6, + 6, + 10, + 21, + 45, + 11, + 17, + 17, + 17, + 5, + 17, + 10, + 5 + ], + "weighted_loads": [ + 0.6306080780923367, + 0.5901407338678837, + 0.2757039051502943, + 0.6204170677810907, + 0.3429769892245531, + 1.7577449642121792, + 0.6234735660254955, + 0.5757773630321026, + 0.8536954857409, + 0.20936353132128716, + 5.143541999161243, + 0.9861787278205156, + 0.37315564416348934, + 0.2859742306172848, + 5.3568426463752985, + 5.246528817340732, + 0.8849164415150881, + 0.9599709436297417, + 0.5037964545190334, + 0.1930951215326786, + 4.860920794308186, + 2.405657486990094, + 0.112989267334342, + 0.34744464978575706, + 1.4002214260399342, + 0.9769980143755674, + 1.8579742219299078, + 0.5592188760638237, + 0.6063387431204319, + 0.1353979855775833, + 0.46564136631786823, + 0.6320175491273403, + 0.46535820327699184, + 0.3350322339683771, + 1.058406988158822, + 2.0379250943660736, + 0.6430520042777061, + 0.5341178216040134, + 1.018796294927597, + 0.22875179536640644, + 0.15861690044403076, + 1.5635850876569748, + 0.8949770499020815, + 0.8895063400268555, + 0.3359514996409416, + 0.5621354375034571, + 2.7574336417019367, + 0.9382464960217476, + 1.517512857913971, + 0.48357680439949036, + 0.5511134564876556, + 0.2651099469512701, + 0.2888135351240635, + 0.7687123343348503, + 1.8517337199300528, + 3.11334627866745, + 0.6076925955712795, + 0.8802177961915731, + 0.9876188430935144, + 1.1984076872467995, + 0.16831415332853794, + 0.768355168402195, + 0.514604814350605, + 0.1365799903869629 + ], + "unique_experts": 64, + "load_cv": 0.7298968911995126, + "normalized_load_entropy": 0.9466818984971769, + "max_load_share": 0.055220883534136546 + }, + "full_input": { + "tokens": 207, + "top_k": 6, + "decisions": 1242, + "ordered_route_sha256": "2699682ce7ed0cfde6fe726cfd9ec80328531d834f60e61ffd322b1110bd6270", + "route_weight_sha256": "459395af5c0ddb0fbcac64e443d7bfa1a7e34724d62f69c32d15d29d67662932", + "loads": [ + 12, + 13, + 6, + 10, + 7, + 37, + 18, + 8, + 14, + 7, + 62, + 22, + 9, + 10, + 54, + 49, + 27, + 29, + 21, + 5, + 51, + 43, + 7, + 9, + 38, + 14, + 38, + 7, + 10, + 4, + 14, + 17, + 14, + 13, + 23, + 18, + 13, + 21, + 20, + 9, + 7, + 36, + 24, + 17, + 11, + 14, + 29, + 21, + 19, + 17, + 16, + 7, + 6, + 23, + 21, + 57, + 13, + 18, + 17, + 18, + 8, + 17, + 13, + 10 + ], + "weighted_loads": [ + 0.6306080780923367, + 0.710429884493351, + 0.2757039051502943, + 0.7097138818353415, + 0.3429769892245531, + 2.646564794704318, + 0.8806517831981182, + 0.6008057147264481, + 0.8536954857409, + 0.622653104364872, + 5.464314471930265, + 1.017660265788436, + 0.37315564416348934, + 0.37738879583775997, + 5.410205883905292, + 6.3284603189677, + 1.109551666304469, + 1.639665313065052, + 1.3732913322746754, + 0.1930951215326786, + 6.165757805109024, + 2.5350436065346003, + 0.26145421154797077, + 0.4228821285068989, + 2.6155321449041367, + 0.9769980143755674, + 3.2254481725394726, + 0.5592188760638237, + 0.6063387431204319, + 0.1353979855775833, + 0.6341608706861734, + 0.6320175491273403, + 0.7515318524092436, + 0.5035816002637148, + 1.0934530328959227, + 2.1557941623032093, + 0.6430520042777061, + 1.0169450286775827, + 1.1408528797328472, + 0.4057291951030493, + 0.26870523765683174, + 3.499949425458908, + 1.0300777703523636, + 1.0945864282548428, + 0.4512994531542063, + 0.7990998011082411, + 2.787524852901697, + 1.2321320660412312, + 1.7042952608317137, + 0.6591629274189472, + 0.802347905933857, + 0.305145101621747, + 0.2888135351240635, + 1.9340193774551153, + 1.8517337199300528, + 4.186568684875965, + 0.7159193716943264, + 0.9470335450023413, + 0.9876188430935144, + 1.3961762860417366, + 0.31280129216611385, + 0.768355168402195, + 0.8467716053128242, + 0.38657814264297485 + ], + "unique_experts": 64, + "load_cv": 0.6946207389005669, + "normalized_load_entropy": 0.9501763230469742, + "max_load_share": 0.0499194847020934 + } + }, + "s0_period": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "442cd9312ef34d8d5a0501a23033ed8f13423f4839975e605aaf80e8883d517f", + "route_weight_sha256": "ef29c799f7598a59aeaa69f36a4202e8f2a03d7a3fa9cf1929627010acd74ecb", + "loads": [ + 12, + 11, + 5, + 9, + 9, + 27, + 12, + 7, + 14, + 7, + 49, + 21, + 10, + 12, + 54, + 37, + 20, + 22, + 12, + 7, + 35, + 40, + 1, + 8, + 24, + 13, + 25, + 8, + 11, + 3, + 12, + 16, + 4, + 8, + 17, + 16, + 14, + 13, + 18, + 8, + 4, + 24, + 18, + 12, + 9, + 8, + 27, + 14, + 16, + 13, + 10, + 5, + 7, + 10, + 23, + 46, + 12, + 19, + 19, + 15, + 3, + 19, + 9, + 3 + ], + "weighted_loads": [ + 0.6276254262775183, + 0.5899854265153408, + 0.2236963640898466, + 0.6519039683043957, + 0.3870012015104294, + 1.7186697497963905, + 0.576631298288703, + 0.5831946022808552, + 0.8747241087257862, + 0.2921774908900261, + 4.728459592908621, + 0.9553283862769604, + 0.3996213246136904, + 0.4682277590036392, + 5.407380172982812, + 5.07185286283493, + 0.8653070572763681, + 1.0323856882750988, + 0.5094083100557327, + 0.2663700710982084, + 4.796256069093943, + 2.4797934014350176, + 0.053070493042469025, + 0.3569926917552948, + 1.3454324901103973, + 0.9522442650049925, + 1.8640925250947475, + 0.5263176411390305, + 0.6487089935690165, + 0.09117431566119194, + 0.5313652493059635, + 0.6143110748380423, + 0.3374728113412857, + 0.29362062364816666, + 0.7955270167440176, + 2.039478024467826, + 0.7031015120446682, + 0.5764290597289801, + 1.0006052013486624, + 0.3245481364428997, + 0.16200057417154312, + 1.8199245762079954, + 0.8138419259339571, + 0.9789333511143923, + 0.3919953852891922, + 0.587378416210413, + 2.596937123686075, + 0.9790115710347891, + 1.6266323011368513, + 0.4784933030605316, + 0.5614185035228729, + 0.21539460308849812, + 0.3314043767750263, + 0.7775221951305866, + 1.9130642246454954, + 3.1645342353731394, + 0.6267526298761368, + 0.9464608430862427, + 1.0666860304772854, + 1.117144837975502, + 0.10724323615431786, + 0.8093121945858002, + 0.4837131295353174, + 0.10450529679656029 + ], + "unique_experts": 64, + "load_cv": 0.7104575450991653, + "normalized_load_entropy": 0.947389819873661, + "max_load_share": 0.05421686746987952 + }, + "full_input": { + "tokens": 191, + "top_k": 6, + "decisions": 1146, + "ordered_route_sha256": "98ea5fbd5f46a20af3e2177386a1121e1dc55ca6353864d82af505651e1435eb", + "route_weight_sha256": "9718741610411799b58587d050d749e5c5a4114556e76b59c9bfce6dd3f7e753", + "loads": [ + 12, + 11, + 5, + 9, + 9, + 38, + 16, + 7, + 14, + 9, + 55, + 21, + 10, + 14, + 54, + 44, + 26, + 25, + 18, + 8, + 49, + 42, + 4, + 8, + 31, + 13, + 32, + 8, + 11, + 3, + 14, + 16, + 5, + 12, + 17, + 16, + 14, + 21, + 18, + 8, + 5, + 33, + 20, + 14, + 13, + 9, + 27, + 16, + 16, + 14, + 10, + 7, + 7, + 21, + 23, + 57, + 12, + 19, + 19, + 15, + 6, + 19, + 9, + 8 + ], + "weighted_loads": [ + 0.6276254262775183, + 0.5899854265153408, + 0.2236963640898466, + 0.6519039683043957, + 0.3870012015104294, + 2.6154527235776186, + 0.7508833836764097, + 0.5831946022808552, + 0.8747241087257862, + 0.696526788175106, + 5.076005155220628, + 0.9553283862769604, + 0.3996213246136904, + 0.529977198690176, + 5.407380172982812, + 5.67412868142128, + 1.2463279720395803, + 1.3806872107088566, + 1.1158928759396076, + 0.30614894069731236, + 5.877165583893657, + 2.5573726817965508, + 0.23222607001662254, + 0.3569926917552948, + 2.0400111712515354, + 0.9522442650049925, + 2.357990464195609, + 0.5263176411390305, + 0.6487089935690165, + 0.09117431566119194, + 0.6643762029707432, + 0.6143110748380423, + 0.37733667716383934, + 0.505077937617898, + 0.7955270167440176, + 2.039478024467826, + 0.7031015120446682, + 1.027057332918048, + 1.0006052013486624, + 0.3245481364428997, + 0.20604703575372696, + 2.9043626356869936, + 0.8912842776626348, + 1.1053975094109774, + 0.5737844333052635, + 0.6595800183713436, + 2.596937123686075, + 1.0580902677029371, + 1.6266323011368513, + 0.4957299157977104, + 0.5614185035228729, + 0.3111808355897665, + 0.3314043767750263, + 1.5528740901499987, + 1.9130642246454954, + 4.027465613558888, + 0.6267526298761368, + 0.9464608430862427, + 1.0666860304772854, + 1.117144837975502, + 0.30451374873518944, + 0.8093121945858002, + 0.4837131295353174, + 0.3628810867667198 + ], + "unique_experts": 64, + "load_cv": 0.7150277027326499, + "normalized_load_entropy": 0.9477971617380677, + "max_load_share": 0.049738219895287955 + } + }, + "s1_period": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "7656eb032a5e5c219d76bda699eb1b2665ddcd1fd74ba04d69ed3747925a7628", + "route_weight_sha256": "61ec922d19f174afb1a8de8bfbb8a5fd01f0d1b0ba2071026838a9ccfa1a3bfc", + "loads": [ + 12, + 10, + 5, + 6, + 6, + 27, + 14, + 7, + 14, + 7, + 53, + 24, + 8, + 8, + 53, + 41, + 18, + 21, + 12, + 6, + 36, + 40, + 3, + 8, + 25, + 15, + 24, + 9, + 10, + 3, + 10, + 16, + 7, + 9, + 20, + 16, + 13, + 12, + 18, + 6, + 4, + 22, + 20, + 13, + 8, + 9, + 28, + 14, + 15, + 13, + 10, + 6, + 7, + 9, + 21, + 46, + 11, + 18, + 17, + 16, + 3, + 21, + 10, + 3 + ], + "weighted_loads": [ + 0.624121131375432, + 0.5849681496620178, + 0.23834345117211342, + 0.5503818765282631, + 0.3097209855914116, + 1.7537201698869467, + 0.66332021728158, + 0.5741331949830055, + 0.8449577111750841, + 0.3048955723643303, + 5.041380234062672, + 1.0662427749484777, + 0.33696222119033337, + 0.3163479119539261, + 5.407003099098802, + 5.274845130741596, + 0.7785380743443966, + 0.9905796274542809, + 0.4847474116832018, + 0.23481919802725315, + 4.776162225753069, + 2.427724240347743, + 0.097123883664608, + 0.35169827565550804, + 1.4064900539815426, + 1.0180052686482668, + 1.8858720920979977, + 0.6501388400793076, + 0.6019900292158127, + 0.09511210583150387, + 0.4797229450196028, + 0.6023788973689079, + 0.4223509281873703, + 0.32863258570432663, + 0.9507419243454933, + 2.033423561602831, + 0.6309347823262215, + 0.5304877869784832, + 1.0132637526839972, + 0.23202340118587017, + 0.15918359905481339, + 1.6639236435294151, + 0.9173600561916828, + 0.8665509726852179, + 0.3363514505326748, + 0.56370959430933, + 2.703239791095257, + 0.9008495286107063, + 1.5483406092971563, + 0.4808921907097101, + 0.540579941123724, + 0.24518146365880966, + 0.3192419409751892, + 0.7354965172708035, + 1.8974137343466282, + 3.148211060091853, + 0.592220276594162, + 0.9156070407480001, + 0.9848878905177116, + 1.156327174976468, + 0.11293292418122292, + 0.8923205733299255, + 0.5222015287727118, + 0.07876313850283623 + ], + "unique_experts": 64, + "load_cv": 0.7347422211320157, + "normalized_load_entropy": 0.9449791884227279, + "max_load_share": 0.05321285140562249 + }, + "full_input": { + "tokens": 207, + "top_k": 6, + "decisions": 1242, + "ordered_route_sha256": "6a5595d139e6ce86bb97ee88dd27817646da7e59ba0cee61e26137de1a80d10d", + "route_weight_sha256": "190a62495af0cf6ceccd053f1914d68f08643ec9bcfd71e0ccd6720c4bca9bef", + "loads": [ + 12, + 13, + 5, + 8, + 6, + 37, + 19, + 8, + 14, + 9, + 59, + 25, + 8, + 11, + 54, + 51, + 24, + 31, + 21, + 6, + 48, + 42, + 6, + 9, + 40, + 15, + 37, + 9, + 10, + 3, + 14, + 16, + 13, + 13, + 21, + 18, + 13, + 21, + 21, + 9, + 7, + 38, + 24, + 17, + 11, + 14, + 29, + 20, + 19, + 17, + 16, + 7, + 7, + 22, + 22, + 58, + 13, + 18, + 17, + 18, + 7, + 21, + 13, + 8 + ], + "weighted_loads": [ + 0.624121131375432, + 0.7052573002874851, + 0.23834345117211342, + 0.6396786905825138, + 0.3097209855914116, + 2.661643425002694, + 0.9182802699506283, + 0.599161546677351, + 0.8449577111750841, + 0.7181851454079151, + 5.334842590615153, + 1.097724312916398, + 0.33696222119033337, + 0.4077624771744013, + 5.460366336628795, + 6.258922182023525, + 0.989476352930069, + 1.7544409073889256, + 1.3753697331994772, + 0.23481919802725315, + 5.767472330480814, + 2.51875470764935, + 0.21291059255599976, + 0.42713575437664986, + 2.692594200372696, + 1.0180052686482668, + 3.2717968244105577, + 0.6501388400793076, + 0.6019900292158127, + 0.09511210583150387, + 0.6878403257578611, + 0.6023788973689079, + 0.6815519332885742, + 0.4971819519996643, + 0.9857879690825939, + 2.1512926295399666, + 0.6309347823262215, + 1.0133149940520525, + 1.1861492078751326, + 0.409000800922513, + 0.26927193626761436, + 3.6060891561210155, + 1.0505569614470005, + 1.0829265248030424, + 0.45714852027595043, + 0.800673957914114, + 2.7333310022950172, + 1.19473509863019, + 1.7133134305477142, + 0.656478313729167, + 0.7916973810642958, + 0.2852166183292866, + 0.3192419409751892, + 1.862902658060193, + 1.9350074492394924, + 4.136706447228789, + 0.7004470527172089, + 0.9156070407480001, + 0.9848878905177116, + 1.3845183551311493, + 0.3208360932767391, + 0.8923205733299255, + 0.854368319734931, + 0.3303033523261547 + ], + "unique_experts": 64, + "load_cv": 0.6927067572828222, + "normalized_load_entropy": 0.949803209662445, + "max_load_share": 0.04750402576489533 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 166, + "ordered_topk_exact_tokens": 91, + "set_exact_tokens": 121, + "mean_set_jaccard": 0.9176706827309238, + "mean_token_weighted_tv": 0.018328988245766925, + "aggregate_load_tv": 0.027108433734939753 + }, + "system_bos": { + "tokens": 166, + "ordered_topk_exact_tokens": 90, + "set_exact_tokens": 116, + "mean_set_jaccard": 0.9087779690189327, + "mean_token_weighted_tv": 0.020465863116803658, + "aggregate_load_tv": 0.031124497991967863 + }, + "system_x": { + "tokens": 166, + "ordered_topk_exact_tokens": 82, + "set_exact_tokens": 106, + "mean_set_jaccard": 0.8831038439472173, + "mean_token_weighted_tv": 0.027699705981929976, + "aggregate_load_tv": 0.038152610441767064 + }, + "system_period": { + "tokens": 166, + "ordered_topk_exact_tokens": 86, + "set_exact_tokens": 103, + "mean_set_jaccard": 0.8851118760757316, + "mean_token_weighted_tv": 0.02587566432172814, + "aggregate_load_tv": 0.037148594377510044 + }, + "bos_at_s0": { + "tokens": 166, + "ordered_topk_exact_tokens": 80, + "set_exact_tokens": 103, + "mean_set_jaccard": 0.8851118760757316, + "mean_token_weighted_tv": 0.0255680016455162, + "aggregate_load_tv": 0.03313253012048192 + }, + "bos_at_s1": { + "tokens": 166, + "ordered_topk_exact_tokens": 75, + "set_exact_tokens": 98, + "mean_set_jaccard": 0.8739242685025819, + "mean_token_weighted_tv": 0.02737435194136328, + "aggregate_load_tv": 0.034136546184738964 + }, + "x_at_s0": { + "tokens": 166, + "ordered_topk_exact_tokens": 84, + "set_exact_tokens": 110, + "mean_set_jaccard": 0.8904761904761905, + "mean_token_weighted_tv": 0.026360001145716173, + "aggregate_load_tv": 0.03815261044176707 + }, + "x_at_s1": { + "tokens": 166, + "ordered_topk_exact_tokens": 69, + "set_exact_tokens": 89, + "mean_set_jaccard": 0.8499713138267355, + "mean_token_weighted_tv": 0.03362766010350132, + "aggregate_load_tv": 0.049196787148594386 + }, + "period_at_s0": { + "tokens": 166, + "ordered_topk_exact_tokens": 81, + "set_exact_tokens": 106, + "mean_set_jaccard": 0.8838783706253587, + "mean_token_weighted_tv": 0.027403340613222624, + "aggregate_load_tv": 0.03614457831325301 + }, + "period_at_s1": { + "tokens": 166, + "ordered_topk_exact_tokens": 67, + "set_exact_tokens": 90, + "mean_set_jaccard": 0.8552782558806655, + "mean_token_weighted_tv": 0.03283183002305857, + "aggregate_load_tv": 0.044176706827309245 + } + } + }, + "layer_17": { + "layer": 17, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "ca6fbf344be7a9d91fdbeda089c2a3a8c7db555110fa17497db4c0caeff0bf99", + "route_weight_sha256": "80d6ca195c7328fdbc1eb003d3a877e3a6c0dac82f8e908a6d380e77f7a6be20", + "loads": [ + 7, + 8, + 16, + 38, + 14, + 24, + 24, + 12, + 6, + 8, + 9, + 5, + 2, + 26, + 9, + 18, + 24, + 46, + 32, + 11, + 17, + 17, + 4, + 8, + 11, + 46, + 15, + 16, + 21, + 6, + 14, + 9, + 25, + 10, + 13, + 15, + 14, + 13, + 23, + 9, + 24, + 9, + 17, + 14, + 19, + 16, + 20, + 9, + 11, + 21, + 0, + 24, + 9, + 10, + 13, + 21, + 8, + 24, + 9, + 21, + 6, + 15, + 22, + 9 + ], + "weighted_loads": [ + 0.2063883114606142, + 0.30214626528322697, + 0.5631971694529057, + 3.468717777170241, + 1.1841907072812319, + 1.3261462040245533, + 1.1430391278117895, + 0.6895312815904617, + 0.44843459501862526, + 0.2931738384068012, + 0.6280804984271526, + 0.21807602979242802, + 0.06190274003893137, + 1.9521255791187286, + 0.49309464916586876, + 0.9376521296799183, + 1.6600656444206834, + 4.730346081778407, + 9.453107761219144, + 0.6395918717607856, + 1.132982375100255, + 0.5160653125494719, + 0.21390129998326302, + 0.28631823882460594, + 0.42536116763949394, + 3.4490656182169914, + 0.7650915626436472, + 0.8185440618544817, + 1.2002969644963741, + 0.2021863665431738, + 1.5547733306884766, + 0.3554066475480795, + 3.8549823313951492, + 0.6489227861166, + 0.7576372176408768, + 1.7177141830325127, + 1.18580705486238, + 0.6105487365275621, + 1.6943751759827137, + 0.5781371761113405, + 1.7314956821501255, + 0.34657837077975273, + 1.623157032765448, + 0.6096517611294985, + 1.4784352723509073, + 0.8422851096838713, + 1.352831257507205, + 0.5259591303765774, + 1.127527561970055, + 0.9471272090449929, + 0.0, + 1.3747435454279184, + 0.45705514773726463, + 0.3514457941055298, + 0.8703026417642832, + 2.418730417266488, + 0.5250934548676014, + 1.4353016698732972, + 0.5136758834123611, + 0.8698989944532514, + 0.25799898244440556, + 1.2509260475635529, + 0.9117815485224128, + 0.6955127120018005 + ], + "unique_experts": 63, + "load_cv": 0.585505808116266, + "normalized_load_entropy": 0.9609680699181695, + "max_load_share": 0.04618473895582329 + }, + "full_input": { + "tokens": 191, + "top_k": 6, + "decisions": 1146, + "ordered_route_sha256": "cbd7f098711516685d588c77731d0bb618e9be6b22c595c2f4ee083299b01dea", + "route_weight_sha256": "b40d8441f124b804767a1db6ea68c32f342d689c8ffcd9ea29a4fa70bac8a505", + "loads": [ + 15, + 10, + 18, + 45, + 14, + 24, + 26, + 12, + 6, + 11, + 15, + 6, + 6, + 34, + 9, + 20, + 24, + 53, + 35, + 11, + 20, + 17, + 4, + 17, + 17, + 52, + 26, + 20, + 24, + 7, + 14, + 9, + 32, + 10, + 13, + 15, + 14, + 14, + 27, + 9, + 32, + 16, + 18, + 16, + 19, + 20, + 20, + 9, + 11, + 22, + 1, + 24, + 11, + 10, + 13, + 24, + 9, + 26, + 10, + 21, + 6, + 16, + 28, + 9 + ], + "weighted_loads": [ + 0.47506514750421047, + 0.38129877485334873, + 0.6641009077429771, + 4.048568748869002, + 1.1841907072812319, + 1.3261462040245533, + 1.241634538397193, + 0.6895312815904617, + 0.44843459501862526, + 0.4012257382273674, + 1.0053456462919712, + 0.23655436001718044, + 0.19184101652354002, + 2.545944720506668, + 0.49309464916586876, + 1.0310666412115097, + 1.6600656444206834, + 5.407481065019965, + 9.580290982499719, + 0.6395918717607856, + 1.4213949013501406, + 0.5160653125494719, + 0.21390129998326302, + 0.665658013895154, + 0.8981536068022251, + 3.746789075434208, + 2.5682078655809164, + 0.9965024758130312, + 1.322557806968689, + 0.2074911412782967, + 1.5547733306884766, + 0.3554066475480795, + 4.124458179809153, + 0.6489227861166, + 0.7576372176408768, + 1.7177141830325127, + 1.18580705486238, + 0.6386280376464128, + 1.86415658518672, + 0.5781371761113405, + 2.7096885181963444, + 0.5495977951213717, + 1.7335017705336213, + 0.6316618449054658, + 1.4784352723509073, + 1.687569348141551, + 1.352831257507205, + 0.5259591303765774, + 1.127527561970055, + 0.9873200850561261, + 0.0684502050280571, + 1.3747435454279184, + 0.6188897378742695, + 0.3514457941055298, + 0.8703026417642832, + 2.6140459571033716, + 0.5594181418418884, + 1.5550691178068519, + 0.5500749498605728, + 0.8698989944532514, + 0.25799898244440556, + 1.3357700183987617, + 1.3491501091048121, + 0.6955127120018005 + ], + "unique_experts": 64, + "load_cv": 0.5822775234605894, + "normalized_load_entropy": 0.9625667539181127, + "max_load_share": 0.0462478184991274 + } + }, + "s1_eos": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "b2a0952cb76e89f6f04fcdbeb622c6325f9c2b8015f6eabcdfd5944f19b3a280", + "route_weight_sha256": "35dc8209f9e23012a162955b83aaac3e7356a8a2c73e1ae2afd3bace5c2ee751", + "loads": [ + 5, + 8, + 14, + 37, + 14, + 24, + 23, + 12, + 6, + 9, + 7, + 4, + 4, + 26, + 11, + 16, + 25, + 46, + 32, + 11, + 17, + 16, + 4, + 10, + 12, + 47, + 12, + 17, + 24, + 8, + 14, + 8, + 25, + 11, + 13, + 16, + 16, + 10, + 21, + 9, + 23, + 7, + 18, + 12, + 19, + 18, + 20, + 9, + 10, + 21, + 0, + 24, + 9, + 13, + 13, + 20, + 8, + 26, + 10, + 21, + 5, + 14, + 22, + 10 + ], + "weighted_loads": [ + 0.15017974562942982, + 0.3204702287912369, + 0.4903428014367819, + 3.4386548828333616, + 1.14630045928061, + 1.2952364720404148, + 1.0800591800361872, + 0.6746517643332481, + 0.45408667996525764, + 0.31525699608027935, + 0.5478483326733112, + 0.18662730604410172, + 0.11174022872000933, + 1.9651602134108543, + 0.6078111305832863, + 0.8524375334382057, + 1.6820434983819723, + 4.7133303582668304, + 9.487757926806808, + 0.6118901604786515, + 1.066736115142703, + 0.4745448036119342, + 0.21545489504933357, + 0.3679774273186922, + 0.4589915219694376, + 3.3418049216270447, + 0.6356008537113667, + 0.8481279388070107, + 1.3360924143344164, + 0.2785987351089716, + 1.573710698634386, + 0.32526344805955887, + 3.7872255071997643, + 0.6637494415044785, + 0.7618076242506504, + 1.7667882405221462, + 1.2608634680509567, + 0.4963751006871462, + 1.6309691946953535, + 0.5957063939422369, + 1.6380680203437805, + 0.2982453443109989, + 1.6117522036656737, + 0.5529173277318478, + 1.4924871418625116, + 0.8909827433526516, + 1.373684473335743, + 0.5294477082788944, + 1.0605193451046944, + 0.9425044739618897, + 0.0, + 1.308705760166049, + 0.4636608324944973, + 0.4399141361936927, + 0.867627777159214, + 2.3291565719991922, + 0.5204759500920773, + 1.4947594245895743, + 0.5576108023524284, + 0.8884883709251881, + 0.21024239808321, + 1.2294490486383438, + 0.8767408318817616, + 0.738375511020422 + ], + "unique_experts": 63, + "load_cv": 0.5883636935927726, + "normalized_load_entropy": 0.9608315469779677, + "max_load_share": 0.04718875502008032 + }, + "full_input": { + "tokens": 207, + "top_k": 6, + "decisions": 1242, + "ordered_route_sha256": "0a656ba17ca26a67be1d57c6b97c39a16b9e78b33d40663778e67ce8c27d0146", + "route_weight_sha256": "233fa0398e9ffd4439cbba98810214dbddcf24c590b666c6b9519dde8723009b", + "loads": [ + 13, + 9, + 16, + 44, + 21, + 24, + 26, + 13, + 6, + 13, + 14, + 6, + 4, + 34, + 11, + 22, + 27, + 53, + 35, + 11, + 18, + 17, + 4, + 21, + 22, + 67, + 26, + 19, + 25, + 10, + 15, + 9, + 30, + 11, + 13, + 16, + 21, + 13, + 26, + 10, + 36, + 15, + 21, + 13, + 21, + 23, + 22, + 11, + 10, + 22, + 1, + 30, + 13, + 13, + 14, + 28, + 16, + 37, + 11, + 23, + 6, + 19, + 32, + 10 + ], + "weighted_loads": [ + 0.47537100315093994, + 0.36354998126626015, + 0.5697910059243441, + 4.107521424070001, + 1.5738861598074436, + 1.2952364720404148, + 1.1985245626419783, + 0.7284480333328247, + 0.45408667996525764, + 0.4408066123723984, + 1.0314221139997244, + 0.2526426613330841, + 0.11174022872000933, + 2.5805027447640896, + 0.6078111305832863, + 1.1415103152394295, + 1.8518291842192411, + 5.317628651857376, + 9.59810976870358, + 0.6118901604786515, + 1.1343733947724104, + 0.5516793755814433, + 0.21545489504933357, + 1.1102521177381277, + 1.0704293735325336, + 4.632120922207832, + 2.550146760419011, + 0.9384225681424141, + 1.3902022782713175, + 0.36243734508752823, + 1.6351120918989182, + 0.36419156566262245, + 3.939811277668923, + 0.6637494415044785, + 0.7618076242506504, + 1.7667882405221462, + 1.519761648029089, + 0.597853060811758, + 1.9940136168152094, + 0.6295115072280169, + 3.2774064764380455, + 0.7005595550872386, + 1.7434648936614394, + 0.5717294719070196, + 1.7305410224944353, + 2.1347452588379383, + 1.5938025116920471, + 0.6611321903765202, + 1.0605193451046944, + 0.9869072856381536, + 0.13681264221668243, + 1.60479580424726, + 0.7188291139900684, + 0.4399141361936927, + 0.9551703110337257, + 2.8202734123915434, + 1.172273337841034, + 2.068233492784202, + 0.5809035617858171, + 0.982095792889595, + 0.2423926740884781, + 1.5312062837183475, + 1.6070570591837168, + 0.738375511020422 + ], + "unique_experts": 64, + "load_cv": 0.5955062968960131, + "normalized_load_entropy": 0.9612196015152575, + "max_load_share": 0.05394524959742351 + } + }, + "s0_bos": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "69da62f1456594687168fd54c37e6c532c967cd7c3ad8b648c24387a59122325", + "route_weight_sha256": "571e79c2eb325f8a040f9b3cfb3ab9854821d82e8b43f368aa70fd583ec9be2b", + "loads": [ + 8, + 5, + 18, + 38, + 13, + 24, + 23, + 12, + 5, + 9, + 9, + 4, + 2, + 26, + 9, + 16, + 24, + 47, + 32, + 9, + 17, + 14, + 6, + 8, + 12, + 47, + 13, + 16, + 24, + 8, + 14, + 10, + 23, + 9, + 13, + 16, + 18, + 8, + 22, + 9, + 25, + 10, + 17, + 13, + 19, + 20, + 21, + 9, + 10, + 20, + 0, + 23, + 9, + 10, + 14, + 21, + 8, + 23, + 10, + 22, + 5, + 15, + 24, + 8 + ], + "weighted_loads": [ + 0.2587096858769655, + 0.18898838944733143, + 0.6635928461328149, + 3.493245135061443, + 1.1564766727387905, + 1.3062509931623936, + 1.1585538517683744, + 0.6497523691505194, + 0.4376491606235504, + 0.3134915418922901, + 0.6419473513960838, + 0.18301444128155708, + 0.059895891696214676, + 2.007519893348217, + 0.44128191471099854, + 0.857167249545455, + 1.7041952200233936, + 4.852917153388262, + 9.570571202784777, + 0.540824462659657, + 1.1440857350826263, + 0.40370870707556605, + 0.30913396924734116, + 0.2846728693693876, + 0.46242474392056465, + 3.5518787782639265, + 0.7146233916282654, + 0.8005715850740671, + 1.2680678963661194, + 0.2793844863772392, + 1.5985486842691898, + 0.4074848312884569, + 3.832324355840683, + 0.6330470517277718, + 0.7650682851672173, + 1.7849975666031241, + 1.3984616789966822, + 0.45035045593976974, + 1.691181130707264, + 0.5931453742086887, + 1.752953439950943, + 0.3587797600775957, + 1.5795592674985528, + 0.5418923683464527, + 1.5000427719205618, + 0.9872405454516411, + 1.4151667654514313, + 0.5183854885399342, + 1.1531118601560593, + 0.9099689675495028, + 0.0, + 1.3994373828172684, + 0.46892255917191505, + 0.3513534814119339, + 0.9297409858554602, + 2.4687022753059864, + 0.5310836061835289, + 1.3966754311695695, + 0.5439691245555878, + 0.9022091012448072, + 0.20994478650391102, + 1.2692187651991844, + 1.0358587820082903, + 0.503525348380208 + ], + "unique_experts": 63, + "load_cv": 0.5984744291888038, + "normalized_load_entropy": 0.9593310493389545, + "max_load_share": 0.04718875502008032 + }, + "full_input": { + "tokens": 191, + "top_k": 6, + "decisions": 1146, + "ordered_route_sha256": "0dbcadc33d6c06786a9349161caad3bbf75e52509160860027145ee46452ceda", + "route_weight_sha256": "93f3368a8c94c5d74b4f6b38946f92f9b9d738b01b3a51069eb765fe95eed155", + "loads": [ + 15, + 7, + 19, + 45, + 13, + 24, + 25, + 12, + 5, + 12, + 15, + 5, + 7, + 34, + 9, + 18, + 24, + 54, + 35, + 10, + 20, + 15, + 6, + 16, + 18, + 53, + 23, + 19, + 28, + 8, + 14, + 10, + 29, + 9, + 13, + 16, + 18, + 9, + 27, + 9, + 33, + 15, + 18, + 14, + 19, + 24, + 21, + 9, + 10, + 22, + 1, + 23, + 11, + 11, + 15, + 24, + 9, + 25, + 11, + 23, + 5, + 16, + 31, + 8 + ], + "weighted_loads": [ + 0.5361461974680424, + 0.27366298250854015, + 0.7220964217558503, + 4.073096106760204, + 1.1564766727387905, + 1.3062509931623936, + 1.2571492623537779, + 0.6497523691505194, + 0.4376491606235504, + 0.4215434417128563, + 1.0192124992609024, + 0.2014927715063095, + 0.34601245634257793, + 2.6013390347361565, + 0.44128191471099854, + 0.954620273783803, + 1.7041952200233936, + 5.53005213662982, + 9.828183677047491, + 0.6000854009762406, + 1.4461985155940056, + 0.48260757653042674, + 0.30913396924734116, + 0.6331823375076056, + 0.985746543854475, + 3.8492064382880926, + 1.5461929850280285, + 0.9299229849129915, + 1.4202554561197758, + 0.2793844863772392, + 1.5985486842691898, + 0.4074848312884569, + 4.097661407664418, + 0.6330470517277718, + 0.7650682851672173, + 1.7849975666031241, + 1.3984616789966822, + 0.47538587637245655, + 1.8845810797065496, + 0.5931453742086887, + 2.7167138159275055, + 0.5140609070658684, + 1.689904005266726, + 0.5607045125216246, + 1.5000427719205618, + 1.7810574099421501, + 1.4151667654514313, + 0.5183854885399342, + 1.1531118601560593, + 1.125755819492042, + 0.0684502050280571, + 1.3994373828172684, + 0.6243363879621029, + 0.4045751094818115, + 1.0037225242704153, + 2.6684106029570103, + 0.5591940302401781, + 1.5164428791031241, + 0.5803681910037994, + 0.9504407439380884, + 0.20994478650391102, + 1.3731585070490837, + 1.4521556589752436, + 0.503525348380208 + ], + "unique_experts": 64, + "load_cv": 0.5946987444202154, + "normalized_load_entropy": 0.9610346332294076, + "max_load_share": 0.04712041884816754 + } + }, + "s1_bos": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "4339da397d92f3feec361e12233a116e3fabf34b705d982e4d3d94c91f4b409b", + "route_weight_sha256": "281936df96c0f8bef2d5872fa4055550591f0aeaec32913afedcb70f113d3ed0", + "loads": [ + 8, + 4, + 15, + 38, + 17, + 25, + 21, + 12, + 5, + 9, + 8, + 3, + 3, + 26, + 10, + 16, + 24, + 47, + 35, + 11, + 17, + 14, + 8, + 9, + 12, + 49, + 16, + 16, + 24, + 5, + 13, + 10, + 24, + 9, + 13, + 15, + 17, + 7, + 22, + 9, + 23, + 11, + 18, + 12, + 20, + 18, + 21, + 9, + 10, + 20, + 1, + 23, + 9, + 9, + 14, + 19, + 8, + 24, + 8, + 21, + 4, + 14, + 24, + 10 + ], + "weighted_loads": [ + 0.24448135308921337, + 0.15679382346570492, + 0.5269059333950281, + 3.4481083042919636, + 1.322266949340701, + 1.3333129957318306, + 1.0691309534013271, + 0.6595474407076836, + 0.42164774239063263, + 0.31673457100987434, + 0.5849104262888432, + 0.15179932117462158, + 0.09784415829926729, + 1.992839254438877, + 0.48871923238039017, + 0.8743408974260092, + 1.7411992326378822, + 4.804241608828306, + 9.682966578751802, + 0.6368046049028635, + 1.0660703014582396, + 0.39861109713092446, + 0.3795584440231323, + 0.3219530079513788, + 0.4399401545524597, + 3.4813982285559177, + 0.8493600636720657, + 0.7879671566188335, + 1.3145454488694668, + 0.17126172594726086, + 1.539388034492731, + 0.39489684626460075, + 3.804617950692773, + 0.6182427406311035, + 0.7482756227254868, + 1.7562123201787472, + 1.3455925825983286, + 0.4115418791770935, + 1.6827031802386045, + 0.5917716473340988, + 1.696757733821869, + 0.40784030221402645, + 1.6089526321738958, + 0.5084224976599216, + 1.4984394237399101, + 0.9308365192264318, + 1.4239069074392319, + 0.5208592899143696, + 1.1583706084638834, + 0.9485695725306869, + 0.026829620823264122, + 1.3397692069411278, + 0.466887928545475, + 0.3073037201538682, + 0.889337470754981, + 2.3798364009708166, + 0.518036600202322, + 1.4008379140868783, + 0.4568498022854328, + 0.8668569773435593, + 0.17584064975380898, + 1.1682866178452969, + 1.050494589842856, + 0.661151485517621 + ], + "unique_experts": 64, + "load_cv": 0.609370757782151, + "normalized_load_entropy": 0.9588348126533135, + "max_load_share": 0.04919678714859438 + }, + "full_input": { + "tokens": 207, + "top_k": 6, + "decisions": 1242, + "ordered_route_sha256": "bd97b4b4d5078622e9d7aaec7a4f68658bf839046ac96fbb79a27bb7a754379a", + "route_weight_sha256": "1ae514478b4b392a2f3937c171b242906ad9795f72913deef0002f1739b4f95b", + "loads": [ + 15, + 8, + 17, + 45, + 24, + 25, + 24, + 13, + 5, + 14, + 15, + 5, + 5, + 34, + 10, + 22, + 26, + 54, + 38, + 11, + 18, + 15, + 8, + 20, + 21, + 68, + 29, + 18, + 25, + 6, + 14, + 11, + 28, + 9, + 13, + 15, + 22, + 9, + 26, + 10, + 37, + 18, + 21, + 13, + 22, + 23, + 23, + 11, + 10, + 22, + 3, + 29, + 13, + 10, + 15, + 25, + 16, + 35, + 9, + 23, + 5, + 19, + 35, + 10 + ], + "weighted_loads": [ + 0.5543497502803802, + 0.3519687298685312, + 0.6063541378825903, + 4.116974845528603, + 1.7498526498675346, + 1.3333129957318306, + 1.1875963360071182, + 0.7133437097072601, + 0.42164774239063263, + 0.4987664017826319, + 1.0684842076152563, + 0.21781467646360397, + 0.2027175733819604, + 2.6081817857921124, + 0.48871923238039017, + 1.1570529136806726, + 1.910984918475151, + 5.408539902418852, + 9.79949539154768, + 0.6368046049028635, + 1.1623709332197905, + 0.4757456691004336, + 0.3795584440231323, + 1.0658830758184195, + 1.036168109625578, + 4.732074525207281, + 1.8554302584379911, + 0.8779234476387501, + 1.3463412560522556, + 0.2498991247266531, + 1.6007894277572632, + 0.43382496386766434, + 3.952775890007615, + 0.6182427406311035, + 0.7482756227254868, + 1.7562123201787472, + 1.6044907625764608, + 0.4839074555784464, + 2.0143420193344355, + 0.6255767606198788, + 3.356231562793255, + 0.8069693446159363, + 1.7406653221696615, + 0.5272346418350935, + 1.7364933043718338, + 2.288337802514434, + 1.644024945795536, + 0.6525437720119953, + 1.1583706084638834, + 1.0285196816548705, + 0.22252255864441395, + 1.6358592510223389, + 0.7240572050213814, + 0.3346638148650527, + 0.9768800046294928, + 2.808191256597638, + 1.17174406722188, + 1.974311982281506, + 0.4801425617188215, + 0.9604643993079662, + 0.20799092575907707, + 1.481120839715004, + 1.832580036483705, + 0.661151485517621 + ], + "unique_experts": 64, + "load_cv": 0.6104376576021165, + "normalized_load_entropy": 0.9599028742415578, + "max_load_share": 0.05475040257648953 + } + }, + "s0_x": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "6d9749a8a043dea24a9784b2820c926d85d595972421bd45e774e3da59bf070d", + "route_weight_sha256": "1c858edf6116f38c53aa1930213dce1e7bb309cf76c1bdc0144ee72243767cba", + "loads": [ + 5, + 4, + 17, + 38, + 15, + 25, + 24, + 12, + 5, + 7, + 8, + 4, + 3, + 26, + 8, + 15, + 25, + 46, + 34, + 11, + 16, + 15, + 6, + 9, + 10, + 49, + 12, + 18, + 23, + 6, + 14, + 10, + 25, + 10, + 13, + 15, + 19, + 11, + 22, + 9, + 25, + 8, + 20, + 9, + 18, + 17, + 21, + 8, + 11, + 20, + 0, + 23, + 9, + 12, + 13, + 23, + 8, + 25, + 8, + 24, + 4, + 15, + 23, + 8 + ], + "weighted_loads": [ + 0.15231861174106598, + 0.1522420160472393, + 0.56236332654953, + 3.535767002031207, + 1.2598090879619122, + 1.3413925245404243, + 1.1981762573122978, + 0.6479352619498968, + 0.42745570093393326, + 0.2464302685111761, + 0.5882477983832359, + 0.17470456287264824, + 0.08026342745870352, + 2.012973126024008, + 0.3848929740488529, + 0.8060855139046907, + 1.7402045130729675, + 4.753641199320555, + 9.446392003446817, + 0.6241647657006979, + 1.0831647664308548, + 0.43435307405889034, + 0.30469632893800735, + 0.3113932143896818, + 0.4106284435838461, + 3.7566843014210463, + 0.6409740820527077, + 0.9139531757682562, + 1.2716302070766687, + 0.20068573579192162, + 1.574116013944149, + 0.406223651021719, + 3.8745498191565275, + 0.6702673770487309, + 0.7522621527314186, + 1.8195207715034485, + 1.444329358637333, + 0.5519294403493404, + 1.7053123693913221, + 0.5966471396386623, + 1.909018026664853, + 0.28966354578733444, + 1.7501163901761174, + 0.38802918791770935, + 1.452199649065733, + 0.8592120967805386, + 1.4063454028218985, + 0.4905995950102806, + 1.153803739696741, + 0.8885702611878514, + 0.0, + 1.380112448707223, + 0.4581640250980854, + 0.37986137345433235, + 0.8900384977459908, + 2.592641420662403, + 0.5278780162334442, + 1.518891111947596, + 0.47432931885123253, + 0.9395572356879711, + 0.17982931435108185, + 1.2908421531319618, + 1.0116704478859901, + 0.5287344064563513 + ], + "unique_experts": 63, + "load_cv": 0.6225676852628189, + "normalized_load_entropy": 0.9558946742473775, + "max_load_share": 0.04919678714859438 + }, + "full_input": { + "tokens": 191, + "top_k": 6, + "decisions": 1146, + "ordered_route_sha256": "10e5f9bc7f1610b0529d20d84a5c09f4601928d433a94b0ebdef6571b18ef08e", + "route_weight_sha256": "72702eb958b98e4ca758192a36ec95ca8a5841d75964942a1e248a3e383fcca0", + "loads": [ + 11, + 5, + 21, + 46, + 15, + 25, + 26, + 12, + 5, + 11, + 15, + 5, + 6, + 35, + 8, + 17, + 25, + 54, + 37, + 11, + 18, + 16, + 6, + 18, + 16, + 57, + 19, + 21, + 27, + 6, + 14, + 10, + 31, + 10, + 13, + 15, + 19, + 12, + 26, + 9, + 32, + 13, + 22, + 10, + 18, + 21, + 21, + 8, + 12, + 21, + 2, + 23, + 11, + 12, + 14, + 27, + 9, + 27, + 9, + 24, + 4, + 16, + 29, + 8 + ], + "weighted_loads": [ + 0.37166661210358143, + 0.1883862018585205, + 0.7400721982121468, + 4.266420794650912, + 1.2598090879619122, + 1.3413925245404243, + 1.2967716678977013, + 0.6479352619498968, + 0.42745570093393326, + 0.3993771616369486, + 1.1225683093070984, + 0.19318289309740067, + 0.17333288956433535, + 2.6448212563991547, + 0.3848929740488529, + 0.8981417547911406, + 1.7402045130729675, + 5.474260285496712, + 9.76730228587985, + 0.6241647657006979, + 1.2856408283114433, + 0.4763170909136534, + 0.30469632893800735, + 0.7109164129942656, + 0.8978102337568998, + 4.137801546603441, + 1.2866389155387878, + 1.0433045756071806, + 1.432476805523038, + 0.20068573579192162, + 1.574116013944149, + 0.406223651021719, + 4.139886870980263, + 0.6702673770487309, + 0.7522621527314186, + 1.8195207715034485, + 1.444329358637333, + 0.5774247292429209, + 1.871502736583352, + 0.5966471396386623, + 2.874999327585101, + 0.4629800282418728, + 1.8965682024136186, + 0.4068413320928812, + 1.452199649065733, + 1.712012629956007, + 1.4063454028218985, + 0.4905995950102806, + 1.1951197795569897, + 0.9191056480631232, + 0.1332036256790161, + 1.380112448707223, + 0.6112835593521595, + 0.37986137345433235, + 0.9317793250083923, + 2.82348395511508, + 0.5624152608215809, + 1.6386585598811507, + 0.5107283852994442, + 0.9395572356879711, + 0.17982931435108185, + 1.392057292163372, + 1.342760857194662, + 0.5287344064563513 + ], + "unique_experts": 64, + "load_cv": 0.6211517187029787, + "normalized_load_entropy": 0.9580118619803141, + "max_load_share": 0.049738219895287955 + } + }, + "s1_x": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "ceca8abf26cd1eaa5aebab4d662b2f265e2ada17e97197938698af7d9bfc05c0", + "route_weight_sha256": "891687d6ff02aa020e702c04d740063735e80148ad8c547f7f0252a1c1c0513d", + "loads": [ + 7, + 4, + 14, + 37, + 15, + 23, + 21, + 12, + 5, + 9, + 8, + 3, + 3, + 26, + 10, + 16, + 25, + 48, + 34, + 11, + 15, + 15, + 7, + 12, + 11, + 53, + 16, + 16, + 23, + 5, + 13, + 10, + 26, + 9, + 13, + 16, + 18, + 8, + 21, + 9, + 24, + 9, + 20, + 13, + 19, + 13, + 20, + 9, + 9, + 21, + 0, + 22, + 9, + 10, + 15, + 20, + 8, + 29, + 8, + 20, + 4, + 15, + 24, + 8 + ], + "weighted_loads": [ + 0.2300921380519867, + 0.1501266099512577, + 0.47507068794220686, + 3.5011338433250785, + 1.2571960091590881, + 1.2701816745102406, + 1.0965269971638918, + 0.6475631911307573, + 0.41640327125787735, + 0.31625744700431824, + 0.5705399736762047, + 0.1500418670475483, + 0.08171170763671398, + 2.0032195076346397, + 0.5324445180594921, + 0.8494257088750601, + 1.7935019452124834, + 4.842356440611184, + 9.668747635558248, + 0.6359908236190677, + 1.0576442293822765, + 0.4136059978045523, + 0.3479490987956524, + 0.39619906432926655, + 0.40946969762444496, + 3.9106100406497717, + 0.801775423809886, + 0.7863165885210037, + 1.3387445006519556, + 0.16171619296073914, + 1.5423081815242767, + 0.4063754305243492, + 3.887269537895918, + 0.6060425713658333, + 0.7607524506747723, + 1.7825220189988613, + 1.387522866949439, + 0.4314601216465235, + 1.6801522076129913, + 0.6094142328947783, + 1.8061416931450367, + 0.3133129943162203, + 1.7458388321101665, + 0.5334570221602917, + 1.431624966673553, + 0.7535666450858116, + 1.406623536720872, + 0.5492255315184593, + 1.0771127585321665, + 0.9761565728113055, + 0.0, + 1.2466378640383482, + 0.4662019945681095, + 0.35991115355864167, + 0.9261139594018459, + 2.4422573279589415, + 0.5094045139849186, + 1.6658978573977947, + 0.47001009806990623, + 0.8039231710135937, + 0.1737932302057743, + 1.2182318046689034, + 0.9927098657935858, + 0.581079488620162 + ], + "unique_experts": 63, + "load_cv": 0.6321315758512929, + "normalized_load_entropy": 0.9559213987877935, + "max_load_share": 0.05321285140562249 + }, + "full_input": { + "tokens": 207, + "top_k": 6, + "decisions": 1242, + "ordered_route_sha256": "9a202db943dbf02f2902bb64827509f10c14a51bc0e8442e3f31db6a8fb0ec99", + "route_weight_sha256": "8f9922dc99499352a432cc04aaa4de5e32c1f5374de566c30c79b57a23499a3c", + "loads": [ + 13, + 5, + 17, + 45, + 22, + 23, + 24, + 13, + 5, + 14, + 16, + 5, + 3, + 35, + 10, + 22, + 27, + 56, + 37, + 11, + 15, + 16, + 7, + 23, + 20, + 74, + 26, + 18, + 25, + 6, + 14, + 11, + 30, + 9, + 13, + 16, + 23, + 10, + 26, + 10, + 37, + 16, + 24, + 14, + 21, + 18, + 22, + 11, + 10, + 22, + 2, + 28, + 13, + 11, + 16, + 27, + 15, + 42, + 10, + 22, + 5, + 21, + 32, + 8 + ], + "weighted_loads": [ + 0.48975097201764584, + 0.19320636242628098, + 0.6090947156772017, + 4.330634201876819, + 1.6847817096859217, + 1.2701816745102406, + 1.2149923797696829, + 0.7013594601303339, + 0.41640327125787735, + 0.4797386731952429, + 1.1960372272878885, + 0.21605722233653069, + 0.08171170763671398, + 2.677553929388523, + 0.5324445180594921, + 1.132406448945403, + 1.9632876310497522, + 5.4976373659446836, + 9.79661182872951, + 0.6359908236190677, + 1.0576442293822765, + 0.49074056977406144, + 0.3479490987956524, + 1.124447314068675, + 0.9712752476334572, + 5.271722381934524, + 1.5902096666395664, + 0.8539132624864578, + 1.4143922198563814, + 0.24035359174013138, + 1.6037095747888088, + 0.4453035481274128, + 4.03542747721076, + 0.6060425713658333, + 0.7607524506747723, + 1.7825220189988613, + 1.6464210469275713, + 0.5038256980478764, + 2.043547471985221, + 0.6432193461805582, + 3.4060859382152557, + 0.7046369761228561, + 1.9180420860648155, + 0.5522691663354635, + 1.6696788473054767, + 1.9673089981079102, + 1.626741575077176, + 0.680910013616085, + 1.1178515125066042, + 1.0189915811643004, + 0.2248629704117775, + 1.5427279081195593, + 0.706090223044157, + 0.386502290610224, + 1.0136564932763577, + 2.8784664627164602, + 1.126463420689106, + 2.36453552916646, + 0.5443740170449018, + 0.8975305929780006, + 0.2059435062110424, + 1.5655576307326555, + 1.5610775165259838, + 0.581079488620162 + ], + "unique_experts": 64, + "load_cv": 0.6474451333848273, + "normalized_load_entropy": 0.9556355798379201, + "max_load_share": 0.05958132045088567 + } + }, + "s0_period": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "595d09d95e81b016cb607f76e3430e8a2abf9030239e7c06b05eb359b75eeaeb", + "route_weight_sha256": "a80f560c2be75881caa5cc82b78f9cbac4e2953b562b4033c8c5599a2b019f48", + "loads": [ + 5, + 4, + 15, + 38, + 15, + 24, + 25, + 12, + 5, + 8, + 7, + 5, + 2, + 26, + 9, + 16, + 25, + 47, + 33, + 13, + 17, + 16, + 7, + 9, + 12, + 49, + 11, + 17, + 23, + 5, + 14, + 10, + 25, + 10, + 13, + 15, + 19, + 10, + 20, + 9, + 25, + 8, + 18, + 10, + 18, + 17, + 21, + 9, + 9, + 19, + 0, + 23, + 9, + 10, + 13, + 23, + 8, + 27, + 9, + 23, + 3, + 15, + 25, + 9 + ], + "weighted_loads": [ + 0.15673181787133217, + 0.1514237392693758, + 0.505171618424356, + 3.512474998831749, + 1.265102580189705, + 1.3441121950745583, + 1.2552328240126371, + 0.6488724146038294, + 0.4320986792445183, + 0.2789033353328705, + 0.5601407513022423, + 0.20907999947667122, + 0.06367655284702778, + 2.0004629530012608, + 0.41932017356157303, + 0.8392786923795938, + 1.7651918325573206, + 4.773281380534172, + 9.503869475796819, + 0.7025707997381687, + 1.0964877335354686, + 0.4694458586163819, + 0.3420358616858721, + 0.3060539551079273, + 0.4740484766662121, + 3.758128009736538, + 0.5692706815898418, + 0.8387706708163023, + 1.272015791386366, + 0.16889441385865211, + 1.5976620726287365, + 0.40477902442216873, + 3.865329435095191, + 0.6739125102758408, + 0.7531382516026497, + 1.850045159459114, + 1.4500384368002415, + 0.5092536248266697, + 1.6350257769227028, + 0.593212129548192, + 1.9196417927742004, + 0.3005247078835964, + 1.673660883679986, + 0.41354205273091793, + 1.4572136998176575, + 0.8622017316520214, + 1.4167165365070105, + 0.5262511596083641, + 1.1079093683511019, + 0.8492418900132179, + 0.0, + 1.3664975017309189, + 0.4501902125775814, + 0.32400881312787533, + 0.9031088910996914, + 2.5510643906891346, + 0.5285549871623516, + 1.577758764848113, + 0.5080568231642246, + 0.887267928570509, + 0.14569123461842537, + 1.2724128030240536, + 1.0580277033150196, + 0.5386561136692762 + ], + "unique_experts": 63, + "load_cv": 0.6239133874454278, + "normalized_load_entropy": 0.9556855409468602, + "max_load_share": 0.04919678714859438 + }, + "full_input": { + "tokens": 191, + "top_k": 6, + "decisions": 1146, + "ordered_route_sha256": "4284c50656a97ac8de620bd2fe618f45d52af5dc60c6f49327b968ca44d5eeba", + "route_weight_sha256": "e9f7ce7df57672d246728aa39b9b4e7d8f969cf30c4c1e009e34791f7db52479", + "loads": [ + 11, + 5, + 19, + 46, + 15, + 24, + 27, + 12, + 5, + 11, + 13, + 6, + 5, + 34, + 9, + 19, + 25, + 54, + 36, + 13, + 20, + 17, + 7, + 16, + 18, + 57, + 19, + 21, + 27, + 6, + 14, + 10, + 31, + 10, + 13, + 15, + 19, + 10, + 25, + 9, + 33, + 13, + 20, + 11, + 18, + 21, + 21, + 9, + 9, + 20, + 3, + 23, + 11, + 10, + 14, + 28, + 8, + 29, + 10, + 23, + 3, + 16, + 31, + 9 + ], + "weighted_loads": [ + 0.37929566018283367, + 0.187567925080657, + 0.7074112771078944, + 4.13703315705061, + 1.265102580189705, + 1.3441121950745583, + 1.3538282345980406, + 0.6488724146038294, + 0.4320986792445183, + 0.38695523515343666, + 0.9374058991670609, + 0.22755832970142365, + 0.1567460149526596, + 2.5942820943892, + 0.41932017356157303, + 0.9571538530290127, + 1.7651918325573206, + 5.45041636377573, + 9.866857001557946, + 0.7025707997381687, + 1.3532764939591289, + 0.5180604574270546, + 0.3420358616858721, + 0.6209773309528828, + 0.9487252049148083, + 4.143705278635025, + 1.2434747815132141, + 1.0057942289859056, + 1.43296704813838, + 0.20404250174760818, + 1.5976620726287365, + 0.40477902442216873, + 4.130666486918926, + 0.6739125102758408, + 0.7531382516026497, + 1.850045159459114, + 1.4500384368002415, + 0.5092536248266697, + 1.828084621578455, + 0.593212129548192, + 2.915018007159233, + 0.482235262170434, + 1.8322012927383184, + 0.4323541969060898, + 1.4572136998176575, + 1.7862826250493526, + 1.4167165365070105, + 0.5262511596083641, + 1.1079093683511019, + 0.8805249147117138, + 0.16021566465497017, + 1.3664975017309189, + 0.604237649589777, + 0.32400881312787533, + 0.9466689936816692, + 2.9495991840958595, + 0.5285549871623516, + 1.6975262127816677, + 0.5444558896124363, + 0.887267928570509, + 0.14569123461842537, + 1.3768658228218555, + 1.3976973704993725, + 0.5386561136692762 + ], + "unique_experts": 64, + "load_cv": 0.621857400522756, + "normalized_load_entropy": 0.9580851521344466, + "max_load_share": 0.049738219895287955 + } + }, + "s1_period": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "bd7c147c86125a056c160e5322c85b04fa7ba318ef6258bf80270fad9b18d6dc", + "route_weight_sha256": "d7234881bb2c8c3a8106a0e3e5347887dcdb0f4b239b9acbd04d6b51011cf0c7", + "loads": [ + 7, + 6, + 15, + 37, + 15, + 23, + 23, + 12, + 5, + 8, + 9, + 4, + 2, + 26, + 9, + 17, + 25, + 48, + 33, + 11, + 17, + 15, + 6, + 10, + 11, + 52, + 15, + 17, + 21, + 6, + 13, + 10, + 24, + 11, + 13, + 16, + 17, + 7, + 20, + 9, + 24, + 8, + 20, + 12, + 18, + 15, + 21, + 9, + 10, + 22, + 0, + 23, + 9, + 12, + 14, + 20, + 8, + 29, + 8, + 20, + 4, + 14, + 23, + 8 + ], + "weighted_loads": [ + 0.21566255949437618, + 0.2326006069779396, + 0.5042097559198737, + 3.484034593217075, + 1.2798122502863407, + 1.2794452402740717, + 1.1510961446911097, + 0.6515324506908655, + 0.4241022430360317, + 0.27601796574890614, + 0.6194265745580196, + 0.18066411465406418, + 0.07422192208468914, + 1.9889684617519379, + 0.48495255038142204, + 0.8672022949904203, + 1.837640618905425, + 4.8451112769544125, + 9.642118213698268, + 0.6437262315303087, + 1.0900295106694102, + 0.4266236526891589, + 0.3022492378950119, + 0.33471085131168365, + 0.4083176888525486, + 3.898464435711503, + 0.7867362517863512, + 0.8401945009827614, + 1.2402077596634626, + 0.1961495541036129, + 1.5534358136355877, + 0.4032827578485012, + 3.8558507096022367, + 0.6796103268861771, + 0.7602607943117619, + 1.7821131218224764, + 1.3555902391672134, + 0.39459239691495895, + 1.6546514853835106, + 0.6082439236342907, + 1.7757144793868065, + 0.28453975543379784, + 1.7550738556310534, + 0.5023568999022245, + 1.4011844880878925, + 0.8369371816515923, + 1.4448664970695972, + 0.5319944247603416, + 1.107918407768011, + 0.9766957117244601, + 0.0, + 1.3163563162088394, + 0.45514848828315735, + 0.4325606073252857, + 0.919599823653698, + 2.4470403660088778, + 0.5063441582024097, + 1.6584290387108922, + 0.4590066149830818, + 0.8168684113770723, + 0.17091937735676765, + 1.1745504029095173, + 0.9155251337215304, + 0.5394604876637459 + ], + "unique_experts": 63, + "load_cv": 0.6231891396639547, + "normalized_load_entropy": 0.9569720938973889, + "max_load_share": 0.05220883534136546 + }, + "full_input": { + "tokens": 207, + "top_k": 6, + "decisions": 1242, + "ordered_route_sha256": "5dacd6a5e3d938e04ea812b15c95e72dcb7a16491d2f963484add4f84b528a91", + "route_weight_sha256": "340d508158dcb248d4e5c74d9bbfbeb1a2862aed91aba1b512a998678b989dd3", + "loads": [ + 13, + 7, + 18, + 45, + 22, + 23, + 26, + 13, + 5, + 12, + 17, + 6, + 2, + 34, + 9, + 25, + 27, + 55, + 37, + 11, + 17, + 16, + 6, + 20, + 20, + 75, + 25, + 18, + 24, + 7, + 14, + 11, + 28, + 11, + 13, + 16, + 22, + 9, + 24, + 10, + 37, + 15, + 25, + 13, + 20, + 20, + 23, + 11, + 10, + 22, + 3, + 29, + 13, + 12, + 15, + 29, + 15, + 43, + 9, + 22, + 5, + 19, + 31, + 8 + ], + "weighted_loads": [ + 0.47972598299384117, + 0.2756803594529629, + 0.627532864920795, + 4.209925285540521, + 1.7073979508131742, + 1.2794452402740717, + 1.2695615272969007, + 0.7053287196904421, + 0.4241022430360317, + 0.40156758204102516, + 1.1317537873983383, + 0.24667946994304657, + 0.07422192208468914, + 2.604310993105173, + 0.48495255038142204, + 1.2231207974255085, + 2.007426304742694, + 5.449409570544958, + 9.81569536961615, + 0.6437262315303087, + 1.0900295106694102, + 0.503758224658668, + 0.3022492378950119, + 1.0288321897387505, + 0.960864745080471, + 5.374456925317645, + 1.5676210448145866, + 0.8811308443546295, + 1.342001961544156, + 0.27478695288300514, + 1.6148372069001198, + 0.4422108754515648, + 4.004008648917079, + 0.6796103268861771, + 0.7602607943117619, + 1.7821131218224764, + 1.6144884191453457, + 0.46695797331631184, + 1.9793876148760319, + 0.6420490369200706, + 3.35404584184289, + 0.6781349126249552, + 1.9683060040697455, + 0.5211690440773964, + 1.6392383687198162, + 2.2547269091010094, + 1.6649845354259014, + 0.6636789068579674, + 1.107918407768011, + 0.9766957117244601, + 0.23202293552458286, + 1.6124463602900505, + 0.6844025254249573, + 0.4325606073252857, + 1.0071423575282097, + 3.102537540718913, + 1.1234030649065971, + 2.423571136780083, + 0.4822993744164705, + 0.9104758333414793, + 0.20306965336203575, + 1.4798514321446419, + 1.4545181589201093, + 0.5394604876637459 + ], + "unique_experts": 64, + "load_cv": 0.6471887559499245, + "normalized_load_entropy": 0.9560605969706724, + "max_load_share": 0.06038647342995169 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 166, + "ordered_topk_exact_tokens": 101, + "set_exact_tokens": 117, + "mean_set_jaccard": 0.909495123350545, + "mean_token_weighted_tv": 0.019602890381679297, + "aggregate_load_tv": 0.030120481927710843 + }, + "system_bos": { + "tokens": 166, + "ordered_topk_exact_tokens": 88, + "set_exact_tokens": 112, + "mean_set_jaccard": 0.9031841652323581, + "mean_token_weighted_tv": 0.02119555886195277, + "aggregate_load_tv": 0.02811244979919679 + }, + "system_x": { + "tokens": 166, + "ordered_topk_exact_tokens": 76, + "set_exact_tokens": 108, + "mean_set_jaccard": 0.8914228341939185, + "mean_token_weighted_tv": 0.025486132099169743, + "aggregate_load_tv": 0.03915662650602411 + }, + "system_period": { + "tokens": 166, + "ordered_topk_exact_tokens": 81, + "set_exact_tokens": 102, + "mean_set_jaccard": 0.8833907056798623, + "mean_token_weighted_tv": 0.026394439297335513, + "aggregate_load_tv": 0.03313253012048194 + }, + "bos_at_s0": { + "tokens": 166, + "ordered_topk_exact_tokens": 83, + "set_exact_tokens": 105, + "mean_set_jaccard": 0.8872633390705681, + "mean_token_weighted_tv": 0.025702917509353215, + "aggregate_load_tv": 0.03212851405622491 + }, + "bos_at_s1": { + "tokens": 166, + "ordered_topk_exact_tokens": 79, + "set_exact_tokens": 91, + "mean_set_jaccard": 0.8577739529546758, + "mean_token_weighted_tv": 0.030167064869338758, + "aggregate_load_tv": 0.03815261044176707 + }, + "x_at_s0": { + "tokens": 166, + "ordered_topk_exact_tokens": 72, + "set_exact_tokens": 95, + "mean_set_jaccard": 0.8646586345381527, + "mean_token_weighted_tv": 0.029633937033274806, + "aggregate_load_tv": 0.03815261044176708 + }, + "x_at_s1": { + "tokens": 166, + "ordered_topk_exact_tokens": 62, + "set_exact_tokens": 87, + "mean_set_jaccard": 0.8429432013769365, + "mean_token_weighted_tv": 0.03458933780777706, + "aggregate_load_tv": 0.04216867469879519 + }, + "period_at_s0": { + "tokens": 166, + "ordered_topk_exact_tokens": 69, + "set_exact_tokens": 90, + "mean_set_jaccard": 0.8556824701403014, + "mean_token_weighted_tv": 0.031204306723897804, + "aggregate_load_tv": 0.03815261044176707 + }, + "period_at_s1": { + "tokens": 166, + "ordered_topk_exact_tokens": 73, + "set_exact_tokens": 94, + "mean_set_jaccard": 0.8503155479059094, + "mean_token_weighted_tv": 0.034516592244954264, + "aggregate_load_tv": 0.034136546184738964 + } + } + }, + "layer_18": { + "layer": 18, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "cfc53bfab8866d861ccfccd8ab4ca892166144e247e2b0f149150808efbf15fb", + "route_weight_sha256": "11857f95ac53549a678ebf0e7aadd32de6415845e97732b9925cc93ad1acf88d", + "loads": [ + 42, + 10, + 17, + 7, + 9, + 12, + 70, + 8, + 17, + 34, + 5, + 10, + 11, + 31, + 11, + 6, + 20, + 2, + 33, + 7, + 2, + 14, + 50, + 17, + 6, + 4, + 2, + 20, + 12, + 7, + 7, + 17, + 7, + 12, + 11, + 16, + 13, + 20, + 9, + 18, + 17, + 15, + 8, + 1, + 10, + 8, + 26, + 9, + 29, + 7, + 9, + 12, + 41, + 33, + 13, + 11, + 4, + 21, + 18, + 20, + 20, + 34, + 2, + 2 + ], + "weighted_loads": [ + 3.651173159480095, + 0.4242181293666363, + 0.8359630145132542, + 0.31188200786709785, + 1.1822137758135796, + 0.5244104564189911, + 11.624550582841039, + 0.6395415589213371, + 1.2230843361467123, + 2.605267746374011, + 0.23525523208081722, + 0.38043804466724396, + 0.6478570699691772, + 5.765204241499305, + 0.5885568298399448, + 0.16537085128948092, + 1.557514851912856, + 0.07632114738225937, + 2.260834438726306, + 0.46260004863142967, + 0.1667647361755371, + 0.8526916857808828, + 5.255593499168754, + 0.7319716867059469, + 0.1971318405121565, + 0.12368076294660568, + 0.045947713777422905, + 1.3881276044994593, + 0.8165415097028017, + 0.38484345376491547, + 0.3528927881270647, + 0.8845845963805914, + 0.6861275546252728, + 0.7148668169975281, + 0.666006613522768, + 1.1591687519103289, + 0.39926512725651264, + 0.6814576387405396, + 0.4570777229964733, + 0.64319889806211, + 0.7461626967415214, + 0.6454505622386932, + 0.28265578113496304, + 0.023998264223337173, + 0.41207914985716343, + 0.4193537663668394, + 2.4863422699272633, + 0.6758365035057068, + 1.2138571701943874, + 0.2539813034236431, + 0.3023892566561699, + 0.539908779785037, + 2.7825593072921038, + 1.8954761773347855, + 0.5810064859688282, + 0.6796437278389931, + 0.17080144211649895, + 1.3661407306790352, + 1.6825571991503239, + 1.198995826765895, + 0.7309440621174872, + 1.1452774945646524, + 0.0474079605191946, + 0.09205160290002823 + ], + "unique_experts": 64, + "load_cv": 0.8104791804802288, + "normalized_load_entropy": 0.9331533766200181, + "max_load_share": 0.07028112449799197 + }, + "full_input": { + "tokens": 191, + "top_k": 6, + "decisions": 1146, + "ordered_route_sha256": "4b8d2c557c199279a24b239001ab899dcf65e874b61e88a98f7cbc0db6cd23c9", + "route_weight_sha256": "0626f6078a6a3b21c86de7801df0a985050e567a1d4dfd08996c40538879f444", + "loads": [ + 49, + 11, + 29, + 7, + 9, + 14, + 70, + 8, + 25, + 34, + 6, + 14, + 11, + 31, + 16, + 10, + 20, + 2, + 52, + 7, + 2, + 15, + 50, + 17, + 6, + 4, + 2, + 20, + 12, + 7, + 15, + 17, + 7, + 12, + 11, + 19, + 14, + 23, + 9, + 20, + 23, + 15, + 11, + 1, + 10, + 8, + 35, + 9, + 32, + 19, + 12, + 14, + 50, + 42, + 13, + 11, + 6, + 21, + 19, + 23, + 20, + 39, + 2, + 4 + ], + "weighted_loads": [ + 4.071200912818313, + 0.49813102558255196, + 1.8766564596444368, + 0.31188200786709785, + 1.1822137758135796, + 0.577351775020361, + 11.624550582841039, + 0.6395415589213371, + 1.7103230450302362, + 2.605267746374011, + 0.24615463707596064, + 0.7639395073056221, + 0.6478570699691772, + 5.765204241499305, + 1.4890355411916971, + 0.29951429506763816, + 1.557514851912856, + 0.07632114738225937, + 3.3910900931805372, + 0.46260004863142967, + 0.1667647361755371, + 0.8770483899861574, + 5.255593499168754, + 0.7319716867059469, + 0.1971318405121565, + 0.12368076294660568, + 0.045947713777422905, + 1.3881276044994593, + 0.8165415097028017, + 0.38484345376491547, + 0.7047107815742493, + 0.8845845963805914, + 0.6861275546252728, + 0.7148668169975281, + 0.666006613522768, + 1.3265106473118067, + 0.4229370690882206, + 0.7861827872693539, + 0.4570777229964733, + 0.6909020636230707, + 0.9929328532889485, + 0.6454505622386932, + 0.3659077659249306, + 0.023998264223337173, + 0.41207914985716343, + 0.4193537663668394, + 4.140634596347809, + 0.6758365035057068, + 1.3606312982738018, + 0.778589490801096, + 0.38851049914956093, + 0.694210534915328, + 3.378934919834137, + 2.52012543566525, + 0.5810064859688282, + 0.6796437278389931, + 1.1689297370612621, + 1.3661407306790352, + 1.7115871980786324, + 1.3486274164170027, + 0.7309440621174872, + 1.2958791926503181, + 0.0474079605191946, + 0.177446860820055 + ], + "unique_experts": 64, + "load_cv": 0.7877933378661279, + "normalized_load_entropy": 0.9343536408196652, + "max_load_share": 0.06108202443280977 + } + }, + "s1_eos": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "3312c993bb46a90cf8476df1bab660e07261812a14e8ae3727e0e59580c23e83", + "route_weight_sha256": "2fd71b6d4a3aff7d08e10cc325b253cae6da10c6aa5566c27956c0543d5f901f", + "loads": [ + 42, + 12, + 18, + 6, + 9, + 12, + 69, + 8, + 18, + 32, + 3, + 9, + 12, + 32, + 11, + 7, + 22, + 3, + 33, + 6, + 2, + 14, + 49, + 18, + 6, + 2, + 3, + 20, + 12, + 8, + 5, + 16, + 7, + 14, + 11, + 14, + 13, + 18, + 9, + 17, + 19, + 16, + 8, + 1, + 15, + 8, + 26, + 9, + 26, + 7, + 9, + 12, + 41, + 33, + 13, + 11, + 4, + 21, + 18, + 20, + 20, + 33, + 2, + 2 + ], + "weighted_loads": [ + 3.635277921333909, + 0.49369431659579277, + 0.8211150094866753, + 0.2679269276559353, + 1.121124230325222, + 0.5100924354046583, + 11.311452514491975, + 0.6227888390421867, + 1.2216790355741978, + 2.5359034575521946, + 0.15790711157023907, + 0.357132276520133, + 0.7018562201410532, + 5.736985133960843, + 0.6085566133260727, + 0.2062312439084053, + 1.6132572833448648, + 0.10980933159589767, + 2.3226320911198854, + 0.4294920787215233, + 0.15889406576752663, + 0.8204190824180841, + 5.223411289975047, + 0.7648421693593264, + 0.192748311907053, + 0.05588492751121521, + 0.08937307633459568, + 1.3668267838656902, + 0.8069817889481783, + 0.39556797966361046, + 0.26530252397060394, + 0.8683276455849409, + 0.6845300607383251, + 0.7726239822804928, + 0.6390926018357277, + 1.0553024355322123, + 0.3882761802524328, + 0.645039476454258, + 0.46646053716540337, + 0.6138037787750363, + 0.833333620801568, + 0.6792051866650581, + 0.2739658039063215, + 0.024127855896949768, + 0.5678535476326942, + 0.4195261634886265, + 2.4022505544126034, + 0.6804135963320732, + 1.1308283098042011, + 0.25437602400779724, + 0.3011165913194418, + 0.5699076727032661, + 2.7713557612150908, + 1.8678630851209164, + 0.5635581463575363, + 0.6902792975306511, + 0.1696632131934166, + 1.3499629870057106, + 1.6625846326351166, + 1.198524259030819, + 0.7380724484100938, + 1.1367322746664286, + 0.047607943415641785, + 0.09262733347713947 + ], + "unique_experts": 64, + "load_cv": 0.7998221605206145, + "normalized_load_entropy": 0.9338115998617723, + "max_load_share": 0.06927710843373494 + }, + "full_input": { + "tokens": 207, + "top_k": 6, + "decisions": 1242, + "ordered_route_sha256": "2875c1bc35cc2ad5244e13f66f50667edbcc0ec15de94d55af744d76e1e31bf3", + "route_weight_sha256": "529de9fb8da7dcac490efd7c8f3e121f530d00635610ccc362e52576aff8853a", + "loads": [ + 49, + 15, + 31, + 6, + 10, + 14, + 70, + 10, + 28, + 34, + 4, + 13, + 12, + 33, + 20, + 9, + 22, + 12, + 57, + 7, + 2, + 15, + 49, + 18, + 6, + 2, + 3, + 20, + 12, + 9, + 16, + 18, + 9, + 15, + 15, + 29, + 14, + 24, + 10, + 20, + 24, + 16, + 11, + 7, + 15, + 8, + 44, + 13, + 29, + 21, + 11, + 14, + 50, + 46, + 15, + 12, + 7, + 26, + 20, + 24, + 20, + 37, + 2, + 8 + ], + "weighted_loads": [ + 4.029607625678182, + 0.6343063376843929, + 1.8917550388723612, + 0.2679269276559353, + 1.159665308892727, + 0.5674653425812721, + 11.340630057267845, + 0.6927375886589289, + 2.0767619237303734, + 2.597839083522558, + 0.16973376087844372, + 0.7020302768796682, + 0.7018562201410532, + 5.778015805408359, + 1.6995883844792843, + 0.26618930883705616, + 1.6132572833448648, + 0.6728480253368616, + 4.2064597848802805, + 0.5660340413451195, + 0.15889406576752663, + 0.847421558573842, + 5.223411289975047, + 0.7648421693593264, + 0.192748311907053, + 0.05588492751121521, + 0.08937307633459568, + 1.3668267838656902, + 0.8069817889481783, + 0.43279384076595306, + 0.8894166266545653, + 1.1135820876806974, + 0.773564524948597, + 0.8476492874324322, + 1.0592800229787827, + 2.356505624949932, + 0.411827152594924, + 0.9008164219558239, + 0.5023598745465279, + 0.6857312554493546, + 1.0205702502280474, + 0.6792051866650581, + 0.36352986469864845, + 0.5051245205104351, + 0.5678535476326942, + 0.4195261634886265, + 5.22917990013957, + 0.8590311445295811, + 1.2253019586205482, + 0.8552883062511683, + 0.35448983311653137, + 0.7258856073021889, + 3.3533901758491993, + 2.680811084806919, + 0.6861885152757168, + 0.725304339081049, + 1.1799806505441666, + 1.5794601831585169, + 1.9963696412742138, + 1.4715174697339535, + 0.7380724484100938, + 1.2724647540599108, + 0.047607943415641785, + 0.3358946871012449 + ], + "unique_experts": 64, + "load_cv": 0.7330395014785036, + "normalized_load_entropy": 0.9426399799140214, + "max_load_share": 0.05636070853462158 + } + }, + "s0_bos": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "a122e06eaf97e5c6bbc5fe78d751bfcae8754ac242b3610a083ba73327f2078d", + "route_weight_sha256": "be6e41eef27b3ce9be4dc6ae638b7ffca0cd1f44c16c7b46072f734a63adf09c", + "loads": [ + 43, + 10, + 19, + 6, + 8, + 13, + 70, + 8, + 18, + 31, + 3, + 9, + 10, + 31, + 11, + 7, + 21, + 2, + 32, + 6, + 2, + 14, + 48, + 16, + 10, + 4, + 4, + 22, + 12, + 6, + 7, + 16, + 7, + 15, + 15, + 15, + 12, + 18, + 8, + 17, + 17, + 16, + 9, + 1, + 12, + 8, + 27, + 8, + 25, + 7, + 8, + 11, + 42, + 35, + 14, + 11, + 5, + 22, + 18, + 20, + 15, + 33, + 4, + 2 + ], + "weighted_loads": [ + 3.83507233671844, + 0.4151998870074749, + 0.8997292350977659, + 0.2926811911165714, + 0.8756973631680012, + 0.5378794260323048, + 11.938158106990159, + 0.6399265490472317, + 1.295518685132265, + 2.5348460376262665, + 0.1590567696839571, + 0.3541887067258358, + 0.5788520351052284, + 5.82705594971776, + 0.6032242514193058, + 0.21998063381761312, + 1.6356234513223171, + 0.07706745713949203, + 2.3100202549248934, + 0.4304501283913851, + 0.17760094627738, + 0.7796521950513124, + 5.215870240703225, + 0.6875196732580662, + 0.3407452516257763, + 0.11499962396919727, + 0.10588540695607662, + 1.5085659511387348, + 0.8045097291469574, + 0.34487665817141533, + 0.32234975695610046, + 0.9144947528839111, + 0.6810941286385059, + 0.8209952302277088, + 0.7958068307489157, + 1.1588458195328712, + 0.37618694361299276, + 0.6566928401589394, + 0.3903660923242569, + 0.6539607550948858, + 0.7535026483237743, + 0.6702604293823242, + 0.32604715414345264, + 0.02401227131485939, + 0.4791540503501892, + 0.42015502229332924, + 2.4274144805967808, + 0.6397813074290752, + 1.1204393617808819, + 0.24364208988845348, + 0.258984399959445, + 0.5342730898410082, + 2.8348078057169914, + 2.0859862994402647, + 0.6151012610644102, + 0.6984420716762543, + 0.2058684229850769, + 1.4429053962230682, + 1.6625836193561554, + 1.2291178703308105, + 0.5754688121378422, + 1.102885304018855, + 0.09898589365184307, + 0.10028596222400665 + ], + "unique_experts": 64, + "load_cv": 0.7999834678377602, + "normalized_load_entropy": 0.9352886464840667, + "max_load_share": 0.07028112449799197 + }, + "full_input": { + "tokens": 191, + "top_k": 6, + "decisions": 1146, + "ordered_route_sha256": "a9ff7265de55fc3bcf8056fb0f19d9b49bb719f008a37d1fda4a441397fa6fb5", + "route_weight_sha256": "4eb88487ebaa00e1c15d340e8f1322296aed8fb62016cbddd14420df4fe8bd48", + "loads": [ + 50, + 11, + 30, + 6, + 8, + 14, + 70, + 8, + 26, + 31, + 3, + 12, + 12, + 31, + 16, + 10, + 21, + 2, + 52, + 6, + 2, + 15, + 48, + 17, + 10, + 4, + 5, + 22, + 12, + 6, + 13, + 16, + 7, + 16, + 15, + 19, + 12, + 21, + 8, + 22, + 23, + 17, + 13, + 1, + 12, + 8, + 37, + 8, + 28, + 18, + 9, + 13, + 51, + 43, + 14, + 11, + 6, + 22, + 19, + 22, + 15, + 39, + 4, + 4 + ], + "weighted_loads": [ + 4.255100090056658, + 0.4891127832233906, + 1.9139845110476017, + 0.2926811911165714, + 0.8756973631680012, + 0.5605298448354006, + 11.938158106990159, + 0.6399265490472317, + 1.782757394015789, + 2.5348460376262665, + 0.1590567696839571, + 0.577670119702816, + 0.8330296352505684, + 5.82705594971776, + 1.4611886870115995, + 0.3130086222663522, + 1.6356234513223171, + 0.07706745713949203, + 3.460707752034068, + 0.4304501283913851, + 0.17760094627738, + 0.804008899256587, + 5.215870240703225, + 0.7379112616181374, + 0.3407452516257763, + 0.11499962396919727, + 0.15538991056382656, + 1.5085659511387348, + 0.8045097291469574, + 0.34487665817141533, + 0.62109699472785, + 0.9144947528839111, + 0.6810941286385059, + 0.8863895423710346, + 0.7958068307489157, + 1.3752959556877613, + 0.37618694361299276, + 0.7572110407054424, + 0.3903660923242569, + 0.893722403794527, + 1.0690360032022, + 0.7329822778701782, + 0.4786476008594036, + 0.02401227131485939, + 0.4791540503501892, + 0.42015502229332924, + 4.078880880028009, + 0.6397813074290752, + 1.2672134898602962, + 0.7122921124100685, + 0.28532328084111214, + 0.6805910114198923, + 3.4311834182590246, + 2.648780694231391, + 0.6151012610644102, + 0.6984420716762543, + 0.42921799421310425, + 1.4429053962230682, + 1.6916136182844639, + 1.3335130251944065, + 0.5754688121378422, + 1.2781659439206123, + 0.09898589365184307, + 0.18568122014403343 + ], + "unique_experts": 64, + "load_cv": 0.785749360217994, + "normalized_load_entropy": 0.9351810208230309, + "max_load_share": 0.06108202443280977 + } + }, + "s1_bos": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "aef8e0eab08d18dc87ab8a4012989e39ce31373403418817c5dcd033a926efd1", + "route_weight_sha256": "4ac567e39ec84e5140d0df9adf71b66ef0e119a123045c824146384d6d28a7c9", + "loads": [ + 41, + 10, + 19, + 5, + 7, + 12, + 70, + 8, + 18, + 33, + 4, + 11, + 10, + 31, + 11, + 8, + 21, + 3, + 30, + 6, + 3, + 13, + 48, + 18, + 7, + 3, + 3, + 19, + 12, + 8, + 6, + 14, + 7, + 14, + 13, + 17, + 13, + 18, + 8, + 13, + 16, + 18, + 12, + 0, + 13, + 8, + 25, + 10, + 30, + 6, + 8, + 13, + 42, + 32, + 14, + 11, + 7, + 21, + 17, + 21, + 17, + 34, + 4, + 2 + ], + "weighted_loads": [ + 3.655729565769434, + 0.4169545490294695, + 0.89878249168396, + 0.24553381651639938, + 0.9244804531335831, + 0.519356956705451, + 11.602731442078948, + 0.6265193447470665, + 1.2632449343800545, + 2.6038634218275547, + 0.17528844624757767, + 0.3963389601558447, + 0.593749962747097, + 5.72790546528995, + 0.5659609101712704, + 0.24424553010612726, + 1.6169398538768291, + 0.09385363385081291, + 2.183023300021887, + 0.4467482194304466, + 0.19622004218399525, + 0.7827125824987888, + 5.2040098533034325, + 0.7591982781887054, + 0.25252524577081203, + 0.09693046845495701, + 0.08516653999686241, + 1.4247861206531525, + 0.8095707762986422, + 0.41539017111063004, + 0.30552762001752853, + 0.8767835609614849, + 0.7042324617505074, + 0.7684176601469517, + 0.7333556637167931, + 1.1874649655073881, + 0.3876131512224674, + 0.672415267676115, + 0.40337570384144783, + 0.5329387076199055, + 0.7169256843626499, + 0.7468192782253027, + 0.38877689419314265, + 0.0, + 0.5269672330468893, + 0.4159709792584181, + 2.2762085404247046, + 0.6911733541637659, + 1.2426219023764133, + 0.22146573476493359, + 0.2680437248200178, + 0.5983071681112051, + 2.836842056363821, + 1.8829698469489813, + 0.605928298085928, + 0.6890128701925278, + 0.2781127244234085, + 1.360789068043232, + 1.646680511534214, + 1.2812502961605787, + 0.6431985422968864, + 1.1474541146308184, + 0.09536498785018921, + 0.09666661731898785 + ], + "unique_experts": 63, + "load_cv": 0.793098974765732, + "normalized_load_entropy": 0.9359689488006241, + "max_load_share": 0.07028112449799197 + }, + "full_input": { + "tokens": 207, + "top_k": 6, + "decisions": 1242, + "ordered_route_sha256": "f9d242cf5eb4363104d47f9d39e6f5d4875897f8c27d615b9f700f475b7fc76d", + "route_weight_sha256": "ad4a875da3d58044af93852f44a6cd5a1b4b150a6fcc2595dabc1f910ab6f514", + "loads": [ + 48, + 14, + 30, + 5, + 8, + 14, + 71, + 10, + 28, + 35, + 4, + 15, + 10, + 32, + 20, + 10, + 21, + 12, + 55, + 7, + 3, + 14, + 48, + 19, + 7, + 3, + 3, + 19, + 12, + 9, + 16, + 16, + 9, + 15, + 17, + 31, + 13, + 24, + 9, + 15, + 22, + 19, + 16, + 6, + 13, + 8, + 44, + 14, + 33, + 20, + 9, + 15, + 51, + 45, + 16, + 12, + 9, + 26, + 19, + 25, + 17, + 40, + 4, + 8 + ], + "weighted_loads": [ + 4.050059270113707, + 0.5858141779899597, + 1.9066699091345072, + 0.24553381651639938, + 0.963021531701088, + 0.5767298638820648, + 11.631908984854817, + 0.6964680943638086, + 2.11832782253623, + 2.6657990477979183, + 0.17528844624757767, + 0.715404761955142, + 0.593749962747097, + 5.768936136737466, + 1.779319442808628, + 0.3091611349955201, + 1.6169398538768291, + 0.6568923275917768, + 4.141112167388201, + 0.5832901820540428, + 0.19622004218399525, + 0.8097150586545467, + 5.2040098533034325, + 0.7827092818915844, + 0.25252524577081203, + 0.09693046845495701, + 0.08516653999686241, + 1.4247861206531525, + 0.8095707762986422, + 0.45261603221297264, + 0.9002723302692175, + 1.1220380030572414, + 0.7902211863547564, + 0.8434429652988911, + 1.153543084859848, + 2.4752684999257326, + 0.3876131512224674, + 0.9207213930785656, + 0.4392750412225723, + 0.5806779321283102, + 0.9485141523182392, + 0.7891439814120531, + 0.5339287049137056, + 0.48099666461348534, + 0.5269672330468893, + 0.4159709792584181, + 5.046904286369681, + 0.8697909023612738, + 1.3370955511927605, + 0.8313874080777168, + 0.2943083308637142, + 0.7531418558210135, + 3.4188764709979296, + 2.658543663099408, + 0.7285586670041084, + 0.7240379117429256, + 0.5368754342198372, + 1.5902862641960382, + 1.9804655201733112, + 1.6301354710012674, + 0.6431985422968864, + 1.3500064872205257, + 0.09536498785018921, + 0.3399339709430933 + ], + "unique_experts": 64, + "load_cv": 0.7325299326085999, + "normalized_load_entropy": 0.9434911149308706, + "max_load_share": 0.0571658615136876 + } + }, + "s0_x": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "1c023e6e4ea54528d7d802bf2739e2fbdf5362b78c5521a0346d6b42991ac3c3", + "route_weight_sha256": "206205b9fea39cefa9c5ff10b7de94463a4c5b84613a5a1c2b249450838acb4e", + "loads": [ + 44, + 10, + 17, + 7, + 8, + 12, + 70, + 9, + 18, + 33, + 3, + 8, + 10, + 32, + 11, + 7, + 20, + 3, + 32, + 6, + 2, + 14, + 47, + 15, + 7, + 4, + 3, + 20, + 14, + 7, + 5, + 14, + 7, + 13, + 16, + 16, + 14, + 17, + 8, + 16, + 17, + 17, + 9, + 1, + 15, + 9, + 26, + 8, + 31, + 7, + 5, + 11, + 42, + 35, + 14, + 11, + 6, + 22, + 16, + 20, + 17, + 33, + 3, + 2 + ], + "weighted_loads": [ + 4.003050245344639, + 0.42647096142172813, + 0.856714079156518, + 0.32306598126888275, + 0.8146914876997471, + 0.5317495688796043, + 12.061661567538977, + 0.6772612817585468, + 1.271426873281598, + 2.5474209524691105, + 0.1482495404779911, + 0.31638842076063156, + 0.5919378139078617, + 5.8002672251313925, + 0.5639922991394997, + 0.20844706892967224, + 1.5782034806907177, + 0.09672320261597633, + 2.318139683455229, + 0.41233816742897034, + 0.1710159331560135, + 0.8266850933432579, + 5.186449494212866, + 0.6257460843771696, + 0.24854397028684616, + 0.1253950148820877, + 0.07621473260223866, + 1.4404740519821644, + 0.8654783815145493, + 0.36731167882680893, + 0.23007969185709953, + 0.8383960276842117, + 0.6798695549368858, + 0.7383994609117508, + 0.8414126895368099, + 1.1759285256266594, + 0.4254254698753357, + 0.6157767716795206, + 0.3877624683082104, + 0.6045944225043058, + 0.7000113939866424, + 0.7140975091606379, + 0.3140640538185835, + 0.023870322853326797, + 0.6011411584913731, + 0.4513172563165426, + 2.559522220864892, + 0.6476973444223404, + 1.2751890467479825, + 0.24805336073040962, + 0.1605459228157997, + 0.5416591614484787, + 2.835176872089505, + 2.1212363727390766, + 0.6210142467170954, + 0.7046447545289993, + 0.22567659057676792, + 1.4689935836941004, + 1.6332312915474176, + 1.1859121676534414, + 0.6508900988847017, + 1.130665535107255, + 0.07611236535012722, + 0.0902569591999054 + ], + "unique_experts": 64, + "load_cv": 0.8094437038434353, + "normalized_load_entropy": 0.9335658649175151, + "max_load_share": 0.07028112449799197 + }, + "full_input": { + "tokens": 191, + "top_k": 6, + "decisions": 1146, + "ordered_route_sha256": "cca1a674ccc5b43264594e521fa3e2a8edeffd35a1712823b4485e9f3ea8676f", + "route_weight_sha256": "985272d6530e54794b467486ffd791f75f3628d9cd37b1f5e7a4cf215b91839c", + "loads": [ + 52, + 11, + 30, + 7, + 8, + 13, + 70, + 9, + 26, + 33, + 3, + 12, + 11, + 32, + 16, + 9, + 20, + 3, + 51, + 6, + 2, + 16, + 47, + 15, + 7, + 4, + 3, + 20, + 14, + 7, + 12, + 14, + 8, + 14, + 16, + 19, + 14, + 20, + 8, + 19, + 22, + 17, + 11, + 1, + 15, + 9, + 35, + 8, + 35, + 19, + 7, + 14, + 52, + 44, + 14, + 11, + 7, + 22, + 19, + 21, + 17, + 37, + 3, + 5 + ], + "weighted_loads": [ + 4.463847549632192, + 0.5003838576376438, + 2.0816205888986588, + 0.32306598126888275, + 0.8146914876997471, + 0.5543999876827002, + 12.061661567538977, + 0.6772612817585468, + 1.758665582165122, + 2.5474209524691105, + 0.1482495404779911, + 0.6717254817485809, + 0.6393309272825718, + 5.8002672251313925, + 1.4911007564514875, + 0.27678804099559784, + 1.5782034806907177, + 0.09672320261597633, + 3.5671331509947777, + 0.41233816742897034, + 0.1710159331560135, + 0.8788101207464933, + 5.186449494212866, + 0.6257460843771696, + 0.24854397028684616, + 0.1253950148820877, + 0.07621473260223866, + 1.4404740519821644, + 0.8654783815145493, + 0.36731167882680893, + 0.5393696948885918, + 0.8383960276842117, + 0.7024261690676212, + 0.7829130999743938, + 0.8414126895368099, + 1.3841238990426064, + 0.4254254698753357, + 0.7161420863121748, + 0.3877624683082104, + 0.6773582324385643, + 0.9156092209741473, + 0.7140975091606379, + 0.37034500017762184, + 0.023870322853326797, + 0.6011411584913731, + 0.4513172563165426, + 4.2415299247950315, + 0.6476973444223404, + 1.4583620810881257, + 0.7570351287722588, + 0.21136298216879368, + 0.7251650504767895, + 3.531000532209873, + 2.73519803583622, + 0.6210142467170954, + 0.7046447545289993, + 0.44902616180479527, + 1.4689935836941004, + 1.7643715161830187, + 1.2228959295898676, + 0.6508900988847017, + 1.2567263469099998, + 0.07611236535012722, + 0.2569130249321461 + ], + "unique_experts": 64, + "load_cv": 0.7919270033330361, + "normalized_load_entropy": 0.9344086019330236, + "max_load_share": 0.06108202443280977 + } + }, + "s1_x": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "fbbea7e994bab124355a5e63159c3d128f4ba0151d6531b39bf317cbc78d4808", + "route_weight_sha256": "1145548cf875bf4c8e47fc2f87e09f1a9f3ee229c68ce5dd2b6c9cf3f2cff74c", + "loads": [ + 42, + 12, + 18, + 6, + 7, + 11, + 69, + 9, + 21, + 33, + 2, + 8, + 10, + 31, + 11, + 6, + 21, + 4, + 31, + 7, + 2, + 20, + 50, + 17, + 11, + 2, + 2, + 21, + 13, + 6, + 5, + 16, + 7, + 11, + 12, + 16, + 17, + 17, + 8, + 12, + 17, + 18, + 7, + 1, + 12, + 8, + 27, + 9, + 31, + 7, + 5, + 13, + 41, + 33, + 13, + 11, + 5, + 21, + 17, + 19, + 19, + 31, + 4, + 3 + ], + "weighted_loads": [ + 3.783013293519616, + 0.47710994631052017, + 0.8662938643246889, + 0.27334674447774887, + 0.8996505849063396, + 0.46510244347155094, + 12.002775736153126, + 0.6775098498910666, + 1.341968921944499, + 2.6128234677016735, + 0.10693771205842495, + 0.307596443220973, + 0.6142673976719379, + 5.797071281820536, + 0.5447249170392752, + 0.176964252255857, + 1.5688430927693844, + 0.13516619428992271, + 2.3430665396153927, + 0.4926388803869486, + 0.15165691450238228, + 1.101260606199503, + 5.232824448496103, + 0.7097339294850826, + 0.3774422649294138, + 0.07369095459580421, + 0.04690760746598244, + 1.5051501616835594, + 0.8289069682359695, + 0.3217431455850601, + 0.23798568546772003, + 0.9134968668222427, + 0.7124989368021488, + 0.6774741355329752, + 0.70768834464252, + 1.1934382040053606, + 0.5046627791598439, + 0.5915768872946501, + 0.4207552336156368, + 0.5096029043197632, + 0.7158549698069692, + 0.7471091095358133, + 0.25302352011203766, + 0.023363947868347168, + 0.484457528218627, + 0.40013542398810387, + 2.571061173453927, + 0.6534334346652031, + 1.3958276193588972, + 0.23638477362692356, + 0.15040392242372036, + 0.6125948429107666, + 2.847987439483404, + 1.958735577762127, + 0.5676692202687263, + 0.7225777432322502, + 0.2063777670264244, + 1.365171367302537, + 1.6533243861049414, + 1.1988279651850462, + 0.7168207801878452, + 1.0381295997649431, + 0.09378152154386044, + 0.11637175269424915 + ], + "unique_experts": 64, + "load_cv": 0.8062492806908258, + "normalized_load_entropy": 0.9329037748879833, + "max_load_share": 0.06927710843373494 + }, + "full_input": { + "tokens": 207, + "top_k": 6, + "decisions": 1242, + "ordered_route_sha256": "868bc6f426ca27926a0375bb3ee2ee93e4a32746f9b91bdb864443a2c15d0e10", + "route_weight_sha256": "86b59e19d52cbd80344cf69741473cc87e4c1a6a124e77520a96ea5b604f478e", + "loads": [ + 51, + 15, + 30, + 6, + 8, + 13, + 70, + 11, + 32, + 35, + 2, + 12, + 11, + 32, + 20, + 7, + 21, + 13, + 57, + 8, + 2, + 22, + 50, + 17, + 11, + 2, + 2, + 21, + 13, + 7, + 14, + 18, + 9, + 12, + 16, + 29, + 17, + 23, + 9, + 14, + 23, + 18, + 9, + 8, + 12, + 8, + 45, + 13, + 35, + 20, + 7, + 17, + 51, + 46, + 15, + 12, + 7, + 26, + 19, + 21, + 19, + 35, + 4, + 10 + ], + "weighted_loads": [ + 4.350104929879308, + 0.6177219673991203, + 1.9914548955857754, + 0.27334674447774887, + 0.9381916634738445, + 0.5224753506481647, + 12.031953278928995, + 0.7474585995078087, + 2.237913092598319, + 2.674759093672037, + 0.10693771205842495, + 0.5992145519703627, + 0.655855767428875, + 5.838101953268051, + 1.5551440138369799, + 0.21007124986499548, + 1.5688430927693844, + 0.6982048880308867, + 4.412961587309837, + 0.6291808430105448, + 0.15165691450238228, + 1.1547235995531082, + 5.232824448496103, + 0.7097339294850826, + 0.3774422649294138, + 0.07369095459580421, + 0.04690760746598244, + 1.5051501616835594, + 0.8289069682359695, + 0.3589690066874027, + 0.7448330577462912, + 1.1587513089179993, + 0.8048298917710781, + 0.7524994406849146, + 1.127875765785575, + 2.476113883778453, + 0.5046627791598439, + 0.8403926212340593, + 0.4566545709967613, + 0.5573421288281679, + 0.909476195462048, + 0.7471091095358133, + 0.3077612388879061, + 0.5603453814983368, + 0.484457528218627, + 0.40013542398810387, + 5.220509001985192, + 0.832050982862711, + 1.5267056282609701, + 0.7913759090006351, + 0.20531152747571468, + 0.866964902728796, + 3.5073256734758615, + 2.709732212126255, + 0.6902995891869068, + 0.7576027847826481, + 0.4651404768228531, + 1.5946685634553432, + 1.9871093947440386, + 1.3824058044701815, + 0.7168207801878452, + 1.165953490883112, + 0.09378152154386044, + 0.42594788782298565 + ], + "unique_experts": 64, + "load_cv": 0.7486087077826563, + "normalized_load_entropy": 0.9401847000108446, + "max_load_share": 0.05636070853462158 + } + }, + "s0_period": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "ddc27c65fe1421434c37d2259656b4942b383ff5581b6919d8de6c07075ff49f", + "route_weight_sha256": "8eabaed42a3674844f2a1552742e13766423a8ca9de33180ddd9bde352ebcd59", + "loads": [ + 43, + 10, + 16, + 4, + 8, + 13, + 70, + 9, + 20, + 34, + 2, + 10, + 10, + 32, + 11, + 8, + 20, + 4, + 32, + 6, + 2, + 17, + 48, + 13, + 8, + 4, + 3, + 21, + 13, + 7, + 5, + 14, + 7, + 14, + 15, + 14, + 12, + 17, + 8, + 18, + 17, + 15, + 8, + 1, + 14, + 9, + 27, + 8, + 30, + 7, + 9, + 11, + 42, + 36, + 15, + 11, + 3, + 22, + 17, + 20, + 15, + 32, + 3, + 2 + ], + "weighted_loads": [ + 4.0387609247118235, + 0.421682920306921, + 0.8368390128016472, + 0.21551212668418884, + 0.8312084637582302, + 0.5433989595621824, + 11.890871982090175, + 0.6855026669800282, + 1.3251054529100657, + 2.6373787820339203, + 0.11770061776041985, + 0.3618326969444752, + 0.5920034386217594, + 5.8042059652507305, + 0.5529629476368427, + 0.24902952555567026, + 1.5886248666793108, + 0.12814918905496597, + 2.3114096745848656, + 0.41576027125120163, + 0.1732691004872322, + 0.9546217303723097, + 5.255249839276075, + 0.5424235742539167, + 0.28228878416121006, + 0.12512818723917007, + 0.074958436191082, + 1.4755333811044693, + 0.8494231961667538, + 0.37348251417279243, + 0.23128040321171284, + 0.8511933498084545, + 0.6768359132111073, + 0.7710017096251249, + 0.8129431549459696, + 1.1269460450857878, + 0.35067880153656006, + 0.6073914673179388, + 0.391241867095232, + 0.6958113927394152, + 0.709720621816814, + 0.659016776829958, + 0.307028166949749, + 0.023643502965569496, + 0.5594951827079058, + 0.46140874177217484, + 2.6058651339262724, + 0.6513608507812023, + 1.2779883164912462, + 0.24623987823724747, + 0.3009720016270876, + 0.5290178526192904, + 2.8219772465527058, + 2.1814772337675095, + 0.6325896866619587, + 0.7176108807325363, + 0.13733871281147003, + 1.4561943896114826, + 1.6494221705943346, + 1.1909196246415377, + 0.5919723715633154, + 1.0685452474281192, + 0.07629642449319363, + 0.09226834401488304 + ], + "unique_experts": 64, + "load_cv": 0.8132604491702183, + "normalized_load_entropy": 0.9325923538118293, + "max_load_share": 0.07028112449799197 + }, + "full_input": { + "tokens": 191, + "top_k": 6, + "decisions": 1146, + "ordered_route_sha256": "be98d02f59b6b40217e75c2569b356be2cefb9645df111efa1b8ff2ba9e57b71", + "route_weight_sha256": "adbd911c4722f94d03d5ac6d60f38412ba47470d3e9ff71d7511a3705751ad4e", + "loads": [ + 51, + 11, + 27, + 4, + 8, + 15, + 70, + 9, + 28, + 34, + 2, + 14, + 10, + 32, + 16, + 11, + 20, + 4, + 52, + 6, + 2, + 20, + 48, + 13, + 8, + 4, + 3, + 21, + 13, + 7, + 11, + 15, + 7, + 15, + 15, + 17, + 12, + 20, + 8, + 21, + 22, + 15, + 10, + 1, + 14, + 9, + 37, + 8, + 33, + 19, + 12, + 13, + 52, + 46, + 15, + 11, + 4, + 23, + 19, + 21, + 15, + 36, + 3, + 4 + ], + "weighted_loads": [ + 4.507433123886585, + 0.4955958165228367, + 1.851094288751483, + 0.21551212668418884, + 0.8312084637582302, + 0.5908552072942257, + 11.890871982090175, + 0.6855026669800282, + 1.8123441617935896, + 2.6373787820339203, + 0.11770061776041985, + 0.6991059221327305, + 0.5920034386217594, + 5.8042059652507305, + 1.5548585448414087, + 0.36219847295433283, + 1.5886248666793108, + 0.12814918905496597, + 3.622406780719757, + 0.41576027125120163, + 0.1732691004872322, + 1.039043778553605, + 5.255249839276075, + 0.5424235742539167, + 0.28228878416121006, + 0.12512818723917007, + 0.074958436191082, + 1.4755333811044693, + 0.8494231961667538, + 0.37348251417279243, + 0.5050208289176226, + 0.8801712673157454, + 0.6768359132111073, + 0.813029820099473, + 0.8129431549459696, + 1.3244161363691092, + 0.35067880153656006, + 0.7050930205732584, + 0.391241867095232, + 0.7673753704875708, + 0.9352303398773074, + 0.659016776829958, + 0.36330911330878735, + 0.023643502965569496, + 0.5594951827079058, + 0.46140874177217484, + 4.460515232756734, + 0.6513608507812023, + 1.4247624445706606, + 0.7480371352285147, + 0.38406436517834663, + 0.6742094997316599, + 3.479573732241988, + 2.8774191699922085, + 0.6325896866619587, + 0.7176108807325363, + 0.3606882840394974, + 1.5100280307233334, + 1.71703159250319, + 1.2279033865779638, + 0.5919723715633154, + 1.1948496168479323, + 0.07629642449319363, + 0.17766360193490982 + ], + "unique_experts": 64, + "load_cv": 0.8009216386450515, + "normalized_load_entropy": 0.9323946803008974, + "max_load_share": 0.06108202443280977 + } + }, + "s1_period": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "e8187c82831470d3d491c70c0f4dfbc3da72e5c9be54e67ca813be93cf6c5369", + "route_weight_sha256": "025dace4139703af5d22908d3ddcf72eaee35dc0d8bc1fb202718c932cb246fb", + "loads": [ + 43, + 11, + 19, + 5, + 7, + 11, + 69, + 8, + 21, + 32, + 3, + 8, + 10, + 31, + 12, + 6, + 21, + 4, + 32, + 7, + 2, + 20, + 50, + 17, + 9, + 2, + 4, + 21, + 12, + 7, + 4, + 16, + 8, + 12, + 11, + 18, + 15, + 17, + 8, + 14, + 18, + 16, + 6, + 1, + 13, + 8, + 27, + 8, + 31, + 7, + 5, + 14, + 41, + 32, + 13, + 11, + 4, + 20, + 16, + 18, + 21, + 32, + 4, + 3 + ], + "weighted_loads": [ + 3.839441252872348, + 0.45804329961538315, + 0.9184617567807436, + 0.2559511438012123, + 0.9221365600824356, + 0.47159245796501637, + 11.912072023376822, + 0.6504059433937073, + 1.3303760271519423, + 2.632402114570141, + 0.1339732278138399, + 0.3079795204102993, + 0.6018086224794388, + 5.66299962811172, + 0.6021252274513245, + 0.17333225393667817, + 1.5727419052273035, + 0.13281236216425896, + 2.4301297795027494, + 0.4825030155479908, + 0.16077416017651558, + 1.0980186611413956, + 5.292762806639075, + 0.6783896051347256, + 0.3261104170233011, + 0.07098431885242462, + 0.11740719340741634, + 1.4893011804670095, + 0.8146276567131281, + 0.3790958300232887, + 0.19901620596647263, + 0.9212713968008757, + 0.7341227382421494, + 0.7060533668845892, + 0.6891484595835209, + 1.2752549480646849, + 0.4409216968342662, + 0.5908694975078106, + 0.4211118184030056, + 0.5629699360579252, + 0.7527533415704966, + 0.6812580320984125, + 0.21905289171263576, + 0.025857705622911453, + 0.5213734079152346, + 0.410083731636405, + 2.5474944841116667, + 0.6365502700209618, + 1.4007519483566284, + 0.23677446972578764, + 0.14187508821487427, + 0.6381124742329121, + 2.836759615689516, + 2.005563547834754, + 0.5802250318229198, + 0.7432508915662766, + 0.1713716723024845, + 1.353459071367979, + 1.6418767124414444, + 1.1458301190286875, + 0.7660733070224524, + 1.0789854787290096, + 0.09500417485833168, + 0.1159767247736454 + ], + "unique_experts": 64, + "load_cv": 0.8088855904596464, + "normalized_load_entropy": 0.9328079249889523, + "max_load_share": 0.06927710843373494 + }, + "full_input": { + "tokens": 207, + "top_k": 6, + "decisions": 1242, + "ordered_route_sha256": "99b4de65163fa7f9234163d8228b3ed462144ac66dfd20731c917870c652d1f2", + "route_weight_sha256": "6dfccbad5f1485e86e6d9ddc6d1f74d90b6dde232fe606ef5c68f3d1a8d871c1", + "loads": [ + 50, + 15, + 30, + 5, + 8, + 13, + 70, + 10, + 31, + 35, + 3, + 12, + 10, + 32, + 21, + 7, + 21, + 13, + 57, + 8, + 2, + 22, + 50, + 17, + 9, + 2, + 4, + 21, + 12, + 8, + 13, + 19, + 10, + 13, + 15, + 32, + 15, + 23, + 9, + 17, + 23, + 16, + 8, + 7, + 13, + 8, + 46, + 12, + 34, + 21, + 6, + 19, + 51, + 46, + 15, + 12, + 6, + 26, + 18, + 20, + 21, + 36, + 4, + 10 + ], + "weighted_loads": [ + 4.2337709572166204, + 0.6272362601011992, + 1.9263491742312908, + 0.2559511438012123, + 0.9606776386499405, + 0.5289653651416302, + 11.941249566152692, + 0.7203546930104494, + 2.185458915308118, + 2.7380287870764732, + 0.1339732278138399, + 0.6386714093387127, + 0.6018086224794388, + 5.704030299559236, + 1.7453226260840893, + 0.20643925154581666, + 1.5727419052273035, + 0.6958510559052229, + 4.4287511091679335, + 0.619044978171587, + 0.16077416017651558, + 1.1649650372564793, + 5.292762806639075, + 0.6783896051347256, + 0.3261104170233011, + 0.07098431885242462, + 0.11740719340741634, + 1.4893011804670095, + 0.8146276567131281, + 0.41632169112563133, + 0.7090590167790651, + 1.1938050333410501, + 0.8185667525976896, + 0.7810786720365286, + 1.1093358807265759, + 2.5822437275201082, + 0.4409216968342662, + 0.8421537727117538, + 0.4570111557841301, + 0.636937465518713, + 0.9264023676514626, + 0.6812580320984125, + 0.27379061048850417, + 0.5068543702363968, + 0.5213734079152346, + 0.410083731636405, + 5.29176845960319, + 0.8151678182184696, + 1.4952255971729755, + 0.836276532150805, + 0.16813969425857067, + 0.9506610967218876, + 3.478792479261756, + 2.8131499718874693, + 0.7028554007411003, + 0.7782759331166744, + 0.4301343820989132, + 1.6533908229321241, + 1.9756617210805416, + 1.3294079583138227, + 0.7660733070224524, + 1.2143724951893091, + 0.09500417485833168, + 0.394350852817297 + ], + "unique_experts": 64, + "load_cv": 0.7515955353311894, + "normalized_load_entropy": 0.9398723279855483, + "max_load_share": 0.05636070853462158 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 166, + "ordered_topk_exact_tokens": 100, + "set_exact_tokens": 121, + "mean_set_jaccard": 0.9225473321858864, + "mean_token_weighted_tv": 0.018352416473025657, + "aggregate_load_tv": 0.023092369477911642 + }, + "system_bos": { + "tokens": 166, + "ordered_topk_exact_tokens": 82, + "set_exact_tokens": 103, + "mean_set_jaccard": 0.8812392426850257, + "mean_token_weighted_tv": 0.02361019544376352, + "aggregate_load_tv": 0.03614457831325302 + }, + "system_x": { + "tokens": 166, + "ordered_topk_exact_tokens": 69, + "set_exact_tokens": 92, + "mean_set_jaccard": 0.8674698795180723, + "mean_token_weighted_tv": 0.028981543777241225, + "aggregate_load_tv": 0.040160642570281124 + }, + "system_period": { + "tokens": 166, + "ordered_topk_exact_tokens": 71, + "set_exact_tokens": 94, + "mean_set_jaccard": 0.8657487091222031, + "mean_token_weighted_tv": 0.02923055800766381, + "aggregate_load_tv": 0.046184738955823285 + }, + "bos_at_s0": { + "tokens": 166, + "ordered_topk_exact_tokens": 77, + "set_exact_tokens": 98, + "mean_set_jaccard": 0.8752151462994836, + "mean_token_weighted_tv": 0.02784125721474818, + "aggregate_load_tv": 0.03514056224899599 + }, + "bos_at_s1": { + "tokens": 166, + "ordered_topk_exact_tokens": 75, + "set_exact_tokens": 96, + "mean_set_jaccard": 0.8694779116465863, + "mean_token_weighted_tv": 0.027483898454839475, + "aggregate_load_tv": 0.037148594377510044 + }, + "x_at_s0": { + "tokens": 166, + "ordered_topk_exact_tokens": 80, + "set_exact_tokens": 98, + "mean_set_jaccard": 0.8706253585771657, + "mean_token_weighted_tv": 0.02933680288583399, + "aggregate_load_tv": 0.037148594377510044 + }, + "x_at_s1": { + "tokens": 166, + "ordered_topk_exact_tokens": 65, + "set_exact_tokens": 90, + "mean_set_jaccard": 0.8526965002868616, + "mean_token_weighted_tv": 0.03395733792693859, + "aggregate_load_tv": 0.04116465863453816 + }, + "period_at_s0": { + "tokens": 166, + "ordered_topk_exact_tokens": 77, + "set_exact_tokens": 92, + "mean_set_jaccard": 0.8613023522662078, + "mean_token_weighted_tv": 0.030252538385789795, + "aggregate_load_tv": 0.040160642570281124 + }, + "period_at_s1": { + "tokens": 166, + "ordered_topk_exact_tokens": 71, + "set_exact_tokens": 94, + "mean_set_jaccard": 0.8549913941480207, + "mean_token_weighted_tv": 0.03346732312375792, + "aggregate_load_tv": 0.039156626506024104 + } + } + }, + "layer_19": { + "layer": 19, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "15442cac09351fceb1e5cae897ab8376ad4d01a702cba6ae5e87938fcee3a102", + "route_weight_sha256": "82cb35b21a85862609483bbebc643885080bacd9c4a1ed33904f3281584cc7bc", + "loads": [ + 14, + 10, + 7, + 36, + 12, + 7, + 17, + 17, + 12, + 7, + 5, + 5, + 14, + 17, + 16, + 21, + 15, + 8, + 16, + 18, + 15, + 8, + 16, + 13, + 11, + 14, + 7, + 18, + 23, + 22, + 14, + 45, + 46, + 4, + 38, + 3, + 9, + 13, + 10, + 4, + 14, + 10, + 7, + 12, + 13, + 14, + 19, + 17, + 9, + 9, + 21, + 8, + 9, + 39, + 30, + 11, + 12, + 15, + 18, + 9, + 23, + 22, + 24, + 24 + ], + "weighted_loads": [ + 0.5299577340483665, + 0.43801360204815865, + 0.24342632293701172, + 5.189052473753691, + 0.7713702861219645, + 0.5441317781805992, + 0.8214664850383997, + 1.3217604029923677, + 0.5842639487236738, + 0.43176065757870674, + 0.13966563530266285, + 0.16774890571832657, + 0.806231539696455, + 0.5525239706039429, + 0.5688566192984581, + 0.8645991925150156, + 0.5152674540877342, + 1.549604382365942, + 1.1830222085118294, + 1.241179222241044, + 1.0668066032230854, + 0.5617075562477112, + 0.7416248042136431, + 0.43688721768558025, + 0.5537102166563272, + 1.9219297338277102, + 0.4142867084592581, + 0.6788427010178566, + 1.6207904014736414, + 0.8510409612208605, + 0.4517618529498577, + 4.223416855558753, + 2.930148249492049, + 0.18984145298600197, + 6.176545275375247, + 0.09031951054930687, + 0.3238473553210497, + 0.4408752769231796, + 1.0076573640108109, + 0.20514870807528496, + 0.5839887969195843, + 0.3805473241955042, + 0.6120812091976404, + 0.43679508939385414, + 1.1831994634121656, + 0.7129976265132427, + 0.8779208762571216, + 1.0104656629264355, + 0.3008355088531971, + 0.631141435354948, + 0.8099296800792217, + 0.2770803961902857, + 0.7288140058517456, + 5.029057385399938, + 1.313348876312375, + 0.6406535301357508, + 0.4016909506171942, + 0.8623217958956957, + 1.0925340931862593, + 0.4749079030007124, + 1.1031890697777271, + 1.2204947900027037, + 1.1093196775764227, + 5.268078111112118 + ], + "unique_experts": 64, + "load_cv": 0.5971794372461874, + "normalized_load_entropy": 0.962301459586584, + "max_load_share": 0.04618473895582329 + }, + "full_input": { + "tokens": 191, + "top_k": 6, + "decisions": 1146, + "ordered_route_sha256": "49b505fba392e4dd6ee2159cc55744f13f9ea98f32a985b6d0466eea55d9f971", + "route_weight_sha256": "972031c0c8b613e46608d76a42ec75107368747d908c6042fe70055c35bfdde7", + "loads": [ + 17, + 11, + 10, + 36, + 17, + 8, + 25, + 17, + 12, + 12, + 5, + 5, + 22, + 21, + 19, + 21, + 17, + 8, + 16, + 25, + 15, + 8, + 21, + 22, + 18, + 14, + 7, + 20, + 24, + 28, + 20, + 45, + 46, + 4, + 38, + 4, + 11, + 21, + 12, + 4, + 18, + 15, + 15, + 14, + 14, + 14, + 19, + 20, + 11, + 9, + 21, + 8, + 9, + 42, + 36, + 11, + 12, + 15, + 22, + 9, + 25, + 26, + 31, + 24 + ], + "weighted_loads": [ + 0.6150420205667615, + 0.5258023031055927, + 0.3290943596512079, + 5.189052473753691, + 1.749626275151968, + 0.5573090072721243, + 1.1701273936778307, + 1.3217604029923677, + 0.5842639487236738, + 0.6920880880206823, + 0.13966563530266285, + 0.16774890571832657, + 1.3109524510800838, + 0.7249027565121651, + 0.788832776248455, + 0.8645991925150156, + 0.5970382280647755, + 1.549604382365942, + 1.1830222085118294, + 1.5438101645559072, + 1.0668066032230854, + 0.5617075562477112, + 0.9171583522111177, + 0.7554733706638217, + 1.0248572616837919, + 1.9219297338277102, + 0.4142867084592581, + 0.7524517849087715, + 1.64609338901937, + 1.0733671076595783, + 0.6745247934013605, + 4.223416855558753, + 2.930148249492049, + 0.18984145298600197, + 6.176545275375247, + 0.14888666197657585, + 0.3664014474488795, + 0.8310984820127487, + 1.0842845812439919, + 0.20514870807528496, + 0.6756265447475016, + 0.7899863217025995, + 1.1908790674060583, + 0.5264473706483841, + 1.1939107421785593, + 0.7129976265132427, + 0.8779208762571216, + 1.2410314120352268, + 0.37012851797044277, + 0.631141435354948, + 0.8099296800792217, + 0.2770803961902857, + 0.7288140058517456, + 5.272161327302456, + 3.0435949079692364, + 0.6406535301357508, + 0.4016909506171942, + 0.8623217958956957, + 1.2927687168121338, + 0.4749079030007124, + 1.2088872492313385, + 1.4377313032746315, + 1.6481529511511326, + 5.268078111112118 + ], + "unique_experts": 64, + "load_cv": 0.5406151782988802, + "normalized_load_entropy": 0.966560664774751, + "max_load_share": 0.04013961605584642 + } + }, + "s1_eos": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "2369f09623e706181a7fcec93913f8a0d48bcda9a4e4f113550b79c4d1209ea1", + "route_weight_sha256": "cbcda8a8f0a82831f62d2e6cc7e6888c85caf8b2987bbcbd41520c8ae3e51154", + "loads": [ + 15, + 9, + 7, + 36, + 11, + 8, + 17, + 17, + 11, + 7, + 4, + 6, + 14, + 16, + 15, + 18, + 15, + 10, + 16, + 18, + 15, + 8, + 15, + 15, + 10, + 14, + 10, + 19, + 24, + 18, + 11, + 45, + 47, + 4, + 38, + 3, + 9, + 13, + 10, + 5, + 15, + 12, + 7, + 16, + 13, + 13, + 20, + 17, + 7, + 8, + 22, + 7, + 9, + 39, + 31, + 12, + 12, + 14, + 15, + 10, + 24, + 22, + 23, + 25 + ], + "weighted_loads": [ + 0.5589835159480572, + 0.38415518030524254, + 0.24985938519239426, + 5.197946632280946, + 0.7560913786292076, + 0.5940384268760681, + 0.7945871837437153, + 1.3094745613634586, + 0.5595514383167028, + 0.40490216948091984, + 0.11419794894754887, + 0.20090347155928612, + 0.8252690471708775, + 0.5128750689327717, + 0.5340431146323681, + 0.7468834258615971, + 0.5101529657840729, + 1.7160135246813297, + 1.159541206434369, + 1.2241638042032719, + 1.0552538335323334, + 0.5492674596607685, + 0.7050935458391905, + 0.5209347661584616, + 0.49512482807040215, + 1.9185412749648094, + 0.4849315397441387, + 0.7253574905917048, + 1.6254767067730427, + 0.6870549162849784, + 0.3664846755564213, + 4.223576724529266, + 2.9450870640575886, + 0.18559524416923523, + 6.1174911092966795, + 0.09178340248763561, + 0.32136422395706177, + 0.4328247345983982, + 0.9443569201976061, + 0.23111146315932274, + 0.6465811375528574, + 0.5191676318645477, + 0.598453750833869, + 0.5472496170550585, + 1.1836180035024881, + 0.6739714648574591, + 0.911010567098856, + 0.979683555662632, + 0.24687960743904114, + 0.5738064311444759, + 0.866042984649539, + 0.24550548195838928, + 0.707687109708786, + 4.957875095307827, + 1.3428675634786487, + 0.6833726819604635, + 0.4008310567587614, + 0.8315525595098734, + 1.003355821594596, + 0.5094266720116138, + 1.1062365882098675, + 1.2164685260504484, + 1.0842404924333096, + 5.0827755350619555 + ], + "unique_experts": 64, + "load_cv": 0.5994438372235203, + "normalized_load_entropy": 0.9624175627423645, + "max_load_share": 0.04718875502008032 + }, + "full_input": { + "tokens": 207, + "top_k": 6, + "decisions": 1242, + "ordered_route_sha256": "b7cd223921296924825f3a9b74655359ea905eac26855d2d2592b1670690595e", + "route_weight_sha256": "0a0db17049cd4374339b33e33a4ad40af8e7fece503e5ee058b67c934e497aba", + "loads": [ + 19, + 13, + 11, + 36, + 23, + 10, + 33, + 17, + 11, + 14, + 5, + 14, + 26, + 18, + 24, + 20, + 17, + 15, + 17, + 27, + 18, + 9, + 21, + 20, + 22, + 14, + 10, + 21, + 25, + 19, + 15, + 45, + 49, + 4, + 38, + 3, + 13, + 18, + 11, + 7, + 19, + 22, + 18, + 17, + 14, + 13, + 20, + 27, + 8, + 9, + 26, + 7, + 12, + 49, + 36, + 12, + 14, + 16, + 24, + 11, + 27, + 30, + 32, + 27 + ], + "weighted_loads": [ + 0.6590740028768778, + 0.6655353270471096, + 0.37282802909612656, + 5.197946632280946, + 2.389156987890601, + 0.683416498824954, + 1.5288272686302662, + 1.3094745613634586, + 0.5595514383167028, + 0.7107060831040144, + 0.18001159466803074, + 0.9612436220049858, + 1.4896526597440243, + 0.5926873199641705, + 1.148276224732399, + 0.8554040528833866, + 0.8539995178580284, + 1.9399720467627048, + 1.2583295498043299, + 1.6584836691617966, + 1.3600924089550972, + 0.6038476936519146, + 0.9364431034773588, + 0.6750490739941597, + 1.2819195035845041, + 1.9185412749648094, + 0.4849315397441387, + 0.8180603375658393, + 1.6618202216923237, + 0.7226939862594008, + 0.49066212959587574, + 4.223576724529266, + 3.0288810804486275, + 0.18559524416923523, + 6.1174911092966795, + 0.09178340248763561, + 0.44948543841019273, + 0.6630447562783957, + 0.988535987213254, + 0.3335617557168007, + 0.7430041022598743, + 1.1554552726447582, + 1.3741696290671825, + 0.5833867210894823, + 1.1943292822688818, + 0.6739714648574591, + 0.911010567098856, + 1.6276954375207424, + 0.2814980372786522, + 0.6211582943797112, + 1.1694300826638937, + 0.24550548195838928, + 0.8538579102605581, + 5.824814233928919, + 3.0547625115141273, + 0.6833726819604635, + 0.4816895667463541, + 0.9196823481470346, + 1.4629449769854546, + 0.5444711521267891, + 1.2424741014838219, + 1.5657257828861475, + 1.793489508330822, + 5.248361760750413 + ], + "unique_experts": 64, + "load_cv": 0.5181658315851491, + "normalized_load_entropy": 0.9692948197226569, + "max_load_share": 0.039452495974235106 + } + }, + "s0_bos": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "db4b4e1efeffc36a89e1558a4e82210e5e398e2d9bbb9e41749b6d0626bbe0ad", + "route_weight_sha256": "c64ded6d4d61d101e61adea34fa76051c13feefd2ed9fcbee5ca125a58938a7e", + "loads": [ + 15, + 11, + 9, + 37, + 15, + 7, + 16, + 18, + 11, + 6, + 5, + 8, + 12, + 16, + 16, + 19, + 15, + 7, + 18, + 19, + 14, + 8, + 15, + 11, + 12, + 15, + 5, + 14, + 22, + 23, + 14, + 45, + 48, + 4, + 39, + 2, + 10, + 14, + 11, + 4, + 13, + 11, + 9, + 12, + 15, + 14, + 18, + 18, + 8, + 8, + 20, + 9, + 9, + 37, + 30, + 13, + 11, + 13, + 15, + 9, + 20, + 22, + 27, + 25 + ], + "weighted_loads": [ + 0.5523856170475483, + 0.4954026825726032, + 0.32534969598054886, + 5.199530420824885, + 0.906021386384964, + 0.5879732575267553, + 0.807109359651804, + 1.406715288758278, + 0.559340039268136, + 0.3827264364808798, + 0.14789736457169056, + 0.24360783025622368, + 0.7295862473547459, + 0.5215853843837976, + 0.5694803353399038, + 0.8407456260174513, + 0.5188273368403316, + 1.2701390646398067, + 1.3016230538487434, + 1.2340396102517843, + 1.0678935870528221, + 0.5668515339493752, + 0.705670777708292, + 0.38431693241000175, + 0.5946424584835768, + 2.0015534311532974, + 0.3086688779294491, + 0.5288960309699178, + 1.630579050630331, + 0.8694377299398184, + 0.4453602246940136, + 4.29240794852376, + 3.0336358658969402, + 0.1867770552635193, + 6.241378171369433, + 0.059351399540901184, + 0.3640619367361069, + 0.5527765695005655, + 1.1047257967293262, + 0.18809828162193298, + 0.5267453286796808, + 0.4306232985109091, + 0.6796563547104597, + 0.4821573793888092, + 1.2909229584038258, + 0.7452270481735468, + 0.8424260141327977, + 1.0435614120215178, + 0.2806193735450506, + 0.5993457175791264, + 0.7916475981473923, + 0.3305743336677551, + 0.7450665012001991, + 5.195513689890504, + 1.3488416876643896, + 0.7028095554560423, + 0.37260071374475956, + 0.7800855208188295, + 1.0308795906603336, + 0.46574003994464874, + 0.9641649723052979, + 1.2034484650939703, + 1.2152705788612366, + 5.454183338209987 + ], + "unique_experts": 64, + "load_cv": 0.6024497978581883, + "normalized_load_entropy": 0.9619328237559176, + "max_load_share": 0.04819277108433735 + }, + "full_input": { + "tokens": 191, + "top_k": 6, + "decisions": 1146, + "ordered_route_sha256": "e3aec250ee348fce1f47b82ab74252099f5a6aa76ba7559a6756f70214a522e0", + "route_weight_sha256": "e54ef2904af81c1c26b3881c3839cb17303e7063cf64f2fa4c8d756a19cd4beb", + "loads": [ + 18, + 12, + 10, + 37, + 19, + 8, + 23, + 18, + 11, + 9, + 5, + 8, + 21, + 22, + 19, + 19, + 17, + 8, + 18, + 25, + 14, + 8, + 20, + 17, + 20, + 15, + 6, + 17, + 22, + 28, + 22, + 45, + 48, + 4, + 39, + 4, + 10, + 22, + 13, + 4, + 16, + 16, + 17, + 15, + 16, + 15, + 18, + 21, + 12, + 8, + 20, + 10, + 9, + 40, + 35, + 13, + 11, + 13, + 19, + 9, + 22, + 27, + 34, + 25 + ], + "weighted_loads": [ + 0.6572361756116152, + 0.5831913836300373, + 0.349929241463542, + 5.199530420824885, + 1.8010854739695787, + 0.6011504866182804, + 1.1167432144284248, + 1.406715288758278, + 0.559340039268136, + 0.5590411219745874, + 0.14789736457169056, + 0.24360783025622368, + 1.2684599980711937, + 0.7805538941174746, + 0.7931303065270185, + 0.8407456260174513, + 0.6005981108173728, + 2.002462174743414, + 1.3016230538487434, + 1.668175721541047, + 1.0678935870528221, + 0.5668515339493752, + 0.8812043257057667, + 0.6135753095149994, + 1.137735489755869, + 2.0015534311532974, + 0.3481666259467602, + 0.6517045507207513, + 1.630579050630331, + 1.064736945554614, + 0.7450489569455385, + 4.29240794852376, + 3.0336358658969402, + 0.1867770552635193, + 6.241378171369433, + 0.13872316479682922, + 0.3640619367361069, + 0.9183451924473047, + 1.1813530139625072, + 0.18809828162193298, + 0.6163910189643502, + 0.8054724652320147, + 1.2584542129188776, + 0.6046124920248985, + 1.3016342371702194, + 0.7731914687901735, + 0.8424260141327977, + 1.2791004236787558, + 0.4279341883957386, + 0.5993457175791264, + 0.7916475981473923, + 0.345562775619328, + 0.7450665012001991, + 5.408523326739669, + 2.1354009956121445, + 0.7028095554560423, + 0.37260071374475956, + 0.7800855208188295, + 1.2311142142862082, + 0.46574003994464874, + 1.0772989802062511, + 1.4491278734058142, + 1.7541038524359465, + 5.454183338209987 + ], + "unique_experts": 64, + "load_cv": 0.5415158383275929, + "normalized_load_entropy": 0.9668576102291926, + "max_load_share": 0.041884816753926704 + } + }, + "s1_bos": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "2235ae15126bcf73ed11a12403e810e6461d6955a9f44cc0045fb8a8b1077102", + "route_weight_sha256": "6a6097ce2cf99aa455b561dcf847c171d87b83fdd5a7937d0b44bcb6565a2063", + "loads": [ + 15, + 9, + 10, + 37, + 13, + 9, + 17, + 19, + 12, + 7, + 3, + 6, + 11, + 13, + 16, + 21, + 17, + 7, + 18, + 19, + 15, + 8, + 15, + 14, + 12, + 16, + 5, + 15, + 21, + 24, + 11, + 46, + 45, + 4, + 39, + 3, + 10, + 16, + 12, + 4, + 14, + 12, + 6, + 13, + 16, + 14, + 18, + 18, + 6, + 9, + 16, + 7, + 9, + 37, + 30, + 13, + 12, + 14, + 15, + 9, + 21, + 22, + 26, + 25 + ], + "weighted_loads": [ + 0.5716637019068003, + 0.4024585448205471, + 0.34293582290410995, + 5.0120130851864815, + 0.8260419629514217, + 0.675088070333004, + 0.8336721695959568, + 1.4544772896915674, + 0.5908937659114599, + 0.3993662688881159, + 0.07349550351500511, + 0.18691611476242542, + 0.691564192995429, + 0.4440331682562828, + 0.5704259369522333, + 0.8972689304500818, + 0.577570783905685, + 1.2973382733762264, + 1.2757154256105423, + 1.2848366312682629, + 1.0977309420704842, + 0.5683651566505432, + 0.7275622002780437, + 0.4717702753841877, + 0.6245728582143784, + 1.9984950255602598, + 0.34312717989087105, + 0.5723168849945068, + 1.5339908339083195, + 0.883826145902276, + 0.35738139785826206, + 4.230799365788698, + 2.926388556137681, + 0.18978755176067352, + 6.188828628510237, + 0.08821857161819935, + 0.3610423319041729, + 0.6232122797518969, + 1.0800685938447714, + 0.19710510596632957, + 0.5728359967470169, + 0.4591597951948643, + 0.5814178232103586, + 0.4959017001092434, + 1.3096714839339256, + 0.7550076153129339, + 0.8837322257459164, + 1.0314390733838081, + 0.2258719950914383, + 0.6730967052280903, + 0.6555386986583471, + 0.25243546813726425, + 0.7347011864185333, + 5.050502063706517, + 1.3978588432073593, + 0.7152563668787479, + 0.4046576078981161, + 0.7957359943538904, + 1.0334051623940468, + 0.4810573849827051, + 0.971953121945262, + 1.1969075202941895, + 1.1563411448150873, + 5.3543750289827585 + ], + "unique_experts": 64, + "load_cv": 0.6000892392360107, + "normalized_load_entropy": 0.9614827989585257, + "max_load_share": 0.04618473895582329 + }, + "full_input": { + "tokens": 207, + "top_k": 6, + "decisions": 1242, + "ordered_route_sha256": "786561dc3676668cd9018e83e63f63edb4641bf733c97a7c8d53b0324834ba33", + "route_weight_sha256": "05884fa51522e2bae01afd872cad69fe30d1e84934cadb3ae3effc0a558c80e4", + "loads": [ + 18, + 13, + 13, + 37, + 25, + 11, + 30, + 19, + 12, + 16, + 4, + 14, + 23, + 17, + 25, + 23, + 19, + 12, + 19, + 30, + 18, + 9, + 21, + 18, + 24, + 16, + 5, + 17, + 22, + 26, + 15, + 46, + 47, + 4, + 39, + 5, + 14, + 22, + 13, + 7, + 17, + 21, + 16, + 15, + 17, + 14, + 18, + 27, + 7, + 10, + 20, + 7, + 12, + 46, + 34, + 13, + 14, + 16, + 25, + 10, + 24, + 29, + 35, + 27 + ], + "weighted_loads": [ + 0.6539797186851501, + 0.6838386915624142, + 0.4364140573889017, + 5.0120130851864815, + 2.519682953134179, + 0.7644661422818899, + 1.4654380269348621, + 1.4544772896915674, + 0.5908937659114599, + 0.7977645713835955, + 0.13930914923548698, + 0.9472562652081251, + 1.3554409258067608, + 0.6004266627132893, + 1.1876139920204878, + 1.0057895574718714, + 0.9214173359796405, + 1.5212967954576015, + 1.374503768980503, + 2.000906404107809, + 1.402569517493248, + 0.6229453906416893, + 0.9589117579162121, + 0.615790955722332, + 1.4974039141088724, + 1.9984950255602598, + 0.34312717989087105, + 0.669128991663456, + 1.5703343488276005, + 0.9487847331911325, + 0.500221736729145, + 4.230799365788698, + 3.01018257252872, + 0.18978755176067352, + 6.188828628510237, + 0.1786989737302065, + 0.5204791314899921, + 0.8871778286993504, + 1.1242476608604193, + 0.3420157954096794, + 0.6622524345293641, + 1.0248059555888176, + 1.3252120167016983, + 0.56736646220088, + 1.3203827627003193, + 0.7550076153129339, + 0.8837322257459164, + 1.6312666945159435, + 0.26049042493104935, + 0.7204485684633255, + 0.9589257966727018, + 0.25243546813726425, + 0.8808719869703054, + 5.812503790482879, + 2.168187204748392, + 0.7152563668787479, + 0.4855161178857088, + 0.8838657829910517, + 1.5351297315210104, + 0.5161018650978804, + 1.1155121605843306, + 1.517662014812231, + 1.8655901607125998, + 5.519961254671216 + ], + "unique_experts": 64, + "load_cv": 0.509282013074258, + "normalized_load_entropy": 0.9699355792919967, + "max_load_share": 0.03784219001610306 + } + }, + "s0_x": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "699cc56563cea3d4cf364ecd15527fe143cd6407f35119b236d2c1ab537e6611", + "route_weight_sha256": "9d40dc995880dc3df2c7043bef1f8d29ae6d494ef1391cbfffa03b1d63ae9441", + "loads": [ + 14, + 11, + 9, + 37, + 16, + 8, + 16, + 20, + 11, + 4, + 6, + 4, + 11, + 15, + 18, + 20, + 16, + 7, + 14, + 19, + 14, + 8, + 15, + 14, + 10, + 15, + 5, + 15, + 22, + 19, + 10, + 45, + 49, + 4, + 38, + 2, + 7, + 16, + 10, + 4, + 14, + 9, + 8, + 16, + 13, + 15, + 22, + 18, + 9, + 8, + 19, + 8, + 9, + 37, + 29, + 13, + 11, + 14, + 15, + 12, + 23, + 22, + 28, + 26 + ], + "weighted_loads": [ + 0.5199434049427509, + 0.4943544417619705, + 0.3210972100496292, + 5.267762772738934, + 0.9455709792673588, + 0.5959881562739611, + 0.7948169764131308, + 1.4946728106588125, + 0.5602809619158506, + 0.32323201559484005, + 0.1555846519768238, + 0.1359398104250431, + 0.7219782285392284, + 0.5109835732728243, + 0.6480103489011526, + 0.8447223361581564, + 0.5543759893625975, + 1.1102605760097504, + 1.1470987554639578, + 1.2713567055761814, + 1.0766548328101635, + 0.5590315572917461, + 0.7137835267931223, + 0.4552296847105026, + 0.4412603247910738, + 1.9829135686159134, + 0.3266311436891556, + 0.5689459899440408, + 1.6407906264066696, + 0.7054423708468676, + 0.32002199813723564, + 4.229554008692503, + 3.0819187853485346, + 0.18568666279315948, + 6.203026438131928, + 0.061408717185258865, + 0.2827742323279381, + 0.5666125491261482, + 1.1011785976588726, + 0.19845304265618324, + 0.5749029628932476, + 0.33321361243724823, + 0.6503715626895428, + 0.5539003517478704, + 1.2408388704061508, + 0.7958880010992289, + 0.9956773901358247, + 1.0902076549828053, + 0.3137488942593336, + 0.6090106070041656, + 0.7487800307571888, + 0.3013365790247917, + 0.726175993680954, + 5.298791848123074, + 1.3422650080174208, + 0.7069458868354559, + 0.3651860598474741, + 0.8094323668628931, + 1.0173409450799227, + 0.5514441709965467, + 1.0629022400826216, + 1.1916017346084118, + 1.2500485181808472, + 5.491235686466098 + ], + "unique_experts": 64, + "load_cv": 0.6150612571072535, + "normalized_load_entropy": 0.9596244923947106, + "max_load_share": 0.04919678714859438 + }, + "full_input": { + "tokens": 191, + "top_k": 6, + "decisions": 1146, + "ordered_route_sha256": "296ffa6b1ca2c11fb865f691ad8698d8a2fb5d855da26ab207809d3ef4645ad5", + "route_weight_sha256": "0a648e08c4157ad63cb498edcd9a9a6f5ed2768d88e3db332722fd4aeec9b9df", + "loads": [ + 18, + 13, + 10, + 37, + 21, + 10, + 25, + 20, + 11, + 8, + 6, + 4, + 22, + 19, + 22, + 20, + 18, + 7, + 14, + 23, + 14, + 8, + 21, + 21, + 17, + 15, + 5, + 17, + 22, + 24, + 15, + 45, + 49, + 4, + 39, + 3, + 7, + 23, + 12, + 5, + 18, + 13, + 17, + 18, + 14, + 15, + 22, + 22, + 11, + 8, + 19, + 8, + 9, + 40, + 34, + 13, + 11, + 14, + 21, + 12, + 25, + 26, + 36, + 26 + ], + "weighted_loads": [ + 0.6718511246144772, + 0.6135174632072449, + 0.34567675553262234, + 5.267762772738934, + 1.9837577249854803, + 0.6992550939321518, + 1.195899797603488, + 1.4946728106588125, + 0.5602809619158506, + 0.5212935097515583, + 0.1555846519768238, + 0.1359398104250431, + 1.4307057838886976, + 0.6783146690577269, + 0.9126167688518763, + 0.8447223361581564, + 0.6361467633396387, + 1.1102605760097504, + 1.1470987554639578, + 1.4455873668193817, + 1.0766548328101635, + 0.5590315572917461, + 0.9371030945330858, + 0.7211258187890053, + 0.8215019404888153, + 1.9829135686159134, + 0.3266311436891556, + 0.6487748296931386, + 1.6407906264066696, + 0.9007415864616632, + 0.4930414538830519, + 4.229554008692503, + 3.0819187853485346, + 0.18568666279315948, + 6.24675721488893, + 0.11997586861252785, + 0.2827742323279381, + 0.8483439050614834, + 1.1778058148920536, + 0.23129171878099442, + 0.7199570974335074, + 0.6922947652637959, + 1.3842379078269005, + 0.6435526330024004, + 1.2515501491725445, + 0.7958880010992289, + 0.9956773901358247, + 1.404601614922285, + 0.3830419033765793, + 0.6090106070041656, + 0.7487800307571888, + 0.3013365790247917, + 0.726175993680954, + 5.512010455131531, + 2.1288243159651756, + 0.7069458868354559, + 0.3651860598474741, + 0.8094323668628931, + 1.2900122571736574, + 0.5514441709965467, + 1.1550243999809027, + 1.4088382478803396, + 1.8350199740380049, + 5.491235686466098 + ], + "unique_experts": 64, + "load_cv": 0.5554647855210743, + "normalized_load_entropy": 0.9645839273832559, + "max_load_share": 0.04275741710296684 + } + }, + "s1_x": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "a2fba395607b798376848493fb7780d372e22ab36c4f2a95f0d92daa5ffab038", + "route_weight_sha256": "3cf0c8179935393f2d73282f22cdfff0802f53ecfc438295a8399a400dc67cf6", + "loads": [ + 16, + 11, + 9, + 38, + 13, + 9, + 16, + 19, + 12, + 8, + 5, + 5, + 10, + 12, + 18, + 18, + 15, + 7, + 15, + 18, + 16, + 8, + 17, + 17, + 9, + 15, + 7, + 15, + 21, + 20, + 12, + 44, + 50, + 4, + 38, + 3, + 8, + 14, + 11, + 5, + 16, + 12, + 7, + 15, + 14, + 15, + 18, + 19, + 8, + 9, + 15, + 9, + 10, + 34, + 29, + 13, + 11, + 15, + 16, + 9, + 23, + 21, + 26, + 24 + ], + "weighted_loads": [ + 0.6103008594363928, + 0.5095782242715359, + 0.3288514167070389, + 5.177365746349096, + 0.8013489469885826, + 0.6412823796272278, + 0.7966200634837151, + 1.4220531471073627, + 0.5969608929008245, + 0.42617952078580856, + 0.14079049788415432, + 0.15356416068971157, + 0.730530047789216, + 0.4119847044348717, + 0.6562144514173269, + 0.7658162098377943, + 0.5282110776752234, + 1.5997801832854748, + 1.1585193686187267, + 1.1744401883333921, + 1.1705390606075525, + 0.562312263995409, + 0.7693954017013311, + 0.5510364873334765, + 0.4366042073816061, + 2.000751368701458, + 0.3885587081313133, + 0.567706735804677, + 1.4633055217564106, + 0.7588951047509909, + 0.36701567843556404, + 4.074834879487753, + 3.1359554398804903, + 0.18989144265651703, + 6.1732819229364395, + 0.09325712732970715, + 0.31167619302868843, + 0.46141536347568035, + 0.9772461634129286, + 0.2459963858127594, + 0.668659470975399, + 0.47026130370795727, + 0.5917125828564167, + 0.5120207667350769, + 1.2315135477110744, + 0.8142018560320139, + 0.8764782771468163, + 1.0824605580419302, + 0.2846803814172745, + 0.6280995197594166, + 0.623384078964591, + 0.3273541387170553, + 0.7334713637828827, + 5.200748270377517, + 1.351080657914281, + 0.7105443775653839, + 0.35559252463281155, + 0.85798772983253, + 1.0551452543586493, + 0.4632402341812849, + 1.0577057171612978, + 1.1788775119930506, + 1.2012927364557981, + 5.432489108294249 + ], + "unique_experts": 64, + "load_cv": 0.5912077642744371, + "normalized_load_entropy": 0.9637185498530598, + "max_load_share": 0.050200803212851405 + }, + "full_input": { + "tokens": 207, + "top_k": 6, + "decisions": 1242, + "ordered_route_sha256": "2907ac16acd98ce35e4d9b88bc19e06d8e9c22b1839fbb3b03be44293113cc68", + "route_weight_sha256": "223eb887f2e44cf6e1e33bf0a56700a437600c4ea9ec3167683a87d13c2aadc0", + "loads": [ + 19, + 16, + 12, + 38, + 25, + 12, + 30, + 19, + 12, + 14, + 6, + 13, + 23, + 14, + 28, + 20, + 17, + 13, + 16, + 25, + 19, + 9, + 24, + 21, + 18, + 15, + 7, + 17, + 22, + 21, + 15, + 44, + 53, + 4, + 39, + 3, + 11, + 20, + 12, + 7, + 19, + 21, + 18, + 18, + 15, + 15, + 18, + 31, + 9, + 10, + 19, + 9, + 13, + 44, + 33, + 13, + 13, + 17, + 26, + 10, + 25, + 31, + 36, + 26 + ], + "weighted_loads": [ + 0.7072711363434792, + 0.8360815867781639, + 0.42044989205896854, + 5.177365746349096, + 2.356859242543578, + 0.7783509511500597, + 1.426113847643137, + 1.4220531471073627, + 0.5969608929008245, + 0.7032723054289818, + 0.2066041436046362, + 0.9139043111354113, + 1.507325192913413, + 0.4841420240700245, + 1.3082320261746645, + 0.8743368368595839, + 0.8720576297491789, + 1.859257884323597, + 1.2573077119886875, + 1.508906738832593, + 1.4753776360303164, + 0.6168924979865551, + 1.034695377573371, + 0.6950571676716208, + 1.0446113012731075, + 2.000751368701458, + 0.3885587081313133, + 0.6775196436792612, + 1.4996490366756916, + 0.7945341747254133, + 0.46367606334388256, + 4.074834879487753, + 3.25542108155787, + 0.18989144265651703, + 6.2049320936203, + 0.09325712732970715, + 0.43587445840239525, + 0.7057146430015564, + 1.0214252304285765, + 0.34844667837023735, + 0.750450293533504, + 0.9767674226313829, + 1.5164545569568872, + 0.614408303052187, + 1.242224826477468, + 0.8142018560320139, + 0.8764782771468163, + 1.8314121197909117, + 0.31929881125688553, + 0.6754513829946518, + 0.9267711769789457, + 0.3273541387170553, + 0.8796421643346548, + 6.009996617212892, + 2.1214090194553137, + 0.7105443775653839, + 0.43645103462040424, + 0.9461175184696913, + 1.5469353757798672, + 0.49828471429646015, + 1.1568117197602987, + 1.6399954613298178, + 1.9984285701066256, + 5.598075333982706 + ], + "unique_experts": 64, + "load_cv": 0.5148725095948989, + "normalized_load_entropy": 0.9700350622353082, + "max_load_share": 0.0426731078904992 + } + }, + "s0_period": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "7a0f63a14bb49cef68ca4665c5da2721d055163babde60b414ce85e9709359d8", + "route_weight_sha256": "cdd370a83c01ad25ea69b5b94e313b65b5616400ea9cfec3671a344c10fccb88", + "loads": [ + 13, + 10, + 10, + 37, + 16, + 8, + 16, + 20, + 11, + 5, + 7, + 4, + 12, + 15, + 18, + 20, + 15, + 8, + 18, + 17, + 14, + 8, + 14, + 15, + 8, + 15, + 4, + 15, + 21, + 20, + 9, + 45, + 50, + 4, + 38, + 1, + 8, + 18, + 12, + 5, + 14, + 12, + 8, + 17, + 14, + 14, + 19, + 17, + 8, + 9, + 19, + 4, + 9, + 35, + 32, + 14, + 11, + 14, + 14, + 11, + 22, + 22, + 27, + 26 + ], + "weighted_loads": [ + 0.5025464724749327, + 0.4649722948670387, + 0.3448611944913864, + 5.2886211182922125, + 0.9406387079507113, + 0.5782374888658524, + 0.7980001475661993, + 1.5285172685980797, + 0.5587983913719654, + 0.3685568831861019, + 0.1918607484549284, + 0.13347601145505905, + 0.7516451012343168, + 0.5056046489626169, + 0.6571966130286455, + 0.8530214205384254, + 0.5246386956423521, + 1.1615776121616364, + 1.2869731336832047, + 1.2587161399424076, + 1.077934492379427, + 0.5703240856528282, + 0.676575418561697, + 0.45331777539104223, + 0.40020208805799484, + 1.9900933355093002, + 0.2713284566998482, + 0.5875177169218659, + 1.6116567514836788, + 0.7559619825333357, + 0.2930290251970291, + 4.227544313296676, + 3.109923504292965, + 0.18351257219910622, + 6.170444678515196, + 0.031239187344908714, + 0.327419551089406, + 0.6010746713727713, + 1.1545361652970314, + 0.25224466994404793, + 0.5652498323470354, + 0.4545711353421211, + 0.6595191117376089, + 0.5837101005017757, + 1.2967137657105923, + 0.753095468506217, + 0.9132698085159063, + 1.0212884675711393, + 0.2762892469763756, + 0.6635618023574352, + 0.7553479727357626, + 0.14165646769106388, + 0.7262443862855434, + 5.275504477322102, + 1.4607659224420786, + 0.7254241090267897, + 0.3701976966112852, + 0.8162028435617685, + 0.9690322075039148, + 0.5218455940485001, + 1.033446492627263, + 1.189370360225439, + 1.2269479762762785, + 5.3936545588076115 + ], + "unique_experts": 64, + "load_cv": 0.6162139903804634, + "normalized_load_entropy": 0.9591793512904828, + "max_load_share": 0.050200803212851405 + }, + "full_input": { + "tokens": 191, + "top_k": 6, + "decisions": 1146, + "ordered_route_sha256": "308b5b6dbb8cbedce21576b1116701802dd9f09c00a1267415f58b8c49991cab", + "route_weight_sha256": "12804d59690622ef6c7761f98b47787c0634ebf6f1c6d7ff0c96cacfcdeadeeb", + "loads": [ + 15, + 11, + 11, + 37, + 21, + 10, + 24, + 20, + 11, + 10, + 7, + 4, + 22, + 19, + 22, + 20, + 17, + 8, + 18, + 22, + 14, + 8, + 19, + 23, + 15, + 15, + 4, + 17, + 21, + 25, + 15, + 45, + 50, + 4, + 40, + 2, + 9, + 27, + 14, + 6, + 18, + 16, + 16, + 19, + 15, + 14, + 19, + 22, + 10, + 9, + 19, + 4, + 9, + 37, + 37, + 14, + 11, + 14, + 19, + 11, + 24, + 27, + 34, + 26 + ], + "weighted_loads": [ + 0.6004055645316839, + 0.5527609959244728, + 0.36944073997437954, + 5.2886211182922125, + 2.0035497434437275, + 0.6656861733645201, + 1.1446303930133581, + 1.5285172685980797, + 0.5587983913719654, + 0.6075820326805115, + 0.1918607484549284, + 0.13347601145505905, + 1.350799584761262, + 0.6676585134118795, + 0.9415879119187593, + 0.8530214205384254, + 0.6064094696193933, + 1.1615776121616364, + 1.2869731336832047, + 1.4655980840325356, + 1.077934492379427, + 0.5703240856528282, + 0.8521089665591717, + 0.7467998312786222, + 0.7875061798840761, + 1.9900933355093002, + 0.2713284566998482, + 0.6678392449393868, + 1.6116567514836788, + 0.9512611981481314, + 0.5220983680337667, + 4.227544313296676, + 3.109923504292965, + 0.18351257219910622, + 6.271421231329441, + 0.0898063387721777, + 0.3828573729842901, + 0.9684262480586767, + 1.2311633825302124, + 0.27817055955529213, + 0.7102709440514445, + 0.8080542869865894, + 1.2383169699460268, + 0.6733623817563057, + 1.307425044476986, + 0.753095468506217, + 0.9132698085159063, + 1.4047583062201738, + 0.34558225609362125, + 0.6635618023574352, + 0.7553479727357626, + 0.14165646769106388, + 0.7262443862855434, + 5.476993381977081, + 2.2473252303898335, + 0.7254241090267897, + 0.3701976966112852, + 0.8162028435617685, + 1.1976820174604654, + 0.5218455940485001, + 1.1292418707162142, + 1.4880579467862844, + 1.7657812498509884, + 5.3936545588076115 + ], + "unique_experts": 64, + "load_cv": 0.5568667160084017, + "normalized_load_entropy": 0.9642430956412054, + "max_load_share": 0.04363001745200698 + } + }, + "s1_period": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "66cfcfbeda981c88c5157b8ea2af4dafa0de55c4b57524c013a4376a3cfd59d9", + "route_weight_sha256": "e071067bcd7a5353e07494ab7667116b445b0f19559fc52e005751d3aac6893c", + "loads": [ + 16, + 11, + 9, + 38, + 15, + 9, + 14, + 19, + 11, + 6, + 5, + 5, + 11, + 13, + 17, + 17, + 17, + 6, + 17, + 18, + 16, + 8, + 17, + 16, + 8, + 16, + 7, + 15, + 21, + 22, + 11, + 45, + 50, + 4, + 38, + 2, + 8, + 17, + 10, + 4, + 18, + 13, + 6, + 12, + 14, + 15, + 19, + 19, + 5, + 9, + 19, + 8, + 9, + 36, + 29, + 13, + 10, + 14, + 15, + 9, + 24, + 21, + 26, + 24 + ], + "weighted_loads": [ + 0.6048748977482319, + 0.5117044262588024, + 0.32556432113051414, + 5.214357607066631, + 0.9102740064263344, + 0.6492613889276981, + 0.7138900775462389, + 1.4380140993744135, + 0.5636286269873381, + 0.363057266920805, + 0.14661706797778606, + 0.1547230016440153, + 0.7341770026832819, + 0.4348206948488951, + 0.627277260646224, + 0.7381968032568693, + 0.5907228589057922, + 1.530618131160736, + 1.2474144343286753, + 1.226086687296629, + 1.1489245295524597, + 0.5525784753262997, + 0.7813589721918106, + 0.5276060216128826, + 0.4150635451078415, + 2.025974038988352, + 0.3623872194439173, + 0.5628319075331092, + 1.5040190033614635, + 0.8250385746359825, + 0.3364867605268955, + 4.138766502961516, + 3.1361270993947983, + 0.18622155487537384, + 6.151317408308387, + 0.058847663924098015, + 0.31586328335106373, + 0.5602886863052845, + 0.9655263312160969, + 0.1871252991259098, + 0.7421171385794878, + 0.4963975101709366, + 0.5816738195717335, + 0.42714896239340305, + 1.2751992978155613, + 0.7833695113658905, + 0.9172595608979464, + 1.0961116142570972, + 0.17971245758235455, + 0.642922680824995, + 0.767770029604435, + 0.2898375540971756, + 0.7086855098605156, + 5.507505267858505, + 1.3768755532801151, + 0.7188584730029106, + 0.3227068167179823, + 0.8202781919389963, + 0.9808371476829052, + 0.45813683420419693, + 1.0680634565651417, + 1.176077175885439, + 1.194670770317316, + 5.307824656367302 + ], + "unique_experts": 64, + "load_cv": 0.6141165023038879, + "normalized_load_entropy": 0.9598845505484013, + "max_load_share": 0.050200803212851405 + }, + "full_input": { + "tokens": 207, + "top_k": 6, + "decisions": 1242, + "ordered_route_sha256": "c1d56e4ec773850488c88230a9d4b8b2fb4c5cf70e99329393f77d3d0b7a560b", + "route_weight_sha256": "24afd3614b54f45cc216038b89d2d8b109dbb85ea8c058d588a2d55799bbf87c", + "loads": [ + 19, + 15, + 12, + 38, + 27, + 12, + 26, + 19, + 11, + 12, + 6, + 13, + 23, + 14, + 29, + 19, + 19, + 11, + 18, + 27, + 19, + 9, + 23, + 20, + 17, + 16, + 7, + 17, + 22, + 23, + 14, + 45, + 53, + 4, + 39, + 2, + 11, + 21, + 11, + 7, + 22, + 22, + 17, + 14, + 15, + 15, + 19, + 32, + 6, + 10, + 23, + 8, + 12, + 47, + 33, + 13, + 12, + 16, + 24, + 10, + 28, + 32, + 36, + 26 + ], + "weighted_loads": [ + 0.6978976000100374, + 0.7930845730006695, + 0.41728793270885944, + 5.214357607066631, + 2.4889979269355536, + 0.7807404417544603, + 1.276730002835393, + 1.4380140993744135, + 0.5636286269873381, + 0.6441641263663769, + 0.21243071369826794, + 0.915063152089715, + 1.409727307036519, + 0.47346204333007336, + 1.331659346818924, + 0.8467174302786589, + 0.9345694109797478, + 1.7545766532421112, + 1.346202777698636, + 1.6388376764953136, + 1.4537631049752235, + 0.6071587093174458, + 1.012708529829979, + 0.6716267019510269, + 0.9999761078506708, + 2.025974038988352, + 0.3623872194439173, + 0.6713291807100177, + 1.5403625182807446, + 0.860677644610405, + 0.43314714543521404, + 4.138766502961516, + 3.257107648998499, + 0.18622155487537384, + 6.208689467981458, + 0.058847663924098015, + 0.44006154872477055, + 0.7074340078979731, + 1.0097053982317448, + 0.33601683005690575, + 0.8705487167462707, + 0.9992720261216164, + 1.3592644836753607, + 0.49443446658551693, + 1.285910576581955, + 0.7833695113658905, + 0.9172595608979464, + 1.9582148902118206, + 0.2143308874219656, + 0.6902745440602303, + 1.0711571276187897, + 0.2898375540971756, + 0.8548563104122877, + 6.413602229207754, + 2.147203914821148, + 0.7188584730029106, + 0.403565326705575, + 0.9084079805761576, + 1.4404263030737638, + 0.4931813143193722, + 1.2455284632742405, + 1.6783759891986847, + 1.9416696280241013, + 5.473410882055759 + ], + "unique_experts": 64, + "load_cv": 0.5376565388748198, + "normalized_load_entropy": 0.966951676482234, + "max_load_share": 0.0426731078904992 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 166, + "ordered_topk_exact_tokens": 91, + "set_exact_tokens": 108, + "mean_set_jaccard": 0.8978772231784279, + "mean_token_weighted_tv": 0.020937640971717346, + "aggregate_load_tv": 0.02811244979919679 + }, + "system_bos": { + "tokens": 166, + "ordered_topk_exact_tokens": 91, + "set_exact_tokens": 109, + "mean_set_jaccard": 0.8928571428571427, + "mean_token_weighted_tv": 0.022944814940712537, + "aggregate_load_tv": 0.031124497991967873 + }, + "system_x": { + "tokens": 166, + "ordered_topk_exact_tokens": 71, + "set_exact_tokens": 99, + "mean_set_jaccard": 0.8720596672403901, + "mean_token_weighted_tv": 0.02853045991835106, + "aggregate_load_tv": 0.040160642570281124 + }, + "system_period": { + "tokens": 166, + "ordered_topk_exact_tokens": 66, + "set_exact_tokens": 92, + "mean_set_jaccard": 0.8618760757314973, + "mean_token_weighted_tv": 0.029453162617240864, + "aggregate_load_tv": 0.04216867469879518 + }, + "bos_at_s0": { + "tokens": 166, + "ordered_topk_exact_tokens": 69, + "set_exact_tokens": 89, + "mean_set_jaccard": 0.8587205966724039, + "mean_token_weighted_tv": 0.029164619631616467, + "aggregate_load_tv": 0.037148594377510044 + }, + "bos_at_s1": { + "tokens": 166, + "ordered_topk_exact_tokens": 72, + "set_exact_tokens": 93, + "mean_set_jaccard": 0.8576305220883534, + "mean_token_weighted_tv": 0.029922592077763325, + "aggregate_load_tv": 0.047188755020080325 + }, + "x_at_s0": { + "tokens": 166, + "ordered_topk_exact_tokens": 76, + "set_exact_tokens": 98, + "mean_set_jaccard": 0.8664658634538153, + "mean_token_weighted_tv": 0.02859019814900695, + "aggregate_load_tv": 0.046184738955823285 + }, + "x_at_s1": { + "tokens": 166, + "ordered_topk_exact_tokens": 58, + "set_exact_tokens": 81, + "mean_set_jaccard": 0.8346815834767641, + "mean_token_weighted_tv": 0.03425773574566716, + "aggregate_load_tv": 0.04919678714859438 + }, + "period_at_s0": { + "tokens": 166, + "ordered_topk_exact_tokens": 65, + "set_exact_tokens": 90, + "mean_set_jaccard": 0.849110728628801, + "mean_token_weighted_tv": 0.0310015219168356, + "aggregate_load_tv": 0.05421686746987951 + }, + "period_at_s1": { + "tokens": 166, + "ordered_topk_exact_tokens": 53, + "set_exact_tokens": 86, + "mean_set_jaccard": 0.8407056798623065, + "mean_token_weighted_tv": 0.03377008503190724, + "aggregate_load_tv": 0.05220883534136546 + } + } + }, + "layer_20": { + "layer": 20, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "c4c8c4c971d9dd3a18b6045036a3214244cd12baf8862369071b6d2065160051", + "route_weight_sha256": "051179cadc92aa52df3d8b391e3e0968159715c9a73148abaaaa1ead2e4955d6", + "loads": [ + 14, + 9, + 27, + 22, + 17, + 6, + 39, + 24, + 28, + 9, + 6, + 10, + 34, + 13, + 22, + 13, + 7, + 16, + 13, + 22, + 1, + 20, + 23, + 12, + 9, + 39, + 19, + 27, + 13, + 14, + 7, + 5, + 10, + 18, + 15, + 2, + 24, + 5, + 17, + 2, + 30, + 10, + 6, + 19, + 10, + 6, + 12, + 22, + 14, + 9, + 36, + 14, + 21, + 12, + 22, + 20, + 26, + 8, + 23, + 7, + 25, + 5, + 2, + 4 + ], + "weighted_loads": [ + 0.5656210090965033, + 0.34084837324917316, + 2.012522291392088, + 1.5015335995703936, + 0.6816263739019632, + 0.22132864221930504, + 4.1408383045345545, + 1.1697156801819801, + 2.5042172744870186, + 0.522150594741106, + 0.3454838003963232, + 1.3972287401556969, + 4.266268651932478, + 1.0914985835552216, + 0.9804848115891218, + 0.5272697303444147, + 0.3310624845325947, + 1.1669983435422182, + 0.7001916561275721, + 2.1368886213749647, + 0.029460281133651733, + 1.1362963411957026, + 1.2721511702984571, + 0.8440229371190071, + 1.3413242027163506, + 2.5512469708919525, + 0.649583924561739, + 1.518193293362856, + 1.3796144891530275, + 0.5662662163376808, + 0.20667542330920696, + 0.14489407278597355, + 0.5239085424691439, + 0.8026176169514656, + 0.5715912487357855, + 0.1856270581483841, + 1.12970463745296, + 0.1568187940865755, + 0.5866025611758232, + 0.07926377840340137, + 1.289015505462885, + 0.3548159673810005, + 0.244083559140563, + 1.4310244340449572, + 0.6199760641902685, + 0.24890168383717537, + 0.9580599553883076, + 1.0287524871528149, + 0.4678480513393879, + 0.33848598785698414, + 3.7666742876172066, + 0.5830484386533499, + 0.7467810120433569, + 0.48647709749639034, + 0.9239168372005224, + 1.180479098111391, + 0.9171036221086979, + 0.2931134682148695, + 1.0327453911304474, + 0.3610486164689064, + 1.2599933799356222, + 0.18297741189599037, + 0.06679648905992508, + 0.1367482803761959 + ], + "unique_experts": 64, + "load_cv": 0.5950148542103973, + "normalized_load_entropy": 0.9562487446333618, + "max_load_share": 0.0391566265060241 + }, + "full_input": { + "tokens": 191, + "top_k": 6, + "decisions": 1146, + "ordered_route_sha256": "c3100b226021b6cde2ebf64ea537cc2c278a971ba30bbb6b9a198ed97641b238", + "route_weight_sha256": "6f73c1fcbe40a8ce7f65c3ba2fb50c697b45202ff777555bbac32423b70c3643", + "loads": [ + 14, + 11, + 27, + 30, + 25, + 11, + 43, + 29, + 28, + 9, + 6, + 11, + 38, + 13, + 22, + 19, + 9, + 16, + 23, + 22, + 6, + 20, + 30, + 12, + 9, + 47, + 20, + 27, + 13, + 15, + 7, + 5, + 10, + 19, + 16, + 2, + 26, + 7, + 19, + 3, + 33, + 12, + 8, + 23, + 18, + 6, + 12, + 23, + 16, + 10, + 44, + 14, + 21, + 19, + 22, + 23, + 27, + 12, + 24, + 7, + 37, + 9, + 3, + 4 + ], + "weighted_loads": [ + 0.5656210090965033, + 0.3855099696666002, + 2.012522291392088, + 2.0887321773916483, + 1.072063622996211, + 0.4507798831909895, + 4.251454180106521, + 1.5110465493053198, + 2.5042172744870186, + 0.522150594741106, + 0.3454838003963232, + 1.4444558955729008, + 4.394470965489745, + 1.0914985835552216, + 0.9804848115891218, + 0.9378081876784563, + 0.39627937600016594, + 1.1669983435422182, + 1.5858759600669146, + 2.1368886213749647, + 0.18851549620740116, + 1.1362963411957026, + 1.6468004528433084, + 0.8440229371190071, + 1.3413242027163506, + 3.1824121735990047, + 0.6670290417969227, + 1.518193293362856, + 1.3796144891530275, + 0.6016679853200912, + 0.20667542330920696, + 0.14489407278597355, + 0.5239085424691439, + 0.8256020452827215, + 0.618818299844861, + 0.1856270581483841, + 1.177023271098733, + 0.21573014184832573, + 1.9057685360312462, + 0.12127099372446537, + 1.432669933885336, + 0.43370751664042473, + 0.4246091153472662, + 1.5574727690545842, + 0.876390416175127, + 0.24890168383717537, + 0.9580599553883076, + 1.0753313191235065, + 0.5048724454827607, + 0.37664791755378246, + 4.802949253469706, + 0.5830484386533499, + 0.7467810120433569, + 0.8297987822443247, + 0.9239168372005224, + 1.5260196551680565, + 0.9777976907789707, + 0.41962010972201824, + 1.0617619529366493, + 0.3610486164689064, + 2.543207477312535, + 0.43261028453707695, + 0.10167751833796501, + 0.1367482803761959 + ], + "unique_experts": 64, + "load_cv": 0.58444944856156, + "normalized_load_entropy": 0.9591527619791242, + "max_load_share": 0.04101221640488656 + } + }, + "s1_eos": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "2132af31265753d5688dc38041545727e388b554185c4b8fa7a237ea413d9756", + "route_weight_sha256": "fa5967f5694edf93f4aa81c37b82018518ee9ed0833c7c8852f848e38d38c8ac", + "loads": [ + 12, + 11, + 28, + 21, + 19, + 6, + 39, + 21, + 26, + 8, + 6, + 11, + 35, + 14, + 21, + 14, + 8, + 16, + 13, + 21, + 1, + 21, + 24, + 12, + 10, + 40, + 19, + 24, + 13, + 14, + 4, + 5, + 10, + 18, + 18, + 2, + 23, + 6, + 16, + 2, + 29, + 8, + 6, + 18, + 9, + 6, + 13, + 24, + 15, + 10, + 36, + 14, + 21, + 11, + 22, + 17, + 27, + 9, + 24, + 7, + 24, + 9, + 2, + 3 + ], + "weighted_loads": [ + 0.49832911416888237, + 0.40040172822773457, + 2.048064796254039, + 1.4647313375025988, + 0.756716700270772, + 0.2266484647989273, + 4.127733523026109, + 1.042558465152979, + 2.4303283598273993, + 0.4622951354831457, + 0.357891246676445, + 1.4020146019756794, + 4.285769440233707, + 1.111317966133356, + 0.9441608935594559, + 0.6515802722424269, + 0.3768549617379904, + 1.154690632596612, + 0.6961469110101461, + 2.0624339766800404, + 0.02923593297600746, + 1.1496373116970062, + 1.2644154969602823, + 0.8402712233364582, + 1.3593939319252968, + 2.5797712225466967, + 0.6585947033017874, + 1.406958568841219, + 1.3612008560448885, + 0.5470297019928694, + 0.12481716275215149, + 0.15035340003669262, + 0.5328422207385302, + 0.7590848188847303, + 0.6725210286676884, + 0.18660749681293964, + 1.0949112344533205, + 0.1901234406977892, + 0.5545333847403526, + 0.07908890955150127, + 1.2702310308814049, + 0.2724874261766672, + 0.24598628841340542, + 1.376775762066245, + 0.5915255751460791, + 0.24422439746558666, + 1.002495437860489, + 1.1008708737790585, + 0.4938335884362459, + 0.3693447969853878, + 3.5591137390583754, + 0.5821607857942581, + 0.7479567099362612, + 0.458054855465889, + 0.9405628051608801, + 1.0666567776352167, + 0.9677074942737818, + 0.32637648843228817, + 1.0659023132175207, + 0.36359789222478867, + 1.2388016991317272, + 0.3019490037113428, + 0.07733600214123726, + 0.10262949578464031 + ], + "unique_experts": 64, + "load_cv": 0.59022482915071, + "normalized_load_entropy": 0.9568987138995829, + "max_load_share": 0.040160642570281124 + }, + "full_input": { + "tokens": 207, + "top_k": 6, + "decisions": 1242, + "ordered_route_sha256": "b8e10242aa48d722a1b55f8ca863cf5b01c69c2122f02d8abc04e30e7345a533", + "route_weight_sha256": "103a5109ea8712b664badf3677b066c0c8abc96f5f0b1aa74b1a5f10ef8e6719", + "loads": [ + 17, + 13, + 28, + 32, + 26, + 14, + 41, + 30, + 26, + 10, + 8, + 11, + 37, + 15, + 22, + 28, + 13, + 16, + 23, + 22, + 6, + 22, + 34, + 14, + 11, + 54, + 20, + 25, + 13, + 19, + 4, + 6, + 11, + 19, + 22, + 4, + 26, + 11, + 19, + 6, + 35, + 9, + 8, + 25, + 21, + 7, + 13, + 25, + 16, + 15, + 49, + 14, + 21, + 21, + 23, + 29, + 28, + 16, + 26, + 9, + 37, + 11, + 3, + 3 + ], + "weighted_loads": [ + 0.729841697961092, + 0.4445438552647829, + 2.048064796254039, + 2.217148656025529, + 1.119126921519637, + 0.5621743109077215, + 4.193086491897702, + 1.6508675757795572, + 2.4303283598273993, + 0.6949182283133268, + 0.4544331468641758, + 1.4020146019756794, + 4.353068133816123, + 1.394088540226221, + 1.0029447600245476, + 1.544461077079177, + 0.6823764219880104, + 1.154690632596612, + 1.680648835375905, + 2.0963343866169453, + 0.17514288215897977, + 1.1856337003409863, + 1.8532400447875261, + 1.0121938548982143, + 1.3795028701424599, + 3.547844784334302, + 0.6760398205369711, + 1.4422909505665302, + 1.3612008560448885, + 0.7133578099310398, + 0.12481716275215149, + 0.181727958843112, + 0.5800288263708353, + 0.8000161144882441, + 0.8652550615370274, + 0.364603815600276, + 1.1972009185701609, + 0.3728301003575325, + 1.9116024784743786, + 0.2762376759201288, + 1.5408487226814032, + 0.32230070419609547, + 0.4179422613233328, + 1.6416222895495594, + 1.3605318423360586, + 0.31729245744645596, + 1.002495437860489, + 1.1383568719029427, + 0.4955649784533307, + 0.674158126115799, + 5.243808856233954, + 0.5821607857942581, + 0.7479567099362612, + 0.8956660255789757, + 0.9726067241281271, + 2.142553424462676, + 1.0140745621174574, + 0.8629418313503265, + 1.1403242330998182, + 0.41668733954429626, + 2.687015329953283, + 0.4311692211776972, + 0.13778897002339363, + 0.10262949578464031 + ], + "unique_experts": 64, + "load_cv": 0.5572100733624499, + "normalized_load_entropy": 0.9629881774237337, + "max_load_share": 0.043478260869565216 + } + }, + "s0_bos": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "223d7634ca02ad4777881ccce619f4050e21018755c1570d9e52e61f6108abd7", + "route_weight_sha256": "d4662f4d922c02ceef358ce74f6ca4d38c56d0553ef52bb735857db8faa61b65", + "loads": [ + 13, + 10, + 27, + 21, + 15, + 6, + 39, + 24, + 29, + 8, + 5, + 9, + 34, + 11, + 21, + 13, + 10, + 16, + 14, + 23, + 1, + 22, + 24, + 14, + 10, + 40, + 22, + 23, + 14, + 14, + 6, + 4, + 11, + 18, + 19, + 2, + 25, + 4, + 16, + 2, + 28, + 10, + 6, + 20, + 11, + 6, + 13, + 22, + 13, + 12, + 37, + 14, + 18, + 10, + 20, + 17, + 26, + 7, + 23, + 7, + 25, + 6, + 2, + 4 + ], + "weighted_loads": [ + 0.5213906727731228, + 0.3738978337496519, + 2.006146304309368, + 1.517048254609108, + 0.5996628943830729, + 0.21218076162040234, + 4.166274067014456, + 1.1449339967221022, + 2.522183671593666, + 0.48625294864177704, + 0.31299385987222195, + 1.1007298529148102, + 4.35892403498292, + 1.0486593656241894, + 0.9443282000720501, + 0.5345953181385994, + 0.4479378052055836, + 1.198040409013629, + 0.763788215816021, + 2.3009520806372166, + 0.029039345681667328, + 1.179360169917345, + 1.3576265629380941, + 0.8887194506824017, + 1.4660514704883099, + 2.6862577628344297, + 0.7779915537685156, + 1.4267238210886717, + 1.4096269514411688, + 0.5497054662555456, + 0.18536600656807423, + 0.130885137245059, + 0.5560707785189152, + 0.7925329618155956, + 0.7064355909824371, + 0.18316307850182056, + 1.1325816437602043, + 0.12232440151274204, + 0.5623176526278257, + 0.07413540035486221, + 1.166779639199376, + 0.3602333590388298, + 0.24405504576861858, + 1.4876452535390854, + 0.6633232329040766, + 0.2615770734846592, + 0.8541888687759638, + 1.0733260866254568, + 0.44138041883707047, + 0.46260302886366844, + 3.7040163427591324, + 0.5955656133592129, + 0.6509991604834795, + 0.43088292330503464, + 0.8726470861583948, + 1.1182896681129932, + 0.9196410961449146, + 0.28303243964910507, + 1.024579158052802, + 0.3615475967526436, + 1.2606431022286415, + 0.19753750041127205, + 0.07808465138077736, + 0.12776572816073895 + ], + "unique_experts": 64, + "load_cv": 0.5959898894473077, + "normalized_load_entropy": 0.9560161021723467, + "max_load_share": 0.040160642570281124 + }, + "full_input": { + "tokens": 191, + "top_k": 6, + "decisions": 1146, + "ordered_route_sha256": "8bc0fa1eec5109d74b9f00ec0825dcc6039978e925daeb7a06edc1633b01229a", + "route_weight_sha256": "177f7dfba7f09b28a685403cf0514b65124aee7e6069926ff61c69e9405d9347", + "loads": [ + 13, + 11, + 27, + 29, + 23, + 11, + 43, + 29, + 29, + 8, + 5, + 10, + 38, + 11, + 22, + 20, + 12, + 16, + 24, + 23, + 5, + 22, + 33, + 14, + 10, + 47, + 25, + 23, + 14, + 15, + 7, + 5, + 11, + 19, + 21, + 2, + 27, + 6, + 17, + 3, + 31, + 12, + 8, + 24, + 19, + 6, + 14, + 23, + 14, + 12, + 45, + 14, + 18, + 16, + 20, + 20, + 26, + 11, + 25, + 7, + 36, + 9, + 2, + 4 + ], + "weighted_loads": [ + 0.5213906727731228, + 0.39804995618760586, + 2.006146304309368, + 2.1042468324303627, + 0.9901001434773207, + 0.430194441229105, + 4.276889942586422, + 1.4641818664968014, + 2.522183671593666, + 0.48625294864177704, + 0.31299385987222195, + 1.7817693650722504, + 4.4953810926526785, + 1.0486593656241894, + 0.9908993728458881, + 0.9853172041475773, + 0.5131546966731548, + 1.198040409013629, + 1.6494725197553635, + 2.3009520806372166, + 0.1925700195133686, + 1.179360169917345, + 1.8319188300520182, + 0.8887194506824017, + 1.4660514704883099, + 3.2484509740024805, + 0.8785167243331671, + 1.4267238210886717, + 1.4096269514411688, + 0.585107235237956, + 0.24323043040931225, + 0.1432048911228776, + 0.5560707785189152, + 0.8155173901468515, + 0.7788973692804575, + 0.18316307850182056, + 1.1799002774059772, + 0.18123574927449226, + 0.9270256292074919, + 0.11994021013379097, + 1.3124679811298847, + 0.417278372682631, + 0.429622745141387, + 1.6764078829437494, + 0.9197375848889351, + 0.2615770734846592, + 0.9997242633253336, + 1.0844816397875547, + 0.47676900401711464, + 0.46260302886366844, + 4.791099555790424, + 0.5955656133592129, + 0.6509991604834795, + 0.7407399024814367, + 0.8726470861583948, + 1.4595829024910927, + 0.9196410961449146, + 0.4095390811562538, + 1.1032707039266825, + 0.3615475967526436, + 2.5424909591674805, + 0.4263378977775574, + 0.07808465138077736, + 0.12776572816073895 + ], + "unique_experts": 64, + "load_cv": 0.5874434727468948, + "normalized_load_entropy": 0.9583723577257659, + "max_load_share": 0.04101221640488656 + } + }, + "s1_bos": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "40d7d2f83c3b010db34dad2bba9c8992fb335de7c76ee54e583423d58904b0a8", + "route_weight_sha256": "c44a6bbef2d56a5f50d8319d4dba24e74bdb3236fbcf2bd6ccb916870a2cc70c", + "loads": [ + 11, + 11, + 27, + 20, + 17, + 8, + 39, + 23, + 28, + 8, + 5, + 9, + 34, + 12, + 22, + 13, + 7, + 16, + 13, + 22, + 1, + 22, + 24, + 14, + 9, + 40, + 21, + 22, + 12, + 14, + 6, + 4, + 12, + 17, + 19, + 2, + 23, + 4, + 16, + 2, + 26, + 10, + 6, + 23, + 11, + 6, + 13, + 24, + 12, + 10, + 37, + 14, + 20, + 12, + 22, + 19, + 27, + 8, + 23, + 7, + 25, + 7, + 1, + 4 + ], + "weighted_loads": [ + 0.47117830254137516, + 0.3973670154809952, + 1.9918043110519648, + 1.486889824271202, + 0.6659231875091791, + 0.2641543988138437, + 4.162684690207243, + 1.0776371080428362, + 2.5124329458922148, + 0.48176234588027, + 0.3164205253124237, + 1.183183278888464, + 4.364354250952601, + 1.0601663030683994, + 0.9748469963669777, + 0.525203101336956, + 0.35950373113155365, + 1.1970947925001383, + 0.72591089643538, + 2.2420663237571716, + 0.03069528378546238, + 1.1861627157777548, + 1.33399311080575, + 0.8995136227458715, + 1.4090569838881493, + 2.6048880629241467, + 0.7450575847178698, + 1.378869317471981, + 1.3160349894315004, + 0.5518735740333796, + 0.18509957939386368, + 0.12385082989931107, + 0.6186433751136065, + 0.7851651348173618, + 0.733878156170249, + 0.1858825758099556, + 1.071698535233736, + 0.1163796205073595, + 0.5465871691703796, + 0.07609201222658157, + 1.108892098069191, + 0.3487635739147663, + 0.2412058264017105, + 1.5844968054443598, + 0.6594434753060341, + 0.2688702456653118, + 0.8800261225551367, + 1.1414485778659582, + 0.416907649487257, + 0.3805891331285238, + 3.6115223113447428, + 0.5837640166282654, + 0.7127552647143602, + 0.4901892617344856, + 0.9425738789141178, + 1.1208584755659103, + 0.97142737172544, + 0.29230933263897896, + 1.042821554467082, + 0.3606555797159672, + 1.2483151834458113, + 0.23236547596752644, + 0.04076695069670677, + 0.14280791580677032 + ], + "unique_experts": 64, + "load_cv": 0.5956650550373224, + "normalized_load_entropy": 0.9557200590247138, + "max_load_share": 0.040160642570281124 + }, + "full_input": { + "tokens": 207, + "top_k": 6, + "decisions": 1242, + "ordered_route_sha256": "a2ab625af685baae12cdaae6f0ed04e50bdd2d7d6af09a33a3996c118a8f0086", + "route_weight_sha256": "00f9d9acf74dca97c03d635d98c79fa8a56e196c8aece5d08ed9de00a7e00516", + "loads": [ + 15, + 12, + 27, + 31, + 24, + 17, + 41, + 32, + 28, + 10, + 7, + 9, + 36, + 13, + 23, + 28, + 12, + 16, + 23, + 23, + 6, + 23, + 35, + 16, + 10, + 54, + 23, + 23, + 12, + 18, + 6, + 5, + 13, + 17, + 23, + 4, + 26, + 10, + 18, + 8, + 31, + 13, + 8, + 29, + 23, + 7, + 13, + 24, + 12, + 15, + 50, + 14, + 20, + 23, + 23, + 30, + 29, + 15, + 24, + 9, + 37, + 10, + 2, + 4 + ], + "weighted_loads": [ + 0.6663282085210085, + 0.4215191379189491, + 1.9918043110519648, + 2.2393071427941322, + 1.0283334087580442, + 0.6686003431677818, + 4.228037659078836, + 1.6595999598503113, + 2.5124329458922148, + 0.7143854387104511, + 0.4129624255001545, + 1.183183278888464, + 4.431652944535017, + 1.3429368771612644, + 1.0336308628320694, + 1.4635075218975544, + 0.6650251913815737, + 1.1970947925001383, + 1.7104128208011389, + 2.2759667336940765, + 0.21599098108708858, + 1.2221591044217348, + 1.9703224413096905, + 1.0714362543076277, + 1.4291659221053123, + 3.551079962402582, + 0.809822691604495, + 1.4142016991972923, + 1.3160349894315004, + 0.6656022630631924, + 0.18509957939386368, + 0.15522538870573044, + 0.6658299807459116, + 0.7851651348173618, + 0.8832734283059835, + 0.36387889459729195, + 1.1739882193505764, + 0.3433656804263592, + 0.952648539096117, + 0.3640723302960396, + 1.3619084805250168, + 0.4831499680876732, + 0.4192344695329666, + 1.9047585744410753, + 1.4284497424960136, + 0.3419383056461811, + 0.8800261225551367, + 1.1414485778659582, + 0.416907649487257, + 0.7159985695034266, + 5.366874450817704, + 0.5837640166282654, + 0.7127552647143602, + 0.9791750777512789, + 0.9746177978813648, + 2.156474705785513, + 1.0567635279148817, + 0.8288746755570173, + 1.078963154926896, + 0.4137450270354748, + 2.6946616508066654, + 0.41643754579126835, + 0.10121991857886314, + 0.14280791580677032 + ], + "unique_experts": 64, + "load_cv": 0.560994635474869, + "normalized_load_entropy": 0.9626063646869302, + "max_load_share": 0.043478260869565216 + } + }, + "s0_x": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "75a638c94781b4ae07cc91b5d5b4b2a3b1667e841e05ea78e48b980e1ad03751", + "route_weight_sha256": "b70acd1f9c84100f96c25310163cb251ae02b883ff846db0ed50a0002cff9d91", + "loads": [ + 12, + 10, + 28, + 23, + 18, + 11, + 39, + 24, + 28, + 7, + 6, + 9, + 34, + 12, + 21, + 13, + 10, + 18, + 12, + 23, + 1, + 22, + 24, + 15, + 11, + 40, + 21, + 25, + 15, + 15, + 5, + 4, + 11, + 19, + 14, + 2, + 26, + 3, + 15, + 2, + 26, + 6, + 6, + 18, + 11, + 6, + 11, + 25, + 9, + 8, + 39, + 13, + 17, + 13, + 19, + 20, + 24, + 9, + 23, + 7, + 26, + 7, + 3, + 2 + ], + "weighted_loads": [ + 0.4976291637867689, + 0.3609925154596567, + 2.048182809725404, + 1.6031564865261316, + 0.7029944639652967, + 0.3744122385978699, + 4.187284175306559, + 1.1494856383651495, + 2.4885454159229994, + 0.455788929015398, + 0.33832298032939434, + 1.1081320904195309, + 4.334979895502329, + 1.090028554201126, + 0.9407104551792145, + 0.5175388306379318, + 0.49475764110684395, + 1.2582141291350126, + 0.7111579328775406, + 2.3424516580998898, + 0.027890315279364586, + 1.1843436751514673, + 1.3234033342450857, + 0.9213346820324659, + 1.5115053094923496, + 2.6312768030911684, + 0.7284243497997522, + 1.5041637755930424, + 1.4177559483796358, + 0.5823522694408894, + 0.1477038860321045, + 0.13488373346626759, + 0.5917026903480291, + 0.8376809936016798, + 0.5536748189479113, + 0.17604829743504524, + 1.191826406866312, + 0.09284141473472118, + 0.5200272016227245, + 0.07090752013027668, + 1.1643724236637354, + 0.2193713765591383, + 0.2511560991406441, + 1.3900449071079493, + 0.6583499684929848, + 0.2690415568649769, + 0.7991319634020329, + 1.1263439264148474, + 0.309021282941103, + 0.3138165771961212, + 3.905715635046363, + 0.5515711102634668, + 0.6188491471111774, + 0.5180995222181082, + 0.8557944037020206, + 1.1859998404979706, + 0.8349576964974403, + 0.3506418615579605, + 1.0277679841965437, + 0.3641268461942673, + 1.2612456977367401, + 0.22741073369979858, + 0.1204170510172844, + 0.07809032872319221 + ], + "unique_experts": 64, + "load_cv": 0.6073558652703314, + "normalized_load_entropy": 0.9543439978342448, + "max_load_share": 0.040160642570281124 + }, + "full_input": { + "tokens": 191, + "top_k": 6, + "decisions": 1146, + "ordered_route_sha256": "0ec63911f873a311c2d57bba0b5a7a4793c46ccd130e82dc937729aae454d34e", + "route_weight_sha256": "450ddbacf6e040d4af7986ed19e540e69c50333556c1c365463e79706cf4e8f5", + "loads": [ + 12, + 12, + 28, + 31, + 27, + 16, + 44, + 29, + 28, + 7, + 6, + 9, + 38, + 13, + 22, + 18, + 12, + 18, + 23, + 23, + 5, + 22, + 31, + 15, + 11, + 49, + 22, + 25, + 15, + 18, + 6, + 4, + 11, + 20, + 16, + 2, + 29, + 5, + 16, + 3, + 28, + 7, + 8, + 19, + 20, + 6, + 11, + 25, + 10, + 9, + 47, + 13, + 17, + 18, + 19, + 24, + 25, + 14, + 25, + 7, + 38, + 10, + 3, + 2 + ], + "weighted_loads": [ + 0.4976291637867689, + 0.4234274234622717, + 2.048182809725404, + 2.1903550643473864, + 1.2121034357696772, + 0.5453527942299843, + 4.335719399154186, + 1.4627299271523952, + 2.4885454159229994, + 0.455788929015398, + 0.33832298032939434, + 1.1081320904195309, + 4.509376233443618, + 1.117270015180111, + 0.9760759137570858, + 0.8511052280664444, + 0.5599745325744152, + 1.2582141291350126, + 1.6960201188921928, + 2.3424516580998898, + 0.19401340372860432, + 1.1843436751514673, + 1.685234485194087, + 0.9213346820324659, + 1.5115053094923496, + 3.2796006966382265, + 0.745869467034936, + 1.5041637755930424, + 1.4177559483796358, + 0.6829174291342497, + 0.20044293254613876, + 0.13488373346626759, + 0.5917026903480291, + 0.8606654219329357, + 0.621003232896328, + 0.17604829743504524, + 1.2745393365621567, + 0.1517527624964714, + 0.8847351782023907, + 0.1328157726675272, + 1.261594070121646, + 0.262072516605258, + 0.43307215720415115, + 1.4266163352876902, + 0.9617035295814276, + 0.2690415568649769, + 0.7991319634020329, + 1.1263439264148474, + 0.34440986812114716, + 0.3528713695704937, + 5.016014905646443, + 0.5515711102634668, + 0.6188491471111774, + 0.7815653048455715, + 0.8557944037020206, + 1.5684103444218636, + 0.878940287977457, + 0.5343576557934284, + 1.092072507366538, + 0.3641268461942673, + 2.730970598757267, + 0.45874330028891563, + 0.1204170510172844, + 0.07809032872319221 + ], + "unique_experts": 64, + "load_cv": 0.6090300367915602, + "normalized_load_entropy": 0.9553856492863275, + "max_load_share": 0.04275741710296684 + } + }, + "s1_x": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "500ac6429c998a3445ce343c67f44b244f4a329d4334de96798e80458b0dfc2d", + "route_weight_sha256": "b33904dc825392fa7b94bc287ed1c6f1b0c88644215546525cdd22e04c9c761c", + "loads": [ + 9, + 10, + 24, + 23, + 19, + 11, + 40, + 23, + 30, + 9, + 5, + 10, + 34, + 12, + 20, + 12, + 9, + 18, + 12, + 23, + 3, + 20, + 24, + 14, + 8, + 40, + 16, + 25, + 13, + 12, + 10, + 5, + 10, + 18, + 15, + 1, + 23, + 5, + 14, + 1, + 27, + 10, + 6, + 20, + 11, + 6, + 13, + 28, + 11, + 9, + 39, + 16, + 16, + 13, + 22, + 17, + 27, + 9, + 23, + 7, + 24, + 7, + 3, + 2 + ], + "weighted_loads": [ + 0.3904105480760336, + 0.3860037960112095, + 1.8864827491343021, + 1.5967231299728155, + 0.7940579671412706, + 0.41121960058808327, + 4.193310812115669, + 1.1139146368950605, + 2.5336546152830124, + 0.5057111606001854, + 0.315844401717186, + 1.2952903248369694, + 4.2839641366153955, + 1.113155722618103, + 0.8821596298366785, + 0.5807722993195057, + 0.4501328859478235, + 1.2486831080168486, + 0.6978298891335726, + 2.209246451035142, + 0.09038441441953182, + 1.1416260916739702, + 1.3363940697163343, + 0.8828200679272413, + 1.3233107700943947, + 2.431562790647149, + 0.581381868571043, + 1.4497363567352295, + 1.3679456729441881, + 0.447799863293767, + 0.29418428242206573, + 0.15669795125722885, + 0.5726846419274807, + 0.7996310014277697, + 0.6192595586180687, + 0.16128332912921906, + 1.079135987907648, + 0.16461165808141232, + 0.49306218698620796, + 0.04465818777680397, + 1.186407620087266, + 0.3565346896648407, + 0.24432779289782047, + 1.4714251551777124, + 0.6782949157059193, + 0.2704649083316326, + 0.9387536067515612, + 1.2391998618841171, + 0.3738744892179966, + 0.3354544974863529, + 3.799899037927389, + 0.6494670379906893, + 0.6102827787399292, + 0.5457605998963118, + 0.9264453761279583, + 1.0368528049439192, + 0.9476026780903339, + 0.3327178880572319, + 1.0460178218781948, + 0.36617838963866234, + 1.221226442605257, + 0.22950943186879158, + 0.13289199769496918, + 0.06580542773008347 + ], + "unique_experts": 64, + "load_cv": 0.5993362026511712, + "normalized_load_entropy": 0.956391438468877, + "max_load_share": 0.040160642570281124 + }, + "full_input": { + "tokens": 207, + "top_k": 6, + "decisions": 1242, + "ordered_route_sha256": "ef86a7131bb76247e9c8ccb20084c1ec7fb4253f1d4b90f85856f5c9289fefed", + "route_weight_sha256": "77df4f2766772f6e4fbb29a489e34bd23cb5bee86cdc7503fc461c6695024555", + "loads": [ + 13, + 11, + 24, + 35, + 28, + 20, + 43, + 32, + 30, + 11, + 7, + 10, + 37, + 13, + 22, + 26, + 15, + 18, + 23, + 24, + 7, + 21, + 34, + 16, + 10, + 55, + 17, + 27, + 13, + 16, + 10, + 7, + 11, + 18, + 17, + 3, + 26, + 11, + 16, + 5, + 32, + 11, + 8, + 24, + 24, + 7, + 13, + 28, + 11, + 13, + 52, + 16, + 16, + 23, + 23, + 28, + 29, + 17, + 24, + 9, + 37, + 9, + 4, + 2 + ], + "weighted_loads": [ + 0.5855604540556669, + 0.41015591844916344, + 1.8864827491343021, + 2.3828857224434614, + 1.2981585320085287, + 0.79504737816751, + 4.297329891473055, + 1.6494809873402119, + 2.5336546152830124, + 0.7383342534303665, + 0.41238630190491676, + 1.2952903248369694, + 4.3999840803444386, + 1.395926296710968, + 0.9842703994363546, + 1.4473741240799427, + 0.8891521953046322, + 1.2486831080168486, + 1.7923683729022741, + 2.243146860972047, + 0.23979716934263706, + 1.1776224803179502, + 1.9034135844558477, + 1.0547426994889975, + 1.3808517716825008, + 3.3863181229680777, + 0.5988269858062267, + 1.5202074274420738, + 1.3679456729441881, + 0.5615285523235798, + 0.29418428242206573, + 0.2197965309023857, + 0.6198712475597858, + 0.7996310014277697, + 0.6904223896563053, + 0.3392796479165554, + 1.1814256720244884, + 0.3855357691645622, + 0.8991235569119453, + 0.24180695414543152, + 1.4212259892374277, + 0.40634796768426895, + 0.3961153123527765, + 1.6562173571437597, + 1.4928120337426662, + 0.3435329683125019, + 0.9387536067515612, + 1.2391998618841171, + 0.3738744892179966, + 0.5738551691174507, + 5.528579540550709, + 0.6494670379906893, + 0.6102827787399292, + 0.9770901128649712, + 0.9584892950952053, + 2.081580499187112, + 1.0388661362230778, + 0.9167056288570166, + 1.0821594223380089, + 0.41926783695816994, + 2.7605829555541277, + 0.3656116984784603, + 0.19334496557712555, + 0.06580542773008347 + ], + "unique_experts": 64, + "load_cv": 0.5752354588959772, + "normalized_load_entropy": 0.9614295362627941, + "max_load_share": 0.04428341384863124 + } + }, + "s0_period": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "36e64a85133d5a51e4a3627cf53f144560d4d38740669a7c0474d236941795d3", + "route_weight_sha256": "f2be33ae84029077d9c3c6f745a3c0097051536e10c196f87319a337053c2029", + "loads": [ + 11, + 10, + 28, + 21, + 18, + 10, + 39, + 20, + 28, + 8, + 6, + 9, + 34, + 12, + 21, + 14, + 12, + 18, + 12, + 24, + 2, + 21, + 24, + 15, + 10, + 40, + 20, + 27, + 13, + 13, + 7, + 5, + 11, + 19, + 15, + 2, + 25, + 5, + 11, + 2, + 28, + 9, + 5, + 18, + 10, + 6, + 12, + 25, + 11, + 10, + 40, + 14, + 18, + 10, + 20, + 20, + 24, + 8, + 21, + 7, + 25, + 9, + 1, + 3 + ], + "weighted_loads": [ + 0.462680384516716, + 0.3652038350701332, + 2.084794720634818, + 1.552736733108759, + 0.7014838177710772, + 0.34755005687475204, + 4.182971702888608, + 1.0411307606846094, + 2.46756661683321, + 0.4831519555300474, + 0.33866515196859837, + 1.0747662112116814, + 4.331268837675452, + 1.0620006211102009, + 0.953973937779665, + 0.5520458668470383, + 0.545101223513484, + 1.2476617768406868, + 0.710922971367836, + 2.386005237698555, + 0.05562571994960308, + 1.16301148571074, + 1.329514842480421, + 0.9160260744392872, + 1.4686313346028328, + 2.635814867913723, + 0.6831401810050011, + 1.5595702659338713, + 1.3579229433089495, + 0.5207872502505779, + 0.21327505819499493, + 0.16768606007099152, + 0.615604305639863, + 0.8124265074729919, + 0.5807411186397076, + 0.17309795320034027, + 1.1534428857266903, + 0.15630128979682922, + 0.41425731033086777, + 0.07042818889021873, + 1.2274889629334211, + 0.32924182899296284, + 0.22186937555670738, + 1.3895293641835451, + 0.6436837147921324, + 0.2719430550932884, + 0.8114235959947109, + 1.1612423993647099, + 0.36588829942047596, + 0.3780815228819847, + 4.009630262851715, + 0.5951293502002954, + 0.6512800212949514, + 0.42836618050932884, + 0.8868067730218172, + 1.1747582759708166, + 0.848192498087883, + 0.330398378893733, + 0.9783812873065472, + 0.36344683170318604, + 1.220702761784196, + 0.28949592635035515, + 0.04112860932946205, + 0.11222049221396446 + ], + "unique_experts": 64, + "load_cv": 0.5989054709222442, + "normalized_load_entropy": 0.9564785075574648, + "max_load_share": 0.040160642570281124 + }, + "full_input": { + "tokens": 191, + "top_k": 6, + "decisions": 1146, + "ordered_route_sha256": "6e31bbe70e04396993184d5256bd30f13dc98aab60023c01a220aebfdc9f9f54", + "route_weight_sha256": "89bd29bca0427e5aa2da9cd339678447857e1883e284a9bbc3931d66549590d5", + "loads": [ + 11, + 12, + 28, + 29, + 27, + 14, + 44, + 26, + 29, + 8, + 6, + 9, + 38, + 12, + 21, + 20, + 14, + 18, + 22, + 24, + 7, + 21, + 31, + 15, + 10, + 49, + 21, + 27, + 13, + 15, + 8, + 5, + 11, + 20, + 17, + 2, + 27, + 7, + 12, + 4, + 31, + 10, + 7, + 19, + 21, + 6, + 12, + 25, + 12, + 11, + 49, + 14, + 18, + 15, + 20, + 23, + 25, + 12, + 22, + 7, + 36, + 13, + 1, + 3 + ], + "weighted_loads": [ + 0.462680384516716, + 0.4336204491555691, + 2.084794720634818, + 2.1399353109300137, + 1.133554445579648, + 0.483100401237607, + 4.342066595330834, + 1.5111877880990505, + 2.5148049034178257, + 0.4831519555300474, + 0.33866515196859837, + 1.0747662112116814, + 4.503839775919914, + 1.0620006211102009, + 0.953973937779665, + 0.9113700836896896, + 0.6103181149810553, + 1.2476617768406868, + 1.5966072753071785, + 2.386005237698555, + 0.2547030095010996, + 1.16301148571074, + 1.692728079855442, + 0.9160260744392872, + 1.4686313346028328, + 3.3390561267733574, + 0.7005852982401848, + 1.5595702659338713, + 1.3579229433089495, + 0.5925702452659607, + 0.26540560461580753, + 0.16768606007099152, + 0.615604305639863, + 0.8354109358042479, + 0.6501503735780716, + 0.17309795320034027, + 1.2007615193724632, + 0.21521263755857944, + 0.7789652869105339, + 0.16999874264001846, + 1.3908598069101572, + 0.3719429690390825, + 0.40287433192133904, + 1.426100792363286, + 1.028135258704424, + 0.2719430550932884, + 0.8114235959947109, + 1.1612423993647099, + 0.40127688460052013, + 0.44356245547533035, + 5.158691491931677, + 0.5951293502002954, + 0.6512800212949514, + 0.6737114507704973, + 0.8868067730218172, + 1.5544927585870028, + 0.8979649655520916, + 0.45690502040088177, + 1.007397849112749, + 0.36344683170318604, + 2.502550618723035, + 0.5701639950275421, + 0.04112860932946205, + 0.11222049221396446 + ], + "unique_experts": 64, + "load_cv": 0.5986191033929734, + "normalized_load_entropy": 0.9576757134542921, + "max_load_share": 0.04275741710296684 + } + }, + "s1_period": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "6ba7a7f5814fe1911dd6854d54e83be6560ce6bddbaeb6d22f002cddf3a72323", + "route_weight_sha256": "f23af14b521f38062c8c490fb06e1765124c9fd1faa4fdf79a3427d94fe02dd8", + "loads": [ + 9, + 10, + 26, + 21, + 21, + 13, + 39, + 22, + 27, + 10, + 6, + 9, + 34, + 11, + 20, + 14, + 9, + 17, + 12, + 23, + 1, + 21, + 24, + 14, + 10, + 41, + 17, + 25, + 14, + 12, + 6, + 6, + 11, + 18, + 15, + 1, + 24, + 5, + 16, + 2, + 28, + 10, + 5, + 19, + 11, + 6, + 12, + 28, + 9, + 8, + 40, + 15, + 18, + 12, + 21, + 19, + 24, + 8, + 22, + 7, + 26, + 7, + 3, + 2 + ], + "weighted_loads": [ + 0.3964717350900173, + 0.38563469983637333, + 1.9729280732572079, + 1.5235514156520367, + 0.8501296546310186, + 0.4554936047643423, + 4.163569876924157, + 1.0696794651448727, + 2.43109280616045, + 0.5305372439324856, + 0.350912569090724, + 1.2324546203017235, + 4.283566549420357, + 1.1154636703431606, + 0.8721131030470133, + 0.5868405532091856, + 0.4338313154876232, + 1.2192681096494198, + 0.7096213474869728, + 2.2720011454075575, + 0.031022431328892708, + 1.1634639222174883, + 1.263110926374793, + 0.8978652432560921, + 1.4416032955050468, + 2.7039534859359264, + 0.6056342553347349, + 1.4599275067448616, + 1.379502734169364, + 0.4282529316842556, + 0.1856809314340353, + 0.19165122509002686, + 0.6222155075520277, + 0.8017279822379351, + 0.5781920850276947, + 0.15316922962665558, + 1.0903153698891401, + 0.159244230017066, + 0.5524787604808807, + 0.0710567943751812, + 1.2289363257586956, + 0.3569837883114815, + 0.2203974723815918, + 1.43401437997818, + 0.6735417954623699, + 0.27181854099035263, + 0.8845862597227097, + 1.2654634434729815, + 0.306190712377429, + 0.3091645836830139, + 3.9329515136778355, + 0.6155182681977749, + 0.6733725741505623, + 0.5162154883146286, + 0.9073854796588421, + 1.1062218733131886, + 0.8575128056108952, + 0.29979333840310574, + 1.0127209313213825, + 0.3631483092904091, + 1.2868025992065668, + 0.23084656894207, + 0.12525026127696037, + 0.06449648551642895 + ], + "unique_experts": 64, + "load_cv": 0.6028779973154622, + "normalized_load_entropy": 0.9555482709995038, + "max_load_share": 0.04116465863453815 + }, + "full_input": { + "tokens": 207, + "top_k": 6, + "decisions": 1242, + "ordered_route_sha256": "8f15c3df0673cbd4d087c674249f4539c5d76ae8dbabc05f35748b1a7f89cf36", + "route_weight_sha256": "012da7fce710c3d452e72e5ab943988a637c02dab379d61a6553c7c913418632", + "loads": [ + 14, + 11, + 26, + 32, + 28, + 21, + 42, + 32, + 27, + 12, + 8, + 9, + 39, + 12, + 22, + 27, + 14, + 17, + 22, + 24, + 5, + 22, + 34, + 16, + 11, + 56, + 18, + 26, + 14, + 16, + 6, + 7, + 12, + 18, + 17, + 3, + 27, + 13, + 18, + 7, + 34, + 12, + 7, + 23, + 24, + 7, + 12, + 28, + 9, + 13, + 53, + 15, + 18, + 22, + 22, + 31, + 25, + 15, + 23, + 9, + 39, + 10, + 4, + 2 + ], + "weighted_loads": [ + 0.6207843739539385, + 0.4097868222743273, + 1.9729280732572079, + 2.275968734174967, + 1.2125398758798838, + 0.7824739441275597, + 4.269354088231921, + 1.6830468233674765, + 2.43109280616045, + 0.7631603367626667, + 0.4474544692784548, + 1.2324546203017235, + 4.484440265223384, + 1.3982342444360256, + 0.98058863542974, + 1.4266018401831388, + 0.7393527757376432, + 1.2192681096494198, + 1.6941232718527317, + 2.3059015553444624, + 0.18415106274187565, + 1.1994603108614683, + 1.8305124435573816, + 1.0697878748178482, + 1.46171223372221, + 3.6846546828746796, + 0.6230793725699186, + 1.4952598884701729, + 1.379502734169364, + 0.5419816207140684, + 0.1856809314340353, + 0.22302578389644623, + 0.6694021131843328, + 0.8017279822379351, + 0.6493549160659313, + 0.33116554841399193, + 1.1926050540059805, + 0.48111336678266525, + 0.9585401304066181, + 0.31421125307679176, + 1.5193402841687202, + 0.45202311500906944, + 0.363855566829443, + 1.6188065819442272, + 1.4870707280933857, + 0.3448866009712219, + 0.8845862597227097, + 1.2654634434729815, + 0.306190712377429, + 0.635768685489893, + 5.670621816068888, + 0.6155182681977749, + 0.6733725741505623, + 0.9357608053833246, + 0.9394293986260891, + 2.166579231619835, + 0.9038798734545708, + 0.8363586813211441, + 1.0488625317811966, + 0.4162377566099167, + 2.775275144726038, + 0.3978261686861515, + 0.18570322915911674, + 0.06449648551642895 + ], + "unique_experts": 64, + "load_cv": 0.5829018417931628, + "normalized_load_entropy": 0.9605385050960239, + "max_load_share": 0.04508856682769726 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 166, + "ordered_topk_exact_tokens": 91, + "set_exact_tokens": 108, + "mean_set_jaccard": 0.8950086058519794, + "mean_token_weighted_tv": 0.019375752820352834, + "aggregate_load_tv": 0.03012048192771085 + }, + "system_bos": { + "tokens": 166, + "ordered_topk_exact_tokens": 91, + "set_exact_tokens": 118, + "mean_set_jaccard": 0.916092943201377, + "mean_token_weighted_tv": 0.0176206089062504, + "aggregate_load_tv": 0.024096385542168676 + }, + "system_x": { + "tokens": 166, + "ordered_topk_exact_tokens": 62, + "set_exact_tokens": 88, + "mean_set_jaccard": 0.854130808950086, + "mean_token_weighted_tv": 0.029144337872065693, + "aggregate_load_tv": 0.042168674698795185 + }, + "system_period": { + "tokens": 166, + "ordered_topk_exact_tokens": 62, + "set_exact_tokens": 96, + "mean_set_jaccard": 0.8743545611015491, + "mean_token_weighted_tv": 0.026323905831808787, + "aggregate_load_tv": 0.0321285140562249 + }, + "bos_at_s0": { + "tokens": 166, + "ordered_topk_exact_tokens": 79, + "set_exact_tokens": 98, + "mean_set_jaccard": 0.870338496844521, + "mean_token_weighted_tv": 0.025880832320460713, + "aggregate_load_tv": 0.032128514056224904 + }, + "bos_at_s1": { + "tokens": 166, + "ordered_topk_exact_tokens": 74, + "set_exact_tokens": 105, + "mean_set_jaccard": 0.8859724612736661, + "mean_token_weighted_tv": 0.02494756244571812, + "aggregate_load_tv": 0.03313253012048193 + }, + "x_at_s0": { + "tokens": 166, + "ordered_topk_exact_tokens": 66, + "set_exact_tokens": 89, + "mean_set_jaccard": 0.858720596672404, + "mean_token_weighted_tv": 0.026964120157287424, + "aggregate_load_tv": 0.046184738955823285 + }, + "x_at_s1": { + "tokens": 166, + "ordered_topk_exact_tokens": 44, + "set_exact_tokens": 68, + "mean_set_jaccard": 0.8106712564543889, + "mean_token_weighted_tv": 0.0354941159105265, + "aggregate_load_tv": 0.04919678714859438 + }, + "period_at_s0": { + "tokens": 166, + "ordered_topk_exact_tokens": 69, + "set_exact_tokens": 92, + "mean_set_jaccard": 0.8623063683304647, + "mean_token_weighted_tv": 0.026943733478077204, + "aggregate_load_tv": 0.04116465863453815 + }, + "period_at_s1": { + "tokens": 166, + "ordered_topk_exact_tokens": 52, + "set_exact_tokens": 79, + "mean_set_jaccard": 0.8360585197934597, + "mean_token_weighted_tv": 0.03243713690731001, + "aggregate_load_tv": 0.047188755020080325 + } + } + }, + "layer_21": { + "layer": 21, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "f4e8ba18faf3f9f8d1dc57a1857f6923e5b360a65d6b2a16e6df2737edba5459", + "route_weight_sha256": "c90256b8247f9a98e38960c29bc3934728b38a38763f0d565375927a512646ec", + "loads": [ + 2, + 37, + 6, + 26, + 7, + 23, + 6, + 28, + 11, + 12, + 13, + 24, + 14, + 6, + 12, + 14, + 15, + 24, + 13, + 18, + 6, + 13, + 13, + 8, + 12, + 39, + 10, + 22, + 17, + 8, + 3, + 2, + 14, + 7, + 11, + 18, + 1, + 4, + 23, + 11, + 16, + 19, + 19, + 34, + 42, + 37, + 7, + 34, + 19, + 3, + 7, + 19, + 7, + 45, + 14, + 16, + 13, + 10, + 20, + 15, + 23, + 5, + 4, + 15 + ], + "weighted_loads": [ + 0.1075895857065916, + 1.8647878784686327, + 0.22418422251939774, + 1.7058499902486801, + 0.2809301558881998, + 1.154718404635787, + 0.2308063581585884, + 1.8604552615433931, + 0.4630929697304964, + 0.8091830722987652, + 0.7292063180357218, + 0.9287170264869928, + 0.5548161398619413, + 0.2852451018989086, + 0.4317840747535229, + 0.5016146898269653, + 0.6832062397152185, + 1.1265009716153145, + 0.47590716928243637, + 0.5635446533560753, + 0.41142326034605503, + 0.6532843038439751, + 0.6737369857728481, + 0.43647170066833496, + 0.6590956039726734, + 2.7212054803967476, + 0.6071354933083057, + 1.6621502749621868, + 0.7113300524652004, + 0.6439989693462849, + 0.1251564510166645, + 0.0879485085606575, + 0.6060311123728752, + 0.2822263855487108, + 0.4181862249970436, + 0.8127512075006962, + 0.06692527234554291, + 0.1666957512497902, + 1.6853493079543114, + 0.3742855675518513, + 0.6750625893473625, + 1.6510586217045784, + 1.45699992030859, + 3.060307225212455, + 3.189145155251026, + 1.5204374883323908, + 0.3542990870773792, + 2.262251542881131, + 1.0475915390998125, + 0.13600672781467438, + 0.38012781739234924, + 1.1010637860745192, + 0.29442025162279606, + 2.454100627452135, + 0.7331690341234207, + 1.2857623919844627, + 0.8044151626527309, + 0.43175014667212963, + 0.7155500315129757, + 1.0858230721205473, + 1.1911323089152575, + 0.18300629034638405, + 0.17492330074310303, + 0.8078387808054686 + ], + "unique_experts": 64, + "load_cv": 0.6592097595886924, + "normalized_load_entropy": 0.9498551714948085, + "max_load_share": 0.045180722891566265 + }, + "full_input": { + "tokens": 191, + "top_k": 6, + "decisions": 1146, + "ordered_route_sha256": "cc5c9f945df3de51bb1eb71b9bb12bfbdbed0ab730c354acb058f47799435a2b", + "route_weight_sha256": "ded4b281d2770d1a0517b5152edcb627545f8971a11bb78f843e89a786d5f2f3", + "loads": [ + 2, + 37, + 10, + 26, + 14, + 23, + 10, + 28, + 13, + 12, + 20, + 25, + 17, + 11, + 14, + 21, + 16, + 28, + 13, + 22, + 6, + 22, + 13, + 8, + 12, + 39, + 19, + 27, + 20, + 8, + 4, + 2, + 15, + 8, + 12, + 28, + 1, + 4, + 23, + 11, + 18, + 20, + 23, + 34, + 42, + 37, + 7, + 34, + 30, + 6, + 7, + 26, + 16, + 46, + 21, + 18, + 14, + 10, + 24, + 16, + 23, + 5, + 10, + 15 + ], + "weighted_loads": [ + 0.1075895857065916, + 1.8647878784686327, + 0.3341950934845954, + 1.7058499902486801, + 0.5411018449813128, + 1.154718404635787, + 0.5418809168040752, + 1.8604552615433931, + 0.582937790080905, + 0.8091830722987652, + 1.0871760677546263, + 0.9816543888300657, + 0.7176275718957186, + 0.6181370913982391, + 0.5154799111187458, + 0.7593758134171367, + 0.6964744525030255, + 1.2582434727810323, + 0.47590716928243637, + 2.1189777553081512, + 0.41142326034605503, + 1.1641814983449876, + 0.6737369857728481, + 0.43647170066833496, + 0.6590956039726734, + 2.7212054803967476, + 1.0202595628798008, + 2.089477311819792, + 0.770730709657073, + 0.6439989693462849, + 0.14783434756100178, + 0.0879485085606575, + 0.6288872994482517, + 0.33117480017244816, + 0.4719594158232212, + 1.3845887705683708, + 0.06692527234554291, + 0.1666957512497902, + 1.6853493079543114, + 0.3742855675518513, + 0.7733424082398415, + 1.6866114623844624, + 1.6773962564766407, + 3.060307225212455, + 3.189145155251026, + 1.5204374883323908, + 0.3542990870773792, + 2.262251542881131, + 1.6299317423254251, + 0.39734868705272675, + 0.38012781739234924, + 1.4236927162855864, + 0.8701388854533434, + 2.467115167528391, + 1.028956202790141, + 1.5250597260892391, + 0.8454660996794701, + 0.43175014667212963, + 0.8709708098322153, + 1.1261346209794283, + 1.1911323089152575, + 0.18300629034638405, + 0.4893776811659336, + 0.8078387808054686 + ], + "unique_experts": 64, + "load_cv": 0.5732526060085446, + "normalized_load_entropy": 0.9592929037342895, + "max_load_share": 0.04013961605584642 + } + }, + "s1_eos": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "4c53ebaef4bcb6cae71c3fea93b296270cf18953465e497dadc0fd129d219116", + "route_weight_sha256": "6c60ab6e0710b267aa2cc31bb41ca573195c171a58a34f41835aaa9adfb1d74c", + "loads": [ + 3, + 38, + 6, + 24, + 8, + 23, + 6, + 28, + 12, + 13, + 12, + 27, + 13, + 5, + 11, + 15, + 15, + 24, + 14, + 17, + 7, + 12, + 14, + 7, + 11, + 39, + 10, + 22, + 19, + 8, + 3, + 3, + 15, + 6, + 9, + 18, + 1, + 4, + 23, + 13, + 18, + 19, + 19, + 34, + 40, + 35, + 7, + 33, + 19, + 3, + 6, + 18, + 9, + 41, + 16, + 17, + 14, + 10, + 20, + 12, + 23, + 7, + 3, + 15 + ], + "weighted_loads": [ + 0.13325887732207775, + 1.8922306504100561, + 0.2135950531810522, + 1.7028909921646118, + 0.31205910444259644, + 1.1731297932565212, + 0.23635836131870747, + 1.8769483789801598, + 0.4951192941516638, + 0.8587505873292685, + 0.6816227305680513, + 1.011102419346571, + 0.496127899736166, + 0.2567344456911087, + 0.392654737457633, + 0.5340234190225601, + 0.6686664801090956, + 1.107174202799797, + 0.49110954627394676, + 0.5370063073933125, + 0.41334519907832146, + 0.6166205182671547, + 0.7054688967764378, + 0.39443353563547134, + 0.6021928265690804, + 2.749302325770259, + 0.6217839624732733, + 1.7031023874878883, + 0.7520836777985096, + 0.6508806459605694, + 0.12565216794610023, + 0.1066591627895832, + 0.6298330556601286, + 0.23679756931960583, + 0.3340661898255348, + 0.8125079944729805, + 0.05576305836439133, + 0.17082364857196808, + 1.6578053832054138, + 0.42568710818886757, + 0.7435463611036539, + 1.6189872696995735, + 1.4104483239352703, + 3.068879636004567, + 3.014728434383869, + 1.4554164949804544, + 0.3562084436416626, + 2.210776759311557, + 1.068468863144517, + 0.13845989108085632, + 0.3408098518848419, + 1.0652504805475473, + 0.36101191863417625, + 2.2704559732228518, + 0.7936775423586369, + 1.2880624569952488, + 0.851915180683136, + 0.44327779300510883, + 0.7563348449766636, + 0.9385284502059221, + 1.173589937388897, + 0.2448169495910406, + 0.1492086984217167, + 0.7883913274854422 + ], + "unique_experts": 64, + "load_cv": 0.6391348929581223, + "normalized_load_entropy": 0.9521465801082112, + "max_load_share": 0.04116465863453815 + }, + "full_input": { + "tokens": 207, + "top_k": 6, + "decisions": 1242, + "ordered_route_sha256": "63112ffd444ec362b8eaed29ab6b99d09bde362268937db55abdf9046ff75185", + "route_weight_sha256": "047360f2442727d5b24c428488f70f4246d9ba4a8f023e11edb18e30b49d590a", + "loads": [ + 10, + 39, + 9, + 24, + 8, + 24, + 11, + 29, + 16, + 15, + 22, + 27, + 17, + 15, + 18, + 20, + 16, + 34, + 17, + 23, + 8, + 23, + 16, + 12, + 12, + 41, + 18, + 32, + 22, + 9, + 5, + 3, + 16, + 11, + 9, + 36, + 2, + 5, + 24, + 13, + 19, + 21, + 26, + 34, + 41, + 36, + 7, + 33, + 30, + 8, + 7, + 28, + 19, + 42, + 30, + 25, + 19, + 10, + 24, + 15, + 24, + 8, + 9, + 16 + ], + "weighted_loads": [ + 0.6121866386383772, + 1.9430743847042322, + 0.9096179371699691, + 1.7028909921646118, + 0.31205910444259644, + 1.1881478121504188, + 0.47444455511868, + 1.9557155817747116, + 0.6529333759099245, + 1.0067442674189806, + 1.1846160050481558, + 1.011102419346571, + 0.6981453783810139, + 0.7846331764012575, + 0.6706937607377768, + 0.7286744397133589, + 0.6819346928969026, + 1.469920300412923, + 0.5918776746839285, + 2.1390925478190184, + 0.46094556152820587, + 1.2002223264425993, + 0.7636898476630449, + 0.8946254309266806, + 0.6389210484921932, + 2.8215751480311155, + 0.910080211237073, + 2.5999649092555046, + 0.7875891956500709, + 0.6997883543372154, + 0.2216041535139084, + 0.1066591627895832, + 0.6525074057281017, + 0.8786075729876757, + 0.3340661898255348, + 1.770359730347991, + 0.12629876285791397, + 0.21150397881865501, + 1.7109504789113998, + 0.42568710818886757, + 0.7734147813171148, + 1.742020022124052, + 1.7812517546117306, + 3.068879636004567, + 3.0765874795615673, + 1.5139570590108633, + 0.3562084436416626, + 2.210776759311557, + 1.8958590235561132, + 1.1631139144301414, + 0.3957025595009327, + 1.7852335069328547, + 0.9618246369063854, + 2.2834705132991076, + 1.6194074489176273, + 1.8764028288424015, + 1.0483379010111094, + 0.44327779300510883, + 0.9126786682754755, + 1.1065327543765306, + 1.196018259972334, + 0.30624392442405224, + 0.42264046147465706, + 0.8761204462498426 + ], + "unique_experts": 64, + "load_cv": 0.5259541277113736, + "normalized_load_entropy": 0.9656977161495927, + "max_load_share": 0.033816425120772944 + } + }, + "s0_bos": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "3fda436755ca5e55fac5fdc1b3445a939efec5fa04b8690eae9c49dbbffb18f2", + "route_weight_sha256": "fda634317a57d349210656fea1063369629803b25917fe3affdfc3e159f16290", + "loads": [ + 3, + 36, + 7, + 25, + 7, + 22, + 8, + 29, + 12, + 11, + 12, + 25, + 15, + 7, + 14, + 11, + 14, + 24, + 15, + 12, + 4, + 15, + 13, + 7, + 11, + 39, + 10, + 23, + 15, + 8, + 3, + 2, + 12, + 6, + 10, + 18, + 1, + 3, + 23, + 10, + 17, + 19, + 19, + 35, + 41, + 32, + 8, + 29, + 20, + 3, + 8, + 19, + 9, + 46, + 17, + 16, + 16, + 9, + 18, + 16, + 23, + 9, + 9, + 16 + ], + "weighted_loads": [ + 0.1361890323460102, + 1.8383319731801748, + 0.23455082811415195, + 1.5723406914621592, + 0.27791116014122963, + 1.1230414006859064, + 0.3063056692481041, + 1.9450840689241886, + 0.4859503787010908, + 0.7867037355899811, + 0.6901435311883688, + 0.9449480380862951, + 0.5840651616454124, + 0.3311730772256851, + 0.5070193409919739, + 0.4045521356165409, + 0.6503195874392986, + 1.1259078867733479, + 0.5370656866580248, + 0.3768669683486223, + 0.3431488536298275, + 0.7157117519527674, + 0.661362174898386, + 0.40340185910463333, + 0.6192909814417362, + 2.7532452046871185, + 0.6232497338205576, + 1.5992986783385277, + 0.6347942464053631, + 0.6674345247447491, + 0.12524151429533958, + 0.07340547069907188, + 0.5265030805021524, + 0.27320054173469543, + 0.37634154595434666, + 0.8302831072360277, + 0.04922851175069809, + 0.1377996951341629, + 1.7337896674871445, + 0.34331745840609074, + 0.7379208095371723, + 1.6977737173438072, + 1.4361400660127401, + 3.115823647007346, + 3.29933750256896, + 1.430083591490984, + 0.4034121446311474, + 2.0281210131943226, + 1.073917867615819, + 0.13595088943839073, + 0.422061150893569, + 1.1239003967493773, + 0.36086416617035866, + 2.4015816003084183, + 0.8379094153642654, + 1.370944783091545, + 0.9143366683274508, + 0.39254463091492653, + 0.7002768758684397, + 1.0734277181327343, + 1.2017933148890734, + 0.32712368853390217, + 0.34047732315957546, + 0.8498350940644741 + ], + "unique_experts": 64, + "load_cv": 0.6346779369188397, + "normalized_load_entropy": 0.9535610887387239, + "max_load_share": 0.04618473895582329 + }, + "full_input": { + "tokens": 191, + "top_k": 6, + "decisions": 1146, + "ordered_route_sha256": "866c0837b4a4d08732dab2b8dda6df8ece6e87bc9763f1fc6477a8e793fa63e7", + "route_weight_sha256": "1e8b8eeee7c0b43c95d76370a0aa40c6dd73887094e3c2ecc661323c05aff1e3", + "loads": [ + 3, + 38, + 9, + 26, + 12, + 22, + 11, + 29, + 15, + 11, + 18, + 26, + 18, + 12, + 16, + 16, + 15, + 27, + 16, + 14, + 4, + 23, + 13, + 7, + 11, + 39, + 19, + 28, + 17, + 8, + 4, + 5, + 13, + 7, + 11, + 28, + 1, + 3, + 23, + 13, + 22, + 20, + 23, + 35, + 41, + 34, + 8, + 29, + 31, + 6, + 8, + 26, + 18, + 47, + 23, + 18, + 17, + 9, + 20, + 17, + 23, + 9, + 15, + 16 + ], + "weighted_loads": [ + 0.1361890323460102, + 1.9150800313800573, + 0.3069337233901024, + 1.756975645199418, + 0.46798843890428543, + 1.1230414006859064, + 0.5638030618429184, + 1.9450840689241886, + 0.6359330955892801, + 0.7867037355899811, + 0.9876392539590597, + 0.9917133096605539, + 0.7497313022613525, + 0.6465557180345058, + 0.5914800614118576, + 0.6233072783797979, + 0.6635878002271056, + 1.2492084093391895, + 0.5886013600975275, + 0.9490990582853556, + 0.3431488536298275, + 1.2318895580247045, + 0.661362174898386, + 0.40340185910463333, + 0.6192909814417362, + 2.7532452046871185, + 1.0340257156640291, + 2.026837982237339, + 0.6897649932652712, + 0.6674345247447491, + 0.14791941083967686, + 0.32726071029901505, + 0.549359267577529, + 0.33358393982052803, + 0.43011473678052425, + 1.4021206703037024, + 0.04922851175069809, + 0.1377996951341629, + 1.7337896674871445, + 0.4645226951688528, + 0.9897087551653385, + 1.7333265580236912, + 1.656536402180791, + 3.115823647007346, + 3.29933750256896, + 1.5938111692667007, + 0.4034121446311474, + 2.0281210131943226, + 1.6591002885252237, + 0.37818697839975357, + 0.422061150893569, + 1.4465293269604445, + 0.936582800000906, + 2.414596140384674, + 1.0688303131610155, + 1.6102421171963215, + 0.9553876053541899, + 0.39254463091492653, + 0.7643618546426296, + 1.1137392669916153, + 1.2017933148890734, + 0.32712368853390217, + 0.6608162987977266, + 0.8498350940644741 + ], + "unique_experts": 64, + "load_cv": 0.5601822396127023, + "normalized_load_entropy": 0.9615825294699101, + "max_load_share": 0.04101221640488656 + } + }, + "s1_bos": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "8a44e83205cf6248b0ef142c05f51f0683ec9f25df439d5583784df837f680db", + "route_weight_sha256": "a13736f9164e6164f158587163556c76457372e22d4dede33848436ba937bb4b", + "loads": [ + 3, + 38, + 5, + 21, + 8, + 22, + 6, + 28, + 9, + 11, + 15, + 23, + 14, + 8, + 14, + 15, + 17, + 23, + 14, + 17, + 5, + 15, + 13, + 7, + 11, + 38, + 9, + 22, + 18, + 9, + 3, + 3, + 13, + 6, + 9, + 16, + 1, + 4, + 23, + 8, + 18, + 19, + 21, + 36, + 42, + 34, + 7, + 31, + 19, + 3, + 6, + 19, + 7, + 46, + 16, + 15, + 14, + 10, + 22, + 15, + 22, + 9, + 5, + 16 + ], + "weighted_loads": [ + 0.13052078522741795, + 1.888758448883891, + 0.1784165482968092, + 1.512841971591115, + 0.3148585222661495, + 1.1118152718991041, + 0.2448496837168932, + 1.881784787401557, + 0.3766972292214632, + 0.7949530966579914, + 0.7595840226858854, + 0.9005801752209663, + 0.5527257043868303, + 0.3712761886417866, + 0.5026897508651018, + 0.5428605042397976, + 0.7562089189887047, + 1.068842040374875, + 0.4849169794470072, + 0.5391696933656931, + 0.36521258763968945, + 0.7067135330289602, + 0.6689834073185921, + 0.4191587474197149, + 0.599609699100256, + 2.6882129460573196, + 0.5821080859750509, + 1.580156335607171, + 0.7294480372220278, + 0.6770862117409706, + 0.1310681663453579, + 0.12057125568389893, + 0.5525734610855579, + 0.24145742692053318, + 0.3604123927652836, + 0.7815694212913513, + 0.050009749829769135, + 0.17020587995648384, + 1.6736180670559406, + 0.2604875322431326, + 0.7686827853322029, + 1.6945991180837154, + 1.4981689490377903, + 3.1657736990600824, + 3.22351061925292, + 1.5115268267691135, + 0.3641237635165453, + 2.066334005445242, + 1.050889603793621, + 0.13689327985048294, + 0.35369645804166794, + 1.1374146603047848, + 0.290307704359293, + 2.429238760843873, + 0.7999284993857145, + 1.2987881675362587, + 0.8413585834205151, + 0.43540230579674244, + 0.819470688700676, + 1.045678235590458, + 1.1573379412293434, + 0.32338945008814335, + 0.2146499752998352, + 0.8424831908196211 + ], + "unique_experts": 64, + "load_cv": 0.6483549858483332, + "normalized_load_entropy": 0.9517201209828976, + "max_load_share": 0.04618473895582329 + }, + "full_input": { + "tokens": 207, + "top_k": 6, + "decisions": 1242, + "ordered_route_sha256": "946ed52834895c6eb3b2ace36d735366c4f49c533dea31d5b4ad0d63c87efe43", + "route_weight_sha256": "7b6870995c4db964fd4634c313ebedc269804a9287d614ce93412d15f5117a38", + "loads": [ + 10, + 40, + 7, + 21, + 11, + 23, + 10, + 30, + 13, + 13, + 23, + 24, + 19, + 16, + 21, + 19, + 18, + 32, + 18, + 20, + 6, + 25, + 15, + 12, + 12, + 40, + 17, + 33, + 20, + 10, + 5, + 5, + 14, + 11, + 9, + 34, + 2, + 5, + 24, + 9, + 21, + 21, + 29, + 36, + 43, + 35, + 7, + 31, + 29, + 8, + 7, + 29, + 17, + 47, + 30, + 23, + 19, + 10, + 24, + 18, + 23, + 10, + 12, + 17 + ], + "weighted_loads": [ + 0.6094485465437174, + 1.9701511319726706, + 0.871768057346344, + 1.512841971591115, + 0.42572270706295967, + 1.1268332907930017, + 0.47373986802995205, + 1.997089548036456, + 0.5413828250020742, + 0.9429467767477036, + 1.1862842198461294, + 0.952233862131834, + 0.7911970373243093, + 0.8147969003766775, + 0.7838505525141954, + 0.7311880961060524, + 0.7694771317765117, + 1.4356873240321875, + 0.6692726649343967, + 1.1319224648177624, + 0.41281295008957386, + 1.2820257497951388, + 0.7272043582051992, + 0.9193506427109241, + 0.6363379210233688, + 2.7604857683181763, + 0.8704043347388506, + 2.4822281543165445, + 0.7605872489511967, + 0.7259939201176167, + 0.22702015191316605, + 0.25161905214190483, + 0.5752478111535311, + 0.8836319800466299, + 0.3604123927652836, + 1.7394211571663618, + 0.12054545432329178, + 0.21088621020317078, + 1.7267631627619267, + 0.29421513713896275, + 0.8818605430424213, + 1.817631870508194, + 1.903337474912405, + 3.1657736990600824, + 3.2853696644306183, + 1.5700673907995224, + 0.3641237635165453, + 2.066334005445242, + 1.8416131436824799, + 1.2128835767507553, + 0.4085891656577587, + 1.857397686690092, + 0.8911204226315022, + 2.442253300920129, + 1.639584632590413, + 1.8871285393834114, + 1.0335068795830011, + 0.43540230579674244, + 0.8771810457110405, + 1.2136825397610664, + 1.1797662638127804, + 0.384816424921155, + 0.5741640105843544, + 0.9302123095840216 + ], + "unique_experts": 64, + "load_cv": 0.5335510108340283, + "normalized_load_entropy": 0.9654122889016002, + "max_load_share": 0.03784219001610306 + } + }, + "s0_x": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "d140d328453d4061bbf58aead8b867f4c09b340f3468e09ea656a2013e04b6a7", + "route_weight_sha256": "f585ef4644b059bde1dae7898560f6412fc56c5be92fc343051d50341831fc25", + "loads": [ + 4, + 39, + 5, + 23, + 8, + 25, + 7, + 28, + 11, + 12, + 14, + 26, + 13, + 5, + 14, + 13, + 14, + 20, + 14, + 15, + 5, + 12, + 13, + 7, + 11, + 39, + 11, + 23, + 15, + 10, + 3, + 3, + 14, + 6, + 10, + 19, + 1, + 3, + 23, + 9, + 17, + 19, + 19, + 33, + 41, + 36, + 7, + 31, + 22, + 4, + 7, + 18, + 8, + 46, + 17, + 18, + 14, + 9, + 19, + 16, + 20, + 6, + 5, + 17 + ], + "weighted_loads": [ + 0.16198848746716976, + 1.9515221305191517, + 0.1723988838493824, + 1.464811783283949, + 0.3181389458477497, + 1.221650367602706, + 0.2566132713109255, + 1.9315021969377995, + 0.4560764469206333, + 0.8438839241862297, + 0.7812550086528063, + 0.9831457547843456, + 0.5595733411610126, + 0.2615276835858822, + 0.5026008021086454, + 0.480318496003747, + 0.6385083012282848, + 0.9725608117878437, + 0.5037276241928339, + 0.460191598162055, + 0.36499993689358234, + 0.5977663137018681, + 0.6666468903422356, + 0.42218185029923916, + 0.6039128489792347, + 2.8024100083857775, + 0.6764344442635775, + 1.668096885085106, + 0.6073676645755768, + 0.7429440747946501, + 0.12072882801294327, + 0.10955989733338356, + 0.6013833954930305, + 0.26195576786994934, + 0.3692292030900717, + 0.8737708460539579, + 0.049844466149806976, + 0.13908403366804123, + 1.7035076208412647, + 0.3094988949596882, + 0.7450803332030773, + 1.6737946644425392, + 1.4006326105445623, + 2.9842236526310444, + 3.2343614511191845, + 1.5630516838282347, + 0.3633160199970007, + 2.1137785986065865, + 1.1820087060332298, + 0.1680967602878809, + 0.39765020832419395, + 1.10746718198061, + 0.3242193292826414, + 2.4137313049286604, + 0.8147045355290174, + 1.4871345311403275, + 0.8491959627717733, + 0.38846853375434875, + 0.693476090207696, + 1.1067041736096144, + 1.0528220422565937, + 0.22245865315198898, + 0.20856343023478985, + 0.878338448703289 + ], + "unique_experts": 64, + "load_cv": 0.6504412512978996, + "normalized_load_entropy": 0.9516703755000325, + "max_load_share": 0.04618473895582329 + }, + "full_input": { + "tokens": 191, + "top_k": 6, + "decisions": 1146, + "ordered_route_sha256": "b6a48428f817fcc9c02b95470c137a603dbe8f5c7cce7b7fb7d30d30295bdfd3", + "route_weight_sha256": "b6a2eb1e6c894f62eed3c052fa40ed2a19afeae2d945741c09a9bdfd79811d05", + "loads": [ + 4, + 39, + 7, + 23, + 14, + 25, + 10, + 28, + 13, + 12, + 22, + 27, + 17, + 10, + 18, + 17, + 16, + 26, + 14, + 17, + 5, + 19, + 13, + 7, + 11, + 39, + 19, + 28, + 19, + 10, + 4, + 4, + 15, + 7, + 11, + 30, + 1, + 3, + 23, + 9, + 20, + 20, + 26, + 33, + 41, + 36, + 7, + 31, + 34, + 7, + 7, + 25, + 18, + 47, + 23, + 20, + 16, + 9, + 20, + 17, + 20, + 6, + 10, + 17 + ], + "weighted_loads": [ + 0.16198848746716976, + 1.9515221305191517, + 0.24478177912533283, + 1.464811783283949, + 0.5478563345968723, + 1.221650367602706, + 0.5228544939309359, + 1.9315021969377995, + 0.5690797604620457, + 0.8438839241862297, + 1.1764964330941439, + 1.0313594788312912, + 0.7620291523635387, + 0.5872950684279203, + 0.640764620155096, + 0.6471037417650223, + 0.6976681789383292, + 1.1935135796666145, + 0.5037276241928339, + 1.0324236880987883, + 0.36499993689358234, + 1.0769090605899692, + 0.6666468903422356, + 0.42218185029923916, + 0.6039128489792347, + 2.8024100083857775, + 1.0580498930066824, + 2.1122986748814583, + 0.735867640003562, + 0.7429440747946501, + 0.14340672455728054, + 0.17263420298695564, + 0.6242395825684071, + 0.3088347725570202, + 0.4230023939162493, + 1.5394302923232317, + 0.049844466149806976, + 0.13908403366804123, + 1.7035076208412647, + 0.3094988949596882, + 0.8589731864631176, + 1.7093475051224232, + 1.7537843231111765, + 2.9842236526310444, + 3.2343614511191845, + 1.5630516838282347, + 0.3633160199970007, + 2.1137785986065865, + 1.8638253137469292, + 0.4251156095415354, + 0.39765020832419395, + 1.430096112191677, + 1.0951281692832708, + 2.426745845004916, + 1.0415524542331696, + 1.7264318652451038, + 0.9344910364598036, + 0.38846853375434875, + 0.7181633971631527, + 1.1470157224684954, + 1.0528220422565937, + 0.22245865315198898, + 0.4426759760826826, + 0.878338448703289 + ], + "unique_experts": 64, + "load_cv": 0.575119762337463, + "normalized_load_entropy": 0.9595964330853228, + "max_load_share": 0.04101221640488656 + } + }, + "s1_x": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "a60542bdf1b1ab771cfe089fe816e92c054ed243ca73a5a384327a34d6e7d134", + "route_weight_sha256": "4f6e9122ce873d15414dbfc8d781308426c583411400931068ca6239408d0d4b", + "loads": [ + 8, + 37, + 6, + 25, + 9, + 26, + 6, + 29, + 9, + 13, + 15, + 25, + 14, + 7, + 15, + 13, + 16, + 18, + 10, + 21, + 5, + 10, + 12, + 7, + 11, + 40, + 10, + 22, + 17, + 8, + 4, + 2, + 13, + 5, + 11, + 17, + 2, + 3, + 23, + 7, + 16, + 19, + 20, + 38, + 40, + 31, + 8, + 31, + 20, + 4, + 7, + 19, + 7, + 46, + 19, + 18, + 15, + 9, + 18, + 16, + 20, + 6, + 3, + 15 + ], + "weighted_loads": [ + 0.3113353978842497, + 1.8543472047895193, + 0.20852095447480679, + 1.6836227308958769, + 0.3455234579741955, + 1.28575773909688, + 0.24091694690287113, + 1.9401865303516388, + 0.38644542917609215, + 0.8769911043345928, + 0.814776036888361, + 0.9429067578166723, + 0.5766169242560863, + 0.34576253965497017, + 0.5026953034102917, + 0.43499622493982315, + 0.7191230654716492, + 0.9165031369775534, + 0.3695897441357374, + 0.6657308824360371, + 0.36750293523073196, + 0.5161238703876734, + 0.6446690522134304, + 0.4220564179122448, + 0.6010489352047443, + 2.8362406082451344, + 0.6117133628576994, + 1.5406772084534168, + 0.6706632003188133, + 0.724400382488966, + 0.16004863008856773, + 0.07362671941518784, + 0.5620632749050856, + 0.196503896266222, + 0.3996615670621395, + 0.8067523799836636, + 0.08502660691738129, + 0.15225641056895256, + 1.627780795097351, + 0.2439864929765463, + 0.6886465065181255, + 1.6318004876375198, + 1.4611974153667688, + 3.227632099762559, + 3.103775108233094, + 1.3826720006763935, + 0.3948552068322897, + 2.08583090826869, + 1.156322281807661, + 0.15803404338657856, + 0.37906189635396004, + 1.184413306415081, + 0.29253053292632103, + 2.4759890995919704, + 0.8612334597855806, + 1.4811524450778961, + 0.8559648804366589, + 0.3929101713001728, + 0.6455525737255812, + 1.0968099609017372, + 1.0870783161371946, + 0.22154509648680687, + 0.1431476343423128, + 0.8210677746683359 + ], + "unique_experts": 64, + "load_cv": 0.6504412512978996, + "normalized_load_entropy": 0.9517736608023957, + "max_load_share": 0.04618473895582329 + }, + "full_input": { + "tokens": 207, + "top_k": 6, + "decisions": 1242, + "ordered_route_sha256": "edc1edde95f7ab8e71daa916f71a26c24e138fcfcdb2745807d49451b5d515f9", + "route_weight_sha256": "6705a6a14486d8f4d51a458dd8771e39e8757a0ae341dfe820a1eaa41b0591de", + "loads": [ + 15, + 38, + 8, + 25, + 11, + 27, + 9, + 30, + 12, + 15, + 25, + 25, + 22, + 15, + 23, + 16, + 17, + 25, + 13, + 25, + 6, + 19, + 14, + 14, + 12, + 44, + 18, + 32, + 19, + 9, + 7, + 2, + 14, + 9, + 11, + 36, + 3, + 4, + 24, + 7, + 19, + 22, + 31, + 38, + 42, + 32, + 8, + 31, + 34, + 9, + 8, + 29, + 18, + 47, + 31, + 26, + 19, + 9, + 19, + 19, + 21, + 7, + 7, + 16 + ], + "weighted_loads": [ + 0.7902631592005491, + 1.9051909390836954, + 0.9018724635243416, + 1.6836227308958769, + 0.40710815973579884, + 1.3007757579907775, + 0.35184197686612606, + 2.0189537331461906, + 0.5087226741015911, + 1.024984784424305, + 1.2972593270242214, + 0.9429067578166723, + 0.929493136703968, + 0.8322367276996374, + 0.8159266095608473, + 0.5653621554374695, + 0.7323912782594562, + 1.1887608487159014, + 0.4727049022912979, + 1.2894609030336142, + 0.4151032976806164, + 1.052844892255962, + 0.7028900031000376, + 1.0304133873432875, + 0.6377771571278572, + 2.9942804630845785, + 0.9000096116214991, + 2.3985933773219585, + 0.7018024120479822, + 0.773308090865612, + 0.2917057164013386, + 0.07362671941518784, + 0.5847376249730587, + 0.7935291416943073, + 0.3996615670621395, + 1.8317610118538141, + 0.15556231141090393, + 0.1929367408156395, + 1.680925890803337, + 0.2439864929765463, + 0.7872166018933058, + 1.8281678445637226, + 2.0275161620229483, + 3.227632099762559, + 3.2012022342532873, + 1.4412125647068024, + 0.3948552068322897, + 2.08583090826869, + 2.244670681655407, + 1.1668784487992525, + 0.4339546039700508, + 1.9043963328003883, + 1.0994519405066967, + 2.4890036396682262, + 1.5824573170393705, + 2.069492816925049, + 1.0126824993640184, + 0.3929101713001728, + 0.6704908292740583, + 1.2648142650723457, + 1.1095066387206316, + 0.2829720713198185, + 0.3014299552887678, + 0.9087968934327364 + ], + "unique_experts": 64, + "load_cv": 0.550241805088355, + "normalized_load_entropy": 0.9630096282892514, + "max_load_share": 0.03784219001610306 + } + }, + "s0_period": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "239a1461dc933ea54c0788ba7c7e6a56b1efa1abd3aac976bb785d105eca68cc", + "route_weight_sha256": "850442aec17d9193a6e1c6f83f739ac1fd53bdd7a5e6bca47305881cf2781705", + "loads": [ + 3, + 38, + 6, + 24, + 8, + 26, + 6, + 27, + 11, + 13, + 13, + 24, + 13, + 4, + 14, + 13, + 17, + 19, + 13, + 17, + 5, + 12, + 13, + 6, + 11, + 37, + 12, + 23, + 16, + 9, + 3, + 3, + 14, + 8, + 9, + 18, + 1, + 3, + 23, + 10, + 18, + 19, + 20, + 34, + 41, + 32, + 7, + 31, + 21, + 3, + 9, + 20, + 8, + 46, + 16, + 17, + 15, + 9, + 17, + 17, + 23, + 6, + 6, + 16 + ], + "weighted_loads": [ + 0.13777930662035942, + 1.8950800355523825, + 0.2079827208071947, + 1.4981023538857698, + 0.3187415264546871, + 1.2261900343000889, + 0.22801786474883556, + 1.9153497032821178, + 0.4511333182454109, + 0.8781744055449963, + 0.7388492897152901, + 0.9255011901259422, + 0.5769430305808783, + 0.22077802196145058, + 0.5013229921460152, + 0.49808737076818943, + 0.7466031443327665, + 0.9441976863890886, + 0.4560797307640314, + 0.5175058990716934, + 0.364599471911788, + 0.6038259379565716, + 0.6690760888159275, + 0.39907989278435707, + 0.6199551559984684, + 2.7177210934460163, + 0.6936185490339994, + 1.6308842673897743, + 0.6482862383127213, + 0.7141060400754213, + 0.12513140216469765, + 0.11686984449625015, + 0.5968139823526144, + 0.31781111285090446, + 0.32578559778630733, + 0.8434954918920994, + 0.05064382031559944, + 0.14019126445055008, + 1.7249716334044933, + 0.33266208693385124, + 0.7809466142207384, + 1.661119967699051, + 1.4423665180802345, + 3.0648030042648315, + 3.229161836206913, + 1.4100460726767778, + 0.36293876357376575, + 2.0973863415420055, + 1.1679472792893648, + 0.1334107741713524, + 0.44756806269288063, + 1.19865058735013, + 0.32147943042218685, + 2.4444490298628807, + 0.7827314231544733, + 1.4351934064179659, + 0.8905354142189026, + 0.3903921041637659, + 0.6342981513589621, + 1.1583589650690556, + 1.1780420411378145, + 0.21944314241409302, + 0.24013680592179298, + 0.8453841544687748 + ], + "unique_experts": 64, + "load_cv": 0.6381246818822041, + "normalized_load_entropy": 0.9526265636004873, + "max_load_share": 0.04618473895582329 + }, + "full_input": { + "tokens": 191, + "top_k": 6, + "decisions": 1146, + "ordered_route_sha256": "d92c316bb3028d22a7af9d80366c1176e2667bee1c218ab85b7330e172b500bf", + "route_weight_sha256": "24a1d5d2f8011c17efebe812f3f0e603763dd3d92639559c3cb5fb8439ff398b", + "loads": [ + 3, + 39, + 8, + 24, + 15, + 26, + 9, + 27, + 13, + 13, + 19, + 25, + 17, + 10, + 18, + 18, + 19, + 23, + 14, + 19, + 5, + 20, + 13, + 6, + 11, + 37, + 20, + 28, + 19, + 9, + 4, + 4, + 15, + 9, + 10, + 29, + 1, + 3, + 23, + 10, + 21, + 20, + 25, + 34, + 41, + 32, + 7, + 31, + 33, + 6, + 9, + 28, + 17, + 47, + 22, + 20, + 16, + 9, + 18, + 19, + 23, + 6, + 11, + 16 + ], + "weighted_loads": [ + 0.13777930662035942, + 1.926318310201168, + 0.28036561608314514, + 1.4981023538857698, + 0.5785557366907597, + 1.2261900343000889, + 0.516449449583888, + 1.9153497032821178, + 0.5647077336907387, + 0.8781744055449963, + 1.0422476902604103, + 0.9735970832407475, + 0.7792410459369421, + 0.6003304868936539, + 0.6472493093460798, + 0.7225870229303837, + 0.8012736150994897, + 1.1014043744653463, + 0.5046617183834314, + 1.0897379890084267, + 0.364599471911788, + 1.108288181014359, + 0.6690760888159275, + 0.39907989278435707, + 0.6199551559984684, + 2.7177210934460163, + 1.0752339977771044, + 2.093036748468876, + 0.7442310508340597, + 0.7141060400754213, + 0.14780929870903492, + 0.18855785578489304, + 0.6196701694279909, + 0.36159178987145424, + 0.37955878861248493, + 1.4668034091591835, + 0.05064382031559944, + 0.14019126445055008, + 1.7249716334044933, + 0.33266208693385124, + 0.8907353337854147, + 1.6966728083789349, + 1.7098251655697823, + 3.0648030042648315, + 3.229161836206913, + 1.4100460726767778, + 0.36293876357376575, + 2.0973863415420055, + 1.8291197177022696, + 0.4375789538025856, + 0.44756806269288063, + 1.594082210212946, + 0.8971980642527342, + 2.4574635699391365, + 1.0077411346137524, + 1.7519502397626638, + 0.9315863512456417, + 0.3903921041637659, + 0.6589854583144188, + 1.2812564894557, + 1.1780420411378145, + 0.21944314241409302, + 0.48851777613162994, + 0.8453841544687748 + ], + "unique_experts": 64, + "load_cv": 0.5630456710434523, + "normalized_load_entropy": 0.9607459609253705, + "max_load_share": 0.04101221640488656 + } + }, + "s1_period": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "57d6527fd0c2a3a973cdcc330d09c60b9606fc0aed51866ba044e6a2d8f71d5f", + "route_weight_sha256": "8dec5ac9a9232debcc6b50561a7c6c81b18e97b638353ea8f3a8bde9b98fc899", + "loads": [ + 6, + 38, + 6, + 23, + 8, + 25, + 7, + 28, + 9, + 12, + 14, + 28, + 15, + 7, + 12, + 13, + 17, + 16, + 12, + 20, + 5, + 13, + 13, + 7, + 11, + 39, + 11, + 21, + 17, + 7, + 4, + 3, + 14, + 7, + 8, + 17, + 1, + 3, + 23, + 6, + 17, + 19, + 19, + 36, + 41, + 34, + 7, + 32, + 19, + 4, + 6, + 19, + 7, + 45, + 19, + 18, + 13, + 9, + 21, + 16, + 25, + 4, + 4, + 16 + ], + "weighted_loads": [ + 0.2513702865689993, + 1.893233247101307, + 0.2047213427722454, + 1.619286336004734, + 0.30598790384829044, + 1.2562799453735352, + 0.26314262486994267, + 1.9238536916673183, + 0.3824859503656626, + 0.8479098230600357, + 0.7580516841262579, + 1.0551192909479141, + 0.6484852228313684, + 0.3420215882360935, + 0.4177359603345394, + 0.46261125057935715, + 0.737293167039752, + 0.853030227124691, + 0.43199709989130497, + 0.6369796860963106, + 0.36654794961214066, + 0.6242195125669241, + 0.6695394515991211, + 0.4213721454143524, + 0.6049690451472998, + 2.7902682032436132, + 0.6456666253507137, + 1.4599971901625395, + 0.6767295617610216, + 0.6849193200469017, + 0.172271266579628, + 0.10731314681470394, + 0.5887109637260437, + 0.2664261907339096, + 0.3009182531386614, + 0.8052390143275261, + 0.05077274888753891, + 0.15554208308458328, + 1.6354568861424923, + 0.2060223836451769, + 0.7096144072711468, + 1.650740209966898, + 1.4203144684433937, + 3.1820422001183033, + 3.0961107779294252, + 1.474408958107233, + 0.380691222846508, + 2.0646203570067883, + 1.0879665836691856, + 0.16260446421802044, + 0.35836128145456314, + 1.2275546193122864, + 0.2914619706571102, + 2.457618398591876, + 0.8905295748263597, + 1.5042323917150497, + 0.8164386916905642, + 0.3977831359952688, + 0.7383214626461267, + 1.1335265263915062, + 1.2682220358401537, + 0.1566976085305214, + 0.17984285205602646, + 0.851746466010809 + ], + "unique_experts": 64, + "load_cv": 0.6579362543870473, + "normalized_load_entropy": 0.9503323969068997, + "max_load_share": 0.045180722891566265 + }, + "full_input": { + "tokens": 207, + "top_k": 6, + "decisions": 1242, + "ordered_route_sha256": "59c4132114aca97f827dc120a2d0c69e56c3fb3df4f3f85f559e776e844dd987", + "route_weight_sha256": "b7d8c9c4fe3ca564f4a429fbbb32dffb87278b65c288841c198bfe4014a2c712", + "loads": [ + 13, + 39, + 8, + 23, + 9, + 26, + 11, + 29, + 12, + 14, + 21, + 29, + 21, + 17, + 19, + 16, + 19, + 23, + 16, + 24, + 6, + 22, + 15, + 14, + 12, + 41, + 20, + 31, + 19, + 8, + 6, + 3, + 15, + 12, + 8, + 37, + 2, + 4, + 24, + 7, + 19, + 21, + 29, + 36, + 42, + 35, + 7, + 32, + 32, + 8, + 7, + 30, + 17, + 46, + 33, + 28, + 17, + 9, + 23, + 20, + 26, + 5, + 8, + 17 + ], + "weighted_loads": [ + 0.7302980478852987, + 1.944076981395483, + 0.8980728518217802, + 1.619286336004734, + 0.34564671479165554, + 1.2712979642674327, + 0.4385665860027075, + 2.00262089446187, + 0.5047631952911615, + 0.9959035031497478, + 1.1426183115690947, + 1.0983950532972813, + 0.9490959700196981, + 0.8842069413512945, + 0.7185265235602856, + 0.5907852128148079, + 0.7843043329194188, + 1.125287938863039, + 0.5833792090415955, + 1.260424280539155, + 0.41414831206202507, + 1.1586994482204318, + 0.7277604024857283, + 1.0306035447865725, + 0.6416972670704126, + 2.86254102550447, + 0.9819357171654701, + 2.30221782438457, + 0.7078687734901905, + 0.7338270284235477, + 0.26822325214743614, + 0.10731314681470394, + 0.6113853137940168, + 0.8939260877668858, + 0.3009182531386614, + 1.8430024925619364, + 0.12130845338106155, + 0.19622241333127022, + 1.6886019818484783, + 0.24020851589739323, + 0.7810639813542366, + 1.7737729623913765, + 1.9714752584695816, + 3.1820422001183033, + 3.1579698231071234, + 1.532949522137642, + 0.380691222846508, + 2.0646203570067883, + 2.035034693777561, + 1.2100990023463964, + 0.4132539890706539, + 2.014204256236553, + 0.8922746889293194, + 2.470632938668132, + 1.6971305795013905, + 2.1779151000082493, + 0.9731563106179237, + 0.3977831359952688, + 0.7954303119331598, + 1.3755851536989212, + 1.2906503584235907, + 0.21812458336353302, + 0.337974239140749, + 0.9394755847752094 + ], + "unique_experts": 64, + "load_cv": 0.5504679647841967, + "normalized_load_entropy": 0.9622978099588275, + "max_load_share": 0.037037037037037035 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 166, + "ordered_topk_exact_tokens": 87, + "set_exact_tokens": 112, + "mean_set_jaccard": 0.8970166379804936, + "mean_token_weighted_tv": 0.01935687286397779, + "aggregate_load_tv": 0.028112449799196786 + }, + "system_bos": { + "tokens": 166, + "ordered_topk_exact_tokens": 74, + "set_exact_tokens": 94, + "mean_set_jaccard": 0.8696213425129088, + "mean_token_weighted_tv": 0.02344697261655546, + "aggregate_load_tv": 0.04116465863453815 + }, + "system_x": { + "tokens": 166, + "ordered_topk_exact_tokens": 59, + "set_exact_tokens": 87, + "mean_set_jaccard": 0.8514056224899598, + "mean_token_weighted_tv": 0.028539878069367034, + "aggregate_load_tv": 0.04116465863453815 + }, + "system_period": { + "tokens": 166, + "ordered_topk_exact_tokens": 64, + "set_exact_tokens": 87, + "mean_set_jaccard": 0.8395582329317269, + "mean_token_weighted_tv": 0.03046131915558713, + "aggregate_load_tv": 0.040160642570281124 + }, + "bos_at_s0": { + "tokens": 166, + "ordered_topk_exact_tokens": 58, + "set_exact_tokens": 93, + "mean_set_jaccard": 0.855134825014343, + "mean_token_weighted_tv": 0.027431120304951827, + "aggregate_load_tv": 0.041164658634538144 + }, + "bos_at_s1": { + "tokens": 166, + "ordered_topk_exact_tokens": 66, + "set_exact_tokens": 89, + "mean_set_jaccard": 0.8512621916236374, + "mean_token_weighted_tv": 0.02788250393469829, + "aggregate_load_tv": 0.038152610441767064 + }, + "x_at_s0": { + "tokens": 166, + "ordered_topk_exact_tokens": 64, + "set_exact_tokens": 100, + "mean_set_jaccard": 0.8676133103843947, + "mean_token_weighted_tv": 0.02654989753816142, + "aggregate_load_tv": 0.03815261044176707 + }, + "x_at_s1": { + "tokens": 166, + "ordered_topk_exact_tokens": 53, + "set_exact_tokens": 81, + "mean_set_jaccard": 0.8343947217441193, + "mean_token_weighted_tv": 0.03215933246650251, + "aggregate_load_tv": 0.055220883534136546 + }, + "period_at_s0": { + "tokens": 166, + "ordered_topk_exact_tokens": 60, + "set_exact_tokens": 91, + "mean_set_jaccard": 0.8508318990246702, + "mean_token_weighted_tv": 0.02843587568411267, + "aggregate_load_tv": 0.03815261044176707 + }, + "period_at_s1": { + "tokens": 166, + "ordered_topk_exact_tokens": 58, + "set_exact_tokens": 86, + "mean_set_jaccard": 0.8427137119908205, + "mean_token_weighted_tv": 0.03140516956729523, + "aggregate_load_tv": 0.045180722891566265 + } + } + }, + "layer_22": { + "layer": 22, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "20047216fdf1117efb3d8837b4e14c343936cbc580bd15cb207d8831fa2de5bd", + "route_weight_sha256": "f1f8265011ae79b7967a90125d3d84ee3043be2ddd127edef02a7b25c17861c8", + "loads": [ + 22, + 14, + 32, + 18, + 14, + 33, + 5, + 9, + 21, + 15, + 7, + 6, + 9, + 2, + 11, + 3, + 14, + 18, + 16, + 17, + 37, + 27, + 12, + 12, + 23, + 6, + 7, + 6, + 9, + 11, + 15, + 18, + 20, + 20, + 2, + 12, + 12, + 5, + 15, + 39, + 21, + 25, + 10, + 22, + 14, + 9, + 33, + 16, + 8, + 10, + 5, + 10, + 19, + 12, + 19, + 18, + 8, + 12, + 16, + 7, + 25, + 36, + 17, + 30 + ], + "weighted_loads": [ + 1.518292162567377, + 0.5225257948040962, + 2.7871513329446316, + 1.3660393878817558, + 0.7894568629562855, + 1.622879732400179, + 0.42356689646840096, + 2.5657008066773415, + 0.9439095593988895, + 1.1154291909188032, + 0.30340801551938057, + 0.3325384296476841, + 0.44138931669294834, + 0.04095713887363672, + 0.5313317105174065, + 0.11723010987043381, + 0.8507755994796753, + 1.5518541559576988, + 0.9477077722549438, + 0.6931018382310867, + 2.151666274294257, + 1.9762997776269913, + 0.5357673596590757, + 0.8547453265637159, + 0.9484050069004297, + 0.3027404025197029, + 0.3039865270256996, + 0.22387432679533958, + 0.6516757421195507, + 0.4176864642649889, + 0.615682277828455, + 1.5177484899759293, + 0.7213984411209822, + 0.7746309284120798, + 0.07927050068974495, + 0.4955386910587549, + 0.7540062870830297, + 0.1754408609122038, + 0.8372037215158343, + 2.6736245900392532, + 1.6732177175581455, + 1.2917915396392345, + 0.6915591713041067, + 0.9712297078222036, + 0.5694272182881832, + 0.35214838199317455, + 2.9751226529479027, + 0.8545736148953438, + 0.2886344753205776, + 0.5595277026295662, + 0.2452661171555519, + 0.5465635843575001, + 0.9254649318754673, + 0.4625183027237654, + 1.0305183716118336, + 0.9561983048915863, + 0.4136880664154887, + 0.49867866188287735, + 1.2605126425623894, + 0.321099229156971, + 2.5426709540188313, + 2.162731923162937, + 0.7511886395514011, + 1.3087655901908875 + ], + "unique_experts": 64, + "load_cv": 0.5664644042297226, + "normalized_load_entropy": 0.9622025149184058, + "max_load_share": 0.0391566265060241 + }, + "full_input": { + "tokens": 191, + "top_k": 6, + "decisions": 1146, + "ordered_route_sha256": "6c722164a6d0d7eae7fe37a871f4cf79740a27884251d7f07db45b0dac22ebd0", + "route_weight_sha256": "0caf643a2a8f4c202ab5c085e72864d1e7d50294ff31e9e7c67a72f384a9635a", + "loads": [ + 26, + 15, + 34, + 27, + 14, + 36, + 9, + 10, + 36, + 20, + 7, + 9, + 9, + 2, + 16, + 3, + 14, + 19, + 16, + 17, + 37, + 34, + 13, + 12, + 24, + 8, + 7, + 10, + 9, + 12, + 15, + 18, + 23, + 26, + 3, + 14, + 12, + 7, + 15, + 39, + 25, + 26, + 15, + 22, + 14, + 10, + 33, + 16, + 12, + 12, + 8, + 10, + 21, + 14, + 19, + 32, + 12, + 13, + 16, + 7, + 34, + 44, + 17, + 37 + ], + "weighted_loads": [ + 1.691573035903275, + 0.5698186829686165, + 2.8654193691909313, + 3.238642543554306, + 0.7894568629562855, + 1.7204873748123646, + 0.6551117124035954, + 2.601602081209421, + 2.151236357167363, + 1.297826575115323, + 0.30340801551938057, + 0.38902399223297834, + 0.44138931669294834, + 0.04095713887363672, + 1.6443689540028572, + 0.11723010987043381, + 0.8507755994796753, + 1.5778046566992998, + 0.9477077722549438, + 0.6931018382310867, + 2.151666274294257, + 2.5005469992756844, + 0.5662589706480503, + 0.8547453265637159, + 0.9818976502865553, + 0.3640735596418381, + 0.3039865270256996, + 0.36842506751418114, + 0.6516757421195507, + 0.43695035949349403, + 0.615682277828455, + 1.5177484899759293, + 0.7961200224235654, + 0.9900189824402332, + 0.14295421913266182, + 0.6268305238336325, + 0.7540062870830297, + 0.25245768390595913, + 0.8372037215158343, + 2.6736245900392532, + 1.8966016471385956, + 1.3335191942751408, + 0.9636129792779684, + 0.9712297078222036, + 0.5694272182881832, + 0.3764508292078972, + 2.9751226529479027, + 0.8545736148953438, + 0.4505145400762558, + 0.7483223527669907, + 0.4075411595404148, + 0.5465635843575001, + 1.0374755766242743, + 0.515892643481493, + 1.0305183716118336, + 2.041928431019187, + 0.5713835349306464, + 0.5243081748485565, + 1.2605126425623894, + 0.321099229156971, + 3.879332412034273, + 2.4432724621146917, + 0.7511886395514011, + 1.660645917057991 + ], + "unique_experts": 64, + "load_cv": 0.5610514893750917, + "normalized_load_entropy": 0.9631813880991336, + "max_load_share": 0.038394415357766144 + } + }, + "s1_eos": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "3205011549d6b864518138408e80f6d93d675fdaf1a9e31f96e1987cd2206e84", + "route_weight_sha256": "7c0a2e678dc043dea338c4d27dbdc11b98e501f5e20ba1efe0948123c072fe1e", + "loads": [ + 24, + 9, + 32, + 17, + 15, + 33, + 5, + 9, + 23, + 16, + 7, + 6, + 9, + 1, + 12, + 2, + 14, + 19, + 15, + 20, + 37, + 27, + 12, + 13, + 22, + 6, + 7, + 7, + 10, + 9, + 15, + 24, + 21, + 19, + 1, + 14, + 11, + 7, + 15, + 37, + 21, + 24, + 10, + 21, + 14, + 9, + 32, + 15, + 8, + 10, + 6, + 10, + 18, + 10, + 20, + 18, + 8, + 11, + 16, + 8, + 25, + 36, + 15, + 29 + ], + "weighted_loads": [ + 1.5916606057435274, + 0.35234309546649456, + 2.7755590714514256, + 1.3404763415455818, + 0.8129258435219526, + 1.5649603195488453, + 0.40907230228185654, + 2.630499079823494, + 1.011015510186553, + 1.1736407205462456, + 0.2925994899123907, + 0.3322151079773903, + 0.4170400518923998, + 0.03124072216451168, + 0.5318985376507044, + 0.08015734702348709, + 0.8420451171696186, + 1.5498053953051567, + 0.8647240214049816, + 0.8044322617352009, + 2.152624512091279, + 1.9135391879826784, + 0.524462366476655, + 0.8452442027628422, + 0.9332296140491962, + 0.32070549577474594, + 0.2904625926166773, + 0.2594473995268345, + 0.6591560021042824, + 0.3503425307571888, + 0.6217863634228706, + 1.7169398292899132, + 0.7697259392589331, + 0.7413577120751143, + 0.045734405517578125, + 0.5589454360306263, + 0.7091404274106026, + 0.2507951371371746, + 0.8320531751960516, + 2.5788669511675835, + 1.647574245929718, + 1.2620258666574955, + 0.6886430755257607, + 0.930069537833333, + 0.5762531235814095, + 0.34369252249598503, + 2.9436988085508347, + 0.8066518697887659, + 0.28940982185304165, + 0.5609236862510443, + 0.27216869592666626, + 0.5336098223924637, + 0.889663852751255, + 0.4221922345459461, + 1.0607422664761543, + 0.937034085392952, + 0.40031979512423277, + 0.45988919772207737, + 1.288298062980175, + 0.32423051819205284, + 2.537675641477108, + 2.1724989283829927, + 0.6704731900244951, + 1.2644257582724094 + ], + "unique_experts": 64, + "load_cv": 0.5662365767993705, + "normalized_load_entropy": 0.9612727061205715, + "max_load_share": 0.03714859437751004 + }, + "full_input": { + "tokens": 207, + "top_k": 6, + "decisions": 1242, + "ordered_route_sha256": "36d3128aba59bb5374ff15d1e7566647aae8c07d01859fe18461598f6faad5aa", + "route_weight_sha256": "22d984b3e662dea71793a27d323b74076e0e30d6a394c213f8539657e4120224", + "loads": [ + 27, + 14, + 32, + 28, + 15, + 37, + 10, + 11, + 45, + 25, + 7, + 11, + 12, + 1, + 17, + 6, + 17, + 21, + 16, + 20, + 38, + 41, + 13, + 13, + 23, + 7, + 7, + 10, + 11, + 9, + 16, + 24, + 23, + 29, + 9, + 19, + 13, + 8, + 15, + 37, + 32, + 25, + 15, + 23, + 14, + 9, + 33, + 17, + 12, + 13, + 16, + 13, + 25, + 13, + 20, + 39, + 12, + 11, + 20, + 8, + 40, + 46, + 15, + 34 + ], + "weighted_loads": [ + 1.7421169644221663, + 0.81251628883183, + 2.7755590714514256, + 3.4866316467523575, + 0.8129258435219526, + 1.682992236688733, + 0.6935860449448228, + 2.71052635461092, + 2.810758216306567, + 1.6332407370209694, + 0.2925994899123907, + 0.636125541292131, + 0.5556072052568197, + 0.03124072216451168, + 1.4583566691726446, + 0.31390414014458656, + 0.9869479648768902, + 1.5997516997158527, + 0.9037656337022781, + 0.8044322617352009, + 2.2029621433466673, + 2.9835567455738783, + 0.5664929132908583, + 0.8452442027628422, + 0.9632651824504137, + 0.3462923336774111, + 0.2904625926166773, + 0.35748331248760223, + 0.742147907614708, + 0.3503425307571888, + 0.6795544065535069, + 1.7169398292899132, + 0.8247219817712903, + 1.115435777232051, + 0.3858684152364731, + 0.7761813104152679, + 0.7998885810375214, + 0.2852720022201538, + 0.8320531751960516, + 2.5788669511675835, + 2.352460341528058, + 1.2873089276254177, + 1.0304221771657467, + 1.0675628129392862, + 0.5762531235814095, + 0.34369252249598503, + 2.9779424965381622, + 0.8724267780780792, + 0.4481777809560299, + 1.0730912666767836, + 0.7681552805006504, + 0.7401061505079269, + 1.5697313211858273, + 0.5313537437468767, + 1.0607422664761543, + 2.6770546259358525, + 0.6271048774942756, + 0.45988919772207737, + 1.3738718060776591, + 0.32423051819205284, + 4.696452394127846, + 2.5962822642177343, + 0.6704731900244951, + 1.5534470230340958 + ], + "unique_experts": 64, + "load_cv": 0.5511458870516487, + "normalized_load_entropy": 0.9647239549602731, + "max_load_share": 0.037037037037037035 + } + }, + "s0_bos": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "df1f3bdcfd9b5273bb143829d38610cc03fdefc4ca99a65f24fef5cab60e3d74", + "route_weight_sha256": "79d6819fe3bbfe554a56377beae498cadd71f3c5c458a2430aea9617b7ee15ee", + "loads": [ + 23, + 14, + 32, + 16, + 14, + 33, + 7, + 7, + 19, + 15, + 6, + 6, + 8, + 1, + 12, + 3, + 13, + 21, + 16, + 20, + 36, + 26, + 13, + 14, + 22, + 6, + 5, + 8, + 10, + 12, + 14, + 22, + 22, + 19, + 1, + 16, + 12, + 4, + 14, + 36, + 21, + 22, + 10, + 20, + 16, + 7, + 35, + 15, + 9, + 10, + 6, + 10, + 18, + 12, + 20, + 18, + 10, + 9, + 16, + 6, + 27, + 34, + 18, + 29 + ], + "weighted_loads": [ + 1.6676516439765692, + 0.5281394366174936, + 2.814907342195511, + 1.2889161091297865, + 0.8084196969866753, + 1.5876751504838467, + 0.47652148455381393, + 2.1380435302853584, + 0.9245987385511398, + 1.1575034745037556, + 0.26520182751119137, + 0.338962085545063, + 0.40207439661026, + 0.034714508801698685, + 0.5524646732956171, + 0.11854491382837296, + 0.8014990426599979, + 1.6011799965053797, + 0.950796727091074, + 0.7966017164289951, + 2.073069153353572, + 1.984379980713129, + 0.5631866957992315, + 0.9415573142468929, + 0.9012453202158213, + 0.2982161305844784, + 0.23584092035889626, + 0.30263992957770824, + 0.6862561050802469, + 0.46791866049170494, + 0.5690679755061865, + 1.6390336900949478, + 0.8009553924202919, + 0.7356116119772196, + 0.04305640235543251, + 0.6413314510136843, + 0.748291028663516, + 0.14644809998571873, + 0.8033856004476547, + 2.6181111987680197, + 1.7226967830210924, + 1.2048994451761246, + 0.7026965823024511, + 0.8904442191123962, + 0.6355230286717415, + 0.2874801643192768, + 2.9945170506834984, + 0.823974721133709, + 0.3106587938964367, + 0.5675036329776049, + 0.2590921949595213, + 0.5326967313885689, + 0.9081250913441181, + 0.4804070647805929, + 1.0497022960335016, + 0.9429223537445068, + 0.49162471666932106, + 0.4158467445522547, + 1.2865907959640026, + 0.25898123998194933, + 2.6602894216775894, + 2.0806977562606335, + 0.8096941839903593, + 1.2806333638727665 + ], + "unique_experts": 64, + "load_cv": 0.5602805473197982, + "normalized_load_entropy": 0.9616118817426936, + "max_load_share": 0.03614457831325301 + }, + "full_input": { + "tokens": 191, + "top_k": 6, + "decisions": 1146, + "ordered_route_sha256": "eb89d43e1d45167c800cd7f1d0ab9342e02e07f11155e47031e0bc54e8fbf8a1", + "route_weight_sha256": "1435fbaf90c4204797f9a172c3eb1ee51ea679c1ca29c698fe6adc62da99c169", + "loads": [ + 27, + 14, + 34, + 24, + 14, + 36, + 10, + 8, + 32, + 20, + 7, + 7, + 8, + 1, + 15, + 4, + 13, + 22, + 16, + 20, + 36, + 33, + 14, + 14, + 24, + 8, + 5, + 13, + 10, + 12, + 15, + 22, + 24, + 25, + 2, + 21, + 12, + 7, + 14, + 36, + 25, + 23, + 14, + 20, + 16, + 8, + 35, + 15, + 14, + 12, + 8, + 10, + 19, + 14, + 20, + 30, + 14, + 11, + 17, + 6, + 37, + 42, + 18, + 39 + ], + "weighted_loads": [ + 1.840932517312467, + 0.5281394366174936, + 2.8931753784418106, + 2.270394181832671, + 0.8084196969866753, + 1.654161810874939, + 0.6969682611525059, + 3.0547143891453743, + 2.0430713668465614, + 1.3399008587002754, + 0.28192693926393986, + 0.35141812544316053, + 0.40207439661026, + 0.034714508801698685, + 1.6082925237715244, + 0.16217167675495148, + 0.8014990426599979, + 1.6271304972469807, + 0.950796727091074, + 0.7966017164289951, + 2.073069153353572, + 2.5121957808732986, + 0.5936783067882061, + 0.9415573142468929, + 0.9388020159676671, + 0.35954928770661354, + 0.23584092035889626, + 0.4890577644109726, + 0.6862561050802469, + 0.46791866049170494, + 0.6128731314092875, + 1.6390336900949478, + 0.8691359274089336, + 0.9483265653252602, + 0.10674012079834938, + 0.8584297765046358, + 0.748291028663516, + 0.2857076842337847, + 0.8033856004476547, + 2.6181111987680197, + 1.9482919219881296, + 1.2857022434473038, + 0.8565285783261061, + 0.8904442191123962, + 0.6355230286717415, + 0.31178261153399944, + 2.9945170506834984, + 0.823974721133709, + 0.5765281207859516, + 0.6976483496837318, + 0.37763415090739727, + 0.5326967313885689, + 0.9818972237408161, + 0.5369050819426775, + 1.0497022960335016, + 1.9931062068790197, + 0.6493201851844788, + 0.45044894609600306, + 1.3039114456623793, + 0.25898123998194933, + 4.012342490255833, + 2.361238295212388, + 0.8096941839903593, + 1.6835162583738565 + ], + "unique_experts": 64, + "load_cv": 0.5552015294541445, + "normalized_load_entropy": 0.962686157903298, + "max_load_share": 0.03664921465968586 + } + }, + "s1_bos": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "7eafd3c96a4eedc1462fa9badd8857f6790b4ead2b343648a6342ceb07b8c3ca", + "route_weight_sha256": "6bdfc0c61a9e3e15be166bf4f3f345de6be5fc660bf5e6997546ce1b6e4c20d1", + "loads": [ + 25, + 13, + 32, + 20, + 13, + 32, + 4, + 8, + 19, + 16, + 7, + 7, + 8, + 1, + 11, + 2, + 12, + 19, + 16, + 20, + 39, + 25, + 12, + 14, + 21, + 7, + 5, + 10, + 10, + 11, + 15, + 22, + 22, + 19, + 2, + 11, + 13, + 5, + 15, + 36, + 21, + 23, + 9, + 17, + 16, + 10, + 33, + 17, + 9, + 10, + 6, + 11, + 17, + 13, + 22, + 18, + 9, + 12, + 14, + 7, + 25, + 35, + 16, + 27 + ], + "weighted_loads": [ + 1.7384706642478704, + 0.5182523652911186, + 2.734801147133112, + 1.4345085136592388, + 0.7733040358871222, + 1.5154367350041866, + 0.3769712783396244, + 2.0318656861782074, + 0.9202322922646999, + 1.1847569420933723, + 0.29572216235101223, + 0.3555998057126999, + 0.40108603052794933, + 0.032942529767751694, + 0.5436695441603661, + 0.09072616323828697, + 0.7800168767571449, + 1.4810978025197983, + 0.940246157348156, + 0.7978317812085152, + 2.2564776446670294, + 1.9084129482507706, + 0.5312130153179169, + 0.9483979977667332, + 0.897836048156023, + 0.3454534262418747, + 0.23296145722270012, + 0.3505995310842991, + 0.670827591791749, + 0.4287593010812998, + 0.6020555943250656, + 1.663099667057395, + 0.8055866826325655, + 0.7890845891088247, + 0.0822460874915123, + 0.47701050713658333, + 0.7965339329093695, + 0.18477029167115688, + 0.8601080290973186, + 2.565908608958125, + 1.6685388907790184, + 1.227863870561123, + 0.6892794519662857, + 0.8170446641743183, + 0.6232089549303055, + 0.38386633060872555, + 2.9527932684868574, + 0.9006951171904802, + 0.30349755100905895, + 0.5667935647070408, + 0.2617913745343685, + 0.5641446504741907, + 0.905694030225277, + 0.5282652154564857, + 1.1350127551704645, + 0.9484733175486326, + 0.4480775995180011, + 0.54179298132658, + 1.2109449692070484, + 0.2954096430912614, + 2.5543866641819477, + 2.0635682214051485, + 0.7442604657262564, + 1.2364972326904535 + ], + "unique_experts": 64, + "load_cv": 0.5539112130781231, + "normalized_load_entropy": 0.9629473902243624, + "max_load_share": 0.0391566265060241 + }, + "full_input": { + "tokens": 207, + "top_k": 6, + "decisions": 1242, + "ordered_route_sha256": "5cdb08cd50cb71c599a217892f42de2138a4ddb901b9496263644a18cebb51e1", + "route_weight_sha256": "d7aacc4b045e6011c144df171d22acedf60bb4a47b98282d1d5cc9e95fe10c06", + "loads": [ + 28, + 17, + 32, + 30, + 13, + 34, + 8, + 10, + 40, + 25, + 7, + 13, + 11, + 1, + 15, + 7, + 15, + 21, + 17, + 20, + 40, + 37, + 13, + 14, + 22, + 8, + 5, + 14, + 11, + 11, + 16, + 22, + 23, + 30, + 11, + 18, + 15, + 8, + 15, + 36, + 32, + 24, + 14, + 19, + 16, + 10, + 34, + 19, + 15, + 13, + 15, + 14, + 23, + 17, + 22, + 38, + 13, + 12, + 16, + 7, + 41, + 45, + 16, + 34 + ], + "weighted_loads": [ + 1.8889270229265094, + 0.9377755746245384, + 2.734801147133112, + 2.685817200690508, + 0.7733040358871222, + 1.557460680603981, + 0.6515139974653721, + 2.1118929609656334, + 2.6881144661456347, + 1.6443569585680962, + 0.29572216235101223, + 0.7233567116782069, + 0.5396531838923693, + 0.032942529767751694, + 1.2174250781536102, + 0.3666010946035385, + 0.9249197244644165, + 1.5310441069304943, + 0.9792877696454525, + 0.7978317812085152, + 2.3068152759224176, + 2.8942202255129814, + 0.5732435621321201, + 0.9483979977667332, + 0.9274138156324625, + 0.37104026414453983, + 0.23296145722270012, + 0.49910013750195503, + 0.7538194973021746, + 0.4287593010812998, + 0.637241642922163, + 1.663099667057395, + 0.8545259702950716, + 1.1887163538485765, + 0.4508259389549494, + 0.7901886515319347, + 0.8872820865362883, + 0.2976516354829073, + 0.8601080290973186, + 2.565908608958125, + 2.374913388863206, + 1.253146931529045, + 1.0284284055233002, + 0.9545379392802715, + 0.6232089549303055, + 0.38386633060872555, + 2.987036956474185, + 0.9664700254797935, + 0.6364400312304497, + 1.1104868091642857, + 0.7116611488163471, + 0.770640978589654, + 1.5432090610265732, + 0.690859317779541, + 1.1350127551704645, + 2.678530279546976, + 0.6748626818880439, + 0.54179298132658, + 1.2737589292228222, + 0.2954096430912614, + 4.756083834916353, + 2.48735155723989, + 0.7442604657262564, + 1.6440222933888435 + ], + "unique_experts": 64, + "load_cv": 0.526190726489356, + "normalized_load_entropy": 0.9674316528276523, + "max_load_share": 0.036231884057971016 + } + }, + "s0_x": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "f01eb8417cab4f20edae7aed9eaa5913192c02b922e7b2048a72999fc37743f7", + "route_weight_sha256": "d6b1d40cd765bb64a07afea90c710d5ea6f3bb711fb3dba88378ee2d23832fae", + "loads": [ + 24, + 12, + 31, + 17, + 14, + 34, + 5, + 9, + 21, + 18, + 7, + 6, + 9, + 1, + 13, + 1, + 13, + 21, + 16, + 19, + 35, + 27, + 11, + 13, + 22, + 6, + 5, + 8, + 10, + 12, + 15, + 21, + 21, + 18, + 1, + 14, + 12, + 4, + 14, + 38, + 23, + 23, + 9, + 19, + 16, + 9, + 33, + 14, + 8, + 10, + 8, + 12, + 18, + 10, + 20, + 19, + 10, + 8, + 16, + 7, + 28, + 36, + 15, + 27 + ], + "weighted_loads": [ + 1.6165276002138853, + 0.4759392887353897, + 2.8162210397422314, + 1.376106457784772, + 0.8040351457893848, + 1.6350310798734426, + 0.4010905660688877, + 2.0891178101301193, + 0.954032089561224, + 1.2494055703282356, + 0.2905833814293146, + 0.33276283368468285, + 0.4263297561556101, + 0.03496735915541649, + 0.5817547794431448, + 0.05152976140379906, + 0.8091159872710705, + 1.592930505052209, + 0.9331018850207329, + 0.7588620912283659, + 2.046348888427019, + 1.9876607488840818, + 0.5013067554682493, + 0.9240684863179922, + 0.9037086702883244, + 0.2961192671209574, + 0.23104656115174294, + 0.29206573963165283, + 0.678634513169527, + 0.4563970621675253, + 0.6024670917540789, + 1.6012602001428604, + 0.7444172911345959, + 0.7158807925879955, + 0.0475134514272213, + 0.5729968175292015, + 0.7219552155584097, + 0.1465477254241705, + 0.8153435233980417, + 2.6603858564049006, + 1.8361735586076975, + 1.2267883904278278, + 0.6681667976081371, + 0.8534994348883629, + 0.6170451696962118, + 0.33401732333004475, + 2.8974480368196964, + 0.7954175397753716, + 0.29082551412284374, + 0.5658948346972466, + 0.3977469727396965, + 0.5929912980645895, + 0.9319472014904022, + 0.3983871638774872, + 1.042692119255662, + 1.0420350171625614, + 0.4992265161126852, + 0.39457508362829685, + 1.2668626084923744, + 0.2734659155830741, + 2.613234795629978, + 2.1565316133201122, + 0.7041001785546541, + 1.2432062067091465 + ], + "unique_experts": 64, + "load_cv": 0.5658946636739662, + "normalized_load_entropy": 0.9606572139155424, + "max_load_share": 0.03815261044176707 + }, + "full_input": { + "tokens": 191, + "top_k": 6, + "decisions": 1146, + "ordered_route_sha256": "846de895fe37f0aca832a09e421065fbf28b68d909e6d02b9a96ab0542e01b6e", + "route_weight_sha256": "485b50c2a129c1bfffb207dd6dbeb96708145140940d30e6946e9961bdeb5742", + "loads": [ + 29, + 13, + 33, + 26, + 14, + 37, + 9, + 9, + 35, + 24, + 7, + 7, + 9, + 1, + 16, + 1, + 13, + 23, + 16, + 19, + 35, + 35, + 12, + 13, + 23, + 8, + 5, + 10, + 10, + 12, + 16, + 21, + 23, + 26, + 2, + 17, + 12, + 5, + 14, + 38, + 27, + 24, + 14, + 19, + 16, + 10, + 33, + 14, + 11, + 12, + 11, + 12, + 19, + 12, + 20, + 35, + 14, + 9, + 17, + 7, + 37, + 45, + 15, + 35 + ], + "weighted_loads": [ + 1.8280683597549796, + 0.5181109011173248, + 2.894489075988531, + 2.44193615950644, + 0.8040351457893848, + 1.705767773091793, + 0.6922412142157555, + 2.0891178101301193, + 2.131189312785864, + 1.4627394266426563, + 0.2905833814293146, + 0.34521887358278036, + 0.4263297561556101, + 0.03496735915541649, + 1.6963292863219976, + 0.05152976140379906, + 0.8091159872710705, + 1.6547463722527027, + 0.9331018850207329, + 0.7588620912283659, + 2.046348888427019, + 2.5939637143164873, + 0.5317983664572239, + 0.9240684863179922, + 0.9294022154062986, + 0.35745242424309254, + 0.23104656115174294, + 0.3627543915063143, + 0.678634513169527, + 0.4563970621675253, + 0.6427122931927443, + 1.6012602001428604, + 0.8125978261232376, + 1.0132940616458654, + 0.11119716987013817, + 0.6868075914680958, + 0.7219552155584097, + 0.1893333848565817, + 0.8153435233980417, + 2.6603858564049006, + 2.067155921831727, + 1.3060926087200642, + 0.925248384475708, + 0.8534994348883629, + 0.6170451696962118, + 0.3583197705447674, + 2.8974480368196964, + 0.7954175397753716, + 0.4064447917044163, + 0.818061463534832, + 0.5724472738802433, + 0.5929912980645895, + 1.004689484834671, + 0.45861494541168213, + 1.042692119255662, + 2.349783629179001, + 0.6569219846278429, + 0.420204596593976, + 1.2830866686999798, + 0.2734659155830741, + 3.960327409207821, + 2.4909252170473337, + 0.7041001785546541, + 1.544932696968317 + ], + "unique_experts": 64, + "load_cv": 0.579256798474025, + "normalized_load_entropy": 0.9593091374700439, + "max_load_share": 0.03926701570680628 + } + }, + "s1_x": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "33655f6e203bb29bd9485880bb39fe23fed72e6d5fa12f1e938a35968d431e82", + "route_weight_sha256": "d1005fd71298114d51d41b824b01b4fb3d96083134d93ccf7425ed362ff23505", + "loads": [ + 24, + 15, + 33, + 19, + 14, + 33, + 6, + 9, + 24, + 16, + 6, + 6, + 9, + 1, + 11, + 1, + 13, + 20, + 16, + 20, + 37, + 27, + 11, + 12, + 20, + 7, + 7, + 7, + 11, + 11, + 12, + 24, + 17, + 15, + 4, + 15, + 11, + 6, + 15, + 34, + 23, + 23, + 8, + 18, + 16, + 7, + 30, + 15, + 8, + 10, + 7, + 10, + 19, + 12, + 20, + 23, + 8, + 11, + 16, + 9, + 25, + 39, + 14, + 26 + ], + "weighted_loads": [ + 1.6994308549910784, + 0.5895319543778896, + 2.8181777335703373, + 1.4725023563951254, + 0.7944033239036798, + 1.5539134182035923, + 0.4290403015911579, + 2.4670795015990734, + 1.0559186153113842, + 1.1802843045443296, + 0.24764966778457165, + 0.3365402966737747, + 0.4408278316259384, + 0.0331207700073719, + 0.5103806350380182, + 0.04904814064502716, + 0.8242800049483776, + 1.385078776627779, + 0.8978230729699135, + 0.7766580563038588, + 2.175321152433753, + 2.039839245378971, + 0.4726559203118086, + 0.8518017902970314, + 0.8420720063149929, + 0.34887297451496124, + 0.2971807233989239, + 0.2561475448310375, + 0.6827503368258476, + 0.43101077526807785, + 0.4962278660386801, + 1.749262748286128, + 0.6278346758335829, + 0.6202240828424692, + 0.1326973307877779, + 0.6004000473767519, + 0.6986496653407812, + 0.21341142244637012, + 0.8449178840965033, + 2.5337132681161165, + 1.7977596279233694, + 1.2289924807846546, + 0.6393366046249866, + 0.8485672455281019, + 0.6286280378699303, + 0.28295037150382996, + 2.8413288295269012, + 0.8264764118939638, + 0.2894723154604435, + 0.5576176419854164, + 0.31937819346785545, + 0.5465391408652067, + 0.9906781502068043, + 0.4771934896707535, + 1.0450026597827673, + 1.1916438452899456, + 0.40306982584297657, + 0.4816330373287201, + 1.2589793242514133, + 0.3468506820499897, + 2.4578441344201565, + 2.340084483847022, + 0.6513214446604252, + 1.2006771489977837 + ], + "unique_experts": 64, + "load_cv": 0.5572786619858364, + "normalized_load_entropy": 0.9628655397587003, + "max_load_share": 0.0391566265060241 + }, + "full_input": { + "tokens": 207, + "top_k": 6, + "decisions": 1242, + "ordered_route_sha256": "fb10f9634f4ae452741fc335fd54cfa4837863e48ed7ca9f170b260652216882", + "route_weight_sha256": "606ac45c4b3adf104db7d93db8de6a2c7b0c93f4c0d9f48d327708841cce8148", + "loads": [ + 27, + 19, + 33, + 32, + 14, + 37, + 11, + 11, + 46, + 26, + 6, + 10, + 12, + 1, + 15, + 5, + 16, + 22, + 17, + 20, + 38, + 41, + 12, + 12, + 20, + 8, + 7, + 8, + 12, + 11, + 13, + 24, + 18, + 25, + 12, + 21, + 13, + 7, + 15, + 34, + 35, + 24, + 13, + 20, + 16, + 7, + 31, + 17, + 11, + 13, + 17, + 13, + 26, + 16, + 20, + 47, + 12, + 11, + 18, + 9, + 40, + 51, + 14, + 30 + ], + "weighted_loads": [ + 1.8498872136697173, + 1.0090551637113094, + 2.8181777335703373, + 2.829351397231221, + 0.7944033239036798, + 1.6453174855560064, + 0.7442223727703094, + 2.5471067763864994, + 2.85265982337296, + 1.684165010228753, + 0.24764966778457165, + 0.6231840727850795, + 0.5793949849903584, + 0.0331207700073719, + 1.1274170074611902, + 0.28279493376612663, + 0.9691828526556492, + 1.435025081038475, + 0.93686468526721, + 0.7766580563038588, + 2.2256587836891413, + 3.1580521129071712, + 0.5146864671260118, + 0.8518017902970314, + 0.8420720063149929, + 0.3744598124176264, + 0.2971807233989239, + 0.29011793434619904, + 0.7657422423362732, + 0.43101077526807785, + 0.5223650839179754, + 1.749262748286128, + 0.676773963496089, + 0.9987534713000059, + 0.47283134050667286, + 0.8648364841938019, + 0.7893978189677, + 0.25865340419113636, + 0.8449178840965033, + 2.5337132681161165, + 2.537972066551447, + 1.2542755417525768, + 1.0476261787116528, + 0.9860605206340551, + 0.6286280378699303, + 0.28295037150382996, + 2.875572517514229, + 0.8922513201832771, + 0.4219307601451874, + 1.1122830882668495, + 0.8122145123779774, + 0.75303546898067, + 1.665714967995882, + 0.6367898248136044, + 1.0450026597827673, + 3.2818843107670546, + 0.6298549082130194, + 0.4816330373287201, + 1.3217932842671871, + 0.3468506820499897, + 4.523229379206896, + 2.915861451998353, + 0.6513214446604252, + 1.4127702042460442 + ], + "unique_experts": 64, + "load_cv": 0.5751633284923022, + "normalized_load_entropy": 0.9624281616071036, + "max_load_share": 0.04106280193236715 + } + }, + "s0_period": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "a4e3676de38d5f69c3ff3e1c3155960db560607d36bc5c905a8d6671dab90748", + "route_weight_sha256": "4228260dd6f458fef43e1ade8d482e2ea51197162181183918b0d69bccdeac1f", + "loads": [ + 21, + 14, + 32, + 17, + 14, + 35, + 9, + 8, + 23, + 17, + 6, + 6, + 9, + 1, + 13, + 1, + 13, + 19, + 16, + 18, + 36, + 25, + 12, + 15, + 21, + 6, + 5, + 9, + 11, + 11, + 17, + 22, + 21, + 16, + 1, + 14, + 12, + 4, + 15, + 37, + 22, + 24, + 9, + 16, + 15, + 6, + 34, + 16, + 9, + 10, + 6, + 11, + 18, + 14, + 19, + 19, + 9, + 8, + 15, + 8, + 28, + 36, + 15, + 27 + ], + "weighted_loads": [ + 1.5059008970856667, + 0.5405013523995876, + 2.825583918020129, + 1.3460645861923695, + 0.8182087354362011, + 1.6678481176495552, + 0.5262943990528584, + 2.0758273489773273, + 1.0440506283193827, + 1.24180637486279, + 0.2606309652328491, + 0.3350623734295368, + 0.4285047221928835, + 0.034759193658828735, + 0.5855147764086723, + 0.053488604724407196, + 0.8078502416610718, + 1.5602221749722958, + 0.948885191231966, + 0.7423248775303364, + 2.104748908430338, + 1.952560056000948, + 0.5346803236752748, + 0.9781285021454096, + 0.8770561907440424, + 0.3024495653808117, + 0.2347467541694641, + 0.3431293684989214, + 0.7073791902512312, + 0.43111761659383774, + 0.6605737153440714, + 1.6418671645224094, + 0.7538244184106588, + 0.6556085925549269, + 0.04879016429185867, + 0.5839701537042856, + 0.7342487294226885, + 0.1464905608445406, + 0.8472597468644381, + 2.641180459409952, + 1.7716240156441927, + 1.265176061540842, + 0.6707048751413822, + 0.7562893368303776, + 0.5896557625383139, + 0.24678799882531166, + 2.9520314559340477, + 0.8565897382795811, + 0.3356563560664654, + 0.5727935899049044, + 0.3259742297232151, + 0.5802708435803652, + 0.9424156844615936, + 0.538147360086441, + 1.0266400072723627, + 1.0249922685325146, + 0.4582682205364108, + 0.3735721707344055, + 1.231172326952219, + 0.30947570968419313, + 2.6497508585453033, + 2.1698255967348814, + 0.7284455429762602, + 1.2335424404591322 + ], + "unique_experts": 64, + "load_cv": 0.5634954628558123, + "normalized_load_entropy": 0.9611242674657484, + "max_load_share": 0.03714859437751004 + }, + "full_input": { + "tokens": 191, + "top_k": 6, + "decisions": 1146, + "ordered_route_sha256": "863a15f8cec28da6efbce23f7be9e0c2e2ecbf19fda3953b7656b58e28b8e2dd", + "route_weight_sha256": "2eb3bf45e1497940f5d9dc010f4e897f317485d1920eaf3dc56d2f51391fff56", + "loads": [ + 26, + 15, + 35, + 26, + 14, + 38, + 12, + 8, + 37, + 22, + 6, + 7, + 9, + 1, + 17, + 1, + 13, + 21, + 16, + 18, + 36, + 33, + 13, + 15, + 22, + 8, + 5, + 12, + 11, + 12, + 17, + 22, + 23, + 22, + 2, + 17, + 12, + 5, + 15, + 37, + 27, + 25, + 14, + 16, + 15, + 7, + 34, + 16, + 13, + 11, + 10, + 11, + 19, + 17, + 19, + 33, + 13, + 9, + 16, + 8, + 38, + 44, + 15, + 35 + ], + "weighted_loads": [ + 1.713870950974524, + 0.6344393528997898, + 2.9303951412439346, + 2.3542474061250687, + 0.8182087354362011, + 1.7349489871412516, + 0.7467411756515503, + 2.0758273489773273, + 2.219351429492235, + 1.42420375905931, + 0.2606309652328491, + 0.34751841332763433, + 0.4285047221928835, + 0.034759193658828735, + 1.5934339240193367, + 0.053488604724407196, + 0.8078502416610718, + 1.6363433171063662, + 0.948885191231966, + 0.7423248775303364, + 2.104748908430338, + 2.569717951118946, + 0.5651719346642494, + 0.9781285021454096, + 0.9057735409587622, + 0.36378272250294685, + 0.2347467541694641, + 0.45658960565924644, + 0.7073791902512312, + 0.4792150966823101, + 0.6605737153440714, + 1.6418671645224094, + 0.8220049533993006, + 0.8671545460820198, + 0.11247388273477554, + 0.7164264097809792, + 0.7342487294226885, + 0.20721072889864445, + 0.8472597468644381, + 2.641180459409952, + 2.0584944430738688, + 1.3585259653627872, + 0.9061848372220993, + 0.7562893368303776, + 0.5896557625383139, + 0.2710904460400343, + 2.9520314559340477, + 0.8565897382795811, + 0.49792029336094856, + 0.6986220348626375, + 0.579927783459425, + 0.5802708435803652, + 1.0198031663894653, + 0.6514254249632359, + 1.0266400072723627, + 2.2226916644722223, + 0.6159636890515685, + 0.3992016837000847, + 1.2532785404473543, + 0.30947570968419313, + 4.041968781501055, + 2.450366135686636, + 0.7284455429762602, + 1.5610628705471754 + ], + "unique_experts": 64, + "load_cv": 0.5729124692608684, + "normalized_load_entropy": 0.9601277486802056, + "max_load_share": 0.038394415357766144 + } + }, + "s1_period": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "d29040099a286f77d76d093b75c68fb218ab9b2649538dd1537ba194cc560a92", + "route_weight_sha256": "54db8997166425171831fcf8ed67a7f9490f3db656bf8bf62260d1fe0687be21", + "loads": [ + 24, + 12, + 31, + 16, + 13, + 32, + 5, + 8, + 26, + 15, + 6, + 6, + 9, + 1, + 13, + 2, + 11, + 17, + 17, + 21, + 37, + 26, + 12, + 12, + 21, + 8, + 5, + 7, + 10, + 12, + 12, + 21, + 20, + 14, + 4, + 15, + 12, + 6, + 15, + 39, + 23, + 23, + 9, + 20, + 17, + 7, + 32, + 15, + 8, + 10, + 6, + 11, + 20, + 10, + 21, + 23, + 8, + 12, + 15, + 9, + 25, + 38, + 13, + 28 + ], + "weighted_loads": [ + 1.6531127858906984, + 0.48516779765486717, + 2.765185873955488, + 1.4004348870366812, + 0.7453750986605883, + 1.5063671488314867, + 0.3956330493092537, + 2.4776848033070564, + 1.1760869547724724, + 1.1395270396023989, + 0.2449244149029255, + 0.3397681750357151, + 0.4532996565103531, + 0.032595667988061905, + 0.6518972851336002, + 0.08315063267946243, + 0.7360419891774654, + 1.3447599112987518, + 0.9348730780184269, + 0.8359571751207113, + 2.1993092875927687, + 1.9913750775158405, + 0.5240291357040405, + 0.8470271825790405, + 0.8833464235067368, + 0.3764218110591173, + 0.23524560034275055, + 0.26153226755559444, + 0.6671419367194176, + 0.4798181839287281, + 0.4835161827504635, + 1.641569010913372, + 0.6995601411908865, + 0.583686975762248, + 0.13129862863570452, + 0.6028121709823608, + 0.7445251159369946, + 0.20533467456698418, + 0.86082324385643, + 2.6906324680894613, + 1.8025948405265808, + 1.2187942676246166, + 0.6704165395349264, + 0.9153470788151026, + 0.6802515666931868, + 0.28114362247288227, + 2.9175350796431303, + 0.8276919834315777, + 0.2820612732321024, + 0.5530055984854698, + 0.2745521403849125, + 0.5657324977219105, + 1.0061724111437798, + 0.42303478717803955, + 1.0751882530748844, + 1.2184306625276804, + 0.38884834572672844, + 0.5255171954631805, + 1.2150423265993595, + 0.35423791501671076, + 2.46114544197917, + 2.295711312443018, + 0.6119600404053926, + 1.2555044442415237 + ], + "unique_experts": 64, + "load_cv": 0.5704366550739675, + "normalized_load_entropy": 0.9616082110314559, + "max_load_share": 0.0391566265060241 + }, + "full_input": { + "tokens": 207, + "top_k": 6, + "decisions": 1242, + "ordered_route_sha256": "b30de88425d57eb5b7fa65224196c853949d5a2c21e9fc5d8fff9e444da75f26", + "route_weight_sha256": "e265923c39f3a0abb99fa90fde123d062f8486ee412424d666d965521e96547d", + "loads": [ + 28, + 17, + 31, + 26, + 13, + 34, + 9, + 10, + 48, + 24, + 6, + 10, + 12, + 1, + 17, + 6, + 14, + 19, + 18, + 21, + 38, + 41, + 13, + 12, + 22, + 9, + 5, + 9, + 11, + 12, + 13, + 21, + 21, + 25, + 12, + 21, + 14, + 6, + 15, + 41, + 35, + 24, + 14, + 22, + 17, + 7, + 33, + 17, + 12, + 12, + 17, + 14, + 27, + 14, + 21, + 46, + 12, + 12, + 17, + 9, + 41, + 49, + 13, + 32 + ], + "weighted_loads": [ + 1.8294836981222034, + 0.9529663734138012, + 2.765185873955488, + 2.6517435740679502, + 0.7453750986605883, + 1.5436287969350815, + 0.6701757684350014, + 2.5577120780944824, + 2.9544146806001663, + 1.5991270560771227, + 0.2449244149029255, + 0.6264119511470199, + 0.591866809874773, + 0.032595667988061905, + 1.2362079583108425, + 0.3168974258005619, + 0.880944836884737, + 1.3947062157094479, + 0.9739146903157234, + 0.8359571751207113, + 2.249646918848157, + 3.1530999429523945, + 0.5660596825182438, + 0.8470271825790405, + 0.906673626974225, + 0.40200864896178246, + 0.23524560034275055, + 0.32825744710862637, + 0.7501338422298431, + 0.4798181839287281, + 0.5226309262216091, + 1.641569010913372, + 0.7484994288533926, + 1.0055309105664492, + 0.4714326383545995, + 0.8443971294909716, + 0.8352732695639133, + 0.20533467456698418, + 0.86082324385643, + 2.7880663108080626, + 2.5554094556719065, + 1.2440773285925388, + 1.054215768352151, + 1.0528403539210558, + 0.6802515666931868, + 0.28114362247288227, + 2.951778767630458, + 0.893466891720891, + 0.44096886552870274, + 1.015712320804596, + 0.8421616144478321, + 0.7722288258373737, + 1.6961676552891731, + 0.6032406836748123, + 1.0751882530748844, + 3.2179687172174454, + 0.6156334280967712, + 0.5255171954631805, + 1.2778562866151333, + 0.35423791501671076, + 4.5977739579975605, + 2.7612832225859165, + 0.6119600404053926, + 1.4564926996827126 + ], + "unique_experts": 64, + "load_cv": 0.578973856987672, + "normalized_load_entropy": 0.9618944242196757, + "max_load_share": 0.039452495974235106 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 166, + "ordered_topk_exact_tokens": 92, + "set_exact_tokens": 114, + "mean_set_jaccard": 0.9066265060240963, + "mean_token_weighted_tv": 0.018719550048236746, + "aggregate_load_tv": 0.02811244979919679 + }, + "system_bos": { + "tokens": 166, + "ordered_topk_exact_tokens": 71, + "set_exact_tokens": 94, + "mean_set_jaccard": 0.8696213425129088, + "mean_token_weighted_tv": 0.024414424585313142, + "aggregate_load_tv": 0.03614457831325301 + }, + "system_x": { + "tokens": 166, + "ordered_topk_exact_tokens": 61, + "set_exact_tokens": 83, + "mean_set_jaccard": 0.845811818703385, + "mean_token_weighted_tv": 0.03145617529671325, + "aggregate_load_tv": 0.044176706827309245 + }, + "system_period": { + "tokens": 166, + "ordered_topk_exact_tokens": 62, + "set_exact_tokens": 92, + "mean_set_jaccard": 0.8571428571428571, + "mean_token_weighted_tv": 0.03082650365779199, + "aggregate_load_tv": 0.04819277108433735 + }, + "bos_at_s0": { + "tokens": 166, + "ordered_topk_exact_tokens": 67, + "set_exact_tokens": 88, + "mean_set_jaccard": 0.8544176706827311, + "mean_token_weighted_tv": 0.027737306402883976, + "aggregate_load_tv": 0.039156626506024084 + }, + "bos_at_s1": { + "tokens": 166, + "ordered_topk_exact_tokens": 72, + "set_exact_tokens": 102, + "mean_set_jaccard": 0.8772231784279979, + "mean_token_weighted_tv": 0.026109414643619256, + "aggregate_load_tv": 0.039156626506024104 + }, + "x_at_s0": { + "tokens": 166, + "ordered_topk_exact_tokens": 74, + "set_exact_tokens": 93, + "mean_set_jaccard": 0.866092943201377, + "mean_token_weighted_tv": 0.026446336106094252, + "aggregate_load_tv": 0.040160642570281124 + }, + "x_at_s1": { + "tokens": 166, + "ordered_topk_exact_tokens": 62, + "set_exact_tokens": 86, + "mean_set_jaccard": 0.8514629948364889, + "mean_token_weighted_tv": 0.03162174280003521, + "aggregate_load_tv": 0.03815261044176707 + }, + "period_at_s0": { + "tokens": 166, + "ordered_topk_exact_tokens": 66, + "set_exact_tokens": 88, + "mean_set_jaccard": 0.8544176706827308, + "mean_token_weighted_tv": 0.028152009514328766, + "aggregate_load_tv": 0.04518072289156627 + }, + "period_at_s1": { + "tokens": 166, + "ordered_topk_exact_tokens": 76, + "set_exact_tokens": 91, + "mean_set_jaccard": 0.8600688468158347, + "mean_token_weighted_tv": 0.030066595078973347, + "aggregate_load_tv": 0.04016064257028114 + } + } + }, + "layer_23": { + "layer": 23, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "95847e55774005e2b5e04a44fbc948aed21c8080dd530f156ad8f82f04221b9b", + "route_weight_sha256": "4bd03ad084610b39bb126d99bb47b65d3968b48c7705363574e570040adc4531", + "loads": [ + 14, + 11, + 14, + 10, + 5, + 11, + 25, + 6, + 11, + 14, + 24, + 6, + 8, + 17, + 22, + 6, + 14, + 13, + 9, + 3, + 26, + 20, + 13, + 32, + 13, + 40, + 16, + 12, + 11, + 11, + 30, + 6, + 5, + 9, + 36, + 39, + 13, + 27, + 24, + 11, + 20, + 11, + 41, + 10, + 7, + 16, + 19, + 19, + 14, + 15, + 13, + 2, + 14, + 19, + 22, + 19, + 4, + 36, + 19, + 5, + 5, + 2, + 19, + 8 + ], + "weighted_loads": [ + 0.669935803860426, + 0.6656971164047718, + 0.5825178995728493, + 0.757225202396512, + 0.2078973725438118, + 0.5059006940573454, + 1.6339524947106838, + 0.22305671498179436, + 0.533477732911706, + 0.560542406514287, + 1.4341609198600054, + 0.2249020803719759, + 0.31490410305559635, + 0.8581380918622017, + 1.5588137991726398, + 0.24528128281235695, + 1.0390535742044449, + 1.0425324067473412, + 0.5767285116016865, + 0.136323731392622, + 1.5180427487939596, + 0.7436567563563585, + 0.8309892378747463, + 2.655993651598692, + 0.46414628624916077, + 2.464355204254389, + 0.6479220353066921, + 0.6547288671135902, + 0.5806648526340723, + 0.8200623318552971, + 1.3899715933948755, + 0.20616030134260654, + 0.16481147520244122, + 0.32337773591279984, + 2.69988252222538, + 3.3028232902288437, + 0.5585212521255016, + 1.0173247698694468, + 1.5677029304206371, + 0.4247255139052868, + 0.8972236216068268, + 0.6094786264002323, + 1.6042020563036203, + 0.5723936054855585, + 0.4492959603667259, + 0.6463914662599564, + 1.0689256843179464, + 0.9256709087640047, + 0.7842081226408482, + 0.5997970085591078, + 0.5830586720257998, + 0.057978544384241104, + 0.9006290696561337, + 0.7211539950221777, + 1.0606777742505074, + 1.0085601322352886, + 0.1466796137392521, + 2.0120297968387604, + 0.9256982766091824, + 0.3432628884911537, + 0.25578363612294197, + 0.08063561841845512, + 0.842584365978837, + 0.28083449974656105 + ], + "unique_experts": 64, + "load_cv": 0.6110623562869136, + "normalized_load_entropy": 0.9571144008506733, + "max_load_share": 0.04116465863453815 + }, + "full_input": { + "tokens": 191, + "top_k": 6, + "decisions": 1146, + "ordered_route_sha256": "bcc211d58e3ff7eeaeb90cc8539483517830c212df8794f0d76487c70d1d216e", + "route_weight_sha256": "686190859551082f45328fe2974214068dda13e0e95a1d2fd5c19eb6adbcaaca", + "loads": [ + 19, + 14, + 15, + 18, + 9, + 13, + 31, + 13, + 12, + 23, + 24, + 7, + 9, + 22, + 24, + 6, + 17, + 13, + 9, + 3, + 26, + 20, + 14, + 43, + 17, + 40, + 16, + 12, + 11, + 11, + 30, + 6, + 7, + 14, + 37, + 39, + 13, + 27, + 28, + 12, + 26, + 11, + 43, + 10, + 7, + 23, + 30, + 22, + 15, + 16, + 13, + 4, + 14, + 20, + 32, + 21, + 4, + 46, + 20, + 5, + 5, + 2, + 25, + 8 + ], + "weighted_loads": [ + 0.8554156108293682, + 0.8387477211654186, + 0.6354920044541359, + 0.9983075144700706, + 0.36497995629906654, + 0.5655820062384009, + 1.9711051601916552, + 0.5806000363081694, + 0.5342191448435187, + 0.8758964911103249, + 1.4341609198600054, + 0.2728499975055456, + 0.3251408990472555, + 1.0635765474289656, + 1.6674540303647518, + 0.24528128281235695, + 1.0878404048271477, + 1.0425324067473412, + 0.5767285116016865, + 0.136323731392622, + 1.5180427487939596, + 0.7436567563563585, + 0.8496138919144869, + 4.019122578203678, + 0.6253694891929626, + 2.464355204254389, + 0.6479220353066921, + 0.6547288671135902, + 0.5806648526340723, + 0.8200623318552971, + 1.3899715933948755, + 0.20616030134260654, + 0.26691642589867115, + 0.5796576426364481, + 2.7554757967591286, + 3.3028232902288437, + 0.5585212521255016, + 1.0173247698694468, + 1.7642682567238808, + 0.451375475153327, + 1.2006812021136284, + 0.6094786264002323, + 1.654902433976531, + 0.5723936054855585, + 0.4492959603667259, + 2.725493837147951, + 2.0316082034260035, + 0.9898770202416927, + 0.8247709348797798, + 0.655426038429141, + 0.5830586720257998, + 0.17292602360248566, + 0.9006290696561337, + 0.7565725054591894, + 1.9748376607894897, + 1.11775703728199, + 0.1466796137392521, + 3.0074252504855394, + 0.9865431226789951, + 0.3432628884911537, + 0.25578363612294197, + 0.08063561841845512, + 1.0371649973094463, + 0.28083449974656105 + ], + "unique_experts": 64, + "load_cv": 0.5942888864338016, + "normalized_load_entropy": 0.9584791548236831, + "max_load_share": 0.04013961605584642 + } + }, + "s1_eos": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "3ac692baff47a2f89370c1a99aaaa86c4d061d8c321f07715d065f5524226ba8", + "route_weight_sha256": "30e8a21c7c264260f2feeef194fd480b2c3a3599c2b56bb09fb813954a22729b", + "loads": [ + 14, + 11, + 14, + 12, + 6, + 12, + 24, + 8, + 11, + 13, + 24, + 4, + 7, + 19, + 22, + 5, + 14, + 13, + 10, + 4, + 25, + 21, + 13, + 32, + 14, + 42, + 15, + 11, + 11, + 11, + 33, + 6, + 4, + 8, + 37, + 39, + 14, + 24, + 23, + 10, + 20, + 11, + 37, + 11, + 8, + 15, + 18, + 21, + 14, + 14, + 10, + 2, + 14, + 19, + 23, + 20, + 4, + 38, + 20, + 5, + 5, + 2, + 18, + 7 + ], + "weighted_loads": [ + 0.6814080402255058, + 0.6690374277532101, + 0.5923596676439047, + 0.8463504761457443, + 0.2908194549381733, + 0.541222583502531, + 1.5751321837306023, + 0.272441616281867, + 0.538343558087945, + 0.5347568020224571, + 1.4208988137543201, + 0.1594780944287777, + 0.28830250538885593, + 0.952365230768919, + 1.5577103551477194, + 0.21267166920006275, + 1.0273365713655949, + 1.0084796622395515, + 0.6100158132612705, + 0.18854182586073875, + 1.4817553348839283, + 0.7949251532554626, + 0.8100530579686165, + 2.7045856565237045, + 0.4875620622187853, + 2.4981865268200636, + 0.5899770576506853, + 0.6348972674459219, + 0.5718546360731125, + 0.804327204823494, + 1.4721801690757275, + 0.19889837875962257, + 0.12855403125286102, + 0.29356011003255844, + 2.796916099265218, + 3.3182136192917824, + 0.5901112332940102, + 0.9344672877341509, + 1.4994665198028088, + 0.3838290963321924, + 0.9008871279656887, + 0.6018516048789024, + 1.446197496727109, + 0.5722394417971373, + 0.4725303128361702, + 0.6159014813601971, + 1.0076287798583508, + 0.9926918745040894, + 0.8009317964315414, + 0.5467308145016432, + 0.49019405990839005, + 0.058779072016477585, + 0.8543167803436518, + 0.7221717778593302, + 1.0857553873211145, + 1.064350113272667, + 0.14456381648778915, + 2.108169872313738, + 0.9648656249046326, + 0.3449184522032738, + 0.24951756745576859, + 0.07918404415249825, + 0.7895327750593424, + 0.25364890694618225 + ], + "unique_experts": 64, + "load_cv": 0.6167372478011013, + "normalized_load_entropy": 0.9563686840959841, + "max_load_share": 0.04216867469879518 + }, + "full_input": { + "tokens": 207, + "top_k": 6, + "decisions": 1242, + "ordered_route_sha256": "cc67eb8a3cdb9c02811432323db48358600451086ae5b1a6c42f41fd7f3be2f0", + "route_weight_sha256": "e72b241822e9d92913f786a5c3dbecd73a9e837675f6c1b875530340715493f1", + "loads": [ + 19, + 17, + 20, + 21, + 10, + 13, + 37, + 18, + 13, + 16, + 26, + 6, + 8, + 24, + 24, + 8, + 18, + 14, + 12, + 4, + 26, + 21, + 14, + 47, + 17, + 42, + 15, + 11, + 11, + 12, + 33, + 6, + 5, + 20, + 38, + 39, + 20, + 25, + 30, + 10, + 28, + 11, + 39, + 11, + 10, + 24, + 34, + 25, + 20, + 18, + 10, + 12, + 20, + 21, + 33, + 21, + 4, + 56, + 24, + 5, + 7, + 3, + 27, + 9 + ], + "weighted_loads": [ + 0.9766108733601868, + 1.0272957738488913, + 0.9047286976128817, + 1.3474920748267323, + 0.4296835735440254, + 0.5463844100013375, + 2.27363308891654, + 0.6626770328730345, + 0.5735758416121826, + 0.6597233712673187, + 1.5130983404815197, + 0.22514970041811466, + 0.2984929522499442, + 1.1641007140278816, + 1.69979284144938, + 0.333580931648612, + 1.1017598514445126, + 1.0665015913546085, + 0.7007367983460426, + 0.18854182586073875, + 1.5283984169363976, + 0.7949251532554626, + 0.828549275174737, + 4.64329856261611, + 0.6108230538666248, + 2.4981865268200636, + 0.5899770576506853, + 0.6348972674459219, + 0.5718546360731125, + 0.8506485186517239, + 1.4721801690757275, + 0.19889837875962257, + 0.17132672667503357, + 0.9914762730477378, + 2.8436254765838385, + 3.3182136192917824, + 1.0254265442490578, + 0.9812155459076166, + 1.9431821815669537, + 0.3838290963321924, + 1.2706807609647512, + 0.6018516048789024, + 1.497487124055624, + 0.5722394417971373, + 0.5760210677981377, + 2.7790761422365904, + 2.6252901069819927, + 1.2236646520905197, + 1.0661200806498528, + 0.7440818194299936, + 0.49019405990839005, + 0.6760395150631666, + 1.500387268140912, + 0.792931703850627, + 2.040816145017743, + 1.1079629138112068, + 0.14456381648778915, + 3.70779992826283, + 1.169940296560526, + 0.3449184522032738, + 0.3227525930851698, + 0.2058170922100544, + 1.119242710992694, + 0.329340822994709 + ], + "unique_experts": 64, + "load_cv": 0.5810482856130836, + "normalized_load_entropy": 0.9606847429043156, + "max_load_share": 0.04508856682769726 + } + }, + "s0_bos": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "a739cf9c05e672c393dd4d013253ffea32dd3a921b3e0adebad652f1c4a821e2", + "route_weight_sha256": "a0cdc9440507fbf67e375faf8b0db1d81a8d7136cab18854220bb3d7798ac113", + "loads": [ + 13, + 12, + 10, + 11, + 2, + 12, + 25, + 9, + 13, + 13, + 26, + 3, + 7, + 19, + 23, + 6, + 16, + 13, + 9, + 2, + 27, + 18, + 13, + 32, + 18, + 41, + 15, + 11, + 13, + 13, + 34, + 6, + 3, + 7, + 37, + 39, + 14, + 25, + 25, + 11, + 20, + 10, + 36, + 11, + 8, + 13, + 18, + 19, + 14, + 19, + 11, + 3, + 13, + 19, + 19, + 21, + 4, + 35, + 21, + 5, + 5, + 2, + 17, + 7 + ], + "weighted_loads": [ + 0.6066466942429543, + 0.6870845630764961, + 0.4551111329346895, + 0.7860464081168175, + 0.08705811575055122, + 0.5286932270973921, + 1.610344685614109, + 0.3080154210329056, + 0.6352165266871452, + 0.5410969350486994, + 1.5309029091149569, + 0.11863132752478123, + 0.2831810712814331, + 0.9535421244800091, + 1.6338654849678278, + 0.252472473308444, + 1.0852603074163198, + 1.0564840361475945, + 0.5650850459933281, + 0.09119336307048798, + 1.5460078679025173, + 0.6903964839875698, + 0.8162629902362823, + 2.7462921664118767, + 0.6345395222306252, + 2.5481461454182863, + 0.6040462981909513, + 0.6338881626725197, + 0.6583062466233969, + 0.8788853250443935, + 1.5309124030172825, + 0.20006583631038666, + 0.0918812695890665, + 0.2560684010386467, + 2.6559614166617393, + 3.367893774062395, + 0.5813375413417816, + 0.9813230521976948, + 1.603038677945733, + 0.4318493939936161, + 0.9044454451650381, + 0.5699361339211464, + 1.472397580742836, + 0.4625095780938864, + 0.5020522885024548, + 0.5576403308659792, + 1.0180333778262138, + 0.9491899777203798, + 0.7954073287546635, + 0.7369971703737974, + 0.49526348896324635, + 0.09536764584481716, + 0.8618842251598835, + 0.7414391748607159, + 0.9305270966142416, + 1.0847710333764553, + 0.1520058959722519, + 2.072939310222864, + 1.059932617470622, + 0.3195640966296196, + 0.2592095509171486, + 0.0721406489610672, + 0.7777669075876474, + 0.2363384459167719 + ], + "unique_experts": 64, + "load_cv": 0.6203876925100296, + "normalized_load_entropy": 0.954405252176754, + "max_load_share": 0.04116465863453815 + }, + "full_input": { + "tokens": 191, + "top_k": 6, + "decisions": 1146, + "ordered_route_sha256": "cf7da6b137f47ca86d9774433eff197bfee060f9d88b97f744f47c40aeae6521", + "route_weight_sha256": "8fe43d4e03d716312367e35919719606b6df7821bf3ab765a8f151d0c45e0851", + "loads": [ + 16, + 15, + 11, + 18, + 7, + 14, + 31, + 16, + 13, + 21, + 26, + 3, + 9, + 24, + 24, + 6, + 19, + 13, + 9, + 3, + 27, + 18, + 15, + 44, + 22, + 41, + 16, + 11, + 13, + 13, + 34, + 6, + 4, + 10, + 37, + 39, + 14, + 25, + 28, + 12, + 26, + 10, + 38, + 12, + 8, + 19, + 29, + 21, + 15, + 20, + 12, + 5, + 13, + 20, + 29, + 24, + 4, + 46, + 24, + 6, + 5, + 2, + 23, + 8 + ], + "weighted_loads": [ + 0.7276067310012877, + 0.8601351678371429, + 0.5132111366838217, + 1.0235873246565461, + 0.3055236488580704, + 0.5883745392784476, + 1.9463693667203188, + 0.6214236561208963, + 0.6352165266871452, + 0.8140861503779888, + 1.5309029091149569, + 0.11863132752478123, + 0.3324221037328243, + 1.158980580046773, + 1.7065363619476557, + 0.252472473308444, + 1.1340471380390227, + 1.0564840361475945, + 0.5650850459933281, + 0.23011557757854462, + 1.5460078679025173, + 0.6903964839875698, + 0.8776746410876513, + 4.195043604820967, + 0.7944570183753967, + 2.5481461454182863, + 0.7378831487149, + 0.6338881626725197, + 0.6583062466233969, + 0.8788853250443935, + 1.5309124030172825, + 0.20006583631038666, + 0.15590878017246723, + 0.47320225089788437, + 2.6559614166617393, + 3.367893774062395, + 0.5813375413417816, + 0.9813230521976948, + 1.766147842630744, + 0.4584993552416563, + 1.202172527089715, + 0.5699361339211464, + 1.5230979584157467, + 0.5344751160591841, + 0.5020522885024548, + 1.6524299699813128, + 1.9807158969342709, + 1.0096014700829983, + 0.8359701409935951, + 0.8097657319158316, + 0.5417643953114748, + 0.21031512506306171, + 0.8618842251598835, + 0.78110496327281, + 1.844686983153224, + 1.233183454722166, + 0.1520058959722519, + 3.092903422191739, + 1.2515261676162481, + 0.5717213973402977, + 0.2592095509171486, + 0.0721406489610672, + 0.962127547711134, + 0.28096054308116436 + ], + "unique_experts": 64, + "load_cv": 0.5968254688026435, + "normalized_load_entropy": 0.9572861767486954, + "max_load_share": 0.04013961605584642 + } + }, + "s1_bos": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "4350167a31cd539fbd6df565d635ad8bd68beb15bbecbc14a7fc4569cad592ef", + "route_weight_sha256": "a65a2790df6aab41daf485bd65d97f3a32ea3e0b5d1b4b6b08185dfa48a46f3d", + "loads": [ + 11, + 12, + 12, + 9, + 3, + 10, + 26, + 8, + 12, + 13, + 25, + 4, + 7, + 20, + 23, + 6, + 15, + 13, + 9, + 2, + 25, + 21, + 13, + 33, + 14, + 42, + 14, + 12, + 12, + 11, + 29, + 6, + 5, + 11, + 37, + 38, + 14, + 28, + 24, + 11, + 22, + 12, + 36, + 12, + 9, + 15, + 19, + 19, + 14, + 15, + 10, + 3, + 15, + 21, + 19, + 21, + 3, + 35, + 18, + 5, + 5, + 2, + 19, + 7 + ], + "weighted_loads": [ + 0.5621766094118357, + 0.7061361521482468, + 0.5346434768289328, + 0.718680702149868, + 0.12719164788722992, + 0.48034385219216347, + 1.6358844321221113, + 0.2829391211271286, + 0.5914903357625008, + 0.5212300270795822, + 1.4953584466129541, + 0.1555465329438448, + 0.2858102582395077, + 0.9871955960988998, + 1.603732081130147, + 0.25093928538262844, + 1.1105026733130217, + 1.0495175868272781, + 0.5771234594285488, + 0.07753109559416771, + 1.4945873077958822, + 0.7828988190740347, + 0.811043806374073, + 2.777930811047554, + 0.49858733639121056, + 2.557849705219269, + 0.5652620997279882, + 0.6629431005567312, + 0.6368989981710911, + 0.8017607405781746, + 1.3968275059014559, + 0.209936099126935, + 0.16218656115233898, + 0.38188522309064865, + 2.7255491223186255, + 3.235836435109377, + 0.5568426698446274, + 1.0877555329352617, + 1.5324003417044878, + 0.42276712134480476, + 1.0344396363943815, + 0.6475551649928093, + 1.44735087454319, + 0.5571991987526417, + 0.5281039252877235, + 0.6252240967005491, + 1.0365973189473152, + 0.9369708355516195, + 0.8027315549552441, + 0.6235444936901331, + 0.4752587005496025, + 0.09370080940425396, + 0.9081118367612362, + 0.7990540750324726, + 0.9376285597681999, + 1.040511080995202, + 0.1015896312892437, + 2.026029447093606, + 0.9512721281498671, + 0.3060688003897667, + 0.2494748905301094, + 0.07287129759788513, + 0.8428007047623396, + 0.25248438119888306 + ], + "unique_experts": 64, + "load_cv": 0.6119064019001402, + "normalized_load_entropy": 0.9560799145720381, + "max_load_share": 0.04216867469879518 + }, + "full_input": { + "tokens": 207, + "top_k": 6, + "decisions": 1242, + "ordered_route_sha256": "1e9f0f5dabf59151c79180e233bf90a7a6eaeb55a80691db63c6184b50058b43", + "route_weight_sha256": "bcd2b79d956a3d461d1b79bc0608da75cb4f0c8bfc864132770a624f859013d7", + "loads": [ + 15, + 18, + 18, + 18, + 8, + 11, + 38, + 17, + 13, + 16, + 27, + 6, + 8, + 25, + 24, + 9, + 19, + 14, + 11, + 2, + 26, + 21, + 15, + 49, + 17, + 42, + 14, + 12, + 12, + 12, + 30, + 6, + 6, + 21, + 37, + 38, + 20, + 30, + 30, + 11, + 31, + 12, + 38, + 12, + 11, + 23, + 37, + 22, + 20, + 19, + 10, + 13, + 21, + 25, + 29, + 24, + 3, + 54, + 21, + 5, + 7, + 3, + 27, + 9 + ], + "weighted_loads": [ + 0.8540812623687088, + 1.064394498243928, + 0.8470125067979097, + 1.2461685696616769, + 0.32083710283041, + 0.48550567869096994, + 2.2921998035162687, + 0.6463561821728945, + 0.626006081700325, + 0.6512145921587944, + 1.5875579733401537, + 0.23770690336823463, + 0.29600070510059595, + 1.1989310793578625, + 1.7010703179985285, + 0.3718485478311777, + 1.1849259533919394, + 1.1075395159423351, + 0.6678444445133209, + 0.07753109559416771, + 1.5412303898483515, + 0.7828988190740347, + 0.8779771532863379, + 4.80073381587863, + 0.6225830372422934, + 2.557849705219269, + 0.5652620997279882, + 0.6629431005567312, + 0.6368989981710911, + 0.8480820544064045, + 1.4431601259857416, + 0.209936099126935, + 0.20495925657451153, + 1.0364105720072985, + 2.7255491223186255, + 3.235836435109377, + 0.992157980799675, + 1.1796489339321852, + 1.9219449181109667, + 0.42276712134480476, + 1.4632933996617794, + 0.6475551649928093, + 1.498640501871705, + 0.5571991987526417, + 0.631594680249691, + 1.779335405677557, + 2.7335037384182215, + 1.1642541401088238, + 1.0679198391735554, + 0.8218855243176222, + 0.4752587005496025, + 0.710961252450943, + 1.5541823245584965, + 0.9894407689571381, + 1.8926893174648285, + 1.1895013768225908, + 0.1015896312892437, + 3.616504695266485, + 1.1284810323268175, + 0.3060688003897667, + 0.3227099161595106, + 0.19950434565544128, + 1.1314048040658236, + 0.3468226082623005 + ], + "unique_experts": 64, + "load_cv": 0.5821896339481208, + "normalized_load_entropy": 0.9599991574405414, + "max_load_share": 0.043478260869565216 + } + }, + "s0_x": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "0a4b5b8037f1f70b5838ffe860ab17f5eaf41128183cfe1f289166df8b9e1f41", + "route_weight_sha256": "b3499c4336a3bf83e5acdd43d0c4c303a5d42c89afba46424f3d94cd4eb683fb", + "loads": [ + 12, + 11, + 13, + 10, + 3, + 12, + 26, + 7, + 12, + 15, + 24, + 4, + 7, + 16, + 23, + 5, + 16, + 13, + 9, + 3, + 26, + 19, + 13, + 32, + 14, + 41, + 15, + 12, + 12, + 12, + 31, + 6, + 5, + 8, + 37, + 39, + 14, + 25, + 25, + 10, + 21, + 11, + 34, + 11, + 8, + 15, + 20, + 19, + 14, + 19, + 11, + 3, + 14, + 17, + 22, + 21, + 3, + 37, + 20, + 5, + 5, + 3, + 18, + 8 + ], + "weighted_loads": [ + 0.5908252224326134, + 0.6667277999222279, + 0.5318583603948355, + 0.7719727177172899, + 0.1185479611158371, + 0.5428284704685211, + 1.6797167584300041, + 0.2406192421913147, + 0.6087128352373838, + 0.599611422047019, + 1.484679002314806, + 0.15714281611144543, + 0.2786242514848709, + 0.8289477676153183, + 1.56881869956851, + 0.22098753973841667, + 1.0695409569889307, + 1.051270179450512, + 0.5744624212384224, + 0.1294754296541214, + 1.4897343441843987, + 0.7437456753104925, + 0.7919109556823969, + 2.66880252212286, + 0.501425376161933, + 2.5532765556126833, + 0.6002185642719269, + 0.6604776158928871, + 0.6266430728137493, + 0.8205608390271664, + 1.4291118551045656, + 0.20915649458765984, + 0.15540434047579765, + 0.2844188418239355, + 2.687415035441518, + 3.4015518873929977, + 0.606871111318469, + 0.9644689150154591, + 1.6373211108148098, + 0.3979140855371952, + 0.8965807631611824, + 0.6063864193856716, + 1.3425212875008583, + 0.4718293063342571, + 0.4884783364832401, + 0.6326231136918068, + 1.1059566158801317, + 0.916398910805583, + 0.8126337230205536, + 0.7326295431703329, + 0.491048701107502, + 0.08858613483607769, + 0.8640930261462927, + 0.6795297712087631, + 1.0739976838231087, + 1.057932611554861, + 0.1007094457745552, + 2.171110473573208, + 0.9918839503079653, + 0.3113309070467949, + 0.24878302589058876, + 0.1024938840419054, + 0.7915589455515146, + 0.2839273139834404 + ], + "unique_experts": 64, + "load_cv": 0.6087351964347035, + "normalized_load_entropy": 0.9567967158282922, + "max_load_share": 0.04116465863453815 + }, + "full_input": { + "tokens": 191, + "top_k": 6, + "decisions": 1146, + "ordered_route_sha256": "2b527efa48bf200de496f9e24b3ff4df93f3dad41dd57b4c25477197d3518fec", + "route_weight_sha256": "a4559a01e9f3e0d6135e758620500fe44d0cd61ababbc203cdd068c73660756f", + "loads": [ + 16, + 14, + 14, + 19, + 7, + 14, + 33, + 14, + 12, + 23, + 24, + 4, + 8, + 21, + 25, + 5, + 20, + 13, + 9, + 3, + 26, + 19, + 14, + 44, + 18, + 41, + 15, + 12, + 12, + 12, + 31, + 6, + 6, + 12, + 37, + 39, + 15, + 25, + 29, + 11, + 27, + 11, + 36, + 11, + 8, + 22, + 33, + 21, + 15, + 20, + 11, + 5, + 14, + 17, + 33, + 23, + 3, + 47, + 22, + 5, + 5, + 3, + 24, + 8 + ], + "weighted_loads": [ + 0.7768308543600142, + 0.8397784046828747, + 0.6159320827573538, + 1.151866170577705, + 0.2786194980144501, + 0.6025097826495767, + 2.0754612777382135, + 0.5385873429477215, + 0.6087128352373838, + 0.8577958475798368, + 1.484679002314806, + 0.15714281611144543, + 0.2888610474765301, + 1.0343862231820822, + 1.6856680363416672, + 0.22098753973841667, + 1.1489905607886612, + 1.051270179450512, + 0.5744624212384224, + 0.1294754296541214, + 1.4897343441843987, + 0.7437456753104925, + 0.8105356097221375, + 4.106144085526466, + 0.660859452560544, + 2.5532765556126833, + 0.6002185642719269, + 0.6604776158928871, + 0.6266430728137493, + 0.8205608390271664, + 1.4291118551045656, + 0.20915649458765984, + 0.21943185105919838, + 0.5486571099609137, + 2.687415035441518, + 3.4015518873929977, + 0.6496869046241045, + 0.9644689150154591, + 1.8611425161361694, + 0.4245640467852354, + 1.1419510394334793, + 0.6063864193856716, + 1.393221665173769, + 0.4718293063342571, + 0.4884783364832401, + 1.7775295861065388, + 2.220105802640319, + 0.9768104031682014, + 0.8531965352594852, + 0.7831659335643053, + 0.491048701107502, + 0.20353361405432224, + 0.8640930261462927, + 0.6795297712087631, + 2.122187077999115, + 1.1483344435691833, + 0.1007094457745552, + 3.2390759494155645, + 1.113128999248147, + 0.3113309070467949, + 0.24878302589058876, + 0.1024938840419054, + 0.973466582596302, + 0.2839273139834404 + ], + "unique_experts": 64, + "load_cv": 0.601623611497486, + "normalized_load_entropy": 0.9570784544542125, + "max_load_share": 0.04101221640488656 + } + }, + "s1_x": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "5a5729dcd1e49a485d89a8b91d273b2be2397ead293c2a7661123b21155cecf5", + "route_weight_sha256": "1ffff7e267e730606395a19e773f631fc4829accd54710a77f9c96ab3cda19d8", + "loads": [ + 10, + 11, + 13, + 11, + 3, + 10, + 26, + 10, + 10, + 13, + 23, + 4, + 8, + 17, + 22, + 4, + 15, + 13, + 9, + 2, + 28, + 22, + 13, + 32, + 14, + 41, + 14, + 13, + 11, + 13, + 31, + 4, + 3, + 10, + 35, + 39, + 12, + 26, + 27, + 7, + 20, + 12, + 38, + 11, + 8, + 15, + 23, + 18, + 13, + 20, + 11, + 3, + 14, + 17, + 23, + 19, + 2, + 37, + 23, + 6, + 6, + 2, + 20, + 6 + ], + "weighted_loads": [ + 0.559783335775137, + 0.626834224909544, + 0.5677144378423691, + 0.8683801628649235, + 0.11211671680212021, + 0.46962315775454044, + 1.6694627311080694, + 0.33439760096371174, + 0.5349383987486362, + 0.5670167915523052, + 1.3993739914149046, + 0.16748464107513428, + 0.3166928458958864, + 0.84794707223773, + 1.5266910009086132, + 0.18220164254307747, + 1.129929343238473, + 1.0126440152525902, + 0.597947720438242, + 0.09944451972842216, + 1.555619016289711, + 0.8392949774861336, + 0.7749526612460613, + 2.720608051866293, + 0.4796503037214279, + 2.5086233373731375, + 0.5785883460193872, + 0.7014925125986338, + 0.5708847269415855, + 0.8350932523608208, + 1.4523490890860558, + 0.1629292629659176, + 0.10484196245670319, + 0.34912121668457985, + 2.5993931256234646, + 3.31961352750659, + 0.5428212061524391, + 1.0213216170668602, + 1.6531160566955805, + 0.2923644110560417, + 0.8948241285979748, + 0.6419300734996796, + 1.4926310442388058, + 0.5721571873873472, + 0.48797979578375816, + 0.6248589009046555, + 1.2174534760415554, + 0.8788989018648863, + 0.7648596167564392, + 0.7684009950608015, + 0.5085731707513332, + 0.10418940335512161, + 0.8536206167191267, + 0.6660558711737394, + 1.1195306330919266, + 0.9700977876782417, + 0.06290358304977417, + 2.0116424560546875, + 1.0512802358716726, + 0.3502138629555702, + 0.277490995824337, + 0.07459064945578575, + 0.8687308877706528, + 0.21692710742354393 + ], + "unique_experts": 64, + "load_cv": 0.6326416679866274, + "normalized_load_entropy": 0.9524780392683662, + "max_load_share": 0.04116465863453815 + }, + "full_input": { + "tokens": 207, + "top_k": 6, + "decisions": 1242, + "ordered_route_sha256": "b3b0679b0b1ad437f48e41f7028051b9651f82ad60259796a2797961f55c6d11", + "route_weight_sha256": "7e0169610d86f7a50a21128bf92b5a1cc3eea3ae587c98fb90ec34e5ea8061a1", + "loads": [ + 14, + 17, + 19, + 21, + 6, + 12, + 39, + 19, + 11, + 15, + 25, + 5, + 9, + 22, + 23, + 7, + 20, + 14, + 11, + 3, + 29, + 22, + 14, + 49, + 17, + 41, + 14, + 13, + 11, + 14, + 31, + 4, + 4, + 20, + 35, + 39, + 18, + 27, + 35, + 7, + 28, + 12, + 40, + 11, + 10, + 23, + 42, + 21, + 20, + 24, + 11, + 14, + 20, + 19, + 36, + 19, + 2, + 55, + 26, + 6, + 8, + 3, + 29, + 7 + ], + "weighted_loads": [ + 0.8342468463815749, + 0.9850925710052252, + 0.880083467811346, + 1.4591263392940164, + 0.21586380898952484, + 0.5183544373139739, + 2.391104841604829, + 0.6625795662403107, + 0.5694541446864605, + 0.6530603319406509, + 1.4915735181421041, + 0.19859704189002514, + 0.3268832927569747, + 1.0596825554966927, + 1.6240292377769947, + 0.30311090499162674, + 1.2441277340985835, + 1.0706659443676472, + 0.6886687055230141, + 0.1309252753853798, + 1.6022620983421803, + 0.8392949774861336, + 0.7934488784521818, + 4.71456978097558, + 0.6017322931438684, + 2.5086233373731375, + 0.5785883460193872, + 0.7014925125986338, + 0.5708847269415855, + 0.8814145661890507, + 1.4523490890860558, + 0.1629292629659176, + 0.14761465787887573, + 0.9975406210869551, + 2.5993931256234646, + 3.31961352750659, + 0.9781365171074867, + 1.068069875240326, + 2.122637638822198, + 0.2923644110560417, + 1.206315591931343, + 0.6419300734996796, + 1.5439206715673208, + 0.5721571873873472, + 0.5914705507457256, + 1.7780973259359598, + 3.116605097427964, + 1.1061822064220905, + 1.0901997573673725, + 0.9608987215906382, + 0.5085731707513332, + 0.814860874786973, + 1.499691104516387, + 0.7368157971650362, + 2.3074933290481567, + 0.9700977876782417, + 0.06290358304977417, + 3.6042286101728678, + 1.221483239904046, + 0.3502138629555702, + 0.3507260214537382, + 0.2012236975133419, + 1.1979620847851038, + 0.25698132812976837 + ], + "unique_experts": 64, + "load_cv": 0.6127441640702002, + "normalized_load_entropy": 0.955520157881175, + "max_load_share": 0.04428341384863124 + } + }, + "s0_period": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "c23d7d4966165230852996f4461e6c99717f425da2a19d2d0ccbb957e5355618", + "route_weight_sha256": "77f1b5411fbe99004ef4d9bafc127f4683bdcd3881f6c01cf96721a5e964ce8a", + "loads": [ + 10, + 10, + 11, + 10, + 2, + 11, + 27, + 9, + 12, + 15, + 25, + 5, + 6, + 17, + 24, + 4, + 16, + 13, + 9, + 4, + 26, + 18, + 13, + 32, + 14, + 41, + 15, + 12, + 12, + 12, + 33, + 6, + 4, + 8, + 38, + 39, + 14, + 25, + 25, + 9, + 22, + 10, + 35, + 11, + 8, + 14, + 19, + 20, + 14, + 20, + 12, + 4, + 14, + 16, + 22, + 22, + 4, + 36, + 23, + 5, + 5, + 2, + 15, + 7 + ], + "weighted_loads": [ + 0.5215330254286528, + 0.6245622299611568, + 0.4773807618767023, + 0.764906607568264, + 0.08752163872122765, + 0.5221696477383375, + 1.7005890868604183, + 0.32000936940312386, + 0.6164171006530523, + 0.6243359204381704, + 1.527765680104494, + 0.19318441674113274, + 0.257346099242568, + 0.8529983945190907, + 1.6120098605751991, + 0.18356133252382278, + 1.0673497263342142, + 1.0573666840791702, + 0.579954843968153, + 0.16969366744160652, + 1.5184586625546217, + 0.692651255056262, + 0.7960697617381811, + 2.720530353486538, + 0.5028808563947678, + 2.561386775225401, + 0.5758215524256229, + 0.6642044708132744, + 0.6323081683367491, + 0.8295921329408884, + 1.5094036348164082, + 0.2130566257983446, + 0.13035848177969456, + 0.2975890766829252, + 2.7533023431897163, + 3.390857972204685, + 0.6164223905652761, + 0.9627997614443302, + 1.6359944753348827, + 0.3646093010902405, + 0.9671259615570307, + 0.5635974667966366, + 1.3749809227883816, + 0.49430431984364986, + 0.4950132705271244, + 0.5954301413148642, + 1.065312247723341, + 0.9418122339993715, + 0.7995448373258114, + 0.7655540555715561, + 0.5187988635152578, + 0.13363372348248959, + 0.8498785328119993, + 0.628758043050766, + 1.075796702876687, + 1.0925287082791328, + 0.15070873126387596, + 2.1113692801445723, + 1.1001061834394932, + 0.3122900612652302, + 0.24790117517113686, + 0.07460368983447552, + 0.6902539618313313, + 0.25410185381770134 + ], + "unique_experts": 64, + "load_cv": 0.6239133874454278, + "normalized_load_entropy": 0.9547629451380459, + "max_load_share": 0.04116465863453815 + }, + "full_input": { + "tokens": 191, + "top_k": 6, + "decisions": 1146, + "ordered_route_sha256": "e0b9f3dcce0413b8258e62c80c77b225646635b64b536d12d8bec8a6459b5c25", + "route_weight_sha256": "d9f217ea81cc367059d9438ba08de994c230e79fa1bb6e39242318b27f1295d8", + "loads": [ + 14, + 13, + 13, + 18, + 6, + 13, + 35, + 16, + 12, + 24, + 25, + 6, + 7, + 22, + 25, + 4, + 19, + 13, + 9, + 4, + 26, + 18, + 14, + 43, + 17, + 41, + 15, + 12, + 12, + 12, + 33, + 6, + 5, + 12, + 39, + 39, + 14, + 25, + 30, + 10, + 28, + 10, + 38, + 11, + 8, + 20, + 31, + 22, + 15, + 21, + 12, + 6, + 14, + 17, + 33, + 24, + 4, + 47, + 25, + 5, + 5, + 2, + 20, + 7 + ], + "weighted_loads": [ + 0.7089871247299016, + 0.7976128347218037, + 0.5931326579302549, + 1.0263968845829368, + 0.2554825246334076, + 0.5818509599193931, + 2.167568249627948, + 0.6261210832744837, + 0.6164171006530523, + 0.9510220624506474, + 1.527765680104494, + 0.23747070506215096, + 0.2675828952342272, + 1.0584368500858545, + 1.684680737555027, + 0.18356133252382278, + 1.116136556956917, + 1.0573666840791702, + 0.579954843968153, + 0.16969366744160652, + 1.5184586625546217, + 0.692651255056262, + 0.8146944157779217, + 4.12579045817256, + 0.6120141185820103, + 2.561386775225401, + 0.5758215524256229, + 0.6642044708132744, + 0.6323081683367491, + 0.8295921329408884, + 1.5094036348164082, + 0.2130566257983446, + 0.19438599236309528, + 0.5887791533023119, + 2.8043833784759045, + 3.390857972204685, + 0.6164223905652761, + 0.9627997614443302, + 1.9780718050897121, + 0.3912592623382807, + 1.2499964069575071, + 0.5635974667966366, + 1.4688888862729073, + 0.49430431984364986, + 0.4950132705271244, + 1.7074980679899454, + 2.067750494927168, + 1.00222372636199, + 0.840107649564743, + 0.8257739916443825, + 0.5187988635152578, + 0.24858120270073414, + 0.8498785328119993, + 0.674595233052969, + 2.031342538073659, + 1.179626114666462, + 0.15070873126387596, + 3.2329965867102146, + 1.2169244959950447, + 0.3122900612652302, + 0.24790117517113686, + 0.07460368983447552, + 0.8480067793279886, + 0.25410185381770134 + ], + "unique_experts": 64, + "load_cv": 0.6142089992059832, + "normalized_load_entropy": 0.9555783037773291, + "max_load_share": 0.04101221640488656 + } + }, + "s1_period": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "83d20fdf724633d207dce1e4c4d96685f88f54bf61c691f149e2239e2894d1ae", + "route_weight_sha256": "e568f05aaa4bf499e2a72f5d42bf1377493d4aab52b85b1056abc79c8a3e0abd", + "loads": [ + 16, + 7, + 14, + 9, + 4, + 10, + 27, + 7, + 11, + 14, + 24, + 4, + 8, + 19, + 22, + 2, + 15, + 13, + 9, + 3, + 27, + 22, + 13, + 32, + 15, + 41, + 12, + 12, + 11, + 11, + 30, + 4, + 3, + 11, + 37, + 38, + 13, + 27, + 24, + 8, + 19, + 12, + 36, + 11, + 8, + 13, + 22, + 17, + 13, + 21, + 13, + 4, + 14, + 18, + 24, + 18, + 4, + 37, + 20, + 6, + 5, + 2, + 21, + 9 + ], + "weighted_loads": [ + 0.7685442864894867, + 0.47606102749705315, + 0.603795824572444, + 0.8511543795466423, + 0.1511958334594965, + 0.4834317658096552, + 1.6829514801502228, + 0.23028015717864037, + 0.5792075991630554, + 0.5829041879624128, + 1.4441235046833754, + 0.16855035722255707, + 0.3070533014833927, + 0.9286486729979515, + 1.5100846104323864, + 0.11774874478578568, + 1.1397850848734379, + 1.0194946303963661, + 0.6073346100747585, + 0.13641929626464844, + 1.5317658577114344, + 0.8254612050950527, + 0.7898389678448439, + 2.7427073381841183, + 0.5307967029511929, + 2.5240411311388016, + 0.5175192095339298, + 0.6756165996193886, + 0.5935822781175375, + 0.7856660336256027, + 1.40899427421391, + 0.15659087523818016, + 0.10763333179056644, + 0.39158693328499794, + 2.727051056921482, + 3.290286049246788, + 0.5644599311053753, + 1.0514772273600101, + 1.532301988452673, + 0.31526120752096176, + 0.8534354101866484, + 0.6392676942050457, + 1.428394017741084, + 0.5616586916148663, + 0.49221182987093925, + 0.546296514570713, + 1.1908249240368605, + 0.8692590314894915, + 0.7642149329185486, + 0.8233812693506479, + 0.5740408226847649, + 0.1308970358222723, + 0.8473740760236979, + 0.7176568508148193, + 1.1477233171463013, + 0.9261516183614731, + 0.13616790249943733, + 2.044617796316743, + 0.975918136537075, + 0.3810095228254795, + 0.24691887572407722, + 0.07668713107705116, + 0.8877655956894159, + 0.31472695246338844 + ], + "unique_experts": 64, + "load_cv": 0.6240167827955921, + "normalized_load_entropy": 0.9539681677621766, + "max_load_share": 0.04116465863453815 + }, + "full_input": { + "tokens": 207, + "top_k": 6, + "decisions": 1242, + "ordered_route_sha256": "f0ea05d2ce1c36181ad4bf692f846f2df98e2aad8db15f6519e749f95404e531", + "route_weight_sha256": "d73308bbabcd856dd92f15a1713eaee62eb3d5cffae9e3867912daf33290938c", + "loads": [ + 20, + 13, + 21, + 19, + 7, + 12, + 42, + 17, + 12, + 17, + 26, + 5, + 9, + 24, + 23, + 5, + 20, + 14, + 11, + 3, + 28, + 22, + 14, + 47, + 18, + 41, + 12, + 12, + 11, + 12, + 30, + 4, + 4, + 22, + 37, + 38, + 19, + 28, + 33, + 8, + 27, + 12, + 38, + 11, + 10, + 20, + 42, + 20, + 19, + 25, + 13, + 14, + 20, + 21, + 36, + 19, + 4, + 55, + 22, + 6, + 7, + 3, + 28, + 10 + ], + "weighted_loads": [ + 1.0407708161510527, + 0.8343193735927343, + 0.9551422614604235, + 1.4113201284781098, + 0.25494292564690113, + 0.5319003602489829, + 2.500576749444008, + 0.5909975841641426, + 0.6137233451008797, + 0.7021522019058466, + 1.536323031410575, + 0.19966275803744793, + 0.317243748344481, + 1.1403841562569141, + 1.607422847300768, + 0.23865800723433495, + 1.24864323111251, + 1.077516559511423, + 0.6980555951595306, + 0.13641929626464844, + 1.5784089397639036, + 0.8254612050950527, + 0.8083351850509644, + 4.699612118303776, + 0.6533283535391092, + 2.5240411311388016, + 0.5175192095339298, + 0.6756165996193886, + 0.5935822781175375, + 0.8319873474538326, + 1.40899427421391, + 0.15659087523818016, + 0.150406027212739, + 1.1453293915838003, + 2.727051056921482, + 3.290286049246788, + 0.9997752420604229, + 1.0982254855334759, + 2.1575021483004093, + 0.31526120752096176, + 1.1705757156014442, + 0.6392676942050457, + 1.4796836450695992, + 0.5616586916148663, + 0.5957025848329067, + 1.6503389049321413, + 2.9586988408118486, + 1.0965423360466957, + 1.02940321713686, + 1.012880900874734, + 0.5740408226847649, + 0.7481574788689613, + 1.4934445638209581, + 0.8330486342310905, + 2.209026299417019, + 0.9558134507387877, + 0.13616790249943733, + 3.714928016066551, + 1.1052420772612095, + 0.3810095228254795, + 0.32015390135347843, + 0.20332017913460732, + 1.1492930948734283, + 0.3547811731696129 + ], + "unique_experts": 64, + "load_cv": 0.6041523737915665, + "normalized_load_entropy": 0.9569824836183146, + "max_load_share": 0.04428341384863124 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 166, + "ordered_topk_exact_tokens": 96, + "set_exact_tokens": 116, + "mean_set_jaccard": 0.9113597246127366, + "mean_token_weighted_tv": 0.017259293146072382, + "aggregate_load_tv": 0.028112449799196783 + }, + "system_bos": { + "tokens": 166, + "ordered_topk_exact_tokens": 71, + "set_exact_tokens": 97, + "mean_set_jaccard": 0.8737808376362592, + "mean_token_weighted_tv": 0.02271309172375554, + "aggregate_load_tv": 0.03614457831325301 + }, + "system_x": { + "tokens": 166, + "ordered_topk_exact_tokens": 53, + "set_exact_tokens": 85, + "mean_set_jaccard": 0.8450946643717727, + "mean_token_weighted_tv": 0.028872759227293085, + "aggregate_load_tv": 0.035140562248995984 + }, + "system_period": { + "tokens": 166, + "ordered_topk_exact_tokens": 63, + "set_exact_tokens": 85, + "mean_set_jaccard": 0.8489672977624784, + "mean_token_weighted_tv": 0.02806698195972895, + "aggregate_load_tv": 0.048192771084337345 + }, + "bos_at_s0": { + "tokens": 166, + "ordered_topk_exact_tokens": 65, + "set_exact_tokens": 90, + "mean_set_jaccard": 0.8568559954102123, + "mean_token_weighted_tv": 0.026924002219934063, + "aggregate_load_tv": 0.04417670682730923 + }, + "bos_at_s1": { + "tokens": 166, + "ordered_topk_exact_tokens": 59, + "set_exact_tokens": 87, + "mean_set_jaccard": 0.8526965002868616, + "mean_token_weighted_tv": 0.02639909638989582, + "aggregate_load_tv": 0.035140562248995984 + }, + "x_at_s0": { + "tokens": 166, + "ordered_topk_exact_tokens": 74, + "set_exact_tokens": 98, + "mean_set_jaccard": 0.8683304647160068, + "mean_token_weighted_tv": 0.025682943211082953, + "aggregate_load_tv": 0.030120481927710836 + }, + "x_at_s1": { + "tokens": 166, + "ordered_topk_exact_tokens": 52, + "set_exact_tokens": 72, + "mean_set_jaccard": 0.8113884107860012, + "mean_token_weighted_tv": 0.03371123870812267, + "aggregate_load_tv": 0.044176706827309245 + }, + "period_at_s0": { + "tokens": 166, + "ordered_topk_exact_tokens": 64, + "set_exact_tokens": 95, + "mean_set_jaccard": 0.8649454962707975, + "mean_token_weighted_tv": 0.02693998405193708, + "aggregate_load_tv": 0.043172690763052204 + }, + "period_at_s1": { + "tokens": 166, + "ordered_topk_exact_tokens": 56, + "set_exact_tokens": 79, + "mean_set_jaccard": 0.8327596098680436, + "mean_token_weighted_tv": 0.030787097206002617, + "aggregate_load_tv": 0.044176706827309245 + } + } + }, + "layer_24": { + "layer": 24, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "c5db216f18d8a530eb7153ec6f4dcd34011a3997ab669e33cb57479d3373a432", + "route_weight_sha256": "51c24b1ace6b0446b3e6a0ae5a33048a699ef4e9fb0b485ee389e261049484b4", + "loads": [ + 13, + 15, + 7, + 16, + 4, + 9, + 3, + 29, + 6, + 13, + 13, + 8, + 27, + 13, + 19, + 29, + 6, + 20, + 16, + 3, + 15, + 3, + 29, + 29, + 17, + 4, + 6, + 4, + 5, + 19, + 9, + 22, + 8, + 47, + 26, + 15, + 53, + 13, + 28, + 10, + 22, + 11, + 9, + 2, + 27, + 22, + 1, + 4, + 17, + 14, + 20, + 24, + 8, + 14, + 15, + 20, + 11, + 9, + 28, + 19, + 10, + 25, + 4, + 29 + ], + "weighted_loads": [ + 0.4659804869443178, + 0.5169140100479126, + 0.23954634927213192, + 0.9640386551618576, + 0.31790006905794144, + 0.2836076319217682, + 0.12928428873419762, + 1.093596724793315, + 0.5559017546474934, + 0.7861055489629507, + 0.4559060111641884, + 0.3298850152641535, + 1.330461559817195, + 0.7159131690859795, + 0.8649404086172581, + 1.0562845580279827, + 0.17192538268864155, + 0.709354093298316, + 0.6162917297333479, + 0.09121364168822765, + 0.5605343710631132, + 0.1375223882496357, + 1.972064195200801, + 1.7800699230283499, + 0.5507303141057491, + 0.13247141987085342, + 0.3026035539805889, + 0.1093162726610899, + 0.1970092598348856, + 0.8503271471709013, + 0.38868863321840763, + 0.7626881208270788, + 0.276728255674243, + 3.855748923495412, + 0.772120101377368, + 0.7030683998018503, + 5.224887995049357, + 0.41744929179549217, + 0.9755924921482801, + 0.39120568707585335, + 1.1046314965933561, + 0.367806950584054, + 0.3110204264521599, + 0.06895400211215019, + 1.0346894729882479, + 0.7331395428627729, + 0.03254774212837219, + 0.16870903223752975, + 1.3826683666557074, + 0.8250964786857367, + 0.7102891374379396, + 1.7388400062918663, + 0.2650456875562668, + 1.0208432860672474, + 1.281533271074295, + 1.4928180389106274, + 0.4645390808582306, + 0.29281182028353214, + 1.8015547953546047, + 0.6326951999217272, + 0.3358185179531574, + 2.10180302336812, + 0.19365787133574486, + 1.020587507635355 + ], + "unique_experts": 64, + "load_cv": 0.6642793661837454, + "normalized_load_entropy": 0.9487577441611142, + "max_load_share": 0.05321285140562249 + }, + "full_input": { + "tokens": 191, + "top_k": 6, + "decisions": 1146, + "ordered_route_sha256": "8be415b4f5e584b254a32e45719fae1331481d8dd98be91c1277784cad2b9cf3", + "route_weight_sha256": "fa9a8624051f24c96fdab913f3e40c93f1700e0686d455fe992b923af882c9c2", + "loads": [ + 13, + 16, + 10, + 16, + 4, + 12, + 3, + 30, + 14, + 13, + 23, + 8, + 28, + 13, + 23, + 29, + 6, + 20, + 16, + 3, + 16, + 4, + 37, + 29, + 24, + 4, + 6, + 4, + 12, + 24, + 9, + 25, + 11, + 50, + 34, + 16, + 54, + 16, + 29, + 10, + 22, + 13, + 14, + 3, + 27, + 24, + 1, + 9, + 17, + 14, + 27, + 30, + 11, + 17, + 15, + 20, + 11, + 9, + 37, + 21, + 12, + 41, + 6, + 31 + ], + "weighted_loads": [ + 0.4659804869443178, + 0.5535378269851208, + 0.350210577249527, + 0.9640386551618576, + 0.31790006905794144, + 0.37267703632824123, + 0.12928428873419762, + 1.152983820065856, + 0.920350537635386, + 0.7861055489629507, + 0.8359155780635774, + 0.3298850152641535, + 1.3332141702994704, + 0.7159131690859795, + 0.9889134466648102, + 1.0562845580279827, + 0.17192538268864155, + 0.709354093298316, + 0.6162917297333479, + 0.09121364168822765, + 0.5947926212102175, + 0.18619368225336075, + 2.5639013405889273, + 1.7800699230283499, + 0.815193213056773, + 0.13247141987085342, + 0.3026035539805889, + 0.1093162726610899, + 0.47803456149995327, + 1.0346773732453585, + 0.38868863321840763, + 0.88303610868752, + 0.37812272273004055, + 4.007756130769849, + 1.0247325622476637, + 0.7437368761748075, + 5.322526773437858, + 1.3484709989279509, + 1.0152049232274294, + 0.39120568707585335, + 1.1046314965933561, + 0.4602117259055376, + 0.5258923906367272, + 0.11285294219851494, + 1.0346894729882479, + 0.8354741875082254, + 0.03254774212837219, + 0.5274790006224066, + 1.3826683666557074, + 0.8250964786857367, + 0.9993875045329332, + 2.150293940678239, + 0.3497078698128462, + 1.1608513109385967, + 1.281533271074295, + 1.4928180389106274, + 0.4645390808582306, + 0.29281182028353214, + 2.082155076088384, + 0.7054086942225695, + 0.39569195732474327, + 3.362688081804663, + 0.19656928139738739, + 2.9573504365980625 + ], + "unique_experts": 64, + "load_cv": 0.6335799650302663, + "normalized_load_entropy": 0.9525207902661548, + "max_load_share": 0.04712041884816754 + } + }, + "s1_eos": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "ba1078cc311da4c07ff85d303b69cafbbd0f6054712b6a29044e553ad4123aad", + "route_weight_sha256": "3845a6662870b7fe05e21e16641ccf7e7e3edd98779986a7fae2fc6eb5d55da9", + "loads": [ + 10, + 18, + 5, + 19, + 4, + 7, + 5, + 28, + 7, + 12, + 11, + 7, + 28, + 13, + 19, + 31, + 7, + 20, + 15, + 4, + 14, + 3, + 29, + 28, + 17, + 4, + 5, + 5, + 4, + 19, + 10, + 22, + 8, + 48, + 29, + 14, + 55, + 17, + 22, + 9, + 22, + 9, + 10, + 3, + 29, + 21, + 1, + 7, + 17, + 14, + 20, + 23, + 11, + 12, + 14, + 21, + 13, + 7, + 29, + 17, + 7, + 25, + 3, + 29 + ], + "weighted_loads": [ + 0.36130346171557903, + 0.6087708100676537, + 0.18663102574646473, + 1.0349473245441914, + 0.3170239143073559, + 0.2265455685555935, + 0.20184646174311638, + 1.0737162325531244, + 0.5936890691518784, + 0.762939989566803, + 0.41356406919658184, + 0.2983983512967825, + 1.3418121486902237, + 0.6985135041177273, + 0.8612751420587301, + 1.103308379650116, + 0.19257726334035397, + 0.7244811467826366, + 0.5753502082079649, + 0.12205048650503159, + 0.5383378844708204, + 0.13169819489121437, + 1.9248709212988615, + 1.7915464267134666, + 0.5551677215844393, + 0.1255015805363655, + 0.28005294501781464, + 0.14088097028434277, + 0.17353110760450363, + 0.8407695963978767, + 0.42085516080260277, + 0.771720239892602, + 0.26412233151495457, + 3.880417790263891, + 0.8566245604306459, + 0.6570271253585815, + 5.40203021094203, + 0.5382951181381941, + 0.7799195535480976, + 0.3660353384912014, + 1.096723634749651, + 0.30810236372053623, + 0.3273828346282244, + 0.09395863302052021, + 1.0654432009905577, + 0.7159566413611174, + 0.03153681382536888, + 0.24987200275063515, + 1.3703411556780338, + 0.8091897778213024, + 0.7252860944718122, + 1.6417317986488342, + 0.35315123200416565, + 0.9626997765153646, + 1.2099360711872578, + 1.489601619541645, + 0.5223780535161495, + 0.22265971079468727, + 1.8463071249425411, + 0.5580314081162214, + 0.23381369933485985, + 2.1430733948946, + 0.1656565275043249, + 1.0254533775150776 + ], + "unique_experts": 64, + "load_cv": 0.6785009524853357, + "normalized_load_entropy": 0.9478241569199802, + "max_load_share": 0.055220883534136546 + }, + "full_input": { + "tokens": 207, + "top_k": 6, + "decisions": 1242, + "ordered_route_sha256": "3622395785c0d2c9c65d9e360d0c21384969c59d7dfa96a022d2d6533c6e6a3a", + "route_weight_sha256": "8deaad18d956c43a304f6d6ec98c2047b7f6d0c906cdd7859c6f5ecf031b7047", + "loads": [ + 10, + 18, + 6, + 20, + 6, + 14, + 5, + 29, + 17, + 15, + 20, + 9, + 31, + 13, + 24, + 31, + 7, + 20, + 16, + 6, + 19, + 4, + 40, + 29, + 28, + 4, + 5, + 5, + 22, + 24, + 10, + 26, + 8, + 54, + 34, + 16, + 62, + 20, + 23, + 9, + 23, + 17, + 15, + 5, + 31, + 22, + 1, + 15, + 17, + 14, + 28, + 37, + 17, + 16, + 17, + 23, + 13, + 8, + 45, + 19, + 11, + 45, + 10, + 34 + ], + "weighted_loads": [ + 0.36130346171557903, + 0.6087708100676537, + 0.21235666796565056, + 1.1473599262535572, + 0.37650143541395664, + 0.4404045722912997, + 0.20184646174311638, + 1.1111026834696531, + 1.2209780095145106, + 0.8922753371298313, + 0.7766911550424993, + 0.3645926807075739, + 1.402860624017194, + 0.6985135041177273, + 1.0113051757216454, + 1.103308379650116, + 0.19257726334035397, + 0.7244811467826366, + 0.6085196863859892, + 0.1797156110405922, + 0.7553451023995876, + 0.1767294965684414, + 2.731793589890003, + 1.8162764329463243, + 0.9557905956171453, + 0.1255015805363655, + 0.28005294501781464, + 0.14088097028434277, + 1.0882383920252323, + 1.0664962399750948, + 0.42085516080260277, + 0.9531927835196257, + 0.26412233151495457, + 4.18389012478292, + 1.031471180729568, + 0.7574507556855679, + 5.91742205992341, + 1.4848447386175394, + 0.8306643143296242, + 0.3660353384912014, + 1.2100045569241047, + 0.7667226120829582, + 0.5282847741618752, + 0.30189761705696583, + 1.1646227110177279, + 0.7750705610960722, + 0.03153681382536888, + 0.8205259955720976, + 1.3703411556780338, + 0.8091897778213024, + 1.0428955499082804, + 2.5975002963095903, + 0.5269328784197569, + 1.2574916500598192, + 1.4163643512874842, + 1.585605200380087, + 0.5223780535161495, + 0.27162379771471024, + 2.4483358436846174, + 0.6247382406145334, + 0.36928091384470463, + 4.072992952540517, + 0.511192251346074, + 3.0911369509994984 + ], + "unique_experts": 64, + "load_cv": 0.6366535580783425, + "normalized_load_entropy": 0.9535746118450386, + "max_load_share": 0.0499194847020934 + } + }, + "s0_bos": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "ba3d7c9e97444001ed48cd16eac632d69c6dc996dad100e1c5d22a7402243a24", + "route_weight_sha256": "ba794f16ab2ba97b12458f8d2e6df9641aa9652cf94d7ce49f368ab44153b3bd", + "loads": [ + 13, + 16, + 7, + 18, + 4, + 8, + 4, + 29, + 7, + 13, + 12, + 6, + 28, + 13, + 19, + 31, + 6, + 19, + 19, + 4, + 15, + 5, + 29, + 27, + 17, + 4, + 4, + 4, + 5, + 19, + 10, + 28, + 11, + 46, + 28, + 13, + 53, + 13, + 21, + 10, + 23, + 11, + 12, + 2, + 25, + 19, + 1, + 4, + 19, + 14, + 20, + 23, + 9, + 15, + 13, + 21, + 13, + 8, + 28, + 16, + 7, + 25, + 4, + 26 + ], + "weighted_loads": [ + 0.4687054939568043, + 0.5610718671232462, + 0.25653854571282864, + 1.0422888062894344, + 0.3184114135801792, + 0.25622058287262917, + 0.1800878867506981, + 1.0918285679072142, + 0.5867144409567118, + 0.7752457391470671, + 0.4294188395142555, + 0.2759059965610504, + 1.3625892214477062, + 0.717971183359623, + 0.8624909166246653, + 1.0970134865492582, + 0.1722868774086237, + 0.6897780131548643, + 0.7022855933755636, + 0.10752448625862598, + 0.5607312005013227, + 0.20125569589436054, + 1.9450009521096945, + 1.7071100138127804, + 0.5641590785235167, + 0.13361656107008457, + 0.22538531944155693, + 0.11006839573383331, + 0.2057319637387991, + 0.8580657131969929, + 0.3928287457674742, + 0.9822557494044304, + 0.36016944982111454, + 3.894644860178232, + 0.8315344415605068, + 0.6164038944989443, + 5.4248665403574705, + 0.4320533964782953, + 0.7587984520941973, + 0.3934012781828642, + 1.1254584211856127, + 0.3641247171908617, + 0.4408877305686474, + 0.07438221573829651, + 0.9541288297623396, + 0.6493222042918205, + 0.030676549300551414, + 0.18094071559607983, + 1.4528074730187654, + 0.8296694476157427, + 0.718534966930747, + 1.7583460435271263, + 0.29714990220963955, + 1.0140272062271833, + 1.2600607462227345, + 1.5296931359916925, + 0.5441622920334339, + 0.24852095544338226, + 1.764870448037982, + 0.5322830080986023, + 0.24444708973169327, + 2.1977566685527563, + 0.19391963630914688, + 0.917988171800971 + ], + "unique_experts": 64, + "load_cv": 0.6554802517342089, + "normalized_load_entropy": 0.9502307370249524, + "max_load_share": 0.05321285140562249 + }, + "full_input": { + "tokens": 191, + "top_k": 6, + "decisions": 1146, + "ordered_route_sha256": "754f040adfb970fb3a0dac4175035daea00d3942d0295e016d0bd4a9206e6d42", + "route_weight_sha256": "5c320f533944a19913decb7f9e54613b6c7672c078261247d9875d8d590eb194", + "loads": [ + 13, + 18, + 10, + 18, + 4, + 12, + 5, + 30, + 14, + 13, + 20, + 6, + 29, + 13, + 23, + 31, + 6, + 19, + 19, + 4, + 16, + 6, + 39, + 27, + 25, + 4, + 5, + 4, + 12, + 24, + 11, + 32, + 14, + 49, + 35, + 13, + 54, + 16, + 21, + 10, + 23, + 12, + 17, + 2, + 25, + 21, + 2, + 8, + 19, + 14, + 29, + 29, + 12, + 18, + 13, + 21, + 13, + 8, + 36, + 18, + 9, + 41, + 5, + 27 + ], + "weighted_loads": [ + 0.4687054939568043, + 0.6342986132949591, + 0.35347980447113514, + 1.0422888062894344, + 0.3184114135801792, + 0.37080006557516754, + 0.288694404065609, + 1.1512156631797552, + 0.9466688837856054, + 0.7752457391470671, + 0.7574878274463117, + 0.2759059965610504, + 1.3653418319299817, + 0.717971183359623, + 0.9914720319211483, + 1.0970134865492582, + 0.1722868774086237, + 0.6897780131548643, + 0.7022855933755636, + 0.10752448625862598, + 0.594989450648427, + 0.24413982592523098, + 2.7350693587213755, + 1.7071100138127804, + 0.8650075844489038, + 0.13361656107008457, + 0.5858263485133648, + 0.11006839573383331, + 0.48675726540386677, + 1.04241593927145, + 0.4355758596211672, + 1.140350665897131, + 0.48650057427585125, + 4.046652067452669, + 1.0335413780994713, + 0.6164038944989443, + 5.522505318745971, + 1.3577913753688335, + 0.7587984520941973, + 0.3934012781828642, + 1.1254584211856127, + 0.42088288627564907, + 0.695528496755287, + 0.07438221573829651, + 0.9541288297623396, + 0.7744961604475975, + 0.09182321093976498, + 0.566785656963475, + 1.4528074730187654, + 0.8296694476157427, + 1.0881646126508713, + 2.1424433514475822, + 0.38181208446621895, + 1.1540352310985327, + 1.2600607462227345, + 1.5296931359916925, + 0.5441622920334339, + 0.24852095544338226, + 2.044671405106783, + 0.6000662669539452, + 0.3043205291032791, + 3.447913941461593, + 0.1956237624399364, + 1.8852911498397589 + ], + "unique_experts": 64, + "load_cv": 0.629645096947459, + "normalized_load_entropy": 0.9534995948381135, + "max_load_share": 0.04712041884816754 + } + }, + "s1_bos": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "76116200ec8455d07c078b5304a22d137bef6cd4c1f5828b92b7c511042a2be1", + "route_weight_sha256": "8cf69c18bfa832d8c0babb1c5ed84b1a60dad334b9d0073364049a428e4be65f", + "loads": [ + 14, + 15, + 7, + 17, + 5, + 8, + 4, + 30, + 8, + 13, + 11, + 6, + 25, + 13, + 19, + 29, + 7, + 19, + 18, + 6, + 15, + 3, + 29, + 28, + 16, + 2, + 5, + 3, + 5, + 20, + 8, + 27, + 11, + 47, + 24, + 15, + 51, + 16, + 26, + 11, + 20, + 12, + 11, + 2, + 26, + 19, + 1, + 6, + 19, + 14, + 20, + 23, + 9, + 14, + 14, + 22, + 12, + 9, + 30, + 18, + 6, + 24, + 3, + 26 + ], + "weighted_loads": [ + 0.51251669973135, + 0.5214530844241381, + 0.2551721874624491, + 0.9923243746161461, + 0.3511828314512968, + 0.2587608564645052, + 0.16264916211366653, + 1.114001203328371, + 0.6232441011816263, + 0.7876277435570955, + 0.39405518397688866, + 0.2637224029749632, + 1.2546229846775532, + 0.7097285501658916, + 0.8621103595942259, + 1.0380048286169767, + 0.1906578727066517, + 0.7212906144559383, + 0.6500889081507921, + 0.1533994935452938, + 0.5409759972244501, + 0.14027336612343788, + 1.9129230342805386, + 1.7463474348187447, + 0.5298477876931429, + 0.08033459261059761, + 0.24429957568645477, + 0.07935535907745361, + 0.20670810528099537, + 0.9039805140346289, + 0.30078898929059505, + 0.9550422467291355, + 0.3693047296255827, + 3.895999686792493, + 0.717982878908515, + 0.6823546383529902, + 5.222279563546181, + 0.5157933812588453, + 0.9301308430731297, + 0.4207782931625843, + 1.072749387472868, + 0.3914098422974348, + 0.43900154531002045, + 0.07656735181808472, + 0.9906650837510824, + 0.6481705699115992, + 0.03311106935143471, + 0.23352145589888096, + 1.4556232746690512, + 0.8189377933740616, + 0.7337345648556948, + 1.7436840739101171, + 0.2950682006776333, + 0.9869713541120291, + 1.2866613157093525, + 1.5496496818959713, + 0.5124984737485647, + 0.3021230064332485, + 1.8187284581363201, + 0.5795703623443842, + 0.22296839952468872, + 2.081929624080658, + 0.17803902551531792, + 0.9299952536821365 + ], + "unique_experts": 64, + "load_cv": 0.6479568403579531, + "normalized_load_entropy": 0.950625146310328, + "max_load_share": 0.05120481927710843 + }, + "full_input": { + "tokens": 207, + "top_k": 6, + "decisions": 1242, + "ordered_route_sha256": "c8ab4ce6c53000e0c6b324a8d9be2b0d4f29ebae2b9dade3f98dcf22e985abd0", + "route_weight_sha256": "a010c83063c58206014b623a37b68935882c0357facfe1afa92fb1f0abc70451", + "loads": [ + 14, + 15, + 10, + 18, + 7, + 16, + 4, + 31, + 17, + 16, + 19, + 8, + 28, + 13, + 24, + 29, + 7, + 19, + 19, + 9, + 20, + 3, + 41, + 29, + 28, + 2, + 5, + 3, + 23, + 25, + 8, + 31, + 11, + 53, + 29, + 17, + 58, + 19, + 27, + 11, + 21, + 20, + 17, + 5, + 27, + 21, + 1, + 13, + 19, + 14, + 28, + 37, + 15, + 18, + 17, + 24, + 12, + 9, + 45, + 20, + 9, + 45, + 10, + 29 + ], + "weighted_loads": [ + 0.51251669973135, + 0.5214530844241381, + 0.34807831421494484, + 1.104736976325512, + 0.41066035255789757, + 0.49722779053263366, + 0.16264916211366653, + 1.1513876542448997, + 1.2461500335484743, + 0.9169630911201239, + 0.7521379194222391, + 0.3299167323857546, + 1.3156714600045234, + 0.7097285501658916, + 1.021413803100586, + 1.0380048286169767, + 0.1906578727066517, + 0.7212906144559383, + 0.6832583863288164, + 0.24180877767503262, + 0.7579832151532173, + 0.14027336612343788, + 2.8356250319629908, + 1.7710774410516024, + 0.9725992097519338, + 0.08033459261059761, + 0.24429957568645477, + 0.07935535907745361, + 1.121415389701724, + 1.129707157611847, + 0.30078898929059505, + 1.1305144988000393, + 0.3693047296255827, + 4.1994720213115215, + 0.8839933713898063, + 0.7827782686799765, + 5.737671412527561, + 1.46159709058702, + 0.9712122082710266, + 0.4207782931625843, + 1.1860303096473217, + 0.8505484461784363, + 0.7992091393098235, + 0.3586428090929985, + 1.0300094950944185, + 0.7529060263186693, + 0.03311106935143471, + 0.827279471908696, + 1.4556232746690512, + 0.8189377933740616, + 1.1329406928271055, + 2.6543979179114103, + 0.4688498470932245, + 1.2817632276564837, + 1.493089595809579, + 1.6456532627344131, + 0.5124984737485647, + 0.3021230064332485, + 2.4254440795630217, + 0.6454850863665342, + 0.3225140627473593, + 4.040454043075442, + 0.5638717017136514, + 1.9817653372883797 + ], + "unique_experts": 64, + "load_cv": 0.6144346009341636, + "normalized_load_entropy": 0.9554093564999485, + "max_load_share": 0.04669887278582931 + } + }, + "s0_x": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "3b4518a8803d06337dd1fd23fc92e27b718801edf8385baef4a99f0906bc06d5", + "route_weight_sha256": "7a8791cc3383c31ebef2a8c64b1751209298d02bdaa4c52ee2612eb5b391a72e", + "loads": [ + 11, + 15, + 7, + 18, + 4, + 8, + 4, + 27, + 7, + 13, + 10, + 6, + 30, + 13, + 22, + 30, + 6, + 20, + 19, + 5, + 13, + 5, + 29, + 28, + 17, + 3, + 4, + 4, + 6, + 20, + 10, + 28, + 7, + 47, + 29, + 14, + 52, + 14, + 20, + 10, + 24, + 13, + 8, + 2, + 27, + 19, + 1, + 4, + 18, + 14, + 20, + 26, + 9, + 13, + 14, + 23, + 13, + 6, + 29, + 15, + 9, + 26, + 4, + 24 + ], + "weighted_loads": [ + 0.39646515995264053, + 0.5403812155127525, + 0.24777655489742756, + 1.0185209587216377, + 0.3009394705295563, + 0.2756646778434515, + 0.16916509345173836, + 1.0368523970246315, + 0.5987660214304924, + 0.7766919508576393, + 0.3608951549977064, + 0.2692808713763952, + 1.4393288306891918, + 0.716827716678381, + 0.9656122587621212, + 1.0907086580991745, + 0.17068669386208057, + 0.7192376051098108, + 0.7064257301390171, + 0.13034191727638245, + 0.5365908313542604, + 0.20620562322437763, + 1.8491134271025658, + 1.7663741819560528, + 0.5445660948753357, + 0.11320627480745316, + 0.22615250200033188, + 0.1112511120736599, + 0.22895902022719383, + 0.8698889780789614, + 0.40389051102101803, + 0.9629476703703403, + 0.24682674929499626, + 3.857382981106639, + 0.8628454823046923, + 0.6655230391770601, + 5.2887306939810514, + 0.4704436007887125, + 0.7388485558331013, + 0.3960345648229122, + 1.1432680916041136, + 0.4394242502748966, + 0.27593644335865974, + 0.07238287851214409, + 1.0181016903370619, + 0.6403785906732082, + 0.031132729724049568, + 0.16942123696208, + 1.395527746528387, + 0.8295683730393648, + 0.7112407591193914, + 1.8590443134307861, + 0.30259974487125874, + 0.9678324647247791, + 1.1832969468086958, + 1.5823799911886454, + 0.5192342530936003, + 0.1996769979596138, + 1.824497040361166, + 0.5086592510342598, + 0.32599625550210476, + 2.252467131242156, + 0.19785826466977596, + 0.8483607098460197 + ], + "unique_experts": 64, + "load_cv": 0.6695033277675626, + "normalized_load_entropy": 0.94802858073009, + "max_load_share": 0.05220883534136546 + }, + "full_input": { + "tokens": 191, + "top_k": 6, + "decisions": 1146, + "ordered_route_sha256": "51947f7542dd988e423f16c60e3fe4b549f1882fd1f300ea99a3f1ca70859cca", + "route_weight_sha256": "fe6bd6af77597b6bb14449c5d22445fed89ad79a3a66a441208752b4ae91447b", + "loads": [ + 11, + 16, + 9, + 18, + 4, + 14, + 4, + 29, + 15, + 13, + 19, + 6, + 33, + 13, + 26, + 30, + 6, + 20, + 19, + 5, + 14, + 6, + 37, + 28, + 24, + 3, + 4, + 4, + 14, + 25, + 10, + 31, + 10, + 50, + 38, + 14, + 54, + 17, + 21, + 10, + 25, + 15, + 11, + 2, + 27, + 21, + 1, + 9, + 18, + 14, + 25, + 32, + 12, + 17, + 14, + 23, + 13, + 6, + 39, + 15, + 11, + 42, + 5, + 25 + ], + "weighted_loads": [ + 0.39646515995264053, + 0.5770050324499607, + 0.31883877515792847, + 1.0185209587216377, + 0.3009394705295563, + 0.4462656087707728, + 0.16916509345173836, + 1.1306901276111603, + 1.0404594354331493, + 0.7766919508576393, + 0.7442267979495227, + 0.2692808713763952, + 1.5037684915587306, + 0.716827716678381, + 1.0878541506826878, + 1.0907086580991745, + 0.17068669386208057, + 0.7192376051098108, + 0.7064257301390171, + 0.13034191727638245, + 0.5708490815013647, + 0.2513111885637045, + 2.467993214726448, + 1.7663741819560528, + 0.8090289938263595, + 0.11320627480745316, + 0.22615250200033188, + 0.1112511120736599, + 0.5460442081093788, + 1.0542392041534185, + 0.40389051102101803, + 1.0870489496737719, + 0.3536827005445957, + 4.009390188381076, + 1.1470091925002635, + 0.6655230391770601, + 5.4258918967098, + 1.4036221597343683, + 0.778187207877636, + 0.3960345648229122, + 1.1789245028048754, + 0.5347684323787689, + 0.3862401961814612, + 0.07238287851214409, + 1.0181016903370619, + 0.733985286206007, + 0.031132729724049568, + 0.5934479526476935, + 1.395527746528387, + 0.8295683730393648, + 0.8832185808569193, + 2.286426071077585, + 0.38726192712783813, + 1.1553534902632236, + 1.1832969468086958, + 1.5823799911886454, + 0.5192342530936003, + 0.1996769979596138, + 2.1590592619031668, + 0.5086592510342598, + 0.3858696948736906, + 3.531958219129592, + 0.19956239080056548, + 1.8156636878848076 + ], + "unique_experts": 64, + "load_cv": 0.6506556658626195, + "normalized_load_entropy": 0.9501573130674433, + "max_load_share": 0.04712041884816754 + } + }, + "s1_x": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "6f0737e1a45c847df0e43e1c8cd7faec0d086f7d8040f859c402a5a1e58738ec", + "route_weight_sha256": "623937ae98e3ef64fc7d79d9162b81f76111568d2246d6590f2a97772a894047", + "loads": [ + 13, + 15, + 7, + 17, + 4, + 8, + 5, + 28, + 7, + 12, + 11, + 6, + 25, + 13, + 20, + 27, + 8, + 19, + 18, + 6, + 14, + 4, + 29, + 28, + 19, + 2, + 6, + 5, + 6, + 18, + 9, + 25, + 8, + 47, + 27, + 16, + 56, + 15, + 28, + 10, + 19, + 10, + 9, + 4, + 27, + 19, + 1, + 4, + 19, + 14, + 21, + 24, + 8, + 13, + 13, + 22, + 12, + 7, + 33, + 14, + 8, + 25, + 4, + 25 + ], + "weighted_loads": [ + 0.4793605376034975, + 0.540338883176446, + 0.25033846125006676, + 0.9830724056810141, + 0.3134114556014538, + 0.2604539543390274, + 0.20801100507378578, + 1.0631567183881998, + 0.6172808948904276, + 0.761496227234602, + 0.3977896701544523, + 0.26111900806427, + 1.2775796949863434, + 0.6957701072096825, + 0.8882361073046923, + 0.9500481095165014, + 0.21607086807489395, + 0.7039741463959217, + 0.6304789111018181, + 0.1653103604912758, + 0.5750176832079887, + 0.16972601041197777, + 1.7762259431183338, + 1.8016630969941616, + 0.6145162675529718, + 0.07008015923202038, + 0.2790924124419689, + 0.15294867381453514, + 0.21450583636760712, + 0.7984546944499016, + 0.3824183363467455, + 0.8423547800630331, + 0.2810764741152525, + 3.883274456486106, + 0.8042113892734051, + 0.7324299588799477, + 5.433687698096037, + 0.48793525621294975, + 1.006890693679452, + 0.392913106828928, + 0.9839807357639074, + 0.3297029584646225, + 0.30441230721771717, + 0.12807566672563553, + 0.9847947731614113, + 0.6513275485485792, + 0.030558550730347633, + 0.17726925760507584, + 1.3984561823308468, + 0.795815346762538, + 0.7470237948000431, + 1.7373021747916937, + 0.27206951938569546, + 0.9975113309919834, + 1.1152556911110878, + 1.4998477436602116, + 0.5002142582088709, + 0.23895298317074776, + 1.9098085146397352, + 0.48368842527270317, + 0.27811359241604805, + 2.104486847296357, + 0.19894559308886528, + 0.8801262341439724 + ], + "unique_experts": 64, + "load_cv": 0.6693105747991549, + "normalized_load_entropy": 0.9497767918717328, + "max_load_share": 0.05622489959839357 + }, + "full_input": { + "tokens": 207, + "top_k": 6, + "decisions": 1242, + "ordered_route_sha256": "e6fc93cfeddc5be1a1f998b2f1660f6740fda334872d32cfb800cf6f45dc98c3", + "route_weight_sha256": "01f0dcc46253ae7a987e775acb71a2a2ac9ae5a3336a8c80eb3312580317b6d8", + "loads": [ + 13, + 15, + 8, + 18, + 6, + 17, + 5, + 29, + 17, + 15, + 18, + 8, + 29, + 13, + 24, + 27, + 9, + 19, + 19, + 8, + 20, + 4, + 39, + 29, + 30, + 2, + 6, + 5, + 25, + 23, + 9, + 30, + 8, + 54, + 32, + 19, + 65, + 19, + 28, + 10, + 20, + 18, + 14, + 6, + 28, + 20, + 1, + 11, + 19, + 14, + 26, + 38, + 15, + 18, + 16, + 24, + 12, + 7, + 50, + 14, + 12, + 46, + 11, + 28 + ], + "weighted_loads": [ + 0.4793605376034975, + 0.540338883176446, + 0.2760641034692526, + 1.09548500739038, + 0.37288897670805454, + 0.5307661301922053, + 0.20801100507378578, + 1.1005431693047285, + 1.2902725655585527, + 0.8908315747976303, + 0.7119268621318042, + 0.3273133374750614, + 1.3687346980441362, + 0.6957701072096825, + 1.011331608518958, + 0.9500481095165014, + 0.24841302633285522, + 0.7039741463959217, + 0.6636483892798424, + 0.2229754850268364, + 0.8252557087689638, + 0.16972601041197777, + 2.527104379609227, + 1.8263931032270193, + 1.010150810237974, + 0.07008015923202038, + 0.2790924124419689, + 0.15294867381453514, + 1.1711564734578133, + 1.0241813380271196, + 0.3824183363467455, + 1.0432482678443193, + 0.2810764741152525, + 4.2228022664785385, + 0.9717194112017751, + 0.8853897675871849, + 6.066420305520296, + 1.469136193394661, + 1.006890693679452, + 0.392913106828928, + 1.0972616579383612, + 0.7926876004785299, + 0.45962132420390844, + 0.33601465076208115, + 1.0241391845047474, + 0.710441468283534, + 0.030558550730347633, + 0.7302158839302137, + 1.3984561823308468, + 0.795815346762538, + 0.9609226062893867, + 2.701855344697833, + 0.4769266378134489, + 1.3255432955920696, + 1.3216839712113142, + 1.5958513244986534, + 0.5002142582088709, + 0.23895298317074776, + 2.5948338750749826, + 0.48368842527270317, + 0.41121248342096806, + 4.037522237747908, + 0.5854027546010911, + 1.9318963177502155 + ], + "unique_experts": 64, + "load_cv": 0.6454555446714605, + "normalized_load_entropy": 0.9533373741912052, + "max_load_share": 0.05233494363929147 + } + }, + "s0_period": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "2eea7e4a1ebf69180f8df2210b2d45fb0d7b1d6e08e31e8e512a95d05cba147d", + "route_weight_sha256": "b2ef8532e06749d32cd2e8cfc5da581c571c0e8ecc029d42a9653f74aa4a9e6e", + "loads": [ + 12, + 18, + 6, + 17, + 4, + 7, + 4, + 27, + 6, + 12, + 11, + 6, + 29, + 13, + 20, + 29, + 6, + 20, + 20, + 5, + 15, + 5, + 27, + 29, + 19, + 3, + 4, + 4, + 6, + 21, + 10, + 26, + 8, + 47, + 26, + 13, + 54, + 14, + 23, + 10, + 23, + 11, + 9, + 2, + 27, + 22, + 1, + 3, + 18, + 14, + 22, + 25, + 9, + 13, + 14, + 22, + 13, + 7, + 28, + 15, + 8, + 26, + 3, + 25 + ], + "weighted_loads": [ + 0.43180517479777336, + 0.6092556249350309, + 0.22457432560622692, + 0.9971818160265684, + 0.306648638099432, + 0.2508377432823181, + 0.18641816079616547, + 1.0395068787038326, + 0.5716408528387547, + 0.7587552703917027, + 0.4018510803580284, + 0.2743008006364107, + 1.407547628507018, + 0.7146905735135078, + 0.885809076949954, + 1.072235768660903, + 0.17079902067780495, + 0.7316680643707514, + 0.740784140303731, + 0.12955776043236256, + 0.5879355911165476, + 0.20445290207862854, + 1.7710117138922215, + 1.8238666597753763, + 0.6080911960452795, + 0.11323269084095955, + 0.23919427767395973, + 0.11351244524121284, + 0.23737968504428864, + 0.9194079767912626, + 0.4184786230325699, + 0.9050413072109222, + 0.2688371669501066, + 3.8707433212548494, + 0.7694090437144041, + 0.6418865621089935, + 5.416499817743897, + 0.4661253038793802, + 0.8398827705532312, + 0.3970742914825678, + 1.0991825815290213, + 0.37386196106672287, + 0.29570208489894867, + 0.07058903574943542, + 0.9978626221418381, + 0.729840436950326, + 0.031380102038383484, + 0.15039809234440327, + 1.3836640156805515, + 0.8229479007422924, + 0.7783185783773661, + 1.8533880058676004, + 0.2998985406011343, + 0.9583411440253258, + 1.1734918635338545, + 1.5791896022856236, + 0.523598799481988, + 0.225358784198761, + 1.8247620966285467, + 0.491895480081439, + 0.2877921871840954, + 2.2589483335614204, + 0.171411057934165, + 0.8685910608619452 + ], + "unique_experts": 64, + "load_cv": 0.6721960657769086, + "normalized_load_entropy": 0.9473419476669507, + "max_load_share": 0.05421686746987952 + }, + "full_input": { + "tokens": 191, + "top_k": 6, + "decisions": 1146, + "ordered_route_sha256": "909a139786a1bc6cd479acf3fb9ed2e2e0462c14d311873c7db0631338d018db", + "route_weight_sha256": "c1f80cc386b0c1b2e8ce3d81201f9f614d85d5c3eb8a8e6db12f022a89384da4", + "loads": [ + 12, + 19, + 9, + 17, + 4, + 12, + 4, + 29, + 13, + 12, + 19, + 6, + 30, + 13, + 25, + 29, + 6, + 20, + 20, + 5, + 16, + 6, + 35, + 29, + 27, + 3, + 4, + 4, + 13, + 26, + 10, + 29, + 11, + 50, + 34, + 13, + 55, + 18, + 23, + 10, + 24, + 13, + 13, + 3, + 27, + 23, + 1, + 8, + 18, + 14, + 29, + 32, + 13, + 16, + 14, + 22, + 13, + 7, + 36, + 16, + 10, + 42, + 6, + 26 + ], + "weighted_loads": [ + 0.43180517479777336, + 0.6458794418722391, + 0.3335948549211025, + 0.9971818160265684, + 0.306648638099432, + 0.38995453040115535, + 0.18641816079616547, + 1.1375045403838158, + 0.9315952956676483, + 0.7587552703917027, + 0.7299200682900846, + 0.2743008006364107, + 1.4103002389892936, + 0.7146905735135078, + 1.0452484544366598, + 1.072235768660903, + 0.17079902067780495, + 0.7316680643707514, + 0.740784140303731, + 0.12955776043236256, + 0.6221938412636518, + 0.24130449816584587, + 2.381630305200815, + 1.8238666597753763, + 0.9072382650338113, + 0.11323269084095955, + 0.23919427767395973, + 0.11351244524121284, + 0.5184049867093563, + 1.1037582028657198, + 0.4184786230325699, + 1.0109133943915367, + 0.3861351031810045, + 4.022750528529286, + 1.0249338657595217, + 0.6418865621089935, + 5.514138596132398, + 1.4243033155798912, + 0.8398827705532312, + 0.3970742914825678, + 1.1440581921488047, + 0.49281587824225426, + 0.4674888893496245, + 0.10930316895246506, + 0.9978626221418381, + 0.7884181831032038, + 0.031380102038383484, + 0.5794689889298752, + 1.3836640156805515, + 0.8229479007422924, + 1.0771452840417624, + 2.3627751003950834, + 0.4146253503859043, + 1.098349168896675, + 1.1734918635338545, + 1.5791896022856236, + 0.523598799481988, + 0.225358784198761, + 2.1045630536973476, + 0.5185540821403265, + 0.34766562655568123, + 3.569450742099434, + 0.25069923466071486, + 1.835894038900733 + ], + "unique_experts": 64, + "load_cv": 0.6397035479875017, + "normalized_load_entropy": 0.9517522135313413, + "max_load_share": 0.04799301919720768 + } + }, + "s1_period": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "2ef6522210f425811d42f2cde306bf99c1d9b85997ed7bdfa9b26a3e0241b67a", + "route_weight_sha256": "d47c52fa90688d082be91817952c9942dfbc375594e65677616171207f6f1794", + "loads": [ + 12, + 16, + 8, + 18, + 4, + 7, + 4, + 26, + 6, + 12, + 11, + 7, + 25, + 13, + 20, + 25, + 7, + 22, + 18, + 4, + 14, + 5, + 28, + 28, + 19, + 3, + 7, + 4, + 6, + 20, + 9, + 25, + 7, + 47, + 25, + 16, + 56, + 19, + 28, + 10, + 19, + 13, + 8, + 3, + 31, + 19, + 1, + 5, + 20, + 14, + 19, + 24, + 9, + 14, + 13, + 22, + 10, + 7, + 31, + 14, + 6, + 26, + 4, + 23 + ], + "weighted_loads": [ + 0.43409050814807415, + 0.5521603357046843, + 0.2786093447357416, + 1.0156836360692978, + 0.3076290264725685, + 0.22926028072834015, + 0.1711834892630577, + 1.0078900139778852, + 0.6077979765832424, + 0.7606264688074589, + 0.4030654728412628, + 0.2875778414309025, + 1.2725344691425562, + 0.700367383658886, + 0.8705982100218534, + 0.9079440087080002, + 0.19421104714274406, + 0.8064651675522327, + 0.6536542251706123, + 0.10664112120866776, + 0.5687815509736538, + 0.20386053249239922, + 1.6957952454686165, + 1.8146622851490974, + 0.6114429142326117, + 0.09474089369177818, + 0.34615781903266907, + 0.10325503721833229, + 0.21767075918614864, + 0.8768038749694824, + 0.37531563080847263, + 0.8546348419040442, + 0.2413227092474699, + 3.839727783575654, + 0.7360810451209545, + 0.7280998304486275, + 5.4477870389819145, + 0.613290511071682, + 1.0002748593688011, + 0.3908615130931139, + 0.9951450806111097, + 0.4100650418549776, + 0.27825550734996796, + 0.09833196364343166, + 1.1527595110237598, + 0.660188740119338, + 0.03261386975646019, + 0.20461066998541355, + 1.4481248296797276, + 0.7982175536453724, + 0.7075643055140972, + 1.7832969278097153, + 0.29980806447565556, + 1.0139469113200903, + 1.1217493489384651, + 1.524739608168602, + 0.4418920334428549, + 0.241781210526824, + 1.8708537239581347, + 0.47447785176336765, + 0.20040499232709408, + 2.2022203020751476, + 0.18944209069013596, + 0.8359459675848484 + ], + "unique_experts": 64, + "load_cv": 0.6695996834443495, + "normalized_load_entropy": 0.9492184430769376, + "max_load_share": 0.05622489959839357 + }, + "full_input": { + "tokens": 207, + "top_k": 6, + "decisions": 1242, + "ordered_route_sha256": "5bdb1f4f863ba5a16a7888b05e746146f25c7c7073fdebf4f040d0921f9475f4", + "route_weight_sha256": "a109bbb0a7eac51401982502ba14f891c8960ca83b8d1d6e1b210ef11abdffc1", + "loads": [ + 12, + 16, + 9, + 19, + 6, + 16, + 4, + 27, + 15, + 15, + 18, + 9, + 29, + 13, + 25, + 25, + 7, + 22, + 19, + 7, + 19, + 6, + 37, + 29, + 30, + 3, + 7, + 4, + 25, + 25, + 9, + 28, + 7, + 53, + 30, + 19, + 63, + 24, + 29, + 10, + 20, + 22, + 12, + 6, + 32, + 20, + 1, + 12, + 20, + 14, + 26, + 39, + 16, + 19, + 16, + 24, + 10, + 7, + 48, + 14, + 10, + 47, + 11, + 26 + ], + "weighted_loads": [ + 0.43409050814807415, + 0.5521603357046843, + 0.30433498695492744, + 1.1280962377786636, + 0.3671065475791693, + 0.4963144164066762, + 0.1711834892630577, + 1.045276464894414, + 1.2307039089500904, + 0.8899618163704872, + 0.7172026648186147, + 0.3537721708416939, + 1.3597131364513189, + 0.700367383658886, + 1.0195946712046862, + 0.9079440087080002, + 0.19421104714274406, + 0.8064651675522327, + 0.6868237033486366, + 0.19921591505408287, + 0.785788768902421, + 0.24140137806534767, + 2.410115061327815, + 1.8393922913819551, + 1.0064151673577726, + 0.09474089369177818, + 0.34615781903266907, + 0.10325503721833229, + 1.1859028618782759, + 1.1025305185467005, + 0.37531563080847263, + 0.9931254182010889, + 0.2413227092474699, + 4.143200118094683, + 0.9057070026174188, + 0.8682615160942078, + 5.963178887963295, + 1.6416023783385754, + 1.0377883575856686, + 0.3908615130931139, + 1.1084260027855635, + 0.9220707938075066, + 0.39232040848582983, + 0.3464215602725744, + 1.192103922367096, + 0.7193026598542929, + 0.03261386975646019, + 0.7836141149746254, + 1.4481248296797276, + 0.7982175536453724, + 1.0319822505116463, + 2.802739292383194, + 0.500792995095253, + 1.3553246427327394, + 1.3281776290386915, + 1.6207431890070438, + 0.4418920334428549, + 0.241781210526824, + 2.5417266730219126, + 0.47447785176336765, + 0.3322421871125698, + 4.167169334366918, + 0.5807164213620126, + 1.8877160511910915 + ], + "unique_experts": 64, + "load_cv": 0.636523208968825, + "normalized_load_entropy": 0.9539410145496896, + "max_load_share": 0.050724637681159424 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 166, + "ordered_topk_exact_tokens": 75, + "set_exact_tokens": 93, + "mean_set_jaccard": 0.8666092943201377, + "mean_token_weighted_tv": 0.020446026821183152, + "aggregate_load_tv": 0.040160642570281124 + }, + "system_bos": { + "tokens": 166, + "ordered_topk_exact_tokens": 65, + "set_exact_tokens": 93, + "mean_set_jaccard": 0.8691910499139415, + "mean_token_weighted_tv": 0.020677267955279494, + "aggregate_load_tv": 0.03313253012048192 + }, + "system_x": { + "tokens": 166, + "ordered_topk_exact_tokens": 57, + "set_exact_tokens": 85, + "mean_set_jaccard": 0.8469592656339643, + "mean_token_weighted_tv": 0.026041258025510484, + "aggregate_load_tv": 0.04116465863453815 + }, + "system_period": { + "tokens": 166, + "ordered_topk_exact_tokens": 58, + "set_exact_tokens": 87, + "mean_set_jaccard": 0.839271371199082, + "mean_token_weighted_tv": 0.027295433579528905, + "aggregate_load_tv": 0.04216867469879518 + }, + "bos_at_s0": { + "tokens": 166, + "ordered_topk_exact_tokens": 65, + "set_exact_tokens": 92, + "mean_set_jaccard": 0.8674698795180723, + "mean_token_weighted_tv": 0.022225993859346014, + "aggregate_load_tv": 0.037148594377510044 + }, + "bos_at_s1": { + "tokens": 166, + "ordered_topk_exact_tokens": 50, + "set_exact_tokens": 75, + "mean_set_jaccard": 0.8258749282845669, + "mean_token_weighted_tv": 0.027682634760591997, + "aggregate_load_tv": 0.04819277108433735 + }, + "x_at_s0": { + "tokens": 166, + "ordered_topk_exact_tokens": 64, + "set_exact_tokens": 87, + "mean_set_jaccard": 0.8485370051635112, + "mean_token_weighted_tv": 0.024998337658772986, + "aggregate_load_tv": 0.0461847389558233 + }, + "x_at_s1": { + "tokens": 166, + "ordered_topk_exact_tokens": 47, + "set_exact_tokens": 68, + "mean_set_jaccard": 0.8024956970740104, + "mean_token_weighted_tv": 0.032236703772501776, + "aggregate_load_tv": 0.04618473895582329 + }, + "period_at_s0": { + "tokens": 166, + "ordered_topk_exact_tokens": 60, + "set_exact_tokens": 85, + "mean_set_jaccard": 0.852839931153184, + "mean_token_weighted_tv": 0.024639989507485586, + "aggregate_load_tv": 0.03915662650602409 + }, + "period_at_s1": { + "tokens": 166, + "ordered_topk_exact_tokens": 49, + "set_exact_tokens": 68, + "mean_set_jaccard": 0.8060814687320712, + "mean_token_weighted_tv": 0.03192148981503693, + "aggregate_load_tv": 0.05220883534136546 + } + } + }, + "layer_25": { + "layer": 25, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "eaeeb598fa56b3c97ddd5c00dc21844892fad3d46fa5294414e52b2477781f88", + "route_weight_sha256": "003b7c40c088b0de34ad000ec10804a02f8043f98fee2e11249eae54d29de65f", + "loads": [ + 13, + 34, + 28, + 3, + 21, + 13, + 7, + 16, + 31, + 7, + 35, + 7, + 5, + 4, + 11, + 0, + 12, + 20, + 11, + 24, + 12, + 7, + 32, + 9, + 12, + 40, + 16, + 11, + 28, + 2, + 4, + 18, + 14, + 24, + 14, + 15, + 30, + 18, + 9, + 27, + 21, + 2, + 24, + 4, + 22, + 25, + 7, + 16, + 15, + 16, + 10, + 18, + 7, + 4, + 16, + 31, + 14, + 9, + 2, + 14, + 13, + 17, + 34, + 11 + ], + "weighted_loads": [ + 0.7636311016976833, + 2.702593019232154, + 1.0337424967437983, + 0.1323654241859913, + 0.9158544540405273, + 0.8044750206172466, + 0.4934666268527508, + 0.5620916187763214, + 1.334250370040536, + 0.3218434005975723, + 2.779860818758607, + 0.29003266245126724, + 0.5820324197411537, + 0.14348956011235714, + 0.7287090197205544, + 0.0, + 0.7804542724043131, + 1.5949878487735987, + 0.5448668096214533, + 1.3305183909833431, + 0.7730456981807947, + 0.23504491336643696, + 1.341936269775033, + 0.6348612084984779, + 0.516756534576416, + 3.9311896301805973, + 0.5243943743407726, + 0.5231179483234882, + 1.5916670095175505, + 0.05979778617620468, + 0.13638661243021488, + 1.2130096014589071, + 0.4394000228494406, + 0.8970381580293179, + 0.38393709249794483, + 1.0531157292425632, + 2.1339698806405067, + 0.6139961648732424, + 0.5502155534923077, + 2.9706208389252424, + 1.5757025051862001, + 0.052284419536590576, + 1.5006621088832617, + 0.14515840634703636, + 1.4425962660461664, + 2.2688720151782036, + 0.22107657231390476, + 0.7272735666483641, + 0.7305999957025051, + 0.6354912780225277, + 0.5963473133742809, + 1.0087254084646702, + 0.4092907439917326, + 0.27510781958699226, + 0.5738013256341219, + 3.822484377771616, + 0.5559166222810745, + 0.29870457388460636, + 0.050917984917759895, + 1.0357895623892546, + 0.5168385542929173, + 1.1462836032733321, + 2.30480401776731, + 0.4516324866563082 + ], + "unique_experts": 63, + "load_cv": 0.6140114398160906, + "normalized_load_entropy": 0.9526207676627519, + "max_load_share": 0.040160642570281124 + }, + "full_input": { + "tokens": 191, + "top_k": 6, + "decisions": 1146, + "ordered_route_sha256": "51ef49d588d66d6e8923e525a682a48dcea232988687ff36dda8a6208063edd5", + "route_weight_sha256": "8d232929cb0da864cef9697c9654922a84649061b578983b0d199165d718ebf6", + "loads": [ + 14, + 53, + 36, + 4, + 21, + 13, + 13, + 16, + 31, + 7, + 45, + 11, + 7, + 5, + 11, + 0, + 12, + 24, + 11, + 24, + 12, + 7, + 32, + 12, + 12, + 40, + 16, + 11, + 29, + 5, + 4, + 19, + 16, + 26, + 15, + 15, + 30, + 20, + 19, + 30, + 29, + 2, + 24, + 5, + 27, + 35, + 9, + 16, + 15, + 17, + 20, + 18, + 14, + 4, + 24, + 31, + 16, + 13, + 2, + 14, + 16, + 17, + 39, + 11 + ], + "weighted_loads": [ + 0.8228652738034725, + 4.144227554090321, + 1.602296406403184, + 0.19548903033137321, + 0.9158544540405273, + 0.8044750206172466, + 0.8908689580857754, + 0.5620916187763214, + 1.334250370040536, + 0.3218434005975723, + 3.8703059311956167, + 0.9580313712358475, + 0.6765552349388599, + 0.1929637175053358, + 0.7287090197205544, + 0.0, + 0.7804542724043131, + 1.7229573354125023, + 0.5448668096214533, + 1.3305183909833431, + 0.7730456981807947, + 0.23504491336643696, + 1.341936269775033, + 0.7533669508993626, + 0.516756534576416, + 3.9311896301805973, + 0.5243943743407726, + 0.5231179483234882, + 1.6332934107631445, + 0.16590530797839165, + 0.13638661243021488, + 1.310253193601966, + 0.5615135226398706, + 1.0060293301939964, + 0.4211114589124918, + 1.0531157292425632, + 2.1339698806405067, + 0.7193111199885607, + 1.9861756935715675, + 3.3148474898189306, + 2.0030476432293653, + 0.052284419536590576, + 1.5006621088832617, + 0.1779501661658287, + 1.800529757514596, + 3.1008354499936104, + 0.26636292738839984, + 0.7272735666483641, + 0.7305999957025051, + 0.675012432038784, + 1.211251150816679, + 1.0087254084646702, + 0.7532086321152747, + 0.27510781958699226, + 0.9562630166765302, + 3.822484377771616, + 0.6576081737875938, + 0.47565331868827343, + 0.050917984917759895, + 1.0357895623892546, + 0.6972795948386192, + 1.1462836032733321, + 2.712841583415866, + 0.4516324866563082 + ], + "unique_experts": 63, + "load_cv": 0.6166636476867943, + "normalized_load_entropy": 0.9539537202074968, + "max_load_share": 0.0462478184991274 + } + }, + "s1_eos": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "b2b1af5da1120b96daaf4de95cdb99bcb970a19622791bd75fe39169f459dcee", + "route_weight_sha256": "4c266a25436d3867cc76ccd3dd7d13ca1882181812c0a4ff71cbe24685131ee6", + "loads": [ + 13, + 35, + 28, + 3, + 21, + 13, + 8, + 20, + 33, + 7, + 37, + 6, + 5, + 5, + 11, + 0, + 12, + 20, + 11, + 21, + 12, + 6, + 30, + 8, + 12, + 40, + 15, + 11, + 27, + 1, + 4, + 16, + 12, + 23, + 15, + 14, + 27, + 15, + 8, + 27, + 22, + 3, + 24, + 5, + 22, + 26, + 7, + 17, + 14, + 15, + 9, + 19, + 7, + 3, + 17, + 33, + 15, + 15, + 2, + 14, + 13, + 18, + 32, + 12 + ], + "weighted_loads": [ + 0.7286606226116419, + 2.6951967012137175, + 1.0759974177926779, + 0.12364245019853115, + 0.9197997767478228, + 0.7902799230068922, + 0.5299855880439281, + 0.673263993114233, + 1.4229077622294426, + 0.3236728012561798, + 2.7957012858241796, + 0.23597194254398346, + 0.5964254587888718, + 0.17009568586945534, + 0.7238346058875322, + 0.0, + 0.7741503100842237, + 1.5863109529018402, + 0.5216207765042782, + 1.2322991471737623, + 0.7751204986125231, + 0.20268819853663445, + 1.2647231724113226, + 0.6128413788974285, + 0.5190675463527441, + 3.920469880104065, + 0.5013012196868658, + 0.529611524194479, + 1.5634622666984797, + 0.029261084273457527, + 0.1315540000796318, + 1.1390178203582764, + 0.3879934083670378, + 0.8627913184463978, + 0.4135645553469658, + 1.0046035572886467, + 2.0591511856764555, + 0.5337056685239077, + 0.528738658875227, + 2.9212078135460615, + 1.6154650934040546, + 0.0779474675655365, + 1.489108208566904, + 0.17712141200900078, + 1.4301966596394777, + 2.2185945212841034, + 0.2202627956867218, + 0.7489287573844194, + 0.6815149765461683, + 0.5966508518904448, + 0.5642921030521393, + 1.0424641091376543, + 0.41118532605469227, + 0.2355942502617836, + 0.6083181221038103, + 3.870081312954426, + 0.5668082013726234, + 0.4587018322199583, + 0.05000409483909607, + 1.0238180477172136, + 0.5246350280940533, + 1.1712050549685955, + 2.2319412138313055, + 0.47355133574455976 + ], + "unique_experts": 63, + "load_cv": 0.6148514370484057, + "normalized_load_entropy": 0.9524455381924591, + "max_load_share": 0.040160642570281124 + }, + "full_input": { + "tokens": 207, + "top_k": 6, + "decisions": 1242, + "ordered_route_sha256": "256a53add9cbc1aa9df6e5387bcb16c6c2e7f226507c62fe0a6da04fd66eb309", + "route_weight_sha256": "45cdabd3f659aa3d37a70dacf318cdd4bb519f310e642dff65e7d972676915a0", + "loads": [ + 16, + 60, + 39, + 4, + 21, + 14, + 14, + 20, + 35, + 8, + 58, + 11, + 11, + 5, + 11, + 1, + 12, + 28, + 12, + 22, + 15, + 13, + 30, + 13, + 12, + 40, + 16, + 11, + 28, + 5, + 4, + 19, + 18, + 24, + 17, + 14, + 28, + 21, + 18, + 32, + 32, + 3, + 25, + 6, + 30, + 41, + 9, + 17, + 14, + 16, + 21, + 19, + 14, + 10, + 29, + 34, + 18, + 21, + 2, + 15, + 17, + 19, + 37, + 13 + ], + "weighted_loads": [ + 0.9939489308744669, + 4.697755723260343, + 1.7452765889465809, + 0.19925799034535885, + 0.9197997767478228, + 0.8290447574108839, + 1.0935316048562527, + 0.673263993114233, + 1.5343508422374725, + 0.35244590416550636, + 4.83798654191196, + 0.9859188999980688, + 0.8963794074952602, + 0.17009568586945534, + 0.7238346058875322, + 0.0427052266895771, + 0.7741503100842237, + 2.2304789908230305, + 0.5746933668851852, + 1.2567187268286943, + 1.0295798797160387, + 0.8502104207873344, + 1.2647231724113226, + 0.8031066581606865, + 0.5190675463527441, + 3.920469880104065, + 0.5349100437015295, + 0.529611524194479, + 1.6077386233955622, + 0.17351690120995045, + 0.1315540000796318, + 1.611995741724968, + 0.7030938658863306, + 0.9104577265679836, + 0.5156968049705029, + 1.0046035572886467, + 2.1012106481939554, + 0.7954994607716799, + 2.2257257252931595, + 3.3857688400894403, + 2.1544185113161802, + 0.0779474675655365, + 1.5750882662832737, + 0.207699378952384, + 2.0448573287576437, + 3.529531553387642, + 0.2629646004643291, + 0.7489287573844194, + 0.6815149765461683, + 0.6391236875206232, + 1.2944359853863716, + 1.0424641091376543, + 0.8488343069329858, + 0.7420202195644379, + 1.3850494211073965, + 3.896536000072956, + 0.7151756025850773, + 0.7150423061102629, + 0.05000409483909607, + 1.1110493261367083, + 0.7992857210338116, + 1.215013548731804, + 2.66140154376626, + 0.49925409350544214 + ], + "unique_experts": 64, + "load_cv": 0.6186069511557847, + "normalized_load_entropy": 0.9560761923308845, + "max_load_share": 0.04830917874396135 + } + }, + "s0_bos": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "fd9fc148ef40524ef925cacfb7e69c665f77167106d5cac53ae1f958fa7b6757", + "route_weight_sha256": "233f3e9fdc8b9be07fb41e868c9dfeb97e19bba12095c05c2fb57dbe36b301b3", + "loads": [ + 14, + 35, + 28, + 5, + 18, + 13, + 7, + 19, + 32, + 7, + 37, + 7, + 5, + 6, + 11, + 1, + 13, + 19, + 12, + 22, + 11, + 6, + 33, + 11, + 12, + 41, + 13, + 11, + 26, + 2, + 4, + 18, + 15, + 28, + 16, + 15, + 29, + 17, + 8, + 27, + 20, + 2, + 26, + 4, + 20, + 25, + 9, + 11, + 13, + 16, + 10, + 20, + 5, + 2, + 14, + 32, + 15, + 6, + 2, + 15, + 15, + 19, + 31, + 10 + ], + "weighted_loads": [ + 0.8289587032049894, + 2.717340672388673, + 1.0698328167200089, + 0.18787485733628273, + 0.8247975688427687, + 0.8370652925223112, + 0.4889049045741558, + 0.6315339840948582, + 1.3830862753093243, + 0.31758106872439384, + 2.973767811432481, + 0.2396488767117262, + 0.5674021765589714, + 0.21414360590279102, + 0.7318184301257133, + 0.03240269795060158, + 0.8238717503845692, + 1.5913967918604612, + 0.5728075001388788, + 1.1909782607108355, + 0.7497448921203613, + 0.20527084916830063, + 1.4231716897338629, + 0.7216271497309208, + 0.48611664213240147, + 3.9640081487596035, + 0.4468651060014963, + 0.533242978155613, + 1.5389428343623877, + 0.05884282849729061, + 0.13573893904685974, + 1.2282209638506174, + 0.49005598574876785, + 1.037342056632042, + 0.4452852141112089, + 1.060414757579565, + 2.1399898659437895, + 0.5787106193602085, + 0.5268378481268883, + 2.9758049231022596, + 1.5656115617603064, + 0.05409366078674793, + 1.5839116498827934, + 0.14369210228323936, + 1.3342854417860508, + 2.3079283237457275, + 0.28883566334843636, + 0.545641852542758, + 0.689148249104619, + 0.6466563697904348, + 0.6123619601130486, + 1.0850286036729813, + 0.32561469450592995, + 0.20312482118606567, + 0.5135282855480909, + 3.810450103133917, + 0.5661524031311274, + 0.19336018338799477, + 0.05047810450196266, + 1.0536213498562574, + 0.5717654172331095, + 1.1909566055983305, + 2.251617593690753, + 0.42694132775068283 + ], + "unique_experts": 64, + "load_cv": 0.6228784899675877, + "normalized_load_entropy": 0.9522079521120073, + "max_load_share": 0.04116465863453815 + }, + "full_input": { + "tokens": 191, + "top_k": 6, + "decisions": 1146, + "ordered_route_sha256": "d9ec9cff693a8b76af2401ccb1a85ff4654dfd3ad4e3a72f0512349f63db1587", + "route_weight_sha256": "0b037f436164d6c136a65f6b7d9bb2583287aa4ffb05bbb0e9636f6d19689825", + "loads": [ + 14, + 53, + 37, + 6, + 18, + 13, + 13, + 20, + 33, + 7, + 47, + 10, + 9, + 7, + 11, + 1, + 13, + 23, + 12, + 22, + 11, + 6, + 33, + 14, + 12, + 41, + 13, + 11, + 27, + 4, + 5, + 19, + 17, + 29, + 17, + 15, + 30, + 19, + 17, + 29, + 28, + 3, + 26, + 6, + 25, + 34, + 11, + 11, + 13, + 18, + 20, + 20, + 11, + 2, + 23, + 32, + 16, + 10, + 2, + 15, + 17, + 19, + 36, + 10 + ], + "weighted_loads": [ + 0.8289587032049894, + 4.099677023477852, + 1.6551525071263313, + 0.2950710691511631, + 0.8247975688427687, + 0.8370652925223112, + 0.8863072358071804, + 0.6634784042835236, + 1.418474331498146, + 0.31758106872439384, + 4.089389091357589, + 0.8862978536635637, + 0.7449436374008656, + 0.2636177632957697, + 0.7318184301257133, + 0.03240269795060158, + 0.8238717503845692, + 1.7193662784993649, + 0.5728075001388788, + 1.1909782607108355, + 0.7497448921203613, + 0.20527084916830063, + 1.4231716897338629, + 0.8401328921318054, + 0.48611664213240147, + 3.9640081487596035, + 0.4468651060014963, + 0.533242978155613, + 1.5805692356079817, + 0.12622319720685482, + 0.5710824429988861, + 1.3254645559936762, + 0.6049481742084026, + 1.0963086001574993, + 0.49883159063756466, + 1.060414757579565, + 2.1982511300593615, + 0.7078341953456402, + 1.0528197772800922, + 3.381887076422572, + 2.0006005484610796, + 0.1053148340433836, + 1.5839116498827934, + 0.20915954560041428, + 1.6861832197755575, + 3.09585028514266, + 0.38753074780106544, + 0.545641852542758, + 0.689148249104619, + 0.7303375396877527, + 1.2272657975554466, + 1.0850286036729813, + 0.6653451099991798, + 0.20312482118606567, + 0.9317113680299371, + 3.810450103133917, + 0.6407247204333544, + 0.35659147799015045, + 0.05047810450196266, + 1.0536213498562574, + 0.7019420731812716, + 1.1909566055983305, + 2.6596551593393087, + 0.42694132775068283 + ], + "unique_experts": 64, + "load_cv": 0.6176901133874817, + "normalized_load_entropy": 0.954911097619514, + "max_load_share": 0.0462478184991274 + } + }, + "s1_bos": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "592cdd88a5174c18114d1e8a5e9fee505662b0f4f78853175d3ba954f2773028", + "route_weight_sha256": "b57b9fae9a6c0c0227412fc331574cc8f848ed61c0ab043f472be16c340fd792", + "loads": [ + 11, + 35, + 30, + 4, + 20, + 11, + 9, + 18, + 31, + 9, + 37, + 6, + 7, + 5, + 11, + 1, + 12, + 18, + 10, + 22, + 12, + 11, + 34, + 8, + 12, + 40, + 16, + 11, + 27, + 1, + 3, + 18, + 14, + 24, + 20, + 14, + 28, + 18, + 8, + 27, + 17, + 3, + 24, + 3, + 20, + 25, + 8, + 14, + 12, + 16, + 10, + 18, + 7, + 3, + 15, + 33, + 14, + 10, + 2, + 15, + 13, + 17, + 33, + 11 + ], + "weighted_loads": [ + 0.7227086238563061, + 2.6734711471945047, + 1.2471160981804132, + 0.15456627309322357, + 0.914635369554162, + 0.7693757675588131, + 0.552355082705617, + 0.5980839561671019, + 1.3658157102763653, + 0.38112202659249306, + 2.8162527065724134, + 0.23542110435664654, + 0.6729213539510965, + 0.1852359864860773, + 0.7449278272688389, + 0.03453689441084862, + 0.7910580243915319, + 1.544746708124876, + 0.5148687306791544, + 1.2230428606271744, + 0.7669591624289751, + 0.3594779148697853, + 1.3874744847416878, + 0.6175872441381216, + 0.48581455275416374, + 3.9579325392842293, + 0.5403304509818554, + 0.5318886786699295, + 1.5384177938103676, + 0.027205131947994232, + 0.10881614498794079, + 1.214928012341261, + 0.47383041866123676, + 0.9241929557174444, + 0.5624509155750275, + 1.0261640101671219, + 2.0891863349825144, + 0.6064195036888123, + 0.5225929729640484, + 2.953518146649003, + 1.4208026379346848, + 0.08184362575411797, + 1.5260909646749496, + 0.10739225335419178, + 1.3250443525612354, + 2.221068661659956, + 0.2462258841842413, + 0.6519193295389414, + 0.6450693067163229, + 0.6454497538506985, + 0.6141621358692646, + 1.0213666297495365, + 0.3994070626795292, + 0.23497622832655907, + 0.5317543223500252, + 3.954284366220236, + 0.5083044487982988, + 0.3047090135514736, + 0.04999859444797039, + 1.0812556464225054, + 0.5349427182227373, + 1.114396719262004, + 2.3016691394150257, + 0.4633459374308586 + ], + "unique_experts": 64, + "load_cv": 0.6157950643135127, + "normalized_load_entropy": 0.9534808414877421, + "max_load_share": 0.040160642570281124 + }, + "full_input": { + "tokens": 207, + "top_k": 6, + "decisions": 1242, + "ordered_route_sha256": "79dcd3792deda2891ad1ee8599ff2296b8fcb2a37ff94d4dd6d00722acab80e6", + "route_weight_sha256": "6512e59770316960a7ed0206fc45119dd0e3cdc67f0c2a46dc548d149c312f98", + "loads": [ + 13, + 60, + 42, + 5, + 20, + 12, + 15, + 18, + 35, + 10, + 59, + 9, + 14, + 6, + 11, + 1, + 12, + 26, + 11, + 23, + 15, + 19, + 34, + 13, + 12, + 40, + 17, + 11, + 28, + 3, + 3, + 21, + 21, + 25, + 22, + 14, + 29, + 24, + 17, + 31, + 26, + 3, + 25, + 4, + 30, + 39, + 9, + 14, + 12, + 18, + 22, + 18, + 13, + 10, + 28, + 34, + 17, + 15, + 2, + 16, + 16, + 18, + 38, + 14 + ], + "weighted_loads": [ + 0.9197760038077831, + 4.63805993553251, + 1.9964948110282421, + 0.20118537917733192, + 0.914635369554162, + 0.8081406019628048, + 1.1159010995179415, + 0.5980839561671019, + 1.560144167393446, + 0.4098951295018196, + 4.9609084110707045, + 0.901655962690711, + 1.0123712718486786, + 0.2310491818934679, + 0.7449278272688389, + 0.03453689441084862, + 0.7910580243915319, + 2.1889147460460663, + 0.5679413210600615, + 1.2474624402821064, + 1.0214185435324907, + 1.054193425923586, + 1.3874744847416878, + 0.8078525234013796, + 0.48581455275416374, + 3.9579325392842293, + 0.5739392749965191, + 0.5318886786699295, + 1.58269415050745, + 0.09603465721011162, + 0.10881614498794079, + 1.6879059337079525, + 0.7955989595502615, + 0.9718593638390303, + 0.6599810160696507, + 1.0261640101671219, + 2.1312457975000143, + 0.8794538788497448, + 1.318372830748558, + 3.4084071163088083, + 1.9221572913229465, + 0.08184362575411797, + 1.6120710223913193, + 0.137970220297575, + 2.0031931195408106, + 3.4708933010697365, + 0.28760318644344807, + 0.6519193295389414, + 0.6450693067163229, + 0.7360044717788696, + 1.344306018203497, + 1.0213666297495365, + 0.8329005613923073, + 0.7414021976292133, + 1.358332393458113, + 3.980739053338766, + 0.6645646188408136, + 0.5441177934408188, + 0.04999859444797039, + 1.168486924842, + 0.7262770961970091, + 1.1582052130252123, + 2.7311294693499804, + 0.5566629786044359 + ], + "unique_experts": 64, + "load_cv": 0.6272653304448165, + "normalized_load_entropy": 0.9545615552603423, + "max_load_share": 0.04830917874396135 + } + }, + "s0_x": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "80f1e32e75fb6961b92f40fd704e32f5c84146d112fc06d7187cc85a90b62da8", + "route_weight_sha256": "5f868ad0320f2d8cd4517095667406ecc8b4ee251fb875ac3a02f6e20994b2aa", + "loads": [ + 11, + 39, + 23, + 5, + 20, + 11, + 9, + 19, + 31, + 7, + 34, + 6, + 5, + 5, + 11, + 1, + 13, + 21, + 12, + 23, + 12, + 5, + 31, + 9, + 11, + 40, + 15, + 11, + 30, + 3, + 5, + 17, + 9, + 26, + 16, + 14, + 30, + 15, + 8, + 27, + 22, + 4, + 26, + 2, + 21, + 26, + 10, + 12, + 12, + 17, + 10, + 19, + 7, + 2, + 16, + 32, + 15, + 10, + 2, + 15, + 17, + 17, + 31, + 11 + ], + "weighted_loads": [ + 0.7228499613702297, + 2.877530127763748, + 0.84554049000144, + 0.1841788087040186, + 0.888852134346962, + 0.7615806199610233, + 0.5438907966017723, + 0.6201317179948092, + 1.368354918435216, + 0.32195035740733147, + 2.7922617215663195, + 0.216636186465621, + 0.5375947877764702, + 0.18873075395822525, + 0.7246057912707329, + 0.03301754221320152, + 0.8346210494637489, + 1.6182561181485653, + 0.5663564093410969, + 1.2482077945023775, + 0.7772242520004511, + 0.17531941644847393, + 1.3434916380792856, + 0.6476294342428446, + 0.4462408162653446, + 3.9492829516530037, + 0.5074261035770178, + 0.5306254848837852, + 1.6494626142084599, + 0.08869767561554909, + 0.17095966264605522, + 1.189398106187582, + 0.31175155006349087, + 0.9506570305675268, + 0.44096713699400425, + 1.028604593127966, + 2.133564654737711, + 0.5236373711377382, + 0.5402143709361553, + 2.9435976427048445, + 1.675136897712946, + 0.11610355041921139, + 1.5819195229560137, + 0.06895564496517181, + 1.4553238563239574, + 2.343342497944832, + 0.31552754156291485, + 0.5618687439709902, + 0.6549462378025055, + 0.6792912520468235, + 0.5866979695856571, + 1.0635390635579824, + 0.43304871767759323, + 0.20296697318553925, + 0.5738193094730377, + 3.9360991939902306, + 0.5612694695591927, + 0.3285468388348818, + 0.0498773418366909, + 1.0338391475379467, + 0.6239926125854254, + 1.1730784140527248, + 2.2161781657487154, + 0.4570718389004469 + ], + "unique_experts": 64, + "load_cv": 0.6183043631410556, + "normalized_load_entropy": 0.9532212193360803, + "max_load_share": 0.040160642570281124 + }, + "full_input": { + "tokens": 191, + "top_k": 6, + "decisions": 1146, + "ordered_route_sha256": "449486a4994350ad178e927c09effbef1eec86784361357f09358a9ca9975508", + "route_weight_sha256": "e61c1ec3ab4086512f910aaeedea1e4deca3b2813c44cf787de7c091f8ae22d7", + "loads": [ + 12, + 59, + 31, + 6, + 20, + 11, + 17, + 19, + 31, + 7, + 44, + 8, + 7, + 6, + 11, + 1, + 13, + 25, + 12, + 23, + 12, + 5, + 31, + 12, + 11, + 40, + 15, + 11, + 31, + 5, + 5, + 19, + 11, + 27, + 17, + 14, + 31, + 17, + 18, + 29, + 31, + 4, + 26, + 3, + 27, + 35, + 12, + 12, + 13, + 17, + 20, + 19, + 14, + 2, + 25, + 32, + 16, + 13, + 2, + 15, + 19, + 17, + 37, + 11 + ], + "weighted_loads": [ + 0.7609519995748997, + 4.46329306345433, + 1.284953510388732, + 0.2186171468347311, + 0.888852134346962, + 0.7615806199610233, + 1.061226174235344, + 0.6201317179948092, + 1.368354918435216, + 0.32195035740733147, + 3.883831875398755, + 0.8137528207153082, + 0.6272321287542582, + 0.23820491135120392, + 0.7246057912707329, + 0.03301754221320152, + 0.8346210494637489, + 1.746225604787469, + 0.5663564093410969, + 1.2482077945023775, + 0.7772242520004511, + 0.17531941644847393, + 1.3434916380792856, + 0.7661351766437292, + 0.4462408162653446, + 3.9492829516530037, + 0.5074261035770178, + 0.5306254848837852, + 1.6910890154540539, + 0.1528752464801073, + 0.17095966264605522, + 1.3790860883891582, + 0.42418915592134, + 1.0096235740929842, + 0.48867608793079853, + 1.028604593127966, + 2.1984286345541477, + 0.6637889314442873, + 1.179211676120758, + 3.3454355876892805, + 2.173415571451187, + 0.11610355041921139, + 1.5819195229560137, + 0.10174740478396416, + 1.8557446356862783, + 3.176935702562332, + 0.4112802427262068, + 0.5618687439709902, + 0.6974010244011879, + 0.6792912520468235, + 1.2016018070280552, + 1.0635390635579824, + 0.8859315551817417, + 0.20296697318553925, + 1.0225232259836048, + 3.9360991939902306, + 0.6318923309445381, + 0.44180770963430405, + 0.0498773418366909, + 1.0338391475379467, + 0.7646770160645247, + 1.1730784140527248, + 2.6627359110862017, + 0.4570718389004469 + ], + "unique_experts": 64, + "load_cv": 0.6315770170701582, + "normalized_load_entropy": 0.9530827729902916, + "max_load_share": 0.05148342059336824 + } + }, + "s1_x": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "884fd80b055ab137b6f289df28c724bfbc20769cb76799875eeb476b29f06468", + "route_weight_sha256": "10ba59dfd7c9d02e75ce5dbd33ce37d53792dc71468e69cad958505c8d7b419d", + "loads": [ + 12, + 38, + 25, + 7, + 21, + 11, + 9, + 17, + 30, + 7, + 39, + 5, + 5, + 5, + 11, + 1, + 13, + 19, + 9, + 21, + 12, + 6, + 31, + 8, + 11, + 41, + 18, + 11, + 27, + 1, + 2, + 17, + 13, + 24, + 18, + 13, + 28, + 21, + 8, + 27, + 22, + 3, + 25, + 1, + 22, + 26, + 9, + 14, + 13, + 16, + 10, + 18, + 7, + 4, + 15, + 32, + 12, + 12, + 1, + 16, + 16, + 17, + 32, + 11 + ], + "weighted_loads": [ + 0.707486841827631, + 2.803190413862467, + 0.9625830482691526, + 0.2518768794834614, + 0.9276191927492619, + 0.7256047632545233, + 0.5639208853244781, + 0.5738410502672195, + 1.3772527668625116, + 0.31770992279052734, + 2.7877337113022804, + 0.20983003824949265, + 0.5299327373504639, + 0.16892071440815926, + 0.748473547399044, + 0.03292875364422798, + 0.7930482514202595, + 1.5320918187499046, + 0.46647110022604465, + 1.1842823941260576, + 0.7718295194208622, + 0.20981763675808907, + 1.28844397328794, + 0.5843655318021774, + 0.435986353084445, + 3.9882831051945686, + 0.5811090283095837, + 0.5433467924594879, + 1.5573913864791393, + 0.03084390051662922, + 0.08300880715250969, + 1.1849673129618168, + 0.4197608567774296, + 0.8823748752474785, + 0.5057501196861267, + 0.9676662720739841, + 2.053486766293645, + 0.695758868008852, + 0.5382718481123447, + 2.9536904133856297, + 1.6813934743404388, + 0.0780715811997652, + 1.5166874565184116, + 0.03901495411992073, + 1.5089547578245401, + 2.203773306682706, + 0.28511411137878895, + 0.6382700316607952, + 0.7063105218112469, + 0.6331316512078047, + 0.5910435114055872, + 1.0219430923461914, + 0.4518278259783983, + 0.26619934663176537, + 0.5693656466901302, + 3.882113788276911, + 0.4882611557841301, + 0.3898818362504244, + 0.028027042746543884, + 1.0710301715880632, + 0.6331214625388384, + 1.1623000390827656, + 2.251752022653818, + 0.4681368265300989 + ], + "unique_experts": 64, + "load_cv": 0.627213584590985, + "normalized_load_entropy": 0.95072636535854, + "max_load_share": 0.04116465863453815 + }, + "full_input": { + "tokens": 207, + "top_k": 6, + "decisions": 1242, + "ordered_route_sha256": "00e49f84940af5a12429de45002955ba3e6d694c1c571f3c66ec389827229404", + "route_weight_sha256": "d57a968cd8b7682365ca4101744baaf3f52cc27be150c71647661934bdb59ea2", + "loads": [ + 14, + 64, + 36, + 7, + 21, + 12, + 17, + 17, + 32, + 8, + 61, + 9, + 9, + 5, + 11, + 1, + 13, + 28, + 10, + 22, + 15, + 13, + 31, + 14, + 11, + 41, + 19, + 11, + 28, + 3, + 2, + 21, + 19, + 25, + 20, + 13, + 29, + 27, + 18, + 32, + 32, + 3, + 26, + 2, + 32, + 40, + 10, + 14, + 13, + 17, + 24, + 18, + 15, + 11, + 28, + 33, + 14, + 17, + 1, + 17, + 19, + 18, + 37, + 12 + ], + "weighted_loads": [ + 0.904554221779108, + 4.892371588386595, + 1.5370852891355753, + 0.2518768794834614, + 0.9276191927492619, + 0.764369597658515, + 1.3319214880466461, + 0.5738410502672195, + 1.4886958468705416, + 0.3464830256998539, + 4.850524719804525, + 0.9415779337286949, + 0.7488704174757004, + 0.16892071440815926, + 0.748473547399044, + 0.03292875364422798, + 0.7930482514202595, + 2.225373137742281, + 0.5195436906069517, + 1.2087019737809896, + 1.0262889005243778, + 0.8573398590087891, + 1.28844397328794, + 0.8138989806175232, + 0.435986353084445, + 3.9882831051945686, + 0.6147178523242474, + 0.5433467924594879, + 1.6016677431762218, + 0.0996734257787466, + 0.08300880715250969, + 1.7731016390025616, + 0.6947140656411648, + 0.9300412833690643, + 0.6110206507146358, + 0.9676662720739841, + 2.095546228811145, + 0.9598752036690712, + 1.39706352353096, + 3.432645309716463, + 2.2264454066753387, + 0.0780715811997652, + 1.6026675142347813, + 0.06959292106330395, + 2.201396580785513, + 3.497268347069621, + 0.3264914136379957, + 0.6382700316607952, + 0.7063105218112469, + 0.6658119168132544, + 1.4633795116096735, + 1.0219430923461914, + 1.0434342455118895, + 0.7726253159344196, + 1.4414455199148506, + 3.908568475395441, + 0.5733816213905811, + 0.6078952923417091, + 0.028027042746543884, + 1.1582614500075579, + 0.836487764492631, + 1.206108532845974, + 2.6812123525887728, + 0.4938395842909813 + ], + "unique_experts": 64, + "load_cv": 0.6467398508871716, + "normalized_load_entropy": 0.9514295429459725, + "max_load_share": 0.05152979066022544 + } + }, + "s0_period": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "cd8ec658c8fe889117e022d21ef833039fd5cd6ea32882c0fa315d30482bbe57", + "route_weight_sha256": "c8a87ebde947988f640253af030070703c1c4172edb5e73cc3ad9b20745ff872", + "loads": [ + 12, + 38, + 24, + 4, + 19, + 10, + 8, + 17, + 30, + 6, + 35, + 4, + 6, + 5, + 11, + 1, + 13, + 19, + 11, + 24, + 12, + 6, + 33, + 10, + 11, + 41, + 14, + 11, + 30, + 1, + 4, + 18, + 10, + 26, + 15, + 15, + 29, + 18, + 9, + 27, + 23, + 3, + 26, + 3, + 21, + 25, + 10, + 15, + 12, + 16, + 11, + 18, + 7, + 2, + 16, + 32, + 16, + 9, + 2, + 15, + 17, + 18, + 32, + 10 + ], + "weighted_loads": [ + 0.757850494235754, + 2.805375326424837, + 0.8785128593444824, + 0.15676671639084816, + 0.8631842117756605, + 0.7408026400953531, + 0.49924558959901333, + 0.5662686582654715, + 1.3587272968143225, + 0.27990126609802246, + 2.882113043218851, + 0.16545848175883293, + 0.5871627405285835, + 0.18182017281651497, + 0.7310951240360737, + 0.03286166861653328, + 0.8576033525168896, + 1.5952400509268045, + 0.5507890153676271, + 1.277335599064827, + 0.7860419135540724, + 0.20849345065653324, + 1.400572882965207, + 0.6574773900210857, + 0.43701365776360035, + 3.985498808324337, + 0.4619565065950155, + 0.5301072522997856, + 1.6575236041098833, + 0.023697229102253914, + 0.14205499179661274, + 1.2212325744330883, + 0.3354880791157484, + 0.9799825679510832, + 0.41262528486549854, + 1.0577304288744926, + 2.1113342456519604, + 0.6248651761561632, + 0.5589757040143013, + 2.966254997998476, + 1.6975416988134384, + 0.07879641465842724, + 1.5620489045977592, + 0.10442792624235153, + 1.4377184491604567, + 2.3038497790694237, + 0.3113651257008314, + 0.6663032192736864, + 0.6638869792222977, + 0.6435693427920341, + 0.628730408847332, + 1.0384970121085644, + 0.4138892814517021, + 0.20050926506519318, + 0.5874424427747726, + 3.887956202030182, + 0.5684695076197386, + 0.30519682727754116, + 0.050133103504776955, + 1.0542864315211773, + 0.6272775083780289, + 1.2004141677170992, + 2.267991155385971, + 0.4403423387557268 + ], + "unique_experts": 64, + "load_cv": 0.6276248890883815, + "normalized_load_entropy": 0.9511883960840432, + "max_load_share": 0.04116465863453815 + }, + "full_input": { + "tokens": 191, + "top_k": 6, + "decisions": 1146, + "ordered_route_sha256": "7b9839facef62855b0c045c05c2cb98ab7bc8d7693b5daef1f6957db2975f941", + "route_weight_sha256": "a73b8599f69aa7a6073a3eb926b68de9144f2135299e43b7e800e8d7ac15cb01", + "loads": [ + 13, + 58, + 31, + 4, + 19, + 10, + 14, + 17, + 30, + 6, + 46, + 7, + 9, + 6, + 11, + 2, + 13, + 23, + 11, + 24, + 12, + 6, + 33, + 13, + 11, + 41, + 14, + 11, + 31, + 3, + 4, + 19, + 12, + 27, + 17, + 15, + 31, + 20, + 18, + 29, + 31, + 3, + 26, + 5, + 27, + 35, + 11, + 15, + 12, + 16, + 21, + 18, + 14, + 2, + 25, + 32, + 17, + 12, + 2, + 15, + 20, + 18, + 37, + 11 + ], + "weighted_loads": [ + 0.8057173937559128, + 4.403653460554779, + 1.301670104265213, + 0.15676671639084816, + 0.8631842117756605, + 0.7408026400953531, + 0.8966479208320379, + 0.5662686582654715, + 1.3587272968143225, + 0.27990126609802246, + 4.002070914953947, + 0.8277525715529919, + 0.7209431305527687, + 0.23129433020949364, + 0.7310951240360737, + 0.0753709003329277, + 0.8576033525168896, + 1.7232095375657082, + 0.5507890153676271, + 1.277335599064827, + 0.7860419135540724, + 0.20849345065653324, + 1.400572882965207, + 0.7759831324219704, + 0.43701365776360035, + 3.985498808324337, + 0.4619565065950155, + 0.5301072522997856, + 1.6991500053554773, + 0.08936127088963985, + 0.14205499179661274, + 1.318476166576147, + 0.44423270784318447, + 1.0389491114765406, + 0.5031248722225428, + 1.0577304288744926, + 2.2177754268050194, + 0.7485008034855127, + 1.0849576331675053, + 3.416730899363756, + 2.1598125137388706, + 0.07879641465842724, + 1.5620489045977592, + 0.16724076867103577, + 1.841083226725459, + 3.250678274780512, + 0.35532290674746037, + 0.6663032192736864, + 0.6638869792222977, + 0.6435693427920341, + 1.24363424628973, + 1.0384970121085644, + 0.7925168201327324, + 0.20050926506519318, + 1.0098204815294594, + 3.887956202030182, + 0.6239837352186441, + 0.41382421366870403, + 0.050133103504776955, + 1.0542864315211773, + 0.8111395537853241, + 1.2004141677170992, + 2.676028721034527, + 0.5852620471268892 + ], + "unique_experts": 64, + "load_cv": 0.6379490382131124, + "normalized_load_entropy": 0.9520991651512687, + "max_load_share": 0.0506108202443281 + } + }, + "s1_period": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "e96f3ea1b1b5d7f3c199c38e796eb424f809be35521964b9910787afa0447141", + "route_weight_sha256": "f4574f8c5bb91f1e95e120ce5f4e60b20882a132d3332f4127e03944d916c138", + "loads": [ + 12, + 38, + 24, + 5, + 21, + 11, + 9, + 17, + 30, + 7, + 37, + 7, + 6, + 6, + 11, + 1, + 12, + 20, + 9, + 21, + 11, + 6, + 29, + 7, + 11, + 42, + 14, + 11, + 28, + 3, + 3, + 17, + 13, + 24, + 17, + 13, + 28, + 22, + 8, + 27, + 20, + 2, + 25, + 3, + 22, + 25, + 6, + 14, + 14, + 18, + 10, + 18, + 7, + 4, + 15, + 33, + 13, + 15, + 2, + 15, + 15, + 18, + 33, + 11 + ], + "weighted_loads": [ + 0.7312582954764366, + 2.801506830379367, + 0.8927769139409065, + 0.18538694083690643, + 0.9327590260654688, + 0.7406375855207443, + 0.5605898406356573, + 0.5748527236282825, + 1.3870486114174128, + 0.3361239768564701, + 2.7831327095627785, + 0.25328782573342323, + 0.6057490222156048, + 0.20582060888409615, + 0.748278621584177, + 0.034030988812446594, + 0.7827988024801016, + 1.5958558581769466, + 0.4753017108887434, + 1.1745230704545975, + 0.7399513181298971, + 0.19720627181231976, + 1.2084850184619427, + 0.5379291474819183, + 0.41824873723089695, + 4.0052672903984785, + 0.47632864490151405, + 0.536825206130743, + 1.5982448142021894, + 0.08530773036181927, + 0.12223426252603531, + 1.1916769221425056, + 0.4290753360837698, + 0.9151080753654242, + 0.4636286832392216, + 0.9681575186550617, + 2.0456531178206205, + 0.7233178466558456, + 0.5591919608414173, + 2.943542269989848, + 1.5981276854872704, + 0.05242989957332611, + 1.5203534923493862, + 0.10235129855573177, + 1.494986530393362, + 2.158267294988036, + 0.20579536631703377, + 0.6433480624109507, + 0.7466466948390007, + 0.6888192314654589, + 0.5846456903964281, + 1.017684243619442, + 0.46134810522198677, + 0.26686297729611397, + 0.5528604313731194, + 3.9452928602695465, + 0.5150503423064947, + 0.4815492834895849, + 0.05289559252560139, + 1.06684335693717, + 0.5994411427527666, + 1.187047515064478, + 2.273146189749241, + 0.4761792775243521 + ], + "unique_experts": 64, + "load_cv": 0.6188258530183832, + "normalized_load_entropy": 0.9534180378781775, + "max_load_share": 0.04216867469879518 + }, + "full_input": { + "tokens": 207, + "top_k": 6, + "decisions": 1242, + "ordered_route_sha256": "e47b7cb45d667456ad75fef0838b70752306ad75a3cc5e1dc5db4900bc582b1a", + "route_weight_sha256": "95bfd27840ee006b487b2fa02369236b15004d41a29287e0f2b0105d05beab67", + "loads": [ + 15, + 64, + 34, + 5, + 21, + 12, + 15, + 17, + 32, + 8, + 59, + 11, + 11, + 6, + 11, + 2, + 12, + 28, + 10, + 22, + 14, + 14, + 29, + 12, + 11, + 42, + 15, + 11, + 29, + 5, + 3, + 20, + 19, + 25, + 20, + 13, + 29, + 28, + 17, + 32, + 30, + 2, + 26, + 4, + 31, + 41, + 7, + 14, + 14, + 18, + 22, + 18, + 14, + 11, + 29, + 34, + 16, + 21, + 2, + 16, + 18, + 19, + 38, + 14 + ], + "weighted_loads": [ + 0.9990868046879768, + 4.942071634344757, + 1.4559741336852312, + 0.18538694083690643, + 0.9327590260654688, + 0.779402419924736, + 1.1241358574479818, + 0.5748527236282825, + 1.4984916914254427, + 0.36489707976579666, + 4.8960409462451935, + 0.9898224510252476, + 0.864239539951086, + 0.20582060888409615, + 0.748278621584177, + 0.08054404705762863, + 0.7827988024801016, + 2.240023896098137, + 0.5283743012696505, + 1.1989426501095295, + 0.9944106992334127, + 0.8874837849289179, + 1.2084850184619427, + 0.7281944267451763, + 0.41824873723089695, + 4.0052672903984785, + 0.5099374689161777, + 0.536825206130743, + 1.642521170899272, + 0.15413725562393665, + 0.12223426252603531, + 1.6646548435091972, + 0.7027258481830359, + 0.96277448348701, + 0.6147591024637222, + 0.9681575186550617, + 2.0877125803381205, + 0.9646063446998596, + 1.354971818625927, + 3.442829880863428, + 2.138705685734749, + 0.05242989957332611, + 1.6063335500657558, + 0.132929265499115, + 2.162603374570608, + 3.551476551219821, + 0.24717266857624054, + 0.6433480624109507, + 0.7466466948390007, + 0.6888192314654589, + 1.3147895727306604, + 1.017684243619442, + 0.9479829110205173, + 0.7732889465987682, + 1.4181249046232551, + 3.971747547388077, + 0.6557717006653547, + 0.7359074745327234, + 0.05289559252560139, + 1.1540746353566647, + 0.7931867595762014, + 1.2308560088276863, + 2.7026065196841955, + 0.7510366328060627 + ], + "unique_experts": 64, + "load_cv": 0.636523208968825, + "normalized_load_entropy": 0.9539466534205627, + "max_load_share": 0.05152979066022544 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 166, + "ordered_topk_exact_tokens": 95, + "set_exact_tokens": 121, + "mean_set_jaccard": 0.9163798049340218, + "mean_token_weighted_tv": 0.01583571343245097, + "aggregate_load_tv": 0.03012048192771085 + }, + "system_bos": { + "tokens": 166, + "ordered_topk_exact_tokens": 82, + "set_exact_tokens": 99, + "mean_set_jaccard": 0.8795180722891566, + "mean_token_weighted_tv": 0.020772225386182588, + "aggregate_load_tv": 0.042168674698795185 + }, + "system_x": { + "tokens": 166, + "ordered_topk_exact_tokens": 67, + "set_exact_tokens": 91, + "mean_set_jaccard": 0.8621629374641423, + "mean_token_weighted_tv": 0.025500616142862892, + "aggregate_load_tv": 0.038152610441767064 + }, + "system_period": { + "tokens": 166, + "ordered_topk_exact_tokens": 68, + "set_exact_tokens": 97, + "mean_set_jaccard": 0.8650315547905911, + "mean_token_weighted_tv": 0.025894501123083644, + "aggregate_load_tv": 0.04116465863453815 + }, + "bos_at_s0": { + "tokens": 166, + "ordered_topk_exact_tokens": 74, + "set_exact_tokens": 95, + "mean_set_jaccard": 0.8752151462994836, + "mean_token_weighted_tv": 0.02164170006009559, + "aggregate_load_tv": 0.03915662650602409 + }, + "bos_at_s1": { + "tokens": 166, + "ordered_topk_exact_tokens": 79, + "set_exact_tokens": 102, + "mean_set_jaccard": 0.8823866896156053, + "mean_token_weighted_tv": 0.022521389247176338, + "aggregate_load_tv": 0.039156626506024104 + }, + "x_at_s0": { + "tokens": 166, + "ordered_topk_exact_tokens": 72, + "set_exact_tokens": 98, + "mean_set_jaccard": 0.8752151462994836, + "mean_token_weighted_tv": 0.022582262487947403, + "aggregate_load_tv": 0.04417670682730924 + }, + "x_at_s1": { + "tokens": 166, + "ordered_topk_exact_tokens": 72, + "set_exact_tokens": 94, + "mean_set_jaccard": 0.8598680436029834, + "mean_token_weighted_tv": 0.02677123775672033, + "aggregate_load_tv": 0.04116465863453815 + }, + "period_at_s0": { + "tokens": 166, + "ordered_topk_exact_tokens": 78, + "set_exact_tokens": 105, + "mean_set_jaccard": 0.884968445209409, + "mean_token_weighted_tv": 0.022131898499329585, + "aggregate_load_tv": 0.03714859437751004 + }, + "period_at_s1": { + "tokens": 166, + "ordered_topk_exact_tokens": 67, + "set_exact_tokens": 98, + "mean_set_jaccard": 0.8690476190476192, + "mean_token_weighted_tv": 0.025366281324728245, + "aggregate_load_tv": 0.03815261044176707 + } + } + }, + "layer_26": { + "layer": 26, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "cca4d18fa54e57902b6b3d0c8645e248c8dd475b10e694ce6196362fe73b0234", + "route_weight_sha256": "2f854006cef4ed7d09fdeaf6fc230c3b51cff57b4a1176ea59f5540d1b7e0b5e", + "loads": [ + 3, + 11, + 7, + 21, + 9, + 9, + 13, + 10, + 7, + 17, + 27, + 7, + 16, + 37, + 11, + 34, + 21, + 16, + 36, + 17, + 25, + 16, + 9, + 9, + 31, + 32, + 17, + 15, + 10, + 32, + 15, + 15, + 24, + 5, + 21, + 9, + 19, + 24, + 7, + 2, + 11, + 1, + 14, + 6, + 4, + 13, + 10, + 10, + 8, + 7, + 18, + 13, + 23, + 13, + 24, + 12, + 14, + 8, + 17, + 18, + 12, + 24, + 35, + 15 + ], + "weighted_loads": [ + 0.10939239710569382, + 0.8685981146991253, + 0.37906045839190483, + 0.8982999976724386, + 0.49260481260716915, + 0.31860896944999695, + 1.0642748717218637, + 0.3301625959575176, + 0.28265540674328804, + 1.0196537226438522, + 1.925631893798709, + 0.6291059963405132, + 1.3463434465229511, + 1.6087969467043877, + 0.7200706694275141, + 1.999846175312996, + 1.4929680414497852, + 0.6226680092513561, + 1.2786624375730753, + 0.9486026018857956, + 1.6779218316078186, + 1.682470852509141, + 0.37063004449009895, + 0.36900491267442703, + 1.5292788110673428, + 2.2597325667738914, + 1.2631087377667427, + 0.6987249869853258, + 0.5556847285479307, + 2.002715490758419, + 0.9251800328493118, + 0.6003761440515518, + 1.1168097630143166, + 0.16036392003297806, + 1.3027876559644938, + 0.39214243926107883, + 0.8504020944237709, + 1.221501735970378, + 0.2511843089014292, + 0.08868664875626564, + 0.41012340039014816, + 0.04700440913438797, + 0.6134317163378, + 0.29565802961587906, + 0.15802732110023499, + 0.5186846014112234, + 0.38914638571441174, + 0.35482284240424633, + 0.3099176436662674, + 0.3863428756594658, + 0.9029102064669132, + 0.486948786303401, + 1.5588395521044731, + 0.6444100830703974, + 1.2695191651582718, + 0.4554579257965088, + 1.0765570923686028, + 0.6744023896753788, + 1.0014419592916965, + 1.2087358571588993, + 1.0993824936449528, + 0.9594901204109192, + 1.7547726687043905, + 0.7842380553483963 + ], + "unique_experts": 64, + "load_cv": 0.561430844783486, + "normalized_load_entropy": 0.9624748961663547, + "max_load_share": 0.03714859437751004 + }, + "full_input": { + "tokens": 191, + "top_k": 6, + "decisions": 1146, + "ordered_route_sha256": "512a41bac07714b6365b72b170031dfc0dab23c174b6f276371781d62a9ccb8f", + "route_weight_sha256": "145e070a8eaa2ed79dcf491bc04887574c600a232a11df4a15a5aa4a52bd4f38", + "loads": [ + 3, + 11, + 7, + 22, + 9, + 9, + 13, + 12, + 7, + 21, + 30, + 13, + 16, + 39, + 26, + 36, + 21, + 27, + 37, + 17, + 25, + 20, + 10, + 9, + 38, + 32, + 23, + 21, + 10, + 33, + 23, + 15, + 27, + 6, + 25, + 9, + 26, + 24, + 7, + 2, + 11, + 1, + 14, + 8, + 5, + 13, + 14, + 10, + 9, + 8, + 26, + 13, + 27, + 13, + 25, + 12, + 27, + 16, + 23, + 19, + 13, + 24, + 36, + 18 + ], + "weighted_loads": [ + 0.10939239710569382, + 0.8685981146991253, + 0.37906045839190483, + 0.935654891654849, + 0.49260481260716915, + 0.31860896944999695, + 1.0642748717218637, + 0.48557983338832855, + 0.28265540674328804, + 1.2529026120901108, + 2.128419617190957, + 0.9723641339223832, + 1.3463434465229511, + 1.7226648926734924, + 1.3803955212351866, + 2.098061129450798, + 1.4929680414497852, + 1.1359328217804432, + 1.3303196113556623, + 0.9486026018857956, + 1.6779218316078186, + 1.905456755310297, + 0.44080227240920067, + 0.36900491267442703, + 1.9438067488372326, + 2.2597325667738914, + 2.055671840906143, + 0.95347885414958, + 0.5556847285479307, + 2.0431876331567764, + 1.74440523609519, + 0.6003761440515518, + 1.2262337245047092, + 0.19722359627485275, + 1.6235503796488047, + 0.39214243926107883, + 1.2147436700761318, + 1.221501735970378, + 0.2511843089014292, + 0.08868664875626564, + 0.41012340039014816, + 0.04700440913438797, + 0.6134317163378, + 0.3955361470580101, + 0.20228629931807518, + 0.5186846014112234, + 0.616629334166646, + 0.35482284240424633, + 0.3474029563367367, + 1.3726944848895073, + 1.2495751976966858, + 0.486948786303401, + 2.0330792888998985, + 0.6444100830703974, + 1.3162919878959656, + 0.4554579257965088, + 2.060757625848055, + 1.0791507908143103, + 1.2401239275932312, + 1.2552601769566536, + 1.1001902731368318, + 0.9594901204109192, + 1.7960230205208063, + 0.8975353501737118 + ], + "unique_experts": 64, + "load_cv": 0.535543491187316, + "normalized_load_entropy": 0.9638736887594826, + "max_load_share": 0.034031413612565446 + } + }, + "s1_eos": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "6d1cddcb3b55f76507b67a4a503f4a501049a0f29ed14f6ebd38d56d0ede8fb1", + "route_weight_sha256": "3fbfb5a86cce02c9cba52932baeaa6c8ba885a682d3fd8662ce0bb0cfd5cf1e8", + "loads": [ + 3, + 11, + 8, + 21, + 10, + 6, + 12, + 8, + 8, + 16, + 26, + 7, + 17, + 36, + 13, + 34, + 20, + 18, + 34, + 18, + 25, + 15, + 12, + 9, + 30, + 32, + 17, + 16, + 11, + 29, + 15, + 14, + 17, + 3, + 19, + 13, + 19, + 23, + 8, + 2, + 14, + 2, + 14, + 6, + 6, + 12, + 10, + 10, + 7, + 8, + 20, + 13, + 25, + 13, + 24, + 15, + 14, + 7, + 17, + 19, + 12, + 27, + 32, + 14 + ], + "weighted_loads": [ + 0.10775436088442802, + 0.8628496527671814, + 0.3957540728151798, + 0.8920094426721334, + 0.49801572784781456, + 0.23464946821331978, + 1.0071844533085823, + 0.29092059284448624, + 0.3116876855492592, + 0.9834114015102386, + 1.876417988911271, + 0.6297834254801273, + 1.34537691809237, + 1.5549098663032055, + 0.7875006161630154, + 1.9866284113377333, + 1.4371759723871946, + 0.6788315996527672, + 1.2207495979964733, + 1.006503615528345, + 1.6277217455208302, + 1.625445332378149, + 0.46702073328197, + 0.3719840422272682, + 1.5051835905760527, + 2.1796143762767315, + 1.2853522524237633, + 0.7244772370904684, + 0.5977064575999975, + 1.9353688955307007, + 0.9136035591363907, + 0.5455579366534948, + 0.8850117679685354, + 0.09709111601114273, + 1.296223597601056, + 0.5137461274862289, + 0.8695555925369263, + 1.2072633355855942, + 0.27780284732580185, + 0.0860831942409277, + 0.5018102191388607, + 0.0839807502925396, + 0.612769290804863, + 0.3131841644644737, + 0.24862847477197647, + 0.48594033904373646, + 0.3965299464762211, + 0.36259010061621666, + 0.27207340858876705, + 0.41229425370693207, + 0.9720816984772682, + 0.4741141963750124, + 1.597184231504798, + 0.639452425763011, + 1.2512954529374838, + 0.5474718175828457, + 1.0553692411631346, + 0.6480648629367352, + 0.9992293659597635, + 1.248826140537858, + 1.0943939201533794, + 1.0631370842456818, + 1.6745522823184729, + 0.7420430481433868 + ], + "unique_experts": 64, + "load_cv": 0.5344685986629396, + "normalized_load_entropy": 0.9654811110874972, + "max_load_share": 0.03614457831325301 + }, + "full_input": { + "tokens": 207, + "top_k": 6, + "decisions": 1242, + "ordered_route_sha256": "564dc1438927d770afbe25a7b67f2840530ecf2bc819ef4ad42d0382c0ef1616", + "route_weight_sha256": "074a3b16d22868ec05907f33107845b1de6d379d103743b66a8cba801cf7bb82", + "loads": [ + 4, + 11, + 8, + 21, + 13, + 6, + 12, + 10, + 8, + 23, + 32, + 14, + 17, + 38, + 28, + 39, + 20, + 26, + 36, + 18, + 25, + 22, + 20, + 9, + 40, + 35, + 29, + 25, + 11, + 32, + 25, + 15, + 24, + 4, + 26, + 13, + 31, + 28, + 11, + 3, + 15, + 2, + 15, + 10, + 7, + 12, + 14, + 11, + 8, + 11, + 27, + 13, + 34, + 15, + 27, + 17, + 32, + 17, + 27, + 24, + 15, + 27, + 35, + 15 + ], + "weighted_loads": [ + 0.1513156108558178, + 0.8628496527671814, + 0.3957540728151798, + 0.8920094426721334, + 0.6772183459252119, + 0.23464946821331978, + 1.0071844533085823, + 0.4600336030125618, + 0.3116876855492592, + 1.3777723871171474, + 2.5280094873160124, + 1.2518162578344345, + 1.34537691809237, + 1.6550964713096619, + 1.611491568852216, + 2.2971766348928213, + 1.4371759723871946, + 1.1150723681785166, + 1.3149317689239979, + 1.006503615528345, + 1.6277217455208302, + 2.1180636547505856, + 1.0199585799127817, + 0.3719840422272682, + 2.011202136054635, + 2.3222762309014797, + 2.624370973557234, + 1.083831725642085, + 0.5977064575999975, + 2.0327007826417685, + 1.9553267061710358, + 0.6249766927212477, + 1.1677208449691534, + 0.13112342730164528, + 1.7616468947380781, + 0.5137461274862289, + 1.5454002246260643, + 1.502513524144888, + 0.5662388615310192, + 0.12130271457135677, + 0.5327172875404358, + 0.0839807502925396, + 0.6565583534538746, + 0.5077970512211323, + 0.3013826943933964, + 0.48594033904373646, + 0.6463825739920139, + 0.4044010788202286, + 0.3057089764624834, + 1.5541682913899422, + 1.2679056897759438, + 0.4741141963750124, + 2.427431834861636, + 0.8285952340811491, + 1.4645911026746035, + 0.6632603257894516, + 2.702360725030303, + 1.4256029003299773, + 1.5711250137537718, + 1.4668049216270447, + 1.3393367668613791, + 1.0631370842456818, + 1.798408480361104, + 0.784804355353117 + ], + "unique_experts": 64, + "load_cv": 0.5109087427509905, + "normalized_load_entropy": 0.9668214177294518, + "max_load_share": 0.0322061191626409 + } + }, + "s0_bos": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "afb514740be3de0a7fdb0f3efd41af88752f637a55191f561260ad6fb6d5525b", + "route_weight_sha256": "78245b4ae0f4c723ca1fe8b5b545ba5edd5ac22065278820a96291ef35d05ffb", + "loads": [ + 3, + 11, + 8, + 23, + 10, + 13, + 13, + 10, + 9, + 16, + 27, + 7, + 17, + 43, + 10, + 33, + 22, + 14, + 34, + 17, + 26, + 15, + 14, + 9, + 27, + 32, + 17, + 15, + 10, + 30, + 14, + 12, + 21, + 5, + 17, + 8, + 18, + 22, + 7, + 1, + 16, + 1, + 14, + 6, + 4, + 16, + 10, + 10, + 7, + 6, + 19, + 13, + 26, + 12, + 22, + 15, + 16, + 8, + 16, + 18, + 13, + 21, + 34, + 13 + ], + "weighted_loads": [ + 0.11286799982190132, + 0.8668752796947956, + 0.4019488226622343, + 0.9973087012767792, + 0.5206537712365389, + 0.4591405652463436, + 1.075543101876974, + 0.3387321550399065, + 0.34167894534766674, + 0.9652171656489372, + 1.975479207932949, + 0.6378641650080681, + 1.360091108828783, + 1.8366602584719658, + 0.6915085352957249, + 1.9744384177029133, + 1.5336837992072105, + 0.5562570560723543, + 1.254593638703227, + 0.9619338512420654, + 1.7263316176831722, + 1.6993733812123537, + 0.5233445167541504, + 0.38481931015849113, + 1.4032015707343817, + 2.225274184718728, + 1.3713668957352638, + 0.7194987330585718, + 0.5902921240776777, + 1.9781508147716522, + 0.8785240389406681, + 0.4905775934457779, + 1.0057580471038818, + 0.15693493001163006, + 1.1502199675887823, + 0.37189585343003273, + 0.8133098818361759, + 1.1720572877675295, + 0.24319276213645935, + 0.0565006360411644, + 0.5597193855792284, + 0.04886331781744957, + 0.6198962107300758, + 0.3193499967455864, + 0.147797629237175, + 0.6084522698074579, + 0.4109250009059906, + 0.35857003927230835, + 0.25644344463944435, + 0.32341518998146057, + 0.9265361409634352, + 0.4829486757516861, + 1.7115408219397068, + 0.6358574517071247, + 1.20089540630579, + 0.5415341146290302, + 1.1133575104176998, + 0.6627777609974146, + 0.943426001816988, + 1.2525548487901688, + 1.1627213284373283, + 0.8651667088270187, + 1.7185059450566769, + 0.7019950654357672 + ], + "unique_experts": 64, + "load_cv": 0.5523950033024861, + "normalized_load_entropy": 0.9635296458869019, + "max_load_share": 0.04317269076305221 + }, + "full_input": { + "tokens": 191, + "top_k": 6, + "decisions": 1146, + "ordered_route_sha256": "7149fa68560c4e06c99abebfaae10832d2d39fb80f35c40b3ff06245a5cfa09a", + "route_weight_sha256": "2e86376c0794099b3839e285f7564f1fa11e34d79ef52366d6bdb85a851e9b04", + "loads": [ + 4, + 11, + 8, + 24, + 10, + 14, + 13, + 12, + 9, + 21, + 29, + 12, + 17, + 45, + 23, + 35, + 22, + 23, + 35, + 17, + 26, + 19, + 16, + 9, + 34, + 32, + 23, + 22, + 10, + 31, + 24, + 12, + 25, + 5, + 22, + 8, + 24, + 22, + 7, + 1, + 16, + 2, + 15, + 8, + 7, + 16, + 13, + 10, + 8, + 6, + 27, + 13, + 30, + 12, + 23, + 15, + 29, + 15, + 22, + 19, + 13, + 21, + 35, + 15 + ], + "weighted_loads": [ + 0.13955451361835003, + 0.8668752796947956, + 0.4019488226622343, + 1.0451072230935097, + 0.5206537712365389, + 0.51082693785429, + 1.075543101876974, + 0.5256350990384817, + 0.34167894534766674, + 1.2399612069129944, + 2.1162053644657135, + 0.9790716711431742, + 1.360091108828783, + 1.9597505182027817, + 1.2782287374138832, + 2.092056564986706, + 1.5336837992072105, + 0.9903609566390514, + 1.3139593657106161, + 0.9619338512420654, + 1.7263316176831722, + 1.9353330321609974, + 0.635485552251339, + 0.38481931015849113, + 1.801698898896575, + 2.225274184718728, + 2.2411350198090076, + 1.0696770288050175, + 0.5902921240776777, + 2.0186229571700096, + 1.7523227669298649, + 0.4905775934457779, + 1.1451122667640448, + 0.15693493001163006, + 1.509310819208622, + 0.37189585343003273, + 1.140226822346449, + 1.1720572877675295, + 0.24319276213645935, + 0.0565006360411644, + 0.5597193855792284, + 0.4411192797124386, + 0.6803011558949947, + 0.41922811418771744, + 0.2908052057027817, + 0.6084522698074579, + 0.5832174047827721, + 0.35857003927230835, + 0.3167308568954468, + 0.32341518998146057, + 1.2732011321932077, + 0.4829486757516861, + 2.168019998818636, + 0.6358574517071247, + 1.2476682290434837, + 0.5415341146290302, + 2.100644137710333, + 1.062690380960703, + 1.1821079701185226, + 1.299079168587923, + 1.1627213284373283, + 0.8651667088270187, + 1.7597562968730927, + 0.8110529500991106 + ], + "unique_experts": 64, + "load_cv": 0.5183422353199625, + "normalized_load_entropy": 0.9664156823500534, + "max_load_share": 0.03926701570680628 + } + }, + "s1_bos": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "146d265a97006d27eb5c6ca1d10402a377be8ea07437a8345a7bec82adcc67b8", + "route_weight_sha256": "b693118e325a35a7170f684b8e56b8c5e23ef140da2a98401bec019884448bfe", + "loads": [ + 3, + 12, + 8, + 23, + 8, + 8, + 13, + 11, + 8, + 16, + 27, + 7, + 17, + 38, + 11, + 32, + 22, + 14, + 36, + 17, + 25, + 17, + 13, + 9, + 28, + 34, + 17, + 15, + 11, + 30, + 15, + 13, + 19, + 6, + 18, + 11, + 18, + 25, + 9, + 1, + 12, + 1, + 14, + 6, + 3, + 15, + 10, + 10, + 7, + 7, + 18, + 15, + 25, + 13, + 24, + 14, + 14, + 8, + 16, + 18, + 12, + 23, + 33, + 13 + ], + "weighted_loads": [ + 0.10878189653158188, + 0.9064333438873291, + 0.40385835617780685, + 1.0063477139919996, + 0.45125822350382805, + 0.30870640464127064, + 1.0858896356076002, + 0.3778854515403509, + 0.316778939217329, + 0.9937193598598242, + 1.95264009013772, + 0.6256063152104616, + 1.3734038583934307, + 1.6452275849878788, + 0.7324222307652235, + 1.89901989325881, + 1.5217470340430737, + 0.5437423139810562, + 1.2927017267793417, + 0.9535067267715931, + 1.6893772389739752, + 1.7724008969962597, + 0.5017154533416033, + 0.3817114531993866, + 1.4137163795530796, + 2.277914386242628, + 1.2929648868739605, + 0.7162738740444183, + 0.6207366585731506, + 1.9654282107949257, + 0.9309358932077885, + 0.5079055745154619, + 0.9447961878031492, + 0.1987261064350605, + 1.22998683527112, + 0.4940120466053486, + 0.8302525207400322, + 1.2527850717306137, + 0.30818238109350204, + 0.05677039548754692, + 0.4441848676651716, + 0.048408981412649155, + 0.6131052989512682, + 0.3332849442958832, + 0.11263550072908401, + 0.582233851775527, + 0.41252306289970875, + 0.3554855231195688, + 0.27188410609960556, + 0.3660621792078018, + 0.8923412598669529, + 0.5530067700892687, + 1.6483012326061726, + 0.6334265898913145, + 1.2583572659641504, + 0.5178949236869812, + 1.0410178136080503, + 0.6631778422743082, + 0.9435545299202204, + 1.2613867539912462, + 1.117080483585596, + 0.9386901240795851, + 1.6867236271500587, + 0.7175746392458677 + ], + "unique_experts": 64, + "load_cv": 0.5451058325717407, + "normalized_load_entropy": 0.9640510604905026, + "max_load_share": 0.03815261044176707 + }, + "full_input": { + "tokens": 207, + "top_k": 6, + "decisions": 1242, + "ordered_route_sha256": "43cde8bc581684ee200a7d747d463894fe0b8c6b25b97e0df2134edc7d538073", + "route_weight_sha256": "cd0dfbacf8904913df852ea0ead707956bcd02a34db26b9a39e4eab3455fe80e", + "loads": [ + 3, + 12, + 8, + 24, + 11, + 8, + 13, + 13, + 8, + 24, + 35, + 13, + 17, + 39, + 24, + 37, + 22, + 21, + 37, + 17, + 25, + 24, + 20, + 9, + 38, + 37, + 30, + 23, + 11, + 33, + 27, + 14, + 25, + 7, + 25, + 11, + 30, + 30, + 12, + 2, + 13, + 1, + 16, + 10, + 6, + 15, + 14, + 11, + 8, + 9, + 25, + 15, + 34, + 15, + 27, + 17, + 33, + 17, + 26, + 23, + 14, + 23, + 36, + 15 + ], + "weighted_loads": [ + 0.10878189653158188, + 0.9064333438873291, + 0.40385835617780685, + 1.043367700651288, + 0.6304608415812254, + 0.30870640464127064, + 1.0858896356076002, + 0.553197992965579, + 0.316778939217329, + 1.4376118276268244, + 2.7269274406135082, + 1.2454008217900991, + 1.3734038583934307, + 1.6995509304106236, + 1.4828069228678942, + 2.219059593975544, + 1.5217470340430737, + 0.9995631538331509, + 1.3329486269503832, + 0.9535067267715931, + 1.6893772389739752, + 2.286546241492033, + 0.984104236587882, + 0.3817114531993866, + 1.9364120736718178, + 2.4205762408673763, + 2.785258263349533, + 1.0336247868835926, + 0.6207366585731506, + 2.0627600979059935, + 2.100196361541748, + 0.5873243305832148, + 1.1884560827165842, + 0.240780271589756, + 1.7486718781292439, + 0.4940120466053486, + 1.503582026809454, + 1.5480352602899075, + 0.5966183952987194, + 0.091989915817976, + 0.4750919360667467, + 0.048408981412649155, + 0.7021482456475496, + 0.5278978310525417, + 0.24504737555980682, + 0.582233851775527, + 0.6547994371503592, + 0.39729650132358074, + 0.3055196739733219, + 0.5229694023728371, + 1.1881652511656284, + 0.5530067700892687, + 2.44771483913064, + 0.8225693982094526, + 1.47165291570127, + 0.6633646283298731, + 2.7254351805895567, + 1.4354810025542974, + 1.5154501777142286, + 1.479365535080433, + 1.361097041517496, + 0.9386901240795851, + 1.81057982519269, + 0.8422436285763979 + ], + "unique_experts": 64, + "load_cv": 0.5128540074070912, + "normalized_load_entropy": 0.9663577748758703, + "max_load_share": 0.03140096618357488 + } + }, + "s0_x": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "aff59fd9212db76982d88785ac8737d452637d2d0f20f7e879f65860a6181570", + "route_weight_sha256": "b5566b0a2152c93962a1722795c6bbf888510b1c7789df06c5026be35bc353ab", + "loads": [ + 3, + 11, + 7, + 23, + 12, + 11, + 13, + 9, + 7, + 17, + 27, + 7, + 17, + 41, + 12, + 33, + 21, + 14, + 37, + 17, + 26, + 20, + 11, + 10, + 28, + 31, + 17, + 15, + 11, + 31, + 15, + 12, + 19, + 2, + 18, + 9, + 19, + 22, + 8, + 1, + 14, + 1, + 14, + 5, + 2, + 17, + 10, + 8, + 6, + 7, + 19, + 14, + 25, + 14, + 22, + 17, + 17, + 8, + 17, + 17, + 12, + 22, + 32, + 12 + ], + "weighted_loads": [ + 0.1097860224545002, + 0.8680000342428684, + 0.3629026636481285, + 0.9997855443507433, + 0.5527112130075693, + 0.3982607014477253, + 1.0472936984151602, + 0.30117283947765827, + 0.2816840410232544, + 0.9975476264953613, + 1.9581256695091724, + 0.6495994850993156, + 1.3583667110651731, + 1.786628883332014, + 0.7373405732214451, + 1.9774113446474075, + 1.5269081182777882, + 0.5497315898537636, + 1.3074455223977566, + 0.9475964084267616, + 1.6710848435759544, + 1.8960517514497042, + 0.43830335699021816, + 0.4115253519266844, + 1.4130219519138336, + 2.217763114720583, + 1.3103331588208675, + 0.7089866660535336, + 0.5919111222028732, + 2.0453190095722675, + 0.8993849344551563, + 0.48403116315603256, + 0.9432013742625713, + 0.06156675145030022, + 1.1511245984584093, + 0.4096306189894676, + 0.8654221370816231, + 1.1812983844429255, + 0.27346022613346577, + 0.057042479515075684, + 0.49377171881496906, + 0.04889621585607529, + 0.6318720541894436, + 0.27267880737781525, + 0.08114079758524895, + 0.6510259658098221, + 0.4031317364424467, + 0.30267764814198017, + 0.22658602707087994, + 0.3609019611030817, + 0.9380925819277763, + 0.505546061322093, + 1.6428236439824104, + 0.6661989390850067, + 1.209527252241969, + 0.6085786521434784, + 1.1277360394597054, + 0.6872097663581371, + 0.9825863186269999, + 1.1751182340085506, + 1.076949369162321, + 0.9007569514214993, + 1.6277539245784283, + 0.6574034299701452 + ], + "unique_experts": 64, + "load_cv": 0.5600502043130662, + "normalized_load_entropy": 0.9611948054408659, + "max_load_share": 0.04116465863453815 + }, + "full_input": { + "tokens": 191, + "top_k": 6, + "decisions": 1146, + "ordered_route_sha256": "6975c594a5eb4cdf5637cfde0c9169548a8d1ea86d8a06249d09e908f187be24", + "route_weight_sha256": "a1408eddb893a4d8d7b8f39a7c773619d89a6d6add74fdd6683f5fa73000c89f", + "loads": [ + 3, + 11, + 7, + 23, + 12, + 11, + 13, + 11, + 7, + 22, + 30, + 14, + 17, + 43, + 26, + 35, + 21, + 25, + 38, + 17, + 26, + 24, + 12, + 10, + 35, + 31, + 23, + 22, + 11, + 33, + 23, + 12, + 21, + 2, + 21, + 9, + 25, + 22, + 8, + 1, + 14, + 1, + 14, + 9, + 3, + 17, + 13, + 8, + 6, + 7, + 27, + 14, + 29, + 14, + 23, + 17, + 34, + 16, + 23, + 18, + 12, + 22, + 33, + 15 + ], + "weighted_loads": [ + 0.1097860224545002, + 0.8680000342428684, + 0.3629026636481285, + 0.9997855443507433, + 0.5527112130075693, + 0.3982607014477253, + 1.0472936984151602, + 0.473892604932189, + 0.2816840410232544, + 1.2615321390330791, + 2.15093644708395, + 1.1384650189429522, + 1.3583667110651731, + 1.906469363719225, + 1.4296648353338242, + 2.0758004784584045, + 1.5269081182777882, + 1.1383510660380125, + 1.3491642959415913, + 0.9475964084267616, + 1.6710848435759544, + 2.167813751846552, + 0.5116641130298376, + 0.4115253519266844, + 1.824688270688057, + 2.217763114720583, + 2.0767285116016865, + 0.9960776213556528, + 0.5919111222028732, + 2.1335114799439907, + 1.6419362425804138, + 0.48403116315603256, + 1.0190293230116367, + 0.06156675145030022, + 1.4125789050012827, + 0.4096306189894676, + 1.1782668642699718, + 1.1812983844429255, + 0.27346022613346577, + 0.057042479515075684, + 0.49377171881496906, + 0.04889621585607529, + 0.6318720541894436, + 0.4714975245296955, + 0.11684469133615494, + 0.6510259658098221, + 0.5893592741340399, + 0.30267764814198017, + 0.22658602707087994, + 0.3609019611030817, + 1.284757573157549, + 0.505546061322093, + 2.0932116210460663, + 0.6661989390850067, + 1.256300074979663, + 0.6085786521434784, + 2.308342721313238, + 1.1970657017081976, + 1.2212682869285345, + 1.221642553806305, + 1.076949369162321, + 0.9007569514214993, + 1.669004276394844, + 0.7638925295323133 + ], + "unique_experts": 64, + "load_cv": 0.5409756222494062, + "normalized_load_entropy": 0.9621080269583243, + "max_load_share": 0.037521815008726006 + } + }, + "s1_x": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "0d834df4a30525333cc9acfe837110df3a429e4999727e08ff7ef87a5d5d014b", + "route_weight_sha256": "9226741fef658cd5e24c34c2a1c0bf10192d5b8169cf7e75f14623a685435da6", + "loads": [ + 3, + 11, + 8, + 22, + 8, + 9, + 13, + 11, + 8, + 18, + 26, + 7, + 17, + 38, + 12, + 34, + 20, + 13, + 34, + 19, + 25, + 18, + 11, + 9, + 28, + 33, + 17, + 15, + 12, + 31, + 15, + 15, + 19, + 5, + 17, + 12, + 20, + 23, + 9, + 4, + 13, + 1, + 14, + 6, + 5, + 15, + 10, + 10, + 6, + 5, + 19, + 13, + 24, + 12, + 24, + 14, + 15, + 8, + 17, + 18, + 11, + 23, + 32, + 12 + ], + "weighted_loads": [ + 0.10796689987182617, + 0.8420887924730778, + 0.37443070858716965, + 0.9550788942724466, + 0.4231129828840494, + 0.33852091804146767, + 1.0261296797543764, + 0.37428100407123566, + 0.32055239006876945, + 1.0642674397677183, + 1.820572653785348, + 0.6692777741700411, + 1.3451315462589264, + 1.6267453115433455, + 0.7246083039790392, + 2.011342938989401, + 1.4688355438411236, + 0.5345052536576986, + 1.2411484029144049, + 1.0408109296113253, + 1.6895699296146631, + 1.8750249557197094, + 0.4357396997511387, + 0.39074641838669777, + 1.3920026943087578, + 2.2418444622308016, + 1.201822653412819, + 0.7533890120685101, + 0.6292679086327553, + 2.036756942048669, + 0.908071719110012, + 0.583485446870327, + 0.9015806410461664, + 0.1723746582865715, + 1.160205915570259, + 0.5057043582201004, + 0.9217175114899874, + 1.167859684675932, + 0.3181060291826725, + 0.1523139551281929, + 0.4729356709867716, + 0.04685989394783974, + 0.6060983911156654, + 0.30969367176294327, + 0.18844838999211788, + 0.5907258857041597, + 0.4090221244841814, + 0.36918393336236477, + 0.24448955431580544, + 0.2755419611930847, + 0.9339596815407276, + 0.4659176226705313, + 1.5488784164190292, + 0.560099521651864, + 1.2532740719616413, + 0.5336375180631876, + 1.0201600901782513, + 0.7084244322031736, + 1.011307343840599, + 1.1775801833719015, + 1.0205208361148834, + 0.9488176368176937, + 1.6731866914778948, + 0.6480283085256815 + ], + "unique_experts": 64, + "load_cv": 0.5350718025100835, + "normalized_load_entropy": 0.9658287581059894, + "max_load_share": 0.03815261044176707 + }, + "full_input": { + "tokens": 207, + "top_k": 6, + "decisions": 1242, + "ordered_route_sha256": "606edb2945443a87aeb6536e3681d919d4e2fb7e2e30c1ae0acd280e2d7c6609", + "route_weight_sha256": "04609dea0a02a0e17e0c20504003ea5315a066f02fbc10887452e224f00ef910", + "loads": [ + 3, + 11, + 8, + 24, + 11, + 9, + 13, + 13, + 8, + 25, + 34, + 15, + 17, + 39, + 27, + 39, + 20, + 20, + 34, + 19, + 25, + 26, + 18, + 9, + 38, + 36, + 29, + 24, + 12, + 35, + 24, + 16, + 23, + 5, + 23, + 12, + 32, + 28, + 12, + 5, + 14, + 1, + 16, + 11, + 6, + 15, + 13, + 11, + 7, + 7, + 26, + 13, + 33, + 14, + 27, + 16, + 36, + 19, + 28, + 23, + 13, + 23, + 35, + 14 + ], + "weighted_loads": [ + 0.10796689987182617, + 0.8420887924730778, + 0.37443070858716965, + 1.0146417263895273, + 0.6023156009614468, + 0.33852091804146767, + 1.0261296797543764, + 0.562434658408165, + 0.32055239006876945, + 1.4642527233809233, + 2.573235409334302, + 1.453808581456542, + 1.3451315462589264, + 1.6810686569660902, + 1.6284003015607595, + 2.323802702128887, + 1.4688355438411236, + 0.989532457664609, + 1.2411484029144049, + 1.0408109296113253, + 1.6895699296146631, + 2.4491308256983757, + 0.9219753332436085, + 0.39074641838669777, + 1.9146995842456818, + 2.38450631685555, + 2.5400870107114315, + 1.110194854438305, + 0.6292679086327553, + 2.206954672932625, + 1.8494058176875114, + 0.6629042029380798, + 1.0728972908109426, + 0.1723746582865715, + 1.5991448611021042, + 0.5057043582201004, + 1.591440575197339, + 1.4631098732352257, + 0.6065420433878899, + 0.18753347545862198, + 0.5038427393883467, + 0.04685989394783974, + 0.6902834586799145, + 0.5494962334632874, + 0.21787035278975964, + 0.5907258857041597, + 0.6313577499240637, + 0.4109949115663767, + 0.2781251221895218, + 0.43244918435811996, + 1.2297836728394032, + 0.4659176226705313, + 2.3147192150354385, + 0.7492423299700022, + 1.466569721698761, + 0.6494260262697935, + 2.786236349493265, + 1.6387343648821115, + 1.6463483236730099, + 1.3955589644610882, + 1.2645373940467834, + 0.9488176368176937, + 1.797042889520526, + 0.721533989533782 + ], + "unique_experts": 64, + "load_cv": 0.5132583429016231, + "normalized_load_entropy": 0.9665981610437919, + "max_load_share": 0.03140096618357488 + } + }, + "s0_period": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "b6427e09cfea17c20150c32c6473ea3bfe85e9e3d888efbbc44b5dc71e4f59b4", + "route_weight_sha256": "fb716b57a871fada9ce02a3d38f7142841077d386ad2b7359e1dffac37f25543", + "loads": [ + 3, + 11, + 7, + 22, + 9, + 11, + 12, + 12, + 8, + 18, + 27, + 7, + 19, + 42, + 13, + 32, + 22, + 16, + 35, + 17, + 26, + 19, + 10, + 9, + 28, + 31, + 17, + 15, + 12, + 31, + 16, + 13, + 19, + 3, + 18, + 9, + 18, + 22, + 8, + 1, + 14, + 1, + 14, + 6, + 2, + 15, + 10, + 8, + 6, + 7, + 19, + 16, + 25, + 13, + 23, + 15, + 16, + 7, + 17, + 16, + 11, + 22, + 33, + 12 + ], + "weighted_loads": [ + 0.11155016347765923, + 0.8692554943263531, + 0.3612060621380806, + 0.9704216625541449, + 0.45378329046070576, + 0.40746463648974895, + 1.037924487143755, + 0.4049438498914242, + 0.3080446198582649, + 1.027570977807045, + 1.9917084071785212, + 0.6468583606183529, + 1.448510080575943, + 1.7921685855835676, + 0.7702147886157036, + 1.9486022740602493, + 1.5848927479237318, + 0.6129732448607683, + 1.277512663975358, + 0.9414217043668032, + 1.6715057864785194, + 1.8271660953760147, + 0.405179426074028, + 0.3772438317537308, + 1.4091767966747284, + 2.223784590139985, + 1.3431964479386806, + 0.7137646339833736, + 0.6326865423470736, + 2.0601089764386415, + 0.9344525560736656, + 0.5033757835626602, + 0.9507764745503664, + 0.09626367501914501, + 1.156235285103321, + 0.4085816200822592, + 0.8353134579956532, + 1.1694670841097832, + 0.28127057664096355, + 0.05901945009827614, + 0.4963057115674019, + 0.04882131889462471, + 0.6310634780675173, + 0.3277605399489403, + 0.08289766311645508, + 0.585330517962575, + 0.39649704471230507, + 0.30130859836935997, + 0.2304963804781437, + 0.3686385229229927, + 0.9422882236540318, + 0.576987911015749, + 1.6819651406258345, + 0.6541333422064781, + 1.2250824756920338, + 0.5492862369865179, + 1.1450813487172127, + 0.6430648304522038, + 0.9882100503891706, + 1.1579682603478432, + 1.0852874666452408, + 0.9089292772114277, + 1.6564993150532246, + 0.6549534685909748 + ], + "unique_experts": 64, + "load_cv": 0.5568153970545298, + "normalized_load_entropy": 0.9618730608664596, + "max_load_share": 0.04216867469879518 + }, + "full_input": { + "tokens": 191, + "top_k": 6, + "decisions": 1146, + "ordered_route_sha256": "334291b673173e5279b0c5595d85b8ed8439eca1e095f145a70abafcf8c11527", + "route_weight_sha256": "31c6d34dfe85889e2e603f203de08c6957339828e6b8cae97c3e5c34917ed213", + "loads": [ + 3, + 11, + 7, + 23, + 9, + 12, + 12, + 14, + 8, + 22, + 31, + 12, + 19, + 44, + 27, + 33, + 22, + 26, + 35, + 17, + 26, + 23, + 11, + 9, + 36, + 31, + 23, + 21, + 12, + 32, + 26, + 13, + 23, + 4, + 21, + 9, + 25, + 22, + 8, + 1, + 14, + 1, + 14, + 8, + 3, + 15, + 14, + 8, + 6, + 7, + 27, + 16, + 30, + 13, + 24, + 15, + 31, + 14, + 23, + 17, + 11, + 22, + 34, + 16 + ], + "weighted_loads": [ + 0.11155016347765923, + 0.8692554943263531, + 0.3612060621380806, + 1.0126433353871107, + 0.45378329046070576, + 0.45196820236742496, + 1.037924487143755, + 0.5576732456684113, + 0.3080446198582649, + 1.2615904249250889, + 2.2482859063893557, + 0.988065866753459, + 1.448510080575943, + 1.9069670531898737, + 1.3942504785954952, + 2.007810264825821, + 1.5848927479237318, + 1.1650544367730618, + 1.277512663975358, + 0.9414217043668032, + 1.6715057864785194, + 2.0921666491776705, + 0.45752421021461487, + 0.3772438317537308, + 1.9096100479364395, + 2.223784590139985, + 2.1017544493079185, + 0.9685185011476278, + 0.6326865423470736, + 2.100581118836999, + 1.7548675779253244, + 0.5033757835626602, + 1.0930373836308718, + 0.1346855480223894, + 1.4270290434360504, + 0.4085816200822592, + 1.210165623575449, + 1.1694670841097832, + 0.28127057664096355, + 0.05901945009827614, + 0.4963057115674019, + 0.04882131889462471, + 0.6310634780675173, + 0.4276386573910713, + 0.12108677625656128, + 0.585330517962575, + 0.6121045164763927, + 0.30130859836935997, + 0.2304963804781437, + 0.3686385229229927, + 1.2889532148838043, + 0.576987911015749, + 2.207833370193839, + 0.6541333422064781, + 1.2718552984297276, + 0.5492862369865179, + 2.3312190994620323, + 1.042977450415492, + 1.2268920186907053, + 1.2044925801455975, + 1.0852874666452408, + 0.9089292772114277, + 1.6977496668696404, + 0.8523302711546421 + ], + "unique_experts": 64, + "load_cv": 0.5391709928799222, + "normalized_load_entropy": 0.9625421160165794, + "max_load_share": 0.038394415357766144 + } + }, + "s1_period": { + "target_content": { + "tokens": 166, + "top_k": 6, + "decisions": 996, + "ordered_route_sha256": "a5f74fd39a2d23516b60a8d84e023850024702c69dc0d2d4eb9ce462437a7e7d", + "route_weight_sha256": "e4a499672b6af202897fe713b8991c754cf9efab7de9b6b0b85643bb397e1fb9", + "loads": [ + 3, + 11, + 7, + 23, + 7, + 6, + 13, + 10, + 8, + 16, + 26, + 6, + 18, + 39, + 12, + 36, + 19, + 15, + 40, + 19, + 25, + 17, + 12, + 8, + 28, + 34, + 17, + 17, + 11, + 30, + 16, + 13, + 19, + 4, + 18, + 11, + 20, + 18, + 7, + 2, + 13, + 1, + 13, + 8, + 3, + 16, + 10, + 9, + 7, + 6, + 21, + 14, + 24, + 12, + 26, + 15, + 15, + 7, + 16, + 18, + 11, + 25, + 32, + 13 + ], + "weighted_loads": [ + 0.10699025169014931, + 0.8414217233657837, + 0.33078664541244507, + 0.9752094186842442, + 0.386817691847682, + 0.2415290866047144, + 1.0549614671617746, + 0.3462168835103512, + 0.32065441831946373, + 0.988672774285078, + 1.8974012527614832, + 0.6660815067589283, + 1.3764299415051937, + 1.664394348859787, + 0.7477367110550404, + 2.090917920693755, + 1.4572573900222778, + 0.5770711619406939, + 1.4399898275732994, + 1.0396869368851185, + 1.6436007339507341, + 1.8189506493508816, + 0.47502967342734337, + 0.3485099282115698, + 1.366347311064601, + 2.3010129537433386, + 1.2290401812642813, + 0.8088371977210045, + 0.5951316505670547, + 2.0136535614728928, + 0.9190871752798557, + 0.523574298247695, + 0.93696035631001, + 0.1388863567262888, + 1.2156943567097187, + 0.4596761614084244, + 0.9369408618658781, + 1.0211011860519648, + 0.2591928858309984, + 0.0863436758518219, + 0.48035707883536816, + 0.04721035435795784, + 0.5849859211593866, + 0.4058848060667515, + 0.12317575141787529, + 0.611129691824317, + 0.396718667820096, + 0.3286259789019823, + 0.2770857997238636, + 0.30561381578445435, + 0.9780540708452463, + 0.4865147825330496, + 1.5668635927140713, + 0.5632755905389786, + 1.3119094856083393, + 0.5568610765039921, + 1.0717969629913568, + 0.695827592164278, + 0.9715455994009972, + 1.2034624610096216, + 1.0418362021446228, + 1.0142104234546423, + 1.6743448860943317, + 0.6887347605079412 + ], + "unique_experts": 64, + "load_cv": 0.5733696556779274, + "normalized_load_entropy": 0.9608215767977372, + "max_load_share": 0.040160642570281124 + }, + "full_input": { + "tokens": 207, + "top_k": 6, + "decisions": 1242, + "ordered_route_sha256": "b99f931d52db43623b7b8bb23c1387408963c386681729886aec8fa9931e9d3d", + "route_weight_sha256": "3e016800ea724759f8583a3987cfb7c682d9bdb7a6556944c021adf7d0680850", + "loads": [ + 3, + 11, + 7, + 24, + 10, + 6, + 13, + 12, + 8, + 23, + 34, + 12, + 18, + 41, + 27, + 41, + 19, + 22, + 40, + 19, + 25, + 25, + 18, + 8, + 39, + 37, + 29, + 26, + 11, + 33, + 25, + 14, + 24, + 4, + 24, + 11, + 33, + 24, + 10, + 3, + 14, + 1, + 15, + 12, + 3, + 16, + 14, + 10, + 9, + 8, + 28, + 14, + 34, + 14, + 30, + 17, + 36, + 16, + 26, + 23, + 13, + 25, + 35, + 16 + ], + "weighted_loads": [ + 0.10699025169014931, + 0.8414217233657837, + 0.33078664541244507, + 1.0057384222745895, + 0.5660203099250793, + 0.2415290866047144, + 1.0549614671617746, + 0.5130466185510159, + 0.32065441831946373, + 1.3850512616336346, + 2.6734839361160994, + 1.2858760133385658, + 1.3764299415051937, + 1.7638628222048283, + 1.6573754660785198, + 2.3960497099906206, + 1.4572573900222778, + 1.0798146966844797, + 1.4399898275732994, + 1.0396869368851185, + 1.6436007339507341, + 2.3935020454227924, + 0.9215977899730206, + 0.3485099282115698, + 1.968143267557025, + 2.443674808368087, + 2.577297193929553, + 1.1579918265342712, + 0.5951316505670547, + 2.1109854485839605, + 1.8602236323058605, + 0.6029930543154478, + 1.1367766484618187, + 0.1388863567262888, + 1.6556258387863636, + 0.4596761614084244, + 1.6569674145430326, + 1.350826533511281, + 0.5476289000362158, + 0.12156319618225098, + 0.5112641472369432, + 0.04721035435795784, + 0.6625766362994909, + 0.60049769282341, + 0.12317575141787529, + 0.611129691824317, + 0.6531805898994207, + 0.3704369571059942, + 0.34550584107637405, + 0.4625210389494896, + 1.2738780621439219, + 0.4865147825330496, + 2.3800661265850067, + 0.7524183988571167, + 1.5643451996147633, + 0.672649584710598, + 2.918096661567688, + 1.4681307524442673, + 1.5434412471950054, + 1.4214412420988083, + 1.2858527600765228, + 1.0142104234546423, + 1.798201084136963, + 0.8492281250655651 + ], + "unique_experts": 64, + "load_cv": 0.5457749527603161, + "normalized_load_entropy": 0.9619991085323056, + "max_load_share": 0.033011272141706925 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 166, + "ordered_topk_exact_tokens": 98, + "set_exact_tokens": 115, + "mean_set_jaccard": 0.905249569707401, + "mean_token_weighted_tv": 0.016882918141109038, + "aggregate_load_tv": 0.03714859437751003 + }, + "system_bos": { + "tokens": 166, + "ordered_topk_exact_tokens": 83, + "set_exact_tokens": 107, + "mean_set_jaccard": 0.8935742971887549, + "mean_token_weighted_tv": 0.01885012203423553, + "aggregate_load_tv": 0.03112449799196787 + }, + "system_x": { + "tokens": 166, + "ordered_topk_exact_tokens": 69, + "set_exact_tokens": 96, + "mean_set_jaccard": 0.8694779116465863, + "mean_token_weighted_tv": 0.024349734086139375, + "aggregate_load_tv": 0.036144578313253004 + }, + "system_period": { + "tokens": 166, + "ordered_topk_exact_tokens": 60, + "set_exact_tokens": 87, + "mean_set_jaccard": 0.8539873780837636, + "mean_token_weighted_tv": 0.02659135064424341, + "aggregate_load_tv": 0.043172690763052204 + }, + "bos_at_s0": { + "tokens": 166, + "ordered_topk_exact_tokens": 85, + "set_exact_tokens": 107, + "mean_set_jaccard": 0.8874067699368904, + "mean_token_weighted_tv": 0.020694017528096235, + "aggregate_load_tv": 0.04216867469879518 + }, + "bos_at_s1": { + "tokens": 166, + "ordered_topk_exact_tokens": 79, + "set_exact_tokens": 109, + "mean_set_jaccard": 0.888984509466437, + "mean_token_weighted_tv": 0.021258217748254538, + "aggregate_load_tv": 0.03714859437751005 + }, + "x_at_s0": { + "tokens": 166, + "ordered_topk_exact_tokens": 83, + "set_exact_tokens": 108, + "mean_set_jaccard": 0.8901319563970166, + "mean_token_weighted_tv": 0.020502556351024704, + "aggregate_load_tv": 0.04417670682730924 + }, + "x_at_s1": { + "tokens": 166, + "ordered_topk_exact_tokens": 71, + "set_exact_tokens": 99, + "mean_set_jaccard": 0.8668674698795181, + "mean_token_weighted_tv": 0.02604991814166487, + "aggregate_load_tv": 0.034136546184738964 + }, + "period_at_s0": { + "tokens": 166, + "ordered_topk_exact_tokens": 84, + "set_exact_tokens": 102, + "mean_set_jaccard": 0.873121055651176, + "mean_token_weighted_tv": 0.023400983565587955, + "aggregate_load_tv": 0.043172690763052204 + }, + "period_at_s1": { + "tokens": 166, + "ordered_topk_exact_tokens": 68, + "set_exact_tokens": 98, + "mean_set_jaccard": 0.8685312679288583, + "mean_token_weighted_tv": 0.025621419003884118, + "aggregate_load_tv": 0.04016064257028112 + } + } + } + } + }, + { + "id": "HumanEval/23", + "domain": "code", + "label": "Python code", + "within_domain_index": 3, + "selection_rank": "03b3c7329e474bf8e9660969ed5898d561e718f12a59d2fc1ed641be54b68860", + "source_text_sha256": "0bb479f80d27872f6bebc01618112b372cc8a2e6aee9e4b76337e3b3416418c7", + "source_characters": 132, + "source_tokens": 42, + "content_token_ids_sha256": "1d8f3287aa0ecec28fd21d2e9db06b60386320bde229230ed104606876efb387", + "prompt_tokens_by_condition": { + "s0_eos": 67, + "s1_eos": 83, + "s0_bos": 67, + "s1_bos": 83, + "s0_x": 67, + "s1_x": 83, + "s0_period": 67, + "s1_period": 83 + }, + "batch_prompt_tokens": 83, + "content_tokens": 42, + "boundary_crossing_tokens_by_condition": { + "s0_eos": 0, + "s1_eos": 0, + "s0_bos": 0, + "s1_bos": 0, + "s0_x": 0, + "s1_x": 0, + "s0_period": 0, + "s1_period": 0 + }, + "forward_seconds": 0.6850698009948246, + "peak_cuda_memory_allocated_bytes": 27616554496, + "hidden_stages": { + "embedding": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b1996961aabdb461bb1c037ff1872ebc0a3737159fce641d8b3377c9541c132d", + "mean": -0.00037236526259221137, + "std": 0.0890573188662529, + "rms": 0.08905809372663498, + "max_abs": 2.046875 + }, + "full_input": { + "shape": [ + 67, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "daec4f99e1a80c672bdc377f47259cffbb0757d96e8106ea603be84b7d121016", + "mean": -0.0005831784219481051, + "std": 0.08765120804309845, + "rms": 0.08765314519405365, + "max_abs": 2.046875 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b1996961aabdb461bb1c037ff1872ebc0a3737159fce641d8b3377c9541c132d", + "mean": -0.00037236526259221137, + "std": 0.0890573188662529, + "rms": 0.08905809372663498, + "max_abs": 2.046875 + }, + "full_input": { + "shape": [ + 83, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f3dd35e25353bbf5441ebc61c37c0f8dd4af4e5d05b3c1e40020949e1af85db2", + "mean": -0.0008942913264036179, + "std": 0.0912005826830864, + "rms": 0.09120496362447739, + "max_abs": 2.046875 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b1996961aabdb461bb1c037ff1872ebc0a3737159fce641d8b3377c9541c132d", + "mean": -0.00037236526259221137, + "std": 0.0890573188662529, + "rms": 0.08905809372663498, + "max_abs": 2.046875 + }, + "full_input": { + "shape": [ + 67, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a5535ebbac49e89dad8952d4758a9d1d8182e2073201a1bd11a7b8065c4b1230", + "mean": -0.0005602948949672282, + "std": 0.0873323529958725, + "rms": 0.08733414858579636, + "max_abs": 2.046875 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b1996961aabdb461bb1c037ff1872ebc0a3737159fce641d8b3377c9541c132d", + "mean": -0.00037236526259221137, + "std": 0.0890573188662529, + "rms": 0.08905809372663498, + "max_abs": 2.046875 + }, + "full_input": { + "shape": [ + 83, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1502ddc7567483505a5a5a5ed330581fd22761c991f6a137823cd29866401290", + "mean": -0.0008758190670050681, + "std": 0.09095339477062225, + "rms": 0.09095760434865952, + "max_abs": 2.046875 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b1996961aabdb461bb1c037ff1872ebc0a3737159fce641d8b3377c9541c132d", + "mean": -0.00037236526259221137, + "std": 0.0890573188662529, + "rms": 0.08905809372663498, + "max_abs": 2.046875 + }, + "full_input": { + "shape": [ + 67, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2a1b6baa59931dc227c98e64dfbfe841ca114c8ef4a69d29c7df3e87b738a7ef", + "mean": -0.0006164511432871222, + "std": 0.08754745125770569, + "rms": 0.0875496193766594, + "max_abs": 2.046875 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b1996961aabdb461bb1c037ff1872ebc0a3737159fce641d8b3377c9541c132d", + "mean": -0.00037236526259221137, + "std": 0.0890573188662529, + "rms": 0.08905809372663498, + "max_abs": 2.046875 + }, + "full_input": { + "shape": [ + 83, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c7a1b34151a4b9c04b2133ff46a603e8984b52039e33188bac93a94636726c7a", + "mean": -0.0009211500291712582, + "std": 0.09112001210451126, + "rms": 0.09112466871738434, + "max_abs": 2.046875 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b1996961aabdb461bb1c037ff1872ebc0a3737159fce641d8b3377c9541c132d", + "mean": -0.00037236526259221137, + "std": 0.0890573188662529, + "rms": 0.08905809372663498, + "max_abs": 2.046875 + }, + "full_input": { + "shape": [ + 67, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f1dee70572f3b0eb577e79ad8baf5d178293e755136bf334173d71b75d459ee3", + "mean": -0.0006176621536724269, + "std": 0.08730251342058182, + "rms": 0.08730469644069672, + "max_abs": 2.046875 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b1996961aabdb461bb1c037ff1872ebc0a3737159fce641d8b3377c9541c132d", + "mean": -0.00037236526259221137, + "std": 0.0890573188662529, + "rms": 0.08905809372663498, + "max_abs": 2.046875 + }, + "full_input": { + "shape": [ + 83, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "83aec5dcea2e9daea174bdf6163ccecd4b90752a13d12e1c4056b7e93cc7d3ff", + "mean": -0.0009221274522133172, + "std": 0.09093010425567627, + "rms": 0.09093478322029114, + "max_abs": 2.046875 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 42, + "exact_hidden_rows": 42, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 1.0, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "system_bos": { + "tokens": 42, + "exact_hidden_rows": 42, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 1.0, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "system_x": { + "tokens": 42, + "exact_hidden_rows": 42, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 1.0, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "system_period": { + "tokens": 42, + "exact_hidden_rows": 42, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 1.0, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "bos_at_s0": { + "tokens": 42, + "exact_hidden_rows": 42, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 1.0, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "bos_at_s1": { + "tokens": 42, + "exact_hidden_rows": 42, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 1.0, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "x_at_s0": { + "tokens": 42, + "exact_hidden_rows": 42, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 1.0, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "x_at_s1": { + "tokens": 42, + "exact_hidden_rows": 42, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 1.0, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "period_at_s0": { + "tokens": 42, + "exact_hidden_rows": 42, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 1.0, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "period_at_s1": { + "tokens": 42, + "exact_hidden_rows": 42, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 1.0, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + } + } + }, + "layer_00": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "780201fe96bf5c0a0f968cdb395ec3c4e957b93c8aae752c52d456283129acf4", + "mean": -0.0009466364281252027, + "std": 0.08520309627056122, + "rms": 0.08520834892988205, + "max_abs": 2.296875 + }, + "full_input": { + "shape": [ + 67, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "35ad0ce7a711b1999744438a95da4f5321f0931513648df742f2b859dfaa019b", + "mean": -0.0011739975307136774, + "std": 0.08684656023979187, + "rms": 0.086854487657547, + "max_abs": 2.4375 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "13d6e7f73332c88fb9be1fda55c26622bfbee6a32a6420ff0a8b6b3aa3dd8e25", + "mean": -0.0008998397970572114, + "std": 0.08522210270166397, + "rms": 0.08522685617208481, + "max_abs": 2.3125 + }, + "full_input": { + "shape": [ + 83, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "13be5385775eaa58721dab92483b271f2cb648374af12ec74afe01faaa322880", + "mean": -0.0013702365104109049, + "std": 0.08911531418561935, + "rms": 0.0891258493065834, + "max_abs": 2.4375 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "aa3307cb0f5e9f0b52eda9579f7dcf368a5c09b1acf7034b4c1b4e08ddd2ddcd", + "mean": -0.000880053557921201, + "std": 0.08516761660575867, + "rms": 0.08517216145992279, + "max_abs": 2.28125 + }, + "full_input": { + "shape": [ + 67, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "019e631550eb57c166285489caf06ecdb3eebb6529508a2a5396d5b060e1a7aa", + "mean": -0.0011031338945031166, + "std": 0.08637071400880814, + "rms": 0.08637775480747223, + "max_abs": 2.4375 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "172f0631f94134884955b33892291af9edbca60344f147af5a2f1d6bbb6399cd", + "mean": -0.0008494709618389606, + "std": 0.08471614122390747, + "rms": 0.08472039550542831, + "max_abs": 2.296875 + }, + "full_input": { + "shape": [ + 83, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "40d82054780be96e0fad64c6900079430cbd4e4ced6a5fa41d3ca0eabc198520", + "mean": -0.0013214143691584468, + "std": 0.08850552141666412, + "rms": 0.08851537853479385, + "max_abs": 2.4375 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "68257475ad88462b3675c2ae8954e7769c9f867a821d389eb98fe61e1bedc025", + "mean": -0.0008913768106140196, + "std": 0.08454082161188126, + "rms": 0.08454552292823792, + "max_abs": 2.296875 + }, + "full_input": { + "shape": [ + 67, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bec2530d4d86d00a5180cceeb343a4291be019931d1930e3e0ac6d8ab48d93d0", + "mean": -0.0011444477131590247, + "std": 0.08620656281709671, + "rms": 0.08621415495872498, + "max_abs": 2.4375 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "aa2af903367470188d419051894de28e188734d04d6415eec2cbe4fd7449aa85", + "mean": -0.0008583273738622665, + "std": 0.08420085906982422, + "rms": 0.08420523256063461, + "max_abs": 2.296875 + }, + "full_input": { + "shape": [ + 83, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "74df9c49ab8c6a301abe39669ff85239bebbcf1e4abf4fc5796b49149ecd2362", + "mean": -0.0013595301425084472, + "std": 0.08846714347600937, + "rms": 0.08847758919000626, + "max_abs": 2.4375 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "78e1ee399b146060263a6629b40055a308dde2efd5455507f0bf8a78121f03ae", + "mean": -0.0008904589922167361, + "std": 0.08447366952896118, + "rms": 0.08447836339473724, + "max_abs": 2.28125 + }, + "full_input": { + "shape": [ + 67, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "faa9d517517c1ce7f6b733b58c63a9e548288cc213b6c1f7a439088db9def98b", + "mean": -0.0011432183673605323, + "std": 0.08579352498054504, + "rms": 0.0858011394739151, + "max_abs": 2.4375 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5a6253dbf92a18ab1b45018b04fe3fd98c0e3bc1ff70f854128d0d669959e86f", + "mean": -0.0008569849305786192, + "std": 0.08418086171150208, + "rms": 0.08418522775173187, + "max_abs": 2.296875 + }, + "full_input": { + "shape": [ + 83, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "de991d0cedb41f0c6e5dec3b7efdf3efe3cd665f7b0f12043276b1408d845915", + "mean": -0.00135493790730834, + "std": 0.08813552558422089, + "rms": 0.08814594149589539, + "max_abs": 2.4375 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9984052777290344, + "min_cosine_similarity": 0.9929930567741394, + "mean_relative_l2": 0.05486069247126579, + "max_abs_delta": 0.0625 + }, + "system_bos": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9977760314941406, + "min_cosine_similarity": 0.9853445291519165, + "mean_relative_l2": 0.06219644099473953, + "max_abs_delta": 0.109375 + }, + "system_x": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9978724122047424, + "min_cosine_similarity": 0.9858656525611877, + "mean_relative_l2": 0.06077028438448906, + "max_abs_delta": 0.0859375 + }, + "system_period": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9979353547096252, + "min_cosine_similarity": 0.9864276647567749, + "mean_relative_l2": 0.05999251827597618, + "max_abs_delta": 0.09375 + }, + "bos_at_s0": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9861248731613159, + "min_cosine_similarity": 0.9364227056503296, + "mean_relative_l2": 0.1570710390806198, + "max_abs_delta": 0.17822265625 + }, + "bos_at_s1": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9877000451087952, + "min_cosine_similarity": 0.9469202160835266, + "mean_relative_l2": 0.14848047494888306, + "max_abs_delta": 0.173828125 + }, + "x_at_s0": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9871732592582703, + "min_cosine_similarity": 0.9398829936981201, + "mean_relative_l2": 0.14946505427360535, + "max_abs_delta": 0.1806640625 + }, + "x_at_s1": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9883384704589844, + "min_cosine_similarity": 0.9496410489082336, + "mean_relative_l2": 0.14376038312911987, + "max_abs_delta": 0.189453125 + }, + "period_at_s0": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9874497652053833, + "min_cosine_similarity": 0.941407322883606, + "mean_relative_l2": 0.1480286717414856, + "max_abs_delta": 0.18017578125 + }, + "period_at_s1": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9884986877441406, + "min_cosine_similarity": 0.9501667022705078, + "mean_relative_l2": 0.14284250140190125, + "max_abs_delta": 0.19140625 + } + } + }, + "layer_01": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "229c7a897d4e1f3b6b983af4ba91c6810fb34d3e3e13aa847a000c70c62a586c", + "mean": -0.0012285293778404593, + "std": 0.10888587683439255, + "rms": 0.10889281332492828, + "max_abs": 2.6875 + }, + "full_input": { + "shape": [ + 67, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "78cd5f0151c0aaef77aad167044ea6ea49f05ca0f7a61807e14e28ac02beaa5e", + "mean": -0.005614018067717552, + "std": 0.9789866805076599, + "rms": 0.979002833366394, + "max_abs": 126.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e39584c05aae574d4ba4e9cbd6cb43299aab8ae2c8f99d7e56f17be61a6cc0ed", + "mean": -0.0011978099355474114, + "std": 0.10862898081541061, + "rms": 0.10863558202981949, + "max_abs": 2.6875 + }, + "full_input": { + "shape": [ + 83, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ae99f030d18833bad0db3cfba2107a05a8b8e9e1aaa6b6c761741b1e9e87c7bb", + "mean": -0.005337641108781099, + "std": 0.9135710597038269, + "rms": 0.9135866761207581, + "max_abs": 135.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "54e1186a6d773a506985768a899d9705bc81914547b0ec159fd74de8f748f1de", + "mean": -0.00127230875659734, + "std": 0.10481580346822739, + "rms": 0.1048235297203064, + "max_abs": 2.65625 + }, + "full_input": { + "shape": [ + 67, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "77509933274c30a4e9516f92d515de6ceb8a4b835f0ab2e8921b17ecdde0ef95", + "mean": -0.001364337746053934, + "std": 0.10895581543445587, + "rms": 0.10896435379981995, + "max_abs": 4.6875 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b33a4d5d75a7cfc98d4cae4ef7365caa038c0cd260135f9916f92ab585c61c53", + "mean": -0.001284400001168251, + "std": 0.10312295705080032, + "rms": 0.10313095152378082, + "max_abs": 2.640625 + }, + "full_input": { + "shape": [ + 83, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "14653a459fcfc1da7b165e696ab0fbcd347b61ea6dc924fc9193b8ae862452c7", + "mean": -0.0017480930546298623, + "std": 0.10893473029136658, + "rms": 0.10894875228404999, + "max_abs": 4.6875 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9b2ded8da6b28b6ace37b9a26d10f7d0b38329a0c1066f0f30cff72edaa9d0a1", + "mean": -0.0012659647036343813, + "std": 0.10493138432502747, + "rms": 0.10493902117013931, + "max_abs": 2.703125 + }, + "full_input": { + "shape": [ + 67, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "99d82c6491fe15aeea31d7977d6b76d462a115408d0d51560a34a1eb2c6b54ca", + "mean": -0.001372495898976922, + "std": 0.10915303975343704, + "rms": 0.10916167497634888, + "max_abs": 4.6875 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f04c2e35e2413142fdab4b559f113eccb1ea5db06c835e16806de0297ac8e01d", + "mean": -0.0012292248429730535, + "std": 0.10239532589912415, + "rms": 0.1024027094244957, + "max_abs": 2.65625 + }, + "full_input": { + "shape": [ + 83, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7d2d0d56f26842bc226184fab97fdb7753594bacded4c06f89b987c8a1edef65", + "mean": -0.0017328365938737988, + "std": 0.10868427157402039, + "rms": 0.10869807749986649, + "max_abs": 4.6875 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "865843fe8e13d5139a18b903993975e81a256d2a57bfced7474ee6f182e8a76c", + "mean": -0.0012422194704413414, + "std": 0.1050441637635231, + "rms": 0.10505151003599167, + "max_abs": 2.6875 + }, + "full_input": { + "shape": [ + 67, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "30e0313f871ceebff95fbd5c93ca2907792ea6f1086c7dd395873ea3ae1afce8", + "mean": -0.0013856153236702085, + "std": 0.10871418565511703, + "rms": 0.10872301459312439, + "max_abs": 4.6875 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "241240dfd1798449868b2747fefb77535476d364c791b177d853a1e22bf62c40", + "mean": -0.0012233750894665718, + "std": 0.10255280882120132, + "rms": 0.10256011039018631, + "max_abs": 2.65625 + }, + "full_input": { + "shape": [ + 83, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "29ad3292bb758fe1773bcaeecc2fec897f29b8bb639158b672e3f384d2400730", + "mean": -0.0017466323915868998, + "std": 0.10836034268140793, + "rms": 0.10837442427873611, + "max_abs": 4.6875 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9975329637527466, + "min_cosine_similarity": 0.9893157482147217, + "mean_relative_l2": 0.0670669823884964, + "max_abs_delta": 0.0859375 + }, + "system_bos": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9953640699386597, + "min_cosine_similarity": 0.978352963924408, + "mean_relative_l2": 0.09029809385538101, + "max_abs_delta": 0.15625 + }, + "system_x": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9936428070068359, + "min_cosine_similarity": 0.9720327854156494, + "mean_relative_l2": 0.1049407348036766, + "max_abs_delta": 0.15234375 + }, + "system_period": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9937276244163513, + "min_cosine_similarity": 0.9714125394821167, + "mean_relative_l2": 0.10385392606258392, + "max_abs_delta": 0.1484375 + }, + "bos_at_s0": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9834069609642029, + "min_cosine_similarity": 0.9077869057655334, + "mean_relative_l2": 0.17122098803520203, + "max_abs_delta": 0.25390625 + }, + "bos_at_s1": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9829623103141785, + "min_cosine_similarity": 0.9182319641113281, + "mean_relative_l2": 0.17609818279743195, + "max_abs_delta": 0.283203125 + }, + "x_at_s0": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9840925931930542, + "min_cosine_similarity": 0.9022828340530396, + "mean_relative_l2": 0.16541987657546997, + "max_abs_delta": 0.333984375 + }, + "x_at_s1": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.981883704662323, + "min_cosine_similarity": 0.9083818793296814, + "mean_relative_l2": 0.18004539608955383, + "max_abs_delta": 0.361328125 + }, + "period_at_s0": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9844660758972168, + "min_cosine_similarity": 0.9043684601783752, + "mean_relative_l2": 0.16362451016902924, + "max_abs_delta": 0.330078125 + }, + "period_at_s1": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9821180701255798, + "min_cosine_similarity": 0.9072425961494446, + "mean_relative_l2": 0.17860452830791473, + "max_abs_delta": 0.3515625 + } + } + }, + "layer_02": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9d3cc090eab44107d44e0c7c2a79f4ad90c0434f649835131224d24bce72b485", + "mean": -0.0013999734073877335, + "std": 0.13066397607326508, + "rms": 0.13067147135734558, + "max_abs": 3.609375 + }, + "full_input": { + "shape": [ + 67, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3694aabd6693c0e7acac2069f8cd6af8cf8a47b4ed8b610584787b3925f202c3", + "mean": -0.015564952045679092, + "std": 2.935025215148926, + "rms": 2.9350662231445312, + "max_abs": 392.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9711b57b25e26f76bcb298b3b37219b6c5e0c83cc4820590f45f988911a4f4cc", + "mean": -0.0011877319775521755, + "std": 0.1303323656320572, + "rms": 0.13033777475357056, + "max_abs": 3.5625 + }, + "full_input": { + "shape": [ + 83, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b87e99d50afead0274981bcc542609299867276e8d8493c5d90a7fbdcfd061c3", + "mean": -0.014903087168931961, + "std": 2.916496515274048, + "rms": 2.916534662246704, + "max_abs": 436.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5cdbdb9bfdf304ca5935effe7f66b574458885ad4d5b15cb794aa46ed30246b4", + "mean": -0.001418844098225236, + "std": 0.12760791182518005, + "rms": 0.1276157945394516, + "max_abs": 3.609375 + }, + "full_input": { + "shape": [ + 67, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0be2ffd1bb6af47051c55fe26525227d27c5d445dc0a332894c9e2fbfabf3d1a", + "mean": -0.0019415924325585365, + "std": 0.23653540015220642, + "rms": 0.23654335737228394, + "max_abs": 23.75 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8ceaedf04521b1a6337d239693010071c5551bea89572862125e3f6442c21572", + "mean": -0.0011369317071512341, + "std": 0.12655940651893616, + "rms": 0.12656451761722565, + "max_abs": 3.53125 + }, + "full_input": { + "shape": [ + 83, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c2382173c1cb3710a44e643c818cc79db9e9bd6ef54f02fa9f74f3690c4be370", + "mean": -0.0018711076118052006, + "std": 0.22008275985717773, + "rms": 0.22009070217609406, + "max_abs": 23.75 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7e969c9fb775954f68b28a76a2d703744c21ea1c8c3537cb2294fc8276c2c25c", + "mean": -0.0013910995330661535, + "std": 0.12689515948295593, + "rms": 0.12690278887748718, + "max_abs": 3.625 + }, + "full_input": { + "shape": [ + 67, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1b2be60729beba4fada07d60a3138ca1252372a25942be431221049460c61b54", + "mean": -0.0019387073116376996, + "std": 0.2363828420639038, + "rms": 0.23639079928398132, + "max_abs": 23.75 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0057eaf13d86c378c7d410948ad1ca496fa12097a708fe13df7a2fcfd26747af", + "mean": -0.0010398204904049635, + "std": 0.12517927587032318, + "rms": 0.1251835972070694, + "max_abs": 3.53125 + }, + "full_input": { + "shape": [ + 83, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5fcbc4871e2da1ce4e63c2bc2526d530e515f41143892bcae4d15c8522e995e5", + "mean": -0.0018277985509485006, + "std": 0.21976803243160248, + "rms": 0.21977563202381134, + "max_abs": 23.75 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "025343c863bc875030be78792ee6933590bdef103c7b015745e159dba7a93b9f", + "mean": -0.0013203074922785163, + "std": 0.12674765288829803, + "rms": 0.1267545372247696, + "max_abs": 3.625 + }, + "full_input": { + "shape": [ + 67, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ed913f1019d76c321aa801b3347fb86d57bd8c34a1fa84bcf109aee5abebed99", + "mean": -0.0019830765668302774, + "std": 0.23585079610347748, + "rms": 0.23585914075374603, + "max_abs": 23.75 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "794d6b5d2c2fc9780b1683a8873cdea34b91c674e60d7b7e0e2c15dbfa2c5534", + "mean": -0.0010058557381853461, + "std": 0.12522335350513458, + "rms": 0.1252274066209793, + "max_abs": 3.53125 + }, + "full_input": { + "shape": [ + 83, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f0c52f6d3393bc60f5c45210003fafc526fe238b1a1ee80738afc5f733b7fbac", + "mean": -0.0018649230478331447, + "std": 0.21938972175121307, + "rms": 0.2193976491689682, + "max_abs": 23.75 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9971379041671753, + "min_cosine_similarity": 0.987368106842041, + "mean_relative_l2": 0.07193496078252792, + "max_abs_delta": 0.1875 + }, + "system_bos": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9942023754119873, + "min_cosine_similarity": 0.9730344414710999, + "mean_relative_l2": 0.10109881311655045, + "max_abs_delta": 0.21875 + }, + "system_x": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9920178651809692, + "min_cosine_similarity": 0.9643009901046753, + "mean_relative_l2": 0.11650470644235611, + "max_abs_delta": 0.296875 + }, + "system_period": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9919843077659607, + "min_cosine_similarity": 0.9632946252822876, + "mean_relative_l2": 0.11616745591163635, + "max_abs_delta": 0.25 + }, + "bos_at_s0": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9832161664962769, + "min_cosine_similarity": 0.8767861127853394, + "mean_relative_l2": 0.16712652146816254, + "max_abs_delta": 0.4140625 + }, + "bos_at_s1": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9805982708930969, + "min_cosine_similarity": 0.8743798136711121, + "mean_relative_l2": 0.1808178722858429, + "max_abs_delta": 0.46484375 + }, + "x_at_s0": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9821102619171143, + "min_cosine_similarity": 0.8461619019508362, + "mean_relative_l2": 0.1678752899169922, + "max_abs_delta": 0.53125 + }, + "x_at_s1": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9772337079048157, + "min_cosine_similarity": 0.8349957466125488, + "mean_relative_l2": 0.1912735551595688, + "max_abs_delta": 0.578125 + }, + "period_at_s0": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9826138615608215, + "min_cosine_similarity": 0.8478630781173706, + "mean_relative_l2": 0.16626547276973724, + "max_abs_delta": 0.5078125 + }, + "period_at_s1": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9774976372718811, + "min_cosine_similarity": 0.830653965473175, + "mean_relative_l2": 0.19027358293533325, + "max_abs_delta": 0.5703125 + } + } + }, + "layer_03": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bda9832f8d86a78babd964e7dbdf3a84953dd1a6987f79100121b2abe5f31428", + "mean": -0.0024989794474095106, + "std": 0.15203607082366943, + "rms": 0.15205660462379456, + "max_abs": 4.53125 + }, + "full_input": { + "shape": [ + 67, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "96b16fb6fc9848c6294b2be9320310f6fdaeb4b4e4cff13e30bee0602126bda4", + "mean": -0.021114351227879524, + "std": 8.801166534423828, + "rms": 8.801192283630371, + "max_abs": 1136.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2c265fe9446a3c5bd7460407f636858fa3d9f4428eddb5f76978c2f9cc16673d", + "mean": -0.0024115697015076876, + "std": 0.15239167213439941, + "rms": 0.15241076052188873, + "max_abs": 4.5 + }, + "full_input": { + "shape": [ + 83, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "74b1b0dfe8618d44af53eaf92ac0b5bafb034da9406c26b3777b80b716226aca", + "mean": -0.019893072545528412, + "std": 8.162898063659668, + "rms": 8.162922859191895, + "max_abs": 1136.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "79384f822dc4bc0190fe9f5e8426474a13f02119de11cb213b7260e2f6f58d9e", + "mean": -0.002564492402598262, + "std": 0.15156294405460358, + "rms": 0.15158464014530182, + "max_abs": 4.625 + }, + "full_input": { + "shape": [ + 67, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7bd0ec462088fd6f15e956004c3c19cc510a07029476d06aacbe082b6a1a4a75", + "mean": -0.005988589022308588, + "std": 7.848329544067383, + "rms": 7.848331928253174, + "max_abs": 1136.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bb1d839526f114a679dec5469991eac130efaa85037feab0f40393d2e19e26b0", + "mean": -0.0025458410382270813, + "std": 0.15091748535633087, + "rms": 0.1509389579296112, + "max_abs": 4.625 + }, + "full_input": { + "shape": [ + 83, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8b6820f5a8cc63bbb8a54736d3dc4f5d6268c2811303be8ad25ff78f5e608b71", + "mean": -0.00555047020316124, + "std": 7.0517096519470215, + "rms": 7.051712512969971, + "max_abs": 1136.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "dc115a411efc1b1779688f928b2a0bffc8180051c20b88a2d29ea394f994ab47", + "mean": -0.002543221926316619, + "std": 0.14997737109661102, + "rms": 0.14999893307685852, + "max_abs": 4.65625 + }, + "full_input": { + "shape": [ + 67, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5188d6d52e3a2c3550a4df58a45e5e951044e9ab763bc00d7a592264f16527fa", + "mean": -0.006056871265172958, + "std": 7.848297595977783, + "rms": 7.848299980163574, + "max_abs": 1136.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1ac9bfe709f0eecff45d8985efb4919f06bfd77aa431654c3a922616616e2bfd", + "mean": -0.0025154291652143, + "std": 0.14912636578083038, + "rms": 0.14914757013320923, + "max_abs": 4.625 + }, + "full_input": { + "shape": [ + 83, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3d6be0951507cf8cdf940d071972dbbf25c06e8ad2e7fc5bb417f8da5b359f23", + "mean": -0.005601873621344566, + "std": 7.051681041717529, + "rms": 7.05168342590332, + "max_abs": 1136.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0521a60303e91c2829524d6321e55de0f79ce25f11165c80a0caf1c1808054dc", + "mean": -0.002478762296959758, + "std": 0.14968912303447723, + "rms": 0.14970964193344116, + "max_abs": 4.65625 + }, + "full_input": { + "shape": [ + 67, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9547fa9b1ed0792915e711427cbc6af51bc004b79bca9f3ac517087bcc329709", + "mean": -0.0060294680297374725, + "std": 7.848283290863037, + "rms": 7.848285675048828, + "max_abs": 1136.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "05f2326edb3826676a8da616718d87cc6c1aa03e8db56b1764d9d7652af8fe63", + "mean": -0.0024600380565971136, + "std": 0.1489206701517105, + "rms": 0.14894098043441772, + "max_abs": 4.625 + }, + "full_input": { + "shape": [ + 83, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e569586e09defc2f56851001b5ddb9d68059ba304047960006b108f88bbb6862", + "mean": -0.005582272540777922, + "std": 7.051668643951416, + "rms": 7.051671028137207, + "max_abs": 1136.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9967942833900452, + "min_cosine_similarity": 0.9842824935913086, + "mean_relative_l2": 0.0749414786696434, + "max_abs_delta": 0.203125 + }, + "system_bos": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9938172101974487, + "min_cosine_similarity": 0.9716336131095886, + "mean_relative_l2": 0.10437161475419998, + "max_abs_delta": 0.328125 + }, + "system_x": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9913562536239624, + "min_cosine_similarity": 0.9595701098442078, + "mean_relative_l2": 0.1194964051246643, + "max_abs_delta": 0.3125 + }, + "system_period": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9911528825759888, + "min_cosine_similarity": 0.9547422528266907, + "mean_relative_l2": 0.12053941190242767, + "max_abs_delta": 0.34375 + }, + "bos_at_s0": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9844081401824951, + "min_cosine_similarity": 0.8825532793998718, + "mean_relative_l2": 0.16074849665164948, + "max_abs_delta": 0.41796875 + }, + "bos_at_s1": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9813535809516907, + "min_cosine_similarity": 0.8806980848312378, + "mean_relative_l2": 0.17685000598430634, + "max_abs_delta": 0.453125 + }, + "x_at_s0": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9821383953094482, + "min_cosine_similarity": 0.8418500423431396, + "mean_relative_l2": 0.16465550661087036, + "max_abs_delta": 0.55859375 + }, + "x_at_s1": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9768729209899902, + "min_cosine_similarity": 0.8261435627937317, + "mean_relative_l2": 0.18909597396850586, + "max_abs_delta": 0.546875 + }, + "period_at_s0": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9824435114860535, + "min_cosine_similarity": 0.8378466367721558, + "mean_relative_l2": 0.16283181309700012, + "max_abs_delta": 0.5390625 + }, + "period_at_s1": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.976175844669342, + "min_cosine_similarity": 0.7979645729064941, + "mean_relative_l2": 0.18994101881980896, + "max_abs_delta": 0.51953125 + } + } + }, + "layer_04": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c5451ce8e3c9de38622f8eb443de5ae308d0c375a03b9d5db0b2f7b0227b06c2", + "mean": -0.0020495112985372543, + "std": 0.19616608321666718, + "rms": 0.19617678225040436, + "max_abs": 5.40625 + }, + "full_input": { + "shape": [ + 67, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bd073c9425d95cf225e7205bca9a22e7eebe77b6e0e98f57f7bbe38f69f9ff9b", + "mean": -0.020533444359898567, + "std": 9.183841705322266, + "rms": 9.18386459350586, + "max_abs": 1152.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3638cf08f8d507c300c5aaa14e40ed78be69a0a31cb3746fa4aee0f38b6a2c8b", + "mean": -0.001986975781619549, + "std": 0.19628293812274933, + "rms": 0.19629299640655518, + "max_abs": 5.40625 + }, + "full_input": { + "shape": [ + 83, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8752db36b4e831c493363d1082b31c7d12e9685768d3ccd0475c4da351716fd1", + "mean": -0.019494017586112022, + "std": 8.495535850524902, + "rms": 8.49555778503418, + "max_abs": 1152.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a6c50fc2eedd819041d40bce96b0f5768b4841d6eb06b5c1709fd3e038a45853", + "mean": -0.002310120966285467, + "std": 0.19671252369880676, + "rms": 0.19672608375549316, + "max_abs": 5.6875 + }, + "full_input": { + "shape": [ + 67, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9ab6333f9a69a4509ddf70293c5844628455709953a559343e2c3e9adbbad35f", + "mean": -0.005555108655244112, + "std": 8.232076644897461, + "rms": 8.232077598571777, + "max_abs": 1152.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a380686f83267df023070780f8426e453582752b4bcb2c98e25decc674936d27", + "mean": -0.00228241179138422, + "std": 0.196305513381958, + "rms": 0.19631877541542053, + "max_abs": 5.625 + }, + "full_input": { + "shape": [ + 83, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "01f2841038837addf8c16b37d843eb13b628b3beefc1210d82e310a430620225", + "mean": -0.005237972363829613, + "std": 7.388927936553955, + "rms": 7.38892936706543, + "max_abs": 1152.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "57d06661859427771e43237e9cdc6ba68a077be3e0d4ea5e4787666e940a1e6e", + "mean": -0.0021882709115743637, + "std": 0.1945321261882782, + "rms": 0.19454443454742432, + "max_abs": 5.5 + }, + "full_input": { + "shape": [ + 67, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0d1cb41efcbb09e2da2117a9b141c5e3e0a5ad67ffc5eb92746b37eafb3f27ea", + "mean": -0.005429103970527649, + "std": 8.232014656066895, + "rms": 8.232016563415527, + "max_abs": 1152.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6b13e2418cdb0d1df575f02210c913eb57c1b4e2ac81cd4b9ce61229b330d60c", + "mean": -0.0022048158571124077, + "std": 0.19365611672401428, + "rms": 0.1936686635017395, + "max_abs": 5.40625 + }, + "full_input": { + "shape": [ + 83, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "145dd609a1bd8582aea3ac9c696f1c1ae0ac2e1614c2960f0b027146ef2ac3d9", + "mean": -0.005175823345780373, + "std": 7.388864040374756, + "rms": 7.388865947723389, + "max_abs": 1152.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a6cc09b4039afec9f9ab5c9549c69bad1ef2a1b5671d7fac4f169ec6f8cbe9a1", + "mean": -0.0020412548910826445, + "std": 0.19408999383449554, + "rms": 0.1941007375717163, + "max_abs": 5.5 + }, + "full_input": { + "shape": [ + 67, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "93cec2281f1a46c54eccc9e88197f37b272481b4e6de0c164f80d4a01be27758", + "mean": -0.005345657002180815, + "std": 8.231996536254883, + "rms": 8.2319974899292, + "max_abs": 1152.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "30b31e2d7b1c1b3f088345f27f8844d4ee45f097b1e2d4056d8d5e7d3d2029ce", + "mean": -0.0020706376526504755, + "std": 0.19337765872478485, + "rms": 0.19338874518871307, + "max_abs": 5.40625 + }, + "full_input": { + "shape": [ + 83, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2832935d0fbc21d6fd44de87155d60aca165d0cad579eef479eb5e5c467a2730", + "mean": -0.005102572496980429, + "std": 7.388848781585693, + "rms": 7.388850212097168, + "max_abs": 1152.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9974343180656433, + "min_cosine_similarity": 0.9852777123451233, + "mean_relative_l2": 0.06593400239944458, + "max_abs_delta": 0.21875 + }, + "system_bos": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9946885704994202, + "min_cosine_similarity": 0.973673939704895, + "mean_relative_l2": 0.09617844223976135, + "max_abs_delta": 0.25 + }, + "system_x": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9927716851234436, + "min_cosine_similarity": 0.9686540365219116, + "mean_relative_l2": 0.1100262701511383, + "max_abs_delta": 0.34375 + }, + "system_period": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9925395250320435, + "min_cosine_similarity": 0.9641803503036499, + "mean_relative_l2": 0.11104380339384079, + "max_abs_delta": 0.375 + }, + "bos_at_s0": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9874406456947327, + "min_cosine_similarity": 0.8737596869468689, + "mean_relative_l2": 0.14063234627246857, + "max_abs_delta": 0.53125 + }, + "bos_at_s1": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9851797819137573, + "min_cosine_similarity": 0.8747653365135193, + "mean_relative_l2": 0.15546970069408417, + "max_abs_delta": 0.625 + }, + "x_at_s0": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9843449592590332, + "min_cosine_similarity": 0.8361883163452148, + "mean_relative_l2": 0.14910924434661865, + "max_abs_delta": 0.671875 + }, + "x_at_s1": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9800378084182739, + "min_cosine_similarity": 0.8225510120391846, + "mean_relative_l2": 0.17304091155529022, + "max_abs_delta": 0.6953125 + }, + "period_at_s0": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9842963218688965, + "min_cosine_similarity": 0.8279018998146057, + "mean_relative_l2": 0.14828146994113922, + "max_abs_delta": 0.67578125 + }, + "period_at_s1": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9793857336044312, + "min_cosine_similarity": 0.8094847202301025, + "mean_relative_l2": 0.17468911409378052, + "max_abs_delta": 0.74609375 + } + } + }, + "layer_05": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "db9c930aeb924b2c45024eaa7e94ef3c7db829914e6f95c7266eae9e1a46ab7c", + "mean": -0.002400043187662959, + "std": 0.22028343379497528, + "rms": 0.22029651701450348, + "max_abs": 5.40625 + }, + "full_input": { + "shape": [ + 67, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "390b53cbfc28b5e6e655b291a1ef0d17bad2ea254063c38c538dd8667f7a3dd5", + "mean": -0.022880688309669495, + "std": 9.463019371032715, + "rms": 9.463047981262207, + "max_abs": 1152.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "62e993be5a7f5dee467627a947cae326e99247f8f9dc6d405444789b306f51f7", + "mean": -0.002494582673534751, + "std": 0.2205296903848648, + "rms": 0.22054380178451538, + "max_abs": 5.40625 + }, + "full_input": { + "shape": [ + 83, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2652ffd24216ce97196e00e688147b55b303a557bdf1d886a4b8fed8ab20c25f", + "mean": -0.021299472078680992, + "std": 8.757814407348633, + "rms": 8.757840156555176, + "max_abs": 1152.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5298d7892d24d4c226a136cf7822b1b3562b1cb1b7e3dfefa63dddf639716fd9", + "mean": -0.0026111318729817867, + "std": 0.22256606817245483, + "rms": 0.2225813865661621, + "max_abs": 5.40625 + }, + "full_input": { + "shape": [ + 67, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cf9a5c018c980c7d67ed191f1b89b82c698f87a3ad1f8cfd30bb3802cf33432c", + "mean": -0.006334776524454355, + "std": 8.375744819641113, + "rms": 8.375748634338379, + "max_abs": 1152.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fc2515357038fdd31a3e38a2cf84aacb1c776636ccac40e111303def292fc7d2", + "mean": -0.0026704531628638506, + "std": 0.2218228280544281, + "rms": 0.22183890640735626, + "max_abs": 5.5 + }, + "full_input": { + "shape": [ + 83, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bd5f9211bedea66b7154b519284b63be89a70296ae7b062011269cebf6f5e848", + "mean": -0.005738525651395321, + "std": 7.517306327819824, + "rms": 7.517308712005615, + "max_abs": 1152.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "dea5b31acb68a1930f6dab3757e159b7b4b19fa521af95f2d38e29523879c2e4", + "mean": -0.002593160839751363, + "std": 0.2194596529006958, + "rms": 0.21947498619556427, + "max_abs": 5.4375 + }, + "full_input": { + "shape": [ + 67, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "57237a4701b69343c1db0dbefdc5cda043a45e45cc819b45c5172a2e1f738843", + "mean": -0.0062207067385315895, + "std": 8.375665664672852, + "rms": 8.3756685256958, + "max_abs": 1152.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fa4726b8272649dedde83eb3f831db57fbd5c1336ca9207369ae444a171a0c2d", + "mean": -0.0028643785044550896, + "std": 0.21829237043857574, + "rms": 0.2183111608028412, + "max_abs": 5.53125 + }, + "full_input": { + "shape": [ + 83, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5b1929e13936c21b043da1cd39c47fb370b32492eff3e9ca59decc0c3739eced", + "mean": -0.0057700201869010925, + "std": 7.51722526550293, + "rms": 7.5172271728515625, + "max_abs": 1152.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ccafe5cf5922cdb77263a430a133e58a879a6e3584a7724ffbd208f20532fecf", + "mean": -0.0024758335202932358, + "std": 0.2194136530160904, + "rms": 0.21942760050296783, + "max_abs": 5.4375 + }, + "full_input": { + "shape": [ + 67, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ff076b1e978c40d2b000463041d0b5f127fb7be05be0b2b7bba4675ef623990d", + "mean": -0.0061565060168504715, + "std": 8.37564468383789, + "rms": 8.375648498535156, + "max_abs": 1152.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fc8e245cc2bbe4aec099f3e21854498cba42bf7fcbe6eb34111cad9b6ded193a", + "mean": -0.0027358313091099262, + "std": 0.21836523711681366, + "rms": 0.21838237345218658, + "max_abs": 5.5625 + }, + "full_input": { + "shape": [ + 83, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e26d6449e14537f21bb01f8144e7368755ca5e7feb88cc5b0aba69ff8ac116bb", + "mean": -0.005738512147217989, + "std": 7.5172119140625, + "rms": 7.517214775085449, + "max_abs": 1152.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9964647889137268, + "min_cosine_similarity": 0.9750056266784668, + "mean_relative_l2": 0.07510824501514435, + "max_abs_delta": 0.1875 + }, + "system_bos": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9940463304519653, + "min_cosine_similarity": 0.9661486744880676, + "mean_relative_l2": 0.10031860321760178, + "max_abs_delta": 0.234375 + }, + "system_x": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9911255836486816, + "min_cosine_similarity": 0.9528708457946777, + "mean_relative_l2": 0.12092262506484985, + "max_abs_delta": 0.28125 + }, + "system_period": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9906331300735474, + "min_cosine_similarity": 0.9524122476577759, + "mean_relative_l2": 0.12382732331752777, + "max_abs_delta": 0.296875 + }, + "bos_at_s0": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.985457718372345, + "min_cosine_similarity": 0.8432843089103699, + "mean_relative_l2": 0.14863641560077667, + "max_abs_delta": 0.65625 + }, + "bos_at_s1": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9834421873092651, + "min_cosine_similarity": 0.8405458927154541, + "mean_relative_l2": 0.16199277341365814, + "max_abs_delta": 0.67529296875 + }, + "x_at_s0": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9818437695503235, + "min_cosine_similarity": 0.7904970645904541, + "mean_relative_l2": 0.15646256506443024, + "max_abs_delta": 0.80859375 + }, + "x_at_s1": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9772915840148926, + "min_cosine_similarity": 0.778777003288269, + "mean_relative_l2": 0.18224917352199554, + "max_abs_delta": 0.8583984375 + }, + "period_at_s0": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9817730784416199, + "min_cosine_similarity": 0.788562536239624, + "mean_relative_l2": 0.15629132091999054, + "max_abs_delta": 0.783203125 + }, + "period_at_s1": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.976362943649292, + "min_cosine_similarity": 0.7610455751419067, + "mean_relative_l2": 0.18437892198562622, + "max_abs_delta": 0.958984375 + } + } + }, + "layer_06": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "50e769ef3cd12b7af590bf74c69a305b9e76e3cbe69c60ae56fdd5d85b8a85bc", + "mean": -0.0041811661794781685, + "std": 0.2570309340953827, + "rms": 0.25706496834754944, + "max_abs": 7.0 + }, + "full_input": { + "shape": [ + 67, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "06b028ea9e572be9719eedfb8eb4de691ecaf6d995bafffff4e7dc30eff75496", + "mean": -0.025090165436267853, + "std": 9.635599136352539, + "rms": 9.635631561279297, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bd6eb3031776a516b366fcd8938cea72960168460c7b3d553a38722baedf841c", + "mean": -0.0043296851217746735, + "std": 0.25662922859191895, + "rms": 0.25666576623916626, + "max_abs": 7.0 + }, + "full_input": { + "shape": [ + 83, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "71080712ed79b4caf506c2b8291a7850760391e26d513364f04ce15eeecab273", + "mean": -0.023351870477199554, + "std": 8.917099952697754, + "rms": 8.917131423950195, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f19311eb3c832847ad8b84973ee86017a9f498605205264803f0ea0270998835", + "mean": -0.004012195859104395, + "std": 0.2588174641132355, + "rms": 0.2588485777378082, + "max_abs": 7.125 + }, + "full_input": { + "shape": [ + 67, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d26986cf8c49b71ca5466627a310d507f9611842151b2b1bc187e8a829710822", + "mean": -0.007863907143473625, + "std": 8.51043701171875, + "rms": 8.510440826416016, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cdcae8edc7844ec37d27825d20853f5d0d707cb634c5f9c57955df67d6bd793f", + "mean": -0.003907286562025547, + "std": 0.25760695338249207, + "rms": 0.25763657689094543, + "max_abs": 7.125 + }, + "full_input": { + "shape": [ + 83, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "758df99abd8accbe727351789d99abefa79b44f8a530f6fdd5c78cbcbb1fb286", + "mean": -0.007079374976456165, + "std": 7.638448715209961, + "rms": 7.638452053070068, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "88b6a98cf7e9a7a5b73ffa9aadfde88c000fafb2a81cf1cd3cfd6dfa54ba0b81", + "mean": -0.0039373659528791904, + "std": 0.25617119669914246, + "rms": 0.25620147585868835, + "max_abs": 7.03125 + }, + "full_input": { + "shape": [ + 67, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cae8799ef11d85317f8644c0053aca329ca96afe4fbc692c754a430c4218bc46", + "mean": -0.007623630575835705, + "std": 8.510353088378906, + "rms": 8.510356903076172, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8848e320ac325db24e656194033ce5a41315f8617cf56c67d63f7a03d203d37d", + "mean": -0.003941139206290245, + "std": 0.253142774105072, + "rms": 0.25317344069480896, + "max_abs": 6.9375 + }, + "full_input": { + "shape": [ + 83, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c92e0b069b58ce7757436cb8753db3da87cc885e1d619c0f63a7943906a25fca", + "mean": -0.006924377754330635, + "std": 7.638332843780518, + "rms": 7.638336181640625, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5122170a2dab726a1f605c2e4f1d9c6e641854c470aaee8ea7e4c9a4da80eca7", + "mean": -0.003873430658131838, + "std": 0.25586849451065063, + "rms": 0.25589779019355774, + "max_abs": 7.0 + }, + "full_input": { + "shape": [ + 67, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "78998ead5c9d49673c3cdb0f7386b779ff115496aa2b574cd7f517e3813d588d", + "mean": -0.007555284537374973, + "std": 8.510334968566895, + "rms": 8.510337829589844, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "dedcbaec3bf77e54b13bd9c8f57041528ffba039adc7c31b21aa92610fd3e65b", + "mean": -0.0038854863960295916, + "std": 0.2527329921722412, + "rms": 0.25276288390159607, + "max_abs": 6.9375 + }, + "full_input": { + "shape": [ + 83, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fb7c10e9256fd6a3bd5197db4da91083006a6f7e0d27acdc0ebe935a9391afec", + "mean": -0.006904676556587219, + "std": 7.638315200805664, + "rms": 7.6383185386657715, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9961363673210144, + "min_cosine_similarity": 0.9710476994514465, + "mean_relative_l2": 0.0780070498585701, + "max_abs_delta": 0.5 + }, + "system_bos": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9937911033630371, + "min_cosine_similarity": 0.9561710357666016, + "mean_relative_l2": 0.10042039304971695, + "max_abs_delta": 0.28515625 + }, + "system_x": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9898683428764343, + "min_cosine_similarity": 0.9412401914596558, + "mean_relative_l2": 0.12790673971176147, + "max_abs_delta": 0.59375 + }, + "system_period": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9887435436248779, + "min_cosine_similarity": 0.9311565160751343, + "mean_relative_l2": 0.13415123522281647, + "max_abs_delta": 0.53125 + }, + "bos_at_s0": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9862658381462097, + "min_cosine_similarity": 0.8481713533401489, + "mean_relative_l2": 0.14272630214691162, + "max_abs_delta": 0.671875 + }, + "bos_at_s1": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9843486547470093, + "min_cosine_similarity": 0.846204936504364, + "mean_relative_l2": 0.15401890873908997, + "max_abs_delta": 0.6005859375 + }, + "x_at_s0": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9821234345436096, + "min_cosine_similarity": 0.7880873084068298, + "mean_relative_l2": 0.1539374589920044, + "max_abs_delta": 1.0224609375 + }, + "x_at_s1": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.97669917345047, + "min_cosine_similarity": 0.7644981741905212, + "mean_relative_l2": 0.18061882257461548, + "max_abs_delta": 1.1923828125 + }, + "period_at_s0": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9818023443222046, + "min_cosine_similarity": 0.7828094959259033, + "mean_relative_l2": 0.154102623462677, + "max_abs_delta": 1.0625 + }, + "period_at_s1": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9750153422355652, + "min_cosine_similarity": 0.7447191476821899, + "mean_relative_l2": 0.1860135793685913, + "max_abs_delta": 1.2783203125 + } + } + }, + "layer_07": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "dd2c245c40969519b7ea3339b1e37a5be7d34c13e1e57a9e2840e67deaa5d420", + "mean": -0.006201295647770166, + "std": 0.2746683955192566, + "rms": 0.2747383713722229, + "max_abs": 7.40625 + }, + "full_input": { + "shape": [ + 67, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "27e1cc00e41208e1873bde6e86ca7b2dfee120b682fa42002685fca4d5f88856", + "mean": -0.026348767802119255, + "std": 9.663089752197266, + "rms": 9.663125991821289, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b2139b94e9c7c5da60363dfedbc334b613d65c694aaf18d5e09ee57ee951798f", + "mean": -0.006275990977883339, + "std": 0.27431410551071167, + "rms": 0.27438586950302124, + "max_abs": 7.53125 + }, + "full_input": { + "shape": [ + 83, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e89a974ab424ee10d88b6f1bf3640263c37a7721a6dbfb03bc09a693ba3eabec", + "mean": -0.024965308606624603, + "std": 8.943596839904785, + "rms": 8.943632125854492, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "605ea5554f84f2b9a220846f0f250f24f63c09e43076e1eec52e642cdde2178d", + "mean": -0.006165291648358107, + "std": 0.27503323554992676, + "rms": 0.27510231733322144, + "max_abs": 7.46875 + }, + "full_input": { + "shape": [ + 67, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b60d20de3be7a76f1e30245951ac87a6fdaff120d4da2c3252f3df32045d5695", + "mean": -0.009165842086076736, + "std": 8.526084899902344, + "rms": 8.526089668273926, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6db73d9f596c54eefe799f9b4ed64999bb3528207f71a6dd9803f22d006eeac0", + "mean": -0.006103827152401209, + "std": 0.27458593249320984, + "rms": 0.27465376257896423, + "max_abs": 7.46875 + }, + "full_input": { + "shape": [ + 83, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c449900c6555f8fd910c526f7452fdccfe2c99200a1a6c55d3b40baedaaedda4", + "mean": -0.00874348171055317, + "std": 7.652707099914551, + "rms": 7.652712345123291, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e7ce25ded9ff156165c94ca856a7067b99d5fa1b8250cf40373a398e02df896d", + "mean": -0.0061623696237802505, + "std": 0.2735911011695862, + "rms": 0.2736605107784271, + "max_abs": 7.46875 + }, + "full_input": { + "shape": [ + 67, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "98474d2d14232a1b10f7a1d260626f6227128490d60e0654475a910f5dab0903", + "mean": -0.009216105565428734, + "std": 8.526010513305664, + "rms": 8.526015281677246, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "39b1cff91d975c0975d542132812bfdbc8a44c8d57d624aca6595da4820b22ba", + "mean": -0.0062269652262330055, + "std": 0.271998792886734, + "rms": 0.272070050239563, + "max_abs": 7.5625 + }, + "full_input": { + "shape": [ + 83, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "24e22ecafa19e7cedcce6b8884daf865e067d10870f3f61d3b688f3ffd750be0", + "mean": -0.008811886422336102, + "std": 7.652613639831543, + "rms": 7.652618885040283, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1aff3b4bae7c627529cb0152884a2ee86b6d5f1e065e8893c8115f30a16b38fb", + "mean": -0.006092495750635862, + "std": 0.27300477027893066, + "rms": 0.273072749376297, + "max_abs": 7.4375 + }, + "full_input": { + "shape": [ + 67, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "28c1775315aa7ed79d82421365612dc3728b46daab9b4e8c121a4960c6cd8637", + "mean": -0.008977376855909824, + "std": 8.525999069213867, + "rms": 8.52600383758545, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "eeaeafab18c497b0089b1021e6b7dc73602d7d6537068cd048c97c9d61341a10", + "mean": -0.006131860427558422, + "std": 0.2716997563838959, + "rms": 0.2717689275741577, + "max_abs": 7.53125 + }, + "full_input": { + "shape": [ + 83, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "92e4aa82e063417c72b40711c720cb1b7539112e52f198e15fd8a3cf390bebe6", + "mean": -0.008641534484922886, + "std": 7.652608394622803, + "rms": 7.652613639831543, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9955302476882935, + "min_cosine_similarity": 0.9611303806304932, + "mean_relative_l2": 0.08300357311964035, + "max_abs_delta": 0.328125 + }, + "system_bos": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9925605058670044, + "min_cosine_similarity": 0.9437198042869568, + "mean_relative_l2": 0.1090892031788826, + "max_abs_delta": 0.375 + }, + "system_x": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9883226752281189, + "min_cosine_similarity": 0.9210727214813232, + "mean_relative_l2": 0.136186882853508, + "max_abs_delta": 0.515625 + }, + "system_period": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9873299598693848, + "min_cosine_similarity": 0.9150642156600952, + "mean_relative_l2": 0.1415596753358841, + "max_abs_delta": 0.5 + }, + "bos_at_s0": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9857333898544312, + "min_cosine_similarity": 0.8535674810409546, + "mean_relative_l2": 0.14578640460968018, + "max_abs_delta": 0.6875 + }, + "bos_at_s1": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9837294816970825, + "min_cosine_similarity": 0.8515564799308777, + "mean_relative_l2": 0.15683190524578094, + "max_abs_delta": 0.638671875 + }, + "x_at_s0": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9810014367103577, + "min_cosine_similarity": 0.796252965927124, + "mean_relative_l2": 0.15972015261650085, + "max_abs_delta": 1.15625 + }, + "x_at_s1": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9756646752357483, + "min_cosine_similarity": 0.7640258073806763, + "mean_relative_l2": 0.18725670874118805, + "max_abs_delta": 1.361328125 + }, + "period_at_s0": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9809443354606628, + "min_cosine_similarity": 0.7836290597915649, + "mean_relative_l2": 0.15782658755779266, + "max_abs_delta": 1.1875 + }, + "period_at_s1": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9737083911895752, + "min_cosine_similarity": 0.7438912391662598, + "mean_relative_l2": 0.19266553223133087, + "max_abs_delta": 1.37158203125 + } + } + }, + "layer_08": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2c71b281da77ece03630079df00f3dc8aabbc8c70d88b8b7f80fe32d07ad6714", + "mean": -0.008002953603863716, + "std": 0.30914512276649475, + "rms": 0.309248685836792, + "max_abs": 8.1875 + }, + "full_input": { + "shape": [ + 67, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "79ac66b3907ca83d01ba58c3b96796c25aeb86a63817a32af0867064b872fbc7", + "mean": -0.027677521109580994, + "std": 9.695799827575684, + "rms": 9.695839881896973, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "518a984f47c7436b04c5cb4af19a8e075b52a75044439cacff85ae093b327729", + "mean": -0.007991461083292961, + "std": 0.30875009298324585, + "rms": 0.30885347723960876, + "max_abs": 8.25 + }, + "full_input": { + "shape": [ + 83, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "656cfbd357f1c441589dea5b30086294156b1fc821911181c9d6a44c10957bbf", + "mean": -0.025695281103253365, + "std": 8.974465370178223, + "rms": 8.974501609802246, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "547e11e5d94f84fa4d3d2753dec2b694bada517415ac3c7ef688ebaa811ded28", + "mean": -0.008384572342038155, + "std": 0.3103334903717041, + "rms": 0.31044673919677734, + "max_abs": 8.25 + }, + "full_input": { + "shape": [ + 67, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "243fa7a840f9a0410004a55daf48a9e4cf9ae7181bf27aea560bc24aa6eda8b2", + "mean": -0.010813317261636257, + "std": 8.544415473937988, + "rms": 8.54442310333252, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "88430b2b3fb6bc2de23d4cb19d93e67518d9f651b62f8ed51dabefa3e8ff1b28", + "mean": -0.00838148407638073, + "std": 0.31129011511802673, + "rms": 0.31140294671058655, + "max_abs": 8.25 + }, + "full_input": { + "shape": [ + 83, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a197c5d8a5fb05de09eb7658930afb651233657b3e52dc24a930d48b2be1e695", + "mean": -0.009863537736237049, + "std": 7.669363021850586, + "rms": 7.669368743896484, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2f5057e21639982357b02e4ba644c5c66656554abcf0733fea3c69e821699916", + "mean": -0.008321323432028294, + "std": 0.3096288740634918, + "rms": 0.30974066257476807, + "max_abs": 8.1875 + }, + "full_input": { + "shape": [ + 67, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "365d581f5d6536d220bb504d1648cdfa96fc94f97ae8b69257844a8dcf3c5596", + "mean": -0.010839547961950302, + "std": 8.5443696975708, + "rms": 8.544376373291016, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "247049f4d56d85344cfc59bfd0d845bb62111c4e147feafe1d87fe7714cbbe31", + "mean": -0.007933058775961399, + "std": 0.30830666422843933, + "rms": 0.3084087073802948, + "max_abs": 8.25 + }, + "full_input": { + "shape": [ + 83, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "15a0b6f6829acaab82e308ea2e790abf43616f88a076b0c77208a0c3e456b2c2", + "mean": -0.00960230827331543, + "std": 7.669266223907471, + "rms": 7.669271469116211, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3c94ed444185fddcc841f3fabbb023669b2771ab16f9f14dc5b1a46c018a6350", + "mean": -0.008357360027730465, + "std": 0.3100680708885193, + "rms": 0.3101806640625, + "max_abs": 8.125 + }, + "full_input": { + "shape": [ + 67, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "202d4633f26aa8768dfef9e56fff6cd61687cb4cc9b477ac74d40a3b03734aac", + "mean": -0.010847766883671284, + "std": 8.544382095336914, + "rms": 8.544389724731445, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "19251d942c8225479b12360743db34e7a766b205cebf96e9ac80ee6ee7c5705a", + "mean": -0.007963255979120731, + "std": 0.3091816306114197, + "rms": 0.30928415060043335, + "max_abs": 8.1875 + }, + "full_input": { + "shape": [ + 83, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9d86cfb66220407859863633a49c82acee300999fe70690a027318b790ce4b72", + "mean": -0.00953497551381588, + "std": 7.669275760650635, + "rms": 7.669281482696533, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9945580363273621, + "min_cosine_similarity": 0.9574857354164124, + "mean_relative_l2": 0.0919247716665268, + "max_abs_delta": 0.671875 + }, + "system_bos": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9924248456954956, + "min_cosine_similarity": 0.945664644241333, + "mean_relative_l2": 0.11012152582406998, + "max_abs_delta": 0.4375 + }, + "system_x": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9858521223068237, + "min_cosine_similarity": 0.9082750678062439, + "mean_relative_l2": 0.1501879096031189, + "max_abs_delta": 0.578125 + }, + "system_period": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9854826927185059, + "min_cosine_similarity": 0.9141154885292053, + "mean_relative_l2": 0.15380986034870148, + "max_abs_delta": 0.53125 + }, + "bos_at_s0": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9843236804008484, + "min_cosine_similarity": 0.8212273120880127, + "mean_relative_l2": 0.15242642164230347, + "max_abs_delta": 0.8125 + }, + "bos_at_s1": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9825479388237, + "min_cosine_similarity": 0.8322674632072449, + "mean_relative_l2": 0.16149695217609406, + "max_abs_delta": 0.96875 + }, + "x_at_s0": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9798703193664551, + "min_cosine_similarity": 0.7678478360176086, + "mean_relative_l2": 0.1658967286348343, + "max_abs_delta": 1.28125 + }, + "x_at_s1": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9730515480041504, + "min_cosine_similarity": 0.7112964391708374, + "mean_relative_l2": 0.19578643143177032, + "max_abs_delta": 1.443359375 + }, + "period_at_s0": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9796991944313049, + "min_cosine_similarity": 0.7522099018096924, + "mean_relative_l2": 0.16512732207775116, + "max_abs_delta": 1.34375 + }, + "period_at_s1": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9723302125930786, + "min_cosine_similarity": 0.7159336805343628, + "mean_relative_l2": 0.19979289174079895, + "max_abs_delta": 1.234375 + } + } + }, + "layer_09": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6ba13fc6ffb2d493760ee2b9a8cea5c9a844e28e866e03284786ba24d325430c", + "mean": -0.010624662972986698, + "std": 0.3648277521133423, + "rms": 0.3649824261665344, + "max_abs": 12.375 + }, + "full_input": { + "shape": [ + 67, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f0f6ea30879cd333a3c68b9aa332ff1c782d592f9848083b5d7edc3d271e0734", + "mean": -0.028958488255739212, + "std": 9.698156356811523, + "rms": 9.698199272155762, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6d73cbe2f96368a64635a67ef8b7676547a20462328378cedf588f0d4446a724", + "mean": -0.010528038255870342, + "std": 0.3618205487728119, + "rms": 0.3619736433029175, + "max_abs": 12.5 + }, + "full_input": { + "shape": [ + 83, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bf38695aae4ab2f2f125e5fe8218bbd3e3ee83faf8099acd8ef68a8774837ab7", + "mean": -0.027466677129268646, + "std": 8.976725578308105, + "rms": 8.976767539978027, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f5aff9bb3b28d0bf3048f07e5a9190ba0cbab808d5ed3203e6df99eafa44b7ce", + "mean": -0.010861334390938282, + "std": 0.3641051650047302, + "rms": 0.36426714062690735, + "max_abs": 12.25 + }, + "full_input": { + "shape": [ + 67, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "dbdfa50a8e716d541f3b2dd3f02cfe4f86f065f6cf0b45616f349afadbb7a64e", + "mean": -0.0122380955144763, + "std": 8.546932220458984, + "rms": 8.546939849853516, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6c8232c2c85f7f8ff63b2cc3204980911148b0a026805df55cc5e8cddde8bde1", + "mean": -0.010848511941730976, + "std": 0.36513397097587585, + "rms": 0.3652951121330261, + "max_abs": 12.375 + }, + "full_input": { + "shape": [ + 83, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "39987a9fd6fcfafc0b184d2797bad556620dd3817225204ee81c002d519d8a76", + "mean": -0.011862707324326038, + "std": 7.6719770431518555, + "rms": 7.671986103057861, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "acea3d4a99d8e363915ef98f55150ea5ed713fccc155c250ae04cdcb20c52232", + "mean": -0.01080226618796587, + "std": 0.3622279763221741, + "rms": 0.3623889982700348, + "max_abs": 12.0 + }, + "full_input": { + "shape": [ + 67, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "daa1b45d77cbb74381cf962605e3372f29a5331326ec0635c2e0bad97075962e", + "mean": -0.012196332216262817, + "std": 8.54686164855957, + "rms": 8.546870231628418, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ef2e5a92923576923c59dacaec72afb57d52995c9fd449e6fad7c15529544e15", + "mean": -0.010030589997768402, + "std": 0.3560618758201599, + "rms": 0.3562031388282776, + "max_abs": 12.0 + }, + "full_input": { + "shape": [ + 83, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e44b5c48484ae67b26aaa9b08f4bbccac72035bdaf2762aed0eabb20b93dcee9", + "mean": -0.011371202766895294, + "std": 7.671701431274414, + "rms": 7.6717095375061035, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e2dc7d21aed35c91121b68f6a2803520d6b8708f7881606b89f6167d60472b4c", + "mean": -0.010980040766298771, + "std": 0.36222732067108154, + "rms": 0.36239367723464966, + "max_abs": 11.9375 + }, + "full_input": { + "shape": [ + 67, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "37a7a50e355c4fa716a17967f39e523ff42c25e468d4355d1e8f6bafeefdd348", + "mean": -0.012158222496509552, + "std": 8.546834945678711, + "rms": 8.546843528747559, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d8f3dbda31c698df4a998ada1e05573ec61d6f5a987f34401aff3c1a2a86348d", + "mean": -0.010294394567608833, + "std": 0.35744619369506836, + "rms": 0.35759440064430237, + "max_abs": 12.0 + }, + "full_input": { + "shape": [ + 83, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "004d22352d858646b700fd27c73f9509f8e12187f4389d36f29a6a006b9a7b2f", + "mean": -0.01131513062864542, + "std": 7.671706676483154, + "rms": 7.671714782714844, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9945048093795776, + "min_cosine_similarity": 0.9542389512062073, + "mean_relative_l2": 0.09048429876565933, + "max_abs_delta": 1.09375 + }, + "system_bos": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9931294322013855, + "min_cosine_similarity": 0.9486402273178101, + "mean_relative_l2": 0.10430904477834702, + "max_abs_delta": 0.65625 + }, + "system_x": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.984237015247345, + "min_cosine_similarity": 0.8849749565124512, + "mean_relative_l2": 0.15370194613933563, + "max_abs_delta": 1.75 + }, + "system_period": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9856881499290466, + "min_cosine_similarity": 0.9041355848312378, + "mean_relative_l2": 0.1501355767250061, + "max_abs_delta": 1.5625 + }, + "bos_at_s0": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9849912524223328, + "min_cosine_similarity": 0.8212094902992249, + "mean_relative_l2": 0.14833417534828186, + "max_abs_delta": 1.09375 + }, + "bos_at_s1": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9834946393966675, + "min_cosine_similarity": 0.8377758264541626, + "mean_relative_l2": 0.1553499400615692, + "max_abs_delta": 1.1875 + }, + "x_at_s0": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9815400242805481, + "min_cosine_similarity": 0.7773277163505554, + "mean_relative_l2": 0.15828999876976013, + "max_abs_delta": 1.609375 + }, + "x_at_s1": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9736865758895874, + "min_cosine_similarity": 0.7086448073387146, + "mean_relative_l2": 0.19001814723014832, + "max_abs_delta": 2.09375 + }, + "period_at_s0": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9816341400146484, + "min_cosine_similarity": 0.7657349705696106, + "mean_relative_l2": 0.1567610651254654, + "max_abs_delta": 1.53125 + }, + "period_at_s1": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9747295379638672, + "min_cosine_similarity": 0.7364720106124878, + "mean_relative_l2": 0.18858899176120758, + "max_abs_delta": 1.921875 + } + } + }, + "layer_10": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "09acdbd4daeb6aa854ec2b64167e4c14debe8664f16f66a0b1ba7653bc5c8f3e", + "mean": -0.010553264059126377, + "std": 0.40744075179100037, + "rms": 0.40757739543914795, + "max_abs": 12.75 + }, + "full_input": { + "shape": [ + 67, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "068bbe98773240b5c7d50604eb321fdf3d3b55a29f6b24c7c72ca31e7e8410c6", + "mean": -0.0296026598662138, + "std": 9.70764446258545, + "rms": 9.70768928527832, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b3b3eff7b472807a7ca5891806192d452db3a6c7c9a1e1150e3c9658b623b007", + "mean": -0.010314060375094414, + "std": 0.40489450097084045, + "rms": 0.405025839805603, + "max_abs": 12.8125 + }, + "full_input": { + "shape": [ + 83, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e9c624cf4ac5896965d5e760969645b4e6ca55b4e885320682cfd52cebb2125f", + "mean": -0.028161393478512764, + "std": 8.985583305358887, + "rms": 8.985627174377441, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6ede6e075a8ff2d57c692c831e6e3d915e2eac110ba76638fbfe7a18cf49bbe2", + "mean": -0.011027664877474308, + "std": 0.4059099853038788, + "rms": 0.40605977177619934, + "max_abs": 12.5625 + }, + "full_input": { + "shape": [ + 67, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8253903839405f49abeafedceb1fb06132dec3024124a50227717cfbc97d5ffb", + "mean": -0.013054324313998222, + "std": 8.557212829589844, + "rms": 8.557222366333008, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bde9667ed72b5051e789baafb94548ba210e7b994f2ffe5994dc5f4331ae2e1c", + "mean": -0.010916490107774734, + "std": 0.4066736102104187, + "rms": 0.4068200886249542, + "max_abs": 12.625 + }, + "full_input": { + "shape": [ + 83, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ae63adc3b709b301844e00be3c46e8e1e38eba766d120ec4a0ac932bbf8932e2", + "mean": -0.012639680877327919, + "std": 7.68167781829834, + "rms": 7.6816887855529785, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0bb7960414735c96fc077a25b40aabb44d79c932e06d72f7da20677f41415721", + "mean": -0.010483980178833008, + "std": 0.4058629870414734, + "rms": 0.4059983491897583, + "max_abs": 12.625 + }, + "full_input": { + "shape": [ + 67, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "49e44db9ed284d93a50a4395aeff653feea2c41cd8f88421eb1fbf766cd13378", + "mean": -0.012747062370181084, + "std": 8.557173728942871, + "rms": 8.557183265686035, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "495a8fa86800b390b49051b859e10d0b94139f64dbad98a2f18c0086b34f291e", + "mean": -0.009670295752584934, + "std": 0.4030921161174774, + "rms": 0.40320807695388794, + "max_abs": 12.625 + }, + "full_input": { + "shape": [ + 83, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6809e95315f13187578556f75d7cb87d3622bf7433853bd6311d721650edd19f", + "mean": -0.012030740268528461, + "std": 7.681502342224121, + "rms": 7.681511878967285, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2dc65d78639a928c31be4513cca5344d64c6322b0f7009740b440297d0b5df87", + "mean": -0.010788355953991413, + "std": 0.40616220235824585, + "rms": 0.4063054621219635, + "max_abs": 12.625 + }, + "full_input": { + "shape": [ + 67, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cab86ac918b573479b033a28812ff25ba4391211e81bdc04fd751c288b843503", + "mean": -0.012646079063415527, + "std": 8.557160377502441, + "rms": 8.557169914245605, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "36ec16df81720acf5ed2830acf523602c3367a58a62e3c608738812985e3ad0d", + "mean": -0.010050131008028984, + "std": 0.40352222323417664, + "rms": 0.4036473333835602, + "max_abs": 12.75 + }, + "full_input": { + "shape": [ + 83, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0dbb1cf32a2efc25b74b213fe5a06ab6b5a2ec3d750806c8a68bd6d0a7fc5fda", + "mean": -0.012081633321940899, + "std": 7.681478500366211, + "rms": 7.681488037109375, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9941362738609314, + "min_cosine_similarity": 0.9498586654663086, + "mean_relative_l2": 0.09382045269012451, + "max_abs_delta": 1.6875 + }, + "system_bos": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9924628138542175, + "min_cosine_similarity": 0.9451810121536255, + "mean_relative_l2": 0.1083802580833435, + "max_abs_delta": 1.0 + }, + "system_x": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9823687672615051, + "min_cosine_similarity": 0.8544855117797852, + "mean_relative_l2": 0.16111180186271667, + "max_abs_delta": 1.53125 + }, + "system_period": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9847086071968079, + "min_cosine_similarity": 0.8959162831306458, + "mean_relative_l2": 0.15467050671577454, + "max_abs_delta": 1.125 + }, + "bos_at_s0": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9839215874671936, + "min_cosine_similarity": 0.8185569643974304, + "mean_relative_l2": 0.15237382054328918, + "max_abs_delta": 1.34375 + }, + "bos_at_s1": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.982546329498291, + "min_cosine_similarity": 0.8257277607917786, + "mean_relative_l2": 0.15818718075752258, + "max_abs_delta": 1.09375 + }, + "x_at_s0": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9804394841194153, + "min_cosine_similarity": 0.7552008628845215, + "mean_relative_l2": 0.16195036470890045, + "max_abs_delta": 1.9375 + }, + "x_at_s1": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.972131609916687, + "min_cosine_similarity": 0.6672039031982422, + "mean_relative_l2": 0.19431182742118835, + "max_abs_delta": 3.15625 + }, + "period_at_s0": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9813477396965027, + "min_cosine_similarity": 0.7608396410942078, + "mean_relative_l2": 0.15801241993904114, + "max_abs_delta": 2.1875 + }, + "period_at_s1": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9743418097496033, + "min_cosine_similarity": 0.7152138352394104, + "mean_relative_l2": 0.18974153697490692, + "max_abs_delta": 3.0 + } + } + }, + "layer_11": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8e7a904eb5fb0d3b8b33d99deff1348ce59d1b1e94198fe23d47a1da153b2286", + "mean": -0.011420980095863342, + "std": 0.5107125043869019, + "rms": 0.5108402371406555, + "max_abs": 17.375 + }, + "full_input": { + "shape": [ + 67, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "37b9f5e7292ebc7fb123d760d47987d7649636cfa907348a98e1a41cb0e20cd7", + "mean": -0.029611194506287575, + "std": 9.761786460876465, + "rms": 9.761831283569336, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6506524784c611568c5e54461e832f55bb60094529bc72e1d65f2fae18aa1a93", + "mean": -0.010809235274791718, + "std": 0.5047041773796082, + "rms": 0.504819929599762, + "max_abs": 17.5 + }, + "full_input": { + "shape": [ + 83, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ccc047f25fe59a6f9a26f1ca841a9c9bcef38dbb6c07216639e40ecb37950913", + "mean": -0.028049271553754807, + "std": 9.034770965576172, + "rms": 9.034814834594727, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0fbc42763d2fdea9ed2240da478574e208fd615c776663d964acf2e4b3517bd7", + "mean": -0.012117401696741581, + "std": 0.5101843476295471, + "rms": 0.5103282332420349, + "max_abs": 17.75 + }, + "full_input": { + "shape": [ + 67, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4bff1d3cb61ff483df56e65ff717e27c9eae537b2c9738a27faa9e0f5b20050f", + "mean": -0.013135998509824276, + "std": 8.602005958557129, + "rms": 8.602015495300293, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6c21757016e448101df2147b0cf7a9820580a7c677e32fcf34b5e7e62da97bf0", + "mean": -0.011682282201945782, + "std": 0.5092288255691528, + "rms": 0.5093628168106079, + "max_abs": 17.75 + }, + "full_input": { + "shape": [ + 83, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8c5e92695704bc844eb90df5f9a1c4f8a64b3e2c94daf590248cb3ba2479d760", + "mean": -0.012633691541850567, + "std": 7.722542762756348, + "rms": 7.722553253173828, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e8da84b8fea34e8438d2cb72247fac796a6eda7b75a9fa42b9ec2670a9209f85", + "mean": -0.011117884889245033, + "std": 0.5086688995361328, + "rms": 0.5087903738021851, + "max_abs": 17.25 + }, + "full_input": { + "shape": [ + 67, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0cdd6a2d909d0cb72a07830578186ad98346f567984c53bbf7d8f5841948a946", + "mean": -0.012272289954125881, + "std": 8.601977348327637, + "rms": 8.601985931396484, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2d110ab75811968d95a0e2e163debe56f28391ff711a7ba2c18f46043ab22b87", + "mean": -0.009856658056378365, + "std": 0.4984641671180725, + "rms": 0.4985616207122803, + "max_abs": 16.875 + }, + "full_input": { + "shape": [ + 83, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "96da6cf074a51d2d5f26f88fbecb7d8cac6e33d11d984e60d47e93ec071ca486", + "mean": -0.01144255232065916, + "std": 7.72205114364624, + "rms": 7.72205924987793, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7c79651ae087efee9038df6e37b94484eb63888e6c93572319786e960ba9cd9d", + "mean": -0.01156329084187746, + "std": 0.5093680620193481, + "rms": 0.5094993114471436, + "max_abs": 17.25 + }, + "full_input": { + "shape": [ + 67, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fc27daa0fb83f1bb8741c4c55d4b9d926d025c7855b15d64f48de66945a87024", + "mean": -0.012315777130424976, + "std": 8.601946830749512, + "rms": 8.60195541381836, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "83dbd602d39893b39ff2ad82c0069bc2de0ff1c745f42ad36d649037d4b4b919", + "mean": -0.010432038456201553, + "std": 0.5013075470924377, + "rms": 0.501416027545929, + "max_abs": 17.125 + }, + "full_input": { + "shape": [ + 83, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "783c5c7e36f57c3ace6774948ae416a3f709c568418c66cf0635f88702fd8a70", + "mean": -0.011603902094066143, + "std": 7.722110271453857, + "rms": 7.722118854522705, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9943270683288574, + "min_cosine_similarity": 0.9583425521850586, + "mean_relative_l2": 0.09588199853897095, + "max_abs_delta": 1.875 + }, + "system_bos": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9934672117233276, + "min_cosine_similarity": 0.9528903961181641, + "mean_relative_l2": 0.10171742737293243, + "max_abs_delta": 1.0 + }, + "system_x": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9827755689620972, + "min_cosine_similarity": 0.8525744676589966, + "mean_relative_l2": 0.1583728790283203, + "max_abs_delta": 1.625 + }, + "system_period": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9850822687149048, + "min_cosine_similarity": 0.8807740211486816, + "mean_relative_l2": 0.15138384699821472, + "max_abs_delta": 2.96875 + }, + "bos_at_s0": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9859523773193359, + "min_cosine_similarity": 0.8408020734786987, + "mean_relative_l2": 0.14019431173801422, + "max_abs_delta": 1.9375 + }, + "bos_at_s1": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9840584993362427, + "min_cosine_similarity": 0.8333384394645691, + "mean_relative_l2": 0.14949733018875122, + "max_abs_delta": 1.75 + }, + "x_at_s0": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9839364290237427, + "min_cosine_similarity": 0.7999585866928101, + "mean_relative_l2": 0.1453845351934433, + "max_abs_delta": 2.40625 + }, + "x_at_s1": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9756163358688354, + "min_cosine_similarity": 0.7074262499809265, + "mean_relative_l2": 0.17932236194610596, + "max_abs_delta": 3.65625 + }, + "period_at_s0": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9841306805610657, + "min_cosine_similarity": 0.8012681007385254, + "mean_relative_l2": 0.1443966180086136, + "max_abs_delta": 2.53125 + }, + "period_at_s1": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9776725769042969, + "min_cosine_similarity": 0.7508957386016846, + "mean_relative_l2": 0.17429572343826294, + "max_abs_delta": 5.125 + } + } + }, + "layer_12": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "61904adb85116ab19d3b6424346d92df6fc212ca238c75f40d3ccb205b96ebab", + "mean": -0.009262530133128166, + "std": 0.5360366702079773, + "rms": 0.5361167192459106, + "max_abs": 16.375 + }, + "full_input": { + "shape": [ + 67, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7b96dad1d3415f04b73c287bfc6278137b29de91a1dbec5b73b8782afed5e777", + "mean": -0.028998754918575287, + "std": 9.82951545715332, + "rms": 9.829558372497559, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a9055ac55d3e0e1ea260642849488a911bb72447c266e83643725de732fae745", + "mean": -0.008815541863441467, + "std": 0.5323007702827454, + "rms": 0.5323737263679504, + "max_abs": 16.75 + }, + "full_input": { + "shape": [ + 83, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6a76c2fd2545e107ab260857e0efed523aee3434c034a1f672ed801b59ee6df0", + "mean": -0.02726217918097973, + "std": 9.100783348083496, + "rms": 9.100824356079102, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "80ebf5d74efea7daf5ca3102d60cf8b13862487486168d46fe70caf3f290c7ac", + "mean": -0.00998231116682291, + "std": 0.5376425385475159, + "rms": 0.5377352237701416, + "max_abs": 16.5 + }, + "full_input": { + "shape": [ + 67, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "479a55e84154a4a3c629df61df7ff2c0125cbb3e54e8c58a23e58b809b6f8a46", + "mean": -0.012208090163767338, + "std": 8.617195129394531, + "rms": 8.617204666137695, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8ff3d6ae11e9c3644fc78df201227006dc1676cbb9764dc0f5c59cb22c3775da", + "mean": -0.009451505728065968, + "std": 0.5374627709388733, + "rms": 0.5375458598136902, + "max_abs": 16.625 + }, + "full_input": { + "shape": [ + 83, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9b845778597750a0584ff99340782a63e5f1d6ef8afc3436d5e94206e41a1371", + "mean": -0.011638565920293331, + "std": 7.737151145935059, + "rms": 7.7371602058410645, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a54244f77db3f3c802dafc20506122562755ca25c39b1920005c67a9e3289224", + "mean": -0.008998094126582146, + "std": 0.5360236763954163, + "rms": 0.5360991358757019, + "max_abs": 16.125 + }, + "full_input": { + "shape": [ + 67, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "abfd13ff64aa79c36e0dd692d0d99d3696365dd8233a391d16a6ade579baaf35", + "mean": -0.01183365285396576, + "std": 8.617175102233887, + "rms": 8.617183685302734, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c879f0f28c21fd9a52bbcf37d7f98a60c0b089345a02e84a2b9a033c27b22971", + "mean": -0.007838904857635498, + "std": 0.5280401110649109, + "rms": 0.5280982851982117, + "max_abs": 15.75 + }, + "full_input": { + "shape": [ + 83, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "233fab262c0c9cb54fd768427e33d852e0189cec62cb09a7b8c93e8a2a2904af", + "mean": -0.01067433226853609, + "std": 7.7365641593933105, + "rms": 7.736571311950684, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a708ad5b4aee2b99533457c0e52217ab34ffdf652b73df3dfff08e16dadcaac4", + "mean": -0.009286717511713505, + "std": 0.5362332463264465, + "rms": 0.5363136529922485, + "max_abs": 16.25 + }, + "full_input": { + "shape": [ + 67, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e9e39129ebcdbbfbd1f6a180938c7651f5f1264bbafecaf4749b8e4232cc45eb", + "mean": -0.011532320640981197, + "std": 8.617119789123535, + "rms": 8.617127418518066, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5d6b2441ef7f966a6c7cc66d89615da15d6f6210b187a1c5300e9cc371f1bb3d", + "mean": -0.008392121642827988, + "std": 0.5304701924324036, + "rms": 0.5305365920066833, + "max_abs": 16.0 + }, + "full_input": { + "shape": [ + 83, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "da433b444bf6c2aae03b6e88890b6a04a529c834027e090de9bb11405c4d873f", + "mean": -0.01071311067789793, + "std": 7.736672878265381, + "rms": 7.736680030822754, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.993083119392395, + "min_cosine_similarity": 0.9443032145500183, + "mean_relative_l2": 0.10313213616609573, + "max_abs_delta": 0.9375 + }, + "system_bos": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.992723286151886, + "min_cosine_similarity": 0.9468465447425842, + "mean_relative_l2": 0.10736068338155746, + "max_abs_delta": 0.90625 + }, + "system_x": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9820290803909302, + "min_cosine_similarity": 0.8582633137702942, + "mean_relative_l2": 0.16380217671394348, + "max_abs_delta": 1.9375 + }, + "system_period": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9839860796928406, + "min_cosine_similarity": 0.874829888343811, + "mean_relative_l2": 0.15798452496528625, + "max_abs_delta": 1.375 + }, + "bos_at_s0": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9844200611114502, + "min_cosine_similarity": 0.8284934759140015, + "mean_relative_l2": 0.14871950447559357, + "max_abs_delta": 2.9375 + }, + "bos_at_s1": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9821293950080872, + "min_cosine_similarity": 0.8138963580131531, + "mean_relative_l2": 0.15909384191036224, + "max_abs_delta": 2.75 + }, + "x_at_s0": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.982663631439209, + "min_cosine_similarity": 0.8019424080848694, + "mean_relative_l2": 0.15383511781692505, + "max_abs_delta": 3.40625 + }, + "x_at_s1": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9743692278862, + "min_cosine_similarity": 0.7266112565994263, + "mean_relative_l2": 0.18905417621135712, + "max_abs_delta": 2.671875 + }, + "period_at_s0": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.982438325881958, + "min_cosine_similarity": 0.8002038598060608, + "mean_relative_l2": 0.15496063232421875, + "max_abs_delta": 4.0 + }, + "period_at_s1": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9765867590904236, + "min_cosine_similarity": 0.7608875036239624, + "mean_relative_l2": 0.18331430852413177, + "max_abs_delta": 5.125 + } + } + }, + "layer_13": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "997a40049f5c0fda43e0aa3247495ed0dc82d41ff6bf5c3cd539a7652ab65606", + "mean": -0.008885197341442108, + "std": 0.5565477013587952, + "rms": 0.5566186904907227, + "max_abs": 16.625 + }, + "full_input": { + "shape": [ + 67, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fddc87dccd03c8cbcb21275151b2a2a59723e434927d1a9b0da283a7b40dbdd3", + "mean": -0.028638280928134918, + "std": 9.837273597717285, + "rms": 9.837316513061523, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "64788d9f6823d7e9b5db42056b312a4a235a72751dd0d9ce309dadf98cc4ca72", + "mean": -0.008353515528142452, + "std": 0.5528618693351746, + "rms": 0.5529249310493469, + "max_abs": 17.0 + }, + "full_input": { + "shape": [ + 83, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1f4878e56e4e872a5c2e1c445ba84733a8dcb5c8c664283632875adf410a5218", + "mean": -0.027765285223722458, + "std": 9.108634948730469, + "rms": 9.108677864074707, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "dd9611bd98a50fa41b1a9ae9f647651db54356684c109fa03219a2aab9416130", + "mean": -0.009815470315515995, + "std": 0.5573328137397766, + "rms": 0.5574192404747009, + "max_abs": 16.75 + }, + "full_input": { + "shape": [ + 67, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "211ab48b1575d4e2181c0e5557bdb2233717a8dd3905f980741171dacca7ca7e", + "mean": -0.011968542821705341, + "std": 8.623987197875977, + "rms": 8.623994827270508, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fb78f030552531b90036b57463aacd2fd8a9a45e0483a26e030c376c909ffe99", + "mean": -0.009339140728116035, + "std": 0.5588629245758057, + "rms": 0.5589409470558167, + "max_abs": 17.0 + }, + "full_input": { + "shape": [ + 83, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8eee7bbf04de6d9d8ae5d4d6954dd721932b344c235c7328892816c2c49165ea", + "mean": -0.012211862951517105, + "std": 7.744274616241455, + "rms": 7.744284152984619, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b02f33b6c3c44a0930634de086dcedbdec083cf956f154f55fd26244e12ff404", + "mean": -0.008638488128781319, + "std": 0.5566264390945435, + "rms": 0.556693434715271, + "max_abs": 16.5 + }, + "full_input": { + "shape": [ + 67, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "161527f21eb39f0a50610c3c000ecb040cc3622898620cee268cc958101805dd", + "mean": -0.01157240942120552, + "std": 8.624096870422363, + "rms": 8.624104499816895, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ad3312c8851ab6cff3a21678f9e032b982d88e77f9a24c93b87e1f85218d7733", + "mean": -0.007284762803465128, + "std": 0.5492676496505737, + "rms": 0.5493159294128418, + "max_abs": 16.125 + }, + "full_input": { + "shape": [ + 83, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6921ee9c688cb627f1ff4ad0ec227d6d0b468bfdd2b00acd772341fa9f4aee69", + "mean": -0.01109760720282793, + "std": 7.743764877319336, + "rms": 7.743772983551025, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fde209e4a734838e92a3214a71c68d60babd7ffb755bae85d173db236d2d1c0b", + "mean": -0.008798663504421711, + "std": 0.5560029149055481, + "rms": 0.5560725331306458, + "max_abs": 16.5 + }, + "full_input": { + "shape": [ + 67, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0bcff8c95d9202a8b35b5f009347b9dccc4c6f606afed1c18b6e53b2136dbcd2", + "mean": -0.011096734553575516, + "std": 8.623970985412598, + "rms": 8.623977661132812, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1c6f1248ab98941b7d32ac183de384aefa0b4c3e7c2f48cdb00b55475e27e5e7", + "mean": -0.007659392897039652, + "std": 0.5508531928062439, + "rms": 0.5509064793586731, + "max_abs": 16.25 + }, + "full_input": { + "shape": [ + 83, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7022e3af78b4636dc4080d15ae82de99038a4cec4b743084631e7fe5a930b304", + "mean": -0.011035819537937641, + "std": 7.743832111358643, + "rms": 7.743840217590332, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9928228259086609, + "min_cosine_similarity": 0.9442976713180542, + "mean_relative_l2": 0.10599790513515472, + "max_abs_delta": 1.53125 + }, + "system_bos": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9923644065856934, + "min_cosine_similarity": 0.9451791048049927, + "mean_relative_l2": 0.11060496419668198, + "max_abs_delta": 0.9921875 + }, + "system_x": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9823079705238342, + "min_cosine_similarity": 0.857378363609314, + "mean_relative_l2": 0.1629323810338974, + "max_abs_delta": 1.796875 + }, + "system_period": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9839743375778198, + "min_cosine_similarity": 0.8690647482872009, + "mean_relative_l2": 0.15800565481185913, + "max_abs_delta": 1.375 + }, + "bos_at_s0": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9840518236160278, + "min_cosine_similarity": 0.8291254043579102, + "mean_relative_l2": 0.15023505687713623, + "max_abs_delta": 3.0 + }, + "bos_at_s1": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9814893007278442, + "min_cosine_similarity": 0.7973086833953857, + "mean_relative_l2": 0.16184008121490479, + "max_abs_delta": 4.21875 + }, + "x_at_s0": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9822774529457092, + "min_cosine_similarity": 0.8004978895187378, + "mean_relative_l2": 0.15651282668113708, + "max_abs_delta": 4.1875 + }, + "x_at_s1": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9742584228515625, + "min_cosine_similarity": 0.736463189125061, + "mean_relative_l2": 0.19034971296787262, + "max_abs_delta": 3.71875 + }, + "period_at_s0": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9820383787155151, + "min_cosine_similarity": 0.8001548051834106, + "mean_relative_l2": 0.1570541262626648, + "max_abs_delta": 5.0 + }, + "period_at_s1": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9764705896377563, + "min_cosine_similarity": 0.7653515934944153, + "mean_relative_l2": 0.18425637483596802, + "max_abs_delta": 5.75 + } + } + }, + "layer_14": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "86927e6bfedb79aa4e5786c383ab8d4bca98862991f99adc86e152d96d4748d6", + "mean": -0.006453670095652342, + "std": 0.619339108467102, + "rms": 0.6193727254867554, + "max_abs": 19.0 + }, + "full_input": { + "shape": [ + 67, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1cff1134f70586f6318413a48e5220f06a29ac2abbcec24b2b3afff0e71b4d7d", + "mean": -0.026242395862936974, + "std": 9.857525825500488, + "rms": 9.857560157775879, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cbf6215cb527bbc1aaeb7a19b8d0bda9787e5af47d6caafe9224e97e7c6559a7", + "mean": -0.006312839221209288, + "std": 0.6158528327941895, + "rms": 0.6158851385116577, + "max_abs": 19.5 + }, + "full_input": { + "shape": [ + 83, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "75fc5c6ff3432a2003187f75ec549aec85cb47da8c3e5dd761e0a534bf6ec330", + "mean": -0.026259183883666992, + "std": 9.126720428466797, + "rms": 9.126758575439453, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7cdf4ca03eaa40f96be18fc32465ef28ab7825467a6e41ad76f2863c395979d8", + "mean": -0.007397122215479612, + "std": 0.6212918758392334, + "rms": 0.6213359236717224, + "max_abs": 19.25 + }, + "full_input": { + "shape": [ + 67, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "67d7672da7587e151e0bf8b2e6f66d9275b650b73ffa4e86fa1f396e9f98547c", + "mean": -0.009567284025251865, + "std": 8.645951271057129, + "rms": 8.645956993103027, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ef9486d922eebc77a3672ef6ca8a61c32400a355e4f2af2989ef7709b15841fa", + "mean": -0.007554003037512302, + "std": 0.6215600967407227, + "rms": 0.6216060519218445, + "max_abs": 19.625 + }, + "full_input": { + "shape": [ + 83, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6f34dc9f3de0c6909cb101602ca28475de9979a580897b4d3d5f0057992c59b3", + "mean": -0.010745642706751823, + "std": 7.76445198059082, + "rms": 7.764459133148193, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d93cb80232d0b657e4368a26f9275db955545490ee7bcec5dbe8dfe929385771", + "mean": -0.006372630596160889, + "std": 0.6201823353767395, + "rms": 0.6202150583267212, + "max_abs": 19.0 + }, + "full_input": { + "shape": [ + 67, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5e347e43234fb8dc34d897359b511c5933dfcb227046b069a17eefd397173c34", + "mean": -0.009244963526725769, + "std": 8.646099090576172, + "rms": 8.646103858947754, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f067a91bae86ed2d40d68276af91077692bc20f02a59343938bf50a25a884da9", + "mean": -0.0055551487021148205, + "std": 0.6104978919029236, + "rms": 0.6105231642723083, + "max_abs": 18.5 + }, + "full_input": { + "shape": [ + 83, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ca2e25de9b6ca16f07ca2c2e0d7d636006fa6bf38579b676930fcc84c73b05a5", + "mean": -0.0096912095323205, + "std": 7.763899326324463, + "rms": 7.7639055252075195, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5bd9bcd82b79c668b2674d3791024eecf6fcf86d634ffea9778865634389e567", + "mean": -0.006475025787949562, + "std": 0.6196234226226807, + "rms": 0.6196572184562683, + "max_abs": 19.0 + }, + "full_input": { + "shape": [ + 67, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c0811ffea2969e5debcd29ce5205c67bc384c91e30b727730747c8c90864b378", + "mean": -0.00877319648861885, + "std": 8.645946502685547, + "rms": 8.645950317382812, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0be63295d398aa7e3fd9534fd10f6e1b100dbcbd38db441fe5a230f5da2397c2", + "mean": -0.005841194186359644, + "std": 0.611981213092804, + "rms": 0.6120090484619141, + "max_abs": 18.625 + }, + "full_input": { + "shape": [ + 83, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5f2d6e17e7e908e25f145e546990d926a0edf2bcd0f3d2a7a552efdeffbce5cc", + "mean": -0.009718029759824276, + "std": 7.763914585113525, + "rms": 7.763919830322266, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9922139048576355, + "min_cosine_similarity": 0.938539981842041, + "mean_relative_l2": 0.11050816625356674, + "max_abs_delta": 1.625 + }, + "system_bos": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9922763109207153, + "min_cosine_similarity": 0.9441514611244202, + "mean_relative_l2": 0.11105000227689743, + "max_abs_delta": 1.177734375 + }, + "system_x": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9816259741783142, + "min_cosine_similarity": 0.8503692150115967, + "mean_relative_l2": 0.1671314686536789, + "max_abs_delta": 1.796875 + }, + "system_period": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9825200438499451, + "min_cosine_similarity": 0.848717212677002, + "mean_relative_l2": 0.16466066241264343, + "max_abs_delta": 1.4375 + }, + "bos_at_s0": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9838284254074097, + "min_cosine_similarity": 0.8216952681541443, + "mean_relative_l2": 0.15163491666316986, + "max_abs_delta": 2.875 + }, + "bos_at_s1": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.981041669845581, + "min_cosine_similarity": 0.7944605350494385, + "mean_relative_l2": 0.16340310871601105, + "max_abs_delta": 3.255859375 + }, + "x_at_s0": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9824265837669373, + "min_cosine_similarity": 0.7980183362960815, + "mean_relative_l2": 0.1564447581768036, + "max_abs_delta": 3.875 + }, + "x_at_s1": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9747756123542786, + "min_cosine_similarity": 0.7405639290809631, + "mean_relative_l2": 0.19037096202373505, + "max_abs_delta": 3.0625 + }, + "period_at_s0": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9820091724395752, + "min_cosine_similarity": 0.7912050485610962, + "mean_relative_l2": 0.1573036015033722, + "max_abs_delta": 4.875 + }, + "period_at_s1": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9762073755264282, + "min_cosine_similarity": 0.7577117681503296, + "mean_relative_l2": 0.18591128289699554, + "max_abs_delta": 5.75 + } + } + }, + "layer_15": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "89b543df89fbe11b5543f23c18292ecde3b00c71a6446960d60b5e4ae1719b21", + "mean": -0.008975657634437084, + "std": 0.7060873508453369, + "rms": 0.706144392490387, + "max_abs": 22.5 + }, + "full_input": { + "shape": [ + 67, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bba9b9ad57b48a0334de14962c391ca0137e5903037125da546eb2141fdaab52", + "mean": -0.027145562693476677, + "std": 9.866901397705078, + "rms": 9.866938591003418, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "815659dc0c6731b2fd7e189cd62eb0d3ef500098553d7103e598d65b1f94ec10", + "mean": -0.008729057386517525, + "std": 0.7018215656280518, + "rms": 0.7018758654594421, + "max_abs": 22.875 + }, + "full_input": { + "shape": [ + 83, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "936c206e9704f924e717e4c85c04af0389e554571b18518998952b8a4349010e", + "mean": -0.027395788580179214, + "std": 9.136523246765137, + "rms": 9.136564254760742, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6093cab8356b9fd657d46cfeffcdd06564833e2cf33dc0ea8d4e0165e354793a", + "mean": -0.009919421747326851, + "std": 0.710823655128479, + "rms": 0.7108928561210632, + "max_abs": 23.0 + }, + "full_input": { + "shape": [ + 67, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e4ea5959434104dcff11c5031d3d90d5d8d592fefdc50c6a78e1c50ce8d16d2c", + "mean": -0.010540474206209183, + "std": 8.655966758728027, + "rms": 8.655973434448242, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "70b4acb61ea17b308b0ca755ece7a4358e8bc67ec73fbac0496a29e95e830377", + "mean": -0.010212878696620464, + "std": 0.7077668309211731, + "rms": 0.7078405618667603, + "max_abs": 23.125 + }, + "full_input": { + "shape": [ + 83, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cb9c5a2fb4f7382c9a09c1aed6652c9f871985c1f32d88face7a09ac4aacbf76", + "mean": -0.012082292698323727, + "std": 7.775015830993652, + "rms": 7.775025367736816, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d36345534e18665a401f2fc02744365cdd8b22174ee5a621420c0b51d118b6ae", + "mean": -0.009162701666355133, + "std": 0.7106101512908936, + "rms": 0.710669219493866, + "max_abs": 22.75 + }, + "full_input": { + "shape": [ + 67, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e68b1956db819b502168e9833edd97543fbfb51d70b95eca8223db584055dc44", + "mean": -0.01034716609865427, + "std": 8.65617561340332, + "rms": 8.656182289123535, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "08394b3fdf02f20866e3351b4d7a49523db967ede34e53afb0633d71a0991b5c", + "mean": -0.008660671301186085, + "std": 0.6982102990150452, + "rms": 0.6982640027999878, + "max_abs": 22.25 + }, + "full_input": { + "shape": [ + 83, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "10146fad0eed213fb6ba4311ada2da559908e1804c7518037e4967e62b0f7ef1", + "mean": -0.011288872919976711, + "std": 7.774478435516357, + "rms": 7.774486541748047, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9096c309f790d2b8d296ab5275e89b49bf25a2fcaff96a3db50d946502fbefaf", + "mean": -0.009437596425414085, + "std": 0.7109349370002747, + "rms": 0.7109975814819336, + "max_abs": 22.625 + }, + "full_input": { + "shape": [ + 67, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "802a3dadb1efdf13b97a84df1d3c92470446a6e1d384afc532f2e63e61359350", + "mean": -0.009990275837481022, + "std": 8.656075477600098, + "rms": 8.656081199645996, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "130b8daf55cb0e63c37a107da21e523f948ea01129165aa8ff3b680861bcdc51", + "mean": -0.008397390134632587, + "std": 0.7000877857208252, + "rms": 0.7001381516456604, + "max_abs": 22.25 + }, + "full_input": { + "shape": [ + 83, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c527001c3baca3df82d040bd0f8a559d29d24b468c3ea935f7251ed5c74e13cf", + "mean": -0.010894939303398132, + "std": 7.7745561599731445, + "rms": 7.774563312530518, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9920487999916077, + "min_cosine_similarity": 0.9381920695304871, + "mean_relative_l2": 0.11263938248157501, + "max_abs_delta": 1.4375 + }, + "system_bos": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.992342472076416, + "min_cosine_similarity": 0.9460717439651489, + "mean_relative_l2": 0.11097683012485504, + "max_abs_delta": 1.3515625 + }, + "system_x": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9807961583137512, + "min_cosine_similarity": 0.8304890990257263, + "mean_relative_l2": 0.17187893390655518, + "max_abs_delta": 2.125 + }, + "system_period": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9817145466804504, + "min_cosine_similarity": 0.8359034657478333, + "mean_relative_l2": 0.16904716193675995, + "max_abs_delta": 2.375 + }, + "bos_at_s0": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9837202429771423, + "min_cosine_similarity": 0.8103927373886108, + "mean_relative_l2": 0.15155728161334991, + "max_abs_delta": 3.0 + }, + "bos_at_s1": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9808474779129028, + "min_cosine_similarity": 0.7933228015899658, + "mean_relative_l2": 0.1636064350605011, + "max_abs_delta": 3.9375 + }, + "x_at_s0": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9828782677650452, + "min_cosine_similarity": 0.7992184162139893, + "mean_relative_l2": 0.1551131010055542, + "max_abs_delta": 4.0 + }, + "x_at_s1": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9750454425811768, + "min_cosine_similarity": 0.7368645668029785, + "mean_relative_l2": 0.19027483463287354, + "max_abs_delta": 3.75 + }, + "period_at_s0": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9820277094841003, + "min_cosine_similarity": 0.7896270155906677, + "mean_relative_l2": 0.15794417262077332, + "max_abs_delta": 4.3125 + }, + "period_at_s1": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.975856602191925, + "min_cosine_similarity": 0.7450097799301147, + "mean_relative_l2": 0.1870131641626358, + "max_abs_delta": 6.4375 + } + } + }, + "layer_16": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "54b010e9fac4a98f4c481e49bc1e74a77da55f3c3e37a74cf2cb5542813862aa", + "mean": -0.010445061139762402, + "std": 0.7916135787963867, + "rms": 0.7916824817657471, + "max_abs": 25.375 + }, + "full_input": { + "shape": [ + 67, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6891cd522a90d2069cd349258e213d5a76d819824cabf1e7a8139f8fb9a74ef7", + "mean": -0.027862822636961937, + "std": 9.877218246459961, + "rms": 9.877257347106934, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d237e0e8f6187e20fa3ec03ab44cbf9e3412374648e02b404d357f009eff4008", + "mean": -0.010273126885294914, + "std": 0.7861292958259583, + "rms": 0.7861964106559753, + "max_abs": 25.75 + }, + "full_input": { + "shape": [ + 83, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4ff17d1d0deeb337c64a3f99d33b6e2fbb244b7258ca049b9682c80342c57068", + "mean": -0.027661338448524475, + "std": 9.146854400634766, + "rms": 9.146896362304688, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ffdd884a465ed780ad5299d055339e0b23a1bcecd2658b5de4371921d8375dfb", + "mean": -0.011134854517877102, + "std": 0.7931286096572876, + "rms": 0.7932067513465881, + "max_abs": 25.875 + }, + "full_input": { + "shape": [ + 67, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4f1f719d1cc06df18201b64e3a9ffc3a69a5b486fe668516e49496c01f17340c", + "mean": -0.011026011779904366, + "std": 8.666302680969238, + "rms": 8.666309356689453, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9f4a7d6ed16fdce34798e36c25c909d2f5f47a8034820a515c0deaf9c074df6d", + "mean": -0.011294243857264519, + "std": 0.7904824018478394, + "rms": 0.7905631065368652, + "max_abs": 26.125 + }, + "full_input": { + "shape": [ + 83, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "27095337384d6b544b57629d0c27f785d8a45bab09f9585bf8a5103f5347d6f4", + "mean": -0.011870818212628365, + "std": 7.786052227020264, + "rms": 7.786061763763428, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d97ca34d12b5db8d7d11fd1aca9e0dd99d20570823fef8e95a55ade1fc260f5f", + "mean": -0.010173955000936985, + "std": 0.7936609983444214, + "rms": 0.7937262058258057, + "max_abs": 25.5 + }, + "full_input": { + "shape": [ + 67, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2b61421e538eacd01f182fa357348c38a75d880bae40316cb5dd4d0e8fd8970b", + "mean": -0.010826706886291504, + "std": 8.666791915893555, + "rms": 8.66679859161377, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "531a7e8489ea24a3e51820305c4f1077670d53964848a615de1be0c086d3c473", + "mean": -0.009745803661644459, + "std": 0.7816015481948853, + "rms": 0.7816622853279114, + "max_abs": 25.375 + }, + "full_input": { + "shape": [ + 83, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4217d56c2b075bd81eec7f86086240740bc628d4de284b05a2c7ed943e6cb5e7", + "mean": -0.01127457432448864, + "std": 7.785742282867432, + "rms": 7.785750865936279, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fd5d57e1277098a2748e0e37b9875f0b4d2de2a69bb14d5bbf9e13a2c6ad2a58", + "mean": -0.010493110865354538, + "std": 0.7939843535423279, + "rms": 0.7940536737442017, + "max_abs": 25.5 + }, + "full_input": { + "shape": [ + 67, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "45e95d41124c43a32acfe6c01f9751c8ea1458ee7b31fadeb2b7e08d2161b71a", + "mean": -0.010408791713416576, + "std": 8.666508674621582, + "rms": 8.66651439666748, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ddbf33b519f1a590f9fd9969cafa246f171b2e13214987eb13f93b9328fee9a5", + "mean": -0.009435255080461502, + "std": 0.783431887626648, + "rms": 0.7834886908531189, + "max_abs": 25.375 + }, + "full_input": { + "shape": [ + 83, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cd4babdd3d60a75b7bf98284ed094344bcd556dfbc0805f1d305ed6f9c095e94", + "mean": -0.010745576582849026, + "std": 7.785680770874023, + "rms": 7.785688400268555, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9918793439865112, + "min_cosine_similarity": 0.9350894689559937, + "mean_relative_l2": 0.11338089406490326, + "max_abs_delta": 1.4375 + }, + "system_bos": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9920862317085266, + "min_cosine_similarity": 0.9452080726623535, + "mean_relative_l2": 0.11208880692720413, + "max_abs_delta": 1.44921875 + }, + "system_x": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9803457856178284, + "min_cosine_similarity": 0.8207720518112183, + "mean_relative_l2": 0.17295238375663757, + "max_abs_delta": 2.0 + }, + "system_period": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9812095165252686, + "min_cosine_similarity": 0.8315762877464294, + "mean_relative_l2": 0.1705397665500641, + "max_abs_delta": 1.9375 + }, + "bos_at_s0": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.983676552772522, + "min_cosine_similarity": 0.8084120154380798, + "mean_relative_l2": 0.15023015439510345, + "max_abs_delta": 3.015625 + }, + "bos_at_s1": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9806508421897888, + "min_cosine_similarity": 0.789963960647583, + "mean_relative_l2": 0.163136288523674, + "max_abs_delta": 4.4296875 + }, + "x_at_s0": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9826549291610718, + "min_cosine_similarity": 0.7982826828956604, + "mean_relative_l2": 0.15487398207187653, + "max_abs_delta": 3.6875 + }, + "x_at_s1": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9748536944389343, + "min_cosine_similarity": 0.7346954345703125, + "mean_relative_l2": 0.1905176341533661, + "max_abs_delta": 5.0 + }, + "period_at_s0": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9818673133850098, + "min_cosine_similarity": 0.7857001423835754, + "mean_relative_l2": 0.1571750044822693, + "max_abs_delta": 3.875 + }, + "period_at_s1": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9756743311882019, + "min_cosine_similarity": 0.7460721731185913, + "mean_relative_l2": 0.18674513697624207, + "max_abs_delta": 6.4375 + } + } + }, + "layer_17": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "adc5f552e9116f959b13d97022462b9e46f2b065630139240d81c698d1c96783", + "mean": -0.012168269604444504, + "std": 0.8788921236991882, + "rms": 0.8789763450622559, + "max_abs": 31.0 + }, + "full_input": { + "shape": [ + 67, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "07dfdf3e3b2eb174a71a418a2f1dc76565e3057673e32440529a36ddc425fb6d", + "mean": -0.029633579775691032, + "std": 9.888752937316895, + "rms": 9.888797760009766, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c07899d73c106c18fc537676831e1e058f908e97eafe7e2d5a11bea80d771283", + "mean": -0.011786211282014847, + "std": 0.8732135891914368, + "rms": 0.8732931017875671, + "max_abs": 31.0 + }, + "full_input": { + "shape": [ + 83, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0bc03906d3c6a4707cf76bcd1c60b4bb08111ec9f8dbfe32df39a5262981ea17", + "mean": -0.02986949123442173, + "std": 9.15938663482666, + "rms": 9.159435272216797, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f8ad232febfbbd43526856c6e095263f51a96a741a23bf5637b9d5f91125aed9", + "mean": -0.012684340588748455, + "std": 0.8801701664924622, + "rms": 0.8802615404129028, + "max_abs": 30.75 + }, + "full_input": { + "shape": [ + 67, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bed0257e1d70e074b307ee043b2ba49e736b39904c7b70657fe0d474397679ce", + "mean": -0.012539125978946686, + "std": 8.678648948669434, + "rms": 8.678657531738281, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e1fa6544dbd769b78dbbc0fc5be69c6fc5cfa51d64251f7662a3cb8c11633885", + "mean": -0.012863771058619022, + "std": 0.8783579468727112, + "rms": 0.8784521222114563, + "max_abs": 31.0 + }, + "full_input": { + "shape": [ + 83, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7bf7a5d35917cd06b181571c4f54a140e8167e09a8041b24d0149e3981248596", + "mean": -0.014149930328130722, + "std": 7.8001627922058105, + "rms": 7.800175189971924, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5a4d845007a3c875af948cfead31d98025aec5543c670e5383a6a96aa1281e1b", + "mean": -0.011812117882072926, + "std": 0.8833805322647095, + "rms": 0.8834595680236816, + "max_abs": 31.0 + }, + "full_input": { + "shape": [ + 67, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "68c47f5416bd78b0015b37dec6ea87bc9c4ab78bfc591c6a7341e6a248232331", + "mean": -0.012571393512189388, + "std": 8.679441452026367, + "rms": 8.679450988769531, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bc788423eb18198770dcda2c05dfd5ce64c05b84282b51719e41f7d412ae10dc", + "mean": -0.011039143428206444, + "std": 0.8739591836929321, + "rms": 0.8740288615226746, + "max_abs": 30.75 + }, + "full_input": { + "shape": [ + 83, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "858058ca03c9c51b1d72b8390d5cdc6c1dd7dc0c652340759cc0d777ad9f2fa9", + "mean": -0.01355107594281435, + "std": 7.800196647644043, + "rms": 7.800208568572998, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8154550406c1ef94b684f8cbb081c268b91a0911a986de75431f7b5639647ba4", + "mean": -0.011908802203834057, + "std": 0.8823392391204834, + "rms": 0.8824195861816406, + "max_abs": 30.875 + }, + "full_input": { + "shape": [ + 67, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "973eb28f9238e30bacc032fb430c9df0c64166866c9458a70e823c79cbb0250b", + "mean": -0.011895217001438141, + "std": 8.678997039794922, + "rms": 8.67900562286377, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6c59df843416095e98a004e39c299f92f62bfb8f6456389cc70fa1ad9e2f32e8", + "mean": -0.010407338850200176, + "std": 0.8742241263389587, + "rms": 0.8742861151695251, + "max_abs": 31.0 + }, + "full_input": { + "shape": [ + 83, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7745e7c8a3dac6b45c815c2f2dc217a4a1db7203b453b70882a92680ba3ce6ed", + "mean": -0.012895077466964722, + "std": 7.800126552581787, + "rms": 7.800137042999268, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9923771619796753, + "min_cosine_similarity": 0.9394473433494568, + "mean_relative_l2": 0.10950181633234024, + "max_abs_delta": 1.25 + }, + "system_bos": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9927187561988831, + "min_cosine_similarity": 0.9508651494979858, + "mean_relative_l2": 0.10742371529340744, + "max_abs_delta": 1.5625 + }, + "system_x": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9818578362464905, + "min_cosine_similarity": 0.8266136646270752, + "mean_relative_l2": 0.16607604920864105, + "max_abs_delta": 2.546875 + }, + "system_period": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9824253916740417, + "min_cosine_similarity": 0.8400857448577881, + "mean_relative_l2": 0.1639440804719925, + "max_abs_delta": 2.0 + }, + "bos_at_s0": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9843276143074036, + "min_cosine_similarity": 0.8096197247505188, + "mean_relative_l2": 0.1458553820848465, + "max_abs_delta": 3.625 + }, + "bos_at_s1": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9817213416099548, + "min_cosine_similarity": 0.8033127188682556, + "mean_relative_l2": 0.15782734751701355, + "max_abs_delta": 4.9140625 + }, + "x_at_s0": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9837877154350281, + "min_cosine_similarity": 0.8149808049201965, + "mean_relative_l2": 0.15048106014728546, + "max_abs_delta": 3.1875 + }, + "x_at_s1": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9770349860191345, + "min_cosine_similarity": 0.7629334330558777, + "mean_relative_l2": 0.1845996379852295, + "max_abs_delta": 6.1875 + }, + "period_at_s0": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9830300211906433, + "min_cosine_similarity": 0.7990236282348633, + "mean_relative_l2": 0.15219923853874207, + "max_abs_delta": 3.375 + }, + "period_at_s1": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9779351353645325, + "min_cosine_similarity": 0.7781245708465576, + "mean_relative_l2": 0.17978180944919586, + "max_abs_delta": 4.0 + } + } + }, + "layer_18": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "639ec8b3a02fba9bc4368d5dbfc93c681201e0c395addd14d2de986360c8b95e", + "mean": -0.011338836513459682, + "std": 0.9992061257362366, + "rms": 0.9992704391479492, + "max_abs": 32.5 + }, + "full_input": { + "shape": [ + 67, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "88fb5fd04e1f8259e140406edfdb4d877309f2f55975630d683c86898ddcac7a", + "mean": -0.029115809127688408, + "std": 9.906880378723145, + "rms": 9.906923294067383, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6415ad434d25c004ce0afb2599e4b1dc4054b8f8fd12de332b18b483182e9607", + "mean": -0.01076948456466198, + "std": 0.9930240511894226, + "rms": 0.9930824637413025, + "max_abs": 31.875 + }, + "full_input": { + "shape": [ + 83, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9cbc3177ac6f761580c62fd5ebb753697c36c0c9fde921570a5aa03d7d2e7675", + "mean": -0.02912737987935543, + "std": 9.178305625915527, + "rms": 9.178351402282715, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9947a8b444e3b992b3f35f657fc2e548aae37c4acc1107abd426f515a5538183", + "mean": -0.011768381111323833, + "std": 0.9963340163230896, + "rms": 0.9964034557342529, + "max_abs": 32.25 + }, + "full_input": { + "shape": [ + 67, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "edd815dcdebdd40ae307281a705bbf993a074f84a933521d8953faa3b60fa16c", + "mean": -0.011825758963823318, + "std": 8.695548057556152, + "rms": 8.695555686950684, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "09fc2d3fec0ed5560131c1a34c4c54d9694dcf399bc9e19ffab6425f150e3d40", + "mean": -0.01179103460162878, + "std": 0.9939887523651123, + "rms": 0.9940586686134338, + "max_abs": 32.25 + }, + "full_input": { + "shape": [ + 83, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "45aafa95d8168ae5d4c67c2e9e5280d67ba2796e2655434ea72c1bae17735369", + "mean": -0.013302475214004517, + "std": 7.818892478942871, + "rms": 7.818902969360352, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d9d0fb09de4bc9885523bfb3f66920768c82c62ff6aa7f90a978667354d13929", + "mean": -0.010692826472222805, + "std": 1.0029785633087158, + "rms": 1.003035545349121, + "max_abs": 32.75 + }, + "full_input": { + "shape": [ + 67, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8961912f7349713ed5f61dd13da43d95776f30ccec051c3a33a40b1d71afcbde", + "mean": -0.011919272132217884, + "std": 8.696823120117188, + "rms": 8.696830749511719, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c199902659c0b45d6a7210bbddabc769dbf73baa6224fbe6fdc95d656a31389a", + "mean": -0.010447513312101364, + "std": 0.9879553318023682, + "rms": 0.988010585308075, + "max_abs": 32.25 + }, + "full_input": { + "shape": [ + 83, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "042eed63b590d96fef685882e96b4a09d3b11bae2be1c1f3bc26d5309a01496e", + "mean": -0.012902921997010708, + "std": 7.819025993347168, + "rms": 7.819036483764648, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cab70ae1e81c7657e55dca720dc8ad34ab83a12c8a1ca5b09455343065e74de1", + "mean": -0.010960177518427372, + "std": 1.0023996829986572, + "rms": 1.0024596452713013, + "max_abs": 32.5 + }, + "full_input": { + "shape": [ + 67, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "af1dbd3227b709a9f8bcd29119252365999b1c6a463167ecf61c44a6025467e4", + "mean": -0.011326494626700878, + "std": 8.69636344909668, + "rms": 8.696371078491211, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "291830d0ca5ef07ffa3e77954898a1c78a982f754138d16c3c7012d07c8b723f", + "mean": -0.009756366722285748, + "std": 0.9919048547744751, + "rms": 0.9919528365135193, + "max_abs": 31.875 + }, + "full_input": { + "shape": [ + 83, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b108346122865f8e3736eee67ba62410f81f4ca421568d52590232ed9cca3abe", + "mean": -0.012228392995893955, + "std": 7.819028854370117, + "rms": 7.819038391113281, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.991958737373352, + "min_cosine_similarity": 0.9342365264892578, + "mean_relative_l2": 0.11320991814136505, + "max_abs_delta": 1.875 + }, + "system_bos": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9927792549133301, + "min_cosine_similarity": 0.9538363218307495, + "mean_relative_l2": 0.10765427350997925, + "max_abs_delta": 1.7109375 + }, + "system_x": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9815663695335388, + "min_cosine_similarity": 0.8130529522895813, + "mean_relative_l2": 0.1681542694568634, + "max_abs_delta": 3.46875 + }, + "system_period": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9813833832740784, + "min_cosine_similarity": 0.8159992098808289, + "mean_relative_l2": 0.16751527786254883, + "max_abs_delta": 3.0 + }, + "bos_at_s0": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9837960600852966, + "min_cosine_similarity": 0.7971851229667664, + "mean_relative_l2": 0.14570116996765137, + "max_abs_delta": 4.359375 + }, + "bos_at_s1": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9810892939567566, + "min_cosine_similarity": 0.7763301730155945, + "mean_relative_l2": 0.15909981727600098, + "max_abs_delta": 6.5703125 + }, + "x_at_s0": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9835796356201172, + "min_cosine_similarity": 0.8038246631622314, + "mean_relative_l2": 0.14965693652629852, + "max_abs_delta": 5.5 + }, + "x_at_s1": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9758862853050232, + "min_cosine_similarity": 0.7521162033081055, + "mean_relative_l2": 0.18837453424930573, + "max_abs_delta": 8.625 + }, + "period_at_s0": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9825196266174316, + "min_cosine_similarity": 0.7824919819831848, + "mean_relative_l2": 0.15145227313041687, + "max_abs_delta": 3.53125 + }, + "period_at_s1": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9765533208847046, + "min_cosine_similarity": 0.759752094745636, + "mean_relative_l2": 0.1833597868680954, + "max_abs_delta": 4.5 + } + } + }, + "layer_19": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cbb6ffcbe4d022beee56133945ef8a4ff1eae09ce22a68f3c0477e58254868f9", + "mean": -0.0075140283443033695, + "std": 1.0889601707458496, + "rms": 1.0889861583709717, + "max_abs": 29.25 + }, + "full_input": { + "shape": [ + 67, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "632868a756e1bb2694979e884dcc58c0dbf067e0a60ef4b3f9a35605b387325d", + "mean": -0.025620443746447563, + "std": 9.913336753845215, + "rms": 9.913369178771973, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "142d092efa731a360e20022f0e0d7998a60819229b9ca5d89e1dfca66567132c", + "mean": -0.006530848331749439, + "std": 1.0832496881484985, + "rms": 1.083269476890564, + "max_abs": 29.0 + }, + "full_input": { + "shape": [ + 83, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "065d11724b6d97f3d14b98609f94c9cfbe32368d3cc000f3f48ba35c50cd299f", + "mean": -0.025507820770144463, + "std": 9.186980247497559, + "rms": 9.187015533447266, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6dd83b947ecd221c458c8805192e1878eebeb28a2393c38d70462f9acd739c2d", + "mean": -0.007925440557301044, + "std": 1.087666630744934, + "rms": 1.087695598602295, + "max_abs": 29.0 + }, + "full_input": { + "shape": [ + 67, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ce5fe95adbda4f6b65b72a616b80b8b5dbc4b56a6c4ba9cbdf2f3a38ddef194f", + "mean": -0.008739516139030457, + "std": 8.703369140625, + "rms": 8.703373908996582, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "19567daf23b5dcac7d7ef73242860c3beac8c3037856aba4d70d6ec85c18e71d", + "mean": -0.008001983165740967, + "std": 1.087060570716858, + "rms": 1.087090015411377, + "max_abs": 29.125 + }, + "full_input": { + "shape": [ + 83, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1568eebdd02ac97c7fe117383bd85aef99bc81021c9d02610a77a289df1c7514", + "mean": -0.009969142265617847, + "std": 7.829104900360107, + "rms": 7.829111099243164, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c7ecc37fa1d78757e4344b3441aeb4336ac9e682c4de936c029a27529fdfd057", + "mean": -0.006726541090756655, + "std": 1.0932198762893677, + "rms": 1.0932406187057495, + "max_abs": 29.375 + }, + "full_input": { + "shape": [ + 67, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cffbb4989c6d2632ff94b9027a35b1b0525e37e99a6759a703aa991900b877b1", + "mean": -0.0086111044511199, + "std": 8.704895973205566, + "rms": 8.704900741577148, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1031ecba458dc2f9245cecfaa6cef410ab698006741259193df32ee74d05e65a", + "mean": -0.005366105120629072, + "std": 1.0824928283691406, + "rms": 1.0825060606002808, + "max_abs": 28.75 + }, + "full_input": { + "shape": [ + 83, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d0179ed3368c74e11ff67f354c29d9b57a89c06a7419cd1202b14d25a5d91c7b", + "mean": -0.008816187269985676, + "std": 7.829302787780762, + "rms": 7.8293070793151855, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "62b12860671237e7477a62ed74c27a87c38f6c2e2f5297089de40e2237879a17", + "mean": -0.007046493701636791, + "std": 1.0942033529281616, + "rms": 1.0942260026931763, + "max_abs": 29.25 + }, + "full_input": { + "shape": [ + 67, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3effce4a827eb9a99f75ba92e3841a02108766684447b4bd558a75fbccab5926", + "mean": -0.008325248956680298, + "std": 8.704427719116211, + "rms": 8.704431533813477, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "07908011f60f5b079b9e27fcd4ce4b0147ae1c343ded4416872398f207c31820", + "mean": -0.005207806825637817, + "std": 1.087154746055603, + "rms": 1.0871672630310059, + "max_abs": 29.125 + }, + "full_input": { + "shape": [ + 83, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3412b10a0cbde2b2709eefb4b053fbda909ad1c41c3dce403611aafa48b09a11", + "mean": -0.00873498897999525, + "std": 7.829505443572998, + "rms": 7.829510688781738, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9915216565132141, + "min_cosine_similarity": 0.9198068380355835, + "mean_relative_l2": 0.11462675780057907, + "max_abs_delta": 4.125 + }, + "system_bos": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9926995635032654, + "min_cosine_similarity": 0.9543082118034363, + "mean_relative_l2": 0.10878081619739532, + "max_abs_delta": 1.828125 + }, + "system_x": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9801313281059265, + "min_cosine_similarity": 0.8049651384353638, + "mean_relative_l2": 0.17372533679008484, + "max_abs_delta": 3.25 + }, + "system_period": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9811597466468811, + "min_cosine_similarity": 0.8211479783058167, + "mean_relative_l2": 0.16855990886688232, + "max_abs_delta": 3.5 + }, + "bos_at_s0": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9834790825843811, + "min_cosine_similarity": 0.8086107969284058, + "mean_relative_l2": 0.14876863360404968, + "max_abs_delta": 4.515625 + }, + "bos_at_s1": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9799780249595642, + "min_cosine_similarity": 0.7324179410934448, + "mean_relative_l2": 0.1622353494167328, + "max_abs_delta": 8.25 + }, + "x_at_s0": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9834262132644653, + "min_cosine_similarity": 0.8183630704879761, + "mean_relative_l2": 0.1524820327758789, + "max_abs_delta": 4.5625 + }, + "x_at_s1": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9741300940513611, + "min_cosine_similarity": 0.7306745052337646, + "mean_relative_l2": 0.1948975771665573, + "max_abs_delta": 6.0 + }, + "period_at_s0": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9823079109191895, + "min_cosine_similarity": 0.7979388236999512, + "mean_relative_l2": 0.15471702814102173, + "max_abs_delta": 3.75 + }, + "period_at_s1": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9763972759246826, + "min_cosine_similarity": 0.7722170352935791, + "mean_relative_l2": 0.18550458550453186, + "max_abs_delta": 4.75 + } + } + }, + "layer_20": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e5537c4f63ad4d02affdd0b8b6e37214475ad1deae8d5eaeba6c31cead67d35e", + "mean": -0.009849597699940205, + "std": 1.2430877685546875, + "rms": 1.2431267499923706, + "max_abs": 34.75 + }, + "full_input": { + "shape": [ + 67, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b51b22bb538e3a1e4057ed5f9b109f172f7fb9f366530ae38824cc20c60de9f6", + "mean": -0.02683371491730213, + "std": 10.226929664611816, + "rms": 10.226964950561523, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c17c92c86ccef9f4c8d649eae696fe1c5e706ee6abee0461e3c7071ec6bc2f2c", + "mean": -0.009085755795240402, + "std": 1.236788272857666, + "rms": 1.2368216514587402, + "max_abs": 34.25 + }, + "full_input": { + "shape": [ + 83, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0d782713dfe46f35db4891f824bec9f2513107368732d13d8ba7c8f93de9a7c8", + "mean": -0.026897240430116653, + "std": 9.491732597351074, + "rms": 9.49177074432373, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b58894aa317c93ff8c663f73a5718a8d1882c13fcdfa4892990f647df8f3e9c0", + "mean": -0.010142361745238304, + "std": 1.2407842874526978, + "rms": 1.2408257722854614, + "max_abs": 34.75 + }, + "full_input": { + "shape": [ + 67, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3804b27b0c1e941565f4d08135bf26e669547ff4b1547ede3524d3d1b3368f96", + "mean": -0.010801819153130054, + "std": 8.724042892456055, + "rms": 8.72404956817627, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8d3fb5063a4dce99356111a6cb37c4de9ad02a144a2a90e59318bd4eb745f55f", + "mean": -0.010110045783221722, + "std": 1.2405458688735962, + "rms": 1.2405871152877808, + "max_abs": 34.5 + }, + "full_input": { + "shape": [ + 83, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d99650e84f4e85ff442f63875ef8d1fab8d1c3732359849b3e273e127e2cef9a", + "mean": -0.011842136271297932, + "std": 7.85310697555542, + "rms": 7.853116035461426, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3dd52d4bd993a074d48406b528ad7915474cc183c48c651de1d87a7034ffe8f5", + "mean": -0.008755657821893692, + "std": 1.2473596334457397, + "rms": 1.2473903894424438, + "max_abs": 34.5 + }, + "full_input": { + "shape": [ + 67, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "862e1deae386cfc8aaad2631133c78e2551da1dd4837f6a8b3ad4f123deaa25a", + "mean": -0.010682150721549988, + "std": 8.726086616516113, + "rms": 8.726093292236328, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b7ef595558d11fc6afb090ab7a5b8c586d4ea03ff804ffcf558a90ee3994632c", + "mean": -0.0073848906904459, + "std": 1.2383599281311035, + "rms": 1.2383819818496704, + "max_abs": 34.25 + }, + "full_input": { + "shape": [ + 83, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e5d3069443d8b43c7cba11f9406f578d768c377be1f106befd7df1693c946fed", + "mean": -0.010641868226230145, + "std": 7.85382080078125, + "rms": 7.853827953338623, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "96e40e240575deea46559db35a66fec66fb16b3b2370af14ca196a882ea458d6", + "mean": -0.00914241187274456, + "std": 1.2486801147460938, + "rms": 1.248713493347168, + "max_abs": 34.5 + }, + "full_input": { + "shape": [ + 67, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "864678e1f53f29ff3381cdc9ed394f7ba12321b64fc4589e411766469a769da3", + "mean": -0.010344098322093487, + "std": 8.725564002990723, + "rms": 8.725569725036621, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "313a4732aa780da198f552cc508badc7934c8ee9b763bc0796ec480734e9c734", + "mean": -0.007348740939050913, + "std": 1.2472232580184937, + "rms": 1.247244954109192, + "max_abs": 34.5 + }, + "full_input": { + "shape": [ + 83, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cb0318c07bef3ed93b26c6e0bd43aa472ed97b0091d83811d7daf52444ef99d2", + "mean": -0.01047488022595644, + "std": 7.85422420501709, + "rms": 7.854230880737305, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9913883209228516, + "min_cosine_similarity": 0.9227422475814819, + "mean_relative_l2": 0.11447396874427795, + "max_abs_delta": 3.4375 + }, + "system_bos": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9929192066192627, + "min_cosine_similarity": 0.9550970196723938, + "mean_relative_l2": 0.10748299956321716, + "max_abs_delta": 1.75 + }, + "system_x": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9800785779953003, + "min_cosine_similarity": 0.8058025240898132, + "mean_relative_l2": 0.17408886551856995, + "max_abs_delta": 3.875 + }, + "system_period": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.980278491973877, + "min_cosine_similarity": 0.8238656520843506, + "mean_relative_l2": 0.1719917356967926, + "max_abs_delta": 3.25 + }, + "bos_at_s0": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9833148717880249, + "min_cosine_similarity": 0.8005093336105347, + "mean_relative_l2": 0.14701113104820251, + "max_abs_delta": 5.15625 + }, + "bos_at_s1": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9801797270774841, + "min_cosine_similarity": 0.7437738180160522, + "mean_relative_l2": 0.1598917692899704, + "max_abs_delta": 7.0703125 + }, + "x_at_s0": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9833823442459106, + "min_cosine_similarity": 0.8140940070152283, + "mean_relative_l2": 0.15153643488883972, + "max_abs_delta": 7.0 + }, + "x_at_s1": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9746941924095154, + "min_cosine_similarity": 0.7440986633300781, + "mean_relative_l2": 0.19215860962867737, + "max_abs_delta": 7.375 + }, + "period_at_s0": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9824310541152954, + "min_cosine_similarity": 0.7932513952255249, + "mean_relative_l2": 0.15311773121356964, + "max_abs_delta": 5.375 + }, + "period_at_s1": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.976189911365509, + "min_cosine_similarity": 0.7802091836929321, + "mean_relative_l2": 0.18607939779758453, + "max_abs_delta": 4.625 + } + } + }, + "layer_21": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a3763edce2f2554ce1344fe98ccea13623e61b7952630cbd623dcbcc2e322a84", + "mean": -0.004008028656244278, + "std": 1.347705602645874, + "rms": 1.3477115631103516, + "max_abs": 45.0 + }, + "full_input": { + "shape": [ + 67, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2522c3c3d97f994f23c442ae67ff6e3ad70e04c2bf9d81f2e2e9c50615aef0c0", + "mean": -0.022133957594633102, + "std": 10.335454940795898, + "rms": 10.335478782653809, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3fee43b668866e50647dfb4747491bb76735df2bcafc66903517e660d1806207", + "mean": -0.0034451668616384268, + "std": 1.3403270244598389, + "rms": 1.3403314352035522, + "max_abs": 45.0 + }, + "full_input": { + "shape": [ + 83, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "277dbc8fc900000a60eab0375560e17adb9951ce51709468c19d34da30722b61", + "mean": -0.022518271580338478, + "std": 9.58623218536377, + "rms": 9.586258888244629, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5c2b066d5e3aee85cda2e5c73673b431c1ae1973e107ee3ca6933b452b1db153", + "mean": -0.0040406351909041405, + "std": 1.343791127204895, + "rms": 1.343797206878662, + "max_abs": 45.25 + }, + "full_input": { + "shape": [ + 67, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "09d8d2ea95a6f0b1852b9c0a9b3d0daccee9e72562bd537b85aab1324276fe20", + "mean": -0.005715842824429274, + "std": 8.718186378479004, + "rms": 8.718188285827637, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b6960bbbbbf0ca3fa178112f97bad78f248e77728dbc6945481332373f8f3467", + "mean": -0.003942152019590139, + "std": 1.3438143730163574, + "rms": 1.3438200950622559, + "max_abs": 45.5 + }, + "full_input": { + "shape": [ + 83, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f1bc284d265c0b33bfdb14a912c0063b4b085da3e4972d43f2b745dbf2f108fc", + "mean": -0.007096114568412304, + "std": 7.855831623077393, + "rms": 7.855835437774658, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f1d76c71961e5d372cea183abc376b8362f3a0f1bc6662a656f5ad6270c96a04", + "mean": -0.0036698465701192617, + "std": 1.3536158800125122, + "rms": 1.3536207675933838, + "max_abs": 46.25 + }, + "full_input": { + "shape": [ + 67, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9c0e427e509b26bac75037a45cd62890448a8ee85eb34a352c88efac03006bb1", + "mean": -0.006270997691899538, + "std": 8.721293449401855, + "rms": 8.721296310424805, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "083c6a8159b7279d085bb67d58f76a2de21f8d546ab4912730d5486b740b02b0", + "mean": -0.0024323780089616776, + "std": 1.3484916687011719, + "rms": 1.3484938144683838, + "max_abs": 45.5 + }, + "full_input": { + "shape": [ + 83, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c2eb9ef7279a0a1d529ba08a3a7e0587be989a8cd4aebe4b9aa30efba2893a0a", + "mean": -0.006784009747207165, + "std": 7.8581223487854, + "rms": 7.85812520980835, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3f33ee495192950d1883dceb03ca6d168a44f4cdb8b7f48c22e95db4acefdd9b", + "mean": -0.003294916357845068, + "std": 1.3531699180603027, + "rms": 1.3531739711761475, + "max_abs": 46.0 + }, + "full_input": { + "shape": [ + 67, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "70c034073b867b054b5785d62070c3c6520abb8dcc06ec92f0d88b777431e229", + "mean": -0.0055211372673511505, + "std": 8.719990730285645, + "rms": 8.719991683959961, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bc66ed05974177ba12fde7e256731141d931f5be47a21acdfe28ce5962b79d99", + "mean": -0.0019962440710514784, + "std": 1.3522839546203613, + "rms": 1.3522855043411255, + "max_abs": 45.0 + }, + "full_input": { + "shape": [ + 83, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "38f23943a94bc7046c83206b01fda17633a4190adf5d04235598bd53881afd2b", + "mean": -0.006269983481615782, + "std": 7.8572845458984375, + "rms": 7.857287406921387, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9900916814804077, + "min_cosine_similarity": 0.9205852746963501, + "mean_relative_l2": 0.12402854859828949, + "max_abs_delta": 4.375 + }, + "system_bos": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9920240044593811, + "min_cosine_similarity": 0.9522976875305176, + "mean_relative_l2": 0.11450644582509995, + "max_abs_delta": 2.125 + }, + "system_x": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.97796231508255, + "min_cosine_similarity": 0.8008479475975037, + "mean_relative_l2": 0.18756815791130066, + "max_abs_delta": 7.25 + }, + "system_period": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9779145121574402, + "min_cosine_similarity": 0.813453197479248, + "mean_relative_l2": 0.18478286266326904, + "max_abs_delta": 5.5 + }, + "bos_at_s0": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9817723035812378, + "min_cosine_similarity": 0.8012897968292236, + "mean_relative_l2": 0.15486811101436615, + "max_abs_delta": 5.328125 + }, + "bos_at_s1": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9788834452629089, + "min_cosine_similarity": 0.752843976020813, + "mean_relative_l2": 0.16652296483516693, + "max_abs_delta": 7.3583984375 + }, + "x_at_s0": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9818283319473267, + "min_cosine_similarity": 0.8128688931465149, + "mean_relative_l2": 0.1596471667289734, + "max_abs_delta": 8.375 + }, + "x_at_s1": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9724690318107605, + "min_cosine_similarity": 0.7192431688308716, + "mean_relative_l2": 0.20299868285655975, + "max_abs_delta": 8.375 + }, + "period_at_s0": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9808214902877808, + "min_cosine_similarity": 0.7904214859008789, + "mean_relative_l2": 0.1608627438545227, + "max_abs_delta": 6.0 + }, + "period_at_s1": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9739308953285217, + "min_cosine_similarity": 0.7541714310646057, + "mean_relative_l2": 0.1949194222688675, + "max_abs_delta": 4.75 + } + } + }, + "layer_22": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a5e96bde914ebf1939d3904ad2885503af9c7d5aabd9780dc3c2b97d05a6cdf6", + "mean": -0.0043130237609148026, + "std": 1.5361384153366089, + "rms": 1.536144495010376, + "max_abs": 57.5 + }, + "full_input": { + "shape": [ + 67, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e6cbc6d129fc71a8137aae3da1a3a04ed14432a0076abfa0fc5711a6fb94e7aa", + "mean": -0.02292909286916256, + "std": 10.359465599060059, + "rms": 10.359490394592285, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4337fa675ff1df9e4d1582ce523ac7f7f6449f3d87167786e339f2d37d046b24", + "mean": -0.0038393933791667223, + "std": 1.5256288051605225, + "rms": 1.5256335735321045, + "max_abs": 57.5 + }, + "full_input": { + "shape": [ + 83, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7aa9f6b307edc30a0c54507a848c8418088d0d383fb054681afbaa73d11e1413", + "mean": -0.023540416732430458, + "std": 9.617778778076172, + "rms": 9.617807388305664, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a2b5c84b8eefb314286c7344a01387a7613b34ceaf907fb132cec751919323f0", + "mean": -0.005161897279322147, + "std": 1.5316503047943115, + "rms": 1.5316590070724487, + "max_abs": 58.0 + }, + "full_input": { + "shape": [ + 67, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "440f75fc469ec24d38673be655a1bdf3cabfc5715dc783243511bcf70e274797", + "mean": -0.007100062444806099, + "std": 8.746999740600586, + "rms": 8.747003555297852, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "99e820934df3811256119e4ab9743b1fd07864db3d4645711472052105c5628f", + "mean": -0.0048883287236094475, + "std": 1.5293465852737427, + "rms": 1.529354453086853, + "max_abs": 58.0 + }, + "full_input": { + "shape": [ + 83, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c6b79e07e414f56b4c3860d8a203b0cb8469e57265802ab6c29b3d77b4b46ac7", + "mean": -0.008441912941634655, + "std": 7.894505500793457, + "rms": 7.894509792327881, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2bc38f589d8317e246291cfc02b3d731bdb131ccb94b9a1e64d0d02c0625df68", + "mean": -0.004240160807967186, + "std": 1.5460559129714966, + "rms": 1.5460617542266846, + "max_abs": 58.0 + }, + "full_input": { + "shape": [ + 67, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "62bb4485e43cf75be5af48947e781a0fd74425ed906f9f1fa776474cd6a3a1e2", + "mean": -0.007238790392875671, + "std": 8.751205444335938, + "rms": 8.751209259033203, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5bdd84ec9dbcbe59bbe9f92ebc31cf0308aaeac108cb9cd37374cf49e26d1b1b", + "mean": -0.0027299218345433474, + "std": 1.540529727935791, + "rms": 1.540532112121582, + "max_abs": 57.75 + }, + "full_input": { + "shape": [ + 83, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "db49d611ab83c1e1e29f4e073cd2a904b89b7908c5610ad347cb93c545a2ec85", + "mean": -0.007361920550465584, + "std": 7.8982834815979, + "rms": 7.89828634262085, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e0f7117c3967c863a6758383234702aaab74fa9cfeeff61f779d9a7140fb2825", + "mean": -0.0037679041270166636, + "std": 1.5435806512832642, + "rms": 1.5435853004455566, + "max_abs": 58.0 + }, + "full_input": { + "shape": [ + 67, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3950ab8efd316fe11a7d5aaaa820c8d26e9df22e2eb792640f63466d515c3b0f", + "mean": -0.0065885442309081554, + "std": 8.749396324157715, + "rms": 8.749399185180664, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b771dc4f04d460e4372d40c6277122408f34005cc34e939a96adebdb1d9818bc", + "mean": -0.0027019097469747066, + "std": 1.5396126508712769, + "rms": 1.5396149158477783, + "max_abs": 57.25 + }, + "full_input": { + "shape": [ + 83, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "92810e8caac54d8721a761bdb13225cd117aca820f7b58c7fb8757a6fb769898", + "mean": -0.00707579217851162, + "std": 7.896512508392334, + "rms": 7.896514892578125, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9892374873161316, + "min_cosine_similarity": 0.9023442268371582, + "mean_relative_l2": 0.1266125589609146, + "max_abs_delta": 5.0 + }, + "system_bos": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9912057518959045, + "min_cosine_similarity": 0.9367896914482117, + "mean_relative_l2": 0.11772463470697403, + "max_abs_delta": 2.875 + }, + "system_x": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9772375226020813, + "min_cosine_similarity": 0.8029354810714722, + "mean_relative_l2": 0.19064734876155853, + "max_abs_delta": 7.5 + }, + "system_period": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9766067266464233, + "min_cosine_similarity": 0.8148553371429443, + "mean_relative_l2": 0.18822480738162994, + "max_abs_delta": 6.25 + }, + "bos_at_s0": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9799984693527222, + "min_cosine_similarity": 0.7746355533599854, + "mean_relative_l2": 0.15874814987182617, + "max_abs_delta": 5.078125 + }, + "bos_at_s1": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9773201942443848, + "min_cosine_similarity": 0.7429280281066895, + "mean_relative_l2": 0.16890351474285126, + "max_abs_delta": 7.7265625 + }, + "x_at_s0": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9812500476837158, + "min_cosine_similarity": 0.8010293245315552, + "mean_relative_l2": 0.1612762063741684, + "max_abs_delta": 8.5 + }, + "x_at_s1": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9712201356887817, + "min_cosine_similarity": 0.7042038440704346, + "mean_relative_l2": 0.20645225048065186, + "max_abs_delta": 9.5 + }, + "period_at_s0": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9804067015647888, + "min_cosine_similarity": 0.791295051574707, + "mean_relative_l2": 0.1622937172651291, + "max_abs_delta": 5.5 + }, + "period_at_s1": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9719414710998535, + "min_cosine_similarity": 0.7291281819343567, + "mean_relative_l2": 0.19976560771465302, + "max_abs_delta": 5.75 + } + } + }, + "layer_23": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b80ac2177a60d8482cc59ea7f342383872810c7939fd625077496aef7c39c8ed", + "mean": -0.013936124742031097, + "std": 1.9374363422393799, + "rms": 1.9374865293502808, + "max_abs": 89.0 + }, + "full_input": { + "shape": [ + 67, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cda79f1a082b37cfccc94a74b9a3ce80a01987d3228c05ec0d5954dc0bb03774", + "mean": -0.02883155457675457, + "std": 10.376585006713867, + "rms": 10.376625061035156, + "max_abs": 1160.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d40bd91eb1f6aabb909518d38655a6055d4d8cb573ce05dc3326aaf948857801", + "mean": -0.014257636852562428, + "std": 1.933603286743164, + "rms": 1.9336557388305664, + "max_abs": 89.0 + }, + "full_input": { + "shape": [ + 83, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "73e68fac7539441d4d39a4d972e1e0cc1262a6c7ac15b8b320e631a6421c36ec", + "mean": -0.02724183350801468, + "std": 9.647416114807129, + "rms": 9.647453308105469, + "max_abs": 1160.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a35e87b2076d9a29a1c26b2aa1660061aef4cd3b5c9447acdb209d6342f37eb7", + "mean": -0.01562906615436077, + "std": 1.939687728881836, + "rms": 1.9397506713867188, + "max_abs": 89.0 + }, + "full_input": { + "shape": [ + 67, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "35e4eaa75996725c713f97d3236f20ff68ac87faae4841f2950054062dc7c6d7", + "mean": -0.013616388663649559, + "std": 8.780769348144531, + "rms": 8.780779838562012, + "max_abs": 1160.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c7bb7a965527a3c5901b416d9ab56fffadae7ae485eb6b20684a67f0717dead0", + "mean": -0.014697270467877388, + "std": 1.9386123418807983, + "rms": 1.9386680126190186, + "max_abs": 89.5 + }, + "full_input": { + "shape": [ + 83, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e121508096da11cd2d00f213c65dd362e5f1f4ca60ad47c969fefa750e0ded9e", + "mean": -0.011717543937265873, + "std": 7.946685791015625, + "rms": 7.9466938972473145, + "max_abs": 1160.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e152cc307c4462e2c27e467457ed5a0c5f05a242dcaf1509ae99a972f9956d2c", + "mean": -0.013863015919923782, + "std": 1.9546878337860107, + "rms": 1.9547370672225952, + "max_abs": 89.0 + }, + "full_input": { + "shape": [ + 67, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "250f5288cbc70a483d5269fc4722f2238e9e167c3a3c71d7767e221893ddfaa7", + "mean": -0.012902205809950829, + "std": 8.787737846374512, + "rms": 8.78774642944336, + "max_abs": 1160.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "20939db731b9a2d71103f265ecbc40a9015d88b5a8959e1c950aaf359378241c", + "mean": -0.012106473557651043, + "std": 1.9654959440231323, + "rms": 1.9655332565307617, + "max_abs": 89.5 + }, + "full_input": { + "shape": [ + 83, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cafbcf6ff1a9161d9841ab936473353e94b7394c67568739f621b41ea5bb73b9", + "mean": -0.010750171728432178, + "std": 7.955193996429443, + "rms": 7.955200672149658, + "max_abs": 1160.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "67fe8cfa97d36df2fe3a36492df50f64485770a21884200ff4e3903b5cb35760", + "mean": -0.013453925959765911, + "std": 1.950061559677124, + "rms": 1.9501079320907593, + "max_abs": 89.0 + }, + "full_input": { + "shape": [ + 67, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a6774e4a4d858c889c8a78dd6c53f04b6f8c6b42bb6d9904ed10ba6540f49a4d", + "mean": -0.012826023623347282, + "std": 8.784132957458496, + "rms": 8.78414249420166, + "max_abs": 1160.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8dd30f87a7044ef194fbb7acdd8c6f542870c26dcb35c37e56b14bf72041b374", + "mean": -0.011590206064283848, + "std": 1.9452530145645142, + "rms": 1.9452874660491943, + "max_abs": 88.0 + }, + "full_input": { + "shape": [ + 83, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e3b33500eb6c0e6483b05df4ef60ee4c8a8dfe70bd8be2aaa4dbb13ad386cd0c", + "mean": -0.010303949937224388, + "std": 7.949857234954834, + "rms": 7.949863910675049, + "max_abs": 1160.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9898244738578796, + "min_cosine_similarity": 0.9042349457740784, + "mean_relative_l2": 0.12503869831562042, + "max_abs_delta": 6.5 + }, + "system_bos": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9918311834335327, + "min_cosine_similarity": 0.9346826672554016, + "mean_relative_l2": 0.11309844255447388, + "max_abs_delta": 5.5 + }, + "system_x": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.979462206363678, + "min_cosine_similarity": 0.8370925188064575, + "mean_relative_l2": 0.18715807795524597, + "max_abs_delta": 10.25 + }, + "system_period": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9788119792938232, + "min_cosine_similarity": 0.8294450044631958, + "mean_relative_l2": 0.1793392300605774, + "max_abs_delta": 7.0 + }, + "bos_at_s0": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9817385077476501, + "min_cosine_similarity": 0.7991417050361633, + "mean_relative_l2": 0.1552942991256714, + "max_abs_delta": 6.75 + }, + "bos_at_s1": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9805117249488831, + "min_cosine_similarity": 0.7713096141815186, + "mean_relative_l2": 0.15855103731155396, + "max_abs_delta": 9.1953125 + }, + "x_at_s0": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9840682148933411, + "min_cosine_similarity": 0.8357326984405518, + "mean_relative_l2": 0.15131178498268127, + "max_abs_delta": 14.0 + }, + "x_at_s1": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9755078554153442, + "min_cosine_similarity": 0.7560171484947205, + "mean_relative_l2": 0.19795964658260345, + "max_abs_delta": 14.0 + }, + "period_at_s0": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.982968270778656, + "min_cosine_similarity": 0.8232302665710449, + "mean_relative_l2": 0.15430514514446259, + "max_abs_delta": 6.0 + }, + "period_at_s1": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9753168821334839, + "min_cosine_similarity": 0.7576761245727539, + "mean_relative_l2": 0.18838664889335632, + "max_abs_delta": 8.75 + } + } + }, + "layer_24": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b2ea52a1cf8effb82d3020dd3f4ca2473a5bf24c6302bcdf0a2cabc0182b5d81", + "mean": -0.02532782405614853, + "std": 4.297481060028076, + "rms": 4.297555446624756, + "max_abs": 354.0 + }, + "full_input": { + "shape": [ + 67, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b38c8e668dfe07b6c88711a174b4ce4052da32e22c2504c05a7cbf46c87e378a", + "mean": -0.03825386241078377, + "std": 10.188929557800293, + "rms": 10.189001083374023, + "max_abs": 1008.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f731923e095ed44ee93b8d1ef27997dc68f049968e819a87a3158912ad36ae61", + "mean": -0.02601318433880806, + "std": 5.085294246673584, + "rms": 5.085360527038574, + "max_abs": 444.0 + }, + "full_input": { + "shape": [ + 83, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1a6c523c92309b13d7777220f90591a6c221696837efaaf6a4e17d808921d60c", + "mean": -0.03444364666938782, + "std": 9.929451942443848, + "rms": 9.929512023925781, + "max_abs": 1120.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "318d6532c050ddcce5fd85570772579ddcccca085e520f1772ff1d0d3a828032", + "mean": -0.02751843072474003, + "std": 5.132761001586914, + "rms": 5.132835388183594, + "max_abs": 448.0 + }, + "full_input": { + "shape": [ + 67, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "78e7a9a7bb85d6b4ed89a36239fcbf62548753dae2c26f89c4d9ecda287408c6", + "mean": -0.021363019943237305, + "std": 7.215075492858887, + "rms": 7.215106964111328, + "max_abs": 840.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c1e87122caf560753d9d47523c9a0aa959eaa93226092bff8d0fef6a698db801", + "mean": -0.027083570137619972, + "std": 5.507900238037109, + "rms": 5.5079665184021, + "max_abs": 488.0 + }, + "full_input": { + "shape": [ + 83, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2127a6ba408e32cec0e1c36155fa095dd7a1a16f24680a3431424231c9121a10", + "mean": -0.017370792105793953, + "std": 6.754012584686279, + "rms": 6.754034519195557, + "max_abs": 840.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fe0dd01345d7c14f7aa6eb8fb64092029f468796da5e77409e46ff6c97d3a3e2", + "mean": -0.024979911744594574, + "std": 4.514085292816162, + "rms": 4.514154434204102, + "max_abs": 380.0 + }, + "full_input": { + "shape": [ + 67, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "390a7e0cb5d1380a35310bd293fba023b678c5aa58b3b5725cdebe8b3f971a26", + "mean": -0.020187223330140114, + "std": 6.959545612335205, + "rms": 6.959574222564697, + "max_abs": 840.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f2ded991a7d59b972a93bf2cd3de473f37260575514d4833ab1baddadcfb7314", + "mean": -0.02178109437227249, + "std": 5.495364665985107, + "rms": 5.495407581329346, + "max_abs": 486.0 + }, + "full_input": { + "shape": [ + 83, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0374eaef05895229e8a9a696a883ca3c212a0c99ac4e017a017226d07f8c27db", + "mean": -0.015324867330491543, + "std": 6.757486343383789, + "rms": 6.757503032684326, + "max_abs": 840.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "59038c65b4cda3e2ca951f1a0b1edfb4d87002e5f47aba4e18a7ff6aff28d952", + "mean": -0.02515779808163643, + "std": 4.980868339538574, + "rms": 4.980931282043457, + "max_abs": 430.0 + }, + "full_input": { + "shape": [ + 67, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9fa6608f8ae4aed5a81a24be8d3dd83ff17c0fe339b6a28c888b18b7c33444ec", + "mean": -0.020189780741930008, + "std": 7.152121067047119, + "rms": 7.152149677276611, + "max_abs": 840.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "889ff1b3bc861148fecbc893c4cc35a09bdd2a513c0ed5b8fa48b842da3ecf88", + "mean": -0.022617259994149208, + "std": 5.292975902557373, + "rms": 5.293024063110352, + "max_abs": 464.0 + }, + "full_input": { + "shape": [ + 83, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f8aa820af974545ec5f74ac1a283f5c83c08fc5e3096b36f83aedcfd50feae4d", + "mean": -0.015302229672670364, + "std": 6.6708760261535645, + "rms": 6.67089319229126, + "max_abs": 840.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9897112250328064, + "min_cosine_similarity": 0.8995858430862427, + "mean_relative_l2": 0.12512405216693878, + "max_abs_delta": 90.0 + }, + "system_bos": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9924027323722839, + "min_cosine_similarity": 0.935184121131897, + "mean_relative_l2": 0.10895391553640366, + "max_abs_delta": 40.0 + }, + "system_x": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9782363176345825, + "min_cosine_similarity": 0.8109191656112671, + "mean_relative_l2": 0.1824944019317627, + "max_abs_delta": 106.0 + }, + "system_period": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.981109082698822, + "min_cosine_similarity": 0.8369418382644653, + "mean_relative_l2": 0.16822631657123566, + "max_abs_delta": 34.0 + }, + "bos_at_s0": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9804540276527405, + "min_cosine_similarity": 0.8230628967285156, + "mean_relative_l2": 0.15712326765060425, + "max_abs_delta": 94.0 + }, + "bos_at_s1": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.982358455657959, + "min_cosine_similarity": 0.8001497387886047, + "mean_relative_l2": 0.15301987528800964, + "max_abs_delta": 44.0 + }, + "x_at_s0": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9852495789527893, + "min_cosine_similarity": 0.8542187213897705, + "mean_relative_l2": 0.14784884452819824, + "max_abs_delta": 26.0 + }, + "x_at_s1": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9748495221138, + "min_cosine_similarity": 0.7707768082618713, + "mean_relative_l2": 0.19091132283210754, + "max_abs_delta": 42.0 + }, + "period_at_s0": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9787530303001404, + "min_cosine_similarity": 0.7129493951797485, + "mean_relative_l2": 0.15968219935894012, + "max_abs_delta": 76.0 + }, + "period_at_s1": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9746527075767517, + "min_cosine_similarity": 0.7624822854995728, + "mean_relative_l2": 0.18301045894622803, + "max_abs_delta": 22.34375 + } + } + }, + "layer_25": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8f63b4003a448143c43c517230078da6fab1ebc0640f7be7acbdb3fcaa1526b3", + "mean": -0.04379796236753464, + "std": 4.818379878997803, + "rms": 4.818579196929932, + "max_abs": 356.0 + }, + "full_input": { + "shape": [ + 67, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "da34198a99a902b8252205d59441c0afa4e577be80cc6c66115c54d69e00f215", + "mean": -0.05481220781803131, + "std": 8.140730857849121, + "rms": 8.140914916992188, + "max_abs": 872.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4029db77f4763a6c3636b304d56aca26d0665659aa5734342eef38b685cc9514", + "mean": -0.041355326771736145, + "std": 5.518267631530762, + "rms": 5.518422603607178, + "max_abs": 446.0 + }, + "full_input": { + "shape": [ + 83, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a34fd424969af99d8d5a26ceaae9ee776f63a25c0a3f2a8b0d28c9eb442cdbe3", + "mean": -0.048671066761016846, + "std": 8.239919662475586, + "rms": 8.240063667297363, + "max_abs": 984.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e7f9e1863b362e6a362535a96271e889a6e6f1cb6f5217fad66db74b68cf1c87", + "mean": -0.04688113182783127, + "std": 5.580898761749268, + "rms": 5.581095218658447, + "max_abs": 450.0 + }, + "full_input": { + "shape": [ + 67, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "06723f98ff00383c08875edc064823d2f6e88b4ef3b62291ceade01cd33a6264", + "mean": -0.03766348585486412, + "std": 5.119884014129639, + "rms": 5.120022296905518, + "max_abs": 450.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "07377facc2fa09ae4b249ed612c2253563c50f3e8f809717cfe9a15d059cbe21", + "mean": -0.04457537829875946, + "std": 5.921814441680908, + "rms": 5.921982765197754, + "max_abs": 492.0 + }, + "full_input": { + "shape": [ + 83, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7e66c6d54bf40b30e5db6ca43843dc924fde5ffb4c53bf9b900b1949a9f1b4fc", + "mean": -0.03160294145345688, + "std": 5.085585117340088, + "rms": 5.0856828689575195, + "max_abs": 492.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "716ef26f0f3357d4225fb620c96c7bdfdd6866b518efacc6ef6247f30071e537", + "mean": -0.04499666020274162, + "std": 5.023499965667725, + "rms": 5.023701190948486, + "max_abs": 382.0 + }, + "full_input": { + "shape": [ + 67, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cc4e6d8cdb0ba0049a478780b1185b01f0852ae36abe727e6521eeb642768dbf", + "mean": -0.03752410039305687, + "std": 4.769558429718018, + "rms": 4.769705772399902, + "max_abs": 382.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "03848913fee5a201803cdb08bc193ba52d1af479e9dd319f7ec19ad74810561b", + "mean": -0.03665250167250633, + "std": 5.915239334106445, + "rms": 5.915352821350098, + "max_abs": 490.0 + }, + "full_input": { + "shape": [ + 83, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1602ccff61400af8d9340639142c37f0df1cf43f68c2f6c0d489b14c922fc6f1", + "mean": -0.027872540056705475, + "std": 5.101569652557373, + "rms": 5.1016459465026855, + "max_abs": 490.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "384ce992c10d4edfd3b897825bdc28291d114c05157689536a4ed3ccfb32475d", + "mean": -0.04514634236693382, + "std": 5.445217609405518, + "rms": 5.445404529571533, + "max_abs": 432.0 + }, + "full_input": { + "shape": [ + 67, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1bf53d9f62a596cee0c4ffa93eaad4d66e0a05c5e54950e9f9ebe228e9364156", + "mean": -0.03696942329406738, + "std": 5.03969144821167, + "rms": 5.0398268699646, + "max_abs": 432.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f723ca2a099993418bcc992cfc02d3c294817a2747cc73cf98550ad807ffca9c", + "mean": -0.037737175822257996, + "std": 5.714175224304199, + "rms": 5.714299201965332, + "max_abs": 468.0 + }, + "full_input": { + "shape": [ + 83, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1f698114e2de945e0f7e967f8b46590528ec39a770213817768353716703d1ce", + "mean": -0.027632681652903557, + "std": 4.97331428527832, + "rms": 4.973391056060791, + "max_abs": 468.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9908975958824158, + "min_cosine_similarity": 0.9151737689971924, + "mean_relative_l2": 0.11556869745254517, + "max_abs_delta": 90.0 + }, + "system_bos": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9939616322517395, + "min_cosine_similarity": 0.9420627951622009, + "mean_relative_l2": 0.09903591126203537, + "max_abs_delta": 42.0 + }, + "system_x": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9825042486190796, + "min_cosine_similarity": 0.8489614129066467, + "mean_relative_l2": 0.16497115790843964, + "max_abs_delta": 108.0 + }, + "system_period": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9850131273269653, + "min_cosine_similarity": 0.8832511305809021, + "mean_relative_l2": 0.15124180912971497, + "max_abs_delta": 36.0 + }, + "bos_at_s0": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9842602610588074, + "min_cosine_similarity": 0.7926945686340332, + "mean_relative_l2": 0.13688628375530243, + "max_abs_delta": 94.0 + }, + "bos_at_s1": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9874113202095032, + "min_cosine_similarity": 0.8527904748916626, + "mean_relative_l2": 0.1321944296360016, + "max_abs_delta": 46.0 + }, + "x_at_s0": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9889100193977356, + "min_cosine_similarity": 0.899142324924469, + "mean_relative_l2": 0.127662792801857, + "max_abs_delta": 26.0 + }, + "x_at_s1": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9817453026771545, + "min_cosine_similarity": 0.8359130024909973, + "mean_relative_l2": 0.1642078310251236, + "max_abs_delta": 44.0 + }, + "period_at_s0": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9830232262611389, + "min_cosine_similarity": 0.7030589580535889, + "mean_relative_l2": 0.1381411850452423, + "max_abs_delta": 76.0 + }, + "period_at_s1": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9816296100616455, + "min_cosine_similarity": 0.8279939889907837, + "mean_relative_l2": 0.1551179587841034, + "max_abs_delta": 23.15625 + } + } + }, + "layer_26": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "02933ff743a448b765dab0159724232d7fa50bb4ff60f8b8bfb9bfe7f69b1e76", + "mean": -0.06222803145647049, + "std": 3.883305072784424, + "rms": 3.8838038444519043, + "max_abs": 182.0 + }, + "full_input": { + "shape": [ + 67, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "560aa8d57c09b3af86afbe9e1660619c68d2b847f3bb0f9f1aa6ef177e3a9f99", + "mean": -0.07738978415727615, + "std": 7.908001899719238, + "rms": 7.90838098526001, + "max_abs": 840.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0ee29f19484c6eb20add2ff8534d49a0b59c86890b6ce23a9bba8f7e3cf63278", + "mean": -0.05198861286044121, + "std": 3.6265485286712646, + "rms": 3.6269211769104004, + "max_abs": 166.0 + }, + "full_input": { + "shape": [ + 83, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "37a76b140f0f4f4529fc3425d0e4a1ece1f7334aaf55735b0e80d8f6004146e2", + "mean": -0.056571271270513535, + "std": 7.847190856933594, + "rms": 7.8473944664001465, + "max_abs": 868.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "49339c4368a53739d61d76bdf75a8d2c74f0f12e5a79a0efbf62bb91afe4b63a", + "mean": -0.06748875975608826, + "std": 3.810720682144165, + "rms": 3.8113183975219727, + "max_abs": 191.0 + }, + "full_input": { + "shape": [ + 67, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "57fa57ffd8bcc640ffc4ea7d4d982080140efa2ec503c00f8352b78b7dfcce1b", + "mean": -0.058904316276311874, + "std": 4.883847713470459, + "rms": 4.88420295715332, + "max_abs": 772.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "96d889eebfd2989a268110132afcbe931fee675c453ee96509b271dd39fb5056", + "mean": -0.058679863810539246, + "std": 3.7617545127868652, + "rms": 3.7622122764587402, + "max_abs": 179.0 + }, + "full_input": { + "shape": [ + 83, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ed683c3a1e57797bfb18789e72cfc09f11e7c7ed11b37de74e719d96e96b653a", + "mean": -0.03882467374205589, + "std": 4.993751525878906, + "rms": 4.993902683258057, + "max_abs": 772.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b712a2e3286a6533088afb6d4f2d556ba7ff2747f43dded11642eb489a7f6e39", + "mean": -0.06815866380929947, + "std": 3.9287109375, + "rms": 3.929302215576172, + "max_abs": 188.0 + }, + "full_input": { + "shape": [ + 67, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5d251b28a6bc3c25b5a652c96b46869eb7817fcc9cbe4b39210cce5be03b960c", + "mean": -0.060805343091487885, + "std": 4.9946441650390625, + "rms": 4.995014667510986, + "max_abs": 772.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1dc95a9eda7e55262306a010a2f2f7546403c42183717910bf2927f1b9c9b30d", + "mean": -0.045521706342697144, + "std": 3.6390907764434814, + "rms": 3.6393754482269287, + "max_abs": 160.0 + }, + "full_input": { + "shape": [ + 83, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "84762d6f222079b0826f4d86463f303f713fdbc175ba949a60548fa8d9f63a19", + "mean": -0.032387301325798035, + "std": 4.955393314361572, + "rms": 4.955499649047852, + "max_abs": 772.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e0a4f5ae119ee4dd740107fb449ba778adffa95c3846f4337a59449dafae4231", + "mean": -0.06833221763372421, + "std": 3.840987205505371, + "rms": 3.841594934463501, + "max_abs": 192.0 + }, + "full_input": { + "shape": [ + 67, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0956223f03cc063e39dd746786b0f1ba416ab68ac9a3f964786a00ff26ef94d2", + "mean": -0.06020078435540199, + "std": 4.914523601531982, + "rms": 4.914892196655273, + "max_abs": 772.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ec7375bb6a0ee56e305dafd99a69eb93cf7d922994b6474901368ed7b47f9d40", + "mean": -0.04634901508688927, + "std": 3.5708673000335693, + "rms": 3.5711679458618164, + "max_abs": 163.0 + }, + "full_input": { + "shape": [ + 83, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "09983df353542b990b389723178ad0da081e8a126c1fbcb7b76a116db2709603", + "mean": -0.032141730189323425, + "std": 4.893235683441162, + "rms": 4.893341541290283, + "max_abs": 772.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9885446429252625, + "min_cosine_similarity": 0.8632803559303284, + "mean_relative_l2": 0.14159713685512543, + "max_abs_delta": 50.5 + }, + "system_bos": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9913586378097534, + "min_cosine_similarity": 0.9038136005401611, + "mean_relative_l2": 0.13396957516670227, + "max_abs_delta": 69.25 + }, + "system_x": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9771591424942017, + "min_cosine_similarity": 0.8479164838790894, + "mean_relative_l2": 0.2102578729391098, + "max_abs_delta": 52.0 + }, + "system_period": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9778215289115906, + "min_cosine_similarity": 0.808035135269165, + "mean_relative_l2": 0.19508899748325348, + "max_abs_delta": 41.0 + }, + "bos_at_s0": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9855130314826965, + "min_cosine_similarity": 0.8410347700119019, + "mean_relative_l2": 0.14028222858905792, + "max_abs_delta": 49.25 + }, + "bos_at_s1": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9858254790306091, + "min_cosine_similarity": 0.7825369834899902, + "mean_relative_l2": 0.15889963507652283, + "max_abs_delta": 74.5 + }, + "x_at_s0": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9888425469398499, + "min_cosine_similarity": 0.8706437349319458, + "mean_relative_l2": 0.13323810696601868, + "max_abs_delta": 47.5 + }, + "x_at_s1": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9815592169761658, + "min_cosine_similarity": 0.7669553160667419, + "mean_relative_l2": 0.17677679657936096, + "max_abs_delta": 53.0 + }, + "period_at_s0": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9860848784446716, + "min_cosine_similarity": 0.8661959767341614, + "mean_relative_l2": 0.1370473951101303, + "max_abs_delta": 53.5 + }, + "period_at_s1": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9811661243438721, + "min_cosine_similarity": 0.7315398454666138, + "mean_relative_l2": 0.15685760974884033, + "max_abs_delta": 25.25 + } + } + }, + "final_norm": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9269f8689535934b3f2a25708633f8872606ea01f5e81a5bb70f4160d37ed231", + "mean": -0.0072544775903224945, + "std": 0.6267409920692444, + "rms": 0.626783013343811, + "max_abs": 21.375 + }, + "full_input": { + "shape": [ + 67, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a6e09bff746889e284814375ed1c8988e76169282f3a13c1794e4fc939fe6ffe", + "mean": -0.006436801515519619, + "std": 0.6152685284614563, + "rms": 0.6153022050857544, + "max_abs": 21.375 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c71910e1b009f642799ac161d7dd48c0916d715d09ee637c222296173b4f6905", + "mean": -0.0060786656104028225, + "std": 0.6241376996040344, + "rms": 0.624167263507843, + "max_abs": 22.125 + }, + "full_input": { + "shape": [ + 83, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f6a411c69a5ac252fb9048f01c43a5a8d71d2eb02d08199802abf601c2942e62", + "mean": -0.0036058153491467237, + "std": 0.5918757915496826, + "rms": 0.5918867588043213, + "max_abs": 22.125 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "03f066cbd7db3f157429584a23ec1fb375588367d193e88e1389da5962fa44d1", + "mean": -0.008552050217986107, + "std": 0.6412028074264526, + "rms": 0.6412597894668579, + "max_abs": 22.75 + }, + "full_input": { + "shape": [ + 67, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4c735c878b07648744cfb5c03c1cdd6a904a02e896dcb63e812ac8ae5c4c39a3", + "mean": -0.007074082735925913, + "std": 0.6259461641311646, + "rms": 0.6259861588478088, + "max_abs": 22.75 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "34a090ca3b20e842f8bbb1fc4ff2de8c2e30436a49839c48bd3a6d2557632978", + "mean": -0.007194432429969311, + "std": 0.6312839388847351, + "rms": 0.6313248872756958, + "max_abs": 22.375 + }, + "full_input": { + "shape": [ + 83, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "30baa45f8df541d0b02483c51d31474fc101e8e9a0a1a828a09b5737051f0200", + "mean": -0.004051344934850931, + "std": 0.5966798067092896, + "rms": 0.5966935753822327, + "max_abs": 22.375 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "37c2f9220a5c0a283b09ec6e764945260ad88a9354ae58ab90016c64bac36544", + "mean": -0.008271780796349049, + "std": 0.6360838413238525, + "rms": 0.6361376047134399, + "max_abs": 22.375 + }, + "full_input": { + "shape": [ + 67, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c7cff82fdd078f1a4db3330b2afbe9d56c6672e3080fad7eb48ddf919cd1f83e", + "mean": -0.006975360214710236, + "std": 0.6194338798522949, + "rms": 0.6194731593132019, + "max_abs": 22.375 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c76b7a552cfd612193a5fa40f63700642da3431784b19267d945e4debab021e2", + "mean": -0.00471144774928689, + "std": 0.6310127377510071, + "rms": 0.6310303211212158, + "max_abs": 22.875 + }, + "full_input": { + "shape": [ + 83, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5fc15a81a52306d68fbe89604eae752c4d5d6810733abb300c9030336ea779b1", + "mean": -0.002598041435703635, + "std": 0.5938791036605835, + "rms": 0.5938847661018372, + "max_abs": 22.875 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "597fdd1bdbdec35249b2a9372875a166e11085fd42d547224c19812bd34d1948", + "mean": -0.008571863174438477, + "std": 0.6393921375274658, + "rms": 0.6394495964050293, + "max_abs": 22.375 + }, + "full_input": { + "shape": [ + 67, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6b687e81734b94d8caacbb67736cf8d6782459a528f9e48cd47ef7d2cdebc6cd", + "mean": -0.007232405245304108, + "std": 0.6243823766708374, + "rms": 0.6244242191314697, + "max_abs": 22.375 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 42, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7534272855ac776a16be25da5b2b0d7a8f2a3a23f1c31a6669754240510e3baa", + "mean": -0.004991147667169571, + "std": 0.6306344866752625, + "rms": 0.6306542158126831, + "max_abs": 22.75 + }, + "full_input": { + "shape": [ + 83, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ca70fe338b5ed7981e43d82d10ce35496258bc320459f569992fa99bc9707bd8", + "mean": -0.0026097551453858614, + "std": 0.596838116645813, + "rms": 0.5968438386917114, + "max_abs": 22.75 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9846657514572144, + "min_cosine_similarity": 0.8295095562934875, + "mean_relative_l2": 0.14782994985580444, + "max_abs_delta": 4.3125 + }, + "system_bos": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.990118682384491, + "min_cosine_similarity": 0.9129338264465332, + "mean_relative_l2": 0.12608221173286438, + "max_abs_delta": 4.21875 + }, + "system_x": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9688175916671753, + "min_cosine_similarity": 0.8458191156387329, + "mean_relative_l2": 0.22290684282779694, + "max_abs_delta": 7.46875 + }, + "system_period": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9689936637878418, + "min_cosine_similarity": 0.774321973323822, + "mean_relative_l2": 0.2145717442035675, + "max_abs_delta": 6.984375 + }, + "bos_at_s0": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9806534051895142, + "min_cosine_similarity": 0.8219811916351318, + "mean_relative_l2": 0.1614648550748825, + "max_abs_delta": 3.90625 + }, + "bos_at_s1": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9797552824020386, + "min_cosine_similarity": 0.7070726752281189, + "mean_relative_l2": 0.1579529196023941, + "max_abs_delta": 8.3125 + }, + "x_at_s0": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9836887121200562, + "min_cosine_similarity": 0.8653102517127991, + "mean_relative_l2": 0.14931820333003998, + "max_abs_delta": 8.15625 + }, + "x_at_s1": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9737806916236877, + "min_cosine_similarity": 0.7057941555976868, + "mean_relative_l2": 0.19110257923603058, + "max_abs_delta": 4.0625 + }, + "period_at_s0": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9800499677658081, + "min_cosine_similarity": 0.8504244089126587, + "mean_relative_l2": 0.1617303192615509, + "max_abs_delta": 8.171875 + }, + "period_at_s1": { + "tokens": 42, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9737513661384583, + "min_cosine_similarity": 0.6976856589317322, + "mean_relative_l2": 0.18523874878883362, + "max_abs_delta": 3.75 + } + } + } + }, + "router_layers": { + "layer_01": { + "layer": 1, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "8e8fc4e655b6177248ba33a98db63655df24d1b9f88de318cf0bf168496e1860", + "route_weight_sha256": "168bcaa11a884b03dc689de41340cee2dc369014e03831aad2b40d6f4d2c79f7", + "loads": [ + 1, + 2, + 2, + 0, + 1, + 1, + 3, + 5, + 7, + 5, + 0, + 1, + 8, + 7, + 0, + 3, + 4, + 2, + 0, + 5, + 7, + 4, + 1, + 2, + 15, + 9, + 3, + 3, + 0, + 2, + 1, + 10, + 6, + 2, + 6, + 5, + 1, + 3, + 4, + 1, + 3, + 4, + 3, + 7, + 0, + 6, + 9, + 1, + 7, + 2, + 1, + 0, + 8, + 5, + 0, + 9, + 6, + 8, + 0, + 10, + 8, + 0, + 10, + 3 + ], + "weighted_loads": [ + 0.06797729432582855, + 0.0902477540075779, + 0.08425833098590374, + 0.0, + 0.020453957840800285, + 0.09335467964410782, + 0.21556062251329422, + 0.1473443154245615, + 0.29274064116179943, + 0.15964647196233273, + 0.0, + 0.023397943004965782, + 0.21681463159620762, + 0.48275396041572094, + 0.0, + 0.11354806832969189, + 0.15099434554576874, + 0.07097974605858326, + 0.0, + 0.14632208086550236, + 0.5684010498225689, + 0.08894338831305504, + 0.02618897706270218, + 0.05152059532701969, + 2.3009393215179443, + 0.5753362737596035, + 0.1031035203486681, + 0.2235943302512169, + 0.0, + 0.055008526891469955, + 0.03976446017622948, + 0.8598283212631941, + 0.34282515570521355, + 0.10199624672532082, + 0.16198364831507206, + 0.15928149409592152, + 0.026495078578591347, + 0.20803118497133255, + 0.09841679409146309, + 0.1009693518280983, + 0.14866828173398972, + 0.1524123251438141, + 0.14564090594649315, + 0.43400880694389343, + 0.0, + 0.1796395182609558, + 0.2075735479593277, + 0.024693414568901062, + 0.16939950361847878, + 0.0567175205796957, + 0.02679523080587387, + 0.0, + 0.3671698831021786, + 0.16283052042126656, + 0.0, + 1.1907550394535065, + 0.24697076715528965, + 0.2915138117969036, + 0.0, + 0.26408094353973866, + 0.41642745956778526, + 0.0, + 0.9576172679662704, + 0.10097694583237171 + ], + "unique_experts": 54, + "load_cv": 0.8516875190664325, + "normalized_load_entropy": 0.9047893777933017, + "max_load_share": 0.05952380952380952 + }, + "full_input": { + "tokens": 67, + "top_k": 6, + "decisions": 402, + "ordered_route_sha256": "656259f38a960830e0a43ea694fa9f65fd1ca962da79325fef72509e5848b4f5", + "route_weight_sha256": "84965bad1404f6af05b8a3e3e6267bdffca856cfdada9e6304ac747e7bf6d25d", + "loads": [ + 2, + 2, + 4, + 2, + 3, + 1, + 5, + 7, + 24, + 6, + 2, + 1, + 8, + 7, + 1, + 12, + 4, + 4, + 0, + 5, + 10, + 4, + 2, + 2, + 15, + 13, + 15, + 4, + 0, + 3, + 1, + 15, + 8, + 4, + 6, + 6, + 2, + 3, + 6, + 4, + 3, + 14, + 3, + 13, + 1, + 17, + 9, + 2, + 7, + 2, + 2, + 1, + 12, + 6, + 3, + 13, + 10, + 15, + 0, + 21, + 9, + 3, + 10, + 3 + ], + "weighted_loads": [ + 0.14397521317005157, + 0.0902477540075779, + 0.18689383380115032, + 0.05833021365106106, + 0.0719759613275528, + 0.09335467964410782, + 0.42298583686351776, + 0.41499759443104267, + 1.188456878066063, + 0.1813710480928421, + 0.14079885184764862, + 0.023397943004965782, + 0.21681463159620762, + 0.48275396041572094, + 0.025594959035515785, + 0.7281258646398783, + 0.15099434554576874, + 0.1882226299494505, + 0.0, + 0.14632208086550236, + 0.9701876752078533, + 0.08894338831305504, + 0.05645783618092537, + 0.05152059532701969, + 2.3009393215179443, + 0.7188383769243956, + 0.8890583142638206, + 0.2958519160747528, + 0.0, + 0.07989991642534733, + 0.03976446017622948, + 1.2596492489101365, + 0.4993526116013527, + 0.5476591177284718, + 0.16198364831507206, + 0.18468260951340199, + 0.04803943634033203, + 0.20803118497133255, + 0.14969213493168354, + 0.309141106903553, + 0.14866828173398972, + 0.5631941966712475, + 0.14564090594649315, + 0.5663299325970002, + 0.984293520450592, + 0.9964717050897889, + 0.2075735479593277, + 0.05083259008824825, + 0.16939950361847878, + 0.0567175205796957, + 0.05290317349135876, + 0.0006069890805520117, + 0.601626317948103, + 0.19053426198661327, + 0.045170378376496956, + 1.7630109414458275, + 0.5617909859865904, + 0.696809945628047, + 0.0, + 0.9809517916291952, + 0.5069775395095348, + 0.14183251187205315, + 0.9576172679662704, + 0.10097694583237171 + ], + "unique_experts": 61, + "load_cv": 0.8603225829069793, + "normalized_load_entropy": 0.9160063390395006, + "max_load_share": 0.05970149253731343 + } + }, + "s1_eos": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "92c73a29d46589e8ff56ab79f73111c79b2a5e571ed1b88cb8f96b5bdf7cc32f", + "route_weight_sha256": "800453514feba8a833851c1882764dbfa011868b0e08ebc8bf901896c1e972ab", + "loads": [ + 2, + 2, + 2, + 0, + 0, + 1, + 4, + 4, + 6, + 5, + 0, + 1, + 8, + 7, + 0, + 3, + 3, + 2, + 0, + 5, + 9, + 3, + 1, + 3, + 15, + 9, + 4, + 3, + 0, + 1, + 1, + 11, + 6, + 3, + 6, + 1, + 1, + 3, + 2, + 1, + 3, + 4, + 3, + 7, + 1, + 5, + 13, + 0, + 5, + 2, + 7, + 1, + 8, + 2, + 0, + 9, + 6, + 8, + 0, + 9, + 8, + 0, + 10, + 3 + ], + "weighted_loads": [ + 0.09255575202405453, + 0.08611352555453777, + 0.08925605937838554, + 0.0, + 0.0, + 0.08517536520957947, + 0.2549751587212086, + 0.118239751085639, + 0.2763073667883873, + 0.15638825297355652, + 0.0, + 0.023226462304592133, + 0.21165891364216805, + 0.479583565145731, + 0.0, + 0.11797637492418289, + 0.12872233241796494, + 0.07431504130363464, + 0.0, + 0.14848501980304718, + 0.6433782670646906, + 0.07425805367529392, + 0.025902938097715378, + 0.07193602994084358, + 2.322665125131607, + 0.5768025573343039, + 0.13622508943080902, + 0.2302209436893463, + 0.0, + 0.03600641340017319, + 0.03982067480683327, + 0.8919098321348429, + 0.33575679920613766, + 0.1409710068255663, + 0.1588350124657154, + 0.061874330043792725, + 0.02611144259572029, + 0.2020970992743969, + 0.05203766003251076, + 0.1018030047416687, + 0.1402042619884014, + 0.1503000631928444, + 0.14938987605273724, + 0.4314994756132364, + 0.03356422483921051, + 0.14865421317517757, + 0.3038867171853781, + 0.0, + 0.12198051437735558, + 0.05864528752863407, + 0.2152321320027113, + 0.01780664175748825, + 0.3761434257030487, + 0.08445281907916069, + 0.0, + 1.211281195282936, + 0.22005935572087765, + 0.28064726665616035, + 0.0, + 0.23106973245739937, + 0.4244863335043192, + 0.0, + 0.9593667704612017, + 0.10072881728410721 + ], + "unique_experts": 54, + "load_cv": 0.8898803993910971, + "normalized_load_entropy": 0.9002606788004699, + "max_load_share": 0.05952380952380952 + }, + "full_input": { + "tokens": 83, + "top_k": 6, + "decisions": 498, + "ordered_route_sha256": "240013825e73f513505215531bc2b02757685896b6760e917aeab63a1da1f227", + "route_weight_sha256": "842bff989c0f0ef539c6e47325631d5884422c02a04017473860db25d5a7e3c9", + "loads": [ + 5, + 2, + 5, + 2, + 5, + 3, + 6, + 7, + 29, + 6, + 5, + 2, + 9, + 8, + 0, + 15, + 3, + 8, + 1, + 6, + 12, + 7, + 5, + 5, + 17, + 14, + 22, + 5, + 0, + 3, + 2, + 18, + 8, + 5, + 6, + 1, + 3, + 4, + 3, + 6, + 3, + 16, + 6, + 14, + 3, + 16, + 13, + 4, + 7, + 2, + 13, + 6, + 13, + 3, + 5, + 13, + 16, + 19, + 2, + 20, + 10, + 4, + 10, + 7 + ], + "weighted_loads": [ + 0.28515210561454296, + 0.08611352555453777, + 0.2554887384176254, + 0.060318924486637115, + 0.28923224844038486, + 0.22300880029797554, + 0.4456590823829174, + 0.35547033324837685, + 1.5834584534168243, + 0.17831826396286488, + 0.32948922365903854, + 0.17126212269067764, + 0.23615294694900513, + 0.5194515623152256, + 0.0, + 0.8197170458734035, + 0.12872233241796494, + 0.32243569754064083, + 0.03927401080727577, + 0.2141815423965454, + 0.996638597920537, + 0.32941848412156105, + 0.2963438853621483, + 0.13081962056457996, + 2.3944705091416836, + 0.7476283758878708, + 1.3935827761888504, + 0.32466525211930275, + 0.0, + 0.19858098402619362, + 0.1257079876959324, + 1.517683823214611, + 0.48065962828695774, + 0.5514354649931192, + 0.1588350124657154, + 0.061874330043792725, + 0.3071507755666971, + 0.23582617938518524, + 0.07752928137779236, + 0.42893705517053604, + 0.1402042619884014, + 0.7231433615088463, + 0.35606775246560574, + 0.6519205290824175, + 1.1758156567811966, + 0.9172086637699977, + 0.3038867171853781, + 0.10796750549343415, + 0.27333031594753265, + 0.05864528752863407, + 0.5142962317913771, + 0.3833662645192817, + 0.6801253110170364, + 0.11047846637666225, + 0.0935137901105918, + 1.7685056552290916, + 0.6907811593264341, + 0.9184787254780531, + 0.07534226402640343, + 0.9025910347700119, + 0.539859090000391, + 0.23229055479168892, + 0.9593667704612017, + 0.5928915590047836 + ], + "unique_experts": 62, + "load_cv": 0.7739134011949609, + "normalized_load_entropy": 0.9324221849301177, + "max_load_share": 0.05823293172690763 + } + }, + "s0_bos": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "3ea8ce9973d1b5bc2646028e932b9caf44a68618a9e2a50dadae788091b96c3f", + "route_weight_sha256": "efb3b1b510c4d21998ce47b9bccc375b0a6850aa41628117be3a664f12548411", + "loads": [ + 2, + 2, + 2, + 0, + 0, + 1, + 4, + 6, + 3, + 5, + 4, + 4, + 5, + 6, + 3, + 5, + 2, + 4, + 1, + 4, + 6, + 1, + 3, + 7, + 15, + 8, + 4, + 3, + 0, + 6, + 1, + 8, + 4, + 1, + 6, + 1, + 2, + 3, + 5, + 1, + 3, + 4, + 3, + 7, + 2, + 5, + 2, + 2, + 7, + 1, + 7, + 0, + 8, + 2, + 0, + 9, + 4, + 8, + 0, + 10, + 8, + 0, + 9, + 3 + ], + "weighted_loads": [ + 0.1003180667757988, + 0.09586123004555702, + 0.08635454997420311, + 0.0, + 0.0, + 0.07940228283405304, + 0.2260767798870802, + 0.17603365145623684, + 0.09265203401446342, + 0.18738573417067528, + 0.09567555598914623, + 0.08922893553972244, + 0.1383371613919735, + 0.502598486840725, + 0.06503358669579029, + 0.16866609454154968, + 0.10056137479841709, + 0.13789227418601513, + 0.02443864196538925, + 0.1263724397867918, + 0.47546377778053284, + 0.024910615757107735, + 0.0814837422221899, + 0.17318495735526085, + 1.8374003805220127, + 0.5671498961746693, + 0.12893816083669662, + 0.22067174315452576, + 0.0, + 0.16545174457132816, + 0.04196019470691681, + 0.8446348756551743, + 0.26066778413951397, + 0.06258290261030197, + 0.1668513435870409, + 0.06195705011487007, + 0.044809119775891304, + 0.22308525815606117, + 0.1272324100136757, + 0.09467054158449173, + 0.13007452711462975, + 0.14368622191250324, + 0.14622686803340912, + 0.4360235929489136, + 0.05527137406170368, + 0.1631920486688614, + 0.03879939578473568, + 0.043504197150468826, + 0.16729765944182873, + 0.030405228957533836, + 0.18218078464269638, + 0.0, + 0.38954757526516914, + 0.08583257347345352, + 0.0, + 1.1023344621062279, + 0.19778441451489925, + 0.29570104368031025, + 0.0, + 0.26958852633833885, + 0.4066467937082052, + 0.0, + 0.9771470557898283, + 0.09559985250234604 + ], + "unique_experts": 57, + "load_cv": 0.7617394000445604, + "normalized_load_entropy": 0.9253645076615585, + "max_load_share": 0.05952380952380952 + }, + "full_input": { + "tokens": 67, + "top_k": 6, + "decisions": 402, + "ordered_route_sha256": "d9fc9b793ce5c6f506557440c62af877ee12e3fad4fa2a9d9370e9d4c9aba925", + "route_weight_sha256": "decc14ff6a93db9d19bc127e536837a91c500bbe77104cf6b45d35a02dd7cb64", + "loads": [ + 4, + 2, + 4, + 1, + 2, + 1, + 6, + 8, + 18, + 6, + 7, + 6, + 5, + 6, + 4, + 14, + 2, + 7, + 1, + 4, + 9, + 1, + 4, + 8, + 15, + 12, + 16, + 4, + 0, + 7, + 1, + 12, + 6, + 3, + 6, + 1, + 2, + 3, + 7, + 4, + 3, + 14, + 4, + 13, + 2, + 15, + 3, + 4, + 7, + 1, + 8, + 0, + 12, + 3, + 2, + 13, + 8, + 16, + 0, + 20, + 10, + 3, + 9, + 3 + ], + "weighted_loads": [ + 0.21602046117186546, + 0.09586123004555702, + 0.17146289348602295, + 0.03027183748781681, + 0.05152200348675251, + 0.07940228283405304, + 0.4180599357932806, + 0.4360315930098295, + 0.9133812412619591, + 0.21119138412177563, + 0.2769314032047987, + 0.14137011021375656, + 0.1383371613919735, + 0.502598486840725, + 0.09323499165475368, + 0.7832438908517361, + 0.10056137479841709, + 0.29505721665918827, + 0.02443864196538925, + 0.1263724397867918, + 0.8117659315466881, + 0.024910615757107735, + 0.1117526013404131, + 0.1992880068719387, + 1.8374003805220127, + 0.716344902291894, + 0.9148929547518492, + 0.2828735075891018, + 0.0, + 0.19135145097970963, + 0.04196019470691681, + 1.2412251755595207, + 0.4083464313298464, + 0.4399544820189476, + 0.1668513435870409, + 0.06195705011487007, + 0.044809119775891304, + 0.22308525815606117, + 0.18015493638813496, + 0.3097348101437092, + 0.13007452711462975, + 0.5544680934399366, + 0.18905433639883995, + 0.5929595157504082, + 0.05527137406170368, + 0.9795231372117996, + 0.065022649243474, + 0.09027615189552307, + 0.16729765944182873, + 0.030405228957533836, + 0.20828872732818127, + 0.0, + 0.6109671331942081, + 0.11165174096822739, + 0.04471815750002861, + 1.6585714295506477, + 0.5383285935968161, + 0.7755467351526022, + 0.0, + 0.9530879631638527, + 0.6021293457597494, + 0.14150775969028473, + 0.9771470557898283, + 0.09559985250234604 + ], + "unique_experts": 61, + "load_cv": 0.7872495710268776, + "normalized_load_entropy": 0.9256446821245139, + "max_load_share": 0.04975124378109453 + } + }, + "s1_bos": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "38322bf38a55041b794a4db0cc081209cead1f657246047dce9fb8cf01e374ff", + "route_weight_sha256": "67e9839fd6beda1f1f2f48f933eed3fed53c2ef50a94f0145a35801474b685d0", + "loads": [ + 1, + 2, + 2, + 1, + 0, + 1, + 4, + 7, + 3, + 4, + 2, + 4, + 5, + 7, + 2, + 4, + 1, + 3, + 3, + 6, + 7, + 1, + 2, + 5, + 15, + 8, + 8, + 3, + 0, + 7, + 1, + 8, + 4, + 1, + 6, + 1, + 0, + 3, + 5, + 1, + 3, + 4, + 2, + 6, + 3, + 5, + 3, + 1, + 6, + 1, + 8, + 0, + 8, + 2, + 3, + 9, + 4, + 8, + 0, + 9, + 7, + 0, + 9, + 3 + ], + "weighted_loads": [ + 0.07269749045372009, + 0.09481337666511536, + 0.09374700114130974, + 0.02203844115138054, + 0.0, + 0.08364647626876831, + 0.21470274776220322, + 0.19655256904661655, + 0.09633336402475834, + 0.15878227539360523, + 0.04939942806959152, + 0.09027018025517464, + 0.13012216798961163, + 0.5369676668196917, + 0.04358110763132572, + 0.14962207712233067, + 0.07931173592805862, + 0.10345616564154625, + 0.0723540224134922, + 0.17822737619280815, + 0.5249844677746296, + 0.025312738493084908, + 0.049028802663087845, + 0.1255801822990179, + 1.773399330675602, + 0.5824311003088951, + 0.2529571820050478, + 0.22843985259532928, + 0.0, + 0.1934351772069931, + 0.0423973873257637, + 0.8222196474671364, + 0.22161021083593369, + 0.06255066394805908, + 0.16175823472440243, + 0.06349462270736694, + 0.0, + 0.21629878878593445, + 0.12099742330610752, + 0.09365858882665634, + 0.122176144272089, + 0.14898435398936272, + 0.1290375106036663, + 0.39652813598513603, + 0.09596794471144676, + 0.17084914073348045, + 0.06310803256928921, + 0.02270333468914032, + 0.14511638693511486, + 0.03314508870244026, + 0.309426624327898, + 0.0, + 0.4008527249097824, + 0.08373894169926643, + 0.06339364126324654, + 1.089507594704628, + 0.1621078923344612, + 0.2783361803740263, + 0.0, + 0.23597736097872257, + 0.39589451253414154, + 0.0, + 0.9617675263434649, + 0.09796563349664211 + ], + "unique_experts": 58, + "load_cv": 0.770945044100374, + "normalized_load_entropy": 0.9244704018123034, + "max_load_share": 0.05952380952380952 + }, + "full_input": { + "tokens": 83, + "top_k": 6, + "decisions": 498, + "ordered_route_sha256": "1dd4019d9e955c0303fb7094a80400acdc859bcf494e4f0d7183684e8a5ee33e", + "route_weight_sha256": "4cc1775bca220cb055a095a7eea0bf5d22193307be177dd30cc6779efa4187f9", + "loads": [ + 5, + 2, + 5, + 4, + 5, + 3, + 6, + 10, + 24, + 5, + 8, + 6, + 5, + 9, + 2, + 16, + 1, + 9, + 4, + 7, + 10, + 3, + 6, + 7, + 17, + 13, + 27, + 5, + 0, + 9, + 2, + 14, + 6, + 3, + 7, + 1, + 1, + 4, + 6, + 6, + 3, + 16, + 6, + 12, + 4, + 15, + 4, + 5, + 8, + 1, + 16, + 4, + 13, + 3, + 7, + 13, + 14, + 20, + 2, + 19, + 10, + 4, + 9, + 7 + ], + "weighted_loads": [ + 0.3042372465133667, + 0.09481337666511536, + 0.246247798204422, + 0.11052057519555092, + 0.28923224844038486, + 0.22147991135716438, + 0.37985363602638245, + 0.4250614196062088, + 1.3265014085918665, + 0.18226460739970207, + 0.423174649477005, + 0.26248883455991745, + 0.13012216798961163, + 0.601010276004672, + 0.04358110763132572, + 0.8513627480715513, + 0.07931173592805862, + 0.3542241621762514, + 0.11162803322076797, + 0.24392389878630638, + 0.8172165863215923, + 0.22995446808636189, + 0.31946974992752075, + 0.1857775878161192, + 1.8452047146856785, + 0.7616061437875032, + 1.5282314401119947, + 0.3198888599872589, + 0.0, + 0.35600974783301353, + 0.12828470021486282, + 1.4454184025526047, + 0.3533064015209675, + 0.39285513013601303, + 0.1847318485379219, + 0.06349462270736694, + 0.25945332646369934, + 0.2500278688967228, + 0.14659151807427406, + 0.4291662834584713, + 0.122176144272089, + 0.7218276523053646, + 0.3721207156777382, + 0.5948702488094568, + 0.249115701764822, + 0.9389424473047256, + 0.09342595748603344, + 0.15240690670907497, + 0.29646618850529194, + 0.03314508870244026, + 0.662701141089201, + 0.36525285243988037, + 0.6883115544915199, + 0.10733429715037346, + 0.15648866072297096, + 1.6236400753259659, + 0.6485096849501133, + 0.9930280819535255, + 0.07534226402640343, + 0.8728954587131739, + 0.6133031491190195, + 0.23236320912837982, + 0.9617675263434649, + 0.5901283752173185 + ], + "unique_experts": 63, + "load_cv": 0.7391195034367848, + "normalized_load_entropy": 0.9386997790626275, + "max_load_share": 0.05421686746987952 + } + }, + "s0_x": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "dca722993e1a1956926bdac5c4e0bae11f23ee5155f0b0441f313e8005ae2734", + "route_weight_sha256": "7a8da9f4f47058f9066a14131b4f9ecf0a6cfd397e1ae0307f0bc7aed3853fd3", + "loads": [ + 2, + 2, + 2, + 0, + 1, + 1, + 4, + 4, + 1, + 5, + 3, + 1, + 6, + 6, + 1, + 5, + 3, + 4, + 2, + 5, + 6, + 3, + 3, + 7, + 15, + 8, + 4, + 3, + 1, + 6, + 1, + 8, + 4, + 1, + 6, + 1, + 0, + 3, + 5, + 1, + 3, + 4, + 3, + 9, + 1, + 5, + 2, + 1, + 8, + 1, + 8, + 0, + 8, + 2, + 1, + 9, + 4, + 8, + 0, + 11, + 8, + 0, + 9, + 3 + ], + "weighted_loads": [ + 0.10222885571420193, + 0.09298541583120823, + 0.08399413339793682, + 0.0, + 0.019225886091589928, + 0.09577323496341705, + 0.23131566494703293, + 0.13383318483829498, + 0.03876118361949921, + 0.18761341646313667, + 0.07606231793761253, + 0.022531267255544662, + 0.16473702527582645, + 0.49344122409820557, + 0.02110045962035656, + 0.1621918585151434, + 0.11878353543579578, + 0.1421699207276106, + 0.0466636810451746, + 0.15151072666049004, + 0.45951416715979576, + 0.06670739129185677, + 0.07980798371136189, + 0.17503142356872559, + 1.9432019293308258, + 0.5567007586359978, + 0.13250326924026012, + 0.2202981859445572, + 0.02204262465238571, + 0.1608259342610836, + 0.04160302132368088, + 0.8971204906702042, + 0.26468057557940483, + 0.06563808023929596, + 0.16417484544217587, + 0.061568986624479294, + 0.0, + 0.23179810494184494, + 0.12390969507396221, + 0.09362605959177017, + 0.135642871260643, + 0.14751426130533218, + 0.14797602407634258, + 0.4803046453744173, + 0.027840008959174156, + 0.15603068470954895, + 0.03953106887638569, + 0.020249376073479652, + 0.1941124126315117, + 0.030119001865386963, + 0.21150045841932297, + 0.0, + 0.36796857602894306, + 0.08823206275701523, + 0.020202843472361565, + 1.112685464322567, + 0.18442828580737114, + 0.29246463254094124, + 0.0, + 0.2928374819457531, + 0.40550121665000916, + 0.0, + 0.9880995322018862, + 0.09647076018154621 + ], + "unique_experts": 59, + "load_cv": 0.7966609581796574, + "normalized_load_entropy": 0.9219490142699771, + "max_load_share": 0.05952380952380952 + }, + "full_input": { + "tokens": 67, + "top_k": 6, + "decisions": 402, + "ordered_route_sha256": "e3cb15a9ed03d1e87122dbe6648b3c5532c978af09934ff8c7715b891cd64c3d", + "route_weight_sha256": "7551f750fc7d40fa3eb62d91d6b49edc87b441cb7f4cf1bfec69d31cddc8dc36", + "loads": [ + 3, + 2, + 4, + 2, + 3, + 1, + 6, + 7, + 16, + 7, + 6, + 2, + 6, + 6, + 2, + 15, + 3, + 6, + 2, + 5, + 9, + 3, + 5, + 9, + 15, + 12, + 17, + 4, + 1, + 7, + 1, + 12, + 6, + 3, + 6, + 1, + 0, + 3, + 6, + 4, + 3, + 15, + 3, + 15, + 1, + 16, + 2, + 2, + 8, + 1, + 9, + 0, + 12, + 3, + 3, + 13, + 7, + 15, + 0, + 22, + 9, + 3, + 9, + 3 + ], + "weighted_loads": [ + 0.1940599363297224, + 0.09298541583120823, + 0.1782734151929617, + 0.055261583998799324, + 0.07074788957834244, + 0.09577323496341705, + 0.42745141685009, + 0.43295150995254517, + 0.8622884303331375, + 0.2378612607717514, + 0.2546998579055071, + 0.04603964649140835, + 0.16473702527582645, + 0.49344122409820557, + 0.049205271527171135, + 0.8945207763463259, + 0.11878353543579578, + 0.26192245446145535, + 0.0466636810451746, + 0.15151072666049004, + 0.7892149202525616, + 0.06670739129185677, + 0.14112252742052078, + 0.2261928003281355, + 1.9432019293308258, + 0.7103482838720083, + 0.9481710363179445, + 0.2867215648293495, + 0.02204262465238571, + 0.18722284398972988, + 0.04160302132368088, + 1.2962345257401466, + 0.4139927998185158, + 0.4588990807533264, + 0.16417484544217587, + 0.061568986624479294, + 0.0, + 0.23179810494184494, + 0.15078594721853733, + 0.33223505690693855, + 0.135642871260643, + 0.613930270075798, + 0.14797602407634258, + 0.6418843325227499, + 0.027840008959174156, + 1.006041046231985, + 0.03953106887638569, + 0.04162187688052654, + 0.1941124126315117, + 0.030119001865386963, + 0.23760840110480785, + 0.0, + 0.5720433909446001, + 0.11418449878692627, + 0.06492100097239017, + 1.6893448755145073, + 0.3768388479948044, + 0.6863164287060499, + 0.0, + 1.0743025168776512, + 0.49605129659175873, + 0.13959337770938873, + 0.9880995322018862, + 0.09647076018154621 + ], + "unique_experts": 61, + "load_cv": 0.8154196983294264, + "normalized_load_entropy": 0.9221967500075666, + "max_load_share": 0.05472636815920398 + } + }, + "s1_x": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "ce57f25c82be69876f43555c3797879e4e6dad61a9f798e613979650342a922f", + "route_weight_sha256": "43c7dcb57a37c366671f9a95fb7341097756f1dfd56c0b6fdb094af87c4c1d5d", + "loads": [ + 1, + 2, + 2, + 0, + 0, + 1, + 4, + 4, + 1, + 4, + 1, + 2, + 5, + 7, + 1, + 4, + 1, + 3, + 4, + 5, + 8, + 3, + 3, + 6, + 15, + 8, + 9, + 3, + 0, + 7, + 1, + 10, + 4, + 1, + 6, + 1, + 0, + 3, + 5, + 1, + 3, + 4, + 4, + 7, + 3, + 5, + 3, + 1, + 5, + 2, + 8, + 0, + 8, + 2, + 3, + 9, + 3, + 8, + 0, + 8, + 7, + 1, + 9, + 3 + ], + "weighted_loads": [ + 0.07311377674341202, + 0.09288764372467995, + 0.09440150484442711, + 0.0, + 0.0, + 0.09007581323385239, + 0.21181597746908665, + 0.12856409139931202, + 0.03758673742413521, + 0.1584315225481987, + 0.025146640837192535, + 0.04533172771334648, + 0.13156084716320038, + 0.547775374725461, + 0.02304626628756523, + 0.1475682444870472, + 0.07815264910459518, + 0.10109302401542664, + 0.09399930015206337, + 0.16034792363643646, + 0.5356027781963348, + 0.06651386246085167, + 0.08038609847426414, + 0.14591002091765404, + 1.765459306538105, + 0.5855278596282005, + 0.29177020117640495, + 0.23111310601234436, + 0.0, + 0.18841289915144444, + 0.04243025928735733, + 0.9120960608124733, + 0.21837016381323338, + 0.06282881647348404, + 0.1583664994686842, + 0.06335107982158661, + 0.0, + 0.22248341888189316, + 0.11781443655490875, + 0.09240040928125381, + 0.12740136310458183, + 0.15098390728235245, + 0.17179842479526997, + 0.4189211744815111, + 0.09904703311622143, + 0.1742378007620573, + 0.06362330913543701, + 0.020175855606794357, + 0.1246020644903183, + 0.05615118518471718, + 0.32420292496681213, + 0.0, + 0.38968679308891296, + 0.08679372817277908, + 0.06970241852104664, + 1.095629334449768, + 0.1201397217810154, + 0.28309468924999237, + 0.0, + 0.2111059781163931, + 0.4018930420279503, + 0.021621420979499817, + 0.9637366905808449, + 0.09960393980145454 + ], + "unique_experts": 58, + "load_cv": 0.7851930289543896, + "normalized_load_entropy": 0.9225439636757846, + "max_load_share": 0.05952380952380952 + }, + "full_input": { + "tokens": 83, + "top_k": 6, + "decisions": 498, + "ordered_route_sha256": "ae3e18d63ffc17979bd7653a38a667dd1aa4a5bb79966803ab7df257ac430275", + "route_weight_sha256": "08a4b0fc6db6b31e0b1d0da41a8324073d964d53c7882a44e4278bb09e650a03", + "loads": [ + 4, + 2, + 5, + 2, + 5, + 3, + 6, + 8, + 22, + 6, + 7, + 3, + 5, + 9, + 2, + 17, + 1, + 9, + 5, + 6, + 11, + 6, + 7, + 8, + 17, + 13, + 29, + 5, + 0, + 9, + 2, + 16, + 6, + 3, + 6, + 1, + 1, + 4, + 5, + 6, + 3, + 17, + 7, + 13, + 4, + 16, + 4, + 5, + 8, + 2, + 16, + 4, + 13, + 2, + 7, + 13, + 12, + 19, + 2, + 19, + 9, + 5, + 9, + 7 + ], + "weighted_loads": [ + 0.27926284819841385, + 0.09288764372467995, + 0.25411443412303925, + 0.056250374764204025, + 0.28923224844038486, + 0.22790924832224846, + 0.3771690670400858, + 0.3949237186461687, + 1.2683231383562088, + 0.2066254187375307, + 0.3992833010852337, + 0.193367388099432, + 0.13156084716320038, + 0.6135656628757715, + 0.04801317676901817, + 0.9596771225333214, + 0.07815264910459518, + 0.34964954666793346, + 0.13327331095933914, + 0.2260444462299347, + 0.8261136636137962, + 0.29503724351525307, + 0.35082704573869705, + 0.20674818754196167, + 1.8372646905481815, + 0.7693702355027199, + 1.6045316886156797, + 0.32420848682522774, + 0.0, + 0.35098746977746487, + 0.12831757217645645, + 1.5388777181506157, + 0.3493059705942869, + 0.39466968178749084, + 0.1583664994686842, + 0.06335107982158661, + 0.25945332646369934, + 0.2562124989926815, + 0.11781443655490875, + 0.44615327939391136, + 0.12740136310458183, + 0.7900902032852173, + 0.37847630120813847, + 0.6172632873058319, + 0.25219479016959667, + 0.9770364854484797, + 0.0971883088350296, + 0.14995641075074673, + 0.2975067626684904, + 0.05615118518471718, + 0.6784462127834558, + 0.36525285243988037, + 0.6628764495253563, + 0.08679372817277908, + 0.16279743798077106, + 1.6430611237883568, + 0.4775724709033966, + 0.914047122001648, + 0.07534226402640343, + 0.9424128290265799, + 0.5172657985240221, + 0.2523535303771496, + 0.9637366905808449, + 0.591766681522131 + ], + "unique_experts": 63, + "load_cv": 0.7515836519236818, + "normalized_load_entropy": 0.9371970742832003, + "max_load_share": 0.05823293172690763 + } + }, + "s0_period": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "eb4fce4e9475ea476b43919971508ee19be3f6592497f20f6a286833cfdee98f", + "route_weight_sha256": "8440a2252cf339eb80bcdb5e43223a56c7cd2b51cd3b84062aacc238e5e78033", + "loads": [ + 2, + 2, + 2, + 0, + 1, + 1, + 4, + 5, + 1, + 5, + 3, + 1, + 6, + 6, + 1, + 5, + 2, + 4, + 2, + 5, + 6, + 3, + 3, + 7, + 15, + 8, + 4, + 3, + 1, + 5, + 1, + 8, + 4, + 1, + 6, + 1, + 0, + 3, + 5, + 1, + 3, + 4, + 3, + 10, + 1, + 5, + 2, + 1, + 7, + 1, + 8, + 0, + 8, + 2, + 2, + 9, + 4, + 8, + 0, + 11, + 8, + 0, + 9, + 3 + ], + "weighted_loads": [ + 0.10141846723854542, + 0.09420435130596161, + 0.08384974487125874, + 0.0, + 0.019177395850419998, + 0.09545590728521347, + 0.2318951077759266, + 0.15704157762229443, + 0.038625527173280716, + 0.18906955979764462, + 0.07639343664050102, + 0.02241344563663006, + 0.16274438053369522, + 0.49385111778974533, + 0.021035211160779, + 0.16200552694499493, + 0.09851688891649246, + 0.1377908829599619, + 0.04627658426761627, + 0.15146922133862972, + 0.45775474049150944, + 0.06812353059649467, + 0.07974493876099586, + 0.1744074709713459, + 1.971334669739008, + 0.5589770637452602, + 0.13147795014083385, + 0.22201046347618103, + 0.021992908790707588, + 0.137351606041193, + 0.04171070083975792, + 0.9156135395169258, + 0.2630706448107958, + 0.0653524249792099, + 0.16439932025969028, + 0.061091721057891846, + 0.0, + 0.23188765347003937, + 0.12385295145213604, + 0.09330891072750092, + 0.13738323003053665, + 0.146940428763628, + 0.14787532202899456, + 0.5036465935409069, + 0.028209075331687927, + 0.15698257833719254, + 0.03990973345935345, + 0.020103562623262405, + 0.1697392724454403, + 0.02985607087612152, + 0.21177424304187298, + 0.0, + 0.368364155292511, + 0.08776364848017693, + 0.041611529886722565, + 1.110806904733181, + 0.1860041841864586, + 0.2932921499013901, + 0.0, + 0.2927865795791149, + 0.4062330350279808, + 0.0, + 0.9855920895934105, + 0.09628629311919212 + ], + "unique_experts": 59, + "load_cv": 0.7966609581796574, + "normalized_load_entropy": 0.9224145838250833, + "max_load_share": 0.05952380952380952 + }, + "full_input": { + "tokens": 67, + "top_k": 6, + "decisions": 402, + "ordered_route_sha256": "9a99b832a6ff4b93c46a753fe386143b43d82b4926428eb4d24c9eb3b5583304", + "route_weight_sha256": "61cccf92b9da9f26d4722cd940de11d482e408b22daa1a54b45261fe5e52543f", + "loads": [ + 3, + 2, + 4, + 2, + 4, + 1, + 6, + 7, + 16, + 7, + 6, + 3, + 6, + 6, + 2, + 14, + 2, + 6, + 2, + 5, + 9, + 3, + 4, + 8, + 15, + 12, + 16, + 4, + 1, + 6, + 1, + 12, + 6, + 3, + 6, + 2, + 0, + 3, + 7, + 4, + 3, + 14, + 3, + 17, + 1, + 15, + 2, + 2, + 9, + 1, + 9, + 1, + 12, + 3, + 4, + 13, + 7, + 14, + 0, + 22, + 9, + 3, + 9, + 3 + ], + "weighted_loads": [ + 0.1949679497629404, + 0.09420435130596161, + 0.1695904303342104, + 0.055538421496748924, + 0.19312538765370846, + 0.09545590728521347, + 0.42719806358218193, + 0.4089877884835005, + 0.8391625676304102, + 0.23864627815783024, + 0.2552066072821617, + 0.18241543509066105, + 0.16274438053369522, + 0.49385111778974533, + 0.049199096858501434, + 0.7765833232551813, + 0.09851688891649246, + 0.25734358467161655, + 0.04627658426761627, + 0.15146922133862972, + 0.7882177401334047, + 0.06812353059649467, + 0.11001379787921906, + 0.20107903145253658, + 1.971334669739008, + 0.7122644316405058, + 0.9174327440559864, + 0.28754982352256775, + 0.021992908790707588, + 0.1635993141680956, + 0.04171070083975792, + 1.3152553886175156, + 0.41184808127582073, + 0.4579625874757767, + 0.16439932025969028, + 0.0823415257036686, + 0.0, + 0.23188765347003937, + 0.1749261748045683, + 0.3118858188390732, + 0.13738323003053665, + 0.5577223002910614, + 0.14787532202899456, + 0.6897972207516432, + 0.028209075331687927, + 0.9733136668801308, + 0.03990973345935345, + 0.041400447487831116, + 0.21452868916094303, + 0.02985607087612152, + 0.23788218572735786, + 0.05319558084011078, + 0.58613121509552, + 0.1137938778847456, + 0.08632968738675117, + 1.689055196940899, + 0.3787779398262501, + 0.6600262206047773, + 0.0, + 1.006394151598215, + 0.4967831149697304, + 0.1368556246161461, + 0.9855920895934105, + 0.09628629311919212 + ], + "unique_experts": 62, + "load_cv": 0.7962530753012729, + "normalized_load_entropy": 0.9267658153287638, + "max_load_share": 0.05472636815920398 + } + }, + "s1_period": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "013d597c39100139469071a6d539b90a177268de9865511bf477792a8bb9bb59", + "route_weight_sha256": "a28827cef14b0d68cd8211e7fc0951cf26a4f9e46e25a29123405f794212ac75", + "loads": [ + 1, + 2, + 2, + 0, + 0, + 1, + 4, + 5, + 1, + 4, + 1, + 2, + 5, + 7, + 1, + 4, + 2, + 2, + 5, + 6, + 7, + 3, + 3, + 6, + 15, + 8, + 9, + 3, + 0, + 7, + 1, + 10, + 4, + 1, + 6, + 1, + 0, + 3, + 5, + 1, + 3, + 4, + 2, + 7, + 3, + 5, + 3, + 1, + 5, + 2, + 8, + 0, + 8, + 2, + 3, + 9, + 3, + 8, + 0, + 9, + 7, + 0, + 9, + 3 + ], + "weighted_loads": [ + 0.07293027639389038, + 0.09474495984613895, + 0.09378525242209435, + 0.0, + 0.0, + 0.08933193981647491, + 0.21186936274170876, + 0.14747356809675694, + 0.03716478496789932, + 0.15880638174712658, + 0.025107592344284058, + 0.04515987075865269, + 0.13036193326115608, + 0.5479928757995367, + 0.023041531443595886, + 0.14754593931138515, + 0.09986766800284386, + 0.07277018576860428, + 0.1138229500502348, + 0.1874589528888464, + 0.5117520745843649, + 0.06730952672660351, + 0.08042148314416409, + 0.14616620168089867, + 1.7825992368161678, + 0.5842729583382607, + 0.2908926270902157, + 0.23154975473880768, + 0.0, + 0.18825068697333336, + 0.042289674282073975, + 0.9211692474782467, + 0.2168664988130331, + 0.06342420727014542, + 0.1590834241360426, + 0.06326816231012344, + 0.0, + 0.22331152856349945, + 0.11826756410300732, + 0.09219055622816086, + 0.1287636123597622, + 0.1501741260290146, + 0.12955822050571442, + 0.4188641831278801, + 0.09993830136954784, + 0.17534132301807404, + 0.06397280097007751, + 0.020340731367468834, + 0.12418205104768276, + 0.055620770901441574, + 0.32425418868660927, + 0.0, + 0.38904895447194576, + 0.08630676195025444, + 0.07200999744236469, + 1.0968161076307297, + 0.1218740213662386, + 0.2827253546565771, + 0.0, + 0.2351389043033123, + 0.40235885977745056, + 0.0, + 0.963941415771842, + 0.09970840252935886 + ], + "unique_experts": 57, + "load_cv": 0.7953949089757174, + "normalized_load_entropy": 0.9195377881175938, + "max_load_share": 0.05952380952380952 + }, + "full_input": { + "tokens": 83, + "top_k": 6, + "decisions": 498, + "ordered_route_sha256": "538645e4ac6e8c575e6a43cf455faf526bae125201533c86517dccf8aca52538", + "route_weight_sha256": "f22164ba260a59ec8c868cbf479822f55a1d6308cb0320f9269904459593ad05", + "loads": [ + 4, + 2, + 5, + 2, + 6, + 3, + 6, + 8, + 21, + 5, + 7, + 6, + 5, + 9, + 2, + 16, + 2, + 8, + 6, + 7, + 10, + 6, + 7, + 8, + 17, + 13, + 29, + 5, + 0, + 9, + 3, + 16, + 6, + 3, + 6, + 1, + 2, + 4, + 5, + 6, + 3, + 17, + 5, + 14, + 4, + 15, + 3, + 4, + 7, + 2, + 16, + 5, + 14, + 2, + 7, + 13, + 12, + 19, + 2, + 19, + 9, + 4, + 9, + 7 + ], + "weighted_loads": [ + 0.2787773832678795, + 0.09474495984613895, + 0.24330663681030273, + 0.05628420040011406, + 0.40903579629957676, + 0.227165374904871, + 0.3760794885456562, + 0.3642071485519409, + 1.2268331795930862, + 0.1821041014045477, + 0.39964204654097557, + 0.38222684524953365, + 0.13036193326115608, + 0.6151081267744303, + 0.047871336340904236, + 0.8492866102606058, + 0.09986766800284386, + 0.32168626599013805, + 0.15309696085751057, + 0.2531554754823446, + 0.8034839387983084, + 0.2959007956087589, + 0.350862430408597, + 0.2068671267479658, + 1.8544046208262444, + 0.7674008924514055, + 1.5941580962389708, + 0.3237816356122494, + 0.0, + 0.3508252575993538, + 0.14904033578932285, + 1.5487194173038006, + 0.3468612153083086, + 0.39440180361270905, + 0.1590834241360426, + 0.06326816231012344, + 0.28143387846648693, + 0.2570406086742878, + 0.11826756410300732, + 0.42709266394376755, + 0.1287636123597622, + 0.7581014707684517, + 0.3362360969185829, + 0.6389140412211418, + 0.2530860584229231, + 0.9434346295893192, + 0.06397280097007751, + 0.12832975573837757, + 0.27553185261785984, + 0.055620770901441574, + 0.6784558575600386, + 0.4082304500043392, + 0.696526899933815, + 0.08630676195025444, + 0.16510501690208912, + 1.6443864032626152, + 0.4824292976409197, + 0.9129046089947224, + 0.07534226402640343, + 0.8720570020377636, + 0.5177316162735224, + 0.22583432868123055, + 0.963941415771842, + 0.5918711442500353 + ], + "unique_experts": 63, + "load_cv": 0.7370216524053118, + "normalized_load_entropy": 0.9403480513031169, + "max_load_share": 0.05823293172690763 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 42, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.8242630385487528, + "mean_token_weighted_tv": 0.021485063358254376, + "aggregate_load_tv": 0.07936507936507936 + }, + "system_bos": { + "tokens": 42, + "ordered_topk_exact_tokens": 19, + "set_exact_tokens": 24, + "mean_set_jaccard": 0.8571428571428571, + "mean_token_weighted_tv": 0.020493726822591964, + "aggregate_load_tv": 0.07539682539682539 + }, + "system_x": { + "tokens": 42, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.8282312925170068, + "mean_token_weighted_tv": 0.025727137546276764, + "aggregate_load_tv": 0.0873015873015873 + }, + "system_period": { + "tokens": 42, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 22, + "mean_set_jaccard": 0.848639455782313, + "mean_token_weighted_tv": 0.02428064014141758, + "aggregate_load_tv": 0.08333333333333333 + }, + "bos_at_s0": { + "tokens": 42, + "ordered_topk_exact_tokens": 5, + "set_exact_tokens": 11, + "mean_set_jaccard": 0.6978458049886621, + "mean_token_weighted_tv": 0.04524270553762714, + "aggregate_load_tv": 0.1626984126984127 + }, + "bos_at_s1": { + "tokens": 42, + "ordered_topk_exact_tokens": 5, + "set_exact_tokens": 10, + "mean_set_jaccard": 0.6870748299319728, + "mean_token_weighted_tv": 0.04820440359236229, + "aggregate_load_tv": 0.16269841269841268 + }, + "x_at_s0": { + "tokens": 42, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 12, + "mean_set_jaccard": 0.717687074829932, + "mean_token_weighted_tv": 0.04222457909158298, + "aggregate_load_tv": 0.15476190476190474 + }, + "x_at_s1": { + "tokens": 42, + "ordered_topk_exact_tokens": 5, + "set_exact_tokens": 11, + "mean_set_jaccard": 0.7171201814058957, + "mean_token_weighted_tv": 0.045982394101364274, + "aggregate_load_tv": 0.1468253968253968 + }, + "period_at_s0": { + "tokens": 42, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 12, + "mean_set_jaccard": 0.7165532879818594, + "mean_token_weighted_tv": 0.04177110759718787, + "aggregate_load_tv": 0.15476190476190474 + }, + "period_at_s1": { + "tokens": 42, + "ordered_topk_exact_tokens": 4, + "set_exact_tokens": 11, + "mean_set_jaccard": 0.7222222222222223, + "mean_token_weighted_tv": 0.045327655372342894, + "aggregate_load_tv": 0.1468253968253968 + } + } + }, + "layer_02": { + "layer": 2, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "703259995058bec8c296b51428bb625d2ca8152f49e2c1585bae18fea3f0bfb6", + "route_weight_sha256": "fac705c1d43b874bf2992f8a15f3072aa234c816c3244c1cfd0eb0227eae5e09", + "loads": [ + 2, + 3, + 0, + 1, + 0, + 1, + 2, + 3, + 4, + 2, + 3, + 2, + 0, + 6, + 7, + 7, + 1, + 1, + 3, + 5, + 4, + 1, + 3, + 2, + 4, + 5, + 2, + 12, + 1, + 7, + 4, + 3, + 0, + 6, + 5, + 10, + 5, + 3, + 13, + 4, + 2, + 1, + 8, + 0, + 2, + 2, + 2, + 13, + 2, + 1, + 2, + 3, + 1, + 7, + 2, + 4, + 1, + 13, + 3, + 7, + 8, + 3, + 8, + 10 + ], + "weighted_loads": [ + 0.057293811812996864, + 0.10316574573516846, + 0.0, + 0.06038004159927368, + 0.0, + 0.030170634388923645, + 0.06096288003027439, + 0.1954619102180004, + 0.18355011194944382, + 0.04664691723883152, + 0.11383110657334328, + 0.06965981982648373, + 0.0, + 0.5666333362460136, + 0.28515628166496754, + 0.45744630694389343, + 0.03970187157392502, + 0.1348155289888382, + 0.1563386209309101, + 0.6888450719416142, + 0.10102802515029907, + 0.04282598942518234, + 0.4475126452744007, + 0.058526452630758286, + 0.12549962475895882, + 0.2203785926103592, + 0.13514211773872375, + 1.5703533850610256, + 0.028210695832967758, + 0.235343798995018, + 0.35280903428792953, + 0.11769610270857811, + 0.0, + 0.5404457002878189, + 0.328715693205595, + 0.7808388620615005, + 0.28607190400362015, + 0.5039847642183304, + 0.7673692684620619, + 0.1905648149549961, + 0.09361934661865234, + 0.027240147814154625, + 0.4848143085837364, + 0.0, + 0.06606047414243221, + 0.17309975251555443, + 0.12063180282711983, + 0.7543812114745378, + 0.20557058043777943, + 0.025705697014927864, + 0.05072329752147198, + 0.312985360622406, + 0.07803326100111008, + 0.23019620031118393, + 0.06689358502626419, + 0.11053729429841042, + 0.02376168593764305, + 1.1524212323129177, + 0.23006916046142578, + 0.2939280793070793, + 0.4437161684036255, + 0.21647639572620392, + 0.6224209573119879, + 0.5256526563316584 + ], + "unique_experts": 59, + "load_cv": 0.8493176013759839, + "normalized_load_entropy": 0.9174833800317614, + "max_load_share": 0.051587301587301584 + }, + "full_input": { + "tokens": 67, + "top_k": 6, + "decisions": 402, + "ordered_route_sha256": "ffe6850373943037737928b234834e4949f2863033cc15b639ec1cc583d4a474", + "route_weight_sha256": "dd6355921a76cd2d258074b9bf8cd578e317c20141b7fd7bc9a16bba58f4d243", + "loads": [ + 2, + 13, + 0, + 3, + 0, + 1, + 4, + 5, + 6, + 2, + 6, + 2, + 0, + 7, + 14, + 7, + 1, + 2, + 4, + 9, + 6, + 10, + 3, + 2, + 7, + 5, + 3, + 14, + 4, + 7, + 4, + 6, + 0, + 8, + 10, + 25, + 5, + 3, + 15, + 4, + 2, + 1, + 14, + 0, + 2, + 2, + 5, + 17, + 3, + 1, + 2, + 10, + 1, + 8, + 2, + 4, + 1, + 21, + 11, + 10, + 18, + 5, + 13, + 20 + ], + "weighted_loads": [ + 0.057293811812996864, + 1.0456805936992168, + 0.0, + 1.7588219046592712, + 0.0, + 0.030170634388923645, + 0.11458274349570274, + 0.29353343695402145, + 0.2648375369608402, + 0.04664691723883152, + 0.23946797475218773, + 0.06965981982648373, + 0.0, + 0.5941091906279325, + 0.5771214012056589, + 0.45744630694389343, + 0.03970187157392502, + 0.1355138340150006, + 0.1579251087969169, + 1.4243262745440006, + 0.41396455466747284, + 0.7359306402504444, + 0.4475126452744007, + 0.058526452630758286, + 0.2799834720790386, + 0.2203785926103592, + 0.13598899048520252, + 1.777050044387579, + 0.2736547626554966, + 0.235343798995018, + 0.35280903428792953, + 0.18838944454910234, + 0.0, + 0.6027808878570795, + 0.5526151992380619, + 2.715108759701252, + 0.28607190400362015, + 0.5039847642183304, + 0.8118326691910625, + 0.1905648149549961, + 0.09361934661865234, + 0.027240147814154625, + 1.1285975091159344, + 0.0, + 0.06606047414243221, + 0.17309975251555443, + 0.21494902670383453, + 0.9933347497135401, + 0.23123388551175594, + 0.025705697014927864, + 0.05072329752147198, + 1.1407815031707287, + 0.07803326100111008, + 0.23151291452813894, + 0.06689358502626419, + 0.11053729429841042, + 0.02376168593764305, + 1.6599847860634327, + 0.5943939164280891, + 0.4832424782216549, + 1.2706901710480452, + 0.30357714369893074, + 0.9949913546442986, + 1.175126338377595 + ], + "unique_experts": 59, + "load_cv": 0.909114648067344, + "normalized_load_entropy": 0.9061990283344193, + "max_load_share": 0.06218905472636816 + } + }, + "s1_eos": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "e1ab0aa6c8e97682cccd088ce0cef3edb8f24e1cd1288b9c28ec3699460befd9", + "route_weight_sha256": "8ebf3389d771592466f8eb034b400bfec31c70eb5990e0668ce0727465355f95", + "loads": [ + 2, + 3, + 1, + 1, + 0, + 1, + 2, + 3, + 4, + 2, + 4, + 2, + 0, + 5, + 6, + 7, + 1, + 1, + 3, + 5, + 4, + 2, + 3, + 2, + 3, + 5, + 2, + 12, + 1, + 7, + 3, + 2, + 1, + 5, + 5, + 10, + 5, + 3, + 13, + 4, + 2, + 1, + 8, + 0, + 2, + 2, + 2, + 13, + 3, + 2, + 1, + 3, + 2, + 6, + 1, + 5, + 0, + 14, + 3, + 7, + 8, + 3, + 8, + 11 + ], + "weighted_loads": [ + 0.05895318277180195, + 0.09497413411736488, + 0.02242174930870533, + 0.05975828692317009, + 0.0, + 0.027817534282803535, + 0.06105933338403702, + 0.18992079235613346, + 0.1787143386900425, + 0.04465504363179207, + 0.15306279063224792, + 0.07239221222698689, + 0.0, + 0.5734106581658125, + 0.2755247484892607, + 0.4630906246602535, + 0.038619264960289, + 0.13227906823158264, + 0.15816070511937141, + 0.7028201706707478, + 0.0980893112719059, + 0.08449247479438782, + 0.44403915852308273, + 0.06002519093453884, + 0.09816386923193932, + 0.21175101958215237, + 0.1357625238597393, + 1.6983187720179558, + 0.027764342725276947, + 0.24108095653355122, + 0.3272993341088295, + 0.0926729142665863, + 0.027120795100927353, + 0.5218256078660488, + 0.34543441981077194, + 0.7889617308974266, + 0.28420162573456764, + 0.5367290079593658, + 0.8010604251176119, + 0.179632056504488, + 0.09717382118105888, + 0.0254232008010149, + 0.48008332774043083, + 0.0, + 0.06407674960792065, + 0.1693263165652752, + 0.11497368291020393, + 0.7670414038002491, + 0.24017203971743584, + 0.05344076454639435, + 0.02405836619436741, + 0.349174864590168, + 0.09920071251690388, + 0.20102203637361526, + 0.03908549249172211, + 0.1315969992429018, + 0.0, + 1.2021666150540113, + 0.22900089621543884, + 0.28896744176745415, + 0.4309200085699558, + 0.20984691008925438, + 0.646925600245595, + 0.598250824958086 + ], + "unique_experts": 60, + "load_cv": 0.8528700083815675, + "normalized_load_entropy": 0.9199221634670945, + "max_load_share": 0.05555555555555555 + }, + "full_input": { + "tokens": 83, + "top_k": 6, + "decisions": 498, + "ordered_route_sha256": "6c68aa44d44a778cace1fd6063a3efb67b931129a2b9839487a5c23656a82158", + "route_weight_sha256": "92c0282b789b46b836d6fcb2a2c5f902caabe5bda12c518a882ea90f5bda5f59", + "loads": [ + 6, + 14, + 2, + 4, + 1, + 2, + 3, + 7, + 12, + 3, + 11, + 2, + 0, + 8, + 17, + 8, + 3, + 2, + 4, + 11, + 6, + 13, + 4, + 2, + 9, + 6, + 3, + 15, + 6, + 7, + 4, + 6, + 1, + 7, + 14, + 27, + 5, + 4, + 18, + 7, + 2, + 1, + 17, + 2, + 5, + 2, + 10, + 20, + 5, + 3, + 2, + 12, + 3, + 10, + 1, + 5, + 5, + 22, + 5, + 15, + 18, + 8, + 17, + 24 + ], + "weighted_loads": [ + 0.5791156347841024, + 1.102297816425562, + 0.0477968193590641, + 1.7923556379973888, + 0.030264263972640038, + 0.16819644160568714, + 0.08579758368432522, + 0.35207257978618145, + 0.7988023944199085, + 0.16185935959219933, + 0.45829878747463226, + 0.07239221222698689, + 0.0, + 0.6219361710245721, + 0.8275707978755236, + 0.4952970780432224, + 0.1027379184961319, + 0.13286410691216588, + 0.159545244066976, + 1.4809913821518421, + 0.38699600473046303, + 0.8772121574729681, + 0.4825752079486847, + 0.06002519093453884, + 0.37457992881536484, + 0.26211156882345676, + 0.13659040117636323, + 2.299166090786457, + 0.2801151107996702, + 0.24108095653355122, + 0.3610362783074379, + 0.20109913125634193, + 0.027120795100927353, + 0.5890393890440464, + 0.7136579137295485, + 2.4997713826596737, + 0.28420162573456764, + 0.5784997753798962, + 0.9406178882345557, + 0.5360743552446365, + 0.09717382118105888, + 0.0254232008010149, + 1.5725240036845207, + 0.20983300916850567, + 0.7080445121973753, + 0.1693263165652752, + 0.7541748192161322, + 1.133708419278264, + 0.3089887145906687, + 0.0968354232609272, + 0.050373828038573265, + 1.4557038620114326, + 0.2757182586938143, + 0.3861525651300326, + 0.03908549249172211, + 0.1315969992429018, + 0.28347745537757874, + 1.6344431601464748, + 0.33956129103899, + 0.7448296714574099, + 1.1061038058251143, + 0.5744346007704735, + 1.4306070487946272, + 1.671168889850378 + ], + "unique_experts": 63, + "load_cv": 0.8100810768727044, + "normalized_load_entropy": 0.9260913995555945, + "max_load_share": 0.05421686746987952 + } + }, + "s0_bos": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "b0446c3a7a41d6e62ed3f8fca6a2370fa99cbef176d003dc64321d4f6cda30eb", + "route_weight_sha256": "3886c97e491aef07311e8510f779748322b220e60b104aee699439914b6c1efc", + "loads": [ + 1, + 4, + 0, + 4, + 0, + 1, + 3, + 2, + 4, + 1, + 3, + 2, + 0, + 4, + 4, + 6, + 2, + 1, + 3, + 5, + 6, + 1, + 3, + 2, + 3, + 5, + 2, + 12, + 2, + 4, + 4, + 3, + 1, + 4, + 5, + 10, + 5, + 3, + 13, + 4, + 2, + 0, + 8, + 1, + 2, + 2, + 6, + 11, + 1, + 0, + 3, + 4, + 1, + 7, + 2, + 4, + 2, + 15, + 3, + 7, + 10, + 3, + 8, + 8 + ], + "weighted_loads": [ + 0.027634205296635628, + 0.15766440518200397, + 0.0, + 0.13650251552462578, + 0.0, + 0.025644438341259956, + 0.08944268152117729, + 0.1646573729813099, + 0.18073423951864243, + 0.025172242894768715, + 0.1089782603085041, + 0.06942038610577583, + 0.0, + 0.5178569778800011, + 0.15478640981018543, + 0.4068403262645006, + 0.0652750339359045, + 0.13594800233840942, + 0.13811783865094185, + 0.6573171392083168, + 0.16667654924094677, + 0.03771067410707474, + 0.43533288314938545, + 0.055449290201067924, + 0.1037353053689003, + 0.21670756302773952, + 0.14878620579838753, + 1.4344845451414585, + 0.05663156323134899, + 0.14093594066798687, + 0.3632979542016983, + 0.11789464950561523, + 0.03275315463542938, + 0.42610687389969826, + 0.2908064164221287, + 0.7832927852869034, + 0.3118020221590996, + 0.6592587977647781, + 0.7052831295877695, + 0.20637474209070206, + 0.09105509892106056, + 0.0, + 0.48260158114135265, + 0.024336274713277817, + 0.04767592437565327, + 0.17435257881879807, + 0.2265691477805376, + 0.6654275003820658, + 0.17084433138370514, + 0.0, + 0.08223058469593525, + 0.3599061667919159, + 0.07255784422159195, + 0.2420886941254139, + 0.06966505758464336, + 0.12194590643048286, + 0.04669361561536789, + 1.327225236222148, + 0.22518939524888992, + 0.33481269143521786, + 0.4646942503750324, + 0.19436763226985931, + 0.6562860421836376, + 0.3750221449881792 + ], + "unique_experts": 59, + "load_cv": 0.8301147215868497, + "normalized_load_entropy": 0.922112351123966, + "max_load_share": 0.05952380952380952 + }, + "full_input": { + "tokens": 67, + "top_k": 6, + "decisions": 402, + "ordered_route_sha256": "aa3b63e15069068cc1da96ca1792677bba015cfd2d491a187b4ebd13c89eb429", + "route_weight_sha256": "096b3505738b13cb32ce04701c178bd96344b82fbb701295f5f8bb6daf3d2c92", + "loads": [ + 1, + 14, + 0, + 5, + 0, + 1, + 5, + 4, + 7, + 1, + 6, + 2, + 1, + 5, + 8, + 6, + 3, + 1, + 3, + 9, + 8, + 10, + 3, + 2, + 5, + 5, + 2, + 14, + 5, + 4, + 4, + 5, + 1, + 6, + 10, + 26, + 5, + 3, + 16, + 4, + 2, + 0, + 15, + 1, + 2, + 2, + 9, + 15, + 2, + 0, + 3, + 11, + 1, + 7, + 2, + 4, + 2, + 24, + 11, + 10, + 20, + 5, + 15, + 19 + ], + "weighted_loads": [ + 0.027634205296635628, + 1.1001792531460524, + 0.0, + 0.8621573559939861, + 0.0, + 0.025644438341259956, + 0.14095187187194824, + 0.25755201652646065, + 0.28805456310510635, + 0.025172242894768715, + 0.23461512848734856, + 0.06942038610577583, + 0.031981877982616425, + 0.5438228901475668, + 0.35139584355056286, + 0.4068403262645006, + 0.09533981047570705, + 0.13594800233840942, + 0.13811783865094185, + 1.344514362514019, + 0.45784577541053295, + 0.7418324649333954, + 0.43533288314938545, + 0.055449290201067924, + 0.2134627252817154, + 0.21670756302773952, + 0.14878620579838753, + 1.6503846533596516, + 0.3432942535728216, + 0.14093594066798687, + 0.3632979542016983, + 0.18487535417079926, + 0.03275315463542938, + 0.48459881730377674, + 0.5147059224545956, + 2.795118696987629, + 0.3118020221590996, + 0.6592587977647781, + 0.8378780772909522, + 0.20637474209070206, + 0.09105509892106056, + 0.0, + 1.1899256464093924, + 0.024336274713277817, + 0.04767592437565327, + 0.17435257881879807, + 0.3217953834682703, + 0.905353618785739, + 0.19650763645768166, + 0.0, + 0.08223058469593525, + 1.0972293876111507, + 0.07255784422159195, + 0.2420886941254139, + 0.06966505758464336, + 0.12194590643048286, + 0.04669361561536789, + 1.8521557841449976, + 0.5895141512155533, + 0.4700846578925848, + 1.291668253019452, + 0.28146838024258614, + 1.196179235354066, + 1.2942719925194979 + ], + "unique_experts": 60, + "load_cv": 0.9424808180140577, + "normalized_load_entropy": 0.9033953415035832, + "max_load_share": 0.06467661691542288 + } + }, + "s1_bos": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "2e6887a287fc0cde31926d338704470cb392ff641c4906e84ec7e5d10fbd3067", + "route_weight_sha256": "28b5631019794bc0767289f73236974d012f0775fa52fb84908afb1a7d532d29", + "loads": [ + 1, + 5, + 1, + 3, + 0, + 1, + 3, + 2, + 4, + 1, + 4, + 2, + 0, + 4, + 5, + 6, + 1, + 1, + 2, + 5, + 6, + 2, + 3, + 2, + 4, + 5, + 2, + 12, + 1, + 5, + 4, + 3, + 1, + 3, + 4, + 11, + 5, + 3, + 13, + 4, + 2, + 0, + 8, + 1, + 1, + 2, + 3, + 13, + 2, + 0, + 2, + 3, + 1, + 7, + 1, + 4, + 2, + 16, + 3, + 7, + 9, + 3, + 8, + 10 + ], + "weighted_loads": [ + 0.029600009322166443, + 0.1732675489038229, + 0.019829532131552696, + 0.11015192605555058, + 0.0, + 0.025331629440188408, + 0.08882772363722324, + 0.15103312954306602, + 0.17295046150684357, + 0.02518896944820881, + 0.1496756300330162, + 0.08233470842242241, + 0.0, + 0.5278172083199024, + 0.1722918301820755, + 0.4238204322755337, + 0.03698301315307617, + 0.12305617332458496, + 0.10320097953081131, + 0.6833708621561527, + 0.16028810292482376, + 0.07170328125357628, + 0.4568457119166851, + 0.05666721612215042, + 0.12729647010564804, + 0.20335835590958595, + 0.1525343433022499, + 1.5984345078468323, + 0.03056981787085533, + 0.1669616922736168, + 0.3856884799897671, + 0.12025005929172039, + 0.034322820603847504, + 0.41888609528541565, + 0.2872744258493185, + 0.8457786291837692, + 0.30110935121774673, + 0.7169139832258224, + 0.7285966295748949, + 0.19024822488427162, + 0.10445591062307358, + 0.0, + 0.4975797161459923, + 0.025807946920394897, + 0.023808585479855537, + 0.17423731088638306, + 0.12795582599937916, + 0.7450639456510544, + 0.1987451333552599, + 0.0, + 0.05950216017663479, + 0.356497123837471, + 0.06642036885023117, + 0.23530867882072926, + 0.042407047003507614, + 0.12281499803066254, + 0.045921724289655685, + 1.3934019412845373, + 0.22676176205277443, + 0.31592193245887756, + 0.44501266069710255, + 0.18689442798495293, + 0.6481641717255116, + 0.47214109264314175 + ], + "unique_experts": 60, + "load_cv": 0.8807736126352433, + "normalized_load_entropy": 0.9164761689742568, + "max_load_share": 0.06349206349206349 + }, + "full_input": { + "tokens": 83, + "top_k": 6, + "decisions": 498, + "ordered_route_sha256": "588bfccc79b893a778235e6cee6c99514f1d0a365ccd7fd72b4731dc68bc5ae1", + "route_weight_sha256": "bb44f9e3cc8553862a60349b99b53c88c56e52099dfead05c3002c40e95ca5bd", + "loads": [ + 5, + 16, + 2, + 6, + 1, + 2, + 4, + 6, + 13, + 2, + 11, + 2, + 1, + 6, + 15, + 7, + 4, + 1, + 2, + 11, + 8, + 13, + 4, + 2, + 9, + 6, + 2, + 15, + 6, + 5, + 5, + 7, + 1, + 5, + 13, + 29, + 5, + 4, + 18, + 7, + 2, + 0, + 18, + 3, + 4, + 2, + 11, + 20, + 4, + 1, + 3, + 12, + 2, + 10, + 1, + 4, + 7, + 23, + 5, + 15, + 19, + 8, + 20, + 23 + ], + "weighted_loads": [ + 0.5497624613344669, + 1.18059123121202, + 0.04520460218191147, + 0.899927431717515, + 0.030264263972640038, + 0.165710536763072, + 0.11181552149355412, + 0.30772876366972923, + 0.826711617410183, + 0.14239328540861607, + 0.45491162687540054, + 0.08233470842242241, + 0.027555864304304123, + 0.5734006185084581, + 0.6763994544744492, + 0.4560268856585026, + 0.12984912283718586, + 0.12305617332458496, + 0.10320097953081131, + 1.3971290178596973, + 0.4354991689324379, + 0.8870160151273012, + 0.49538176134228706, + 0.05666721612215042, + 0.36630385741591454, + 0.25371890515089035, + 0.1525343433022499, + 2.216368645429611, + 0.3398474957793951, + 0.1669616922736168, + 0.4194254241883755, + 0.22350208461284637, + 0.034322820603847504, + 0.48257075995206833, + 0.655497919768095, + 2.65705843269825, + 0.30110935121774673, + 0.7586847506463528, + 0.9505183016881347, + 0.5466905236244202, + 0.10445591062307358, + 0.0, + 1.644187642261386, + 0.23288720846176147, + 0.6677763480693102, + 0.17423731088638306, + 0.767535287886858, + 1.1098557505756617, + 0.26756180822849274, + 0.04339465871453285, + 0.08581762202084064, + 1.457239806652069, + 0.24293791502714157, + 0.4193458538502455, + 0.042407047003507614, + 0.12281499803066254, + 0.3293991796672344, + 1.7728257980197668, + 0.3373221568763256, + 0.723570941016078, + 1.120196457952261, + 0.551482118666172, + 1.5602807868272066, + 1.725246200338006 + ], + "unique_experts": 63, + "load_cv": 0.8483597103576372, + "normalized_load_entropy": 0.9193546053695167, + "max_load_share": 0.05823293172690763 + } + }, + "s0_x": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "e297161f114ba17649a3d3188b227443ae0d105db7dc73aee5a9f9ff60788125", + "route_weight_sha256": "ea6170c07d42b6a2ee85a567d1199c68cd7a9238045ebe4be2888c0da757a509", + "loads": [ + 1, + 5, + 0, + 4, + 0, + 1, + 3, + 3, + 4, + 1, + 3, + 2, + 0, + 4, + 6, + 7, + 1, + 1, + 3, + 5, + 6, + 1, + 3, + 2, + 3, + 5, + 2, + 12, + 1, + 4, + 4, + 2, + 1, + 5, + 5, + 10, + 5, + 3, + 13, + 4, + 2, + 0, + 8, + 1, + 1, + 2, + 6, + 13, + 1, + 0, + 1, + 4, + 1, + 7, + 1, + 4, + 3, + 15, + 3, + 7, + 8, + 3, + 8, + 8 + ], + "weighted_loads": [ + 0.027366111055016518, + 0.19067519903182983, + 0.0, + 0.13447361439466476, + 0.0, + 0.02534128911793232, + 0.08434252999722958, + 0.1894000694155693, + 0.18993930146098137, + 0.025723770260810852, + 0.10358753055334091, + 0.06762250699102879, + 0.0, + 0.49023606814444065, + 0.20957822911441326, + 0.43966275081038475, + 0.04109393060207367, + 0.13762648403644562, + 0.14928600937128067, + 0.6422669366002083, + 0.16266319900751114, + 0.03786608949303627, + 0.4269346073269844, + 0.05647130310535431, + 0.1052720807492733, + 0.22208472713828087, + 0.14586452022194862, + 1.4141031429171562, + 0.03000796213746071, + 0.13643847219645977, + 0.3568866029381752, + 0.06653391756117344, + 0.03206424042582512, + 0.4728468917310238, + 0.28477438166737556, + 0.7780265882611275, + 0.3069463297724724, + 0.6002919524908066, + 0.6958477944135666, + 0.20879145711660385, + 0.09096163511276245, + 0.0, + 0.4748008567839861, + 0.02424984611570835, + 0.022792736068367958, + 0.16882843151688576, + 0.23631149716675282, + 0.747843449935317, + 0.1739029437303543, + 0.0, + 0.03168974816799164, + 0.35608688183128834, + 0.07433582097291946, + 0.24336978048086166, + 0.04090666398406029, + 0.11531651206314564, + 0.07269501686096191, + 1.2598790731281042, + 0.22374530881643295, + 0.34134899266064167, + 0.40075658820569515, + 0.20548992604017258, + 0.6875111125409603, + 0.35894449427723885 + ], + "unique_experts": 59, + "load_cv": 0.8587580314110463, + "normalized_load_entropy": 0.9156947234882337, + "max_load_share": 0.05952380952380952 + }, + "full_input": { + "tokens": 67, + "top_k": 6, + "decisions": 402, + "ordered_route_sha256": "1be4b57259e25dac1b3e87f55f485234d4e0bf920d793c8f391133c0c8e34ab3", + "route_weight_sha256": "91fe730872332e41dcbe08f963bc54f9e6e64edeeb5b7e174f687dee56b6a246", + "loads": [ + 1, + 15, + 0, + 5, + 0, + 1, + 5, + 5, + 7, + 1, + 8, + 3, + 1, + 5, + 10, + 7, + 2, + 1, + 3, + 9, + 8, + 11, + 3, + 2, + 5, + 5, + 2, + 14, + 4, + 4, + 4, + 4, + 1, + 7, + 10, + 25, + 5, + 3, + 15, + 4, + 2, + 1, + 14, + 1, + 1, + 2, + 9, + 18, + 2, + 0, + 1, + 10, + 1, + 7, + 1, + 4, + 3, + 22, + 12, + 10, + 19, + 5, + 14, + 18 + ], + "weighted_loads": [ + 0.027366111055016518, + 1.1331900469958782, + 0.0, + 0.8601284548640251, + 0.0, + 0.02534128911793232, + 0.14369565434753895, + 0.2845242992043495, + 0.3041391782462597, + 0.025723770260810852, + 0.33756524324417114, + 0.10252446867525578, + 0.03005734458565712, + 0.5141311846673489, + 0.4063743520528078, + 0.43966275081038475, + 0.0722015667706728, + 0.13762648403644562, + 0.14928600937128067, + 1.3476140722632408, + 0.4646337553858757, + 1.0398363806307316, + 0.4269346073269844, + 0.05647130310535431, + 0.21523553878068924, + 0.22208472713828087, + 0.14586452022194862, + 1.6332475766539574, + 0.31828046403825283, + 0.13643847219645977, + 0.3568866029381752, + 0.13221183232963085, + 0.03206424042582512, + 0.5332968719303608, + 0.5086738876998425, + 2.7374339401721954, + 0.3069463297724724, + 0.6002919524908066, + 0.7403111951425672, + 0.20879145711660385, + 0.09096163511276245, + 0.024320751428604126, + 1.1019333694130182, + 0.02424984611570835, + 0.022792736068367958, + 0.16882843151688576, + 0.3313020747154951, + 1.0183485466986895, + 0.19956624880433083, + 0.0, + 0.03168974816799164, + 1.0114326383918524, + 0.07433582097291946, + 0.24336978048086166, + 0.04090666398406029, + 0.11531651206314564, + 0.07269501686096191, + 1.707297282293439, + 0.7167553454637527, + 0.47488086856901646, + 1.2805245332419872, + 0.2925906740128994, + 1.1856086365878582, + 0.9923881143331528 + ], + "unique_experts": 61, + "load_cv": 0.9246640411630992, + "normalized_load_entropy": 0.9043568662265628, + "max_load_share": 0.06218905472636816 + } + }, + "s1_x": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "361d0f2ff1e3b6e4b99386ba67f34c0aee9a08555b208879413766ea2f7dbab6", + "route_weight_sha256": "fdbdbb1925927cf8c3d5fbb1d81d35cfdc1bac790e2da2e561a36140580a6c46", + "loads": [ + 2, + 4, + 0, + 3, + 0, + 1, + 3, + 3, + 4, + 1, + 4, + 2, + 0, + 4, + 5, + 7, + 1, + 1, + 3, + 5, + 6, + 2, + 3, + 2, + 3, + 5, + 2, + 12, + 1, + 4, + 4, + 2, + 1, + 4, + 4, + 10, + 5, + 3, + 14, + 4, + 2, + 0, + 8, + 1, + 1, + 2, + 3, + 14, + 1, + 0, + 1, + 3, + 1, + 7, + 2, + 3, + 3, + 16, + 3, + 7, + 9, + 3, + 8, + 10 + ], + "weighted_loads": [ + 0.05918470211327076, + 0.148212980479002, + 0.0, + 0.10907468572258949, + 0.0, + 0.026002390310168266, + 0.08494412712752819, + 0.17061686888337135, + 0.18135164864361286, + 0.025490259751677513, + 0.14682382717728615, + 0.08471522107720375, + 0.0, + 0.5148063283413649, + 0.16928418166935444, + 0.46918661892414093, + 0.0354091078042984, + 0.12203831970691681, + 0.14348526298999786, + 0.664149560034275, + 0.1572183035314083, + 0.07153137773275375, + 0.4516407400369644, + 0.058034872636199, + 0.09952602162957191, + 0.202778622508049, + 0.15213171765208244, + 1.5907486900687218, + 0.029678400605916977, + 0.13877410627901554, + 0.3887527622282505, + 0.06962230242788792, + 0.034686680883169174, + 0.4526285082101822, + 0.2893795557320118, + 0.833501510322094, + 0.29400690644979477, + 0.695145308971405, + 0.7549732979387045, + 0.18409427627921104, + 0.10552947968244553, + 0.0, + 0.5021576248109341, + 0.02539900690317154, + 0.0239711944013834, + 0.17041979730129242, + 0.13345318287611008, + 0.8052204176783562, + 0.1737060844898224, + 0.0, + 0.03572731837630272, + 0.3562399595975876, + 0.0671563372015953, + 0.23732767440378666, + 0.06627084128558636, + 0.0915080439299345, + 0.06917131319642067, + 1.344131438061595, + 0.22382955998182297, + 0.316935695707798, + 0.44732725620269775, + 0.19849419221282005, + 0.6744073070585728, + 0.45954308845102787 + ], + "unique_experts": 59, + "load_cv": 0.8977730630082078, + "normalized_load_entropy": 0.9133365331954862, + "max_load_share": 0.06349206349206349 + }, + "full_input": { + "tokens": 83, + "top_k": 6, + "decisions": 498, + "ordered_route_sha256": "4a7846efc69674accd34ed7a01398664060b90f110592dbb28ba3bf9fbf57ac4", + "route_weight_sha256": "ad53069e4f8fea6aa8ed20be96e0832474cfe74adb6b44a75b0233c648ac5ca2", + "loads": [ + 6, + 15, + 1, + 5, + 1, + 2, + 4, + 7, + 13, + 2, + 13, + 3, + 1, + 5, + 14, + 8, + 4, + 1, + 3, + 11, + 8, + 14, + 4, + 2, + 8, + 6, + 2, + 15, + 6, + 4, + 5, + 6, + 2, + 6, + 13, + 28, + 5, + 4, + 18, + 7, + 2, + 0, + 17, + 3, + 4, + 2, + 11, + 22, + 3, + 1, + 2, + 11, + 2, + 10, + 2, + 3, + 8, + 23, + 6, + 15, + 20, + 8, + 19, + 22 + ], + "weighted_loads": [ + 0.5793471541255713, + 1.155536662787199, + 0.025375070050358772, + 0.8662605620920658, + 0.030264263972640038, + 0.16638129763305187, + 0.10661749355494976, + 0.327453151345253, + 0.8402343075722456, + 0.14269457571208477, + 0.5658143274486065, + 0.11976270005106926, + 0.026353416964411736, + 0.5389263071119785, + 0.643524156883359, + 0.5013930723071098, + 0.13339035958051682, + 0.12203831970691681, + 0.14348526298999786, + 1.3903406336903572, + 0.4342840127646923, + 1.169347731396556, + 0.4901767894625664, + 0.058034872636199, + 0.33791301026940346, + 0.2531391717493534, + 0.15213171765208244, + 2.211564637720585, + 0.34578643180429935, + 0.13877410627901554, + 0.4224897064268589, + 0.17006448842585087, + 0.0636065173894167, + 0.5164127964526415, + 0.6576030496507883, + 2.608262024819851, + 0.29400690644979477, + 0.7369160763919353, + 0.861774074845016, + 0.5405365750193596, + 0.10552947968244553, + 0.0, + 1.5900994427502155, + 0.2314852625131607, + 0.667938956990838, + 0.17041979730129242, + 0.7729917280375957, + 1.1983802020549774, + 0.24252275936305523, + 0.04339465871453285, + 0.062042780220508575, + 1.3735452368855476, + 0.2436738833785057, + 0.4213648494333029, + 0.06627084128558636, + 0.0915080439299345, + 0.3526487685739994, + 1.7179473731666803, + 0.440353661775589, + 0.7256551962345839, + 1.1685785856097937, + 0.5630818828940392, + 1.5293905679136515, + 1.4684130679816008 + ], + "unique_experts": 63, + "load_cv": 0.8404136242095916, + "normalized_load_entropy": 0.9206275431150637, + "max_load_share": 0.05622489959839357 + } + }, + "s0_period": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "7c2f3bf4494b8a0025f9807004e7987b51bf33efdcdfdd1bb8435e90344a1265", + "route_weight_sha256": "0ce20357d5ea46867d8733c518d71a94ff598721a6e2002d1024025ce205725f", + "loads": [ + 1, + 4, + 0, + 3, + 0, + 1, + 3, + 3, + 4, + 1, + 3, + 2, + 0, + 4, + 6, + 7, + 1, + 1, + 3, + 5, + 6, + 2, + 3, + 2, + 3, + 5, + 2, + 12, + 1, + 4, + 4, + 2, + 1, + 5, + 5, + 10, + 5, + 3, + 13, + 4, + 2, + 0, + 8, + 1, + 1, + 2, + 6, + 13, + 1, + 0, + 1, + 4, + 1, + 7, + 2, + 4, + 3, + 14, + 3, + 7, + 9, + 3, + 8, + 8 + ], + "weighted_loads": [ + 0.027077697217464447, + 0.1542482227087021, + 0.0, + 0.11048908159136772, + 0.0, + 0.025816846638917923, + 0.08422505296766758, + 0.1894453689455986, + 0.19283685460686684, + 0.02528253383934498, + 0.10424409434199333, + 0.06792835704982281, + 0.0, + 0.48626795038580894, + 0.20300398394465446, + 0.44516022875905037, + 0.04109662398695946, + 0.1373646855354309, + 0.15068405866622925, + 0.6461827270686626, + 0.16277030110359192, + 0.07240960374474525, + 0.42886679247021675, + 0.05663151107728481, + 0.10442933812737465, + 0.22253425046801567, + 0.14385810121893883, + 1.3999191708862782, + 0.02994668297469616, + 0.13622680492699146, + 0.3553395252674818, + 0.06535840965807438, + 0.03233560919761658, + 0.4696190059185028, + 0.2832673080265522, + 0.7788805514574051, + 0.30717476829886436, + 0.5840971916913986, + 0.6925141680985689, + 0.20894823968410492, + 0.09206709638237953, + 0.0, + 0.47951333597302437, + 0.02421453408896923, + 0.022742893546819687, + 0.16840044036507607, + 0.23961266502738, + 0.7477489896118641, + 0.1732935756444931, + 0.0, + 0.031819626688957214, + 0.3542333357036114, + 0.07593397796154022, + 0.24071163311600685, + 0.06537758186459541, + 0.11600187979638577, + 0.07342354580760002, + 1.2063021808862686, + 0.22293918207287788, + 0.3365957122296095, + 0.43158925883471966, + 0.21205177903175354, + 0.69611044973135, + 0.35950566455721855 + ], + "unique_experts": 59, + "load_cv": 0.8457502733179187, + "normalized_load_entropy": 0.9180927512558353, + "max_load_share": 0.05555555555555555 + }, + "full_input": { + "tokens": 67, + "top_k": 6, + "decisions": 402, + "ordered_route_sha256": "ca2ec99bb5ea5ddcf5d4d31ec5dc4d6d20014e3dc79a61cce02587fa6ed5487a", + "route_weight_sha256": "2fbdd1a044b71af593788c9ca5d81f9c2c2186222f7650c5110ea08f04a1d841", + "loads": [ + 2, + 14, + 0, + 5, + 0, + 1, + 4, + 5, + 8, + 1, + 6, + 2, + 0, + 5, + 10, + 8, + 1, + 1, + 3, + 9, + 8, + 11, + 3, + 2, + 6, + 5, + 2, + 14, + 4, + 4, + 4, + 4, + 1, + 8, + 10, + 24, + 5, + 3, + 16, + 4, + 2, + 1, + 14, + 1, + 1, + 2, + 10, + 18, + 3, + 0, + 1, + 10, + 1, + 7, + 2, + 4, + 3, + 21, + 11, + 10, + 21, + 5, + 14, + 17 + ], + "weighted_loads": [ + 0.3201398178935051, + 1.0967630706727505, + 0.0, + 0.8690597973763943, + 0.0, + 0.025816846638917923, + 0.10851351730525494, + 0.284286804497242, + 0.3532336540520191, + 0.02528253383934498, + 0.22988096252083778, + 0.06792835704982281, + 0.0, + 0.5100268982350826, + 0.4001227356493473, + 0.4900345876812935, + 0.04109662398695946, + 0.1373646855354309, + 0.15068405866622925, + 1.3763298355042934, + 0.40704022347927094, + 0.9429331161081791, + 0.42886679247021675, + 0.05663151107728481, + 0.24448499456048012, + 0.22253425046801567, + 0.14385810121893883, + 1.6198676340281963, + 0.28545134514570236, + 0.13622680492699146, + 0.3553395252674818, + 0.13058901391923428, + 0.03233560919761658, + 0.5777638778090477, + 0.5071668140590191, + 2.676442250609398, + 0.30717476829886436, + 0.5840971916913986, + 0.796182936988771, + 0.20894823968410492, + 0.09206709638237953, + 0.024031657725572586, + 1.1129288263618946, + 0.02421453408896923, + 0.022742893546819687, + 0.16840044036507607, + 0.36059307120740414, + 1.0211484096944332, + 0.22521465457975864, + 0.0, + 0.031819626688957214, + 0.9917846731841564, + 0.07593397796154022, + 0.24071163311600685, + 0.06537758186459541, + 0.11600187979638577, + 0.07342354580760002, + 1.6520263962447643, + 0.5872639380395412, + 0.47347248531877995, + 1.3174286633729935, + 0.29915252700448036, + 1.1923994366079569, + 0.9498445857316256 + ], + "unique_experts": 60, + "load_cv": 0.9186483302032844, + "normalized_load_entropy": 0.9040681649791069, + "max_load_share": 0.05970149253731343 + } + }, + "s1_period": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "ea19ad97a1100fd75aae425fc281ba96d375d8790f293b44648391b6e05bb647", + "route_weight_sha256": "929772c5f9d7590b6c0db740372513beab74c950bc89353fc1f8cb28047439ea", + "loads": [ + 2, + 4, + 0, + 2, + 0, + 1, + 3, + 3, + 4, + 1, + 4, + 2, + 0, + 4, + 5, + 7, + 1, + 1, + 3, + 5, + 6, + 2, + 3, + 2, + 3, + 5, + 2, + 12, + 1, + 4, + 4, + 2, + 1, + 4, + 4, + 10, + 5, + 3, + 14, + 4, + 2, + 0, + 8, + 1, + 1, + 2, + 3, + 14, + 1, + 0, + 2, + 3, + 1, + 7, + 2, + 3, + 3, + 16, + 3, + 7, + 9, + 3, + 8, + 10 + ], + "weighted_loads": [ + 0.05763760954141617, + 0.14276167936623096, + 0.0, + 0.08508024364709854, + 0.0, + 0.026320818811655045, + 0.08538298308849335, + 0.17178169824182987, + 0.18190082721412182, + 0.025029726326465607, + 0.1477491296827793, + 0.08457670360803604, + 0.0, + 0.5116843488067389, + 0.16421150229871273, + 0.46995252557098866, + 0.03566940873861313, + 0.12110652029514313, + 0.14379902929067612, + 0.664733748883009, + 0.1574146319180727, + 0.07183123379945755, + 0.44933051988482475, + 0.057931747287511826, + 0.09845237247645855, + 0.2037928570061922, + 0.15168984606862068, + 1.6071989201009274, + 0.029693134129047394, + 0.13931488804519176, + 0.38500979728996754, + 0.07010878995060921, + 0.034173086285591125, + 0.4524093568325043, + 0.2840233761817217, + 0.8312237821519375, + 0.2946881540119648, + 0.6922412663698196, + 0.7540905028581619, + 0.18284048698842525, + 0.10576673224568367, + 0.0, + 0.5091430339962244, + 0.02583385445177555, + 0.02407299540936947, + 0.1704290695488453, + 0.13293659687042236, + 0.8017755411565304, + 0.17357927560806274, + 0.0, + 0.058516666293144226, + 0.3552921786904335, + 0.06759372353553772, + 0.23593135364353657, + 0.06632000207901001, + 0.09150258265435696, + 0.07031995430588722, + 1.325992090627551, + 0.22399182245135307, + 0.3134736903011799, + 0.4452612716704607, + 0.20388369634747505, + 0.6792734041810036, + 0.4615326765924692 + ], + "unique_experts": 59, + "load_cv": 0.8966497931745142, + "normalized_load_entropy": 0.9138357974164938, + "max_load_share": 0.06349206349206349 + }, + "full_input": { + "tokens": 83, + "top_k": 6, + "decisions": 498, + "ordered_route_sha256": "eaebea177b3192eb9e26e6c2018924966fdd130389a56631d3dc8792b580b493", + "route_weight_sha256": "ae1afe57a49dc3b84b3f4c3214f56ade032282e7786b1db146af661fcc8c2844", + "loads": [ + 7, + 15, + 1, + 5, + 1, + 2, + 4, + 7, + 14, + 2, + 11, + 2, + 0, + 5, + 14, + 9, + 4, + 1, + 3, + 11, + 8, + 13, + 4, + 2, + 8, + 6, + 2, + 15, + 6, + 4, + 5, + 6, + 1, + 7, + 13, + 26, + 5, + 4, + 20, + 7, + 2, + 0, + 17, + 3, + 4, + 2, + 12, + 22, + 4, + 1, + 3, + 11, + 2, + 10, + 2, + 3, + 8, + 23, + 5, + 15, + 21, + 8, + 19, + 21 + ], + "weighted_loads": [ + 0.8447709940373898, + 1.150085361674428, + 0.025375070050358772, + 0.8778562657535076, + 0.030264263972640038, + 0.16669972613453865, + 0.10725530609488487, + 0.32853937707841396, + 0.8850315753370523, + 0.14223404228687286, + 0.45298512652516365, + 0.08457670360803604, + 0.0, + 0.5358043275773525, + 0.6382670812308788, + 0.5372284930199385, + 0.13244116678833961, + 0.12110652029514313, + 0.14379902929067612, + 1.4191050194203854, + 0.39124751277267933, + 0.9979380797594786, + 0.4878665693104267, + 0.057931747287511826, + 0.33701702766120434, + 0.2541534062474966, + 0.15168984606862068, + 2.2268302999436855, + 0.3061790782958269, + 0.13931488804519176, + 0.41874674148857594, + 0.17091288790106773, + 0.034173086285591125, + 0.556174585595727, + 0.6522468701004982, + 2.5076047517359257, + 0.2946881540119648, + 0.73401203379035, + 0.9544957065954804, + 0.5392827857285738, + 0.10576673224568367, + 0.0, + 1.601393049582839, + 0.23199312761425972, + 0.6680407579988241, + 0.1704290695488453, + 0.7983384057879448, + 1.1986179556697607, + 0.26661841198801994, + 0.04339465871453285, + 0.08483212813735008, + 1.3391666486859322, + 0.24411126971244812, + 0.4199685286730528, + 0.06632000207901001, + 0.09150258265435696, + 0.35379740968346596, + 1.6979088615626097, + 0.33455221727490425, + 0.7444298136979342, + 1.1836246624588966, + 0.5684713870286942, + 1.5385125521570444, + 1.4179705400019884 + ], + "unique_experts": 62, + "load_cv": 0.8367207486756465, + "normalized_load_entropy": 0.9192927919341131, + "max_load_share": 0.05220883534136546 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 42, + "ordered_topk_exact_tokens": 25, + "set_exact_tokens": 31, + "mean_set_jaccard": 0.9200680272108844, + "mean_token_weighted_tv": 0.017103814386895726, + "aggregate_load_tv": 0.03968253968253968 + }, + "system_bos": { + "tokens": 42, + "ordered_topk_exact_tokens": 18, + "set_exact_tokens": 26, + "mean_set_jaccard": 0.8860544217687075, + "mean_token_weighted_tv": 0.024382098688788358, + "aggregate_load_tv": 0.05555555555555555 + }, + "system_x": { + "tokens": 42, + "ordered_topk_exact_tokens": 20, + "set_exact_tokens": 32, + "mean_set_jaccard": 0.9319727891156463, + "mean_token_weighted_tv": 0.02349227367501174, + "aggregate_load_tv": 0.03968253968253968 + }, + "system_period": { + "tokens": 42, + "ordered_topk_exact_tokens": 22, + "set_exact_tokens": 32, + "mean_set_jaccard": 0.9319727891156463, + "mean_token_weighted_tv": 0.02366380136282671, + "aggregate_load_tv": 0.03571428571428571 + }, + "bos_at_s0": { + "tokens": 42, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.8180272108843538, + "mean_token_weighted_tv": 0.038601779024161044, + "aggregate_load_tv": 0.0873015873015873 + }, + "bos_at_s1": { + "tokens": 42, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.8231292517006804, + "mean_token_weighted_tv": 0.038526800084149555, + "aggregate_load_tv": 0.07936507936507936 + }, + "x_at_s0": { + "tokens": 42, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 20, + "mean_set_jaccard": 0.8350340136054423, + "mean_token_weighted_tv": 0.03667390834362734, + "aggregate_load_tv": 0.07539682539682539 + }, + "x_at_s1": { + "tokens": 42, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 21, + "mean_set_jaccard": 0.8418367346938777, + "mean_token_weighted_tv": 0.03749446812573643, + "aggregate_load_tv": 0.07539682539682539 + }, + "period_at_s0": { + "tokens": 42, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 20, + "mean_set_jaccard": 0.8350340136054423, + "mean_token_weighted_tv": 0.03658697193133689, + "aggregate_load_tv": 0.07142857142857142 + }, + "period_at_s1": { + "tokens": 42, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 21, + "mean_set_jaccard": 0.8418367346938777, + "mean_token_weighted_tv": 0.03740508790083584, + "aggregate_load_tv": 0.07539682539682539 + } + } + }, + "layer_03": { + "layer": 3, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "c1098ec365ec569f4b6c0ec90e95afb0c2db08d9c0a35a920451802e2d33c2f9", + "route_weight_sha256": "6189c042f4df18a1ffd2e5208e17c820807d6622734ac3f696643903fecfb751", + "loads": [ + 16, + 7, + 1, + 2, + 3, + 9, + 0, + 14, + 1, + 8, + 0, + 6, + 3, + 5, + 4, + 6, + 2, + 1, + 5, + 1, + 3, + 6, + 6, + 2, + 5, + 2, + 2, + 4, + 4, + 2, + 1, + 3, + 2, + 2, + 3, + 1, + 7, + 1, + 2, + 1, + 2, + 0, + 1, + 5, + 2, + 8, + 10, + 7, + 12, + 7, + 0, + 0, + 2, + 0, + 9, + 2, + 6, + 0, + 2, + 5, + 11, + 2, + 5, + 1 + ], + "weighted_loads": [ + 1.128832619637251, + 0.40614283457398415, + 0.030398564413189888, + 0.1227128617465496, + 0.12980278208851814, + 0.7241584900766611, + 0.0, + 1.024608314037323, + 0.023048104718327522, + 0.5625469889491796, + 0.0, + 0.21218955889344215, + 0.07007719576358795, + 0.38132017850875854, + 0.1295153573155403, + 0.9236836805939674, + 0.09320030361413956, + 0.022612422704696655, + 0.6934443935751915, + 0.03769788518548012, + 0.18583694472908974, + 0.5890560783445835, + 0.3682589940726757, + 0.05819413997232914, + 0.1829615980386734, + 0.0740128830075264, + 0.11608964577317238, + 0.31240880489349365, + 0.13820043951272964, + 0.08704902976751328, + 0.0259636789560318, + 0.07448945567011833, + 0.07575821317732334, + 0.15047991648316383, + 0.14055799506604671, + 0.02653469704091549, + 1.082142747938633, + 0.031027061864733696, + 0.10128390789031982, + 0.055513229221105576, + 0.07353048771619797, + 0.0, + 0.038677506148815155, + 0.24548204615712166, + 0.07057645916938782, + 0.7658248655498028, + 0.7550185676664114, + 0.4768769107758999, + 0.9469701405614614, + 0.7462018355727196, + 0.0, + 0.0, + 0.12894638255238533, + 0.0, + 0.9837556071579456, + 0.09610680118203163, + 0.5700397361069918, + 0.0, + 0.25250526517629623, + 0.400801345705986, + 0.619674576446414, + 0.11811662092804909, + 0.3120160736143589, + 0.06076129898428917 + ], + "unique_experts": 57, + "load_cv": 0.9000153969736404, + "normalized_load_entropy": 0.9061066467116319, + "max_load_share": 0.06349206349206349 + }, + "full_input": { + "tokens": 67, + "top_k": 6, + "decisions": 402, + "ordered_route_sha256": "576149cb8d260c08f850205d58cb965a8241633dc581564d12c6e1af4cd49cfc", + "route_weight_sha256": "c9af2f14d801f54c0c772d19b2d19dc7ed10f86b416ddd98a1338352068b1d5d", + "loads": [ + 26, + 7, + 1, + 12, + 5, + 13, + 0, + 23, + 1, + 14, + 2, + 7, + 5, + 10, + 10, + 6, + 2, + 1, + 5, + 1, + 5, + 9, + 11, + 2, + 5, + 4, + 2, + 10, + 4, + 5, + 3, + 3, + 2, + 2, + 12, + 1, + 7, + 1, + 2, + 1, + 2, + 1, + 10, + 6, + 2, + 8, + 23, + 7, + 18, + 17, + 0, + 0, + 3, + 0, + 14, + 4, + 6, + 1, + 2, + 5, + 17, + 2, + 9, + 3 + ], + "weighted_loads": [ + 2.556673664599657, + 0.40614283457398415, + 0.030398564413189888, + 0.7154222726821899, + 0.1587109222309664, + 0.8956989105790854, + 0.0, + 2.4379977658391, + 0.023048104718327522, + 0.8233779481961392, + 0.07247994840145111, + 0.21306286327308044, + 0.082098645681981, + 0.8076564930379391, + 0.4784398190677166, + 0.9236836805939674, + 0.09320030361413956, + 0.022612422704696655, + 0.6934443935751915, + 0.03769788518548012, + 0.254824610427022, + 0.9328157044947147, + 0.7131702490150928, + 0.05819413997232914, + 0.1829615980386734, + 0.08771310583688319, + 0.11608964577317238, + 0.536649938672781, + 0.13820043951272964, + 0.2853470407426357, + 0.1281609795987606, + 0.07448945567011833, + 0.07575821317732334, + 0.15047991648316383, + 1.1712745148688555, + 0.02653469704091549, + 1.082142747938633, + 0.031027061864733696, + 0.10128390789031982, + 0.055513229221105576, + 0.07353048771619797, + 0.01140190102159977, + 0.5822726786136627, + 0.2728906087577343, + 0.07057645916938782, + 0.7658248655498028, + 2.5747377518564463, + 0.4768769107758999, + 1.544042969122529, + 1.3616323694586754, + 0.0, + 0.0, + 0.1436905823647976, + 0.0, + 2.8458391726017, + 0.18638120219111443, + 0.5700397361069918, + 0.012812383472919464, + 0.25250526517629623, + 0.400801345705986, + 1.045570770278573, + 0.11811662092804909, + 0.7527835033833981, + 0.13812636211514473 + ], + "unique_experts": 60, + "load_cv": 0.9591415309660254, + "normalized_load_entropy": 0.8993501403887392, + "max_load_share": 0.06467661691542288 + } + }, + "s1_eos": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "4f9ebb5e2875dc0f791217c8bd8f70e7dfe91a8025654b461e4391ad17f360f3", + "route_weight_sha256": "bf2bb82e7d89d405385cb542dc2ceaddf4a739983922f519f9c166ca4436e3ff", + "loads": [ + 16, + 7, + 0, + 2, + 3, + 10, + 0, + 14, + 1, + 7, + 0, + 6, + 3, + 6, + 5, + 6, + 2, + 1, + 5, + 1, + 3, + 6, + 6, + 1, + 4, + 1, + 2, + 4, + 4, + 2, + 0, + 3, + 2, + 2, + 4, + 1, + 8, + 1, + 2, + 1, + 2, + 0, + 1, + 5, + 2, + 8, + 9, + 7, + 12, + 7, + 1, + 0, + 3, + 0, + 9, + 2, + 6, + 1, + 2, + 5, + 10, + 2, + 5, + 1 + ], + "weighted_loads": [ + 1.1998473890125751, + 0.40520066022872925, + 0.0, + 0.12428717687726021, + 0.12412110529839993, + 0.7684362903237343, + 0.0, + 1.0275255925953388, + 0.025436662137508392, + 0.5351252239197493, + 0.0, + 0.21487771347165108, + 0.06833482347428799, + 0.41689061746001244, + 0.1616724096238613, + 0.9432778172194958, + 0.09644556418061256, + 0.0231131874024868, + 0.6723139621317387, + 0.0381268747150898, + 0.1886570192873478, + 0.5741369053721428, + 0.3658849522471428, + 0.027168242260813713, + 0.15516706556081772, + 0.03928860276937485, + 0.12276232242584229, + 0.3101981617510319, + 0.1380026638507843, + 0.08736160397529602, + 0.0, + 0.07619426399469376, + 0.07398471422493458, + 0.15096409991383553, + 0.1633631531149149, + 0.02641185000538826, + 1.1174938380718231, + 0.030265185981988907, + 0.10439079254865646, + 0.05579596385359764, + 0.0726931095123291, + 0.0, + 0.042722150683403015, + 0.24830780550837517, + 0.0667743906378746, + 0.7742117904126644, + 0.70582508854568, + 0.47493280097842216, + 0.9725552536547184, + 0.7362024113535881, + 0.03325938060879707, + 0.0, + 0.15482599660754204, + 0.0, + 1.0126043781638145, + 0.09502094984054565, + 0.581338306888938, + 0.022601472213864326, + 0.2521122135221958, + 0.3975837603211403, + 0.5879087820649147, + 0.1178499199450016, + 0.3120386339724064, + 0.06651085615158081 + ], + "unique_experts": 57, + "load_cv": 0.8977730630082078, + "normalized_load_entropy": 0.9054018400490965, + "max_load_share": 0.06349206349206349 + }, + "full_input": { + "tokens": 83, + "top_k": 6, + "decisions": 498, + "ordered_route_sha256": "377aa68a8964e0a3b9e00ac5b8ea467ecbb63c3db96faa668515515de3d88beb", + "route_weight_sha256": "3ddbf8bc7321d48bfda0d6ff8dfcb1ea45a121ac0caa2ac9fb859196a5cf4f51", + "loads": [ + 30, + 9, + 0, + 13, + 4, + 16, + 0, + 26, + 1, + 16, + 4, + 7, + 7, + 12, + 13, + 7, + 4, + 1, + 6, + 1, + 5, + 12, + 16, + 1, + 6, + 4, + 2, + 7, + 4, + 5, + 2, + 3, + 2, + 4, + 12, + 1, + 8, + 6, + 2, + 2, + 3, + 1, + 15, + 7, + 2, + 11, + 26, + 7, + 20, + 17, + 1, + 6, + 7, + 5, + 15, + 8, + 6, + 2, + 9, + 6, + 21, + 3, + 11, + 8 + ], + "weighted_loads": [ + 3.003512654453516, + 0.4791157953441143, + 0.0, + 0.7812667526304722, + 0.12465710111428052, + 1.048564851284027, + 0.0, + 2.526185614988208, + 0.025436662137508392, + 0.9788507110788487, + 0.11314019560813904, + 0.21575101785128936, + 0.157350524852518, + 0.9010965041816235, + 0.6877899430692196, + 0.9922391138970852, + 0.3095013089478016, + 0.0231131874024868, + 0.7280770279467106, + 0.0381268747150898, + 0.25490761175751686, + 1.0094687566161156, + 1.2157350145280361, + 0.027168242260813713, + 0.2572772614657879, + 0.09552747686393559, + 0.12276232242584229, + 0.40590881928801537, + 0.1380026638507843, + 0.27487989515066147, + 0.0982988029718399, + 0.07619426399469376, + 0.07398471422493458, + 0.22367976605892181, + 1.082921115681529, + 0.02641185000538826, + 1.1174938380718231, + 0.4484989643096924, + 0.10439079254865646, + 0.10640142485499382, + 0.14756659418344498, + 0.008849496021866798, + 0.7109407559037209, + 0.3184835650026798, + 0.0667743906378746, + 1.0153974704444408, + 3.1207108478993177, + 0.47493280097842216, + 1.8873385302722454, + 1.2016065195202827, + 0.03325938060879707, + 0.7787903510034084, + 0.36541907023638487, + 0.7142806276679039, + 2.98276749253273, + 0.41734249144792557, + 0.581338306888938, + 0.031660850159823895, + 0.7386611476540565, + 0.42778249084949493, + 1.2676777709275484, + 0.16806970164179802, + 0.7824697382748127, + 0.5134557373821735 + ], + "unique_experts": 62, + "load_cv": 0.8625380405648372, + "normalized_load_entropy": 0.9173131564733944, + "max_load_share": 0.060240963855421686 + } + }, + "s0_bos": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "a1e16c9837de05feb3fa2bea5c4026c48b82d612bd3672cf37afb2ac188fe4b4", + "route_weight_sha256": "205939e0ab01526b24f231d37c34a1662fbf0091f8821c545457cc8551d2183c", + "loads": [ + 16, + 7, + 1, + 3, + 2, + 10, + 0, + 13, + 1, + 6, + 0, + 6, + 3, + 4, + 5, + 7, + 3, + 1, + 4, + 2, + 3, + 7, + 6, + 1, + 6, + 4, + 2, + 4, + 4, + 2, + 1, + 2, + 2, + 1, + 4, + 1, + 7, + 1, + 2, + 1, + 4, + 0, + 1, + 5, + 2, + 9, + 9, + 7, + 12, + 7, + 0, + 0, + 2, + 0, + 7, + 2, + 5, + 0, + 1, + 5, + 10, + 2, + 5, + 2 + ], + "weighted_loads": [ + 1.1157137118279934, + 0.38444989174604416, + 0.030076682567596436, + 0.15405204519629478, + 0.10178994573652744, + 0.7280445639044046, + 0.0, + 0.9099327586591244, + 0.022393589839339256, + 0.4850961044430733, + 0.0, + 0.22720026969909668, + 0.06778261624276638, + 0.29757529869675636, + 0.16264506615698338, + 0.9543263241648674, + 0.1317504569888115, + 0.02203928679227829, + 0.6467682495713234, + 0.067773362621665, + 0.18477072194218636, + 0.6200939416885376, + 0.3584773540496826, + 0.02460889145731926, + 0.20242952182888985, + 0.14373150281608105, + 0.12168167158961296, + 0.32068822532892227, + 0.14277824573218822, + 0.08666624128818512, + 0.03186033293604851, + 0.054893145337700844, + 0.07265974767506123, + 0.1382237672805786, + 0.15573957934975624, + 0.027966048568487167, + 1.0763450041413307, + 0.029550883919000626, + 0.10200322791934013, + 0.0549997054040432, + 0.13048413768410683, + 0.0, + 0.03520705923438072, + 0.24275321885943413, + 0.0718621015548706, + 0.7847767006605864, + 0.7306629810482264, + 0.48223186284303665, + 0.8353248313069344, + 0.7657095566391945, + 0.0, + 0.0, + 0.1326775774359703, + 0.0, + 0.9263074472546577, + 0.09855993837118149, + 0.5238095577806234, + 0.0, + 0.1847769320011139, + 0.3691044244915247, + 0.5603703893721104, + 0.11630980297923088, + 0.32085542753338814, + 0.09865562990307808 + ], + "unique_experts": 57, + "load_cv": 0.873881244984178, + "normalized_load_entropy": 0.909381493964824, + "max_load_share": 0.06349206349206349 + }, + "full_input": { + "tokens": 67, + "top_k": 6, + "decisions": 402, + "ordered_route_sha256": "622312a9282927986be79a0aace486c55bb2b33c74b0e97beb0c111ee43ae480", + "route_weight_sha256": "648aced8828ec0a4860c45ec9700d97f1bf3dd6ae4c50f8f9ac3e4cae5ac9307", + "loads": [ + 27, + 7, + 1, + 13, + 4, + 15, + 0, + 22, + 1, + 11, + 3, + 7, + 4, + 8, + 11, + 7, + 3, + 1, + 5, + 2, + 5, + 10, + 11, + 1, + 6, + 5, + 2, + 10, + 4, + 6, + 3, + 2, + 2, + 1, + 12, + 1, + 7, + 1, + 2, + 1, + 4, + 0, + 11, + 6, + 2, + 9, + 23, + 7, + 20, + 17, + 0, + 0, + 2, + 0, + 11, + 4, + 5, + 0, + 1, + 5, + 16, + 2, + 9, + 4 + ], + "weighted_loads": [ + 2.6692868191748857, + 0.38444989174604416, + 0.030076682567596436, + 0.7467614561319351, + 0.1306980858789757, + 0.9565672595053911, + 0.0, + 2.121399860829115, + 0.022393589839339256, + 0.7344262506230734, + 0.10487052798271179, + 0.22807357407873496, + 0.06825726717943326, + 0.7010066397488117, + 0.5323198493570089, + 0.9543263241648674, + 0.1317504569888115, + 0.02203928679227829, + 0.6835702061653137, + 0.067773362621665, + 0.2571635264903307, + 0.9613456502556801, + 0.6959855929017067, + 0.02460889145731926, + 0.20242952182888985, + 0.1442592723760754, + 0.12168167158961296, + 0.5449293591082096, + 0.14277824573218822, + 0.324058935046196, + 0.13000695407390594, + 0.054893145337700844, + 0.07265974767506123, + 0.1382237672805786, + 1.1494902782142162, + 0.027966048568487167, + 1.0763450041413307, + 0.029550883919000626, + 0.10200322791934013, + 0.0549997054040432, + 0.13048413768410683, + 0.0, + 0.7009244374930859, + 0.27016178146004677, + 0.0718621015548706, + 0.7847767006605864, + 2.775434162467718, + 0.48223186284303665, + 1.5860465466976166, + 1.3811400905251503, + 0.0, + 0.0, + 0.1326775774359703, + 0.0, + 2.0868495758622885, + 0.1860799565911293, + 0.5238095577806234, + 0.0, + 0.1847769320011139, + 0.3691044244915247, + 0.9647014904767275, + 0.11630980297923088, + 0.7637729458510876, + 0.17481045424938202 + ], + "unique_experts": 58, + "load_cv": 0.9694090810828925, + "normalized_load_entropy": 0.8949717156327254, + "max_load_share": 0.06716417910447761 + } + }, + "s1_bos": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "876d5a5fed27623750bfb38c51d05da99b6169b1331f78d94b6858cb6412a5ac", + "route_weight_sha256": "9e67513e3ce61cc4a4ae63a2885a3dc9300d4838dcb815715124965b66449572", + "loads": [ + 15, + 7, + 0, + 3, + 2, + 10, + 0, + 14, + 1, + 6, + 0, + 6, + 3, + 4, + 4, + 7, + 3, + 1, + 4, + 1, + 3, + 6, + 6, + 3, + 7, + 4, + 2, + 4, + 4, + 2, + 0, + 3, + 1, + 1, + 4, + 1, + 7, + 1, + 2, + 1, + 4, + 0, + 1, + 5, + 2, + 9, + 10, + 7, + 11, + 7, + 0, + 0, + 4, + 0, + 7, + 2, + 6, + 0, + 1, + 5, + 9, + 2, + 5, + 2 + ], + "weighted_loads": [ + 1.0845753327012062, + 0.37218184769153595, + 0.0, + 0.15412911027669907, + 0.08322310261428356, + 0.7454671207815409, + 0.0, + 0.9608961790800095, + 0.02402743324637413, + 0.5062863621860743, + 0.0, + 0.23423485457897186, + 0.06648978590965271, + 0.30606645718216896, + 0.1334310583770275, + 0.9548745471984148, + 0.13384118489921093, + 0.022906821221113205, + 0.6167108863592148, + 0.03606341406702995, + 0.19026370719075203, + 0.5676661729812622, + 0.33627116307616234, + 0.08168222568929195, + 0.22960494458675385, + 0.14995864406228065, + 0.13291895389556885, + 0.32041526585817337, + 0.1421300694346428, + 0.08115388080477715, + 0.0, + 0.07831532321870327, + 0.04973316192626953, + 0.1346462070941925, + 0.1528092324733734, + 0.028445709496736526, + 1.0063083544373512, + 0.0316183976829052, + 0.10360311716794968, + 0.06172458827495575, + 0.12694743275642395, + 0.0, + 0.038587238639593124, + 0.24243437871336937, + 0.0712690744549036, + 0.7693663965910673, + 0.7498419228941202, + 0.49984988756477833, + 0.8302969262003899, + 0.7586843483150005, + 0.0, + 0.0, + 0.19148924387991428, + 0.0, + 0.9841054305434227, + 0.09551331773400307, + 0.5578377228230238, + 0.0, + 0.14600379765033722, + 0.3596343472599983, + 0.520999375730753, + 0.12449652329087257, + 0.3242914080619812, + 0.10282204300165176 + ], + "unique_experts": 55, + "load_cv": 0.8692559727043218, + "normalized_load_entropy": 0.9063159659468102, + "max_load_share": 0.05952380952380952 + }, + "full_input": { + "tokens": 83, + "top_k": 6, + "decisions": 498, + "ordered_route_sha256": "21def015970652e715756f523755df599cf5848fc0dd425b4cdda5831d30aaf3", + "route_weight_sha256": "f7766023fa46c72d214e9f4a6807078b29398df30f2c16b5fedc237d808ea370", + "loads": [ + 30, + 9, + 0, + 14, + 3, + 16, + 0, + 25, + 1, + 15, + 4, + 7, + 6, + 10, + 12, + 8, + 5, + 1, + 6, + 1, + 5, + 12, + 17, + 4, + 9, + 6, + 2, + 7, + 4, + 5, + 2, + 3, + 1, + 3, + 12, + 1, + 7, + 6, + 2, + 2, + 5, + 0, + 16, + 7, + 2, + 12, + 29, + 7, + 20, + 17, + 0, + 6, + 7, + 5, + 12, + 8, + 6, + 0, + 8, + 6, + 19, + 3, + 11, + 9 + ], + "weighted_loads": [ + 2.9755474347621202, + 0.446096982806921, + 0.0, + 0.811108686029911, + 0.08375909843016416, + 1.0321512129157782, + 0.0, + 2.2899535689502954, + 0.02402743324637413, + 0.9634470231248997, + 0.11314019560813904, + 0.23510815895861015, + 0.14756749995285645, + 0.8239534348249435, + 0.6816873997449875, + 1.0038358438760042, + 0.34689692966639996, + 0.022906821221113205, + 0.7092903852462769, + 0.03606341406702995, + 0.2605592831969261, + 1.016959823668003, + 1.199136720970273, + 0.11207371205091476, + 0.331715140491724, + 0.19733857386745512, + 0.13291895389556885, + 0.41612592339515686, + 0.1421300694346428, + 0.26278097555041313, + 0.09339043870568275, + 0.07831532321870327, + 0.04973316192626953, + 0.2073618732392788, + 1.0810042656958103, + 0.028445709496736526, + 1.0063083544373512, + 0.4498521760106087, + 0.10360311716794968, + 0.11233004927635193, + 0.20182091742753983, + 0.0, + 0.8542703278362751, + 0.312610138207674, + 0.0712690744549036, + 1.0105520766228437, + 3.2128650173544884, + 0.49984988756477833, + 1.8354656212031841, + 1.2240884564816952, + 0.0, + 0.7787903510034084, + 0.3916583191603422, + 0.7142806276679039, + 2.163980793207884, + 0.4140593521296978, + 0.5578377228230238, + 0.0, + 0.632552731782198, + 0.38983307778835297, + 1.1414127387106419, + 0.174716304987669, + 0.8248635344207287, + 0.5495769046247005 + ], + "unique_experts": 59, + "load_cv": 0.8679067024516968, + "normalized_load_entropy": 0.9137762060329045, + "max_load_share": 0.060240963855421686 + } + }, + "s0_x": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "fa5aaa96d93ce33258da2baffa76cfb317276a7573d4d2227b2aaa0c6254ca65", + "route_weight_sha256": "c9373df97344d18d82374c461dc6642a6fadf884ed2c6441572c67076bbb5675", + "loads": [ + 16, + 7, + 1, + 3, + 2, + 11, + 0, + 12, + 0, + 6, + 0, + 6, + 1, + 4, + 5, + 7, + 3, + 1, + 4, + 2, + 3, + 8, + 5, + 1, + 6, + 4, + 2, + 4, + 4, + 2, + 0, + 2, + 2, + 1, + 5, + 1, + 7, + 1, + 2, + 1, + 3, + 0, + 1, + 5, + 2, + 9, + 9, + 7, + 12, + 7, + 1, + 0, + 2, + 0, + 8, + 2, + 5, + 0, + 1, + 6, + 12, + 1, + 5, + 2 + ], + "weighted_loads": [ + 1.1685524806380272, + 0.38165609538555145, + 0.032626163214445114, + 0.15292629972100258, + 0.09820197336375713, + 0.7707612346857786, + 0.0, + 0.8969718031585217, + 0.0, + 0.4972699452191591, + 0.0, + 0.22394515201449394, + 0.023270616307854652, + 0.2866487614810467, + 0.15725398436188698, + 0.9568311162292957, + 0.13196995109319687, + 0.02235441841185093, + 0.6308031007647514, + 0.06708267517387867, + 0.1877625398337841, + 0.687308456748724, + 0.25160031393170357, + 0.024205274879932404, + 0.20272843539714813, + 0.1447940468788147, + 0.11924293637275696, + 0.32567131891846657, + 0.14587100595235825, + 0.09221519902348518, + 0.0, + 0.05337095260620117, + 0.07230000384151936, + 0.13948370516300201, + 0.1754696648567915, + 0.02780751697719097, + 1.018066555261612, + 0.03157534450292587, + 0.10010293498635292, + 0.05040021613240242, + 0.09885367564857006, + 0.0, + 0.03650062158703804, + 0.2453676126897335, + 0.070650614798069, + 0.7999888956546783, + 0.7517565991729498, + 0.48154223524034023, + 0.8395648635923862, + 0.7682484500110149, + 0.03210243955254555, + 0.0, + 0.13765479624271393, + 0.0, + 0.9153404869139194, + 0.1021430753171444, + 0.5259657762944698, + 0.0, + 0.18485958874225616, + 0.40035171434283257, + 0.6611479949206114, + 0.07944457232952118, + 0.327862735837698, + 0.1044711135327816 + ], + "unique_experts": 56, + "load_cv": 0.9078199503383368, + "normalized_load_entropy": 0.9015407260055865, + "max_load_share": 0.06349206349206349 + }, + "full_input": { + "tokens": 67, + "top_k": 6, + "decisions": 402, + "ordered_route_sha256": "14e9281b18561bae79c3e00c2cf2778631ea9b0e3092d152f96a74214f3def14", + "route_weight_sha256": "b2c1e55088ca68d639a0d387ebbac60a2f669dbfcb439aaac0456a87a99a0575", + "loads": [ + 25, + 7, + 1, + 14, + 5, + 15, + 0, + 22, + 0, + 11, + 2, + 7, + 2, + 8, + 11, + 7, + 3, + 1, + 4, + 2, + 4, + 11, + 10, + 1, + 6, + 5, + 3, + 11, + 4, + 6, + 2, + 2, + 2, + 1, + 14, + 1, + 8, + 1, + 2, + 1, + 3, + 0, + 11, + 6, + 2, + 9, + 23, + 7, + 18, + 18, + 1, + 0, + 2, + 0, + 12, + 4, + 5, + 0, + 1, + 6, + 18, + 1, + 9, + 4 + ], + "weighted_loads": [ + 2.4470048137009144, + 0.38165609538555145, + 0.032626163214445114, + 0.8801805153489113, + 0.15826572955120355, + 0.9566290397197008, + 0.0, + 2.1496985740959644, + 0.0, + 0.7664751596166752, + 0.07247994840145111, + 0.22481845639413223, + 0.02374526724452153, + 0.6882473267614841, + 0.4916319362819195, + 0.9568311162292957, + 0.13196995109319687, + 0.02235441841185093, + 0.6308031007647514, + 0.06708267517387867, + 0.21467476524412632, + 1.037519734352827, + 0.5856864899396896, + 0.024205274879932404, + 0.20272843539714813, + 0.14532181643880904, + 0.16143731400370598, + 0.5974158570170403, + 0.14587100595235825, + 0.3368198834359646, + 0.09907188639044762, + 0.05337095260620117, + 0.07230000384151936, + 0.13948370516300201, + 1.2707871180027723, + 0.02780751697719097, + 1.0658362321555614, + 0.03157534450292587, + 0.10010293498635292, + 0.05040021613240242, + 0.09885367564857006, + 0.0, + 0.65929289534688, + 0.27277617529034615, + 0.070650614798069, + 0.7999888956546783, + 2.806227959692478, + 0.48154223524034023, + 1.434766799211502, + 1.4470751993358135, + 0.03210243955254555, + 0.0, + 0.13765479624271393, + 0.0, + 2.053151909261942, + 0.19415459036827087, + 0.5259657762944698, + 0.0, + 0.18485958874225616, + 0.40035171434283257, + 1.114947073161602, + 0.07944457232952118, + 0.7734707035124302, + 0.18124842271208763 + ], + "unique_experts": 58, + "load_cv": 0.9767348869220909, + "normalized_load_entropy": 0.8912880870262612, + "max_load_share": 0.06218905472636816 + } + }, + "s1_x": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "067d87fd5a77445be38762a52975568a4b138fe1dc8e84b64f761b6efec2c631", + "route_weight_sha256": "2f4298fb464750fa875b05d21113c937ac4704d7c27213547fe605bd99959d5a", + "loads": [ + 15, + 7, + 0, + 3, + 1, + 11, + 0, + 13, + 1, + 6, + 0, + 6, + 2, + 4, + 5, + 7, + 3, + 1, + 4, + 1, + 3, + 6, + 5, + 1, + 6, + 4, + 2, + 4, + 4, + 2, + 0, + 2, + 2, + 1, + 4, + 1, + 7, + 1, + 2, + 1, + 3, + 0, + 1, + 5, + 2, + 9, + 11, + 7, + 12, + 7, + 1, + 0, + 3, + 0, + 7, + 2, + 6, + 0, + 2, + 5, + 12, + 2, + 5, + 2 + ], + "weighted_loads": [ + 1.1071214005351067, + 0.3780343197286129, + 0.0, + 0.15521986596286297, + 0.026869721710681915, + 0.8009426705539227, + 0.0, + 0.9395348764955997, + 0.023679109290242195, + 0.5215163957327604, + 0.0, + 0.23499583452939987, + 0.046758659183979034, + 0.29836926609277725, + 0.16708633303642273, + 0.9526108670979738, + 0.13300629146397114, + 0.022758416831493378, + 0.6061251312494278, + 0.035517849028110504, + 0.1949094608426094, + 0.5736839324235916, + 0.25280336290597916, + 0.026311080902814865, + 0.2010770384222269, + 0.1533130668103695, + 0.13317551091313362, + 0.3241332061588764, + 0.1425088755786419, + 0.07718178629875183, + 0.0, + 0.05611161142587662, + 0.07260962203145027, + 0.13804562389850616, + 0.1539297141134739, + 0.028095990419387817, + 1.0025105327367783, + 0.03531115874648094, + 0.10326335206627846, + 0.05820910260081291, + 0.09980912506580353, + 0.0, + 0.03953733667731285, + 0.2463901787996292, + 0.07065355964004993, + 0.7716814577579498, + 0.833924962207675, + 0.498424356803298, + 0.872390303760767, + 0.7609877921640873, + 0.03311875835061073, + 0.0, + 0.1757881212979555, + 0.0, + 0.933238185942173, + 0.09638938307762146, + 0.5584832355380058, + 0.0, + 0.20357638597488403, + 0.36018890142440796, + 0.6317495331168175, + 0.12432920187711716, + 0.32420334592461586, + 0.10796760022640228 + ], + "unique_experts": 56, + "load_cv": 0.9022521581664961, + "normalized_load_entropy": 0.9031806370242411, + "max_load_share": 0.05952380952380952 + }, + "full_input": { + "tokens": 83, + "top_k": 6, + "decisions": 498, + "ordered_route_sha256": "eb23764148571c9dee82b526150b21c5b1b096e1e475c91ae31704b6cff7ff8e", + "route_weight_sha256": "d4e5603aef2c075653d4ebf5068d80ad12989c5afbd0bbad19a8a7470bd9ed46", + "loads": [ + 28, + 9, + 0, + 15, + 3, + 17, + 0, + 24, + 1, + 15, + 4, + 7, + 5, + 10, + 13, + 8, + 5, + 1, + 5, + 1, + 4, + 12, + 15, + 2, + 8, + 6, + 3, + 8, + 4, + 6, + 2, + 2, + 2, + 3, + 12, + 1, + 8, + 6, + 2, + 2, + 4, + 0, + 16, + 7, + 2, + 12, + 29, + 7, + 20, + 18, + 1, + 6, + 6, + 5, + 12, + 8, + 6, + 0, + 9, + 6, + 22, + 3, + 11, + 9 + ], + "weighted_loads": [ + 2.7369206473231316, + 0.45194945484399796, + 0.0, + 0.959533778950572, + 0.0585197500186041, + 1.059815065935254, + 0.0, + 2.264953089877963, + 0.023679109290242195, + 0.9991342052235268, + 0.11314019560813904, + 0.23586913890903816, + 0.12783637322718278, + 0.8035594187676907, + 0.6906212754547596, + 1.0015721637755632, + 0.34606203623116016, + 0.022758416831493378, + 0.6618881970643997, + 0.035517849028110504, + 0.22694512829184532, + 1.0243260562419891, + 1.0957634337246418, + 0.05700290575623512, + 0.3031872343271971, + 0.20069299661554396, + 0.17213104665279388, + 0.4646424949169159, + 0.1425088755786419, + 0.30101070925593376, + 0.093329768627882, + 0.05611161142587662, + 0.07260962203145027, + 0.21076129004359245, + 1.1255088560283184, + 0.028095990419387817, + 1.0428442656993866, + 0.4535449370741844, + 0.10326335206627846, + 0.10881456360220909, + 0.1746826097369194, + 0.0, + 0.7688458561897278, + 0.31656593829393387, + 0.07065355964004993, + 1.0128671377897263, + 3.2743602227419615, + 0.498424356803298, + 1.7636093348264694, + 1.2856764122843742, + 0.03311875835061073, + 0.7787903510034084, + 0.37595719657838345, + 0.7142806276679039, + 2.0930837094783783, + 0.42047448828816414, + 0.5584832355380058, + 0.0, + 0.6901253201067448, + 0.3903876319527626, + 1.306075032800436, + 0.17454898357391357, + 0.810767151415348, + 0.5549649596214294 + ], + "unique_experts": 60, + "load_cv": 0.8673118255535993, + "normalized_load_entropy": 0.9141991005273563, + "max_load_share": 0.05823293172690763 + } + }, + "s0_period": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "ced8caf90f7ef70895b047a56b6e6407797c1662609ccf016538d8ce6d65c5e7", + "route_weight_sha256": "9f93ba585913f903353765b73ee297ff04b588f34d1c2fd3cc8a90cca4a85188", + "loads": [ + 16, + 8, + 1, + 2, + 2, + 10, + 0, + 13, + 0, + 6, + 0, + 6, + 1, + 4, + 4, + 7, + 3, + 1, + 4, + 2, + 3, + 8, + 6, + 1, + 6, + 4, + 2, + 4, + 4, + 2, + 0, + 2, + 2, + 1, + 5, + 1, + 7, + 1, + 2, + 1, + 3, + 0, + 1, + 5, + 2, + 9, + 10, + 7, + 12, + 7, + 1, + 0, + 2, + 0, + 7, + 2, + 5, + 0, + 1, + 6, + 10, + 3, + 5, + 2 + ], + "weighted_loads": [ + 1.1185482293367386, + 0.4015332814306021, + 0.031389832496643066, + 0.12321515381336212, + 0.10046595893800259, + 0.7262330688536167, + 0.0, + 0.9353411570191383, + 0.0, + 0.5034546125680208, + 0.0, + 0.2241845801472664, + 0.023066306486725807, + 0.2836579978466034, + 0.12727891467511654, + 0.962187172845006, + 0.13294578716158867, + 0.022315194830298424, + 0.6335558593273163, + 0.0674961507320404, + 0.18824955448508263, + 0.6936439387500286, + 0.3104020990431309, + 0.024135133251547813, + 0.20251791179180145, + 0.14545940794050694, + 0.11915488913655281, + 0.3240552395582199, + 0.1449245996773243, + 0.0934554971754551, + 0.0, + 0.05397975631058216, + 0.07263283059000969, + 0.1374286264181137, + 0.17708237655460835, + 0.027959510684013367, + 1.0242124199867249, + 0.03149816766381264, + 0.10040328651666641, + 0.05057857930660248, + 0.10013436153531075, + 0.0, + 0.03663938492536545, + 0.24715856835246086, + 0.0694973710924387, + 0.7990754712373018, + 0.7740668430924416, + 0.4800829757004976, + 0.8224235121160746, + 0.7687780372798443, + 0.03169228881597519, + 0.0, + 0.1395713835954666, + 0.0, + 0.8686427474021912, + 0.10188313201069832, + 0.527801962569356, + 0.0, + 0.18741871416568756, + 0.40017503313720226, + 0.5765954442322254, + 0.1478054765611887, + 0.32611602172255516, + 0.10376624017953873 + ], + "unique_experts": 56, + "load_cv": 0.8988949291916044, + "normalized_load_entropy": 0.9032392178028024, + "max_load_share": 0.06349206349206349 + }, + "full_input": { + "tokens": 67, + "top_k": 6, + "decisions": 402, + "ordered_route_sha256": "b0ea2c91bd4d4660019dbe3b4d52f48ab392a4f0e87dd7930dfbb88c107a3798", + "route_weight_sha256": "599cd70601770d1c15e6445058373f09aa8ba0825a5a63500011c34a56aa284d", + "loads": [ + 25, + 9, + 1, + 13, + 5, + 14, + 0, + 23, + 0, + 12, + 2, + 7, + 2, + 8, + 10, + 7, + 3, + 1, + 4, + 2, + 4, + 11, + 12, + 1, + 6, + 5, + 2, + 10, + 4, + 6, + 2, + 2, + 2, + 1, + 13, + 1, + 7, + 1, + 2, + 1, + 3, + 0, + 11, + 6, + 2, + 10, + 24, + 7, + 18, + 17, + 1, + 0, + 2, + 0, + 11, + 4, + 5, + 0, + 2, + 6, + 16, + 3, + 9, + 4 + ], + "weighted_loads": [ + 2.3272258546203375, + 0.5470526721328497, + 0.031389832496643066, + 0.7851495780050755, + 0.16916334733832628, + 0.9126009978353977, + 0.0, + 2.242119323462248, + 0.0, + 0.9302485174848698, + 0.07247994840145111, + 0.22505788452690467, + 0.023540957423392683, + 0.6832490637898445, + 0.5863965135067701, + 0.962187172845006, + 0.13294578716158867, + 0.022315194830298424, + 0.6335558593273163, + 0.0674961507320404, + 0.21516177989542484, + 1.0386676229536533, + 0.7005147822201252, + 0.024135133251547813, + 0.20251791179180145, + 0.14598717750050128, + 0.11915488913655281, + 0.5482963733375072, + 0.1449245996773243, + 0.3281555771827698, + 0.09966393932700157, + 0.05397975631058216, + 0.07263283059000969, + 0.1374286264181137, + 1.1708330754190683, + 0.027959510684013367, + 1.0242124199867249, + 0.03149816766381264, + 0.10040328651666641, + 0.05057857930660248, + 0.10013436153531075, + 0.0, + 0.663023829460144, + 0.2745671309530735, + 0.0694973710924387, + 0.8488823641091585, + 2.801563823595643, + 0.4800829757004976, + 1.4093224350363016, + 1.3842085711658, + 0.03169228881597519, + 0.0, + 0.1395713835954666, + 0.0, + 2.002289967611432, + 0.19176726043224335, + 0.527801962569356, + 0.0, + 0.2269219607114792, + 0.40017503313720226, + 0.9845366347581148, + 0.1478054765611887, + 0.7913458831608295, + 0.18053490296006203 + ], + "unique_experts": 58, + "load_cv": 0.9665451615256178, + "normalized_load_entropy": 0.8942081144799369, + "max_load_share": 0.06218905472636816 + } + }, + "s1_period": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "7d4e92937fe0208043d593c232305db96791908da885c276f5ffe4e552deb832", + "route_weight_sha256": "0486431dde694a7f28500299cab0a4686a09c592b73c2d2e93ad35e93233fa03", + "loads": [ + 15, + 7, + 0, + 4, + 2, + 11, + 0, + 13, + 1, + 6, + 0, + 6, + 1, + 4, + 5, + 7, + 3, + 1, + 4, + 1, + 3, + 8, + 4, + 1, + 6, + 4, + 2, + 4, + 4, + 1, + 0, + 2, + 2, + 1, + 5, + 1, + 7, + 1, + 2, + 1, + 3, + 0, + 1, + 5, + 2, + 9, + 10, + 7, + 12, + 7, + 1, + 0, + 3, + 0, + 7, + 2, + 6, + 0, + 2, + 5, + 12, + 2, + 5, + 1 + ], + "weighted_loads": [ + 1.083201639354229, + 0.379883985966444, + 0.0, + 0.19523444399237633, + 0.07875471003353596, + 0.792711216956377, + 0.0, + 0.9307417199015617, + 0.023722246289253235, + 0.5310946088284254, + 0.0, + 0.2357639465481043, + 0.024336544796824455, + 0.2962696701288223, + 0.16610489040613174, + 0.9542874116450548, + 0.1334448028355837, + 0.022754350677132607, + 0.6094317138195038, + 0.03522052615880966, + 0.19585929438471794, + 0.6698743291199207, + 0.1969010941684246, + 0.026093605905771255, + 0.20083400048315525, + 0.15458435751497746, + 0.13135480508208275, + 0.3226229213178158, + 0.14218636974692345, + 0.039664290845394135, + 0.0, + 0.05618801712989807, + 0.07255075685679913, + 0.138443261384964, + 0.17739199101924896, + 0.028560591861605644, + 0.9998905807733536, + 0.03558671101927757, + 0.10298316925764084, + 0.05828149989247322, + 0.10052820481359959, + 0.0, + 0.03997005149722099, + 0.24747519940137863, + 0.0704596322029829, + 0.7684792764484882, + 0.7795634008944035, + 0.49591654539108276, + 0.8602585680782795, + 0.7654589787125587, + 0.03362404555082321, + 0.0, + 0.17767783999443054, + 0.0, + 0.9155217073857784, + 0.09654982015490532, + 0.5604044031351805, + 0.0, + 0.20089511200785637, + 0.3603119943290949, + 0.6421385742723942, + 0.12495744228363037, + 0.32393185794353485, + 0.05671890825033188 + ], + "unique_experts": 56, + "load_cv": 0.9067091271014427, + "normalized_load_entropy": 0.9012620717878833, + "max_load_share": 0.05952380952380952 + }, + "full_input": { + "tokens": 83, + "top_k": 6, + "decisions": 498, + "ordered_route_sha256": "8a4881f313b2839e0d91698db5f6713c3ace91378e51b62bf54b5e67cf284c3e", + "route_weight_sha256": "e4fbc90f1450bc7582c1d0f71d5663f0c8d305d1007e65ba1cebae24daca20ed", + "loads": [ + 27, + 10, + 0, + 16, + 4, + 17, + 0, + 25, + 1, + 16, + 4, + 7, + 4, + 10, + 13, + 8, + 5, + 1, + 5, + 1, + 4, + 14, + 15, + 2, + 8, + 6, + 2, + 7, + 4, + 5, + 2, + 2, + 2, + 3, + 12, + 1, + 7, + 6, + 2, + 2, + 4, + 0, + 17, + 7, + 2, + 13, + 28, + 7, + 19, + 17, + 1, + 6, + 6, + 5, + 12, + 8, + 6, + 0, + 10, + 6, + 22, + 3, + 11, + 8 + ], + "weighted_loads": [ + 2.6114773862063885, + 0.5626679509878159, + 0.0, + 0.9109128192067146, + 0.11585509323049337, + 1.0536777451634407, + 0.0, + 2.338284255936742, + 0.023722246289253235, + 1.1332861929549836, + 0.11314019560813904, + 0.23663725092774257, + 0.1054142588400282, + 0.7942806743085384, + 0.7704521976411343, + 1.0032487083226442, + 0.3465005476027727, + 0.022754350677132607, + 0.6651947796344757, + 0.03522052615880966, + 0.22789496183395386, + 1.118132758885622, + 1.1134284883737564, + 0.05725095793604851, + 0.3029441963881254, + 0.20196428732015193, + 0.13135480508208275, + 0.41833357885479927, + 0.14218636974692345, + 0.2566581591963768, + 0.0940251387655735, + 0.05618801712989807, + 0.07255075685679913, + 0.21115892753005028, + 1.0579899698495865, + 0.028560591861605644, + 0.9998905807733536, + 0.45382048934698105, + 0.10298316925764084, + 0.1088869608938694, + 0.17540168948471546, + 0.0, + 0.8610528148710728, + 0.3176509588956833, + 0.0704596322029829, + 1.071288414299488, + 3.226658033207059, + 0.49591654539108276, + 1.7058070749044418, + 1.2308630868792534, + 0.03362404555082321, + 0.7787903510034084, + 0.3778469152748585, + 0.7142806276679039, + 2.0670720748603344, + 0.41938767209649086, + 0.5604044031351805, + 0.0, + 0.7357938177883625, + 0.39051072485744953, + 1.2710438407957554, + 0.1751772239804268, + 0.8204353116452694, + 0.5040224157273769 + ], + "unique_experts": 60, + "load_cv": 0.8685011718909993, + "normalized_load_entropy": 0.9131810821274098, + "max_load_share": 0.05622489959839357 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 42, + "ordered_topk_exact_tokens": 27, + "set_exact_tokens": 33, + "mean_set_jaccard": 0.9387755102040817, + "mean_token_weighted_tv": 0.012951706314370745, + "aggregate_load_tv": 0.031746031746031744 + }, + "system_bos": { + "tokens": 42, + "ordered_topk_exact_tokens": 27, + "set_exact_tokens": 31, + "mean_set_jaccard": 0.925170068027211, + "mean_token_weighted_tv": 0.018616022608642067, + "aggregate_load_tv": 0.03571428571428571 + }, + "system_x": { + "tokens": 42, + "ordered_topk_exact_tokens": 30, + "set_exact_tokens": 33, + "mean_set_jaccard": 0.9336734693877551, + "mean_token_weighted_tv": 0.02121372523141049, + "aggregate_load_tv": 0.03571428571428571 + }, + "system_period": { + "tokens": 42, + "ordered_topk_exact_tokens": 28, + "set_exact_tokens": 32, + "mean_set_jaccard": 0.9268707482993198, + "mean_token_weighted_tv": 0.02147727253447686, + "aggregate_load_tv": 0.03968253968253968 + }, + "bos_at_s0": { + "tokens": 42, + "ordered_topk_exact_tokens": 20, + "set_exact_tokens": 27, + "mean_set_jaccard": 0.8928571428571429, + "mean_token_weighted_tv": 0.027380842915070907, + "aggregate_load_tv": 0.05952380952380952 + }, + "bos_at_s1": { + "tokens": 42, + "ordered_topk_exact_tokens": 16, + "set_exact_tokens": 23, + "mean_set_jaccard": 0.8656462585034015, + "mean_token_weighted_tv": 0.03200406558989059, + "aggregate_load_tv": 0.06746031746031746 + }, + "x_at_s0": { + "tokens": 42, + "ordered_topk_exact_tokens": 18, + "set_exact_tokens": 23, + "mean_set_jaccard": 0.8605442176870748, + "mean_token_weighted_tv": 0.03252862070110582, + "aggregate_load_tv": 0.07936507936507936 + }, + "x_at_s1": { + "tokens": 42, + "ordered_topk_exact_tokens": 20, + "set_exact_tokens": 24, + "mean_set_jaccard": 0.8724489795918366, + "mean_token_weighted_tv": 0.033671980479820854, + "aggregate_load_tv": 0.06349206349206349 + }, + "period_at_s0": { + "tokens": 42, + "ordered_topk_exact_tokens": 19, + "set_exact_tokens": 23, + "mean_set_jaccard": 0.8707482993197279, + "mean_token_weighted_tv": 0.030214161501221713, + "aggregate_load_tv": 0.07142857142857142 + }, + "period_at_s1": { + "tokens": 42, + "ordered_topk_exact_tokens": 19, + "set_exact_tokens": 24, + "mean_set_jaccard": 0.8633786848072562, + "mean_token_weighted_tv": 0.03557544968844879, + "aggregate_load_tv": 0.07142857142857142 + } + } + }, + "layer_04": { + "layer": 4, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "4b3d68dd201fcb5e6e9fd33e23c6d9203181324a75ad57bbdc49b7dcc824c2dc", + "route_weight_sha256": "cfd794685c48bfdedb2086a139448180c7eaddfd2ce6559f27e77dbf43a3c97f", + "loads": [ + 2, + 3, + 6, + 8, + 1, + 0, + 4, + 5, + 0, + 5, + 3, + 0, + 0, + 10, + 3, + 0, + 3, + 1, + 9, + 3, + 0, + 3, + 5, + 2, + 6, + 6, + 6, + 0, + 3, + 13, + 0, + 8, + 4, + 1, + 5, + 8, + 1, + 0, + 4, + 4, + 6, + 7, + 3, + 1, + 2, + 4, + 2, + 3, + 11, + 0, + 1, + 4, + 4, + 0, + 1, + 2, + 4, + 5, + 2, + 10, + 23, + 1, + 0, + 11 + ], + "weighted_loads": [ + 0.061064837500452995, + 0.1014887597411871, + 0.2833193000406027, + 0.6453478112816811, + 0.12863783538341522, + 0.0, + 0.20377101749181747, + 0.40391865372657776, + 0.0, + 0.31708565913140774, + 0.3084549978375435, + 0.0, + 0.0, + 0.5562368258833885, + 0.12281058356165886, + 0.0, + 0.08233921974897385, + 0.07944009453058243, + 0.32996484637260437, + 0.10168917290866375, + 0.0, + 0.0917870681732893, + 0.19692596793174744, + 0.08510852791368961, + 0.4503979757428169, + 0.31230948492884636, + 0.4307849258184433, + 0.0, + 0.11898838169872761, + 0.8295441139489412, + 0.0, + 0.2846248745918274, + 0.15496283024549484, + 0.024519722908735275, + 0.40912526473402977, + 0.5126938261091709, + 0.0236953217536211, + 0.0, + 0.244641637429595, + 0.13065861724317074, + 0.5363573022186756, + 0.7242112867534161, + 0.1090648677200079, + 0.03588339313864708, + 0.07220932841300964, + 0.23107243701815605, + 0.17293674126267433, + 0.21139214001595974, + 0.8927213810384274, + 0.0, + 0.02814318612217903, + 0.14589472860097885, + 0.19768190383911133, + 0.0, + 0.07248134911060333, + 0.1525784619152546, + 0.16072998195886612, + 0.45637860521674156, + 0.08627158030867577, + 0.8704494908452034, + 2.6606064811348915, + 0.025340953841805458, + 0.0, + 1.5506477281451225 + ], + "unique_experts": 52, + "load_cv": 1.011772478125923, + "normalized_load_entropy": 0.8869106927965554, + "max_load_share": 0.09126984126984126 + }, + "full_input": { + "tokens": 67, + "top_k": 6, + "decisions": 402, + "ordered_route_sha256": "866769855c4f390dae3023151e9d1b01ead691480ee3082b8d5fb096da4d056c", + "route_weight_sha256": "3eefcc52a082e31cafacfc0a049ad7f4354c1f1939dbd9fe979357454eb541a7", + "loads": [ + 2, + 6, + 9, + 12, + 1, + 0, + 6, + 5, + 0, + 5, + 13, + 2, + 0, + 23, + 5, + 3, + 3, + 1, + 13, + 4, + 0, + 5, + 7, + 2, + 6, + 12, + 12, + 1, + 4, + 30, + 0, + 10, + 4, + 3, + 16, + 8, + 1, + 1, + 5, + 4, + 9, + 10, + 11, + 1, + 2, + 6, + 13, + 3, + 12, + 2, + 2, + 4, + 4, + 0, + 1, + 2, + 4, + 5, + 2, + 22, + 27, + 1, + 3, + 12 + ], + "weighted_loads": [ + 0.061064837500452995, + 0.2407857272773981, + 0.4294709451496601, + 0.8978548788581975, + 0.12863783538341522, + 0.0, + 0.30338287353515625, + 0.40391865372657776, + 0.0, + 0.31708565913140774, + 0.9682728126645088, + 0.026552767492830753, + 0.0, + 1.4799395687878132, + 0.16914501786231995, + 0.1712210848927498, + 0.08233921974897385, + 0.07944009453058243, + 0.5242206413822714, + 0.14227760769426823, + 0.0, + 1.1570982616394758, + 0.3194056302309036, + 0.08510852791368961, + 0.4503979757428169, + 0.7589377388358116, + 0.9719411768019199, + 0.00797671265900135, + 0.14322124235332012, + 2.1609638852387434, + 0.0, + 0.31556502915918827, + 0.15496283024549484, + 0.06482324562966824, + 1.4340365885582287, + 0.5126938261091709, + 0.0236953217536211, + 0.040350768715143204, + 1.2413509842008352, + 0.13065861724317074, + 0.6763034053146839, + 0.9326788038015366, + 0.4680412132292986, + 0.03588339313864708, + 0.07220932841300964, + 0.42838883958756924, + 1.3266591764986515, + 0.21139214001595974, + 0.9293955527245998, + 0.050371766090393066, + 0.0748562179505825, + 0.14589472860097885, + 0.19768190383911133, + 0.0, + 0.07248134911060333, + 0.1525784619152546, + 0.16072998195886612, + 0.45637860521674156, + 0.08627158030867577, + 1.552785187959671, + 3.086717417696491, + 0.025340953841805458, + 0.21264271810650826, + 1.5906735360622406 + ], + "unique_experts": 58, + "load_cv": 1.0315557784609306, + "normalized_load_entropy": 0.8888457525784778, + "max_load_share": 0.07462686567164178 + } + }, + "s1_eos": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "a9d060bd0005624adc581c929c6929ba1aac953752ca352623ecc381eaf72130", + "route_weight_sha256": "48ad06b549787afc9e94f42d6dfb1bf2fc59b4ed23a70230e426414b0ea36275", + "loads": [ + 2, + 4, + 6, + 8, + 1, + 0, + 4, + 5, + 0, + 5, + 3, + 0, + 0, + 10, + 3, + 0, + 3, + 1, + 9, + 3, + 0, + 3, + 5, + 2, + 6, + 6, + 6, + 0, + 3, + 14, + 0, + 7, + 5, + 0, + 5, + 8, + 1, + 0, + 4, + 3, + 6, + 7, + 3, + 1, + 2, + 4, + 3, + 3, + 11, + 0, + 1, + 4, + 4, + 0, + 1, + 2, + 3, + 5, + 2, + 10, + 23, + 1, + 0, + 11 + ], + "weighted_loads": [ + 0.062044017016887665, + 0.12454983778297901, + 0.28452945686876774, + 0.6721187345683575, + 0.1286078691482544, + 0.0, + 0.20043368637561798, + 0.40191394463181496, + 0.0, + 0.30931021831929684, + 0.3123558685183525, + 0.0, + 0.0, + 0.5494695045053959, + 0.12687891349196434, + 0.0, + 0.08157151378691196, + 0.07661822438240051, + 0.3315299768000841, + 0.1009187139570713, + 0.0, + 0.09159689024090767, + 0.1930303443223238, + 0.08876277506351471, + 0.4507380239665508, + 0.3167171999812126, + 0.43367385119199753, + 0.0, + 0.12184140272438526, + 0.8199209719896317, + 0.0, + 0.247438482940197, + 0.18734487891197205, + 0.0, + 0.3972550146281719, + 0.505293320864439, + 0.023870820179581642, + 0.0, + 0.2352339755743742, + 0.10787270590662956, + 0.5388714522123337, + 0.7063131928443909, + 0.1075227577239275, + 0.037463653832674026, + 0.07095912098884583, + 0.23388829827308655, + 0.20714035630226135, + 0.20757523737847805, + 0.8850060719996691, + 0.0, + 0.028583304956555367, + 0.14831776916980743, + 0.19302801974117756, + 0.0, + 0.07097137719392776, + 0.15164896473288536, + 0.12473529577255249, + 0.43707992136478424, + 0.09098680317401886, + 0.8809686452150345, + 2.6214798223227262, + 0.026362212374806404, + 0.0, + 1.5275810547173023 + ], + "unique_experts": 51, + "load_cv": 1.0206978676681129, + "normalized_load_entropy": 0.8842862533083681, + "max_load_share": 0.09126984126984126 + }, + "full_input": { + "tokens": 83, + "top_k": 6, + "decisions": 498, + "ordered_route_sha256": "cc36b76cc42f1744558ea5d426d25e5d3b41219c389f40821cb3dbf85c2706ff", + "route_weight_sha256": "901bbed21529b4ca86efd7a0e86096dab7578e8f5288ce9490c45ad94a1ea558", + "loads": [ + 2, + 6, + 10, + 17, + 1, + 0, + 8, + 5, + 0, + 14, + 12, + 2, + 1, + 24, + 6, + 4, + 5, + 3, + 16, + 6, + 1, + 6, + 11, + 3, + 6, + 16, + 15, + 1, + 4, + 35, + 0, + 9, + 5, + 2, + 20, + 8, + 1, + 3, + 7, + 6, + 9, + 13, + 12, + 1, + 3, + 7, + 13, + 7, + 11, + 3, + 3, + 4, + 8, + 4, + 7, + 2, + 8, + 7, + 2, + 23, + 30, + 3, + 4, + 13 + ], + "weighted_loads": [ + 0.062044017016887665, + 0.24136455915868282, + 0.47897941805422306, + 1.4026510091498494, + 0.1286078691482544, + 0.0, + 0.45549656823277473, + 0.40191394463181496, + 0.0, + 1.3894464615732431, + 0.8995226994156837, + 0.026520012877881527, + 0.1006382554769516, + 1.5286555774509907, + 0.20152566954493523, + 0.2513109855353832, + 0.44574824906885624, + 0.14785274863243103, + 0.8611440725217108, + 0.23192580416798592, + 0.048865072429180145, + 1.1873948201537132, + 0.6427923943847418, + 0.18181905150413513, + 0.4507380239665508, + 1.0384646691381931, + 1.2483007609844208, + 0.008329138159751892, + 0.14619668386876583, + 2.1033051889389753, + 0.0, + 0.27808212768286467, + 0.18734487891197205, + 0.04067705571651459, + 1.787918166082818, + 0.505293320864439, + 0.023870820179581642, + 0.11194923892617226, + 1.4210415352135897, + 0.3188542388379574, + 0.6985461264848709, + 1.000390229630284, + 0.5365411322563887, + 0.037463653832674026, + 0.10849696770310402, + 0.39768797933356836, + 1.4034393317997456, + 0.5459853019565344, + 0.8850060719996691, + 0.08654778264462948, + 0.12086511589586735, + 0.14831776916980743, + 0.63163779117167, + 0.18095937371253967, + 0.6237349137663841, + 0.15164896473288536, + 0.5434404164552689, + 0.5101334005594254, + 0.09098680317401886, + 1.6384515017271042, + 3.5303326826542616, + 0.2229615394026041, + 0.28704607486724854, + 1.6110553108155727 + ], + "unique_experts": 61, + "load_cv": 0.9139612883977805, + "normalized_load_entropy": 0.9114008279163054, + "max_load_share": 0.07028112449799197 + } + }, + "s0_bos": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "2092e54c77b7c277a83660848edd88dfbe22af8c8faa8b1000d820800fdb38f0", + "route_weight_sha256": "f18c5a47f06aa11bc3834bec8e22186015a3048e19ac3ac7d0f8120566d1d342", + "loads": [ + 1, + 5, + 6, + 8, + 1, + 0, + 4, + 5, + 0, + 3, + 3, + 0, + 0, + 10, + 3, + 0, + 3, + 1, + 8, + 3, + 1, + 3, + 5, + 2, + 7, + 6, + 6, + 0, + 3, + 11, + 0, + 9, + 4, + 2, + 4, + 8, + 2, + 0, + 6, + 4, + 6, + 7, + 3, + 1, + 2, + 3, + 1, + 3, + 11, + 0, + 1, + 6, + 4, + 0, + 1, + 2, + 3, + 4, + 2, + 11, + 23, + 0, + 0, + 11 + ], + "weighted_loads": [ + 0.025639710947871208, + 0.14957678318023682, + 0.2679475750774145, + 0.6490192599594593, + 0.1252577155828476, + 0.0, + 0.19003820791840553, + 0.4109988175332546, + 0.0, + 0.244521826505661, + 0.30562731623649597, + 0.0, + 0.0, + 0.5345137603580952, + 0.12654194980859756, + 0.0, + 0.08213818073272705, + 0.07676603645086288, + 0.28916858695447445, + 0.09806825779378414, + 0.028406351804733276, + 0.09090439975261688, + 0.18871421180665493, + 0.0894559696316719, + 0.48789724335074425, + 0.30319368839263916, + 0.42094259709119797, + 0.0, + 0.11826437525451183, + 0.6446203719824553, + 0.0, + 0.32927973195910454, + 0.15925885178148746, + 0.048725027590990067, + 0.2742653861641884, + 0.47825368493795395, + 0.0595229659229517, + 0.0, + 0.3118898905813694, + 0.13914482295513153, + 0.5509279128164053, + 0.7111425921320915, + 0.10196135006844997, + 0.038184117525815964, + 0.065195856615901, + 0.19752798229455948, + 0.13593977689743042, + 0.21297602728009224, + 0.883772000670433, + 0.0, + 0.027708405628800392, + 0.22385688498616219, + 0.2067037783563137, + 0.0, + 0.06923942267894745, + 0.151803657412529, + 0.12484078481793404, + 0.4291435293853283, + 0.0891079492866993, + 0.8748363964259624, + 2.581100068986416, + 0.0, + 0.0, + 1.4495102986693382 + ], + "unique_experts": 52, + "load_cv": 1.0087797997102, + "normalized_load_entropy": 0.8867557643312801, + "max_load_share": 0.09126984126984126 + }, + "full_input": { + "tokens": 67, + "top_k": 6, + "decisions": 402, + "ordered_route_sha256": "52bef14b4114dc21f44b7384dbd92b9da85efdec74fda4dcead0d6c2e0f456ee", + "route_weight_sha256": "8a10fd90e39ceeb231829c5d7486e7ca98849578e0e28316f9cfc8bd1cf7beb1", + "loads": [ + 1, + 8, + 9, + 13, + 1, + 0, + 6, + 5, + 0, + 3, + 13, + 1, + 0, + 23, + 5, + 3, + 3, + 1, + 13, + 3, + 1, + 4, + 7, + 2, + 7, + 12, + 12, + 0, + 4, + 30, + 0, + 10, + 4, + 3, + 16, + 8, + 2, + 2, + 7, + 4, + 9, + 10, + 11, + 1, + 2, + 5, + 12, + 3, + 12, + 1, + 2, + 6, + 4, + 0, + 1, + 2, + 3, + 4, + 2, + 23, + 28, + 0, + 3, + 12 + ], + "weighted_loads": [ + 0.025639710947871208, + 0.2938892990350723, + 0.4187214281409979, + 0.9610087120090611, + 0.1252577155828476, + 0.0, + 0.28094812855124474, + 0.4109988175332546, + 0.0, + 0.244521826505661, + 0.9654451310634613, + 0.017114784568548203, + 0.0, + 1.4516476802527905, + 0.17287638410925865, + 0.17199347168207169, + 0.08213818073272705, + 0.07676603645086288, + 0.6176558301376645, + 0.09806825779378414, + 0.028406351804733276, + 0.3810335844755173, + 0.29852536134421825, + 0.0894559696316719, + 0.48789724335074425, + 0.7541659735143185, + 0.9851084612309933, + 0.0, + 0.14338968880474567, + 2.1404921186476713, + 0.0, + 0.3476777207106352, + 0.15925885178148746, + 0.0741112157702446, + 1.3231515756633598, + 0.47825368493795395, + 0.0595229659229517, + 0.0818660743534565, + 1.3085992373526096, + 0.13914482295513153, + 0.6908740159124136, + 0.8950393572449684, + 0.46093769557774067, + 0.038184117525815964, + 0.065195856615901, + 0.4774866122752428, + 1.2896622121334076, + 0.21297602728009224, + 0.9204461723566055, + 0.028017770498991013, + 0.07442143745720387, + 0.22385688498616219, + 0.2067037783563137, + 0.0, + 0.06923942267894745, + 0.151803657412529, + 0.12484078481793404, + 0.4291435293853283, + 0.0891079492866993, + 1.5701218359172344, + 3.2172144560609013, + 0.0, + 0.21554478630423546, + 1.4888340830802917 + ], + "unique_experts": 57, + "load_cv": 1.0547146343100238, + "normalized_load_entropy": 0.8830922017402428, + "max_load_share": 0.07462686567164178 + } + }, + "s1_bos": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "75b75e7fa097e39ee3d8d2ecd6012b1b8e0746a299fecaaf328e5d94afbadb29", + "route_weight_sha256": "4158fa59e7d8442eb16db91864d324975f1afb70e8ad0e8e6e6a16679f273dc5", + "loads": [ + 1, + 4, + 6, + 8, + 2, + 0, + 4, + 5, + 0, + 2, + 3, + 0, + 0, + 12, + 3, + 0, + 3, + 1, + 8, + 3, + 1, + 3, + 3, + 3, + 7, + 6, + 6, + 0, + 2, + 7, + 0, + 11, + 3, + 2, + 4, + 8, + 2, + 0, + 4, + 6, + 6, + 7, + 3, + 1, + 3, + 4, + 1, + 3, + 10, + 0, + 1, + 6, + 4, + 1, + 1, + 2, + 3, + 5, + 2, + 11, + 24, + 0, + 0, + 11 + ], + "weighted_loads": [ + 0.027523892000317574, + 0.11702288687229156, + 0.2752377185970545, + 0.6533578857779503, + 0.16269465163350105, + 0.0, + 0.18343840911984444, + 0.41376818343997, + 0.0, + 0.19302090257406235, + 0.31098825484514236, + 0.0, + 0.0, + 0.5662603862583637, + 0.12875161319971085, + 0.0, + 0.08425391837954521, + 0.07978849858045578, + 0.28617320768535137, + 0.10175378061830997, + 0.026923134922981262, + 0.08900398761034012, + 0.1386973075568676, + 0.12391873076558113, + 0.48343480937182903, + 0.3077244758605957, + 0.433608777821064, + 0.0, + 0.08718869835138321, + 0.4627086669206619, + 0.0, + 0.38558192551136017, + 0.13079753518104553, + 0.04797821864485741, + 0.26252463087439537, + 0.5021307244896889, + 0.06368299573659897, + 0.0, + 0.25599205680191517, + 0.18968870863318443, + 0.5592986289411783, + 0.7083882987499237, + 0.10858483612537384, + 0.04270710423588753, + 0.10145936906337738, + 0.22623064182698727, + 0.13429608941078186, + 0.21030672825872898, + 0.8544648587703705, + 0.0, + 0.032399795949459076, + 0.22987442836165428, + 0.1892108153551817, + 0.02476632595062256, + 0.06479348987340927, + 0.1537224017083645, + 0.12321506440639496, + 0.45668087154626846, + 0.09342922642827034, + 0.9190908223390579, + 2.6118661239743233, + 0.0, + 0.0, + 1.4440051540732384 + ], + "unique_experts": 53, + "load_cv": 1.0216847645558156, + "normalized_load_entropy": 0.8885875211429274, + "max_load_share": 0.09523809523809523 + }, + "full_input": { + "tokens": 83, + "top_k": 6, + "decisions": 498, + "ordered_route_sha256": "83ba42d57a9f6a815ebaa603f7643471c74b53ddcb6c25d14f77cc3acc20e91b", + "route_weight_sha256": "5db4aa896dc591507c2bf718117336469522ab0a7492257a0bfefcdb1d3c7d19", + "loads": [ + 1, + 6, + 10, + 18, + 2, + 0, + 8, + 5, + 0, + 11, + 12, + 1, + 1, + 26, + 6, + 4, + 5, + 3, + 16, + 5, + 2, + 5, + 9, + 4, + 7, + 16, + 15, + 0, + 3, + 29, + 0, + 12, + 3, + 3, + 20, + 8, + 2, + 4, + 7, + 9, + 9, + 13, + 12, + 1, + 4, + 7, + 12, + 7, + 10, + 2, + 3, + 6, + 8, + 5, + 7, + 2, + 8, + 7, + 2, + 24, + 32, + 2, + 4, + 13 + ], + "weighted_loads": [ + 0.027523892000317574, + 0.24200257658958435, + 0.4723439943045378, + 1.4403379606083035, + 0.16269465163350105, + 0.0, + 0.415475744754076, + 0.41376818343997, + 0.0, + 1.2731571458280087, + 0.8981550857424736, + 0.017114784568548203, + 0.1006382554769516, + 1.5385540053248405, + 0.20339836925268173, + 0.2620312012732029, + 0.4484306536614895, + 0.1510230228304863, + 0.943760152120376, + 0.19230990298092365, + 0.07578820735216141, + 0.4196574501693249, + 0.5769176743924618, + 0.21697500720620155, + 0.48343480937182903, + 1.0059556290507317, + 1.2817286290228367, + 0.0, + 0.11255662888288498, + 1.8108902890235186, + 0.0, + 0.4039799142628908, + 0.13079753518104553, + 0.07336440682411194, + 1.6342272058245726, + 0.5021307244896889, + 0.06368299573659897, + 0.15328871831297874, + 1.4417996164411306, + 0.40067024156451225, + 0.7189733032137156, + 1.0156401972053573, + 0.537603210657835, + 0.04270710423588753, + 0.13899721577763557, + 0.39586222014622763, + 1.3786630518734455, + 0.5487167928367853, + 0.8544648587703705, + 0.06373600661754608, + 0.12468160688877106, + 0.22987442836165428, + 0.6278205867856741, + 0.20572569966316223, + 0.6175570264458656, + 0.1537224017083645, + 0.5419201850891113, + 0.5297343507409096, + 0.09342922642827034, + 1.6847718097269535, + 3.750148795545101, + 0.1965993270277977, + 0.29822537675499916, + 1.5287130549550056 + ], + "unique_experts": 60, + "load_cv": 0.8974353657179779, + "normalized_load_entropy": 0.9123887619457853, + "max_load_share": 0.0642570281124498 + } + }, + "s0_x": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "846c0efd481b54f83e11ff4240ad5f8a23206a7ab2d1f4824325e82b74cf8b2e", + "route_weight_sha256": "1e06004248a1c6d11f89150d3f111a71105faaf000a1a2b348724fb8447ebd17", + "loads": [ + 1, + 4, + 6, + 8, + 1, + 0, + 4, + 5, + 0, + 4, + 3, + 0, + 0, + 10, + 2, + 0, + 3, + 1, + 10, + 4, + 1, + 3, + 4, + 2, + 7, + 6, + 6, + 0, + 3, + 9, + 1, + 9, + 3, + 1, + 4, + 8, + 3, + 0, + 4, + 4, + 5, + 7, + 4, + 1, + 3, + 4, + 2, + 3, + 11, + 0, + 0, + 5, + 4, + 0, + 1, + 2, + 3, + 4, + 2, + 12, + 23, + 1, + 0, + 11 + ], + "weighted_loads": [ + 0.025964101776480675, + 0.11715386807918549, + 0.27234354615211487, + 0.7024239525198936, + 0.12550874054431915, + 0.0, + 0.1841589193791151, + 0.41148799657821655, + 0.0, + 0.2740139849483967, + 0.30602386593818665, + 0.0, + 0.0, + 0.5363834761083126, + 0.09059607982635498, + 0.0, + 0.08115070685744286, + 0.0769508108496666, + 0.372161366045475, + 0.12801873125135899, + 0.027543805539608, + 0.08903512544929981, + 0.1658660676330328, + 0.09042988158762455, + 0.4905646201223135, + 0.3052922412753105, + 0.43599706143140793, + 0.0, + 0.11395969055593014, + 0.495038740336895, + 0.027314603328704834, + 0.33168540336191654, + 0.12821586057543755, + 0.024733487516641617, + 0.2603991739451885, + 0.48557818681001663, + 0.08310451731085777, + 0.0, + 0.2450299821794033, + 0.13221904449164867, + 0.5357598401606083, + 0.7242975868284702, + 0.12810469791293144, + 0.038377925753593445, + 0.10467831790447235, + 0.21793070621788502, + 0.16968884319067, + 0.20861209370195866, + 0.910595815628767, + 0.0, + 0.0, + 0.1884576380252838, + 0.19922180101275444, + 0.0, + 0.07059644162654877, + 0.15145071223378181, + 0.12103660218417645, + 0.4174850173294544, + 0.09091038629412651, + 0.9331431537866592, + 2.53544139303267, + 0.025961732491850853, + 0.0, + 1.447489608079195 + ], + "unique_experts": 53, + "load_cv": 1.0017621159041052, + "normalized_load_entropy": 0.8903129334164785, + "max_load_share": 0.09126984126984126 + }, + "full_input": { + "tokens": 67, + "top_k": 6, + "decisions": 402, + "ordered_route_sha256": "6d3ac240359bf333c9a977cbaf952e211cbd7028b66bc871e89a769f6c07c6f3", + "route_weight_sha256": "c43913b02742e005af34f6b471e9435cb6047f083f2980aaa5cadabaadf34e68", + "loads": [ + 1, + 8, + 10, + 12, + 1, + 0, + 5, + 5, + 0, + 4, + 14, + 1, + 0, + 22, + 4, + 3, + 3, + 1, + 14, + 4, + 1, + 4, + 6, + 2, + 7, + 12, + 12, + 0, + 4, + 26, + 1, + 10, + 3, + 2, + 14, + 8, + 3, + 2, + 5, + 4, + 9, + 10, + 13, + 1, + 3, + 6, + 15, + 3, + 13, + 1, + 1, + 5, + 4, + 0, + 1, + 2, + 3, + 4, + 2, + 25, + 27, + 1, + 3, + 12 + ], + "weighted_loads": [ + 0.025964101776480675, + 0.3042724281549454, + 0.45261741057038307, + 0.965477570251096, + 0.12550874054431915, + 0.0, + 0.22217886708676815, + 0.41148799657821655, + 0.0, + 0.2740139849483967, + 1.1836607456207275, + 0.017114784568548203, + 0.0, + 1.4157394729554653, + 0.13693051412701607, + 0.18216567486524582, + 0.08115070685744286, + 0.0769508108496666, + 0.5546890233235899, + 0.12801873125135899, + 0.027543805539608, + 0.3791643101722002, + 0.2832337375730276, + 0.09042988158762455, + 0.4905646201223135, + 0.6966403909027576, + 1.0431198589503765, + 0.0, + 0.13900429010391235, + 1.7512658701598411, + 0.027314603328704834, + 0.3500833921134472, + 0.12821586057543755, + 0.05011967569589615, + 1.0874973556783516, + 0.48557818681001663, + 0.08310451731085777, + 0.08128877729177475, + 1.2417393289506435, + 0.13221904449164867, + 0.7326513305306435, + 0.9184737652540207, + 0.5227699428796768, + 0.038377925753593445, + 0.10467831790447235, + 0.4663909934461117, + 1.5689557120203972, + 0.20861209370195866, + 0.9905802942812443, + 0.028017770498991013, + 0.04671303182840347, + 0.1884576380252838, + 0.19922180101275444, + 0.0, + 0.07059644162654877, + 0.15145071223378181, + 0.12103660218417645, + 0.4174850173294544, + 0.09091038629412651, + 1.7135877721011639, + 2.9718462156597525, + 0.025961732491850853, + 0.20571345835924149, + 1.486556302756071 + ], + "unique_experts": 59, + "load_cv": 1.0296344137914735, + "normalized_load_entropy": 0.8875570985343755, + "max_load_share": 0.06716417910447761 + } + }, + "s1_x": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "2249d6b22652ba2cb4c713a3d55ce81a81219cabca6189ad90974ea31731ed32", + "route_weight_sha256": "d99f95fea40302343c5135a8448bd4454226e280745398e1b1cd1c5e9ccd894c", + "loads": [ + 1, + 4, + 7, + 8, + 2, + 0, + 4, + 5, + 0, + 2, + 3, + 0, + 0, + 12, + 2, + 0, + 3, + 1, + 9, + 3, + 0, + 3, + 3, + 3, + 7, + 6, + 6, + 0, + 2, + 5, + 0, + 12, + 3, + 2, + 4, + 8, + 3, + 0, + 4, + 5, + 5, + 7, + 5, + 1, + 3, + 4, + 2, + 3, + 10, + 0, + 1, + 5, + 4, + 1, + 1, + 2, + 3, + 5, + 2, + 11, + 24, + 0, + 0, + 11 + ], + "weighted_loads": [ + 0.027209434658288956, + 0.11856171861290932, + 0.31819339841604233, + 0.6940038092434406, + 0.15752393379807472, + 0.0, + 0.16354635171592236, + 0.4067082405090332, + 0.0, + 0.19655399024486542, + 0.31746529042720795, + 0.0, + 0.0, + 0.586676137521863, + 0.09172064810991287, + 0.0, + 0.08317540027201176, + 0.0793439969420433, + 0.34882182627916336, + 0.10163779929280281, + 0.0, + 0.08860252611339092, + 0.13797106221318245, + 0.12600766867399216, + 0.4757619481533766, + 0.30128221958875656, + 0.4385981485247612, + 0.0, + 0.0850638598203659, + 0.33861085399985313, + 0.0, + 0.42365836538374424, + 0.12403162568807602, + 0.04562779888510704, + 0.23915793001651764, + 0.5084974281489849, + 0.0859039407223463, + 0.0, + 0.24943206273019314, + 0.16189548559486866, + 0.5298640877008438, + 0.7422706596553326, + 0.1643675472587347, + 0.043230872601270676, + 0.10771790519356728, + 0.22761224955320358, + 0.16845924779772758, + 0.20260793715715408, + 0.8773289732635021, + 0.0, + 0.032428283244371414, + 0.19686360284686089, + 0.18942777626216412, + 0.02361883968114853, + 0.0643450915813446, + 0.15480228886008263, + 0.1199540477246046, + 0.45747315511107445, + 0.09619756415486336, + 0.9280071258544922, + 2.6309474874287844, + 0.0, + 0.0, + 1.436193808913231 + ], + "unique_experts": 52, + "load_cv": 1.0285665294807882, + "normalized_load_entropy": 0.8867691732134716, + "max_load_share": 0.09523809523809523 + }, + "full_input": { + "tokens": 83, + "top_k": 6, + "decisions": 498, + "ordered_route_sha256": "75d80f2be7e921499247f0a5f7f2bf71bbcac63097f8447914e72303a28e2713", + "route_weight_sha256": "c465ddfcfc224ca73c14e0fabeb05c295b90ce60c5ee6e7babe1ff27780b11eb", + "loads": [ + 1, + 7, + 12, + 17, + 2, + 0, + 6, + 5, + 0, + 11, + 13, + 1, + 1, + 25, + 5, + 4, + 5, + 3, + 16, + 5, + 1, + 5, + 9, + 4, + 7, + 16, + 15, + 0, + 3, + 24, + 0, + 13, + 3, + 3, + 19, + 8, + 3, + 4, + 8, + 8, + 9, + 13, + 15, + 1, + 4, + 7, + 14, + 7, + 11, + 2, + 3, + 5, + 8, + 5, + 7, + 2, + 8, + 7, + 2, + 25, + 32, + 2, + 4, + 13 + ], + "weighted_loads": [ + 0.027209434658288956, + 0.28949565440416336, + 0.5503938775509596, + 1.4333620490506291, + 0.15752393379807472, + 0.0, + 0.3088602405041456, + 0.4067082405090332, + 0.0, + 1.2766902334988117, + 1.0942499488592148, + 0.017114784568548203, + 0.1006382554769516, + 1.519224924966693, + 0.16636740416288376, + 0.2654304765164852, + 0.44735213555395603, + 0.15057852119207382, + 0.8585835892299656, + 0.1921939216554165, + 0.048865072429180145, + 0.4192559886723757, + 0.5814023949205875, + 0.21906394511461258, + 0.4757619481533766, + 0.947410874068737, + 1.3186127692461014, + 0.0, + 0.11030875332653522, + 1.431412486359477, + 0.0, + 0.4420563541352749, + 0.12403162568807602, + 0.07101398706436157, + 1.4135090287891217, + 0.5084974281489849, + 0.0859039407223463, + 0.15303033962845802, + 1.488377308472991, + 0.3728770185261965, + 0.7439500205218792, + 1.0859634297667071, + 0.6331517528742552, + 0.043230872601270676, + 0.14525575190782547, + 0.3542245703865774, + 1.6203209683299065, + 0.5410180017352104, + 0.9150845110416412, + 0.06373600661754608, + 0.1247100941836834, + 0.19686360284686089, + 0.6280375476926565, + 0.2045782133936882, + 0.617108628153801, + 0.15480228886008263, + 0.538659168407321, + 0.5305266343057156, + 0.09619756415486336, + 1.7908227182924747, + 3.5929825212806463, + 0.1965993270277977, + 0.28767943009734154, + 1.5206908695399761 + ], + "unique_experts": 60, + "load_cv": 0.8785456104488126, + "normalized_load_entropy": 0.9134263131784996, + "max_load_share": 0.0642570281124498 + } + }, + "s0_period": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "9bc92c6b2457eac703a52ce747af51871ae4efa99fc7bbd77e454db15b467e3f", + "route_weight_sha256": "e36b92a95051262a361ef14c6d833ccb43563df50172737847f2a6e4e7dfd3f2", + "loads": [ + 1, + 4, + 6, + 8, + 1, + 0, + 4, + 5, + 0, + 4, + 3, + 0, + 0, + 10, + 2, + 0, + 3, + 1, + 9, + 4, + 1, + 3, + 4, + 2, + 7, + 6, + 6, + 0, + 3, + 9, + 1, + 10, + 3, + 2, + 4, + 8, + 3, + 0, + 4, + 4, + 5, + 7, + 4, + 1, + 3, + 4, + 1, + 3, + 11, + 0, + 0, + 5, + 4, + 0, + 1, + 2, + 3, + 4, + 2, + 12, + 24, + 0, + 0, + 11 + ], + "weighted_loads": [ + 0.02620825171470642, + 0.11708695441484451, + 0.27579993940889835, + 0.6923138089478016, + 0.12372175604104996, + 0.0, + 0.1838821116834879, + 0.4081583507359028, + 0.0, + 0.2789379581809044, + 0.305227167904377, + 0.0, + 0.0, + 0.5342080444097519, + 0.09069620072841644, + 0.0, + 0.08094094507396221, + 0.07634498924016953, + 0.35415684804320335, + 0.1298022586852312, + 0.027086758986115456, + 0.08928393945097923, + 0.16436101496219635, + 0.08801058493554592, + 0.48844771459698677, + 0.3042018860578537, + 0.4355575814843178, + 0.0, + 0.11419335380196571, + 0.4811681732535362, + 0.027156872674822807, + 0.3689325973391533, + 0.12949290871620178, + 0.047217754647135735, + 0.2637336440384388, + 0.4886787123978138, + 0.0857609286904335, + 0.0, + 0.23966969549655914, + 0.1331509631127119, + 0.5305442288517952, + 0.7243608720600605, + 0.12967639975249767, + 0.03835948929190636, + 0.1059607919305563, + 0.22058428078889847, + 0.13509684801101685, + 0.2105949018150568, + 0.8976604156196117, + 0.0, + 0.0, + 0.18662018701434135, + 0.19935161247849464, + 0.0, + 0.07032137364149094, + 0.1520507149398327, + 0.12390485964715481, + 0.42029475793242455, + 0.08952587097883224, + 0.9334667399525642, + 2.5582952350378036, + 0.0, + 0.0, + 1.4514459520578384 + ], + "unique_experts": 52, + "load_cv": 1.0246397519690482, + "normalized_load_entropy": 0.8863465478159517, + "max_load_share": 0.09523809523809523 + }, + "full_input": { + "tokens": 67, + "top_k": 6, + "decisions": 402, + "ordered_route_sha256": "492447f32cef6c081ff73d6e0c7d85e862e3ce25eb1fe9e04895094f5d79055a", + "route_weight_sha256": "b95ab83af151f5698ea5f53b8b8f19aba5315b0d1f24d09bbac086e7494e323f", + "loads": [ + 1, + 8, + 10, + 12, + 1, + 0, + 5, + 5, + 0, + 4, + 13, + 1, + 0, + 22, + 4, + 3, + 3, + 1, + 13, + 4, + 1, + 4, + 7, + 2, + 7, + 12, + 13, + 0, + 3, + 27, + 1, + 11, + 3, + 3, + 14, + 8, + 3, + 2, + 5, + 4, + 8, + 10, + 12, + 1, + 3, + 6, + 13, + 3, + 13, + 1, + 1, + 6, + 5, + 0, + 1, + 2, + 3, + 4, + 2, + 25, + 28, + 0, + 3, + 12 + ], + "weighted_loads": [ + 0.02620825171470642, + 0.313481692224741, + 0.45103345438838005, + 0.9553141252254136, + 0.12372175604104996, + 0.0, + 0.2215267512947321, + 0.4081583507359028, + 0.0, + 0.2789379581809044, + 0.9650449827313423, + 0.017114784568548203, + 0.0, + 1.3918833285570145, + 0.13703063502907753, + 0.16500946879386902, + 0.08094094507396221, + 0.07634498924016953, + 0.5362536829488818, + 0.1298022586852312, + 0.027086758986115456, + 0.3794131241738796, + 0.3158005625009537, + 0.08801058493554592, + 0.48844771459698677, + 0.6759553831070662, + 1.3073638156056404, + 0.0, + 0.11419335380196571, + 1.75980878037808, + 0.027156872674822807, + 0.38733058609068394, + 0.12949290871620178, + 0.07260394282639027, + 1.076154319831403, + 0.4886787123978138, + 0.0857609286904335, + 0.08202223107218742, + 1.2363790422677994, + 0.1331509631127119, + 0.6704903319478035, + 0.9125762172043324, + 0.48865274526178837, + 0.03835948929190636, + 0.1059607919305563, + 0.49177482910454273, + 1.4489618241786957, + 0.2105949018150568, + 0.9884845912456512, + 0.028017770498991013, + 0.04671303182840347, + 0.314638864248991, + 0.26388004794716835, + 0.0, + 0.07032137364149094, + 0.1520507149398327, + 0.12390485964715481, + 0.42029475793242455, + 0.08952587097883224, + 1.7149570547044277, + 2.9847670702729374, + 0.0, + 0.20632114633917809, + 1.4902897998690605 + ], + "unique_experts": 58, + "load_cv": 1.0357702349959053, + "normalized_load_entropy": 0.8863262698844616, + "max_load_share": 0.06965174129353234 + } + }, + "s1_period": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "2380129fd3b58e78fc81c8dae2defc4e3a00469b68d93962e572cc42b86e5c07", + "route_weight_sha256": "f8d66aa3c35ac46294d550140d989475935f817faf85d3d93d67e8a8b94d8b1b", + "loads": [ + 1, + 4, + 7, + 8, + 2, + 0, + 4, + 5, + 0, + 2, + 3, + 0, + 0, + 12, + 2, + 0, + 3, + 1, + 9, + 3, + 0, + 3, + 3, + 3, + 6, + 6, + 6, + 0, + 2, + 5, + 0, + 12, + 3, + 2, + 4, + 8, + 3, + 0, + 4, + 5, + 5, + 7, + 5, + 1, + 3, + 3, + 3, + 3, + 10, + 0, + 1, + 6, + 4, + 1, + 1, + 2, + 3, + 5, + 2, + 11, + 24, + 0, + 0, + 11 + ], + "weighted_loads": [ + 0.027125174179673195, + 0.11768362671136856, + 0.322376761585474, + 0.6727838069200516, + 0.15700507909059525, + 0.0, + 0.1663176417350769, + 0.41341113671660423, + 0.0, + 0.1950562745332718, + 0.3136742264032364, + 0.0, + 0.0, + 0.575719466432929, + 0.0912761241197586, + 0.0, + 0.0842286515980959, + 0.0790187194943428, + 0.3430986776947975, + 0.10255756974220276, + 0.0, + 0.08797330968081951, + 0.1370200254023075, + 0.12313560396432877, + 0.4356917440891266, + 0.29940981417894363, + 0.4424769654870033, + 0.0, + 0.08478406444191933, + 0.3362489193677902, + 0.0, + 0.4319346025586128, + 0.12519043311476707, + 0.04604986310005188, + 0.2296619899570942, + 0.49652162939310074, + 0.08843847922980785, + 0.0, + 0.24224381521344185, + 0.16168081387877464, + 0.5299908295273781, + 0.7364837154746056, + 0.1678025908768177, + 0.043022044003009796, + 0.10484328866004944, + 0.20042316243052483, + 0.20315419882535934, + 0.20332025736570358, + 0.8742151409387589, + 0.0, + 0.032100874930620193, + 0.22082077153027058, + 0.18880452774465084, + 0.02335759811103344, + 0.06440041214227676, + 0.15470129996538162, + 0.12136577442288399, + 0.45005640015006065, + 0.0955788865685463, + 0.9331528022885323, + 2.6035389974713326, + 0.0, + 0.0, + 1.44188991189003 + ], + "unique_experts": 52, + "load_cv": 1.0266050182235003, + "normalized_load_entropy": 0.8872531678668177, + "max_load_share": 0.09523809523809523 + }, + "full_input": { + "tokens": 83, + "top_k": 6, + "decisions": 498, + "ordered_route_sha256": "8b7617b89e0782d572d5284ca9adc9b915f3edeecf76aa5b004ec812fb79ae99", + "route_weight_sha256": "fd9287eed14a6ca9e6439d242e63e431e0401060afff398eb20ba3d1960e1ff8", + "loads": [ + 1, + 7, + 11, + 17, + 2, + 0, + 6, + 5, + 0, + 11, + 12, + 1, + 1, + 25, + 5, + 4, + 5, + 3, + 16, + 5, + 1, + 5, + 10, + 4, + 6, + 16, + 16, + 0, + 2, + 24, + 0, + 13, + 3, + 3, + 18, + 8, + 4, + 5, + 8, + 8, + 8, + 13, + 14, + 1, + 4, + 6, + 14, + 7, + 11, + 2, + 3, + 7, + 9, + 5, + 7, + 2, + 8, + 7, + 2, + 25, + 32, + 2, + 4, + 14 + ], + "weighted_loads": [ + 0.027125174179673195, + 0.2764212191104889, + 0.5190984215587378, + 1.4140294278040528, + 0.15700507909059525, + 0.0, + 0.31163153052330017, + 0.41341113671660423, + 0.0, + 1.275192517787218, + 0.9008410573005676, + 0.017114784568548203, + 0.1006382554769516, + 1.4813603330403566, + 0.1659228801727295, + 0.2731168046593666, + 0.44840538688004017, + 0.15025324374437332, + 0.8520997736195568, + 0.19311369210481644, + 0.048865072429180145, + 0.41862677223980427, + 0.6135832108557224, + 0.2161918804049492, + 0.4356917440891266, + 0.9133812431246042, + 1.624980054795742, + 0.0, + 0.08478406444191933, + 1.4167494382709265, + 0.0, + 0.45033259131014347, + 0.12519043311476707, + 0.07143605127930641, + 1.345048618328292, + 0.49652162939310074, + 0.11439067870378494, + 0.19671166688203812, + 1.4875182546675205, + 0.37266234681010246, + 0.6896655037999153, + 1.0943227763054892, + 0.5968209654092789, + 0.043022044003009796, + 0.14238113537430763, + 0.32848771318094805, + 1.5077404268085957, + 0.5417303219437599, + 0.9108795262873173, + 0.06373600661754608, + 0.12438268586993217, + 0.31636527366936207, + 0.6800690349191427, + 0.2043169718235731, + 0.6171639487147331, + 0.15470129996538162, + 0.5400708951056004, + 0.5231098793447018, + 0.0955788865685463, + 1.8511148989200592, + 3.5637174360454082, + 0.1965993270277977, + 0.3007309064269066, + 1.5573452059179544 + ], + "unique_experts": 60, + "load_cv": 0.8744236385932448, + "normalized_load_entropy": 0.9140495364586037, + "max_load_share": 0.0642570281124498 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 42, + "ordered_topk_exact_tokens": 32, + "set_exact_tokens": 38, + "mean_set_jaccard": 0.9727891156462586, + "mean_token_weighted_tv": 0.00833966119569682, + "aggregate_load_tv": 0.015873015873015872 + }, + "system_bos": { + "tokens": 42, + "ordered_topk_exact_tokens": 20, + "set_exact_tokens": 27, + "mean_set_jaccard": 0.8928571428571429, + "mean_token_weighted_tv": 0.0195579872289229, + "aggregate_load_tv": 0.051587301587301584 + }, + "system_x": { + "tokens": 42, + "ordered_topk_exact_tokens": 22, + "set_exact_tokens": 27, + "mean_set_jaccard": 0.8877551020408163, + "mean_token_weighted_tv": 0.021018279139839467, + "aggregate_load_tv": 0.05952380952380952 + }, + "system_period": { + "tokens": 42, + "ordered_topk_exact_tokens": 23, + "set_exact_tokens": 28, + "mean_set_jaccard": 0.8945578231292517, + "mean_token_weighted_tv": 0.02107415230767358, + "aggregate_load_tv": 0.05952380952380952 + }, + "bos_at_s0": { + "tokens": 42, + "ordered_topk_exact_tokens": 22, + "set_exact_tokens": 27, + "mean_set_jaccard": 0.8877551020408163, + "mean_token_weighted_tv": 0.025955621064418836, + "aggregate_load_tv": 0.047619047619047616 + }, + "bos_at_s1": { + "tokens": 42, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.8333333333333334, + "mean_token_weighted_tv": 0.033233112877323515, + "aggregate_load_tv": 0.0873015873015873 + }, + "x_at_s0": { + "tokens": 42, + "ordered_topk_exact_tokens": 17, + "set_exact_tokens": 23, + "mean_set_jaccard": 0.870748299319728, + "mean_token_weighted_tv": 0.029928920036625294, + "aggregate_load_tv": 0.05555555555555555 + }, + "x_at_s1": { + "tokens": 42, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.8129251700680273, + "mean_token_weighted_tv": 0.0372891413447048, + "aggregate_load_tv": 0.09523809523809523 + }, + "period_at_s0": { + "tokens": 42, + "ordered_topk_exact_tokens": 18, + "set_exact_tokens": 23, + "mean_set_jaccard": 0.870748299319728, + "mean_token_weighted_tv": 0.029539733282512144, + "aggregate_load_tv": 0.06349206349206349 + }, + "period_at_s1": { + "tokens": 42, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.8078231292517007, + "mean_token_weighted_tv": 0.03807856217913684, + "aggregate_load_tv": 0.09523809523809523 + } + } + }, + "layer_05": { + "layer": 5, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "32f163cf1dbe2937e81290d35c0744337468ce893ec3b0eeda95fd11ad1e373d", + "route_weight_sha256": "4e85481a30ef1ffeec7210f70fa09582ce5cfbdd96d5d90b76b7d23ca0dac3d6", + "loads": [ + 3, + 4, + 2, + 1, + 6, + 3, + 2, + 0, + 0, + 1, + 14, + 3, + 5, + 1, + 7, + 11, + 0, + 6, + 14, + 3, + 0, + 3, + 2, + 1, + 0, + 6, + 0, + 3, + 2, + 5, + 2, + 2, + 2, + 0, + 3, + 12, + 2, + 0, + 12, + 7, + 5, + 9, + 6, + 4, + 7, + 1, + 3, + 2, + 2, + 7, + 8, + 0, + 1, + 9, + 0, + 5, + 8, + 2, + 3, + 8, + 4, + 2, + 2, + 4 + ], + "weighted_loads": [ + 0.2804776318371296, + 0.4661400429904461, + 0.06512099131941795, + 0.08518562465906143, + 0.3344605825841427, + 0.09980702959001064, + 0.0825335942208767, + 0.0, + 0.0, + 0.03815736621618271, + 0.9332860969007015, + 0.13857286050915718, + 0.3206975497305393, + 0.038890838623046875, + 0.3263847194612026, + 1.3422574438154697, + 0.0, + 0.4138743467628956, + 0.8973399847745895, + 0.11296365596354008, + 0.0, + 0.3025786019861698, + 0.0880903322249651, + 0.044901542365550995, + 0.0, + 0.411362050101161, + 0.0, + 0.18984034843742847, + 0.06460745260119438, + 0.3181711193174124, + 0.09808512032032013, + 0.0629572793841362, + 0.0645054467022419, + 0.0, + 0.366657555103302, + 1.0155986435711384, + 0.0698029100894928, + 0.0, + 1.1106258630752563, + 0.4169883541762829, + 0.2436780259013176, + 0.47966837137937546, + 0.37130554765462875, + 0.18497530557215214, + 0.48139241710305214, + 0.026315653696656227, + 0.14143729582428932, + 0.06330497562885284, + 0.12321769818663597, + 0.27475471794605255, + 1.154649667441845, + 0.0, + 0.027947284281253815, + 0.6644877530634403, + 0.0, + 0.25203074887394905, + 0.5531968846917152, + 0.06625580042600632, + 0.10581160336732864, + 0.7394352033734322, + 0.34264515340328217, + 0.07681572809815407, + 0.07620210386812687, + 0.38884707540273666 + ], + "unique_experts": 54, + "load_cv": 0.9011344715706195, + "normalized_load_entropy": 0.9012166123041979, + "max_load_share": 0.05555555555555555 + }, + "full_input": { + "tokens": 67, + "top_k": 6, + "decisions": 402, + "ordered_route_sha256": "40a48be7632b6585d2fdbb5a9c4b424dc34a929f1787dc2dd927f34ef2d7bd50", + "route_weight_sha256": "86183862283e31afe384c7ec6b20bc18b9daa6ae6e51786f8824846f283374e6", + "loads": [ + 3, + 5, + 2, + 1, + 7, + 4, + 3, + 3, + 1, + 2, + 26, + 3, + 8, + 1, + 7, + 24, + 2, + 12, + 23, + 4, + 2, + 4, + 2, + 1, + 0, + 14, + 0, + 3, + 2, + 5, + 2, + 2, + 2, + 0, + 3, + 16, + 2, + 0, + 23, + 15, + 9, + 17, + 13, + 5, + 8, + 1, + 3, + 4, + 2, + 11, + 16, + 0, + 3, + 18, + 3, + 14, + 8, + 2, + 3, + 9, + 4, + 2, + 2, + 6 + ], + "weighted_loads": [ + 0.2804776318371296, + 0.46966198994778097, + 0.06512099131941795, + 0.08518562465906143, + 0.33621940459124744, + 0.13638550601899624, + 0.12392881140112877, + 0.07031064480543137, + 0.0033761407248675823, + 0.04267343878746033, + 1.6256357729434967, + 0.13857286050915718, + 0.5064426772296429, + 0.038890838623046875, + 0.3263847194612026, + 3.527535585220903, + 0.1605260819196701, + 0.7125608995556831, + 1.6589127480983734, + 0.12603504490107298, + 0.015467382967472076, + 0.3427332825958729, + 0.0880903322249651, + 0.044901542365550995, + 0.0, + 1.314542917534709, + 0.0, + 0.18984034843742847, + 0.06460745260119438, + 0.3181711193174124, + 0.09808512032032013, + 0.0629572793841362, + 0.0645054467022419, + 0.0, + 0.366657555103302, + 1.3270101360976696, + 0.0698029100894928, + 0.0, + 2.2150760293006897, + 1.0660303309559822, + 0.4197678230702877, + 1.3110411055386066, + 0.8235976472496986, + 0.22721788473427296, + 0.5630015321075916, + 0.026315653696656227, + 0.14143729582428932, + 0.08127631177194417, + 0.12321769818663597, + 0.4455073783174157, + 1.8277275897562504, + 0.0, + 1.6573171988129616, + 1.261503104120493, + 0.016888719401322305, + 0.9374561980366707, + 0.5531968846917152, + 0.06625580042600632, + 0.10581160336732864, + 0.7854083850979805, + 0.34264515340328217, + 0.07681572809815407, + 0.07620210386812687, + 1.324075412005186 + ], + "unique_experts": 59, + "load_cv": 1.044527333563191, + "normalized_load_entropy": 0.8856572875513409, + "max_load_share": 0.06467661691542288 + } + }, + "s1_eos": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "89fa486b3db8e96cec74fbd9b56ca22aebc74269836b5890f459417b752d557c", + "route_weight_sha256": "3c02bf42fe613b8723cee084f936b6589926b86176c3cf64c6c5eb8297758931", + "loads": [ + 5, + 4, + 1, + 1, + 6, + 5, + 2, + 0, + 0, + 1, + 14, + 3, + 5, + 1, + 7, + 11, + 0, + 6, + 14, + 3, + 0, + 3, + 1, + 1, + 0, + 6, + 0, + 2, + 3, + 5, + 2, + 2, + 2, + 1, + 3, + 12, + 1, + 0, + 12, + 6, + 5, + 9, + 7, + 4, + 7, + 1, + 2, + 2, + 2, + 7, + 9, + 0, + 1, + 8, + 0, + 5, + 7, + 2, + 3, + 8, + 4, + 2, + 2, + 4 + ], + "weighted_loads": [ + 0.34587542340159416, + 0.45615701004862785, + 0.03411758318543434, + 0.08247151970863342, + 0.33113933354616165, + 0.16596278175711632, + 0.08367537334561348, + 0.0, + 0.0, + 0.03958306461572647, + 0.9144242461770773, + 0.13905258104205132, + 0.3115485645830631, + 0.03867794945836067, + 0.3213585112243891, + 1.3408044166862965, + 0.0, + 0.41374238952994347, + 0.9028441365808249, + 0.11560211516916752, + 0.0, + 0.2973620221018791, + 0.06097869575023651, + 0.04571809992194176, + 0.0, + 0.41013869270682335, + 0.0, + 0.14728344976902008, + 0.09708048775792122, + 0.3105997033417225, + 0.09809830412268639, + 0.058280106633901596, + 0.06593213230371475, + 0.025982853025197983, + 0.36516816914081573, + 1.0085662193596363, + 0.04549475014209747, + 0.0, + 1.1114125177264214, + 0.3613695353269577, + 0.24463296681642532, + 0.4698677994310856, + 0.39210439287126064, + 0.18131687119603157, + 0.48088032752275467, + 0.025162803009152412, + 0.10542444884777069, + 0.06527003645896912, + 0.11806707456707954, + 0.27229950949549675, + 1.210395809262991, + 0.0, + 0.03185701742768288, + 0.6345481686294079, + 0.0, + 0.24761441349983215, + 0.5129848532378674, + 0.06601527146995068, + 0.10317537374794483, + 0.7230815030634403, + 0.3433721400797367, + 0.07573512569069862, + 0.07335864007472992, + 0.387951523065567 + ], + "unique_experts": 55, + "load_cv": 0.9033684619131552, + "normalized_load_entropy": 0.9008157505999742, + "max_load_share": 0.05555555555555555 + }, + "full_input": { + "tokens": 83, + "top_k": 6, + "decisions": 498, + "ordered_route_sha256": "c86443df5caa605ae635897afe1b4b521255f9b7df761fe8a37b6ee5e0cc0874", + "route_weight_sha256": "a0ad043ace42fd4f909a1fac349e17a7ce00a1c44759257af285a776b30bbb2b", + "loads": [ + 6, + 6, + 1, + 7, + 7, + 7, + 11, + 3, + 1, + 2, + 29, + 6, + 10, + 1, + 8, + 26, + 3, + 17, + 26, + 13, + 2, + 4, + 2, + 1, + 1, + 14, + 0, + 4, + 3, + 7, + 2, + 2, + 3, + 2, + 4, + 16, + 2, + 3, + 24, + 18, + 8, + 22, + 18, + 8, + 8, + 1, + 2, + 5, + 2, + 21, + 19, + 1, + 3, + 18, + 4, + 15, + 7, + 2, + 4, + 9, + 5, + 2, + 2, + 8 + ], + "weighted_loads": [ + 0.38248975947499275, + 0.4803003133274615, + 0.03411758318543434, + 0.49988507851958275, + 0.3329141028225422, + 0.24106959626078606, + 1.095265842974186, + 0.09028710587881505, + 0.003369556972756982, + 0.04401056980714202, + 1.7936885748058558, + 0.5136177651584148, + 0.7215464524924755, + 0.03867794945836067, + 0.3547420259565115, + 3.9844184485264122, + 0.24172737449407578, + 1.0900246761739254, + 2.0298907849937677, + 0.9633475756272674, + 0.015363501850515604, + 0.3393036760389805, + 0.09885649755597115, + 0.04571809992194176, + 0.07574586570262909, + 1.1237684451043606, + 0.0, + 0.3190804645419121, + 0.09708048775792122, + 0.39630792662501335, + 0.09809830412268639, + 0.058280106633901596, + 0.18457147479057312, + 0.06866530701518059, + 0.39962729439139366, + 1.4422920681536198, + 0.09045467898249626, + 0.15136179327964783, + 2.3488475680351257, + 1.4578595720231533, + 0.3705130107700825, + 1.7216131277382374, + 1.1356142032891512, + 0.4189876541495323, + 0.542211975902319, + 0.025162803009152412, + 0.10542444884777069, + 0.11616769502870739, + 0.11806707456707954, + 1.0832870909944177, + 2.3093495778739452, + 0.047753579914569855, + 1.6609905399382114, + 1.4450123086571693, + 0.05458913557231426, + 0.8641253150999546, + 0.5129848532378674, + 0.06601527146995068, + 0.17350388504564762, + 0.7705882862210274, + 0.3892147168517113, + 0.07573512569069862, + 0.07335864007472992, + 1.564898256212473 + ], + "unique_experts": 63, + "load_cv": 0.9505015360903735, + "normalized_load_entropy": 0.9024993956275544, + "max_load_share": 0.05823293172690763 + } + }, + "s0_bos": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "f082a00d74df32a50587e4055c21667c23092d03e7a79b09856ef0244a495db4", + "route_weight_sha256": "c130968afceda260a864853ede181f50497d3c78f04b901b5559216467e509da", + "loads": [ + 5, + 5, + 2, + 1, + 6, + 3, + 2, + 0, + 0, + 1, + 13, + 2, + 5, + 2, + 7, + 13, + 0, + 6, + 14, + 3, + 1, + 3, + 1, + 2, + 0, + 5, + 0, + 3, + 3, + 4, + 2, + 2, + 1, + 1, + 3, + 10, + 1, + 0, + 11, + 7, + 5, + 9, + 6, + 4, + 6, + 0, + 3, + 3, + 2, + 7, + 8, + 0, + 1, + 9, + 1, + 5, + 7, + 2, + 3, + 9, + 4, + 2, + 2, + 4 + ], + "weighted_loads": [ + 0.3215508721768856, + 0.5602519884705544, + 0.07048609480261803, + 0.07906659692525864, + 0.3529319688677788, + 0.09745194390416145, + 0.07714992761611938, + 0.0, + 0.0, + 0.03780883178114891, + 0.8330106623470783, + 0.10796410962939262, + 0.30239464715123177, + 0.07105060666799545, + 0.3377799987792969, + 1.4320612251758575, + 0.0, + 0.43404895812273026, + 0.8809794001281261, + 0.11547300405800343, + 0.025937039405107498, + 0.28794657811522484, + 0.06342250853776932, + 0.07048597186803818, + 0.0, + 0.3718234524130821, + 0.0, + 0.19251426681876183, + 0.09817003086209297, + 0.3007366843521595, + 0.09833856299519539, + 0.06213744170963764, + 0.03056703507900238, + 0.026994874700903893, + 0.37377921491861343, + 0.8630938977003098, + 0.04411225765943527, + 0.0, + 1.0815984159708023, + 0.4377286359667778, + 0.2457413598895073, + 0.47735344618558884, + 0.41168466582894325, + 0.18221305310726166, + 0.4678768031299114, + 0.0, + 0.13668184354901314, + 0.08904056809842587, + 0.11899654939770699, + 0.2787080146372318, + 0.9845004379749298, + 0.0, + 0.030233463272452354, + 0.6741970907896757, + 0.03209168463945389, + 0.23709136992692947, + 0.5239343158900738, + 0.06441065669059753, + 0.10611033998429775, + 0.7577143833041191, + 0.34663818404078484, + 0.08126040175557137, + 0.07220900245010853, + 0.37078070640563965 + ], + "unique_experts": 56, + "load_cv": 0.873881244984178, + "normalized_load_entropy": 0.9079380073727944, + "max_load_share": 0.05555555555555555 + }, + "full_input": { + "tokens": 67, + "top_k": 6, + "decisions": 402, + "ordered_route_sha256": "03593bd47bb854656464b8d6c61f45456a42b630168db1ed9a81d5021585a465", + "route_weight_sha256": "121972f6b31e754fdd45c8ea57aa2efb5c0ba305e4e2c73705517e9b4565934f", + "loads": [ + 5, + 6, + 2, + 1, + 6, + 4, + 3, + 2, + 1, + 2, + 25, + 2, + 8, + 3, + 7, + 27, + 2, + 12, + 23, + 4, + 2, + 4, + 1, + 2, + 0, + 13, + 0, + 3, + 3, + 4, + 2, + 2, + 1, + 1, + 3, + 14, + 1, + 0, + 23, + 16, + 9, + 17, + 14, + 5, + 7, + 0, + 3, + 4, + 2, + 12, + 15, + 0, + 2, + 18, + 3, + 15, + 7, + 2, + 3, + 10, + 4, + 2, + 2, + 6 + ], + "weighted_loads": [ + 0.3215508721768856, + 0.5637739354278892, + 0.07048609480261803, + 0.07906659692525864, + 0.3529319688677788, + 0.13403042033314705, + 0.12072296813130379, + 0.03492828458547592, + 0.0033761407248675823, + 0.07413972541689873, + 1.557189516723156, + 0.10796410962939262, + 0.48454130068421364, + 0.10827256739139557, + 0.3377799987792969, + 3.6277295290492475, + 0.15493019670248032, + 0.7327355109155178, + 1.7352182194590569, + 0.12854439299553633, + 0.03851654287427664, + 0.3272150084376335, + 0.06342250853776932, + 0.07048597186803818, + 0.0, + 1.27500431984663, + 0.0, + 0.19251426681876183, + 0.09817003086209297, + 0.3007366843521595, + 0.09833856299519539, + 0.06213744170963764, + 0.03056703507900238, + 0.026994874700903893, + 0.37377921491861343, + 1.174505390226841, + 0.04411225765943527, + 0.0, + 2.3275946639478207, + 1.1118638589978218, + 0.4218311570584774, + 1.3217441104352474, + 0.9381061494350433, + 0.22313706949353218, + 0.5494859181344509, + 0.0, + 0.13668184354901314, + 0.10461590997874737, + 0.11899654939770699, + 0.4967635618522763, + 1.583292592316866, + 0.0, + 0.6949398126453161, + 1.2712124418467283, + 0.04708103742450476, + 0.9269384257495403, + 0.5239343158900738, + 0.06441065669059753, + 0.10611033998429775, + 0.8036875650286674, + 0.34663818404078484, + 0.08126040175557137, + 0.07220900245010853, + 1.306009043008089 + ], + "unique_experts": 59, + "load_cv": 1.0595846991439775, + "normalized_load_entropy": 0.8831537342048387, + "max_load_share": 0.06716417910447761 + } + }, + "s1_bos": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "4998dbbf82406915a286292a1e819aa7f526c4894d251a1eb608c5edc59e47c4", + "route_weight_sha256": "538edb4b24baa138f1370170b8c04b5c77e949e09c878661bd0d2f397bd6f92d", + "loads": [ + 5, + 5, + 2, + 1, + 6, + 4, + 2, + 0, + 0, + 1, + 13, + 3, + 5, + 2, + 7, + 13, + 0, + 6, + 13, + 3, + 0, + 3, + 1, + 2, + 0, + 5, + 0, + 3, + 3, + 4, + 2, + 2, + 1, + 1, + 3, + 11, + 1, + 0, + 11, + 6, + 5, + 9, + 6, + 4, + 7, + 1, + 2, + 3, + 2, + 7, + 8, + 0, + 1, + 8, + 2, + 3, + 7, + 2, + 3, + 9, + 5, + 2, + 2, + 4 + ], + "weighted_loads": [ + 0.333671934902668, + 0.5379550009965897, + 0.07507878169417381, + 0.07829354703426361, + 0.3655449412763119, + 0.13312904722988605, + 0.08152738958597183, + 0.0, + 0.0, + 0.039855919778347015, + 0.8108078502118587, + 0.1479724757373333, + 0.30246973037719727, + 0.07153018563985825, + 0.3226157184690237, + 1.4665641840547323, + 0.0, + 0.42729804664850235, + 0.850019846111536, + 0.11774377711117268, + 0.0, + 0.2866273708641529, + 0.06884907186031342, + 0.06986241042613983, + 0.0, + 0.37346499040722847, + 0.0, + 0.18491518683731556, + 0.09833191148936749, + 0.2800162807106972, + 0.10050464048981667, + 0.0589592419564724, + 0.033196527510881424, + 0.029256559908390045, + 0.3778923377394676, + 0.9150314331054688, + 0.04132736846804619, + 0.0, + 1.0440861247479916, + 0.4030848741531372, + 0.24616045877337456, + 0.48666489869356155, + 0.3879145011305809, + 0.18382768332958221, + 0.4982357360422611, + 0.025631476193666458, + 0.09762538969516754, + 0.0925542451441288, + 0.11324222013354301, + 0.26847345381975174, + 0.9751391150057316, + 0.0, + 0.03345685452222824, + 0.6244134716689587, + 0.06312109716236591, + 0.16415368765592575, + 0.525088258087635, + 0.06719139218330383, + 0.10349636524915695, + 0.7653614319860935, + 0.376571923494339, + 0.07695705443620682, + 0.0724884681403637, + 0.3622741997241974 + ], + "unique_experts": 56, + "load_cv": 0.8622715463835601, + "normalized_load_entropy": 0.9098507790194984, + "max_load_share": 0.051587301587301584 + }, + "full_input": { + "tokens": 83, + "top_k": 6, + "decisions": 498, + "ordered_route_sha256": "30bd0df5ab40aec1bb3d848c66206443cd0c315b89e4852ba196992275ff0057", + "route_weight_sha256": "333c15e1c8a289c0d357104f01063ef54a6921d6b3dd202ddde0a4751ffb3c09", + "loads": [ + 6, + 7, + 2, + 7, + 6, + 6, + 11, + 2, + 1, + 1, + 28, + 6, + 10, + 3, + 8, + 29, + 4, + 17, + 27, + 13, + 1, + 4, + 2, + 2, + 1, + 13, + 0, + 5, + 3, + 6, + 2, + 2, + 2, + 2, + 4, + 15, + 2, + 3, + 24, + 18, + 7, + 22, + 18, + 8, + 8, + 1, + 2, + 5, + 2, + 20, + 19, + 1, + 2, + 18, + 5, + 14, + 7, + 2, + 4, + 10, + 6, + 2, + 2, + 8 + ], + "weighted_loads": [ + 0.3702862709760666, + 0.5620983042754233, + 0.07507878169417381, + 0.49570710584521294, + 0.3655449412763119, + 0.2082358617335558, + 1.097999420017004, + 0.05472685559652746, + 0.003369556972756982, + 0.039855919778347015, + 1.7018731161952019, + 0.5225376598536968, + 0.7157227732241154, + 0.1110675185918808, + 0.3559992332011461, + 4.176855149213225, + 0.27436137944459915, + 1.1035803332924843, + 2.142820328474045, + 0.9654892375692725, + 0.01257950346916914, + 0.3310348428785801, + 0.10672687366604805, + 0.06986241042613983, + 0.07574586570262909, + 1.0870947428047657, + 0.0, + 0.35671220161020756, + 0.09833191148936749, + 0.36572450399398804, + 0.10050464048981667, + 0.0589592419564724, + 0.1518358699977398, + 0.07193901389837265, + 0.41235146299004555, + 1.3487572818994522, + 0.08628729730844498, + 0.15136179327964783, + 2.417240761220455, + 1.5188228785991669, + 0.33730070292949677, + 1.7683461531996727, + 1.189399279654026, + 0.4227030426263809, + 0.5595673844218254, + 0.025631476193666458, + 0.09762538969516754, + 0.14101900160312653, + 0.11324222013354301, + 1.0483282031491399, + 2.075760133564472, + 0.047753579914569855, + 0.698163203895092, + 1.4348776116967201, + 0.11572252865880728, + 0.8049401827156544, + 0.525088258087635, + 0.06719139218330383, + 0.17382487654685974, + 0.8128682151436806, + 0.42241450026631355, + 0.07695705443620682, + 0.0724884681403637, + 1.5392209328711033 + ], + "unique_experts": 63, + "load_cv": 0.9559160968750186, + "normalized_load_entropy": 0.9025718782746983, + "max_load_share": 0.05823293172690763 + } + }, + "s0_x": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "044c202ced9d9a0b87623bfb9b03993332d4459ac954615d99205dd6e2f0b2f1", + "route_weight_sha256": "7b5cf6560a872a4a5d0e6b249c2446b571e2630d554627b356e0bef4a4e32ccd", + "loads": [ + 5, + 5, + 2, + 1, + 6, + 3, + 2, + 0, + 0, + 1, + 13, + 3, + 5, + 2, + 7, + 12, + 0, + 6, + 14, + 3, + 1, + 3, + 2, + 2, + 0, + 5, + 0, + 4, + 2, + 4, + 2, + 2, + 1, + 1, + 3, + 11, + 1, + 0, + 11, + 7, + 5, + 9, + 6, + 4, + 6, + 0, + 3, + 2, + 2, + 7, + 8, + 0, + 1, + 8, + 1, + 5, + 7, + 2, + 3, + 9, + 4, + 2, + 2, + 4 + ], + "weighted_loads": [ + 0.3417183794081211, + 0.5584960617125034, + 0.07193954661488533, + 0.08061008900403976, + 0.3597758561372757, + 0.10012747161090374, + 0.0787828303873539, + 0.0, + 0.0, + 0.037171199917793274, + 0.8619912676513195, + 0.1423640064895153, + 0.3057991787791252, + 0.07211459055542946, + 0.33060432225465775, + 1.4137409888207912, + 0.0, + 0.4203445166349411, + 0.9252810049802065, + 0.12271393090486526, + 0.025762410834431648, + 0.2802557721734047, + 0.08987266384065151, + 0.07296911999583244, + 0.0, + 0.3691374771296978, + 0.0, + 0.2224680781364441, + 0.06367333978414536, + 0.28255409374833107, + 0.09481078013777733, + 0.06081519089639187, + 0.03224300220608711, + 0.02710220217704773, + 0.3645727187395096, + 0.8793383594602346, + 0.042375605553388596, + 0.0, + 1.0563942827284336, + 0.4633693993091583, + 0.24964294582605362, + 0.4836640078574419, + 0.36901692673563957, + 0.17993138916790485, + 0.4590385742485523, + 0.0, + 0.13552233576774597, + 0.06368394754827023, + 0.12863687798380852, + 0.27551891654729843, + 0.8977523595094681, + 0.0, + 0.033835120499134064, + 0.6364668570458889, + 0.03325274586677551, + 0.23062630370259285, + 0.5163629166781902, + 0.06329307332634926, + 0.106340816244483, + 0.7574884369969368, + 0.350653238594532, + 0.083095483481884, + 0.07306474633514881, + 0.3616176024079323 + ], + "unique_experts": 56, + "load_cv": 0.8646059575489728, + "normalized_load_entropy": 0.909453086399482, + "max_load_share": 0.05555555555555555 + }, + "full_input": { + "tokens": 67, + "top_k": 6, + "decisions": 402, + "ordered_route_sha256": "d0c14355efe409bdc83a2bd7053019184b5eefc06d62f339ec1001c15154a9d6", + "route_weight_sha256": "ecb5ed613f3e3cf92b69101a4a89066220b055c4db3194a35e9ac613e8b4cbc9", + "loads": [ + 5, + 7, + 2, + 1, + 6, + 4, + 3, + 2, + 1, + 1, + 26, + 3, + 8, + 3, + 7, + 26, + 2, + 12, + 23, + 4, + 2, + 4, + 2, + 2, + 0, + 14, + 0, + 4, + 2, + 4, + 2, + 2, + 1, + 1, + 3, + 15, + 1, + 0, + 21, + 15, + 11, + 17, + 13, + 5, + 7, + 0, + 3, + 3, + 2, + 10, + 15, + 0, + 2, + 19, + 3, + 15, + 7, + 2, + 3, + 10, + 4, + 2, + 2, + 6 + ], + "weighted_loads": [ + 0.3417183794081211, + 0.598107805242762, + 0.07193954661488533, + 0.08061008900403976, + 0.3597758561372757, + 0.13670594803988934, + 0.11892970651388168, + 0.03492828458547592, + 0.0033761407248675823, + 0.037171199917793274, + 1.697317898273468, + 0.1423640064895153, + 0.4876877926290035, + 0.10755778476595879, + 0.33060432225465775, + 3.7892354032956064, + 0.15504337847232819, + 0.7190310694277287, + 1.6771542821079493, + 0.13578531984239817, + 0.03834191430360079, + 0.32249440997838974, + 0.08987266384065151, + 0.07296911999583244, + 0.0, + 1.3580747731029987, + 0.0, + 0.2224680781364441, + 0.06367333978414536, + 0.28255409374833107, + 0.09481078013777733, + 0.06081519089639187, + 0.03224300220608711, + 0.02710220217704773, + 0.3645727187395096, + 1.1907498519867659, + 0.042375605553388596, + 0.0, + 1.9956363812088966, + 1.0986237451434135, + 0.5417568795382977, + 1.2784483600407839, + 0.792156808078289, + 0.21904452331364155, + 0.5406476892530918, + 0.0, + 0.13552233576774597, + 0.07925928942859173, + 0.12863687798380852, + 0.41992459911853075, + 1.5112771466374397, + 0.0, + 0.6985414698719978, + 1.345381710678339, + 0.04824209865182638, + 0.9943951964378357, + 0.5163629166781902, + 0.06329307332634926, + 0.106340816244483, + 0.8034616187214851, + 0.350653238594532, + 0.083095483481884, + 0.07306474633514881, + 1.2968459390103817 + ], + "unique_experts": 59, + "load_cv": 1.0509530740251327, + "normalized_load_entropy": 0.8841641720983549, + "max_load_share": 0.06467661691542288 + } + }, + "s1_x": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "5810b44d22d7bf6d3afd0085e7810ad17132ec487b9b6a464bfcf36be9d6bb8f", + "route_weight_sha256": "4aae58491e68823747961fa7d081dcfec7de471531a94154f6cd5fe41ea73f1f", + "loads": [ + 5, + 4, + 2, + 1, + 6, + 4, + 2, + 0, + 1, + 1, + 13, + 3, + 5, + 2, + 7, + 13, + 0, + 6, + 13, + 3, + 0, + 3, + 1, + 2, + 0, + 5, + 0, + 3, + 2, + 4, + 2, + 2, + 1, + 1, + 3, + 11, + 1, + 0, + 11, + 6, + 6, + 8, + 6, + 3, + 7, + 0, + 4, + 3, + 2, + 7, + 8, + 0, + 1, + 8, + 1, + 5, + 7, + 2, + 4, + 9, + 4, + 2, + 2, + 4 + ], + "weighted_loads": [ + 0.3514724671840668, + 0.5052326209843159, + 0.07547949254512787, + 0.0788004919886589, + 0.37426936253905296, + 0.13487676158547401, + 0.08136919885873795, + 0.0, + 0.03182108700275421, + 0.039635416120290756, + 0.8261348530650139, + 0.14652543887495995, + 0.30192775651812553, + 0.07165050506591797, + 0.32400614582002163, + 1.473498422652483, + 0.0, + 0.42311258986592293, + 0.8883407972753048, + 0.12659595347940922, + 0.0, + 0.28184571117162704, + 0.06875639408826828, + 0.06896382011473179, + 0.0, + 0.3713313080370426, + 0.0, + 0.18728414550423622, + 0.06429993733763695, + 0.28067246079444885, + 0.09777858853340149, + 0.05929482914507389, + 0.0331893265247345, + 0.029715020209550858, + 0.36980239301919937, + 0.9127720650285482, + 0.03593369573354721, + 0.0, + 1.0237304009497166, + 0.41789671406149864, + 0.29185501113533974, + 0.4302563779056072, + 0.3487158976495266, + 0.14185968600213528, + 0.5016717836260796, + 0.0, + 0.16062427684664726, + 0.09301059693098068, + 0.11302413046360016, + 0.26409606635570526, + 0.9018038548529148, + 0.0, + 0.03245191276073456, + 0.628274317830801, + 0.0341695174574852, + 0.23442238569259644, + 0.5189058035612106, + 0.061069922521710396, + 0.13633217476308346, + 0.7627334743738174, + 0.348659161478281, + 0.07575336843729019, + 0.07345649600028992, + 0.35191770270466805 + ], + "unique_experts": 56, + "load_cv": 0.8599307981321611, + "normalized_load_entropy": 0.909684513121254, + "max_load_share": 0.051587301587301584 + }, + "full_input": { + "tokens": 83, + "top_k": 6, + "decisions": 498, + "ordered_route_sha256": "de614355e799176142dd1a79a860f703870594e33adbdd1ac642c650bc259016", + "route_weight_sha256": "569a549bf3f8d00e952c3e6183f889fe2045f2e24aadf404207ebc5a5ee4c836", + "loads": [ + 6, + 6, + 2, + 7, + 6, + 6, + 11, + 2, + 2, + 1, + 29, + 6, + 10, + 3, + 8, + 29, + 4, + 17, + 27, + 13, + 1, + 4, + 2, + 2, + 1, + 14, + 0, + 5, + 2, + 6, + 2, + 2, + 2, + 3, + 4, + 16, + 2, + 3, + 21, + 18, + 9, + 21, + 17, + 7, + 8, + 0, + 4, + 5, + 2, + 20, + 17, + 1, + 2, + 19, + 4, + 16, + 7, + 2, + 5, + 10, + 5, + 2, + 2, + 8 + ], + "weighted_loads": [ + 0.38808680325746536, + 0.5293759242631495, + 0.07547949254512787, + 0.49621405079960823, + 0.37426936253905296, + 0.20998357608914375, + 1.0950033329427242, + 0.05472685559652746, + 0.03519064397551119, + 0.039635416120290756, + 1.8181940726935863, + 0.5210906229913235, + 0.7149327285587788, + 0.10741672664880753, + 0.35738966055214405, + 4.374833029229194, + 0.27588336914777756, + 1.0993948765099049, + 2.0524149388074875, + 0.9743414139375091, + 0.01257950346916914, + 0.3267546445131302, + 0.10663419589400291, + 0.06896382011473179, + 0.07574586570262909, + 1.1640713773667812, + 0.0, + 0.3590811602771282, + 0.06429993733763695, + 0.3663806840777397, + 0.09777858853340149, + 0.05929482914507389, + 0.15182866901159286, + 0.11553766950964928, + 0.4042615182697773, + 1.3918339777737856, + 0.080893624573946, + 0.15136179327964783, + 2.043242886662483, + 1.54360693693161, + 0.4577196016907692, + 1.6622313857078552, + 1.081476140767336, + 0.37939280457794666, + 0.5630034320056438, + 0.0, + 0.16062427684664726, + 0.1414753533899784, + 0.11302413046360016, + 1.0375288324430585, + 1.9160346798598766, + 0.047753579914569855, + 0.6971582621335983, + 1.5086598917841911, + 0.08677094895392656, + 0.9450595788657665, + 0.5189058035612106, + 0.061069922521710396, + 0.20666068606078625, + 0.8102402575314045, + 0.3945017382502556, + 0.07575336843729019, + 0.07345649600028992, + 1.528864435851574 + ], + "unique_experts": 62, + "load_cv": 0.9469654697557154, + "normalized_load_entropy": 0.9034952084339664, + "max_load_share": 0.05823293172690763 + } + }, + "s0_period": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "26ac0591d02b283a00438be915880ecfc371e0fbc5b660e643b16c3be68d5ed9", + "route_weight_sha256": "66db432649f09f3590391cc0b98610e8e1985327a9f8c1e0dd1087bb85164e48", + "loads": [ + 5, + 5, + 2, + 1, + 6, + 4, + 2, + 0, + 0, + 1, + 13, + 3, + 5, + 2, + 7, + 13, + 0, + 6, + 14, + 3, + 0, + 3, + 2, + 2, + 0, + 5, + 0, + 3, + 2, + 4, + 2, + 2, + 1, + 1, + 3, + 11, + 1, + 0, + 11, + 7, + 5, + 9, + 6, + 4, + 6, + 1, + 3, + 2, + 2, + 7, + 8, + 0, + 1, + 8, + 1, + 5, + 7, + 2, + 3, + 9, + 4, + 2, + 1, + 4 + ], + "weighted_loads": [ + 0.34277714043855667, + 0.5580835193395615, + 0.07041001319885254, + 0.08105308562517166, + 0.35220153629779816, + 0.1304146833717823, + 0.07665291056036949, + 0.0, + 0.0, + 0.03715694323182106, + 0.8625080548226833, + 0.14080416783690453, + 0.3114093691110611, + 0.07130525447428226, + 0.33437057584524155, + 1.429029455408454, + 0.0, + 0.41641100496053696, + 0.9304055795073509, + 0.1143440306186676, + 0.0, + 0.2774900197982788, + 0.08869844861328602, + 0.07202420569956303, + 0.0, + 0.36725419387221336, + 0.0, + 0.1922097820788622, + 0.0633337888866663, + 0.2790730446577072, + 0.09507883712649345, + 0.06011596694588661, + 0.03189997002482414, + 0.02726200595498085, + 0.3651600331068039, + 0.901782626286149, + 0.04107362776994705, + 0.0, + 1.0713536478579044, + 0.4859682358801365, + 0.24407953396439552, + 0.4750952608883381, + 0.36768804863095284, + 0.17761898040771484, + 0.46097178757190704, + 0.02532968856394291, + 0.13695337623357773, + 0.0637372825294733, + 0.12888134270906448, + 0.2711009867489338, + 0.8796923123300076, + 0.0, + 0.03150837495923042, + 0.6389611847698689, + 0.033159445971250534, + 0.23608608916401863, + 0.5125863626599312, + 0.06346103176474571, + 0.10770061612129211, + 0.7515174262225628, + 0.3475032337009907, + 0.08212171122431755, + 0.043051932007074356, + 0.359131321310997 + ], + "unique_experts": 56, + "load_cv": 0.8773341971705065, + "normalized_load_entropy": 0.9074119711037275, + "max_load_share": 0.05555555555555555 + }, + "full_input": { + "tokens": 67, + "top_k": 6, + "decisions": 402, + "ordered_route_sha256": "345a15c7287cdff7316e61185396d5dab9502f096c65cd766333a8eeae02b328", + "route_weight_sha256": "f34738e7561552ee15413583ae59647bdc196461926648693bc9384037e20eb5", + "loads": [ + 5, + 7, + 2, + 1, + 6, + 5, + 3, + 2, + 1, + 1, + 26, + 3, + 8, + 3, + 7, + 27, + 3, + 13, + 23, + 4, + 1, + 4, + 2, + 2, + 0, + 13, + 0, + 3, + 2, + 4, + 2, + 2, + 1, + 1, + 3, + 16, + 1, + 0, + 21, + 15, + 10, + 17, + 13, + 5, + 8, + 1, + 3, + 3, + 2, + 10, + 15, + 0, + 2, + 17, + 3, + 15, + 7, + 2, + 3, + 10, + 4, + 2, + 1, + 6 + ], + "weighted_loads": [ + 0.34277714043855667, + 0.5992434376385063, + 0.07041001319885254, + 0.08105308562517166, + 0.35220153629779816, + 0.1669931598007679, + 0.11702688410878181, + 0.03492828458547592, + 0.0033761407248675823, + 0.03715694323182106, + 1.6906058825552464, + 0.14080416783690453, + 0.4950765334069729, + 0.10641873069107533, + 0.33437057584524155, + 3.629029072355479, + 0.19420389086008072, + 0.7716139853000641, + 1.630263525992632, + 0.1274154195562005, + 0.01257950346916914, + 0.3196011148393154, + 0.08869844861328602, + 0.07202420569956303, + 0.0, + 1.2704350613057613, + 0.0, + 0.1922097820788622, + 0.0633337888866663, + 0.2790730446577072, + 0.09507883712649345, + 0.06011596694588661, + 0.03189997002482414, + 0.02726200595498085, + 0.3651600331068039, + 1.2648035380989313, + 0.04107362776994705, + 0.0, + 1.974281806498766, + 1.1287783235311508, + 0.47762583941221237, + 1.3050741851329803, + 0.8050738610327244, + 0.21702363342046738, + 0.5976865254342556, + 0.02532968856394291, + 0.13695337623357773, + 0.07931262440979481, + 0.12888134270906448, + 0.41438518557697535, + 1.498142171651125, + 0.0, + 0.6962147243320942, + 1.2359765358269215, + 0.0481487987563014, + 1.1308462917804718, + 0.5125863626599312, + 0.06346103176474571, + 0.10770061612129211, + 0.7974906079471111, + 0.3475032337009907, + 0.08212171122431755, + 0.043051932007074356, + 1.2943596579134464 + ], + "unique_experts": 60, + "load_cv": 1.0520829542437857, + "normalized_load_entropy": 0.8846344065838951, + "max_load_share": 0.06716417910447761 + } + }, + "s1_period": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "50d07bab86f10e1f53bda8185c8f64da58bca7264c3fdc675969b8c6f5afaf59", + "route_weight_sha256": "d60de8a723c293d4015a6040404816770065acb4a3d7a7f3a27d277c020a47db", + "loads": [ + 5, + 4, + 2, + 1, + 6, + 3, + 2, + 0, + 1, + 1, + 14, + 2, + 5, + 2, + 7, + 12, + 0, + 6, + 13, + 3, + 0, + 3, + 1, + 2, + 0, + 5, + 0, + 3, + 2, + 3, + 2, + 2, + 1, + 1, + 4, + 12, + 1, + 0, + 11, + 7, + 5, + 10, + 5, + 4, + 7, + 0, + 3, + 3, + 2, + 7, + 8, + 0, + 1, + 8, + 1, + 5, + 7, + 2, + 4, + 9, + 4, + 2, + 2, + 4 + ], + "weighted_loads": [ + 0.34953123331069946, + 0.5093713514506817, + 0.07451633736491203, + 0.07799211889505386, + 0.37059781700372696, + 0.10024473443627357, + 0.08033723011612892, + 0.0, + 0.03135004639625549, + 0.03939569368958473, + 0.8599483333528042, + 0.11075575277209282, + 0.3037983737885952, + 0.07030218280851841, + 0.3279245160520077, + 1.4458808954805136, + 0.0, + 0.4146186411380768, + 0.8934708796441555, + 0.12037048116326332, + 0.0, + 0.28286348283290863, + 0.06650964915752411, + 0.06890256889164448, + 0.0, + 0.36950840801000595, + 0.0, + 0.18546385318040848, + 0.06445836648344994, + 0.2475322149693966, + 0.09648211300373077, + 0.058807799592614174, + 0.032864321023225784, + 0.029708368703722954, + 0.40725893527269363, + 0.9511422645300627, + 0.03713604807853699, + 0.0, + 1.0106534212827682, + 0.4642191268503666, + 0.2498999498784542, + 0.5059319846332073, + 0.3053535744547844, + 0.1781725324690342, + 0.503848023712635, + 0.0, + 0.12891704961657524, + 0.09217937476933002, + 0.11325706169009209, + 0.26124906726181507, + 0.8758430294692516, + 0.0, + 0.029958948493003845, + 0.6259475089609623, + 0.03387301787734032, + 0.2450663298368454, + 0.5139020271599293, + 0.0602853000164032, + 0.13734897039830685, + 0.7474008873105049, + 0.3508489616215229, + 0.0753159262239933, + 0.07335691899061203, + 0.35277777537703514 + ], + "unique_experts": 56, + "load_cv": 0.8830591140127697, + "normalized_load_entropy": 0.906617310880113, + "max_load_share": 0.05555555555555555 + }, + "full_input": { + "tokens": 83, + "top_k": 6, + "decisions": 498, + "ordered_route_sha256": "7b41c51e996bc39715a9ce2e84c4741373d393aa843cb88d1bedbd096f8d0ad0", + "route_weight_sha256": "c73afb58d99b79205b656d2bf6ce1f3d3e240b274fec5cc0bfb809b2b0e1495a", + "loads": [ + 6, + 6, + 2, + 7, + 6, + 6, + 11, + 2, + 2, + 1, + 30, + 5, + 10, + 3, + 8, + 29, + 4, + 18, + 26, + 13, + 1, + 4, + 2, + 2, + 1, + 13, + 0, + 5, + 2, + 5, + 2, + 2, + 2, + 2, + 5, + 17, + 2, + 3, + 21, + 19, + 8, + 23, + 16, + 8, + 9, + 0, + 3, + 5, + 2, + 20, + 17, + 1, + 2, + 18, + 4, + 16, + 7, + 2, + 5, + 10, + 5, + 2, + 2, + 8 + ], + "weighted_loads": [ + 0.38614556938409805, + 0.5335146547295153, + 0.07451633736491203, + 0.4954056777060032, + 0.37059781700372696, + 0.22024169191718102, + 1.0939046442508698, + 0.05472685559652746, + 0.034719603369012475, + 0.03939569368958473, + 1.8665071092545986, + 0.48532093688845634, + 0.7162064090371132, + 0.10487948544323444, + 0.3613080307841301, + 4.225401392672211, + 0.29740462452173233, + 1.1325169578194618, + 1.9877528175711632, + 0.9681159416213632, + 0.01257950346916914, + 0.32628801092505455, + 0.10438745096325874, + 0.06890256889164448, + 0.07574586570262909, + 1.0831381604075432, + 0.0, + 0.3572608679533005, + 0.06445836648344994, + 0.33324043825268745, + 0.09648211300373077, + 0.058807799592614174, + 0.15150366351008415, + 0.07239082269370556, + 0.44171806052327156, + 1.464736109599471, + 0.08209597691893578, + 0.15136179327964783, + 1.9923861622810364, + 1.5912019312381744, + 0.3942417874932289, + 1.812772948294878, + 1.0621487721800804, + 0.4145713075995445, + 0.6107575856149197, + 0.0, + 0.12891704961657524, + 0.14064413122832775, + 0.11325706169009209, + 1.0345279080793262, + 1.8883631825447083, + 0.047753579914569855, + 0.6946652978658676, + 1.4364116489887238, + 0.08647444937378168, + 1.0478182025253773, + 0.5139020271599293, + 0.0602853000164032, + 0.20767748169600964, + 0.794907670468092, + 0.39669153839349747, + 0.0753159262239933, + 0.07335691899061203, + 1.529724508523941 + ], + "unique_experts": 62, + "load_cv": 0.9594191750560683, + "normalized_load_entropy": 0.9013230483450255, + "max_load_share": 0.060240963855421686 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 42, + "ordered_topk_exact_tokens": 28, + "set_exact_tokens": 33, + "mean_set_jaccard": 0.9387755102040817, + "mean_token_weighted_tv": 0.01216008560732007, + "aggregate_load_tv": 0.031746031746031744 + }, + "system_bos": { + "tokens": 42, + "ordered_topk_exact_tokens": 26, + "set_exact_tokens": 34, + "mean_set_jaccard": 0.9455782312925171, + "mean_token_weighted_tv": 0.015398262711685328, + "aggregate_load_tv": 0.027777777777777776 + }, + "system_x": { + "tokens": 42, + "ordered_topk_exact_tokens": 28, + "set_exact_tokens": 33, + "mean_set_jaccard": 0.9387755102040817, + "mean_token_weighted_tv": 0.016707472614057008, + "aggregate_load_tv": 0.031746031746031744 + }, + "system_period": { + "tokens": 42, + "ordered_topk_exact_tokens": 26, + "set_exact_tokens": 31, + "mean_set_jaccard": 0.9200680272108844, + "mean_token_weighted_tv": 0.019757258750143506, + "aggregate_load_tv": 0.03571428571428571 + }, + "bos_at_s0": { + "tokens": 42, + "ordered_topk_exact_tokens": 21, + "set_exact_tokens": 26, + "mean_set_jaccard": 0.8911564625850341, + "mean_token_weighted_tv": 0.027507624744127195, + "aggregate_load_tv": 0.051587301587301584 + }, + "bos_at_s1": { + "tokens": 42, + "ordered_topk_exact_tokens": 22, + "set_exact_tokens": 29, + "mean_set_jaccard": 0.9064625850340138, + "mean_token_weighted_tv": 0.02730218411999799, + "aggregate_load_tv": 0.047619047619047616 + }, + "x_at_s0": { + "tokens": 42, + "ordered_topk_exact_tokens": 28, + "set_exact_tokens": 29, + "mean_set_jaccard": 0.9064625850340138, + "mean_token_weighted_tv": 0.02731098270132428, + "aggregate_load_tv": 0.04365079365079365 + }, + "x_at_s1": { + "tokens": 42, + "ordered_topk_exact_tokens": 21, + "set_exact_tokens": 26, + "mean_set_jaccard": 0.8809523809523809, + "mean_token_weighted_tv": 0.03290083410129661, + "aggregate_load_tv": 0.05555555555555555 + }, + "period_at_s0": { + "tokens": 42, + "ordered_topk_exact_tokens": 25, + "set_exact_tokens": 29, + "mean_set_jaccard": 0.9115646258503401, + "mean_token_weighted_tv": 0.027096593841200785, + "aggregate_load_tv": 0.04365079365079365 + }, + "period_at_s1": { + "tokens": 42, + "ordered_topk_exact_tokens": 20, + "set_exact_tokens": 27, + "mean_set_jaccard": 0.8775510204081634, + "mean_token_weighted_tv": 0.034702867469085116, + "aggregate_load_tv": 0.05555555555555555 + } + } + }, + "layer_06": { + "layer": 6, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "c6488d7edcea658735ddd8090b9f18ed3e3422816dc111a818bfc02180708ca5", + "route_weight_sha256": "ad0150054305802d90178ccecd2bd674c551fdbdbd4d5743e2c6fb9a937c1998", + "loads": [ + 0, + 9, + 1, + 3, + 11, + 0, + 14, + 2, + 5, + 7, + 5, + 7, + 7, + 2, + 0, + 1, + 6, + 4, + 3, + 8, + 3, + 1, + 5, + 6, + 0, + 8, + 3, + 1, + 3, + 5, + 0, + 5, + 0, + 9, + 3, + 14, + 2, + 8, + 2, + 2, + 1, + 6, + 2, + 5, + 1, + 4, + 10, + 0, + 0, + 3, + 3, + 2, + 1, + 0, + 3, + 9, + 7, + 0, + 3, + 5, + 3, + 5, + 0, + 4 + ], + "weighted_loads": [ + 0.0, + 0.4512634202837944, + 0.05529198423027992, + 0.12763134017586708, + 0.9746602773666382, + 0.0, + 1.521162522956729, + 0.13672848045825958, + 0.314159769564867, + 0.4606015384197235, + 0.4260261580348015, + 0.4450622834265232, + 0.43750863522291183, + 0.062342116609215736, + 0.0, + 0.028408324345946312, + 0.3433879278600216, + 0.14349437691271305, + 0.1704302802681923, + 0.5651533529162407, + 0.2210295982658863, + 0.03913075849413872, + 0.1739663165062666, + 0.6243718881160021, + 0.0, + 0.6636821366846561, + 0.12096988782286644, + 0.04621908813714981, + 0.18475933372974396, + 0.3028338421136141, + 0.0, + 0.34471234306693077, + 0.0, + 0.4794101621955633, + 0.17998051270842552, + 0.8219463769346476, + 0.3319842666387558, + 0.5339826848357916, + 0.09245101734995842, + 0.08416881039738655, + 0.07941672950983047, + 0.3972117677330971, + 0.09163277968764305, + 0.21989110112190247, + 0.0402669757604599, + 0.13874650187790394, + 0.7850757949054241, + 0.0, + 0.0, + 0.10408098623156548, + 0.1366056650876999, + 0.10533642210066319, + 0.024865681305527687, + 0.0, + 0.1450704149901867, + 1.1321976967155933, + 0.6981154978275299, + 0.0, + 0.13854501396417618, + 0.2804609388113022, + 0.1483139470219612, + 0.16600670851767063, + 0.0, + 0.2190842144191265 + ], + "unique_experts": 53, + "load_cv": 0.8646059575489728, + "normalized_load_entropy": 0.9037641864825751, + "max_load_share": 0.05555555555555555 + }, + "full_input": { + "tokens": 67, + "top_k": 6, + "decisions": 402, + "ordered_route_sha256": "6e33260682ba0db177da32254a258a705ae5683b982684ac67caf15a4560db02", + "route_weight_sha256": "ae7b9bfa0b8959dc85b081ab46aa1d08344557ef668472765ad285a7ce7f4545", + "loads": [ + 0, + 12, + 1, + 3, + 12, + 0, + 22, + 2, + 5, + 7, + 5, + 12, + 7, + 4, + 2, + 2, + 11, + 5, + 3, + 16, + 4, + 4, + 7, + 7, + 0, + 9, + 3, + 1, + 3, + 8, + 0, + 5, + 3, + 9, + 4, + 20, + 2, + 17, + 2, + 11, + 1, + 11, + 4, + 5, + 1, + 9, + 23, + 2, + 4, + 3, + 11, + 9, + 1, + 0, + 3, + 19, + 17, + 0, + 3, + 14, + 3, + 5, + 0, + 4 + ], + "weighted_loads": [ + 0.0, + 0.5219455934129655, + 0.05529198423027992, + 0.12763134017586708, + 1.0032528582960367, + 0.0, + 2.3867823723703623, + 0.13672848045825958, + 0.314159769564867, + 0.4606015384197235, + 0.4260261580348015, + 0.7841609455645084, + 0.43750863522291183, + 0.09037633845582604, + 0.12559539824724197, + 0.0584098007529974, + 0.6643242165446281, + 0.14752681320533156, + 0.1704302802681923, + 1.0545030981302261, + 0.2647138461470604, + 0.18976915627717972, + 1.6681622546166182, + 0.6600704547017813, + 0.0, + 0.6914383880794048, + 0.12096988782286644, + 0.04621908813714981, + 0.18475933372974396, + 0.48170470260083675, + 0.0, + 0.34471234306693077, + 0.08859229274094105, + 0.4794101621955633, + 0.2142825499176979, + 1.352876028046012, + 0.3319842666387558, + 1.2745907064527273, + 0.09245101734995842, + 0.4487520921975374, + 0.07941672950983047, + 0.7953182905912399, + 0.14954627119004726, + 0.21989110112190247, + 0.0402669757604599, + 0.27191765466704965, + 2.2908219173550606, + 0.022344991331920028, + 0.21411238983273506, + 0.10408098623156548, + 0.6256591267883778, + 0.41093376092612743, + 0.024865681305527687, + 0.0, + 0.1450704149901867, + 1.8990030698478222, + 1.847500093281269, + 0.0, + 0.13854501396417618, + 1.2428382262587547, + 0.1483139470219612, + 0.16600670851767063, + 0.0, + 0.2190842144191265 + ], + "unique_experts": 57, + "load_cv": 0.9229492676253301, + "normalized_load_entropy": 0.9012018074661995, + "max_load_share": 0.05721393034825871 + } + }, + "s1_eos": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "74f5b45a59a7d214455ccf8c3779ed036287dc802f19115927ab236d86f1b2c8", + "route_weight_sha256": "ad5e53b1bbd1468d3eac88f29ae1c31067bcd95334691ac324f82b23aa21c120", + "loads": [ + 0, + 9, + 1, + 3, + 11, + 0, + 14, + 2, + 5, + 7, + 5, + 7, + 7, + 2, + 0, + 1, + 6, + 4, + 3, + 8, + 3, + 1, + 5, + 6, + 0, + 8, + 4, + 1, + 3, + 5, + 0, + 5, + 2, + 12, + 3, + 14, + 2, + 7, + 2, + 1, + 1, + 6, + 2, + 5, + 1, + 4, + 9, + 0, + 0, + 3, + 2, + 2, + 0, + 0, + 3, + 9, + 7, + 0, + 3, + 5, + 2, + 5, + 0, + 4 + ], + "weighted_loads": [ + 0.0, + 0.4655935652554035, + 0.055026620626449585, + 0.1275636963546276, + 0.9459864795207977, + 0.0, + 1.5304926373064518, + 0.13366838172078133, + 0.3130338527262211, + 0.4481749124825001, + 0.4410717561841011, + 0.4452362097799778, + 0.42980628460645676, + 0.06286520510911942, + 0.0, + 0.028177410364151, + 0.34083331748843193, + 0.14171415381133556, + 0.16908466070890427, + 0.5799044165760279, + 0.23180871084332466, + 0.038916975259780884, + 0.17186765372753143, + 0.6299591418355703, + 0.0, + 0.6555352732539177, + 0.14571397565305233, + 0.04736992344260216, + 0.1802906859666109, + 0.29880348965525627, + 0.0, + 0.3472989425063133, + 0.06394409388303757, + 0.5801209677010775, + 0.18242500722408295, + 0.8275150991976261, + 0.3304504454135895, + 0.4830964170396328, + 0.09374655783176422, + 0.04990019276738167, + 0.07883013784885406, + 0.4005545899271965, + 0.09219837933778763, + 0.21916687488555908, + 0.039678290486335754, + 0.1366884931921959, + 0.6971785984933376, + 0.0, + 0.0, + 0.10594353266060352, + 0.09385662153363228, + 0.10594659298658371, + 0.0, + 0.0, + 0.14194662123918533, + 1.138100042939186, + 0.6335491389036179, + 0.0, + 0.13625121116638184, + 0.2801565118134022, + 0.11848536506295204, + 0.16739686019718647, + 0.0, + 0.21798428893089294 + ], + "unique_experts": 53, + "load_cv": 0.8796286350792006, + "normalized_load_entropy": 0.9016563220594974, + "max_load_share": 0.05555555555555555 + }, + "full_input": { + "tokens": 83, + "top_k": 6, + "decisions": 498, + "ordered_route_sha256": "9cf9f59a257bad10ee2697006915d795825713339f49e2ca28afb38393fb64ff", + "route_weight_sha256": "555e5a276fb0ade57d131c86b95580410d0fb0d3749debdf32794eb428c208c8", + "loads": [ + 0, + 11, + 4, + 4, + 13, + 0, + 28, + 3, + 10, + 13, + 5, + 17, + 11, + 4, + 9, + 2, + 16, + 5, + 5, + 18, + 5, + 5, + 7, + 7, + 1, + 9, + 4, + 2, + 4, + 8, + 0, + 8, + 8, + 14, + 7, + 22, + 3, + 24, + 2, + 10, + 1, + 12, + 4, + 5, + 2, + 8, + 25, + 2, + 3, + 3, + 10, + 8, + 1, + 3, + 3, + 20, + 24, + 0, + 3, + 16, + 8, + 5, + 0, + 4 + ], + "weighted_loads": [ + 0.0, + 0.5052744476124644, + 0.19640390947461128, + 0.16472327709197998, + 1.0955161955207586, + 0.0, + 2.770795403048396, + 0.19538214057683945, + 0.6519454717636108, + 1.1574556566774845, + 0.4410717561841011, + 1.0773181356489658, + 0.7588098533451557, + 0.09116386948153377, + 0.666518297046423, + 0.13942790776491165, + 1.0815813578665257, + 0.14577356074005365, + 0.316792793571949, + 1.2734266836196184, + 0.3223671577870846, + 0.26276176050305367, + 1.6640306562185287, + 0.6652259398251772, + 0.032244231551885605, + 0.6912685558199883, + 0.14571397565305233, + 0.07381313480436802, + 0.21704460866749287, + 0.5069404281675816, + 0.0, + 0.5463672578334808, + 0.24802331812679768, + 0.6620425637811422, + 0.4413159489631653, + 1.5831310972571373, + 0.3649123050272465, + 1.7847483158111572, + 0.09374655783176422, + 0.5224864780902863, + 0.07883013784885406, + 0.8414426911622286, + 0.15018063969910145, + 0.21916687488555908, + 0.12384045869112015, + 0.2354569381568581, + 2.5086935870349407, + 0.02237329655326903, + 0.17345501482486725, + 0.10594353266060352, + 0.6254777126014233, + 0.3463466875255108, + 0.03700830787420273, + 0.16901040449738503, + 0.14194662123918533, + 2.1544998846948147, + 2.392568465322256, + 0.0, + 0.13625121116638184, + 1.333889463916421, + 0.42490747943520546, + 0.16739686019718647, + 0.0, + 0.21798428893089294 + ], + "unique_experts": 59, + "load_cv": 0.8770757014649444, + "normalized_load_entropy": 0.9120966380412248, + "max_load_share": 0.05622489959839357 + } + }, + "s0_bos": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "089b32f245e035192e80b011841b9dc8f56b9bf4d959c13b252b7bfa1a933921", + "route_weight_sha256": "d59dfc315faa28046fc88aed7e1372f24f7ee8438b3321c121649c4c22fc3faa", + "loads": [ + 0, + 7, + 1, + 3, + 12, + 0, + 13, + 2, + 5, + 7, + 5, + 7, + 7, + 1, + 0, + 0, + 5, + 6, + 3, + 7, + 3, + 1, + 4, + 5, + 1, + 8, + 5, + 1, + 3, + 5, + 0, + 5, + 1, + 10, + 3, + 14, + 2, + 7, + 2, + 2, + 2, + 6, + 3, + 5, + 1, + 4, + 11, + 1, + 0, + 3, + 4, + 1, + 0, + 0, + 3, + 10, + 7, + 0, + 3, + 5, + 2, + 4, + 0, + 4 + ], + "weighted_loads": [ + 0.0, + 0.3593881279230118, + 0.05562624707818031, + 0.13460423052310944, + 1.022655624896288, + 0.0, + 1.492105569690466, + 0.1384274736046791, + 0.3301009051501751, + 0.4488713704049587, + 0.42204537615180016, + 0.4494820833206177, + 0.43736038357019424, + 0.029630953446030617, + 0.0, + 0.0, + 0.31287768483161926, + 0.20150052942335606, + 0.16396785154938698, + 0.5176333915442228, + 0.21666910126805305, + 0.03957430645823479, + 0.14366459101438522, + 0.5900976657867432, + 0.02476787194609642, + 0.6712157055735588, + 0.17937583662569523, + 0.04686448723077774, + 0.18968896195292473, + 0.3414589427411556, + 0.0, + 0.3451174423098564, + 0.034489624202251434, + 0.5375040788203478, + 0.17598792724311352, + 0.836462676525116, + 0.33168967068195343, + 0.4586881585419178, + 0.08977627381682396, + 0.08815504983067513, + 0.10508971475064754, + 0.38306333124637604, + 0.12483140081167221, + 0.23862382397055626, + 0.03990890458226204, + 0.13852575793862343, + 0.7363590076565742, + 0.028818072751164436, + 0.0, + 0.08342643827199936, + 0.20046401768922806, + 0.08480331301689148, + 0.0, + 0.0, + 0.14350711181759834, + 1.0965548437088728, + 0.7134129069745541, + 0.0, + 0.15088199824094772, + 0.2666084300726652, + 0.11763974279165268, + 0.1385655663907528, + 0.0, + 0.21802392043173313 + ], + "unique_experts": 54, + "load_cv": 0.861101967620244, + "normalized_load_entropy": 0.9057495388803228, + "max_load_share": 0.05555555555555555 + }, + "full_input": { + "tokens": 67, + "top_k": 6, + "decisions": 402, + "ordered_route_sha256": "68d60215db08f78a3b2dfd7747f10de3e7129a097e8acbd59781535fa1b279eb", + "route_weight_sha256": "f08ae36e062fa2a3d69bdc63b494a84bac231cab123e02ce4ff9dc1b00f88d60", + "loads": [ + 0, + 9, + 1, + 3, + 13, + 0, + 21, + 2, + 5, + 7, + 5, + 12, + 7, + 2, + 3, + 2, + 11, + 6, + 3, + 15, + 4, + 4, + 5, + 6, + 1, + 9, + 5, + 1, + 3, + 9, + 0, + 5, + 4, + 10, + 4, + 20, + 2, + 17, + 2, + 11, + 2, + 11, + 6, + 5, + 1, + 8, + 25, + 2, + 4, + 3, + 11, + 8, + 0, + 0, + 3, + 20, + 17, + 0, + 3, + 14, + 2, + 4, + 0, + 4 + ], + "weighted_loads": [ + 0.0, + 0.4253404587507248, + 0.05562624707818031, + 0.13460423052310944, + 1.0512482058256865, + 0.0, + 2.458406239748001, + 0.1384274736046791, + 0.3301009051501751, + 0.4488713704049587, + 0.42204537615180016, + 0.7911943420767784, + 0.43736038357019424, + 0.05273698270320892, + 0.17588210105895996, + 0.07676414400339127, + 0.6637804768979549, + 0.20150052942335606, + 0.16396785154938698, + 1.0052700359374285, + 0.26035334914922714, + 0.19445296004414558, + 0.6898433491587639, + 0.6257962323725224, + 0.02476787194609642, + 0.6989719569683075, + 0.17937583662569523, + 0.04686448723077774, + 0.18968896195292473, + 0.5668986439704895, + 0.0, + 0.3451174423098564, + 0.12308191694319248, + 0.5375040788203478, + 0.2102899644523859, + 1.379832934588194, + 0.33168967068195343, + 1.2413738779723644, + 0.08977627381682396, + 0.448528153821826, + 0.10508971475064754, + 0.7811698541045189, + 0.2294334340840578, + 0.23862382397055626, + 0.03990890458226204, + 0.26768206246197224, + 2.3599900007247925, + 0.047922734171152115, + 0.2227209098637104, + 0.08342643827199936, + 0.6833003386855125, + 0.39040065184235573, + 0.0, + 0.0, + 0.14350711181759834, + 1.8633602168411016, + 1.8231900669634342, + 0.0, + 0.15088199824094772, + 1.2289857175201178, + 0.11763974279165268, + 0.1385655663907528, + 0.0, + 0.21802392043173313 + ], + "unique_experts": 57, + "load_cv": 0.9280840833889753, + "normalized_load_entropy": 0.901620505039125, + "max_load_share": 0.06218905472636816 + } + }, + "s1_bos": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "b87ebc5028c0866f7cb7b2c4fbc85e3259a38599f341a846017d16d885b1e7d9", + "route_weight_sha256": "266bc5ae1bea974ee581b335d21d9071aa315bc716198ef2a4cf9214a93a38f3", + "loads": [ + 0, + 9, + 1, + 3, + 12, + 0, + 13, + 2, + 5, + 7, + 5, + 7, + 7, + 2, + 0, + 1, + 5, + 4, + 3, + 8, + 3, + 1, + 4, + 5, + 2, + 8, + 4, + 1, + 3, + 5, + 0, + 5, + 2, + 12, + 3, + 14, + 2, + 7, + 2, + 2, + 2, + 6, + 1, + 5, + 1, + 4, + 10, + 2, + 0, + 2, + 3, + 1, + 0, + 0, + 3, + 8, + 7, + 0, + 3, + 5, + 2, + 4, + 0, + 4 + ], + "weighted_loads": [ + 0.0, + 0.4497731402516365, + 0.056530777364969254, + 0.1367357112467289, + 0.9897838309407234, + 0.0, + 1.5366039406508207, + 0.14022494852542877, + 0.33806129172444344, + 0.43120963871479034, + 0.41831754706799984, + 0.44316941499710083, + 0.4293515533208847, + 0.060171084478497505, + 0.0, + 0.027712387964129448, + 0.31487155705690384, + 0.13310931622982025, + 0.1631188951432705, + 0.5938232112675905, + 0.22248698398470879, + 0.040615446865558624, + 0.13424501568078995, + 0.609715037047863, + 0.054084718227386475, + 0.6783632785081863, + 0.1496974416077137, + 0.04816479608416557, + 0.1877557747066021, + 0.33363346941769123, + 0.0, + 0.348099909722805, + 0.06906740367412567, + 0.5915132742375135, + 0.1834040880203247, + 0.8407235741615295, + 0.33310575783252716, + 0.45717718452215195, + 0.09536764398217201, + 0.08647648990154266, + 0.09981263801455498, + 0.39009038358926773, + 0.05924100801348686, + 0.24033669382333755, + 0.04249608516693115, + 0.14161155000329018, + 0.6958963871002197, + 0.047709355130791664, + 0.0, + 0.06583075597882271, + 0.14143235608935356, + 0.08547110855579376, + 0.0, + 0.0, + 0.14061346650123596, + 1.0577163770794868, + 0.6395887732505798, + 0.0, + 0.14529260620474815, + 0.2635735757648945, + 0.12007796764373779, + 0.14601365476846695, + 0.0, + 0.21782321110367775 + ], + "unique_experts": 55, + "load_cv": 0.8599307981321611, + "normalized_load_entropy": 0.9089912224927453, + "max_load_share": 0.05555555555555555 + }, + "full_input": { + "tokens": 83, + "top_k": 6, + "decisions": 498, + "ordered_route_sha256": "b73480195e8b0aa615fdee6032bbd0583c007807910796c273b3b0ac43ef9d35", + "route_weight_sha256": "53331ec37eadd435abad3da2df7e78627b6679016c267a5be6542f1ff4cbe1bc", + "loads": [ + 0, + 10, + 4, + 4, + 14, + 0, + 28, + 3, + 10, + 13, + 5, + 17, + 11, + 3, + 9, + 3, + 16, + 4, + 5, + 18, + 5, + 5, + 5, + 6, + 3, + 9, + 4, + 2, + 4, + 8, + 0, + 8, + 8, + 14, + 7, + 22, + 3, + 25, + 2, + 11, + 2, + 12, + 3, + 5, + 2, + 7, + 27, + 4, + 3, + 2, + 11, + 7, + 1, + 3, + 3, + 19, + 24, + 0, + 3, + 16, + 8, + 4, + 0, + 4 + ], + "weighted_loads": [ + 0.0, + 0.48468751832842827, + 0.19790806621313095, + 0.17389529198408127, + 1.1393135469406843, + 0.0, + 2.847617167979479, + 0.2019387073814869, + 0.6769729107618332, + 1.1404903829097748, + 0.41831754706799984, + 1.0836447104811668, + 0.7583551220595837, + 0.08327711373567581, + 0.6712738759815693, + 0.19217596389353275, + 1.0856000110507011, + 0.13310931622982025, + 0.31082702800631523, + 1.2861175257712603, + 0.3130454309284687, + 0.2676996849477291, + 0.6804237738251686, + 0.6449818350374699, + 0.08632894977927208, + 0.7140965610742569, + 0.1496974416077137, + 0.07460800744593143, + 0.22450969740748405, + 0.5388767961412668, + 0.0, + 0.5471682250499725, + 0.2561205383390188, + 0.6714683901518583, + 0.44229502975940704, + 1.6236054264008999, + 0.36756761744618416, + 1.8375756740570068, + 0.09536764398217201, + 0.5590627752244473, + 0.09981263801455498, + 0.8309784848242998, + 0.11722326837480068, + 0.24033669382333755, + 0.12665825337171555, + 0.23660176806151867, + 2.6470847986638546, + 0.122917540371418, + 0.19135965406894684, + 0.06583075597882271, + 0.7067698761820793, + 0.32587120309472084, + 0.03700830787420273, + 0.16901040449738503, + 0.14061346650123596, + 2.0741162188351154, + 2.4297006241977215, + 0.0, + 0.14529260620474815, + 1.3173065278679132, + 0.4265000820159912, + 0.14601365476846695, + 0.0, + 0.21782321110367775 + ], + "unique_experts": 59, + "load_cv": 0.8896375534635645, + "normalized_load_entropy": 0.9118250718215873, + "max_load_share": 0.05622489959839357 + } + }, + "s0_x": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "9e13cca0f18d87b41f521f74b3592b554e26898afbd81a0d89cad3f465b25119", + "route_weight_sha256": "04dd7ddda3e650cfed449ed4bad684098072357b151ff5a82e41e643654bfbd5", + "loads": [ + 0, + 7, + 1, + 3, + 11, + 0, + 14, + 2, + 6, + 7, + 5, + 8, + 7, + 2, + 0, + 1, + 4, + 6, + 3, + 7, + 3, + 1, + 5, + 5, + 1, + 8, + 3, + 1, + 3, + 5, + 0, + 5, + 1, + 9, + 2, + 14, + 2, + 8, + 2, + 3, + 2, + 6, + 2, + 5, + 1, + 3, + 10, + 1, + 0, + 2, + 4, + 2, + 0, + 0, + 3, + 9, + 7, + 0, + 4, + 5, + 2, + 5, + 0, + 4 + ], + "weighted_loads": [ + 0.0, + 0.36431047320365906, + 0.05318918451666832, + 0.1291176602244377, + 0.9729883037507534, + 0.0, + 1.5610684771090746, + 0.13533729314804077, + 0.36873381584882736, + 0.4538186602294445, + 0.4175715185701847, + 0.48042871803045273, + 0.4329560846090317, + 0.061920732259750366, + 0.0, + 0.02796284854412079, + 0.2768244631588459, + 0.20274857617914677, + 0.15866640582680702, + 0.5244255103170872, + 0.21738051250576973, + 0.03919310122728348, + 0.1822946723550558, + 0.6011791862547398, + 0.024022690951824188, + 0.660271443426609, + 0.12475107610225677, + 0.044662561267614365, + 0.1984955184161663, + 0.34300488233566284, + 0.0, + 0.3445402570068836, + 0.03447480499744415, + 0.48797596618533134, + 0.15278328955173492, + 0.8489946164190769, + 0.3523610532283783, + 0.5253346990793943, + 0.09053909033536911, + 0.11485417559742928, + 0.1070171669125557, + 0.38203011080622673, + 0.09501581639051437, + 0.25158003717660904, + 0.04016600549221039, + 0.10468470863997936, + 0.7257700636982918, + 0.029110876843333244, + 0.0, + 0.06261635199189186, + 0.20711935311555862, + 0.10611775703728199, + 0.0, + 0.0, + 0.14083118364214897, + 1.0740036629140377, + 0.6026966385543346, + 0.0, + 0.18651529774069786, + 0.2599653471261263, + 0.11710260435938835, + 0.1770135909318924, + 0.0, + 0.21010300517082214 + ], + "unique_experts": 55, + "load_cv": 0.8469410521875619, + "normalized_load_entropy": 0.9098108154938633, + "max_load_share": 0.05555555555555555 + }, + "full_input": { + "tokens": 67, + "top_k": 6, + "decisions": 402, + "ordered_route_sha256": "9b45e73e7472d38f0194cb6624c12f0e432efc691bf242c81f8a3d4ae4528154", + "route_weight_sha256": "fd0ab09830714154f2d38a0381c4e98c37df33b7fa95ccd835536917aa1d416e", + "loads": [ + 0, + 9, + 1, + 3, + 12, + 0, + 24, + 2, + 6, + 7, + 5, + 12, + 7, + 3, + 3, + 3, + 9, + 6, + 3, + 16, + 4, + 4, + 6, + 6, + 1, + 9, + 3, + 1, + 3, + 8, + 0, + 5, + 4, + 9, + 3, + 20, + 2, + 18, + 2, + 11, + 2, + 13, + 5, + 5, + 1, + 7, + 23, + 2, + 4, + 2, + 9, + 10, + 0, + 0, + 3, + 20, + 16, + 0, + 4, + 15, + 2, + 5, + 0, + 4 + ], + "weighted_loads": [ + 0.0, + 0.43026280403137207, + 0.05318918451666832, + 0.1291176602244377, + 1.001580884680152, + 0.0, + 2.8193916585296392, + 0.13533729314804077, + 0.36873381584882736, + 0.4538186602294445, + 0.4175715185701847, + 0.7697178237140179, + 0.4329560846090317, + 0.08502676151692867, + 0.17091405019164085, + 0.10164929926395416, + 0.5810560621321201, + 0.20274857617914677, + 0.15866640582680702, + 1.0770785063505173, + 0.2610647603869438, + 0.1933916211128235, + 0.7284734304994345, + 0.636877752840519, + 0.024022690951824188, + 0.6880276948213577, + 0.12475107610225677, + 0.044662561267614365, + 0.1984955184161663, + 0.5168631561100483, + 0.0, + 0.3445402570068836, + 0.1230670977383852, + 0.48797596618533134, + 0.1870853267610073, + 1.421228215098381, + 0.3523610532283783, + 1.26682966388762, + 0.09053909033536911, + 0.43254934437572956, + 0.1070171669125557, + 0.9192180596292019, + 0.18666747026145458, + 0.25158003717660904, + 0.04016600549221039, + 0.23384101316332817, + 2.0712030716240406, + 0.04821553826332092, + 0.2275121621787548, + 0.06261635199189186, + 0.5636716224253178, + 0.4467282947152853, + 0.0, + 0.0, + 0.14083118364214897, + 1.8966104239225388, + 1.5496957637369633, + 0.0, + 0.18651529774069786, + 1.2973385471850634, + 0.11710260435938835, + 0.1770135909318924, + 0.0, + 0.21010300517082214 + ], + "unique_experts": 57, + "load_cv": 0.9361566099148, + "normalized_load_entropy": 0.9009960234857479, + "max_load_share": 0.05970149253731343 + } + }, + "s1_x": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "c04511330ccdaa2ae60535b89175ee8288361aea7f59220a1de976012cfdebb3", + "route_weight_sha256": "8f12faa2485c820be0555ecfe457272c9e4497020f2d26b3c00e3b8d80f2d8bd", + "loads": [ + 0, + 8, + 1, + 3, + 11, + 0, + 13, + 2, + 5, + 7, + 4, + 8, + 7, + 1, + 0, + 1, + 5, + 4, + 3, + 7, + 3, + 1, + 4, + 5, + 2, + 8, + 3, + 1, + 3, + 3, + 0, + 5, + 1, + 11, + 3, + 14, + 2, + 9, + 2, + 3, + 3, + 7, + 2, + 6, + 1, + 4, + 9, + 2, + 2, + 2, + 4, + 1, + 0, + 0, + 3, + 8, + 7, + 0, + 3, + 5, + 2, + 4, + 0, + 4 + ], + "weighted_loads": [ + 0.0, + 0.4130310080945492, + 0.05436323210597038, + 0.13165020570158958, + 0.895459771156311, + 0.0, + 1.5683647319674492, + 0.13691970705986023, + 0.3380863815546036, + 0.43030981346964836, + 0.371051624417305, + 0.49727610498666763, + 0.42781366407871246, + 0.02859402447938919, + 0.0, + 0.028657948598265648, + 0.31247130781412125, + 0.13515318557620049, + 0.15905079618096352, + 0.5415244661271572, + 0.22208276763558388, + 0.040498312562704086, + 0.13817187771201134, + 0.591356098651886, + 0.05753922834992409, + 0.6577957049012184, + 0.12814882770180702, + 0.04617014899849892, + 0.19656863436102867, + 0.2689087688922882, + 0.0, + 0.3449976108968258, + 0.03162309154868126, + 0.5536329727619886, + 0.193369522690773, + 0.8279733844101429, + 0.3513465076684952, + 0.5624188613146544, + 0.09548689424991608, + 0.11507629975676537, + 0.12300850264728069, + 0.443634532392025, + 0.09089291840791702, + 0.29140976816415787, + 0.04087613523006439, + 0.14140281826257706, + 0.6695281527936459, + 0.050896888598799706, + 0.06101295351982117, + 0.06672826409339905, + 0.19821877777576447, + 0.0887155830860138, + 0.0, + 0.0, + 0.13929464668035507, + 1.0414450913667679, + 0.5249063409864902, + 0.0, + 0.14470960572361946, + 0.257010031491518, + 0.12170133367180824, + 0.15021993592381477, + 0.0, + 0.21107344143092632 + ], + "unique_experts": 56, + "load_cv": 0.8361629962581538, + "normalized_load_entropy": 0.9137437484583536, + "max_load_share": 0.05555555555555555 + }, + "full_input": { + "tokens": 83, + "top_k": 6, + "decisions": 498, + "ordered_route_sha256": "39a03769bef7bb3db7529f0c74afad4b9e19f7f7d71f438b8110fa0a379a882e", + "route_weight_sha256": "28ea286b704c3c757073d8027c044066825556159fbb6a775b4cfd3b97fcb8fd", + "loads": [ + 0, + 9, + 4, + 4, + 13, + 0, + 30, + 3, + 10, + 13, + 4, + 17, + 11, + 2, + 9, + 3, + 15, + 4, + 5, + 19, + 5, + 5, + 5, + 6, + 4, + 9, + 3, + 2, + 4, + 6, + 0, + 8, + 6, + 13, + 7, + 22, + 3, + 25, + 2, + 12, + 3, + 15, + 4, + 6, + 2, + 7, + 24, + 3, + 5, + 2, + 11, + 8, + 1, + 3, + 3, + 20, + 23, + 0, + 3, + 17, + 8, + 4, + 0, + 4 + ], + "weighted_loads": [ + 0.0, + 0.44794538617134094, + 0.19574052095413208, + 0.16880978643894196, + 1.044989487156272, + 0.0, + 3.2208882216364145, + 0.19863346591591835, + 0.6769980005919933, + 1.1395905576646328, + 0.371051624417305, + 1.084912233054638, + 0.7568172328174114, + 0.0517000537365675, + 0.6702181547880173, + 0.209350248798728, + 1.0343229994177818, + 0.13515318557620049, + 0.30675892904400826, + 1.3409116752445698, + 0.3126412145793438, + 0.2606142722070217, + 0.68435063585639, + 0.6266228966414928, + 0.12388038262724876, + 0.693528987467289, + 0.12814882770180702, + 0.07261336036026478, + 0.23332255706191063, + 0.466098390519619, + 0.0, + 0.5440659262239933, + 0.17884823493659496, + 0.63365070335567, + 0.45226046442985535, + 1.6113361120224, + 0.3858083672821522, + 1.7858667466789484, + 0.09548689424991608, + 0.58766258507967, + 0.12300850264728069, + 1.0170954037457705, + 0.14887517876923084, + 0.29140976816415787, + 0.12503830343484879, + 0.23639303632080555, + 2.303333256393671, + 0.07000155001878738, + 0.2565395012497902, + 0.06672826409339905, + 0.6831504665315151, + 0.3586387112736702, + 0.03700830787420273, + 0.16901040449738503, + 0.13929464668035507, + 2.1275120116770267, + 2.1327145472168922, + 0.0, + 0.14470960572361946, + 1.3835561517626047, + 0.42812344804406166, + 0.15021993592381477, + 0.0, + 0.21107344143092632 + ], + "unique_experts": 59, + "load_cv": 0.8899275797728526, + "normalized_load_entropy": 0.9119223461796976, + "max_load_share": 0.060240963855421686 + } + }, + "s0_period": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "debb13a8c773b55c5157d2d66d03af5e79f5a13909015b7ab7b84956ddc64ead", + "route_weight_sha256": "6fee9dd537e92fadb767de166a802a15c0b3c9980ce2584b22f695e6ded8e82e", + "loads": [ + 0, + 8, + 1, + 3, + 11, + 0, + 14, + 2, + 6, + 7, + 4, + 7, + 7, + 2, + 0, + 1, + 6, + 5, + 3, + 7, + 3, + 1, + 5, + 5, + 1, + 8, + 3, + 1, + 3, + 4, + 0, + 5, + 0, + 8, + 2, + 15, + 2, + 10, + 2, + 3, + 2, + 6, + 2, + 5, + 1, + 3, + 10, + 2, + 0, + 2, + 4, + 1, + 0, + 0, + 3, + 8, + 7, + 0, + 4, + 5, + 3, + 5, + 0, + 4 + ], + "weighted_loads": [ + 0.0, + 0.40792013332247734, + 0.05356272682547569, + 0.12861033529043198, + 0.9739805497229099, + 0.0, + 1.5628948714584112, + 0.1364387534558773, + 0.37248343229293823, + 0.4571734182536602, + 0.37958957254886627, + 0.45000186190009117, + 0.4303109794855118, + 0.06163916364312172, + 0.0, + 0.026493139564990997, + 0.34473127499222755, + 0.17224243469536304, + 0.15845709294080734, + 0.5317203868180513, + 0.2195756882429123, + 0.03907235711812973, + 0.18363798409700394, + 0.6067455559968948, + 0.023509791120886803, + 0.6525041498243809, + 0.11932020261883736, + 0.044710446149110794, + 0.19402047246694565, + 0.2960383761674166, + 0.0, + 0.34096022322773933, + 0.0, + 0.43123362213373184, + 0.15050656720995903, + 0.8747246135026217, + 0.3511175811290741, + 0.6515205670148134, + 0.0917348675429821, + 0.11892833933234215, + 0.10519351623952389, + 0.3899925649166107, + 0.0936704371124506, + 0.2396732233464718, + 0.0403481163084507, + 0.1023745909333229, + 0.6970375627279282, + 0.04852594994008541, + 0.0, + 0.06241418048739433, + 0.2061476670205593, + 0.08602753281593323, + 0.0, + 0.0, + 0.14114229753613472, + 1.0423609912395477, + 0.6028745509684086, + 0.0, + 0.18439708277583122, + 0.2620408032089472, + 0.14905392192304134, + 0.17351417988538742, + 0.0, + 0.20965966023504734 + ], + "unique_experts": 54, + "load_cv": 0.8622715463835601, + "normalized_load_entropy": 0.9067643419647893, + "max_load_share": 0.05952380952380952 + }, + "full_input": { + "tokens": 67, + "top_k": 6, + "decisions": 402, + "ordered_route_sha256": "3e95ad848995b3ad57dc3a705b3e9194876f45d8b9e82a863e5d4c656bd2921f", + "route_weight_sha256": "cda1c221a3a52333b19257c5a18d5e3fc0789204f8f8bc3ce91545280c6643df", + "loads": [ + 0, + 10, + 1, + 3, + 12, + 0, + 24, + 2, + 6, + 7, + 4, + 11, + 8, + 3, + 2, + 3, + 10, + 5, + 3, + 17, + 4, + 4, + 6, + 6, + 1, + 9, + 3, + 1, + 4, + 7, + 0, + 5, + 3, + 8, + 3, + 21, + 2, + 20, + 2, + 12, + 2, + 12, + 5, + 5, + 1, + 7, + 23, + 3, + 4, + 2, + 9, + 9, + 0, + 0, + 3, + 19, + 16, + 0, + 4, + 14, + 3, + 5, + 0, + 4 + ], + "weighted_loads": [ + 0.0, + 0.47387246415019035, + 0.05356272682547569, + 0.12861033529043198, + 1.0025731306523085, + 0.0, + 2.6894886437803507, + 0.1364387534558773, + 0.37248343229293823, + 0.4571734182536602, + 0.37958957254886627, + 0.7364013493061066, + 0.48211487755179405, + 0.08474519290030003, + 0.12781894207000732, + 0.09426095709204674, + 0.6099005788564682, + 0.17224243469536304, + 0.15845709294080734, + 1.1738598067313433, + 0.2632599361240864, + 0.19142130389809608, + 0.7298167422413826, + 0.642444122582674, + 0.023509791120886803, + 0.6802604012191296, + 0.11932020261883736, + 0.044710446149110794, + 0.2986016795039177, + 0.47141576372087, + 0.0, + 0.34096022322773933, + 0.08859229274094105, + 0.43123362213373184, + 0.18480860441923141, + 1.4442191999405622, + 0.3511175811290741, + 1.4760616030544043, + 0.0917348675429821, + 0.4743189197033644, + 0.10519351623952389, + 0.8442904986441135, + 0.1885317899286747, + 0.2396732233464718, + 0.0403481163084507, + 0.23153089545667171, + 2.02351862937212, + 0.06763061136007309, + 0.22424867376685143, + 0.06241418048739433, + 0.563433263450861, + 0.4261302091181278, + 0.0, + 0.0, + 0.14114229753613472, + 1.9558378830552101, + 1.5475133024156094, + 0.0, + 0.18439708277583122, + 1.2244180906563997, + 0.14905392192304134, + 0.17351417988538742, + 0.0, + 0.20965966023504734 + ], + "unique_experts": 57, + "load_cv": 0.9454176376299751, + "normalized_load_entropy": 0.9001841942653599, + "max_load_share": 0.05970149253731343 + } + }, + "s1_period": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "9e2dfca9f4dc1ce860f34aa86a12300d3b9e4134356c6424daf8c9bbc963c9dc", + "route_weight_sha256": "f2d0991d507e77364cd79c32f170664cf4be148dd5f9f472f9525473e1d781d5", + "loads": [ + 0, + 8, + 1, + 3, + 11, + 0, + 13, + 2, + 5, + 7, + 4, + 8, + 7, + 1, + 0, + 1, + 5, + 5, + 3, + 8, + 3, + 1, + 4, + 5, + 2, + 8, + 3, + 1, + 2, + 4, + 0, + 5, + 1, + 11, + 3, + 15, + 2, + 9, + 2, + 3, + 3, + 6, + 1, + 6, + 1, + 3, + 10, + 2, + 2, + 2, + 3, + 1, + 0, + 0, + 3, + 8, + 7, + 0, + 3, + 5, + 2, + 4, + 0, + 4 + ], + "weighted_loads": [ + 0.0, + 0.4171736538410187, + 0.05380880460143089, + 0.1323033832013607, + 0.9151937961578369, + 0.0, + 1.5761824175715446, + 0.13652649521827698, + 0.34042271226644516, + 0.4395512640476227, + 0.36267224699258804, + 0.481788232922554, + 0.4192659556865692, + 0.028868485242128372, + 0.0, + 0.02846665121614933, + 0.30565696954727173, + 0.16639527678489685, + 0.15730459243059158, + 0.5767662953585386, + 0.22195177152752876, + 0.04050737991929054, + 0.13629070855677128, + 0.5998671017587185, + 0.05957973748445511, + 0.644811350852251, + 0.12731609866023064, + 0.045629117637872696, + 0.15943827107548714, + 0.2891312837600708, + 0.0, + 0.344612792134285, + 0.03700987249612808, + 0.5443427227437496, + 0.1977056749165058, + 0.8729394115507603, + 0.352638378739357, + 0.581585330888629, + 0.0920751802623272, + 0.11543368361890316, + 0.12369116768240929, + 0.4082242585718632, + 0.05990574136376381, + 0.284374862909317, + 0.04036911949515343, + 0.10829271376132965, + 0.6831976361572742, + 0.049049779772758484, + 0.06149437837302685, + 0.06614012829959393, + 0.14293091371655464, + 0.08896010369062424, + 0.0, + 0.0, + 0.1386416107416153, + 1.0596428960561752, + 0.5135455243289471, + 0.0, + 0.14281940087676048, + 0.2610081918537617, + 0.12172289192676544, + 0.1484212428331375, + 0.0, + 0.2120092511177063 + ], + "unique_experts": 56, + "load_cv": 0.8622715463835601, + "normalized_load_entropy": 0.909903277207579, + "max_load_share": 0.05952380952380952 + }, + "full_input": { + "tokens": 83, + "top_k": 6, + "decisions": 498, + "ordered_route_sha256": "1c234415ffa9a194e18353c298c9b51838cc922a8f583000ae4d9f5b7875f837", + "route_weight_sha256": "23a8cf24e79fa26c909595dd8c0c4bd8f201726cdf88024ee06f59e891baae01", + "loads": [ + 0, + 9, + 4, + 4, + 13, + 0, + 30, + 3, + 10, + 13, + 4, + 17, + 12, + 2, + 9, + 3, + 14, + 5, + 5, + 20, + 5, + 5, + 5, + 6, + 4, + 9, + 3, + 2, + 4, + 7, + 0, + 8, + 6, + 13, + 7, + 23, + 3, + 26, + 2, + 13, + 3, + 12, + 3, + 6, + 2, + 6, + 26, + 3, + 5, + 2, + 9, + 8, + 1, + 3, + 3, + 20, + 23, + 0, + 3, + 16, + 8, + 4, + 0, + 4 + ], + "weighted_loads": [ + 0.0, + 0.45208803191781044, + 0.1951860934495926, + 0.16946296393871307, + 1.0647235121577978, + 0.0, + 3.0924542117863894, + 0.1982402540743351, + 0.6793343313038349, + 1.1488320082426071, + 0.36267224699258804, + 1.0665732994675636, + 0.8124128691852093, + 0.05197451449930668, + 0.6701820306479931, + 0.19333337433636189, + 0.9915429316461086, + 0.16639527678489685, + 0.3050127252936363, + 1.4706647489219904, + 0.3125102184712887, + 0.25873542577028275, + 0.6824694667011499, + 0.6351338997483253, + 0.12658455222845078, + 0.6805446334183216, + 0.12731609866023064, + 0.07207232899963856, + 0.32107777521014214, + 0.48642347007989883, + 0.0, + 0.5436811074614525, + 0.1842350158840418, + 0.6250867508351803, + 0.45659661665558815, + 1.6679155007004738, + 0.387100238353014, + 1.9560291972011328, + 0.0920751802623272, + 0.6236536633223295, + 0.12369116768240929, + 0.8491123598068953, + 0.11788800172507763, + 0.284374862909317, + 0.12453128769993782, + 0.20328293181955814, + 2.3318703584372997, + 0.06815444119274616, + 0.22806423716247082, + 0.06614012829959393, + 0.5684408247470856, + 0.36334434151649475, + 0.03700830787420273, + 0.16901040449738503, + 0.1386416107416153, + 2.2044934891164303, + 2.1103033646941185, + 0.0, + 0.14281940087676048, + 1.3147411439567804, + 0.42814500629901886, + 0.1484212428331375, + 0.0, + 0.2120092511177063 + ], + "unique_experts": 59, + "load_cv": 0.9045956297344265, + "normalized_load_entropy": 0.9104261160703888, + "max_load_share": 0.060240963855421686 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 42, + "ordered_topk_exact_tokens": 32, + "set_exact_tokens": 35, + "mean_set_jaccard": 0.9523809523809523, + "mean_token_weighted_tv": 0.011985050115202154, + "aggregate_load_tv": 0.023809523809523808 + }, + "system_bos": { + "tokens": 42, + "ordered_topk_exact_tokens": 25, + "set_exact_tokens": 29, + "mean_set_jaccard": 0.9115646258503403, + "mean_token_weighted_tv": 0.018341568010371356, + "aggregate_load_tv": 0.03968253968253968 + }, + "system_x": { + "tokens": 42, + "ordered_topk_exact_tokens": 18, + "set_exact_tokens": 25, + "mean_set_jaccard": 0.8792517006802721, + "mean_token_weighted_tv": 0.024358395841859636, + "aggregate_load_tv": 0.05555555555555555 + }, + "system_period": { + "tokens": 42, + "ordered_topk_exact_tokens": 18, + "set_exact_tokens": 25, + "mean_set_jaccard": 0.8843537414965985, + "mean_token_weighted_tv": 0.024152053253991262, + "aggregate_load_tv": 0.047619047619047616 + }, + "bos_at_s0": { + "tokens": 42, + "ordered_topk_exact_tokens": 23, + "set_exact_tokens": 25, + "mean_set_jaccard": 0.8792517006802721, + "mean_token_weighted_tv": 0.02702197479084134, + "aggregate_load_tv": 0.05555555555555555 + }, + "bos_at_s1": { + "tokens": 42, + "ordered_topk_exact_tokens": 27, + "set_exact_tokens": 30, + "mean_set_jaccard": 0.913265306122449, + "mean_token_weighted_tv": 0.023132260090538433, + "aggregate_load_tv": 0.03571428571428571 + }, + "x_at_s0": { + "tokens": 42, + "ordered_topk_exact_tokens": 23, + "set_exact_tokens": 26, + "mean_set_jaccard": 0.8911564625850341, + "mean_token_weighted_tv": 0.027330326803383372, + "aggregate_load_tv": 0.04365079365079365 + }, + "x_at_s1": { + "tokens": 42, + "ordered_topk_exact_tokens": 19, + "set_exact_tokens": 22, + "mean_set_jaccard": 0.8537414965986395, + "mean_token_weighted_tv": 0.03342208372695105, + "aggregate_load_tv": 0.06746031746031746 + }, + "period_at_s0": { + "tokens": 42, + "ordered_topk_exact_tokens": 27, + "set_exact_tokens": 29, + "mean_set_jaccard": 0.9064625850340136, + "mean_token_weighted_tv": 0.02619001173990823, + "aggregate_load_tv": 0.047619047619047616 + }, + "period_at_s1": { + "tokens": 42, + "ordered_topk_exact_tokens": 19, + "set_exact_tokens": 23, + "mean_set_jaccard": 0.8605442176870748, + "mean_token_weighted_tv": 0.032160541508346796, + "aggregate_load_tv": 0.07142857142857142 + } + } + }, + "layer_07": { + "layer": 7, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "a4ece8de356d5673bac5f48df7f9b1e445d6ef636390d21fd3cdadc0f70f6b4c", + "route_weight_sha256": "f178003c78cd786c927881f1f054700820c1a14c83576d870f2955d433f31e8f", + "loads": [ + 1, + 3, + 7, + 0, + 6, + 2, + 9, + 5, + 15, + 6, + 2, + 4, + 9, + 15, + 2, + 3, + 12, + 2, + 3, + 2, + 5, + 6, + 2, + 1, + 5, + 0, + 3, + 2, + 5, + 2, + 2, + 1, + 2, + 7, + 4, + 2, + 1, + 2, + 9, + 6, + 1, + 9, + 6, + 1, + 6, + 0, + 1, + 5, + 4, + 2, + 11, + 5, + 3, + 1, + 1, + 4, + 0, + 1, + 0, + 5, + 4, + 7, + 0, + 0 + ], + "weighted_loads": [ + 0.03436662629246712, + 0.14187883399426937, + 0.440213343128562, + 0.0, + 0.40313960053026676, + 0.10113205388188362, + 0.7616254985332489, + 0.3013968952000141, + 0.9886922501027584, + 0.2730141840875149, + 0.09433680400252342, + 0.16710541397333145, + 0.7616836577653885, + 1.7144406847655773, + 0.17287993431091309, + 0.112558763474226, + 1.213202878832817, + 0.1837368682026863, + 0.14432889968156815, + 0.08571946434676647, + 0.4971410408616066, + 0.3318406008183956, + 0.07103045657277107, + 0.04512902349233627, + 0.21174656972289085, + 0.0, + 0.1556059792637825, + 0.11798667535185814, + 0.2016060333698988, + 0.08862559869885445, + 0.06904024817049503, + 0.03791807219386101, + 0.09079466760158539, + 0.2739130351692438, + 0.15442688576877117, + 0.07590658217668533, + 0.032773472368717194, + 0.06317261047661304, + 0.5323030389845371, + 0.31542073749005795, + 0.029886677861213684, + 0.6649217642843723, + 0.3612845614552498, + 0.04374149069190025, + 0.36219120398163795, + 0.0, + 0.03639763966202736, + 0.24206885695457458, + 0.24598911963403225, + 0.07582099363207817, + 0.7289502583444118, + 0.1604243889451027, + 0.12546886876225471, + 0.06643886119127274, + 0.05824747309088707, + 0.29977330937981606, + 0.0, + 0.04624253138899803, + 0.0, + 0.3832111619412899, + 0.2618224732577801, + 0.5629651919007301, + 0.0, + 0.0 + ], + "unique_experts": 57, + "load_cv": 0.8819171036881969, + "normalized_load_entropy": 0.9092739423062762, + "max_load_share": 0.05952380952380952 + }, + "full_input": { + "tokens": 67, + "top_k": 6, + "decisions": 402, + "ordered_route_sha256": "5447127d0fe771f2766e839588dbba6b954b54bc25d1b1deed3b0f04ccfa8271", + "route_weight_sha256": "99c094a1f4374751b28dda618c6b9ddbb295751da725a1d240d1e674b367a2fb", + "loads": [ + 1, + 3, + 7, + 3, + 6, + 3, + 15, + 5, + 23, + 6, + 4, + 7, + 9, + 20, + 2, + 3, + 27, + 5, + 5, + 3, + 5, + 6, + 5, + 3, + 9, + 0, + 8, + 2, + 8, + 2, + 2, + 1, + 5, + 8, + 4, + 2, + 1, + 2, + 19, + 9, + 1, + 20, + 10, + 3, + 9, + 0, + 3, + 7, + 4, + 2, + 26, + 5, + 3, + 2, + 1, + 11, + 0, + 1, + 4, + 5, + 4, + 13, + 3, + 7 + ], + "weighted_loads": [ + 0.03436662629246712, + 0.14187883399426937, + 0.440213343128562, + 0.11044304072856903, + 0.40313960053026676, + 0.14331360161304474, + 1.2682727687060833, + 0.3013968952000141, + 1.6486795581877232, + 0.2730141840875149, + 0.17669875919818878, + 0.6262778863310814, + 0.7616836577653885, + 2.001564495265484, + 0.17287993431091309, + 0.112558763474226, + 3.232582949101925, + 0.34834475442767143, + 0.18587036058306694, + 0.14017248339951038, + 0.4971410408616066, + 0.3318406008183956, + 0.24237914383411407, + 0.18314838409423828, + 0.3460571700707078, + 0.0, + 0.5468188486993313, + 0.11798667535185814, + 0.26486265659332275, + 0.08862559869885445, + 0.06904024817049503, + 0.03791807219386101, + 0.20541589334607124, + 0.3234876859933138, + 0.15442688576877117, + 0.07590658217668533, + 0.032773472368717194, + 0.06317261047661304, + 1.4482123628258705, + 0.44727166555821896, + 0.029886677861213684, + 1.5754775553941727, + 0.6426871418952942, + 0.07571189850568771, + 1.8440840616822243, + 0.0, + 0.12240948900580406, + 0.4012613669037819, + 0.24598911963403225, + 0.07582099363207817, + 1.8861858025193214, + 0.1604243889451027, + 0.12546886876225471, + 0.09731273166835308, + 0.05824747309088707, + 0.9574257545173168, + 0.0, + 0.04624253138899803, + 0.08540127333253622, + 0.3832111619412899, + 0.2618224732577801, + 0.8601026423275471, + 0.04830775037407875, + 0.26946128718554974 + ], + "unique_experts": 61, + "load_cv": 0.9775454764540009, + "normalized_load_entropy": 0.9054059068657221, + "max_load_share": 0.06716417910447761 + } + }, + "s1_eos": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "d838a73e23b633c0145004ea58569ee380eedcf7c6fe88bd3aa6aeef9fbca1d0", + "route_weight_sha256": "d30287120e9a14b28522c4f40e45c593c918e07707d85837954db368582081da", + "loads": [ + 1, + 3, + 7, + 1, + 5, + 2, + 8, + 5, + 14, + 6, + 2, + 4, + 9, + 15, + 2, + 3, + 12, + 2, + 3, + 2, + 6, + 6, + 2, + 1, + 5, + 0, + 4, + 3, + 4, + 2, + 2, + 1, + 2, + 7, + 6, + 2, + 1, + 2, + 9, + 6, + 2, + 9, + 6, + 1, + 6, + 0, + 1, + 5, + 3, + 2, + 10, + 4, + 3, + 1, + 1, + 4, + 0, + 1, + 1, + 5, + 4, + 6, + 0, + 0 + ], + "weighted_loads": [ + 0.034187547862529755, + 0.1403871849179268, + 0.44947197660803795, + 0.03265565633773804, + 0.37103360518813133, + 0.10424705222249031, + 0.7320085391402245, + 0.2960079088807106, + 0.9360058568418026, + 0.27342733554542065, + 0.09407487139105797, + 0.16108491830527782, + 0.7610085532069206, + 1.6911834701895714, + 0.16968438029289246, + 0.1127283126115799, + 1.2134718261659145, + 0.2035447508096695, + 0.14430828019976616, + 0.08547650463879108, + 0.519079091027379, + 0.33535100519657135, + 0.06913517415523529, + 0.04980090633034706, + 0.2142689935863018, + 0.0, + 0.18254413455724716, + 0.15910892561078072, + 0.17383156344294548, + 0.08909409865736961, + 0.07064946740865707, + 0.04041077941656113, + 0.08994660153985023, + 0.24936998635530472, + 0.23019629158079624, + 0.07424762099981308, + 0.029774315655231476, + 0.06361840851604939, + 0.5341315641999245, + 0.314947497099638, + 0.05849282443523407, + 0.6272305622696877, + 0.360018752515316, + 0.04578854888677597, + 0.36119393818080425, + 0.0, + 0.03666546940803528, + 0.24171197414398193, + 0.21259991079568863, + 0.07818250730633736, + 0.7005265168845654, + 0.13259132392704487, + 0.12782628275454044, + 0.0714685246348381, + 0.05886813625693321, + 0.2928527407348156, + 0.0, + 0.048588771373033524, + 0.03520897775888443, + 0.38183098286390305, + 0.2589845173060894, + 0.5128348432481289, + 0.0, + 0.0 + ], + "unique_experts": 59, + "load_cv": 0.8421678345957021, + "normalized_load_entropy": 0.9183748085674523, + "max_load_share": 0.05952380952380952 + }, + "full_input": { + "tokens": 83, + "top_k": 6, + "decisions": 498, + "ordered_route_sha256": "d00fd6ea9682f483e288b2181dd26f7acf6a4af1d6c13eec275977b395b418e5", + "route_weight_sha256": "b0ba90e9ad5a7bdf27ce3b051409a84e854935ac68ce79f312d90e845e941cde", + "loads": [ + 1, + 3, + 7, + 3, + 6, + 3, + 15, + 5, + 30, + 8, + 9, + 9, + 9, + 20, + 4, + 5, + 28, + 6, + 5, + 3, + 6, + 6, + 4, + 4, + 10, + 0, + 13, + 4, + 7, + 8, + 2, + 1, + 8, + 15, + 6, + 2, + 1, + 6, + 26, + 9, + 4, + 25, + 16, + 4, + 15, + 0, + 3, + 11, + 3, + 2, + 32, + 4, + 3, + 1, + 5, + 13, + 0, + 7, + 4, + 5, + 4, + 12, + 4, + 4 + ], + "weighted_loads": [ + 0.034187547862529755, + 0.1403871849179268, + 0.44947197660803795, + 0.09529522247612476, + 0.4178417883813381, + 0.14783628284931183, + 1.1828870493918657, + 0.2960079088807106, + 2.3132869452238083, + 0.37479433231055737, + 0.6666275262832642, + 0.7319952491670847, + 0.7610085532069206, + 2.000672021880746, + 0.2377716265618801, + 0.20769033208489418, + 3.6504149585962296, + 0.4132879674434662, + 0.18537335470318794, + 0.13599308021366596, + 0.519079091027379, + 0.33535100519657135, + 0.18642720207571983, + 0.22043230012059212, + 0.3672271613031626, + 0.0, + 0.9366991110146046, + 0.18972623348236084, + 0.2373565575107932, + 0.8699478097259998, + 0.07064946740865707, + 0.04041077941656113, + 0.4745134450495243, + 0.7888918109238148, + 0.23019629158079624, + 0.07424762099981308, + 0.029774315655231476, + 0.29269361682236195, + 2.299077857285738, + 0.45960382372140884, + 0.27948539704084396, + 1.9975506216287613, + 1.1296747885644436, + 0.11805253103375435, + 2.379722585901618, + 0.0, + 0.1400369293987751, + 0.6055764276534319, + 0.21259991079568863, + 0.07818250730633736, + 2.3140684198588133, + 0.13259132392704487, + 0.12782628275454044, + 0.0714685246348381, + 0.26652079075574875, + 1.067097855731845, + 0.0, + 0.5890486761927605, + 0.09251644276082516, + 0.38183098286390305, + 0.2589845173060894, + 0.8040692303329706, + 0.08281572721898556, + 0.11711879633367062 + ], + "unique_experts": 61, + "load_cv": 0.9404024159497519, + "normalized_load_entropy": 0.9108919011396385, + "max_load_share": 0.0642570281124498 + } + }, + "s0_bos": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "5cb04eaa2901e046cf8b9ba9c05b844217e3d798e95ffaf143f1b55d34400002", + "route_weight_sha256": "b966d7adeb83b79962bd4ccfa04e6ccad07329736a6a04ff6111d9a7ea18f648", + "loads": [ + 0, + 3, + 7, + 1, + 6, + 2, + 9, + 6, + 15, + 6, + 2, + 3, + 9, + 15, + 2, + 3, + 13, + 2, + 4, + 2, + 4, + 5, + 2, + 1, + 4, + 0, + 6, + 2, + 5, + 2, + 1, + 1, + 2, + 7, + 5, + 2, + 1, + 2, + 8, + 5, + 1, + 11, + 5, + 1, + 5, + 0, + 1, + 5, + 4, + 2, + 12, + 3, + 2, + 2, + 1, + 4, + 0, + 1, + 1, + 5, + 4, + 7, + 0, + 0 + ], + "weighted_loads": [ + 0.0, + 0.12928628735244274, + 0.45430295355618, + 0.03600310534238815, + 0.4029303453862667, + 0.10221896693110466, + 0.7177977934479713, + 0.3420172967016697, + 1.0526369996368885, + 0.2786265127360821, + 0.08856385387480259, + 0.12515035085380077, + 0.7434150539338589, + 1.7494808211922646, + 0.17576997727155685, + 0.1138441152870655, + 1.2287769429385662, + 0.18445435166358948, + 0.17844644375145435, + 0.08877186104655266, + 0.4879845716059208, + 0.29276118054986, + 0.07469217851758003, + 0.039115358144044876, + 0.18290678597986698, + 0.0, + 0.2946493085473776, + 0.11362588033080101, + 0.21516091749072075, + 0.0858786404132843, + 0.04134764522314072, + 0.03674488514661789, + 0.07880249246954918, + 0.2912484835833311, + 0.18012933433055878, + 0.07226311787962914, + 0.032322537153959274, + 0.06352808699011803, + 0.4818809162825346, + 0.2838783971965313, + 0.029344260692596436, + 0.7295142263174057, + 0.32721851766109467, + 0.03974081575870514, + 0.3320263661444187, + 0.0, + 0.03650436922907829, + 0.2281007394194603, + 0.2555962838232517, + 0.07472535967826843, + 0.7701769322156906, + 0.10414935648441315, + 0.08718917518854141, + 0.10170073434710503, + 0.05499057099223137, + 0.28050824254751205, + 0.0, + 0.04772503674030304, + 0.04100929945707321, + 0.3873881511390209, + 0.2738953083753586, + 0.5513725057244301, + 0.0, + 0.0 + ], + "unique_experts": 58, + "load_cv": 0.9022521581664961, + "normalized_load_entropy": 0.9086904308820091, + "max_load_share": 0.05952380952380952 + }, + "full_input": { + "tokens": 67, + "top_k": 6, + "decisions": 402, + "ordered_route_sha256": "07ab491cab1f95e187a7d701373e12b0609c67602707c96c7faf78c6fcc721da", + "route_weight_sha256": "f551fab8026dc917b3e9ebe46c35325512aa4a4cc13c65ee8de63fb414f401e4", + "loads": [ + 0, + 3, + 7, + 4, + 6, + 3, + 15, + 6, + 23, + 6, + 4, + 7, + 9, + 20, + 2, + 3, + 28, + 6, + 7, + 3, + 4, + 5, + 5, + 3, + 7, + 0, + 11, + 2, + 7, + 2, + 1, + 1, + 5, + 9, + 5, + 2, + 1, + 2, + 17, + 8, + 1, + 22, + 9, + 2, + 8, + 0, + 4, + 7, + 4, + 2, + 27, + 3, + 2, + 4, + 1, + 11, + 0, + 1, + 4, + 5, + 4, + 13, + 2, + 7 + ], + "weighted_loads": [ + 0.0, + 0.12928628735244274, + 0.45430295355618, + 0.14644614607095718, + 0.4029303453862667, + 0.14440051466226578, + 1.288596909493208, + 0.3420172967016697, + 1.7183920815587044, + 0.2786265127360821, + 0.16722708754241467, + 0.6762787234038115, + 0.7434150539338589, + 2.036604631692171, + 0.17576997727155685, + 0.1138441152870655, + 3.324625603854656, + 0.3838810436427593, + 0.26140871830284595, + 0.14572418853640556, + 0.4879845716059208, + 0.29276118054986, + 0.24604086577892303, + 0.1736656315624714, + 0.31015305407345295, + 0.0, + 0.7057475242763758, + 0.11362588033080101, + 0.2652903404086828, + 0.0858786404132843, + 0.04134764522314072, + 0.03674488514661789, + 0.19342371821403503, + 0.3809012193232775, + 0.18012933433055878, + 0.07226311787962914, + 0.032322537153959274, + 0.06352808699011803, + 1.3589257840067148, + 0.4207008294761181, + 0.029344260692596436, + 1.6295373737812042, + 0.6027282699942589, + 0.05733917094767094, + 0.9856489486992359, + 0.0, + 0.17376477643847466, + 0.3922201246023178, + 0.2555962838232517, + 0.07472535967826843, + 2.036783829331398, + 0.10414935648441315, + 0.08718917518854141, + 0.17828392051160336, + 0.05499057099223137, + 0.9381606876850128, + 0.0, + 0.04772503674030304, + 0.11145445518195629, + 0.3873881511390209, + 0.2738953083753586, + 0.848509956151247, + 0.04269230179488659, + 0.26946128718554974 + ], + "unique_experts": 60, + "load_cv": 1.0015581534213502, + "normalized_load_entropy": 0.9005300431912718, + "max_load_share": 0.06965174129353234 + } + }, + "s1_bos": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "938e9640a88b6308ab7428a14254fdd43de94642ae4a3b5fa5e734c1c92fff94", + "route_weight_sha256": "31468a82daab86a298016230b05be34ebdef68f3a5444504ae3356be100b3597", + "loads": [ + 0, + 3, + 7, + 0, + 6, + 3, + 7, + 6, + 15, + 5, + 2, + 3, + 9, + 15, + 2, + 2, + 13, + 2, + 3, + 4, + 4, + 6, + 2, + 0, + 3, + 0, + 4, + 3, + 4, + 2, + 2, + 2, + 2, + 9, + 6, + 2, + 1, + 1, + 9, + 6, + 1, + 10, + 6, + 1, + 6, + 0, + 1, + 6, + 4, + 2, + 11, + 4, + 2, + 1, + 1, + 4, + 0, + 1, + 1, + 5, + 4, + 6, + 0, + 0 + ], + "weighted_loads": [ + 0.0, + 0.12186079286038876, + 0.45768506079912186, + 0.0, + 0.39967318810522556, + 0.13962703198194504, + 0.6505263857543468, + 0.33672141283750534, + 1.0507910810410976, + 0.2454586625099182, + 0.0948097500950098, + 0.13300846144557, + 0.768470998853445, + 1.723126344382763, + 0.17019064351916313, + 0.07386903837323189, + 1.249710388481617, + 0.19358331710100174, + 0.1484908014535904, + 0.15627302043139935, + 0.4845519308000803, + 0.33558931201696396, + 0.07113274559378624, + 0.0, + 0.15503989905118942, + 0.0, + 0.20179343409836292, + 0.15758095681667328, + 0.1871086061000824, + 0.08725850284099579, + 0.06853972189128399, + 0.07838629931211472, + 0.08851950615644455, + 0.331921748816967, + 0.22124128602445126, + 0.0702054426074028, + 0.0332556888461113, + 0.035378582775592804, + 0.508051997050643, + 0.3335380330681801, + 0.02867165394127369, + 0.6384421214461327, + 0.3817721828818321, + 0.039127279072999954, + 0.3612065352499485, + 0.0, + 0.03620745241641998, + 0.27873731404542923, + 0.23779805935919285, + 0.07477512210607529, + 0.7427319474518299, + 0.13786061480641365, + 0.0881250873208046, + 0.061312101781368256, + 0.0518803596496582, + 0.2803233787417412, + 0.0, + 0.04649891331791878, + 0.03878256678581238, + 0.38657021149992943, + 0.2736131101846695, + 0.5182721093297005, + 0.0, + 0.0 + ], + "unique_experts": 56, + "load_cv": 0.8988949291916044, + "normalized_load_entropy": 0.9057285402218647, + "max_load_share": 0.05952380952380952 + }, + "full_input": { + "tokens": 83, + "top_k": 6, + "decisions": 498, + "ordered_route_sha256": "e7b3c879f8ac43fda77f2564833eeb845f1c98775236c2c1cfd67fd87fb85a9a", + "route_weight_sha256": "8e4f9ba195b9065dc0caf54a2e983fe94f2854d2a76c329a69bb0947902918bd", + "loads": [ + 0, + 3, + 7, + 2, + 7, + 4, + 15, + 6, + 31, + 7, + 9, + 8, + 9, + 20, + 4, + 4, + 29, + 6, + 6, + 5, + 4, + 6, + 4, + 4, + 7, + 0, + 13, + 4, + 6, + 8, + 2, + 2, + 8, + 17, + 6, + 2, + 1, + 5, + 26, + 9, + 3, + 26, + 16, + 3, + 16, + 0, + 4, + 12, + 4, + 2, + 33, + 4, + 2, + 1, + 5, + 13, + 0, + 7, + 3, + 5, + 4, + 12, + 3, + 4 + ], + "weighted_loads": [ + 0.0, + 0.12186079286038876, + 0.45768506079912186, + 0.06263956613838673, + 0.44648137129843235, + 0.18321626260876656, + 1.2400244567543268, + 0.33672141283750534, + 2.4403627403080463, + 0.34682565927505493, + 0.6622873526066542, + 0.7584414519369602, + 0.768470998853445, + 2.0326148960739374, + 0.2382778897881508, + 0.16883105784654617, + 3.714428499341011, + 0.40627604722976685, + 0.22642307728528976, + 0.21353481151163578, + 0.4845519308000803, + 0.33558931201696396, + 0.18842477351427078, + 0.21664737910032272, + 0.30078232288360596, + 0.0, + 0.9673707988113165, + 0.1881982646882534, + 0.23695805110037327, + 0.868112213909626, + 0.06853972189128399, + 0.07838629931211472, + 0.4730863496661186, + 0.8714435733854771, + 0.22124128602445126, + 0.0702054426074028, + 0.0332556888461113, + 0.26445379108190536, + 2.265430448576808, + 0.48393789678812027, + 0.24966422654688358, + 2.0127535201609135, + 1.1536209248006344, + 0.09741520322859287, + 1.5755252949893475, + 0.0, + 0.18728522211313248, + 0.647704878821969, + 0.23779805935919285, + 0.07477512210607529, + 2.513183744624257, + 0.13786061480641365, + 0.0881250873208046, + 0.061312101781368256, + 0.25953301414847374, + 1.0545684937387705, + 0.0, + 0.5869588181376457, + 0.08047682978212833, + 0.38657021149992943, + 0.2736131101846695, + 0.8095064964145422, + 0.07725922390818596, + 0.11711879633367062 + ], + "unique_experts": 60, + "load_cv": 0.9743653899324297, + "normalized_load_entropy": 0.905232659919496, + "max_load_share": 0.06626506024096386 + } + }, + "s0_x": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "930265b7bb92f16ac9bd435d98338546a89cf9f2104903e72217cad64af40d02", + "route_weight_sha256": "1d6356bb01e465e526afb71ef038c8dbcbd277e9e83127699d0b38a356cad482", + "loads": [ + 0, + 3, + 7, + 1, + 6, + 3, + 9, + 6, + 15, + 6, + 2, + 3, + 9, + 15, + 2, + 3, + 14, + 2, + 4, + 3, + 4, + 5, + 2, + 0, + 4, + 0, + 6, + 2, + 5, + 2, + 1, + 1, + 2, + 7, + 4, + 2, + 1, + 2, + 8, + 4, + 2, + 9, + 5, + 1, + 5, + 0, + 1, + 6, + 3, + 2, + 12, + 4, + 2, + 2, + 1, + 4, + 0, + 1, + 1, + 5, + 4, + 7, + 0, + 0 + ], + "weighted_loads": [ + 0.0, + 0.1305379830300808, + 0.4540355000644922, + 0.037006083875894547, + 0.38132889568805695, + 0.1409168802201748, + 0.7139350362122059, + 0.3369690217077732, + 1.0433709658682346, + 0.2681211270391941, + 0.08889419585466385, + 0.135157385841012, + 0.762771263718605, + 1.7673333436250687, + 0.16968268156051636, + 0.11256599426269531, + 1.3017228245735168, + 0.1777111515402794, + 0.1767265424132347, + 0.12016720697283745, + 0.46893155202269554, + 0.28617822006344795, + 0.07524424046278, + 0.0, + 0.18716681748628616, + 0.0, + 0.31290052831172943, + 0.11316285282373428, + 0.2091722320765257, + 0.0846172608435154, + 0.03923313692212105, + 0.039364248514175415, + 0.08157476782798767, + 0.2904616501182318, + 0.14468494802713394, + 0.07252826169133186, + 0.035712454468011856, + 0.06307914294302464, + 0.5155656859278679, + 0.24706730619072914, + 0.05963757820427418, + 0.6522198729217052, + 0.32445722818374634, + 0.0390031673014164, + 0.32982760295271873, + 0.0, + 0.035722360014915466, + 0.26739436015486717, + 0.21391328796744347, + 0.07295215502381325, + 0.7744744643568993, + 0.1291140727698803, + 0.08435355871915817, + 0.09967251121997833, + 0.057143304497003555, + 0.28436533734202385, + 0.0, + 0.04918213561177254, + 0.047955550253391266, + 0.3840039223432541, + 0.27173150330781937, + 0.5647070184350014, + 0.0, + 0.0 + ], + "unique_experts": 57, + "load_cv": 0.8977730630082078, + "normalized_load_entropy": 0.9087807361953119, + "max_load_share": 0.05952380952380952 + }, + "full_input": { + "tokens": 67, + "top_k": 6, + "decisions": 402, + "ordered_route_sha256": "a06465a589a735a1ee3a3634cf4c22f7799fb0dbc59b99c43bc52f1dd7bb1c99", + "route_weight_sha256": "36ceae64cfa5c132c3271e1b9e92fe85dda9bd3decdecdd41aa1b05813de8bbd", + "loads": [ + 0, + 3, + 7, + 4, + 6, + 5, + 12, + 6, + 23, + 6, + 4, + 7, + 10, + 21, + 2, + 3, + 30, + 5, + 6, + 4, + 4, + 5, + 5, + 2, + 7, + 0, + 10, + 2, + 7, + 2, + 1, + 1, + 5, + 9, + 4, + 2, + 1, + 2, + 17, + 7, + 2, + 20, + 10, + 2, + 7, + 0, + 5, + 9, + 3, + 2, + 26, + 4, + 2, + 3, + 1, + 11, + 0, + 1, + 4, + 5, + 4, + 14, + 2, + 8 + ], + "weighted_loads": [ + 0.0, + 0.1305379830300808, + 0.4540355000644922, + 0.14744912460446358, + 0.38132889568805695, + 0.2394055612385273, + 0.9992289580404758, + 0.3369690217077732, + 1.6980435736477375, + 0.2681211270391941, + 0.16857248172163963, + 0.6822069231420755, + 0.8005867153406143, + 2.087896328419447, + 0.16968268156051636, + 0.11256599426269531, + 3.676647938787937, + 0.3539959043264389, + 0.2182680033147335, + 0.17673902586102486, + 0.46893155202269554, + 0.28617822006344795, + 0.246592927724123, + 0.14155252277851105, + 0.31441308557987213, + 0.0, + 0.6844459176063538, + 0.11316285282373428, + 0.25930165499448776, + 0.0846172608435154, + 0.03923313692212105, + 0.039364248514175415, + 0.19619599357247353, + 0.38003252632915974, + 0.14468494802713394, + 0.07252826169133186, + 0.035712454468011856, + 0.06307914294302464, + 1.3119820691645145, + 0.3818146623671055, + 0.05963757820427418, + 1.4933134838938713, + 0.6517208181321621, + 0.056601522490382195, + 0.9339483082294464, + 0.0, + 0.20432652905583382, + 0.4718492142856121, + 0.21391328796744347, + 0.07295215502381325, + 1.8293378800153732, + 0.1291140727698803, + 0.08435355871915817, + 0.13054638169705868, + 0.057143304497003555, + 0.9420177824795246, + 0.0, + 0.04918213561177254, + 0.11840070597827435, + 0.3840039223432541, + 0.27173150330781937, + 0.914725948125124, + 0.04269230179488659, + 0.3487673904746771 + ], + "unique_experts": 60, + "load_cv": 0.9995791297703047, + "normalized_load_entropy": 0.9016462722134517, + "max_load_share": 0.07462686567164178 + } + }, + "s1_x": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "8fc2d6d8008f341126432ab1253d498573f2557fe395012e8f6ade7df109495e", + "route_weight_sha256": "5dde39401878d946fa18ac103cc6825bd960611158e42f979a4b51e9d3bc57ad", + "loads": [ + 0, + 2, + 7, + 0, + 6, + 3, + 7, + 6, + 16, + 5, + 2, + 3, + 9, + 15, + 2, + 2, + 14, + 2, + 3, + 4, + 3, + 5, + 2, + 0, + 4, + 0, + 5, + 3, + 2, + 2, + 1, + 2, + 2, + 8, + 5, + 2, + 1, + 3, + 10, + 5, + 1, + 10, + 6, + 0, + 6, + 0, + 1, + 6, + 4, + 2, + 11, + 4, + 2, + 2, + 1, + 4, + 0, + 1, + 1, + 6, + 5, + 6, + 0, + 0 + ], + "weighted_loads": [ + 0.0, + 0.1008262149989605, + 0.4553076792508364, + 0.0, + 0.3682860732078552, + 0.14564047008752823, + 0.6384101398289204, + 0.3263101577758789, + 1.0862498115748167, + 0.24028191342949867, + 0.0939025916159153, + 0.12474840693175793, + 0.7843408025801182, + 1.7598818559199572, + 0.1652468629181385, + 0.07525760307908058, + 1.2842290662229061, + 0.18123217672109604, + 0.15003391355276108, + 0.15754649601876736, + 0.4348793476819992, + 0.2923065200448036, + 0.07346833124756813, + 0.0, + 0.1871897280216217, + 0.0, + 0.27536627650260925, + 0.1567232571542263, + 0.08178034611046314, + 0.08598234504461288, + 0.04051998257637024, + 0.08092669025063515, + 0.09127935767173767, + 0.29637554474174976, + 0.18510903418064117, + 0.06981296464800835, + 0.03707286715507507, + 0.09415562637150288, + 0.6209781710058451, + 0.2800139896571636, + 0.03158248960971832, + 0.6301857903599739, + 0.3785215839743614, + 0.0, + 0.3555005881935358, + 0.0, + 0.03552611544728279, + 0.29344673454761505, + 0.23453685082495213, + 0.07247111573815346, + 0.7413882277905941, + 0.13762753084301949, + 0.08827847056090832, + 0.10257846117019653, + 0.052818600088357925, + 0.2891768738627434, + 0.0, + 0.04532337933778763, + 0.04050193354487419, + 0.4257027320563793, + 0.2930299676954746, + 0.5223439410328865, + 0.0, + 0.0 + ], + "unique_experts": 55, + "load_cv": 0.9243221181930583, + "normalized_load_entropy": 0.9016455134686573, + "max_load_share": 0.06349206349206349 + }, + "full_input": { + "tokens": 83, + "top_k": 6, + "decisions": 498, + "ordered_route_sha256": "b627403daa195f90e4afa2f244e7729223a9dc3d026a95ae7cf0865c6a834208", + "route_weight_sha256": "0345d81eae68fc44ef916bf17bac7a4d368b6e43699e6538511abe59e79af878", + "loads": [ + 0, + 2, + 7, + 2, + 7, + 5, + 13, + 6, + 32, + 7, + 9, + 8, + 9, + 21, + 4, + 4, + 31, + 7, + 5, + 5, + 3, + 5, + 4, + 4, + 9, + 0, + 14, + 4, + 4, + 8, + 1, + 2, + 8, + 16, + 5, + 2, + 1, + 7, + 25, + 8, + 3, + 25, + 16, + 2, + 14, + 0, + 5, + 13, + 4, + 2, + 32, + 4, + 2, + 2, + 5, + 13, + 0, + 7, + 3, + 6, + 5, + 13, + 3, + 5 + ], + "weighted_loads": [ + 0.0, + 0.1008262149989605, + 0.4553076792508364, + 0.06263956613838673, + 0.415094256401062, + 0.24340742081403732, + 0.9870948772877455, + 0.3263101577758789, + 2.4802305568009615, + 0.3416489101946354, + 0.6624112389981747, + 0.7579134609550238, + 0.7843408025801182, + 2.100138111039996, + 0.23333410918712616, + 0.17021962255239487, + 4.003218732774258, + 0.44694824144244194, + 0.19109898805618286, + 0.21370267681777477, + 0.4348793476819992, + 0.2923065200448036, + 0.19076035916805267, + 0.20169536769390106, + 0.3651448041200638, + 0.0, + 1.029260542243719, + 0.18734056502580643, + 0.131629791110754, + 0.8668360561132431, + 0.04051998257637024, + 0.08092669025063515, + 0.47584620118141174, + 0.8358973693102598, + 0.18510903418064117, + 0.06981296464800835, + 0.03707286715507507, + 0.32323083467781544, + 2.211911676451564, + 0.4245222136378288, + 0.2525750622153282, + 1.8818175308406353, + 1.1380305849015713, + 0.05828792415559292, + 1.5000052023679018, + 0.0, + 0.21776089072227478, + 0.727575184777379, + 0.23453685082495213, + 0.07247111573815346, + 2.269895488396287, + 0.13762753084301949, + 0.08827847056090832, + 0.10257846117019653, + 0.26047125458717346, + 1.0634219888597727, + 0.0, + 0.5857832841575146, + 0.08219619654119015, + 0.4257027320563793, + 0.2930299676954746, + 0.8677553627640009, + 0.07725922390818596, + 0.18436266295611858 + ], + "unique_experts": 60, + "load_cv": 0.9762175772092456, + "normalized_load_entropy": 0.9046244484495551, + "max_load_share": 0.0642570281124498 + } + }, + "s0_period": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "bc05eda095e3f46f35a80d643995ff89703e51fba516bfe54b9566747d982a1c", + "route_weight_sha256": "cc39bcba56851d5c51a05fbf99f9c8e45ced53def460eafca1c1d836a873ce2d", + "loads": [ + 0, + 2, + 7, + 1, + 6, + 2, + 7, + 6, + 15, + 5, + 2, + 3, + 9, + 15, + 2, + 3, + 14, + 2, + 3, + 3, + 5, + 5, + 2, + 0, + 4, + 0, + 7, + 2, + 4, + 2, + 1, + 2, + 2, + 7, + 5, + 2, + 1, + 1, + 9, + 5, + 3, + 10, + 5, + 1, + 5, + 0, + 1, + 6, + 4, + 2, + 12, + 3, + 2, + 2, + 1, + 4, + 0, + 1, + 1, + 5, + 4, + 7, + 0, + 0 + ], + "weighted_loads": [ + 0.0, + 0.10033010318875313, + 0.46157288923859596, + 0.03604239597916603, + 0.3766202926635742, + 0.10038779303431511, + 0.6074502617120743, + 0.34390395134687424, + 1.054209966212511, + 0.23643813654780388, + 0.09044842049479485, + 0.13268583081662655, + 0.7654872424900532, + 1.7452043015509844, + 0.17071091756224632, + 0.11452358216047287, + 1.2843591906130314, + 0.17033399641513824, + 0.15204475447535515, + 0.12090501375496387, + 0.5033268351107836, + 0.28890836238861084, + 0.07664863765239716, + 0.0, + 0.18569622188806534, + 0.0, + 0.37996069714426994, + 0.11227749288082123, + 0.17319216951727867, + 0.08417761698365211, + 0.038472190499305725, + 0.0759105235338211, + 0.08361384645104408, + 0.28856285475194454, + 0.18466618098318577, + 0.07199496030807495, + 0.033896397799253464, + 0.03640792891383171, + 0.5469939857721329, + 0.2762347646057606, + 0.08571754023432732, + 0.690029002726078, + 0.32038112729787827, + 0.038247931748628616, + 0.3319225814193487, + 0.0, + 0.03545946627855301, + 0.28204353898763657, + 0.23992070369422436, + 0.07331493124365807, + 0.775937907397747, + 0.10638953000307083, + 0.08440567553043365, + 0.09839838370680809, + 0.05666299909353256, + 0.2864883579313755, + 0.0, + 0.05027591064572334, + 0.04801657795906067, + 0.38923490047454834, + 0.2661290280520916, + 0.5610362142324448, + 0.0, + 0.0 + ], + "unique_experts": 57, + "load_cv": 0.9044833879306905, + "normalized_load_entropy": 0.9075887413147854, + "max_load_share": 0.05952380952380952 + }, + "full_input": { + "tokens": 67, + "top_k": 6, + "decisions": 402, + "ordered_route_sha256": "e97566dbf0bb8008b9f3ef95d0b74d60db441f8829348ab6d629153428c28ebe", + "route_weight_sha256": "1dfc5ba324b356b440e1d0650d465b0006f03343c1eb763a8c64df002a95df80", + "loads": [ + 0, + 2, + 7, + 4, + 6, + 3, + 11, + 6, + 24, + 5, + 4, + 7, + 10, + 20, + 2, + 3, + 30, + 5, + 5, + 4, + 5, + 5, + 6, + 2, + 7, + 0, + 11, + 2, + 6, + 2, + 1, + 2, + 5, + 9, + 5, + 2, + 1, + 1, + 19, + 8, + 3, + 22, + 10, + 2, + 7, + 0, + 3, + 8, + 4, + 2, + 28, + 3, + 2, + 3, + 1, + 11, + 0, + 1, + 4, + 5, + 4, + 13, + 2, + 7 + ], + "weighted_loads": [ + 0.0, + 0.10033010318875313, + 0.46157288923859596, + 0.14648543670773506, + 0.3766202926635742, + 0.14256934076547623, + 0.9337719939649105, + 0.34390395134687424, + 1.7939250096678734, + 0.23643813654780388, + 0.16931728646159172, + 0.6874550860375166, + 0.8016983270645142, + 2.032328112050891, + 0.17071091756224632, + 0.11452358216047287, + 3.6226302348077297, + 0.33979514241218567, + 0.19358621537685394, + 0.17681851796805859, + 0.5033268351107836, + 0.28890836238861084, + 0.29266946390271187, + 0.13832836598157883, + 0.3129424899816513, + 0.0, + 0.7361662201583385, + 0.11227749288082123, + 0.22332159243524075, + 0.08417761698365211, + 0.038472190499305725, + 0.0759105235338211, + 0.19823507219552994, + 0.37336073629558086, + 0.18466618098318577, + 0.07199496030807495, + 0.033896397799253464, + 0.03640792891383171, + 1.4372656121850014, + 0.41040605679154396, + 0.08571754023432732, + 1.5808843709528446, + 0.6503221280872822, + 0.055846286937594414, + 0.9360432866960764, + 0.0, + 0.1280830167233944, + 0.43996644020080566, + 0.23992070369422436, + 0.07331493124365807, + 2.1620136573910713, + 0.10638953000307083, + 0.08440567553043365, + 0.12927225418388844, + 0.05666299909353256, + 0.9441408030688763, + 0.0, + 0.05027591064572334, + 0.11846173368394375, + 0.38923490047454834, + 0.2661290280520916, + 0.8581736646592617, + 0.04269230179488659, + 0.26946128718554974 + ], + "unique_experts": 60, + "load_cv": 1.0357702349959053, + "normalized_load_entropy": 0.8970466526236174, + "max_load_share": 0.07462686567164178 + } + }, + "s1_period": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "9a80c03e5794f9aa8e28b287cba62a16915b35c4bd05dbda84016fb3021da097", + "route_weight_sha256": "63e4ced796e3b7342d24959201f6d0d65387e7f6337aaaf213349b3ca20ee460", + "loads": [ + 0, + 2, + 7, + 0, + 6, + 2, + 7, + 6, + 15, + 4, + 2, + 3, + 9, + 15, + 2, + 3, + 14, + 2, + 3, + 5, + 4, + 5, + 2, + 0, + 4, + 0, + 6, + 3, + 4, + 2, + 1, + 2, + 1, + 7, + 6, + 2, + 1, + 1, + 10, + 5, + 2, + 10, + 6, + 0, + 6, + 0, + 1, + 6, + 4, + 2, + 11, + 3, + 3, + 2, + 1, + 4, + 0, + 1, + 1, + 5, + 5, + 6, + 0, + 0 + ], + "weighted_loads": [ + 0.0, + 0.10282712429761887, + 0.47070356644690037, + 0.0, + 0.37522832676768303, + 0.1089644692838192, + 0.6150266379117966, + 0.3286373447626829, + 1.069079553708434, + 0.1961432322859764, + 0.09592557698488235, + 0.11969859525561333, + 0.791388526558876, + 1.7118121273815632, + 0.16469977051019669, + 0.1096932701766491, + 1.3039786107838154, + 0.1707749292254448, + 0.15488388761878014, + 0.18315879628062248, + 0.47575980983674526, + 0.28625306487083435, + 0.07291262224316597, + 0.0, + 0.18862891010940075, + 0.0, + 0.3039154037833214, + 0.15746918693184853, + 0.1632161419838667, + 0.08585400879383087, + 0.040650367736816406, + 0.08225540816783905, + 0.0603581964969635, + 0.27338120713829994, + 0.22226113639771938, + 0.06993890926241875, + 0.03420247137546539, + 0.031550437211990356, + 0.613051088526845, + 0.28772557713091373, + 0.05951789952814579, + 0.6435456778854132, + 0.3772846646606922, + 0.0, + 0.3557389583438635, + 0.0, + 0.035370588302612305, + 0.293189138174057, + 0.23487500846385956, + 0.07256890833377838, + 0.7532176300883293, + 0.10640767961740494, + 0.12245655432343483, + 0.10440013185143471, + 0.05224187299609184, + 0.2858334220945835, + 0.0, + 0.0463680699467659, + 0.04032565653324127, + 0.3895901329815388, + 0.29189861938357353, + 0.5208822824060917, + 0.0, + 0.0 + ], + "unique_experts": 55, + "load_cv": 0.9100375290935977, + "normalized_load_entropy": 0.9028657661681142, + "max_load_share": 0.05952380952380952 + }, + "full_input": { + "tokens": 83, + "top_k": 6, + "decisions": 498, + "ordered_route_sha256": "25d50e20d0bf05073f70a13159bb0df78326560a31a060120ad1d3fdbda166c5", + "route_weight_sha256": "3a83fbf987b7df920ed910d405ca7313570f44e128d4ccc8832c8aa0dd4964fb", + "loads": [ + 0, + 2, + 7, + 2, + 7, + 3, + 14, + 6, + 32, + 6, + 9, + 8, + 9, + 20, + 4, + 5, + 31, + 7, + 5, + 6, + 4, + 5, + 5, + 3, + 8, + 0, + 15, + 4, + 6, + 8, + 1, + 2, + 8, + 15, + 6, + 2, + 1, + 5, + 27, + 8, + 4, + 26, + 16, + 2, + 14, + 0, + 3, + 12, + 4, + 2, + 34, + 3, + 3, + 2, + 5, + 13, + 0, + 7, + 3, + 5, + 5, + 12, + 3, + 4 + ], + "weighted_loads": [ + 0.0, + 0.10282712429761887, + 0.47070356644690037, + 0.06263956613838673, + 0.4220365099608898, + 0.15255369991064072, + 0.9985090363770723, + 0.3286373447626829, + 2.52633317746222, + 0.29751022905111313, + 0.6664597652852535, + 0.7071139365434647, + 0.791388526558876, + 2.0213006790727377, + 0.23278701677918434, + 0.20465528964996338, + 3.9755801633000374, + 0.42548925057053566, + 0.19594896212220192, + 0.23767851293087006, + 0.47575980983674526, + 0.28625306487083435, + 0.2231377810239792, + 0.1669904701411724, + 0.3343713339418173, + 0.0, + 1.0447731092572212, + 0.18808649480342865, + 0.21306558698415756, + 0.8667077198624611, + 0.040650367736816406, + 0.08225540816783905, + 0.47791219875216484, + 0.81290303170681, + 0.22226113639771938, + 0.06993890926241875, + 0.03420247137546539, + 0.2606256455183029, + 2.3135874811559916, + 0.43255280889570713, + 0.2805104721337557, + 1.9632856007665396, + 1.141149166971445, + 0.05828792415559292, + 1.5002435725182295, + 0.0, + 0.13874204829335213, + 0.6557755414396524, + 0.23487500846385956, + 0.07256890833377838, + 2.714670529589057, + 0.10640767961740494, + 0.12245655432343483, + 0.10440013185143471, + 0.2598945274949074, + 1.0600785370916128, + 0.0, + 0.5868279747664928, + 0.08201991952955723, + 0.3895901329815388, + 0.29189861938357353, + 0.8121166694909334, + 0.07725922390818596, + 0.11711879633367062 + ], + "unique_experts": 60, + "load_cv": 0.9997257732738695, + "normalized_load_entropy": 0.9019956196796225, + "max_load_share": 0.06827309236947791 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 42, + "ordered_topk_exact_tokens": 28, + "set_exact_tokens": 32, + "mean_set_jaccard": 0.9319727891156462, + "mean_token_weighted_tv": 0.0133842910595593, + "aggregate_load_tv": 0.031746031746031744 + }, + "system_bos": { + "tokens": 42, + "ordered_topk_exact_tokens": 21, + "set_exact_tokens": 26, + "mean_set_jaccard": 0.8860544217687075, + "mean_token_weighted_tv": 0.022564840636083057, + "aggregate_load_tv": 0.06349206349206349 + }, + "system_x": { + "tokens": 42, + "ordered_topk_exact_tokens": 18, + "set_exact_tokens": 23, + "mean_set_jaccard": 0.8656462585034015, + "mean_token_weighted_tv": 0.026106090817068304, + "aggregate_load_tv": 0.06349206349206349 + }, + "system_period": { + "tokens": 42, + "ordered_topk_exact_tokens": 21, + "set_exact_tokens": 25, + "mean_set_jaccard": 0.8843537414965987, + "mean_token_weighted_tv": 0.02468796642053695, + "aggregate_load_tv": 0.03571428571428571 + }, + "bos_at_s0": { + "tokens": 42, + "ordered_topk_exact_tokens": 18, + "set_exact_tokens": 25, + "mean_set_jaccard": 0.8741496598639455, + "mean_token_weighted_tv": 0.026560630604979537, + "aggregate_load_tv": 0.051587301587301584 + }, + "bos_at_s1": { + "tokens": 42, + "ordered_topk_exact_tokens": 20, + "set_exact_tokens": 26, + "mean_set_jaccard": 0.8809523809523809, + "mean_token_weighted_tv": 0.026706602557429245, + "aggregate_load_tv": 0.05555555555555555 + }, + "x_at_s0": { + "tokens": 42, + "ordered_topk_exact_tokens": 16, + "set_exact_tokens": 22, + "mean_set_jaccard": 0.8486394557823128, + "mean_token_weighted_tv": 0.03198942664035019, + "aggregate_load_tv": 0.05952380952380952 + }, + "x_at_s1": { + "tokens": 42, + "ordered_topk_exact_tokens": 18, + "set_exact_tokens": 20, + "mean_set_jaccard": 0.8157596371882088, + "mean_token_weighted_tv": 0.03794257686517778, + "aggregate_load_tv": 0.08333333333333333 + }, + "period_at_s0": { + "tokens": 42, + "ordered_topk_exact_tokens": 16, + "set_exact_tokens": 21, + "mean_set_jaccard": 0.8327664399092972, + "mean_token_weighted_tv": 0.03546054073653761, + "aggregate_load_tv": 0.07142857142857142 + }, + "period_at_s1": { + "tokens": 42, + "ordered_topk_exact_tokens": 17, + "set_exact_tokens": 23, + "mean_set_jaccard": 0.8270975056689343, + "mean_token_weighted_tv": 0.03713881381831709, + "aggregate_load_tv": 0.07142857142857142 + } + } + }, + "layer_08": { + "layer": 8, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "47cb9ed1b25487423d15c0d70dc472729299a1be40fce1bd3a79858f2da34f00", + "route_weight_sha256": "796f50b7d10901714aad26c664f15416448d10ce3f8225d7c88ccfb2a32cec2f", + "loads": [ + 3, + 14, + 3, + 3, + 3, + 0, + 17, + 4, + 18, + 2, + 5, + 8, + 3, + 8, + 2, + 4, + 0, + 11, + 6, + 0, + 3, + 0, + 2, + 0, + 2, + 5, + 2, + 3, + 2, + 1, + 5, + 2, + 4, + 14, + 1, + 1, + 1, + 5, + 0, + 2, + 12, + 4, + 1, + 2, + 1, + 8, + 7, + 0, + 4, + 5, + 6, + 0, + 6, + 4, + 3, + 8, + 2, + 0, + 0, + 4, + 1, + 2, + 0, + 3 + ], + "weighted_loads": [ + 0.2152954265475273, + 0.955876637250185, + 0.12007823958992958, + 0.14162235707044601, + 0.13419829681515694, + 0.0, + 1.093900764361024, + 0.3143482729792595, + 1.682237382978201, + 0.12083302438259125, + 0.29755091667175293, + 0.7239147461950779, + 0.20406266301870346, + 0.5225115455687046, + 0.09268637374043465, + 0.17802279070019722, + 0.0, + 0.6717520765960217, + 0.22829690761864185, + 0.0, + 0.19363413378596306, + 0.0, + 0.06491871178150177, + 0.0, + 0.10947196558117867, + 0.22487463057041168, + 0.09226976335048676, + 0.1133229248225689, + 0.07316971570253372, + 0.05337570980191231, + 0.18050037324428558, + 0.12762239202857018, + 0.3226832300424576, + 0.6386018600314856, + 0.053776178508996964, + 0.04428543150424957, + 0.02729572355747223, + 0.2542515639215708, + 0.0, + 0.08070576936006546, + 0.5113079138100147, + 0.14345820993185043, + 0.043498363345861435, + 0.06287437118589878, + 0.03879517316818237, + 0.4261839874088764, + 0.5065836533904076, + 0.0, + 0.19392292946577072, + 0.19001668132841587, + 0.522474866360426, + 0.0, + 0.5529436729848385, + 0.35809025913476944, + 0.09415838681161404, + 0.487276416271925, + 0.06255622394382954, + 0.0, + 0.0, + 0.2442851271480322, + 0.035570669919252396, + 0.0731491670012474, + 0.0, + 0.11250200867652893 + ], + "unique_experts": 53, + "load_cv": 1.0334540197243192, + "normalized_load_entropy": 0.8842769757965908, + "max_load_share": 0.07142857142857142 + }, + "full_input": { + "tokens": 67, + "top_k": 6, + "decisions": 402, + "ordered_route_sha256": "1914144b9ad729573bf5a76d3dc61c55f5a1810c4e8f47cc4904b0d19eb9dc04", + "route_weight_sha256": "5623c98b8a2bb62784b7387273955fdd58573833beffc168126a85b2e00abbbb", + "loads": [ + 3, + 20, + 5, + 4, + 5, + 0, + 21, + 5, + 27, + 2, + 7, + 10, + 10, + 15, + 2, + 5, + 0, + 14, + 6, + 0, + 4, + 0, + 4, + 0, + 2, + 16, + 2, + 3, + 2, + 1, + 7, + 2, + 8, + 27, + 1, + 1, + 1, + 5, + 0, + 9, + 19, + 4, + 1, + 2, + 1, + 15, + 14, + 4, + 4, + 8, + 9, + 0, + 17, + 4, + 7, + 16, + 2, + 0, + 4, + 4, + 1, + 2, + 2, + 6 + ], + "weighted_loads": [ + 0.2152954265475273, + 1.3250084482133389, + 0.15922374837100506, + 0.18823914602398872, + 0.1976601225323975, + 0.0, + 1.3865698333829641, + 0.3594556711614132, + 2.347176019102335, + 0.12083302438259125, + 0.4003140330314636, + 0.7890103040263057, + 0.5881831049919128, + 0.9944006055593491, + 0.09268637374043465, + 0.22178490087389946, + 0.0, + 0.8364887423813343, + 0.22829690761864185, + 0.0, + 0.2411378026008606, + 0.0, + 0.13763083890080452, + 0.0, + 0.10947196558117867, + 0.991020780056715, + 0.09226976335048676, + 0.1133229248225689, + 0.07316971570253372, + 0.05337570980191231, + 0.2031111903488636, + 0.12762239202857018, + 0.49440376088023186, + 1.6593791544437408, + 0.053776178508996964, + 0.04428543150424957, + 0.02729572355747223, + 0.2542515639215708, + 0.0, + 0.28892260417342186, + 0.8877574130892754, + 0.14345820993185043, + 0.043498363345861435, + 0.06287437118589878, + 0.03879517316818237, + 0.9760118313133717, + 1.2324820905923843, + 0.11854150518774986, + 0.19392292946577072, + 0.35361614264547825, + 0.6945858411490917, + 0.0, + 1.2093010284006596, + 0.35809025913476944, + 1.6736701540648937, + 0.976136801764369, + 0.06255622394382954, + 0.0, + 0.11671090847812593, + 0.2442851271480322, + 0.035570669919252396, + 0.0731491670012474, + 0.0941658690571785, + 0.3198321908712387 + ], + "unique_experts": 56, + "load_cv": 1.0569651448570276, + "normalized_load_entropy": 0.8786244973243637, + "max_load_share": 0.06716417910447761 + } + }, + "s1_eos": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "0ff8c56c021d9b372c8493aef0c00438f50e772e588ee39423001df06ffb377a", + "route_weight_sha256": "2ccdd67e7c983d670c72fff4cf6f2a0a2464a5e1bc833daf89460e7c86001be0", + "loads": [ + 3, + 14, + 2, + 5, + 3, + 0, + 15, + 5, + 18, + 2, + 5, + 8, + 4, + 7, + 2, + 4, + 0, + 11, + 6, + 0, + 3, + 0, + 2, + 0, + 2, + 5, + 1, + 3, + 2, + 1, + 6, + 2, + 4, + 13, + 1, + 1, + 1, + 5, + 1, + 3, + 11, + 4, + 1, + 2, + 1, + 8, + 7, + 0, + 4, + 5, + 6, + 0, + 6, + 5, + 0, + 8, + 2, + 0, + 1, + 4, + 1, + 3, + 0, + 3 + ], + "weighted_loads": [ + 0.2111143134534359, + 0.9524047188460827, + 0.0924820676445961, + 0.23319842293858528, + 0.13220791891217232, + 0.0, + 1.0396112650632858, + 0.3495757859200239, + 1.6772323697805405, + 0.12388867512345314, + 0.3036414384841919, + 0.693101841956377, + 0.24015505239367485, + 0.47317664697766304, + 0.09288493543863297, + 0.17815065756440163, + 0.0, + 0.6240343041718006, + 0.23096240684390068, + 0.0, + 0.2028213068842888, + 0.0, + 0.0635374877601862, + 0.0, + 0.11302754655480385, + 0.2273561768233776, + 0.0616060271859169, + 0.11464865319430828, + 0.07239210978150368, + 0.05190429836511612, + 0.2139053363353014, + 0.1245819739997387, + 0.3187430389225483, + 0.5936174709349871, + 0.05369246378540993, + 0.04552396386861801, + 0.027500949800014496, + 0.2575070057064295, + 0.036152396351099014, + 0.11184372194111347, + 0.47138845175504684, + 0.14279353618621826, + 0.04370869696140289, + 0.06324024125933647, + 0.0388888455927372, + 0.3982301279902458, + 0.4749279022216797, + 0.0, + 0.19612125121057034, + 0.20276271738111973, + 0.5234576053917408, + 0.0, + 0.5515731908380985, + 0.38116687536239624, + 0.0, + 0.5008197575807571, + 0.06263047643005848, + 0.0, + 0.024632655084133148, + 0.24430272728204727, + 0.03415955975651741, + 0.11205202713608742, + 0.0, + 0.11537626385688782 + ], + "unique_experts": 54, + "load_cv": 0.9926664834129886, + "normalized_load_entropy": 0.8896842500958414, + "max_load_share": 0.07142857142857142 + }, + "full_input": { + "tokens": 83, + "top_k": 6, + "decisions": 498, + "ordered_route_sha256": "cbfc186e6bc3e47b4eee45533239546cfcc4343c1eb167472f06c662b25f55ed", + "route_weight_sha256": "246c720e00f558af37bc9c9a85cc6307abc8811752b32457dda343e0f84f5a7d", + "loads": [ + 4, + 19, + 12, + 7, + 3, + 1, + 25, + 5, + 32, + 2, + 9, + 12, + 13, + 14, + 2, + 6, + 0, + 25, + 7, + 0, + 4, + 0, + 3, + 4, + 2, + 16, + 1, + 5, + 3, + 1, + 8, + 2, + 8, + 31, + 1, + 1, + 1, + 5, + 7, + 9, + 24, + 4, + 3, + 2, + 1, + 21, + 21, + 4, + 8, + 10, + 10, + 0, + 15, + 11, + 4, + 19, + 2, + 0, + 4, + 6, + 1, + 7, + 3, + 8 + ], + "weighted_loads": [ + 0.2495826780796051, + 1.2312361728399992, + 0.7130561172962189, + 0.33765456080436707, + 0.13220791891217232, + 0.04495854675769806, + 1.8497242778539658, + 0.3495757859200239, + 2.6222721114754677, + 0.12388867512345314, + 0.49305666610598564, + 0.8127464374992996, + 0.7787280939519405, + 0.9183787666261196, + 0.09288493543863297, + 0.26435553655028343, + 0.0, + 1.6266853027045727, + 0.277472160756588, + 0.0, + 0.25016558542847633, + 0.0, + 0.10335462354123592, + 0.1888187024742365, + 0.11302754655480385, + 1.3371861837804317, + 0.0616060271859169, + 0.23338995687663555, + 0.11444157734513283, + 0.05190429836511612, + 0.23673833813518286, + 0.1245819739997387, + 0.46523135527968407, + 1.8667937647551298, + 0.05369246378540993, + 0.04552396386861801, + 0.027500949800014496, + 0.2575070057064295, + 0.43211914971470833, + 0.2737198225222528, + 1.0602857656776905, + 0.14279353618621826, + 0.21132686361670494, + 0.06324024125933647, + 0.0388888455927372, + 1.4973180294036865, + 1.5028269588947296, + 0.11353981588035822, + 0.544159023091197, + 0.5341011788696051, + 0.7487771287560463, + 0.0, + 1.0673691108822823, + 1.06001415848732, + 1.5832302179187536, + 1.2331959903240204, + 0.06263047643005848, + 0.0, + 0.12530208262614906, + 0.3159494213759899, + 0.03415955975651741, + 0.2993306629359722, + 0.14311015605926514, + 0.40711498260498047 + ], + "unique_experts": 59, + "load_cv": 1.0089757019999714, + "normalized_load_entropy": 0.8890694240592749, + "max_load_share": 0.0642570281124498 + } + }, + "s0_bos": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "6948431c3f677ee5b77bee6ff3163ce300473b4dbe7877a6fe1144752cd317cc", + "route_weight_sha256": "2aad5d25ca991bb9f646786f9f6828fd62b202ce46aad84e9647bb440195b66b", + "loads": [ + 3, + 14, + 3, + 3, + 3, + 0, + 16, + 5, + 19, + 3, + 5, + 8, + 4, + 7, + 2, + 5, + 0, + 11, + 6, + 0, + 3, + 0, + 1, + 0, + 2, + 6, + 1, + 3, + 2, + 1, + 4, + 2, + 4, + 13, + 1, + 1, + 1, + 5, + 0, + 4, + 11, + 4, + 1, + 2, + 1, + 9, + 7, + 0, + 4, + 5, + 6, + 0, + 6, + 4, + 2, + 7, + 2, + 0, + 0, + 4, + 1, + 2, + 1, + 2 + ], + "weighted_loads": [ + 0.23484888672828674, + 0.9847405478358269, + 0.11935818009078503, + 0.14177634194493294, + 0.1314120516180992, + 0.0, + 1.089529873803258, + 0.33399449847638607, + 1.673180878162384, + 0.1623251475393772, + 0.2958422563970089, + 0.7282441221177578, + 0.2304263338446617, + 0.4641265645623207, + 0.08545007929205894, + 0.19126232154667377, + 0.0, + 0.6993318516761065, + 0.23317794688045979, + 0.0, + 0.1885540522634983, + 0.0, + 0.03383253142237663, + 0.0, + 0.10256968066096306, + 0.3272828012704849, + 0.060127515345811844, + 0.11021367087960243, + 0.07481352984905243, + 0.053717855364084244, + 0.1488939356058836, + 0.1286349557340145, + 0.32372843474149704, + 0.6795537248253822, + 0.05453546717762947, + 0.048891082406044006, + 0.024701915681362152, + 0.2538589835166931, + 0.0, + 0.13538289442658424, + 0.4591093137860298, + 0.14834626391530037, + 0.042382754385471344, + 0.06409246101975441, + 0.041287049651145935, + 0.4783165045082569, + 0.46664096415042877, + 0.0, + 0.18076424673199654, + 0.20474259927868843, + 0.5094963610172272, + 0.0, + 0.554314635694027, + 0.354770515114069, + 0.06869297847151756, + 0.4393621049821377, + 0.05957972817122936, + 0.0, + 0.0, + 0.24421897903084755, + 0.042514827102422714, + 0.0747821070253849, + 0.02709381654858589, + 0.07546716555953026 + ], + "unique_experts": 54, + "load_cv": 1.0187212056965105, + "normalized_load_entropy": 0.887032039570809, + "max_load_share": 0.07539682539682539 + }, + "full_input": { + "tokens": 67, + "top_k": 6, + "decisions": 402, + "ordered_route_sha256": "10f185c55aec1b85321e50d508ad2fdb0ba182f9c1b74dac9253b2e62581cab6", + "route_weight_sha256": "1df36cd959cff79e8a3f2dcc54434f7e6eda7c171ce8892502b46c7179547e3b", + "loads": [ + 3, + 20, + 5, + 4, + 4, + 0, + 20, + 6, + 28, + 3, + 6, + 11, + 11, + 14, + 2, + 6, + 0, + 14, + 6, + 0, + 4, + 0, + 3, + 0, + 3, + 18, + 1, + 3, + 2, + 1, + 6, + 2, + 9, + 27, + 1, + 1, + 1, + 5, + 0, + 10, + 17, + 4, + 1, + 2, + 1, + 16, + 15, + 3, + 4, + 8, + 9, + 0, + 17, + 4, + 6, + 15, + 2, + 0, + 3, + 4, + 1, + 2, + 3, + 5 + ], + "weighted_loads": [ + 0.23484888672828674, + 1.3538723587989807, + 0.1585036888718605, + 0.1878465600311756, + 0.19207240641117096, + 0.0, + 1.3831851910799742, + 0.37910189665853977, + 2.3690240122377872, + 0.1623251475393772, + 0.3528204895555973, + 0.8422974972054362, + 0.6145467758178711, + 0.9405688382685184, + 0.08545007929205894, + 0.23767493478953838, + 0.0, + 0.8523004297167063, + 0.23317794688045979, + 0.0, + 0.2356717698276043, + 0.0, + 0.10654465854167938, + 0.0, + 0.14840707182884216, + 1.1521987989544868, + 0.060127515345811844, + 0.11021367087960243, + 0.07481352984905243, + 0.053717855364084244, + 0.22263418324291706, + 0.1286349557340145, + 0.5542391911149025, + 1.7680626977235079, + 0.05453546717762947, + 0.048891082406044006, + 0.024701915681362152, + 0.2538589835166931, + 0.0, + 0.36060827411711216, + 0.8131068572402, + 0.14834626391530037, + 0.042382754385471344, + 0.06409246101975441, + 0.041287049651145935, + 1.007158037275076, + 1.167514879256487, + 0.10917067900300026, + 0.18076424673199654, + 0.3783932663500309, + 0.6816073358058929, + 0.0, + 1.210671991109848, + 0.354770515114069, + 0.7770780008286238, + 0.9309654105454683, + 0.05957972817122936, + 0.0, + 0.1136852316558361, + 0.24421897903084755, + 0.042514827102422714, + 0.0747821070253849, + 0.11717145889997482, + 0.28279734775424004 + ], + "unique_experts": 56, + "load_cv": 1.0648044745843361, + "normalized_load_entropy": 0.8771561423369116, + "max_load_share": 0.06965174129353234 + } + }, + "s1_bos": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "be02e18a9bd1128a97e079b4d7b5abf5e93dca97d91726c07b56c3b4d99eb13e", + "route_weight_sha256": "6c3e7438f9e6b2168af9dcb7afaa2a6954cc4fdeafa62d801840e39024233e50", + "loads": [ + 3, + 14, + 3, + 4, + 4, + 0, + 16, + 5, + 19, + 3, + 5, + 8, + 4, + 7, + 2, + 5, + 0, + 10, + 6, + 0, + 3, + 0, + 1, + 0, + 2, + 6, + 2, + 3, + 2, + 1, + 5, + 2, + 4, + 13, + 1, + 1, + 1, + 4, + 0, + 1, + 11, + 5, + 1, + 2, + 1, + 8, + 6, + 0, + 4, + 5, + 7, + 0, + 6, + 4, + 2, + 8, + 2, + 0, + 0, + 3, + 1, + 2, + 1, + 3 + ], + "weighted_loads": [ + 0.22002943977713585, + 0.9906067214906216, + 0.12299248948693275, + 0.18269836902618408, + 0.15943468548357487, + 0.0, + 1.1165027916431427, + 0.3439929950982332, + 1.7235926873981953, + 0.16609030961990356, + 0.3000040538609028, + 0.7076981104910374, + 0.23408597335219383, + 0.4752241261303425, + 0.08553285151720047, + 0.19486775435507298, + 0.0, + 0.628229133784771, + 0.23843304626643658, + 0.0, + 0.20299329981207848, + 0.0, + 0.03321244195103645, + 0.0, + 0.09937309473752975, + 0.3525439538061619, + 0.08980626985430717, + 0.11698707193136215, + 0.07391579821705818, + 0.05381891876459122, + 0.16957535967230797, + 0.12773267552256584, + 0.3258357420563698, + 0.638261079788208, + 0.05277018994092941, + 0.05146513506770134, + 0.024876464158296585, + 0.2377406358718872, + 0.0, + 0.04905560240149498, + 0.45615920051932335, + 0.16888715885579586, + 0.04212972894310951, + 0.06340372562408447, + 0.04059353843331337, + 0.41325586661696434, + 0.3684445545077324, + 0.0, + 0.1828041709959507, + 0.20802947878837585, + 0.5464796293526888, + 0.0, + 0.5510620810091496, + 0.3730785511434078, + 0.06811656057834625, + 0.48821384459733963, + 0.05928990989923477, + 0.0, + 0.0, + 0.2117180973291397, + 0.03692959249019623, + 0.07734495028853416, + 0.024565832689404488, + 0.10732100531458855 + ], + "unique_experts": 54, + "load_cv": 1.011772478125923, + "normalized_load_entropy": 0.8879616929101501, + "max_load_share": 0.07539682539682539 + }, + "full_input": { + "tokens": 83, + "top_k": 6, + "decisions": 498, + "ordered_route_sha256": "bc588cc44c47c0ae3859b3bdeb881d57e5d261482e4924c514bf9b0ec163394a", + "route_weight_sha256": "0cc727b2ebdfd9a1fc2829c90d4e7363a65b6ad217eac881c57b3363a801bf74", + "loads": [ + 4, + 19, + 13, + 6, + 5, + 1, + 26, + 5, + 33, + 3, + 9, + 12, + 13, + 14, + 2, + 6, + 0, + 25, + 7, + 0, + 4, + 0, + 2, + 4, + 2, + 17, + 2, + 5, + 3, + 1, + 7, + 2, + 8, + 33, + 1, + 1, + 1, + 4, + 6, + 6, + 23, + 5, + 3, + 2, + 1, + 22, + 20, + 3, + 8, + 11, + 11, + 0, + 15, + 10, + 5, + 19, + 2, + 0, + 2, + 4, + 1, + 6, + 4, + 9 + ], + "weighted_loads": [ + 0.25849780440330505, + 1.269438175484538, + 0.7435665391385555, + 0.28819209709763527, + 0.20583298988640308, + 0.04495854675769806, + 1.93346294388175, + 0.3439929950982332, + 2.706896435469389, + 0.16609030961990356, + 0.4921039491891861, + 0.8699107533320785, + 0.7726590149104595, + 0.9293763935565948, + 0.08553285151720047, + 0.24069680459797382, + 0.0, + 1.6671596840023994, + 0.2849428001791239, + 0.0, + 0.25220371782779694, + 0.0, + 0.07302957773208618, + 0.1888187024742365, + 0.09937309473752975, + 1.462373960763216, + 0.08980626985430717, + 0.23572837561368942, + 0.11596526578068733, + 0.05381891876459122, + 0.2348201610147953, + 0.12773267552256584, + 0.47232405841350555, + 2.065218575298786, + 0.05277018994092941, + 0.05146513506770134, + 0.024876464158296585, + 0.2377406358718872, + 0.3959667533636093, + 0.21567565016448498, + 1.0368456952273846, + 0.16888715885579586, + 0.20974789559841156, + 0.06340372562408447, + 0.04059353843331337, + 1.5631413906812668, + 1.361383344978094, + 0.10444516688585281, + 0.5308419428765774, + 0.5935620591044426, + 0.7717991527169943, + 0.0, + 1.0668580010533333, + 1.0519258342683315, + 0.7371868882328272, + 1.2223051339387894, + 0.05928990989923477, + 0.0, + 0.09775993227958679, + 0.24446361884474754, + 0.03692959249019623, + 0.26462358608841896, + 0.1664402987807989, + 0.45198097079992294 + ], + "unique_experts": 59, + "load_cv": 1.0332374147157395, + "normalized_load_entropy": 0.886179612833878, + "max_load_share": 0.06626506024096386 + } + }, + "s0_x": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "615168823b8f5607168fe664f50a77c8263fa8f65ba27d126043fe4c5af7c19e", + "route_weight_sha256": "88dec7adca78f5dfe981864bfc01b00667baf26b3c46a4bad9801261b40a3b52", + "loads": [ + 3, + 14, + 2, + 3, + 3, + 0, + 16, + 5, + 19, + 3, + 5, + 8, + 3, + 7, + 2, + 5, + 0, + 11, + 6, + 0, + 3, + 0, + 2, + 0, + 2, + 6, + 2, + 3, + 3, + 1, + 5, + 2, + 4, + 12, + 1, + 1, + 1, + 5, + 1, + 1, + 12, + 5, + 1, + 2, + 1, + 9, + 6, + 0, + 4, + 5, + 6, + 0, + 5, + 3, + 2, + 8, + 2, + 0, + 0, + 4, + 2, + 2, + 1, + 2 + ], + "weighted_loads": [ + 0.24336231872439384, + 0.9853287674486637, + 0.09145517274737358, + 0.13290602713823318, + 0.12835488095879555, + 0.0, + 1.1022758930921555, + 0.3415695410221815, + 1.8287701196968555, + 0.15977533161640167, + 0.2818841654807329, + 0.7247399762272835, + 0.19688022881746292, + 0.45680128782987595, + 0.0814681202173233, + 0.19079109653830528, + 0.0, + 0.6463086046278477, + 0.2413368672132492, + 0.0, + 0.1773301288485527, + 0.0, + 0.06579799950122833, + 0.0, + 0.10409368202090263, + 0.3298831172287464, + 0.09009091183543205, + 0.11329184100031853, + 0.1079590804874897, + 0.05426850542426109, + 0.166974863037467, + 0.12755270302295685, + 0.33238109201192856, + 0.5919889695942402, + 0.05603298917412758, + 0.05834377557039261, + 0.024157529696822166, + 0.26390496268868446, + 0.0374392569065094, + 0.04403536766767502, + 0.49838295206427574, + 0.17997808754444122, + 0.04199283942580223, + 0.064019326120615, + 0.040752895176410675, + 0.5112030208110809, + 0.4097384437918663, + 0.0, + 0.17862533405423164, + 0.2117222659289837, + 0.5236208327114582, + 0.0, + 0.5163185186684132, + 0.31683769822120667, + 0.0686611607670784, + 0.5112781152129173, + 0.058052077889442444, + 0.0, + 0.0, + 0.24509217776358128, + 0.07211956568062305, + 0.07452941313385963, + 0.029017459601163864, + 0.0757426880300045 + ], + "unique_experts": 55, + "load_cv": 1.0127680724412236, + "normalized_load_entropy": 0.8903948944681012, + "max_load_share": 0.07539682539682539 + }, + "full_input": { + "tokens": 67, + "top_k": 6, + "decisions": 402, + "ordered_route_sha256": "6bf3bbe91fbb08e60b025e5014b575ebd2f7d39e437ebd9ca4f2afa2adb4e7c7", + "route_weight_sha256": "bd9188cec1d15b52c04336cebe4f038a23be99dd18068cf37d7a74023ff880c4", + "loads": [ + 3, + 21, + 5, + 4, + 4, + 0, + 21, + 6, + 29, + 3, + 6, + 11, + 10, + 15, + 2, + 5, + 0, + 14, + 6, + 0, + 4, + 0, + 4, + 0, + 2, + 20, + 2, + 3, + 3, + 1, + 6, + 2, + 10, + 25, + 1, + 1, + 1, + 5, + 1, + 6, + 17, + 5, + 1, + 2, + 1, + 15, + 13, + 3, + 4, + 9, + 10, + 0, + 16, + 3, + 4, + 16, + 2, + 0, + 3, + 4, + 2, + 2, + 3, + 5 + ], + "weighted_loads": [ + 0.24336231872439384, + 1.40764681994915, + 0.17218163795769215, + 0.18222404643893242, + 0.1890152357518673, + 0.0, + 1.446817509829998, + 0.3866769392043352, + 2.5926178470253944, + 0.15977533161640167, + 0.33889844827353954, + 0.834403551183641, + 0.5810006707906723, + 1.016374185681343, + 0.0814681202173233, + 0.19079109653830528, + 0.0, + 0.7882868573069572, + 0.2413368672132492, + 0.0, + 0.22275184094905853, + 0.0, + 0.13851012662053108, + 0.0, + 0.10409368202090263, + 1.2944291643798351, + 0.09009091183543205, + 0.11329184100031853, + 0.1079590804874897, + 0.05426850542426109, + 0.18318306095898151, + 0.12755270302295685, + 0.6113659515976906, + 1.5164008755236864, + 0.05603298917412758, + 0.05834377557039261, + 0.024157529696822166, + 0.26390496268868446, + 0.0374392569065094, + 0.21048046462237835, + 0.7834485955536366, + 0.17997808754444122, + 0.04199283942580223, + 0.064019326120615, + 0.040752895176410675, + 0.9916287511587143, + 1.0409624874591827, + 0.10917067900300026, + 0.17862533405423164, + 0.4425954334437847, + 0.7498049475252628, + 0.0, + 1.1726758740842342, + 0.31683769822120667, + 0.6925409194082022, + 1.0229926649481058, + 0.058052077889442444, + 0.0, + 0.1136852316558361, + 0.24509217776358128, + 0.07211956568062305, + 0.07452941313385963, + 0.12117516249418259, + 0.2830728702247143 + ], + "unique_experts": 57, + "load_cv": 1.0659196723497881, + "normalized_load_entropy": 0.8797055008733482, + "max_load_share": 0.07213930348258707 + } + }, + "s1_x": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "6641186d44e2141127c3968c54977ed9222418dc4256c26016131b9d1aab83e1", + "route_weight_sha256": "9009b232b2f7fb2e3c88776e20a4ea746b227635137f7dcc3cbc9a935174aab4", + "loads": [ + 4, + 14, + 3, + 3, + 3, + 0, + 16, + 5, + 21, + 3, + 5, + 8, + 4, + 7, + 3, + 5, + 0, + 8, + 8, + 0, + 3, + 0, + 1, + 0, + 2, + 7, + 2, + 3, + 2, + 1, + 4, + 2, + 4, + 12, + 1, + 1, + 1, + 5, + 0, + 1, + 12, + 4, + 1, + 1, + 1, + 9, + 6, + 0, + 4, + 4, + 7, + 0, + 6, + 4, + 1, + 8, + 2, + 0, + 1, + 3, + 1, + 3, + 0, + 2 + ], + "weighted_loads": [ + 0.25241140462458134, + 0.9778187237679958, + 0.12690849602222443, + 0.13961127027869225, + 0.1296471357345581, + 0.0, + 1.113996483385563, + 0.34822348691523075, + 1.8969946540892124, + 0.16346215456724167, + 0.29458525590598583, + 0.6688337475061417, + 0.2417571134865284, + 0.4808884672820568, + 0.1175995022058487, + 0.196493623778224, + 0.0, + 0.5113468691706657, + 0.3049396462738514, + 0.0, + 0.19438179209828377, + 0.0, + 0.031930264085531235, + 0.0, + 0.10215466096997261, + 0.36414507403969765, + 0.09001636877655983, + 0.12166183441877365, + 0.07320061698555946, + 0.0534263476729393, + 0.14051239006221294, + 0.12910402193665504, + 0.33248572796583176, + 0.5277948435395956, + 0.05211636796593666, + 0.05291365459561348, + 0.02460312470793724, + 0.2735605910420418, + 0.0, + 0.04160572588443756, + 0.4822956696152687, + 0.13671349734067917, + 0.04147978127002716, + 0.03174024820327759, + 0.03977343440055847, + 0.4618905149400234, + 0.37474147602915764, + 0.0, + 0.18255597725510597, + 0.1911352537572384, + 0.5487393662333488, + 0.0, + 0.5243605487048626, + 0.35088319703936577, + 0.03511643037199974, + 0.5419779121875763, + 0.06037190929055214, + 0.0, + 0.024424633011221886, + 0.21375320479273796, + 0.035049181431531906, + 0.10646474361419678, + 0.0, + 0.07392865046858788 + ], + "unique_experts": 54, + "load_cv": 1.0479797358885121, + "normalized_load_entropy": 0.882908682616037, + "max_load_share": 0.08333333333333333 + }, + "full_input": { + "tokens": 83, + "top_k": 6, + "decisions": 498, + "ordered_route_sha256": "ab20cc817b4222bbec714a37609f5077aa6b3913cd1546a778aa1a358ccba901", + "route_weight_sha256": "76cbf3824302b4d449303691b5bf60d826dc33022cf8709e02f4e42bd1a8d5cf", + "loads": [ + 5, + 21, + 13, + 5, + 3, + 1, + 28, + 5, + 36, + 3, + 9, + 13, + 13, + 16, + 3, + 5, + 0, + 22, + 10, + 0, + 4, + 0, + 2, + 4, + 2, + 21, + 2, + 5, + 3, + 1, + 5, + 2, + 9, + 28, + 1, + 1, + 1, + 5, + 6, + 5, + 23, + 4, + 3, + 1, + 1, + 22, + 20, + 3, + 8, + 10, + 12, + 0, + 15, + 10, + 3, + 18, + 2, + 0, + 3, + 4, + 1, + 7, + 3, + 7 + ], + "weighted_loads": [ + 0.29087976925075054, + 1.3381434474140406, + 0.7474825456738472, + 0.24824628978967667, + 0.1296471357345581, + 0.04495854675769806, + 2.0182288214564323, + 0.34822348691523075, + 2.932779051363468, + 0.16346215456724167, + 0.48444664664566517, + 0.8617895869538188, + 0.7803301550447941, + 1.0627298839390278, + 0.1175995022058487, + 0.196493623778224, + 0.0, + 1.5085975602269173, + 0.38595112040638924, + 0.0, + 0.24224476888775826, + 0.0, + 0.07174739986658096, + 0.1888187024742365, + 0.10215466096997261, + 1.6799768768250942, + 0.09001636877655983, + 0.24040313810110092, + 0.11525008454918861, + 0.0534263476729393, + 0.15672058798372746, + 0.12910402193665504, + 0.5208301618695259, + 1.6160405557602644, + 0.05211636796593666, + 0.05291365459561348, + 0.02460312470793724, + 0.2735605910420418, + 0.3959667533636093, + 0.15979671664536, + 0.9817712642252445, + 0.13671349734067917, + 0.2090979479253292, + 0.03174024820327759, + 0.03977343440055847, + 1.5092663764953613, + 1.3131897002458572, + 0.10444516688585281, + 0.5305937491357327, + 0.5848961882293224, + 0.8456097431480885, + 0.0, + 1.0401564687490463, + 1.0297304801642895, + 0.6587270777672529, + 1.1939806155860424, + 0.06037190929055214, + 0.0, + 0.12218456529080868, + 0.2464987263083458, + 0.035049181431531906, + 0.2937433794140816, + 0.1442832164466381, + 0.3656673692166805 + ], + "unique_experts": 59, + "load_cv": 1.0481158321637434, + "normalized_load_entropy": 0.8826572692577042, + "max_load_share": 0.07228915662650602 + } + }, + "s0_period": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "29c3d77791ca3adc3b81c0540d63bd42d384b118178cfebe7cd0c1ee1a5b4838", + "route_weight_sha256": "13181f321eed5d24a1b837a5c6ef4a03e29705b3b1c14c0de8ddedc9735f3cce", + "loads": [ + 3, + 14, + 2, + 3, + 4, + 0, + 16, + 5, + 20, + 3, + 5, + 8, + 4, + 7, + 1, + 5, + 0, + 9, + 7, + 0, + 3, + 0, + 2, + 0, + 2, + 6, + 2, + 3, + 3, + 1, + 5, + 2, + 4, + 12, + 1, + 1, + 1, + 5, + 1, + 1, + 13, + 4, + 1, + 2, + 1, + 10, + 6, + 0, + 5, + 4, + 6, + 0, + 5, + 3, + 1, + 7, + 2, + 0, + 0, + 4, + 1, + 3, + 0, + 3 + ], + "weighted_loads": [ + 0.2394757866859436, + 0.9875818938016891, + 0.09232491441071033, + 0.13254885375499725, + 0.1527074333280325, + 0.0, + 1.0903225876390934, + 0.34189074113965034, + 1.7742913626134396, + 0.1601559743285179, + 0.28283214569091797, + 0.7330184653401375, + 0.23974106460809708, + 0.4739740528166294, + 0.04797680675983429, + 0.19043554924428463, + 0.0, + 0.5830781981348991, + 0.27545809000730515, + 0.0, + 0.17446886003017426, + 0.0, + 0.06607326865196228, + 0.0, + 0.10232850536704063, + 0.3328906446695328, + 0.08929204195737839, + 0.11483494378626347, + 0.10539394617080688, + 0.053893234580755234, + 0.16790966130793095, + 0.12609773129224777, + 0.33116626366972923, + 0.5827861651778221, + 0.055272072553634644, + 0.05842101201415062, + 0.024897752329707146, + 0.26071644201874733, + 0.036803364753723145, + 0.04407157376408577, + 0.533350583165884, + 0.14195970445871353, + 0.04333936795592308, + 0.06457608565688133, + 0.04087161272764206, + 0.5674498900771141, + 0.42459792643785477, + 0.0, + 0.21015122719109058, + 0.176486786454916, + 0.5258112475275993, + 0.0, + 0.5025450438261032, + 0.3192160166800022, + 0.03618573024868965, + 0.4615374878048897, + 0.057734809815883636, + 0.0, + 0.0, + 0.24527771584689617, + 0.04110979288816452, + 0.10869204998016357, + 0.0, + 0.10612887144088745 + ], + "unique_experts": 54, + "load_cv": 1.0354025560190752, + "normalized_load_entropy": 0.8849959579314572, + "max_load_share": 0.07936507936507936 + }, + "full_input": { + "tokens": 67, + "top_k": 6, + "decisions": 402, + "ordered_route_sha256": "112038a62a83d0a412f3c43d35150ae680041205e1ad0ca38b403576b1301cdd", + "route_weight_sha256": "b9e8ff3b34a51b0dfa302a6c97ef4409a294eacb5fd51ebf90bd8ba0c9bf1d09", + "loads": [ + 3, + 20, + 4, + 4, + 5, + 0, + 23, + 6, + 30, + 3, + 6, + 11, + 11, + 15, + 1, + 5, + 0, + 12, + 7, + 0, + 4, + 0, + 4, + 0, + 2, + 20, + 2, + 3, + 3, + 1, + 6, + 2, + 9, + 25, + 1, + 1, + 1, + 5, + 1, + 6, + 17, + 4, + 1, + 2, + 1, + 16, + 14, + 3, + 5, + 9, + 9, + 0, + 16, + 3, + 3, + 15, + 2, + 0, + 3, + 4, + 1, + 3, + 2, + 7 + ], + "weighted_loads": [ + 0.2394757866859436, + 1.356713704764843, + 0.1314704231917858, + 0.1795041561126709, + 0.21336778812110424, + 0.0, + 1.5843850560486317, + 0.38699813932180405, + 2.5844017900526524, + 0.1601559743285179, + 0.33974647894501686, + 0.842078841291368, + 0.6238615065813065, + 0.9888230301439762, + 0.04797680675983429, + 0.19043554924428463, + 0.0, + 0.7126010358333588, + 0.27545809000730515, + 0.0, + 0.21717702224850655, + 0.0, + 0.13878539577126503, + 0.0, + 0.10232850536704063, + 1.2911334410309792, + 0.08929204195737839, + 0.11483494378626347, + 0.10539394617080688, + 0.053893234580755234, + 0.18411785922944546, + 0.12609773129224777, + 0.5763659328222275, + 1.5209358129650354, + 0.055272072553634644, + 0.05842101201415062, + 0.024897752329707146, + 0.26071644201874733, + 0.036803364753723145, + 0.20852811075747013, + 0.7688848301768303, + 0.14195970445871353, + 0.04333936795592308, + 0.06457608565688133, + 0.04087161272764206, + 1.048325601965189, + 1.1040120869874954, + 0.10917067900300026, + 0.21015122719109058, + 0.4374922849237919, + 0.6979222223162651, + 0.0, + 1.1589023992419243, + 0.3192160166800022, + 0.6600654888898134, + 0.9564096163958311, + 0.057734809815883636, + 0.0, + 0.1136852316558361, + 0.24527771584689617, + 0.04110979288816452, + 0.10869204998016357, + 0.08882303908467293, + 0.43914902210235596 + ], + "unique_experts": 57, + "load_cv": 1.0821438769459557, + "normalized_load_entropy": 0.8765399727932142, + "max_load_share": 0.07462686567164178 + } + }, + "s1_period": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "ed5bf2ff570bfb4915aeab24201be5be2909e5424bb99f97b9f7203548e37692", + "route_weight_sha256": "5010f383f8601c2fc329c87274be16eb192d60f389cbce0879b08dd6ae53a9f6", + "loads": [ + 4, + 14, + 3, + 4, + 3, + 0, + 16, + 5, + 21, + 3, + 5, + 8, + 4, + 7, + 3, + 5, + 0, + 8, + 9, + 0, + 3, + 0, + 1, + 0, + 2, + 7, + 1, + 3, + 2, + 1, + 3, + 2, + 4, + 11, + 1, + 1, + 1, + 5, + 0, + 2, + 12, + 4, + 1, + 1, + 1, + 8, + 6, + 0, + 4, + 4, + 7, + 0, + 6, + 4, + 1, + 8, + 3, + 0, + 1, + 3, + 1, + 3, + 0, + 2 + ], + "weighted_loads": [ + 0.2489162664860487, + 0.9713344685733318, + 0.12866957299411297, + 0.17594172805547714, + 0.12986581772565842, + 0.0, + 1.1327501572668552, + 0.3530616872012615, + 1.8176101669669151, + 0.16413133963942528, + 0.2956267148256302, + 0.6811492033302784, + 0.24149245768785477, + 0.48077334091067314, + 0.1179719790816307, + 0.20118754915893078, + 0.0, + 0.5058483500033617, + 0.34127975441515446, + 0.0, + 0.19344064593315125, + 0.0, + 0.03149658441543579, + 0.0, + 0.10536698624491692, + 0.3706556037068367, + 0.05816291272640228, + 0.12354462593793869, + 0.07360963150858879, + 0.051655363291502, + 0.10896662063896656, + 0.12986153364181519, + 0.3380293734371662, + 0.5018183719366789, + 0.05249457433819771, + 0.05223878473043442, + 0.02486773580312729, + 0.27419062331318855, + 0.0, + 0.07268007472157478, + 0.48570961505174637, + 0.1351934615522623, + 0.04209272563457489, + 0.03163543716073036, + 0.04014813154935837, + 0.4275030605494976, + 0.36761265993118286, + 0.0, + 0.1886074971407652, + 0.18281812965869904, + 0.5576407816261053, + 0.0, + 0.5261388421058655, + 0.35244176536798477, + 0.03552516922354698, + 0.5100907124578953, + 0.09273095056414604, + 0.0, + 0.024271631613373756, + 0.2123202085494995, + 0.034872837364673615, + 0.10845082625746727, + 0.0, + 0.07247263938188553 + ], + "unique_experts": 54, + "load_cv": 1.039288668880689, + "normalized_load_entropy": 0.8843709277889735, + "max_load_share": 0.08333333333333333 + }, + "full_input": { + "tokens": 83, + "top_k": 6, + "decisions": 498, + "ordered_route_sha256": "77b775710710ee3c9da4526d31a8617e785f1358938b985b58605cae2442e0cd", + "route_weight_sha256": "e7d781f7b43221965d366b5f9b1ab83fbeb6bf6f7de81aad41a382d3672498c0", + "loads": [ + 5, + 19, + 13, + 6, + 3, + 1, + 29, + 5, + 36, + 3, + 9, + 12, + 13, + 14, + 3, + 6, + 0, + 23, + 11, + 0, + 4, + 0, + 2, + 4, + 2, + 21, + 1, + 5, + 3, + 1, + 4, + 2, + 8, + 27, + 1, + 1, + 1, + 5, + 6, + 6, + 23, + 4, + 3, + 1, + 1, + 20, + 21, + 3, + 8, + 12, + 11, + 0, + 15, + 10, + 3, + 19, + 3, + 0, + 3, + 4, + 1, + 7, + 3, + 8 + ], + "weighted_loads": [ + 0.2873846311122179, + 1.2501659225672483, + 0.7492436226457357, + 0.2861129157245159, + 0.12986581772565842, + 0.04495854675769806, + 2.1449670679867268, + 0.3530616872012615, + 2.872901540249586, + 0.16413133963942528, + 0.48668184131383896, + 0.8352890042588115, + 0.7800654992461205, + 0.9320831596851349, + 0.1179719790816307, + 0.24481364153325558, + 0.0, + 1.5501205269247293, + 0.42622569762170315, + 0.0, + 0.23939670994877815, + 0.0, + 0.07131372019648552, + 0.1888187024742365, + 0.10536698624491692, + 1.6528045125305653, + 0.05816291272640228, + 0.24228592962026596, + 0.11565909907221794, + 0.051655363291502, + 0.12517481856048107, + 0.12986153364181519, + 0.484517689794302, + 1.5962129030376673, + 0.05249457433819771, + 0.05223878473043442, + 0.02486773580312729, + 0.27419062331318855, + 0.3959667533636093, + 0.19032828323543072, + 0.9905099980533123, + 0.1351934615522623, + 0.20971089228987694, + 0.03163543716073036, + 0.04014813154935837, + 1.4424613416194916, + 1.4154393002390862, + 0.10444516688585281, + 0.5366452690213919, + 0.6729386746883392, + 0.7829603049904108, + 0.0, + 1.0419347621500492, + 1.0312890484929085, + 0.6591358166188002, + 1.1982944160699844, + 0.09273095056414604, + 0.0, + 0.12203156389296055, + 0.24506573006510735, + 0.034872837364673615, + 0.29572946205735207, + 0.14164825156331062, + 0.4375043362379074 + ], + "unique_experts": 59, + "load_cv": 1.0409511502025977, + "normalized_load_entropy": 0.8837310167543694, + "max_load_share": 0.07228915662650602 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 42, + "ordered_topk_exact_tokens": 26, + "set_exact_tokens": 30, + "mean_set_jaccard": 0.9183673469387754, + "mean_token_weighted_tv": 0.015111143057722421, + "aggregate_load_tv": 0.03968253968253968 + }, + "system_bos": { + "tokens": 42, + "ordered_topk_exact_tokens": 28, + "set_exact_tokens": 35, + "mean_set_jaccard": 0.947278911564626, + "mean_token_weighted_tv": 0.01521149341992679, + "aggregate_load_tv": 0.031746031746031744 + }, + "system_x": { + "tokens": 42, + "ordered_topk_exact_tokens": 17, + "set_exact_tokens": 26, + "mean_set_jaccard": 0.8809523809523809, + "mean_token_weighted_tv": 0.02441065534505816, + "aggregate_load_tv": 0.05555555555555555 + }, + "system_period": { + "tokens": 42, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 23, + "mean_set_jaccard": 0.8656462585034013, + "mean_token_weighted_tv": 0.025783755838693606, + "aggregate_load_tv": 0.06349206349206349 + }, + "bos_at_s0": { + "tokens": 42, + "ordered_topk_exact_tokens": 21, + "set_exact_tokens": 27, + "mean_set_jaccard": 0.8928571428571429, + "mean_token_weighted_tv": 0.02473460002580569, + "aggregate_load_tv": 0.03968253968253968 + }, + "bos_at_s1": { + "tokens": 42, + "ordered_topk_exact_tokens": 21, + "set_exact_tokens": 30, + "mean_set_jaccard": 0.9132653061224489, + "mean_token_weighted_tv": 0.02311064482533506, + "aggregate_load_tv": 0.051587301587301584 + }, + "x_at_s0": { + "tokens": 42, + "ordered_topk_exact_tokens": 20, + "set_exact_tokens": 28, + "mean_set_jaccard": 0.8945578231292517, + "mean_token_weighted_tv": 0.02673352330124804, + "aggregate_load_tv": 0.04365079365079365 + }, + "x_at_s1": { + "tokens": 42, + "ordered_topk_exact_tokens": 17, + "set_exact_tokens": 23, + "mean_set_jaccard": 0.8656462585034015, + "mean_token_weighted_tv": 0.030998164943108957, + "aggregate_load_tv": 0.07142857142857142 + }, + "period_at_s0": { + "tokens": 42, + "ordered_topk_exact_tokens": 16, + "set_exact_tokens": 24, + "mean_set_jaccard": 0.8622448979591836, + "mean_token_weighted_tv": 0.030866672040983326, + "aggregate_load_tv": 0.06349206349206349 + }, + "period_at_s1": { + "tokens": 42, + "ordered_topk_exact_tokens": 16, + "set_exact_tokens": 21, + "mean_set_jaccard": 0.8571428571428571, + "mean_token_weighted_tv": 0.03160798711524833, + "aggregate_load_tv": 0.07142857142857142 + } + } + }, + "layer_09": { + "layer": 9, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "49b897547d2707b099ad9032f8d27f38a862bd0a0140a2286f5ba39f54b5911f", + "route_weight_sha256": "36d236bb867f0c629e13e8d9f481e2b9db46db0ecb75162a9dde6dd795d9239c", + "loads": [ + 5, + 4, + 1, + 2, + 1, + 3, + 0, + 6, + 3, + 2, + 5, + 9, + 2, + 3, + 0, + 3, + 1, + 6, + 0, + 9, + 0, + 2, + 1, + 6, + 1, + 8, + 13, + 0, + 5, + 0, + 0, + 3, + 1, + 4, + 8, + 6, + 0, + 2, + 9, + 1, + 1, + 10, + 2, + 1, + 3, + 12, + 10, + 2, + 5, + 1, + 2, + 4, + 4, + 18, + 2, + 8, + 9, + 0, + 5, + 4, + 3, + 9, + 2, + 0 + ], + "weighted_loads": [ + 0.2735015079379082, + 0.2624985948204994, + 0.07821931689977646, + 0.07108703814446926, + 0.037102457135915756, + 0.1419193260371685, + 0.0, + 0.2826674096286297, + 0.19730748981237411, + 0.0819890908896923, + 0.26176317408680916, + 0.6716073043644428, + 0.07028147019445896, + 0.10616446658968925, + 0.0, + 0.1432187519967556, + 0.06018044799566269, + 0.2295221071690321, + 0.0, + 0.742968212813139, + 0.0, + 0.11609607562422752, + 0.04716205596923828, + 0.3177147526293993, + 0.03559080883860588, + 0.3312056679278612, + 0.8529977425932884, + 0.0, + 0.2827206179499626, + 0.0, + 0.0, + 0.15721628069877625, + 0.02313436195254326, + 0.22125495597720146, + 0.526743046939373, + 0.33306043967604637, + 0.0, + 0.11733423918485641, + 0.5072667077183723, + 0.027240801602602005, + 0.06036686897277832, + 0.647034116089344, + 0.07109729386866093, + 0.06356165558099747, + 0.15611687675118446, + 0.6803553402423859, + 0.7112166471779346, + 0.14897390455007553, + 0.33644895255565643, + 0.04313141852617264, + 0.07934848219156265, + 0.2831757664680481, + 0.16160355135798454, + 1.3710742946714163, + 0.11935196071863174, + 0.38754335418343544, + 0.5940395519137383, + 0.0, + 0.3310092054307461, + 0.2518966309726238, + 0.20661024376749992, + 0.6553749293088913, + 0.08802855759859085, + 0.0 + ], + "unique_experts": 54, + "load_cv": 0.9543630168607882, + "normalized_load_entropy": 0.8926150280980436, + "max_load_share": 0.07142857142857142 + }, + "full_input": { + "tokens": 67, + "top_k": 6, + "decisions": 402, + "ordered_route_sha256": "23415d4778f43f46b4dd5bf427499f28c36c578ce0c729d2f0d00829935a46e7", + "route_weight_sha256": "fb83dbb4d6b6a93b702f90604e4a94969037354ff333350a25adf219af61b612", + "loads": [ + 12, + 7, + 1, + 2, + 3, + 3, + 0, + 6, + 5, + 2, + 16, + 9, + 5, + 7, + 0, + 3, + 2, + 7, + 0, + 19, + 0, + 2, + 5, + 10, + 4, + 9, + 13, + 1, + 5, + 0, + 0, + 9, + 3, + 4, + 17, + 13, + 0, + 2, + 12, + 1, + 1, + 20, + 2, + 1, + 8, + 21, + 20, + 2, + 8, + 1, + 6, + 5, + 4, + 22, + 2, + 13, + 14, + 0, + 8, + 8, + 3, + 9, + 4, + 1 + ], + "weighted_loads": [ + 0.7585740238428116, + 0.5147848054766655, + 0.07821931689977646, + 0.07108703814446926, + 0.28765416517853737, + 0.1419193260371685, + 0.0, + 0.2826674096286297, + 0.29413601756095886, + 0.0819890908896923, + 1.4341332651674747, + 0.6716073043644428, + 0.12422561226412654, + 0.21492115617729723, + 0.0, + 0.1432187519967556, + 0.1013559065759182, + 0.27173408307135105, + 0.0, + 1.8187357224524021, + 0.0, + 0.11609607562422752, + 1.5829581022262573, + 0.6034744847565889, + 0.16280551627278328, + 0.4076674971729517, + 0.8529977425932884, + 0.013008564710617065, + 0.2827206179499626, + 0.0, + 0.0, + 0.3438385312911123, + 0.05986977438442409, + 0.22125495597720146, + 1.0221335925161839, + 0.805458378046751, + 0.0, + 0.11733423918485641, + 0.6295404322445393, + 0.027240801602602005, + 0.06036686897277832, + 1.618399553000927, + 0.07109729386866093, + 0.06356165558099747, + 0.47134867776185274, + 1.3581156805157661, + 1.4797025844454765, + 0.14897390455007553, + 0.5367149524390697, + 0.04313141852617264, + 0.2887524515390396, + 0.3170423023402691, + 0.16160355135798454, + 1.525249743834138, + 0.11935196071863174, + 0.6496921293437481, + 0.8362282104790211, + 0.0, + 0.5348554402589798, + 0.42459478229284286, + 0.20661024376749992, + 0.6553749293088913, + 0.1437802091240883, + 0.036286111921072006 + ], + "unique_experts": 56, + "load_cv": 0.9479276697917166, + "normalized_load_entropy": 0.8928314930862761, + "max_load_share": 0.05472636815920398 + } + }, + "s1_eos": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "3ab84532d7147f57f9d9b13c79e64be8ca326dff15c80d65b5b4b692d943c4a4", + "route_weight_sha256": "8775262191d3c4fb73254ab04b97a86bd73801146bae3ec843601ba7c675c950", + "loads": [ + 6, + 4, + 1, + 3, + 1, + 3, + 0, + 7, + 3, + 2, + 5, + 9, + 1, + 4, + 0, + 3, + 1, + 6, + 0, + 9, + 0, + 2, + 1, + 5, + 1, + 7, + 12, + 0, + 5, + 0, + 0, + 3, + 2, + 4, + 7, + 6, + 0, + 2, + 10, + 0, + 1, + 10, + 1, + 1, + 3, + 12, + 10, + 2, + 4, + 1, + 2, + 4, + 5, + 19, + 2, + 7, + 9, + 0, + 6, + 4, + 3, + 9, + 2, + 0 + ], + "weighted_loads": [ + 0.3000730499625206, + 0.2764595188200474, + 0.08078572899103165, + 0.11292559467256069, + 0.03881774842739105, + 0.14122408255934715, + 0.0, + 0.3285627216100693, + 0.19730966910719872, + 0.0824597030878067, + 0.2574754972010851, + 0.6822509840130806, + 0.03190339729189873, + 0.14778314158320427, + 0.0, + 0.1417950987815857, + 0.061586253345012665, + 0.23908348381519318, + 0.0, + 0.7400930039584637, + 0.0, + 0.11337015777826309, + 0.048573024570941925, + 0.28938162326812744, + 0.038795147091150284, + 0.30558745190501213, + 0.817633468657732, + 0.0, + 0.28099412843585014, + 0.0, + 0.0, + 0.1601988971233368, + 0.05313957296311855, + 0.21583618968725204, + 0.48675810918211937, + 0.3283998444676399, + 0.0, + 0.11983706057071686, + 0.5474571753293276, + 0.0, + 0.05689100921154022, + 0.6371536180377007, + 0.04055653512477875, + 0.059213485568761826, + 0.1617472730576992, + 0.7193687874823809, + 0.6934754140675068, + 0.14577379822731018, + 0.29830683022737503, + 0.04350905120372772, + 0.08067893236875534, + 0.2903761863708496, + 0.18173211440443993, + 1.4010272677987814, + 0.11832870170474052, + 0.3330788426101208, + 0.5948307476937771, + 0.0, + 0.37497036159038544, + 0.2510238252580166, + 0.20342371612787247, + 0.6412456147372723, + 0.08413930982351303, + 0.0 + ], + "unique_experts": 53, + "load_cv": 0.9638201894133501, + "normalized_load_entropy": 0.8898028193140786, + "max_load_share": 0.07539682539682539 + }, + "full_input": { + "tokens": 83, + "top_k": 6, + "decisions": 498, + "ordered_route_sha256": "6d8409ed9f1f82c0dacf1da4b9cde459a3f31725733d4d5ad0581991490e6f3d", + "route_weight_sha256": "44b26c33bedb66acfdae76c1b6088a25fbcb7a9192ba9170b14f8fcfaacab154", + "loads": [ + 17, + 9, + 1, + 3, + 3, + 3, + 0, + 7, + 10, + 4, + 16, + 11, + 4, + 8, + 1, + 3, + 2, + 7, + 0, + 19, + 0, + 5, + 5, + 16, + 6, + 15, + 16, + 1, + 11, + 0, + 2, + 8, + 4, + 7, + 13, + 19, + 0, + 5, + 15, + 1, + 7, + 25, + 3, + 1, + 8, + 26, + 30, + 2, + 11, + 6, + 4, + 5, + 5, + 22, + 3, + 12, + 14, + 0, + 11, + 8, + 3, + 10, + 4, + 1 + ], + "weighted_loads": [ + 1.0067683272063732, + 0.601113811135292, + 0.08078572899103165, + 0.11292559467256069, + 0.31664977967739105, + 0.14122408255934715, + 0.0, + 0.3285627216100693, + 0.615072600543499, + 0.17410588636994362, + 1.3461099285632372, + 0.7791312746703625, + 0.0854788413271308, + 0.24080349365249276, + 0.03954945504665375, + 0.1417950987815857, + 0.107024185359478, + 0.2949870228767395, + 0.0, + 1.8707005083560944, + 0.0, + 0.23954662680625916, + 1.5809771195054054, + 1.128542847931385, + 0.23191136866807938, + 0.7374559249728918, + 1.071665234863758, + 0.013008564710617065, + 0.708414364606142, + 0.0, + 0.13796716555953026, + 0.307922383537516, + 0.09516774443909526, + 0.4377147853374481, + 0.7917364351451397, + 1.1513597890734673, + 0.0, + 0.26067739725112915, + 0.7927710916846991, + 0.0667569637298584, + 0.45788856968283653, + 2.10109406709671, + 0.13335487246513367, + 0.059213485568761826, + 0.34533261228352785, + 1.83499869517982, + 2.347462136298418, + 0.14577379822731018, + 0.7260474190115929, + 0.37390486150979996, + 0.20363817363977432, + 0.3233145661652088, + 0.18173211440443993, + 1.5499568674713373, + 0.159552950412035, + 0.5811065677553415, + 0.8281311690807343, + 0.0, + 0.6856564618647099, + 0.43081963062286377, + 0.20342371612787247, + 0.6792283803224564, + 0.2440594621002674, + 0.03599189594388008 + ], + "unique_experts": 58, + "load_cv": 0.8977228728004489, + "normalized_load_entropy": 0.9048778659630408, + "max_load_share": 0.060240963855421686 + } + }, + "s0_bos": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "d57679aba4a58f488f27fd740a8e3032be9027f54ab3040741ff9d76095703ba", + "route_weight_sha256": "11f2d258fd1b67ac6861f9bbb40aea97b59ba7a764a1de50b851f959e335c05d", + "loads": [ + 4, + 5, + 1, + 1, + 1, + 3, + 0, + 6, + 2, + 3, + 4, + 9, + 0, + 5, + 0, + 3, + 1, + 5, + 1, + 10, + 0, + 2, + 1, + 6, + 1, + 6, + 12, + 1, + 5, + 0, + 0, + 3, + 2, + 4, + 9, + 6, + 0, + 2, + 10, + 0, + 1, + 9, + 2, + 1, + 5, + 12, + 11, + 3, + 4, + 1, + 3, + 4, + 5, + 19, + 2, + 6, + 8, + 0, + 5, + 4, + 3, + 8, + 2, + 0 + ], + "weighted_loads": [ + 0.19814804941415787, + 0.30209747701883316, + 0.0777745321393013, + 0.04342082515358925, + 0.03698638454079628, + 0.1650896519422531, + 0.0, + 0.2766476720571518, + 0.13418041914701462, + 0.11639737337827682, + 0.22024806216359138, + 0.7034731991589069, + 0.0, + 0.17047031223773956, + 0.0, + 0.13856890425086021, + 0.058791957795619965, + 0.1881272792816162, + 0.03227728232741356, + 0.7954717054963112, + 0.0, + 0.11856827884912491, + 0.04333685338497162, + 0.3418489657342434, + 0.029118621721863747, + 0.2598535232245922, + 0.8461242578923702, + 0.038333870470523834, + 0.2776947133243084, + 0.0, + 0.0, + 0.15952647849917412, + 0.050615860149264336, + 0.21139633655548096, + 0.5699235573410988, + 0.31552616879343987, + 0.0, + 0.12534736469388008, + 0.5514087229967117, + 0.0, + 0.05846855416893959, + 0.6550794690847397, + 0.06678910925984383, + 0.06019964814186096, + 0.27947869896888733, + 0.7425684612244368, + 0.7617571912705898, + 0.20741964504122734, + 0.29712576419115067, + 0.04084925353527069, + 0.10842364467680454, + 0.3017914816737175, + 0.19856498762965202, + 1.3492656610906124, + 0.11949682608246803, + 0.26718418300151825, + 0.543223861604929, + 0.0, + 0.33812442421913147, + 0.2477889433503151, + 0.19548247754573822, + 0.6540193036198616, + 0.0863431952893734, + 0.0 + ], + "unique_experts": 54, + "load_cv": 0.9533064286410665, + "normalized_load_entropy": 0.893746006845044, + "max_load_share": 0.07539682539682539 + }, + "full_input": { + "tokens": 67, + "top_k": 6, + "decisions": 402, + "ordered_route_sha256": "86419cb5d7f2061bca9323e9a217e29937f6680565a50287ac50b19ea1d03b3b", + "route_weight_sha256": "6da51fb7f47a3318aa100799131a6aa95031c15fa994340309d61ad26c83e8da", + "loads": [ + 12, + 8, + 1, + 1, + 4, + 3, + 0, + 6, + 4, + 3, + 15, + 9, + 2, + 9, + 0, + 3, + 2, + 10, + 1, + 20, + 0, + 2, + 4, + 10, + 4, + 7, + 12, + 2, + 5, + 0, + 0, + 8, + 2, + 4, + 18, + 13, + 0, + 2, + 11, + 1, + 1, + 19, + 2, + 1, + 8, + 21, + 22, + 3, + 7, + 1, + 9, + 5, + 5, + 23, + 2, + 11, + 13, + 0, + 7, + 8, + 3, + 8, + 4, + 1 + ], + "weighted_loads": [ + 0.7318329177796841, + 0.5297607369720936, + 0.0777745321393013, + 0.04342082515358925, + 0.3494671694934368, + 0.1650896519422531, + 0.0, + 0.2766476720571518, + 0.23100894689559937, + 0.11639737337827682, + 1.392618153244257, + 0.7034731991589069, + 0.04656588099896908, + 0.34536629263311625, + 0.0, + 0.13856890425086021, + 0.09996741637587547, + 0.3860525041818619, + 0.03227728232741356, + 1.8427579551935196, + 0.0, + 0.11856827884912491, + 0.6480880230665207, + 0.6714615523815155, + 0.15633332915604115, + 0.3363153524696827, + 0.8461242578923702, + 0.0513424351811409, + 0.2776947133243084, + 0.0, + 0.0, + 0.343430956825614, + 0.050615860149264336, + 0.21139633655548096, + 1.0653141029179096, + 0.7678589820861816, + 0.0, + 0.12534736469388008, + 0.5962342731654644, + 0.04449191316962242, + 0.05846855416893959, + 1.6289877519011497, + 0.06678910925984383, + 0.06019964814186096, + 0.5402170205488801, + 1.590211609378457, + 1.5630359202623367, + 0.20741964504122734, + 0.48039082810282707, + 0.04084925353527069, + 0.3887291941791773, + 0.3356580175459385, + 0.19856498762965202, + 1.5111296474933624, + 0.11949682608246803, + 0.5378039106726646, + 0.7854125201702118, + 0.0, + 0.4825054332613945, + 0.42048709467053413, + 0.19548247754573822, + 0.6540193036198616, + 0.14209484681487083, + 0.036286111921072006 + ], + "unique_experts": 57, + "load_cv": 0.9562468610178311, + "normalized_load_entropy": 0.8934789996789502, + "max_load_share": 0.05721393034825871 + } + }, + "s1_bos": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "280f9764048c61313947d0ae98cdc6c4b97a15d382e7b7c1ce2b24d19cc91891", + "route_weight_sha256": "c5d68bb07c4516c62f6e6bd25382a0ca16122a79a9e9875a223ec9b8ef5a94b2", + "loads": [ + 4, + 5, + 1, + 2, + 1, + 3, + 1, + 6, + 2, + 3, + 4, + 9, + 0, + 5, + 0, + 2, + 1, + 6, + 0, + 10, + 0, + 2, + 1, + 7, + 2, + 6, + 12, + 0, + 5, + 0, + 0, + 3, + 2, + 4, + 8, + 6, + 0, + 2, + 10, + 0, + 1, + 10, + 2, + 1, + 4, + 11, + 11, + 3, + 4, + 1, + 2, + 4, + 5, + 19, + 2, + 7, + 10, + 0, + 4, + 4, + 3, + 8, + 1, + 0 + ], + "weighted_loads": [ + 0.20632881298661232, + 0.3111537806689739, + 0.0791279599070549, + 0.07205589488148689, + 0.03752277418971062, + 0.15268809348344803, + 0.03305096924304962, + 0.27431192621588707, + 0.13820583373308182, + 0.11395925283432007, + 0.22190122306346893, + 0.7055912911891937, + 0.0, + 0.1740937978029251, + 0.0, + 0.10734524205327034, + 0.0605333186686039, + 0.22688177041709423, + 0.0, + 0.804067574441433, + 0.0, + 0.12015891075134277, + 0.04597853124141693, + 0.3846563994884491, + 0.06610514968633652, + 0.2562623769044876, + 0.8538555763661861, + 0.0, + 0.28155696764588356, + 0.0, + 0.0, + 0.16087088733911514, + 0.05107496306300163, + 0.22018051519989967, + 0.5262618958950043, + 0.30872792750597, + 0.0, + 0.12242733687162399, + 0.5600410550832748, + 0.0, + 0.05618208646774292, + 0.6819988824427128, + 0.07068091630935669, + 0.054857369512319565, + 0.25412847846746445, + 0.6912487708032131, + 0.762695100158453, + 0.20015356689691544, + 0.2952388897538185, + 0.04190408065915108, + 0.07905440777540207, + 0.3082827031612396, + 0.19219236448407173, + 1.4183944892138243, + 0.11806473135948181, + 0.28920913860201836, + 0.6276694536209106, + 0.0, + 0.3025246486067772, + 0.2504439540207386, + 0.19419632107019424, + 0.6280360221862793, + 0.03791678324341774, + 0.0 + ], + "unique_experts": 53, + "load_cv": 0.966952026064637, + "normalized_load_entropy": 0.8898646529131762, + "max_load_share": 0.07539682539682539 + }, + "full_input": { + "tokens": 83, + "top_k": 6, + "decisions": 498, + "ordered_route_sha256": "16de1c9c9f666f450465be15176bc5e42d4bc471adb6afadf6ac95a9eff50323", + "route_weight_sha256": "d17cfee11c7d0a6968f704ee8ef6df436eac0e057f81135bc0325759829a5e7e", + "loads": [ + 15, + 10, + 1, + 2, + 4, + 3, + 1, + 6, + 9, + 5, + 15, + 11, + 2, + 9, + 1, + 2, + 2, + 11, + 0, + 20, + 0, + 5, + 5, + 18, + 7, + 14, + 16, + 1, + 11, + 0, + 2, + 7, + 2, + 7, + 14, + 18, + 0, + 5, + 13, + 2, + 7, + 25, + 4, + 1, + 7, + 25, + 31, + 3, + 11, + 6, + 6, + 5, + 5, + 23, + 3, + 12, + 15, + 0, + 9, + 8, + 3, + 9, + 3, + 1 + ], + "weighted_loads": [ + 0.9566603004932404, + 0.6344523951411247, + 0.0791279599070549, + 0.07205589488148689, + 0.3788369484245777, + 0.15268809348344803, + 0.03305096924304962, + 0.27431192621588707, + 0.5559687651693821, + 0.20560543611645699, + 1.310535654425621, + 0.8024715818464756, + 0.046616869047284126, + 0.3195732207968831, + 0.03954945504665375, + 0.10734524205327034, + 0.10597125068306923, + 0.44526482559740543, + 0.0, + 1.955205049365759, + 0.0, + 0.24633537977933884, + 0.6875431574881077, + 1.2342863865196705, + 0.2592213712632656, + 0.6881308499723673, + 1.1078873425722122, + 0.013008564710617065, + 0.7089772038161755, + 0.0, + 0.13796716555953026, + 0.30576190538704395, + 0.05107496306300163, + 0.44205911085009575, + 0.8312402218580246, + 1.0884156860411167, + 0.0, + 0.2632676735520363, + 0.713432714343071, + 0.11535916104912758, + 0.45717964693903923, + 2.163724210113287, + 0.1634792536497116, + 0.054857369512319565, + 0.3838873477652669, + 1.9842936657369137, + 2.4182944521307945, + 0.20015356689691544, + 0.7156734094023705, + 0.3722998909652233, + 0.2677848618477583, + 0.34122108295559883, + 0.19219236448407173, + 1.6070686746388674, + 0.15928898006677628, + 0.5457498598843813, + 0.8609698750078678, + 0.0, + 0.6051095090806484, + 0.4302397593855858, + 0.19419632107019424, + 0.6660187877714634, + 0.19783693552017212, + 0.03599189594388008 + ], + "unique_experts": 59, + "load_cv": 0.8994459853684791, + "normalized_load_entropy": 0.9057558230563707, + "max_load_share": 0.06224899598393574 + } + }, + "s0_x": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "5368af09f918060f6efbcc5d0f41ee4a801b35c19a510f7612390293e229be4d", + "route_weight_sha256": "b5f7d20fdad5a92690aa619790785b08cdf12c0a3d63041b24fe363136e9041a", + "loads": [ + 5, + 5, + 1, + 1, + 1, + 3, + 1, + 5, + 3, + 2, + 4, + 9, + 0, + 4, + 0, + 2, + 1, + 4, + 0, + 10, + 0, + 2, + 1, + 5, + 1, + 6, + 13, + 1, + 5, + 0, + 0, + 4, + 2, + 4, + 9, + 7, + 0, + 2, + 12, + 0, + 1, + 11, + 2, + 1, + 4, + 13, + 10, + 3, + 4, + 1, + 3, + 4, + 5, + 19, + 2, + 5, + 8, + 0, + 5, + 4, + 3, + 8, + 1, + 0 + ], + "weighted_loads": [ + 0.2523542158305645, + 0.29282596334815025, + 0.08435440063476562, + 0.043973956257104874, + 0.039438992738723755, + 0.1604110710322857, + 0.03161059692502022, + 0.22412384673953056, + 0.18498649820685387, + 0.08148236945271492, + 0.22177864238619804, + 0.7012595012784004, + 0.0, + 0.13586138002574444, + 0.0, + 0.08663399145007133, + 0.05967835709452629, + 0.1330018751323223, + 0.0, + 0.7908168099820614, + 0.0, + 0.12115025892853737, + 0.0455707386136055, + 0.296186126768589, + 0.029738225042819977, + 0.2707030735909939, + 0.8736659921705723, + 0.03696946054697037, + 0.27826782315969467, + 0.0, + 0.0, + 0.21617857739329338, + 0.05069098435342312, + 0.20635101944208145, + 0.5560748614370823, + 0.38724419102072716, + 0.0, + 0.11971244215965271, + 0.6409076694399118, + 0.0, + 0.059131402522325516, + 0.7431830987334251, + 0.0697569027543068, + 0.05781020596623421, + 0.24988600984215736, + 0.773699089884758, + 0.6762803494930267, + 0.20434130355715752, + 0.3012704402208328, + 0.0383303239941597, + 0.10818466357886791, + 0.2975359261035919, + 0.1912642139941454, + 1.3776460010558367, + 0.12401067093014717, + 0.2111744061112404, + 0.5433422774076462, + 0.0, + 0.3254045136272907, + 0.24893462657928467, + 0.1963905319571495, + 0.6609197035431862, + 0.0429026335477829, + 0.0 + ], + "unique_experts": 54, + "load_cv": 0.9916507077737953, + "normalized_load_entropy": 0.8882071129579812, + "max_load_share": 0.07539682539682539 + }, + "full_input": { + "tokens": 67, + "top_k": 6, + "decisions": 402, + "ordered_route_sha256": "93a1a4a5b8122cd70c6f025c3e1278ecfecfc1cc8cef50f14189c67383be93ef", + "route_weight_sha256": "11a9b545b9b46c2b0fd82e035b1a1321635447c401a9cb216f9a16e87fdb7533", + "loads": [ + 14, + 8, + 1, + 1, + 3, + 3, + 1, + 5, + 5, + 2, + 16, + 9, + 2, + 8, + 0, + 2, + 3, + 6, + 0, + 20, + 0, + 2, + 4, + 9, + 4, + 9, + 13, + 2, + 5, + 0, + 0, + 9, + 2, + 4, + 19, + 13, + 0, + 2, + 15, + 0, + 1, + 21, + 2, + 1, + 7, + 21, + 21, + 3, + 7, + 1, + 7, + 5, + 5, + 22, + 2, + 10, + 13, + 0, + 7, + 10, + 3, + 8, + 3, + 1 + ], + "weighted_loads": [ + 0.9046716056764126, + 0.5321305952966213, + 0.08435440063476562, + 0.043973956257104874, + 0.2881969064474106, + 0.1604110710322857, + 0.03161059692502022, + 0.22412384673953056, + 0.2818150259554386, + 0.08148236945271492, + 1.5443783812224865, + 0.7012595012784004, + 0.04656588099896908, + 0.2831228291615844, + 0.0, + 0.08663399145007133, + 0.13770448043942451, + 0.2146190106868744, + 0.0, + 1.8557059057056904, + 0.0, + 0.12115025892853737, + 0.6503219082951546, + 0.5825254544615746, + 0.15695293247699738, + 0.4182840697467327, + 0.8736659921705723, + 0.04997802525758743, + 0.27826782315969467, + 0.0, + 0.0, + 0.40008305571973324, + 0.05069098435342312, + 0.20635101944208145, + 1.1475427895784378, + 0.8129740320146084, + 0.0, + 0.11971244215965271, + 0.7658522445708513, + 0.0, + 0.059131402522325516, + 1.6599515117704868, + 0.0697569027543068, + 0.05781020596623421, + 0.5106243314221501, + 1.3657847121357918, + 1.4440591037273407, + 0.20434130355715752, + 0.4940130300819874, + 0.0383303239941597, + 0.3129051495343447, + 0.3314024619758129, + 0.1912642139941454, + 1.495868293568492, + 0.12401067093014717, + 0.4714108146727085, + 0.785530935972929, + 0.0, + 0.4769156835973263, + 0.49939950183033943, + 0.1963905319571495, + 0.6609197035431862, + 0.09865428507328033, + 0.036286111921072006 + ], + "unique_experts": 56, + "load_cv": 0.9840061545414446, + "normalized_load_entropy": 0.8873455733617162, + "max_load_share": 0.05472636815920398 + } + }, + "s1_x": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "65a78456b6466a2091b2b9fd2b139a4a083341ecb5a10f06b3b8f1363d3a6194", + "route_weight_sha256": "7eaa01392dfd06011458127a8868d15c9d25fb7df371b8a0397487be80eb8211", + "loads": [ + 5, + 5, + 1, + 2, + 0, + 3, + 0, + 7, + 3, + 2, + 4, + 9, + 1, + 3, + 0, + 1, + 1, + 5, + 0, + 10, + 0, + 2, + 1, + 5, + 2, + 6, + 12, + 1, + 5, + 0, + 0, + 3, + 2, + 4, + 8, + 7, + 0, + 2, + 10, + 0, + 1, + 11, + 2, + 1, + 5, + 13, + 10, + 3, + 4, + 1, + 3, + 4, + 5, + 19, + 2, + 5, + 9, + 0, + 5, + 4, + 3, + 8, + 2, + 0 + ], + "weighted_loads": [ + 0.2744619119912386, + 0.3081253245472908, + 0.08203928172588348, + 0.07241009175777435, + 0.0, + 0.14666731655597687, + 0.0, + 0.30526717007160187, + 0.19676882773637772, + 0.0756971463561058, + 0.22378645837306976, + 0.676870658993721, + 0.03090236708521843, + 0.11218558251857758, + 0.0, + 0.05336592718958855, + 0.062220875173807144, + 0.17628381960093975, + 0.0, + 0.784039780497551, + 0.0, + 0.12046618387103081, + 0.04417792335152626, + 0.27515679225325584, + 0.0664438959211111, + 0.279017549008131, + 0.83581318333745, + 0.03762606158852577, + 0.2818358726799488, + 0.0, + 0.0, + 0.15898284688591957, + 0.05107258819043636, + 0.2129560299217701, + 0.5148363783955574, + 0.3911989741027355, + 0.0, + 0.11674967780709267, + 0.5840650275349617, + 0.0, + 0.05501970276236534, + 0.6925992779433727, + 0.06879755854606628, + 0.05635346472263336, + 0.2830526474863291, + 0.7859680727124214, + 0.6393441036343575, + 0.2061087228357792, + 0.3152070790529251, + 0.038853421807289124, + 0.10056445188820362, + 0.29350753873586655, + 0.1931171752512455, + 1.4455953128635883, + 0.12268038466572762, + 0.21115142852067947, + 0.584228653460741, + 0.0, + 0.3313850574195385, + 0.25266047567129135, + 0.19549036026000977, + 0.6157173253595829, + 0.0838824212551117, + 0.0 + ], + "unique_experts": 53, + "load_cv": 0.9731854638710686, + "normalized_load_entropy": 0.8896062766178976, + "max_load_share": 0.07539682539682539 + }, + "full_input": { + "tokens": 83, + "top_k": 6, + "decisions": 498, + "ordered_route_sha256": "73d2b60ddd6992a48375e80dbdc6c6d09554bb950cd2d38577de983001abf834", + "route_weight_sha256": "dce6e5385090012676653d8b2320e1779af7b144334d2e7c285c628ddf702722", + "loads": [ + 18, + 10, + 1, + 2, + 3, + 3, + 0, + 7, + 11, + 4, + 16, + 11, + 3, + 5, + 1, + 1, + 3, + 7, + 0, + 21, + 0, + 5, + 5, + 16, + 7, + 16, + 17, + 2, + 11, + 0, + 3, + 7, + 2, + 7, + 15, + 19, + 0, + 5, + 15, + 2, + 7, + 25, + 4, + 1, + 8, + 24, + 29, + 3, + 11, + 6, + 5, + 5, + 5, + 21, + 3, + 10, + 14, + 0, + 10, + 9, + 3, + 9, + 4, + 1 + ], + "weighted_loads": [ + 1.1578573528677225, + 0.6081586964428425, + 0.08203928172588348, + 0.07241009175777435, + 0.3167872540652752, + 0.14666731655597687, + 0.0, + 0.30526717007160187, + 0.6561840027570724, + 0.16734332963824272, + 1.4713605344295502, + 0.7737509496510029, + 0.07751923613250256, + 0.16410814318805933, + 0.03954945504665375, + 0.05336592718958855, + 0.14867888763546944, + 0.27850172482430935, + 0.0, + 1.8961318992078304, + 0.0, + 0.24664265289902687, + 0.6878530718386173, + 1.1268008574843407, + 0.2595601174980402, + 0.7910339515656233, + 1.1368123851716518, + 0.05063462629914284, + 0.7092561088502407, + 0.0, + 0.17905963957309723, + 0.3038738649338484, + 0.05107258819043636, + 0.43483462557196617, + 0.8798942714929581, + 1.1541299894452095, + 0.0, + 0.25759001448750496, + 0.8414796181023121, + 0.1165655180811882, + 0.45601726323366165, + 2.0159882716834545, + 0.1615958958864212, + 0.05635346472263336, + 0.4128115167841315, + 1.6988864094018936, + 2.185959354043007, + 0.2061087228357792, + 0.7311593592166901, + 0.36924923211336136, + 0.21479963697493076, + 0.32644591853022575, + 0.1931171752512455, + 1.5461467541754246, + 0.16390463337302208, + 0.4512424860149622, + 0.8175290748476982, + 0.0, + 0.6239096075296402, + 0.4862179048359394, + 0.19549036026000977, + 0.653700090944767, + 0.24380257353186607, + 0.03599189594388008 + ], + "unique_experts": 58, + "load_cv": 0.8934005516749658, + "normalized_load_entropy": 0.9053427375406219, + "max_load_share": 0.05823293172690763 + } + }, + "s0_period": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "1321b1c65f1c957f5c1433a7d93c06d753a4da272cf776d1757147a11d2ca1cc", + "route_weight_sha256": "d1a987a33367598c1e61706f0213204dc14d44311bffdc647367df2090034f96", + "loads": [ + 5, + 5, + 1, + 1, + 1, + 3, + 0, + 6, + 3, + 3, + 4, + 9, + 1, + 2, + 0, + 2, + 1, + 4, + 0, + 10, + 0, + 2, + 1, + 5, + 1, + 6, + 11, + 1, + 5, + 0, + 0, + 4, + 2, + 4, + 9, + 7, + 0, + 2, + 12, + 0, + 1, + 11, + 2, + 2, + 4, + 13, + 10, + 3, + 4, + 1, + 3, + 4, + 5, + 19, + 2, + 5, + 9, + 0, + 5, + 4, + 3, + 8, + 1, + 0 + ], + "weighted_loads": [ + 0.246701093390584, + 0.29972365871071815, + 0.08942172676324844, + 0.04348704591393471, + 0.038711145520210266, + 0.16179970651865005, + 0.0, + 0.26320819929242134, + 0.18743878230452538, + 0.11650658771395683, + 0.22406523674726486, + 0.704220574349165, + 0.030268477275967598, + 0.0714766550809145, + 0.0, + 0.08520779013633728, + 0.06081421673297882, + 0.1322280690073967, + 0.0, + 0.8115569800138474, + 0.0, + 0.12057631462812424, + 0.042101435363292694, + 0.30074045434594154, + 0.02935710921883583, + 0.2683671563863754, + 0.8045729696750641, + 0.03685729578137398, + 0.2835962623357773, + 0.0, + 0.0, + 0.2113526612520218, + 0.050153011456131935, + 0.2140745259821415, + 0.558404553681612, + 0.3829217627644539, + 0.0, + 0.11884957551956177, + 0.6297801453620195, + 0.0, + 0.05895940586924553, + 0.7346447631716728, + 0.06731400080025196, + 0.08857888355851173, + 0.24939527362585068, + 0.771217804402113, + 0.6760780550539494, + 0.20185941830277443, + 0.299862876534462, + 0.03839365020394325, + 0.10732096619904041, + 0.2980785183608532, + 0.19751658104360104, + 1.4103738199919462, + 0.12435990199446678, + 0.20594214275479317, + 0.5714054778218269, + 0.0, + 0.3207434006035328, + 0.2465020716190338, + 0.1966993771493435, + 0.6547799967229366, + 0.04534122720360756, + 0.0 + ], + "unique_experts": 54, + "load_cv": 0.9793792286287206, + "normalized_load_entropy": 0.8901036880147202, + "max_load_share": 0.07539682539682539 + }, + "full_input": { + "tokens": 67, + "top_k": 6, + "decisions": 402, + "ordered_route_sha256": "53b5ab5b5ec08926c6a79454653b81076effed8df6473755477f233d1b403fa6", + "route_weight_sha256": "b22440e10bb682eaef2ee40f8f3f25b4b7a1ce65c2aca0bb68c35cd4782dc2b5", + "loads": [ + 15, + 8, + 1, + 1, + 3, + 3, + 0, + 6, + 5, + 3, + 16, + 9, + 3, + 6, + 0, + 2, + 2, + 7, + 0, + 20, + 0, + 2, + 4, + 9, + 4, + 7, + 11, + 2, + 5, + 0, + 0, + 9, + 2, + 4, + 19, + 13, + 0, + 2, + 14, + 0, + 1, + 22, + 2, + 2, + 7, + 21, + 22, + 3, + 7, + 1, + 7, + 5, + 5, + 22, + 2, + 10, + 15, + 0, + 7, + 9, + 3, + 8, + 3, + 1 + ], + "weighted_loads": [ + 0.9099150281399488, + 0.5338333137333393, + 0.08942172676324844, + 0.04348704591393471, + 0.2796690762042999, + 0.16179970651865005, + 0.0, + 0.26320819929242134, + 0.2842673100531101, + 0.11650658771395683, + 1.4924376085400581, + 0.704220574349165, + 0.07683435827493668, + 0.2209146535024047, + 0.0, + 0.08520779013633728, + 0.10198967531323433, + 0.2668997459113598, + 0.0, + 1.8790526911616325, + 0.0, + 0.12057631462812424, + 0.6468526050448418, + 0.588542602956295, + 0.15657181665301323, + 0.3448289856314659, + 0.8045729696750641, + 0.04986586049199104, + 0.2835962623357773, + 0.0, + 0.0, + 0.39525713957846165, + 0.050153011456131935, + 0.2140745259821415, + 1.1105539165437222, + 0.794322095811367, + 0.0, + 0.11884957551956177, + 0.7204005885869265, + 0.0, + 0.05895940586924553, + 1.6899153664708138, + 0.06731400080025196, + 0.08857888355851173, + 0.5101335952058434, + 1.3780623711645603, + 1.5700871422886848, + 0.20185941830277443, + 0.4880979657173157, + 0.03839365020394325, + 0.30831952951848507, + 0.3319450542330742, + 0.19751658104360104, + 1.5209749694913626, + 0.12435990199446678, + 0.474374707788229, + 0.8520754314959049, + 0.0, + 0.47321101650595665, + 0.4592980779707432, + 0.1966993771493435, + 0.6547799967229366, + 0.101092878729105, + 0.036286111921072006 + ], + "unique_experts": 55, + "load_cv": 0.9932197556596416, + "normalized_load_entropy": 0.8861341125313724, + "max_load_share": 0.05472636815920398 + } + }, + "s1_period": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "dd291083403cad517aae7144b09353e40cebd5cc4c7dfd4020708f81bc790c1d", + "route_weight_sha256": "a536ed263f4203f8c13029e71d6b20e4e06c704c0027add4d9c0766cdce881c5", + "loads": [ + 5, + 4, + 1, + 1, + 0, + 3, + 1, + 7, + 3, + 2, + 4, + 9, + 1, + 4, + 0, + 1, + 1, + 6, + 0, + 10, + 0, + 2, + 1, + 5, + 2, + 6, + 12, + 1, + 5, + 0, + 0, + 3, + 2, + 4, + 8, + 6, + 0, + 2, + 11, + 0, + 1, + 12, + 1, + 1, + 4, + 12, + 10, + 3, + 4, + 1, + 3, + 4, + 5, + 19, + 2, + 7, + 9, + 0, + 4, + 4, + 3, + 8, + 2, + 0 + ], + "weighted_loads": [ + 0.26408191211521626, + 0.2647606246173382, + 0.08127378672361374, + 0.03941275551915169, + 0.0, + 0.14550509676337242, + 0.03319326788187027, + 0.3117745630443096, + 0.19630645588040352, + 0.07682931795716286, + 0.22321435809135437, + 0.6812282279133797, + 0.031622495502233505, + 0.14080719649791718, + 0.0, + 0.053890157490968704, + 0.06405025720596313, + 0.2230902872979641, + 0.0, + 0.8005737066268921, + 0.0, + 0.1206122450530529, + 0.043181680142879486, + 0.2795008756220341, + 0.0647235494107008, + 0.271277517080307, + 0.8418486043810844, + 0.04214368015527725, + 0.28023163601756096, + 0.0, + 0.0, + 0.15612243860960007, + 0.05098734423518181, + 0.21440107747912407, + 0.5304651521146297, + 0.32928598672151566, + 0.0, + 0.11754107102751732, + 0.6241526268422604, + 0.0, + 0.053735677152872086, + 0.7033995296806097, + 0.036408647894859314, + 0.054172582924366, + 0.2519240975379944, + 0.7428089492022991, + 0.645647831261158, + 0.20457609742879868, + 0.30938220769166946, + 0.039052266627550125, + 0.10127600841224194, + 0.3007510118186474, + 0.19290557503700256, + 1.4602705594152212, + 0.12437520921230316, + 0.2719186618924141, + 0.5876731313765049, + 0.0, + 0.29291582852602005, + 0.25267506390810013, + 0.19491515681147575, + 0.6131092123687267, + 0.08452767506241798, + 0.0 + ], + "unique_experts": 54, + "load_cv": 0.9814351306102038, + "normalized_load_entropy": 0.8889908249863459, + "max_load_share": 0.07539682539682539 + }, + "full_input": { + "tokens": 83, + "top_k": 6, + "decisions": 498, + "ordered_route_sha256": "1cbc1539b7056ff40db92679aadd5b8632aca4db43315cacf72457cb350c934b", + "route_weight_sha256": "b7dd193fd08b8db5da5002297b21e8f42339fbb72947463c31168fc6f3b5f67d", + "loads": [ + 17, + 9, + 1, + 1, + 2, + 3, + 1, + 7, + 10, + 4, + 16, + 11, + 3, + 7, + 1, + 1, + 2, + 9, + 0, + 20, + 0, + 5, + 5, + 16, + 7, + 16, + 16, + 2, + 11, + 0, + 3, + 7, + 2, + 7, + 14, + 19, + 0, + 5, + 16, + 1, + 7, + 28, + 3, + 1, + 7, + 23, + 31, + 3, + 11, + 6, + 5, + 5, + 5, + 22, + 3, + 12, + 15, + 0, + 9, + 8, + 3, + 9, + 4, + 1 + ], + "weighted_loads": [ + 1.0466474164277315, + 0.5551193095743656, + 0.08127378672361374, + 0.03941275551915169, + 0.26699863374233246, + 0.14550509676337242, + 0.03319326788187027, + 0.3117745630443096, + 0.6140693873167038, + 0.16847550123929977, + 1.3819394335150719, + 0.7781085185706615, + 0.07823936454951763, + 0.2271280074492097, + 0.03954945504665375, + 0.053890157490968704, + 0.10948818922042847, + 0.37141813337802887, + 0.0, + 1.906282652169466, + 0.0, + 0.24678871408104897, + 0.6856205314397812, + 1.1330118924379349, + 0.2578397709876299, + 0.782414024695754, + 1.0958803705871105, + 0.05515224486589432, + 0.7076518721878529, + 0.0, + 0.1754598431289196, + 0.3010134566575289, + 0.05098734423518181, + 0.43627967312932014, + 0.8354434780776501, + 1.12823286652565, + 0.0, + 0.2583814077079296, + 0.8966855071485043, + 0.0667569637298584, + 0.4547332376241684, + 2.1700167637318373, + 0.12920698523521423, + 0.054172582924366, + 0.38168296683579683, + 1.6505138128995895, + 2.426508091390133, + 0.20457609742879868, + 0.7226085364818573, + 0.36944807693362236, + 0.21144243516027927, + 0.3336893916130066, + 0.19290557503700256, + 1.610979462042451, + 0.16559945791959763, + 0.5139174740761518, + 0.8643423318862915, + 0.0, + 0.5844702832400799, + 0.4324708692729473, + 0.19491515681147575, + 0.6510919779539108, + 0.24444782733917236, + 0.03599189594388008 + ], + "unique_experts": 59, + "load_cv": 0.9195910236862588, + "normalized_load_entropy": 0.9018318411520097, + "max_load_share": 0.06224899598393574 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 42, + "ordered_topk_exact_tokens": 25, + "set_exact_tokens": 31, + "mean_set_jaccard": 0.925170068027211, + "mean_token_weighted_tv": 0.014947487507015467, + "aggregate_load_tv": 0.03571428571428571 + }, + "system_bos": { + "tokens": 42, + "ordered_topk_exact_tokens": 26, + "set_exact_tokens": 31, + "mean_set_jaccard": 0.9200680272108844, + "mean_token_weighted_tv": 0.017678808598291306, + "aggregate_load_tv": 0.03571428571428571 + }, + "system_x": { + "tokens": 42, + "ordered_topk_exact_tokens": 19, + "set_exact_tokens": 27, + "mean_set_jaccard": 0.8928571428571429, + "mean_token_weighted_tv": 0.024482931320865948, + "aggregate_load_tv": 0.03571428571428571 + }, + "system_period": { + "tokens": 42, + "ordered_topk_exact_tokens": 21, + "set_exact_tokens": 26, + "mean_set_jaccard": 0.8911564625850341, + "mean_token_weighted_tv": 0.024328648689247313, + "aggregate_load_tv": 0.047619047619047616 + }, + "bos_at_s0": { + "tokens": 42, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 21, + "mean_set_jaccard": 0.8571428571428571, + "mean_token_weighted_tv": 0.029110254919422523, + "aggregate_load_tv": 0.06746031746031746 + }, + "bos_at_s1": { + "tokens": 42, + "ordered_topk_exact_tokens": 18, + "set_exact_tokens": 26, + "mean_set_jaccard": 0.8860544217687075, + "mean_token_weighted_tv": 0.026481320150196552, + "aggregate_load_tv": 0.05555555555555555 + }, + "x_at_s0": { + "tokens": 42, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.8384353741496599, + "mean_token_weighted_tv": 0.032928448680433486, + "aggregate_load_tv": 0.07539682539682539 + }, + "x_at_s1": { + "tokens": 42, + "ordered_topk_exact_tokens": 18, + "set_exact_tokens": 25, + "mean_set_jaccard": 0.8639455782312925, + "mean_token_weighted_tv": 0.030417192372537795, + "aggregate_load_tv": 0.051587301587301584 + }, + "period_at_s0": { + "tokens": 42, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.8248299319727892, + "mean_token_weighted_tv": 0.03417585187015079, + "aggregate_load_tv": 0.07539682539682539 + }, + "period_at_s1": { + "tokens": 42, + "ordered_topk_exact_tokens": 17, + "set_exact_tokens": 25, + "mean_set_jaccard": 0.8690476190476191, + "mean_token_weighted_tv": 0.029175195332971356, + "aggregate_load_tv": 0.04365079365079365 + } + } + }, + "layer_10": { + "layer": 10, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "346549175dbaa040c8f77631b15a15c4b9f521306feefa5723ef729f18d3d0b0", + "route_weight_sha256": "ae6821bcb6af18930785c70ac751572b80309b2de8027299bf0a5b381ce8f28e", + "loads": [ + 0, + 3, + 1, + 3, + 4, + 4, + 10, + 1, + 0, + 2, + 7, + 3, + 4, + 2, + 2, + 0, + 5, + 6, + 4, + 1, + 4, + 10, + 9, + 1, + 0, + 6, + 2, + 3, + 0, + 4, + 9, + 2, + 3, + 12, + 2, + 3, + 0, + 9, + 1, + 1, + 0, + 10, + 1, + 2, + 20, + 9, + 4, + 1, + 0, + 1, + 15, + 3, + 2, + 4, + 2, + 6, + 2, + 3, + 2, + 10, + 7, + 1, + 0, + 4 + ], + "weighted_loads": [ + 0.0, + 0.10703159496188164, + 0.05653628706932068, + 0.22788283601403236, + 0.20269860699772835, + 0.1364360023289919, + 0.4625379201024771, + 0.03507503867149353, + 0.0, + 0.10389018803834915, + 0.3961487580090761, + 0.2334459200501442, + 0.3838813863694668, + 0.10593089833855629, + 0.07037478312849998, + 0.0, + 0.344035018235445, + 0.30672134831547737, + 0.14848993346095085, + 0.05476361885666847, + 0.16122515127062798, + 0.7673372719436884, + 0.5462854765355587, + 0.049843017011880875, + 0.0, + 0.4270540699362755, + 0.15869179368019104, + 0.18655657768249512, + 0.0, + 0.18817881867289543, + 0.4121086969971657, + 0.10028790310025215, + 0.1614978387951851, + 0.5575468055903912, + 0.1798136681318283, + 0.22876447811722755, + 0.0, + 0.7090136855840683, + 0.06554204970598221, + 0.04435039684176445, + 0.0, + 0.6650244370102882, + 0.03585147112607956, + 0.07551772892475128, + 1.4356359876692295, + 0.5813687704503536, + 0.20016879588365555, + 0.03898852318525314, + 0.0, + 0.03923124819993973, + 1.0212254337966442, + 0.17156971618533134, + 0.10875345021486282, + 0.19312682375311852, + 0.11890185624361038, + 0.371709905564785, + 0.06269111298024654, + 0.3654331639409065, + 0.10163281857967377, + 0.49027328938245773, + 0.4078902006149292, + 0.13769640028476715, + 0.0, + 0.19100762531161308 + ], + "unique_experts": 55, + "load_cv": 1.0047756963872039, + "normalized_load_entropy": 0.8900381029236115, + "max_load_share": 0.07936507936507936 + }, + "full_input": { + "tokens": 67, + "top_k": 6, + "decisions": 402, + "ordered_route_sha256": "f90450c61d69e490d6e17af1db6ee0a62784bc924c97839af661c2495c48d8c2", + "route_weight_sha256": "fd385f25a823661fcc586ade4a451e6861e21cf26462bbb48b7874b0befc1447", + "loads": [ + 0, + 3, + 3, + 3, + 4, + 4, + 10, + 5, + 0, + 4, + 9, + 5, + 5, + 5, + 4, + 0, + 5, + 8, + 11, + 3, + 7, + 12, + 10, + 1, + 0, + 8, + 2, + 10, + 1, + 5, + 12, + 3, + 3, + 20, + 3, + 4, + 0, + 9, + 1, + 1, + 0, + 20, + 6, + 4, + 26, + 12, + 10, + 4, + 0, + 3, + 17, + 9, + 2, + 6, + 2, + 16, + 2, + 9, + 2, + 20, + 12, + 13, + 0, + 4 + ], + "weighted_loads": [ + 0.0, + 0.10703159496188164, + 0.0755688757635653, + 0.22788283601403236, + 0.20269860699772835, + 0.1364360023289919, + 0.4625379201024771, + 0.2113962024450302, + 0.0, + 0.12833688501268625, + 0.4925361815840006, + 0.33876074478030205, + 0.4166979044675827, + 1.521769940853119, + 0.26379217579960823, + 0.0, + 0.344035018235445, + 0.4465392269194126, + 0.5285869515500963, + 0.15832023322582245, + 0.27453526481986046, + 0.8518301416188478, + 0.5500097551848739, + 0.049843017011880875, + 0.0, + 0.49067455157637596, + 0.15869179368019104, + 0.8596514351665974, + 0.04658098891377449, + 0.23100491613149643, + 0.70084672793746, + 0.1140607763081789, + 0.1614978387951851, + 0.9265351369976997, + 0.20971055701375008, + 0.2657475508749485, + 0.0, + 0.7090136855840683, + 0.06554204970598221, + 0.04435039684176445, + 0.0, + 1.7310426831245422, + 0.1866195285692811, + 0.17403056472539902, + 1.9189643934369087, + 0.7269433848559856, + 0.4695275165140629, + 0.1735402513295412, + 0.0, + 0.13538027927279472, + 1.1159071400761604, + 0.4697300046682358, + 0.10875345021486282, + 0.3012324795126915, + 0.11890185624361038, + 0.987148329615593, + 0.06269111298024654, + 0.7105157189071178, + 0.10163281857967377, + 1.1182713136076927, + 0.7106095664203167, + 1.1769007481634617, + 0.0, + 0.19100762531161308 + ], + "unique_experts": 56, + "load_cv": 0.9138939210641169, + "normalized_load_entropy": 0.9026155588050995, + "max_load_share": 0.06467661691542288 + } + }, + "s1_eos": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "08ec3500ea1be49a9c7ee04e17d1ab1f22357304d4e8e19aa032186774486c20", + "route_weight_sha256": "6a782c0c4cae1b93032cfb9fb9b18ab48d7fa42d4eadf5cc2e6a6b0adb7ca6f5", + "loads": [ + 0, + 3, + 1, + 3, + 4, + 4, + 9, + 1, + 0, + 4, + 8, + 4, + 4, + 1, + 2, + 0, + 5, + 6, + 5, + 1, + 4, + 9, + 9, + 1, + 0, + 6, + 2, + 3, + 0, + 3, + 9, + 1, + 4, + 11, + 2, + 3, + 0, + 9, + 1, + 2, + 0, + 9, + 0, + 3, + 19, + 9, + 3, + 2, + 1, + 1, + 16, + 3, + 2, + 4, + 2, + 6, + 2, + 3, + 2, + 9, + 7, + 1, + 0, + 4 + ], + "weighted_loads": [ + 0.0, + 0.10326572880148888, + 0.05797478184103966, + 0.2231360748410225, + 0.20425835624337196, + 0.1364336758852005, + 0.43395967222750187, + 0.035194944590330124, + 0.0, + 0.18517392873764038, + 0.4258828107267618, + 0.27031780779361725, + 0.3895614631474018, + 0.044987309724092484, + 0.07131503149867058, + 0.0, + 0.3355361744761467, + 0.30669054575264454, + 0.1814725510776043, + 0.06136070936918259, + 0.15800697728991508, + 0.7414459548890591, + 0.5512760020792484, + 0.04906918480992317, + 0.0, + 0.4415234960615635, + 0.16320645809173584, + 0.19834693893790245, + 0.0, + 0.15266644954681396, + 0.417785182595253, + 0.07249295711517334, + 0.18292216770350933, + 0.5193372927606106, + 0.17678352817893028, + 0.22360142320394516, + 0.0, + 0.6698679737746716, + 0.06704887747764587, + 0.07196406275033951, + 0.0, + 0.6310360766947269, + 0.0, + 0.110385337844491, + 1.4294142313301563, + 0.5794392600655556, + 0.1704879067838192, + 0.07761679962277412, + 0.035939618945121765, + 0.037984833121299744, + 1.0523923560976982, + 0.1723734512925148, + 0.10623262077569962, + 0.1933005452156067, + 0.11707047745585442, + 0.3668580390512943, + 0.061520153656601906, + 0.3622586503624916, + 0.10285906866192818, + 0.4553521126508713, + 0.3988586403429508, + 0.13744717836380005, + 0.0, + 0.19134321808815002 + ], + "unique_experts": 55, + "load_cv": 0.9711120970122177, + "normalized_load_entropy": 0.8948951667473315, + "max_load_share": 0.07539682539682539 + }, + "full_input": { + "tokens": 83, + "top_k": 6, + "decisions": 498, + "ordered_route_sha256": "fd830f41cb433d37c919b911fc61a6b2e7e5459337bb0d3b6717e8594e64d6d4", + "route_weight_sha256": "9ba693219ff81c67020574e1af8e1f93b5f8d6b65cd3b7aea5b199e97de27ae3", + "loads": [ + 0, + 3, + 4, + 3, + 8, + 4, + 9, + 2, + 0, + 6, + 10, + 8, + 8, + 3, + 5, + 0, + 5, + 10, + 11, + 2, + 5, + 11, + 10, + 1, + 1, + 9, + 4, + 24, + 0, + 6, + 18, + 2, + 9, + 28, + 4, + 5, + 2, + 11, + 2, + 2, + 1, + 25, + 4, + 5, + 25, + 14, + 10, + 5, + 9, + 4, + 20, + 18, + 3, + 7, + 2, + 18, + 3, + 9, + 2, + 25, + 18, + 11, + 0, + 5 + ], + "weighted_loads": [ + 0.0, + 0.10326572880148888, + 0.11738308379426599, + 0.2231360748410225, + 0.4057484641671181, + 0.1364336758852005, + 0.43395967222750187, + 0.07312478125095367, + 0.0, + 0.21027656458318233, + 0.5044600013643503, + 0.5025452487170696, + 0.5920013301074505, + 1.4199166186153889, + 0.3281414844095707, + 0.0, + 0.3355361744761467, + 0.5401004981249571, + 0.5460583199746907, + 0.10186617448925972, + 0.19858165830373764, + 0.8280608505010605, + 0.5551804224960506, + 0.04906918480992317, + 0.04175034537911415, + 0.7613200303167105, + 0.23362107761204243, + 1.4897575713694096, + 0.0, + 0.28616636991500854, + 1.151980571448803, + 0.08626583032310009, + 0.6761668231338263, + 1.3560033235698938, + 0.3187727816402912, + 0.38802382722496986, + 0.08464804291725159, + 0.7568568736314774, + 0.10453920438885689, + 0.07196406275033951, + 0.04222068190574646, + 2.072276869788766, + 0.09776597935706377, + 0.17871597036719322, + 1.9025574959814548, + 0.8408561125397682, + 0.5404136702418327, + 0.20392115600407124, + 0.6836413666605949, + 0.21170183643698692, + 1.2864713184535503, + 1.031481046229601, + 0.17482101172208786, + 0.3420374244451523, + 0.11707047745585442, + 1.1742374785244465, + 0.13405939377844334, + 0.7183494158089161, + 0.10285906866192818, + 1.4782791621983051, + 1.1244683861732483, + 1.036395326256752, + 0.0, + 0.22765635326504707 + ], + "unique_experts": 59, + "load_cv": 0.9094324083548169, + "normalized_load_entropy": 0.9068670963239984, + "max_load_share": 0.05622489959839357 + } + }, + "s0_bos": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "8c358b819195b4fadb32a0cf0d7ce1f2637080be68b5973133c15d7868d6408b", + "route_weight_sha256": "95ef78271a5502417c7c8e83bff6d3621eb8e8a2cf5188719414bc69b37a96a9", + "loads": [ + 0, + 4, + 1, + 3, + 4, + 3, + 9, + 1, + 0, + 4, + 7, + 4, + 4, + 2, + 2, + 0, + 5, + 3, + 3, + 1, + 4, + 10, + 10, + 2, + 0, + 7, + 2, + 4, + 0, + 4, + 8, + 2, + 3, + 10, + 2, + 3, + 1, + 9, + 1, + 1, + 0, + 10, + 3, + 2, + 19, + 8, + 3, + 1, + 1, + 1, + 15, + 3, + 2, + 4, + 2, + 6, + 2, + 3, + 3, + 8, + 7, + 2, + 0, + 4 + ], + "weighted_loads": [ + 0.0, + 0.1413863878697157, + 0.05516516789793968, + 0.21589148417115211, + 0.21006549522280693, + 0.11052724532783031, + 0.430424340069294, + 0.03252722695469856, + 0.0, + 0.19934490323066711, + 0.39914662949740887, + 0.2658932954072952, + 0.365111593157053, + 0.09017216041684151, + 0.07098692283034325, + 0.0, + 0.34602391347289085, + 0.12226430885493755, + 0.10984587296843529, + 0.04661780595779419, + 0.1581105925142765, + 0.7659428007900715, + 0.5797999408096075, + 0.0783119760453701, + 0.0, + 0.45498480647802353, + 0.15457959473133087, + 0.2128043845295906, + 0.0, + 0.18333205953240395, + 0.3819742798805237, + 0.10068579576909542, + 0.15578901767730713, + 0.4751278832554817, + 0.17756754159927368, + 0.23826715350151062, + 0.04735899716615677, + 0.7452514059841633, + 0.06541237235069275, + 0.04192974418401718, + 0.0, + 0.7014055289328098, + 0.10070009529590607, + 0.07218678295612335, + 1.3671242631971836, + 0.5147559717297554, + 0.1736038364470005, + 0.03743137791752815, + 0.03214244544506073, + 0.0370345264673233, + 1.0088637359440327, + 0.16446109488606453, + 0.10520762205123901, + 0.1955302208662033, + 0.12360058724880219, + 0.4055406376719475, + 0.06504932418465614, + 0.36485154926776886, + 0.1515095718204975, + 0.41947048902511597, + 0.4105035178363323, + 0.17624062299728394, + 0.0, + 0.19855381548404694 + ], + "unique_experts": 57, + "load_cv": 0.9351617982003452, + "normalized_load_entropy": 0.9051899165642826, + "max_load_share": 0.07539682539682539 + }, + "full_input": { + "tokens": 67, + "top_k": 6, + "decisions": 402, + "ordered_route_sha256": "00e8a5e359d5280c24fc53fba989074b693c8108ce05696d7c60bad3ec09ede8", + "route_weight_sha256": "92cea0e4d1b9376cb2bb7d9a53a14460be716812f5946d306018857d90fd2087", + "loads": [ + 0, + 5, + 2, + 3, + 4, + 3, + 9, + 5, + 0, + 5, + 10, + 6, + 5, + 5, + 5, + 0, + 5, + 5, + 9, + 2, + 8, + 12, + 10, + 2, + 0, + 9, + 2, + 12, + 1, + 5, + 11, + 3, + 3, + 18, + 3, + 4, + 1, + 9, + 1, + 1, + 0, + 20, + 7, + 4, + 25, + 11, + 9, + 4, + 1, + 4, + 17, + 8, + 2, + 6, + 2, + 16, + 2, + 9, + 3, + 19, + 12, + 14, + 0, + 4 + ], + "weighted_loads": [ + 0.0, + 0.178171182051301, + 0.0693229278549552, + 0.21589148417115211, + 0.21006549522280693, + 0.11052724532783031, + 0.430424340069294, + 0.20884839072823524, + 0.0, + 0.21557721495628357, + 0.5357640143483877, + 0.36836133152246475, + 0.3979281112551689, + 0.6366194486618042, + 0.31691649928689003, + 0.0, + 0.34602391347289085, + 0.2552262004464865, + 0.5090368911623955, + 0.11012781411409378, + 0.34350530430674553, + 0.8504356704652309, + 0.5797999408096075, + 0.0783119760453701, + 0.0, + 0.518605288118124, + 0.15457959473133087, + 1.0082268677651882, + 0.04658098891377449, + 0.22615815699100494, + 0.6762018278241158, + 0.11445866897702217, + 0.15578901767730713, + 0.8573311567306519, + 0.20746443048119545, + 0.27525022625923157, + 0.04735899716615677, + 0.7452514059841633, + 0.06541237235069275, + 0.04192974418401718, + 0.0, + 1.886047601699829, + 0.2558002509176731, + 0.1706996187567711, + 1.8762125819921494, + 0.6603305861353874, + 0.44296255707740784, + 0.17074711807072163, + 0.03214244544506073, + 0.21474546939134598, + 1.103545442223549, + 0.4008720628917217, + 0.10520762205123901, + 0.3134327828884125, + 0.12360058724880219, + 1.0344564281404018, + 0.06504932418465614, + 0.7099341042339802, + 0.1515095718204975, + 1.0795162729918957, + 0.7106284946203232, + 1.2154449708759785, + 0.0, + 0.19855381548404694 + ], + "unique_experts": 58, + "load_cv": 0.8771893478330003, + "normalized_load_entropy": 0.9105144783842366, + "max_load_share": 0.06218905472636816 + } + }, + "s1_bos": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "52355e77d5eb1e08e6137bc62c8ab585870f0a7a26f36b52cc0f496e3017ef0f", + "route_weight_sha256": "22740b57e1319f985d7c97b45a8bc741732b5dc48393b38dc710ef173457667b", + "loads": [ + 0, + 4, + 1, + 3, + 4, + 2, + 9, + 1, + 1, + 5, + 7, + 4, + 4, + 2, + 2, + 0, + 5, + 5, + 3, + 1, + 2, + 9, + 9, + 1, + 0, + 7, + 3, + 4, + 0, + 2, + 8, + 3, + 3, + 11, + 2, + 3, + 1, + 9, + 1, + 1, + 0, + 10, + 2, + 2, + 20, + 9, + 3, + 1, + 1, + 1, + 15, + 3, + 2, + 4, + 2, + 6, + 2, + 3, + 3, + 9, + 7, + 1, + 0, + 4 + ], + "weighted_loads": [ + 0.0, + 0.1307595893740654, + 0.04924244061112404, + 0.22547314688563347, + 0.2015690580010414, + 0.08135311305522919, + 0.44000438787043095, + 0.03220360353589058, + 0.029812650755047798, + 0.2411641851067543, + 0.40145470201969147, + 0.2671893462538719, + 0.379094660282135, + 0.07495371624827385, + 0.07187556102871895, + 0.0, + 0.3497627004981041, + 0.21002274937927723, + 0.10731617733836174, + 0.04905473813414574, + 0.09008770063519478, + 0.7282922230660915, + 0.5440395586192608, + 0.04947266727685928, + 0.0, + 0.46924630366265774, + 0.1894807666540146, + 0.19983354210853577, + 0.0, + 0.10259496048092842, + 0.39534156024456024, + 0.125355402007699, + 0.1605992130935192, + 0.510666586458683, + 0.17960315942764282, + 0.2328682728111744, + 0.040927138179540634, + 0.7167680487036705, + 0.06582894176244736, + 0.03730446472764015, + 0.0, + 0.6769645139575005, + 0.07628346234560013, + 0.0679691918194294, + 1.4545797109603882, + 0.5609935261309147, + 0.174585722386837, + 0.031928759068250656, + 0.03247859328985214, + 0.03682592883706093, + 1.0338553078472614, + 0.16886413097381592, + 0.10356495529413223, + 0.195235688239336, + 0.12197940051555634, + 0.39579764008522034, + 0.061924733221530914, + 0.36202844977378845, + 0.14718907326459885, + 0.4625249169766903, + 0.4033293351531029, + 0.13964368402957916, + 0.0, + 0.2017672248184681 + ], + "unique_experts": 58, + "load_cv": 0.9627739799441746, + "normalized_load_entropy": 0.9020777885223898, + "max_load_share": 0.07936507936507936 + }, + "full_input": { + "tokens": 83, + "top_k": 6, + "decisions": 498, + "ordered_route_sha256": "05813331a604a5c3522d84226b3a4602c4f635ed8b9015fd27c9cdc7f234004a", + "route_weight_sha256": "0155353ccaed1b273c7645145be133ad279fe38ff77587a16386370a1a1371ec", + "loads": [ + 0, + 4, + 3, + 3, + 8, + 2, + 9, + 2, + 1, + 6, + 10, + 8, + 8, + 4, + 6, + 0, + 5, + 8, + 8, + 2, + 4, + 11, + 9, + 1, + 1, + 10, + 5, + 26, + 0, + 5, + 17, + 4, + 8, + 29, + 4, + 5, + 3, + 11, + 2, + 1, + 1, + 26, + 4, + 4, + 26, + 14, + 10, + 4, + 9, + 5, + 18, + 17, + 3, + 8, + 2, + 19, + 3, + 9, + 3, + 26, + 18, + 11, + 0, + 5 + ], + "weighted_loads": [ + 0.0, + 0.1307595893740654, + 0.10366906877607107, + 0.22547314688563347, + 0.4030591659247875, + 0.08135311305522919, + 0.44000438787043095, + 0.07013344019651413, + 0.029812650755047798, + 0.25739649683237076, + 0.5260763578116894, + 0.5015966258943081, + 0.5815345272421837, + 0.5838352255523205, + 0.39665206894278526, + 0.0, + 0.3497627004981041, + 0.3876704964786768, + 0.5058237798511982, + 0.09588895738124847, + 0.18276242166757584, + 0.814907118678093, + 0.5440395586192608, + 0.04947266727685928, + 0.04175034537911415, + 0.7890428379178047, + 0.2598953861743212, + 1.573543306440115, + 0.0, + 0.236094880849123, + 1.127476081252098, + 0.13912827521562576, + 0.6538438685238361, + 1.38378188572824, + 0.32159241288900375, + 0.3972906768321991, + 0.12557518109679222, + 0.8037569485604763, + 0.10331926867365837, + 0.03730446472764015, + 0.04222068190574646, + 2.3336747381836176, + 0.12209833972156048, + 0.13629982434213161, + 1.9758307076990604, + 0.8224103786051273, + 0.5445114858448505, + 0.15731180645525455, + 0.6801803410053253, + 0.2858727388083935, + 1.2111719511449337, + 0.9597387909889221, + 0.17215334624052048, + 0.40048154816031456, + 0.12197940051555634, + 1.2893531918525696, + 0.13446397334337234, + 0.7181192152202129, + 0.14718907326459885, + 1.5442981608211994, + 1.1244883202016354, + 1.0385918319225311, + 0.0, + 0.23808035999536514 + ], + "unique_experts": 60, + "load_cv": 0.9251865028192703, + "normalized_load_entropy": 0.9069966700548966, + "max_load_share": 0.05823293172690763 + } + }, + "s0_x": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "d7fa4c6336e49871964b4da3cc750e33ad2c73a8558c403bd351577b949f7886", + "route_weight_sha256": "9c93f496f38d7935b7f2a289447f47f8e9c2981c0f31097b0bc696b3e5eac809", + "loads": [ + 0, + 5, + 1, + 3, + 4, + 2, + 9, + 1, + 0, + 4, + 7, + 3, + 4, + 2, + 1, + 0, + 5, + 5, + 4, + 1, + 4, + 10, + 10, + 1, + 0, + 6, + 3, + 3, + 0, + 3, + 8, + 2, + 2, + 10, + 2, + 3, + 1, + 9, + 1, + 1, + 0, + 11, + 2, + 1, + 19, + 8, + 3, + 1, + 1, + 1, + 15, + 4, + 2, + 5, + 2, + 6, + 2, + 3, + 4, + 10, + 7, + 1, + 0, + 4 + ], + "weighted_loads": [ + 0.0, + 0.1667973417788744, + 0.05114886164665222, + 0.21976372599601746, + 0.22041014954447746, + 0.08061260357499123, + 0.4436630457639694, + 0.03234085440635681, + 0.0, + 0.1864005234092474, + 0.39829462580382824, + 0.22626028209924698, + 0.36421462520956993, + 0.07584385573863983, + 0.03420399874448776, + 0.0, + 0.3496788963675499, + 0.2722400277853012, + 0.1338985599577427, + 0.04586510732769966, + 0.15306436270475388, + 0.7647675164043903, + 0.5817617624998093, + 0.04821965843439102, + 0.0, + 0.40182026103138924, + 0.19156079180538654, + 0.12799952924251556, + 0.0, + 0.13776905834674835, + 0.40142350271344185, + 0.10167251341044903, + 0.1224764846265316, + 0.4702559597790241, + 0.18338646739721298, + 0.23485419899225235, + 0.044632118195295334, + 0.7545224763453007, + 0.06683729588985443, + 0.04282711446285248, + 0.0, + 0.6788231637328863, + 0.07602925971150398, + 0.033254534006118774, + 1.4567664191126823, + 0.5294379815459251, + 0.17390076816082, + 0.03802277147769928, + 0.03399224579334259, + 0.03545594587922096, + 1.0289634205400944, + 0.20921225100755692, + 0.10846797749400139, + 0.23550575971603394, + 0.12019703350961208, + 0.39728712290525436, + 0.05830772593617439, + 0.3657059371471405, + 0.1920480988919735, + 0.4374033063650131, + 0.41395852342247963, + 0.13936133682727814, + 0.0, + 0.20191766694188118 + ], + "unique_experts": 57, + "load_cv": 0.964865264471691, + "normalized_load_entropy": 0.8982611485274083, + "max_load_share": 0.07539682539682539 + }, + "full_input": { + "tokens": 67, + "top_k": 6, + "decisions": 402, + "ordered_route_sha256": "fef3d494f7e7762809840763933a6dad90a099736dbfffb6e94cb89f0a7eb57b", + "route_weight_sha256": "f5efd4c51f419e39c5235b9342e2f8e99afc6742cb90a77149330ff3bdee4fd1", + "loads": [ + 1, + 6, + 2, + 3, + 4, + 2, + 9, + 6, + 0, + 5, + 9, + 5, + 5, + 4, + 3, + 0, + 5, + 8, + 9, + 3, + 7, + 12, + 10, + 1, + 0, + 8, + 3, + 8, + 1, + 4, + 11, + 3, + 2, + 19, + 3, + 4, + 1, + 9, + 1, + 1, + 0, + 20, + 5, + 3, + 26, + 12, + 10, + 5, + 1, + 3, + 18, + 9, + 2, + 7, + 2, + 15, + 2, + 10, + 4, + 21, + 12, + 14, + 0, + 4 + ], + "weighted_loads": [ + 0.033359840512275696, + 0.21516899950802326, + 0.06530662160366774, + 0.21976372599601746, + 0.22041014954447746, + 0.08061260357499123, + 0.4436630457639694, + 0.24803712218999863, + 0.0, + 0.20263283513486385, + 0.4946820493787527, + 0.33070438355207443, + 0.39703114330768585, + 0.5795603506267071, + 0.23477889597415924, + 0.0, + 0.3496788963675499, + 0.44464896619319916, + 0.4688171446323395, + 0.1457996852695942, + 0.26637447625398636, + 0.8492603860795498, + 0.5817617624998093, + 0.04821965843439102, + 0.0, + 0.4654407426714897, + 0.19156079180538654, + 0.674645084887743, + 0.04658098891377449, + 0.18059515580534935, + 0.6788689978420734, + 0.11544538661837578, + 0.1224764846265316, + 0.8839888647198677, + 0.21328335627913475, + 0.2718372717499733, + 0.044632118195295334, + 0.7545224763453007, + 0.06683729588985443, + 0.04282711446285248, + 0.0, + 1.5762198362499475, + 0.1810036189854145, + 0.1317673698067665, + 1.9840455017983913, + 0.7438897714018822, + 0.493231151252985, + 0.2128515150398016, + 0.03399224579334259, + 0.13333315029740334, + 1.157427866011858, + 0.48630181699991226, + 0.10846797749400139, + 0.35349317267537117, + 0.12019703350961208, + 0.935913510620594, + 0.05830772593617439, + 0.7736148424446583, + 0.1920480988919735, + 1.1115112081170082, + 0.7090209238231182, + 1.2648782692849636, + 0.0, + 0.20191766694188118 + ], + "unique_experts": 59, + "load_cv": 0.904747946836996, + "normalized_load_entropy": 0.9078450212512231, + "max_load_share": 0.06467661691542288 + } + }, + "s1_x": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "644be7ed3575780b1abc4dec7c7843650ad741dea20e751cdec08bab52470a57", + "route_weight_sha256": "27765730ea7246b4d5e18e83b48b5345eb1c06405b0d5e942464b6ecaf3afc6c", + "loads": [ + 0, + 4, + 1, + 3, + 4, + 2, + 10, + 0, + 0, + 5, + 7, + 4, + 4, + 2, + 1, + 0, + 5, + 7, + 5, + 1, + 2, + 10, + 8, + 1, + 0, + 7, + 3, + 2, + 0, + 3, + 9, + 2, + 3, + 11, + 2, + 3, + 2, + 9, + 1, + 1, + 0, + 10, + 0, + 1, + 20, + 9, + 3, + 1, + 0, + 1, + 15, + 4, + 2, + 4, + 2, + 6, + 1, + 3, + 3, + 9, + 9, + 1, + 0, + 4 + ], + "weighted_loads": [ + 0.0, + 0.131869500502944, + 0.054934702813625336, + 0.222301933914423, + 0.205773264169693, + 0.08015253022313118, + 0.49706026911735535, + 0.0, + 0.0, + 0.24443824216723442, + 0.40297074615955353, + 0.27526751160621643, + 0.3850739561021328, + 0.06813093274831772, + 0.034538812935352325, + 0.0, + 0.35576796159148216, + 0.3805563524365425, + 0.1693222876638174, + 0.041015367954969406, + 0.08225705474615097, + 0.7529944591224194, + 0.5137245692312717, + 0.04898525029420853, + 0.0, + 0.4578962493687868, + 0.19149525091052055, + 0.08427118882536888, + 0.0, + 0.1597001850605011, + 0.4597475789487362, + 0.0987279862165451, + 0.1596437692642212, + 0.4940365105867386, + 0.17875167727470398, + 0.23482490703463554, + 0.07316207140684128, + 0.6961259245872498, + 0.06525220721960068, + 0.03476107493042946, + 0.0, + 0.5626626703888178, + 0.0, + 0.03279419243335724, + 1.5552485175430775, + 0.5813396796584129, + 0.1785818263888359, + 0.031216125935316086, + 0.0, + 0.03532541170716286, + 1.0473557375371456, + 0.1960829384624958, + 0.10523087531328201, + 0.19921531528234482, + 0.12005053088068962, + 0.38209421187639236, + 0.032771866768598557, + 0.3620775118470192, + 0.15540451183915138, + 0.4341568425297737, + 0.5070416890084743, + 0.14107200503349304, + 0.0, + 0.2052026279270649 + ], + "unique_experts": 54, + "load_cv": 1.0097783446710427, + "normalized_load_entropy": 0.8859405782840039, + "max_load_share": 0.07936507936507936 + }, + "full_input": { + "tokens": 83, + "top_k": 6, + "decisions": 498, + "ordered_route_sha256": "16f7afdb44cd62a68749d3d5493592551319286b5de6c212b53988263ad5b182", + "route_weight_sha256": "eb41b774bdad7e9e30428a64e83e60a3416994f0ebb75e90612d1704c73e47cc", + "loads": [ + 1, + 5, + 3, + 3, + 8, + 2, + 10, + 2, + 0, + 6, + 10, + 8, + 8, + 3, + 5, + 0, + 5, + 10, + 10, + 2, + 3, + 12, + 8, + 1, + 1, + 10, + 5, + 20, + 0, + 7, + 19, + 3, + 8, + 29, + 4, + 5, + 4, + 11, + 2, + 1, + 1, + 24, + 2, + 3, + 25, + 15, + 11, + 5, + 8, + 5, + 21, + 19, + 3, + 8, + 2, + 16, + 2, + 10, + 3, + 25, + 19, + 12, + 0, + 5 + ], + "weighted_loads": [ + 0.05345359072089195, + 0.18115180172026157, + 0.10936133097857237, + 0.222301933914423, + 0.4072633720934391, + 0.08015253022313118, + 0.49706026911735535, + 0.08806060254573822, + 0.0, + 0.2606705538928509, + 0.5334105454385281, + 0.5001907199621201, + 0.5875138230621815, + 0.5371108278632164, + 0.3686062842607498, + 0.0, + 0.35576796159148216, + 0.5392767675220966, + 0.5295188967138529, + 0.0797417126595974, + 0.12283173575997353, + 0.8396093547344208, + 0.5137245692312717, + 0.04898525029420853, + 0.04175034537911415, + 0.7776927836239338, + 0.26190987043082714, + 1.203410804271698, + 0.0, + 0.3418913185596466, + 1.2484885454177856, + 0.11250085942447186, + 0.6528884246945381, + 1.384829981252551, + 0.3207409307360649, + 0.39924731105566025, + 0.15781011432409286, + 0.7831148244440556, + 0.10274253413081169, + 0.03476107493042946, + 0.04222068190574646, + 1.7579236291348934, + 0.04581487737596035, + 0.10112482495605946, + 1.9674001783132553, + 0.9061009734869003, + 0.6163321398198605, + 0.20375747419893742, + 0.6477017477154732, + 0.25177717581391335, + 1.3783401623368263, + 1.0772102549672127, + 0.17381926625967026, + 0.3951599523425102, + 0.12005053088068962, + 1.0690945982933044, + 0.10531110689043999, + 0.7683200016617775, + 0.15540451183915138, + 1.443386945873499, + 1.178667925298214, + 1.1254220381379128, + 0.0, + 0.24151576310396194 + ], + "unique_experts": 60, + "load_cv": 0.9082966599823652, + "normalized_load_entropy": 0.9069663267190579, + "max_load_share": 0.05823293172690763 + } + }, + "s0_period": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "71f81f5c32a65582e0121c1e1d3e5b6b568dca63972b1a0a13619cc6a9d1157f", + "route_weight_sha256": "ed02c3deba088c473b52205d730a658264956c6830b7dac34c458c8ec96e82fd", + "loads": [ + 0, + 3, + 1, + 3, + 4, + 3, + 9, + 1, + 1, + 3, + 7, + 3, + 4, + 0, + 2, + 0, + 5, + 6, + 3, + 1, + 4, + 10, + 11, + 1, + 0, + 6, + 2, + 2, + 0, + 4, + 10, + 2, + 3, + 11, + 2, + 3, + 1, + 9, + 1, + 1, + 0, + 11, + 2, + 2, + 19, + 9, + 3, + 1, + 1, + 1, + 15, + 3, + 2, + 4, + 2, + 6, + 1, + 3, + 3, + 10, + 7, + 1, + 0, + 4 + ], + "weighted_loads": [ + 0.0, + 0.1101204864680767, + 0.05056943744421005, + 0.22007909789681435, + 0.21648911014199257, + 0.09980923496186733, + 0.44390609487891197, + 0.032299190759658813, + 0.0295547004789114, + 0.1561216413974762, + 0.395654009655118, + 0.2283848077058792, + 0.3644631803035736, + 0.0, + 0.06915988400578499, + 0.0, + 0.3479459472000599, + 0.30759986117482185, + 0.10293858870863914, + 0.046971771866083145, + 0.1551743485033512, + 0.7705959528684616, + 0.6151580773293972, + 0.04515761137008667, + 0.0, + 0.40428896620869637, + 0.16154909133911133, + 0.08329318091273308, + 0.0, + 0.1812761053442955, + 0.5003231391310692, + 0.10119414329528809, + 0.16053999215364456, + 0.49225696362555027, + 0.18361759930849075, + 0.2330617941915989, + 0.04338027909398079, + 0.7496714368462563, + 0.06647989898920059, + 0.042386770248413086, + 0.0, + 0.7261770516633987, + 0.0732652135193348, + 0.06391780823469162, + 1.4466010443866253, + 0.5727325938642025, + 0.17439677193760872, + 0.03661542385816574, + 0.03261379525065422, + 0.03461381047964096, + 1.0317972972989082, + 0.1681462563574314, + 0.10825976356863976, + 0.1848202869296074, + 0.12048575840890408, + 0.4081718511879444, + 0.032837461680173874, + 0.3672971725463867, + 0.15759626775979996, + 0.44662403501570225, + 0.41002191975712776, + 0.1397734135389328, + 0.0, + 0.20114444196224213 + ], + "unique_experts": 57, + "load_cv": 0.9957075928610918, + "normalized_load_entropy": 0.8935535140936793, + "max_load_share": 0.07539682539682539 + }, + "full_input": { + "tokens": 67, + "top_k": 6, + "decisions": 402, + "ordered_route_sha256": "cd94d6ccdbe5bdd1fba6d3aa7841421478d1d821127518dba3ac629ddac6c819", + "route_weight_sha256": "e54aed98c1b4290126604bb6d0911b3b3504914afa5f4eb6f63db65bd4e8cddc", + "loads": [ + 1, + 4, + 2, + 3, + 4, + 3, + 9, + 5, + 1, + 4, + 10, + 5, + 6, + 2, + 4, + 0, + 5, + 8, + 8, + 2, + 7, + 12, + 11, + 1, + 0, + 8, + 2, + 8, + 1, + 5, + 14, + 3, + 3, + 19, + 3, + 4, + 1, + 9, + 1, + 1, + 0, + 21, + 5, + 4, + 25, + 13, + 9, + 4, + 1, + 4, + 18, + 9, + 2, + 6, + 2, + 15, + 1, + 10, + 3, + 21, + 13, + 13, + 0, + 4 + ], + "weighted_loads": [ + 0.03165864571928978, + 0.14662064239382744, + 0.06472719740122557, + 0.22007909789681435, + 0.21648911014199257, + 0.09980923496186733, + 0.44390609487891197, + 0.2086203545331955, + 0.0295547004789114, + 0.17235395312309265, + 0.5282830949872732, + 0.33037878572940826, + 0.4351683668792248, + 0.5037164948880672, + 0.2641538344323635, + 0.0, + 0.3479459472000599, + 0.4538011997938156, + 0.43785717338323593, + 0.11048178002238274, + 0.2684844620525837, + 0.8550888225436211, + 0.6151580773293972, + 0.04515761137008667, + 0.0, + 0.46790944784879684, + 0.16154909133911133, + 0.6666693240404129, + 0.04658098891377449, + 0.2241022028028965, + 0.8636493384838104, + 0.11496701650321484, + 0.16053999215364456, + 0.8612288404256105, + 0.21351448819041252, + 0.27004486694931984, + 0.04338027909398079, + 0.7496714368462563, + 0.06647989898920059, + 0.042386770248413086, + 0.0, + 1.7164557799696922, + 0.17823957279324532, + 0.16243064403533936, + 1.9274648614227772, + 0.7615538164973259, + 0.44375549256801605, + 0.1751860696822405, + 0.03261379525065422, + 0.1844015084207058, + 1.1562649086117744, + 0.5156058855354786, + 0.10825976356863976, + 0.3036051131784916, + 0.12048575840890408, + 0.9582324884831905, + 0.032837461680173874, + 0.786533061414957, + 0.15759626775979996, + 1.1279140431433916, + 0.757539089769125, + 1.1789777614176273, + 0.0, + 0.20114444196224213 + ], + "unique_experts": 60, + "load_cv": 0.9156256535112408, + "normalized_load_entropy": 0.9064173184533458, + "max_load_share": 0.06218905472636816 + } + }, + "s1_period": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "afe044a7c3f5b618a9c2ffef3e205edb893154622d6043c94c0ca08f07267fb5", + "route_weight_sha256": "96575073b4922119371df2507a291893ddc0062d8322a08a46b3167873e49746", + "loads": [ + 0, + 3, + 1, + 3, + 4, + 3, + 10, + 0, + 1, + 5, + 7, + 4, + 4, + 2, + 1, + 0, + 5, + 6, + 4, + 0, + 2, + 10, + 9, + 1, + 0, + 7, + 2, + 2, + 0, + 3, + 10, + 2, + 3, + 12, + 2, + 3, + 1, + 9, + 1, + 1, + 0, + 11, + 1, + 1, + 20, + 9, + 3, + 1, + 0, + 0, + 16, + 4, + 2, + 3, + 2, + 6, + 1, + 3, + 4, + 9, + 8, + 1, + 0, + 4 + ], + "weighted_loads": [ + 0.0, + 0.10084444656968117, + 0.05372697860002518, + 0.2114374004304409, + 0.205694068223238, + 0.110014284029603, + 0.4913926664739847, + 0.0, + 0.0298386812210083, + 0.23749399557709694, + 0.40630108676850796, + 0.27554232627153397, + 0.38918714970350266, + 0.06737208180129528, + 0.033920157700777054, + 0.0, + 0.35321612656116486, + 0.31397272273898125, + 0.1423415020108223, + 0.0, + 0.08104006201028824, + 0.7650762367993593, + 0.5436682365834713, + 0.046217937022447586, + 0.0, + 0.45778943225741386, + 0.16816622763872147, + 0.08457871153950691, + 0.0, + 0.14459891989827156, + 0.5024680159986019, + 0.09669952280819416, + 0.15979917347431183, + 0.5541352033615112, + 0.1789862923324108, + 0.23341718688607216, + 0.03894040361046791, + 0.6878635883331299, + 0.06540589034557343, + 0.03493659570813179, + 0.0, + 0.6335413549095392, + 0.04006955400109291, + 0.032897189259529114, + 1.5216859839856625, + 0.5902647897601128, + 0.17440509796142578, + 0.032934438437223434, + 0.0, + 0.0, + 1.0655271634459496, + 0.19764660112559795, + 0.10469621419906616, + 0.15273769944906235, + 0.1193160880357027, + 0.37039829045534134, + 0.03234320506453514, + 0.3659319058060646, + 0.18910590931773186, + 0.44099045917391777, + 0.45634306222200394, + 0.139483243227005, + 0.0, + 0.2036222629249096 + ], + "unique_experts": 54, + "load_cv": 1.0402579287499012, + "normalized_load_entropy": 0.8813834330199857, + "max_load_share": 0.07936507936507936 + }, + "full_input": { + "tokens": 83, + "top_k": 6, + "decisions": 498, + "ordered_route_sha256": "b7ed05b2b3b0f153ba7c530d6dffb34a1f2021944aa7b84271d8e22faabb3831", + "route_weight_sha256": "4d820ba670a2d9df78aef470a0133b9fec3c8754d9f96e4ed5503c7d2f6e1e3c", + "loads": [ + 2, + 3, + 3, + 4, + 8, + 3, + 10, + 1, + 1, + 6, + 10, + 7, + 8, + 3, + 5, + 0, + 5, + 10, + 8, + 0, + 3, + 12, + 9, + 1, + 1, + 10, + 4, + 20, + 0, + 6, + 21, + 3, + 8, + 29, + 4, + 5, + 3, + 11, + 2, + 1, + 1, + 26, + 3, + 3, + 25, + 15, + 10, + 5, + 8, + 4, + 20, + 20, + 3, + 8, + 2, + 17, + 2, + 10, + 4, + 27, + 18, + 12, + 0, + 5 + ], + "weighted_loads": [ + 0.08874581381678581, + 0.10084444656968117, + 0.10815360676497221, + 0.27135196700692177, + 0.4071841761469841, + 0.110014284029603, + 0.4913926664739847, + 0.03792983666062355, + 0.0298386812210083, + 0.2537263073027134, + 0.522646052762866, + 0.44941410794854164, + 0.5916270166635513, + 0.536351976916194, + 0.34223324060440063, + 0.0, + 0.35321612656116486, + 0.570574339479208, + 0.4670860171318054, + 0.0, + 0.1216147430241108, + 0.8516911324113607, + 0.5436682365834713, + 0.046217937022447586, + 0.04175034537911415, + 0.7775859665125608, + 0.23858084715902805, + 1.2130222469568253, + 0.0, + 0.27809884026646614, + 1.3984917402267456, + 0.11047239601612091, + 0.6530438289046288, + 1.3908012341707945, + 0.32097554579377174, + 0.39783959090709686, + 0.1235884465277195, + 0.7748524881899357, + 0.10289621725678444, + 0.03493659570813179, + 0.04222068190574646, + 1.8968200348317623, + 0.08588443137705326, + 0.10122782178223133, + 1.930128052830696, + 0.8896208815276623, + 0.5443308614194393, + 0.2062262985855341, + 0.6477017477154732, + 0.2197665423154831, + 1.3147441670298576, + 1.16420959495008, + 0.1732846051454544, + 0.38568074628710747, + 0.1193160880357027, + 1.110159993171692, + 0.10488244518637657, + 0.8523583449423313, + 0.18910590931773186, + 1.5164259374141693, + 1.1306778006255627, + 1.0878934152424335, + 0.0, + 0.23993539810180664 + ], + "unique_experts": 60, + "load_cv": 0.9348980103570227, + "normalized_load_entropy": 0.903480761083801, + "max_load_share": 0.05823293172690763 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 42, + "ordered_topk_exact_tokens": 26, + "set_exact_tokens": 31, + "mean_set_jaccard": 0.9251700680272108, + "mean_token_weighted_tv": 0.01523895776786265, + "aggregate_load_tv": 0.04365079365079365 + }, + "system_bos": { + "tokens": 42, + "ordered_topk_exact_tokens": 25, + "set_exact_tokens": 29, + "mean_set_jaccard": 0.901360544217687, + "mean_token_weighted_tv": 0.020492689617510353, + "aggregate_load_tv": 0.03968253968253968 + }, + "system_x": { + "tokens": 42, + "ordered_topk_exact_tokens": 22, + "set_exact_tokens": 26, + "mean_set_jaccard": 0.8718820861678005, + "mean_token_weighted_tv": 0.02854333030769513, + "aggregate_load_tv": 0.05952380952380952 + }, + "system_period": { + "tokens": 42, + "ordered_topk_exact_tokens": 20, + "set_exact_tokens": 26, + "mean_set_jaccard": 0.8809523809523812, + "mean_token_weighted_tv": 0.026094184767100074, + "aggregate_load_tv": 0.05555555555555555 + }, + "bos_at_s0": { + "tokens": 42, + "ordered_topk_exact_tokens": 23, + "set_exact_tokens": 27, + "mean_set_jaccard": 0.8928571428571429, + "mean_token_weighted_tv": 0.02429265979056557, + "aggregate_load_tv": 0.05555555555555555 + }, + "bos_at_s1": { + "tokens": 42, + "ordered_topk_exact_tokens": 20, + "set_exact_tokens": 26, + "mean_set_jaccard": 0.8758503401360546, + "mean_token_weighted_tv": 0.027000297548338062, + "aggregate_load_tv": 0.05952380952380952 + }, + "x_at_s0": { + "tokens": 42, + "ordered_topk_exact_tokens": 17, + "set_exact_tokens": 26, + "mean_set_jaccard": 0.8860544217687075, + "mean_token_weighted_tv": 0.026018585211464336, + "aggregate_load_tv": 0.05555555555555555 + }, + "x_at_s1": { + "tokens": 42, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 21, + "mean_set_jaccard": 0.8378684807256236, + "mean_token_weighted_tv": 0.03591197347711949, + "aggregate_load_tv": 0.06746031746031746 + }, + "period_at_s0": { + "tokens": 42, + "ordered_topk_exact_tokens": 23, + "set_exact_tokens": 30, + "mean_set_jaccard": 0.913265306122449, + "mean_token_weighted_tv": 0.02280651709242236, + "aggregate_load_tv": 0.03968253968253968 + }, + "period_at_s1": { + "tokens": 42, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 21, + "mean_set_jaccard": 0.8418367346938774, + "mean_token_weighted_tv": 0.034219061667543085, + "aggregate_load_tv": 0.07142857142857142 + } + } + }, + "layer_11": { + "layer": 11, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "ebe362975a7113c97eb0caa0bf18fc6d3c7003b858d0452a4d3b1597af62d404", + "route_weight_sha256": "c28226b265821a8525abf65b7025b3602be8f46e07c4e2094e365f4cc6b4e376", + "loads": [ + 1, + 4, + 1, + 0, + 5, + 7, + 0, + 2, + 5, + 3, + 1, + 5, + 4, + 3, + 4, + 4, + 7, + 4, + 1, + 2, + 5, + 1, + 6, + 3, + 3, + 2, + 2, + 3, + 7, + 2, + 9, + 7, + 3, + 2, + 7, + 4, + 0, + 1, + 0, + 2, + 8, + 4, + 1, + 10, + 6, + 9, + 0, + 9, + 0, + 5, + 1, + 2, + 8, + 0, + 0, + 2, + 1, + 8, + 12, + 3, + 3, + 8, + 1, + 19 + ], + "weighted_loads": [ + 0.053556956350803375, + 0.15494998916983604, + 0.06347192823886871, + 0.0, + 0.2023045551031828, + 0.35677705332636833, + 0.0, + 0.1101374514400959, + 0.28185703977942467, + 0.11112044006586075, + 0.02502552792429924, + 0.19873257353901863, + 0.37425217032432556, + 0.2340448647737503, + 0.22046321630477905, + 0.16111162304878235, + 0.304642029106617, + 0.14936731941998005, + 0.06464872509241104, + 0.0932028517127037, + 0.2901909966021776, + 0.0808996632695198, + 0.3073258437216282, + 0.24594911187887192, + 0.1250900663435459, + 0.0832989364862442, + 0.06555191241204739, + 0.10502995550632477, + 0.5878528282046318, + 0.07087034918367863, + 0.5151738934218884, + 0.3578907810151577, + 0.1056896224617958, + 0.08381049707531929, + 0.5845193788409233, + 0.12939128652215004, + 0.0, + 0.04650977626442909, + 0.0, + 0.09921468794345856, + 0.302273690700531, + 0.20318518951535225, + 0.052286919206380844, + 0.773120092228055, + 0.3721523620188236, + 0.7853226885199547, + 0.0, + 0.47133227065205574, + 0.0, + 0.2684034127742052, + 0.056991126388311386, + 0.06660962663590908, + 0.3403925634920597, + 0.0, + 0.0, + 0.08225862309336662, + 0.03390485793352127, + 0.5602532308548689, + 0.8504153788089752, + 0.1219879724085331, + 0.10078899562358856, + 0.26908951066434383, + 0.03271045163273811, + 1.2846737243235111 + ], + "unique_experts": 56, + "load_cv": 0.888747154232979, + "normalized_load_entropy": 0.9076539929232269, + "max_load_share": 0.07539682539682539 + }, + "full_input": { + "tokens": 67, + "top_k": 6, + "decisions": 402, + "ordered_route_sha256": "57fc2b5bfab63b0e9f92063d7a9ff0b5bb8fd21c6d4c6172198bf1bee20e5aa6", + "route_weight_sha256": "bd32cf340053750fd44c72c0080cebf99b946f0dd536e67c067537350d7faeab", + "loads": [ + 1, + 5, + 2, + 0, + 10, + 7, + 0, + 2, + 9, + 6, + 5, + 8, + 4, + 3, + 4, + 10, + 12, + 6, + 13, + 2, + 5, + 1, + 7, + 9, + 3, + 3, + 3, + 5, + 14, + 2, + 15, + 14, + 4, + 2, + 11, + 6, + 0, + 1, + 0, + 2, + 14, + 4, + 1, + 32, + 9, + 9, + 0, + 17, + 0, + 7, + 1, + 2, + 8, + 0, + 5, + 4, + 1, + 8, + 15, + 3, + 4, + 13, + 10, + 19 + ], + "weighted_loads": [ + 0.053556956350803375, + 0.18882954865694046, + 0.12205008789896965, + 0.0, + 0.43937790766358376, + 0.35677705332636833, + 0.0, + 0.1101374514400959, + 0.5199704952538013, + 0.19615588150918484, + 0.13032292062416673, + 0.25259699393063784, + 0.37425217032432556, + 0.2340448647737503, + 0.22046321630477905, + 0.39155375584959984, + 0.824069906026125, + 0.1792031042277813, + 2.1318123303353786, + 0.0932028517127037, + 0.2901909966021776, + 0.0808996632695198, + 0.31124819116666913, + 0.5289629120379686, + 0.1250900663435459, + 0.13562723994255066, + 0.06890446390025318, + 0.14975992683321238, + 1.0460113734006882, + 0.07087034918367863, + 0.8098455425351858, + 0.6770433112978935, + 0.1412607729434967, + 0.08381049707531929, + 0.7613742873072624, + 0.23828266747295856, + 0.0, + 0.04650977626442909, + 0.0, + 0.09921468794345856, + 0.6345639787614346, + 0.20318518951535225, + 0.052286919206380844, + 2.9603236857801676, + 0.5355614274740219, + 0.7853226885199547, + 0.0, + 1.0250353962182999, + 0.0, + 0.3635328244417906, + 0.056991126388311386, + 0.06660962663590908, + 0.3403925634920597, + 0.0, + 0.26748625468462706, + 0.17371686920523643, + 0.03390485793352127, + 0.5602532308548689, + 0.9878290332853794, + 0.1219879724085331, + 0.14299867674708366, + 0.5126095972955227, + 0.5466896742582321, + 1.2846737243235111 + ], + "unique_experts": 57, + "load_cv": 0.9250922378998533, + "normalized_load_entropy": 0.903003056616709, + "max_load_share": 0.07960199004975124 + } + }, + "s1_eos": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "46911a79b08f90cbb38c1032bcec5e29ad2fc4142274f4a6636b75a22f128914", + "route_weight_sha256": "4df4d9ec8c32905ec9a6c4c49ee55d2ca93443642467435d0fd4170874b6a6f0", + "loads": [ + 1, + 5, + 1, + 0, + 5, + 8, + 0, + 2, + 5, + 4, + 1, + 5, + 4, + 3, + 4, + 4, + 9, + 3, + 3, + 2, + 4, + 1, + 5, + 4, + 3, + 2, + 1, + 3, + 7, + 2, + 8, + 5, + 3, + 2, + 7, + 3, + 0, + 1, + 1, + 2, + 7, + 4, + 1, + 10, + 7, + 9, + 0, + 9, + 0, + 5, + 1, + 3, + 8, + 0, + 0, + 2, + 1, + 7, + 12, + 3, + 4, + 6, + 1, + 19 + ], + "weighted_loads": [ + 0.05160613730549812, + 0.19055987149477005, + 0.06039869040250778, + 0.0, + 0.20104643516242504, + 0.37411895394325256, + 0.0, + 0.1100618802011013, + 0.27785949409008026, + 0.13631622679531574, + 0.02364024892449379, + 0.1972993239760399, + 0.37690088897943497, + 0.23478109389543533, + 0.228802602738142, + 0.151058129966259, + 0.36811033077538013, + 0.12343121320009232, + 0.1253793016076088, + 0.09083196520805359, + 0.24675806984305382, + 0.07881666719913483, + 0.2634211294353008, + 0.2818416766822338, + 0.12492086365818977, + 0.08060941100120544, + 0.030981754884123802, + 0.10403341986238956, + 0.5807990655303001, + 0.07149365544319153, + 0.48666801676154137, + 0.29854005575180054, + 0.10609040781855583, + 0.07710424438118935, + 0.580255139619112, + 0.10000201873481274, + 0.0, + 0.04373442754149437, + 0.02890520542860031, + 0.10130660235881805, + 0.2694938238710165, + 0.2049785889685154, + 0.052754756063222885, + 0.7345956303179264, + 0.404997818171978, + 0.7914700210094452, + 0.0, + 0.4552767090499401, + 0.0, + 0.2664107233285904, + 0.05842529237270355, + 0.09456880576908588, + 0.337728351354599, + 0.0, + 0.0, + 0.0869557075202465, + 0.03410952910780907, + 0.5314912647008896, + 0.8597280941903591, + 0.11992951855063438, + 0.15979884192347527, + 0.2108512632548809, + 0.03253185749053955, + 1.3013467229902744 + ], + "unique_experts": 57, + "load_cv": 0.870414594974933, + "normalized_load_entropy": 0.9126378596912756, + "max_load_share": 0.07539682539682539 + }, + "full_input": { + "tokens": 83, + "top_k": 6, + "decisions": 498, + "ordered_route_sha256": "dacd6cb19790ba467283ca31aa2fb9ba6467d15f78eca1299938f0fcb264a7e5", + "route_weight_sha256": "dc871e602786b70c209b3e88732b66a7bfb39c70a72a783a8cced6ca13e169b3", + "loads": [ + 3, + 6, + 2, + 0, + 16, + 12, + 0, + 4, + 15, + 4, + 6, + 8, + 4, + 3, + 4, + 5, + 27, + 5, + 14, + 3, + 5, + 2, + 8, + 8, + 3, + 3, + 4, + 6, + 18, + 2, + 17, + 11, + 4, + 2, + 11, + 7, + 0, + 1, + 1, + 3, + 14, + 4, + 1, + 37, + 9, + 9, + 1, + 23, + 0, + 8, + 1, + 3, + 8, + 5, + 20, + 9, + 7, + 8, + 14, + 7, + 6, + 14, + 12, + 21 + ], + "weighted_loads": [ + 0.19923335686326027, + 0.2240792214870453, + 0.10668612271547318, + 0.0, + 0.771402396261692, + 0.5162831917405128, + 0.0, + 0.23890648409724236, + 0.8795925080776215, + 0.13631622679531574, + 0.16799749247729778, + 0.2504581641405821, + 0.37690088897943497, + 0.23478109389543533, + 0.228802602738142, + 0.19103078171610832, + 1.9831917267292738, + 0.15245602186769247, + 2.1990117095410824, + 0.1296682134270668, + 0.3196621872484684, + 0.14916349202394485, + 0.37887542811222374, + 0.4614771120250225, + 0.12492086365818977, + 0.129976537078619, + 0.11189954075962305, + 0.18554612714797258, + 1.3571542650461197, + 0.07149365544319153, + 0.9375589434057474, + 0.5734421014785767, + 0.13977092131972313, + 0.07710424438118935, + 0.7865662723779678, + 0.4284061882644892, + 0.0, + 0.04373442754149437, + 0.02890520542860031, + 0.14797892048954964, + 0.6231302227824926, + 0.2049785889685154, + 0.052754756063222885, + 3.263442315161228, + 0.5387176461517811, + 0.7914700210094452, + 0.04667087271809578, + 1.4589424096047878, + 0.0, + 0.485257089138031, + 0.05842529237270355, + 0.09456880576908588, + 0.337728351354599, + 0.30820222944021225, + 1.2078744871541858, + 0.42246030643582344, + 0.5079856477677822, + 0.5742686688899994, + 0.9619650542736053, + 0.27302519977092743, + 0.23902055993676186, + 0.5744025986641645, + 0.5981015115976334, + 1.3771917894482613 + ], + "unique_experts": 60, + "load_cv": 0.9108501023245785, + "normalized_load_entropy": 0.9107826040701327, + "max_load_share": 0.07429718875502007 + } + }, + "s0_bos": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "e1474c917c528b832d98817abb0f2c127d0f02781d6576cd1f3927f886460f39", + "route_weight_sha256": "b890914c85d734d43df85d671578f5f8fe52636836682caef3b01de3fe56e925", + "loads": [ + 1, + 4, + 1, + 0, + 5, + 7, + 0, + 2, + 5, + 3, + 1, + 5, + 4, + 3, + 5, + 3, + 9, + 4, + 2, + 2, + 5, + 1, + 6, + 3, + 4, + 2, + 1, + 3, + 8, + 2, + 9, + 6, + 4, + 2, + 7, + 2, + 0, + 1, + 0, + 2, + 10, + 4, + 1, + 10, + 6, + 9, + 0, + 8, + 0, + 4, + 1, + 3, + 8, + 0, + 1, + 1, + 1, + 7, + 12, + 4, + 4, + 6, + 1, + 17 + ], + "weighted_loads": [ + 0.046199679374694824, + 0.15969696827232838, + 0.06616710871458054, + 0.0, + 0.18168354593217373, + 0.34327250719070435, + 0.0, + 0.10096362978219986, + 0.2812468148767948, + 0.08874848484992981, + 0.024128438904881477, + 0.19285400211811066, + 0.3802734389901161, + 0.24262558668851852, + 0.25098205730319023, + 0.10940062999725342, + 0.38441394828259945, + 0.15460090711712837, + 0.09572502598166466, + 0.0916934497654438, + 0.318062886595726, + 0.08133828639984131, + 0.31535281240940094, + 0.25245092064142227, + 0.1625964343547821, + 0.07550165429711342, + 0.030055806040763855, + 0.10548928380012512, + 0.6338303238153458, + 0.07155567780137062, + 0.526983629912138, + 0.3296408820897341, + 0.12897024489939213, + 0.08111942186951637, + 0.5773346088826656, + 0.06963893957436085, + 0.0, + 0.04898369312286377, + 0.0, + 0.09638229757547379, + 0.3734806627035141, + 0.19173680990934372, + 0.0529608316719532, + 0.7855165041983128, + 0.3836165927350521, + 0.8504645712673664, + 0.0, + 0.4129066690802574, + 0.0, + 0.23296508379280567, + 0.056060224771499634, + 0.0984652079641819, + 0.3279212415218353, + 0.0, + 0.04184481129050255, + 0.03588307276368141, + 0.03225919231772423, + 0.5205180868506432, + 0.8539859540760517, + 0.1584668681025505, + 0.15985729172825813, + 0.21493988670408726, + 0.03365820646286011, + 1.2136480510234833 + ], + "unique_experts": 57, + "load_cv": 0.8599307981321611, + "normalized_load_entropy": 0.9114884290408052, + "max_load_share": 0.06746031746031746 + }, + "full_input": { + "tokens": 67, + "top_k": 6, + "decisions": 402, + "ordered_route_sha256": "1b6450599f97531df340f64f1ed823af19b7925ac73c15fbda6cbd22108ffe00", + "route_weight_sha256": "a1df3de5fb77f3d81fe3073ed555d66837f98a586f468cf89063e17fcd79b000", + "loads": [ + 1, + 5, + 2, + 0, + 9, + 7, + 0, + 2, + 9, + 7, + 4, + 7, + 4, + 3, + 5, + 11, + 14, + 5, + 13, + 2, + 5, + 1, + 6, + 9, + 4, + 3, + 1, + 6, + 13, + 2, + 15, + 14, + 5, + 2, + 11, + 3, + 0, + 1, + 0, + 2, + 18, + 4, + 1, + 33, + 9, + 9, + 0, + 16, + 0, + 6, + 1, + 3, + 8, + 0, + 6, + 3, + 1, + 7, + 15, + 4, + 5, + 13, + 10, + 17 + ], + "weighted_loads": [ + 0.046199679374694824, + 0.1935765277594328, + 0.12474526837468147, + 0.0, + 0.37848176062107086, + 0.34327250719070435, + 0.0, + 0.10096362978219986, + 0.5034040957689285, + 0.21058066561818123, + 0.12246987596154213, + 0.2346627600491047, + 0.3802734389901161, + 0.24262558668851852, + 0.25098205730319023, + 0.41139546409249306, + 0.9266177099198103, + 0.16944623552262783, + 1.2665852755308151, + 0.0916934497654438, + 0.318062886595726, + 0.08133828639984131, + 0.31535281240940094, + 0.535464720800519, + 0.1625964343547821, + 0.12049843370914459, + 0.030055806040763855, + 0.19716981891542673, + 1.030263364315033, + 0.07155567780137062, + 0.8216552790254354, + 0.7515638377517462, + 0.16454139538109303, + 0.08111942186951637, + 0.7511294782161713, + 0.14837178774178028, + 0.0, + 0.04898369312286377, + 0.0, + 0.09638229757547379, + 0.8327777795493603, + 0.19173680990934372, + 0.0529608316719532, + 3.1019330993294716, + 0.5470256581902504, + 0.8504645712673664, + 0.0, + 0.9578976817429066, + 0.0, + 0.32809449546039104, + 0.056060224771499634, + 0.0984652079641819, + 0.3279212415218353, + 0.0, + 0.307055595330894, + 0.12164052575826645, + 0.03225919231772423, + 0.5205180868506432, + 0.9913996085524559, + 0.1584668681025505, + 0.20403074845671654, + 0.5326301753520966, + 0.5668429248034954, + 1.2136480510234833 + ], + "unique_experts": 57, + "load_cv": 0.94164004434788, + "normalized_load_entropy": 0.9007179647920212, + "max_load_share": 0.08208955223880597 + } + }, + "s1_bos": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "c2387918d2e7801f7239c2f7bba233af5d5abe19abb2bad3bec97c0fb74702f3", + "route_weight_sha256": "2dccea930ba3838cd60bd6470a4799f8297712575ad00ed47c1349dbf59ce017", + "loads": [ + 1, + 3, + 1, + 0, + 4, + 7, + 0, + 2, + 5, + 4, + 1, + 5, + 4, + 3, + 4, + 5, + 8, + 4, + 2, + 2, + 4, + 1, + 6, + 4, + 4, + 2, + 1, + 3, + 8, + 1, + 9, + 6, + 3, + 2, + 8, + 3, + 0, + 0, + 0, + 2, + 9, + 4, + 1, + 9, + 6, + 9, + 0, + 9, + 0, + 6, + 1, + 3, + 7, + 0, + 2, + 1, + 1, + 7, + 12, + 6, + 5, + 5, + 0, + 17 + ], + "weighted_loads": [ + 0.04612108692526817, + 0.11892504245042801, + 0.06406302005052567, + 0.0, + 0.1604218054562807, + 0.35079389810562134, + 0.0, + 0.10374263301491737, + 0.28690055757761, + 0.12195414304733276, + 0.025005830451846123, + 0.19317591562867165, + 0.38257940858602524, + 0.2420581877231598, + 0.22486446052789688, + 0.1892248447984457, + 0.33622326515614986, + 0.15999305248260498, + 0.09896643087267876, + 0.09156978875398636, + 0.26075710728764534, + 0.0829315260052681, + 0.30490695126354694, + 0.2848076708614826, + 0.1736363060772419, + 0.08052150532603264, + 0.03029368259012699, + 0.10290003754198551, + 0.649249542504549, + 0.04060128703713417, + 0.5303567871451378, + 0.32717364840209484, + 0.10234064608812332, + 0.0774696096777916, + 0.6443930566310883, + 0.09182748012244701, + 0.0, + 0.0, + 0.0, + 0.09895584732294083, + 0.3406894765794277, + 0.2040993794798851, + 0.05268717557191849, + 0.7866929657757282, + 0.3851638175547123, + 0.8348335176706314, + 0.0, + 0.44085877388715744, + 0.0, + 0.3004441726952791, + 0.05665145814418793, + 0.0965788010507822, + 0.2960810028016567, + 0.0, + 0.06877685338258743, + 0.035709448158741, + 0.033202942460775375, + 0.5163672082126141, + 0.8550446927547455, + 0.21354121156036854, + 0.1865405458956957, + 0.17938679829239845, + 0.0, + 1.2167184874415398 + ], + "unique_experts": 55, + "load_cv": 0.8552300820967742, + "normalized_load_entropy": 0.9087570380801298, + "max_load_share": 0.06746031746031746 + }, + "full_input": { + "tokens": 83, + "top_k": 6, + "decisions": 498, + "ordered_route_sha256": "cec9f374d4d7de6a43d720d6c0a6a42699bd3dca1c42ded3f4d3f08fec453d5a", + "route_weight_sha256": "9bdd7b71bb84ce6cb4920dc6048caa18d41191b47e956deeac576d1666a15733", + "loads": [ + 3, + 4, + 2, + 0, + 14, + 11, + 0, + 4, + 15, + 5, + 5, + 7, + 4, + 3, + 4, + 7, + 26, + 5, + 12, + 3, + 5, + 2, + 8, + 8, + 4, + 3, + 3, + 6, + 18, + 1, + 18, + 12, + 4, + 2, + 12, + 7, + 0, + 0, + 0, + 3, + 17, + 4, + 1, + 37, + 8, + 9, + 1, + 24, + 0, + 9, + 1, + 4, + 7, + 5, + 21, + 8, + 7, + 8, + 14, + 10, + 7, + 15, + 12, + 19 + ], + "weighted_loads": [ + 0.19374830648303032, + 0.15244439244270325, + 0.11035045236349106, + 0.0, + 0.7022989261895418, + 0.4929581359028816, + 0.0, + 0.23258723691105843, + 0.8791873753070831, + 0.15522096678614616, + 0.16333097033202648, + 0.23494686000049114, + 0.38257940858602524, + 0.2420581877231598, + 0.22486446052789688, + 0.26046487875282764, + 1.9706705044955015, + 0.17483838088810444, + 1.2741993069648743, + 0.13040603697299957, + 0.3336612246930599, + 0.15327835083007812, + 0.4165902193635702, + 0.4644431062042713, + 0.1736363060772419, + 0.1271282285451889, + 0.10804626159369946, + 0.19080132525414228, + 1.3855097815394402, + 0.04060128703713417, + 0.9812477137893438, + 0.602075694128871, + 0.13602115958929062, + 0.0774696096777916, + 0.8422239869832993, + 0.41931640170514584, + 0.0, + 0.0, + 0.0, + 0.1456281654536724, + 0.7892496101558208, + 0.2040993794798851, + 0.05268717557191849, + 3.6287469044327736, + 0.5188836455345154, + 0.8348335176706314, + 0.04667087271809578, + 1.4780695289373398, + 0.0, + 0.5192905385047197, + 0.05665145814418793, + 0.12313470244407654, + 0.2960810028016567, + 0.30820222944021225, + 1.2585444217547774, + 0.37121404707431793, + 0.5070790611207485, + 0.5591446124017239, + 0.9572816528379917, + 0.3666368927806616, + 0.27022714726626873, + 0.6335616614669561, + 0.6176288984715939, + 1.2925635538995266 + ], + "unique_experts": 58, + "load_cv": 0.9170619196514304, + "normalized_load_entropy": 0.9070644090861631, + "max_load_share": 0.07429718875502007 + } + }, + "s0_x": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "8f6aa0207d1fbbe9197d501a15c0248c31c8292febece584ced188d3468f7b31", + "route_weight_sha256": "408258597c21d637167a7d660138a7ee03b95783e47bc56c4386b185081ee756", + "loads": [ + 1, + 5, + 1, + 0, + 5, + 7, + 0, + 2, + 7, + 3, + 2, + 6, + 4, + 3, + 4, + 4, + 7, + 2, + 3, + 2, + 4, + 1, + 6, + 3, + 3, + 2, + 2, + 3, + 8, + 1, + 9, + 6, + 4, + 2, + 6, + 2, + 0, + 1, + 0, + 2, + 7, + 5, + 2, + 10, + 7, + 9, + 0, + 9, + 0, + 4, + 1, + 3, + 8, + 0, + 1, + 2, + 1, + 7, + 12, + 4, + 3, + 6, + 0, + 18 + ], + "weighted_loads": [ + 0.05246454477310181, + 0.19929350540041924, + 0.06431152671575546, + 0.0, + 0.18431611731648445, + 0.36080725491046906, + 0.0, + 0.10687984898686409, + 0.35546910762786865, + 0.08712773397564888, + 0.05269039049744606, + 0.22575823962688446, + 0.38905253261327744, + 0.24533827602863312, + 0.22345832362771034, + 0.13775217719376087, + 0.29750686697661877, + 0.08851239643990993, + 0.12316626496613026, + 0.09792695939540863, + 0.2927064970135689, + 0.08260953426361084, + 0.31624123081564903, + 0.25052937120199203, + 0.13563022390007973, + 0.0824522003531456, + 0.06915475055575371, + 0.10103380121290684, + 0.6435336358845234, + 0.037502486258745193, + 0.5211280956864357, + 0.3406237158924341, + 0.13396769389510155, + 0.08285893127322197, + 0.535370010882616, + 0.06945408508181572, + 0.0, + 0.04857075959444046, + 0.0, + 0.10214868187904358, + 0.24955870024859905, + 0.22422444075345993, + 0.08269093185663223, + 0.7255237437784672, + 0.41802696138620377, + 0.8339473232626915, + 0.0, + 0.4741145297884941, + 0.0, + 0.23019519820809364, + 0.05660024285316467, + 0.10031176544725895, + 0.33641423657536507, + 0.0, + 0.04471036419272423, + 0.07178659737110138, + 0.03372352570295334, + 0.5260494835674763, + 0.8399980179965496, + 0.15411301888525486, + 0.12777141109108925, + 0.21238807030022144, + 0.0, + 1.26415428891778 + ], + "unique_experts": 56, + "load_cv": 0.8587580314110463, + "normalized_load_entropy": 0.912078889888145, + "max_load_share": 0.07142857142857142 + }, + "full_input": { + "tokens": 67, + "top_k": 6, + "decisions": 402, + "ordered_route_sha256": "89cb6ece1a68a0d852a775009cfbbf0aeb0318c7a94e221eaf7bf0bc8872f245", + "route_weight_sha256": "9f97e4ec1702f5c2628aa70e636ad39fa2a593016ca044d204bf5947a9b14daf", + "loads": [ + 1, + 6, + 2, + 0, + 9, + 7, + 0, + 2, + 11, + 6, + 5, + 8, + 4, + 3, + 4, + 10, + 11, + 4, + 15, + 2, + 4, + 1, + 6, + 9, + 3, + 3, + 2, + 5, + 15, + 1, + 15, + 15, + 5, + 2, + 11, + 4, + 0, + 1, + 0, + 2, + 13, + 5, + 2, + 32, + 10, + 9, + 0, + 17, + 0, + 8, + 1, + 3, + 8, + 1, + 5, + 4, + 1, + 7, + 16, + 4, + 4, + 11, + 9, + 18 + ], + "weighted_loads": [ + 0.05246454477310181, + 0.23317306488752365, + 0.1228896863758564, + 0.0, + 0.3811143320053816, + 0.36080725491046906, + 0.0, + 0.10687984898686409, + 0.5834825411438942, + 0.17523666471242905, + 0.15195010602474213, + 0.2675669975578785, + 0.38905253261327744, + 0.24533827602863312, + 0.22345832362771034, + 0.36819430999457836, + 0.7598258759826422, + 0.1390722207725048, + 1.383581718429923, + 0.09792695939540863, + 0.2927064970135689, + 0.08260953426361084, + 0.31624123081564903, + 0.5335431713610888, + 0.13563022390007973, + 0.1305982582271099, + 0.06915475055575371, + 0.1467353580519557, + 1.1523775272071362, + 0.037502486258745193, + 0.8157997447997332, + 0.8240657616406679, + 0.16953884437680244, + 0.08285893127322197, + 0.8071058467030525, + 0.1806785613298416, + 0.0, + 0.04857075959444046, + 0.0, + 0.10214868187904358, + 0.5459141936153173, + 0.22422444075345993, + 0.08269093185663223, + 2.765942554920912, + 0.581436026841402, + 0.8339473232626915, + 0.0, + 1.0360577143728733, + 0.0, + 0.41553615778684616, + 0.05660024285316467, + 0.10031176544725895, + 0.33641423657536507, + 0.054859429597854614, + 0.2747927410528064, + 0.15286806598305702, + 0.03372352570295334, + 0.5260494835674763, + 1.037995245307684, + 0.15411301888525486, + 0.1713733822107315, + 0.46634653583168983, + 0.48129673674702644, + 1.26415428891778 + ], + "unique_experts": 58, + "load_cv": 0.9263756405638126, + "normalized_load_entropy": 0.904223553060543, + "max_load_share": 0.07960199004975124 + } + }, + "s1_x": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "d85b62e9d0dfdbf3d5c1504753d7f4c0a8e36a40091836144b6b265c1a45f2c5", + "route_weight_sha256": "e911eea2914cca48a61b1688a56f57330f5cf9d77d6d25a51dd16ca0b1c5d4b7", + "loads": [ + 1, + 5, + 1, + 0, + 5, + 7, + 0, + 2, + 7, + 0, + 3, + 6, + 4, + 3, + 4, + 5, + 7, + 2, + 5, + 2, + 4, + 1, + 5, + 3, + 3, + 3, + 4, + 3, + 8, + 1, + 9, + 6, + 1, + 3, + 6, + 2, + 0, + 1, + 0, + 2, + 5, + 5, + 1, + 9, + 7, + 9, + 0, + 10, + 0, + 4, + 1, + 3, + 9, + 0, + 1, + 2, + 0, + 7, + 12, + 4, + 6, + 5, + 0, + 18 + ], + "weighted_loads": [ + 0.05054659768939018, + 0.19531182944774628, + 0.0621800497174263, + 0.0, + 0.1961382646113634, + 0.36422399058938026, + 0.0, + 0.11239399015903473, + 0.37804335728287697, + 0.0, + 0.09052549861371517, + 0.22341790795326233, + 0.39562171697616577, + 0.24973821640014648, + 0.2285260558128357, + 0.18317905440926552, + 0.27425484359264374, + 0.08907115831971169, + 0.1907551009207964, + 0.10075391829013824, + 0.2524862214922905, + 0.0834377184510231, + 0.2651779502630234, + 0.25312164053320885, + 0.144161656498909, + 0.1196233369410038, + 0.13229374587535858, + 0.09761371091008186, + 0.6152075417339802, + 0.03704523667693138, + 0.5360222198069096, + 0.3483087196946144, + 0.0370439775288105, + 0.10808020830154419, + 0.5705841481685638, + 0.06916501931846142, + 0.0, + 0.04385249316692352, + 0.0, + 0.106718510389328, + 0.18501484766602516, + 0.22923873737454414, + 0.0527154915034771, + 0.6020565181970596, + 0.42825867608189583, + 0.8162848651409149, + 0.0, + 0.519061703234911, + 0.0, + 0.2475748285651207, + 0.059225115925073624, + 0.09862357378005981, + 0.37228752486407757, + 0.0, + 0.04203907027840614, + 0.0776858851313591, + 0.0, + 0.5382246784865856, + 0.8441763464361429, + 0.15519769489765167, + 0.20627756044268608, + 0.158024363219738, + 0.0, + 1.2778751216828823 + ], + "unique_experts": 54, + "load_cv": 0.8715716770344346, + "normalized_load_entropy": 0.9058511994606088, + "max_load_share": 0.07142857142857142 + }, + "full_input": { + "tokens": 83, + "top_k": 6, + "decisions": 498, + "ordered_route_sha256": "c9b597a8eb2dc0d7e2c807819bee7a1a2d212b75729c4d82ccc3ddedf40cda6f", + "route_weight_sha256": "29f3f13743ae0f0455f16051103f0f317125b38497ebfcb936ac1faafd9ef671", + "loads": [ + 3, + 6, + 2, + 0, + 15, + 11, + 0, + 4, + 17, + 1, + 7, + 8, + 4, + 3, + 4, + 6, + 25, + 3, + 16, + 3, + 5, + 2, + 7, + 7, + 3, + 4, + 6, + 6, + 19, + 1, + 18, + 13, + 2, + 3, + 12, + 6, + 0, + 1, + 0, + 3, + 10, + 5, + 1, + 36, + 9, + 9, + 1, + 23, + 0, + 9, + 1, + 3, + 9, + 6, + 21, + 10, + 6, + 8, + 15, + 8, + 8, + 13, + 11, + 20 + ], + "weighted_loads": [ + 0.19817381724715233, + 0.22883117944002151, + 0.1084674820303917, + 0.0, + 0.7380153853446245, + 0.5063882283866405, + 0.0, + 0.24123859405517578, + 0.9655627459287643, + 0.03604425862431526, + 0.23074440471827984, + 0.2651888523250818, + 0.39562171697616577, + 0.24973821640014648, + 0.2285260558128357, + 0.22315170615911484, + 1.8504836894571781, + 0.10391648672521114, + 1.4443885367363691, + 0.13959016650915146, + 0.3253903388977051, + 0.15378454327583313, + 0.37686121836304665, + 0.43275707587599754, + 0.144161656498909, + 0.16728905960917473, + 0.21004632487893105, + 0.19524794165045023, + 1.4434313364326954, + 0.03704523667693138, + 0.9869131464511156, + 0.6726855151355267, + 0.0707244910299778, + 0.10808020830154419, + 0.8702671863138676, + 0.39718637987971306, + 0.0, + 0.04385249316692352, + 0.0, + 0.15339082852005959, + 0.4180130697786808, + 0.22923873737454414, + 0.0527154915034771, + 2.902541235089302, + 0.5619785040616989, + 0.8162848651409149, + 0.04667087271809578, + 1.4613333195447922, + 0.0, + 0.5517046973109245, + 0.059225115925073624, + 0.09862357378005981, + 0.37228752486407757, + 0.3597619943320751, + 1.2570707714185119, + 0.46012699231505394, + 0.47387611865997314, + 0.5810020826756954, + 0.9943875130265951, + 0.3082933761179447, + 0.28998521342873573, + 0.5383770074695349, + 0.5956742092967033, + 1.3537201881408691 + ], + "unique_experts": 59, + "load_cv": 0.9091486042767222, + "normalized_load_entropy": 0.9076337503539513, + "max_load_share": 0.07228915662650602 + } + }, + "s0_period": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "9907227773f0a3f0d014f4dc00f23d1cc1cfbc8677cc52ec633d964b102c02d7", + "route_weight_sha256": "94703b97af897b8becd74f704d52c8660f51f55e129ef041329e4b03722a70e2", + "loads": [ + 1, + 5, + 1, + 0, + 5, + 7, + 0, + 2, + 6, + 3, + 2, + 6, + 4, + 3, + 4, + 3, + 6, + 2, + 3, + 2, + 5, + 1, + 6, + 3, + 3, + 3, + 2, + 3, + 8, + 1, + 9, + 6, + 2, + 2, + 7, + 2, + 0, + 1, + 0, + 2, + 7, + 6, + 2, + 10, + 7, + 9, + 0, + 8, + 0, + 5, + 1, + 3, + 8, + 0, + 1, + 2, + 1, + 7, + 12, + 4, + 4, + 6, + 0, + 18 + ], + "weighted_loads": [ + 0.0521853044629097, + 0.1960216909646988, + 0.06403229385614395, + 0.0, + 0.18314641155302525, + 0.3572896346449852, + 0.0, + 0.10550442337989807, + 0.31310245394706726, + 0.08674087934195995, + 0.051135413348674774, + 0.22644583322107792, + 0.38326363265514374, + 0.24502097815275192, + 0.22074351087212563, + 0.1102767325937748, + 0.2720844577997923, + 0.08312973938882351, + 0.12746598199009895, + 0.09614209458231926, + 0.3153866417706013, + 0.08221915364265442, + 0.3181981034576893, + 0.25107093155384064, + 0.1299782581627369, + 0.12100069969892502, + 0.06889690831303596, + 0.09837210737168789, + 0.6789369955658913, + 0.0380687415599823, + 0.521023890003562, + 0.33920220099389553, + 0.07143901661038399, + 0.08144224435091019, + 0.5652763582766056, + 0.07012979686260223, + 0.0, + 0.04828270152211189, + 0.0, + 0.10176253318786621, + 0.25375545397400856, + 0.25294436886906624, + 0.08228035271167755, + 0.7476542741060257, + 0.41312565095722675, + 0.8497105129063129, + 0.0, + 0.43298475816845894, + 0.0, + 0.26104601845145226, + 0.05680062994360924, + 0.1000619437545538, + 0.3400262724608183, + 0.0, + 0.034591883420944214, + 0.07292933389544487, + 0.03380071744322777, + 0.5270175486803055, + 0.8668242860585451, + 0.15402042120695114, + 0.1482196059077978, + 0.21758978068828583, + 0.0, + 1.2684311009943485 + ], + "unique_experts": 56, + "load_cv": 0.8540508604644194, + "normalized_load_entropy": 0.9126058286990774, + "max_load_share": 0.07142857142857142 + }, + "full_input": { + "tokens": 67, + "top_k": 6, + "decisions": 402, + "ordered_route_sha256": "3d401dece6edc6780a41a104fa67fe84e9958ab427892fe4f3aae97e5efd8b96", + "route_weight_sha256": "902a87b7fa13686c1495e62c8e6f71b20f3692390c8e02d0001aa63823a8722c", + "loads": [ + 1, + 6, + 2, + 0, + 11, + 7, + 0, + 2, + 10, + 5, + 5, + 8, + 4, + 3, + 4, + 10, + 11, + 3, + 15, + 2, + 5, + 1, + 6, + 9, + 3, + 4, + 2, + 5, + 16, + 1, + 15, + 15, + 3, + 2, + 11, + 5, + 0, + 1, + 0, + 2, + 13, + 6, + 2, + 33, + 10, + 9, + 0, + 16, + 0, + 8, + 1, + 4, + 8, + 0, + 5, + 4, + 1, + 7, + 15, + 4, + 5, + 11, + 7, + 18 + ], + "weighted_loads": [ + 0.0521853044629097, + 0.2299012504518032, + 0.12261045351624489, + 0.0, + 0.4933683965355158, + 0.3572896346449852, + 0.0, + 0.10550442337989807, + 0.5407567992806435, + 0.1451559104025364, + 0.15224725753068924, + 0.26825459115207195, + 0.38326363265514374, + 0.24502097815275192, + 0.22074351087212563, + 0.38102324306964874, + 0.7866897787898779, + 0.09797506779432297, + 1.3407891169190407, + 0.09614209458231926, + 0.3153866417706013, + 0.08221915364265442, + 0.3181981034576893, + 0.5340847317129374, + 0.1299782581627369, + 0.17105137556791306, + 0.06889690831303596, + 0.14516332279890776, + 1.229700855910778, + 0.0380687415599823, + 0.8156955391168594, + 0.82494848780334, + 0.10701016709208488, + 0.08144224435091019, + 0.7614981196820736, + 0.33461180329322815, + 0.0, + 0.04828270152211189, + 0.0, + 0.10176253318786621, + 0.5517946779727936, + 0.25294436886906624, + 0.08228035271167755, + 2.8869641795754433, + 0.576534716412425, + 0.8497105129063129, + 0.0, + 0.9869879223406315, + 0.0, + 0.4069983549416065, + 0.05680062994360924, + 0.1298145055770874, + 0.3400262724608183, + 0.0, + 0.26506089698523283, + 0.15577474236488342, + 0.03380071744322777, + 0.5270175486803055, + 1.0042379405349493, + 0.15402042120695114, + 0.192313926294446, + 0.468165023252368, + 0.4083077684044838, + 1.2684311009943485 + ], + "unique_experts": 57, + "load_cv": 0.9340390250277263, + "normalized_load_entropy": 0.9025612255465456, + "max_load_share": 0.08208955223880597 + } + }, + "s1_period": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "a1e65de9c10ee22d3c5b968e4175f37f338e9a0f1b30d6030b323ab4910062e6", + "route_weight_sha256": "8d2dba2d4cbc9cc0ede362be441a45f9db20db984f393c2322228e78442601d2", + "loads": [ + 1, + 4, + 1, + 0, + 4, + 7, + 0, + 2, + 7, + 1, + 3, + 6, + 4, + 3, + 4, + 5, + 7, + 2, + 5, + 2, + 4, + 1, + 6, + 3, + 3, + 3, + 2, + 3, + 8, + 1, + 9, + 6, + 2, + 2, + 6, + 3, + 0, + 0, + 0, + 2, + 5, + 5, + 1, + 9, + 7, + 10, + 0, + 9, + 0, + 4, + 1, + 3, + 9, + 0, + 1, + 2, + 1, + 8, + 12, + 4, + 6, + 4, + 0, + 19 + ], + "weighted_loads": [ + 0.04978616535663605, + 0.15514086931943893, + 0.06301059573888779, + 0.0, + 0.17260276898741722, + 0.36830681562423706, + 0.0, + 0.10919792950153351, + 0.34949905052781105, + 0.029571935534477234, + 0.09210502915084362, + 0.2217241283506155, + 0.3852430433034897, + 0.24750874191522598, + 0.22750581428408623, + 0.1959196925163269, + 0.2827089559286833, + 0.08511297777295113, + 0.19262352399528027, + 0.09647660702466965, + 0.25484954193234444, + 0.08470640331506729, + 0.3061056509613991, + 0.2548164390027523, + 0.13832127675414085, + 0.11928099021315575, + 0.06737929210066795, + 0.09707711078226566, + 0.6408303193747997, + 0.038580965250730515, + 0.5289710108190775, + 0.3464207723736763, + 0.06613687053322792, + 0.07248221337795258, + 0.5545169822871685, + 0.09283210337162018, + 0.0, + 0.0, + 0.0, + 0.10489170253276825, + 0.1794272605329752, + 0.23029937595129013, + 0.051605161279439926, + 0.6336278636008501, + 0.41984081640839577, + 0.8612216152250767, + 0.0, + 0.46013665199279785, + 0.0, + 0.24670980870723724, + 0.057657018303871155, + 0.0977360513061285, + 0.37084718607366085, + 0.0, + 0.04255370423197746, + 0.08094285055994987, + 0.03295154124498367, + 0.5768477786332369, + 0.8525024987757206, + 0.14377238787710667, + 0.22382596880197525, + 0.1378819514065981, + 0.0, + 1.3138838969171047 + ], + "unique_experts": 55, + "load_cv": 0.8876124622232263, + "normalized_load_entropy": 0.906465153573279, + "max_load_share": 0.07539682539682539 + }, + "full_input": { + "tokens": 83, + "top_k": 6, + "decisions": 498, + "ordered_route_sha256": "df32b688d79fdc84cabbe6426b22b728d931d302510764695ac4b83e9b480cc5", + "route_weight_sha256": "673c43334880f758687c93b08f6b770d737bf03535949edb3166a003e5e55eb7", + "loads": [ + 3, + 5, + 2, + 0, + 16, + 13, + 0, + 4, + 17, + 1, + 6, + 8, + 4, + 3, + 5, + 8, + 25, + 3, + 15, + 3, + 5, + 2, + 8, + 7, + 3, + 4, + 4, + 6, + 20, + 1, + 18, + 12, + 3, + 2, + 12, + 8, + 0, + 0, + 0, + 3, + 9, + 5, + 1, + 36, + 9, + 10, + 1, + 23, + 0, + 8, + 1, + 4, + 9, + 5, + 20, + 9, + 7, + 9, + 14, + 8, + 8, + 12, + 10, + 21 + ], + "weighted_loads": [ + 0.1974133849143982, + 0.18866021931171417, + 0.10929802805185318, + 0.0, + 0.8192844688892365, + 0.5812145229429007, + 0.0, + 0.23804253339767456, + 0.9372276291251183, + 0.029571935534477234, + 0.20101851783692837, + 0.263495072722435, + 0.3852430433034897, + 0.24750874191522598, + 0.2660774812102318, + 0.30323174595832825, + 1.8946289252489805, + 0.09995830617845058, + 1.3678564000874758, + 0.13531285524368286, + 0.327753659337759, + 0.15505322813987732, + 0.41778891906142235, + 0.434451874345541, + 0.13832127675414085, + 0.16825110837817192, + 0.14513187110424042, + 0.1825322275981307, + 1.5378375388681889, + 0.038580965250730515, + 0.9798619374632835, + 0.6213228181004524, + 0.09981738403439522, + 0.07248221337795258, + 0.8431896604597569, + 0.5242036767303944, + 0.0, + 0.0, + 0.0, + 0.15156402066349983, + 0.3709656987339258, + 0.23029937595129013, + 0.051605161279439926, + 3.0039416905492544, + 0.5535606443881989, + 0.8612216152250767, + 0.04667087271809578, + 1.4519742392003536, + 0.0, + 0.5049349293112755, + 0.057657018303871155, + 0.1368676032871008, + 0.37084718607366085, + 0.30820222944021225, + 1.225820298306644, + 0.4164474494755268, + 0.5068276599049568, + 0.6196251828223467, + 0.9547394588589668, + 0.2968680690973997, + 0.30636369436979294, + 0.5256136916577816, + 0.5285643488168716, + 1.3897289633750916 + ], + "unique_experts": 58, + "load_cv": 0.9108501023245785, + "normalized_load_entropy": 0.906410043310263, + "max_load_share": 0.07228915662650602 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 42, + "ordered_topk_exact_tokens": 17, + "set_exact_tokens": 24, + "mean_set_jaccard": 0.8775510204081634, + "mean_token_weighted_tv": 0.018974156872857185, + "aggregate_load_tv": 0.047619047619047616 + }, + "system_bos": { + "tokens": 42, + "ordered_topk_exact_tokens": 22, + "set_exact_tokens": 28, + "mean_set_jaccard": 0.8996598639455784, + "mean_token_weighted_tv": 0.01805417953679959, + "aggregate_load_tv": 0.051587301587301584 + }, + "system_x": { + "tokens": 42, + "ordered_topk_exact_tokens": 18, + "set_exact_tokens": 26, + "mean_set_jaccard": 0.8809523809523809, + "mean_token_weighted_tv": 0.02297558258509352, + "aggregate_load_tv": 0.051587301587301584 + }, + "system_period": { + "tokens": 42, + "ordered_topk_exact_tokens": 17, + "set_exact_tokens": 22, + "mean_set_jaccard": 0.8639455782312927, + "mean_token_weighted_tv": 0.0244365625881723, + "aggregate_load_tv": 0.05952380952380952 + }, + "bos_at_s0": { + "tokens": 42, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 23, + "mean_set_jaccard": 0.8616780045351474, + "mean_token_weighted_tv": 0.026086240807282075, + "aggregate_load_tv": 0.051587301587301584 + }, + "bos_at_s1": { + "tokens": 42, + "ordered_topk_exact_tokens": 18, + "set_exact_tokens": 23, + "mean_set_jaccard": 0.8565759637188209, + "mean_token_weighted_tv": 0.026787194578597944, + "aggregate_load_tv": 0.06746031746031746 + }, + "x_at_s0": { + "tokens": 42, + "ordered_topk_exact_tokens": 17, + "set_exact_tokens": 21, + "mean_set_jaccard": 0.8429705215419501, + "mean_token_weighted_tv": 0.028970950992689246, + "aggregate_load_tv": 0.05952380952380952 + }, + "x_at_s1": { + "tokens": 42, + "ordered_topk_exact_tokens": 16, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.8151927437641724, + "mean_token_weighted_tv": 0.03468520682127703, + "aggregate_load_tv": 0.09126984126984125 + }, + "period_at_s0": { + "tokens": 42, + "ordered_topk_exact_tokens": 17, + "set_exact_tokens": 23, + "mean_set_jaccard": 0.8514739229024945, + "mean_token_weighted_tv": 0.02835482525240098, + "aggregate_load_tv": 0.06349206349206349 + }, + "period_at_s1": { + "tokens": 42, + "ordered_topk_exact_tokens": 17, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.8140589569160998, + "mean_token_weighted_tv": 0.033773872979162706, + "aggregate_load_tv": 0.0873015873015873 + } + } + }, + "layer_12": { + "layer": 12, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "c7da9a2a5f9c89c26a0ca4a072a65aac439631b0eee81d6676462953bd888bc9", + "route_weight_sha256": "65945200c18c7bd790b61cf2921a66834019c2541f5365830c4b94a964be4ea7", + "loads": [ + 3, + 0, + 6, + 3, + 4, + 1, + 6, + 8, + 10, + 1, + 3, + 1, + 5, + 0, + 3, + 4, + 9, + 0, + 5, + 6, + 1, + 0, + 4, + 3, + 1, + 0, + 0, + 6, + 11, + 7, + 0, + 6, + 9, + 7, + 1, + 1, + 0, + 3, + 9, + 0, + 0, + 9, + 4, + 5, + 1, + 1, + 4, + 9, + 7, + 6, + 2, + 1, + 4, + 2, + 5, + 0, + 2, + 5, + 16, + 5, + 1, + 9, + 4, + 3 + ], + "weighted_loads": [ + 0.1456960253417492, + 0.0, + 0.22430685721337795, + 0.13166575878858566, + 0.16585856676101685, + 0.03531677648425102, + 0.2384167853742838, + 0.5624010339379311, + 0.5671230033040047, + 0.03789437934756279, + 0.11178794130682945, + 0.031004570424556732, + 0.40553436055779457, + 0.0, + 0.12333894707262516, + 0.20534586906433105, + 0.480129674077034, + 0.0, + 0.3725040890276432, + 0.26440883055329323, + 0.036904800683259964, + 0.0, + 0.19929478131234646, + 0.2659558840095997, + 0.044783204793930054, + 0.0, + 0.0, + 0.4510234147310257, + 0.8362388834357262, + 0.9606192447245121, + 0.0, + 0.24674316309392452, + 0.7674868777394295, + 0.3754055127501488, + 0.06281380355358124, + 0.05119848623871803, + 0.0, + 0.14180677756667137, + 0.515902241691947, + 0.0, + 0.0, + 0.4340303856879473, + 0.17318394780158997, + 0.23092995956540108, + 0.032777175307273865, + 0.035602327436208725, + 0.2760763056576252, + 0.4184365179389715, + 0.33647559210658073, + 0.304503146559, + 0.3347969651222229, + 0.03684745356440544, + 0.22598763555288315, + 0.10736062005162239, + 0.45966917276382446, + 0.0, + 0.07890384271740913, + 0.20457319170236588, + 1.2257775459438562, + 0.2440970614552498, + 0.029840771108865738, + 0.5020188242197037, + 0.2870163023471832, + 0.1651901714503765 + ], + "unique_experts": 53, + "load_cv": 0.8669340828204047, + "normalized_load_entropy": 0.9013693142455514, + "max_load_share": 0.06349206349206349 + }, + "full_input": { + "tokens": 67, + "top_k": 6, + "decisions": 402, + "ordered_route_sha256": "3fef88060bb87084a5f3749a881eb97dff6d8ccbdf57f11ac059e11fecda057d", + "route_weight_sha256": "749a97dd973402b10ae5a53af858d6ea7e4da782f9b7703fb10ce87516904707", + "loads": [ + 3, + 0, + 6, + 8, + 8, + 2, + 6, + 11, + 16, + 1, + 3, + 1, + 11, + 0, + 3, + 4, + 13, + 0, + 5, + 6, + 2, + 0, + 5, + 8, + 1, + 0, + 1, + 13, + 26, + 17, + 3, + 11, + 10, + 9, + 1, + 8, + 0, + 9, + 22, + 0, + 0, + 14, + 8, + 5, + 3, + 2, + 5, + 15, + 10, + 6, + 3, + 1, + 4, + 2, + 5, + 0, + 5, + 5, + 19, + 8, + 1, + 13, + 8, + 7 + ], + "weighted_loads": [ + 0.1456960253417492, + 0.0, + 0.22430685721337795, + 0.2568697286769748, + 1.7887966968119144, + 0.039344345685094595, + 0.2384167853742838, + 0.7851147502660751, + 0.9629157446324825, + 0.03789437934756279, + 0.11178794130682945, + 0.031004570424556732, + 0.6933499872684479, + 0.0, + 0.12333894707262516, + 0.20534586906433105, + 0.6904025413095951, + 0.0, + 0.3725040890276432, + 0.26440883055329323, + 0.03921083570457995, + 0.0, + 0.24887542612850666, + 0.7216084562242031, + 0.044783204793930054, + 0.0, + 0.032737184315919876, + 0.8546030446887016, + 2.6712208054959774, + 2.38853807374835, + 0.1093466579914093, + 0.5099779535084963, + 0.8137354515492916, + 0.48318031802773476, + 0.06281380355358124, + 0.5502412356436253, + 0.0, + 0.331748079508543, + 1.5269265715032816, + 0.0, + 0.0, + 0.9621386397629976, + 0.4315815158188343, + 0.23092995956540108, + 0.15050753206014633, + 0.07527853548526764, + 0.31604553014039993, + 0.7472370434552431, + 0.4682753272354603, + 0.304503146559, + 0.3477413412183523, + 0.03684745356440544, + 0.22598763555288315, + 0.10736062005162239, + 0.45966917276382446, + 0.0, + 0.1819850099273026, + 0.20457319170236588, + 1.4658486638218164, + 0.33663608133792877, + 0.029840771108865738, + 0.6592230964452028, + 0.45139921084046364, + 0.2943098694086075 + ], + "unique_experts": 55, + "load_cv": 0.9160580751078896, + "normalized_load_entropy": 0.8979423862025832, + "max_load_share": 0.06467661691542288 + } + }, + "s1_eos": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "9a30b04578b554e3ea0099ce32519eb2d65a4106580173cc7e2807591883a42e", + "route_weight_sha256": "23ffaa092ded30d6504c49cf2e11726c61859f9ddb30f0ff9aae6f6487d95e06", + "loads": [ + 2, + 0, + 5, + 3, + 6, + 1, + 6, + 8, + 10, + 1, + 3, + 1, + 4, + 0, + 2, + 4, + 10, + 0, + 4, + 7, + 1, + 0, + 4, + 2, + 0, + 0, + 0, + 6, + 11, + 8, + 0, + 6, + 9, + 7, + 1, + 1, + 0, + 3, + 8, + 0, + 1, + 9, + 3, + 5, + 1, + 1, + 4, + 8, + 8, + 5, + 2, + 1, + 4, + 2, + 5, + 0, + 3, + 6, + 16, + 7, + 1, + 9, + 4, + 3 + ], + "weighted_loads": [ + 0.1122936625033617, + 0.0, + 0.19389168545603752, + 0.1307525709271431, + 0.23443621583282948, + 0.0353534072637558, + 0.24655339308083057, + 0.5546430237591267, + 0.5552705451846123, + 0.03274216875433922, + 0.11007552221417427, + 0.03086433745920658, + 0.35309254936873913, + 0.0, + 0.09187951311469078, + 0.21848046407103539, + 0.5177958253771067, + 0.0, + 0.33099861070513725, + 0.2940590903162956, + 0.03662081062793732, + 0.0, + 0.1993439607322216, + 0.23535845801234245, + 0.0, + 0.0, + 0.0, + 0.45971837267279625, + 0.8286740928888321, + 0.8732628468424082, + 0.0, + 0.24580147862434387, + 0.7520687691867352, + 0.37303194403648376, + 0.06128279119729996, + 0.05099409446120262, + 0.0, + 0.14212977141141891, + 0.45884986221790314, + 0.0, + 0.045528843998909, + 0.4370808694511652, + 0.14362122491002083, + 0.22309928946197033, + 0.03243893012404442, + 0.034949738532304764, + 0.2822071723639965, + 0.38488929718732834, + 0.38492114283144474, + 0.2628626115620136, + 0.32045159488916397, + 0.03712151572108269, + 0.2252688892185688, + 0.11038797535002232, + 0.4663798473775387, + 0.0, + 0.11360805481672287, + 0.23040996678173542, + 1.2375439926981926, + 0.30559092573821545, + 0.0295098964124918, + 0.5135167762637138, + 0.2905152328312397, + 0.17114708945155144 + ], + "unique_experts": 53, + "load_cv": 0.8819171036881969, + "normalized_load_entropy": 0.8986263496591974, + "max_load_share": 0.06349206349206349 + }, + "full_input": { + "tokens": 83, + "top_k": 6, + "decisions": 498, + "ordered_route_sha256": "5a583528a7a930426bffb8c8c0f86b6e7d1493ec22ea54c2d5d623c7a2854b77", + "route_weight_sha256": "ee4064e81bfe93c8a26e9ef56624608fbfdef82a718fd52b054675de46d23e3b", + "loads": [ + 6, + 0, + 5, + 6, + 10, + 2, + 6, + 15, + 16, + 4, + 4, + 1, + 8, + 0, + 2, + 4, + 15, + 2, + 5, + 7, + 2, + 2, + 7, + 8, + 0, + 0, + 3, + 13, + 28, + 24, + 11, + 10, + 13, + 12, + 6, + 8, + 0, + 9, + 25, + 0, + 2, + 20, + 9, + 7, + 14, + 5, + 7, + 16, + 15, + 5, + 4, + 1, + 4, + 5, + 5, + 1, + 6, + 11, + 19, + 11, + 3, + 17, + 9, + 3 + ], + "weighted_loads": [ + 0.3033879306167364, + 0.0, + 0.19389168545603752, + 0.18893732805736363, + 1.8579174671322107, + 0.039264658000320196, + 0.24655339308083057, + 0.952128492295742, + 1.0228841453790665, + 0.35159045830368996, + 0.15383192896842957, + 0.03086433745920658, + 0.5482535120099783, + 0.0, + 0.09187951311469078, + 0.21848046407103539, + 0.8327994626015425, + 0.11286119744181633, + 0.3670531362295151, + 0.2940590903162956, + 0.038933820091187954, + 0.089393500238657, + 0.3190632164478302, + 0.6980517953634262, + 0.0, + 0.0, + 0.12061893567442894, + 0.8202717155218124, + 2.9860217794775963, + 3.1638805102556944, + 0.8614486902952194, + 0.4687932226806879, + 0.9292394369840622, + 0.6807435527443886, + 0.31540412828326225, + 0.6200726293027401, + 0.0, + 0.38352351635694504, + 1.7726453840732574, + 0.0, + 0.07533795014023781, + 1.4528790730983019, + 0.49847155436873436, + 0.3315494451671839, + 1.2464658468961716, + 0.34228750318288803, + 0.4129062071442604, + 0.8136755209416151, + 0.7028241138905287, + 0.2628626115620136, + 0.38614861480891705, + 0.03712151572108269, + 0.2252688892185688, + 0.2685289364308119, + 0.4663798473775387, + 0.03179667517542839, + 0.19277461292222142, + 0.45364432223141193, + 1.4695351608097553, + 0.42519701225683093, + 0.0985516645014286, + 0.9164701886475086, + 0.5156044587492943, + 0.17114708945155144 + ], + "unique_experts": 58, + "load_cv": 0.832081606964351, + "normalized_load_entropy": 0.9163635675035453, + "max_load_share": 0.05622489959839357 + } + }, + "s0_bos": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "14ea2b38f51418c8e0ef2fa19025b439a744453ded03d692795e35fe100a7555", + "route_weight_sha256": "4e158831f0c2c3769b852d5d7ad59595a187939bdca0a6f8e97c7c42e7dd9d32", + "loads": [ + 3, + 0, + 6, + 3, + 3, + 1, + 5, + 8, + 10, + 1, + 4, + 1, + 5, + 0, + 2, + 4, + 9, + 0, + 5, + 6, + 1, + 0, + 5, + 3, + 1, + 1, + 0, + 8, + 10, + 8, + 0, + 4, + 9, + 7, + 1, + 1, + 0, + 3, + 8, + 0, + 0, + 10, + 4, + 6, + 1, + 1, + 4, + 9, + 7, + 4, + 2, + 1, + 4, + 1, + 5, + 0, + 3, + 4, + 16, + 6, + 1, + 10, + 4, + 3 + ], + "weighted_loads": [ + 0.15417913161218166, + 0.0, + 0.22598030418157578, + 0.13273511081933975, + 0.14502396807074547, + 0.035353098064661026, + 0.2149888165295124, + 0.5445850230753422, + 0.5285844281315804, + 0.03583962470293045, + 0.13234174065291882, + 0.03158518671989441, + 0.4741092845797539, + 0.0, + 0.09627320617437363, + 0.21649427711963654, + 0.5177137181162834, + 0.0, + 0.3815953992307186, + 0.2670680545270443, + 0.0393180251121521, + 0.0, + 0.23591201938688755, + 0.26140739396214485, + 0.05583552271127701, + 0.03467553108930588, + 0.0, + 0.527532197535038, + 0.7295824848115444, + 1.0154442675411701, + 0.0, + 0.1902726273983717, + 0.7853389084339142, + 0.3661028519272804, + 0.06397344917058945, + 0.05065527930855751, + 0.0, + 0.14065535366535187, + 0.43260418251156807, + 0.0, + 0.0, + 0.52165687084198, + 0.1719515472650528, + 0.26184989139437675, + 0.03379639983177185, + 0.03800136595964432, + 0.2843623161315918, + 0.41437056101858616, + 0.35241540893912315, + 0.2366773672401905, + 0.3445858657360077, + 0.036841824650764465, + 0.2310769185423851, + 0.07980220019817352, + 0.46339667215943336, + 0.0, + 0.12153314612805843, + 0.17823268473148346, + 1.2008073050528765, + 0.2628731094300747, + 0.030389225110411644, + 0.5338448956608772, + 0.29652174562215805, + 0.15957100316882133 + ], + "unique_experts": 54, + "load_cv": 0.873881244984178, + "normalized_load_entropy": 0.901544284440542, + "max_load_share": 0.06349206349206349 + }, + "full_input": { + "tokens": 67, + "top_k": 6, + "decisions": 402, + "ordered_route_sha256": "b75a30bfca10d92dd3b45915c8938b969c61a9b436635d09b0eb46cad0729a1f", + "route_weight_sha256": "b03c8039f68ac6317af0a5b8134aa1cf0b6fd9f865c35ee94998cb2746a712ce", + "loads": [ + 4, + 0, + 6, + 7, + 6, + 1, + 5, + 11, + 16, + 1, + 4, + 1, + 12, + 0, + 2, + 4, + 14, + 0, + 5, + 6, + 1, + 0, + 6, + 9, + 1, + 1, + 2, + 15, + 26, + 19, + 2, + 10, + 10, + 9, + 1, + 8, + 0, + 9, + 21, + 0, + 0, + 15, + 7, + 6, + 3, + 2, + 4, + 14, + 11, + 4, + 3, + 1, + 4, + 1, + 5, + 0, + 5, + 5, + 19, + 9, + 1, + 14, + 7, + 7 + ], + "weighted_loads": [ + 0.2089041043072939, + 0.0, + 0.22598030418157578, + 0.25485781114548445, + 0.8172498941421509, + 0.035353098064661026, + 0.2149888165295124, + 0.7688552401959896, + 0.9686459712684155, + 0.03583962470293045, + 0.13234174065291882, + 0.03158518671989441, + 0.8516665957868099, + 0.0, + 0.09627320617437363, + 0.21649427711963654, + 0.7299626208841801, + 0.0, + 0.3815953992307186, + 0.2670680545270443, + 0.0393180251121521, + 0.0, + 0.28549266420304775, + 0.7625039108097553, + 0.05583552271127701, + 0.03467553108930588, + 0.07526382058858871, + 0.9311118274927139, + 2.58207325078547, + 2.605705600231886, + 0.06332514062523842, + 0.5204614493995905, + 0.8315874822437763, + 0.46076934039592743, + 0.06397344917058945, + 0.5496980287134647, + 0.0, + 0.3183862157166004, + 1.4655674807727337, + 0.0, + 0.0, + 0.9935799837112427, + 0.3861078545451164, + 0.26184989139437675, + 0.1428167261183262, + 0.07767757400870323, + 0.2843623161315918, + 0.6778726521879435, + 0.5270434468984604, + 0.2366773672401905, + 0.3575302418321371, + 0.036841824650764465, + 0.2310769185423851, + 0.07980220019817352, + 0.46339667215943336, + 0.0, + 0.22005321644246578, + 0.2095549814403057, + 1.4357940051704645, + 0.4070624280720949, + 0.030389225110411644, + 0.6910491678863764, + 0.4149089902639389, + 0.2886907011270523 + ], + "unique_experts": 56, + "load_cv": 0.938269415626235, + "normalized_load_entropy": 0.8944196158433965, + "max_load_share": 0.06467661691542288 + } + }, + "s1_bos": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "546450100a547cc21a2f38a38fc78ac304c07980987d973d1ce2a4d25b1789c1", + "route_weight_sha256": "eb3745cb337ea63e98459153fbe2cb5e2ae247550eac07f492911eb5e02e578e", + "loads": [ + 3, + 0, + 5, + 2, + 4, + 2, + 3, + 8, + 10, + 1, + 4, + 1, + 6, + 0, + 2, + 4, + 9, + 0, + 5, + 5, + 1, + 0, + 5, + 3, + 1, + 1, + 1, + 8, + 11, + 8, + 0, + 5, + 9, + 7, + 1, + 1, + 0, + 3, + 8, + 0, + 1, + 10, + 4, + 4, + 1, + 1, + 4, + 8, + 8, + 5, + 2, + 1, + 4, + 1, + 5, + 1, + 4, + 3, + 17, + 4, + 0, + 10, + 4, + 3 + ], + "weighted_loads": [ + 0.15653803013265133, + 0.0, + 0.20042448863387108, + 0.09544795751571655, + 0.1728673242032528, + 0.06555934250354767, + 0.14950859546661377, + 0.5475149005651474, + 0.5301022306084633, + 0.0421401783823967, + 0.1350606232881546, + 0.03441489115357399, + 0.5255063436925411, + 0.0, + 0.0831143781542778, + 0.21381957456469536, + 0.4946261905133724, + 0.0, + 0.3803471624851227, + 0.2401205711066723, + 0.03760892152786255, + 0.0, + 0.23481007106602192, + 0.2519634999334812, + 0.047748856246471405, + 0.03272609785199165, + 0.032384805381298065, + 0.5282872021198273, + 0.8045137487351894, + 0.9611655101180077, + 0.0, + 0.2252537626773119, + 0.7636713460087776, + 0.36345410346984863, + 0.06148529797792435, + 0.05148519203066826, + 0.0, + 0.140834741294384, + 0.39646001160144806, + 0.0, + 0.032072365283966064, + 0.5573679599910975, + 0.1798099260777235, + 0.1864633746445179, + 0.032944295555353165, + 0.035454027354717255, + 0.2881227135658264, + 0.3626904506236315, + 0.3880013972520828, + 0.26506789959967136, + 0.32966868579387665, + 0.03724156692624092, + 0.2288902960717678, + 0.0798012763261795, + 0.46050745993852615, + 0.035470377653837204, + 0.15305827744305134, + 0.1342247724533081, + 1.2546373419463634, + 0.2106841318309307, + 0.0, + 0.5457971505820751, + 0.29684700444340706, + 0.16030709818005562 + ], + "unique_experts": 56, + "load_cv": 0.8796286350792006, + "normalized_load_entropy": 0.9054625422952128, + "max_load_share": 0.06746031746031746 + }, + "full_input": { + "tokens": 83, + "top_k": 6, + "decisions": 498, + "ordered_route_sha256": "8045eef791d951321b7da6d6d32509b6e4e23aab16a64e94bb7f24a7337deb78", + "route_weight_sha256": "9fa2820f05dd713486b49a2093fb1e1ed575877762a0e9e82d86bc8c8de0116d", + "loads": [ + 7, + 0, + 5, + 4, + 7, + 2, + 3, + 15, + 16, + 4, + 5, + 1, + 11, + 0, + 2, + 4, + 16, + 2, + 6, + 5, + 1, + 2, + 8, + 9, + 1, + 1, + 4, + 15, + 28, + 26, + 11, + 10, + 13, + 12, + 6, + 8, + 0, + 7, + 25, + 0, + 2, + 21, + 9, + 7, + 15, + 5, + 6, + 16, + 16, + 5, + 4, + 1, + 4, + 4, + 5, + 2, + 5, + 9, + 20, + 8, + 2, + 18, + 9, + 3 + ], + "weighted_loads": [ + 0.34763229824602604, + 0.0, + 0.20042448863387108, + 0.1507140537723899, + 0.8456857241690159, + 0.06555934250354767, + 0.14950859546661377, + 0.9504205696284771, + 1.0449111349880695, + 0.36098846793174744, + 0.1788170300424099, + 0.03441489115357399, + 0.8551647141575813, + 0.0, + 0.0831143781542778, + 0.21381957456469536, + 0.8784838281571865, + 0.11286119744181633, + 0.4164016880095005, + 0.2401205711066723, + 0.03760892152786255, + 0.089393500238657, + 0.3545293267816305, + 0.714656837284565, + 0.047748856246471405, + 0.03272609785199165, + 0.153003741055727, + 0.8888405449688435, + 3.0809044800698757, + 3.500756025314331, + 0.8614486902952194, + 0.5065980181097984, + 0.9408420138061047, + 0.6638273671269417, + 0.31560663506388664, + 0.6205637268722057, + 0.0, + 0.31274160742759705, + 1.8160628378391266, + 0.0, + 0.061881471425294876, + 1.565475219860673, + 0.4910669457167387, + 0.3274441063404083, + 1.2715867310762405, + 0.3427917920053005, + 0.3765845187008381, + 0.7857026252895594, + 0.7422624677419662, + 0.26506789959967136, + 0.3953657057136297, + 0.03724156692624092, + 0.2288902960717678, + 0.23794223740696907, + 0.46050745993852615, + 0.0672670528292656, + 0.18082216940820217, + 0.39106715843081474, + 1.4866448603570461, + 0.36076063476502895, + 0.0690417680889368, + 0.9487505629658699, + 0.5219362303614616, + 0.16030709818005562 + ], + "unique_experts": 60, + "load_cv": 0.8631362075807559, + "normalized_load_entropy": 0.9140359331393991, + "max_load_share": 0.05622489959839357 + } + }, + "s0_x": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "384bd74c1ebff0f4da5aa3628f9e1f3ef63b8999455d905eaeabad316e747e67", + "route_weight_sha256": "374aa92e1d75f7afa5ca0144df77aa64f0f229c2dd33059694ec70dc176cacba", + "loads": [ + 3, + 0, + 6, + 2, + 4, + 2, + 5, + 9, + 10, + 1, + 4, + 1, + 4, + 0, + 2, + 5, + 9, + 0, + 5, + 4, + 1, + 0, + 5, + 3, + 1, + 1, + 0, + 8, + 11, + 8, + 0, + 4, + 9, + 6, + 1, + 1, + 0, + 2, + 9, + 0, + 1, + 9, + 5, + 6, + 1, + 1, + 4, + 9, + 9, + 5, + 2, + 0, + 4, + 1, + 5, + 0, + 1, + 3, + 17, + 6, + 1, + 9, + 4, + 3 + ], + "weighted_loads": [ + 0.15154807828366756, + 0.0, + 0.2284050416201353, + 0.09015211462974548, + 0.1743017639964819, + 0.06774252653121948, + 0.21039351634681225, + 0.6072906292974949, + 0.5352563485503197, + 0.040045611560344696, + 0.14248840883374214, + 0.03025509975850582, + 0.3802257664501667, + 0.0, + 0.09593300148844719, + 0.24785961583256721, + 0.48441196978092194, + 0.0, + 0.4034956023097038, + 0.18616236746311188, + 0.03662409633398056, + 0.0, + 0.23430910892784595, + 0.26085637137293816, + 0.058461371809244156, + 0.035008203238248825, + 0.0, + 0.541685439646244, + 0.8258150666952133, + 0.8581179082393646, + 0.0, + 0.18088586069643497, + 0.7671343348920345, + 0.3252272307872772, + 0.06405776739120483, + 0.05129131302237511, + 0.0, + 0.10485421493649483, + 0.44422524608671665, + 0.0, + 0.03201061487197876, + 0.48286255449056625, + 0.20744582079350948, + 0.2789398469030857, + 0.033169250935316086, + 0.038544345647096634, + 0.2919766567647457, + 0.4017560388892889, + 0.43698699586093426, + 0.2626648098230362, + 0.3389587849378586, + 0.0, + 0.23450421914458275, + 0.08120820671319962, + 0.475793682038784, + 0.0, + 0.06525018066167831, + 0.14652172476053238, + 1.2660845406353474, + 0.2693343386054039, + 0.029700137674808502, + 0.5103327110409737, + 0.28989143669605255, + 0.15636447444558144 + ], + "unique_experts": 54, + "load_cv": 0.9033684619131552, + "normalized_load_entropy": 0.8974562898253794, + "max_load_share": 0.06746031746031746 + }, + "full_input": { + "tokens": 67, + "top_k": 6, + "decisions": 402, + "ordered_route_sha256": "1ca575f6b0e1154f8e126a70a782d094b5ca15dc57fc249ff5531820786d7d6a", + "route_weight_sha256": "922bf6bb6144d3e05f3d8a672391e981cd8a892a414e651d20cc15b4e9a2fd82", + "loads": [ + 3, + 0, + 6, + 6, + 7, + 2, + 5, + 12, + 16, + 1, + 4, + 1, + 10, + 0, + 2, + 5, + 11, + 0, + 5, + 4, + 1, + 0, + 6, + 10, + 1, + 1, + 1, + 16, + 29, + 19, + 3, + 9, + 10, + 8, + 1, + 9, + 0, + 6, + 23, + 0, + 1, + 14, + 10, + 6, + 3, + 3, + 4, + 14, + 13, + 5, + 3, + 0, + 4, + 1, + 5, + 0, + 3, + 3, + 20, + 8, + 1, + 14, + 7, + 7 + ], + "weighted_loads": [ + 0.15154807828366756, + 0.0, + 0.2284050416201353, + 0.21227481495589018, + 0.8465276900678873, + 0.06774252653121948, + 0.21039351634681225, + 0.8391075022518635, + 0.9320457056164742, + 0.040045611560344696, + 0.14248840883374214, + 0.03025509975850582, + 0.6639102883636951, + 0.0, + 0.09593300148844719, + 0.24785961583256721, + 0.5827698111534119, + 0.0, + 0.4034956023097038, + 0.18616236746311188, + 0.03662409633398056, + 0.0, + 0.28388975374400616, + 0.9066064916551113, + 0.058461371809244156, + 0.035008203238248825, + 0.032737184315919876, + 1.0023350268602371, + 2.9804318100214005, + 2.1875960491597652, + 0.11642218381166458, + 0.4527751673012972, + 0.8133829087018967, + 0.41124172508716583, + 0.06405776739120483, + 0.6253238953649998, + 0.0, + 0.21833386272192, + 1.3741550389677286, + 0.0, + 0.03201061487197876, + 0.9800576791167259, + 0.5019547063857317, + 0.2789398469030857, + 0.1500176079571247, + 0.13003088533878326, + 0.2919766567647457, + 0.6458361949771643, + 0.6135649774223566, + 0.2626648098230362, + 0.351903161033988, + 0.0, + 0.23450421914458275, + 0.08120820671319962, + 0.475793682038784, + 0.0, + 0.16377025097608566, + 0.14652172476053238, + 1.489226896315813, + 0.3534399699419737, + 0.029700137674808502, + 0.7386951986700296, + 0.4082786813378334, + 0.2854841724038124 + ], + "unique_experts": 56, + "load_cv": 0.9803772619522932, + "normalized_load_entropy": 0.8900459300925359, + "max_load_share": 0.07213930348258707 + } + }, + "s1_x": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "3593b7e356e38fae6a0826ce6ba48fca24bf207ea25174cce63c6d19c7a58c4f", + "route_weight_sha256": "f7bf2c44a3c3bf0fa0d8557a7cb594a4200d7a80f422b40617b9d6e74981f677", + "loads": [ + 1, + 0, + 5, + 2, + 4, + 2, + 4, + 9, + 10, + 1, + 4, + 1, + 4, + 0, + 2, + 5, + 9, + 0, + 5, + 5, + 1, + 0, + 5, + 3, + 1, + 1, + 1, + 8, + 10, + 8, + 1, + 3, + 9, + 6, + 1, + 1, + 0, + 2, + 9, + 0, + 1, + 9, + 4, + 6, + 1, + 1, + 4, + 7, + 8, + 4, + 2, + 0, + 5, + 1, + 6, + 0, + 4, + 4, + 20, + 6, + 0, + 10, + 3, + 3 + ], + "weighted_loads": [ + 0.08657044172286987, + 0.0, + 0.202845960855484, + 0.0923854373395443, + 0.1652279496192932, + 0.06767873838543892, + 0.18294762820005417, + 0.6436048783361912, + 0.5212132185697556, + 0.040142904967069626, + 0.13502082787454128, + 0.03330783545970917, + 0.38373667374253273, + 0.0, + 0.08520401269197464, + 0.2542593665421009, + 0.4467041827738285, + 0.0, + 0.3870222643017769, + 0.21447152271866798, + 0.035448551177978516, + 0.0, + 0.24613412469625473, + 0.2556758429855108, + 0.04935554787516594, + 0.03330551087856293, + 0.03378846123814583, + 0.5564401298761368, + 0.8469797372817993, + 0.7472852896898985, + 0.0372031070291996, + 0.15168888121843338, + 0.7207384034991264, + 0.3279922902584076, + 0.06328623741865158, + 0.0511789508163929, + 0.0, + 0.11467734351754189, + 0.4141575749963522, + 0.0, + 0.03168991953134537, + 0.46572759561240673, + 0.19164336659014225, + 0.2707474157214165, + 0.031086552888154984, + 0.03748828172683716, + 0.3103406950831413, + 0.34011175110936165, + 0.4170603845268488, + 0.2227426841855049, + 0.3161862939596176, + 0.0, + 0.27294235676527023, + 0.08048217743635178, + 0.5081136599183083, + 0.0, + 0.14642084389925003, + 0.17030411213636398, + 1.4516111798584461, + 0.26210292987525463, + 0.0, + 0.5534717999398708, + 0.2513641491532326, + 0.15269279852509499 + ], + "unique_experts": 55, + "load_cv": 0.9319231328943299, + "normalized_load_entropy": 0.8975949296201859, + "max_load_share": 0.07936507936507936 + }, + "full_input": { + "tokens": 83, + "top_k": 6, + "decisions": 498, + "ordered_route_sha256": "1460b0ac5c2c7b9579d192e839e77954a5f1559866fd3d562b21a4c7da2efc53", + "route_weight_sha256": "6031f1acc8b5a6cfbae860472cd2fa96660a9be3f6849b0ca7fc2bce72536731", + "loads": [ + 5, + 0, + 5, + 4, + 7, + 2, + 4, + 16, + 16, + 4, + 5, + 1, + 8, + 0, + 2, + 5, + 13, + 2, + 6, + 5, + 1, + 3, + 8, + 10, + 1, + 2, + 4, + 16, + 29, + 23, + 13, + 7, + 13, + 11, + 6, + 9, + 0, + 6, + 25, + 0, + 2, + 20, + 12, + 9, + 14, + 6, + 7, + 13, + 14, + 4, + 4, + 0, + 5, + 4, + 6, + 1, + 5, + 11, + 23, + 9, + 2, + 19, + 8, + 3 + ], + "weighted_loads": [ + 0.2776647098362446, + 0.0, + 0.202845960855484, + 0.14765153359621763, + 0.8380463495850563, + 0.06767873838543892, + 0.18294762820005417, + 1.048287458717823, + 0.9747593440115452, + 0.35899119451642036, + 0.17877723462879658, + 0.03330783545970917, + 0.562441173940897, + 0.0, + 0.08520401269197464, + 0.2542593665421009, + 0.6915337145328522, + 0.11286119744181633, + 0.4230767898261547, + 0.21447152271866798, + 0.035448551177978516, + 0.12607085332274437, + 0.3658533804118633, + 0.8487803135067225, + 0.04935554787516594, + 0.06481138616800308, + 0.15440739691257477, + 0.9924233444035053, + 3.32191626355052, + 2.7008752021938562, + 0.9389689452946186, + 0.39027986861765385, + 0.8979090712964535, + 0.6108497455716133, + 0.3174075745046139, + 0.7195220999419689, + 0.0, + 0.28658420965075493, + 1.5514742527157068, + 0.0, + 0.06149902567267418, + 1.4897221829742193, + 0.6454617213457823, + 0.4095596894621849, + 1.233395241200924, + 0.3874276541173458, + 0.44728803634643555, + 0.6335059441626072, + 0.6875287089496851, + 0.2227426841855049, + 0.3818833138793707, + 0.0, + 0.27294235676527023, + 0.23862313851714134, + 0.5081136599183083, + 0.03179667517542839, + 0.17418473586440086, + 0.4791347198188305, + 1.6935010887682438, + 0.37391817197203636, + 0.0690417680889368, + 1.0098475888371468, + 0.47645337507128716, + 0.15269279852509499 + ], + "unique_experts": 59, + "load_cv": 0.8541197173727897, + "normalized_load_entropy": 0.914868267221342, + "max_load_share": 0.05823293172690763 + } + }, + "s0_period": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "9662f476e563db9182f18d4c3d6ba8dfd9e1fffce9a9d905dc95d156b41b184e", + "route_weight_sha256": "aa5d53b7d31ac3ec554e2326f8f1032099acf0480d515b21ed669dc16dc91a7a", + "loads": [ + 3, + 0, + 6, + 2, + 4, + 1, + 3, + 9, + 11, + 1, + 4, + 1, + 4, + 0, + 2, + 5, + 9, + 0, + 5, + 5, + 1, + 0, + 5, + 3, + 1, + 1, + 0, + 8, + 11, + 8, + 0, + 3, + 9, + 6, + 1, + 1, + 0, + 3, + 9, + 0, + 0, + 9, + 5, + 6, + 1, + 1, + 4, + 9, + 8, + 6, + 2, + 0, + 4, + 1, + 5, + 0, + 1, + 3, + 18, + 5, + 1, + 10, + 4, + 4 + ], + "weighted_loads": [ + 0.1548782866448164, + 0.0, + 0.22923477366566658, + 0.09046938270330429, + 0.17382107488811016, + 0.03503086417913437, + 0.14423441886901855, + 0.6335706822574139, + 0.5795902013778687, + 0.03861053287982941, + 0.14329657889902592, + 0.030113745480775833, + 0.37860599532723427, + 0.0, + 0.0929324459284544, + 0.2535760998725891, + 0.4737499989569187, + 0.0, + 0.3916511610150337, + 0.22128232941031456, + 0.036128461360931396, + 0.0, + 0.23826218210160732, + 0.26074998266994953, + 0.05726882442831993, + 0.034437596797943115, + 0.0, + 0.5382503010332584, + 0.846819918602705, + 0.8853452317416668, + 0.0, + 0.1486194059252739, + 0.787658516317606, + 0.3239649683237076, + 0.06581094861030579, + 0.05173257738351822, + 0.0, + 0.14210109040141106, + 0.4743401352316141, + 0.0, + 0.0, + 0.4788852408528328, + 0.20308920741081238, + 0.2770405225455761, + 0.032256145030260086, + 0.038396112620830536, + 0.2905764728784561, + 0.39902560971677303, + 0.3882692363113165, + 0.2853473052382469, + 0.34416673332452774, + 0.0, + 0.23542028665542603, + 0.08160499483346939, + 0.47048062831163406, + 0.0, + 0.05450883507728577, + 0.14643409103155136, + 1.3290538638830185, + 0.23018662631511688, + 0.02986193634569645, + 0.542437233030796, + 0.2904141917824745, + 0.1939127966761589 + ], + "unique_experts": 53, + "load_cv": 0.9319231328943299, + "normalized_load_entropy": 0.8921145871083943, + "max_load_share": 0.07142857142857142 + }, + "full_input": { + "tokens": 67, + "top_k": 6, + "decisions": 402, + "ordered_route_sha256": "ae2d2d492ad21f9ca72ed4aa58eeb7148abdf2d90dab16670e1de81d86e1f9b5", + "route_weight_sha256": "f383fd9bda26215bc168301ffdee551cf4a8e5e5932135dcea206a81f28f9bc7", + "loads": [ + 3, + 0, + 6, + 6, + 7, + 1, + 3, + 12, + 17, + 1, + 4, + 1, + 10, + 0, + 2, + 5, + 13, + 0, + 5, + 5, + 1, + 0, + 6, + 10, + 1, + 1, + 1, + 16, + 28, + 18, + 2, + 8, + 10, + 8, + 1, + 9, + 0, + 8, + 21, + 0, + 0, + 15, + 10, + 6, + 3, + 2, + 4, + 15, + 11, + 6, + 3, + 0, + 4, + 1, + 5, + 0, + 3, + 4, + 21, + 7, + 1, + 15, + 8, + 8 + ], + "weighted_loads": [ + 0.1548782866448164, + 0.0, + 0.22923477366566658, + 0.21259208302944899, + 0.8460470009595156, + 0.03503086417913437, + 0.14423441886901855, + 0.868228230625391, + 0.9764937087893486, + 0.03861053287982941, + 0.14329657889902592, + 0.030113745480775833, + 0.6852317340672016, + 0.0, + 0.0929324459284544, + 0.2535760998725891, + 0.6605067402124405, + 0.0, + 0.3916511610150337, + 0.22128232941031456, + 0.036128461360931396, + 0.0, + 0.2878428269177675, + 0.8182140346616507, + 0.05726882442831993, + 0.034437596797943115, + 0.032737184315919876, + 0.9801639840006828, + 3.026395309716463, + 2.211341116577387, + 0.06332514062523842, + 0.41761522740125656, + 0.8339070901274681, + 0.4090214669704437, + 0.06581094861030579, + 0.5998827032744884, + 0.0, + 0.29055798053741455, + 1.3421392682939768, + 0.0, + 0.0, + 1.0639435425400734, + 0.4929097257554531, + 0.2770405225455761, + 0.15504994615912437, + 0.07807232066988945, + 0.2905764728784561, + 0.6737524513155222, + 0.5256313513964415, + 0.2853473052382469, + 0.35711110942065716, + 0.0, + 0.23542028665542603, + 0.08160499483346939, + 0.47048062831163406, + 0.0, + 0.15302890539169312, + 0.17810355871915817, + 1.5504484064877033, + 0.31429225765168667, + 0.02986193634569645, + 0.7519513461738825, + 0.4591616094112396, + 0.3230324946343899 + ], + "unique_experts": 55, + "load_cv": 0.9807811352975548, + "normalized_load_entropy": 0.8866640169374082, + "max_load_share": 0.06965174129353234 + } + }, + "s1_period": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "b5456366e1f4107c27f0614439ac902e74dc0498353f49b6a6eee68d1494d8a1", + "route_weight_sha256": "23734adb27bae849e0a1b4858562c05e2a1498b1cfeb57742d30f330c1e24d2d", + "loads": [ + 3, + 0, + 6, + 2, + 3, + 2, + 5, + 9, + 10, + 1, + 4, + 1, + 5, + 0, + 2, + 5, + 9, + 0, + 5, + 5, + 1, + 0, + 5, + 3, + 1, + 1, + 1, + 8, + 11, + 8, + 0, + 3, + 9, + 6, + 1, + 1, + 0, + 2, + 8, + 0, + 0, + 9, + 5, + 4, + 1, + 1, + 4, + 7, + 8, + 5, + 2, + 0, + 5, + 1, + 6, + 1, + 2, + 5, + 19, + 5, + 0, + 10, + 3, + 3 + ], + "weighted_loads": [ + 0.14795436523854733, + 0.0, + 0.2318357639014721, + 0.09169908985495567, + 0.14533474668860435, + 0.06810091808438301, + 0.21201381459832191, + 0.6324795410037041, + 0.5250019244849682, + 0.03164172172546387, + 0.13239578157663345, + 0.03339754045009613, + 0.41092177480459213, + 0.0, + 0.08443555049598217, + 0.25119052082300186, + 0.4376675821840763, + 0.0, + 0.3821748234331608, + 0.22041002288460732, + 0.03482693433761597, + 0.0, + 0.2436385117471218, + 0.25618013739585876, + 0.04694514349102974, + 0.03302852809429169, + 0.035329047590494156, + 0.5563747882843018, + 0.9043775089085102, + 0.6988316737115383, + 0.0, + 0.15211637318134308, + 0.7536908015608788, + 0.3210257776081562, + 0.062108345329761505, + 0.051253791898489, + 0.0, + 0.11551938578486443, + 0.39393461868166924, + 0.0, + 0.0, + 0.48806384578347206, + 0.2165256328880787, + 0.19502738863229752, + 0.031332362443208694, + 0.03778202459216118, + 0.3047081157565117, + 0.3419383615255356, + 0.3662151210010052, + 0.2490519993007183, + 0.31998660415410995, + 0.0, + 0.2671157605946064, + 0.08084253966808319, + 0.508650129660964, + 0.03493800386786461, + 0.08570582419633865, + 0.1976237390190363, + 1.4552526287734509, + 0.22416475787758827, + 0.0, + 0.5537514239549637, + 0.24942484498023987, + 0.15575798228383064 + ], + "unique_experts": 54, + "load_cv": 0.9199504844979112, + "normalized_load_entropy": 0.8971813019263892, + "max_load_share": 0.07539682539682539 + }, + "full_input": { + "tokens": 83, + "top_k": 6, + "decisions": 498, + "ordered_route_sha256": "ed19034d88440183b825055d89821052c319a35e2d73e370a76d7fe22773fbe0", + "route_weight_sha256": "f23ce0a4ecc9b513e0c9ef8c59437c347621f63cb9b3fca77677efc5225efba7", + "loads": [ + 7, + 0, + 6, + 4, + 6, + 2, + 5, + 16, + 16, + 4, + 5, + 1, + 8, + 0, + 2, + 5, + 13, + 2, + 6, + 5, + 1, + 2, + 8, + 10, + 1, + 1, + 4, + 16, + 30, + 23, + 11, + 7, + 13, + 11, + 6, + 9, + 0, + 6, + 26, + 0, + 1, + 21, + 13, + 6, + 14, + 5, + 7, + 14, + 15, + 5, + 4, + 0, + 5, + 4, + 6, + 2, + 3, + 12, + 22, + 8, + 2, + 19, + 9, + 3 + ], + "weighted_loads": [ + 0.33904863335192204, + 0.0, + 0.2318357639014721, + 0.146965186111629, + 0.8181531466543674, + 0.06810091808438301, + 0.21201381459832191, + 1.0379469506442547, + 0.9916633330285549, + 0.3504900112748146, + 0.17615218833088875, + 0.03339754045009613, + 0.5354257486760616, + 0.0, + 0.08443555049598217, + 0.25119052082300186, + 0.6833866871893406, + 0.11286119744181633, + 0.4182293489575386, + 0.22041002288460732, + 0.03482693433761597, + 0.089393500238657, + 0.3633577674627304, + 0.7717825770378113, + 0.04694514349102974, + 0.03302852809429169, + 0.1559479832649231, + 0.9468998797237873, + 3.422258600592613, + 2.70296236500144, + 0.8614486902952194, + 0.3931212816387415, + 0.9308614693582058, + 0.6083374992012978, + 0.3162296824157238, + 0.6778722815215588, + 0.0, + 0.28742625191807747, + 1.6218326557427645, + 0.0, + 0.02980910614132881, + 1.6234598867595196, + 0.6859030798077583, + 0.30347754433751106, + 1.2433635517954826, + 0.34511978924274445, + 0.4393346309661865, + 0.6748760677874088, + 0.6734360083937645, + 0.2490519993007183, + 0.38568362407386303, + 0.0, + 0.2671157605946064, + 0.23898350074887276, + 0.508650129660964, + 0.066734679043293, + 0.11346971616148949, + 0.49973454512655735, + 1.6720129363238811, + 0.33597999997437, + 0.0690417680889368, + 1.0130841210484505, + 0.509403757750988, + 0.15575798228383064 + ], + "unique_experts": 59, + "load_cv": 0.8723553489126641, + "normalized_load_entropy": 0.9117578792922459, + "max_load_share": 0.060240963855421686 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 42, + "ordered_topk_exact_tokens": 23, + "set_exact_tokens": 29, + "mean_set_jaccard": 0.9013605442176872, + "mean_token_weighted_tv": 0.019729046084518944, + "aggregate_load_tv": 0.04365079365079365 + }, + "system_bos": { + "tokens": 42, + "ordered_topk_exact_tokens": 27, + "set_exact_tokens": 31, + "mean_set_jaccard": 0.9149659863945578, + "mean_token_weighted_tv": 0.018414275942458994, + "aggregate_load_tv": 0.047619047619047616 + }, + "system_x": { + "tokens": 42, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 27, + "mean_set_jaccard": 0.8877551020408164, + "mean_token_weighted_tv": 0.02589564116316892, + "aggregate_load_tv": 0.051587301587301584 + }, + "system_period": { + "tokens": 42, + "ordered_topk_exact_tokens": 18, + "set_exact_tokens": 28, + "mean_set_jaccard": 0.8996598639455782, + "mean_token_weighted_tv": 0.025064041882398583, + "aggregate_load_tv": 0.047619047619047616 + }, + "bos_at_s0": { + "tokens": 42, + "ordered_topk_exact_tokens": 17, + "set_exact_tokens": 25, + "mean_set_jaccard": 0.8639455782312925, + "mean_token_weighted_tv": 0.029360692571139053, + "aggregate_load_tv": 0.04365079365079365 + }, + "bos_at_s1": { + "tokens": 42, + "ordered_topk_exact_tokens": 16, + "set_exact_tokens": 23, + "mean_set_jaccard": 0.8452380952380952, + "mean_token_weighted_tv": 0.03261930983336199, + "aggregate_load_tv": 0.07539682539682539 + }, + "x_at_s0": { + "tokens": 42, + "ordered_topk_exact_tokens": 17, + "set_exact_tokens": 24, + "mean_set_jaccard": 0.8571428571428571, + "mean_token_weighted_tv": 0.030935583769210746, + "aggregate_load_tv": 0.06349206349206349 + }, + "x_at_s1": { + "tokens": 42, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.8038548752834468, + "mean_token_weighted_tv": 0.03912289604722034, + "aggregate_load_tv": 0.09523809523809523 + }, + "period_at_s0": { + "tokens": 42, + "ordered_topk_exact_tokens": 18, + "set_exact_tokens": 25, + "mean_set_jaccard": 0.8639455782312927, + "mean_token_weighted_tv": 0.02991305435785935, + "aggregate_load_tv": 0.06349206349206349 + }, + "period_at_s1": { + "tokens": 42, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.8146258503401362, + "mean_token_weighted_tv": 0.038277391654749714, + "aggregate_load_tv": 0.09523809523809523 + } + } + }, + "layer_13": { + "layer": 13, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "22a4b7bca70be12dd8b6d17a91c650eea8b8fadb8cb14ee707853505f7c360b7", + "route_weight_sha256": "7edd97553cbadc61d2716a7e0ae3f39a125e22918371230386bc1f444c57f6fd", + "loads": [ + 1, + 6, + 2, + 1, + 0, + 5, + 5, + 2, + 2, + 1, + 8, + 5, + 3, + 1, + 3, + 5, + 2, + 7, + 6, + 1, + 4, + 4, + 2, + 11, + 5, + 3, + 0, + 0, + 9, + 7, + 0, + 0, + 2, + 9, + 4, + 3, + 11, + 14, + 2, + 5, + 1, + 0, + 4, + 9, + 12, + 6, + 0, + 5, + 7, + 3, + 1, + 1, + 3, + 3, + 1, + 4, + 1, + 1, + 9, + 8, + 0, + 4, + 2, + 6 + ], + "weighted_loads": [ + 0.03406631574034691, + 0.3292316887527704, + 0.058791520074009895, + 0.029015639796853065, + 0.0, + 0.18568305298686028, + 0.20765943452715874, + 0.12375401705503464, + 0.07799504697322845, + 0.030279044061899185, + 0.33105820789933205, + 0.22608448565006256, + 0.155790526419878, + 0.02755722962319851, + 0.14136720821261406, + 0.2831794135272503, + 0.09658174589276314, + 0.4282476156949997, + 0.5499810688197613, + 0.03368217498064041, + 0.16605279594659805, + 0.14985143765807152, + 0.11554452776908875, + 1.0671065375208855, + 0.25473225861787796, + 0.18677354976534843, + 0.0, + 0.0, + 0.3479070942848921, + 0.6610389724373817, + 0.0, + 0.0, + 0.10900017246603966, + 0.44375780783593655, + 0.14211295545101166, + 0.1790229268372059, + 0.5938987769186497, + 0.9817652404308319, + 0.08872221037745476, + 0.17173769883811474, + 0.03224116936326027, + 0.0, + 0.13689399883151054, + 0.5057966839522123, + 0.874189168214798, + 0.2673958856612444, + 0.0, + 0.1653287038207054, + 0.4133458212018013, + 0.0930627528578043, + 0.03411906212568283, + 0.054906368255615234, + 0.11905667744576931, + 0.11639897897839546, + 0.03523571416735649, + 0.35383179783821106, + 0.027648285031318665, + 0.033901017159223557, + 0.33371295034885406, + 0.3751879744231701, + 0.0, + 0.22054876014590263, + 0.0816246997565031, + 0.3274133987724781 + ], + "unique_experts": 56, + "load_cv": 0.8457502733179187, + "normalized_load_entropy": 0.9101732651626028, + "max_load_share": 0.05555555555555555 + }, + "full_input": { + "tokens": 67, + "top_k": 6, + "decisions": 402, + "ordered_route_sha256": "9643b5526f155cc4b88874b3551d436af945e829f81dec2d59d17a0f608f6c5a", + "route_weight_sha256": "61330b4d5c1561d68cbe0512d5e00bcee0e1576ff6b44faf551b167de7ea1f85", + "loads": [ + 1, + 9, + 2, + 1, + 0, + 6, + 22, + 2, + 2, + 5, + 18, + 11, + 3, + 1, + 4, + 11, + 2, + 10, + 9, + 2, + 4, + 6, + 2, + 13, + 10, + 3, + 3, + 0, + 9, + 21, + 1, + 0, + 2, + 14, + 5, + 3, + 15, + 15, + 2, + 7, + 1, + 3, + 5, + 11, + 23, + 16, + 1, + 7, + 8, + 3, + 2, + 1, + 6, + 6, + 3, + 4, + 4, + 1, + 15, + 12, + 0, + 5, + 2, + 7 + ], + "weighted_loads": [ + 0.03406631574034691, + 0.4812848325818777, + 0.058791520074009895, + 0.029015639796853065, + 0.0, + 0.21618160232901573, + 1.6995056867599487, + 0.12375401705503464, + 0.07799504697322845, + 0.17088117450475693, + 1.0151674207299948, + 0.4810814275406301, + 0.155790526419878, + 0.02755722962319851, + 0.18674355745315552, + 0.5943474918603897, + 0.09658174589276314, + 0.5063530029729009, + 0.7763268128037453, + 0.07914075255393982, + 0.16605279594659805, + 0.22278370335698128, + 0.11554452776908875, + 1.1395617984235287, + 0.4422273710370064, + 0.18677354976534843, + 0.1237773634493351, + 0.0, + 0.3479070942848921, + 1.376950230449438, + 0.04158704727888107, + 0.0, + 0.10900017246603966, + 0.8236346747726202, + 0.16493931971490383, + 0.1790229268372059, + 0.7874726690351963, + 1.0154219567775726, + 0.08872221037745476, + 0.23947940208017826, + 0.03224116936326027, + 0.14319257996976376, + 0.19448186457157135, + 0.6024331357330084, + 1.6461941860616207, + 1.2390504609793425, + 0.03127436339855194, + 1.3575168177485466, + 0.4454607255756855, + 0.0930627528578043, + 0.07235971093177795, + 0.054906368255615234, + 0.2308774907141924, + 0.2531557194888592, + 0.12382766976952553, + 0.35383179783821106, + 0.19303833320736885, + 0.033901017159223557, + 0.617756525054574, + 0.582217138260603, + 0.0, + 0.24994398094713688, + 0.0816246997565031, + 0.36533500999212265 + ], + "unique_experts": 60, + "load_cv": 0.9182171284520875, + "normalized_load_entropy": 0.9042842550370958, + "max_load_share": 0.05721393034825871 + } + }, + "s1_eos": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "8015c37d8408f3da8af81b5a78987704685c3d157b7f9ec9b52fb434a7329d9d", + "route_weight_sha256": "ec23232ffa3ea623c67015ae9453a055db54ba0cc6b44943a4b4e7b1bb8a820e", + "loads": [ + 2, + 6, + 2, + 1, + 0, + 4, + 6, + 2, + 2, + 1, + 9, + 4, + 3, + 1, + 3, + 6, + 2, + 7, + 6, + 1, + 4, + 3, + 2, + 11, + 5, + 4, + 1, + 0, + 7, + 9, + 0, + 0, + 2, + 9, + 6, + 4, + 11, + 14, + 2, + 5, + 1, + 0, + 4, + 8, + 13, + 6, + 0, + 5, + 7, + 2, + 1, + 1, + 3, + 3, + 1, + 4, + 0, + 1, + 7, + 7, + 0, + 3, + 2, + 6 + ], + "weighted_loads": [ + 0.07114588096737862, + 0.3269322067499161, + 0.06056436523795128, + 0.031191455200314522, + 0.0, + 0.15028608590364456, + 0.2507836278527975, + 0.12371937185525894, + 0.07276251167058945, + 0.025879763066768646, + 0.3486485257744789, + 0.19212833791971207, + 0.14998159930109978, + 0.030008062720298767, + 0.14021029323339462, + 0.32649312913417816, + 0.09512676671147346, + 0.4175625666975975, + 0.5872543416917324, + 0.032417282462120056, + 0.15720221772789955, + 0.10808687657117844, + 0.1173032820224762, + 1.060401275753975, + 0.25184043124318123, + 0.2039598934352398, + 0.0239822119474411, + 0.0, + 0.2914997525513172, + 0.7170700412243605, + 0.0, + 0.0, + 0.11480963975191116, + 0.4486628547310829, + 0.2057557813823223, + 0.214591845870018, + 0.5757273510098457, + 0.9910839349031448, + 0.08678353577852249, + 0.1855837181210518, + 0.03995629772543907, + 0.0, + 0.13410654664039612, + 0.4506646618247032, + 0.9543285816907883, + 0.27030930295586586, + 0.0, + 0.1645757108926773, + 0.41115497797727585, + 0.06972130388021469, + 0.03616764768958092, + 0.05511195585131645, + 0.1153224166482687, + 0.11417453363537788, + 0.034915708005428314, + 0.347266498953104, + 0.0, + 0.03380056470632553, + 0.26794734597206116, + 0.34104350954294205, + 0.0, + 0.18213516473770142, + 0.08128885924816132, + 0.31712689250707626 + ], + "unique_experts": 56, + "load_cv": 0.8457502733179187, + "normalized_load_entropy": 0.9107052189747219, + "max_load_share": 0.05555555555555555 + }, + "full_input": { + "tokens": 83, + "top_k": 6, + "decisions": 498, + "ordered_route_sha256": "5bf71afc55263c4cabbb900f4b84a64d5edd3348a32c3788c0b4414aebe1f85b", + "route_weight_sha256": "6359c40aee1972a98201fc8ab635795ded4f9abf4dce2ccd69ac71f588ae95f4", + "loads": [ + 7, + 9, + 2, + 1, + 0, + 5, + 33, + 2, + 2, + 5, + 19, + 16, + 3, + 1, + 4, + 13, + 3, + 10, + 10, + 4, + 4, + 7, + 2, + 16, + 9, + 4, + 5, + 0, + 7, + 28, + 8, + 1, + 2, + 19, + 9, + 5, + 16, + 15, + 3, + 6, + 3, + 6, + 12, + 10, + 29, + 17, + 3, + 8, + 9, + 7, + 2, + 1, + 6, + 5, + 3, + 6, + 3, + 12, + 15, + 11, + 1, + 5, + 2, + 7 + ], + "weighted_loads": [ + 0.2731762230396271, + 0.5114473961293697, + 0.06056436523795128, + 0.031191455200314522, + 0.0, + 0.18696721643209457, + 2.5739564783871174, + 0.12371937185525894, + 0.07276251167058945, + 0.19604500383138657, + 1.0221530944108963, + 0.9477978791110218, + 0.14998159930109978, + 0.030008062720298767, + 0.18349692225456238, + 0.7011651620268822, + 0.11984328553080559, + 0.5035661654546857, + 0.8434339519590139, + 0.1557115688920021, + 0.15720221772789955, + 0.3173362072557211, + 0.1173032820224762, + 1.2564567402005196, + 0.39988543279469013, + 0.2039598934352398, + 0.180760458111763, + 0.0, + 0.2914997525513172, + 2.1090469900518656, + 0.43479324504733086, + 0.03967433422803879, + 0.11480963975191116, + 1.316553071141243, + 0.4298554304987192, + 0.265274029225111, + 0.8757648952305317, + 1.024464763700962, + 0.12863268703222275, + 0.2287147343158722, + 0.12223567441105843, + 0.2714715860784054, + 0.7975217141211033, + 0.5637328363955021, + 2.167821079492569, + 1.2340692654252052, + 0.10425745695829391, + 1.3949721604585648, + 0.6649823822081089, + 0.31643519178032875, + 0.07285308092832565, + 0.05511195585131645, + 0.22044448740780354, + 0.19641951471567154, + 0.1055527962744236, + 0.4188210926949978, + 0.15723931789398193, + 0.7457834370434284, + 0.6338419150561094, + 0.5395572707056999, + 0.028848227113485336, + 0.26679809391498566, + 0.08128885924816132, + 0.3701229877769947 + ], + "unique_experts": 62, + "load_cv": 0.8939780686060449, + "normalized_load_entropy": 0.9159308745537518, + "max_load_share": 0.06626506024096386 + } + }, + "s0_bos": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "988d24fe31553016e0e7d7438c7424cdb2dbbe8981ee67e56eb67227227e7032", + "route_weight_sha256": "30d7e0664909baa92cc5335a43709e84f6cd58ffa4e448a944c00f52b6b66a96", + "loads": [ + 2, + 5, + 3, + 1, + 0, + 6, + 8, + 2, + 3, + 1, + 7, + 5, + 3, + 1, + 4, + 6, + 2, + 7, + 6, + 1, + 4, + 4, + 2, + 11, + 5, + 5, + 0, + 0, + 7, + 6, + 0, + 0, + 2, + 10, + 4, + 4, + 10, + 14, + 2, + 4, + 0, + 0, + 3, + 8, + 12, + 6, + 0, + 4, + 8, + 2, + 0, + 1, + 4, + 3, + 1, + 4, + 1, + 1, + 9, + 6, + 0, + 3, + 2, + 7 + ], + "weighted_loads": [ + 0.06556452810764313, + 0.3193097673356533, + 0.09144872054457664, + 0.03002764657139778, + 0.0, + 0.21569157391786575, + 0.38159736059606075, + 0.12446968257427216, + 0.11961623094975948, + 0.029247991740703583, + 0.2960379719734192, + 0.2235717698931694, + 0.15104736760258675, + 0.026562059298157692, + 0.17306219786405563, + 0.32664274238049984, + 0.10025482252240181, + 0.43694547563791275, + 0.5389893166720867, + 0.033340830355882645, + 0.17572954297065735, + 0.14781515672802925, + 0.1129077598452568, + 1.0733248703181744, + 0.2449636235833168, + 0.23801170103251934, + 0.0, + 0.0, + 0.2954974565654993, + 0.534399501979351, + 0.0, + 0.0, + 0.11248980835080147, + 0.48725677095353603, + 0.13101440854370594, + 0.21651563048362732, + 0.543710932135582, + 0.9766642190515995, + 0.08847444877028465, + 0.14460164681077003, + 0.0, + 0.0, + 0.10674408450722694, + 0.4771210942417383, + 0.8804315775632858, + 0.2630721163004637, + 0.0, + 0.12783975899219513, + 0.41605461947619915, + 0.07634711265563965, + 0.0, + 0.07068007439374924, + 0.1643805056810379, + 0.11644062027335167, + 0.03216805309057236, + 0.3533457852900028, + 0.028427530080080032, + 0.034438177943229675, + 0.29827637784183025, + 0.30985732935369015, + 0.0, + 0.17336688190698624, + 0.08274330571293831, + 0.3734966591000557 + ], + "unique_experts": 54, + "load_cv": 0.8349568463388831, + "normalized_load_entropy": 0.9089271906974058, + "max_load_share": 0.05555555555555555 + }, + "full_input": { + "tokens": 67, + "top_k": 6, + "decisions": 402, + "ordered_route_sha256": "105544047ea9e2bbc9a8225c68a1a3dd21644252d3d408b12abb9570449eff72", + "route_weight_sha256": "38585c3664da5e872a19fcdc71b12f554aa223bf68fda135ba01b36c484dc3b4", + "loads": [ + 2, + 8, + 4, + 1, + 1, + 7, + 26, + 2, + 3, + 7, + 16, + 9, + 3, + 1, + 4, + 12, + 3, + 9, + 9, + 2, + 4, + 5, + 2, + 12, + 8, + 5, + 3, + 0, + 7, + 20, + 1, + 0, + 2, + 13, + 5, + 4, + 14, + 15, + 2, + 6, + 0, + 3, + 4, + 11, + 23, + 17, + 1, + 5, + 9, + 2, + 1, + 1, + 7, + 7, + 4, + 4, + 5, + 1, + 16, + 10, + 0, + 4, + 2, + 8 + ], + "weighted_loads": [ + 0.06556452810764313, + 0.485901303589344, + 0.15979868546128273, + 0.03002764657139778, + 0.049792610108852386, + 0.2461901232600212, + 1.9418634343892336, + 0.12446968257427216, + 0.11961623094975948, + 0.29086810164153576, + 0.8710983116179705, + 0.4113773535937071, + 0.15104736760258675, + 0.026562059298157692, + 0.17306219786405563, + 0.6378108207136393, + 0.12507178634405136, + 0.5045279711484909, + 0.769673015922308, + 0.07879940792918205, + 0.17572954297065735, + 0.18925625830888748, + 0.1129077598452568, + 1.1135024279356003, + 0.37732122652232647, + 0.23801170103251934, + 0.1237773634493351, + 0.0, + 0.2954974565654993, + 1.219925694167614, + 0.03809381276369095, + 0.0, + 0.11248980835080147, + 0.780892638489604, + 0.15384077280759811, + 0.21651563048362732, + 0.7365853525698185, + 1.0103209353983402, + 0.08847444877028465, + 0.21234335005283356, + 0.0, + 0.1476377137005329, + 0.18092402443289757, + 0.6585230212658644, + 1.7037987522780895, + 1.2718271669000387, + 0.03127436339855194, + 0.488906666636467, + 0.44816952385008335, + 0.07634711265563965, + 0.03824064880609512, + 0.07068007439374924, + 0.276201318949461, + 0.31675658747553825, + 0.15815245360136032, + 0.3533457852900028, + 0.30969469994306564, + 0.034438177943229675, + 0.6329351142048836, + 0.516886493191123, + 0.0, + 0.20276210270822048, + 0.08274330571293831, + 0.41141827031970024 + ], + "unique_experts": 60, + "load_cv": 0.9151930275987694, + "normalized_load_entropy": 0.907343566265638, + "max_load_share": 0.06467661691542288 + } + }, + "s1_bos": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "3a27d764c605eba9114cddfb53887ff84385ab26fda4649b651f1fce6ec6f824", + "route_weight_sha256": "77580ed9206e0ab66a29158816f10610e1444eef00c339686a885de5934a1994", + "loads": [ + 2, + 5, + 2, + 1, + 0, + 5, + 8, + 2, + 2, + 1, + 9, + 4, + 3, + 2, + 3, + 7, + 2, + 7, + 6, + 1, + 4, + 4, + 2, + 11, + 5, + 4, + 0, + 0, + 10, + 7, + 0, + 0, + 2, + 10, + 4, + 4, + 10, + 14, + 1, + 5, + 1, + 0, + 4, + 8, + 12, + 6, + 0, + 4, + 7, + 2, + 0, + 1, + 4, + 3, + 1, + 4, + 1, + 1, + 7, + 6, + 0, + 3, + 1, + 7 + ], + "weighted_loads": [ + 0.06706705316901207, + 0.29763369262218475, + 0.06356905214488506, + 0.03104223869740963, + 0.0, + 0.19011686369776726, + 0.34604077599942684, + 0.1253998503088951, + 0.08400234580039978, + 0.029349032789468765, + 0.35156935825943947, + 0.19116314128041267, + 0.15245452150702477, + 0.06268938817083836, + 0.14491094276309013, + 0.3623485267162323, + 0.09686370566487312, + 0.42638602294027805, + 0.5578983090817928, + 0.03381809592247009, + 0.1739990897476673, + 0.1432640478014946, + 0.11206815764307976, + 1.0665374547243118, + 0.25330082699656487, + 0.2097795568406582, + 0.0, + 0.0, + 0.383788650855422, + 0.5163159556686878, + 0.0, + 0.0, + 0.11237242072820663, + 0.4921179823577404, + 0.1313373688608408, + 0.21230290457606316, + 0.5369683019816875, + 1.0080347806215286, + 0.05304940417408943, + 0.18151774257421494, + 0.04117885231971741, + 0.0, + 0.12653670832514763, + 0.4452258590608835, + 0.9352022968232632, + 0.27352379634976387, + 0.0, + 0.12453919090330601, + 0.4158706031739712, + 0.07566539943218231, + 0.0, + 0.050226837396621704, + 0.1573232151567936, + 0.11474314332008362, + 0.03191852197051048, + 0.3551660180091858, + 0.02762254700064659, + 0.034446485340595245, + 0.2518569268286228, + 0.3050561100244522, + 0.0, + 0.1691625528037548, + 0.053324345499277115, + 0.3581247255206108 + ], + "unique_experts": 55, + "load_cv": 0.8528700083815675, + "normalized_load_entropy": 0.9072848958294348, + "max_load_share": 0.05555555555555555 + }, + "full_input": { + "tokens": 83, + "top_k": 6, + "decisions": 498, + "ordered_route_sha256": "1550e7d19a73780dbd57564f0a691381ac2ffbc4a5c60d612d69cfd900a0b525", + "route_weight_sha256": "0c519f021efcca2e4dff75dbdc23fe37c26d396e1e7768f4dccf6b56cd0406b4", + "loads": [ + 7, + 9, + 3, + 1, + 0, + 6, + 35, + 2, + 2, + 5, + 20, + 14, + 3, + 2, + 3, + 14, + 3, + 9, + 10, + 4, + 4, + 8, + 2, + 16, + 9, + 4, + 4, + 0, + 10, + 26, + 8, + 1, + 2, + 19, + 7, + 5, + 15, + 15, + 2, + 6, + 4, + 4, + 13, + 10, + 28, + 18, + 3, + 6, + 9, + 7, + 1, + 1, + 7, + 5, + 3, + 6, + 5, + 12, + 16, + 10, + 1, + 5, + 1, + 8 + ], + "weighted_loads": [ + 0.26909739524126053, + 0.5345584936439991, + 0.11099516786634922, + 0.03104223869740963, + 0.0, + 0.22679799422621727, + 2.756807405501604, + 0.1253998503088951, + 0.08400234580039978, + 0.22929736226797104, + 1.0693956203758717, + 0.8830335829406977, + 0.15245452150702477, + 0.06268938817083836, + 0.14491094276309013, + 0.7370205596089363, + 0.12305488623678684, + 0.5001091007143259, + 0.8118014391511679, + 0.15711238235235214, + 0.1739990897476673, + 0.3534196373075247, + 0.11206815764307976, + 1.2641633860766888, + 0.44201146997511387, + 0.2097795568406582, + 0.1567782461643219, + 0.0, + 0.383788650855422, + 1.9080970790237188, + 0.43319007009267807, + 0.03967433422803879, + 0.11237242072820663, + 1.3233382999897003, + 0.3554370179772377, + 0.26298508793115616, + 0.8358775749802589, + 1.0414156094193459, + 0.09489855542778969, + 0.22464875876903534, + 0.15683848783373833, + 0.20662901178002357, + 0.8600564487278461, + 0.5609603952616453, + 2.187109399586916, + 1.28277587890625, + 0.10425745695829391, + 0.5241182390600443, + 0.6696980074048042, + 0.32237928733229637, + 0.036685433238744736, + 0.050226837396621704, + 0.26244528591632843, + 0.19698812440037727, + 0.10255561023950577, + 0.42672061175107956, + 0.22295869886875153, + 0.7464293576776981, + 0.6175036244094372, + 0.5035698711872101, + 0.028848227113485336, + 0.25382548198103905, + 0.053324345499277115, + 0.41112082079052925 + ], + "unique_experts": 62, + "load_cv": 0.8977228728004489, + "normalized_load_entropy": 0.9151191232632372, + "max_load_share": 0.07028112449799197 + } + }, + "s0_x": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "46e6d7a204eb7a50353a3a697c5aea6348a23ddfbb4ec24eeacde029f8636a13", + "route_weight_sha256": "de4c211751bb0caba2ac925acf29989518493f9fff7436ab17e10ec3edf59dca", + "loads": [ + 2, + 5, + 3, + 1, + 0, + 4, + 7, + 2, + 3, + 2, + 8, + 5, + 3, + 2, + 4, + 5, + 2, + 8, + 7, + 1, + 5, + 3, + 2, + 11, + 5, + 5, + 0, + 0, + 7, + 7, + 0, + 0, + 2, + 10, + 4, + 4, + 10, + 14, + 1, + 5, + 1, + 0, + 1, + 7, + 13, + 6, + 0, + 5, + 7, + 2, + 0, + 1, + 4, + 3, + 1, + 4, + 1, + 1, + 7, + 7, + 0, + 4, + 1, + 7 + ], + "weighted_loads": [ + 0.07080196961760521, + 0.3260635994374752, + 0.09111051820218563, + 0.02904694341123104, + 0.0, + 0.15202650055289268, + 0.24427636340260506, + 0.12503812834620476, + 0.1149537768214941, + 0.056251801550388336, + 0.310847757384181, + 0.2280239798128605, + 0.16050591319799423, + 0.0631051566451788, + 0.17158927582204342, + 0.285507008433342, + 0.09644205868244171, + 0.4726862758398056, + 0.6618471257388592, + 0.03421304002404213, + 0.20427269116044044, + 0.11460494995117188, + 0.11708755418658257, + 1.0359401144087315, + 0.24009649455547333, + 0.2445656731724739, + 0.0, + 0.0, + 0.28165850788354874, + 0.5064799841493368, + 0.0, + 0.0, + 0.10595424100756645, + 0.5230164807289839, + 0.1383102461695671, + 0.21285130828619003, + 0.5273281447589397, + 0.9522985890507698, + 0.0514225997030735, + 0.17572873458266258, + 0.04179477319121361, + 0.0, + 0.03255069628357887, + 0.38726090639829636, + 0.9688452892005444, + 0.2560854945331812, + 0.0, + 0.16146439127624035, + 0.3979126214981079, + 0.07286053523421288, + 0.0, + 0.07064460963010788, + 0.15915725752711296, + 0.11766040325164795, + 0.03389538824558258, + 0.3596760146319866, + 0.028800614178180695, + 0.036094728857278824, + 0.24932978861033916, + 0.34891640208661556, + 0.0, + 0.21788359805941582, + 0.054609667509794235, + 0.36610543355345726 + ], + "unique_experts": 55, + "load_cv": 0.838570091547447, + "normalized_load_entropy": 0.9096222548771911, + "max_load_share": 0.05555555555555555 + }, + "full_input": { + "tokens": 67, + "top_k": 6, + "decisions": 402, + "ordered_route_sha256": "a1bb5cb7337da668617f5b33a829d01196cfb289201bfba3f61217ec9bd0ebed", + "route_weight_sha256": "fc0f917eeb0ddb846da8b072c28b078e53a9b2659d11f695d32726d17e764c42", + "loads": [ + 2, + 7, + 3, + 1, + 0, + 5, + 24, + 2, + 3, + 5, + 18, + 10, + 3, + 2, + 4, + 12, + 3, + 10, + 10, + 2, + 5, + 4, + 2, + 13, + 11, + 5, + 3, + 0, + 7, + 21, + 1, + 0, + 2, + 15, + 5, + 4, + 13, + 15, + 1, + 7, + 1, + 3, + 3, + 8, + 26, + 18, + 2, + 6, + 8, + 2, + 1, + 1, + 7, + 6, + 3, + 4, + 4, + 1, + 13, + 11, + 0, + 5, + 1, + 8 + ], + "weighted_loads": [ + 0.07080196961760521, + 0.42416929081082344, + 0.09111051820218563, + 0.02904694341123104, + 0.0, + 0.18252504989504814, + 1.6691986471414566, + 0.12503812834620476, + 0.1149537768214941, + 0.1605155561119318, + 0.8886239565908909, + 0.48406012915074825, + 0.16050591319799423, + 0.0631051566451788, + 0.17158927582204342, + 0.8180497772991657, + 0.12239556759595871, + 0.5429164096713066, + 0.9015825279057026, + 0.07967161759734154, + 0.20427269116044044, + 0.16198353841900826, + 0.11708755418658257, + 1.1170283779501915, + 0.494146266952157, + 0.2445656731724739, + 0.1237773634493351, + 0.0, + 0.28165850788354874, + 1.2069014143198729, + 0.05076892301440239, + 0.0, + 0.10595424100756645, + 0.9345339667052031, + 0.16113661043345928, + 0.21285130828619003, + 0.6704447977244854, + 0.9859553053975105, + 0.0514225997030735, + 0.2434704378247261, + 0.04179477319121361, + 0.15506556630134583, + 0.12685806304216385, + 0.43279125168919563, + 1.913305625319481, + 1.4636172074824572, + 0.05989626981317997, + 0.5225312989205122, + 0.4300275258719921, + 0.07286053523421288, + 0.03824064880609512, + 0.07064460963010788, + 0.27097807079553604, + 0.25441714376211166, + 0.12248734384775162, + 0.3596760146319866, + 0.19419066235423088, + 0.036094728857278824, + 0.5305926781147718, + 0.5559455659240484, + 0.0, + 0.24727881886065006, + 0.054609667509794235, + 0.4040270447731018 + ], + "unique_experts": 60, + "load_cv": 0.9462550548064793, + "normalized_load_entropy": 0.9027715983430461, + "max_load_share": 0.06467661691542288 + } + }, + "s1_x": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "9235509f98010014a6062b330ded2d25fc7615073188dca74a3c7763742daff1", + "route_weight_sha256": "9ab4261bb3a7e396374a9f4273c1b11cccb5899a03abc75d411e8e05412299f8", + "loads": [ + 2, + 5, + 2, + 1, + 0, + 4, + 7, + 2, + 3, + 1, + 7, + 5, + 4, + 1, + 3, + 4, + 2, + 9, + 8, + 2, + 4, + 4, + 2, + 11, + 5, + 5, + 0, + 0, + 6, + 9, + 0, + 0, + 2, + 10, + 5, + 3, + 11, + 15, + 1, + 5, + 1, + 0, + 2, + 6, + 14, + 5, + 0, + 3, + 7, + 2, + 0, + 1, + 4, + 3, + 2, + 4, + 1, + 1, + 6, + 8, + 0, + 4, + 1, + 7 + ], + "weighted_loads": [ + 0.07050111517310143, + 0.28671738132834435, + 0.060291681438684464, + 0.029126254841685295, + 0.0, + 0.1489839255809784, + 0.24045034684240818, + 0.1318579465150833, + 0.11142047122120857, + 0.02830866165459156, + 0.28602610900998116, + 0.23185644298791885, + 0.19239117205142975, + 0.03400313854217529, + 0.1422707475721836, + 0.2507605589926243, + 0.09184997528791428, + 0.5180908385664225, + 0.792265996336937, + 0.06341547332704067, + 0.17734087631106377, + 0.14185375347733498, + 0.11665403842926025, + 0.9961121827363968, + 0.24576956778764725, + 0.23664598539471626, + 0.0, + 0.0, + 0.25385257229208946, + 0.4846772104501724, + 0.0, + 0.0, + 0.11575789749622345, + 0.48681260645389557, + 0.16567868180572987, + 0.16672343388199806, + 0.561980351805687, + 1.0396433435380459, + 0.05163271725177765, + 0.1944832019507885, + 0.06478635221719742, + 0.0, + 0.062038494274020195, + 0.33930252492427826, + 1.052597213536501, + 0.23882165178656578, + 0.0, + 0.09771365113556385, + 0.395456712692976, + 0.06648607552051544, + 0.0, + 0.05966292694211006, + 0.15218167752027512, + 0.11738615110516548, + 0.06596246734261513, + 0.36202065274119377, + 0.025857042521238327, + 0.037817321717739105, + 0.21882911957800388, + 0.39294989220798016, + 0.0, + 0.22411714121699333, + 0.05401834100484848, + 0.3547409027814865 + ], + "unique_experts": 55, + "load_cv": 0.8761847250788941, + "normalized_load_entropy": 0.9059560863966403, + "max_load_share": 0.05952380952380952 + }, + "full_input": { + "tokens": 83, + "top_k": 6, + "decisions": 498, + "ordered_route_sha256": "e29cd38ae89e5bff786f1086ac1755991a08e38833e9ea6f6a427a67b37dde72", + "route_weight_sha256": "5d16ec954aa25842fc9f34e5836d3d0cc0b148daaa50df8c5dc820b39f341555", + "loads": [ + 7, + 7, + 2, + 1, + 0, + 5, + 34, + 2, + 3, + 2, + 16, + 15, + 4, + 1, + 3, + 12, + 3, + 11, + 12, + 5, + 4, + 9, + 2, + 15, + 10, + 5, + 4, + 0, + 6, + 29, + 8, + 1, + 2, + 22, + 8, + 4, + 15, + 16, + 2, + 6, + 3, + 6, + 11, + 6, + 32, + 18, + 4, + 6, + 9, + 7, + 1, + 1, + 7, + 5, + 4, + 7, + 4, + 13, + 12, + 12, + 1, + 7, + 1, + 8 + ], + "weighted_loads": [ + 0.2725314572453499, + 0.4103055037558079, + 0.060291681438684464, + 0.029126254841685295, + 0.0, + 0.1856650561094284, + 2.452521925792098, + 0.1318579465150833, + 0.11142047122120857, + 0.05873698182404041, + 0.8560021594166756, + 0.9317478816956282, + 0.19239117205142975, + 0.03400313854217529, + 0.1422707475721836, + 0.7689733318984509, + 0.11688985116779804, + 0.5987592097371817, + 1.0810295287519693, + 0.18670975975692272, + 0.17734087631106377, + 0.3805751446634531, + 0.11665403842926025, + 1.169542696326971, + 0.44815473817288876, + 0.23664598539471626, + 0.1567782461643219, + 0.0, + 0.25385257229208946, + 1.8796895816922188, + 0.4612859934568405, + 0.03967433422803879, + 0.11575789749622345, + 1.4565374478697777, + 0.38977833092212677, + 0.21740561723709106, + 0.8088492378592491, + 1.0730241723358631, + 0.0934818685054779, + 0.2376142181456089, + 0.14706572890281677, + 0.2683654651045799, + 0.7824054826050997, + 0.33930252492427826, + 2.4150808416306973, + 1.3763316813856363, + 0.1471552439033985, + 0.5194454304873943, + 0.649284116923809, + 0.3131999634206295, + 0.036685433238744736, + 0.05966292694211006, + 0.25730374827980995, + 0.19963113218545914, + 0.1365995556116104, + 0.47582950070500374, + 0.18309636041522026, + 0.7824703678488731, + 0.4455585554242134, + 0.591463653370738, + 0.028848227113485336, + 0.34416066482663155, + 0.05401834100484848, + 0.40773699805140495 + ], + "unique_experts": 62, + "load_cv": 0.9276934576510316, + "normalized_load_entropy": 0.9115677100604308, + "max_load_share": 0.06827309236947791 + } + }, + "s0_period": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "16256f9b247d393ad46c3fc48393b1895183710eff6403792e24306139bb34d4", + "route_weight_sha256": "b87b30cd8c06eab98065115f10e43d3b7750ec72aa7e193e7d5994270fc6bae2", + "loads": [ + 2, + 5, + 3, + 1, + 0, + 4, + 7, + 2, + 3, + 2, + 8, + 5, + 4, + 1, + 3, + 4, + 2, + 8, + 7, + 1, + 4, + 4, + 2, + 12, + 5, + 5, + 0, + 0, + 6, + 9, + 0, + 0, + 2, + 10, + 4, + 4, + 11, + 14, + 1, + 4, + 2, + 0, + 1, + 6, + 13, + 5, + 0, + 4, + 7, + 2, + 0, + 1, + 4, + 3, + 1, + 4, + 1, + 1, + 8, + 7, + 0, + 4, + 2, + 7 + ], + "weighted_loads": [ + 0.06909284926950932, + 0.31059480458498, + 0.09112729504704475, + 0.029434164986014366, + 0.0, + 0.14700214751064777, + 0.2560291551053524, + 0.12574803829193115, + 0.11657252907752991, + 0.0542483814060688, + 0.2965697906911373, + 0.2306194007396698, + 0.1907784789800644, + 0.035912081599235535, + 0.14551030844449997, + 0.25308624282479286, + 0.09476295486092567, + 0.474617188796401, + 0.6581750623881817, + 0.03386017307639122, + 0.17197154834866524, + 0.14692829176783562, + 0.11963618919253349, + 1.0741405971348286, + 0.23987670987844467, + 0.2427164427936077, + 0.0, + 0.0, + 0.24711374752223492, + 0.6512095406651497, + 0.0, + 0.0, + 0.11094005033373833, + 0.5298603791743517, + 0.14209803752601147, + 0.21488229930400848, + 0.554884847253561, + 0.9675353989005089, + 0.05183965340256691, + 0.1499061957001686, + 0.07387054339051247, + 0.0, + 0.03322219476103783, + 0.34722623229026794, + 0.9870932698249817, + 0.22993258014321327, + 0.0, + 0.12881160527467728, + 0.38931023329496384, + 0.07081779278814793, + 0.0, + 0.06779943406581879, + 0.160066120326519, + 0.12160014361143112, + 0.03319830447435379, + 0.3621177636086941, + 0.02786845900118351, + 0.03528682142496109, + 0.2829346749931574, + 0.3551104236394167, + 0.0, + 0.21967560797929764, + 0.08572021126747131, + 0.3654855750501156 + ], + "unique_experts": 55, + "load_cv": 0.8552300820967742, + "normalized_load_entropy": 0.9085312348150212, + "max_load_share": 0.05555555555555555 + }, + "full_input": { + "tokens": 67, + "top_k": 6, + "decisions": 402, + "ordered_route_sha256": "eb37d35bd47fed4639fc015018c03606cd0d47cca3efa3d86981fef67fb62c47", + "route_weight_sha256": "3e4a82549c454a26135ff76c5815befad79024ba2e66b9681e5eed2832cdc5df", + "loads": [ + 2, + 8, + 3, + 1, + 0, + 5, + 23, + 2, + 3, + 5, + 17, + 10, + 4, + 1, + 4, + 10, + 2, + 10, + 11, + 2, + 4, + 6, + 2, + 13, + 9, + 5, + 3, + 0, + 6, + 24, + 1, + 0, + 2, + 16, + 5, + 4, + 16, + 15, + 1, + 6, + 3, + 4, + 2, + 8, + 25, + 16, + 1, + 5, + 8, + 2, + 1, + 1, + 7, + 6, + 3, + 4, + 4, + 1, + 14, + 11, + 0, + 5, + 2, + 8 + ], + "weighted_loads": [ + 0.06909284926950932, + 0.5874305292963982, + 0.09112729504704475, + 0.029434164986014366, + 0.0, + 0.17750069685280323, + 1.7132295705378056, + 0.12574803829193115, + 0.11657252907752991, + 0.15904930047690868, + 0.8981928210705519, + 0.4945013504475355, + 0.1907784789800644, + 0.035912081599235535, + 0.17750083655118942, + 0.5642543211579323, + 0.09476295486092567, + 0.5441453997045755, + 0.9319021683186293, + 0.07931875064969063, + 0.17197154834866524, + 0.21807951480150223, + 0.11963618919253349, + 1.1177313290536404, + 0.4967467989772558, + 0.2427164427936077, + 0.1237773634493351, + 0.0, + 0.24711374752223492, + 1.406403835862875, + 0.05053532496094704, + 0.0, + 0.11094005033373833, + 0.9735976662486792, + 0.16492440178990364, + 0.21488229930400848, + 0.8100851997733116, + 1.0011921152472496, + 0.05183965340256691, + 0.21764789894223213, + 0.11209266260266304, + 0.20113127678632736, + 0.07177409529685974, + 0.4574955739080906, + 1.8536287359893322, + 1.2421353235840797, + 0.03127436339855194, + 0.4898785129189491, + 0.42142513766884804, + 0.07081779278814793, + 0.03824064880609512, + 0.06779943406581879, + 0.2718869335949421, + 0.25835688412189484, + 0.12179026007652283, + 0.3621177636086941, + 0.1932585071772337, + 0.03528682142496109, + 0.5561326444149017, + 0.5621395874768496, + 0.0, + 0.24907082878053188, + 0.08572021126747131, + 0.40340718626976013 + ], + "unique_experts": 60, + "load_cv": 0.9491801967825755, + "normalized_load_entropy": 0.9024166290730292, + "max_load_share": 0.06218905472636816 + } + }, + "s1_period": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "6a2df6f7af2e1b62e5973e230d1e3c10336e55cfdd0ab868687fa43e8724f534", + "route_weight_sha256": "40bf49df3331e195382dbc10268de07ce51f47fcee21f495e6a3912ab01e41b4", + "loads": [ + 2, + 8, + 2, + 1, + 0, + 4, + 7, + 2, + 2, + 1, + 8, + 5, + 3, + 1, + 3, + 4, + 2, + 9, + 8, + 1, + 4, + 4, + 2, + 11, + 5, + 5, + 0, + 0, + 6, + 9, + 1, + 0, + 2, + 9, + 5, + 3, + 10, + 15, + 1, + 5, + 1, + 0, + 2, + 6, + 14, + 5, + 0, + 3, + 7, + 2, + 0, + 1, + 4, + 3, + 1, + 4, + 1, + 1, + 7, + 8, + 0, + 4, + 1, + 7 + ], + "weighted_loads": [ + 0.06874513998627663, + 0.3697441089898348, + 0.061742208898067474, + 0.030171969905495644, + 0.0, + 0.15213971212506294, + 0.24216300435364246, + 0.12820206955075264, + 0.08259232714772224, + 0.027225082740187645, + 0.2920561842620373, + 0.22970237210392952, + 0.15343091264367104, + 0.03395621478557587, + 0.1443069875240326, + 0.25949930772185326, + 0.0886450968682766, + 0.5072848051786423, + 0.7517154086381197, + 0.03642592579126358, + 0.167429868131876, + 0.14026224613189697, + 0.11518892645835876, + 1.008015438914299, + 0.23962800204753876, + 0.22849350608885288, + 0.0, + 0.0, + 0.2534234933555126, + 0.5248013194650412, + 0.034354861825704575, + 0.0, + 0.1128389872610569, + 0.4485643319785595, + 0.1660713069140911, + 0.16668671742081642, + 0.5252791941165924, + 1.05274947732687, + 0.049955740571022034, + 0.1934910286217928, + 0.0628155842423439, + 0.0, + 0.06685464829206467, + 0.3379041999578476, + 1.0332025475800037, + 0.23970364034175873, + 0.0, + 0.09883828461170197, + 0.41480619087815285, + 0.06441396102309227, + 0.0, + 0.05275823548436165, + 0.154445243999362, + 0.11675724759697914, + 0.03331465274095535, + 0.3654942028224468, + 0.03353889286518097, + 0.03653758019208908, + 0.2571289464831352, + 0.3976027835160494, + 0.0, + 0.22698195278644562, + 0.055231645703315735, + 0.34928440675139427 + ], + "unique_experts": 56, + "load_cv": 0.8819171036881969, + "normalized_load_entropy": 0.9050591540360539, + "max_load_share": 0.05952380952380952 + }, + "full_input": { + "tokens": 83, + "top_k": 6, + "decisions": 498, + "ordered_route_sha256": "b63bec8ed62cf7dd8f52fe16e2d0af116f3ae6b5451e581a7461cc8bfdff0537", + "route_weight_sha256": "200738708788512341ab75a929e0d282320f00bef97d9ebc137bcaf6f0d0274e", + "loads": [ + 7, + 12, + 2, + 1, + 0, + 5, + 33, + 2, + 2, + 3, + 17, + 16, + 3, + 1, + 3, + 11, + 3, + 11, + 12, + 4, + 4, + 9, + 2, + 15, + 9, + 5, + 4, + 0, + 6, + 30, + 9, + 1, + 2, + 22, + 8, + 4, + 15, + 16, + 2, + 6, + 3, + 6, + 11, + 7, + 32, + 17, + 3, + 5, + 9, + 7, + 1, + 1, + 7, + 5, + 3, + 6, + 4, + 12, + 13, + 12, + 1, + 7, + 1, + 8 + ], + "weighted_loads": [ + 0.2707754820585251, + 0.7189529594033957, + 0.061742208898067474, + 0.030171969905495644, + 0.0, + 0.18882084265351295, + 2.355685770511627, + 0.12820206955075264, + 0.08259232714772224, + 0.08036740310490131, + 0.9077847227454185, + 0.9730464052408934, + 0.15343091264367104, + 0.03395621478557587, + 0.1443069875240326, + 0.6341713406145573, + 0.11202730238437653, + 0.581866167485714, + 1.0363947749137878, + 0.15972021222114563, + 0.167429868131876, + 0.3745513539761305, + 0.11518892645835876, + 1.176266998052597, + 0.5290015805512667, + 0.22849350608885288, + 0.1567782461643219, + 0.0, + 0.2534234933555126, + 1.9829660188406706, + 0.4926191419363022, + 0.03967433422803879, + 0.1128389872610569, + 1.4930348098278046, + 0.390170956030488, + 0.21736890077590942, + 0.8343948163092136, + 1.0861303061246872, + 0.09180489182472229, + 0.2366220448166132, + 0.14509496092796326, + 0.2872132919728756, + 0.7640721015632153, + 0.3726537302136421, + 2.3928243182599545, + 1.2373003773391247, + 0.10425745695829391, + 0.49841733276844025, + 0.6686335951089859, + 0.31112784892320633, + 0.036685433238744736, + 0.05275823548436165, + 0.2595673147588968, + 0.1990022286772728, + 0.10395174100995064, + 0.4370487965643406, + 0.1907782107591629, + 0.748520452529192, + 0.4899920653551817, + 0.5961165446788073, + 0.028848227113485336, + 0.3425669502466917, + 0.055231645703315735, + 0.4022805020213127 + ], + "unique_experts": 62, + "load_cv": 0.9346219391078883, + "normalized_load_entropy": 0.9095179155764436, + "max_load_share": 0.06626506024096386 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 42, + "ordered_topk_exact_tokens": 22, + "set_exact_tokens": 28, + "mean_set_jaccard": 0.8996598639455782, + "mean_token_weighted_tv": 0.018847401519971236, + "aggregate_load_tv": 0.047619047619047616 + }, + "system_bos": { + "tokens": 42, + "ordered_topk_exact_tokens": 20, + "set_exact_tokens": 26, + "mean_set_jaccard": 0.8911564625850341, + "mean_token_weighted_tv": 0.020084467805212454, + "aggregate_load_tv": 0.04365079365079365 + }, + "system_x": { + "tokens": 42, + "ordered_topk_exact_tokens": 22, + "set_exact_tokens": 28, + "mean_set_jaccard": 0.8945578231292517, + "mean_token_weighted_tv": 0.024236188491895086, + "aggregate_load_tv": 0.05555555555555555 + }, + "system_period": { + "tokens": 42, + "ordered_topk_exact_tokens": 22, + "set_exact_tokens": 26, + "mean_set_jaccard": 0.8707482993197279, + "mean_token_weighted_tv": 0.02881411580546271, + "aggregate_load_tv": 0.047619047619047616 + }, + "bos_at_s0": { + "tokens": 42, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 24, + "mean_set_jaccard": 0.8724489795918368, + "mean_token_weighted_tv": 0.02749538321846298, + "aggregate_load_tv": 0.06349206349206349 + }, + "bos_at_s1": { + "tokens": 42, + "ordered_topk_exact_tokens": 19, + "set_exact_tokens": 24, + "mean_set_jaccard": 0.8775510204081634, + "mean_token_weighted_tv": 0.02680033877758043, + "aggregate_load_tv": 0.051587301587301584 + }, + "x_at_s0": { + "tokens": 42, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 18, + "mean_set_jaccard": 0.8367346938775513, + "mean_token_weighted_tv": 0.03173202214141687, + "aggregate_load_tv": 0.07142857142857142 + }, + "x_at_s1": { + "tokens": 42, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 20, + "mean_set_jaccard": 0.8310657596371881, + "mean_token_weighted_tv": 0.03699438065467846, + "aggregate_load_tv": 0.07936507936507936 + }, + "period_at_s0": { + "tokens": 42, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 18, + "mean_set_jaccard": 0.8316326530612246, + "mean_token_weighted_tv": 0.030436003602863776, + "aggregate_load_tv": 0.07936507936507936 + }, + "period_at_s1": { + "tokens": 42, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.8157596371882085, + "mean_token_weighted_tv": 0.038211751418809094, + "aggregate_load_tv": 0.07142857142857142 + } + } + }, + "layer_14": { + "layer": 14, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "56c540b0c910b3cf66dc4ca6cfbd101c2d1acf07f431e30e567b3d7b83f12268", + "route_weight_sha256": "f9b9f687f143decfc6dda1a720c8f7e77f5fc6b2aa968e291e40af87edaeb19a", + "loads": [ + 4, + 2, + 0, + 3, + 0, + 5, + 1, + 8, + 4, + 6, + 2, + 9, + 1, + 8, + 3, + 8, + 4, + 0, + 4, + 6, + 1, + 1, + 0, + 2, + 2, + 4, + 5, + 4, + 10, + 1, + 3, + 6, + 5, + 10, + 2, + 1, + 1, + 3, + 0, + 3, + 2, + 2, + 3, + 16, + 0, + 2, + 6, + 10, + 1, + 4, + 9, + 6, + 5, + 12, + 2, + 2, + 4, + 6, + 2, + 5, + 1, + 4, + 0, + 6 + ], + "weighted_loads": [ + 0.20287635549902916, + 0.20387260615825653, + 0.0, + 0.0987530779093504, + 0.0, + 0.21442734077572823, + 0.0557185597717762, + 0.2743913661688566, + 0.2031034640967846, + 0.4466302711516619, + 0.06763409823179245, + 0.6957657635211945, + 0.033827364444732666, + 0.3610384985804558, + 0.23069925978779793, + 0.38138592056930065, + 0.17737537994980812, + 0.0, + 0.15610948391258717, + 0.3110448308289051, + 0.11129619926214218, + 0.042389076203107834, + 0.0, + 0.107091274112463, + 0.07706427201628685, + 0.16414561308920383, + 0.2278105616569519, + 0.15632236748933792, + 0.6329531632363796, + 0.057211365550756454, + 0.11814964935183525, + 0.22212428599596024, + 0.19823220185935497, + 0.9262816533446312, + 0.07322461158037186, + 0.06090043857693672, + 0.03659868612885475, + 0.2656422033905983, + 0.0, + 0.1303051896393299, + 0.09334551356732845, + 0.08821545913815498, + 0.1471617203205824, + 1.3193881139159203, + 0.0, + 0.07194186374545097, + 0.30842861719429493, + 0.3867922928184271, + 0.06117205321788788, + 0.16954324766993523, + 0.5034124292433262, + 0.19881488010287285, + 0.292001161724329, + 1.140949172899127, + 0.08871101215481758, + 0.14156090840697289, + 0.32411758601665497, + 0.20209835097193718, + 0.07377536967396736, + 0.30207977816462517, + 0.04921554774045944, + 0.1532502956688404, + 0.0, + 0.22156835719943047 + ], + "unique_experts": 57, + "load_cv": 0.8337489515345331, + "normalized_load_entropy": 0.9162649109955616, + "max_load_share": 0.06349206349206349 + }, + "full_input": { + "tokens": 67, + "top_k": 6, + "decisions": 402, + "ordered_route_sha256": "058267d57f7914239f59e889b3df8e4e88ca1bbb68eb813402278035a7ca5f85", + "route_weight_sha256": "ec7ff19189c5c13217a992e79f03795353e2ae441e0bd0a838666c547afc4243", + "loads": [ + 11, + 2, + 0, + 5, + 0, + 15, + 1, + 10, + 4, + 15, + 3, + 12, + 1, + 8, + 3, + 13, + 4, + 0, + 8, + 7, + 1, + 2, + 0, + 13, + 3, + 7, + 11, + 10, + 18, + 1, + 6, + 11, + 5, + 17, + 2, + 1, + 2, + 5, + 2, + 3, + 2, + 2, + 4, + 17, + 2, + 2, + 12, + 14, + 1, + 5, + 12, + 11, + 11, + 18, + 2, + 6, + 4, + 7, + 2, + 14, + 1, + 5, + 0, + 6 + ], + "weighted_loads": [ + 0.9024604484438896, + 0.20387260615825653, + 0.0, + 0.17808319069445133, + 0.0, + 1.1262267287820578, + 0.0557185597717762, + 0.34730065427720547, + 0.2031034640967846, + 0.9148880410939455, + 0.10254079475998878, + 0.8888253197073936, + 0.033827364444732666, + 0.3610384985804558, + 0.23069925978779793, + 0.5752231124788523, + 0.17737537994980812, + 0.0, + 0.44845989532768726, + 0.3509601764380932, + 0.11129619926214218, + 0.07785163447260857, + 0.0, + 0.5774468295276165, + 0.09968012757599354, + 0.2742789965122938, + 0.5712711401283741, + 0.5458701699972153, + 1.7343188039958477, + 0.057211365550756454, + 0.3179056793451309, + 0.4102897113189101, + 0.19823220185935497, + 1.5051640570163727, + 0.07322461158037186, + 0.06090043857693672, + 0.08896055445075035, + 0.3620328865945339, + 0.13802888244390488, + 0.1303051896393299, + 0.09334551356732845, + 0.08821545913815498, + 0.2035310659557581, + 1.3678786642849445, + 0.06273462250828743, + 0.07194186374545097, + 0.6134794149547815, + 0.5692894719541073, + 0.06117205321788788, + 0.21229131892323494, + 0.6143827028572559, + 1.4743748977780342, + 1.0346162132918835, + 1.5664626527577639, + 0.08871101215481758, + 0.47096196189522743, + 0.32411758601665497, + 0.23896868526935577, + 0.07377536967396736, + 0.6998339034616947, + 0.04921554774045944, + 0.15826248424127698, + 0.0, + 0.22156835719943047 + ], + "unique_experts": 59, + "load_cv": 0.8388803281430683, + "normalized_load_entropy": 0.911397252544017, + "max_load_share": 0.04477611940298507 + } + }, + "s1_eos": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "2596d8448d6e585a1dd7e530fe85affc8828049b92665d6aa3852c8749bf5ce7", + "route_weight_sha256": "1ccd4b3028bb63a94af5f1fda5b3012d344d9a0067abed04afbd87b01e01a077", + "loads": [ + 4, + 2, + 0, + 3, + 0, + 7, + 2, + 6, + 4, + 6, + 3, + 9, + 1, + 7, + 3, + 8, + 3, + 0, + 3, + 6, + 1, + 1, + 0, + 2, + 4, + 6, + 5, + 4, + 10, + 1, + 3, + 6, + 3, + 10, + 2, + 1, + 1, + 3, + 0, + 3, + 1, + 2, + 3, + 16, + 1, + 3, + 5, + 10, + 1, + 4, + 8, + 7, + 4, + 13, + 2, + 2, + 4, + 3, + 2, + 8, + 1, + 4, + 0, + 5 + ], + "weighted_loads": [ + 0.19574805907905102, + 0.1996021643280983, + 0.0, + 0.1021611038595438, + 0.0, + 0.284619202837348, + 0.08907265588641167, + 0.2225677538663149, + 0.19689946621656418, + 0.4742587208747864, + 0.1018086913973093, + 0.7119368109852076, + 0.035781681537628174, + 0.32837317511439323, + 0.23693358525633812, + 0.383115092292428, + 0.1540171056985855, + 0.0, + 0.1240030974149704, + 0.31721339747309685, + 0.1083584874868393, + 0.03836682066321373, + 0.0, + 0.1137397475540638, + 0.11765797436237335, + 0.21485961973667145, + 0.2215963490307331, + 0.15892628952860832, + 0.6195453852415085, + 0.05656759813427925, + 0.11540894582867622, + 0.2216862365603447, + 0.132796049118042, + 0.9769123829901218, + 0.07308026403188705, + 0.0602448470890522, + 0.03285742178559303, + 0.2647537440061569, + 0.0, + 0.12910714000463486, + 0.06448087096214294, + 0.08841527625918388, + 0.14417505636811256, + 1.3619305416941643, + 0.03213199973106384, + 0.10467733815312386, + 0.27618234045803547, + 0.3847720567137003, + 0.0663904920220375, + 0.1643974408507347, + 0.4574122466146946, + 0.22253154404461384, + 0.254899475723505, + 1.1723303850740194, + 0.08759502694010735, + 0.13594475388526917, + 0.321084912866354, + 0.11987324059009552, + 0.07509138435125351, + 0.39121835865080357, + 0.04982208460569382, + 0.14116912707686424, + 0.0, + 0.1917480155825615 + ], + "unique_experts": 58, + "load_cv": 0.8313278968364126, + "normalized_load_entropy": 0.9190415057489595, + "max_load_share": 0.06349206349206349 + }, + "full_input": { + "tokens": 83, + "top_k": 6, + "decisions": 498, + "ordered_route_sha256": "292df431bd34df028f53228cf53536b9548b37675586c7c9100a757e92228a3e", + "route_weight_sha256": "c543442c5b9e43a359551b32cae98fbecd801f53ecda336601a620aea3aac119", + "loads": [ + 11, + 3, + 0, + 6, + 3, + 23, + 2, + 10, + 6, + 18, + 3, + 12, + 6, + 7, + 3, + 14, + 3, + 0, + 10, + 9, + 3, + 6, + 0, + 11, + 10, + 10, + 10, + 12, + 23, + 2, + 8, + 10, + 5, + 21, + 3, + 2, + 1, + 6, + 3, + 4, + 1, + 2, + 5, + 17, + 3, + 3, + 11, + 13, + 3, + 6, + 22, + 10, + 12, + 23, + 4, + 5, + 5, + 5, + 3, + 26, + 4, + 6, + 2, + 8 + ], + "weighted_loads": [ + 0.9583287928253412, + 0.25137946754693985, + 0.0, + 0.21844343282282352, + 0.20672496408224106, + 1.4125349130481482, + 0.08907265588641167, + 0.3866512794047594, + 0.3645389601588249, + 1.2618278302252293, + 0.1018086913973093, + 0.9281610380858183, + 0.38732459768652916, + 0.32837317511439323, + 0.23693358525633812, + 0.6337700951844454, + 0.1540171056985855, + 0.0, + 0.6099233310669661, + 0.49365387856960297, + 0.3364866077899933, + 0.22175152227282524, + 0.0, + 0.49706531316041946, + 0.397870359942317, + 0.36504305340349674, + 0.5841118954122066, + 0.46081630419939756, + 2.1763879247009754, + 0.1045103594660759, + 0.3672167584300041, + 0.3369360454380512, + 0.21288951113820076, + 2.064212705940008, + 0.12075097858905792, + 0.1400972194969654, + 0.03285742178559303, + 0.618137288838625, + 0.20712298154830933, + 0.18702742084860802, + 0.06448087096214294, + 0.08841527625918388, + 0.24135037139058113, + 1.4082006625831127, + 0.0944371186196804, + 0.10467733815312386, + 0.6003336887806654, + 0.5040506385266781, + 0.1917927749454975, + 0.21994525380432606, + 1.3479517437517643, + 1.4376087449491024, + 1.0704865269362926, + 1.9136843848973513, + 0.17153526470065117, + 0.39196982979774475, + 0.3721212260425091, + 0.20080847665667534, + 0.18288084864616394, + 1.380238052457571, + 0.3027806095778942, + 0.1858162167482078, + 0.10349757224321365, + 0.29863179102540016 + ], + "unique_experts": 61, + "load_cv": 0.8189522152871282, + "normalized_load_entropy": 0.924308046349111, + "max_load_share": 0.05220883534136546 + } + }, + "s0_bos": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "c91a0200bfba29556b2f4161c6badef057342825bed1ab3aa41bc974fed4a06e", + "route_weight_sha256": "2e983118d0656df12b2c5879337e3a891005c633d9ca70aa14d6c6dd757946ce", + "loads": [ + 4, + 2, + 0, + 4, + 0, + 4, + 2, + 6, + 3, + 4, + 3, + 9, + 1, + 8, + 3, + 8, + 5, + 1, + 2, + 5, + 1, + 2, + 0, + 3, + 2, + 7, + 5, + 4, + 10, + 1, + 3, + 7, + 2, + 9, + 2, + 1, + 1, + 3, + 1, + 4, + 2, + 3, + 2, + 14, + 0, + 3, + 5, + 9, + 1, + 5, + 10, + 7, + 3, + 12, + 2, + 2, + 4, + 5, + 0, + 10, + 1, + 5, + 0, + 5 + ], + "weighted_loads": [ + 0.1869865320622921, + 0.20676913112401962, + 0.0, + 0.12339556030929089, + 0.0, + 0.1811341941356659, + 0.08367311581969261, + 0.2179649882018566, + 0.166567862033844, + 0.3228098414838314, + 0.10842842794954777, + 0.7244028523564339, + 0.03307196870446205, + 0.3519718814641237, + 0.24561553075909615, + 0.391327116638422, + 0.21587182767689228, + 0.03426996245980263, + 0.06918278709053993, + 0.26879556477069855, + 0.1097838282585144, + 0.068098871037364, + 0.0, + 0.13683423586189747, + 0.08343084529042244, + 0.2635322567075491, + 0.24162861704826355, + 0.1599334441125393, + 0.8227535039186478, + 0.05628833919763565, + 0.11621875315904617, + 0.25889054127037525, + 0.11262984573841095, + 0.876267921179533, + 0.06582203879952431, + 0.05676880478858948, + 0.02992401272058487, + 0.26486533135175705, + 0.03344067558646202, + 0.17479965463280678, + 0.09678727388381958, + 0.12527131289243698, + 0.11946357786655426, + 1.2542054913938046, + 0.0, + 0.1106166485697031, + 0.28116513043642044, + 0.3696857150644064, + 0.07398313283920288, + 0.2013771664351225, + 0.5188022013753653, + 0.2309712078422308, + 0.2078605480492115, + 1.1137168239802122, + 0.09314326196908951, + 0.14212995395064354, + 0.32735631614923477, + 0.18514016643166542, + 0.0, + 0.4738337490707636, + 0.04906298220157623, + 0.19037534296512604, + 0.0, + 0.19252416864037514 + ], + "unique_experts": 58, + "load_cv": 0.807966132865042, + "normalized_load_entropy": 0.9210124763468606, + "max_load_share": 0.05555555555555555 + }, + "full_input": { + "tokens": 67, + "top_k": 6, + "decisions": 402, + "ordered_route_sha256": "c8e46d4578239808814de99b2451a4f7819baa4708d9799066b8316f37d0df91", + "route_weight_sha256": "f5c69e085fbcfeb22d691a88e86fce5ad104f2099e15df82982e4080558efe48", + "loads": [ + 10, + 2, + 0, + 7, + 0, + 14, + 2, + 7, + 3, + 12, + 4, + 12, + 1, + 8, + 3, + 12, + 5, + 1, + 8, + 6, + 1, + 3, + 0, + 13, + 4, + 10, + 11, + 10, + 19, + 1, + 6, + 12, + 2, + 15, + 2, + 1, + 2, + 5, + 3, + 4, + 2, + 3, + 2, + 15, + 3, + 3, + 11, + 11, + 1, + 6, + 13, + 13, + 9, + 18, + 2, + 6, + 4, + 6, + 1, + 21, + 1, + 5, + 0, + 5 + ], + "weighted_loads": [ + 0.8400545492768288, + 0.20676913112401962, + 0.0, + 0.25874430499970913, + 0.0, + 1.0929335821419954, + 0.08367311581969261, + 0.25153544545173645, + 0.166567862033844, + 0.7557037696242332, + 0.1433351244777441, + 0.9174624085426331, + 0.03307196870446205, + 0.3519718814641237, + 0.24561553075909615, + 0.5528452135622501, + 0.21587182767689228, + 0.03426996245980263, + 0.5238037705421448, + 0.3087109103798866, + 0.1097838282585144, + 0.0987926684319973, + 0.0, + 0.579617640003562, + 0.1478543896228075, + 0.3840460944920778, + 0.5850891955196857, + 0.6081906110048294, + 1.944341853260994, + 0.05628833919763565, + 0.3182681202888489, + 0.4925152715295553, + 0.11262984573841095, + 1.4411662630736828, + 0.06582203879952431, + 0.05676880478858948, + 0.08228588104248047, + 0.3612560145556927, + 0.166000884026289, + 0.17479965463280678, + 0.09678727388381958, + 0.12527131289243698, + 0.11946357786655426, + 1.3026960417628288, + 0.1386081837117672, + 0.1106166485697031, + 0.5674352459609509, + 0.458244938403368, + 0.07398313283920288, + 0.2441252376884222, + 0.6284032594412565, + 0.7416956964880228, + 0.950475599616766, + 1.539230303838849, + 0.09314326196908951, + 0.5068650282919407, + 0.32735631614923477, + 0.22983750328421593, + 0.041591230779886246, + 0.9552632663398981, + 0.04906298220157623, + 0.19037534296512604, + 0.0, + 0.19252416864037514 + ], + "unique_experts": 60, + "load_cv": 0.8317687845237677, + "normalized_load_entropy": 0.9153759435145276, + "max_load_share": 0.05223880597014925 + } + }, + "s1_bos": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "82fabae58ebfeb908dba06ee553e7430131db63014008f3d05ca78ddc36e14b8", + "route_weight_sha256": "b6c19813be09540adf4477ab9ca3a2a6ed5b0266c5d8a22a3bcc8879e17a0fb4", + "loads": [ + 5, + 2, + 0, + 4, + 0, + 4, + 2, + 5, + 4, + 4, + 3, + 9, + 1, + 7, + 3, + 9, + 5, + 0, + 2, + 6, + 1, + 1, + 0, + 4, + 3, + 4, + 5, + 4, + 11, + 1, + 3, + 6, + 2, + 9, + 2, + 1, + 2, + 3, + 0, + 5, + 2, + 2, + 2, + 15, + 0, + 3, + 5, + 10, + 1, + 4, + 9, + 5, + 3, + 12, + 2, + 2, + 4, + 5, + 2, + 11, + 1, + 5, + 0, + 5 + ], + "weighted_loads": [ + 0.22632078267633915, + 0.18588341027498245, + 0.0, + 0.12873043678700924, + 0.0, + 0.17870603874325752, + 0.08476388826966286, + 0.20133691653609276, + 0.19615356251597404, + 0.33143505081534386, + 0.10522549599409103, + 0.7467480823397636, + 0.030365796759724617, + 0.32296571135520935, + 0.23963772505521774, + 0.43569907918572426, + 0.21348750032484531, + 0.0, + 0.06881636753678322, + 0.31504761427640915, + 0.11408122628927231, + 0.03959446772933006, + 0.0, + 0.16591187566518784, + 0.10407932288944721, + 0.1670364774763584, + 0.2358524277806282, + 0.15711234509944916, + 0.787700118497014, + 0.056323546916246414, + 0.1119978204369545, + 0.227131562307477, + 0.10474298894405365, + 0.8813405893743038, + 0.06642927974462509, + 0.05913699045777321, + 0.05484146997332573, + 0.26219605281949043, + 0.0, + 0.20348957367241383, + 0.07262399606406689, + 0.08992069214582443, + 0.11911236867308617, + 1.2925647664815187, + 0.0, + 0.11072785407304764, + 0.2780386172235012, + 0.3841985445469618, + 0.0661303848028183, + 0.1686028242111206, + 0.505728492513299, + 0.1703066024929285, + 0.2002900093793869, + 1.1446597687900066, + 0.089487474411726, + 0.13804873451590538, + 0.32979900762438774, + 0.17866981215775013, + 0.06738163158297539, + 0.48057097755372524, + 0.04829021170735359, + 0.17962560802698135, + 0.0, + 0.18550355732440948 + ], + "unique_experts": 57, + "load_cv": 0.8252441861305371, + "normalized_load_entropy": 0.9187539043953772, + "max_load_share": 0.05952380952380952 + }, + "full_input": { + "tokens": 83, + "top_k": 6, + "decisions": 498, + "ordered_route_sha256": "2f7c93b0dabaff20730410ce9726c7334ea172bb15aab942c59c0d344cf4a6b4", + "route_weight_sha256": "56cda1a665779166f849b78179c0d02348c683265f08b40c99d76e1a38952db8", + "loads": [ + 12, + 3, + 0, + 7, + 3, + 20, + 2, + 8, + 6, + 16, + 3, + 12, + 6, + 7, + 3, + 15, + 5, + 0, + 9, + 9, + 3, + 5, + 0, + 12, + 9, + 8, + 10, + 12, + 25, + 2, + 8, + 10, + 4, + 20, + 3, + 2, + 2, + 6, + 3, + 6, + 2, + 2, + 3, + 16, + 3, + 4, + 11, + 13, + 3, + 6, + 23, + 9, + 11, + 22, + 4, + 5, + 5, + 8, + 3, + 29, + 4, + 6, + 2, + 8 + ], + "weighted_loads": [ + 0.9985442887991667, + 0.237660713493824, + 0.0, + 0.2633356209844351, + 0.20672496408224106, + 1.3066217489540577, + 0.08476388826966286, + 0.32788338512182236, + 0.3637930564582348, + 1.0977310948073864, + 0.10522549599409103, + 0.9629723094403744, + 0.3819087129086256, + 0.32296571135520935, + 0.23963772505521774, + 0.674434956163168, + 0.21348750032484531, + 0.0, + 0.5150807444006205, + 0.49148809537291527, + 0.3422093465924263, + 0.17327187210321426, + 0.0, + 0.5216233562678099, + 0.38429170846939087, + 0.3143314775079489, + 0.5983679741621017, + 0.5291667878627777, + 2.5093209501355886, + 0.10426630824804306, + 0.3720763064920902, + 0.3866879791021347, + 0.18483645096421242, + 1.9708376973867416, + 0.11409999430179596, + 0.13898936286568642, + 0.05484146997332573, + 0.6155795976519585, + 0.19053740426898003, + 0.261409854516387, + 0.07262399606406689, + 0.08992069214582443, + 0.17163221165537834, + 1.3388348873704672, + 0.10083800181746483, + 0.15130798891186714, + 0.5991473756730556, + 0.49799085035920143, + 0.1915326677262783, + 0.22415063716471195, + 1.3910735417157412, + 0.5995775870978832, + 1.0158770605921745, + 1.8860137686133385, + 0.17342771217226982, + 0.44262850657105446, + 0.38083532080054283, + 0.3091342318803072, + 0.17517109587788582, + 1.4788758736103773, + 0.301248736679554, + 0.2194809466600418, + 0.10349757224321365, + 0.29238733276724815 + ], + "unique_experts": 61, + "load_cv": 0.8154786343851438, + "normalized_load_entropy": 0.9268815220720978, + "max_load_share": 0.05823293172690763 + } + }, + "s0_x": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "f2deb685760d5d7aca3a744763084f8fa9686f3f50dee3d11004c22d3914d7b5", + "route_weight_sha256": "d35d06f1d3c1e434822715fa76a50cb76d5e8319a3254056975e4cdf162d0bcf", + "loads": [ + 2, + 2, + 0, + 4, + 0, + 5, + 2, + 7, + 4, + 5, + 3, + 10, + 1, + 8, + 3, + 9, + 5, + 0, + 4, + 6, + 1, + 1, + 0, + 1, + 2, + 6, + 5, + 4, + 10, + 1, + 4, + 7, + 2, + 9, + 2, + 1, + 1, + 3, + 0, + 4, + 1, + 2, + 2, + 15, + 1, + 3, + 4, + 9, + 1, + 5, + 10, + 4, + 4, + 12, + 2, + 2, + 4, + 3, + 1, + 11, + 2, + 5, + 0, + 5 + ], + "weighted_loads": [ + 0.12060662731528282, + 0.1952933892607689, + 0.0, + 0.12792020477354527, + 0.0, + 0.21909797564148903, + 0.0812084898352623, + 0.2527003884315491, + 0.20098762959241867, + 0.4427262246608734, + 0.10548154264688492, + 0.756305942311883, + 0.035192813724279404, + 0.35486089810729027, + 0.24470966681838036, + 0.4374392442405224, + 0.21757972426712513, + 0.0, + 0.13177597522735596, + 0.2956594005227089, + 0.10986322164535522, + 0.04003295302391052, + 0.0, + 0.07345695048570633, + 0.07826085388660431, + 0.2351809088140726, + 0.2423526905477047, + 0.15792011842131615, + 0.6380682811141014, + 0.0575605146586895, + 0.15357140451669693, + 0.25983675196766853, + 0.11393174901604652, + 0.9007938466966152, + 0.0685026217252016, + 0.05600319802761078, + 0.029624860733747482, + 0.2615300826728344, + 0.0, + 0.17795684933662415, + 0.058372095227241516, + 0.09029050916433334, + 0.11960022896528244, + 1.2897605039179325, + 0.03101971559226513, + 0.10407895408570766, + 0.24733418971300125, + 0.3342661149799824, + 0.07667183130979538, + 0.1997948419302702, + 0.5289190448820591, + 0.13329393230378628, + 0.22494256496429443, + 1.139969028532505, + 0.09161588922142982, + 0.13678020611405373, + 0.3391486518085003, + 0.11523433402180672, + 0.03284784406423569, + 0.49430990777909756, + 0.07620446756482124, + 0.1987849846482277, + 0.0, + 0.19797204434871674 + ], + "unique_experts": 58, + "load_cv": 0.8457502733179187, + "normalized_load_entropy": 0.9153357317058786, + "max_load_share": 0.05952380952380952 + }, + "full_input": { + "tokens": 67, + "top_k": 6, + "decisions": 402, + "ordered_route_sha256": "0e7d026b12efb03d90f7fe1e651df56b33759a25c49fafe2fde34aaf69ebb523", + "route_weight_sha256": "71fe6e10d7d3fd10ab07ca59ffdb3dc8203fe88f487ba1ab2dd9f7bc33720ede", + "loads": [ + 9, + 2, + 0, + 5, + 0, + 17, + 2, + 8, + 4, + 13, + 4, + 13, + 1, + 9, + 3, + 12, + 5, + 0, + 7, + 8, + 1, + 2, + 0, + 11, + 4, + 10, + 13, + 9, + 18, + 1, + 7, + 12, + 2, + 16, + 2, + 1, + 2, + 6, + 2, + 4, + 1, + 2, + 3, + 16, + 3, + 3, + 10, + 11, + 1, + 6, + 13, + 7, + 10, + 19, + 2, + 6, + 4, + 4, + 1, + 23, + 2, + 5, + 0, + 5 + ], + "weighted_loads": [ + 0.8836818262934685, + 0.1952933892607689, + 0.0, + 0.16795833595097065, + 0.0, + 1.2652035001665354, + 0.0812084898352623, + 0.2862708456814289, + 0.20098762959241867, + 0.8092596456408501, + 0.14038823917508125, + 0.9493654984980822, + 0.035192813724279404, + 0.4142150618135929, + 0.24470966681838036, + 0.5433846116065979, + 0.21757972426712513, + 0.0, + 0.35186945647001266, + 0.4094836190342903, + 0.10986322164535522, + 0.06845473870635033, + 0.0, + 0.5162403546273708, + 0.14176448620855808, + 0.38104250840842724, + 0.7267195340245962, + 0.5299560762941837, + 1.5603259205818176, + 0.0575605146586895, + 0.35939237102866173, + 0.48842836916446686, + 0.11393174901604652, + 1.5367121398448944, + 0.0685026217252016, + 0.05600319802761078, + 0.08198672905564308, + 0.43077392876148224, + 0.12427807226777077, + 0.17795684933662415, + 0.058372095227241516, + 0.09029050916433334, + 0.16690616309642792, + 1.3382510542869568, + 0.09375433810055256, + 0.10407895408570766, + 0.5492614842951298, + 0.422825338318944, + 0.07667183130979538, + 0.2425429131835699, + 0.6510875150561333, + 0.5235392916947603, + 0.9675576165318489, + 1.6517606936395168, + 0.09161588922142982, + 0.45846472308039665, + 0.3391486518085003, + 0.1555466279387474, + 0.03284784406423569, + 1.0281319115310907, + 0.07620446756482124, + 0.1987849846482277, + 0.0, + 0.19797204434871674 + ], + "unique_experts": 59, + "load_cv": 0.8676565566510159, + "normalized_load_entropy": 0.9094807399018044, + "max_load_share": 0.05721393034825871 + } + }, + "s1_x": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "1b310cb7aee92a7904e7c857f8d5b691e1fce34c2d4b73ac3bb9eecaa35f7973", + "route_weight_sha256": "4be91f41f6d70357aed9a5eb2dfb83c65d6b8a831b326d677db1504fc8277eaa", + "loads": [ + 4, + 2, + 0, + 4, + 0, + 7, + 2, + 7, + 4, + 5, + 1, + 9, + 1, + 8, + 3, + 8, + 5, + 0, + 3, + 6, + 1, + 1, + 0, + 3, + 1, + 7, + 5, + 4, + 10, + 1, + 5, + 5, + 1, + 10, + 2, + 1, + 2, + 3, + 1, + 5, + 1, + 1, + 2, + 16, + 0, + 3, + 4, + 7, + 1, + 5, + 9, + 6, + 5, + 12, + 2, + 2, + 4, + 3, + 2, + 9, + 1, + 5, + 0, + 5 + ], + "weighted_loads": [ + 0.177459716796875, + 0.18630095571279526, + 0.0, + 0.13615035079419613, + 0.0, + 0.28468917310237885, + 0.08236674591898918, + 0.26202256977558136, + 0.19769011810421944, + 0.3729807026684284, + 0.047851964831352234, + 0.782309103757143, + 0.03359676152467728, + 0.3602636530995369, + 0.2300793118774891, + 0.40264270827174187, + 0.20771661214530468, + 0.0, + 0.10554792359471321, + 0.3057136833667755, + 0.1114681288599968, + 0.038279883563518524, + 0.0, + 0.139222651720047, + 0.03398120030760765, + 0.2677979916334152, + 0.23594460263848305, + 0.1636516936123371, + 0.5312142483890057, + 0.05739744007587433, + 0.1883692778646946, + 0.1959713026881218, + 0.07489186525344849, + 0.9036031998693943, + 0.07219211012125015, + 0.05483562871813774, + 0.06215325742959976, + 0.2591172605752945, + 0.028546230867505074, + 0.2016746960580349, + 0.05820383131504059, + 0.05445892736315727, + 0.11892089247703552, + 1.3887986689805984, + 0.0, + 0.10269084945321083, + 0.25016016513109207, + 0.2601020522415638, + 0.06631837040185928, + 0.19617989845573902, + 0.510946286842227, + 0.19051003456115723, + 0.2551079988479614, + 1.1851512715220451, + 0.08810538053512573, + 0.134786918759346, + 0.35335981845855713, + 0.11049015633761883, + 0.06504001468420029, + 0.45165460370481014, + 0.04900867119431496, + 0.18205191381275654, + 0.0, + 0.2011823020875454 + ], + "unique_experts": 58, + "load_cv": 0.8349568463388831, + "normalized_load_entropy": 0.9159902355773939, + "max_load_share": 0.06349206349206349 + }, + "full_input": { + "tokens": 83, + "top_k": 6, + "decisions": 498, + "ordered_route_sha256": "e162f12524da20d5fd800b924d02bf27c87b007cf194927a76dc1cb5423fcc15", + "route_weight_sha256": "4b89cb6cac5ea70953c95066234167e63703d18a3e77646e941e41a1196277d3", + "loads": [ + 11, + 3, + 0, + 5, + 3, + 27, + 2, + 10, + 6, + 15, + 1, + 13, + 6, + 8, + 3, + 11, + 5, + 0, + 9, + 9, + 3, + 4, + 0, + 13, + 7, + 11, + 11, + 12, + 22, + 2, + 11, + 9, + 3, + 21, + 3, + 2, + 3, + 7, + 4, + 6, + 1, + 1, + 4, + 18, + 2, + 3, + 10, + 9, + 3, + 7, + 23, + 9, + 13, + 23, + 4, + 5, + 5, + 5, + 3, + 28, + 4, + 6, + 2, + 9 + ], + "weighted_loads": [ + 0.974540289491415, + 0.2380782589316368, + 0.0, + 0.17580808512866497, + 0.20672496408224106, + 1.6876594610512257, + 0.08236674591898918, + 0.38856903836131096, + 0.3653296120464802, + 0.9659965746104717, + 0.047851964831352234, + 1.0479310527443886, + 0.38513967767357826, + 0.3602636530995369, + 0.2300793118774891, + 0.5259988941252232, + 0.20771661214530468, + 0.0, + 0.5077470783144236, + 0.48215416446328163, + 0.3395962491631508, + 0.1404988057911396, + 0.0, + 0.585932707414031, + 0.3141935858875513, + 0.4215157497674227, + 0.7037303932011127, + 0.48813603073358536, + 1.81460902094841, + 0.10534020140767097, + 0.4489920660853386, + 0.33410331048071384, + 0.15498532727360725, + 1.9917361810803413, + 0.11986282467842102, + 0.13468800112605095, + 0.10029133781790733, + 0.7077140025794506, + 0.2107826303690672, + 0.25959497690200806, + 0.05820383131504059, + 0.05445892736315727, + 0.22892512753605843, + 1.4753566607832909, + 0.06230511888861656, + 0.10269084945321083, + 0.5728293433785439, + 0.3285414297133684, + 0.1917206533253193, + 0.25172771140933037, + 1.4001084361225367, + 0.5926734115928411, + 1.070695050060749, + 2.048364955931902, + 0.17204561829566956, + 0.32978419959545135, + 0.4043961316347122, + 0.19960236363112926, + 0.17282947897911072, + 1.4856612142175436, + 0.30196719616651535, + 0.221907252445817, + 0.10349757224321365, + 0.34128062799572945 + ], + "unique_experts": 61, + "load_cv": 0.8477511172169773, + "normalized_load_entropy": 0.9207464727495366, + "max_load_share": 0.05622489959839357 + } + }, + "s0_period": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "550e9ce94e903170c64d36d338308e95983d22b58fcc4f8222d6ae6239e56af8", + "route_weight_sha256": "d8d2b5265d731801113cb4d5ab07ad6ba3795ed47b129f53d1ee491071d232bf", + "loads": [ + 3, + 2, + 0, + 3, + 0, + 5, + 2, + 7, + 4, + 5, + 2, + 10, + 1, + 8, + 3, + 9, + 5, + 0, + 4, + 6, + 1, + 1, + 0, + 1, + 3, + 6, + 5, + 4, + 10, + 1, + 4, + 6, + 2, + 9, + 2, + 1, + 1, + 3, + 0, + 4, + 1, + 2, + 2, + 15, + 1, + 3, + 4, + 9, + 1, + 5, + 10, + 6, + 4, + 12, + 2, + 2, + 4, + 4, + 0, + 11, + 1, + 5, + 0, + 5 + ], + "weighted_loads": [ + 0.14879384636878967, + 0.19989922642707825, + 0.0, + 0.10186008736491203, + 0.0, + 0.2186466995626688, + 0.08339055627584457, + 0.24447751604020596, + 0.19754841923713684, + 0.46094027161598206, + 0.07640989869832993, + 0.7769114598631859, + 0.03431612625718117, + 0.3453582413494587, + 0.24025945737957954, + 0.4279322810471058, + 0.22181590646505356, + 0.0, + 0.13047794252634048, + 0.30080730468034744, + 0.10966766625642776, + 0.04225613921880722, + 0.0, + 0.0717170238494873, + 0.1022122222930193, + 0.23336809501051903, + 0.23880703188478947, + 0.1619165539741516, + 0.6543014943599701, + 0.057702165096998215, + 0.15229512378573418, + 0.23226791620254517, + 0.11260946840047836, + 0.9244248904287815, + 0.06753920391201973, + 0.056242093443870544, + 0.03467077016830444, + 0.25972624495625496, + 0.0, + 0.17229186743497849, + 0.05299766734242439, + 0.08966145291924477, + 0.11990311369299889, + 1.3119177836924791, + 0.030920252203941345, + 0.1035830769687891, + 0.24901412427425385, + 0.34603021293878555, + 0.07460187375545502, + 0.20127648673951626, + 0.5521831698715687, + 0.19283586740493774, + 0.24099265038967133, + 1.1456752866506577, + 0.0899302326142788, + 0.13776876404881477, + 0.3322762995958328, + 0.14454891346395016, + 0.0, + 0.49702563136816025, + 0.047125138342380524, + 0.19189768843352795, + 0.0, + 0.20695718377828598 + ], + "unique_experts": 57, + "load_cv": 0.8505033856900834, + "normalized_load_entropy": 0.9126089109013719, + "max_load_share": 0.05952380952380952 + }, + "full_input": { + "tokens": 67, + "top_k": 6, + "decisions": 402, + "ordered_route_sha256": "f72d27c021dd229ced31b5031aea2d9903119eb833deaca15192f880acad3f40", + "route_weight_sha256": "9c2aa43c9ecc72010939a13c454287306cedc41bb199fb2ab22e0e554a1b3015", + "loads": [ + 10, + 2, + 0, + 4, + 0, + 16, + 2, + 8, + 4, + 13, + 3, + 13, + 1, + 9, + 3, + 13, + 5, + 0, + 8, + 7, + 1, + 2, + 0, + 11, + 5, + 9, + 12, + 10, + 18, + 1, + 7, + 11, + 2, + 16, + 2, + 1, + 3, + 6, + 2, + 4, + 1, + 2, + 2, + 16, + 3, + 3, + 9, + 12, + 1, + 7, + 14, + 9, + 10, + 19, + 2, + 6, + 4, + 5, + 0, + 22, + 1, + 5, + 0, + 5 + ], + "weighted_loads": [ + 0.851718582212925, + 0.19989922642707825, + 0.0, + 0.14189821854233742, + 0.0, + 1.198840904980898, + 0.08339055627584457, + 0.2780479732900858, + 0.19754841923713684, + 0.8256000652909279, + 0.11131659522652626, + 0.9699710160493851, + 0.03431612625718117, + 0.3963652774691582, + 0.24025945737957954, + 0.5713508650660515, + 0.22181590646505356, + 0.0, + 0.4263133853673935, + 0.3407226502895355, + 0.10966766625642776, + 0.07119578123092651, + 0.0, + 0.5145004279911518, + 0.17483986169099808, + 0.34467847645282745, + 0.6366756614297628, + 0.5832711979746819, + 1.681142807006836, + 0.057702165096998215, + 0.3537408113479614, + 0.4559705890715122, + 0.11260946840047836, + 1.5448862835764885, + 0.06753920391201973, + 0.056242093443870544, + 0.1312088593840599, + 0.4147169627249241, + 0.12357963621616364, + 0.17229186743497849, + 0.05299766734242439, + 0.08966145291924477, + 0.11990311369299889, + 1.3604083340615034, + 0.09365487471222878, + 0.1035830769687891, + 0.4894257076084614, + 0.49808899126946926, + 0.07460187375545502, + 0.2905480768531561, + 0.7208899073302746, + 0.5830812267959118, + 0.9836077019572258, + 1.6536025516688824, + 0.0899302326142788, + 0.5299735181033611, + 0.3322762995958328, + 0.18379428423941135, + 0.0, + 0.9697066396474838, + 0.047125138342380524, + 0.19189768843352795, + 0.0, + 0.20695718377828598 + ], + "unique_experts": 58, + "load_cv": 0.8658288871882003, + "normalized_load_entropy": 0.9073414227883385, + "max_load_share": 0.05472636815920398 + } + }, + "s1_period": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "3de7206fcdf2956bc54b5eea7732675e0828d4850ec2afb4b52388e06be6be89", + "route_weight_sha256": "c32a3a155ccffb3976d7eb86555316e323a10e9b09839ead2b5f38e962a71f03", + "loads": [ + 3, + 2, + 0, + 2, + 0, + 7, + 2, + 7, + 4, + 5, + 1, + 10, + 1, + 8, + 3, + 10, + 5, + 0, + 4, + 6, + 1, + 1, + 0, + 3, + 1, + 7, + 5, + 4, + 10, + 1, + 4, + 6, + 2, + 11, + 2, + 1, + 0, + 3, + 0, + 4, + 1, + 1, + 2, + 16, + 0, + 2, + 5, + 8, + 1, + 4, + 11, + 4, + 5, + 12, + 2, + 2, + 4, + 3, + 1, + 11, + 1, + 5, + 0, + 5 + ], + "weighted_loads": [ + 0.149860180914402, + 0.182563416659832, + 0.0, + 0.08211084082722664, + 0.0, + 0.2888197097927332, + 0.08164994418621063, + 0.2612355053424835, + 0.19750234112143517, + 0.45442555844783783, + 0.045220859348773956, + 0.8228164575994015, + 0.035654857754707336, + 0.36472389101982117, + 0.2262907177209854, + 0.4611828997731209, + 0.2064930647611618, + 0.0, + 0.13415908254683018, + 0.3060355633497238, + 0.11384808272123337, + 0.03427208214998245, + 0.0, + 0.13677321188151836, + 0.03608299046754837, + 0.25836076214909554, + 0.2369111180305481, + 0.16114301420748234, + 0.5785570703446865, + 0.056671034544706345, + 0.15088706836104393, + 0.22481632605195045, + 0.10646532475948334, + 0.9627561531960964, + 0.07438166439533234, + 0.05586923658847809, + 0.0, + 0.2625887766480446, + 0.0, + 0.16514651104807854, + 0.0478428490459919, + 0.055952515453100204, + 0.11316860839724541, + 1.3948855139315128, + 0.0, + 0.07071571797132492, + 0.27705721743404865, + 0.292944323271513, + 0.06530635803937912, + 0.1642092876136303, + 0.6124224085360765, + 0.12647771835327148, + 0.26366253942251205, + 1.190961342304945, + 0.08609529584646225, + 0.1359866000711918, + 0.35501789674162865, + 0.10894493013620377, + 0.03356102481484413, + 0.5039587691426277, + 0.04740440472960472, + 0.18332540802657604, + 0.0, + 0.19894907623529434 + ], + "unique_experts": 56, + "load_cv": 0.905596941307677, + "normalized_load_entropy": 0.9023941668306448, + "max_load_share": 0.06349206349206349 + }, + "full_input": { + "tokens": 83, + "top_k": 6, + "decisions": 498, + "ordered_route_sha256": "8be719d4f784a6f5cfda225b59d30bef80499237944aa0f80139b8508953fc75", + "route_weight_sha256": "ca44da43771a67fbc31a3649673ddc2f12ebc445dc86d6efc645c58ea5d833e7", + "loads": [ + 10, + 3, + 0, + 4, + 4, + 24, + 2, + 10, + 6, + 16, + 1, + 13, + 6, + 8, + 3, + 13, + 5, + 0, + 10, + 9, + 3, + 4, + 0, + 12, + 9, + 11, + 11, + 11, + 23, + 2, + 10, + 11, + 4, + 21, + 3, + 2, + 0, + 7, + 3, + 5, + 1, + 1, + 3, + 18, + 2, + 2, + 10, + 11, + 3, + 7, + 25, + 7, + 13, + 24, + 4, + 5, + 5, + 5, + 2, + 30, + 4, + 6, + 2, + 9 + ], + "weighted_loads": [ + 0.9279933571815491, + 0.23434071987867355, + 0.0, + 0.1558464877307415, + 0.2495073564350605, + 1.4708746913820505, + 0.08164994418621063, + 0.3877819739282131, + 0.3651418350636959, + 1.117374949157238, + 0.045220859348773956, + 1.0390406847000122, + 0.3871977739036083, + 0.36472389101982117, + 0.2262907177209854, + 0.5869628898799419, + 0.2064930647611618, + 0.0, + 0.561595231294632, + 0.48247604444622993, + 0.34197620302438736, + 0.13649100437760353, + 0.0, + 0.5270264595746994, + 0.41996963135898113, + 0.407975809648633, + 0.6472071185708046, + 0.44580470956861973, + 1.8702538833022118, + 0.10461379587650299, + 0.4224017895758152, + 0.39821201376616955, + 0.1865587867796421, + 2.0268085189163685, + 0.1220523789525032, + 0.1357216089963913, + 0.0, + 0.7095262072980404, + 0.18252423033118248, + 0.2230667918920517, + 0.0478428490459919, + 0.055952515453100204, + 0.16568845137953758, + 1.4880569837987423, + 0.06230511888861656, + 0.07071571797132492, + 0.5578025672584772, + 0.39933099411427975, + 0.19070864096283913, + 0.26189268566668034, + 1.5114119928330183, + 0.5260902289301157, + 1.0792495906352997, + 2.0580133013427258, + 0.17003553360700607, + 0.43914075568318367, + 0.40605420991778374, + 0.19367149099707603, + 0.14135048910975456, + 1.5385509245097637, + 0.3003629297018051, + 0.2231807466596365, + 0.10349757224321365, + 0.33599323220551014 + ], + "unique_experts": 60, + "load_cv": 0.8776639604744433, + "normalized_load_entropy": 0.9140744268878853, + "max_load_share": 0.060240963855421686 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 42, + "ordered_topk_exact_tokens": 18, + "set_exact_tokens": 22, + "mean_set_jaccard": 0.8639455782312927, + "mean_token_weighted_tv": 0.02154982928186655, + "aggregate_load_tv": 0.05952380952380952 + }, + "system_bos": { + "tokens": 42, + "ordered_topk_exact_tokens": 20, + "set_exact_tokens": 25, + "mean_set_jaccard": 0.8690476190476191, + "mean_token_weighted_tv": 0.022557247873573077, + "aggregate_load_tv": 0.05555555555555555 + }, + "system_x": { + "tokens": 42, + "ordered_topk_exact_tokens": 18, + "set_exact_tokens": 24, + "mean_set_jaccard": 0.8622448979591837, + "mean_token_weighted_tv": 0.027709441259503365, + "aggregate_load_tv": 0.06746031746031746 + }, + "system_period": { + "tokens": 42, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 25, + "mean_set_jaccard": 0.8639455782312927, + "mean_token_weighted_tv": 0.028175538272729943, + "aggregate_load_tv": 0.051587301587301584 + }, + "bos_at_s0": { + "tokens": 42, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 18, + "mean_set_jaccard": 0.8112244897959183, + "mean_token_weighted_tv": 0.0353962552645022, + "aggregate_load_tv": 0.09523809523809523 + }, + "bos_at_s1": { + "tokens": 42, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.8095238095238095, + "mean_token_weighted_tv": 0.034754946983108916, + "aggregate_load_tv": 0.07539682539682539 + }, + "x_at_s0": { + "tokens": 42, + "ordered_topk_exact_tokens": 16, + "set_exact_tokens": 20, + "mean_set_jaccard": 0.8208616780045352, + "mean_token_weighted_tv": 0.03262142056510562, + "aggregate_load_tv": 0.09126984126984126 + }, + "x_at_s1": { + "tokens": 42, + "ordered_topk_exact_tokens": 8, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.8146258503401361, + "mean_token_weighted_tv": 0.03638012520968914, + "aggregate_load_tv": 0.07142857142857142 + }, + "period_at_s0": { + "tokens": 42, + "ordered_topk_exact_tokens": 19, + "set_exact_tokens": 22, + "mean_set_jaccard": 0.8395691609977324, + "mean_token_weighted_tv": 0.03155816787676442, + "aggregate_load_tv": 0.07936507936507936 + }, + "period_at_s1": { + "tokens": 42, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.8231292517006804, + "mean_token_weighted_tv": 0.03564051558662738, + "aggregate_load_tv": 0.08333333333333333 + } + } + }, + "layer_15": { + "layer": 15, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "3ea7540a1f010ccdad7736a0c9dd470630c5dcc46faa6cb411bc221161eb1399", + "route_weight_sha256": "8e3100f7bca0daa90ad0edb997feda134d1304da33c8804d67c35c41c3053fe0", + "loads": [ + 8, + 4, + 2, + 1, + 6, + 2, + 9, + 0, + 1, + 8, + 5, + 6, + 2, + 1, + 8, + 7, + 14, + 7, + 4, + 6, + 0, + 2, + 0, + 5, + 0, + 2, + 4, + 3, + 0, + 6, + 4, + 5, + 5, + 4, + 0, + 3, + 8, + 3, + 2, + 0, + 4, + 7, + 3, + 3, + 3, + 0, + 1, + 8, + 11, + 6, + 7, + 2, + 3, + 4, + 6, + 3, + 2, + 0, + 2, + 4, + 1, + 6, + 1, + 8 + ], + "weighted_loads": [ + 0.41788244619965553, + 0.15280104987323284, + 0.07353127002716064, + 0.03349684923887253, + 0.40556742437183857, + 0.08913861587643623, + 1.4875450283288956, + 0.0, + 0.029497334733605385, + 0.4958211835473776, + 0.24149103090167046, + 0.4126598071306944, + 0.0763065479695797, + 0.03193964436650276, + 0.3170624878257513, + 0.7937899678945541, + 1.5592842623591423, + 0.23961363546550274, + 0.20166604965925217, + 0.34979113936424255, + 0.0, + 0.13468897715210915, + 0.0, + 0.22515477798879147, + 0.0, + 0.2834957465529442, + 0.22713624313473701, + 0.16648706421256065, + 0.0, + 0.2298748530447483, + 0.15349172800779343, + 0.17663289420306683, + 0.46922189369797707, + 0.18491293862462044, + 0.0, + 0.08971287310123444, + 0.3715704120695591, + 0.12257138267159462, + 0.07175689563155174, + 0.0, + 0.23629025742411613, + 0.256507333368063, + 0.31262337788939476, + 0.13217378593981266, + 0.11212259531021118, + 0.0, + 0.09464237838983536, + 0.26071253791451454, + 1.3685383088886738, + 0.34778664354234934, + 0.24337596260011196, + 0.078225277364254, + 0.0993178877979517, + 0.11560865119099617, + 0.21907908655703068, + 0.11507692188024521, + 0.13012100756168365, + 0.0, + 0.16182857751846313, + 0.22287951968610287, + 0.04421129450201988, + 0.29491102509200573, + 0.028353199362754822, + 0.27075586281716824 + ], + "unique_experts": 55, + "load_cv": 0.7643808970053655, + "normalized_load_entropy": 0.9211220067673445, + "max_load_share": 0.05555555555555555 + }, + "full_input": { + "tokens": 67, + "top_k": 6, + "decisions": 402, + "ordered_route_sha256": "cb772e4f37b791c12f951199efea18f62140c36e7fe1393c3e09dffdb8659778", + "route_weight_sha256": "3f7cfe8764b7c804f9e94b193068d989248476ab1ecf4aa76cab15716842b922", + "loads": [ + 10, + 4, + 2, + 1, + 12, + 5, + 15, + 2, + 8, + 9, + 10, + 7, + 7, + 1, + 18, + 8, + 21, + 10, + 4, + 8, + 0, + 2, + 0, + 10, + 4, + 3, + 13, + 3, + 3, + 6, + 9, + 5, + 10, + 6, + 0, + 3, + 13, + 3, + 3, + 1, + 10, + 9, + 3, + 6, + 3, + 0, + 1, + 9, + 12, + 15, + 13, + 4, + 9, + 4, + 7, + 7, + 2, + 0, + 3, + 4, + 1, + 7, + 1, + 13 + ], + "weighted_loads": [ + 0.5122638940811157, + 0.15280104987323284, + 0.07353127002716064, + 0.03349684923887253, + 0.7948830388486385, + 0.1559636015444994, + 1.9176480509340763, + 0.06934306025505066, + 0.5468900930136442, + 0.5272971261292696, + 0.4281023442745209, + 0.4428902566432953, + 0.4784308783710003, + 0.03193964436650276, + 0.6874088384211063, + 0.8257075473666191, + 2.2331516183912754, + 0.3483063895255327, + 0.20166604965925217, + 0.4563601240515709, + 0.0, + 0.13468897715210915, + 0.0, + 0.4962772224098444, + 0.10577677236869931, + 0.31191584654152393, + 0.8668751418590546, + 0.16648706421256065, + 0.11262395419180393, + 0.2298748530447483, + 0.3631268348544836, + 0.17663289420306683, + 0.8740429636090994, + 0.27993495762348175, + 0.0, + 0.08971287310123444, + 1.1027888543903828, + 0.12257138267159462, + 0.10188701748847961, + 0.03891400247812271, + 0.5218953059520572, + 0.29954370111227036, + 0.31262337788939476, + 0.26241897605359554, + 0.11212259531021118, + 0.0, + 0.09464237838983536, + 0.2951604835689068, + 1.3820351278409362, + 1.2290364848449826, + 0.5723735187202692, + 0.16018935292959213, + 0.2791594509035349, + 0.11560865119099617, + 0.2552247066050768, + 1.773688554763794, + 0.13012100756168365, + 0.0, + 0.2127828598022461, + 0.22287951968610287, + 0.04421129450201988, + 0.3416260126978159, + 0.028353199362754822, + 0.47356726974248886 + ], + "unique_experts": 59, + "load_cv": 0.7585555677357052, + "normalized_load_entropy": 0.9262000224748034, + "max_load_share": 0.05223880597014925 + } + }, + "s1_eos": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "59e745b3dc5bd98f9a27f95a885f01f865695b07ebb23d16b5d86c27896961c5", + "route_weight_sha256": "99ae48899a19652476d7f1a1346c233766222045e9c0ce56eba4868ea7bbea87", + "loads": [ + 10, + 5, + 2, + 1, + 7, + 2, + 9, + 0, + 1, + 9, + 5, + 5, + 2, + 1, + 8, + 7, + 14, + 6, + 4, + 6, + 0, + 2, + 0, + 4, + 1, + 2, + 4, + 3, + 0, + 7, + 2, + 4, + 5, + 4, + 0, + 3, + 9, + 3, + 4, + 0, + 4, + 7, + 3, + 3, + 3, + 0, + 1, + 6, + 11, + 7, + 6, + 2, + 4, + 3, + 5, + 5, + 2, + 1, + 2, + 4, + 1, + 6, + 0, + 5 + ], + "weighted_loads": [ + 0.44609441235661507, + 0.19108248502016068, + 0.0731780156493187, + 0.03440161421895027, + 0.44478247314691544, + 0.08043614402413368, + 1.4828616958111525, + 0.0, + 0.025969769805669785, + 0.5370460748672485, + 0.23344792798161507, + 0.3788839504122734, + 0.07022826001048088, + 0.029667723923921585, + 0.32234961725771427, + 0.8169456273317337, + 1.5498578250408173, + 0.21556418761610985, + 0.21139750257134438, + 0.35351039469242096, + 0.0, + 0.1332887001335621, + 0.0, + 0.20285221189260483, + 0.048306770622730255, + 0.2804723083972931, + 0.2265622764825821, + 0.16838469356298447, + 0.0, + 0.2588043753057718, + 0.08333532884716988, + 0.1482323855161667, + 0.4778725504875183, + 0.1756005696952343, + 0.0, + 0.09204667434096336, + 0.3935272265225649, + 0.11696828901767731, + 0.1400382947176695, + 0.0, + 0.2365725990384817, + 0.25358150713145733, + 0.30334384366869926, + 0.13390768505632877, + 0.10660582780838013, + 0.0, + 0.09492073208093643, + 0.19822382554411888, + 1.3788112662732601, + 0.40377454459667206, + 0.19879752211272717, + 0.0859052985906601, + 0.1288775634020567, + 0.09680451638996601, + 0.1778273992240429, + 0.1685252357274294, + 0.13338061422109604, + 0.03186028450727463, + 0.1577390357851982, + 0.22506927885115147, + 0.04351232573390007, + 0.3047696705907583, + 0.0, + 0.17739221826195717 + ], + "unique_experts": 56, + "load_cv": 0.7656982282661802, + "normalized_load_entropy": 0.9231167823349824, + "max_load_share": 0.05555555555555555 + }, + "full_input": { + "tokens": 83, + "top_k": 6, + "decisions": 498, + "ordered_route_sha256": "21ce60ab4a4fcb6cd8c52deef994efc026e7d12ca2e4b4eeaba7af61b9dcc831", + "route_weight_sha256": "69505545d88c7f3e1dc219a8e9422700818a2a670fdc0f6a7126b7e77bbdf9ea", + "loads": [ + 28, + 6, + 2, + 1, + 16, + 7, + 21, + 2, + 12, + 10, + 10, + 9, + 8, + 2, + 13, + 17, + 26, + 10, + 5, + 9, + 1, + 3, + 0, + 9, + 3, + 3, + 14, + 5, + 6, + 8, + 9, + 8, + 11, + 7, + 2, + 3, + 15, + 3, + 5, + 2, + 10, + 10, + 3, + 6, + 3, + 1, + 1, + 9, + 14, + 19, + 14, + 4, + 5, + 4, + 7, + 9, + 2, + 7, + 4, + 8, + 1, + 13, + 2, + 11 + ], + "weighted_loads": [ + 1.6281746737658978, + 0.21755308657884598, + 0.0731780156493187, + 0.03440161421895027, + 0.9561357237398624, + 0.2858589328825474, + 2.410060554742813, + 0.06772179901599884, + 0.7023596446961164, + 0.5680727139115334, + 0.4636380672454834, + 0.7109918668866158, + 0.557243725284934, + 0.1108662374317646, + 0.49328234419226646, + 1.4811784159392118, + 2.6876370422542095, + 0.3709549270570278, + 0.26169929280877113, + 0.5766692273318768, + 0.028784895315766335, + 0.21385889872908592, + 0.0, + 0.44510074704885483, + 0.08255984797142446, + 0.30898986384272575, + 0.914095439016819, + 0.29391659051179886, + 0.42600656673312187, + 0.2971804719418287, + 0.34214351139962673, + 0.601159829646349, + 0.9062879644334316, + 0.3223022911697626, + 0.14883409067988396, + 0.09204667434096336, + 1.1036941912025213, + 0.11696828901767731, + 0.17315230332314968, + 0.08114276826381683, + 0.5051003131084144, + 0.3822954245842993, + 0.30334384366869926, + 0.44246344827115536, + 0.10660582780838013, + 0.03762061893939972, + 0.09492073208093643, + 0.2908859569579363, + 1.5230206763371825, + 2.0925192944705486, + 0.5833243429660797, + 0.15946020185947418, + 0.14277046918869019, + 0.2379951197654009, + 0.24418130703270435, + 1.8168623987585306, + 0.13338061422109604, + 0.6927730813622475, + 0.23953944817185402, + 0.39954944513738155, + 0.04351232573390007, + 0.6827795896679163, + 0.11621781811118126, + 0.4107792731374502 + ], + "unique_experts": 63, + "load_cv": 0.7635065229646085, + "normalized_load_entropy": 0.9333488282225425, + "max_load_share": 0.05622489959839357 + } + }, + "s0_bos": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "67d3d04eb40b1392df70983881f803926854bcf8fb5f6d6aef13096262d8066b", + "route_weight_sha256": "e6574e649b38cc85da42533529d62f26975f69ab8ea7e58c406b9696903ac0f6", + "loads": [ + 11, + 5, + 2, + 1, + 6, + 2, + 8, + 0, + 1, + 9, + 5, + 6, + 1, + 1, + 6, + 7, + 14, + 9, + 4, + 6, + 1, + 2, + 1, + 5, + 0, + 2, + 3, + 3, + 0, + 7, + 3, + 5, + 5, + 3, + 0, + 2, + 9, + 3, + 4, + 1, + 4, + 5, + 3, + 2, + 3, + 0, + 1, + 7, + 11, + 6, + 5, + 2, + 3, + 4, + 6, + 3, + 2, + 0, + 2, + 4, + 2, + 6, + 1, + 7 + ], + "weighted_loads": [ + 0.4943264778703451, + 0.17187818326056004, + 0.07235387712717056, + 0.03401494026184082, + 0.40623381920158863, + 0.07645263522863388, + 1.531846009194851, + 0.0, + 0.033953770995140076, + 0.5040767304599285, + 0.2623845934867859, + 0.4207017105072737, + 0.04490005597472191, + 0.02894464135169983, + 0.23716506734490395, + 0.8283079825341702, + 1.516036480665207, + 0.31774787977337837, + 0.20120295882225037, + 0.34349527209997177, + 0.032217588275671005, + 0.13331370055675507, + 0.03456522524356842, + 0.21651933155953884, + 0.0, + 0.2762226238846779, + 0.19840112701058388, + 0.1652018129825592, + 0.0, + 0.28067099675536156, + 0.13679436221718788, + 0.18705187924206257, + 0.4942843019962311, + 0.1532704159617424, + 0.0, + 0.06083281710743904, + 0.3984611500054598, + 0.1182214692234993, + 0.1294757891446352, + 0.03312947601079941, + 0.22976185008883476, + 0.19244841486215591, + 0.3126571364700794, + 0.09425497055053711, + 0.11848284304141998, + 0.0, + 0.09738343954086304, + 0.2377665974199772, + 1.3168130479753017, + 0.399607015773654, + 0.20962806791067123, + 0.09939825534820557, + 0.09844230115413666, + 0.11518066748976707, + 0.21888122335076332, + 0.12797850370407104, + 0.12853485718369484, + 0.0, + 0.16293451935052872, + 0.23463072627782822, + 0.0784880556166172, + 0.2947017587721348, + 0.02810017764568329, + 0.238342197611928 + ], + "unique_experts": 58, + "load_cv": 0.7683261149384729, + "normalized_load_entropy": 0.9259525578543513, + "max_load_share": 0.05555555555555555 + }, + "full_input": { + "tokens": 67, + "top_k": 6, + "decisions": 402, + "ordered_route_sha256": "223ea61501d79a814d11c67b5b8136954e4a3a4967217c21722966a5be2ddea6", + "route_weight_sha256": "1fdeb245c184284f6b21288ef5b26ae834ddb48e479962a9216f6d8d67d4db21", + "loads": [ + 14, + 5, + 2, + 1, + 11, + 4, + 13, + 2, + 7, + 10, + 10, + 7, + 6, + 1, + 15, + 8, + 21, + 11, + 4, + 8, + 1, + 2, + 1, + 10, + 3, + 3, + 12, + 3, + 4, + 7, + 9, + 5, + 10, + 5, + 0, + 3, + 15, + 3, + 5, + 2, + 11, + 6, + 3, + 5, + 3, + 0, + 1, + 8, + 12, + 14, + 12, + 5, + 9, + 5, + 9, + 5, + 2, + 0, + 3, + 4, + 2, + 7, + 1, + 12 + ], + "weighted_loads": [ + 0.6185907479375601, + 0.17187818326056004, + 0.07235387712717056, + 0.03401494026184082, + 0.7232367396354675, + 0.14730345830321312, + 1.8414696604013443, + 0.06934306025505066, + 0.5280351266264915, + 0.5355526730418205, + 0.4489959068596363, + 0.4509321600198746, + 0.4419845826923847, + 0.02894464135169983, + 0.5974592808634043, + 0.8602255620062351, + 2.1941203586757183, + 0.39148372039198875, + 0.20120295882225037, + 0.4500642567873001, + 0.032217588275671005, + 0.13331370055675507, + 0.03456522524356842, + 0.4876417759805918, + 0.11734974756836891, + 0.30464272387325764, + 0.8381400257349014, + 0.1652018129825592, + 0.18158663250505924, + 0.28067099675536156, + 0.4104717019945383, + 0.18705187924206257, + 0.8991053719073534, + 0.24829243496060371, + 0.0, + 0.15237735584378242, + 1.1474647615104914, + 0.1182214692234993, + 0.15960591100156307, + 0.07064882665872574, + 0.6250783056020737, + 0.22919931262731552, + 0.3126571364700794, + 0.2238042689859867, + 0.11848284304141998, + 0.0, + 0.09738343954086304, + 0.27221454307436943, + 1.3303098669275641, + 1.2056417856365442, + 0.6084091514348984, + 0.23196445405483246, + 0.27828386425971985, + 0.1754867546260357, + 0.3542271554470062, + 0.7663639932870865, + 0.12853485718369484, + 0.0, + 0.21388880163431168, + 0.23463072627782822, + 0.0784880556166172, + 0.34141674637794495, + 0.02810017764568329, + 0.4580106884241104 + ], + "unique_experts": 61, + "load_cv": 0.7271004282739888, + "normalized_load_entropy": 0.9337974660160532, + "max_load_share": 0.05223880597014925 + } + }, + "s1_bos": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "1b705b1721fd79340e2487bd4acebaa54a6020cbf9667b43459d2692d0858728", + "route_weight_sha256": "ea6b8d815d7ab6659c8a790e5dd36df1823790b27548aeeb8abc31aeeb02afe3", + "loads": [ + 9, + 5, + 2, + 1, + 7, + 1, + 9, + 0, + 2, + 7, + 5, + 7, + 2, + 0, + 6, + 7, + 15, + 5, + 4, + 6, + 0, + 2, + 0, + 5, + 2, + 2, + 5, + 3, + 0, + 6, + 3, + 5, + 5, + 3, + 1, + 4, + 8, + 3, + 3, + 1, + 4, + 4, + 3, + 2, + 3, + 0, + 1, + 8, + 11, + 8, + 5, + 2, + 3, + 4, + 5, + 4, + 2, + 1, + 2, + 4, + 1, + 6, + 1, + 7 + ], + "weighted_loads": [ + 0.44765350595116615, + 0.18798330053687096, + 0.07293924689292908, + 0.03454044088721275, + 0.4285768326371908, + 0.04125356674194336, + 1.5478251185268164, + 0.0, + 0.06650310568511486, + 0.4577627219259739, + 0.2510962635278702, + 0.4641068410128355, + 0.07514866627752781, + 0.0, + 0.2323013637214899, + 0.8279266059398651, + 1.5545076187700033, + 0.19003821536898613, + 0.21125996857881546, + 0.3451990336179733, + 0.0, + 0.13198966532945633, + 0.0, + 0.22978362254798412, + 0.08171171136200428, + 0.27434809505939484, + 0.24100815691053867, + 0.1639152094721794, + 0.0, + 0.22930653393268585, + 0.1173577569425106, + 0.18666833266615868, + 0.4980006404221058, + 0.14734093844890594, + 0.02902492880821228, + 0.12182542867958546, + 0.3582751527428627, + 0.11498456634581089, + 0.10049965046346188, + 0.03163976967334747, + 0.2391567137092352, + 0.1610957495868206, + 0.3105081766843796, + 0.09647967480123043, + 0.11280027776956558, + 0.0, + 0.09591442346572876, + 0.2685204017907381, + 1.2762150056660175, + 0.49361219070851803, + 0.22061555460095406, + 0.08121294900774956, + 0.10055939480662346, + 0.11895119585096836, + 0.19103752076625824, + 0.15142834559082985, + 0.13069533556699753, + 0.028871115297079086, + 0.15392909944057465, + 0.23357902094721794, + 0.03822699561715126, + 0.30668124556541443, + 0.0279151052236557, + 0.2511286921799183 + ], + "unique_experts": 58, + "load_cv": 0.7470442302063551, + "normalized_load_entropy": 0.9297198395372464, + "max_load_share": 0.05952380952380952 + }, + "full_input": { + "tokens": 83, + "top_k": 6, + "decisions": 498, + "ordered_route_sha256": "cb337b2dcbb2bddfc9f062b29c70b58c1bba7456d80d99fbadeb06ecc55d6a59", + "route_weight_sha256": "15ace66c8d9bae888d5fb5e6c5c44cab341cba0366479fe46bad679dd76a315d", + "loads": [ + 28, + 6, + 2, + 1, + 16, + 6, + 21, + 2, + 12, + 8, + 10, + 11, + 8, + 1, + 10, + 17, + 27, + 9, + 5, + 9, + 1, + 3, + 0, + 10, + 6, + 3, + 15, + 5, + 6, + 7, + 11, + 9, + 11, + 6, + 3, + 4, + 15, + 3, + 4, + 3, + 10, + 6, + 3, + 5, + 3, + 1, + 1, + 9, + 14, + 21, + 14, + 4, + 4, + 5, + 6, + 7, + 2, + 7, + 4, + 8, + 1, + 13, + 3, + 13 + ], + "weighted_loads": [ + 1.698844101279974, + 0.21445390209555626, + 0.07293924689292908, + 0.03454044088721275, + 0.8608493451029062, + 0.2851095236837864, + 2.40059906989336, + 0.06772179901599884, + 0.7056945450603962, + 0.4887893609702587, + 0.4812864027917385, + 0.7962147574871778, + 0.549053642898798, + 0.08119851350784302, + 0.3916992973536253, + 1.4921593945473433, + 2.7143283654004335, + 0.3454289548099041, + 0.2615617588162422, + 0.5683578662574291, + 0.028784895315766335, + 0.21255986392498016, + 0.0, + 0.4720321577042341, + 0.24724562652409077, + 0.3028656505048275, + 0.9285413194447756, + 0.2894471064209938, + 0.42600656673312187, + 0.26768263056874275, + 0.427126994356513, + 0.6395957767963409, + 0.9264160543680191, + 0.29404265992343426, + 0.17785901948809624, + 0.12182542867958546, + 1.0847702100872993, + 0.11498456634581089, + 0.13361365906894207, + 0.10923021286725998, + 0.635792987421155, + 0.2843014970421791, + 0.3105081766843796, + 0.40433461032807827, + 0.11280027776956558, + 0.03762061893939972, + 0.09591442346572876, + 0.3027146030217409, + 1.42042441572994, + 2.2598423529416323, + 0.6306094918400049, + 0.15476785227656364, + 0.11445230059325695, + 0.26014179922640324, + 0.21951258927583694, + 0.8626620583236217, + 0.13069533556699753, + 0.6897839121520519, + 0.23572951182723045, + 0.40805918723344803, + 0.03822699561715126, + 0.6846911646425724, + 0.14413292333483696, + 0.49297516234219074 + ], + "unique_experts": 63, + "load_cv": 0.7765764084821252, + "normalized_load_entropy": 0.9327071672686484, + "max_load_share": 0.05622489959839357 + } + }, + "s0_x": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "7c91df75aac80d95f4761bd9988662048517958bc46ed055e5a660534382744a", + "route_weight_sha256": "440fd065e60635cd67b949df4e0daa5f45683a166b3d42265d2ef023f8f63f95", + "loads": [ + 8, + 5, + 2, + 1, + 5, + 1, + 9, + 0, + 2, + 9, + 5, + 5, + 1, + 1, + 5, + 7, + 14, + 9, + 4, + 6, + 1, + 2, + 0, + 5, + 1, + 2, + 4, + 3, + 0, + 7, + 2, + 4, + 5, + 4, + 0, + 3, + 8, + 3, + 3, + 2, + 3, + 6, + 3, + 3, + 4, + 0, + 1, + 7, + 12, + 6, + 8, + 2, + 4, + 4, + 4, + 4, + 2, + 0, + 2, + 4, + 2, + 6, + 1, + 6 + ], + "weighted_loads": [ + 0.38465917855501175, + 0.1880246140062809, + 0.06824854388833046, + 0.03455056622624397, + 0.3850512020289898, + 0.0403391569852829, + 1.530336445197463, + 0.0, + 0.08911105990409851, + 0.524444816634059, + 0.2573559395968914, + 0.38983531668782234, + 0.043440282344818115, + 0.029391907155513763, + 0.2146612424403429, + 0.8274121843278408, + 1.603656493127346, + 0.3232925534248352, + 0.18311313167214394, + 0.36955399438738823, + 0.03322898969054222, + 0.13091324642300606, + 0.0, + 0.21734292432665825, + 0.0534466877579689, + 0.2669227197766304, + 0.2140854299068451, + 0.16724035516381264, + 0.0, + 0.27835693024098873, + 0.08152904361486435, + 0.15109438821673393, + 0.5056969486176968, + 0.17608009278774261, + 0.0, + 0.08175318501889706, + 0.37870632484555244, + 0.11728555150330067, + 0.1060511115938425, + 0.06721584126353264, + 0.19939588010311127, + 0.22239682264626026, + 0.31718654930591583, + 0.11700954474508762, + 0.14702923223376274, + 0.0, + 0.09390739351511002, + 0.22211046516895294, + 1.3565028980374336, + 0.29808779805898666, + 0.3250865712761879, + 0.09791305661201477, + 0.12902145087718964, + 0.11224282160401344, + 0.15353018790483475, + 0.15260950662195683, + 0.1371210366487503, + 0.0, + 0.15551849454641342, + 0.2411820963025093, + 0.07324721477925777, + 0.3083269353955984, + 0.028769226744771004, + 0.23286628350615501 + ], + "unique_experts": 58, + "load_cv": 0.7483920783572244, + "normalized_load_entropy": 0.9294371842225726, + "max_load_share": 0.05555555555555555 + }, + "full_input": { + "tokens": 67, + "top_k": 6, + "decisions": 402, + "ordered_route_sha256": "9a39733ee79f0021efd7b085861fcf05b2daf1d99915a50cb27a51afd133a3e7", + "route_weight_sha256": "64cffad87bd98d6994ff07a5f648e08571e34f4dcd52e3b8df9690c20f668ed6", + "loads": [ + 9, + 5, + 2, + 1, + 11, + 2, + 15, + 2, + 9, + 10, + 11, + 6, + 6, + 1, + 14, + 8, + 21, + 11, + 4, + 9, + 1, + 2, + 0, + 11, + 4, + 3, + 15, + 3, + 3, + 7, + 8, + 4, + 10, + 6, + 0, + 3, + 13, + 3, + 4, + 3, + 9, + 8, + 3, + 6, + 4, + 0, + 1, + 8, + 13, + 14, + 14, + 4, + 11, + 5, + 5, + 7, + 2, + 0, + 3, + 4, + 2, + 8, + 1, + 10 + ], + "weighted_loads": [ + 0.41854003071784973, + 0.1880246140062809, + 0.06824854388833046, + 0.03455056622624397, + 0.7519509699195623, + 0.05908204987645149, + 1.9781068321317434, + 0.06934306025505066, + 0.64318972453475, + 0.555920759215951, + 0.5136059448122978, + 0.42006576620042324, + 0.4385988302528858, + 0.029391907155513763, + 0.5749554559588432, + 0.8593297637999058, + 2.305327419191599, + 0.3970283940434456, + 0.18311313167214394, + 0.5245550833642483, + 0.03322898969054222, + 0.13091324642300606, + 0.0, + 0.5850468948483467, + 0.1427134871482849, + 0.29534281976521015, + 1.0073507018387318, + 0.16724035516381264, + 0.11262395419180393, + 0.27835693024098873, + 0.3328541312366724, + 0.15109438821673393, + 0.9105180185288191, + 0.2711021117866039, + 0.0, + 0.08175318501889706, + 1.050011407583952, + 0.11728555150330067, + 0.13618123345077038, + 0.108038030564785, + 0.49733105301856995, + 0.2881667781621218, + 0.31718654930591583, + 0.2891369741410017, + 0.14702923223376274, + 0.0, + 0.09390739351511002, + 0.2565584108233452, + 1.369999716989696, + 1.0589965097606182, + 0.6551779247820377, + 0.1798771321773529, + 0.34684765338897705, + 0.14761165902018547, + 0.18740257993340492, + 0.8393856566399336, + 0.1371210366487503, + 0.0, + 0.20647277683019638, + 0.2411820963025093, + 0.07324721477925777, + 0.4208915326744318, + 0.028769226744771004, + 0.39256362058222294 + ], + "unique_experts": 60, + "load_cv": 0.736839267168186, + "normalized_load_entropy": 0.931137265513642, + "max_load_share": 0.05223880597014925 + } + }, + "s1_x": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "4277a0d7c0333fbf10f60a773ae4d50b34d4570ff954818de4486212f05cb81e", + "route_weight_sha256": "6d46636d55890d7cd61beffc117ceb98ad61700b7df33934eb8463f546c50e75", + "loads": [ + 9, + 4, + 2, + 1, + 7, + 1, + 9, + 0, + 2, + 9, + 5, + 6, + 1, + 0, + 6, + 7, + 15, + 7, + 4, + 6, + 0, + 2, + 0, + 4, + 1, + 2, + 5, + 3, + 0, + 6, + 2, + 6, + 5, + 4, + 0, + 4, + 8, + 3, + 3, + 1, + 4, + 6, + 3, + 2, + 4, + 0, + 1, + 5, + 11, + 6, + 6, + 2, + 4, + 4, + 5, + 5, + 2, + 1, + 2, + 4, + 1, + 7, + 1, + 6 + ], + "weighted_loads": [ + 0.4517943672835827, + 0.15221293829381466, + 0.07214057818055153, + 0.03588056564331055, + 0.45766863971948624, + 0.039830081164836884, + 1.4791173189878464, + 0.0, + 0.08233053609728813, + 0.5493861176073551, + 0.2522689811885357, + 0.39628402702510357, + 0.04300166666507721, + 0.0, + 0.24290918931365013, + 0.8396129421889782, + 1.6395237483084202, + 0.24813348054885864, + 0.19790521636605263, + 0.3860249128192663, + 0.0, + 0.13336629793047905, + 0.0, + 0.19499190710484982, + 0.040787748992443085, + 0.2645941898226738, + 0.2454851884394884, + 0.16796641051769257, + 0.0, + 0.23259716108441353, + 0.07574596628546715, + 0.205531507730484, + 0.5169950574636459, + 0.15564949065446854, + 0.0, + 0.11788024380803108, + 0.35168095491826534, + 0.11269200220704079, + 0.10722042992711067, + 0.03261784836649895, + 0.22868095338344574, + 0.2164121363312006, + 0.29700973257422447, + 0.09995178505778313, + 0.13975778967142105, + 0.0, + 0.09058180451393127, + 0.1637609638273716, + 1.377706540748477, + 0.258630458265543, + 0.2542426399886608, + 0.08900154754519463, + 0.13255133107304573, + 0.1139566395431757, + 0.17598402127623558, + 0.18642956390976906, + 0.13968594372272491, + 0.031224548816680908, + 0.15733764320611954, + 0.23872263729572296, + 0.040246691554784775, + 0.3666083849966526, + 0.030228545889258385, + 0.23498199507594109 + ], + "unique_experts": 57, + "load_cv": 0.7590887111884662, + "normalized_load_entropy": 0.9253691489630084, + "max_load_share": 0.05952380952380952 + }, + "full_input": { + "tokens": 83, + "top_k": 6, + "decisions": 498, + "ordered_route_sha256": "8cf5a631c378b7287dcbb8bfe55d4cb58894f9eb0bd76edfb98cd46dabad9348", + "route_weight_sha256": "ae4aebdd5440e9e673f7307e9f75a84f4e8f1fd0779e6d020e44cb2b3bc2b7dd", + "loads": [ + 27, + 5, + 2, + 1, + 15, + 4, + 21, + 2, + 14, + 10, + 11, + 10, + 7, + 1, + 10, + 19, + 27, + 11, + 5, + 10, + 1, + 3, + 0, + 10, + 5, + 3, + 16, + 5, + 6, + 8, + 8, + 10, + 12, + 7, + 2, + 4, + 14, + 3, + 4, + 3, + 8, + 9, + 3, + 5, + 4, + 1, + 1, + 6, + 14, + 18, + 13, + 5, + 6, + 5, + 5, + 9, + 2, + 7, + 4, + 8, + 1, + 15, + 3, + 10 + ], + "weighted_loads": [ + 1.624054465442896, + 0.17868353985249996, + 0.07214057818055153, + 0.03588056564331055, + 0.8578243777155876, + 0.19085485860705376, + 2.432015674188733, + 0.06772179901599884, + 0.842277342453599, + 0.5804127566516399, + 0.5348420664668083, + 0.7283919434994459, + 0.5259337741881609, + 0.08119851350784302, + 0.4023071229457855, + 1.5691474005579948, + 2.798617821186781, + 0.4035242199897766, + 0.24820700660347939, + 0.6636723931878805, + 0.028784895315766335, + 0.21393649652600288, + 0.0, + 0.5093474593013525, + 0.17457910999655724, + 0.29311174526810646, + 1.0535243097692728, + 0.29349830746650696, + 0.42600656673312187, + 0.29892999678850174, + 0.2995214145630598, + 0.6584589518606663, + 0.9834558293223381, + 0.30235121212899685, + 0.14883409067988396, + 0.11788024380803108, + 0.9751145411282778, + 0.11269200220704079, + 0.14033443853259087, + 0.11688471958041191, + 0.4393848367035389, + 0.3760571349412203, + 0.29700973257422447, + 0.5143563821911812, + 0.13975778967142105, + 0.03762061893939972, + 0.09058180451393127, + 0.1979551650583744, + 1.5219159508123994, + 1.8009356185793877, + 0.5143314674496651, + 0.19717424362897873, + 0.17857064120471478, + 0.2551472429186106, + 0.17598402127623558, + 0.8918774519115686, + 0.13968594372272491, + 0.6921373456716537, + 0.23913805559277534, + 0.41320280358195305, + 0.040246691554784775, + 0.7942046523094177, + 0.14644636400043964, + 0.3840549308806658 + ], + "unique_experts": 63, + "load_cv": 0.7682238609401126, + "normalized_load_entropy": 0.9332251900908324, + "max_load_share": 0.05421686746987952 + } + }, + "s0_period": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "b2b2aa0effb53a4a89dbf1d66e5cf55f5b7ae5e85a26923d95d3752e5e06577d", + "route_weight_sha256": "86ec57a60784862aa93cc76f8bd4482b605094add8caecdf8a949f7ba71bf72c", + "loads": [ + 8, + 5, + 2, + 1, + 6, + 1, + 9, + 0, + 2, + 9, + 5, + 5, + 1, + 0, + 6, + 7, + 14, + 9, + 4, + 6, + 1, + 2, + 0, + 5, + 1, + 2, + 3, + 3, + 0, + 7, + 3, + 4, + 5, + 4, + 0, + 3, + 9, + 3, + 3, + 2, + 4, + 5, + 3, + 4, + 4, + 0, + 1, + 7, + 10, + 6, + 8, + 2, + 4, + 4, + 4, + 4, + 2, + 0, + 2, + 4, + 1, + 6, + 1, + 6 + ], + "weighted_loads": [ + 0.40934372693300247, + 0.1827467568218708, + 0.06903155520558357, + 0.03112553060054779, + 0.41370620764791965, + 0.04291236028075218, + 1.5577146522700787, + 0.0, + 0.08120512589812279, + 0.5353698097169399, + 0.25936633348464966, + 0.37906613387167454, + 0.04351302236318588, + 0.0, + 0.23124690353870392, + 0.8446374088525772, + 1.6174383871257305, + 0.3241891451179981, + 0.19035525992512703, + 0.36238975264132023, + 0.032766398042440414, + 0.13324183970689774, + 0.0, + 0.22370316460728645, + 0.05624303221702576, + 0.2684914767742157, + 0.1923312433063984, + 0.17052902281284332, + 0.0, + 0.27502153255045414, + 0.10607554949820042, + 0.1541328150779009, + 0.5083307288587093, + 0.16809175163507462, + 0.0, + 0.08093205094337463, + 0.41928302869200706, + 0.1197376474738121, + 0.10948794707655907, + 0.06644376367330551, + 0.22950307838618755, + 0.18695684149861336, + 0.3145136758685112, + 0.1506558060646057, + 0.15026728808879852, + 0.0, + 0.09501952677965164, + 0.22445082291960716, + 1.3226680606603622, + 0.3507422776892781, + 0.32349992729723454, + 0.09043998643755913, + 0.12942222878336906, + 0.11218715831637383, + 0.15089082717895508, + 0.15633299574255943, + 0.1364811360836029, + 0.0, + 0.16031190752983093, + 0.24395903572440147, + 0.040854886174201965, + 0.30929818749427795, + 0.029240291565656662, + 0.221219003200531 + ], + "unique_experts": 57, + "load_cv": 0.7429860151408539, + "normalized_load_entropy": 0.9276983016279359, + "max_load_share": 0.05555555555555555 + }, + "full_input": { + "tokens": 67, + "top_k": 6, + "decisions": 402, + "ordered_route_sha256": "bace35dddd29316c5a1e9b0254f8ca7c79bf36ef686c212b95eb36fa6513b73d", + "route_weight_sha256": "86ea1fbe9c5706b6109c4cc224718c3622b4443640130f9a4db4d87d82196787", + "loads": [ + 10, + 5, + 2, + 1, + 12, + 2, + 16, + 2, + 9, + 10, + 10, + 7, + 6, + 0, + 15, + 8, + 21, + 11, + 4, + 8, + 1, + 2, + 0, + 11, + 5, + 3, + 13, + 3, + 3, + 7, + 9, + 4, + 10, + 6, + 0, + 3, + 15, + 3, + 4, + 3, + 10, + 8, + 3, + 6, + 4, + 0, + 1, + 8, + 11, + 14, + 14, + 4, + 10, + 4, + 4, + 7, + 2, + 0, + 4, + 4, + 1, + 8, + 1, + 10 + ], + "weighted_loads": [ + 0.4813092350959778, + 0.1827467568218708, + 0.06903155520558357, + 0.03112553060054779, + 0.827250137925148, + 0.061655253171920776, + 1.9955429509282112, + 0.06934306025505066, + 0.6232258304953575, + 0.5668457522988319, + 0.4459776468575001, + 0.4414024017751217, + 0.4165792278945446, + 0.0, + 0.5915411170572042, + 0.8765549883246422, + 2.310807678848505, + 0.3979249857366085, + 0.19035525992512703, + 0.46895873732864857, + 0.032766398042440414, + 0.13324183970689774, + 0.0, + 0.587648555636406, + 0.19222566112875938, + 0.29691157676279545, + 0.8755699209868908, + 0.17052902281284332, + 0.11262395419180393, + 0.27502153255045414, + 0.3660917803645134, + 0.1541328150779009, + 0.9131517987698317, + 0.26311377063393593, + 0.0, + 0.08093205094337463, + 1.160358015447855, + 0.1197376474738121, + 0.13961806893348694, + 0.10620797052979469, + 0.6057609524577856, + 0.3050325773656368, + 0.3145136758685112, + 0.2420179881155491, + 0.15026728808879852, + 0.0, + 0.09501952677965164, + 0.2588987685739994, + 1.3361648796126246, + 1.0949929365888238, + 0.6377952080219984, + 0.17240406200289726, + 0.30926379188895226, + 0.11218715831637383, + 0.15089082717895508, + 0.8533412702381611, + 0.1364811360836029, + 0.0, + 0.26170021295547485, + 0.24395903572440147, + 0.040854886174201965, + 0.5028350315988064, + 0.029240291565656662, + 0.38250819966197014 + ], + "unique_experts": 59, + "load_cv": 0.7469814174985655, + "normalized_load_entropy": 0.9281940547354488, + "max_load_share": 0.05223880597014925 + } + }, + "s1_period": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "b0ad11a6fae9b97a230a2567dd3fa61fb62829c52ecbc8d0aaf02ac3d76bfbc9", + "route_weight_sha256": "b0685ffaf27e593e0c4e2532e95c9fb2b266c10db2c38645d40c704bd078989b", + "loads": [ + 9, + 4, + 2, + 1, + 8, + 1, + 9, + 0, + 2, + 8, + 5, + 6, + 1, + 0, + 7, + 7, + 16, + 6, + 5, + 6, + 0, + 2, + 0, + 4, + 1, + 2, + 4, + 3, + 0, + 6, + 2, + 4, + 5, + 4, + 0, + 4, + 8, + 3, + 5, + 1, + 4, + 4, + 3, + 2, + 3, + 0, + 1, + 7, + 11, + 6, + 7, + 2, + 4, + 4, + 4, + 4, + 2, + 1, + 2, + 4, + 1, + 7, + 1, + 7 + ], + "weighted_loads": [ + 0.46548235043883324, + 0.15598572604358196, + 0.07076425105333328, + 0.036219436675310135, + 0.4783980306237936, + 0.04309644550085068, + 1.4861898683011532, + 0.0, + 0.0774321798235178, + 0.5209889970719814, + 0.24753738194704056, + 0.4160248041152954, + 0.04024706035852432, + 0.0, + 0.2662966586649418, + 0.8097030259668827, + 1.7003845572471619, + 0.22527813352644444, + 0.23137743584811687, + 0.37988467514514923, + 0.0, + 0.133742555975914, + 0.0, + 0.2111461814492941, + 0.02762230485677719, + 0.2671213820576668, + 0.21972051449120045, + 0.16950035095214844, + 0.0, + 0.22613422200083733, + 0.07812031731009483, + 0.15321923419833183, + 0.5371064096689224, + 0.15270153433084488, + 0.0, + 0.11694072373211384, + 0.35301142558455467, + 0.1137145571410656, + 0.17400086484849453, + 0.032687120139598846, + 0.23910165764391422, + 0.15650715306401253, + 0.3058604523539543, + 0.10182645544409752, + 0.10260815732181072, + 0.0, + 0.09047692269086838, + 0.22837630845606327, + 1.3925568424165249, + 0.3188732657581568, + 0.29200929030776024, + 0.07421762123703957, + 0.133813988417387, + 0.1165654081851244, + 0.14303693920373917, + 0.15053534507751465, + 0.14047181606292725, + 0.02945232205092907, + 0.1609460636973381, + 0.24037714302539825, + 0.03628113865852356, + 0.355432465672493, + 0.031155383214354515, + 0.26966458559036255 + ], + "unique_experts": 57, + "load_cv": 0.7787489887007035, + "normalized_load_entropy": 0.923443286532111, + "max_load_share": 0.06349206349206349 + }, + "full_input": { + "tokens": 83, + "top_k": 6, + "decisions": 498, + "ordered_route_sha256": "85001e27940273231c0732e4f8d35a34933651c3fe97dac92751c358e101f9b8", + "route_weight_sha256": "9107c57c86e74665cb35518eab061850c7f1a9623a6e5ffb869a189a75a9d241", + "loads": [ + 28, + 5, + 2, + 1, + 17, + 4, + 21, + 2, + 14, + 9, + 10, + 10, + 7, + 1, + 11, + 20, + 28, + 10, + 6, + 9, + 1, + 3, + 0, + 9, + 5, + 3, + 15, + 5, + 6, + 7, + 9, + 8, + 11, + 9, + 2, + 4, + 14, + 3, + 6, + 3, + 9, + 7, + 3, + 5, + 3, + 1, + 1, + 8, + 14, + 17, + 15, + 4, + 5, + 5, + 4, + 7, + 2, + 7, + 5, + 8, + 1, + 15, + 3, + 11 + ], + "weighted_loads": [ + 1.6569178476929665, + 0.18245632760226727, + 0.07076425105333328, + 0.036219436675310135, + 0.949963903054595, + 0.19412122294306755, + 2.4909168537706137, + 0.06772179901599884, + 0.8200269713997841, + 0.5520156361162663, + 0.4777275212109089, + 0.7481327205896378, + 0.5115121062844992, + 0.08119851350784302, + 0.4256945922970772, + 1.5903930868953466, + 2.860382255166769, + 0.3806688729673624, + 0.28167922608554363, + 0.603043507784605, + 0.028784895315766335, + 0.21431275457143784, + 0.0, + 0.4533947166055441, + 0.15329533256590366, + 0.29563893750309944, + 0.9566194172948599, + 0.29503224790096283, + 0.42600656673312187, + 0.2645103186368942, + 0.33623376302421093, + 0.6061466783285141, + 0.9655218236148357, + 0.3576962649822235, + 0.14883409067988396, + 0.11694072373211384, + 1.0982178151607513, + 0.1137145571410656, + 0.20711487345397472, + 0.12137489020824432, + 0.5512814875692129, + 0.32527153566479683, + 0.3058604523539543, + 0.42699161916971207, + 0.10260815732181072, + 0.03762061893939972, + 0.09047692269086838, + 0.2625705096870661, + 1.5367662524804473, + 1.7905279193073511, + 0.5962036680430174, + 0.14777252450585365, + 0.1477068942040205, + 0.2577560115605593, + 0.14303693920373917, + 0.8368204049766064, + 0.14047181606292725, + 0.6903651189059019, + 0.30260273069143295, + 0.41485730931162834, + 0.03628113865852356, + 0.9051972515881062, + 0.14737320132553577, + 0.41873752139508724 + ], + "unique_experts": 63, + "load_cv": 0.7858258700421177, + "normalized_load_entropy": 0.9314476770972314, + "max_load_share": 0.05622489959839357 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 42, + "ordered_topk_exact_tokens": 16, + "set_exact_tokens": 22, + "mean_set_jaccard": 0.8588435374149659, + "mean_token_weighted_tv": 0.023209874285385013, + "aggregate_load_tv": 0.05952380952380952 + }, + "system_bos": { + "tokens": 42, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 18, + "mean_set_jaccard": 0.8316326530612246, + "mean_token_weighted_tv": 0.026504905539609137, + "aggregate_load_tv": 0.07142857142857142 + }, + "system_x": { + "tokens": 42, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 24, + "mean_set_jaccard": 0.8673469387755103, + "mean_token_weighted_tv": 0.028012131185581286, + "aggregate_load_tv": 0.05952380952380952 + }, + "system_period": { + "tokens": 42, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 24, + "mean_set_jaccard": 0.8571428571428571, + "mean_token_weighted_tv": 0.02933685467134984, + "aggregate_load_tv": 0.06349206349206349 + }, + "bos_at_s0": { + "tokens": 42, + "ordered_topk_exact_tokens": 16, + "set_exact_tokens": 22, + "mean_set_jaccard": 0.8588435374149661, + "mean_token_weighted_tv": 0.02826971883353378, + "aggregate_load_tv": 0.05952380952380952 + }, + "bos_at_s1": { + "tokens": 42, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 20, + "mean_set_jaccard": 0.824829931972789, + "mean_token_weighted_tv": 0.034585372500476386, + "aggregate_load_tv": 0.07539682539682539 + }, + "x_at_s0": { + "tokens": 42, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.8384353741496599, + "mean_token_weighted_tv": 0.03218555806337723, + "aggregate_load_tv": 0.06746031746031746 + }, + "x_at_s1": { + "tokens": 42, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.8129251700680273, + "mean_token_weighted_tv": 0.03656934889122134, + "aggregate_load_tv": 0.05555555555555555 + }, + "period_at_s0": { + "tokens": 42, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 20, + "mean_set_jaccard": 0.8452380952380955, + "mean_token_weighted_tv": 0.031509019877939, + "aggregate_load_tv": 0.06746031746031746 + }, + "period_at_s1": { + "tokens": 42, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 21, + "mean_set_jaccard": 0.822562358276644, + "mean_token_weighted_tv": 0.035877808884140994, + "aggregate_load_tv": 0.06349206349206349 + } + } + }, + "layer_16": { + "layer": 16, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "ab05ada694e66f9b881e950e3c53fb60bbf6808af1a3e4084acdaa580c02dbb6", + "route_weight_sha256": "264e8a2535d364dafe747c04e566e1981e08f8b242c419db87abaa8e97f36fa0", + "loads": [ + 0, + 1, + 0, + 5, + 1, + 4, + 5, + 1, + 5, + 2, + 12, + 3, + 0, + 6, + 5, + 9, + 3, + 5, + 10, + 2, + 7, + 2, + 1, + 3, + 7, + 6, + 5, + 2, + 3, + 3, + 6, + 0, + 5, + 3, + 6, + 2, + 1, + 2, + 1, + 1, + 3, + 8, + 5, + 9, + 6, + 2, + 3, + 5, + 6, + 7, + 3, + 4, + 2, + 4, + 8, + 9, + 2, + 1, + 4, + 5, + 2, + 7, + 1, + 1 + ], + "weighted_loads": [ + 0.0, + 0.04881947115063667, + 0.0, + 0.20223816111683846, + 0.0325138196349144, + 0.22345256432890892, + 0.17433099448680878, + 0.08292070776224136, + 0.21325104124844074, + 0.060130298137664795, + 1.1259292792528868, + 0.07670221105217934, + 0.0, + 0.20021143555641174, + 0.4256775379180908, + 0.8393330331891775, + 0.19981205463409424, + 0.29308078438043594, + 0.42843224108219147, + 0.078121617436409, + 0.8668379187583923, + 0.062366485595703125, + 0.021947495639324188, + 0.11449189856648445, + 0.8328246399760246, + 0.3630031757056713, + 0.2817158214747906, + 0.07180170714855194, + 0.20537876337766647, + 0.11749812215566635, + 0.2608055267482996, + 0.0, + 0.24466191232204437, + 0.1041887030005455, + 0.26827117055654526, + 0.22856327891349792, + 0.05450264364480972, + 0.07129127904772758, + 0.02957390435039997, + 0.03188787400722504, + 0.09496738202869892, + 0.6388978809118271, + 0.1816338449716568, + 0.677418440580368, + 0.271720128133893, + 0.08552007749676704, + 0.09187200292944908, + 0.34484703093767166, + 0.39853309467434883, + 0.27196681685745716, + 0.13810213655233383, + 0.13573687337338924, + 0.08381704986095428, + 0.33342332765460014, + 0.944368539378047, + 0.35911146365106106, + 0.13488560169935226, + 0.03790673986077309, + 0.1649559922516346, + 0.38681482151150703, + 0.08287454769015312, + 0.26552899926900864, + 0.04963753744959831, + 0.03156721964478493 + ], + "unique_experts": 60, + "load_cv": 0.6953395591685559, + "normalized_load_entropy": 0.937759758345301, + "max_load_share": 0.047619047619047616 + }, + "full_input": { + "tokens": 67, + "top_k": 6, + "decisions": 402, + "ordered_route_sha256": "c9a875479fbf7f79e73857574e35b9068a8bca5d627e816ba14e7d1860870e39", + "route_weight_sha256": "a48db5af3818efe69ec27f7c6ada4ed21d7edf60d4627d96ca89b0f0ea0a52c8", + "loads": [ + 0, + 1, + 0, + 5, + 1, + 12, + 9, + 1, + 5, + 5, + 16, + 3, + 0, + 8, + 5, + 15, + 12, + 9, + 16, + 4, + 17, + 4, + 3, + 3, + 12, + 6, + 10, + 2, + 3, + 3, + 8, + 0, + 6, + 11, + 6, + 2, + 1, + 12, + 1, + 1, + 5, + 18, + 7, + 11, + 11, + 3, + 3, + 5, + 6, + 7, + 3, + 6, + 2, + 15, + 8, + 19, + 2, + 1, + 4, + 5, + 6, + 9, + 1, + 7 + ], + "weighted_loads": [ + 0.0, + 0.04881947115063667, + 0.0, + 0.20223816111683846, + 0.0325138196349144, + 1.0144669003784657, + 0.3524216562509537, + 0.08292070776224136, + 0.21325104124844074, + 1.4538686871528625, + 1.3762461934238672, + 0.07670221105217934, + 0.0, + 0.2511121854186058, + 0.4256775379180908, + 1.3604427110403776, + 0.7129289195872843, + 0.5239472426474094, + 1.0245353486388922, + 0.12010774156078696, + 1.7900846675038338, + 0.1427522897720337, + 0.1415812484920025, + 0.11449189856648445, + 1.3355571925640106, + 0.3630031757056713, + 0.6367493644356728, + 0.07180170714855194, + 0.20537876337766647, + 0.11749812215566635, + 0.3529367055743933, + 0.0, + 0.2849569395184517, + 0.46005101781338453, + 0.26827117055654526, + 0.22856327891349792, + 0.05450264364480972, + 0.5699092969298363, + 0.02957390435039997, + 0.03188787400722504, + 0.1804202925413847, + 1.5791933424770832, + 0.2700974754989147, + 0.8266607113182545, + 0.49614319391548634, + 0.1533822976052761, + 0.09187200292944908, + 0.34484703093767166, + 0.39853309467434883, + 0.27196681685745716, + 0.13810213655233383, + 0.23662892170250416, + 0.08381704986095428, + 1.1069387085735798, + 0.944368539378047, + 1.1585488375276327, + 0.13488560169935226, + 0.03790673986077309, + 0.1649559922516346, + 0.38681482151150703, + 0.3396100215613842, + 0.30714159714989364, + 0.04963753744959831, + 0.2848104313015938 + ], + "unique_experts": 60, + "load_cv": 0.7877524653623674, + "normalized_load_entropy": 0.9232560260107915, + "max_load_share": 0.0472636815920398 + } + }, + "s1_eos": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "767c2e8c3738d5457d5e7098efddedb7aa871933464a07a6c9c810208a929f7b", + "route_weight_sha256": "262dff401e67572b8e004d54bc90b631f506b5dca7b2878b3d798b74bf44b9c2", + "loads": [ + 0, + 1, + 0, + 5, + 1, + 4, + 5, + 1, + 5, + 1, + 11, + 3, + 0, + 5, + 5, + 10, + 2, + 6, + 11, + 3, + 7, + 2, + 1, + 3, + 6, + 6, + 5, + 2, + 3, + 2, + 6, + 0, + 5, + 5, + 6, + 2, + 1, + 3, + 1, + 2, + 3, + 9, + 5, + 7, + 7, + 2, + 2, + 4, + 5, + 6, + 2, + 3, + 2, + 5, + 7, + 9, + 2, + 1, + 3, + 5, + 4, + 8, + 2, + 2 + ], + "weighted_loads": [ + 0.0, + 0.048363346606492996, + 0.0, + 0.20608055591583252, + 0.029310738667845726, + 0.23954493924975395, + 0.18049027398228645, + 0.08662564307451248, + 0.21384482271969318, + 0.029556678608059883, + 1.1016119457781315, + 0.07308760099112988, + 0.0, + 0.17890851013362408, + 0.4349838048219681, + 0.8267930168658495, + 0.10390942171216011, + 0.320759829133749, + 0.46785804629325867, + 0.10683274082839489, + 0.8763759378343821, + 0.0629664994776249, + 0.022657832130789757, + 0.11560573801398277, + 0.8042997270822525, + 0.3486284874379635, + 0.2762996144592762, + 0.0798301137983799, + 0.19515668973326683, + 0.090157400816679, + 0.2674988266080618, + 0.0, + 0.2560333274304867, + 0.16055997647345066, + 0.26973934657871723, + 0.2361394353210926, + 0.05253490060567856, + 0.10582355409860611, + 0.02994571253657341, + 0.07295686192810535, + 0.09635747037827969, + 0.7332631889730692, + 0.173191387206316, + 0.6039818450808525, + 0.2840682175010443, + 0.09035928919911385, + 0.05833403021097183, + 0.29836272448301315, + 0.386614840477705, + 0.24761946871876717, + 0.09444386139512062, + 0.11215652897953987, + 0.086069755256176, + 0.35895076394081116, + 0.8848236203193665, + 0.3695211857557297, + 0.13504121452569962, + 0.031508758664131165, + 0.1529738362878561, + 0.4040972366929054, + 0.14286312647163868, + 0.3143125530332327, + 0.07979141734540462, + 0.06279024854302406 + ], + "unique_experts": 60, + "load_cv": 0.6865882144089577, + "normalized_load_entropy": 0.9397286644067455, + "max_load_share": 0.04365079365079365 + }, + "full_input": { + "tokens": 83, + "top_k": 6, + "decisions": 498, + "ordered_route_sha256": "ef4bff6a2c754fcb263376f9b6e69c7578156eccb7621608c541ca9474469a3f", + "route_weight_sha256": "c02260d7f864d62b0fc4581ad5ff3382fb031b98c248236c70806cd30d6cdd77", + "loads": [ + 0, + 4, + 0, + 7, + 1, + 13, + 11, + 2, + 5, + 5, + 17, + 5, + 0, + 8, + 6, + 20, + 12, + 17, + 21, + 5, + 17, + 4, + 3, + 4, + 20, + 6, + 15, + 2, + 3, + 2, + 10, + 0, + 10, + 12, + 8, + 4, + 1, + 11, + 3, + 5, + 6, + 24, + 8, + 10, + 11, + 6, + 3, + 10, + 7, + 9, + 8, + 5, + 2, + 17, + 7, + 20, + 4, + 1, + 3, + 7, + 8, + 9, + 5, + 9 + ], + "weighted_loads": [ + 0.0, + 0.17076654359698296, + 0.0, + 0.2968169152736664, + 0.029310738667845726, + 1.0730702616274357, + 0.47198300436139107, + 0.11198024824261665, + 0.21384482271969318, + 1.430043676868081, + 1.356984542682767, + 0.1341013554483652, + 0.0, + 0.26882280968129635, + 0.48644018173217773, + 1.8695027623325586, + 0.5554910441860557, + 1.0323907919228077, + 1.3694847635924816, + 0.1453362179454416, + 1.7744842302054167, + 0.15651049464941025, + 0.10727371089160442, + 0.19146402552723885, + 1.9118874818086624, + 0.3486284874379635, + 1.4808017797768116, + 0.0798301137983799, + 0.19515668973326683, + 0.090157400816679, + 0.4249763283878565, + 0.0, + 0.4762333929538727, + 0.432831178419292, + 0.3383288960903883, + 0.3562600910663605, + 0.05253490060567856, + 0.5450013056397438, + 0.15523511543869972, + 0.2513690236955881, + 0.19832367077469826, + 2.578820126131177, + 0.29157861694693565, + 0.8065150864422321, + 0.4303422961384058, + 0.28517288714647293, + 0.08995995670557022, + 0.5914260149002075, + 0.4832504875957966, + 0.4080177843570709, + 0.3534957878291607, + 0.19482248649001122, + 0.086069755256176, + 1.4301656614989042, + 0.8848236203193665, + 1.345408070832491, + 0.24345838651061058, + 0.031508758664131165, + 0.1529738362878561, + 0.6320145353674889, + 0.3485842365771532, + 0.31615599896758795, + 0.4131427276879549, + 0.3717041602358222 + ], + "unique_experts": 60, + "load_cv": 0.7474520301304772, + "normalized_load_entropy": 0.9315523966440579, + "max_load_share": 0.04819277108433735 + } + }, + "s0_bos": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "e9392088eda260b732e2aafe22e4bcfb617426cfa11d37a4675aff739c8cc251", + "route_weight_sha256": "4f9e2f8c929aa7a20dd58602e4f5e05eecbf33e4b0f16fde8644a376cade6d4c", + "loads": [ + 2, + 1, + 0, + 5, + 1, + 2, + 3, + 1, + 5, + 2, + 12, + 3, + 0, + 3, + 5, + 10, + 4, + 5, + 9, + 2, + 7, + 3, + 1, + 3, + 7, + 6, + 7, + 2, + 3, + 3, + 7, + 0, + 5, + 3, + 7, + 3, + 1, + 2, + 1, + 2, + 3, + 8, + 6, + 7, + 7, + 3, + 4, + 4, + 5, + 6, + 3, + 3, + 3, + 5, + 8, + 8, + 2, + 1, + 2, + 5, + 2, + 7, + 1, + 1 + ], + "weighted_loads": [ + 0.05911162681877613, + 0.051233235746622086, + 0.0, + 0.21442897617816925, + 0.028654444962739944, + 0.1741287149488926, + 0.12039145454764366, + 0.0828850269317627, + 0.2154161836951971, + 0.1273897849023342, + 1.1027750186622143, + 0.07420418784022331, + 0.0, + 0.10525330528616905, + 0.4326274059712887, + 0.9047756865620613, + 0.22859283536672592, + 0.2986070476472378, + 0.3682776056230068, + 0.08188196085393429, + 0.8063598666340113, + 0.08681434392929077, + 0.021431442350149155, + 0.1129310242831707, + 0.8296802453696728, + 0.3550953231751919, + 0.3548702485859394, + 0.07011815905570984, + 0.20879223570227623, + 0.12587309628725052, + 0.27636269852519035, + 0.0, + 0.244876466691494, + 0.11630018055438995, + 0.2935487385839224, + 0.2733851969242096, + 0.060820501297712326, + 0.07069218158721924, + 0.02912747859954834, + 0.07821990549564362, + 0.09653987176716328, + 0.6225218512117863, + 0.21961181797087193, + 0.6184713654220104, + 0.3030900713056326, + 0.12766441330313683, + 0.1135474257171154, + 0.3176090903580189, + 0.3894333280622959, + 0.229384433478117, + 0.13323060795664787, + 0.09528925642371178, + 0.14147676527500153, + 0.34298635460436344, + 0.8905047066509724, + 0.332683552056551, + 0.13395431637763977, + 0.031265128403902054, + 0.11473852023482323, + 0.39257828146219254, + 0.0811035968363285, + 0.2713823579251766, + 0.050779182463884354, + 0.03328467905521393 + ], + "unique_experts": 61, + "load_cv": 0.6717493323650421, + "normalized_load_entropy": 0.9433330921147361, + "max_load_share": 0.047619047619047616 + }, + "full_input": { + "tokens": 67, + "top_k": 6, + "decisions": 402, + "ordered_route_sha256": "cca588fb125f3876c938ba5ea9e6a52a76f2093ebfe6e4f7102100e544441e0f", + "route_weight_sha256": "1bc0e84c48a90bfaf0e8169cd2782779c0d600f3e4d2aea0a32591369cae9a32", + "loads": [ + 2, + 1, + 1, + 5, + 1, + 12, + 6, + 1, + 5, + 5, + 16, + 3, + 1, + 5, + 5, + 16, + 13, + 8, + 15, + 4, + 17, + 5, + 3, + 3, + 12, + 6, + 11, + 2, + 3, + 3, + 9, + 0, + 6, + 10, + 9, + 3, + 1, + 11, + 1, + 2, + 5, + 19, + 8, + 9, + 11, + 4, + 4, + 4, + 5, + 7, + 4, + 5, + 3, + 16, + 8, + 18, + 2, + 1, + 2, + 5, + 5, + 9, + 1, + 5 + ], + "weighted_loads": [ + 0.05911162681877613, + 0.051233235746622086, + 0.03945969417691231, + 0.21442897617816925, + 0.028654444962739944, + 1.0596757382154465, + 0.2531715855002403, + 0.0828850269317627, + 0.2154161836951971, + 0.5857355259358883, + 1.3558629751205444, + 0.07420418784022331, + 0.07331757992506027, + 0.16430094838142395, + 0.4326274059712887, + 1.361234687268734, + 1.1908419113606215, + 0.49261846765875816, + 0.9368696305900812, + 0.15294265560805798, + 1.7296066153794527, + 0.16720014810562134, + 0.14106519520282745, + 0.1129310242831707, + 1.3303529769182205, + 0.3550953231751919, + 0.6369472444057465, + 0.07011815905570984, + 0.20879223570227623, + 0.12587309628725052, + 0.368493877351284, + 0.0, + 0.2851714938879013, + 0.48337934724986553, + 0.44883481599390507, + 0.2733851969242096, + 0.060820501297712326, + 0.5435050204396248, + 0.02912747859954834, + 0.07821990549564362, + 0.18199278227984905, + 1.569483494386077, + 0.32034983672201633, + 0.7819322682917118, + 0.46493531204760075, + 0.1955266334116459, + 0.1135474257171154, + 0.3176090903580189, + 0.3894333280622959, + 0.2737786993384361, + 0.17986135929822922, + 0.1961813047528267, + 0.14147676527500153, + 1.116501735523343, + 0.8905047066509724, + 1.1321209259331226, + 0.13395431637763977, + 0.031265128403902054, + 0.11473852023482323, + 0.39257828146219254, + 0.2543152943253517, + 0.35739825293421745, + 0.050779182463884354, + 0.24190429970622063 + ], + "unique_experts": 63, + "load_cv": 0.7725232414691064, + "normalized_load_entropy": 0.9309452451875689, + "max_load_share": 0.0472636815920398 + } + }, + "s1_bos": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "6693cc02ddb4da0284a8cb21322ec5ceb9ba8083bd1a39055eafebe2a696abe5", + "route_weight_sha256": "efe84317edb6caaec47d75e4c88a5f40751274bfd96f77afb4167ea7c8411eb8", + "loads": [ + 2, + 1, + 0, + 4, + 1, + 3, + 3, + 1, + 4, + 2, + 12, + 3, + 0, + 6, + 5, + 10, + 5, + 5, + 10, + 2, + 6, + 3, + 1, + 3, + 7, + 6, + 8, + 2, + 3, + 3, + 6, + 0, + 5, + 3, + 6, + 3, + 1, + 2, + 1, + 3, + 3, + 8, + 4, + 8, + 6, + 4, + 1, + 4, + 6, + 7, + 3, + 2, + 3, + 4, + 8, + 8, + 2, + 0, + 2, + 5, + 3, + 7, + 2, + 1 + ], + "weighted_loads": [ + 0.06082525476813316, + 0.04947172477841377, + 0.0, + 0.1699671596288681, + 0.030676836147904396, + 0.1986391842365265, + 0.12195751070976257, + 0.08765147626399994, + 0.17965573072433472, + 0.12296589463949203, + 1.1098489575088024, + 0.07869940251111984, + 0.0, + 0.1919822208583355, + 0.4391487129032612, + 0.9125167205929756, + 0.25178730860352516, + 0.2737273946404457, + 0.40341096743941307, + 0.08400835283100605, + 0.7927036359906197, + 0.08736247755587101, + 0.022067829966545105, + 0.12037026882171631, + 0.8705251328647137, + 0.3400541637092829, + 0.37705596908926964, + 0.0704352855682373, + 0.2006668709218502, + 0.1284770779311657, + 0.26224696077406406, + 0.0, + 0.2481173276901245, + 0.09514783695340157, + 0.2505990620702505, + 0.2691900171339512, + 0.05489920452237129, + 0.07069040462374687, + 0.030910104513168335, + 0.10849622637033463, + 0.092015465721488, + 0.627056185156107, + 0.15329032205045223, + 0.6657073646783829, + 0.25939615070819855, + 0.15348657965660095, + 0.02721838839352131, + 0.31659749522805214, + 0.42801983654499054, + 0.2555638328194618, + 0.1306832730770111, + 0.07150707021355629, + 0.11137025058269501, + 0.3324805609881878, + 0.9300520457327366, + 0.3343391977250576, + 0.13353389501571655, + 0.0, + 0.11795223504304886, + 0.4201618917286396, + 0.10675052925944328, + 0.27335225045681, + 0.08062151260674, + 0.03023143857717514 + ], + "unique_experts": 60, + "load_cv": 0.6821704427601365, + "normalized_load_entropy": 0.9409238908859834, + "max_load_share": 0.047619047619047616 + }, + "full_input": { + "tokens": 83, + "top_k": 6, + "decisions": 498, + "ordered_route_sha256": "4d7432c85a8e6ea96e64a08b387bda291ccfd24115661ec52b399d6146d5296c", + "route_weight_sha256": "3ee082ccbbb44b2c3b55e8f4535df4f4bdac35631c0476b5b81f292fc110966f", + "loads": [ + 2, + 4, + 0, + 6, + 1, + 12, + 9, + 2, + 4, + 6, + 19, + 5, + 0, + 9, + 6, + 20, + 16, + 15, + 20, + 2, + 16, + 5, + 3, + 4, + 18, + 6, + 18, + 2, + 3, + 3, + 10, + 0, + 10, + 13, + 9, + 5, + 1, + 11, + 3, + 6, + 6, + 24, + 6, + 11, + 12, + 8, + 2, + 10, + 8, + 10, + 9, + 4, + 3, + 16, + 8, + 19, + 4, + 0, + 2, + 6, + 8, + 7, + 5, + 6 + ], + "weighted_loads": [ + 0.06082525476813316, + 0.17187492176890373, + 0.0, + 0.26070351898670197, + 0.030676836147904396, + 1.0343754030764103, + 0.40936775878071785, + 0.11300608143210411, + 0.17965573072433472, + 0.6201453469693661, + 1.4097520355135202, + 0.13971315696835518, + 0.0, + 0.28189652040600777, + 0.49060508981347084, + 1.9312134347856045, + 1.1983609460294247, + 0.9553015530109406, + 1.2994219213724136, + 0.08400835283100605, + 1.6908119283616543, + 0.18090647272765636, + 0.10668370872735977, + 0.19622855633497238, + 1.8743553943932056, + 0.3400541637092829, + 1.5773668326437473, + 0.0704352855682373, + 0.2006668709218502, + 0.1284770779311657, + 0.41972446255385876, + 0.0, + 0.4683173932135105, + 0.5366602204740047, + 0.36103217862546444, + 0.38931067287921906, + 0.05489920452237129, + 0.5496443770825863, + 0.15619950741529465, + 0.2869083881378174, + 0.19398166611790657, + 2.4871339574456215, + 0.23921570368111134, + 0.8765651024878025, + 0.4747605137526989, + 0.34830017760396004, + 0.0588443148881197, + 0.6096607856452465, + 0.5246554836630821, + 0.4159621484577656, + 0.3973722979426384, + 0.15417302772402763, + 0.11137025058269501, + 1.4036954585462809, + 0.9300520457327366, + 1.3102260828018188, + 0.24195106700062752, + 0.0, + 0.11795223504304886, + 0.6249145455658436, + 0.37247378937900066, + 0.27335225045681, + 0.4139728229492903, + 0.28760549426078796 + ], + "unique_experts": 60, + "load_cv": 0.7477972038286198, + "normalized_load_entropy": 0.9311658765554567, + "max_load_share": 0.04819277108433735 + } + }, + "s0_x": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "9efc92cf8a9101940aa585c562d3b2d8a4016e671f561f7d5751055acb3161a6", + "route_weight_sha256": "7359c0ce8406f65b31eaffac7e6596b9b0f1cae71d6aba02b5f28706942f6122", + "loads": [ + 1, + 1, + 0, + 6, + 1, + 2, + 3, + 1, + 5, + 1, + 13, + 3, + 0, + 4, + 5, + 10, + 4, + 5, + 10, + 2, + 7, + 3, + 1, + 3, + 7, + 5, + 6, + 2, + 3, + 3, + 6, + 0, + 6, + 3, + 5, + 1, + 1, + 2, + 1, + 3, + 2, + 8, + 7, + 6, + 7, + 4, + 2, + 5, + 5, + 7, + 3, + 2, + 3, + 5, + 9, + 8, + 2, + 1, + 3, + 5, + 6, + 5, + 1, + 1 + ], + "weighted_loads": [ + 0.02378208190202713, + 0.051918238401412964, + 0.0, + 0.2351319007575512, + 0.03195143863558769, + 0.1656671017408371, + 0.1164073646068573, + 0.08439572900533676, + 0.21151537634432316, + 0.07857498526573181, + 1.1406000070273876, + 0.07417615316808224, + 0.0, + 0.12700366973876953, + 0.4354451410472393, + 0.9084510188549757, + 0.18641727231442928, + 0.3013255409896374, + 0.4113536514341831, + 0.0868267435580492, + 0.8150299359112978, + 0.08995183557271957, + 0.02210964448750019, + 0.10835173539817333, + 0.8806849122047424, + 0.3250727728009224, + 0.32777103409171104, + 0.07395300641655922, + 0.20772728696465492, + 0.1284909024834633, + 0.25873914547264576, + 0.0, + 0.27485668286681175, + 0.0974614080041647, + 0.22170466929674149, + 0.18392466008663177, + 0.05925171077251434, + 0.07169396057724953, + 0.03011268936097622, + 0.11065692454576492, + 0.05999654717743397, + 0.5899555068463087, + 0.2705892063677311, + 0.6328906640410423, + 0.28644326888024807, + 0.1649710014462471, + 0.05917058140039444, + 0.34137027338147163, + 0.403460543602705, + 0.2613351009786129, + 0.1307901367545128, + 0.07010753452777863, + 0.14572801813483238, + 0.3480024002492428, + 0.9214051831513643, + 0.3347345571964979, + 0.1344541236758232, + 0.03306783735752106, + 0.1397014856338501, + 0.3780870772898197, + 0.21667736023664474, + 0.2000586800277233, + 0.05211444944143295, + 0.03592788800597191 + ], + "unique_experts": 61, + "load_cv": 0.7011131055669135, + "normalized_load_entropy": 0.9388126308923762, + "max_load_share": 0.051587301587301584 + }, + "full_input": { + "tokens": 67, + "top_k": 6, + "decisions": 402, + "ordered_route_sha256": "cb32013c69aca1e14394ca930aeecdaeb58a30ab84da58d31e686d2ee9b3ef48", + "route_weight_sha256": "7d8c0d51dbd6f7caa871a018289d3bd810a2241e96e3eadd6b928e03e74ae7a9", + "loads": [ + 1, + 1, + 0, + 6, + 1, + 11, + 7, + 1, + 5, + 2, + 17, + 4, + 0, + 5, + 5, + 16, + 10, + 10, + 16, + 3, + 19, + 6, + 3, + 3, + 14, + 5, + 11, + 2, + 3, + 3, + 9, + 0, + 8, + 7, + 6, + 1, + 1, + 12, + 1, + 3, + 4, + 17, + 10, + 8, + 11, + 5, + 2, + 5, + 5, + 7, + 4, + 4, + 3, + 17, + 9, + 19, + 2, + 1, + 3, + 5, + 10, + 6, + 1, + 6 + ], + "weighted_loads": [ + 0.02378208190202713, + 0.051918238401412964, + 0.0, + 0.2351319007575512, + 0.03195143863558769, + 1.000960823148489, + 0.2935013473033905, + 0.08439572900533676, + 0.21151537634432316, + 0.4567142724990845, + 1.3980756103992462, + 0.09983797185122967, + 0.0, + 0.14607856795191765, + 0.4354451410472393, + 1.4701555836945772, + 0.49045246839523315, + 0.576045710593462, + 1.0681498404592276, + 0.12634427659213543, + 2.0301068890839815, + 0.20518098399043083, + 0.1417433973401785, + 0.10835173539817333, + 1.5123952068388462, + 0.3250727728009224, + 0.6726708523929119, + 0.07395300641655922, + 0.20772728696465492, + 0.1284909024834633, + 0.3978800866752863, + 0.0, + 0.3886537291109562, + 0.3272874765098095, + 0.25583456084132195, + 0.18392466008663177, + 0.05925171077251434, + 0.5792782641947269, + 0.03011268936097622, + 0.11065692454576492, + 0.14544945769011974, + 1.3895152676850557, + 0.4028228633105755, + 0.8204765021800995, + 0.45983236469328403, + 0.23283322155475616, + 0.05917058140039444, + 0.34137027338147163, + 0.403460543602705, + 0.2613351009786129, + 0.16592097654938698, + 0.17099958285689354, + 0.14572801813483238, + 1.2547379471361637, + 0.9214051831513643, + 1.2453125324100256, + 0.1344541236758232, + 0.03306783735752106, + 0.1397014856338501, + 0.3780870772898197, + 0.46337536349892616, + 0.23982597514986992, + 0.05211444944143295, + 0.2880586199462414 + ], + "unique_experts": 61, + "load_cv": 0.8100596452091148, + "normalized_load_entropy": 0.922057148046315, + "max_load_share": 0.0472636815920398 + } + }, + "s1_x": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "bdbbe089071e1b4f0d6c9e03674e90f4a275cd7c7338d396e1072e223abe346e", + "route_weight_sha256": "ec9513b8366d041416488445cd2e9e5d328cef38a7a202f48ec14099e5d93799", + "loads": [ + 1, + 1, + 1, + 4, + 1, + 3, + 3, + 1, + 4, + 0, + 13, + 3, + 0, + 5, + 5, + 10, + 5, + 5, + 12, + 2, + 6, + 3, + 2, + 3, + 8, + 5, + 5, + 3, + 3, + 4, + 5, + 0, + 6, + 2, + 4, + 1, + 1, + 3, + 1, + 1, + 2, + 10, + 7, + 7, + 5, + 3, + 3, + 4, + 7, + 6, + 3, + 3, + 3, + 4, + 9, + 9, + 2, + 0, + 4, + 5, + 4, + 4, + 2, + 1 + ], + "weighted_loads": [ + 0.024620572105050087, + 0.04945478215813637, + 0.03721558675169945, + 0.1580243743956089, + 0.029138140380382538, + 0.21366328746080399, + 0.11887915059924126, + 0.08883727341890335, + 0.18171504139900208, + 0.0, + 1.163667045533657, + 0.07737498916685581, + 0.0, + 0.15894353948533535, + 0.43630189076066017, + 0.874692976474762, + 0.18790698423981667, + 0.26962733268737793, + 0.477063974365592, + 0.08447252586483955, + 0.8121455945074558, + 0.09254219010472298, + 0.05971182510256767, + 0.11260952986776829, + 0.9667654857039452, + 0.3160001263022423, + 0.2945983484387398, + 0.09423993900418282, + 0.18976490944623947, + 0.15134342573583126, + 0.21756751649081707, + 0.0, + 0.2762126289308071, + 0.07766510546207428, + 0.1858679335564375, + 0.19067025184631348, + 0.05151445418596268, + 0.1052803099155426, + 0.033312246203422546, + 0.037299249321222305, + 0.061277000233531, + 0.6399844344705343, + 0.26147876121103764, + 0.5970128923654556, + 0.21677624806761742, + 0.13988789170980453, + 0.08768316358327866, + 0.28383469209074974, + 0.4886700436472893, + 0.24204920791089535, + 0.11817044951021671, + 0.10917764902114868, + 0.12787075527012348, + 0.32785797119140625, + 0.9596191290766001, + 0.38113410770893097, + 0.1341865211725235, + 0.0, + 0.17329687252640724, + 0.42949917167425156, + 0.1491166204214096, + 0.16626404225826263, + 0.08322331123054028, + 0.03583645075559616 + ], + "unique_experts": 60, + "load_cv": 0.7251380178095505, + "normalized_load_entropy": 0.9364206232007508, + "max_load_share": 0.051587301587301584 + }, + "full_input": { + "tokens": 83, + "top_k": 6, + "decisions": 498, + "ordered_route_sha256": "399ab8304a743e283f4b6941c332a20f76e0e05c3bcedc9ac22fd32146720857", + "route_weight_sha256": "836cccc990be986be40385b35c170f90fb3838fd8fd44bb90d2cac8b3cd2bac0", + "loads": [ + 1, + 4, + 1, + 6, + 1, + 12, + 9, + 2, + 4, + 2, + 21, + 5, + 0, + 8, + 6, + 20, + 12, + 17, + 22, + 2, + 18, + 6, + 6, + 4, + 22, + 5, + 15, + 3, + 3, + 4, + 10, + 0, + 12, + 8, + 6, + 3, + 1, + 11, + 3, + 4, + 5, + 25, + 10, + 10, + 8, + 7, + 4, + 10, + 10, + 9, + 9, + 5, + 3, + 17, + 9, + 21, + 4, + 1, + 4, + 6, + 7, + 4, + 5, + 6 + ], + "weighted_loads": [ + 0.024620572105050087, + 0.17185797914862633, + 0.03721558675169945, + 0.24876073375344276, + 0.029138140380382538, + 1.0365599542856216, + 0.3873673379421234, + 0.11419187858700752, + 0.18171504139900208, + 0.41369665041565895, + 1.5120214466005564, + 0.13838874362409115, + 0.0, + 0.24885783903300762, + 0.4877582676708698, + 1.9336792007088661, + 0.4449479877948761, + 1.013100951910019, + 1.3851282503455877, + 0.08447252586483955, + 2.0362945422530174, + 0.22127043455839157, + 0.20073738135397434, + 0.18846781738102436, + 2.221236404031515, + 0.3160001263022423, + 1.4725970588624477, + 0.09423993900418282, + 0.18976490944623947, + 0.15134342573583126, + 0.40588850528001785, + 0.0, + 0.5611118972301483, + 0.3365598749369383, + 0.259838679805398, + 0.31079090759158134, + 0.05151445418596268, + 0.5444580614566803, + 0.15860164910554886, + 0.21571141108870506, + 0.16324320062994957, + 2.3659625221043825, + 0.3838562835007906, + 0.8212448097765446, + 0.32854295894503593, + 0.3347014896571636, + 0.11930909007787704, + 0.5768979825079441, + 0.6154231708496809, + 0.4024475235491991, + 0.3666877504438162, + 0.19184360653162003, + 0.12787075527012348, + 1.4950331505388021, + 0.9596191290766001, + 1.4939096011221409, + 0.24260369315743446, + 0.0654362291097641, + 0.17329687252640724, + 0.6342518255114555, + 0.3137894459068775, + 0.16626404225826263, + 0.41657462157309055, + 0.2893737740814686 + ], + "unique_experts": 62, + "load_cv": 0.7831943132873266, + "normalized_load_entropy": 0.9301197424829584, + "max_load_share": 0.050200803212851405 + } + }, + "s0_period": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "e682fccefb167a7e3d9a4cff6a6de27f3e79eb389a8a5cd3ac85a08f8ca47a62", + "route_weight_sha256": "745e581d23bd868a34558ce6eb528750b0486d852262cddc46ebe6ff6493f578", + "loads": [ + 2, + 1, + 0, + 5, + 1, + 2, + 2, + 1, + 5, + 1, + 12, + 3, + 0, + 5, + 5, + 10, + 4, + 6, + 10, + 2, + 7, + 3, + 1, + 3, + 8, + 5, + 5, + 2, + 3, + 3, + 6, + 0, + 5, + 2, + 6, + 2, + 1, + 2, + 1, + 3, + 2, + 9, + 5, + 7, + 6, + 4, + 3, + 5, + 5, + 7, + 3, + 3, + 3, + 5, + 8, + 8, + 2, + 1, + 3, + 5, + 5, + 6, + 1, + 1 + ], + "weighted_loads": [ + 0.05876556597650051, + 0.05232018232345581, + 0.0, + 0.19905375316739082, + 0.031945932656526566, + 0.18090610578656197, + 0.0813957154750824, + 0.08319579809904099, + 0.20870789885520935, + 0.05400906130671501, + 1.121928371489048, + 0.07535129971802235, + 0.0, + 0.16323689743876457, + 0.42821021378040314, + 0.9261594880372286, + 0.17348789796233177, + 0.3394012451171875, + 0.41366465762257576, + 0.08211418613791466, + 0.8152279313653708, + 0.09050373919308186, + 0.02170880138874054, + 0.10769895650446415, + 0.9202939197421074, + 0.3195176385343075, + 0.29544056206941605, + 0.07604433223605156, + 0.20583269000053406, + 0.12341656535863876, + 0.268998634070158, + 0.0, + 0.24081312865018845, + 0.06713215261697769, + 0.25451724976301193, + 0.2265031412243843, + 0.058732770383358, + 0.06798267737030983, + 0.0321592278778553, + 0.11133677139878273, + 0.06007333844900131, + 0.6360847447067499, + 0.19107475504279137, + 0.6791767068207264, + 0.26087252609431744, + 0.15954331308603287, + 0.09034022875130177, + 0.3416280299425125, + 0.4082496762275696, + 0.26118889823555946, + 0.1299995295703411, + 0.10218323580920696, + 0.13523317500948906, + 0.3399976156651974, + 0.920382909476757, + 0.3364850301295519, + 0.1351379156112671, + 0.03367502614855766, + 0.14137841202318668, + 0.41551370546221733, + 0.18330756202340126, + 0.22348330728709698, + 0.050759561359882355, + 0.03555675223469734 + ], + "unique_experts": 61, + "load_cv": 0.6792092982645926, + "normalized_load_entropy": 0.9421657980993889, + "max_load_share": 0.047619047619047616 + }, + "full_input": { + "tokens": 67, + "top_k": 6, + "decisions": 402, + "ordered_route_sha256": "b69fda870c3fe48b79a18af99ae74ab8826b480c588069526a4dc9244585948d", + "route_weight_sha256": "a1fb7211939091b7c166cfd3a1f59c943b4f4b25351500e32e97bcd0286609a5", + "loads": [ + 2, + 1, + 0, + 5, + 1, + 13, + 5, + 1, + 5, + 2, + 17, + 4, + 0, + 7, + 5, + 16, + 10, + 11, + 16, + 3, + 19, + 5, + 4, + 3, + 15, + 5, + 10, + 2, + 3, + 3, + 9, + 0, + 6, + 7, + 7, + 2, + 1, + 11, + 1, + 3, + 4, + 19, + 7, + 9, + 11, + 5, + 3, + 6, + 5, + 7, + 3, + 5, + 3, + 16, + 8, + 19, + 2, + 1, + 3, + 5, + 8, + 7, + 1, + 5 + ], + "weighted_loads": [ + 0.05876556597650051, + 0.05232018232345581, + 0.0, + 0.19905375316739082, + 0.031945932656526566, + 1.096817683428526, + 0.21417584642767906, + 0.08319579809904099, + 0.20870789885520935, + 0.4321483485400677, + 1.4371642395853996, + 0.10178502462804317, + 0.0, + 0.2265205755829811, + 0.42821021378040314, + 1.4667867328971624, + 0.5456674415618181, + 0.7242924384772778, + 1.0269022453576326, + 0.12163171917200089, + 1.8592034298926592, + 0.17088954336941242, + 0.18204005807638168, + 0.10769895650446415, + 1.5776930525898933, + 0.3195176385343075, + 0.6592585183680058, + 0.07604433223605156, + 0.20583269000053406, + 0.12341656535863876, + 0.42410293966531754, + 0.0, + 0.28110815584659576, + 0.332697631791234, + 0.2894141711294651, + 0.2265031412243843, + 0.058732770383358, + 0.5407955162227154, + 0.0321592278778553, + 0.11133677139878273, + 0.1455262489616871, + 1.511003540828824, + 0.28354985639452934, + 0.8570399656891823, + 0.4738247860223055, + 0.22740553319454193, + 0.09034022875130177, + 0.3804393410682678, + 0.4082496762275696, + 0.26118889823555946, + 0.1299995295703411, + 0.20307528413832188, + 0.13523317500948906, + 1.113512996584177, + 0.920382909476757, + 1.2003927249461412, + 0.1351379156112671, + 0.03367502614855766, + 0.14137841202318668, + 0.41551370546221733, + 0.3720869980752468, + 0.2632506024092436, + 0.050759561359882355, + 0.24417637288570404 + ], + "unique_experts": 61, + "load_cv": 0.810548387450621, + "normalized_load_entropy": 0.9238424640150656, + "max_load_share": 0.0472636815920398 + } + }, + "s1_period": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "2c7733af6ae5dbaa9e29032396fb67fc45c401fc746da459ba495682e97caa45", + "route_weight_sha256": "590ee39e6dc509da4c5651333824906fd2b3cbcbfdf07ae2ca625040f520010f", + "loads": [ + 0, + 1, + 2, + 5, + 2, + 2, + 3, + 1, + 4, + 1, + 12, + 2, + 0, + 5, + 5, + 10, + 5, + 7, + 12, + 2, + 6, + 2, + 2, + 3, + 8, + 4, + 4, + 3, + 3, + 2, + 5, + 0, + 6, + 4, + 5, + 1, + 1, + 3, + 1, + 3, + 2, + 12, + 5, + 8, + 6, + 3, + 2, + 4, + 7, + 6, + 3, + 2, + 3, + 4, + 9, + 9, + 2, + 0, + 3, + 6, + 3, + 4, + 2, + 0 + ], + "weighted_loads": [ + 0.0, + 0.049346424639225006, + 0.06745062954723835, + 0.19632988050580025, + 0.05567184090614319, + 0.17702467367053032, + 0.12059430405497551, + 0.08857136964797974, + 0.17870469391345978, + 0.050732143223285675, + 1.1421500947326422, + 0.047315509989857674, + 0.0, + 0.15146097913384438, + 0.4384202789515257, + 0.9058614205569029, + 0.19201189652085304, + 0.3293328080326319, + 0.45890793949365616, + 0.08615325018763542, + 0.8292126655578613, + 0.06628946773707867, + 0.0481208898127079, + 0.10969835706055164, + 0.9198527112603188, + 0.27236518636345863, + 0.2780090272426605, + 0.09429380111396313, + 0.18935422971844673, + 0.0870937928557396, + 0.22146011143922806, + 0.0, + 0.30487541668117046, + 0.1242833286523819, + 0.21766781620681286, + 0.1928505301475525, + 0.0521375946700573, + 0.10522491857409477, + 0.033543046563863754, + 0.09561974182724953, + 0.061504459008574486, + 0.7508363481611013, + 0.20149840041995049, + 0.6459680907428265, + 0.250277753919363, + 0.13723670691251755, + 0.05969395861029625, + 0.29722868651151657, + 0.4974254034459591, + 0.2384304776787758, + 0.13081680238246918, + 0.0789567194879055, + 0.11347512528300285, + 0.3382977917790413, + 0.9780033230781555, + 0.37945619225502014, + 0.13387886434793472, + 0.0, + 0.14940360933542252, + 0.4685968831181526, + 0.11930500902235508, + 0.16472472995519638, + 0.07881377451121807, + 0.0 + ], + "unique_experts": 59, + "load_cv": 0.7456939458124664, + "normalized_load_entropy": 0.9328802049906648, + "max_load_share": 0.047619047619047616 + }, + "full_input": { + "tokens": 83, + "top_k": 6, + "decisions": 498, + "ordered_route_sha256": "a2434dae8140e366e9ddd1bd97556da68d7eb420641cde2f3e48be6feab25598", + "route_weight_sha256": "1a7de3277dfed409babbd643711987116035b520fce77c3a509958059de50068", + "loads": [ + 0, + 4, + 2, + 7, + 2, + 11, + 9, + 2, + 4, + 3, + 20, + 4, + 0, + 8, + 6, + 20, + 11, + 18, + 22, + 2, + 17, + 4, + 5, + 4, + 23, + 4, + 14, + 3, + 3, + 2, + 10, + 0, + 12, + 10, + 7, + 3, + 1, + 11, + 4, + 6, + 5, + 27, + 8, + 12, + 9, + 7, + 3, + 10, + 10, + 9, + 9, + 4, + 3, + 17, + 10, + 21, + 4, + 0, + 3, + 8, + 7, + 4, + 5, + 5 + ], + "weighted_loads": [ + 0.0, + 0.17174962162971497, + 0.06745062954723835, + 0.2870662398636341, + 0.05567184090614319, + 0.9883087500929832, + 0.4113064594566822, + 0.11392597481608391, + 0.17870469391345978, + 0.4644287936389446, + 1.5064510107040405, + 0.10832926444709301, + 0.0, + 0.24137527868151665, + 0.48987665586173534, + 1.9025406073778868, + 0.40854084491729736, + 1.1017599124461412, + 1.3733501695096493, + 0.08615325018763542, + 1.7910270132124424, + 0.15983346290886402, + 0.15747414156794548, + 0.18555664457380772, + 2.2245778515934944, + 0.27236518636345863, + 1.475451536476612, + 0.09429380111396313, + 0.18935422971844673, + 0.0870937928557396, + 0.44487253949046135, + 0.0, + 0.5598102379590273, + 0.3897313494235277, + 0.2906997185200453, + 0.31297118589282036, + 0.0521375946700573, + 0.5444026701152325, + 0.21453331410884857, + 0.2740319035947323, + 0.16347065940499306, + 2.4289903435856104, + 0.33207326382398605, + 0.9073829725384712, + 0.36735375598073006, + 0.33205030485987663, + 0.09131988510489464, + 0.5902919769287109, + 0.6340072564780712, + 0.39882879331707954, + 0.3749164715409279, + 0.16162267699837685, + 0.11347512528300285, + 1.4665791746228933, + 1.0190147049725056, + 1.4029766209423542, + 0.2422960363328457, + 0.0, + 0.14940360933542252, + 0.7024323996156454, + 0.33901082165539265, + 0.16472472995519638, + 0.41216508485376835, + 0.2599117308855057 + ], + "unique_experts": 60, + "load_cv": 0.8007895170286977, + "normalized_load_entropy": 0.9261499743417814, + "max_load_share": 0.05421686746987952 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 42, + "ordered_topk_exact_tokens": 18, + "set_exact_tokens": 26, + "mean_set_jaccard": 0.8769841269841271, + "mean_token_weighted_tv": 0.02367038752085396, + "aggregate_load_tv": 0.06349206349206349 + }, + "system_bos": { + "tokens": 42, + "ordered_topk_exact_tokens": 20, + "set_exact_tokens": 22, + "mean_set_jaccard": 0.8639455782312927, + "mean_token_weighted_tv": 0.0241605529251198, + "aggregate_load_tv": 0.05555555555555555 + }, + "system_x": { + "tokens": 42, + "ordered_topk_exact_tokens": 16, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.8078231292517007, + "mean_token_weighted_tv": 0.03692153317942506, + "aggregate_load_tv": 0.08333333333333331 + }, + "system_period": { + "tokens": 42, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.7921768707482993, + "mean_token_weighted_tv": 0.03804161825350353, + "aggregate_load_tv": 0.09523809523809523 + }, + "bos_at_s0": { + "tokens": 42, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 23, + "mean_set_jaccard": 0.8605442176870749, + "mean_token_weighted_tv": 0.03052153584680387, + "aggregate_load_tv": 0.06746031746031746 + }, + "bos_at_s1": { + "tokens": 42, + "ordered_topk_exact_tokens": 8, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.7936507936507937, + "mean_token_weighted_tv": 0.03786871679836795, + "aggregate_load_tv": 0.09523809523809523 + }, + "x_at_s0": { + "tokens": 42, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 18, + "mean_set_jaccard": 0.8163265306122449, + "mean_token_weighted_tv": 0.035932299304043964, + "aggregate_load_tv": 0.0873015873015873 + }, + "x_at_s1": { + "tokens": 42, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.7678004535147392, + "mean_token_weighted_tv": 0.04400299214536235, + "aggregate_load_tv": 0.11111111111111109 + }, + "period_at_s0": { + "tokens": 42, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 20, + "mean_set_jaccard": 0.8452380952380952, + "mean_token_weighted_tv": 0.03189474361993018, + "aggregate_load_tv": 0.06746031746031746 + }, + "period_at_s1": { + "tokens": 42, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.7814058956916101, + "mean_token_weighted_tv": 0.043646722477639004, + "aggregate_load_tv": 0.10714285714285714 + } + } + }, + "layer_17": { + "layer": 17, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "45a96ce7789e1d8e9cf5ac7841b39882257cef4f6382c458ada0d7716610e954", + "route_weight_sha256": "d00447deeb42a270aed81a1bf95d6c1ec0a22c9455fc9836f258bb7dea11808a", + "loads": [ + 5, + 6, + 7, + 3, + 4, + 4, + 4, + 6, + 0, + 5, + 6, + 2, + 6, + 3, + 2, + 5, + 5, + 10, + 5, + 1, + 8, + 0, + 1, + 4, + 4, + 7, + 7, + 5, + 2, + 3, + 3, + 1, + 2, + 0, + 1, + 1, + 5, + 5, + 7, + 2, + 9, + 7, + 4, + 11, + 2, + 2, + 5, + 2, + 1, + 3, + 0, + 5, + 1, + 3, + 3, + 2, + 3, + 8, + 2, + 8, + 0, + 4, + 6, + 4 + ], + "weighted_loads": [ + 0.16568976268172264, + 0.1957180369645357, + 0.32614591903984547, + 0.19301871955394745, + 0.17577685974538326, + 0.16007518023252487, + 0.15759631618857384, + 0.46173397824168205, + 0.0, + 0.15547332353889942, + 0.5447794906795025, + 0.09859959408640862, + 0.21329881064593792, + 0.16341083124279976, + 0.09902487695217133, + 0.4657817557454109, + 0.3187011517584324, + 0.7598668672144413, + 0.5188130997121334, + 0.05128363147377968, + 0.9578908160328865, + 0.0, + 0.057738419622182846, + 0.22929347679018974, + 0.1815246306359768, + 0.5525920316576958, + 0.4622332062572241, + 0.1692540943622589, + 0.0636709276586771, + 0.09521003440022469, + 0.2133832573890686, + 0.04345838353037834, + 0.07002631202340126, + 0.0, + 0.050554465502500534, + 0.04560405761003494, + 0.29795920103788376, + 0.2870544455945492, + 0.41104322858154774, + 0.13568711280822754, + 0.6231054179370403, + 0.2363557107746601, + 0.14269758760929108, + 0.440303485840559, + 0.07363633625209332, + 0.10815421491861343, + 0.6107016205787659, + 0.11112969368696213, + 0.06088116392493248, + 0.12100624479353428, + 0.0, + 0.31251032277941704, + 0.045931391417980194, + 0.14323488995432854, + 0.13216017186641693, + 0.08339685201644897, + 0.10803594067692757, + 0.6086031999439001, + 0.1692497432231903, + 0.3534800037741661, + 0.0, + 0.1328021828085184, + 0.25456614419817924, + 0.13844379968941212 + ], + "unique_experts": 59, + "load_cv": 0.6534980587377429, + "normalized_load_entropy": 0.9421497254628224, + "max_load_share": 0.04365079365079365 + }, + "full_input": { + "tokens": 67, + "top_k": 6, + "decisions": 402, + "ordered_route_sha256": "d1cfed61e52c0f4a8f40bdbbaad3dbd977513bc4d8d44d6f83fc672326b5b1f4", + "route_weight_sha256": "c46fc37877f09e16ecff8a9e0f70547563745ebe4bc6e590795063c1bb3fc328", + "loads": [ + 13, + 8, + 9, + 10, + 4, + 4, + 6, + 6, + 0, + 8, + 12, + 3, + 8, + 11, + 2, + 7, + 5, + 16, + 8, + 1, + 11, + 0, + 1, + 12, + 12, + 12, + 16, + 8, + 6, + 5, + 3, + 1, + 9, + 0, + 1, + 1, + 5, + 6, + 12, + 2, + 17, + 13, + 7, + 14, + 2, + 6, + 5, + 2, + 1, + 4, + 1, + 5, + 3, + 4, + 3, + 5, + 5, + 10, + 3, + 8, + 0, + 5, + 11, + 4 + ], + "weighted_loads": [ + 0.4211692465469241, + 0.27524025924503803, + 0.4240719359368086, + 0.7744513228535652, + 0.17577685974538326, + 0.16007518023252487, + 0.2540467865765095, + 0.46173397824168205, + 0.0, + 0.26421288773417473, + 0.9411755688488483, + 0.11707206815481186, + 0.2778293304145336, + 0.749700989574194, + 0.09902487695217133, + 0.5513041839003563, + 0.3187011517584324, + 1.3828886076807976, + 0.6419358272105455, + 0.05128363147377968, + 1.2369720861315727, + 0.0, + 0.057738419622182846, + 0.5754086170345545, + 0.7153379693627357, + 0.7967697493731976, + 2.181473484262824, + 0.3108968771994114, + 0.22658835537731647, + 0.13367195194587111, + 0.2133832573890686, + 0.04345838353037834, + 0.33590724086388946, + 0.0, + 0.050554465502500534, + 0.04560405761003494, + 0.29795920103788376, + 0.32197750732302666, + 0.6018317379057407, + 0.13568711280822754, + 1.4456133432686329, + 0.41174516920000315, + 0.3311982825398445, + 0.5000489640515298, + 0.07363633625209332, + 0.9808776304125786, + 0.6107016205787659, + 0.11112969368696213, + 0.06088116392493248, + 0.1608701180666685, + 0.06940052658319473, + 0.31251032277941704, + 0.1971052587032318, + 0.19517778605222702, + 0.13216017186641693, + 0.26663071662187576, + 0.17372754216194153, + 0.7209177315235138, + 0.20190609991550446, + 0.3534800037741661, + 0.0, + 0.20746182091534138, + 0.6512469835579395, + 0.13844379968941212 + ], + "unique_experts": 60, + "load_cv": 0.7077802955078927, + "normalized_load_entropy": 0.9338565088530004, + "max_load_share": 0.04228855721393035 + } + }, + "s1_eos": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "3bc0852415ac1baf0882730dd656d4ca6bec815c2f89e6ef174be548abeccf95", + "route_weight_sha256": "784a5da8778164486ef6dbab5658b478831090cb0cbb289b88bfc3a872ad3e77", + "loads": [ + 3, + 5, + 6, + 3, + 6, + 3, + 4, + 7, + 0, + 3, + 6, + 2, + 8, + 3, + 2, + 5, + 5, + 10, + 5, + 1, + 8, + 0, + 2, + 6, + 7, + 8, + 5, + 4, + 3, + 3, + 3, + 1, + 3, + 1, + 2, + 1, + 5, + 4, + 7, + 2, + 9, + 5, + 4, + 9, + 2, + 3, + 5, + 2, + 1, + 4, + 0, + 5, + 1, + 3, + 3, + 2, + 4, + 7, + 2, + 8, + 0, + 2, + 5, + 4 + ], + "weighted_loads": [ + 0.10116008669137955, + 0.1740608960390091, + 0.3052678368985653, + 0.19302291423082352, + 0.27218358032405376, + 0.13415131345391273, + 0.15742117539048195, + 0.5210071168839931, + 0.0, + 0.08980615995824337, + 0.5499396622180939, + 0.09393419325351715, + 0.2867079060524702, + 0.17234677448868752, + 0.09975764527916908, + 0.46025289222598076, + 0.36039602756500244, + 0.7868103981018066, + 0.4983484782278538, + 0.05330631136894226, + 0.9082280471920967, + 0.0, + 0.0912620946764946, + 0.28381947986781597, + 0.2915835902094841, + 0.5832937620580196, + 0.37617677450180054, + 0.13928516022861004, + 0.10980821773409843, + 0.10382957383990288, + 0.21441801637411118, + 0.04647739976644516, + 0.08764546923339367, + 0.03189244866371155, + 0.09530528262257576, + 0.04668174311518669, + 0.31150611862540245, + 0.2372983731329441, + 0.4199519343674183, + 0.13901890069246292, + 0.6073386743664742, + 0.16361012868583202, + 0.14507333934307098, + 0.36929648369550705, + 0.07053487189114094, + 0.13634318113327026, + 0.6168420650064945, + 0.10738299414515495, + 0.059110045433044434, + 0.15258623287081718, + 0.0, + 0.29707371816039085, + 0.045863740146160126, + 0.13841522485017776, + 0.12503764405846596, + 0.0814269445836544, + 0.13280549459159374, + 0.5844685137271881, + 0.1733061894774437, + 0.3412251081317663, + 0.0, + 0.0667969100177288, + 0.20786823518574238, + 0.1408582516014576 + ], + "unique_experts": 60, + "load_cv": 0.6202674184946007, + "normalized_load_entropy": 0.9485426700673898, + "max_load_share": 0.03968253968253968 + }, + "full_input": { + "tokens": 83, + "top_k": 6, + "decisions": 498, + "ordered_route_sha256": "571973157c2dc75459f484c9796fe02efc362b3bc00f308ea53d3ce94e1d9e47", + "route_weight_sha256": "048aa929d4c6a5c1ce1632bb025e216762bbacdc31c79ed319c8b21c2e2c1ac4", + "loads": [ + 11, + 6, + 8, + 9, + 12, + 3, + 7, + 8, + 0, + 9, + 13, + 4, + 8, + 11, + 2, + 12, + 7, + 18, + 8, + 1, + 9, + 1, + 2, + 17, + 17, + 28, + 18, + 6, + 5, + 6, + 5, + 2, + 7, + 1, + 2, + 1, + 10, + 6, + 11, + 3, + 22, + 13, + 8, + 10, + 4, + 8, + 7, + 4, + 1, + 6, + 1, + 11, + 5, + 4, + 4, + 8, + 12, + 17, + 3, + 10, + 1, + 7, + 14, + 4 + ], + "weighted_loads": [ + 0.4137849723920226, + 0.2165362909436226, + 0.3875546306371689, + 0.8237782903015614, + 0.672395845875144, + 0.13415131345391273, + 0.27682844549417496, + 0.5774888023734093, + 0.0, + 0.2861256171017885, + 1.047435401007533, + 0.1601845733821392, + 0.2867079060524702, + 0.7766342386603355, + 0.09975764527916908, + 0.7935896664857864, + 0.5281564928591251, + 1.439706675708294, + 0.6062368992716074, + 0.05330631136894226, + 0.9771989956498146, + 0.07652508467435837, + 0.0912620946764946, + 1.0178851298987865, + 0.8915621710475534, + 1.8402597643435001, + 2.2353388853371143, + 0.23625859804451466, + 0.1962106116116047, + 0.2186778774484992, + 0.3092281296849251, + 0.08612915500998497, + 0.20036090444773436, + 0.03189244866371155, + 0.09530528262257576, + 0.04668174311518669, + 0.5730645284056664, + 0.30989229679107666, + 0.7456634026020765, + 0.17263783514499664, + 2.124646194279194, + 0.5784089956432581, + 0.3276711218059063, + 0.388099892064929, + 0.30522662959992886, + 1.3850711211562157, + 0.8383219502866268, + 0.23975929245352745, + 0.059110045433044434, + 0.2291250191628933, + 0.13652655482292175, + 0.5951024703681469, + 0.2854219302535057, + 0.19348229467868805, + 0.21229220554232597, + 0.4757747370749712, + 0.7948328834027052, + 1.136180404573679, + 0.19700241088867188, + 0.4328665155917406, + 0.034835997968912125, + 0.35116021707654, + 0.8952360283583403, + 0.1408582516014576 + ], + "unique_experts": 63, + "load_cv": 0.7175055938381788, + "normalized_load_entropy": 0.9390414597895207, + "max_load_share": 0.05622489959839357 + } + }, + "s0_bos": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "786e8be9aff6f9a35833bf155d1c09df11dc215d52cfeea71e7b6d2d76900ba1", + "route_weight_sha256": "2cfd109a3aa18b0d4bc75f0723ffead56907057c91812b2a9938f9d38a4c5d90", + "loads": [ + 5, + 1, + 7, + 3, + 5, + 5, + 4, + 6, + 0, + 5, + 7, + 2, + 7, + 3, + 2, + 4, + 5, + 10, + 5, + 1, + 7, + 1, + 1, + 5, + 4, + 6, + 10, + 7, + 2, + 3, + 3, + 1, + 3, + 0, + 1, + 1, + 5, + 4, + 7, + 2, + 9, + 6, + 4, + 11, + 2, + 2, + 5, + 2, + 2, + 3, + 0, + 6, + 1, + 3, + 3, + 2, + 3, + 7, + 2, + 5, + 0, + 4, + 6, + 4 + ], + "weighted_loads": [ + 0.16523361764848232, + 0.028461582958698273, + 0.3259170576930046, + 0.1977587640285492, + 0.21683158352971077, + 0.17865602113306522, + 0.16032665222883224, + 0.442768856883049, + 0.0, + 0.16118365339934826, + 0.5626369640231133, + 0.09677891805768013, + 0.25956491008400917, + 0.15585977211594582, + 0.0929778628051281, + 0.4609113000333309, + 0.31086750514805317, + 0.7328237146139145, + 0.5198018923401833, + 0.06070723384618759, + 0.84998594596982, + 0.034919120371341705, + 0.05980760231614113, + 0.2485826201736927, + 0.15873802825808525, + 0.5079108588397503, + 0.6375469472259283, + 0.23428237810730934, + 0.05814292095601559, + 0.11019206419587135, + 0.23094230145215988, + 0.052507881075143814, + 0.09230378456413746, + 0.0, + 0.04955751448869705, + 0.04562404006719589, + 0.29587770625948906, + 0.22219398245215416, + 0.3868288416415453, + 0.1396082267165184, + 0.5908865705132484, + 0.21643763408064842, + 0.13926221057772636, + 0.43413120694458485, + 0.07945261150598526, + 0.10755609348416328, + 0.6771863512694836, + 0.10978317633271217, + 0.0899609848856926, + 0.12379433587193489, + 0.0, + 0.34905398823320866, + 0.04748852550983429, + 0.12874263525009155, + 0.1435406394302845, + 0.0788540318608284, + 0.10636850260198116, + 0.561348021030426, + 0.17012614011764526, + 0.2510880306363106, + 0.0, + 0.13586074113845825, + 0.30146948248147964, + 0.14462601765990257 + ], + "unique_experts": 60, + "load_cv": 0.6534980587377429, + "normalized_load_entropy": 0.943950560542291, + "max_load_share": 0.04365079365079365 + }, + "full_input": { + "tokens": 67, + "top_k": 6, + "decisions": 402, + "ordered_route_sha256": "f817f11b030548e98f79555ee27f78490c70bf8f150bdd7ad542bf99d28c6256", + "route_weight_sha256": "ef0fabebc5632eb48f74f8768a45f37eba5bdeb52a71f86b56dafaed971997a4", + "loads": [ + 12, + 3, + 8, + 10, + 5, + 5, + 6, + 6, + 0, + 8, + 13, + 3, + 11, + 11, + 2, + 6, + 5, + 16, + 9, + 2, + 10, + 2, + 1, + 13, + 11, + 11, + 18, + 9, + 6, + 3, + 3, + 1, + 9, + 0, + 1, + 1, + 5, + 5, + 13, + 2, + 17, + 11, + 7, + 13, + 2, + 6, + 5, + 2, + 2, + 5, + 1, + 6, + 3, + 5, + 4, + 5, + 4, + 9, + 3, + 6, + 0, + 5, + 12, + 4 + ], + "weighted_loads": [ + 0.43097308836877346, + 0.11273873597383499, + 0.3796178437769413, + 0.779191367328167, + 0.21683158352971077, + 0.17865602113306522, + 0.2567771226167679, + 0.442768856883049, + 0.0, + 0.26992321759462357, + 0.9590330421924591, + 0.11525139212608337, + 0.5162931326776743, + 0.74214993044734, + 0.0929778628051281, + 0.5511842370033264, + 0.31086750514805317, + 1.3558454550802708, + 0.8135788235813379, + 0.11807134374976158, + 1.1481036879122257, + 0.11535143107175827, + 0.05980760231614113, + 0.5912223141640425, + 0.6979384869337082, + 0.7531454935669899, + 1.3795454856008291, + 0.3302837274968624, + 0.20820623077452183, + 0.11019206419587135, + 0.23094230145215988, + 0.052507881075143814, + 0.3540324103087187, + 0.0, + 0.04955751448869705, + 0.04562404006719589, + 0.29587770625948906, + 0.25202267058193684, + 0.6117187775671482, + 0.1396082267165184, + 1.4259598590433598, + 0.37560570426285267, + 0.32446687668561935, + 0.49065662920475006, + 0.07945261150598526, + 0.8850107081234455, + 0.6771863512694836, + 0.10978317633271217, + 0.0899609848856926, + 0.3281862735748291, + 0.06940052658319473, + 0.34905398823320866, + 0.20308652520179749, + 0.23144381865859032, + 0.21969332918524742, + 0.2608643025159836, + 0.14673845656216145, + 0.6736625526100397, + 0.2027824968099594, + 0.2961231917142868, + 0.0, + 0.2291279137134552, + 0.6783567555248737, + 0.14462601765990257 + ], + "unique_experts": 61, + "load_cv": 0.7038526333628682, + "normalized_load_entropy": 0.937415031488103, + "max_load_share": 0.04477611940298507 + } + }, + "s1_bos": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "0c6527c10fb2a83224a8b7d4c60e51a01ebaa04117cdca6ab84342dc25894f6c", + "route_weight_sha256": "64d68744fc006e2e55d0d758909209a999a76a61e695c7bc8a04d57190ffc070", + "loads": [ + 6, + 2, + 6, + 3, + 5, + 5, + 3, + 6, + 0, + 3, + 5, + 2, + 6, + 2, + 2, + 5, + 5, + 10, + 6, + 1, + 7, + 0, + 2, + 4, + 5, + 8, + 10, + 6, + 3, + 1, + 3, + 1, + 3, + 0, + 1, + 1, + 5, + 4, + 8, + 2, + 9, + 7, + 5, + 10, + 2, + 2, + 5, + 2, + 2, + 4, + 0, + 5, + 1, + 3, + 3, + 2, + 4, + 7, + 2, + 6, + 0, + 3, + 7, + 4 + ], + "weighted_loads": [ + 0.19878383725881577, + 0.05603135749697685, + 0.28878532722592354, + 0.19489186629652977, + 0.23942448571324348, + 0.17910798825323582, + 0.12850934080779552, + 0.4645291939377785, + 0.0, + 0.08947654254734516, + 0.48723193630576134, + 0.09372490644454956, + 0.22499226033687592, + 0.12184692919254303, + 0.09306101128458977, + 0.48300064727663994, + 0.32468206994235516, + 0.7386081218719482, + 0.5725972540676594, + 0.05629931017756462, + 0.8497562073171139, + 0.0, + 0.09697682783007622, + 0.2069302536547184, + 0.2101946733891964, + 0.5710623096674681, + 0.6571015231311321, + 0.19865122996270657, + 0.0923694297671318, + 0.03975098952651024, + 0.23092824965715408, + 0.041736286133527756, + 0.0879032127559185, + 0.0, + 0.05150561034679413, + 0.044810377061367035, + 0.30396996811032295, + 0.21697727218270302, + 0.4428724627941847, + 0.14569749683141708, + 0.628712609410286, + 0.23777071200311184, + 0.15944087132811546, + 0.3965906910598278, + 0.07478022202849388, + 0.10304928943514824, + 0.6431768648326397, + 0.11042720451951027, + 0.09200305864214897, + 0.1542888842523098, + 0.0, + 0.31101443991065025, + 0.04674911871552467, + 0.14042483642697334, + 0.13697459176182747, + 0.07581686601042747, + 0.14856718108057976, + 0.5791329853236675, + 0.17031432688236237, + 0.2999974563717842, + 0.0, + 0.09898161143064499, + 0.34103960916399956, + 0.1500786617398262 + ], + "unique_experts": 59, + "load_cv": 0.6581083314802502, + "normalized_load_entropy": 0.9418139006287279, + "max_load_share": 0.03968253968253968 + }, + "full_input": { + "tokens": 83, + "top_k": 6, + "decisions": 498, + "ordered_route_sha256": "661fee1127d9b0589e2a50793c685d51e465781a62cae8d10123d997aad72dfe", + "route_weight_sha256": "fa079924a27051d463037d27076fac354a47e4e7bcad8d5f5e667e2b218630f3", + "loads": [ + 13, + 6, + 8, + 9, + 11, + 5, + 6, + 7, + 0, + 9, + 12, + 4, + 8, + 10, + 2, + 11, + 7, + 18, + 10, + 1, + 8, + 1, + 2, + 16, + 14, + 28, + 22, + 8, + 3, + 2, + 5, + 2, + 6, + 0, + 1, + 1, + 10, + 6, + 12, + 3, + 23, + 14, + 9, + 11, + 4, + 7, + 7, + 4, + 2, + 6, + 2, + 11, + 5, + 4, + 4, + 8, + 12, + 17, + 3, + 8, + 1, + 8, + 17, + 4 + ], + "weighted_loads": [ + 0.49317658692598343, + 0.2520661912858486, + 0.37107212096452713, + 0.8256472423672676, + 0.6396367512643337, + 0.17910798825323582, + 0.24791661091148853, + 0.5210108794271946, + 0.0, + 0.3079617563635111, + 0.9847276750952005, + 0.15997528657317162, + 0.3241145871579647, + 0.726134393364191, + 0.09306101128458977, + 0.7690137401223183, + 0.49244253523647785, + 1.3915043994784355, + 0.7191238608211279, + 0.05629931017756462, + 0.9467586986720562, + 0.07652508467435837, + 0.09697682783007622, + 0.9757115561515093, + 0.8239849209785461, + 1.823595879599452, + 1.628353327512741, + 0.28345336206257343, + 0.0923694297671318, + 0.11863998696208, + 0.325738362967968, + 0.08138804137706757, + 0.19622234813869, + 0.0, + 0.05150561034679413, + 0.044810377061367035, + 0.5655283778905869, + 0.28957119584083557, + 0.7685565631836653, + 0.1793164312839508, + 2.2098209597170353, + 0.6584643479436636, + 0.3406078666448593, + 0.41539409942924976, + 0.3094719797372818, + 1.4597797505557537, + 0.864656750112772, + 0.24280350282788277, + 0.09200305864214897, + 0.23441766947507858, + 0.1937604434788227, + 0.6090431921184063, + 0.3057241849601269, + 0.19461430609226227, + 0.22422915324568748, + 0.47910734824836254, + 0.8107171431183815, + 1.1308448761701584, + 0.19401054829359055, + 0.3916388638317585, + 0.034835997968912125, + 0.3797310069203377, + 1.087899375706911, + 0.1500786617398262 + ], + "unique_experts": 62, + "load_cv": 0.7450313365168327, + "normalized_load_entropy": 0.9346766087919762, + "max_load_share": 0.05622489959839357 + } + }, + "s0_x": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "de808121c2dbe70d7dd587dc7c772e43eb2e29d90e595803a109a80482132408", + "route_weight_sha256": "d3232c2c4bd3804b23ba2c2c22b287e6d44a2f12d25f36b6952fa652a7ed0538", + "loads": [ + 5, + 1, + 7, + 3, + 5, + 6, + 4, + 7, + 0, + 6, + 5, + 2, + 7, + 3, + 2, + 4, + 7, + 10, + 7, + 1, + 6, + 0, + 2, + 5, + 4, + 8, + 7, + 5, + 3, + 1, + 3, + 1, + 2, + 0, + 2, + 1, + 5, + 4, + 7, + 2, + 9, + 5, + 4, + 9, + 2, + 3, + 5, + 2, + 1, + 4, + 0, + 5, + 1, + 3, + 3, + 2, + 3, + 10, + 2, + 6, + 0, + 4, + 6, + 3 + ], + "weighted_loads": [ + 0.1697037797421217, + 0.027343647554516792, + 0.3153831958770752, + 0.203960333019495, + 0.22181795723736286, + 0.20338813588023186, + 0.16756828874349594, + 0.48952541314065456, + 0.0, + 0.18605023249983788, + 0.49481984972953796, + 0.09784762561321259, + 0.24867084063589573, + 0.16177241131663322, + 0.09625113010406494, + 0.4288947880268097, + 0.3770004212856293, + 0.7638563476502895, + 0.5929754097014666, + 0.060147903859615326, + 0.8137387670576572, + 0.0, + 0.09001411683857441, + 0.2470469083636999, + 0.16125274449586868, + 0.5619001965969801, + 0.5037205647677183, + 0.16962426714599133, + 0.09147042408585548, + 0.03911151736974716, + 0.21896051242947578, + 0.05308196321129799, + 0.051475873216986656, + 0.0, + 0.08641808107495308, + 0.04414056986570358, + 0.3249230459332466, + 0.22369356080889702, + 0.41546291299164295, + 0.13090602308511734, + 0.7115528024733067, + 0.17766418308019638, + 0.13880559615790844, + 0.3524066749960184, + 0.0768816415220499, + 0.1293183583766222, + 0.692826721817255, + 0.11008314788341522, + 0.060187507420778275, + 0.1524722408503294, + 0.0, + 0.3133339621126652, + 0.046360358595848083, + 0.13734396174550056, + 0.13836855441331863, + 0.08160456269979477, + 0.10924860835075378, + 0.6653460692614317, + 0.16687700897455215, + 0.26958387717604637, + 0.0, + 0.1422502938657999, + 0.3045658804476261, + 0.11439181491732597 + ], + "unique_experts": 59, + "load_cv": 0.6519540564416777, + "normalized_load_entropy": 0.9420550997396894, + "max_load_share": 0.03968253968253968 + }, + "full_input": { + "tokens": 67, + "top_k": 6, + "decisions": 402, + "ordered_route_sha256": "d2ee9ba426f555a5f70daef45967c2b993111a90af400ad6b72f622446569a48", + "route_weight_sha256": "784c772e3d8e67fd138fdc8737842132907074301a6a397b22c0340516c9ff5c", + "loads": [ + 11, + 2, + 10, + 11, + 5, + 6, + 6, + 7, + 0, + 10, + 12, + 3, + 9, + 12, + 3, + 6, + 7, + 17, + 11, + 1, + 8, + 1, + 2, + 13, + 11, + 15, + 14, + 7, + 7, + 2, + 3, + 1, + 8, + 0, + 2, + 1, + 5, + 4, + 13, + 2, + 16, + 9, + 7, + 11, + 2, + 7, + 5, + 2, + 2, + 5, + 2, + 5, + 4, + 4, + 4, + 6, + 4, + 12, + 3, + 6, + 0, + 5, + 10, + 3 + ], + "weighted_loads": [ + 0.37214829213917255, + 0.06340019591152668, + 0.4512624964118004, + 0.9377484880387783, + 0.22181795723736286, + 0.20338813588023186, + 0.2640187591314316, + 0.48952541314065456, + 0.0, + 0.3387147281318903, + 1.0433570370078087, + 0.11632009968161583, + 0.3132013604044914, + 0.7860406003892422, + 0.1302626021206379, + 0.5221882909536362, + 0.3770004212856293, + 1.4321943297982216, + 0.9340807907283306, + 0.060147903859615326, + 1.0107492692768574, + 0.046539902687072754, + 0.09001411683857441, + 0.6148374080657959, + 0.6801151670515537, + 0.8905525505542755, + 1.1302651036530733, + 0.2656256165355444, + 0.24358399957418442, + 0.06958835944533348, + 0.21896051242947578, + 0.05308196321129799, + 0.3132044989615679, + 0.0, + 0.08641808107495308, + 0.04414056986570358, + 0.3249230459332466, + 0.22369356080889702, + 0.6352957878261805, + 0.13090602308511734, + 1.5085972473025322, + 0.31846274994313717, + 0.329916151240468, + 0.4089320972561836, + 0.0768816415220499, + 0.9740519244223833, + 0.692826721817255, + 0.11008314788341522, + 0.09955860674381256, + 0.18997383676469326, + 0.1351708620786667, + 0.3133339621126652, + 0.2295850906521082, + 0.19000281020998955, + 0.18162961304187775, + 0.29851851984858513, + 0.145956389605999, + 0.7776606008410454, + 0.1995333656668663, + 0.26958387717604637, + 0.0, + 0.22609327919781208, + 0.5659010149538517, + 0.11439181491732597 + ], + "unique_experts": 61, + "load_cv": 0.68791777170114, + "normalized_load_entropy": 0.9391310974332435, + "max_load_share": 0.04228855721393035 + } + }, + "s1_x": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "066c909e73afc5ada76307c952d305580b7024c23834c0f523a680b2fb650549", + "route_weight_sha256": "f4012847fba0fc6a59f5709d75cfa67ba14670e9d37af7fa92de42952b95bc86", + "loads": [ + 5, + 2, + 6, + 3, + 6, + 2, + 5, + 7, + 0, + 5, + 6, + 2, + 5, + 3, + 2, + 4, + 8, + 10, + 5, + 1, + 6, + 0, + 2, + 5, + 2, + 9, + 8, + 5, + 4, + 2, + 3, + 1, + 2, + 0, + 2, + 1, + 6, + 4, + 6, + 3, + 10, + 3, + 3, + 10, + 2, + 3, + 6, + 2, + 1, + 4, + 0, + 5, + 2, + 3, + 3, + 1, + 4, + 10, + 2, + 7, + 0, + 4, + 6, + 3 + ], + "weighted_loads": [ + 0.16331840865314007, + 0.05672813393175602, + 0.31099013425409794, + 0.2078869603574276, + 0.2991510406136513, + 0.09463947638869286, + 0.19430461898446083, + 0.5010275654494762, + 0.0, + 0.15513469837605953, + 0.5226824600249529, + 0.09659620374441147, + 0.1883730310946703, + 0.16358357667922974, + 0.09998387470841408, + 0.4022488258779049, + 0.457380598410964, + 0.7971399687230587, + 0.5300880260765553, + 0.057929132133722305, + 0.8168248049914837, + 0.0, + 0.09776470810174942, + 0.23375510424375534, + 0.0862705297768116, + 0.610212717205286, + 0.5170958824455738, + 0.16121939569711685, + 0.11004060693085194, + 0.06850561127066612, + 0.2197367176413536, + 0.050578244030475616, + 0.0692776907235384, + 0.0, + 0.09425272420048714, + 0.04346585273742676, + 0.3563910536468029, + 0.216155257076025, + 0.4106207396835089, + 0.16380040533840656, + 0.7051731180399656, + 0.0968400351703167, + 0.102315628901124, + 0.38905700109899044, + 0.07590287737548351, + 0.13304872065782547, + 0.687055641785264, + 0.1110679842531681, + 0.05380174145102501, + 0.14938789419829845, + 0.0, + 0.30762986838817596, + 0.0767715536057949, + 0.13192764297127724, + 0.1352996900677681, + 0.049819134175777435, + 0.1473924107849598, + 0.7078174706548452, + 0.17382078617811203, + 0.2999962121248245, + 0.0, + 0.13692453689873219, + 0.24910174682736397, + 0.11219063401222229 + ], + "unique_experts": 59, + "load_cv": 0.6702473755783305, + "normalized_load_entropy": 0.9411778598895189, + "max_load_share": 0.03968253968253968 + }, + "full_input": { + "tokens": 83, + "top_k": 6, + "decisions": 498, + "ordered_route_sha256": "b61da5105a72f6fa54f5293b86de0136a1f1000691d8923d37908c48b4cfe2fa", + "route_weight_sha256": "bc7eb506c21c4a33d09d71e846538904c5944ee1dd19aa727dce018244f3acb9", + "loads": [ + 11, + 3, + 10, + 10, + 12, + 2, + 8, + 8, + 1, + 12, + 14, + 4, + 5, + 12, + 2, + 11, + 10, + 19, + 8, + 1, + 6, + 1, + 2, + 17, + 11, + 31, + 17, + 6, + 4, + 3, + 5, + 2, + 5, + 0, + 2, + 1, + 11, + 6, + 9, + 4, + 23, + 9, + 8, + 11, + 4, + 8, + 8, + 4, + 2, + 5, + 2, + 11, + 7, + 4, + 4, + 8, + 12, + 21, + 4, + 9, + 1, + 10, + 14, + 3 + ], + "weighted_loads": [ + 0.4148282874375582, + 0.09920352883636951, + 0.4807944595813751, + 0.9990191534161568, + 0.6993633061647415, + 0.09463947638869286, + 0.31371188908815384, + 0.5575092509388924, + 0.0260931309312582, + 0.385715464130044, + 1.1603894978761673, + 0.16284658387303352, + 0.1883730310946703, + 0.8301669247448444, + 0.09998387470841408, + 0.7354067377746105, + 0.6251410637050867, + 1.503032386302948, + 0.6551816258579493, + 0.057929132133722305, + 0.8168248049914837, + 0.07652508467435837, + 0.09776470810174942, + 0.9936259761452675, + 0.648714616894722, + 2.00532329082489, + 1.2691577598452568, + 0.2016933262348175, + 0.11004060693085194, + 0.14739460870623589, + 0.3145468309521675, + 0.09022999927401543, + 0.1775968261063099, + 0.0, + 0.09425272420048714, + 0.04346585273742676, + 0.6179494634270668, + 0.28874918073415756, + 0.7052127104252577, + 0.19741933979094028, + 2.2465426828712225, + 0.45440448448061943, + 0.31794035620987415, + 0.4078604094684124, + 0.31059463508427143, + 1.3542828485369682, + 0.9085355270653963, + 0.2434442825615406, + 0.09253741055727005, + 0.19405549205839634, + 0.22670242190361023, + 0.605658620595932, + 0.34601930901408195, + 0.18718811869621277, + 0.2225542515516281, + 0.4756296221166849, + 0.8155779503285885, + 1.3420763332396746, + 0.24601814895868301, + 0.3916376195847988, + 0.034835997968912125, + 0.45130777917802334, + 0.7974961809813976, + 0.11219063401222229 + ], + "unique_experts": 63, + "load_cv": 0.7577388458948686, + "normalized_load_entropy": 0.9351339253460367, + "max_load_share": 0.06224899598393574 + } + }, + "s0_period": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "6b99a87f62f2a11d8f23a39df3ff60d9d01380b08e9e2194fb73917bc9400dc8", + "route_weight_sha256": "4db6353c67d62cabe3895cc3ab1b883fce84449f6f82eb59ad7439a93b2a2939", + "loads": [ + 4, + 2, + 6, + 3, + 4, + 5, + 4, + 7, + 0, + 6, + 5, + 3, + 5, + 3, + 2, + 4, + 7, + 10, + 5, + 1, + 7, + 0, + 2, + 5, + 3, + 7, + 8, + 7, + 3, + 2, + 3, + 1, + 3, + 0, + 2, + 1, + 5, + 4, + 8, + 2, + 9, + 4, + 5, + 9, + 2, + 2, + 5, + 2, + 1, + 3, + 0, + 5, + 2, + 3, + 3, + 2, + 4, + 10, + 2, + 6, + 0, + 4, + 6, + 4 + ], + "weighted_loads": [ + 0.1440577171742916, + 0.05850844830274582, + 0.29381405003368855, + 0.20219910889863968, + 0.2055707350373268, + 0.17523621581494808, + 0.16768895834684372, + 0.4975277967751026, + 0.0, + 0.18175849504768848, + 0.4960176609456539, + 0.13571883738040924, + 0.1927617359906435, + 0.16378682851791382, + 0.09305146709084511, + 0.42239897698163986, + 0.3838314116001129, + 0.7877161577343941, + 0.5221260860562325, + 0.056499186903238297, + 0.8771086856722832, + 0.0, + 0.08491108566522598, + 0.24363631568849087, + 0.12602174282073975, + 0.5468330271542072, + 0.49949683994054794, + 0.23325158283114433, + 0.08912288397550583, + 0.0711904875934124, + 0.22227763757109642, + 0.05064826086163521, + 0.08594278059899807, + 0.0, + 0.08859509229660034, + 0.04408136010169983, + 0.33175909891724586, + 0.22640248388051987, + 0.4480246864259243, + 0.13261040300130844, + 0.7059449851512909, + 0.14609740674495697, + 0.16077681630849838, + 0.3531783428043127, + 0.07919586636126041, + 0.09719426929950714, + 0.6891508065164089, + 0.1097588948905468, + 0.060177914798259735, + 0.11336612142622471, + 0.0, + 0.31194954365491867, + 0.073744410648942, + 0.12744106724858284, + 0.1395939700305462, + 0.0895884558558464, + 0.14484644308686256, + 0.6699693519622087, + 0.16607710719108582, + 0.2777112554758787, + 0.0, + 0.13916130177676678, + 0.2972438223659992, + 0.14309175498783588 + ], + "unique_experts": 59, + "load_cv": 0.633132402386639, + "normalized_load_entropy": 0.9460616185300134, + "max_load_share": 0.03968253968253968 + }, + "full_input": { + "tokens": 67, + "top_k": 6, + "decisions": 402, + "ordered_route_sha256": "6bf64b5c6c186a8c99b6cbedae7335c8a79d22ffa1acde19c835366e4b9387c6", + "route_weight_sha256": "83338e1e10d91cfc56cc2a35d4a161e3752be2c78732e149a614e23f78bb87ab", + "loads": [ + 10, + 3, + 8, + 11, + 4, + 5, + 6, + 7, + 0, + 9, + 11, + 4, + 7, + 11, + 3, + 6, + 7, + 16, + 9, + 1, + 10, + 1, + 2, + 12, + 10, + 15, + 15, + 10, + 7, + 3, + 3, + 1, + 9, + 0, + 2, + 1, + 5, + 4, + 14, + 2, + 16, + 8, + 9, + 11, + 2, + 6, + 5, + 2, + 1, + 4, + 2, + 5, + 5, + 4, + 4, + 7, + 5, + 13, + 3, + 6, + 0, + 5, + 11, + 4 + ], + "weighted_loads": [ + 0.3404947333037853, + 0.0945649966597557, + 0.41703454963862896, + 0.8295583352446556, + 0.2055707350373268, + 0.17523621581494808, + 0.26413942873477936, + 0.4975277967751026, + 0.0, + 0.2904980592429638, + 0.8924137391149998, + 0.15419131144881248, + 0.2572922557592392, + 0.750076986849308, + 0.12816724181175232, + 0.5171831659972668, + 0.3838314116001129, + 1.4107378982007504, + 0.9039558190852404, + 0.056499186903238297, + 1.1283342987298965, + 0.048349857330322266, + 0.08491108566522598, + 0.5555967874825001, + 0.6776531524956226, + 0.9163740314543247, + 1.1229875162243843, + 0.365427166223526, + 0.24100502580404282, + 0.10779159516096115, + 0.22227763757109642, + 0.05064826086163521, + 0.3476714063435793, + 0.0, + 0.08859509229660034, + 0.04408136010169983, + 0.33175909891724586, + 0.22640248388051987, + 0.6673600245267153, + 0.13261040300130844, + 1.4941590763628483, + 0.2935763020068407, + 0.39745528250932693, + 0.4097037650644779, + 0.07919586636126041, + 0.9931641072034836, + 0.6891508065164089, + 0.1097588948905468, + 0.060177914798259735, + 0.1467397939413786, + 0.13537316769361496, + 0.31194954365491867, + 0.26459589041769505, + 0.17850985378026962, + 0.18554546684026718, + 0.47537143900990486, + 0.182585671544075, + 0.8237028568983078, + 0.19873346388339996, + 0.2777112554758787, + 0.0, + 0.23476450704038143, + 0.6055287346243858, + 0.14309175498783588 + ], + "unique_experts": 61, + "load_cv": 0.6757200670174558, + "normalized_load_entropy": 0.9409146852150545, + "max_load_share": 0.03980099502487562 + } + }, + "s1_period": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "2ea609149bd36f4254657588439222ea95562cab0a93d1bd2762a1e1c57264bc", + "route_weight_sha256": "4ebe9904f1e323b91f422e390dfe81b47a94334154d39e7ea7b81111b821b9a2", + "loads": [ + 5, + 3, + 6, + 3, + 5, + 4, + 5, + 6, + 0, + 4, + 7, + 3, + 4, + 3, + 2, + 5, + 8, + 10, + 5, + 1, + 6, + 0, + 2, + 4, + 4, + 8, + 9, + 5, + 3, + 2, + 3, + 1, + 2, + 1, + 2, + 1, + 5, + 4, + 6, + 3, + 9, + 3, + 4, + 8, + 2, + 2, + 6, + 2, + 1, + 4, + 0, + 5, + 2, + 3, + 3, + 2, + 5, + 10, + 2, + 6, + 0, + 3, + 6, + 4 + ], + "weighted_loads": [ + 0.1608402319252491, + 0.09807899594306946, + 0.3065446522086859, + 0.20462099835276604, + 0.2959153112024069, + 0.1514438595622778, + 0.1913275420665741, + 0.4623263105750084, + 0.0, + 0.1212464515119791, + 0.5505818575620651, + 0.1235024742782116, + 0.1655472945421934, + 0.16932691261172295, + 0.10066539794206619, + 0.4388647824525833, + 0.46954788826406, + 0.8346677049994469, + 0.5314195491373539, + 0.059741102159023285, + 0.8631178513169289, + 0.0, + 0.09738767892122269, + 0.20348453894257545, + 0.1583717204630375, + 0.5822456069290638, + 0.5735005512833595, + 0.15092915296554565, + 0.08653601445257664, + 0.06375101953744888, + 0.22355109453201294, + 0.05146779865026474, + 0.07133511826395988, + 0.03132859244942665, + 0.09559865295886993, + 0.04339689761400223, + 0.32577159628272057, + 0.21489962562918663, + 0.4500056952238083, + 0.1620525885373354, + 0.6518124639987946, + 0.0925797875970602, + 0.13947761431336403, + 0.3196018487215042, + 0.0765337124466896, + 0.10015544667840004, + 0.6739047970622778, + 0.10924611613154411, + 0.05491180717945099, + 0.1523277759552002, + 0.0, + 0.3038576506078243, + 0.07687002047896385, + 0.12903820350766182, + 0.13402307778596878, + 0.07348032481968403, + 0.17389456555247307, + 0.7149855382740498, + 0.17420445382595062, + 0.29762904718518257, + 0.0, + 0.10400395467877388, + 0.24516382068395615, + 0.15406117215752602 + ], + "unique_experts": 60, + "load_cv": 0.6186404847588913, + "normalized_load_entropy": 0.9495812781215932, + "max_load_share": 0.03968253968253968 + }, + "full_input": { + "tokens": 83, + "top_k": 6, + "decisions": 498, + "ordered_route_sha256": "ccc658c0cd19253e3576cdee6126312a579216bc0c5a5f32b8a64615b7c2ca20", + "route_weight_sha256": "c445c1f8f5d509163ec0d6fe7f5e6e6761480389adad15474bbd0af1ef307aa5", + "loads": [ + 11, + 4, + 10, + 10, + 11, + 4, + 8, + 7, + 0, + 10, + 14, + 5, + 4, + 11, + 2, + 12, + 10, + 18, + 8, + 1, + 6, + 1, + 2, + 15, + 14, + 31, + 19, + 6, + 4, + 3, + 5, + 2, + 5, + 1, + 2, + 1, + 10, + 6, + 9, + 4, + 22, + 10, + 10, + 9, + 4, + 7, + 8, + 4, + 1, + 4, + 2, + 11, + 7, + 4, + 4, + 11, + 13, + 23, + 3, + 8, + 1, + 8, + 14, + 4 + ], + "weighted_loads": [ + 0.417037695646286, + 0.14055439084768295, + 0.4675327055156231, + 0.8840906880795956, + 0.6961275767534971, + 0.1514438595622778, + 0.3107348121702671, + 0.5188079960644245, + 0.0, + 0.3153576124459505, + 1.0480775963515043, + 0.18975285440683365, + 0.1655472945421934, + 0.773614376783371, + 0.10066539794206619, + 0.7819790467619896, + 0.6373083535581827, + 1.4875639826059341, + 0.6718841698020697, + 0.059741102159023285, + 0.8631178513169289, + 0.07652508467435837, + 0.09738767892122269, + 0.9324178267270327, + 0.7540969606488943, + 2.068354059010744, + 1.3501408137381077, + 0.1914030835032463, + 0.11713577806949615, + 0.14264001697301865, + 0.31836120784282684, + 0.09111955389380455, + 0.17965425364673138, + 0.03132859244942665, + 0.09559865295886993, + 0.04339689761400223, + 0.5873300060629845, + 0.2874935492873192, + 0.7445976659655571, + 0.19567152298986912, + 2.1711294427514076, + 0.48848447389900684, + 0.3977288343012333, + 0.33840525709092617, + 0.3112254701554775, + 1.5063021518290043, + 0.8953846823424101, + 0.2416224144399166, + 0.05491180717945099, + 0.1523277759552002, + 0.19837365299463272, + 0.6018864028155804, + 0.3507290631532669, + 0.18278127163648605, + 0.2212776392698288, + 0.7250700443983078, + 0.8424425534904003, + 1.458228848874569, + 0.1979006752371788, + 0.38927045464515686, + 0.034835997968912125, + 0.38135939091444016, + 0.7659108489751816, + 0.15406117215752602 + ], + "unique_experts": 63, + "load_cv": 0.7614758606568716, + "normalized_load_entropy": 0.9348259105305216, + "max_load_share": 0.06224899598393574 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 42, + "ordered_topk_exact_tokens": 17, + "set_exact_tokens": 24, + "mean_set_jaccard": 0.8622448979591837, + "mean_token_weighted_tv": 0.025729244752299218, + "aggregate_load_tv": 0.07539682539682539 + }, + "system_bos": { + "tokens": 42, + "ordered_topk_exact_tokens": 20, + "set_exact_tokens": 27, + "mean_set_jaccard": 0.8837868480725624, + "mean_token_weighted_tv": 0.02368112527100103, + "aggregate_load_tv": 0.06349206349206349 + }, + "system_x": { + "tokens": 42, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.7970521541950115, + "mean_token_weighted_tv": 0.03585419025538223, + "aggregate_load_tv": 0.06746031746031746 + }, + "system_period": { + "tokens": 42, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.8157596371882085, + "mean_token_weighted_tv": 0.03539731932271804, + "aggregate_load_tv": 0.06349206349206349 + }, + "bos_at_s0": { + "tokens": 42, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 21, + "mean_set_jaccard": 0.836734693877551, + "mean_token_weighted_tv": 0.03310251102915832, + "aggregate_load_tv": 0.05555555555555555 + }, + "bos_at_s1": { + "tokens": 42, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.7916099773242632, + "mean_token_weighted_tv": 0.042078956451621796, + "aggregate_load_tv": 0.0873015873015873 + }, + "x_at_s0": { + "tokens": 42, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 18, + "mean_set_jaccard": 0.8077200577200576, + "mean_token_weighted_tv": 0.03884175865511809, + "aggregate_load_tv": 0.07539682539682539 + }, + "x_at_s1": { + "tokens": 42, + "ordered_topk_exact_tokens": 8, + "set_exact_tokens": 11, + "mean_set_jaccard": 0.7230158730158731, + "mean_token_weighted_tv": 0.04968926008968126, + "aggregate_load_tv": 0.10317460317460317 + }, + "period_at_s0": { + "tokens": 42, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.7938775510204081, + "mean_token_weighted_tv": 0.03937369365511196, + "aggregate_load_tv": 0.07936507936507936 + }, + "period_at_s1": { + "tokens": 42, + "ordered_topk_exact_tokens": 7, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.7564625850340138, + "mean_token_weighted_tv": 0.046049347812575955, + "aggregate_load_tv": 0.09523809523809523 + } + } + }, + "layer_18": { + "layer": 18, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "f855bf2295033785b54b6e92a029b2f7c875628e94e647eeac150584d4fbb924", + "route_weight_sha256": "7e85db3a1a0d0f95d535ed28cd9d13ef137f0dde4d7e417240e0bfb2f57bd52f", + "loads": [ + 12, + 6, + 3, + 2, + 1, + 6, + 14, + 1, + 6, + 7, + 2, + 4, + 1, + 1, + 3, + 3, + 2, + 1, + 16, + 1, + 0, + 7, + 2, + 8, + 5, + 2, + 0, + 5, + 2, + 1, + 5, + 1, + 0, + 3, + 4, + 11, + 2, + 4, + 2, + 8, + 1, + 1, + 2, + 1, + 0, + 0, + 8, + 4, + 7, + 3, + 6, + 2, + 2, + 10, + 1, + 2, + 3, + 5, + 6, + 3, + 5, + 10, + 0, + 6 + ], + "weighted_loads": [ + 1.1062286142259836, + 0.28032078593969345, + 0.18280774541199207, + 0.10969176888465881, + 0.040902089327573776, + 0.21561364736407995, + 1.9619869738817215, + 0.07527375221252441, + 0.24269810691475868, + 0.36206350661814213, + 0.08403541147708893, + 0.15242690593004227, + 0.03516385704278946, + 0.04883064702153206, + 0.19083520211279392, + 0.10148737579584122, + 0.14279381558299065, + 0.040085338056087494, + 1.0260652843862772, + 0.07598293572664261, + 0.0, + 0.6075421683490276, + 0.12292882055044174, + 0.33738881908357143, + 0.2021285630762577, + 0.06839445047080517, + 0.0, + 0.19292030856013298, + 0.22927191108465195, + 0.03805919364094734, + 0.296687800437212, + 0.03085274249315262, + 0.0, + 0.11958406493067741, + 0.30163734033703804, + 1.2789861857891083, + 0.09795893728733063, + 0.13715181685984135, + 0.0683942399919033, + 0.29368534684181213, + 0.051512233912944794, + 0.03831053897738457, + 0.10151677951216698, + 0.04113493859767914, + 0.0, + 0.0, + 0.8052900955080986, + 0.21207240223884583, + 0.3795338850468397, + 0.09597055148333311, + 0.20565898157656193, + 0.06634840741753578, + 0.10872164368629456, + 0.680566718801856, + 0.04458557069301605, + 0.11460557579994202, + 0.08062365092337132, + 0.3521081171929836, + 0.5486589521169662, + 0.13503674417734146, + 0.24586790800094604, + 0.35027332324534655, + 0.0, + 0.3071237597614527 + ], + "unique_experts": 58, + "load_cv": 0.8932715087867623, + "normalized_load_entropy": 0.9088056837468661, + "max_load_share": 0.06349206349206349 + }, + "full_input": { + "tokens": 67, + "top_k": 6, + "decisions": 402, + "ordered_route_sha256": "46ca3b506d4628e71bc41d790c9fc36d07f55acad1499fea13b3b4fb3a48da0a", + "route_weight_sha256": "51d21b0a712c0b2b68a0574159b6e4cfa69601a906f8606f7e19bb0e773b7084", + "loads": [ + 18, + 8, + 15, + 2, + 1, + 8, + 14, + 1, + 14, + 7, + 3, + 8, + 2, + 1, + 8, + 7, + 2, + 1, + 34, + 1, + 0, + 9, + 2, + 8, + 5, + 2, + 0, + 5, + 2, + 1, + 12, + 1, + 0, + 3, + 4, + 14, + 3, + 6, + 2, + 12, + 7, + 1, + 5, + 1, + 0, + 0, + 17, + 4, + 10, + 15, + 9, + 5, + 11, + 18, + 1, + 2, + 5, + 5, + 7, + 6, + 5, + 14, + 0, + 8 + ], + "weighted_loads": [ + 1.4926617834717035, + 0.37899788469076157, + 1.2234625201672316, + 0.10969176888465881, + 0.040902089327573776, + 0.26399336103349924, + 1.9619869738817215, + 0.07527375221252441, + 0.7139592096209526, + 0.36206350661814213, + 0.09489010740071535, + 0.5535627454519272, + 0.060980526730418205, + 0.04883064702153206, + 1.0792167820036411, + 0.23110048286616802, + 0.14279381558299065, + 0.040085338056087494, + 2.039878385141492, + 0.07598293572664261, + 0.0, + 0.6671667266637087, + 0.12292882055044174, + 0.33738881908357143, + 0.2021285630762577, + 0.06839445047080517, + 0.0, + 0.19292030856013298, + 0.22927191108465195, + 0.03805919364094734, + 0.5641306610777974, + 0.03085274249315262, + 0.0, + 0.11958406493067741, + 0.30163734033703804, + 1.4303985573351383, + 0.12155184336006641, + 0.19648047350347042, + 0.0683942399919033, + 0.40805516205728054, + 0.3160310164093971, + 0.03831053897738457, + 0.18327653035521507, + 0.04113493859767914, + 0.0, + 0.0, + 2.2774969544261694, + 0.21207240223884583, + 0.5291097033768892, + 0.6350861685350537, + 0.2975651789456606, + 0.2732364237308502, + 0.7110081743448973, + 1.1990244146436453, + 0.04458557069301605, + 0.11460557579994202, + 1.0791863296180964, + 0.3521081171929836, + 0.5781368631869555, + 0.2841818146407604, + 0.24586790800094604, + 0.48192045371979475, + 0.0, + 0.40126446448266506 + ], + "unique_experts": 58, + "load_cv": 0.9751116863830364, + "normalized_load_entropy": 0.8951898295786854, + "max_load_share": 0.0845771144278607 + } + }, + "s1_eos": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "c54f11294d2bac6a5c53a223cf7e5faaeace8caecbb511882553ff8b4e3e6afd", + "route_weight_sha256": "fb4a010e894f79ad2908f28782371487aeff9c369b2ed7e35833699a62414ade", + "loads": [ + 12, + 7, + 3, + 3, + 1, + 4, + 15, + 1, + 6, + 7, + 2, + 5, + 2, + 1, + 3, + 2, + 4, + 2, + 15, + 1, + 0, + 7, + 2, + 6, + 5, + 1, + 0, + 6, + 2, + 1, + 4, + 2, + 0, + 3, + 4, + 11, + 2, + 5, + 1, + 8, + 1, + 2, + 2, + 1, + 0, + 0, + 9, + 4, + 7, + 3, + 5, + 1, + 2, + 10, + 2, + 1, + 2, + 5, + 5, + 3, + 5, + 10, + 0, + 6 + ], + "weighted_loads": [ + 1.0838448200374842, + 0.31090495735406876, + 0.18946398980915546, + 0.11062661278992891, + 0.04366230592131615, + 0.16334790363907814, + 1.9731571860611439, + 0.07312072813510895, + 0.28420981019735336, + 0.3753942884504795, + 0.08224277943372726, + 0.1856520213186741, + 0.06244313530623913, + 0.046723272651433945, + 0.1856863759458065, + 0.07302705571055412, + 0.21299675665795803, + 0.06847874820232391, + 1.037902470678091, + 0.07076968252658844, + 0.0, + 0.6319712325930595, + 0.11598921567201614, + 0.27131639420986176, + 0.19675390049815178, + 0.03991597518324852, + 0.0, + 0.25200812332332134, + 0.23290281370282173, + 0.0398290678858757, + 0.23945580795407295, + 0.060039497911930084, + 0.0, + 0.11589419841766357, + 0.2947647925466299, + 1.3310235273092985, + 0.09761187434196472, + 0.1728417556732893, + 0.035276465117931366, + 0.2952637765556574, + 0.041623327881097794, + 0.06752548739314079, + 0.1073322743177414, + 0.04190507158637047, + 0.0, + 0.0, + 0.7814814690500498, + 0.21957186609506607, + 0.3930148594081402, + 0.09417422953993082, + 0.1708421129733324, + 0.044236257672309875, + 0.10771548748016357, + 0.6768362801522017, + 0.07671353407204151, + 0.05850856751203537, + 0.04885702580213547, + 0.3404228836297989, + 0.5104699991643429, + 0.12811960466206074, + 0.2658795714378357, + 0.3491260800510645, + 0.0, + 0.30298334173858166 + ], + "unique_experts": 58, + "load_cv": 0.8864763178059175, + "normalized_load_entropy": 0.9104396772224683, + "max_load_share": 0.05952380952380952 + }, + "full_input": { + "tokens": 83, + "top_k": 6, + "decisions": 498, + "ordered_route_sha256": "aaa5abdb190ffe8a80be62a141f46c8d4ca20729fdb138e828592be1f1b0ea9f", + "route_weight_sha256": "43d2d21f1d8a2dc418bf73c574be28d389927507cbaef84949d740d163068626", + "loads": [ + 20, + 10, + 16, + 3, + 2, + 8, + 15, + 3, + 16, + 9, + 3, + 9, + 2, + 2, + 12, + 4, + 4, + 12, + 37, + 2, + 0, + 9, + 3, + 6, + 5, + 1, + 0, + 6, + 2, + 2, + 14, + 4, + 1, + 4, + 8, + 27, + 3, + 10, + 2, + 12, + 6, + 2, + 4, + 7, + 0, + 0, + 27, + 7, + 10, + 17, + 8, + 4, + 11, + 22, + 4, + 1, + 5, + 10, + 7, + 7, + 5, + 14, + 0, + 12 + ], + "weighted_loads": [ + 1.502962615340948, + 0.4486369155347347, + 1.268154352903366, + 0.11062661278992891, + 0.08266741782426834, + 0.27803593687713146, + 1.9731571860611439, + 0.1425662897527218, + 1.152635220438242, + 0.4372377321124077, + 0.0940099572762847, + 0.5534411109983921, + 0.06244313530623913, + 0.08871027454733849, + 1.23290722258389, + 0.1384555846452713, + 0.21299675665795803, + 0.6644899416714907, + 2.783458324149251, + 0.2075943648815155, + 0.0, + 0.7111023664474487, + 0.14912645518779755, + 0.27131639420986176, + 0.19675390049815178, + 0.03991597518324852, + 0.0, + 0.25200812332332134, + 0.23290281370282173, + 0.07627173885703087, + 0.782930719666183, + 0.30516329407691956, + 0.0575639046728611, + 0.19103248417377472, + 0.7136113774031401, + 2.6764044538140297, + 0.121129609644413, + 0.39194091968238354, + 0.07419322058558464, + 0.41597647592425346, + 0.24534927681088448, + 0.06752548739314079, + 0.16937503032386303, + 0.5371991582214832, + 0.0, + 0.0, + 3.404926532879472, + 0.37341077625751495, + 0.4897627644240856, + 0.7085941722616553, + 0.249046066775918, + 0.23893727734684944, + 0.6899550389498472, + 1.3847912698984146, + 0.197231138125062, + 0.05850856751203537, + 1.0599792376160622, + 0.5747734718024731, + 0.8441445752978325, + 0.40185868740081787, + 0.2658795714378357, + 0.4934820793569088, + 0.0, + 0.5320716332644224 + ], + "unique_experts": 59, + "load_cv": 0.9307483436211756, + "normalized_load_entropy": 0.9066229489709697, + "max_load_share": 0.07429718875502007 + } + }, + "s0_bos": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "a72f43fd18b4634b71d13a27133aa042a9f91b5531c84111be7e20da2517b961", + "route_weight_sha256": "c63434d62cfa5d6d39b863807cdfed6aa344b4a58b85e3fa4b5a93fc6799613c", + "loads": [ + 10, + 8, + 3, + 3, + 1, + 5, + 14, + 1, + 6, + 6, + 3, + 5, + 1, + 1, + 3, + 3, + 3, + 3, + 15, + 1, + 0, + 8, + 2, + 8, + 5, + 2, + 0, + 4, + 2, + 1, + 5, + 0, + 0, + 3, + 3, + 11, + 4, + 4, + 2, + 7, + 1, + 0, + 3, + 1, + 0, + 0, + 8, + 4, + 6, + 1, + 9, + 1, + 2, + 10, + 2, + 3, + 3, + 6, + 6, + 2, + 5, + 8, + 0, + 5 + ], + "weighted_loads": [ + 1.104883011430502, + 0.34279440715909004, + 0.1902484316378832, + 0.14882560074329376, + 0.04066634550690651, + 0.17838452197611332, + 1.9091188982129097, + 0.07631387561559677, + 0.2439255304634571, + 0.32512651942670345, + 0.12139858677983284, + 0.1928333044052124, + 0.036971643567085266, + 0.05205217003822327, + 0.19975550845265388, + 0.11112785339355469, + 0.1815176773816347, + 0.09346947446465492, + 1.0141662657260895, + 0.07398512214422226, + 0.0, + 0.5897872615605593, + 0.12023346871137619, + 0.3410384766757488, + 0.21255875006318092, + 0.0722785759717226, + 0.0, + 0.16399472951889038, + 0.22605044022202492, + 0.03765605390071869, + 0.2693453077226877, + 0.0, + 0.0, + 0.12547888979315758, + 0.29100725427269936, + 1.2888050880283117, + 0.17306826263666153, + 0.15172693878412247, + 0.06184525974094868, + 0.26552475057542324, + 0.043341826647520065, + 0.0, + 0.14834997057914734, + 0.040120482444763184, + 0.0, + 0.0, + 0.7469415254890919, + 0.20722847059369087, + 0.3501265775412321, + 0.05548541992902756, + 0.2819075882434845, + 0.04353278875350952, + 0.1115853413939476, + 0.7172159757465124, + 0.07645098119974136, + 0.1390251349657774, + 0.07902500033378601, + 0.38131640292704105, + 0.5265531241893768, + 0.09451954066753387, + 0.23830148577690125, + 0.3051397353410721, + 0.0, + 0.2649112846702337 + ], + "unique_experts": 56, + "load_cv": 0.863439540886295, + "normalized_load_entropy": 0.9096757445864326, + "max_load_share": 0.05952380952380952 + }, + "full_input": { + "tokens": 67, + "top_k": 6, + "decisions": 402, + "ordered_route_sha256": "a0fc890cef9fa8ba71fe2d1984fc136f461205affc7b0216b0c4a4d6df096c44", + "route_weight_sha256": "5e7f38dadb4a1b37e8ee70a5de02923ed73c828c5fccf83995d7b5d849e5bdc6", + "loads": [ + 16, + 10, + 14, + 3, + 1, + 6, + 14, + 1, + 14, + 6, + 3, + 8, + 3, + 1, + 8, + 6, + 3, + 3, + 34, + 1, + 0, + 11, + 2, + 9, + 5, + 2, + 1, + 4, + 2, + 1, + 10, + 0, + 0, + 4, + 3, + 15, + 4, + 6, + 2, + 13, + 7, + 1, + 7, + 1, + 0, + 0, + 18, + 4, + 9, + 12, + 11, + 4, + 11, + 17, + 2, + 3, + 4, + 6, + 7, + 4, + 5, + 13, + 0, + 7 + ], + "weighted_loads": [ + 1.4913161806762218, + 0.44147150591015816, + 1.2044369988143444, + 0.14882560074329376, + 0.04066634550690651, + 0.20105080120265484, + 1.9091188982129097, + 0.07631387561559677, + 0.715186633169651, + 0.32512651942670345, + 0.12139858677983284, + 0.4424474388360977, + 0.3045506328344345, + 0.05205217003822327, + 0.9745348002761602, + 0.21177789941430092, + 0.1815176773816347, + 0.09346947446465492, + 2.044433930888772, + 0.07398512214422226, + 0.0, + 0.681543480604887, + 0.12023346871137619, + 0.38904034718871117, + 0.21255875006318092, + 0.0722785759717226, + 0.04721047729253769, + 0.16399472951889038, + 0.22605044022202492, + 0.03765605390071869, + 0.4801622498780489, + 0.0, + 0.0, + 0.19103314355015755, + 0.29100725427269936, + 1.4754666667431593, + 0.17306826263666153, + 0.21105559542775154, + 0.06184525974094868, + 0.5387863051146269, + 0.37908393517136574, + 0.06846324354410172, + 0.3037908021360636, + 0.040120482444763184, + 0.0, + 0.0, + 2.1668199356645346, + 0.20722847059369087, + 0.4997023958712816, + 0.5433373842388391, + 0.34024108573794365, + 0.23960580676794052, + 0.7138718720525503, + 1.16895773075521, + 0.07645098119974136, + 0.1390251349657774, + 0.3022472411394119, + 0.38131640292704105, + 0.556031035259366, + 0.19993160665035248, + 0.23830148577690125, + 0.4694594722241163, + 0.0, + 0.3590519893914461 + ], + "unique_experts": 58, + "load_cv": 0.949597338647647, + "normalized_load_entropy": 0.9013862002244303, + "max_load_share": 0.0845771144278607 + } + }, + "s1_bos": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "50ea86d773fdf56f215f402839e465b03907e223d5bcf2fd520e2aedf6897cd2", + "route_weight_sha256": "7059177b4537827042fa16abd9ceffc3276c12a050dde4087f6f52cceddcc5ba", + "loads": [ + 10, + 7, + 3, + 3, + 0, + 5, + 16, + 1, + 7, + 7, + 3, + 6, + 1, + 1, + 3, + 2, + 4, + 2, + 15, + 1, + 0, + 8, + 2, + 8, + 6, + 1, + 0, + 4, + 2, + 2, + 5, + 0, + 0, + 3, + 3, + 12, + 2, + 6, + 2, + 6, + 1, + 0, + 3, + 0, + 0, + 0, + 7, + 4, + 7, + 1, + 7, + 2, + 2, + 10, + 2, + 3, + 3, + 5, + 5, + 3, + 5, + 8, + 0, + 5 + ], + "weighted_loads": [ + 1.0859076380729675, + 0.32984801195561886, + 0.1882420051842928, + 0.14788275212049484, + 0.0, + 0.1764827761799097, + 2.020910819992423, + 0.07674454152584076, + 0.31349558755755424, + 0.3734698761254549, + 0.12194537371397018, + 0.22674920037388802, + 0.03435453400015831, + 0.044257596135139465, + 0.1994643248617649, + 0.06336118839681149, + 0.21212958917021751, + 0.06858474016189575, + 1.040641998872161, + 0.07121998816728592, + 0.0, + 0.6220753565430641, + 0.1152927465736866, + 0.3398826867341995, + 0.22961196675896645, + 0.041337963193655014, + 0.0, + 0.16840169206261635, + 0.23040772415697575, + 0.06831743009388447, + 0.26840133033692837, + 0.0, + 0.0, + 0.12320169061422348, + 0.2973134070634842, + 1.2564139794558287, + 0.0965232290327549, + 0.21832406148314476, + 0.07006968930363655, + 0.22731025516986847, + 0.03313112258911133, + 0.0, + 0.13572334870696068, + 0.0, + 0.0, + 0.0, + 0.708035197108984, + 0.22579612210392952, + 0.38144954293966293, + 0.05542183667421341, + 0.2360802497714758, + 0.0746131855994463, + 0.11361433938145638, + 0.6656052954494953, + 0.07658226788043976, + 0.13816789537668228, + 0.08130587823688984, + 0.3697105571627617, + 0.5201920010149479, + 0.12578953057527542, + 0.25019655749201775, + 0.30173501186072826, + 0.0, + 0.2669455409049988 + ], + "unique_experts": 54, + "load_cv": 0.8966497931745142, + "normalized_load_entropy": 0.90281636591896, + "max_load_share": 0.06349206349206349 + }, + "full_input": { + "tokens": 83, + "top_k": 6, + "decisions": 498, + "ordered_route_sha256": "39bb4548573934540b4504ec4cec24fa6bb06a290b2f1270dc9e61d33eee19ca", + "route_weight_sha256": "a900a92c7122b4fa04f0c5c6b094bba0e849c5dfb0f8f08f7e926c653bf55346", + "loads": [ + 18, + 11, + 14, + 3, + 1, + 8, + 16, + 3, + 17, + 9, + 3, + 10, + 1, + 2, + 12, + 5, + 4, + 12, + 38, + 2, + 0, + 10, + 3, + 8, + 6, + 1, + 0, + 4, + 2, + 3, + 14, + 2, + 1, + 4, + 7, + 27, + 2, + 11, + 3, + 10, + 7, + 1, + 6, + 6, + 0, + 0, + 26, + 7, + 10, + 15, + 10, + 5, + 11, + 22, + 4, + 3, + 5, + 10, + 7, + 7, + 5, + 13, + 0, + 11 + ], + "weighted_loads": [ + 1.5050254333764315, + 0.4908307883888483, + 1.205788679420948, + 0.14788275212049484, + 0.039005111902952194, + 0.26443242840468884, + 2.020910819992423, + 0.1461901031434536, + 1.1819209977984428, + 0.4353133197873831, + 0.12194537371397018, + 0.5624260567128658, + 0.03435453400015831, + 0.086244598031044, + 1.3523735348135233, + 0.16449405811727047, + 0.21212958917021751, + 0.6645959336310625, + 2.856380958110094, + 0.20804467052221298, + 0.0, + 0.6839376483112574, + 0.148429986089468, + 0.3398826867341995, + 0.22961196675896645, + 0.041337963193655014, + 0.0, + 0.16840169206261635, + 0.23040772415697575, + 0.10476010106503963, + 0.801471808925271, + 0.24512379616498947, + 0.0575639046728611, + 0.19833997637033463, + 0.7161599919199944, + 2.560943691059947, + 0.0965232290327549, + 0.437423225492239, + 0.10898644477128983, + 0.3460696581751108, + 0.28627242520451546, + 0.0442715585231781, + 0.24936079792678356, + 0.49529408663511276, + 0.0, + 0.0, + 3.3307976610958576, + 0.3796350322663784, + 0.47819744795560837, + 0.6886723134666681, + 0.31594751216471195, + 0.2647672761231661, + 0.69585389085114, + 1.3375337589532137, + 0.19709987193346024, + 0.13816789537668228, + 0.34048021025955677, + 0.6040611453354359, + 0.8538665771484375, + 0.47444237023591995, + 0.25019655749201775, + 0.48105175234377384, + 0.0, + 0.49603383243083954 + ], + "unique_experts": 59, + "load_cv": 0.9226727364723513, + "normalized_load_entropy": 0.9074597291709149, + "max_load_share": 0.07630522088353414 + } + }, + "s0_x": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "f99293679b74326b7453f49eb7db75836b98fc82f687fdff1c961ab920b7641b", + "route_weight_sha256": "d585cf853a958affdf9f3c662a4369aca0124631ac09b9364c1ec19b9dc8e965", + "loads": [ + 10, + 8, + 3, + 3, + 0, + 5, + 14, + 1, + 6, + 6, + 3, + 5, + 1, + 1, + 2, + 3, + 4, + 2, + 14, + 1, + 0, + 8, + 2, + 7, + 6, + 1, + 0, + 5, + 2, + 1, + 6, + 1, + 0, + 3, + 3, + 13, + 3, + 4, + 2, + 4, + 0, + 0, + 4, + 1, + 0, + 0, + 8, + 4, + 8, + 2, + 7, + 2, + 2, + 12, + 2, + 2, + 3, + 5, + 6, + 1, + 5, + 10, + 0, + 5 + ], + "weighted_loads": [ + 1.0881883017718792, + 0.36271107383072376, + 0.1950876098126173, + 0.14796556159853935, + 0.0, + 0.20002806186676025, + 1.9337837398052216, + 0.07699757069349289, + 0.2728375159204006, + 0.30994386598467827, + 0.12292490527033806, + 0.19790484756231308, + 0.03362204134464264, + 0.05285872891545296, + 0.15577270090579987, + 0.10024331137537956, + 0.20438647456467152, + 0.06428239867091179, + 0.9745882339775562, + 0.0737781897187233, + 0.0, + 0.6464870162308216, + 0.12377903237938881, + 0.2894399370998144, + 0.24572144076228142, + 0.04866035655140877, + 0.0, + 0.21448498591780663, + 0.22293352149426937, + 0.03655359521508217, + 0.28425345569849014, + 0.03343161940574646, + 0.0, + 0.1223108097910881, + 0.286477642133832, + 1.339875241741538, + 0.13273775950074196, + 0.13310582377016544, + 0.06369584426283836, + 0.17561819404363632, + 0.0, + 0.0, + 0.15266915783286095, + 0.044436030089855194, + 0.0, + 0.0, + 0.8066476285457611, + 0.20748040825128555, + 0.4273690413683653, + 0.0845674928277731, + 0.21803132072091103, + 0.09460710734128952, + 0.11689304187893867, + 0.7575719095766544, + 0.07476981170475483, + 0.1081097349524498, + 0.08108861371874809, + 0.368983406573534, + 0.528652973473072, + 0.05695495381951332, + 0.2573787607252598, + 0.36628961376845837, + 0.0, + 0.2757037952542305 + ], + "unique_experts": 55, + "load_cv": 0.8966497931745142, + "normalized_load_entropy": 0.903145494621535, + "max_load_share": 0.05555555555555555 + }, + "full_input": { + "tokens": 67, + "top_k": 6, + "decisions": 402, + "ordered_route_sha256": "c5ce9592fc5110460febd4b423914aaa0f26ea1112c069f212f92a80f8e0d6b8", + "route_weight_sha256": "f2e975dbe5cfa74bac2eedd040f324133c1d81ea261746b4a1bdc12b39af883b", + "loads": [ + 17, + 10, + 16, + 3, + 0, + 6, + 14, + 1, + 14, + 6, + 3, + 9, + 2, + 1, + 7, + 5, + 4, + 2, + 32, + 1, + 0, + 11, + 2, + 7, + 6, + 1, + 0, + 5, + 2, + 1, + 11, + 1, + 1, + 4, + 3, + 17, + 3, + 6, + 2, + 8, + 5, + 0, + 6, + 1, + 0, + 0, + 17, + 4, + 12, + 14, + 9, + 6, + 12, + 20, + 2, + 2, + 4, + 5, + 9, + 2, + 6, + 14, + 0, + 8 + ], + "weighted_loads": [ + 1.51755016669631, + 0.4613881725817919, + 1.4114601761102676, + 0.14796556159853935, + 0.0, + 0.22269434109330177, + 1.9337837398052216, + 0.07699757069349289, + 0.7440986186265945, + 0.30994386598467827, + 0.12292490527033806, + 0.567620649933815, + 0.07984477281570435, + 0.05285872891545296, + 1.040486330166459, + 0.16911572590470314, + 0.20438647456467152, + 0.06428239867091179, + 2.081556513905525, + 0.0737781897187233, + 0.0, + 0.7435041945427656, + 0.12377903237938881, + 0.2894399370998144, + 0.24572144076228142, + 0.04866035655140877, + 0.0, + 0.21448498591780663, + 0.22293352149426937, + 0.03655359521508217, + 0.48310762643814087, + 0.03343161940574646, + 0.02233523689210415, + 0.16491976752877235, + 0.286477642133832, + 1.5170131605118513, + 0.13273775950074196, + 0.19243448041379452, + 0.06369584426283836, + 0.29466859996318817, + 0.24157942086458206, + 0.0, + 0.20798788778483868, + 0.044436030089855194, + 0.0, + 0.0, + 2.2779190447181463, + 0.20748040825128555, + 0.6165195684880018, + 0.612806785851717, + 0.2760218270123005, + 0.333470843732357, + 0.817097270861268, + 1.2594270706176758, + 0.07476981170475483, + 0.1081097349524498, + 0.304310854524374, + 0.368983406573534, + 0.6578541491180658, + 0.0940946601331234, + 0.2866130080074072, + 0.493945375084877, + 0.0, + 0.4513633958995342 + ], + "unique_experts": 57, + "load_cv": 0.9742990720080765, + "normalized_load_entropy": 0.8935855638294148, + "max_load_share": 0.07960199004975124 + } + }, + "s1_x": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "bd8c1376dd0f6d3c672c0c0e1116ea6eea62c92803478bc4626821dab4458676", + "route_weight_sha256": "2571286816218d699917451ecb5f453b1989b9bda3768704eab241e25010cf57", + "loads": [ + 10, + 9, + 3, + 4, + 0, + 6, + 16, + 1, + 7, + 7, + 3, + 6, + 0, + 1, + 1, + 0, + 4, + 2, + 16, + 1, + 0, + 8, + 2, + 4, + 5, + 2, + 0, + 6, + 2, + 1, + 6, + 1, + 0, + 2, + 2, + 11, + 3, + 4, + 2, + 4, + 1, + 0, + 3, + 1, + 0, + 0, + 10, + 4, + 8, + 2, + 6, + 3, + 2, + 10, + 1, + 3, + 4, + 5, + 6, + 1, + 5, + 10, + 0, + 5 + ], + "weighted_loads": [ + 1.0498859398066998, + 0.3996646646410227, + 0.19585920311510563, + 0.1409381851553917, + 0.0, + 0.2123171417042613, + 2.0000205989927053, + 0.07351190596818924, + 0.3948528878390789, + 0.3809150643646717, + 0.12714539840817451, + 0.21720553934574127, + 0.0, + 0.051659271121025085, + 0.12729348242282867, + 0.0, + 0.21176553890109062, + 0.06688355654478073, + 1.0174947883933783, + 0.06968291103839874, + 0.0, + 0.7163768783211708, + 0.12123659625649452, + 0.19454000145196915, + 0.19946230202913284, + 0.06906173750758171, + 0.0, + 0.26871102303266525, + 0.23873020894825459, + 0.04452696815133095, + 0.2875869683921337, + 0.034539997577667236, + 0.0, + 0.08824966102838516, + 0.2529944106936455, + 1.2122004553675652, + 0.1326635777950287, + 0.14045440405607224, + 0.07157997786998749, + 0.1666315346956253, + 0.028701210394501686, + 0.0, + 0.12540093809366226, + 0.038181934505701065, + 0.0, + 0.0, + 0.7932618074119091, + 0.21826595813035965, + 0.4488529674708843, + 0.08577350527048111, + 0.19858332350850105, + 0.12744340673089027, + 0.12238384038209915, + 0.6152970474213362, + 0.030064741149544716, + 0.13356558047235012, + 0.10755506530404091, + 0.39073364809155464, + 0.5269345548003912, + 0.06348833441734314, + 0.2689508870244026, + 0.3666614927351475, + 0.0, + 0.2875191867351532 + ], + "unique_experts": 54, + "load_cv": 0.939462651235409, + "normalized_load_entropy": 0.8951619300681198, + "max_load_share": 0.06349206349206349 + }, + "full_input": { + "tokens": 83, + "top_k": 6, + "decisions": 498, + "ordered_route_sha256": "cf4d8c93af6c1e213a4abec54753ac382aa5df9d8aa8df86108e9a780a865427", + "route_weight_sha256": "d963897ad13be683cd4fc312067a0e6577ca8bb053f63cc0c2217504bca149dd", + "loads": [ + 20, + 12, + 15, + 4, + 1, + 9, + 16, + 3, + 18, + 9, + 3, + 10, + 1, + 2, + 10, + 1, + 4, + 12, + 41, + 2, + 0, + 10, + 3, + 4, + 5, + 2, + 0, + 6, + 2, + 2, + 14, + 3, + 2, + 3, + 6, + 25, + 3, + 9, + 3, + 8, + 6, + 0, + 4, + 8, + 0, + 0, + 28, + 7, + 12, + 15, + 8, + 8, + 12, + 22, + 3, + 3, + 6, + 10, + 8, + 3, + 6, + 14, + 0, + 12 + ], + "weighted_loads": [ + 1.6564517971128225, + 0.5373966228216887, + 1.3335559517145157, + 0.1409381851553917, + 0.039005111902952194, + 0.30026679392904043, + 2.0000205989927053, + 0.14295746758580208, + 1.3040355183184147, + 0.4427585080265999, + 0.12714539840817451, + 0.5108859091997147, + 0.03733107075095177, + 0.09364627301692963, + 1.0743035804480314, + 0.035433582961559296, + 0.21176553890109062, + 0.6628947500139475, + 2.944130353629589, + 0.2065075933933258, + 0.0, + 0.796421904116869, + 0.15437383577227592, + 0.19454000145196915, + 0.19946230202913284, + 0.06906173750758171, + 0.0, + 0.26871102303266525, + 0.23873020894825459, + 0.08096963912248611, + 0.743994228541851, + 0.2796637937426567, + 0.08998268470168114, + 0.1633879467844963, + 0.6718409955501556, + 2.49310390278697, + 0.1326635777950287, + 0.3595535680651665, + 0.11049673333764076, + 0.2858936134725809, + 0.2166894357651472, + 0.0, + 0.14846784807741642, + 0.6021081544458866, + 0.0, + 0.0, + 3.3402015902101994, + 0.37210486829280853, + 0.5818538069725037, + 0.6473226118832827, + 0.2464398704469204, + 0.44245728850364685, + 0.7811241131275892, + 1.2843334376811981, + 0.1505823452025652, + 0.13356558047235012, + 0.36672939732670784, + 0.6250842362642288, + 0.8606091309338808, + 0.24701879918575287, + 0.30203186348080635, + 0.5059575941413641, + 0.0, + 0.5804561376571655 + ], + "unique_experts": 58, + "load_cv": 0.9690539195233491, + "normalized_load_entropy": 0.9003948796349291, + "max_load_share": 0.0823293172690763 + } + }, + "s0_period": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "017cdbee920ac85ae3bf1ea1addf0975522f443cab7911f5eb3d9ff2936a47e2", + "route_weight_sha256": "f19198b3dfb8a473831ca663ca65e6a7a4d21077999b287d982264434752749b", + "loads": [ + 10, + 9, + 3, + 3, + 1, + 5, + 15, + 1, + 6, + 6, + 3, + 4, + 1, + 1, + 3, + 3, + 4, + 2, + 15, + 1, + 0, + 8, + 2, + 6, + 5, + 1, + 1, + 5, + 2, + 1, + 5, + 0, + 0, + 3, + 3, + 12, + 4, + 4, + 2, + 5, + 1, + 0, + 3, + 1, + 0, + 0, + 8, + 4, + 8, + 2, + 8, + 2, + 2, + 11, + 2, + 2, + 3, + 5, + 5, + 2, + 5, + 8, + 0, + 5 + ], + "weighted_loads": [ + 1.1052547693252563, + 0.3932357747107744, + 0.18747154623270035, + 0.1523771919310093, + 0.040656596422195435, + 0.17194003704935312, + 1.9563093557953835, + 0.07505592703819275, + 0.2885865345597267, + 0.33110830187797546, + 0.12428033724427223, + 0.15743332728743553, + 0.032260503619909286, + 0.05486193671822548, + 0.18650120310485363, + 0.10354185476899147, + 0.20830795727670193, + 0.06397944130003452, + 1.062056940048933, + 0.07050243020057678, + 0.0, + 0.663634616881609, + 0.1266946643590927, + 0.2680546063929796, + 0.2053511142730713, + 0.04753749072551727, + 0.021722186356782913, + 0.21773480996489525, + 0.22261345386505127, + 0.0349196195602417, + 0.2503370139747858, + 0.0, + 0.0, + 0.12534555792808533, + 0.28818875923752785, + 1.3453022185713053, + 0.16902558878064156, + 0.13271481357514858, + 0.06923288479447365, + 0.20010369643568993, + 0.030754268169403076, + 0.0, + 0.12964582070708275, + 0.043861329555511475, + 0.0, + 0.0, + 0.8043888248503208, + 0.21907078474760056, + 0.43191998451948166, + 0.08202497102320194, + 0.24453545361757278, + 0.08533881604671478, + 0.1188841424882412, + 0.7227117493748665, + 0.07494449242949486, + 0.1044698916375637, + 0.08166552893817425, + 0.36963309347629547, + 0.4948136992752552, + 0.08938269689679146, + 0.2514193244278431, + 0.2977776825428009, + 0.0, + 0.27631836384534836 + ], + "unique_experts": 57, + "load_cv": 0.8796286350792006, + "normalized_load_entropy": 0.910341165526337, + "max_load_share": 0.05952380952380952 + }, + "full_input": { + "tokens": 67, + "top_k": 6, + "decisions": 402, + "ordered_route_sha256": "5f1ff4b62847d43ff843c84751d7821c2ab279872ae9b1af8c09ec7d4af0e8cb", + "route_weight_sha256": "13b9e6a9dbddd1202429f80dfd8fd237ea3e5efdd81d00e8a8f1fc06553b5a1b", + "loads": [ + 17, + 12, + 14, + 3, + 1, + 6, + 15, + 1, + 14, + 6, + 3, + 8, + 1, + 1, + 8, + 7, + 4, + 2, + 34, + 1, + 0, + 11, + 2, + 6, + 5, + 1, + 1, + 5, + 2, + 1, + 11, + 1, + 0, + 4, + 3, + 15, + 4, + 6, + 2, + 9, + 6, + 0, + 5, + 1, + 0, + 0, + 18, + 4, + 11, + 14, + 11, + 5, + 12, + 20, + 2, + 2, + 4, + 6, + 7, + 3, + 5, + 12, + 0, + 7 + ], + "weighted_loads": [ + 1.5402622669935226, + 0.5165152791887522, + 1.2016601134091616, + 0.1523771919310093, + 0.040656596422195435, + 0.19460631627589464, + 1.9563093557953835, + 0.07505592703819275, + 0.7598476372659206, + 0.33110830187797546, + 0.12428033724427223, + 0.5089070610702038, + 0.032260503619909286, + 0.05486193671822548, + 1.1636865511536598, + 0.24361366964876652, + 0.20830795727670193, + 0.06397944130003452, + 2.218478988856077, + 0.07050243020057678, + 0.0, + 0.7612772714346647, + 0.1266946643590927, + 0.2680546063929796, + 0.2053511142730713, + 0.04753749072551727, + 0.021722186356782913, + 0.21773480996489525, + 0.22261345386505127, + 0.0349196195602417, + 0.4799027796834707, + 0.029341017827391624, + 0.0, + 0.16813478246331215, + 0.28818875923752785, + 1.503031088039279, + 0.16902558878064156, + 0.19204347021877766, + 0.06923288479447365, + 0.3125355653464794, + 0.2788010723888874, + 0.0, + 0.18496455065906048, + 0.043861329555511475, + 0.0, + 0.0, + 2.42834478802979, + 0.21907078474760056, + 0.5814958028495312, + 0.6005093976855278, + 0.33756566047668457, + 0.29353801161050797, + 0.7976371143013239, + 1.2761373706161976, + 0.07494449242949486, + 0.1044698916375637, + 0.30488776974380016, + 0.42071011662483215, + 0.5614627320319414, + 0.12652240321040154, + 0.2514193244278431, + 0.42763195000588894, + 0.0, + 0.37045906856656075 + ], + "unique_experts": 58, + "load_cv": 0.9840061545414446, + "normalized_load_entropy": 0.8945959852416192, + "max_load_share": 0.0845771144278607 + } + }, + "s1_period": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "d09ec3cd9f307db5f2b9dc8cd9fea5ce9bdfcd6a234833f85f150b69ab71f29d", + "route_weight_sha256": "92ebef0a85a636c80a93e098173d82fb2228aa9f078e2aa84b8ce4c5a3206409", + "loads": [ + 10, + 7, + 3, + 4, + 1, + 5, + 17, + 1, + 7, + 8, + 3, + 4, + 1, + 1, + 1, + 1, + 4, + 3, + 15, + 1, + 0, + 9, + 2, + 3, + 5, + 2, + 1, + 4, + 3, + 2, + 4, + 1, + 0, + 3, + 3, + 14, + 3, + 3, + 2, + 4, + 0, + 0, + 2, + 1, + 0, + 0, + 9, + 4, + 8, + 3, + 4, + 3, + 2, + 11, + 2, + 3, + 3, + 5, + 6, + 3, + 4, + 9, + 0, + 5 + ], + "weighted_loads": [ + 1.0680245533585548, + 0.34198453836143017, + 0.19117474369704723, + 0.14626033045351505, + 0.043603021651506424, + 0.19769181683659554, + 2.1124630011618137, + 0.07527949661016464, + 0.3960465546697378, + 0.41184454038739204, + 0.12301163002848625, + 0.15378331020474434, + 0.03373122960329056, + 0.047298744320869446, + 0.1278386265039444, + 0.031161604449152946, + 0.2143293246626854, + 0.09853796474635601, + 1.020997565239668, + 0.06922601163387299, + 0.0, + 0.7850856296718121, + 0.11841271445155144, + 0.15486041828989983, + 0.19911755993962288, + 0.06815014407038689, + 0.022845545783638954, + 0.1833171509206295, + 0.25700972974300385, + 0.07536877878010273, + 0.21416237764060497, + 0.03313952311873436, + 0.0, + 0.11869079992175102, + 0.279684504494071, + 1.4369578156620264, + 0.13101351261138916, + 0.11358143389225006, + 0.07292219996452332, + 0.16640063747763634, + 0.0, + 0.0, + 0.10081170499324799, + 0.03654277324676514, + 0.0, + 0.0, + 0.7635478004813194, + 0.20830113068223, + 0.4817359410226345, + 0.09965978842228651, + 0.12483860179781914, + 0.113693006336689, + 0.12162922322750092, + 0.6458569206297398, + 0.07528869435191154, + 0.1279327403753996, + 0.07434940710663795, + 0.3662041053175926, + 0.5448518674820662, + 0.13028680719435215, + 0.23150451108813286, + 0.3401926662772894, + 0.0, + 0.31555934995412827 + ], + "unique_experts": 57, + "load_cv": 0.9265001998420627, + "normalized_load_entropy": 0.9062173346189111, + "max_load_share": 0.06746031746031746 + }, + "full_input": { + "tokens": 83, + "top_k": 6, + "decisions": 498, + "ordered_route_sha256": "b79546c60f867231e02680b580bcf02b724b137416d85a1bc05366cc8e9e19b2", + "route_weight_sha256": "df77293fb45b89e9ec2bacacf45c53f571d786a3faa6c65b71dc2ceb08ee42ab", + "loads": [ + 18, + 10, + 14, + 4, + 2, + 8, + 17, + 3, + 17, + 11, + 3, + 8, + 2, + 2, + 10, + 2, + 4, + 13, + 37, + 2, + 0, + 11, + 3, + 3, + 5, + 2, + 1, + 4, + 3, + 3, + 11, + 4, + 1, + 4, + 7, + 29, + 3, + 8, + 3, + 9, + 5, + 0, + 3, + 8, + 0, + 0, + 28, + 7, + 11, + 17, + 7, + 9, + 12, + 24, + 4, + 3, + 5, + 11, + 8, + 5, + 5, + 13, + 0, + 12 + ], + "weighted_loads": [ + 1.4871423486620188, + 0.47971649654209614, + 1.2087214179337025, + 0.14626033045351505, + 0.08260813355445862, + 0.28564146906137466, + 2.1124630011618137, + 0.14472505822777748, + 1.2644719649106264, + 0.519998773932457, + 0.12301163002848625, + 0.5020976550877094, + 0.06404427997767925, + 0.08928574621677399, + 1.2401363756507635, + 0.06659518741071224, + 0.2143293246626854, + 0.6945491582155228, + 2.7988981064409018, + 0.20605069398880005, + 0.0, + 0.872619241476059, + 0.15154995396733284, + 0.15486041828989983, + 0.19911755993962288, + 0.06815014407038689, + 0.022845545783638954, + 0.1833171509206295, + 0.25700972974300385, + 0.1118114497512579, + 0.6344802137464285, + 0.30643436312675476, + 0.0575639046728611, + 0.19382908567786217, + 0.6985310893505812, + 2.7331986781209707, + 0.13101351261138916, + 0.3326805979013443, + 0.11183895543217659, + 0.32094759680330753, + 0.1841876395046711, + 0.0, + 0.12387861497700214, + 0.5606632977724075, + 0.0, + 0.0, + 3.3537962809205055, + 0.3621400408446789, + 0.5784838460385799, + 0.7015115180984139, + 0.20731663331389427, + 0.5138693265616894, + 0.7550247218459845, + 1.3599411938339472, + 0.19580629840493202, + 0.1279327403753996, + 0.3335237391293049, + 0.6656645648181438, + 0.8785264436155558, + 0.3138172719627619, + 0.2633911892771721, + 0.4830141253769398, + 0.0, + 0.5792236067354679 + ], + "unique_experts": 59, + "load_cv": 0.9475103389014411, + "normalized_load_entropy": 0.905761199034375, + "max_load_share": 0.07429718875502007 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 42, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 22, + "mean_set_jaccard": 0.8537414965986395, + "mean_token_weighted_tv": 0.026630109808008586, + "aggregate_load_tv": 0.05555555555555555 + }, + "system_bos": { + "tokens": 42, + "ordered_topk_exact_tokens": 17, + "set_exact_tokens": 23, + "mean_set_jaccard": 0.8656462585034015, + "mean_token_weighted_tv": 0.025600094969073933, + "aggregate_load_tv": 0.05555555555555555 + }, + "system_x": { + "tokens": 42, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 20, + "mean_set_jaccard": 0.8299319727891158, + "mean_token_weighted_tv": 0.03460884097564433, + "aggregate_load_tv": 0.07142857142857142 + }, + "system_period": { + "tokens": 42, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.828231292517007, + "mean_token_weighted_tv": 0.03510756650939584, + "aggregate_load_tv": 0.08333333333333333 + }, + "bos_at_s0": { + "tokens": 42, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 22, + "mean_set_jaccard": 0.8435374149659864, + "mean_token_weighted_tv": 0.03231930705009117, + "aggregate_load_tv": 0.07142857142857142 + }, + "bos_at_s1": { + "tokens": 42, + "ordered_topk_exact_tokens": 18, + "set_exact_tokens": 22, + "mean_set_jaccard": 0.8312925170068026, + "mean_token_weighted_tv": 0.03411053231961671, + "aggregate_load_tv": 0.08333333333333333 + }, + "x_at_s0": { + "tokens": 42, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.7993197278911565, + "mean_token_weighted_tv": 0.03774208002280267, + "aggregate_load_tv": 0.08333333333333333 + }, + "x_at_s1": { + "tokens": 42, + "ordered_topk_exact_tokens": 8, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.7817460317460319, + "mean_token_weighted_tv": 0.04694215601886667, + "aggregate_load_tv": 0.10714285714285714 + }, + "period_at_s0": { + "tokens": 42, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.8095238095238095, + "mean_token_weighted_tv": 0.03578706336252037, + "aggregate_load_tv": 0.07936507936507936 + }, + "period_at_s1": { + "tokens": 42, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.7777777777777779, + "mean_token_weighted_tv": 0.0472740951725947, + "aggregate_load_tv": 0.10714285714285712 + } + } + }, + "layer_19": { + "layer": 19, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "223ee54e7d43244ffa6931b9eb97da68a15848df884c1bb711cf65c62d31fe8f", + "route_weight_sha256": "d19fed460559e46d6b2614352d65657896006e8c94c23b19bbe012ed96828c6e", + "loads": [ + 2, + 5, + 5, + 2, + 4, + 4, + 5, + 3, + 2, + 9, + 2, + 5, + 5, + 7, + 5, + 5, + 1, + 1, + 3, + 8, + 3, + 2, + 7, + 2, + 3, + 1, + 5, + 3, + 0, + 0, + 4, + 2, + 18, + 2, + 4, + 1, + 5, + 12, + 2, + 1, + 11, + 2, + 6, + 5, + 4, + 5, + 2, + 4, + 5, + 0, + 5, + 1, + 1, + 10, + 0, + 5, + 2, + 2, + 4, + 2, + 8, + 6, + 0, + 2 + ], + "weighted_loads": [ + 0.08068284392356873, + 0.32774024456739426, + 0.18055986613035202, + 0.0737028568983078, + 0.17108294740319252, + 0.43559130281209946, + 0.23582054302096367, + 0.2552649825811386, + 0.10058467090129852, + 0.47791420482099056, + 0.07503072544932365, + 0.2375378217548132, + 0.45570705458521843, + 0.26155707240104675, + 0.2926774527877569, + 0.19125909358263016, + 0.0319199338555336, + 0.027941051870584488, + 0.10610741190612316, + 0.5510155465453863, + 0.279217179864645, + 0.1312003657221794, + 0.23821907117962837, + 0.07044282555580139, + 0.2462015524506569, + 0.029282372444868088, + 0.1712400820106268, + 0.11105538345873356, + 0.0, + 0.0, + 0.14332862943410873, + 0.11013039946556091, + 1.5198866687715054, + 0.0801394097507, + 0.45025864988565445, + 0.0391104482114315, + 0.4295932799577713, + 0.44985370337963104, + 0.06752233393490314, + 0.03266730159521103, + 0.4467110075056553, + 0.08970922231674194, + 0.4393692146986723, + 0.21482460387051105, + 0.2093261033296585, + 0.19455937668681145, + 0.06380456686019897, + 0.21193618327379227, + 0.17564603686332703, + 0.0, + 0.20434469915926456, + 0.0522959865629673, + 0.07631809264421463, + 0.5624506715685129, + 0.0, + 0.19442207925021648, + 0.06955487839877605, + 0.13369182869791985, + 0.24119817093014717, + 0.12354760244488716, + 0.3160682078450918, + 0.430961724370718, + 0.0, + 0.07556093484163284 + ], + "unique_experts": 59, + "load_cv": 0.809212514065453, + "normalized_load_entropy": 0.9270913120701758, + "max_load_share": 0.07142857142857142 + }, + "full_input": { + "tokens": 67, + "top_k": 6, + "decisions": 402, + "ordered_route_sha256": "0a5ba4236338d26a92fcc86ca0cf6399604cd42ff0f36f4e63041b952e48895e", + "route_weight_sha256": "b4e3cab5a5a7337cfe6657f684642ebaccbf4051368d32aed9f18c61dcdf999b", + "loads": [ + 4, + 6, + 7, + 2, + 9, + 5, + 15, + 3, + 2, + 13, + 2, + 6, + 13, + 11, + 9, + 5, + 4, + 1, + 3, + 15, + 3, + 2, + 12, + 11, + 12, + 1, + 5, + 5, + 0, + 5, + 12, + 2, + 19, + 2, + 4, + 2, + 7, + 18, + 3, + 1, + 15, + 6, + 14, + 7, + 5, + 5, + 2, + 8, + 6, + 0, + 5, + 1, + 1, + 12, + 6, + 5, + 2, + 2, + 10, + 2, + 8, + 10, + 7, + 2 + ], + "weighted_loads": [ + 0.12996808998286724, + 0.4120792895555496, + 0.23856218345463276, + 0.0737028568983078, + 0.950902920216322, + 0.448779609054327, + 0.6474713711068034, + 0.2552649825811386, + 0.10058467090129852, + 0.7101032081991434, + 0.07503072544932365, + 0.2681291885674, + 0.9696197509765625, + 0.43515586107969284, + 0.5411612931638956, + 0.19125909358263016, + 0.14537758380174637, + 0.027941051870584488, + 0.10610741190612316, + 0.887871628627181, + 0.279217179864645, + 0.1312003657221794, + 0.4222015403211117, + 0.3810002002865076, + 0.7528687487356365, + 0.029282372444868088, + 0.1712400820106268, + 0.1986574288457632, + 0.0, + 0.20089512318372726, + 0.43663526698946953, + 0.11013039946556091, + 1.5556237883865833, + 0.0801394097507, + 0.45025864988565445, + 0.09485246241092682, + 0.4717313183937222, + 0.7609957791864872, + 0.10925393365323544, + 0.03266730159521103, + 0.5489833918400109, + 0.38476066291332245, + 1.03533654846251, + 0.30800978653132915, + 0.2200404405593872, + 0.19455937668681145, + 0.06380456686019897, + 0.49559394642710686, + 0.21413296088576317, + 0.0, + 0.20434469915926456, + 0.0522959865629673, + 0.07631809264421463, + 0.7804870251566172, + 1.7422162182629108, + 0.19442207925021648, + 0.06955487839877605, + 0.13369182869791985, + 0.5025991350412369, + 0.12354760244488716, + 0.3160682078450918, + 0.6495296526700258, + 0.5373954083770514, + 0.07556093484163284 + ], + "unique_experts": 62, + "load_cv": 0.7485702484707908, + "normalized_load_entropy": 0.9325393839152171, + "max_load_share": 0.0472636815920398 + } + }, + "s1_eos": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "a32e991ccfa6b8f19e9eec79b4d4c5c3de67bc40eaf8386d5248f207bb9fd38a", + "route_weight_sha256": "7728bccaf0e2312a6a55d045ab83d5e3084eac2735829da316ee994a72e8fbb3", + "loads": [ + 2, + 5, + 5, + 2, + 4, + 4, + 5, + 3, + 2, + 8, + 2, + 7, + 5, + 8, + 5, + 4, + 2, + 1, + 4, + 7, + 3, + 2, + 8, + 3, + 2, + 1, + 5, + 2, + 0, + 0, + 3, + 2, + 18, + 2, + 4, + 1, + 4, + 11, + 2, + 2, + 11, + 3, + 6, + 6, + 4, + 5, + 1, + 4, + 5, + 0, + 5, + 1, + 1, + 9, + 1, + 6, + 2, + 2, + 4, + 2, + 7, + 6, + 0, + 1 + ], + "weighted_loads": [ + 0.07991560734808445, + 0.31884584948420525, + 0.1717783473432064, + 0.07343237474560738, + 0.1619492955505848, + 0.42703813686966896, + 0.22599688172340393, + 0.25725898891687393, + 0.10187797620892525, + 0.4205162990838289, + 0.07427380979061127, + 0.31413015723228455, + 0.46798065677285194, + 0.2970786653459072, + 0.2988671585917473, + 0.16872816905379295, + 0.06524710729718208, + 0.028708774596452713, + 0.13727413304150105, + 0.5744380317628384, + 0.266587533056736, + 0.13390233367681503, + 0.27278904616832733, + 0.10318021476268768, + 0.18620288372039795, + 0.029568899422883987, + 0.188011534512043, + 0.07847035489976406, + 0.0, + 0.0, + 0.09715189598500729, + 0.10560973733663559, + 1.5203092098236084, + 0.07942484691739082, + 0.4402734935283661, + 0.03691406175494194, + 0.3626342639327049, + 0.44404171220958233, + 0.06155633367598057, + 0.06620316207408905, + 0.4599235765635967, + 0.16340391151607037, + 0.4412194211035967, + 0.24565798789262772, + 0.19011504389345646, + 0.19686532020568848, + 0.03554529696702957, + 0.2049487642943859, + 0.17341231554746628, + 0.0, + 0.20504270866513252, + 0.05442268028855324, + 0.07454947382211685, + 0.5567168854176998, + 0.03435104340314865, + 0.21935687400400639, + 0.07632245309650898, + 0.13712800666689873, + 0.22353151068091393, + 0.11928771436214447, + 0.2996683679521084, + 0.4186340682208538, + 0.0, + 0.044819217175245285 + ], + "unique_experts": 60, + "load_cv": 0.790310430762197, + "normalized_load_entropy": 0.9307700495448082, + "max_load_share": 0.07142857142857142 + }, + "full_input": { + "tokens": 83, + "top_k": 6, + "decisions": 498, + "ordered_route_sha256": "b427ba42565b6c97eeee0c359641945efd7b9854381bf80c726fdb5433ab0dfd", + "route_weight_sha256": "7ee11b5123c981d4f5969e0f84a2a70e5ed3ca00312aca06c4719c3f19426364", + "loads": [ + 4, + 9, + 9, + 2, + 16, + 6, + 17, + 3, + 2, + 13, + 3, + 13, + 19, + 10, + 15, + 6, + 5, + 6, + 5, + 17, + 6, + 3, + 14, + 9, + 13, + 1, + 5, + 4, + 1, + 2, + 8, + 3, + 21, + 2, + 4, + 2, + 7, + 16, + 3, + 4, + 16, + 12, + 15, + 8, + 5, + 5, + 1, + 15, + 6, + 1, + 10, + 1, + 4, + 19, + 6, + 6, + 4, + 4, + 13, + 4, + 9, + 14, + 9, + 3 + ], + "weighted_loads": [ + 0.10529305692762136, + 0.578668151050806, + 0.30739426612854004, + 0.07343237474560738, + 1.5536561328917742, + 0.5159262418746948, + 0.8013658178970218, + 0.25725898891687393, + 0.10187797620892525, + 0.6707634460180998, + 0.14097673445940018, + 1.0036847852170467, + 1.191569434478879, + 0.3925416134297848, + 0.9479295555502176, + 0.2765602245926857, + 0.44875776395201683, + 0.25534098595380783, + 0.23765077628195286, + 1.0665802545845509, + 0.570991650223732, + 0.18893742188811302, + 0.5097969360649586, + 0.2915569515898824, + 0.8906401926651597, + 0.029568899422883987, + 0.188011534512043, + 0.18680035881698132, + 0.03855089098215103, + 0.07485083490610123, + 0.26836539059877396, + 0.14660030230879784, + 1.6417317669838667, + 0.07942484691739082, + 0.4402734935283661, + 0.07328234240412712, + 0.4463904434815049, + 0.6738218516111374, + 0.10703793354332447, + 0.17013034224510193, + 0.5952190663665533, + 0.6879148650914431, + 1.1440500188618898, + 0.3230547644197941, + 0.20082938112318516, + 0.19686532020568848, + 0.03554529696702957, + 0.8964664749801159, + 0.20919878408312798, + 0.0434851236641407, + 0.5432889349758625, + 0.05442268028855324, + 0.21758809126913548, + 1.406786471605301, + 1.7437866292893887, + 0.21935687400400639, + 0.15736607275903225, + 0.22635780274868011, + 0.677349615842104, + 0.18665112555027008, + 0.37597742676734924, + 0.7819788157939911, + 0.7268819995224476, + 0.21043509617447853 + ], + "unique_experts": 64, + "load_cv": 0.6978135560245512, + "normalized_load_entropy": 0.9416687618385836, + "max_load_share": 0.04216867469879518 + } + }, + "s0_bos": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "9f9c732ef29f745520ac1af7d957c8aba50d510c7d71fcab06fe80feb4713cdf", + "route_weight_sha256": "c78b46db816f38c458c6d393c8b4bd339a32e2a9a8c322df3f0bb8f8770d99d2", + "loads": [ + 2, + 6, + 5, + 1, + 3, + 4, + 4, + 3, + 2, + 9, + 2, + 6, + 5, + 7, + 5, + 5, + 1, + 1, + 3, + 8, + 3, + 2, + 8, + 2, + 3, + 1, + 4, + 1, + 2, + 0, + 4, + 2, + 19, + 2, + 4, + 1, + 6, + 14, + 2, + 1, + 10, + 1, + 5, + 7, + 4, + 6, + 0, + 4, + 6, + 0, + 5, + 1, + 2, + 8, + 0, + 4, + 2, + 2, + 4, + 2, + 7, + 6, + 0, + 3 + ], + "weighted_loads": [ + 0.0808778703212738, + 0.36505646631121635, + 0.17509221658110619, + 0.04201476275920868, + 0.12077533826231956, + 0.43253765627741814, + 0.20247362926602364, + 0.26659683883190155, + 0.10237611830234528, + 0.5571792554110289, + 0.074277613312006, + 0.2488495483994484, + 0.44665417075157166, + 0.2657283805310726, + 0.3098280131816864, + 0.19894521310925484, + 0.03085933066904545, + 0.0267083328217268, + 0.11366749741137028, + 0.5603051763027906, + 0.2823290377855301, + 0.1364276185631752, + 0.2612788509577513, + 0.06006588786840439, + 0.2634361796081066, + 0.029636817052960396, + 0.15271855145692825, + 0.03475379943847656, + 0.06622233428061008, + 0.0, + 0.13201871328055859, + 0.11417681351304054, + 1.5581105537712574, + 0.08223604038357735, + 0.422428622841835, + 0.04079721122980118, + 0.4718960542231798, + 0.574683403596282, + 0.07162470743060112, + 0.036061521619558334, + 0.41300399601459503, + 0.05505089834332466, + 0.4141452629119158, + 0.33783681131899357, + 0.2073657177388668, + 0.23059952072799206, + 0.0, + 0.1974806934595108, + 0.2014046460390091, + 0.0, + 0.21113356575369835, + 0.04869264364242554, + 0.10943736135959625, + 0.5275761298835278, + 0.0, + 0.15262789838016033, + 0.0756725687533617, + 0.13173141703009605, + 0.23922306299209595, + 0.0992233157157898, + 0.26870387978851795, + 0.4099867735058069, + 0.0, + 0.10928153060376644 + ], + "unique_experts": 59, + "load_cv": 0.8457502733179187, + "normalized_load_entropy": 0.9221640686819558, + "max_load_share": 0.07539682539682539 + }, + "full_input": { + "tokens": 67, + "top_k": 6, + "decisions": 402, + "ordered_route_sha256": "d5461c0b5be044a1686a7efeca4be4a7e71ff1e911bb3c775157e062f23e784c", + "route_weight_sha256": "2f850559820b4456c218242fcfaff9ecbdab96b8837bfc9cba94c14b7e19e72f", + "loads": [ + 3, + 7, + 7, + 1, + 8, + 5, + 14, + 3, + 2, + 12, + 2, + 7, + 13, + 13, + 9, + 5, + 4, + 2, + 3, + 15, + 3, + 2, + 13, + 9, + 11, + 1, + 5, + 4, + 2, + 5, + 12, + 2, + 20, + 2, + 4, + 3, + 6, + 20, + 3, + 1, + 13, + 5, + 14, + 9, + 5, + 7, + 0, + 7, + 9, + 0, + 5, + 1, + 2, + 10, + 5, + 4, + 2, + 2, + 10, + 2, + 7, + 10, + 7, + 3 + ], + "weighted_loads": [ + 0.1257421299815178, + 0.4493955112993717, + 0.2286037839949131, + 0.04201476275920868, + 0.8157320227473974, + 0.4457259625196457, + 0.613223317079246, + 0.26659683883190155, + 0.10237611830234528, + 0.7395675275474787, + 0.074277613312006, + 0.2794409152120352, + 0.9711519293487072, + 0.5343193635344505, + 0.554928507655859, + 0.19894521310925484, + 0.14431698061525822, + 0.7557616513222456, + 0.11366749741137028, + 1.0704039353877306, + 0.2823290377855301, + 0.1364276185631752, + 0.4452613200992346, + 0.32612733263522387, + 0.7739646676927805, + 0.029636817052960396, + 0.1832908745855093, + 0.18366685509681702, + 0.06622233428061008, + 0.2032325342297554, + 0.4330287482589483, + 0.11417681351304054, + 1.591783907264471, + 0.08223604038357735, + 0.422428622841835, + 0.11636118777096272, + 0.4718960542231798, + 0.8639663066715002, + 0.11335630714893341, + 0.036061521619558334, + 0.5141185559332371, + 0.31049349904060364, + 1.038863630965352, + 0.4312069471925497, + 0.2180800549685955, + 0.259186876937747, + 0.0, + 0.4339383542537689, + 0.3220335617661476, + 0.0, + 0.21113356575369835, + 0.04869264364242554, + 0.10943736135959625, + 0.7182065434753895, + 0.7985514290630817, + 0.15262789838016033, + 0.0756725687533617, + 0.13173141703009605, + 0.5006240271031857, + 0.0992233157157898, + 0.26870387978851795, + 0.6286216899752617, + 0.5373954083770514, + 0.10928153060376644 + ], + "unique_experts": 62, + "load_cv": 0.7496275982783661, + "normalized_load_entropy": 0.933712272283046, + "max_load_share": 0.04975124378109453 + } + }, + "s1_bos": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "2e7731dc92cdf86b1b419dba415ef9bedcf325391d345f540ffdb9f829142c8b", + "route_weight_sha256": "c5e9b43bcca01622a80408e8ff4faa52909a84e959eabdb4244d029c4718c69c", + "loads": [ + 2, + 4, + 5, + 1, + 3, + 4, + 5, + 3, + 2, + 9, + 3, + 5, + 5, + 7, + 6, + 6, + 1, + 1, + 3, + 7, + 3, + 2, + 8, + 3, + 3, + 0, + 4, + 1, + 1, + 1, + 3, + 2, + 19, + 2, + 4, + 1, + 4, + 15, + 2, + 2, + 10, + 1, + 5, + 8, + 3, + 5, + 1, + 4, + 5, + 0, + 5, + 1, + 1, + 12, + 0, + 4, + 2, + 2, + 5, + 3, + 5, + 6, + 0, + 2 + ], + "weighted_loads": [ + 0.0786522813141346, + 0.28224094957113266, + 0.1771259345114231, + 0.04380067065358162, + 0.11300233006477356, + 0.42320484295487404, + 0.2330707237124443, + 0.2706528753042221, + 0.09905239567160606, + 0.49526605755090714, + 0.10782128572463989, + 0.2239835001528263, + 0.47094444930553436, + 0.2655872032046318, + 0.3517543338239193, + 0.22299651615321636, + 0.03179384395480156, + 0.02644026279449463, + 0.11020250432193279, + 0.5401494018733501, + 0.2765059433877468, + 0.13596186414361, + 0.2665552459657192, + 0.09096749126911163, + 0.26337598636746407, + 0.0, + 0.14466097950935364, + 0.03463684394955635, + 0.03424239531159401, + 0.03208916634321213, + 0.09792561084032059, + 0.11082405224442482, + 1.5834619216620922, + 0.0780249573290348, + 0.43595703691244125, + 0.04073583334684372, + 0.37061716616153717, + 0.6481087952852249, + 0.06897240690886974, + 0.06775647029280663, + 0.41290421411395073, + 0.04358051344752312, + 0.398797569796443, + 0.35044257901608944, + 0.15913615748286247, + 0.2057912014424801, + 0.03819804638624191, + 0.20174039155244827, + 0.16850634291768074, + 0.0, + 0.2057269923388958, + 0.050957176834344864, + 0.07924394309520721, + 0.6972009688615799, + 0.0, + 0.15597032755613327, + 0.07522042095661163, + 0.13491207361221313, + 0.27442920207977295, + 0.13776440732181072, + 0.20964537374675274, + 0.4244590736925602, + 0.0, + 0.07547838985919952 + ], + "unique_experts": 60, + "load_cv": 0.8727272250089698, + "normalized_load_entropy": 0.9211076913850031, + "max_load_share": 0.07539682539682539 + }, + "full_input": { + "tokens": 83, + "top_k": 6, + "decisions": 498, + "ordered_route_sha256": "9372df6b8d71892e62dff6748bb7c12737a3a554e100cef718e2f8cd05d7e815", + "route_weight_sha256": "112f1212def319f2c863b1089abf62b30bb5b51c363b359f50c1eb8da51bccdf", + "loads": [ + 3, + 8, + 9, + 1, + 15, + 6, + 16, + 3, + 2, + 16, + 4, + 11, + 19, + 11, + 16, + 8, + 4, + 6, + 4, + 18, + 6, + 3, + 14, + 8, + 14, + 0, + 4, + 3, + 2, + 3, + 9, + 3, + 22, + 2, + 4, + 3, + 7, + 19, + 3, + 5, + 14, + 10, + 14, + 10, + 4, + 5, + 1, + 14, + 6, + 1, + 10, + 1, + 4, + 21, + 4, + 4, + 4, + 4, + 15, + 5, + 6, + 14, + 9, + 4 + ], + "weighted_loads": [ + 0.09963474981486797, + 0.5420632511377335, + 0.30972226336598396, + 0.04380067065358162, + 1.5995499920099974, + 0.5120929479598999, + 0.782228427939117, + 0.2706528753042221, + 0.09905239567160606, + 0.824259452521801, + 0.1745242103934288, + 0.9135381281375885, + 1.2094913553446531, + 0.4419996924698353, + 1.0091124381870031, + 0.3308285716921091, + 0.4153045006096363, + 0.25307247415184975, + 0.2105791475623846, + 1.263734720647335, + 0.5809100605547428, + 0.190996952354908, + 0.5035631358623505, + 0.26922006998211145, + 1.0814541094005108, + 0.0, + 0.14466097950935364, + 0.1492617465555668, + 0.07279328629374504, + 0.11011062934994698, + 0.3215353339910507, + 0.15181461721658707, + 1.70683347992599, + 0.0780249573290348, + 0.43595703691244125, + 0.1299826204776764, + 0.4861944876611233, + 0.8422149624675512, + 0.11445400677621365, + 0.21175597235560417, + 0.5388924963772297, + 0.5478967092931271, + 1.1016281675547361, + 0.42636887170374393, + 0.16985049471259117, + 0.2057912014424801, + 0.03819804638624191, + 0.8471096120774746, + 0.20429281145334244, + 0.0434851236641407, + 0.5439732186496258, + 0.050957176834344864, + 0.22228256054222584, + 1.4517733082175255, + 0.7680586613714695, + 0.15597032755613327, + 0.1562640406191349, + 0.22414186969399452, + 0.7705492787063122, + 0.20512781850993633, + 0.2508664671331644, + 0.7842702493071556, + 0.7268819995224476, + 0.24109426885843277 + ], + "unique_experts": 63, + "load_cv": 0.7275064652671701, + "normalized_load_entropy": 0.937352302346512, + "max_load_share": 0.04417670682730924 + } + }, + "s0_x": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "7030b1cdd40cfc0718bf358aef355c3846cde52e2306144396da83bb1344af57", + "route_weight_sha256": "82c74e939b512ce81114be504048db492f759fc5d39ac300d3b4993794b35c0c", + "loads": [ + 1, + 6, + 5, + 1, + 4, + 4, + 5, + 3, + 2, + 7, + 2, + 6, + 5, + 8, + 6, + 5, + 1, + 1, + 4, + 8, + 3, + 2, + 8, + 3, + 1, + 1, + 4, + 1, + 2, + 1, + 4, + 2, + 19, + 2, + 4, + 1, + 4, + 13, + 2, + 2, + 10, + 1, + 5, + 8, + 4, + 4, + 1, + 5, + 5, + 0, + 6, + 1, + 1, + 9, + 0, + 4, + 2, + 2, + 5, + 2, + 5, + 6, + 0, + 3 + ], + "weighted_loads": [ + 0.04931531101465225, + 0.3676740862429142, + 0.1736279521137476, + 0.04599990323185921, + 0.1756698340177536, + 0.43944066390395164, + 0.23480192944407463, + 0.2608790881931782, + 0.09645171836018562, + 0.4469892159104347, + 0.07574773207306862, + 0.25836149975657463, + 0.47215111553668976, + 0.28828102350234985, + 0.3348284997045994, + 0.19205821491777897, + 0.03117501176893711, + 0.027168814092874527, + 0.14603271894156933, + 0.5910735093057156, + 0.2753579877316952, + 0.13137073069810867, + 0.2678704056888819, + 0.09163148887455463, + 0.1220049262046814, + 0.02931007370352745, + 0.14614724926650524, + 0.03693629056215286, + 0.06048622913658619, + 0.03178302198648453, + 0.1233046893030405, + 0.11076324433088303, + 1.5687702037394047, + 0.08145756646990776, + 0.44718198478221893, + 0.037094149738550186, + 0.39485326036810875, + 0.4907136857509613, + 0.07830997556447983, + 0.07036488130688667, + 0.42446766421198845, + 0.02895679697394371, + 0.4041323158890009, + 0.3063513282686472, + 0.19296005368232727, + 0.1745126061141491, + 0.039107795804739, + 0.2514142133295536, + 0.17322823405265808, + 0.0, + 0.24052243120968342, + 0.05289869382977486, + 0.07409989088773727, + 0.5839193519204855, + 0.0, + 0.1581079140305519, + 0.07166482880711555, + 0.13221973180770874, + 0.2859009727835655, + 0.09887152165174484, + 0.21327777206897736, + 0.4161505848169327, + 0.0, + 0.11029010266065598 + ], + "unique_experts": 61, + "load_cv": 0.8288997707394862, + "normalized_load_entropy": 0.9265892340702641, + "max_load_share": 0.07539682539682539 + }, + "full_input": { + "tokens": 67, + "top_k": 6, + "decisions": 402, + "ordered_route_sha256": "c0a3dba80ad9e4a9b0b0bdd5366d35ca4ed56a00f05025499b0f295470e5ed27", + "route_weight_sha256": "43b0de82f421628b1de91aaa1ca8fa527af58d484f70bb4ea7f8d99e1ede5ad3", + "loads": [ + 3, + 7, + 7, + 1, + 9, + 6, + 15, + 3, + 2, + 10, + 2, + 7, + 15, + 12, + 11, + 5, + 4, + 1, + 4, + 14, + 3, + 2, + 14, + 10, + 7, + 1, + 4, + 3, + 2, + 6, + 11, + 2, + 20, + 2, + 5, + 2, + 4, + 18, + 3, + 2, + 14, + 4, + 14, + 10, + 5, + 4, + 1, + 10, + 6, + 0, + 6, + 1, + 1, + 13, + 5, + 4, + 2, + 2, + 12, + 2, + 6, + 10, + 8, + 3 + ], + "weighted_loads": [ + 0.13469916209578514, + 0.45201313123106956, + 0.2374977506697178, + 0.04599990323185921, + 0.9762970954179764, + 0.5397036820650101, + 0.6631422890350223, + 0.2608790881931782, + 0.09645171836018562, + 0.6261372156441212, + 0.07574773207306862, + 0.2889528665691614, + 1.1509042754769325, + 0.46629462763667107, + 0.6221697703003883, + 0.19205821491777897, + 0.14463266171514988, + 0.027168814092874527, + 0.14603271894156933, + 0.8525394275784492, + 0.2753579877316952, + 0.13137073069810867, + 0.5028154496103525, + 0.35049385856837034, + 0.4462647866457701, + 0.02931007370352745, + 0.14614724926650524, + 0.13100185617804527, + 0.06048622913658619, + 0.23499584570527077, + 0.3811637256294489, + 0.11076324433088303, + 1.6095728166401386, + 0.08145756646990776, + 0.4879934713244438, + 0.0928361639380455, + 0.39485326036810875, + 0.6983872316777706, + 0.12004157528281212, + 0.07036488130688667, + 0.5709504224359989, + 0.26570460572838783, + 1.1460050996392965, + 0.40061395429074764, + 0.20367439091205597, + 0.1745126061141491, + 0.039107795804739, + 0.6151538677513599, + 0.21171515807509422, + 0.0, + 0.24052243120968342, + 0.05289869382977486, + 0.07409989088773727, + 0.8399440068751574, + 0.7985514290630817, + 0.1581079140305519, + 0.07166482880711555, + 0.13221973180770874, + 0.59423853084445, + 0.09887152165174484, + 0.25033222138881683, + 0.6327860709279776, + 0.5842391569167376, + 0.11029010266065598 + ], + "unique_experts": 63, + "load_cv": 0.7627208048576614, + "normalized_load_entropy": 0.9319262989039189, + "max_load_share": 0.04975124378109453 + } + }, + "s1_x": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "109a84eac86ecf38b6b1e0773cc0d3f9873ecdd8b92ce373718d593c7ec58cd8", + "route_weight_sha256": "96c1ee25d0278818bba452ded11afb9bddede98a7bcc3162c268c8ede39fdf39", + "loads": [ + 5, + 6, + 5, + 1, + 4, + 4, + 6, + 3, + 2, + 10, + 2, + 6, + 5, + 7, + 6, + 4, + 1, + 1, + 3, + 6, + 3, + 2, + 8, + 3, + 2, + 0, + 3, + 1, + 0, + 1, + 1, + 2, + 18, + 2, + 4, + 1, + 4, + 16, + 3, + 2, + 12, + 3, + 4, + 8, + 3, + 4, + 1, + 6, + 4, + 0, + 4, + 1, + 1, + 9, + 0, + 5, + 2, + 2, + 5, + 2, + 5, + 6, + 0, + 2 + ], + "weighted_loads": [ + 0.19152671843767166, + 0.3662972394376993, + 0.17392167076468468, + 0.04598507657647133, + 0.16676019877195358, + 0.4018329940736294, + 0.2658598702400923, + 0.25824445858597755, + 0.09057334065437317, + 0.5054496843367815, + 0.07975456863641739, + 0.25217774510383606, + 0.50864402577281, + 0.2628673017024994, + 0.36144309863448143, + 0.15388714894652367, + 0.03337952867150307, + 0.02867976576089859, + 0.09418845549225807, + 0.5239919871091843, + 0.268227007240057, + 0.12817805632948875, + 0.2708197683095932, + 0.10412636585533619, + 0.16458780318498611, + 0.0, + 0.09572861529886723, + 0.038084741681814194, + 0.0, + 0.03264140710234642, + 0.03017844446003437, + 0.10796578601002693, + 1.5586061738431454, + 0.07812226563692093, + 0.45065705850720406, + 0.04124049097299576, + 0.32526079192757607, + 0.601344745606184, + 0.10297330468893051, + 0.07072056457400322, + 0.521990705281496, + 0.12290945276618004, + 0.36174800619482994, + 0.31195233203470707, + 0.14442310482263565, + 0.17337457835674286, + 0.035309337079524994, + 0.2922496944665909, + 0.1367068514227867, + 0.0, + 0.17654144577682018, + 0.05369339883327484, + 0.07791583985090256, + 0.5729281473904848, + 0.0, + 0.19023955799639225, + 0.07216726057231426, + 0.13733378797769547, + 0.2643886059522629, + 0.10853387415409088, + 0.24408410117030144, + 0.4106941055506468, + 0.0, + 0.06890573166310787 + ], + "unique_experts": 59, + "load_cv": 0.8761847250788941, + "normalized_load_entropy": 0.9183405306725454, + "max_load_share": 0.07142857142857142 + }, + "full_input": { + "tokens": 83, + "top_k": 6, + "decisions": 498, + "ordered_route_sha256": "ff59286e018417d860f50d2c36d46a6ebfffe5b237dbaee7dcf7271ba2bc2857", + "route_weight_sha256": "31d666a55ad6856ef2bb34fdd681322069d18bd1db89b1d62886cb73c012e736", + "loads": [ + 7, + 11, + 8, + 1, + 16, + 7, + 16, + 3, + 2, + 15, + 3, + 12, + 20, + 9, + 17, + 6, + 4, + 6, + 4, + 13, + 6, + 3, + 15, + 8, + 10, + 0, + 3, + 3, + 1, + 3, + 6, + 3, + 22, + 2, + 5, + 2, + 6, + 21, + 4, + 4, + 15, + 12, + 14, + 10, + 4, + 4, + 1, + 18, + 5, + 1, + 9, + 1, + 4, + 20, + 4, + 5, + 4, + 4, + 15, + 4, + 7, + 16, + 10, + 4 + ], + "weighted_loads": [ + 0.2473022025078535, + 0.6739718113094568, + 0.2788381949067116, + 0.04598507657647133, + 1.4902780409902334, + 0.5421997494995594, + 0.742620219476521, + 0.25824445858597755, + 0.09057334065437317, + 0.7442124765366316, + 0.1464574933052063, + 0.9417323730885983, + 1.3387119192630053, + 0.35611362755298615, + 1.077686807140708, + 0.2617192044854164, + 0.4168901853263378, + 0.2553119771182537, + 0.19456509873270988, + 0.8702596500515938, + 0.572631124407053, + 0.18321314454078674, + 0.54237075522542, + 0.282378944568336, + 0.726132083684206, + 0.0, + 0.09572861529886723, + 0.15750455111265182, + 0.03855089098215103, + 0.10603481158614159, + 0.2158856801688671, + 0.14895635098218918, + 1.7344140652567148, + 0.07812226563692093, + 0.4838142767548561, + 0.0793243907392025, + 0.40507761016488075, + 0.8004729133099318, + 0.14845490455627441, + 0.1746477447450161, + 0.6093565076589584, + 0.5934256576001644, + 1.2486469708383083, + 0.39234517700970173, + 0.15513744205236435, + 0.17337457835674286, + 0.035309337079524994, + 1.0933470837771893, + 0.1724933199584484, + 0.0434851236641407, + 0.5147876720875502, + 0.05369339883327484, + 0.22095445729792118, + 1.419617434963584, + 0.7680586613714695, + 0.19023955799639225, + 0.15321088023483753, + 0.22656358405947685, + 0.749704334884882, + 0.1758972853422165, + 0.31930066272616386, + 0.8790870923548937, + 0.8168723322451115, + 0.23452161066234112 + ], + "unique_experts": 63, + "load_cv": 0.7481422182724571, + "normalized_load_entropy": 0.9340911092903168, + "max_load_share": 0.04417670682730924 + } + }, + "s0_period": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "6afa225b63b1ef0f336cf63b2280d79a17568b8ce2a899212c877455a2af816a", + "route_weight_sha256": "11d064bc5f7c2352963ca8d634f5e9e7685359e4c963493d7d706b5b6ea12cf8", + "loads": [ + 3, + 6, + 4, + 2, + 4, + 4, + 5, + 3, + 2, + 9, + 2, + 6, + 5, + 7, + 6, + 5, + 1, + 1, + 3, + 8, + 3, + 2, + 7, + 2, + 1, + 1, + 4, + 1, + 1, + 1, + 3, + 2, + 19, + 2, + 4, + 1, + 5, + 13, + 2, + 2, + 11, + 2, + 5, + 7, + 4, + 4, + 1, + 6, + 5, + 0, + 6, + 1, + 1, + 8, + 0, + 4, + 2, + 2, + 4, + 2, + 6, + 6, + 0, + 3 + ], + "weighted_loads": [ + 0.10954664088785648, + 0.3820293080061674, + 0.1434975266456604, + 0.06976007483899593, + 0.17552253603935242, + 0.4321088194847107, + 0.2262706533074379, + 0.272212628275156, + 0.09608278051018715, + 0.5091536026448011, + 0.07723350450396538, + 0.26295729354023933, + 0.4731345698237419, + 0.25319087505340576, + 0.33416303992271423, + 0.18787027150392532, + 0.03092961572110653, + 0.029591763392090797, + 0.11696266010403633, + 0.6333374734967947, + 0.27735528349876404, + 0.13363898918032646, + 0.22813904099166393, + 0.06531854160130024, + 0.12050016224384308, + 0.028910895809531212, + 0.1489901766180992, + 0.03615114837884903, + 0.029368478804826736, + 0.03299260511994362, + 0.09621592052280903, + 0.11480334028601646, + 1.590543333441019, + 0.08217291906476021, + 0.4456217959523201, + 0.037307899445295334, + 0.4397213086485863, + 0.4902263395488262, + 0.07984629832208157, + 0.06879332289099693, + 0.4521270338445902, + 0.08747744560241699, + 0.3957026693969965, + 0.27173239178955555, + 0.19780952110886574, + 0.1661161445081234, + 0.03661932423710823, + 0.28061728551983833, + 0.17219220101833344, + 0.0, + 0.24640746042132378, + 0.05048123747110367, + 0.07549817115068436, + 0.5448901243507862, + 0.0, + 0.15818939730525017, + 0.07125196047127247, + 0.13159029185771942, + 0.24026328325271606, + 0.10515385121107101, + 0.24999988079071045, + 0.4176347553730011, + 0.0, + 0.11114590615034103 + ], + "unique_experts": 61, + "load_cv": 0.826464510917131, + "normalized_load_entropy": 0.9280192344971069, + "max_load_share": 0.07539682539682539 + }, + "full_input": { + "tokens": 67, + "top_k": 6, + "decisions": 402, + "ordered_route_sha256": "9aec389dec5ffe9707260addff8e10cd232eaa8aae4bf7b11a0cb9bfb67d20cb", + "route_weight_sha256": "a2b4a300a2e8bb3e2e5cf235288e3b181e1b5f932349f333db2ab2ec0e3e9d7f", + "loads": [ + 5, + 7, + 6, + 2, + 9, + 6, + 14, + 3, + 2, + 13, + 2, + 7, + 14, + 11, + 11, + 5, + 4, + 1, + 3, + 14, + 3, + 2, + 12, + 9, + 7, + 1, + 4, + 3, + 1, + 6, + 11, + 2, + 20, + 2, + 6, + 2, + 6, + 19, + 3, + 2, + 15, + 5, + 13, + 9, + 5, + 4, + 1, + 12, + 6, + 0, + 6, + 1, + 1, + 10, + 5, + 4, + 2, + 2, + 11, + 2, + 6, + 11, + 8, + 3 + ], + "weighted_loads": [ + 0.21047148294746876, + 0.4663683529943228, + 0.20017478801310062, + 0.06976007483899593, + 1.06741601228714, + 0.5225408561527729, + 0.6001876099035144, + 0.272212628275156, + 0.09608278051018715, + 0.722728269174695, + 0.07723350450396538, + 0.2935486603528261, + 1.0537490621209145, + 0.42807383090257645, + 0.6353414915502071, + 0.18787027150392532, + 0.1443872656673193, + 0.029591763392090797, + 0.11696266010403633, + 0.8967841733247042, + 0.27735528349876404, + 0.13363898918032646, + 0.41212151013314724, + 0.3199228635057807, + 0.45147099904716015, + 0.028910895809531212, + 0.1489901766180992, + 0.13410166278481483, + 0.029368478804826736, + 0.23581277206540108, + 0.3967510797083378, + 0.11480334028601646, + 1.6306493803858757, + 0.08217291906476021, + 0.5573602356016636, + 0.09304991364479065, + 0.49336956441402435, + 0.7451078593730927, + 0.12157789804041386, + 0.06879332289099693, + 0.5967585947364569, + 0.30850043147802353, + 0.9916700031608343, + 0.36933950893580914, + 0.20852385833859444, + 0.1661161445081234, + 0.03661932423710823, + 0.7164959162473679, + 0.21067912504076958, + 0.0, + 0.24640746042132378, + 0.05048123747110367, + 0.07549817115068436, + 0.7483108974993229, + 0.7985514290630817, + 0.15818939730525017, + 0.07125196047127247, + 0.13159029185771942, + 0.5353855304419994, + 0.10515385121107101, + 0.24999988079071045, + 0.7249736990779638, + 0.5777077097445726, + 0.11114590615034103 + ], + "unique_experts": 63, + "load_cv": 0.7485702484707908, + "normalized_load_entropy": 0.9341312690942675, + "max_load_share": 0.04975124378109453 + } + }, + "s1_period": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "14d7fc80b6708162198a3451dce2b7c6d82835ab81db6afa1b12acd65130824d", + "route_weight_sha256": "d0bbd312db613fb581bd1cfcb0195584fc126ad4e3fd113220407d9eaa2c943a", + "loads": [ + 1, + 7, + 5, + 1, + 4, + 4, + 4, + 3, + 2, + 9, + 3, + 6, + 5, + 7, + 6, + 4, + 1, + 1, + 4, + 7, + 3, + 2, + 8, + 2, + 3, + 0, + 4, + 2, + 0, + 1, + 2, + 2, + 19, + 2, + 4, + 1, + 4, + 16, + 2, + 2, + 12, + 3, + 4, + 8, + 3, + 4, + 1, + 6, + 3, + 0, + 5, + 1, + 1, + 10, + 1, + 5, + 2, + 2, + 4, + 2, + 4, + 6, + 0, + 2 + ], + "weighted_loads": [ + 0.06100602447986603, + 0.4294574223458767, + 0.1754438579082489, + 0.04503782466053963, + 0.17117048054933548, + 0.40057769790291786, + 0.194776501506567, + 0.2626841217279434, + 0.08916611596941948, + 0.4915702249854803, + 0.10839120298624039, + 0.25185051932930946, + 0.5197763927280903, + 0.26315974071621895, + 0.35836685076355934, + 0.15617698058485985, + 0.032831691205501556, + 0.030122658237814903, + 0.13873577117919922, + 0.6309598907828331, + 0.27256201207637787, + 0.13011033833026886, + 0.2684074603021145, + 0.07952417619526386, + 0.17842845618724823, + 0.0, + 0.14540243707597256, + 0.06440228037536144, + 0.0, + 0.03514475002884865, + 0.05917332321405411, + 0.10624602809548378, + 1.6450763046741486, + 0.08018998801708221, + 0.45522816106677055, + 0.038720231503248215, + 0.3355816528201103, + 0.5750741437077522, + 0.0710439644753933, + 0.07311633974313736, + 0.5321009010076523, + 0.13079631328582764, + 0.35649923607707024, + 0.310384314507246, + 0.14490561187267303, + 0.1732027418911457, + 0.03283153846859932, + 0.3040722496807575, + 0.09732851758599281, + 0.0, + 0.21067279763519764, + 0.05692962184548378, + 0.08338269591331482, + 0.6846049949526787, + 0.028734387829899788, + 0.18746192939579487, + 0.07238820195198059, + 0.13809628039598465, + 0.22742031514644623, + 0.11056841909885406, + 0.19963912293314934, + 0.40646960958838463, + 0.0, + 0.06855677254498005 + ], + "unique_experts": 60, + "load_cv": 0.8898803993910971, + "normalized_load_entropy": 0.919364705160472, + "max_load_share": 0.07539682539682539 + }, + "full_input": { + "tokens": 83, + "top_k": 6, + "decisions": 498, + "ordered_route_sha256": "6425fd7a15bf1710cf2d11a5faa9cfab8d7d0370e2edebee36f950cd10b0489a", + "route_weight_sha256": "3a1035e1ebad5fff5fea1243753f9594406bfd1adcb82a8494aacb27024c564e", + "loads": [ + 2, + 11, + 8, + 1, + 16, + 7, + 13, + 3, + 2, + 14, + 4, + 12, + 19, + 9, + 19, + 6, + 4, + 6, + 5, + 15, + 6, + 3, + 14, + 7, + 10, + 0, + 4, + 4, + 2, + 3, + 7, + 3, + 22, + 2, + 5, + 1, + 6, + 20, + 3, + 5, + 16, + 12, + 14, + 10, + 4, + 4, + 1, + 19, + 4, + 1, + 11, + 1, + 4, + 21, + 5, + 5, + 4, + 4, + 13, + 4, + 7, + 17, + 10, + 4 + ], + "weighted_loads": [ + 0.0819884929805994, + 0.6892797239124775, + 0.27205170691013336, + 0.04503782466053963, + 1.5525028314441442, + 0.5388071686029434, + 0.6387379830703139, + 0.2626841217279434, + 0.08916611596941948, + 0.7213929910212755, + 0.1750941276550293, + 0.9414051473140717, + 1.2509451266378164, + 0.35653869062662125, + 1.1330880317837, + 0.2640090361237526, + 0.4163423478603363, + 0.25675486959517, + 0.23911241441965103, + 1.0224259160459042, + 0.5769661292433739, + 0.18514542654156685, + 0.5054153501987457, + 0.2577767549082637, + 0.6774881035089493, + 0.0, + 0.14540243707597256, + 0.19754711724817753, + 0.07490978017449379, + 0.10957979783415794, + 0.24587229825556278, + 0.14723659306764603, + 1.7877838518470526, + 0.08018998801708221, + 0.5172828398644924, + 0.038720231503248215, + 0.415398471057415, + 0.7210000772029161, + 0.1165255643427372, + 0.2217325046658516, + 0.6649137288331985, + 0.596685104072094, + 1.0935864187777042, + 0.3865094408392906, + 0.15561994910240173, + 0.1732027418911457, + 0.03283153846859932, + 1.2165068797767162, + 0.1331149861216545, + 0.0434851236641407, + 0.5836246367543936, + 0.05692962184548378, + 0.22642131336033344, + 1.5751313120126724, + 0.7967930492013693, + 0.18746192939579487, + 0.15343182161450386, + 0.22732607647776604, + 0.6812384203076363, + 0.17793183028697968, + 0.3262028954923153, + 0.9111915752291679, + 0.7668581791222095, + 0.2341726515442133 + ], + "unique_experts": 63, + "load_cv": 0.750552878693931, + "normalized_load_entropy": 0.9337859312848645, + "max_load_share": 0.04417670682730924 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 42, + "ordered_topk_exact_tokens": 19, + "set_exact_tokens": 26, + "mean_set_jaccard": 0.8860544217687076, + "mean_token_weighted_tv": 0.022563638631254435, + "aggregate_load_tv": 0.047619047619047616 + }, + "system_bos": { + "tokens": 42, + "ordered_topk_exact_tokens": 18, + "set_exact_tokens": 23, + "mean_set_jaccard": 0.8503401360544218, + "mean_token_weighted_tv": 0.02690678493430217, + "aggregate_load_tv": 0.06349206349206349 + }, + "system_x": { + "tokens": 42, + "ordered_topk_exact_tokens": 17, + "set_exact_tokens": 22, + "mean_set_jaccard": 0.8384353741496599, + "mean_token_weighted_tv": 0.032776485285943464, + "aggregate_load_tv": 0.07539682539682539 + }, + "system_period": { + "tokens": 42, + "ordered_topk_exact_tokens": 17, + "set_exact_tokens": 27, + "mean_set_jaccard": 0.8613378684807255, + "mean_token_weighted_tv": 0.031027128498646476, + "aggregate_load_tv": 0.07142857142857142 + }, + "bos_at_s0": { + "tokens": 42, + "ordered_topk_exact_tokens": 19, + "set_exact_tokens": 24, + "mean_set_jaccard": 0.846938775510204, + "mean_token_weighted_tv": 0.03089640054496981, + "aggregate_load_tv": 0.05952380952380952 + }, + "bos_at_s1": { + "tokens": 42, + "ordered_topk_exact_tokens": 16, + "set_exact_tokens": 23, + "mean_set_jaccard": 0.8227891156462585, + "mean_token_weighted_tv": 0.03544860401944745, + "aggregate_load_tv": 0.08333333333333333 + }, + "x_at_s0": { + "tokens": 42, + "ordered_topk_exact_tokens": 20, + "set_exact_tokens": 25, + "mean_set_jaccard": 0.8426303854875284, + "mean_token_weighted_tv": 0.031543037809786345, + "aggregate_load_tv": 0.07936507936507936 + }, + "x_at_s1": { + "tokens": 42, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.8049886621315193, + "mean_token_weighted_tv": 0.03845836180040524, + "aggregate_load_tv": 0.0873015873015873 + }, + "period_at_s0": { + "tokens": 42, + "ordered_topk_exact_tokens": 21, + "set_exact_tokens": 27, + "mean_set_jaccard": 0.8735827664399093, + "mean_token_weighted_tv": 0.027101131222609962, + "aggregate_load_tv": 0.05952380952380952 + }, + "period_at_s1": { + "tokens": 42, + "ordered_topk_exact_tokens": 17, + "set_exact_tokens": 23, + "mean_set_jaccard": 0.8361678004535148, + "mean_token_weighted_tv": 0.035050675295115935, + "aggregate_load_tv": 0.07936507936507936 + } + } + }, + "layer_20": { + "layer": 20, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "9955f3cefb3b149fffe70abcbd045351966e5d0d48cc9fdd0d6c116c2cf796f0", + "route_weight_sha256": "b388031d5e64e0a0910e1654c9c8f05f81a60344f00b683155378d4b3632fe04", + "loads": [ + 4, + 3, + 0, + 1, + 9, + 8, + 2, + 3, + 6, + 0, + 0, + 2, + 5, + 8, + 5, + 5, + 6, + 5, + 6, + 3, + 2, + 4, + 4, + 3, + 0, + 12, + 1, + 12, + 1, + 6, + 1, + 2, + 11, + 4, + 7, + 0, + 2, + 3, + 5, + 4, + 12, + 7, + 1, + 0, + 5, + 0, + 2, + 1, + 3, + 1, + 14, + 1, + 1, + 6, + 3, + 5, + 10, + 4, + 2, + 2, + 3, + 3, + 1, + 0 + ], + "weighted_loads": [ + 0.12492208555340767, + 0.09429090656340122, + 0.0, + 0.03938119858503342, + 1.0413608253002167, + 0.3292576037347317, + 0.207352414727211, + 0.21097039431333542, + 0.3485727906227112, + 0.0, + 0.0, + 0.31246042624115944, + 0.32852794975042343, + 0.6187716666609049, + 0.15726055577397346, + 0.17712943069636822, + 0.26731435768306255, + 0.5577436052262783, + 0.277872059494257, + 0.10633856803178787, + 0.06210779584944248, + 0.18688410706818104, + 0.23648567870259285, + 0.21627677604556084, + 0.0, + 0.7689649350941181, + 0.028890423476696014, + 0.754228014498949, + 0.06104210019111633, + 0.27971656061708927, + 0.029844431206583977, + 0.05756125971674919, + 0.6559089422225952, + 0.6650291159749031, + 0.2965733576565981, + 0.0, + 0.0737438015639782, + 0.19194710440933704, + 0.17089426703751087, + 0.133057514205575, + 0.47294496186077595, + 0.24012632854282856, + 0.027725649997591972, + 0.0, + 0.24567793682217598, + 0.0, + 0.13655930757522583, + 0.020003696903586388, + 0.11079358123242855, + 0.04682460054755211, + 1.484454918652773, + 0.04268975928425789, + 0.028628678992390633, + 0.28592672012746334, + 0.11361442320048809, + 0.29520886205136776, + 0.35147319734096527, + 0.16079645603895187, + 0.08006854355335236, + 0.08223140984773636, + 0.21867113187909126, + 0.1248500794172287, + 0.043856773525476456, + 0.0 + ], + "unique_experts": 56, + "load_cv": 0.8622715463835601, + "normalized_load_entropy": 0.9095219928897991, + "max_load_share": 0.05555555555555555 + }, + "full_input": { + "tokens": 67, + "top_k": 6, + "decisions": 402, + "ordered_route_sha256": "a93c0027a637e4da22cc149a5a1ede83210028545e5fa7e426851b68fd0e8b87", + "route_weight_sha256": "4de28f6ea07e8904b39f590df8975d22004bf2917b5e6d9aac03715c03b8409f", + "loads": [ + 4, + 5, + 0, + 9, + 17, + 12, + 7, + 9, + 6, + 0, + 0, + 2, + 9, + 8, + 5, + 12, + 7, + 5, + 16, + 3, + 6, + 4, + 11, + 3, + 0, + 20, + 2, + 12, + 1, + 7, + 1, + 2, + 11, + 5, + 10, + 0, + 4, + 6, + 7, + 4, + 14, + 8, + 3, + 3, + 14, + 0, + 2, + 2, + 4, + 2, + 22, + 1, + 2, + 12, + 3, + 8, + 11, + 9, + 4, + 2, + 15, + 7, + 2, + 0 + ], + "weighted_loads": [ + 0.12492208555340767, + 0.13896636851131916, + 0.0, + 0.642991129308939, + 1.4412519484758377, + 0.5253777354955673, + 0.3587977848947048, + 0.5562613494694233, + 0.3485727906227112, + 0.0, + 0.0, + 0.31246042624115944, + 0.4608535338193178, + 0.6187716666609049, + 0.15726055577397346, + 0.556929474696517, + 0.30562745220959187, + 0.5577436052262783, + 1.172160379588604, + 0.10633856803178787, + 0.17354050697758794, + 0.18688410706818104, + 0.6232830509543419, + 0.21627677604556084, + 0.0, + 1.2389719560742378, + 0.04632892832159996, + 0.754228014498949, + 0.06104210019111633, + 0.3140763994306326, + 0.029844431206583977, + 0.05756125971674919, + 0.6559089422225952, + 0.6881874334067106, + 0.41616244055330753, + 0.0, + 0.12025701813399792, + 0.28089157678186893, + 1.4898554105311632, + 0.133057514205575, + 0.6034542974084616, + 0.28291318751871586, + 0.19779705069959164, + 0.09496016486082226, + 0.5436068456619978, + 0.0, + 0.13655930757522583, + 0.056853754445910454, + 0.11242993699852377, + 0.08712346106767654, + 2.437587831169367, + 0.04268975928425789, + 0.07166843675076962, + 0.6295018419623375, + 0.11361442320048809, + 0.6735532339662313, + 0.411929115653038, + 0.32659060694277287, + 0.14368201978504658, + 0.08223140984773636, + 1.4900257696863264, + 0.3588978871703148, + 0.07953639701008797, + 0.0 + ], + "unique_experts": 57, + "load_cv": 0.8226725827818314, + "normalized_load_entropy": 0.9153834105096023, + "max_load_share": 0.05472636815920398 + } + }, + "s1_eos": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "42f11e33994c4f7fd7a207ef76a26ff2b4aa30cfa42ae8439fcd188d7a249928", + "route_weight_sha256": "cce2a8a8b4ca41d74442ac3b611146f9da289d80ff47479e5d93fd9ba8e998d3", + "loads": [ + 4, + 3, + 0, + 1, + 9, + 7, + 2, + 4, + 6, + 0, + 1, + 1, + 4, + 8, + 3, + 6, + 6, + 6, + 5, + 3, + 2, + 4, + 6, + 3, + 0, + 13, + 1, + 11, + 2, + 5, + 0, + 2, + 12, + 6, + 6, + 0, + 3, + 3, + 5, + 2, + 11, + 6, + 0, + 0, + 6, + 0, + 1, + 1, + 3, + 3, + 15, + 1, + 2, + 5, + 3, + 5, + 9, + 4, + 3, + 2, + 3, + 3, + 1, + 0 + ], + "weighted_loads": [ + 0.12581933476030827, + 0.09922806546092033, + 0.0, + 0.046770356595516205, + 1.0747572220861912, + 0.29232288151979446, + 0.20147525519132614, + 0.2266319990158081, + 0.34038257971405983, + 0.0, + 0.03654257208108902, + 0.27715635299682617, + 0.29660725966095924, + 0.6036365069448948, + 0.10341386869549751, + 0.2843635380268097, + 0.27756789326667786, + 0.6101995017379522, + 0.2421223782002926, + 0.1072563361376524, + 0.06164465472102165, + 0.1921147145330906, + 0.30648820847272873, + 0.21985536068677902, + 0.0, + 0.831487825140357, + 0.031796008348464966, + 0.7277859598398209, + 0.0853502955287695, + 0.24516098760068417, + 0.0, + 0.059774041175842285, + 0.7231484893709421, + 0.7335337717086077, + 0.2512212097644806, + 0.0, + 0.10466454550623894, + 0.18203246593475342, + 0.1776590310037136, + 0.07484627142548561, + 0.45019339211285114, + 0.21833656914532185, + 0.0, + 0.0, + 0.29657937586307526, + 0.0, + 0.10428354144096375, + 0.020155347883701324, + 0.10761415958404541, + 0.1080627590417862, + 1.508203413337469, + 0.04804474860429764, + 0.061617787927389145, + 0.2419145330786705, + 0.11419959180057049, + 0.30393437668681145, + 0.3378436863422394, + 0.15103577449917793, + 0.10955380462110043, + 0.08492191880941391, + 0.21251355856657028, + 0.12267358228564262, + 0.04160059988498688, + 0.0 + ], + "unique_experts": 55, + "load_cv": 0.861101967620244, + "normalized_load_entropy": 0.9094136626427842, + "max_load_share": 0.05952380952380952 + }, + "full_input": { + "tokens": 83, + "top_k": 6, + "decisions": 498, + "ordered_route_sha256": "e4420ec14634f2b70359a6e0d0c025ec6353167209c0b236df706f96ae701f14", + "route_weight_sha256": "b13b044570f7a33cf4bde95fa1bc2850cfb222bb39c1927990ce902c66f05f61", + "loads": [ + 9, + 5, + 0, + 12, + 17, + 13, + 4, + 14, + 6, + 2, + 3, + 1, + 6, + 9, + 4, + 20, + 11, + 6, + 15, + 4, + 6, + 6, + 17, + 5, + 1, + 27, + 2, + 14, + 2, + 10, + 0, + 3, + 13, + 7, + 10, + 2, + 6, + 10, + 8, + 6, + 15, + 8, + 2, + 6, + 18, + 1, + 1, + 1, + 6, + 8, + 27, + 1, + 3, + 13, + 3, + 16, + 11, + 11, + 5, + 3, + 16, + 5, + 2, + 0 + ], + "weighted_loads": [ + 0.3568578027188778, + 0.14343420416116714, + 0.0, + 0.8196360729634762, + 1.49247545003891, + 0.5600816048681736, + 0.27141653187572956, + 0.8503717854619026, + 0.34038257971405983, + 0.23369725048542023, + 0.13443511724472046, + 0.27715635299682617, + 0.354615181684494, + 0.884691808372736, + 0.16425475105643272, + 1.1648462004959583, + 0.5754872038960457, + 0.6101995017379522, + 1.2250479124486446, + 0.145937355235219, + 0.17320640827529132, + 0.2520520556718111, + 0.9465857110917568, + 0.3935929089784622, + 0.020255209878087044, + 1.6547359451651573, + 0.04923451319336891, + 0.820031164214015, + 0.0853502955287695, + 0.40139327198266983, + 0.0, + 0.08966726437211037, + 0.7723618503659964, + 0.7781529817730188, + 0.4342230148613453, + 0.17897973582148552, + 0.2057614717632532, + 0.42523843236267567, + 1.5374024137854576, + 0.2733866423368454, + 0.6810845974832773, + 0.3104413691908121, + 0.15823759138584137, + 0.2319970156531781, + 1.0766076724976301, + 0.07300540059804916, + 0.10428354144096375, + 0.020155347883701324, + 0.17315074754878879, + 0.4214148074388504, + 3.055278390645981, + 0.04804474860429764, + 0.09905854240059853, + 0.6377298533916473, + 0.11419959180057049, + 1.3521230481564999, + 0.4228893741965294, + 0.6840200666338205, + 0.18306745775043964, + 0.11294193007051945, + 1.61488055344671, + 0.23436396569013596, + 0.1026824600994587, + 0.0 + ], + "unique_experts": 61, + "load_cv": 0.8036846004202332, + "normalized_load_entropy": 0.9228134332782156, + "max_load_share": 0.05421686746987952 + } + }, + "s0_bos": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "ea3a9f4f432579b5902196cea0e9fc4b75d200cf43bee06014afce9a0a91cd02", + "route_weight_sha256": "1706ac63088b1f58d03d6e48a109a40f9e4f6ded6633f9dacf7cdd9ff9b5837c", + "loads": [ + 3, + 2, + 0, + 2, + 9, + 7, + 2, + 3, + 7, + 0, + 2, + 3, + 5, + 8, + 4, + 2, + 7, + 6, + 5, + 3, + 2, + 4, + 4, + 3, + 0, + 12, + 1, + 10, + 1, + 5, + 0, + 2, + 12, + 4, + 8, + 0, + 4, + 3, + 4, + 2, + 10, + 8, + 1, + 0, + 5, + 0, + 2, + 1, + 4, + 2, + 15, + 1, + 2, + 7, + 4, + 6, + 9, + 4, + 1, + 2, + 3, + 3, + 1, + 0 + ], + "weighted_loads": [ + 0.09049530141055584, + 0.07034572586417198, + 0.0, + 0.07345198467373848, + 1.0789491850882769, + 0.29183797538280487, + 0.20852352678775787, + 0.2155902460217476, + 0.3702080138027668, + 0.0, + 0.05910203792154789, + 0.3490762021392584, + 0.3292269092053175, + 0.5799879357218742, + 0.1263954360038042, + 0.0885588601231575, + 0.31047395430505276, + 0.6032620165497065, + 0.23429646342992783, + 0.11432131752371788, + 0.0647375863045454, + 0.17306804470717907, + 0.2523682899773121, + 0.22585415467619896, + 0.0, + 0.8339529484510422, + 0.02979181334376335, + 0.7068979032337666, + 0.05862906575202942, + 0.24820689857006073, + 0.0, + 0.05679599940776825, + 0.6985797788947821, + 0.623228058218956, + 0.31510161608457565, + 0.0, + 0.1443117931485176, + 0.19698921032249928, + 0.14189748838543892, + 0.06862713769078255, + 0.4085777997970581, + 0.28727262280881405, + 0.029353583231568336, + 0.0, + 0.24462208896875381, + 0.0, + 0.13689066469669342, + 0.02088155224919319, + 0.15091217309236526, + 0.08087556809186935, + 1.4666498992592096, + 0.04568122327327728, + 0.06333459168672562, + 0.3456263095140457, + 0.14316053874790668, + 0.35795143246650696, + 0.3102408964186907, + 0.1730378419160843, + 0.04798304662108421, + 0.08297836035490036, + 0.22162669897079468, + 0.12246955186128616, + 0.04488540440797806, + 0.0 + ], + "unique_experts": 56, + "load_cv": 0.8481301591995267, + "normalized_load_entropy": 0.9127193916041751, + "max_load_share": 0.05952380952380952 + }, + "full_input": { + "tokens": 67, + "top_k": 6, + "decisions": 402, + "ordered_route_sha256": "4e98b8e9da45e5a80e1a8c2918744b4c022447444cb5adecb269b0feb6f96564", + "route_weight_sha256": "8eb5695bc4e30bdbb7c290d03d183df60ac950f177879ebe135f456f23282956", + "loads": [ + 3, + 3, + 0, + 10, + 17, + 11, + 7, + 8, + 7, + 0, + 2, + 4, + 9, + 8, + 5, + 10, + 8, + 6, + 15, + 3, + 7, + 4, + 12, + 3, + 0, + 19, + 4, + 10, + 1, + 6, + 2, + 3, + 12, + 5, + 10, + 0, + 6, + 6, + 5, + 2, + 12, + 10, + 3, + 3, + 14, + 0, + 3, + 2, + 4, + 2, + 23, + 1, + 3, + 13, + 4, + 9, + 9, + 8, + 3, + 2, + 14, + 6, + 1, + 0 + ], + "weighted_loads": [ + 0.09049530141055584, + 0.09448633156716824, + 0.0, + 0.677061915397644, + 1.478840308263898, + 0.47668034955859184, + 0.3599688969552517, + 0.5092113800346851, + 0.3702080138027668, + 0.0, + 0.05910203792154789, + 1.0286880638450384, + 0.46662505716085434, + 0.5799879357218742, + 0.17389352805912495, + 0.5508892089128494, + 0.34878704883158207, + 0.6032620165497065, + 1.1285847835242748, + 0.11432131752371788, + 0.247002262622118, + 0.17306804470717907, + 0.7159213572740555, + 0.22585415467619896, + 0.0, + 1.2596997134387493, + 0.13169832155108452, + 0.7068979032337666, + 0.05862906575202942, + 0.28256673738360405, + 0.10131191089749336, + 0.0697938846424222, + 0.6985797788947821, + 0.6463863756507635, + 0.38807264529168606, + 0.0, + 0.19082500971853733, + 0.28593368269503117, + 0.5064558275043964, + 0.06862713769078255, + 0.5475143566727638, + 0.3441587472334504, + 0.20200714655220509, + 0.1583949588239193, + 0.5425509978085756, + 0.0, + 0.27975431084632874, + 0.03266810439527035, + 0.15091217309236526, + 0.08087556809186935, + 2.4235434029251337, + 0.04568122327327728, + 0.11049474775791168, + 0.6730738542973995, + 0.14316053874790668, + 0.7636784464120865, + 0.3102408964186907, + 0.30071318335831165, + 0.11201910860836506, + 0.08297836035490036, + 1.4916069582104683, + 0.3086160160601139, + 0.04488540440797806, + 0.0 + ], + "unique_experts": 58, + "load_cv": 0.7937623459917389, + "normalized_load_entropy": 0.922259721507582, + "max_load_share": 0.05721393034825871 + } + }, + "s1_bos": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "78def8d9713668e1182f1ad660e6dd8481a40fa3ff8f4853702b17d7f152395b", + "route_weight_sha256": "c47b32a89d781acadb0eda841579b64c4453f07fb90c0405a3744ad58e25947a", + "loads": [ + 3, + 3, + 0, + 2, + 9, + 5, + 2, + 3, + 6, + 0, + 0, + 2, + 4, + 9, + 3, + 4, + 6, + 6, + 5, + 3, + 2, + 3, + 4, + 3, + 0, + 14, + 1, + 10, + 1, + 6, + 0, + 1, + 12, + 5, + 8, + 0, + 4, + 3, + 5, + 2, + 9, + 9, + 1, + 0, + 6, + 0, + 2, + 1, + 4, + 2, + 14, + 1, + 3, + 8, + 5, + 5, + 9, + 4, + 1, + 2, + 3, + 3, + 1, + 0 + ], + "weighted_loads": [ + 0.0931769348680973, + 0.10223186947405338, + 0.0, + 0.07540080696344376, + 1.0815371610224247, + 0.21276690810918808, + 0.20446178317070007, + 0.20082342624664307, + 0.3444630466401577, + 0.0, + 0.0, + 0.28573308140039444, + 0.2988838329911232, + 0.6454194188117981, + 0.09817634709179401, + 0.15301980450749397, + 0.277976693585515, + 0.6255590468645096, + 0.23797893524169922, + 0.11083434708416462, + 0.06148238107562065, + 0.15223746001720428, + 0.247139073908329, + 0.21801912784576416, + 0.0, + 0.8808226566761732, + 0.031948272138834, + 0.7108884006738663, + 0.05689014494419098, + 0.269880810752511, + 0.0, + 0.029943950474262238, + 0.7360847853124142, + 0.6643581669777632, + 0.33378758281469345, + 0.0, + 0.13770517334342003, + 0.1928314622491598, + 0.1677747182548046, + 0.06601561047136784, + 0.36246815510094166, + 0.32481713965535164, + 0.028817040845751762, + 0.0, + 0.29010653868317604, + 0.0, + 0.12532202526926994, + 0.02139369584619999, + 0.14143009670078754, + 0.07892753928899765, + 1.3982341140508652, + 0.04720627889037132, + 0.09327180869877338, + 0.35821979865431786, + 0.17229572497308254, + 0.31133126467466354, + 0.3167805578559637, + 0.16644510067999363, + 0.04760802909731865, + 0.08308553695678711, + 0.22021272405982018, + 0.11931975185871124, + 0.04345466569066048, + 0.0 + ], + "unique_experts": 55, + "load_cv": 0.8646059575489728, + "normalized_load_entropy": 0.908249118048863, + "max_load_share": 0.05555555555555555 + }, + "full_input": { + "tokens": 83, + "top_k": 6, + "decisions": 498, + "ordered_route_sha256": "939a46b368f93ea27413a47c3bdbfd4496fe8c40890c33b49a7193deb76f2f7b", + "route_weight_sha256": "29d7b196d2baa8daf905d33157eb1e3afaee9dff541e277474199e5bffe3ea7b", + "loads": [ + 7, + 4, + 0, + 13, + 17, + 12, + 4, + 12, + 6, + 2, + 2, + 2, + 6, + 10, + 4, + 18, + 11, + 6, + 15, + 4, + 8, + 5, + 16, + 5, + 1, + 28, + 4, + 13, + 1, + 10, + 0, + 2, + 13, + 5, + 11, + 2, + 7, + 10, + 8, + 7, + 14, + 12, + 3, + 6, + 18, + 1, + 2, + 1, + 4, + 7, + 26, + 1, + 4, + 18, + 5, + 16, + 11, + 11, + 2, + 3, + 15, + 5, + 2, + 0 + ], + "weighted_loads": [ + 0.28849094174802303, + 0.12637247517704964, + 0.0, + 0.8482665233314037, + 1.4992553889751434, + 0.5477591343224049, + 0.2744030598551035, + 0.7781326808035374, + 0.3444630466401577, + 0.23369725048542023, + 0.09789254516363144, + 0.28573308140039444, + 0.356891755014658, + 0.9264747202396393, + 0.15901722945272923, + 1.066339384764433, + 0.5758960042148829, + 0.6255590468645096, + 1.2209044694900513, + 0.14951536618173122, + 0.28073384054005146, + 0.2121748011559248, + 0.9503865167498589, + 0.39175667613744736, + 0.020255209878087044, + 1.705806052312255, + 0.1333278939127922, + 0.8031336050480604, + 0.05689014494419098, + 0.37727685272693634, + 0.0, + 0.05983717367053032, + 0.7852981463074684, + 0.6643581669777632, + 0.4500642530620098, + 0.17897973582148552, + 0.2388020996004343, + 0.44367866590619087, + 0.603333655744791, + 0.32181124575436115, + 0.638974966481328, + 0.4548525735735893, + 0.19727065227925777, + 0.3213338702917099, + 1.070134835317731, + 0.07300540059804916, + 0.12532202526926994, + 0.02139369584619999, + 0.14143009670078754, + 0.4180609732866287, + 2.989957708865404, + 0.04720627889037132, + 0.12994876317679882, + 0.8311343044042587, + 0.17229572497308254, + 1.390243485569954, + 0.40011407993733883, + 0.6994293928146362, + 0.08317334204912186, + 0.11110554821789265, + 1.6207216549664736, + 0.23296735063195229, + 0.1045365259051323, + 0.0 + ], + "unique_experts": 61, + "load_cv": 0.8011117096203161, + "normalized_load_entropy": 0.9232394371528991, + "max_load_share": 0.05622489959839357 + } + }, + "s0_x": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "049aa269cdd4197b49161803f29974c2cc117e68e43c5f62ebaf87afa13b7328", + "route_weight_sha256": "848b3413151116bba24fa45ec574a5e87d0daa7f0ddda1c84d1593545993453d", + "loads": [ + 2, + 4, + 0, + 2, + 10, + 8, + 2, + 3, + 6, + 0, + 1, + 1, + 5, + 9, + 5, + 3, + 7, + 6, + 5, + 2, + 1, + 4, + 6, + 3, + 0, + 13, + 1, + 11, + 1, + 5, + 0, + 2, + 10, + 5, + 7, + 0, + 4, + 3, + 5, + 2, + 10, + 8, + 0, + 0, + 6, + 0, + 1, + 1, + 4, + 3, + 15, + 1, + 3, + 6, + 3, + 5, + 7, + 4, + 2, + 2, + 3, + 3, + 1, + 0 + ], + "weighted_loads": [ + 0.06339692883193493, + 0.1251471471041441, + 0.0, + 0.08188148960471153, + 1.0980488993227482, + 0.3232623692601919, + 0.21257764101028442, + 0.2040197253227234, + 0.34164903312921524, + 0.0, + 0.03262879326939583, + 0.2516413629055023, + 0.34187336824834347, + 0.6300275139510632, + 0.15668177977204323, + 0.09989443607628345, + 0.3538562525063753, + 0.617998642846942, + 0.24198520183563232, + 0.07314775511622429, + 0.027995921671390533, + 0.17824218049645424, + 0.29749008268117905, + 0.22107895463705063, + 0.0, + 0.8238336890935898, + 0.03112535923719406, + 0.7364900447428226, + 0.05568065121769905, + 0.25477609410881996, + 0.0, + 0.06028749234974384, + 0.6162703298032284, + 0.6586687434464693, + 0.2929486557841301, + 0.0, + 0.14659969881176949, + 0.20505904406309128, + 0.17096491158008575, + 0.06634998135268688, + 0.4480785205960274, + 0.2815467957407236, + 0.0, + 0.0, + 0.27979343943297863, + 0.0, + 0.0998612567782402, + 0.023164687678217888, + 0.14511016197502613, + 0.1097292248159647, + 1.5517021678388119, + 0.044204600155353546, + 0.09102272056043148, + 0.292927548289299, + 0.1152764093130827, + 0.33777592331171036, + 0.25174506194889545, + 0.17384248971939087, + 0.08439499884843826, + 0.08270642906427383, + 0.21329384669661522, + 0.12492631748318672, + 0.041318487375974655, + 0.0 + ], + "unique_experts": 55, + "load_cv": 0.861101967620244, + "normalized_load_entropy": 0.9079098879378517, + "max_load_share": 0.05952380952380952 + }, + "full_input": { + "tokens": 67, + "top_k": 6, + "decisions": 402, + "ordered_route_sha256": "a9ae41d43425a8518ee4f81787781782fd548d68eeb37903880ea170c53a88d2", + "route_weight_sha256": "b068ed5558e2a540e82d5e09329b9b405166d52e1e9c569284b0623f28ac33ce", + "loads": [ + 2, + 6, + 0, + 10, + 19, + 10, + 8, + 8, + 6, + 0, + 1, + 1, + 9, + 10, + 6, + 9, + 8, + 6, + 16, + 2, + 5, + 4, + 13, + 3, + 0, + 22, + 2, + 11, + 1, + 8, + 1, + 2, + 10, + 6, + 9, + 0, + 8, + 6, + 6, + 2, + 11, + 9, + 2, + 1, + 16, + 0, + 1, + 1, + 4, + 4, + 23, + 1, + 4, + 12, + 3, + 9, + 8, + 9, + 4, + 2, + 15, + 6, + 1, + 0 + ], + "weighted_loads": [ + 0.06339692883193493, + 0.1863524466753006, + 0.0, + 0.6854914203286171, + 1.6239055134356022, + 0.39873395673930645, + 0.40270812809467316, + 0.491206631064415, + 0.34164903312921524, + 0.0, + 0.03262879326939583, + 0.2516413629055023, + 0.520106490701437, + 0.6576516013592482, + 0.19485993683338165, + 0.44129651971161366, + 0.3921693470329046, + 0.617998642846942, + 1.2360249869525433, + 0.07314775511622429, + 0.17637930624186993, + 0.17824218049645424, + 0.7003312595188618, + 0.22107895463705063, + 0.0, + 1.3148250617086887, + 0.04856386408209801, + 0.7364900447428226, + 0.05568065121769905, + 0.3547309786081314, + 0.053987860679626465, + 0.06028749234974384, + 0.6162703298032284, + 0.6818270608782768, + 0.36533138900995255, + 0.0, + 0.25858613662421703, + 0.29400351643562317, + 0.5355232506990433, + 0.06634998135268688, + 0.5370485186576843, + 0.3243336547166109, + 0.17325162142515182, + 0.036976318806409836, + 0.6232724599540234, + 0.0, + 0.0998612567782402, + 0.023164687678217888, + 0.14511016197502613, + 0.14949124120175838, + 2.517033848911524, + 0.044204600155353546, + 0.1314964834600687, + 0.5953742675483227, + 0.1152764093130827, + 0.7768689058721066, + 0.29635599441826344, + 0.3575409706681967, + 0.14652719907462597, + 0.08270642906427383, + 1.6695351786911488, + 0.3036617152392864, + 0.041318487375974655, + 0.0 + ], + "unique_experts": 58, + "load_cv": 0.8580178603311884, + "normalized_load_entropy": 0.9095256742221287, + "max_load_share": 0.05721393034825871 + } + }, + "s1_x": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "1283024ee57ea7f44cdc90ca6fb3baed5a1694db14610d0c594bfc28013b011a", + "route_weight_sha256": "f53b16101538601d2728dcc90d888f4a5fbaf83b15e99aef59eeea0d31b4b6db", + "loads": [ + 2, + 4, + 0, + 2, + 10, + 7, + 2, + 4, + 7, + 0, + 1, + 1, + 5, + 7, + 1, + 4, + 7, + 6, + 7, + 4, + 3, + 4, + 7, + 3, + 0, + 14, + 1, + 11, + 1, + 5, + 0, + 1, + 11, + 4, + 7, + 0, + 2, + 4, + 7, + 2, + 10, + 6, + 0, + 0, + 8, + 0, + 1, + 1, + 3, + 1, + 17, + 1, + 1, + 10, + 3, + 4, + 7, + 4, + 1, + 2, + 3, + 1, + 0, + 0 + ], + "weighted_loads": [ + 0.054382529109716415, + 0.13307195901870728, + 0.0, + 0.09592517837882042, + 1.1017224825918674, + 0.300318056717515, + 0.206642284989357, + 0.21727127581834793, + 0.35963221080601215, + 0.0, + 0.03556982800364494, + 0.2315167337656021, + 0.3285082168877125, + 0.635710034519434, + 0.031536318361759186, + 0.21512989699840546, + 0.33796005696058273, + 0.6214364990592003, + 0.3122224807739258, + 0.13053477369248867, + 0.09883738681674004, + 0.18661618046462536, + 0.3641771264374256, + 0.21019840613007545, + 0.0, + 0.7926367707550526, + 0.035466331988573074, + 0.7103667557239532, + 0.051330678164958954, + 0.2317792847752571, + 0.0, + 0.032752033323049545, + 0.7077759988605976, + 0.6095021143555641, + 0.29948223382234573, + 0.0, + 0.07810559868812561, + 0.23446215130388737, + 0.23725387640297413, + 0.0716354064643383, + 0.42358631640672684, + 0.22593560069799423, + 0.0, + 0.0, + 0.36426520720124245, + 0.0, + 0.08791247755289078, + 0.024292128160595894, + 0.11592205613851547, + 0.04182187840342522, + 1.447545152157545, + 0.045895081013441086, + 0.0342639721930027, + 0.4059909414499998, + 0.11925048753619194, + 0.27542856335639954, + 0.2716267351061106, + 0.15860223211348057, + 0.045000236481428146, + 0.08336471766233444, + 0.20863094553351402, + 0.05450955033302307, + 0.0, + 0.0 + ], + "unique_experts": 54, + "load_cv": 0.9458772644723543, + "normalized_load_entropy": 0.8920917569426597, + "max_load_share": 0.06746031746031746 + }, + "full_input": { + "tokens": 83, + "top_k": 6, + "decisions": 498, + "ordered_route_sha256": "3b27e34168f19a1d797fa64acd265b418d54046ed1ee718c50a0320807437559", + "route_weight_sha256": "e53233c5e435f7f33eb416a30103456a8e837b197ce406d9cb82b1f314ac8784", + "loads": [ + 7, + 5, + 0, + 14, + 20, + 14, + 5, + 13, + 7, + 2, + 3, + 1, + 8, + 8, + 2, + 18, + 13, + 6, + 18, + 5, + 6, + 7, + 18, + 5, + 2, + 28, + 2, + 15, + 1, + 10, + 0, + 2, + 12, + 4, + 10, + 2, + 5, + 11, + 9, + 6, + 14, + 8, + 2, + 4, + 21, + 1, + 1, + 1, + 3, + 5, + 29, + 1, + 2, + 18, + 3, + 15, + 9, + 12, + 2, + 3, + 16, + 3, + 1, + 0 + ], + "weighted_loads": [ + 0.2872872706502676, + 0.15721256472170353, + 0.0, + 0.9008742533624172, + 1.6580118276178837, + 0.6151148211210966, + 0.31373672001063824, + 0.758097443729639, + 0.35963221080601215, + 0.23369725048542023, + 0.13346237316727638, + 0.2315167337656021, + 0.44221367686986923, + 0.9167653359472752, + 0.0923772007226944, + 1.0872757770121098, + 0.7660519629716873, + 0.6214364990592003, + 1.4102867469191551, + 0.16921579279005527, + 0.2071924451738596, + 0.2797389328479767, + 1.0041864924132824, + 0.38393595442175865, + 0.06460322998464108, + 1.5971160531044006, + 0.05290483683347702, + 0.8432595040649176, + 0.051330678164958954, + 0.3720222320407629, + 0.0, + 0.06264525651931763, + 0.7569893598556519, + 0.6095021143555641, + 0.4043130688369274, + 0.17897973582148552, + 0.17920252494513988, + 0.48903296142816544, + 0.646104333922267, + 0.2701757773756981, + 0.6509146392345428, + 0.3167310319840908, + 0.16023249179124832, + 0.18881665170192719, + 1.1893783900886774, + 0.07300540059804916, + 0.08791247755289078, + 0.024292128160595894, + 0.11592205613851547, + 0.2808828167617321, + 3.0177043974399567, + 0.045895081013441086, + 0.06104136258363724, + 0.7470225673168898, + 0.11925048753619194, + 1.3198676258325577, + 0.363371716812253, + 0.7331461161375046, + 0.08056554943323135, + 0.11138472892343998, + 1.7001635301858187, + 0.15578264743089676, + 0.06108186021447182, + 0.0 + ], + "unique_experts": 61, + "load_cv": 0.8808923630618676, + "normalized_load_entropy": 0.9095878754577127, + "max_load_share": 0.05823293172690763 + } + }, + "s0_period": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "fb045f1a172d15af4a01ea4c2f158eb15d45bad2e3474117fa975db7b43f55ad", + "route_weight_sha256": "75231ee826f0de710c05653a0b4ef9f293f87734a0eb5859dc4fb29718351316", + "loads": [ + 3, + 4, + 0, + 2, + 10, + 8, + 2, + 3, + 6, + 1, + 0, + 1, + 5, + 8, + 3, + 4, + 7, + 6, + 5, + 2, + 2, + 4, + 6, + 3, + 0, + 13, + 1, + 11, + 1, + 5, + 0, + 2, + 11, + 5, + 7, + 0, + 5, + 3, + 4, + 2, + 10, + 7, + 0, + 0, + 6, + 0, + 1, + 1, + 3, + 3, + 16, + 1, + 3, + 7, + 3, + 5, + 7, + 4, + 1, + 2, + 3, + 3, + 1, + 0 + ], + "weighted_loads": [ + 0.10074394010007381, + 0.12101226858794689, + 0.0, + 0.08309141546487808, + 1.102936154231429, + 0.32162246480584145, + 0.2132149413228035, + 0.21425262093544006, + 0.34078508615493774, + 0.026132719591259956, + 0.0, + 0.258595734834671, + 0.34087178483605385, + 0.5876136980950832, + 0.09547640942037106, + 0.14102106355130672, + 0.3512325845658779, + 0.6101797968149185, + 0.24073709174990654, + 0.07443724572658539, + 0.06760448217391968, + 0.18447785265743732, + 0.2890615053474903, + 0.2224448211491108, + 0.0, + 0.8494288120418787, + 0.030564013868570328, + 0.7416718453168869, + 0.05664753541350365, + 0.26170099899172783, + 0.0, + 0.06091761589050293, + 0.6571401190012693, + 0.6707385368645191, + 0.2833098694682121, + 0.0, + 0.1752883493900299, + 0.20827842131257057, + 0.13371851667761803, + 0.07003884017467499, + 0.44760768488049507, + 0.2476199995726347, + 0.0, + 0.0, + 0.29005581699311733, + 0.0, + 0.10280688852071762, + 0.023492518812417984, + 0.10781915858387947, + 0.1063874363899231, + 1.6255946978926659, + 0.04210752621293068, + 0.08967474848031998, + 0.3355773165822029, + 0.11152403801679611, + 0.33357688412070274, + 0.24393992125988007, + 0.17427701875567436, + 0.046933699399232864, + 0.08429457992315292, + 0.2128298208117485, + 0.12628794834017754, + 0.03768865391612053, + 0.0 + ], + "unique_experts": 55, + "load_cv": 0.873881244984178, + "normalized_load_entropy": 0.9069871952504195, + "max_load_share": 0.06349206349206349 + }, + "full_input": { + "tokens": 67, + "top_k": 6, + "decisions": 402, + "ordered_route_sha256": "9007bc06c1e71f7fef656c7d1bb61edbee4e201d87e6a60fd21db330798eeb9b", + "route_weight_sha256": "4e05487595bfd2c2570e973952cdd162003bce0709c6af91260ddb27852da7a4", + "loads": [ + 3, + 6, + 0, + 10, + 19, + 10, + 8, + 9, + 7, + 1, + 0, + 1, + 10, + 8, + 3, + 10, + 8, + 6, + 15, + 2, + 7, + 4, + 13, + 3, + 0, + 22, + 2, + 11, + 1, + 7, + 1, + 2, + 11, + 6, + 9, + 0, + 7, + 6, + 5, + 3, + 12, + 8, + 2, + 1, + 17, + 0, + 1, + 1, + 3, + 4, + 25, + 1, + 4, + 13, + 3, + 8, + 8, + 8, + 3, + 2, + 14, + 7, + 1, + 0 + ], + "weighted_loads": [ + 0.10074394010007381, + 0.18782366812229156, + 0.0, + 0.6867013461887836, + 1.5559589695185423, + 0.397094052284956, + 0.4204849302768707, + 0.6699206940829754, + 0.3856474459171295, + 0.026132719591259956, + 0.0, + 0.258595734834671, + 0.5652497243136168, + 0.5876136980950832, + 0.09547640942037106, + 0.4917778242379427, + 0.3895456790924072, + 0.6101797968149185, + 1.1350254118442535, + 0.07443724572658539, + 0.26034521870315075, + 0.18447785265743732, + 0.6801104359328747, + 0.2224448211491108, + 0.0, + 1.368262005969882, + 0.048002518713474274, + 0.7416718453168869, + 0.05664753541350365, + 0.3315596878528595, + 0.05463065952062607, + 0.06091761589050293, + 0.6571401190012693, + 0.6938968542963266, + 0.3484105207026005, + 0.0, + 0.22180156596004963, + 0.29722289368510246, + 0.49827685579657555, + 0.11100925505161285, + 0.5881468169391155, + 0.290406858548522, + 0.17177671939134598, + 0.036976318806409836, + 0.6662855073809624, + 0.0, + 0.10280688852071762, + 0.023492518812417984, + 0.10781915858387947, + 0.1693332940340042, + 2.616009369492531, + 0.04210752621293068, + 0.13117868825793266, + 0.6309018824249506, + 0.11152403801679611, + 0.7497910372912884, + 0.29180823639035225, + 0.3019523601979017, + 0.11081268452107906, + 0.08429457992315292, + 1.4828100800514221, + 0.3533424325287342, + 0.03768865391612053, + 0.0 + ], + "unique_experts": 58, + "load_cv": 0.8771893478330003, + "normalized_load_entropy": 0.9075250552277025, + "max_load_share": 0.06218905472636816 + } + }, + "s1_period": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "21aa7b7bfaa9e7ba70bc5534dcbc29d0d592d248b16e11d56967a925f8d8b9bc", + "route_weight_sha256": "c524d18713d7be0db1a832d08f8adab16362bb4eb3deb648013dc75a9525b60f", + "loads": [ + 2, + 4, + 0, + 2, + 11, + 6, + 2, + 3, + 6, + 0, + 0, + 1, + 5, + 8, + 1, + 4, + 7, + 6, + 5, + 5, + 2, + 4, + 7, + 3, + 0, + 14, + 1, + 11, + 1, + 4, + 0, + 1, + 11, + 4, + 6, + 0, + 3, + 4, + 6, + 2, + 11, + 7, + 0, + 0, + 8, + 0, + 1, + 1, + 4, + 1, + 18, + 1, + 1, + 9, + 4, + 4, + 8, + 4, + 1, + 2, + 3, + 2, + 0, + 0 + ], + "weighted_loads": [ + 0.05419105291366577, + 0.13329130969941616, + 0.0, + 0.09656047821044922, + 1.1362334117293358, + 0.27808667719364166, + 0.2090200036764145, + 0.2215960994362831, + 0.34659870341420174, + 0.0, + 0.0, + 0.2935490012168884, + 0.33103782311081886, + 0.7121390551328659, + 0.03178791701793671, + 0.20346248894929886, + 0.3480011932551861, + 0.6454198993742466, + 0.2623363360762596, + 0.16323753260076046, + 0.0686988141387701, + 0.19170585088431835, + 0.3277355171740055, + 0.2054091952741146, + 0.0, + 0.9500993266701698, + 0.032985832542181015, + 0.7284428514540195, + 0.05150708183646202, + 0.19790680333971977, + 0.0, + 0.03315616399049759, + 0.7047255989164114, + 0.6254964284598827, + 0.2461717501282692, + 0.0, + 0.10421566106379032, + 0.22778022848069668, + 0.20897682942450047, + 0.06722551211714745, + 0.46648345328867435, + 0.24626459181308746, + 0.0, + 0.0, + 0.35679602436721325, + 0.0, + 0.10493230819702148, + 0.022493138909339905, + 0.14119702391326427, + 0.0434495210647583, + 1.5476172417402267, + 0.043931737542152405, + 0.034181177616119385, + 0.3905985355377197, + 0.1453232504427433, + 0.2775828614830971, + 0.28997922129929066, + 0.14989607222378254, + 0.045250002294778824, + 0.08339470624923706, + 0.20319879800081253, + 0.09002876654267311, + 0.0, + 0.0 + ], + "unique_experts": 53, + "load_cv": 0.9638201894133501, + "normalized_load_entropy": 0.8894291043236644, + "max_load_share": 0.07142857142857142 + }, + "full_input": { + "tokens": 83, + "top_k": 6, + "decisions": 498, + "ordered_route_sha256": "278eb843969fc26301163e52a18719e640c876516970a9606d9cdc516c8e88f0", + "route_weight_sha256": "9ce484f4acc72fbba301e95bb5db590cfc3c57c5a33a0b3b747942e42b8057d4", + "loads": [ + 8, + 5, + 0, + 13, + 20, + 12, + 5, + 13, + 6, + 2, + 2, + 1, + 10, + 9, + 2, + 16, + 12, + 6, + 15, + 6, + 6, + 6, + 18, + 5, + 1, + 28, + 2, + 14, + 1, + 9, + 0, + 2, + 12, + 4, + 8, + 2, + 6, + 12, + 8, + 8, + 16, + 8, + 3, + 4, + 22, + 1, + 1, + 1, + 4, + 6, + 30, + 1, + 2, + 17, + 4, + 16, + 9, + 11, + 2, + 3, + 16, + 5, + 1, + 0 + ], + "weighted_loads": [ + 0.325756436213851, + 0.15743191540241241, + 0.0, + 0.8694261945784092, + 1.5917981564998627, + 0.5358195006847382, + 0.3169029410928488, + 0.8319398388266563, + 0.34659870341420174, + 0.23369725048542023, + 0.09789254516363144, + 0.2935490012168884, + 0.5334691517055035, + 0.9931943565607071, + 0.09262879937887192, + 1.0076275914907455, + 0.6459205038845539, + 0.6454198993742466, + 1.2452618703246117, + 0.20191855169832706, + 0.2168225310742855, + 0.25164319202303886, + 0.9683284386992455, + 0.3791467435657978, + 0.020255209878087044, + 1.7833247669041157, + 0.05042433738708496, + 0.8206880558282137, + 0.05150708183646202, + 0.3360852524638176, + 0.0, + 0.06304938718676567, + 0.7539389599114656, + 0.6254964284598827, + 0.31014691665768623, + 0.17897973582148552, + 0.2053125873208046, + 0.5353693850338459, + 0.6178272869437933, + 0.3475643955171108, + 0.7299492601305246, + 0.29953304305672646, + 0.18754741176962852, + 0.18881665170192719, + 1.2110740058124065, + 0.07300540059804916, + 0.10493230819702148, + 0.022493138909339905, + 0.14119702391326427, + 0.3711264058947563, + 3.1397630386054516, + 0.043931737542152405, + 0.06256888434290886, + 0.7174227945506573, + 0.1453232504427433, + 1.342605121433735, + 0.3355263117700815, + 0.6828803643584251, + 0.08081531524658203, + 0.1114147175103426, + 1.6408435013145208, + 0.22045906260609627, + 0.06108186021447182, + 0.0 + ], + "unique_experts": 61, + "load_cv": 0.8685011718909993, + "normalized_load_entropy": 0.912183067059787, + "max_load_share": 0.060240963855421686 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 42, + "ordered_topk_exact_tokens": 18, + "set_exact_tokens": 24, + "mean_set_jaccard": 0.8633786848072563, + "mean_token_weighted_tv": 0.02483600207294027, + "aggregate_load_tv": 0.07142857142857142 + }, + "system_bos": { + "tokens": 42, + "ordered_topk_exact_tokens": 21, + "set_exact_tokens": 27, + "mean_set_jaccard": 0.8826530612244897, + "mean_token_weighted_tv": 0.021933592501140776, + "aggregate_load_tv": 0.05555555555555555 + }, + "system_x": { + "tokens": 42, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.7896825396825398, + "mean_token_weighted_tv": 0.042606488712841555, + "aggregate_load_tv": 0.09126984126984126 + }, + "system_period": { + "tokens": 42, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.8004535147392291, + "mean_token_weighted_tv": 0.03980384030867191, + "aggregate_load_tv": 0.07539682539682538 + }, + "bos_at_s0": { + "tokens": 42, + "ordered_topk_exact_tokens": 16, + "set_exact_tokens": 21, + "mean_set_jaccard": 0.8063492063492064, + "mean_token_weighted_tv": 0.036733711537505896, + "aggregate_load_tv": 0.07539682539682539 + }, + "bos_at_s1": { + "tokens": 42, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 22, + "mean_set_jaccard": 0.8202947845804988, + "mean_token_weighted_tv": 0.035948274723653285, + "aggregate_load_tv": 0.07936507936507936 + }, + "x_at_s0": { + "tokens": 42, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 18, + "mean_set_jaccard": 0.7828798185941043, + "mean_token_weighted_tv": 0.03975261701270938, + "aggregate_load_tv": 0.08333333333333333 + }, + "x_at_s1": { + "tokens": 42, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 21, + "mean_set_jaccard": 0.8001133786848071, + "mean_token_weighted_tv": 0.04140955112164929, + "aggregate_load_tv": 0.0992063492063492 + }, + "period_at_s0": { + "tokens": 42, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 20, + "mean_set_jaccard": 0.8044217687074832, + "mean_token_weighted_tv": 0.03591602694775377, + "aggregate_load_tv": 0.08333333333333334 + }, + "period_at_s1": { + "tokens": 42, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.7947845804988661, + "mean_token_weighted_tv": 0.041311094825643865, + "aggregate_load_tv": 0.09523809523809523 + } + } + }, + "layer_21": { + "layer": 21, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "dad4e5b7d03ff4d4f71d307e57bae5e705e9786a0e7eeff72e04984e0623cee1", + "route_weight_sha256": "349ac7932e12ddfce67851e5c1a99b8b7a1adf169a5c15c7759ab55cbd17befe", + "loads": [ + 2, + 4, + 1, + 0, + 5, + 3, + 2, + 5, + 8, + 1, + 3, + 3, + 9, + 3, + 0, + 4, + 1, + 6, + 5, + 11, + 1, + 5, + 1, + 1, + 1, + 11, + 8, + 10, + 3, + 0, + 8, + 2, + 0, + 8, + 1, + 4, + 1, + 1, + 3, + 5, + 0, + 6, + 7, + 1, + 10, + 3, + 2, + 1, + 13, + 2, + 0, + 8, + 4, + 15, + 3, + 9, + 3, + 2, + 0, + 4, + 2, + 5, + 1, + 1 + ], + "weighted_loads": [ + 0.1692655012011528, + 0.13208451867103577, + 0.02757539041340351, + 0.0, + 0.16988027468323708, + 0.23039166815578938, + 0.07376913912594318, + 0.3173089735209942, + 0.31123073026537895, + 0.026259511709213257, + 0.14333193935453892, + 0.11929040402173996, + 0.4111188743263483, + 0.13969891890883446, + 0.0, + 0.16619241423904896, + 0.03391166403889656, + 0.20108694955706596, + 0.18820999190211296, + 0.42386108823120594, + 0.058288294821977615, + 0.1838542316108942, + 0.04511406645178795, + 0.11369137465953827, + 0.03200652077794075, + 1.3647749777883291, + 0.6732090637087822, + 0.8305742852389812, + 0.08907195553183556, + 0.0, + 0.2960181962698698, + 0.08050231263041496, + 0.0, + 0.3106793910264969, + 0.026208393275737762, + 0.2700698897242546, + 0.049136340618133545, + 0.028714735060930252, + 0.25151087902486324, + 0.196705499663949, + 0.0, + 0.5307587832212448, + 0.6186790131032467, + 0.056820981204509735, + 0.8351905159652233, + 0.09585929289460182, + 0.12744946032762527, + 0.03778662160038948, + 0.8454728219658136, + 0.07717237249016762, + 0.0, + 0.5435791723430157, + 0.27226419374346733, + 1.060774428769946, + 0.08939171768724918, + 0.5883403830230236, + 0.26835788786411285, + 0.12972749769687653, + 0.0, + 0.15952247381210327, + 0.07846967503428459, + 0.18072579056024551, + 0.033055562525987625, + 0.03964938223361969 + ], + "unique_experts": 57, + "load_cv": 0.8977730630082078, + "normalized_load_entropy": 0.9039933155351443, + "max_load_share": 0.05952380952380952 + }, + "full_input": { + "tokens": 67, + "top_k": 6, + "decisions": 402, + "ordered_route_sha256": "3c4949e4dd4c8231ace40b860cddf4917008f4619ff175beea7ab85e7ea7bfe7", + "route_weight_sha256": "48f7dccaae2f0f9930f647513dd8aebdfe57e32848090d00f13a3d3967e5296c", + "loads": [ + 2, + 4, + 5, + 0, + 13, + 3, + 4, + 5, + 10, + 1, + 11, + 4, + 11, + 7, + 3, + 10, + 2, + 10, + 5, + 16, + 1, + 15, + 1, + 2, + 1, + 12, + 17, + 15, + 6, + 0, + 9, + 2, + 1, + 8, + 2, + 13, + 1, + 1, + 3, + 7, + 2, + 7, + 11, + 1, + 10, + 3, + 2, + 1, + 24, + 4, + 0, + 15, + 13, + 16, + 8, + 10, + 4, + 2, + 5, + 5, + 3, + 5, + 7, + 1 + ], + "weighted_loads": [ + 0.1692655012011528, + 0.13208451867103577, + 0.13144593266770244, + 0.0, + 0.46015218645334244, + 0.23039166815578938, + 0.3224311228841543, + 0.3173089735209942, + 0.43339869007468224, + 0.026259511709213257, + 0.5445066001266241, + 0.1669086068868637, + 0.519788159057498, + 0.4412198178470135, + 0.11145382933318615, + 0.3754244800657034, + 0.04717619717121124, + 0.32472238317131996, + 0.18820999190211296, + 2.0122020300477743, + 0.058288294821977615, + 0.7196212136186659, + 0.04511406645178795, + 0.15807370841503143, + 0.03200652077794075, + 1.400652488693595, + 1.0836432985961437, + 1.2057612463831902, + 0.14800518797710538, + 0.0, + 0.33524408377707005, + 0.08050231263041496, + 0.02282715030014515, + 0.3106793910264969, + 0.07950850203633308, + 0.8218380473554134, + 0.049136340618133545, + 0.028714735060930252, + 0.25151087902486324, + 0.28377037681639194, + 0.08680186420679092, + 0.566767331212759, + 0.8543677292764187, + 0.056820981204509735, + 0.8351905159652233, + 0.09585929289460182, + 0.12744946032762527, + 0.03778662160038948, + 1.4364084992557764, + 0.2390338033437729, + 0.0, + 0.8736672885715961, + 0.8506085500121117, + 1.0737882507964969, + 0.2964561264961958, + 0.7535007111728191, + 0.30955221876502037, + 0.12972749769687653, + 0.1990114375948906, + 0.20346607640385628, + 0.10071444697678089, + 0.18072579056024551, + 0.3238091990351677, + 0.03964938223361969 + ], + "unique_experts": 61, + "load_cv": 0.8440573799053936, + "normalized_load_entropy": 0.9148901614283037, + "max_load_share": 0.05970149253731343 + } + }, + "s1_eos": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "808beca858577a9cc863381c024cce92c4c79944dcd4e25221a02a487e57e247", + "route_weight_sha256": "78d9468844618f76d8b12d9abcd42459b1f42696982711934ea07318d1636d21", + "loads": [ + 2, + 4, + 2, + 0, + 4, + 3, + 2, + 5, + 8, + 1, + 3, + 2, + 9, + 3, + 1, + 5, + 1, + 4, + 3, + 12, + 1, + 3, + 1, + 1, + 1, + 11, + 9, + 10, + 3, + 0, + 9, + 3, + 0, + 7, + 0, + 5, + 1, + 1, + 3, + 5, + 0, + 7, + 7, + 1, + 8, + 3, + 2, + 1, + 11, + 2, + 0, + 8, + 4, + 16, + 5, + 10, + 3, + 2, + 1, + 4, + 3, + 5, + 0, + 1 + ], + "weighted_loads": [ + 0.18694426864385605, + 0.14207009598612785, + 0.0582154244184494, + 0.0, + 0.13386311382055283, + 0.23571906797587872, + 0.08310254290699959, + 0.31228236854076385, + 0.3081424068659544, + 0.026172500103712082, + 0.14825669303536415, + 0.08314786106348038, + 0.4186497051268816, + 0.14249933511018753, + 0.023578602820634842, + 0.1970778852701187, + 0.03303799405694008, + 0.1381477639079094, + 0.13288464397192, + 0.44934229366481304, + 0.057619038969278336, + 0.1278943493962288, + 0.04780705273151398, + 0.10955000668764114, + 0.03197353705763817, + 1.3368422742933035, + 0.6900458578020334, + 0.8710565567016602, + 0.09057116881012917, + 0.0, + 0.3185182213783264, + 0.09616132266819477, + 0.0, + 0.2656757663935423, + 0.0, + 0.2988944686949253, + 0.04934953153133392, + 0.0323990173637867, + 0.24233975820243359, + 0.18998857773840427, + 0.0, + 0.5585765615105629, + 0.6153120286762714, + 0.05509504675865173, + 0.7934027016162872, + 0.0986463762819767, + 0.12269694358110428, + 0.0414704829454422, + 0.762415774166584, + 0.07652201130986214, + 0.0, + 0.5559888631105423, + 0.2705237679183483, + 1.140229593962431, + 0.16727097891271114, + 0.5820952467620373, + 0.2689744532108307, + 0.1306898333132267, + 0.03234811872243881, + 0.17022160440683365, + 0.09932946413755417, + 0.17683152481913567, + 0.0, + 0.04456370323896408 + ], + "unique_experts": 57, + "load_cv": 0.8988949291916044, + "normalized_load_entropy": 0.9048974202599115, + "max_load_share": 0.06349206349206349 + }, + "full_input": { + "tokens": 83, + "top_k": 6, + "decisions": 498, + "ordered_route_sha256": "ede621b48d87432cdac4520c794849a481b9291de8255594551ca2a81f5a68b1", + "route_weight_sha256": "00708890a91695fbf898129bbd1e6bbf29e957f389cc5b9054f544d033ebdd77", + "loads": [ + 10, + 5, + 6, + 0, + 4, + 4, + 6, + 7, + 11, + 3, + 14, + 3, + 13, + 13, + 9, + 8, + 2, + 13, + 5, + 16, + 2, + 12, + 4, + 6, + 2, + 14, + 17, + 20, + 6, + 1, + 14, + 3, + 1, + 12, + 0, + 20, + 2, + 2, + 4, + 7, + 2, + 9, + 16, + 2, + 9, + 4, + 2, + 1, + 22, + 5, + 1, + 18, + 14, + 17, + 18, + 18, + 7, + 2, + 4, + 8, + 4, + 6, + 6, + 2 + ], + "weighted_loads": [ + 0.6971746664494276, + 0.19309665262699127, + 0.7849896312691271, + 0.0, + 0.13386311382055283, + 0.2502994379028678, + 0.2638816833496094, + 0.4258342497050762, + 0.44908701442182064, + 0.1728406883776188, + 0.6962448693811893, + 0.12885484844446182, + 0.6259451303631067, + 0.6792016699910164, + 0.3300994634628296, + 0.28519197925925255, + 0.04630252718925476, + 0.45532204676419497, + 0.18615751340985298, + 1.9851176794618368, + 0.10526561737060547, + 0.638119250535965, + 0.13754519820213318, + 0.5994342975318432, + 0.0669056586921215, + 1.4357989095151424, + 0.9763710293918848, + 1.7445051670074463, + 0.12568768532946706, + 0.049421634525060654, + 0.5150099825114012, + 0.09616132266819477, + 0.0226528812199831, + 0.9041385073214769, + 0.0, + 1.1488128490746021, + 0.12071677297353745, + 0.07316223159432411, + 0.30036852322518826, + 0.27725564129650593, + 0.07521121576428413, + 0.6838500797748566, + 1.0561328865587711, + 0.10196701437234879, + 0.861678846180439, + 0.15623683109879494, + 0.12269694358110428, + 0.0414704829454422, + 1.5837697871029377, + 0.9885476790368557, + 0.05020568519830704, + 1.292383674532175, + 0.8509288355708122, + 1.1532434159889817, + 0.9383504334837198, + 1.1381450146436691, + 0.4234948568046093, + 0.1306898333132267, + 0.17422987893223763, + 0.36849393136799335, + 0.12171371653676033, + 0.23814160004258156, + 0.2670958414673805, + 0.13625900447368622 + ], + "unique_experts": 62, + "load_cv": 0.764182211272264, + "normalized_load_entropy": 0.9281830121526633, + "max_load_share": 0.04417670682730924 + } + }, + "s0_bos": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "403db3d1be282b36bb51f86748912012895c05f1039de4c411d619292d9aec99", + "route_weight_sha256": "7bb76868be53068ef41a9d3d9858a08552f4f4e8a5a6579481c9c0b4685a8327", + "loads": [ + 3, + 5, + 0, + 0, + 4, + 3, + 1, + 5, + 6, + 1, + 5, + 4, + 7, + 3, + 1, + 5, + 2, + 6, + 2, + 10, + 1, + 7, + 1, + 1, + 1, + 10, + 8, + 10, + 3, + 0, + 7, + 2, + 0, + 7, + 0, + 6, + 1, + 0, + 4, + 6, + 1, + 6, + 6, + 2, + 10, + 3, + 2, + 1, + 13, + 2, + 1, + 7, + 4, + 14, + 3, + 9, + 5, + 2, + 1, + 3, + 2, + 5, + 1, + 1 + ], + "weighted_loads": [ + 0.19244546815752983, + 0.1584399715065956, + 0.0, + 0.0, + 0.13714669458568096, + 0.24145358242094517, + 0.045689940452575684, + 0.3089616186916828, + 0.2472386248409748, + 0.03940391167998314, + 0.21259348094463348, + 0.15015635266900063, + 0.3627206161618233, + 0.1428823545575142, + 0.02686344087123871, + 0.2014496773481369, + 0.06711605936288834, + 0.22361240722239017, + 0.09917100891470909, + 0.3786480501294136, + 0.056717339903116226, + 0.2398645617067814, + 0.04621320962905884, + 0.11763910204172134, + 0.03323906287550926, + 1.3483276925981045, + 0.673469539731741, + 0.7306398041546345, + 0.08501982130110264, + 0.0, + 0.27061770111322403, + 0.06423457525670528, + 0.0, + 0.2936910819262266, + 0.0, + 0.31725165992975235, + 0.052863989025354385, + 0.0, + 0.2660439182072878, + 0.22632519714534283, + 0.030630631372332573, + 0.549769688397646, + 0.5556007735431194, + 0.08263376168906689, + 0.8748155385255814, + 0.09770429879426956, + 0.13295802474021912, + 0.038901109248399734, + 0.8110195323824883, + 0.0743246041238308, + 0.028709005564451218, + 0.5074662081897259, + 0.256950918585062, + 1.0483435206115246, + 0.10014265403151512, + 0.5769552439451218, + 0.3420683052390814, + 0.12253779172897339, + 0.02589413896203041, + 0.12610449269413948, + 0.08261597156524658, + 0.17953062243759632, + 0.03580208867788315, + 0.04077180474996567 + ], + "unique_experts": 58, + "load_cv": 0.8409702970761654, + "normalized_load_entropy": 0.9134929093975662, + "max_load_share": 0.05555555555555555 + }, + "full_input": { + "tokens": 67, + "top_k": 6, + "decisions": 402, + "ordered_route_sha256": "99e1b19b7158b35d6bb9e7db7af0725d849537c55eb6658be7cd676424f0b9d9", + "route_weight_sha256": "48ea3c7b01090b011922e20b0edd968b76d45cb57e7d228c02690b94b7b9261f", + "loads": [ + 3, + 6, + 3, + 1, + 10, + 3, + 3, + 5, + 10, + 1, + 11, + 4, + 9, + 7, + 5, + 10, + 3, + 8, + 3, + 13, + 1, + 15, + 1, + 2, + 1, + 11, + 18, + 15, + 5, + 0, + 8, + 5, + 1, + 7, + 1, + 15, + 1, + 0, + 4, + 9, + 5, + 7, + 10, + 2, + 10, + 5, + 2, + 1, + 25, + 5, + 1, + 14, + 13, + 15, + 7, + 10, + 6, + 2, + 4, + 4, + 3, + 5, + 7, + 1 + ], + "weighted_loads": [ + 0.19244546815752983, + 0.20016832277178764, + 0.10809475742280483, + 0.21466460824012756, + 0.35323432087898254, + 0.24145358242094517, + 0.28976789861917496, + 0.3089616186916828, + 0.4384077861905098, + 0.03940391167998314, + 0.5062731616199017, + 0.15015635266900063, + 0.47138990089297295, + 0.39756570756435394, + 0.18072687834501266, + 0.4167133718729019, + 0.08038059249520302, + 0.30531386472284794, + 0.15159190073609352, + 0.9833481162786484, + 0.056717339903116226, + 0.7330111740157008, + 0.04621320962905884, + 0.1620214357972145, + 0.03323906287550926, + 1.3842052035033703, + 1.1347494423389435, + 1.106379508972168, + 0.13953864574432373, + 0.0, + 0.3096187338232994, + 0.3130779732018709, + 0.02282715030014515, + 0.2936910819262266, + 0.05330010876059532, + 0.8690198175609112, + 0.052863989025354385, + 0.0, + 0.2660439182072878, + 0.35130165331065655, + 0.25160317681729794, + 0.5857782363891602, + 0.8019333109259605, + 0.08263376168906689, + 0.8748155385255814, + 0.250243429094553, + 0.13295802474021912, + 0.038901109248399734, + 1.437632367014885, + 0.28099895641207695, + 0.028709005564451218, + 0.8375543244183064, + 0.8352952748537064, + 1.0613573426380754, + 0.22817910462617874, + 0.7421155720949173, + 0.3832626361399889, + 0.12253779172897339, + 0.12006949819624424, + 0.1700480952858925, + 0.10486074350774288, + 0.17953062243759632, + 0.32693488895893097, + 0.04077180474996567 + ], + "unique_experts": 62, + "load_cv": 0.8110368351692092, + "normalized_load_entropy": 0.9231839750605643, + "max_load_share": 0.06218905472636816 + } + }, + "s1_bos": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "bfa1b2b2838809b84877201e9d17d64f08f62a62677750d068b0a35a2f413af5", + "route_weight_sha256": "46f545c02c6b265401224f75effd2d6404c734c639b298647520fcbb54c9319a", + "loads": [ + 3, + 4, + 0, + 0, + 4, + 3, + 2, + 5, + 6, + 1, + 6, + 2, + 8, + 3, + 1, + 5, + 1, + 5, + 3, + 13, + 1, + 3, + 1, + 1, + 1, + 11, + 8, + 10, + 3, + 0, + 7, + 1, + 0, + 7, + 0, + 6, + 1, + 1, + 4, + 6, + 1, + 6, + 8, + 1, + 8, + 4, + 2, + 3, + 12, + 2, + 0, + 8, + 4, + 14, + 4, + 9, + 4, + 2, + 0, + 5, + 2, + 5, + 0, + 1 + ], + "weighted_loads": [ + 0.21709135174751282, + 0.1400377880781889, + 0.0, + 0.0, + 0.13518098182976246, + 0.23416039533913136, + 0.07414481602609158, + 0.3049183748662472, + 0.24414396658539772, + 0.035124726593494415, + 0.23177563957870007, + 0.08851645141839981, + 0.3810403384268284, + 0.1361578069627285, + 0.02547254040837288, + 0.1999397836625576, + 0.036426108330488205, + 0.18550530076026917, + 0.13708187267184258, + 0.4897714089602232, + 0.05843024700880051, + 0.11932963877916336, + 0.04734831303358078, + 0.11364723742008209, + 0.03454785794019699, + 1.362438127398491, + 0.6805028356611729, + 0.7097315900027752, + 0.08499165438115597, + 0.0, + 0.2643624506890774, + 0.03434458002448082, + 0.0, + 0.2963268104940653, + 0.0, + 0.3282620310783386, + 0.05595002695918083, + 0.023842642083764076, + 0.2766334339976311, + 0.21975321136415005, + 0.029691586270928383, + 0.561395276337862, + 0.6583967320621014, + 0.05709417536854744, + 0.806862436234951, + 0.12556052580475807, + 0.12852500192821026, + 0.1003672368824482, + 0.7966625727713108, + 0.07621851935982704, + 0.0, + 0.5405789092183113, + 0.25176549330353737, + 1.0425856746733189, + 0.1310588214546442, + 0.5435735620558262, + 0.30565534718334675, + 0.12751859799027443, + 0.0, + 0.21014103665947914, + 0.07844896614551544, + 0.17796258628368378, + 0.0, + 0.04163939878344536 + ], + "unique_experts": 56, + "load_cv": 0.8715716770344346, + "normalized_load_entropy": 0.9059918603730491, + "max_load_share": 0.05555555555555555 + }, + "full_input": { + "tokens": 83, + "top_k": 6, + "decisions": 498, + "ordered_route_sha256": "b96c6d6ff5835562a661c360f0239f727bcb938af98363da7b5347e941f88b01", + "route_weight_sha256": "44c18a1552e403fa4943f980306f0d43fb8061db13e373d635a610b0c0aa10ce", + "loads": [ + 11, + 6, + 3, + 0, + 7, + 4, + 6, + 8, + 9, + 3, + 15, + 4, + 12, + 12, + 7, + 9, + 2, + 11, + 7, + 16, + 2, + 11, + 4, + 6, + 2, + 14, + 16, + 21, + 5, + 1, + 12, + 2, + 1, + 12, + 0, + 21, + 2, + 2, + 5, + 8, + 3, + 8, + 17, + 2, + 9, + 5, + 2, + 3, + 23, + 5, + 1, + 18, + 14, + 15, + 18, + 17, + 8, + 2, + 2, + 9, + 3, + 6, + 7, + 2 + ], + "weighted_loads": [ + 0.7273217495530844, + 0.2266168501228094, + 0.7274523470550776, + 0.0, + 0.24971150793135166, + 0.24874076526612043, + 0.29925630427896976, + 0.4548559691756964, + 0.38823240250349045, + 0.18179291486740112, + 0.6979700196534395, + 0.17749399691820145, + 0.5883357636630535, + 0.5971935838460922, + 0.2753276377916336, + 0.3666590489447117, + 0.04969064146280289, + 0.4342150017619133, + 0.28887511789798737, + 1.085496550425887, + 0.10607682541012764, + 0.6254777768626809, + 0.13708645850419998, + 0.6035315282642841, + 0.06947997957468033, + 1.4613947626203299, + 0.9668280072510242, + 1.614117570221424, + 0.11574633046984673, + 0.049421634525060654, + 0.46586216054856777, + 0.12533249333500862, + 0.0226528812199831, + 0.9291591327637434, + 0.0, + 1.1781804114580154, + 0.12731726840138435, + 0.06460585631430149, + 0.33466219902038574, + 0.3088406752794981, + 0.11435635574162006, + 0.6866687946021557, + 1.0985393524169922, + 0.10396614298224449, + 0.8751385807991028, + 0.1831509806215763, + 0.12852500192821026, + 0.1003672368824482, + 1.6302808821201324, + 1.0334110297262669, + 0.05020568519830704, + 1.276973720639944, + 0.8321705609560013, + 1.0555994966998696, + 0.943603502586484, + 1.099623329937458, + 0.46017575077712536, + 0.12751859799027443, + 0.05238417163491249, + 0.40841336362063885, + 0.1008332185447216, + 0.23927266150712967, + 0.34273672476410866, + 0.1333347000181675 + ], + "unique_experts": 62, + "load_cv": 0.756034096479408, + "normalized_load_entropy": 0.9302018849861203, + "max_load_share": 0.04618473895582329 + } + }, + "s0_x": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "ae1cdafdf48a77fb62a76403451eac67fa822c8b895768db31156dbad5b675b0", + "route_weight_sha256": "08d69f21767b2656e58b380325f3c3a3a1d8f76fd1da0e4fe8579f7165face66", + "loads": [ + 3, + 4, + 0, + 0, + 4, + 4, + 1, + 5, + 6, + 1, + 5, + 4, + 8, + 3, + 1, + 7, + 2, + 4, + 3, + 8, + 1, + 3, + 1, + 1, + 1, + 12, + 9, + 10, + 3, + 0, + 6, + 2, + 0, + 6, + 0, + 5, + 1, + 0, + 4, + 6, + 1, + 7, + 7, + 2, + 9, + 3, + 2, + 3, + 15, + 4, + 1, + 7, + 4, + 14, + 2, + 10, + 5, + 2, + 0, + 3, + 2, + 4, + 0, + 1 + ], + "weighted_loads": [ + 0.23810037225484848, + 0.1302485354244709, + 0.0, + 0.0, + 0.1364110615104437, + 0.27519798651337624, + 0.04606613889336586, + 0.3025520034134388, + 0.24020941369235516, + 0.03984566405415535, + 0.21691697090864182, + 0.15188587456941605, + 0.39085584320127964, + 0.1451280117034912, + 0.028831874951720238, + 0.2565459609031677, + 0.0653294213116169, + 0.14910420030355453, + 0.12437821552157402, + 0.33102741464972496, + 0.0576624795794487, + 0.11221335642039776, + 0.045004867017269135, + 0.1205395981669426, + 0.03153548762202263, + 1.366168899461627, + 0.6575169675052166, + 0.7350922524929047, + 0.08506461046636105, + 0.0, + 0.23236766085028648, + 0.0668197050690651, + 0.0, + 0.25618236139416695, + 0.0, + 0.2991238720715046, + 0.05013900622725487, + 0.0, + 0.2666789721697569, + 0.2313937544822693, + 0.027491940185427666, + 0.5702742971479893, + 0.5753125511109829, + 0.08066307567059994, + 0.8473633844405413, + 0.09727395698428154, + 0.1316435392946005, + 0.1104277390986681, + 0.8934872727841139, + 0.13027869164943695, + 0.025868570432066917, + 0.5191294588148594, + 0.2680528499186039, + 1.0449184197932482, + 0.06079933978617191, + 0.6165476441383362, + 0.3470523674041033, + 0.12031672522425652, + 0.0, + 0.11421592906117439, + 0.0791265107691288, + 0.15046162530779839, + 0.0, + 0.03964018449187279 + ], + "unique_experts": 56, + "load_cv": 0.873881244984178, + "normalized_load_entropy": 0.9078893857121073, + "max_load_share": 0.05952380952380952 + }, + "full_input": { + "tokens": 67, + "top_k": 6, + "decisions": 402, + "ordered_route_sha256": "48cbbf1f69b745ab05c65bf8ef625b8a69d6164b3b722bbe250d1ae6df4128c7", + "route_weight_sha256": "70667199b0f763ead59c4b3373b8b762210829bd6f322327f6782af9ced4f1c6", + "loads": [ + 3, + 4, + 3, + 0, + 11, + 4, + 4, + 5, + 8, + 1, + 13, + 5, + 12, + 6, + 4, + 12, + 4, + 8, + 3, + 10, + 1, + 10, + 1, + 2, + 1, + 13, + 19, + 15, + 6, + 0, + 7, + 3, + 1, + 6, + 1, + 15, + 1, + 0, + 4, + 8, + 3, + 8, + 14, + 2, + 9, + 3, + 2, + 3, + 29, + 6, + 1, + 14, + 14, + 15, + 7, + 11, + 7, + 2, + 1, + 4, + 3, + 4, + 5, + 1 + ], + "weighted_loads": [ + 0.23810037225484848, + 0.1302485354244709, + 0.10623289830982685, + 0.0, + 0.39998273737728596, + 0.27519798651337624, + 0.3343908190727234, + 0.3025520034134388, + 0.3565520327538252, + 0.03984566405415535, + 0.6058602407574654, + 0.20076176896691322, + 0.562604196369648, + 0.3763454630970955, + 0.13927136361598969, + 0.4545639604330063, + 0.12078048661351204, + 0.3017987683415413, + 0.12437821552157402, + 0.9022663570940495, + 0.0576624795794487, + 0.5635247016325593, + 0.045004867017269135, + 0.16492193192243576, + 0.03153548762202263, + 1.4020464103668928, + 1.1145441234111786, + 1.1099437102675438, + 0.18355493620038033, + 0.0, + 0.26922592520713806, + 0.13043349981307983, + 0.02282715030014515, + 0.25618236139416695, + 0.05330010876059532, + 0.9445409551262856, + 0.05013900622725487, + 0.0, + 0.2666789721697569, + 0.31582901254296303, + 0.1070991326123476, + 0.6062828451395035, + 0.9540626034140587, + 0.08066307567059994, + 0.8473633844405413, + 0.09727395698428154, + 0.1316435392946005, + 0.1104277390986681, + 1.656611606478691, + 0.3048630580306053, + 0.025868570432066917, + 0.8492175750434399, + 1.0382464826107025, + 1.057932241819799, + 0.2210418228060007, + 0.7817079722881317, + 0.4327652435749769, + 0.12031672522425652, + 0.024670977145433426, + 0.1581595316529274, + 0.1013712827116251, + 0.15046162530779839, + 0.22191396355628967, + 0.03964018449187279 + ], + "unique_experts": 61, + "load_cv": 0.8758338730285722, + "normalized_load_entropy": 0.9142720707629098, + "max_load_share": 0.07213930348258707 + } + }, + "s1_x": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "384dd50b2b9bd5d776eb6a8f66765bd0bcfee37c832c4570efa4fe15618b24fd", + "route_weight_sha256": "97bba924a76f631a9d0dce4ebb99ffbdbc3797952f6d65f6e0c4cb4469774b8a", + "loads": [ + 3, + 2, + 0, + 0, + 3, + 4, + 2, + 5, + 5, + 2, + 5, + 2, + 8, + 4, + 1, + 5, + 4, + 3, + 4, + 14, + 1, + 3, + 1, + 1, + 1, + 13, + 8, + 10, + 3, + 0, + 7, + 1, + 0, + 5, + 0, + 6, + 1, + 1, + 4, + 4, + 0, + 7, + 7, + 1, + 8, + 1, + 1, + 4, + 14, + 2, + 0, + 7, + 4, + 16, + 3, + 10, + 4, + 2, + 1, + 3, + 4, + 6, + 0, + 1 + ], + "weighted_loads": [ + 0.26949527114629745, + 0.07303546741604805, + 0.0, + 0.0, + 0.10217390209436417, + 0.28324633464217186, + 0.07696082070469856, + 0.27518508210778236, + 0.2018491979688406, + 0.06866532936692238, + 0.21179374493658543, + 0.08713746815919876, + 0.4029854927212, + 0.19341921247541904, + 0.03262872248888016, + 0.20020859315991402, + 0.1289465744048357, + 0.12767891585826874, + 0.14446857199072838, + 0.5162435565143824, + 0.059812650084495544, + 0.11980036273598671, + 0.047547440975904465, + 0.10794473439455032, + 0.034760236740112305, + 1.3603728041052818, + 0.6443911530077457, + 0.7666457779705524, + 0.0823100097477436, + 0.0, + 0.26419016532599926, + 0.032032039016485214, + 0.0, + 0.19666358083486557, + 0.0, + 0.3290414474904537, + 0.04899243265390396, + 0.02993643656373024, + 0.27041092328727245, + 0.15316809900105, + 0.0, + 0.5706417188048363, + 0.6164372153580189, + 0.053474582731723785, + 0.7915397062897682, + 0.03067140094935894, + 0.10624063014984131, + 0.13906830735504627, + 0.8590567782521248, + 0.07766289636492729, + 0.0, + 0.5469063445925713, + 0.2719717025756836, + 1.1822965275496244, + 0.09744219668209553, + 0.573551133275032, + 0.3235424440354109, + 0.120053019374609, + 0.029650241136550903, + 0.12396053224802017, + 0.12651189789175987, + 0.1991853378713131, + 0.0, + 0.0418645516037941 + ], + "unique_experts": 56, + "load_cv": 0.9362388636862621, + "normalized_load_entropy": 0.8995809669029031, + "max_load_share": 0.06349206349206349 + }, + "full_input": { + "tokens": 83, + "top_k": 6, + "decisions": 498, + "ordered_route_sha256": "f29b3e07bc57d0d95e2afe80a57a41f819b9a066ed318a6bb4624bb7480e4ab8", + "route_weight_sha256": "7be1ea238328e50e700779ad259e012e9a72b4f6622b4a009bb8604790708555", + "loads": [ + 12, + 3, + 2, + 0, + 4, + 6, + 5, + 6, + 8, + 4, + 14, + 3, + 16, + 14, + 9, + 8, + 5, + 8, + 6, + 17, + 2, + 9, + 4, + 8, + 2, + 18, + 16, + 20, + 5, + 1, + 12, + 1, + 1, + 9, + 0, + 22, + 2, + 2, + 5, + 6, + 1, + 11, + 18, + 2, + 9, + 2, + 1, + 4, + 28, + 5, + 1, + 17, + 15, + 17, + 16, + 19, + 8, + 2, + 2, + 7, + 5, + 7, + 4, + 2 + ], + "weighted_loads": [ + 0.8208979647606611, + 0.12406202405691147, + 0.6930954176932573, + 0.0, + 0.13169236294925213, + 0.33381221536546946, + 0.18650060147047043, + 0.3569090999662876, + 0.34292114712297916, + 0.2153335176408291, + 0.6702056247740984, + 0.12950092181563377, + 0.7749639693647623, + 0.7090088594704866, + 0.3387818727642298, + 0.3178563565015793, + 0.14221110753715038, + 0.3348480947315693, + 0.19774144142866135, + 1.1119686979800463, + 0.10745922848582268, + 0.5525910491123796, + 0.13728558644652367, + 0.7117091007530689, + 0.06969235837459564, + 1.5456315223127604, + 0.9307163245975971, + 1.6280493400990963, + 0.11306468583643436, + 0.049421634525060654, + 0.4588511772453785, + 0.032032039016485214, + 0.0226528812199831, + 0.7916240766644478, + 0.0, + 1.2486889250576496, + 0.12035967409610748, + 0.07069965079426765, + 0.3284396883100271, + 0.24696341715753078, + 0.032703448086977005, + 0.8016243353486061, + 1.1566083058714867, + 0.10034655034542084, + 0.85981585085392, + 0.08826185576617718, + 0.10624063014984131, + 0.13906830735504627, + 1.9271420761942863, + 0.9957053773105145, + 0.05020568519830704, + 1.283301156014204, + 1.0584526769816875, + 1.1953103495761752, + 0.8499121200293303, + 1.165260348469019, + 0.4780628476291895, + 0.120053019374609, + 0.054644182324409485, + 0.3222328592091799, + 0.14889615029096603, + 0.260495413094759, + 0.14809297770261765, + 0.13355985283851624 + ], + "unique_experts": 62, + "load_cv": 0.8258555482006319, + "normalized_load_entropy": 0.9195820976339897, + "max_load_share": 0.05622489959839357 + } + }, + "s0_period": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "107a2a543dd23df05a7f8120b0ad421fc6609f713f61b97384b3e047e7ac516f", + "route_weight_sha256": "c03fca72ff4927f5f52c8a6cda9338b40e9fa316efcd250cd9301a65206fbcbe", + "loads": [ + 3, + 4, + 1, + 0, + 4, + 3, + 1, + 5, + 7, + 1, + 4, + 4, + 8, + 3, + 1, + 6, + 2, + 4, + 3, + 9, + 1, + 4, + 1, + 1, + 1, + 13, + 8, + 10, + 3, + 0, + 7, + 2, + 0, + 6, + 0, + 5, + 1, + 1, + 4, + 6, + 1, + 6, + 7, + 2, + 9, + 3, + 2, + 1, + 13, + 3, + 1, + 8, + 4, + 13, + 3, + 10, + 5, + 2, + 0, + 4, + 2, + 5, + 0, + 1 + ], + "weighted_loads": [ + 0.237170722335577, + 0.1339881680905819, + 0.034348659217357635, + 0.0, + 0.1345869041979313, + 0.24598420038819313, + 0.044295214116573334, + 0.3063319995999336, + 0.2712771240621805, + 0.03691167011857033, + 0.1836211271584034, + 0.15097125805914402, + 0.40210204012691975, + 0.15261489897966385, + 0.025878822430968285, + 0.23961549252271652, + 0.0645398311316967, + 0.1464400291442871, + 0.12470778077840805, + 0.3601115234196186, + 0.058689016848802567, + 0.1500664446502924, + 0.04562567546963692, + 0.11796311289072037, + 0.03214698284864426, + 1.4193289447575808, + 0.6152617149055004, + 0.7263453714549541, + 0.08595758862793446, + 0.0, + 0.274923887103796, + 0.06805205345153809, + 0.0, + 0.2523951753973961, + 0.0, + 0.2966179959475994, + 0.053537674248218536, + 0.026744648814201355, + 0.26570322550833225, + 0.2216835767030716, + 0.02687864750623703, + 0.5440566763281822, + 0.5704550594091415, + 0.08136014454066753, + 0.8639819510281086, + 0.10391980595886707, + 0.1351271141320467, + 0.03974379599094391, + 0.8224003873765469, + 0.10302606783807278, + 0.02482791617512703, + 0.5722379945218563, + 0.2570471875369549, + 1.0366861708462238, + 0.09422503411769867, + 0.6318094842135906, + 0.33503382094204426, + 0.12479621917009354, + 0.0, + 0.16275456175208092, + 0.07225969806313515, + 0.18193607963621616, + 0.0, + 0.0393868014216423 + ], + "unique_experts": 58, + "load_cv": 0.8481301591995267, + "normalized_load_entropy": 0.9133524897454994, + "max_load_share": 0.051587301587301584 + }, + "full_input": { + "tokens": 67, + "top_k": 6, + "decisions": 402, + "ordered_route_sha256": "e45d4c00ec6764b444920634e4176f8e553ef832dd650e362d8643662cd9cddb", + "route_weight_sha256": "fa1a3abc61328e362ad941820826876641f994f516816ded0b3235bb93a522d2", + "loads": [ + 3, + 4, + 4, + 0, + 12, + 3, + 5, + 5, + 9, + 1, + 10, + 4, + 11, + 9, + 4, + 11, + 4, + 7, + 3, + 11, + 1, + 11, + 1, + 2, + 1, + 14, + 18, + 15, + 6, + 0, + 8, + 3, + 1, + 7, + 1, + 15, + 1, + 1, + 4, + 8, + 4, + 7, + 12, + 2, + 9, + 3, + 2, + 1, + 26, + 5, + 1, + 16, + 13, + 14, + 8, + 12, + 6, + 2, + 1, + 6, + 3, + 5, + 5, + 1 + ], + "weighted_loads": [ + 0.237170722335577, + 0.1339881680905819, + 0.1396909561008215, + 0.0, + 0.43024246022105217, + 0.24598420038819313, + 0.41384198889136314, + 0.3063319995999336, + 0.38950894959270954, + 0.03691167011857033, + 0.48323066905140877, + 0.15097125805914402, + 0.5484681222587824, + 0.5139815993607044, + 0.14113064855337143, + 0.450243528932333, + 0.12082009017467499, + 0.26393989846110344, + 0.12470778077840805, + 0.9313504658639431, + 0.058689016848802567, + 0.6012522438541055, + 0.04562567546963692, + 0.16234544664621353, + 0.03214698284864426, + 1.4552064556628466, + 1.078557301312685, + 1.0876472182571888, + 0.18031352758407593, + 0.0, + 0.3149673640727997, + 0.14070496708154678, + 0.02282715030014515, + 0.2913265526294708, + 0.05330010876059532, + 0.912500262260437, + 0.053537674248218536, + 0.026744648814201355, + 0.26570322550833225, + 0.3032863512635231, + 0.1408502385020256, + 0.5800652243196964, + 0.8644972294569016, + 0.08136014454066753, + 0.8639819510281086, + 0.10391980595886707, + 0.1351271141320467, + 0.03974379599094391, + 1.541372086852789, + 0.3326298873871565, + 0.02482791617512703, + 0.9611385278403759, + 0.8353915438055992, + 1.0496999928727746, + 0.2536611221730709, + 0.8781352527439594, + 0.3762281518429518, + 0.12479621917009354, + 0.024670977145433426, + 0.2971988469362259, + 0.09450447000563145, + 0.18193607963621616, + 0.23218968883156776, + 0.0393868014216423 + ], + "unique_experts": 62, + "load_cv": 0.8365165311773561, + "normalized_load_entropy": 0.9189022065254654, + "max_load_share": 0.06467661691542288 + } + }, + "s1_period": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "6a89b60ad866a7f083cd523102a5c4b9c43cd7973e15b25bd6580c527aedcdb5", + "route_weight_sha256": "15b1b88d677724138d72529de6babad6d2c0a1b8ba55ee65ca36d19703d2c085", + "loads": [ + 3, + 4, + 2, + 0, + 4, + 5, + 2, + 5, + 5, + 1, + 6, + 3, + 8, + 3, + 0, + 4, + 3, + 3, + 4, + 13, + 1, + 3, + 1, + 1, + 1, + 12, + 8, + 10, + 2, + 0, + 8, + 2, + 0, + 5, + 0, + 6, + 1, + 1, + 4, + 4, + 0, + 8, + 6, + 1, + 8, + 1, + 1, + 2, + 13, + 2, + 0, + 8, + 4, + 15, + 5, + 10, + 4, + 2, + 0, + 5, + 3, + 5, + 0, + 1 + ], + "weighted_loads": [ + 0.2787238359451294, + 0.13360920175909996, + 0.057767828926444054, + 0.0, + 0.13064280897378922, + 0.3234014119952917, + 0.08008011989295483, + 0.2878275699913502, + 0.19778727926313877, + 0.03125843033194542, + 0.25539724342525005, + 0.11474038101732731, + 0.4377547651529312, + 0.1667420156300068, + 0.0, + 0.16488239355385303, + 0.09015328250825405, + 0.13748874142766, + 0.1486104466021061, + 0.4872264564037323, + 0.057285651564598083, + 0.11880459822714329, + 0.04789547249674797, + 0.11358766257762909, + 0.03516831994056702, + 1.38025239482522, + 0.6178482919931412, + 0.6645182929933071, + 0.05926014855504036, + 0.0, + 0.3270829990506172, + 0.0627318937331438, + 0.0, + 0.1949938777834177, + 0.0, + 0.3320929929614067, + 0.046674564480781555, + 0.032929860055446625, + 0.28623312897980213, + 0.15192143619060516, + 0.0, + 0.6198428086936474, + 0.574142150580883, + 0.05393306538462639, + 0.7814662251621485, + 0.03812524303793907, + 0.1144818365573883, + 0.06467264518141747, + 0.8130370900034904, + 0.07831817865371704, + 0.0, + 0.6280656978487968, + 0.2619453966617584, + 1.1274032220244408, + 0.19064156711101532, + 0.6113464832305908, + 0.3441144935786724, + 0.12192549556493759, + 0.0, + 0.19766873866319656, + 0.09539741091430187, + 0.17071112804114819, + 0.0, + 0.042398642748594284 + ], + "unique_experts": 55, + "load_cv": 0.9044833879306905, + "normalized_load_entropy": 0.9014025240480151, + "max_load_share": 0.05952380952380952 + }, + "full_input": { + "tokens": 83, + "top_k": 6, + "decisions": 498, + "ordered_route_sha256": "8475aa1ada3c245a321a6a3d72642e45b5650ed43c6acf3d471ba2991e101f34", + "route_weight_sha256": "e3c4e22a3db25d9042e9aa47142910d6b503c85369440116322c75f09168e78e", + "loads": [ + 11, + 5, + 4, + 0, + 5, + 7, + 7, + 6, + 7, + 3, + 14, + 4, + 14, + 13, + 8, + 6, + 4, + 8, + 7, + 17, + 2, + 9, + 4, + 8, + 2, + 15, + 16, + 20, + 4, + 1, + 13, + 2, + 1, + 10, + 0, + 23, + 2, + 2, + 5, + 6, + 3, + 10, + 17, + 2, + 9, + 2, + 1, + 2, + 26, + 5, + 1, + 19, + 14, + 16, + 20, + 19, + 8, + 2, + 1, + 10, + 4, + 6, + 4, + 2 + ], + "weighted_loads": [ + 0.788954233750701, + 0.18463575839996338, + 0.7508632466197014, + 0.0, + 0.17096396163105965, + 0.379062726162374, + 0.2944509368389845, + 0.3695515878498554, + 0.29957486875355244, + 0.17792661860585213, + 0.6772021632641554, + 0.1673486102372408, + 0.7349624149501324, + 0.6809615343809128, + 0.3248995468020439, + 0.24447582103312016, + 0.10341781564056873, + 0.34465792030096054, + 0.2468549720942974, + 1.1133720725774765, + 0.10493222996592522, + 0.5515952846035361, + 0.13763361796736717, + 0.7256583608686924, + 0.07010044157505035, + 1.479209030047059, + 0.9041734635829926, + 1.491304311901331, + 0.09001482464373112, + 0.049421634525060654, + 0.518636105582118, + 0.0627318937331438, + 0.0226528812199831, + 0.8289792034775019, + 0.0, + 1.264474492520094, + 0.11804180592298508, + 0.07369307428598404, + 0.3442618940025568, + 0.261673029512167, + 0.10462373495101929, + 0.745116326957941, + 1.1547060795128345, + 0.10080503299832344, + 0.8497423697263002, + 0.09571569785475731, + 0.1144818365573883, + 0.06467264518141747, + 1.7371334619820118, + 1.0791426450014114, + 0.05020568519830704, + 1.4297482930123806, + 0.8423504643142223, + 1.1404170440509915, + 1.0237691309303045, + 1.2119912579655647, + 0.498634897172451, + 0.12192549556493759, + 0.02499394118785858, + 0.4661881420761347, + 0.11778166331350803, + 0.23202120326459408, + 0.15201923996210098, + 0.13409394398331642 + ], + "unique_experts": 62, + "load_cv": 0.8107179488100046, + "normalized_load_entropy": 0.922512779402028, + "max_load_share": 0.05220883534136546 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 42, + "ordered_topk_exact_tokens": 21, + "set_exact_tokens": 26, + "mean_set_jaccard": 0.8809523809523809, + "mean_token_weighted_tv": 0.022040680050849915, + "aggregate_load_tv": 0.05952380952380952 + }, + "system_bos": { + "tokens": 42, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 22, + "mean_set_jaccard": 0.8435374149659864, + "mean_token_weighted_tv": 0.026174433351982208, + "aggregate_load_tv": 0.07142857142857142 + }, + "system_x": { + "tokens": 42, + "ordered_topk_exact_tokens": 8, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.7738095238095238, + "mean_token_weighted_tv": 0.0388848702645018, + "aggregate_load_tv": 0.0992063492063492 + }, + "system_period": { + "tokens": 42, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.7902494331065759, + "mean_token_weighted_tv": 0.039275824247548975, + "aggregate_load_tv": 0.09126984126984125 + }, + "bos_at_s0": { + "tokens": 42, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 18, + "mean_set_jaccard": 0.7981859410430839, + "mean_token_weighted_tv": 0.034377910573745056, + "aggregate_load_tv": 0.07936507936507936 + }, + "bos_at_s1": { + "tokens": 42, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 25, + "mean_set_jaccard": 0.8650793650793651, + "mean_token_weighted_tv": 0.027331269457049313, + "aggregate_load_tv": 0.06746031746031746 + }, + "x_at_s0": { + "tokens": 42, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.7704081632653063, + "mean_token_weighted_tv": 0.03841280748712875, + "aggregate_load_tv": 0.1111111111111111 + }, + "x_at_s1": { + "tokens": 42, + "ordered_topk_exact_tokens": 8, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.7766439909297053, + "mean_token_weighted_tv": 0.04177317961252162, + "aggregate_load_tv": 0.09920634920634921 + }, + "period_at_s0": { + "tokens": 42, + "ordered_topk_exact_tokens": 16, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.8038548752834467, + "mean_token_weighted_tv": 0.03498569576601897, + "aggregate_load_tv": 0.07539682539682539 + }, + "period_at_s1": { + "tokens": 42, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 20, + "mean_set_jaccard": 0.8044217687074832, + "mean_token_weighted_tv": 0.04091273390111469, + "aggregate_load_tv": 0.07936507936507936 + } + } + }, + "layer_22": { + "layer": 22, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "67c74db88bb580d90ddc3f9d36c3158531799ec3a31c34944f2eed3c9329daaf", + "route_weight_sha256": "293ebb9711b814542e11f11aa6fc21e1dbf90efca6c6e987e4c0444816ee0456", + "loads": [ + 6, + 2, + 2, + 9, + 5, + 9, + 2, + 3, + 11, + 8, + 1, + 3, + 1, + 0, + 5, + 3, + 1, + 5, + 1, + 5, + 9, + 10, + 1, + 7, + 4, + 3, + 3, + 1, + 2, + 3, + 1, + 0, + 4, + 5, + 1, + 4, + 1, + 4, + 1, + 2, + 2, + 3, + 3, + 0, + 1, + 2, + 4, + 6, + 5, + 4, + 7, + 1, + 8, + 4, + 4, + 11, + 0, + 2, + 3, + 1, + 10, + 13, + 5, + 5 + ], + "weighted_loads": [ + 0.49362510815262794, + 0.08295994251966476, + 0.18956726789474487, + 0.6526595503091812, + 0.215379536151886, + 0.3412065710872412, + 0.08726733550429344, + 0.09284015372395515, + 0.6593791916966438, + 0.9734396263957024, + 0.14513741433620453, + 0.15145896933972836, + 0.06126130744814873, + 0.0, + 0.28153460659086704, + 0.10809017904102802, + 0.06557708978652954, + 0.2062985636293888, + 0.029520228505134583, + 0.24598991870880127, + 0.35087996535003185, + 0.7795483395457268, + 0.03568889945745468, + 0.3229797836393118, + 0.13538891449570656, + 0.09946096688508987, + 0.15291578695178032, + 0.029655173420906067, + 0.10743478685617447, + 0.09141419269144535, + 0.03505830094218254, + 0.0, + 0.15882342867553234, + 0.17503764294087887, + 0.039011575281620026, + 0.1367949303239584, + 0.08111607283353806, + 0.1300652790814638, + 0.03607936203479767, + 0.07612846419215202, + 0.167333222925663, + 0.16737911850214005, + 0.13187550753355026, + 0.0, + 0.030284501612186432, + 0.06540563516318798, + 0.28366681933403015, + 0.23427273333072662, + 0.18443642929196358, + 0.17760368064045906, + 0.5354817286133766, + 0.057097963988780975, + 0.4165261797606945, + 0.1319938264787197, + 0.17323322221636772, + 0.6155420131981373, + 0.0, + 0.11200365424156189, + 0.11937155574560165, + 0.033121488988399506, + 0.9682821221649647, + 0.7581741288304329, + 0.20429154485464096, + 0.1814211755990982 + ], + "unique_experts": 60, + "load_cv": 0.7864755010690473, + "normalized_load_entropy": 0.9259531492109845, + "max_load_share": 0.051587301587301584 + }, + "full_input": { + "tokens": 67, + "top_k": 6, + "decisions": 402, + "ordered_route_sha256": "9b736b38f3ab075294c60a00cefd80d0057f2c150423b6c34476d4d7880211de", + "route_weight_sha256": "d8d89cea541a5328a201f951ee4f164597e8228e285519a2877a22351677cae5", + "loads": [ + 10, + 2, + 5, + 18, + 5, + 12, + 6, + 3, + 26, + 13, + 1, + 6, + 1, + 0, + 10, + 3, + 1, + 7, + 1, + 6, + 10, + 16, + 2, + 7, + 4, + 5, + 3, + 6, + 2, + 3, + 3, + 0, + 7, + 11, + 2, + 6, + 1, + 6, + 1, + 2, + 6, + 4, + 8, + 0, + 1, + 3, + 5, + 6, + 10, + 6, + 10, + 1, + 9, + 6, + 4, + 24, + 3, + 3, + 3, + 1, + 19, + 20, + 5, + 12 + ], + "weighted_loads": [ + 0.6684287469834089, + 0.08295994251966476, + 0.2972671091556549, + 2.5272860378026962, + 0.215379536151886, + 0.4379420215263963, + 0.3131222249940038, + 0.09284015372395515, + 1.9221516158431768, + 1.1741756834089756, + 0.14513741433620453, + 0.2057577520608902, + 0.06126130744814873, + 0.0, + 1.2443838664330542, + 0.10809017904102802, + 0.06557708978652954, + 0.2814102880656719, + 0.029520228505134583, + 0.2817145064473152, + 0.39959884248673916, + 1.2426438424736261, + 0.06622232310473919, + 0.3229797836393118, + 0.13538891449570656, + 0.16264337860047817, + 0.15291578695178032, + 0.2107062228024006, + 0.10743478685617447, + 0.09141419269144535, + 0.1058178823441267, + 0.0, + 0.23610001150518656, + 0.3947078716009855, + 0.10731405019760132, + 0.2683811690658331, + 0.08111607283353806, + 0.21325811930000782, + 0.03607936203479767, + 0.07612846419215202, + 0.41752561554312706, + 0.2074122168123722, + 0.4213932938873768, + 0.0, + 0.030284501612186432, + 0.08889256417751312, + 0.32528554275631905, + 0.23427273333072662, + 0.38350073620676994, + 0.35946888104081154, + 0.6950366944074631, + 0.057097963988780975, + 0.5485160313546658, + 0.19603046029806137, + 0.17323322221636772, + 1.7294965162873268, + 0.12428704649209976, + 0.1376250833272934, + 0.11937155574560165, + 0.033121488988399506, + 2.181350402534008, + 1.0128946658223867, + 0.20429154485464096, + 0.5161429215222597 + ], + "unique_experts": 61, + "load_cv": 0.907806843179294, + "normalized_load_entropy": 0.9119177965473386, + "max_load_share": 0.06467661691542288 + } + }, + "s1_eos": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "020e6e0bcb5079b084bbf6b8af4fd10b38420ac5a739c5f79298b48c1ea44654", + "route_weight_sha256": "0b41d1e8432fe21a92d8fe244b0fffabdc28ae44e1e51111017d2486c7c8ed97", + "loads": [ + 7, + 2, + 2, + 9, + 5, + 9, + 3, + 4, + 12, + 8, + 1, + 2, + 1, + 0, + 5, + 5, + 1, + 3, + 1, + 7, + 9, + 10, + 1, + 7, + 3, + 2, + 1, + 0, + 2, + 1, + 1, + 3, + 4, + 5, + 2, + 3, + 1, + 4, + 1, + 2, + 2, + 3, + 2, + 1, + 2, + 2, + 4, + 6, + 5, + 3, + 8, + 1, + 8, + 4, + 5, + 8, + 0, + 2, + 3, + 1, + 10, + 13, + 4, + 6 + ], + "weighted_loads": [ + 0.5242430940270424, + 0.07265890017151833, + 0.18631114810705185, + 0.6231009103357792, + 0.22009695321321487, + 0.3271261602640152, + 0.11362062022089958, + 0.13158982805907726, + 0.7127619087696075, + 0.9435832016170025, + 0.14736774563789368, + 0.1313224844634533, + 0.06041854992508888, + 0.0, + 0.30059664696455, + 0.1776423081755638, + 0.06613793969154358, + 0.14360891468822956, + 0.027805542573332787, + 0.29850723035633564, + 0.3477944489568472, + 0.7612574361264706, + 0.03532993420958519, + 0.3387241642922163, + 0.11231609061360359, + 0.0735584981739521, + 0.0818500816822052, + 0.0, + 0.10862378776073456, + 0.03121134452521801, + 0.03515123948454857, + 0.08077369257807732, + 0.15555881336331367, + 0.1906401887536049, + 0.08286260440945625, + 0.10731739178299904, + 0.0781625434756279, + 0.14056484773755074, + 0.03694375231862068, + 0.07717601954936981, + 0.1679001748561859, + 0.16697949543595314, + 0.09858182072639465, + 0.025624681264162064, + 0.052373047918081284, + 0.06466922909021378, + 0.2804194800555706, + 0.24377001821994781, + 0.1867132354527712, + 0.1380087062716484, + 0.553277475759387, + 0.058111123740673065, + 0.4344160258769989, + 0.14165691845119, + 0.21261930838227272, + 0.5252843610942364, + 0.0, + 0.11459685862064362, + 0.1319836601614952, + 0.033225491642951965, + 0.968490969389677, + 0.7735273651778698, + 0.16570731066167355, + 0.2184018474072218 + ], + "unique_experts": 61, + "load_cv": 0.7890341918499408, + "normalized_load_entropy": 0.9268861052943181, + "max_load_share": 0.051587301587301584 + }, + "full_input": { + "tokens": 83, + "top_k": 6, + "decisions": 498, + "ordered_route_sha256": "0fa28b3d495327a3afcda36530f23292ba05820daf5467ba07eb17d77c8dcc28", + "route_weight_sha256": "2211331ed1d968a417961e2f5533198c62f48de97f31a66835031f59ddcd9257", + "loads": [ + 10, + 7, + 2, + 20, + 5, + 12, + 8, + 5, + 34, + 17, + 1, + 7, + 4, + 0, + 10, + 9, + 4, + 7, + 2, + 7, + 11, + 24, + 3, + 7, + 3, + 3, + 1, + 2, + 3, + 1, + 2, + 3, + 6, + 15, + 9, + 8, + 3, + 7, + 1, + 3, + 13, + 4, + 7, + 3, + 2, + 3, + 5, + 8, + 11, + 5, + 17, + 4, + 15, + 6, + 5, + 28, + 4, + 2, + 6, + 1, + 25, + 23, + 5, + 10 + ], + "weighted_loads": [ + 0.6764907501637936, + 0.5454235300421715, + 0.18631114810705185, + 2.760654430836439, + 0.22009695321321487, + 0.4185924483463168, + 0.39322077482938766, + 0.17292293347418308, + 2.50769772939384, + 1.4216054528951645, + 0.14736774563789368, + 0.43697773292660713, + 0.2003544121980667, + 0.0, + 1.025537258014083, + 0.4150959625840187, + 0.2086438536643982, + 0.2563785593956709, + 0.06725397147238255, + 0.29850723035633564, + 0.4522213991731405, + 1.795552734285593, + 0.10618547163903713, + 0.3387241642922163, + 0.11231609061360359, + 0.09912380762398243, + 0.0818500816822052, + 0.08316656202077866, + 0.1911729797720909, + 0.03121134452521801, + 0.08832728862762451, + 0.08077369257807732, + 0.21026490489020944, + 0.5376574397087097, + 0.39530364982783794, + 0.32727865502238274, + 0.16849609091877937, + 0.23906363919377327, + 0.03694375231862068, + 0.12275490909814835, + 0.8875961359590292, + 0.19226709939539433, + 0.44916724786162376, + 0.16193877533078194, + 0.052373047918081284, + 0.10082622244954109, + 0.31606239080429077, + 0.3120893556624651, + 0.42061989568173885, + 0.594526544213295, + 0.9996544420719147, + 0.25989074632525444, + 1.1375785749405622, + 0.23547926358878613, + 0.21261930838227272, + 2.214165458921343, + 0.2133721262216568, + 0.11459685862064362, + 0.20404993137344718, + 0.033225491642951965, + 2.9982113502919674, + 1.1972374729812145, + 0.19621234759688377, + 0.481564162299037 + ], + "unique_experts": 63, + "load_cv": 0.911982670743045, + "normalized_load_entropy": 0.9160689559047163, + "max_load_share": 0.06827309236947791 + } + }, + "s0_bos": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "11c2f08a505cbe43be9473fbee2aef8c166863fa76f36b0effe1d60d4dff0386", + "route_weight_sha256": "b8daaa487618c986602dfc98b25b25184d93e3699d68a425dd787f07972ab7d0", + "loads": [ + 6, + 3, + 2, + 8, + 5, + 10, + 3, + 2, + 12, + 8, + 1, + 2, + 1, + 0, + 7, + 3, + 1, + 6, + 1, + 6, + 6, + 9, + 1, + 5, + 5, + 2, + 3, + 2, + 2, + 3, + 1, + 2, + 3, + 7, + 0, + 5, + 1, + 3, + 1, + 1, + 2, + 2, + 3, + 0, + 2, + 2, + 5, + 7, + 4, + 4, + 7, + 1, + 8, + 5, + 3, + 10, + 0, + 2, + 3, + 1, + 9, + 12, + 6, + 5 + ], + "weighted_loads": [ + 0.49088216945528984, + 0.11060996726155281, + 0.19842873513698578, + 0.5602709464728832, + 0.2218642570078373, + 0.37526993453502655, + 0.11828376911580563, + 0.06818840280175209, + 0.7084041703492403, + 0.9791258163750172, + 0.11659237742424011, + 0.1353895291686058, + 0.06151113659143448, + 0.0, + 0.36705278791487217, + 0.11140786297619343, + 0.06495317071676254, + 0.2636942192912102, + 0.03118470311164856, + 0.2641237508505583, + 0.25277309492230415, + 0.7301825471222401, + 0.034671466797590256, + 0.26334789022803307, + 0.16378984041512012, + 0.07122479006648064, + 0.1435941867530346, + 0.07056938298046589, + 0.10665500536561012, + 0.09626574255526066, + 0.03143441304564476, + 0.05192120373249054, + 0.12663961201906204, + 0.2554728575050831, + 0.0, + 0.17383822798728943, + 0.08494629710912704, + 0.09943529590964317, + 0.036815840750932693, + 0.04385413974523544, + 0.1787262186408043, + 0.14206811413168907, + 0.13199076801538467, + 0.0, + 0.06445551291108131, + 0.06190227158367634, + 0.3316669724881649, + 0.2576892953366041, + 0.15081810764968395, + 0.18449629098176956, + 0.5048535205423832, + 0.056545332074165344, + 0.43658386915922165, + 0.18369215168058872, + 0.13558100163936615, + 0.5849766656756401, + 0.0, + 0.11730698496103287, + 0.11919420585036278, + 0.03506840020418167, + 0.9438165463507175, + 0.7058951072394848, + 0.2396784983575344, + 0.18763470835983753 + ], + "unique_experts": 60, + "load_cv": 0.7656982282661802, + "normalized_load_entropy": 0.9284173661369195, + "max_load_share": 0.047619047619047616 + }, + "full_input": { + "tokens": 67, + "top_k": 6, + "decisions": 402, + "ordered_route_sha256": "b16e1df5736680a20ae5b21b48664bab186ec1c89c94ace6ec09de782f39e6ea", + "route_weight_sha256": "a93114e73708927a74a87023d66d09f66070b63fd3904328aa71bf77358b5441", + "loads": [ + 10, + 4, + 5, + 16, + 5, + 11, + 6, + 3, + 25, + 13, + 2, + 3, + 1, + 0, + 9, + 4, + 1, + 7, + 1, + 7, + 7, + 15, + 2, + 5, + 6, + 4, + 3, + 8, + 2, + 4, + 2, + 2, + 5, + 13, + 1, + 9, + 1, + 7, + 1, + 1, + 6, + 3, + 8, + 0, + 2, + 3, + 6, + 7, + 10, + 6, + 9, + 1, + 10, + 6, + 3, + 23, + 3, + 4, + 4, + 1, + 19, + 19, + 6, + 12 + ], + "weighted_loads": [ + 0.6656858082860708, + 0.15482283756136894, + 0.3061285763978958, + 1.5436049215495586, + 0.2218642570078373, + 0.38786329980939627, + 0.33300807513296604, + 0.9944156743586063, + 1.8827859107404947, + 1.1798618733882904, + 0.13299926184117794, + 0.1478404514491558, + 0.06151113659143448, + 0.0, + 1.3483319524675608, + 0.1552609894424677, + 0.06495317071676254, + 0.2894316501915455, + 0.03118470311164856, + 0.29284921661019325, + 0.2992432303726673, + 1.1880282517522573, + 0.06520489044487476, + 0.26334789022803307, + 0.16763665666803718, + 0.13440720178186893, + 0.1435941867530346, + 0.28464145585894585, + 0.10665500536561012, + 0.14086289145052433, + 0.05200536921620369, + 0.05192120373249054, + 0.19739243388175964, + 0.47514308616518974, + 0.06830247491598129, + 0.36443307623267174, + 0.08494629710912704, + 0.27523813769221306, + 0.036815840750932693, + 0.04385413974523544, + 0.42822976782917976, + 0.2247139923274517, + 0.3012240552343428, + 0.0, + 0.06445551291108131, + 0.08538920059800148, + 0.3732856959104538, + 0.2576892953366041, + 0.45448413118720055, + 0.30634444765746593, + 0.6203779093921185, + 0.056545332074165344, + 0.6034191194921732, + 0.22164595685899258, + 0.13558100163936615, + 1.7178985513746738, + 0.12428704649209976, + 0.15055190538987517, + 0.13966859318315983, + 0.03506840020418167, + 2.1434142664074898, + 0.9606156442314386, + 0.2396784983575344, + 0.4722008667886257 + ], + "unique_experts": 62, + "load_cv": 0.8662861660514048, + "normalized_load_entropy": 0.918938920227684, + "max_load_share": 0.06218905472636816 + } + }, + "s1_bos": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "07b79a9702d9c1c6f3119fa58243cc86d687f1aed64fc15f51402f3889913074", + "route_weight_sha256": "5985f14fc8827e93713dbb6d5b51b25ddcd9990c41539223bb9ca05499fe7ccf", + "loads": [ + 6, + 0, + 2, + 9, + 5, + 10, + 2, + 3, + 11, + 8, + 1, + 3, + 1, + 0, + 5, + 3, + 1, + 4, + 1, + 6, + 7, + 9, + 1, + 6, + 5, + 4, + 2, + 2, + 2, + 2, + 1, + 3, + 4, + 5, + 1, + 4, + 1, + 3, + 1, + 1, + 2, + 2, + 4, + 1, + 3, + 1, + 5, + 7, + 5, + 3, + 7, + 1, + 7, + 5, + 4, + 10, + 0, + 2, + 3, + 1, + 9, + 12, + 6, + 7 + ], + "weighted_loads": [ + 0.4924388937652111, + 0.0, + 0.19394232332706451, + 0.6405345648527145, + 0.2208361066877842, + 0.3545211125165224, + 0.09344368055462837, + 0.0951572060585022, + 0.6719021443277597, + 0.9446362145245075, + 0.12235163152217865, + 0.15603126026690006, + 0.061001259833574295, + 0.0, + 0.2938800510019064, + 0.107413399964571, + 0.06513524055480957, + 0.20968203619122505, + 0.02925024926662445, + 0.26425064727663994, + 0.3090817518532276, + 0.7305526025593281, + 0.032758086919784546, + 0.301704827696085, + 0.1692168489098549, + 0.13655612990260124, + 0.11616206169128418, + 0.060412222519516945, + 0.10697881877422333, + 0.05896333046257496, + 0.03062715008854866, + 0.08307990618050098, + 0.16309397481381893, + 0.2117556631565094, + 0.0488104522228241, + 0.1396597921848297, + 0.08243516832590103, + 0.09923888184130192, + 0.03867170214653015, + 0.04245193302631378, + 0.16994643956422806, + 0.1408393532037735, + 0.16088133677840233, + 0.024587184190750122, + 0.09209864027798176, + 0.030404722318053246, + 0.3238861672580242, + 0.2712555732578039, + 0.19059478677809238, + 0.13909174129366875, + 0.5233820416033268, + 0.054392654448747635, + 0.40662526711821556, + 0.17411802522838116, + 0.19624652713537216, + 0.5781574286520481, + 0.0, + 0.11994428187608719, + 0.12735999003052711, + 0.036441169679164886, + 0.9154376871883869, + 0.7152670361101627, + 0.22531516291201115, + 0.24960553832352161 + ], + "unique_experts": 61, + "load_cv": 0.7524211361581797, + "normalized_load_entropy": 0.9309335981110687, + "max_load_share": 0.047619047619047616 + }, + "full_input": { + "tokens": 83, + "top_k": 6, + "decisions": 498, + "ordered_route_sha256": "eca0471cddd10548dea1d911ca5ba3d7338d2dd72ef09b59b0e5bf094a6135e3", + "route_weight_sha256": "3e55cb99146816a7f8e2818fe04088402eb374f7cc4a418b61f1a543df483ef1", + "loads": [ + 9, + 4, + 2, + 20, + 5, + 12, + 6, + 4, + 33, + 17, + 1, + 9, + 4, + 0, + 9, + 8, + 4, + 7, + 2, + 7, + 9, + 21, + 3, + 6, + 5, + 5, + 2, + 5, + 3, + 2, + 1, + 3, + 5, + 14, + 8, + 11, + 3, + 6, + 1, + 2, + 13, + 3, + 9, + 3, + 3, + 1, + 6, + 9, + 13, + 6, + 15, + 4, + 14, + 8, + 4, + 30, + 4, + 2, + 5, + 1, + 25, + 22, + 7, + 13 + ], + "weighted_loads": [ + 0.6446865499019623, + 0.43301864713430405, + 0.19394232332706451, + 1.909973843023181, + 0.2208361066877842, + 0.3941333247348666, + 0.36317090690135956, + 0.13649031147360802, + 2.445120496675372, + 1.4226584658026695, + 0.12235163152217865, + 0.5249679312109947, + 0.20093712210655212, + 0.0, + 1.0059640891849995, + 0.38797055557370186, + 0.20764115452766418, + 0.2952803298830986, + 0.06869867816567421, + 0.29136947356164455, + 0.4093264676630497, + 1.6859011892229319, + 0.10770638659596443, + 0.301704827696085, + 0.1692168489098549, + 0.16212143935263157, + 0.11616206169128418, + 0.18460494093596935, + 0.18952801078557968, + 0.05896333046257496, + 0.03062715008854866, + 0.08307990618050098, + 0.21170773170888424, + 0.5340326353907585, + 0.3612514976412058, + 0.452753271907568, + 0.1727687157690525, + 0.2222635168582201, + 0.03867170214653015, + 0.08803082257509232, + 0.8920771721750498, + 0.16612695716321468, + 0.5134904384613037, + 0.16090127825737, + 0.09209864027798176, + 0.030404722318053246, + 0.3595290780067444, + 0.3395749107003212, + 0.595507737249136, + 0.6696191020309925, + 0.9247919227927923, + 0.256172277033329, + 1.1116214469075203, + 0.323633024469018, + 0.19624652713537216, + 2.2876587491482496, + 0.2133721262216568, + 0.11994428187608719, + 0.19438625872135162, + 0.036441169679164886, + 3.0009207613766193, + 1.1389771439135075, + 0.2558201998472214, + 0.6256191227585077 + ], + "unique_experts": 63, + "load_cv": 0.8945552126973804, + "normalized_load_entropy": 0.918614512896142, + "max_load_share": 0.06626506024096386 + } + }, + "s0_x": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "a6c71a2a295adf007d1e7ac7e7e03c59fa213c9972310c9c65660a8c6a490fd4", + "route_weight_sha256": "d47ee856ddb7038d79b74bc70dc23cb9d26b4f04e21b53d017377f06a4979989", + "loads": [ + 6, + 2, + 2, + 8, + 5, + 12, + 2, + 3, + 11, + 8, + 1, + 2, + 1, + 0, + 8, + 5, + 1, + 4, + 1, + 5, + 8, + 9, + 1, + 6, + 3, + 3, + 3, + 2, + 2, + 2, + 1, + 3, + 4, + 4, + 1, + 4, + 1, + 3, + 1, + 1, + 3, + 2, + 3, + 0, + 2, + 1, + 5, + 7, + 3, + 4, + 8, + 1, + 7, + 5, + 3, + 12, + 1, + 1, + 2, + 1, + 10, + 12, + 6, + 4 + ], + "weighted_loads": [ + 0.48774899542331696, + 0.07976510003209114, + 0.20183546841144562, + 0.6206130906939507, + 0.20931577309966087, + 0.43559986911714077, + 0.0878269225358963, + 0.08986358158290386, + 0.6514828242361546, + 0.984842699021101, + 0.12379606068134308, + 0.1248469203710556, + 0.05999534949660301, + 0.0, + 0.42428523674607277, + 0.17554683424532413, + 0.06481310725212097, + 0.19436503574252129, + 0.03166845440864563, + 0.23554790019989014, + 0.331738842651248, + 0.7156655788421631, + 0.037454113364219666, + 0.2921559065580368, + 0.09743307530879974, + 0.10582848638296127, + 0.1354902647435665, + 0.05765085853636265, + 0.10545381531119347, + 0.06681686267256737, + 0.030250245705246925, + 0.08256984129548073, + 0.16153086721897125, + 0.15053699165582657, + 0.0498785674571991, + 0.13970486633479595, + 0.07893479615449905, + 0.09620747342705727, + 0.03526534140110016, + 0.044441286474466324, + 0.22363624349236488, + 0.1410064734518528, + 0.13340534642338753, + 0.0, + 0.06613403931260109, + 0.03024972788989544, + 0.330075990408659, + 0.2759206295013428, + 0.11998387426137924, + 0.17509275674819946, + 0.6167424842715263, + 0.05530470609664917, + 0.4490165114402771, + 0.17740420624613762, + 0.12455890327692032, + 0.6590933166444302, + 0.02489701844751835, + 0.08200442790985107, + 0.08354712650179863, + 0.03163623437285423, + 0.8717871457338333, + 0.7312863655388355, + 0.2470674179494381, + 0.15499914437532425 + ], + "unique_experts": 62, + "load_cv": 0.799187039693594, + "normalized_load_entropy": 0.9272382047708642, + "max_load_share": 0.047619047619047616 + }, + "full_input": { + "tokens": 67, + "top_k": 6, + "decisions": 402, + "ordered_route_sha256": "ed8000ed602a42bd5b1bc8bee91841c65ce279a4ec2fb56489248a33c787cfce", + "route_weight_sha256": "72b06025fd50a21522622138529e98cbb2b7ecc2de8ab07bde4c5edb351ea745", + "loads": [ + 10, + 3, + 5, + 17, + 5, + 14, + 6, + 3, + 25, + 14, + 1, + 3, + 1, + 0, + 11, + 5, + 1, + 6, + 1, + 6, + 9, + 17, + 2, + 6, + 3, + 5, + 3, + 5, + 2, + 2, + 3, + 3, + 6, + 12, + 2, + 6, + 1, + 4, + 1, + 1, + 7, + 3, + 8, + 0, + 2, + 2, + 6, + 7, + 7, + 6, + 11, + 1, + 8, + 7, + 3, + 27, + 4, + 2, + 3, + 1, + 19, + 20, + 6, + 12 + ], + "weighted_loads": [ + 0.6625526342540979, + 0.12417919561266899, + 0.30953530967235565, + 1.6874573230743408, + 0.20931577309966087, + 0.47215583082288504, + 0.3727159835398197, + 0.08986358158290386, + 1.8828369155526161, + 1.2167248986661434, + 0.12379606068134308, + 0.1372978426516056, + 0.05999534949660301, + 0.0, + 1.2803533412516117, + 0.17554683424532413, + 0.06481310725212097, + 0.2528136931359768, + 0.03166845440864563, + 0.27024977281689644, + 0.3826334271579981, + 1.2822312135249376, + 0.06798753701150417, + 0.2921559065580368, + 0.09743307530879974, + 0.16901089809834957, + 0.1354902647435665, + 0.1617069486528635, + 0.10545381531119347, + 0.06681686267256737, + 0.10280970111489296, + 0.08256984129548073, + 0.23228368908166885, + 0.4561166577041149, + 0.11818104237318039, + 0.23042425327003002, + 0.07893479615449905, + 0.13280601799488068, + 0.03526534140110016, + 0.044441286474466324, + 0.4705116078257561, + 0.218871358782053, + 0.4245515763759613, + 0.0, + 0.06613403931260109, + 0.05373665690422058, + 0.3716947138309479, + 0.2759206295013428, + 0.25916737504303455, + 0.41500700265169144, + 0.7889436222612858, + 0.05530470609664917, + 0.5948276817798615, + 0.24377251416444778, + 0.12455890327692032, + 2.008596008643508, + 0.1491840649396181, + 0.10762585699558258, + 0.11462209187448025, + 0.03163623437285423, + 2.080072682350874, + 1.041826656088233, + 0.2470674179494381, + 0.4390608165413141 + ], + "unique_experts": 62, + "load_cv": 0.9340390250277263, + "normalized_load_entropy": 0.9099624219064224, + "max_load_share": 0.06716417910447761 + } + }, + "s1_x": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "35103b21d01b15623e03ade9bc14a2c6679f3a9c99b502317a06216f4dea50c1", + "route_weight_sha256": "36a5822332e197663d2017bf5464b7597c07ec4ac246eec0d4f9f8f44644effe", + "loads": [ + 7, + 1, + 2, + 10, + 5, + 10, + 2, + 2, + 11, + 8, + 1, + 2, + 1, + 0, + 6, + 3, + 1, + 2, + 1, + 4, + 9, + 11, + 1, + 5, + 3, + 4, + 2, + 0, + 2, + 2, + 1, + 5, + 4, + 5, + 2, + 3, + 1, + 4, + 1, + 1, + 5, + 2, + 4, + 1, + 1, + 1, + 5, + 7, + 4, + 3, + 8, + 1, + 7, + 5, + 3, + 13, + 0, + 2, + 3, + 1, + 10, + 15, + 3, + 3 + ], + "weighted_loads": [ + 0.47702062502503395, + 0.033341556787490845, + 0.18467117100954056, + 0.7777297925204039, + 0.21168433874845505, + 0.3554436210542917, + 0.08623256161808968, + 0.0645541213452816, + 0.6690352689474821, + 0.9759855978190899, + 0.12352310121059418, + 0.11621645838022232, + 0.0600578598678112, + 0.0, + 0.33339566364884377, + 0.09928424842655659, + 0.0646207258105278, + 0.10420720279216766, + 0.027637271210551262, + 0.18661946430802345, + 0.40793055668473244, + 0.8151522241532803, + 0.03427961468696594, + 0.2822367176413536, + 0.10132383555173874, + 0.14886470884084702, + 0.10422222316265106, + 0.0, + 0.10204004123806953, + 0.060426920652389526, + 0.03211440145969391, + 0.14315716736018658, + 0.15762764029204845, + 0.18709515407681465, + 0.08019744232296944, + 0.11756638437509537, + 0.08025161176919937, + 0.12481764890253544, + 0.03783745318651199, + 0.03983251005411148, + 0.28477475605905056, + 0.13453373312950134, + 0.16987643390893936, + 0.026675866916775703, + 0.031074751168489456, + 0.027343809604644775, + 0.32473739609122276, + 0.29831860959529877, + 0.160262119024992, + 0.15228711068630219, + 0.5542151909321547, + 0.05381280928850174, + 0.456599947065115, + 0.1701861470937729, + 0.13509783521294594, + 0.7127657420933247, + 0.0, + 0.1323646605014801, + 0.13324303925037384, + 0.034458696842193604, + 0.8122275322675705, + 0.8462734408676624, + 0.13045142218470573, + 0.12601691856980324 + ], + "unique_experts": 61, + "load_cv": 0.8622715463835601, + "normalized_load_entropy": 0.9176587237278392, + "max_load_share": 0.05952380952380952 + }, + "full_input": { + "tokens": 83, + "top_k": 6, + "decisions": 498, + "ordered_route_sha256": "ff450acc7b6c2861543848f66a519f194fe8bc5a2dc8255439595c89bd5b5a50", + "route_weight_sha256": "3e12e068907935f91a425b934f931d8e015bcdb14a00a0b02dcb03f37458959b", + "loads": [ + 10, + 5, + 2, + 22, + 5, + 11, + 7, + 3, + 32, + 18, + 1, + 6, + 4, + 0, + 10, + 7, + 4, + 5, + 2, + 4, + 11, + 25, + 2, + 5, + 3, + 5, + 2, + 0, + 3, + 2, + 2, + 5, + 5, + 14, + 9, + 9, + 3, + 7, + 1, + 2, + 17, + 3, + 9, + 3, + 1, + 2, + 6, + 9, + 9, + 6, + 18, + 4, + 13, + 9, + 3, + 38, + 4, + 2, + 5, + 1, + 25, + 27, + 4, + 7 + ], + "weighted_loads": [ + 0.6292682811617851, + 0.4663602039217949, + 0.18467117100954056, + 2.0973286498337984, + 0.21168433874845505, + 0.36803698632866144, + 0.39673981815576553, + 0.10588722676038742, + 2.4133174624294043, + 1.501119464635849, + 0.12352310121059418, + 0.40462482906877995, + 0.19999372214078903, + 0.0, + 0.8879489991813898, + 0.3367379028350115, + 0.20712663978338242, + 0.18980549648404121, + 0.06708570010960102, + 0.18661946430802345, + 0.5131310150027275, + 1.8995172567665577, + 0.07808080315589905, + 0.2822367176413536, + 0.10132383555173874, + 0.17443001829087734, + 0.10422222316265106, + 0.0, + 0.1845892332494259, + 0.060426920652389526, + 0.06529185175895691, + 0.14315716736018658, + 0.20624139718711376, + 0.5093721263110638, + 0.3926384877413511, + 0.3873262442648411, + 0.17058515921235085, + 0.2348383590579033, + 0.03783745318651199, + 0.08541139960289001, + 1.043098859488964, + 0.15982133708894253, + 0.6034319065511227, + 0.16298996098339558, + 0.031074751168489456, + 0.05774004012346268, + 0.36038030683994293, + 0.36663794703781605, + 0.36216557770967484, + 0.6929163038730621, + 1.020680958405137, + 0.2555924318730831, + 1.1361943297088146, + 0.33195111714303493, + 0.13509783521294594, + 2.8012627866119146, + 0.2133721262216568, + 0.1323646605014801, + 0.20026930794119835, + 0.034458696842193604, + 2.8102690279483795, + 1.4329359345138073, + 0.16095645911991596, + 0.3380465395748615 + ], + "unique_experts": 62, + "load_cv": 1.0145869222478705, + "normalized_load_entropy": 0.9009190055813832, + "max_load_share": 0.07630522088353414 + } + }, + "s0_period": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "d313fd6affb7a96c04ff797bbbfcf6a0f3916ae79e4ca1a5a9e9368d95ac65fa", + "route_weight_sha256": "e9b61f3291ef1eb7921a769b37d5a8e1af57eefc0c235c79046d06d1d3cb2e10", + "loads": [ + 6, + 2, + 2, + 8, + 5, + 10, + 2, + 3, + 12, + 9, + 1, + 2, + 1, + 0, + 7, + 4, + 1, + 4, + 1, + 5, + 8, + 10, + 1, + 6, + 3, + 3, + 3, + 2, + 2, + 2, + 1, + 2, + 4, + 5, + 1, + 4, + 1, + 3, + 1, + 1, + 4, + 2, + 3, + 0, + 3, + 1, + 5, + 6, + 4, + 4, + 7, + 1, + 7, + 7, + 2, + 13, + 1, + 1, + 1, + 1, + 9, + 12, + 6, + 4 + ], + "weighted_loads": [ + 0.5115026570856571, + 0.07577330991625786, + 0.19755426794290543, + 0.6010973267257214, + 0.2209426537156105, + 0.3639273401349783, + 0.08563051745295525, + 0.09231303818523884, + 0.7317386530339718, + 1.003723667934537, + 0.12694622576236725, + 0.12096789106726646, + 0.060056574642658234, + 0.0, + 0.3934713024646044, + 0.1370163131505251, + 0.06472562253475189, + 0.20065646432340145, + 0.03171028196811676, + 0.2295282892882824, + 0.3282188419252634, + 0.775667229667306, + 0.036977846175432205, + 0.2999064065515995, + 0.09736734442412853, + 0.10402623191475868, + 0.14147823303937912, + 0.05865939520299435, + 0.10653335228562355, + 0.06257467716932297, + 0.03454482927918434, + 0.05278804525732994, + 0.15848055109381676, + 0.18202327378094196, + 0.04871152341365814, + 0.1367795281112194, + 0.08015310764312744, + 0.09704234264791012, + 0.036290496587753296, + 0.04565015062689781, + 0.23469108901917934, + 0.1454351656138897, + 0.13575944304466248, + 0.0, + 0.09250296652317047, + 0.030443036928772926, + 0.33238134533166885, + 0.24492788687348366, + 0.16342578455805779, + 0.17480569705367088, + 0.5733009763062, + 0.056004829704761505, + 0.4444909542798996, + 0.2569238692522049, + 0.0958203598856926, + 0.6924679633229971, + 0.026048889383673668, + 0.08833856135606766, + 0.04428321495652199, + 0.03333903104066849, + 0.8822744563221931, + 0.7103912569582462, + 0.24757754802703857, + 0.15696385130286217 + ], + "unique_experts": 62, + "load_cv": 0.8042153994218032, + "normalized_load_entropy": 0.9261009921939921, + "max_load_share": 0.051587301587301584 + }, + "full_input": { + "tokens": 67, + "top_k": 6, + "decisions": 402, + "ordered_route_sha256": "4b0bcd2c72edbfc2f9147a499176fbdfed371c15d33c93c3d0481a327e52e092", + "route_weight_sha256": "6bce0720124542180ee8cf2705b27026b3bd5a37604f07810fcf4f31f6fbf735", + "loads": [ + 10, + 3, + 5, + 16, + 5, + 11, + 5, + 3, + 26, + 14, + 1, + 3, + 1, + 0, + 11, + 4, + 1, + 6, + 1, + 6, + 9, + 17, + 2, + 6, + 3, + 5, + 3, + 6, + 2, + 3, + 2, + 2, + 6, + 11, + 2, + 6, + 1, + 6, + 1, + 2, + 9, + 3, + 8, + 0, + 3, + 2, + 6, + 6, + 9, + 5, + 11, + 1, + 9, + 9, + 2, + 27, + 4, + 2, + 2, + 1, + 19, + 19, + 6, + 12 + ], + "weighted_loads": [ + 0.6863062959164381, + 0.1745690144598484, + 0.30525410920381546, + 1.5844313018023968, + 0.2209426537156105, + 0.376520705409348, + 0.30035482347011566, + 0.09231303818523884, + 1.9578057639300823, + 1.2044597249478102, + 0.12694622576236725, + 0.13341881334781647, + 0.060056574642658234, + 0.0, + 1.3530730623751879, + 0.1370163131505251, + 0.06472562253475189, + 0.27416939474642277, + 0.03171028196811676, + 0.2626512087881565, + 0.37837632186710835, + 1.3092495985329151, + 0.06751126982271671, + 0.2999064065515995, + 0.09736734442412853, + 0.16720864363014698, + 0.14147823303937912, + 0.20329626090824604, + 0.10653335228562355, + 0.11349872127175331, + 0.05978075601160526, + 0.05278804525732994, + 0.22923337295651436, + 0.4016935024410486, + 0.11701399832963943, + 0.24382491782307625, + 0.08015310764312744, + 0.2183325495570898, + 0.036290496587753296, + 0.07925118133425713, + 0.5370762776583433, + 0.24017642810940742, + 0.37071933411061764, + 0.0, + 0.09250296652317047, + 0.05392996594309807, + 0.37400006875395775, + 0.24492788687348366, + 0.3524270411580801, + 0.29310455545783043, + 0.8230038471519947, + 0.056004829704761505, + 0.612507039681077, + 0.3498644456267357, + 0.0958203598856926, + 1.953027805313468, + 0.15033593587577343, + 0.11395999044179916, + 0.07100580260157585, + 0.03333903104066849, + 2.1299594081938267, + 0.9651117939502001, + 0.24757754802703857, + 0.4607084970921278 + ], + "unique_experts": 62, + "load_cv": 0.9285107029229333, + "normalized_load_entropy": 0.9107101170098237, + "max_load_share": 0.06716417910447761 + } + }, + "s1_period": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "8a7c19f6844d90abb4a8cab725bc5e3bbe72f263d7c5e9a31daadae5752fb81b", + "route_weight_sha256": "134adc07add3068ab065610c6340bcaf444be9854af73e5ea9bbdef289959724", + "loads": [ + 6, + 1, + 2, + 9, + 5, + 12, + 2, + 2, + 13, + 9, + 1, + 2, + 1, + 0, + 7, + 3, + 1, + 4, + 0, + 3, + 7, + 9, + 1, + 8, + 4, + 4, + 2, + 0, + 2, + 1, + 1, + 2, + 5, + 4, + 2, + 3, + 1, + 3, + 1, + 1, + 5, + 2, + 3, + 1, + 1, + 2, + 5, + 8, + 4, + 3, + 8, + 1, + 7, + 6, + 4, + 13, + 0, + 2, + 3, + 1, + 9, + 14, + 3, + 3 + ], + "weighted_loads": [ + 0.47067277133464813, + 0.03404511883854866, + 0.19423436373472214, + 0.7904609981924295, + 0.2183675840497017, + 0.4071301147341728, + 0.08399829640984535, + 0.06638901308178902, + 0.7767755053937435, + 0.9588063359260559, + 0.15053772926330566, + 0.11459596827626228, + 0.060529641807079315, + 0.0, + 0.393214151263237, + 0.101418761536479, + 0.06554067134857178, + 0.17335353791713715, + 0.0, + 0.15650421008467674, + 0.31907903030514717, + 0.7292476296424866, + 0.03515147790312767, + 0.37235111370682716, + 0.14095119014382362, + 0.14373208209872246, + 0.10406431369483471, + 0.0, + 0.1037604920566082, + 0.030543150380253792, + 0.03356548026204109, + 0.056592388078570366, + 0.18769345618784428, + 0.15186410769820213, + 0.08321612700819969, + 0.1138177178800106, + 0.08219024538993835, + 0.09799966029822826, + 0.03894400969147682, + 0.045001521706581116, + 0.28191904723644257, + 0.13250409066677094, + 0.1321304701268673, + 0.02639910951256752, + 0.03070905990898609, + 0.06042007356882095, + 0.31525687500834465, + 0.32148669101297855, + 0.17226840183138847, + 0.15106049552559853, + 0.5545700900256634, + 0.053123921155929565, + 0.4443194791674614, + 0.2094702608883381, + 0.16559050232172012, + 0.7326512262225151, + 0.0, + 0.13156255707144737, + 0.1360631138086319, + 0.034304939210414886, + 0.8137384317815304, + 0.8402841631323099, + 0.1239062249660492, + 0.1285543255507946 + ], + "unique_experts": 60, + "load_cv": 0.8727272250089698, + "normalized_load_entropy": 0.9142967832618022, + "max_load_share": 0.05555555555555555 + }, + "full_input": { + "tokens": 83, + "top_k": 6, + "decisions": 498, + "ordered_route_sha256": "8ad6e19944503a9d47c527e1827d0ac8105ff1b23d3c33880d55c1263cbb69f7", + "route_weight_sha256": "c108a466abd13c048de24b06222ca44f53dca3c8371b56147b1891ea5cf6aee2", + "loads": [ + 9, + 6, + 2, + 20, + 5, + 13, + 6, + 3, + 33, + 18, + 1, + 6, + 4, + 0, + 11, + 7, + 4, + 7, + 1, + 4, + 9, + 23, + 3, + 8, + 4, + 5, + 2, + 1, + 3, + 1, + 2, + 2, + 6, + 15, + 9, + 9, + 3, + 5, + 1, + 3, + 18, + 3, + 8, + 3, + 1, + 2, + 7, + 10, + 9, + 5, + 18, + 4, + 13, + 9, + 4, + 37, + 4, + 2, + 5, + 1, + 25, + 25, + 4, + 7 + ], + "weighted_loads": [ + 0.6229204274713993, + 0.5187258124351501, + 0.19423436373472214, + 2.0578897818922997, + 0.2183675840497017, + 0.41972348000854254, + 0.35372552275657654, + 0.10772211849689484, + 2.481911052018404, + 1.436828587204218, + 0.15053772926330566, + 0.4030043389648199, + 0.20046550408005714, + 0.0, + 0.9815513249486685, + 0.3388724159449339, + 0.2080465853214264, + 0.2589518316090107, + 0.03944842889904976, + 0.1959749236702919, + 0.4245932325720787, + 1.7933321297168732, + 0.11281168460845947, + 0.37235111370682716, + 0.14095119014382362, + 0.16929739154875278, + 0.10406431369483471, + 0.03336714208126068, + 0.18630968406796455, + 0.030543150380253792, + 0.07435055822134018, + 0.056592388078570366, + 0.23630721308290958, + 0.5387671235948801, + 0.3956571724265814, + 0.3659205734729767, + 0.17252379283308983, + 0.1566802617162466, + 0.03894400969147682, + 0.15587575733661652, + 1.082344999536872, + 0.15779169462621212, + 0.5176660604774952, + 0.1627132035791874, + 0.03070905990898609, + 0.06042007356882095, + 0.3907437436282635, + 0.38980602845549583, + 0.37897857278585434, + 0.6075783334672451, + 1.0720762554556131, + 0.25490354374051094, + 1.1198093369603157, + 0.35972385853528976, + 0.16559050232172012, + 2.739136593416333, + 0.2133721262216568, + 0.13156255707144737, + 0.2030893824994564, + 0.034304939210414886, + 2.8604611307382584, + 1.307250490412116, + 0.15441126190125942, + 0.32972973957657814 + ], + "unique_experts": 63, + "load_cv": 0.9927317677194138, + "normalized_load_entropy": 0.9042087389857131, + "max_load_share": 0.07429718875502007 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 42, + "ordered_topk_exact_tokens": 17, + "set_exact_tokens": 24, + "mean_set_jaccard": 0.8673469387755103, + "mean_token_weighted_tv": 0.02307560197299435, + "aggregate_load_tv": 0.06746031746031746 + }, + "system_bos": { + "tokens": 42, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 23, + "mean_set_jaccard": 0.8554421768707483, + "mean_token_weighted_tv": 0.025968486243592843, + "aggregate_load_tv": 0.06746031746031746 + }, + "system_x": { + "tokens": 42, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.8038548752834468, + "mean_token_weighted_tv": 0.037432657377350895, + "aggregate_load_tv": 0.09126984126984126 + }, + "system_period": { + "tokens": 42, + "ordered_topk_exact_tokens": 8, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.7891156462585035, + "mean_token_weighted_tv": 0.0409822247124144, + "aggregate_load_tv": 0.09126984126984126 + }, + "bos_at_s0": { + "tokens": 42, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 22, + "mean_set_jaccard": 0.8384353741496597, + "mean_token_weighted_tv": 0.02989827435729759, + "aggregate_load_tv": 0.07936507936507936 + }, + "bos_at_s1": { + "tokens": 42, + "ordered_topk_exact_tokens": 17, + "set_exact_tokens": 24, + "mean_set_jaccard": 0.839002267573696, + "mean_token_weighted_tv": 0.030493701852503278, + "aggregate_load_tv": 0.09126984126984126 + }, + "x_at_s0": { + "tokens": 42, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 20, + "mean_set_jaccard": 0.8227891156462585, + "mean_token_weighted_tv": 0.03504211076402238, + "aggregate_load_tv": 0.08333333333333333 + }, + "x_at_s1": { + "tokens": 42, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.7660997732426305, + "mean_token_weighted_tv": 0.04708793841391092, + "aggregate_load_tv": 0.0992063492063492 + }, + "period_at_s0": { + "tokens": 42, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.8191609977324263, + "mean_token_weighted_tv": 0.03415874174485604, + "aggregate_load_tv": 0.08333333333333333 + }, + "period_at_s1": { + "tokens": 42, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.7524943310657597, + "mean_token_weighted_tv": 0.04758900980509463, + "aggregate_load_tv": 0.11507936507936506 + } + } + }, + "layer_23": { + "layer": 23, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "792f680df7afdad8e8f80e6828cf91c338ebca1e4c231c1304d424eee9bc8924", + "route_weight_sha256": "1311a58ab751d5fdbdc15b60580034c13e5b2feac348514403c363b2e6392814", + "loads": [ + 3, + 2, + 10, + 4, + 8, + 5, + 8, + 1, + 3, + 3, + 6, + 0, + 2, + 3, + 4, + 1, + 3, + 3, + 1, + 4, + 1, + 3, + 3, + 9, + 7, + 14, + 5, + 2, + 2, + 1, + 3, + 0, + 3, + 7, + 0, + 2, + 3, + 3, + 4, + 1, + 5, + 1, + 5, + 2, + 0, + 9, + 14, + 7, + 0, + 2, + 5, + 3, + 5, + 5, + 4, + 3, + 6, + 11, + 1, + 2, + 8, + 0, + 5, + 2 + ], + "weighted_loads": [ + 0.09435583837330341, + 0.06902092695236206, + 0.4162907190620899, + 0.231570016592741, + 0.31313543394207954, + 0.1730353869497776, + 0.38305041939020157, + 0.05292803794145584, + 0.11868459545075893, + 0.1661784052848816, + 0.30657779797911644, + 0.0, + 0.2111067697405815, + 0.1342036873102188, + 0.1525532491505146, + 0.024821558967232704, + 0.34503597021102905, + 0.2079244926571846, + 0.05528659000992775, + 0.16256185807287693, + 0.02647113800048828, + 0.1207584273070097, + 0.1257714033126831, + 0.6472276598215103, + 0.2752561569213867, + 0.9349076300859451, + 0.3637806363403797, + 0.0753590501844883, + 0.08153513073921204, + 0.07314921170473099, + 0.26581112667918205, + 0.0, + 0.10400290600955486, + 0.2528362777084112, + 0.0, + 0.1126362793147564, + 0.11269775405526161, + 0.10425874590873718, + 0.20608679577708244, + 0.04403943940997124, + 0.2920392192900181, + 0.029855523258447647, + 0.19550085626542568, + 0.10387538000941277, + 0.0, + 0.33527797646820545, + 0.8142437823116779, + 0.31733287684619427, + 0.0, + 0.11147201620042324, + 0.24355116486549377, + 0.11293311975896358, + 0.4192775059491396, + 0.18843840062618256, + 0.2095644660294056, + 0.14463607221841812, + 0.32650627195835114, + 1.0581721607595682, + 0.03894941881299019, + 0.1982639692723751, + 0.35546831600368023, + 0.0, + 0.2153468206524849, + 0.06352382712066174 + ], + "unique_experts": 58, + "load_cv": 0.8054675845311285, + "normalized_load_entropy": 0.9232257750839113, + "max_load_share": 0.05555555555555555 + }, + "full_input": { + "tokens": 67, + "top_k": 6, + "decisions": 402, + "ordered_route_sha256": "21a50cba7855df04f03ddf79dd83908f48f960f077b9b297483e4ffdc4e2f4de", + "route_weight_sha256": "4096f3977c7bc3bec5a7a7146f1c0fc03a9136c7c55bacf109801ebb9620a356", + "loads": [ + 8, + 5, + 10, + 14, + 14, + 7, + 14, + 7, + 4, + 11, + 6, + 1, + 3, + 7, + 5, + 1, + 6, + 3, + 1, + 4, + 1, + 3, + 4, + 18, + 11, + 14, + 5, + 2, + 2, + 1, + 3, + 0, + 6, + 12, + 0, + 3, + 4, + 3, + 8, + 2, + 11, + 1, + 8, + 2, + 0, + 17, + 25, + 10, + 2, + 2, + 6, + 4, + 5, + 6, + 14, + 4, + 6, + 21, + 4, + 2, + 8, + 0, + 7, + 4 + ], + "weighted_loads": [ + 0.2847808487713337, + 0.24395600333809853, + 0.4162907190620899, + 0.5175862326286733, + 0.5605356451123953, + 0.23259344417601824, + 0.7843631990253925, + 0.34515934623777866, + 0.11942668055417016, + 0.4505112301558256, + 0.30657779797911644, + 0.04683065041899681, + 0.22133414540439844, + 0.3019236531108618, + 0.22352821752429008, + 0.024821558967232704, + 0.3961122911423445, + 0.2079244926571846, + 0.05528659000992775, + 0.16256185807287693, + 0.02647113800048828, + 0.1207584273070097, + 0.14442738145589828, + 1.8137150183320045, + 0.429703064262867, + 0.9349076300859451, + 0.3637806363403797, + 0.0753590501844883, + 0.08153513073921204, + 0.07314921170473099, + 0.26581112667918205, + 0.0, + 0.24989988841116428, + 0.5262490332825109, + 0.0, + 0.14359860122203827, + 0.15324506163597107, + 0.10425874590873718, + 0.38675896264612675, + 0.06839296035468578, + 0.6143776662647724, + 0.029855523258447647, + 0.2813306637108326, + 0.10387538000941277, + 0.0, + 2.4160040225833654, + 1.7758073918521404, + 0.38224128959700465, + 0.08344048634171486, + 0.11147201620042324, + 0.26873692497611046, + 0.20689189992845058, + 0.4192775059491396, + 0.22391001507639885, + 1.126869697123766, + 0.206220380961895, + 0.32650627195835114, + 1.9989927504211664, + 0.20017215982079506, + 0.1982639692723751, + 0.35546831600368023, + 0.0, + 0.28327561914920807, + 0.14624789915978909 + ], + "unique_experts": 60, + "load_cv": 0.850135068918501, + "normalized_load_entropy": 0.9179417563367428, + "max_load_share": 0.06218905472636816 + } + }, + "s1_eos": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "552ac7e11423e5f9ec87ef5bc5bf33530f32ccc5e244eba991ccd405bdcc6a6b", + "route_weight_sha256": "2fef1a7c49e77f1073c6e490ed18b567c3f7864ba76104132b93ae9d062d57eb", + "loads": [ + 2, + 1, + 12, + 4, + 8, + 5, + 8, + 1, + 6, + 2, + 6, + 0, + 2, + 3, + 3, + 0, + 3, + 3, + 1, + 4, + 2, + 2, + 4, + 9, + 8, + 14, + 5, + 2, + 2, + 1, + 5, + 0, + 6, + 7, + 0, + 2, + 1, + 2, + 4, + 3, + 6, + 1, + 4, + 2, + 1, + 8, + 16, + 6, + 0, + 2, + 5, + 2, + 4, + 5, + 4, + 3, + 5, + 10, + 2, + 1, + 5, + 0, + 5, + 2 + ], + "weighted_loads": [ + 0.06405011750757694, + 0.0312952883541584, + 0.49415306746959686, + 0.21753718331456184, + 0.359128013253212, + 0.17110365629196167, + 0.37159163877367973, + 0.05179715156555176, + 0.2125747837126255, + 0.13019274175167084, + 0.32868580147624016, + 0.0, + 0.22766876220703125, + 0.13599814102053642, + 0.11143683269619942, + 0.0, + 0.3526758477091789, + 0.20200353488326073, + 0.056554727256298065, + 0.16781868785619736, + 0.05492301285266876, + 0.08996641635894775, + 0.15311927907168865, + 0.6960595771670341, + 0.31090959161520004, + 0.9310322478413582, + 0.33755987137556076, + 0.07772741839289665, + 0.07748595997691154, + 0.07266445457935333, + 0.3324442245066166, + 0.0, + 0.20723282359540462, + 0.2747994512319565, + 0.0, + 0.11028436571359634, + 0.041632577776908875, + 0.07477846182882786, + 0.2021241206675768, + 0.09482741355895996, + 0.32858438417315483, + 0.02942143939435482, + 0.16834460571408272, + 0.11548783257603645, + 0.03422893211245537, + 0.2995597328990698, + 0.8801702838391066, + 0.2783813029527664, + 0.0, + 0.11526045762002468, + 0.24363872036337852, + 0.0786007009446621, + 0.37492940574884415, + 0.19111225754022598, + 0.21017659083008766, + 0.1377456709742546, + 0.25880980119109154, + 1.0148088745772839, + 0.06880535557866096, + 0.16292564570903778, + 0.2588646300137043, + 0.0, + 0.2151380069553852, + 0.06808138266205788 + ], + "unique_experts": 58, + "load_cv": 0.839771051835638, + "normalized_load_entropy": 0.9190453753691475, + "max_load_share": 0.06349206349206349 + }, + "full_input": { + "tokens": 83, + "top_k": 6, + "decisions": 498, + "ordered_route_sha256": "a2cf5dc35e99b0100963d535ce6155940e71d0f5c8ab8e70063914caf6c135ec", + "route_weight_sha256": "a2ce063c5d038a25c7b319b314da6371612e99324205242ab902375ba2738d53", + "loads": [ + 7, + 7, + 18, + 15, + 12, + 7, + 21, + 10, + 8, + 6, + 8, + 1, + 3, + 8, + 4, + 3, + 8, + 4, + 3, + 4, + 3, + 2, + 5, + 24, + 11, + 14, + 5, + 2, + 2, + 2, + 5, + 0, + 8, + 19, + 0, + 2, + 7, + 3, + 11, + 4, + 14, + 1, + 7, + 2, + 3, + 16, + 33, + 10, + 7, + 5, + 5, + 12, + 10, + 6, + 14, + 5, + 5, + 26, + 6, + 1, + 7, + 1, + 11, + 5 + ], + "weighted_loads": [ + 0.3519002152606845, + 0.38000742346048355, + 0.8124367110431194, + 0.7725134526845068, + 0.5411381721496582, + 0.2145685376599431, + 1.1128189526498318, + 0.3925469983369112, + 0.24936913745477796, + 0.2853282392024994, + 0.42100419104099274, + 0.036957092583179474, + 0.23786414600908756, + 0.34406768903136253, + 0.20384041592478752, + 0.122614074498415, + 0.47280482575297356, + 0.26444893702864647, + 0.14791244640946388, + 0.16781868785619736, + 0.10053640231490135, + 0.08996641635894775, + 0.171657957136631, + 2.508489243686199, + 0.42815124429762363, + 0.9310322478413582, + 0.33755987137556076, + 0.07772741839289665, + 0.07748595997691154, + 0.11863834410905838, + 0.3324442245066166, + 0.0, + 0.288063058629632, + 0.989657121244818, + 0.0, + 0.11028436571359634, + 0.4735135845839977, + 0.11992336250841618, + 0.6124702459201217, + 0.11770175024867058, + 0.7112393956631422, + 0.02942143939435482, + 0.24973505549132824, + 0.11548783257603645, + 0.13736910372972488, + 2.4097754191607237, + 2.522016640752554, + 0.5131131315138191, + 0.28639059513807297, + 0.26659475080668926, + 0.24363872036337852, + 0.690503703430295, + 1.016231968998909, + 0.22240646556019783, + 1.179583702236414, + 0.20387544855475426, + 0.25880980119109154, + 2.546620447188616, + 0.268850177526474, + 0.16292564570903778, + 0.33356069028377533, + 0.12467562407255173, + 0.44820535741746426, + 0.19937971606850624 + ], + "unique_experts": 62, + "load_cv": 0.8391844713328402, + "normalized_load_entropy": 0.9248630749466433, + "max_load_share": 0.06626506024096386 + } + }, + "s0_bos": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "0e3389670744c85733ffa5c4e90c149fcf7481f166ce9a6719ae18addb57f038", + "route_weight_sha256": "fa1891ee33f022615b649e726a56a1d65e5d670e85bad22e1ec9d19d854c9880", + "loads": [ + 3, + 2, + 11, + 4, + 6, + 4, + 8, + 3, + 4, + 4, + 6, + 0, + 3, + 3, + 4, + 1, + 4, + 3, + 1, + 3, + 1, + 4, + 2, + 9, + 9, + 14, + 5, + 1, + 2, + 1, + 4, + 0, + 3, + 7, + 0, + 2, + 4, + 3, + 2, + 2, + 5, + 1, + 5, + 2, + 1, + 7, + 14, + 8, + 0, + 2, + 5, + 4, + 3, + 4, + 5, + 3, + 6, + 10, + 1, + 2, + 5, + 0, + 5, + 2 + ], + "weighted_loads": [ + 0.10382172092795372, + 0.07184905558824539, + 0.4587025847285986, + 0.208785742521286, + 0.22481831349432468, + 0.14513979479670525, + 0.36679883301258087, + 0.09465335495769978, + 0.16548367217183113, + 0.19625964015722275, + 0.2928768824785948, + 0.0, + 0.2472519911825657, + 0.1539505235850811, + 0.16718877665698528, + 0.024007467553019524, + 0.35600169003009796, + 0.2066747285425663, + 0.05848044902086258, + 0.1262039989233017, + 0.026017451658844948, + 0.14531414583325386, + 0.08953671716153622, + 0.6756265424191952, + 0.33594028279185295, + 0.9341020546853542, + 0.3470771238207817, + 0.05313752591609955, + 0.0847514346241951, + 0.07439478486776352, + 0.3208104707300663, + 0.0, + 0.10890323854982853, + 0.25717606395483017, + 0.0, + 0.1161019541323185, + 0.14892923273146152, + 0.10964683443307877, + 0.14725257083773613, + 0.08073294907808304, + 0.3155689537525177, + 0.028646346181631088, + 0.18708224780857563, + 0.10829334706068039, + 0.03694204241037369, + 0.26398738846182823, + 0.7585097569972277, + 0.3548061177134514, + 0.0, + 0.11298383213579655, + 0.24588372558355331, + 0.1686824094504118, + 0.37570182234048843, + 0.14801224134862423, + 0.24825819954276085, + 0.15047729015350342, + 0.3274192586541176, + 1.1236006803810596, + 0.039526499807834625, + 0.17842328920960426, + 0.2520584687590599, + 0.0, + 0.21868725679814816, + 0.07570938393473625 + ], + "unique_experts": 59, + "load_cv": 0.7813329824913631, + "normalized_load_entropy": 0.9290266348280694, + "max_load_share": 0.05555555555555555 + }, + "full_input": { + "tokens": 67, + "top_k": 6, + "decisions": 402, + "ordered_route_sha256": "b84b6cbd67d06afb788f62878c78df6a33e17097cf8f96c63158932c86a01ede", + "route_weight_sha256": "f67f8544989f61d9eb0575888ba77128f616ae1af1ca04a69840913cceebcc50", + "loads": [ + 6, + 5, + 11, + 13, + 14, + 7, + 14, + 9, + 4, + 11, + 6, + 0, + 4, + 7, + 5, + 1, + 7, + 3, + 1, + 4, + 1, + 4, + 4, + 19, + 13, + 14, + 6, + 1, + 2, + 1, + 4, + 0, + 5, + 10, + 0, + 3, + 4, + 3, + 5, + 3, + 11, + 1, + 8, + 3, + 1, + 15, + 25, + 10, + 2, + 2, + 6, + 5, + 3, + 5, + 15, + 5, + 6, + 21, + 5, + 3, + 5, + 0, + 7, + 4 + ], + "weighted_loads": [ + 0.21924920240417123, + 0.24678413197398186, + 0.4587025847285986, + 0.49611105024814606, + 0.5624140240252018, + 0.2549525247886777, + 0.7576403766870499, + 0.353017745539546, + 0.16548367217183113, + 0.4435288030654192, + 0.2928768824785948, + 0.0, + 0.2574793668463826, + 0.32167048938572407, + 0.23816374503076077, + 0.024007467553019524, + 0.4070780109614134, + 0.2066747285425663, + 0.05848044902086258, + 0.2799810320138931, + 0.026017451658844948, + 0.14531414583325386, + 0.14953476376831532, + 1.938374500721693, + 0.49168945848941803, + 0.9341020546853542, + 0.4615205004811287, + 0.05313752591609955, + 0.0847514346241951, + 0.07439478486776352, + 0.3208104707300663, + 0.0, + 0.21058430336415768, + 0.4954224154353142, + 0.0, + 0.14706427603960037, + 0.14892923273146152, + 0.10964683443307877, + 0.28868949972093105, + 0.10508647002279758, + 0.6565231494605541, + 0.028646346181631088, + 0.2696293368935585, + 0.14858289062976837, + 0.03694204241037369, + 1.4128231592476368, + 1.7200733665376902, + 0.4159098407253623, + 0.08344048634171486, + 0.11298383213579655, + 0.3242966756224632, + 0.2626411896198988, + 0.37570182234048843, + 0.1809015218168497, + 1.1655634306371212, + 0.2602480724453926, + 0.3274192586541176, + 2.0650706589221954, + 0.28270865231752396, + 0.437019769102335, + 0.2520584687590599, + 0.0, + 0.28661605529487133, + 0.15430404618382454 + ], + "unique_experts": 60, + "load_cv": 0.8435880516995681, + "normalized_load_entropy": 0.9196911729930985, + "max_load_share": 0.06218905472636816 + } + }, + "s1_bos": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "92f59e3bdef29fe0c49c2c82f77258c10523cc6f1e51bd0b248b674331f91a34", + "route_weight_sha256": "33c5b288ec2376d5ac80c2b51353d4c5223bf69a0d1890077b4ee89e292fb7eb", + "loads": [ + 4, + 2, + 10, + 5, + 6, + 4, + 8, + 3, + 6, + 3, + 6, + 0, + 2, + 3, + 4, + 0, + 4, + 3, + 1, + 3, + 1, + 4, + 4, + 9, + 4, + 14, + 4, + 1, + 2, + 1, + 3, + 0, + 4, + 7, + 0, + 2, + 2, + 4, + 2, + 1, + 5, + 1, + 5, + 2, + 1, + 9, + 15, + 8, + 1, + 2, + 5, + 4, + 4, + 5, + 4, + 2, + 6, + 10, + 1, + 2, + 6, + 0, + 5, + 3 + ], + "weighted_loads": [ + 0.13888772577047348, + 0.06747712567448616, + 0.4331671670079231, + 0.2622665520757437, + 0.22624507173895836, + 0.15144091844558716, + 0.36238306760787964, + 0.10261286608874798, + 0.22988442704081535, + 0.16307399421930313, + 0.3097870536148548, + 0.0, + 0.22803685441613197, + 0.1560252234339714, + 0.16352158412337303, + 0.0, + 0.3696965202689171, + 0.21294030174613, + 0.058654531836509705, + 0.1373862288892269, + 0.02686700038611889, + 0.1454104222357273, + 0.15812063589692116, + 0.7096764743328094, + 0.16590441390872002, + 0.9413483515381813, + 0.32882145792245865, + 0.05404876545071602, + 0.08346783369779587, + 0.07556392252445221, + 0.2851385027170181, + 0.0, + 0.14235495030879974, + 0.25820705108344555, + 0.0, + 0.11317596584558487, + 0.07682595402002335, + 0.138518825173378, + 0.1429833620786667, + 0.04100191965699196, + 0.32779068499803543, + 0.028035372495651245, + 0.1847006008028984, + 0.11831481382250786, + 0.03683670982718468, + 0.3405038006603718, + 0.8265353739261627, + 0.3634937573224306, + 0.03439445421099663, + 0.10705159977078438, + 0.24464640766382217, + 0.15946567803621292, + 0.3709094598889351, + 0.17434058897197247, + 0.21071776002645493, + 0.11660733073949814, + 0.35392702743411064, + 1.0762447025626898, + 0.037782490253448486, + 0.16160441935062408, + 0.2756752297282219, + 0.0, + 0.20702111721038818, + 0.10025362856686115 + ], + "unique_experts": 59, + "load_cv": 0.7890341918499408, + "normalized_load_entropy": 0.9277305463740296, + "max_load_share": 0.05952380952380952 + }, + "full_input": { + "tokens": 83, + "top_k": 6, + "decisions": 498, + "ordered_route_sha256": "cc79189ce220014d82e4c02b1cd6340e0420f80fd73a69e7954ae47c1fe624d9", + "route_weight_sha256": "25c7f312f8b41c9d155cfe34608b42b9fd5e9043b2b7c34d66e8368b78de2044", + "loads": [ + 8, + 8, + 16, + 14, + 10, + 7, + 20, + 13, + 7, + 7, + 8, + 1, + 3, + 8, + 5, + 3, + 9, + 4, + 3, + 3, + 2, + 4, + 6, + 25, + 7, + 14, + 4, + 1, + 2, + 2, + 4, + 0, + 5, + 18, + 0, + 2, + 8, + 5, + 8, + 2, + 14, + 1, + 7, + 2, + 3, + 15, + 31, + 11, + 8, + 5, + 6, + 14, + 10, + 8, + 14, + 5, + 6, + 27, + 6, + 2, + 8, + 1, + 11, + 7 + ], + "weighted_loads": [ + 0.4409226910211146, + 0.4161892607808113, + 0.7514508105814457, + 0.7831619009375572, + 0.4180908650159836, + 0.23922449070960283, + 1.0553565807640553, + 0.4756160844117403, + 0.26596958562731743, + 0.32224684208631516, + 0.4021054431796074, + 0.05029663071036339, + 0.23823223821818829, + 0.3640947714447975, + 0.25592516735196114, + 0.122614074498415, + 0.4898254983127117, + 0.27538570389151573, + 0.15001225098967552, + 0.1373862288892269, + 0.07248038984835148, + 0.1454104222357273, + 0.22564764134585857, + 2.610631536692381, + 0.29055210016667843, + 0.9413483515381813, + 0.32882145792245865, + 0.05404876545071602, + 0.08346783369779587, + 0.12153781205415726, + 0.3342573307454586, + 0.0, + 0.1871444284915924, + 0.9652327932417393, + 0.0, + 0.11317596584558487, + 0.5087069608271122, + 0.1836637258529663, + 0.5045391665771604, + 0.06387625634670258, + 0.7911634836345911, + 0.028035372495651245, + 0.23874249123036861, + 0.11831481382250786, + 0.1399768814444542, + 1.418855333700776, + 2.440393503755331, + 0.5945411929860711, + 0.3207850493490696, + 0.25838589295744896, + 0.27359778992831707, + 0.7713686805218458, + 1.012212023139, + 0.3249748405069113, + 1.1801248714327812, + 0.25901005789637566, + 0.35392702743411064, + 2.5941465366631746, + 0.3032577484846115, + 0.16160441935062408, + 0.3503712899982929, + 0.12467562407255173, + 0.44008846767246723, + 0.27980845980346203 + ], + "unique_experts": 62, + "load_cv": 0.8186370442485268, + "normalized_load_entropy": 0.9271938916867302, + "max_load_share": 0.06224899598393574 + } + }, + "s0_x": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "6ae582182a8ab868493eb5d72818af66c99e93ccf1249ab7a378d0d7734fb0cc", + "route_weight_sha256": "fd75fb8106bd4ef7f885a9b4210a79034244c4063942d5c7b674f7a84bb8b672", + "loads": [ + 3, + 2, + 10, + 4, + 8, + 5, + 7, + 3, + 4, + 4, + 6, + 0, + 3, + 3, + 4, + 1, + 4, + 3, + 1, + 3, + 1, + 4, + 2, + 9, + 8, + 14, + 4, + 1, + 2, + 1, + 4, + 0, + 3, + 5, + 0, + 2, + 3, + 3, + 2, + 1, + 6, + 1, + 6, + 2, + 1, + 9, + 14, + 7, + 1, + 2, + 5, + 5, + 4, + 5, + 4, + 3, + 5, + 10, + 1, + 1, + 5, + 0, + 5, + 3 + ], + "weighted_loads": [ + 0.09610793925821781, + 0.0726892314851284, + 0.44105647318065166, + 0.24263012036681175, + 0.295855812728405, + 0.1729588769376278, + 0.3617713451385498, + 0.09697562828660011, + 0.15841489285230637, + 0.18761420622467995, + 0.3144751191139221, + 0.0, + 0.22800123691558838, + 0.1299128383398056, + 0.16188828274607658, + 0.023750334978103638, + 0.36747331731021404, + 0.20971957966685295, + 0.05669045448303223, + 0.12724300287663937, + 0.025997068732976913, + 0.13488602451980114, + 0.09902728348970413, + 0.6507497616112232, + 0.29666128754615784, + 0.9255663380026817, + 0.3268441706895828, + 0.05231279879808426, + 0.08234535157680511, + 0.06996428221464157, + 0.32553133368492126, + 0.0, + 0.09891156107187271, + 0.19101815484464169, + 0.0, + 0.12143115699291229, + 0.10860058851540089, + 0.10672670416533947, + 0.14216846227645874, + 0.04301255941390991, + 0.313239686191082, + 0.02830611541867256, + 0.22777425684034824, + 0.10746699944138527, + 0.03507153317332268, + 0.32407804392278194, + 0.796374998986721, + 0.3128396477550268, + 0.03016068786382675, + 0.11461160704493523, + 0.22767698764801025, + 0.18523877672851086, + 0.41459182277321815, + 0.1923205927014351, + 0.2273903749883175, + 0.14678371883928776, + 0.2684027813374996, + 1.1151903793215752, + 0.0378045029938221, + 0.1322902888059616, + 0.2331483792513609, + 0.0, + 0.20701895095407963, + 0.09077981673181057 + ], + "unique_experts": 60, + "load_cv": 0.7735551067308701, + "normalized_load_entropy": 0.9306601922880802, + "max_load_share": 0.05555555555555555 + }, + "full_input": { + "tokens": 67, + "top_k": 6, + "decisions": 402, + "ordered_route_sha256": "fe47ded9e2c66c59a1887dd7f3674c906293135f7d1a81fe2b8716f4242743e4", + "route_weight_sha256": "f3ac1e78ab88392971859cda9ea6da77f8f8839580eb15fa011a95409da58385", + "loads": [ + 7, + 5, + 10, + 16, + 13, + 7, + 14, + 10, + 4, + 10, + 6, + 0, + 4, + 7, + 6, + 1, + 8, + 3, + 1, + 3, + 1, + 4, + 3, + 19, + 12, + 14, + 5, + 1, + 2, + 1, + 4, + 0, + 5, + 9, + 0, + 3, + 4, + 3, + 6, + 2, + 12, + 1, + 9, + 2, + 1, + 16, + 27, + 9, + 3, + 2, + 5, + 6, + 4, + 6, + 15, + 4, + 5, + 20, + 4, + 1, + 5, + 0, + 8, + 4 + ], + "weighted_loads": [ + 0.2848426070995629, + 0.24762430787086487, + 0.44105647318065166, + 0.6951630506664515, + 0.4897652920335531, + 0.23251693416386843, + 0.8177367001771927, + 0.3712958302348852, + 0.15841489285230637, + 0.3947726059705019, + 0.3144751191139221, + 0.0, + 0.2382286125794053, + 0.29763280414044857, + 0.2757928781211376, + 0.023750334978103638, + 0.44775334000587463, + 0.20971957966685295, + 0.05669045448303223, + 0.12724300287663937, + 0.025997068732976913, + 0.13488602451980114, + 0.11768326163291931, + 1.8705280609428883, + 0.44355710968375206, + 0.9255663380026817, + 0.3615628629922867, + 0.05231279879808426, + 0.08234535157680511, + 0.06996428221464157, + 0.32553133368492126, + 0.0, + 0.20059262588620186, + 0.4861695971339941, + 0.0, + 0.15239347890019417, + 0.14945786260068417, + 0.10672670416533947, + 0.3407444264739752, + 0.06736608035862446, + 0.5883183479309082, + 0.02830611541867256, + 0.31073768623173237, + 0.10746699944138527, + 0.03507153317332268, + 1.4411114994436502, + 1.9079085774719715, + 0.37394337076693773, + 0.11360117420554161, + 0.11461160704493523, + 0.22767698764801025, + 0.27919755689799786, + 0.41459182277321815, + 0.2233540192246437, + 1.2803593538701534, + 0.1975302528589964, + 0.2684027813374996, + 2.0936266481876373, + 0.21640607714653015, + 0.1322902888059616, + 0.2331483792513609, + 0.0, + 0.30220339447259903, + 0.14646798186004162 + ], + "unique_experts": 60, + "load_cv": 0.8722089751454914, + "normalized_load_entropy": 0.9149673322584777, + "max_load_share": 0.06716417910447761 + } + }, + "s1_x": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "32f2e5534cadf8989b3af89e8a9cce4fbf2400025e14492b584a7fe92a5abd43", + "route_weight_sha256": "e89c332769151cc1b86a93a06b2a56582dcd2b62f8665db7ec5717cded3f5f8d", + "loads": [ + 2, + 0, + 13, + 5, + 7, + 5, + 9, + 3, + 6, + 3, + 5, + 0, + 2, + 3, + 3, + 0, + 5, + 3, + 1, + 3, + 3, + 4, + 3, + 9, + 6, + 14, + 5, + 1, + 2, + 1, + 4, + 0, + 3, + 8, + 0, + 2, + 2, + 2, + 4, + 1, + 6, + 1, + 4, + 2, + 1, + 9, + 17, + 6, + 1, + 2, + 5, + 5, + 5, + 3, + 5, + 2, + 4, + 8, + 2, + 1, + 5, + 0, + 5, + 1 + ], + "weighted_loads": [ + 0.07884151488542557, + 0.0, + 0.531090784817934, + 0.336842542514205, + 0.24478928372263908, + 0.18200946599245071, + 0.44271742925047874, + 0.11008299142122269, + 0.21663268841803074, + 0.18439968675374985, + 0.28774765878915787, + 0.0, + 0.18445225432515144, + 0.13074972108006477, + 0.11045649461448193, + 0.0, + 0.3984980136156082, + 0.2098563127219677, + 0.057478167116642, + 0.1227482222020626, + 0.09255699627101421, + 0.12276754342019558, + 0.13839803263545036, + 0.7390267793089151, + 0.22948557510972023, + 0.9105530194938183, + 0.3627602644264698, + 0.051468342542648315, + 0.07350035384297371, + 0.06720869243144989, + 0.3279372379183769, + 0.0, + 0.10261308588087559, + 0.2907072249799967, + 0.0, + 0.1063229963183403, + 0.07244797796010971, + 0.08036318048834801, + 0.20832990854978561, + 0.03988335654139519, + 0.34996747598052025, + 0.0275370292365551, + 0.16711238771677017, + 0.12395266816020012, + 0.03675851970911026, + 0.30593663826584816, + 0.9614732507616282, + 0.27896733954548836, + 0.037343721836805344, + 0.10500418767333031, + 0.22745400294661522, + 0.18731856904923916, + 0.4301342014223337, + 0.1135178916156292, + 0.2858951985836029, + 0.1048256941139698, + 0.22546813264489174, + 0.9216760639101267, + 0.06992075592279434, + 0.1201329454779625, + 0.2223427426069975, + 0.0, + 0.204061359167099, + 0.02999867871403694 + ], + "unique_experts": 58, + "load_cv": 0.8516875190664325, + "normalized_load_entropy": 0.9185486160218183, + "max_load_share": 0.06746031746031746 + }, + "full_input": { + "tokens": 83, + "top_k": 6, + "decisions": 498, + "ordered_route_sha256": "737ecfae6b5ba4bfa8f6367938d02cd27d73329b8fdb8d139eb69157d985cea4", + "route_weight_sha256": "f5a44fc54e703187481988506b702d34911bf0b78d9261ea640d778eb2ad08e5", + "loads": [ + 6, + 7, + 19, + 16, + 10, + 7, + 22, + 11, + 7, + 7, + 7, + 0, + 3, + 8, + 4, + 3, + 11, + 4, + 3, + 4, + 4, + 5, + 4, + 26, + 8, + 15, + 6, + 1, + 2, + 2, + 4, + 0, + 4, + 18, + 0, + 2, + 8, + 3, + 12, + 2, + 13, + 1, + 6, + 2, + 3, + 15, + 35, + 9, + 10, + 5, + 5, + 16, + 11, + 4, + 18, + 3, + 4, + 24, + 6, + 1, + 7, + 1, + 11, + 3 + ], + "weighted_loads": [ + 0.36810636753216386, + 0.3808530457317829, + 0.8493744283914566, + 0.9502351358532906, + 0.3753378242254257, + 0.22547434736043215, + 1.1984223425388336, + 0.4070208687335253, + 0.2527178470045328, + 0.32756824418902397, + 0.38006604835391045, + 0.0, + 0.19464763812720776, + 0.3388192690908909, + 0.20286007784307003, + 0.122614074498415, + 0.5576551221311092, + 0.27230171486735344, + 0.14883588626980782, + 0.15345890261232853, + 0.1381703857332468, + 0.1643624510616064, + 0.15693671070039272, + 2.6631267089396715, + 0.30935640819370747, + 0.9423588775098324, + 0.39446958154439926, + 0.051468342542648315, + 0.07350035384297371, + 0.11318258196115494, + 0.3279372379183769, + 0.0, + 0.14740256406366825, + 0.9506331570446491, + 0.0, + 0.1063229963183403, + 0.5043289847671986, + 0.12550808116793633, + 0.6636156076565385, + 0.0627576932311058, + 0.6501502227038145, + 0.0275370292365551, + 0.22115427814424038, + 0.12395266816020012, + 0.13989869132637978, + 1.393967505544424, + 2.827348416671157, + 0.5100147752091289, + 0.4169013872742653, + 0.2563384808599949, + 0.22745400294661522, + 0.9108305312693119, + 1.0714367646723986, + 0.14481209963560104, + 1.4702611602842808, + 0.13563087210059166, + 0.22546813264489174, + 2.423380458727479, + 0.27201494574546814, + 0.1201329454779625, + 0.2970388028770685, + 0.12467562407255173, + 0.43712870962917805, + 0.12875979021191597 + ], + "unique_experts": 61, + "load_cv": 0.8902175115937103, + "normalized_load_entropy": 0.9155937424514016, + "max_load_share": 0.07028112449799197 + } + }, + "s0_period": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "9c6b6c1b7378618ef56adbd04abfe54bcd0554c9de00392b1cfbc6838132a7eb", + "route_weight_sha256": "e158145d17f71ff9ceba4fb46ce42a6103b074c46daab79101ee4ca10bce7fbb", + "loads": [ + 2, + 2, + 12, + 4, + 6, + 5, + 8, + 3, + 4, + 4, + 6, + 0, + 2, + 3, + 4, + 1, + 4, + 3, + 1, + 3, + 1, + 3, + 2, + 9, + 8, + 14, + 4, + 1, + 2, + 1, + 4, + 0, + 3, + 7, + 0, + 2, + 2, + 3, + 2, + 1, + 6, + 1, + 6, + 2, + 1, + 9, + 14, + 6, + 0, + 2, + 5, + 5, + 5, + 6, + 4, + 3, + 4, + 11, + 1, + 1, + 5, + 0, + 6, + 3 + ], + "weighted_loads": [ + 0.07279035449028015, + 0.07209363579750061, + 0.49188888631761074, + 0.2322916015982628, + 0.23722736909985542, + 0.17723962105810642, + 0.39419781789183617, + 0.10036660172045231, + 0.15999677404761314, + 0.20626770704984665, + 0.31439200788736343, + 0.0, + 0.20807267725467682, + 0.13473407179117203, + 0.16307180747389793, + 0.02518729865550995, + 0.37209577299654484, + 0.20744097605347633, + 0.05632544681429863, + 0.1281765028834343, + 0.02627541311085224, + 0.10507097654044628, + 0.10149235278367996, + 0.6747172195464373, + 0.3019798658788204, + 0.929268978536129, + 0.31582866609096527, + 0.05131743848323822, + 0.07958515733480453, + 0.070756696164608, + 0.3346953373402357, + 0.0, + 0.10794731229543686, + 0.25237864442169666, + 0.0, + 0.11791755631566048, + 0.08280279487371445, + 0.10850563459098339, + 0.1408357210457325, + 0.041672758758068085, + 0.31980713829398155, + 0.027734864503145218, + 0.22970233112573624, + 0.11152780801057816, + 0.03566748648881912, + 0.3215547762811184, + 0.7866464368999004, + 0.2805262003093958, + 0.0, + 0.1127511952072382, + 0.24063126742839813, + 0.19342658855021, + 0.4574800804257393, + 0.22081570699810982, + 0.21522622555494308, + 0.14665568061172962, + 0.22691983729600906, + 1.1577593050897121, + 0.040633343160152435, + 0.14882756769657135, + 0.2344312220811844, + 0.0, + 0.22644011303782463, + 0.11027757078409195 + ], + "unique_experts": 59, + "load_cv": 0.8129401922096431, + "normalized_load_entropy": 0.923594282862694, + "max_load_share": 0.05555555555555555 + }, + "full_input": { + "tokens": 67, + "top_k": 6, + "decisions": 402, + "ordered_route_sha256": "32a98c26c0d2ae2196dc01047b799a484c3915d4f56ef955135b28b5c19ff693", + "route_weight_sha256": "29ab8bc26911b7d3b14987ccf2d6c59fc5842877f9af1412cca45af4ac5f4971", + "loads": [ + 6, + 5, + 13, + 14, + 11, + 8, + 16, + 10, + 4, + 11, + 6, + 1, + 3, + 7, + 5, + 1, + 7, + 3, + 1, + 3, + 1, + 3, + 3, + 19, + 12, + 14, + 4, + 1, + 2, + 1, + 4, + 0, + 5, + 11, + 0, + 3, + 2, + 3, + 7, + 2, + 12, + 1, + 10, + 2, + 1, + 15, + 25, + 8, + 2, + 2, + 5, + 6, + 5, + 8, + 15, + 5, + 4, + 22, + 4, + 1, + 5, + 0, + 8, + 4 + ], + "weighted_loads": [ + 0.2560185738839209, + 0.24702871218323708, + 0.5406249072402716, + 0.543800899758935, + 0.4449163097888231, + 0.27561876457184553, + 0.918106272816658, + 0.3834592252969742, + 0.15999677404761314, + 0.46676631830632687, + 0.31439200788736343, + 0.04348941892385483, + 0.21830005291849375, + 0.302454037591815, + 0.23404677584767342, + 0.02518729865550995, + 0.42317209392786026, + 0.20744097605347633, + 0.05632544681429863, + 0.1281765028834343, + 0.02627541311085224, + 0.10507097654044628, + 0.12014833092689514, + 1.9153891745954752, + 0.4522539973258972, + 0.929268978536129, + 0.31582866609096527, + 0.05131743848323822, + 0.07958515733480453, + 0.070756696164608, + 0.3346953373402357, + 0.0, + 0.209628377109766, + 0.5788586270064116, + 0.0, + 0.14887987822294235, + 0.08280279487371445, + 0.10850563459098339, + 0.46956530027091503, + 0.06602627970278263, + 0.6258461214601994, + 0.027734864503145218, + 0.35759139619767666, + 0.11152780801057816, + 0.03566748648881912, + 1.3999401330947876, + 1.748210046440363, + 0.3416299233213067, + 0.08344048634171486, + 0.1127511952072382, + 0.24063126742839813, + 0.287385368719697, + 0.4574800804257393, + 0.30059316009283066, + 1.1841047331690788, + 0.2316496316343546, + 0.22691983729600906, + 2.1670084819197655, + 0.2264857441186905, + 0.14882756769657135, + 0.2344312220811844, + 0.0, + 0.2943689115345478, + 0.15642381086945534 + ], + "unique_experts": 61, + "load_cv": 0.8767377557452396, + "normalized_load_entropy": 0.9138538578689601, + "max_load_share": 0.06218905472636816 + } + }, + "s1_period": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "dff86ffad3e02942ddf51e4eb8c4d619dc2a39ab7cf6c19a5182f01138e313e5", + "route_weight_sha256": "c62c97e91bd1b7151e48f8a5c0989016b65e8d943191b6f51ffffce5fa8316e8", + "loads": [ + 3, + 1, + 13, + 3, + 8, + 5, + 9, + 2, + 6, + 3, + 6, + 0, + 2, + 2, + 3, + 0, + 5, + 3, + 1, + 3, + 1, + 3, + 3, + 9, + 7, + 14, + 5, + 1, + 2, + 1, + 3, + 0, + 5, + 7, + 0, + 2, + 2, + 3, + 4, + 1, + 6, + 1, + 5, + 2, + 0, + 8, + 16, + 6, + 1, + 2, + 5, + 4, + 5, + 5, + 5, + 2, + 4, + 9, + 2, + 1, + 5, + 0, + 5, + 2 + ], + "weighted_loads": [ + 0.10208368860185146, + 0.03619606792926788, + 0.5334091037511826, + 0.328535333275795, + 0.29511117190122604, + 0.17906996607780457, + 0.43967392295598984, + 0.06226599961519241, + 0.20997131615877151, + 0.1624131090939045, + 0.3457716479897499, + 0.0, + 0.19773778691887856, + 0.09691609814763069, + 0.1089830081909895, + 0.0, + 0.42109022475779057, + 0.20457077771425247, + 0.05761722847819328, + 0.1256121974438429, + 0.027175787836313248, + 0.09273736551404, + 0.13002098351716995, + 0.7301265951246023, + 0.26599254459142685, + 0.9076568707823753, + 0.3715504202991724, + 0.05068376287817955, + 0.07542456313967705, + 0.0697745531797409, + 0.27403952181339264, + 0.0, + 0.17093468643724918, + 0.2782124113291502, + 0.0, + 0.11373671516776085, + 0.0733184814453125, + 0.10900437645614147, + 0.20698302425444126, + 0.04015912115573883, + 0.3323734812438488, + 0.028037073090672493, + 0.20715725421905518, + 0.11772570013999939, + 0.0, + 0.2884890381246805, + 0.9188176561146975, + 0.2664095591753721, + 0.03032633475959301, + 0.10397595539689064, + 0.2420346662402153, + 0.15998063050210476, + 0.4279714487493038, + 0.18844477459788322, + 0.26014387607574463, + 0.10736089572310448, + 0.21423964574933052, + 0.9703365098685026, + 0.06819741614162922, + 0.1422971934080124, + 0.21223985217511654, + 0.0, + 0.1946412343531847, + 0.05263571813702583 + ], + "unique_experts": 58, + "load_cv": 0.8445578155189225, + "normalized_load_entropy": 0.9184397429046576, + "max_load_share": 0.06349206349206349 + }, + "full_input": { + "tokens": 83, + "top_k": 6, + "decisions": 498, + "ordered_route_sha256": "edbf5195b1c9b01ecdb1841f1914ba97ea2f6d874da3f80a1dd4a0cb88e669ab", + "route_weight_sha256": "4cdbee5e33ffddda01b642b79e73cdef9ddb9048486c8894247431a2fdc665de", + "loads": [ + 7, + 7, + 19, + 14, + 11, + 8, + 24, + 11, + 7, + 8, + 8, + 0, + 3, + 7, + 4, + 3, + 11, + 4, + 3, + 3, + 2, + 4, + 4, + 24, + 10, + 15, + 5, + 1, + 2, + 2, + 3, + 0, + 6, + 19, + 0, + 2, + 8, + 4, + 13, + 2, + 14, + 1, + 7, + 2, + 2, + 14, + 34, + 9, + 8, + 5, + 5, + 14, + 11, + 7, + 17, + 3, + 4, + 25, + 4, + 1, + 7, + 1, + 11, + 4 + ], + "weighted_loads": [ + 0.37499764980748296, + 0.38490820303559303, + 0.8516927473247051, + 0.9130729679018259, + 0.4267534650862217, + 0.2597765037789941, + 1.2945126742124557, + 0.38247058913111687, + 0.2460564747452736, + 0.3501061163842678, + 0.4380900375545025, + 0.0, + 0.20793317072093487, + 0.3049856461584568, + 0.2013865914195776, + 0.122614074498415, + 0.5765360984951258, + 0.2670161798596382, + 0.1489749476313591, + 0.1256121974438429, + 0.07278917729854584, + 0.13718780130147934, + 0.1485596615821123, + 2.5861449111253023, + 0.3689536564052105, + 0.937292605638504, + 0.3715504202991724, + 0.05068376287817955, + 0.07542456313967705, + 0.11574844270944595, + 0.27403952181339264, + 0.0, + 0.21572416462004185, + 1.058558277785778, + 0.0, + 0.11373671516776085, + 0.5051994882524014, + 0.1541492771357298, + 0.8468762403354049, + 0.06303345784544945, + 0.6663532238453627, + 0.028037073090672493, + 0.2611991446465254, + 0.11772570013999939, + 0.10314017161726952, + 1.3730940390378237, + 2.619633534923196, + 0.4974569948390126, + 0.316716929897666, + 0.2553102485835552, + 0.2420346662402153, + 0.7718836329877377, + 1.0692740119993687, + 0.2624785415828228, + 1.3434750735759735, + 0.13816607370972633, + 0.21423964574933052, + 2.54142471216619, + 0.19333750568330288, + 0.1422971934080124, + 0.28693591244518757, + 0.12467562407255173, + 0.42770858481526375, + 0.15898612514138222 + ], + "unique_experts": 61, + "load_cv": 0.8829406550017019, + "normalized_load_entropy": 0.9155481253222099, + "max_load_share": 0.06827309236947791 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 42, + "ordered_topk_exact_tokens": 20, + "set_exact_tokens": 24, + "mean_set_jaccard": 0.8622448979591839, + "mean_token_weighted_tv": 0.024781358450473773, + "aggregate_load_tv": 0.07936507936507936 + }, + "system_bos": { + "tokens": 42, + "ordered_topk_exact_tokens": 17, + "set_exact_tokens": 23, + "mean_set_jaccard": 0.8503401360544218, + "mean_token_weighted_tv": 0.025676387983063858, + "aggregate_load_tv": 0.06349206349206349 + }, + "system_x": { + "tokens": 42, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.7681405895691611, + "mean_token_weighted_tv": 0.042701820332911755, + "aggregate_load_tv": 0.09523809523809523 + }, + "system_period": { + "tokens": 42, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.8242630385487528, + "mean_token_weighted_tv": 0.03512638017889999, + "aggregate_load_tv": 0.07539682539682539 + }, + "bos_at_s0": { + "tokens": 42, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 18, + "mean_set_jaccard": 0.806122448979592, + "mean_token_weighted_tv": 0.03526176552155188, + "aggregate_load_tv": 0.06746031746031746 + }, + "bos_at_s1": { + "tokens": 42, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.7913832199546486, + "mean_token_weighted_tv": 0.03840734182103049, + "aggregate_load_tv": 0.0992063492063492 + }, + "x_at_s0": { + "tokens": 42, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.8129251700680273, + "mean_token_weighted_tv": 0.034195629835483576, + "aggregate_load_tv": 0.06349206349206349 + }, + "x_at_s1": { + "tokens": 42, + "ordered_topk_exact_tokens": 5, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.7647392290249433, + "mean_token_weighted_tv": 0.04663364606953803, + "aggregate_load_tv": 0.08333333333333333 + }, + "period_at_s0": { + "tokens": 42, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 18, + "mean_set_jaccard": 0.8112244897959184, + "mean_token_weighted_tv": 0.03449906847838845, + "aggregate_load_tv": 0.06746031746031746 + }, + "period_at_s1": { + "tokens": 42, + "ordered_topk_exact_tokens": 8, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.7868480725623583, + "mean_token_weighted_tv": 0.041150887785035936, + "aggregate_load_tv": 0.06349206349206349 + } + } + }, + "layer_24": { + "layer": 24, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "96c599b141937b9cc617874e182905d420865b5b4561192fafd3469a03440ff4", + "route_weight_sha256": "fe79a95f75e8cc8a0b22b4b87a44a30b666f3438b13221c0c485dd427290e7ca", + "loads": [ + 1, + 3, + 5, + 4, + 1, + 8, + 1, + 8, + 5, + 1, + 2, + 1, + 2, + 3, + 4, + 8, + 6, + 3, + 3, + 1, + 6, + 0, + 10, + 5, + 10, + 6, + 3, + 1, + 4, + 3, + 2, + 5, + 1, + 2, + 2, + 1, + 6, + 2, + 7, + 4, + 2, + 2, + 4, + 5, + 2, + 6, + 0, + 5, + 4, + 0, + 9, + 8, + 6, + 6, + 4, + 3, + 0, + 2, + 5, + 1, + 11, + 12, + 0, + 5 + ], + "weighted_loads": [ + 0.03555654361844063, + 0.10704690590500832, + 0.18177843652665615, + 0.19593805260956287, + 0.027513163164258003, + 0.25673787109553814, + 0.005388419143855572, + 0.3085265924455598, + 0.2542272638529539, + 0.07610270380973816, + 0.08612052723765373, + 0.037494804710149765, + 0.20242560282349586, + 0.13239912316203117, + 0.15460090711712837, + 0.29963062703609467, + 0.20544779859483242, + 0.07576781651005149, + 0.1380033828318119, + 0.0005652036634273827, + 0.2039729319512844, + 0.0, + 0.6928320452570915, + 0.525142602622509, + 0.40804304368793964, + 0.19546941854059696, + 0.0812242217361927, + 0.0026636479888111353, + 0.17084166780114174, + 0.1782791018486023, + 0.03148959460668266, + 0.16103083826601505, + 0.031877003610134125, + 0.046117173274978995, + 0.03155858034733683, + 0.022241704165935516, + 0.2737074065953493, + 0.05588719993829727, + 0.25503500550985336, + 0.121425686404109, + 0.06730398163199425, + 0.05723255127668381, + 0.16057300567626953, + 0.19412491656839848, + 0.07675885409116745, + 0.18318220786750317, + 0.0, + 0.18880154751241207, + 0.1170862428843975, + 0.0, + 2.2592503875494003, + 0.5969651024788618, + 0.17221684381365776, + 0.27029363438487053, + 0.3745327368378639, + 0.272980909794569, + 0.0, + 0.07102320343255997, + 0.4623171538114548, + 0.029481250792741776, + 0.4320323895663023, + 0.9539150018244982, + 0.0, + 0.16783455898985267 + ], + "unique_experts": 59, + "load_cv": 0.7348023491493781, + "normalized_load_entropy": 0.9311191205041379, + "max_load_share": 0.047619047619047616 + }, + "full_input": { + "tokens": 67, + "top_k": 6, + "decisions": 402, + "ordered_route_sha256": "92f8786640a24830c3ab814fbc81809a04f8ed0c429e30581108ee92dbfb3100", + "route_weight_sha256": "36fb68b526f8f2701c3649c73a06d5560cb758eab92092e3e3e561444ac024be", + "loads": [ + 1, + 3, + 8, + 4, + 1, + 13, + 1, + 9, + 13, + 1, + 12, + 1, + 4, + 3, + 8, + 8, + 6, + 3, + 3, + 1, + 7, + 1, + 17, + 5, + 17, + 6, + 3, + 1, + 11, + 8, + 2, + 7, + 3, + 6, + 10, + 1, + 7, + 5, + 8, + 4, + 2, + 3, + 9, + 7, + 2, + 8, + 0, + 11, + 4, + 0, + 15, + 14, + 11, + 9, + 4, + 3, + 0, + 3, + 13, + 2, + 12, + 29, + 2, + 7 + ], + "weighted_loads": [ + 0.03555654361844063, + 0.10704690590500832, + 0.291686724871397, + 0.19593805260956287, + 0.027513163164258003, + 0.4156434539472684, + 0.005388419143855572, + 0.3626077977241948, + 0.6106659015640616, + 0.07610270380973816, + 0.4529733853414655, + 0.037494804710149765, + 0.241854686755687, + 0.13239912316203117, + 0.28164498321712017, + 0.29963062703609467, + 0.20544779859483242, + 0.07576781651005149, + 0.1380033828318119, + 0.0005652036634273827, + 0.23790216818451881, + 0.0435030460357666, + 1.1329270526766777, + 0.525142602622509, + 0.6776661465410143, + 0.19546941854059696, + 0.0812242217361927, + 0.0026636479888111353, + 0.44625793769955635, + 0.3737797439098358, + 0.03148959460668266, + 0.22761907614767551, + 0.09864426404237747, + 0.23191948956809938, + 0.2987457752460614, + 0.022241704165935516, + 0.3689761105924845, + 0.9975806437432766, + 0.3028980679810047, + 0.121425686404109, + 0.06730398163199425, + 0.11425638943910599, + 0.37309354241006076, + 0.2723915409296751, + 0.07675885409116745, + 0.28598818741738796, + 0.0, + 0.5734261739999056, + 0.1170862428843975, + 0.0, + 2.528022490441799, + 1.029360393062234, + 0.31975327618420124, + 0.40953075513243675, + 0.3745327368378639, + 0.272980909794569, + 0.0, + 0.10512220859527588, + 0.7241971989860758, + 0.06697186082601547, + 0.4712482038885355, + 2.067881381139159, + 0.00290865870192647, + 2.1045120148919523 + ], + "unique_experts": 61, + "load_cv": 0.8426486110860818, + "normalized_load_entropy": 0.9195010374663289, + "max_load_share": 0.07213930348258707 + } + }, + "s1_eos": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "adea971a2163a15b092d93cdac8ad915b9b1a3f9c87de2e7cf31e35d434f18ad", + "route_weight_sha256": "48e91c0e3cbfbffeec390b5b0eafb08e407880e964381896d6c62d01b8290962", + "loads": [ + 1, + 4, + 5, + 3, + 1, + 5, + 1, + 6, + 4, + 1, + 2, + 0, + 2, + 3, + 4, + 7, + 6, + 3, + 3, + 1, + 7, + 1, + 10, + 4, + 10, + 4, + 2, + 1, + 4, + 5, + 2, + 6, + 1, + 2, + 4, + 1, + 8, + 4, + 4, + 4, + 3, + 4, + 5, + 5, + 2, + 6, + 0, + 5, + 4, + 0, + 8, + 7, + 6, + 6, + 4, + 3, + 0, + 1, + 6, + 2, + 11, + 12, + 0, + 6 + ], + "weighted_loads": [ + 0.036377210170030594, + 0.13581057451665401, + 0.18220821768045425, + 0.17407221160829067, + 0.028048662468791008, + 0.17225697822868824, + 0.00459597771987319, + 0.2924106866121292, + 0.21877754107117653, + 0.07580683380365372, + 0.08250315859913826, + 0.0, + 0.20342518389225006, + 0.12827416136860847, + 0.15160682424902916, + 0.26298097148537636, + 0.20893639884889126, + 0.07618724241910968, + 0.1339525394141674, + 5.4301450290950015e-05, + 0.23609260097146034, + 0.03822153061628342, + 0.6765656173229218, + 0.5096108354628086, + 0.41274750232696533, + 0.1343410722911358, + 0.051970269065350294, + 0.0027528649661689997, + 0.16963333263993263, + 0.24450967088341713, + 0.0319968203548342, + 0.2041705586016178, + 0.03408366069197655, + 0.04449556958570611, + 0.08600425483018626, + 0.023268476128578186, + 0.3362698182463646, + 0.10844046995043755, + 0.16351845487952232, + 0.1177937500178814, + 0.09410180523991585, + 0.11467543430626392, + 0.1675132691852923, + 0.19789820350706577, + 0.07548744231462479, + 0.18667292408645153, + 0.0, + 0.19887061044573784, + 0.11817402206361294, + 0.0, + 2.255495263263583, + 0.5723592657595873, + 0.17274228297173977, + 0.2646300233900547, + 0.38121601939201355, + 0.2709328196942806, + 0.0, + 0.031170332804322243, + 0.4833691455423832, + 0.061266761273145676, + 0.3988579623401165, + 1.0450574681162834, + 0.0, + 0.2169820189010352 + ], + "unique_experts": 59, + "load_cv": 0.6996741854137838, + "normalized_load_entropy": 0.9362055950748285, + "max_load_share": 0.047619047619047616 + }, + "full_input": { + "tokens": 83, + "top_k": 6, + "decisions": 498, + "ordered_route_sha256": "94fda5ceb34f5e58407a171809d23ccf47b9e3b900911cfc82f2ee74ab9df691", + "route_weight_sha256": "d40c903f774ddac441159f850954a8328a78b0c665069430068accd82c80af46", + "loads": [ + 1, + 4, + 6, + 4, + 3, + 14, + 1, + 7, + 13, + 4, + 11, + 2, + 6, + 3, + 7, + 7, + 6, + 3, + 4, + 3, + 12, + 2, + 22, + 5, + 20, + 4, + 2, + 1, + 24, + 10, + 2, + 9, + 1, + 8, + 10, + 3, + 15, + 7, + 5, + 4, + 4, + 12, + 11, + 8, + 4, + 7, + 0, + 13, + 4, + 0, + 14, + 21, + 12, + 10, + 7, + 5, + 0, + 2, + 21, + 3, + 15, + 31, + 7, + 12 + ], + "weighted_loads": [ + 0.036377210170030594, + 0.13581057451665401, + 0.2073082122951746, + 0.2832046505063772, + 0.08896294422447681, + 0.4494210894918069, + 0.00459597771987319, + 0.32944419980049133, + 0.8176968488842249, + 0.20603638142347336, + 0.4360163686797023, + 0.06610120460391045, + 0.30110663757659495, + 0.12827416136860847, + 0.2548105865716934, + 0.26298097148537636, + 0.20893639884889126, + 0.07618724241910968, + 0.16599850356578827, + 0.058471668267884525, + 0.4595431014895439, + 0.07802519202232361, + 1.3998673558235168, + 0.5342922396957874, + 0.775334948906675, + 0.1343410722911358, + 0.051970269065350294, + 0.0027528649661689997, + 1.1455737315118313, + 0.46439420990645885, + 0.0319968203548342, + 0.34335820749402046, + 0.03408366069197655, + 0.3565942105342401, + 0.3080351571115898, + 0.12256509438157082, + 0.8646904230117798, + 1.0580376908183098, + 0.2149445079267025, + 0.1177937500178814, + 0.20839671418070793, + 0.5674466677010059, + 0.4083471621379431, + 0.4565973114222288, + 0.17028146982192993, + 0.245865723118186, + 0.0, + 0.7372000502655283, + 0.11817402206361294, + 0.0, + 2.5235577039420605, + 1.5610915143042803, + 0.34604132175445557, + 0.5588268227875233, + 0.5855092480778694, + 0.3646382540464401, + 0.0, + 0.07041011564433575, + 1.0790229836129583, + 0.10276712849736214, + 0.5203840229660273, + 2.8115894380025566, + 0.3496224844129756, + 2.3222686655353755 + ], + "unique_experts": 61, + "load_cv": 0.832081606964351, + "normalized_load_entropy": 0.922220037742389, + "max_load_share": 0.06224899598393574 + } + }, + "s0_bos": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "5b96659453d1376f7a6d57e47a1aca046ccefe3b693bf091128e9c0eefd94f9d", + "route_weight_sha256": "c1c2867f84b834939dc40e56ea8e158a61bce2f4dcc9358e5cda62fc5c5f9cb3", + "loads": [ + 0, + 4, + 7, + 2, + 1, + 7, + 3, + 7, + 5, + 1, + 2, + 1, + 2, + 3, + 3, + 9, + 6, + 3, + 3, + 1, + 7, + 2, + 11, + 5, + 13, + 6, + 2, + 1, + 4, + 5, + 3, + 4, + 1, + 2, + 3, + 0, + 5, + 2, + 5, + 5, + 1, + 4, + 6, + 4, + 0, + 4, + 0, + 4, + 3, + 0, + 9, + 10, + 5, + 4, + 4, + 3, + 0, + 2, + 5, + 1, + 10, + 10, + 1, + 6 + ], + "weighted_loads": [ + 0.0, + 0.14496572874486446, + 0.25039767287671566, + 0.12921019084751606, + 0.02830476127564907, + 0.22619006969034672, + 0.07915353681892157, + 0.31608780287206173, + 0.24246053025126457, + 0.07710634917020798, + 0.08526244014501572, + 0.04087875783443451, + 0.2046126127243042, + 0.13196124508976936, + 0.13527318090200424, + 0.3351309336721897, + 0.20332271419465542, + 0.07777257363704848, + 0.14019428938627243, + 4.907388938590884e-05, + 0.239973409101367, + 0.06289028562605381, + 0.679742818698287, + 0.5059613659977913, + 0.4929501097649336, + 0.19789454713463783, + 0.05971095897257328, + 0.002953137271106243, + 0.18115562200546265, + 0.24182088486850262, + 0.06551773939281702, + 0.13578862696886063, + 0.02484907954931259, + 0.04383703792700544, + 0.06701745063764974, + 0.0, + 0.25427134335041046, + 0.056108150631189346, + 0.19847330264747143, + 0.1456558983772993, + 0.038615304976701736, + 0.11526341922581196, + 0.23758820888906484, + 0.16665717773139477, + 0.0, + 0.13015288300812244, + 0.0, + 0.15165962278842926, + 0.0945894755423069, + 0.0, + 2.2553584091365337, + 0.6771713402122259, + 0.14722358249127865, + 0.197734996676445, + 0.40024250745773315, + 0.28055696189403534, + 0.0, + 0.06018909439444542, + 0.4678593948483467, + 0.0305497944355011, + 0.4048708211630583, + 0.942810783162713, + 0.02568136528134346, + 0.20066012698225677 + ], + "unique_experts": 58, + "load_cv": 0.755095231255003, + "normalized_load_entropy": 0.9279645731208107, + "max_load_share": 0.051587301587301584 + }, + "full_input": { + "tokens": 67, + "top_k": 6, + "decisions": 402, + "ordered_route_sha256": "ef3065ec79fd0fdc985bd66281e112232363b29553f1ae52bc13e59d759e62ef", + "route_weight_sha256": "b04f5d441df28a7e4ad0c6d6b49cf0a5828013a791f4860d544c0ed054026979", + "loads": [ + 0, + 4, + 10, + 2, + 1, + 11, + 4, + 8, + 12, + 1, + 11, + 1, + 4, + 3, + 6, + 9, + 7, + 3, + 3, + 1, + 8, + 3, + 19, + 5, + 21, + 6, + 3, + 1, + 11, + 10, + 4, + 9, + 4, + 6, + 10, + 0, + 6, + 4, + 5, + 5, + 1, + 5, + 12, + 4, + 1, + 6, + 1, + 8, + 3, + 0, + 16, + 16, + 9, + 8, + 4, + 3, + 0, + 3, + 12, + 2, + 11, + 27, + 2, + 7 + ], + "weighted_loads": [ + 0.0, + 0.14496572874486446, + 0.35053765773773193, + 0.12921019084751606, + 0.02830476127564907, + 0.35490931977983564, + 0.14261876698583364, + 0.37016900815069675, + 0.5943926610052586, + 0.07710634917020798, + 0.4363349499180913, + 0.04087875783443451, + 0.2497498062439263, + 0.13196124508976936, + 0.22752985544502735, + 0.3351309336721897, + 0.2361822072416544, + 0.07777257363704848, + 0.14019428938627243, + 4.907388938590884e-05, + 0.2739026453346014, + 0.10085869766771793, + 1.2758369948714972, + 0.5059613659977913, + 0.800310697639361, + 0.19789454713463783, + 0.4830373916774988, + 0.002953137271106243, + 0.45657189190387726, + 0.43732152692973614, + 0.10545790288597345, + 0.30988047271966934, + 0.14823903515934944, + 0.22963935422012582, + 0.277854876301717, + 0.0, + 0.3495400473475456, + 0.9609051644802094, + 0.19847330264747143, + 0.1456558983772993, + 0.038615304976701736, + 0.17228725738823414, + 0.5249233725699014, + 0.16665717773139477, + 0.037315718829631805, + 0.2463840004056692, + 0.06381694227457047, + 0.5255236260127276, + 0.0945894755423069, + 0.0, + 2.5636672377586365, + 1.0614913683384657, + 0.2606457993388176, + 0.3655308783054352, + 0.40024250745773315, + 0.28055696189403534, + 0.0, + 0.09254341199994087, + 0.7359860930591822, + 0.06826430559158325, + 0.4440866354852915, + 2.0553695987910032, + 0.027388280257582664, + 1.1679368789773434 + ], + "unique_experts": 60, + "load_cv": 0.8515314522743829, + "normalized_load_entropy": 0.9181353912457177, + "max_load_share": 0.06716417910447761 + } + }, + "s1_bos": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "83c90cdbb84d8a223869c8bb5f1a4dc06736715ea9836190fc9009e67a5a53d1", + "route_weight_sha256": "ad99b4129ac0e0ace34db9e6ee5babedf82eca28a8599788a3f20022eed0b088", + "loads": [ + 2, + 4, + 5, + 1, + 1, + 6, + 1, + 7, + 5, + 1, + 3, + 1, + 2, + 3, + 3, + 8, + 6, + 3, + 3, + 2, + 7, + 0, + 9, + 5, + 14, + 5, + 3, + 1, + 4, + 5, + 3, + 7, + 1, + 2, + 4, + 0, + 5, + 2, + 4, + 4, + 1, + 5, + 6, + 4, + 1, + 5, + 0, + 4, + 4, + 0, + 8, + 8, + 4, + 6, + 4, + 3, + 0, + 2, + 5, + 1, + 10, + 11, + 2, + 6 + ], + "weighted_loads": [ + 0.06124079413712025, + 0.13524660468101501, + 0.19672702252864838, + 0.0960417166352272, + 0.02602800540626049, + 0.1987870242446661, + 0.008642231114208698, + 0.304396552965045, + 0.25385744124650955, + 0.07494182139635086, + 0.10950984433293343, + 0.040871597826480865, + 0.2077924981713295, + 0.13306275010108948, + 0.1271487958729267, + 0.3003864139318466, + 0.20980508998036385, + 0.07291427263407968, + 0.1308218128979206, + 0.02582990424707532, + 0.23430847376585007, + 0.0, + 0.6193709298968315, + 0.5264339745044708, + 0.5279456619173288, + 0.17262892238795757, + 0.07291048485785723, + 0.002913110191002488, + 0.170491062104702, + 0.26341981813311577, + 0.06647638184949756, + 0.23267734423279762, + 0.03289133310317993, + 0.04254491072060773, + 0.0897404774223105, + 0.0, + 0.24137781001627445, + 0.05571735464036465, + 0.17160595022141933, + 0.11897396296262741, + 0.04252239316701889, + 0.13844366185367107, + 0.2722785780024424, + 0.16763013787567616, + 0.039644256234169006, + 0.15920286066830158, + 0.0, + 0.16426547057926655, + 0.12171013653278351, + 0.0, + 2.211571717634797, + 0.6550799421966076, + 0.10656824707984924, + 0.275423277169466, + 0.40437351539731026, + 0.2833251431584358, + 0.0, + 0.07036696001887321, + 0.4543834812939167, + 0.031873639672994614, + 0.37937290221452713, + 0.9739443138241768, + 0.055255403742194176, + 0.21054508280940354 + ], + "unique_experts": 59, + "load_cv": 0.7237468644557459, + "normalized_load_entropy": 0.9339550432369208, + "max_load_share": 0.05555555555555555 + }, + "full_input": { + "tokens": 83, + "top_k": 6, + "decisions": 498, + "ordered_route_sha256": "0a477f52b1e78f9b859620ebc5289ce526598df3f329308a51520bf62a743816", + "route_weight_sha256": "180a29c3e58e7cda8e0ec02051dc784c4615984fb6effe3c40867cf5d4ab4faa", + "loads": [ + 2, + 4, + 7, + 2, + 3, + 15, + 1, + 8, + 13, + 4, + 11, + 3, + 6, + 3, + 6, + 8, + 6, + 3, + 4, + 5, + 12, + 0, + 22, + 6, + 24, + 5, + 3, + 1, + 24, + 10, + 3, + 12, + 1, + 8, + 10, + 2, + 12, + 5, + 5, + 4, + 2, + 12, + 13, + 8, + 3, + 7, + 0, + 11, + 4, + 0, + 15, + 22, + 11, + 10, + 7, + 5, + 0, + 3, + 18, + 2, + 13, + 31, + 8, + 10 + ], + "weighted_loads": [ + 0.06124079413712025, + 0.13524660468101501, + 0.24455424770712852, + 0.20517415553331375, + 0.0869422871619463, + 0.4722656108206138, + 0.008642231114208698, + 0.3414300661534071, + 0.8484312072396278, + 0.2051713690161705, + 0.45768142212182283, + 0.10697280243039131, + 0.3086524105165154, + 0.13306275010108948, + 0.22520968317985535, + 0.3003864139318466, + 0.20980508998036385, + 0.07291427263407968, + 0.16286777704954147, + 0.11501106666401029, + 0.45775897428393364, + 0.0, + 1.468335323035717, + 0.5511153787374496, + 0.8895078564528376, + 0.17262892238795757, + 0.07291048485785723, + 0.002913110191002488, + 1.1464314609766006, + 0.4833043571561575, + 0.06647638184949756, + 0.44890836253762245, + 0.03289133310317993, + 0.35464355166914174, + 0.3055974933449761, + 0.09929661825299263, + 0.7697984147816896, + 1.0002991501241922, + 0.21563137881457806, + 0.11897396296262741, + 0.15681730210781097, + 0.5530190877616405, + 0.6591452848915651, + 0.4972823057323694, + 0.13706987351179123, + 0.2585636470466852, + 0.0, + 0.728106654016301, + 0.12171013653278351, + 0.0, + 2.585037926211953, + 1.5936030857264996, + 0.3082601744681597, + 0.5696200765669346, + 0.6086667440831661, + 0.3770305775105953, + 0.0, + 0.11358990147709846, + 1.035839043557644, + 0.07385582104325294, + 0.47112671472132206, + 2.7652915264479816, + 0.40359424985945225, + 1.300808233441785 + ], + "unique_experts": 60, + "load_cv": 0.8404136242095916, + "normalized_load_entropy": 0.9201565412906243, + "max_load_share": 0.06224899598393574 + } + }, + "s0_x": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "cf36a81e4352bb67beae35bd96d73b2ec8ba724aeaad293563485e28a32e408e", + "route_weight_sha256": "9dc07121d2c62231e387ba393b887d51438b561ee915b3d6cfb44351c2ecbd9e", + "loads": [ + 0, + 6, + 6, + 3, + 1, + 8, + 1, + 8, + 4, + 1, + 2, + 1, + 2, + 3, + 4, + 9, + 6, + 4, + 4, + 1, + 6, + 1, + 10, + 5, + 12, + 6, + 3, + 0, + 4, + 4, + 2, + 6, + 0, + 2, + 2, + 0, + 6, + 1, + 5, + 4, + 1, + 4, + 3, + 4, + 1, + 6, + 0, + 4, + 3, + 0, + 8, + 8, + 6, + 6, + 4, + 3, + 0, + 2, + 6, + 1, + 13, + 11, + 1, + 4 + ], + "weighted_loads": [ + 0.0, + 0.19547301530838013, + 0.20892317034304142, + 0.15960005670785904, + 0.02512383460998535, + 0.2714374363422394, + 0.008482473902404308, + 0.3153977780311834, + 0.23293732479214668, + 0.07533781975507736, + 0.08356855437159538, + 0.03406010940670967, + 0.20076781883835793, + 0.13151198625564575, + 0.16219458729028702, + 0.35265612229704857, + 0.19403952173888683, + 0.10414082978968509, + 0.1670678686350584, + 0.00037973624421283603, + 0.2177976332604885, + 0.03718138113617897, + 0.5724101383239031, + 0.5067926608026028, + 0.4392286892980337, + 0.2060132473707199, + 0.07033685967326164, + 0.0, + 0.1701081246137619, + 0.22148675844073296, + 0.0368282743729651, + 0.19338954612612724, + 0.0, + 0.048124851658940315, + 0.031468006811337546, + 0.0, + 0.2777202147990465, + 0.028175082057714462, + 0.2088475450873375, + 0.1223768088966608, + 0.04051128029823303, + 0.11388079635798931, + 0.12995262071490288, + 0.15621013939380646, + 0.03581077605485916, + 0.1560869172681123, + 0.0, + 0.1557608675211668, + 0.09601727686822414, + 0.0, + 2.175367593765259, + 0.6287738271057606, + 0.17024149931967258, + 0.2765332981944084, + 0.3813896030187607, + 0.26830149441957474, + 0.0, + 0.06217794679105282, + 0.49205680936574936, + 0.031840980052948, + 0.5214979741722345, + 0.9333751332014799, + 0.025672532618045807, + 0.13390225544571877 + ], + "unique_experts": 57, + "load_cv": 0.7813329824913631, + "normalized_load_entropy": 0.9212902047626822, + "max_load_share": 0.051587301587301584 + }, + "full_input": { + "tokens": 67, + "top_k": 6, + "decisions": 402, + "ordered_route_sha256": "7e9937efc6c7d755ac7c396177e0f759e0a78ced21a914ea92d84da03735979e", + "route_weight_sha256": "d01207ae93ce24a69adb4d5678f17f9899b4f095cc6d41ebe6b942de4b8446f3", + "loads": [ + 0, + 6, + 8, + 3, + 1, + 13, + 1, + 10, + 12, + 1, + 11, + 1, + 5, + 3, + 8, + 9, + 6, + 4, + 4, + 1, + 7, + 1, + 17, + 5, + 19, + 6, + 3, + 0, + 12, + 9, + 2, + 7, + 3, + 6, + 11, + 1, + 8, + 3, + 6, + 4, + 2, + 5, + 7, + 5, + 1, + 7, + 0, + 9, + 3, + 0, + 14, + 14, + 10, + 10, + 4, + 3, + 0, + 3, + 14, + 2, + 16, + 28, + 2, + 6 + ], + "weighted_loads": [ + 0.0, + 0.19547301530838013, + 0.282501008361578, + 0.15960005670785904, + 0.02512383460998535, + 0.4295605014776811, + 0.008482473902404308, + 0.40430292623932473, + 0.6655249558389187, + 0.07533781975507736, + 0.45312211010605097, + 0.03406010940670967, + 0.27782579930499196, + 0.13151198625564575, + 0.28769373893737793, + 0.35265612229704857, + 0.19403952173888683, + 0.10414082978968509, + 0.1670678686350584, + 0.00037973624421283603, + 0.2517268694937229, + 0.03718138113617897, + 1.0014476049691439, + 0.5067926608026028, + 0.7088517921511084, + 0.2060132473707199, + 0.07033685967326164, + 0.0, + 0.4822363965213299, + 0.4169874005019665, + 0.0368282743729651, + 0.2262362763285637, + 0.10641581565141678, + 0.2339271679520607, + 0.32882652155240066, + 0.03574419021606445, + 0.4149938244372606, + 0.9308192655444145, + 0.24547719210386276, + 0.1223768088966608, + 0.07462676241993904, + 0.1709046345204115, + 0.26061700540594757, + 0.19138234853744507, + 0.03581077605485916, + 0.21359217097051442, + 0.0, + 0.5607299532275647, + 0.09601727686822414, + 0.0, + 2.395278014242649, + 1.0673995353281498, + 0.2928118072450161, + 0.4641367457807064, + 0.3813896030187607, + 0.26830149441957474, + 0.0, + 0.10828470624983311, + 0.7878007832914591, + 0.06556550413370132, + 0.6236697621643543, + 2.049955850467086, + 0.02737944759428501, + 1.1364485286176205 + ], + "unique_experts": 59, + "load_cv": 0.8580178603311884, + "normalized_load_entropy": 0.9143325309477022, + "max_load_share": 0.06965174129353234 + } + }, + "s1_x": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "fe1578c3bf453db555b7330efb4a2d5515920eb85a473006c20281236d044528", + "route_weight_sha256": "9e1e017e38988738517c48d2dcd23d71c600fd5497857b263a42286871d1f02b", + "loads": [ + 1, + 6, + 5, + 2, + 0, + 8, + 1, + 7, + 4, + 1, + 3, + 0, + 2, + 3, + 4, + 7, + 6, + 3, + 3, + 1, + 6, + 1, + 11, + 4, + 11, + 4, + 2, + 1, + 3, + 5, + 2, + 5, + 0, + 2, + 4, + 1, + 8, + 2, + 5, + 4, + 1, + 3, + 4, + 4, + 1, + 7, + 0, + 5, + 5, + 0, + 8, + 9, + 3, + 6, + 4, + 3, + 0, + 3, + 6, + 1, + 12, + 11, + 2, + 6 + ], + "weighted_loads": [ + 0.037559714168310165, + 0.183631407096982, + 0.18916796147823334, + 0.132020253688097, + 0.0, + 0.26507796719670296, + 0.04448923096060753, + 0.3378985822200775, + 0.2736443020403385, + 0.07377498596906662, + 0.11824263073503971, + 0.0, + 0.20540796220302582, + 0.13278861716389656, + 0.15031227096915245, + 0.26820182241499424, + 0.20366143994033337, + 0.07779073204528686, + 0.11870903894305229, + 1.6393063560826704e-05, + 0.2137878891080618, + 0.03802545741200447, + 0.5554366186261177, + 0.5142339058220387, + 0.4320711325854063, + 0.13930713757872581, + 0.08921463415026665, + 0.027407051995396614, + 0.12459270283579826, + 0.25770068913698196, + 0.050151389092206955, + 0.173381470143795, + 0.0, + 0.05219828293775208, + 0.08224090079784219, + 0.0251990407705307, + 0.36060814931988716, + 0.05835726298391819, + 0.19078224897384644, + 0.1168874241411686, + 0.03885874152183533, + 0.08450849540531635, + 0.13585964376852644, + 0.1593285221606493, + 0.040885284543037415, + 0.20787990372627974, + 0.0, + 0.20224975422024727, + 0.15467661060392857, + 0.0, + 1.9066988416016102, + 0.663609629496932, + 0.0854093749076128, + 0.3009330704808235, + 0.37772081047296524, + 0.25858674570918083, + 0.0, + 0.08900915458798409, + 0.4750344417989254, + 0.030369222164154053, + 0.4324356745928526, + 0.9316030405461788, + 0.05407802201807499, + 0.21168785821646452 + ], + "unique_experts": 58, + "load_cv": 0.7537593695608741, + "normalized_load_entropy": 0.9273144765410385, + "max_load_share": 0.047619047619047616 + }, + "full_input": { + "tokens": 83, + "top_k": 6, + "decisions": 498, + "ordered_route_sha256": "aa39e81fcf1bb87dbddfc02a49c4bb220339f8f4af0ee35c84920e2451f6db03", + "route_weight_sha256": "39144b3ac853fb7bd519e1e358e7b9fd715d8d6db2314810a503adaeb00349e4", + "loads": [ + 1, + 6, + 6, + 3, + 2, + 16, + 1, + 8, + 13, + 4, + 10, + 2, + 5, + 3, + 7, + 7, + 7, + 3, + 4, + 3, + 12, + 1, + 23, + 5, + 21, + 4, + 2, + 1, + 25, + 11, + 2, + 10, + 0, + 9, + 11, + 4, + 17, + 6, + 5, + 4, + 2, + 10, + 8, + 7, + 3, + 8, + 0, + 11, + 5, + 0, + 13, + 23, + 10, + 11, + 7, + 5, + 0, + 4, + 20, + 1, + 17, + 31, + 8, + 10 + ], + "weighted_loads": [ + 0.037559714168310165, + 0.183631407096982, + 0.21426795609295368, + 0.24115269258618355, + 0.060914281755685806, + 0.5077291078632697, + 0.04448923096060753, + 0.37493209540843964, + 0.9184967614710331, + 0.20400453358888626, + 0.42291378509253263, + 0.06610120460391045, + 0.26710088015533984, + 0.13278861716389656, + 0.26328134164214134, + 0.26820182241499424, + 0.23826716281473637, + 0.07779073204528686, + 0.15075500309467316, + 0.0584337598811544, + 0.4701685141772032, + 0.03802545741200447, + 1.2195920404046774, + 0.5389153100550175, + 0.7850050444249064, + 0.13930713757872581, + 0.08921463415026665, + 0.027407051995396614, + 1.1740830391645432, + 0.515911104157567, + 0.050151389092206955, + 0.3725380226969719, + 0.0, + 0.40118505389546044, + 0.339424286810754, + 0.1859334483742714, + 1.0185906514525414, + 1.041130544617772, + 0.19078224897384644, + 0.1168874241411686, + 0.1531536504626274, + 0.4990839213132858, + 0.26708717384190095, + 0.4106833767145872, + 0.11628109961748123, + 0.2670727027580142, + 0.0, + 0.7033358968328685, + 0.15467661060392857, + 0.0, + 2.126062076538801, + 1.6472759898751974, + 0.29336391016840935, + 0.6262446120381355, + 0.5820140391588211, + 0.35229218006134033, + 0.0, + 0.1343303620815277, + 1.082742664963007, + 0.030369222164154053, + 0.6038668006658554, + 2.7498558717779815, + 0.40241686813533306, + 1.3229635199531913 + ], + "unique_experts": 60, + "load_cv": 0.8637339603444748, + "normalized_load_entropy": 0.9156588241702132, + "max_load_share": 0.06224899598393574 + } + }, + "s0_period": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "600b2bf52d858f8dd5a91f1e3a624f67c52ba19a383c633ed076a03aa3c13111", + "route_weight_sha256": "021a7e6ff5ea775d5577e3cd30ba8634e46f4dce0067f6ec76b948e953c93ee1", + "loads": [ + 0, + 6, + 6, + 3, + 0, + 8, + 1, + 8, + 4, + 1, + 2, + 1, + 2, + 3, + 5, + 9, + 6, + 4, + 4, + 1, + 7, + 1, + 9, + 4, + 11, + 6, + 2, + 1, + 4, + 4, + 2, + 5, + 1, + 2, + 2, + 1, + 6, + 0, + 6, + 4, + 1, + 3, + 5, + 5, + 1, + 5, + 0, + 4, + 4, + 0, + 9, + 9, + 3, + 6, + 4, + 3, + 0, + 2, + 6, + 2, + 12, + 11, + 0, + 5 + ], + "weighted_loads": [ + 0.0, + 0.18802710622549057, + 0.21313759870827198, + 0.1625293716788292, + 0.0, + 0.27240962721407413, + 0.017405815422534943, + 0.32975790013733786, + 0.22827787697315216, + 0.07569526135921478, + 0.08317655324935913, + 0.032720692455768585, + 0.19851232692599297, + 0.13020704686641693, + 0.1835700459778309, + 0.35598015040159225, + 0.19766434095799923, + 0.10914528715511551, + 0.16076813079416752, + 0.00010488517727935687, + 0.24499895237386227, + 0.03814217820763588, + 0.5828994885087013, + 0.4842226840555668, + 0.43378912284970284, + 0.20378883928060532, + 0.05708715878427029, + 0.006364680361002684, + 0.1713768132030964, + 0.2218937948346138, + 0.039958344772458076, + 0.16767511516809464, + 0.031799279153347015, + 0.046166911779437214, + 0.030939678981667385, + 0.023069502785801888, + 0.28095427341759205, + 0.0, + 0.24373182840645313, + 0.12448825687170029, + 0.03778153657913208, + 0.09027460403740406, + 0.18803083337843418, + 0.18683442287147045, + 0.03682519868016243, + 0.15650822408497334, + 0.0, + 0.15921886265277863, + 0.12091461382806301, + 0.0, + 2.1556860264390707, + 0.6717897411435843, + 0.09042121469974518, + 0.2692948244512081, + 0.3892590031027794, + 0.2753670960664749, + 0.0, + 0.06505054794251919, + 0.5016813445836306, + 0.06421203166246414, + 0.48035210929811, + 0.9692945312708616, + 0.0, + 0.16188535327091813 + ], + "unique_experts": 57, + "load_cv": 0.7643808970053655, + "normalized_load_entropy": 0.9231932739450558, + "max_load_share": 0.047619047619047616 + }, + "full_input": { + "tokens": 67, + "top_k": 6, + "decisions": 402, + "ordered_route_sha256": "b900cf0125d85e1acb9d2eac525a38876c42d17271a5bcacb2f95e51d893ef21", + "route_weight_sha256": "b3914da21602cf156d2d12b7be3a06f19a1338553293fe97ffe04a6ea3c444ab", + "loads": [ + 0, + 6, + 9, + 3, + 0, + 12, + 1, + 10, + 11, + 1, + 10, + 1, + 4, + 3, + 9, + 9, + 6, + 4, + 4, + 1, + 8, + 1, + 16, + 4, + 18, + 6, + 2, + 1, + 12, + 9, + 2, + 7, + 4, + 7, + 10, + 1, + 7, + 3, + 6, + 4, + 2, + 6, + 10, + 6, + 1, + 6, + 0, + 9, + 4, + 0, + 15, + 16, + 8, + 9, + 4, + 3, + 0, + 4, + 13, + 3, + 14, + 28, + 2, + 7 + ], + "weighted_loads": [ + 0.0, + 0.18802710622549057, + 0.3271733969449997, + 0.1625293716788292, + 0.0, + 0.39833705162163824, + 0.017405815422534943, + 0.42345345129433554, + 0.5802100077271461, + 0.07569526135921478, + 0.39876840356737375, + 0.032720692455768585, + 0.23895640345290303, + 0.13020704686641693, + 0.31149507500231266, + 0.35598015040159225, + 0.19766434095799923, + 0.10914528715511551, + 0.16076813079416752, + 0.00010488517727935687, + 0.27892818860709667, + 0.03814217820763588, + 1.0330788902938366, + 0.4842226840555668, + 0.7034122257027775, + 0.20378883928060532, + 0.05708715878427029, + 0.006364680361002684, + 0.47943228855729103, + 0.4173944368958473, + 0.039958344772458076, + 0.2314140759408474, + 0.14974834024906158, + 0.26731769932666793, + 0.29911919435835443, + 0.023069502785801888, + 0.3762229774147272, + 0.9343340843915939, + 0.24373182840645313, + 0.12448825687170029, + 0.08212464302778244, + 0.24336226470768452, + 0.38444436783902347, + 0.22475946135818958, + 0.03682519868016243, + 0.21401347778737545, + 0.0, + 0.5638250231277198, + 0.12091461382806301, + 0.0, + 2.423076892271638, + 1.1891127172857523, + 0.23916668072342873, + 0.40853194519877434, + 0.3892590031027794, + 0.2753670960664749, + 0.0, + 0.13609793223440647, + 0.7616553567349911, + 0.09966588392853737, + 0.5500339977443218, + 2.0940927620977163, + 0.03812898509204388, + 1.163329562637955 + ], + "unique_experts": 59, + "load_cv": 0.8369898246307907, + "normalized_load_entropy": 0.9174757154963392, + "max_load_share": 0.06965174129353234 + } + }, + "s1_period": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "1eaac7bc38176598192439f126cf8abb94e798f1ff699c803b778026e6fe42ce", + "route_weight_sha256": "e1d873f97b7a52f7c36cb27df956c1848f92a2449d3e6fcf7b56d7e51248bb69", + "loads": [ + 1, + 4, + 6, + 2, + 0, + 6, + 1, + 7, + 4, + 1, + 3, + 0, + 2, + 3, + 5, + 8, + 6, + 2, + 3, + 2, + 7, + 1, + 11, + 4, + 13, + 4, + 2, + 1, + 4, + 5, + 2, + 5, + 0, + 2, + 2, + 1, + 9, + 3, + 5, + 4, + 2, + 3, + 4, + 4, + 1, + 5, + 0, + 6, + 5, + 0, + 7, + 9, + 4, + 5, + 5, + 3, + 0, + 1, + 6, + 2, + 10, + 11, + 1, + 7 + ], + "weighted_loads": [ + 0.04057571291923523, + 0.13076867163181305, + 0.22008959762752056, + 0.13225247338414192, + 0.0, + 0.20315081998705864, + 0.0352034829556942, + 0.3425809722393751, + 0.29561810940504074, + 0.07369112223386765, + 0.12047458253800869, + 0.0, + 0.20502381399273872, + 0.12869611382484436, + 0.17340689152479172, + 0.31349198520183563, + 0.20526344515383244, + 0.04642078849428799, + 0.12471738457679749, + 0.03150639247178333, + 0.25570773519575596, + 0.03752443939447403, + 0.5512018278241158, + 0.5325787365436554, + 0.5162805058062077, + 0.14365896955132484, + 0.09659753367304802, + 0.010395953431725502, + 0.15345797687768936, + 0.2578534912317991, + 0.04543828032910824, + 0.17069772444665432, + 0.0, + 0.048037827349617146, + 0.028419463407772128, + 0.025746045634150505, + 0.424817631021142, + 0.08498021587729454, + 0.18742251954972744, + 0.11901490390300751, + 0.06767847947776318, + 0.08602800965309143, + 0.13260713328054408, + 0.16519613191485405, + 0.03811969235539436, + 0.16884138993918896, + 0.0, + 0.22712282836437225, + 0.15078462287783623, + 0.0, + 1.9604477211833, + 0.6820986531674862, + 0.11837292835116386, + 0.2641795165836811, + 0.42261088266968727, + 0.26622842997312546, + 0.0, + 0.031413692981004715, + 0.47678377851843834, + 0.059613294899463654, + 0.3562788534909487, + 0.9577328860759735, + 0.026019584387540817, + 0.2465782966464758 + ], + "unique_experts": 58, + "load_cv": 0.7564287338059591, + "normalized_load_entropy": 0.9273955926941574, + "max_load_share": 0.051587301587301584 + }, + "full_input": { + "tokens": 83, + "top_k": 6, + "decisions": 498, + "ordered_route_sha256": "54c4171370b0b6f9334f013939d004b6fdc03a3bce1fff21a4cbf3774ddc09cc", + "route_weight_sha256": "2e0348180df11619eeaa77896577756aa4e0b5d9ddce3a75ec629f2f08aac9dc", + "loads": [ + 1, + 4, + 7, + 3, + 2, + 15, + 1, + 8, + 12, + 4, + 10, + 2, + 5, + 3, + 9, + 8, + 6, + 2, + 4, + 5, + 12, + 1, + 21, + 5, + 22, + 4, + 2, + 1, + 25, + 10, + 2, + 9, + 0, + 8, + 9, + 4, + 16, + 8, + 5, + 4, + 3, + 12, + 8, + 8, + 3, + 7, + 0, + 13, + 5, + 0, + 14, + 25, + 10, + 10, + 8, + 5, + 0, + 1, + 20, + 3, + 15, + 31, + 7, + 11 + ], + "weighted_loads": [ + 0.04057571291923523, + 0.13076867163181305, + 0.2451895922422409, + 0.24138491228222847, + 0.060914281755685806, + 0.47886457887943834, + 0.0352034829556942, + 0.37961448542773724, + 0.890191875398159, + 0.2039206698536873, + 0.4251457368955016, + 0.06610120460391045, + 0.26671673194505274, + 0.12869611382484436, + 0.313560014590621, + 0.31349198520183563, + 0.20526344515383244, + 0.04642078849428799, + 0.15676334872841835, + 0.1273354266959359, + 0.47915823571383953, + 0.03752443939447403, + 1.1517387367784977, + 0.5572601407766342, + 0.8388274891767651, + 0.14365896955132484, + 0.09659753367304802, + 0.010395953431725502, + 1.1754705756902695, + 0.47773803025484085, + 0.04543828032910824, + 0.34192839078605175, + 0.0, + 0.36013646829815116, + 0.29126698195614154, + 0.16290813870728016, + 0.9532382357865572, + 1.1115793995559216, + 0.18742251954972744, + 0.11901490390300751, + 0.18197338841855526, + 0.5938800740987062, + 0.24933913411950925, + 0.4531734772026539, + 0.11458059400320053, + 0.2664033863693476, + 0.0, + 0.7706816873978823, + 0.15078462287783623, + 0.0, + 2.297125430777669, + 1.7430174704641104, + 0.29167196713387966, + 0.6074708662927151, + 0.6269041113555431, + 0.35993386432528496, + 0.0, + 0.031413692981004715, + 1.0779916383326054, + 0.09551502391695976, + 0.5206901356577873, + 2.7728291447274387, + 0.3743584305047989, + 1.3699440527707338 + ], + "unique_experts": 60, + "load_cv": 0.8613404603236207, + "normalized_load_entropy": 0.9161425485842614, + "max_load_share": 0.06224899598393574 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 42, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.828231292517007, + "mean_token_weighted_tv": 0.02545783533917399, + "aggregate_load_tv": 0.07539682539682539 + }, + "system_bos": { + "tokens": 42, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.7976190476190477, + "mean_token_weighted_tv": 0.0301965820615026, + "aggregate_load_tv": 0.07142857142857142 + }, + "system_x": { + "tokens": 42, + "ordered_topk_exact_tokens": 6, + "set_exact_tokens": 13, + "mean_set_jaccard": 0.7692743764172336, + "mean_token_weighted_tv": 0.041691873309965946, + "aggregate_load_tv": 0.08333333333333333 + }, + "system_period": { + "tokens": 42, + "ordered_topk_exact_tokens": 6, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.7502267573696145, + "mean_token_weighted_tv": 0.04391881380927641, + "aggregate_load_tv": 0.09126984126984126 + }, + "bos_at_s0": { + "tokens": 42, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.7857142857142857, + "mean_token_weighted_tv": 0.033378100780196075, + "aggregate_load_tv": 0.10317460317460317 + }, + "bos_at_s1": { + "tokens": 42, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 18, + "mean_set_jaccard": 0.7919501133786847, + "mean_token_weighted_tv": 0.034195586244052154, + "aggregate_load_tv": 0.09126984126984125 + }, + "x_at_s0": { + "tokens": 42, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 18, + "mean_set_jaccard": 0.8163265306122449, + "mean_token_weighted_tv": 0.030319561160078074, + "aggregate_load_tv": 0.07142857142857142 + }, + "x_at_s1": { + "tokens": 42, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 20, + "mean_set_jaccard": 0.8015873015873015, + "mean_token_weighted_tv": 0.041708648635254315, + "aggregate_load_tv": 0.07539682539682539 + }, + "period_at_s0": { + "tokens": 42, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 18, + "mean_set_jaccard": 0.8214285714285714, + "mean_token_weighted_tv": 0.030628194992806085, + "aggregate_load_tv": 0.07142857142857142 + }, + "period_at_s1": { + "tokens": 42, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 21, + "mean_set_jaccard": 0.8095238095238095, + "mean_token_weighted_tv": 0.041287115613158676, + "aggregate_load_tv": 0.07936507936507936 + } + } + }, + "layer_25": { + "layer": 25, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "254c713545086662cd8b4d6b80d20d7daae9fbee74f1a139ea392ba687963b4d", + "route_weight_sha256": "4112b37526ca662ee28ce37612f189640a685ae5efb10db086ee1d6258fa76e2", + "loads": [ + 2, + 14, + 3, + 4, + 4, + 4, + 4, + 0, + 5, + 1, + 13, + 4, + 4, + 1, + 1, + 2, + 2, + 7, + 5, + 6, + 1, + 4, + 0, + 9, + 0, + 4, + 5, + 1, + 4, + 2, + 2, + 5, + 2, + 3, + 4, + 5, + 2, + 12, + 5, + 4, + 9, + 1, + 3, + 2, + 8, + 15, + 6, + 1, + 1, + 3, + 2, + 3, + 6, + 0, + 3, + 4, + 4, + 8, + 1, + 1, + 4, + 0, + 3, + 4 + ], + "weighted_loads": [ + 0.07378602400422096, + 1.1776343882083893, + 0.17398647591471672, + 0.1294653918594122, + 0.12444859743118286, + 0.20141405798494816, + 0.22661654651165009, + 0.0, + 0.19993005692958832, + 0.02971586585044861, + 1.0105550102889538, + 0.16021224483847618, + 0.17256788536906242, + 0.02017340436577797, + 0.03896120563149452, + 0.07159853354096413, + 0.17402128875255585, + 0.6646088361740112, + 0.21266922168433666, + 0.8249292969703674, + 0.10540768504142761, + 0.15223089791834354, + 0.0, + 0.5086867026984692, + 0.0, + 0.20299235731363297, + 0.1926792822778225, + 0.0339486263692379, + 0.2637660764157772, + 0.06617424264550209, + 0.12258709967136383, + 0.41258325055241585, + 0.08033235371112823, + 0.09869019500911236, + 0.1553959045559168, + 0.1896428894251585, + 0.14199082180857658, + 0.4746340960264206, + 0.30894314497709274, + 0.3956043869256973, + 0.8102647513151169, + 0.07673321664333344, + 0.0748922061175108, + 0.06863990798592567, + 0.6537266969680786, + 0.9991659689694643, + 0.22073706984519958, + 0.026780283078551292, + 0.03451348468661308, + 0.11779781430959702, + 0.103087417781353, + 0.13080620020627975, + 0.23674773052334785, + 0.0, + 0.14165569469332695, + 0.14872844517230988, + 0.17661458998918533, + 0.38916011713445187, + 0.03395546227693558, + 0.10496989637613297, + 0.210186667740345, + 0.0, + 0.1707809902727604, + 0.9930939450860023 + ], + "unique_experts": 59, + "load_cv": 0.8325393042503718, + "normalized_load_entropy": 0.9226596770366705, + "max_load_share": 0.05952380952380952 + }, + "full_input": { + "tokens": 67, + "top_k": 6, + "decisions": 402, + "ordered_route_sha256": "40cec6deb62d9f255e7d50a7a896814fd6806adfd56011a6608e961e6aeff840", + "route_weight_sha256": "4a216c67376a5593b27540534b44ec6c247af71d877e0f8ac0456f443e7a67fd", + "loads": [ + 3, + 33, + 11, + 5, + 4, + 4, + 10, + 0, + 5, + 1, + 23, + 8, + 6, + 2, + 1, + 2, + 2, + 11, + 6, + 6, + 1, + 4, + 0, + 11, + 0, + 4, + 5, + 1, + 5, + 5, + 2, + 6, + 4, + 4, + 5, + 5, + 2, + 14, + 16, + 7, + 18, + 1, + 3, + 3, + 13, + 24, + 8, + 1, + 2, + 4, + 12, + 3, + 11, + 0, + 11, + 4, + 6, + 12, + 1, + 1, + 7, + 0, + 9, + 4 + ], + "weighted_loads": [ + 0.12583710998296738, + 2.6054424913600087, + 0.6987103242427111, + 0.1910917814821005, + 0.12444859743118286, + 0.20141405798494816, + 0.6399153769016266, + 0.0, + 0.19993005692958832, + 0.02971586585044861, + 1.8951852060854435, + 0.8319005062803626, + 0.29569724202156067, + 0.06810666993260384, + 0.03896120563149452, + 0.07159853354096413, + 0.17402128875255585, + 0.7972297966480255, + 0.23813564889132977, + 0.8249292969703674, + 0.10540768504142761, + 0.15223089791834354, + 0.0, + 0.6027847006917, + 0.0, + 0.20299235731363297, + 0.1926792822778225, + 0.0339486263692379, + 0.3084872253239155, + 0.18247418105602264, + 0.12258709967136383, + 0.519788634032011, + 0.1956203170120716, + 0.16047248803079128, + 0.2092230413109064, + 0.1896428894251585, + 0.14199082180857658, + 0.5661439895629883, + 1.770159026607871, + 0.7317594811320305, + 1.3158277198672295, + 0.07673321664333344, + 0.0748922061175108, + 0.10139866918325424, + 1.0018224567174911, + 1.7724936455488205, + 0.2673011418664828, + 0.026780283078551292, + 0.07344424352049828, + 0.1556275114417076, + 0.689046461135149, + 0.13080620020627975, + 0.5071630240418017, + 0.0, + 0.5317819057963789, + 0.14872844517230988, + 0.2678285278379917, + 0.6014912407845259, + 0.03395546227693558, + 0.10496989637613297, + 0.36644262075424194, + 0.0, + 0.6155673563480377, + 0.9930939450860023 + ], + "unique_experts": 59, + "load_cv": 0.991224084160677, + "normalized_load_entropy": 0.8994668703870285, + "max_load_share": 0.08208955223880597 + } + }, + "s1_eos": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "70a7876dc1543e6c8c0f5c67fac2951be8641a446965e3303cda4a1c76f32a63", + "route_weight_sha256": "24f94d8032eefba11c04d73601221bd3822666e63296e31291702df29db23f69", + "loads": [ + 2, + 15, + 4, + 3, + 6, + 3, + 4, + 1, + 5, + 1, + 12, + 3, + 5, + 1, + 1, + 1, + 2, + 7, + 5, + 6, + 2, + 3, + 0, + 7, + 0, + 4, + 6, + 1, + 4, + 2, + 1, + 5, + 3, + 4, + 6, + 4, + 3, + 10, + 6, + 4, + 9, + 1, + 3, + 1, + 9, + 14, + 5, + 0, + 1, + 4, + 2, + 4, + 5, + 0, + 4, + 3, + 4, + 7, + 2, + 1, + 5, + 0, + 2, + 4 + ], + "weighted_loads": [ + 0.07223740592598915, + 1.154142577201128, + 0.2122013047337532, + 0.10762729868292809, + 0.1952469665557146, + 0.16909567266702652, + 0.23762183263897896, + 0.025218002498149872, + 0.19873614795506, + 0.028328707441687584, + 1.0104038640856743, + 0.11765550822019577, + 0.22769669070839882, + 0.020248638466000557, + 0.040264274924993515, + 0.04097633808851242, + 0.17877180129289627, + 0.7018327079713345, + 0.20725112780928612, + 0.813760107383132, + 0.13615655153989792, + 0.13806823641061783, + 0.0, + 0.4597917441278696, + 0.0, + 0.20242063142359257, + 0.2427789755165577, + 0.03190530836582184, + 0.2570432461798191, + 0.06682578474283218, + 0.19250477850437164, + 0.3785042054951191, + 0.1071191169321537, + 0.1320128869265318, + 0.22475245222449303, + 0.15281974337995052, + 0.16993789747357368, + 0.40933237224817276, + 0.3155356924980879, + 0.3926844485104084, + 0.8147704657167196, + 0.0985613614320755, + 0.07646713219583035, + 0.03202023357152939, + 0.6705819927155972, + 0.9242246802896261, + 0.1896294243633747, + 0.0, + 0.03326660022139549, + 0.1582087092101574, + 0.10535304620862007, + 0.16213785111904144, + 0.19422763027250767, + 0.0, + 0.17294399067759514, + 0.11702847853302956, + 0.183820441365242, + 0.3568286206573248, + 0.06164919398725033, + 0.10886334627866745, + 0.25162341073155403, + 0.0, + 0.1260203756392002, + 0.845298994332552 + ], + "unique_experts": 59, + "load_cv": 0.8029612615836025, + "normalized_load_entropy": 0.9254370503785355, + "max_load_share": 0.05952380952380952 + }, + "full_input": { + "tokens": 83, + "top_k": 6, + "decisions": 498, + "ordered_route_sha256": "9837d35e24b6eae21f68294abe99707d6ba205590edbcade724998433279bc88", + "route_weight_sha256": "140503da24cfa55178e6a3fc7ea33ce551b85aa778da2703187a3da4dcd8b889", + "loads": [ + 5, + 40, + 14, + 4, + 6, + 4, + 12, + 1, + 7, + 2, + 34, + 7, + 11, + 1, + 1, + 1, + 2, + 15, + 6, + 7, + 5, + 10, + 0, + 12, + 0, + 4, + 7, + 1, + 5, + 6, + 1, + 8, + 9, + 4, + 9, + 4, + 4, + 16, + 14, + 9, + 19, + 1, + 4, + 2, + 18, + 28, + 7, + 0, + 1, + 6, + 14, + 4, + 12, + 6, + 16, + 4, + 7, + 14, + 2, + 2, + 10, + 1, + 7, + 5 + ], + "weighted_loads": [ + 0.33549411594867706, + 3.1565240314230323, + 0.782048923894763, + 0.181623425334692, + 0.1952469665557146, + 0.20945371687412262, + 0.8565323427319527, + 0.025218002498149872, + 0.3127498496323824, + 0.05692855082452297, + 2.9185668118298054, + 0.847504111006856, + 0.5534786656498909, + 0.020248638466000557, + 0.040264274924993515, + 0.04097633808851242, + 0.17877180129289627, + 1.3446694575250149, + 0.2571628950536251, + 0.8389407098293304, + 0.39399072527885437, + 0.7804767154157162, + 0.0, + 0.6542321313172579, + 0.0, + 0.20242063142359257, + 0.27587589621543884, + 0.03190530836582184, + 0.3041256181895733, + 0.22431854903697968, + 0.19250477850437164, + 0.845557015389204, + 0.38652333058416843, + 0.1320128869265318, + 0.3761545829474926, + 0.15281974337995052, + 0.2132541686296463, + 0.6838119886815548, + 1.9390731323510408, + 0.8525562882423401, + 1.413980407640338, + 0.0985613614320755, + 0.16286656074225903, + 0.06197705864906311, + 1.3111085556447506, + 2.190098475664854, + 0.23353701597079635, + 0.0, + 0.03326660022139549, + 0.2527706064283848, + 0.8253180366009474, + 0.16213785111904144, + 0.6358491480350494, + 0.4724448099732399, + 0.9569389331154525, + 0.14361943677067757, + 0.3125871382653713, + 0.6895218174904585, + 0.06164919398725033, + 0.19489049911499023, + 0.5403064042329788, + 0.04294683039188385, + 0.559614872559905, + 0.8709017150104046 + ], + "unique_experts": 61, + "load_cv": 0.9807011828705563, + "normalized_load_entropy": 0.9033978894697711, + "max_load_share": 0.08032128514056225 + } + }, + "s0_bos": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "6440e4e070866937d811920ded878713af1a4b8b88c792582f8b5b181d54a0a0", + "route_weight_sha256": "493426c3f281c9f9395270ad360d2d69b4275f6aecc161491ae8c512b8308e16", + "loads": [ + 2, + 13, + 6, + 4, + 5, + 4, + 3, + 0, + 4, + 2, + 13, + 4, + 3, + 1, + 1, + 1, + 2, + 7, + 6, + 5, + 2, + 3, + 0, + 7, + 0, + 4, + 7, + 2, + 4, + 2, + 3, + 5, + 2, + 4, + 4, + 5, + 2, + 11, + 6, + 4, + 9, + 1, + 2, + 1, + 9, + 13, + 5, + 0, + 1, + 4, + 3, + 3, + 6, + 0, + 3, + 3, + 4, + 7, + 2, + 1, + 3, + 0, + 3, + 6 + ], + "weighted_loads": [ + 0.08109603449702263, + 1.1075387205928564, + 0.27728244848549366, + 0.1452248878777027, + 0.15871070511639118, + 0.2047234158962965, + 0.18306872993707657, + 0.0, + 0.16846558079123497, + 0.06011488847434521, + 1.0462197624146938, + 0.16608695685863495, + 0.13953828439116478, + 0.019731663167476654, + 0.04019095376133919, + 0.03966805338859558, + 0.1675531268119812, + 0.6652717441320419, + 0.24281911738216877, + 0.7998355887830257, + 0.13731261529028416, + 0.13969314843416214, + 0.0, + 0.4647500030696392, + 0.0, + 0.20537886954843998, + 0.2753066420555115, + 0.05637410469353199, + 0.2718580327928066, + 0.06255637854337692, + 0.31736456975340843, + 0.42784368619322777, + 0.08129702135920525, + 0.12685684859752655, + 0.14523780532181263, + 0.1934901922941208, + 0.1522800698876381, + 0.4618810247629881, + 0.32263735868036747, + 0.3899587281048298, + 0.7945776488631964, + 0.09323027729988098, + 0.04872497357428074, + 0.03716953098773956, + 0.6601673103868961, + 0.9465428162366152, + 0.1839682012796402, + 0.0, + 0.03821897506713867, + 0.1573508158326149, + 0.13772521540522575, + 0.1311069391667843, + 0.2156889270991087, + 0.0, + 0.1437230072915554, + 0.13391222432255745, + 0.17174796387553215, + 0.34332650527358055, + 0.06307900883257389, + 0.10273704677820206, + 0.16115880012512207, + 0.0, + 0.17580720409750938, + 0.7521734312176704 + ], + "unique_experts": 58, + "load_cv": 0.7851930289543896, + "normalized_load_entropy": 0.9266488780756865, + "max_load_share": 0.051587301587301584 + }, + "full_input": { + "tokens": 67, + "top_k": 6, + "decisions": 402, + "ordered_route_sha256": "69bbbb265ece038725ad629c48eeb9dc14105a0c2bed315b4af96f3152f55264", + "route_weight_sha256": "693fcf18e810999f8e42b54a753fc489c0875019cbb7dbd4f6cac62abcffd1e8", + "loads": [ + 2, + 30, + 14, + 5, + 5, + 4, + 9, + 1, + 4, + 2, + 23, + 7, + 6, + 2, + 1, + 1, + 2, + 11, + 7, + 5, + 2, + 3, + 0, + 9, + 0, + 4, + 7, + 2, + 5, + 3, + 4, + 6, + 4, + 5, + 6, + 5, + 3, + 13, + 16, + 6, + 18, + 2, + 3, + 3, + 14, + 21, + 6, + 0, + 1, + 6, + 13, + 3, + 11, + 0, + 12, + 3, + 5, + 12, + 2, + 1, + 5, + 0, + 9, + 8 + ], + "weighted_loads": [ + 0.08109603449702263, + 2.413101806305349, + 0.8058305326849222, + 0.28135863319039345, + 0.15871070511639118, + 0.2047234158962965, + 0.5963675603270531, + 0.05004771798849106, + 0.16846558079123497, + 0.06011488847434521, + 1.9618082642555237, + 0.8229190148413181, + 0.3204300291836262, + 0.06766492873430252, + 0.04019095376133919, + 0.03966805338859558, + 0.1675531268119812, + 0.7978927046060562, + 0.2682855445891619, + 0.7998355887830257, + 0.13731261529028416, + 0.13969314843416214, + 0.0, + 0.55884800106287, + 0.0, + 0.20537886954843998, + 0.2753066420555115, + 0.05637410469353199, + 0.3165791817009449, + 0.09465363994240761, + 0.4928312115371227, + 0.535049069672823, + 0.19065700471401215, + 0.18863914161920547, + 0.2551443073898554, + 0.1934901922941208, + 0.21204451844096184, + 0.5630741249769926, + 0.8739400580525398, + 0.8005797304213047, + 1.301448693498969, + 0.1374702826142311, + 0.08342341147363186, + 0.10354281961917877, + 0.9997204300016165, + 1.673659672960639, + 0.22921037301421165, + 0.0, + 0.03821897506713867, + 0.23898815736174583, + 0.7236842587590218, + 0.1311069391667843, + 0.510511027649045, + 0.0, + 0.5990909202955663, + 0.13391222432255745, + 0.22719908133149147, + 0.575759869068861, + 0.06307900883257389, + 0.10273704677820206, + 0.2852746769785881, + 0.0, + 0.6205935701727867, + 0.8181127905845642 + ], + "unique_experts": 59, + "load_cv": 0.9407985192986366, + "normalized_load_entropy": 0.9064885738958062, + "max_load_share": 0.07462686567164178 + } + }, + "s1_bos": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "6f9afc3c2ffaf8299fec046a619582195e65a864f9d2a853236215818ab8a453", + "route_weight_sha256": "84b3d5c95d56ce6cded34c7c6a7f896aeef82647c5cd331c703033298e417c4e", + "loads": [ + 2, + 13, + 5, + 4, + 4, + 4, + 4, + 1, + 4, + 1, + 13, + 4, + 5, + 1, + 1, + 3, + 2, + 7, + 6, + 5, + 1, + 4, + 0, + 7, + 0, + 4, + 8, + 2, + 4, + 2, + 2, + 5, + 3, + 2, + 3, + 4, + 3, + 10, + 6, + 4, + 8, + 1, + 1, + 1, + 9, + 13, + 5, + 0, + 1, + 4, + 3, + 3, + 7, + 0, + 4, + 3, + 4, + 8, + 1, + 1, + 4, + 0, + 3, + 5 + ], + "weighted_loads": [ + 0.07846428081393242, + 1.121742781251669, + 0.3247842900454998, + 0.1426418498158455, + 0.13257459923624992, + 0.2182963751256466, + 0.23626788705587387, + 0.025944683700799942, + 0.16657985001802444, + 0.027107369154691696, + 0.9586131796240807, + 0.16594096273183823, + 0.23374392837285995, + 0.01971152052283287, + 0.04135308042168617, + 0.10560506954789162, + 0.17438284307718277, + 0.7051061615347862, + 0.24473237060010433, + 0.8176048509776592, + 0.10640104115009308, + 0.1718897856771946, + 0.0, + 0.4794142097234726, + 0.0, + 0.19562768004834652, + 0.3129756711423397, + 0.0560510978102684, + 0.25884459540247917, + 0.0671992227435112, + 0.293825663626194, + 0.4266636297106743, + 0.11704375967383385, + 0.06008540838956833, + 0.11837063729763031, + 0.1571800522506237, + 0.17588185891509056, + 0.43075283244252205, + 0.3295765481889248, + 0.3953458406031132, + 0.7359058186411858, + 0.0952175036072731, + 0.02790990099310875, + 0.036385633051395416, + 0.6595980077981949, + 0.9362909775227308, + 0.18551528453826904, + 0.0, + 0.03368992358446121, + 0.15773839130997658, + 0.12761717662215233, + 0.1289987787604332, + 0.2561977952718735, + 0.0, + 0.17610851675271988, + 0.13547956570982933, + 0.17718899250030518, + 0.3640203271061182, + 0.03603297472000122, + 0.1148565486073494, + 0.19787953421473503, + 0.0, + 0.1654084511101246, + 0.7108471039682627 + ], + "unique_experts": 59, + "load_cv": 0.7800420555749596, + "normalized_load_entropy": 0.9276043912148344, + "max_load_share": 0.051587301587301584 + }, + "full_input": { + "tokens": 83, + "top_k": 6, + "decisions": 498, + "ordered_route_sha256": "e6afb415058e34e0fee8e3851ad3fd24d0e42b9b20360cd4fb6810cbc5521ad6", + "route_weight_sha256": "23df60effdc422d5194d30ec37fbbd60418f46df59c69dff568607f427f18b8f", + "loads": [ + 5, + 37, + 16, + 4, + 4, + 5, + 12, + 1, + 8, + 2, + 36, + 6, + 13, + 1, + 1, + 3, + 2, + 15, + 7, + 6, + 4, + 11, + 0, + 12, + 0, + 4, + 9, + 2, + 5, + 5, + 2, + 8, + 10, + 2, + 6, + 4, + 4, + 17, + 13, + 8, + 18, + 1, + 2, + 2, + 18, + 27, + 6, + 0, + 1, + 7, + 15, + 3, + 13, + 6, + 16, + 4, + 7, + 14, + 1, + 2, + 8, + 1, + 8, + 8 + ], + "weighted_loads": [ + 0.3254050314426422, + 3.040804329328239, + 0.9971952978521585, + 0.1426418498158455, + 0.13257459923624992, + 0.2586544193327427, + 0.8551783971488476, + 0.025944683700799942, + 0.3677953891456127, + 0.055707212537527084, + 2.9643133245408535, + 0.8161801844835281, + 0.6379878018051386, + 0.01971152052283287, + 0.04135308042168617, + 0.10560506954789162, + 0.17438284307718277, + 1.3479429110884666, + 0.2946441378444433, + 0.8427854534238577, + 0.36423521488904953, + 0.8142982646822929, + 0.0, + 0.6738545969128609, + 0.0, + 0.19562768004834652, + 0.34607259184122086, + 0.0560510978102684, + 0.30592696741223335, + 0.19087978824973106, + 0.293825663626194, + 0.8937164396047592, + 0.45760379545390606, + 0.06008540838956833, + 0.27547114342451096, + 0.1571800522506237, + 0.21919813007116318, + 0.7496442571282387, + 1.0509051233530045, + 0.8439234681427479, + 1.3108602203428745, + 0.0952175036072731, + 0.11430932953953743, + 0.06634245812892914, + 1.3077350985258818, + 2.1567155439406633, + 0.22809980064630508, + 0.0, + 0.03368992358446121, + 0.2979293093085289, + 0.8475821670144796, + 0.1289987787604332, + 0.6936550363898277, + 0.4724448099732399, + 0.9601034591905773, + 0.16207052394747734, + 0.3214493505656719, + 0.6735769268125296, + 0.03603297472000122, + 0.20088370144367218, + 0.42723991721868515, + 0.04294683039188385, + 0.5990029480308294, + 0.8023710828274488 + ], + "unique_experts": 61, + "load_cv": 0.9759531942386166, + "normalized_load_entropy": 0.9029811920423234, + "max_load_share": 0.07429718875502007 + } + }, + "s0_x": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "c030098e84bb63fd58a723d2fdbb9ba11ead9d8b795b67903a8e57522e0102ba", + "route_weight_sha256": "668a8fe5a74b59a4237bff22c915b001fe621595db98a43bab07cbc2437523d8", + "loads": [ + 2, + 13, + 3, + 5, + 6, + 3, + 4, + 0, + 4, + 1, + 13, + 3, + 4, + 1, + 1, + 1, + 2, + 7, + 4, + 6, + 2, + 3, + 0, + 8, + 0, + 3, + 6, + 2, + 4, + 3, + 1, + 5, + 3, + 5, + 5, + 4, + 2, + 12, + 6, + 5, + 10, + 1, + 2, + 2, + 8, + 12, + 5, + 0, + 0, + 4, + 3, + 4, + 7, + 0, + 3, + 3, + 4, + 8, + 2, + 1, + 3, + 0, + 3, + 5 + ], + "weighted_loads": [ + 0.07650268450379372, + 1.0947852190583944, + 0.15262877382338047, + 0.16698874719440937, + 0.18961215019226074, + 0.17747113481163979, + 0.23222731798887253, + 0.0, + 0.17578230053186417, + 0.02897549420595169, + 0.9587124176323414, + 0.11858455836772919, + 0.1964610144495964, + 0.020285621285438538, + 0.03835589438676834, + 0.03831376135349274, + 0.1738893687725067, + 0.673261396586895, + 0.1808401644229889, + 0.8342716954648495, + 0.13831260800361633, + 0.11990990489721298, + 0.0, + 0.47168077155947685, + 0.0, + 0.18870826438069344, + 0.23519851453602314, + 0.055730611085891724, + 0.27310850471258163, + 0.09702227264642715, + 0.1578376740217209, + 0.42693599313497543, + 0.11501311510801315, + 0.17570592276751995, + 0.1917769182473421, + 0.15501981787383556, + 0.15124154090881348, + 0.47092610597610474, + 0.3339007329195738, + 0.4303518161177635, + 0.8866480849683285, + 0.09498371928930283, + 0.049207475036382675, + 0.06764893606305122, + 0.6897918544709682, + 0.8515678979456425, + 0.17362428829073906, + 0.0, + 0.0, + 0.15333234518766403, + 0.12116074748337269, + 0.16131297498941422, + 0.26994365081191063, + 0.0, + 0.14564083144068718, + 0.13273123651742935, + 0.16716356202960014, + 0.3786780349910259, + 0.06566815823316574, + 0.09962941706180573, + 0.15548868291079998, + 0.0, + 0.1866964027285576, + 0.830814603716135 + ], + "unique_experts": 57, + "load_cv": 0.799187039693594, + "normalized_load_entropy": 0.9227093418062141, + "max_load_share": 0.051587301587301584 + }, + "full_input": { + "tokens": 67, + "top_k": 6, + "decisions": 402, + "ordered_route_sha256": "35d6f0fdaf3e1abeffbaad3ab3c5f08a71f0899dbb1bb3a56698fec09bc67fa0", + "route_weight_sha256": "9aa14d4b10c1d0cef68b54954287ffd9048644a36dd7e6001af881489367b6f7", + "loads": [ + 3, + 33, + 9, + 5, + 6, + 3, + 12, + 0, + 4, + 1, + 23, + 6, + 6, + 2, + 1, + 1, + 2, + 11, + 6, + 6, + 2, + 3, + 0, + 10, + 0, + 3, + 6, + 2, + 5, + 6, + 1, + 7, + 5, + 6, + 6, + 4, + 3, + 14, + 17, + 7, + 20, + 1, + 2, + 3, + 13, + 20, + 6, + 0, + 1, + 4, + 13, + 4, + 13, + 0, + 12, + 3, + 4, + 12, + 2, + 1, + 6, + 0, + 10, + 5 + ], + "weighted_loads": [ + 0.11413516104221344, + 2.5971797509118915, + 0.5310444943606853, + 0.16698874719440937, + 0.18961215019226074, + 0.17747113481163979, + 0.7641214095056057, + 0.0, + 0.17578230053186417, + 0.02897549420595169, + 1.855748787522316, + 0.795978419482708, + 0.3187556713819504, + 0.0682188868522644, + 0.03835589438676834, + 0.03831376135349274, + 0.1738893687725067, + 0.8058823570609093, + 0.23360973969101906, + 0.8342716954648495, + 0.13831260800361633, + 0.11990990489721298, + 0.0, + 0.5657787695527077, + 0.0, + 0.18870826438069344, + 0.23519851453602314, + 0.055730611085891724, + 0.3178296536207199, + 0.211353937163949, + 0.1578376740217209, + 0.6253135725855827, + 0.21184346079826355, + 0.23748821578919888, + 0.24194554053246975, + 0.15501981787383556, + 0.21613363176584244, + 0.574782133102417, + 0.9998650886118412, + 0.8349961414933205, + 1.4455330334603786, + 0.09498371928930283, + 0.049207475036382675, + 0.10040769726037979, + 1.0398212745785713, + 1.6014727428555489, + 0.21886646002531052, + 0.0, + 0.04148275777697563, + 0.15333234518766403, + 0.7071197908371687, + 0.16131297498941422, + 0.6810857076197863, + 0.0, + 0.6012465595267713, + 0.13273123651742935, + 0.16716356202960014, + 0.5563592575490475, + 0.06566815823316574, + 0.09962941706180573, + 0.29668317548930645, + 0.0, + 0.671143114566803, + 0.830814603716135 + ], + "unique_experts": 58, + "load_cv": 0.9924219686341229, + "normalized_load_entropy": 0.8969810057221126, + "max_load_share": 0.08208955223880597 + } + }, + "s1_x": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "238a5daa89514714ec44d4d7c50ce0a9362ffcf674be3e07554c89219eb09fe0", + "route_weight_sha256": "48479055cf32bc8540bc5c658740c86dac50fb0b075f6de5f49a6dbdf6528c4b", + "loads": [ + 2, + 14, + 4, + 2, + 7, + 3, + 4, + 1, + 5, + 1, + 13, + 4, + 4, + 1, + 1, + 2, + 2, + 7, + 5, + 5, + 2, + 4, + 0, + 7, + 0, + 4, + 5, + 1, + 4, + 2, + 2, + 6, + 4, + 3, + 3, + 4, + 3, + 11, + 6, + 4, + 9, + 1, + 1, + 2, + 9, + 14, + 5, + 0, + 0, + 4, + 3, + 4, + 7, + 0, + 2, + 3, + 4, + 10, + 2, + 1, + 2, + 0, + 3, + 4 + ], + "weighted_loads": [ + 0.07357510551810265, + 1.1506156735122204, + 0.19421124272048473, + 0.07510638609528542, + 0.22258901596069336, + 0.18354621902108192, + 0.2568984068930149, + 0.028198113664984703, + 0.18978099152445793, + 0.030137179419398308, + 0.9040041845291853, + 0.15554670616984367, + 0.22110524773597717, + 0.02059303969144821, + 0.039783038198947906, + 0.06029745563864708, + 0.18265001475811005, + 0.7135944925248623, + 0.20062412321567535, + 0.7850247845053673, + 0.13894712924957275, + 0.15437723696231842, + 0.0, + 0.4218248501420021, + 0.0, + 0.19422303326427937, + 0.21601301059126854, + 0.03072124905884266, + 0.2656888961791992, + 0.0655200220644474, + 0.32477565109729767, + 0.421673983335495, + 0.15008090995252132, + 0.10748437233269215, + 0.09947139956057072, + 0.14970876462757587, + 0.1659465730190277, + 0.43879600800573826, + 0.3697309195995331, + 0.3640656843781471, + 0.8772417400032282, + 0.07295192033052444, + 0.028356151655316353, + 0.06945088878273964, + 0.7489487249404192, + 0.8739278707653284, + 0.1835232973098755, + 0.0, + 0.0, + 0.15572470240294933, + 0.11277969181537628, + 0.16188279539346695, + 0.3054851032793522, + 0.0, + 0.10111323371529579, + 0.1461934745311737, + 0.16442895494401455, + 0.4496509563177824, + 0.06482389569282532, + 0.10284017771482468, + 0.12774629145860672, + 0.0, + 0.16789397597312927, + 0.6430500335991383 + ], + "unique_experts": 58, + "load_cv": 0.8301147215868497, + "normalized_load_entropy": 0.9208156779597164, + "max_load_share": 0.05555555555555555 + }, + "full_input": { + "tokens": 83, + "top_k": 6, + "decisions": 498, + "ordered_route_sha256": "13904db0ab067dafc6eae398a26126d23afeb8dc00ea229fa6717bfe8b776829", + "route_weight_sha256": "a2a6c093f048222e1a2ba48592ceffea6b49b381ead08a878cb5df68e3e872d7", + "loads": [ + 4, + 40, + 13, + 2, + 7, + 4, + 14, + 2, + 7, + 2, + 36, + 7, + 9, + 1, + 1, + 2, + 2, + 16, + 6, + 6, + 5, + 11, + 0, + 13, + 0, + 4, + 6, + 1, + 5, + 5, + 2, + 10, + 10, + 3, + 5, + 4, + 4, + 17, + 14, + 8, + 19, + 1, + 2, + 3, + 19, + 28, + 6, + 0, + 0, + 5, + 17, + 4, + 15, + 6, + 15, + 4, + 5, + 17, + 2, + 2, + 6, + 1, + 8, + 5 + ], + "weighted_loads": [ + 0.2693309113383293, + 3.208735409192741, + 0.6753673292696476, + 0.07510638609528542, + 0.22258901596069336, + 0.22390426322817802, + 1.078302651643753, + 0.05376151017844677, + 0.3037946932017803, + 0.058737022802233696, + 2.880110939964652, + 0.8781938664615154, + 0.49766499921679497, + 0.02059303969144821, + 0.039783038198947906, + 0.06029745563864708, + 0.18265001475811005, + 1.4048739485442638, + 0.25053589046001434, + 0.8102053869515657, + 0.3967813029885292, + 0.7967857159674168, + 0.0, + 0.6597436890006065, + 0.0, + 0.19422303326427937, + 0.2491099312901497, + 0.03072124905884266, + 0.3127712681889534, + 0.18134893476963043, + 0.32477565109729767, + 0.9998648092150688, + 0.43136143684387207, + 0.10748437233269215, + 0.21269953437149525, + 0.14970876462757587, + 0.20926284417510033, + 0.7049160953611135, + 1.15479551628232, + 0.816222608089447, + 1.4997302610427141, + 0.07295192033052444, + 0.11475558020174503, + 0.09940771386027336, + 1.4315079357475042, + 2.1058581490069628, + 0.22610781341791153, + 0.0, + 0.0, + 0.20528013072907925, + 0.9782956261187792, + 0.16188279539346695, + 0.8973487801849842, + 0.4724448099732399, + 1.0021768170408905, + 0.17278443276882172, + 0.19220497272908688, + 0.7625854443758726, + 0.06482389569282532, + 0.18886733055114746, + 0.3523284085094929, + 0.04294683039188385, + 0.6014884728938341, + 0.6686527542769909 + ], + "unique_experts": 60, + "load_cv": 1.024710423049179, + "normalized_load_entropy": 0.8958375720556959, + "max_load_share": 0.08032128514056225 + } + }, + "s0_period": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "3e005b63e1a108617f7c815f1ad56c901c0a5c8fe0812b7c7defe50b69196ea2", + "route_weight_sha256": "577c67535a61ee8399d803973d75f78dde5f268a9314b4aa7659c36453f4f4f3", + "loads": [ + 2, + 13, + 3, + 5, + 6, + 3, + 4, + 0, + 6, + 1, + 13, + 3, + 3, + 1, + 1, + 1, + 2, + 7, + 5, + 6, + 2, + 2, + 0, + 8, + 0, + 3, + 7, + 2, + 4, + 2, + 1, + 5, + 3, + 5, + 4, + 4, + 2, + 12, + 6, + 5, + 10, + 1, + 2, + 1, + 9, + 13, + 5, + 0, + 1, + 4, + 3, + 4, + 7, + 0, + 3, + 3, + 4, + 7, + 2, + 1, + 2, + 0, + 3, + 5 + ], + "weighted_loads": [ + 0.0777716226875782, + 1.0934328567236662, + 0.16829483956098557, + 0.17797177471220493, + 0.18611066788434982, + 0.1739310510456562, + 0.22081705927848816, + 0.0, + 0.22429820522665977, + 0.027694500982761383, + 1.004201017320156, + 0.12757929414510727, + 0.17556582391262054, + 0.01976783201098442, + 0.0387977696955204, + 0.04263824597001076, + 0.17715832591056824, + 0.6677331551909447, + 0.21249472349882126, + 0.8211976252496243, + 0.13715902343392372, + 0.09576212614774704, + 0.0, + 0.486850842833519, + 0.0, + 0.18117353320121765, + 0.273591760545969, + 0.05577412620186806, + 0.2676011510193348, + 0.06327211298048496, + 0.2960548400878906, + 0.4299674555659294, + 0.11875232309103012, + 0.16501897014677525, + 0.1357726752758026, + 0.15768789127469063, + 0.15087059140205383, + 0.49320267885923386, + 0.3301349300891161, + 0.4373243786394596, + 0.9016300942748785, + 0.08591734617948532, + 0.048725174739956856, + 0.032326020300388336, + 0.6936535686254501, + 0.897611441090703, + 0.18138360232114792, + 0.0, + 0.033633336424827576, + 0.15554463118314743, + 0.1212560385465622, + 0.16358894482254982, + 0.25766136310994625, + 0.0, + 0.14655868336558342, + 0.13624292612075806, + 0.17049889639019966, + 0.3498434256762266, + 0.06538629904389381, + 0.09770653396844864, + 0.12354505062103271, + 0.0, + 0.1809556782245636, + 0.654452433809638 + ], + "unique_experts": 58, + "load_cv": 0.8215723361655577, + "normalized_load_entropy": 0.9204549203481184, + "max_load_share": 0.051587301587301584 + }, + "full_input": { + "tokens": 67, + "top_k": 6, + "decisions": 402, + "ordered_route_sha256": "800426e75cd9a684f48a836534435b29ed03983415f25db8d80c5d71bdfe63bb", + "route_weight_sha256": "5c2c821f27ced6acc270a6a2fec028752b0ca06ac84fd5c77c42b13df2fe7dd7", + "loads": [ + 3, + 33, + 9, + 5, + 6, + 3, + 10, + 0, + 6, + 1, + 24, + 6, + 6, + 3, + 1, + 2, + 2, + 11, + 6, + 6, + 2, + 2, + 0, + 10, + 0, + 3, + 7, + 2, + 5, + 5, + 1, + 6, + 5, + 6, + 6, + 4, + 3, + 14, + 16, + 7, + 19, + 1, + 2, + 3, + 14, + 22, + 6, + 0, + 1, + 4, + 13, + 4, + 13, + 0, + 12, + 3, + 4, + 11, + 2, + 1, + 5, + 0, + 9, + 6 + ], + "weighted_loads": [ + 0.12406791001558304, + 2.638024973683059, + 0.5369404796510935, + 0.17797177471220493, + 0.18611066788434982, + 0.1739310510456562, + 0.6341158896684647, + 0.0, + 0.22429820522665977, + 0.027694500982761383, + 1.932658601552248, + 0.7968517243862152, + 0.33904436230659485, + 0.10347309708595276, + 0.0387977696955204, + 0.08668706193566322, + 0.17715832591056824, + 0.800354115664959, + 0.23796115070581436, + 0.8211976252496243, + 0.13715902343392372, + 0.09576212614774704, + 0.0, + 0.5809488408267498, + 0.0, + 0.18117353320121765, + 0.273591760545969, + 0.05577412620186806, + 0.31232229992747307, + 0.173385513946414, + 0.2960548400878906, + 0.5371728390455246, + 0.21763689815998077, + 0.22680126316845417, + 0.22748904675245285, + 0.15768789127469063, + 0.22456329315900803, + 0.59241983294487, + 0.8814376294612885, + 0.8846308775246143, + 1.414581911638379, + 0.08591734617948532, + 0.048725174739956856, + 0.09824743121862411, + 1.0465996079146862, + 1.752479812130332, + 0.22662577405571938, + 0.0, + 0.033633336424827576, + 0.15554463118314743, + 0.7072150819003582, + 0.16358894482254982, + 0.5901607796549797, + 0.0, + 0.5801952532492578, + 0.13624292612075806, + 0.17049889639019966, + 0.5213218312710524, + 0.06538629904389381, + 0.09770653396844864, + 0.2850387431681156, + 0.0, + 0.6257420442998409, + 0.7796676512807608 + ], + "unique_experts": 58, + "load_cv": 0.9948134103652497, + "normalized_load_entropy": 0.8978922133735275, + "max_load_share": 0.08208955223880597 + } + }, + "s1_period": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "e92a5939d7ee2e904dfaaef3ae4ecb3928829c875dca53bac676ce8f5e4d355e", + "route_weight_sha256": "0dbc0cd4ed54f9080e3365de5eec646b08d3a47db4fbe2a61c4e92055838abb2", + "loads": [ + 2, + 14, + 2, + 4, + 7, + 3, + 4, + 1, + 4, + 1, + 13, + 3, + 4, + 1, + 1, + 3, + 2, + 7, + 5, + 5, + 1, + 5, + 0, + 7, + 0, + 4, + 5, + 1, + 4, + 2, + 2, + 6, + 4, + 4, + 3, + 4, + 3, + 11, + 6, + 4, + 10, + 1, + 1, + 2, + 9, + 14, + 4, + 0, + 0, + 4, + 1, + 4, + 7, + 0, + 3, + 4, + 4, + 9, + 2, + 1, + 4, + 0, + 2, + 4 + ], + "weighted_loads": [ + 0.07641465216875076, + 1.1517919227480888, + 0.1397089660167694, + 0.14040961302816868, + 0.22795079089701176, + 0.17267673462629318, + 0.26501093804836273, + 0.02800074778497219, + 0.16279318183660507, + 0.03155524656176567, + 0.9391319807618856, + 0.11296000145375729, + 0.22958755865693092, + 0.020410967990756035, + 0.043211039155721664, + 0.10344868339598179, + 0.18720752745866776, + 0.7163174487650394, + 0.1943239513784647, + 0.793836947530508, + 0.10617107897996902, + 0.1918098796159029, + 0.0, + 0.4444686882197857, + 0.0, + 0.20244349166750908, + 0.2193436101078987, + 0.03056294471025467, + 0.25155266374349594, + 0.06516564637422562, + 0.3510243780910969, + 0.43326033651828766, + 0.15511023998260498, + 0.14357141964137554, + 0.09955155104398727, + 0.15190022811293602, + 0.1704915538430214, + 0.46249550208449364, + 0.386721296235919, + 0.3774346262216568, + 0.8645879104733467, + 0.07539897412061691, + 0.028828907757997513, + 0.06735389307141304, + 0.7076571714133024, + 0.8556045070290565, + 0.14821499586105347, + 0.0, + 0.0, + 0.1543026827275753, + 0.03858748450875282, + 0.15984884276986122, + 0.3299380484968424, + 0.0, + 0.13525661081075668, + 0.17112350277602673, + 0.1739821471273899, + 0.42236165702342987, + 0.06431454233825207, + 0.10957590490579605, + 0.19579394906759262, + 0.0, + 0.12985828518867493, + 0.640424232929945 + ], + "unique_experts": 58, + "load_cv": 0.8325393042503718, + "normalized_load_entropy": 0.9197340165685791, + "max_load_share": 0.05555555555555555 + }, + "full_input": { + "tokens": 83, + "top_k": 6, + "decisions": 498, + "ordered_route_sha256": "f63bc1b021ddf6071dd39ad036f382bbdb563c1bdee8cb03caab78d13e714989", + "route_weight_sha256": "0645029681fc1f2ff50388d21914f106462fe4dc9e5c140a5aed020df7f8b820", + "loads": [ + 5, + 40, + 10, + 4, + 7, + 4, + 12, + 2, + 6, + 2, + 36, + 6, + 10, + 1, + 1, + 3, + 2, + 15, + 7, + 6, + 4, + 12, + 0, + 12, + 0, + 4, + 6, + 1, + 5, + 5, + 2, + 9, + 10, + 4, + 6, + 4, + 4, + 18, + 13, + 8, + 20, + 1, + 2, + 3, + 19, + 29, + 5, + 0, + 1, + 5, + 13, + 4, + 14, + 6, + 16, + 5, + 6, + 16, + 2, + 2, + 9, + 1, + 7, + 6 + ], + "weighted_loads": [ + 0.3392924778163433, + 3.2664551427587867, + 0.5899783615022898, + 0.14040961302816868, + 0.22795079089701176, + 0.21303477883338928, + 0.8839214481413364, + 0.053851064294576645, + 0.27680688351392746, + 0.06015508994460106, + 2.936141839250922, + 0.8149465154856443, + 0.5443953536450863, + 0.020410967990756035, + 0.043211039155721664, + 0.10344868339598179, + 0.18720752745866776, + 1.3591541983187199, + 0.26926897652447224, + 0.8190175499767065, + 0.3640052527189255, + 0.8342183586210012, + 0.0, + 0.638909075409174, + 0.0, + 0.20244349166750908, + 0.25244053080677986, + 0.03056294471025467, + 0.2986350357532501, + 0.17769604176282883, + 0.3510243780910969, + 0.9003131464123726, + 0.42641366459429264, + 0.14357141964137554, + 0.2580999284982681, + 0.15190022811293602, + 0.213807824999094, + 0.7511076219379902, + 1.1080498713999987, + 0.840393491089344, + 1.4645648896694183, + 0.07539897412061691, + 0.1152283363044262, + 0.09731071814894676, + 1.4112262949347496, + 2.1453667618334293, + 0.1907995119690895, + 0.0, + 0.039788078516721725, + 0.20385811105370522, + 0.7585524749010801, + 0.15984884276986122, + 0.8282208945602179, + 0.4724448099732399, + 0.971069376450032, + 0.19771446101367474, + 0.2569064646959305, + 0.7367110680788755, + 0.06431454233825207, + 0.19560305774211884, + 0.4803302064538002, + 0.04294683039188385, + 0.5634527821093798, + 0.8955773748457432 + ], + "unique_experts": 61, + "load_cv": 1.008464042894378, + "normalized_load_entropy": 0.9015743240035912, + "max_load_share": 0.08032128514056225 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 42, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 20, + "mean_set_jaccard": 0.8299319727891158, + "mean_token_weighted_tv": 0.033018869414393394, + "aggregate_load_tv": 0.07936507936507936 + }, + "system_bos": { + "tokens": 42, + "ordered_topk_exact_tokens": 20, + "set_exact_tokens": 26, + "mean_set_jaccard": 0.8809523809523809, + "mean_token_weighted_tv": 0.02462792755769832, + "aggregate_load_tv": 0.05555555555555555 + }, + "system_x": { + "tokens": 42, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 22, + "mean_set_jaccard": 0.8458049886621317, + "mean_token_weighted_tv": 0.03822891507297754, + "aggregate_load_tv": 0.07539682539682539 + }, + "system_period": { + "tokens": 42, + "ordered_topk_exact_tokens": 16, + "set_exact_tokens": 22, + "mean_set_jaccard": 0.8395691609977325, + "mean_token_weighted_tv": 0.03594146030289786, + "aggregate_load_tv": 0.08333333333333333 + }, + "bos_at_s0": { + "tokens": 42, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 18, + "mean_set_jaccard": 0.8174603174603176, + "mean_token_weighted_tv": 0.038947692983562036, + "aggregate_load_tv": 0.07539682539682539 + }, + "bos_at_s1": { + "tokens": 42, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.8197278911564626, + "mean_token_weighted_tv": 0.03788797949839916, + "aggregate_load_tv": 0.07539682539682539 + }, + "x_at_s0": { + "tokens": 42, + "ordered_topk_exact_tokens": 17, + "set_exact_tokens": 21, + "mean_set_jaccard": 0.8367346938775511, + "mean_token_weighted_tv": 0.034714346374606804, + "aggregate_load_tv": 0.07936507936507936 + }, + "x_at_s1": { + "tokens": 42, + "ordered_topk_exact_tokens": 16, + "set_exact_tokens": 22, + "mean_set_jaccard": 0.8293650793650794, + "mean_token_weighted_tv": 0.0414587790589957, + "aggregate_load_tv": 0.06746031746031746 + }, + "period_at_s0": { + "tokens": 42, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 20, + "mean_set_jaccard": 0.8350340136054423, + "mean_token_weighted_tv": 0.038925502937109696, + "aggregate_load_tv": 0.08333333333333333 + }, + "period_at_s1": { + "tokens": 42, + "ordered_topk_exact_tokens": 18, + "set_exact_tokens": 21, + "mean_set_jaccard": 0.822562358276644, + "mean_token_weighted_tv": 0.04222080175809208, + "aggregate_load_tv": 0.07142857142857142 + } + } + }, + "layer_26": { + "layer": 26, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "04b21381c8867a7d5bef70223fe79ccf611635d3c8798b5556a6300dff9ef752", + "route_weight_sha256": "07d5159215a70a47550de55ac9d60bca46769b91e21701f79b5a215e827a6532", + "loads": [ + 8, + 2, + 1, + 0, + 1, + 5, + 3, + 6, + 1, + 6, + 7, + 4, + 9, + 2, + 10, + 3, + 2, + 4, + 2, + 5, + 0, + 6, + 0, + 2, + 4, + 3, + 8, + 7, + 2, + 7, + 6, + 0, + 9, + 4, + 9, + 0, + 4, + 2, + 2, + 0, + 2, + 1, + 2, + 5, + 6, + 1, + 4, + 2, + 3, + 2, + 8, + 7, + 9, + 2, + 2, + 0, + 7, + 4, + 6, + 6, + 5, + 3, + 6, + 3 + ], + "weighted_loads": [ + 0.3110937103629112, + 0.07632406055927277, + 0.02825232595205307, + 0.0, + 0.03813069686293602, + 0.19310516864061356, + 0.16799934953451157, + 0.21677161008119583, + 0.038594938814640045, + 0.4283733628690243, + 0.3788071535527706, + 0.2313607968389988, + 0.5601709336042404, + 0.08816234394907951, + 0.6501324493438005, + 0.15053488686680794, + 0.17857848852872849, + 0.15339860133826733, + 0.06723076850175858, + 0.1971351895481348, + 0.0, + 0.6999727040529251, + 0.0, + 0.0757819190621376, + 0.14885909482836723, + 0.18380796909332275, + 0.977019440382719, + 0.43423688784241676, + 0.07125724852085114, + 0.5371843166649342, + 0.4031077567487955, + 0.0, + 0.4414393212646246, + 0.17420998960733414, + 0.38881255965679884, + 0.0, + 0.12475338950753212, + 0.08388325572013855, + 0.05681264400482178, + 0.0, + 0.1386159211397171, + 0.03611382842063904, + 0.08280036225914955, + 0.2731717899441719, + 0.25285162776708603, + 0.030633283779025078, + 0.12331419251859188, + 0.074318528175354, + 0.13507444597780704, + 0.06249777786433697, + 0.5099632702767849, + 0.28041530027985573, + 0.446688087657094, + 0.07898981496691704, + 0.06255554966628551, + 0.0, + 0.6181944459676743, + 0.2715449817478657, + 0.45732761546969414, + 0.2310805544257164, + 0.7051797658205032, + 0.11318639107048512, + 0.30481766909360886, + 1.3222729936242104 + ], + "unique_experts": 57, + "load_cv": 0.6982322999340562, + "normalized_load_entropy": 0.9322979169998825, + "max_load_share": 0.03968253968253968 + }, + "full_input": { + "tokens": 67, + "top_k": 6, + "decisions": 402, + "ordered_route_sha256": "c2e9cd1f3b1a401bc73d27f7a3d04391ec6c4e182b03424503e6904b22d10c23", + "route_weight_sha256": "268c00e2720802adebd00916e33ca66c5c34fb16fc1896a06f3178a4622dbdd8", + "loads": [ + 8, + 2, + 1, + 3, + 1, + 5, + 3, + 8, + 1, + 10, + 11, + 10, + 9, + 4, + 25, + 5, + 2, + 15, + 2, + 5, + 0, + 9, + 2, + 2, + 11, + 3, + 13, + 13, + 2, + 7, + 12, + 0, + 12, + 5, + 12, + 0, + 10, + 2, + 2, + 0, + 2, + 1, + 3, + 8, + 7, + 1, + 7, + 2, + 4, + 3, + 16, + 7, + 13, + 2, + 4, + 0, + 22, + 14, + 12, + 7, + 6, + 3, + 7, + 4 + ], + "weighted_loads": [ + 0.3110937103629112, + 0.07632406055927277, + 0.02825232595205307, + 0.10398070514202118, + 0.03813069686293602, + 0.19310516864061356, + 0.16799934953451157, + 0.33537793532013893, + 0.038594938814640045, + 0.6498376689851284, + 0.6175830140709877, + 0.5661165961064398, + 0.5601709336042404, + 0.20976170524954796, + 1.2997981993830763, + 0.24808038398623466, + 0.17857848852872849, + 0.711172888870351, + 0.06723076850175858, + 0.1971351895481348, + 0.0, + 0.9005579613149166, + 0.08394186943769455, + 0.0757819190621376, + 0.5754681564867496, + 0.18380796909332275, + 1.6948741674423218, + 0.6863968092948198, + 0.07125724852085114, + 0.5371843166649342, + 1.1391998026520014, + 0.0, + 0.5449330136179924, + 0.2067522332072258, + 0.6815358949825168, + 0.0, + 0.4591127708554268, + 0.08388325572013855, + 0.05681264400482178, + 0.0, + 0.1386159211397171, + 0.03611382842063904, + 0.13484039530158043, + 0.42676854506134987, + 0.29599668458104134, + 0.030633283779025078, + 0.28564478270709515, + 0.074318528175354, + 0.1694477554410696, + 1.0488511752337217, + 0.854008786380291, + 0.28041530027985573, + 0.8928073290735483, + 0.07898981496691704, + 0.14505992643535137, + 0.0, + 1.6465722378343344, + 0.7217486430890858, + 0.6938039213418961, + 0.2779475562274456, + 0.7059880230226554, + 0.11318639107048512, + 0.3455415107309818, + 1.3661074563860893 + ], + "unique_experts": 59, + "load_cv": 0.8529255495176439, + "normalized_load_entropy": 0.9137672659578818, + "max_load_share": 0.06218905472636816 + } + }, + "s1_eos": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "cc2fcd461edd02028c62c3acfdbcf67e4e090b9ac11781b43bd9133b4c708469", + "route_weight_sha256": "60c141e2037646d3407dbd8615b01c0dd97ea98912202ba36e2276ecd44bed6d", + "loads": [ + 8, + 2, + 0, + 1, + 1, + 5, + 3, + 6, + 0, + 6, + 6, + 4, + 9, + 3, + 11, + 5, + 2, + 3, + 2, + 5, + 0, + 6, + 0, + 2, + 3, + 3, + 8, + 7, + 1, + 7, + 7, + 0, + 7, + 4, + 8, + 1, + 5, + 2, + 3, + 0, + 2, + 1, + 2, + 5, + 8, + 2, + 4, + 2, + 2, + 1, + 8, + 7, + 9, + 2, + 4, + 0, + 6, + 4, + 6, + 5, + 5, + 3, + 5, + 3 + ], + "weighted_loads": [ + 0.31815314944833517, + 0.07614398375153542, + 0.0, + 0.032350316643714905, + 0.03737799450755119, + 0.20272215642035007, + 0.1778607927262783, + 0.2248028926551342, + 0.0, + 0.425845954567194, + 0.36682967469096184, + 0.2146633416414261, + 0.5789236500859261, + 0.12202166020870209, + 0.7023228220641613, + 0.21852182410657406, + 0.1707347258925438, + 0.13133618980646133, + 0.06805409118533134, + 0.1958917286247015, + 0.0, + 0.6651345565915108, + 0.0, + 0.06900345534086227, + 0.11685660853981972, + 0.18641172908246517, + 1.025874800980091, + 0.4265366531908512, + 0.03858434408903122, + 0.5276955738663673, + 0.4007451944053173, + 0.0, + 0.4046058841049671, + 0.18973195552825928, + 0.39284185599535704, + 0.028631141409277916, + 0.15304241701960564, + 0.08782294392585754, + 0.08655981160700321, + 0.0, + 0.14330100268125534, + 0.034065131098032, + 0.09522570669651031, + 0.27939390763640404, + 0.3354303929954767, + 0.06862350553274155, + 0.12224974483251572, + 0.07344400137662888, + 0.10431695729494095, + 0.03270293399691582, + 0.4965370297431946, + 0.2807676326483488, + 0.44469235092401505, + 0.07856381312012672, + 0.1285232175141573, + 0.0, + 0.5951055604964495, + 0.2518925182521343, + 0.4565276727080345, + 0.20678040757775307, + 0.6941424794495106, + 0.11507344245910645, + 0.27588136307895184, + 1.1574229300022125 + ], + "unique_experts": 57, + "load_cv": 0.6909777415771085, + "normalized_load_entropy": 0.9331546605689333, + "max_load_share": 0.04365079365079365 + }, + "full_input": { + "tokens": 83, + "top_k": 6, + "decisions": 498, + "ordered_route_sha256": "1f7d55d2c3d3065bccb3d9a2fcbcf64699b1f957eb5021806bdd5cd42a212219", + "route_weight_sha256": "fe8fcba452707c794a67af7307820c6399b299169c0897f9c4580edff4e0100c", + "loads": [ + 9, + 2, + 0, + 4, + 4, + 5, + 3, + 8, + 0, + 13, + 13, + 11, + 9, + 4, + 27, + 10, + 2, + 11, + 3, + 5, + 0, + 15, + 8, + 2, + 13, + 4, + 19, + 18, + 1, + 9, + 16, + 1, + 11, + 4, + 14, + 1, + 17, + 7, + 6, + 1, + 3, + 1, + 4, + 9, + 9, + 2, + 8, + 3, + 3, + 4, + 15, + 7, + 18, + 4, + 8, + 2, + 24, + 13, + 16, + 12, + 8, + 3, + 8, + 4 + ], + "weighted_loads": [ + 0.36618180852383375, + 0.07614398375153542, + 0.0, + 0.13436907902359962, + 0.21573718637228012, + 0.20272215642035007, + 0.1778607927262783, + 0.37132248654961586, + 0.0, + 0.8158716037869453, + 1.0621285177767277, + 0.8337109249550849, + 0.5789236500859261, + 0.17771484330296516, + 1.540282625646796, + 0.5298129674047232, + 0.1707347258925438, + 0.5552147099515423, + 0.1212899312376976, + 0.1958917286247015, + 0.0, + 1.2236837148666382, + 0.5442354790866375, + 0.06900345534086227, + 0.6633912436664104, + 0.25795760564506054, + 2.297009740024805, + 0.8518145866692066, + 0.03858434408903122, + 0.5986783057451248, + 1.391859758645296, + 0.0808718129992485, + 0.5742299407720566, + 0.18973195552825928, + 0.8275648122653365, + 0.028631141409277916, + 0.8281409293413162, + 0.38943150267004967, + 0.37985885329544544, + 0.03406776115298271, + 0.17434080317616463, + 0.034065131098032, + 0.18888376280665398, + 0.4775438532233238, + 0.38842334039509296, + 0.06862350553274155, + 0.37427160143852234, + 0.11633650586009026, + 0.13896896690130234, + 1.1727253906428814, + 0.7745562121272087, + 0.2807676326483488, + 1.2450949251651764, + 0.26822999864816666, + 0.37223060987889767, + 0.11703720688819885, + 2.2510494086891413, + 1.0059099518693984, + 1.0277958810329437, + 0.49489189498126507, + 0.9339326010667719, + 0.11507344245910645, + 0.40457987412810326, + 1.2013002559542656 + ], + "unique_experts": 61, + "load_cv": 0.781214828404597, + "normalized_load_entropy": 0.9259720572465618, + "max_load_share": 0.05421686746987952 + } + }, + "s0_bos": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "16f95fa2023161465aa2b0829400e4bf02d645bf4c0a70d89e399a4ccd5340ca", + "route_weight_sha256": "cab32e75123bc2e1b7b7624398866af960e71069455fbccfa05796945881b88d", + "loads": [ + 8, + 2, + 1, + 1, + 2, + 5, + 3, + 5, + 1, + 6, + 6, + 4, + 9, + 2, + 11, + 4, + 2, + 5, + 2, + 5, + 1, + 6, + 0, + 2, + 3, + 4, + 8, + 7, + 1, + 7, + 6, + 0, + 8, + 4, + 5, + 1, + 6, + 2, + 2, + 0, + 2, + 3, + 3, + 6, + 6, + 0, + 3, + 2, + 2, + 2, + 8, + 6, + 9, + 2, + 3, + 0, + 7, + 4, + 6, + 5, + 5, + 3, + 5, + 3 + ], + "weighted_loads": [ + 0.27621067874133587, + 0.07290391996502876, + 0.027970749884843826, + 0.02147379145026207, + 0.13337649405002594, + 0.23528136126697063, + 0.17585952579975128, + 0.19093217328190804, + 0.043452296406030655, + 0.42898792400956154, + 0.37248334288597107, + 0.2202734649181366, + 0.5744580589234829, + 0.09306884929537773, + 0.6677983421832323, + 0.1993202269077301, + 0.1809907853603363, + 0.18282202631235123, + 0.07088430970907211, + 0.20319157093763351, + 0.029965847730636597, + 0.7193616479635239, + 0.0, + 0.07556447386741638, + 0.1212795302271843, + 0.21939274854958057, + 1.1096860449761152, + 0.4257078804075718, + 0.03622306138277054, + 0.5349792409688234, + 0.39518464356660843, + 0.0, + 0.4128983374685049, + 0.17731494829058647, + 0.2166416011750698, + 0.029824981465935707, + 0.1862038429826498, + 0.08924433588981628, + 0.05757593736052513, + 0.0, + 0.14116740226745605, + 0.1138971745967865, + 0.12261921353638172, + 0.3152086678892374, + 0.2503129579126835, + 0.0, + 0.10255691409111023, + 0.07513602077960968, + 0.10591548308730125, + 0.0698271170258522, + 0.5158962532877922, + 0.24871487356722355, + 0.4455527365207672, + 0.08179835975170135, + 0.09351404197514057, + 0.0, + 0.6761803813278675, + 0.2573663704097271, + 0.4287969134747982, + 0.18527699261903763, + 0.7132945843040943, + 0.1132732555270195, + 0.2771021695807576, + 0.9837480299174786 + ], + "unique_experts": 59, + "load_cv": 0.6565751707919504, + "normalized_load_entropy": 0.9416028377487121, + "max_load_share": 0.04365079365079365 + }, + "full_input": { + "tokens": 67, + "top_k": 6, + "decisions": 402, + "ordered_route_sha256": "980dcabee1970310da7e8200cd64daf3d7a668d126d041d74709489c945d6d0b", + "route_weight_sha256": "8a74c2efa295e5f848d84f9363e4a3d5e3400208bcb9f661654d5eb772c9c81c", + "loads": [ + 9, + 2, + 1, + 4, + 2, + 6, + 3, + 7, + 1, + 10, + 9, + 9, + 9, + 4, + 24, + 6, + 2, + 13, + 2, + 5, + 1, + 10, + 3, + 2, + 10, + 4, + 13, + 14, + 1, + 7, + 14, + 0, + 10, + 4, + 9, + 1, + 12, + 2, + 2, + 0, + 2, + 4, + 5, + 9, + 9, + 0, + 6, + 2, + 3, + 2, + 16, + 6, + 13, + 2, + 5, + 1, + 20, + 13, + 12, + 6, + 5, + 3, + 6, + 5 + ], + "weighted_loads": [ + 0.299258217215538, + 0.07290391996502876, + 0.027970749884843826, + 0.13536280021071434, + 0.13337649405002594, + 0.285649036988616, + 0.17585952579975128, + 0.3311629854142666, + 0.043452296406030655, + 0.6558756567537785, + 0.5524402223527431, + 0.5529824662953615, + 0.5744580589234829, + 0.22088200971484184, + 1.238334532827139, + 0.31567784398794174, + 0.1809907853603363, + 0.5969106890261173, + 0.07088430970907211, + 0.20319157093763351, + 0.029965847730636597, + 0.9572880417108536, + 0.12983384355902672, + 0.07556447386741638, + 0.5367942489683628, + 0.21939274854958057, + 1.8874121885746717, + 0.7330989707261324, + 0.03622306138277054, + 0.5349792409688234, + 1.1930827237665653, + 0.0, + 0.48347371630370617, + 0.17731494829058647, + 0.5506108663976192, + 0.029824981465935707, + 0.5015934202820063, + 0.08924433588981628, + 0.05757593736052513, + 0.0, + 0.14116740226745605, + 0.5442890524864197, + 0.21806380338966846, + 0.46880542300641537, + 0.40324612706899643, + 0.0, + 0.26654137298464775, + 0.07513602077960968, + 0.16770626977086067, + 0.0698271170258522, + 0.8599417693912983, + 0.24871487356722355, + 0.8853758051991463, + 0.08179835975170135, + 0.17819985561072826, + 0.03433853015303612, + 1.640820799395442, + 0.7027163617312908, + 0.6652732193470001, + 0.23214399442076683, + 0.7132945843040943, + 0.1132732555270195, + 0.3178260112181306, + 1.098103079944849 + ], + "unique_experts": 61, + "load_cv": 0.8046638883216899, + "normalized_load_entropy": 0.923783351807069, + "max_load_share": 0.05970149253731343 + } + }, + "s1_bos": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "f8910847986aa9757580fb0f3d7059f922991f99fc1eb5d69d7a5f8525ab1a8a", + "route_weight_sha256": "670f9cf9c3ef66666ca45ee3bea260377a59ec4343fd7acf031242f36f163371", + "loads": [ + 7, + 2, + 1, + 1, + 2, + 6, + 3, + 4, + 1, + 6, + 6, + 4, + 9, + 3, + 10, + 5, + 2, + 4, + 2, + 5, + 0, + 7, + 0, + 2, + 3, + 3, + 8, + 7, + 1, + 8, + 5, + 0, + 9, + 5, + 5, + 1, + 4, + 2, + 2, + 0, + 2, + 3, + 2, + 5, + 6, + 1, + 4, + 2, + 3, + 2, + 8, + 6, + 9, + 3, + 3, + 0, + 6, + 4, + 6, + 5, + 5, + 3, + 6, + 3 + ], + "weighted_loads": [ + 0.2780706752091646, + 0.07501636072993279, + 0.025500379502773285, + 0.020785396918654442, + 0.14484867826104164, + 0.2752367649227381, + 0.1809098832309246, + 0.16112498939037323, + 0.043984122574329376, + 0.4328935369849205, + 0.3731037452816963, + 0.2348022162914276, + 0.5866702906787395, + 0.12279054336249828, + 0.6423356775194407, + 0.23348325304687023, + 0.17535530775785446, + 0.1493391953408718, + 0.06934051588177681, + 0.1988188661634922, + 0.0, + 0.7196054756641388, + 0.0, + 0.07171914912760258, + 0.11068936996161938, + 0.19168571382761002, + 1.0489518642425537, + 0.41981881111860275, + 0.03521297872066498, + 0.5719598475843668, + 0.37236253544688225, + 0.0, + 0.4419190287590027, + 0.2507268600165844, + 0.2578121982514858, + 0.030484208837151527, + 0.12258890457451344, + 0.08863604068756104, + 0.0676036886870861, + 0.0, + 0.1359834037721157, + 0.12650083005428314, + 0.06948547996580601, + 0.30661801248788834, + 0.25212743133306503, + 0.030823910608887672, + 0.12577352114021778, + 0.07198721170425415, + 0.12080941908061504, + 0.06590213999152184, + 0.5099542401731014, + 0.2529224082827568, + 0.4624305572360754, + 0.1060014683753252, + 0.09350846894085407, + 0.0, + 0.6383477821946144, + 0.2743656747043133, + 0.4286857135593891, + 0.19733257964253426, + 0.7273495309054852, + 0.11705328896641731, + 0.3058296674862504, + 1.0090473890304565 + ], + "unique_experts": 59, + "load_cv": 0.6457411303748569, + "normalized_load_entropy": 0.9431274024597941, + "max_load_share": 0.03968253968253968 + }, + "full_input": { + "tokens": 83, + "top_k": 6, + "decisions": 498, + "ordered_route_sha256": "af08efa06cf17ccc9498328ba098dc01cb39e0a0fe68e57f9402eadf1a9025e8", + "route_weight_sha256": "cc0f393d4e3991152fa1575775e5385c0c8af42834e1a7587806449e9f36f069", + "loads": [ + 7, + 2, + 1, + 2, + 5, + 6, + 3, + 6, + 1, + 14, + 14, + 10, + 9, + 6, + 23, + 10, + 2, + 11, + 3, + 5, + 0, + 15, + 8, + 2, + 13, + 4, + 20, + 17, + 1, + 10, + 16, + 1, + 13, + 6, + 12, + 1, + 16, + 7, + 5, + 1, + 3, + 3, + 6, + 9, + 8, + 1, + 7, + 3, + 4, + 4, + 15, + 6, + 18, + 5, + 7, + 3, + 24, + 12, + 16, + 12, + 7, + 3, + 9, + 5 + ], + "weighted_loads": [ + 0.2780706752091646, + 0.07501636072993279, + 0.025500379502773285, + 0.05792100913822651, + 0.32320787012577057, + 0.2752367649227381, + 0.1809098832309246, + 0.3254131004214287, + 0.043984122574329376, + 0.8681745417416096, + 1.1417610794305801, + 0.8515988737344742, + 0.5866702906787395, + 0.266865449026227, + 1.377153331413865, + 0.552950182929635, + 0.17535530775785446, + 0.5584137123078108, + 0.127453301101923, + 0.1988188661634922, + 0.0, + 1.2572744712233543, + 0.525217592716217, + 0.07171914912760258, + 0.6360831763595343, + 0.2632315903902054, + 2.4710426330566406, + 0.8045336343348026, + 0.03521297872066498, + 0.6429425794631243, + 1.5095191970467567, + 0.0808718129992485, + 0.606214914470911, + 0.295657716691494, + 0.7774162665009499, + 0.030484208837151527, + 0.7930981572717428, + 0.39024459943175316, + 0.36090273037552834, + 0.03406776115298271, + 0.167023204267025, + 0.12650083005428314, + 0.23974590934813023, + 0.5047679580748081, + 0.3384247198700905, + 0.030823910608887672, + 0.33172560669481754, + 0.11487971618771553, + 0.15546142868697643, + 0.22098204120993614, + 0.7879734225571156, + 0.2529224082827568, + 1.2468484472483397, + 0.29566765390336514, + 0.3374373819679022, + 0.1516130082309246, + 2.2937242686748505, + 1.023119144141674, + 0.9999539218842983, + 0.48544406704604626, + 0.9662229530513287, + 0.11705328896641731, + 0.4345281785354018, + 1.1340244859457016 + ], + "unique_experts": 63, + "load_cv": 0.7422551628181605, + "normalized_load_entropy": 0.9337299416596193, + "max_load_share": 0.04819277108433735 + } + }, + "s0_x": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "56598f856bfc5df2062c0dc90c32096382af1aceb2fbdc0657ade5d0543550bb", + "route_weight_sha256": "3740de8a5bcf2ad16a2d4cc6400b33f71226c79696f7aee23f83f599384b669a", + "loads": [ + 8, + 2, + 1, + 1, + 1, + 8, + 3, + 5, + 1, + 7, + 7, + 4, + 9, + 3, + 9, + 4, + 2, + 4, + 2, + 5, + 1, + 7, + 0, + 2, + 3, + 4, + 8, + 7, + 1, + 6, + 6, + 0, + 8, + 4, + 5, + 2, + 5, + 2, + 2, + 1, + 2, + 2, + 2, + 5, + 6, + 0, + 4, + 2, + 3, + 2, + 8, + 6, + 7, + 2, + 4, + 0, + 7, + 4, + 6, + 5, + 5, + 2, + 5, + 3 + ], + "weighted_loads": [ + 0.299172842875123, + 0.07278876006603241, + 0.02617490291595459, + 0.03925042226910591, + 0.033925630152225494, + 0.3405594862997532, + 0.1692354753613472, + 0.19013794139027596, + 0.04261380061507225, + 0.46630834415555, + 0.3892090264707804, + 0.24306291714310646, + 0.558769728988409, + 0.11980404332280159, + 0.6046434566378593, + 0.19071321189403534, + 0.17624583840370178, + 0.13650502264499664, + 0.07022793591022491, + 0.19146256521344185, + 0.031080424785614014, + 0.7599901333451271, + 0.0, + 0.07352147623896599, + 0.12641312927007675, + 0.21373405866324902, + 0.9848757870495319, + 0.4137667901813984, + 0.03573198989033699, + 0.5240935236215591, + 0.3788437470793724, + 0.0, + 0.44757864996790886, + 0.15499276295304298, + 0.2344064237549901, + 0.06159015744924545, + 0.1607959009706974, + 0.08528239652514458, + 0.0564204677939415, + 0.027329176664352417, + 0.1358947642147541, + 0.06590161472558975, + 0.08799676410853863, + 0.2827567644417286, + 0.22736696898937225, + 0.0, + 0.1248839683830738, + 0.0775916762650013, + 0.11795714497566223, + 0.06762120127677917, + 0.5117011927068233, + 0.24049575254321098, + 0.3625367730855942, + 0.07829476147890091, + 0.11867263913154602, + 0.0, + 0.6420795992016792, + 0.28511763364076614, + 0.45477040484547615, + 0.19130914099514484, + 0.6967191100120544, + 0.07251115702092648, + 0.28277771547436714, + 1.0720604285597801 + ], + "unique_experts": 60, + "load_cv": 0.6347221912105463, + "normalized_load_entropy": 0.9451762881227854, + "max_load_share": 0.03571428571428571 + }, + "full_input": { + "tokens": 67, + "top_k": 6, + "decisions": 402, + "ordered_route_sha256": "d51b4b9af2a6042f0502681c7116eccd6f97267c5b804aabfb4baf11eca004cf", + "route_weight_sha256": "a0be38d22c069b98128e62ee7af5cddc16d40bb02d525b89a53fa3000e84ea78", + "loads": [ + 8, + 2, + 1, + 3, + 1, + 8, + 3, + 7, + 1, + 10, + 11, + 11, + 9, + 5, + 23, + 6, + 2, + 15, + 2, + 5, + 1, + 10, + 1, + 2, + 10, + 4, + 13, + 14, + 1, + 7, + 12, + 0, + 10, + 4, + 8, + 2, + 11, + 2, + 2, + 1, + 2, + 2, + 3, + 10, + 7, + 0, + 7, + 2, + 3, + 2, + 17, + 6, + 11, + 2, + 6, + 1, + 24, + 14, + 12, + 6, + 5, + 2, + 6, + 4 + ], + "weighted_loads": [ + 0.299172842875123, + 0.07278876006603241, + 0.02617490291595459, + 0.11073175817728043, + 0.033925630152225494, + 0.3405594862997532, + 0.1692354753613472, + 0.3166288696229458, + 0.04261380061507225, + 0.6521247662603855, + 0.6377601083368063, + 0.7201343160122633, + 0.558769728988409, + 0.24079396948218346, + 1.2838097680360079, + 0.28645047545433044, + 0.17624583840370178, + 0.7346462532877922, + 0.07022793591022491, + 0.19146256521344185, + 0.031080424785614014, + 0.9615191631019115, + 0.03534792363643646, + 0.07352147623896599, + 0.5488762706518173, + 0.21373405866324902, + 1.6667395234107971, + 0.7030872087925673, + 0.03573198989033699, + 0.5731189958751202, + 1.0219380930066109, + 0.0, + 0.517231211066246, + 0.15499276295304298, + 0.4948742212727666, + 0.06159015744924545, + 0.469409566372633, + 0.08528239652514458, + 0.0564204677939415, + 0.027329176664352417, + 0.1358947642147541, + 0.06590161472558975, + 0.13548230566084385, + 0.529592826962471, + 0.2626814544200897, + 0.0, + 0.2888019382953644, + 0.0775916762650013, + 0.11795714497566223, + 0.06762120127677917, + 0.8880506046116352, + 0.24049575254321098, + 0.7803277596831322, + 0.07829476147890091, + 0.19995979219675064, + 0.030570684000849724, + 1.7995745930820704, + 0.8406710848212242, + 0.6912467107176781, + 0.23817614279687405, + 0.6967191100120544, + 0.07251115702092648, + 0.3235015571117401, + 1.115894891321659 + ], + "unique_experts": 62, + "load_cv": 0.8431184622387223, + "normalized_load_entropy": 0.9187217115226243, + "max_load_share": 0.05970149253731343 + } + }, + "s1_x": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "201cc4debd2cfb89db8e5a9cca7708a7a53160def1c4aefbb3519aee52e6ba61", + "route_weight_sha256": "f2053174de3acc03c77797d87bbe23f4124cd246ea9c1ac4f1737e4f80eb945a", + "loads": [ + 5, + 2, + 0, + 2, + 2, + 5, + 3, + 4, + 1, + 7, + 7, + 4, + 9, + 1, + 9, + 5, + 2, + 5, + 2, + 5, + 0, + 8, + 0, + 2, + 5, + 4, + 8, + 7, + 1, + 8, + 8, + 0, + 7, + 6, + 5, + 2, + 6, + 3, + 2, + 0, + 2, + 3, + 0, + 5, + 6, + 1, + 3, + 2, + 3, + 2, + 8, + 6, + 7, + 2, + 3, + 0, + 7, + 4, + 6, + 5, + 5, + 3, + 5, + 2 + ], + "weighted_loads": [ + 0.1870676800608635, + 0.07309751212596893, + 0.0, + 0.07137006148695946, + 0.14436764270067215, + 0.21949978172779083, + 0.17863889783620834, + 0.1493506971746683, + 0.04230581223964691, + 0.4828553758561611, + 0.3762965966016054, + 0.2900248020887375, + 0.5536546595394611, + 0.055671703070402145, + 0.6524676438421011, + 0.2361726202070713, + 0.16690490394830704, + 0.17577441222965717, + 0.06411542370915413, + 0.19210815988481045, + 0.0, + 0.8038712255656719, + 0.0, + 0.0673256665468216, + 0.2052953876554966, + 0.236408032476902, + 0.8937391508370638, + 0.4233969375491142, + 0.035296481102705, + 0.5855312468484044, + 0.4351185839623213, + 0.0, + 0.349012890830636, + 0.245584137737751, + 0.2462327377870679, + 0.0609582494944334, + 0.19665155746042728, + 0.12231674790382385, + 0.05871494673192501, + 0.0, + 0.13274121657013893, + 0.11304287612438202, + 0.0, + 0.2794421687722206, + 0.22546904906630516, + 0.030064595863223076, + 0.09246090427041054, + 0.07390856370329857, + 0.09739689156413078, + 0.06374550797045231, + 0.4959539398550987, + 0.2341962829232216, + 0.35620460473001003, + 0.06922909058630466, + 0.09155462682247162, + 0.0, + 0.6874387338757515, + 0.33798855915665627, + 0.45466460287570953, + 0.19822211004793644, + 0.6913623586297035, + 0.10504056699573994, + 0.28763950895518064, + 0.9694570079445839 + ], + "unique_experts": 57, + "load_cv": 0.6519540564416777, + "normalized_load_entropy": 0.9383385259351944, + "max_load_share": 0.03571428571428571 + }, + "full_input": { + "tokens": 83, + "top_k": 6, + "decisions": 498, + "ordered_route_sha256": "074fb0ca211ff0f5f1674ff85e270fae8a9599b006e33b7034ec71df832f9f86", + "route_weight_sha256": "f5676414f7b529d88f71ec139e96f2f1ab61146833961ea11e2a4263513421c5", + "loads": [ + 5, + 2, + 0, + 3, + 5, + 5, + 3, + 6, + 1, + 14, + 14, + 12, + 9, + 2, + 25, + 10, + 2, + 12, + 2, + 5, + 0, + 16, + 7, + 2, + 15, + 5, + 19, + 18, + 1, + 11, + 17, + 1, + 11, + 7, + 11, + 2, + 19, + 8, + 5, + 1, + 3, + 3, + 2, + 9, + 7, + 1, + 6, + 3, + 4, + 4, + 15, + 6, + 16, + 4, + 7, + 2, + 28, + 14, + 17, + 13, + 7, + 3, + 8, + 3 + ], + "weighted_loads": [ + 0.1870676800608635, + 0.07309751212596893, + 0.0, + 0.10307852551341057, + 0.3227268345654011, + 0.21949978172779083, + 0.17863889783620834, + 0.2956418264657259, + 0.04230581223964691, + 0.8738082982599735, + 1.0944398064166307, + 1.0594198405742645, + 0.5536546595394611, + 0.11136488616466522, + 1.6015918496996164, + 0.5544153042137623, + 0.16690490394830704, + 0.6297795064747334, + 0.06411542370915413, + 0.19210815988481045, + 0.0, + 1.3239421360194683, + 0.48735954985022545, + 0.0673256665468216, + 0.724128782749176, + 0.3079539090394974, + 2.16723551414907, + 0.8512211889028549, + 0.035296481102705, + 0.7139679314568639, + 1.377241438254714, + 0.0808718129992485, + 0.5118296761065722, + 0.2851578816771507, + 0.6826066384091973, + 0.0609582494944334, + 0.896544000133872, + 0.423925306648016, + 0.35201398842036724, + 0.03406776115298271, + 0.16378101706504822, + 0.11304287612438202, + 0.09686670079827309, + 0.4775921143591404, + 0.25654770247638226, + 0.030064595863223076, + 0.30387234687805176, + 0.11680106818675995, + 0.13204890117049217, + 0.21882540918886662, + 0.7739731222391129, + 0.2341962829232216, + 1.1070318948477507, + 0.2588952761143446, + 0.33236013911664486, + 0.11703720688819885, + 2.4571545496582985, + 1.2339561246335506, + 1.091226190328598, + 0.5324554704129696, + 0.930235780775547, + 0.10504056699573994, + 0.41633802000433207, + 1.013334333896637 + ], + "unique_experts": 62, + "load_cv": 0.8142118399456845, + "normalized_load_entropy": 0.9225222789438249, + "max_load_share": 0.05622489959839357 + } + }, + "s0_period": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "daa28b531fca3605fa25b75d28d106a5c58d10f53b500ee77a41bc1ff17b17f5", + "route_weight_sha256": "d9f145940b9d1cc525372725a15fd53f85b60367737939db733333c8bcbf5095", + "loads": [ + 7, + 2, + 1, + 1, + 2, + 8, + 3, + 5, + 1, + 6, + 7, + 4, + 9, + 2, + 9, + 4, + 2, + 6, + 2, + 5, + 0, + 7, + 0, + 2, + 3, + 4, + 8, + 7, + 1, + 6, + 6, + 0, + 9, + 5, + 5, + 2, + 3, + 2, + 2, + 1, + 2, + 3, + 1, + 5, + 7, + 0, + 4, + 3, + 3, + 2, + 8, + 6, + 8, + 2, + 3, + 0, + 7, + 4, + 6, + 5, + 5, + 2, + 5, + 2 + ], + "weighted_loads": [ + 0.23030042834579945, + 0.07297394052147865, + 0.029223445802927017, + 0.042234085500240326, + 0.1463656760752201, + 0.33337391540408134, + 0.1729551050812006, + 0.1982194036245346, + 0.03990436717867851, + 0.43449150025844574, + 0.4026757813990116, + 0.23253099992871284, + 0.5778458826243877, + 0.09400263801217079, + 0.5808404162526131, + 0.2015102654695511, + 0.17879261821508408, + 0.18406281806528568, + 0.0725158043205738, + 0.19228813238441944, + 0.0, + 0.7666335888206959, + 0.0, + 0.0746254026889801, + 0.13372453302145004, + 0.2209457140415907, + 1.0309342686086893, + 0.42194244265556335, + 0.03589719906449318, + 0.5208666548132896, + 0.4132314845919609, + 0.0, + 0.428296510130167, + 0.20554755255579948, + 0.23464358504861593, + 0.06260908767580986, + 0.09324290603399277, + 0.08205960690975189, + 0.056733934208750725, + 0.026529347524046898, + 0.14189282059669495, + 0.1407046727836132, + 0.04261127859354019, + 0.29096342623233795, + 0.26013775914907455, + 0.0, + 0.1274060718715191, + 0.09546260349452496, + 0.12112895213067532, + 0.06994223594665527, + 0.5126221440732479, + 0.24966994673013687, + 0.4041237309575081, + 0.0769578218460083, + 0.0902228131890297, + 0.0, + 0.6392985582351685, + 0.27178697288036346, + 0.4478391632437706, + 0.19822034239768982, + 0.6961807496845722, + 0.0742284394800663, + 0.27480289433151484, + 0.9476974532008171 + ], + "unique_experts": 59, + "load_cv": 0.6519540564416777, + "normalized_load_entropy": 0.9415063972354609, + "max_load_share": 0.03571428571428571 + }, + "full_input": { + "tokens": 67, + "top_k": 6, + "decisions": 402, + "ordered_route_sha256": "34a08485bfbaa3fad7a88ca85c8a0297dd5962f108b32442cc77a6ab9eee3eeb", + "route_weight_sha256": "1db51ea2db91033ca2b3233697be03bc0859ad77f2523fe4691e1d7145ad9d98", + "loads": [ + 7, + 2, + 1, + 4, + 2, + 9, + 3, + 7, + 1, + 10, + 11, + 9, + 9, + 4, + 23, + 5, + 2, + 16, + 2, + 5, + 0, + 10, + 1, + 2, + 11, + 4, + 12, + 13, + 1, + 6, + 14, + 0, + 12, + 6, + 8, + 2, + 10, + 2, + 2, + 1, + 2, + 3, + 2, + 8, + 9, + 0, + 8, + 3, + 3, + 2, + 16, + 6, + 13, + 2, + 5, + 0, + 23, + 13, + 12, + 6, + 5, + 2, + 6, + 4 + ], + "weighted_loads": [ + 0.23030042834579945, + 0.07297394052147865, + 0.029223445802927017, + 0.15706871822476387, + 0.1463656760752201, + 0.37801825255155563, + 0.1729551050812006, + 0.3229762762784958, + 0.03990436717867851, + 0.6518695689737797, + 0.6570315137505531, + 0.5652400013059378, + 0.5778458826243877, + 0.21612832322716713, + 1.1871463116258383, + 0.2598835304379463, + 0.17879261821508408, + 0.7369000744074583, + 0.0725158043205738, + 0.19228813238441944, + 0.0, + 0.9652584940195084, + 0.03632165864109993, + 0.0746254026889801, + 0.6545874550938606, + 0.2209457140415907, + 1.6682799588888884, + 0.6747619155794382, + 0.03589719906449318, + 0.5208666548132896, + 1.1386600229889154, + 0.0, + 0.5373059436678886, + 0.2441430315375328, + 0.5075064590200782, + 0.06260908767580986, + 0.45711416378617287, + 0.08205960690975189, + 0.056733934208750725, + 0.026529347524046898, + 0.14189282059669495, + 0.1407046727836132, + 0.08897962048649788, + 0.4445601813495159, + 0.3333524093031883, + 0.0, + 0.3370105065405369, + 0.09546260349452496, + 0.12112895213067532, + 0.06994223594665527, + 0.856667660176754, + 0.24966994673013687, + 0.9047043658792973, + 0.0769578218460083, + 0.16982684656977654, + 0.0, + 1.814000193029642, + 0.7171369642019272, + 0.6843154691159725, + 0.24508734419941902, + 0.6961807496845722, + 0.0742284394800663, + 0.3155267359688878, + 1.0722006037831306 + ], + "unique_experts": 60, + "load_cv": 0.8379356095431509, + "normalized_load_entropy": 0.9173994890495976, + "max_load_share": 0.05721393034825871 + } + }, + "s1_period": { + "target_content": { + "tokens": 42, + "top_k": 6, + "decisions": 252, + "ordered_route_sha256": "ed653c4c90a0e7a846064d220b15b85244ab4169f38b5d2e763040736c96bc54", + "route_weight_sha256": "1a224cc2e0f62e5ba831a083aa3500b38447446f881216331460c8bad3ca4cc2", + "loads": [ + 6, + 2, + 0, + 1, + 2, + 8, + 3, + 3, + 1, + 6, + 6, + 4, + 9, + 1, + 10, + 5, + 2, + 4, + 2, + 5, + 0, + 7, + 0, + 2, + 4, + 5, + 8, + 7, + 1, + 8, + 5, + 1, + 7, + 7, + 6, + 1, + 6, + 1, + 3, + 0, + 2, + 3, + 1, + 5, + 6, + 1, + 3, + 2, + 3, + 2, + 8, + 6, + 7, + 2, + 3, + 0, + 7, + 4, + 6, + 6, + 5, + 3, + 6, + 2 + ], + "weighted_loads": [ + 0.22241525538265705, + 0.07439690828323364, + 0.0, + 0.03869481012225151, + 0.14795416593551636, + 0.31694499030709267, + 0.18328684754669666, + 0.14070964604616165, + 0.04054855555295944, + 0.4349481798708439, + 0.3438430204987526, + 0.3199727423489094, + 0.5575930736958981, + 0.05764639377593994, + 0.6582662146538496, + 0.22250564582645893, + 0.16766493767499924, + 0.1435123085975647, + 0.0665559358894825, + 0.1855123396962881, + 0.0, + 0.7502001412212849, + 0.0, + 0.06415341421961784, + 0.1487108077853918, + 0.2637878246605396, + 0.9379767011851072, + 0.4197508618235588, + 0.036983001977205276, + 0.5872248653322458, + 0.34733735769987106, + 0.01996109075844288, + 0.35735172405838966, + 0.276873966678977, + 0.2953739818185568, + 0.031125549226999283, + 0.22160967998206615, + 0.04029293358325958, + 0.09054249338805676, + 0.0, + 0.1365363635122776, + 0.1196114644408226, + 0.03754284232854843, + 0.29267712868750095, + 0.22992032393813133, + 0.032237958163022995, + 0.09446807578206062, + 0.0715540312230587, + 0.10385725647211075, + 0.0642511360347271, + 0.48046012222766876, + 0.21874823607504368, + 0.368308050557971, + 0.0703081414103508, + 0.07879165187478065, + 0.0, + 0.7306168712675571, + 0.3436140902340412, + 0.4526553750038147, + 0.244101420044899, + 0.6978623941540718, + 0.11494626104831696, + 0.3128917859867215, + 0.9744492322206497 + ], + "unique_experts": 59, + "load_cv": 0.661163987290747, + "normalized_load_entropy": 0.9390359359302297, + "max_load_share": 0.03968253968253968 + }, + "full_input": { + "tokens": 83, + "top_k": 6, + "decisions": 498, + "ordered_route_sha256": "8413ef92331e3c052b1f69d73061515a14a40b536752f94d8129af28ba56dee0", + "route_weight_sha256": "ba639b993c3d229d1fbac20a649e58e85d66f171df802c952246f69d59ca7222", + "loads": [ + 6, + 2, + 0, + 2, + 5, + 8, + 3, + 5, + 1, + 13, + 13, + 10, + 9, + 2, + 25, + 10, + 2, + 11, + 2, + 5, + 0, + 15, + 7, + 2, + 15, + 6, + 19, + 18, + 1, + 10, + 14, + 2, + 11, + 7, + 12, + 1, + 19, + 6, + 6, + 1, + 3, + 3, + 4, + 10, + 6, + 1, + 7, + 3, + 7, + 4, + 15, + 6, + 17, + 4, + 7, + 3, + 28, + 12, + 16, + 13, + 7, + 3, + 9, + 4 + ], + "weighted_loads": [ + 0.22241525538265705, + 0.07439690828323364, + 0.0, + 0.06861532106995583, + 0.3263133578002453, + 0.31694499030709267, + 0.18328684754669666, + 0.27684053406119347, + 0.04054855555295944, + 0.8264928534626961, + 1.0739399045705795, + 0.936769399791956, + 0.5575930736958981, + 0.11333957687020302, + 1.5428940784186125, + 0.5253256317228079, + 0.16766493767499924, + 0.6393186617642641, + 0.0665559358894825, + 0.1855123396962881, + 0.0, + 1.2774615548551083, + 0.4867679588496685, + 0.06415341421961784, + 0.7450026925653219, + 0.335333701223135, + 2.208197394385934, + 0.841275542974472, + 0.036983001977205276, + 0.6582075972110033, + 1.289685271680355, + 0.10083290375769138, + 0.5197365991771221, + 0.276873966678977, + 0.7333356756716967, + 0.031125549226999283, + 0.9368413630872965, + 0.3419014923274517, + 0.383841535076499, + 0.03406776115298271, + 0.1675761640071869, + 0.1196114644408226, + 0.1644282564520836, + 0.5188473928719759, + 0.22992032393813133, + 0.032237958163022995, + 0.3436935432255268, + 0.11444653570652008, + 0.2503709588199854, + 0.2193310372531414, + 0.7584793046116829, + 0.21874823607504368, + 1.1828622687608004, + 0.25997432693839073, + 0.32975422590970993, + 0.1468634381890297, + 2.5759044159203768, + 1.092367559671402, + 1.023923583328724, + 0.532212907448411, + 0.9367358162999153, + 0.11494626104831696, + 0.44159029703587294, + 1.0982076898217201 + ], + "unique_experts": 62, + "load_cv": 0.7861541952665404, + "normalized_load_entropy": 0.9275681018787486, + "max_load_share": 0.05622489959839357 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 42, + "ordered_topk_exact_tokens": 21, + "set_exact_tokens": 26, + "mean_set_jaccard": 0.8809523809523809, + "mean_token_weighted_tv": 0.02582135644652659, + "aggregate_load_tv": 0.05555555555555555 + }, + "system_bos": { + "tokens": 42, + "ordered_topk_exact_tokens": 19, + "set_exact_tokens": 28, + "mean_set_jaccard": 0.8894557823129252, + "mean_token_weighted_tv": 0.022330104218175013, + "aggregate_load_tv": 0.047619047619047616 + }, + "system_x": { + "tokens": 42, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 24, + "mean_set_jaccard": 0.8409297052154197, + "mean_token_weighted_tv": 0.03978938937541984, + "aggregate_load_tv": 0.07142857142857142 + }, + "system_period": { + "tokens": 42, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 23, + "mean_set_jaccard": 0.8412698412698415, + "mean_token_weighted_tv": 0.035710584228148774, + "aggregate_load_tv": 0.07142857142857142 + }, + "bos_at_s0": { + "tokens": 42, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 24, + "mean_set_jaccard": 0.8543083900226757, + "mean_token_weighted_tv": 0.035205380769357794, + "aggregate_load_tv": 0.05952380952380952 + }, + "bos_at_s1": { + "tokens": 42, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 22, + "mean_set_jaccard": 0.8395691609977325, + "mean_token_weighted_tv": 0.03437507319973693, + "aggregate_load_tv": 0.06349206349206349 + }, + "x_at_s0": { + "tokens": 42, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 20, + "mean_set_jaccard": 0.8350340136054422, + "mean_token_weighted_tv": 0.032442052249929736, + "aggregate_load_tv": 0.06746031746031746 + }, + "x_at_s1": { + "tokens": 42, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 20, + "mean_set_jaccard": 0.817687074829932, + "mean_token_weighted_tv": 0.04424878594554251, + "aggregate_load_tv": 0.09523809523809523 + }, + "period_at_s0": { + "tokens": 42, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 21, + "mean_set_jaccard": 0.8346938775510204, + "mean_token_weighted_tv": 0.03691761105853532, + "aggregate_load_tv": 0.07539682539682539 + }, + "period_at_s1": { + "tokens": 42, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 20, + "mean_set_jaccard": 0.8157596371882088, + "mean_token_weighted_tv": 0.04440089575724587, + "aggregate_load_tv": 0.09126984126984128 + } + } + } + } + }, + { + "id": "gsm8k/test/1069", + "domain": "math", + "label": "Grade-school math", + "within_domain_index": 0, + "selection_rank": "000946b459ce33a645f403b9d781a7aefd81f5568412149f4588381fed55b1d7", + "source_text_sha256": "0cc2ca2bdd6ee8d664eb1197e8020bac71c25ba0ce52d813fc4adbf08df22378", + "source_characters": 522, + "source_tokens": 107, + "content_token_ids_sha256": "4352631307b8b721b2b062c1b5231bc7b86c810c027c92464ac415d75ff73c57", + "prompt_tokens_by_condition": { + "s0_eos": 131, + "s1_eos": 147, + "s0_bos": 131, + "s1_bos": 147, + "s0_x": 131, + "s1_x": 147, + "s0_period": 131, + "s1_period": 147 + }, + "batch_prompt_tokens": 147, + "content_tokens": 106, + "boundary_crossing_tokens_by_condition": { + "s0_eos": 1, + "s1_eos": 1, + "s0_bos": 1, + "s1_bos": 1, + "s0_x": 1, + "s1_x": 1, + "s0_period": 1, + "s1_period": 1 + }, + "forward_seconds": 0.8311633130069822, + "peak_cuda_memory_allocated_bytes": 27701139456, + "hidden_stages": { + "embedding": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6fa762ca3d9437b6eb7d7235d7342f5ac0eee48f09cc9c56b3a2f6342cb439ed", + "mean": -0.0009989648824557662, + "std": 0.0989219918847084, + "rms": 0.09892703592777252, + "max_abs": 1.7109375 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f01939f917925e26373217dbd28730db8dd3e0f46c5dfb5ce611079f4a010dc0", + "mean": -0.0009563579806126654, + "std": 0.09677619487047195, + "rms": 0.0967809185385704, + "max_abs": 2.046875 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6fa762ca3d9437b6eb7d7235d7342f5ac0eee48f09cc9c56b3a2f6342cb439ed", + "mean": -0.0009989648824557662, + "std": 0.0989219918847084, + "rms": 0.09892703592777252, + "max_abs": 1.7109375 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0ef4682bdffe5f861263252c8a89938344b54541ff6e04d5aeff9c082c6019c8", + "mean": -0.001091402256861329, + "std": 0.097677081823349, + "rms": 0.09768317639827728, + "max_abs": 2.046875 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6fa762ca3d9437b6eb7d7235d7342f5ac0eee48f09cc9c56b3a2f6342cb439ed", + "mean": -0.0009989648824557662, + "std": 0.0989219918847084, + "rms": 0.09892703592777252, + "max_abs": 1.7109375 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "12fb1f7893c0817f1195b099fe6a61fd7b2fbfb304e6ab7f799231372ae00893", + "mean": -0.0009446542826481164, + "std": 0.09662870317697525, + "rms": 0.09663331508636475, + "max_abs": 2.046875 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6fa762ca3d9437b6eb7d7235d7342f5ac0eee48f09cc9c56b3a2f6342cb439ed", + "mean": -0.0009989648824557662, + "std": 0.0989219918847084, + "rms": 0.09892703592777252, + "max_abs": 1.7109375 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "73cf54398ca47312937c60c8160ee3c03e3a030a9957b9ba98b935abbfad7477", + "mean": -0.0010809723753482103, + "std": 0.09754687547683716, + "rms": 0.09755286574363708, + "max_abs": 2.046875 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6fa762ca3d9437b6eb7d7235d7342f5ac0eee48f09cc9c56b3a2f6342cb439ed", + "mean": -0.0009989648824557662, + "std": 0.0989219918847084, + "rms": 0.09892703592777252, + "max_abs": 1.7109375 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "81758f70b2069d72ad2314e65dcc7097d180e3dfacbedb62e976f97c74022a15", + "mean": -0.0009733753395266831, + "std": 0.09672808647155762, + "rms": 0.0967329889535904, + "max_abs": 2.046875 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6fa762ca3d9437b6eb7d7235d7342f5ac0eee48f09cc9c56b3a2f6342cb439ed", + "mean": -0.0009989648824557662, + "std": 0.0989219918847084, + "rms": 0.09892703592777252, + "max_abs": 1.7109375 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "65208cd7ff20c13e9ebae6e356543a2794239929bd36e87b46b92b344091fc8e", + "mean": -0.0011065674480050802, + "std": 0.09763458371162415, + "rms": 0.09764084964990616, + "max_abs": 2.046875 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6fa762ca3d9437b6eb7d7235d7342f5ac0eee48f09cc9c56b3a2f6342cb439ed", + "mean": -0.0009989648824557662, + "std": 0.0989219918847084, + "rms": 0.09892703592777252, + "max_abs": 1.7109375 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9c9577121a8bd19c0ffd7d62e7f24f5fb22f0d7ded1ac9de5a781b10a17b07bf", + "mean": -0.0009739947272464633, + "std": 0.0966147929430008, + "rms": 0.09661970287561417, + "max_abs": 2.046875 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6fa762ca3d9437b6eb7d7235d7342f5ac0eee48f09cc9c56b3a2f6342cb439ed", + "mean": -0.0009989648824557662, + "std": 0.0989219918847084, + "rms": 0.09892703592777252, + "max_abs": 1.7109375 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ba75fb77ec227a7e098e77d23471338f5225b0c1aa3d2bae1d29e276381c8399", + "mean": -0.0011071193730458617, + "std": 0.09753456711769104, + "rms": 0.09754085540771484, + "max_abs": 2.046875 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 106, + "exact_hidden_rows": 106, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999999403953552, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "system_bos": { + "tokens": 106, + "exact_hidden_rows": 106, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999999403953552, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "system_x": { + "tokens": 106, + "exact_hidden_rows": 106, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999999403953552, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "system_period": { + "tokens": 106, + "exact_hidden_rows": 106, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999999403953552, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "bos_at_s0": { + "tokens": 106, + "exact_hidden_rows": 106, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999999403953552, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "bos_at_s1": { + "tokens": 106, + "exact_hidden_rows": 106, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999999403953552, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "x_at_s0": { + "tokens": 106, + "exact_hidden_rows": 106, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999999403953552, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "x_at_s1": { + "tokens": 106, + "exact_hidden_rows": 106, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999999403953552, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "period_at_s0": { + "tokens": 106, + "exact_hidden_rows": 106, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999999403953552, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "period_at_s1": { + "tokens": 106, + "exact_hidden_rows": 106, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999999403953552, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + } + } + }, + "layer_00": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4421f34ed0aeb95757a03278ea03fd3205f7d12522a433877ec8cc451d57a32a", + "mean": -0.0013498780317604542, + "std": 0.0904666930437088, + "rms": 0.09047676622867584, + "max_abs": 2.5625 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "dc9d829c85369aabf5e357951f4637fc9f3fe980bd43fa8ab7d42da7c58f2137", + "mean": -0.0013725346652790904, + "std": 0.09055308252573013, + "rms": 0.09056349098682404, + "max_abs": 2.5625 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "43d3b4bf14912aa983ccd099b558635eb0758a1a103e3ff867f0701719ca2b33", + "mean": -0.0013639295939356089, + "std": 0.09066205471754074, + "rms": 0.0906723141670227, + "max_abs": 2.5625 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d57d0f624e27cb9e28a1ea9e2183ac28f95eb94f8f99842aa3921103d8257b02", + "mean": -0.0014860335504636168, + "std": 0.09155896306037903, + "rms": 0.09157101809978485, + "max_abs": 2.5625 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ccf5d6b5fe67614bd570695b286c6797b3c97e5b8c701648ace7bf942dbac9d3", + "mean": -0.0012661692453548312, + "std": 0.09007047116756439, + "rms": 0.09007935971021652, + "max_abs": 2.484375 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0a3e09a4ab83e36a097d9d602a94f3dfb48d90d03655267f0d6f61cfa5693d4f", + "mean": -0.0012916012201458216, + "std": 0.0899227112531662, + "rms": 0.08993198722600937, + "max_abs": 2.484375 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cdee6ad04c6fdd093068d383a05cecf9e1d7f99cc0ac445558a47c8366a9c3a8", + "mean": -0.0013141545932739973, + "std": 0.09020178765058517, + "rms": 0.09021136164665222, + "max_abs": 2.5 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "aeaa04705fb0ab141d9ecd2bde8629473b04ac61c6d1770c6aeabc40e7f009d9", + "mean": -0.0014390598516911268, + "std": 0.09096989780664444, + "rms": 0.09098127484321594, + "max_abs": 2.5 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9f44c9ea515290ab50998b622f5efffc4541c10ef3243b1e5724b55585160f21", + "mean": -0.0012767226435244083, + "std": 0.08972016721963882, + "rms": 0.08972924947738647, + "max_abs": 2.5 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b4651da3e3224cc38272797c5d5d76e049bdf51f4539986e1419c39de10d0b3f", + "mean": -0.0013182602124288678, + "std": 0.0897519513964653, + "rms": 0.0897616371512413, + "max_abs": 2.5 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2eb00b20b8946358505225f06e641f302782449a01a0c912711fde4252581579", + "mean": -0.0013301329454407096, + "std": 0.08993719518184662, + "rms": 0.08994702249765396, + "max_abs": 2.515625 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a3168d1997a57ab0d363f36f1e4fa6ebb3fe5bc0991dc3de021fd591ad2fa893", + "mean": -0.001469469745643437, + "std": 0.09089401364326477, + "rms": 0.09090588986873627, + "max_abs": 2.515625 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c0e48e077c3393e7c88a69c691ba3b6ed0e37fc1c70794362d33766892d5937f", + "mean": -0.0012695570476353168, + "std": 0.08974438160657883, + "rms": 0.08975336700677872, + "max_abs": 2.5 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f53711a4e185b0cbb59fc4d37fde7a929ea365dc88ef26c197cfbb79487a0379", + "mean": -0.0013120424700900912, + "std": 0.08959085494279861, + "rms": 0.08960046619176865, + "max_abs": 2.5 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1f333123368f334862ac7f560bf0d45095961c4ed4ec4222e2d19e0ad28453e3", + "mean": -0.0013250666670501232, + "std": 0.08995572477579117, + "rms": 0.08996548503637314, + "max_abs": 2.515625 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e0a41d54420ff453cedf4f6cfca044562ed19b89e43f26c125da9bafd3324652", + "mean": -0.001463396125473082, + "std": 0.0907340794801712, + "rms": 0.09074588119983673, + "max_abs": 2.515625 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9994285702705383, + "min_cosine_similarity": 0.9949464797973633, + "mean_relative_l2": 0.030349962413311005, + "max_abs_delta": 0.125 + }, + "system_bos": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9992271065711975, + "min_cosine_similarity": 0.9914023876190186, + "mean_relative_l2": 0.035804297775030136, + "max_abs_delta": 0.1171875 + }, + "system_x": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9992680549621582, + "min_cosine_similarity": 0.9932349920272827, + "mean_relative_l2": 0.03529829904437065, + "max_abs_delta": 0.125 + }, + "system_period": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9993001818656921, + "min_cosine_similarity": 0.993533730506897, + "mean_relative_l2": 0.034617822617292404, + "max_abs_delta": 0.1171875 + }, + "bos_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9901829957962036, + "min_cosine_similarity": 0.964756965637207, + "mean_relative_l2": 0.1375914365053177, + "max_abs_delta": 0.1875 + }, + "bos_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9912739396095276, + "min_cosine_similarity": 0.9726550579071045, + "mean_relative_l2": 0.12979845702648163, + "max_abs_delta": 0.19580078125 + }, + "x_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9910417199134827, + "min_cosine_similarity": 0.9702110290527344, + "mean_relative_l2": 0.1309943050146103, + "max_abs_delta": 0.19482421875 + }, + "x_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9919419288635254, + "min_cosine_similarity": 0.9745176434516907, + "mean_relative_l2": 0.12422292679548264, + "max_abs_delta": 0.19970703125 + }, + "period_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.991144061088562, + "min_cosine_similarity": 0.971450924873352, + "mean_relative_l2": 0.1303914338350296, + "max_abs_delta": 0.21875 + }, + "period_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9920117259025574, + "min_cosine_similarity": 0.97525554895401, + "mean_relative_l2": 0.12379564344882965, + "max_abs_delta": 0.20068359375 + } + } + }, + "layer_01": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a954a16ece32480c192677d779371f4c2598dd422898774805fe4fbafc0d63cd", + "mean": -0.0016289366176351905, + "std": 0.10498753190040588, + "rms": 0.10500016063451767, + "max_abs": 2.984375 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "98b1a1b23aa28b12bc27c8a284741d05ed6de6b90be587a3c6fe09290e435558", + "mean": -0.0037306398153305054, + "std": 0.7036307454109192, + "rms": 0.7036406397819519, + "max_abs": 126.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f415f518e67e7f819067f20057c8fcc5652ed2de842c0e643f11e8519a2163e2", + "mean": -0.0016263617435470223, + "std": 0.10536660254001617, + "rms": 0.10537915676832199, + "max_abs": 3.0 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "635fa4d30a26206882201f02556dcddd69bbed442f99f036439b69631f522867", + "mean": -0.0037903999909758568, + "std": 0.6889532208442688, + "rms": 0.6889636516571045, + "max_abs": 135.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5e076f85f221a74c65825deb0d30227f6ceb623015060abb46711fe20b9139eb", + "mean": -0.0017307412344962358, + "std": 0.1047600731253624, + "rms": 0.1047743707895279, + "max_abs": 3.015625 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7391645827ed4517c869558ddef2ecf55705eee9a1ec6c6034ba88c79215e82d", + "mean": -0.0016390568343922496, + "std": 0.106883205473423, + "rms": 0.10689577460289001, + "max_abs": 4.71875 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "dbe47f23a59d622038d9952fcd6478b3eb57177d8bfdd73d41a8815e2a86db8d", + "mean": -0.0018363739363849163, + "std": 0.1047932431101799, + "rms": 0.10480932891368866, + "max_abs": 3.03125 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "83d2dd98737dbfc34c6610c360f6f789af925808496588a49841c2eaa63dec50", + "mean": -0.0019006034126505256, + "std": 0.10770846903324127, + "rms": 0.10772523283958435, + "max_abs": 4.71875 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6883e052b6165ab5591b9be6e983a85668d337adb7afca8715bbb4f303affa59", + "mean": -0.0017090096371248364, + "std": 0.10480806976556778, + "rms": 0.10482200235128403, + "max_abs": 3.046875 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "dc941fa51512cac06675b81ef37143fd3a9211c6e2fca454003ee30500d10bdd", + "mean": -0.0016205058200284839, + "std": 0.10694164782762527, + "rms": 0.106953926384449, + "max_abs": 4.71875 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6740706c3fd9d622bfd3dc16623ac3c47e4672892445194e5ef6a870b9a12056", + "mean": -0.0018414369551464915, + "std": 0.10468100011348724, + "rms": 0.10469719767570496, + "max_abs": 3.03125 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "29a9b6b08e41b932569838c74906217124a0f0b39de0c82c75db5e29f6256346", + "mean": -0.0019085431704297662, + "std": 0.10769239813089371, + "rms": 0.10770930349826813, + "max_abs": 4.71875 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c69723056b0160e23128f91c3336c47df7b8e204209c5bee0abbae74031daecf", + "mean": -0.0017136178212240338, + "std": 0.1047929897904396, + "rms": 0.10480699688196182, + "max_abs": 3.046875 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1ba7ef4fd9679a617658359b3bba05b0e79a2c4d84ebb2632ec3d2be77212583", + "mean": -0.0016370750963687897, + "std": 0.10666810721158981, + "rms": 0.10668066143989563, + "max_abs": 4.71875 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "000d98c8bbae4a8c8327937f5db4dfc49c0099536963057b052aa3ea0bd08485", + "mean": -0.0018418619874864817, + "std": 0.10466909408569336, + "rms": 0.10468529909849167, + "max_abs": 3.03125 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "718c15655df21ef1a62b86e1036ee44f6f85439d311b825fa4c184a325269ed2", + "mean": -0.0019171524327248335, + "std": 0.10745912045240402, + "rms": 0.10747621953487396, + "max_abs": 4.71875 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9989263415336609, + "min_cosine_similarity": 0.9877792596817017, + "mean_relative_l2": 0.042138535529375076, + "max_abs_delta": 0.1171875 + }, + "system_bos": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9960403442382812, + "min_cosine_similarity": 0.9434788227081299, + "mean_relative_l2": 0.08140438795089722, + "max_abs_delta": 0.318359375 + }, + "system_x": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9950397610664368, + "min_cosine_similarity": 0.9494081735610962, + "mean_relative_l2": 0.09036039561033249, + "max_abs_delta": 0.2783203125 + }, + "system_period": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9952490329742432, + "min_cosine_similarity": 0.9539182186126709, + "mean_relative_l2": 0.08863569796085358, + "max_abs_delta": 0.2568359375 + }, + "bos_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9898311495780945, + "min_cosine_similarity": 0.9271641969680786, + "mean_relative_l2": 0.138205423951149, + "max_abs_delta": 0.3544921875 + }, + "bos_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9897908568382263, + "min_cosine_similarity": 0.9623129367828369, + "mean_relative_l2": 0.13873417675495148, + "max_abs_delta": 0.20703125 + }, + "x_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9912149906158447, + "min_cosine_similarity": 0.9376325607299805, + "mean_relative_l2": 0.12789905071258545, + "max_abs_delta": 0.3134765625 + }, + "x_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9889415502548218, + "min_cosine_similarity": 0.959129810333252, + "mean_relative_l2": 0.14318329095840454, + "max_abs_delta": 0.2734375 + }, + "period_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9914209842681885, + "min_cosine_similarity": 0.9462807178497314, + "mean_relative_l2": 0.1268215775489807, + "max_abs_delta": 0.2734375 + }, + "period_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9891214370727539, + "min_cosine_similarity": 0.963118314743042, + "mean_relative_l2": 0.14222195744514465, + "max_abs_delta": 0.2734375 + } + } + }, + "layer_02": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bf5a5df04bd14eda5ba34b8882a035777075e870b1ab15e2ae01c37cd0042508", + "mean": -0.0015930673107504845, + "std": 0.12583273649215698, + "rms": 0.12584282457828522, + "max_abs": 3.5 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "21ce74090648f67b0fce714386dd26587e06385ec616d5abf698f643cab3328e", + "mean": -0.008740259334445, + "std": 2.1011135578155518, + "rms": 2.1011319160461426, + "max_abs": 392.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cedfbc32197c4007e743744e283fcf6e6d0a466b0ed01de019d1138559c74fba", + "mean": -0.0014850785955786705, + "std": 0.1261427104473114, + "rms": 0.1261514574289322, + "max_abs": 3.5 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "89457b45593b7a32d2634dafa38244440bf5405af15c4a746e47401e10ed74ac", + "mean": -0.009106220677495003, + "std": 2.19856333732605, + "rms": 2.198582172393799, + "max_abs": 436.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1a74954505d2606c685db6a9f65e863d85f5ecdaf8bb66504d6c30a5a753614b", + "mean": -0.0016688088653609157, + "std": 0.12573596835136414, + "rms": 0.12574703991413116, + "max_abs": 3.484375 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3f909839c935735f247177ef02733028116d1d4c2837f35f454b89343d12af07", + "mean": -0.0018531144596636295, + "std": 0.1907258927822113, + "rms": 0.19073490798473358, + "max_abs": 23.875 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2b9c274e17adcc20de24856fec8064c7c7aa0e219f36b2026e200aad7dc33591", + "mean": -0.0014898041263222694, + "std": 0.125648632645607, + "rms": 0.12565746903419495, + "max_abs": 3.4375 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9447247e8c9ed502a0dd88bcc119087c8adce583ef72d7ea9bd88f5966a6481f", + "mean": -0.0017768989782780409, + "std": 0.1854175478219986, + "rms": 0.18542605638504028, + "max_abs": 23.875 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cca520421876b30f6e300fd6bc4a3be0436b36ac493d0b6fc7b8209e2f4b4fac", + "mean": -0.0016423885244876146, + "std": 0.1255636364221573, + "rms": 0.12557438015937805, + "max_abs": 3.5 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cb554951a4e6feddc3d3fc83ec49d6a8e9e038857acc8069c20fe95b4e1ad00f", + "mean": -0.0018338699592277408, + "std": 0.19066567718982697, + "rms": 0.19067449867725372, + "max_abs": 23.875 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "550780e12b5a1b2883c20bb96ef9d7dc28d148a7484ace977d62205f92caf78b", + "mean": -0.0014455656055361032, + "std": 0.12520918250083923, + "rms": 0.1252175271511078, + "max_abs": 3.46875 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "72b429d89254da7639bd4f30b05df77f71f2326eda8a6361ad6d971983b01762", + "mean": -0.0017469993326812983, + "std": 0.1852537840604782, + "rms": 0.1852620244026184, + "max_abs": 23.875 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "57f022e6eee123246f5796cb4b507da3b6729dc6ec7f7ab0199043ff2f2593fa", + "mean": -0.0016009206883609295, + "std": 0.12542086839675903, + "rms": 0.12543107569217682, + "max_abs": 3.5 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "785aeab1ef0fea380b521dc6c61e96e00d425bc6774312dba6ee0e442fe46c50", + "mean": -0.0018443360459059477, + "std": 0.19033192098140717, + "rms": 0.19034086167812347, + "max_abs": 23.875 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6fac26454abb2dd23be01bf42d44db5427b56e3c142850037ac4114f7e62bde4", + "mean": -0.001435463665984571, + "std": 0.12514984607696533, + "rms": 0.12515807151794434, + "max_abs": 3.46875 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e7c0b8a4a5ddc56b034fa44b7a8d3ce6915ce33d0219f600b6993f3c8490168e", + "mean": -0.00177065993193537, + "std": 0.18496198952198029, + "rms": 0.18497046828269958, + "max_abs": 23.875 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9988261461257935, + "min_cosine_similarity": 0.9893540143966675, + "mean_relative_l2": 0.04463080316781998, + "max_abs_delta": 0.1171875 + }, + "system_bos": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.995675802230835, + "min_cosine_similarity": 0.9391905069351196, + "mean_relative_l2": 0.08616556227207184, + "max_abs_delta": 0.3486328125 + }, + "system_x": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9945176839828491, + "min_cosine_similarity": 0.9523674249649048, + "mean_relative_l2": 0.09804815798997879, + "max_abs_delta": 0.2685546875 + }, + "system_period": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9948450326919556, + "min_cosine_similarity": 0.9583618640899658, + "mean_relative_l2": 0.09540586918592453, + "max_abs_delta": 0.236328125 + }, + "bos_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9908062815666199, + "min_cosine_similarity": 0.9143287539482117, + "mean_relative_l2": 0.1301039457321167, + "max_abs_delta": 0.375 + }, + "bos_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9896675944328308, + "min_cosine_similarity": 0.962099552154541, + "mean_relative_l2": 0.14017948508262634, + "max_abs_delta": 0.38671875 + }, + "x_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9911686182022095, + "min_cosine_similarity": 0.9295823574066162, + "mean_relative_l2": 0.12746362388134003, + "max_abs_delta": 0.3671875 + }, + "x_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9876708984375, + "min_cosine_similarity": 0.9466551542282104, + "mean_relative_l2": 0.15138176083564758, + "max_abs_delta": 0.48828125 + }, + "period_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9911938309669495, + "min_cosine_similarity": 0.9391674995422363, + "mean_relative_l2": 0.12792447209358215, + "max_abs_delta": 0.375 + }, + "period_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9876900315284729, + "min_cosine_similarity": 0.9504563808441162, + "mean_relative_l2": 0.1516035497188568, + "max_abs_delta": 0.4921875 + } + } + }, + "layer_03": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6ada859f620a5403505d167ea4c698a5ec65b63eb3289ef150e5749ef8a2e984", + "mean": -0.0019618715159595013, + "std": 0.15013465285301208, + "rms": 0.1501474678516388, + "max_abs": 4.34375 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2cf636df981b061cb89bb111ad6c5f1b102449c3c703548bf87248b6eefa20ca", + "mean": -0.011545831337571144, + "std": 6.295918941497803, + "rms": 6.295929431915283, + "max_abs": 1136.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7cd1e255b3ddb65781e4b146ce9b535bacbcb13f418c227dbfcf6183019fb2de", + "mean": -0.001928941928781569, + "std": 0.15059304237365723, + "rms": 0.15060539543628693, + "max_abs": 4.28125 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8188ed37a9aba0c13afa13863597e0d43852a7074d412761cdafb40706550f1f", + "mean": -0.011925225146114826, + "std": 6.1405134201049805, + "rms": 6.140524864196777, + "max_abs": 1136.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "23b8255c730f5ed0f3972c6d4fc4e6a62b14ab0f0916049396e560cd9b561cd5", + "mean": -0.0020011388696730137, + "std": 0.15174247324466705, + "rms": 0.1517556607723236, + "max_abs": 4.4375 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f0be1e7d61d8049826f27bc5cbac356ac5421cd48919bf72dec256cda5bd0112", + "mean": -0.0038068443536758423, + "std": 5.613907337188721, + "rms": 5.613908290863037, + "max_abs": 1136.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9b740769df1b1713c72c47ee695cd4da886093faba65d4a1df3b2437d11b701b", + "mean": -0.0020501231774687767, + "std": 0.15221937000751495, + "rms": 0.15223316848278046, + "max_abs": 4.4375 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c2d1c7f72eeb39205824d7b1a3d6f280ed3735aa995b320343aef2cf293687cc", + "mean": -0.0038611122872680426, + "std": 5.299835681915283, + "rms": 5.2998366355896, + "max_abs": 1136.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0eb0aadfb3e870ceea03741486b789f6e3c8a12e89391a6a2f33ec295141f87c", + "mean": -0.0020482675172388554, + "std": 0.15064293146133423, + "rms": 0.15065686404705048, + "max_abs": 4.46875 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e3c6c9913824de5d0cacabcd1d658445d682f85b7dea11f479c1869aaceac3d5", + "mean": -0.0038907441776245832, + "std": 5.6138715744018555, + "rms": 5.613872528076172, + "max_abs": 1136.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "42a880c102e9c12f564710f88c4e9581d541fcdfd73411095739a40d78e20ecd", + "mean": -0.0021641235798597336, + "std": 0.15128245949745178, + "rms": 0.1512979418039322, + "max_abs": 4.375 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8ad2eb30f8bfe5d2a8e03be56fae318d870c7b69d157b2d06497655896bbe944", + "mean": -0.003982170019298792, + "std": 5.299809455871582, + "rms": 5.299810409545898, + "max_abs": 1136.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7619796f25f930362588a573dab5a01a941c369aa67123bf1c45e4dac1b57ddd", + "mean": -0.002025193301960826, + "std": 0.15059927105903625, + "rms": 0.15061289072036743, + "max_abs": 4.46875 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e1570c3b39d7400781053fd40422dc5f8c785c6723ace171f5e42593fb8b35e7", + "mean": -0.0038801960181444883, + "std": 5.61386251449585, + "rms": 5.613863468170166, + "max_abs": 1136.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c2e4be6c3c56f178de7fcdb861af2c9dd16262630c9ae95ec2f7f8ba04666ceb", + "mean": -0.0021425068844109774, + "std": 0.15120773017406464, + "rms": 0.15122291445732117, + "max_abs": 4.375 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e88446177b5216ce0a88c9cd1600a9e9790ba2a05ebaab285891cf65b1ec5774", + "mean": -0.003969297744333744, + "std": 5.299800872802734, + "rms": 5.299802303314209, + "max_abs": 1136.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9988664388656616, + "min_cosine_similarity": 0.9910316467285156, + "mean_relative_l2": 0.044549617916345596, + "max_abs_delta": 0.09375 + }, + "system_bos": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9959756135940552, + "min_cosine_similarity": 0.9613170027732849, + "mean_relative_l2": 0.08488837629556656, + "max_abs_delta": 0.25 + }, + "system_x": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9946893453598022, + "min_cosine_similarity": 0.9642188549041748, + "mean_relative_l2": 0.09797769784927368, + "max_abs_delta": 0.205078125 + }, + "system_period": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9949053525924683, + "min_cosine_similarity": 0.9680143594741821, + "mean_relative_l2": 0.09615248441696167, + "max_abs_delta": 0.212890625 + }, + "bos_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9920462369918823, + "min_cosine_similarity": 0.9370954036712646, + "mean_relative_l2": 0.12303648144006729, + "max_abs_delta": 0.3203125 + }, + "bos_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9906198978424072, + "min_cosine_similarity": 0.9653571844100952, + "mean_relative_l2": 0.13512855768203735, + "max_abs_delta": 0.38671875 + }, + "x_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9920623898506165, + "min_cosine_similarity": 0.93813157081604, + "mean_relative_l2": 0.12100708484649658, + "max_abs_delta": 0.35546875 + }, + "x_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9881583452224731, + "min_cosine_similarity": 0.9394081234931946, + "mean_relative_l2": 0.14864572882652283, + "max_abs_delta": 0.48828125 + }, + "period_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.992250382900238, + "min_cosine_similarity": 0.9500299692153931, + "mean_relative_l2": 0.12040475755929947, + "max_abs_delta": 0.36328125 + }, + "period_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9882867336273193, + "min_cosine_similarity": 0.9480363130569458, + "mean_relative_l2": 0.14846301078796387, + "max_abs_delta": 0.4921875 + } + } + }, + "layer_04": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1b5e1c1644c85634bd4e2fa96ea8e6ee4d09ff1c53f96335ebeaa3a8131b3b50", + "mean": -0.0024810326285660267, + "std": 0.1834801882505417, + "rms": 0.18349696695804596, + "max_abs": 5.46875 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ef8aeced6c11a023fb5247200edd77cccd5795b2b6ee76d8f1a9dce7758e3412", + "mean": -0.011857330799102783, + "std": 6.569735527038574, + "rms": 6.569746017456055, + "max_abs": 1152.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f944eb8a3cfbc5be4797e67295c6fb121f8e46ff314a888ec41bb6437868a9aa", + "mean": -0.002498095855116844, + "std": 0.1838986873626709, + "rms": 0.1839156597852707, + "max_abs": 5.375 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4c2e2d5662ce303f6f10a8e4cc3b471fd2a42ef1367c11792a92c3e13334ae16", + "mean": -0.012261820025742054, + "std": 6.391158580780029, + "rms": 6.391170024871826, + "max_abs": 1152.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "403b740ccd7f4be1606032ef805e271ccfb4ef1632cf0a3fb1c3cd848aab975a", + "mean": -0.002738719107583165, + "std": 0.18678830564022064, + "rms": 0.18680837750434875, + "max_abs": 5.625 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2d939de23395abca1cbf5cdea2b9705bb6e5654e261f6de226dc39def6bbb451", + "mean": -0.004311583004891872, + "std": 5.888072967529297, + "rms": 5.8880743980407715, + "max_abs": 1152.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ffc8f2c0f66e17330d357cd922f19010ddf2a42963fcf789b38e5de9668f64ca", + "mean": -0.0027627148665487766, + "std": 0.18677455186843872, + "rms": 0.1867949664592743, + "max_abs": 5.5625 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6a3bf85f4a5898f7b6804b6ebc7e1b61fe4fd6e13d28068953fadacd8262fdb0", + "mean": -0.004304341971874237, + "std": 5.553698539733887, + "rms": 5.5537004470825195, + "max_abs": 1152.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "04ba81886cbbb4f08c20b3660e5fbff5a0bb650b5dee0817cbf55eb57ebb4730", + "mean": -0.002724328078329563, + "std": 0.18488293886184692, + "rms": 0.18490299582481384, + "max_abs": 5.59375 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ea0dc1efcae18f247231d370fd31e981eda203ca96868929d57f60a2e687a711", + "mean": -0.004259445704519749, + "std": 5.888000011444092, + "rms": 5.888000965118408, + "max_abs": 1152.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bcbd2acff05d92f7d03a0cb5bb23fd53ef5bb3e1f3b7039cab1bcddc88a73653", + "mean": -0.002765091136097908, + "std": 0.18544405698776245, + "rms": 0.18546466529369354, + "max_abs": 5.53125 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "601aa27b5fa2b24647294245b06519eff2982a25e8e61b591d815544bfe1605c", + "mean": -0.004284476861357689, + "std": 5.553642749786377, + "rms": 5.553644180297852, + "max_abs": 1152.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6ede8d802e1736f546698286026fff5da6791ab88d85b2d05ec031f0b6af71a2", + "mean": -0.0026825706008821726, + "std": 0.18461167812347412, + "rms": 0.18463116884231567, + "max_abs": 5.5625 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "46d93079b8223c6f9f5addc41ea6d13fa436dd5ed76b9d8651442e72ef473c7a", + "mean": -0.004241119604557753, + "std": 5.887985706329346, + "rms": 5.887986660003662, + "max_abs": 1152.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d43350b27f6fbaca34fcfc99abc219e7eff57c658a01645c5e8c0b024362aa3d", + "mean": -0.002752960892394185, + "std": 0.18523231148719788, + "rms": 0.18525275588035583, + "max_abs": 5.53125 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "919b3331d250693658e2e47d6e8a61930669d2de63afa750737d841aabb1fd23", + "mean": -0.004278490319848061, + "std": 5.553630828857422, + "rms": 5.5536322593688965, + "max_abs": 1152.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9990268349647522, + "min_cosine_similarity": 0.994565486907959, + "mean_relative_l2": 0.041906848549842834, + "max_abs_delta": 0.125 + }, + "system_bos": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9964049458503723, + "min_cosine_similarity": 0.9711805582046509, + "mean_relative_l2": 0.08088288456201553, + "max_abs_delta": 0.278076171875 + }, + "system_x": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9950554370880127, + "min_cosine_similarity": 0.9763650298118591, + "mean_relative_l2": 0.09636443853378296, + "max_abs_delta": 0.205078125 + }, + "system_period": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9951531887054443, + "min_cosine_similarity": 0.9785659313201904, + "mean_relative_l2": 0.09568417072296143, + "max_abs_delta": 0.2265625 + }, + "bos_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9938530921936035, + "min_cosine_similarity": 0.964787483215332, + "mean_relative_l2": 0.11061214655637741, + "max_abs_delta": 0.34375 + }, + "bos_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9922863841056824, + "min_cosine_similarity": 0.9676378965377808, + "mean_relative_l2": 0.12410406768321991, + "max_abs_delta": 0.4375 + }, + "x_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9934976696968079, + "min_cosine_similarity": 0.9557960033416748, + "mean_relative_l2": 0.11068062484264374, + "max_abs_delta": 0.3828125 + }, + "x_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9894388914108276, + "min_cosine_similarity": 0.946610689163208, + "mean_relative_l2": 0.14238505065441132, + "max_abs_delta": 0.515625 + }, + "period_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9934975504875183, + "min_cosine_similarity": 0.9620665311813354, + "mean_relative_l2": 0.11099183559417725, + "max_abs_delta": 0.3671875 + }, + "period_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9894500374794006, + "min_cosine_similarity": 0.956946611404419, + "mean_relative_l2": 0.14281530678272247, + "max_abs_delta": 0.53125 + } + } + }, + "layer_05": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d8e2c5f1882406387f079bea90d59dadea11484b678761414c8b78966556ac62", + "mean": -0.0016584694385528564, + "std": 0.20519371330738068, + "rms": 0.2052004188299179, + "max_abs": 5.71875 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fa49134ab9e88a340eeaa560cd69a1437e207d3f1c32e771f101f29983df4b2a", + "mean": -0.01230314839631319, + "std": 6.770280838012695, + "rms": 6.770291805267334, + "max_abs": 1152.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1320d175ad5a3967c37a5c1849b5eecc0be7c17f185908a216978e8747c9d36a", + "mean": -0.001723561785183847, + "std": 0.20552769303321838, + "rms": 0.2055349051952362, + "max_abs": 5.78125 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f342ce53f291a44a38b67a44d85c8c9590ad0a1f6c3187404d9ee6ca455aaf48", + "mean": -0.012621641159057617, + "std": 6.58876895904541, + "rms": 6.588780879974365, + "max_abs": 1152.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f0110478a0f1a46f116616c2d3d0518743c8dc6c63b1e458abca2c40ea763dba", + "mean": -0.0017872325843200088, + "std": 0.20819422602653503, + "rms": 0.20820188522338867, + "max_abs": 5.8125 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6dc04a6e2fe5b2e5d757331fe8abf09548006cfcdeec49d700ac12de3977359b", + "mean": -0.0038959383964538574, + "std": 5.991711139678955, + "rms": 5.99171257019043, + "max_abs": 1152.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "da43ce204372f280479f020fea2b171e6e4d4c2bee6456ba5879b019eacfa731", + "mean": -0.0018607634119689465, + "std": 0.20770633220672607, + "rms": 0.20771464705467224, + "max_abs": 5.84375 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "700e8d882d6c580d40569bd99c92d322cfb0110be63ead8bc6351147ce694a7a", + "mean": -0.003867719555273652, + "std": 5.650531768798828, + "rms": 5.6505327224731445, + "max_abs": 1152.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "be536375ee0c23f5cd48e097d28ee4814676be61895d08e0ef213e45e41a1a50", + "mean": -0.0018869859632104635, + "std": 0.20689459145069122, + "rms": 0.20690318942070007, + "max_abs": 5.9375 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "19598514894ad9c1e43d7aa2a4619a5764e9d6d5b3e451229abb8110096f1a24", + "mean": -0.003909708932042122, + "std": 5.991650581359863, + "rms": 5.99165153503418, + "max_abs": 1152.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c52c2faf2f8fedef6528a0890ef499788449c689ab26ea0f7902d6322528ef6f", + "mean": -0.0020078520756214857, + "std": 0.20626820623874664, + "rms": 0.2062779814004898, + "max_abs": 5.96875 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0c3c6442b9ad47a92eacc90b8312c6d4adde7b9c49c5b175568181853d4bc835", + "mean": -0.003939204383641481, + "std": 5.650471210479736, + "rms": 5.650472164154053, + "max_abs": 1152.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "342de16a5bfa5bcaa9d10c19ac5e203e68ba14677e7db58bbd0a4f0ed34b85e7", + "mean": -0.0019125378457829356, + "std": 0.20695844292640686, + "rms": 0.2069672793149948, + "max_abs": 5.96875 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f4cdb49af7959ad19ff2e9295a25482749e9e03c3f51c77c59e79530e2ca1acc", + "mean": -0.003932572901248932, + "std": 5.991641044616699, + "rms": 5.991641998291016, + "max_abs": 1152.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "15782305d360e432e7893d71da82cb1e4af6ab71f2e8848ccf5ab39182e56ded", + "mean": -0.0019986715633422136, + "std": 0.20582476258277893, + "rms": 0.20583446323871613, + "max_abs": 6.0 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "771dd3e4612f5c395a2c2f33ef5f70eb65e029ffb7454de8554754eac5a04bf2", + "mean": -0.00395150575786829, + "std": 5.650449752807617, + "rms": 5.650451183319092, + "max_abs": 1152.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.998722493648529, + "min_cosine_similarity": 0.9927221536636353, + "mean_relative_l2": 0.04775160551071167, + "max_abs_delta": 0.203125 + }, + "system_bos": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9956796169281006, + "min_cosine_similarity": 0.9713759422302246, + "mean_relative_l2": 0.08933248370885849, + "max_abs_delta": 0.34375 + }, + "system_x": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9937944412231445, + "min_cosine_similarity": 0.973311722278595, + "mean_relative_l2": 0.10835234820842743, + "max_abs_delta": 0.3203125 + }, + "system_period": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9937615990638733, + "min_cosine_similarity": 0.9750608801841736, + "mean_relative_l2": 0.1084635779261589, + "max_abs_delta": 0.3359375 + }, + "bos_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9934810400009155, + "min_cosine_similarity": 0.974429726600647, + "mean_relative_l2": 0.11350765824317932, + "max_abs_delta": 0.390625 + }, + "bos_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.991587221622467, + "min_cosine_similarity": 0.9596744179725647, + "mean_relative_l2": 0.1283016800880432, + "max_abs_delta": 0.46875 + }, + "x_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.992885947227478, + "min_cosine_similarity": 0.9575899839401245, + "mean_relative_l2": 0.11575352400541306, + "max_abs_delta": 0.5625 + }, + "x_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9880517721176147, + "min_cosine_similarity": 0.9331761598587036, + "mean_relative_l2": 0.15046080946922302, + "max_abs_delta": 0.53125 + }, + "period_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9929401278495789, + "min_cosine_similarity": 0.9647048115730286, + "mean_relative_l2": 0.11609672755002975, + "max_abs_delta": 0.59375 + }, + "period_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9881339073181152, + "min_cosine_similarity": 0.9456541538238525, + "mean_relative_l2": 0.15030452609062195, + "max_abs_delta": 0.498046875 + } + } + }, + "layer_06": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2687dc6cb89328973827d7642a52176d18ee28a3398c609e4200e27e363b4d49", + "mean": -0.0030073849484324455, + "std": 0.2457047551870346, + "rms": 0.245723158121109, + "max_abs": 7.53125 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "93844561e92a1f009f6e7a1fee863fbd2e7c6159369854f4deea27cd7123c9b2", + "mean": -0.013990683481097221, + "std": 6.893036842346191, + "rms": 6.893050670623779, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d75627b8cc6b17e4a3586abfe1d8024494831a6c1ee0d0d09217d7067806257a", + "mean": -0.00312596233561635, + "std": 0.24586495757102966, + "rms": 0.24588483572006226, + "max_abs": 7.5625 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "85378e997eefec900433075a81b402aec6c0b64e050787997f17bf0be1a2bbf5", + "mean": -0.01430341973900795, + "std": 6.7091450691223145, + "rms": 6.709159851074219, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "63a2df09ef35a39aae8560e0b01a188c71e1ca684d331404ba32aa53d4b37cac", + "mean": -0.002841254463419318, + "std": 0.2475014179944992, + "rms": 0.24751773476600647, + "max_abs": 7.5 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5ecbe9e9ad98595ef2173e40e99bbc7c90179bd558d8b35b9b440a3f1069ee41", + "mean": -0.005119259003549814, + "std": 6.087390899658203, + "rms": 6.0873942375183105, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9437074e88f95f0a7684a063c93866d32258a608f2b7028dccdd20574660727c", + "mean": -0.003035046625882387, + "std": 0.24749387800693512, + "rms": 0.24751245975494385, + "max_abs": 7.5625 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "02db538e60fbac3646abfed3728ff3062a3fcd2d78540d7b2c60ea028f3a5544", + "mean": -0.005138964857906103, + "std": 5.74227237701416, + "rms": 5.742274761199951, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "38decabc3bbec74af5aa1123eb64040bc80b446426950956e796e5d845c2b3f2", + "mean": -0.002855760045349598, + "std": 0.24717526137828827, + "rms": 0.24719177186489105, + "max_abs": 7.5625 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cc954e2bcfde9a2ca3e4a7a4059d26e147760afe26680954834aca37c3ed4c27", + "mean": -0.005033185239881277, + "std": 6.087344646453857, + "rms": 6.087346076965332, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "69b89bfc1a3fd46de91a2dcce71309cbca3919f5208db40471f2a3b0bfd02f53", + "mean": -0.003077046014368534, + "std": 0.24599744379520416, + "rms": 0.24601668119430542, + "max_abs": 7.6875 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "31318772fb0427f75edc50eb3cd323b7f1b80e43209e31afca9f8646acc28406", + "mean": -0.005081439856439829, + "std": 5.742188930511475, + "rms": 5.742190837860107, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5df932d230c32c2b85960211c680e985ddb2ebb3ae1c4ed0a4eec5de5c0f047c", + "mean": -0.0029296129941940308, + "std": 0.24693897366523743, + "rms": 0.24695636332035065, + "max_abs": 7.59375 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5f1b1fb9a539148fd0e2c455f06aec8e202541cd6ca80e69fcb6fe83d22305ec", + "mean": -0.005071891471743584, + "std": 6.087328910827637, + "rms": 6.087331771850586, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1f178c66df409c214e49655733e5ee7444e5a2797caec581a737e0ca236f2808", + "mean": -0.0031378334388136864, + "std": 0.24590586125850677, + "rms": 0.2459258735179901, + "max_abs": 7.6875 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e503c9b5872fbdaf5acf2f8d2a1d0deb0fd984c6d001a08213400e48c20274bf", + "mean": -0.005136073566973209, + "std": 5.7421793937683105, + "rms": 5.742181301116943, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9986541271209717, + "min_cosine_similarity": 0.992357611656189, + "mean_relative_l2": 0.04890172928571701, + "max_abs_delta": 0.15625 + }, + "system_bos": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9957531690597534, + "min_cosine_similarity": 0.976182222366333, + "mean_relative_l2": 0.08928949385881424, + "max_abs_delta": 0.53125 + }, + "system_x": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9937794804573059, + "min_cosine_similarity": 0.9755287170410156, + "mean_relative_l2": 0.10888580977916718, + "max_abs_delta": 0.46875 + }, + "system_period": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9937719106674194, + "min_cosine_similarity": 0.9768378138542175, + "mean_relative_l2": 0.10878808796405792, + "max_abs_delta": 0.421875 + }, + "bos_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9941877722740173, + "min_cosine_similarity": 0.975341796875, + "mean_relative_l2": 0.10594172030687332, + "max_abs_delta": 0.4375 + }, + "bos_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9926490783691406, + "min_cosine_similarity": 0.9680474996566772, + "mean_relative_l2": 0.11956249177455902, + "max_abs_delta": 0.46875 + }, + "x_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.993486225605011, + "min_cosine_similarity": 0.9572927951812744, + "mean_relative_l2": 0.11017149686813354, + "max_abs_delta": 0.625 + }, + "x_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.988974928855896, + "min_cosine_similarity": 0.9455299973487854, + "mean_relative_l2": 0.14489340782165527, + "max_abs_delta": 0.625 + }, + "period_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9934402108192444, + "min_cosine_similarity": 0.9615525007247925, + "mean_relative_l2": 0.11091279238462448, + "max_abs_delta": 0.46875 + }, + "period_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9889074563980103, + "min_cosine_similarity": 0.9530739784240723, + "mean_relative_l2": 0.14535768330097198, + "max_abs_delta": 0.546875 + } + } + }, + "layer_07": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "424ad98be5c68d5c17a05d23b850f938b4a601c8357e83227d8a5d8ce8e7a21d", + "mean": -0.0029490303713828325, + "std": 0.2626529633998871, + "rms": 0.26266953349113464, + "max_abs": 7.34375 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6dc374e5b0d75a9bfd9c7d19f9cb86981abb204122df207b88abda8c2f3b3bde", + "mean": -0.01395244151353836, + "std": 6.913416862487793, + "rms": 6.913430690765381, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3492721f83ba422446ec498b74709b0bf37bcde38b07b54b530338a71518132c", + "mean": -0.0030173086561262608, + "std": 0.2633501887321472, + "rms": 0.2633674740791321, + "max_abs": 7.40625 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "70d938bb1d0753ab6d528224df349b701c03ecf0318aa3f462cccc9bdfcd47f0", + "mean": -0.014578565023839474, + "std": 6.729323387145996, + "rms": 6.729339599609375, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0a60c6c933619a2074adf85c19f1e59a6c3ce1eeb9a9109d3ddd5b555b18bbb1", + "mean": -0.0029986421577632427, + "std": 0.26359015703201294, + "rms": 0.2636072039604187, + "max_abs": 7.25 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "38bc7a12381bcc55c84197861af8dd97c9646a1d87f7e3bd06ff3f7c7f67097a", + "mean": -0.00520282844081521, + "std": 6.098881244659424, + "rms": 6.098883628845215, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e32bf08b8badb38408caab321d5390541435250972a7f8dc8e2d12872348007a", + "mean": -0.003031225176528096, + "std": 0.2640767991542816, + "rms": 0.26409420371055603, + "max_abs": 7.375 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6a5e5f192071b7378f637f7ef741db2e3bce97e04d647670218a601e866a1c11", + "mean": -0.005434600170701742, + "std": 5.7532854080200195, + "rms": 5.7532877922058105, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e1601a92d1fdcc4077f846918f01bde0886dde88118254b67871121cbb61a6e1", + "mean": -0.0030036503449082375, + "std": 0.2625865042209625, + "rms": 0.26260367035865784, + "max_abs": 7.40625 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0d3f89845e3f8eee232a1946b11cadcae670f69ecee92ac80c1192497ac50ad9", + "mean": -0.005221914034336805, + "std": 6.098804950714111, + "rms": 6.098806858062744, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "df11b4db2afb9ca8354537034eb7a3e455084a5f2c580e161d9e915e8b5212f8", + "mean": -0.0031309835612773895, + "std": 0.26293808221817017, + "rms": 0.2629567086696625, + "max_abs": 7.5 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "eff615d9a5cf10f69f20a0da04b20710fcfb711e2a3087fdbb9110f974ef261d", + "mean": -0.0054975105449557304, + "std": 5.753209590911865, + "rms": 5.7532124519348145, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c921065fad9f84f71bc0afd773a3c19f1cc82e19016cc5688cbce7addf534091", + "mean": -0.0029957902152091265, + "std": 0.2622874677181244, + "rms": 0.2623045742511749, + "max_abs": 7.3125 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ee1d166e0e545b6c6dc8d76f332042ff32f88fd169c58f876461aa0d1b97d415", + "mean": -0.005132903810590506, + "std": 6.098794460296631, + "rms": 6.0987958908081055, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8edab1163443dfb998571de95ef3698ad00d0c386fff97ecec154bd0e647b747", + "mean": -0.0030884237494319677, + "std": 0.26280340552330017, + "rms": 0.2628215253353119, + "max_abs": 7.5 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "803a3731b15e078da1d713fed1d6d6e02c63e13d06d97a6bc7b35c0e143278cf", + "mean": -0.005415491294115782, + "std": 5.753208160400391, + "rms": 5.75321102142334, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9984689354896545, + "min_cosine_similarity": 0.9926226139068604, + "mean_relative_l2": 0.05224448814988136, + "max_abs_delta": 0.25 + }, + "system_bos": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9952537417411804, + "min_cosine_similarity": 0.9768246412277222, + "mean_relative_l2": 0.09444557875394821, + "max_abs_delta": 0.625 + }, + "system_x": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9931686520576477, + "min_cosine_similarity": 0.9758623838424683, + "mean_relative_l2": 0.11457628011703491, + "max_abs_delta": 0.75 + }, + "system_period": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.993222713470459, + "min_cosine_similarity": 0.9753881692886353, + "mean_relative_l2": 0.11373836547136307, + "max_abs_delta": 0.65625 + }, + "bos_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9937793016433716, + "min_cosine_similarity": 0.9752922654151917, + "mean_relative_l2": 0.1084149181842804, + "max_abs_delta": 0.625 + }, + "bos_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9923049211502075, + "min_cosine_similarity": 0.9668449759483337, + "mean_relative_l2": 0.12127062678337097, + "max_abs_delta": 0.625 + }, + "x_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9928780198097229, + "min_cosine_similarity": 0.9484659433364868, + "mean_relative_l2": 0.11403343826532364, + "max_abs_delta": 0.6875 + }, + "x_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9881783127784729, + "min_cosine_similarity": 0.9347034692764282, + "mean_relative_l2": 0.14944222569465637, + "max_abs_delta": 1.125 + }, + "period_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9929512739181519, + "min_cosine_similarity": 0.9537563323974609, + "mean_relative_l2": 0.11351568251848221, + "max_abs_delta": 0.71875 + }, + "period_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.98818439245224, + "min_cosine_similarity": 0.9447482824325562, + "mean_relative_l2": 0.14933228492736816, + "max_abs_delta": 0.9375 + } + } + }, + "layer_08": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e672be0784f9712d66daa17edbd7a7c204cc038c749a615d081e3cf2f5ad241b", + "mean": -0.00572922732681036, + "std": 0.2981151342391968, + "rms": 0.29817017912864685, + "max_abs": 7.8125 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ca8e6ed80fceff41d7ce1110450816dd0a2d605ce2dd6ea74e233bbceb7fc827", + "mean": -0.01636667549610138, + "std": 6.937502861022949, + "rms": 6.9375224113464355, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "98f4504a9322f9308fd1c72aea14107031c96fa3f94145742b7a0cd59a04b27e", + "mean": -0.005725155584514141, + "std": 0.2991069257259369, + "rms": 0.29916173219680786, + "max_abs": 7.96875 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2fa4002db08ea79bddc1f41dad42cdd98434b9318c09d2ebdd9d9fe10f133bbf", + "mean": -0.016497524455189705, + "std": 6.753163814544678, + "rms": 6.753183841705322, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6c1c0cc576f141b78ae80597d45b8fddc132ff6224d4ebd7195a51f7ca64fe9c", + "mean": -0.005965412128716707, + "std": 0.3005039691925049, + "rms": 0.30056315660476685, + "max_abs": 7.8125 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "49e0e00e2e9e7dd4eac1928bbb68089946e1b13169ed0e09ed0c554e517b393a", + "mean": -0.007809286005795002, + "std": 6.112795829772949, + "rms": 6.1128010749816895, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ddba18ba5d99f6c87176b5f4f55854edf4a2f45597eb8c3e81ce63bc6a4bd0c4", + "mean": -0.006105208303779364, + "std": 0.3026665151119232, + "rms": 0.3027280867099762, + "max_abs": 8.0 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7dcaaec08af9be1b451f06b1b29990d80f656e8d03119b9b1647dfd9f42ef842", + "mean": -0.007691661361604929, + "std": 5.7666192054748535, + "rms": 5.766624927520752, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "18d1f58e7d4f033cf2cb470b810c50ad5d26429b7c2556b6b3593bbb57f5da1d", + "mean": -0.006061225663870573, + "std": 0.29978296160697937, + "rms": 0.29984423518180847, + "max_abs": 8.0 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bc2119ca70c2be7c36b14dcedd78f7259a8978bf5597e3c091464fc7c759d00d", + "mean": -0.007895397953689098, + "std": 6.112740993499756, + "rms": 6.112746238708496, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9a4ccbf87bfffed5ab0c7e1c5a1e150ad5ab18d8a9c68547e3d679dcd84284ce", + "mean": -0.006182849407196045, + "std": 0.30215775966644287, + "rms": 0.30222100019454956, + "max_abs": 8.4375 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "554abe1b75d5bd106d8454f57387fcf51ba173490e3035c9f5ad4de0ee4aa981", + "mean": -0.007699795998632908, + "std": 5.766577243804932, + "rms": 5.766582489013672, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cf1d9207220d4596826cb55ee3dda790a027b2fe4ec89909e72fd9a171a663b2", + "mean": -0.006105782464146614, + "std": 0.29932618141174316, + "rms": 0.29938843846321106, + "max_abs": 8.0625 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e61a137d508d63e07b2b1ae4ac754d05521968495f6ed87a83fe48fcf8472b1b", + "mean": -0.007931613363325596, + "std": 6.112726211547852, + "rms": 6.112731456756592, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4ab5b4b6ba56bec16d9bc1299c6187af871237b1b102c557c6f309d03395b648", + "mean": -0.0062163881957530975, + "std": 0.3015194833278656, + "rms": 0.30158355832099915, + "max_abs": 8.4375 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "86e6c778642d0b30d540241edb90899a11649d68ee58c4732d7b31274dcf1369", + "mean": -0.007691249717026949, + "std": 5.766554832458496, + "rms": 5.766560077667236, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9978504776954651, + "min_cosine_similarity": 0.9898397922515869, + "mean_relative_l2": 0.06041976064443588, + "max_abs_delta": 0.3125 + }, + "system_bos": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9945120811462402, + "min_cosine_similarity": 0.9740538001060486, + "mean_relative_l2": 0.10153069347143173, + "max_abs_delta": 0.5625 + }, + "system_x": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9921198487281799, + "min_cosine_similarity": 0.9663866758346558, + "mean_relative_l2": 0.123087577521801, + "max_abs_delta": 0.8125 + }, + "system_period": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9923723936080933, + "min_cosine_similarity": 0.9764952063560486, + "mean_relative_l2": 0.12074737995862961, + "max_abs_delta": 0.78125 + }, + "bos_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9928606748580933, + "min_cosine_similarity": 0.972001314163208, + "mean_relative_l2": 0.1157849133014679, + "max_abs_delta": 0.71875 + }, + "bos_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.991356611251831, + "min_cosine_similarity": 0.9680136442184448, + "mean_relative_l2": 0.1293911188840866, + "max_abs_delta": 0.65625 + }, + "x_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9918051958084106, + "min_cosine_similarity": 0.9513715505599976, + "mean_relative_l2": 0.12250111997127533, + "max_abs_delta": 0.53125 + }, + "x_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9867761135101318, + "min_cosine_similarity": 0.9395537972450256, + "mean_relative_l2": 0.159341961145401, + "max_abs_delta": 1.21875 + }, + "period_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9919523000717163, + "min_cosine_similarity": 0.9563133716583252, + "mean_relative_l2": 0.12121038883924484, + "max_abs_delta": 0.5 + }, + "period_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9870883226394653, + "min_cosine_similarity": 0.9495311975479126, + "mean_relative_l2": 0.1572568118572235, + "max_abs_delta": 1.09375 + } + } + }, + "layer_09": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0ae3a793d449da18920c823e3832419e4004b47b126a684d0fcd522270c7480c", + "mean": -0.005253441631793976, + "std": 0.3481358289718628, + "rms": 0.3481754660606384, + "max_abs": 11.0625 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "179cf068f1b2a4490e50bc6c028e136ba5ab768ba358815b9bb1e548bc497479", + "mean": -0.015736207365989685, + "std": 6.940224647521973, + "rms": 6.940242290496826, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c444b6250adfec2fe3850767f9361e35a95ab572c691e040baa0fa8bc6da52f2", + "mean": -0.005274406634271145, + "std": 0.3492807447910309, + "rms": 0.34932056069374084, + "max_abs": 11.125 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4451bd02c3a0932291da2adf28f574a1234ed90b71df83e804fa56b3a30e71f7", + "mean": -0.016410216689109802, + "std": 6.755890846252441, + "rms": 6.755910396575928, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8cd147afb11854dcf1dc39f22573414d85ca349309bbfa8b58500bb70aa1905a", + "mean": -0.005639984738081694, + "std": 0.35037603974342346, + "rms": 0.3504214584827423, + "max_abs": 10.75 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6082f45b0cabbd2068a598e4c156c5b01907be1fcc5bdfebf3e30c927069cd42", + "mean": -0.0073905629105865955, + "std": 6.115811824798584, + "rms": 6.115816593170166, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0a624b101fabbc7760c7a198e3489ac1b22e81b04c7499e90ad26d9c896abe79", + "mean": -0.005591204855591059, + "std": 0.35266366600990295, + "rms": 0.35270798206329346, + "max_abs": 11.125 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "019039338baa44d386c771e1c5890e9e96e184e401beb3cd56dea2bc9c71dd5d", + "mean": -0.007662636693567038, + "std": 5.769747734069824, + "rms": 5.7697529792785645, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "dad6209f2a72170ba76f88e57d6bbb4455d8e1119b29cdb64b008645f6236b5e", + "mean": -0.005813478492200375, + "std": 0.3500727713108063, + "rms": 0.35012105107307434, + "max_abs": 11.0 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3f4c0d36659b66a19bcd2bcc0a7503f0070fe9cff989afd95cde665d5a3f54ef", + "mean": -0.007528543472290039, + "std": 6.115774154663086, + "rms": 6.11577844619751, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cf9a34339eec525e859ff4d02d2c56f327f4c9d0663b1519088089e7dccaf9ef", + "mean": -0.005822105798870325, + "std": 0.3525109589099884, + "rms": 0.35255903005599976, + "max_abs": 11.375 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6f2a82b91d2db517fea8d44300601cf1e3f75627620547fbb482c3d449ce4acd", + "mean": -0.007830503396689892, + "std": 5.769704818725586, + "rms": 5.769710540771484, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "eebdcf5c6eff8ae11b36dafba77c251f0aadf707ae0999d93285f648512e049c", + "mean": -0.005927037913352251, + "std": 0.34977611899375916, + "rms": 0.34982630610466003, + "max_abs": 11.125 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ff1497ae28e7623baa140501704cf45aaf03d933d42b6ba41fbd9dfe79f66faf", + "mean": -0.0075250654481351376, + "std": 6.115740776062012, + "rms": 6.1157450675964355, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6f1262321817a4fd2f43792e69902c42b02421c1a60148f2228c1d2e4cb07613", + "mean": -0.005942431278526783, + "std": 0.3517676889896393, + "rms": 0.35181787610054016, + "max_abs": 11.3125 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "dff1cc1ef53cb971de8fb591ab5409c41cd99bdf38f07732dc85f879c19f9e2d", + "mean": -0.007832854054868221, + "std": 5.769653797149658, + "rms": 5.769659519195557, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9979239702224731, + "min_cosine_similarity": 0.9918900728225708, + "mean_relative_l2": 0.05931854620575905, + "max_abs_delta": 0.375 + }, + "system_bos": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9951302409172058, + "min_cosine_similarity": 0.9757516384124756, + "mean_relative_l2": 0.09547333419322968, + "max_abs_delta": 0.75 + }, + "system_x": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9931890964508057, + "min_cosine_similarity": 0.9756157398223877, + "mean_relative_l2": 0.11439388245344162, + "max_abs_delta": 1.125 + }, + "system_period": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9932770729064941, + "min_cosine_similarity": 0.9796955585479736, + "mean_relative_l2": 0.11343645304441452, + "max_abs_delta": 1.1875 + }, + "bos_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9936254024505615, + "min_cosine_similarity": 0.9805798530578613, + "mean_relative_l2": 0.1092313826084137, + "max_abs_delta": 0.8125 + }, + "bos_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9924641847610474, + "min_cosine_similarity": 0.9722732901573181, + "mean_relative_l2": 0.12003786861896515, + "max_abs_delta": 1.0 + }, + "x_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9927719235420227, + "min_cosine_similarity": 0.9631131887435913, + "mean_relative_l2": 0.11510618776082993, + "max_abs_delta": 0.6875 + }, + "x_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.988574743270874, + "min_cosine_similarity": 0.952023446559906, + "mean_relative_l2": 0.14755424857139587, + "max_abs_delta": 1.75 + }, + "period_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9928509593009949, + "min_cosine_similarity": 0.9666690826416016, + "mean_relative_l2": 0.1144760325551033, + "max_abs_delta": 0.625 + }, + "period_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9888275265693665, + "min_cosine_similarity": 0.9597182273864746, + "mean_relative_l2": 0.14561040699481964, + "max_abs_delta": 1.6875 + } + } + }, + "layer_10": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ffcdfdc07485d2f3d75714b00419d6c68c7bbb4f461ebab787f18a172bf2633f", + "mean": -0.0046871621161699295, + "std": 0.3899678885936737, + "rms": 0.3899960517883301, + "max_abs": 11.625 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "dfff3726021722eaadb2199a3c1a4ede41b7f1b4511e70d1e7075fba1f7da3d4", + "mean": -0.01560793723911047, + "std": 6.948079586029053, + "rms": 6.948097229003906, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6630d6f5d887dc7a808e9dfadc734d2dc157e6984b9662a39c1d6e414d410e0b", + "mean": -0.004691531416028738, + "std": 0.39082610607147217, + "rms": 0.39085426926612854, + "max_abs": 11.625 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0fae8b2f4383ca8e5e3781db745cd88a2e781e60179ce1092c998679f1bbc03e", + "mean": -0.01642095483839512, + "std": 6.76351261138916, + "rms": 6.763531684875488, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1f85478fd1d4dfce572c92b76653771b855dffde0eaca5dfecfc2bd250773793", + "mean": -0.004951490554958582, + "std": 0.3911657929420471, + "rms": 0.3911971151828766, + "max_abs": 11.625 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9fdac9455e4340ec34b058c6a5c814d6bfb09562010fa9ad7af822cbbc476234", + "mean": -0.0072418018244206905, + "std": 6.124356269836426, + "rms": 6.124361038208008, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "99c4799d542001e5673fc23cb7d5f2f9a02c55275ad635ca57d4b4c5f180065b", + "mean": -0.00484556844457984, + "std": 0.39245936274528503, + "rms": 0.3924892544746399, + "max_abs": 11.625 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "254f3798b91b69d7417d81276beaef662a2ad6a729148ebda499f2f810814f8f", + "mean": -0.007597674150019884, + "std": 5.778127670288086, + "rms": 5.77813196182251, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5d3fce4a5bd366ae78deb72b24ab203c1543c79316214e6243f720370b534f8b", + "mean": -0.005206821020692587, + "std": 0.390974223613739, + "rms": 0.3910088837146759, + "max_abs": 11.8125 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "16da61368905d28ce72ace339e789e71bf57a32d6659a239ecc282255c266e4f", + "mean": -0.007412804756313562, + "std": 6.124306678771973, + "rms": 6.124311447143555, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a29265e92dd682ae1691208cf1d0765923c993a36266e2dbabb63af078b38260", + "mean": -0.005236056167632341, + "std": 0.39240097999572754, + "rms": 0.3924359083175659, + "max_abs": 11.875 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3cfc6f095bd52103113543c1486751cd5326213933f8443471a30bf528775dfa", + "mean": -0.007890893146395683, + "std": 5.778053283691406, + "rms": 5.778058052062988, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f7e47c36925f66ca21875186485ae3d9445539839f90e5ff731eb089076b0e98", + "mean": -0.005317281000316143, + "std": 0.3904646337032318, + "rms": 0.39050087332725525, + "max_abs": 11.8125 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6d5582477d944a2ab92036e2705b9c039226dba475338d9736c92465ffcb5080", + "mean": -0.0073760817758738995, + "std": 6.124258995056152, + "rms": 6.124264240264893, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a49d4435e805e3d93b2e9f387cb81f986e977e4c536d80cb3e1fddd6a5057572", + "mean": -0.0053627085871994495, + "std": 0.3912576138973236, + "rms": 0.39129436016082764, + "max_abs": 11.875 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1fa3aef53336d3d11e1fb603848a9753749e6edd90828eff0ae8d2c7f653f52f", + "mean": -0.007886094972491264, + "std": 5.777980327606201, + "rms": 5.777985572814941, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9976423978805542, + "min_cosine_similarity": 0.9905320405960083, + "mean_relative_l2": 0.06355271488428116, + "max_abs_delta": 0.375 + }, + "system_bos": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9945402145385742, + "min_cosine_similarity": 0.9758986234664917, + "mean_relative_l2": 0.10065620392560959, + "max_abs_delta": 0.65625 + }, + "system_x": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.992746889591217, + "min_cosine_similarity": 0.9767105579376221, + "mean_relative_l2": 0.11757277697324753, + "max_abs_delta": 0.9375 + }, + "system_period": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9926813840866089, + "min_cosine_similarity": 0.9769675135612488, + "mean_relative_l2": 0.11746227741241455, + "max_abs_delta": 0.9375 + }, + "bos_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9928244352340698, + "min_cosine_similarity": 0.9789261817932129, + "mean_relative_l2": 0.11544682830572128, + "max_abs_delta": 0.75 + }, + "bos_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9918463230133057, + "min_cosine_similarity": 0.9688334465026855, + "mean_relative_l2": 0.12396927922964096, + "max_abs_delta": 1.0 + }, + "x_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9920899868011475, + "min_cosine_similarity": 0.9692872166633606, + "mean_relative_l2": 0.12102805078029633, + "max_abs_delta": 0.71875 + }, + "x_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9877268671989441, + "min_cosine_similarity": 0.9512993097305298, + "mean_relative_l2": 0.1522609293460846, + "max_abs_delta": 1.625 + }, + "period_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9922253489494324, + "min_cosine_similarity": 0.9673396348953247, + "mean_relative_l2": 0.11929835379123688, + "max_abs_delta": 0.5625 + }, + "period_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9881616234779358, + "min_cosine_similarity": 0.9616526365280151, + "mean_relative_l2": 0.1490638256072998, + "max_abs_delta": 1.375 + } + } + }, + "layer_11": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b3d4824fcb7efff6c4596ca0a960f9955acda0d09cda2cd70794aab01d617033", + "mean": -0.009379766881465912, + "std": 0.4793906509876251, + "rms": 0.47948241233825684, + "max_abs": 15.3125 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d639a3cb5dff0674de64432b0e904a06cc4ee9c886efbc2374ad82a108cd46e5", + "mean": -0.019004134461283684, + "std": 6.989168643951416, + "rms": 6.989194393157959, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "387eaf55dc88a1202fd9fe6d3195977b09a82f56f319d68dfc37edb76cdce6ad", + "mean": -0.009286878630518913, + "std": 0.47897711396217346, + "rms": 0.4790671467781067, + "max_abs": 15.4375 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8a9ba11c0030d7a695ac92115dba0156be51ff7f1da70fd2553126e7ec652d12", + "mean": -0.01943803019821644, + "std": 6.802736282348633, + "rms": 6.802763938903809, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ef5aaac57bfdf49f3269cb453581a12bbf6c1a18a9e2ad11b8dc8260d26a0203", + "mean": -0.00950761791318655, + "std": 0.48127225041389465, + "rms": 0.4813661575317383, + "max_abs": 15.25 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "151ac62b7b2ed6e40383dd749d987811e936dd86e0de0dc5f8e4ddbed89876d4", + "mean": -0.010504301637411118, + "std": 6.159126281738281, + "rms": 6.159135341644287, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0603b27060977ff031703f51ab029fff0aba2571bd6fd73b326a65a6862e17f2", + "mean": -0.009361736476421356, + "std": 0.4811488389968872, + "rms": 0.481239914894104, + "max_abs": 15.375 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d1b9750dd5096ed33a4bc26de8b4d075764a0fd66e2d3373c7a46466f3f1711c", + "mean": -0.010516677983105183, + "std": 5.811446189880371, + "rms": 5.811455726623535, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a5153407e8cb96db56c8130e291829ad6085b78723296083246c8ad9c3a5d511", + "mean": -0.009793182834982872, + "std": 0.48056188225746155, + "rms": 0.48066166043281555, + "max_abs": 15.8125 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e25a08c82dccba106381d09cc77d9b0894d17dca1988809e959406d65d2a8fa4", + "mean": -0.010636928491294384, + "std": 6.159049034118652, + "rms": 6.159058094024658, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "58e6bc3886f462bbc35bc94748cd493cc4f83114162aafdc0e51e94d3920b220", + "mean": -0.009661679156124592, + "std": 0.47849106788635254, + "rms": 0.4785885810852051, + "max_abs": 15.875 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a2f43aa3ffc5c949c13cc80e3df2655e73833067f49d0242c30204a7df23b5fc", + "mean": -0.010664736852049828, + "std": 5.811169147491455, + "rms": 5.811179161071777, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4433b07a01fc93d254a129cdc38f1a06379bf49b2350aaf2c3a912e20b106726", + "mean": -0.010012253187596798, + "std": 0.4788285493850708, + "rms": 0.478933185338974, + "max_abs": 15.75 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ebae36ece9584f886376230b15713a538bdce023451062b458a1f0feeaaef84b", + "mean": -0.01070733554661274, + "std": 6.158899784088135, + "rms": 6.158908843994141, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c2897d9fbe5fa6a3eea297e844bde4eac0f8dc084fa32ba93daa72cc6d646c04", + "mean": -0.009787406772375107, + "std": 0.47733554244041443, + "rms": 0.4774358570575714, + "max_abs": 15.5625 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b9e81df463f2b1f3c1ff078d0fa4741de08324f719afec029c893f06d9de7d73", + "mean": -0.010624894872307777, + "std": 5.8110785484313965, + "rms": 5.811088562011719, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9976889491081238, + "min_cosine_similarity": 0.9908194541931152, + "mean_relative_l2": 0.0634516179561615, + "max_abs_delta": 0.5 + }, + "system_bos": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9950953722000122, + "min_cosine_similarity": 0.9707736968994141, + "mean_relative_l2": 0.0952104926109314, + "max_abs_delta": 0.75 + }, + "system_x": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9936835169792175, + "min_cosine_similarity": 0.9794391393661499, + "mean_relative_l2": 0.10988527536392212, + "max_abs_delta": 1.125 + }, + "system_period": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9932631254196167, + "min_cosine_similarity": 0.9787676930427551, + "mean_relative_l2": 0.11301791667938232, + "max_abs_delta": 1.125 + }, + "bos_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9936884641647339, + "min_cosine_similarity": 0.9781694412231445, + "mean_relative_l2": 0.10835447907447815, + "max_abs_delta": 0.75 + }, + "bos_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9926816821098328, + "min_cosine_similarity": 0.9677563905715942, + "mean_relative_l2": 0.11749318987131119, + "max_abs_delta": 0.9375 + }, + "x_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.993148684501648, + "min_cosine_similarity": 0.9774806499481201, + "mean_relative_l2": 0.113218292593956, + "max_abs_delta": 0.75 + }, + "x_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9893600940704346, + "min_cosine_similarity": 0.9576194286346436, + "mean_relative_l2": 0.1422211080789566, + "max_abs_delta": 1.25 + }, + "period_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9932387471199036, + "min_cosine_similarity": 0.9785710573196411, + "mean_relative_l2": 0.11184001713991165, + "max_abs_delta": 0.8125 + }, + "period_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9895634651184082, + "min_cosine_similarity": 0.9664546251296997, + "mean_relative_l2": 0.14057321846485138, + "max_abs_delta": 1.1875 + } + } + }, + "layer_12": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "08dd55157cec6397ee26d503f10be9e33755e659ce6a12030c624ca4822448b9", + "mean": -0.010701213032007217, + "std": 0.5040990710258484, + "rms": 0.5042126178741455, + "max_abs": 14.875 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "77d2295cfccc4c4e2959186626af330e873ae854018c4b7a2cf2082fd9520077", + "mean": -0.02055356837809086, + "std": 7.038413047790527, + "rms": 7.038443088531494, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a1803cf211f43055beb3f782f78ec573dbb0634ec4e8ca2d82bfed02cba53b6d", + "mean": -0.010424542240798473, + "std": 0.5037732124328613, + "rms": 0.50388103723526, + "max_abs": 15.125 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6322c9f6c74f65aa04f45c114286b5805ab09acd1a77f873104c1f8d5f22d551", + "mean": -0.020372511819005013, + "std": 6.852925777435303, + "rms": 6.852956295013428, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8b09cd9db58a6e7609f90fb0d397cb53b4d379d3aeecb932f50f07acd0e31494", + "mean": -0.010749246925115585, + "std": 0.506001889705658, + "rms": 0.5061160326004028, + "max_abs": 15.125 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "387c7e20e175801794264279332bffd851bc4ac59103b792105af8e8e7c3b73b", + "mean": -0.011816967278718948, + "std": 6.170841693878174, + "rms": 6.170853137969971, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "52cbe5a861004dcb86d35152decd76992c62462313ca60365d41aa3113817562", + "mean": -0.010601038113236427, + "std": 0.5058470964431763, + "rms": 0.5059581398963928, + "max_abs": 15.125 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5ca3a41ede2e3f9ba0e241edbef33cc54bcd1dc2ed96881c005a069be64cf768", + "mean": -0.011512210592627525, + "std": 5.823177337646484, + "rms": 5.823188781738281, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d994fef2ecadd381bd9dbbc08409dce8b55708d353205de3bb15bb3982e8ad0f", + "mean": -0.01100162137299776, + "std": 0.5056166648864746, + "rms": 0.5057363510131836, + "max_abs": 15.125 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f8effe249665364a7166a2a0b80165ea850679812318b5bc9bc5e7024bc00cf4", + "mean": -0.012162677943706512, + "std": 6.170792102813721, + "rms": 6.170804500579834, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e51cd7a4aa28028ae5a45323a16bfe4c2c8fbce199102263db48d1878a3be9ab", + "mean": -0.010916327126324177, + "std": 0.5036554932594299, + "rms": 0.5037737488746643, + "max_abs": 15.125 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "98cf675fec0c684efb0a293010f4acc39f09456a44c9929be9801a36714a24de", + "mean": -0.011770504526793957, + "std": 5.822841644287109, + "rms": 5.822853088378906, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6a5cf625575e818fc9fcd8577d475ec11aa93a4ce3632269f8914c2ee9684af6", + "mean": -0.011178595945239067, + "std": 0.5048644542694092, + "rms": 0.5049881935119629, + "max_abs": 15.25 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5e3eee56be527e635b64c7d8594c0841dc26b5dce488a459c4e3c9869a058e53", + "mean": -0.012116225436329842, + "std": 6.170677661895752, + "rms": 6.170689582824707, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fd36e8338c990616f139f47ef3872868ab4a705ac9da4e488e06bd52997a2da6", + "mean": -0.010927660390734673, + "std": 0.5033067464828491, + "rms": 0.5034253597259521, + "max_abs": 15.1875 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9d98435b84510c087ce497e652f72c14f1c8727b02a60d11958175d7afccc70d", + "mean": -0.011553846299648285, + "std": 5.822834491729736, + "rms": 5.822846412658691, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9973759055137634, + "min_cosine_similarity": 0.987407922744751, + "mean_relative_l2": 0.06771058589220047, + "max_abs_delta": 0.4375 + }, + "system_bos": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9947676658630371, + "min_cosine_similarity": 0.9701840877532959, + "mean_relative_l2": 0.09892290830612183, + "max_abs_delta": 1.125 + }, + "system_x": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9931865334510803, + "min_cosine_similarity": 0.9774331450462341, + "mean_relative_l2": 0.11406180262565613, + "max_abs_delta": 1.375 + }, + "system_period": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9928735494613647, + "min_cosine_similarity": 0.9764383435249329, + "mean_relative_l2": 0.11628706753253937, + "max_abs_delta": 0.921875 + }, + "bos_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9930899739265442, + "min_cosine_similarity": 0.9772330522537231, + "mean_relative_l2": 0.11353044956922531, + "max_abs_delta": 1.0 + }, + "bos_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9921938180923462, + "min_cosine_similarity": 0.9669166803359985, + "mean_relative_l2": 0.12142741680145264, + "max_abs_delta": 1.3125 + }, + "x_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9926567673683167, + "min_cosine_similarity": 0.9770681858062744, + "mean_relative_l2": 0.1172279343008995, + "max_abs_delta": 1.25 + }, + "x_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.988714337348938, + "min_cosine_similarity": 0.9545091390609741, + "mean_relative_l2": 0.1468079537153244, + "max_abs_delta": 1.8125 + }, + "period_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9926753044128418, + "min_cosine_similarity": 0.9781772494316101, + "mean_relative_l2": 0.1167917400598526, + "max_abs_delta": 1.3125 + }, + "period_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9888242483139038, + "min_cosine_similarity": 0.9660049676895142, + "mean_relative_l2": 0.14584055542945862, + "max_abs_delta": 1.875 + } + } + }, + "layer_13": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8f41b5d6bd138faee9a94639a104a930d70ff4879c88316124bfff044cd554ed", + "mean": -0.011637426912784576, + "std": 0.5295923948287964, + "rms": 0.5297202467918396, + "max_abs": 16.5 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9493194a186aab9b2ba5947d0e5546224aaf88bbb79f3741dfde7da70ad049c2", + "mean": -0.021265460178256035, + "std": 7.045016288757324, + "rms": 7.045048713684082, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5d0ac5b4babf530d341b68642ba416e60bafe8f70c83684cf619e887924c6f50", + "mean": -0.011390960775315762, + "std": 0.5290701389312744, + "rms": 0.5291927456855774, + "max_abs": 16.875 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "73559c9c178939865a18d7a7675763726292cbeced639835600b2750e4975af9", + "mean": -0.021527927368879318, + "std": 6.859773635864258, + "rms": 6.859807014465332, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "82c3f4d77ec5ef67d71f8e27edad66b3a524457a63af60098b0274ca790b5e39", + "mean": -0.01177380234003067, + "std": 0.5315490961074829, + "rms": 0.5316795110702515, + "max_abs": 16.5 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "460ccd50ebd4a5d57dea587c182e76e0a8b896e6210d0c26b7ba0162af7a885b", + "mean": -0.012598621658980846, + "std": 6.176937580108643, + "rms": 6.176950931549072, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9d73b2d3f701c5833afbfe9e979d8d3efe644577b2febcb0f297f89bf7558515", + "mean": -0.011508996598422527, + "std": 0.5307456851005554, + "rms": 0.5308704972267151, + "max_abs": 16.625 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3b933cf5f2621f4322fbb5b19e9ca732dd6519ade79afd5b43c249d1d575fd74", + "mean": -0.012570835649967194, + "std": 5.829607009887695, + "rms": 5.829619884490967, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b3769c372ac8b2a8422ea00558959677a3ba24070d1870fe97e69072cd51620b", + "mean": -0.011891336180269718, + "std": 0.5304832458496094, + "rms": 0.5306165218353271, + "max_abs": 16.375 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2f8f7c1eb982f2f300461da38261e2ec28b31ae0578370c07e50d13d7b212d4b", + "mean": -0.012913004495203495, + "std": 6.1768999099731445, + "rms": 6.176913261413574, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b628570fe9194ac790b155699e39d54610b70f2be2d1f30ee704a3b8595bdfc3", + "mean": -0.011855179443955421, + "std": 0.5293829441070557, + "rms": 0.5295156836509705, + "max_abs": 16.5 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "898b7696a9033d52f063924298a4e9faec8bc174aa95c7621d489726abc5fe8a", + "mean": -0.012876469641923904, + "std": 5.829358100891113, + "rms": 5.829371929168701, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f3d47521e9795016d80759b1843f28a93cd21dc039097e0a08c9caf1e1f100e1", + "mean": -0.012082398869097233, + "std": 0.5300137996673584, + "rms": 0.5301515460014343, + "max_abs": 16.375 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fb1ffbe33daab88a02149c312c4d9251d945d86bac74ec76b9f16065da4f4a3b", + "mean": -0.01285542268306017, + "std": 6.176792144775391, + "rms": 6.1768059730529785, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1b89ce1ee19583c02f1aa8ea716c4aa7d2d83ee802ca69568ff41778a2111f4b", + "mean": -0.011838573031127453, + "std": 0.5284451246261597, + "rms": 0.5285777449607849, + "max_abs": 16.25 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8467be7b8c1bd618ed7aa20c842524392745d8dcbc5932fc99d70ecefb389c67", + "mean": -0.012697331607341766, + "std": 5.829311847686768, + "rms": 5.8293256759643555, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9973422288894653, + "min_cosine_similarity": 0.9885382056236267, + "mean_relative_l2": 0.06896618008613586, + "max_abs_delta": 0.5 + }, + "system_bos": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9948363900184631, + "min_cosine_similarity": 0.9729360342025757, + "mean_relative_l2": 0.09837346524000168, + "max_abs_delta": 1.3125 + }, + "system_x": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9932426810264587, + "min_cosine_similarity": 0.9793205857276917, + "mean_relative_l2": 0.11355433613061905, + "max_abs_delta": 1.125 + }, + "system_period": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.993194580078125, + "min_cosine_similarity": 0.9771559834480286, + "mean_relative_l2": 0.11368115991353989, + "max_abs_delta": 0.9375 + }, + "bos_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.993220865726471, + "min_cosine_similarity": 0.9723426103591919, + "mean_relative_l2": 0.1126696765422821, + "max_abs_delta": 1.4375 + }, + "bos_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9923928380012512, + "min_cosine_similarity": 0.9698810577392578, + "mean_relative_l2": 0.12010140717029572, + "max_abs_delta": 2.125 + }, + "x_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9927011728286743, + "min_cosine_similarity": 0.9739219546318054, + "mean_relative_l2": 0.11694912612438202, + "max_abs_delta": 1.875 + }, + "x_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9890157580375671, + "min_cosine_similarity": 0.9568765163421631, + "mean_relative_l2": 0.14504966139793396, + "max_abs_delta": 2.4375 + }, + "period_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9926944971084595, + "min_cosine_similarity": 0.9755662083625793, + "mean_relative_l2": 0.11682508885860443, + "max_abs_delta": 1.875 + }, + "period_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9891096949577332, + "min_cosine_similarity": 0.9652802348136902, + "mean_relative_l2": 0.1443847268819809, + "max_abs_delta": 2.625 + } + } + }, + "layer_14": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "baf5669f991df2593bd77c1fc4a0c8be5c7032d17b948b53804631b8989dfed4", + "mean": -0.011740018613636494, + "std": 0.6184245944023132, + "rms": 0.6185359954833984, + "max_abs": 18.125 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "82db9a51d613dffb16fa8fa4c4df7fee3ea65241ce8e86cd03d703a4175a91ee", + "mean": -0.02094406448304653, + "std": 7.063847064971924, + "rms": 7.063877582550049, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "94e991447b28f0cfa6631de93efd1241748b80b38714346a5705053a6c3de2a5", + "mean": -0.01156668271869421, + "std": 0.6184132695198059, + "rms": 0.6185214519500732, + "max_abs": 18.375 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "de6d7dd378f9ee30d0067bcbecb07e71ceda1a8e3df6a3eba7446d852d70834b", + "mean": -0.021484004333615303, + "std": 6.87725830078125, + "rms": 6.877292156219482, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "91c0366b4ec985d8c8335a2300a2fe1128fe3aa2fedddb18718d4463d475b395", + "mean": -0.011929967440664768, + "std": 0.6209437251091003, + "rms": 0.6210582852363586, + "max_abs": 18.0 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c782ae13cdd3e07289a2c5f97db38945bc70d73d30de1dae7ea07e909e7c4039", + "mean": -0.012349874712526798, + "std": 6.197612762451172, + "rms": 6.197624683380127, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "33dee5effe5e918743a94164523282b0a480c3b62cc1cb132965237506670636", + "mean": -0.011831722222268581, + "std": 0.6194081902503967, + "rms": 0.6195212006568909, + "max_abs": 18.25 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5f8b9b11cb6d9a57c05bea45724023c491d3af0d0569c50172dfc56711e21538", + "mean": -0.012577692978084087, + "std": 5.849313735961914, + "rms": 5.849327087402344, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d83c2cf3eed66c036fd72c50c80da572d7fa51986157574225faf766e52dd702", + "mean": -0.012110944837331772, + "std": 0.6182519793510437, + "rms": 0.6183705925941467, + "max_abs": 18.375 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3e26550ee7a5da8f9287b2f0147929d6921f704a4db6adf8c2dc744cf63edcb0", + "mean": -0.012703944928944111, + "std": 6.197488784790039, + "rms": 6.197501182556152, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c24e7d5e1c821772b5d3307e2facdf58ebae33ef58507d510f837e152ee02164", + "mean": -0.012292392551898956, + "std": 0.6165212392807007, + "rms": 0.6166437864303589, + "max_abs": 18.625 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "051d48a81a93f94c2cf5acb354f8d792563112b3ea7e290061c9c3d6b37d6fb5", + "mean": -0.01298451703041792, + "std": 5.848990440368652, + "rms": 5.849005222320557, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1f4da6f9864c0425694f75b61d7ac506e0343159bd63aeff1992053a17b906c0", + "mean": -0.012171624228358269, + "std": 0.6187210083007812, + "rms": 0.6188406944274902, + "max_abs": 18.125 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3a332829d4edec4ff1370719da8389a42d3e629314a58a34133bb136528391f1", + "mean": -0.012550980783998966, + "std": 6.197427749633789, + "rms": 6.1974406242370605, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "caccf74f028dbe68811d93bddcc3fabd55f4eabadc26deccc309bc749070d446", + "mean": -0.012212594039738178, + "std": 0.6158651113510132, + "rms": 0.615986168384552, + "max_abs": 18.5 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "362fccffeb78ff7895f76228991f848aa0d809ebbfb727377b2a5cd5b887d0d9", + "mean": -0.0128233153373003, + "std": 5.848907470703125, + "rms": 5.848921775817871, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9974645972251892, + "min_cosine_similarity": 0.9909155964851379, + "mean_relative_l2": 0.06785790622234344, + "max_abs_delta": 0.5625 + }, + "system_bos": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9952451586723328, + "min_cosine_similarity": 0.9764267802238464, + "mean_relative_l2": 0.09446680545806885, + "max_abs_delta": 1.0625 + }, + "system_x": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9936268925666809, + "min_cosine_similarity": 0.9806174039840698, + "mean_relative_l2": 0.11042901873588562, + "max_abs_delta": 1.1875 + }, + "system_period": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9935499429702759, + "min_cosine_similarity": 0.9771431684494019, + "mean_relative_l2": 0.11067378520965576, + "max_abs_delta": 1.109375 + }, + "bos_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9937475919723511, + "min_cosine_similarity": 0.9715599417686462, + "mean_relative_l2": 0.10838599503040314, + "max_abs_delta": 1.625 + }, + "bos_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9930229783058167, + "min_cosine_similarity": 0.9732204675674438, + "mean_relative_l2": 0.11494994908571243, + "max_abs_delta": 2.3125 + }, + "x_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.993337094783783, + "min_cosine_similarity": 0.9720900058746338, + "mean_relative_l2": 0.11140212416648865, + "max_abs_delta": 2.1875 + }, + "x_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9897341728210449, + "min_cosine_similarity": 0.9607683420181274, + "mean_relative_l2": 0.13958321511745453, + "max_abs_delta": 2.6875 + }, + "period_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9933035373687744, + "min_cosine_similarity": 0.9751104116439819, + "mean_relative_l2": 0.1116604208946228, + "max_abs_delta": 2.0 + }, + "period_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9898687601089478, + "min_cosine_similarity": 0.9651419520378113, + "mean_relative_l2": 0.13873307406902313, + "max_abs_delta": 2.875 + } + } + }, + "layer_15": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "51107489cbc7c73dd8d84b97194c8712e01e97f36280d27722c431ea92300b4d", + "mean": -0.015953967347741127, + "std": 0.6907501816749573, + "rms": 0.6909343600273132, + "max_abs": 22.0 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8474c2198cee89c85ac7bd796224a0c6a6d44a8fa350cea11e00c686a9ede955", + "mean": -0.024002805352211, + "std": 7.073402404785156, + "rms": 7.073443412780762, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1fa741d687581fa71324873801fda026d3d051fcc7efb535804b70f6f912ba56", + "mean": -0.015760507434606552, + "std": 0.6896371245384216, + "rms": 0.6898171901702881, + "max_abs": 21.75 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "229341ab392ce2d0f2e6737ed0b39ab0ae453c8eea92213f3b07ef6061188395", + "mean": -0.024506358429789543, + "std": 6.887209892272949, + "rms": 6.887253761291504, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f83bdeb21c1c48d3f862118a70c8a05b14a6e4b4319cc04f41dff0b34104faf4", + "mean": -0.016127578914165497, + "std": 0.6933900117874146, + "rms": 0.6935775279998779, + "max_abs": 22.25 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "00fbb4dab6f81e770961be74cce45c72ede04d42f842635be78230ebdd308800", + "mean": -0.015459075570106506, + "std": 6.207983016967773, + "rms": 6.20800256729126, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "da99d943ab1a09972f2c8de4e46f48e642331b15495006481328cb931f5877ec", + "mean": -0.016129713505506516, + "std": 0.6913207769393921, + "rms": 0.691508948802948, + "max_abs": 22.25 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c03692faec96aac7c739fcc76ef06a5de855a8f2910071d5affd4f958ecfd789", + "mean": -0.015741141512989998, + "std": 5.860284805297852, + "rms": 5.8603057861328125, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b1c7a6c8f841df12b9e6ccb810805599e8ea85fe3e110a637b42ffc875484fab", + "mean": -0.01651676557958126, + "std": 0.690993070602417, + "rms": 0.6911904215812683, + "max_abs": 22.25 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "859ba25d94593d93196ff494538e03a2590237ffd258154b624409a659b03546", + "mean": -0.015947405248880386, + "std": 6.207863807678223, + "rms": 6.207884311676025, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d554f0fa300a93f67d5d8f442d36ae240fd8237911deb825b93dda82f7edf3df", + "mean": -0.016947157680988312, + "std": 0.6880207061767578, + "rms": 0.6882293820381165, + "max_abs": 21.875 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1297f72822f7d3aefd045fa0541cdc056ec0770b5d9ea10b16ff94d225f2be3a", + "mean": -0.016327042132616043, + "std": 5.859884262084961, + "rms": 5.859907627105713, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f2743d9e4584d0c416cea15cf95cc84dbf60dd806ddbbf9a5eeee5c1b459ba88", + "mean": -0.01662125252187252, + "std": 0.6914042234420776, + "rms": 0.69160395860672, + "max_abs": 22.375 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c4f4fa35c458772ffc22d0086cb63b9bef4702493ab96c5bf795e4bae324dd53", + "mean": -0.015806205570697784, + "std": 6.207798480987549, + "rms": 6.20781946182251, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "55f9656c835c206d710ba821869f05ec7bc02989c324d1fe3e5cc52d421cf9b6", + "mean": -0.01693127118051052, + "std": 0.6873903274536133, + "rms": 0.6875988245010376, + "max_abs": 22.0 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4edf8fdccf6a7bd6f934f477dec715b318211ff5750d1be6d9c721814dfeabc9", + "mean": -0.016174839809536934, + "std": 5.859809875488281, + "rms": 5.859832286834717, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.997488796710968, + "min_cosine_similarity": 0.9913253784179688, + "mean_relative_l2": 0.06752272695302963, + "max_abs_delta": 0.625 + }, + "system_bos": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9954224228858948, + "min_cosine_similarity": 0.9768766164779663, + "mean_relative_l2": 0.09264790266752243, + "max_abs_delta": 1.4375 + }, + "system_x": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9939083456993103, + "min_cosine_similarity": 0.9812502861022949, + "mean_relative_l2": 0.1080431118607521, + "max_abs_delta": 1.5625 + }, + "system_period": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.993707001209259, + "min_cosine_similarity": 0.9759143590927124, + "mean_relative_l2": 0.10913312435150146, + "max_abs_delta": 1.5 + }, + "bos_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9941937327384949, + "min_cosine_similarity": 0.9711694717407227, + "mean_relative_l2": 0.1044728010892868, + "max_abs_delta": 1.75 + }, + "bos_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9933918118476868, + "min_cosine_similarity": 0.9737443923950195, + "mean_relative_l2": 0.11172930151224136, + "max_abs_delta": 2.625 + }, + "x_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9937061071395874, + "min_cosine_similarity": 0.9703841209411621, + "mean_relative_l2": 0.10819942504167557, + "max_abs_delta": 2.25 + }, + "x_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9902028441429138, + "min_cosine_similarity": 0.9653347730636597, + "mean_relative_l2": 0.13630430400371552, + "max_abs_delta": 3.125 + }, + "period_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.993668258190155, + "min_cosine_similarity": 0.9742269515991211, + "mean_relative_l2": 0.10862668603658676, + "max_abs_delta": 2.0625 + }, + "period_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9902489185333252, + "min_cosine_similarity": 0.9668760895729065, + "mean_relative_l2": 0.13596172630786896, + "max_abs_delta": 3.375 + } + } + }, + "layer_16": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "768c4e9e6efe7de2fa00e1f1c9e6efa3e9ff77b9486bbb6a1880983e084d7421", + "mean": -0.017474422231316566, + "std": 0.7914940118789673, + "rms": 0.7916868925094604, + "max_abs": 25.125 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c892b1c40264e3147ad5a2ea425989b67f7ebc8af9b6f143a73b841ccd39d624", + "mean": -0.025069585070014, + "std": 7.086719036102295, + "rms": 7.08676290512085, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "303beb1c54a0386c5bcc5156b9a683a302bb44148aa770eee2120f8fc346a123", + "mean": -0.017432324588298798, + "std": 0.791316032409668, + "rms": 0.7915080189704895, + "max_abs": 25.875 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "498d1f417b9ed31b07a5045799c309c915a37947154a9495065e9982d71fca06", + "mean": -0.02537098340690136, + "std": 6.900440692901611, + "rms": 6.900487422943115, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "036bf08373bb92d5cefe4a31509bd85ea6aa54949ccf84c611ff51786cdcfb0b", + "mean": -0.017557619139552116, + "std": 0.7926464676856995, + "rms": 0.7928408980369568, + "max_abs": 24.625 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cca05d8e79ed0c2b273fcae09b9fe902ab7d1fa4fae84c973194a6527459ed93", + "mean": -0.01640835590660572, + "std": 6.222057819366455, + "rms": 6.222079753875732, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "38ea0f38de0c99c04d6f2db5087bc8315bf04b39b95e127e8b58499bcf384993", + "mean": -0.01790175959467888, + "std": 0.7906455993652344, + "rms": 0.7908481955528259, + "max_abs": 24.875 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e1555d1a0ce8c6458300766fdad78b3600fd8c77ac3d3b39fc81dc3523a48cc8", + "mean": -0.01659010909497738, + "std": 5.874813556671143, + "rms": 5.8748369216918945, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "23552642619b42c10c5c067b857f95e164b2faa427211b896f42a08cfa7b320d", + "mean": -0.01837625354528427, + "std": 0.7904047966003418, + "rms": 0.790618360042572, + "max_abs": 24.875 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "99a139ed6c252d1c39f472c93544c4b8b1262019275503b29c785392e6b731aa", + "mean": -0.01723696105182171, + "std": 6.222066402435303, + "rms": 6.222089767456055, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1a91b09aae0d2de8ac6c6a30a40b899fc0840dcbed7ef971afd265e5e5cf86a2", + "mean": -0.019184675067663193, + "std": 0.7883893251419067, + "rms": 0.7886226773262024, + "max_abs": 24.5 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5e8f1269218e33e7cad95821f4ad83af095e3cbf61212fa2ba701e3fa4a5b6db", + "mean": -0.017577189952135086, + "std": 5.874645233154297, + "rms": 5.874671459197998, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ad784c5705061e3964f60dcc8b3c6498ba26b3d805d706ca19962b77e1e7faea", + "mean": -0.018267584964632988, + "std": 0.7909691333770752, + "rms": 0.7911800742149353, + "max_abs": 25.0 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d65266c22c29fe1cd77f522bb745d658cee0a2c0ac13fb42392966241456c55b", + "mean": -0.016885807737708092, + "std": 6.221900463104248, + "rms": 6.221922874450684, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c8bf336ddcb5f35427d618949c44b9cdddd93003c93c57b8616ba88aa3503888", + "mean": -0.019045429304242134, + "std": 0.7880802750587463, + "rms": 0.7883103489875793, + "max_abs": 24.75 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8cb331e3bb1506d31d9cc4290b5794f38ca30467508ab0840a4b1bb7533695ff", + "mean": -0.017222842201590538, + "std": 5.874454975128174, + "rms": 5.874480247497559, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9975440502166748, + "min_cosine_similarity": 0.9901691675186157, + "mean_relative_l2": 0.06681011617183685, + "max_abs_delta": 0.75 + }, + "system_bos": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9955072999000549, + "min_cosine_similarity": 0.9801681041717529, + "mean_relative_l2": 0.09171741455793381, + "max_abs_delta": 1.5 + }, + "system_x": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.99410080909729, + "min_cosine_similarity": 0.980288028717041, + "mean_relative_l2": 0.10612577199935913, + "max_abs_delta": 1.75 + }, + "system_period": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9938421249389648, + "min_cosine_similarity": 0.9762542843818665, + "mean_relative_l2": 0.10774140805006027, + "max_abs_delta": 1.625 + }, + "bos_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.99428790807724, + "min_cosine_similarity": 0.964693546295166, + "mean_relative_l2": 0.10320204496383667, + "max_abs_delta": 2.125 + }, + "bos_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.993550717830658, + "min_cosine_similarity": 0.977868914604187, + "mean_relative_l2": 0.10979899764060974, + "max_abs_delta": 3.125 + }, + "x_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9938176274299622, + "min_cosine_similarity": 0.9650149345397949, + "mean_relative_l2": 0.10705585032701492, + "max_abs_delta": 2.5625 + }, + "x_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.990565299987793, + "min_cosine_similarity": 0.9671100378036499, + "mean_relative_l2": 0.13348595798015594, + "max_abs_delta": 3.4375 + }, + "period_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9938619136810303, + "min_cosine_similarity": 0.9701651334762573, + "mean_relative_l2": 0.10666128993034363, + "max_abs_delta": 2.4375 + }, + "period_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.990638017654419, + "min_cosine_similarity": 0.9671933054924011, + "mean_relative_l2": 0.13280785083770752, + "max_abs_delta": 3.75 + } + } + }, + "layer_17": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e1fb2dcee13dd10f1a067f95f0b5102f7c053d08edbcd19215e980bc93528176", + "mean": -0.021859485656023026, + "std": 0.9147013425827026, + "rms": 0.9149625301361084, + "max_abs": 28.75 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "783fbc323402fc66cd6fcf5d80ee074848d05df90b1fdde60014e11166ae1ff6", + "mean": -0.02893121726810932, + "std": 7.103884220123291, + "rms": 7.103943347930908, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "58ceb58553d97335dd4e5c2ff7f541228ff342e57b25f5e82404ec30f56bc32a", + "mean": -0.0216534323990345, + "std": 0.9144630432128906, + "rms": 0.9147193431854248, + "max_abs": 29.375 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5a4433adddeb984d23c5c972a5acba8137ae4a6d47d71c1693ef94cd170b492c", + "mean": -0.029239961877465248, + "std": 6.91792631149292, + "rms": 6.917988300323486, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b937e8d13ceffd26a7952bbb543aae82d93114c4747f5b84522920f26db226ee", + "mean": -0.021692955866456032, + "std": 0.916378378868103, + "rms": 0.9166350960731506, + "max_abs": 28.375 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "947649acc71d8ae5a09d549874117f99b8882cbf6456fe5fe362fa1f30c66420", + "mean": -0.020018061622977257, + "std": 6.241098403930664, + "rms": 6.241130352020264, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c6e033003c8e200f2ceb706ca403fe881461ae2544d81ae1c60da8372e657267", + "mean": -0.02207564003765583, + "std": 0.9138293266296387, + "rms": 0.9140958786010742, + "max_abs": 28.5 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5bfa1cf7d5e35f92aea35bd76728d748a925dd484ee66d6b7c68bb0fbe24cb97", + "mean": -0.02046036906540394, + "std": 5.894845008850098, + "rms": 5.894880771636963, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f8f11768e833cda7fd9f98b5dc51c4c6b4fef75391abbc43ef146f4848ff2560", + "mean": -0.022592298686504364, + "std": 0.9130615592002869, + "rms": 0.9133409857749939, + "max_abs": 29.0 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c157bc2ebade25eb80a7d25ffb5ff9a4bd89f6b6407bbd7b85d9f66f120da2a2", + "mean": -0.020971301943063736, + "std": 6.241025924682617, + "rms": 6.241060733795166, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2262ac2ec286c6d05e55f9e5bfd2ab688c360777407d1598d1b61b8e35f5a6b2", + "mean": -0.023443305864930153, + "std": 0.9111811518669128, + "rms": 0.9114826321601868, + "max_abs": 29.25 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6202a3d3f6005941949614b0baa298168ea2a90b38f4e7d1710b1c894f1d9d6c", + "mean": -0.02159346453845501, + "std": 5.89460563659668, + "rms": 5.8946452140808105, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "532fd441906eec504c8dee982f38b45207ff09ed3af7f77d5f4e733b7ea90e08", + "mean": -0.022382207214832306, + "std": 0.9142983555793762, + "rms": 0.9145722389221191, + "max_abs": 28.875 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "47adce5963548521ac214004b4605fe833e40068f7344ee5b18059789a63838e", + "mean": -0.020482443273067474, + "std": 6.240891456604004, + "rms": 6.24092435836792, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c0b9631acb40c758db27b3c657b022e1a32a7c543badc7ad72c2f1250c9d862b", + "mean": -0.02303740754723549, + "std": 0.9114705920219421, + "rms": 0.9117616415023804, + "max_abs": 29.125 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "05e30499a61278e8a1580e692ebaf892f1af2034159f8ebc8694964001468bbc", + "mean": -0.020990317687392235, + "std": 5.894522666931152, + "rms": 5.89456033706665, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9976507425308228, + "min_cosine_similarity": 0.9910615682601929, + "mean_relative_l2": 0.06533306837081909, + "max_abs_delta": 1.0 + }, + "system_bos": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9957796931266785, + "min_cosine_similarity": 0.9792454838752747, + "mean_relative_l2": 0.08843706548213959, + "max_abs_delta": 1.625 + }, + "system_x": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9944701790809631, + "min_cosine_similarity": 0.979172945022583, + "mean_relative_l2": 0.10230481624603271, + "max_abs_delta": 2.125 + }, + "system_period": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9941882491111755, + "min_cosine_similarity": 0.978803277015686, + "mean_relative_l2": 0.10398813337087631, + "max_abs_delta": 1.625 + }, + "bos_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9946691989898682, + "min_cosine_similarity": 0.9712610244750977, + "mean_relative_l2": 0.09970330446958542, + "max_abs_delta": 2.25 + }, + "bos_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9940494894981384, + "min_cosine_similarity": 0.9807705283164978, + "mean_relative_l2": 0.10530418902635574, + "max_abs_delta": 3.25 + }, + "x_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9942705631256104, + "min_cosine_similarity": 0.9743239283561707, + "mean_relative_l2": 0.10311249643564224, + "max_abs_delta": 2.625 + }, + "x_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9913681149482727, + "min_cosine_similarity": 0.9699857831001282, + "mean_relative_l2": 0.1274145543575287, + "max_abs_delta": 3.5625 + }, + "period_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9943583607673645, + "min_cosine_similarity": 0.9773398637771606, + "mean_relative_l2": 0.10221947729587555, + "max_abs_delta": 2.4375 + }, + "period_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.991438090801239, + "min_cosine_similarity": 0.9665250778198242, + "mean_relative_l2": 0.1266496777534485, + "max_abs_delta": 4.125 + } + } + }, + "layer_18": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2e02acdfeddb4637ba12ec1a51665d809598797dca51f723cd18fc2becd2e5ca", + "mean": -0.02356138452887535, + "std": 1.066172480583191, + "rms": 1.0664327144622803, + "max_abs": 33.25 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9c0a7d898be664a4e406fd821542a6d4d00b6618bda4394e1cdcac6782909147", + "mean": -0.030376872047781944, + "std": 7.129125118255615, + "rms": 7.129190444946289, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "69a1ec488f4aef49cacda703b1dc53a5169b82fabb133400ca4ccc19a4f7a6a4", + "mean": -0.0233609676361084, + "std": 1.0643792152404785, + "rms": 1.0646356344223022, + "max_abs": 33.25 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e88d1d3116b16aad2261157cf9885dc2a97fb3f1bd0e18041e71ca6f94cd615a", + "mean": -0.030370617285370827, + "std": 6.94316291809082, + "rms": 6.9432291984558105, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6952a828baea4f5498d53ae2ea7954b822417e2f9ee17c306cd4f140c890b60d", + "mean": -0.0234221238642931, + "std": 1.0657885074615479, + "rms": 1.0660457611083984, + "max_abs": 33.5 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "331caea955911216343539b74cee9cfd90ca930a0462331a60b6f2635d23dee5", + "mean": -0.021465115249156952, + "std": 6.267117500305176, + "rms": 6.267154216766357, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "982b638d86eb491abc20c82aa237e93d636ced2af67e8a679754f10fefb9cb40", + "mean": -0.023875011131167412, + "std": 1.0629485845565796, + "rms": 1.0632166862487793, + "max_abs": 33.5 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e67d5957a9a22266d0ead7271375feda765f9559dc3605bdee501ee5d139adbe", + "mean": -0.021629033610224724, + "std": 5.921844005584717, + "rms": 5.921883583068848, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "386530f024546f56309b33ec9c0517b0fcae2aac4b871c5f5aff5e55ab3c81b9", + "mean": -0.024458030238747597, + "std": 1.06283438205719, + "rms": 1.0631158351898193, + "max_abs": 34.25 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d759fa3d5c3322127e795e4644060ec9943c32abb98d0937f37938e00c398e33", + "mean": -0.022577449679374695, + "std": 6.267087459564209, + "rms": 6.267127990722656, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4486b324a5d2ade393bf223ec8c59c2128f95b8f4aabb531a3a69a56d66f4f6d", + "mean": -0.025633765384554863, + "std": 1.0600476264953613, + "rms": 1.0603575706481934, + "max_abs": 34.0 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "334b083a55b15e09e9bfb383b23b7238a7228a9b4625185ac61e78894866e787", + "mean": -0.0229041650891304, + "std": 5.921689033508301, + "rms": 5.9217329025268555, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f2276c3a21b07d2b8e4f1e13d1b90da23b3109cecdf5d95246738ec50e1b24ff", + "mean": -0.02433539368212223, + "std": 1.064113974571228, + "rms": 1.06439208984375, + "max_abs": 34.0 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d2363964c8ae0f6e64c9ee9d316af26a57f439119bb49aa001c51f2cd144afaf", + "mean": -0.022186100482940674, + "std": 6.2669878005981445, + "rms": 6.267026901245117, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9a15389dd932d005537746df297e8c4733adf5d79193149b538732361a1f49c7", + "mean": -0.025350509211421013, + "std": 1.059181571006775, + "rms": 1.059484839439392, + "max_abs": 34.0 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "50217a94ba3c6f65fb4eee6788cca607624f6e879e90b8cc64c43d2f8b85332c", + "mean": -0.022421592846512794, + "std": 5.921361446380615, + "rms": 5.921403884887695, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.997767448425293, + "min_cosine_similarity": 0.9915263652801514, + "mean_relative_l2": 0.06357374787330627, + "max_abs_delta": 1.25 + }, + "system_bos": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9960147738456726, + "min_cosine_similarity": 0.9768258333206177, + "mean_relative_l2": 0.08541087061166763, + "max_abs_delta": 1.875 + }, + "system_x": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9946739673614502, + "min_cosine_similarity": 0.9795641899108887, + "mean_relative_l2": 0.09987909346818924, + "max_abs_delta": 2.375 + }, + "system_period": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9943424463272095, + "min_cosine_similarity": 0.9786133766174316, + "mean_relative_l2": 0.10225322097539902, + "max_abs_delta": 2.125 + }, + "bos_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9950990676879883, + "min_cosine_similarity": 0.9770044088363647, + "mean_relative_l2": 0.09557586163282394, + "max_abs_delta": 2.5 + }, + "bos_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9943913817405701, + "min_cosine_similarity": 0.9783557653427124, + "mean_relative_l2": 0.1017322912812233, + "max_abs_delta": 3.875 + }, + "x_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9948360323905945, + "min_cosine_similarity": 0.9810555577278137, + "mean_relative_l2": 0.09783085435628891, + "max_abs_delta": 2.875 + }, + "x_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9919102787971497, + "min_cosine_similarity": 0.9693634510040283, + "mean_relative_l2": 0.12265582382678986, + "max_abs_delta": 4.5 + }, + "period_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.994874119758606, + "min_cosine_similarity": 0.976268470287323, + "mean_relative_l2": 0.09718247503042221, + "max_abs_delta": 2.625 + }, + "period_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9918433427810669, + "min_cosine_similarity": 0.9617289304733276, + "mean_relative_l2": 0.12284308671951294, + "max_abs_delta": 5.25 + } + } + }, + "layer_19": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "86d5a7ef50279f6becce7e101e78d5c969fab81b7e81af19e917d5355a480f8b", + "mean": -0.025339210405945778, + "std": 1.1849663257598877, + "rms": 1.1852372884750366, + "max_abs": 31.875 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e8f17cd0f0093cfe28cc72251515596855a71764e450cf51ef03ed8040ad185f", + "mean": -0.0315546989440918, + "std": 7.144625663757324, + "rms": 7.144695281982422, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c245e0d319c87dd2e41961aa7a7542e8000b455a0ec6b43c3813df7535530d06", + "mean": -0.02500789985060692, + "std": 1.1837427616119385, + "rms": 1.184006929397583, + "max_abs": 32.75 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "68ab98b2825710dae02857dcbab25301ac9ac0d7d61f40edf8dd496da352f544", + "mean": -0.031001143157482147, + "std": 6.959766387939453, + "rms": 6.959835052490234, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "78b5336f2fcaa5f8f92badf89041ddf19d02f64a051a9551d5c962128586d270", + "mean": -0.025279659777879715, + "std": 1.1855947971343994, + "rms": 1.1858643293380737, + "max_abs": 30.25 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "dbad56a32314f22decaada481fba095c40a1a68c7aab56ea3e68cd9c9e253d6e", + "mean": -0.02286696806550026, + "std": 6.285197734832764, + "rms": 6.285239219665527, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "22351cdc0fff426c235c9f068f6365aaf60d0757479efafb3098c6447cc4e5e9", + "mean": -0.025770191103219986, + "std": 1.1823428869247437, + "rms": 1.1826236248016357, + "max_abs": 30.5 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c9eccbd8b7d0bd3953224f23a300cc8c615368ddba06d81ffa7e740bcbb3aa5d", + "mean": -0.02249821648001671, + "std": 5.941118240356445, + "rms": 5.941160678863525, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "087ef6af9e6403e130b3eb5d24db5b67042131781fc51cac8b31c1721c214725", + "mean": -0.026194659993052483, + "std": 1.1815863847732544, + "rms": 1.1818766593933105, + "max_abs": 29.75 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f97913a617d614e5b241a652f4b7460b32b0197e771e27211f4e65fee3549dd0", + "mean": -0.023746469989418983, + "std": 6.2851667404174805, + "rms": 6.285211086273193, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cf63ce54e765fd454364e7abb5da5032be67e5877cdcc81b15037c31ed436e4f", + "mean": -0.02748335897922516, + "std": 1.1787025928497314, + "rms": 1.179023027420044, + "max_abs": 30.875 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0e86bc5c15bd22d91a402035bc78181486401d65bcfb74f1f529210ce3557607", + "mean": -0.023607676848769188, + "std": 5.940836429595947, + "rms": 5.940883159637451, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "996ce0c00ecfe9f977d1ba101a033a47f932cae92b439329152ac1b40fcecf7b", + "mean": -0.026245711371302605, + "std": 1.183884859085083, + "rms": 1.184175729751587, + "max_abs": 30.375 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "831bd0b437ee8126f401ad966a625d19f88f6f6d0f3182ae5d94507ee356068b", + "mean": -0.02362382784485817, + "std": 6.285150527954102, + "rms": 6.2851948738098145, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "491cd2475ad478120401fbd7224a881be0b7773c14ec9a429ef8906bc1483356", + "mean": -0.027157112956047058, + "std": 1.1792913675308228, + "rms": 1.179603934288025, + "max_abs": 31.0 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "16c1b0c8343628cbe802436f0bd972654b446eee1b9ded60b967e4d73ecef71f", + "mean": -0.02320409007370472, + "std": 5.940777778625488, + "rms": 5.940823554992676, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9977580308914185, + "min_cosine_similarity": 0.9908620119094849, + "mean_relative_l2": 0.06386473029851913, + "max_abs_delta": 1.25 + }, + "system_bos": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9960338473320007, + "min_cosine_similarity": 0.9723469018936157, + "mean_relative_l2": 0.08522384613752365, + "max_abs_delta": 2.125 + }, + "system_x": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9946581125259399, + "min_cosine_similarity": 0.9814339876174927, + "mean_relative_l2": 0.10011856257915497, + "max_abs_delta": 2.375 + }, + "system_period": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9943397641181946, + "min_cosine_similarity": 0.9744046330451965, + "mean_relative_l2": 0.10198985040187836, + "max_abs_delta": 2.875 + }, + "bos_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.995126485824585, + "min_cosine_similarity": 0.9803434014320374, + "mean_relative_l2": 0.09556478261947632, + "max_abs_delta": 2.75 + }, + "bos_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9943177700042725, + "min_cosine_similarity": 0.9743464589118958, + "mean_relative_l2": 0.10255378484725952, + "max_abs_delta": 4.125 + }, + "x_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9947994947433472, + "min_cosine_similarity": 0.9811888337135315, + "mean_relative_l2": 0.09839286655187607, + "max_abs_delta": 3.0 + }, + "x_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9918394088745117, + "min_cosine_similarity": 0.9706288576126099, + "mean_relative_l2": 0.1229497566819191, + "max_abs_delta": 4.5 + }, + "period_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9948434829711914, + "min_cosine_similarity": 0.9704583883285522, + "mean_relative_l2": 0.09754309803247452, + "max_abs_delta": 2.75 + }, + "period_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.991756796836853, + "min_cosine_similarity": 0.9560244679450989, + "mean_relative_l2": 0.12334685027599335, + "max_abs_delta": 5.25 + } + } + }, + "layer_20": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7d72caa627e6365f5a38d491ade07ba39895cd2dd6fa96ce5bf65d46901b21e8", + "mean": -0.02687295340001583, + "std": 1.3818074464797974, + "rms": 1.3820686340332031, + "max_abs": 40.0 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1cc7b67b3c0fd71f123c93ee82508806a3618a96a705a4b118ea879af8b25059", + "mean": -0.03292310982942581, + "std": 7.3868584632873535, + "rms": 7.386931896209717, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "262088d745c0c441417f950ed8dec459ff1a4cf0a3eff533da9d3a2e60fc2e93", + "mean": -0.02642110548913479, + "std": 1.3814629316329956, + "rms": 1.3817155361175537, + "max_abs": 40.0 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e3ceec0d87fecbad6656ad2f92f35b8a22672728b160e77b264ef1d4ef8545d1", + "mean": -0.032141901552677155, + "std": 7.206895351409912, + "rms": 7.206966876983643, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "db8118d42c8a769eefb882c3f4e5ba1e4b46f24db27ddeabcae5e2bc42134807", + "mean": -0.026743654161691666, + "std": 1.3801056146621704, + "rms": 1.3803646564483643, + "max_abs": 39.5 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1fcdc1dde49ff1968d986e081cd2c7e66d2ccb84973865713c212bd261f413aa", + "mean": -0.024641426280140877, + "std": 6.322779178619385, + "rms": 6.322826862335205, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7b9dd74eca92b6d8865934198edac0959a22262a653fc66db7dbb670d25da601", + "mean": -0.027297304943203926, + "std": 1.3788191080093384, + "rms": 1.37908935546875, + "max_abs": 40.25 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9a572d7432c034ffa4d1df73817ff20df1f78e48b9e7aa0fdad626bc0b482c22", + "mean": -0.024052515625953674, + "std": 5.980731964111328, + "rms": 5.980780124664307, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "69b309dedd79f0c5355c1fa91c002444d6b7120ab7f2ff5d270d4ba2b957c7c0", + "mean": -0.028190527111291885, + "std": 1.375437617301941, + "rms": 1.3757264614105225, + "max_abs": 39.25 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "25fadc294f80c3e3e104d9f17fbbac703bbd08c9012dbce348335ace7810f96c", + "mean": -0.02596956677734852, + "std": 6.322803974151611, + "rms": 6.322856903076172, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4c325ce15300674b6405a696606854c9126d301d2d27428b13cd8887cbc3c5c2", + "mean": -0.029382148757576942, + "std": 1.3743029832839966, + "rms": 1.3746169805526733, + "max_abs": 39.75 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d5e876f2f9138b68339c726e9dbb87cca0c07251f41f1991d0ce948c50f97059", + "mean": -0.025448257103562355, + "std": 5.980443000793457, + "rms": 5.980497360229492, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e716a37310a36b6bea48d48e452030ebb0d084143a18c25188dddf18666d932c", + "mean": -0.027745481580495834, + "std": 1.3792273998260498, + "rms": 1.3795064687728882, + "max_abs": 39.5 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9c1b23f5e757f306a96b96e67dbeddfd5e047293fa232d21b0e4388307af4de1", + "mean": -0.025349579751491547, + "std": 6.322981357574463, + "rms": 6.323031902313232, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0cdbd3b0b50e18073098ce5ff818edd11c8c4923d6c16079fb87d226e941fac4", + "mean": -0.029354695230722427, + "std": 1.3757091760635376, + "rms": 1.3760223388671875, + "max_abs": 39.75 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5a8fb4aa9f0754d9a9c37c0dfbb4e214ef38ba18c2ccf323452352ba5c5cbd01", + "mean": -0.02523195743560791, + "std": 5.980459213256836, + "rms": 5.980511665344238, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9978433847427368, + "min_cosine_similarity": 0.9887330532073975, + "mean_relative_l2": 0.0626230537891388, + "max_abs_delta": 1.25 + }, + "system_bos": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9963012337684631, + "min_cosine_similarity": 0.9713046550750732, + "mean_relative_l2": 0.08196526765823364, + "max_abs_delta": 2.25 + }, + "system_x": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.994713306427002, + "min_cosine_similarity": 0.9819066524505615, + "mean_relative_l2": 0.09914759546518326, + "max_abs_delta": 2.25 + }, + "system_period": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9943705201148987, + "min_cosine_similarity": 0.9735732078552246, + "mean_relative_l2": 0.10132433474063873, + "max_abs_delta": 2.375 + }, + "bos_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9955223202705383, + "min_cosine_similarity": 0.9811677932739258, + "mean_relative_l2": 0.09159044176340103, + "max_abs_delta": 3.125 + }, + "bos_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9946624636650085, + "min_cosine_similarity": 0.9745088219642639, + "mean_relative_l2": 0.09918281435966492, + "max_abs_delta": 4.625 + }, + "x_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9952043294906616, + "min_cosine_similarity": 0.9812189340591431, + "mean_relative_l2": 0.09471902996301651, + "max_abs_delta": 3.25 + }, + "x_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9918688535690308, + "min_cosine_similarity": 0.9682328701019287, + "mean_relative_l2": 0.12234635651111603, + "max_abs_delta": 4.875 + }, + "period_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9953359365463257, + "min_cosine_similarity": 0.9708144664764404, + "mean_relative_l2": 0.09269281476736069, + "max_abs_delta": 3.0 + }, + "period_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9919679164886475, + "min_cosine_similarity": 0.9574152827262878, + "mean_relative_l2": 0.12131954729557037, + "max_abs_delta": 5.0 + } + } + }, + "layer_21": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "09e6ee4b4c7b51727ee42c2fb0598c70f6db017ee78d48bfbb51b6bd21702b6e", + "mean": -0.03344935178756714, + "std": 1.5256015062332153, + "rms": 1.5259681940078735, + "max_abs": 51.75 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "649577b1775b6ea203887890bca0867fdc7c62011f67853fe64b3eafc7b445c0", + "mean": -0.03785667568445206, + "std": 7.47972297668457, + "rms": 7.479818820953369, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6aec2e1b08fe3a98dac5627cb62e898f5892fd062b9626a0ef9ba6ce5c12d5c2", + "mean": -0.033067528158426285, + "std": 1.5249528884887695, + "rms": 1.5253113508224487, + "max_abs": 51.75 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "75b9f277035ed6680727d92eec52e51865fb47bca7807056444b7dd93877adc7", + "mean": -0.03610968589782715, + "std": 7.294979572296143, + "rms": 7.295068740844727, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4494294562773c5b56d4079a3f8e1e125462031ba646f3cad65b11badcc82ead", + "mean": -0.03350058197975159, + "std": 1.5253336429595947, + "rms": 1.5257015228271484, + "max_abs": 50.5 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a38e83f89bbb55336645cf42af50445b47c6c01da55e187930a8e15b019970ce", + "mean": -0.02960285171866417, + "std": 6.339300632476807, + "rms": 6.339369297027588, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "38a73aa5e40d5b43a0b653ee01f32b4d8d109aae17911ab678d140c96605bc16", + "mean": -0.033886343240737915, + "std": 1.5206103324890137, + "rms": 1.520987868309021, + "max_abs": 51.5 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3760bb45017b97dc9288a80f3d07a6bd71ee25c78696b8fa4ee00f55a89a6739", + "mean": -0.02793193981051445, + "std": 6.001340866088867, + "rms": 6.001405715942383, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7cd99844475a66f85b716492478fec4e49cea2746988456e86c7173de5b912e3", + "mean": -0.035433150827884674, + "std": 1.5198777914047241, + "rms": 1.520290732383728, + "max_abs": 50.75 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4f6253f40a1965cd536d276ef69d888fa8e936d748b6cd69e24c5a1d2eced5ad", + "mean": -0.03132150322198868, + "std": 6.339505672454834, + "rms": 6.339582443237305, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6677e78ea64a777094a799cca31908c541b2432a33d8e1f2020ce0d7b112b379", + "mean": -0.037206169217824936, + "std": 1.518493413925171, + "rms": 1.5189491510391235, + "max_abs": 51.5 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4abc7336861c6a3748aa9683c55700b85c933c1a332d380b2dcb669bbcb653ea", + "mean": -0.03055484965443611, + "std": 6.0021162033081055, + "rms": 6.002193450927734, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "241431a546615d39743080b212e24c2c6ffb0582586fc8dccdcba438f6e86b2b", + "mean": -0.03487040847539902, + "std": 1.5234835147857666, + "rms": 1.523882508277893, + "max_abs": 51.0 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "20e7bd987c5ef4209f3c227acdfe9c7e4bc28f851f254d82ccd420fdb9f5926a", + "mean": -0.030688347294926643, + "std": 6.339355945587158, + "rms": 6.339430809020996, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6c52c13d8237d8bb19e31a2da766b3f03e85f0b0f07bb630656305bec5f46f82", + "mean": -0.03713497146964073, + "std": 1.5194467306137085, + "rms": 1.5199004411697388, + "max_abs": 51.0 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c5607b3ba2233a074ae404f90607aa6fe139ecb16e684680158287060d13a590", + "mean": -0.03016648255288601, + "std": 6.001461505889893, + "rms": 6.001537322998047, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.997669517993927, + "min_cosine_similarity": 0.9862689971923828, + "mean_relative_l2": 0.06509029120206833, + "max_abs_delta": 1.75 + }, + "system_bos": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9961757063865662, + "min_cosine_similarity": 0.9703007340431213, + "mean_relative_l2": 0.08317994326353073, + "max_abs_delta": 2.25 + }, + "system_x": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9941377639770508, + "min_cosine_similarity": 0.979863166809082, + "mean_relative_l2": 0.10402756184339523, + "max_abs_delta": 2.75 + }, + "system_period": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9938863515853882, + "min_cosine_similarity": 0.9717841148376465, + "mean_relative_l2": 0.10527835786342621, + "max_abs_delta": 2.5 + }, + "bos_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9954992532730103, + "min_cosine_similarity": 0.980961799621582, + "mean_relative_l2": 0.09218034148216248, + "max_abs_delta": 3.25 + }, + "bos_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.994515597820282, + "min_cosine_similarity": 0.9723063111305237, + "mean_relative_l2": 0.10050778836011887, + "max_abs_delta": 4.625 + }, + "x_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9951647520065308, + "min_cosine_similarity": 0.9801027178764343, + "mean_relative_l2": 0.09551329165697098, + "max_abs_delta": 3.0 + }, + "x_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9913156628608704, + "min_cosine_similarity": 0.9660736918449402, + "mean_relative_l2": 0.12646910548210144, + "max_abs_delta": 4.75 + }, + "period_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9953747987747192, + "min_cosine_similarity": 0.9703736305236816, + "mean_relative_l2": 0.09256309270858765, + "max_abs_delta": 2.625 + }, + "period_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9916186928749084, + "min_cosine_similarity": 0.9548677206039429, + "mean_relative_l2": 0.12354820966720581, + "max_abs_delta": 5.125 + } + } + }, + "layer_22": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4a24859400c49edee9ad8e01e3f9b8d765c66af30f13ca91efcdf67d52c1ff1c", + "mean": -0.043746188282966614, + "std": 1.8034594058990479, + "rms": 1.8039900064468384, + "max_abs": 65.0 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "73b1261fce117b31e2924474fe5c4f8baa6379dcb175cb1b47d5d8eda8852041", + "mean": -0.046458687633275986, + "std": 7.535338401794434, + "rms": 7.5354814529418945, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4c8a4299678010acd6fc4854a260984a93799ddc6500a1bd300f7e9508617f19", + "mean": -0.042826391756534576, + "std": 1.8040043115615845, + "rms": 1.804512619972229, + "max_abs": 65.0 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f50fcd5c8fd858f41a2c8ff22a3c2af7ae789eecf071b45a1b029961a7514abb", + "mean": -0.04360527917742729, + "std": 7.353886127471924, + "rms": 7.354015350341797, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9871edc3a24523bf170e2902877e351543ad26d731f0e6736a8c765980947640", + "mean": -0.043671123683452606, + "std": 1.8019202947616577, + "rms": 1.8024494647979736, + "max_abs": 64.5 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "46cc864ec1d21fedc18d714e7f9de8d5c18986b734261abbbf58912b2568813b", + "mean": -0.03812864050269127, + "std": 6.404855251312256, + "rms": 6.40496826171875, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e459523937c3318d234424f67e0cb2c033a07c1fdab3b490b8509459f3891596", + "mean": -0.043605826795101166, + "std": 1.7976150512695312, + "rms": 1.798143744468689, + "max_abs": 64.5 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e6b43c929b5a3b5937a9bd284a2e4dca74d3e9090ac796bdfa40d061aec9e7e2", + "mean": -0.035332415252923965, + "std": 6.072697639465332, + "rms": 6.072800159454346, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0b6115e45dc69c3378033e2f6ff9783994cef92b7361d0372a9d7de647f18ef1", + "mean": -0.04628836363554001, + "std": 1.8007621765136719, + "rms": 1.8013569116592407, + "max_abs": 65.0 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "852dda01e5d03b8bc664c25b878296e67618affc3379b44f691134e42468fc20", + "mean": -0.040350526571273804, + "std": 6.4061689376831055, + "rms": 6.4062957763671875, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7b43ec1e682b89c0eb9263271880fda35cd430aa45ce2d0d95323b28cfff595e", + "mean": -0.04758232459425926, + "std": 1.7985875606536865, + "rms": 1.7992167472839355, + "max_abs": 65.0 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b1e724fd9e604da383b7a70b1c3ba993869ce46aad9ab14be44d1f0a7d14edb7", + "mean": -0.038333673030138016, + "std": 6.074484825134277, + "rms": 6.074605464935303, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ad723d2bf96fecd7e3b5527cf7840285c723847ab05eeeddd97121ae79ebf946", + "mean": -0.045263223350048065, + "std": 1.8025704622268677, + "rms": 1.8031386137008667, + "max_abs": 65.0 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e75947838574178c3039362d55540e40a04b705322cbef7825a3bd83cbfb5daf", + "mean": -0.03937338665127754, + "std": 6.405615329742432, + "rms": 6.405735969543457, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "172cb056398c366bc5a56e55dc0b41e6023f1237da3ad95f185eb234b03a7845", + "mean": -0.04714566469192505, + "std": 1.7999598979949951, + "rms": 1.800577163696289, + "max_abs": 64.5 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2f85994ace7ebb81ec11bcbcd39505ef4abc96ee25ec8ae82005f70560712814", + "mean": -0.037719059735536575, + "std": 6.073733806610107, + "rms": 6.073851108551025, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9977244138717651, + "min_cosine_similarity": 0.9888207316398621, + "mean_relative_l2": 0.064309261739254, + "max_abs_delta": 2.0 + }, + "system_bos": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9962634444236755, + "min_cosine_similarity": 0.966613233089447, + "mean_relative_l2": 0.08183081448078156, + "max_abs_delta": 2.75 + }, + "system_x": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9943161606788635, + "min_cosine_similarity": 0.9771530628204346, + "mean_relative_l2": 0.10141521692276001, + "max_abs_delta": 2.75 + }, + "system_period": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9940476417541504, + "min_cosine_similarity": 0.9699365496635437, + "mean_relative_l2": 0.10283442586660385, + "max_abs_delta": 2.875 + }, + "bos_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9956839680671692, + "min_cosine_similarity": 0.9806397557258606, + "mean_relative_l2": 0.08980875462293625, + "max_abs_delta": 3.75 + }, + "bos_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9947959184646606, + "min_cosine_similarity": 0.9701153039932251, + "mean_relative_l2": 0.09738870710134506, + "max_abs_delta": 4.625 + }, + "x_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9953495264053345, + "min_cosine_similarity": 0.979823887348175, + "mean_relative_l2": 0.09370769560337067, + "max_abs_delta": 2.875 + }, + "x_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9916401505470276, + "min_cosine_similarity": 0.9674439430236816, + "mean_relative_l2": 0.12341520935297012, + "max_abs_delta": 5.25 + }, + "period_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9956022500991821, + "min_cosine_similarity": 0.9703953266143799, + "mean_relative_l2": 0.0902918130159378, + "max_abs_delta": 2.25 + }, + "period_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9919978976249695, + "min_cosine_similarity": 0.9591995477676392, + "mean_relative_l2": 0.12012293934822083, + "max_abs_delta": 5.5 + } + } + }, + "layer_23": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d552d075e2174f5794d282648de1199e99cee36a3267075131b76f1f346a892c", + "mean": -0.05928533524274826, + "std": 2.2231757640838623, + "rms": 2.223966121673584, + "max_abs": 91.5 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ca4ba3e0bdf397089a3725998a4759273fb81643475c8e00cac384e58ce88a98", + "mean": -0.059070199728012085, + "std": 7.608714580535889, + "rms": 7.608943939208984, + "max_abs": 1160.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f8dc5263f7bab02990521d1fac5bd332f8154406543cafb56813650c59ce3d34", + "mean": -0.05864885076880455, + "std": 2.2247166633605957, + "rms": 2.225489616394043, + "max_abs": 93.0 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "09c776c9eeed2989e1eecf3edc9e72d2d662e1c58214edc378ce7917bef971c7", + "mean": -0.05416536703705788, + "std": 7.4311652183532715, + "rms": 7.431363105773926, + "max_abs": 1160.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "dedace2060a98927bd24851098937216160b56b113dd307743afe1daf0d0f939", + "mean": -0.059288352727890015, + "std": 2.2176618576049805, + "rms": 2.218454122543335, + "max_abs": 95.0 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f9f8cbb95d4903081825bd1a85c03959544529ef8645a558dbf128862ca1edf8", + "mean": -0.05087801814079285, + "std": 6.498650550842285, + "rms": 6.498849391937256, + "max_abs": 1160.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ea3407015369d6e9127bf52eae39903239d2a8a70016f400a7285e7e7944f8a1", + "mean": -0.059836868196725845, + "std": 2.215859889984131, + "rms": 2.216667652130127, + "max_abs": 93.5 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2e7ae08a2b9438ef5e173ed12211d0f44361f4fd51cc9910170384ae49c41e1f", + "mean": -0.04632950946688652, + "std": 6.176595687866211, + "rms": 6.176769733428955, + "max_abs": 1160.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c072e613e6352627b6f8ff914d3181a27c0dc980ad0aaec274a9ffa0b84b5aad", + "mean": -0.061811190098524094, + "std": 2.2208707332611084, + "rms": 2.2217307090759277, + "max_abs": 94.0 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9310fc7536f63b50b373ea3635a87f30d9996c97b54fca4f0de11159ee63081d", + "mean": -0.05283597484230995, + "std": 6.502445697784424, + "rms": 6.502660274505615, + "max_abs": 1160.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fee25da8eba5d2ba95662b9d1f762c037b7591d420e55e415472406657a44ac4", + "mean": -0.06353885680437088, + "std": 2.2173986434936523, + "rms": 2.218308687210083, + "max_abs": 94.0 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "995a439da93c3964858e205c7d01f885e1d23756221a29b7468f851e7856d744", + "mean": -0.04914817214012146, + "std": 6.179977893829346, + "rms": 6.180172443389893, + "max_abs": 1160.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a8ae18a138a15fa08e472a0d3b106b06444515fcb3dce5718d77c7815f7e5e44", + "mean": -0.061072319746017456, + "std": 2.221219062805176, + "rms": 2.2220582962036133, + "max_abs": 94.0 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4b97e13af697f1f5a4932dac12ceee498795787aac620c3a3927875d469eaa30", + "mean": -0.052362583577632904, + "std": 6.500639915466309, + "rms": 6.500850677490234, + "max_abs": 1160.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2672e02b9d6561526ac730df2749308031baf8392217cab49239e20843b512d3", + "mean": -0.06318173557519913, + "std": 2.219033718109131, + "rms": 2.219933032989502, + "max_abs": 95.0 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f28a798d8180f98284f05559448eebe414961227e135e5a91fb098ea77a534a0", + "mean": -0.048581767827272415, + "std": 6.1787214279174805, + "rms": 6.17891263961792, + "max_abs": 1160.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9980285167694092, + "min_cosine_similarity": 0.9919068217277527, + "mean_relative_l2": 0.05999017134308815, + "max_abs_delta": 2.25 + }, + "system_bos": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9968457221984863, + "min_cosine_similarity": 0.9746330976486206, + "mean_relative_l2": 0.07557851076126099, + "max_abs_delta": 3.0 + }, + "system_x": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9950974583625793, + "min_cosine_similarity": 0.9782869219779968, + "mean_relative_l2": 0.09406274557113647, + "max_abs_delta": 3.5 + }, + "system_period": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9948263168334961, + "min_cosine_similarity": 0.9691611528396606, + "mean_relative_l2": 0.09557238966226578, + "max_abs_delta": 4.0 + }, + "bos_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9963443875312805, + "min_cosine_similarity": 0.9833729267120361, + "mean_relative_l2": 0.08282667398452759, + "max_abs_delta": 3.5 + }, + "bos_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9955887198448181, + "min_cosine_similarity": 0.9749062657356262, + "mean_relative_l2": 0.08984969556331635, + "max_abs_delta": 4.5 + }, + "x_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.995986819267273, + "min_cosine_similarity": 0.9836500883102417, + "mean_relative_l2": 0.08716931194067001, + "max_abs_delta": 3.75 + }, + "x_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.992880642414093, + "min_cosine_similarity": 0.9712978005409241, + "mean_relative_l2": 0.11381848901510239, + "max_abs_delta": 6.0 + }, + "period_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9962748885154724, + "min_cosine_similarity": 0.977013111114502, + "mean_relative_l2": 0.08333688974380493, + "max_abs_delta": 3.0 + }, + "period_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9931778907775879, + "min_cosine_similarity": 0.9650478959083557, + "mean_relative_l2": 0.11078757792711258, + "max_abs_delta": 6.0 + } + } + }, + "layer_24": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "246b5375e15eb006eb861117a61710af2d781771e09c5864e0ee6ceffdd4012e", + "mean": -0.07381024211645126, + "std": 2.701780080795288, + "rms": 2.7027878761291504, + "max_abs": 116.0 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "aa0f3e14368ca637c21b004ceb601378c79790a5a190134ab034859e9ca85978", + "mean": -0.07203720510005951, + "std": 7.292396545410156, + "rms": 7.292752742767334, + "max_abs": 1008.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2080af6de8003dd9a146344e0ecb655db9b9041620bc32feb841282e825336c3", + "mean": -0.07339729368686676, + "std": 2.70308780670166, + "rms": 2.7040839195251465, + "max_abs": 118.0 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fb04d3a2d3ba9d76fe221f916c527fc6e2a58601ae59321a5674c43ec316fc34", + "mean": -0.06565237045288086, + "std": 7.3376264572143555, + "rms": 7.337920188903809, + "max_abs": 1120.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7ceefdca7dbf7750acbd0dea3c47c71f255568dd11305e0ced4f6fdcbddc6f9c", + "mean": -0.07376959919929504, + "std": 2.6951193809509277, + "rms": 2.6961288452148438, + "max_abs": 119.0 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "66babf75be097cb7d9e880167584d9a4db4a78c3e6a1f79e3bfd9f42628e1858", + "mean": -0.06271377950906754, + "std": 4.910208225250244, + "rms": 4.910608291625977, + "max_abs": 840.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a3e338ad5566112614fbf822b2c6f49dce464820eaa6c3e25b764af24ab847a5", + "mean": -0.07464949786663055, + "std": 2.6925833225250244, + "rms": 2.693617820739746, + "max_abs": 117.0 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6cd0732f4ebf3ec8727efd08d6a333d9f075447bbc0970a3f2e9835fe4c1851c", + "mean": -0.05676497146487236, + "std": 4.727226257324219, + "rms": 4.727567195892334, + "max_abs": 840.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "420726c34d09294564d414f0081a9969a0cd9a9bd417fda2309aad2a549ff312", + "mean": -0.07617975771427155, + "std": 2.700382709503174, + "rms": 2.7014570236206055, + "max_abs": 117.0 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "913a2fc18d1c22f599f1a5949652cc9a8cdbfdedbe60d69dff1340a4d10a68a1", + "mean": -0.06480672210454941, + "std": 4.917520999908447, + "rms": 4.917947769165039, + "max_abs": 840.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6f63192192ea18d433834bea79067832917a133c1319c9613780c0a8e32030e0", + "mean": -0.07756505161523819, + "std": 2.6968321800231934, + "rms": 2.6979475021362305, + "max_abs": 117.5 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "aef34c987479c6fad0726f05fc37cca60b652baf91ab46bcc8a42fe7e2a2fe4e", + "mean": -0.059335824102163315, + "std": 4.734389781951904, + "rms": 4.734761714935303, + "max_abs": 840.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "be67f280ff52f04e2c84b1fc436b463c011e15022f4865dfc82630a411c868d0", + "mean": -0.07557377964258194, + "std": 2.699242353439331, + "rms": 2.7003002166748047, + "max_abs": 117.0 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0b36af0e242e50fc5ffcfd8a9822cc49e66a1e4370c22b24b569061b5901d882", + "mean": -0.06428099423646927, + "std": 4.9143900871276855, + "rms": 4.9148101806640625, + "max_abs": 840.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "361194f273497e3a1261961f7d4218c80ef2333b751e5b8ab7313594497cdec0", + "mean": -0.07735750824213028, + "std": 2.6983063220977783, + "rms": 2.6994149684906006, + "max_abs": 118.5 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ff6b3f9caff1f84bd4142129f082f9f8523c8e84f2c1f170260ba444c7494580", + "mean": -0.05864370986819267, + "std": 4.732210636138916, + "rms": 4.732573986053467, + "max_abs": 840.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9983025789260864, + "min_cosine_similarity": 0.9938017725944519, + "mean_relative_l2": 0.05580355226993561, + "max_abs_delta": 2.0 + }, + "system_bos": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9973087906837463, + "min_cosine_similarity": 0.9793431758880615, + "mean_relative_l2": 0.06982332468032837, + "max_abs_delta": 3.0 + }, + "system_x": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9958130717277527, + "min_cosine_similarity": 0.9798667430877686, + "mean_relative_l2": 0.08683108538389206, + "max_abs_delta": 3.0 + }, + "system_period": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9956204295158386, + "min_cosine_similarity": 0.9737493395805359, + "mean_relative_l2": 0.08786649256944656, + "max_abs_delta": 4.5 + }, + "bos_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9968873262405396, + "min_cosine_similarity": 0.9867760539054871, + "mean_relative_l2": 0.07647384703159332, + "max_abs_delta": 4.0 + }, + "bos_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9962208867073059, + "min_cosine_similarity": 0.9788992404937744, + "mean_relative_l2": 0.0828598141670227, + "max_abs_delta": 4.5 + }, + "x_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9964933395385742, + "min_cosine_similarity": 0.9858922362327576, + "mean_relative_l2": 0.08138810098171234, + "max_abs_delta": 5.25 + }, + "x_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9938487410545349, + "min_cosine_similarity": 0.9691653847694397, + "mean_relative_l2": 0.10553787648677826, + "max_abs_delta": 7.75 + }, + "period_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9967391490936279, + "min_cosine_similarity": 0.9811182022094727, + "mean_relative_l2": 0.0778583437204361, + "max_abs_delta": 3.5 + }, + "period_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9941608309745789, + "min_cosine_similarity": 0.9647791385650635, + "mean_relative_l2": 0.10225702822208405, + "max_abs_delta": 7.75 + } + } + }, + "layer_25": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "278743765f034424e1cfff75ffa2a5d9e678b0baee57a93b3a1e441988ec5441", + "mean": -0.11768342554569244, + "std": 3.621800184249878, + "rms": 3.623711347579956, + "max_abs": 166.0 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "13e7260cccf90fca688094bf5eb738a0883af8288770e9f6d91e354791726ebc", + "mean": -0.1104610338807106, + "std": 6.091772079467773, + "rms": 6.0927734375, + "max_abs": 872.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d07a3d28a6bfba208c855e4e92af261ca585bbf161c576bb5ad405314f09f407", + "mean": -0.11546164005994797, + "std": 3.6196208000183105, + "rms": 3.621461868286133, + "max_abs": 168.0 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5586ea42d83638f30d0aa4cad1667babbb2bb415c6ac2d2f8ba6ec413074a779", + "mean": -0.10005216300487518, + "std": 6.271531581878662, + "rms": 6.272329330444336, + "max_abs": 984.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "020fa01adad7e394a863127116d49715283d527768f3719bde9cc68b1657395b", + "mean": -0.11874376982450485, + "std": 3.613858938217163, + "rms": 3.615809202194214, + "max_abs": 168.0 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2913a1326b99329f790fde2596b1228c50c81552fa658ac1ad6da1c2e796d1b2", + "mean": -0.10143798589706421, + "std": 3.746861457824707, + "rms": 3.7482340335845947, + "max_abs": 248.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6450cb21414521f0692ad8e2b4ab0134817832101edfea427c198cd595f7be35", + "mean": -0.11888296157121658, + "std": 3.612543821334839, + "rms": 3.61449933052063, + "max_abs": 166.0 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "717fcc6985250fcb534943e8693efc05914b13e83fbbd0b01a6f20fd5fb9385f", + "mean": -0.09213163703680038, + "std": 3.7440457344055176, + "rms": 3.7451791763305664, + "max_abs": 248.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f5805766c189db60ec86c21282dea559e570d4a4ca94fd20eb8ce1acbd62d0c7", + "mean": -0.12108665704727173, + "std": 3.6235344409942627, + "rms": 3.6255569458007812, + "max_abs": 166.0 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0c3278503800a2003c9d223ab1fb7a5b69e14213c1f8a589d79beb325c0aca9a", + "mean": -0.10389328747987747, + "std": 3.7660763263702393, + "rms": 3.7675092220306396, + "max_abs": 248.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "512a96b3a4808237e083a693a8b1326516283601e59a4246ca866f2395becd88", + "mean": -0.12032942473888397, + "std": 3.6169352531433105, + "rms": 3.61893630027771, + "max_abs": 168.0 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "116a5c83959358a881e2d300e9e063eb388f0792849e12881f38307f6b13de03", + "mean": -0.0933915451169014, + "std": 3.757869005203247, + "rms": 3.7590293884277344, + "max_abs": 248.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5043348a26b6fffe4de300ea45e772e07dc1c1c88dd9a97f82913b55cb1d5a1c", + "mean": -0.12017322331666946, + "std": 3.621234655380249, + "rms": 3.623228073120117, + "max_abs": 166.0 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "72cb58d9587b449adaf4b67fff4fdc499c22842519380d7676013d45126b50c9", + "mean": -0.10281259566545486, + "std": 3.758190870285034, + "rms": 3.759596824645996, + "max_abs": 248.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f51e112a9f9b4e216d11be83b297a9575772623e690fbd4bddd220a38d5171e5", + "mean": -0.12054824829101562, + "std": 3.6201632022857666, + "rms": 3.6221694946289062, + "max_abs": 167.0 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "94d8012c34b3883289b2cd7b3611721a0808cbd0685faeda86bea1d9eb711818", + "mean": -0.09299915283918381, + "std": 3.7544593811035156, + "rms": 3.755610704421997, + "max_abs": 248.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9987584352493286, + "min_cosine_similarity": 0.9948996305465698, + "mean_relative_l2": 0.04764914885163307, + "max_abs_delta": 5.0 + }, + "system_bos": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9981086850166321, + "min_cosine_similarity": 0.9871747493743896, + "mean_relative_l2": 0.05850007385015488, + "max_abs_delta": 4.5 + }, + "system_x": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9968609809875488, + "min_cosine_similarity": 0.9803997278213501, + "mean_relative_l2": 0.07468672841787338, + "max_abs_delta": 12.5 + }, + "system_period": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9967651963233948, + "min_cosine_similarity": 0.9762740135192871, + "mean_relative_l2": 0.075280100107193, + "max_abs_delta": 11.75 + }, + "bos_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9978373646736145, + "min_cosine_similarity": 0.9904502630233765, + "mean_relative_l2": 0.06370772421360016, + "max_abs_delta": 6.0 + }, + "bos_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9973310232162476, + "min_cosine_similarity": 0.9812362194061279, + "mean_relative_l2": 0.06935401260852814, + "max_abs_delta": 9.0625 + }, + "x_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9975534081459045, + "min_cosine_similarity": 0.9892224073410034, + "mean_relative_l2": 0.0680345669388771, + "max_abs_delta": 7.0 + }, + "x_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9956544637680054, + "min_cosine_similarity": 0.9739859104156494, + "mean_relative_l2": 0.08876188844442368, + "max_abs_delta": 9.5 + }, + "period_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9977353811264038, + "min_cosine_similarity": 0.9882178902626038, + "mean_relative_l2": 0.06484556943178177, + "max_abs_delta": 6.0 + }, + "period_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9958962202072144, + "min_cosine_similarity": 0.9768168926239014, + "mean_relative_l2": 0.08586220443248749, + "max_abs_delta": 10.0 + } + } + }, + "layer_26": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c24342ac8ec72139779acea405e63533d5a85da23798d648e686623a47535c91", + "mean": -0.17943112552165985, + "std": 4.215304851531982, + "rms": 4.219121932983398, + "max_abs": 296.0 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6be74cfb4242f465081566e764edcb9cac2c71c869fed4a328407641fcca81af", + "mean": -0.16819995641708374, + "std": 6.438908576965332, + "rms": 6.441105365753174, + "max_abs": 844.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "229e1ccac10cf30158d12800a103775f9fbec33626ccdcdd3838e77e53d035ee", + "mean": -0.17379707098007202, + "std": 4.143494606018066, + "rms": 4.1471381187438965, + "max_abs": 290.0 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bc42bc7b4718f0978708d08084f12485d01947e65feb66064345b65bdf5d111a", + "mean": -0.14540012180805206, + "std": 6.596408367156982, + "rms": 6.598010540008545, + "max_abs": 868.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9e4c498d0735147d050f6a5d9cfc986bd12a61a60b11562aaf654848a4744f09", + "mean": -0.17992465198040009, + "std": 4.198667526245117, + "rms": 4.202520847320557, + "max_abs": 300.0 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ee9ba8a9ec515f320b913d032250a384cd58e0b2cc0c848eda583c9b14d7e5b5", + "mean": -0.15682430565357208, + "std": 4.675661563873291, + "rms": 4.678290843963623, + "max_abs": 776.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e76c340f91361893481c333bd553be86ce13f947630a5ec92775e8377be10c14", + "mean": -0.17725448310375214, + "std": 4.139097690582275, + "rms": 4.1428914070129395, + "max_abs": 292.0 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4a76c1d2df03525bce414b4d9ab270d44a717adcf2bd665cac851a8f98311a46", + "mean": -0.1361696720123291, + "std": 4.72183895111084, + "rms": 4.723802089691162, + "max_abs": 776.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "10124c40b5f520d90bae5896fea9c0c4e1e7ee43bebade5c5ab48dedc96286d1", + "mean": -0.1826297491788864, + "std": 4.228824615478516, + "rms": 4.232766628265381, + "max_abs": 304.0 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "794f7d5737c138b6132f722a18ce72e0dfc41fb88d28aae2fc085cf94dad4f68", + "mean": -0.16000716388225555, + "std": 4.713201999664307, + "rms": 4.715917110443115, + "max_abs": 776.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "95f767ae3aff045c7cbc24b646e8993586d28c2d8047d2bcc179cdc0c06a2302", + "mean": -0.17522288858890533, + "std": 4.0938544273376465, + "rms": 4.097602367401123, + "max_abs": 294.0 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ea75a165900f37c359a1a461612b6e921c75551e83398012df293ce1e6d2437b", + "mean": -0.1346554160118103, + "std": 4.701534748077393, + "rms": 4.703463077545166, + "max_abs": 776.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "38d45c3f3d3becb7770e264c73c1fe37c666aaa64194db514d0a33428f93182a", + "mean": -0.18096967041492462, + "std": 4.197787284851074, + "rms": 4.201685905456543, + "max_abs": 300.0 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0c41f7e967ec6515a7863c2188ee35c5c370d16fb9fd5d9191cbb004b85b5d29", + "mean": -0.15796253085136414, + "std": 4.68052864074707, + "rms": 4.683193206787109, + "max_abs": 776.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b84503ed4fbc0a0ea8a1f379f29ebc4f85cec5e9fff6038d1e7d6d4e76525f14", + "mean": -0.1744711548089981, + "std": 4.077659606933594, + "rms": 4.081389904022217, + "max_abs": 296.0 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "04c77476ff5353436eb1044c6aa50bbea7e12f47cbcfb0698eb543eef433a835", + "mean": -0.13342878222465515, + "std": 4.6798624992370605, + "rms": 4.681764602661133, + "max_abs": 776.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.998507022857666, + "min_cosine_similarity": 0.9898717403411865, + "mean_relative_l2": 0.054682228714227676, + "max_abs_delta": 13.0 + }, + "system_bos": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9979593753814697, + "min_cosine_similarity": 0.9843690395355225, + "mean_relative_l2": 0.06325507164001465, + "max_abs_delta": 20.0 + }, + "system_x": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.995922327041626, + "min_cosine_similarity": 0.9622545838356018, + "mean_relative_l2": 0.08827080577611923, + "max_abs_delta": 42.5 + }, + "system_period": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9959200620651245, + "min_cosine_similarity": 0.972229540348053, + "mean_relative_l2": 0.08836130797863007, + "max_abs_delta": 37.0 + }, + "bos_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9977632761001587, + "min_cosine_similarity": 0.9832099080085754, + "mean_relative_l2": 0.06627855449914932, + "max_abs_delta": 16.0 + }, + "bos_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9970747232437134, + "min_cosine_similarity": 0.9774815440177917, + "mean_relative_l2": 0.07453510165214539, + "max_abs_delta": 20.0 + }, + "x_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9975554943084717, + "min_cosine_similarity": 0.986723005771637, + "mean_relative_l2": 0.06997551769018173, + "max_abs_delta": 17.0 + }, + "x_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9952111840248108, + "min_cosine_similarity": 0.9730640649795532, + "mean_relative_l2": 0.09451492875814438, + "max_abs_delta": 30.0 + }, + "period_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9977383017539978, + "min_cosine_similarity": 0.9864797592163086, + "mean_relative_l2": 0.06671909987926483, + "max_abs_delta": 17.0 + }, + "period_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.995600163936615, + "min_cosine_similarity": 0.974795937538147, + "mean_relative_l2": 0.0920105129480362, + "max_abs_delta": 24.0 + } + } + }, + "final_norm": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0aa7666967d30e72c3c2718112af11090f7c988b7844526d7c6a4c993fcae1de", + "mean": -0.030581384897232056, + "std": 0.7347864508628845, + "rms": 0.7354225516319275, + "max_abs": 18.25 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1aef58d7ba593578e28c646e2f0e5d279dd219551f8426bcf2270e4ac57eb56e", + "mean": -0.02623012103140354, + "std": 0.7165364623069763, + "rms": 0.7170163989067078, + "max_abs": 24.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "98595f5674d33a04c964e157a0c7746e34107d98194979fca6f0c956631921cd", + "mean": -0.030145442113280296, + "std": 0.7337035536766052, + "rms": 0.7343226075172424, + "max_abs": 18.875 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9eb5c786aabc3074501e1484793bf59cf0a13a1efcd2f212981dc136c949d0c4", + "mean": -0.022519269958138466, + "std": 0.6942316889762878, + "rms": 0.6945967674255371, + "max_abs": 24.75 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "326fb83dc0cf9257f6a1ee98ef0a751ed17966cdc8cfc352605cad9d7d66d447", + "mean": -0.030816171318292618, + "std": 0.7379338145256042, + "rms": 0.7385769486427307, + "max_abs": 18.875 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "58b7b7feee6bd7a7117c64485b95e1873688fb82de0cbc56a4e43e112e62aaf1", + "mean": -0.026364769786596298, + "std": 0.7197664976119995, + "rms": 0.7202491760253906, + "max_abs": 23.75 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b7c24f167998bf5509aa38b6daf7f4058d7e6cb7a3a465d2cdae85c590b85a5e", + "mean": -0.030907878652215004, + "std": 0.7426014542579651, + "rms": 0.7432444095611572, + "max_abs": 19.125 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4776398ff41e0084b950734929a7a6c3294a42e44d2e761777ae342f37a3a0e6", + "mean": -0.02305656112730503, + "std": 0.701316237449646, + "rms": 0.7016951441764832, + "max_abs": 24.625 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "79a53e8ff50fc498d471fbd3adcadc8b4bbd22dbf9026a4831ef123d572cb2ed", + "mean": -0.0310379471629858, + "std": 0.7316316366195679, + "rms": 0.7322896718978882, + "max_abs": 18.375 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bfb5b5c805e4b84f7c9538d7d5d1eae3441b52a5e9407649494258aca8fc434c", + "mean": -0.026606697589159012, + "std": 0.7123432755470276, + "rms": 0.7128400206565857, + "max_abs": 23.375 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f979bcb10b5c5eef915fb887a25cc073bcc6aa5e7bb24f0e05ff7d673c5b3cc9", + "mean": -0.030695632100105286, + "std": 0.7268539667129517, + "rms": 0.7275018095970154, + "max_abs": 18.875 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "70546224c04fd062989d70cc29cef121f81c8b6a04f489ddc5e92f82eaeb2ccf", + "mean": -0.022842662408947945, + "std": 0.6881340146064758, + "rms": 0.6885130405426025, + "max_abs": 25.25 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8313bc3d3c9af723b604d171d03a24ed6d14a931628291ddad5deee71c556fbb", + "mean": -0.031062444671988487, + "std": 0.7381483912467957, + "rms": 0.7388016581535339, + "max_abs": 19.0 + }, + "full_input": { + "shape": [ + 131, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "65346641b75ca4aef2dc06a1d3f83e8040d4828d14a49e17dc84422ce6c510eb", + "mean": -0.02653207816183567, + "std": 0.7195372581481934, + "rms": 0.7200262546539307, + "max_abs": 23.5 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 106, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8185eb364bdb0168a6f1bb59b21d776e681dc51ed611272bb288f14d5c93f6f4", + "mean": -0.030754467472434044, + "std": 0.7339853048324585, + "rms": 0.7346293330192566, + "max_abs": 19.0 + }, + "full_input": { + "shape": [ + 147, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d5380ad808462260d59d0169bffa3d35b5690d1d79536de9e5fca0e0f8d6e4a4", + "mean": -0.022742189466953278, + "std": 0.6949408650398254, + "rms": 0.6953128576278687, + "max_abs": 25.25 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9983918070793152, + "min_cosine_similarity": 0.9894969463348389, + "mean_relative_l2": 0.05259931832551956, + "max_abs_delta": 1.4375 + }, + "system_bos": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9977622628211975, + "min_cosine_similarity": 0.9856116771697998, + "mean_relative_l2": 0.06274014711380005, + "max_abs_delta": 1.54541015625 + }, + "system_x": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9954123497009277, + "min_cosine_similarity": 0.9189777374267578, + "mean_relative_l2": 0.08418913930654526, + "max_abs_delta": 3.1875 + }, + "system_period": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9954441785812378, + "min_cosine_similarity": 0.9382176995277405, + "mean_relative_l2": 0.0840914398431778, + "max_abs_delta": 2.625 + }, + "bos_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9976590871810913, + "min_cosine_similarity": 0.9835751056671143, + "mean_relative_l2": 0.06488508731126785, + "max_abs_delta": 1.2421875 + }, + "bos_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.99686199426651, + "min_cosine_similarity": 0.9644786715507507, + "mean_relative_l2": 0.07428079843521118, + "max_abs_delta": 1.5390625 + }, + "x_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9972602725028992, + "min_cosine_similarity": 0.9813464283943176, + "mean_relative_l2": 0.07020466029644012, + "max_abs_delta": 1.4375 + }, + "x_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9943917989730835, + "min_cosine_similarity": 0.9531116485595703, + "mean_relative_l2": 0.09730320423841476, + "max_abs_delta": 2.6875 + }, + "period_at_s0": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.99759840965271, + "min_cosine_similarity": 0.9811949729919434, + "mean_relative_l2": 0.06522314250469208, + "max_abs_delta": 1.375 + }, + "period_at_s1": { + "tokens": 106, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9950127005577087, + "min_cosine_similarity": 0.9603859186172485, + "mean_relative_l2": 0.09102045744657516, + "max_abs_delta": 2.15625 + } + } + } + }, + "router_layers": { + "layer_01": { + "layer": 1, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "589f427b6e0bb3519d3887d6c185ace6919c60b5fefaebd0ddcde0f8c39ba3db", + "route_weight_sha256": "a7c680efdc231bb9c9006c7895b67462a0d9264963716045ac2e20d5624a100f", + "loads": [ + 11, + 14, + 4, + 15, + 5, + 10, + 13, + 6, + 16, + 6, + 17, + 7, + 18, + 7, + 5, + 9, + 8, + 4, + 21, + 19, + 2, + 20, + 13, + 16, + 16, + 2, + 14, + 9, + 4, + 7, + 9, + 8, + 2, + 10, + 8, + 18, + 5, + 16, + 6, + 8, + 16, + 20, + 4, + 9, + 9, + 8, + 5, + 12, + 10, + 7, + 4, + 5, + 10, + 15, + 22, + 5, + 9, + 6, + 4, + 14, + 2, + 18, + 7, + 7 + ], + "weighted_loads": [ + 0.7114781439304352, + 1.0018724165856838, + 0.21652577072381973, + 1.1304023321717978, + 0.6027305871248245, + 0.9781888127326965, + 0.6202144883573055, + 0.3490325193852186, + 0.7213996928185225, + 0.43863486126065254, + 0.9381683208048344, + 0.48708040080964565, + 0.5185950640588999, + 0.515726663172245, + 0.24716797471046448, + 0.4581745509058237, + 0.3563226405531168, + 0.10935663990676403, + 1.6291352063417435, + 1.450070597231388, + 0.10909216478466988, + 2.1608668863773346, + 0.5092788301408291, + 1.0281732305884361, + 1.0971226524561644, + 0.0930091105401516, + 0.5318365935236216, + 0.36801241897046566, + 0.1484958902001381, + 0.29764341190457344, + 0.6110510788857937, + 0.6081428080797195, + 0.05180734023451805, + 0.3511987682431936, + 0.6708192359656096, + 1.0642505753785372, + 0.234678627923131, + 0.9187040347605944, + 0.3048494700342417, + 0.5465450622141361, + 0.8485316373407841, + 1.302207237109542, + 0.21413935907185078, + 0.6563743259757757, + 0.5554541312158108, + 0.692082904279232, + 0.5869445689022541, + 0.7525439523160458, + 0.45867073722183704, + 0.5471929255872965, + 0.1991474535316229, + 0.45734043046832085, + 0.8206064291298389, + 0.7405685074627399, + 1.5629965607076883, + 0.25180409476161003, + 0.2767060399055481, + 0.23906048946082592, + 0.12303046509623528, + 1.0761499218642712, + 0.05467807129025459, + 1.6203271597623825, + 0.5664559844881296, + 0.6221146434545517 + ], + "unique_experts": 64, + "load_cv": 0.5415748066808126, + "normalized_load_entropy": 0.9644490447061523, + "max_load_share": 0.03459119496855346 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "1fd413308b0f80843f5e0f6be689657a3d46c5b1d698d7adff8faf835ad272dd", + "route_weight_sha256": "b525873e47aa37089248587e37e1cb17fe1b2f40fe4b88cb55fd4e8fdc18c183", + "loads": [ + 11, + 14, + 6, + 15, + 9, + 10, + 15, + 9, + 33, + 6, + 19, + 7, + 18, + 7, + 5, + 18, + 8, + 6, + 21, + 19, + 6, + 21, + 14, + 16, + 16, + 6, + 27, + 9, + 4, + 7, + 10, + 13, + 3, + 13, + 8, + 18, + 5, + 16, + 6, + 11, + 17, + 30, + 4, + 14, + 10, + 19, + 6, + 12, + 10, + 8, + 8, + 6, + 14, + 15, + 25, + 9, + 12, + 14, + 4, + 25, + 3, + 22, + 7, + 7 + ], + "weighted_loads": [ + 0.7114781439304352, + 1.0018724165856838, + 0.3189222142100334, + 1.1304023321717978, + 0.7650192938745022, + 0.9781888127326965, + 0.7487008944153786, + 0.6354453321546316, + 1.6720220688730478, + 0.43863486126065254, + 1.179211225360632, + 0.48708040080964565, + 0.5185950640588999, + 0.515726663172245, + 0.24716797471046448, + 1.0752208288758993, + 0.3563226405531168, + 0.2125642243772745, + 1.6291352063417435, + 1.450070597231388, + 0.4172936286777258, + 2.1814454589039087, + 0.5394217874854803, + 1.0281732305884361, + 1.0971226524561644, + 0.2616884969174862, + 1.343967318534851, + 0.36801241897046566, + 0.1484958902001381, + 0.29764341190457344, + 0.6849880553781986, + 1.0080372410011478, + 0.11345990747213364, + 0.5784634035080671, + 0.6708192359656096, + 1.0642505753785372, + 0.234678627923131, + 0.9187040347605944, + 0.3048494700342417, + 0.7893244214355946, + 0.8799314126372337, + 1.714035650715232, + 0.21413935907185078, + 0.7658744509099051, + 1.5398246608674526, + 1.5118728563538752, + 0.682605717331171, + 0.7525439523160458, + 0.45867073722183704, + 0.5698450300842524, + 0.34697335213422775, + 0.45794428046792746, + 1.1003385968506336, + 0.7405685074627399, + 1.6083772358542774, + 0.7815837077796459, + 0.5536059699952602, + 0.721646036952734, + 0.12303046509623528, + 1.7931708246469498, + 0.14555662497878075, + 1.8384420275688171, + 0.5664559844881296, + 0.6221146434545517 + ], + "unique_experts": 64, + "load_cv": 0.5523387109868286, + "normalized_load_entropy": 0.9651575367167546, + "max_load_share": 0.04198473282442748 + } + }, + "s1_eos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "543863c9d5ae1ae89c2f6ae521cc4d50b96edd86fd66b3474ee252091cabff9e", + "route_weight_sha256": "29b26da9204877338151b8399f4cf73a3197347b709f1c60742e489e4f393945", + "loads": [ + 12, + 14, + 4, + 16, + 5, + 10, + 13, + 8, + 16, + 6, + 17, + 9, + 14, + 7, + 4, + 10, + 8, + 2, + 21, + 19, + 3, + 21, + 16, + 16, + 16, + 2, + 11, + 8, + 4, + 7, + 10, + 8, + 0, + 6, + 8, + 18, + 6, + 16, + 6, + 8, + 16, + 22, + 3, + 9, + 11, + 8, + 5, + 11, + 10, + 8, + 4, + 5, + 10, + 17, + 22, + 5, + 8, + 6, + 6, + 13, + 1, + 17, + 7, + 7 + ], + "weighted_loads": [ + 0.7331828232854605, + 1.0364174582064152, + 0.21342474222183228, + 1.172524333000183, + 0.6023660153150558, + 0.9609161466360092, + 0.5797424372285604, + 0.39067923463881016, + 0.6616966929286718, + 0.4373421110212803, + 0.960180539637804, + 0.5244065877050161, + 0.4166687335819006, + 0.5424383282661438, + 0.2094617746770382, + 0.4888872690498829, + 0.34512652456760406, + 0.060150280594825745, + 1.631028924137354, + 1.4567217603325844, + 0.12738431990146637, + 2.2203673236072063, + 0.5833244472742081, + 1.0206068120896816, + 1.0524334236979485, + 0.0946536734700203, + 0.4626818597316742, + 0.31418205983936787, + 0.14945408888161182, + 0.3009668719023466, + 0.6414275541901588, + 0.6054574735462666, + 0.0, + 0.20023133605718613, + 0.6709555722773075, + 1.0539261847734451, + 0.26168014481663704, + 0.9415430631488562, + 0.30693013221025467, + 0.5419005528092384, + 0.858414089307189, + 1.415518717840314, + 0.1888924092054367, + 0.6557684782892466, + 0.6173567846417427, + 0.6996145285665989, + 0.5821901746094227, + 0.7377040237188339, + 0.4619214851409197, + 0.5755097400397062, + 0.19675847329199314, + 0.45068054646253586, + 0.8260796181857586, + 0.7884181011468172, + 1.5963700488209724, + 0.24325692653656006, + 0.259118665009737, + 0.2425660416483879, + 0.17579678632318974, + 1.0449835434556007, + 0.03192185238003731, + 1.6004619859158993, + 0.5583796706050634, + 0.6223800927400589 + ], + "unique_experts": 63, + "load_cv": 0.5557058457369999, + "normalized_load_entropy": 0.9610338614963312, + "max_load_share": 0.03459119496855346 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "3e2ee860b11dbba43959fd163326990b552bb5abbbdd956b6c72092e4965f37e", + "route_weight_sha256": "dc2a7e6ddca445bfc7ba3a6f9b47530139f1e559317c61a9804d6220e9ee5d21", + "loads": [ + 14, + 14, + 7, + 16, + 12, + 12, + 15, + 12, + 39, + 6, + 22, + 10, + 14, + 8, + 4, + 22, + 8, + 8, + 22, + 20, + 7, + 24, + 21, + 17, + 18, + 7, + 31, + 9, + 4, + 9, + 12, + 15, + 1, + 8, + 8, + 18, + 7, + 17, + 6, + 13, + 17, + 34, + 6, + 15, + 13, + 19, + 6, + 14, + 12, + 9, + 13, + 9, + 15, + 17, + 27, + 9, + 17, + 18, + 8, + 24, + 3, + 22, + 7, + 11 + ], + "weighted_loads": [ + 0.838549317792058, + 1.0364174582064152, + 0.3791877031326294, + 1.172524333000183, + 0.9992882683873177, + 1.098204329609871, + 0.6877038460224867, + 0.646762166172266, + 2.0338798258453608, + 0.4373421110212803, + 1.3941657468676567, + 0.6712372060865164, + 0.4166687335819006, + 0.582404013723135, + 0.2094617746770382, + 1.193025216460228, + 0.34512652456760406, + 0.29270975664258003, + 1.670078668743372, + 1.5227903574705124, + 0.3735993951559067, + 2.4453012216836214, + 0.8544667383830529, + 1.054947067052126, + 1.1242657862603664, + 0.29007013887166977, + 1.777590123936534, + 0.3565009292215109, + 0.14945408888161182, + 0.46324763260781765, + 0.8005950823426247, + 1.2318723424396012, + 0.049505215138196945, + 0.3429843746125698, + 0.6709555722773075, + 1.0539261847734451, + 0.5205957181751728, + 0.9751638453453779, + 0.30693013221025467, + 0.9024659469723701, + 0.8911459650844336, + 1.9891606755554676, + 0.396454855799675, + 0.8535954505205154, + 1.758445881307125, + 1.4674606907065026, + 0.6753115244209766, + 0.8206557006633375, + 0.6131650619208813, + 0.5985772628337145, + 0.6299546901136637, + 0.8156060390174389, + 1.1693581007421017, + 0.7884181011468172, + 1.6902688810369, + 0.74941336363554, + 0.6910807620733976, + 0.9507757611572742, + 0.25096466206014156, + 1.716790609061718, + 0.14770853705704212, + 1.9104448147118092, + 0.5583796706050634, + 1.114692397415638 + ], + "unique_experts": 64, + "load_cv": 0.5386668924007019, + "normalized_load_entropy": 0.9664519772940311, + "max_load_share": 0.04421768707482993 + } + }, + "s0_bos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "ca1f17a755612297c92a597f68b5d9c8d6c84e427b20d9493abaecb682bd822e", + "route_weight_sha256": "bdd4e9e5bf0974bf3cce948ab5f6ebd2b4dbcae9d6411aa54b001ce038c63e19", + "loads": [ + 12, + 13, + 4, + 15, + 5, + 10, + 16, + 8, + 15, + 6, + 18, + 10, + 16, + 7, + 5, + 14, + 4, + 7, + 19, + 19, + 2, + 19, + 14, + 16, + 17, + 2, + 9, + 9, + 3, + 9, + 9, + 8, + 3, + 9, + 8, + 17, + 5, + 15, + 6, + 8, + 17, + 17, + 4, + 13, + 10, + 8, + 5, + 14, + 6, + 6, + 5, + 5, + 10, + 13, + 21, + 5, + 11, + 6, + 2, + 14, + 1, + 18, + 7, + 7 + ], + "weighted_loads": [ + 0.7546841334551573, + 0.9624247029423714, + 0.22529194876551628, + 1.1489359587430954, + 0.5400380976498127, + 0.8492179960012436, + 0.7508574370294809, + 0.396746501326561, + 0.537418132647872, + 0.4767244979739189, + 1.0240165684372187, + 0.5849198382347822, + 0.4817309360951185, + 0.4589212164282799, + 0.2629626579582691, + 0.6666236966848373, + 0.23490938171744347, + 0.20721746236085892, + 1.4535474590957165, + 1.4581922739744186, + 0.10394937545061111, + 2.0148737393319607, + 0.5393449123948812, + 1.0940592046827078, + 1.119284825399518, + 0.09180358797311783, + 0.39515569992363453, + 0.3550729304552078, + 0.11851632595062256, + 0.3697553649544716, + 0.5949703678488731, + 0.5705456957221031, + 0.08538916520774364, + 0.31486478820443153, + 0.6928666662424803, + 0.9655433408915997, + 0.2506106495857239, + 0.8849245943129063, + 0.3152655754238367, + 0.5618991106748581, + 0.8726208172738552, + 1.0097223166376352, + 0.21600002236664295, + 0.7469017673283815, + 0.6008340921252966, + 0.6383213400840759, + 0.5880758389830589, + 0.8183975480496883, + 0.34763846360147, + 0.5249276235699654, + 0.2437612134963274, + 0.46300413087010384, + 0.8553606458008289, + 0.6708247419446707, + 1.5811349339783192, + 0.2499282006174326, + 0.3624242711812258, + 0.1980949230492115, + 0.07908011227846146, + 1.0263303592801094, + 0.025899279862642288, + 1.6458030808717012, + 0.5515212640166283, + 0.6067164465785027 + ], + "unique_experts": 64, + "load_cv": 0.527964852061631, + "normalized_load_entropy": 0.964803467734659, + "max_load_share": 0.0330188679245283 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "c03a09bc2cf8ea31fd37100d11536690670b633bba7c4db7e03daf4cef1f78c8", + "route_weight_sha256": "d5c8973ed2a0ab5fefba661dabdc44c51f57060bd0c032124699c683449d6a6e", + "loads": [ + 13, + 13, + 6, + 15, + 9, + 10, + 18, + 11, + 31, + 6, + 20, + 11, + 17, + 7, + 5, + 23, + 4, + 10, + 19, + 19, + 6, + 19, + 15, + 16, + 17, + 6, + 22, + 9, + 3, + 9, + 10, + 12, + 4, + 11, + 8, + 17, + 5, + 15, + 6, + 11, + 18, + 28, + 5, + 17, + 10, + 19, + 7, + 14, + 6, + 6, + 9, + 5, + 14, + 13, + 23, + 9, + 15, + 15, + 2, + 24, + 3, + 22, + 7, + 7 + ], + "weighted_loads": [ + 0.7782156802713871, + 0.9624247029423714, + 0.31059621647000313, + 1.1489359587430954, + 0.6966253370046616, + 0.8492179960012436, + 0.883550463244319, + 0.6755038555711508, + 1.3934963177889585, + 0.4767244979739189, + 1.260302783921361, + 0.6094700768589973, + 0.5137459803372622, + 0.4589212164282799, + 0.2629626579582691, + 1.283669974654913, + 0.23490938171744347, + 0.34736286848783493, + 1.4535474590957165, + 1.4581922739744186, + 0.3789036553353071, + 2.0148737393319607, + 0.5694878697395325, + 1.0940592046827078, + 1.119284825399518, + 0.26533403620123863, + 1.204012218862772, + 0.3550729304552078, + 0.11851632595062256, + 0.3697553649544716, + 0.6688577458262444, + 0.9995884671807289, + 0.14704173244535923, + 0.5034292675554752, + 0.6928666662424803, + 0.9655433408915997, + 0.2506106495857239, + 0.8849245943129063, + 0.3152655754238367, + 0.8075179979205132, + 0.9037816636264324, + 1.4403171613812447, + 0.2587823402136564, + 0.8559201657772064, + 0.6008340921252966, + 1.4939791038632393, + 0.7318166885524988, + 0.8183975480496883, + 0.34763846360147, + 0.5249276235699654, + 0.39599376544356346, + 0.46300413087010384, + 1.1262078881263733, + 0.6708247419446707, + 1.6260651145130396, + 0.7826385516673326, + 0.7035312559455633, + 0.7569326609373093, + 0.07908011227846146, + 1.7100075334310532, + 0.22151431813836098, + 1.8680704589933157, + 0.5515212640166283, + 0.6067164465785027 + ], + "unique_experts": 64, + "load_cv": 0.5309171128575806, + "normalized_load_entropy": 0.9661493516981463, + "max_load_share": 0.039440203562340966 + } + }, + "s1_bos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "d09bc80fe1cb534d0ef31fba8d7d12c4904e14cb12d118e146cbb734cb7751a4", + "route_weight_sha256": "e956b03129babbf6bba24049989c5ed26ef95ed13230af853266803564acc323", + "loads": [ + 12, + 14, + 4, + 15, + 5, + 10, + 12, + 10, + 15, + 6, + 17, + 10, + 12, + 7, + 4, + 12, + 5, + 4, + 19, + 19, + 2, + 20, + 15, + 16, + 16, + 2, + 23, + 7, + 4, + 9, + 10, + 8, + 0, + 5, + 8, + 17, + 5, + 15, + 7, + 8, + 15, + 20, + 3, + 10, + 13, + 8, + 5, + 13, + 12, + 6, + 5, + 5, + 10, + 14, + 22, + 5, + 8, + 6, + 2, + 13, + 1, + 17, + 7, + 7 + ], + "weighted_loads": [ + 0.7042935322970152, + 1.0547708831727505, + 0.21066130697727203, + 1.1425827704370022, + 0.5469395853579044, + 0.9070250988006592, + 0.5853596888482571, + 0.44649275206029415, + 0.5320233646780252, + 0.45410894975066185, + 0.9729130119085312, + 0.5725029893219471, + 0.3684030622243881, + 0.4737158101052046, + 0.19455355033278465, + 0.5995308123528957, + 0.25792259350419044, + 0.11421572789549828, + 1.4006634373217821, + 1.4278417080640793, + 0.10198807716369629, + 2.1462858747690916, + 0.5755712017416954, + 1.0490125603973866, + 1.0341132525354624, + 0.09466978907585144, + 0.7944580856710672, + 0.27773912250995636, + 0.14806489273905754, + 0.3680972885340452, + 0.633908299729228, + 0.5791554376482964, + 0.0, + 0.1611360851675272, + 0.6969879008829594, + 0.9532034955918789, + 0.25634062848985195, + 0.8615538068115711, + 0.3378109931945801, + 0.5388953238725662, + 0.7516170032322407, + 1.289248514920473, + 0.18538745492696762, + 0.6668430492281914, + 0.6937577407807112, + 0.6420814767479897, + 0.5896135754883289, + 0.8234854396432638, + 0.4967685993760824, + 0.5200532004237175, + 0.23777201771736145, + 0.4554060995578766, + 0.8577531166374683, + 0.6915864013135433, + 1.6271856352686882, + 0.23913463950157166, + 0.2870222460478544, + 0.2001776620745659, + 0.06966651789844036, + 1.0209041088819504, + 0.02808283269405365, + 1.6086371634155512, + 0.5323869585990906, + 0.5999138504266739 + ], + "unique_experts": 63, + "load_cv": 0.5593949841650413, + "normalized_load_entropy": 0.9598489947388626, + "max_load_share": 0.036163522012578615 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "0d8c8f0cd16da8c268ad88541899400ef50d2613e42594979d4944bb4a20cc3d", + "route_weight_sha256": "f23caadd157489adb8b7487d39dd506656124968dc3c13f8fd4c513aca8ccd0c", + "loads": [ + 15, + 14, + 7, + 16, + 12, + 12, + 14, + 14, + 37, + 6, + 22, + 11, + 12, + 8, + 4, + 24, + 5, + 10, + 20, + 20, + 5, + 22, + 19, + 17, + 18, + 7, + 43, + 8, + 4, + 11, + 12, + 14, + 1, + 7, + 8, + 17, + 6, + 16, + 7, + 13, + 16, + 32, + 7, + 16, + 14, + 19, + 7, + 15, + 14, + 7, + 14, + 9, + 15, + 14, + 27, + 9, + 18, + 20, + 4, + 23, + 4, + 22, + 7, + 11 + ], + "weighted_loads": [ + 0.83193071000278, + 1.0547708831727505, + 0.36276572570204735, + 1.1742998696863651, + 0.9395125173032284, + 1.0443132817745209, + 0.6814788579940796, + 0.693437771871686, + 1.7989749182015657, + 0.45410894975066185, + 1.4009301252663136, + 0.7193336077034473, + 0.3684030622243881, + 0.5136814955621958, + 0.19455355033278465, + 1.3036687597632408, + 0.25792259350419044, + 0.3484102077782154, + 1.4397131819278002, + 1.4939103052020073, + 0.2959448844194412, + 2.3508627098053694, + 0.8464046958833933, + 1.0833528153598309, + 1.1059456150978804, + 0.2969457507133484, + 2.114833977073431, + 0.3200579918920994, + 0.14806489273905754, + 0.5303780492395163, + 0.796668229624629, + 1.2312960848212242, + 0.049505215138196945, + 0.3010237533599138, + 0.6969879008829594, + 0.9532034955918789, + 0.5152562018483877, + 0.8951745890080929, + 0.3378109931945801, + 0.9029073268175125, + 0.7814347203820944, + 1.8628904726356268, + 0.42929232865571976, + 0.8646700214594603, + 0.8458098601549864, + 1.443515133112669, + 0.7391833905130625, + 0.9061232823878527, + 0.648012176156044, + 0.5400333944708109, + 0.6848255544900894, + 0.8203315921127796, + 1.1758075095713139, + 0.6915864013135433, + 1.7402011957019567, + 0.743575744330883, + 0.7733644545078278, + 1.0056033991277218, + 0.1448343936353922, + 1.6580606922507286, + 0.24620863609015942, + 1.9214028809219599, + 0.5323869585990906, + 1.092226155102253 + ], + "unique_experts": 64, + "load_cv": 0.5685372990888663, + "normalized_load_entropy": 0.9635388713381974, + "max_load_share": 0.048752834467120185 + } + }, + "s0_x": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "02dc371a07f33b617d47d6e71220cf7d9b1394a4e653a3ddced4f07b735aa796", + "route_weight_sha256": "6ccc3225765c2a4de6ce3edb5f6af6535f7d9bfe635160f531fa1e45225226d1", + "loads": [ + 12, + 12, + 4, + 15, + 5, + 10, + 15, + 6, + 18, + 6, + 19, + 10, + 18, + 7, + 6, + 12, + 4, + 8, + 19, + 19, + 2, + 20, + 11, + 16, + 17, + 2, + 16, + 8, + 3, + 8, + 9, + 8, + 3, + 9, + 7, + 15, + 5, + 15, + 4, + 8, + 17, + 18, + 3, + 13, + 10, + 8, + 5, + 13, + 9, + 6, + 4, + 5, + 10, + 13, + 23, + 5, + 9, + 6, + 2, + 13, + 1, + 18, + 7, + 7 + ], + "weighted_loads": [ + 0.7370364535599947, + 0.9398941658437252, + 0.21531904116272926, + 1.1030369102954865, + 0.5575645603239536, + 0.9653187058866024, + 0.7348634656518698, + 0.3532760515809059, + 0.6650340147316456, + 0.4610063284635544, + 1.0478470139205456, + 0.562158852815628, + 0.53134442307055, + 0.47148582339286804, + 0.2659936435520649, + 0.5841699820011854, + 0.23260588385164738, + 0.23188264295458794, + 1.5062903985381126, + 1.4157474413514137, + 0.1043412983417511, + 2.1176374182105064, + 0.4608166478574276, + 1.0432574916630983, + 1.164162801578641, + 0.09192242473363876, + 0.5904727373272181, + 0.33052106760442257, + 0.11790814250707626, + 0.3312660753726959, + 0.5906205326318741, + 0.5787106081843376, + 0.08568439818918705, + 0.3182668536901474, + 0.6549130044877529, + 0.9188365247100592, + 0.23999354429543018, + 0.9210362229496241, + 0.24995082803070545, + 0.5535029955208302, + 0.9316729474812746, + 1.1454162616282701, + 0.18974428996443748, + 0.7544130831956863, + 0.5843784417957067, + 0.6609972827136517, + 0.5927270725369453, + 0.7674356568604708, + 0.42960044741630554, + 0.5096577554941177, + 0.20343686267733574, + 0.47202277928590775, + 0.8357914574444294, + 0.6684886384755373, + 1.6929289307445288, + 0.2485658172518015, + 0.3009886797517538, + 0.20927886106073856, + 0.07841718196868896, + 1.0143112987279892, + 0.028426816686987877, + 1.6027291044592857, + 0.5525876842439175, + 0.6092501096427441 + ], + "unique_experts": 64, + "load_cv": 0.551131469004925, + "normalized_load_entropy": 0.9622017995872615, + "max_load_share": 0.036163522012578615 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "90d4102604e794371a2124d28a1d5810e37057ef99064749961018fb0c439d06", + "route_weight_sha256": "a4283fd581cc59ac5a62038212323fe82b04fa5b6b0a5049f40d49a65406ad19", + "loads": [ + 12, + 12, + 6, + 15, + 9, + 10, + 17, + 9, + 34, + 7, + 21, + 10, + 19, + 7, + 6, + 22, + 4, + 10, + 19, + 19, + 5, + 21, + 13, + 16, + 17, + 6, + 30, + 8, + 3, + 8, + 10, + 12, + 4, + 11, + 7, + 15, + 5, + 15, + 4, + 11, + 18, + 30, + 3, + 17, + 10, + 20, + 6, + 13, + 9, + 7, + 8, + 5, + 14, + 13, + 25, + 9, + 12, + 14, + 2, + 24, + 2, + 22, + 7, + 7 + ], + "weighted_loads": [ + 0.7370364535599947, + 0.9398941658437252, + 0.30974672734737396, + 1.1030369102954865, + 0.7162474989891052, + 0.9653187058866024, + 0.8700889516621828, + 0.6521381251513958, + 1.5235714875161648, + 0.48733612336218357, + 1.2876325137913227, + 0.562158852815628, + 0.565522151067853, + 0.47148582339286804, + 0.2659936435520649, + 1.318062113597989, + 0.23260588385164738, + 0.3367628864943981, + 1.5062903985381126, + 1.4157474413514137, + 0.3588300943374634, + 2.1373779755085707, + 0.5218177400529385, + 1.0432574916630983, + 1.164162801578641, + 0.26983996108174324, + 1.4314583409577608, + 0.33052106760442257, + 0.11790814250707626, + 0.3312660753726959, + 0.6673721224069595, + 1.0227291136980057, + 0.14733696542680264, + 0.5099507011473179, + 0.6549130044877529, + 0.9188365247100592, + 0.23999354429543018, + 0.9210362229496241, + 0.24995082803070545, + 0.8224404193460941, + 0.9643615130335093, + 1.6311912760138512, + 0.18974428996443748, + 0.8634314816445112, + 0.5843784417957067, + 1.5504138134419918, + 0.7144491970539093, + 0.7674356568604708, + 0.42960044741630554, + 0.5288806110620499, + 0.35425860807299614, + 0.47202277928590775, + 1.089277297258377, + 0.6684886384755373, + 1.7378591112792492, + 0.8029562477022409, + 0.4929502513259649, + 0.6888207644224167, + 0.07841718196868896, + 1.7965906634926796, + 0.11930537037551403, + 1.820070307701826, + 0.5525876842439175, + 0.6092501096427441 + ], + "unique_experts": 64, + "load_cv": 0.5828194144978662, + "normalized_load_entropy": 0.9606291459635847, + "max_load_share": 0.043256997455470736 + } + }, + "s1_x": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "9c6a3a62830f6e940dfe2963b160ec5760c8ab49c573189c9c1dc8db201ff246", + "route_weight_sha256": "857e0acd1b3fd66735e74da9f2a8eb3f5cdb414d43b0dbe42eb56d8cddb99522", + "loads": [ + 12, + 14, + 4, + 15, + 5, + 10, + 13, + 6, + 14, + 6, + 17, + 10, + 10, + 7, + 4, + 11, + 6, + 2, + 18, + 19, + 3, + 20, + 16, + 15, + 16, + 2, + 28, + 7, + 5, + 8, + 10, + 8, + 1, + 5, + 8, + 17, + 5, + 14, + 5, + 8, + 15, + 24, + 3, + 10, + 12, + 9, + 5, + 13, + 11, + 6, + 5, + 5, + 10, + 16, + 22, + 5, + 8, + 6, + 1, + 13, + 1, + 17, + 8, + 7 + ], + "weighted_loads": [ + 0.6842167396098375, + 1.0477829091250896, + 0.20179082080721855, + 1.1101531460881233, + 0.5566173270344734, + 0.9383680149912834, + 0.6172869391739368, + 0.35145774856209755, + 0.5006166156381369, + 0.43915044143795967, + 0.970922376960516, + 0.5621870346367359, + 0.31893135234713554, + 0.48360247164964676, + 0.17823120020329952, + 0.5559966843575239, + 0.2852078229188919, + 0.0658087320625782, + 1.3682262115180492, + 1.3957143127918243, + 0.12205950729548931, + 2.173196792602539, + 0.6100342124700546, + 0.99234414473176, + 1.052112691104412, + 0.09459133818745613, + 0.969204742461443, + 0.27628539502620697, + 0.17554671131074429, + 0.33469147980213165, + 0.6400393303483725, + 0.5762586295604706, + 0.026766974478960037, + 0.1603471077978611, + 0.6877364125102758, + 0.9609379395842552, + 0.2501257620751858, + 0.8328101355582476, + 0.2787789087742567, + 0.537701889872551, + 0.7913097515702248, + 1.4812785778194666, + 0.1843406744301319, + 0.6663247141987085, + 0.666444206610322, + 0.6734446510672569, + 0.5901354588568211, + 0.8137218654155731, + 0.4766198471188545, + 0.5137098729610443, + 0.2319443766027689, + 0.4578166604042053, + 0.8538311831653118, + 0.7410332132130861, + 1.6203330252319574, + 0.238302331417799, + 0.2876730393618345, + 0.20493794418871403, + 0.04614117741584778, + 1.0207798406481743, + 0.029889877885580063, + 1.5789940729737282, + 0.552195705473423, + 0.5977233499288559 + ], + "unique_experts": 64, + "load_cv": 0.5928986558484998, + "normalized_load_entropy": 0.9572969025167835, + "max_load_share": 0.0440251572327044 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "a17ce5796e017ec12c477aae1a37e5a118c7ff50f366ed9f519371c37f1fc397", + "route_weight_sha256": "0646522b26d3e46c010d9559f26b6a891ba3554d806653186e2d432dc29575cf", + "loads": [ + 14, + 14, + 7, + 15, + 12, + 12, + 15, + 12, + 36, + 7, + 22, + 11, + 10, + 8, + 4, + 24, + 6, + 8, + 19, + 20, + 6, + 22, + 20, + 16, + 18, + 7, + 49, + 8, + 5, + 10, + 12, + 14, + 2, + 7, + 8, + 17, + 6, + 15, + 5, + 13, + 16, + 37, + 6, + 16, + 13, + 21, + 7, + 15, + 13, + 7, + 14, + 9, + 15, + 16, + 26, + 9, + 17, + 18, + 3, + 24, + 3, + 22, + 8, + 11 + ], + "weighted_loads": [ + 0.789583234116435, + 1.0477829091250896, + 0.36131536960601807, + 1.1101531460881233, + 0.9492043145000935, + 1.0756561979651451, + 0.7104350849986076, + 0.6550053432583809, + 1.7597002554684877, + 0.4640343561768532, + 1.3978906124830246, + 0.7090176530182362, + 0.31893135234713554, + 0.523568157106638, + 0.17823120020329952, + 1.3712008092552423, + 0.2852078229188919, + 0.30087266489863396, + 1.4072759561240673, + 1.4617829099297523, + 0.31566206365823746, + 2.377773627638817, + 0.8808677066117525, + 1.0266843996942043, + 1.12394505366683, + 0.3016520217061043, + 2.3348216731101274, + 0.31860426440835, + 0.17554671131074429, + 0.4969722405076027, + 0.805811895057559, + 1.2351627945899963, + 0.07627218961715698, + 0.30285292491316795, + 0.6877364125102758, + 0.9609379395842552, + 0.5090413354337215, + 0.8664309177547693, + 0.2787789087742567, + 0.919755756855011, + 0.8211686015129089, + 2.1214220635592937, + 0.3919031210243702, + 0.8641516864299774, + 0.8184963259845972, + 1.5104322172701359, + 0.745535921305418, + 0.896359708160162, + 0.6278634238988161, + 0.5336559452116489, + 0.6787099931389093, + 0.8227421529591084, + 1.155722714960575, + 0.7410332132130861, + 1.7138104867190123, + 0.75426110252738, + 0.6454546228051186, + 0.906862473115325, + 0.1213090531527996, + 1.7521514594554901, + 0.14567656256258488, + 1.8875319249927998, + 0.552195705473423, + 1.090035654604435 + ], + "unique_experts": 64, + "load_cv": 0.6074347027077821, + "normalized_load_entropy": 0.960624474421995, + "max_load_share": 0.05555555555555555 + } + }, + "s0_period": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "f9a1b1824cf4d59a939acf3547278e98b2d75b79e2ad72ae7e0f9219fb9ccd89", + "route_weight_sha256": "6fceae65e123c761ccc17d424788cd2661c5afa924c8e1262f110a8fffa2ec69", + "loads": [ + 12, + 12, + 4, + 15, + 5, + 10, + 14, + 7, + 18, + 6, + 19, + 9, + 18, + 7, + 6, + 12, + 4, + 8, + 19, + 19, + 2, + 20, + 11, + 16, + 17, + 2, + 15, + 8, + 3, + 8, + 9, + 8, + 3, + 9, + 7, + 15, + 5, + 15, + 4, + 8, + 17, + 18, + 3, + 13, + 11, + 8, + 5, + 13, + 9, + 6, + 4, + 5, + 10, + 13, + 23, + 5, + 10, + 6, + 2, + 13, + 1, + 18, + 7, + 7 + ], + "weighted_loads": [ + 0.7346339263021946, + 0.9492479525506496, + 0.2153097465634346, + 1.1031599678099155, + 0.5545664243400097, + 0.9654400609433651, + 0.7006708085536957, + 0.3726238440722227, + 0.654806537553668, + 0.459777656942606, + 1.049211259931326, + 0.5376362688839436, + 0.5307161342352629, + 0.47762247547507286, + 0.26795448549091816, + 0.5833627451211214, + 0.230966379866004, + 0.23158452846109867, + 1.5025542248040438, + 1.4217468574643135, + 0.10494358837604523, + 2.1189355105161667, + 0.46108129248023033, + 1.0428463444113731, + 1.1674342900514603, + 0.09208666533231735, + 0.5617915149778128, + 0.33179498836398125, + 0.11816494725644588, + 0.33122350834310055, + 0.5934871267527342, + 0.5785197019577026, + 0.08452259376645088, + 0.3168164025992155, + 0.6549951676279306, + 0.921391611918807, + 0.24181456118822098, + 0.9236911628395319, + 0.2512537855654955, + 0.5551440268754959, + 0.9417764656245708, + 1.1470824498683214, + 0.18974540010094643, + 0.7549308184534311, + 0.6200654823333025, + 0.6611506454646587, + 0.5927050299942493, + 0.7731582913547754, + 0.42726106010377407, + 0.5112299546599388, + 0.20284431241452694, + 0.46914440020918846, + 0.8300229907035828, + 0.6728824693709612, + 1.6957165971398354, + 0.24780815839767456, + 0.3337094746530056, + 0.20584658533334732, + 0.07890937104821205, + 1.0135986618697643, + 0.02846958115696907, + 1.6044418271631002, + 0.5467713493853807, + 0.6130482405424118 + ], + "unique_experts": 64, + "load_cv": 0.5473866410543777, + "normalized_load_entropy": 0.962652757340139, + "max_load_share": 0.036163522012578615 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "e218fd5d058e4a500635bc1042d52e4c760a4bfe5fb2dc624927c209d69ae098", + "route_weight_sha256": "cb60d53d6c9e0be512a1642fed132f3ad1ce9097b210bbebaea1f3eccb350b94", + "loads": [ + 12, + 12, + 6, + 15, + 10, + 10, + 16, + 9, + 34, + 7, + 21, + 11, + 19, + 7, + 6, + 21, + 4, + 10, + 19, + 19, + 5, + 21, + 12, + 16, + 17, + 6, + 28, + 8, + 3, + 8, + 10, + 12, + 4, + 11, + 7, + 16, + 5, + 15, + 4, + 11, + 18, + 29, + 3, + 18, + 11, + 19, + 6, + 13, + 10, + 7, + 8, + 6, + 14, + 13, + 25, + 9, + 13, + 13, + 2, + 24, + 2, + 22, + 7, + 7 + ], + "weighted_loads": [ + 0.7346339263021946, + 0.9492479525506496, + 0.3008318766951561, + 1.1031599678099155, + 0.8344881385564804, + 0.9654400609433651, + 0.8356729112565517, + 0.6240116711705923, + 1.4870900437235832, + 0.48531064949929714, + 1.2889690436422825, + 0.6986723653972149, + 0.5631053876131773, + 0.47762247547507286, + 0.26795448549091816, + 1.200409023091197, + 0.230966379866004, + 0.33600073121488094, + 1.5025542248040438, + 1.4217468574643135, + 0.35938119143247604, + 2.1388852801173925, + 0.49122424982488155, + 1.0428463444113731, + 1.1674342900514603, + 0.2698254734277725, + 1.372706577181816, + 0.33179498836398125, + 0.11816494725644588, + 0.33122350834310055, + 0.6743154432624578, + 1.0239415168762207, + 0.14617516100406647, + 0.5076935682445765, + 0.6549951676279306, + 0.9426993913948536, + 0.24181456118822098, + 0.9236911628395319, + 0.2512537855654955, + 0.80501938611269, + 0.9747237302362919, + 1.5769903920590878, + 0.18974540010094643, + 0.8897296749055386, + 0.6200654823333025, + 1.5184348337352276, + 0.7138471640646458, + 0.7731582913547754, + 0.4484195578843355, + 0.530539907515049, + 0.3553576320409775, + 0.5220563374459743, + 1.0967559330165386, + 0.6728824693709612, + 1.7406467776745558, + 0.804819792509079, + 0.5260008126497269, + 0.6564726755023003, + 0.07890937104821205, + 1.7273313291370869, + 0.11934813484549522, + 1.819472910836339, + 0.5467713493853807, + 0.6130482405424118 + ], + "unique_experts": 64, + "load_cv": 0.5684218673236123, + "normalized_load_entropy": 0.962174849081457, + "max_load_share": 0.043256997455470736 + } + }, + "s1_period": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "cf325abc71dd7998efb94b173fd2af5d2e7d7857c6862150e37892b61586429b", + "route_weight_sha256": "10528267fbc280a4af8f7807b3ccf1e0c09c1eec5704e8a5acf396da0f3f7109", + "loads": [ + 12, + 14, + 4, + 15, + 5, + 10, + 13, + 8, + 14, + 6, + 17, + 10, + 10, + 7, + 4, + 10, + 6, + 2, + 19, + 19, + 3, + 20, + 15, + 15, + 16, + 2, + 28, + 7, + 5, + 8, + 10, + 8, + 0, + 5, + 8, + 17, + 5, + 14, + 5, + 8, + 15, + 24, + 3, + 10, + 12, + 9, + 5, + 13, + 11, + 6, + 5, + 5, + 10, + 15, + 22, + 5, + 9, + 6, + 1, + 13, + 1, + 17, + 8, + 7 + ], + "weighted_loads": [ + 0.6824292335659266, + 1.0529062431305647, + 0.20188648998737335, + 1.1121537573635578, + 0.5535155236721039, + 0.9357941709458828, + 0.616270937025547, + 0.3922526389360428, + 0.49468961358070374, + 0.43893810361623764, + 0.9729586001485586, + 0.5584162659943104, + 0.32019614428281784, + 0.48833101987838745, + 0.17922191694378853, + 0.5271316040307283, + 0.2820786852389574, + 0.06530042365193367, + 1.3960498925298452, + 1.3999013118445873, + 0.12266027554869652, + 2.1705576423555613, + 0.5903539061546326, + 0.9923464730381966, + 1.0512705296278, + 0.09453927725553513, + 0.9654605947434902, + 0.27688915468752384, + 0.17546270973980427, + 0.33369945362210274, + 0.6413653697818518, + 0.578355710953474, + 0.0, + 0.15945927053689957, + 0.6870636641979218, + 0.9638837706297636, + 0.24986649118363857, + 0.8373932279646397, + 0.2789634168148041, + 0.5378772616386414, + 0.7982281092554331, + 1.4803566914051771, + 0.18389401957392693, + 0.66622762568295, + 0.6663552299141884, + 0.6738472282886505, + 0.592541329562664, + 0.812850346788764, + 0.4764194078743458, + 0.5164440646767616, + 0.23045464232563972, + 0.4559086002409458, + 0.8493962399661541, + 0.7246661856770515, + 1.6254706904292107, + 0.23794879391789436, + 0.3135691359639168, + 0.20294197462499142, + 0.04663688316941261, + 1.0217533484101295, + 0.0300276055932045, + 1.5813505556434393, + 0.5495964828878641, + 0.5989107824862003 + ], + "unique_experts": 63, + "load_cv": 0.592631734661827, + "normalized_load_entropy": 0.9564992678862176, + "max_load_share": 0.0440251572327044 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "bd9fb0ef6de8806720112560df447787bf5c76869f6bf182ef6baca00cb57cd9", + "route_weight_sha256": "ff77156ec436494cdcf7c314384db9d72279007d8806dfe0a0e8d8a0c36de316", + "loads": [ + 14, + 14, + 7, + 15, + 13, + 12, + 15, + 13, + 35, + 6, + 22, + 13, + 10, + 8, + 4, + 22, + 6, + 8, + 20, + 20, + 6, + 22, + 19, + 16, + 18, + 7, + 49, + 8, + 5, + 10, + 13, + 14, + 1, + 7, + 8, + 17, + 7, + 15, + 5, + 13, + 16, + 37, + 6, + 16, + 13, + 20, + 6, + 15, + 13, + 7, + 14, + 10, + 16, + 15, + 26, + 9, + 18, + 18, + 3, + 23, + 3, + 22, + 8, + 11 + ], + "weighted_loads": [ + 0.7877957280725241, + 1.0529062431305647, + 0.3512282781302929, + 1.1121537573635578, + 1.0659652836620808, + 1.0730823539197445, + 0.7095061764121056, + 0.6460629068315029, + 1.7105729095637798, + 0.43893810361623764, + 1.4001265559345484, + 0.8726629503071308, + 0.32019614428281784, + 0.5282967053353786, + 0.17922191694378853, + 1.2312695514410734, + 0.2820786852389574, + 0.2999453581869602, + 1.4350996371358633, + 1.4659699089825153, + 0.31609088741242886, + 2.375134477391839, + 0.8611874002963305, + 1.0266867280006409, + 1.123102892190218, + 0.30088938772678375, + 2.3207073528319597, + 0.31920802406966686, + 0.17546270973980427, + 0.4959802143275738, + 0.8308495860546827, + 1.238291870802641, + 0.049505215138196945, + 0.30147404223680496, + 0.6870636641979218, + 0.9638837706297636, + 0.5307828355580568, + 0.8710140101611614, + 0.2789634168148041, + 0.9007184058427811, + 0.8281311299651861, + 2.0892745181918144, + 0.3914564661681652, + 0.8640545979142189, + 0.8184073492884636, + 1.477892853319645, + 0.7124732881784439, + 0.8954881895333529, + 0.6276629846543074, + 0.5365142282098532, + 0.6777656637132168, + 0.863679725676775, + 1.185770781710744, + 0.7246661856770515, + 1.7189481519162655, + 0.7548905126750469, + 0.6748622339218855, + 0.9041037373244762, + 0.12180475890636444, + 1.6589099317789078, + 0.1458142902702093, + 1.8854513075202703, + 0.5495964828878641, + 1.0912230871617794 + ], + "unique_experts": 64, + "load_cv": 0.6013090684336673, + "normalized_load_entropy": 0.960792800603373, + "max_load_share": 0.05555555555555555 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 106, + "ordered_topk_exact_tokens": 65, + "set_exact_tokens": 77, + "mean_set_jaccard": 0.9218328840970351, + "mean_token_weighted_tv": 0.011586343280900762, + "aggregate_load_tv": 0.036163522012578615 + }, + "system_bos": { + "tokens": 106, + "ordered_topk_exact_tokens": 52, + "set_exact_tokens": 66, + "mean_set_jaccard": 0.8800539083557951, + "mean_token_weighted_tv": 0.01888271601308348, + "aggregate_load_tv": 0.05817610062893082 + }, + "system_x": { + "tokens": 106, + "ordered_topk_exact_tokens": 48, + "set_exact_tokens": 61, + "mean_set_jaccard": 0.8625336927223721, + "mean_token_weighted_tv": 0.02160303707603576, + "aggregate_load_tv": 0.07075471698113207 + }, + "system_period": { + "tokens": 106, + "ordered_topk_exact_tokens": 50, + "set_exact_tokens": 63, + "mean_set_jaccard": 0.8643306379155435, + "mean_token_weighted_tv": 0.021118465152059524, + "aggregate_load_tv": 0.07075471698113207 + }, + "bos_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 53, + "set_exact_tokens": 67, + "mean_set_jaccard": 0.8847708894878706, + "mean_token_weighted_tv": 0.02282220336942459, + "aggregate_load_tv": 0.05345911949685534 + }, + "bos_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 44, + "set_exact_tokens": 59, + "mean_set_jaccard": 0.8636567834681044, + "mean_token_weighted_tv": 0.02246411133311548, + "aggregate_load_tv": 0.047169811320754707 + }, + "x_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 52, + "set_exact_tokens": 66, + "mean_set_jaccard": 0.8840970350404314, + "mean_token_weighted_tv": 0.020080415022401314, + "aggregate_load_tv": 0.04874213836477987 + }, + "x_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 50, + "set_exact_tokens": 65, + "mean_set_jaccard": 0.8778077268643308, + "mean_token_weighted_tv": 0.021159955326748907, + "aggregate_load_tv": 0.050314465408805034 + }, + "period_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 53, + "set_exact_tokens": 66, + "mean_set_jaccard": 0.8825247079964061, + "mean_token_weighted_tv": 0.02013508636363835, + "aggregate_load_tv": 0.04874213836477987 + }, + "period_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 52, + "set_exact_tokens": 65, + "mean_set_jaccard": 0.8778077268643308, + "mean_token_weighted_tv": 0.020882907446544124, + "aggregate_load_tv": 0.04874213836477988 + } + } + }, + "layer_02": { + "layer": 2, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "cc20b25108140f754d0809d9560e13ca71402e5076a836a2ac19a15b86f0ae88", + "route_weight_sha256": "cf059acf2b352ff52d52827daabb845bf01160a6233a91246ee2fdca666ac3fe", + "loads": [ + 7, + 13, + 19, + 21, + 4, + 13, + 7, + 7, + 5, + 22, + 7, + 6, + 4, + 13, + 12, + 18, + 12, + 15, + 6, + 1, + 15, + 5, + 15, + 7, + 4, + 14, + 21, + 15, + 14, + 10, + 12, + 13, + 11, + 9, + 11, + 8, + 9, + 12, + 4, + 15, + 7, + 9, + 3, + 6, + 2, + 24, + 6, + 8, + 9, + 8, + 11, + 1, + 16, + 9, + 9, + 15, + 13, + 8, + 9, + 5, + 7, + 7, + 4, + 4 + ], + "weighted_loads": [ + 0.7139181420207024, + 1.018763829022646, + 1.0201019290834665, + 1.0522535797208548, + 0.11548941396176815, + 1.0667714588344097, + 0.2917012330144644, + 0.46198346838355064, + 0.36223581805825233, + 2.1924303863197565, + 0.2103768903762102, + 0.4404197633266449, + 0.25679318979382515, + 0.7068267855793238, + 0.46119103766977787, + 1.2412808276712894, + 0.6128811072558165, + 1.4009389393031597, + 0.31808464601635933, + 0.18959921598434448, + 1.3208111375570297, + 0.2689012475311756, + 2.1771317198872566, + 0.2728504966944456, + 0.20093796774744987, + 0.9110868126153946, + 1.3731565475463867, + 1.0419200956821442, + 1.1128719430416822, + 0.5632499270141125, + 0.7649323157966137, + 0.7903866451233625, + 1.078832808881998, + 0.6475670002400875, + 1.149782121181488, + 0.5248701628297567, + 0.6920597422868013, + 1.2350799459964037, + 0.40970284305512905, + 0.945006463676691, + 0.3644084557890892, + 0.5204959362745285, + 0.27682502567768097, + 0.3721795938909054, + 0.40122440457344055, + 1.733051035553217, + 0.39718060567975044, + 0.4200294651091099, + 0.7807779163122177, + 0.2780558727681637, + 1.205033479258418, + 0.04382197931408882, + 1.098573386669159, + 0.8048993200063705, + 0.30618302896618843, + 0.901391725987196, + 0.9315882958471775, + 0.45399213023483753, + 1.1268152669072151, + 0.2774914987385273, + 0.4050120636820793, + 0.6786950491368771, + 0.16930624842643738, + 0.17484395951032639 + ], + "unique_experts": 64, + "load_cv": 0.5237524992886008, + "normalized_load_entropy": 0.9664169030991824, + "max_load_share": 0.03773584905660377 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "0678383ebc30a245061990c5231f377474726d3019db5caadceb73058b46cc40", + "route_weight_sha256": "6c89bed242306fe28f0b9588b68d3f250bf1a12fab1f97248a7887fd00205b5a", + "loads": [ + 7, + 23, + 20, + 23, + 4, + 13, + 7, + 9, + 8, + 22, + 10, + 6, + 4, + 15, + 21, + 18, + 12, + 16, + 7, + 5, + 17, + 14, + 15, + 7, + 7, + 14, + 22, + 17, + 16, + 10, + 12, + 14, + 11, + 9, + 16, + 24, + 9, + 12, + 7, + 15, + 7, + 9, + 10, + 6, + 2, + 24, + 8, + 12, + 10, + 8, + 11, + 6, + 16, + 10, + 9, + 15, + 13, + 16, + 17, + 7, + 18, + 10, + 9, + 15 + ], + "weighted_loads": [ + 0.7139181420207024, + 1.964918576180935, + 1.0465061943978071, + 2.7543272133916616, + 0.11548941396176815, + 1.0667714588344097, + 0.2917012330144644, + 0.5884051993489265, + 0.5386082492768764, + 2.1924303863197565, + 0.33677191473543644, + 0.4404197633266449, + 0.25679318979382515, + 0.754680210724473, + 0.890381870791316, + 1.2412808276712894, + 0.6128811072558165, + 1.4016361007816158, + 0.31967189349234104, + 0.9300090074539185, + 1.6335365325212479, + 0.9641568921506405, + 2.1771317198872566, + 0.2728504966944456, + 0.3474470488727093, + 0.9110868126153946, + 1.3740022249985486, + 1.2904057279229164, + 1.320730036124587, + 0.5632499270141125, + 0.7649323157966137, + 0.7910821380792186, + 1.078832808881998, + 0.6475670002400875, + 1.374313086271286, + 2.6633953163400292, + 0.6920597422868013, + 1.2350799459964037, + 0.5032721413299441, + 0.945006463676691, + 0.3644084557890892, + 0.5204959362745285, + 1.0372595712542534, + 0.3721795938909054, + 0.40122440457344055, + 1.733051035553217, + 0.4639497809112072, + 0.6619398407638073, + 0.8061187248677015, + 0.2780558727681637, + 1.205033479258418, + 0.6557633429765701, + 1.098573386669159, + 0.8062125303549692, + 0.30618302896618843, + 0.901391725987196, + 0.9315882958471775, + 0.8914907034486532, + 1.4907280579209328, + 0.36310699582099915, + 1.2628194568678737, + 0.8261592760682106, + 0.563099529594183, + 0.7937237937003374 + ], + "unique_experts": 64, + "load_cv": 0.4400123133951726, + "normalized_load_entropy": 0.9765168626384779, + "max_load_share": 0.030534351145038167 + } + }, + "s1_eos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "f0c61856ed92b63cc4a12681f3f817cc4ff94e5e2475ef7f74a3bbf05f085668", + "route_weight_sha256": "832a0b2f7b13add79e65691b80429ac5a45c2be697d8d0a9e0b74fcc927646fc", + "loads": [ + 7, + 13, + 21, + 21, + 3, + 13, + 8, + 8, + 5, + 22, + 8, + 5, + 4, + 12, + 11, + 18, + 12, + 15, + 6, + 1, + 15, + 6, + 15, + 8, + 4, + 14, + 20, + 15, + 14, + 10, + 14, + 12, + 11, + 9, + 11, + 8, + 10, + 12, + 4, + 15, + 7, + 11, + 3, + 6, + 2, + 24, + 6, + 7, + 9, + 7, + 11, + 1, + 16, + 10, + 9, + 14, + 13, + 7, + 9, + 5, + 5, + 7, + 4, + 3 + ], + "weighted_loads": [ + 0.7088024467229843, + 1.017704326659441, + 1.0878480859100819, + 1.0641126055270433, + 0.09150998480618, + 1.0967178083956242, + 0.3269333653151989, + 0.5160004682838917, + 0.3629775755107403, + 2.190787533298135, + 0.24210764281451702, + 0.425576226785779, + 0.25826072692871094, + 0.669585881754756, + 0.41863836348056793, + 1.2506726626306772, + 0.6029183641076088, + 1.4250491373240948, + 0.3105910625308752, + 0.18823519349098206, + 1.3287735916674137, + 0.2996102496981621, + 2.1920013427734375, + 0.2974198590964079, + 0.19509639218449593, + 0.9104767125099897, + 1.3591413870453835, + 1.0446217358112335, + 1.1191357653588057, + 0.577217273414135, + 0.8512680940330029, + 0.7395233605057001, + 1.0795218870043755, + 0.6549798846244812, + 1.1481491662561893, + 0.49965750426054, + 0.7356636244803667, + 1.197759846225381, + 0.41347121447324753, + 0.9222799446433783, + 0.36803906597197056, + 0.5893736220896244, + 0.27759893238544464, + 0.37560591474175453, + 0.40389469265937805, + 1.7059247568249702, + 0.3932630382478237, + 0.37599952891469, + 0.7842868082225323, + 0.2534842025488615, + 1.2112133465707302, + 0.04369969666004181, + 1.0842203050851822, + 0.8344923239201307, + 0.3165533859282732, + 0.8893318604677916, + 0.9285186044871807, + 0.3986659497022629, + 1.104517675936222, + 0.27594029158353806, + 0.3271052297204733, + 0.6899002250283957, + 0.17025097832083702, + 0.14633166044950485 + ], + "unique_experts": 64, + "load_cv": 0.5303568896901725, + "normalized_load_entropy": 0.965291742094749, + "max_load_share": 0.03773584905660377 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "56d03c6199415ba7960f07dccb1bab5a069567593aed9c32b071620e37bbfb9f", + "route_weight_sha256": "db3912fc52f9bb3305df42ef9e22b77c692d255c7900164cb03ac5fdd4831e45", + "loads": [ + 11, + 24, + 24, + 24, + 4, + 14, + 8, + 12, + 14, + 23, + 15, + 5, + 4, + 15, + 23, + 19, + 14, + 16, + 7, + 7, + 17, + 16, + 16, + 8, + 11, + 15, + 21, + 18, + 18, + 10, + 15, + 14, + 11, + 9, + 20, + 26, + 10, + 13, + 9, + 18, + 7, + 11, + 13, + 7, + 5, + 24, + 13, + 14, + 11, + 8, + 12, + 9, + 17, + 14, + 9, + 14, + 18, + 14, + 11, + 13, + 16, + 13, + 14, + 17 + ], + "weighted_loads": [ + 1.2288674972951412, + 2.02279294654727, + 1.1601964179426432, + 2.801028626039624, + 0.12168855220079422, + 1.238207209855318, + 0.3269333653151989, + 0.7015574313700199, + 1.0857628118246794, + 2.307131314650178, + 0.5470846686512232, + 0.425576226785779, + 0.25826072692871094, + 0.7219446167000569, + 1.07068432867527, + 1.2833891715854406, + 0.6665951982140541, + 1.4256315685925074, + 0.31196707382332534, + 0.9670776464045048, + 1.6175894029438496, + 1.069699652493, + 2.2305893898010254, + 0.2974198590964079, + 0.5022405907511711, + 0.9607876595109701, + 1.3599623222835362, + 1.690429612994194, + 1.3392318431288004, + 0.577217273414135, + 0.885280191898346, + 0.7824199981987476, + 1.0795218870043755, + 0.6549798846244812, + 1.5148744471371174, + 2.3995297802612185, + 0.7356636244803667, + 1.2396582458168268, + 0.5682089710608125, + 1.276274060830474, + 0.36803906597197056, + 0.5893736220896244, + 1.4934269823133945, + 0.556410688906908, + 1.0520192235708237, + 1.7059247568249702, + 0.9954143259674311, + 0.7396041713654995, + 0.8527863156050444, + 0.2966319490224123, + 1.237504357472062, + 0.9471989497542381, + 1.260645568370819, + 1.018942695343867, + 0.3165533859282732, + 0.8893318604677916, + 1.2099577318876982, + 0.7344385012984276, + 1.2155008912086487, + 0.6311133652925491, + 1.029118156991899, + 1.1147190276533365, + 1.0073134452104568, + 1.175030568614602 + ], + "unique_experts": 64, + "load_cv": 0.38363567463128384, + "normalized_load_entropy": 0.9818786451936132, + "max_load_share": 0.02947845804988662 + } + }, + "s0_bos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "8827654982ef66e27369c49e26a33cfba0330af430bd4754f2ca6f0e06fe4b52", + "route_weight_sha256": "317a1f1231f8e74b416305627311da4c003486e655ed3d6b028d70ffcafe0944", + "loads": [ + 7, + 14, + 20, + 20, + 4, + 13, + 6, + 9, + 5, + 22, + 4, + 8, + 4, + 9, + 6, + 18, + 11, + 15, + 6, + 1, + 16, + 4, + 15, + 7, + 4, + 14, + 20, + 17, + 16, + 10, + 14, + 14, + 11, + 8, + 11, + 6, + 9, + 14, + 4, + 15, + 9, + 10, + 3, + 6, + 2, + 24, + 6, + 8, + 8, + 7, + 12, + 1, + 15, + 10, + 12, + 15, + 13, + 7, + 9, + 6, + 7, + 7, + 4, + 4 + ], + "weighted_loads": [ + 0.7813214436173439, + 1.0774461422115564, + 1.0382968038320541, + 1.0382337905466557, + 0.11573162861168385, + 1.077304482460022, + 0.25186987593770027, + 0.5223885178565979, + 0.3869449310004711, + 2.137728162109852, + 0.12290644831955433, + 0.48736200854182243, + 0.23686984553933144, + 0.5499054901301861, + 0.2851960379630327, + 1.2895991299301386, + 0.602395573630929, + 1.3083137422800064, + 0.305977176874876, + 0.17024874687194824, + 1.353322273120284, + 0.2286401130259037, + 2.215511240065098, + 0.2723542805761099, + 0.18383878096938133, + 0.8997251130640507, + 1.3435836844146252, + 1.101707335561514, + 1.235477151349187, + 0.5794040113687515, + 0.8800984546542168, + 0.9078010339289904, + 1.0645230114459991, + 0.6468969248235226, + 1.1305250078439713, + 0.3973444662988186, + 0.6804147157818079, + 1.3043489940464497, + 0.4150120485574007, + 0.9621757790446281, + 0.4701318237930536, + 0.555106196552515, + 0.2896214872598648, + 0.3861328326165676, + 0.43298108875751495, + 1.7321413103491068, + 0.40749670192599297, + 0.40324183367192745, + 0.7816809117794037, + 0.25888654217123985, + 1.281575160101056, + 0.05007157474756241, + 1.0685724336653948, + 0.8344874866306782, + 0.41265703178942204, + 0.9378944858908653, + 0.918526154011488, + 0.3809795007109642, + 1.0734587833285332, + 0.3042565006762743, + 0.4169070329517126, + 0.6713642030954361, + 0.23847166448831558, + 0.13604172877967358 + ], + "unique_experts": 64, + "load_cv": 0.5386453744762338, + "normalized_load_entropy": 0.9643333377750397, + "max_load_share": 0.03773584905660377 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "bc4ca5e40c2eb6dc93fa706b5f655e4da6c1e10d4ffcddd5e96c421c9b319f5b", + "route_weight_sha256": "b9b1847632d6461dc9a4bb0b9f600b4b061278a20fafd3c0cd3b6919cea0bddf", + "loads": [ + 7, + 24, + 21, + 21, + 4, + 13, + 6, + 11, + 8, + 22, + 7, + 8, + 5, + 10, + 13, + 18, + 12, + 15, + 6, + 5, + 19, + 13, + 15, + 7, + 6, + 14, + 20, + 19, + 18, + 10, + 14, + 14, + 11, + 8, + 16, + 23, + 9, + 14, + 8, + 15, + 9, + 10, + 11, + 6, + 2, + 24, + 9, + 12, + 9, + 7, + 12, + 6, + 15, + 10, + 12, + 15, + 13, + 15, + 17, + 9, + 19, + 9, + 10, + 16 + ], + "weighted_loads": [ + 0.7813214436173439, + 2.0236008893698454, + 1.0631781965494156, + 1.7674810625612736, + 0.11573162861168385, + 1.077304482460022, + 0.25186987593770027, + 0.6316887177526951, + 0.5791304148733616, + 2.137728162109852, + 0.24930147267878056, + 0.48736200854182243, + 0.26920297741889954, + 0.5761403627693653, + 0.5938619002699852, + 1.2895991299301386, + 0.6323110777884722, + 1.3083137422800064, + 0.305977176874876, + 0.8704004436731339, + 1.6630445532500744, + 0.934080321341753, + 2.215511240065098, + 0.2723542805761099, + 0.29028818383812904, + 0.8997251130640507, + 1.3435836844146252, + 1.355740923434496, + 1.4947608578950167, + 0.5794040113687515, + 0.8800984546542168, + 0.9078010339289904, + 1.0645230114459991, + 0.6468969248235226, + 1.3550559729337692, + 2.5926856165751815, + 0.6804147157818079, + 1.3043489940464497, + 0.5993940709158778, + 0.9621757790446281, + 0.4701318237930536, + 0.555106196552515, + 1.0849203541874886, + 0.3861328326165676, + 0.43298108875751495, + 1.7321413103491068, + 0.5085894577205181, + 0.6486582551151514, + 0.8070217203348875, + 0.25888654217123985, + 1.281575160101056, + 0.6777288131415844, + 1.0685724336653948, + 0.8344874866306782, + 0.41265703178942204, + 0.9378944858908653, + 0.918526154011488, + 0.7879742868244648, + 1.4373715743422508, + 0.4189817067235708, + 1.3486701371148229, + 0.7572733536362648, + 0.7145004980266094, + 1.045482810586691 + ], + "unique_experts": 64, + "load_cv": 0.42735215557487166, + "normalized_load_entropy": 0.9777418717608247, + "max_load_share": 0.030534351145038167 + } + }, + "s1_bos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "0176145ec3a2ff04034569af9e0a381b5331b3b047d5c5607d57bf33f81f0762", + "route_weight_sha256": "9db62570ddf697b967199f5ad10a94cbea3a6bddb05ec11789f649942fcc06c8", + "loads": [ + 7, + 13, + 20, + 21, + 3, + 13, + 6, + 9, + 5, + 22, + 6, + 6, + 5, + 9, + 5, + 17, + 10, + 15, + 7, + 1, + 16, + 4, + 15, + 8, + 4, + 14, + 21, + 15, + 16, + 10, + 14, + 13, + 11, + 10, + 11, + 7, + 10, + 13, + 3, + 13, + 9, + 14, + 3, + 6, + 2, + 24, + 6, + 7, + 9, + 8, + 11, + 1, + 15, + 9, + 13, + 17, + 13, + 7, + 9, + 6, + 6, + 7, + 4, + 2 + ], + "weighted_loads": [ + 0.7531993761658669, + 1.0687761809676886, + 1.0649756621569395, + 1.0896923374384642, + 0.09741212800145149, + 1.115555938333273, + 0.2684703581035137, + 0.5332884099334478, + 0.38256844505667686, + 2.174514716491103, + 0.18295059725642204, + 0.4500968437641859, + 0.2705118600279093, + 0.5365988090634346, + 0.23913229629397392, + 1.2986179627478123, + 0.5785626247525215, + 1.3350259810686111, + 0.3196950163692236, + 0.1759830266237259, + 1.3804914485663176, + 0.23031660728156567, + 2.2977909818291664, + 0.2943264991044998, + 0.18562314845621586, + 0.919719522818923, + 1.3910861890763044, + 1.006835237145424, + 1.223585657775402, + 0.5995277501642704, + 0.9133194889873266, + 0.828582938760519, + 1.0512725822627544, + 0.7204587236046791, + 1.142586499452591, + 0.42863287404179573, + 0.719341354444623, + 1.2506576925516129, + 0.40480655431747437, + 0.8566070683300495, + 0.4868853911757469, + 0.6907849833369255, + 0.2774161994457245, + 0.38122427836060524, + 0.4363980144262314, + 1.6966329216957092, + 0.4036793150007725, + 0.3497126270085573, + 0.8091153521090746, + 0.2804894279688597, + 1.232545891776681, + 0.03881770372390747, + 1.0246461927890778, + 0.8232811205089092, + 0.46325648203492165, + 1.044130377471447, + 0.8920364640653133, + 0.360821008682251, + 1.0751371085643768, + 0.3020906876772642, + 0.35034796595573425, + 0.7088081203401089, + 0.2027033045887947, + 0.08265721425414085 + ], + "unique_experts": 64, + "load_cv": 0.5433248846715838, + "normalized_load_entropy": 0.9633411278532145, + "max_load_share": 0.03773584905660377 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "39279a35bd4333bb6d76558ddfc9a9b7b809bb2b7a9e613661ea9d301cfb5b01", + "route_weight_sha256": "0b099e66a329c897228fabed70f353a3ca08417ae22b26d17815a90f0a361e33", + "loads": [ + 11, + 24, + 23, + 24, + 4, + 14, + 6, + 13, + 14, + 23, + 13, + 6, + 6, + 11, + 16, + 18, + 13, + 15, + 7, + 7, + 18, + 14, + 16, + 8, + 10, + 15, + 21, + 18, + 20, + 10, + 15, + 15, + 11, + 10, + 20, + 26, + 10, + 14, + 9, + 16, + 9, + 14, + 14, + 7, + 5, + 24, + 13, + 14, + 11, + 9, + 12, + 9, + 16, + 12, + 13, + 17, + 18, + 13, + 11, + 14, + 18, + 14, + 15, + 16 + ], + "weighted_loads": [ + 1.2732644267380238, + 2.0738648008555174, + 1.140897361561656, + 1.8836122620850801, + 0.1275906953960657, + 1.2570453397929668, + 0.2684703581035137, + 0.7030474562197924, + 1.122596526518464, + 2.2908584978431463, + 0.4879276230931282, + 0.4500968437641859, + 0.29832240380346775, + 0.5870923325419426, + 0.7896385360509157, + 1.3313344717025757, + 0.6710498202592134, + 1.3350259810686111, + 0.3196950163692236, + 0.9017834104597569, + 1.6543177496641874, + 1.0228318367153406, + 2.3363790288567543, + 0.2943264991044998, + 0.46092921681702137, + 0.9700304698199034, + 1.3910861890763044, + 1.6640492528676987, + 1.4924228377640247, + 0.5995277501642704, + 0.9473315868526697, + 0.8714795764535666, + 1.0512725822627544, + 0.7204587236046791, + 1.509311780333519, + 2.420198197476566, + 0.719341354444623, + 1.2925560921430588, + 0.6695600422099233, + 1.2106011845171452, + 0.4868853911757469, + 0.6907849833369255, + 1.5210047345608473, + 0.5620290525257587, + 1.084522545337677, + 1.6966329216957092, + 1.0149288028478622, + 0.7169520128518343, + 0.8776148594915867, + 0.32363717444241047, + 1.2588369026780128, + 0.9841586947441101, + 1.2010714560747147, + 1.006648249924183, + 0.46325648203492165, + 1.044130377471447, + 1.1734755914658308, + 0.6278726607561111, + 1.1861203238368034, + 0.6572637613862753, + 1.1128637930378318, + 1.150075914338231, + 1.1202010437846184, + 1.2731048073619604 + ], + "unique_experts": 64, + "load_cv": 0.364727087400127, + "normalized_load_entropy": 0.9837426206291194, + "max_load_share": 0.02947845804988662 + } + }, + "s0_x": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "e07bd84f3bc1bcaee171481a472ec4f0c990706ac1acab93f291d69ecfde6cdc", + "route_weight_sha256": "c4ccc5fb67047b29997fe134a45270ec55ecf335de540190d8e299b8634a54f5", + "loads": [ + 7, + 12, + 22, + 19, + 4, + 13, + 7, + 9, + 5, + 22, + 3, + 7, + 5, + 10, + 7, + 18, + 11, + 15, + 6, + 1, + 15, + 4, + 15, + 9, + 5, + 14, + 20, + 17, + 15, + 10, + 14, + 12, + 11, + 8, + 11, + 8, + 8, + 14, + 4, + 15, + 9, + 10, + 3, + 6, + 3, + 24, + 6, + 9, + 8, + 9, + 12, + 1, + 16, + 9, + 11, + 14, + 13, + 7, + 9, + 6, + 5, + 8, + 4, + 2 + ], + "weighted_loads": [ + 0.7749966382980347, + 1.0305372178554535, + 1.1029793582856655, + 1.024844627827406, + 0.11543266288936138, + 1.0765878073871136, + 0.2898529674857855, + 0.5267252307385206, + 0.38222842663526535, + 2.172145336866379, + 0.09267738275229931, + 0.46524142287671566, + 0.2819359563291073, + 0.5911920703947544, + 0.30345737747848034, + 1.2814663406461477, + 0.5893978253006935, + 1.3755415454506874, + 0.2990255393087864, + 0.17286857962608337, + 1.3147963676601648, + 0.2323075383901596, + 2.2002994790673256, + 0.32162580266594887, + 0.21561218239367008, + 0.9166990239173174, + 1.3475116975605488, + 1.1069624908268452, + 1.1866936050355434, + 0.5700590945780277, + 0.8670158535242081, + 0.7731993403285742, + 1.0504658296704292, + 0.6134267020970583, + 1.1307125426828861, + 0.4908287860453129, + 0.6520395074039698, + 1.2748374436050653, + 0.39822263084352016, + 0.9624651856720448, + 0.44424702040851116, + 0.5408907663077116, + 0.2789168283343315, + 0.37658514082431793, + 0.4375362880527973, + 1.7200051806867123, + 0.4049448035657406, + 0.4171672984957695, + 0.7708772998303175, + 0.3125351332128048, + 1.2579044308513403, + 0.04171070083975792, + 1.1014343928545713, + 0.7876347862184048, + 0.38266970962285995, + 0.8826144244521856, + 0.9002900570631027, + 0.37456491962075233, + 1.0598600506782532, + 0.3057815805077553, + 0.3437618128955364, + 0.7240065783262253, + 0.22454574704170227, + 0.08271750994026661 + ], + "unique_experts": 64, + "load_cv": 0.5321438616707556, + "normalized_load_entropy": 0.9651384057883976, + "max_load_share": 0.03773584905660377 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "55366659d918262ee71a65928d143e7d1551034019fed9bed6fd47e3d989eada", + "route_weight_sha256": "f1a17bbf1c5be69fd523900e77ed57ce93e0b997d6fbbb26e92aa9a81c7a0d72", + "loads": [ + 7, + 22, + 23, + 20, + 4, + 13, + 8, + 11, + 8, + 22, + 8, + 8, + 6, + 11, + 14, + 18, + 12, + 15, + 6, + 5, + 17, + 14, + 15, + 9, + 7, + 14, + 20, + 19, + 17, + 10, + 14, + 12, + 11, + 8, + 16, + 24, + 8, + 14, + 7, + 15, + 9, + 10, + 10, + 6, + 3, + 24, + 8, + 14, + 9, + 9, + 13, + 6, + 16, + 9, + 11, + 14, + 13, + 14, + 18, + 8, + 18, + 10, + 9, + 13 + ], + "weighted_loads": [ + 0.7749966382980347, + 1.9766919650137424, + 1.1309201046824455, + 1.7540918998420238, + 0.11543266288936138, + 1.0765878073871136, + 0.32476520724594593, + 0.6329644676297903, + 0.5647850222885609, + 2.172145336866379, + 0.327559320256114, + 0.5003078486770391, + 0.31158167868852615, + 0.6177027076482773, + 0.6123670991510153, + 1.2814663406461477, + 0.620056314393878, + 1.3755415454506874, + 0.2990255393087864, + 0.885008841753006, + 1.6148444805294275, + 1.234803095459938, + 2.2002994790673256, + 0.32162580266594887, + 0.31984727643430233, + 0.9166990239173174, + 1.3475116975605488, + 1.3529635630548, + 1.446169774979353, + 0.5700590945780277, + 0.8670158535242081, + 0.7731993403285742, + 1.0504658296704292, + 0.6134267020970583, + 1.355243507772684, + 2.6199067225679755, + 0.6520395074039698, + 1.2748374436050653, + 0.4921100726351142, + 0.9624651856720448, + 0.44424702040851116, + 0.5408907663077116, + 0.9859348945319653, + 0.37658514082431793, + 0.4375362880527973, + 1.7200051806867123, + 0.47171397879719734, + 0.693684171885252, + 0.7962181083858013, + 0.3125351332128048, + 1.2811326440423727, + 0.6232838556170464, + 1.1014343928545713, + 0.7876347862184048, + 0.38266970962285995, + 0.8826144244521856, + 0.9002900570631027, + 0.7399755120277405, + 1.5524780303239822, + 0.3913970775902271, + 1.3278349721804261, + 0.809915728867054, + 0.6462535262107849, + 0.6546409651637077 + ], + "unique_experts": 64, + "load_cv": 0.4133039332941418, + "normalized_load_entropy": 0.979570932022044, + "max_load_share": 0.030534351145038167 + } + }, + "s1_x": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "3ca02828cab26d5623eaeda462602b735de37c072bb5eb8cd81ada692123c54d", + "route_weight_sha256": "d8654b4b6bd9c2652c319d650a1f8e14f99988729271c933fa2f5f9bba222691", + "loads": [ + 7, + 12, + 22, + 20, + 3, + 13, + 6, + 9, + 5, + 22, + 7, + 7, + 5, + 10, + 5, + 17, + 10, + 16, + 7, + 1, + 16, + 4, + 15, + 8, + 3, + 14, + 21, + 14, + 16, + 10, + 14, + 14, + 11, + 10, + 11, + 9, + 9, + 14, + 3, + 13, + 8, + 13, + 3, + 6, + 2, + 24, + 6, + 8, + 8, + 8, + 11, + 1, + 15, + 9, + 13, + 15, + 13, + 7, + 9, + 6, + 5, + 7, + 4, + 2 + ], + "weighted_loads": [ + 0.763949066400528, + 1.016626462340355, + 1.1217796877026558, + 1.0597002916038036, + 0.0974863562732935, + 1.125016912817955, + 0.2705776132643223, + 0.529625715687871, + 0.38628091663122177, + 2.1785879135131836, + 0.2123872172087431, + 0.4774225018918514, + 0.2860104162245989, + 0.5603717267513275, + 0.23863746598362923, + 1.3092497065663338, + 0.5654781255871058, + 1.3937556147575378, + 0.31292653270065784, + 0.17598509788513184, + 1.3849727753549814, + 0.2330777272582054, + 2.3043280988931656, + 0.29629326798021793, + 0.1592130120843649, + 0.9201638884842396, + 1.390529377385974, + 0.9651778489351273, + 1.2061929795891047, + 0.601969238370657, + 0.9043925125151873, + 0.8107853922992945, + 1.0455980971455574, + 0.7120308317244053, + 1.150918759405613, + 0.5162900052964687, + 0.69570242613554, + 1.233569085597992, + 0.390296533703804, + 0.8579851649701595, + 0.446811456233263, + 0.6579021718353033, + 0.2722684219479561, + 0.3729134872555733, + 0.4323715269565582, + 1.6919267401099205, + 0.4064393565058708, + 0.36719577200710773, + 0.7758942432701588, + 0.283516600728035, + 1.2121647242456675, + 0.0357549823820591, + 1.0262809172272682, + 0.7967966496944427, + 0.46252977289259434, + 0.9608589950948954, + 0.885766688734293, + 0.36357181519269943, + 1.0697885006666183, + 0.3000353332608938, + 0.31413804180920124, + 0.7086993735283613, + 0.19466983154416084, + 0.07973539642989635 + ], + "unique_experts": 64, + "load_cv": 0.5439069926565877, + "normalized_load_entropy": 0.963210484351768, + "max_load_share": 0.03773584905660377 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "d1c388755f921fc438bcc81788c0772328388179bd38eaafb41f48b6d8cbafc3", + "route_weight_sha256": "2e408882001428c7d8ad23c31820590c0b8106c431f007f7682582138cada0ab", + "loads": [ + 11, + 23, + 24, + 22, + 4, + 14, + 6, + 13, + 14, + 23, + 16, + 8, + 6, + 11, + 15, + 18, + 13, + 16, + 7, + 7, + 18, + 15, + 16, + 8, + 9, + 15, + 21, + 17, + 20, + 10, + 15, + 16, + 11, + 10, + 20, + 28, + 9, + 15, + 8, + 16, + 8, + 13, + 13, + 7, + 5, + 24, + 13, + 16, + 10, + 9, + 14, + 8, + 16, + 12, + 13, + 15, + 18, + 13, + 12, + 14, + 18, + 14, + 14, + 15 + ], + "weighted_loads": [ + 1.2840141169726849, + 2.0217150822281837, + 1.1777733024209738, + 1.8210577331483364, + 0.12766492366790771, + 1.266506314277649, + 0.2705776132643223, + 0.6954357344657183, + 1.1193918082863092, + 2.2949316948652267, + 0.6321229767054319, + 0.5123686827719212, + 0.3121378645300865, + 0.5844945348799229, + 0.7473972514271736, + 1.3419662155210972, + 0.6631022710353136, + 1.3937556147575378, + 0.31292653270065784, + 0.9115872420370579, + 1.6604699436575174, + 1.3079666160047054, + 2.3429161459207535, + 0.29629326798021793, + 0.4331414606422186, + 0.97047483548522, + 1.390529377385974, + 1.6188849657773972, + 1.47338848374784, + 0.601969238370657, + 0.9384046103805304, + 0.853682029992342, + 1.0455980971455574, + 0.7120308317244053, + 1.517644040286541, + 2.4800143716856837, + 0.69570242613554, + 1.2754674851894379, + 0.5370358908548951, + 1.2119792811572552, + 0.446811456233263, + 0.6579021718353033, + 1.4492880143225193, + 0.5537182614207268, + 1.0804960578680038, + 1.6919267401099205, + 1.015536230057478, + 0.7624508421868086, + 0.8443937506526709, + 0.32666434720158577, + 1.2894485257565975, + 0.9175136126577854, + 1.2027061805129051, + 0.9801637791097164, + 0.46252977289259434, + 0.9608589950948954, + 1.1672058161348104, + 0.6323708146810532, + 1.2867366969585419, + 0.6552084069699049, + 1.1201240150257945, + 1.1437269430607557, + 1.0547056011855602, + 1.0022705346345901 + ], + "unique_experts": 64, + "load_cv": 0.36831847116688826, + "normalized_load_entropy": 0.9834701524480606, + "max_load_share": 0.031746031746031744 + } + }, + "s0_period": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "32af30e028713c74b052db9a5d0f984511ab284ab24c5e278901ed2632a57858", + "route_weight_sha256": "11e157a2c30537f7d491ba3e041aee8f38d3d994f0d8d869a13141eefa2c312e", + "loads": [ + 7, + 12, + 22, + 20, + 3, + 13, + 6, + 9, + 5, + 22, + 3, + 8, + 5, + 10, + 8, + 17, + 11, + 15, + 6, + 1, + 15, + 4, + 15, + 8, + 4, + 14, + 20, + 15, + 19, + 10, + 14, + 12, + 11, + 9, + 11, + 8, + 9, + 13, + 4, + 15, + 9, + 10, + 3, + 6, + 3, + 24, + 6, + 8, + 9, + 10, + 12, + 1, + 16, + 10, + 10, + 14, + 13, + 7, + 9, + 6, + 4, + 7, + 4, + 2 + ], + "weighted_loads": [ + 0.7776240035891533, + 1.0277094058692455, + 1.1063058320432901, + 1.0568351559340954, + 0.09297908842563629, + 1.074068583548069, + 0.2574187908321619, + 0.5217319279909134, + 0.3805094175040722, + 2.180737441405654, + 0.09253405965864658, + 0.49372692592442036, + 0.2804193589836359, + 0.5935327187180519, + 0.3393563535064459, + 1.2523407712578773, + 0.593925254419446, + 1.3835387714207172, + 0.29772964864969254, + 0.17254763841629028, + 1.3156724758446217, + 0.23265656270086765, + 2.2000825852155685, + 0.29259971156716347, + 0.19092379324138165, + 0.921060124412179, + 1.3447501733899117, + 1.0404565148055553, + 1.2900637909770012, + 0.573854248970747, + 0.8686597663909197, + 0.7699382621794939, + 1.0536065697669983, + 0.6503441259264946, + 1.1291146278381348, + 0.484879057854414, + 0.6746400222182274, + 1.2475140485912561, + 0.3946695774793625, + 0.9654893055558205, + 0.4475203603506088, + 0.5439894553273916, + 0.27496153116226196, + 0.37658169865608215, + 0.43607609532773495, + 1.7135733850300312, + 0.40152643993496895, + 0.3865526709705591, + 0.7922342009842396, + 0.34277824498713017, + 1.264101479202509, + 0.04232319816946983, + 1.0973282475024462, + 0.8228171952068806, + 0.358629597350955, + 0.8852278422564268, + 0.8971166685223579, + 0.37048352509737015, + 1.0646711215376854, + 0.3096226919442415, + 0.3222280256450176, + 0.6854627970606089, + 0.22165348380804062, + 0.08034084364771843 + ], + "unique_experts": 64, + "load_cv": 0.5409901892585632, + "normalized_load_entropy": 0.9638281746625448, + "max_load_share": 0.03773584905660377 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "fd9ba3411bbbbd4c76ed9708edeb0821d8060a004f65d7099bee27e67608ac00", + "route_weight_sha256": "02bea9eb07eba2f17800d9fa7610a6d0d03b768133e872ba42a4b70476dd5a87", + "loads": [ + 8, + 22, + 23, + 22, + 3, + 13, + 6, + 11, + 9, + 22, + 6, + 8, + 5, + 11, + 15, + 18, + 11, + 15, + 6, + 5, + 17, + 13, + 15, + 8, + 7, + 14, + 20, + 17, + 21, + 10, + 14, + 12, + 11, + 10, + 16, + 23, + 9, + 13, + 8, + 15, + 9, + 10, + 10, + 6, + 3, + 24, + 9, + 13, + 11, + 10, + 13, + 6, + 16, + 10, + 10, + 14, + 13, + 14, + 17, + 8, + 18, + 9, + 9, + 12 + ], + "weighted_loads": [ + 1.0715897008776665, + 1.9738641530275345, + 1.1337451785802841, + 1.8189552873373032, + 0.09297908842563629, + 1.074068583548069, + 0.2574187908321619, + 0.6328213103115559, + 0.6112201251089573, + 2.180737441405654, + 0.2189290840178728, + 0.49372692592442036, + 0.2804193589836359, + 0.6198514234274626, + 0.6431686319410801, + 1.2974858805537224, + 0.593925254419446, + 1.3835387714207172, + 0.29772964864969254, + 0.9102802574634552, + 1.558425422757864, + 1.1077789384871721, + 2.2000825852155685, + 0.29259971156716347, + 0.32481736317276955, + 0.921060124412179, + 1.3447501733899117, + 1.2881415821611881, + 1.5205465853214264, + 0.573854248970747, + 0.8686597663909197, + 0.7699382621794939, + 1.0536065697669983, + 0.6983236595988274, + 1.3536455929279327, + 2.553817323409021, + 0.6746400222182274, + 1.2475140485912561, + 0.5481265457347035, + 0.9654893055558205, + 0.4475203603506088, + 0.5439894553273916, + 1.003056064248085, + 0.37658169865608215, + 0.43607609532773495, + 1.7135733850300312, + 0.4943249300122261, + 0.6659772414714098, + 0.8434964418411255, + 0.34277824498713017, + 1.2874065767973661, + 0.6036486476659775, + 1.0973282475024462, + 0.8228171952068806, + 0.358629597350955, + 0.8852278422564268, + 0.8971166685223579, + 0.7340274341404438, + 1.428583912551403, + 0.39523818902671337, + 1.3068084912374616, + 0.7713719476014376, + 0.6451274380087852, + 0.604772387072444 + ], + "unique_experts": 64, + "load_cv": 0.4190291974818708, + "normalized_load_entropy": 0.978825838557918, + "max_load_share": 0.030534351145038167 + } + }, + "s1_period": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "f8cd8cbbc6935c47b828dcaf178aac96941d9ac3f4971d0f7d5cd39bc6ba950d", + "route_weight_sha256": "ba9dd0a752604e2c83ac3ede44ee7fee0ff18f2c2dc24f08bfbc3ecf16ebbd76", + "loads": [ + 7, + 12, + 22, + 20, + 3, + 13, + 6, + 9, + 5, + 22, + 6, + 7, + 5, + 10, + 5, + 18, + 10, + 16, + 7, + 1, + 16, + 4, + 15, + 9, + 3, + 14, + 21, + 14, + 16, + 10, + 14, + 14, + 11, + 10, + 11, + 8, + 10, + 14, + 3, + 13, + 8, + 13, + 3, + 6, + 2, + 24, + 6, + 7, + 8, + 8, + 11, + 1, + 15, + 9, + 13, + 16, + 13, + 7, + 9, + 6, + 4, + 7, + 4, + 2 + ], + "weighted_loads": [ + 0.7615537494421005, + 1.0200648996978998, + 1.126186853274703, + 1.063328417018056, + 0.09773083031177521, + 1.1193039156496525, + 0.27173405326902866, + 0.5307207815349102, + 0.382339783012867, + 2.1812825202941895, + 0.1824882086366415, + 0.47735537588596344, + 0.287250192835927, + 0.5587045587599277, + 0.24002771079540253, + 1.3291756883263588, + 0.5668461881577969, + 1.3983742073178291, + 0.31524997763335705, + 0.1751265823841095, + 1.3814164083451033, + 0.23246979340910912, + 2.303097575902939, + 0.3223415743559599, + 0.15846962481737137, + 0.9227949492633343, + 1.3935838714241982, + 0.9635681658983231, + 1.2106676641851664, + 0.6063421182334423, + 0.9046164974570274, + 0.7998914010822773, + 1.047719333320856, + 0.7053376995027065, + 1.1465115956962109, + 0.4961876180022955, + 0.716212434694171, + 1.2313646171241999, + 0.3906952142715454, + 0.8590084575116634, + 0.44783712923526764, + 0.6576794814318419, + 0.27064701169729233, + 0.37726307287812233, + 0.42862771451473236, + 1.6897232588380575, + 0.40270955115556717, + 0.3364249151200056, + 0.7769462950527668, + 0.28263150714337826, + 1.2127590626478195, + 0.03592631220817566, + 1.0221943594515324, + 0.7980007864534855, + 0.4669128470122814, + 0.9928012099117041, + 0.8800042904913425, + 0.3588275946676731, + 1.070829339325428, + 0.30005818605422974, + 0.291401170194149, + 0.7007174678146839, + 0.1966327540576458, + 0.07784553430974483 + ], + "unique_experts": 64, + "load_cv": 0.5508443091735221, + "normalized_load_entropy": 0.9622779599135183, + "max_load_share": 0.03773584905660377 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "1eb73bad063d9c6fa2b5e86d939e78bca98970b6c3ad4e5ad6e7eeaa0a87f045", + "route_weight_sha256": "37512aa9dbe5a8aeb438c73443feee33387cdc8b788efa0bbacbe7e4cf68fa4b", + "loads": [ + 12, + 23, + 24, + 23, + 4, + 14, + 6, + 13, + 15, + 23, + 13, + 7, + 5, + 11, + 15, + 20, + 13, + 16, + 7, + 7, + 18, + 14, + 16, + 9, + 9, + 15, + 21, + 17, + 20, + 10, + 15, + 16, + 11, + 11, + 20, + 25, + 10, + 15, + 9, + 16, + 8, + 13, + 13, + 7, + 5, + 24, + 14, + 15, + 11, + 9, + 14, + 8, + 16, + 12, + 13, + 16, + 18, + 13, + 11, + 14, + 18, + 14, + 14, + 14 + ], + "weighted_loads": [ + 1.549279447644949, + 2.0251535195857286, + 1.181911937892437, + 1.8598962482064962, + 0.12790939770638943, + 1.2607933171093464, + 0.27173405326902866, + 0.7022539004683495, + 1.1606672015041113, + 2.2976263016462326, + 0.48746523447334766, + 0.47735537588596344, + 0.287250192835927, + 0.5828273668885231, + 0.7415453437715769, + 1.3969186916947365, + 0.6635053381323814, + 1.3983742073178291, + 0.31524997763335705, + 0.9403796829283237, + 1.614644756540656, + 1.1341755092144012, + 2.3416856229305267, + 0.3223415743559599, + 0.43217651546001434, + 0.9731058962643147, + 1.3935838714241982, + 1.6195764541625977, + 1.4495582785457373, + 0.6063421182334423, + 0.9386285953223705, + 0.8427880387753248, + 1.047719333320856, + 0.7451374232769012, + 1.513236876577139, + 2.36447883117944, + 0.716212434694171, + 1.2732630167156458, + 0.6062805177643895, + 1.213002573698759, + 0.44783712923526764, + 0.6576794814318419, + 1.4615768864750862, + 0.5580678470432758, + 1.076752245426178, + 1.6897232588380575, + 1.0374806858599186, + 0.7361821178346872, + 0.8700117282569408, + 0.32577925361692905, + 1.2902433667331934, + 0.8886561915278435, + 1.1986196227371693, + 0.9813679158687592, + 0.4669128470122814, + 0.9928012099117041, + 1.16144341789186, + 0.627164900302887, + 1.1818125545978546, + 0.6552312597632408, + 1.1105678034946322, + 1.14013228751719, + 1.0569113492965698, + 0.946599867194891 + ], + "unique_experts": 64, + "load_cv": 0.36178283796902383, + "normalized_load_entropy": 0.9838525642659067, + "max_load_share": 0.02834467120181406 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 106, + "ordered_topk_exact_tokens": 81, + "set_exact_tokens": 88, + "mean_set_jaccard": 0.9514824797843666, + "mean_token_weighted_tv": 0.009863773308132054, + "aggregate_load_tv": 0.020440251572327046 + }, + "system_bos": { + "tokens": 106, + "ordered_topk_exact_tokens": 64, + "set_exact_tokens": 79, + "mean_set_jaccard": 0.925202156334232, + "mean_token_weighted_tv": 0.01703526871278882, + "aggregate_load_tv": 0.031446540880503145 + }, + "system_x": { + "tokens": 106, + "ordered_topk_exact_tokens": 64, + "set_exact_tokens": 77, + "mean_set_jaccard": 0.9198113207547172, + "mean_token_weighted_tv": 0.018224691532833397, + "aggregate_load_tv": 0.03459119496855346 + }, + "system_period": { + "tokens": 106, + "ordered_topk_exact_tokens": 65, + "set_exact_tokens": 79, + "mean_set_jaccard": 0.925202156334232, + "mean_token_weighted_tv": 0.017713503771514264, + "aggregate_load_tv": 0.03459119496855346 + }, + "bos_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 54, + "set_exact_tokens": 68, + "mean_set_jaccard": 0.889487870619946, + "mean_token_weighted_tv": 0.024373016820974508, + "aggregate_load_tv": 0.03930817610062893 + }, + "bos_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 60, + "set_exact_tokens": 73, + "mean_set_jaccard": 0.9070080862533693, + "mean_token_weighted_tv": 0.02200270359808544, + "aggregate_load_tv": 0.04088050314465409 + }, + "x_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 56, + "set_exact_tokens": 69, + "mean_set_jaccard": 0.8962264150943396, + "mean_token_weighted_tv": 0.02140951968448342, + "aggregate_load_tv": 0.04402515723270441 + }, + "x_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 57, + "set_exact_tokens": 72, + "mean_set_jaccard": 0.9043126684636119, + "mean_token_weighted_tv": 0.021908039543426263, + "aggregate_load_tv": 0.04402515723270441 + }, + "period_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 56, + "set_exact_tokens": 69, + "mean_set_jaccard": 0.8962264150943396, + "mean_token_weighted_tv": 0.021468450429515458, + "aggregate_load_tv": 0.04245283018867924 + }, + "period_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 56, + "set_exact_tokens": 69, + "mean_set_jaccard": 0.8962264150943396, + "mean_token_weighted_tv": 0.02251767243241083, + "aggregate_load_tv": 0.04402515723270441 + } + } + }, + "layer_03": { + "layer": 3, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "5c708656f66dbccaf27909a933700a3f4e6c9ef47b9516930df25024551145f2", + "route_weight_sha256": "2f412c8729e0a98ba795e323b06afdc63660bbb34b1eb2b7d1320b992334e0c1", + "loads": [ + 2, + 10, + 20, + 10, + 18, + 5, + 19, + 2, + 12, + 0, + 9, + 8, + 21, + 5, + 9, + 6, + 7, + 1, + 7, + 11, + 8, + 17, + 6, + 4, + 20, + 12, + 36, + 10, + 9, + 7, + 9, + 5, + 11, + 12, + 17, + 5, + 17, + 10, + 10, + 17, + 11, + 9, + 5, + 22, + 3, + 4, + 6, + 18, + 1, + 11, + 2, + 5, + 13, + 2, + 14, + 6, + 15, + 6, + 4, + 21, + 4, + 15, + 13, + 2 + ], + "weighted_loads": [ + 0.075216980651021, + 0.3996259495615959, + 0.9685515146702528, + 0.520164530724287, + 1.3389092553406954, + 0.2114521525800228, + 1.3844496794044971, + 0.06382112763822079, + 1.3161378856748343, + 0.0, + 0.5358419176191092, + 0.4489046800881624, + 1.5114770252257586, + 0.18419169262051582, + 0.8164339493960142, + 0.19671044498682022, + 0.5821663476526737, + 0.024105118587613106, + 0.24450990371406078, + 0.7747996337711811, + 0.4261648003011942, + 2.5407507978379726, + 0.36695078015327454, + 0.1258755810558796, + 1.637579521164298, + 0.8086502458900213, + 3.7110604532063007, + 0.7138015180826187, + 0.6026349645107985, + 0.5579756535589695, + 1.072098407894373, + 0.4178365860134363, + 0.9674594588577747, + 0.9293294511735439, + 0.8376033399254084, + 0.265037352219224, + 1.095077995210886, + 0.6168859396129847, + 0.8733101412653923, + 1.2535908855497837, + 0.6763572916388512, + 0.3819702323526144, + 0.20346294529736042, + 1.6010248698294163, + 0.12597401440143585, + 0.4421975612640381, + 0.2988450061529875, + 1.529038231819868, + 0.03754769265651703, + 0.41277920082211494, + 0.08173449337482452, + 0.45444876328110695, + 0.8844436332583427, + 0.06659658625721931, + 1.6718143709003925, + 0.49966079741716385, + 1.6261582225561142, + 0.2441426645964384, + 0.39598775655031204, + 1.6407230086624622, + 0.11875336803495884, + 1.4048662036657333, + 1.382305547595024, + 0.15328311920166016 + ], + "unique_experts": 63, + "load_cv": 0.6669929188642996, + "normalized_load_entropy": 0.9473231297423207, + "max_load_share": 0.05660377358490566 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "c33d89f6699fa2b5883a5bff26a7d4995403f13323fa39048663f488ae946295", + "route_weight_sha256": "5ae0c6919b27694cac8ffd478c07223edeb3aea862207d449983dc119ce0be59", + "loads": [ + 11, + 10, + 20, + 21, + 21, + 7, + 19, + 10, + 12, + 5, + 10, + 9, + 23, + 9, + 16, + 6, + 7, + 1, + 7, + 11, + 10, + 20, + 12, + 6, + 20, + 14, + 36, + 17, + 9, + 11, + 11, + 5, + 11, + 12, + 26, + 5, + 17, + 10, + 10, + 17, + 11, + 10, + 14, + 22, + 3, + 4, + 19, + 18, + 8, + 21, + 2, + 5, + 14, + 2, + 18, + 7, + 15, + 7, + 5, + 21, + 11, + 15, + 16, + 4 + ], + "weighted_loads": [ + 1.3786082807928324, + 0.3996259495615959, + 0.9685515146702528, + 1.1764625161886215, + 1.5602519758976996, + 0.30647071450948715, + 1.3844496794044971, + 1.2319990899413824, + 1.3161378856748343, + 0.2155721224262379, + 0.5716727431863546, + 0.4497846794547513, + 1.5234791113471147, + 0.5270496644079685, + 1.35649318061769, + 0.19671044498682022, + 0.5821663476526737, + 0.024105118587613106, + 0.24450990371406078, + 0.7747996337711811, + 0.4994556400924921, + 2.823532324284315, + 0.8048937991261482, + 0.18881351687014103, + 1.637579521164298, + 0.822323709668126, + 3.7110604532063007, + 0.9756804686039686, + 0.6026349645107985, + 0.7604935839772224, + 1.1474294029176235, + 0.4178365860134363, + 0.9674594588577747, + 0.9293294511735439, + 1.8690871614962816, + 0.265037352219224, + 1.095077995210886, + 0.6168859396129847, + 0.8733101412653923, + 1.2535908855497837, + 0.6763572916388512, + 0.39336081128567457, + 0.747603403404355, + 1.6010248698294163, + 0.12597401440143585, + 0.4421975612640381, + 1.9286282416433096, + 1.529038231819868, + 0.8180567994713783, + 1.0296606868505478, + 0.08173449337482452, + 0.45444876328110695, + 0.899182241410017, + 0.06659658625721931, + 3.504579607397318, + 0.5467802584171295, + 1.6261582225561142, + 0.2569370772689581, + 0.46562591195106506, + 1.6407230086624622, + 0.6307383645325899, + 1.4048662036657333, + 1.7073907479643822, + 0.2272137515246868 + ], + "unique_experts": 64, + "load_cv": 0.5444043993723834, + "normalized_load_entropy": 0.9640690921728908, + "max_load_share": 0.04580152671755725 + } + }, + "s1_eos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "f401d8f201401151d30b82f7b8ae26f633a72c34c197a86c39e221e4818e3794", + "route_weight_sha256": "3121776a37d1a45ae5257ea5417f41f0fa37d6051a68b4ca97f1f667e60b0caa", + "loads": [ + 2, + 10, + 19, + 10, + 18, + 5, + 21, + 2, + 11, + 0, + 8, + 8, + 21, + 5, + 9, + 5, + 7, + 3, + 7, + 11, + 7, + 17, + 5, + 4, + 20, + 14, + 35, + 10, + 8, + 7, + 9, + 5, + 12, + 12, + 17, + 6, + 17, + 11, + 11, + 17, + 10, + 9, + 5, + 22, + 3, + 4, + 6, + 18, + 0, + 11, + 2, + 5, + 13, + 2, + 14, + 6, + 16, + 6, + 4, + 21, + 3, + 15, + 13, + 2 + ], + "weighted_loads": [ + 0.07476493716239929, + 0.3935480210930109, + 0.92890421487391, + 0.513605622574687, + 1.344812773168087, + 0.21444201096892357, + 1.4477516543120146, + 0.06476582959294319, + 1.308179497718811, + 0.0, + 0.5069770328700542, + 0.4459485951811075, + 1.5134736895561218, + 0.1818009801208973, + 0.8161111418157816, + 0.165750402957201, + 0.5749648213386536, + 0.08944880217313766, + 0.24331489019095898, + 0.7909479979425669, + 0.40227353759109974, + 2.557188533246517, + 0.33413009718060493, + 0.13222388923168182, + 1.6389426421374083, + 0.8690270055085421, + 3.6932732723653316, + 0.7089944183826447, + 0.5866617355495691, + 0.5441145487129688, + 1.0700143687427044, + 0.4155088309198618, + 1.00226516649127, + 0.927292937412858, + 0.8465569242835045, + 0.2870451230555773, + 1.0953433942049742, + 0.6538468562066555, + 0.8906522952020168, + 1.2582163028419018, + 0.6603752337396145, + 0.3852957785129547, + 0.20471221767365932, + 1.5766955409199, + 0.13629791513085365, + 0.44966254383325577, + 0.2856941223144531, + 1.5416470039635897, + 0.0, + 0.41205058991909027, + 0.08303581550717354, + 0.4479328766465187, + 0.8929855041205883, + 0.06724356859922409, + 1.6886064819991589, + 0.5010835751891136, + 1.6561989057809114, + 0.24233748763799667, + 0.38575849682092667, + 1.655925702303648, + 0.08818832226097584, + 1.415803723037243, + 1.368977926671505, + 0.15457003563642502 + ], + "unique_experts": 62, + "load_cv": 0.6686513710939508, + "normalized_load_entropy": 0.9462946414700991, + "max_load_share": 0.055031446540880505 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "e24aaac2c269d47b174828b5b7cee4bd2c11a3b0799ccc3ae9fa6b5f895abfe9", + "route_weight_sha256": "9a068fa791c244f1ad4703b8338d8059c72d25969eec4c56f7307351a285bf46", + "loads": [ + 15, + 12, + 19, + 22, + 20, + 9, + 21, + 13, + 11, + 8, + 11, + 9, + 25, + 10, + 18, + 6, + 9, + 3, + 8, + 11, + 9, + 23, + 16, + 5, + 22, + 17, + 35, + 13, + 8, + 11, + 10, + 5, + 12, + 14, + 25, + 6, + 17, + 16, + 11, + 18, + 11, + 10, + 19, + 24, + 3, + 7, + 23, + 18, + 10, + 21, + 2, + 11, + 17, + 7, + 19, + 11, + 16, + 7, + 12, + 22, + 16, + 16, + 18, + 9 + ], + "weighted_loads": [ + 1.7583824843168259, + 0.4676911476999521, + 0.92890421487391, + 1.240053677931428, + 1.5413140677846968, + 0.4104784205555916, + 1.4477516543120146, + 1.3141659684479237, + 1.308179497718811, + 0.3991569280042313, + 0.5923983808606863, + 0.4468285945476964, + 1.6022625489567872, + 0.5881290845572948, + 1.5352591704577208, + 0.21475913748145103, + 0.7890897765755653, + 0.08944880217313766, + 0.298681179061532, + 0.7909479979425669, + 0.46861777268350124, + 2.930556543171406, + 1.2734557166695595, + 0.16710840165615082, + 1.740515911951661, + 0.9255514190881513, + 3.6932732723653316, + 0.8053435292094946, + 0.5866617355495691, + 0.7378340922296047, + 1.1113983914256096, + 0.4155088309198618, + 1.00226516649127, + 1.0003687385469675, + 1.7604228928685188, + 0.2870451230555773, + 1.0953433942049742, + 1.0708539299666882, + 0.8906522952020168, + 1.3083419427275658, + 0.7349767498672009, + 0.3941103108227253, + 0.8772282674908638, + 1.646409073844552, + 0.13629791513085365, + 0.6915164552628994, + 2.4834247678518295, + 1.5416470039635897, + 1.1211215313524008, + 0.8790399357676506, + 0.08303581550717354, + 1.2255512811243534, + 1.1041434155777097, + 0.7808378636837006, + 3.6309150978922844, + 0.7801028992980719, + 1.6561989057809114, + 0.25134733878076077, + 0.9364179521799088, + 1.6867996118962765, + 0.8845009971410036, + 1.4659044668078423, + 1.782124601304531, + 0.5970531925559044 + ], + "unique_experts": 64, + "load_cv": 0.46788458689259294, + "normalized_load_entropy": 0.9732253616363321, + "max_load_share": 0.03968253968253968 + } + }, + "s0_bos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "7752e40a970fb67d0d5ccf480257fd1248cbcc38e20d8589c18bc1bea00ea17c", + "route_weight_sha256": "8d3148fec4b24bc6fb4b0ed4f3f56af65ef7b970e50015d1e41ca13c881cff68", + "loads": [ + 2, + 10, + 18, + 11, + 17, + 5, + 19, + 2, + 11, + 1, + 11, + 9, + 21, + 5, + 9, + 3, + 7, + 3, + 7, + 11, + 7, + 17, + 6, + 3, + 19, + 16, + 33, + 10, + 8, + 7, + 9, + 7, + 10, + 13, + 15, + 6, + 15, + 11, + 11, + 17, + 10, + 12, + 5, + 23, + 2, + 4, + 9, + 18, + 1, + 10, + 4, + 5, + 13, + 1, + 14, + 6, + 15, + 5, + 4, + 20, + 4, + 15, + 12, + 2 + ], + "weighted_loads": [ + 0.08159433305263519, + 0.37915957532823086, + 0.9037153590470552, + 0.5857111234217882, + 1.3105272483080626, + 0.21779190003871918, + 1.3432407137006521, + 0.06876575574278831, + 1.3118408769369125, + 0.027057219296693802, + 0.5835917796939611, + 0.49011735804378986, + 1.4596839267760515, + 0.17512774094939232, + 0.8253181483596563, + 0.11592850834131241, + 0.5817531868815422, + 0.09927479550242424, + 0.23085878416895866, + 0.761471712961793, + 0.407079815864563, + 2.5759774893522263, + 0.3644459843635559, + 0.10197631642222404, + 1.6752151921391487, + 0.9345190599560738, + 3.55237302929163, + 0.7024471834301949, + 0.5918206740170717, + 0.5392409265041351, + 1.018191546201706, + 0.4934139046818018, + 0.9628131873905659, + 0.9731083605438471, + 0.7802577093243599, + 0.2961700614541769, + 0.9803333412855864, + 0.663053510710597, + 0.8599432241171598, + 1.23599449172616, + 0.6522105932235718, + 0.4635403510183096, + 0.1829382423311472, + 1.668224772438407, + 0.10912295430898666, + 0.4470207095146179, + 0.4066773150116205, + 1.541120694950223, + 0.04188923165202141, + 0.3613085150718689, + 0.14773105084896088, + 0.44279516860842705, + 0.8550774827599525, + 0.03551569953560829, + 1.7042285799980164, + 0.5353896915912628, + 1.6110957395285368, + 0.2262192852795124, + 0.4347483068704605, + 1.7122829854488373, + 0.12830559723079205, + 1.369235523045063, + 1.392199270427227, + 0.14999815076589584 + ], + "unique_experts": 64, + "load_cv": 0.6359047310290565, + "normalized_load_entropy": 0.9513122403736226, + "max_load_share": 0.05188679245283019 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "635b78df4e8b80ee537792287a71598ecd46caddb1ffea69f5b53c7aff1dbebc", + "route_weight_sha256": "8feecadf8cdf6d7f0ae5e18fdba7d5a639988d96b9b57301b58d0d79f4d6b96a", + "loads": [ + 12, + 10, + 18, + 22, + 20, + 7, + 19, + 10, + 11, + 6, + 12, + 10, + 22, + 9, + 16, + 3, + 7, + 3, + 8, + 11, + 9, + 20, + 12, + 5, + 19, + 17, + 33, + 17, + 8, + 12, + 11, + 7, + 10, + 13, + 23, + 6, + 15, + 11, + 11, + 17, + 10, + 12, + 16, + 23, + 2, + 5, + 22, + 18, + 9, + 20, + 4, + 5, + 13, + 1, + 17, + 7, + 15, + 5, + 5, + 20, + 11, + 15, + 15, + 4 + ], + "weighted_loads": [ + 1.519965972751379, + 0.37915957532823086, + 0.9037153590470552, + 1.2616724129766226, + 1.4535248414613307, + 0.3138803690671921, + 1.3432407137006521, + 1.1964077316224575, + 1.3118408769369125, + 0.26306464144727215, + 0.6194226052612066, + 0.49099735741037875, + 1.4601603297924157, + 0.5345690213143826, + 1.4070790242403746, + 0.11592850834131241, + 0.5817531868815422, + 0.09927479550242424, + 0.26680825278162956, + 0.761471712961793, + 0.4789850078523159, + 2.867996759712696, + 0.7959638237953186, + 0.16145830042660236, + 1.6752151921391487, + 0.9350480166613124, + 3.55237302929163, + 0.9643261339515448, + 0.5918206740170717, + 0.7838306836783886, + 1.0934481471776962, + 0.4934139046818018, + 0.9628131873905659, + 0.9731083605438471, + 1.7749182134866714, + 0.2961700614541769, + 0.9803333412855864, + 0.663053510710597, + 0.8599432241171598, + 1.23599449172616, + 0.6522105932235718, + 0.4635403510183096, + 0.8829447943717241, + 1.668224772438407, + 0.10912295430898666, + 0.495784405618906, + 2.035643110051751, + 1.541120694950223, + 0.9164343662559986, + 0.9781900011003017, + 0.14773105084896088, + 0.44279516860842705, + 0.8550774827599525, + 0.03551569953560829, + 2.835354335606098, + 0.5871013179421425, + 1.6110957395285368, + 0.2262192852795124, + 0.48945870995521545, + 1.7122829854488373, + 0.6268800068646669, + 1.369235523045063, + 1.717284470796585, + 0.2256622239947319 + ], + "unique_experts": 64, + "load_cv": 0.5176788346010984, + "normalized_load_entropy": 0.9667146830791691, + "max_load_share": 0.04198473282442748 + } + }, + "s1_bos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "d202dca5e5f56da2c672e86ad8f19db9aece0dfbfb6508e37950fc8e5a7bd283", + "route_weight_sha256": "a4d6271674c632b33a6c63ae773b1c3900e9a817bcdee879b937d3dc33f5d9ea", + "loads": [ + 2, + 10, + 17, + 11, + 17, + 5, + 19, + 1, + 11, + 0, + 10, + 8, + 21, + 5, + 9, + 5, + 8, + 3, + 8, + 10, + 6, + 17, + 5, + 4, + 19, + 14, + 33, + 10, + 9, + 7, + 9, + 7, + 12, + 13, + 16, + 5, + 15, + 12, + 11, + 17, + 10, + 13, + 6, + 23, + 3, + 4, + 7, + 18, + 1, + 7, + 4, + 5, + 13, + 2, + 14, + 6, + 16, + 5, + 4, + 20, + 5, + 15, + 12, + 2 + ], + "weighted_loads": [ + 0.06401857547461987, + 0.37545884773135185, + 0.8526440542191267, + 0.5808912552893162, + 1.3275210987776518, + 0.22506371140480042, + 1.3248685467988253, + 0.037588607519865036, + 1.3456937316805124, + 0.0, + 0.5537579450756311, + 0.46507369354367256, + 1.499635824933648, + 0.17235304974019527, + 0.781569616869092, + 0.1602717712521553, + 0.604234853759408, + 0.0974536407738924, + 0.2717173136770725, + 0.7530853897333145, + 0.37437374889850616, + 2.574404951184988, + 0.32944588363170624, + 0.13540907762944698, + 1.6197794750332832, + 0.8817375600337982, + 3.5311981104314327, + 0.6837024688720703, + 0.6264116559177637, + 0.5283954814076424, + 1.020045779645443, + 0.4728734437376261, + 1.049783881753683, + 0.9437311869114637, + 0.8071224261075258, + 0.2716042045503855, + 0.9988441597670317, + 0.7108337599784136, + 0.8653932455927134, + 1.252425815910101, + 0.6806857399642467, + 0.5093195121735334, + 0.2242173980921507, + 1.6420640125870705, + 0.13872388191521168, + 0.4530530273914337, + 0.35802438482642174, + 1.5698262639343739, + 0.04053765907883644, + 0.26309724524617195, + 0.15041693672537804, + 0.4351953901350498, + 0.8731022998690605, + 0.06206333264708519, + 1.6977893486618996, + 0.5269857421517372, + 1.6441277209669352, + 0.21844379603862762, + 0.4296237900853157, + 1.7229292709380388, + 0.17792123556137085, + 1.4106674194335938, + 1.3311675041913986, + 0.15829791873693466 + ], + "unique_experts": 63, + "load_cv": 0.6329119281551548, + "normalized_load_entropy": 0.9514742642994442, + "max_load_share": 0.05188679245283019 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "691abc5a613e04f184187b1c48bfff6e635a1cb4f2eb3bb490b6ce3942ddb44c", + "route_weight_sha256": "e71cc47045285c34ba5e176ccda61f3a9706f8e8e5473bf79eb4adb614f23f27", + "loads": [ + 16, + 12, + 17, + 23, + 19, + 9, + 19, + 11, + 11, + 8, + 13, + 9, + 24, + 10, + 18, + 6, + 10, + 3, + 10, + 10, + 8, + 23, + 16, + 5, + 21, + 16, + 33, + 13, + 9, + 11, + 10, + 7, + 12, + 15, + 24, + 5, + 15, + 17, + 11, + 18, + 11, + 13, + 22, + 26, + 3, + 8, + 25, + 18, + 11, + 17, + 4, + 11, + 16, + 7, + 18, + 11, + 16, + 5, + 12, + 21, + 18, + 16, + 17, + 9 + ], + "weighted_loads": [ + 1.8147326502949, + 0.4496019743382931, + 0.8526440542191267, + 1.3407443165779114, + 1.4514067848213017, + 0.42283322289586067, + 1.3248685467988253, + 1.211933922022581, + 1.3456937316805124, + 0.4178138449206017, + 0.6391792930662632, + 0.46595369291026145, + 1.5804767979716416, + 0.5952027570456266, + 1.5455166976898909, + 0.20928050577640533, + 0.8183598089963198, + 0.0974536407738924, + 0.36360564455389977, + 0.7530853897333145, + 0.44488558173179626, + 2.938196513801813, + 1.2709475010633469, + 0.17075172625482082, + 1.721352744847536, + 0.9294657324790023, + 3.5311981104314327, + 0.7800515796989202, + 0.6264116559177637, + 0.7189686149358749, + 1.0614298023283482, + 0.4728734437376261, + 1.049783881753683, + 1.0168069880455732, + 1.729318318888545, + 0.2716042045503855, + 0.9988441597670317, + 1.1278408337384462, + 0.8653932455927134, + 1.302551455795765, + 0.7552872560918331, + 0.5093195121735334, + 1.0732501745224, + 1.740872249007225, + 0.13872388191521168, + 0.7534936331212521, + 2.5894149895757437, + 1.5698262639343739, + 1.2086388356983662, + 0.7300865910947323, + 0.15041693672537804, + 1.2128137946128845, + 1.0738761462271214, + 0.7756576277315617, + 2.8517788983881474, + 0.807742053642869, + 1.6441277209669352, + 0.21844379603862762, + 0.973228707909584, + 1.7538031805306673, + 0.9456158466637135, + 1.4607681632041931, + 1.7443141788244247, + 0.6034427657723427 + ], + "unique_experts": 64, + "load_cv": 0.44995770596336576, + "normalized_load_entropy": 0.9753379818069444, + "max_load_share": 0.03741496598639456 + } + }, + "s0_x": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "79dd09644a2b45ecd29318d1e50583149e69426472d3003ecf93148b8a1ccf0b", + "route_weight_sha256": "1c6fc73d8b2b4ab72dc5ba9b0d8e12a13d48fa9bf14b5f1337038b6bd2de2b44", + "loads": [ + 2, + 10, + 17, + 9, + 17, + 5, + 17, + 2, + 11, + 1, + 10, + 8, + 21, + 5, + 9, + 3, + 7, + 3, + 8, + 11, + 6, + 17, + 6, + 4, + 20, + 16, + 33, + 10, + 9, + 7, + 9, + 7, + 11, + 12, + 16, + 6, + 15, + 11, + 11, + 17, + 10, + 12, + 4, + 23, + 3, + 4, + 6, + 17, + 1, + 11, + 4, + 5, + 13, + 4, + 14, + 6, + 15, + 6, + 4, + 20, + 6, + 15, + 12, + 2 + ], + "weighted_loads": [ + 0.0696018896996975, + 0.38533505611121655, + 0.843104301020503, + 0.5051008313894272, + 1.2790671680122614, + 0.20938435196876526, + 1.32337049767375, + 0.06839168071746826, + 1.3328629173338413, + 0.02378900907933712, + 0.5605044644325972, + 0.4598295260220766, + 1.4981390051543713, + 0.1776897944509983, + 0.7814995888620615, + 0.11660653725266457, + 0.5883360207080841, + 0.09292580187320709, + 0.2606654278934002, + 0.7801584508270025, + 0.3755461797118187, + 2.5621888861060143, + 0.37307166680693626, + 0.13391944207251072, + 1.674221757799387, + 0.9401170313358307, + 3.550677752122283, + 0.7019953578710556, + 0.6226719915866852, + 0.5532927252352238, + 1.0281082540750504, + 0.4837248660624027, + 0.9719493258744478, + 0.9567618127912283, + 0.8042417131364346, + 0.3009347375482321, + 0.970205632969737, + 0.666639557108283, + 0.8541879300028086, + 1.222763855010271, + 0.6644825786352158, + 0.4610488321632147, + 0.14853964000940323, + 1.6471110004931688, + 0.14847858250141144, + 0.44970597326755524, + 0.31728973239660263, + 1.5199039094150066, + 0.04212616756558418, + 0.40164898708462715, + 0.14424709044396877, + 0.4320470653474331, + 0.8926502987742424, + 0.12331737764179707, + 1.711036890745163, + 0.5353196337819099, + 1.631525058299303, + 0.2436972726136446, + 0.4293092340230942, + 1.6576706785708666, + 0.19513893499970436, + 1.3698893897235394, + 1.3926702477037907, + 0.1500263661146164 + ], + "unique_experts": 64, + "load_cv": 0.6220694913899826, + "normalized_load_entropy": 0.9544651058903467, + "max_load_share": 0.05188679245283019 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "f36f552eaa4c797378e2124007a71927bd4c323953cca366ac10d2c26c83116c", + "route_weight_sha256": "b83cf08772176eff50277c8444706ed8cc55ee48f5c79eaef2f58f5b4d83b551", + "loads": [ + 9, + 10, + 17, + 21, + 21, + 7, + 17, + 10, + 11, + 6, + 11, + 9, + 22, + 9, + 16, + 3, + 7, + 3, + 8, + 11, + 7, + 20, + 12, + 6, + 20, + 17, + 34, + 18, + 9, + 12, + 10, + 7, + 11, + 12, + 25, + 6, + 16, + 11, + 11, + 17, + 10, + 12, + 15, + 24, + 3, + 5, + 19, + 17, + 7, + 22, + 4, + 5, + 13, + 4, + 17, + 7, + 15, + 6, + 5, + 20, + 13, + 15, + 15, + 4 + ], + "weighted_loads": [ + 1.1481055952608585, + 0.38533505611121655, + 0.843104301020503, + 1.296553622931242, + 1.4710873612202704, + 0.3017851300537586, + 1.32337049767375, + 1.1961285434663296, + 1.3328629173338413, + 0.2799891288741492, + 0.5963352899998426, + 0.4607095253886655, + 1.4986154081707355, + 0.536220122128725, + 1.3223051261156797, + 0.11660653725266457, + 0.5883360207080841, + 0.09292580187320709, + 0.2606654278934002, + 0.7801584508270025, + 0.4023440480232239, + 2.8402523025870323, + 0.8074405044317245, + 0.1964411772787571, + 1.674221757799387, + 0.9406459880410694, + 3.5930707808583975, + 1.0114681217819452, + 0.6226719915866852, + 0.7975725792348385, + 1.0748167745769024, + 0.4837248660624027, + 0.9719493258744478, + 0.9567618127912283, + 1.900023553520441, + 0.3009347375482321, + 1.0183308068662882, + 0.666639557108283, + 0.8541879300028086, + 1.222763855010271, + 0.6644825786352158, + 0.4610488321632147, + 0.8047753535211086, + 1.6768649220466614, + 0.14847858250141144, + 0.5065373592078686, + 1.945072054862976, + 1.5199039094150066, + 0.7644398212432861, + 1.082269586622715, + 0.14424709044396877, + 0.4320470653474331, + 0.8926502987742424, + 0.12331737764179707, + 2.820501182228327, + 0.5909372940659523, + 1.631525058299303, + 0.2436972726136446, + 0.4908430613577366, + 1.6576706785708666, + 0.7223271802067757, + 1.3698893897235394, + 1.7177554480731487, + 0.22703303024172783 + ], + "unique_experts": 64, + "load_cv": 0.5190777328368547, + "normalized_load_entropy": 0.9680198690327312, + "max_load_share": 0.043256997455470736 + } + }, + "s1_x": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "09e7642a29f7a078fbea500c4de1119538037ea050339d06edfa21c6e58cc376", + "route_weight_sha256": "3837de62448cd56c2475131c85a66e219115fd8262d0db74fbe86bdf0222644c", + "loads": [ + 1, + 10, + 19, + 9, + 17, + 5, + 18, + 1, + 11, + 0, + 10, + 9, + 21, + 5, + 9, + 5, + 8, + 3, + 8, + 10, + 6, + 17, + 5, + 4, + 20, + 14, + 33, + 10, + 9, + 7, + 9, + 6, + 12, + 13, + 16, + 5, + 15, + 12, + 11, + 17, + 10, + 12, + 6, + 23, + 3, + 4, + 7, + 18, + 1, + 10, + 3, + 5, + 13, + 2, + 14, + 6, + 16, + 5, + 4, + 20, + 6, + 15, + 11, + 2 + ], + "weighted_loads": [ + 0.034699905663728714, + 0.3780419882386923, + 0.908946193754673, + 0.5151058658957481, + 1.2870287410914898, + 0.21883049793541431, + 1.3000927232205868, + 0.038190584629774094, + 1.3588312771171331, + 0.0, + 0.5586958024650812, + 0.4897385537624359, + 1.5177105627954006, + 0.17223059944808483, + 0.750535286962986, + 0.1584153901785612, + 0.6067710537463427, + 0.09653913229703903, + 0.27272701635956764, + 0.7674852162599564, + 0.37469669431447983, + 2.534976590424776, + 0.3317537233233452, + 0.13587521389126778, + 1.6320789940655231, + 0.8820673525333405, + 3.524403451010585, + 0.691578533500433, + 0.6294857282191515, + 0.535283874720335, + 1.0219118371605873, + 0.4408320337533951, + 1.0453757215291262, + 0.9431880787014961, + 0.8012787494808435, + 0.27906461246311665, + 1.0001343823969364, + 0.7136135175824165, + 0.85253637842834, + 1.2617157399654388, + 0.6938886046409607, + 0.48065201938152313, + 0.22162122279405594, + 1.632512053474784, + 0.14198440499603748, + 0.44947151839733124, + 0.4027995727956295, + 1.586431609466672, + 0.0407869890332222, + 0.3610624372959137, + 0.12026241421699524, + 0.4473761096596718, + 0.8899286948144436, + 0.0638675857335329, + 1.6991493999958038, + 0.5274829715490341, + 1.6443737950176, + 0.21806921437382698, + 0.4197441302239895, + 1.689668733626604, + 0.21374636329710484, + 1.4207514487206936, + 1.284742921590805, + 0.1553008258342743 + ], + "unique_experts": 63, + "load_cv": 0.6381401221935369, + "normalized_load_entropy": 0.9503385820055237, + "max_load_share": 0.05188679245283019 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "86cae9d7b01e366fabf72d6c19c7e84220154216f636952e81d70a95407dde0c", + "route_weight_sha256": "f1da00028927e44ad9e779f5ae452522827b1696a274c92a2aee8fde0f9c2fa7", + "loads": [ + 13, + 12, + 19, + 22, + 20, + 8, + 18, + 12, + 11, + 8, + 13, + 10, + 24, + 10, + 18, + 6, + 10, + 3, + 9, + 10, + 7, + 23, + 16, + 5, + 22, + 16, + 34, + 14, + 9, + 12, + 10, + 6, + 12, + 15, + 24, + 5, + 16, + 17, + 11, + 18, + 11, + 12, + 21, + 26, + 3, + 8, + 23, + 18, + 10, + 21, + 3, + 11, + 16, + 7, + 18, + 11, + 16, + 5, + 12, + 21, + 20, + 16, + 16, + 9 + ], + "weighted_loads": [ + 1.512916337698698, + 0.4521851148456335, + 0.908946193754673, + 1.4187052063643932, + 1.4475170620717108, + 0.3673769850283861, + 1.3000927232205868, + 1.2349246591329575, + 1.3588312771171331, + 0.4366232789470814, + 0.6441171504557133, + 0.4906185531290248, + 1.5985515358333942, + 0.5940090548247099, + 1.4827305302023888, + 0.20742412470281124, + 0.8208960089832544, + 0.09653913229703903, + 0.3280933052301407, + 0.7674852162599564, + 0.4066457152366638, + 2.887470368295908, + 1.275514092296362, + 0.1730671525001526, + 1.733652263879776, + 0.9297955249785446, + 3.563436133787036, + 0.8331346642225981, + 0.6294857282191515, + 0.76835036277771, + 1.0632958598434925, + 0.4408320337533951, + 1.0453757215291262, + 1.0162638798356056, + 1.7681346479803324, + 0.27906461246311665, + 1.040444653481245, + 1.1306205913424492, + 0.85253637842834, + 1.3118413798511028, + 0.7684901207685471, + 0.48065201938152313, + 0.9551525842398405, + 1.732483757659793, + 0.14198440499603748, + 0.7610669918358326, + 2.5690529197454453, + 1.586431609466672, + 1.0910748429596424, + 0.8875942528247833, + 0.12026241421699524, + 1.2249945141375065, + 1.0907025411725044, + 0.7774618808180094, + 2.831139400601387, + 0.8104393351823092, + 1.6443737950176, + 0.21806921437382698, + 0.9640363939106464, + 1.7205426432192326, + 1.0578895658254623, + 1.470852192491293, + 1.6978895962238312, + 0.6010610833764076 + ], + "unique_experts": 64, + "load_cv": 0.4602616053598672, + "normalized_load_entropy": 0.9740321801750196, + "max_load_share": 0.03854875283446712 + } + }, + "s0_period": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "339471ba7cf83ec872751c85b665354576540f79e5cfdfb0e461e86c2a23d922", + "route_weight_sha256": "57bf447aa6603cd8d21092a2cd9c30c3d5347eafa39e0fa9f523285ec59c2344", + "loads": [ + 2, + 10, + 17, + 9, + 17, + 5, + 18, + 2, + 12, + 0, + 11, + 8, + 21, + 5, + 9, + 3, + 7, + 3, + 8, + 11, + 7, + 17, + 6, + 4, + 20, + 16, + 33, + 10, + 9, + 7, + 9, + 7, + 10, + 12, + 16, + 7, + 15, + 11, + 11, + 17, + 10, + 11, + 4, + 23, + 3, + 4, + 6, + 18, + 1, + 10, + 4, + 5, + 13, + 4, + 14, + 6, + 14, + 6, + 4, + 19, + 6, + 15, + 12, + 2 + ], + "weighted_loads": [ + 0.06829877011477947, + 0.38646621257066727, + 0.8456591218709946, + 0.4958440065383911, + 1.2841581273823977, + 0.20969212613999844, + 1.3524194471538067, + 0.06855444237589836, + 1.356292998418212, + 0.0, + 0.5868153087794781, + 0.46170499734580517, + 1.4971517585217953, + 0.17730418592691422, + 0.7649241778999567, + 0.11620933562517166, + 0.5872813202440739, + 0.09365978091955185, + 0.2637451272457838, + 0.775137435644865, + 0.3987794276326895, + 2.5576492063701153, + 0.3631290849298239, + 0.1329067163169384, + 1.6839982699602842, + 0.9429700244218111, + 3.5549886021763086, + 0.7069535255432129, + 0.6307209711521864, + 0.555647473782301, + 1.0270372368395329, + 0.4845145493745804, + 0.9543542489409447, + 0.9606120623648167, + 0.8011133428663015, + 0.3323592934757471, + 0.9636146072298288, + 0.659659830853343, + 0.8631878085434437, + 1.2306635938584805, + 0.6697883065789938, + 0.43514147587120533, + 0.14903019182384014, + 1.6470901854336262, + 0.14835052378475666, + 0.4473807290196419, + 0.310917966067791, + 1.5539032723754644, + 0.041334573179483414, + 0.3673487603664398, + 0.1453344002366066, + 0.4321361407637596, + 0.8972899876534939, + 0.12309076450765133, + 1.7012644670903683, + 0.5294575393199921, + 1.59501807205379, + 0.24087066762149334, + 0.4286511391401291, + 1.6334961913526058, + 0.19291304424405098, + 1.3814397305250168, + 1.3806931413710117, + 0.15049537271261215 + ], + "unique_experts": 63, + "load_cv": 0.6228320653709206, + "normalized_load_entropy": 0.9535310947986834, + "max_load_share": 0.05188679245283019 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "84a484be062f0b3b1bd7541757567f0bef546a15eedfcda3f9c69eeab46ea9cd", + "route_weight_sha256": "541242b43dfbbce269c3ed9f798cf50f03ebb9e962409cd51ec8a0af106b8f66", + "loads": [ + 9, + 11, + 17, + 21, + 21, + 7, + 18, + 10, + 12, + 6, + 12, + 9, + 22, + 9, + 16, + 3, + 7, + 3, + 8, + 11, + 8, + 20, + 13, + 6, + 20, + 17, + 33, + 17, + 9, + 12, + 10, + 7, + 10, + 12, + 24, + 7, + 15, + 11, + 11, + 17, + 10, + 11, + 15, + 24, + 3, + 6, + 19, + 18, + 7, + 20, + 4, + 5, + 13, + 4, + 17, + 7, + 14, + 6, + 6, + 19, + 13, + 15, + 15, + 4 + ], + "weighted_loads": [ + 1.0793037991970778, + 0.534002460539341, + 0.8456591218709946, + 1.2259223945438862, + 1.4834811338223517, + 0.30224846489727497, + 1.3524194471538067, + 1.2383909821510315, + 1.356292998418212, + 0.41334964701673016, + 0.6226461343467236, + 0.46258499671239406, + 1.4976281615381595, + 0.5338729619979858, + 1.4286584574729204, + 0.11620933562517166, + 0.5872813202440739, + 0.09365978091955185, + 0.2637451272457838, + 0.775137435644865, + 0.42557729594409466, + 2.8317036367952824, + 0.8489665854722261, + 0.19551224075257778, + 1.6839982699602842, + 0.9434989811270498, + 3.5549886021763086, + 0.9688324760645628, + 0.6307209711521864, + 0.7956837750971317, + 1.0737457573413849, + 0.4845145493745804, + 0.9543542489409447, + 0.9606120623648167, + 1.795773847028613, + 0.3323592934757471, + 0.9636146072298288, + 0.659659830853343, + 0.8631878085434437, + 1.2306635938584805, + 0.6697883065789938, + 0.43514147587120533, + 0.8076116945594549, + 1.6769087500870228, + 0.14835052378475666, + 0.5554245263338089, + 1.9396389052271843, + 1.5539032723754644, + 0.7618436105549335, + 0.9842302463948727, + 0.1453344002366066, + 0.4321361407637596, + 0.8972899876534939, + 0.12309076450765133, + 2.8061410635709763, + 0.5850027576088905, + 1.59501807205379, + 0.24087066762149334, + 0.5316972993314266, + 1.6334961913526058, + 0.6786594018340111, + 1.3814397305250168, + 1.7057783417403698, + 0.22667890414595604 + ], + "unique_experts": 64, + "load_cv": 0.5022400597952904, + "normalized_load_entropy": 0.9698743421085468, + "max_load_share": 0.04198473282442748 + } + }, + "s1_period": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "e824bb76e0bf50daa8e77d231ea075570c903fb5d002d6c87594c31c91f5a291", + "route_weight_sha256": "4b4c9bb740862ae9fe1852d2c1ffb762dd8a008bc005fcce45edd5f0b8eacf20", + "loads": [ + 1, + 10, + 17, + 8, + 17, + 5, + 18, + 1, + 11, + 0, + 10, + 9, + 21, + 5, + 10, + 4, + 8, + 2, + 8, + 10, + 6, + 17, + 5, + 4, + 19, + 15, + 34, + 10, + 9, + 7, + 9, + 6, + 13, + 13, + 16, + 5, + 15, + 12, + 11, + 17, + 10, + 12, + 6, + 23, + 3, + 4, + 8, + 18, + 1, + 10, + 4, + 5, + 14, + 2, + 14, + 6, + 16, + 5, + 4, + 20, + 5, + 15, + 11, + 2 + ], + "weighted_loads": [ + 0.03485961630940437, + 0.3756083454936743, + 0.8518534991890192, + 0.47238894924521446, + 1.2890232857316732, + 0.22294927015900612, + 1.3023987542837858, + 0.03765373304486275, + 1.3585000187158585, + 0.0, + 0.5600551255047321, + 0.4915448725223541, + 1.522895872592926, + 0.17199417762458324, + 0.7802111357450485, + 0.13676267303526402, + 0.6037360094487667, + 0.06773276440799236, + 0.27545805647969246, + 0.7644674219191074, + 0.3741998188197613, + 2.5249678008258343, + 0.32489054277539253, + 0.13599551282823086, + 1.6013102270662785, + 0.9082024339586496, + 3.5330949258059263, + 0.690836563706398, + 0.6350279320031404, + 0.5361635610461235, + 1.0270541496574879, + 0.44183780439198017, + 1.0877455342561007, + 0.9447431173175573, + 0.8017524685710669, + 0.27920992858707905, + 0.9977569151669741, + 0.7065040357410908, + 0.8574536498636007, + 1.2629394754767418, + 0.700709868222475, + 0.4808902982622385, + 0.22405239939689636, + 1.6360166482627392, + 0.1430193204432726, + 0.44909460097551346, + 0.41989981569349766, + 1.5903925709426403, + 0.04104648157954216, + 0.36282201670110226, + 0.1492397040128708, + 0.443508293479681, + 0.9181016329675913, + 0.06401516124606133, + 1.6922032907605171, + 0.5241585522890091, + 1.6473900340497494, + 0.21649573370814323, + 0.42445845901966095, + 1.6844104379415512, + 0.1868662443011999, + 1.4174185171723366, + 1.2835719101130962, + 0.15685208141803741 + ], + "unique_experts": 63, + "load_cv": 0.642587575953094, + "normalized_load_entropy": 0.949649262704549, + "max_load_share": 0.05345911949685535 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "fec5a3a55ddf4483ecdf21cce840fb9d0884f5d845dab72f78930dbb32d4b17f", + "route_weight_sha256": "64c35accea283ae48602b163ac0fab9034f93217bd65110a46f549f88fff095c", + "loads": [ + 12, + 13, + 17, + 21, + 20, + 8, + 18, + 13, + 11, + 9, + 13, + 10, + 24, + 10, + 19, + 5, + 10, + 2, + 9, + 10, + 7, + 23, + 17, + 5, + 21, + 17, + 34, + 13, + 9, + 12, + 10, + 6, + 13, + 15, + 23, + 5, + 15, + 17, + 11, + 18, + 11, + 12, + 22, + 26, + 3, + 9, + 24, + 18, + 9, + 20, + 4, + 11, + 17, + 7, + 18, + 11, + 16, + 5, + 13, + 21, + 19, + 16, + 16, + 9 + ], + "weighted_loads": [ + 1.4150786697864532, + 0.5581741388887167, + 0.8518534991890192, + 1.2907200418412685, + 1.4483502288348973, + 0.3714957572519779, + 1.3023987542837858, + 1.3205993194133043, + 1.3585000187158585, + 0.5620470679714344, + 0.6454764734953642, + 0.492424871888943, + 1.6037368456309196, + 0.5903480555862188, + 1.593940507620573, + 0.18577140755951405, + 0.8178609646856785, + 0.06773276440799236, + 0.3308243453502655, + 0.7644674219191074, + 0.40614883974194527, + 2.8727446869015694, + 1.3355558589100838, + 0.17340639792382717, + 1.7028834968805313, + 0.9559306064038537, + 3.5330949258059263, + 0.787185674533248, + 0.6350279320031404, + 0.7662795074284077, + 1.068438172340393, + 0.44183780439198017, + 1.0877455342561007, + 1.0178189184516668, + 1.6762148644775152, + 0.27920992858707905, + 0.9977569151669741, + 1.1235111095011234, + 0.8574536498636007, + 1.3130651153624058, + 0.7753113843500614, + 0.4808902982622385, + 1.0489964466542006, + 1.7356093227863312, + 0.1430193204432726, + 0.8224000185728073, + 2.5861531626433134, + 1.5903925709426403, + 1.0480521395802498, + 0.8298113625496626, + 0.1492397040128708, + 1.2211266979575157, + 1.1188754793256521, + 0.7776094563305378, + 2.8166807256639004, + 0.8062783423811197, + 1.6473900340497494, + 0.21649573370814323, + 1.0188485756516457, + 1.7152843475341797, + 0.9875073041766882, + 1.467519260942936, + 1.6967185847461224, + 0.6023186482489109 + ], + "unique_experts": 64, + "load_cv": 0.45703283958506896, + "normalized_load_entropy": 0.9741993494450464, + "max_load_share": 0.03854875283446712 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 106, + "ordered_topk_exact_tokens": 88, + "set_exact_tokens": 94, + "mean_set_jaccard": 0.9676549865229112, + "mean_token_weighted_tv": 0.007108923144427673, + "aggregate_load_tv": 0.017295597484276726 + }, + "system_bos": { + "tokens": 106, + "ordered_topk_exact_tokens": 69, + "set_exact_tokens": 83, + "mean_set_jaccard": 0.9359838274932615, + "mean_token_weighted_tv": 0.014127089808923457, + "aggregate_load_tv": 0.025157232704402517 + }, + "system_x": { + "tokens": 106, + "ordered_topk_exact_tokens": 69, + "set_exact_tokens": 84, + "mean_set_jaccard": 0.940700808625337, + "mean_token_weighted_tv": 0.014625655267528206, + "aggregate_load_tv": 0.023584905660377357 + }, + "system_period": { + "tokens": 106, + "ordered_topk_exact_tokens": 72, + "set_exact_tokens": 83, + "mean_set_jaccard": 0.9339622641509434, + "mean_token_weighted_tv": 0.015065134142718787, + "aggregate_load_tv": 0.029874213836477984 + }, + "bos_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 59, + "set_exact_tokens": 77, + "mean_set_jaccard": 0.9177897574123989, + "mean_token_weighted_tv": 0.019715805643431422, + "aggregate_load_tv": 0.04088050314465408 + }, + "bos_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 59, + "set_exact_tokens": 75, + "mean_set_jaccard": 0.9144204851752021, + "mean_token_weighted_tv": 0.020862098537244887, + "aggregate_load_tv": 0.03459119496855345 + }, + "x_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 59, + "set_exact_tokens": 74, + "mean_set_jaccard": 0.9097035040431266, + "mean_token_weighted_tv": 0.01984079482631301, + "aggregate_load_tv": 0.03773584905660377 + }, + "x_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 59, + "set_exact_tokens": 76, + "mean_set_jaccard": 0.9130727762803237, + "mean_token_weighted_tv": 0.021829275800934377, + "aggregate_load_tv": 0.03144654088050314 + }, + "period_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 63, + "set_exact_tokens": 76, + "mean_set_jaccard": 0.9130727762803234, + "mean_token_weighted_tv": 0.01961964223850167, + "aggregate_load_tv": 0.03773584905660377 + }, + "period_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 58, + "set_exact_tokens": 74, + "mean_set_jaccard": 0.9076819407008087, + "mean_token_weighted_tv": 0.022258095768333045, + "aggregate_load_tv": 0.03930817610062892 + } + } + }, + "layer_04": { + "layer": 4, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "c1262afcc6204f0a06e6d9babadbc94c51a618483a53aae4fed2dbae82bb0ba8", + "route_weight_sha256": "e3a31a316d248d5de92b77d22eeed591f3badd690678ae1d3486d3ed3587e274", + "loads": [ + 18, + 10, + 10, + 4, + 15, + 12, + 7, + 10, + 9, + 8, + 10, + 16, + 0, + 0, + 7, + 12, + 3, + 26, + 4, + 6, + 19, + 7, + 6, + 14, + 4, + 1, + 0, + 15, + 10, + 5, + 8, + 25, + 30, + 10, + 0, + 0, + 17, + 12, + 7, + 6, + 19, + 4, + 4, + 22, + 6, + 10, + 9, + 23, + 5, + 7, + 14, + 6, + 6, + 3, + 12, + 14, + 3, + 24, + 20, + 1, + 0, + 15, + 24, + 2 + ], + "weighted_loads": [ + 1.401329718530178, + 0.44759885407984257, + 0.8602710515260696, + 0.24847974255681038, + 1.3736142739653587, + 0.9449144396930933, + 0.4124106913805008, + 0.916135486215353, + 0.7807577140629292, + 0.5716018974781036, + 0.8877921141684055, + 0.728798408061266, + 0.0, + 0.0, + 0.37785247154533863, + 0.9810585025697947, + 0.2878572903573513, + 2.4292663857340813, + 0.15211861208081245, + 0.6042775399982929, + 1.5669698603451252, + 0.31397756561636925, + 0.5356493294239044, + 1.1994875110685825, + 0.18063772097229958, + 0.0288420170545578, + 0.0, + 0.7825079429894686, + 0.6062504760921001, + 0.2045357432216406, + 0.6422692500054836, + 1.9246505852788687, + 2.4777452368289232, + 0.5829360224306583, + 0.0, + 0.0, + 1.2136002480983734, + 1.355715986341238, + 0.5758771635591984, + 0.602408193051815, + 1.3820200636982918, + 0.21641525998711586, + 0.23436816036701202, + 1.7492560651153326, + 0.37100742012262344, + 0.46069544181227684, + 0.482000270858407, + 1.9298266731202602, + 0.1641941573470831, + 0.3356892764568329, + 1.0446445792913437, + 0.25346346758306026, + 0.5963116809725761, + 0.10199179127812386, + 0.9327448010444641, + 0.9862451925873756, + 0.17966270446777344, + 1.593566905707121, + 1.6522135138511658, + 0.04791048541665077, + 0.0, + 1.2085485234856606, + 1.724567323923111, + 0.12571850046515465 + ], + "unique_experts": 58, + "load_cv": 0.7430705157552911, + "normalized_load_entropy": 0.928368774088562, + "max_load_share": 0.04716981132075472 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "1fd40b29253b30852591f71a95cab85450e62d8be97f2e2ae748bef5c98c8e7c", + "route_weight_sha256": "fe56be6f601a95a1681d1eb1b6224f4473e21eac41cfcdd250cd545307e94ed6", + "loads": [ + 18, + 13, + 13, + 8, + 16, + 12, + 9, + 10, + 9, + 8, + 20, + 18, + 0, + 13, + 10, + 16, + 3, + 26, + 8, + 6, + 19, + 9, + 8, + 14, + 4, + 7, + 5, + 16, + 10, + 24, + 8, + 27, + 30, + 12, + 11, + 0, + 17, + 15, + 8, + 6, + 22, + 6, + 12, + 22, + 6, + 11, + 20, + 23, + 6, + 9, + 15, + 6, + 6, + 3, + 12, + 14, + 3, + 24, + 20, + 12, + 4, + 15, + 27, + 2 + ], + "weighted_loads": [ + 1.401329718530178, + 0.6052196342498064, + 1.0387923270463943, + 0.5944202704995405, + 1.4534658789634705, + 0.9449144396930933, + 0.5358540788292885, + 0.916135486215353, + 0.7807577140629292, + 0.5716018974781036, + 1.5453056450933218, + 0.7552845096215606, + 0.0, + 0.9337232895195484, + 0.45257717557251453, + 1.2799647245556116, + 0.2878572903573513, + 2.4292663857340813, + 0.4231499210873153, + 0.6042775399982929, + 1.5669698603451252, + 1.3787981234490871, + 0.6675850860774517, + 1.1994875110685825, + 0.18063772097229958, + 0.47677358612418175, + 0.48704126477241516, + 0.7904911516234279, + 0.6062504760921001, + 1.5570641609810991, + 0.6422692500054836, + 1.9555805316194892, + 2.4777452368289232, + 0.6231853282079101, + 1.0355615564621985, + 0.0, + 1.2136002480983734, + 1.5561843402683735, + 1.5725000835955143, + 0.602408193051815, + 1.5230508781969547, + 0.346896693110466, + 0.5945549514144659, + 1.7492560651153326, + 0.37100742012262344, + 0.49079236947000027, + 1.631185943260789, + 1.9298266731202602, + 0.20113533921539783, + 0.3860152307897806, + 1.091641578823328, + 0.25346346758306026, + 0.5963116809725761, + 0.10199179127812386, + 0.9327448010444641, + 0.9862451925873756, + 0.17966270446777344, + 1.593566905707121, + 1.6522135138511658, + 0.6689686104655266, + 0.4087276184000075, + 1.2085485234856606, + 1.9478164911270142, + 0.12571850046515465 + ], + "unique_experts": 62, + "load_cv": 0.5783586833299419, + "normalized_load_entropy": 0.9571873561127534, + "max_load_share": 0.03816793893129771 + } + }, + "s1_eos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "e3e710bd1b2bc8bad741e9abc15ada1ec8f8e592d8d7666d295c4c54f1bc5d91", + "route_weight_sha256": "a21b0d4a254435f79ac7edf48f96889dd43037d20741c02844584dacafad4db8", + "loads": [ + 19, + 10, + 12, + 4, + 15, + 10, + 7, + 10, + 9, + 8, + 10, + 15, + 0, + 0, + 8, + 12, + 3, + 26, + 4, + 6, + 20, + 7, + 6, + 13, + 5, + 1, + 0, + 15, + 10, + 7, + 8, + 24, + 29, + 10, + 0, + 0, + 17, + 12, + 7, + 6, + 19, + 4, + 4, + 22, + 6, + 10, + 8, + 23, + 3, + 7, + 14, + 6, + 6, + 3, + 12, + 14, + 2, + 25, + 20, + 1, + 0, + 15, + 25, + 2 + ], + "weighted_loads": [ + 1.4394301027059555, + 0.4448329322040081, + 0.9196952283382416, + 0.2501268535852432, + 1.3736210726201534, + 0.8848854824900627, + 0.42861346900463104, + 0.9296754114329815, + 0.7763925828039646, + 0.5661929659545422, + 0.8829663470387459, + 0.7122833337634802, + 0.0, + 0.0, + 0.41383558325469494, + 0.9766082391142845, + 0.2894962392747402, + 2.430607333779335, + 0.152348343282938, + 0.5967748276889324, + 1.5864005088806152, + 0.3166029155254364, + 0.5343278646469116, + 1.1558523494750261, + 0.21019397303462029, + 0.031925637274980545, + 0.0, + 0.7870142608880997, + 0.6125864870846272, + 0.2749982364475727, + 0.6400303617119789, + 1.9082205593585968, + 2.4443169981241226, + 0.5792926196008921, + 0.0, + 0.0, + 1.2153822090476751, + 1.3667360469698906, + 0.5668794810771942, + 0.6041640117764473, + 1.3752037957310677, + 0.22097155079245567, + 0.22985383123159409, + 1.7433380633592606, + 0.3665557708591223, + 0.4690093453973532, + 0.4487481936812401, + 1.8905238769948483, + 0.08920628018677235, + 0.3349269460886717, + 1.0351067762821913, + 0.2583459112793207, + 0.5897512249648571, + 0.10236220434308052, + 0.9102555178105831, + 0.9854758270084858, + 0.14173420891165733, + 1.6385273095220327, + 1.662046229466796, + 0.04374071955680847, + 0.0, + 1.2041192799806595, + 1.7612656131386757, + 0.12318767607212067 + ], + "unique_experts": 58, + "load_cv": 0.7449844159396087, + "normalized_load_entropy": 0.9277453232334708, + "max_load_share": 0.04559748427672956 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "032ab3edd5b9abf06a63ec092245476b4714513b4be024e35f548194cb211143", + "route_weight_sha256": "ee09abcf237a5693c5f2fc72740a1a35e403578b12739c538616dd5cbd33f846", + "loads": [ + 19, + 12, + 16, + 13, + 16, + 10, + 11, + 10, + 9, + 17, + 19, + 17, + 1, + 14, + 11, + 17, + 5, + 28, + 11, + 8, + 21, + 10, + 11, + 14, + 5, + 11, + 8, + 16, + 10, + 30, + 8, + 26, + 29, + 12, + 15, + 0, + 18, + 17, + 10, + 9, + 22, + 9, + 13, + 22, + 7, + 12, + 18, + 27, + 3, + 10, + 16, + 6, + 10, + 7, + 18, + 14, + 7, + 27, + 20, + 14, + 7, + 17, + 29, + 3 + ], + "weighted_loads": [ + 1.4394301027059555, + 0.5808839984238148, + 1.1419268622994423, + 1.0574509587313514, + 1.4568739049136639, + 0.8848854824900627, + 0.7172986976802349, + 0.9296754114329815, + 0.7763925828039646, + 1.644039299339056, + 1.472653480246663, + 0.738687627017498, + 0.10025633871555328, + 0.999300479888916, + 0.48854565620422363, + 1.355827186256647, + 0.652452614158392, + 2.50121589563787, + 0.7525359368883073, + 0.6866227574646473, + 1.6356145143508911, + 1.413175754249096, + 0.9580234363675117, + 1.2495789173990488, + 0.21019397303462029, + 0.7537496536970139, + 0.7670351676642895, + 0.7952883755788207, + 0.6125864870846272, + 1.5735316034406424, + 0.6400303617119789, + 1.9387975530698895, + 2.4443169981241226, + 0.6199430590495467, + 1.3664655631873757, + 0.0, + 1.242733497172594, + 1.6340490225702524, + 1.7547307685017586, + 0.815223790705204, + 1.5356476120650768, + 0.4492489994299831, + 0.6602234430611134, + 1.7433380633592606, + 0.4047683458775282, + 0.49959705225774087, + 1.6379199661314487, + 2.2289842404425144, + 0.08920628018677235, + 0.4214551169425249, + 1.1279968973249197, + 0.2583459112793207, + 1.0259463675320148, + 0.2842724435031414, + 1.4617025144398212, + 0.9854758270084858, + 0.5627830289304256, + 1.7116711679846048, + 1.662046229466796, + 0.7817900273948908, + 0.8901036269962788, + 1.400238037109375, + 2.0584409572184086, + 0.16759147122502327 + ], + "unique_experts": 63, + "load_cv": 0.5080124254895209, + "normalized_load_entropy": 0.9671677059241448, + "max_load_share": 0.034013605442176874 + } + }, + "s0_bos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "5335deb77efb44ad49f9cbb7148e14e9985d97a456b33493dd44005a8794618c", + "route_weight_sha256": "6ad63d81191e9bc60d09a12448b5e9e4a321fc99154afd6a22ed7c0533ae7314", + "loads": [ + 19, + 11, + 11, + 4, + 15, + 12, + 6, + 12, + 9, + 8, + 10, + 15, + 1, + 0, + 10, + 12, + 3, + 26, + 4, + 6, + 19, + 9, + 6, + 14, + 2, + 1, + 0, + 16, + 10, + 5, + 8, + 21, + 29, + 9, + 0, + 0, + 17, + 11, + 7, + 6, + 19, + 4, + 4, + 22, + 5, + 8, + 9, + 23, + 4, + 8, + 13, + 6, + 6, + 4, + 12, + 14, + 3, + 25, + 20, + 1, + 0, + 15, + 25, + 2 + ], + "weighted_loads": [ + 1.3834361992776394, + 0.48156179301440716, + 0.9000699259340763, + 0.2512349672615528, + 1.3205631468445063, + 1.0182911586016417, + 0.38386229425668716, + 1.0165021028369665, + 0.786236222833395, + 0.6108218990266323, + 0.8571374267339706, + 0.7118799723684788, + 0.03910929337143898, + 0.0, + 0.4759396482259035, + 0.9871267192065716, + 0.28546663746237755, + 2.481137130409479, + 0.1458938717842102, + 0.5949106886982918, + 1.5571782290935516, + 0.38078935258090496, + 0.5253936797380447, + 1.1911837253719568, + 0.09950325638055801, + 0.027600068598985672, + 0.0, + 0.8002205584198236, + 0.6077014580368996, + 0.18532336317002773, + 0.6276843287050724, + 1.8225761447101831, + 2.446063971146941, + 0.5787004865705967, + 0.0, + 0.0, + 1.2728071995079517, + 1.3241948168724775, + 0.5521441623568535, + 0.6258014068007469, + 1.322161853313446, + 0.21586846560239792, + 0.22892596572637558, + 1.7405898198485374, + 0.33384088054299355, + 0.41322642378509045, + 0.46508043445646763, + 1.9510653652250767, + 0.125205984339118, + 0.3900864254683256, + 1.0025704726576805, + 0.24118927121162415, + 0.58624517172575, + 0.13053002208471298, + 0.9347577430307865, + 1.0041064023971558, + 0.18948842957615852, + 1.6066750437021255, + 1.6672001872211695, + 0.057482004165649414, + 0.0, + 1.1998226195573807, + 1.7533564940094948, + 0.1224411204457283 + ], + "unique_experts": 59, + "load_cv": 0.7360103032489881, + "normalized_load_entropy": 0.9295825408441264, + "max_load_share": 0.04559748427672956 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "b96cdc2b1b1f419f87e00289f5cc8f4f5d92236ab7eaf3abe25a91983078d702", + "route_weight_sha256": "604141f256da555dedefb2405cbad885c03cf6c326a5174c77982033ee2354a7", + "loads": [ + 19, + 14, + 14, + 9, + 16, + 12, + 8, + 12, + 9, + 8, + 20, + 16, + 1, + 13, + 13, + 16, + 3, + 26, + 9, + 6, + 19, + 10, + 8, + 14, + 2, + 7, + 5, + 16, + 10, + 24, + 8, + 22, + 29, + 10, + 11, + 0, + 17, + 14, + 9, + 6, + 22, + 6, + 12, + 22, + 5, + 9, + 20, + 23, + 5, + 9, + 15, + 6, + 6, + 4, + 12, + 14, + 3, + 25, + 20, + 12, + 6, + 15, + 28, + 2 + ], + "weighted_loads": [ + 1.3834361992776394, + 0.6351033914834261, + 1.0910141579806805, + 0.6227822913497221, + 1.383963594213128, + 1.0182911586016417, + 0.49797390028834343, + 1.0165021028369665, + 0.786236222833395, + 0.6108218990266323, + 1.514650957658887, + 0.7289507426321507, + 0.03910929337143898, + 0.9251042865216732, + 0.5506643522530794, + 1.2802034690976143, + 0.28546663746237755, + 2.481137130409479, + 0.528548520145705, + 0.5949106886982918, + 1.5571782290935516, + 0.670407934114337, + 0.6471395790576935, + 1.1911837253719568, + 0.09950325638055801, + 0.48598016053438187, + 0.5006065592169762, + 0.8002205584198236, + 0.6077014580368996, + 1.6535071267717285, + 0.6276843287050724, + 1.8409618306905031, + 2.446063971146941, + 0.6040571201592684, + 1.0940493089146912, + 0.0, + 1.2728071995079517, + 1.5063319075852633, + 1.573966447263956, + 0.6258014068007469, + 1.463192667812109, + 0.34745102748274803, + 0.5891127567738295, + 1.7405898198485374, + 0.33384088054299355, + 0.4433233514428139, + 1.6142661068588495, + 1.9510653652250767, + 0.16214716620743275, + 0.41807944141328335, + 1.0823798552155495, + 0.24118927121162415, + 0.58624517172575, + 0.13053002208471298, + 0.9347577430307865, + 1.0041064023971558, + 0.18948842957615852, + 1.6066750437021255, + 1.6672001872211695, + 0.6753397546708584, + 0.6473781601525843, + 1.1998226195573807, + 1.9753847010433674, + 0.1224411204457283 + ], + "unique_experts": 63, + "load_cv": 0.5665964506760219, + "normalized_load_entropy": 0.9590036795114795, + "max_load_share": 0.03689567430025445 + } + }, + "s1_bos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "030634bdaf1b05d9be26ca98d69c58c50db87d96ecf2ace8f07fbc40a8ff6fae", + "route_weight_sha256": "a6185cd4397a1c81eddacd72fb9ea8d713c7ed7fb0e2f521a3bdf4e13bf63479", + "loads": [ + 19, + 10, + 13, + 4, + 14, + 11, + 6, + 12, + 9, + 8, + 10, + 17, + 1, + 0, + 12, + 12, + 3, + 26, + 4, + 6, + 19, + 10, + 6, + 13, + 2, + 0, + 0, + 14, + 10, + 2, + 8, + 23, + 29, + 9, + 0, + 0, + 17, + 12, + 7, + 6, + 20, + 5, + 5, + 23, + 4, + 9, + 8, + 23, + 1, + 8, + 13, + 6, + 6, + 4, + 12, + 15, + 3, + 24, + 20, + 1, + 0, + 14, + 25, + 3 + ], + "weighted_loads": [ + 1.4266221188008785, + 0.42079036124050617, + 0.9805885776877403, + 0.24650061130523682, + 1.309642544016242, + 0.9815872758626938, + 0.380302045494318, + 1.0481807738542557, + 0.7743163146078587, + 0.5983317345380783, + 0.8635095618665218, + 0.7813854552805424, + 0.04069092869758606, + 0.0, + 0.5414904411882162, + 0.9831721782684326, + 0.2883119583129883, + 2.4828148782253265, + 0.14393223263323307, + 0.5820903293788433, + 1.5458823144435883, + 0.4199260529130697, + 0.5141268596053123, + 1.1427376102656126, + 0.09902136400341988, + 0.0, + 0.0, + 0.7537695690989494, + 0.61907172575593, + 0.08448481187224388, + 0.633874699473381, + 1.8865527343004942, + 2.4466394633054733, + 0.5772780887782574, + 0.0, + 0.0, + 1.249421689659357, + 1.3329049833118916, + 0.5360861867666245, + 0.6255562528967857, + 1.3414675071835518, + 0.25392409786581993, + 0.25953538715839386, + 1.7781475726515055, + 0.29223398491740227, + 0.4438903108239174, + 0.45897956378757954, + 1.906089510768652, + 0.03201263025403023, + 0.39280048944056034, + 1.0229684747755527, + 0.2555477246642113, + 0.5750655867159367, + 0.13303102552890778, + 0.918962262570858, + 1.02573006413877, + 0.19234326109290123, + 1.5938797388225794, + 1.6869664713740349, + 0.05876173451542854, + 0.0, + 1.1589129939675331, + 1.7391939088702202, + 0.14620567485690117 + ], + "unique_experts": 58, + "load_cv": 0.7506968401538778, + "normalized_load_entropy": 0.9255050322603552, + "max_load_share": 0.04559748427672956 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "069edf9a22c5328b3d6ecb6907016e860b50650f28e305daeb92128cbf44e065", + "route_weight_sha256": "9f289a8345d75c9cc4e1a2b0766f63d43b2d250e54c576839255c83bd78be9fe", + "loads": [ + 19, + 12, + 17, + 14, + 15, + 11, + 10, + 12, + 9, + 17, + 19, + 18, + 2, + 14, + 15, + 17, + 5, + 28, + 12, + 8, + 20, + 12, + 11, + 14, + 2, + 10, + 8, + 14, + 10, + 24, + 8, + 24, + 29, + 10, + 15, + 0, + 19, + 17, + 10, + 9, + 23, + 10, + 14, + 23, + 5, + 11, + 19, + 27, + 1, + 10, + 16, + 6, + 10, + 8, + 18, + 15, + 8, + 26, + 20, + 14, + 9, + 16, + 29, + 4 + ], + "weighted_loads": [ + 1.4266221188008785, + 0.5511930901557207, + 1.207479327917099, + 1.073744693043409, + 1.3703886289149523, + 0.9815872758626938, + 0.6466245166957378, + 1.0481807738542557, + 0.7743163146078587, + 1.6761780679225922, + 1.453196695074439, + 0.7984562255442142, + 0.14094726741313934, + 0.9818698987364769, + 0.6162005141377449, + 1.374735102057457, + 0.65126833319664, + 2.5534234400838614, + 0.8471681582741439, + 0.6719382591545582, + 1.5950963199138641, + 0.7499214690178633, + 0.9186740145087242, + 1.2364641781896353, + 0.09902136400341988, + 0.6943119056522846, + 0.7773732058703899, + 0.7537695690989494, + 0.61907172575593, + 1.3855321798473597, + 0.633874699473381, + 1.9049384202808142, + 2.4466394633054733, + 0.602634722366929, + 1.3669785654637963, + 0.0, + 1.301683273166418, + 1.5821706596761942, + 1.7239374741911888, + 0.8366160318255424, + 1.501911323517561, + 0.4843732938898029, + 0.6899049989879131, + 1.7781475726515055, + 0.3304465599358082, + 0.4744780176843051, + 1.6966041829437017, + 2.244549874216318, + 0.03201263025403023, + 0.45647301338613033, + 1.1495666429400444, + 0.2555477246642113, + 1.0112607292830944, + 0.31494126468896866, + 1.4704092592000961, + 1.02573006413877, + 0.6133920811116695, + 1.6670235972851515, + 1.6869664713740349, + 0.78863993473351, + 1.1092371568083763, + 1.3550317510962486, + 2.0550098083913326, + 0.19060947000980377 + ], + "unique_experts": 63, + "load_cv": 0.4947209762685603, + "normalized_load_entropy": 0.9676109776468482, + "max_load_share": 0.032879818594104306 + } + }, + "s0_x": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "28836afc82972a1087727c8ba375dabcf183fbce7262962ba036b0fb1f4295f5", + "route_weight_sha256": "c6e9401fcaa608f5fc4fc1c1a4b6f5fb6ca71988274533ff4ad55dff8aef5682", + "loads": [ + 18, + 11, + 12, + 4, + 14, + 12, + 6, + 11, + 9, + 8, + 10, + 14, + 0, + 0, + 9, + 12, + 3, + 26, + 4, + 6, + 19, + 9, + 6, + 16, + 2, + 0, + 0, + 15, + 10, + 4, + 8, + 22, + 29, + 7, + 0, + 0, + 17, + 11, + 8, + 6, + 21, + 5, + 4, + 23, + 6, + 10, + 8, + 23, + 5, + 7, + 13, + 6, + 6, + 4, + 12, + 14, + 3, + 24, + 20, + 1, + 0, + 15, + 25, + 3 + ], + "weighted_loads": [ + 1.373115036636591, + 0.4782284330576658, + 0.9454113077372313, + 0.25912244617938995, + 1.288365414366126, + 0.9899936057627201, + 0.4024266228079796, + 0.9606597069650888, + 0.7705715782940388, + 0.6007292531430721, + 0.8833559080958366, + 0.6724330242723227, + 0.0, + 0.0, + 0.45469101145863533, + 0.9916213732212782, + 0.2825716510415077, + 2.5041353553533554, + 0.15213707461953163, + 0.5987653136253357, + 1.558691419661045, + 0.3865542933344841, + 0.5510990396142006, + 1.2492150608450174, + 0.09778378903865814, + 0.0, + 0.0, + 0.7792908325791359, + 0.6170795485377312, + 0.13436226174235344, + 0.6422089971601963, + 1.8661248069256544, + 2.42554684355855, + 0.4984657932072878, + 0.0, + 0.0, + 1.259599195793271, + 1.259764026850462, + 0.5803417582064867, + 0.6256403475999832, + 1.3806316182017326, + 0.2561817578971386, + 0.22038725018501282, + 1.744605464860797, + 0.35881086625158787, + 0.4775246698409319, + 0.4656182359904051, + 2.0117138661444187, + 0.16342538967728615, + 0.3512745276093483, + 0.9936560802161694, + 0.24426142685115337, + 0.614960066974163, + 0.12902785651385784, + 0.9372374452650547, + 1.0055573731660843, + 0.18816396594047546, + 1.6185547728091478, + 1.6667760387063026, + 0.05421171709895134, + 0.0, + 1.2041538693010807, + 1.7758007273077965, + 0.1498165726661682 + ], + "unique_experts": 57, + "load_cv": 0.740724588777398, + "normalized_load_entropy": 0.927562505021289, + "max_load_share": 0.04559748427672956 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "6a7caad0bc51ae1a82192cc4277eaf3a92edb23d8b29a57e6b982f39e8edd81f", + "route_weight_sha256": "6a72c23f1a43230633584f8df81ccebb42d68f6c01cea217b0b278ce662caf90", + "loads": [ + 18, + 15, + 17, + 8, + 15, + 12, + 7, + 11, + 9, + 8, + 21, + 15, + 0, + 12, + 12, + 16, + 3, + 26, + 8, + 6, + 19, + 10, + 8, + 16, + 2, + 6, + 5, + 15, + 10, + 20, + 8, + 23, + 29, + 8, + 9, + 0, + 17, + 14, + 9, + 6, + 25, + 7, + 13, + 23, + 6, + 11, + 21, + 23, + 7, + 8, + 15, + 6, + 7, + 4, + 12, + 14, + 3, + 24, + 20, + 13, + 5, + 15, + 28, + 3 + ], + "weighted_loads": [ + 1.373115036636591, + 0.6762815397232771, + 1.1935138329863548, + 0.5953049189120065, + 1.35107216052711, + 0.9899936057627201, + 0.46653149276971817, + 0.9606597069650888, + 0.7705715782940388, + 0.6007292531430721, + 1.7569936010986567, + 0.6895037945359945, + 0.0, + 0.8848548233509064, + 0.5294157154858112, + 1.3036122377961874, + 0.2825716510415077, + 2.5041353553533554, + 0.3912976385036018, + 0.5987653136253357, + 1.558691419661045, + 0.6761728748679161, + 0.6865337714552879, + 1.2492150608450174, + 0.09778378903865814, + 0.38970164582133293, + 0.5396211892366409, + 0.7792908325791359, + 0.6170795485377312, + 1.3362370061659021, + 0.6422089971601963, + 1.8845104929059744, + 2.42554684355855, + 0.5238224267959595, + 0.8578817960806191, + 0.0, + 1.259599195793271, + 1.4388521760702133, + 1.5769646782428026, + 0.6256403475999832, + 1.5785572938621044, + 0.391070194542408, + 0.6162494886666536, + 1.744605464860797, + 0.35881086625158787, + 0.5076215974986553, + 1.8590683843940496, + 2.0117138661444187, + 0.24343717470765114, + 0.37926754355430603, + 1.0754902996122837, + 0.24426142685115337, + 0.6383317690342665, + 0.12902785651385784, + 0.9372374452650547, + 1.0055573731660843, + 0.18816396594047546, + 1.6185547728091478, + 1.6667760387063026, + 0.7482909858226776, + 0.44445453444495797, + 1.2041538693010807, + 1.9934544079005718, + 0.1498165726661682 + ], + "unique_experts": 62, + "load_cv": 0.5716929295094144, + "normalized_load_entropy": 0.9579526988531777, + "max_load_share": 0.03689567430025445 + } + }, + "s1_x": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "954f4fd494a7e67d066ee40696d0ce07f564accf5abfece69ad36fc5713be8ed", + "route_weight_sha256": "9b7dc66048b6ea48484ae4329c29ebb984030ef8f2654889b547a6ea4a24fd75", + "loads": [ + 19, + 9, + 13, + 4, + 13, + 11, + 6, + 11, + 9, + 8, + 10, + 16, + 1, + 0, + 11, + 12, + 3, + 26, + 4, + 6, + 19, + 9, + 6, + 16, + 2, + 0, + 0, + 14, + 10, + 2, + 8, + 21, + 28, + 9, + 0, + 0, + 19, + 12, + 7, + 6, + 20, + 5, + 5, + 23, + 4, + 11, + 8, + 23, + 0, + 10, + 13, + 6, + 6, + 4, + 12, + 16, + 3, + 24, + 20, + 2, + 0, + 13, + 25, + 3 + ], + "weighted_loads": [ + 1.4400530830025673, + 0.389031732454896, + 0.9873880203813314, + 0.2548496574163437, + 1.2599803134799004, + 0.9847041256725788, + 0.3846304155886173, + 1.003185674548149, + 0.7706501670181751, + 0.5971365869045258, + 0.8778951726853848, + 0.7371705509722233, + 0.040444955229759216, + 0.0, + 0.5214229822158813, + 0.9810498543083668, + 0.2852596119046211, + 2.5040296651422977, + 0.1482209712266922, + 0.5890918634831905, + 1.5244184881448746, + 0.39107353426516056, + 0.5304332971572876, + 1.2369100265204906, + 0.09432100132107735, + 0.0, + 0.0, + 0.7566765490919352, + 0.6353085450828075, + 0.07992245256900787, + 0.6426385827362537, + 1.7971680257469416, + 2.3940262999385595, + 0.5553140621632338, + 0.0, + 0.0, + 1.338767934590578, + 1.2746349684894085, + 0.5285873711109161, + 0.622591957449913, + 1.2987305354326963, + 0.26003871113061905, + 0.25835098698735237, + 1.7705289963632822, + 0.2905222661793232, + 0.5220073740929365, + 0.49162482656538486, + 1.962685950100422, + 0.0, + 0.4547936376184225, + 1.0170929580926895, + 0.2566204220056534, + 0.5946164652705193, + 0.13712593540549278, + 0.9207926094532013, + 1.0509242992848158, + 0.1952708624303341, + 1.6204631701111794, + 1.690572975203395, + 0.10053230449557304, + 0.0, + 1.1265572309494019, + 1.7408844158053398, + 0.14427083358168602 + ], + "unique_experts": 57, + "load_cv": 0.7456212909573433, + "normalized_load_entropy": 0.925508511545786, + "max_load_share": 0.0440251572327044 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "4b491751ef5b73e8f61fb0bc9f4ad5e29ae9f637869d49a9b212835b5debefdf", + "route_weight_sha256": "5595261ac89de3e8da3474208abf34bfe0df68343d5ebfbfb487fe8eca0f7c1c", + "loads": [ + 19, + 12, + 19, + 13, + 14, + 11, + 9, + 11, + 9, + 17, + 20, + 17, + 2, + 13, + 14, + 17, + 5, + 28, + 11, + 8, + 20, + 11, + 11, + 17, + 2, + 10, + 8, + 14, + 10, + 21, + 8, + 22, + 28, + 10, + 14, + 0, + 21, + 17, + 10, + 9, + 24, + 10, + 15, + 23, + 5, + 13, + 21, + 27, + 0, + 12, + 16, + 6, + 10, + 8, + 18, + 16, + 8, + 26, + 20, + 16, + 8, + 15, + 29, + 4 + ], + "weighted_loads": [ + 1.4400530830025673, + 0.5658898260444403, + 1.2797477710992098, + 1.0478156667377334, + 1.3159155547618866, + 0.9847041256725788, + 0.6050770431756973, + 1.003185674548149, + 0.7706501670181751, + 1.6749829202890396, + 1.6579870041459799, + 0.7542413212358952, + 0.1407012939453125, + 0.9395650438964367, + 0.59613305516541, + 1.3655371367931366, + 0.6482159867882729, + 2.5746382270008326, + 0.697094866540283, + 0.6789397932589054, + 1.5736324936151505, + 0.7210689503699541, + 0.9432195834815502, + 1.3306365944445133, + 0.09432100132107735, + 0.6400742679834366, + 0.802515771239996, + 0.7566765490919352, + 0.6353085450828075, + 1.167326545342803, + 0.6426385827362537, + 1.8155537117272615, + 2.3940262999385595, + 0.5806706957519054, + 1.1813864393625408, + 0.0, + 1.3916126620024443, + 1.5175518970936537, + 1.7164386585354805, + 0.8336517363786697, + 1.5132349152117968, + 0.4906055890751304, + 0.7289276197552681, + 1.7705289963632822, + 0.3287348411977291, + 0.5525950809533242, + 1.9810035023838282, + 2.301146313548088, + 0.0, + 0.5184661615639925, + 1.1441969946026802, + 0.2566204220056534, + 1.030811607837677, + 0.31903617456555367, + 1.4722396060824394, + 1.0509242992848158, + 0.6163196824491024, + 1.6936070285737514, + 1.690572975203395, + 0.8997536618262529, + 0.8924240060150623, + 1.3226759880781174, + 2.0446549244225025, + 0.18867462873458862 + ], + "unique_experts": 62, + "load_cv": 0.4968781246891196, + "normalized_load_entropy": 0.9664683436944366, + "max_load_share": 0.032879818594104306 + } + }, + "s0_period": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "8e4128d95f032215e0198e1dac1cb5dbe87e4d6537bb8451b8c9afd92ea3f0f0", + "route_weight_sha256": "04b0bb4e0fb12f8c6b19931fdcbcdf30edecf1c642031fcd6c23cff62f4aba34", + "loads": [ + 18, + 11, + 12, + 4, + 14, + 12, + 7, + 11, + 9, + 8, + 10, + 14, + 1, + 0, + 9, + 12, + 3, + 26, + 4, + 6, + 19, + 9, + 6, + 14, + 2, + 0, + 0, + 15, + 10, + 4, + 8, + 22, + 29, + 8, + 0, + 0, + 16, + 11, + 7, + 6, + 21, + 5, + 4, + 23, + 6, + 10, + 8, + 23, + 5, + 8, + 13, + 6, + 6, + 4, + 12, + 14, + 3, + 25, + 20, + 1, + 0, + 15, + 25, + 2 + ], + "weighted_loads": [ + 1.383093524724245, + 0.47992124035954475, + 0.9404020216315985, + 0.25932013988494873, + 1.2787076700478792, + 0.9861434958875179, + 0.43130892142653465, + 0.9756620228290558, + 0.7734606117010117, + 0.5992015600204468, + 0.8754502646625042, + 0.673474483191967, + 0.03894531726837158, + 0.0, + 0.4557567834854126, + 0.9868290722370148, + 0.2823733240365982, + 2.4937752448022366, + 0.1549975946545601, + 0.601123683154583, + 1.5556178838014603, + 0.3786433655768633, + 0.5452982261776924, + 1.1847644001245499, + 0.09801416471600533, + 0.0, + 0.0, + 0.7745393998920918, + 0.6211478784680367, + 0.13524418324232101, + 0.6400337740778923, + 1.8512651398777962, + 2.4131905175745487, + 0.541920643299818, + 0.0, + 0.0, + 1.204941626638174, + 1.2884976007044315, + 0.5448890924453735, + 0.6278200596570969, + 1.386929303407669, + 0.2558045797049999, + 0.22321440279483795, + 1.7608647290617228, + 0.3568670339882374, + 0.47012918442487717, + 0.4536384865641594, + 1.998764242976904, + 0.15351511165499687, + 0.4001362584531307, + 0.9948554411530495, + 0.24304964393377304, + 0.6198853030800819, + 0.12975943833589554, + 0.9339115992188454, + 0.9993716664612293, + 0.1883574202656746, + 1.6524037029594183, + 1.6623603608459234, + 0.051944028586149216, + 0.0, + 1.2009014189243317, + 1.7788934037089348, + 0.12155627086758614 + ], + "unique_experts": 58, + "load_cv": 0.7385854619695192, + "normalized_load_entropy": 0.9287132537560583, + "max_load_share": 0.04559748427672956 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "003bbda4f777c82e28b2ce459a162a74d37392fb1076c11cdc3ecf02821f9ed6", + "route_weight_sha256": "271fd3a188199cb9786f88333f9d4bd0411bdcad5d597cda5cf9c8917f6d368f", + "loads": [ + 18, + 15, + 16, + 8, + 15, + 12, + 8, + 11, + 9, + 8, + 20, + 15, + 1, + 12, + 12, + 16, + 3, + 26, + 8, + 6, + 19, + 10, + 9, + 14, + 2, + 6, + 6, + 15, + 10, + 21, + 8, + 23, + 29, + 9, + 9, + 0, + 16, + 14, + 8, + 6, + 24, + 7, + 12, + 23, + 6, + 11, + 20, + 23, + 7, + 9, + 15, + 7, + 8, + 4, + 12, + 14, + 3, + 25, + 20, + 13, + 5, + 15, + 28, + 2 + ], + "weighted_loads": [ + 1.383093524724245, + 0.6886724345386028, + 1.148554164916277, + 0.5996733209758531, + 1.3460298273712397, + 0.9861434958875179, + 0.502544853836298, + 0.9756620228290558, + 0.7734606117010117, + 0.5992015600204468, + 1.5329637955874205, + 0.6905452534556389, + 0.03894531726837158, + 0.8632313832640648, + 0.5304814875125885, + 1.2813857197761536, + 0.2823733240365982, + 2.4937752448022366, + 0.4018089660385158, + 0.601123683154583, + 1.5556178838014603, + 0.6682619471102953, + 0.7171807326376438, + 1.1847644001245499, + 0.09801416471600533, + 0.37096923030912876, + 0.8075688853859901, + 0.7745393998920918, + 0.6211478784680367, + 1.362694934286992, + 0.6400337740778923, + 1.8696508258581161, + 2.4131905175745487, + 0.5672772768884897, + 0.8518289034254849, + 0.0, + 1.204941626638174, + 1.4688700437545776, + 1.5415120124816895, + 0.6278200596570969, + 1.527960117906332, + 0.3884730413556099, + 0.5834011938422918, + 1.7608647290617228, + 0.3568670339882374, + 0.5002261120826006, + 1.7620475962758064, + 1.998764242976904, + 0.24493155628442764, + 0.42812927439808846, + 1.0757415369153023, + 0.3686927929520607, + 0.7084471546113491, + 0.12975943833589554, + 0.9339115992188454, + 0.9993716664612293, + 0.1883574202656746, + 1.6524037029594183, + 1.6623603608459234, + 0.7532928064465523, + 0.44540979946032166, + 1.2009014189243317, + 1.997762992978096, + 0.12155627086758614 + ], + "unique_experts": 63, + "load_cv": 0.5618226111975865, + "normalized_load_entropy": 0.9599701713736472, + "max_load_share": 0.03689567430025445 + } + }, + "s1_period": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "d29f344cb4614a551a6597742379f4ca5bbfce77be25bdc4f54c2b433e24be98", + "route_weight_sha256": "1194b80b778fded131adb82b63fab84da142a8c16ad43c84d1c993627daf3f87", + "loads": [ + 19, + 10, + 14, + 4, + 13, + 11, + 6, + 11, + 9, + 8, + 10, + 16, + 1, + 0, + 11, + 12, + 3, + 26, + 4, + 6, + 19, + 10, + 6, + 15, + 2, + 0, + 0, + 13, + 10, + 2, + 8, + 22, + 27, + 9, + 0, + 0, + 19, + 11, + 7, + 6, + 20, + 5, + 5, + 23, + 4, + 12, + 8, + 23, + 0, + 10, + 13, + 6, + 6, + 4, + 12, + 15, + 3, + 24, + 20, + 1, + 0, + 14, + 25, + 3 + ], + "weighted_loads": [ + 1.4335098434239626, + 0.42241799272596836, + 1.016542725265026, + 0.25353994220495224, + 1.253371600061655, + 0.9819605387747288, + 0.38093800470232964, + 1.014160431921482, + 0.768192071467638, + 0.5970341935753822, + 0.8805694282054901, + 0.7379926070570946, + 0.04044593870639801, + 0.0, + 0.5227374937385321, + 0.9788608737289906, + 0.2853848524391651, + 2.4917488507926464, + 0.14826666563749313, + 0.5861212573945522, + 1.5285871848464012, + 0.4245246108621359, + 0.518296554684639, + 1.1941444259136915, + 0.09388045221567154, + 0.0, + 0.0, + 0.7129826862365007, + 0.635498121380806, + 0.07647473365068436, + 0.6389786265790462, + 1.8099524844437838, + 2.3652852177619934, + 0.5715508684515953, + 0.0, + 0.0, + 1.3307781238108873, + 1.2778896354138851, + 0.5257143378257751, + 0.625584252178669, + 1.309664960950613, + 0.2549790143966675, + 0.2554640546441078, + 1.7802454233169556, + 0.29162305407226086, + 0.543442863970995, + 0.4806116260588169, + 1.9439614415168762, + 0.0, + 0.4612347986549139, + 1.0202568508684635, + 0.2535383999347687, + 0.5898472368717194, + 0.13683593645691872, + 0.9170299135148525, + 1.0212008766829967, + 0.19550712779164314, + 1.6243298910558224, + 1.6994267757982016, + 0.058721430599689484, + 0.0, + 1.1610051579773426, + 1.7484193854033947, + 0.13976320624351501 + ], + "unique_experts": 57, + "load_cv": 0.7443469960017739, + "normalized_load_entropy": 0.9251341046313518, + "max_load_share": 0.04245283018867924 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "555df4a58c7cb25d24efb68c2ce16d3b76c3b4dd11be8732980c9edf4b9ebee4", + "route_weight_sha256": "1b7e011f8e6593ac7deb815311b737a63c2cedbfd9c7a1a8f1d620c7ec1e5e21", + "loads": [ + 19, + 13, + 19, + 13, + 14, + 11, + 9, + 11, + 9, + 17, + 19, + 17, + 2, + 13, + 14, + 17, + 5, + 28, + 11, + 8, + 20, + 12, + 12, + 16, + 2, + 10, + 9, + 13, + 10, + 21, + 8, + 23, + 27, + 10, + 13, + 0, + 21, + 17, + 10, + 9, + 23, + 10, + 14, + 23, + 5, + 14, + 20, + 27, + 0, + 12, + 16, + 7, + 11, + 8, + 18, + 15, + 8, + 26, + 20, + 15, + 8, + 16, + 29, + 5 + ], + "weighted_loads": [ + 1.4335098434239626, + 0.5882428716868162, + 1.269698977470398, + 1.0487091776158195, + 1.3132524937391281, + 0.9819605387747288, + 0.6096223667263985, + 1.014160431921482, + 0.768192071467638, + 1.674880526959896, + 1.4702565614134073, + 0.7550633773207664, + 0.1407022774219513, + 0.9140410237014294, + 0.5974475666880608, + 1.3700060285627842, + 0.6483412273228168, + 2.562357412651181, + 0.6999118565581739, + 0.6759691871702671, + 1.577801190316677, + 0.7545200269669294, + 0.9631991125643253, + 1.2878709938377142, + 0.09388045221567154, + 0.6117020584642887, + 1.10291962698102, + 0.7129826862365007, + 0.635498121380806, + 1.152203792706132, + 0.6389786265790462, + 1.8283381704241037, + 2.3652852177619934, + 0.596907502040267, + 1.1257696545217186, + 0.0, + 1.3845367394387722, + 1.5661009345203638, + 1.7135656252503395, + 0.8366440311074257, + 1.4701087772846222, + 0.48294870935205836, + 0.6858336664736271, + 1.7802454233169556, + 0.32983562909066677, + 0.5740305708313826, + 1.8202248513698578, + 2.2824218049645424, + 0.0, + 0.5249073226004839, + 1.1463626734912395, + 0.3496968522667885, + 1.0785162597894669, + 0.3187461756169796, + 1.4684769101440907, + 1.0212008766829967, + 0.6165559478104115, + 1.6974737495183945, + 1.6994267757982016, + 0.9146947618573904, + 0.8937396183609962, + 1.3571239151060581, + 2.0654873214662075, + 0.2146223559975624 + ], + "unique_experts": 62, + "load_cv": 0.4863350898425885, + "normalized_load_entropy": 0.9678030004344504, + "max_load_share": 0.032879818594104306 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 106, + "ordered_topk_exact_tokens": 88, + "set_exact_tokens": 95, + "mean_set_jaccard": 0.9703504043126685, + "mean_token_weighted_tv": 0.006861931055713937, + "aggregate_load_tv": 0.015723270440251572 + }, + "system_bos": { + "tokens": 106, + "ordered_topk_exact_tokens": 78, + "set_exact_tokens": 88, + "mean_set_jaccard": 0.9474393530997305, + "mean_token_weighted_tv": 0.012502119797369782, + "aggregate_load_tv": 0.026729559748427674 + }, + "system_x": { + "tokens": 106, + "ordered_topk_exact_tokens": 71, + "set_exact_tokens": 80, + "mean_set_jaccard": 0.9278975741239892, + "mean_token_weighted_tv": 0.015501524023008797, + "aggregate_load_tv": 0.031446540880503145 + }, + "system_period": { + "tokens": 106, + "ordered_topk_exact_tokens": 75, + "set_exact_tokens": 83, + "mean_set_jaccard": 0.9344115004492364, + "mean_token_weighted_tv": 0.015066548927142372, + "aggregate_load_tv": 0.031446540880503145 + }, + "bos_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 68, + "set_exact_tokens": 80, + "mean_set_jaccard": 0.9278975741239892, + "mean_token_weighted_tv": 0.018258946165793908, + "aggregate_load_tv": 0.025157232704402517 + }, + "bos_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 66, + "set_exact_tokens": 79, + "mean_set_jaccard": 0.9272237196765499, + "mean_token_weighted_tv": 0.018835988009945966, + "aggregate_load_tv": 0.03616352201257862 + }, + "x_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 75, + "set_exact_tokens": 85, + "mean_set_jaccard": 0.9413746630727762, + "mean_token_weighted_tv": 0.01654420613820823, + "aggregate_load_tv": 0.028301886792452834 + }, + "x_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 62, + "set_exact_tokens": 74, + "mean_set_jaccard": 0.9137466307277629, + "mean_token_weighted_tv": 0.021473058578470407, + "aggregate_load_tv": 0.045597484276729564 + }, + "period_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 71, + "set_exact_tokens": 83, + "mean_set_jaccard": 0.9359838274932614, + "mean_token_weighted_tv": 0.016777586068887757, + "aggregate_load_tv": 0.026729559748427674 + }, + "period_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 62, + "set_exact_tokens": 74, + "mean_set_jaccard": 0.9117250673854448, + "mean_token_weighted_tv": 0.021654883065735393, + "aggregate_load_tv": 0.045597484276729564 + } + } + }, + "layer_05": { + "layer": 5, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "3b57efff154237fe225d9bbb9b4792cbb1c68c83a06bbc231a4e1d28313848ce", + "route_weight_sha256": "70c05905c07a242b066a24a7c52c4581f5cf1cadbe3fd5ffe6dba4561f891f6b", + "loads": [ + 4, + 5, + 19, + 7, + 14, + 6, + 2, + 13, + 8, + 10, + 0, + 4, + 6, + 17, + 41, + 1, + 11, + 1, + 0, + 4, + 12, + 5, + 23, + 10, + 8, + 6, + 14, + 7, + 5, + 16, + 11, + 6, + 24, + 17, + 23, + 0, + 13, + 2, + 0, + 1, + 14, + 0, + 9, + 5, + 12, + 15, + 13, + 10, + 14, + 1, + 0, + 10, + 2, + 6, + 9, + 8, + 11, + 11, + 25, + 34, + 27, + 11, + 7, + 6 + ], + "weighted_loads": [ + 0.2761971838772297, + 0.23429909348487854, + 1.5979280807077885, + 0.5224511586129665, + 0.7530813552439213, + 0.23955112881958485, + 0.15842075273394585, + 0.95862852409482, + 0.4077389985322952, + 0.4566696248948574, + 0.0, + 0.18056795001029968, + 0.516250267624855, + 1.215536743402481, + 3.2314039170742035, + 0.032475538551807404, + 1.0421234145760536, + 0.042541276663541794, + 0.0, + 0.20055846124887466, + 0.5368448197841644, + 0.36007263138890266, + 1.674861129373312, + 0.6140849739313126, + 0.5073203518986702, + 0.30816263891756535, + 0.9596301056444645, + 0.6679347641766071, + 0.24213692359626293, + 1.2785879969596863, + 0.6598573066294193, + 0.26035455241799355, + 1.1932132989168167, + 1.2630372308194637, + 1.896285830065608, + 0.0, + 0.7927178964018822, + 0.1956365667283535, + 0.0, + 0.03400837630033493, + 0.9655244182795286, + 0.0, + 0.9248266443610191, + 0.5098825693130493, + 0.724996916949749, + 1.1382833756506443, + 0.725476797670126, + 0.6976057961583138, + 1.1422322485595942, + 0.0587395504117012, + 0.0, + 0.6883076056838036, + 0.07289976999163628, + 0.4694150350987911, + 0.4994385279715061, + 0.5824432447552681, + 0.5576145872473717, + 0.8034348525106907, + 2.4997966289520264, + 3.9196354150772095, + 2.661437716335058, + 0.7106204126030207, + 0.3501591347157955, + 0.40345763973891735 + ], + "unique_experts": 58, + "load_cv": 0.8333985971833123, + "normalized_load_entropy": 0.9175175189687514, + "max_load_share": 0.06446540880503145 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "a17fbc88fcfe4218eba261cfb68ca109c1b08d284f13351ea33b38039f14be60", + "route_weight_sha256": "542c13b35c9cba0a3b4786b849eaed76bc7c3e945d5a1877e1657cbdeaa818d3", + "loads": [ + 4, + 6, + 19, + 7, + 15, + 7, + 4, + 15, + 9, + 11, + 10, + 4, + 9, + 17, + 41, + 13, + 14, + 7, + 9, + 5, + 14, + 5, + 23, + 10, + 8, + 14, + 14, + 7, + 5, + 17, + 11, + 6, + 24, + 17, + 23, + 5, + 13, + 2, + 11, + 8, + 19, + 8, + 18, + 6, + 14, + 15, + 13, + 12, + 14, + 4, + 7, + 10, + 4, + 15, + 12, + 17, + 11, + 11, + 25, + 35, + 27, + 11, + 7, + 8 + ], + "weighted_loads": [ + 0.2761971838772297, + 0.23780662985518575, + 1.5979280807077885, + 0.5224511586129665, + 0.7548475930234417, + 0.275870518758893, + 0.2325599379837513, + 0.9952205445151776, + 0.4110950971953571, + 0.4612001455388963, + 0.5883434191346169, + 0.18056795001029968, + 0.7125271484255791, + 1.215536743402481, + 3.2314039170742035, + 2.006290715187788, + 1.3009330332279205, + 0.339633546769619, + 0.8087241612374783, + 0.21362189669162035, + 0.5523287521209568, + 0.36007263138890266, + 1.674861129373312, + 0.6140849739313126, + 0.5073203518986702, + 1.2073265928775072, + 0.9596301056444645, + 0.6679347641766071, + 0.24213692359626293, + 1.3098694905638695, + 0.6598573066294193, + 0.26035455241799355, + 1.1932132989168167, + 1.2630372308194637, + 1.896285830065608, + 0.43511495366692543, + 0.7927178964018822, + 0.1956365667283535, + 1.0870030112564564, + 0.6388167031109333, + 1.17184441909194, + 0.7758868783712387, + 1.7709394916892052, + 0.5523672066628933, + 0.8847065195441246, + 1.1382833756506443, + 0.725476797670126, + 0.7155796405859292, + 1.1422322485595942, + 0.2135008331388235, + 0.6613304428756237, + 0.6883076056838036, + 1.7022130005061626, + 1.0633132793009281, + 0.5163133632158861, + 1.2703734785318375, + 0.5576145872473717, + 0.8034348525106907, + 2.4997966289520264, + 3.9653655365109444, + 2.661437716335058, + 0.7106204126030207, + 0.3501591347157955, + 1.3389437329024076 + ], + "unique_experts": 64, + "load_cv": 0.5956535936654047, + "normalized_load_entropy": 0.9620027956711968, + "max_load_share": 0.05216284987277354 + } + }, + "s1_eos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "1520c8cf520477f7af530cc84523c9e6a5f05846e284f9433cd8d2543cf8f585", + "route_weight_sha256": "326f2e15a93b2f8720f048667e56dfdacb73e2c1a55c93c519e9600b62752c07", + "loads": [ + 4, + 6, + 19, + 6, + 13, + 6, + 2, + 13, + 8, + 10, + 0, + 3, + 6, + 17, + 41, + 1, + 11, + 1, + 0, + 5, + 12, + 5, + 23, + 11, + 7, + 7, + 15, + 7, + 5, + 15, + 11, + 5, + 24, + 17, + 22, + 0, + 13, + 2, + 0, + 1, + 14, + 0, + 9, + 5, + 12, + 15, + 17, + 10, + 15, + 1, + 1, + 10, + 2, + 5, + 7, + 8, + 11, + 11, + 25, + 34, + 27, + 10, + 7, + 6 + ], + "weighted_loads": [ + 0.273258525878191, + 0.2588463630527258, + 1.6056763976812363, + 0.4870515912771225, + 0.7181868366897106, + 0.2428632490336895, + 0.15972161665558815, + 0.9477242231369019, + 0.4052456021308899, + 0.46278220415115356, + 0.0, + 0.15137894824147224, + 0.5164763145148754, + 1.2115086503326893, + 3.201437082141638, + 0.032706405967473984, + 1.0371468476951122, + 0.04200546815991402, + 0.0, + 0.23676839098334312, + 0.5489494726061821, + 0.3611077778041363, + 1.6621416248381138, + 0.6569396629929543, + 0.47246785648167133, + 0.3336329162120819, + 1.0094166733324528, + 0.6686172485351562, + 0.24136106669902802, + 1.2459398955106735, + 0.6631479263305664, + 0.2223997302353382, + 1.1976938471198082, + 1.2789466045796871, + 1.8582854121923447, + 0.0, + 0.7851021103560925, + 0.19801176339387894, + 0.0, + 0.03374800831079483, + 0.9540967848151922, + 0.0, + 0.9135397970676422, + 0.5068499930202961, + 0.7272137030959129, + 1.131502240896225, + 0.891317879781127, + 0.6967779211699963, + 1.1695406343787909, + 0.059888217598199844, + 0.02574901655316353, + 0.6694751493632793, + 0.07575823739171028, + 0.44440530613064766, + 0.42806725576519966, + 0.5691402815282345, + 0.5571539048105478, + 0.7991954758763313, + 2.5212221406400204, + 3.954327717423439, + 2.6436433233320713, + 0.6696202345192432, + 0.351798340678215, + 0.4231371097266674 + ], + "unique_experts": 59, + "load_cv": 0.8352949500468861, + "normalized_load_entropy": 0.9178603789424242, + "max_load_share": 0.06446540880503145 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "fe059ef4fd18ce4e2391aab132d3c9b6dba16a79246b2bd6d9f07ce7470690c0", + "route_weight_sha256": "df01e67abbc59ad6627593415335d58822c4c8296ac45b1bd8f97b05203e0339", + "loads": [ + 5, + 7, + 19, + 12, + 14, + 8, + 11, + 15, + 9, + 11, + 12, + 6, + 11, + 17, + 42, + 15, + 15, + 12, + 12, + 15, + 14, + 5, + 24, + 11, + 8, + 15, + 15, + 9, + 5, + 18, + 11, + 5, + 25, + 18, + 23, + 5, + 14, + 5, + 12, + 12, + 18, + 14, + 22, + 9, + 14, + 15, + 17, + 13, + 15, + 15, + 10, + 12, + 4, + 15, + 11, + 18, + 11, + 11, + 26, + 35, + 28, + 10, + 7, + 10 + ], + "weighted_loads": [ + 0.31015167012810707, + 0.26241649757139385, + 1.6056763976812363, + 0.9000983871519566, + 0.7199600775493309, + 0.3159369081258774, + 1.1719492264091969, + 1.0025324574671686, + 0.4086057851091027, + 0.46720202965661883, + 0.749253373593092, + 0.5264166556298733, + 0.9454875290393829, + 1.2115086503326893, + 3.2351355850696564, + 2.5190200493671, + 1.3823277093470097, + 0.7209266126155853, + 1.1467117443680763, + 1.089568835683167, + 0.5642884767148644, + 0.3611077778041363, + 1.7001036629080772, + 0.6569396629929543, + 0.5485547874122858, + 1.052002664655447, + 1.0094166733324528, + 0.8413334935903549, + 0.24136106669902802, + 1.3625003546476364, + 0.6631479263305664, + 0.2223997302353382, + 1.3174441307783127, + 1.3223239928483963, + 1.8928320854902267, + 0.5633079707622528, + 0.8307116627693176, + 0.3489954322576523, + 1.2307952865958214, + 1.0963216051459312, + 1.1183835808187723, + 1.2118655294179916, + 2.045615378767252, + 0.7520828321576118, + 0.8581251800060272, + 1.131502240896225, + 0.891317879781127, + 0.7477731846738607, + 1.1695406343787909, + 0.888741685077548, + 1.0886446684598923, + 0.7376639470458031, + 1.7050272412598133, + 1.247693058103323, + 0.482790156500414, + 1.1867046486586332, + 0.5571539048105478, + 0.7991954758763313, + 2.5917196162045, + 4.001807041466236, + 2.689540561288595, + 0.6696202345192432, + 0.351798340678215, + 1.6015939451754093 + ], + "unique_experts": 64, + "load_cv": 0.5041107542720596, + "normalized_load_entropy": 0.972616601238238, + "max_load_share": 0.047619047619047616 + } + }, + "s0_bos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "09d3a60b8d7c003df8840c1034d1914c09c815572f48ad02c43514d21791607d", + "route_weight_sha256": "ce6d318b39fb0360e3ccf319e0a0403626c0a99b2f31fb96f4b3eb0efc227404", + "loads": [ + 4, + 5, + 18, + 6, + 14, + 4, + 2, + 13, + 9, + 10, + 0, + 4, + 6, + 17, + 44, + 1, + 11, + 1, + 0, + 7, + 10, + 5, + 23, + 11, + 9, + 6, + 13, + 7, + 4, + 16, + 10, + 4, + 24, + 17, + 24, + 0, + 14, + 2, + 0, + 1, + 14, + 0, + 9, + 5, + 13, + 15, + 12, + 12, + 15, + 1, + 0, + 11, + 2, + 5, + 8, + 8, + 11, + 11, + 26, + 32, + 29, + 10, + 6, + 5 + ], + "weighted_loads": [ + 0.28699941188097, + 0.22002526558935642, + 1.6305641531944275, + 0.5041002854704857, + 0.7518262639641762, + 0.17744944989681244, + 0.15616508945822716, + 0.9529927186667919, + 0.4310535080730915, + 0.4422050416469574, + 0.0, + 0.18635361641645432, + 0.5006782822310925, + 1.2218029648065567, + 3.4630591347813606, + 0.0357411727309227, + 1.0452084206044674, + 0.04175717756152153, + 0.0, + 0.31780530512332916, + 0.4641650393605232, + 0.3577819913625717, + 1.708116341382265, + 0.6728749889880419, + 0.531679192557931, + 0.30176530964672565, + 0.9436810072511435, + 0.6536173783242702, + 0.21892181783914566, + 1.2495930660516024, + 0.6235874481499195, + 0.18595163524150848, + 1.1643490884453058, + 1.2639025375247002, + 1.928069081157446, + 0.0, + 0.8243421204388142, + 0.1987389512360096, + 0.0, + 0.030410941690206528, + 0.9941627979278564, + 0.0, + 0.9746658802032471, + 0.5249365195631981, + 0.7604710403829813, + 1.1209786683321, + 0.6991582401096821, + 0.7756349742412567, + 1.1540546659380198, + 0.06794162839651108, + 0.0, + 0.7233836576342583, + 0.0769541822373867, + 0.45145104825496674, + 0.46742277778685093, + 0.5843697339296341, + 0.5615446828305721, + 0.8148158695548773, + 2.5452078320086002, + 3.8811997398734093, + 2.7747649755328894, + 0.689559506252408, + 0.32540978491306305, + 0.39519111812114716 + ], + "unique_experts": 58, + "load_cv": 0.8593828155266332, + "normalized_load_entropy": 0.914029662573577, + "max_load_share": 0.06918238993710692 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "b1987dc0918c14b7cb250aef3caeeda22c5c6c97181f7be2a4026ee9127d45f9", + "route_weight_sha256": "5152145bf582b273f869b3a9d36b9e312730aee9a871e8eb12a2def5114cef4b", + "loads": [ + 4, + 6, + 18, + 6, + 14, + 5, + 4, + 14, + 10, + 10, + 10, + 4, + 9, + 17, + 44, + 14, + 14, + 7, + 10, + 8, + 11, + 5, + 23, + 11, + 9, + 14, + 13, + 7, + 4, + 17, + 10, + 4, + 24, + 17, + 24, + 5, + 14, + 2, + 12, + 9, + 18, + 8, + 19, + 6, + 15, + 15, + 12, + 13, + 15, + 5, + 7, + 11, + 3, + 14, + 10, + 18, + 11, + 11, + 26, + 33, + 29, + 11, + 6, + 7 + ], + "weighted_loads": [ + 0.28699941188097, + 0.22353280195966363, + 1.6305641531944275, + 0.5041002854704857, + 0.7518262639641762, + 0.2137688398361206, + 0.22913124412298203, + 0.9560513298492879, + 0.43440960673615336, + 0.4422050416469574, + 0.5947984904050827, + 0.18635361641645432, + 0.703481025993824, + 1.2218029648065567, + 3.4630591347813606, + 2.061862599104643, + 1.3209374360740185, + 0.3388494476675987, + 0.9389357529580593, + 0.33086874056607485, + 0.4767464203760028, + 0.3577819913625717, + 1.708116341382265, + 0.6728749889880419, + 0.531679192557931, + 1.2009292636066675, + 0.9436810072511435, + 0.6536173783242702, + 0.21892181783914566, + 1.281581187620759, + 0.6235874481499195, + 0.18595163524150848, + 1.1643490884453058, + 1.2639025375247002, + 1.928069081157446, + 0.44420283660292625, + 0.8243421204388142, + 0.1987389512360096, + 1.2645667530596256, + 0.6685140803456306, + 1.16968834400177, + 0.8131344094872475, + 1.8884949460625648, + 0.5698330923914909, + 0.9187457654625177, + 1.1209786683321, + 0.6991582401096821, + 0.7912051910534501, + 1.1540546659380198, + 0.25935244001448154, + 0.6353364773094654, + 0.7233836576342583, + 0.7417305670678616, + 1.0453492924571037, + 0.48239232902415097, + 1.2686380930244923, + 0.5615446828305721, + 0.8148158695548773, + 2.5452078320086002, + 3.926929861307144, + 2.7747649755328894, + 0.7254539337009192, + 0.32540978491306305, + 1.3306772112846375 + ], + "unique_experts": 64, + "load_cv": 0.6168423884394373, + "normalized_load_entropy": 0.9596193377173321, + "max_load_share": 0.05597964376590331 + } + }, + "s1_bos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "92ae5e54b4e00eba3822b8c7fb91e3e8ce7a42ff995a4fe42bca1acbb6e31262", + "route_weight_sha256": "f8fb02ce5ae6b7fd2211234bda95097d0cd00b1b04d9df108b3e43098b5ab697", + "loads": [ + 4, + 4, + 18, + 6, + 13, + 5, + 1, + 13, + 9, + 12, + 0, + 4, + 6, + 18, + 42, + 1, + 13, + 1, + 0, + 8, + 11, + 6, + 24, + 10, + 8, + 6, + 13, + 7, + 4, + 16, + 11, + 5, + 23, + 18, + 23, + 0, + 14, + 2, + 0, + 0, + 14, + 0, + 9, + 5, + 12, + 15, + 13, + 12, + 14, + 1, + 1, + 10, + 2, + 6, + 7, + 8, + 10, + 11, + 25, + 33, + 28, + 9, + 6, + 6 + ], + "weighted_loads": [ + 0.2723713628947735, + 0.17943602427840233, + 1.6327356025576591, + 0.5091480873525143, + 0.7045920714735985, + 0.21587774902582169, + 0.11667592823505402, + 0.9334580339491367, + 0.43524566292762756, + 0.5203309915959835, + 0.0, + 0.18458692729473114, + 0.510307177901268, + 1.2986016049981117, + 3.306475382298231, + 0.038254037499427795, + 1.125069659203291, + 0.04226955026388168, + 0.0, + 0.3521433137357235, + 0.4875191692262888, + 0.40265967324376106, + 1.7045094594359398, + 0.6353721935302019, + 0.49847506918013096, + 0.29758716374635696, + 0.9444682635366917, + 0.6575903818011284, + 0.21566849015653133, + 1.278101846575737, + 0.6861764006316662, + 0.21511086076498032, + 1.12572599388659, + 1.3227451294660568, + 1.8900359347462654, + 0.0, + 0.8323256000876427, + 0.20694146677851677, + 0.0, + 0.0, + 0.9503297246992588, + 0.0, + 0.9757227897644043, + 0.5374079048633575, + 0.744583748281002, + 1.1051589474081993, + 0.7471506856381893, + 0.8072361163794994, + 1.134652715176344, + 0.06030157208442688, + 0.026601171121001244, + 0.6666428446769714, + 0.07692320644855499, + 0.48802625015378, + 0.43603439070284367, + 0.5735924430191517, + 0.5369332022964954, + 0.8099641688168049, + 2.496285943314433, + 3.959498817101121, + 2.720400556921959, + 0.6779414862394333, + 0.3300756737589836, + 0.44039031118154526 + ], + "unique_experts": 58, + "load_cv": 0.8432130614963472, + "normalized_load_entropy": 0.9155773336480183, + "max_load_share": 0.0660377358490566 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "c1af7007cb50fef97e2aed5ece225625c4e1325167ea3ad8f1aa89056f5d5d0c", + "route_weight_sha256": "0a806652c14b80fde89b3e588e053e65e42751b85a72873045be5d9774967cf4", + "loads": [ + 5, + 5, + 18, + 12, + 13, + 7, + 10, + 15, + 10, + 12, + 13, + 7, + 11, + 18, + 43, + 16, + 18, + 12, + 14, + 18, + 12, + 6, + 25, + 10, + 9, + 14, + 13, + 9, + 4, + 18, + 11, + 5, + 24, + 19, + 24, + 5, + 15, + 5, + 13, + 11, + 17, + 13, + 22, + 10, + 14, + 15, + 13, + 14, + 14, + 14, + 11, + 12, + 3, + 16, + 10, + 19, + 10, + 11, + 26, + 34, + 29, + 10, + 6, + 10 + ], + "weighted_loads": [ + 0.30926450714468956, + 0.18300615879707038, + 1.6327356025576591, + 0.9221948832273483, + 0.7045920714735985, + 0.28895140811800957, + 1.125692255795002, + 0.9882662682794034, + 0.4386058459058404, + 0.5203309915959835, + 0.7900383472442627, + 0.5596246346831322, + 0.9554594494402409, + 1.2986016049981117, + 3.3401738852262497, + 2.583036793861538, + 1.5196766033768654, + 0.721190694719553, + 1.3040767721831799, + 1.2049437584355474, + 0.5001005502417684, + 0.40265967324376106, + 1.7424714975059032, + 0.6353721935302019, + 0.5745620001107454, + 1.015956912189722, + 0.9444682635366917, + 0.8303066268563271, + 0.21566849015653133, + 1.3652342110872269, + 0.6861764006316662, + 0.21511086076498032, + 1.2454762775450945, + 1.366122517734766, + 1.9245826080441475, + 0.5740801692008972, + 0.8779351525008678, + 0.3579251356422901, + 1.3889021910727024, + 1.0396398603916168, + 1.07914325222373, + 1.194096889346838, + 2.0936169363558292, + 0.8167814649641514, + 0.8776725828647614, + 1.1051589474081993, + 0.7471506856381893, + 0.8558024140074849, + 1.134652715176344, + 0.8541472163051367, + 1.112227601930499, + 0.7348316423594952, + 0.7416995912790298, + 1.2913140021264553, + 0.488769106566906, + 1.211756220087409, + 0.5369332022964954, + 0.8099641688168049, + 2.566783418878913, + 4.006978141143918, + 2.766297794878483, + 0.7172098383307457, + 0.3300756737589836, + 1.6188471466302872 + ], + "unique_experts": 64, + "load_cv": 0.516524220811125, + "normalized_load_entropy": 0.9710130920480787, + "max_load_share": 0.048752834467120185 + } + }, + "s0_x": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "521ef5ae2845a135818a199bdf950bacb58410aecaa98a758a45af1d4548c799", + "route_weight_sha256": "1d5353123f020e46159dfdbd1900263cd959229ec7d9003765912e405ce7eb27", + "loads": [ + 4, + 5, + 19, + 6, + 12, + 4, + 1, + 14, + 9, + 9, + 0, + 4, + 6, + 17, + 44, + 1, + 12, + 1, + 0, + 7, + 10, + 6, + 23, + 11, + 9, + 6, + 13, + 7, + 4, + 16, + 10, + 5, + 24, + 17, + 25, + 0, + 14, + 2, + 0, + 1, + 14, + 0, + 9, + 5, + 13, + 13, + 14, + 12, + 15, + 1, + 0, + 10, + 2, + 5, + 8, + 8, + 10, + 10, + 26, + 33, + 30, + 9, + 6, + 5 + ], + "weighted_loads": [ + 0.28960999473929405, + 0.21904591470956802, + 1.6572074219584465, + 0.5036738403141499, + 0.6714675202965736, + 0.1761832106858492, + 0.11184820532798767, + 0.9970546327531338, + 0.42270630970597267, + 0.39437147229909897, + 0.0, + 0.18288059532642365, + 0.503829400986433, + 1.2406531870365143, + 3.4302462600171566, + 0.03608600050210953, + 1.0967595130205154, + 0.041888460516929626, + 0.0, + 0.3178752176463604, + 0.4506108779460192, + 0.38909459486603737, + 1.6821111664175987, + 0.6562007311731577, + 0.5480351038277149, + 0.30127573758363724, + 0.9338174350559711, + 0.6506579034030437, + 0.21185784228146076, + 1.2843787055462599, + 0.6242860332131386, + 0.2262522205710411, + 1.1596531085669994, + 1.2693320102989674, + 1.9239522218704224, + 0.0, + 0.8194264099001884, + 0.1970386579632759, + 0.0, + 0.03181346133351326, + 0.9955142308026552, + 0.0, + 0.9360817894339561, + 0.51978699862957, + 0.7662921436131, + 1.0292490646243095, + 0.7624312378466129, + 0.7387987542897463, + 1.1592014469206333, + 0.06197395548224449, + 0.0, + 0.6714247800409794, + 0.07860065996646881, + 0.44798582792282104, + 0.460428424179554, + 0.5827002078294754, + 0.5084603894501925, + 0.7622124962508678, + 2.5461564250290394, + 3.8723686672747135, + 2.7916135042905807, + 0.6517201289534569, + 0.32088828459382057, + 0.3871508240699768 + ], + "unique_experts": 58, + "load_cv": 0.870359359312455, + "normalized_load_entropy": 0.9125119929856927, + "max_load_share": 0.06918238993710692 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "7cb40385e1cf64b2d6c856417430df9d874d884c007250be3075903f695fdeb1", + "route_weight_sha256": "33241d8ffe0eff9f1e74915e135122bda59551e85774cc7d51e5cc53197e6db6", + "loads": [ + 4, + 6, + 19, + 6, + 12, + 5, + 3, + 15, + 10, + 9, + 11, + 4, + 9, + 17, + 44, + 14, + 15, + 7, + 9, + 8, + 11, + 6, + 23, + 11, + 9, + 15, + 13, + 7, + 4, + 16, + 10, + 5, + 24, + 17, + 25, + 5, + 14, + 2, + 10, + 8, + 20, + 8, + 18, + 7, + 15, + 13, + 14, + 13, + 15, + 4, + 7, + 10, + 3, + 16, + 10, + 18, + 10, + 10, + 26, + 34, + 30, + 10, + 6, + 7 + ], + "weighted_loads": [ + 0.28960999473929405, + 0.22255345107987523, + 1.6572074219584465, + 0.5036738403141499, + 0.6714675202965736, + 0.21250260062515736, + 0.1829225718975067, + 1.0001132439356297, + 0.42606240836903453, + 0.39437147229909897, + 0.6823634393513203, + 0.18288059532642365, + 0.7124452106654644, + 1.2406531870365143, + 3.4302462600171566, + 2.2493473552167416, + 1.3520278558135033, + 0.3389807306230068, + 0.8001624047756195, + 0.3309386530891061, + 0.46319225896149874, + 0.38909459486603737, + 1.6821111664175987, + 0.6562007311731577, + 0.5480351038277149, + 1.2855325192213058, + 0.9338174350559711, + 0.6506579034030437, + 0.21185784228146076, + 1.2843787055462599, + 0.6242860332131386, + 0.2262522205710411, + 1.1596531085669994, + 1.2693320102989674, + 1.9239522218704224, + 0.4439144544303417, + 0.8194264099001884, + 0.1970386579632759, + 0.9474252574145794, + 0.6408631578087807, + 1.2860548328608274, + 0.7794261798262596, + 1.688373900949955, + 0.5882744919508696, + 0.9089803509414196, + 1.0292490646243095, + 0.7624312378466129, + 0.7543689711019397, + 1.1592014469206333, + 0.211581664159894, + 0.6363357529044151, + 0.6714247800409794, + 0.7433770447969437, + 1.1554992944002151, + 0.475397975416854, + 1.3446766547858715, + 0.5084603894501925, + 0.7622124962508678, + 2.5461564250290394, + 3.9180987887084484, + 2.7916135042905807, + 0.6882599331438541, + 0.32088828459382057, + 1.322636917233467 + ], + "unique_experts": 64, + "load_cv": 0.6304632892613512, + "normalized_load_entropy": 0.9580356372277505, + "max_load_share": 0.05597964376590331 + } + }, + "s1_x": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "c448a5ab4e9e6f817a975d5b9992e11c331664cd2309aee3c983f358531887ea", + "route_weight_sha256": "af2b1748857ca46f714f5b9006e42434f5569dd668a92d58b9a3e3612117a164", + "loads": [ + 4, + 4, + 19, + 6, + 13, + 6, + 1, + 14, + 9, + 11, + 0, + 5, + 6, + 19, + 41, + 1, + 12, + 1, + 0, + 7, + 11, + 6, + 23, + 11, + 8, + 4, + 12, + 7, + 4, + 15, + 12, + 5, + 23, + 19, + 23, + 1, + 14, + 2, + 0, + 0, + 13, + 0, + 9, + 5, + 14, + 15, + 14, + 12, + 14, + 1, + 1, + 10, + 2, + 6, + 8, + 8, + 10, + 10, + 26, + 32, + 28, + 8, + 6, + 5 + ], + "weighted_loads": [ + 0.2705626040697098, + 0.16444430500268936, + 1.6568969562649727, + 0.5056982412934303, + 0.6975999660789967, + 0.2516584675759077, + 0.11652390658855438, + 0.9586781971156597, + 0.43701258674263954, + 0.4820769391953945, + 0.0, + 0.2139271181076765, + 0.5118849165737629, + 1.3588974364101887, + 3.2182189375162125, + 0.036771804094314575, + 1.1022383011877537, + 0.04229295998811722, + 0.0, + 0.3409423381090164, + 0.4983784519135952, + 0.3985049966722727, + 1.6512815468013287, + 0.6636479310691357, + 0.4977568332105875, + 0.23656393960118294, + 0.9038323797285557, + 0.6455539241433144, + 0.20953549444675446, + 1.2535856328904629, + 0.7081022560596466, + 0.21499639749526978, + 1.1275823153555393, + 1.326598921790719, + 1.85178641974926, + 0.027132607996463776, + 0.8259866386651993, + 0.20501281693577766, + 0.0, + 0.0, + 0.9395398460328579, + 0.0, + 0.9370989762246609, + 0.5325417816638947, + 0.8118966408073902, + 1.091446079313755, + 0.7812010906636715, + 0.7986282873898745, + 1.130721341818571, + 0.05685627833008766, + 0.02627115324139595, + 0.6575233414769173, + 0.07703258469700813, + 0.4903441593050957, + 0.4796519074589014, + 0.5768377259373665, + 0.5199233889579773, + 0.7550073228776455, + 2.5487854443490505, + 3.9258524365723133, + 2.7178446650505066, + 0.6394951641559601, + 0.32808710634708405, + 0.42170400172472 + ], + "unique_experts": 59, + "load_cv": 0.8373759780046351, + "normalized_load_entropy": 0.9168159856942634, + "max_load_share": 0.06446540880503145 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "edcba33bbbb03bb224c504861b43eb830fc968440642368a92232a52f45bb9ef", + "route_weight_sha256": "19a5f7db15009f59f09f39bbc4b5787f554fcecb942aa2a0bd050546934e6e96", + "loads": [ + 5, + 5, + 19, + 12, + 13, + 8, + 10, + 16, + 10, + 11, + 14, + 8, + 11, + 19, + 42, + 16, + 17, + 12, + 13, + 17, + 12, + 6, + 24, + 11, + 9, + 13, + 12, + 9, + 4, + 17, + 12, + 5, + 24, + 21, + 24, + 7, + 15, + 5, + 11, + 11, + 17, + 12, + 21, + 10, + 16, + 15, + 14, + 14, + 14, + 14, + 9, + 12, + 3, + 18, + 11, + 19, + 10, + 10, + 27, + 33, + 29, + 9, + 6, + 9 + ], + "weighted_loads": [ + 0.30745574831962585, + 0.16801443952135742, + 1.6568969562649727, + 0.9187450371682644, + 0.6975999660789967, + 0.3247321266680956, + 1.12599141523242, + 1.0134864314459264, + 0.4403727697208524, + 0.4820769391953945, + 0.8807821795344353, + 0.5889648254960775, + 0.9638131447136402, + 1.3588974364101887, + 3.251917440444231, + 2.7910267733968794, + 1.497281227260828, + 0.7212141044437885, + 1.1330297514796257, + 1.1937427828088403, + 0.5109598329290748, + 0.3985049966722727, + 1.6892435848712921, + 0.6636479310691357, + 0.573843764141202, + 1.0331332609057426, + 0.9038323797285557, + 0.818270169198513, + 0.20953549444675446, + 1.3407179974019527, + 0.7081022560596466, + 0.21499639749526978, + 1.2473325990140438, + 1.4144231285899878, + 1.886333093047142, + 0.6493267752230167, + 0.8715961910784245, + 0.355996485799551, + 1.0556631237268448, + 1.053996205329895, + 1.1424413286149502, + 1.1116073541343212, + 1.9237234890460968, + 0.8081716038286686, + 0.9346510358154774, + 1.091446079313755, + 0.7812010906636715, + 0.8471945850178599, + 1.130721341818571, + 0.8446190897375345, + 1.0004497319459915, + 0.725712139159441, + 0.741808969527483, + 1.4031410366296768, + 0.5323866233229637, + 1.2844394613057375, + 0.5199233889579773, + 0.7550073228776455, + 2.6192829199135303, + 3.9733317606151104, + 2.7637419030070305, + 0.6788381040096283, + 0.32808710634708405, + 1.600160837173462 + ], + "unique_experts": 64, + "load_cv": 0.5097907118576094, + "normalized_load_entropy": 0.9716560845390239, + "max_load_share": 0.047619047619047616 + } + }, + "s0_period": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "eba0b61c7378a0f8960a657d91a13f60dca73ce799a8be42e4c8263713c7d578", + "route_weight_sha256": "afcf163a865dacd8c3c184ab382cfb483ea26a75c5465e0e3fec030bda4cb7ad", + "loads": [ + 4, + 5, + 19, + 6, + 12, + 4, + 2, + 14, + 9, + 9, + 0, + 4, + 6, + 17, + 44, + 1, + 12, + 1, + 0, + 7, + 10, + 5, + 23, + 11, + 9, + 6, + 12, + 7, + 4, + 16, + 10, + 5, + 24, + 18, + 25, + 0, + 12, + 2, + 0, + 1, + 14, + 0, + 9, + 5, + 13, + 14, + 13, + 11, + 15, + 1, + 1, + 10, + 2, + 5, + 8, + 8, + 11, + 11, + 26, + 33, + 29, + 10, + 6, + 5 + ], + "weighted_loads": [ + 0.2911284491419792, + 0.2136759962886572, + 1.6573541648685932, + 0.5049134492874146, + 0.6677041538059711, + 0.17350596748292446, + 0.1501302272081375, + 1.0021866969764233, + 0.4208994582295418, + 0.3939860723912716, + 0.0, + 0.17975200712680817, + 0.5025958605110645, + 1.2434532307088375, + 3.421797003597021, + 0.03515452519059181, + 1.1031105890870094, + 0.04245282709598541, + 0.0, + 0.3145093098282814, + 0.4482201747596264, + 0.36077026277780533, + 1.6835118494927883, + 0.6567829363048077, + 0.5379807204008102, + 0.29658592119812965, + 0.895279549062252, + 0.6421254687011242, + 0.2102744784206152, + 1.270906463265419, + 0.626553550362587, + 0.2255145013332367, + 1.1533816866576672, + 1.307883258908987, + 1.926602877676487, + 0.0, + 0.7403202336281538, + 0.19570130109786987, + 0.0, + 0.03167843818664551, + 0.9771712254732847, + 0.0, + 0.9585147313773632, + 0.5147436149418354, + 0.7658663541078568, + 1.066864874213934, + 0.7321038544178009, + 0.7111231852322817, + 1.149877218529582, + 0.055151116102933884, + 0.02533409371972084, + 0.6773535422980785, + 0.0779927596449852, + 0.4543108120560646, + 0.45628406666219234, + 0.5660599619150162, + 0.5442394148558378, + 0.8019027337431908, + 2.5394110586494207, + 3.8672256022691727, + 2.7491778805851936, + 0.6835048981010914, + 0.3199523836374283, + 0.39294588565826416 + ], + "unique_experts": 59, + "load_cv": 0.8639733231351976, + "normalized_load_entropy": 0.9147735547250929, + "max_load_share": 0.06918238993710692 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "3a6f9b74d1cd3ab27ad6212fd4106618f1b643740dfde2113605195a097808a2", + "route_weight_sha256": "571fab35eeba41b6ca8af55c21b2dabb0de1192ac856ccbb680932c4de3da4ce", + "loads": [ + 4, + 6, + 19, + 6, + 12, + 5, + 4, + 15, + 10, + 9, + 11, + 4, + 9, + 17, + 44, + 14, + 16, + 8, + 9, + 8, + 11, + 5, + 23, + 11, + 9, + 14, + 12, + 7, + 4, + 17, + 10, + 5, + 24, + 18, + 25, + 6, + 12, + 2, + 10, + 8, + 19, + 8, + 18, + 6, + 16, + 14, + 13, + 12, + 15, + 4, + 8, + 10, + 3, + 14, + 10, + 18, + 11, + 11, + 26, + 34, + 29, + 11, + 6, + 7 + ], + "weighted_loads": [ + 0.2911284491419792, + 0.2171835326589644, + 1.6573541648685932, + 0.5049134492874146, + 0.6677041538059711, + 0.20982535742223263, + 0.22231224551796913, + 1.0052453081589192, + 0.42425555689260364, + 0.3939860723912716, + 0.6823554486036301, + 0.17975200712680817, + 0.7108417004346848, + 1.2434532307088375, + 3.421797003597021, + 2.081454373896122, + 1.4047366976737976, + 0.3967764750123024, + 0.7431162446737289, + 0.3275727452710271, + 0.46080155577510595, + 0.36077026277780533, + 1.6835118494927883, + 0.6567829363048077, + 0.5379807204008102, + 1.1957498751580715, + 0.895279549062252, + 0.6421254687011242, + 0.2102744784206152, + 1.2983839511871338, + 0.626553550362587, + 0.2255145013332367, + 1.1533816866576672, + 1.307883258908987, + 1.926602877676487, + 0.49155354872345924, + 0.7403202336281538, + 0.19570130109786987, + 0.9144930392503738, + 0.6344478093087673, + 1.2099221479147673, + 0.811584122478962, + 1.7214358821511269, + 0.5549290664494038, + 0.9675811938941479, + 1.066864874213934, + 0.7321038544178009, + 0.7266934020444751, + 1.149877218529582, + 0.20270770229399204, + 0.673789482563734, + 0.6773535422980785, + 0.74276914447546, + 1.0482090562582016, + 0.4712536178994924, + 1.4598106667399406, + 0.5442394148558378, + 0.8019027337431908, + 2.5394110586494207, + 3.9129557237029076, + 2.7491778805851936, + 0.7203886695206165, + 0.3199523836374283, + 1.3284319788217545 + ], + "unique_experts": 64, + "load_cv": 0.6245199646988511, + "normalized_load_entropy": 0.9589581592713964, + "max_load_share": 0.05597964376590331 + } + }, + "s1_period": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "3a16cfbd9b61f6235941b36ea74e0fe827f2c36ea04addd2279025b16ca5bf87", + "route_weight_sha256": "9940e42df9d24776ad769802014a2b266c3d8065e574e81220ee99026e88c9a7", + "loads": [ + 4, + 4, + 19, + 6, + 13, + 7, + 1, + 14, + 9, + 12, + 0, + 5, + 6, + 18, + 41, + 1, + 12, + 1, + 0, + 7, + 11, + 6, + 23, + 10, + 8, + 5, + 12, + 7, + 4, + 15, + 12, + 5, + 23, + 18, + 23, + 0, + 15, + 2, + 0, + 0, + 13, + 0, + 9, + 5, + 14, + 15, + 14, + 11, + 15, + 1, + 1, + 10, + 2, + 6, + 7, + 8, + 10, + 10, + 26, + 33, + 28, + 8, + 6, + 5 + ], + "weighted_loads": [ + 0.2738468013703823, + 0.16690963134169579, + 1.6513909790664911, + 0.5112374313175678, + 0.6973665878176689, + 0.28019013069570065, + 0.11460141092538834, + 0.9673934206366539, + 0.43200764060020447, + 0.519241951406002, + 0.0, + 0.2133330162614584, + 0.513216532766819, + 1.3121608085930347, + 3.219789005815983, + 0.036083757877349854, + 1.110483881086111, + 0.04226798191666603, + 0.0, + 0.3361010327935219, + 0.49435911513864994, + 0.3987145200371742, + 1.6561531461775303, + 0.6292204111814499, + 0.501107020303607, + 0.2663535140454769, + 0.9007492512464523, + 0.6392649300396442, + 0.20910786651074886, + 1.2471573259681463, + 0.7235634066164494, + 0.21420235373079777, + 1.1114836893975735, + 1.3087545074522495, + 1.856117706745863, + 0.0, + 0.8615227788686752, + 0.2045011818408966, + 0.0, + 0.0, + 0.9084270428866148, + 0.0, + 0.9510293640196323, + 0.5320027023553848, + 0.8146764971315861, + 1.0897832177579403, + 0.7805402297526598, + 0.7663612924516201, + 1.1545982658863068, + 0.05420715734362602, + 0.02595900557935238, + 0.658225204795599, + 0.07552536204457283, + 0.4926677383482456, + 0.43432730063796043, + 0.5659472793340683, + 0.5247951801866293, + 0.75280986353755, + 2.5463509932160378, + 3.9175856560468674, + 2.733426922932267, + 0.6455886028707027, + 0.32885288819670677, + 0.4178813472390175 + ], + "unique_experts": 58, + "load_cv": 0.8405819784986105, + "normalized_load_entropy": 0.915681235156182, + "max_load_share": 0.06446540880503145 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "f0ba2978082ac5def8bd6c08090a4d0e61f79d1f7df88997820e47e61441f796", + "route_weight_sha256": "9713e024da3b2014dd32c7185b2d3fe94dc14975932541a2b083b02e78e0f9b8", + "loads": [ + 5, + 5, + 19, + 12, + 13, + 9, + 10, + 16, + 10, + 12, + 14, + 8, + 11, + 18, + 42, + 17, + 17, + 13, + 13, + 17, + 12, + 6, + 24, + 10, + 9, + 13, + 12, + 9, + 4, + 17, + 12, + 5, + 24, + 19, + 24, + 6, + 16, + 5, + 11, + 11, + 17, + 13, + 21, + 10, + 17, + 15, + 14, + 13, + 15, + 14, + 9, + 12, + 3, + 16, + 10, + 19, + 10, + 10, + 27, + 34, + 29, + 9, + 6, + 9 + ], + "weighted_loads": [ + 0.3107399456202984, + 0.17047976586036384, + 1.6513909790664911, + 0.9242842271924019, + 0.6973665878176689, + 0.3532637897878885, + 1.1236328780651093, + 1.0222016549669206, + 0.4353678235784173, + 0.519241951406002, + 0.8936670906841755, + 0.5883707236498594, + 0.9646544009447098, + 1.3121608085930347, + 3.2534875087440014, + 2.6560107157565653, + 1.528101559728384, + 0.7630832381546497, + 1.0898001044988632, + 1.1889014774933457, + 0.5069404961541295, + 0.3987145200371742, + 1.6941151842474937, + 0.6292204111814499, + 0.5771939512342215, + 0.984723262488842, + 0.9007492512464523, + 0.8119811750948429, + 0.20910786651074886, + 1.3342896904796362, + 0.7235634066164494, + 0.21420235373079777, + 1.231233973056078, + 1.3521318957209587, + 1.890664380043745, + 0.6508699506521225, + 0.9071323312819004, + 0.35548485070466995, + 1.016826804727316, + 1.0445926785469055, + 1.090026030316949, + 1.2221363186836243, + 1.9529891051352024, + 0.8068786859512329, + 0.9871384389698505, + 1.0897832177579403, + 0.7805402297526598, + 0.8149275900796056, + 1.1545982658863068, + 0.8381983134895563, + 0.9975737649947405, + 0.7264140024781227, + 0.7403017468750477, + 1.295955490320921, + 0.48706201650202274, + 1.3676566649228334, + 0.5247951801866293, + 0.75280986353755, + 2.6168484687805176, + 3.9650649800896645, + 2.779324160888791, + 0.6857624836266041, + 0.32885288819670677, + 1.5963381826877594 + ], + "unique_experts": 64, + "load_cv": 0.5110801246927482, + "normalized_load_entropy": 0.9715426309081285, + "max_load_share": 0.047619047619047616 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 106, + "ordered_topk_exact_tokens": 87, + "set_exact_tokens": 94, + "mean_set_jaccard": 0.965633423180593, + "mean_token_weighted_tv": 0.008173429969487325, + "aggregate_load_tv": 0.017295597484276733 + }, + "system_bos": { + "tokens": 106, + "ordered_topk_exact_tokens": 71, + "set_exact_tokens": 82, + "mean_set_jaccard": 0.9353099730458221, + "mean_token_weighted_tv": 0.015211167991301924, + "aggregate_load_tv": 0.028301886792452824 + }, + "system_x": { + "tokens": 106, + "ordered_topk_exact_tokens": 64, + "set_exact_tokens": 77, + "mean_set_jaccard": 0.9218328840970351, + "mean_token_weighted_tv": 0.018547516939985863, + "aggregate_load_tv": 0.029874213836477988 + }, + "system_period": { + "tokens": 106, + "ordered_topk_exact_tokens": 64, + "set_exact_tokens": 77, + "mean_set_jaccard": 0.9218328840970351, + "mean_token_weighted_tv": 0.018187031193794508, + "aggregate_load_tv": 0.03144654088050314 + }, + "bos_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 70, + "set_exact_tokens": 81, + "mean_set_jaccard": 0.9285714285714287, + "mean_token_weighted_tv": 0.018541945153320173, + "aggregate_load_tv": 0.02987421383647798 + }, + "bos_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 57, + "set_exact_tokens": 73, + "mean_set_jaccard": 0.9110512129380055, + "mean_token_weighted_tv": 0.02200140270738388, + "aggregate_load_tv": 0.03459119496855346 + }, + "x_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 68, + "set_exact_tokens": 78, + "mean_set_jaccard": 0.9204851752021564, + "mean_token_weighted_tv": 0.0199337673180227, + "aggregate_load_tv": 0.03773584905660377 + }, + "x_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 54, + "set_exact_tokens": 69, + "mean_set_jaccard": 0.8942048517520215, + "mean_token_weighted_tv": 0.025355663001185882, + "aggregate_load_tv": 0.040880503144654086 + }, + "period_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 69, + "set_exact_tokens": 78, + "mean_set_jaccard": 0.9225067385444746, + "mean_token_weighted_tv": 0.019123776165663072, + "aggregate_load_tv": 0.033018867924528295 + }, + "period_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 58, + "set_exact_tokens": 71, + "mean_set_jaccard": 0.9036388140161725, + "mean_token_weighted_tv": 0.023873280285734613, + "aggregate_load_tv": 0.03773584905660377 + } + } + }, + "layer_06": { + "layer": 6, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "d312f244aef5956c418ef47cb7eb3a086ca22c3513f7f09000c4fd18155ad758", + "route_weight_sha256": "7c3435ba420a996e885650ceac8de5aacb6ba5eeae5de1b7a478b3954a2effae", + "loads": [ + 7, + 2, + 2, + 19, + 10, + 5, + 7, + 16, + 23, + 6, + 14, + 5, + 6, + 9, + 14, + 8, + 5, + 2, + 7, + 4, + 18, + 17, + 5, + 5, + 5, + 20, + 6, + 14, + 40, + 8, + 17, + 9, + 0, + 1, + 1, + 0, + 25, + 1, + 24, + 7, + 21, + 13, + 2, + 2, + 25, + 6, + 0, + 3, + 7, + 22, + 3, + 17, + 5, + 0, + 18, + 1, + 2, + 8, + 5, + 6, + 8, + 39, + 14, + 15 + ], + "weighted_loads": [ + 0.3071697875857353, + 0.06784368678927422, + 0.13162225484848022, + 1.3445884808897972, + 0.4629886541515589, + 0.34635409712791443, + 0.34386630915105343, + 1.1315651386976242, + 2.408040829002857, + 0.41282129660248756, + 1.3459609113633633, + 0.31206217035651207, + 0.7164726704359055, + 0.7972980514168739, + 0.7603673078119755, + 0.39977334626019, + 0.4146498925983906, + 0.08519201911985874, + 0.5982144400477409, + 0.2404152788221836, + 1.0551602877676487, + 1.2507864125072956, + 0.19507474452257156, + 0.19762170314788818, + 0.1897541806101799, + 1.2556553576141596, + 0.23130776174366474, + 1.041527047753334, + 3.247094079852104, + 0.39358463883399963, + 0.8913376368582249, + 0.5750906951725483, + 0.0, + 0.028205515816807747, + 0.0833287164568901, + 0.0, + 2.3945555705577135, + 0.04184648394584656, + 1.891489204019308, + 0.30080750212073326, + 1.4069373030215502, + 0.9265116695314646, + 0.07146695256233215, + 0.13882547244429588, + 1.8154393397271633, + 0.18698743917047977, + 0.0, + 0.1770142875611782, + 0.49519651010632515, + 2.37932813167572, + 0.17114900052547455, + 1.287222232669592, + 0.32870373874902725, + 0.0, + 1.5023333691060543, + 0.03699066862463951, + 0.10414430126547813, + 0.6009477954357862, + 0.19303329847753048, + 0.28118614852428436, + 0.4186785575002432, + 3.2194770127534866, + 0.6039900220930576, + 1.0899751782417297 + ], + "unique_experts": 60, + "load_cv": 0.889064398637493, + "normalized_load_entropy": 0.9101799228678294, + "max_load_share": 0.06289308176100629 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "a881e7f396e90e19fb0b071ae5df8bb77e5afd58d18d0f5efdb493727563ac9b", + "route_weight_sha256": "6cec17a5ef6d3a51844addd5271511870559ed9f37fa1063fb7a485351f8b174", + "loads": [ + 7, + 4, + 2, + 19, + 11, + 5, + 16, + 16, + 23, + 6, + 14, + 11, + 6, + 11, + 16, + 9, + 10, + 3, + 7, + 13, + 19, + 21, + 7, + 6, + 5, + 21, + 6, + 14, + 40, + 11, + 17, + 9, + 5, + 1, + 2, + 5, + 25, + 8, + 24, + 16, + 21, + 19, + 4, + 2, + 25, + 11, + 12, + 5, + 11, + 22, + 9, + 24, + 5, + 0, + 18, + 11, + 12, + 8, + 5, + 15, + 8, + 39, + 14, + 15 + ], + "weighted_loads": [ + 0.3071697875857353, + 0.10750133357942104, + 0.13162225484848022, + 1.3445884808897972, + 0.49176791682839394, + 0.34635409712791443, + 1.3268975410610437, + 1.1315651386976242, + 2.408040829002857, + 0.41282129660248756, + 1.3459609113633633, + 0.7294659800827503, + 0.7164726704359055, + 0.8253445941954851, + 0.8949576877057552, + 0.4356148559600115, + 0.7997126504778862, + 0.08923931233584881, + 0.5982144400477409, + 0.8220425583422184, + 1.0990978218615055, + 1.5020581427961588, + 1.68899817019701, + 0.23330182954669, + 0.1897541806101799, + 1.2833882197737694, + 0.23130776174366474, + 1.041527047753334, + 3.247094079852104, + 0.5572588630020618, + 0.8913376368582249, + 0.5750906951725483, + 0.17470654100179672, + 0.028205515816807747, + 0.1179552711546421, + 0.4531530328094959, + 2.3945555705577135, + 0.6480760127305984, + 1.891489204019308, + 0.6622715890407562, + 1.4069373030215502, + 1.4125333037227392, + 0.12936127930879593, + 0.13882547244429588, + 1.8154393397271633, + 0.32134975772351027, + 1.3017774485051632, + 0.19937790767289698, + 0.7016692738980055, + 2.37932813167572, + 0.6967690140008926, + 1.5948810800909996, + 0.32870373874902725, + 0.0, + 1.5023333691060543, + 0.7996482029557228, + 1.2718817666172981, + 0.6009477954357862, + 0.19303329847753048, + 1.2501131556928158, + 0.4186785575002432, + 3.2194770127534866, + 0.6039900220930576, + 1.0899751782417297 + ], + "unique_experts": 63, + "load_cv": 0.669201520842609, + "normalized_load_entropy": 0.9477882791175685, + "max_load_share": 0.05089058524173028 + } + }, + "s1_eos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "c5a4af76e0743851f3d1fec41c6f256886015719dbc8aaf52f162b31ed0049c1", + "route_weight_sha256": "0331ac87852e3a618366f33c52ee1a1e3f34f654e44f4b610d964e6034a54fb2", + "loads": [ + 7, + 2, + 2, + 19, + 11, + 5, + 7, + 15, + 23, + 6, + 14, + 5, + 6, + 9, + 14, + 8, + 5, + 2, + 7, + 4, + 18, + 17, + 7, + 4, + 5, + 20, + 6, + 15, + 40, + 7, + 17, + 9, + 0, + 1, + 1, + 0, + 24, + 1, + 23, + 6, + 20, + 13, + 2, + 2, + 25, + 5, + 0, + 5, + 7, + 22, + 3, + 16, + 5, + 0, + 17, + 1, + 2, + 8, + 7, + 6, + 8, + 40, + 15, + 15 + ], + "weighted_loads": [ + 0.30063183046877384, + 0.06886604055762291, + 0.12951336055994034, + 1.3636667169630527, + 0.49183399975299835, + 0.3401011247187853, + 0.3510566111654043, + 1.0983436852693558, + 2.384106617420912, + 0.4074960723519325, + 1.3288297839462757, + 0.3134022504091263, + 0.7167456448078156, + 0.7940850742161274, + 0.757407408207655, + 0.3974882196635008, + 0.41995835304260254, + 0.08391257002949715, + 0.5997213087975979, + 0.237983338534832, + 1.069889210164547, + 1.240111991763115, + 0.2776549234986305, + 0.1669748518615961, + 0.19471034593880177, + 1.221265435218811, + 0.23062215000391006, + 1.0618271492421627, + 3.223397273570299, + 0.3446815125644207, + 0.9118099734187126, + 0.5817090086638927, + 0.0, + 0.02851802110671997, + 0.08218980580568314, + 0.0, + 2.3546845987439156, + 0.04211655259132385, + 1.8412668108940125, + 0.2588118128478527, + 1.362906102091074, + 0.9213712587952614, + 0.07120567932724953, + 0.1402808129787445, + 1.8322645910084248, + 0.1576666347682476, + 0.0, + 0.2622273713350296, + 0.4999426454305649, + 2.3663324303925037, + 0.17049193382263184, + 1.2767874673008919, + 0.3185344710946083, + 0.0, + 1.4736099652945995, + 0.037213731557130814, + 0.10712093487381935, + 0.5986851342022419, + 0.2567753531038761, + 0.29182499647140503, + 0.4174389913678169, + 3.251227777451277, + 0.6390848997980356, + 1.085508055984974 + ], + "unique_experts": 60, + "load_cv": 0.8835302860603158, + "normalized_load_entropy": 0.9115399201761747, + "max_load_share": 0.06289308176100629 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "b437ff4fa790e05b206680e164393900f1c3149fdd023a34cf131ca46928ef94", + "route_weight_sha256": "d736ef715e1bdd6c3ba8fa38ec73f3644011599af3a826afc4edf64c5759c9c2", + "loads": [ + 7, + 4, + 5, + 20, + 13, + 5, + 21, + 16, + 28, + 12, + 14, + 15, + 10, + 11, + 23, + 10, + 15, + 3, + 9, + 15, + 20, + 22, + 9, + 5, + 6, + 21, + 6, + 16, + 41, + 10, + 17, + 12, + 7, + 2, + 5, + 7, + 25, + 16, + 23, + 15, + 20, + 19, + 4, + 2, + 26, + 9, + 16, + 7, + 10, + 22, + 11, + 22, + 6, + 3, + 17, + 12, + 19, + 8, + 7, + 18, + 13, + 40, + 15, + 15 + ], + "weighted_loads": [ + 0.30063183046877384, + 0.10849128663539886, + 0.2708248719573021, + 1.401042364537716, + 0.6429674103856087, + 0.3401011247187853, + 1.7012226916849613, + 1.1600135043263435, + 2.726183544844389, + 1.1150626093149185, + 1.3288297839462757, + 0.9924247898161411, + 1.047210682183504, + 0.8224118920043111, + 1.430873952805996, + 0.5448066871613264, + 1.2346994131803513, + 0.08799710124731064, + 0.7478381842374802, + 1.018173921853304, + 1.1626358889043331, + 1.5603526253253222, + 1.769626833498478, + 0.20233765430748463, + 0.227445462718606, + 1.2566518038511276, + 0.23062215000391006, + 1.0886018592864275, + 3.260178990662098, + 0.5312478095293045, + 0.9118099734187126, + 0.7788127511739731, + 0.24381256476044655, + 0.06211774796247482, + 0.341581579297781, + 0.6703130267560482, + 2.389031011611223, + 1.2123986892402172, + 1.8412668108940125, + 0.736721932888031, + 1.362906102091074, + 1.421156384050846, + 0.12915625423192978, + 0.1402808129787445, + 1.917019035667181, + 0.25656531867571175, + 1.6188007201999426, + 0.28461913648061454, + 0.6687656156718731, + 2.3663324303925037, + 0.8139457739889622, + 1.5157772675156593, + 0.3555344007909298, + 0.1675299070775509, + 1.4736099652945995, + 1.049981128424406, + 1.89202169328928, + 0.5986851342022419, + 0.2567753531038761, + 1.391948876902461, + 0.6786106452345848, + 3.251227777451277, + 0.6390848997980356, + 1.085508055984974 + ], + "unique_experts": 64, + "load_cv": 0.5897043277813561, + "normalized_load_entropy": 0.9594564497964009, + "max_load_share": 0.046485260770975055 + } + }, + "s0_bos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "9b14d4a85dbebedce06ad97ca6b834d527607941125413f9044c36106368047b", + "route_weight_sha256": "eef3b823dd74b8b14b5dbd96e21b4a38d6cd8f074d640164a3d0c59722f0629e", + "loads": [ + 7, + 3, + 2, + 18, + 9, + 4, + 6, + 15, + 22, + 6, + 14, + 5, + 6, + 7, + 13, + 8, + 5, + 1, + 7, + 4, + 18, + 19, + 7, + 4, + 5, + 20, + 5, + 16, + 40, + 7, + 18, + 9, + 0, + 0, + 3, + 0, + 24, + 1, + 24, + 6, + 19, + 12, + 2, + 2, + 24, + 6, + 0, + 5, + 8, + 24, + 3, + 17, + 6, + 0, + 17, + 1, + 2, + 8, + 7, + 6, + 8, + 42, + 15, + 14 + ], + "weighted_loads": [ + 0.3043613266199827, + 0.09828509390354156, + 0.13294041901826859, + 1.3399278223514557, + 0.42684391140937805, + 0.31323377415537834, + 0.32653884403407574, + 1.107758890837431, + 2.324183613061905, + 0.4190693125128746, + 1.4085845462977886, + 0.32245679572224617, + 0.7151332348585129, + 0.7470290809869766, + 0.7212327755987644, + 0.3898205328732729, + 0.4107371084392071, + 0.05895473062992096, + 0.6078956872224808, + 0.24082544445991516, + 1.0643982663750648, + 1.3370909746736288, + 0.2640463709831238, + 0.16359319165349007, + 0.18726828880608082, + 1.229577036574483, + 0.1918695978820324, + 1.1542197577655315, + 3.205473303794861, + 0.3578449562191963, + 0.9393647201359272, + 0.5709956884384155, + 0.0, + 0.0, + 0.14396903105080128, + 0.0, + 2.3832289464771748, + 0.0477713942527771, + 1.9191543143242598, + 0.2514582294970751, + 1.3494067713618279, + 0.9176216684281826, + 0.0758351981639862, + 0.13611196354031563, + 1.8528747111558914, + 0.19487666338682175, + 0.0, + 0.2636315952986479, + 0.5359612181782722, + 2.4636821411550045, + 0.1725662536919117, + 1.2645039223134518, + 0.3636898957192898, + 0.0, + 1.4812888018786907, + 0.03431219980120659, + 0.09680192917585373, + 0.605901962146163, + 0.2628474738448858, + 0.2812344431877136, + 0.4188144989311695, + 3.464435512199998, + 0.6447085663676262, + 1.059813391417265 + ], + "unique_experts": 59, + "load_cv": 0.8980947093914455, + "normalized_load_entropy": 0.9094808557517545, + "max_load_share": 0.0660377358490566 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "0c509d84c512e04349074a037daf8f7ce918a05773e756a7033c0306dd73b001", + "route_weight_sha256": "c8e6156446d72e386a765d636c41450fe4a6773703c4e8581ab4195a3ef43946", + "loads": [ + 7, + 4, + 2, + 18, + 10, + 4, + 15, + 15, + 22, + 6, + 14, + 11, + 6, + 8, + 16, + 10, + 11, + 1, + 7, + 13, + 19, + 23, + 8, + 5, + 5, + 21, + 5, + 16, + 40, + 11, + 18, + 9, + 4, + 0, + 4, + 5, + 24, + 9, + 24, + 15, + 19, + 18, + 4, + 2, + 24, + 10, + 13, + 6, + 12, + 24, + 10, + 24, + 6, + 0, + 17, + 11, + 12, + 8, + 7, + 15, + 8, + 42, + 15, + 14 + ], + "weighted_loads": [ + 0.3043613266199827, + 0.13319546729326248, + 0.13294041901826859, + 1.3399278223514557, + 0.4556231740862131, + 0.31323377415537834, + 1.3263382036238909, + 1.107758890837431, + 2.324183613061905, + 0.4190693125128746, + 1.4085845462977886, + 0.7550490349531174, + 0.7151332348585129, + 0.7701297458261251, + 0.9046255946159363, + 0.4773463997989893, + 0.8361816257238388, + 0.05895473062992096, + 0.6078956872224808, + 0.8137293271720409, + 1.1083358004689217, + 1.5894059054553509, + 0.810261607170105, + 0.19927331805229187, + 0.18726828880608082, + 1.2573098987340927, + 0.1918695978820324, + 1.1542197577655315, + 3.205473303794861, + 0.5709140859544277, + 0.9393647201359272, + 0.5709956884384155, + 0.13838420063257217, + 0.0, + 0.17859558574855328, + 0.4566383846104145, + 2.3832289464771748, + 0.7227206379175186, + 1.9191543143242598, + 0.6086010504513979, + 1.3494067713618279, + 1.4005168825387955, + 0.13372952491044998, + 0.13611196354031563, + 1.8528747111558914, + 0.3251990657299757, + 1.5290389098227024, + 0.2827364895492792, + 0.7446406800299883, + 2.4636821411550045, + 0.7660990357398987, + 1.5721627697348595, + 0.3636898957192898, + 0.0, + 1.4812888018786907, + 0.7969697341322899, + 1.3166692554950714, + 0.605901962146163, + 0.2628474738448858, + 1.250161450356245, + 0.4188144989311695, + 3.464435512199998, + 0.6447085663676262, + 1.059813391417265 + ], + "unique_experts": 62, + "load_cv": 0.6801036928015736, + "normalized_load_entropy": 0.9458381580305029, + "max_load_share": 0.05343511450381679 + } + }, + "s1_bos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "60011c360f828760a94e53999b25fc730000b05055d63d722cf6d2ef8f20bf47", + "route_weight_sha256": "65a4ddb2074591521dd6018b92b1272e29b32bb81bfdaf7ab190934d9d6755eb", + "loads": [ + 7, + 3, + 2, + 19, + 11, + 6, + 7, + 16, + 22, + 6, + 14, + 5, + 6, + 7, + 13, + 9, + 5, + 1, + 7, + 4, + 18, + 17, + 6, + 5, + 6, + 20, + 7, + 14, + 38, + 7, + 19, + 9, + 0, + 0, + 2, + 0, + 23, + 1, + 22, + 5, + 20, + 11, + 2, + 2, + 24, + 6, + 0, + 5, + 8, + 21, + 3, + 18, + 5, + 0, + 18, + 1, + 2, + 9, + 6, + 6, + 6, + 43, + 17, + 14 + ], + "weighted_loads": [ + 0.2923469506204128, + 0.09864060394465923, + 0.12566913291811943, + 1.4189933575689793, + 0.5114049017429352, + 0.3664386812597513, + 0.3629935458302498, + 1.1324086114764214, + 2.3060640953481197, + 0.4123132210224867, + 1.3634449429810047, + 0.31653741002082825, + 0.7004546374082565, + 0.738445833325386, + 0.7378025688230991, + 0.43148113787174225, + 0.4212102070450783, + 0.062084805220365524, + 0.6008766628801823, + 0.23501430079340935, + 1.0858620777726173, + 1.2501785680651665, + 0.2402779646217823, + 0.19874035194516182, + 0.23323237337172031, + 1.190163318067789, + 0.2524646706879139, + 1.0224366784095764, + 3.0682774502784014, + 0.3704349473118782, + 1.0118897836655378, + 0.5695366486907005, + 0.0, + 0.0, + 0.11838768422603607, + 0.0, + 2.3133245669305325, + 0.049266647547483444, + 1.856918215751648, + 0.22173995152115822, + 1.3698976021260023, + 0.8945362251251936, + 0.07687260210514069, + 0.13969701156020164, + 1.8325353525578976, + 0.19658225774765015, + 0.0, + 0.2626241371035576, + 0.5333563759922981, + 2.3359834291040897, + 0.17542283609509468, + 1.3169947043061256, + 0.3229624554514885, + 0.0, + 1.547408301383257, + 0.03501420095562935, + 0.09484478458762169, + 0.6301467251032591, + 0.22364869713783264, + 0.28239959850907326, + 0.33488910645246506, + 3.4769766833633184, + 0.7176405340433121, + 1.0366056822240353 + ], + "unique_experts": 59, + "load_cv": 0.8846041066250222, + "normalized_load_entropy": 0.9111335424996113, + "max_load_share": 0.06761006289308176 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "c41aa4c3b89419c24b0e1c27a7fdab36f72c29de9adb33512dd49e88ae10f627", + "route_weight_sha256": "be1e569541384af039548e5fe62d057d3095f03cff2502362d3193a7777cbac7", + "loads": [ + 7, + 4, + 5, + 20, + 13, + 6, + 22, + 17, + 27, + 12, + 14, + 15, + 10, + 8, + 22, + 12, + 16, + 1, + 9, + 15, + 20, + 22, + 7, + 6, + 7, + 21, + 7, + 15, + 39, + 10, + 19, + 12, + 7, + 1, + 6, + 7, + 24, + 16, + 22, + 14, + 20, + 17, + 4, + 2, + 25, + 9, + 17, + 7, + 11, + 21, + 12, + 24, + 6, + 3, + 18, + 12, + 19, + 9, + 6, + 18, + 11, + 43, + 17, + 14 + ], + "weighted_loads": [ + 0.2923469506204128, + 0.13350786454975605, + 0.2669806443154812, + 1.4563690051436424, + 0.6625383123755455, + 0.3664386812597513, + 1.7720167804509401, + 1.1940784305334091, + 2.648141022771597, + 1.1198797579854727, + 1.3634449429810047, + 1.0094906464219093, + 1.030919674783945, + 0.7615464981645346, + 1.4172781743109226, + 0.641682606190443, + 1.2771816477179527, + 0.062084805220365524, + 0.7489935383200645, + 1.014296293258667, + 1.1786087565124035, + 1.5708902273327112, + 0.7864932008087635, + 0.23410315439105034, + 0.26596749015152454, + 1.2255496867001057, + 0.2524646706879139, + 1.0492113884538412, + 3.1050591673702, + 0.5585234612226486, + 1.0118897836655378, + 0.7666403912007809, + 0.24091879278421402, + 0.03359972685575485, + 0.3777794577181339, + 0.6786021329462528, + 2.34767097979784, + 1.2771566212177277, + 1.856918215751648, + 0.6996500715613365, + 1.3698976021260023, + 1.3963752519339323, + 0.13482317700982094, + 0.13969701156020164, + 1.9172897972166538, + 0.29170222766697407, + 1.8000326585024595, + 0.3383314460515976, + 0.709616407752037, + 2.3359834291040897, + 0.8991959802806377, + 1.555984504520893, + 0.35996238514781, + 0.1675299070775509, + 1.547408301383257, + 1.0477815978229046, + 1.9591775201261044, + 0.6301467251032591, + 0.22364869713783264, + 1.3825234789401293, + 0.5960607603192329, + 3.4769766833633184, + 0.7176405340433121, + 1.0366056822240353 + ], + "unique_experts": 64, + "load_cv": 0.5929043983544934, + "normalized_load_entropy": 0.9583885109911207, + "max_load_share": 0.048752834467120185 + } + }, + "s0_x": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "21f3db42898c44cb4d29802dbd70dc059d3cfb3ee213aa28385c267cf1b050f7", + "route_weight_sha256": "d4dbe8d6fd29475e0a69658643305e8fb3d3ac846d0dfa602a0d142c03aaf90b", + "loads": [ + 7, + 2, + 2, + 19, + 8, + 5, + 7, + 17, + 22, + 6, + 14, + 5, + 6, + 7, + 14, + 8, + 5, + 1, + 7, + 4, + 18, + 18, + 7, + 4, + 5, + 20, + 5, + 15, + 39, + 8, + 17, + 9, + 0, + 0, + 2, + 0, + 24, + 1, + 23, + 5, + 19, + 13, + 2, + 2, + 25, + 6, + 0, + 5, + 7, + 24, + 3, + 16, + 7, + 0, + 17, + 1, + 2, + 8, + 7, + 6, + 8, + 43, + 15, + 14 + ], + "weighted_loads": [ + 0.3015555068850517, + 0.06721125915646553, + 0.12732788920402527, + 1.357424758374691, + 0.3934864290058613, + 0.3381571304053068, + 0.3655206002295017, + 1.1529814712703228, + 2.326108366250992, + 0.4134873077273369, + 1.4035720713436604, + 0.314245767891407, + 0.703861877322197, + 0.7330030612647533, + 0.8036770150065422, + 0.4021935500204563, + 0.4168533869087696, + 0.05715130642056465, + 0.5977863892912865, + 0.23919270560145378, + 1.0692734494805336, + 1.2738577723503113, + 0.28550177067518234, + 0.17017896845936775, + 0.18758254684507847, + 1.2327769100666046, + 0.1928212083876133, + 1.0545493923127651, + 3.099494831636548, + 0.39486441388726234, + 0.914456445723772, + 0.5701671950519085, + 0.0, + 0.0, + 0.1151320468634367, + 0.0, + 2.4051999524235725, + 0.045403432101011276, + 1.854442484676838, + 0.2044808380305767, + 1.3535062558948994, + 0.9400210827589035, + 0.07525216788053513, + 0.1376742608845234, + 1.8420629184693098, + 0.19421559385955334, + 0.0, + 0.25384748727083206, + 0.4888065904378891, + 2.468854308128357, + 0.17833329737186432, + 1.2214438803493977, + 0.40309763699769974, + 0.0, + 1.4692290164530277, + 0.03437314182519913, + 0.09762167930603027, + 0.6022088993340731, + 0.26734907180070877, + 0.27924542129039764, + 0.41265360452234745, + 3.4678005650639534, + 0.6501494012773037, + 1.0419858023524284 + ], + "unique_experts": 59, + "load_cv": 0.9000305450384971, + "normalized_load_entropy": 0.9087389251601621, + "max_load_share": 0.06761006289308176 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "94f6e398a8c8d062f5023941a2b03f2c7349cf5d5889cf8a594836221d22845d", + "route_weight_sha256": "d8631f2f9a631ae38d1c317b52804bd226d97e96fff1eef0fcbcff46fa51ada6", + "loads": [ + 7, + 3, + 2, + 19, + 9, + 5, + 18, + 17, + 22, + 6, + 14, + 10, + 6, + 8, + 17, + 10, + 10, + 1, + 7, + 14, + 19, + 22, + 8, + 5, + 5, + 21, + 5, + 15, + 39, + 11, + 17, + 9, + 4, + 0, + 3, + 5, + 24, + 9, + 23, + 13, + 19, + 21, + 4, + 2, + 25, + 10, + 12, + 6, + 11, + 24, + 8, + 24, + 7, + 0, + 17, + 12, + 11, + 8, + 7, + 16, + 8, + 43, + 15, + 14 + ], + "weighted_loads": [ + 0.3015555068850517, + 0.10212163254618645, + 0.12732788920402527, + 1.357424758374691, + 0.42226569168269634, + 0.3381571304053068, + 1.6485511139035225, + 1.1529814712703228, + 2.326108366250992, + 0.4134873077273369, + 1.4035720713436604, + 0.679142314940691, + 0.703861877322197, + 0.7561037261039019, + 0.9851437769830227, + 0.49394748359918594, + 0.8023114055395126, + 0.05715130642056465, + 0.5977863892912865, + 0.8741810172796249, + 1.1132109835743904, + 1.5137018244713545, + 0.8317170068621635, + 0.20585909485816956, + 0.18758254684507847, + 1.2605097722262144, + 0.1928212083876133, + 1.0545493923127651, + 3.099494831636548, + 0.5600855201482773, + 0.914456445723772, + 0.5701671950519085, + 0.13072335720062256, + 0.0, + 0.1497586015611887, + 0.4838039241731167, + 2.4051999524235725, + 0.672576516866684, + 1.854442484676838, + 0.5192086659371853, + 1.3535062558948994, + 1.546210154891014, + 0.1331464946269989, + 0.1376742608845234, + 1.8420629184693098, + 0.3245379962027073, + 1.262658428400755, + 0.2729523815214634, + 0.6985818985849619, + 2.468854308128357, + 0.6433210074901581, + 1.5642555989325047, + 0.40309763699769974, + 0.0, + 1.4692290164530277, + 0.8531853444874287, + 1.2096203155815601, + 0.6022088993340731, + 0.26734907180070877, + 1.3238748796284199, + 0.41265360452234745, + 3.4678005650639534, + 0.6501494012773037, + 1.0419858023524284 + ], + "unique_experts": 62, + "load_cv": 0.6885808365232933, + "normalized_load_entropy": 0.9444285339532309, + "max_load_share": 0.054707379134860054 + } + }, + "s1_x": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "24e33b29371f87561b04653053f1242db4d50456d9bf41de16549d0b2a5e62fe", + "route_weight_sha256": "80b63d036597617ec568107909ac92013ba466d28802b85a7b3842700ca6abff", + "loads": [ + 5, + 3, + 2, + 19, + 12, + 5, + 7, + 15, + 22, + 5, + 14, + 5, + 6, + 8, + 13, + 8, + 6, + 1, + 7, + 5, + 18, + 18, + 8, + 4, + 6, + 20, + 6, + 14, + 37, + 7, + 18, + 9, + 0, + 0, + 2, + 0, + 23, + 1, + 22, + 5, + 21, + 12, + 2, + 2, + 24, + 6, + 0, + 5, + 8, + 22, + 4, + 18, + 5, + 0, + 17, + 1, + 2, + 8, + 8, + 5, + 6, + 44, + 16, + 14 + ], + "weighted_loads": [ + 0.239910539239645, + 0.09875248372554779, + 0.12712648883461952, + 1.4102871380746365, + 0.5478042121976614, + 0.3331333100795746, + 0.37400222942233086, + 1.0854660794138908, + 2.315674651414156, + 0.3747635968029499, + 1.355189710855484, + 0.3140994422137737, + 0.6914905235171318, + 0.7608713656663895, + 0.7588175125420094, + 0.41195862367749214, + 0.4592213910073042, + 0.05848543345928192, + 0.6002428084611893, + 0.25980966351926327, + 1.0964466445147991, + 1.2553435359150171, + 0.3262804076075554, + 0.1689992155879736, + 0.23491634242236614, + 1.183912556618452, + 0.2147678453475237, + 0.9837189577519894, + 2.950501035898924, + 0.3735812194645405, + 0.9842658340930939, + 0.5671512633562088, + 0.0, + 0.0, + 0.12086629122495651, + 0.0, + 2.313042588531971, + 0.04836905002593994, + 1.8509886711835861, + 0.2041739858686924, + 1.394147850573063, + 0.9098378103226423, + 0.07929732650518417, + 0.14156504720449448, + 1.813614521175623, + 0.19677443616092205, + 0.0, + 0.25975168868899345, + 0.5406373329460621, + 2.344934705644846, + 0.23076217994093895, + 1.3172472678124905, + 0.32867755368351936, + 0.0, + 1.4994170926511288, + 0.03595660254359245, + 0.08726364374160767, + 0.6048146691173315, + 0.291162446141243, + 0.2374180555343628, + 0.33378713950514793, + 3.483270427212119, + 0.6827002353966236, + 1.0090324319899082 + ], + "unique_experts": 59, + "load_cv": 0.886926257803086, + "normalized_load_entropy": 0.9109210694054742, + "max_load_share": 0.06918238993710692 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "224a4ab15d84249cd39a98ecc9d67d95c1ab8a3635abbeec4a6890b6db829aa1", + "route_weight_sha256": "4efbac872f764bf12078052450a35be86e3d83a0c57e1d5c012162ff3bc552ed", + "loads": [ + 5, + 4, + 5, + 20, + 14, + 5, + 25, + 16, + 27, + 11, + 14, + 14, + 10, + 9, + 22, + 11, + 15, + 1, + 9, + 18, + 20, + 23, + 9, + 5, + 7, + 21, + 6, + 15, + 38, + 10, + 18, + 12, + 6, + 1, + 6, + 7, + 24, + 15, + 22, + 14, + 21, + 20, + 4, + 2, + 25, + 9, + 15, + 6, + 11, + 22, + 12, + 25, + 6, + 3, + 17, + 13, + 18, + 8, + 8, + 18, + 11, + 44, + 16, + 14 + ], + "weighted_loads": [ + 0.239910539239645, + 0.1336197443306446, + 0.2684380002319813, + 1.4476627856492996, + 0.6989376228302717, + 0.3331333100795746, + 2.153501333668828, + 1.1471358984708786, + 2.657751578837633, + 1.082330133765936, + 1.355189710855484, + 0.9451335668563843, + 1.0219555608928204, + 0.783972030505538, + 1.4424421228468418, + 0.645831510424614, + 1.2331269662827253, + 0.05848543345928192, + 0.7483596839010715, + 1.119794713333249, + 1.1891933232545853, + 1.5574574954807758, + 0.8724956437945366, + 0.20436201803386211, + 0.26765145920217037, + 1.2192989252507687, + 0.2147678453475237, + 1.0104936677962542, + 2.9872827529907227, + 0.5595755912363529, + 0.9842658340930939, + 0.7642550058662891, + 0.19772161915898323, + 0.03359972685575485, + 0.38025806471705437, + 0.6723995693027973, + 2.3473890013992786, + 1.137393843382597, + 1.8509886711835861, + 0.6820841059088707, + 1.394147850573063, + 1.5379876289516687, + 0.13724790140986443, + 0.14156504720449448, + 1.8983689658343792, + 0.29189440608024597, + 1.52777118422091, + 0.2788565829396248, + 0.7168595343828201, + 2.344934705644846, + 0.862171083688736, + 1.5852747540920973, + 0.36567748337984085, + 0.1675299070775509, + 1.4994170926511288, + 1.1188517026603222, + 1.799528330564499, + 0.6048146691173315, + 0.291162446141243, + 1.40888393484056, + 0.5949587933719158, + 3.483270427212119, + 0.6827002353966236, + 1.0090324319899082 + ], + "unique_experts": 64, + "load_cv": 0.6059430440306658, + "normalized_load_entropy": 0.9565255630071497, + "max_load_share": 0.049886621315192746 + } + }, + "s0_period": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "85943ea706d19a38ba78530efe03940b317e6d4872024078733310682cc75ae3", + "route_weight_sha256": "cd97cf8351545163300372731978bd20421cf1c1c6b2aff9246843577e421968", + "loads": [ + 7, + 2, + 2, + 19, + 11, + 6, + 6, + 15, + 22, + 5, + 14, + 5, + 6, + 7, + 14, + 8, + 5, + 1, + 7, + 5, + 18, + 18, + 8, + 4, + 5, + 20, + 5, + 16, + 38, + 7, + 18, + 8, + 0, + 0, + 2, + 0, + 24, + 1, + 24, + 5, + 20, + 12, + 2, + 2, + 25, + 5, + 0, + 5, + 7, + 24, + 4, + 16, + 6, + 0, + 17, + 1, + 2, + 8, + 7, + 6, + 8, + 41, + 16, + 14 + ], + "weighted_loads": [ + 0.30272514559328556, + 0.06669413298368454, + 0.12755151838064194, + 1.3634857311844826, + 0.5035997498780489, + 0.3730974681675434, + 0.3146800026297569, + 1.1003600023686886, + 2.336196668446064, + 0.3798207975924015, + 1.4096051380038261, + 0.3186621181666851, + 0.6961358264088631, + 0.7301564365625381, + 0.8044990971684456, + 0.3963982071727514, + 0.4154408611357212, + 0.058750372380018234, + 0.5967121757566929, + 0.27751249447464943, + 1.0632935613393784, + 1.2858605794608593, + 0.32863036170601845, + 0.16414988413453102, + 0.18767470493912697, + 1.2298730071634054, + 0.19484632089734077, + 1.0665833689272404, + 3.04012780636549, + 0.3450038284063339, + 0.9435570035129786, + 0.5193688869476318, + 0.0, + 0.0, + 0.11494994163513184, + 0.0, + 2.394999247044325, + 0.04671395942568779, + 1.873147727921605, + 0.20631799660623074, + 1.3814546447247267, + 0.9183937236666679, + 0.07668398320674896, + 0.1347511261701584, + 1.8499352168291807, + 0.16406967863440514, + 0.0, + 0.25637715123593807, + 0.4912978932261467, + 2.4604264441877604, + 0.23151317983865738, + 1.2139948420226574, + 0.36444197595119476, + 0.0, + 1.4469758160412312, + 0.0342213474214077, + 0.10495217144489288, + 0.5968738589435816, + 0.2660204041749239, + 0.2782492358237505, + 0.4174165241420269, + 3.375587133690715, + 0.6747235078364611, + 1.038936287164688 + ], + "unique_experts": 59, + "load_cv": 0.888352256827189, + "normalized_load_entropy": 0.9098036706058912, + "max_load_share": 0.06446540880503145 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "5b664214c30af201bd3b814d1a9372f5e5b173793c5e4db2b43cb43119cbfbf4", + "route_weight_sha256": "8f3b6ae56fcd68f87072296a13c3406dab670a0f55141bed045eb1ceb278ce65", + "loads": [ + 7, + 3, + 2, + 19, + 12, + 6, + 17, + 15, + 22, + 5, + 14, + 10, + 7, + 8, + 16, + 10, + 10, + 1, + 7, + 16, + 19, + 22, + 9, + 5, + 5, + 21, + 5, + 16, + 39, + 10, + 18, + 8, + 4, + 0, + 3, + 5, + 24, + 9, + 24, + 13, + 20, + 19, + 4, + 2, + 25, + 9, + 12, + 6, + 11, + 24, + 9, + 24, + 6, + 0, + 17, + 12, + 11, + 8, + 7, + 15, + 8, + 41, + 16, + 14 + ], + "weighted_loads": [ + 0.30272514559328556, + 0.10160450637340546, + 0.12755151838064194, + 1.3634857311844826, + 0.532379012554884, + 0.3730974681675434, + 1.4785578474402428, + 1.1003600023686886, + 2.336196668446064, + 0.3798207975924015, + 1.4096051380038261, + 0.6814443022012711, + 0.7495071664452553, + 0.7532571014016867, + 0.9433604143559933, + 0.4825885687023401, + 0.7887792624533176, + 0.058750372380018234, + 0.5967121757566929, + 1.0050611682236195, + 1.1072310954332352, + 1.5271924007683992, + 0.8748455978929996, + 0.19983001053333282, + 0.18767470493912697, + 1.2576058693230152, + 0.19484632089734077, + 1.0665833689272404, + 3.146093226969242, + 0.5123604908585548, + 0.9435570035129786, + 0.5193688869476318, + 0.13393693044781685, + 0.0, + 0.14957649633288383, + 0.48296083137393, + 2.394999247044325, + 0.7554023750126362, + 1.873147727921605, + 0.5210458245128393, + 1.3814546447247267, + 1.4421099573373795, + 0.13457830995321274, + 0.1347511261701584, + 1.8499352168291807, + 0.2943920809775591, + 1.2738210894167423, + 0.2754820454865694, + 0.6969832237809896, + 2.4604264441877604, + 0.6889587342739105, + 1.5558941438794136, + 0.36444197595119476, + 0.0, + 1.4469758160412312, + 0.9446259215474129, + 1.2139290757477283, + 0.5968738589435816, + 0.2660204041749239, + 1.247176242992282, + 0.4174165241420269, + 3.375587133690715, + 0.6747235078364611, + 1.038936287164688 + ], + "unique_experts": 62, + "load_cv": 0.6788840312571357, + "normalized_load_entropy": 0.9453306246042388, + "max_load_share": 0.05216284987277354 + } + }, + "s1_period": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "aa524bfcc26e037e504013e63544012a825f89450e3cc829de570c4810561c97", + "route_weight_sha256": "c812554e4ddc69ac49883563702a70de690771145579e7ca7d7b0389d1b858e9", + "loads": [ + 5, + 3, + 2, + 19, + 11, + 6, + 7, + 16, + 22, + 5, + 14, + 5, + 6, + 8, + 14, + 8, + 6, + 1, + 7, + 5, + 18, + 18, + 6, + 4, + 6, + 20, + 7, + 14, + 37, + 7, + 17, + 9, + 0, + 0, + 2, + 0, + 23, + 1, + 22, + 6, + 22, + 12, + 2, + 2, + 24, + 6, + 0, + 5, + 8, + 22, + 4, + 18, + 5, + 0, + 17, + 1, + 2, + 8, + 7, + 5, + 6, + 43, + 16, + 14 + ], + "weighted_loads": [ + 0.23820943385362625, + 0.09897627495229244, + 0.12576942890882492, + 1.4055111072957516, + 0.5054514054208994, + 0.3596405293792486, + 0.3747374378144741, + 1.1157933324575424, + 2.3116016015410423, + 0.3819558322429657, + 1.362218752503395, + 0.3196041025221348, + 0.6838085353374481, + 0.7458944618701935, + 0.8145438618957996, + 0.40601409040391445, + 0.4584790822118521, + 0.058571431785821915, + 0.594478577375412, + 0.25693429447710514, + 1.0867888368666172, + 1.2689693477004766, + 0.23587678000330925, + 0.16417676769196987, + 0.2363250069320202, + 1.1875278241932392, + 0.25123184733092785, + 0.9512695372104645, + 2.960835302248597, + 0.3698877952992916, + 0.9422826617956161, + 0.5631829090416431, + 0.0, + 0.0, + 0.12033859640359879, + 0.0, + 2.2925099954009056, + 0.04963851720094681, + 1.839654602110386, + 0.2556150145828724, + 1.4412308242172003, + 0.911027304828167, + 0.07744092866778374, + 0.13830778375267982, + 1.8163679651916027, + 0.19445181638002396, + 0.0, + 0.25965485721826553, + 0.536868579685688, + 2.3404974080622196, + 0.23334261402487755, + 1.305390102788806, + 0.32494350522756577, + 0.0, + 1.4912683740258217, + 0.03659285977482796, + 0.09313440695405006, + 0.6016644388437271, + 0.25383743084967136, + 0.2390713095664978, + 0.33272386714816093, + 3.4465615451335907, + 0.6783625297248363, + 1.0051136836409569 + ], + "unique_experts": 59, + "load_cv": 0.8822758435631801, + "normalized_load_entropy": 0.9114077647296626, + "max_load_share": 0.06761006289308176 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "06514455868e900d480921b412932c7d41d6fc98884f8f7550717e33989ba02d", + "route_weight_sha256": "0242ac8f9bdfb7f199b2f7d3aea59dfcfbdf8add48eb644c3ae16c9a4974ce6b", + "loads": [ + 5, + 4, + 5, + 20, + 13, + 6, + 25, + 17, + 27, + 11, + 14, + 14, + 11, + 9, + 23, + 11, + 15, + 1, + 9, + 17, + 20, + 23, + 7, + 5, + 7, + 21, + 7, + 15, + 39, + 10, + 17, + 12, + 6, + 1, + 6, + 7, + 24, + 17, + 22, + 15, + 22, + 18, + 4, + 2, + 25, + 9, + 16, + 6, + 11, + 22, + 11, + 25, + 6, + 3, + 17, + 13, + 18, + 8, + 7, + 17, + 11, + 43, + 16, + 14 + ], + "weighted_loads": [ + 0.23820943385362625, + 0.13384353555738926, + 0.2670809403061867, + 1.4428867548704147, + 0.6565848160535097, + 0.3596405293792486, + 2.008109299466014, + 1.1774631515145302, + 2.6536785289645195, + 1.0895223692059517, + 1.362218752503395, + 0.9475617483258247, + 1.0787434466183186, + 0.768995126709342, + 1.4984492249786854, + 0.6219664569944143, + 1.224676227197051, + 0.058571431785821915, + 0.7425954528152943, + 1.172743147239089, + 1.1795355156064034, + 1.576554998755455, + 0.7820920161902905, + 0.1995395701378584, + 0.2690601237118244, + 1.2229141928255558, + 0.25123184733092785, + 0.9780442472547293, + 3.1219567339867353, + 0.5565129816532135, + 0.9422826617956161, + 0.7602866515517235, + 0.1984143666923046, + 0.03359972685575485, + 0.37973036989569664, + 0.6840631030499935, + 2.3268564082682133, + 1.3195445910096169, + 1.839654602110386, + 0.7335251346230507, + 1.4412308242172003, + 1.405359573662281, + 0.135391503572464, + 0.13830778375267982, + 1.901122409850359, + 0.2895717862993479, + 1.5771638806909323, + 0.27875975146889687, + 0.6818229295313358, + 2.3404974080622196, + 0.7960816770792007, + 1.5776850413531065, + 0.36194343492388725, + 0.1675299070775509, + 1.4912683740258217, + 1.1816222928464413, + 1.796544460579753, + 0.6016644388437271, + 0.25383743084967136, + 1.3391951899975538, + 0.5938955210149288, + 3.4465615451335907, + 0.6783625297248363, + 1.0051136836409569 + ], + "unique_experts": 64, + "load_cv": 0.606078801068069, + "normalized_load_entropy": 0.9565092846555124, + "max_load_share": 0.048752834467120185 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 106, + "ordered_topk_exact_tokens": 86, + "set_exact_tokens": 95, + "mean_set_jaccard": 0.9703504043126685, + "mean_token_weighted_tv": 0.007546725691700319, + "aggregate_load_tv": 0.015723270440251576 + }, + "system_bos": { + "tokens": 106, + "ordered_topk_exact_tokens": 66, + "set_exact_tokens": 78, + "mean_set_jaccard": 0.9245283018867925, + "mean_token_weighted_tv": 0.016045382518743007, + "aggregate_load_tv": 0.03144654088050314 + }, + "system_x": { + "tokens": 106, + "ordered_topk_exact_tokens": 65, + "set_exact_tokens": 78, + "mean_set_jaccard": 0.9245283018867926, + "mean_token_weighted_tv": 0.01765654616514748, + "aggregate_load_tv": 0.033018867924528295 + }, + "system_period": { + "tokens": 106, + "ordered_topk_exact_tokens": 63, + "set_exact_tokens": 78, + "mean_set_jaccard": 0.9245283018867926, + "mean_token_weighted_tv": 0.01748794012369131, + "aggregate_load_tv": 0.02830188679245283 + }, + "bos_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 61, + "set_exact_tokens": 78, + "mean_set_jaccard": 0.9245283018867925, + "mean_token_weighted_tv": 0.01830910802555253, + "aggregate_load_tv": 0.034591194968553465 + }, + "bos_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 63, + "set_exact_tokens": 76, + "mean_set_jaccard": 0.9171159029649596, + "mean_token_weighted_tv": 0.01995797978081512, + "aggregate_load_tv": 0.033018867924528295 + }, + "x_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 66, + "set_exact_tokens": 83, + "mean_set_jaccard": 0.9359838274932615, + "mean_token_weighted_tv": 0.016686421186434774, + "aggregate_load_tv": 0.029874213836477984 + }, + "x_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 60, + "set_exact_tokens": 76, + "mean_set_jaccard": 0.9191374663072776, + "mean_token_weighted_tv": 0.021323781126653247, + "aggregate_load_tv": 0.0330188679245283 + }, + "period_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 63, + "set_exact_tokens": 77, + "mean_set_jaccard": 0.9198113207547169, + "mean_token_weighted_tv": 0.0186883063354301, + "aggregate_load_tv": 0.036163522012578615 + }, + "period_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 61, + "set_exact_tokens": 75, + "mean_set_jaccard": 0.9164420485175202, + "mean_token_weighted_tv": 0.02154396405830136, + "aggregate_load_tv": 0.03144654088050314 + } + } + }, + "layer_07": { + "layer": 7, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "69705102ba639f29c3fe7eff9ac867572af8ef9eafda90a37cd9fe25b52509fc", + "route_weight_sha256": "1a8645162aebb98308ce026d1e9cf99ec8ddc31901e1c86c6f5177953d1a0acd", + "loads": [ + 23, + 9, + 69, + 2, + 6, + 15, + 4, + 22, + 1, + 12, + 4, + 6, + 4, + 4, + 36, + 8, + 2, + 9, + 9, + 4, + 2, + 7, + 19, + 15, + 14, + 4, + 3, + 8, + 3, + 4, + 8, + 15, + 1, + 10, + 8, + 15, + 15, + 1, + 4, + 11, + 2, + 0, + 6, + 3, + 2, + 11, + 10, + 1, + 20, + 12, + 0, + 18, + 25, + 28, + 2, + 0, + 0, + 9, + 9, + 15, + 22, + 12, + 5, + 8 + ], + "weighted_loads": [ + 1.8535610847175121, + 0.34453812055289745, + 6.036229087039828, + 0.07380510121583939, + 0.546269740909338, + 0.7957295253872871, + 0.19588299468159676, + 1.594452627003193, + 0.06145324930548668, + 0.7146905325353146, + 0.22441130504012108, + 0.3900969922542572, + 0.18871379643678665, + 0.167274110019207, + 3.126688841730356, + 0.40468533523380756, + 0.09455788135528564, + 0.4805769957602024, + 1.0554575324058533, + 0.1899428442120552, + 0.08473372459411621, + 0.5825379155576229, + 1.3805391155183315, + 1.1376485731452703, + 0.7389171086251736, + 0.17915331944823265, + 0.1494566984474659, + 0.44258179888129234, + 0.1663036346435547, + 0.26853470876812935, + 0.5727222822606564, + 0.6724364403635263, + 0.05815122649073601, + 0.5516311768442392, + 0.5572447739541531, + 0.7438970357179642, + 1.2010863274335861, + 0.08553936332464218, + 0.28742048144340515, + 0.6294325664639473, + 0.10076576098799706, + 0.0, + 0.5361979976296425, + 0.13321038708090782, + 0.07078081928193569, + 0.6042075157165527, + 0.9979924038052559, + 0.021614713594317436, + 1.458985272794962, + 0.8286561891436577, + 0.0, + 1.0969735570251942, + 2.540048733353615, + 1.786967147141695, + 0.14864696562290192, + 0.0, + 0.0, + 0.5958241950720549, + 0.7381397038698196, + 0.9492623377591372, + 1.8996583856642246, + 0.6407947223633528, + 0.23879636265337467, + 0.614953875541687 + ], + "unique_experts": 60, + "load_cv": 1.070125370326139, + "normalized_load_entropy": 0.8949138917663118, + "max_load_share": 0.10849056603773585 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "b4605dbc232dafaeebe0ade071ed38b7b2d1da13a02f9eef9e117f6face03671", + "route_weight_sha256": "045fa43498b6c19fe97c3a3ca76db887403037ecab2892a1449878bf5af2d74b", + "loads": [ + 23, + 9, + 69, + 5, + 6, + 16, + 9, + 22, + 8, + 12, + 5, + 10, + 4, + 9, + 36, + 8, + 17, + 11, + 12, + 5, + 2, + 7, + 22, + 18, + 18, + 4, + 7, + 8, + 6, + 4, + 8, + 15, + 4, + 12, + 8, + 15, + 15, + 1, + 13, + 14, + 2, + 10, + 11, + 6, + 6, + 11, + 12, + 2, + 20, + 12, + 15, + 18, + 25, + 29, + 2, + 7, + 0, + 10, + 13, + 15, + 22, + 18, + 8, + 15 + ], + "weighted_loads": [ + 1.8535610847175121, + 0.34453812055289745, + 6.036229087039828, + 0.18368643522262573, + 0.546269740909338, + 0.8375449702143669, + 0.6885252557694912, + 1.594452627003193, + 0.6601374857127666, + 0.7146905325353146, + 0.25710612162947655, + 0.9453179873526096, + 0.18871379643678665, + 0.4531626719981432, + 3.126688841730356, + 0.40468533523380756, + 2.102487776428461, + 0.5958682261407375, + 1.1651893462985754, + 0.2483627162873745, + 0.08473372459411621, + 0.5825379155576229, + 1.5543268322944641, + 1.3361663352698088, + 0.869565146509558, + 0.17915331944823265, + 0.48189787194132805, + 0.44258179888129234, + 0.229388321749866, + 0.26853470876812935, + 0.5727222822606564, + 0.6724364403635263, + 0.17174774780869484, + 0.6875372212380171, + 0.5572447739541531, + 0.7438970357179642, + 1.2010863274335861, + 0.08553936332464218, + 1.1209963411092758, + 0.7590654902160168, + 0.10076576098799706, + 0.9969595968723297, + 0.9065600745379925, + 0.20168525073677301, + 1.5892629865556955, + 0.6042075157165527, + 1.145627398043871, + 0.10963986627757549, + 1.458985272794962, + 0.8286561891436577, + 1.0417979061603546, + 1.0969735570251942, + 2.540048733353615, + 1.81903026252985, + 0.14864696562290192, + 0.6539452150464058, + 0.0, + 0.6296481359750032, + 0.8236444406211376, + 0.9492623377591372, + 1.8996583856642246, + 0.939094765111804, + 0.28750704508274794, + 0.8863599710166454 + ], + "unique_experts": 63, + "load_cv": 0.816341935789904, + "normalized_load_entropy": 0.9375490627963158, + "max_load_share": 0.08778625954198473 + } + }, + "s1_eos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "f1d0e6e2366714050dd248aa85f994fe03cd3d4a4d9885a0b89713a7d0c75ab6", + "route_weight_sha256": "5e7f42cca09a6602ce763213311ed54cf7f2f1f2b293b423015e10fc7997408e", + "loads": [ + 23, + 9, + 69, + 1, + 6, + 15, + 4, + 21, + 1, + 10, + 4, + 6, + 5, + 3, + 36, + 8, + 2, + 8, + 10, + 4, + 2, + 7, + 19, + 15, + 13, + 4, + 3, + 9, + 3, + 4, + 8, + 15, + 1, + 10, + 8, + 16, + 15, + 1, + 4, + 11, + 3, + 0, + 6, + 4, + 3, + 11, + 10, + 1, + 20, + 12, + 0, + 18, + 26, + 28, + 2, + 0, + 0, + 9, + 9, + 15, + 23, + 11, + 5, + 7 + ], + "weighted_loads": [ + 1.8415513448417187, + 0.3452346455305815, + 6.095405897125602, + 0.04414232447743416, + 0.5581786893308163, + 0.7863078378140926, + 0.19986241683363914, + 1.5407087355852127, + 0.06086632236838341, + 0.6358005777001381, + 0.2241358645260334, + 0.3923102244734764, + 0.21618407033383846, + 0.13466686755418777, + 3.0967074185609818, + 0.4084115270525217, + 0.0971701629459858, + 0.44973092526197433, + 1.067088820040226, + 0.20265531539916992, + 0.08086640760302544, + 0.5783841218799353, + 1.3802014999091625, + 1.1549638956785202, + 0.6979616358876228, + 0.17408905550837517, + 0.15314537286758423, + 0.48172420263290405, + 0.15580488368868828, + 0.2662040889263153, + 0.5605514645576477, + 0.6529271230101585, + 0.05659748241305351, + 0.5502814650535583, + 0.5512428693473339, + 0.7772557027637959, + 1.175959300249815, + 0.08561824262142181, + 0.2734049819409847, + 0.6281776092946529, + 0.13581345230340958, + 0.0, + 0.5379394516348839, + 0.18899184465408325, + 0.10512358509004116, + 0.6048111915588379, + 0.9956212267279625, + 0.021626895293593407, + 1.4544330090284348, + 0.8267226703464985, + 0.0, + 1.090758666396141, + 2.558629998937249, + 1.7807000987231731, + 0.1457621529698372, + 0.0, + 0.0, + 0.6078377738595009, + 0.7403612527996302, + 0.958632942289114, + 1.9153308346867561, + 0.6012226641178131, + 0.25278889387845993, + 0.5818304680287838 + ], + "unique_experts": 60, + "load_cv": 1.0708643817538308, + "normalized_load_entropy": 0.8951563444200169, + "max_load_share": 0.10849056603773585 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "adff17b2ea4da47bf6c7417a9fb5f3e81090db1efbc43c4306aff2ae46fa1856", + "route_weight_sha256": "f0fe9224011afe05ba8204dc6433c36044449b713be3f911261142b5485f341e", + "loads": [ + 23, + 9, + 69, + 3, + 7, + 16, + 11, + 21, + 16, + 12, + 10, + 11, + 5, + 9, + 38, + 10, + 18, + 11, + 13, + 5, + 2, + 7, + 21, + 19, + 18, + 4, + 11, + 10, + 6, + 10, + 8, + 15, + 7, + 19, + 8, + 16, + 15, + 5, + 20, + 14, + 5, + 15, + 16, + 8, + 13, + 11, + 13, + 6, + 20, + 12, + 22, + 18, + 26, + 28, + 6, + 9, + 0, + 16, + 12, + 15, + 23, + 17, + 9, + 10 + ], + "weighted_loads": [ + 1.8415513448417187, + 0.3452346455305815, + 6.095405897125602, + 0.10772784613072872, + 0.6048130691051483, + 0.8305982202291489, + 0.6896567698568106, + 1.5407087355852127, + 1.380922868847847, + 0.7372541576623917, + 0.7435794398188591, + 1.0246792696416378, + 0.21618407033383846, + 0.47031109780073166, + 3.166428327560425, + 0.5049166809767485, + 2.533697735518217, + 0.6153412871062756, + 1.180051477625966, + 0.26138922199606895, + 0.08086640760302544, + 0.5783841218799353, + 1.4973689019680023, + 1.395471215248108, + 0.852908234577626, + 0.17408905550837517, + 0.8387588039040565, + 0.5122217908501625, + 0.21933672577142715, + 1.0443060621619225, + 0.5605514645576477, + 0.6529271230101585, + 0.44206877052783966, + 1.1670513786375523, + 0.5512428693473339, + 0.7772557027637959, + 1.175959300249815, + 0.3128590490669012, + 1.9508241042494774, + 0.7750993520021439, + 0.3591918423771858, + 1.4613973647356033, + 1.3489707186818123, + 0.29766363371163607, + 2.176892975345254, + 0.6048111915588379, + 1.189511053264141, + 0.3096187859773636, + 1.4544330090284348, + 0.8267226703464985, + 1.4978695698082447, + 1.090758666396141, + 2.558629998937249, + 1.7807000987231731, + 0.35253021866083145, + 0.7644002232700586, + 0.0, + 1.183084174990654, + 0.7975771240890026, + 0.958632942289114, + 1.9153308346867561, + 0.8927764855325222, + 0.33715100260451436, + 0.6702603977173567 + ], + "unique_experts": 63, + "load_cv": 0.704741329951204, + "normalized_load_entropy": 0.9528419104226822, + "max_load_share": 0.0782312925170068 + } + }, + "s0_bos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "c41180c144be250d03c7ecc81ebcda27ca11b60adaf77222c0a109d281469d10", + "route_weight_sha256": "b96c997f8f9af7eb5eeddc5a5cadb4883e1c48f84312f55f22972706f39be839", + "loads": [ + 23, + 6, + 70, + 2, + 6, + 13, + 4, + 19, + 1, + 10, + 3, + 6, + 4, + 5, + 35, + 8, + 2, + 8, + 9, + 4, + 1, + 6, + 20, + 17, + 16, + 4, + 3, + 10, + 3, + 4, + 8, + 16, + 1, + 11, + 8, + 14, + 14, + 1, + 4, + 11, + 4, + 0, + 6, + 3, + 2, + 12, + 10, + 0, + 21, + 14, + 0, + 20, + 27, + 27, + 2, + 0, + 0, + 9, + 9, + 14, + 23, + 12, + 4, + 7 + ], + "weighted_loads": [ + 1.8619745671749115, + 0.24826333671808243, + 5.96587773039937, + 0.0760069228708744, + 0.5581399388611317, + 0.7272623144090176, + 0.1834522895514965, + 1.4356455411762, + 0.05756793171167374, + 0.64671840518713, + 0.18596478924155235, + 0.40347377955913544, + 0.19397682324051857, + 0.1912964414805174, + 3.0860485881567, + 0.4062536992132664, + 0.10819794610142708, + 0.46217360347509384, + 1.0758689567446709, + 0.20419033244252205, + 0.05043207108974457, + 0.5648586712777615, + 1.421404603868723, + 1.2043714839965105, + 0.8110477421432734, + 0.17494825087487698, + 0.15813228115439415, + 0.5461666621267796, + 0.16324786096811295, + 0.28314267098903656, + 0.5817007794976234, + 0.7643351852893829, + 0.06050090864300728, + 0.5986899267882109, + 0.5787682645022869, + 0.6849260423332453, + 1.1748452074825764, + 0.08767262101173401, + 0.27756309136748314, + 0.6499394439160824, + 0.16326696425676346, + 0.0, + 0.5450789481401443, + 0.13140935450792313, + 0.07905678078532219, + 0.628846313804388, + 0.9985133670270443, + 0.0, + 1.5143131464719772, + 0.9049622379243374, + 0.0, + 1.1601063441485167, + 2.6117489598691463, + 1.78451744094491, + 0.14344386383891106, + 0.0, + 0.0, + 0.5697718728333712, + 0.715205866843462, + 0.8940177317708731, + 1.9260884448885918, + 0.6468261927366257, + 0.2033943422138691, + 0.5870806984603405 + ], + "unique_experts": 59, + "load_cv": 1.085247416775937, + "normalized_load_entropy": 0.8914355952601066, + "max_load_share": 0.11006289308176101 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "0607c0c9ea4f57d880344f84cb32751c18be538ecd8e950345b8fae302c62b63", + "route_weight_sha256": "ef21bdd210c070cfac45e21ad934c1b88a35ea4a29f5ef6864a27cf66086683e", + "loads": [ + 23, + 6, + 70, + 5, + 6, + 14, + 10, + 19, + 8, + 10, + 5, + 10, + 4, + 10, + 35, + 8, + 17, + 10, + 13, + 5, + 1, + 6, + 23, + 20, + 19, + 4, + 8, + 10, + 5, + 4, + 8, + 16, + 4, + 13, + 8, + 14, + 14, + 1, + 13, + 14, + 4, + 10, + 11, + 5, + 6, + 12, + 13, + 1, + 21, + 14, + 15, + 20, + 27, + 29, + 2, + 7, + 0, + 9, + 12, + 14, + 23, + 18, + 6, + 14 + ], + "weighted_loads": [ + 1.8619745671749115, + 0.24826333671808243, + 5.96587773039937, + 0.18588825687766075, + 0.5581399388611317, + 0.7690777592360973, + 0.7658824287354946, + 1.4356455411762, + 0.6617978289723396, + 0.64671840518713, + 0.2518605925142765, + 0.9847525358200073, + 0.19397682324051857, + 0.4771850034594536, + 3.0860485881567, + 0.4062536992132664, + 2.1247946992516518, + 0.5708738416433334, + 1.2294567245990038, + 0.2683994509279728, + 0.05043207108974457, + 0.5648586712777615, + 1.5951923206448555, + 1.4070303980261087, + 0.9346609599888325, + 0.17494825087487698, + 0.5578024461865425, + 0.5461666621267796, + 0.21327878162264824, + 0.28314267098903656, + 0.5817007794976234, + 0.7643351852893829, + 0.1740974299609661, + 0.7406139466911554, + 0.5787682645022869, + 0.6849260423332453, + 1.1748452074825764, + 0.08767262101173401, + 1.159431491047144, + 0.7818540558218956, + 0.16326696425676346, + 0.9998104870319366, + 0.9066954962909222, + 0.1865635309368372, + 0.7716692797839642, + 0.628846313804388, + 1.1916042268276215, + 0.08802515268325806, + 1.5143131464719772, + 0.9049622379243374, + 1.150116205215454, + 1.1601063441485167, + 2.6117489598691463, + 1.8610742278397083, + 0.14344386383891106, + 0.6539452150464058, + 0.0, + 0.5697718728333712, + 0.7857176382094622, + 0.8940177317708731, + 1.9260884448885918, + 0.9451262354850769, + 0.2465080711990595, + 0.8584867939352989 + ], + "unique_experts": 63, + "load_cv": 0.8321777820423744, + "normalized_load_entropy": 0.9347862256434114, + "max_load_share": 0.089058524173028 + } + }, + "s1_bos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "1d6a118568f3748211f823821c0b7d1612dc5e8a62c84636593935c12c792b94", + "route_weight_sha256": "623d61768fa30a5f783087811724b300acc47ed374603700642f29b58fef3e7a", + "loads": [ + 23, + 8, + 68, + 2, + 6, + 15, + 4, + 19, + 1, + 11, + 4, + 5, + 5, + 5, + 34, + 7, + 2, + 8, + 12, + 5, + 1, + 6, + 21, + 16, + 14, + 3, + 3, + 10, + 3, + 4, + 8, + 16, + 1, + 12, + 9, + 12, + 14, + 1, + 4, + 11, + 4, + 0, + 6, + 4, + 2, + 11, + 10, + 0, + 20, + 13, + 0, + 19, + 26, + 28, + 2, + 0, + 0, + 9, + 9, + 14, + 23, + 11, + 5, + 7 + ], + "weighted_loads": [ + 1.7895488888025284, + 0.3255842290818691, + 5.983256973326206, + 0.07552690804004669, + 0.5609011501073837, + 0.7970979958772659, + 0.18024292960762978, + 1.3810252342373133, + 0.05995389074087143, + 0.6661945953965187, + 0.2163400910794735, + 0.36432817950844765, + 0.21403715759515762, + 0.19287201762199402, + 3.0372440479695797, + 0.3741477392613888, + 0.11255451664328575, + 0.46463559195399284, + 1.1659460812807083, + 0.25575292855501175, + 0.05055280402302742, + 0.5504246838390827, + 1.4525966085493565, + 1.1801078151911497, + 0.7190081514418125, + 0.14287094585597515, + 0.16115958988666534, + 0.5389208272099495, + 0.15489942580461502, + 0.2754562012851238, + 0.5685765147209167, + 0.7308155335485935, + 0.05861108750104904, + 0.6146404463797808, + 0.6024666856974363, + 0.6176511980593204, + 1.1423924639821053, + 0.08430013805627823, + 0.24945258721709251, + 0.6499218754470348, + 0.1600197497755289, + 0.0, + 0.5369988493621349, + 0.18697378784418106, + 0.08518093824386597, + 0.5846633687615395, + 0.9932047016918659, + 0.0, + 1.4534605219960213, + 0.8702204637229443, + 0.0, + 1.1152100786566734, + 2.5341711416840553, + 1.859811406582594, + 0.14520611613988876, + 0.0, + 0.0, + 0.5798339396715164, + 0.6835699789226055, + 0.917634379118681, + 1.8895033039152622, + 0.6046075187623501, + 0.24579443037509918, + 0.5946155972778797 + ], + "unique_experts": 59, + "load_cv": 1.0568845089762042, + "normalized_load_entropy": 0.8954426983802198, + "max_load_share": 0.1069182389937107 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "7b87c1d66626ff385ff8a2e4c78bc2c4318fc9c8f30833ad1791178be4a28828", + "route_weight_sha256": "0361872dd08cb0a10d3416793b6c257c1bd547e6c5ad0f9f4dddc1d8a56ef4dc", + "loads": [ + 23, + 8, + 68, + 4, + 7, + 16, + 12, + 19, + 16, + 13, + 11, + 10, + 5, + 11, + 36, + 9, + 18, + 11, + 16, + 6, + 1, + 6, + 23, + 21, + 18, + 3, + 12, + 11, + 5, + 10, + 8, + 16, + 7, + 21, + 9, + 12, + 14, + 5, + 20, + 14, + 6, + 15, + 16, + 7, + 12, + 11, + 14, + 5, + 20, + 13, + 22, + 19, + 26, + 28, + 6, + 9, + 0, + 15, + 11, + 14, + 23, + 17, + 8, + 10 + ], + "weighted_loads": [ + 1.7895488888025284, + 0.3255842290818691, + 5.983256973326206, + 0.13911242969334126, + 0.6075355298817158, + 0.8413883782923222, + 0.7952000256627798, + 1.3810252342373133, + 1.3711705170571804, + 0.7676481753587723, + 0.7715610153973103, + 1.0157099105417728, + 0.21403715759515762, + 0.5285162478685379, + 3.1069649569690228, + 0.47065289318561554, + 2.56328072398901, + 0.6255880109965801, + 1.3110732454806566, + 0.31936629116535187, + 0.05055280402302742, + 0.5504246838390827, + 1.5697640106081963, + 1.469827713444829, + 0.8667612969875336, + 0.14287094585597515, + 0.922326248139143, + 0.569418415427208, + 0.20468818582594395, + 1.053558174520731, + 0.5685765147209167, + 0.7308155335485935, + 0.4440823756158352, + 1.2356338109821081, + 0.6024666856974363, + 0.6176511980593204, + 1.1423924639821053, + 0.3115409445017576, + 1.9719775691628456, + 0.7991687059402466, + 0.38339813984930515, + 1.465204730629921, + 1.3383067958056927, + 0.28033182583749294, + 1.321716956794262, + 0.5846633687615395, + 1.2342898659408092, + 0.2879918906837702, + 1.4534605219960213, + 0.8702204637229443, + 1.6504744701087475, + 1.1152100786566734, + 2.5341711416840553, + 1.859811406582594, + 0.351974181830883, + 0.7644002232700586, + 0.0, + 1.1207942552864552, + 0.7252382002770901, + 0.917634379118681, + 1.8895033039152622, + 0.8961613401770592, + 0.3246026672422886, + 0.6830455269664526 + ], + "unique_experts": 63, + "load_cv": 0.6992331076818002, + "normalized_load_entropy": 0.9523977922024746, + "max_load_share": 0.07709750566893424 + } + }, + "s0_x": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "972b07054bcd28f6744f7c37896f0b5c296bbcb45b00c116e1e510c4fecbd812", + "route_weight_sha256": "fcfb8e3a127c80e9ee01c95be46d2544c15856ddc68c0233ef7060ac9bbd5cc4", + "loads": [ + 22, + 9, + 68, + 2, + 6, + 14, + 4, + 19, + 1, + 11, + 5, + 6, + 4, + 5, + 35, + 8, + 2, + 9, + 10, + 4, + 1, + 6, + 20, + 17, + 14, + 4, + 3, + 10, + 3, + 4, + 8, + 15, + 1, + 12, + 8, + 12, + 14, + 1, + 4, + 11, + 4, + 0, + 6, + 3, + 2, + 11, + 10, + 0, + 21, + 14, + 0, + 19, + 26, + 27, + 2, + 0, + 0, + 9, + 10, + 14, + 23, + 12, + 4, + 7 + ], + "weighted_loads": [ + 1.7768488228321075, + 0.38032957166433334, + 5.834028532728553, + 0.07694720104336739, + 0.5598767399787903, + 0.7788715735077858, + 0.18272179923951626, + 1.4125048350542784, + 0.05888567119836807, + 0.6775475554168224, + 0.25804267078638077, + 0.39612841233611107, + 0.18745066225528717, + 0.2003850731998682, + 3.0598903223872185, + 0.4032962694764137, + 0.09762286767363548, + 0.49895709939301014, + 1.1127084903419018, + 0.2064320668578148, + 0.05162215605378151, + 0.558555718511343, + 1.4376599378883839, + 1.1798922140151262, + 0.7465228736400604, + 0.17698239535093307, + 0.17171142250299454, + 0.5419864989817142, + 0.16628271713852882, + 0.28282975405454636, + 0.5684707425534725, + 0.691660201177001, + 0.05867660045623779, + 0.6147749181836843, + 0.5820373855531216, + 0.6059262193739414, + 1.154054183512926, + 0.08420141041278839, + 0.278326652944088, + 0.6536685228347778, + 0.16345564275979996, + 0.0, + 0.5470438897609711, + 0.1391815021634102, + 0.08112650364637375, + 0.5906155202537775, + 0.9758618846535683, + 0.0, + 1.5152769479900599, + 0.9143236093223095, + 0.0, + 1.1610862240195274, + 2.5697115138173103, + 1.8421494700014591, + 0.142607219517231, + 0.0, + 0.0, + 0.5768117923289537, + 0.7544512804597616, + 0.8837959356606007, + 1.91501796990633, + 0.6451838035136461, + 0.20591751486063004, + 0.5917097888886929 + ], + "unique_experts": 59, + "load_cv": 1.0562855166095884, + "normalized_load_entropy": 0.8954966718198276, + "max_load_share": 0.1069182389937107 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "6594b1c7008636ddecbe44078209062c866d77eb2f7725a7a0e720410cb67a93", + "route_weight_sha256": "6102e3bf3d5fb145818c8d519d039db8f1accef2a019be93ba29951e39544f16", + "loads": [ + 22, + 9, + 68, + 5, + 6, + 16, + 8, + 19, + 8, + 11, + 7, + 10, + 4, + 11, + 35, + 8, + 18, + 11, + 13, + 5, + 1, + 6, + 23, + 20, + 17, + 4, + 7, + 10, + 5, + 4, + 8, + 15, + 4, + 14, + 8, + 12, + 14, + 1, + 13, + 14, + 4, + 10, + 11, + 5, + 5, + 11, + 14, + 2, + 21, + 14, + 14, + 19, + 26, + 28, + 2, + 7, + 0, + 9, + 13, + 14, + 23, + 19, + 6, + 15 + ], + "weighted_loads": [ + 1.7768488228321075, + 0.38032957166433334, + 5.834028532728553, + 0.18682853505015373, + 0.5598767399787903, + 0.8769848421216011, + 0.5492690559476614, + 1.4125048350542784, + 0.6464264504611492, + 0.6775475554168224, + 0.32528920471668243, + 0.9776929654181004, + 0.18745066225528717, + 0.5199653878808022, + 3.0598903223872185, + 0.4032962694764137, + 2.385462399572134, + 0.6195899527519941, + 1.2214287091046572, + 0.26827748492360115, + 0.05162215605378151, + 0.558555718511343, + 1.6114476546645164, + 1.3692938517779112, + 0.8701360914856195, + 0.17698239535093307, + 0.5178738832473755, + 0.5419864989817142, + 0.21631363779306412, + 0.28282975405454636, + 0.5684707425534725, + 0.691660201177001, + 0.17227312177419662, + 0.7533496636897326, + 0.5820373855531216, + 0.6059262193739414, + 1.154054183512926, + 0.08420141041278839, + 1.0829642452299595, + 0.7851873114705086, + 0.16345564275979996, + 0.9327073097229004, + 0.9171018153429031, + 0.19297870807349682, + 0.7210266627371311, + 0.5906155202537775, + 1.1867020726203918, + 0.13538067042827606, + 1.5152769479900599, + 0.9143236093223095, + 0.9752984791994095, + 1.1610862240195274, + 2.5697115138173103, + 1.874212585389614, + 0.142607219517231, + 0.6539452150464058, + 0.0, + 0.5768117923289537, + 0.8249630518257618, + 0.8837959356606007, + 1.91501796990633, + 0.9961181525141001, + 0.24903124384582043, + 0.9425262361764908 + ], + "unique_experts": 63, + "load_cv": 0.8092043133006809, + "normalized_load_entropy": 0.93766621790449, + "max_load_share": 0.08651399491094147 + } + }, + "s1_x": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "81c966e6468398a6632ef9c398e8f2e081004fc694eba6801e818adca2934759", + "route_weight_sha256": "d0e87ca23c93f3f267a26ae2dd4b3bc1c11a53c3e14db87cb1a99e56bf066220", + "loads": [ + 22, + 9, + 68, + 2, + 6, + 12, + 4, + 20, + 1, + 9, + 5, + 6, + 5, + 5, + 34, + 8, + 2, + 7, + 12, + 7, + 1, + 6, + 21, + 17, + 15, + 2, + 3, + 10, + 3, + 4, + 8, + 16, + 1, + 12, + 8, + 12, + 14, + 1, + 3, + 12, + 4, + 0, + 6, + 3, + 2, + 11, + 10, + 0, + 21, + 13, + 0, + 18, + 26, + 28, + 2, + 0, + 1, + 9, + 8, + 14, + 24, + 11, + 4, + 8 + ], + "weighted_loads": [ + 1.708357084542513, + 0.3683096319437027, + 5.857192298397422, + 0.07641399465501308, + 0.5635576173663139, + 0.6853886805474758, + 0.17946746572852135, + 1.3995538465678692, + 0.06161676347255707, + 0.5945418141782284, + 0.25342445634305477, + 0.38603684678673744, + 0.2118634730577469, + 0.19340921752154827, + 2.993538249284029, + 0.411678534001112, + 0.11033818125724792, + 0.4207727052271366, + 1.1838523801416159, + 0.37935442104935646, + 0.051218315958976746, + 0.5335565991699696, + 1.4648597724735737, + 1.2265810817480087, + 0.7791318763047457, + 0.11210086196660995, + 0.17683984711766243, + 0.5367169566452503, + 0.14333274215459824, + 0.27342626079916954, + 0.559321653097868, + 0.7206006553024054, + 0.05773588642477989, + 0.6121371686458588, + 0.5736759677529335, + 0.603333804756403, + 1.1203067265450954, + 0.0816173329949379, + 0.20916328206658363, + 0.6794424522668123, + 0.1595296896994114, + 0.0, + 0.545548640191555, + 0.14387677796185017, + 0.08378195017576218, + 0.5780424419790506, + 1.0019021928310394, + 0.0, + 1.4807180669158697, + 0.8693932555615902, + 0.0, + 1.081220854073763, + 2.5267846547067165, + 1.88712053373456, + 0.14973577111959457, + 0.0, + 0.02593553252518177, + 0.5808229800313711, + 0.6427759975194931, + 0.9058125056326389, + 1.9023002088069916, + 0.6109474301338196, + 0.21023180335760117, + 0.6449862383306026 + ], + "unique_experts": 60, + "load_cv": 1.0586794526474634, + "normalized_load_entropy": 0.8956786256864259, + "max_load_share": 0.1069182389937107 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "5e0eb3beced450f782216bf9cc93ca21ede6636b593681660d8b29ea2b7e48c1", + "route_weight_sha256": "6058b9a31bf57c1f7d404fae795a378d5743e362fedbb7fdcaa439864f14fa7f", + "loads": [ + 22, + 9, + 68, + 4, + 7, + 14, + 10, + 20, + 15, + 11, + 12, + 11, + 5, + 12, + 36, + 10, + 19, + 10, + 15, + 9, + 1, + 6, + 23, + 22, + 20, + 2, + 11, + 11, + 5, + 10, + 8, + 16, + 7, + 21, + 8, + 12, + 14, + 5, + 18, + 15, + 6, + 14, + 16, + 5, + 11, + 11, + 15, + 7, + 21, + 13, + 21, + 18, + 26, + 28, + 6, + 9, + 1, + 15, + 10, + 14, + 24, + 18, + 7, + 12 + ], + "weighted_loads": [ + 1.708357084542513, + 0.3683096319437027, + 5.857192298397422, + 0.13999951630830765, + 0.610191997140646, + 0.7835272140800953, + 0.5640462394803762, + 1.3995538465678692, + 1.295819740742445, + 0.695995394140482, + 0.8122697342187166, + 1.060198176652193, + 0.2118634730577469, + 0.5599411483854055, + 3.063259158283472, + 0.5081836879253387, + 2.8218186534941196, + 0.5884512029588223, + 1.2857432998716831, + 0.5119857229292393, + 0.051218315958976746, + 0.5335565991699696, + 1.5820271745324135, + 1.4851702153682709, + 0.9603140782564878, + 0.11210086196660995, + 0.8845993019640446, + 0.5672145448625088, + 0.19312150217592716, + 1.0515282340347767, + 0.559321653097868, + 0.7206006553024054, + 0.44320717453956604, + 1.2277749367058277, + 0.5736759677529335, + 0.603333804756403, + 1.1203067265450954, + 0.3088581394404173, + 1.8501913622021675, + 0.8277476709336042, + 0.38290807977318764, + 1.3354255706071854, + 1.3602000027894974, + 0.2023118995130062, + 1.2821133881807327, + 0.5780424419790506, + 1.2687103599309921, + 0.39517257548868656, + 1.4807180669158697, + 0.8693932555615902, + 1.4204263724386692, + 1.081220854073763, + 2.5267846547067165, + 1.88712053373456, + 0.35650383681058884, + 0.7644002232700586, + 0.02593553252518177, + 1.1217832956463099, + 0.6844442188739777, + 0.9058125056326389, + 1.9023002088069916, + 0.9557834565639496, + 0.2890400402247906, + 0.8016993459314108 + ], + "unique_experts": 64, + "load_cv": 0.6992331076818002, + "normalized_load_entropy": 0.9530228271970802, + "max_load_share": 0.07709750566893424 + } + }, + "s0_period": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "fd45aabbb862a1b7f335a71b3d303cc70144b25b6cab20aaa0d83302ba1886f1", + "route_weight_sha256": "dc6a95e5edf9899b9f179c63cc813bd0dce4f46fd12a61a341decb9baf49fd9c", + "loads": [ + 22, + 8, + 70, + 1, + 6, + 15, + 4, + 19, + 1, + 11, + 4, + 6, + 4, + 5, + 35, + 8, + 2, + 8, + 10, + 5, + 1, + 6, + 20, + 16, + 15, + 4, + 3, + 10, + 3, + 4, + 8, + 16, + 1, + 12, + 8, + 12, + 14, + 1, + 4, + 11, + 4, + 0, + 6, + 3, + 2, + 10, + 10, + 0, + 21, + 12, + 0, + 19, + 26, + 28, + 2, + 0, + 0, + 9, + 10, + 14, + 24, + 12, + 4, + 7 + ], + "weighted_loads": [ + 1.7905123196542263, + 0.340446624904871, + 5.930720705538988, + 0.045453641563653946, + 0.5563168339431286, + 0.8121967948973179, + 0.18344319984316826, + 1.403639066964388, + 0.05936422944068909, + 0.6721320487558842, + 0.22462816536426544, + 0.3962372951209545, + 0.18532037734985352, + 0.1994406245648861, + 3.05033653229475, + 0.41060421243309975, + 0.10026068240404129, + 0.4470667075365782, + 1.0978534780442715, + 0.256236732006073, + 0.051430538296699524, + 0.5589864104986191, + 1.4257308430969715, + 1.157564327120781, + 0.7847792711108923, + 0.17759175598621368, + 0.17172113060951233, + 0.5465131737291813, + 0.16029992327094078, + 0.281329158693552, + 0.5669604018330574, + 0.7345983758568764, + 0.05965924263000488, + 0.6108325459063053, + 0.5919837728142738, + 0.5989618301391602, + 1.1541315838694572, + 0.08484997600317001, + 0.29997117444872856, + 0.658673383295536, + 0.16600513085722923, + 0.0, + 0.5508138686418533, + 0.1332701314240694, + 0.08420974388718605, + 0.563277468085289, + 0.9688550978899002, + 0.0, + 1.519308103248477, + 0.8372089229524136, + 0.0, + 1.151475315913558, + 2.566066689789295, + 1.8776845484972, + 0.1465068832039833, + 0.0, + 0.0, + 0.5763880535960197, + 0.751925740391016, + 0.876006780192256, + 1.9454063139855862, + 0.6371666174381971, + 0.19331521168351173, + 0.5886358991265297 + ], + "unique_experts": 59, + "load_cv": 1.0802790785459124, + "normalized_load_entropy": 0.8924417700113033, + "max_load_share": 0.11006289308176101 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "af751bd3c95069a39179e2bf55f86d2427f20f22a63045e2091aac5ba296aee5", + "route_weight_sha256": "13118c3debbb2428dceb9ea9eba23e99d81fc4ca7449296fdf57f8f09b691f3a", + "loads": [ + 22, + 8, + 70, + 4, + 6, + 16, + 9, + 19, + 9, + 11, + 6, + 10, + 4, + 10, + 35, + 8, + 18, + 10, + 13, + 6, + 1, + 6, + 24, + 19, + 18, + 4, + 7, + 10, + 5, + 4, + 8, + 16, + 4, + 14, + 8, + 12, + 14, + 1, + 14, + 14, + 4, + 11, + 11, + 5, + 5, + 10, + 12, + 1, + 21, + 12, + 16, + 19, + 26, + 29, + 2, + 7, + 0, + 9, + 13, + 14, + 24, + 18, + 6, + 14 + ], + "weighted_loads": [ + 1.7905123196542263, + 0.340446624904871, + 5.930720705538988, + 0.1553349755704403, + 0.5563168339431286, + 0.8540122397243977, + 0.5914602354168892, + 1.403639066964388, + 0.732557151466608, + 0.6721320487558842, + 0.291724257171154, + 0.9775158725678921, + 0.18532037734985352, + 0.4853291865438223, + 3.05033653229475, + 0.41060421243309975, + 2.3740090280771255, + 0.5611522179096937, + 1.2122392375022173, + 0.3148863650858402, + 0.051430538296699524, + 0.5589864104986191, + 1.6435879059135914, + 1.3439563810825348, + 0.9083924889564514, + 0.17759175598621368, + 0.5127136632800102, + 0.5465131737291813, + 0.21033084392547607, + 0.281329158693552, + 0.5669604018330574, + 0.7345983758568764, + 0.17325576394796371, + 0.75092863291502, + 0.5919837728142738, + 0.5989618301391602, + 1.1541315838694572, + 0.08484997600317001, + 1.2058744616806507, + 0.7923589423298836, + 0.16600513085722923, + 0.9873584434390068, + 0.9254636205732822, + 0.18902995809912682, + 0.7251722067594528, + 0.563277468085289, + 1.09839341416955, + 0.08802515268325806, + 1.519308103248477, + 0.8372089229524136, + 1.3111928924918175, + 1.151475315913558, + 2.566066689789295, + 1.909747663885355, + 0.1465068832039833, + 0.6539452150464058, + 0.0, + 0.5763880535960197, + 0.8224375117570162, + 0.876006780192256, + 1.9454063139855862, + 0.9354666601866484, + 0.23642894066870213, + 0.8600419946014881 + ], + "unique_experts": 63, + "load_cv": 0.8301836247434485, + "normalized_load_entropy": 0.9351223371280649, + "max_load_share": 0.089058524173028 + } + }, + "s1_period": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "6b1678470d6d34ef0e3e04aa9958d6beaa25d946f095bcbf088465a74d0aca42", + "route_weight_sha256": "512b4d5269ae519c3d7453aeb645dffbb1be9d009d77adc29299aabc7293b710", + "loads": [ + 24, + 9, + 68, + 2, + 6, + 13, + 4, + 20, + 1, + 10, + 4, + 5, + 5, + 6, + 34, + 7, + 2, + 7, + 12, + 6, + 1, + 6, + 21, + 17, + 14, + 3, + 3, + 10, + 3, + 4, + 8, + 15, + 1, + 12, + 8, + 12, + 14, + 1, + 4, + 11, + 4, + 0, + 6, + 4, + 3, + 10, + 10, + 0, + 20, + 13, + 0, + 18, + 26, + 28, + 2, + 0, + 1, + 9, + 8, + 14, + 25, + 11, + 4, + 7 + ], + "weighted_loads": [ + 1.7847013212740421, + 0.36532895639538765, + 5.853841416537762, + 0.07517501898109913, + 0.5728714019060135, + 0.7252181433141232, + 0.17953677102923393, + 1.408754514530301, + 0.06329400092363358, + 0.6165996268391609, + 0.22117770463228226, + 0.35530076920986176, + 0.2129391748458147, + 0.2265748493373394, + 2.9846731945872307, + 0.38456201553344727, + 0.11269818991422653, + 0.41491574421525, + 1.1494168043136597, + 0.3196989893913269, + 0.05318916589021683, + 0.5367596969008446, + 1.4556836113333702, + 1.218538785353303, + 0.7318209391087294, + 0.14122558198869228, + 0.17360727116465569, + 0.5320780910551548, + 0.14205772057175636, + 0.27287959679961205, + 0.5596716292202473, + 0.6818368081003428, + 0.058588992804288864, + 0.6144969183951616, + 0.5718877501785755, + 0.606475692242384, + 1.1289863660931587, + 0.0807611346244812, + 0.25984038412570953, + 0.6531003750860691, + 0.1607459858059883, + 0.0, + 0.5443473011255264, + 0.18344678170979023, + 0.10816318728029728, + 0.5448772553354502, + 0.9964498244225979, + 0.0, + 1.4606591165065765, + 0.8583591654896736, + 0.0, + 1.0855104550719261, + 2.542104721069336, + 1.8836251869797707, + 0.15054181963205338, + 0.0, + 0.025874922052025795, + 0.5801256615668535, + 0.6462947688996792, + 0.9031334444880486, + 1.9517211243510246, + 0.6029652468860149, + 0.20636211708188057, + 0.5971646793186665 + ], + "unique_experts": 60, + "load_cv": 1.0595757842315778, + "normalized_load_entropy": 0.8964597456418415, + "max_load_share": 0.1069182389937107 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "7485ccce4b3a267217e736f94542a3b283e60959928919cc8a84f1e8136625d5", + "route_weight_sha256": "a65fdac08c6634ab2614dd14202af5a78ec86d67d8b28cd9609f43f4dea2be29", + "loads": [ + 24, + 9, + 68, + 4, + 7, + 14, + 10, + 20, + 17, + 12, + 11, + 10, + 5, + 12, + 36, + 9, + 19, + 10, + 15, + 7, + 1, + 6, + 24, + 21, + 18, + 3, + 11, + 11, + 5, + 10, + 8, + 15, + 8, + 21, + 8, + 12, + 14, + 5, + 21, + 14, + 6, + 15, + 16, + 6, + 12, + 10, + 13, + 6, + 20, + 13, + 24, + 18, + 26, + 28, + 6, + 9, + 1, + 15, + 10, + 14, + 25, + 17, + 7, + 10 + ], + "weighted_loads": [ + 1.7847013212740421, + 0.36532895639538765, + 5.853841416537762, + 0.1387605406343937, + 0.6195057816803455, + 0.7695085257291794, + 0.529119336977601, + 1.408754514530301, + 1.430156171321869, + 0.7180532068014145, + 0.7807127237319946, + 0.979429267346859, + 0.2129391748458147, + 0.5622190795838833, + 3.0543941035866737, + 0.481067169457674, + 2.7681163549423218, + 0.5760272108018398, + 1.2566495258361101, + 0.3924837112426758, + 0.05318916589021683, + 0.5367596969008446, + 1.6056106090545654, + 1.442762104794383, + 0.8795740846544504, + 0.14122558198869228, + 0.8768895380198956, + 0.5625756792724133, + 0.1918464805930853, + 1.0509815700352192, + 0.5596716292202473, + 0.6818368081003428, + 0.4772999994456768, + 1.2254161071032286, + 0.5718877501785755, + 0.606475692242384, + 1.1289863660931587, + 0.3080019410699606, + 2.0087139159440994, + 0.8026456646621227, + 0.38412437587976456, + 1.4197279661893845, + 1.3547478057444096, + 0.24188190326094627, + 1.307699779048562, + 0.5448772553354502, + 1.1783681474626064, + 0.3285695929080248, + 1.4606591165065765, + 0.8583591654896736, + 1.9068893603980541, + 1.0855104550719261, + 2.542104721069336, + 1.8836251869797707, + 0.35730988532304764, + 0.7644002232700586, + 0.025874922052025795, + 1.1210859771817923, + 0.6879629902541637, + 0.9031334444880486, + 1.9517211243510246, + 0.894519068300724, + 0.28517035394907, + 0.6855946090072393 + ], + "unique_experts": 64, + "load_cv": 0.7066066728107835, + "normalized_load_entropy": 0.9522432044433802, + "max_load_share": 0.07709750566893424 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 106, + "ordered_topk_exact_tokens": 88, + "set_exact_tokens": 96, + "mean_set_jaccard": 0.973045822102426, + "mean_token_weighted_tv": 0.007795143072967822, + "aggregate_load_tv": 0.014150943396226412 + }, + "system_bos": { + "tokens": 106, + "ordered_topk_exact_tokens": 72, + "set_exact_tokens": 82, + "mean_set_jaccard": 0.9353099730458222, + "mean_token_weighted_tv": 0.01607490237802267, + "aggregate_load_tv": 0.026729559748427674 + }, + "system_x": { + "tokens": 106, + "ordered_topk_exact_tokens": 64, + "set_exact_tokens": 83, + "mean_set_jaccard": 0.9380053908355797, + "mean_token_weighted_tv": 0.017885839021852555, + "aggregate_load_tv": 0.023584905660377357 + }, + "system_period": { + "tokens": 106, + "ordered_topk_exact_tokens": 68, + "set_exact_tokens": 82, + "mean_set_jaccard": 0.9353099730458222, + "mean_token_weighted_tv": 0.01754378494015842, + "aggregate_load_tv": 0.026729559748427674 + }, + "bos_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 69, + "set_exact_tokens": 81, + "mean_set_jaccard": 0.9326145552560647, + "mean_token_weighted_tv": 0.016996600208276848, + "aggregate_load_tv": 0.034591194968553465 + }, + "bos_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 70, + "set_exact_tokens": 82, + "mean_set_jaccard": 0.9353099730458221, + "mean_token_weighted_tv": 0.018472753790259925, + "aggregate_load_tv": 0.029874213836477988 + }, + "x_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 65, + "set_exact_tokens": 79, + "mean_set_jaccard": 0.9272237196765499, + "mean_token_weighted_tv": 0.01832830959509285, + "aggregate_load_tv": 0.029874213836477988 + }, + "x_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 62, + "set_exact_tokens": 78, + "mean_set_jaccard": 0.9225067385444743, + "mean_token_weighted_tv": 0.02276462114433635, + "aggregate_load_tv": 0.04088050314465409 + }, + "period_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 70, + "set_exact_tokens": 82, + "mean_set_jaccard": 0.933288409703504, + "mean_token_weighted_tv": 0.017607210880532017, + "aggregate_load_tv": 0.031446540880503145 + }, + "period_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 62, + "set_exact_tokens": 79, + "mean_set_jaccard": 0.92722371967655, + "mean_token_weighted_tv": 0.021609649958335003, + "aggregate_load_tv": 0.034591194968553465 + } + } + }, + "layer_08": { + "layer": 8, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "9c84679980e2e25a36a8d4f555eb6f701dc477e73b1fa33ab1497dbd00dea254", + "route_weight_sha256": "4676afc6afafe157191f35f63015541d189f11a1ebdd2e71fed2745fe928d556", + "loads": [ + 4, + 50, + 2, + 6, + 1, + 15, + 3, + 35, + 0, + 12, + 6, + 4, + 2, + 6, + 2, + 11, + 7, + 9, + 1, + 5, + 5, + 10, + 36, + 0, + 35, + 1, + 0, + 0, + 13, + 27, + 9, + 16, + 8, + 4, + 18, + 0, + 20, + 45, + 3, + 9, + 9, + 16, + 3, + 30, + 20, + 5, + 2, + 18, + 0, + 0, + 0, + 18, + 11, + 3, + 6, + 3, + 6, + 2, + 8, + 12, + 7, + 7, + 8, + 2 + ], + "weighted_loads": [ + 0.16116192936897278, + 2.951208457350731, + 0.08219493180513382, + 0.5300752967596054, + 0.03382440283894539, + 0.7340435516089201, + 0.18918294087052345, + 2.6418707743287086, + 0.0, + 0.5744224116206169, + 0.49735406041145325, + 0.24024677649140358, + 0.09121742844581604, + 0.3526274301111698, + 0.13077382743358612, + 0.6529566571116447, + 0.4018009305000305, + 0.7481247521936893, + 0.05595732852816582, + 0.27125899866223335, + 0.5434230081737041, + 0.55565569922328, + 2.355171889066696, + 0.0, + 2.5889946296811104, + 0.052604034543037415, + 0.0, + 0.0, + 0.9014212787151337, + 2.0371909998357296, + 0.8049781322479248, + 1.499951422214508, + 0.562448300421238, + 0.17837046831846237, + 1.0800558011978865, + 0.0, + 1.404964977875352, + 2.611601810902357, + 0.11114750616252422, + 0.779865775257349, + 0.445380374789238, + 0.8719411082565784, + 0.18908200412988663, + 1.9637525789439678, + 1.3657228164374828, + 0.3481248989701271, + 0.10365879908204079, + 0.8499507755041122, + 0.0, + 0.0, + 0.0, + 1.2162021324038506, + 0.8591854013502598, + 0.24004815518856049, + 0.3888612240552902, + 0.14281689375638962, + 0.3505629412829876, + 0.11945414543151855, + 0.40482764318585396, + 0.9033133946359158, + 0.4490074925124645, + 0.293211679905653, + 0.5582263991236687, + 0.08524098247289658 + ], + "unique_experts": 56, + "load_cv": 1.1198324703627462, + "normalized_load_entropy": 0.8720019800791666, + "max_load_share": 0.07861635220125786 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "c7f576ae505b1ccba2b32506496d7c4c2498708358d882c13120390f7b579643", + "route_weight_sha256": "bd0b548d8139dbd127b6d8a4b0d3ab1515453d83e7bbed82ad73dc6374efc6c4", + "loads": [ + 4, + 56, + 4, + 7, + 4, + 15, + 8, + 36, + 8, + 12, + 7, + 6, + 9, + 13, + 2, + 11, + 7, + 12, + 1, + 5, + 5, + 10, + 38, + 0, + 35, + 12, + 0, + 0, + 13, + 27, + 12, + 16, + 12, + 19, + 18, + 0, + 20, + 45, + 3, + 16, + 16, + 16, + 3, + 30, + 20, + 11, + 8, + 22, + 0, + 3, + 3, + 18, + 23, + 3, + 10, + 11, + 6, + 2, + 12, + 12, + 7, + 7, + 10, + 5 + ], + "weighted_loads": [ + 0.16116192936897278, + 3.3214488830417395, + 0.12131887953728437, + 0.5764947421848774, + 0.1499489697162062, + 0.7340435516089201, + 0.6806586422026157, + 2.6875676587224007, + 0.5623978152871132, + 0.5744224116206169, + 0.5582963936030865, + 0.3051420906558633, + 0.4723633639514446, + 0.8507262021303177, + 0.13077382743358612, + 0.6529566571116447, + 0.4018009305000305, + 0.8882923051714897, + 0.05595732852816582, + 0.27125899866223335, + 0.5434230081737041, + 0.55565569922328, + 2.429469220340252, + 0.0, + 2.5889946296811104, + 0.8238506875932217, + 0.0, + 0.0, + 0.9014212787151337, + 2.0371909998357296, + 0.8734045070596039, + 1.499951422214508, + 0.7315427996218204, + 1.4007792975753546, + 1.0800558011978865, + 0.0, + 1.404964977875352, + 2.611601810902357, + 0.11114750616252422, + 0.9882167628966272, + 0.8495104797184467, + 0.8719411082565784, + 0.18908200412988663, + 1.9637525789439678, + 1.3657228164374828, + 0.9551267214119434, + 0.768534030765295, + 0.9717418635264039, + 0.0, + 0.16474704071879387, + 0.169997688382864, + 1.2162021324038506, + 1.7300790883600712, + 0.24004815518856049, + 1.966016935184598, + 0.6341387592256069, + 0.3505629412829876, + 0.11945414543151855, + 0.5196736725047231, + 0.9033133946359158, + 0.4490074925124645, + 0.293211679905653, + 0.6418886967003345, + 0.29288384318351746 + ], + "unique_experts": 59, + "load_cv": 0.9074484895410615, + "normalized_load_entropy": 0.9115815854250848, + "max_load_share": 0.07124681933842239 + } + }, + "s1_eos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "fb6965aaa14c39e8b0bd764589395999239f71c2f6ad2cac836d225c281decff", + "route_weight_sha256": "56a807f1015cd150db740f209f7bea34f47048a4bec71ef1305724ad8313f4a3", + "loads": [ + 4, + 51, + 2, + 6, + 1, + 14, + 2, + 36, + 0, + 12, + 6, + 4, + 2, + 6, + 2, + 11, + 8, + 9, + 2, + 5, + 5, + 10, + 36, + 0, + 35, + 1, + 0, + 0, + 15, + 26, + 9, + 15, + 8, + 5, + 18, + 1, + 19, + 45, + 2, + 9, + 9, + 17, + 3, + 30, + 20, + 5, + 2, + 16, + 0, + 0, + 0, + 18, + 10, + 3, + 6, + 3, + 6, + 2, + 9, + 11, + 7, + 8, + 7, + 2 + ], + "weighted_loads": [ + 0.16302623599767685, + 2.951507482677698, + 0.08149874582886696, + 0.5330043733119965, + 0.036338429898023605, + 0.69082185998559, + 0.1457185447216034, + 2.7036046124994755, + 0.0, + 0.5681494735181332, + 0.4977595768868923, + 0.24929000064730644, + 0.09021115303039551, + 0.360026016831398, + 0.13109704852104187, + 0.658121544867754, + 0.4405181184411049, + 0.7275431863963604, + 0.08490271307528019, + 0.27223772555589676, + 0.5450703017413616, + 0.5476699993014336, + 2.33272173628211, + 0.0, + 2.6080708913505077, + 0.050223805010318756, + 0.0, + 0.0, + 0.9773262292146683, + 1.9790684096515179, + 0.793513361364603, + 1.4504347145557404, + 0.5575473718345165, + 0.21630102768540382, + 1.06457787938416, + 0.03269033879041672, + 1.345103757455945, + 2.6224481016397476, + 0.07168932259082794, + 0.7689554132521152, + 0.4342466089874506, + 0.9065162502229214, + 0.18976649641990662, + 1.936833743005991, + 1.3507619686424732, + 0.35053105279803276, + 0.10319700092077255, + 0.786332605406642, + 0.0, + 0.0, + 0.0, + 1.200441762804985, + 0.8327322863042355, + 0.23686624318361282, + 0.3954465053975582, + 0.1431654505431652, + 0.34855200722813606, + 0.11834311112761497, + 0.4524037539958954, + 0.8548173680901527, + 0.4418761618435383, + 0.332826629281044, + 0.5194189473986626, + 0.08791439980268478 + ], + "unique_experts": 57, + "load_cv": 1.1220908396994775, + "normalized_load_entropy": 0.8732595599709654, + "max_load_share": 0.08018867924528301 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "c679d7a91f44b7fe9e450a768886ece080c32c5c6678c03fe520cf3b44898abd", + "route_weight_sha256": "5b715fb3dca687ab1865c6cbc97fab0fca25b15a61982d19998cad49a15ee139", + "loads": [ + 5, + 56, + 12, + 8, + 2, + 15, + 13, + 37, + 13, + 12, + 9, + 8, + 11, + 13, + 2, + 11, + 8, + 23, + 3, + 5, + 5, + 10, + 37, + 4, + 35, + 12, + 0, + 2, + 16, + 26, + 12, + 15, + 11, + 27, + 18, + 1, + 19, + 45, + 8, + 15, + 22, + 17, + 5, + 30, + 20, + 17, + 16, + 20, + 3, + 5, + 5, + 18, + 19, + 9, + 10, + 13, + 6, + 2, + 12, + 13, + 7, + 12, + 10, + 7 + ], + "weighted_loads": [ + 0.20254267752170563, + 3.2311204709112644, + 0.7046112669631839, + 0.638735368847847, + 0.09502143412828445, + 0.7353409565985203, + 1.140802577137947, + 2.738542925566435, + 0.8569414466619492, + 0.5681494735181332, + 0.6516677401959896, + 0.368848429992795, + 0.6270033940672874, + 0.8313263542950153, + 0.13109704852104187, + 0.658121544867754, + 0.4405181184411049, + 1.6945586241781712, + 0.13174488209187984, + 0.27223772555589676, + 0.5450703017413616, + 0.5476699993014336, + 2.3719392083585262, + 0.18764951638877392, + 2.6080708913505077, + 1.1630446873605251, + 0.0, + 0.11914309486746788, + 1.018996823579073, + 1.9790684096515179, + 0.8623194140382111, + 1.4504347145557404, + 0.666721798479557, + 1.7513069715350866, + 1.06457787938416, + 0.03269033879041672, + 1.345103757455945, + 2.6224481016397476, + 0.46553878113627434, + 0.9319288227707148, + 1.0619254503399134, + 0.9065162502229214, + 0.3579035922884941, + 1.936833743005991, + 1.3507619686424732, + 1.522357176989317, + 1.1421527825295925, + 0.9007126493379474, + 0.32165708392858505, + 0.33190638944506645, + 0.2548299878835678, + 1.200441762804985, + 1.5158974677324295, + 0.920733168721199, + 1.9791135229170322, + 0.8363406173884869, + 0.34855200722813606, + 0.11834311112761497, + 0.5545457161497325, + 0.9279432222247124, + 0.4418761618435383, + 0.5213823020458221, + 0.6612185277044773, + 0.37812773138284683 + ], + "unique_experts": 63, + "load_cv": 0.7774537711910131, + "normalized_load_entropy": 0.9353789149505723, + "max_load_share": 0.06349206349206349 + } + }, + "s0_bos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "aeda5fe3046742584878753572deb424df0b1702c137b2a3325b9398bcabb7a9", + "route_weight_sha256": "79ce20b8552121e8d6c5b65fb59c13b4589ae745f3c9b5689898eca3b666deda", + "loads": [ + 5, + 55, + 2, + 6, + 1, + 12, + 3, + 35, + 0, + 13, + 6, + 4, + 2, + 6, + 2, + 12, + 5, + 10, + 1, + 5, + 5, + 10, + 34, + 0, + 35, + 1, + 0, + 0, + 13, + 26, + 9, + 16, + 8, + 4, + 20, + 1, + 17, + 45, + 2, + 9, + 8, + 18, + 3, + 31, + 23, + 5, + 2, + 16, + 0, + 0, + 0, + 18, + 10, + 3, + 7, + 3, + 6, + 2, + 8, + 11, + 7, + 6, + 7, + 2 + ], + "weighted_loads": [ + 0.20250430330634117, + 3.1492164488881826, + 0.08365790918469429, + 0.5362477451562881, + 0.03220513463020325, + 0.6205242350697517, + 0.18466096371412277, + 2.6638961620628834, + 0.0, + 0.6206011436879635, + 0.5041605904698372, + 0.23263004049658775, + 0.0941491462290287, + 0.3712225407361984, + 0.12590930610895157, + 0.6793200485408306, + 0.3237052857875824, + 0.7792039811611176, + 0.05694418400526047, + 0.2713753990828991, + 0.5604281015694141, + 0.5542288087308407, + 2.2789941988885403, + 0.0, + 2.65229388512671, + 0.06223701685667038, + 0.0, + 0.0, + 0.9354188814759254, + 1.9633272551000118, + 0.8101800084114075, + 1.5230272226035595, + 0.5577358603477478, + 0.18900243192911148, + 1.1596324630081654, + 0.03289817273616791, + 1.3305867854505777, + 2.5988093074411154, + 0.06946566328406334, + 0.7754526399075985, + 0.3812983687967062, + 0.9582989104092121, + 0.19466665014624596, + 2.0149940960109234, + 1.5070830136537552, + 0.35056061297655106, + 0.10651230067014694, + 0.7903337962925434, + 0.0, + 0.0, + 0.0, + 1.2269317097961903, + 0.8396762348711491, + 0.24006281793117523, + 0.42612920701503754, + 0.14281639829277992, + 0.34793591126799583, + 0.12283870205283165, + 0.40986981242895126, + 0.8906268589198589, + 0.4357798360288143, + 0.2505149655044079, + 0.5238290689885616, + 0.09399686753749847 + ], + "unique_experts": 57, + "load_cv": 1.146225336680222, + "normalized_load_entropy": 0.8698621096769783, + "max_load_share": 0.08647798742138364 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "aa24823d9b01f094fb42a3d6000e09bd6308d39e4d56ed8232394f7d4f894308", + "route_weight_sha256": "5a268be55f5ea974eacc3eadff17eb9dbf32186763aea428ccd3e2bb42af707a", + "loads": [ + 5, + 61, + 4, + 7, + 3, + 12, + 8, + 36, + 8, + 13, + 7, + 6, + 9, + 13, + 2, + 13, + 5, + 14, + 1, + 5, + 5, + 10, + 36, + 0, + 36, + 12, + 0, + 0, + 13, + 26, + 12, + 16, + 12, + 20, + 20, + 1, + 17, + 45, + 2, + 15, + 14, + 18, + 3, + 31, + 23, + 12, + 8, + 19, + 0, + 3, + 3, + 18, + 22, + 3, + 11, + 11, + 6, + 2, + 11, + 11, + 7, + 6, + 9, + 5 + ], + "weighted_loads": [ + 0.20250430330634117, + 3.519456874579191, + 0.12278185691684484, + 0.5853911079466343, + 0.1438319832086563, + 0.6205242350697517, + 0.6669188141822815, + 2.7095930464565754, + 0.5673615634441376, + 0.6206011436879635, + 0.5696657001972198, + 0.29752535466104746, + 0.4752950817346573, + 0.8697233088314533, + 0.12590930610895157, + 0.7251182720065117, + 0.3237052857875824, + 0.9637354947626591, + 0.05694418400526047, + 0.2713753990828991, + 0.5604281015694141, + 0.5542288087308407, + 2.353291530162096, + 0.0, + 2.6979112569242716, + 0.8334836699068546, + 0.0, + 0.0, + 0.9354188814759254, + 1.9633272551000118, + 0.928486755117774, + 1.5230272226035595, + 0.7268303595483303, + 1.4979848731309175, + 1.1596324630081654, + 0.03289817273616791, + 1.3305867854505777, + 2.5988093074411154, + 0.06946566328406334, + 0.9958281144499779, + 0.7738925348967314, + 0.9582989104092121, + 0.19466665014624596, + 2.0149940960109234, + 1.5070830136537552, + 1.014516431838274, + 0.7363410741090775, + 0.9027468226850033, + 0.0, + 0.17316676303744316, + 0.169997688382864, + 1.2269317097961903, + 1.726844448596239, + 0.24006281793117523, + 1.132426330819726, + 0.6479756645858288, + 0.34793591126799583, + 0.12283870205283165, + 0.5216756425797939, + 0.8906268589198589, + 0.4357798360288143, + 0.2505149655044079, + 0.6114345043897629, + 0.30163972824811935 + ], + "unique_experts": 60, + "load_cv": 0.9323364943139253, + "normalized_load_entropy": 0.9094844426004693, + "max_load_share": 0.07760814249363868 + } + }, + "s1_bos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "8071e13440487387609771822859012f0421a6573fe9970d8433c4f48724e557", + "route_weight_sha256": "e661374091157b5a94c107bd922db374fa984d762353cbf1184cf5ccbb2903d3", + "loads": [ + 4, + 57, + 2, + 6, + 0, + 12, + 3, + 35, + 0, + 12, + 6, + 4, + 2, + 6, + 2, + 11, + 7, + 9, + 1, + 5, + 5, + 10, + 35, + 0, + 36, + 1, + 0, + 0, + 12, + 26, + 9, + 15, + 8, + 3, + 17, + 0, + 20, + 47, + 1, + 9, + 6, + 19, + 3, + 33, + 21, + 5, + 2, + 16, + 0, + 0, + 0, + 19, + 10, + 3, + 7, + 3, + 6, + 2, + 8, + 11, + 7, + 8, + 7, + 2 + ], + "weighted_loads": [ + 0.1674175225198269, + 3.228900048881769, + 0.08413660526275635, + 0.5403053686022758, + 0.0, + 0.6192424893379211, + 0.1838604137301445, + 2.7091346699744463, + 0.0, + 0.5831149891018867, + 0.5082065425813198, + 0.24014881253242493, + 0.09302917867898941, + 0.3787367269396782, + 0.1286197267472744, + 0.640646442770958, + 0.417810283601284, + 0.7081496715545654, + 0.0548427514731884, + 0.27444107830524445, + 0.5643280036747456, + 0.5389402359724045, + 2.3082664236426353, + 0.0, + 2.6673880256712437, + 0.05712953582406044, + 0.0, + 0.0, + 0.8731108345091343, + 1.9098514802753925, + 0.7840849757194519, + 1.450014442205429, + 0.5567416772246361, + 0.1510700136423111, + 1.0318696089088917, + 0.0, + 1.4065200630575418, + 2.736565835773945, + 0.03399493545293808, + 0.7627119794487953, + 0.298944603651762, + 0.9901036620140076, + 0.1927851028740406, + 2.007874833419919, + 1.4227626621723175, + 0.33923501893877983, + 0.09835291281342506, + 0.7733186613768339, + 0.0, + 0.0, + 0.0, + 1.2422460950911045, + 0.7978467494249344, + 0.23533230274915695, + 0.43401292338967323, + 0.14124493300914764, + 0.3423396721482277, + 0.12095776200294495, + 0.4295279234647751, + 0.8898361138999462, + 0.430167019367218, + 0.32896657288074493, + 0.5195386968553066, + 0.08785884827375412 + ], + "unique_experts": 55, + "load_cv": 1.1830421057036502, + "normalized_load_entropy": 0.8625445618468696, + "max_load_share": 0.08962264150943396 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "f53e545cf5f350defeaa20c320c2595462ccc4462114f8aebd484c01cc027536", + "route_weight_sha256": "b8bab4634a1c6d8beb412c073b09670728cd9dcf27bf2a251ad2fe83be80888f", + "loads": [ + 5, + 62, + 12, + 8, + 2, + 13, + 14, + 36, + 13, + 12, + 9, + 7, + 11, + 13, + 2, + 12, + 7, + 24, + 2, + 5, + 5, + 10, + 36, + 4, + 36, + 12, + 0, + 2, + 13, + 26, + 12, + 15, + 11, + 27, + 17, + 0, + 20, + 47, + 7, + 14, + 18, + 19, + 5, + 33, + 21, + 18, + 16, + 19, + 3, + 6, + 5, + 19, + 19, + 9, + 10, + 13, + 6, + 2, + 10, + 12, + 7, + 12, + 10, + 7 + ], + "weighted_loads": [ + 0.20693396404385567, + 3.5085130371153355, + 0.7072491263970733, + 0.6485202722251415, + 0.0996086560189724, + 0.6637615859508514, + 1.165040671825409, + 2.7440729830414057, + 0.8766919113695621, + 0.5831149891018867, + 0.6634925566613674, + 0.35654656309634447, + 0.6298214197158813, + 0.8567377217113972, + 0.1286197267472744, + 0.681500755250454, + 0.417810283601284, + 1.7239635065197945, + 0.10168492048978806, + 0.27444107830524445, + 0.5643280036747456, + 0.5389402359724045, + 2.3474838957190514, + 0.18764951638877392, + 2.6673880256712437, + 1.1699504181742668, + 0.0, + 0.11914309486746788, + 0.914781428873539, + 1.9098514802753925, + 0.8954151701182127, + 1.450014442205429, + 0.6659161038696766, + 1.8317458983510733, + 1.0318696089088917, + 0.0, + 1.4065200630575418, + 2.736565835773945, + 0.4278443939983845, + 0.9291770067065954, + 0.9094037041068077, + 0.9901036620140076, + 0.3609221987426281, + 2.007874833419919, + 1.4227626621723175, + 1.5915294326841831, + 1.103323582559824, + 0.8786690626293421, + 0.32165708392858505, + 0.3809460252523422, + 0.2548299878835678, + 1.2422460950911045, + 1.4942505694925785, + 0.9191992282867432, + 1.1024913266301155, + 0.8392141237854958, + 0.3423396721482277, + 0.12095776200294495, + 0.5287644825875759, + 0.9230446331202984, + 0.430167019367218, + 0.5175222456455231, + 0.6622111834585667, + 0.37807217985391617 + ], + "unique_experts": 62, + "load_cv": 0.8192910394311834, + "normalized_load_entropy": 0.9301305249315823, + "max_load_share": 0.07029478458049887 + } + }, + "s0_x": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "d64f0da2ae00c90d1fee5335f1284f00671f7df62ca146cc20ce5accb65b718b", + "route_weight_sha256": "18356a9357689fd5b7de408b43da063cb132307f68aafed52d5e7851a1d8195b", + "loads": [ + 4, + 54, + 2, + 6, + 0, + 12, + 2, + 35, + 0, + 12, + 6, + 5, + 2, + 5, + 2, + 12, + 8, + 9, + 1, + 5, + 5, + 10, + 36, + 0, + 35, + 1, + 0, + 2, + 13, + 26, + 9, + 16, + 8, + 5, + 20, + 0, + 18, + 45, + 3, + 9, + 6, + 17, + 3, + 32, + 21, + 5, + 2, + 15, + 0, + 0, + 0, + 19, + 9, + 3, + 6, + 3, + 6, + 2, + 9, + 11, + 7, + 8, + 7, + 2 + ], + "weighted_loads": [ + 0.16190028563141823, + 3.0792898274958134, + 0.08568740263581276, + 0.5367517918348312, + 0.0, + 0.6089855022728443, + 0.14338227361440659, + 2.6592529602348804, + 0.0, + 0.5962074734270573, + 0.502685409039259, + 0.2695576027035713, + 0.09114363044500351, + 0.3243675269186497, + 0.11246147006750107, + 0.6837003901600838, + 0.4293903075158596, + 0.7299325950443745, + 0.05823974683880806, + 0.27070780470967293, + 0.5605907514691353, + 0.5472834222018719, + 2.3294425942003727, + 0.0, + 2.7031210474669933, + 0.053176380693912506, + 0.0, + 0.06475205905735493, + 0.9115360081195831, + 1.9492588974535465, + 0.8063349239528179, + 1.508633978664875, + 0.5584261007606983, + 0.22196673229336739, + 1.1430517919361591, + 0.0, + 1.3310234062373638, + 2.6044574212282896, + 0.10135249048471451, + 0.7858166433870792, + 0.3209371343255043, + 0.8953093066811562, + 0.19295009598135948, + 2.0146051812916994, + 1.4300692938268185, + 0.35892166942358017, + 0.10978936403989792, + 0.7344936523586512, + 0.0, + 0.0, + 0.0, + 1.2646192200481892, + 0.7491658516228199, + 0.23839940503239632, + 0.37012626975774765, + 0.14460882171988487, + 0.35440394654870033, + 0.12196213006973267, + 0.4532304219901562, + 0.8808084651827812, + 0.43802130222320557, + 0.32817989587783813, + 0.5120207853615284, + 0.08170144632458687 + ], + "unique_experts": 56, + "load_cv": 1.1456730553403973, + "normalized_load_entropy": 0.8696456279979754, + "max_load_share": 0.08490566037735849 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "c132b4e461bd360da8615b54cfd65282c39d9bc4a739f8a1edbf4956b840fd8f", + "route_weight_sha256": "d0dd68516199a6a0c7c3e00a63bfcb0265c79997c3fc7831f8988710aa928cf6", + "loads": [ + 4, + 61, + 5, + 7, + 2, + 12, + 8, + 36, + 9, + 12, + 7, + 7, + 9, + 13, + 2, + 12, + 8, + 12, + 1, + 5, + 5, + 10, + 38, + 0, + 35, + 13, + 0, + 2, + 13, + 26, + 11, + 16, + 13, + 20, + 20, + 0, + 18, + 45, + 3, + 14, + 12, + 17, + 3, + 32, + 21, + 11, + 8, + 18, + 0, + 4, + 4, + 19, + 21, + 3, + 8, + 11, + 6, + 2, + 12, + 11, + 7, + 8, + 9, + 5 + ], + "weighted_loads": [ + 0.16190028563141823, + 3.502186046913266, + 0.16711513232439756, + 0.5847106501460075, + 0.10662544891238213, + 0.6089855022728443, + 0.6609515994787216, + 2.7049498446285725, + 0.6284937560558319, + 0.5962074734270573, + 0.563504733145237, + 0.334452916868031, + 0.4722895659506321, + 0.9049894958734512, + 0.11246147006750107, + 0.6837003901600838, + 0.4293903075158596, + 0.8625324331223965, + 0.05823974683880806, + 0.27070780470967293, + 0.5605907514691353, + 0.5472834222018719, + 2.4037399254739285, + 0.0, + 2.7031210474669933, + 0.9250681214034557, + 0.0, + 0.06475205905735493, + 0.9115360081195831, + 1.9492588974535465, + 0.8662943411618471, + 1.508633978664875, + 0.7708101980388165, + 1.3764681983739138, + 1.1430517919361591, + 0.0, + 1.3310234062373638, + 2.6044574212282896, + 0.10135249048471451, + 0.9524827897548676, + 0.682691428810358, + 0.8953093066811562, + 0.19295009598135948, + 2.0146051812916994, + 1.4300692938268185, + 0.9709783233702183, + 0.7386329062283039, + 0.846906678751111, + 0.0, + 0.23150409758090973, + 0.22369014099240303, + 1.2646192200481892, + 1.590553019195795, + 0.23839940503239632, + 0.9937464725226164, + 0.6482663489878178, + 0.35440394654870033, + 0.12196213006973267, + 0.5650362521409988, + 0.8808084651827812, + 0.43802130222320557, + 0.32817989587783813, + 0.5912055894732475, + 0.28934430703520775 + ], + "unique_experts": 60, + "load_cv": 0.9273229602630871, + "normalized_load_entropy": 0.9118986829140502, + "max_load_share": 0.07760814249363868 + } + }, + "s1_x": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "e046980a7d25fdc31f1a03a14202b92b9bfc7cd5d738888c6be2676bebb559ae", + "route_weight_sha256": "cd590d91c80d0a8ccc1f3aa492d12d5a2a090446fb0550ec69ed2dbbefd98b4d", + "loads": [ + 3, + 55, + 2, + 6, + 0, + 11, + 3, + 36, + 0, + 13, + 6, + 4, + 2, + 5, + 2, + 11, + 9, + 9, + 2, + 5, + 5, + 9, + 36, + 0, + 36, + 1, + 1, + 0, + 12, + 26, + 9, + 16, + 8, + 4, + 17, + 0, + 17, + 46, + 1, + 9, + 7, + 17, + 3, + 32, + 23, + 5, + 2, + 15, + 0, + 0, + 0, + 18, + 10, + 3, + 8, + 4, + 6, + 2, + 9, + 11, + 7, + 8, + 7, + 2 + ], + "weighted_loads": [ + 0.1234465166926384, + 3.075431253761053, + 0.08489060774445534, + 0.5479437708854675, + 0.0, + 0.5868779700249434, + 0.18336642906069756, + 2.7603314705193043, + 0.0, + 0.6218588724732399, + 0.5117980465292931, + 0.24404654651880264, + 0.09290587902069092, + 0.33630798384547234, + 0.12560578808188438, + 0.6349210515618324, + 0.4753500074148178, + 0.6936410181224346, + 0.08836749568581581, + 0.27981600910425186, + 0.561066310852766, + 0.48296114057302475, + 2.3505486734211445, + 0.0, + 2.700254064053297, + 0.059756774455308914, + 0.028123611584305763, + 0.0, + 0.8541862294077873, + 1.9128810297697783, + 0.7795124091207981, + 1.4844938293099403, + 0.5690875202417374, + 0.17160318046808243, + 1.0076462551951408, + 0.0, + 1.2633098252117634, + 2.665533473715186, + 0.035799961537122726, + 0.7734968662261963, + 0.3484932370483875, + 0.9129896350204945, + 0.19681206345558167, + 1.9546444024890661, + 1.4599259085953236, + 0.34763041138648987, + 0.10594551265239716, + 0.732733428478241, + 0.0, + 0.0, + 0.0, + 1.1719735451042652, + 0.7633792422711849, + 0.2295178920030594, + 0.44709023274481297, + 0.18277639895677567, + 0.3448810949921608, + 0.11972073838114738, + 0.4738977290689945, + 0.882502369582653, + 0.414418775588274, + 0.33163826540112495, + 0.5241759046912193, + 0.08463893458247185 + ], + "unique_experts": 56, + "load_cv": 1.1619911738025108, + "normalized_load_entropy": 0.867291253298977, + "max_load_share": 0.08647798742138364 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "5f491237afbac26d7afc0dc65e6ac2cd233900cbcf3e08c65bc7b49911614a07", + "route_weight_sha256": "9ed9b96f738a5a57ef6675cb993e825764d9ef8792198c44e450ec5b36d55e13", + "loads": [ + 4, + 61, + 13, + 8, + 1, + 12, + 15, + 37, + 13, + 13, + 10, + 8, + 11, + 14, + 2, + 11, + 10, + 23, + 4, + 5, + 5, + 9, + 37, + 4, + 36, + 14, + 1, + 2, + 13, + 26, + 11, + 16, + 12, + 25, + 17, + 0, + 17, + 46, + 7, + 13, + 19, + 17, + 5, + 32, + 23, + 17, + 16, + 18, + 3, + 6, + 6, + 18, + 19, + 9, + 10, + 12, + 6, + 2, + 11, + 12, + 7, + 12, + 9, + 7 + ], + "weighted_loads": [ + 0.16296295821666718, + 3.3999098874628544, + 0.7454493036493659, + 0.6544289812445641, + 0.054176315665245056, + 0.6313970666378736, + 1.1833062432706356, + 2.7952697835862637, + 0.8815451040863991, + 0.6218588724732399, + 0.7199978530406952, + 0.39855530206114054, + 0.6296981200575829, + 0.9454187415540218, + 0.12560578808188438, + 0.6349210515618324, + 0.5093805678188801, + 1.6529480442404747, + 0.1694321669638157, + 0.27981600910425186, + 0.561066310852766, + 0.48296114057302475, + 2.3897661454975605, + 0.18764951638877392, + 2.700254064053297, + 1.341163944453001, + 0.028123611584305763, + 0.11914309486746788, + 0.895856823772192, + 1.9128810297697783, + 0.8424265626817942, + 1.4844938293099403, + 0.7200531922280788, + 1.5520151685923338, + 1.0076462551951408, + 0.0, + 1.2633098252117634, + 2.665533473715186, + 0.4296494200825691, + 0.9026289936155081, + 0.9068866521120071, + 0.9129896350204945, + 0.36494915932416916, + 1.9546444024890661, + 1.4599259085953236, + 1.5123157650232315, + 1.075940378010273, + 0.8380838297307491, + 0.32165708392858505, + 0.3846045434474945, + 0.32662878185510635, + 1.1719735451042652, + 1.4231200516223907, + 0.9133848175406456, + 1.0705770682543516, + 0.7458745948970318, + 0.3448810949921608, + 0.11972073838114738, + 0.5731342881917953, + 0.9157108888030052, + 0.414418775588274, + 0.5201939381659031, + 0.6244383417069912, + 0.3748522661626339 + ], + "unique_experts": 63, + "load_cv": 0.8049056199382258, + "normalized_load_entropy": 0.9329800691722219, + "max_load_share": 0.0691609977324263 + } + }, + "s0_period": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "cddc71f6c4bdca849d7e9885f49f42ba4460b9896f6c93efa0b27988383584db", + "route_weight_sha256": "4b9b034abf7bfbd6c00455d59fd98cfc7ed7861e582081f6e00b4127c3631923", + "loads": [ + 4, + 53, + 2, + 6, + 0, + 12, + 3, + 34, + 0, + 12, + 6, + 5, + 2, + 5, + 2, + 12, + 7, + 9, + 2, + 5, + 5, + 10, + 36, + 0, + 35, + 1, + 0, + 1, + 13, + 26, + 9, + 16, + 8, + 5, + 19, + 1, + 18, + 46, + 2, + 9, + 6, + 17, + 3, + 33, + 22, + 5, + 2, + 16, + 0, + 0, + 0, + 18, + 8, + 3, + 7, + 4, + 6, + 2, + 9, + 10, + 7, + 8, + 7, + 2 + ], + "weighted_loads": [ + 0.16412734612822533, + 3.0029879920184612, + 0.08379299938678741, + 0.5379503890872002, + 0.0, + 0.6090687587857246, + 0.1887248456478119, + 2.607543036341667, + 0.0, + 0.5925633423030376, + 0.5030600652098656, + 0.26275456324219704, + 0.09478826448321342, + 0.3225044570863247, + 0.11860876530408859, + 0.6782878637313843, + 0.40412432700395584, + 0.7388332784175873, + 0.08846623823046684, + 0.2722563296556473, + 0.5533172152936459, + 0.5474053546786308, + 2.324786063283682, + 0.0, + 2.6649301182478666, + 0.05290781334042549, + 0.0, + 0.033461056649684906, + 0.9051708467304707, + 1.9689856618642807, + 0.7977445535361767, + 1.5126036778092384, + 0.555241983383894, + 0.22125961631536484, + 1.0969525277614594, + 0.03460604324936867, + 1.3385189566761255, + 2.621234767138958, + 0.06834018230438232, + 0.764638427644968, + 0.31996608152985573, + 0.8977117203176022, + 0.19667503610253334, + 2.070920968428254, + 1.4806892648339272, + 0.3574201874434948, + 0.10072121396660805, + 0.7728704884648323, + 0.0, + 0.0, + 0.0, + 1.2209036312997341, + 0.7041782028973103, + 0.2368050180375576, + 0.4065822809934616, + 0.18124323710799217, + 0.34917686879634857, + 0.11985157057642937, + 0.460451602935791, + 0.8449708856642246, + 0.4361361972987652, + 0.3304590433835983, + 0.5127265155315399, + 0.09057439118623734 + ], + "unique_experts": 57, + "load_cv": 1.1419381699150197, + "normalized_load_entropy": 0.8714170561882196, + "max_load_share": 0.08333333333333333 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "f84155dddf7ad06031e2c4be265da8cf8b16ca4db19ec18b886e5af3d38a675e", + "route_weight_sha256": "a4aa95728de44f55371a7e038c81c5f74b16ccf24adf28d675b6879a18b0a05d", + "loads": [ + 4, + 59, + 4, + 7, + 2, + 12, + 11, + 35, + 8, + 12, + 8, + 7, + 9, + 13, + 2, + 12, + 7, + 12, + 2, + 5, + 5, + 10, + 38, + 0, + 35, + 13, + 0, + 1, + 13, + 26, + 11, + 16, + 12, + 20, + 19, + 1, + 18, + 46, + 2, + 15, + 11, + 17, + 3, + 33, + 22, + 11, + 9, + 19, + 0, + 5, + 3, + 18, + 20, + 3, + 9, + 12, + 6, + 2, + 12, + 10, + 7, + 8, + 8, + 6 + ], + "weighted_loads": [ + 0.16412734612822533, + 3.37322841770947, + 0.12291694711893797, + 0.5897299610078335, + 0.11028328165411949, + 0.6090687587857246, + 0.8498051427304745, + 2.653239920735359, + 0.6540372371673584, + 0.5925633423030376, + 0.6128563210368156, + 0.32764987740665674, + 0.475934199988842, + 0.8528460822999477, + 0.11860876530408859, + 0.6782878637313843, + 0.40412432700395584, + 0.8695802763104439, + 0.08846623823046684, + 0.2722563296556473, + 0.5533172152936459, + 0.5474053546786308, + 2.3990833945572376, + 0.0, + 2.6649301182478666, + 0.9133962467312813, + 0.0, + 0.033461056649684906, + 0.9051708467304707, + 1.9689856618642807, + 0.8580012675374746, + 1.5126036778092384, + 0.7243364825844765, + 1.373115198686719, + 1.0969525277614594, + 0.03460604324936867, + 1.3385189566761255, + 2.621234767138958, + 0.06834018230438232, + 0.9660468064248562, + 0.6378040723502636, + 0.8977117203176022, + 0.19667503610253334, + 2.070920968428254, + 1.4806892648339272, + 0.9529878459870815, + 0.8136328905820847, + 0.8852835148572922, + 0.0, + 0.26435045525431633, + 0.169997688382864, + 1.2209036312997341, + 1.542153362184763, + 0.2368050180375576, + 1.0302024837583303, + 0.6726261414587498, + 0.34917686879634857, + 0.11985157057642937, + 0.5722574330866337, + 0.8449708856642246, + 0.4361361972987652, + 0.3304590433835983, + 0.5587583258748055, + 0.42228613793849945 + ], + "unique_experts": 61, + "load_cv": 0.9187935429139239, + "normalized_load_entropy": 0.91321368286519, + "max_load_share": 0.07506361323155217 + } + }, + "s1_period": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "77107b94fbba5f017c3548bc1460026e3c2f38e9889d0a7b1336ec5005491e39", + "route_weight_sha256": "9c00373a600fa867cd0acf26b35dae22c13d62363795f893ce3cc5e46fd7d2a4", + "loads": [ + 4, + 55, + 2, + 6, + 0, + 12, + 3, + 33, + 0, + 12, + 6, + 5, + 2, + 6, + 2, + 11, + 8, + 9, + 2, + 5, + 5, + 10, + 35, + 0, + 36, + 1, + 2, + 0, + 12, + 25, + 9, + 16, + 8, + 5, + 17, + 1, + 19, + 47, + 1, + 9, + 6, + 17, + 3, + 32, + 22, + 5, + 2, + 14, + 0, + 0, + 0, + 19, + 10, + 3, + 7, + 4, + 6, + 2, + 8, + 11, + 7, + 8, + 7, + 2 + ], + "weighted_loads": [ + 0.16053762659430504, + 3.067081969231367, + 0.08380267396569252, + 0.552061028778553, + 0.0, + 0.6035013031214476, + 0.1853078342974186, + 2.615355681627989, + 0.0, + 0.5834593437612057, + 0.5146403387188911, + 0.2883664406836033, + 0.09457037970423698, + 0.3829435743391514, + 0.12882351875305176, + 0.6408059783279896, + 0.45872874557971954, + 0.694996539503336, + 0.08616331219673157, + 0.27961917594075203, + 0.5636203177273273, + 0.5229188576340675, + 2.313864056020975, + 0.0, + 2.697077129036188, + 0.063788503408432, + 0.058860668912529945, + 0.0, + 0.855864629149437, + 1.8708140812814236, + 0.7650143653154373, + 1.4968017973005772, + 0.5686369650065899, + 0.20011991262435913, + 1.0058358944952488, + 0.036788973957300186, + 1.3487266041338444, + 2.708173468708992, + 0.03617013990879059, + 0.7383790761232376, + 0.3008888140320778, + 0.9172150827944279, + 0.19815553352236748, + 1.968262841925025, + 1.4317564219236374, + 0.3376770503818989, + 0.09571538493037224, + 0.6797978710383177, + 0.0, + 0.0, + 0.0, + 1.2185526378452778, + 0.7579226791858673, + 0.23282244428992271, + 0.4129750691354275, + 0.18497147038578987, + 0.3423054479062557, + 0.11910359561443329, + 0.43532707542181015, + 0.8793462663888931, + 0.42492642626166344, + 0.3336359113454819, + 0.5219946317374706, + 0.08612887188792229 + ], + "unique_experts": 57, + "load_cv": 1.1478805863815926, + "normalized_load_entropy": 0.8715762999191733, + "max_load_share": 0.08647798742138364 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "1d62d932b714b620cbb8c4f297fb1c1da88eae054e113c3fcd07b56dfccc4437", + "route_weight_sha256": "ed445b97581d2d85ab98211209d8c2213be50ff158f2cef43eae4f293cc8a038", + "loads": [ + 5, + 60, + 12, + 8, + 1, + 13, + 16, + 34, + 13, + 12, + 10, + 8, + 11, + 13, + 2, + 11, + 9, + 24, + 4, + 5, + 5, + 10, + 36, + 4, + 36, + 14, + 2, + 2, + 13, + 25, + 11, + 16, + 11, + 26, + 17, + 1, + 19, + 47, + 7, + 13, + 18, + 17, + 5, + 32, + 22, + 16, + 17, + 17, + 3, + 8, + 5, + 19, + 19, + 9, + 9, + 13, + 6, + 2, + 10, + 12, + 7, + 12, + 10, + 8 + ], + "weighted_loads": [ + 0.20005406811833382, + 3.3466949574649334, + 0.7069151951000094, + 0.6655059233307838, + 0.053235698491334915, + 0.6480203997343779, + 1.2785532847046852, + 2.650293994694948, + 0.9117957018315792, + 0.5834593437612057, + 0.7324918508529663, + 0.40476419124752283, + 0.6313626207411289, + 0.8534614071249962, + 0.12882351875305176, + 0.6408059783279896, + 0.494767002761364, + 1.7172827795147896, + 0.1681809015572071, + 0.27961917594075203, + 0.5636203177273273, + 0.5229188576340675, + 2.353081528097391, + 0.18764951638877392, + 2.697077129036188, + 1.300068948417902, + 0.058860668912529945, + 0.11914309486746788, + 0.8975352235138416, + 1.8708140812814236, + 0.8257686365395784, + 1.4968017973005772, + 0.6778113916516304, + 1.5765032190829515, + 1.0058358944952488, + 0.036788973957300186, + 1.3487266041338444, + 2.708173468708992, + 0.430019598454237, + 0.8647612500935793, + 0.8658681511878967, + 0.9172150827944279, + 0.36629262939095497, + 1.968262841925025, + 1.4317564219236374, + 1.4567430019378662, + 1.2001888081431389, + 0.7851482722908258, + 0.32165708392858505, + 0.48581448569893837, + 0.2548299878835678, + 1.2185526378452778, + 1.4144478924572468, + 0.9166893698275089, + 1.0364619046449661, + 0.7949016019701958, + 0.3423054479062557, + 0.11910359561443329, + 0.534563634544611, + 0.9125547856092453, + 0.42492642626166344, + 0.52219158411026, + 0.6557305604219437, + 0.45208312943577766 + ], + "unique_experts": 64, + "load_cv": 0.7909867825626158, + "normalized_load_entropy": 0.9360273374846931, + "max_load_share": 0.06802721088435375 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 106, + "ordered_topk_exact_tokens": 81, + "set_exact_tokens": 89, + "mean_set_jaccard": 0.9521563342318061, + "mean_token_weighted_tv": 0.010383088537052556, + "aggregate_load_tv": 0.017295597484276733 + }, + "system_bos": { + "tokens": 106, + "ordered_topk_exact_tokens": 68, + "set_exact_tokens": 84, + "mean_set_jaccard": 0.9366576819407009, + "mean_token_weighted_tv": 0.015899788509210887, + "aggregate_load_tv": 0.026729559748427667 + }, + "system_x": { + "tokens": 106, + "ordered_topk_exact_tokens": 57, + "set_exact_tokens": 77, + "mean_set_jaccard": 0.9198113207547169, + "mean_token_weighted_tv": 0.018999031358310638, + "aggregate_load_tv": 0.02515723270440251 + }, + "system_period": { + "tokens": 106, + "ordered_topk_exact_tokens": 58, + "set_exact_tokens": 80, + "mean_set_jaccard": 0.9278975741239892, + "mean_token_weighted_tv": 0.018089988875150117, + "aggregate_load_tv": 0.02044025157232704 + }, + "bos_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 66, + "set_exact_tokens": 79, + "mean_set_jaccard": 0.925202156334232, + "mean_token_weighted_tv": 0.017346901599458366, + "aggregate_load_tv": 0.02987421383647798 + }, + "bos_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 62, + "set_exact_tokens": 78, + "mean_set_jaccard": 0.9204851752021564, + "mean_token_weighted_tv": 0.019050630837468045, + "aggregate_load_tv": 0.029874213836477984 + }, + "x_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 59, + "set_exact_tokens": 74, + "mean_set_jaccard": 0.9117250673854447, + "mean_token_weighted_tv": 0.020047437557774894, + "aggregate_load_tv": 0.029874213836477988 + }, + "x_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 51, + "set_exact_tokens": 72, + "mean_set_jaccard": 0.9043126684636119, + "mean_token_weighted_tv": 0.023581674190694995, + "aggregate_load_tv": 0.029874213836477984 + }, + "period_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 61, + "set_exact_tokens": 75, + "mean_set_jaccard": 0.9144204851752024, + "mean_token_weighted_tv": 0.019224314379312518, + "aggregate_load_tv": 0.033018867924528295 + }, + "period_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 57, + "set_exact_tokens": 76, + "mean_set_jaccard": 0.9171159029649596, + "mean_token_weighted_tv": 0.021965619255700765, + "aggregate_load_tv": 0.029874213836477988 + } + } + }, + "layer_09": { + "layer": 9, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "a42a4c864a2d92544d094a78acd6122d869610f379041107839560dbd5f206e5", + "route_weight_sha256": "5fbcfca4e175fc526a36cb02005aecbbd88ae60bcb7add1a6c19d1535e14fe7e", + "loads": [ + 10, + 5, + 6, + 23, + 12, + 11, + 6, + 8, + 0, + 4, + 1, + 19, + 10, + 9, + 1, + 2, + 11, + 12, + 5, + 3, + 2, + 20, + 5, + 3, + 2, + 8, + 3, + 24, + 24, + 1, + 25, + 5, + 8, + 0, + 14, + 4, + 27, + 19, + 0, + 10, + 10, + 1, + 12, + 13, + 11, + 1, + 3, + 22, + 5, + 7, + 10, + 28, + 10, + 0, + 11, + 1, + 48, + 25, + 5, + 5, + 22, + 7, + 11, + 6 + ], + "weighted_loads": [ + 0.5057369992136955, + 0.3860093764960766, + 0.36288806051015854, + 1.2421430926769972, + 0.7367789074778557, + 0.9636108316481113, + 0.27189142629504204, + 0.4081961214542389, + 0.0, + 0.20878968015313148, + 0.04328217729926109, + 1.1340590044856071, + 1.042642230167985, + 1.1053102277219296, + 0.04535449668765068, + 0.10452199727296829, + 0.8663734346628189, + 0.44998660311102867, + 0.28503064066171646, + 0.19801577925682068, + 0.13897626474499702, + 1.4035865515470505, + 0.2559230327606201, + 0.11453557386994362, + 0.07983461394906044, + 0.34126151353120804, + 0.10671282559633255, + 1.3241414576768875, + 2.4831264950335026, + 0.03655720502138138, + 1.465245932340622, + 0.24277235195040703, + 0.43620731867849827, + 0.0, + 1.2617293670773506, + 0.2937455251812935, + 2.408131182193756, + 1.540141535922885, + 0.0, + 0.5743346810340881, + 0.693728219717741, + 0.05457477271556854, + 0.6477046497166157, + 0.6692506410181522, + 0.5330536998808384, + 0.04178019240498543, + 0.20771102979779243, + 1.4563649035990238, + 0.3977513089776039, + 0.29944036342203617, + 0.7664716430008411, + 2.072507742792368, + 0.6912101469933987, + 0.0, + 0.5403048731386662, + 0.05412149056792259, + 3.874270796775818, + 1.5875719375908375, + 0.47774767875671387, + 0.19762949645519257, + 1.5191163048148155, + 0.39841626584529877, + 0.608181219547987, + 0.34148746728897095 + ], + "unique_experts": 60, + "load_cv": 0.9122532567819724, + "normalized_load_entropy": 0.9074526503552216, + "max_load_share": 0.07547169811320754 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "3c0ddb98b96235d489cc9d023e1373c0d9e9a27d5be241075720500e4bd71ed4", + "route_weight_sha256": "14f6fa6ac1dbe11703ad605aa5fc25b695a37edfdddc1e27b49fd0eb8f976965", + "loads": [ + 17, + 8, + 6, + 23, + 14, + 11, + 6, + 8, + 2, + 4, + 12, + 19, + 13, + 13, + 1, + 2, + 12, + 13, + 5, + 12, + 2, + 20, + 10, + 7, + 6, + 10, + 3, + 25, + 24, + 1, + 27, + 11, + 9, + 0, + 23, + 11, + 27, + 19, + 3, + 10, + 10, + 10, + 12, + 13, + 16, + 9, + 14, + 22, + 8, + 7, + 15, + 29, + 10, + 3, + 11, + 6, + 52, + 25, + 7, + 9, + 22, + 7, + 13, + 7 + ], + "weighted_loads": [ + 1.0374720804393291, + 0.6247099973261356, + 0.36288806051015854, + 1.2421430926769972, + 0.9628274068236351, + 0.9636108316481113, + 0.27189142629504204, + 0.4081961214542389, + 0.09500579535961151, + 0.20878968015313148, + 1.2129287086427212, + 1.1340590044856071, + 1.0960279353894293, + 1.2053472101688385, + 0.04535449668765068, + 0.10452199727296829, + 0.9074934348464012, + 0.49259695783257484, + 0.28503064066171646, + 1.062452644109726, + 0.13897626474499702, + 1.4035865515470505, + 1.8325368221849203, + 0.4709226116538048, + 0.24544008821249008, + 0.5184507519006729, + 0.10671282559633255, + 1.3371393689885736, + 2.4831264950335026, + 0.03655720502138138, + 1.565021924674511, + 0.4313891031779349, + 0.4399422805290669, + 0.0, + 1.7526521142572165, + 0.7662447318434715, + 2.408131182193756, + 1.540141535922885, + 0.12471703067421913, + 0.5743346810340881, + 0.693728219717741, + 0.9789061099290848, + 0.6477046497166157, + 0.6692506410181522, + 0.8491130960173905, + 0.7352306768298149, + 1.1159100942313671, + 1.4563649035990238, + 0.6152961514890194, + 0.29944036342203617, + 1.0348208919167519, + 2.106613915413618, + 0.6912101469933987, + 0.11954950354993343, + 0.5403048731386662, + 0.28752170875668526, + 4.080196246504784, + 1.5875719375908375, + 0.6286587230861187, + 0.3727867901325226, + 1.5191163048148155, + 0.39841626584529877, + 0.6640434619039297, + 0.3777092285454273 + ], + "unique_experts": 63, + "load_cv": 0.7122455122744298, + "normalized_load_entropy": 0.9438082661903796, + "max_load_share": 0.06615776081424936 + } + }, + "s1_eos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "9cbc698b2afca68accb9d2bade7296ccb3ef5a987fbfdc6d06a8b2fa1a54a90e", + "route_weight_sha256": "466c0ab51128e41c238aab1df6754dd1f99a29498b251dbe44a36d9cd9c71435", + "loads": [ + 9, + 5, + 8, + 24, + 12, + 11, + 5, + 7, + 0, + 4, + 1, + 19, + 10, + 9, + 1, + 2, + 11, + 12, + 5, + 3, + 2, + 20, + 7, + 3, + 2, + 5, + 3, + 25, + 24, + 1, + 24, + 5, + 7, + 0, + 15, + 4, + 26, + 19, + 0, + 10, + 11, + 2, + 12, + 11, + 11, + 1, + 3, + 22, + 5, + 7, + 10, + 28, + 10, + 0, + 11, + 1, + 49, + 25, + 5, + 5, + 23, + 7, + 11, + 6 + ], + "weighted_loads": [ + 0.46173403039574623, + 0.38072769716382027, + 0.4597684033215046, + 1.2670935615897179, + 0.7459978498518467, + 0.9766949787735939, + 0.23422508127987385, + 0.36330052092671394, + 0.0, + 0.20992263033986092, + 0.04292873665690422, + 1.144822783768177, + 1.0368068013340235, + 1.082472313195467, + 0.047545526176691055, + 0.10256612673401833, + 0.8754943013191223, + 0.46381075493991375, + 0.2860499359667301, + 0.19388244301080704, + 0.13103849813342094, + 1.3886007405817509, + 0.339109905064106, + 0.11097655072808266, + 0.08071146160364151, + 0.22499792650341988, + 0.10371185652911663, + 1.3581450562924147, + 2.498722217977047, + 0.03672603890299797, + 1.4087239690124989, + 0.24367541074752808, + 0.3946903795003891, + 0.0, + 1.285320244729519, + 0.2909183166921139, + 2.3560790978372097, + 1.5360869616270065, + 0.0, + 0.5779263749718666, + 0.7316639460623264, + 0.09310483187437057, + 0.6423497200012207, + 0.5912929102778435, + 0.5457807295024395, + 0.04260780289769173, + 0.23007646575570107, + 1.4556967616081238, + 0.39952346682548523, + 0.29558481462299824, + 0.749963253736496, + 2.0716629959642887, + 0.7028393223881721, + 0.0, + 0.5342457592487335, + 0.06931526213884354, + 3.878963988274336, + 1.5953241437673569, + 0.4770282953977585, + 0.19647375866770744, + 1.5534518957138062, + 0.3832610212266445, + 0.602484755218029, + 0.35024867579340935 + ], + "unique_experts": 60, + "load_cv": 0.9203688575277232, + "normalized_load_entropy": 0.9069963785807705, + "max_load_share": 0.0770440251572327 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "2fe0cfe0e042797439de4c48312460ad9b96a6756a25b2a2c6fe31e9d57a22e5", + "route_weight_sha256": "dcb7c96b28b830e058be12fb0ee58e6ddafba9e0d145136cb2ab4bac17ecc9bf", + "loads": [ + 20, + 10, + 8, + 24, + 14, + 11, + 5, + 7, + 7, + 6, + 12, + 21, + 13, + 13, + 2, + 2, + 12, + 13, + 5, + 12, + 2, + 23, + 12, + 15, + 7, + 14, + 7, + 26, + 30, + 1, + 27, + 10, + 8, + 3, + 21, + 16, + 26, + 22, + 5, + 11, + 17, + 16, + 14, + 11, + 17, + 14, + 23, + 22, + 12, + 12, + 13, + 29, + 10, + 3, + 12, + 5, + 54, + 25, + 10, + 9, + 23, + 8, + 13, + 7 + ], + "weighted_loads": [ + 1.2258616350591183, + 0.7058941572904587, + 0.4597684033215046, + 1.2670935615897179, + 0.9942476339638233, + 0.9766949787735939, + 0.23422508127987385, + 0.36330052092671394, + 0.42149077728390694, + 0.301060251891613, + 1.122627142816782, + 1.241539642214775, + 1.0914431661367416, + 1.1704938760958612, + 0.08730733767151833, + 0.10256612673401833, + 0.9213511906564236, + 0.5196070168167353, + 0.2860499359667301, + 1.1471124701201916, + 0.13103849813342094, + 1.514803871512413, + 1.9155209884047508, + 1.0600487515330315, + 0.2687183581292629, + 0.7523876875638962, + 0.35772685892879963, + 1.3711429676041007, + 2.925231173634529, + 0.03672603890299797, + 1.6191283129155636, + 0.39178167888894677, + 0.3982963804155588, + 0.2217627316713333, + 1.58824167214334, + 1.0907549671828747, + 2.3560790978372097, + 1.6788054816424847, + 0.2396739460527897, + 0.6449103727936745, + 1.1312436312437057, + 1.5275064706802368, + 0.7342940382659435, + 0.5912929102778435, + 0.762383152730763, + 1.1573470830917358, + 1.9688591919839382, + 1.4556967616081238, + 0.8568210154771805, + 0.6246945913881063, + 0.9319092966616154, + 2.105033800005913, + 0.7028393223881721, + 0.1482066996395588, + 0.5748501047492027, + 0.2608998827636242, + 4.112158138304949, + 1.5953241437673569, + 0.7897010818123817, + 0.3823169767856598, + 1.5534518957138062, + 0.4208161234855652, + 0.7601465359330177, + 0.38623474165797234 + ], + "unique_experts": 64, + "load_cv": 0.6427081535989227, + "normalized_load_entropy": 0.95413099397554, + "max_load_share": 0.061224489795918366 + } + }, + "s0_bos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "af46e483e6edc2d65fa64a583e4fd0e967469b4c1b72e66a646c6291ae63d9da", + "route_weight_sha256": "32aa3f256d5d333a59c207a12c127b9b3b83f4950261b8b062886d53bc4ed40d", + "loads": [ + 11, + 5, + 6, + 23, + 12, + 12, + 4, + 8, + 0, + 4, + 1, + 19, + 11, + 9, + 1, + 2, + 11, + 11, + 6, + 3, + 2, + 22, + 4, + 3, + 2, + 4, + 2, + 23, + 24, + 1, + 23, + 4, + 6, + 0, + 15, + 4, + 27, + 20, + 0, + 9, + 10, + 1, + 15, + 10, + 11, + 1, + 3, + 20, + 5, + 6, + 10, + 28, + 10, + 0, + 14, + 0, + 48, + 28, + 5, + 5, + 24, + 7, + 14, + 7 + ], + "weighted_loads": [ + 0.5315876863896847, + 0.3863951787352562, + 0.39981235936284065, + 1.2639016546308994, + 0.7206497602164745, + 1.0302265547215939, + 0.20730305835604668, + 0.41121185570955276, + 0.0, + 0.20897247083485126, + 0.041031889617443085, + 1.1270999871194363, + 1.0606616027653217, + 1.1092142425477505, + 0.04256204143166542, + 0.10673791542649269, + 0.8632359206676483, + 0.4173062052577734, + 0.33418258279561996, + 0.23610183224081993, + 0.13014544174075127, + 1.5040384978055954, + 0.21045709401369095, + 0.108809320256114, + 0.07862293720245361, + 0.19024675339460373, + 0.07709075137972832, + 1.2997841443866491, + 2.5506617315113544, + 0.035893362015485764, + 1.3774566017091274, + 0.20140476524829865, + 0.37044674530625343, + 0.0, + 1.2347500286996365, + 0.2950173616409302, + 2.4474958404898643, + 1.596777055412531, + 0.0, + 0.5715703628957272, + 0.7044580392539501, + 0.05416892468929291, + 0.7735090646892786, + 0.5468333065509796, + 0.5508593954145908, + 0.04061241075396538, + 0.2402094565331936, + 1.4083123914897442, + 0.40241991728544235, + 0.26213936507701874, + 0.8042821828275919, + 2.0651065446436405, + 0.6921124719083309, + 0.0, + 0.6419157311320305, + 0.0, + 3.877029560506344, + 1.7678102273494005, + 0.4839372932910919, + 0.19928980618715286, + 1.5892297178506851, + 0.39442434906959534, + 0.7260486725717783, + 0.39491360634565353 + ], + "unique_experts": 59, + "load_cv": 0.9338510828938161, + "normalized_load_entropy": 0.9018136117109715, + "max_load_share": 0.07547169811320754 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "2cba6cede25aacb5bc607d9b3775737adb917f1a6c1525204f580f80b2d729d9", + "route_weight_sha256": "c41b61e505065228cc5a43c1046479efb4f1222e732736b4f436a11187f21088", + "loads": [ + 19, + 8, + 6, + 23, + 15, + 12, + 4, + 8, + 2, + 4, + 12, + 19, + 13, + 13, + 1, + 2, + 12, + 14, + 6, + 12, + 2, + 22, + 8, + 7, + 6, + 6, + 2, + 24, + 24, + 1, + 25, + 9, + 6, + 0, + 24, + 11, + 27, + 20, + 2, + 10, + 10, + 10, + 15, + 10, + 15, + 9, + 14, + 20, + 8, + 6, + 17, + 29, + 10, + 3, + 14, + 4, + 52, + 28, + 7, + 9, + 24, + 7, + 16, + 8 + ], + "weighted_loads": [ + 1.1006114296615124, + 0.610844612121582, + 0.39981235936284065, + 1.2639016546308994, + 1.005041804164648, + 1.0302265547215939, + 0.20730305835604668, + 0.41121185570955276, + 0.09500579535961151, + 0.20897247083485126, + 1.2106784209609032, + 1.1270999871194363, + 1.106606014072895, + 1.2695579575374722, + 0.04256204143166542, + 0.10673791542649269, + 0.9043559208512306, + 0.5360781420022249, + 0.33418258279561996, + 1.1005386970937252, + 0.13014544174075127, + 1.5040384978055954, + 0.8613257687538862, + 0.5077653098851442, + 0.24422841146588326, + 0.373133085668087, + 0.07709075137972832, + 1.3127820556983352, + 2.5506617315113544, + 0.035893362015485764, + 1.480504583567381, + 0.3872836921364069, + 0.37044674530625343, + 0.0, + 1.7256727758795023, + 0.7576619349420071, + 2.4474958404898643, + 1.596777055412531, + 0.0811324268579483, + 0.6166542619466782, + 0.7044580392539501, + 1.0139388740062714, + 0.7735090646892786, + 0.5468333065509796, + 0.8491599978879094, + 0.8675687648355961, + 1.1362057588994503, + 1.4083123914897442, + 0.618070837110281, + 0.26213936507701874, + 1.1534072272479534, + 2.0992127172648907, + 0.6921124719083309, + 0.12172668613493443, + 0.6419157311320305, + 0.20054291561245918, + 4.08295501023531, + 1.7678102273494005, + 0.6377749033272266, + 0.3744470998644829, + 1.5892297178506851, + 0.39442434906959534, + 0.781910914927721, + 0.4311353676021099 + ], + "unique_experts": 63, + "load_cv": 0.735148808802008, + "normalized_load_entropy": 0.9391553419130453, + "max_load_share": 0.06615776081424936 + } + }, + "s1_bos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "1317ca242670eb9e2639783ef4e638272811075ba2b7babe330f8c3a1a940878", + "route_weight_sha256": "62ed9252e508553a37c04bd6e00111c13a986ee8213372784659b06af7fcd54f", + "loads": [ + 9, + 5, + 7, + 22, + 11, + 12, + 4, + 7, + 0, + 4, + 1, + 19, + 10, + 9, + 1, + 2, + 11, + 12, + 7, + 2, + 2, + 21, + 7, + 1, + 1, + 4, + 2, + 24, + 24, + 1, + 22, + 7, + 6, + 0, + 15, + 4, + 28, + 20, + 0, + 10, + 10, + 1, + 15, + 9, + 12, + 1, + 3, + 19, + 5, + 6, + 10, + 28, + 10, + 0, + 12, + 1, + 49, + 28, + 5, + 5, + 24, + 7, + 14, + 8 + ], + "weighted_loads": [ + 0.4413131270557642, + 0.37633850425481796, + 0.43315858393907547, + 1.199748508632183, + 0.6827272400259972, + 1.0319776311516762, + 0.20721051841974258, + 0.3705190010368824, + 0.0, + 0.2113368734717369, + 0.041068244725465775, + 1.1240378431975842, + 1.0211943238973618, + 1.0973635837435722, + 0.0435665100812912, + 0.10439491271972656, + 0.8682416789233685, + 0.4539233595132828, + 0.3694361299276352, + 0.16648531705141068, + 0.12873568013310432, + 1.4249354042112827, + 0.3341543860733509, + 0.037206389009952545, + 0.0336175411939621, + 0.16178280487656593, + 0.07268388196825981, + 1.3037826362997293, + 2.538699481636286, + 0.03735022246837616, + 1.3100720401853323, + 0.3044300340116024, + 0.36968011781573296, + 0.0, + 1.2412673570215702, + 0.29323237761855125, + 2.453176263719797, + 1.5719126407057047, + 0.0, + 0.5958008207380772, + 0.6979749351739883, + 0.052801311016082764, + 0.7632507290691137, + 0.5093391947448254, + 0.5844341609627008, + 0.041068460792303085, + 0.2454693354666233, + 1.344995990395546, + 0.40090976655483246, + 0.2677394449710846, + 0.7981795221567154, + 2.0935777574777603, + 0.695551760494709, + 0.0, + 0.5629338324069977, + 0.05264982208609581, + 3.908183880150318, + 1.7434580735862255, + 0.4795207977294922, + 0.1929398477077484, + 1.5773803554475307, + 0.386084359139204, + 0.7107036020606756, + 0.42987366393208504 + ], + "unique_experts": 60, + "load_cv": 0.9350363347339264, + "normalized_load_entropy": 0.9022857785239654, + "max_load_share": 0.0770440251572327 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "ffe0561a2be8bb86b6de5876ae387e3c200b61619fff43f78383d3b4b0b6858a", + "route_weight_sha256": "a9e730075a1ddc4553e18f579ec491d833721f08a215b53a216967d1ece5623c", + "loads": [ + 21, + 10, + 7, + 22, + 14, + 12, + 4, + 7, + 7, + 6, + 12, + 21, + 12, + 13, + 2, + 2, + 12, + 15, + 7, + 11, + 2, + 24, + 11, + 13, + 6, + 13, + 6, + 25, + 30, + 1, + 25, + 11, + 6, + 3, + 21, + 16, + 28, + 23, + 4, + 12, + 16, + 15, + 17, + 9, + 16, + 14, + 23, + 19, + 12, + 11, + 15, + 29, + 10, + 3, + 13, + 5, + 54, + 28, + 10, + 9, + 24, + 8, + 16, + 9 + ], + "weighted_loads": [ + 1.2766922730952501, + 0.6880919858813286, + 0.43315858393907547, + 1.199748508632183, + 0.985780481249094, + 1.0319776311516762, + 0.20721051841974258, + 0.3705190010368824, + 0.42149077728390694, + 0.302474495023489, + 1.1207666508853436, + 1.2207547016441822, + 1.0688892733305693, + 1.2357598850503564, + 0.08332832157611847, + 0.10439491271972656, + 0.9140985682606697, + 0.5948064588010311, + 0.3694361299276352, + 1.1197153441607952, + 0.12873568013310432, + 1.5511385351419449, + 0.985854234546423, + 0.9924056716263294, + 0.2216244377195835, + 0.6849364191293716, + 0.3266988843679428, + 1.3167805476114154, + 2.965208437293768, + 0.03735022246837616, + 1.5175154190510511, + 0.4497224260121584, + 0.36968011781573296, + 0.2217627316713333, + 1.5441887844353914, + 1.0845365561544895, + 2.453176263719797, + 1.7146311607211828, + 0.19507833942770958, + 0.7145028598606586, + 1.0975546203553677, + 1.5182135105133057, + 0.8551950473338366, + 0.5093391947448254, + 0.7523493086919188, + 1.3262595608830452, + 1.9841720089316368, + 1.344995990395546, + 0.8614576272666454, + 0.5968492217361927, + 1.0551597904413939, + 2.1269485615193844, + 0.695551760494709, + 0.15241997689008713, + 0.6035381779074669, + 0.24423444271087646, + 4.141378030180931, + 1.7434580735862255, + 0.7922900766134262, + 0.37878306582570076, + 1.5773803554475307, + 0.4236394613981247, + 0.8683653827756643, + 0.465859729796648 + ], + "unique_experts": 64, + "load_cv": 0.6500900856113115, + "normalized_load_entropy": 0.9528395087045427, + "max_load_share": 0.061224489795918366 + } + }, + "s0_x": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "069fd19d32582ff191795c1e32667ec0fd80930ccb56bf88bfd580a8c21caf2f", + "route_weight_sha256": "1f3b2d745af5216b688f8550a4870c7834921363a4e93688f9278be1f92bdce6", + "loads": [ + 10, + 5, + 6, + 24, + 12, + 12, + 5, + 8, + 0, + 4, + 1, + 20, + 10, + 9, + 0, + 2, + 11, + 11, + 5, + 3, + 2, + 22, + 5, + 3, + 3, + 5, + 2, + 25, + 24, + 1, + 22, + 5, + 8, + 0, + 15, + 4, + 27, + 20, + 0, + 9, + 11, + 1, + 15, + 10, + 11, + 1, + 3, + 19, + 5, + 6, + 10, + 28, + 10, + 0, + 13, + 0, + 49, + 26, + 5, + 5, + 23, + 7, + 11, + 7 + ], + "weighted_loads": [ + 0.5106133222579956, + 0.38207951188087463, + 0.3869696855545044, + 1.271904805675149, + 0.7067273296415806, + 1.0019640922546387, + 0.2493809536099434, + 0.4228327125310898, + 0.0, + 0.20908772945404053, + 0.041428592056035995, + 1.163780014961958, + 1.0262910909950733, + 1.100190881639719, + 0.0, + 0.10517996922135353, + 0.8554550036787987, + 0.41593386232852936, + 0.29188647121191025, + 0.20863833650946617, + 0.130681574344635, + 1.4859788827598095, + 0.2277512401342392, + 0.11212870851159096, + 0.11068025976419449, + 0.23395298421382904, + 0.0722646713256836, + 1.351436235010624, + 2.5310029052197933, + 0.0364890992641449, + 1.2908311001956463, + 0.2456342838704586, + 0.4486507326364517, + 0.0, + 1.2314926460385323, + 0.296736691147089, + 2.4162227399647236, + 1.5656987950205803, + 0.0, + 0.5544421281665564, + 0.7263158466666937, + 0.055945150554180145, + 0.7775563672184944, + 0.5575565062463284, + 0.5472933240234852, + 0.0401550829410553, + 0.2357584573328495, + 1.3785500451922417, + 0.4042087495326996, + 0.2649693265557289, + 0.7987129837274551, + 2.0513925440609455, + 0.7048689387738705, + 0.0, + 0.6069116294384003, + 0.0, + 3.873212307691574, + 1.6654824987053871, + 0.4749627411365509, + 0.1930813044309616, + 1.5540751479566097, + 0.3982780873775482, + 0.6163125857710838, + 0.3938230462372303 + ], + "unique_experts": 58, + "load_cv": 0.9316459003823399, + "normalized_load_entropy": 0.9025288300312965, + "max_load_share": 0.0770440251572327 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "391e945ad2260e64d1410e40a9d0e37a0e69b16a6a21fa5f30cbe24fa0bc2c30", + "route_weight_sha256": "8aec9d38ae6becf6629a714f4a9f78d60fd96c1d61fbb59a54e55e51e0b985f3", + "loads": [ + 19, + 8, + 6, + 24, + 14, + 12, + 5, + 8, + 2, + 4, + 13, + 20, + 12, + 13, + 0, + 2, + 13, + 12, + 5, + 12, + 2, + 22, + 9, + 7, + 7, + 8, + 2, + 26, + 24, + 1, + 24, + 10, + 8, + 0, + 25, + 10, + 27, + 20, + 3, + 9, + 11, + 10, + 15, + 10, + 14, + 8, + 15, + 19, + 8, + 6, + 15, + 29, + 10, + 3, + 13, + 5, + 53, + 26, + 7, + 10, + 23, + 7, + 13, + 8 + ], + "weighted_loads": [ + 1.21633305773139, + 0.628783106803894, + 0.3869696855545044, + 1.271904805675149, + 0.9339409805834293, + 1.0019640922546387, + 0.2493809536099434, + 0.4228327125310898, + 0.09500579535961151, + 0.20908772945404053, + 1.362064179033041, + 1.163780014961958, + 1.0722355023026466, + 1.2344000907614827, + 0.0, + 0.10517996922135353, + 0.9328885450959206, + 0.45854421705007553, + 0.29188647121191025, + 1.0730752013623714, + 0.130681574344635, + 1.4859788827598095, + 0.8782240506261587, + 0.4672487638890743, + 0.27628573402762413, + 0.45905542746186256, + 0.0722646713256836, + 1.36443414632231, + 2.5310029052197933, + 0.0364890992641449, + 1.3855131641030312, + 0.43151321075856686, + 0.4486507326364517, + 0.0, + 1.818405730649829, + 0.7385038509964943, + 2.4162227399647236, + 1.5656987950205803, + 0.12816281989216805, + 0.5544421281665564, + 0.7263158466666937, + 0.969321645796299, + 0.7775563672184944, + 0.5575565062463284, + 0.8090015025809407, + 0.5992555543780327, + 1.1545952931046486, + 1.3785500451922417, + 0.6305516697466373, + 0.2649693265557289, + 1.054214932024479, + 2.0854987166821957, + 0.7048689387738705, + 0.11835422180593014, + 0.6069116294384003, + 0.2385825589299202, + 4.07913775742054, + 1.6654824987053871, + 0.624477069824934, + 0.40832655504345894, + 1.5540751479566097, + 0.3982780873775482, + 0.6721748281270266, + 0.4300448074936867 + ], + "unique_experts": 62, + "load_cv": 0.7324665156512737, + "normalized_load_entropy": 0.9399296830171949, + "max_load_share": 0.06743002544529263 + } + }, + "s1_x": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "ce7e4bdd21f6850af35e526dd4867ebc1c09e32e02b13cfc9a5e980fc69b255a", + "route_weight_sha256": "2f3c79d431976c1e56ce63946e02a60f2939d08d623109949a119284b0f15e38", + "loads": [ + 12, + 5, + 7, + 22, + 10, + 12, + 5, + 8, + 0, + 4, + 1, + 18, + 10, + 9, + 1, + 2, + 11, + 10, + 5, + 2, + 3, + 21, + 5, + 1, + 1, + 7, + 2, + 18, + 24, + 1, + 23, + 8, + 7, + 0, + 16, + 4, + 28, + 20, + 0, + 10, + 11, + 1, + 15, + 10, + 14, + 1, + 3, + 19, + 5, + 6, + 10, + 29, + 10, + 0, + 12, + 0, + 49, + 26, + 5, + 5, + 25, + 7, + 12, + 8 + ], + "weighted_loads": [ + 0.5707601364701986, + 0.37110190838575363, + 0.4173832833766937, + 1.1687966734170914, + 0.6283840164542198, + 1.0003322139382362, + 0.24470912665128708, + 0.4171042777597904, + 0.0, + 0.21095608174800873, + 0.04087765887379646, + 1.061150200664997, + 1.0206591337919235, + 1.074391845613718, + 0.04037593677639961, + 0.10269991680979729, + 0.877045039087534, + 0.388701593503356, + 0.28372209519147873, + 0.17809858918190002, + 0.15890906564891338, + 1.4140695482492447, + 0.25642338022589684, + 0.035762969404459, + 0.032857175916433334, + 0.28204955719411373, + 0.06958120688796043, + 1.0487977601587772, + 2.4915182515978813, + 0.038996241986751556, + 1.3300355486571789, + 0.340493131428957, + 0.39372080005705357, + 0.0, + 1.2648960724473, + 0.29295065626502037, + 2.420261148363352, + 1.5277083050459623, + 0.0, + 0.5722001977264881, + 0.7251163311302662, + 0.051507510244846344, + 0.7552066762000322, + 0.5393820218741894, + 0.6753326617181301, + 0.03992544487118721, + 0.2508889473974705, + 1.3337572403252125, + 0.4021746888756752, + 0.2620178945362568, + 0.797183521091938, + 2.113524381071329, + 0.7027111202478409, + 0.0, + 0.5625940784811974, + 0.0, + 3.957140553742647, + 1.6432826276868582, + 0.47985491901636124, + 0.19199199602007866, + 1.6087134219706059, + 0.39162665978074074, + 0.6216004602611065, + 0.42924875020980835 + ], + "unique_experts": 59, + "load_cv": 0.9234580722063009, + "normalized_load_entropy": 0.9036516235893011, + "max_load_share": 0.0770440251572327 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "1288730c889014ff0b09e32fc782d12ebd24a5fd33bcf754187ad6f7dea6daa3", + "route_weight_sha256": "a3218e6ccf4a303df54ad903cf5019cbdda9259c564dd787e312f17efb969576", + "loads": [ + 26, + 10, + 7, + 22, + 12, + 12, + 5, + 8, + 8, + 6, + 13, + 20, + 12, + 12, + 2, + 2, + 13, + 11, + 5, + 12, + 3, + 24, + 9, + 13, + 6, + 17, + 7, + 19, + 30, + 1, + 26, + 12, + 7, + 3, + 23, + 15, + 28, + 23, + 5, + 12, + 17, + 15, + 17, + 10, + 17, + 12, + 22, + 19, + 12, + 11, + 13, + 30, + 10, + 2, + 13, + 5, + 54, + 26, + 10, + 10, + 25, + 8, + 14, + 9 + ], + "weighted_loads": [ + 1.5593814570456743, + 0.6794366836547852, + 0.4173832833766937, + 1.1687966734170914, + 0.8793640732765198, + 1.0003322139382362, + 0.24470912665128708, + 0.4171042777597904, + 0.4631164036691189, + 0.3020937032997608, + 1.2800973914563656, + 1.1578670591115952, + 1.068354083225131, + 1.162282650358975, + 0.08013774827122688, + 0.10269991680979729, + 0.9633544906973839, + 0.4444978553801775, + 0.28372209519147873, + 1.1774854399263859, + 0.15890906564891338, + 1.5402726791799068, + 0.9074082337319851, + 0.9927613288164139, + 0.22086407244205475, + 0.831693259999156, + 0.36982613801956177, + 1.0617956714704633, + 2.9180272072553635, + 0.038996241986751556, + 1.5361990891397, + 0.485785523429513, + 0.39372080005705357, + 0.2217627316713333, + 1.6276069302111864, + 1.049118049442768, + 2.420261148363352, + 1.6704268250614405, + 0.24389242008328438, + 0.6831768788397312, + 1.1246960163116455, + 1.4354179166257381, + 0.8471509944647551, + 0.5393820218741894, + 0.8050634386017919, + 0.9943377561867237, + 1.8628142848610878, + 1.3337572403252125, + 0.8808345831930637, + 0.5911276713013649, + 0.978221133351326, + 2.146895185112953, + 0.7027111202478409, + 0.09955780580639839, + 0.6031984239816666, + 0.23766210675239563, + 4.19033470377326, + 1.6432826276868582, + 0.7807943969964981, + 0.43088123574852943, + 1.6087134219706059, + 0.4291817620396614, + 0.7792622409760952, + 0.46523481607437134 + ], + "unique_experts": 64, + "load_cv": 0.6484428216702406, + "normalized_load_entropy": 0.9535127742504544, + "max_load_share": 0.061224489795918366 + } + }, + "s0_period": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "a695bb4a51ad1df8ab7a0f873a60763a7a13913bf73cc0d6e38c192734e79f47", + "route_weight_sha256": "70863320e2de8683a63d94248a7965fb7b82c333834fc71782d2e011729a479c", + "loads": [ + 11, + 5, + 7, + 24, + 12, + 11, + 7, + 9, + 0, + 4, + 1, + 19, + 10, + 9, + 1, + 2, + 11, + 11, + 6, + 3, + 2, + 22, + 5, + 3, + 3, + 5, + 2, + 22, + 24, + 1, + 22, + 4, + 8, + 0, + 15, + 4, + 28, + 20, + 0, + 9, + 11, + 1, + 14, + 11, + 11, + 1, + 3, + 20, + 5, + 6, + 10, + 28, + 10, + 0, + 13, + 0, + 48, + 25, + 5, + 5, + 23, + 7, + 10, + 7 + ], + "weighted_loads": [ + 0.5480893272906542, + 0.38112127035856247, + 0.42395687103271484, + 1.2596249803900719, + 0.7038081735372543, + 0.9641630202531815, + 0.316324844956398, + 0.4714205265045166, + 0.0, + 0.20977578684687614, + 0.04121742025017738, + 1.123274352401495, + 1.0379169397056103, + 1.1079878360033035, + 0.04351182281970978, + 0.10655363276600838, + 0.852978989481926, + 0.4124521780759096, + 0.3350730501115322, + 0.21007641404867172, + 0.12959839776158333, + 1.4899327047169209, + 0.22900673188269138, + 0.11325579136610031, + 0.11235059797763824, + 0.22667516767978668, + 0.07385382428765297, + 1.2421753946691751, + 2.5247808173298836, + 0.03745255619287491, + 1.2868620995432138, + 0.2017625942826271, + 0.44719529151916504, + 0.0, + 1.2429527007043362, + 0.29507991671562195, + 2.4489673376083374, + 1.5620990321040154, + 0.0, + 0.5622700974345207, + 0.7292109988629818, + 0.055659253150224686, + 0.7368825413286686, + 0.5957050397992134, + 0.5433744862675667, + 0.04063011333346367, + 0.21553417667746544, + 1.4202633649110794, + 0.4025614261627197, + 0.2669408656656742, + 0.8201492577791214, + 2.040912240743637, + 0.6960475817322731, + 0.0, + 0.6018197610974312, + 0.0, + 3.844039961695671, + 1.61167704872787, + 0.4772597774863243, + 0.19442368671298027, + 1.5462866947054863, + 0.39453016221523285, + 0.5711376555263996, + 0.3928634561598301 + ], + "unique_experts": 59, + "load_cv": 0.913812887366643, + "normalized_load_entropy": 0.9060274927681491, + "max_load_share": 0.07547169811320754 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "48677f6a7eb17e86b83179bd693457785d65be6cea099fada96f830ae3efef3d", + "route_weight_sha256": "7e46f9bea7b5d29ca815b3365ca06d16f0c896e74cf18f6d3b44722179549f8e", + "loads": [ + 20, + 8, + 7, + 24, + 14, + 11, + 7, + 9, + 2, + 4, + 13, + 19, + 12, + 12, + 1, + 2, + 12, + 13, + 6, + 12, + 2, + 22, + 9, + 7, + 7, + 7, + 2, + 23, + 24, + 1, + 24, + 9, + 8, + 0, + 25, + 11, + 28, + 20, + 3, + 9, + 11, + 11, + 14, + 11, + 14, + 8, + 16, + 20, + 8, + 6, + 15, + 29, + 10, + 2, + 13, + 5, + 53, + 25, + 7, + 9, + 23, + 7, + 12, + 8 + ], + "weighted_loads": [ + 1.2217383068054914, + 0.6234131678938866, + 0.42395687103271484, + 1.2596249803900719, + 0.9304529428482056, + 0.9641630202531815, + 0.316324844956398, + 0.4714205265045166, + 0.09500579535961151, + 0.20977578684687614, + 1.3062917329370975, + 1.123274352401495, + 1.0838613510131836, + 1.2072499999776483, + 0.04351182281970978, + 0.10655363276600838, + 0.8940989896655083, + 0.5066960323601961, + 0.3350730501115322, + 1.074513278901577, + 0.12959839776158333, + 1.4899327047169209, + 0.8819123469293118, + 0.46945832297205925, + 0.2779560722410679, + 0.40333767235279083, + 0.07385382428765297, + 1.2551733059808612, + 2.5247808173298836, + 0.03745255619287491, + 1.38718824647367, + 0.38764152117073536, + 0.44719529151916504, + 0.0, + 1.7908802684396505, + 0.7735564708709717, + 2.4489673376083374, + 1.5620990321040154, + 0.12814849615097046, + 0.5622700974345207, + 0.7292109988629818, + 1.0184058994054794, + 0.7368825413286686, + 0.5957050397992134, + 0.8050826648250222, + 0.6156498715281487, + 1.2507632076740265, + 1.4202633649110794, + 0.6305159144103527, + 0.2669408656656742, + 1.0771705694496632, + 2.0750184133648872, + 0.6960475817322731, + 0.07586542703211308, + 0.6018197610974312, + 0.24417820572853088, + 4.088650614023209, + 1.61167704872787, + 0.6318313218653202, + 0.3695809803903103, + 1.5462866947054863, + 0.39453016221523285, + 0.6269998978823423, + 0.42908521741628647 + ], + "unique_experts": 63, + "load_cv": 0.7250747641579695, + "normalized_load_entropy": 0.9417832467160528, + "max_load_share": 0.06743002544529263 + } + }, + "s1_period": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "3a82fbe145e5fe9b4955634bf20a5836836fd7cc77735f82032d70b66d0d444c", + "route_weight_sha256": "44f98fc547808a7c9e811417ed702f7aab3aa96a5b468f7bd7c4a1e4b9c6981f", + "loads": [ + 9, + 5, + 7, + 23, + 11, + 12, + 5, + 8, + 0, + 4, + 1, + 18, + 10, + 8, + 1, + 2, + 11, + 11, + 6, + 2, + 3, + 21, + 7, + 1, + 2, + 7, + 2, + 19, + 24, + 1, + 21, + 7, + 6, + 0, + 16, + 4, + 27, + 20, + 0, + 10, + 11, + 1, + 15, + 11, + 11, + 1, + 3, + 19, + 5, + 6, + 10, + 30, + 10, + 0, + 12, + 0, + 50, + 27, + 5, + 5, + 25, + 7, + 12, + 8 + ], + "weighted_loads": [ + 0.46725403890013695, + 0.37274646013975143, + 0.42480452358722687, + 1.2137911226600409, + 0.6570554301142693, + 0.9943695850670338, + 0.2438679151237011, + 0.4239871948957443, + 0.0, + 0.20955456979572773, + 0.040502745658159256, + 1.0712973307818174, + 1.0225944519042969, + 1.0401389114558697, + 0.04223359376192093, + 0.10346551239490509, + 0.8716466352343559, + 0.429774709045887, + 0.3304305151104927, + 0.17734839767217636, + 0.16048909723758698, + 1.4210396483540535, + 0.323279295116663, + 0.03572099655866623, + 0.06244990602135658, + 0.277244932949543, + 0.0710616409778595, + 1.0786410216242075, + 2.497328646481037, + 0.03876982629299164, + 1.2566742934286594, + 0.3071954492479563, + 0.3638368770480156, + 0.0, + 1.2540699914097786, + 0.29590631648898125, + 2.364352535456419, + 1.5356372240930796, + 0.0, + 0.5849365573376417, + 0.7276809699833393, + 0.05361120402812958, + 0.759190509095788, + 0.578103419393301, + 0.5551807545125484, + 0.0403064526617527, + 0.23684043064713478, + 1.3545545730739832, + 0.40173422545194626, + 0.26927465572953224, + 0.7862341683357954, + 2.1490702889859676, + 0.6975716762244701, + 0.0, + 0.5596262812614441, + 0.0, + 3.97608183324337, + 1.6809865031391382, + 0.480484701693058, + 0.19259146228432655, + 1.6107181794941425, + 0.38323158398270607, + 0.6245381869375706, + 0.43442418053746223 + ], + "unique_experts": 59, + "load_cv": 0.9292652361935297, + "normalized_load_entropy": 0.9039625835651564, + "max_load_share": 0.07861635220125786 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "c32209eabb833cd3dac0733a440dd1970a16aa52aa7700074e620d0ddd770b9b", + "route_weight_sha256": "8da08eab3473f254d2d6b2cd642fc77021539600307c2523e84c296f2481d4ac", + "loads": [ + 22, + 10, + 7, + 23, + 13, + 12, + 5, + 8, + 7, + 6, + 13, + 20, + 12, + 12, + 2, + 2, + 12, + 13, + 6, + 11, + 3, + 24, + 11, + 13, + 7, + 17, + 6, + 20, + 30, + 1, + 24, + 11, + 6, + 3, + 22, + 16, + 27, + 23, + 5, + 11, + 17, + 16, + 17, + 11, + 14, + 11, + 25, + 19, + 12, + 11, + 13, + 31, + 10, + 3, + 13, + 5, + 56, + 27, + 10, + 9, + 25, + 8, + 14, + 9 + ], + "weighted_loads": [ + 1.3507398255169392, + 0.6824963018298149, + 0.42480452358722687, + 1.2137911226600409, + 0.9086490273475647, + 0.9943695850670338, + 0.2438679151237011, + 0.4239871948957443, + 0.42149077728390694, + 0.3006921913474798, + 1.1909548304975033, + 1.1680141892284155, + 1.0702894013375044, + 1.1616430478170514, + 0.0819954052567482, + 0.10346551239490509, + 0.9175035245716572, + 0.537656158208847, + 0.3304305151104927, + 1.130578424781561, + 0.16048909723758698, + 1.5472427792847157, + 0.9769745245575905, + 0.9740129187703133, + 0.250456802546978, + 0.8450004458427429, + 0.3250766433775425, + 1.0916389329358935, + 2.9238376021385193, + 0.03876982629299164, + 1.4695563651621342, + 0.45248784124851227, + 0.3638368770480156, + 0.2217627316713333, + 1.5569914188235998, + 1.1039340049028397, + 2.364352535456419, + 1.6783557441085577, + 0.2585763521492481, + 0.6519205551594496, + 1.1272606551647186, + 1.5057466924190521, + 0.8511348273605108, + 0.578103419393301, + 0.6849115313962102, + 0.9305629581212997, + 2.127091407775879, + 1.3545545730739832, + 0.8784240297973156, + 0.5983844324946404, + 0.9641978461295366, + 2.1824410930275917, + 0.6975716762244701, + 0.1495121419429779, + 0.6002306267619133, + 0.23866800591349602, + 4.252326223999262, + 1.6809865031391382, + 0.7916205674409866, + 0.3784346804022789, + 1.6107181794941425, + 0.42078668624162674, + 0.7821999676525593, + 0.4704102464020252 + ], + "unique_experts": 64, + "load_cv": 0.6561364668787465, + "normalized_load_entropy": 0.9533539827416604, + "max_load_share": 0.06349206349206349 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 106, + "ordered_topk_exact_tokens": 84, + "set_exact_tokens": 90, + "mean_set_jaccard": 0.9568733153638815, + "mean_token_weighted_tv": 0.010755419037041237, + "aggregate_load_tv": 0.01729559748427673 + }, + "system_bos": { + "tokens": 106, + "ordered_topk_exact_tokens": 70, + "set_exact_tokens": 79, + "mean_set_jaccard": 0.9272237196765499, + "mean_token_weighted_tv": 0.017238900917670073, + "aggregate_load_tv": 0.02515723270440251 + }, + "system_x": { + "tokens": 106, + "ordered_topk_exact_tokens": 60, + "set_exact_tokens": 75, + "mean_set_jaccard": 0.9144204851752021, + "mean_token_weighted_tv": 0.019788711762301764, + "aggregate_load_tv": 0.03459119496855345 + }, + "system_period": { + "tokens": 106, + "ordered_topk_exact_tokens": 52, + "set_exact_tokens": 67, + "mean_set_jaccard": 0.8928571428571428, + "mean_token_weighted_tv": 0.022434309010727786, + "aggregate_load_tv": 0.03616352201257861 + }, + "bos_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 68, + "set_exact_tokens": 75, + "mean_set_jaccard": 0.910377358490566, + "mean_token_weighted_tv": 0.02031400094230501, + "aggregate_load_tv": 0.03616352201257861 + }, + "bos_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 66, + "set_exact_tokens": 73, + "mean_set_jaccard": 0.9090296495956873, + "mean_token_weighted_tv": 0.020912425864909618, + "aggregate_load_tv": 0.03616352201257861 + }, + "x_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 66, + "set_exact_tokens": 75, + "mean_set_jaccard": 0.910377358490566, + "mean_token_weighted_tv": 0.020711325618596572, + "aggregate_load_tv": 0.029874213836477984 + }, + "x_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 53, + "set_exact_tokens": 62, + "mean_set_jaccard": 0.8753369272237197, + "mean_token_weighted_tv": 0.027207444878822228, + "aggregate_load_tv": 0.047169811320754707 + }, + "period_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 70, + "set_exact_tokens": 79, + "mean_set_jaccard": 0.9211590296495956, + "mean_token_weighted_tv": 0.01961736682415852, + "aggregate_load_tv": 0.02987421383647798 + }, + "period_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 55, + "set_exact_tokens": 64, + "mean_set_jaccard": 0.8827493261455527, + "mean_token_weighted_tv": 0.02624876061805858, + "aggregate_load_tv": 0.040880503144654086 + } + } + }, + "layer_10": { + "layer": 10, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "6d6df128bc7a9c388ef211e88c1425d3d7cd6719d80ceb61de1af27fcc5fa385", + "route_weight_sha256": "f170c1c9d1318243b250985bec1202a649c3c940dcfbda883f1c11268a2598b1", + "loads": [ + 1, + 6, + 11, + 0, + 12, + 16, + 1, + 76, + 13, + 7, + 10, + 6, + 0, + 2, + 14, + 11, + 8, + 0, + 7, + 11, + 6, + 44, + 5, + 12, + 10, + 13, + 26, + 2, + 9, + 6, + 2, + 13, + 1, + 21, + 6, + 15, + 4, + 2, + 24, + 1, + 1, + 1, + 9, + 37, + 0, + 5, + 4, + 12, + 2, + 10, + 1, + 0, + 20, + 5, + 8, + 3, + 19, + 8, + 15, + 1, + 6, + 10, + 9, + 16 + ], + "weighted_loads": [ + 0.04237937927246094, + 0.5411389842629433, + 0.6573456525802612, + 0.0, + 1.2894918397068977, + 0.9701553545892239, + 0.037234362214803696, + 5.851094916462898, + 0.939504973590374, + 0.3934359010308981, + 0.5966593883931637, + 0.6015142537653446, + 0.0, + 0.08020957559347153, + 0.8979637660086155, + 0.6306700557470322, + 0.4009768180549145, + 0.0, + 0.6965558677911758, + 0.8302815668284893, + 0.3424658700823784, + 3.6131395250558853, + 0.17694320529699326, + 0.6256700754165649, + 0.7227849550545216, + 1.2734690271317959, + 2.159035872668028, + 0.07414437457919121, + 0.6230178736150265, + 0.47995834052562714, + 0.12508642300963402, + 0.9300293549895287, + 0.05445748567581177, + 1.0378010496497154, + 0.46358758211135864, + 0.9193320386111736, + 0.24781450256705284, + 0.24338586628437042, + 1.533714983612299, + 0.05185836926102638, + 0.03371048346161842, + 0.04458838701248169, + 0.6963666081428528, + 1.955309521406889, + 0.0, + 0.20262622088193893, + 0.2122106496244669, + 1.1475247517228127, + 0.12453718855977058, + 0.5766106769442558, + 0.02895352616906166, + 0.0, + 1.3481962233781815, + 0.3325672447681427, + 0.5019224714487791, + 0.1705891750752926, + 1.3301734328269958, + 0.6984659619629383, + 0.898040659725666, + 0.03964560478925705, + 0.37426167726516724, + 0.6453512161970139, + 0.524958398193121, + 0.8357304446399212 + ], + "unique_experts": 59, + "load_cv": 1.1911723879299345, + "normalized_load_entropy": 0.8776443038915314, + "max_load_share": 0.11949685534591195 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "9cc13f865d28ed853ac318f9950716697355c5edfdc3c3b44c50046e8bf27b1d", + "route_weight_sha256": "e68aa0326ab5a21e274dfa39b398e8304ecb6726355edf89550ae00577e0abc4", + "loads": [ + 1, + 6, + 13, + 0, + 12, + 16, + 1, + 80, + 13, + 9, + 12, + 7, + 1, + 5, + 16, + 11, + 8, + 3, + 14, + 13, + 9, + 46, + 6, + 12, + 10, + 16, + 26, + 8, + 10, + 7, + 6, + 14, + 1, + 29, + 7, + 16, + 4, + 2, + 24, + 1, + 1, + 11, + 13, + 39, + 4, + 7, + 10, + 16, + 2, + 12, + 3, + 5, + 20, + 6, + 8, + 12, + 19, + 14, + 15, + 15, + 11, + 23, + 9, + 16 + ], + "weighted_loads": [ + 0.04237937927246094, + 0.5411389842629433, + 0.6764615518040955, + 0.0, + 1.2894918397068977, + 0.9701553545892239, + 0.037234362214803696, + 6.028269298374653, + 0.939504973590374, + 0.418023057281971, + 0.6920301765203476, + 0.6498682834208012, + 0.032807640731334686, + 1.4944849722087383, + 1.0325930714607239, + 0.6306700557470322, + 0.4009768180549145, + 0.18482903391122818, + 1.082031627651304, + 0.9247364215552807, + 0.45470738410949707, + 3.697250511497259, + 0.18071568105369806, + 0.6256700754165649, + 0.7227849550545216, + 1.3863629661500454, + 2.159035872668028, + 0.8674252592027187, + 0.6693758107721806, + 0.522886399179697, + 0.4939884655177593, + 0.9437987543642521, + 0.05445748567581177, + 1.4314476028084755, + 0.4934810120612383, + 0.9563792459666729, + 0.24781450256705284, + 0.24338586628437042, + 1.533714983612299, + 0.05185836926102638, + 0.03371048346161842, + 0.9756435826420784, + 0.8092512805014849, + 2.0522204898297787, + 0.21025227382779121, + 0.30714789777994156, + 0.4813896920531988, + 1.4050840716809034, + 0.12453718855977058, + 0.6688361875712872, + 0.12386935576796532, + 0.26402899622917175, + 1.3481962233781815, + 0.40857987850904465, + 0.5019224714487791, + 0.8358480706810951, + 1.3301734328269958, + 1.0435514189302921, + 0.898040659725666, + 0.9376296661794186, + 0.7149884589016438, + 1.7754898555576801, + 0.524958398193121, + 0.8357304446399212 + ], + "unique_experts": 63, + "load_cv": 0.9809581084231527, + "normalized_load_entropy": 0.915254820697597, + "max_load_share": 0.10178117048346055 + } + }, + "s1_eos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "29041a0bce3a633e0cfff6df765fed70831243673a41abc18789c64fab0bbf71", + "route_weight_sha256": "b3a2297bd0277172a755799a38b0bcfad6bb70d5cf5aac4fb82c06afa7a96e10", + "loads": [ + 1, + 6, + 11, + 0, + 12, + 16, + 1, + 78, + 13, + 6, + 10, + 6, + 0, + 1, + 14, + 11, + 8, + 0, + 7, + 12, + 6, + 44, + 4, + 12, + 11, + 12, + 26, + 2, + 9, + 6, + 2, + 13, + 2, + 21, + 6, + 15, + 4, + 2, + 25, + 1, + 1, + 1, + 8, + 37, + 0, + 5, + 3, + 12, + 2, + 11, + 1, + 0, + 20, + 5, + 7, + 3, + 19, + 8, + 15, + 1, + 6, + 10, + 9, + 16 + ], + "weighted_loads": [ + 0.04190649464726448, + 0.5238684415817261, + 0.6682788617908955, + 0.0, + 1.2976085506379604, + 1.0045651532709599, + 0.03691909834742546, + 5.870639530941844, + 0.9374528117477894, + 0.34938038513064384, + 0.6000647619366646, + 0.6017383933067322, + 0.0, + 0.03903038427233696, + 0.9061056636273861, + 0.6269809529185295, + 0.413629699498415, + 0.0, + 0.692159540951252, + 0.8849710375070572, + 0.3444915860891342, + 3.5520248971879482, + 0.14323486760258675, + 0.6239887773990631, + 0.7659980095922947, + 1.2545484378933907, + 2.1434317901730537, + 0.07312945276498795, + 0.6253544986248016, + 0.4810640960931778, + 0.12633583694696426, + 0.9262632131576538, + 0.09737049788236618, + 1.0079724602401257, + 0.4725538641214371, + 0.929960336536169, + 0.24958141148090363, + 0.2449643835425377, + 1.5819915942847729, + 0.05421824008226395, + 0.033020537346601486, + 0.04429614916443825, + 0.6516555659472942, + 1.9754853304475546, + 0.0, + 0.20666027069091797, + 0.1730900164693594, + 1.1180950440466404, + 0.12378698959946632, + 0.6317489258944988, + 0.027636604383587837, + 0.0, + 1.3554360531270504, + 0.3343459442257881, + 0.47796571627259254, + 0.1750631295144558, + 1.324964839965105, + 0.6983473114669323, + 0.8860760405659676, + 0.036290060728788376, + 0.37761399522423744, + 0.6502956673502922, + 0.5228557847440243, + 0.8318619430065155 + ], + "unique_experts": 59, + "load_cv": 1.2132823710017189, + "normalized_load_entropy": 0.8747222773232891, + "max_load_share": 0.12264150943396226 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "99dcf6d3f9d825d20e70592488f103e7766a711352ba49377a966c55efa03045", + "route_weight_sha256": "77bf3114ee8bbe4d6355d59496e883966b28894348dde03dc7e8ffa93c1bc9ea", + "loads": [ + 1, + 6, + 14, + 0, + 16, + 16, + 1, + 80, + 13, + 8, + 12, + 9, + 4, + 3, + 17, + 11, + 8, + 5, + 13, + 14, + 7, + 46, + 5, + 12, + 12, + 15, + 28, + 22, + 9, + 9, + 12, + 14, + 7, + 37, + 8, + 17, + 6, + 5, + 26, + 1, + 2, + 17, + 12, + 39, + 3, + 10, + 9, + 16, + 10, + 14, + 4, + 13, + 21, + 7, + 7, + 15, + 20, + 15, + 15, + 21, + 16, + 21, + 9, + 17 + ], + "weighted_loads": [ + 0.04190649464726448, + 0.5238684415817261, + 0.727444785181433, + 0.0, + 1.4998337998986244, + 1.0045651532709599, + 0.03691909834742546, + 5.954510124400258, + 0.9374528117477894, + 0.37450399063527584, + 0.6781395860016346, + 0.7722992226481438, + 0.20108699798583984, + 1.4135893993079662, + 1.1108634285628796, + 0.6269809529185295, + 0.413629699498415, + 0.2981035076081753, + 1.056555730290711, + 0.9631233029067516, + 0.38491325452923775, + 3.638113606721163, + 0.1471561649814248, + 0.6239887773990631, + 0.8077810741961002, + 1.5845872517675161, + 2.2139522060751915, + 1.4755683485418558, + 0.6253544986248016, + 0.612981054931879, + 0.938111312687397, + 0.9400326125323772, + 0.5901520326733589, + 1.8241906203329563, + 0.6149022858589888, + 1.0934192836284637, + 0.3344799131155014, + 0.37164250016212463, + 1.6201590932905674, + 0.05421824008226395, + 0.07519777491688728, + 1.3473646976053715, + 0.7494641439989209, + 2.043528141453862, + 0.17765875905752182, + 0.4595945253968239, + 0.48982694186270237, + 1.3621466550976038, + 0.7738156132400036, + 0.8037190549075603, + 0.20727789215743542, + 0.7782944366335869, + 1.425062607973814, + 0.45305971056222916, + 0.47796571627259254, + 1.0670674294233322, + 1.3970027677714825, + 1.0961918234825134, + 0.8860760405659676, + 1.3470055423676968, + 1.1163851544260979, + 1.6391083672642708, + 0.5228557847440243, + 0.8681098818778992 + ], + "unique_experts": 63, + "load_cv": 0.8759734335857001, + "normalized_load_entropy": 0.929924252998302, + "max_load_share": 0.09070294784580499 + } + }, + "s0_bos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "27d170469fa0b18407a756148772dd325a556a1e936f9582f608e7272d47be26", + "route_weight_sha256": "e1e678a580a83b4ceb3d23588fe5d09b54b82947ab62500be372a154d6bebfe8", + "loads": [ + 1, + 6, + 11, + 0, + 12, + 15, + 1, + 75, + 13, + 7, + 9, + 6, + 0, + 1, + 14, + 11, + 8, + 0, + 8, + 10, + 7, + 43, + 2, + 14, + 13, + 12, + 26, + 2, + 11, + 6, + 1, + 12, + 2, + 21, + 6, + 15, + 3, + 2, + 26, + 1, + 1, + 1, + 9, + 34, + 0, + 5, + 5, + 12, + 2, + 10, + 1, + 0, + 22, + 5, + 8, + 4, + 20, + 8, + 15, + 1, + 6, + 7, + 8, + 19 + ], + "weighted_loads": [ + 0.03726743161678314, + 0.5452377907931805, + 0.6676652021706104, + 0.0, + 1.351277906447649, + 0.9199492000043392, + 0.03696514666080475, + 5.825392585247755, + 0.9391618594527245, + 0.42259417846798897, + 0.5426606126129627, + 0.5990216508507729, + 0.0, + 0.039193831384181976, + 0.9113842658698559, + 0.6561385989189148, + 0.37611253559589386, + 0.0, + 0.7324629947543144, + 0.7517605386674404, + 0.38299380242824554, + 3.5590568520128727, + 0.07036560773849487, + 0.6894786655902863, + 0.840693186968565, + 1.244887936860323, + 2.19901542365551, + 0.07503880560398102, + 0.7029905095696449, + 0.47665970027446747, + 0.07929620891809464, + 0.8826092090457678, + 0.10383507236838341, + 0.973208948969841, + 0.4528617635369301, + 0.9501051977276802, + 0.2085409164428711, + 0.25898537039756775, + 1.66993011161685, + 0.052473198622465134, + 0.03339865431189537, + 0.045721374452114105, + 0.7059625163674355, + 1.8536355253309011, + 0.0, + 0.20124678313732147, + 0.24857167527079582, + 1.188524629920721, + 0.11987797170877457, + 0.5868816897273064, + 0.029275692999362946, + 0.0, + 1.435118742287159, + 0.33898306638002396, + 0.49367342703044415, + 0.23320843651890755, + 1.3869737442582846, + 0.712375782430172, + 0.8875328674912453, + 0.07674910128116608, + 0.39017753675580025, + 0.508126650005579, + 0.48916234262287617, + 0.9643543735146523 + ], + "unique_experts": 59, + "load_cv": 1.1819716910477818, + "normalized_load_entropy": 0.8766141470803807, + "max_load_share": 0.1179245283018868 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "b6ab8ffb2ea14935dfb3fab9ffad1113f34967a809d7ce774a4b6f254f30fe50", + "route_weight_sha256": "cb72607880b766deefa514f75c77491bbc5b6de5da0569a07eda318280ad294f", + "loads": [ + 1, + 6, + 12, + 0, + 12, + 15, + 1, + 79, + 13, + 8, + 11, + 7, + 1, + 4, + 17, + 11, + 8, + 3, + 14, + 12, + 11, + 45, + 2, + 14, + 13, + 15, + 26, + 9, + 12, + 7, + 5, + 13, + 2, + 29, + 7, + 16, + 3, + 2, + 26, + 1, + 1, + 11, + 13, + 36, + 3, + 7, + 11, + 16, + 2, + 13, + 3, + 5, + 22, + 6, + 8, + 13, + 20, + 14, + 15, + 16, + 11, + 20, + 8, + 19 + ], + "weighted_loads": [ + 0.03726743161678314, + 0.5452377907931805, + 0.6818266483023763, + 0.0, + 1.351277906447649, + 0.9199492000043392, + 0.03696514666080475, + 6.00256696715951, + 0.9391618594527245, + 0.4388323873281479, + 0.6380314007401466, + 0.6473756805062294, + 0.032807640731334686, + 0.5861504673957825, + 1.0964610576629639, + 0.6561385989189148, + 0.37611253559589386, + 0.1947464495897293, + 1.1343564875423908, + 0.8478724099695683, + 0.5659008026123047, + 3.6431678384542465, + 0.07036560773849487, + 0.6894786655902863, + 0.840693186968565, + 1.3551020547747612, + 2.19901542365551, + 0.9659380093216896, + 0.749348446726799, + 0.5195877589285374, + 0.4460972473025322, + 0.8963786084204912, + 0.10383507236838341, + 1.3675944954156876, + 0.48275519348680973, + 0.9871524050831795, + 0.2085409164428711, + 0.25898537039756775, + 1.66993011161685, + 0.052473198622465134, + 0.03339865431189537, + 1.1733816862106323, + 0.8593569900840521, + 1.9505464937537909, + 0.19866793230175972, + 0.3057684600353241, + 0.5177507176995277, + 1.4662283342331648, + 0.11987797170877457, + 0.7579709775745869, + 0.1241915225982666, + 0.23833921924233437, + 1.435118742287159, + 0.41491229832172394, + 0.49367342703044415, + 0.925438180565834, + 1.3869737442582846, + 1.0574612393975258, + 0.8875328674912453, + 1.010627444833517, + 0.7280504032969475, + 1.6412811055779457, + 0.48916234262287617, + 0.9643543735146523 + ], + "unique_experts": 63, + "load_cv": 0.971513801557888, + "normalized_load_entropy": 0.9145817640824895, + "max_load_share": 0.1005089058524173 + } + }, + "s1_bos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "e448584f337c92a4bf9afe4a4fc0b1c050a499d847dc4d5d2ce8578401eab1a4", + "route_weight_sha256": "0ce2f98e3708984e59b09a7e985329590b9a85d4dd90bf80513aca5b88c4c58e", + "loads": [ + 1, + 6, + 11, + 0, + 12, + 15, + 1, + 77, + 12, + 6, + 10, + 6, + 0, + 1, + 14, + 11, + 9, + 0, + 8, + 9, + 8, + 43, + 3, + 11, + 12, + 12, + 26, + 2, + 10, + 6, + 1, + 14, + 2, + 19, + 6, + 14, + 3, + 2, + 25, + 1, + 1, + 1, + 8, + 36, + 0, + 6, + 5, + 12, + 2, + 10, + 1, + 0, + 20, + 4, + 7, + 4, + 22, + 8, + 17, + 2, + 6, + 9, + 9, + 17 + ], + "weighted_loads": [ + 0.03809859976172447, + 0.5303442180156708, + 0.6731289215385914, + 0.0, + 1.30003185197711, + 0.9537453912198544, + 0.03894782438874245, + 5.839565539732575, + 0.8670896664261818, + 0.3704075291752815, + 0.608794778585434, + 0.5883067212998867, + 0.0, + 0.041558463126420975, + 0.9087753929197788, + 0.6355477869510651, + 0.43468401581048965, + 0.0, + 0.732390683144331, + 0.7007213570177555, + 0.4416273981332779, + 3.524767480790615, + 0.10173126310110092, + 0.5876477733254433, + 0.8051579631865025, + 1.245587557554245, + 2.192319594323635, + 0.07227364555001259, + 0.6489626206457615, + 0.4782881885766983, + 0.08173100650310516, + 0.9499637223780155, + 0.09957748278975487, + 0.8890259061008692, + 0.44715138152241707, + 0.8908922113478184, + 0.20426061376929283, + 0.24449122697114944, + 1.6338990926742554, + 0.05252958834171295, + 0.033899713307619095, + 0.04357345402240753, + 0.6768777184188366, + 1.9552232343703508, + 0.0, + 0.23624106124043465, + 0.2522902935743332, + 1.1738853119313717, + 0.12153104692697525, + 0.5908733271062374, + 0.02795405685901642, + 0.0, + 1.3418656662106514, + 0.29953495413064957, + 0.46575549617409706, + 0.23803768679499626, + 1.465594720095396, + 0.7180404029786587, + 0.970484122633934, + 0.10791226476430893, + 0.394620668143034, + 0.5808908753097057, + 0.5275139510631561, + 0.8625018633902073 + ], + "unique_experts": 59, + "load_cv": 1.19713474630341, + "normalized_load_entropy": 0.8767244051783644, + "max_load_share": 0.12106918238993711 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "9097293b00e588a55be5d61cc8ff96f024aad55f8b4d7510f812f70f0887f42b", + "route_weight_sha256": "fa56b7eec02b556c58274dec437c85b08f07301e457f45684a81ab9a1896c0a6", + "loads": [ + 1, + 6, + 13, + 0, + 16, + 15, + 1, + 79, + 12, + 7, + 12, + 10, + 4, + 3, + 18, + 11, + 9, + 4, + 13, + 11, + 10, + 45, + 3, + 11, + 13, + 16, + 28, + 23, + 10, + 9, + 10, + 15, + 7, + 35, + 8, + 16, + 5, + 5, + 26, + 1, + 2, + 18, + 10, + 38, + 3, + 11, + 11, + 16, + 10, + 14, + 4, + 13, + 21, + 6, + 7, + 16, + 23, + 15, + 17, + 23, + 16, + 20, + 9, + 18 + ], + "weighted_loads": [ + 0.03809859976172447, + 0.5303442180156708, + 0.7272918904200196, + 0.0, + 1.502257101237774, + 0.9537453912198544, + 0.03894782438874245, + 5.9234361331909895, + 0.8670896664261818, + 0.38664573803544044, + 0.686869602650404, + 0.8133222013711929, + 0.20108699798583984, + 0.5503471568226814, + 1.1736734360456467, + 0.6355477869510651, + 0.43468401581048965, + 0.2524219863116741, + 1.1327503211796284, + 0.7821642085909843, + 0.5370771363377571, + 3.6108561903238297, + 0.10173126310110092, + 0.5876477733254433, + 0.846941027790308, + 1.623063636943698, + 2.262840010225773, + 1.5491257105022669, + 0.6489626206457615, + 0.6102051474153996, + 0.842114619910717, + 0.963733121752739, + 0.5923590175807476, + 1.708104370161891, + 0.5894998032599688, + 1.054351158440113, + 0.2891591154038906, + 0.3711693435907364, + 1.67206659168005, + 0.05252958834171295, + 0.07607695087790489, + 1.6138287708163261, + 0.7226803153753281, + 2.0232660453766584, + 0.21662672981619835, + 0.48917531594634056, + 0.5690272189676762, + 1.4424863960593939, + 0.7715596705675125, + 0.8271402306854725, + 0.207595344632864, + 0.7504517622292042, + 1.411492221057415, + 0.4150552302598953, + 0.46575549617409706, + 1.1752032823860645, + 1.5376326479017735, + 1.1158849149942398, + 0.970484122633934, + 1.4600792676210403, + 1.1307836100459099, + 1.5735081247985363, + 0.5275139510631561, + 0.898749802261591 + ], + "unique_experts": 63, + "load_cv": 0.8682379488143408, + "normalized_load_entropy": 0.9296071740302764, + "max_load_share": 0.08956916099773243 + } + }, + "s0_x": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "70dc388f9a89de3df9221a61d229d311ca14078c1bc30f7f1540414756554446", + "route_weight_sha256": "c09eaaafbb477cd85727124f11bc57b8b71938695bbc1d6ead39f67946f26993", + "loads": [ + 1, + 6, + 11, + 0, + 12, + 15, + 1, + 76, + 12, + 7, + 11, + 6, + 0, + 1, + 14, + 12, + 9, + 0, + 8, + 7, + 7, + 43, + 2, + 11, + 13, + 12, + 26, + 2, + 10, + 6, + 2, + 12, + 2, + 25, + 6, + 15, + 3, + 2, + 25, + 1, + 1, + 1, + 8, + 35, + 0, + 3, + 5, + 12, + 2, + 11, + 1, + 0, + 21, + 5, + 8, + 3, + 19, + 8, + 16, + 2, + 6, + 9, + 9, + 17 + ], + "weighted_loads": [ + 0.03857901692390442, + 0.5163986533880234, + 0.6465538144111633, + 0.0, + 1.3199774473905563, + 0.9094148464500904, + 0.036278750747442245, + 5.889273136854172, + 0.8804637677967548, + 0.42581072449684143, + 0.6269910410046577, + 0.5898757390677929, + 0.0, + 0.036712028086185455, + 0.8850579410791397, + 0.679033175110817, + 0.433228712528944, + 0.0, + 0.7394254468381405, + 0.5682437904179096, + 0.3878239244222641, + 3.525111772119999, + 0.07037427462637424, + 0.5889617241919041, + 0.8351554572582245, + 1.2528825923800468, + 2.160859262570739, + 0.07399272918701172, + 0.6666939686983824, + 0.4798521548509598, + 0.13008634001016617, + 0.8857994340360165, + 0.0978030152618885, + 1.1496219094842672, + 0.45860742032527924, + 0.9612959176301956, + 0.2041870430111885, + 0.26181621849536896, + 1.6083520874381065, + 0.05183593928813934, + 0.032476164400577545, + 0.0467989444732666, + 0.6720599867403507, + 1.8843653742223978, + 0.0, + 0.13027647510170937, + 0.2487982790917158, + 1.1797686964273453, + 0.11679866164922714, + 0.6210182346403599, + 0.029107755050063133, + 0.0, + 1.3958621583878994, + 0.3431462086737156, + 0.4994810726493597, + 0.18529099225997925, + 1.330946885049343, + 0.7097744084894657, + 0.9218510165810585, + 0.10425715520977974, + 0.3876967504620552, + 0.610969103872776, + 0.517402209341526, + 0.8767804242670536 + ], + "unique_experts": 59, + "load_cv": 1.1935609054349903, + "normalized_load_entropy": 0.8759733116314325, + "max_load_share": 0.11949685534591195 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "324440fb982d46247177874e3c2173080c5dac2b57df0fa0ebeaa1a890f7b7d0", + "route_weight_sha256": "7eef7e94916b88d3ae36a45ebfe3e30d438c69ea3e8d88d5c00230907d7dac86", + "loads": [ + 1, + 6, + 12, + 0, + 12, + 15, + 1, + 81, + 12, + 8, + 13, + 7, + 1, + 3, + 16, + 12, + 9, + 4, + 13, + 9, + 10, + 45, + 2, + 11, + 13, + 15, + 26, + 7, + 11, + 7, + 6, + 13, + 2, + 34, + 7, + 16, + 3, + 2, + 25, + 1, + 1, + 10, + 11, + 37, + 4, + 6, + 12, + 17, + 2, + 13, + 3, + 5, + 21, + 7, + 8, + 12, + 19, + 15, + 16, + 16, + 11, + 23, + 9, + 17 + ], + "weighted_loads": [ + 0.03857901692390442, + 0.5163986533880234, + 0.6607152605429292, + 0.0, + 1.3199774473905563, + 0.9094148464500904, + 0.036278750747442245, + 6.105545911937952, + 0.8804637677967548, + 0.44204893335700035, + 0.7223618291318417, + 0.6382297687232494, + 0.032807640731334686, + 0.540220107883215, + 1.0172363258898258, + 0.679033175110817, + 0.433228712528944, + 0.2464507445693016, + 1.0782297477126122, + 0.6699670813977718, + 0.5000654384493828, + 3.6092227585613728, + 0.07037427462637424, + 0.5889617241919041, + 0.8351554572582245, + 1.3640562258660793, + 2.160859262570739, + 0.8240856826305389, + 0.7130519058555365, + 0.5227802135050297, + 0.4966913163661957, + 0.8995688334107399, + 0.0978030152618885, + 1.575569836422801, + 0.4885008502751589, + 0.9983431249856949, + 0.2041870430111885, + 0.26181621849536896, + 1.6083520874381065, + 0.05183593928813934, + 0.032476164400577545, + 0.9157849885523319, + 0.7768046353012323, + 1.9812763426452875, + 0.21411948651075363, + 0.3049864210188389, + 0.5675716679543257, + 1.4608833771198988, + 0.11679866164922714, + 0.7118802070617676, + 0.12402358464896679, + 0.2775573804974556, + 1.3958621583878994, + 0.47629057615995407, + 0.4994810726493597, + 0.8592761680483818, + 1.330946885049343, + 1.1171484775841236, + 0.9218510165810585, + 0.965323232114315, + 0.7301126606762409, + 1.8218256942927837, + 0.517402209341526, + 0.8767804242670536 + ], + "unique_experts": 63, + "load_cv": 0.9966729807093595, + "normalized_load_entropy": 0.9122211470479683, + "max_load_share": 0.10305343511450382 + } + }, + "s1_x": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "f0b26448790b4d401c1ea3209f3bea5b3c626e8f3f37def42938678b827d4335", + "route_weight_sha256": "ad79ddd2c607b8b58a3057b7f21d4bb9e5e5488096995b23e119140f86499b87", + "loads": [ + 1, + 6, + 11, + 0, + 12, + 16, + 1, + 75, + 12, + 7, + 9, + 6, + 0, + 1, + 13, + 12, + 9, + 1, + 7, + 7, + 8, + 42, + 3, + 12, + 12, + 12, + 26, + 1, + 9, + 6, + 2, + 12, + 2, + 21, + 6, + 15, + 4, + 2, + 26, + 1, + 1, + 1, + 8, + 35, + 0, + 6, + 5, + 12, + 2, + 11, + 1, + 0, + 20, + 4, + 6, + 3, + 21, + 8, + 16, + 4, + 6, + 10, + 11, + 17 + ], + "weighted_loads": [ + 0.039433542639017105, + 0.5057776980102062, + 0.6650728024542332, + 0.0, + 1.290391355752945, + 0.982638843357563, + 0.04042072966694832, + 5.6631305404007435, + 0.8647265210747719, + 0.4286140874028206, + 0.5569260567426682, + 0.5740477815270424, + 0.0, + 0.040738727897405624, + 0.8542052544653416, + 0.6930869668722153, + 0.43038517236709595, + 0.046312328428030014, + 0.6953279078006744, + 0.6077104844152927, + 0.4340061992406845, + 3.486942868679762, + 0.09986513294279575, + 0.6060572899878025, + 0.7731055170297623, + 1.237497717142105, + 2.1877635661512613, + 0.032784540206193924, + 0.5743110701441765, + 0.4770395942032337, + 0.13201512768864632, + 0.8670726232230663, + 0.10035580769181252, + 0.9482949804514647, + 0.4436214119195938, + 0.9376666471362114, + 0.23764167726039886, + 0.2397763356566429, + 1.6530723571777344, + 0.05399266630411148, + 0.03327447921037674, + 0.047269996255636215, + 0.6690125539898872, + 1.880370182916522, + 0.0, + 0.2354570087045431, + 0.25689927488565445, + 1.1347018033266068, + 0.12142860516905785, + 0.6289126798510551, + 0.030183477327227592, + 0.0, + 1.3521784916520119, + 0.3007610887289047, + 0.4334826413542032, + 0.18932797014713287, + 1.4298630952835083, + 0.7226644642651081, + 0.9306953176856041, + 0.19116419181227684, + 0.39931054040789604, + 0.614965159446001, + 0.5838668905198574, + 0.8566024154424667 + ], + "unique_experts": 60, + "load_cv": 1.172428937186668, + "normalized_load_entropy": 0.8806415158570565, + "max_load_share": 0.1179245283018868 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "1109f0fffca424a3ad7c8d8756fac972a2a7068751db0b9d41d976245720c331", + "route_weight_sha256": "70c553557842e29b08ccd166540b7ead4ca560bc725fcad6ef29eafd989145d0", + "loads": [ + 1, + 6, + 13, + 0, + 16, + 16, + 1, + 78, + 12, + 8, + 12, + 9, + 4, + 2, + 18, + 12, + 9, + 6, + 11, + 8, + 9, + 44, + 3, + 12, + 13, + 16, + 28, + 19, + 9, + 9, + 11, + 13, + 7, + 37, + 8, + 17, + 6, + 5, + 27, + 1, + 2, + 17, + 10, + 37, + 2, + 12, + 12, + 17, + 10, + 15, + 5, + 13, + 21, + 7, + 6, + 14, + 22, + 16, + 16, + 25, + 16, + 22, + 11, + 18 + ], + "weighted_loads": [ + 0.039433542639017105, + 0.5057776980102062, + 0.7192357713356614, + 0.0, + 1.492616605013609, + 0.982638843357563, + 0.04042072966694832, + 5.798367213457823, + 0.8647265210747719, + 0.4448522962629795, + 0.6851053610444069, + 0.744608610868454, + 0.20108699798583984, + 0.5096223913133144, + 1.1655006743967533, + 0.6930869668722153, + 0.43038517236709595, + 0.3520347289741039, + 1.0195345133543015, + 0.6527351066470146, + 0.47442786768078804, + 3.5730315782129765, + 0.09986513294279575, + 0.6060572899878025, + 0.8148885816335678, + 1.6074522752314806, + 2.258283982053399, + 1.3731274474412203, + 0.5743110701441765, + 0.608956553041935, + 0.8705515079200268, + 0.8808420225977898, + 0.5931373424828053, + 1.7617597077041864, + 0.5859698336571455, + 1.101125594228506, + 0.32254017889499664, + 0.36645445227622986, + 1.691239856183529, + 0.05399266630411148, + 0.07545171678066254, + 1.352280616760254, + 0.7148151509463787, + 1.9484129939228296, + 0.1437068171799183, + 0.550818195566535, + 0.6393374465405941, + 1.3985545057803392, + 0.7714572288095951, + 0.8341432884335518, + 0.24526985920965672, + 0.7831152528524399, + 1.4218050464987755, + 0.4742223285138607, + 0.4334826413542032, + 1.041858572512865, + 1.5019010230898857, + 1.1708034463226795, + 0.9306953176856041, + 1.5252717807888985, + 1.1504623964428902, + 1.669759128242731, + 0.5838668905198574, + 0.8928503543138504 + ], + "unique_experts": 63, + "load_cv": 0.861197502977345, + "normalized_load_entropy": 0.930127809809327, + "max_load_share": 0.08843537414965986 + } + }, + "s0_period": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "59da3977ae1aba3924b6f4411b0d99911af8b6b0ac2bb092a43ed4bd0dfc4121", + "route_weight_sha256": "718ddb2626980258d261b1034c3023644c8750ebd649900c9bf64d0588917a4f", + "loads": [ + 1, + 6, + 10, + 0, + 12, + 15, + 1, + 75, + 13, + 8, + 10, + 6, + 0, + 1, + 14, + 12, + 8, + 0, + 8, + 10, + 6, + 42, + 2, + 13, + 12, + 12, + 26, + 2, + 9, + 6, + 2, + 13, + 1, + 24, + 6, + 15, + 4, + 2, + 25, + 1, + 1, + 1, + 8, + 34, + 0, + 5, + 5, + 12, + 2, + 11, + 1, + 0, + 21, + 5, + 7, + 3, + 21, + 8, + 16, + 1, + 6, + 7, + 9, + 19 + ], + "weighted_loads": [ + 0.04137144982814789, + 0.5279764160513878, + 0.611906673759222, + 0.0, + 1.3406788185238838, + 0.9066485948860645, + 0.03660454973578453, + 5.819096643477678, + 0.9246712140738964, + 0.4574591815471649, + 0.5938868075609207, + 0.5927928015589714, + 0.0, + 0.03725587576627731, + 0.8846455663442612, + 0.7026071585714817, + 0.3940806910395622, + 0.0, + 0.7352929338812828, + 0.7362446337938309, + 0.33973247930407524, + 3.4583518840372562, + 0.06959236413240433, + 0.6656306516379118, + 0.775619599968195, + 1.2475000098347664, + 2.1612225007265806, + 0.07664096727967262, + 0.6404090747237206, + 0.48009758815169334, + 0.12996087968349457, + 0.9201498962938786, + 0.05444364249706268, + 1.1162897013127804, + 0.45120564103126526, + 0.9523596614599228, + 0.24647806584835052, + 0.2575991228222847, + 1.5973820500075817, + 0.05173715576529503, + 0.03302880376577377, + 0.04588297754526138, + 0.6772151552140713, + 1.8509135842323303, + 0.0, + 0.19827053882181644, + 0.24992041662335396, + 1.168378483504057, + 0.11810903623700142, + 0.624754037708044, + 0.029977982863783836, + 0.0, + 1.3932517655193806, + 0.34525178372859955, + 0.4667772464454174, + 0.18929273262619972, + 1.4166399836540222, + 0.7137752212584019, + 0.9227226190268993, + 0.07130380719900131, + 0.3873376213014126, + 0.5087171569466591, + 0.512446803972125, + 0.9466567113995552 + ], + "unique_experts": 59, + "load_cv": 1.1813021893423352, + "normalized_load_entropy": 0.8763642408551601, + "max_load_share": 0.1179245283018868 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "02fe1962a59ef87232ff317af4d993caea3c9d18d5dde33f1126b07ca44cf91f", + "route_weight_sha256": "908a5a92d9cd795ae0bfdbf6e5b6487aba666bec561540872fe622ae94788586", + "loads": [ + 1, + 6, + 11, + 0, + 12, + 15, + 1, + 79, + 13, + 9, + 12, + 7, + 1, + 3, + 16, + 12, + 8, + 3, + 13, + 12, + 9, + 44, + 2, + 13, + 12, + 15, + 26, + 8, + 10, + 7, + 7, + 14, + 1, + 32, + 7, + 16, + 4, + 2, + 25, + 1, + 1, + 11, + 11, + 36, + 3, + 8, + 11, + 16, + 2, + 14, + 4, + 6, + 21, + 6, + 7, + 12, + 21, + 15, + 16, + 16, + 12, + 20, + 9, + 19 + ], + "weighted_loads": [ + 0.04137144982814789, + 0.5279764160513878, + 0.6260681198909879, + 0.0, + 1.3406788185238838, + 0.9066485948860645, + 0.03660454973578453, + 5.996271025389433, + 0.9246712140738964, + 0.47369739040732384, + 0.6892575956881046, + 0.641146831214428, + 0.032807640731334686, + 0.5407639555633068, + 1.0158519074320793, + 0.7026071585714817, + 0.3940806910395622, + 0.23127888143062592, + 1.0740972347557545, + 0.8375524692237377, + 0.4519739933311939, + 3.54246287047863, + 0.06959236413240433, + 0.6656306516379118, + 0.775619599968195, + 1.3610182106494904, + 2.1612225007265806, + 0.852224837988615, + 0.6867670118808746, + 0.5230256468057632, + 0.5672678537666798, + 0.933919295668602, + 0.05444364249706268, + 1.4944978915154934, + 0.4810990709811449, + 0.9894068688154221, + 0.24647806584835052, + 0.2575991228222847, + 1.5973820500075817, + 0.05173715576529503, + 0.03302880376577377, + 1.001720555126667, + 0.7819598037749529, + 1.94782455265522, + 0.16772127151489258, + 0.34678504429757595, + 0.5190994590520859, + 1.4213594179600477, + 0.11810903623700142, + 0.7698932029306889, + 0.16246804781258106, + 0.34714871272444725, + 1.3932517655193806, + 0.42534948885440826, + 0.4667772464454174, + 0.9055890738964081, + 1.4166399836540222, + 1.1333916746079922, + 0.9227226190268993, + 0.9903314970433712, + 0.7811085544526577, + 1.6394301913678646, + 0.512446803972125, + 0.9466567113995552 + ], + "unique_experts": 63, + "load_cv": 0.970873801179979, + "normalized_load_entropy": 0.9147247688473218, + "max_load_share": 0.1005089058524173 + } + }, + "s1_period": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "061f966a1192589e9c4960a2e07ac2fde24bac5d2e428985f5bdfd902e2727ff", + "route_weight_sha256": "b6309229c195fb8aebff45b6f3a96995552c7b4e2ebc00975b9d6060bb8b9f99", + "loads": [ + 1, + 6, + 11, + 0, + 12, + 15, + 1, + 77, + 13, + 5, + 10, + 6, + 0, + 1, + 14, + 11, + 8, + 1, + 9, + 7, + 8, + 43, + 3, + 11, + 12, + 11, + 26, + 2, + 10, + 6, + 2, + 13, + 1, + 22, + 6, + 14, + 3, + 2, + 25, + 1, + 1, + 1, + 8, + 36, + 0, + 6, + 5, + 12, + 2, + 11, + 1, + 0, + 20, + 4, + 6, + 3, + 20, + 8, + 17, + 3, + 6, + 10, + 10, + 17 + ], + "weighted_loads": [ + 0.03993423283100128, + 0.5144063867628574, + 0.6666573043912649, + 0.0, + 1.2669639103114605, + 0.9522770643234253, + 0.04053862392902374, + 5.758279237896204, + 0.9064008556306362, + 0.3342425562441349, + 0.599631629884243, + 0.578317429870367, + 0.0, + 0.04013998061418533, + 0.8889874219894409, + 0.6381502337753773, + 0.391508586704731, + 0.046505965292453766, + 0.7757573500275612, + 0.6387698724865913, + 0.4315730072557926, + 3.5330029353499413, + 0.10011757351458073, + 0.5768027566373348, + 0.7642715275287628, + 1.1782721243798733, + 2.175016922876239, + 0.07442305982112885, + 0.6247013565152884, + 0.48133767396211624, + 0.1333063431084156, + 0.9004211984574795, + 0.05718938633799553, + 0.9802904240787029, + 0.4410534203052521, + 0.8935603387653828, + 0.2006721831858158, + 0.23737477511167526, + 1.618515145033598, + 0.053645409643650055, + 0.03382506221532822, + 0.048311490565538406, + 0.6633037328720093, + 1.9577055014669895, + 0.0, + 0.2327385451644659, + 0.25776729360222816, + 1.127470649778843, + 0.12196183204650879, + 0.6353729739785194, + 0.029103130102157593, + 0.0, + 1.3482623472809792, + 0.3046374171972275, + 0.4346026461571455, + 0.1891501285135746, + 1.3986207991838455, + 0.7277369126677513, + 0.9686587415635586, + 0.14273751527071, + 0.39464354142546654, + 0.6166502051055431, + 0.5429913587868214, + 0.8542463537305593 + ], + "unique_experts": 60, + "load_cv": 1.1981916149916523, + "normalized_load_entropy": 0.8773911976609144, + "max_load_share": 0.12106918238993711 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "1d1fc5b7b42ad9fccca18fb57108b410b8cbc4c8fb115a4af5896df9873668ca", + "route_weight_sha256": "1b9385196d528c8858dd632d8751083eacb8c15ba6285d69cd77cec9b25ee351", + "loads": [ + 1, + 6, + 13, + 1, + 16, + 15, + 1, + 79, + 13, + 6, + 12, + 10, + 4, + 2, + 19, + 11, + 8, + 6, + 13, + 8, + 9, + 45, + 3, + 11, + 13, + 14, + 28, + 20, + 10, + 9, + 12, + 14, + 6, + 38, + 8, + 16, + 5, + 5, + 26, + 1, + 2, + 17, + 10, + 38, + 2, + 12, + 11, + 17, + 10, + 15, + 4, + 14, + 21, + 6, + 6, + 15, + 21, + 16, + 17, + 24, + 17, + 22, + 10, + 18 + ], + "weighted_loads": [ + 0.03993423283100128, + 0.5144063867628574, + 0.7208202732726932, + 0.05708339810371399, + 1.4691891595721245, + 0.9522770643234253, + 0.04053862392902374, + 5.842149831354618, + 0.9064008556306362, + 0.3504807651042938, + 0.677706453949213, + 0.8008906506001949, + 0.20108699798583984, + 0.5090236440300941, + 1.1818877048790455, + 0.6381502337753773, + 0.391508586704731, + 0.40279316157102585, + 1.0999639555811882, + 0.6830091774463654, + 0.47199467569589615, + 3.619091644883156, + 0.10011757351458073, + 0.5768027566373348, + 0.8060545921325684, + 1.5083109382539988, + 2.2455373387783766, + 1.4073254596441984, + 0.6247013565152884, + 0.6132546328008175, + 0.973350502550602, + 0.9141905978322029, + 0.5499709211289883, + 1.7810260318219662, + 0.5834018420428038, + 1.0570192858576775, + 0.2855706848204136, + 0.3640528917312622, + 1.6566826440393925, + 0.053645409643650055, + 0.07600229978561401, + 1.354488767683506, + 0.7091063298285007, + 2.025748312473297, + 0.1437068171799183, + 0.5227829832583666, + 0.5745042189955711, + 1.4008121136575937, + 0.771990455687046, + 0.8414854630827904, + 0.20874441787600517, + 0.8820151537656784, + 1.4178889021277428, + 0.426336333155632, + 0.4346026461571455, + 1.105642281472683, + 1.470658726990223, + 1.256163652986288, + 0.9686587415635586, + 1.4514202438294888, + 1.1768209338188171, + 1.6476058401167393, + 0.5429913587868214, + 0.890494292601943 + ], + "unique_experts": 64, + "load_cv": 0.8756916322901833, + "normalized_load_entropy": 0.9287466275512577, + "max_load_share": 0.08956916099773243 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 106, + "ordered_topk_exact_tokens": 87, + "set_exact_tokens": 94, + "mean_set_jaccard": 0.9676549865229112, + "mean_token_weighted_tv": 0.009523508200457073, + "aggregate_load_tv": 0.0110062893081761 + }, + "system_bos": { + "tokens": 106, + "ordered_topk_exact_tokens": 65, + "set_exact_tokens": 79, + "mean_set_jaccard": 0.92722371967655, + "mean_token_weighted_tv": 0.01742158526168117, + "aggregate_load_tv": 0.029874213836477988 + }, + "system_x": { + "tokens": 106, + "ordered_topk_exact_tokens": 57, + "set_exact_tokens": 77, + "mean_set_jaccard": 0.9218328840970351, + "mean_token_weighted_tv": 0.019562410550930026, + "aggregate_load_tv": 0.02672955974842767 + }, + "system_period": { + "tokens": 106, + "ordered_topk_exact_tokens": 56, + "set_exact_tokens": 78, + "mean_set_jaccard": 0.9225067385444743, + "mean_token_weighted_tv": 0.019766912496877165, + "aggregate_load_tv": 0.031446540880503145 + }, + "bos_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 66, + "set_exact_tokens": 75, + "mean_set_jaccard": 0.9083557951482479, + "mean_token_weighted_tv": 0.022436651120067767, + "aggregate_load_tv": 0.03144654088050314 + }, + "bos_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 63, + "set_exact_tokens": 79, + "mean_set_jaccard": 0.92722371967655, + "mean_token_weighted_tv": 0.019208187457033486, + "aggregate_load_tv": 0.02830188679245283 + }, + "x_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 58, + "set_exact_tokens": 76, + "mean_set_jaccard": 0.9150943396226415, + "mean_token_weighted_tv": 0.020725584299004864, + "aggregate_load_tv": 0.033018867924528295 + }, + "x_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 54, + "set_exact_tokens": 71, + "mean_set_jaccard": 0.9036388140161725, + "mean_token_weighted_tv": 0.02385722614719339, + "aggregate_load_tv": 0.03144654088050314 + }, + "period_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 60, + "set_exact_tokens": 75, + "mean_set_jaccard": 0.9123989218328841, + "mean_token_weighted_tv": 0.02093105250090923, + "aggregate_load_tv": 0.029874213836477988 + }, + "period_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 58, + "set_exact_tokens": 77, + "mean_set_jaccard": 0.9218328840970351, + "mean_token_weighted_tv": 0.02120664586611795, + "aggregate_load_tv": 0.02830188679245283 + } + } + }, + "layer_11": { + "layer": 11, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "4b1d87440f0ed0684b8957e81ac6569d8e51d1bb7ca368903c1dff5cb69ae135", + "route_weight_sha256": "6308faba8d0a0fa6cf2a4e4935f29d6d925d1fbdff459c2f55260ee312899d10", + "loads": [ + 5, + 8, + 6, + 36, + 3, + 0, + 7, + 3, + 5, + 5, + 1, + 8, + 14, + 21, + 53, + 8, + 4, + 7, + 1, + 22, + 8, + 15, + 5, + 8, + 5, + 6, + 9, + 9, + 0, + 31, + 36, + 7, + 31, + 27, + 3, + 4, + 9, + 2, + 2, + 9, + 14, + 31, + 8, + 0, + 21, + 9, + 4, + 1, + 4, + 14, + 14, + 14, + 13, + 0, + 1, + 2, + 2, + 11, + 3, + 7, + 7, + 9, + 4, + 0 + ], + "weighted_loads": [ + 0.26545171067118645, + 0.40832236781716347, + 0.5035345554351807, + 1.9241983629763126, + 0.10914527252316475, + 0.0, + 0.3801582418382168, + 0.163464467972517, + 0.33765895664691925, + 0.24571601673960686, + 0.047118980437517166, + 0.365037702023983, + 0.7455920893698931, + 1.4659338556230068, + 3.9042216949164867, + 0.35404255986213684, + 0.17297201231122017, + 0.26803385466337204, + 0.036519743502140045, + 1.1879064999520779, + 0.6222416162490845, + 1.0324679352343082, + 0.17605124600231647, + 0.6093945503234863, + 0.20998040586709976, + 0.3475765697658062, + 0.34328808076679707, + 0.5084939673542976, + 0.0, + 2.226338267326355, + 1.8102843463420868, + 0.3857763893902302, + 2.3206097185611725, + 1.5459708496928215, + 0.15579007752239704, + 0.4850723147392273, + 0.49235155060887337, + 0.07378437742590904, + 0.0682106502354145, + 0.45401037856936455, + 0.9266417250037193, + 1.8894262183457613, + 0.4848138242959976, + 0.0, + 1.5253383331000805, + 0.7517745494842529, + 0.169124536216259, + 0.040222860872745514, + 0.23686303570866585, + 1.1477239914238453, + 0.6499520055949688, + 1.1887784451246262, + 0.655208058655262, + 0.0, + 0.03050900250673294, + 0.10841508954763412, + 0.091106366366148, + 0.5724056679755449, + 0.13788341358304024, + 0.48012850061059, + 0.4580758512020111, + 1.2542942352592945, + 0.14418712630867958, + 0.0 + ], + "unique_experts": 59, + "load_cv": 1.0525340911972363, + "normalized_load_entropy": 0.889589566618353, + "max_load_share": 0.08333333333333333 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "87c2d9f4d4d28aa990afff2dec2a9fddb3d4a702ed036665e9273f966bb8c033", + "route_weight_sha256": "ebc871151dd27645b14c674a91fedb07e0883d99d5768d04bccf6e57fba04d3a", + "loads": [ + 5, + 9, + 7, + 36, + 8, + 0, + 7, + 3, + 8, + 6, + 5, + 11, + 14, + 21, + 53, + 14, + 9, + 9, + 13, + 22, + 8, + 15, + 6, + 13, + 5, + 6, + 10, + 11, + 6, + 31, + 42, + 15, + 33, + 27, + 7, + 8, + 9, + 2, + 2, + 9, + 21, + 31, + 8, + 22, + 23, + 9, + 4, + 9, + 4, + 17, + 14, + 14, + 13, + 0, + 5, + 4, + 2, + 11, + 6, + 8, + 8, + 15, + 12, + 1 + ], + "weighted_loads": [ + 0.26545171067118645, + 0.4390721470117569, + 0.5617959760129452, + 1.9241983629763126, + 0.332118958234787, + 0.0, + 0.3801582418382168, + 0.163464467972517, + 0.5138701014220715, + 0.2766457460820675, + 0.16392404260113835, + 0.41911145113408566, + 0.7455920893698931, + 1.4659338556230068, + 3.9042216949164867, + 0.5853516757488251, + 0.7441748827695847, + 0.2979943146929145, + 2.1046069897711277, + 1.1879064999520779, + 0.6222416162490845, + 1.0324679352343082, + 0.18000599276274443, + 0.8586287572979927, + 0.20998040586709976, + 0.3475765697658062, + 0.346659786766395, + 0.5687108235433698, + 0.46550923958420753, + 2.226338267326355, + 2.102411797270179, + 0.7374504208564758, + 2.3861130978912115, + 1.5459708496928215, + 0.3358154948800802, + 0.7977876476943493, + 0.49235155060887337, + 0.07378437742590904, + 0.0682106502354145, + 0.45401037856936455, + 1.2744915448129177, + 1.8894262183457613, + 0.4848138242959976, + 2.137112010270357, + 1.6527464017271996, + 0.7517745494842529, + 0.169124536216259, + 0.6206588037312031, + 0.23686303570866585, + 1.3326697163283825, + 0.6499520055949688, + 1.1887784451246262, + 0.655208058655262, + 0.0, + 0.22778398916125298, + 0.20005758851766586, + 0.091106366366148, + 0.5724056679755449, + 0.2749410979449749, + 0.5393722169101238, + 0.48998285084962845, + 1.5931204240769148, + 0.6187935806810856, + 0.026970436796545982 + ], + "unique_experts": 62, + "load_cv": 0.8336702696657483, + "normalized_load_entropy": 0.9284366209018127, + "max_load_share": 0.06743002544529263 + } + }, + "s1_eos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "7f6c6b267270dcb05e6c855d9eaa21cc39bc5c8d163709c707f7f74eec613d78", + "route_weight_sha256": "3a09211fe92eb56d75f4eef20c51f4af8321c548c6cc73e42a286c1704a1efb8", + "loads": [ + 5, + 7, + 8, + 34, + 3, + 0, + 7, + 3, + 5, + 5, + 2, + 8, + 14, + 20, + 56, + 8, + 4, + 6, + 1, + 22, + 9, + 15, + 5, + 8, + 6, + 6, + 7, + 10, + 0, + 31, + 35, + 7, + 30, + 27, + 4, + 4, + 10, + 2, + 2, + 8, + 14, + 30, + 8, + 0, + 20, + 9, + 4, + 1, + 4, + 14, + 15, + 14, + 14, + 0, + 1, + 2, + 2, + 11, + 3, + 7, + 7, + 9, + 3, + 0 + ], + "weighted_loads": [ + 0.26675277948379517, + 0.38435073569417, + 0.5833518318831921, + 1.8634723275899887, + 0.11239251494407654, + 0.0, + 0.377290029078722, + 0.16569554060697556, + 0.3396593779325485, + 0.24634090438485146, + 0.08588530495762825, + 0.36375923827290535, + 0.7515444979071617, + 1.4291481859982014, + 4.048986773937941, + 0.3503144010901451, + 0.17232432588934898, + 0.22866136208176613, + 0.03622697666287422, + 1.2073829509317875, + 0.6486072055995464, + 1.0260095596313477, + 0.17267580144107342, + 0.6079737618565559, + 0.24474162608385086, + 0.3456328511238098, + 0.2694616951048374, + 0.5437709502875805, + 0.0, + 2.250016700476408, + 1.7704468481242657, + 0.3761579729616642, + 2.276290025562048, + 1.5366192534565926, + 0.1807479728013277, + 0.4792076647281647, + 0.5245080962777138, + 0.07470349222421646, + 0.07193728536367416, + 0.4192405641078949, + 0.9013205133378506, + 1.8565826192498207, + 0.4895901791751385, + 0.0, + 1.4894830323755741, + 0.7460076697170734, + 0.168687105178833, + 0.04022322595119476, + 0.2310909666121006, + 1.1504226587712765, + 0.6899272091686726, + 1.2049822211265564, + 0.6841293722391129, + 0.0, + 0.03074604645371437, + 0.10651925951242447, + 0.0878058485686779, + 0.5815261527895927, + 0.14244280755519867, + 0.4859680272638798, + 0.4584548585116863, + 1.2501881830394268, + 0.11164307594299316, + 0.0 + ], + "unique_experts": 59, + "load_cv": 1.0516317578222718, + "normalized_load_entropy": 0.8910442210712308, + "max_load_share": 0.0880503144654088 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "9eec1d05650d8887209dfd3fc71893e5ce33abd9e8a2dd5a2e39ca51f6f4013f", + "route_weight_sha256": "fe4fddc118d2436e236b7255e5d8a633608da7dd10f99e82462b7fdd941ecc4b", + "loads": [ + 7, + 8, + 9, + 34, + 14, + 4, + 7, + 5, + 14, + 5, + 7, + 11, + 14, + 20, + 56, + 9, + 23, + 8, + 12, + 23, + 10, + 16, + 8, + 13, + 6, + 6, + 10, + 13, + 10, + 31, + 43, + 13, + 31, + 27, + 8, + 11, + 10, + 2, + 2, + 9, + 20, + 30, + 8, + 26, + 22, + 9, + 5, + 14, + 4, + 18, + 15, + 14, + 14, + 5, + 19, + 9, + 8, + 12, + 5, + 12, + 10, + 18, + 14, + 2 + ], + "weighted_loads": [ + 0.4126493036746979, + 0.41728347167372704, + 0.6309469267725945, + 1.8634723275899887, + 0.6867468245327473, + 0.1424565203487873, + 0.377290029078722, + 0.2939024306833744, + 0.8840354308485985, + 0.24634090438485146, + 0.2433102303184569, + 0.41688454523682594, + 0.7515444979071617, + 1.4291481859982014, + 4.048986773937941, + 0.3901400566101074, + 1.8952984400093555, + 0.25764457043260336, + 2.09014905244112, + 1.24568135663867, + 0.7215951345860958, + 1.0982584282755852, + 0.28459309646859765, + 0.8313096836209297, + 0.24474162608385086, + 0.3456328511238098, + 0.3489218207541853, + 0.6498604724183679, + 0.7672496512532234, + 2.250016700476408, + 2.1755855195224285, + 0.6548122614622116, + 2.3088079281151295, + 1.5366192534565926, + 0.3791962545365095, + 1.0558600276708603, + 0.5245080962777138, + 0.07470349222421646, + 0.07193728536367416, + 0.46585893258452415, + 1.1786660626530647, + 1.8565826192498207, + 0.4895901791751385, + 2.4699151031672955, + 1.627722628414631, + 0.7460076697170734, + 0.2149418443441391, + 1.0495682209730148, + 0.2310909666121006, + 1.4475570432841778, + 0.6899272091686726, + 1.2049822211265564, + 0.6841293722391129, + 0.3046979382634163, + 1.1238082684576511, + 0.4380844086408615, + 0.558709193021059, + 0.6238129138946533, + 0.24415628984570503, + 0.7033557556569576, + 0.5724693275988102, + 1.7174909245222807, + 0.6857751272618771, + 0.07072880305349827 + ], + "unique_experts": 64, + "load_cv": 0.7184988942520638, + "normalized_load_entropy": 0.9477897938521193, + "max_load_share": 0.06349206349206349 + } + }, + "s0_bos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "cf68f8da993223827f6ad80657c30eeb298e0e75ec46fdb09562c5e3d519e21b", + "route_weight_sha256": "4a21c2dce915ab14021a0c3b2118cfcc6803c4ef5759d4ff6200ac6c49793d45", + "loads": [ + 5, + 7, + 7, + 32, + 2, + 0, + 7, + 3, + 5, + 5, + 2, + 8, + 14, + 20, + 56, + 6, + 5, + 5, + 1, + 22, + 9, + 15, + 5, + 8, + 6, + 6, + 8, + 9, + 0, + 32, + 37, + 7, + 31, + 26, + 3, + 4, + 8, + 1, + 3, + 10, + 15, + 31, + 6, + 0, + 21, + 11, + 4, + 1, + 4, + 14, + 14, + 14, + 11, + 0, + 0, + 2, + 3, + 11, + 4, + 6, + 8, + 10, + 5, + 1 + ], + "weighted_loads": [ + 0.26589368656277657, + 0.3673239052295685, + 0.555907778441906, + 1.7543144151568413, + 0.07676922902464867, + 0.0, + 0.38468898087739944, + 0.16401070728898048, + 0.34248466044664383, + 0.24861392751336098, + 0.0854158028960228, + 0.3545694090425968, + 0.7452841140329838, + 1.416208479553461, + 3.9706560596823692, + 0.2797209247946739, + 0.20965810865163803, + 0.19478662870824337, + 0.03591391071677208, + 1.193619441241026, + 0.7095241062343121, + 1.0441971942782402, + 0.17542850971221924, + 0.6118074506521225, + 0.24252204410731792, + 0.34641188383102417, + 0.3094336725771427, + 0.5270838923752308, + 0.0, + 2.347087223082781, + 1.9061128087341785, + 0.39674731716513634, + 2.3554009199142456, + 1.528905626386404, + 0.15002650767564774, + 0.48020437359809875, + 0.4412023350596428, + 0.03174422308802605, + 0.10932759195566177, + 0.49435069784522057, + 0.9804943166673183, + 1.8860353399068117, + 0.40596768632531166, + 0.0, + 1.5555937960743904, + 0.8757657743990421, + 0.16815658658742905, + 0.03867589309811592, + 0.23407384008169174, + 1.14793810993433, + 0.6411626078188419, + 1.2011325918138027, + 0.5650705732405186, + 0.0, + 0.0, + 0.10813494026660919, + 0.1364326775074005, + 0.5628479346632957, + 0.1706702969968319, + 0.44224969670176506, + 0.5002611950039864, + 1.3112445585429668, + 0.19736965745687485, + 0.034393925219774246 + ], + "unique_experts": 59, + "load_cv": 1.0600236658046736, + "normalized_load_entropy": 0.8900305783764142, + "max_load_share": 0.0880503144654088 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "29c08ad1b34ec2472db53f833e0a8fc3a5c83e32e5f97bdc80d3bf304726bd0b", + "route_weight_sha256": "5f41b0f610ddb80001c86ebc438cbd1a636595a570718efb17d5ea19631e1e18", + "loads": [ + 5, + 8, + 8, + 32, + 7, + 0, + 7, + 3, + 8, + 7, + 5, + 10, + 14, + 20, + 56, + 13, + 11, + 6, + 12, + 22, + 9, + 15, + 5, + 13, + 6, + 6, + 8, + 12, + 6, + 32, + 43, + 15, + 33, + 26, + 7, + 8, + 8, + 1, + 3, + 10, + 23, + 31, + 6, + 22, + 23, + 11, + 4, + 9, + 4, + 17, + 14, + 14, + 11, + 0, + 4, + 3, + 3, + 11, + 7, + 7, + 10, + 17, + 14, + 1 + ], + "weighted_loads": [ + 0.26589368656277657, + 0.3980736844241619, + 0.6141691990196705, + 1.7543144151568413, + 0.2997429147362709, + 0.0, + 0.38468898087739944, + 0.16401070728898048, + 0.5155389793217182, + 0.3153141662478447, + 0.1979710515588522, + 0.39643357414752245, + 0.7452841140329838, + 1.416208479553461, + 3.9706560596823692, + 0.5433079078793526, + 0.8629644922912121, + 0.20962687488645315, + 1.208762340247631, + 1.193619441241026, + 0.7095241062343121, + 1.0441971942782402, + 0.17542850971221924, + 0.8610416576266289, + 0.24252204410731792, + 0.34641188383102417, + 0.3094336725771427, + 0.6327735977247357, + 0.4578249752521515, + 2.347087223082781, + 2.1982402596622705, + 0.748421348631382, + 2.4209042992442846, + 1.528905626386404, + 0.3276018686592579, + 0.7947137616574764, + 0.4412023350596428, + 0.03174422308802605, + 0.10932759195566177, + 0.49435069784522057, + 1.4189613722264767, + 1.8860353399068117, + 0.40596768632531166, + 2.2841840125620365, + 1.6830018647015095, + 0.8757657743990421, + 0.16815658658742905, + 0.6080773137509823, + 0.23407384008169174, + 1.3253308609127998, + 0.6411626078188419, + 1.2011325918138027, + 0.5650705732405186, + 0.0, + 0.19117647595703602, + 0.1522780880331993, + 0.1364326775074005, + 0.5628479346632957, + 0.30772798135876656, + 0.49841608107089996, + 0.5789225697517395, + 1.7104191612452269, + 0.7421929091215134, + 0.034393925219774246 + ], + "unique_experts": 62, + "load_cv": 0.8475956450970142, + "normalized_load_entropy": 0.9267674336919711, + "max_load_share": 0.07124681933842239 + } + }, + "s1_bos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "063878f4a3311799da1d6ac9c354f96cf7fb0fae4e39c28fc6e459afabfe3ed0", + "route_weight_sha256": "7725d027d95e00fe2a0cc37a90048403f9f5af9009c778c203d548d2afca33a3", + "loads": [ + 4, + 7, + 8, + 31, + 1, + 0, + 7, + 3, + 5, + 7, + 2, + 9, + 14, + 21, + 58, + 8, + 4, + 3, + 1, + 22, + 9, + 15, + 4, + 8, + 6, + 5, + 8, + 8, + 0, + 33, + 34, + 7, + 29, + 25, + 4, + 4, + 9, + 1, + 3, + 10, + 14, + 31, + 7, + 0, + 20, + 12, + 4, + 1, + 4, + 14, + 15, + 15, + 13, + 0, + 0, + 2, + 2, + 12, + 4, + 6, + 8, + 10, + 4, + 1 + ], + "weighted_loads": [ + 0.2274002470076084, + 0.37678568065166473, + 0.5813726335763931, + 1.7261734157800674, + 0.04210631176829338, + 0.0, + 0.38105520606040955, + 0.16009849682450294, + 0.34611400216817856, + 0.3322046622633934, + 0.08248688280582428, + 0.3903672844171524, + 0.7388038486242294, + 1.4724295251071453, + 4.05369645357132, + 0.3489683233201504, + 0.16797276213765144, + 0.12139297649264336, + 0.03492068126797676, + 1.2125283852219582, + 0.6797452382743359, + 1.0483843982219696, + 0.1449864450842142, + 0.6164077706634998, + 0.2419740241020918, + 0.31489090248942375, + 0.3090282753109932, + 0.503669835627079, + 0.0, + 2.368911702185869, + 1.7375390753149986, + 0.3936556950211525, + 2.2502124942839146, + 1.4876281395554543, + 0.16401616856455803, + 0.4824768006801605, + 0.48160238191485405, + 0.03283311054110527, + 0.12092729285359383, + 0.4942653141915798, + 0.9308821298182011, + 1.9510830119252205, + 0.4483342729508877, + 0.0, + 1.5084886997938156, + 0.8777532149106264, + 0.16975292935967445, + 0.03861263394355774, + 0.22582148015499115, + 1.1480556577444077, + 0.6932416558265686, + 1.2634464018046856, + 0.6463257297873497, + 0.0, + 0.0, + 0.10752912610769272, + 0.08655795454978943, + 0.6141620203852654, + 0.17577799782156944, + 0.44229158759117126, + 0.4981972724199295, + 1.3162950351834297, + 0.15342240408062935, + 0.03594175726175308 + ], + "unique_experts": 59, + "load_cv": 1.0601729176151644, + "normalized_load_entropy": 0.8889459954177847, + "max_load_share": 0.09119496855345911 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "db3c1b6b3634163e1118bfe96b741309482c6289ddfbfea6814227d0e86e5538", + "route_weight_sha256": "5ed753acdc5d50aff7ab96a6915cdba14f2e6404d7742ff5e1520859d2ddc829", + "loads": [ + 6, + 8, + 9, + 31, + 12, + 4, + 7, + 5, + 15, + 8, + 5, + 11, + 14, + 21, + 58, + 10, + 23, + 4, + 11, + 23, + 10, + 16, + 6, + 13, + 6, + 5, + 10, + 11, + 9, + 33, + 42, + 13, + 30, + 25, + 8, + 11, + 9, + 1, + 3, + 11, + 22, + 31, + 7, + 26, + 22, + 12, + 5, + 15, + 4, + 18, + 15, + 15, + 13, + 5, + 18, + 9, + 8, + 13, + 6, + 12, + 10, + 21, + 16, + 2 + ], + "weighted_loads": [ + 0.3732967711985111, + 0.40971841663122177, + 0.6289677284657955, + 1.7261734157800674, + 0.6164606213569641, + 0.1424565203487873, + 0.38105520606040955, + 0.2883053869009018, + 0.9338930882513523, + 0.3656670153141022, + 0.19136191345751286, + 0.4321260014548898, + 0.7388038486242294, + 1.4724295251071453, + 4.05369645357132, + 0.4201198183000088, + 1.94713818654418, + 0.13623322267085314, + 1.190480537712574, + 1.2508267909288406, + 0.7527331672608852, + 1.1206332668662071, + 0.25312922708690166, + 0.8397436924278736, + 0.2419740241020918, + 0.31489090248942375, + 0.38532793149352074, + 0.6123246671631932, + 0.7224895767867565, + 2.368911702185869, + 2.1426777467131615, + 0.6723099835216999, + 2.282730396836996, + 1.4876281395554543, + 0.35987500101327896, + 1.0471043959259987, + 0.48160238191485405, + 0.03283311054110527, + 0.12092729285359383, + 0.5408836826682091, + 1.3671442307531834, + 1.9510830119252205, + 0.4483342729508877, + 2.670016884803772, + 1.6467282958328724, + 0.8777532149106264, + 0.21600766852498055, + 1.069721806794405, + 0.22582148015499115, + 1.444377139210701, + 0.6932416558265686, + 1.2634464018046856, + 0.6463257297873497, + 0.3046979382634163, + 1.083843333646655, + 0.43909427523612976, + 0.5574612990021706, + 0.6564487814903259, + 0.2774914801120758, + 0.6799233704805374, + 0.5856522768735886, + 1.8891275133937597, + 0.7738927491009235, + 0.07828819006681442 + ], + "unique_experts": 64, + "load_cv": 0.7296339010403502, + "normalized_load_entropy": 0.9457989903903397, + "max_load_share": 0.06575963718820861 + } + }, + "s0_x": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "c9d2102c4e765ca32e668a3cb4765d2dd08e77646cec3289e66efe9c2cad66dd", + "route_weight_sha256": "7a1c4be6944fc03f96cd76e1414f5aa1929535c5963245cd1b21f52c6f4f8ef2", + "loads": [ + 4, + 7, + 7, + 33, + 1, + 0, + 7, + 3, + 5, + 7, + 2, + 9, + 14, + 20, + 58, + 7, + 5, + 3, + 1, + 22, + 9, + 15, + 5, + 8, + 5, + 6, + 7, + 10, + 0, + 34, + 36, + 7, + 30, + 26, + 3, + 4, + 9, + 1, + 3, + 10, + 13, + 32, + 6, + 0, + 21, + 10, + 4, + 1, + 4, + 14, + 14, + 15, + 13, + 0, + 0, + 2, + 2, + 10, + 4, + 6, + 8, + 9, + 4, + 1 + ], + "weighted_loads": [ + 0.22547554224729538, + 0.374129805713892, + 0.5517630837857723, + 1.795439686626196, + 0.040227506309747696, + 0.0, + 0.38116586208343506, + 0.16148146986961365, + 0.3377590626478195, + 0.3362540043890476, + 0.0831357054412365, + 0.39819036796689034, + 0.7263783402740955, + 1.4146955497562885, + 4.0121275801211596, + 0.3052460700273514, + 0.20726271346211433, + 0.12932007759809494, + 0.03599163889884949, + 1.1929005794227123, + 0.7022384218871593, + 1.0360158756375313, + 0.17662856355309486, + 0.6027786545455456, + 0.20718073099851608, + 0.35499537736177444, + 0.27649600617587566, + 0.5569475870579481, + 0.0, + 2.416768167167902, + 1.8547274097800255, + 0.3750704862177372, + 2.308298707008362, + 1.516906913369894, + 0.14683321677148342, + 0.48785319924354553, + 0.48392927274107933, + 0.03031429462134838, + 0.11567226052284241, + 0.49814749509096146, + 0.8798824213445187, + 1.935255715623498, + 0.4032624363899231, + 0.0, + 1.5362603329122066, + 0.8353190310299397, + 0.1653833296149969, + 0.03989965841174126, + 0.22403917461633682, + 1.1305187977850437, + 0.6486579701304436, + 1.2400602772831917, + 0.6356501244008541, + 0.0, + 0.0, + 0.10649542137980461, + 0.09428133815526962, + 0.5346271023154259, + 0.17078343033790588, + 0.4417048282921314, + 0.4802703894674778, + 1.2412016578018665, + 0.14936474338173866, + 0.034235041588544846 + ], + "unique_experts": 59, + "load_cv": 1.084809949291962, + "normalized_load_entropy": 0.8856400513915555, + "max_load_share": 0.09119496855345911 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "fb1ff209add5689ce31e7b7829c73763c8743b6a55a0963bef03b45315f37dbd", + "route_weight_sha256": "49bd2a515a42e760bec84a4c57b7422b3c60fc56465d2f5c54ffe817269de02f", + "loads": [ + 4, + 9, + 8, + 33, + 6, + 0, + 7, + 3, + 9, + 8, + 4, + 11, + 14, + 20, + 58, + 13, + 10, + 5, + 13, + 22, + 9, + 15, + 5, + 13, + 5, + 6, + 7, + 12, + 6, + 34, + 42, + 16, + 32, + 26, + 8, + 8, + 9, + 1, + 3, + 10, + 19, + 32, + 6, + 21, + 23, + 10, + 4, + 9, + 4, + 19, + 14, + 15, + 13, + 1, + 4, + 3, + 2, + 10, + 8, + 7, + 9, + 15, + 13, + 1 + ], + "weighted_loads": [ + 0.22547554224729538, + 0.4444102980196476, + 0.6100245043635368, + 1.795439686626196, + 0.26320119202136993, + 0.0, + 0.38116586208343506, + 0.16148146986961365, + 0.563910435885191, + 0.36718373373150826, + 0.15025985054671764, + 0.44005453307181597, + 0.7263783402740955, + 1.4146955497562885, + 4.0121275801211596, + 0.5365551859140396, + 0.7676416374742985, + 0.17977134976536036, + 1.3005156703293324, + 1.1929005794227123, + 0.7022384218871593, + 1.0360158756375313, + 0.17662856355309486, + 0.852012861520052, + 0.20718073099851608, + 0.35499537736177444, + 0.27649600617587566, + 0.6219367971643806, + 0.4611654430627823, + 2.416768167167902, + 2.1468548607081175, + 0.7753102071583271, + 2.373802086338401, + 1.516906913369894, + 0.4197112862020731, + 0.814607810229063, + 0.48392927274107933, + 0.03031429462134838, + 0.11567226052284241, + 0.49814749509096146, + 1.2057052813470364, + 1.935255715623498, + 0.4032624363899231, + 2.0065398775041103, + 1.6636684015393257, + 0.8353190310299397, + 0.1653833296149969, + 0.6187601387500763, + 0.22403917461633682, + 1.4049938432872295, + 0.6486579701304436, + 1.2400602772831917, + 0.6356501244008541, + 0.05562260374426842, + 0.19471074268221855, + 0.15063856914639473, + 0.09428133815526962, + 0.5346271023154259, + 0.3680431880056858, + 0.49662144109606743, + 0.5109669174998999, + 1.5673990193754435, + 0.6430556885898113, + 0.034235041588544846 + ], + "unique_experts": 63, + "load_cv": 0.8599718409250325, + "normalized_load_entropy": 0.9257325277577036, + "max_load_share": 0.0737913486005089 + } + }, + "s1_x": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "d380c9ffbceb286c20933907383c0a62fcd0e05223bee4109f8cca9e80c433d9", + "route_weight_sha256": "964d5e7d20f9a8e142d30039e2166af869293cef9ab90a49f72f1050ac843e12", + "loads": [ + 5, + 8, + 8, + 31, + 1, + 0, + 7, + 3, + 5, + 7, + 1, + 9, + 14, + 20, + 60, + 7, + 5, + 3, + 1, + 22, + 9, + 15, + 3, + 8, + 6, + 5, + 10, + 9, + 0, + 34, + 34, + 6, + 29, + 26, + 3, + 4, + 9, + 0, + 3, + 9, + 13, + 31, + 6, + 0, + 20, + 12, + 4, + 1, + 4, + 14, + 15, + 15, + 13, + 0, + 0, + 2, + 2, + 11, + 5, + 6, + 8, + 10, + 4, + 1 + ], + "weighted_loads": [ + 0.26611625775694847, + 0.4170880429446697, + 0.5725844241678715, + 1.7106986157596111, + 0.04797579348087311, + 0.0, + 0.37774263322353363, + 0.15638714656233788, + 0.3445042297244072, + 0.3310643918812275, + 0.03949274495244026, + 0.39407455921173096, + 0.7264003269374371, + 1.427194457501173, + 4.099747447296977, + 0.30173090286552906, + 0.20036419481039047, + 0.11973566934466362, + 0.03497825935482979, + 1.2117819711565971, + 0.6715496331453323, + 1.0365066826343536, + 0.10435261018574238, + 0.609790213406086, + 0.24800994619727135, + 0.32542990893125534, + 0.3788827359676361, + 0.5377489328384399, + 0.0, + 2.347475677728653, + 1.7336610723286867, + 0.35568175464868546, + 2.278047449886799, + 1.5233853906393051, + 0.1295232381671667, + 0.4870050698518753, + 0.47542232275009155, + 0.0, + 0.12757115811109543, + 0.454434409737587, + 0.8738884925842285, + 1.9626726973801851, + 0.4050101041793823, + 0.0, + 1.5066396854817867, + 0.8745799846947193, + 0.16880569607019424, + 0.040196143090724945, + 0.22609280049800873, + 1.107619896531105, + 0.6982704363763332, + 1.2536387871950865, + 0.6387401036918163, + 0.0, + 0.0, + 0.10662855207920074, + 0.08782420679926872, + 0.5753360651433468, + 0.20762187987565994, + 0.4446004219353199, + 0.4840441979467869, + 1.2923455573618412, + 0.15213772282004356, + 0.03690347447991371 + ], + "unique_experts": 58, + "load_cv": 1.0808647742704414, + "normalized_load_entropy": 0.8851658420094204, + "max_load_share": 0.09433962264150944 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "7800145412afa954c053c637bfa226f7803301a83d77f51515bdc67086df640d", + "route_weight_sha256": "7eaa6f17a6d74c194d2166b93d04bfd2ab0bc78c65c88f8624bbdc8fa54e621b", + "loads": [ + 7, + 10, + 9, + 31, + 12, + 4, + 7, + 5, + 15, + 7, + 4, + 11, + 14, + 20, + 60, + 8, + 24, + 4, + 12, + 23, + 10, + 16, + 5, + 13, + 6, + 5, + 12, + 13, + 10, + 34, + 42, + 13, + 30, + 26, + 8, + 11, + 9, + 0, + 3, + 10, + 18, + 31, + 6, + 26, + 22, + 12, + 5, + 13, + 4, + 20, + 15, + 15, + 13, + 6, + 20, + 9, + 8, + 12, + 8, + 11, + 9, + 19, + 15, + 2 + ], + "weighted_loads": [ + 0.4120127819478512, + 0.49103186652064323, + 0.6201795190572739, + 1.7106986157596111, + 0.6223301030695438, + 0.1424565203487873, + 0.37774263322353363, + 0.2845940366387367, + 0.964513748884201, + 0.3310643918812275, + 0.14836777560412884, + 0.4358332762494683, + 0.7264003269374371, + 1.427194457501173, + 4.099747447296977, + 0.34155655838549137, + 1.912932962179184, + 0.1345759155228734, + 1.267788365483284, + 1.2500803768634796, + 0.7445375621318817, + 1.1087555512785912, + 0.21249539218842983, + 0.8331261351704597, + 0.24800994619727135, + 0.32542990893125534, + 0.45518239215016365, + 0.7017653109505773, + 0.7616326808929443, + 2.347475677728653, + 2.1387997437268496, + 0.6835462041199207, + 2.3105653524398804, + 1.5233853906393051, + 0.40946550108492374, + 1.0782602056860924, + 0.47542232275009155, + 0.0, + 0.12757115811109543, + 0.5010527782142162, + 1.1147707402706146, + 1.9626726973801851, + 0.4050101041793823, + 2.3783347196877003, + 1.6448792815208435, + 0.8745799846947193, + 0.21506043523550034, + 1.0053867101669312, + 0.22609280049800873, + 1.4875628724694252, + 0.6982704363763332, + 1.2536387871950865, + 0.6387401036918163, + 0.35487687587738037, + 1.1470942329615355, + 0.4381937012076378, + 0.5587275512516499, + 0.6176228262484074, + 0.3565986827015877, + 0.6583140455186367, + 0.5220341570675373, + 1.7573118936270475, + 0.7694738283753395, + 0.07924990728497505 + ], + "unique_experts": 63, + "load_cv": 0.7427091405506528, + "normalized_load_entropy": 0.9438670757242716, + "max_load_share": 0.06802721088435375 + } + }, + "s0_period": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "77d001447a59e39aee2bfbb4bb385c4e103a5c9760015924cf55392d773bb579", + "route_weight_sha256": "8201d380a42f8a2f158e86ef35b8a809caea916bf0d6a4879210d565da58cb49", + "loads": [ + 5, + 7, + 7, + 31, + 1, + 0, + 7, + 3, + 5, + 6, + 3, + 8, + 14, + 20, + 59, + 7, + 5, + 4, + 1, + 22, + 9, + 15, + 4, + 8, + 6, + 6, + 7, + 9, + 0, + 32, + 34, + 7, + 30, + 26, + 3, + 4, + 9, + 1, + 2, + 8, + 14, + 34, + 7, + 0, + 21, + 11, + 4, + 1, + 4, + 14, + 16, + 14, + 13, + 0, + 0, + 2, + 3, + 10, + 4, + 6, + 7, + 11, + 4, + 1 + ], + "weighted_loads": [ + 0.2649393565952778, + 0.37668392807245255, + 0.5531094186007977, + 1.7165585421025753, + 0.04064379259943962, + 0.0, + 0.3789537623524666, + 0.15915557369589806, + 0.3402586989104748, + 0.296207744628191, + 0.11704427748918533, + 0.3622630052268505, + 0.7402814216911793, + 1.4107555374503136, + 4.075305033475161, + 0.31329451128840446, + 0.20576239004731178, + 0.16208627074956894, + 0.03607397526502609, + 1.1872294023633003, + 0.700656346976757, + 1.0285280458629131, + 0.14715103432536125, + 0.6088940016925335, + 0.24098369106650352, + 0.35580411553382874, + 0.27505243569612503, + 0.5269590578973293, + 0.0, + 2.334094364196062, + 1.7410255428403616, + 0.37699807435274124, + 2.2959041111171246, + 1.5110058411955833, + 0.1504425462335348, + 0.49525136500597, + 0.48043281212449074, + 0.03258560225367546, + 0.06340517476201057, + 0.43141473457217216, + 0.9336184225976467, + 2.0139661952853203, + 0.44841280207037926, + 0.0, + 1.5361587181687355, + 0.8591240532696247, + 0.1704748049378395, + 0.03949456289410591, + 0.23416649922728539, + 1.1324021704494953, + 0.7226634174585342, + 1.201393686234951, + 0.6358902789652348, + 0.0, + 0.0, + 0.1071818396449089, + 0.13558350130915642, + 0.5386918038129807, + 0.1722199134528637, + 0.44061316922307014, + 0.44809452816843987, + 1.3336250372231007, + 0.14918704330921173, + 0.03348781168460846 + ], + "unique_experts": 59, + "load_cv": 1.0777863208941678, + "normalized_load_entropy": 0.8873826093574206, + "max_load_share": 0.09276729559748427 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "ae5d3e55c835cfbe299d7faf9ee94d21dff7c8438844ad60ce1d1a7e42526936", + "route_weight_sha256": "800b9b868ff905fec914aab9e51503fbe6ad2fe5b2ff5396b4b4a93e82373921", + "loads": [ + 5, + 8, + 8, + 31, + 7, + 0, + 7, + 3, + 9, + 7, + 5, + 10, + 14, + 20, + 59, + 14, + 11, + 5, + 13, + 22, + 9, + 15, + 4, + 13, + 6, + 6, + 7, + 11, + 7, + 32, + 40, + 16, + 32, + 26, + 7, + 9, + 9, + 1, + 2, + 8, + 20, + 34, + 7, + 23, + 23, + 11, + 4, + 9, + 4, + 18, + 16, + 14, + 13, + 0, + 4, + 4, + 3, + 10, + 7, + 7, + 8, + 17, + 11, + 1 + ], + "weighted_loads": [ + 0.2649393565952778, + 0.407433707267046, + 0.6113708391785622, + 1.7165585421025753, + 0.3503844290971756, + 0.0, + 0.3789537623524666, + 0.15915557369589806, + 0.5673865936696529, + 0.3271374739706516, + 0.18416842259466648, + 0.40412717033177614, + 0.7402814216911793, + 1.4107555374503136, + 4.075305033475161, + 0.5839537791907787, + 0.8200983852148056, + 0.17692651692777872, + 1.2501915507018566, + 1.1872294023633003, + 0.700656346976757, + 1.0285280458629131, + 0.14715103432536125, + 0.8581282086670399, + 0.24098369106650352, + 0.35580411553382874, + 0.27505243569612503, + 0.5888795936480165, + 0.4994458928704262, + 2.334094364196062, + 2.0331529937684536, + 0.7696454487740993, + 2.3614074904471636, + 1.5110058411955833, + 0.35040990449488163, + 0.9725234135985374, + 0.48043281212449074, + 0.03258560225367546, + 0.06340517476201057, + 0.43141473457217216, + 1.2660701535642147, + 2.0139661952853203, + 0.44841280207037926, + 2.1251609586179256, + 1.6635667867958546, + 0.8591240532696247, + 0.1704748049378395, + 0.6166993826627731, + 0.23416649922728539, + 1.3628806062042713, + 0.7226634174585342, + 1.201393686234951, + 0.6358902789652348, + 0.0, + 0.19469379261136055, + 0.1923961602151394, + 0.13558350130915642, + 0.5386918038129807, + 0.30927759781479836, + 0.4997161589562893, + 0.47805051878094673, + 1.681886812672019, + 0.5739775449037552, + 0.03348781168460846 + ], + "unique_experts": 62, + "load_cv": 0.8571967336137588, + "normalized_load_entropy": 0.9256504450982256, + "max_load_share": 0.07506361323155217 + } + }, + "s1_period": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "c7e8678fad0d4e60fc1d6863df4cba0828fb76dfe05d5cd7ed1e113e70d9be80", + "route_weight_sha256": "5f6d52bfa4a8dd01208cc9e75ead222fff2bb1e6fc489ed47fb5a1193a62953d", + "loads": [ + 4, + 8, + 8, + 32, + 1, + 0, + 7, + 3, + 5, + 7, + 2, + 9, + 14, + 21, + 59, + 8, + 3, + 2, + 1, + 24, + 9, + 15, + 5, + 8, + 6, + 5, + 8, + 9, + 0, + 33, + 36, + 6, + 29, + 26, + 2, + 4, + 9, + 1, + 3, + 9, + 14, + 31, + 6, + 0, + 20, + 11, + 4, + 1, + 4, + 13, + 15, + 14, + 13, + 0, + 0, + 2, + 2, + 12, + 5, + 6, + 8, + 9, + 4, + 1 + ], + "weighted_loads": [ + 0.22854209318757057, + 0.40580397099256516, + 0.5616800263524055, + 1.7534951977431774, + 0.04788433015346527, + 0.0, + 0.3795938603579998, + 0.15802503377199173, + 0.34211885184049606, + 0.33383723348379135, + 0.08255798369646072, + 0.3965435065329075, + 0.735425565391779, + 1.4770615361630917, + 4.078342370688915, + 0.3437553532421589, + 0.11620011180639267, + 0.08237278833985329, + 0.03479750454425812, + 1.29151401668787, + 0.6660042144358158, + 1.034984566271305, + 0.17461837455630302, + 0.606599785387516, + 0.24767608381807804, + 0.3255396969616413, + 0.31240995414555073, + 0.5380390956997871, + 0.0, + 2.33070819824934, + 1.759863093495369, + 0.35527923330664635, + 2.2829545848071575, + 1.5086623542010784, + 0.10802721604704857, + 0.491436243057251, + 0.4803677648305893, + 0.03377896547317505, + 0.12700237706303596, + 0.456100856885314, + 0.918097548186779, + 1.936300877481699, + 0.4063011147081852, + 0.0, + 1.517186313867569, + 0.8459239769726992, + 0.16704333573579788, + 0.041429273784160614, + 0.22977983206510544, + 1.0957680828869343, + 0.7049198113381863, + 1.239095401018858, + 0.6458583474159241, + 0.0, + 0.0, + 0.10580531135201454, + 0.08893309161067009, + 0.6214306205511093, + 0.208902133628726, + 0.4315166026353836, + 0.4780960790812969, + 1.2323407121002674, + 0.15008137375116348, + 0.037111781537532806 + ], + "unique_experts": 59, + "load_cv": 1.085684707986098, + "normalized_load_entropy": 0.8847810325533897, + "max_load_share": 0.09276729559748427 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "67c1edcf81b68ee990835551b3283e241aaafcd508ecc771bf0591b3b288fb54", + "route_weight_sha256": "5f887d43448e42e54bc07a8061f1e4b719e5a6f1b9cd7b5c8d09bb40f65d9ba3", + "loads": [ + 6, + 9, + 9, + 32, + 13, + 6, + 7, + 5, + 15, + 7, + 5, + 11, + 14, + 21, + 60, + 11, + 22, + 3, + 11, + 25, + 10, + 16, + 7, + 13, + 6, + 5, + 10, + 12, + 11, + 33, + 44, + 12, + 30, + 26, + 7, + 12, + 9, + 1, + 3, + 10, + 19, + 31, + 6, + 25, + 22, + 11, + 5, + 14, + 4, + 18, + 15, + 14, + 13, + 5, + 19, + 9, + 8, + 13, + 7, + 11, + 10, + 18, + 14, + 2 + ], + "weighted_loads": [ + 0.3744386173784733, + 0.4387367069721222, + 0.6092751212418079, + 1.7534951977431774, + 0.6899398826062679, + 0.215272706001997, + 0.3795938603579998, + 0.2862319238483906, + 0.9578404575586319, + 0.33383723348379135, + 0.1914330143481493, + 0.43830222357064486, + 0.735425565391779, + 1.4770615361630917, + 4.11788634210825, + 0.4513397812843323, + 1.8350116088986397, + 0.09721303451806307, + 1.1903573609888554, + 1.3298124223947525, + 0.7389921434223652, + 1.1072334349155426, + 0.2827611565589905, + 0.8299357071518898, + 0.24767608381807804, + 0.3255396969616413, + 0.38870961032807827, + 0.6533834496513009, + 0.8186613582074642, + 2.33070819824934, + 2.165001764893532, + 0.6339335218071938, + 2.315472487360239, + 1.5086623542010784, + 0.3715117909014225, + 1.142939930781722, + 0.4803677648305893, + 0.03377896547317505, + 0.12700237706303596, + 0.5027192253619432, + 1.173092357814312, + 1.936300877481699, + 0.4063011147081852, + 2.349483333528042, + 1.6554259099066257, + 0.8459239769726992, + 0.21329807490110397, + 1.0472594983875751, + 0.22977983206510544, + 1.4259384460747242, + 0.7049198113381863, + 1.239095401018858, + 0.6458583474159241, + 0.3046979382634163, + 1.11983329243958, + 0.4373704604804516, + 0.5598364360630512, + 0.6637173816561699, + 0.31061561591923237, + 0.6432742960751057, + 0.5561557821929455, + 1.7039711382240057, + 0.6968223340809345, + 0.07945821434259415 + ], + "unique_experts": 64, + "load_cv": 0.7438160205367139, + "normalized_load_entropy": 0.9449545981402929, + "max_load_share": 0.06802721088435375 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 106, + "ordered_topk_exact_tokens": 85, + "set_exact_tokens": 92, + "mean_set_jaccard": 0.9622641509433962, + "mean_token_weighted_tv": 0.008896002633813417, + "aggregate_load_tv": 0.020440251572327043 + }, + "system_bos": { + "tokens": 106, + "ordered_topk_exact_tokens": 67, + "set_exact_tokens": 79, + "mean_set_jaccard": 0.9231805929919138, + "mean_token_weighted_tv": 0.016882307001582858, + "aggregate_load_tv": 0.029874213836477995 + }, + "system_x": { + "tokens": 106, + "ordered_topk_exact_tokens": 70, + "set_exact_tokens": 87, + "mean_set_jaccard": 0.9467654986522911, + "mean_token_weighted_tv": 0.01451364916942592, + "aggregate_load_tv": 0.023584905660377367 + }, + "system_period": { + "tokens": 106, + "ordered_topk_exact_tokens": 63, + "set_exact_tokens": 75, + "mean_set_jaccard": 0.9164420485175203, + "mean_token_weighted_tv": 0.018576885564779898, + "aggregate_load_tv": 0.031446540880503145 + }, + "bos_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 62, + "set_exact_tokens": 73, + "mean_set_jaccard": 0.9049865229110514, + "mean_token_weighted_tv": 0.020247828417440068, + "aggregate_load_tv": 0.0330188679245283 + }, + "bos_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 58, + "set_exact_tokens": 69, + "mean_set_jaccard": 0.8942048517520216, + "mean_token_weighted_tv": 0.02231206963682231, + "aggregate_load_tv": 0.036163522012578615 + }, + "x_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 52, + "set_exact_tokens": 69, + "mean_set_jaccard": 0.8942048517520216, + "mean_token_weighted_tv": 0.021506185476439742, + "aggregate_load_tv": 0.03773584905660378 + }, + "x_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 50, + "set_exact_tokens": 68, + "mean_set_jaccard": 0.8874663072776281, + "mean_token_weighted_tv": 0.02473888060359179, + "aggregate_load_tv": 0.04402515723270441 + }, + "period_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 50, + "set_exact_tokens": 68, + "mean_set_jaccard": 0.8915094339622641, + "mean_token_weighted_tv": 0.021246212183163977, + "aggregate_load_tv": 0.04088050314465408 + }, + "period_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 52, + "set_exact_tokens": 67, + "mean_set_jaccard": 0.8867924528301887, + "mean_token_weighted_tv": 0.024089205228143704, + "aggregate_load_tv": 0.039308176100628936 + } + } + }, + "layer_12": { + "layer": 12, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "6cbad277acf6519be46f7821ca0be87241d4cbd843bd9328340d0b4c9d0406ad", + "route_weight_sha256": "78edc1275e6e1072879fd25f622a9a49403f5abc10b7e442ccc39c34ca557610", + "loads": [ + 12, + 12, + 17, + 8, + 7, + 23, + 48, + 5, + 2, + 0, + 0, + 15, + 5, + 12, + 17, + 5, + 12, + 2, + 12, + 4, + 17, + 18, + 5, + 6, + 1, + 13, + 1, + 9, + 0, + 0, + 1, + 6, + 4, + 13, + 5, + 10, + 2, + 14, + 1, + 5, + 61, + 0, + 1, + 21, + 1, + 10, + 1, + 3, + 1, + 36, + 17, + 23, + 24, + 4, + 12, + 6, + 8, + 6, + 3, + 4, + 3, + 7, + 14, + 21 + ], + "weighted_loads": [ + 0.6971328500658274, + 0.7905490435659885, + 0.9895778317004442, + 0.6389426440000534, + 0.3310254942625761, + 1.1895442083477974, + 3.4106342308223248, + 0.2964579239487648, + 0.07914519682526588, + 0.0, + 0.0, + 0.7411461696028709, + 0.32240111008286476, + 0.6477220691740513, + 0.884047219529748, + 0.22011923044919968, + 0.581856407225132, + 0.2505287379026413, + 0.7328612506389618, + 0.2121775969862938, + 1.335206501185894, + 0.9796921536326408, + 0.3051856979727745, + 0.29270659387111664, + 0.03502165153622627, + 0.6530428230762482, + 0.03942021355032921, + 0.6414456404745579, + 0.0, + 0.0, + 0.03294021636247635, + 0.3096100501716137, + 0.14975859224796295, + 1.5039398930966854, + 0.42433836311101913, + 0.4435684122145176, + 0.08682530000805855, + 0.9780723862349987, + 0.04304194822907448, + 0.30278779938817024, + 4.342488821595907, + 0.0, + 0.0316978357732296, + 1.967620100826025, + 0.05664372444152832, + 0.6352357342839241, + 0.04257562384009361, + 0.19205279648303986, + 0.03744896128773689, + 2.011653019115329, + 1.6258794851601124, + 1.8244091980159283, + 1.529139768332243, + 0.18804795667529106, + 0.6492206156253815, + 0.2536538504064083, + 0.44153790175914764, + 0.36063080094754696, + 0.10567788779735565, + 0.24461771175265312, + 0.13280197232961655, + 0.5850950740277767, + 1.0454378053545952, + 1.5036349967122078 + ], + "unique_experts": 59, + "load_cv": 1.1057562511648893, + "normalized_load_entropy": 0.8819827532059923, + "max_load_share": 0.0959119496855346 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "abebb2955da1ea0cafa50633f3ea9be5073f1cf11cc0db8bbc0758a37fc9e426", + "route_weight_sha256": "804a2e904924e7399f6d56b88e658502126f17796524c8ab59f32e5b85019146", + "loads": [ + 12, + 12, + 17, + 13, + 9, + 24, + 48, + 7, + 9, + 0, + 0, + 15, + 10, + 12, + 17, + 5, + 15, + 2, + 12, + 4, + 18, + 18, + 6, + 11, + 1, + 13, + 2, + 17, + 15, + 10, + 4, + 12, + 5, + 15, + 5, + 17, + 2, + 18, + 15, + 5, + 61, + 5, + 6, + 22, + 3, + 11, + 2, + 7, + 6, + 37, + 18, + 23, + 24, + 4, + 12, + 6, + 11, + 6, + 4, + 8, + 3, + 12, + 19, + 24 + ], + "weighted_loads": [ + 0.6971328500658274, + 0.7905490435659885, + 0.9895778317004442, + 0.7619459067936987, + 1.8837109934538603, + 1.1936232261359692, + 3.4106342308223248, + 0.41196583956480026, + 0.5703594721853733, + 0.0, + 0.0, + 0.7411461696028709, + 0.574132863432169, + 0.6477220691740513, + 0.884047219529748, + 0.22011923044919968, + 0.751900739967823, + 0.2505287379026413, + 0.7328612506389618, + 0.2121775969862938, + 1.337522826390341, + 0.9796921536326408, + 0.3556837886571884, + 0.7509812340140343, + 0.03502165153622627, + 0.6530428230762482, + 0.0721893422305584, + 1.0648913383483887, + 1.910487700253725, + 1.4811587743461132, + 0.13796357810497284, + 0.5863526053726673, + 0.1963835246860981, + 1.6231118626892567, + 0.42433836311101913, + 0.9409579262137413, + 0.08682530000805855, + 1.0919196605682373, + 1.1368934363126755, + 0.30278779938817024, + 4.342488821595907, + 0.4555625859647989, + 0.37558584846556187, + 2.082743775099516, + 0.14624306187033653, + 0.6748358532786369, + 0.086761973798275, + 0.4196388367563486, + 0.29325632378458977, + 2.057834694162011, + 1.6388161508366466, + 1.8244091980159283, + 1.529139768332243, + 0.18804795667529106, + 0.6492206156253815, + 0.2536538504064083, + 0.5448721596039832, + 0.36063080094754696, + 0.17074143886566162, + 0.4161285227164626, + 0.13280197232961655, + 0.8148258421570063, + 1.3680629171431065, + 1.5974443964660168 + ], + "unique_experts": 62, + "load_cv": 0.8550186277027555, + "normalized_load_entropy": 0.9266020529806855, + "max_load_share": 0.07760814249363868 + } + }, + "s1_eos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "3b2a40cd59d1417b2ef85845b963d2acebb2f45cfcc45e24d92bc354deb3c852", + "route_weight_sha256": "9dc5e2c720554166360cc326e7fb47be61bba6dac01c1ba6deded85a0c6a09ae", + "loads": [ + 11, + 12, + 15, + 9, + 7, + 22, + 48, + 5, + 1, + 0, + 0, + 16, + 5, + 12, + 17, + 5, + 12, + 2, + 11, + 4, + 17, + 18, + 5, + 7, + 1, + 12, + 1, + 8, + 0, + 1, + 1, + 6, + 4, + 13, + 5, + 10, + 2, + 14, + 1, + 6, + 64, + 0, + 1, + 21, + 1, + 10, + 1, + 3, + 1, + 35, + 17, + 24, + 24, + 4, + 13, + 6, + 8, + 5, + 2, + 5, + 3, + 7, + 14, + 21 + ], + "weighted_loads": [ + 0.6555048078298569, + 0.7865678183734417, + 0.9182407259941101, + 0.6739293970167637, + 0.33290589414536953, + 1.1545022185891867, + 3.4247875530272722, + 0.29972341656684875, + 0.03934863954782486, + 0.0, + 0.0, + 0.7741447165608406, + 0.330065805464983, + 0.6505865044891834, + 0.8813594933599234, + 0.21509460732340813, + 0.580751933157444, + 0.24283894151449203, + 0.6942517980933189, + 0.22422561794519424, + 1.3247162476181984, + 0.9834112972021103, + 0.3093375898897648, + 0.314431918784976, + 0.03573000803589821, + 0.6269085444509983, + 0.0388675220310688, + 0.6065557822585106, + 0.0, + 0.030410438776016235, + 0.03382682427763939, + 0.320358470082283, + 0.1479145586490631, + 1.494091834872961, + 0.4285473860800266, + 0.4504924565553665, + 0.09037059918045998, + 0.9533298090100288, + 0.04008999094367027, + 0.32812267541885376, + 4.423538137227297, + 0.0, + 0.036108411848545074, + 1.9414792396128178, + 0.05539384111762047, + 0.6450115963816643, + 0.04258597642183304, + 0.1903177797794342, + 0.03712649643421173, + 1.988708458840847, + 1.6311638616025448, + 1.8233291264623404, + 1.5317815095186234, + 0.1917574480175972, + 0.705532044172287, + 0.25095947086811066, + 0.4368585254997015, + 0.3225975073873997, + 0.06551341712474823, + 0.3074513301253319, + 0.13583743572235107, + 0.5783410370349884, + 1.0395659618079662, + 1.499690379947424 + ], + "unique_experts": 60, + "load_cv": 1.122936557250457, + "normalized_load_entropy": 0.8811249535958439, + "max_load_share": 0.10062893081761007 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "80fe4d6f960def1834a417e4f75aed9fc259cb469733170a6f6754e850fec8fc", + "route_weight_sha256": "96580d1d857f9df6c1411c5b1d5ee0292a79c62a1d3e7278e8afc1393fb0bafa", + "loads": [ + 15, + 12, + 15, + 12, + 12, + 23, + 48, + 10, + 8, + 3, + 1, + 16, + 9, + 12, + 17, + 5, + 16, + 4, + 12, + 4, + 18, + 20, + 7, + 13, + 1, + 12, + 4, + 15, + 17, + 16, + 12, + 11, + 8, + 18, + 10, + 17, + 2, + 18, + 19, + 6, + 64, + 11, + 9, + 24, + 14, + 14, + 4, + 9, + 9, + 36, + 19, + 24, + 24, + 7, + 13, + 6, + 11, + 11, + 3, + 10, + 5, + 16, + 20, + 21 + ], + "weighted_loads": [ + 0.8465703129768372, + 0.7865678183734417, + 0.9182407259941101, + 0.7281197472475469, + 1.994316903874278, + 1.1584246568381786, + 3.4247875530272722, + 0.5571334287524223, + 0.6237003356218338, + 0.3142116814851761, + 0.041834063827991486, + 0.7741447165608406, + 0.5171141102910042, + 0.6505865044891834, + 0.8813594933599234, + 0.21509460732340813, + 0.8661869466304779, + 0.3547147512435913, + 0.7301300726830959, + 0.22422561794519424, + 1.327055960893631, + 1.072738628834486, + 0.3953136317431927, + 0.7759487126022577, + 0.03573000803589821, + 0.6269085444509983, + 0.1617760956287384, + 0.9710963517427444, + 2.206500019878149, + 2.3143096566200256, + 0.8928064331412315, + 0.549959747120738, + 0.32460073567926884, + 1.8183910138905048, + 0.6839220449328423, + 1.0112230759114027, + 0.09037059918045998, + 1.1307894438505173, + 1.4244776628911495, + 0.32812267541885376, + 4.423538137227297, + 0.9414538592100143, + 0.49997467175126076, + 2.165744248777628, + 1.2533623091876507, + 0.9538998417556286, + 0.18067467585206032, + 0.5119804870337248, + 0.43579139560461044, + 2.037308819591999, + 1.6966787157580256, + 1.8233291264623404, + 1.5317815095186234, + 0.3508767709136009, + 0.705532044172287, + 0.25095947086811066, + 0.5161576839163899, + 0.5741574391722679, + 0.12915755808353424, + 0.504378592595458, + 0.20471677370369434, + 1.048981960862875, + 1.4158107750117779, + 1.499690379947424 + ], + "unique_experts": 64, + "load_cv": 0.7358093209317683, + "normalized_load_entropy": 0.9468468654849046, + "max_load_share": 0.07256235827664399 + } + }, + "s0_bos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "f39e86d442c2ca38c9185e52c08cde6fcb4172b63e7eb24d0da1a1561d8415a2", + "route_weight_sha256": "0293a4b86ec7c3cf725885d10cb3ccf752f56312ce9056b6943d76d2927ffc59", + "loads": [ + 11, + 12, + 16, + 10, + 7, + 25, + 48, + 5, + 1, + 0, + 2, + 15, + 5, + 12, + 16, + 6, + 12, + 2, + 10, + 4, + 16, + 17, + 5, + 6, + 1, + 12, + 2, + 8, + 0, + 0, + 0, + 7, + 6, + 12, + 5, + 10, + 2, + 14, + 1, + 6, + 64, + 0, + 1, + 20, + 1, + 9, + 1, + 3, + 1, + 35, + 17, + 23, + 24, + 4, + 13, + 6, + 8, + 5, + 2, + 6, + 3, + 8, + 12, + 21 + ], + "weighted_loads": [ + 0.6805925983935595, + 0.778975322842598, + 0.979119922965765, + 0.7143946178257465, + 0.3265245035290718, + 1.2321515399962664, + 3.449734279885888, + 0.3042266108095646, + 0.03791159763932228, + 0.0, + 0.06779322773218155, + 0.7421177737414837, + 0.3181958608329296, + 0.6272458992898464, + 0.8345671538263559, + 0.2751522734761238, + 0.5917846392840147, + 0.24424227327108383, + 0.6681391559541225, + 0.20421937480568886, + 1.2995921820402145, + 0.9406380616128445, + 0.30007433146238327, + 0.28691495954990387, + 0.03458259999752045, + 0.6308779790997505, + 0.07042649760842323, + 0.6042939908802509, + 0.0, + 0.0, + 0.0, + 0.35016118362545967, + 0.20904240757226944, + 1.4495234750211239, + 0.4167904779314995, + 0.45712703093886375, + 0.08896979689598083, + 0.9430523999035358, + 0.03933161869645119, + 0.3408091776072979, + 4.542424900457263, + 0.0, + 0.03317977115511894, + 1.9613042958080769, + 0.05894197151064873, + 0.6183952949941158, + 0.041644640266895294, + 0.1734653003513813, + 0.043217141181230545, + 1.9674808382987976, + 1.6538671553134918, + 1.9026563689112663, + 1.520186636596918, + 0.19885730370879173, + 0.6944091841578484, + 0.2544047497212887, + 0.4659224562346935, + 0.3741695135831833, + 0.0694199800491333, + 0.34174125269055367, + 0.1328296810388565, + 0.6203080732375383, + 0.9036745242774487, + 1.505216434597969 + ], + "unique_experts": 59, + "load_cv": 1.11700308777787, + "normalized_load_entropy": 0.8829329673996275, + "max_load_share": 0.10062893081761007 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "8072ee7295add64fb3e3a210a1281a602ba4fa4532cfc456367eff2f58477b63", + "route_weight_sha256": "3a9cdb077a8663a9319bde312027354e35e5ba30d440f7e38538ce820c0fc361", + "loads": [ + 11, + 12, + 16, + 14, + 8, + 25, + 48, + 7, + 9, + 0, + 2, + 15, + 11, + 12, + 16, + 6, + 17, + 2, + 10, + 4, + 16, + 17, + 6, + 11, + 1, + 12, + 4, + 16, + 16, + 10, + 2, + 14, + 7, + 14, + 5, + 17, + 2, + 18, + 15, + 6, + 64, + 5, + 5, + 21, + 3, + 10, + 2, + 7, + 6, + 36, + 18, + 23, + 24, + 4, + 13, + 6, + 10, + 5, + 3, + 10, + 3, + 13, + 17, + 24 + ], + "weighted_loads": [ + 0.6805925983935595, + 0.778975322842598, + 0.979119922965765, + 0.8342744819819927, + 0.9290745928883553, + 1.2321515399962664, + 3.449734279885888, + 0.4196794852614403, + 0.6044096276164055, + 0.0, + 0.06779322773218155, + 0.7421177737414837, + 0.6300383321940899, + 0.6272458992898464, + 0.8345671538263559, + 0.2751522734761238, + 0.8354187067598104, + 0.24424227327108383, + 0.6681391559541225, + 0.20421937480568886, + 1.2995921820402145, + 0.9406380616128445, + 0.3505724221467972, + 0.7451895996928215, + 0.03458259999752045, + 0.6308779790997505, + 0.14555450901389122, + 1.0277396887540817, + 1.910970788449049, + 1.567954920232296, + 0.06245002523064613, + 0.6741179265081882, + 0.2556673400104046, + 1.5658033452928066, + 0.4167904779314995, + 0.9545165449380875, + 0.08896979689598083, + 1.0568996742367744, + 1.21843546256423, + 0.3408091776072979, + 4.542424900457263, + 0.4772850461304188, + 0.3456985019147396, + 2.0781098566949368, + 0.15260877832770348, + 0.6579954139888287, + 0.08427504077553749, + 0.39571417681872845, + 0.2938905283808708, + 2.0110211335122585, + 1.666803820990026, + 1.9026563689112663, + 1.520186636596918, + 0.19885730370879173, + 0.6944091841578484, + 0.2544047497212887, + 0.5646552331745625, + 0.3741695135831833, + 0.1328727975487709, + 0.5676612704992294, + 0.1328296810388565, + 0.8418298214673996, + 1.2181828990578651, + 1.599025834351778 + ], + "unique_experts": 63, + "load_cv": 0.8644174501455169, + "normalized_load_entropy": 0.927683694345073, + "max_load_share": 0.08142493638676845 + } + }, + "s1_bos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "6f0a3cabda4ee7afcbb81fdc28ea0eeb925745950bb0ecf67f1d3fc52f0dea77", + "route_weight_sha256": "bcb8d2ebecbfcc763524d4ca7df0bb9372aa86e3c8898990c81f494403d7067f", + "loads": [ + 11, + 12, + 16, + 9, + 8, + 23, + 46, + 5, + 1, + 0, + 2, + 15, + 5, + 12, + 17, + 5, + 11, + 2, + 11, + 4, + 16, + 17, + 5, + 7, + 0, + 12, + 2, + 8, + 1, + 0, + 1, + 5, + 5, + 12, + 5, + 9, + 2, + 13, + 1, + 6, + 64, + 0, + 1, + 20, + 2, + 8, + 1, + 4, + 1, + 37, + 18, + 24, + 24, + 4, + 14, + 6, + 9, + 7, + 1, + 6, + 3, + 6, + 14, + 20 + ], + "weighted_loads": [ + 0.6617584768682718, + 0.7719002924859524, + 0.9715378768742085, + 0.6631711274385452, + 0.35639694705605507, + 1.1796947177499533, + 3.363359933719039, + 0.30476706475019455, + 0.03885319456458092, + 0.0, + 0.0655163861811161, + 0.7461464069783688, + 0.31039537861943245, + 0.6352530755102634, + 0.858994634822011, + 0.21914881467819214, + 0.5576681233942509, + 0.24478840827941895, + 0.7049075774848461, + 0.21099242940545082, + 1.300105955451727, + 0.9263913687318563, + 0.3180011659860611, + 0.3125406876206398, + 0.0, + 0.6343116816133261, + 0.07342322170734406, + 0.5986761562526226, + 0.02873198501765728, + 0.0, + 0.031563807278871536, + 0.29300884529948235, + 0.17599324882030487, + 1.4176144003868103, + 0.41999124363064766, + 0.416216105222702, + 0.09265491366386414, + 0.8880064785480499, + 0.040612779557704926, + 0.3304339610040188, + 4.545307399705052, + 0.0, + 0.036641236394643784, + 1.8950611501932144, + 0.08829724229872227, + 0.5745035819709301, + 0.04467804729938507, + 0.21591593697667122, + 0.03941318765282631, + 2.0514433942735195, + 1.71769367903471, + 1.8849452435970306, + 1.525171872228384, + 0.19643478840589523, + 0.7425677739083767, + 0.26640833355486393, + 0.48900022730231285, + 0.43819762021303177, + 0.03559261932969093, + 0.334776621311903, + 0.13794799521565437, + 0.5184172205626965, + 0.9949854090809822, + 1.4640130139887333 + ], + "unique_experts": 60, + "load_cv": 1.1121766181818684, + "normalized_load_entropy": 0.8843352799477366, + "max_load_share": 0.10062893081761007 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "651d14dcdac6ef04ad304e45b40ebc378927e00f26811fd6510d656ef30da39b", + "route_weight_sha256": "a68b1e85d5f488f4b91c6ed592968317166abe6ec8ac6e5c8b80fa5b0c5e317e", + "loads": [ + 15, + 12, + 16, + 11, + 11, + 23, + 46, + 11, + 9, + 3, + 3, + 15, + 10, + 12, + 17, + 5, + 16, + 4, + 12, + 4, + 16, + 19, + 7, + 13, + 0, + 12, + 5, + 15, + 18, + 18, + 12, + 10, + 9, + 17, + 10, + 16, + 2, + 17, + 19, + 6, + 64, + 11, + 7, + 23, + 15, + 12, + 4, + 10, + 10, + 38, + 20, + 24, + 24, + 7, + 14, + 6, + 11, + 13, + 2, + 11, + 5, + 15, + 20, + 20 + ], + "weighted_loads": [ + 0.8528239820152521, + 0.7719002924859524, + 0.9715378768742085, + 0.7144197262823582, + 1.0288348235189915, + 1.1796947177499533, + 3.363359933719039, + 0.6008292958140373, + 0.7330865189433098, + 0.3142116814851761, + 0.10735045000910759, + 0.7461464069783688, + 0.5714981965720654, + 0.6352530755102634, + 0.858994634822011, + 0.21914881467819214, + 0.8849611394107342, + 0.3566642180085182, + 0.7407858520746231, + 0.21099242940545082, + 1.300105955451727, + 1.015718700364232, + 0.403977207839489, + 0.7740574814379215, + 0.0, + 0.6343116816133261, + 0.19633179530501366, + 0.9632167257368565, + 2.34886490739882, + 2.5343479365110397, + 0.8905434161424637, + 0.5218173246830702, + 0.3526794258505106, + 1.736036203801632, + 0.6753659024834633, + 0.9769467245787382, + 0.09265491366386414, + 1.0654661133885384, + 1.546889539808035, + 0.3304339610040188, + 4.545307399705052, + 0.9600710533559322, + 0.42569465562701225, + 2.100813776254654, + 1.2878421787172556, + 0.8833918273448944, + 0.18175877258181572, + 0.5431576538830996, + 0.4775346368551254, + 2.098359640687704, + 1.7832085331901908, + 1.8849452435970306, + 1.525171872228384, + 0.35555411130189896, + 0.7425677739083767, + 0.26640833355486393, + 0.5481204763054848, + 0.6897575519979, + 0.10090281441807747, + 0.5573806799948215, + 0.20682733319699764, + 0.9855483919382095, + 1.3769110217690468, + 1.4640130139887333 + ], + "unique_experts": 63, + "load_cv": 0.7285054732792168, + "normalized_load_entropy": 0.9475863972819915, + "max_load_share": 0.07256235827664399 + } + }, + "s0_x": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "a489432f8ff46de1ed79bb16bf2b151e380e728ed2faa25e8e6739155947a70a", + "route_weight_sha256": "0b9910df805fa2d6c92f901c71121a7cf51b2e29fa288d46aa55b74f8324cb3d", + "loads": [ + 10, + 12, + 16, + 9, + 7, + 25, + 48, + 5, + 1, + 0, + 1, + 14, + 5, + 12, + 15, + 5, + 11, + 2, + 11, + 4, + 17, + 18, + 5, + 7, + 1, + 13, + 3, + 8, + 0, + 0, + 0, + 5, + 6, + 13, + 5, + 10, + 3, + 14, + 1, + 6, + 63, + 0, + 1, + 21, + 1, + 9, + 1, + 3, + 1, + 34, + 18, + 22, + 24, + 5, + 13, + 7, + 8, + 6, + 2, + 5, + 3, + 7, + 13, + 21 + ], + "weighted_loads": [ + 0.6220101974904537, + 0.785813432186842, + 0.9811211451888084, + 0.6665273923426867, + 0.31897960789501667, + 1.22510108910501, + 3.484336569905281, + 0.2976859398186207, + 0.033640943467617035, + 0.0, + 0.0351988710463047, + 0.6918587200343609, + 0.31453392654657364, + 0.6232833974063396, + 0.7981158867478371, + 0.232985008507967, + 0.5687755197286606, + 0.24637512117624283, + 0.7144378684461117, + 0.19526052847504616, + 1.360332366079092, + 0.9843666162341833, + 0.29303212091326714, + 0.3139064908027649, + 0.034225448966026306, + 0.658540666103363, + 0.09833114966750145, + 0.5872109457850456, + 0.0, + 0.0, + 0.0, + 0.25953194685280323, + 0.2102347146719694, + 1.4493193812668324, + 0.4108068197965622, + 0.4556513652205467, + 0.12351664900779724, + 0.9418922960758209, + 0.04299463331699371, + 0.33383291959762573, + 4.493560086935759, + 0.0, + 0.033207815140485764, + 1.9946229979395866, + 0.060692183673381805, + 0.6225031688809395, + 0.04223524034023285, + 0.15791162848472595, + 0.03950551524758339, + 1.9585925750434399, + 1.691422201693058, + 1.8401892594993114, + 1.5206326991319656, + 0.24081376194953918, + 0.7077709510922432, + 0.28794315829873085, + 0.44911888241767883, + 0.42027491703629494, + 0.07187170162796974, + 0.3000498451292515, + 0.1392827183008194, + 0.5952249430119991, + 0.9599856846034527, + 1.4892005510628223 + ], + "unique_experts": 59, + "load_cv": 1.1076148465567635, + "normalized_load_entropy": 0.8838418713262023, + "max_load_share": 0.09905660377358491 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "3a51cb56f25bcdb8591a362f8d77bd10dc2f89ed961786695de877533863ba43", + "route_weight_sha256": "de6e1d678a3fbe6edf41f05dc8b131f5303231f9f0d5b40d6e0eba70c6d9b778", + "loads": [ + 10, + 12, + 16, + 13, + 8, + 25, + 48, + 8, + 8, + 0, + 1, + 14, + 10, + 12, + 15, + 5, + 13, + 2, + 11, + 4, + 17, + 18, + 6, + 13, + 1, + 13, + 4, + 17, + 17, + 10, + 3, + 11, + 7, + 15, + 5, + 18, + 3, + 18, + 15, + 6, + 63, + 6, + 4, + 22, + 3, + 11, + 2, + 7, + 6, + 35, + 19, + 22, + 24, + 5, + 13, + 7, + 10, + 6, + 3, + 8, + 3, + 13, + 18, + 24 + ], + "weighted_loads": [ + 0.6220101974904537, + 0.785813432186842, + 0.9811211451888084, + 0.7864072564989328, + 0.9215296972543001, + 1.22510108910501, + 3.484336569905281, + 0.4553254321217537, + 0.5165938660502434, + 0.0, + 0.0351988710463047, + 0.6918587200343609, + 0.5791530385613441, + 0.6232833974063396, + 0.7981158867478371, + 0.232985008507967, + 0.7066461183130741, + 0.24637512117624283, + 0.7144378684461117, + 0.19526052847504616, + 1.360332366079092, + 0.9843666162341833, + 0.34353021159768105, + 0.9221084490418434, + 0.034225448966026306, + 0.658540666103363, + 0.13110027834773064, + 1.0677422434091568, + 2.145022638142109, + 1.3354610279202461, + 0.11649371311068535, + 0.5460702124983072, + 0.25685964711010456, + 1.5580124594271183, + 0.4108068197965622, + 1.028655033558607, + 0.12351664900779724, + 1.0557395704090595, + 1.0855621621012688, + 0.33383291959762573, + 4.493560086935759, + 0.518140971660614, + 0.3023580498993397, + 2.098040707409382, + 0.14922301471233368, + 0.7139428071677685, + 0.08679278567433357, + 0.36230248026549816, + 0.29922908917069435, + 2.002254743129015, + 1.7043588673695922, + 1.8401892594993114, + 1.5206326991319656, + 0.24081376194953918, + 0.7077709510922432, + 0.28794315829873085, + 0.5478516593575478, + 0.42027491703629494, + 0.138724934309721, + 0.4587544873356819, + 0.1392827183008194, + 0.9054521787911654, + 1.277702011168003, + 1.5830099508166313 + ], + "unique_experts": 63, + "load_cv": 0.8556242132999753, + "normalized_load_entropy": 0.928785483870232, + "max_load_share": 0.08015267175572519 + } + }, + "s1_x": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "e104f7e05def3cb26f978934e752d9b66cf951098255d3be11a1fe43ca18a91b", + "route_weight_sha256": "edddc4992aec663bb7be8ee89179030ffc24c8b827504398fa7512970c972fd0", + "loads": [ + 9, + 12, + 14, + 9, + 8, + 23, + 47, + 5, + 0, + 0, + 1, + 16, + 5, + 12, + 16, + 6, + 11, + 2, + 13, + 5, + 17, + 17, + 5, + 6, + 1, + 11, + 2, + 9, + 1, + 0, + 0, + 6, + 6, + 13, + 5, + 9, + 3, + 14, + 1, + 6, + 63, + 0, + 1, + 20, + 2, + 8, + 1, + 3, + 1, + 37, + 18, + 23, + 24, + 4, + 14, + 6, + 8, + 7, + 2, + 5, + 4, + 6, + 13, + 20 + ], + "weighted_loads": [ + 0.594809964299202, + 0.754401046782732, + 0.9073624685406685, + 0.6463728696107864, + 0.3464887998998165, + 1.1537264585494995, + 3.42166150175035, + 0.3048822954297066, + 0.0, + 0.0, + 0.03273693472146988, + 0.7770615592598915, + 0.303061880171299, + 0.6602806095033884, + 0.8091996945440769, + 0.2629665229469538, + 0.5623180475085974, + 0.2417220026254654, + 0.7796228900551796, + 0.22679025679826736, + 1.336853438988328, + 0.9280406087636948, + 0.3082987442612648, + 0.2868262119591236, + 0.0340694822371006, + 0.604411318898201, + 0.0742533951997757, + 0.6279209293425083, + 0.030330603942275047, + 0.0, + 0.0, + 0.3361796475946903, + 0.21029330044984818, + 1.400832923129201, + 0.4077445901930332, + 0.4261072389781475, + 0.12439890205860138, + 0.9252380877733231, + 0.03954363986849785, + 0.3203691653907299, + 4.4551824033260345, + 0.0, + 0.039419252425432205, + 1.925517488270998, + 0.08858373016119003, + 0.5807605013251305, + 0.04668794199824333, + 0.1590898409485817, + 0.03843235597014427, + 2.069188456982374, + 1.7159295789897442, + 1.7970012500882149, + 1.54386854916811, + 0.19958946853876114, + 0.7424515336751938, + 0.2668114956468344, + 0.45111847296357155, + 0.4478110335767269, + 0.07139534503221512, + 0.292919147759676, + 0.1852719448506832, + 0.5272921472787857, + 0.9640340395271778, + 1.4509875047951937 + ], + "unique_experts": 59, + "load_cv": 1.1066144523104062, + "normalized_load_entropy": 0.8846172784734078, + "max_load_share": 0.09905660377358491 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "766fd3409da575fd8e6dd88e025a78646fab0997f427aeefebeba19517f6d3bf", + "route_weight_sha256": "09973b17d752d719633a50cf72f71088804283a8a081a433cd91cf500ec9a12e", + "loads": [ + 13, + 12, + 14, + 11, + 11, + 23, + 47, + 11, + 7, + 3, + 2, + 16, + 9, + 12, + 16, + 6, + 14, + 4, + 14, + 5, + 17, + 21, + 7, + 13, + 1, + 11, + 5, + 17, + 21, + 15, + 12, + 11, + 10, + 18, + 10, + 17, + 3, + 18, + 18, + 6, + 63, + 11, + 9, + 23, + 15, + 13, + 4, + 8, + 8, + 38, + 20, + 23, + 24, + 7, + 14, + 6, + 9, + 13, + 3, + 9, + 6, + 16, + 19, + 20 + ], + "weighted_loads": [ + 0.7858754694461823, + 0.754401046782732, + 0.9073624685406685, + 0.6976214684545994, + 1.018926676362753, + 1.1537264585494995, + 3.42166150175035, + 0.6115635223686695, + 0.5362570658326149, + 0.3142116814851761, + 0.07457099854946136, + 0.7770615592598915, + 0.5056388787925243, + 0.6602806095033884, + 0.8091996945440769, + 0.2629665229469538, + 0.7787836585193872, + 0.35359781235456467, + 0.8155011646449566, + 0.22679025679826736, + 1.336853438988328, + 1.0881279110908508, + 0.3942747861146927, + 0.8805322200059891, + 0.0340694822371006, + 0.604411318898201, + 0.1971619687974453, + 1.0675420500338078, + 2.608292454853654, + 2.1241935715079308, + 0.8979160450398922, + 0.5899852756410837, + 0.3869794774800539, + 1.7067670356482267, + 0.6631192490458488, + 1.084764489904046, + 0.12439890205860138, + 1.1026977226138115, + 1.362661525607109, + 0.3203691653907299, + 4.4551824033260345, + 0.9578666314482689, + 0.5070208758115768, + 2.111655291169882, + 1.2885686494410038, + 0.9302169382572174, + 0.1878623627126217, + 0.41074983589351177, + 0.3774829376488924, + 2.125511448830366, + 1.781444433145225, + 1.7970012500882149, + 1.54386854916811, + 0.35870879143476486, + 0.7424515336751938, + 0.2668114956468344, + 0.4788603447377682, + 0.6993709653615952, + 0.13391228765249252, + 0.4611009806394577, + 0.2541512828320265, + 1.0612541921436787, + 1.343175757676363, + 1.4509875047951937 + ], + "unique_experts": 64, + "load_cv": 0.7259034324300534, + "normalized_load_entropy": 0.9489550102605094, + "max_load_share": 0.07142857142857142 + } + }, + "s0_period": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "5e95e4bd3bfdfcf9dc748048c4ffa8fb19d35ad8ba948c01001a7739b28a6d27", + "route_weight_sha256": "03729c08846c038f30e7ebeb26488dbab1878fe1a3e91fd0954f4062d59d20e4", + "loads": [ + 12, + 12, + 15, + 10, + 7, + 24, + 47, + 5, + 1, + 0, + 2, + 15, + 5, + 12, + 16, + 5, + 11, + 2, + 11, + 4, + 16, + 18, + 5, + 7, + 1, + 13, + 3, + 8, + 0, + 0, + 0, + 6, + 6, + 12, + 6, + 10, + 2, + 14, + 1, + 6, + 63, + 0, + 1, + 20, + 2, + 9, + 1, + 3, + 1, + 35, + 17, + 23, + 24, + 4, + 12, + 6, + 8, + 6, + 2, + 6, + 3, + 7, + 12, + 21 + ], + "weighted_loads": [ + 0.6700678002089262, + 0.768440954387188, + 0.9474060758948326, + 0.6986699216067791, + 0.3189764954149723, + 1.1824164930731058, + 3.466107713058591, + 0.300117626786232, + 0.03549792617559433, + 0.0, + 0.06693944334983826, + 0.7311455681920052, + 0.32347872108221054, + 0.6358127277344465, + 0.8602225221693516, + 0.23302895948290825, + 0.5554037280380726, + 0.24991824477910995, + 0.7116386145353317, + 0.1908324621617794, + 1.297658521682024, + 0.9807333797216415, + 0.288413368165493, + 0.31985948979854584, + 0.03478739410638809, + 0.6574924476444721, + 0.09912053309381008, + 0.5967327393591404, + 0.0, + 0.0, + 0.0, + 0.29930414259433746, + 0.2113189585506916, + 1.4181441627442837, + 0.4504895694553852, + 0.47137110866606236, + 0.08723749965429306, + 0.9439849704504013, + 0.042205337435007095, + 0.33200401067733765, + 4.498185813426971, + 0.0, + 0.034471381455659866, + 1.920263722538948, + 0.09021497704088688, + 0.6268840320408344, + 0.04305427893996239, + 0.15798524022102356, + 0.04132518544793129, + 1.965219659730792, + 1.6139510236680508, + 1.8453362621366978, + 1.5189892649650574, + 0.20198888331651688, + 0.6643961258232594, + 0.259522395208478, + 0.4597252123057842, + 0.4213239587843418, + 0.06932121142745018, + 0.3322388529777527, + 0.13509869202971458, + 0.5927571542561054, + 0.9140690006315708, + 1.5055458880960941 + ], + "unique_experts": 59, + "load_cv": 1.0997300911978436, + "normalized_load_entropy": 0.8858640679108709, + "max_load_share": 0.09905660377358491 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "2858a9175ffce4e220c86b16f79a0bb2f6012a802b2f6817cd4bf9d7be03f95f", + "route_weight_sha256": "d7ec0a97775a7665d5e982fdfc6689eb1c3a2f01246ed4b9ddf28fd2bc7f5825", + "loads": [ + 12, + 12, + 15, + 14, + 8, + 24, + 47, + 8, + 9, + 0, + 2, + 15, + 10, + 12, + 16, + 5, + 15, + 2, + 11, + 4, + 16, + 18, + 6, + 13, + 1, + 13, + 4, + 17, + 16, + 9, + 2, + 12, + 7, + 14, + 6, + 18, + 2, + 18, + 15, + 6, + 63, + 5, + 5, + 21, + 4, + 10, + 2, + 7, + 5, + 36, + 18, + 23, + 24, + 4, + 12, + 6, + 11, + 6, + 3, + 9, + 3, + 13, + 18, + 24 + ], + "weighted_loads": [ + 0.6700678002089262, + 0.768440954387188, + 0.9474060758948326, + 0.8185497857630253, + 0.9215265847742558, + 1.1824164930731058, + 3.466107713058591, + 0.46079524978995323, + 0.5634735599160194, + 0.0, + 0.06693944334983826, + 0.7311455681920052, + 0.5997483693063259, + 0.6358127277344465, + 0.8602225221693516, + 0.23302895948290825, + 0.8054147958755493, + 0.24991824477910995, + 0.7116386145353317, + 0.1908324621617794, + 1.297658521682024, + 0.9807333797216415, + 0.3389114588499069, + 0.8300368823111057, + 0.03478739410638809, + 0.6574924476444721, + 0.13188966177403927, + 1.0606300570070744, + 2.170277666300535, + 1.3021170943975449, + 0.06245002523064613, + 0.5870495811104774, + 0.25794389098882675, + 1.5229421816766262, + 0.4504895694553852, + 1.01900471188128, + 0.08723749965429306, + 1.05783224478364, + 1.1040107682347298, + 0.33200401067733765, + 4.498185813426971, + 0.5217812806367874, + 0.34011244401335716, + 2.0154436975717545, + 0.18118244595825672, + 0.6664841510355473, + 0.08930519968271255, + 0.36144535802304745, + 0.27496209368109703, + 2.0144443158060312, + 1.626887689344585, + 1.8453362621366978, + 1.5189892649650574, + 0.20198888331651688, + 0.6643961258232594, + 0.259522395208478, + 0.587619561702013, + 0.4213239587843418, + 0.13482165709137917, + 0.4860011599957943, + 0.13509869202971458, + 0.8747749794274569, + 1.2764973975718021, + 1.599355287849903 + ], + "unique_experts": 63, + "load_cv": 0.8521058258922487, + "normalized_load_entropy": 0.9291248723874521, + "max_load_share": 0.08015267175572519 + } + }, + "s1_period": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "e88d1de4e52600627ca79d81dd67493b03d88deca22530cc4aba823d5be75e13", + "route_weight_sha256": "9c41426d99700608e2151777010cde6398495183cb069e4565af16f8f1cd2b62", + "loads": [ + 10, + 12, + 15, + 9, + 8, + 22, + 49, + 5, + 0, + 0, + 2, + 16, + 5, + 13, + 17, + 5, + 11, + 2, + 11, + 4, + 16, + 18, + 5, + 6, + 0, + 12, + 2, + 9, + 0, + 0, + 0, + 6, + 5, + 13, + 5, + 7, + 3, + 14, + 1, + 6, + 64, + 0, + 2, + 20, + 2, + 8, + 1, + 3, + 1, + 38, + 18, + 23, + 24, + 4, + 14, + 6, + 9, + 7, + 2, + 4, + 3, + 7, + 12, + 20 + ], + "weighted_loads": [ + 0.6205760911107063, + 0.7589535601437092, + 0.942499715834856, + 0.6457382813096046, + 0.3443982284516096, + 1.1182056590914726, + 3.5287146493792534, + 0.3065435476601124, + 0.0, + 0.0, + 0.06361955776810646, + 0.7880000602453947, + 0.30132531002163887, + 0.6965579837560654, + 0.8618470821529627, + 0.21864623948931694, + 0.5782110765576363, + 0.24498733133077621, + 0.7086154818534851, + 0.1842641644179821, + 1.3200316578149796, + 0.9805296696722507, + 0.31169258058071136, + 0.29603737592697144, + 0.0, + 0.643473606556654, + 0.07372542843222618, + 0.6386910751461983, + 0.0, + 0.0, + 0.0, + 0.3212549723684788, + 0.17787920497357845, + 1.3998671248555183, + 0.40771516785025597, + 0.3540238179266453, + 0.12309490889310837, + 0.940917581319809, + 0.04117657244205475, + 0.3119991533458233, + 4.491807393729687, + 0.0, + 0.0716407485306263, + 1.9290225021541119, + 0.0905876625329256, + 0.5730692446231842, + 0.046992409974336624, + 0.1573024019598961, + 0.03829445317387581, + 2.106758937239647, + 1.7173739038407803, + 1.791596345603466, + 1.5357159562408924, + 0.20005906000733376, + 0.7389451116323471, + 0.2763125114142895, + 0.4879893362522125, + 0.44287820532917976, + 0.07036414742469788, + 0.23388200625777245, + 0.14471478760242462, + 0.5861004181206226, + 0.915870014578104, + 1.4654976204037666 + ], + "unique_experts": 57, + "load_cv": 1.1321977571969675, + "normalized_load_entropy": 0.8798405474691299, + "max_load_share": 0.10062893081761007 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "74c8a792251ebc3890257c8bf122edd965481f494898eb54a6940a41f98fa802", + "route_weight_sha256": "19ae6ed04c115a8075306c8944c262eca53cdff64d4e1d3668a1e71059ed4a57", + "loads": [ + 14, + 12, + 15, + 11, + 11, + 22, + 49, + 13, + 8, + 3, + 3, + 16, + 9, + 13, + 17, + 5, + 15, + 4, + 12, + 4, + 16, + 21, + 7, + 13, + 0, + 12, + 5, + 16, + 19, + 14, + 11, + 11, + 9, + 18, + 10, + 15, + 3, + 18, + 19, + 6, + 64, + 11, + 9, + 23, + 15, + 12, + 4, + 9, + 8, + 39, + 20, + 23, + 24, + 7, + 14, + 6, + 10, + 13, + 3, + 8, + 5, + 17, + 19, + 20 + ], + "weighted_loads": [ + 0.8116415962576866, + 0.7589535601437092, + 0.942499715834856, + 0.6969868801534176, + 1.016836104914546, + 1.1182056590914726, + 3.5287146493792534, + 0.690284188836813, + 0.5999813340604305, + 0.3142116814851761, + 0.10545362159609795, + 0.7880000602453947, + 0.48873531073331833, + 0.6965579837560654, + 0.8618470821529627, + 0.21864623948931694, + 0.8841801732778549, + 0.3568631410598755, + 0.7444937564432621, + 0.1842641644179821, + 1.3200316578149796, + 1.1137709505856037, + 0.39766862243413925, + 0.8070466816425323, + 0.0, + 0.643473606556654, + 0.19663400202989578, + 1.0032316446304321, + 2.555587735027075, + 2.0287598073482513, + 0.8589796088635921, + 0.5728766079992056, + 0.3545653820037842, + 1.7086700424551964, + 0.6630898267030716, + 0.970717566087842, + 0.12309490889310837, + 1.1183772161602974, + 1.4252926707267761, + 0.3119991533458233, + 4.491807393729687, + 1.0191855803132057, + 0.4977182261645794, + 2.108006324619055, + 1.2955983597785234, + 0.8819574899971485, + 0.18742256984114647, + 0.44942802377045155, + 0.384701207280159, + 2.168716762214899, + 1.7828887579962611, + 1.791596345603466, + 1.5357159562408924, + 0.3591783829033375, + 0.7389451116323471, + 0.2763125114142895, + 0.5157312080264091, + 0.694438137114048, + 0.13332650810480118, + 0.402693759649992, + 0.2135941255837679, + 1.1108570285141468, + 1.31942967325449, + 1.4654976204037666 + ], + "unique_experts": 63, + "load_cv": 0.7418224474210945, + "normalized_load_entropy": 0.9467891771577689, + "max_load_share": 0.07256235827664399 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 106, + "ordered_topk_exact_tokens": 77, + "set_exact_tokens": 85, + "mean_set_jaccard": 0.9433962264150944, + "mean_token_weighted_tv": 0.012846673250128076, + "aggregate_load_tv": 0.017295597484276726 + }, + "system_bos": { + "tokens": 106, + "ordered_topk_exact_tokens": 63, + "set_exact_tokens": 77, + "mean_set_jaccard": 0.917789757412399, + "mean_token_weighted_tv": 0.018935836034493066, + "aggregate_load_tv": 0.028301886792452824 + }, + "system_x": { + "tokens": 106, + "ordered_topk_exact_tokens": 59, + "set_exact_tokens": 75, + "mean_set_jaccard": 0.9123989218328842, + "mean_token_weighted_tv": 0.01954761229209461, + "aggregate_load_tv": 0.029874213836477988 + }, + "system_period": { + "tokens": 106, + "ordered_topk_exact_tokens": 60, + "set_exact_tokens": 78, + "mean_set_jaccard": 0.9204851752021563, + "mean_token_weighted_tv": 0.018689518601124017, + "aggregate_load_tv": 0.02987421383647798 + }, + "bos_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 55, + "set_exact_tokens": 75, + "mean_set_jaccard": 0.914420485175202, + "mean_token_weighted_tv": 0.020865905353412876, + "aggregate_load_tv": 0.02987421383647798 + }, + "bos_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 56, + "set_exact_tokens": 79, + "mean_set_jaccard": 0.9231805929919138, + "mean_token_weighted_tv": 0.02006513677221143, + "aggregate_load_tv": 0.028301886792452824 + }, + "x_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 66, + "set_exact_tokens": 85, + "mean_set_jaccard": 0.9413746630727762, + "mean_token_weighted_tv": 0.01794000572683114, + "aggregate_load_tv": 0.028301886792452824 + }, + "x_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 52, + "set_exact_tokens": 75, + "mean_set_jaccard": 0.910377358490566, + "mean_token_weighted_tv": 0.02331960856703655, + "aggregate_load_tv": 0.033018867924528295 + }, + "period_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 56, + "set_exact_tokens": 79, + "mean_set_jaccard": 0.925202156334232, + "mean_token_weighted_tv": 0.019904055237278062, + "aggregate_load_tv": 0.026729559748427667 + }, + "period_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 48, + "set_exact_tokens": 73, + "mean_set_jaccard": 0.9049865229110512, + "mean_token_weighted_tv": 0.024361698466511268, + "aggregate_load_tv": 0.02987421383647798 + } + } + }, + "layer_13": { + "layer": 13, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "3d447295c94da2017bf00f2a9737bbfab93a29ff0780e8a67ebb8e4ce0a55975", + "route_weight_sha256": "a1d4ea2a239cdeaaf71fc91b533e30763e649af1a6327099e1468115ded4e302", + "loads": [ + 21, + 3, + 5, + 6, + 36, + 7, + 8, + 17, + 22, + 0, + 12, + 5, + 19, + 17, + 4, + 20, + 13, + 6, + 1, + 2, + 5, + 5, + 21, + 0, + 9, + 0, + 7, + 1, + 5, + 0, + 0, + 6, + 22, + 4, + 3, + 15, + 2, + 0, + 17, + 40, + 8, + 0, + 6, + 1, + 0, + 11, + 9, + 29, + 16, + 1, + 12, + 12, + 51, + 1, + 11, + 2, + 0, + 5, + 19, + 8, + 10, + 9, + 16, + 13 + ], + "weighted_loads": [ + 1.186272593215108, + 0.1120518110692501, + 0.23479197919368744, + 0.27273096702992916, + 1.5449955202639103, + 0.37693826481699944, + 0.34298891574144363, + 1.236370712518692, + 1.0122700110077858, + 0.0, + 0.8442351259291172, + 0.269512128084898, + 1.0547733251005411, + 0.8301410786807537, + 0.14233152754604816, + 1.2293448019772768, + 0.7019311338663101, + 0.21082459203898907, + 0.043238721787929535, + 0.06122390367090702, + 0.2021663412451744, + 0.273240327835083, + 1.1341001465916634, + 0.0, + 0.3756143730133772, + 0.0, + 0.22449656762182713, + 0.024971207603812218, + 0.19801643304526806, + 0.0, + 0.0, + 0.27365681529045105, + 1.398639852181077, + 0.22210876643657684, + 0.2743402346968651, + 1.157321773469448, + 0.07425030693411827, + 0.0, + 1.0671164840459824, + 2.3329588063061237, + 0.5258928164839745, + 0.0, + 0.24360192567110062, + 0.0521089993417263, + 0.0, + 0.6855216473340988, + 0.36255341209471226, + 1.0313785262405872, + 2.0200120098888874, + 0.04031718522310257, + 0.42517517134547234, + 0.4605964124202728, + 2.706569455564022, + 0.050859108567237854, + 0.5418964736163616, + 0.10136893391609192, + 0.0, + 0.29537928476929665, + 0.8593525625765324, + 0.34364989027380943, + 0.5002698376774788, + 0.3993190582841635, + 0.8596455492079258, + 0.7741978652775288 + ], + "unique_experts": 55, + "load_cv": 1.0218722690333535, + "normalized_load_entropy": 0.8845684955761033, + "max_load_share": 0.08018867924528301 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "5c784b7238b07e018784e18223f89f086cf5d5dfd7d3a54af0e6dc9f1316d1ac", + "route_weight_sha256": "89dd19e1713f710c3b4d7367fbb323cf018835d0df7e0b6083050b6e16b9e68c", + "loads": [ + 21, + 7, + 5, + 6, + 36, + 7, + 26, + 17, + 22, + 2, + 22, + 11, + 19, + 17, + 5, + 26, + 13, + 9, + 2, + 3, + 5, + 8, + 21, + 0, + 13, + 0, + 10, + 1, + 5, + 13, + 0, + 6, + 22, + 10, + 4, + 15, + 5, + 1, + 17, + 42, + 9, + 1, + 9, + 3, + 11, + 22, + 11, + 31, + 18, + 1, + 13, + 12, + 55, + 4, + 14, + 2, + 3, + 5, + 25, + 13, + 10, + 10, + 16, + 14 + ], + "weighted_loads": [ + 1.186272593215108, + 0.3346177004277706, + 0.23479197919368744, + 0.27273096702992916, + 1.5449955202639103, + 0.37693826481699944, + 1.7300127763301134, + 1.236370712518692, + 1.0122700110077858, + 0.07683849334716797, + 1.5561608280986547, + 0.6563020176254213, + 1.0547733251005411, + 0.8301410786807537, + 0.18772769160568714, + 1.536924222484231, + 0.7019311338663101, + 0.30141525249928236, + 0.08501464501023293, + 0.10470501147210598, + 0.2021663412451744, + 0.42305272445082664, + 1.1341001465916634, + 0.0, + 0.48027717787772417, + 0.0, + 0.3489877339452505, + 0.024971207603812218, + 0.19801643304526806, + 0.9533435329794884, + 0.0, + 0.27365681529045105, + 1.398639852181077, + 0.8198971189558506, + 0.29716166108846664, + 1.157321773469448, + 0.31322198919951916, + 0.03359677270054817, + 1.0671164840459824, + 2.4482819214463234, + 0.6313182711601257, + 0.049772460013628006, + 0.3846755065023899, + 0.1487981639802456, + 0.7189312092959881, + 1.7155404910445213, + 0.4281363505870104, + 2.2237046249210835, + 2.1016862094402313, + 0.04031718522310257, + 0.4630493111908436, + 0.4605964124202728, + 2.851235054433346, + 0.18897921591997147, + 0.6732517257332802, + 0.10136893391609192, + 0.164889108389616, + 0.29537928476929665, + 1.1747772339731455, + 0.5798852518200874, + 0.5002698376774788, + 0.4286246933043003, + 0.8596455492079258, + 0.8118398524820805 + ], + "unique_experts": 61, + "load_cv": 0.8556242132999753, + "normalized_load_entropy": 0.9178575585605444, + "max_load_share": 0.06997455470737914 + } + }, + "s1_eos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "302b4b08595123079ab16c41c8e6812f2d23c1a1576f81675e3b86917a1f5b76", + "route_weight_sha256": "4257e53a9289a226626d11148b87601da4bfb3e00d8431797ed86909f59a0d04", + "loads": [ + 21, + 1, + 6, + 8, + 37, + 7, + 9, + 17, + 22, + 0, + 11, + 5, + 19, + 16, + 4, + 20, + 14, + 6, + 1, + 2, + 5, + 5, + 20, + 0, + 9, + 0, + 8, + 1, + 8, + 0, + 0, + 6, + 20, + 4, + 3, + 16, + 2, + 0, + 17, + 41, + 8, + 0, + 7, + 1, + 0, + 11, + 8, + 27, + 16, + 1, + 11, + 12, + 51, + 1, + 10, + 3, + 0, + 5, + 19, + 9, + 9, + 9, + 16, + 11 + ], + "weighted_loads": [ + 1.1859569437801838, + 0.046380314975976944, + 0.2591371424496174, + 0.33233814500272274, + 1.586552070453763, + 0.3871600776910782, + 0.3693106509745121, + 1.238809209316969, + 0.9994898065924644, + 0.0, + 0.8283105194568634, + 0.26238398998975754, + 1.0648119542747736, + 0.7832999508827925, + 0.1399559024721384, + 1.213305177167058, + 0.7456208951771259, + 0.20413314923644066, + 0.04351745918393135, + 0.062207115814089775, + 0.2046236153692007, + 0.27379875630140305, + 1.101047407835722, + 0.0, + 0.37190502136945724, + 0.0, + 0.26428149454295635, + 0.02484774775803089, + 0.2935274466872215, + 0.0, + 0.0, + 0.2653981987386942, + 1.32096316665411, + 0.21814827248454094, + 0.28354473412036896, + 1.1644203960895538, + 0.0767035074532032, + 0.0, + 1.05635404586792, + 2.3889632374048233, + 0.5264220871031284, + 0.0, + 0.2696160785853863, + 0.0504227913916111, + 0.0, + 0.6958271935582161, + 0.33359093591570854, + 0.9659464079886675, + 1.998962016776204, + 0.03971508517861366, + 0.3941010348498821, + 0.47317418828606606, + 2.693323325365782, + 0.05006667971611023, + 0.5040391888469458, + 0.13089202716946602, + 0.0, + 0.2941826581954956, + 0.8531238753348589, + 0.3764277081936598, + 0.46005019918084145, + 0.4022870361804962, + 0.8646974712610245, + 0.7159403450787067 + ], + "unique_experts": 55, + "load_cv": 1.0162829231012356, + "normalized_load_entropy": 0.8859191880435413, + "max_load_share": 0.08018867924528301 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "7a8f55e6c2d5dcd68646f3c69c103751262b715743ba3b66b87c61897131ecae", + "route_weight_sha256": "4272f488ef5a96ff52b66472fe7a23fb0ec8909b371bc35a4b214e83178ff9ce", + "loads": [ + 26, + 5, + 6, + 8, + 37, + 9, + 39, + 17, + 22, + 2, + 23, + 17, + 19, + 16, + 5, + 27, + 14, + 10, + 3, + 4, + 5, + 11, + 20, + 3, + 13, + 0, + 12, + 1, + 8, + 18, + 7, + 7, + 20, + 15, + 6, + 17, + 7, + 1, + 18, + 43, + 11, + 3, + 15, + 2, + 16, + 23, + 10, + 30, + 19, + 6, + 12, + 12, + 53, + 3, + 13, + 5, + 3, + 16, + 27, + 12, + 10, + 11, + 16, + 13 + ], + "weighted_loads": [ + 1.3873069062829018, + 0.29008908569812775, + 0.2591371424496174, + 0.33233814500272274, + 1.586552070453763, + 0.45498912781476974, + 2.695791518315673, + 1.238809209316969, + 0.9994898065924644, + 0.08927828818559647, + 1.6254053693264723, + 1.1705725556239486, + 1.0648119542747736, + 0.7832999508827925, + 0.18342391960322857, + 1.5892586838454008, + 0.7456208951771259, + 0.335100076161325, + 0.10958867520093918, + 0.14564023353159428, + 0.2046236153692007, + 0.5952750202268362, + 1.101047407835722, + 0.12196814641356468, + 0.49189343303442, + 0.0, + 0.4257033597677946, + 0.02484774775803089, + 0.2935274466872215, + 1.620271172374487, + 0.4052514396607876, + 0.3049159664660692, + 1.32096316665411, + 1.3168985024094582, + 0.5091251097619534, + 1.2197712771594524, + 0.45602688752114773, + 0.03337422013282776, + 1.0993187241256237, + 2.5208815932273865, + 0.7079563289880753, + 0.13146701455116272, + 0.9349429160356522, + 0.12460591271519661, + 1.1465180963277817, + 1.7108412645757198, + 0.4096921943128109, + 2.1953693833202124, + 2.291789600625634, + 0.2852587178349495, + 0.43133485317230225, + 0.47317418828606606, + 2.766389463096857, + 0.1301712915301323, + 0.6165968887507915, + 0.20289282873272896, + 0.15489286184310913, + 1.001487098634243, + 1.2367993984371424, + 0.530915142968297, + 0.4887353330850601, + 0.4842456020414829, + 0.8646974712610245, + 0.805651567876339 + ], + "unique_experts": 63, + "load_cv": 0.7619553757078977, + "normalized_load_entropy": 0.935007253172296, + "max_load_share": 0.060090702947845805 + } + }, + "s0_bos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "6aec63e9528ff4de7a06eafa5ae19b07c111effb2f9baf3ea7397512be48cdf3", + "route_weight_sha256": "3dc378aa3604afad76dc0915a076ab74fd5a6d90c7e3eda43e2378d0fb593488", + "loads": [ + 21, + 2, + 5, + 6, + 39, + 8, + 9, + 19, + 21, + 0, + 10, + 5, + 19, + 16, + 5, + 20, + 16, + 7, + 0, + 2, + 4, + 5, + 21, + 0, + 8, + 0, + 7, + 1, + 6, + 0, + 0, + 5, + 21, + 4, + 3, + 16, + 2, + 0, + 18, + 41, + 8, + 0, + 6, + 1, + 0, + 10, + 12, + 24, + 16, + 1, + 13, + 11, + 51, + 1, + 10, + 2, + 0, + 4, + 18, + 7, + 11, + 9, + 16, + 13 + ], + "weighted_loads": [ + 1.171831265091896, + 0.08280017226934433, + 0.24334204569458961, + 0.27569830045104027, + 1.695031626150012, + 0.41163718700408936, + 0.38456601835787296, + 1.3704527281224728, + 0.9583569560199976, + 0.0, + 0.7488554548472166, + 0.26380745880305767, + 1.0912927240133286, + 0.7856110166758299, + 0.17597291991114616, + 1.2518960181623697, + 0.7869646325707436, + 0.2425024528056383, + 0.0, + 0.06024792231619358, + 0.17244519293308258, + 0.27560804411768913, + 1.162504505366087, + 0.0, + 0.34539420157670975, + 0.0, + 0.23601225204765797, + 0.02516668476164341, + 0.23343251086771488, + 0.0, + 0.0, + 0.22823134437203407, + 1.384612262248993, + 0.21874773874878883, + 0.2844218760728836, + 1.1823387034237385, + 0.07371977716684341, + 0.0, + 1.111593384295702, + 2.3936133459210396, + 0.5310539193451405, + 0.0, + 0.2341286651790142, + 0.05172058939933777, + 0.0, + 0.6429376266896725, + 0.4730734098702669, + 0.8612161595374346, + 2.015200525522232, + 0.041113536804914474, + 0.473426915705204, + 0.44304036535322666, + 2.7369687035679817, + 0.051245350390672684, + 0.49929420091211796, + 0.10385046526789665, + 0.0, + 0.27139102667570114, + 0.826864005997777, + 0.30276085436344147, + 0.5388980209827423, + 0.41343711502850056, + 0.8633713126182556, + 0.786207964643836 + ], + "unique_experts": 54, + "load_cv": 1.0301994301433328, + "normalized_load_entropy": 0.8822318757837058, + "max_load_share": 0.08018867924528301 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "1ac5a4088612711c7a8de864eac1d192d54fcb7019a98ab4283d3c1a4a79db7e", + "route_weight_sha256": "bfb16f0647ca76bc1c7c5dec871678364f18fcd744fd08bdfe7399f2e16593b0", + "loads": [ + 21, + 7, + 6, + 6, + 40, + 8, + 27, + 19, + 21, + 4, + 20, + 9, + 19, + 16, + 5, + 26, + 16, + 9, + 1, + 3, + 4, + 8, + 21, + 0, + 11, + 0, + 10, + 1, + 6, + 13, + 0, + 5, + 21, + 9, + 4, + 16, + 5, + 1, + 18, + 43, + 9, + 1, + 9, + 3, + 11, + 21, + 14, + 25, + 18, + 1, + 14, + 11, + 55, + 5, + 13, + 2, + 4, + 4, + 24, + 12, + 11, + 10, + 16, + 14 + ], + "weighted_loads": [ + 1.171831265091896, + 0.38361771777272224, + 0.3128858767449856, + 0.27569830045104027, + 1.7446896824985743, + 0.41163718700408936, + 1.8328811712563038, + 1.3704527281224728, + 0.9583569560199976, + 0.1813470907509327, + 1.4021617956459522, + 0.6001809388399124, + 1.0912927240133286, + 0.7856110166758299, + 0.17597291991114616, + 1.559475438669324, + 0.7869646325707436, + 0.3218936678022146, + 0.04177592322230339, + 0.10372903011739254, + 0.17244519293308258, + 0.43178199231624603, + 1.162504505366087, + 0.0, + 0.4498271830379963, + 0.0, + 0.36050341837108135, + 0.02516668476164341, + 0.23343251086771488, + 0.9026180617511272, + 0.0, + 0.22823134437203407, + 1.384612262248993, + 0.7668539322912693, + 0.30724330246448517, + 1.1823387034237385, + 0.3325855527073145, + 0.03359677270054817, + 1.111593384295702, + 2.5013340078294277, + 0.6396706141531467, + 0.049772460013628006, + 0.3928975760936737, + 0.16159847751259804, + 0.7219070307910442, + 1.667300682514906, + 0.538656348362565, + 1.2223351020365953, + 2.0899714417755604, + 0.041113536804914474, + 0.5113010555505753, + 0.44304036535322666, + 2.8816343024373055, + 0.25117137283086777, + 0.6300259474664927, + 0.10385046526789665, + 0.27569739893078804, + 0.27139102667570114, + 1.1425860468298197, + 0.5389962159097195, + 0.5388980209827423, + 0.4427427500486374, + 0.8633713126182556, + 0.8238499518483877 + ], + "unique_experts": 61, + "load_cv": 0.8562293705845997, + "normalized_load_entropy": 0.9184480834352792, + "max_load_share": 0.06997455470737914 + } + }, + "s1_bos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "76acf5a4513d99c824e355e5e56df350dce233363a5c0e216c756bef727655b9", + "route_weight_sha256": "a72d96e7d3e3352bd34a0073f4a58206e06535725253c56c8e4dcfc41ad7b72a", + "loads": [ + 20, + 1, + 5, + 7, + 39, + 8, + 9, + 17, + 22, + 0, + 10, + 5, + 19, + 19, + 4, + 18, + 16, + 8, + 0, + 1, + 6, + 5, + 21, + 0, + 8, + 0, + 10, + 1, + 6, + 0, + 0, + 5, + 20, + 4, + 3, + 16, + 2, + 0, + 18, + 40, + 8, + 0, + 6, + 1, + 0, + 10, + 11, + 26, + 16, + 1, + 12, + 12, + 49, + 1, + 10, + 1, + 0, + 4, + 19, + 8, + 11, + 9, + 16, + 12 + ], + "weighted_loads": [ + 1.134083965793252, + 0.04954517260193825, + 0.22272959910333157, + 0.31249553337693214, + 1.6765466965734959, + 0.41446132957935333, + 0.3926128149032593, + 1.2886896580457687, + 0.9947170577943325, + 0.0, + 0.7316670939326286, + 0.25434795022010803, + 1.0715434961020947, + 0.878663869574666, + 0.1450604721903801, + 1.130218256264925, + 0.7791696041822433, + 0.27362264320254326, + 0.0, + 0.034683603793382645, + 0.23984985798597336, + 0.27776236087083817, + 1.143059702590108, + 0.0, + 0.34601524844765663, + 0.0, + 0.3511142022907734, + 0.02513045445084572, + 0.24068447388708591, + 0.0, + 0.0, + 0.22471830993890762, + 1.329202700406313, + 0.21734175086021423, + 0.26959093660116196, + 1.1779262199997902, + 0.0741039291024208, + 0.0, + 1.10674162581563, + 2.3445613756775856, + 0.5293354988098145, + 0.0, + 0.2399020604789257, + 0.04537436366081238, + 0.0, + 0.642531257122755, + 0.4389057047665119, + 0.9475613329559565, + 1.983749259263277, + 0.04431726038455963, + 0.4341314509510994, + 0.46584993228316307, + 2.597283609211445, + 0.04953690245747566, + 0.4796456042677164, + 0.0696326270699501, + 0.0, + 0.2509389854967594, + 0.8477672226727009, + 0.3402038514614105, + 0.5224763825535774, + 0.4250609986484051, + 0.8530894871801138, + 0.7591535076498985 + ], + "unique_experts": 54, + "load_cv": 1.0162829231012356, + "normalized_load_entropy": 0.8823946629896093, + "max_load_share": 0.0770440251572327 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "a2092ba2778876d182318c78ca5e30564a0fe34ced3ffa8983869b5e42752b0c", + "route_weight_sha256": "7823118d621f2d066334611c2c11321cdc19d54e1f9f2d0ea924d3db2c9368ba", + "loads": [ + 25, + 6, + 6, + 7, + 39, + 10, + 39, + 17, + 22, + 3, + 22, + 15, + 19, + 19, + 4, + 25, + 16, + 11, + 2, + 3, + 7, + 11, + 21, + 3, + 12, + 0, + 14, + 1, + 6, + 18, + 7, + 6, + 20, + 15, + 6, + 17, + 8, + 1, + 19, + 42, + 11, + 3, + 14, + 2, + 16, + 22, + 13, + 28, + 18, + 6, + 13, + 12, + 51, + 3, + 13, + 3, + 4, + 15, + 27, + 11, + 12, + 11, + 16, + 14 + ], + "weighted_loads": [ + 1.33543392829597, + 0.3718451149761677, + 0.2717678342014551, + 0.31249553337693214, + 1.6765466965734959, + 0.4822903797030449, + 2.8059772085398436, + 1.2886896580457687, + 0.9947170577943325, + 0.14035510644316673, + 1.5224461760371923, + 1.0893424917012453, + 1.0715434961020947, + 0.878663869574666, + 0.1450604721903801, + 1.5061717629432678, + 0.7791696041822433, + 0.390349593013525, + 0.06607121601700783, + 0.11811672151088715, + 0.28392086178064346, + 0.5993897970765829, + 1.143059702590108, + 0.12196814641356468, + 0.5232898555696011, + 0.0, + 0.5125360675156116, + 0.02513045445084572, + 0.24068447388708591, + 1.6210905015468597, + 0.4052514396607876, + 0.26423607766628265, + 1.329202700406313, + 1.3105145804584026, + 0.49517131224274635, + 1.2332771010696888, + 0.5463984292000532, + 0.03337422013282776, + 1.1497063040733337, + 2.4627348482608795, + 0.7155328206717968, + 0.13146701455116272, + 0.9195860587060452, + 0.12016347050666809, + 1.151759061962366, + 1.657886628061533, + 0.5150069631636143, + 1.3472146969288588, + 2.2345940805971622, + 0.28986089304089546, + 0.4713652692735195, + 0.46584993228316307, + 2.67034974694252, + 0.12964151427149773, + 0.5916644334793091, + 0.14163342863321304, + 0.1976245604455471, + 0.9582434259355068, + 1.211680043488741, + 0.49469128623604774, + 0.5511615164577961, + 0.5070195645093918, + 0.8530894871801138, + 0.8488647304475307 + ], + "unique_experts": 63, + "load_cv": 0.7487767321973888, + "normalized_load_entropy": 0.9360330642825462, + "max_load_share": 0.05782312925170068 + } + }, + "s0_x": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "202475c18864f7e1848073a919154a7c26f859aa4b61ecaeb80399e24072e0c5", + "route_weight_sha256": "4176474524e33113c81b4caa303e7512819cdbb31d6802153c67e893843ccd0f", + "loads": [ + 21, + 2, + 5, + 7, + 34, + 8, + 8, + 19, + 22, + 0, + 12, + 5, + 19, + 17, + 5, + 18, + 15, + 6, + 0, + 2, + 6, + 5, + 23, + 0, + 8, + 0, + 8, + 1, + 5, + 0, + 0, + 5, + 20, + 4, + 3, + 16, + 3, + 0, + 18, + 40, + 9, + 0, + 6, + 1, + 0, + 10, + 12, + 26, + 16, + 1, + 13, + 11, + 50, + 1, + 9, + 1, + 0, + 4, + 19, + 8, + 12, + 8, + 16, + 13 + ], + "weighted_loads": [ + 1.1754037383943796, + 0.08026737347245216, + 0.24339411780238152, + 0.30940748937428, + 1.478092534467578, + 0.40949616208672523, + 0.33311767131090164, + 1.3800631389021873, + 0.9992404449731112, + 0.0, + 0.7967011779546738, + 0.24714018031954765, + 1.089074980467558, + 0.8140165507793427, + 0.17763333767652512, + 1.1414401941001415, + 0.7644009366631508, + 0.20851614885032177, + 0.0, + 0.06258475594222546, + 0.23582278192043304, + 0.2786019332706928, + 1.2232770770788193, + 0.0, + 0.3449145592749119, + 0.0, + 0.2740478366613388, + 0.025365980342030525, + 0.20274722017347813, + 0.0, + 0.0, + 0.22606789134442806, + 1.3572576493024826, + 0.22133975476026535, + 0.27346883714199066, + 1.1829636208713055, + 0.10796608403325081, + 0.0, + 1.10847282782197, + 2.3260520063340664, + 0.5658123157918453, + 0.0, + 0.247847069054842, + 0.05125400424003601, + 0.0, + 0.6487360559403896, + 0.4726372957229614, + 0.9382006954401731, + 1.9795866198837757, + 0.04507093504071236, + 0.4684674274176359, + 0.41255148500204086, + 2.6967241689562798, + 0.04792993888258934, + 0.45920436829328537, + 0.07179564982652664, + 0.0, + 0.2574577294290066, + 0.8644846547394991, + 0.34972526505589485, + 0.5551664661616087, + 0.37291782163083553, + 0.8609951231628656, + 0.7778197228908539 + ], + "unique_experts": 54, + "load_cv": 1.0051684008669886, + "normalized_load_entropy": 0.8848590734480105, + "max_load_share": 0.07861635220125786 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "03f81b351f6c11227371b101fe31efbe334200463a4f4d9821afa175617a77f4", + "route_weight_sha256": "93990526e02a99b8a01332d1241c2f68e316b017e3a5079bbfdb4263edfd081c", + "loads": [ + 21, + 6, + 5, + 7, + 34, + 8, + 26, + 19, + 22, + 2, + 23, + 10, + 19, + 17, + 5, + 25, + 15, + 8, + 1, + 3, + 7, + 8, + 23, + 0, + 13, + 0, + 11, + 1, + 5, + 12, + 0, + 5, + 20, + 10, + 4, + 16, + 6, + 1, + 18, + 42, + 10, + 1, + 9, + 2, + 13, + 22, + 15, + 27, + 18, + 1, + 14, + 11, + 54, + 4, + 11, + 1, + 3, + 4, + 24, + 13, + 12, + 9, + 16, + 14 + ], + "weighted_loads": [ + 1.1754037383943796, + 0.3064592704176903, + 0.24339411780238152, + 0.30940748937428, + 1.478092534467578, + 0.40949616208672523, + 1.6770331729203463, + 1.3800631389021873, + 0.9992404449731112, + 0.07683849334716797, + 1.4680028278380632, + 0.6534666549414396, + 1.089074980467558, + 0.8140165507793427, + 0.17763333767652512, + 1.6666444726288319, + 0.7644009366631508, + 0.2867001462727785, + 0.04177592322230339, + 0.10606586374342442, + 0.27735406532883644, + 0.45022493228316307, + 1.2232770770788193, + 0.0, + 0.5303616523742676, + 0.0, + 0.3985390029847622, + 0.025365980342030525, + 0.20274722017347813, + 0.8830203227698803, + 0.0, + 0.22606789134442806, + 1.3572576493024826, + 0.8371398746967316, + 0.2962902635335922, + 1.1829636208713055, + 0.3490245100110769, + 0.03359677270054817, + 1.10847282782197, + 2.4326683431863785, + 0.6770827434957027, + 0.049772460013628006, + 0.38059669360518456, + 0.09726661816239357, + 0.874735627323389, + 1.8796173259615898, + 0.5673327632248402, + 1.299319637939334, + 2.0661360807716846, + 0.04507093504071236, + 0.5063415672630072, + 0.41255148500204086, + 2.8413897678256035, + 0.18605004623532295, + 0.5476030185818672, + 0.07179564982652664, + 0.164889108389616, + 0.2574577294290066, + 1.1532887760549784, + 0.5859606266021729, + 0.5551664661616087, + 0.40222345665097237, + 0.8609951231628656, + 0.8154617100954056 + ], + "unique_experts": 61, + "load_cv": 0.8412161402730223, + "normalized_load_entropy": 0.9181060499683701, + "max_load_share": 0.06870229007633588 + } + }, + "s1_x": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "9e1f39f5fc4e8d6d60921296ccd6137edd20bb2a692cebc68e180dcf17852feb", + "route_weight_sha256": "79b831b884bcb9c5ca7ff5c8ddf92c83a5dc8d2f3f4ec5f7ed19173bb7f8a814", + "loads": [ + 20, + 1, + 5, + 7, + 35, + 9, + 10, + 18, + 21, + 0, + 11, + 4, + 20, + 17, + 4, + 16, + 16, + 7, + 0, + 0, + 5, + 5, + 20, + 0, + 9, + 0, + 8, + 1, + 7, + 0, + 0, + 5, + 22, + 4, + 3, + 15, + 2, + 0, + 18, + 40, + 8, + 1, + 8, + 1, + 0, + 9, + 11, + 29, + 16, + 1, + 13, + 14, + 49, + 1, + 10, + 2, + 0, + 4, + 16, + 9, + 12, + 9, + 16, + 12 + ], + "weighted_loads": [ + 1.1065749172121286, + 0.04759102314710617, + 0.223411463201046, + 0.3053768388926983, + 1.5434788167476654, + 0.45204639434814453, + 0.4179418161511421, + 1.3037859667092562, + 0.9580199886113405, + 0.0, + 0.7522416170686483, + 0.21135495603084564, + 1.0845948196947575, + 0.809125255793333, + 0.1419703457504511, + 1.0841568298637867, + 0.7820006608963013, + 0.240286810323596, + 0.0, + 0.0, + 0.21179665252566338, + 0.2783137708902359, + 1.0974248312413692, + 0.0, + 0.38723844289779663, + 0.0, + 0.2982242275029421, + 0.025725403800606728, + 0.26669944263994694, + 0.0, + 0.0, + 0.22665315493941307, + 1.3967771027237177, + 0.21864355728030205, + 0.2763656824827194, + 1.1599948666989803, + 0.07570759207010269, + 0.0, + 1.0927461329847574, + 2.3321808706969023, + 0.5228987373411655, + 0.0315183661878109, + 0.30695873498916626, + 0.04660744592547417, + 0.0, + 0.6013758070766926, + 0.4433209076523781, + 1.0259608626365662, + 1.9420290999114513, + 0.04316699877381325, + 0.47187001816928387, + 0.5177339296787977, + 2.580809937790036, + 0.04224982112646103, + 0.4640517346560955, + 0.09793748147785664, + 0.0, + 0.23912091925740242, + 0.7422119975090027, + 0.369562279433012, + 0.549461105838418, + 0.41204747557640076, + 0.8686532005667686, + 0.7472802549600601 + ], + "unique_experts": 54, + "load_cv": 1.0015414724274025, + "normalized_load_entropy": 0.8846780801586147, + "max_load_share": 0.0770440251572327 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "0d4507210ec5705dd4cf1091cc0f38da1e67c4cf2c351799caff265ee356c6fe", + "route_weight_sha256": "a3cb7311c8e9813e1046048fa95747c77f0892262772df492508927aba099aea", + "loads": [ + 25, + 5, + 5, + 7, + 35, + 11, + 39, + 18, + 21, + 1, + 21, + 14, + 20, + 17, + 4, + 24, + 16, + 10, + 2, + 2, + 6, + 10, + 20, + 3, + 14, + 0, + 13, + 1, + 7, + 18, + 7, + 6, + 22, + 16, + 6, + 16, + 7, + 1, + 19, + 42, + 11, + 5, + 16, + 2, + 18, + 22, + 14, + 31, + 19, + 6, + 14, + 14, + 51, + 3, + 12, + 5, + 3, + 15, + 23, + 12, + 13, + 12, + 16, + 14 + ], + "weighted_loads": [ + 1.3079248797148466, + 0.28693729266524315, + 0.223411463201046, + 0.3053768388926983, + 1.5434788167476654, + 0.5198754444718361, + 2.690402088686824, + 1.3037859667092562, + 0.9580199886113405, + 0.030591819435358047, + 1.409404195845127, + 1.0610906202346087, + 1.0845948196947575, + 0.809125255793333, + 0.1419703457504511, + 1.599669024348259, + 0.7820006608963013, + 0.3520879354327917, + 0.06607121601700783, + 0.0834331177175045, + 0.26536694914102554, + 0.5601177830249071, + 1.0974248312413692, + 0.12196814641356468, + 0.5639343522489071, + 0.0, + 0.49099245481193066, + 0.025725403800606728, + 0.26669944263994694, + 1.6255043745040894, + 0.4052514396607876, + 0.2661709226667881, + 1.3967771027237177, + 1.3986561819911003, + 0.5019460581243038, + 1.215345747768879, + 0.432716378942132, + 0.03337422013282776, + 1.1357108112424612, + 2.4452915471047163, + 0.7089135348796844, + 0.2017212137579918, + 0.9726491868495941, + 0.08864400908350945, + 1.311626199632883, + 1.7638154923915863, + 0.5624229945242405, + 1.4256142266094685, + 2.2369047589600086, + 0.2887106314301491, + 0.509103836491704, + 0.5177339296787977, + 2.6538760755211115, + 0.1223544329404831, + 0.535197963938117, + 0.20975967682898045, + 0.15489286184310913, + 0.9464253596961498, + 1.0144362095743418, + 0.5240497142076492, + 0.5781462397426367, + 0.5293334908783436, + 0.8686532005667686, + 0.8369914777576923 + ], + "unique_experts": 63, + "load_cv": 0.7408236490847178, + "normalized_load_entropy": 0.9360590923259703, + "max_load_share": 0.05782312925170068 + } + }, + "s0_period": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "289a6b387394388ca6c3cc73528d6faf67928edf0a8648a6bae482429b0ef49b", + "route_weight_sha256": "974e8efc90957499305dede3119a7e0e718d50e975a3c992707fd90dae263746", + "loads": [ + 21, + 2, + 6, + 7, + 34, + 8, + 10, + 18, + 21, + 0, + 12, + 6, + 19, + 17, + 6, + 18, + 16, + 8, + 0, + 1, + 4, + 5, + 22, + 0, + 7, + 0, + 7, + 1, + 6, + 0, + 0, + 6, + 21, + 4, + 3, + 16, + 3, + 0, + 18, + 39, + 8, + 0, + 7, + 1, + 0, + 10, + 12, + 22, + 16, + 1, + 13, + 11, + 50, + 1, + 10, + 2, + 0, + 4, + 19, + 9, + 11, + 8, + 16, + 13 + ], + "weighted_loads": [ + 1.163913071155548, + 0.07953277230262756, + 0.27117496356368065, + 0.3085036836564541, + 1.462855400517583, + 0.4095574654638767, + 0.43154244869947433, + 1.325747836381197, + 0.966707918792963, + 0.0, + 0.8015038445591927, + 0.2818956431001425, + 1.078286174684763, + 0.8127681072801352, + 0.210497185587883, + 1.152609508484602, + 0.7890161722898483, + 0.266982140019536, + 0.0, + 0.032406359910964966, + 0.17123422771692276, + 0.2784576043486595, + 1.1969377845525742, + 0.0, + 0.30641938745975494, + 0.0, + 0.23359681107103825, + 0.02438303455710411, + 0.2328713722527027, + 0.0, + 0.0, + 0.26188010163605213, + 1.3723495732992887, + 0.22222523018717766, + 0.2789374366402626, + 1.1843721941113472, + 0.10390912741422653, + 0.0, + 1.0933359563350677, + 2.2855983823537827, + 0.519757455214858, + 0.0, + 0.278446227312088, + 0.052806392312049866, + 0.0, + 0.6431906558573246, + 0.4755989648401737, + 0.8036406636238098, + 1.9728574007749557, + 0.045225489884614944, + 0.46671090833842754, + 0.41820629872381687, + 2.687087034806609, + 0.04837750270962715, + 0.4877711683511734, + 0.10424646735191345, + 0.0, + 0.2534761466085911, + 0.8700401317328215, + 0.3794162943959236, + 0.5246087163686752, + 0.37781449407339096, + 0.8541696239262819, + 0.773828748613596 + ], + "unique_experts": 54, + "load_cv": 0.985617067184247, + "normalized_load_entropy": 0.8880665224612855, + "max_load_share": 0.07861635220125786 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "8a4b693550991f5f750dabae35ab1b7a86c8d2e889c446da71aa41d74a5c479c", + "route_weight_sha256": "b292205e6cd4acb258202230c04d99f2dcaf5f5f448cdf4de46026201705353f", + "loads": [ + 21, + 7, + 6, + 7, + 34, + 8, + 26, + 18, + 21, + 2, + 23, + 11, + 19, + 17, + 6, + 24, + 16, + 10, + 1, + 2, + 5, + 8, + 22, + 0, + 11, + 0, + 10, + 1, + 6, + 13, + 0, + 6, + 21, + 11, + 4, + 16, + 7, + 1, + 18, + 41, + 9, + 3, + 10, + 3, + 12, + 21, + 14, + 23, + 18, + 1, + 14, + 11, + 54, + 4, + 12, + 2, + 3, + 4, + 24, + 14, + 11, + 9, + 16, + 14 + ], + "weighted_loads": [ + 1.163913071155548, + 0.4831204004585743, + 0.27117496356368065, + 0.3085036836564541, + 1.462855400517583, + 0.4095574654638767, + 1.7252725791186094, + 1.325747836381197, + 0.966707918792963, + 0.07683849334716797, + 1.5423597190529108, + 0.7042452096939087, + 1.078286174684763, + 0.8127681072801352, + 0.210497185587883, + 1.4601889289915562, + 0.7890161722898483, + 0.3440727386623621, + 0.04177592322230339, + 0.07588746771216393, + 0.21817396953701973, + 0.42695945315063, + 1.1969377845525742, + 0.0, + 0.5292996987700462, + 0.0, + 0.35808797739446163, + 0.02438303455710411, + 0.2328713722527027, + 0.964756540954113, + 0.0, + 0.26188010163605213, + 1.3723495732992887, + 0.8948986455798149, + 0.30175886303186417, + 1.1843721941113472, + 0.4004474859684706, + 0.03359677270054817, + 1.0933359563350677, + 2.3894843868911266, + 0.6296329852193594, + 0.13313450291752815, + 0.4023900330066681, + 0.1616024412214756, + 0.8155428841710091, + 1.6777095831930637, + 0.5411819033324718, + 1.1647596061229706, + 2.0522086545825005, + 0.045225489884614944, + 0.5045850481837988, + 0.41820629872381687, + 2.831752633675933, + 0.18649761006236076, + 0.5761698186397552, + 0.10424646735191345, + 0.164889108389616, + 0.2534761466085911, + 1.141911095008254, + 0.6156516559422016, + 0.5246087163686752, + 0.4071201290935278, + 0.8541696239262819, + 0.8114707358181477 + ], + "unique_experts": 61, + "load_cv": 0.8184963985231102, + "normalized_load_entropy": 0.9229505614241362, + "max_load_share": 0.06870229007633588 + } + }, + "s1_period": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "6c834287c903418b48e94117279e854bbb1d274232122e1580768fabccc7a24e", + "route_weight_sha256": "848503c6cbc19af8935e2dbffcf336391d72eae4ba6b08114cbe3e2997cb56e4", + "loads": [ + 19, + 1, + 5, + 7, + 38, + 8, + 10, + 19, + 21, + 0, + 11, + 4, + 18, + 16, + 4, + 16, + 16, + 9, + 0, + 0, + 5, + 5, + 21, + 0, + 9, + 0, + 8, + 1, + 7, + 0, + 0, + 4, + 21, + 4, + 3, + 15, + 2, + 0, + 18, + 42, + 9, + 1, + 7, + 1, + 0, + 10, + 12, + 25, + 15, + 1, + 12, + 12, + 52, + 1, + 11, + 2, + 0, + 4, + 18, + 9, + 11, + 8, + 16, + 12 + ], + "weighted_loads": [ + 1.088750071823597, + 0.04791400581598282, + 0.22523579746484756, + 0.30737508460879326, + 1.6155778374522924, + 0.40941399708390236, + 0.40398024022579193, + 1.3577751759439707, + 0.9715514928102493, + 0.0, + 0.7675297874957323, + 0.2137524001300335, + 1.0266347862780094, + 0.7730877138674259, + 0.13889380730688572, + 1.0750305466353893, + 0.7694571763277054, + 0.2997255325317383, + 0.0, + 0.0, + 0.20824408158659935, + 0.2807002291083336, + 1.164183545857668, + 0.0, + 0.3740875720977783, + 0.0, + 0.29393021017313004, + 0.025768032297492027, + 0.27014609798789024, + 0.0, + 0.0, + 0.18769654631614685, + 1.3839216735213995, + 0.21936176717281342, + 0.2718017175793648, + 1.1571321040391922, + 0.07454459741711617, + 0.0, + 1.0931017026305199, + 2.4109652675688267, + 0.5613851100206375, + 0.03097318857908249, + 0.2745106779038906, + 0.04938692972064018, + 0.0, + 0.6464869976043701, + 0.4770875349640846, + 0.9166398011147976, + 1.9104488715529442, + 0.044144876301288605, + 0.4346141070127487, + 0.444597827270627, + 2.707153184339404, + 0.04824332892894745, + 0.4886280093342066, + 0.1005200743675232, + 0.0, + 0.23568369820713997, + 0.8085756972432137, + 0.37578932009637356, + 0.5195626821368933, + 0.38524407520890236, + 0.8588432930409908, + 0.7501001730561256 + ], + "unique_experts": 54, + "load_cv": 1.0286624490477576, + "normalized_load_entropy": 0.8822647362226211, + "max_load_share": 0.08176100628930817 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "44537d5d5d03ea7deec06b06d0a38ec0a5719939b0b219ec03911cb7f4374c67", + "route_weight_sha256": "ba5e0aba5f1008fd9bbc2f13cb4600cf477fe756a6134b4dcb2a94e7b77a93c0", + "loads": [ + 24, + 6, + 5, + 7, + 38, + 10, + 39, + 19, + 21, + 1, + 22, + 15, + 18, + 16, + 4, + 23, + 16, + 12, + 2, + 2, + 6, + 10, + 21, + 3, + 13, + 0, + 12, + 1, + 7, + 19, + 7, + 6, + 21, + 17, + 6, + 16, + 8, + 1, + 19, + 44, + 12, + 5, + 15, + 2, + 18, + 23, + 14, + 27, + 18, + 6, + 13, + 12, + 54, + 3, + 13, + 4, + 3, + 15, + 24, + 12, + 12, + 10, + 16, + 14 + ], + "weighted_loads": [ + 1.290100034326315, + 0.451536200940609, + 0.22523579746484756, + 0.30737508460879326, + 1.6155778374522924, + 0.4772430472075939, + 2.668548097833991, + 1.3577751759439707, + 0.9715514928102493, + 0.030591819435358047, + 1.5027986317873, + 1.0950716864317656, + 1.0266347862780094, + 0.7730877138674259, + 0.13889380730688572, + 1.4509840533137321, + 0.7694571763277054, + 0.41742054745554924, + 0.06607121601700783, + 0.0834331177175045, + 0.2634231969714165, + 0.5551966708153486, + 1.164183545857668, + 0.12196814641356468, + 0.6292502880096436, + 0.0, + 0.4553520753979683, + 0.025768032297492027, + 0.27014609798789024, + 1.7042022235691547, + 0.4052514396607876, + 0.2602010630071163, + 1.3839216735213995, + 1.4459398612380028, + 0.4973820932209492, + 1.2124829851090908, + 0.5012297984212637, + 0.03337422013282776, + 1.1360663808882236, + 2.521278690546751, + 0.7454949803650379, + 0.20181125029921532, + 0.9238808266818523, + 0.0833483524620533, + 1.2833864279091358, + 1.6966321021318436, + 0.553188793361187, + 1.3162931650877, + 2.1994364708662033, + 0.28968850895762444, + 0.47184792533516884, + 0.444597827270627, + 2.7802193220704794, + 0.1283479407429695, + 0.5597742386162281, + 0.17252087593078613, + 0.15489286184310913, + 0.9429881386458874, + 1.0531341545283794, + 0.5302767548710108, + 0.548247816041112, + 0.46720264106988907, + 0.8588432930409908, + 0.8398113958537579 + ], + "unique_experts": 63, + "load_cv": 0.7604422579267583, + "normalized_load_entropy": 0.9344027427380897, + "max_load_share": 0.061224489795918366 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 106, + "ordered_topk_exact_tokens": 68, + "set_exact_tokens": 82, + "mean_set_jaccard": 0.933288409703504, + "mean_token_weighted_tv": 0.011906176190471874, + "aggregate_load_tv": 0.023584905660377353 + }, + "system_bos": { + "tokens": 106, + "ordered_topk_exact_tokens": 49, + "set_exact_tokens": 72, + "mean_set_jaccard": 0.90633423180593, + "mean_token_weighted_tv": 0.017593594188889804, + "aggregate_load_tv": 0.02515723270440251 + }, + "system_x": { + "tokens": 106, + "ordered_topk_exact_tokens": 47, + "set_exact_tokens": 66, + "mean_set_jaccard": 0.8881401617250675, + "mean_token_weighted_tv": 0.02007037947692399, + "aggregate_load_tv": 0.03930817610062892 + }, + "system_period": { + "tokens": 106, + "ordered_topk_exact_tokens": 48, + "set_exact_tokens": 70, + "mean_set_jaccard": 0.8989218328840971, + "mean_token_weighted_tv": 0.01798562266213714, + "aggregate_load_tv": 0.03616352201257861 + }, + "bos_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 47, + "set_exact_tokens": 67, + "mean_set_jaccard": 0.8888140161725068, + "mean_token_weighted_tv": 0.02066430432792261, + "aggregate_load_tv": 0.033018867924528295 + }, + "bos_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 49, + "set_exact_tokens": 64, + "mean_set_jaccard": 0.8766846361185985, + "mean_token_weighted_tv": 0.022415568893951066, + "aggregate_load_tv": 0.03459119496855346 + }, + "x_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 48, + "set_exact_tokens": 64, + "mean_set_jaccard": 0.8827493261455527, + "mean_token_weighted_tv": 0.021096949351354026, + "aggregate_load_tv": 0.033018867924528295 + }, + "x_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 37, + "set_exact_tokens": 62, + "mean_set_jaccard": 0.8656783468104222, + "mean_token_weighted_tv": 0.025613021307607304, + "aggregate_load_tv": 0.04245283018867924 + }, + "period_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 45, + "set_exact_tokens": 58, + "mean_set_jaccard": 0.86455525606469, + "mean_token_weighted_tv": 0.023650030350699177, + "aggregate_load_tv": 0.040880503144654086 + }, + "period_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 39, + "set_exact_tokens": 61, + "mean_set_jaccard": 0.8614106019766399, + "mean_token_weighted_tv": 0.025421504572666478, + "aggregate_load_tv": 0.040880503144654086 + } + } + }, + "layer_14": { + "layer": 14, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "324e227a70483eb2ae19c993a66f3ad93d811f6f98d59d267fd99a6c29a536a7", + "route_weight_sha256": "d1dd82463c78db1c3b4bb90b5270c0c6090b83865ef6698d1d4bf2a28d174265", + "loads": [ + 8, + 3, + 9, + 5, + 6, + 2, + 30, + 5, + 12, + 0, + 46, + 1, + 4, + 22, + 3, + 5, + 17, + 8, + 6, + 19, + 21, + 9, + 0, + 8, + 2, + 7, + 9, + 10, + 10, + 29, + 3, + 6, + 10, + 0, + 1, + 15, + 3, + 14, + 15, + 17, + 12, + 26, + 13, + 0, + 5, + 4, + 17, + 23, + 8, + 19, + 1, + 15, + 12, + 1, + 31, + 17, + 6, + 0, + 2, + 4, + 2, + 10, + 4, + 4 + ], + "weighted_loads": [ + 0.6040242351591587, + 0.11442848667502403, + 0.4152928125113249, + 0.18242976069450378, + 0.38970035314559937, + 0.07457546144723892, + 2.4959817454218864, + 0.15838291123509407, + 0.6597911827266216, + 0.0, + 2.345003282651305, + 0.03931782767176628, + 0.14597502164542675, + 1.467061560600996, + 0.11079831421375275, + 0.24903356283903122, + 0.8388347961008549, + 0.44128669053316116, + 0.261835191398859, + 1.6215955540537834, + 1.7869772985577583, + 0.7738313414156437, + 0.0, + 0.29114046692848206, + 0.1655225194990635, + 0.5043042041361332, + 0.4405545983463526, + 0.4162650443613529, + 0.3699612654745579, + 1.5832856707274914, + 0.1648142859339714, + 0.2519053593277931, + 0.7027243729680777, + 0.0, + 0.04384315758943558, + 0.9454983659088612, + 0.09922508336603642, + 0.9104253239929676, + 0.9385438784956932, + 0.9447525404393673, + 0.44108780659735203, + 2.050581719726324, + 0.7592981401830912, + 0.0, + 0.3145759887993336, + 0.12758143618702888, + 1.7063447628170252, + 1.954442759975791, + 1.40902029722929, + 1.9620887339115143, + 0.057178713381290436, + 0.5910528991371393, + 0.8279745951294899, + 0.06824849545955658, + 2.559664560481906, + 1.061129815876484, + 0.3102151192724705, + 0.0, + 0.07055007293820381, + 0.15977666154503822, + 0.11961697787046432, + 0.41518858447670937, + 0.2607385627925396, + 0.2516997680068016 + ], + "unique_experts": 59, + "load_cv": 0.9162337025119546, + "normalized_load_entropy": 0.9054984308392324, + "max_load_share": 0.07232704402515723 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "c3d4b8ae33f160f825da14bee7c190c2e0c7b176a1861afaf83519a98a02562b", + "route_weight_sha256": "eb4213a6e9c176a907596dfab08a980e2a08a25069365679bc550200442bf72b", + "loads": [ + 14, + 3, + 9, + 6, + 7, + 13, + 30, + 7, + 12, + 7, + 48, + 4, + 4, + 22, + 3, + 9, + 17, + 8, + 11, + 21, + 21, + 9, + 0, + 19, + 3, + 10, + 15, + 16, + 17, + 29, + 5, + 11, + 10, + 7, + 1, + 15, + 4, + 15, + 17, + 17, + 12, + 26, + 14, + 1, + 7, + 4, + 24, + 26, + 8, + 19, + 6, + 20, + 18, + 7, + 31, + 21, + 7, + 0, + 2, + 15, + 2, + 11, + 4, + 5 + ], + "weighted_loads": [ + 1.2579242251813412, + 0.11442848667502403, + 0.4152928125113249, + 0.22233949229121208, + 0.43555187806487083, + 1.0991025790572166, + 2.4959817454218864, + 0.23122138902544975, + 0.6597911827266216, + 0.5074448511004448, + 2.4116725847125053, + 0.23252084106206894, + 0.14597502164542675, + 1.467061560600996, + 0.11079831421375275, + 0.4354028720408678, + 0.8388347961008549, + 0.44128669053316116, + 0.6194785591214895, + 1.7752068638801575, + 1.7869772985577583, + 0.7738313414156437, + 0.0, + 0.7619989104568958, + 0.18814696371555328, + 0.7190549261868, + 0.778325529769063, + 0.8714401656761765, + 1.4846928007900715, + 1.5832856707274914, + 0.32002706080675125, + 0.45565840136259794, + 0.7027243729680777, + 0.5695316791534424, + 0.04384315758943558, + 0.9454983659088612, + 0.15101350657641888, + 0.9534423686563969, + 1.0713873989880085, + 0.9447525404393673, + 0.44108780659735203, + 2.050581719726324, + 0.8180085923522711, + 0.04766218736767769, + 0.37912432476878166, + 0.12758143618702888, + 2.0453713461756706, + 2.089050717651844, + 1.40902029722929, + 1.9620887339115143, + 0.26335075311362743, + 1.902636231854558, + 1.5449663624167442, + 0.4967467077076435, + 2.559664560481906, + 1.3944612927734852, + 0.3507119454443455, + 0.0, + 0.07055007293820381, + 0.6672403030097485, + 0.11961697787046432, + 0.4201966621913016, + 0.2607385627925396, + 0.33166737854480743 + ], + "unique_experts": 62, + "load_cv": 0.7347259398463567, + "normalized_load_entropy": 0.936543110314368, + "max_load_share": 0.061068702290076333 + } + }, + "s1_eos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "1960dfdc83b8a07182f75b5e4a75ffcdd0dac0e0298506d4ab27c068cf3ec09b", + "route_weight_sha256": "4846032c5b7401e732c2a2ee216be2fba6d5b82be8a8d155c224d814ccbe8471", + "loads": [ + 8, + 3, + 9, + 4, + 6, + 2, + 30, + 4, + 12, + 0, + 45, + 1, + 4, + 21, + 4, + 5, + 18, + 9, + 5, + 18, + 21, + 9, + 0, + 8, + 2, + 7, + 9, + 8, + 8, + 31, + 3, + 6, + 10, + 0, + 1, + 15, + 3, + 14, + 15, + 17, + 11, + 26, + 13, + 0, + 6, + 3, + 17, + 23, + 8, + 19, + 2, + 17, + 10, + 1, + 32, + 19, + 8, + 0, + 2, + 4, + 3, + 7, + 5, + 5 + ], + "weighted_loads": [ + 0.6180758439004421, + 0.11257878318428993, + 0.4080621022731066, + 0.14821355044841766, + 0.3924258276820183, + 0.07229283824563026, + 2.5378566831350327, + 0.12544718571007252, + 0.6595272645354271, + 0.0, + 2.308792434632778, + 0.041664622724056244, + 0.14879672415554523, + 1.4539470355957747, + 0.1411832608282566, + 0.25343430414795876, + 0.8590991273522377, + 0.4813279379159212, + 0.22164791822433472, + 1.57772047072649, + 1.763855718076229, + 0.7948933467268944, + 0.0, + 0.288351533934474, + 0.168695580214262, + 0.4989745169878006, + 0.42285006679594517, + 0.3348077032715082, + 0.3065818324685097, + 1.6480975039303303, + 0.17202181741595268, + 0.24961096420884132, + 0.6941792462021112, + 0.0, + 0.041478171944618225, + 0.9418126121163368, + 0.10237285494804382, + 0.8982379995286465, + 0.9379592854529619, + 0.9356648754328489, + 0.39918842539191246, + 2.064770644530654, + 0.7679458893835545, + 0.0, + 0.360024344176054, + 0.09586446359753609, + 1.7058060187846422, + 1.9102596528828144, + 1.4189950563013554, + 1.9435210600495338, + 0.09078595414757729, + 0.6750064976513386, + 0.774027481675148, + 0.07151061296463013, + 2.589069291949272, + 1.1369963008910418, + 0.38795063085854053, + 0.0, + 0.06958949193358421, + 0.15992079488933086, + 0.1484630350023508, + 0.30108997225761414, + 0.2902409750968218, + 0.2693417724221945 + ], + "unique_experts": 59, + "load_cv": 0.9201969304057772, + "normalized_load_entropy": 0.9056744419929111, + "max_load_share": 0.07075471698113207 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "90c87e8396aff3593d5f5491e52c18888f03960d5f6d49487b5f96c346ce3f2e", + "route_weight_sha256": "4128d40b9c3e3f8307330e6159388141a3d4c9994a2beadfeeeabb92ed9d4a84", + "loads": [ + 15, + 4, + 9, + 6, + 10, + 19, + 30, + 8, + 14, + 10, + 45, + 4, + 9, + 21, + 4, + 10, + 18, + 9, + 12, + 23, + 23, + 13, + 0, + 18, + 8, + 12, + 14, + 16, + 20, + 32, + 7, + 9, + 12, + 11, + 2, + 16, + 3, + 17, + 18, + 18, + 11, + 26, + 15, + 1, + 8, + 3, + 24, + 26, + 10, + 20, + 17, + 21, + 18, + 11, + 34, + 22, + 9, + 1, + 3, + 22, + 6, + 9, + 7, + 9 + ], + "weighted_loads": [ + 1.3655064441263676, + 0.16442816331982613, + 0.4080621022731066, + 0.22379210218787193, + 0.6457514613866806, + 1.31019152328372, + 2.5378566831350327, + 0.28925771079957485, + 0.8273547887802124, + 0.7837820798158646, + 2.308792434632778, + 0.2565896362066269, + 0.49742372520267963, + 1.4539470355957747, + 0.1411832608282566, + 0.49522566981613636, + 0.8590991273522377, + 0.4813279379159212, + 0.7403981983661652, + 1.882365783676505, + 1.9931524209678173, + 0.9446960389614105, + 0.0, + 0.7099330518394709, + 0.448733102530241, + 0.7721089720726013, + 0.7930136639624834, + 0.6995214922353625, + 1.9594682790338993, + 1.6957262195646763, + 0.38030778616666794, + 0.33844641502946615, + 0.7749996315687895, + 1.0494425483047962, + 0.09047159552574158, + 1.0218082591891289, + 0.10237285494804382, + 1.2535371743142605, + 1.1617664564400911, + 0.9928172472864389, + 0.39918842539191246, + 2.064770644530654, + 0.8660516552627087, + 0.05069635063409805, + 0.4233754687011242, + 0.09586446359753609, + 2.070959521457553, + 2.0210286173969507, + 1.5479664504528046, + 1.977564625442028, + 1.039996698498726, + 1.948073387145996, + 1.5792193785309792, + 0.8256336413323879, + 2.6715116538107395, + 1.4085302222520113, + 0.4396613594144583, + 0.038023509085178375, + 0.1764349602162838, + 1.1976417135447264, + 0.4001373890787363, + 0.3452907600440085, + 0.39196272008121014, + 0.4508251156657934 + ], + "unique_experts": 63, + "load_cv": 0.6331648869572732, + "normalized_load_entropy": 0.9511211966371629, + "max_load_share": 0.05102040816326531 + } + }, + "s0_bos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "5b64528d4dead65dd359a3a83d3274a9c66716a05f78f3e32ff4daa63c22ae7b", + "route_weight_sha256": "ae9d99ed3498da694496af90e10f388018f492704ffebe238d811b49ea04b14a", + "loads": [ + 8, + 3, + 9, + 6, + 6, + 2, + 31, + 4, + 13, + 0, + 43, + 1, + 4, + 19, + 3, + 5, + 18, + 8, + 5, + 16, + 20, + 9, + 0, + 8, + 2, + 7, + 8, + 8, + 10, + 28, + 4, + 6, + 10, + 0, + 1, + 16, + 2, + 14, + 14, + 17, + 17, + 27, + 13, + 0, + 7, + 2, + 16, + 23, + 10, + 19, + 3, + 15, + 11, + 1, + 32, + 16, + 8, + 0, + 2, + 4, + 2, + 11, + 5, + 4 + ], + "weighted_loads": [ + 0.6300218012183905, + 0.11089278943836689, + 0.4228513166308403, + 0.21775326691567898, + 0.39076628163456917, + 0.07090229913592339, + 2.5433206744492054, + 0.12167464755475521, + 0.7017308697104454, + 0.0, + 2.238440530374646, + 0.04039795324206352, + 0.14966900646686554, + 1.4068522714078426, + 0.1016409732401371, + 0.2428070344030857, + 0.8891025427728891, + 0.4279900807887316, + 0.2296757884323597, + 1.4721378404647112, + 1.7702581323683262, + 0.7277033589780331, + 0.0, + 0.2944227997213602, + 0.160181675106287, + 0.5045502781867981, + 0.4033727813512087, + 0.34043950214982033, + 0.3732472714036703, + 1.5712583437561989, + 0.20015119388699532, + 0.24956370890140533, + 0.7153450101613998, + 0.0, + 0.047764852643013, + 0.9698759410530329, + 0.07231134176254272, + 0.9171116873621941, + 0.9182870052754879, + 0.9904358685016632, + 0.6029877383261919, + 2.134971546009183, + 0.7681375835090876, + 0.0, + 0.413179125636816, + 0.07012226432561874, + 1.7053733058273792, + 1.9845497235655785, + 1.4723188243806362, + 1.9481441490352154, + 0.12160962447524071, + 0.5791721548885107, + 0.7946582660079002, + 0.0710342675447464, + 2.6089290753006935, + 1.0253314301371574, + 0.3978048153221607, + 0.0, + 0.0680706575512886, + 0.1523040384054184, + 0.11806968227028847, + 0.4443227667361498, + 0.2881532050669193, + 0.2500969022512436 + ], + "unique_experts": 59, + "load_cv": 0.8949179458591799, + "normalized_load_entropy": 0.908278688240737, + "max_load_share": 0.06761006289308176 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "479d6f0b924445205a2dec1f1b2640cd076aaf62d968dc21f6a48b8d1a75ca06", + "route_weight_sha256": "d4b7d44f0b073c348d3eeff723fe732a3996ff10a93bc7eea0708aeb4e38ccd2", + "loads": [ + 14, + 3, + 9, + 8, + 7, + 13, + 31, + 5, + 13, + 7, + 45, + 4, + 4, + 19, + 3, + 9, + 18, + 8, + 11, + 18, + 20, + 9, + 0, + 18, + 3, + 10, + 14, + 14, + 18, + 28, + 6, + 10, + 10, + 7, + 1, + 16, + 3, + 15, + 16, + 17, + 17, + 27, + 13, + 1, + 10, + 2, + 23, + 26, + 10, + 19, + 7, + 20, + 17, + 7, + 32, + 20, + 9, + 1, + 3, + 15, + 2, + 11, + 5, + 5 + ], + "weighted_loads": [ + 1.283921791240573, + 0.11089278943836689, + 0.4228513166308403, + 0.3009080681949854, + 0.43780626729130745, + 1.0846797414124012, + 2.5433206744492054, + 0.15523391030728817, + 0.7017308697104454, + 0.5195355005562305, + 2.3051098324358463, + 0.23360096663236618, + 0.14966900646686554, + 1.4068522714078426, + 0.1016409732401371, + 0.458477009087801, + 0.8891025427728891, + 0.4279900807887316, + 0.6730389725416899, + 1.6164037007838488, + 1.7702581323683262, + 0.7277033589780331, + 0.0, + 0.7375752907246351, + 0.1828061193227768, + 0.7349245846271515, + 0.7411437127739191, + 0.8383194282650948, + 1.5514255668967962, + 1.5712583437561989, + 0.358825895935297, + 0.4528633616864681, + 0.7153450101613998, + 0.5669514238834381, + 0.047764852643013, + 0.9698759410530329, + 0.12409976497292519, + 0.9601287320256233, + 1.0635339245200157, + 0.9904358685016632, + 0.6029877383261919, + 2.134971546009183, + 0.7681375835090876, + 0.04766218736767769, + 0.5514081083238125, + 0.07012226432561874, + 2.0385648887604475, + 2.119450619444251, + 1.4723188243806362, + 1.9481441490352154, + 0.31943370401859283, + 1.0955688450485468, + 1.5116500332951546, + 0.49953247979283333, + 2.6089290753006935, + 1.395291555672884, + 0.4383016414940357, + 0.04337989538908005, + 0.11109066382050514, + 0.6513321585953236, + 0.11806968227028847, + 0.4443227667361498, + 0.2881532050669193, + 0.32984886318445206 + ], + "unique_experts": 63, + "load_cv": 0.709184545062688, + "normalized_load_entropy": 0.9403179824747155, + "max_load_share": 0.05725190839694656 + } + }, + "s1_bos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "cc1f95e521e37724d55e748a1d8e0c186f66146de803c7d8fd22c5e713863dab", + "route_weight_sha256": "b971c1a6cf15f83bcc27268b9c0b57478409a88a167c6980a9e0b3a53b9f7b7b", + "loads": [ + 8, + 3, + 10, + 4, + 6, + 2, + 30, + 4, + 13, + 0, + 49, + 1, + 4, + 18, + 4, + 5, + 16, + 8, + 6, + 16, + 20, + 9, + 0, + 8, + 2, + 7, + 7, + 8, + 10, + 29, + 4, + 7, + 10, + 0, + 1, + 16, + 3, + 14, + 14, + 16, + 14, + 26, + 13, + 0, + 7, + 2, + 17, + 22, + 9, + 21, + 2, + 16, + 11, + 1, + 32, + 17, + 8, + 0, + 2, + 3, + 3, + 8, + 5, + 5 + ], + "weighted_loads": [ + 0.6069354079663754, + 0.11286364495754242, + 0.4507516138255596, + 0.15279367938637733, + 0.3962676450610161, + 0.06881047040224075, + 2.5821320191025734, + 0.1291108950972557, + 0.6976350527256727, + 0.0, + 2.468094404786825, + 0.041652049869298935, + 0.14764605835080147, + 1.3584250342100859, + 0.14362205937504768, + 0.2575226463377476, + 0.8145924061536789, + 0.4244084358215332, + 0.2441608514636755, + 1.44746982306242, + 1.7371579594910145, + 0.689389955252409, + 0.0, + 0.28577578626573086, + 0.168413195759058, + 0.4946656711399555, + 0.34699342027306557, + 0.3360334075987339, + 0.36901012249290943, + 1.5951738506555557, + 0.20609529688954353, + 0.28651752322912216, + 0.709202267229557, + 0.0, + 0.04073009267449379, + 0.9749383293092251, + 0.10639575123786926, + 0.9211654029786587, + 0.910456757992506, + 0.9622774198651314, + 0.501237066462636, + 2.0699491817504168, + 0.7512815129011869, + 0.0, + 0.4339386783540249, + 0.0645665843039751, + 1.6732572186738253, + 1.9397835694253445, + 1.4118211679160595, + 2.013320265337825, + 0.08980103209614754, + 0.6094480343163013, + 0.7823568638414145, + 0.06311202794313431, + 2.5416994616389275, + 1.0630170740187168, + 0.37783094123005867, + 0.0, + 0.065813347697258, + 0.11781341396272182, + 0.15336260572075844, + 0.32881903648376465, + 0.2855044510215521, + 0.26772401854395866 + ], + "unique_experts": 59, + "load_cv": 0.9246566462064066, + "normalized_load_entropy": 0.9062870881687828, + "max_load_share": 0.0770440251572327 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "e683d1a4a5f2aa0f195c220cab851859603773711004479e07a0ca25d17f775b", + "route_weight_sha256": "7b4a547da1c4346fc34309f2365472a24f8251f18c559ced7964caee4f9df8d2", + "loads": [ + 15, + 4, + 10, + 6, + 10, + 19, + 30, + 7, + 15, + 10, + 49, + 4, + 9, + 18, + 4, + 10, + 16, + 8, + 13, + 21, + 22, + 12, + 0, + 17, + 8, + 12, + 12, + 16, + 23, + 30, + 8, + 10, + 12, + 11, + 2, + 17, + 3, + 17, + 17, + 17, + 14, + 26, + 14, + 1, + 10, + 3, + 24, + 25, + 11, + 22, + 18, + 21, + 19, + 10, + 34, + 20, + 9, + 2, + 3, + 21, + 6, + 9, + 7, + 9 + ], + "weighted_loads": [ + 1.3543660081923008, + 0.1647130250930786, + 0.4507516138255596, + 0.24192716926336288, + 0.6526455022394657, + 1.284864418208599, + 2.5821320191025734, + 0.25565337017178535, + 0.865462576970458, + 0.7949097491800785, + 2.468094404786825, + 0.2565770633518696, + 0.49627305939793587, + 1.3584250342100859, + 0.14362205937504768, + 0.5072697885334492, + 0.8145924061536789, + 0.4244084358215332, + 0.7245956119149923, + 1.7480654399842024, + 1.9664546623826027, + 0.7913585007190704, + 0.0, + 0.679944459348917, + 0.448450718075037, + 0.7790340930223465, + 0.7171570174396038, + 0.7551137022674084, + 2.205026851966977, + 1.6428025662899017, + 0.4171578884124756, + 0.42712271958589554, + 0.7900226525962353, + 1.0630056746304035, + 0.08972351625561714, + 1.0549339763820171, + 0.10639575123786926, + 1.2764645777642727, + 1.1661299355328083, + 1.0194297917187214, + 0.501237066462636, + 2.0699491817504168, + 0.8038940187543631, + 0.05069635063409805, + 0.5388152152299881, + 0.10629953257739544, + 2.0295939203351736, + 2.0552089493721724, + 1.5407925620675087, + 2.047363830730319, + 1.0856135301291943, + 1.097439132630825, + 1.5875487606972456, + 0.7764280922710896, + 2.624141823500395, + 1.3873772956430912, + 0.4295416697859764, + 0.07994239404797554, + 0.17265881597995758, + 1.1490102652460337, + 0.40503695979714394, + 0.3682672418653965, + 0.38722619600594044, + 0.4586971290409565 + ], + "unique_experts": 63, + "load_cv": 0.6365342307720256, + "normalized_load_entropy": 0.95190195824871, + "max_load_share": 0.05555555555555555 + } + }, + "s0_x": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "86ab03bcececb69ad3526c7d5b4e666c158bec16a60224de414dad7be02cafd2", + "route_weight_sha256": "18a99917e68065d5340abfd1b918b3dc725a7220dbc32a1f68fe40779ad65585", + "loads": [ + 9, + 3, + 9, + 4, + 6, + 2, + 30, + 4, + 13, + 0, + 46, + 0, + 4, + 21, + 2, + 5, + 18, + 8, + 6, + 16, + 20, + 9, + 0, + 8, + 2, + 7, + 8, + 8, + 10, + 30, + 3, + 6, + 10, + 0, + 1, + 15, + 3, + 14, + 13, + 17, + 15, + 26, + 12, + 0, + 8, + 2, + 18, + 23, + 8, + 21, + 2, + 16, + 10, + 1, + 31, + 17, + 8, + 0, + 2, + 5, + 2, + 9, + 5, + 5 + ], + "weighted_loads": [ + 0.6604546271264553, + 0.1146102286875248, + 0.4154236763715744, + 0.1577872671186924, + 0.393857654184103, + 0.06988519430160522, + 2.541016925126314, + 0.12998679839074612, + 0.7105885278433561, + 0.0, + 2.3265794534236193, + 0.0, + 0.15177315846085548, + 1.465032210573554, + 0.07565983757376671, + 0.24345492757856846, + 0.9013492148369551, + 0.4630364514887333, + 0.2619503401219845, + 1.455880431458354, + 1.7652004659175873, + 0.7087256778031588, + 0.0, + 0.29590264707803726, + 0.16147958859801292, + 0.5098300166428089, + 0.40552376583218575, + 0.33841801807284355, + 0.368241174146533, + 1.6397969014942646, + 0.16569488495588303, + 0.25149543583393097, + 0.7222974859178066, + 0.0, + 0.04403965547680855, + 0.9445629380643368, + 0.10560351237654686, + 0.9020728580653667, + 0.8866784311830997, + 0.9931588098406792, + 0.5534566435962915, + 2.0685261506587267, + 0.7393078729510307, + 0.0, + 0.4713858440518379, + 0.06615056842565536, + 1.749532775953412, + 1.9496693518012762, + 1.369897797703743, + 2.0271361526101828, + 0.09172772616147995, + 0.5860515255481005, + 0.7546571083366871, + 0.05760508030653, + 2.5454692263156176, + 1.0697485730051994, + 0.3996482118964195, + 0.0, + 0.06768921762704849, + 0.18533469550311565, + 0.11831727996468544, + 0.3757165912538767, + 0.2898409962654114, + 0.2931896299123764 + ], + "unique_experts": 58, + "load_cv": 0.9195089004536757, + "normalized_load_entropy": 0.9041551504261802, + "max_load_share": 0.07232704402515723 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "a5483fe8232ae326826aac4e6319bc6c541ad8e19c0cbeb74d5ce236ec76ce37", + "route_weight_sha256": "e4f65b857a99067777b19b6df0cb2f1315abd5398489c40f7592acd17f7d074c", + "loads": [ + 16, + 3, + 9, + 5, + 7, + 15, + 30, + 5, + 13, + 6, + 48, + 3, + 4, + 21, + 2, + 9, + 18, + 8, + 10, + 19, + 20, + 9, + 0, + 18, + 3, + 10, + 15, + 13, + 17, + 30, + 5, + 10, + 10, + 7, + 1, + 15, + 4, + 16, + 15, + 17, + 15, + 26, + 14, + 1, + 10, + 2, + 24, + 26, + 8, + 21, + 7, + 19, + 16, + 8, + 31, + 21, + 9, + 1, + 2, + 17, + 2, + 9, + 5, + 6 + ], + "weighted_loads": [ + 1.4210194684565067, + 0.1146102286875248, + 0.4154236763715744, + 0.1976969987154007, + 0.4422745481133461, + 1.2299837283790112, + 2.541016925126314, + 0.16354606114327908, + 0.7105885278433561, + 0.4436611346900463, + 2.3932487554848194, + 0.19320301339030266, + 0.15177315846085548, + 1.465032210573554, + 0.07565983757376671, + 0.45281810872256756, + 0.9013492148369551, + 0.4630364514887333, + 0.5687324833124876, + 1.6928639095276594, + 1.7652004659175873, + 0.7087256778031588, + 0.0, + 0.7390551380813122, + 0.18410403281450272, + 0.7387415245175362, + 0.8539600856602192, + 0.7487865462899208, + 1.3257116805762053, + 1.6397969014942646, + 0.3256790563464165, + 0.45089225471019745, + 0.7222974859178066, + 0.6191830784082413, + 0.04403965547680855, + 0.9445629380643368, + 0.15739193558692932, + 1.0184957273304462, + 1.0163524374365807, + 0.9931588098406792, + 0.5534566435962915, + 2.0685261506587267, + 0.8285519704222679, + 0.04766218736767769, + 0.535934180021286, + 0.06615056842565536, + 2.054284378886223, + 2.085913088172674, + 1.369897797703743, + 2.0271361526101828, + 0.3329622782766819, + 1.0091026406735182, + 1.4716488756239414, + 0.5702790133655071, + 2.5454692263156176, + 1.3830158598721027, + 0.4401450380682945, + 0.041082996875047684, + 0.06768921762704849, + 0.7503036167472601, + 0.11831727996468544, + 0.3757165912538767, + 0.2898409962654114, + 0.3827686235308647 + ], + "unique_experts": 63, + "load_cv": 0.7354305863571425, + "normalized_load_entropy": 0.9364741633133284, + "max_load_share": 0.061068702290076333 + } + }, + "s1_x": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "f70b6be4603826ed921b3c59d6e76cb616b6494d313cd88c82527cf523342a80", + "route_weight_sha256": "a583ac093015e69cbcc81d077819393353305d716a6ab41f34f0c30a88b155cb", + "loads": [ + 8, + 3, + 9, + 4, + 6, + 2, + 30, + 4, + 13, + 0, + 46, + 2, + 3, + 20, + 4, + 6, + 19, + 8, + 5, + 16, + 20, + 9, + 0, + 7, + 2, + 7, + 7, + 8, + 9, + 31, + 3, + 7, + 10, + 0, + 0, + 16, + 3, + 14, + 14, + 17, + 16, + 26, + 13, + 0, + 8, + 3, + 18, + 22, + 9, + 21, + 3, + 14, + 10, + 1, + 32, + 16, + 8, + 0, + 1, + 3, + 3, + 8, + 4, + 5 + ], + "weighted_loads": [ + 0.6122251898050308, + 0.11496531963348389, + 0.42450734972953796, + 0.1531876139342785, + 0.39064714685082436, + 0.0662909671664238, + 2.586704671382904, + 0.1290412787348032, + 0.6988472118973732, + 0.0, + 2.3579287622123957, + 0.07221752777695656, + 0.11099855042994022, + 1.4454186018556356, + 0.1455335970968008, + 0.27301207184791565, + 0.9212744403630495, + 0.4437496233731508, + 0.2110045701265335, + 1.4801808651536703, + 1.717753078788519, + 0.6804620120674372, + 0.0, + 0.25957406871020794, + 0.16403472051024437, + 0.5008833482861519, + 0.35537079721689224, + 0.3287308122962713, + 0.3294946663081646, + 1.6748976856470108, + 0.1746046133339405, + 0.2803615853190422, + 0.7102384269237518, + 0.0, + 0.0, + 0.9687303975224495, + 0.10493239760398865, + 0.8980978690087795, + 0.9154412671923637, + 0.971398651599884, + 0.5749982353299856, + 2.0272866934537888, + 0.7524827513843775, + 0.0, + 0.4692235253751278, + 0.09948445297777653, + 1.7493411377072334, + 1.9014099519699812, + 1.3905600756406784, + 2.001728877425194, + 0.1182248592376709, + 0.5412768628448248, + 0.7441201061010361, + 0.06130553409457207, + 2.5822994466871023, + 1.0216399766504765, + 0.39268070086836815, + 0.0, + 0.027824504300951958, + 0.10225168243050575, + 0.1550937294960022, + 0.311984920874238, + 0.2651716470718384, + 0.286659337580204 + ], + "unique_experts": 58, + "load_cv": 0.9227724738028822, + "normalized_load_entropy": 0.9045786103023035, + "max_load_share": 0.07232704402515723 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "18e89fd7ab1f8cd0e5525e379def3a79a88d92bd7c8f64eb1f9d8c2157b1e3f0", + "route_weight_sha256": "31624f3754ed3fea3b1d68446370c21f15f0aa92e7ba5cb2fd893ecafdc27e5e", + "loads": [ + 16, + 4, + 9, + 5, + 10, + 22, + 30, + 7, + 15, + 9, + 46, + 6, + 8, + 20, + 4, + 10, + 19, + 8, + 11, + 21, + 22, + 12, + 0, + 17, + 8, + 12, + 13, + 16, + 21, + 32, + 7, + 9, + 12, + 11, + 1, + 17, + 3, + 18, + 17, + 18, + 16, + 26, + 15, + 1, + 10, + 3, + 24, + 25, + 11, + 22, + 18, + 17, + 18, + 11, + 34, + 19, + 9, + 1, + 2, + 24, + 6, + 9, + 6, + 9 + ], + "weighted_loads": [ + 1.4388334825634956, + 0.16681469976902008, + 0.42450734972953796, + 0.1924457848072052, + 0.6505059637129307, + 1.5073500722646713, + 2.586704671382904, + 0.25558375380933285, + 0.8666747361421585, + 0.7100930511951447, + 2.3579287622123957, + 0.3365929275751114, + 0.4596255514770746, + 1.4454186018556356, + 0.1455335970968008, + 0.47806407883763313, + 0.9212744403630495, + 0.4437496233731508, + 0.6468820124864578, + 1.8097413517534733, + 1.9470497816801071, + 0.7824305575340986, + 0.0, + 0.7066896483302116, + 0.4440722428262234, + 0.7707270383834839, + 0.8268400728702545, + 0.6810336876660585, + 1.8231488056480885, + 1.7225264012813568, + 0.393099382519722, + 0.35843604803085327, + 0.7910588122904301, + 1.1181593090295792, + 0.04899342358112335, + 1.0487260445952415, + 0.10493239760398865, + 1.34910224750638, + 1.1335214599967003, + 1.028551023453474, + 0.5749982353299856, + 2.0272866934537888, + 0.861819414421916, + 0.05069635063409805, + 0.532574649900198, + 0.09948445297777653, + 2.078193813562393, + 2.020058274269104, + 1.5195314697921276, + 2.035772442817688, + 1.0551712960004807, + 0.9701902773231268, + 1.5493120029568672, + 0.9011908546090126, + 2.6647418085485697, + 1.2561332546174526, + 0.4443914294242859, + 0.038023509085178375, + 0.13466997258365154, + 1.2802383229136467, + 0.4067680835723877, + 0.35143312625586987, + 0.36689339205622673, + 0.4885884150862694 + ], + "unique_experts": 63, + "load_cv": 0.6395000065117882, + "normalized_load_entropy": 0.9497702786852418, + "max_load_share": 0.05215419501133787 + } + }, + "s0_period": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "e01f8ade70423b5ad5d467b475fe49ce542efe65e17c8ccbc68bd6ec3a56a444", + "route_weight_sha256": "2f25d83675d7cd7460eed1c8064b43d6703a0375f642e154eb7dea979ecaf57a", + "loads": [ + 8, + 3, + 9, + 4, + 6, + 2, + 30, + 3, + 13, + 0, + 45, + 1, + 4, + 20, + 2, + 5, + 20, + 8, + 5, + 16, + 20, + 9, + 0, + 7, + 2, + 7, + 8, + 9, + 9, + 30, + 3, + 7, + 10, + 0, + 1, + 14, + 2, + 14, + 14, + 17, + 18, + 26, + 14, + 0, + 7, + 3, + 18, + 22, + 9, + 21, + 2, + 14, + 10, + 1, + 32, + 17, + 8, + 0, + 2, + 2, + 2, + 11, + 5, + 5 + ], + "weighted_loads": [ + 0.6225825622677803, + 0.11538246646523476, + 0.42161495611071587, + 0.15512404590845108, + 0.3904699571430683, + 0.07164167985320091, + 2.5610268376767635, + 0.09762189723551273, + 0.7044156771153212, + 0.0, + 2.308526808395982, + 0.03108292631804943, + 0.15044135600328445, + 1.411680718883872, + 0.07376679591834545, + 0.24404048174619675, + 0.9420072101056576, + 0.4445953853428364, + 0.22886894270777702, + 1.4455421529710293, + 1.7419356815516949, + 0.6919277273118496, + 0.0, + 0.26162903010845184, + 0.16487089358270168, + 0.5009557344019413, + 0.4012579619884491, + 0.3696933872997761, + 0.34347199834883213, + 1.6386957075446844, + 0.1659836508333683, + 0.2870956063270569, + 0.7139544151723385, + 0.0, + 0.040992967784404755, + 0.8974604979157448, + 0.07109593600034714, + 0.9018108621239662, + 0.9072880558669567, + 0.966743029654026, + 0.6641177162528038, + 2.0566464215517044, + 0.782485943287611, + 0.0, + 0.4249958097934723, + 0.09361347556114197, + 1.7763610929250717, + 1.9487136527895927, + 1.4307241179049015, + 2.0270753633230925, + 0.0893607996404171, + 0.5297692716121674, + 0.7567713856697083, + 0.06511157751083374, + 2.5705852545797825, + 1.0618812441825867, + 0.39899502508342266, + 0.0, + 0.06814106553792953, + 0.08504065871238708, + 0.11901082471013069, + 0.42550829239189625, + 0.2883383985608816, + 0.29521386697888374 + ], + "unique_experts": 59, + "load_cv": 0.9224294835113128, + "normalized_load_entropy": 0.9033409584921162, + "max_load_share": 0.07075471698113207 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "247c70f209fe91bd5c1c5c82c25bf7721c81076119a6fdbec0641a67f883b609", + "route_weight_sha256": "2ef80574e779905826b2e7888691416efcce67f824cffaf94fc93aca93f198cf", + "loads": [ + 15, + 3, + 9, + 5, + 7, + 14, + 30, + 5, + 13, + 6, + 47, + 4, + 4, + 20, + 2, + 9, + 20, + 8, + 10, + 18, + 20, + 9, + 0, + 17, + 3, + 10, + 15, + 15, + 16, + 30, + 5, + 11, + 10, + 7, + 1, + 14, + 3, + 16, + 16, + 17, + 18, + 26, + 14, + 1, + 9, + 3, + 23, + 26, + 9, + 22, + 7, + 17, + 16, + 8, + 32, + 21, + 9, + 1, + 2, + 14, + 2, + 11, + 5, + 6 + ], + "weighted_loads": [ + 1.3194525353610516, + 0.11538246646523476, + 0.42161495611071587, + 0.19503377750515938, + 0.4382286109030247, + 1.1508364416658878, + 2.5610268376767635, + 0.1723956484347582, + 0.7044156771153212, + 0.4564596898853779, + 2.375196110457182, + 0.2242859397083521, + 0.15044135600328445, + 1.411680718883872, + 0.07376679591834545, + 0.44559259712696075, + 0.9420072101056576, + 0.4445953853428364, + 0.5873065944761038, + 1.601671438664198, + 1.7419356815516949, + 0.6919277273118496, + 0.0, + 0.7047815211117268, + 0.18749533779919147, + 0.7213744260370731, + 0.7933018654584885, + 0.8277984261512756, + 1.370858894661069, + 1.6386957075446844, + 0.33007126674056053, + 0.47927291691303253, + 0.7139544151723385, + 0.5990615971386433, + 0.040992967784404755, + 0.8974604979157448, + 0.1228843592107296, + 1.0043153017759323, + 1.0343434661626816, + 0.966743029654026, + 0.6641177162528038, + 2.0566464215517044, + 0.782485943287611, + 0.04766218736767769, + 0.4895441457629204, + 0.09361347556114197, + 2.0291005056351423, + 2.1549121905118227, + 1.4307241179049015, + 2.0772415939718485, + 0.347491554915905, + 0.9598291851580143, + 1.4737631529569626, + 0.5801172368228436, + 2.5705852545797825, + 1.4421190954744816, + 0.43949185125529766, + 0.038564395159482956, + 0.06814106553792953, + 0.6337137967348099, + 0.11901082471013069, + 0.42550829239189625, + 0.2883383985608816, + 0.38420963659882545 + ], + "unique_experts": 63, + "load_cv": 0.7276419449276745, + "normalized_load_entropy": 0.937736700159821, + "max_load_share": 0.05979643765903308 + } + }, + "s1_period": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "f321ce00a4556d82c859a05ac1cf961e6d9584e2bc9fcf9467501a8bc7461fc0", + "route_weight_sha256": "661c7c54673f5542e402f5082d4c2c893c41ef8f69b6225b6862f4d25af93322", + "loads": [ + 8, + 3, + 10, + 4, + 6, + 2, + 30, + 5, + 13, + 0, + 49, + 2, + 4, + 19, + 4, + 5, + 16, + 8, + 4, + 16, + 20, + 9, + 1, + 8, + 2, + 7, + 7, + 8, + 10, + 31, + 3, + 7, + 10, + 0, + 1, + 16, + 3, + 14, + 14, + 16, + 14, + 26, + 13, + 0, + 7, + 2, + 19, + 21, + 9, + 22, + 2, + 15, + 10, + 1, + 31, + 16, + 8, + 0, + 2, + 2, + 3, + 8, + 5, + 5 + ], + "weighted_loads": [ + 0.6211526170372963, + 0.1152249351143837, + 0.45356386713683605, + 0.1538023054599762, + 0.40503840893507004, + 0.06602463498711586, + 2.633822750300169, + 0.17376579903066158, + 0.7076041288673878, + 0.0, + 2.4896742217242718, + 0.0719001293182373, + 0.14719987474381924, + 1.4061283990740776, + 0.13961118645966053, + 0.25030842423439026, + 0.8193705976009369, + 0.43016486056149006, + 0.16928093135356903, + 1.4636819772422314, + 1.7280444614589214, + 0.6856511160731316, + 0.020067373290657997, + 0.2957517374306917, + 0.16210037842392921, + 0.5015065595507622, + 0.3489467687904835, + 0.33198908530175686, + 0.3531501442193985, + 1.68535166233778, + 0.1754496656358242, + 0.28112760931253433, + 0.7151506170630455, + 0.0, + 0.04141397401690483, + 0.9712785985320807, + 0.10815638676285744, + 0.9091122709214687, + 0.9034614972770214, + 0.949464950710535, + 0.5025730952620506, + 2.0449062939733267, + 0.7494810130447149, + 0.0, + 0.4254952371120453, + 0.06984174251556396, + 1.7574282195419073, + 1.888469010591507, + 1.3772976770997047, + 2.0512575805187225, + 0.09479879215359688, + 0.5585991386324167, + 0.7507623955607414, + 0.06250330805778503, + 2.5323988292366266, + 1.0231628380715847, + 0.39792193099856377, + 0.0, + 0.06225280463695526, + 0.07922879606485367, + 0.1535937264561653, + 0.3236004374921322, + 0.29194567166268826, + 0.29037151858210564 + ], + "unique_experts": 60, + "load_cv": 0.9299460478503597, + "normalized_load_entropy": 0.9064085926719875, + "max_load_share": 0.0770440251572327 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "85dfe0b1c583f48b0490e084b3d8cde7a9ae83ff19a39198c08b8bc36a175b45", + "route_weight_sha256": "72f412196627bd1c9fe838c85953c6e08eb0ea6e6099be2904e0d57fd6e761f9", + "loads": [ + 16, + 4, + 10, + 5, + 10, + 20, + 30, + 8, + 15, + 10, + 49, + 5, + 9, + 19, + 4, + 9, + 16, + 8, + 10, + 21, + 22, + 12, + 1, + 17, + 9, + 12, + 13, + 15, + 22, + 32, + 8, + 10, + 12, + 10, + 2, + 17, + 3, + 18, + 17, + 17, + 14, + 26, + 14, + 1, + 9, + 2, + 25, + 25, + 11, + 24, + 18, + 18, + 18, + 12, + 33, + 19, + 9, + 2, + 3, + 21, + 6, + 9, + 7, + 9 + ], + "weighted_loads": [ + 1.427394326776266, + 0.1670743152499199, + 0.45356386713683605, + 0.1930604763329029, + 0.6623955443501472, + 1.3425793796777725, + 2.633822750300169, + 0.30030827410519123, + 0.8754316531121731, + 0.7717431336641312, + 2.4896742217242718, + 0.28682514280080795, + 0.49582687579095364, + 1.4061283990740776, + 0.13961118645966053, + 0.45141180604696274, + 0.8193705976009369, + 0.43016486056149006, + 0.6476853638887405, + 1.781012276187539, + 1.9573411643505096, + 0.787619661539793, + 0.020067373290657997, + 0.6899204105138779, + 0.4811932072043419, + 0.7657426483929157, + 0.7610010839998722, + 0.6381202060729265, + 1.7696559354662895, + 1.732980377972126, + 0.4340037852525711, + 0.3969808407127857, + 0.7959710024297237, + 1.0835780389606953, + 0.09040739759802818, + 1.0512742456048727, + 0.10815638676285744, + 1.3572390191257, + 1.11327188834548, + 1.006617322564125, + 0.5025730952620506, + 2.0449062939733267, + 0.802093518897891, + 0.05069635063409805, + 0.4888463616371155, + 0.06984174251556396, + 2.075380565598607, + 2.0427329894155264, + 1.506269071251154, + 2.127844415605068, + 1.1058253720402718, + 0.9850837606936693, + 1.5559542924165726, + 0.9002525694668293, + 2.614841191098094, + 1.3424702398478985, + 0.4496326595544815, + 0.08574442937970161, + 0.16909827291965485, + 1.1513754650950432, + 0.4052680805325508, + 0.36304864287376404, + 0.3936674166470766, + 0.487471591681242 + ], + "unique_experts": 64, + "load_cv": 0.6389852082393954, + "normalized_load_entropy": 0.9522139617694072, + "max_load_share": 0.05555555555555555 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 106, + "ordered_topk_exact_tokens": 70, + "set_exact_tokens": 89, + "mean_set_jaccard": 0.9541778975741242, + "mean_token_weighted_tv": 0.01051289562733387, + "aggregate_load_tv": 0.026729559748427674 + }, + "system_bos": { + "tokens": 106, + "ordered_topk_exact_tokens": 53, + "set_exact_tokens": 76, + "mean_set_jaccard": 0.9110512129380055, + "mean_token_weighted_tv": 0.018506487295523566, + "aggregate_load_tv": 0.02987421383647798 + }, + "system_x": { + "tokens": 106, + "ordered_topk_exact_tokens": 58, + "set_exact_tokens": 78, + "mean_set_jaccard": 0.9245283018867925, + "mean_token_weighted_tv": 0.017226483277484494, + "aggregate_load_tv": 0.02672955974842767 + }, + "system_period": { + "tokens": 106, + "ordered_topk_exact_tokens": 56, + "set_exact_tokens": 80, + "mean_set_jaccard": 0.9278975741239892, + "mean_token_weighted_tv": 0.01676435682500871, + "aggregate_load_tv": 0.0330188679245283 + }, + "bos_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 52, + "set_exact_tokens": 71, + "mean_set_jaccard": 0.9036388140161725, + "mean_token_weighted_tv": 0.01997464565771087, + "aggregate_load_tv": 0.036163522012578615 + }, + "bos_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 53, + "set_exact_tokens": 79, + "mean_set_jaccard": 0.925202156334232, + "mean_token_weighted_tv": 0.018186417364357214, + "aggregate_load_tv": 0.0330188679245283 + }, + "x_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 53, + "set_exact_tokens": 73, + "mean_set_jaccard": 0.9110512129380054, + "mean_token_weighted_tv": 0.019681217886929243, + "aggregate_load_tv": 0.031446540880503145 + }, + "x_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 47, + "set_exact_tokens": 74, + "mean_set_jaccard": 0.9097035040431267, + "mean_token_weighted_tv": 0.02207232878174422, + "aggregate_load_tv": 0.03301886792452831 + }, + "period_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 48, + "set_exact_tokens": 66, + "mean_set_jaccard": 0.8921832884097036, + "mean_token_weighted_tv": 0.02138628168383016, + "aggregate_load_tv": 0.04088050314465409 + }, + "period_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 47, + "set_exact_tokens": 74, + "mean_set_jaccard": 0.9097035040431267, + "mean_token_weighted_tv": 0.02192080054291577, + "aggregate_load_tv": 0.037735849056603765 + } + } + }, + "layer_15": { + "layer": 15, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "424b83222963288c7b51db288e19e31d950be855d7135e911e1aa39b69bcd559", + "route_weight_sha256": "5ab55488e4cb84d34aec2630974058a3fb4c347f6a2794aa2a8331ad5cdd3736", + "loads": [ + 6, + 8, + 24, + 11, + 1, + 1, + 0, + 6, + 1, + 0, + 18, + 14, + 18, + 9, + 5, + 0, + 1, + 9, + 0, + 6, + 3, + 26, + 0, + 5, + 6, + 22, + 3, + 27, + 3, + 5, + 11, + 11, + 0, + 4, + 1, + 3, + 7, + 19, + 0, + 9, + 21, + 7, + 14, + 14, + 4, + 8, + 17, + 24, + 6, + 2, + 4, + 64, + 13, + 16, + 4, + 13, + 21, + 3, + 9, + 17, + 30, + 4, + 13, + 5 + ], + "weighted_loads": [ + 0.20583334751427174, + 0.5175073351711035, + 2.0950902309268713, + 0.4969756118953228, + 0.044354259967803955, + 0.04172603413462639, + 0.0, + 0.25775187835097313, + 0.041745174676179886, + 0.0, + 1.9223980531096458, + 1.6828082781285048, + 0.9534522630274296, + 0.4274421092122793, + 0.1627441793680191, + 0.0, + 0.03988068550825119, + 0.30901380628347397, + 0.0, + 0.3514700196683407, + 0.10549894906580448, + 1.3719036914408207, + 0.0, + 0.22048850916326046, + 0.21087726578116417, + 1.8610960152000189, + 0.07483047619462013, + 2.0573028437793255, + 0.09874187037348747, + 0.2090410739183426, + 0.6583085544407368, + 0.5623814705759287, + 0.0, + 0.22414297610521317, + 0.051840148866176605, + 0.08722850680351257, + 0.3333963956683874, + 1.3448778241872787, + 0.0, + 0.3854710813611746, + 1.3706287033855915, + 0.25312837958335876, + 0.8221541345119476, + 1.1899082623422146, + 0.16487673670053482, + 0.37965687923133373, + 1.5651527680456638, + 2.0206036996096373, + 0.22131763398647308, + 0.22445397824048996, + 0.16871466860175133, + 4.062083929777145, + 1.728655593469739, + 0.9210643619298935, + 0.1475727390497923, + 0.4798679109662771, + 1.0319727268069983, + 0.21072491258382797, + 0.6778816618025303, + 0.7405165396630764, + 1.7895771488547325, + 0.3189484588801861, + 0.8430008720606565, + 0.1969042718410492 + ], + "unique_experts": 57, + "load_cv": 1.0421100871808326, + "normalized_load_entropy": 0.889716802178046, + "max_load_share": 0.10062893081761007 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "670b7c6f40e86afe1d6f50fb46b2e688f4f46b46db98f10c4e2dc945afc04260", + "route_weight_sha256": "23e1c2f0f1546c6223f2c7060beba5ea344534d6709b7f5d63c70df2e8564103", + "loads": [ + 8, + 8, + 24, + 12, + 6, + 4, + 7, + 7, + 7, + 1, + 22, + 15, + 24, + 9, + 15, + 1, + 8, + 11, + 0, + 8, + 3, + 26, + 0, + 10, + 11, + 23, + 13, + 27, + 6, + 5, + 15, + 11, + 5, + 6, + 1, + 3, + 12, + 19, + 0, + 9, + 28, + 9, + 14, + 16, + 4, + 8, + 17, + 25, + 7, + 10, + 7, + 66, + 20, + 16, + 5, + 18, + 21, + 3, + 10, + 18, + 30, + 8, + 13, + 11 + ], + "weighted_loads": [ + 0.3700896967202425, + 0.5175073351711035, + 2.0950902309268713, + 0.5489051081240177, + 0.4138655476272106, + 0.11419024504721165, + 0.6066682673990726, + 0.29089248552918434, + 0.39816592261195183, + 0.0314757265150547, + 2.0708591863512993, + 1.7129141874611378, + 1.382351890206337, + 0.4274421092122793, + 0.5417059576138854, + 0.031402166932821274, + 0.649676937609911, + 0.37491615675389767, + 0.0, + 0.4736870378255844, + 0.10549894906580448, + 1.3719036914408207, + 0.0, + 0.4926790688186884, + 0.3294020656030625, + 1.8894580397754908, + 0.7298884280025959, + 2.0573028437793255, + 0.21170932799577713, + 0.2090410739183426, + 0.8330956399440765, + 0.5623814705759287, + 0.4048077315092087, + 0.3150714486837387, + 0.051840148866176605, + 0.08722850680351257, + 1.1177375679835677, + 1.3448778241872787, + 0.0, + 0.3854710813611746, + 2.046304071554914, + 0.2988581024110317, + 0.8221541345119476, + 1.2725028060376644, + 0.16487673670053482, + 0.37965687923133373, + 1.5651527680456638, + 2.054982179775834, + 0.23481694143265486, + 1.42238125577569, + 0.3524727299809456, + 4.148444887250662, + 2.0005039582028985, + 0.9210643619298935, + 0.16715843603014946, + 2.199159422889352, + 1.0319727268069983, + 0.21072491258382797, + 0.7231812998652458, + 0.8278636373579502, + 1.7895771488547325, + 0.5515390858054161, + 0.8430008720606565, + 0.4611115790903568 + ], + "unique_experts": 61, + "load_cv": 0.8288098583667273, + "normalized_load_entropy": 0.9289003772260528, + "max_load_share": 0.08396946564885496 + } + }, + "s1_eos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "72ec0bb630e6da344e5ded8a007a0fcd4102480ec89f64712ebadcbe8a29ab61", + "route_weight_sha256": "295f82df45540cdd1363b057fdf4fe6cccae328e2fb2eff07b812eda9cf6cdfb", + "loads": [ + 4, + 9, + 24, + 12, + 1, + 2, + 0, + 7, + 1, + 0, + 18, + 14, + 17, + 9, + 4, + 0, + 1, + 7, + 0, + 6, + 2, + 27, + 0, + 4, + 6, + 22, + 4, + 27, + 3, + 5, + 11, + 9, + 0, + 5, + 1, + 2, + 7, + 19, + 1, + 9, + 20, + 8, + 15, + 14, + 4, + 7, + 18, + 23, + 5, + 2, + 4, + 63, + 13, + 17, + 4, + 15, + 21, + 3, + 8, + 17, + 34, + 3, + 13, + 5 + ], + "weighted_loads": [ + 0.1356627456843853, + 0.5568171106278896, + 2.0755981765687466, + 0.5387258902192116, + 0.045574434101581573, + 0.08065778762102127, + 0.0, + 0.2898516561836004, + 0.042641788721084595, + 0.0, + 1.9121454693377018, + 1.66029816493392, + 0.9132169429212809, + 0.4281308688223362, + 0.12821718491613865, + 0.0, + 0.041615914553403854, + 0.2536168247461319, + 0.0, + 0.3677012138068676, + 0.06755845434963703, + 1.410908592864871, + 0.0, + 0.20172050595283508, + 0.2119024097919464, + 1.8609704189002514, + 0.10880886949598789, + 2.05342785269022, + 0.09882099740207195, + 0.20807962492108345, + 0.6417837329208851, + 0.5125057119876146, + 0.0, + 0.26038144156336784, + 0.05280254781246185, + 0.05971905589103699, + 0.33284551464021206, + 1.3333803601562977, + 0.03396497666835785, + 0.3810142744332552, + 1.3477166555821896, + 0.2866818979382515, + 0.8446848317980766, + 1.1942829266190529, + 0.16055520623922348, + 0.35700323805212975, + 1.5941394492983818, + 1.9667567424476147, + 0.19262906722724438, + 0.21954823285341263, + 0.1662953943014145, + 4.095923230051994, + 1.725755736231804, + 0.9282648712396622, + 0.14660529233515263, + 0.5359976068139076, + 1.0400699973106384, + 0.2071419544517994, + 0.6510505080223083, + 0.7349285911768675, + 1.8931402042508125, + 0.26969362050294876, + 0.8370129391551018, + 0.18708983063697815 + ], + "unique_experts": 58, + "load_cv": 1.0519326216149516, + "normalized_load_entropy": 0.8880999968824761, + "max_load_share": 0.09905660377358491 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "9669e00b777ca1e8b433c47756adf36369d3eea88afd25b2265e6a634fdb0fc3", + "route_weight_sha256": "0727b5460c7f48c64cde4ee6cb3930541bc393c1d0b7ff4d357de25dd7f7b70a", + "loads": [ + 23, + 10, + 24, + 13, + 8, + 7, + 13, + 7, + 11, + 2, + 23, + 19, + 24, + 10, + 10, + 10, + 13, + 12, + 1, + 10, + 3, + 28, + 0, + 10, + 9, + 23, + 14, + 29, + 9, + 6, + 17, + 13, + 5, + 7, + 3, + 2, + 13, + 19, + 3, + 10, + 27, + 10, + 15, + 16, + 4, + 8, + 18, + 25, + 8, + 14, + 9, + 65, + 16, + 18, + 5, + 20, + 21, + 9, + 10, + 22, + 34, + 10, + 15, + 10 + ], + "weighted_loads": [ + 1.4176755547523499, + 0.5834819190204144, + 2.0755981765687466, + 0.5920955128967762, + 0.5066227540373802, + 0.2849900647997856, + 1.108738237991929, + 0.2898516561836004, + 0.5473484955728054, + 0.06318290159106255, + 2.1534663029015064, + 2.0354099087417126, + 1.4518794175237417, + 0.5087223164737225, + 0.3300168439745903, + 0.6605832846835256, + 1.1269064582884312, + 0.4448345359414816, + 0.049402523785829544, + 0.6363469157367945, + 0.09649740904569626, + 1.4921812321990728, + 0.0, + 0.4790999982506037, + 0.2789020976051688, + 1.8894332461059093, + 0.8066808637231588, + 2.1787969432771206, + 0.5178000833839178, + 0.24560922384262085, + 0.8677703384310007, + 0.9702724125236273, + 0.3970720171928406, + 0.3757525198161602, + 0.2007896900177002, + 0.05971905589103699, + 1.0996883949264884, + 1.3333803601562977, + 0.09950781986117363, + 0.41678321920335293, + 1.9855419681407511, + 0.3751657479442656, + 0.8446848317980766, + 1.4702377431094646, + 0.16055520623922348, + 0.39481423795223236, + 1.5941394492983818, + 2.0378158763051033, + 0.33530568052083254, + 2.168760523200035, + 0.4093885254114866, + 4.164828345179558, + 1.862024019472301, + 1.0761627703905106, + 0.16893625259399414, + 2.240298818796873, + 1.0400699973106384, + 0.8702718429267406, + 0.735729593783617, + 0.9902561251074076, + 1.8931402042508125, + 0.7213858775794506, + 0.9524062760174274, + 0.3947167955338955 + ], + "unique_experts": 63, + "load_cv": 0.7195286828862792, + "normalized_load_entropy": 0.9460975671975499, + "max_load_share": 0.07369614512471655 + } + }, + "s0_bos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "dc452b7a4639e7eed548473043c094f53c16b21adda1ddf5ea6edbd2d0f30f69", + "route_weight_sha256": "3808886d2e9a60d27fcd53e3f6cd9d87bc1bb6b11debf135699d7702f8d0b06c", + "loads": [ + 6, + 10, + 25, + 11, + 1, + 1, + 0, + 6, + 1, + 0, + 18, + 15, + 17, + 9, + 6, + 0, + 1, + 6, + 0, + 7, + 3, + 26, + 0, + 5, + 6, + 20, + 4, + 26, + 2, + 6, + 11, + 12, + 0, + 4, + 1, + 4, + 8, + 19, + 0, + 7, + 19, + 6, + 14, + 15, + 5, + 7, + 17, + 23, + 7, + 2, + 4, + 64, + 13, + 17, + 7, + 12, + 20, + 3, + 8, + 16, + 33, + 3, + 13, + 4 + ], + "weighted_loads": [ + 0.20668132789433002, + 0.5727169662714005, + 2.1359560191631317, + 0.4771820902824402, + 0.04473692923784256, + 0.042050234973430634, + 0.0, + 0.2541708145290613, + 0.038261692970991135, + 0.0, + 1.9385241884738207, + 1.6793287079781294, + 0.9351939670741558, + 0.4327572900801897, + 0.20190020091831684, + 0.0, + 0.04359683766961098, + 0.23338951915502548, + 0.0, + 0.4025360494852066, + 0.09253297187387943, + 1.38562436029315, + 0.0, + 0.23472514376044273, + 0.2132388073951006, + 1.8208758998662233, + 0.1085217110812664, + 2.047155387699604, + 0.06824014522135258, + 0.2522467039525509, + 0.6462270319461823, + 0.5898805186152458, + 0.0, + 0.24279597960412502, + 0.0554722435772419, + 0.11919091269373894, + 0.374127771705389, + 1.3761136643588543, + 0.0, + 0.3211321420967579, + 1.2729458063840866, + 0.22515979781746864, + 0.8360430933535099, + 1.2475790791213512, + 0.19516582414507866, + 0.3656788803637028, + 1.5906898602843285, + 1.9795992150902748, + 0.24084347300231457, + 0.2225484475493431, + 0.16378651559352875, + 4.1926977299153805, + 1.7533041015267372, + 0.9601559340953827, + 0.25340734235942364, + 0.41836800798773766, + 1.0051250327378511, + 0.2092217355966568, + 0.6386917717754841, + 0.6923187226057053, + 1.8889862578362226, + 0.2759944275021553, + 0.859512023627758, + 0.16885602101683617 + ], + "unique_experts": 57, + "load_cv": 1.0395258052432481, + "normalized_load_entropy": 0.8907818717278153, + "max_load_share": 0.10062893081761007 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "9780f24b1ad0756c46bedce53e66c8a467a14327449869a08876a72cb869ea5c", + "route_weight_sha256": "60a110c49e8816e5d97e3b4d827427eca0406009f16072b36054969680b11e74", + "loads": [ + 9, + 10, + 25, + 12, + 5, + 4, + 7, + 7, + 5, + 1, + 22, + 17, + 23, + 9, + 15, + 1, + 8, + 8, + 0, + 9, + 3, + 26, + 0, + 10, + 10, + 21, + 14, + 26, + 5, + 6, + 15, + 12, + 5, + 6, + 1, + 5, + 13, + 19, + 1, + 7, + 27, + 6, + 14, + 17, + 5, + 7, + 17, + 24, + 8, + 10, + 9, + 67, + 20, + 17, + 9, + 15, + 20, + 3, + 9, + 17, + 33, + 7, + 13, + 10 + ], + "weighted_loads": [ + 0.4458512980490923, + 0.5727169662714005, + 2.1359560191631317, + 0.5324078500270844, + 0.34810128435492516, + 0.15163864381611347, + 0.5478357672691345, + 0.28731142170727253, + 0.3289880268275738, + 0.0314757265150547, + 2.086985321715474, + 1.7505389228463173, + 1.3691722601652145, + 0.4327572900801897, + 0.5707638934254646, + 0.031402166932821274, + 0.65636882558465, + 0.29806855879724026, + 0.0, + 0.5247530676424503, + 0.09253297187387943, + 1.38562436029315, + 0.0, + 0.5069157034158707, + 0.32805320248007774, + 1.8492379244416952, + 0.7635796628892422, + 2.047155387699604, + 0.18120760284364223, + 0.2522467039525509, + 0.821014117449522, + 0.5898805186152458, + 0.4048077315092087, + 0.33372445218265057, + 0.0554722435772419, + 0.2056046463549137, + 1.2081927778199315, + 1.3761136643588543, + 0.022597679868340492, + 0.3211321420967579, + 2.057515200227499, + 0.22515979781746864, + 0.8360430933535099, + 1.330173622816801, + 0.19516582414507866, + 0.3656788803637028, + 1.5906898602843285, + 2.0139776952564716, + 0.25434278044849634, + 1.3947447054088116, + 0.4745985195040703, + 4.3288213685154915, + 2.020808137021959, + 0.9601559340953827, + 0.3537127207964659, + 1.119377963244915, + 1.0051250327378511, + 0.2092217355966568, + 0.6839914098381996, + 0.7816439047455788, + 1.8889862578362226, + 0.5255981124937534, + 0.859512023627758, + 0.45377228409051895 + ], + "unique_experts": 62, + "load_cv": 0.8318042417089893, + "normalized_load_entropy": 0.9302193063210946, + "max_load_share": 0.08524173027989822 + } + }, + "s1_bos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "49c32526ac0a32a419c01ca45912277dd5ae5128130b85d6815d821f27ea31e8", + "route_weight_sha256": "83746def478a6ba02377ea85673be52c4843b7773c3833b6cfdc3245eb974bd9", + "loads": [ + 5, + 10, + 26, + 10, + 1, + 2, + 0, + 7, + 1, + 0, + 20, + 15, + 18, + 9, + 5, + 0, + 1, + 7, + 0, + 7, + 3, + 27, + 0, + 5, + 6, + 21, + 3, + 27, + 3, + 5, + 11, + 10, + 0, + 5, + 1, + 3, + 7, + 19, + 0, + 10, + 20, + 6, + 14, + 14, + 3, + 7, + 18, + 24, + 6, + 2, + 4, + 63, + 13, + 17, + 5, + 11, + 21, + 3, + 8, + 15, + 32, + 3, + 13, + 4 + ], + "weighted_loads": [ + 0.17702149040997028, + 0.5707817859947681, + 2.1459739096462727, + 0.4435130823403597, + 0.04420823976397514, + 0.07345571368932724, + 0.0, + 0.29611783288419247, + 0.04297321289777756, + 0.0, + 1.9849928598850965, + 1.638385958969593, + 0.9498325493186712, + 0.4318397827446461, + 0.16083567403256893, + 0.0, + 0.04598783701658249, + 0.27228933572769165, + 0.0, + 0.3836551196873188, + 0.0930198710411787, + 1.417515143752098, + 0.0, + 0.25295093283057213, + 0.21137304045259953, + 1.847696317359805, + 0.08168204873800278, + 2.0681964084506035, + 0.09770670160651207, + 0.2055191658437252, + 0.6377260386943817, + 0.5483139809221029, + 0.0, + 0.29873284325003624, + 0.05618590489029884, + 0.09205278381705284, + 0.3443320691585541, + 1.3129216935485601, + 0.0, + 0.4066731669008732, + 1.3226014785468578, + 0.21602188050746918, + 0.8525791838765144, + 1.2037367597222328, + 0.12223716452717781, + 0.36173879727721214, + 1.6061764415353537, + 1.9984895549714565, + 0.21336754225194454, + 0.2070767730474472, + 0.1618364118039608, + 4.169225322082639, + 1.6940669901669025, + 0.9492861609905958, + 0.1884397640824318, + 0.3984989635646343, + 1.0373003911226988, + 0.19995930790901184, + 0.6489729434251785, + 0.645613107830286, + 1.862157603725791, + 0.25858353078365326, + 0.8456829972565174, + 0.16762082278728485 + ], + "unique_experts": 57, + "load_cv": 1.0478636717596275, + "normalized_load_entropy": 0.8884890944682778, + "max_load_share": 0.09905660377358491 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "b7c80df72e1fc81f5aaa202f4026d9f2382583b767ee39cb61c188f7a029f2f7", + "route_weight_sha256": "9d3ee254b99a4cc206912ccdfc14f15e4c927e4e290479b8b2b110b7539953dc", + "loads": [ + 25, + 11, + 26, + 11, + 8, + 7, + 13, + 7, + 10, + 2, + 25, + 20, + 25, + 10, + 10, + 10, + 13, + 12, + 1, + 11, + 4, + 28, + 0, + 11, + 9, + 22, + 13, + 29, + 9, + 6, + 17, + 14, + 5, + 7, + 3, + 3, + 14, + 19, + 2, + 11, + 27, + 7, + 14, + 16, + 3, + 8, + 18, + 26, + 9, + 15, + 11, + 65, + 16, + 18, + 5, + 15, + 21, + 9, + 10, + 20, + 32, + 10, + 15, + 9 + ], + "weighted_loads": [ + 1.5104344841092825, + 0.5974465943872929, + 2.1459739096462727, + 0.4978348184376955, + 0.431004099547863, + 0.3163528647273779, + 1.03215860016644, + 0.29611783288419247, + 0.4988310392946005, + 0.06455855071544647, + 2.226313693448901, + 2.017701618373394, + 1.4964272174984217, + 0.5124312303960323, + 0.3510512076318264, + 0.6605832846835256, + 1.1473883911967278, + 0.46167369931936264, + 0.049402523785829544, + 0.6523008216172457, + 0.12195882573723793, + 1.4987877830863, + 0.0, + 0.5303304251283407, + 0.3265975210815668, + 1.876159144565463, + 0.7795540429651737, + 2.193565499037504, + 0.5166857875883579, + 0.2430487647652626, + 0.8637126442044973, + 1.0060806814581156, + 0.3970720171928406, + 0.4141039215028286, + 0.20417304709553719, + 0.09205278381705284, + 1.183739979751408, + 1.3129216935485601, + 0.06554284319281578, + 0.4424421116709709, + 2.093723764643073, + 0.3002987876534462, + 0.8525791838765144, + 1.4796915762126446, + 0.12223716452717781, + 0.39954979717731476, + 1.6061764415353537, + 2.0779820941388607, + 0.3560441555455327, + 2.2060410045087337, + 0.48304956033825874, + 4.238130437210202, + 1.8283413415774703, + 1.0971840601414442, + 0.1884397640824318, + 1.1831678412854671, + 1.0373003911226988, + 0.8630891963839531, + 0.7336520291864872, + 0.9088276475667953, + 1.862157603725791, + 0.7273107208311558, + 0.9610763341188431, + 0.40780577063560486 + ], + "unique_experts": 63, + "load_cv": 0.7208994461334842, + "normalized_load_entropy": 0.9458681754196466, + "max_load_share": 0.07369614512471655 + } + }, + "s0_x": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "7d54e7410f6d379db070f2ad85cb21c24e4e53bccbf30c2ad387bd9fc1b69034", + "route_weight_sha256": "977c8b5414fb2270921734777302c7ae8e6707f5e296e7312bf6d223c2c63481", + "loads": [ + 6, + 9, + 24, + 12, + 1, + 2, + 0, + 7, + 1, + 0, + 18, + 15, + 17, + 9, + 5, + 0, + 1, + 7, + 0, + 7, + 2, + 26, + 0, + 4, + 6, + 21, + 4, + 27, + 2, + 5, + 13, + 11, + 0, + 4, + 1, + 2, + 7, + 19, + 0, + 8, + 21, + 6, + 14, + 15, + 4, + 7, + 17, + 23, + 7, + 2, + 5, + 63, + 13, + 16, + 4, + 12, + 20, + 3, + 8, + 20, + 33, + 3, + 13, + 4 + ], + "weighted_loads": [ + 0.20267621986567974, + 0.5488270483911037, + 2.102989323437214, + 0.5572519078850746, + 0.0429464690387249, + 0.08005166798830032, + 0.0, + 0.25665662437677383, + 0.04269930720329285, + 0.0, + 1.9383813384920359, + 1.662230096757412, + 0.9392974525690079, + 0.4293802920728922, + 0.15947705321013927, + 0.0, + 0.04182729497551918, + 0.262332309037447, + 0.0, + 0.40614197589457035, + 0.07164353877305984, + 1.384369032457471, + 0.0, + 0.2095038890838623, + 0.20957389287650585, + 1.8220030143857002, + 0.1111142635345459, + 2.0811494551599026, + 0.06532532162964344, + 0.2156892940402031, + 0.7052676565945148, + 0.5785281136631966, + 0.0, + 0.24773097783327103, + 0.05115044116973877, + 0.06262815929949284, + 0.3411779385060072, + 1.361852090805769, + 0.0, + 0.3553414735943079, + 1.3318550828844309, + 0.21687530353665352, + 0.843903087079525, + 1.2355413250625134, + 0.15672770887613297, + 0.36688505858182907, + 1.5659033954143524, + 1.9602870531380177, + 0.24406485632061958, + 0.2133624628186226, + 0.1898440197110176, + 4.20397262275219, + 1.716051910072565, + 0.9354500584304333, + 0.14575039222836494, + 0.42719609662890434, + 0.9909367263317108, + 0.2016519121825695, + 0.6391075849533081, + 0.8285437785089016, + 1.887658428400755, + 0.2719647288322449, + 0.8653687927871943, + 0.16107282415032387 + ], + "unique_experts": 57, + "load_cv": 1.0460501691838242, + "normalized_load_entropy": 0.8879540805735953, + "max_load_share": 0.09905660377358491 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "7651d5ec266f332ec31b94b1b187b264aad5aa75b0118b59a687369f59214cdf", + "route_weight_sha256": "3384adca13bf87620a0598f2b59efcb55105983a63240ff32bb9ebf2a98bfddf", + "loads": [ + 8, + 9, + 24, + 13, + 6, + 3, + 7, + 8, + 8, + 1, + 23, + 16, + 23, + 9, + 14, + 1, + 8, + 8, + 0, + 10, + 2, + 26, + 0, + 10, + 10, + 22, + 15, + 27, + 5, + 5, + 17, + 11, + 5, + 6, + 1, + 2, + 12, + 19, + 0, + 8, + 28, + 7, + 14, + 18, + 4, + 7, + 17, + 24, + 8, + 10, + 9, + 65, + 21, + 16, + 4, + 16, + 20, + 3, + 9, + 21, + 33, + 8, + 13, + 9 + ], + "weighted_loads": [ + 0.32688931562006474, + 0.5488270483911037, + 2.102989323437214, + 0.6022280640900135, + 0.40020984038710594, + 0.09878687374293804, + 0.5976619385182858, + 0.28979723155498505, + 0.42913768999278545, + 0.0314757265150547, + 2.155570575967431, + 1.692336006090045, + 1.3674023486673832, + 0.4293802920728922, + 0.5283407457172871, + 0.031402166932821274, + 0.6687015406787395, + 0.2982248477637768, + 0.0, + 0.5772529114037752, + 0.07164353877305984, + 1.384369032457471, + 0.0, + 0.5774245522916317, + 0.324388287961483, + 1.850365038961172, + 0.8816364780068398, + 2.0811494551599026, + 0.1782927792519331, + 0.2156892940402031, + 0.8800547420978546, + 0.5785281136631966, + 0.4048077315092087, + 0.33865945041179657, + 0.05115044116973877, + 0.06262815929949284, + 1.11977185215801, + 1.361852090805769, + 0.0, + 0.3553414735943079, + 2.036870727315545, + 0.2645096741616726, + 0.843903087079525, + 1.3982345722615719, + 0.15672770887613297, + 0.36688505858182907, + 1.5659033954143524, + 1.9946655333042145, + 0.25756416376680136, + 1.395543422549963, + 0.39890911243855953, + 4.290333580225706, + 2.0285567631945014, + 0.9354500584304333, + 0.14575039222836494, + 1.1671191230416298, + 0.9909367263317108, + 0.2016519121825695, + 0.6844072230160236, + 0.9164335243403912, + 1.887658428400755, + 0.571920920163393, + 0.8653687927871943, + 0.4007049538195133 + ], + "unique_experts": 61, + "load_cv": 0.8361518290302036, + "normalized_load_entropy": 0.9263515337962899, + "max_load_share": 0.08269720101781171 + } + }, + "s1_x": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "d038d19f21354147a1a7aeb96869ac1b95c7eed309a528972a0132856eaeb43e", + "route_weight_sha256": "f3b369eb466ba6925e72e84e56796c1b75e2c83f9895b39f35047925c641d755", + "loads": [ + 5, + 10, + 24, + 12, + 2, + 2, + 0, + 6, + 2, + 0, + 19, + 15, + 17, + 9, + 5, + 0, + 1, + 7, + 0, + 7, + 4, + 28, + 0, + 4, + 6, + 21, + 3, + 27, + 3, + 5, + 13, + 9, + 1, + 4, + 1, + 4, + 7, + 18, + 0, + 6, + 19, + 7, + 14, + 15, + 5, + 8, + 16, + 21, + 6, + 2, + 5, + 63, + 12, + 17, + 6, + 9, + 20, + 3, + 9, + 20, + 32, + 3, + 13, + 4 + ], + "weighted_loads": [ + 0.17724968865513802, + 0.5661971662193537, + 2.0350438095629215, + 0.5211943760514259, + 0.07936358451843262, + 0.076059116050601, + 0.0, + 0.23451285436749458, + 0.07663360983133316, + 0.0, + 1.9577376395463943, + 1.6498257350176573, + 0.9206475540995598, + 0.41888084076344967, + 0.17045054957270622, + 0.0, + 0.04494772106409073, + 0.2557161580771208, + 0.0, + 0.3989354334771633, + 0.13361983560025692, + 1.4609954729676247, + 0.0, + 0.21483993902802467, + 0.2068526539951563, + 1.815686147660017, + 0.07150125317275524, + 2.0556286722421646, + 0.0958099253475666, + 0.2072681561112404, + 0.6792301647365093, + 0.5210002493113279, + 0.032671406865119934, + 0.25245560705661774, + 0.05446905270218849, + 0.1204344816505909, + 0.341568049043417, + 1.2821508683264256, + 0.0, + 0.28738902881741524, + 1.274907534942031, + 0.246531181037426, + 0.8378287106752396, + 1.2274769581854343, + 0.17380594089627266, + 0.39149939827620983, + 1.5520758554339409, + 1.8886025995016098, + 0.21890859492123127, + 0.20519708842039108, + 0.18788999505341053, + 4.210471892729402, + 1.738251730799675, + 0.9279059693217278, + 0.21727766655385494, + 0.35420150123536587, + 0.9939493201673031, + 0.19650092348456383, + 0.6903057843446732, + 0.8402974270284176, + 1.8689327854663134, + 0.2694546617567539, + 0.8441927265375853, + 0.15889006666839123 + ], + "unique_experts": 58, + "load_cv": 1.0311205191148503, + "normalized_load_entropy": 0.8939388025703796, + "max_load_share": 0.09905660377358491 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "f73a0b145ef47520d81441f0872048b4dc220ba0997420c3ded18f5cd5dc88dd", + "route_weight_sha256": "3d56d758ffdd56105778e7a30bca1bc6015e2284c98403c129105737af35304a", + "loads": [ + 25, + 11, + 24, + 13, + 8, + 5, + 13, + 6, + 14, + 1, + 25, + 19, + 24, + 10, + 10, + 10, + 13, + 12, + 1, + 12, + 5, + 29, + 0, + 11, + 8, + 22, + 14, + 29, + 9, + 6, + 19, + 13, + 7, + 6, + 3, + 4, + 13, + 18, + 3, + 7, + 24, + 8, + 14, + 18, + 5, + 9, + 16, + 22, + 9, + 14, + 11, + 66, + 15, + 18, + 6, + 13, + 20, + 9, + 11, + 25, + 32, + 11, + 15, + 9 + ], + "weighted_loads": [ + 1.470181044191122, + 0.5928619746118784, + 2.0350438095629215, + 0.5664053596556187, + 0.4213220998644829, + 0.22641241922974586, + 1.1172372493892908, + 0.23451285436749458, + 0.6821094732731581, + 0.0310196690261364, + 2.2507448494434357, + 1.983114479109645, + 1.4599882736802101, + 0.49947228841483593, + 0.3606660831719637, + 0.6605832846835256, + 1.1521364077925682, + 0.45513431169092655, + 0.049402523785829544, + 0.7195383701473475, + 0.16255879029631615, + 1.5422681123018265, + 0.0, + 0.5704965498298407, + 0.27019123546779156, + 1.844148974865675, + 0.8907073382288218, + 2.1809977628290653, + 0.5147890113294125, + 0.2447977550327778, + 0.905216770246625, + 0.9787669498473406, + 0.47165919467806816, + 0.3678266853094101, + 0.20245619490742683, + 0.1204344816505909, + 1.0183529304340482, + 1.2821508683264256, + 0.10596279427409172, + 0.32315797358751297, + 1.939017929136753, + 0.330808088183403, + 0.8378287106752396, + 1.630305863916874, + 0.17380594089627266, + 0.42931039817631245, + 1.5520758554339409, + 1.9226894453167915, + 0.36158520821481943, + 2.048789646476507, + 0.4208276979625225, + 4.3153579365462065, + 1.8692221296951175, + 1.0758038684725761, + 0.21727766655385494, + 1.0899540092796087, + 0.9939493201673031, + 0.8596308119595051, + 0.7749848701059818, + 1.1022641733288765, + 1.8689327854663134, + 0.7681746408343315, + 0.9595860633999109, + 0.3550443761050701 + ], + "unique_experts": 63, + "load_cv": 0.715285626293863, + "normalized_load_entropy": 0.9475343532443304, + "max_load_share": 0.07482993197278912 + } + }, + "s0_period": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "8f7864245c62ba63ffcbdf52cedcd0781f585715f6ad7924c1e0de44d724ff2b", + "route_weight_sha256": "69746f7ec9c5515a793e082950209c9875927eadbef8e9c6987248d6b6c3ae95", + "loads": [ + 6, + 9, + 23, + 12, + 1, + 2, + 0, + 6, + 1, + 0, + 19, + 14, + 16, + 10, + 5, + 0, + 1, + 7, + 0, + 7, + 4, + 27, + 0, + 4, + 5, + 21, + 4, + 27, + 2, + 5, + 12, + 11, + 0, + 4, + 1, + 3, + 7, + 18, + 0, + 8, + 22, + 6, + 15, + 15, + 3, + 7, + 17, + 25, + 8, + 2, + 3, + 64, + 13, + 16, + 6, + 10, + 21, + 4, + 8, + 18, + 31, + 3, + 13, + 4 + ], + "weighted_loads": [ + 0.2016410455107689, + 0.5422401279211044, + 2.0334247052669525, + 0.5606487318873405, + 0.0407368503510952, + 0.08219433203339577, + 0.0, + 0.23856152780354023, + 0.043096669018268585, + 0.0, + 1.9579484481364489, + 1.6412913482636213, + 0.8869331665337086, + 0.45369913056492805, + 0.16519618220627308, + 0.0, + 0.04164738208055496, + 0.26487397588789463, + 0.0, + 0.40670359693467617, + 0.13312488049268723, + 1.4029638022184372, + 0.0, + 0.2200133576989174, + 0.17271697893738747, + 1.8321329969912767, + 0.1067811381071806, + 2.0651029236614704, + 0.06844530440866947, + 0.22340680286288261, + 0.6723337285220623, + 0.5850498601794243, + 0.0, + 0.25018370524048805, + 0.05488060414791107, + 0.08954251185059547, + 0.3368640523403883, + 1.3033412620425224, + 0.0, + 0.34808989986777306, + 1.3489135727286339, + 0.22086501121520996, + 0.8719465360045433, + 1.2269911151379347, + 0.12396817654371262, + 0.35869235172867775, + 1.56127367913723, + 2.0346787106245756, + 0.27370867505669594, + 0.21712646633386612, + 0.11725940555334091, + 4.278543220832944, + 1.76622224599123, + 0.9148697964847088, + 0.220047265291214, + 0.38292445056140423, + 1.0277801807969809, + 0.23538155853748322, + 0.6444892138242722, + 0.7554211858659983, + 1.791456576436758, + 0.26962966471910477, + 0.8512920662760735, + 0.16521622985601425 + ], + "unique_experts": 57, + "load_cv": 1.0489201003147333, + "normalized_load_entropy": 0.8887149468460046, + "max_load_share": 0.10062893081761007 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "0a9b105097a72a41c7c3decc57cc6fd8930e35bb8fa92de51072af6e0acf9ae8", + "route_weight_sha256": "2cbc63fdd46a86dc7e79c6a7ad5554da089e65dd2f3d105ebd7b221df9c3e665", + "loads": [ + 8, + 9, + 23, + 13, + 6, + 3, + 8, + 7, + 7, + 1, + 23, + 16, + 22, + 10, + 14, + 1, + 8, + 9, + 0, + 9, + 4, + 27, + 0, + 10, + 9, + 22, + 15, + 27, + 5, + 5, + 16, + 11, + 5, + 6, + 1, + 3, + 13, + 18, + 0, + 8, + 29, + 7, + 15, + 17, + 3, + 7, + 17, + 26, + 9, + 10, + 7, + 66, + 20, + 16, + 6, + 14, + 21, + 4, + 10, + 19, + 31, + 8, + 13, + 9 + ], + "weighted_loads": [ + 0.33768273144960403, + 0.5422401279211044, + 2.0334247052669525, + 0.6112983971834183, + 0.44537852704524994, + 0.10092953778803349, + 0.6345534659922123, + 0.27170213498175144, + 0.4077690038830042, + 0.0314757265150547, + 2.1064095813781023, + 1.7058103270828724, + 1.2808530814945698, + 0.45369913056492805, + 0.5340598747134209, + 0.031402166932821274, + 0.6680365391075611, + 0.32942711748182774, + 0.0, + 0.5289206150919199, + 0.13312488049268723, + 1.4029638022184372, + 0.0, + 0.5706576965749264, + 0.2875313740223646, + 1.8604950215667486, + 0.8067309428006411, + 2.0651029236614704, + 0.18141276203095913, + 0.22340680286288261, + 0.8471208140254021, + 0.5850498601794243, + 0.4048077315092087, + 0.3411121778190136, + 0.05488060414791107, + 0.08954251185059547, + 1.2055827667936683, + 1.3033412620425224, + 0.0, + 0.34808989986777306, + 2.1244471445679665, + 0.26493046432733536, + 0.8719465360045433, + 1.3095856588333845, + 0.12396817654371262, + 0.35869235172867775, + 1.56127367913723, + 2.0690571907907724, + 0.2872079825028777, + 1.3925333358347416, + 0.32345994003117085, + 4.36490417830646, + 2.038848019205034, + 0.9148697964847088, + 0.220047265291214, + 1.1407133769243956, + 1.0277801807969809, + 0.23538155853748322, + 0.7421241626143456, + 0.8420163039118052, + 1.791456576436758, + 0.6507742591202259, + 0.8512920662760735, + 0.3901620991528034 + ], + "unique_experts": 61, + "load_cv": 0.833297398366671, + "normalized_load_entropy": 0.9282968754629334, + "max_load_share": 0.08396946564885496 + } + }, + "s1_period": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "bb0333a691dfd428c8f8e1c9622dd4feb06eebe49e0bf941cefc89e21a1f2b32", + "route_weight_sha256": "e553b68c7ed5f21e90ea115b6e5a4c966640ef305663c9ab9ac927823fe7ac0f", + "loads": [ + 5, + 9, + 25, + 11, + 2, + 1, + 0, + 5, + 1, + 0, + 19, + 15, + 17, + 11, + 4, + 0, + 1, + 7, + 0, + 7, + 4, + 27, + 0, + 5, + 6, + 21, + 2, + 27, + 2, + 5, + 13, + 11, + 1, + 5, + 1, + 4, + 7, + 19, + 0, + 7, + 19, + 8, + 14, + 14, + 3, + 8, + 16, + 23, + 5, + 2, + 4, + 65, + 12, + 16, + 6, + 10, + 20, + 3, + 8, + 19, + 33, + 3, + 13, + 5 + ], + "weighted_loads": [ + 0.17261593602597713, + 0.5341334380209446, + 2.090183585882187, + 0.48471136949956417, + 0.07552004978060722, + 0.04900924488902092, + 0.0, + 0.21647359430789948, + 0.045840077102184296, + 0.0, + 1.9659187644720078, + 1.6154198590666056, + 0.9300253242254257, + 0.49220890179276466, + 0.12956934235990047, + 0.0, + 0.04511971026659012, + 0.2490241937339306, + 0.0, + 0.40781122259795666, + 0.13728067278862, + 1.4455003440380096, + 0.0, + 0.238779803737998, + 0.20906549878418446, + 1.816509272903204, + 0.04283080995082855, + 2.07438100874424, + 0.06531110778450966, + 0.20845447108149529, + 0.6723998114466667, + 0.5887448452413082, + 0.03434862941503525, + 0.30202875658869743, + 0.0568988136947155, + 0.12009789235889912, + 0.3367678336799145, + 1.3102024234831333, + 0.0, + 0.32157612405717373, + 1.2886240519583225, + 0.2753342054784298, + 0.8545621689409018, + 1.206753309816122, + 0.12172067165374756, + 0.3893214985728264, + 1.5549869909882545, + 1.9761567413806915, + 0.18695589900016785, + 0.21181143820285797, + 0.15728585794568062, + 4.21349361166358, + 1.7225032411515713, + 0.8994769472628832, + 0.2174512967467308, + 0.37661752104759216, + 1.0122592151165009, + 0.19702530652284622, + 0.6531683430075645, + 0.7968548908829689, + 1.9103844836354256, + 0.2610761187970638, + 0.8472834341228008, + 0.20800266414880753 + ], + "unique_experts": 58, + "load_cv": 1.0585299902597287, + "normalized_load_entropy": 0.8887992770866961, + "max_load_share": 0.10220125786163523 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "e0c508e93941a280831f487dad05249cc3ea952bf8fe1477556509b3bf7a5785", + "route_weight_sha256": "fac68ff96855a0f5da24a5b3da848b38a43099e51502a813147be3b75f2f52cb", + "loads": [ + 25, + 10, + 25, + 12, + 9, + 4, + 13, + 5, + 13, + 1, + 24, + 19, + 24, + 12, + 9, + 11, + 13, + 11, + 1, + 11, + 5, + 28, + 0, + 12, + 8, + 22, + 13, + 29, + 8, + 6, + 19, + 15, + 6, + 8, + 3, + 4, + 13, + 19, + 3, + 8, + 25, + 10, + 14, + 17, + 3, + 9, + 16, + 24, + 8, + 13, + 10, + 67, + 15, + 17, + 6, + 14, + 20, + 9, + 11, + 24, + 33, + 11, + 15, + 10 + ], + "weighted_loads": [ + 1.4511698726564646, + 0.5607982464134693, + 2.090183585882187, + 0.5369552504271269, + 0.4990047253668308, + 0.19936254806816578, + 1.1188526134938002, + 0.21647359430789948, + 0.6356084682047367, + 0.0310196690261364, + 2.2072395980358124, + 1.9487086031585932, + 1.4626216739416122, + 0.5728003494441509, + 0.31978487595915794, + 0.6960167894139886, + 1.1287220232188702, + 0.4091641493141651, + 0.049402523785829544, + 0.6764569245278835, + 0.16621962748467922, + 1.5267729833722115, + 0.0, + 0.547224136069417, + 0.2724040802568197, + 1.844972100108862, + 0.7837828807532787, + 2.1997500993311405, + 0.4842901937663555, + 0.24598407000303268, + 0.8983864169567823, + 1.0465115457773209, + 0.4314206466078758, + 0.44838549569249153, + 0.20488595589995384, + 0.12009789235889912, + 1.1683606477454305, + 1.3102024234831333, + 0.11297129839658737, + 0.35734506882727146, + 1.9969377424567938, + 0.4034113548696041, + 0.8545621689409018, + 1.532729122787714, + 0.12172067165374756, + 0.427132498472929, + 1.5549869909882545, + 2.0102435871958733, + 0.329632512293756, + 2.010785363614559, + 0.3910547699779272, + 4.282398726791143, + 1.8572210362181067, + 1.0473748464137316, + 0.2174512967467308, + 1.110218945890665, + 1.0122592151165009, + 0.8601551949977875, + 0.7987801022827625, + 1.0577472485601902, + 1.9103844836354256, + 0.9010648354887962, + 0.9626767709851265, + 0.4176187217235565 + ], + "unique_experts": 63, + "load_cv": 0.7261300670015323, + "normalized_load_entropy": 0.9459910987765013, + "max_load_share": 0.07596371882086168 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 106, + "ordered_topk_exact_tokens": 72, + "set_exact_tokens": 82, + "mean_set_jaccard": 0.933288409703504, + "mean_token_weighted_tv": 0.012823697697933553, + "aggregate_load_tv": 0.02830188679245283 + }, + "system_bos": { + "tokens": 106, + "ordered_topk_exact_tokens": 59, + "set_exact_tokens": 71, + "mean_set_jaccard": 0.9056603773584906, + "mean_token_weighted_tv": 0.017727049594780185, + "aggregate_load_tv": 0.029874213836477984 + }, + "system_x": { + "tokens": 106, + "ordered_topk_exact_tokens": 52, + "set_exact_tokens": 69, + "mean_set_jaccard": 0.8962264150943396, + "mean_token_weighted_tv": 0.019792859969695785, + "aggregate_load_tv": 0.02987421383647798 + }, + "system_period": { + "tokens": 106, + "ordered_topk_exact_tokens": 54, + "set_exact_tokens": 69, + "mean_set_jaccard": 0.8982479784366577, + "mean_token_weighted_tv": 0.0196473658313307, + "aggregate_load_tv": 0.034591194968553465 + }, + "bos_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 60, + "set_exact_tokens": 75, + "mean_set_jaccard": 0.9123989218328842, + "mean_token_weighted_tv": 0.018298716257976473, + "aggregate_load_tv": 0.0330188679245283 + }, + "bos_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 50, + "set_exact_tokens": 71, + "mean_set_jaccard": 0.9016172506738546, + "mean_token_weighted_tv": 0.02019957885286718, + "aggregate_load_tv": 0.028301886792452827 + }, + "x_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 60, + "set_exact_tokens": 72, + "mean_set_jaccard": 0.9047619047619049, + "mean_token_weighted_tv": 0.019773252194149875, + "aggregate_load_tv": 0.028301886792452827 + }, + "x_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 44, + "set_exact_tokens": 61, + "mean_set_jaccard": 0.8706199460916443, + "mean_token_weighted_tv": 0.02489165778992311, + "aggregate_load_tv": 0.04245283018867924 + }, + "period_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 56, + "set_exact_tokens": 66, + "mean_set_jaccard": 0.8861185983827493, + "mean_token_weighted_tv": 0.021728353856026002, + "aggregate_load_tv": 0.03301886792452831 + }, + "period_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 49, + "set_exact_tokens": 65, + "mean_set_jaccard": 0.8814016172506738, + "mean_token_weighted_tv": 0.02405416573626253, + "aggregate_load_tv": 0.039308176100628936 + } + } + }, + "layer_16": { + "layer": 16, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "ea190e2e6db2abb7f1e48dd8beef92df9ac2e0ff360139bb7521a1b8446d4055", + "route_weight_sha256": "4fe0240692bd94857f88d6e3ff582ee06a20ee4ff838a3a7a3f413da2a396e8e", + "loads": [ + 5, + 8, + 34, + 6, + 0, + 5, + 26, + 21, + 20, + 9, + 0, + 5, + 1, + 6, + 5, + 3, + 16, + 4, + 7, + 20, + 0, + 19, + 0, + 27, + 1, + 13, + 3, + 21, + 9, + 20, + 3, + 9, + 3, + 3, + 14, + 22, + 21, + 13, + 5, + 0, + 8, + 0, + 11, + 3, + 0, + 14, + 5, + 13, + 4, + 3, + 4, + 25, + 20, + 11, + 2, + 1, + 24, + 13, + 20, + 3, + 17, + 15, + 3, + 10 + ], + "weighted_loads": [ + 0.25855917669832706, + 0.33856269903481007, + 1.5992615781724453, + 0.27303487807512283, + 0.0, + 0.18885894119739532, + 1.5740552712231874, + 1.5240834169089794, + 1.7679294664412737, + 2.1928589902818203, + 0.0, + 0.24477969855070114, + 0.061714813113212585, + 0.21199834533035755, + 0.31369494274258614, + 0.42618998885154724, + 0.595839885994792, + 0.4491395875811577, + 0.5295413918793201, + 1.4161858353763819, + 0.0, + 1.8508144188672304, + 0.0, + 2.0067345444113016, + 0.034605473279953, + 0.7555696945637465, + 0.10633612237870693, + 1.4590121619403362, + 0.5105434991419315, + 1.0796834416687489, + 0.10048065334558487, + 0.36519988253712654, + 0.12517352029681206, + 0.1095372699201107, + 0.6285113580524921, + 2.245800357311964, + 1.2600815072655678, + 1.3497114852070808, + 0.4059898629784584, + 0.0, + 0.45283292979002, + 0.0, + 0.9128382988274097, + 0.13322638534009457, + 0.0, + 0.8393807932734489, + 0.21883935667574406, + 0.787200078368187, + 0.3762325942516327, + 0.1293895822018385, + 0.1673638578504324, + 1.4029259029775858, + 1.07781046256423, + 1.6149726137518883, + 0.05918426997959614, + 0.025580693036317825, + 1.4063900783658028, + 0.6460863314568996, + 1.118117269128561, + 0.0986538715660572, + 1.3740510195493698, + 0.5592763964086771, + 0.2094033695757389, + 0.3742703218013048 + ], + "unique_experts": 57, + "load_cv": 0.8501274402634565, + "normalized_load_entropy": 0.9073394524774672, + "max_load_share": 0.05345911949685535 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "a028a7c5a699ff99e3e6714a987479bf8687c87f5a0c435b15e45ec0f5c84d49", + "route_weight_sha256": "8fc571da27dc4e84b36ec07b0b8424c46b5eb286161d6691138e02325a30de67", + "loads": [ + 5, + 8, + 34, + 6, + 0, + 13, + 31, + 21, + 20, + 11, + 3, + 5, + 1, + 7, + 5, + 10, + 25, + 9, + 13, + 21, + 11, + 21, + 2, + 27, + 9, + 13, + 7, + 21, + 9, + 20, + 5, + 9, + 4, + 10, + 14, + 22, + 21, + 23, + 6, + 0, + 10, + 7, + 13, + 3, + 4, + 15, + 5, + 14, + 4, + 3, + 4, + 27, + 20, + 23, + 2, + 11, + 24, + 13, + 20, + 3, + 21, + 18, + 3, + 17 + ], + "weighted_loads": [ + 0.25855917669832706, + 0.33856269903481007, + 1.5992615781724453, + 0.27303487807512283, + 0.0, + 0.9589200355112553, + 1.8012174349278212, + 1.5240834169089794, + 1.7679294664412737, + 3.521092738956213, + 0.17360147461295128, + 0.24477969855070114, + 0.061714813113212585, + 0.23107340931892395, + 0.31369494274258614, + 0.9182074554264545, + 1.0386430299840868, + 0.8159756455570459, + 1.1455233432352543, + 1.4186538725625724, + 0.9646391570568085, + 1.9315383862704039, + 0.12183016538619995, + 2.0067345444113016, + 0.7373954728245735, + 0.7555696945637465, + 0.3455494623631239, + 1.4590121619403362, + 0.5105434991419315, + 1.0796834416687489, + 0.19385924376547337, + 0.36519988253712654, + 0.1657172217965126, + 0.5311623783782125, + 0.6285113580524921, + 2.245800357311964, + 1.2600815072655678, + 1.8768072985112667, + 0.6245623901486397, + 0.0, + 0.5339676253497601, + 1.3199611939489841, + 0.9912886992096901, + 0.13322638534009457, + 0.14413229376077652, + 0.9069098979234695, + 0.21883935667574406, + 0.8512481898069382, + 0.3762325942516327, + 0.1293895822018385, + 0.1673638578504324, + 1.5017794836312532, + 1.07781046256423, + 2.4328295402228832, + 0.05918426997959614, + 0.830581434071064, + 1.4063900783658028, + 0.6460863314568996, + 1.118117269128561, + 0.0986538715660572, + 1.7431281581521034, + 0.6710717438254505, + 0.2094033695757389, + 0.7701430274173617 + ], + "unique_experts": 62, + "load_cv": 0.6826882386773858, + "normalized_load_entropy": 0.9404588078659737, + "max_load_share": 0.043256997455470736 + } + }, + "s1_eos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "87c3414feecb2fe70ebc794b74277899fcfe011fdbb182cea438025264828baa", + "route_weight_sha256": "750011bd491e0d3c455351cdab67174f998e10b85125db9bf229004e5f655600", + "loads": [ + 5, + 8, + 33, + 8, + 0, + 6, + 25, + 21, + 21, + 10, + 0, + 5, + 1, + 6, + 5, + 3, + 15, + 4, + 7, + 20, + 0, + 20, + 0, + 26, + 1, + 14, + 1, + 21, + 10, + 21, + 3, + 9, + 3, + 3, + 16, + 23, + 21, + 11, + 5, + 0, + 8, + 0, + 11, + 3, + 0, + 14, + 3, + 12, + 4, + 3, + 4, + 26, + 21, + 11, + 2, + 1, + 24, + 12, + 19, + 3, + 16, + 15, + 3, + 10 + ], + "weighted_loads": [ + 0.25714029371738434, + 0.33764518797397614, + 1.5736716520041227, + 0.3248290363699198, + 0.0, + 0.2161435205489397, + 1.5548749957233667, + 1.5269231628626585, + 1.7758186683058739, + 2.2078226543962955, + 0.0, + 0.24994094297289848, + 0.05951455608010292, + 0.20944059826433659, + 0.3229709230363369, + 0.4116260167211294, + 0.548064362257719, + 0.4684981629252434, + 0.5209476388990879, + 1.439435750246048, + 0.0, + 1.9158242642879486, + 0.0, + 1.9652002230286598, + 0.03338005766272545, + 0.7777075041085482, + 0.04248316213488579, + 1.4497168082743883, + 0.5387048311531544, + 1.0824717320501804, + 0.09855447709560394, + 0.3664255775511265, + 0.12116023525595665, + 0.1076829731464386, + 0.6869847662746906, + 2.2782801762223244, + 1.260423792526126, + 1.273671057075262, + 0.4258529171347618, + 0.0, + 0.46055653132498264, + 0.0, + 0.9064952619373798, + 0.13023507595062256, + 0.0, + 0.8336247056722641, + 0.15108351595699787, + 0.7362774312496185, + 0.3698585592210293, + 0.12674880027770996, + 0.1662083975970745, + 1.4187363181263208, + 1.1369940862059593, + 1.6260279566049576, + 0.06150139309465885, + 0.025167841464281082, + 1.4190823175013065, + 0.6036691591143608, + 1.0723894909024239, + 0.10437875054776669, + 1.2881925478577614, + 0.5652039367705584, + 0.20890644937753677, + 0.42469776049256325 + ], + "unique_experts": 57, + "load_cv": 0.8525435038821357, + "normalized_load_entropy": 0.9058712698764587, + "max_load_share": 0.05188679245283019 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "7ceeefd54e6dbd189c42b589fcf2ac0e7c98d8e8e098ec0accef1852c250a64e", + "route_weight_sha256": "d0b46e1186d83d888870c0fc6d93dd309d8f2ed4780a5405940902ebf4d221ed", + "loads": [ + 5, + 11, + 33, + 10, + 0, + 14, + 30, + 22, + 21, + 13, + 5, + 7, + 1, + 9, + 6, + 14, + 26, + 15, + 15, + 22, + 11, + 22, + 2, + 27, + 16, + 14, + 10, + 21, + 10, + 21, + 7, + 9, + 8, + 9, + 17, + 25, + 21, + 21, + 8, + 3, + 11, + 14, + 14, + 5, + 4, + 18, + 4, + 19, + 7, + 7, + 10, + 27, + 21, + 24, + 2, + 12, + 26, + 12, + 19, + 4, + 22, + 17, + 6, + 16 + ], + "weighted_loads": [ + 0.25714029371738434, + 0.46015355736017227, + 1.5736716520041227, + 0.41715586744248867, + 0.0, + 1.0806479435414076, + 1.8105029072612524, + 1.5524459183216095, + 1.7758186683058739, + 3.5696547739207745, + 0.18504849821329117, + 0.31252108328044415, + 0.05951455608010292, + 0.30043235793709755, + 0.3764563128352165, + 1.3980061057955027, + 0.9934575241059065, + 1.2735503651201725, + 1.365072138607502, + 1.4777373054530472, + 0.934458190575242, + 2.0056279376149178, + 0.08163376897573471, + 2.04160937666893, + 1.2836748138070107, + 0.7777075041085482, + 1.1726796701550484, + 1.4497168082743883, + 0.5387048311531544, + 1.0824717320501804, + 0.25434678606688976, + 0.3664255775511265, + 0.33700570091605186, + 0.41246550250798464, + 0.7222619988024235, + 2.396726593375206, + 1.260423792526126, + 1.8004237245768309, + 0.7548445425927639, + 0.17725524678826332, + 0.5686932671815157, + 2.296932503581047, + 1.0139428526163101, + 0.2223087176680565, + 0.12815969437360764, + 1.0333322323858738, + 0.18252027593553066, + 1.0901827737689018, + 0.495566263794899, + 0.3194245733320713, + 0.42638491094112396, + 1.4610597472637892, + 1.1369940862059593, + 2.728157015517354, + 0.06150139309465885, + 0.9677906110882759, + 1.5272342301905155, + 0.6036691591143608, + 1.0723894909024239, + 0.30627608858048916, + 1.6860366947948933, + 0.6239107915898785, + 0.5384230315685272, + 0.7827724982053041 + ], + "unique_experts": 63, + "load_cv": 0.5731491571082793, + "normalized_load_entropy": 0.9569229567529546, + "max_load_share": 0.03741496598639456 + } + }, + "s0_bos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "1307e897ec314d8702f9ee98f737e9b8303f8318cca574baf17c36d3e55b320b", + "route_weight_sha256": "98d06f1cadb24b73706cb4398eea821dce7b054ba3d4b7f906ce45a48731000e", + "loads": [ + 4, + 8, + 32, + 7, + 0, + 4, + 28, + 20, + 20, + 12, + 0, + 5, + 1, + 7, + 5, + 4, + 15, + 4, + 7, + 20, + 0, + 22, + 0, + 26, + 1, + 13, + 3, + 22, + 9, + 21, + 3, + 10, + 3, + 1, + 13, + 25, + 19, + 13, + 5, + 0, + 8, + 0, + 13, + 4, + 1, + 14, + 3, + 14, + 5, + 2, + 3, + 23, + 23, + 11, + 1, + 1, + 25, + 9, + 19, + 2, + 17, + 13, + 3, + 10 + ], + "weighted_loads": [ + 0.22681022062897682, + 0.3480416461825371, + 1.5625127330422401, + 0.29809038527309895, + 0.0, + 0.14245365746319294, + 1.632623815909028, + 1.511587530374527, + 1.77675561606884, + 2.29736165702343, + 0.0, + 0.2526442613452673, + 0.05973314866423607, + 0.24309459142386913, + 0.340553343296051, + 0.4707665368914604, + 0.5713882707059383, + 0.4505333676934242, + 0.5254776328802109, + 1.4301682356745005, + 0.0, + 1.9812514893710613, + 0.0, + 1.9995936173945665, + 0.03404397889971733, + 0.7491114046424627, + 0.10499110072851181, + 1.48113907687366, + 0.5450544990599155, + 1.118427550420165, + 0.10925581492483616, + 0.39947251230478287, + 0.10725255683064461, + 0.03543539345264435, + 0.5931952763348818, + 2.398927439004183, + 1.2055547535419464, + 1.2977159805595875, + 0.4156568869948387, + 0.0, + 0.444879999384284, + 0.0, + 0.9888429902493954, + 0.17067050375044346, + 0.025522397831082344, + 0.8528871349990368, + 0.14924720861017704, + 0.8577229827642441, + 0.4032598212361336, + 0.11279389448463917, + 0.1419125832617283, + 1.335856745019555, + 1.1853470634669065, + 1.571830376982689, + 0.03383161872625351, + 0.02425982989370823, + 1.4410554356873035, + 0.46483826637268066, + 1.0986904688179493, + 0.07851457595825195, + 1.4036097135394812, + 0.4941163472831249, + 0.21127915754914284, + 0.3794178180396557 + ], + "unique_experts": 58, + "load_cv": 0.862690443228957, + "normalized_load_entropy": 0.9043478366242764, + "max_load_share": 0.050314465408805034 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "0051ad60646c8e7964a0ee07c2fa83dde470672e1951085e40d6dca03ad8b4b7", + "route_weight_sha256": "5c7b76220fd5e98bd30145e9313febc5dad6025d960914ea1f7d0aca3206fd67", + "loads": [ + 4, + 8, + 32, + 7, + 0, + 13, + 32, + 20, + 20, + 14, + 3, + 6, + 2, + 9, + 5, + 11, + 23, + 9, + 13, + 21, + 11, + 24, + 2, + 26, + 8, + 13, + 7, + 22, + 9, + 21, + 5, + 10, + 4, + 7, + 14, + 25, + 19, + 23, + 6, + 0, + 10, + 8, + 16, + 4, + 4, + 15, + 3, + 15, + 5, + 3, + 4, + 25, + 23, + 23, + 1, + 11, + 25, + 9, + 19, + 2, + 20, + 15, + 3, + 15 + ], + "weighted_loads": [ + 0.22681022062897682, + 0.3480416461825371, + 1.5625127330422401, + 0.29809038527309895, + 0.0, + 0.9534477982670069, + 1.8062318470329046, + 1.511587530374527, + 1.77675561606884, + 2.717396382242441, + 0.17360147461295128, + 0.29153733514249325, + 0.1330738253891468, + 0.30283869057893753, + 0.340553343296051, + 0.9665676914155483, + 1.472935676574707, + 0.8161431793123484, + 1.1233797445893288, + 1.4600829984992743, + 0.9646391570568085, + 2.0619754567742348, + 0.12183016538619995, + 1.9995936173945665, + 0.6698107942938805, + 0.7491114046424627, + 0.33193444460630417, + 1.48113907687366, + 0.5450544990599155, + 1.118427550420165, + 0.20263440534472466, + 0.39947251230478287, + 0.14779625833034515, + 0.45062151923775673, + 0.7076216209679842, + 2.398927439004183, + 1.2055547535419464, + 1.8216295577585697, + 0.6112082377076149, + 0.0, + 0.5260146949440241, + 1.3607686758041382, + 1.09257285669446, + 0.17067050375044346, + 0.13064616732299328, + 0.9204162396490574, + 0.14924720861017704, + 0.9172926023602486, + 0.4032598212361336, + 0.15826706774532795, + 0.1850498467683792, + 1.4347103256732225, + 1.1853470634669065, + 2.3853251673281193, + 0.03383161872625351, + 0.8292605709284544, + 1.4410554356873035, + 0.46483826637268066, + 1.0986904688179493, + 0.07851457595825195, + 1.7135643232613802, + 0.5923305153846741, + 0.21127915754914284, + 0.7104655150324106 + ], + "unique_experts": 62, + "load_cv": 0.6814732028202093, + "normalized_load_entropy": 0.9402344564450715, + "max_load_share": 0.04071246819338423 + } + }, + "s1_bos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "2a9ec524bb627f7fb27a9c601c8b914367d3447b70a2c285e88e1a7eb2b21d55", + "route_weight_sha256": "acc80ed4a875382cb6fc1e9528e71e2789adc9e3de2a2392abfef793f34ea32d", + "loads": [ + 5, + 7, + 32, + 5, + 0, + 3, + 27, + 20, + 21, + 11, + 0, + 5, + 1, + 5, + 5, + 3, + 13, + 4, + 7, + 20, + 0, + 20, + 0, + 25, + 1, + 13, + 2, + 22, + 9, + 21, + 3, + 11, + 3, + 3, + 14, + 25, + 20, + 13, + 5, + 0, + 8, + 0, + 11, + 3, + 1, + 13, + 5, + 13, + 4, + 3, + 5, + 24, + 22, + 11, + 1, + 1, + 25, + 12, + 19, + 3, + 20, + 13, + 3, + 12 + ], + "weighted_loads": [ + 0.2571532167494297, + 0.3014342039823532, + 1.5420797187834978, + 0.23720111697912216, + 0.0, + 0.10655185766518116, + 1.602141797542572, + 1.495548602193594, + 1.788165058940649, + 2.211519945412874, + 0.0, + 0.24472011998295784, + 0.05831615626811981, + 0.18052174896001816, + 0.3406389690935612, + 0.4231865368783474, + 0.5089952945709229, + 0.45929141342639923, + 0.5368267521262169, + 1.421899078413844, + 0.0, + 1.921408724039793, + 0.0, + 1.9504995662719011, + 0.03764329105615616, + 0.7356346193701029, + 0.0684987585991621, + 1.4222375079989433, + 0.5351806581020355, + 1.1131444033235312, + 0.10596386343240738, + 0.43462279438972473, + 0.10390201024711132, + 0.1071900837123394, + 0.6320429984480143, + 2.3658152893185616, + 1.2136247418820858, + 1.2464204486459494, + 0.40205758810043335, + 0.0, + 0.4625195786356926, + 0.0, + 0.8930533714592457, + 0.13685882836580276, + 0.026800842955708504, + 0.8431725278496742, + 0.22412952966988087, + 0.798527866601944, + 0.3558109700679779, + 0.1398970577865839, + 0.20659715682268143, + 1.370817320421338, + 1.1530759502202272, + 1.5579311400651932, + 0.031826164573431015, + 0.024492483586072922, + 1.4540233835577965, + 0.5816295742988586, + 1.099636249244213, + 0.10675293765962124, + 1.40644770860672, + 0.5056329444050789, + 0.20579267293214798, + 0.4301776587963104 + ], + "unique_experts": 58, + "load_cv": 0.8569860339000577, + "normalized_load_entropy": 0.9059205356743181, + "max_load_share": 0.050314465408805034 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "0684ffd9e6bb0d390881fe833d2198a8e9a6acc8f6be886cef49d7912123a212", + "route_weight_sha256": "a507d8f5c857807b73fcae977d6532516e0512bee9e68eb1f6a7a29900333f54", + "loads": [ + 5, + 10, + 32, + 7, + 0, + 11, + 32, + 21, + 21, + 14, + 5, + 7, + 1, + 8, + 6, + 14, + 24, + 14, + 15, + 20, + 11, + 22, + 2, + 26, + 15, + 13, + 11, + 22, + 9, + 21, + 7, + 11, + 8, + 10, + 16, + 27, + 20, + 23, + 8, + 3, + 11, + 15, + 14, + 5, + 7, + 17, + 6, + 20, + 7, + 7, + 11, + 25, + 22, + 24, + 1, + 12, + 27, + 12, + 19, + 4, + 27, + 14, + 6, + 17 + ], + "weighted_loads": [ + 0.2571532167494297, + 0.42394257336854935, + 1.5420797187834978, + 0.32952794805169106, + 0.0, + 0.971056280657649, + 1.8572898916900158, + 1.521071357652545, + 1.788165058940649, + 2.6609895788133144, + 0.18504849821329117, + 0.3073002602905035, + 0.05831615626811981, + 0.2715135086327791, + 0.3941243588924408, + 1.4148691669106483, + 1.413054745644331, + 1.2408106252551079, + 1.3848201110959053, + 1.421899078413844, + 0.934458190575242, + 2.011212397366762, + 0.08163376897573471, + 2.0269087199121714, + 1.2150219082832336, + 0.7356346193701029, + 1.1884904634207487, + 1.4222375079989433, + 0.5351806581020355, + 1.1131444033235312, + 0.2617561724036932, + 0.43462279438972473, + 0.31974747590720654, + 0.5015389695763588, + 0.7120528910309076, + 2.484261706471443, + 1.2136247418820858, + 1.7736342325806618, + 0.7112514264881611, + 0.17725524678826332, + 0.5706563144922256, + 2.359988547861576, + 1.0015874076634645, + 0.2289324700832367, + 0.22615603543817997, + 1.042880054563284, + 0.25556628964841366, + 1.1519280783832073, + 0.4815186746418476, + 0.33257283084094524, + 0.47327686473727226, + 1.4131407495588064, + 1.1530759502202272, + 2.6567569244652987, + 0.031826164573431015, + 0.9671152532100677, + 1.5621752962470055, + 0.5816295742988586, + 1.099636249244213, + 0.3086502756923437, + 1.8639911487698555, + 0.5565229058265686, + 0.5353092551231384, + 0.7927433531731367 + ], + "unique_experts": 63, + "load_cv": 0.5772968306233145, + "normalized_load_entropy": 0.9566616405980731, + "max_load_share": 0.036281179138321996 + } + }, + "s0_x": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "63440e7af76104fe3d583288d2e23a34bc43071bdf730c10e57dfbb2ef5e7c3b", + "route_weight_sha256": "2bddda51a96b48ccdc5b6ee9e1ad868f99c1b180e0f81754162eb80a6629af03", + "loads": [ + 5, + 5, + 32, + 5, + 0, + 3, + 25, + 20, + 21, + 10, + 0, + 7, + 1, + 6, + 5, + 3, + 14, + 4, + 7, + 20, + 1, + 21, + 0, + 27, + 1, + 13, + 3, + 23, + 10, + 21, + 3, + 11, + 3, + 3, + 14, + 24, + 21, + 12, + 6, + 0, + 8, + 0, + 12, + 4, + 0, + 14, + 4, + 14, + 4, + 1, + 4, + 24, + 21, + 11, + 1, + 1, + 25, + 10, + 21, + 3, + 17, + 13, + 3, + 11 + ], + "weighted_loads": [ + 0.26610938645899296, + 0.241815023124218, + 1.5703845638781786, + 0.2292555868625641, + 0.0, + 0.11514360457658768, + 1.54939753562212, + 1.513736605644226, + 1.8122760020196438, + 2.217994499951601, + 0.0, + 0.3065373878926039, + 0.05707354471087456, + 0.2136343400925398, + 0.345174640417099, + 0.42550942301750183, + 0.5449660420417786, + 0.4420112296938896, + 0.5333989523351192, + 1.4320097379386425, + 0.031971581280231476, + 1.9574696812778711, + 0.0, + 1.9982127621769905, + 0.03724818304181099, + 0.7531120143830776, + 0.10849041678011417, + 1.4932633191347122, + 0.561575124040246, + 1.1233476717025042, + 0.10293320938944817, + 0.43277634494006634, + 0.10440992936491966, + 0.09999756142497063, + 0.6208962444216013, + 2.3765904530882835, + 1.2807574588805437, + 1.2975923866033554, + 0.4333943724632263, + 0.0, + 0.4305200334638357, + 0.0, + 0.9292991645634174, + 0.16771374084055424, + 0.0, + 0.8601567186415195, + 0.18801964446902275, + 0.8517490029335022, + 0.3604790046811104, + 0.08048008382320404, + 0.16352454200387, + 1.359011271968484, + 1.0994861777871847, + 1.5599074177443981, + 0.032945189625024796, + 0.0231825802475214, + 1.433947928249836, + 0.49365944787859917, + 1.2092791385948658, + 0.1046985611319542, + 1.3241766765713692, + 0.4894809126853943, + 0.2061438336968422, + 0.3966853618621826 + ], + "unique_experts": 58, + "load_cv": 0.8590145151655703, + "normalized_load_entropy": 0.9052465932139756, + "max_load_share": 0.050314465408805034 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "31a6ff4fad3a7ac3b79b63cb3d89adb7437256335d60e448d6570bcd1c57774c", + "route_weight_sha256": "6604fe8eba4790e8f4f0424dd893ebbd4e5e87a5644f8e580057e68a21e247e3", + "loads": [ + 5, + 5, + 32, + 5, + 0, + 11, + 30, + 20, + 21, + 11, + 3, + 7, + 1, + 7, + 5, + 10, + 21, + 10, + 13, + 20, + 13, + 24, + 2, + 27, + 9, + 13, + 7, + 23, + 10, + 21, + 6, + 11, + 5, + 8, + 14, + 24, + 21, + 23, + 7, + 0, + 10, + 7, + 14, + 4, + 3, + 15, + 4, + 15, + 4, + 1, + 5, + 26, + 21, + 24, + 1, + 12, + 25, + 10, + 21, + 3, + 21, + 15, + 3, + 17 + ], + "weighted_loads": [ + 0.26610938645899296, + 0.241815023124218, + 1.5703845638781786, + 0.2292555868625641, + 0.0, + 0.8852046988904476, + 1.7817806862294674, + 1.513736605644226, + 1.8122760020196438, + 2.5960611887276173, + 0.17360147461295128, + 0.3065373878926039, + 0.05707354471087456, + 0.23270940408110619, + 0.345174640417099, + 0.949007160961628, + 0.8751865290105343, + 0.8797636460512877, + 1.1911410689353943, + 1.4320097379386425, + 1.2409390732645988, + 2.072652941569686, + 0.12183016538619995, + 1.9982127621769905, + 0.7752031907439232, + 0.7531120143830776, + 0.33463933132588863, + 1.4932633191347122, + 0.561575124040246, + 1.1233476717025042, + 0.24290483631193638, + 0.43277634494006634, + 0.2183665782213211, + 0.4405549392104149, + 0.6208962444216013, + 2.3765904530882835, + 1.2807574588805437, + 1.862959560006857, + 0.6636761277914047, + 0.0, + 0.5116547290235758, + 1.2603927738964558, + 1.014037910848856, + 0.16771374084055424, + 0.10471914894878864, + 0.9276858232915401, + 0.18801964446902275, + 0.9147433489561081, + 0.3604790046811104, + 0.08048008382320404, + 0.1977182887494564, + 1.4578648526221514, + 1.0994861777871847, + 2.5097896941006184, + 0.032945189625024796, + 0.9411797281354666, + 1.433947928249836, + 0.49365944787859917, + 1.2092791385948658, + 0.1046985611319542, + 1.6978793106973171, + 0.6086319908499718, + 0.2061438336968422, + 0.7548977080732584 + ], + "unique_experts": 62, + "load_cv": 0.6835980983211037, + "normalized_load_entropy": 0.9391294331460209, + "max_load_share": 0.04071246819338423 + } + }, + "s1_x": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "e4f157cb9a79356c6b1e4937d614dd2cea198013ec9d48a97f0cb6cd347f5a65", + "route_weight_sha256": "0709d2d68bb235791ba261f1b0bd2396c398c831abf52e028ef76f13aa7a555c", + "loads": [ + 5, + 6, + 32, + 6, + 1, + 2, + 26, + 20, + 21, + 11, + 0, + 5, + 1, + 6, + 6, + 3, + 12, + 4, + 7, + 19, + 1, + 21, + 1, + 23, + 1, + 15, + 3, + 22, + 9, + 22, + 3, + 9, + 3, + 1, + 14, + 25, + 20, + 11, + 5, + 0, + 8, + 0, + 11, + 3, + 1, + 14, + 6, + 13, + 4, + 4, + 5, + 24, + 20, + 11, + 1, + 1, + 26, + 13, + 20, + 3, + 18, + 13, + 3, + 12 + ], + "weighted_loads": [ + 0.2674561571329832, + 0.2695682439953089, + 1.5476561896502972, + 0.26104388386011124, + 0.027147550135850906, + 0.0735245831310749, + 1.5701885558664799, + 1.5111511871218681, + 1.8014234583824873, + 2.231556311249733, + 0.0, + 0.2449699342250824, + 0.05737118050456047, + 0.21727132983505726, + 0.3715666402131319, + 0.4273730404675007, + 0.48666176572442055, + 0.45667798072099686, + 0.5250995494425297, + 1.3681931979954243, + 0.03358389437198639, + 1.9898169748485088, + 0.03072972036898136, + 1.852763820439577, + 0.034107550978660583, + 0.8070316761732101, + 0.10684137605130672, + 1.441856388002634, + 0.5185279063880444, + 1.1747423727065325, + 0.10474210418760777, + 0.36871789768338203, + 0.10370073653757572, + 0.03261569142341614, + 0.6418582070618868, + 2.3629568684846163, + 1.1928119603544474, + 1.1938360519707203, + 0.4092063307762146, + 0.0, + 0.46345231868326664, + 0.0, + 0.8998864218592644, + 0.13350138254463673, + 0.027674758806824684, + 0.8506291285157204, + 0.2534809112548828, + 0.7772456407546997, + 0.3425398953258991, + 0.15997289307415485, + 0.19980249553918839, + 1.3587798085063696, + 1.0564635694026947, + 1.5691433437168598, + 0.03149500861763954, + 0.023782256990671158, + 1.4707483407109976, + 0.5940835848450661, + 1.192614957690239, + 0.09869419783353806, + 1.3748010862618685, + 0.4995110500603914, + 0.20566514506936073, + 0.4720922913402319 + ], + "unique_experts": 61, + "load_cv": 0.8434006819162021, + "normalized_load_entropy": 0.9104861373705229, + "max_load_share": 0.050314465408805034 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "80f5a2e76338ab1f401082c558e1c9e4bf84d679a41bec763f5a2cf90e78e3d4", + "route_weight_sha256": "4b3218767e8890c83f869fbcf59d4aee8b45d31a073ef6a1b5facd59ebfa1fd6", + "loads": [ + 5, + 9, + 32, + 8, + 1, + 10, + 31, + 21, + 21, + 13, + 6, + 7, + 1, + 9, + 7, + 14, + 22, + 15, + 14, + 19, + 16, + 24, + 4, + 24, + 16, + 15, + 12, + 22, + 9, + 22, + 8, + 9, + 9, + 5, + 15, + 27, + 20, + 21, + 8, + 3, + 11, + 14, + 14, + 5, + 5, + 18, + 7, + 20, + 7, + 8, + 10, + 25, + 20, + 25, + 1, + 13, + 28, + 14, + 20, + 4, + 23, + 14, + 6, + 16 + ], + "weighted_loads": [ + 0.2674561571329832, + 0.392076613381505, + 1.5476561896502972, + 0.35337071493268013, + 0.027147550135850906, + 0.9380290061235428, + 1.83802006021142, + 1.5366739425808191, + 1.8014234583824873, + 2.6449085995554924, + 0.21206353977322578, + 0.30755007453262806, + 0.05737118050456047, + 0.3082630895078182, + 0.42505203001201153, + 1.4592647440731525, + 0.8503662217408419, + 1.323198925703764, + 1.3038518130779266, + 1.3681931979954243, + 1.3785761687904596, + 2.115961167961359, + 0.14515413530170918, + 1.9291729740798473, + 1.354891050606966, + 0.8070316761732101, + 1.2100536320358515, + 1.441856388002634, + 0.5185279063880444, + 1.1747423727065325, + 0.2887418568134308, + 0.36871789768338203, + 0.38319809921085835, + 0.23558054491877556, + 0.6771354395896196, + 2.481403285637498, + 1.1928119603544474, + 1.7185669373720884, + 0.772750336676836, + 0.17725524678826332, + 0.5715890545397997, + 2.2534124068915844, + 1.0110632665455341, + 0.22557502426207066, + 0.15306594781577587, + 1.05033665522933, + 0.2849176712334156, + 1.1172288171947002, + 0.46824759989976883, + 0.3526486661285162, + 0.4199620746076107, + 1.401103237643838, + 1.0564635694026947, + 2.7644328083842993, + 0.03149500861763954, + 1.1018989607691765, + 1.5789002534002066, + 0.6639865040779114, + 1.192614957690239, + 0.30059153586626053, + 1.7263634148985147, + 0.575539031997323, + 0.5351817272603512, + 0.740203533321619 + ], + "unique_experts": 64, + "load_cv": 0.5612554104036274, + "normalized_load_entropy": 0.9595215917430395, + "max_load_share": 0.036281179138321996 + } + }, + "s0_period": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "1f0962a59d10b71766aa84891822ca3ce5aa0d8eb4d658058344680ef8bd0c1a", + "route_weight_sha256": "442972a15681ac40cdd6e1f785b3df02841f0bc9ff6f4f6994164ed95f7e8d34", + "loads": [ + 4, + 6, + 31, + 6, + 0, + 3, + 26, + 20, + 20, + 10, + 0, + 8, + 1, + 5, + 6, + 2, + 16, + 4, + 7, + 19, + 1, + 20, + 0, + 27, + 1, + 12, + 3, + 23, + 9, + 20, + 3, + 11, + 3, + 4, + 13, + 25, + 19, + 13, + 6, + 0, + 9, + 0, + 13, + 4, + 0, + 14, + 5, + 13, + 4, + 2, + 4, + 26, + 21, + 11, + 1, + 1, + 23, + 9, + 21, + 3, + 18, + 13, + 3, + 11 + ], + "weighted_loads": [ + 0.2184022106230259, + 0.26786855794489384, + 1.5603371988981962, + 0.27028101682662964, + 0.0, + 0.10567649453878403, + 1.5565467718988657, + 1.520747259259224, + 1.7747874483466148, + 2.2158301137387753, + 0.0, + 0.3446132726967335, + 0.05792466551065445, + 0.17380979284644127, + 0.3740364648401737, + 0.38739013671875, + 0.6026989128440619, + 0.44729799777269363, + 0.5090574249625206, + 1.3876202423125505, + 0.03263654187321663, + 1.9347213841974735, + 0.0, + 2.013038231059909, + 0.037679288536310196, + 0.7176918350160122, + 0.10699482262134552, + 1.515194034203887, + 0.5320224612951279, + 1.084203215315938, + 0.09999458864331245, + 0.42821964994072914, + 0.10607731714844704, + 0.12753663025796413, + 0.5877562053501606, + 2.3802182655781507, + 1.2002906575798988, + 1.3211259581148624, + 0.431268110871315, + 0.0, + 0.4722094517201185, + 0.0, + 0.9667858369648457, + 0.16609283722937107, + 0.0, + 0.8580943010747433, + 0.2200772687792778, + 0.7954159826040268, + 0.3752349801361561, + 0.10572783090174198, + 0.16702576354146004, + 1.4540382586419582, + 1.0975255984812975, + 1.5789823308587074, + 0.03183383494615555, + 0.02324914000928402, + 1.3664478957653046, + 0.47073008120059967, + 1.1845938116312027, + 0.09884663484990597, + 1.428364945575595, + 0.48940117470920086, + 0.2086867094039917, + 0.3948791231960058 + ], + "unique_experts": 58, + "load_cv": 0.8484507505334952, + "normalized_load_entropy": 0.9073527583848422, + "max_load_share": 0.04874213836477988 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "81427ddaee2cbf9a541eaf8f1bf0abdef1329b9be0516045d6461588a7ec780e", + "route_weight_sha256": "30c4279cf66f2d140bd8431802445e9fd34eb34270de660f8905a0982dbbc196", + "loads": [ + 4, + 6, + 31, + 6, + 0, + 12, + 31, + 20, + 20, + 11, + 4, + 8, + 1, + 6, + 6, + 9, + 23, + 10, + 13, + 19, + 13, + 22, + 3, + 27, + 10, + 12, + 7, + 23, + 9, + 20, + 6, + 11, + 4, + 8, + 13, + 25, + 19, + 23, + 7, + 0, + 11, + 7, + 16, + 4, + 3, + 15, + 5, + 15, + 4, + 2, + 4, + 28, + 21, + 24, + 1, + 12, + 23, + 9, + 21, + 3, + 22, + 15, + 3, + 16 + ], + "weighted_loads": [ + 0.2184022106230259, + 0.26786855794489384, + 1.5603371988981962, + 0.27028101682662964, + 0.0, + 0.9213752038776875, + 1.7921550441533327, + 1.520747259259224, + 1.7747874483466148, + 2.5938968025147915, + 0.22472826018929482, + 0.3446132726967335, + 0.05792466551065445, + 0.19288485683500767, + 0.3740364648401737, + 0.888762179762125, + 0.9728818144649267, + 0.981750575825572, + 1.1075936742126942, + 1.3876202423125505, + 1.078805673867464, + 2.015445351600647, + 0.16674073040485382, + 2.013038231059909, + 0.8472634293138981, + 0.7176918350160122, + 0.3663460984826088, + 1.515194034203887, + 0.5320224612951279, + 1.084203215315938, + 0.25257587991654873, + 0.42821964994072914, + 0.14662101864814758, + 0.43877297826111317, + 0.5877562053501606, + 2.3802182655781507, + 1.2002906575798988, + 1.8499019853770733, + 0.6560751497745514, + 0.0, + 0.5533441472798586, + 1.317379992455244, + 1.0674449186772108, + 0.16609283722937107, + 0.11996565014123917, + 0.9256234057247639, + 0.2200772687792778, + 0.8821263313293457, + 0.3752349801361561, + 0.10572783090174198, + 0.16702576354146004, + 1.5528918392956257, + 1.0975255984812975, + 2.4322342686355114, + 0.03183383494615555, + 0.8897708412259817, + 1.3664478957653046, + 0.47073008120059967, + 1.1845938116312027, + 0.09884663484990597, + 1.8048276472836733, + 0.6153916325420141, + 0.2086867094039917, + 0.7124378643929958 + ], + "unique_experts": 62, + "load_cv": 0.6767443343166935, + "normalized_load_entropy": 0.9409805553859161, + "max_load_share": 0.039440203562340966 + } + }, + "s1_period": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "41ef79ad525f87bc0096f4458a47dbc97519218854c3e94bc6376c2decd2985d", + "route_weight_sha256": "9fd79d950476bf64e2453733c2927478ab18218be9bb87f5b2082c5332b017e0", + "loads": [ + 5, + 7, + 32, + 7, + 0, + 2, + 26, + 20, + 20, + 10, + 0, + 5, + 1, + 5, + 8, + 3, + 13, + 4, + 7, + 20, + 1, + 21, + 1, + 23, + 1, + 13, + 3, + 21, + 10, + 21, + 3, + 9, + 4, + 0, + 14, + 25, + 19, + 11, + 5, + 0, + 9, + 0, + 11, + 3, + 1, + 13, + 6, + 13, + 4, + 4, + 6, + 25, + 20, + 11, + 1, + 1, + 25, + 13, + 21, + 3, + 18, + 13, + 3, + 12 + ], + "weighted_loads": [ + 0.26786706782877445, + 0.3020603097975254, + 1.5345600806176662, + 0.3027477189898491, + 0.0, + 0.07167940586805344, + 1.5493191182613373, + 1.5100255571305752, + 1.7733294069766998, + 2.1613735631108284, + 0.0, + 0.24645665660500526, + 0.056628964841365814, + 0.18060491047799587, + 0.4412100575864315, + 0.4295995533466339, + 0.5111493598669767, + 0.470151849091053, + 0.5046174600720406, + 1.4081631246954203, + 0.033257126808166504, + 1.9879366271197796, + 0.030767720192670822, + 1.870161646977067, + 0.041164569556713104, + 0.7407997287809849, + 0.10828046500682831, + 1.3994355089962482, + 0.5611439608037472, + 1.1331929340958595, + 0.1049824021756649, + 0.3627379387617111, + 0.13480084389448166, + 0.0, + 0.6374105736613274, + 2.375264097005129, + 1.162701390683651, + 1.2522126082330942, + 0.431498434394598, + 0.0, + 0.49738914519548416, + 0.0, + 0.8914685919880867, + 0.13444536179304123, + 0.027253203094005585, + 0.8205973543226719, + 0.2536183148622513, + 0.7673435769975185, + 0.33950379118323326, + 0.16064736060798168, + 0.23762260749936104, + 1.4177336040884256, + 1.0503042936325073, + 1.5784715302288532, + 0.030667873099446297, + 0.023321228101849556, + 1.4550238363444805, + 0.5905046872794628, + 1.225749708712101, + 0.09950725361704826, + 1.329797774553299, + 0.5035708621144295, + 0.20764034986495972, + 0.4616087060421705 + ], + "unique_experts": 59, + "load_cv": 0.8366198394877641, + "normalized_load_entropy": 0.9099621701329075, + "max_load_share": 0.050314465408805034 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "bbd68965b0c8ab434cee2485767924603600ecd8cee9356f7f21b32b60e0d049", + "route_weight_sha256": "cdcba87f40a4d1d1a38d6cf5e5f916192d9d480ff2ae4fc326a8bbf4bd59fd25", + "loads": [ + 5, + 10, + 32, + 9, + 0, + 11, + 31, + 21, + 20, + 12, + 6, + 7, + 1, + 8, + 9, + 14, + 22, + 16, + 15, + 20, + 14, + 23, + 3, + 24, + 17, + 13, + 12, + 21, + 10, + 21, + 8, + 9, + 10, + 4, + 15, + 27, + 19, + 21, + 9, + 3, + 12, + 14, + 14, + 5, + 5, + 17, + 7, + 20, + 7, + 8, + 11, + 26, + 20, + 24, + 2, + 13, + 27, + 13, + 21, + 4, + 24, + 14, + 6, + 16 + ], + "weighted_loads": [ + 0.26786706782877445, + 0.42456867918372154, + 1.5345600806176662, + 0.395074550062418, + 0.0, + 0.9715680964291096, + 1.8237546756863594, + 1.5355483125895262, + 1.7733294069766998, + 2.574725851416588, + 0.2203826606273651, + 0.3090367969125509, + 0.056628964841365814, + 0.27159667015075684, + 0.4946954473853111, + 1.4306909255683422, + 0.8525588903576136, + 1.4151187166571617, + 1.3616836033761501, + 1.4081631246954203, + 1.0655831824988127, + 2.0777403004467487, + 0.11240148916840553, + 1.9465708006173372, + 1.4394268579781055, + 0.7407997287809849, + 1.2368908785283566, + 1.3994355089962482, + 0.5611439608037472, + 1.1331929340958595, + 0.32677573151886463, + 0.3627379387617111, + 0.3874313049018383, + 0.20699899271130562, + 0.6726878061890602, + 2.4937105141580105, + 1.162701390683651, + 1.7757938243448734, + 0.8148969262838364, + 0.17725524678826332, + 0.6055258810520172, + 2.1551491282880306, + 0.9992345254868269, + 0.22651900351047516, + 0.15193633176386356, + 1.0203048810362816, + 0.2850550748407841, + 1.098346758633852, + 0.46521149575710297, + 0.353323133662343, + 0.45778218656778336, + 1.460057033225894, + 1.0503042936325073, + 2.702598040923476, + 0.06956096552312374, + 1.0163939241319895, + 1.5631757490336895, + 0.5905046872794628, + 1.225749708712101, + 0.30140459164977074, + 1.7507625445723534, + 0.5999899730086327, + 0.5371569320559502, + 0.7147972397506237 + ], + "unique_experts": 63, + "load_cv": 0.5544716159906284, + "normalized_load_entropy": 0.9598074704507698, + "max_load_share": 0.036281179138321996 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 106, + "ordered_topk_exact_tokens": 79, + "set_exact_tokens": 86, + "mean_set_jaccard": 0.9460916442048519, + "mean_token_weighted_tv": 0.012340420602276077, + "aggregate_load_tv": 0.022012578616352196 + }, + "system_bos": { + "tokens": 106, + "ordered_topk_exact_tokens": 62, + "set_exact_tokens": 78, + "mean_set_jaccard": 0.9164420485175202, + "mean_token_weighted_tv": 0.018222215365759045, + "aggregate_load_tv": 0.03459119496855345 + }, + "system_x": { + "tokens": 106, + "ordered_topk_exact_tokens": 57, + "set_exact_tokens": 73, + "mean_set_jaccard": 0.9110512129380055, + "mean_token_weighted_tv": 0.020068459669655224, + "aggregate_load_tv": 0.037735849056603765 + }, + "system_period": { + "tokens": 106, + "ordered_topk_exact_tokens": 54, + "set_exact_tokens": 70, + "mean_set_jaccard": 0.8989218328840971, + "mean_token_weighted_tv": 0.021140800999864092, + "aggregate_load_tv": 0.0440251572327044 + }, + "bos_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 52, + "set_exact_tokens": 65, + "mean_set_jaccard": 0.88544474393531, + "mean_token_weighted_tv": 0.02193722480310584, + "aggregate_load_tv": 0.042452830188679236 + }, + "bos_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 60, + "set_exact_tokens": 71, + "mean_set_jaccard": 0.9036388140161725, + "mean_token_weighted_tv": 0.02074353098166439, + "aggregate_load_tv": 0.03773584905660377 + }, + "x_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 56, + "set_exact_tokens": 68, + "mean_set_jaccard": 0.8915094339622642, + "mean_token_weighted_tv": 0.02185155142906983, + "aggregate_load_tv": 0.03616352201257861 + }, + "x_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 53, + "set_exact_tokens": 64, + "mean_set_jaccard": 0.8807277628032345, + "mean_token_weighted_tv": 0.0244207802000192, + "aggregate_load_tv": 0.04559748427672956 + }, + "period_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 54, + "set_exact_tokens": 68, + "mean_set_jaccard": 0.8935309973045823, + "mean_token_weighted_tv": 0.02082009263828678, + "aggregate_load_tv": 0.03930817610062893 + }, + "period_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 50, + "set_exact_tokens": 62, + "mean_set_jaccard": 0.8733153638814016, + "mean_token_weighted_tv": 0.025780614702698757, + "aggregate_load_tv": 0.045597484276729564 + } + } + }, + "layer_17": { + "layer": 17, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "15173018c2218e1beef95c545b601a38fd86df0c6c4471aa1fff1c9279d0a4c4", + "route_weight_sha256": "8379cc7a51271cc914f8472bbafaf1efe333d7da52ba52d54b192525723be1d5", + "loads": [ + 11, + 3, + 4, + 10, + 8, + 12, + 0, + 15, + 16, + 14, + 3, + 7, + 5, + 15, + 34, + 5, + 12, + 9, + 4, + 3, + 15, + 11, + 17, + 13, + 3, + 21, + 12, + 11, + 5, + 8, + 7, + 0, + 2, + 10, + 19, + 17, + 9, + 8, + 12, + 20, + 4, + 5, + 2, + 12, + 6, + 5, + 17, + 23, + 20, + 5, + 14, + 4, + 8, + 19, + 13, + 4, + 4, + 0, + 18, + 8, + 22, + 4, + 7, + 2 + ], + "weighted_loads": [ + 0.4592456556856632, + 0.11734012886881828, + 0.14675667136907578, + 1.0805201195180416, + 0.7738931700587273, + 0.5783834178000689, + 0.0, + 0.8316010385751724, + 0.9659401439130306, + 2.023073460906744, + 0.12183648906648159, + 0.47390396893024445, + 0.20277532376348972, + 1.3128482848405838, + 2.4719753861427307, + 0.35363421589136124, + 0.638238649815321, + 0.41294006258249283, + 0.7850050218403339, + 0.14218446239829063, + 0.7344445437192917, + 0.5218462143093348, + 1.322110217064619, + 2.4313500728458166, + 0.12503115832805634, + 1.3151463251560926, + 0.502138052135706, + 0.5024989768862724, + 0.9276046939194202, + 0.31643681041896343, + 0.4434561785310507, + 0.0, + 0.07745986431837082, + 0.7319806776940823, + 1.3569919392466545, + 1.5358563028275967, + 0.42805821262300014, + 0.5330376550555229, + 0.8262107819318771, + 1.5938333123922348, + 0.17957673966884613, + 0.22559035755693913, + 0.09954215213656425, + 0.5616691056638956, + 0.34911560639739037, + 0.231998598203063, + 1.102604504674673, + 1.4992879163473845, + 2.2702354192733765, + 0.1770895291119814, + 0.9987151362001896, + 0.17450378090143204, + 0.5811853408813477, + 1.4269135631620884, + 0.5320737212896347, + 0.31739629805088043, + 0.17944470793008804, + 0.0, + 1.2905459329485893, + 0.33170087449252605, + 1.3642008695751429, + 0.1442687250673771, + 0.6026030220091343, + 0.07135353423655033 + ], + "unique_experts": 61, + "load_cv": 0.6799146480566978, + "normalized_load_entropy": 0.9426857542840901, + "max_load_share": 0.05345911949685535 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "d874e880ed965058c68cb65c3caa4ac1082f9b7e7dac460c9861ee26c1031610", + "route_weight_sha256": "3793274e999d3a8aee4de03bf4889aef65c6ffc610f271af0280b1f4d31b2149", + "loads": [ + 19, + 4, + 7, + 17, + 8, + 12, + 2, + 15, + 16, + 18, + 11, + 8, + 8, + 23, + 34, + 9, + 12, + 16, + 7, + 3, + 18, + 11, + 17, + 20, + 10, + 29, + 19, + 14, + 9, + 9, + 7, + 0, + 11, + 10, + 19, + 17, + 9, + 8, + 17, + 20, + 11, + 9, + 4, + 14, + 6, + 10, + 17, + 23, + 20, + 5, + 16, + 4, + 10, + 20, + 13, + 7, + 4, + 3, + 18, + 8, + 22, + 5, + 12, + 2 + ], + "weighted_loads": [ + 0.7289920588955283, + 0.15363987907767296, + 0.30221978947520256, + 1.6693027429282665, + 0.7738931700587273, + 0.5783834178000689, + 0.09668757021427155, + 0.8316010385751724, + 0.9659401439130306, + 2.411979429423809, + 0.5815515406429768, + 0.4923671465367079, + 0.3000979293137789, + 1.9024758450686932, + 2.4719753861427307, + 0.7704495228827, + 0.638238649815321, + 1.0805266872048378, + 0.8771391119807959, + 0.14218446239829063, + 1.01652991771698, + 0.5218462143093348, + 1.322110217064619, + 2.743302857503295, + 0.6386091448366642, + 1.9044996779412031, + 2.0662636905908585, + 0.6413760781288147, + 1.0808066632598639, + 0.3217472522519529, + 0.4434561785310507, + 0.0, + 0.4189458843320608, + 0.7319806776940823, + 1.3569919392466545, + 1.5358563028275967, + 0.42805821262300014, + 0.5330376550555229, + 1.016499888151884, + 1.5938333123922348, + 1.0632450804114342, + 0.3244032091461122, + 0.24142244085669518, + 0.5836987402290106, + 0.34911560639739037, + 1.1833363715559244, + 1.102604504674673, + 1.4992879163473845, + 2.2702354192733765, + 0.1770895291119814, + 1.1060428358614445, + 0.17450378090143204, + 0.7637864649295807, + 1.4548549894243479, + 0.5320737212896347, + 0.5332590565085411, + 0.17944470793008804, + 0.1479300558567047, + 1.2905459329485893, + 0.33170087449252605, + 1.3642008695751429, + 0.22998930141329765, + 0.9640147127211094, + 0.07135353423655033 + ], + "unique_experts": 63, + "load_cv": 0.5530884234801793, + "normalized_load_entropy": 0.9615247867503937, + "max_load_share": 0.043256997455470736 + } + }, + "s1_eos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "2d7994ab12958fb40f677268cf2e06dad20261d6e2dfd7bcead8407fa5098e91", + "route_weight_sha256": "70035d2566381f238e63ee8956f15b93493654e69ce2d27162291adf7574f2da", + "loads": [ + 10, + 2, + 3, + 11, + 8, + 12, + 0, + 14, + 16, + 14, + 2, + 7, + 5, + 16, + 36, + 4, + 12, + 9, + 4, + 3, + 14, + 11, + 16, + 14, + 5, + 22, + 11, + 11, + 5, + 8, + 7, + 0, + 2, + 10, + 20, + 18, + 8, + 8, + 12, + 20, + 4, + 6, + 3, + 11, + 6, + 5, + 18, + 23, + 20, + 4, + 14, + 3, + 8, + 19, + 12, + 4, + 4, + 0, + 18, + 7, + 24, + 4, + 7, + 2 + ], + "weighted_loads": [ + 0.4238820783793926, + 0.0827171728014946, + 0.11190268397331238, + 1.0942679215222597, + 0.7751458361744881, + 0.5919983722269535, + 0.0, + 0.7868027798831463, + 0.9600420407950878, + 2.0622357819229364, + 0.0979692880064249, + 0.4680746756494045, + 0.2116925437003374, + 1.3691917024552822, + 2.594115199521184, + 0.3215258978307247, + 0.6366167403757572, + 0.41421908512711525, + 0.7575617842376232, + 0.14280834794044495, + 0.6979348491877317, + 0.5117232874035835, + 1.2787560559809208, + 2.4280003365129232, + 0.2048335298895836, + 1.3706864137202501, + 0.4806762672960758, + 0.4857496079057455, + 0.9062008541077375, + 0.3099457938224077, + 0.4462139271199703, + 0.0, + 0.07794873043894768, + 0.730797067284584, + 1.400078896433115, + 1.6047251261770725, + 0.38765687867999077, + 0.5239873640239239, + 0.8469147384166718, + 1.606158223003149, + 0.1800391636788845, + 0.26147444546222687, + 0.13385894522070885, + 0.5189533140510321, + 0.3497694171965122, + 0.24473890848457813, + 1.1190274823457003, + 1.498103205114603, + 2.2558613065630198, + 0.1445007473230362, + 1.013908615335822, + 0.14256532303988934, + 0.5886841304600239, + 1.4227971993386745, + 0.48736350424587727, + 0.31941646337509155, + 0.1772787757217884, + 0.0, + 1.2930719126015902, + 0.2931535914540291, + 1.4405797105282545, + 0.14469533041119576, + 0.5847856644541025, + 0.07398590631783009 + ], + "unique_experts": 61, + "load_cv": 0.7070648251072875, + "normalized_load_entropy": 0.939353304538427, + "max_load_share": 0.05660377358490566 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "c27b24dd32eb11fc6e1f17e5a343a2adbd93d1dfb1bbb644375c140c94c0faa7", + "route_weight_sha256": "d2a9da0882939586abf96cb2df4b631f4d220c84dd0b71e11d4edfb350f374d9", + "loads": [ + 18, + 3, + 7, + 17, + 14, + 12, + 3, + 15, + 16, + 21, + 10, + 9, + 5, + 24, + 36, + 12, + 14, + 16, + 7, + 3, + 15, + 12, + 16, + 24, + 15, + 45, + 23, + 13, + 6, + 10, + 9, + 1, + 8, + 10, + 20, + 18, + 12, + 10, + 16, + 21, + 16, + 12, + 6, + 12, + 8, + 11, + 20, + 25, + 20, + 5, + 16, + 9, + 12, + 20, + 13, + 9, + 11, + 11, + 19, + 9, + 25, + 9, + 16, + 2 + ], + "weighted_loads": [ + 0.745468688197434, + 0.12484922632575035, + 0.2781751714646816, + 1.729561297222972, + 1.1655286718159914, + 0.5919983722269535, + 0.11930635198950768, + 0.8422826677560806, + 0.9600420407950878, + 2.53832028247416, + 0.6115971077233553, + 0.5349057111889124, + 0.2116925437003374, + 1.9901667460799217, + 2.594115199521184, + 0.9174895659089088, + 0.8065987229347229, + 1.0108820796012878, + 0.8613641727715731, + 0.14280834794044495, + 0.7663097586482763, + 0.5884743109345436, + 1.2787560559809208, + 3.1293016467243433, + 0.8242883128114045, + 2.9630731977522373, + 2.258565729483962, + 0.5814634766429663, + 0.9581469167023897, + 0.38862484972923994, + 0.5411052592098713, + 0.03952908515930176, + 0.2593120615929365, + 0.730797067284584, + 1.400078896433115, + 1.6047251261770725, + 0.6144228465855122, + 0.5968528650701046, + 1.1750329360365868, + 1.6392649412155151, + 1.715931199491024, + 0.5973498141393065, + 0.2713233381509781, + 0.5377670582383871, + 0.5847405903041363, + 1.6205067690461874, + 1.3361921701580286, + 1.6297797448933125, + 2.2558613065630198, + 0.1796242967247963, + 1.1932541821151972, + 0.43855172395706177, + 0.8610968552529812, + 1.4525980185717344, + 0.5754405502229929, + 0.7187933661043644, + 0.7944975793361664, + 0.5989238247275352, + 1.3169765826314688, + 0.38755084574222565, + 1.4758379776030779, + 0.45413411408662796, + 1.2718266136944294, + 0.07398590631783009 + ], + "unique_experts": 64, + "load_cv": 0.5525393619506215, + "normalized_load_entropy": 0.9648814932752326, + "max_load_share": 0.05102040816326531 + } + }, + "s0_bos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "3bfe471afc46fa30c37908fabeccef80a78172816e9c8e751f83627ba4756dcc", + "route_weight_sha256": "530b31c99623abcc0ef1d60cdb491aea969d97edf848ab376ae187e046e348f8", + "loads": [ + 10, + 2, + 4, + 11, + 8, + 12, + 0, + 14, + 16, + 15, + 2, + 8, + 5, + 16, + 37, + 5, + 10, + 7, + 4, + 3, + 13, + 13, + 15, + 14, + 6, + 22, + 13, + 9, + 5, + 6, + 6, + 0, + 2, + 12, + 18, + 17, + 6, + 7, + 12, + 22, + 4, + 6, + 1, + 10, + 5, + 5, + 18, + 23, + 19, + 6, + 14, + 4, + 8, + 20, + 15, + 4, + 4, + 0, + 18, + 8, + 24, + 4, + 7, + 2 + ], + "weighted_loads": [ + 0.4262986518442631, + 0.07843301445245743, + 0.14253831654787064, + 1.1012264806777239, + 0.7648247256875038, + 0.606150321662426, + 0.0, + 0.8170522265136242, + 0.9853343069553375, + 2.1262273974716663, + 0.10700490325689316, + 0.5280799195170403, + 0.1953228898346424, + 1.3707629442214966, + 2.6597001999616623, + 0.34013479202985764, + 0.5601409561932087, + 0.3314511515200138, + 0.8513173609972, + 0.14080916717648506, + 0.6605057064443827, + 0.5863502509891987, + 1.2687561623752117, + 2.423575095832348, + 0.2366855964064598, + 1.3754292018711567, + 0.5340338461101055, + 0.4294909257441759, + 0.8611836321651936, + 0.2590914610773325, + 0.4140574000775814, + 0.0, + 0.07467517629265785, + 0.7990592941641808, + 1.3246396444737911, + 1.5557327438145876, + 0.3416717052459717, + 0.480924304574728, + 0.8006571233272552, + 1.6933348961174488, + 0.17371242120862007, + 0.2658705562353134, + 0.06650709360837936, + 0.47617163322865963, + 0.3244145307689905, + 0.22632459923624992, + 1.1840077079832554, + 1.5143939107656479, + 2.265090972185135, + 0.21190660633146763, + 0.9925106149166822, + 0.18296372704207897, + 0.5973559655249119, + 1.4541912898421288, + 0.5750859640538692, + 0.3225448615849018, + 0.18156471848487854, + 0.0, + 1.2775287739932537, + 0.3311068844050169, + 1.4811263158917427, + 0.14852173998951912, + 0.5982675775885582, + 0.07015207596123219 + ], + "unique_experts": 61, + "load_cv": 0.7161807294458152, + "normalized_load_entropy": 0.9381509104515737, + "max_load_share": 0.05817610062893082 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "8babf30a09a803ccb1a54b21719dce24de1fb1b61e1872d662cad912b99ee759", + "route_weight_sha256": "c9033e30e488a4ce5d83dcdb9b12de22da5599ea088f8c0019129e2caaa8b194", + "loads": [ + 17, + 4, + 6, + 18, + 8, + 12, + 2, + 14, + 16, + 19, + 11, + 9, + 9, + 24, + 37, + 9, + 10, + 14, + 7, + 4, + 16, + 13, + 15, + 21, + 13, + 30, + 19, + 11, + 9, + 6, + 6, + 0, + 9, + 12, + 18, + 17, + 6, + 7, + 17, + 22, + 12, + 9, + 3, + 11, + 5, + 10, + 18, + 23, + 19, + 7, + 16, + 4, + 10, + 22, + 15, + 7, + 4, + 3, + 18, + 9, + 24, + 5, + 13, + 2 + ], + "weighted_loads": [ + 0.7057782765477896, + 0.16429385542869568, + 0.24312607571482658, + 1.6900091040879488, + 0.7648247256875038, + 0.606150321662426, + 0.09668757021427155, + 0.8170522265136242, + 0.9853343069553375, + 2.5152308493852615, + 0.6097868010401726, + 0.5465430971235037, + 0.4508071057498455, + 1.960390504449606, + 2.6597001999616623, + 0.722676120698452, + 0.5601409561932087, + 0.9990377761423588, + 0.949998626485467, + 0.19727200269699097, + 0.9580597449094057, + 0.5863502509891987, + 1.2687561623752117, + 2.730108927935362, + 0.7382312156260014, + 1.966921679675579, + 1.163417611271143, + 0.5214182008057833, + 1.0102460663765669, + 0.2590914610773325, + 0.4140574000775814, + 0.0, + 0.37147185392677784, + 0.7990592941641808, + 1.3246396444737911, + 1.5557327438145876, + 0.3416717052459717, + 0.480924304574728, + 0.9913978520780802, + 1.6933348961174488, + 1.0776509381830692, + 0.3580215461552143, + 0.20961543917655945, + 0.49498537741601467, + 0.3244145307689905, + 1.146440040320158, + 1.1840077079832554, + 1.5143939107656479, + 2.265090972185135, + 0.3637316022068262, + 1.0999632868915796, + 0.18296372704207897, + 0.7811027802526951, + 1.5348188746720552, + 0.5750859640538692, + 0.544462438672781, + 0.18156471848487854, + 0.14466749504208565, + 1.2775287739932537, + 0.37624880485236645, + 1.4811263158917427, + 0.24128186330199242, + 1.0300835967063904, + 0.07015207596123219 + ], + "unique_experts": 63, + "load_cv": 0.5824638131669951, + "normalized_load_entropy": 0.9585680125365876, + "max_load_share": 0.047073791348600506 + } + }, + "s1_bos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "b211070a341c2c0c8b046602835316ae8db7881b7e3c5a8d91c787398b624755", + "route_weight_sha256": "aa7d0f2c2141737add94d5d417ff9069c9428f92c8761925e2f78f509e3d6f42", + "loads": [ + 10, + 1, + 4, + 10, + 8, + 12, + 0, + 14, + 16, + 16, + 2, + 7, + 4, + 16, + 38, + 4, + 10, + 8, + 5, + 3, + 11, + 12, + 16, + 14, + 7, + 22, + 14, + 12, + 4, + 7, + 6, + 0, + 1, + 10, + 20, + 19, + 8, + 7, + 11, + 22, + 4, + 5, + 2, + 10, + 5, + 4, + 19, + 23, + 20, + 5, + 14, + 3, + 8, + 20, + 15, + 4, + 4, + 0, + 18, + 6, + 23, + 4, + 7, + 2 + ], + "weighted_loads": [ + 0.4487729072570801, + 0.035659316927194595, + 0.13543065823614597, + 1.1042594574391842, + 0.755806103348732, + 0.5963479746133089, + 0.0, + 0.8108220007270575, + 0.9809349793940783, + 2.090055637061596, + 0.11105590872466564, + 0.4772167094051838, + 0.15910374745726585, + 1.3551393076777458, + 2.6216071229428053, + 0.3092520609498024, + 0.5612341463565826, + 0.36787961423397064, + 0.8020416554063559, + 0.13489806093275547, + 0.5938642416149378, + 0.5594588872045279, + 1.305474892258644, + 2.396876085549593, + 0.2701391912996769, + 1.3641283754259348, + 0.5745185036212206, + 0.5098837669938803, + 0.8193905763328075, + 0.28113772347569466, + 0.41567532159388065, + 0.0, + 0.03763199225068092, + 0.7285959720611572, + 1.3957888316363096, + 1.6298489347100258, + 0.4000668078660965, + 0.4772790800780058, + 0.7758936155587435, + 1.6717724800109863, + 0.17652452737092972, + 0.22597973607480526, + 0.09796678274869919, + 0.4829043261706829, + 0.3163451962172985, + 0.21023599803447723, + 1.1711549684405327, + 1.497683610767126, + 2.2653320115059614, + 0.16760693490505219, + 0.9937394615262747, + 0.1515466906130314, + 0.5955465883016586, + 1.451210368424654, + 0.5823656618595123, + 0.3247392252087593, + 0.1759786456823349, + 0.0, + 1.2760308012366295, + 0.269192086532712, + 1.4346000142395496, + 0.15241465717554092, + 0.6141481753438711, + 0.074362363666296 + ], + "unique_experts": 61, + "load_cv": 0.7390137826793703, + "normalized_load_entropy": 0.9342701251280983, + "max_load_share": 0.059748427672955975 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "065e3d6fbe5d694048489bcdd66870393116212f55e4799ff0b0741ee044c585", + "route_weight_sha256": "b552f7c9b855bc0beddd6a3b748ab3d79faaa24099cb1725e8902f7fa2499796", + "loads": [ + 17, + 4, + 8, + 16, + 14, + 12, + 3, + 15, + 16, + 24, + 11, + 9, + 6, + 24, + 38, + 12, + 12, + 15, + 8, + 3, + 12, + 13, + 16, + 24, + 16, + 44, + 26, + 14, + 4, + 8, + 8, + 1, + 5, + 10, + 20, + 19, + 12, + 9, + 15, + 23, + 17, + 10, + 5, + 11, + 7, + 10, + 21, + 25, + 20, + 6, + 17, + 9, + 12, + 20, + 16, + 9, + 11, + 11, + 19, + 8, + 24, + 9, + 17, + 2 + ], + "weighted_loads": [ + 0.7522592861205339, + 0.180180873721838, + 0.29713582061231136, + 1.7395528331398964, + 1.1461889389902353, + 0.5963479746133089, + 0.11930635198950768, + 0.8663018885999918, + 0.9809349793940783, + 2.630789939314127, + 0.6673292219638824, + 0.5440477449446917, + 0.2716752626001835, + 1.9761143513023853, + 2.6216071229428053, + 0.8748619742691517, + 0.7312161289155483, + 0.9645426087081432, + 0.9169137701392174, + 0.13489806093275547, + 0.6909969169646502, + 0.6362099107354879, + 1.305474892258644, + 3.095069959759712, + 0.8594975732266903, + 2.9488636776804924, + 1.482011053711176, + 0.6000744421035051, + 0.8193905763328075, + 0.3545528016984463, + 0.5105666536837816, + 0.03952908515930176, + 0.17920446395874023, + 0.7285959720611572, + 1.3957888316363096, + 1.6298489347100258, + 0.6268327757716179, + 0.5501445811241865, + 1.0984385963529348, + 1.7048791982233524, + 1.7529184259474277, + 0.5648270025849342, + 0.2346983179450035, + 0.501718070358038, + 0.5513163693249226, + 1.7111738622188568, + 1.388319656252861, + 1.6293601505458355, + 2.2653320115059614, + 0.21001660078763962, + 1.2365217823535204, + 0.4475330915302038, + 0.8697977513074875, + 1.451210368424654, + 0.670442707836628, + 0.7308383546769619, + 0.7931974492967129, + 0.5942889899015427, + 1.299935471266508, + 0.36358934082090855, + 1.469858281314373, + 0.45589641109108925, + 1.3475215546786785, + 0.074362363666296 + ], + "unique_experts": 64, + "load_cv": 0.5731491571082793, + "normalized_load_entropy": 0.9622872040312177, + "max_load_share": 0.049886621315192746 + } + }, + "s0_x": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "395cae08e37d371fbdefd2d797245faeea391e417de439840d07c9dad4abeb8d", + "route_weight_sha256": "8c010728e6e48e80b71f752ffa1963fef0caf93c28a7e2c67af20df1fa2fc3c7", + "loads": [ + 10, + 4, + 4, + 11, + 8, + 11, + 0, + 15, + 16, + 14, + 2, + 8, + 4, + 16, + 39, + 4, + 10, + 8, + 4, + 3, + 11, + 13, + 15, + 14, + 6, + 22, + 11, + 10, + 5, + 7, + 6, + 0, + 2, + 11, + 18, + 17, + 9, + 9, + 11, + 20, + 4, + 5, + 2, + 9, + 5, + 4, + 19, + 23, + 19, + 6, + 14, + 5, + 8, + 20, + 14, + 4, + 4, + 0, + 18, + 9, + 23, + 4, + 7, + 2 + ], + "weighted_loads": [ + 0.42551259882748127, + 0.14392735064029694, + 0.14339393004775047, + 1.0859674736857414, + 0.7818880453705788, + 0.5719960145652294, + 0.0, + 0.854507852345705, + 0.9850730337202549, + 2.0604556780308485, + 0.10674967430531979, + 0.5418478809297085, + 0.15470819920301437, + 1.356411350890994, + 2.677631814032793, + 0.3033635877072811, + 0.5663883723318577, + 0.3729413654655218, + 0.775050550699234, + 0.13599893450737, + 0.5895062051713467, + 0.5927260331809521, + 1.2487727254629135, + 2.4342703223228455, + 0.2456306405365467, + 1.3675894644111395, + 0.4691010154783726, + 0.44499378465116024, + 0.8699278347194195, + 0.288099804893136, + 0.4116854891180992, + 0.0, + 0.07433343678712845, + 0.7657247148454189, + 1.3164622373878956, + 1.568831853568554, + 0.44320569559931755, + 0.5348389390856028, + 0.7599367648363113, + 1.5873019956052303, + 0.17687413096427917, + 0.21693307720124722, + 0.09649546816945076, + 0.453328475356102, + 0.3179734591394663, + 0.20000844448804855, + 1.1931449547410011, + 1.5112649202346802, + 2.275530118495226, + 0.21325200609862804, + 0.9895977154374123, + 0.20907927863299847, + 0.59701744094491, + 1.4492775052785873, + 0.5639832299202681, + 0.32211679965257645, + 0.17707310989499092, + 0.0, + 1.274947851896286, + 0.3722764905542135, + 1.446129497140646, + 0.15437046065926552, + 0.6077822670340538, + 0.07353848405182362 + ], + "unique_experts": 61, + "load_cv": 0.7130810842591014, + "normalized_load_entropy": 0.9400213068363287, + "max_load_share": 0.06132075471698113 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "e62288b0bb72a0eb7a77145e519b8d56cc904ef6a8e197f0061e5cf9ace07bdd", + "route_weight_sha256": "e1331a2247c78339cec3b4f8bf8d1c07dec738262a4559a1bb40428d527687a8", + "loads": [ + 16, + 5, + 7, + 19, + 8, + 11, + 2, + 15, + 16, + 19, + 11, + 9, + 6, + 25, + 39, + 8, + 10, + 16, + 7, + 3, + 13, + 13, + 15, + 22, + 13, + 31, + 18, + 12, + 9, + 7, + 6, + 0, + 9, + 11, + 18, + 17, + 9, + 9, + 16, + 20, + 11, + 9, + 4, + 10, + 5, + 9, + 19, + 23, + 20, + 6, + 16, + 5, + 10, + 20, + 14, + 9, + 4, + 3, + 18, + 9, + 23, + 5, + 12, + 2 + ], + "weighted_loads": [ + 0.6396498531103134, + 0.1802271008491516, + 0.3092504031956196, + 1.8247080072760582, + 0.7818880453705788, + 0.5719960145652294, + 0.09668757021427155, + 0.854507852345705, + 0.9850730337202549, + 2.4710653368383646, + 0.7235900852829218, + 0.5603110585361719, + 0.2178211659193039, + 1.9842914808541536, + 2.677631814032793, + 0.7136781290173531, + 0.5663883723318577, + 1.0858905483037233, + 0.8688997644931078, + 0.13599893450737, + 0.7903978191316128, + 0.5927260331809521, + 1.2487727254629135, + 2.8055509999394417, + 0.7482038289308548, + 2.029236352071166, + 1.079383585602045, + 0.5369210597127676, + 1.0258099269121885, + 0.288099804893136, + 0.4116854891180992, + 0.0, + 0.37113011442124844, + 0.7657247148454189, + 1.3164622373878956, + 1.568831853568554, + 0.44320569559931755, + 0.5348389390856028, + 0.9589476641267538, + 1.5873019956052303, + 1.0502876192331314, + 0.37122362293303013, + 0.23966559767723083, + 0.47214221954345703, + 0.3179734591394663, + 1.1305241584777832, + 1.1931449547410011, + 1.5112649202346802, + 2.3158247731626034, + 0.21325200609862804, + 1.1231390982866287, + 0.20907927863299847, + 0.7830666415393353, + 1.4492775052785873, + 0.5639832299202681, + 0.6058806777000427, + 0.17707310989499092, + 0.14318760484457016, + 1.274947851896286, + 0.3722764905542135, + 1.446129497140646, + 0.24655737355351448, + 0.9454834274947643, + 0.07353848405182362 + ], + "unique_experts": 63, + "load_cv": 0.586010116222433, + "normalized_load_entropy": 0.9590770355560516, + "max_load_share": 0.04961832061068702 + } + }, + "s1_x": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "84a230dd3c0474f31d4e2dd6edaf0de6b1756e9d9934c6a6b8c6801b9f62a3cb", + "route_weight_sha256": "0c607a2a66ab6b8dbdbd051bb007f15365676023f9a8dfab96aaa3dcd378cb7d", + "loads": [ + 10, + 2, + 4, + 11, + 8, + 12, + 0, + 14, + 16, + 12, + 3, + 9, + 4, + 16, + 39, + 5, + 10, + 11, + 4, + 3, + 11, + 12, + 16, + 14, + 7, + 21, + 12, + 10, + 5, + 9, + 6, + 0, + 1, + 10, + 19, + 19, + 6, + 8, + 12, + 21, + 4, + 4, + 2, + 10, + 4, + 5, + 19, + 23, + 19, + 3, + 14, + 5, + 8, + 20, + 12, + 4, + 5, + 0, + 19, + 6, + 25, + 3, + 8, + 2 + ], + "weighted_loads": [ + 0.440869415178895, + 0.07181917503476143, + 0.1342281512916088, + 1.1164102368056774, + 0.7654362395405769, + 0.5995590817183256, + 0.0, + 0.8399095125496387, + 0.9972985871136189, + 2.085144178941846, + 0.1434459239244461, + 0.5495248101651669, + 0.15592274069786072, + 1.3721006736159325, + 2.642088545486331, + 0.3522188775241375, + 0.564083356410265, + 0.4659447744488716, + 0.7353281006217003, + 0.1316852644085884, + 0.5832882542163134, + 0.5725168026983738, + 1.2583857737481594, + 2.3555721305310726, + 0.2852276973426342, + 1.3824519775807858, + 0.5168532952666283, + 0.42896826565265656, + 0.8560448121279478, + 0.3399394452571869, + 0.395007586106658, + 0.0, + 0.03942759335041046, + 0.734702505171299, + 1.3722630180418491, + 1.656218834221363, + 0.3339029364287853, + 0.4923311769962311, + 0.7925191670656204, + 1.6447517946362495, + 0.18557101860642433, + 0.18633894808590412, + 0.09315245598554611, + 0.4792445953935385, + 0.2897297963500023, + 0.2315287757664919, + 1.1572200525552034, + 1.5083965733647346, + 2.227544739842415, + 0.10872190073132515, + 0.9803044311702251, + 0.20574765466153622, + 0.5938358120620251, + 1.4684675298631191, + 0.4777068104594946, + 0.3356781229376793, + 0.21121004968881607, + 0.0, + 1.3111870996654034, + 0.26775598153471947, + 1.4732971489429474, + 0.12194131314754486, + 0.6197612471878529, + 0.07904709503054619 + ], + "unique_experts": 61, + "load_cv": 0.7319144390527519, + "normalized_load_entropy": 0.9364948818260016, + "max_load_share": 0.06132075471698113 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "658323fff5600278514055ab74a1db7fc9ba21e2d77ef906c88206251142d495", + "route_weight_sha256": "c2926c2db331e86dd3374ff1fb2ec33fd6b19359b47ad29fbf0b7caf9a819357", + "loads": [ + 15, + 3, + 9, + 18, + 14, + 12, + 3, + 15, + 16, + 20, + 13, + 11, + 4, + 25, + 39, + 13, + 12, + 19, + 7, + 3, + 11, + 13, + 16, + 25, + 16, + 44, + 22, + 11, + 5, + 10, + 8, + 1, + 5, + 10, + 19, + 19, + 10, + 10, + 15, + 22, + 16, + 10, + 5, + 11, + 6, + 11, + 21, + 25, + 20, + 3, + 17, + 11, + 12, + 20, + 13, + 11, + 12, + 12, + 21, + 8, + 26, + 9, + 17, + 2 + ], + "weighted_loads": [ + 0.6545152179896832, + 0.11395122855901718, + 0.3631649278104305, + 1.909141220152378, + 1.1558190751820803, + 0.5995590817183256, + 0.11930635198950768, + 0.8953894004225731, + 0.9972985871136189, + 2.5842333789914846, + 0.8500915337353945, + 0.6163558457046747, + 0.15592274069786072, + 2.0552210062742233, + 2.642088545486331, + 0.9222678914666176, + 0.7340653389692307, + 1.1142222434282303, + 0.8495425265282393, + 0.1316852644085884, + 0.5832882542163134, + 0.6492678262293339, + 1.2583857737481594, + 3.096851896494627, + 0.8803661055862904, + 3.022723278030753, + 1.28990207798779, + 0.4680599607527256, + 0.8560448121279478, + 0.4133545234799385, + 0.48989891819655895, + 0.03952908515930176, + 0.18100006505846977, + 0.734702505171299, + 1.3722630180418491, + 1.656218834221363, + 0.5606689043343067, + 0.5651966780424118, + 1.0870140306651592, + 1.6778585128486156, + 1.7345524579286575, + 0.5415107477456331, + 0.23263761028647423, + 0.4980583395808935, + 0.5247009694576263, + 1.5308662634342909, + 1.3743847403675318, + 1.640073113143444, + 2.2674477845430374, + 0.10872190073132515, + 1.24716941639781, + 0.5017340555787086, + 0.8762726075947285, + 1.4684675298631191, + 0.5657838564366102, + 0.8172556404024363, + 0.828428853303194, + 0.6339382193982601, + 1.3838621601462364, + 0.36215323582291603, + 1.5085554160177708, + 0.4592635426670313, + 1.2691045459359884, + 0.07904709503054619 + ], + "unique_experts": 64, + "load_cv": 0.576012817733337, + "normalized_load_entropy": 0.9614237838553763, + "max_load_share": 0.049886621315192746 + } + }, + "s0_period": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "546db3822e625a9253c3d8b0ddc9c15f6777d1143af41ef851e6285fdee11443", + "route_weight_sha256": "5ffc6f55a6084fa5f0038c4a39ed24638a2c64f3900773fd2c9d905bfa6eb4b1", + "loads": [ + 8, + 2, + 4, + 11, + 8, + 12, + 0, + 15, + 16, + 13, + 2, + 8, + 5, + 16, + 40, + 4, + 10, + 9, + 4, + 3, + 11, + 13, + 16, + 14, + 6, + 20, + 13, + 10, + 5, + 6, + 7, + 0, + 2, + 10, + 19, + 17, + 7, + 8, + 11, + 21, + 4, + 5, + 3, + 9, + 5, + 5, + 19, + 23, + 19, + 4, + 14, + 5, + 8, + 20, + 15, + 4, + 4, + 0, + 18, + 8, + 25, + 4, + 7, + 2 + ], + "weighted_loads": [ + 0.3673657812178135, + 0.0762600228190422, + 0.14411437883973122, + 1.08705610409379, + 0.7631188333034515, + 0.6088507305830717, + 0.0, + 0.8480915855616331, + 0.989546712487936, + 2.0490028709173203, + 0.10056607238948345, + 0.5279521755874157, + 0.1936203744262457, + 1.3519697412848473, + 2.691842233762145, + 0.2992994450032711, + 0.556256290525198, + 0.4119262732565403, + 0.7716056816279888, + 0.13917412981390953, + 0.5838432237505913, + 0.5983452405780554, + 1.2862444706261158, + 2.433174354955554, + 0.24938764423131943, + 1.2695221826434135, + 0.5360390450805426, + 0.4478063229471445, + 0.8976362962275743, + 0.26272224821150303, + 0.4261124972254038, + 0.0, + 0.07574154064059258, + 0.7393353916704655, + 1.3514804020524025, + 1.5616435371339321, + 0.3804969973862171, + 0.5188370030373335, + 0.7733177468180656, + 1.6185142882168293, + 0.1770189069211483, + 0.2138531655073166, + 0.1333308257162571, + 0.4601166136562824, + 0.32060488872230053, + 0.22853603214025497, + 1.194201335310936, + 1.497522396966815, + 2.2628338411450386, + 0.1502854861319065, + 0.9850085657089949, + 0.20356438867747784, + 0.5892509333789349, + 1.4306046292185783, + 0.5974194053560495, + 0.32064491510391235, + 0.18111543729901314, + 0.0, + 1.2720276527106762, + 0.33195479959249496, + 1.4979081600904465, + 0.15020747482776642, + 0.6143682226538658, + 0.07577589899301529 + ], + "unique_experts": 61, + "load_cv": 0.7303996466614715, + "normalized_load_entropy": 0.9378973316435734, + "max_load_share": 0.06289308176100629 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "9b702251e2280f92442928a8dd0efcab3e7f9a92bf7626e22830dbd5c8e276d3", + "route_weight_sha256": "96d86c1e0263ae85d9a79f4eae7831b0e5a217dd5102d0450aa9b41558f69f4c", + "loads": [ + 14, + 3, + 7, + 19, + 8, + 12, + 2, + 15, + 16, + 17, + 10, + 9, + 7, + 24, + 40, + 8, + 10, + 16, + 7, + 3, + 14, + 13, + 16, + 21, + 13, + 30, + 20, + 13, + 9, + 6, + 7, + 0, + 10, + 10, + 19, + 17, + 7, + 8, + 15, + 21, + 11, + 9, + 6, + 10, + 5, + 10, + 19, + 23, + 19, + 4, + 16, + 5, + 10, + 20, + 15, + 10, + 4, + 4, + 18, + 8, + 25, + 5, + 12, + 2 + ], + "weighted_loads": [ + 0.5820901188999414, + 0.11255977302789688, + 0.308971356600523, + 1.719374556094408, + 0.7631188333034515, + 0.6088507305830717, + 0.09668757021427155, + 0.8480915855616331, + 0.989546712487936, + 2.4277536682784557, + 0.5667548980563879, + 0.5464153531938791, + 0.2567333411425352, + 1.9415973015129566, + 2.691842233762145, + 0.7017649859189987, + 0.556256290525198, + 1.0795128978788853, + 0.8675311300903559, + 0.13917412981390953, + 0.8345072865486145, + 0.5983452405780554, + 1.2862444706261158, + 2.7461958546191454, + 0.753622230142355, + 1.9580595679581165, + 1.146086622029543, + 0.5749101657420397, + 1.0528775602579117, + 0.26272224821150303, + 0.4261124972254038, + 0.0, + 0.4118636604398489, + 0.7393353916704655, + 1.3514804020524025, + 1.5616435371339321, + 0.3804969973862171, + 0.5188370030373335, + 0.9337459001690149, + 1.6185142882168293, + 1.0413334257900715, + 0.380766823887825, + 0.32150693237781525, + 0.47893035784363747, + 0.32060488872230053, + 1.2206290531903505, + 1.194201335310936, + 1.497522396966815, + 2.2628338411450386, + 0.1502854861319065, + 1.1218018364161253, + 0.20356438867747784, + 0.7774601243436337, + 1.4306046292185783, + 0.5974194053560495, + 0.7912142258137465, + 0.18111543729901314, + 0.18775947019457817, + 1.2720276527106762, + 0.33195479959249496, + 1.4979081600904465, + 0.24264170974493027, + 0.9586855508387089, + 0.07577589899301529 + ], + "unique_experts": 63, + "load_cv": 0.5914648666212721, + "normalized_load_entropy": 0.9583919629707557, + "max_load_share": 0.05089058524173028 + } + }, + "s1_period": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "0bf971fbd499fb3e96240b5d6682885f86e57a896c075f068a03604c3d94941d", + "route_weight_sha256": "937e2a553b90faf17c4444b321ff3081ffc842272c14bf39fcdcca08e8d68fe1", + "loads": [ + 10, + 1, + 3, + 11, + 8, + 11, + 0, + 15, + 16, + 12, + 3, + 8, + 4, + 16, + 39, + 6, + 10, + 10, + 4, + 3, + 12, + 14, + 15, + 14, + 6, + 22, + 12, + 8, + 4, + 7, + 7, + 0, + 1, + 10, + 19, + 19, + 8, + 8, + 11, + 21, + 4, + 4, + 3, + 11, + 6, + 4, + 20, + 23, + 20, + 4, + 14, + 4, + 8, + 20, + 11, + 4, + 5, + 0, + 18, + 7, + 25, + 3, + 8, + 2 + ], + "weighted_loads": [ + 0.44780577160418034, + 0.035558249801397324, + 0.10630624368786812, + 1.1080794986337423, + 0.7609725743532181, + 0.5658175200223923, + 0.0, + 0.8685513827949762, + 0.9847955331206322, + 2.050467735156417, + 0.14464434795081615, + 0.5243829302489758, + 0.1618676707148552, + 1.3721698466688395, + 2.6500512938946486, + 0.38477833941578865, + 0.5616861060261726, + 0.43926207534968853, + 0.780430905520916, + 0.13225086778402328, + 0.6052825469523668, + 0.6238969005644321, + 1.235183421522379, + 2.3753645587712526, + 0.2475414089858532, + 1.4103487338870764, + 0.5235910005867481, + 0.3709139693528414, + 0.8308824934065342, + 0.27226679399609566, + 0.43006363324820995, + 0.0, + 0.038044992834329605, + 0.7388191521167755, + 1.3825933560729027, + 1.6763939820230007, + 0.4002339653670788, + 0.4952064696699381, + 0.7734991759061813, + 1.6526506766676903, + 0.1839056797325611, + 0.18451940827071667, + 0.1301414966583252, + 0.5204450227320194, + 0.3490237928926945, + 0.20680980756878853, + 1.187376556918025, + 1.5158018674701452, + 2.2586983740329742, + 0.12928521074354649, + 0.9890113975852728, + 0.17651150189340115, + 0.5994347333908081, + 1.4437889494001865, + 0.42637814208865166, + 0.3350754603743553, + 0.21314000710844994, + 0.0, + 1.2851357348263264, + 0.30733751878142357, + 1.487300081178546, + 0.11898713186383247, + 0.6205509174615145, + 0.08033925667405128 + ], + "unique_experts": 61, + "load_cv": 0.7372990068898084, + "normalized_load_entropy": 0.9356380520887008, + "max_load_share": 0.06132075471698113 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "02493126581604c4d030f9a53e20cdbf75cfcb33cd79b0b97e81d18823257920", + "route_weight_sha256": "80bb7ce0e8b2be6dc7c6ab7fcc8a24dc30fecda451756a3250a2a697a39672af", + "loads": [ + 15, + 2, + 8, + 18, + 14, + 11, + 3, + 16, + 16, + 19, + 12, + 10, + 4, + 24, + 39, + 14, + 12, + 17, + 6, + 3, + 12, + 15, + 15, + 24, + 16, + 46, + 24, + 9, + 5, + 8, + 9, + 1, + 5, + 10, + 19, + 19, + 12, + 10, + 14, + 22, + 17, + 10, + 8, + 12, + 8, + 10, + 22, + 25, + 20, + 4, + 17, + 10, + 13, + 20, + 12, + 11, + 12, + 13, + 19, + 9, + 26, + 8, + 16, + 2 + ], + "weighted_loads": [ + 0.6614515744149685, + 0.07769030332565308, + 0.31000207737088203, + 1.8008546996861696, + 1.1513554099947214, + 0.5658175200223923, + 0.11930635198950768, + 0.9240312706679106, + 0.9847955331206322, + 2.526193207129836, + 0.7024180591106415, + 0.5912139657884836, + 0.1618676707148552, + 1.993144890293479, + 2.6500512938946486, + 0.9785283915698528, + 0.7316680885851383, + 1.0359250698238611, + 0.8459063787013292, + 0.13225086778402328, + 0.6052825469523668, + 0.7006479240953922, + 1.235183421522379, + 3.076866490766406, + 0.8816279694437981, + 3.1153836883604527, + 1.3644560929387808, + 0.4100056644529104, + 0.8612850699573755, + 0.3456818722188473, + 0.5249549653381109, + 0.03952908515930176, + 0.17961746454238892, + 0.7388191521167755, + 1.3825933560729027, + 1.6763939820230007, + 0.6269999332726002, + 0.5680719707161188, + 1.0679940395057201, + 1.6857573948800564, + 1.7723067067563534, + 0.5534438453614712, + 0.34502948448061943, + 0.5392587669193745, + 0.5839949660003185, + 1.7094676904380322, + 1.4045412447303534, + 1.6474784072488546, + 2.2586983740329742, + 0.12928521074354649, + 1.2273296620696783, + 0.4724979028105736, + 0.9099576845765114, + 1.4437889494001865, + 0.5144551880657673, + 0.958265196532011, + 0.8303588107228279, + 0.7028769962489605, + 1.309040404856205, + 0.40173477306962013, + 1.5225583482533693, + 0.4276779368519783, + 1.1820568293333054, + 0.08033925667405128 + ], + "unique_experts": 64, + "load_cv": 0.5805652952353996, + "normalized_load_entropy": 0.9613826805124274, + "max_load_share": 0.05215419501133787 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 106, + "ordered_topk_exact_tokens": 68, + "set_exact_tokens": 83, + "mean_set_jaccard": 0.9380053908355797, + "mean_token_weighted_tv": 0.013010689206772818, + "aggregate_load_tv": 0.023584905660377357 + }, + "system_bos": { + "tokens": 106, + "ordered_topk_exact_tokens": 55, + "set_exact_tokens": 71, + "mean_set_jaccard": 0.8995956873315364, + "mean_token_weighted_tv": 0.02005728376361559, + "aggregate_load_tv": 0.03144654088050314 + }, + "system_x": { + "tokens": 106, + "ordered_topk_exact_tokens": 47, + "set_exact_tokens": 72, + "mean_set_jaccard": 0.9043126684636119, + "mean_token_weighted_tv": 0.020460693121729594, + "aggregate_load_tv": 0.037735849056603765 + }, + "system_period": { + "tokens": 106, + "ordered_topk_exact_tokens": 61, + "set_exact_tokens": 73, + "mean_set_jaccard": 0.898921832884097, + "mean_token_weighted_tv": 0.021149663764210243, + "aggregate_load_tv": 0.033018867924528295 + }, + "bos_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 55, + "set_exact_tokens": 67, + "mean_set_jaccard": 0.8847708894878705, + "mean_token_weighted_tv": 0.022505468838268292, + "aggregate_load_tv": 0.04245283018867925 + }, + "bos_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 54, + "set_exact_tokens": 70, + "mean_set_jaccard": 0.8928571428571428, + "mean_token_weighted_tv": 0.022318104123872407, + "aggregate_load_tv": 0.03459119496855346 + }, + "x_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 55, + "set_exact_tokens": 66, + "mean_set_jaccard": 0.8845462713387241, + "mean_token_weighted_tv": 0.022796341560710715, + "aggregate_load_tv": 0.04088050314465408 + }, + "x_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 56, + "set_exact_tokens": 71, + "mean_set_jaccard": 0.8955525606469003, + "mean_token_weighted_tv": 0.02314842872778481, + "aggregate_load_tv": 0.03930817610062892 + }, + "period_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 50, + "set_exact_tokens": 70, + "mean_set_jaccard": 0.896900269541779, + "mean_token_weighted_tv": 0.020647590479128203, + "aggregate_load_tv": 0.04245283018867924 + }, + "period_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 53, + "set_exact_tokens": 72, + "mean_set_jaccard": 0.8942048517520216, + "mean_token_weighted_tv": 0.02307763405776811, + "aggregate_load_tv": 0.03616352201257861 + } + } + }, + "layer_18": { + "layer": 18, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "719343bd5183cc03b2385ab653c0a6ea9630ae2b3c7cfdbe4e79b05a6bc21228", + "route_weight_sha256": "eaacee0d89b6f0ab83bcdab05954371737403172568fe745389f7eeec86e31ea", + "loads": [ + 2, + 3, + 7, + 2, + 62, + 10, + 2, + 19, + 3, + 0, + 8, + 12, + 17, + 10, + 14, + 2, + 20, + 8, + 1, + 7, + 18, + 0, + 8, + 28, + 12, + 3, + 17, + 7, + 11, + 5, + 3, + 3, + 9, + 5, + 2, + 3, + 12, + 4, + 11, + 0, + 5, + 6, + 30, + 3, + 7, + 23, + 4, + 24, + 9, + 10, + 10, + 3, + 10, + 4, + 13, + 10, + 18, + 5, + 15, + 8, + 5, + 4, + 38, + 2 + ], + "weighted_loads": [ + 0.0855637788772583, + 0.20228518173098564, + 0.541903343051672, + 0.07408379018306732, + 4.145492278039455, + 0.5577927827835083, + 0.06591863743960857, + 1.5271106977015734, + 0.1591414473950863, + 0.0, + 0.667643815279007, + 0.7423409186303616, + 0.841460082679987, + 0.6525557301938534, + 0.8193204365670681, + 0.06128275580704212, + 1.3282616399228573, + 0.3066416699439287, + 0.04808256775140762, + 0.5392465218901634, + 1.211766904219985, + 0.0, + 0.9114716276526451, + 1.579757645726204, + 0.7807842269539833, + 0.14924574829638004, + 0.9130567461252213, + 0.34170834720134735, + 1.004286378622055, + 0.35381216183304787, + 0.1340434905141592, + 0.15295368060469627, + 0.6062404550611973, + 0.20778263360261917, + 0.07727237790822983, + 0.14204297959804535, + 0.47477827966213226, + 0.1434656959027052, + 0.5754496976733208, + 0.0, + 0.28506945446133614, + 0.29611479490995407, + 1.7963515780866146, + 0.2690289169549942, + 0.25739845633506775, + 1.8330047465860844, + 0.2053482048213482, + 1.5500134192407131, + 0.3261201623827219, + 0.4519216399639845, + 0.6633655112236738, + 0.2128559947013855, + 0.7885811850428581, + 0.1669740453362465, + 0.5464091990143061, + 0.8186880871653557, + 0.7561683636158705, + 0.48014264553785324, + 2.9945940263569355, + 0.817337054759264, + 0.19916658475995064, + 0.1227355133742094, + 2.3437573295086622, + 0.11404164135456085 + ], + "unique_experts": 61, + "load_cv": 1.017527653293298, + "normalized_load_entropy": 0.9042250262213114, + "max_load_share": 0.09748427672955975 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "bc1c48ffa6e07c31f721da7df4c21b44aee9198c24cccabfc21b4ec7b4104c26", + "route_weight_sha256": "7dff02dee7a1b0392d9b44e9a408a7525e7c97a433d473d8c6ae709a0f417198", + "loads": [ + 9, + 4, + 20, + 2, + 62, + 12, + 2, + 19, + 11, + 0, + 9, + 17, + 17, + 10, + 19, + 6, + 20, + 8, + 18, + 7, + 18, + 1, + 8, + 30, + 12, + 4, + 17, + 7, + 11, + 5, + 10, + 3, + 10, + 5, + 2, + 6, + 14, + 6, + 11, + 3, + 9, + 6, + 34, + 3, + 7, + 23, + 11, + 24, + 11, + 21, + 13, + 5, + 19, + 12, + 13, + 10, + 20, + 6, + 17, + 12, + 5, + 8, + 38, + 4 + ], + "weighted_loads": [ + 0.5069068111479282, + 0.27801109477877617, + 1.6694326847791672, + 0.07408379018306732, + 4.145492278039455, + 0.6068177986890078, + 0.06591863743960857, + 1.5271106977015734, + 0.6446660347282887, + 0.0, + 0.6786159742623568, + 1.2057046294212341, + 0.841460082679987, + 0.6525557301938534, + 1.7338814865797758, + 0.18937602825462818, + 1.3282616399228573, + 0.3066416699439287, + 1.1365978829562664, + 0.5392465218901634, + 1.211766904219985, + 0.024969439953565598, + 0.9114716276526451, + 1.6628217287361622, + 0.7807842269539833, + 0.18002566695213318, + 0.9130567461252213, + 0.34170834720134735, + 1.004286378622055, + 0.35381216183304787, + 0.42170657124370337, + 0.15295368060469627, + 0.6342797446995974, + 0.20778263360261917, + 0.07727237790822983, + 0.3779478371143341, + 0.5852895453572273, + 0.20370969362556934, + 0.5754496976733208, + 0.07513235323131084, + 0.4860691986978054, + 0.29611479490995407, + 1.9106545876711607, + 0.2690289169549942, + 0.25739845633506775, + 1.8330047465860844, + 1.9293557368218899, + 1.5500134192407131, + 0.4357250723987818, + 0.9381442833691835, + 0.8416365012526512, + 0.40189630538225174, + 1.3906442057341337, + 0.7177206575870514, + 0.5464091990143061, + 0.8186880871653557, + 1.7542841415852308, + 0.5238568261265755, + 3.0868225749582052, + 0.9446948654949665, + 0.19916658475995064, + 0.23333646170794964, + 2.3437573295086622, + 0.2079588659107685 + ], + "unique_experts": 63, + "load_cv": 0.8135453381321874, + "normalized_load_entropy": 0.9342502381646628, + "max_load_share": 0.07888040712468193 + } + }, + "s1_eos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "69245321be4545d12d197a561026a610ab77c02808943d573469e00d5a66bc5a", + "route_weight_sha256": "14f138145d3253dcda433d5099502d75780725aaa11b39119765fcb55d28a4fb", + "loads": [ + 2, + 3, + 9, + 3, + 62, + 10, + 2, + 19, + 3, + 0, + 8, + 12, + 16, + 11, + 15, + 2, + 20, + 8, + 1, + 7, + 18, + 0, + 8, + 27, + 12, + 3, + 17, + 7, + 10, + 5, + 7, + 3, + 7, + 5, + 2, + 3, + 14, + 4, + 10, + 0, + 5, + 6, + 29, + 3, + 6, + 24, + 4, + 24, + 9, + 9, + 9, + 3, + 10, + 3, + 12, + 11, + 19, + 5, + 15, + 8, + 5, + 3, + 36, + 3 + ], + "weighted_loads": [ + 0.0797506757080555, + 0.19455205276608467, + 0.6152935940772295, + 0.10164200887084007, + 4.1914605461061, + 0.5571393650025129, + 0.062974339351058, + 1.5296922028064728, + 0.15683425962924957, + 0.0, + 0.6737153567373753, + 0.7527240812778473, + 0.8105000890791416, + 0.6875172164291143, + 0.857277974486351, + 0.06249934248626232, + 1.333743367344141, + 0.3126393109560013, + 0.047154299914836884, + 0.5395128279924393, + 1.2249676324427128, + 0.0, + 0.91094109416008, + 1.5729957893490791, + 0.7823463417589664, + 0.15030448511242867, + 0.8922303654253483, + 0.34514718875288963, + 0.9768303763121367, + 0.35382817685604095, + 0.2454170137643814, + 0.15371961519122124, + 0.5501959938555956, + 0.204091377556324, + 0.07701568678021431, + 0.13993915170431137, + 0.5443425178527832, + 0.14220515824854374, + 0.5455564521253109, + 0.0, + 0.2763730622828007, + 0.2894793339073658, + 1.7607581727206707, + 0.2601664774119854, + 0.22299351543188095, + 1.8568642679601908, + 0.2001427225768566, + 1.5844244342297316, + 0.31892475858330727, + 0.41269972175359726, + 0.6523682754486799, + 0.216224804520607, + 0.7780262492597103, + 0.1353549137711525, + 0.5045480616390705, + 0.822657011449337, + 0.7692142613232136, + 0.4811401106417179, + 2.969609320163727, + 0.8231286313384771, + 0.1992359608411789, + 0.0917718205600977, + 2.2756654918193817, + 0.1539573147892952 + ], + "unique_experts": 61, + "load_cv": 1.004223508502698, + "normalized_load_entropy": 0.9065307762302621, + "max_load_share": 0.09748427672955975 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "9e38e447db6297fe6aa9effe7e33e9cce82e09c63b5a8c5cc99dc35305ec566d", + "route_weight_sha256": "8a3abb84ff07b86187d0ae26504649c6fc9873316ef43640d5be7bd416576df2", + "loads": [ + 10, + 6, + 23, + 3, + 63, + 13, + 2, + 21, + 13, + 2, + 9, + 17, + 16, + 12, + 24, + 3, + 20, + 17, + 24, + 8, + 18, + 1, + 9, + 28, + 12, + 3, + 17, + 7, + 10, + 6, + 17, + 5, + 8, + 6, + 6, + 18, + 16, + 9, + 11, + 2, + 11, + 6, + 32, + 8, + 6, + 24, + 21, + 28, + 12, + 23, + 11, + 5, + 19, + 15, + 14, + 12, + 22, + 11, + 19, + 12, + 5, + 6, + 36, + 9 + ], + "weighted_loads": [ + 0.514115460216999, + 0.33314212784171104, + 1.769347433000803, + 0.10164200887084007, + 4.22953012958169, + 0.6456272657960653, + 0.062974339351058, + 1.599061019718647, + 1.018032293766737, + 0.0627104826271534, + 0.6855366798117757, + 1.2025042958557606, + 0.8105000890791416, + 0.729355214163661, + 1.9304942451417446, + 0.09618852101266384, + 1.333743367344141, + 0.8773244582116604, + 1.9432193730026484, + 0.6746792644262314, + 1.2249676324427128, + 0.025896336883306503, + 0.9463110826909542, + 1.6121071130037308, + 0.7823463417589664, + 0.15030448511242867, + 0.8922303654253483, + 0.34514718875288963, + 0.9768303763121367, + 0.38996945321559906, + 0.803459002636373, + 0.3976120240986347, + 0.6054191049188375, + 0.27990737557411194, + 0.5018039457499981, + 1.5116178710013628, + 0.6518404949456453, + 0.3665090147405863, + 0.5824099481105804, + 0.047740740701556206, + 0.523665513843298, + 0.2894793339073658, + 1.8556050285696983, + 0.71987733989954, + 0.22299351543188095, + 1.8568642679601908, + 3.0362121872603893, + 1.7639373745769262, + 0.41586667858064175, + 1.0095916241407394, + 0.7917676288634539, + 0.39573971927165985, + 1.3701730463653803, + 0.8342128060758114, + 0.6260292157530785, + 0.8581997565925121, + 1.7773139849305153, + 0.7564168013632298, + 3.3846624828875065, + 1.0797122325748205, + 0.1992359608411789, + 0.18582457304000854, + 2.2756654918193817, + 0.38499978743493557 + ], + "unique_experts": 64, + "load_cv": 0.7248826999998742, + "normalized_load_entropy": 0.945226702137035, + "max_load_share": 0.07142857142857142 + } + }, + "s0_bos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "783d10d51186457c100638ea35f752e58ce00d97a98e808cedf596d113a2d3df", + "route_weight_sha256": "20727efef2fc5839d0cb43813c89aabd8883f60e38536998e543299c00a20481", + "loads": [ + 2, + 4, + 6, + 4, + 61, + 9, + 1, + 19, + 3, + 0, + 8, + 11, + 17, + 11, + 15, + 2, + 21, + 7, + 0, + 7, + 18, + 0, + 8, + 30, + 11, + 3, + 18, + 7, + 10, + 5, + 7, + 3, + 8, + 5, + 2, + 3, + 15, + 3, + 9, + 0, + 5, + 6, + 30, + 3, + 7, + 24, + 4, + 26, + 7, + 9, + 10, + 3, + 9, + 3, + 13, + 10, + 16, + 5, + 15, + 7, + 7, + 3, + 38, + 3 + ], + "weighted_loads": [ + 0.09255807660520077, + 0.2108680121600628, + 0.5231265127658844, + 0.13515943847596645, + 4.108332064002752, + 0.5362662188708782, + 0.023266881704330444, + 1.5609436109662056, + 0.16498884186148643, + 0.0, + 0.6744470223784447, + 0.6986191608011723, + 0.8661200646311045, + 0.6770367454737425, + 0.8503349646925926, + 0.06296518445014954, + 1.3809323348104954, + 0.2737099379301071, + 0.0, + 0.5337982513010502, + 1.1964129116386175, + 0.0, + 0.8889065571129322, + 1.7344836592674255, + 0.72565608471632, + 0.14811266027390957, + 0.9591575171798468, + 0.346519585698843, + 1.0447838138788939, + 0.35991641506552696, + 0.24618981964886189, + 0.1500355564057827, + 0.5685793831944466, + 0.20484098605811596, + 0.08031845465302467, + 0.13838618993759155, + 0.5769334807991982, + 0.11350107192993164, + 0.5052783619612455, + 0.0, + 0.297849353402853, + 0.30366721376776695, + 1.8104069586843252, + 0.25849610567092896, + 0.2579798046499491, + 1.925009785220027, + 0.18823211640119553, + 1.6622120812535286, + 0.2613156232982874, + 0.4329619389027357, + 0.7017090581357479, + 0.2147403210401535, + 0.7261473834514618, + 0.12996701523661613, + 0.55734583735466, + 0.8093733042478561, + 0.6754265073686838, + 0.4819943346083164, + 2.928010229021311, + 0.8138257637619972, + 0.2626882903277874, + 0.09738410264253616, + 2.3493764977902174, + 0.15173009224236012 + ], + "unique_experts": 60, + "load_cv": 1.02419216063171, + "normalized_load_entropy": 0.902124965679024, + "max_load_share": 0.0959119496855346 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "89e15aaa76618b4919b8f66a317703990f9fcdfff737911ec9c90df8920dd774", + "route_weight_sha256": "5c3392076ac419c3224513ff56ec02414e4a551fc2cdbffd620343438432cb52", + "loads": [ + 8, + 5, + 18, + 4, + 61, + 12, + 1, + 19, + 11, + 0, + 8, + 15, + 18, + 11, + 20, + 5, + 21, + 7, + 19, + 7, + 18, + 1, + 8, + 33, + 11, + 4, + 19, + 7, + 10, + 5, + 13, + 3, + 9, + 5, + 2, + 7, + 16, + 5, + 9, + 3, + 11, + 7, + 35, + 3, + 7, + 24, + 12, + 26, + 9, + 19, + 12, + 5, + 18, + 11, + 13, + 10, + 17, + 6, + 17, + 10, + 7, + 6, + 38, + 5 + ], + "weighted_loads": [ + 0.47644328884780407, + 0.2865939252078533, + 1.6242549307644367, + 0.13515943847596645, + 4.108332064002752, + 0.6103144399821758, + 0.023266881704330444, + 1.5609436109662056, + 0.6505134291946888, + 0.0, + 0.6744470223784447, + 1.0372221432626247, + 1.0426982883363962, + 0.6770367454737425, + 1.643398316577077, + 0.15812227874994278, + 1.3809323348104954, + 0.2737099379301071, + 1.1312345396727324, + 0.5337982513010502, + 1.1964129116386175, + 0.024969439953565598, + 0.8889065571129322, + 1.8686829805374146, + 0.72565608471632, + 0.17934979870915413, + 1.0083097238093615, + 0.346519585698843, + 1.0447838138788939, + 0.35991641506552696, + 0.5598151925951242, + 0.1500355564057827, + 0.6045460216701031, + 0.20484098605811596, + 0.08031845465302467, + 0.40535006672143936, + 0.6676194742321968, + 0.1737450696527958, + 0.5052783619612455, + 0.1444559581577778, + 0.5887108631432056, + 0.3699682615697384, + 1.9905789718031883, + 0.25849610567092896, + 0.2579798046499491, + 1.925009785220027, + 1.9326514229178429, + 1.6622120812535286, + 0.37092053331434727, + 0.8703395929187536, + 0.8471653517335653, + 0.40186716616153717, + 1.3282104041427374, + 0.6517097689211369, + 0.55734583735466, + 0.8093733042478561, + 0.8985367063432932, + 0.5242297053337097, + 3.0180899631232023, + 0.9713178128004074, + 0.2626882903277874, + 0.18224560655653477, + 2.3493764977902174, + 0.24564731679856777 + ], + "unique_experts": 63, + "load_cv": 0.8195083034733079, + "normalized_load_entropy": 0.9335000416430502, + "max_load_share": 0.07760814249363868 + } + }, + "s1_bos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "6ca59e01e015099bed57107fac057147f114b374d2ccc3d0322d542f81d1bb84", + "route_weight_sha256": "5a4738aaa7197eb0120c7544b15183df26718dd12aedc22ba8d16f224ed6483a", + "loads": [ + 2, + 4, + 6, + 3, + 63, + 9, + 0, + 19, + 3, + 0, + 8, + 11, + 18, + 10, + 14, + 1, + 20, + 8, + 1, + 7, + 18, + 0, + 8, + 26, + 10, + 3, + 18, + 7, + 10, + 5, + 6, + 3, + 8, + 4, + 2, + 4, + 14, + 3, + 11, + 0, + 5, + 8, + 33, + 3, + 8, + 23, + 4, + 23, + 9, + 10, + 9, + 4, + 9, + 2, + 14, + 11, + 18, + 5, + 15, + 8, + 6, + 2, + 38, + 2 + ], + "weighted_loads": [ + 0.09103438816964626, + 0.1941378116607666, + 0.49019936099648476, + 0.10185081139206886, + 4.162478178739548, + 0.5343818664550781, + 0.0, + 1.5483862534165382, + 0.1609867960214615, + 0.0, + 0.6585879623889923, + 0.7097636386752129, + 0.9071228783577681, + 0.6331240776926279, + 0.8196247406303883, + 0.031861625611782074, + 1.3532640226185322, + 0.30647691152989864, + 0.04319576546549797, + 0.5291838757693768, + 1.225822465494275, + 0.0, + 0.894106961786747, + 1.5270980335772038, + 0.6883571036159992, + 0.1530013494193554, + 0.9588694963604212, + 0.3397570475935936, + 1.0369153060019016, + 0.35237008333206177, + 0.2137121744453907, + 0.14550607651472092, + 0.5776116084307432, + 0.17052283510565758, + 0.0874035619199276, + 0.185535728931427, + 0.5462103374302387, + 0.10426026023924351, + 0.5551834013313055, + 0.0, + 0.2814820185303688, + 0.36238331720232964, + 1.898943429812789, + 0.2615172155201435, + 0.2921703830361366, + 1.887320403009653, + 0.19375735893845558, + 1.5574783328920603, + 0.3214017543941736, + 0.45726615749299526, + 0.6434270776808262, + 0.2511620260775089, + 0.7476398982107639, + 0.09180035069584846, + 0.564633809030056, + 0.8338799756020308, + 0.731130039319396, + 0.4847659096121788, + 2.9397126026451588, + 0.8303468301892281, + 0.21971064247190952, + 0.06850424222648144, + 2.3262785989791155, + 0.09719303622841835 + ], + "unique_experts": 60, + "load_cv": 1.034031887967891, + "normalized_load_entropy": 0.9004195839209338, + "max_load_share": 0.09905660377358491 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "3565636ffd82f6a8a4fb5887b002b79c88a6a12058dcc6c7f6c6c558acb48d63", + "route_weight_sha256": "cb09b96ac72e4cf0e747cb3596370d7b1eb6280944d4bfcf794e84afdee125fe", + "loads": [ + 9, + 7, + 18, + 3, + 64, + 12, + 0, + 21, + 13, + 2, + 8, + 16, + 18, + 11, + 23, + 3, + 20, + 17, + 24, + 8, + 18, + 1, + 9, + 27, + 10, + 3, + 18, + 7, + 10, + 6, + 15, + 5, + 10, + 5, + 6, + 18, + 15, + 8, + 12, + 2, + 11, + 9, + 37, + 8, + 8, + 23, + 22, + 27, + 12, + 24, + 11, + 6, + 18, + 14, + 16, + 12, + 20, + 12, + 19, + 12, + 6, + 6, + 38, + 9 + ], + "weighted_loads": [ + 0.4898811485618353, + 0.332727886736393, + 1.5805921033024788, + 0.10185081139206886, + 4.2005477622151375, + 0.6228697672486305, + 0.0, + 1.6177550703287125, + 1.022184830158949, + 0.0627104826271534, + 0.6585879623889923, + 1.1396057642996311, + 0.9071228783577681, + 0.6749620754271746, + 1.930709220468998, + 0.09826995432376862, + 1.3532640226185322, + 0.8711620587855577, + 1.950479008257389, + 0.6643503122031689, + 1.225822465494275, + 0.025896336883306503, + 0.9294769503176212, + 1.565936353057623, + 0.6883571036159992, + 0.1530013494193554, + 0.9588694963604212, + 0.3397570475935936, + 1.0369153060019016, + 0.3885113596916199, + 0.7988528534770012, + 0.3893984854221344, + 0.6663257647305727, + 0.2463388331234455, + 0.5121918208897114, + 1.5031968019902706, + 0.6355725713074207, + 0.32856411673128605, + 0.592036897316575, + 0.047740740701556206, + 0.5423116572201252, + 0.4104446545243263, + 2.050883600488305, + 0.7212280780076981, + 0.2921703830361366, + 1.887320403009653, + 2.991661559790373, + 1.736991273239255, + 0.4183436743915081, + 1.0701203737407923, + 0.7896226793527603, + 0.4300638996064663, + 1.339786695316434, + 0.7616838701069355, + 0.686114963144064, + 0.8694227207452059, + 0.9884453658014536, + 0.7974729090929031, + 3.3574453741312027, + 1.1590387299656868, + 0.21971064247190952, + 0.20970244519412518, + 2.3262785989791155, + 0.3616856802254915 + ], + "unique_experts": 63, + "load_cv": 0.7370381958993796, + "normalized_load_entropy": 0.9437213501987941, + "max_load_share": 0.07256235827664399 + } + }, + "s0_x": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "108da8589ca07d93030e341c9660bf564529769a17a4cf31cccf070bdff9d8c6", + "route_weight_sha256": "d82e5df4b926aa651f3e7fc47e096314dc14e05d4b4e884c1996127a6f48ed1b", + "loads": [ + 2, + 4, + 6, + 2, + 62, + 9, + 0, + 19, + 3, + 0, + 8, + 10, + 18, + 10, + 14, + 3, + 22, + 8, + 0, + 7, + 18, + 1, + 8, + 27, + 11, + 3, + 18, + 7, + 9, + 5, + 5, + 3, + 9, + 5, + 2, + 3, + 15, + 3, + 10, + 0, + 5, + 8, + 31, + 3, + 7, + 24, + 4, + 26, + 9, + 8, + 10, + 3, + 9, + 3, + 14, + 9, + 16, + 5, + 15, + 7, + 7, + 3, + 39, + 2 + ], + "weighted_loads": [ + 0.09608200564980507, + 0.21078326180577278, + 0.5158571116626263, + 0.07026386260986328, + 4.174640987068415, + 0.5531842522323132, + 0.0, + 1.5502765569835901, + 0.16526345536112785, + 0.0, + 0.6493399702012539, + 0.6760537847876549, + 0.9084010776132345, + 0.6508994176983833, + 0.8269424922764301, + 0.10046259127557278, + 1.3900550808757544, + 0.2995396200567484, + 0.0, + 0.5338193513453007, + 1.2193940412253141, + 0.028737124055624008, + 0.8786642253398895, + 1.5269327946007252, + 0.7332873791456223, + 0.1497662104666233, + 0.9552106242626905, + 0.34896593913435936, + 1.007814034819603, + 0.3535882867872715, + 0.18123794719576836, + 0.14504503086209297, + 0.6077627278864384, + 0.2001140434294939, + 0.07623327523469925, + 0.14224651083350182, + 0.5642617251724005, + 0.11227576062083244, + 0.5563466008752584, + 0.0, + 0.2849019393324852, + 0.37676188722252846, + 1.849589042365551, + 0.25297318398952484, + 0.26724322885274887, + 1.9325547330081463, + 0.19860340654850006, + 1.6678568311035633, + 0.3250012453645468, + 0.3840576373040676, + 0.6511552482843399, + 0.21519802510738373, + 0.7307689972221851, + 0.13073450699448586, + 0.578997815027833, + 0.7820113301277161, + 0.6852408815175295, + 0.5015470497310162, + 2.9154829643666744, + 0.7850990481674671, + 0.2640905138105154, + 0.09667707793414593, + 2.3624361604452133, + 0.11335271969437599 + ], + "unique_experts": 60, + "load_cv": 1.0352552780661466, + "normalized_load_entropy": 0.9004749214974056, + "max_load_share": 0.09748427672955975 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "7ce3199c35a6d59b049d85281d4c54f14dd2a43147be427fbc5f4491c1e8882a", + "route_weight_sha256": "0e5573849eac653dc0f6eab6d8b9266ba26acf76a9caf98eff6a93e290da9baf", + "loads": [ + 10, + 5, + 19, + 2, + 62, + 11, + 0, + 19, + 11, + 0, + 8, + 15, + 18, + 10, + 19, + 6, + 22, + 8, + 18, + 7, + 18, + 2, + 8, + 27, + 11, + 3, + 18, + 7, + 9, + 5, + 12, + 3, + 10, + 5, + 2, + 7, + 16, + 5, + 10, + 3, + 10, + 8, + 34, + 3, + 7, + 24, + 11, + 26, + 12, + 19, + 12, + 6, + 19, + 11, + 14, + 9, + 17, + 7, + 19, + 10, + 7, + 6, + 39, + 5 + ], + "weighted_loads": [ + 0.5690237283706665, + 0.2865091748535633, + 1.7859767898917198, + 0.07026386260986328, + 4.174640987068415, + 0.6022092681378126, + 0.0, + 1.5502765569835901, + 0.6507880426943302, + 0.0, + 0.6493399702012539, + 1.1131761707365513, + 0.9084010776132345, + 0.6508994176983833, + 1.7179751452058554, + 0.19561968557536602, + 1.3900550808757544, + 0.2995396200567484, + 1.1368521749973297, + 0.5338193513453007, + 1.2193940412253141, + 0.053706564009189606, + 0.8786642253398895, + 1.5269327946007252, + 0.7332873791456223, + 0.1497662104666233, + 0.9552106242626905, + 0.34896593913435936, + 1.007814034819603, + 0.3535882867872715, + 0.5237317234277725, + 0.14504503086209297, + 0.6393158324062824, + 0.2001140434294939, + 0.07623327523469925, + 0.41931622847914696, + 0.6540889944881201, + 0.1725197583436966, + 0.5563466008752584, + 0.07608918473124504, + 0.5259344354271889, + 0.37676188722252846, + 1.9377897027879953, + 0.25297318398952484, + 0.26724322885274887, + 1.9325547330081463, + 1.8782478868961334, + 1.6678568311035633, + 0.4769241642206907, + 0.8601769581437111, + 0.7775825504213572, + 0.44069015979766846, + 1.4303431455045938, + 0.6505543477833271, + 0.578997815027833, + 0.7820113301277161, + 0.9083510804921389, + 0.5829368382692337, + 3.1137704718858004, + 0.915959220379591, + 0.2640905138105154, + 0.18035114742815495, + 2.3624361604452133, + 0.2864307388663292 + ], + "unique_experts": 62, + "load_cv": 0.8136726647306733, + "normalized_load_entropy": 0.9338310385633312, + "max_load_share": 0.07888040712468193 + } + }, + "s1_x": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "d4da8671fb85feb3b377a59963093ead8fbce4b979832c212ef914e2bc56222e", + "route_weight_sha256": "06b70b2ce90fccd8931b569cc8a82fe67eeb1f92341d09102c22861a5165e8e8", + "loads": [ + 3, + 3, + 6, + 3, + 63, + 8, + 1, + 19, + 3, + 0, + 8, + 9, + 19, + 11, + 14, + 1, + 20, + 8, + 1, + 7, + 18, + 0, + 8, + 27, + 11, + 3, + 17, + 7, + 10, + 6, + 4, + 3, + 8, + 7, + 2, + 4, + 15, + 2, + 10, + 0, + 5, + 6, + 33, + 4, + 5, + 24, + 4, + 24, + 10, + 10, + 9, + 4, + 9, + 3, + 12, + 10, + 18, + 5, + 14, + 7, + 7, + 2, + 39, + 3 + ], + "weighted_loads": [ + 0.13138443045318127, + 0.15947510674595833, + 0.5311920940876007, + 0.09981400519609451, + 4.191255893558264, + 0.524688359349966, + 0.03782723471522331, + 1.5232612676918507, + 0.1589037850499153, + 0.0, + 0.6719640158116817, + 0.611160933971405, + 0.926977314054966, + 0.6919398065656424, + 0.8099954016506672, + 0.03176524490118027, + 1.331533458083868, + 0.2984461821615696, + 0.043094173073768616, + 0.5090447254478931, + 1.248233299702406, + 0.0, + 0.8896561041474342, + 1.5326165854930878, + 0.7658414393663406, + 0.14414802752435207, + 0.892524192109704, + 0.34462058916687965, + 1.0369299668818712, + 0.3871898651123047, + 0.1541485469788313, + 0.14241327345371246, + 0.5767005309462547, + 0.2598314005881548, + 0.0873439721763134, + 0.19009704515337944, + 0.579504257068038, + 0.07894425466656685, + 0.5746572911739349, + 0.0, + 0.26968878880143166, + 0.2811789568513632, + 1.926787130534649, + 0.28313263319432735, + 0.19755247607827187, + 1.882039487361908, + 0.21042615920305252, + 1.612037232145667, + 0.3553861044347286, + 0.4398834388703108, + 0.6895165741443634, + 0.2515100706368685, + 0.7613937892019749, + 0.13414845243096352, + 0.5022622849792242, + 0.7817330732941628, + 0.7142608426511288, + 0.5038701146841049, + 2.8744605854153633, + 0.7839111536741257, + 0.25617034547030926, + 0.06802467815577984, + 2.347256977111101, + 0.14774389564990997 + ], + "unique_experts": 61, + "load_cv": 1.0418063867373337, + "normalized_load_entropy": 0.901003564641443, + "max_load_share": 0.09905660377358491 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "435ac2aec5ce5d5cc9030d77ebc8059b3fc7fc7c3506ae9e4ba2a5fd26e30de1", + "route_weight_sha256": "6fb64721898925caca768ee93d21a8c9c260a3febcea489b7e1e33793f82d42c", + "loads": [ + 13, + 6, + 19, + 3, + 64, + 11, + 1, + 21, + 14, + 2, + 8, + 14, + 19, + 12, + 23, + 2, + 20, + 17, + 26, + 8, + 18, + 1, + 9, + 27, + 11, + 3, + 17, + 7, + 10, + 7, + 13, + 5, + 10, + 8, + 6, + 17, + 16, + 7, + 11, + 2, + 11, + 6, + 35, + 10, + 5, + 24, + 21, + 28, + 14, + 23, + 11, + 7, + 19, + 15, + 14, + 11, + 20, + 12, + 18, + 10, + 7, + 4, + 39, + 10 + ], + "weighted_loads": [ + 0.7610095497220755, + 0.2980651818215847, + 1.7399326153099537, + 0.09981400519609451, + 4.2293254770338535, + 0.6131762601435184, + 0.03782723471522331, + 1.5926300846040249, + 1.0632629618048668, + 0.0627104826271534, + 0.6719640158116817, + 0.9630325511097908, + 0.926977314054966, + 0.733777804300189, + 1.867544211447239, + 0.06545442342758179, + 1.331533458083868, + 0.8631313294172287, + 2.075258608907461, + 0.6442111618816853, + 1.248233299702406, + 0.025896336883306503, + 0.9250260926783085, + 1.5326165854930878, + 0.7658414393663406, + 0.14414802752435207, + 0.892524192109704, + 0.34462058916687965, + 1.0369299668818712, + 0.4233311414718628, + 0.7030374985188246, + 0.38630568236112595, + 0.662752091884613, + 0.3356473986059427, + 0.5121322311460972, + 1.4803767055273056, + 0.6594080161303282, + 0.3032481111586094, + 0.6115107871592045, + 0.047740740701556206, + 0.5029432587325573, + 0.2811789568513632, + 1.9830629713833332, + 0.8018622975796461, + 0.19755247607827187, + 1.882039487361908, + 2.989600755274296, + 1.7915501724928617, + 0.4900215435773134, + 0.9870223216712475, + 0.8275900445878506, + 0.4660345707088709, + 1.4307093266397715, + 0.7691723741590977, + 0.6237434390932322, + 0.8172758184373379, + 0.9715761691331863, + 0.8188259638845921, + 3.2856448516249657, + 1.0509334206581116, + 0.25617034547030926, + 0.1321211401373148, + 2.347256977111101, + 0.44204833172261715 + ], + "unique_experts": 64, + "load_cv": 0.7385992615376957, + "normalized_load_entropy": 0.9437785417141519, + "max_load_share": 0.07256235827664399 + } + }, + "s0_period": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "5374bbb267326ce01c9c46eaed80ce2fdf95279666466eddfd96335022be6ffc", + "route_weight_sha256": "7d09249787253a5f327db7d5da5c6ef9655bfc4d3cfd779c417cff015f13995b", + "loads": [ + 2, + 4, + 6, + 2, + 62, + 9, + 1, + 18, + 3, + 0, + 8, + 11, + 18, + 11, + 15, + 2, + 22, + 8, + 1, + 6, + 17, + 0, + 8, + 26, + 10, + 3, + 17, + 8, + 10, + 5, + 4, + 3, + 8, + 5, + 1, + 3, + 15, + 3, + 10, + 0, + 5, + 7, + 31, + 3, + 7, + 24, + 4, + 25, + 9, + 9, + 9, + 4, + 9, + 4, + 14, + 11, + 16, + 5, + 15, + 7, + 8, + 3, + 40, + 2 + ], + "weighted_loads": [ + 0.08690940774977207, + 0.22054835595190525, + 0.514220330864191, + 0.06750673055648804, + 4.146815728396177, + 0.5548662319779396, + 0.040978603065013885, + 1.498370461165905, + 0.16064921393990517, + 0.0, + 0.647371631115675, + 0.7114154472947121, + 0.9042949769645929, + 0.6803461331874132, + 0.847849702462554, + 0.061166055500507355, + 1.404052197933197, + 0.3018763866275549, + 0.04501543566584587, + 0.49415089935064316, + 1.1923627890646458, + 0.0, + 0.8792099617421627, + 1.5444200113415718, + 0.6943097189068794, + 0.15024195238947868, + 0.9049277491867542, + 0.36295133642852306, + 1.0276815835386515, + 0.3520350567996502, + 0.14855927601456642, + 0.14611175283789635, + 0.5962381288409233, + 0.20501568913459778, + 0.04327847808599472, + 0.14109796285629272, + 0.5630911868065596, + 0.11691932380199432, + 0.5654949061572552, + 0.0, + 0.2847543768584728, + 0.33980462327599525, + 1.8389820270240307, + 0.262479729950428, + 0.2568654790520668, + 1.9106322098523378, + 0.1988666132092476, + 1.637503633275628, + 0.3309996537864208, + 0.4144025929272175, + 0.6175317205488682, + 0.24795223772525787, + 0.7280614003539085, + 0.16033773496747017, + 0.5748683903366327, + 0.8204553313553333, + 0.6824136711657047, + 0.4844377227127552, + 2.9387708604335785, + 0.7976700104773045, + 0.28971336781978607, + 0.09578290581703186, + 2.404899887740612, + 0.10818587616086006 + ], + "unique_experts": 61, + "load_cv": 1.032040786021419, + "normalized_load_entropy": 0.9016129911894853, + "max_load_share": 0.09748427672955975 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "d5de87699fe3e1b3d3c1ef7a16fae47227678e8ada5e86a7da1756e7c0d0e64e", + "route_weight_sha256": "24b6ec84b48ea44627ce08bbaa863d66a79e4d86c8d864573a5a5ca317018d16", + "loads": [ + 10, + 5, + 18, + 2, + 62, + 11, + 1, + 18, + 11, + 0, + 8, + 16, + 18, + 11, + 20, + 5, + 22, + 8, + 20, + 6, + 17, + 1, + 8, + 27, + 10, + 3, + 17, + 8, + 10, + 5, + 11, + 4, + 9, + 5, + 1, + 6, + 16, + 5, + 10, + 3, + 9, + 7, + 34, + 3, + 7, + 24, + 12, + 25, + 11, + 20, + 12, + 6, + 19, + 13, + 14, + 11, + 17, + 8, + 18, + 10, + 8, + 6, + 40, + 4 + ], + "weighted_loads": [ + 0.5587895344942808, + 0.2962742689996958, + 1.612786017358303, + 0.06750673055648804, + 4.146815728396177, + 0.6038912478834391, + 0.040978603065013885, + 1.498370461165905, + 0.6461738012731075, + 0.0, + 0.647371631115675, + 1.1291570998728275, + 0.9042949769645929, + 0.6803461331874132, + 1.8609043434262276, + 0.1563231498003006, + 1.404052197933197, + 0.3018763866275549, + 1.2345391139388084, + 0.49415089935064316, + 1.1923627890646458, + 0.024969439953565598, + 0.8792099617421627, + 1.5864555947482586, + 0.6943097189068794, + 0.15024195238947868, + 0.9049277491867542, + 0.36295133642852306, + 1.0276815835386515, + 0.3520350567996502, + 0.4791765920817852, + 0.1782686859369278, + 0.6219452507793903, + 0.20501568913459778, + 0.04327847808599472, + 0.38115574419498444, + 0.6508564781397581, + 0.17716332152485847, + 0.5654949061572552, + 0.0814702957868576, + 0.48341160640120506, + 0.33980462327599525, + 1.927182687446475, + 0.262479729950428, + 0.2568654790520668, + 1.9106322098523378, + 2.05233521014452, + 1.637503633275628, + 0.4406045638024807, + 0.8808946497738361, + 0.783539516851306, + 0.4337489977478981, + 1.4050543960183859, + 0.7342515103518963, + 0.5748683903366327, + 0.8204553313553333, + 0.9055238701403141, + 0.613295167684555, + 3.072724709287286, + 0.918516619130969, + 0.28971336781978607, + 0.1836896948516369, + 2.404899887740612, + 0.20210310071706772 + ], + "unique_experts": 63, + "load_cv": 0.8177366480692325, + "normalized_load_entropy": 0.9332301179134331, + "max_load_share": 0.07888040712468193 + } + }, + "s1_period": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "edbb266b8f8c170418332b2814ebbf111876202914a498b5ddb7ed83e85f8b56", + "route_weight_sha256": "8e0b290cad99f6597fe64be388f853e6015d11fd088e1280782e22206dffde79", + "loads": [ + 2, + 4, + 6, + 3, + 63, + 8, + 0, + 19, + 3, + 0, + 8, + 10, + 18, + 10, + 14, + 1, + 21, + 8, + 1, + 6, + 18, + 0, + 8, + 27, + 11, + 3, + 17, + 7, + 11, + 6, + 5, + 2, + 7, + 4, + 2, + 4, + 15, + 1, + 11, + 0, + 5, + 6, + 33, + 4, + 6, + 23, + 4, + 24, + 9, + 8, + 9, + 5, + 9, + 3, + 14, + 12, + 15, + 5, + 15, + 9, + 8, + 3, + 40, + 3 + ], + "weighted_loads": [ + 0.09570305049419403, + 0.19053929299116135, + 0.5300600416958332, + 0.10445144027471542, + 4.2117976024746895, + 0.5225657224655151, + 0.0, + 1.5339089706540108, + 0.1526315174996853, + 0.0, + 0.6603167802095413, + 0.6619989424943924, + 0.9039937909692526, + 0.6522648129612207, + 0.8135356679558754, + 0.032567098736763, + 1.3708031810820103, + 0.29352317191660404, + 0.04299662634730339, + 0.4883347786962986, + 1.2474262081086636, + 0.0, + 0.9102575033903122, + 1.5434850566089153, + 0.775831550359726, + 0.14618683978915215, + 0.8933817483484745, + 0.3432626463472843, + 1.0662514548748732, + 0.39039161056280136, + 0.1840246468782425, + 0.11283228173851967, + 0.5445070471614599, + 0.16063185781240463, + 0.08537321537733078, + 0.19429407641291618, + 0.577382093295455, + 0.04306858032941818, + 0.6009640712291002, + 0.0, + 0.2707677185535431, + 0.27948080003261566, + 1.9278716053813696, + 0.27760795690119267, + 0.22220608033239841, + 1.8722326252609491, + 0.20898983255028725, + 1.6298591643571854, + 0.3288056943565607, + 0.3829577937722206, + 0.6330192815512419, + 0.2930675074458122, + 0.7557336315512657, + 0.13903242349624634, + 0.5728635396808386, + 0.8453276176005602, + 0.6272448059171438, + 0.4989537447690964, + 2.915445748716593, + 0.8549090567976236, + 0.2872519511729479, + 0.09357942081987858, + 2.3847880382090807, + 0.15173648297786713 + ], + "unique_experts": 60, + "load_cv": 1.0463526378840218, + "normalized_load_entropy": 0.8988715799946325, + "max_load_share": 0.09905660377358491 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "7d838ff03fa7d9401589a0cb92e87ce294759aa09961180806b9fed556c3dc7e", + "route_weight_sha256": "67eb458c13bc1775eccc0e55000e413f69fb661c46f5bc2e43b9e21cbcf386cc", + "loads": [ + 10, + 7, + 18, + 3, + 64, + 11, + 0, + 21, + 13, + 3, + 8, + 15, + 18, + 11, + 23, + 2, + 21, + 17, + 23, + 7, + 18, + 1, + 9, + 27, + 11, + 3, + 17, + 7, + 11, + 7, + 14, + 4, + 9, + 5, + 6, + 18, + 16, + 6, + 12, + 3, + 11, + 6, + 35, + 9, + 6, + 23, + 22, + 28, + 12, + 22, + 11, + 9, + 19, + 16, + 16, + 13, + 17, + 13, + 19, + 12, + 8, + 6, + 40, + 10 + ], + "weighted_loads": [ + 0.5427660159766674, + 0.3291293680667877, + 1.617547795176506, + 0.10445144027471542, + 4.249867185950279, + 0.6110536232590675, + 0.0, + 1.603277787566185, + 1.0138295516371727, + 0.11426594480872154, + 0.6603167802095413, + 1.064312383532524, + 0.9039937909692526, + 0.6941028106957674, + 2.0385253094136715, + 0.06625627726316452, + 1.3708031810820103, + 0.8582083191722631, + 1.9573761820793152, + 0.6235012151300907, + 1.2474262081086636, + 0.025896336883306503, + 0.9456274919211864, + 1.5434850566089153, + 0.775831550359726, + 0.14618683978915215, + 0.8933817483484745, + 0.3432626463472843, + 1.0662514548748732, + 0.42653288692235947, + 0.6913088522851467, + 0.35672469064593315, + 0.6292913984507322, + 0.23644785583019257, + 0.5101614743471146, + 1.501291073858738, + 0.6571808885782957, + 0.2673724368214607, + 0.6378175672143698, + 0.07522405497729778, + 0.5071924030780792, + 0.27948080003261566, + 1.984147446230054, + 0.7373188193887472, + 0.22220608033239841, + 1.8722326252609491, + 3.0163989663124084, + 1.80937210470438, + 0.4257476143538952, + 0.972833126783371, + 0.7707749102264643, + 0.5772105231881142, + 1.4109909441322088, + 0.8244854304939508, + 0.6943446937948465, + 0.8808703627437353, + 0.8845601323992014, + 0.8808716386556625, + 3.3254415094852448, + 1.1118574980646372, + 0.2872519511729479, + 0.1850232109427452, + 2.3847880382090807, + 0.42186051420867443 + ], + "unique_experts": 63, + "load_cv": 0.7349143030383903, + "normalized_load_entropy": 0.9442137143944663, + "max_load_share": 0.07256235827664399 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 106, + "ordered_topk_exact_tokens": 77, + "set_exact_tokens": 86, + "mean_set_jaccard": 0.9460916442048519, + "mean_token_weighted_tv": 0.011411630882407134, + "aggregate_load_tv": 0.02358490566037736 + }, + "system_bos": { + "tokens": 106, + "ordered_topk_exact_tokens": 61, + "set_exact_tokens": 73, + "mean_set_jaccard": 0.9090296495956872, + "mean_token_weighted_tv": 0.018426405485578865, + "aggregate_load_tv": 0.03616352201257862 + }, + "system_x": { + "tokens": 106, + "ordered_topk_exact_tokens": 58, + "set_exact_tokens": 73, + "mean_set_jaccard": 0.9110512129380054, + "mean_token_weighted_tv": 0.019260707636416522, + "aggregate_load_tv": 0.03616352201257861 + }, + "system_period": { + "tokens": 106, + "ordered_topk_exact_tokens": 64, + "set_exact_tokens": 74, + "mean_set_jaccard": 0.911725067385445, + "mean_token_weighted_tv": 0.019146814292191335, + "aggregate_load_tv": 0.03144654088050314 + }, + "bos_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 61, + "set_exact_tokens": 72, + "mean_set_jaccard": 0.9083557951482482, + "mean_token_weighted_tv": 0.019820274996026507, + "aggregate_load_tv": 0.034591194968553465 + }, + "bos_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 62, + "set_exact_tokens": 72, + "mean_set_jaccard": 0.9083557951482479, + "mean_token_weighted_tv": 0.02031172278671051, + "aggregate_load_tv": 0.036163522012578615 + }, + "x_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 57, + "set_exact_tokens": 75, + "mean_set_jaccard": 0.9164420485175202, + "mean_token_weighted_tv": 0.018943123730286112, + "aggregate_load_tv": 0.03459119496855346 + }, + "x_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 58, + "set_exact_tokens": 74, + "mean_set_jaccard": 0.9097035040431268, + "mean_token_weighted_tv": 0.021816562184677372, + "aggregate_load_tv": 0.03773584905660378 + }, + "period_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 60, + "set_exact_tokens": 72, + "mean_set_jaccard": 0.9043126684636119, + "mean_token_weighted_tv": 0.020092840332819044, + "aggregate_load_tv": 0.036163522012578615 + }, + "period_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 51, + "set_exact_tokens": 64, + "mean_set_jaccard": 0.8827493261455527, + "mean_token_weighted_tv": 0.02441339204439296, + "aggregate_load_tv": 0.04402515723270441 + } + } + }, + "layer_19": { + "layer": 19, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "bae268da9f5c1f2fe27e95962980f486e9751a3b1fb311c393cad3e80177b8cc", + "route_weight_sha256": "819efe608489181f61adb9c5d347c92200afe9b44a7e5f12bbfc9b098d13c098", + "loads": [ + 1, + 2, + 15, + 15, + 3, + 0, + 11, + 24, + 15, + 10, + 1, + 5, + 6, + 3, + 5, + 0, + 16, + 3, + 13, + 9, + 16, + 23, + 11, + 5, + 7, + 13, + 6, + 15, + 5, + 9, + 9, + 16, + 0, + 26, + 5, + 12, + 4, + 5, + 5, + 6, + 11, + 4, + 3, + 3, + 23, + 10, + 15, + 5, + 7, + 20, + 2, + 62, + 17, + 9, + 3, + 8, + 10, + 20, + 13, + 16, + 7, + 0, + 12, + 1 + ], + "weighted_loads": [ + 0.03695053234696388, + 0.08136849105358124, + 1.5101588144898415, + 1.1777614504098892, + 0.11613812297582626, + 0.0, + 0.964268933981657, + 1.2848247922956944, + 1.0433117933571339, + 0.6737231910228729, + 0.026474198326468468, + 0.18889827094972134, + 0.2243287581950426, + 0.1055797915905714, + 0.3812611885368824, + 0.0, + 1.4518532641232014, + 0.13111365213990211, + 0.5855053160339594, + 0.2971794940531254, + 1.0825345069169998, + 1.5142957717180252, + 0.4325633607804775, + 0.18726453743875027, + 0.30274177342653275, + 1.8712110947817564, + 0.35410504788160324, + 0.9325724225491285, + 0.3465273380279541, + 0.8410707898437977, + 0.5264816600829363, + 1.8485940974205732, + 0.0, + 1.3027348425239325, + 0.4231125768274069, + 0.7898448221385479, + 0.13952034153044224, + 0.16785772144794464, + 0.24018891155719757, + 0.4873911924660206, + 0.5686105918139219, + 0.12783442065119743, + 0.11466658487915993, + 0.1179710254073143, + 1.9166558645665646, + 0.5196969769895077, + 0.7727635987102985, + 0.3221588507294655, + 0.324018482118845, + 1.4178076647222042, + 0.0765354372560978, + 3.2668107580393553, + 1.1846460476517677, + 0.490253284573555, + 0.11049617454409599, + 0.5088073629885912, + 0.3718956708908081, + 1.2737502567470074, + 1.4355277195572853, + 1.0145727917551994, + 0.3119290415197611, + 0.0, + 0.7504538483917713, + 0.0317755825817585 + ], + "unique_experts": 60, + "load_cv": 0.9302862668393245, + "normalized_load_entropy": 0.9153394539724383, + "max_load_share": 0.09748427672955975 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "5a4ebbb41e27fecd32a765fbebdec49f5e27c0cddda2352a8490969d0b4f1b24", + "route_weight_sha256": "fb6c88a7de1134c9342ca834e470011254724d14af701d0e9ccb0de920522a01", + "loads": [ + 3, + 6, + 18, + 15, + 8, + 2, + 22, + 24, + 15, + 15, + 1, + 6, + 14, + 4, + 10, + 0, + 18, + 3, + 13, + 13, + 16, + 23, + 17, + 14, + 16, + 13, + 6, + 17, + 5, + 13, + 14, + 16, + 0, + 26, + 5, + 13, + 6, + 10, + 6, + 6, + 16, + 6, + 12, + 4, + 24, + 10, + 15, + 9, + 8, + 20, + 2, + 62, + 17, + 12, + 10, + 8, + 10, + 20, + 20, + 17, + 9, + 4, + 18, + 1 + ], + "weighted_loads": [ + 0.08009973959997296, + 0.4487611260265112, + 1.7708072494715452, + 1.1777614504098892, + 0.8697395212948322, + 0.05986778251826763, + 1.4332743426784873, + 1.2848247922956944, + 1.0433117933571339, + 1.039355255663395, + 0.026474198326468468, + 0.21867776103317738, + 0.7671856265515089, + 0.14514357782900333, + 0.8445628508925438, + 0.0, + 1.5356602668762207, + 0.13111365213990211, + 0.5855053160339594, + 0.470568735152483, + 1.0825345069169998, + 1.5142957717180252, + 0.6569707300513983, + 0.4994352627545595, + 0.7600910407491028, + 1.8712110947817564, + 0.35410504788160324, + 1.0359979066997766, + 0.3465273380279541, + 1.0003204196691513, + 0.7146702334284782, + 1.8485940974205732, + 0.0, + 1.3027348425239325, + 0.4231125768274069, + 0.847672376781702, + 0.18272018083371222, + 0.405797578394413, + 0.2816780060529709, + 0.4873911924660206, + 0.7272405517287552, + 0.2592369094491005, + 0.7649691179394722, + 0.17559487000107765, + 1.9273697137832642, + 0.5196969769895077, + 0.7727635987102985, + 0.674629770219326, + 0.3623111695051193, + 1.4178076647222042, + 0.0765354372560978, + 3.2668107580393553, + 1.1846460476517677, + 0.748150572180748, + 1.8813826944679022, + 0.5088073629885912, + 0.3718956708908081, + 1.2737502567470074, + 1.7276027295738459, + 1.0549106635153294, + 0.5320062953978777, + 0.21485797688364983, + 1.264773439615965, + 0.0317755825817585 + ], + "unique_experts": 62, + "load_cv": 0.7365566186085138, + "normalized_load_entropy": 0.9420420083410275, + "max_load_share": 0.07888040712468193 + } + }, + "s1_eos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "1fe3ce9d08510d2a0dd824e89d6d96aea4d6428c5d1405fb68a906a3e1a4ac3d", + "route_weight_sha256": "1da21d8a7b731fdef4ab17b1cafe9e08027a056c2ee4a86e553e234094050bc2", + "loads": [ + 1, + 2, + 16, + 15, + 3, + 0, + 11, + 22, + 15, + 10, + 1, + 5, + 5, + 2, + 5, + 0, + 15, + 3, + 13, + 10, + 16, + 23, + 12, + 5, + 8, + 13, + 6, + 15, + 5, + 9, + 8, + 16, + 1, + 28, + 5, + 13, + 3, + 3, + 5, + 6, + 12, + 4, + 4, + 3, + 23, + 10, + 15, + 5, + 7, + 19, + 2, + 61, + 17, + 8, + 3, + 9, + 10, + 20, + 13, + 16, + 7, + 0, + 12, + 2 + ], + "weighted_loads": [ + 0.03708122298121452, + 0.07689891010522842, + 1.5648909378796816, + 1.1989934332668781, + 0.11089129373431206, + 0.0, + 0.9523154608905315, + 1.2219726759940386, + 1.0540050454437733, + 0.6536299735307693, + 0.025047169998288155, + 0.187780587002635, + 0.18872392922639847, + 0.08137623220682144, + 0.3876231424510479, + 0.0, + 1.4361968003213406, + 0.12762702070176601, + 0.5828601326793432, + 0.32992237247526646, + 1.0761898942291737, + 1.523958034813404, + 0.4563177041709423, + 0.18798121809959412, + 0.32569154165685177, + 1.8994121067225933, + 0.35844605416059494, + 0.9382178131490946, + 0.34100191853940487, + 0.873510405421257, + 0.4818070773035288, + 1.8417071998119354, + 0.02753663808107376, + 1.3639305997639894, + 0.4108496177941561, + 0.8264891915023327, + 0.1061989888548851, + 0.10775583051145077, + 0.2388889454305172, + 0.49136659502983093, + 0.6018568444997072, + 0.13368662260472775, + 0.14611579105257988, + 0.11140942759811878, + 1.9478574730455875, + 0.509405892342329, + 0.7595715466886759, + 0.3187784105539322, + 0.3243543989956379, + 1.3967704251408577, + 0.07548054680228233, + 3.2487527672201395, + 1.1843867022544146, + 0.47185680642724037, + 0.11375235207378864, + 0.5303449332714081, + 0.37274693325161934, + 1.2830126881599426, + 1.4357659164816141, + 1.0342669151723385, + 0.31242524832487106, + 0.0, + 0.7502020541578531, + 0.058426614850759506 + ], + "unique_experts": 61, + "load_cv": 0.9229439211495802, + "normalized_load_entropy": 0.9165535760525387, + "max_load_share": 0.0959119496855346 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "71d42fc1d90dbe7bfddc68b3bb04b38b0dcda52a709c68291ed0e7b1ec3ea152", + "route_weight_sha256": "25b5c7e32b049006908df7d9095055e964971dfd20b64fd40a12a37fe4c7854e", + "loads": [ + 4, + 8, + 18, + 15, + 15, + 3, + 24, + 22, + 15, + 16, + 2, + 13, + 17, + 2, + 16, + 2, + 18, + 8, + 14, + 18, + 20, + 24, + 19, + 11, + 21, + 13, + 6, + 17, + 6, + 11, + 12, + 16, + 3, + 28, + 5, + 13, + 6, + 7, + 6, + 8, + 18, + 12, + 14, + 4, + 24, + 10, + 15, + 16, + 8, + 20, + 7, + 61, + 20, + 17, + 8, + 9, + 12, + 22, + 23, + 18, + 10, + 7, + 21, + 4 + ], + "weighted_loads": [ + 0.09798093466088176, + 0.5832991413772106, + 1.7903947811573744, + 1.1989934332668781, + 1.5776271615177393, + 0.1338860411196947, + 1.5697244359180331, + 1.2219726759940386, + 1.0540050454437733, + 1.0378879718482494, + 0.09129929728806019, + 0.9486239310353994, + 0.8772700652480125, + 0.08137623220682144, + 1.246509725227952, + 0.1104513667523861, + 1.830825574696064, + 0.35224019922316074, + 0.6826484482735395, + 0.7153744678944349, + 1.411358980461955, + 1.5783785097301006, + 0.7316476013511419, + 0.3874273542314768, + 1.0864487765356898, + 1.8994121067225933, + 0.35844605416059494, + 1.0750792007893324, + 0.3804007265716791, + 0.9467834047973156, + 0.6281651277095079, + 1.8417071998119354, + 0.11764673888683319, + 1.3639305997639894, + 0.4108496177941561, + 0.8264891915023327, + 0.18940758844837546, + 0.282584635540843, + 0.2821744941174984, + 0.5962988790124655, + 0.7789551797322929, + 0.5144623313099146, + 0.9143110513687134, + 0.14952714927494526, + 1.9585713222622871, + 0.509405892342329, + 0.7595715466886759, + 1.084641445428133, + 0.35865310579538345, + 1.4399962238967419, + 0.40887659043073654, + 3.2487527672201395, + 1.3278617449104786, + 1.2627374939620495, + 1.8246355410665274, + 0.5303449332714081, + 0.45293139666318893, + 1.3712757602334023, + 1.9393530935049057, + 1.11087117344141, + 0.5017232708632946, + 0.3201575931161642, + 1.4698556158691645, + 0.2225419282913208 + ], + "unique_experts": 64, + "load_cv": 0.64117024631765, + "normalized_load_entropy": 0.9564345772685067, + "max_load_share": 0.0691609977324263 + } + }, + "s0_bos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "2a477ba55be89ae525464c04cceb2af3422237d37aefda7a68bca33cef3b7180", + "route_weight_sha256": "f709060b32d58bc8d87c9d45a309ba970fb0d36632b707601643c8914dd87a37", + "loads": [ + 2, + 2, + 13, + 15, + 5, + 0, + 12, + 22, + 15, + 13, + 0, + 5, + 4, + 3, + 5, + 0, + 15, + 3, + 13, + 10, + 15, + 23, + 11, + 4, + 6, + 13, + 6, + 14, + 5, + 8, + 8, + 16, + 1, + 29, + 5, + 12, + 3, + 4, + 5, + 6, + 11, + 4, + 3, + 3, + 22, + 10, + 16, + 5, + 5, + 21, + 2, + 63, + 17, + 9, + 3, + 8, + 10, + 20, + 14, + 17, + 7, + 0, + 13, + 2 + ], + "weighted_loads": [ + 0.06813471764326096, + 0.07804320380091667, + 1.3906136397272348, + 1.1706230454146862, + 0.18993204459547997, + 0.0, + 0.984882427379489, + 1.2509014904499054, + 1.0446756668388844, + 0.8606891967356205, + 0.0, + 0.1856131125241518, + 0.1560155302286148, + 0.10049343295395374, + 0.3984410874545574, + 0.0, + 1.4427836071699858, + 0.1288812719285488, + 0.5886208154261112, + 0.32918104343116283, + 1.0607812032103539, + 1.5404197573661804, + 0.4406425766646862, + 0.15495466068387032, + 0.27073733881115913, + 1.9117008950561285, + 0.3505581244826317, + 0.9017276223748922, + 0.346381526440382, + 0.7673018984496593, + 0.48701225593686104, + 1.82057018391788, + 0.02741846814751625, + 1.4242810178548098, + 0.42586737498641014, + 0.8287988640367985, + 0.10891547240316868, + 0.14298544637858868, + 0.2473595179617405, + 0.5108328685164452, + 0.5630086101591587, + 0.1307207029312849, + 0.10970023646950722, + 0.11514311656355858, + 1.9793038181960583, + 0.5156470276415348, + 0.7907531410455704, + 0.33236122131347656, + 0.24496625736355782, + 1.4424194227904081, + 0.07873879745602608, + 3.345301503315568, + 1.2101948000490665, + 0.47514396347105503, + 0.11368722282350063, + 0.5269628595560789, + 0.38509382866322994, + 1.2905077375471592, + 1.467297986149788, + 1.071083553135395, + 0.30416244082152843, + 0.0, + 0.809652503579855, + 0.0586093794554472 + ], + "unique_experts": 60, + "load_cv": 0.9454694201032113, + "normalized_load_entropy": 0.9140897845748444, + "max_load_share": 0.09905660377358491 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "4464278edfd62c912d0c49c1003bccd61f748efef544b252e19f4188cdf07174", + "route_weight_sha256": "1d95631470021eb21fc420df46b31c1ff43bce4cb87c8c5c501ba05069c13051", + "loads": [ + 3, + 6, + 15, + 15, + 9, + 2, + 22, + 22, + 15, + 17, + 0, + 6, + 12, + 7, + 10, + 0, + 17, + 4, + 13, + 15, + 15, + 23, + 17, + 10, + 15, + 13, + 7, + 16, + 5, + 12, + 15, + 16, + 1, + 29, + 5, + 14, + 3, + 9, + 6, + 6, + 14, + 7, + 12, + 4, + 23, + 11, + 16, + 9, + 7, + 21, + 2, + 64, + 17, + 12, + 9, + 8, + 10, + 20, + 22, + 18, + 9, + 3, + 19, + 2 + ], + "weighted_loads": [ + 0.1068435050547123, + 0.42008821852505207, + 1.6146779581904411, + 1.1706230454146862, + 0.7966205477714539, + 0.04658413864672184, + 1.4083589622750878, + 1.2509014904499054, + 1.0446756668388844, + 1.1590125784277916, + 0.0, + 0.21539260260760784, + 0.6916545443236828, + 0.25511169619858265, + 0.8604121580719948, + 0.0, + 1.526590609923005, + 0.8599870763719082, + 0.5886208154261112, + 0.7412944789975882, + 1.0607812032103539, + 1.5404197573661804, + 0.6743511203676462, + 0.3808692432940006, + 0.8379142172634602, + 1.9117008950561285, + 0.38628536462783813, + 1.036255406215787, + 0.346381526440382, + 0.926551528275013, + 0.7590315211564302, + 1.82057018391788, + 0.02741846814751625, + 1.4242810178548098, + 0.42586737498641014, + 0.9056027550250292, + 0.10891547240316868, + 0.38800803013145924, + 0.2888486124575138, + 0.5108328685164452, + 0.6770772421732545, + 0.29858882911503315, + 0.7675374448299408, + 0.17276696115732193, + 1.9900176674127579, + 0.542370893061161, + 0.7907531410455704, + 0.6943819224834442, + 0.31942567229270935, + 1.4424194227904081, + 0.07873879745602608, + 3.3611804712563753, + 1.2101948000490665, + 0.7097277510911226, + 0.9408719390630722, + 0.5269628595560789, + 0.38509382866322994, + 1.2905077375471592, + 1.792299898341298, + 1.1139375790953636, + 0.4895195718854666, + 0.18156729638576508, + 1.3239720948040485, + 0.0586093794554472 + ], + "unique_experts": 62, + "load_cv": 0.7532451316881961, + "normalized_load_entropy": 0.9412135210508388, + "max_load_share": 0.08142493638676845 + } + }, + "s1_bos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "ef37e8f0f61234abefb4cd28ebcc22b948c878c4ad3cbbe264f8ae1724ee72fd", + "route_weight_sha256": "7bc56c1aec0080e5ba705da593ec6da039b4e8c6f3f4214e9102ee8a39b47e83", + "loads": [ + 2, + 1, + 15, + 15, + 4, + 0, + 11, + 22, + 15, + 10, + 0, + 5, + 5, + 2, + 6, + 1, + 15, + 3, + 12, + 10, + 16, + 23, + 12, + 4, + 6, + 13, + 6, + 14, + 5, + 9, + 7, + 17, + 1, + 27, + 5, + 13, + 2, + 5, + 6, + 6, + 10, + 4, + 3, + 3, + 22, + 10, + 16, + 5, + 7, + 21, + 2, + 62, + 18, + 8, + 3, + 8, + 11, + 20, + 15, + 16, + 6, + 0, + 13, + 2 + ], + "weighted_loads": [ + 0.06602268852293491, + 0.03699541836977005, + 1.3931751288473606, + 1.2077214792370796, + 0.159630186855793, + 0.0, + 0.9441973343491554, + 1.2465481441468, + 1.058255948126316, + 0.6650566682219505, + 0.0, + 0.1771391537040472, + 0.19450263306498528, + 0.08563858643174171, + 0.41971175745129585, + 0.021104633808135986, + 1.4115778431296349, + 0.14266031980514526, + 0.5445552915334702, + 0.32252118550240993, + 1.097573947161436, + 1.537261750549078, + 0.4629968162626028, + 0.15107566863298416, + 0.2651420049369335, + 1.8954105246812105, + 0.35194506123661995, + 0.9078835491091013, + 0.34021260403096676, + 0.8263096883893013, + 0.4607480317354202, + 1.8528244476765394, + 0.027465904131531715, + 1.3600442465394735, + 0.42145536839962006, + 0.8292798902839422, + 0.09216596186161041, + 0.17943603731691837, + 0.2684680353850126, + 0.49297768250107765, + 0.5442957244813442, + 0.13915794901549816, + 0.10511773824691772, + 0.12167487666010857, + 1.8992425352334976, + 0.5145372841507196, + 0.7839352041482925, + 0.32095998153090477, + 0.32233016192913055, + 1.4645002540200949, + 0.07596008852124214, + 3.274225426837802, + 1.218937637284398, + 0.45050350949168205, + 0.11111021228134632, + 0.537221884354949, + 0.3967602550983429, + 1.3059793934226036, + 1.4910655617713928, + 1.016193002462387, + 0.263800535351038, + 0.0, + 0.8029946219176054, + 0.05886811390519142 + ], + "unique_experts": 61, + "load_cv": 0.933681638377494, + "normalized_load_entropy": 0.9152889923042414, + "max_load_share": 0.09748427672955975 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "5861159fdc582cbfd4e0ef8db25f236b07bc1fe50fd1a805b0b7a415a6ec2d88", + "route_weight_sha256": "da8f7265effe8eeb58a6753e8ba84408a23d6d2a91b869b1cf89c048812ef5e5", + "loads": [ + 4, + 7, + 17, + 15, + 16, + 2, + 22, + 22, + 15, + 18, + 1, + 13, + 17, + 4, + 16, + 3, + 19, + 8, + 13, + 18, + 20, + 24, + 20, + 8, + 18, + 13, + 6, + 16, + 6, + 11, + 13, + 17, + 3, + 27, + 5, + 14, + 5, + 9, + 7, + 9, + 14, + 11, + 13, + 5, + 23, + 10, + 16, + 15, + 8, + 22, + 7, + 62, + 21, + 18, + 7, + 8, + 13, + 22, + 26, + 18, + 9, + 7, + 22, + 4 + ], + "weighted_loads": [ + 0.12255729362368584, + 0.5089054591953754, + 1.627277597784996, + 1.2077214792370796, + 1.6402949299663305, + 0.09213621355593204, + 1.4804587280377746, + 1.2465481441468, + 1.058255948126316, + 1.1092233210802078, + 0.06625212728977203, + 0.9379824977368116, + 0.8789246939122677, + 0.1646881438791752, + 1.2214053440839052, + 0.13155600056052208, + 1.8394872061908245, + 0.36727349832654, + 0.6443436071276665, + 0.9034347329288721, + 1.4327430333942175, + 1.5916822254657745, + 0.7986743822693825, + 0.3000881224870682, + 1.1108062695711851, + 1.8954105246812105, + 0.35194506123661995, + 1.056471949443221, + 0.379611412063241, + 0.8995826877653599, + 0.6879291199147701, + 1.8528244476765394, + 0.11757600493729115, + 1.3600442465394735, + 0.42145536839962006, + 0.8912843111902475, + 0.20682024210691452, + 0.34289332665503025, + 0.31175358407199383, + 0.6392393838614225, + 0.6764292540028691, + 0.48761160112917423, + 0.8750095926225185, + 0.19585006311535835, + 1.9099563844501972, + 0.5145372841507196, + 0.7839352041482925, + 1.0456931106746197, + 0.3566288687288761, + 1.507726052775979, + 0.40935613214969635, + 3.274225426837802, + 1.3624126799404621, + 1.2459846436977386, + 0.8804610278457403, + 0.537221884354949, + 0.4769447185099125, + 1.3942424654960632, + 2.0371214728802443, + 1.0937965400516987, + 0.43821313604712486, + 0.3201575931161642, + 1.5226481836289167, + 0.22298342734575272 + ], + "unique_experts": 64, + "load_cv": 0.6488233306999206, + "normalized_load_entropy": 0.9558796039015394, + "max_load_share": 0.07029478458049887 + } + }, + "s0_x": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "eeb78dfef57cb6ccdbc9c4363b25a6d00a94712908fef4ad8c92a0a0730f615b", + "route_weight_sha256": "e09cc3fb863ba7d35f37be105193790ad8b479e1b53569415ec399795e5fc617", + "loads": [ + 2, + 3, + 13, + 14, + 4, + 0, + 12, + 20, + 15, + 12, + 0, + 5, + 5, + 3, + 5, + 0, + 15, + 3, + 13, + 9, + 15, + 23, + 12, + 4, + 7, + 13, + 6, + 14, + 5, + 8, + 9, + 17, + 1, + 28, + 5, + 13, + 3, + 3, + 5, + 6, + 10, + 4, + 3, + 3, + 23, + 9, + 16, + 5, + 7, + 20, + 2, + 64, + 16, + 8, + 3, + 9, + 13, + 20, + 15, + 17, + 5, + 0, + 13, + 1 + ], + "weighted_loads": [ + 0.06679828651249409, + 0.11425012722611427, + 1.3665930293500423, + 1.1462886556982994, + 0.13673215731978416, + 0.0, + 1.000620324164629, + 1.2068988345563412, + 1.0374902915209532, + 0.773224113509059, + 0.0, + 0.1822306476533413, + 0.19483206793665886, + 0.11260526068508625, + 0.3788556419312954, + 0.0, + 1.417072230949998, + 0.13255999982357025, + 0.5726469419896603, + 0.3132699877023697, + 1.0478770695626736, + 1.5246758088469505, + 0.4737342167645693, + 0.15583306178450584, + 0.29383016936481, + 1.9016124214977026, + 0.34271371364593506, + 0.9048771746456623, + 0.34395067766308784, + 0.7900082152336836, + 0.512161735445261, + 1.7909446489065886, + 0.027111278846859932, + 1.3654666561633348, + 0.41882069036364555, + 0.8093029409646988, + 0.1058901697397232, + 0.11076154746115208, + 0.24662607349455357, + 0.4982213042676449, + 0.5360682047903538, + 0.1347607970237732, + 0.11281901970505714, + 0.11108290404081345, + 2.003168039023876, + 0.47991354763507843, + 0.8016371466219425, + 0.3333519399166107, + 0.3044597748667002, + 1.4523261561989784, + 0.0768519677221775, + 3.3118000980466604, + 1.1611392386257648, + 0.44682365097105503, + 0.11316312476992607, + 0.5415228214114904, + 0.4844560269266367, + 1.2827104665338993, + 1.5164367370307446, + 1.083101313561201, + 0.24625000916421413, + 0.0, + 0.7953648380935192, + 0.03350439667701721 + ], + "unique_experts": 60, + "load_cv": 0.9494772565145645, + "normalized_load_entropy": 0.9137124486747147, + "max_load_share": 0.10062893081761007 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "8fe96020ba903f350ec33dd968012cfaf309d4002d64ff91912a3ac703897b35", + "route_weight_sha256": "8576bb12721964f36993bb7dd9ccd1e8310479ec3dff27becafca2a6b259a456", + "loads": [ + 3, + 6, + 15, + 14, + 9, + 3, + 23, + 20, + 15, + 17, + 0, + 6, + 15, + 4, + 11, + 0, + 17, + 3, + 13, + 13, + 15, + 23, + 19, + 10, + 15, + 13, + 6, + 16, + 5, + 12, + 14, + 17, + 1, + 28, + 5, + 14, + 3, + 7, + 6, + 7, + 14, + 6, + 13, + 4, + 24, + 9, + 16, + 10, + 8, + 20, + 2, + 64, + 16, + 13, + 9, + 9, + 13, + 20, + 24, + 18, + 7, + 3, + 20, + 1 + ], + "weighted_loads": [ + 0.10550707392394543, + 0.445352416485548, + 1.5791473928838968, + 1.1462886556982994, + 0.888470932841301, + 0.14385011978447437, + 1.4855905240401626, + 1.2068988345563412, + 1.0374902915209532, + 1.1287832893431187, + 0.0, + 0.21201013773679733, + 0.9155381508171558, + 0.15216904692351818, + 0.8786855861544609, + 0.0, + 1.5008792337030172, + 0.13255999982357025, + 0.5726469419896603, + 0.48489342629909515, + 1.0478770695626736, + 1.5246758088469505, + 0.761258527636528, + 0.38174764439463615, + 0.71568888053298, + 1.9016124214977026, + 0.34271371364593506, + 1.0208949595689774, + 0.34395067766308784, + 0.9492578450590372, + 0.7013429868966341, + 1.7909446489065886, + 0.027111278846859932, + 1.3654666561633348, + 0.41882069036364555, + 0.8671304956078529, + 0.1058901697397232, + 0.2770193535834551, + 0.2881151679903269, + 0.5329358838498592, + 0.705733691342175, + 0.26484090462327003, + 0.9216369017958641, + 0.1687067486345768, + 2.013881888240576, + 0.47991354763507843, + 0.8016371466219425, + 0.8044063001871109, + 0.3427524622529745, + 1.4523261561989784, + 0.0768519677221775, + 3.3118000980466604, + 1.1611392386257648, + 0.7513282690197229, + 0.9403478410094976, + 0.5415228214114904, + 0.4844560269266367, + 1.2827104665338993, + 1.8847584370523691, + 1.1278168968856335, + 0.42556766234338284, + 0.18156729638576508, + 1.3574675098061562, + 0.03350439667701721 + ], + "unique_experts": 62, + "load_cv": 0.7611800970488838, + "normalized_load_entropy": 0.9392090154239882, + "max_load_share": 0.08142493638676845 + } + }, + "s1_x": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "39fb0aa79a13b8f72c062b6b09b7c80167d3b7a399bdf3fb971ec14ab6f4a530", + "route_weight_sha256": "3c5e2e8836026f0ecb0e296bfc4b27bee1caaf2cab925eca86e3909bfe566649", + "loads": [ + 2, + 2, + 15, + 13, + 3, + 0, + 12, + 20, + 15, + 10, + 1, + 4, + 6, + 2, + 6, + 1, + 14, + 3, + 11, + 10, + 16, + 23, + 11, + 6, + 5, + 13, + 6, + 14, + 6, + 10, + 8, + 18, + 1, + 27, + 5, + 13, + 3, + 4, + 5, + 6, + 11, + 4, + 4, + 4, + 22, + 10, + 16, + 4, + 8, + 21, + 2, + 61, + 16, + 7, + 2, + 9, + 12, + 20, + 15, + 17, + 7, + 0, + 12, + 2 + ], + "weighted_loads": [ + 0.06495082750916481, + 0.08217039331793785, + 1.4301438499242067, + 1.1552968993782997, + 0.11331410333514214, + 0.0, + 0.9725099243223667, + 1.1971549708396196, + 1.047583932057023, + 0.714612752199173, + 0.03565646708011627, + 0.14815210364758968, + 0.24446393735706806, + 0.07586383819580078, + 0.40622415766119957, + 0.021886367350816727, + 1.370638344436884, + 0.13337913155555725, + 0.505626305937767, + 0.3316326607018709, + 1.0910115502774715, + 1.5252331234514713, + 0.43312979117035866, + 0.2053022515028715, + 0.23639729246497154, + 1.9146367032080889, + 0.3517749607563019, + 0.9148713424801826, + 0.3670439627021551, + 0.9002167601138353, + 0.46374686621129513, + 1.8454261757433414, + 0.02549959346652031, + 1.3289429228752851, + 0.4085749387741089, + 0.795368729159236, + 0.11684486456215382, + 0.1538948267698288, + 0.2474363036453724, + 0.4794557951390743, + 0.5880863554775715, + 0.15294495970010757, + 0.13877311162650585, + 0.1430729553103447, + 1.8711527101695538, + 0.5035261269658804, + 0.8030493780970573, + 0.28023068606853485, + 0.35138406977057457, + 1.470258528366685, + 0.07874971255660057, + 3.1606909949332476, + 1.1426088735461235, + 0.44234185107052326, + 0.0873669907450676, + 0.5468522906303406, + 0.43459679558873177, + 1.2923269383609295, + 1.4837425202131271, + 1.108325220644474, + 0.2961635459214449, + 0.0, + 0.7702431753277779, + 0.05898638255894184 + ], + "unique_experts": 62, + "load_cv": 0.9141591105900023, + "normalized_load_entropy": 0.9193425529531362, + "max_load_share": 0.0959119496855346 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "d3b65a8acf2a591edfb995b9389ca0fe04fcc15aadaa7ab6c8bfca889542dbdc", + "route_weight_sha256": "eef25ae3faa1ffcf9ac8b243c84e78d30fb27a1a48f56959c717be65c338bc3c", + "loads": [ + 4, + 9, + 17, + 13, + 15, + 3, + 24, + 20, + 15, + 16, + 2, + 12, + 20, + 2, + 18, + 3, + 18, + 8, + 12, + 16, + 20, + 24, + 20, + 10, + 15, + 13, + 6, + 16, + 7, + 12, + 12, + 18, + 4, + 27, + 5, + 13, + 5, + 6, + 6, + 8, + 15, + 13, + 15, + 5, + 23, + 10, + 16, + 15, + 9, + 22, + 7, + 61, + 19, + 17, + 6, + 9, + 14, + 22, + 26, + 19, + 9, + 10, + 22, + 4 + ], + "weighted_loads": [ + 0.12148543260991573, + 0.5891324877738953, + 1.6893120687454939, + 1.1552968993782997, + 1.5751868281513453, + 0.14034893549978733, + 1.5447685150429606, + 1.1971549708396196, + 1.047583932057023, + 1.056356344372034, + 0.1019085943698883, + 0.9089954476803541, + 1.0678573716431856, + 0.07586383819580078, + 1.3011880051344633, + 0.13233773410320282, + 1.7977315112948418, + 0.357992310076952, + 0.6054146215319633, + 0.625541502609849, + 1.426180636510253, + 1.5796535983681679, + 0.7907209973782301, + 0.35431470535695553, + 0.8968332130461931, + 1.9146367032080889, + 0.3517749607563019, + 1.0392743982374668, + 0.40644277073442936, + 0.9734897594898939, + 0.6087853815406561, + 1.8454261757433414, + 0.15266600996255875, + 1.3289429228752851, + 0.4085749387741089, + 0.795368729159236, + 0.19613798893988132, + 0.22164497151970863, + 0.2907218523323536, + 0.5843880791217089, + 0.7127202088013291, + 0.5825959257781506, + 1.088293505832553, + 0.18119067698717117, + 1.8818665593862534, + 0.5035261269658804, + 0.8030493780970573, + 1.0926791280508041, + 0.38568277657032013, + 1.513484327122569, + 0.4121457561850548, + 3.1606909949332476, + 1.2860839162021875, + 1.2052772101014853, + 0.8567178063094616, + 0.5468522906303406, + 0.5147812590003014, + 1.3805900104343891, + 2.0235876757651567, + 1.2062139175832272, + 0.38777258805930614, + 0.43698357604444027, + 1.578535333275795, + 0.22310169599950314 + ], + "unique_experts": 64, + "load_cv": 0.6375673696984512, + "normalized_load_entropy": 0.9574889783031489, + "max_load_share": 0.0691609977324263 + } + }, + "s0_period": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "312287d94ba7ceee24c24689b787e3f05ee05ca2f3a881ab90b8efaaeb9252df", + "route_weight_sha256": "dcfdbb0da7bb2b4434bd02914876f653f44746f81fb75d265d7482a2a8252263", + "loads": [ + 2, + 1, + 13, + 15, + 5, + 0, + 12, + 21, + 15, + 11, + 0, + 5, + 4, + 3, + 5, + 0, + 16, + 3, + 13, + 9, + 16, + 23, + 11, + 6, + 7, + 13, + 6, + 12, + 5, + 9, + 8, + 17, + 1, + 26, + 5, + 13, + 4, + 5, + 5, + 6, + 10, + 4, + 3, + 4, + 22, + 10, + 14, + 5, + 8, + 21, + 3, + 63, + 17, + 7, + 3, + 8, + 10, + 20, + 15, + 18, + 6, + 0, + 13, + 1 + ], + "weighted_loads": [ + 0.06358209624886513, + 0.03663429617881775, + 1.3432428166270256, + 1.1630032565444708, + 0.18375949561595917, + 0.0, + 0.9889124277979136, + 1.2215686459094286, + 1.0445749573409557, + 0.7982793655246496, + 0.0, + 0.18329682014882565, + 0.15870322287082672, + 0.10909896716475487, + 0.38114331290125847, + 0.0, + 1.4679064266383648, + 0.13937867805361748, + 0.5746432598680258, + 0.30881495028734207, + 1.080093115568161, + 1.513673521578312, + 0.4252477325499058, + 0.22287601418793201, + 0.29604440927505493, + 1.8847068939357996, + 0.3522387593984604, + 0.8316290844231844, + 0.3365580029785633, + 0.8149976544082165, + 0.4994977377355099, + 1.808031177148223, + 0.0279703289270401, + 1.327851790934801, + 0.421178026124835, + 0.8075740281492472, + 0.14069225080311298, + 0.17874457873404026, + 0.24936224520206451, + 0.4924851842224598, + 0.528716079890728, + 0.13511401042342186, + 0.10941470973193645, + 0.14962968230247498, + 1.9198567122220993, + 0.5108954161405563, + 0.7210119124501944, + 0.3270186074078083, + 0.33649994246661663, + 1.4654654487967491, + 0.10239645093679428, + 3.3295981511473656, + 1.1893058344721794, + 0.40276019647717476, + 0.10724116303026676, + 0.512523191049695, + 0.377984169870615, + 1.279694240540266, + 1.524888675659895, + 1.132784390822053, + 0.2677672654390335, + 0.0, + 0.8020093217492104, + 0.03286139667034149 + ], + "unique_experts": 60, + "load_cv": 0.932155251680339, + "normalized_load_entropy": 0.9163043618196356, + "max_load_share": 0.09905660377358491 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "5c90c73b68f8c6d48ae9959eba8c669cc9bf1718b49ab5567a2ff213b7172f7a", + "route_weight_sha256": "eb8a38c7aaa596ca9612721a529d5c001aa2943c6c49e52c2c1449c1c5abeb2d", + "loads": [ + 3, + 5, + 15, + 15, + 10, + 3, + 22, + 21, + 15, + 16, + 0, + 6, + 13, + 4, + 11, + 0, + 18, + 3, + 13, + 13, + 16, + 23, + 17, + 12, + 15, + 13, + 6, + 14, + 5, + 13, + 13, + 17, + 1, + 26, + 6, + 14, + 5, + 10, + 6, + 7, + 14, + 6, + 12, + 5, + 23, + 10, + 14, + 11, + 9, + 21, + 3, + 63, + 17, + 11, + 9, + 8, + 10, + 20, + 23, + 19, + 8, + 4, + 20, + 1 + ], + "weighted_loads": [ + 0.10229088366031647, + 0.3876738455146551, + 1.5590298380702734, + 1.1630032565444708, + 0.9989767707884312, + 0.13528886251151562, + 1.4143636235967278, + 1.2215686459094286, + 1.0445749573409557, + 1.1599237620830536, + 0.0, + 0.21307631023228168, + 0.754553310573101, + 0.1486627534031868, + 0.8893502317368984, + 0.0, + 1.5517134293913841, + 0.13937867805361748, + 0.5746432598680258, + 0.48590949177742004, + 1.080093115568161, + 1.513673521578312, + 0.6560585517436266, + 0.4487905967980623, + 0.716850595548749, + 1.8847068939357996, + 0.3522387593984604, + 0.9476882722228765, + 0.3365580029785633, + 0.9742472842335701, + 0.6892205569893122, + 1.808031177148223, + 0.0279703289270401, + 1.327851790934801, + 0.48683938197791576, + 0.8654015827924013, + 0.19448243640363216, + 0.38147267140448093, + 0.29085133969783783, + 0.521311542019248, + 0.6901942463591695, + 0.26671554893255234, + 0.7676226366311312, + 0.20725352689623833, + 1.930570561438799, + 0.5108954161405563, + 0.7210119124501944, + 0.8737041242420673, + 0.37479262985289097, + 1.4654654487967491, + 0.10239645093679428, + 3.3295981511473656, + 1.1893058344721794, + 0.7162090688943863, + 0.9344258792698383, + 0.512523191049695, + 0.377984169870615, + 1.279694240540266, + 1.8470892198383808, + 1.1782238576561213, + 0.43718715012073517, + 0.26744359731674194, + 1.3517743237316608, + 0.03286139667034149 + ], + "unique_experts": 62, + "load_cv": 0.7372595154235082, + "normalized_load_entropy": 0.9432568140553036, + "max_load_share": 0.08015267175572519 + } + }, + "s1_period": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "2b7f8fc97835afe18a75c9b15a3555c668c08ad5331a90babc49c363b6696a3d", + "route_weight_sha256": "af844570fa4ef37a2a302531611b58ac2dd1af2f807a030baa82b91a6d18bde8", + "loads": [ + 2, + 1, + 14, + 14, + 3, + 0, + 11, + 21, + 14, + 9, + 0, + 5, + 6, + 2, + 6, + 1, + 15, + 3, + 11, + 12, + 16, + 23, + 11, + 4, + 6, + 13, + 6, + 13, + 5, + 9, + 8, + 18, + 0, + 29, + 5, + 13, + 3, + 5, + 5, + 6, + 10, + 4, + 4, + 5, + 22, + 10, + 15, + 5, + 8, + 21, + 2, + 60, + 17, + 8, + 3, + 8, + 12, + 20, + 15, + 17, + 8, + 0, + 12, + 2 + ], + "weighted_loads": [ + 0.06588625721633434, + 0.040522072464227676, + 1.4195392709225416, + 1.1880709044635296, + 0.11659019812941551, + 0.0, + 0.9435665421187878, + 1.245522791519761, + 1.0087318383157253, + 0.6307936459779739, + 0.0, + 0.18146952241659164, + 0.23785658553242683, + 0.08120222389698029, + 0.4094381295144558, + 0.021432416513562202, + 1.3969067111611366, + 0.1382354237139225, + 0.4989597350358963, + 0.40300713665783405, + 1.0967124551534653, + 1.5335080809891224, + 0.43338337168097496, + 0.14933031797409058, + 0.25937472842633724, + 1.9055382497608662, + 0.3531833589076996, + 0.8544354028999805, + 0.33404253982007504, + 0.8875616975128651, + 0.4797359649091959, + 1.8572262823581696, + 0.0, + 1.402329595759511, + 0.4235295746475458, + 0.8107046484947205, + 0.1162067074328661, + 0.18363579735159874, + 0.23869038745760918, + 0.48364875465631485, + 0.5478254333138466, + 0.1527796946465969, + 0.14225500263273716, + 0.18041695468127728, + 1.8732384033501148, + 0.5138366520404816, + 0.7765896189957857, + 0.3162124790251255, + 0.3518810626119375, + 1.4464839175343513, + 0.07698192819952965, + 3.1778409648686647, + 1.1848730202764273, + 0.45791058614850044, + 0.1044264379888773, + 0.5126444566994905, + 0.4245098661631346, + 1.3042138740420341, + 1.48241650685668, + 1.1237642019987106, + 0.3055806662887335, + 0.0, + 0.779919546097517, + 0.058672426268458366 + ], + "unique_experts": 60, + "load_cv": 0.913812887366643, + "normalized_load_entropy": 0.9171938752177742, + "max_load_share": 0.09433962264150944 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "ff23261d904664f89c1ff34df855e1d2624d356db6c08ea61ea55616d2445d66", + "route_weight_sha256": "160a05eede3ba6183227a9a16ef162dc4a5f833df8ce9e359c2faae40812c704", + "loads": [ + 5, + 7, + 16, + 14, + 15, + 3, + 22, + 21, + 14, + 16, + 1, + 13, + 19, + 2, + 18, + 3, + 19, + 8, + 12, + 19, + 20, + 24, + 20, + 8, + 14, + 13, + 6, + 15, + 6, + 11, + 13, + 18, + 2, + 29, + 6, + 13, + 5, + 6, + 6, + 9, + 14, + 13, + 15, + 6, + 23, + 10, + 15, + 17, + 9, + 22, + 7, + 60, + 20, + 18, + 7, + 8, + 14, + 22, + 25, + 19, + 11, + 10, + 22, + 4 + ], + "weighted_loads": [ + 0.16256115958094597, + 0.4829951152205467, + 1.6775709930807352, + 1.1880709044635296, + 1.6307646427303553, + 0.14106940291821957, + 1.479676610790193, + 1.245522791519761, + 1.0087318383157253, + 1.005575593560934, + 0.06625212728977203, + 0.9423128664493561, + 0.9666301161050797, + 0.08120222389698029, + 1.2811944279819727, + 0.1318837832659483, + 1.8261455744504929, + 0.36284860223531723, + 0.5987480506300926, + 0.7360026855021715, + 1.4318815413862467, + 1.587928555905819, + 0.7883178070187569, + 0.2983427718281746, + 0.8272808268666267, + 1.9055382497608662, + 0.3531833589076996, + 0.9805682301521301, + 0.3734413478523493, + 0.9608346968889236, + 0.6585789751261473, + 1.8572262823581696, + 0.09011010080575943, + 1.402329595759511, + 0.48061676137149334, + 0.8107046484947205, + 0.1954998318105936, + 0.21305351331830025, + 0.2819759361445904, + 0.6328785847872496, + 0.6943200463429093, + 0.598762072622776, + 0.935695881024003, + 0.21853467635810375, + 1.8839522525668144, + 0.5138366520404816, + 0.7765896189957857, + 1.2243086285889149, + 0.3861797694116831, + 1.4897097162902355, + 0.41037797182798386, + 3.1778409648686647, + 1.3283480629324913, + 1.2463885210454464, + 0.8737772535532713, + 0.5126444566994905, + 0.5046943295747042, + 1.3924769461154938, + 1.9917550962418318, + 1.2167414240539074, + 0.4596413020044565, + 0.43835523165762424, + 1.5440325550734997, + 0.22278773970901966 + ], + "unique_experts": 64, + "load_cv": 0.636921854256399, + "normalized_load_entropy": 0.9565878112582266, + "max_load_share": 0.06802721088435375 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 106, + "ordered_topk_exact_tokens": 77, + "set_exact_tokens": 89, + "mean_set_jaccard": 0.9541778975741241, + "mean_token_weighted_tv": 0.01045321486890316, + "aggregate_load_tv": 0.018867924528301883 + }, + "system_bos": { + "tokens": 106, + "ordered_topk_exact_tokens": 68, + "set_exact_tokens": 84, + "mean_set_jaccard": 0.938679245283019, + "mean_token_weighted_tv": 0.014843375536279296, + "aggregate_load_tv": 0.02672955974842767 + }, + "system_x": { + "tokens": 106, + "ordered_topk_exact_tokens": 60, + "set_exact_tokens": 70, + "mean_set_jaccard": 0.9009433962264151, + "mean_token_weighted_tv": 0.019664557413461636, + "aggregate_load_tv": 0.03773584905660378 + }, + "system_period": { + "tokens": 106, + "ordered_topk_exact_tokens": 56, + "set_exact_tokens": 73, + "mean_set_jaccard": 0.9090296495956873, + "mean_token_weighted_tv": 0.01904809374783961, + "aggregate_load_tv": 0.03459119496855346 + }, + "bos_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 59, + "set_exact_tokens": 78, + "mean_set_jaccard": 0.9245283018867925, + "mean_token_weighted_tv": 0.0170702924249026, + "aggregate_load_tv": 0.02987421383647798 + }, + "bos_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 58, + "set_exact_tokens": 72, + "mean_set_jaccard": 0.9063342318059299, + "mean_token_weighted_tv": 0.019168544323447178, + "aggregate_load_tv": 0.026729559748427674 + }, + "x_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 54, + "set_exact_tokens": 73, + "mean_set_jaccard": 0.9090296495956873, + "mean_token_weighted_tv": 0.018149983058771434, + "aggregate_load_tv": 0.036163522012578615 + }, + "x_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 49, + "set_exact_tokens": 69, + "mean_set_jaccard": 0.8982479784366577, + "mean_token_weighted_tv": 0.021760528081290004, + "aggregate_load_tv": 0.03301886792452831 + }, + "period_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 51, + "set_exact_tokens": 76, + "mean_set_jaccard": 0.9191374663072778, + "mean_token_weighted_tv": 0.017924610340862342, + "aggregate_load_tv": 0.029874213836477988 + }, + "period_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 45, + "set_exact_tokens": 63, + "mean_set_jaccard": 0.8840970350404314, + "mean_token_weighted_tv": 0.0232401428621192, + "aggregate_load_tv": 0.034591194968553465 + } + } + }, + "layer_20": { + "layer": 20, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "6c3f1a4a50467e96816e924647cfe079079df5cd828b95f42e5cc718dec46a26", + "route_weight_sha256": "d658a805b179e837f15b50da38f457bd619e2725156f82f56b73e40fdb5d3137", + "loads": [ + 9, + 13, + 4, + 4, + 15, + 19, + 20, + 8, + 3, + 2, + 10, + 5, + 3, + 13, + 6, + 1, + 1, + 17, + 3, + 20, + 8, + 18, + 4, + 12, + 14, + 3, + 5, + 1, + 18, + 7, + 30, + 0, + 0, + 12, + 2, + 5, + 21, + 3, + 3, + 3, + 2, + 6, + 12, + 20, + 4, + 6, + 56, + 30, + 11, + 5, + 0, + 8, + 14, + 16, + 5, + 3, + 9, + 6, + 18, + 20, + 5, + 8, + 21, + 6 + ], + "weighted_loads": [ + 0.3836801405996084, + 0.5960327330976725, + 0.13837837427854538, + 0.145584337413311, + 0.5487233009189367, + 1.2490468434989452, + 1.9708814416080713, + 0.42039212211966515, + 0.09930658340454102, + 0.1562987957149744, + 0.5534305982291698, + 0.16803507879376411, + 0.509739100933075, + 1.5698324963450432, + 0.18764927797019482, + 0.03576904907822609, + 0.03288915380835533, + 1.1031919121742249, + 0.17169375158846378, + 1.1937086042016745, + 0.2681904975324869, + 0.8927742652595043, + 0.3571596331894398, + 0.7319884411990643, + 1.0634860657155514, + 0.11218030750751495, + 0.17601155675947666, + 0.04646219685673714, + 1.7439204454421997, + 0.21318337880074978, + 1.119807243347168, + 0.0, + 0.0, + 0.4539270494133234, + 0.07266579195857048, + 0.22331367246806622, + 2.030921310186386, + 0.09756922908127308, + 0.08337868005037308, + 0.09970558062195778, + 0.0829203836619854, + 0.2626734543591738, + 0.7656213454902172, + 1.4417044389992952, + 0.23315680399537086, + 0.3200017213821411, + 3.1857185531407595, + 1.6206759922206402, + 0.36892347782850266, + 0.16763169318437576, + 0.0, + 0.38632757589221, + 0.5689267851412296, + 0.8140505310148001, + 0.2745877355337143, + 0.1191011480987072, + 0.31753470562398434, + 0.22900984436273575, + 0.9713284112513065, + 0.9813624378293753, + 0.7191325798630714, + 0.2650705315172672, + 1.2379609141498804, + 0.20932387374341488 + ], + "unique_experts": 61, + "load_cv": 0.9355438401318618, + "normalized_load_entropy": 0.910915845685971, + "max_load_share": 0.0880503144654088 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "0d86e55895476dbcc572ed392e084ce62b36b9164237e0459055674b0b3e6e42", + "route_weight_sha256": "5238357ac9253f6f023a15ab0eb9806d4ae614001bd88e22fa1f72f518096aec", + "loads": [ + 9, + 15, + 4, + 12, + 23, + 23, + 24, + 14, + 3, + 2, + 10, + 6, + 5, + 14, + 6, + 4, + 4, + 17, + 13, + 21, + 13, + 18, + 11, + 12, + 14, + 9, + 6, + 1, + 18, + 9, + 30, + 0, + 0, + 13, + 3, + 5, + 24, + 5, + 5, + 4, + 4, + 8, + 14, + 22, + 16, + 6, + 56, + 30, + 13, + 5, + 8, + 8, + 15, + 24, + 5, + 6, + 9, + 12, + 18, + 20, + 18, + 12, + 22, + 6 + ], + "weighted_loads": [ + 0.3836801405996084, + 0.6407086551189423, + 0.13837837427854538, + 0.7404818013310432, + 0.9466882813721895, + 1.406091695651412, + 2.084487061947584, + 0.8223049305379391, + 0.09930658340454102, + 0.1562987957149744, + 0.5534305982291698, + 0.21060629189014435, + 0.5676251873373985, + 1.6208187118172646, + 0.18764927797019482, + 0.17366956174373627, + 0.1460942067205906, + 1.1031919121742249, + 1.0555304903537035, + 1.2526185605674982, + 0.4212864248547703, + 0.8927742652595043, + 0.7078925892710686, + 0.7319884411990643, + 1.0634860657155514, + 0.7558391653001308, + 0.1934576816856861, + 0.04646219685673714, + 1.7439204454421997, + 0.2789151482284069, + 1.119807243347168, + 0.0, + 0.0, + 0.4770288560539484, + 0.11709551885724068, + 0.22331367246806622, + 2.163119899109006, + 0.15508219227194786, + 1.402389831840992, + 0.1292266920208931, + 0.16816669330000877, + 0.3397859577089548, + 0.9686676450073719, + 1.4800183865008876, + 0.6523912064731121, + 0.3200017213821411, + 3.1857185531407595, + 1.6206759922206402, + 0.40563441428821534, + 0.16763169318437576, + 1.1756745129823685, + 0.38632757589221, + 0.607893094420433, + 1.4394291024655104, + 0.2745877355337143, + 0.5866982266306877, + 0.31753470562398434, + 0.4165533632040024, + 0.9713284112513065, + 0.9813624378293753, + 2.0399483423680067, + 0.4983102083206177, + 1.271981855854392, + 0.20932387374341488 + ], + "unique_experts": 62, + "load_cv": 0.7486928742903053, + "normalized_load_entropy": 0.9387350721814224, + "max_load_share": 0.07124681933842239 + } + }, + "s1_eos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "97b50ccf01f64fc4874f4799100c2970095f260171d899833e9d11e6ad2bf463", + "route_weight_sha256": "091da83c4ea6227df01bef6b71d725994359f4a7b8f07df25848e9f0726c2cff", + "loads": [ + 8, + 13, + 4, + 3, + 14, + 19, + 20, + 9, + 4, + 2, + 10, + 7, + 3, + 13, + 5, + 1, + 1, + 16, + 4, + 21, + 7, + 17, + 4, + 13, + 14, + 3, + 6, + 1, + 19, + 7, + 28, + 0, + 0, + 12, + 3, + 5, + 21, + 3, + 3, + 2, + 2, + 5, + 12, + 21, + 4, + 6, + 58, + 29, + 10, + 5, + 0, + 8, + 12, + 17, + 5, + 3, + 9, + 7, + 18, + 19, + 6, + 9, + 21, + 5 + ], + "weighted_loads": [ + 0.34800461307168007, + 0.5936350170522928, + 0.1399261374026537, + 0.12205862626433372, + 0.5125010497868061, + 1.2748594135046005, + 2.0019055791199207, + 0.44481061212718487, + 0.1356974057853222, + 0.15671133436262608, + 0.5625528134405613, + 0.23295140080153942, + 0.49899613857269287, + 1.5599395390599966, + 0.15014123171567917, + 0.04090045392513275, + 0.03201787546277046, + 1.0571095794439316, + 0.19575881771743298, + 1.2516359277069569, + 0.24393238686025143, + 0.8606856353580952, + 0.347602054476738, + 0.7572535835206509, + 1.0646220855414867, + 0.1087016798555851, + 0.20851163566112518, + 0.04584019258618355, + 1.7662964761257172, + 0.21302062086760998, + 1.0589079298079014, + 0.0, + 0.0, + 0.445318304002285, + 0.10177141427993774, + 0.2219333667308092, + 2.018470421433449, + 0.0962213110178709, + 0.0832015611231327, + 0.0676143690943718, + 0.08072765544056892, + 0.25633892975747585, + 0.7838907726109028, + 1.471002908423543, + 0.23803097754716873, + 0.3211229741573334, + 3.2433493714779615, + 1.5738085769116879, + 0.3491553273051977, + 0.16721632331609726, + 0.0, + 0.3718805592507124, + 0.5144103318452835, + 0.8485818058252335, + 0.27157289907336235, + 0.11830523982644081, + 0.32212502881884575, + 0.2566895801573992, + 0.9664016738533974, + 0.9540792554616928, + 0.7670901045203209, + 0.29410478472709656, + 1.2516665142029524, + 0.17167235724627972 + ], + "unique_experts": 61, + "load_cv": 0.940267348051329, + "normalized_load_entropy": 0.9114518351365545, + "max_load_share": 0.09119496855345911 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "a443cb56ed9680530bb8d7ade4d9685cd45e90603ecd44cdea54a9b1a0665e8c", + "route_weight_sha256": "2e27d0ee1e79660d4444b3a0962f289189a148fe1d7430a74a5fe7ea90514c75", + "loads": [ + 13, + 15, + 4, + 14, + 23, + 25, + 22, + 17, + 4, + 4, + 12, + 7, + 5, + 15, + 6, + 12, + 8, + 16, + 14, + 23, + 12, + 18, + 15, + 15, + 15, + 16, + 7, + 3, + 19, + 12, + 28, + 1, + 1, + 12, + 6, + 7, + 25, + 9, + 6, + 6, + 6, + 6, + 14, + 26, + 19, + 7, + 58, + 29, + 12, + 10, + 13, + 8, + 12, + 27, + 6, + 14, + 11, + 14, + 20, + 20, + 20, + 11, + 22, + 5 + ], + "weighted_loads": [ + 0.5798699762672186, + 0.637951985001564, + 0.1399261374026537, + 0.8794953711330891, + 0.9650704972445965, + 1.5057506300508976, + 2.070968883112073, + 1.007357407361269, + 0.1356974057853222, + 0.39229353703558445, + 0.6543648391962051, + 0.23295140080153942, + 0.5623743273317814, + 1.89359419234097, + 0.2108682543039322, + 0.6769276112318039, + 0.3965901881456375, + 1.0571095794439316, + 1.1885441895574331, + 1.3477864786982536, + 0.4018896669149399, + 0.897039134055376, + 0.9597973003983498, + 0.929216992110014, + 1.0845962837338448, + 1.136239182204008, + 0.22595776058733463, + 0.10657254420220852, + 1.7662964761257172, + 0.3726684544235468, + 1.0589079298079014, + 0.031783509999513626, + 0.04884977638721466, + 0.445318304002285, + 0.24888898059725761, + 0.39922397397458553, + 2.2047569695860147, + 0.31327310763299465, + 1.442513331770897, + 0.264201994985342, + 0.25503136217594147, + 0.309299373999238, + 0.9786683730781078, + 1.6570695834234357, + 1.1059652101248503, + 0.3941517025232315, + 3.2433493714779615, + 1.5738085769116879, + 0.3842994443839416, + 0.4806552678346634, + 1.7543159276247025, + 0.3718805592507124, + 0.5144103318452835, + 1.512092811986804, + 0.3001569751650095, + 1.2256633006036282, + 0.4063292369246483, + 0.7975587528198957, + 1.040771059691906, + 0.9820582363754511, + 2.2408503476763144, + 0.4181135930120945, + 1.3140113186091185, + 0.17167235724627972 + ], + "unique_experts": 64, + "load_cv": 0.6490768794607117, + "normalized_load_entropy": 0.9547516249284759, + "max_load_share": 0.06575963718820861 + } + }, + "s0_bos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "9e1481a43f5990fa891d58b42b89839602d2a317e6881006653a04756489ecec", + "route_weight_sha256": "e2e8a510a773821ba2791cd4a5a81fb68f90076802101990a5a506b8a04bbf51", + "loads": [ + 10, + 14, + 3, + 3, + 13, + 18, + 20, + 7, + 4, + 2, + 10, + 6, + 3, + 13, + 4, + 1, + 1, + 17, + 4, + 21, + 6, + 17, + 4, + 13, + 14, + 5, + 8, + 0, + 20, + 3, + 26, + 0, + 1, + 11, + 5, + 5, + 20, + 2, + 2, + 3, + 3, + 6, + 12, + 20, + 4, + 6, + 59, + 32, + 10, + 5, + 0, + 9, + 14, + 16, + 5, + 5, + 8, + 6, + 17, + 20, + 6, + 8, + 20, + 6 + ], + "weighted_loads": [ + 0.4269222021102905, + 0.6191753540188074, + 0.10445233806967735, + 0.1164909154176712, + 0.4820384494960308, + 1.2168205883353949, + 1.991246361285448, + 0.38638032227754593, + 0.12775330431759357, + 0.15867457166314125, + 0.5667191036045551, + 0.20906530693173409, + 0.48015690594911575, + 1.5824478901922703, + 0.1253842506557703, + 0.03881518915295601, + 0.03406341373920441, + 1.1092703640460968, + 0.19923105090856552, + 1.3128098994493484, + 0.2077900394797325, + 0.8769491761922836, + 0.35552046820521355, + 0.7808804530650377, + 1.0736193619668484, + 0.1654472816735506, + 0.25483197905123234, + 0.0, + 1.8265505395829678, + 0.10468458198010921, + 0.9883724078536034, + 0.0, + 0.027167366817593575, + 0.41760194674134254, + 0.16216593235731125, + 0.22350443713366985, + 2.061628010123968, + 0.07334604486823082, + 0.05354991741478443, + 0.1012125313282013, + 0.11296587809920311, + 0.2591697722673416, + 0.7978464625775814, + 1.4557188898324966, + 0.2288980819284916, + 0.3267051726579666, + 3.3569218534976244, + 1.6606667041778564, + 0.34095749258995056, + 0.16888484358787537, + 0.0, + 0.42317664436995983, + 0.5856460276991129, + 0.8088373132050037, + 0.2664756067097187, + 0.19069992192089558, + 0.2816794030368328, + 0.2344888038933277, + 0.9313726797699928, + 1.0275105275213718, + 0.7138689942657948, + 0.2642555981874466, + 1.2284987401217222, + 0.22934598848223686 + ], + "unique_experts": 61, + "load_cv": 0.9481431934096507, + "normalized_load_entropy": 0.911274448645384, + "max_load_share": 0.09276729559748427 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "4651c40ade68d64ed9c9d7389eab51865c739720575181a54482c6d29b73c365", + "route_weight_sha256": "d1ef29bffd4de0e227edb6c792eb71648261b9034a018e476fa3e8746006529f", + "loads": [ + 10, + 15, + 3, + 11, + 21, + 22, + 24, + 12, + 4, + 2, + 10, + 7, + 5, + 14, + 4, + 5, + 4, + 17, + 14, + 22, + 10, + 17, + 13, + 13, + 14, + 12, + 11, + 0, + 20, + 5, + 27, + 1, + 1, + 12, + 6, + 5, + 23, + 4, + 3, + 4, + 5, + 8, + 14, + 22, + 16, + 6, + 60, + 33, + 11, + 5, + 8, + 9, + 15, + 23, + 5, + 8, + 8, + 11, + 17, + 20, + 18, + 11, + 20, + 6 + ], + "weighted_loads": [ + 0.4269222021102905, + 0.64329001493752, + 0.10445233806967735, + 0.7113883793354034, + 0.8800034299492836, + 1.3883830532431602, + 2.104851981624961, + 0.7246359437704086, + 0.12775330431759357, + 0.15867457166314125, + 0.5667191036045551, + 0.9070173390209675, + 0.5380429923534393, + 1.6363070495426655, + 0.1253842506557703, + 0.26333313807845116, + 0.13267302885651588, + 1.1092703640460968, + 1.0830677896738052, + 1.366136372089386, + 0.3617339916527271, + 0.8769491761922836, + 0.8068186864256859, + 0.7808804530650377, + 1.0736193619668484, + 0.8533379565924406, + 0.3555988762527704, + 0.0, + 1.8265505395829678, + 0.17041635140776634, + 1.0270861461758614, + 0.011960592120885849, + 0.027167366817593575, + 0.44070375338196754, + 0.20497947558760643, + 0.22350443713366985, + 2.204408621415496, + 0.1308590080589056, + 0.41824922151863575, + 0.12981083802878857, + 0.18992702662944794, + 0.3144384101033211, + 0.996038231998682, + 1.5728982016444206, + 0.64052421040833, + 0.3267051726579666, + 3.4940895307809114, + 1.67178229149431, + 0.3760291039943695, + 0.16888484358787537, + 1.191018771380186, + 0.42317664436995983, + 0.6271752882748842, + 1.3448758535087109, + 0.2664756067097187, + 0.6477333586663008, + 0.2816794030368328, + 0.38431721925735474, + 0.9313726797699928, + 1.0275105275213718, + 2.027662670239806, + 0.4643736071884632, + 1.2284987401217222, + 0.22934598848223686 + ], + "unique_experts": 63, + "load_cv": 0.7630830714997835, + "normalized_load_entropy": 0.939391201513075, + "max_load_share": 0.07633587786259542 + } + }, + "s1_bos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "9a1082dd6a5953616dd693616ced520f935d212308c6a834543b29a5f37bf089", + "route_weight_sha256": "15d33c98c6d8cd311f54764595cf107b95a2ec70467bc3396effabd64b47c39b", + "loads": [ + 7, + 14, + 3, + 3, + 12, + 20, + 20, + 8, + 5, + 2, + 9, + 9, + 3, + 13, + 3, + 1, + 2, + 17, + 3, + 20, + 7, + 18, + 4, + 14, + 14, + 4, + 11, + 0, + 20, + 4, + 28, + 1, + 1, + 11, + 5, + 5, + 21, + 3, + 3, + 2, + 3, + 6, + 12, + 18, + 4, + 6, + 56, + 31, + 7, + 4, + 0, + 11, + 14, + 16, + 5, + 3, + 9, + 6, + 17, + 21, + 5, + 8, + 19, + 5 + ], + "weighted_loads": [ + 0.3292253464460373, + 0.6347652189433575, + 0.10140948370099068, + 0.11388716846704483, + 0.447505671530962, + 1.337486632168293, + 2.001825388520956, + 0.39821422658860683, + 0.15820332244038582, + 0.16010856069624424, + 0.5324860438704491, + 0.30923585779964924, + 0.4618055745959282, + 1.570596620440483, + 0.09703133255243301, + 0.053258657455444336, + 0.05887812562286854, + 1.090899258852005, + 0.1662131380289793, + 1.2561215907335281, + 0.23931296356022358, + 0.8933871984481812, + 0.35543326288461685, + 0.801154762506485, + 1.0764933973550797, + 0.13106725178658962, + 0.36533438600599766, + 0.0, + 1.8317977227270603, + 0.12091121822595596, + 1.0299732349812984, + 0.026539500802755356, + 0.02769242413341999, + 0.41187727078795433, + 0.16067108511924744, + 0.21808107569813728, + 1.9549671709537506, + 0.10102839209139347, + 0.07971356995403767, + 0.06760598719120026, + 0.11434083431959152, + 0.2634014431387186, + 0.7899519428610802, + 1.37052808329463, + 0.2310006357729435, + 0.32490185275673866, + 3.2613895758986473, + 1.6453487928956747, + 0.24717592261731625, + 0.13525008410215378, + 0.0, + 0.4726101364940405, + 0.5787993632256985, + 0.8183458521962166, + 0.25595684722065926, + 0.12355964630842209, + 0.3324855137616396, + 0.2392813004553318, + 0.9296337235718966, + 1.0412919707596302, + 0.7074060142040253, + 0.2660922724753618, + 1.1507893037050962, + 0.18398230336606503 + ], + "unique_experts": 62, + "load_cv": 0.9279021143248046, + "normalized_load_entropy": 0.9136585174381119, + "max_load_share": 0.0880503144654088 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "5d396952e62db2eff84d5a7eca509197c7fb464b60a2482c4ea49c53782e4593", + "route_weight_sha256": "cec0269b52f93388e462092dbdf4a2cf4d6819fdb8f75ea4680e1514a361438f", + "loads": [ + 12, + 15, + 3, + 14, + 21, + 27, + 22, + 16, + 5, + 4, + 11, + 9, + 5, + 16, + 4, + 13, + 8, + 17, + 13, + 22, + 12, + 19, + 16, + 16, + 15, + 17, + 14, + 2, + 20, + 8, + 28, + 2, + 2, + 11, + 7, + 7, + 25, + 9, + 5, + 7, + 8, + 8, + 14, + 23, + 19, + 7, + 56, + 31, + 7, + 9, + 13, + 11, + 15, + 27, + 6, + 14, + 10, + 13, + 18, + 22, + 17, + 10, + 20, + 5 + ], + "weighted_loads": [ + 0.5634282361716032, + 0.6588798798620701, + 0.10140948370099068, + 0.8713239133358002, + 0.8967431001365185, + 1.6323695816099644, + 2.0708886925131083, + 0.9408844001591206, + 0.15820332244038582, + 0.3956907633692026, + 0.6242980696260929, + 0.30923585779964924, + 0.5251837633550167, + 1.9372890833765268, + 0.15775835514068604, + 0.7815737277269363, + 0.3859774488955736, + 1.090899258852005, + 1.1589985098689795, + 1.3476826548576355, + 0.42068600095808506, + 0.929740697145462, + 1.0280301310122013, + 0.9731181710958481, + 1.0964675955474377, + 1.1233196873217821, + 0.4717239923775196, + 0.06073235161602497, + 1.8317977227270603, + 0.2308221459388733, + 1.0299732349812984, + 0.05832301080226898, + 0.07654220052063465, + 0.41187727078795433, + 0.23738977685570717, + 0.3953716829419136, + 2.1476576421409845, + 0.3297802824527025, + 0.48863756470382214, + 0.3225480653345585, + 0.3268497548997402, + 0.3617882300168276, + 0.9805195853114128, + 1.6379482354968786, + 1.1079282946884632, + 0.3979305811226368, + 3.2613895758986473, + 1.6453487928956747, + 0.24717592261731625, + 0.461115337908268, + 1.8338892571628094, + 0.4726101364940405, + 0.6226292997598648, + 1.49050616286695, + 0.2845409233123064, + 1.218984842300415, + 0.3774456735700369, + 0.7801504731178284, + 0.9648097176104784, + 1.0692709516733885, + 2.1366448383778334, + 0.3887991849333048, + 1.2131341081112623, + 0.18398230336606503 + ], + "unique_experts": 64, + "load_cv": 0.6340737792562671, + "normalized_load_entropy": 0.9566773730320619, + "max_load_share": 0.06349206349206349 + } + }, + "s0_x": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "51f6d82fe235c90563ef11217a47d43503b3fb4a00b750d2c77f278822d8798b", + "route_weight_sha256": "bcee1e5099bba1c370b77412be8f4168c58a7f382c3c05d3b36357e5c17d44d7", + "loads": [ + 9, + 12, + 5, + 3, + 14, + 20, + 20, + 6, + 4, + 2, + 10, + 6, + 3, + 14, + 4, + 1, + 1, + 17, + 3, + 21, + 8, + 18, + 4, + 13, + 14, + 4, + 8, + 1, + 20, + 6, + 29, + 0, + 0, + 11, + 3, + 5, + 20, + 3, + 1, + 3, + 2, + 5, + 12, + 19, + 4, + 6, + 59, + 32, + 11, + 4, + 0, + 8, + 12, + 15, + 5, + 5, + 8, + 8, + 16, + 20, + 6, + 6, + 21, + 6 + ], + "weighted_loads": [ + 0.39247806556522846, + 0.5535428579896688, + 0.15909529849886894, + 0.11491327360272408, + 0.5277209747582674, + 1.3325220681726933, + 1.9753159638494253, + 0.36152519285678864, + 0.12943439930677414, + 0.15650968626141548, + 0.5453316867351532, + 0.19925690442323685, + 0.4641479328274727, + 1.6042050085961819, + 0.1286823358386755, + 0.04416121169924736, + 0.032640669494867325, + 1.112773172557354, + 0.1809132657945156, + 1.3107602801173925, + 0.25789863988757133, + 0.8952448107302189, + 0.3576459102332592, + 0.7699424624443054, + 1.0764475464820862, + 0.13466333970427513, + 0.236033346503973, + 0.04656105116009712, + 1.8032477479428053, + 0.19123515859246254, + 1.0955379959195852, + 0.0, + 0.0, + 0.4153561368584633, + 0.09901097789406776, + 0.21791600063443184, + 2.0188991464674473, + 0.10418920964002609, + 0.0243923868983984, + 0.0997721292078495, + 0.07932819798588753, + 0.20772991329431534, + 0.7823712565004826, + 1.4070146717131138, + 0.2294515110552311, + 0.32332926988601685, + 3.374279761686921, + 1.6718152929097414, + 0.36863161623477936, + 0.13796772435307503, + 0.0, + 0.3766275495290756, + 0.518541568890214, + 0.777036240324378, + 0.2634534277021885, + 0.1952764317393303, + 0.2784064207226038, + 0.30653417110443115, + 0.8871715683490038, + 0.9918115362524986, + 0.7348712030798197, + 0.20536432787775993, + 1.2391474675387144, + 0.23224378935992718 + ], + "unique_experts": 61, + "load_cv": 0.960742003239216, + "normalized_load_entropy": 0.9089180299926731, + "max_load_share": 0.09276729559748427 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "0977b932d2328c6b0990a35de6a55a6da0dc914015080b312c3d139a649ee995", + "route_weight_sha256": "4b4c6c25bb7b0e22f1783c72a25ffddcddeb7f8989c3251c99b88fc518ac3a2b", + "loads": [ + 9, + 14, + 5, + 11, + 24, + 24, + 25, + 12, + 4, + 2, + 10, + 6, + 5, + 16, + 4, + 3, + 4, + 17, + 14, + 22, + 12, + 18, + 11, + 13, + 14, + 11, + 9, + 1, + 20, + 10, + 29, + 0, + 0, + 12, + 4, + 5, + 24, + 5, + 2, + 4, + 3, + 6, + 14, + 20, + 17, + 6, + 59, + 32, + 12, + 5, + 8, + 8, + 12, + 22, + 5, + 9, + 8, + 14, + 16, + 20, + 19, + 9, + 21, + 6 + ], + "weighted_loads": [ + 0.39247806556522846, + 0.6148929987102747, + 0.15909529849886894, + 0.7098107375204563, + 1.1013305950909853, + 1.4741214830428362, + 2.126564607024193, + 0.7320884838700294, + 0.12943439930677414, + 0.15650968626141548, + 0.5453316867351532, + 0.19925690442323685, + 0.5220340192317963, + 1.6847444362938404, + 0.1286823358386755, + 0.13838958367705345, + 0.13670655339956284, + 1.112773172557354, + 1.1634345836937428, + 1.3649846967309713, + 0.4077559523284435, + 0.8952448107302189, + 0.7139553315937519, + 0.7699424624443054, + 1.0764475464820862, + 0.7664431147277355, + 0.25347947143018246, + 0.04656105116009712, + 1.8032477479428053, + 0.3236872684210539, + 1.0955379959195852, + 0.0, + 0.0, + 0.4384579434990883, + 0.1337692029774189, + 0.21791600063443184, + 2.1786067206412554, + 0.16170217283070087, + 0.3890916910022497, + 0.1406557746231556, + 0.11775101721286774, + 0.24995852261781693, + 0.9792168252170086, + 1.4436218030750751, + 0.6878452766686678, + 0.32332926988601685, + 3.374279761686921, + 1.6718152929097414, + 0.4037032276391983, + 0.17763836681842804, + 1.2356698364019394, + 0.3766275495290756, + 0.518541568890214, + 1.3437851686030626, + 0.2634534277021885, + 0.7310483120381832, + 0.2784064207226038, + 0.5097403973340988, + 0.8871715683490038, + 0.9918115362524986, + 2.2425935715436935, + 0.40932855010032654, + 1.2391474675387144, + 0.23224378935992718 + ], + "unique_experts": 62, + "load_cv": 0.773733569479971, + "normalized_load_entropy": 0.9359044582010803, + "max_load_share": 0.07506361323155217 + } + }, + "s1_x": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "61bc87f46c555fb4d93f16f7101e7d50bd5238d7cc2bdcd991e18f9325374d89", + "route_weight_sha256": "0a18c341ed2e627e659d11b7493c38469d0e97806c442830e93f9478c19df5ce", + "loads": [ + 7, + 12, + 2, + 4, + 17, + 19, + 20, + 6, + 3, + 2, + 10, + 8, + 4, + 13, + 5, + 1, + 2, + 17, + 4, + 20, + 7, + 18, + 4, + 14, + 14, + 3, + 9, + 0, + 19, + 4, + 30, + 0, + 1, + 9, + 5, + 4, + 19, + 3, + 2, + 2, + 3, + 6, + 12, + 19, + 6, + 6, + 58, + 32, + 9, + 4, + 0, + 10, + 14, + 13, + 5, + 5, + 8, + 7, + 17, + 21, + 5, + 8, + 17, + 8 + ], + "weighted_loads": [ + 0.32787808030843735, + 0.5538746975362301, + 0.0644483957439661, + 0.1544644981622696, + 0.6552547961473465, + 1.2983652278780937, + 2.0064961574971676, + 0.3658000025898218, + 0.10412686690688133, + 0.1604948230087757, + 0.5677108317613602, + 0.273574635386467, + 0.46028604730963707, + 1.5865594986826181, + 0.15125984326004982, + 0.0474623367190361, + 0.057938652113080025, + 1.0982689335942268, + 0.1926271989941597, + 1.2759726718068123, + 0.23402822390198708, + 0.8984367400407791, + 0.34540339186787605, + 0.7845841478556395, + 1.0554709285497665, + 0.10668468475341797, + 0.28726131096482277, + 0.0, + 1.7746240962296724, + 0.12828459404408932, + 1.1141778528690338, + 0.0, + 0.027601873502135277, + 0.3616815321147442, + 0.15927217714488506, + 0.19633875228464603, + 1.9141566716134548, + 0.10516370832920074, + 0.05506864935159683, + 0.06531594693660736, + 0.11210358701646328, + 0.26149473525583744, + 0.7734509035944939, + 1.382076809182763, + 0.306617371737957, + 0.3299890048801899, + 3.283798089250922, + 1.6629420462995768, + 0.30334202758967876, + 0.13569911196827888, + 0.0, + 0.4233777988702059, + 0.5934514924883842, + 0.7163426652550697, + 0.25538530573248863, + 0.19388061203062534, + 0.3109525628387928, + 0.2661246992647648, + 0.91077078320086, + 1.0267343800514936, + 0.7513583973050117, + 0.2535060402005911, + 1.0824588909745216, + 0.2794519867748022 + ], + "unique_experts": 61, + "load_cv": 0.9439620944414331, + "normalized_load_entropy": 0.9121625413876335, + "max_load_share": 0.09119496855345911 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "f7405b71c583f899782f6b5e0ef6fbe6fdea7aff7a2203d437d000a1108ac90d", + "route_weight_sha256": "a9335fb7a30aa0227626b6deeca1f6bce28172eb290349fdb1ca93ca37d2f1fc", + "loads": [ + 11, + 13, + 2, + 16, + 28, + 26, + 23, + 14, + 3, + 4, + 12, + 8, + 6, + 15, + 6, + 14, + 9, + 17, + 15, + 22, + 11, + 19, + 15, + 16, + 16, + 17, + 10, + 3, + 19, + 8, + 30, + 2, + 2, + 9, + 7, + 6, + 23, + 9, + 4, + 6, + 6, + 7, + 14, + 24, + 20, + 7, + 58, + 32, + 9, + 8, + 13, + 10, + 14, + 23, + 6, + 16, + 9, + 15, + 18, + 22, + 19, + 10, + 18, + 8 + ], + "weighted_loads": [ + 0.5243224259465933, + 0.5779893584549427, + 0.0644483957439661, + 0.9485848546028137, + 1.2921566627919674, + 1.5745494924485683, + 2.1145949568599463, + 0.8844284303486347, + 0.10412686690688133, + 0.3960770256817341, + 0.659522857517004, + 0.273574635386467, + 0.5236642360687256, + 1.9179393146187067, + 0.21198686584830284, + 0.7663759626448154, + 0.5436722412705421, + 1.0982689335942268, + 1.2953082993626595, + 1.3697486594319344, + 0.4017397053539753, + 0.93479023873806, + 0.9811049439013004, + 0.9565475564450026, + 1.1140113770961761, + 1.0740705616772175, + 0.3047074358910322, + 0.09458570368587971, + 1.7746240962296724, + 0.23819552175700665, + 1.1141778528690338, + 0.06365732848644257, + 0.07645164988934994, + 0.3616815321147442, + 0.2273098435252905, + 0.37362935952842236, + 2.093276670202613, + 0.331100482493639, + 0.4639926441013813, + 0.2619035728275776, + 0.25061683915555477, + 0.3144551794975996, + 0.9521913751959801, + 1.6072204560041428, + 1.1596484426409006, + 0.40301773324608803, + 3.283798089250922, + 1.6629420462995768, + 0.30334202758967876, + 0.3756384290754795, + 1.7780558802187443, + 0.4233777988702059, + 0.5934514924883842, + 1.2502786424010992, + 0.2839693818241358, + 1.3249907959252596, + 0.3559127226471901, + 0.8520866669714451, + 0.9459467772394419, + 1.054713360965252, + 2.3129964862018824, + 0.4160687495023012, + 1.1448036953806877, + 0.2794519867748022 + ], + "unique_experts": 64, + "load_cv": 0.6572639710365613, + "normalized_load_entropy": 0.9541625999085309, + "max_load_share": 0.06575963718820861 + } + }, + "s0_period": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "98bd658dff460d6c1fbd43bf6e82ccc8a5a7b2dbef7ff9fca8197f1042ba37ad", + "route_weight_sha256": "a05682e2e4288e59a498cffb1c84d5eb4d496b801fca7afae45f0949a83cd9a7", + "loads": [ + 9, + 14, + 4, + 3, + 12, + 20, + 21, + 8, + 5, + 2, + 10, + 7, + 3, + 14, + 4, + 2, + 1, + 17, + 4, + 21, + 6, + 18, + 4, + 13, + 14, + 4, + 5, + 1, + 20, + 7, + 26, + 0, + 1, + 12, + 4, + 5, + 20, + 3, + 1, + 2, + 2, + 6, + 12, + 19, + 5, + 6, + 58, + 30, + 10, + 6, + 0, + 9, + 14, + 14, + 5, + 6, + 8, + 7, + 17, + 20, + 5, + 6, + 19, + 5 + ], + "weighted_loads": [ + 0.39869704470038414, + 0.6135482210665941, + 0.13248439319431782, + 0.12049108371138573, + 0.437824759632349, + 1.2882128730416298, + 2.0202397741377354, + 0.4415227472782135, + 0.16059870459139347, + 0.1579401958733797, + 0.5499989148229361, + 0.2314067017287016, + 0.4565560072660446, + 1.6044344957917929, + 0.12820772267878056, + 0.07761238142848015, + 0.03123394213616848, + 1.1014138124883175, + 0.19464453123509884, + 1.30576347745955, + 0.2097571026533842, + 0.896975927054882, + 0.3528597243130207, + 0.7653199378401041, + 1.0542252771556377, + 0.13111023232340813, + 0.16119654662907124, + 0.04301469773054123, + 1.816213894635439, + 0.21203405037522316, + 0.9917739555239677, + 0.0, + 0.026249468326568604, + 0.443846283480525, + 0.1266219113022089, + 0.21973492950201035, + 2.0282708909362555, + 0.105876624584198, + 0.023611867800354958, + 0.06797175854444504, + 0.07863643392920494, + 0.23961961641907692, + 0.7863439358770847, + 1.41844941675663, + 0.2597696837037802, + 0.3200499303638935, + 3.3316246271133423, + 1.6021062284708023, + 0.3457948751747608, + 0.18737909756600857, + 0.0, + 0.40889466367661953, + 0.5862064175307751, + 0.7295279186218977, + 0.2666463069617748, + 0.22116347774863243, + 0.27746975235641, + 0.2618900127708912, + 0.9216407313942909, + 0.9980559553951025, + 0.701076328754425, + 0.2062208503484726, + 1.1752424947917461, + 0.19765220768749714 + ], + "unique_experts": 62, + "load_cv": 0.9309663318211533, + "normalized_load_entropy": 0.9144144726861227, + "max_load_share": 0.09119496855345911 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "adcff45813d545e2f28e1bd53b4994bb635afa9e3bb50befc589c90925f5bb3d", + "route_weight_sha256": "df866e0da140adef65e99a4b6dd7ec45e0eccda33cd66f4e337048ae5af87446", + "loads": [ + 9, + 16, + 4, + 11, + 22, + 23, + 26, + 14, + 5, + 2, + 10, + 7, + 6, + 15, + 4, + 6, + 4, + 17, + 14, + 22, + 11, + 18, + 11, + 13, + 14, + 12, + 6, + 1, + 20, + 10, + 26, + 0, + 1, + 13, + 5, + 5, + 23, + 5, + 2, + 4, + 4, + 7, + 14, + 20, + 18, + 6, + 58, + 30, + 11, + 7, + 9, + 9, + 14, + 20, + 5, + 9, + 8, + 12, + 17, + 20, + 17, + 10, + 19, + 5 + ], + "weighted_loads": [ + 0.39869704470038414, + 0.6803391817957163, + 0.13248439319431782, + 0.715388547629118, + 0.9213986545801163, + 1.39734704233706, + 2.19400498457253, + 0.9491258859634399, + 0.16059870459139347, + 0.1579401958733797, + 0.5499989148229361, + 0.2314067017287016, + 0.5575976558029652, + 1.6542113814502954, + 0.12820772267878056, + 0.24229858443140984, + 0.1348232589662075, + 1.1014138124883175, + 1.0784812700003386, + 1.360729055479169, + 0.4100628551095724, + 0.896975927054882, + 0.7130755223333836, + 0.7653199378401041, + 1.0542252771556377, + 0.8478012792766094, + 0.17864267155528069, + 0.04301469773054123, + 1.816213894635439, + 0.3124511893838644, + 0.9917739555239677, + 0.0, + 0.026249468326568604, + 0.46694809012115, + 0.16079513914883137, + 0.21973492950201035, + 2.1601773351430893, + 0.16338958777487278, + 0.3883111719042063, + 0.15827316790819168, + 0.17653532698750496, + 0.2818482257425785, + 0.9823466651141644, + 1.4550565481185913, + 0.7333605624735355, + 0.3200499303638935, + 3.3316246271133423, + 1.6021062284708023, + 0.38086648657917976, + 0.24678403325378895, + 1.212629720568657, + 0.40889466367661953, + 0.5862064175307751, + 1.224543610587716, + 0.2666463069617748, + 0.7182425633072853, + 0.27746975235641, + 0.4117184281349182, + 0.9216407313942909, + 0.9980559553951025, + 2.016523474827409, + 0.466956552118063, + 1.1752424947917461, + 0.19765220768749714 + ], + "unique_experts": 63, + "load_cv": 0.7378213507453583, + "normalized_load_entropy": 0.9421769806684992, + "max_load_share": 0.0737913486005089 + } + }, + "s1_period": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "78a57f47b0aea81b9152249ae6d169b918b765f800cab1fff60513ff0e053493", + "route_weight_sha256": "6a0eccc39565c56ff43b2409badf2533b41ab4b519e97db8956113d7f43738bc", + "loads": [ + 7, + 14, + 4, + 3, + 16, + 19, + 20, + 5, + 4, + 2, + 10, + 7, + 4, + 14, + 5, + 1, + 1, + 18, + 4, + 21, + 7, + 18, + 4, + 12, + 14, + 4, + 6, + 0, + 20, + 2, + 32, + 0, + 1, + 10, + 5, + 5, + 19, + 4, + 2, + 2, + 3, + 6, + 12, + 19, + 6, + 6, + 58, + 31, + 9, + 6, + 1, + 8, + 14, + 13, + 5, + 5, + 8, + 7, + 15, + 21, + 6, + 7, + 18, + 6 + ], + "weighted_loads": [ + 0.3281952776014805, + 0.6110566854476929, + 0.12769412249326706, + 0.12282247468829155, + 0.6091567352414131, + 1.3110957890748978, + 2.0252757277339697, + 0.3045266531407833, + 0.13966844975948334, + 0.16094272769987583, + 0.5909093171358109, + 0.25330778397619724, + 0.47515153512358665, + 1.6032746583223343, + 0.15140276215970516, + 0.05334428697824478, + 0.02869657799601555, + 1.1326867956668139, + 0.19269540905952454, + 1.316220736131072, + 0.23973426409065723, + 0.9073729068040848, + 0.34721604362130165, + 0.7377045080065727, + 1.0468834564089775, + 0.13254455849528313, + 0.18320012465119362, + 0.0, + 1.8101975284516811, + 0.07133937440812588, + 1.1805566847324371, + 0.0, + 0.02779742144048214, + 0.3872923031449318, + 0.1578693799674511, + 0.21394271962344646, + 1.9099752102047205, + 0.14519067481160164, + 0.055352600291371346, + 0.06591057404875755, + 0.11435532383620739, + 0.25881517492234707, + 0.7780454270541668, + 1.3904109243303537, + 0.2982994858175516, + 0.3220277391374111, + 3.3198219817131758, + 1.6235710214823484, + 0.30035911314189434, + 0.1960452552884817, + 0.03173283860087395, + 0.3733780588954687, + 0.5724143330007792, + 0.7204598374664783, + 0.26065272465348244, + 0.19233347848057747, + 0.286039836704731, + 0.26553409546613693, + 0.8422030806541443, + 1.0346715301275253, + 0.7582657225430012, + 0.22334102354943752, + 1.129388315603137, + 0.20597802102565765 + ], + "unique_experts": 62, + "load_cv": 0.9491439165274571, + "normalized_load_entropy": 0.912491325822487, + "max_load_share": 0.09119496855345911 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "89f2d410be4d81ebb1472048f3732386069c9b649ce50a3e40a25433e6d96109", + "route_weight_sha256": "67491844a58f0608e6ff10f93672d542a42955147c20d0840ef52c4fae48795d", + "loads": [ + 11, + 15, + 4, + 14, + 26, + 25, + 23, + 14, + 4, + 4, + 12, + 7, + 7, + 16, + 6, + 13, + 7, + 18, + 14, + 23, + 12, + 19, + 15, + 14, + 15, + 18, + 7, + 2, + 20, + 6, + 32, + 1, + 2, + 10, + 6, + 7, + 23, + 11, + 4, + 8, + 8, + 7, + 14, + 24, + 20, + 7, + 58, + 31, + 9, + 11, + 14, + 8, + 14, + 23, + 6, + 17, + 9, + 14, + 16, + 22, + 20, + 10, + 19, + 6 + ], + "weighted_loads": [ + 0.5246396232396364, + 0.6351713463664055, + 0.12769412249326706, + 0.8802592195570469, + 1.1443636901676655, + 1.5419870056211948, + 2.136658489704132, + 0.9008137155324221, + 0.13966844975948334, + 0.3965249303728342, + 0.6827213428914547, + 0.25330778397619724, + 0.5835625119507313, + 1.9339516572654247, + 0.21212978474795818, + 0.7788090296089649, + 0.37289333902299404, + 1.1326867956668139, + 1.1854807808995247, + 1.4065615218132734, + 0.4431304205209017, + 0.9437264055013657, + 0.9839139692485332, + 0.9096679165959358, + 1.0668576546013355, + 1.122820157557726, + 0.20064624957740307, + 0.06073235161602497, + 1.8101975284516811, + 0.1812503021210432, + 1.1805566847324371, + 0.031783509999513626, + 0.0766471978276968, + 0.3872923031449318, + 0.18619109317660332, + 0.3912333268672228, + 2.0908209048211575, + 0.4087921530008316, + 0.4642765950411558, + 0.34869111329317093, + 0.3279041778296232, + 0.31177561916410923, + 0.9586564935743809, + 1.6147213727235794, + 1.1455271989107132, + 0.39505646750330925, + 3.3198219817131758, + 1.6235710214823484, + 0.30035911314189434, + 0.523483095690608, + 1.8158200457692146, + 0.3733780588954687, + 0.5724143330007792, + 1.2450698502361774, + 0.2892368007451296, + 1.351821180433035, + 0.3309999965131283, + 0.8064032681286335, + 0.8773790746927261, + 1.0626505110412836, + 2.269678896293044, + 0.4293037373572588, + 1.191733120009303, + 0.20597802102565765 + ], + "unique_experts": 64, + "load_cv": 0.6575142649499451, + "normalized_load_entropy": 0.9540051685406803, + "max_load_share": 0.06575963718820861 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 106, + "ordered_topk_exact_tokens": 57, + "set_exact_tokens": 73, + "mean_set_jaccard": 0.9090296495956873, + "mean_token_weighted_tv": 0.014378456811789633, + "aggregate_load_tv": 0.026729559748427677 + }, + "system_bos": { + "tokens": 106, + "ordered_topk_exact_tokens": 50, + "set_exact_tokens": 69, + "mean_set_jaccard": 0.8982479784366576, + "mean_token_weighted_tv": 0.017751458962008637, + "aggregate_load_tv": 0.03930817610062892 + }, + "system_x": { + "tokens": 106, + "ordered_topk_exact_tokens": 43, + "set_exact_tokens": 61, + "mean_set_jaccard": 0.8746630727762804, + "mean_token_weighted_tv": 0.021308530174758075, + "aggregate_load_tv": 0.04874213836477988 + }, + "system_period": { + "tokens": 106, + "ordered_topk_exact_tokens": 52, + "set_exact_tokens": 67, + "mean_set_jaccard": 0.8888140161725068, + "mean_token_weighted_tv": 0.020183141141216148, + "aggregate_load_tv": 0.040880503144654086 + }, + "bos_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 44, + "set_exact_tokens": 63, + "mean_set_jaccard": 0.8820754716981132, + "mean_token_weighted_tv": 0.019411896355450153, + "aggregate_load_tv": 0.04402515723270441 + }, + "bos_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 44, + "set_exact_tokens": 58, + "mean_set_jaccard": 0.8645552560646901, + "mean_token_weighted_tv": 0.022079110084066413, + "aggregate_load_tv": 0.04874213836477986 + }, + "x_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 46, + "set_exact_tokens": 68, + "mean_set_jaccard": 0.8955525606469003, + "mean_token_weighted_tv": 0.018272398707439314, + "aggregate_load_tv": 0.03773584905660378 + }, + "x_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 41, + "set_exact_tokens": 54, + "mean_set_jaccard": 0.8557951482479785, + "mean_token_weighted_tv": 0.02456081524175012, + "aggregate_load_tv": 0.05660377358490567 + }, + "period_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 49, + "set_exact_tokens": 70, + "mean_set_jaccard": 0.894878706199461, + "mean_token_weighted_tv": 0.01848400820854981, + "aggregate_load_tv": 0.04245283018867925 + }, + "period_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 38, + "set_exact_tokens": 56, + "mean_set_jaccard": 0.8571428571428572, + "mean_token_weighted_tv": 0.024212375942195923, + "aggregate_load_tv": 0.0518867924528302 + } + } + }, + "layer_21": { + "layer": 21, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "b022f2714ac1226255daa40116ef89f28824c1923fe6edd0a1f5d6f1029be4ae", + "route_weight_sha256": "5e97ae0029de306cf46dd7ed184179237a3a5389f6014008708b2d6ba2c60755", + "loads": [ + 0, + 9, + 15, + 2, + 4, + 12, + 7, + 7, + 4, + 9, + 19, + 35, + 1, + 3, + 6, + 12, + 1, + 11, + 1, + 10, + 9, + 12, + 19, + 7, + 15, + 3, + 6, + 1, + 11, + 25, + 8, + 23, + 13, + 8, + 3, + 2, + 0, + 2, + 7, + 3, + 18, + 11, + 2, + 23, + 16, + 9, + 17, + 15, + 0, + 7, + 19, + 5, + 11, + 3, + 2, + 5, + 16, + 36, + 9, + 5, + 16, + 7, + 24, + 15 + ], + "weighted_loads": [ + 0.0, + 1.2086641751229763, + 2.5416420437395573, + 0.055149372667074203, + 0.1361163929104805, + 1.1281939838081598, + 0.47164657339453697, + 0.26279435493052006, + 0.1585540883243084, + 0.9750766083598137, + 1.5961644984781742, + 1.5174979250878096, + 0.027851367369294167, + 0.08515904285013676, + 0.22105107828974724, + 0.4115078803151846, + 0.04094123840332031, + 0.7736549153923988, + 0.03963276371359825, + 0.3318430781364441, + 0.4367123581469059, + 0.6807277798652649, + 1.4314015191048384, + 0.5722916517406702, + 1.175207193940878, + 0.09649429470300674, + 0.23347381129860878, + 0.06970957666635513, + 0.4022159893065691, + 1.8037310093641281, + 0.47224840335547924, + 0.8596083205193281, + 0.7337395213544369, + 0.30719684436917305, + 0.0951492041349411, + 0.06118220463395119, + 0.0, + 0.06887354142963886, + 0.5520359314978123, + 0.07871692627668381, + 0.7459269911050797, + 0.4724824894219637, + 0.102239228785038, + 1.648595167323947, + 1.0872510001063347, + 0.36346277222037315, + 0.8811451140791178, + 1.4326373655349016, + 0.0, + 0.22780958749353886, + 0.9424127656966448, + 0.35490118339657784, + 0.544267550110817, + 0.09524739161133766, + 0.07025398313999176, + 0.2708261050283909, + 1.3515603058040142, + 3.2068537827581167, + 0.5808964986354113, + 0.19240664318203926, + 0.745796600356698, + 0.35389091446995735, + 0.9752665776759386, + 1.1614090241491795 + ], + "unique_experts": 61, + "load_cv": 0.803826732231728, + "normalized_load_entropy": 0.9232872373115111, + "max_load_share": 0.05660377358490566 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "365a12d2db918e2cee5ac6f0cfba33a8fbed9b89b2a6fdfa4926eb7a61bbee65", + "route_weight_sha256": "517ced52052c18c14699fce5b1ff23e845d6652c8517b308a7e2873400d8eafc", + "loads": [ + 0, + 10, + 18, + 2, + 10, + 13, + 10, + 7, + 5, + 9, + 29, + 35, + 5, + 8, + 8, + 18, + 2, + 14, + 1, + 13, + 9, + 21, + 19, + 8, + 15, + 3, + 15, + 6, + 15, + 25, + 11, + 23, + 14, + 8, + 4, + 12, + 0, + 2, + 7, + 4, + 19, + 11, + 7, + 23, + 16, + 9, + 17, + 15, + 11, + 11, + 19, + 12, + 21, + 4, + 6, + 9, + 18, + 36, + 12, + 7, + 16, + 7, + 27, + 15 + ], + "weighted_loads": [ + 0.0, + 1.236307468265295, + 2.617201415123418, + 0.055149372667074203, + 0.36289460211992264, + 1.1686479542404413, + 0.7513496316969395, + 0.26279435493052006, + 0.22099532932043076, + 0.9750766083598137, + 2.1565663516521454, + 1.5174979250878096, + 0.3452358525246382, + 0.4745561610907316, + 0.2919338159263134, + 0.6032482599839568, + 0.0541996406391263, + 0.8575024735182524, + 0.03963276371359825, + 1.8523630313575268, + 0.4367123581469059, + 1.3438770323991776, + 1.4314015191048384, + 0.6137108225375414, + 1.175207193940878, + 0.09649429470300674, + 0.6415633093565702, + 0.5534757860004902, + 0.4960613464936614, + 1.8037310093641281, + 0.6854749042540789, + 0.8596083205193281, + 0.756668334826827, + 0.30719684436917305, + 0.14511487260460854, + 0.6311707850545645, + 0.0, + 0.06887354142963886, + 0.5520359314978123, + 0.12125365063548088, + 0.8050325885415077, + 0.4724824894219637, + 0.36858299747109413, + 1.648595167323947, + 1.0872510001063347, + 0.36346277222037315, + 0.8811451140791178, + 1.4326373655349016, + 0.5844348035752773, + 0.563975078985095, + 0.9424127656966448, + 0.6820295713841915, + 1.1796580776572227, + 0.1082611558958888, + 0.20096923224627972, + 0.6987341679632664, + 1.4430053979158401, + 3.2068537827581167, + 0.7000230401754379, + 0.2733023129403591, + 0.745796600356698, + 0.35389091446995735, + 1.1089329365640879, + 1.1614090241491795 + ], + "unique_experts": 62, + "load_cv": 0.6394367102675008, + "normalized_load_entropy": 0.9494399967243122, + "max_load_share": 0.04580152671755725 + } + }, + "s1_eos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "6df0603ad04508550e6e2e3ea68b168f984736da9be78ee9beac29d1502ba8fa", + "route_weight_sha256": "eab1ad4bc151d09174e2fbca6d68e2bd1509104d747d5ca479c5a8766842e955", + "loads": [ + 0, + 9, + 15, + 2, + 3, + 13, + 8, + 7, + 4, + 10, + 20, + 35, + 2, + 3, + 6, + 12, + 1, + 12, + 1, + 9, + 9, + 12, + 19, + 7, + 15, + 3, + 6, + 1, + 11, + 25, + 8, + 21, + 15, + 6, + 3, + 1, + 0, + 2, + 7, + 2, + 18, + 11, + 2, + 24, + 16, + 10, + 16, + 15, + 0, + 7, + 19, + 5, + 11, + 2, + 2, + 5, + 15, + 37, + 9, + 6, + 16, + 7, + 22, + 16 + ], + "weighted_loads": [ + 0.0, + 1.1856143735349178, + 2.5186525247991085, + 0.05631450563669205, + 0.10258190333843231, + 1.1516451593488455, + 0.49990670941770077, + 0.2692001685500145, + 0.1569796409457922, + 1.0091886185109615, + 1.652151359245181, + 1.5201350767165422, + 0.05598914809525013, + 0.08216354064643383, + 0.22380519658327103, + 0.41459533385932446, + 0.04304946959018707, + 0.7962008882313967, + 0.0412263423204422, + 0.3066769354045391, + 0.4358777776360512, + 0.6809135414659977, + 1.4507520720362663, + 0.5936954077333212, + 1.1742303408682346, + 0.09483145549893379, + 0.22210057079792023, + 0.06723655760288239, + 0.39677990786731243, + 1.776402521878481, + 0.4748040307313204, + 0.8041462264955044, + 0.7695122081786394, + 0.23580327257514, + 0.09760766662657261, + 0.03187555447220802, + 0.0, + 0.06894873455166817, + 0.5521022230386734, + 0.05286587402224541, + 0.7562461830675602, + 0.4739156477153301, + 0.10259905830025673, + 1.7127977833151817, + 1.1047288365662098, + 0.38591622561216354, + 0.8677427489310503, + 1.4189364593476057, + 0.0, + 0.2238150518387556, + 0.9600795693695545, + 0.35213619098067284, + 0.5189411547034979, + 0.0651894249022007, + 0.0703335665166378, + 0.2903640531003475, + 1.3385621272027493, + 3.220122380182147, + 0.5801403503865004, + 0.2314444314688444, + 0.74523507617414, + 0.35270096734166145, + 0.9155304301530123, + 1.1814589854329824 + ], + "unique_experts": 61, + "load_cv": 0.8087326473669351, + "normalized_load_entropy": 0.9218776562135488, + "max_load_share": 0.05817610062893082 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "28f4020eacbd783aff715d0f1f1525a71c93eaacca85f7ab36507ba7b737c7c9", + "route_weight_sha256": "5725bbe9e60b62da3b9577ff02e0ac8075e3a2f157be473910c502c836010b6a", + "loads": [ + 8, + 10, + 18, + 2, + 3, + 16, + 13, + 8, + 7, + 13, + 31, + 35, + 8, + 14, + 11, + 15, + 2, + 21, + 3, + 13, + 10, + 22, + 21, + 12, + 16, + 5, + 14, + 10, + 15, + 26, + 15, + 21, + 16, + 10, + 3, + 16, + 1, + 3, + 8, + 4, + 19, + 13, + 11, + 25, + 17, + 11, + 16, + 15, + 10, + 11, + 20, + 15, + 21, + 3, + 13, + 15, + 20, + 37, + 12, + 12, + 17, + 8, + 25, + 17 + ], + "weighted_loads": [ + 0.5105472411960363, + 1.232034556567669, + 3.210868529509753, + 0.05631450563669205, + 0.10258190333843231, + 1.233820291236043, + 0.7464465387165546, + 0.3515673577785492, + 0.29761713556945324, + 1.1818612795323133, + 2.2782839592546225, + 1.5201350767165422, + 0.4384096059948206, + 0.7185558397322893, + 0.4272816311568022, + 0.5018684025853872, + 0.05630787182599306, + 1.1072004004381597, + 0.09466592036187649, + 1.8436319418251514, + 0.48396145924925804, + 1.353232815861702, + 1.5143680404871702, + 1.0824721362441778, + 1.2093958295881748, + 0.16757072880864143, + 0.5044822171330452, + 0.9071466401219368, + 0.46852173609659076, + 1.825318083167076, + 0.8726777471601963, + 0.8041462264955044, + 0.7921785283833742, + 0.8321745358407497, + 0.09760766662657261, + 0.8933215029537678, + 0.07126513868570328, + 0.1100214384496212, + 0.6058099083602428, + 0.1333284191787243, + 0.7983048222959042, + 0.5992259085178375, + 0.536168996244669, + 1.7539618760347366, + 1.1743333376944065, + 0.4437253996729851, + 0.8677427489310503, + 1.4189364593476057, + 0.7891379594802856, + 1.2646088022738695, + 1.012834344059229, + 1.0637979470193386, + 1.1152637731283903, + 0.07820318918675184, + 0.7308765333145857, + 1.0466497763991356, + 1.5488099716603756, + 3.220122380182147, + 0.7287569679319859, + 0.4993588402867317, + 0.7676651496440172, + 0.41619032993912697, + 1.0385571774095297, + 1.266838712617755 + ], + "unique_experts": 64, + "load_cv": 0.5497030808541924, + "normalized_load_entropy": 0.9622939311682396, + "max_load_share": 0.04195011337868481 + } + }, + "s0_bos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "baeeaa1f1dc0ee73499cf8646fe1623175ece4bf2a34765ec0c546037e2c7f8c", + "route_weight_sha256": "9f92932432aa621d49e6c13cb0b501ef5ea20046ecb19a6f3bf049fb98d7d4de", + "loads": [ + 0, + 9, + 14, + 3, + 5, + 13, + 8, + 9, + 4, + 9, + 20, + 31, + 1, + 5, + 7, + 11, + 0, + 13, + 2, + 8, + 11, + 10, + 18, + 7, + 15, + 3, + 9, + 1, + 10, + 25, + 8, + 23, + 14, + 6, + 2, + 1, + 0, + 2, + 7, + 2, + 16, + 12, + 2, + 24, + 17, + 8, + 17, + 15, + 0, + 6, + 18, + 5, + 12, + 2, + 3, + 5, + 16, + 37, + 9, + 5, + 16, + 7, + 23, + 15 + ], + "weighted_loads": [ + 0.0, + 1.1435950361192226, + 2.5091712176799774, + 0.08419542200863361, + 0.1752677895128727, + 1.1312998365610838, + 0.5126072261482477, + 0.31536235846579075, + 0.15785571560263634, + 1.0054413303732872, + 1.6931440196931362, + 1.3647998366504908, + 0.02764628641307354, + 0.15732529573142529, + 0.2665775753557682, + 0.3728975020349026, + 0.0, + 0.826486125588417, + 0.06744264997541904, + 0.27249305695295334, + 0.5039212312549353, + 0.6509470231831074, + 1.3915417306125164, + 0.5789684262126684, + 1.1951974146068096, + 0.09504814073443413, + 0.3056646678596735, + 0.07013389468193054, + 0.36940498650074005, + 1.816524963825941, + 0.4803593885153532, + 0.9012244418263435, + 0.7721340265125036, + 0.2425999827682972, + 0.06175768002867699, + 0.030955126509070396, + 0.0, + 0.07253722473978996, + 0.568328034132719, + 0.05582495778799057, + 0.6938410494476557, + 0.50859384983778, + 0.09284104406833649, + 1.698098698630929, + 1.1383416596800089, + 0.3086615242063999, + 0.8906189110130072, + 1.4697052482515574, + 0.0, + 0.19631184451282024, + 0.940752575173974, + 0.37107331305742264, + 0.5909308362752199, + 0.06852931901812553, + 0.103562131524086, + 0.2580311931669712, + 1.3992519676685333, + 3.2598693929612637, + 0.5546638909727335, + 0.1956869587302208, + 0.7221096474677324, + 0.3546364828944206, + 0.9688848182559013, + 1.1925864927470684 + ], + "unique_experts": 60, + "load_cv": 0.7877217262320039, + "normalized_load_entropy": 0.9242969506109854, + "max_load_share": 0.05817610062893082 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "fbedca1b24650523963945dee493afda281de04ed49578588ce3792eae28ed5e", + "route_weight_sha256": "c21aa0255f0930a75f67075192b2925caf814ed9291d9204a7bf5fd79ad1f024", + "loads": [ + 0, + 12, + 16, + 4, + 10, + 14, + 10, + 9, + 6, + 9, + 29, + 31, + 5, + 10, + 9, + 15, + 1, + 17, + 3, + 10, + 11, + 18, + 18, + 8, + 15, + 3, + 18, + 6, + 13, + 25, + 11, + 25, + 15, + 6, + 3, + 11, + 0, + 2, + 7, + 5, + 18, + 12, + 7, + 24, + 17, + 9, + 17, + 15, + 11, + 9, + 18, + 12, + 22, + 3, + 7, + 8, + 18, + 37, + 11, + 6, + 16, + 7, + 27, + 15 + ], + "weighted_loads": [ + 0.0, + 1.2471665050834417, + 2.582222467288375, + 0.2861540336161852, + 0.3666016757488251, + 1.1641357634216547, + 0.7291711326688528, + 0.31536235846579075, + 0.26097921654582024, + 1.0054413303732872, + 2.190469518303871, + 1.3647998366504908, + 0.3454192075878382, + 0.4965167511254549, + 0.33836253359913826, + 0.5142780337482691, + 0.013258402235805988, + 0.9656248204410076, + 0.12309141643345356, + 0.8503771163523197, + 0.5039212312549353, + 1.3153661582618952, + 1.3915417306125164, + 0.6203875970095396, + 1.1951974146068096, + 0.09504814073443413, + 0.713754165917635, + 0.5220765881240368, + 0.45961719285696745, + 1.816524963825941, + 0.6888138558715582, + 1.0583816021680832, + 0.7950628399848938, + 0.2425999827682972, + 0.11172334849834442, + 0.6009437069296837, + 0.0, + 0.07253722473978996, + 0.568328034132719, + 0.179921705275774, + 0.8209153283387423, + 0.50859384983778, + 0.35678065568208694, + 1.698098698630929, + 1.1383416596800089, + 0.4144578389823437, + 0.8906189110130072, + 1.4697052482515574, + 0.5844348035752773, + 0.552364656701684, + 0.940752575173974, + 0.6982017010450363, + 1.2263213638216257, + 0.08154308330267668, + 0.23427738063037395, + 0.6270514205098152, + 1.4951020292937756, + 3.2598693929612637, + 0.6176522113382816, + 0.23954520002007484, + 0.7221096474677324, + 0.3546364828944206, + 1.1590640135109425, + 1.1925864927470684 + ], + "unique_experts": 62, + "load_cv": 0.6263419639252591, + "normalized_load_entropy": 0.9514727176448573, + "max_load_share": 0.047073791348600506 + } + }, + "s1_bos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "bb58cf7fa5d6ba201a28b24b181468b1847f30501de58cab899b036f897b1d04", + "route_weight_sha256": "f947546fe02efe37dc4d6f0cb4f77f55881279d164ade969144c7d09dd035916", + "loads": [ + 0, + 9, + 14, + 3, + 3, + 14, + 9, + 7, + 4, + 9, + 20, + 32, + 0, + 4, + 8, + 11, + 1, + 13, + 1, + 8, + 9, + 11, + 18, + 6, + 15, + 3, + 8, + 1, + 11, + 25, + 8, + 24, + 14, + 5, + 3, + 1, + 0, + 2, + 7, + 2, + 18, + 12, + 2, + 25, + 16, + 9, + 17, + 15, + 0, + 5, + 19, + 5, + 12, + 4, + 3, + 6, + 15, + 35, + 7, + 5, + 16, + 7, + 25, + 15 + ], + "weighted_loads": [ + 0.0, + 1.1272586695849895, + 2.5104965306818485, + 0.08605888858437538, + 0.10133979469537735, + 1.1974570117890835, + 0.5369784142822027, + 0.26146459206938744, + 0.15962525084614754, + 0.9746605530381203, + 1.5842866282910109, + 1.4281800743192434, + 0.0, + 0.11245024390518665, + 0.2882928419858217, + 0.38296062499284744, + 0.049221478402614594, + 0.7871356885880232, + 0.039979565888643265, + 0.2718176878988743, + 0.43894935213029385, + 0.6567697171121836, + 1.4043274745345116, + 0.5790381990373135, + 1.188090804964304, + 0.09778937324881554, + 0.2723294012248516, + 0.06387417018413544, + 0.3916489500552416, + 1.7528354581445456, + 0.48157108575105667, + 0.9372044056653976, + 0.7625825572758913, + 0.19950702600181103, + 0.09283333271741867, + 0.030948491767048836, + 0.0, + 0.07926911860704422, + 0.5543178096413612, + 0.056892773136496544, + 0.7529833130538464, + 0.5043935775756836, + 0.0972629152238369, + 1.737255234271288, + 1.0842217989265919, + 0.3391342256218195, + 0.877539549022913, + 1.4518538303673267, + 0.0, + 0.1703209225088358, + 0.9835227318108082, + 0.37075019627809525, + 0.5828858986496925, + 0.11283767409622669, + 0.09941773302853107, + 0.2852103225886822, + 1.3393024373799562, + 3.1394199430942535, + 0.4643602501600981, + 0.19766439869999886, + 0.7340969871729612, + 0.35533702932298183, + 1.02569760940969, + 1.1959558054804802 + ], + "unique_experts": 60, + "load_cv": 0.7990887179545314, + "normalized_load_entropy": 0.9222414759382, + "max_load_share": 0.055031446540880505 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "d1090796de321a30e565873b736a04353f82587734f295aaa3d2d9141f8efd9c", + "route_weight_sha256": "38324300ab1304a5b88caea6e218ffcc8d8897c90b5ed6ec09105cb28e19ab25", + "loads": [ + 8, + 13, + 16, + 3, + 6, + 15, + 14, + 9, + 7, + 12, + 30, + 33, + 6, + 14, + 13, + 14, + 2, + 21, + 4, + 11, + 10, + 20, + 20, + 11, + 16, + 5, + 16, + 11, + 14, + 26, + 15, + 26, + 15, + 9, + 3, + 16, + 1, + 3, + 8, + 4, + 19, + 14, + 11, + 26, + 17, + 10, + 17, + 15, + 10, + 10, + 20, + 15, + 22, + 5, + 14, + 15, + 20, + 35, + 8, + 9, + 17, + 8, + 29, + 16 + ], + "weighted_loads": [ + 0.5105472411960363, + 1.2770574390888214, + 3.2000365536659956, + 0.08605888858437538, + 0.2118990682065487, + 1.2124813981354237, + 0.8251359090209007, + 0.3809131421148777, + 0.30592450872063637, + 1.147333214059472, + 2.156537873670459, + 1.4841375071555376, + 0.37903933599591255, + 0.6813605222851038, + 0.49034731462597847, + 0.5036819260567427, + 0.06247988063842058, + 1.1001068726181984, + 0.15602275915443897, + 0.8688917867839336, + 0.4870330337435007, + 1.3287143390625715, + 1.4679434429854155, + 1.06781492754817, + 1.2232562936842442, + 0.17052864655852318, + 0.5547110475599766, + 0.9235403090715408, + 0.45848100911825895, + 1.8017510194331408, + 0.8491512108594179, + 1.0741149187088013, + 0.7852488774806261, + 0.7958782892674208, + 0.09283333271741867, + 0.8923944402486086, + 0.07126513868570328, + 0.12034182250499725, + 0.6080254949629307, + 0.13143530674278736, + 0.7974325343966484, + 0.629703838378191, + 0.5356192626059055, + 1.7784193269908428, + 1.1538263000547886, + 0.39694339968264103, + 0.877539549022913, + 1.4518538303673267, + 0.7891379594802856, + 1.3215369787067175, + 1.0362775065004826, + 1.082411952316761, + 1.179208517074585, + 0.12585143838077784, + 0.759960699826479, + 1.0408989191055298, + 1.5565317068248987, + 3.1394199430942535, + 0.48931774497032166, + 0.39681720547378063, + 0.7565270606428385, + 0.41882639192044735, + 1.213968900963664, + 1.2813355326652527 + ], + "unique_experts": 64, + "load_cv": 0.54322945043267, + "normalized_load_entropy": 0.9638246226489955, + "max_load_share": 0.03968253968253968 + } + }, + "s0_x": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "1e23bc5b391c2a4853814fdbfb5ac9abc20697eccd13ae0375987b170c3f66f8", + "route_weight_sha256": "4b46aaa8beb47a39c4dc2683c0fe3abcf43878bb80698f520bdd24dc87867243", + "loads": [ + 1, + 9, + 13, + 3, + 5, + 11, + 7, + 6, + 4, + 9, + 20, + 35, + 0, + 3, + 5, + 8, + 1, + 13, + 1, + 6, + 12, + 13, + 19, + 7, + 15, + 3, + 7, + 2, + 12, + 24, + 9, + 22, + 14, + 8, + 2, + 1, + 0, + 2, + 7, + 2, + 17, + 11, + 2, + 24, + 16, + 11, + 20, + 15, + 0, + 6, + 17, + 7, + 12, + 2, + 3, + 5, + 16, + 36, + 8, + 6, + 15, + 7, + 24, + 15 + ], + "weighted_loads": [ + 0.027709810063242912, + 1.1909167431294918, + 2.502615850418806, + 0.0873209610581398, + 0.16818910278379917, + 1.0625487100332975, + 0.4763323999941349, + 0.23555550165474415, + 0.15958434902131557, + 1.0052127428352833, + 1.6451475229114294, + 1.5304440390318632, + 0.0, + 0.08597393333911896, + 0.19257991015911102, + 0.28669968247413635, + 0.0512382872402668, + 0.8142024874687195, + 0.0408887080848217, + 0.222807127982378, + 0.5318132787942886, + 0.7109917681664228, + 1.426125142723322, + 0.5795918740332127, + 1.2043952867388725, + 0.09720822609961033, + 0.2422744259238243, + 0.10095063969492912, + 0.41663316637277603, + 1.7673781346529722, + 0.5194270741194487, + 0.8545556366443634, + 0.7649821266531944, + 0.3026597611606121, + 0.06458503566682339, + 0.04369970038533211, + 0.0, + 0.06911021284759045, + 0.5653855055570602, + 0.05402693338692188, + 0.7078548241406679, + 0.4701865389943123, + 0.09685118868947029, + 1.6415560580790043, + 1.0898056384176016, + 0.4099720884114504, + 0.9830210413783789, + 1.4503718055784702, + 0.0, + 0.19275795854628086, + 0.9092612192034721, + 0.41858429834246635, + 0.5884324070066214, + 0.06528244353830814, + 0.10189955122768879, + 0.25865087285637856, + 1.3821350783109665, + 3.1904062014073133, + 0.5070306528359652, + 0.23017249628901482, + 0.687275405973196, + 0.3532386776059866, + 0.9662392307072878, + 1.21541753038764 + ], + "unique_experts": 61, + "load_cv": 0.8044170218153973, + "normalized_load_entropy": 0.9229368906687706, + "max_load_share": 0.05660377358490566 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "fa01eeae7e9ec98b918170aeb2c4bc7dec710c94538b6f3f18a5e23e5aeea9d7", + "route_weight_sha256": "804f22087100a019a2054f9acd5a9c718fbc80ad77986ed3d0d668f0eaa6b29b", + "loads": [ + 2, + 9, + 16, + 3, + 10, + 11, + 10, + 6, + 5, + 9, + 31, + 35, + 5, + 6, + 7, + 11, + 2, + 19, + 1, + 8, + 12, + 20, + 19, + 8, + 15, + 3, + 16, + 7, + 16, + 24, + 12, + 22, + 15, + 8, + 3, + 12, + 0, + 2, + 7, + 3, + 17, + 11, + 9, + 24, + 16, + 11, + 20, + 15, + 13, + 10, + 17, + 14, + 23, + 3, + 7, + 9, + 19, + 36, + 10, + 8, + 15, + 7, + 27, + 15 + ], + "weighted_loads": [ + 0.05735265463590622, + 1.1909167431294918, + 2.617726931348443, + 0.0873209610581398, + 0.35952298901975155, + 1.0625487100332975, + 0.7504864484071732, + 0.23555550165474415, + 0.22202559001743793, + 1.0052127428352833, + 2.2392832078039646, + 1.5304440390318632, + 0.33613594248890877, + 0.36116474866867065, + 0.26190386340022087, + 0.3865773770958185, + 0.06449668947607279, + 1.0445952713489532, + 0.0408887080848217, + 0.8006911873817444, + 0.5318132787942886, + 1.3154273070394993, + 1.426125142723322, + 0.6210110448300838, + 1.2043952867388725, + 0.09720822609961033, + 0.6503639239817858, + 0.5539935752749443, + 0.5497585041448474, + 1.7673781346529722, + 0.7576247397810221, + 0.8545556366443634, + 0.7879109401255846, + 0.3026597611606121, + 0.11455070413649082, + 0.7079560812562704, + 0.0, + 0.06911021284759045, + 0.5653855055570602, + 0.09376814030110836, + 0.7078548241406679, + 0.4701865389943123, + 0.46639711409807205, + 1.6415560580790043, + 1.0898056384176016, + 0.4099720884114504, + 0.9830210413783789, + 1.4503718055784702, + 0.7120340131223202, + 0.5323355700820684, + 0.9092612192034721, + 0.74571268633008, + 1.4133648108690977, + 0.07829620782285929, + 0.23261480033397675, + 0.70192451775074, + 1.5199231058359146, + 3.1904062014073133, + 0.5750526823103428, + 0.29836793802678585, + 0.687275405973196, + 0.3532386776059866, + 1.0907037984579802, + 1.21541753038764 + ], + "unique_experts": 63, + "load_cv": 0.6452426514393726, + "normalized_load_entropy": 0.9498032582490591, + "max_load_share": 0.04580152671755725 + } + }, + "s1_x": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "89252f5c3da9f3cc9d67d3d1aae46552e3201c4ce0d735cd4e675f73cefdaf17", + "route_weight_sha256": "99db34a4d52585e1795220c2301cbe1201eceef2ba4424f61872b844c6230ffe", + "loads": [ + 2, + 9, + 14, + 3, + 4, + 12, + 8, + 5, + 4, + 10, + 20, + 31, + 0, + 3, + 6, + 6, + 1, + 13, + 1, + 11, + 13, + 12, + 18, + 7, + 16, + 5, + 7, + 1, + 11, + 24, + 9, + 25, + 14, + 5, + 3, + 1, + 0, + 2, + 7, + 3, + 16, + 10, + 2, + 25, + 15, + 9, + 19, + 15, + 0, + 5, + 18, + 8, + 12, + 3, + 3, + 5, + 17, + 35, + 6, + 5, + 16, + 8, + 23, + 15 + ], + "weighted_loads": [ + 0.05883225239813328, + 1.137634675949812, + 2.5068975631147623, + 0.08765139244496822, + 0.14032577350735664, + 1.120036419481039, + 0.5191744770854712, + 0.1909167543053627, + 0.15482679195702076, + 1.0057789161801338, + 1.662637922912836, + 1.3922169599682093, + 0.0, + 0.08559193648397923, + 0.21880540996789932, + 0.21747695095837116, + 0.060065917670726776, + 0.7707937527447939, + 0.042553819715976715, + 0.37388445250689983, + 0.5618943180888891, + 0.6826360132545233, + 1.4045241065323353, + 0.6249366365373135, + 1.1841162387281656, + 0.15213324688374996, + 0.23808778822422028, + 0.06677740067243576, + 0.3827274274080992, + 1.7295727953314781, + 0.5118066277354956, + 0.9584455620497465, + 0.7406774945557117, + 0.1791711114346981, + 0.09421778097748756, + 0.059031736105680466, + 0.0, + 0.07467752695083618, + 0.544878389686346, + 0.09367524646222591, + 0.6922945659607649, + 0.43727258034050465, + 0.10137872397899628, + 1.6564787290990353, + 1.0355211962014437, + 0.3332972079515457, + 0.9728639721870422, + 1.4080639611929655, + 0.0, + 0.15851998515427113, + 0.9210610389709473, + 0.4826054088771343, + 0.5635680891573429, + 0.08616800606250763, + 0.09936203435063362, + 0.22691304236650467, + 1.44410565122962, + 3.0534664038568735, + 0.45876994356513023, + 0.21053404361009598, + 0.7145530823618174, + 0.39327916502952576, + 0.9399566762149334, + 1.1971814632415771 + ], + "unique_experts": 61, + "load_cv": 0.7863144509210206, + "normalized_load_entropy": 0.9254115054360444, + "max_load_share": 0.055031446540880505 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "9ed7ffe07c65ef7b6a66d2d94b3711a37974e61d32bfae99fd04ccc8e7182f6c", + "route_weight_sha256": "8c3b85ee8686b5870a224cf0f809aab258e4e1e757f88222502a420fccec3491", + "loads": [ + 10, + 11, + 16, + 3, + 5, + 13, + 12, + 6, + 7, + 13, + 31, + 31, + 8, + 13, + 11, + 9, + 2, + 19, + 4, + 14, + 14, + 20, + 20, + 13, + 17, + 9, + 15, + 10, + 14, + 25, + 16, + 25, + 15, + 9, + 3, + 17, + 1, + 3, + 8, + 3, + 16, + 13, + 13, + 26, + 17, + 10, + 19, + 15, + 13, + 10, + 19, + 19, + 23, + 4, + 14, + 15, + 22, + 35, + 7, + 10, + 17, + 9, + 25, + 16 + ], + "weighted_loads": [ + 0.5693794935941696, + 1.229499440640211, + 3.1964375860989094, + 0.08765139244496822, + 0.17170106247067451, + 1.1350608058273792, + 0.6927376575767994, + 0.2732839435338974, + 0.31336759217083454, + 1.1784515772014856, + 2.303850593045354, + 1.3922169599682093, + 0.41366269066929817, + 0.6317685823887587, + 0.4242097828537226, + 0.3378738909959793, + 0.07332431990653276, + 1.0270566288381815, + 0.15550913102924824, + 0.9709585513919592, + 0.609977999702096, + 1.284529672935605, + 1.4681400749832392, + 1.1670129038393497, + 1.2192817274481058, + 0.3117995448410511, + 0.5204694345593452, + 0.8944982886314392, + 0.4426544914022088, + 1.7784883566200733, + 0.9211212135851383, + 0.9584455620497465, + 0.7633438147604465, + 0.7755423747003078, + 0.09421778097748756, + 0.9857122115790844, + 0.07126513868570328, + 0.11575023084878922, + 0.5985860750079155, + 0.09367524646222591, + 0.6922945659607649, + 0.6339568253606558, + 0.6429416835308075, + 1.6976428218185902, + 1.1414946112781763, + 0.39110638201236725, + 0.9728639721870422, + 1.4080639611929655, + 1.0414362363517284, + 1.1933112312108278, + 0.9738158136606216, + 1.2225530054420233, + 1.3642282746732235, + 0.09918177034705877, + 0.7599050011485815, + 1.0427908934652805, + 1.6579097546637058, + 3.0534664038568735, + 0.4837274383753538, + 0.4494419824331999, + 0.7369831558316946, + 0.45676852762699127, + 1.0155151188373566, + 1.2825611904263496 + ], + "unique_experts": 64, + "load_cv": 0.530200239292589, + "normalized_load_entropy": 0.9648332749214988, + "max_load_share": 0.03968253968253968 + } + }, + "s0_period": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "08a61374115ff26c41dd4e3eaa1d1d7e6d67472bf5810ab6de417b25c1486d84", + "route_weight_sha256": "747dab1c40c89cb8be40c93fa1085927de2f2b02fb3c3d9beffc14020d8aad9f", + "loads": [ + 1, + 9, + 13, + 3, + 4, + 14, + 7, + 8, + 4, + 9, + 18, + 33, + 1, + 2, + 7, + 9, + 1, + 13, + 1, + 9, + 10, + 12, + 18, + 7, + 15, + 3, + 8, + 1, + 11, + 25, + 8, + 22, + 14, + 7, + 3, + 1, + 0, + 2, + 7, + 2, + 17, + 11, + 2, + 24, + 16, + 9, + 19, + 15, + 0, + 7, + 19, + 6, + 12, + 2, + 2, + 5, + 16, + 37, + 9, + 5, + 14, + 7, + 25, + 15 + ], + "weighted_loads": [ + 0.026585077866911888, + 1.1819273494184017, + 2.517217079177499, + 0.08899793773889542, + 0.14199288561940193, + 1.1863572280853987, + 0.45492012798786163, + 0.29244947992265224, + 0.15923780016601086, + 0.9873570390045643, + 1.595957513898611, + 1.4580748435109854, + 0.02769695594906807, + 0.054492976516485214, + 0.2521096467971802, + 0.30463485419750214, + 0.047494564205408096, + 0.7891548648476601, + 0.03889985755085945, + 0.3047262132167816, + 0.47144375927746296, + 0.6889254208654165, + 1.3822334576398134, + 0.5757188592106104, + 1.1890793778002262, + 0.09843919984996319, + 0.27557835541665554, + 0.06828038394451141, + 0.387374060228467, + 1.802282927557826, + 0.46587342396378517, + 0.83355444483459, + 0.751429945230484, + 0.27054404467344284, + 0.09159431979060173, + 0.04040858894586563, + 0.0, + 0.07533517107367516, + 0.553817629814148, + 0.055816929787397385, + 0.7044482324272394, + 0.4706734288483858, + 0.0969085544347763, + 1.6800501625984907, + 1.083536071702838, + 0.3537703566253185, + 0.9657927919179201, + 1.445245275273919, + 0.0, + 0.22257457487285137, + 0.9503558203577995, + 0.3854396939277649, + 0.5883065853267908, + 0.06574261374771595, + 0.06793213821947575, + 0.2543599810451269, + 1.3828112110495567, + 3.2330194748938084, + 0.541840810328722, + 0.19536568224430084, + 0.6599127911031246, + 0.36491805873811245, + 1.0070705115795135, + 1.1787242107093334 + ], + "unique_experts": 62, + "load_cv": 0.8000781180957115, + "normalized_load_entropy": 0.9238437126883069, + "max_load_share": 0.05817610062893082 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "29593429b5399f805a29e9f0ea724269500803e60eabbbbd6f8dabbd5c84d0bc", + "route_weight_sha256": "bda0944340ec03f3b4436ac226b80710522110b07b131a3c5e9732247968f945", + "loads": [ + 1, + 10, + 16, + 3, + 11, + 14, + 10, + 8, + 5, + 9, + 27, + 33, + 6, + 7, + 9, + 13, + 2, + 18, + 2, + 11, + 10, + 19, + 18, + 8, + 15, + 3, + 17, + 6, + 15, + 25, + 11, + 22, + 15, + 7, + 4, + 12, + 0, + 2, + 7, + 2, + 18, + 11, + 8, + 24, + 16, + 9, + 19, + 15, + 12, + 11, + 19, + 14, + 22, + 3, + 6, + 10, + 18, + 37, + 10, + 7, + 14, + 7, + 28, + 15 + ], + "weighted_loads": [ + 0.026585077866911888, + 1.2078067678958178, + 2.637622620910406, + 0.08899793773889542, + 0.40934132039546967, + 1.1863572280853987, + 0.7665528357028961, + 0.29244947992265224, + 0.22167904116213322, + 0.9873570390045643, + 2.1014526281505823, + 1.4580748435109854, + 0.35600581020116806, + 0.4021265283226967, + 0.32190392166376114, + 0.45170713029801846, + 0.060752966441214085, + 0.9876322485506535, + 0.08270657062530518, + 0.882610272616148, + 0.47144375927746296, + 1.292799349874258, + 1.3822334576398134, + 0.6171380300074816, + 1.1890793778002262, + 0.09843919984996319, + 0.683667853474617, + 0.5260692536830902, + 0.5174612710252404, + 1.802282927557826, + 0.6925732120871544, + 0.83355444483459, + 0.7743587587028742, + 0.27054404467344284, + 0.14155998826026917, + 0.667646886780858, + 0.0, + 0.07533517107367516, + 0.553817629814148, + 0.055816929787397385, + 0.7398807387799025, + 0.4706734288483858, + 0.42918122187256813, + 1.6800501625984907, + 1.083536071702838, + 0.3537703566253185, + 0.9657927919179201, + 1.445245275273919, + 0.6553838588297367, + 0.6029726956039667, + 0.9503558203577995, + 0.7705409675836563, + 1.2236971128731966, + 0.0787563780322671, + 0.1986473873257637, + 0.7743982318788767, + 1.4699960201978683, + 3.2330194748938084, + 0.5663917418569326, + 0.3276648558676243, + 0.6599127911031246, + 0.36491805873811245, + 1.1460034064948559, + 1.1787242107093334 + ], + "unique_experts": 63, + "load_cv": 0.6286532348122817, + "normalized_load_entropy": 0.951645420791889, + "max_load_share": 0.047073791348600506 + } + }, + "s1_period": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "390c85a73b20d5aeae5f5f5078d1bb55e7d43396d9b2d6a864fe0ff7c344472c", + "route_weight_sha256": "cb7b106653cead30f6eedfac1f4cb449404d00c808fca87a7cf316fa3d3f18ca", + "loads": [ + 1, + 9, + 13, + 3, + 2, + 12, + 8, + 6, + 4, + 9, + 16, + 31, + 0, + 4, + 7, + 9, + 1, + 13, + 2, + 14, + 9, + 10, + 18, + 7, + 16, + 3, + 8, + 2, + 12, + 25, + 9, + 22, + 15, + 6, + 3, + 1, + 0, + 2, + 7, + 2, + 16, + 12, + 2, + 26, + 16, + 10, + 19, + 16, + 0, + 4, + 19, + 7, + 12, + 3, + 3, + 5, + 17, + 35, + 5, + 6, + 14, + 8, + 25, + 15 + ], + "weighted_loads": [ + 0.028794432058930397, + 1.2003966383635998, + 2.5003207996487617, + 0.08831900730729103, + 0.06576913967728615, + 1.1025132052600384, + 0.4925188310444355, + 0.23022264055907726, + 0.15249978937208652, + 0.9637649692595005, + 1.4871845412999392, + 1.401959117501974, + 0.0, + 0.11452171951532364, + 0.2566726189106703, + 0.32256218791007996, + 0.05730121210217476, + 0.7766640409827232, + 0.06619944795966148, + 0.4637151136994362, + 0.4338768310844898, + 0.6244793478399515, + 1.4231385309249163, + 0.6290580295026302, + 1.2095335740596056, + 0.10103118233382702, + 0.2759788278490305, + 0.09678114950656891, + 0.40791542641818523, + 1.775625329464674, + 0.5023825913667679, + 0.8744573649019003, + 0.7661545388400555, + 0.21839435957372189, + 0.09309178590774536, + 0.05483299493789673, + 0.0, + 0.07808198779821396, + 0.5495071075856686, + 0.05450780689716339, + 0.6961686313152313, + 0.4967651907354593, + 0.10246921330690384, + 1.7500864695757627, + 1.0745581965893507, + 0.37223806232213974, + 0.9764804039150476, + 1.444490760564804, + 0.0, + 0.11926533840596676, + 0.9625120908021927, + 0.4383871890604496, + 0.5699987020343542, + 0.08555139042437077, + 0.1005542054772377, + 0.2332735639065504, + 1.42288763448596, + 3.0839964281767607, + 0.4067723713815212, + 0.23302163556218147, + 0.6528075970709324, + 0.39215002954006195, + 1.0243500769138336, + 1.199381124228239 + ], + "unique_experts": 61, + "load_cv": 0.7873199042451452, + "normalized_load_entropy": 0.9250769418480599, + "max_load_share": 0.055031446540880505 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "5f68abee92fb9b12533eec5c60c2da6e518dd64752d0a141aeb53dcf058dda70", + "route_weight_sha256": "5353a797306fc4ffdbaf57fb19dc3fa62473ca8ce93c1af3b89817782be75d70", + "loads": [ + 10, + 10, + 16, + 3, + 3, + 13, + 13, + 7, + 7, + 12, + 26, + 31, + 7, + 14, + 12, + 12, + 2, + 19, + 6, + 18, + 10, + 19, + 20, + 13, + 17, + 5, + 16, + 11, + 15, + 26, + 16, + 22, + 16, + 10, + 3, + 18, + 1, + 3, + 8, + 2, + 16, + 14, + 13, + 27, + 17, + 11, + 19, + 16, + 12, + 9, + 20, + 18, + 22, + 4, + 14, + 16, + 22, + 35, + 6, + 12, + 15, + 9, + 27, + 16 + ], + "weighted_loads": [ + 0.5710575841367245, + 1.2468168213963509, + 3.2409823443740606, + 0.08831900730729103, + 0.10281671583652496, + 1.1175375916063786, + 0.741075785830617, + 0.31258982978761196, + 0.3191602509468794, + 1.1364376302808523, + 2.0938339456915855, + 1.401959117501974, + 0.38356830179691315, + 0.66594173386693, + 0.4591195397078991, + 0.44774785451591015, + 0.07055961433798075, + 1.0281761772930622, + 0.22847063653171062, + 1.0893345158547163, + 0.4819605126976967, + 1.2459423635154963, + 1.4867544993758202, + 1.1784730777144432, + 1.2446990627795458, + 0.17377045564353466, + 0.5583604741841555, + 0.8851868696510792, + 0.46810097713023424, + 1.8245408907532692, + 0.9079748000949621, + 0.8744573649019003, + 0.7888208590447903, + 0.8147656228393316, + 0.09309178590774536, + 1.0041377060115337, + 0.07126513868570328, + 0.11915469169616699, + 0.603214792907238, + 0.05450780689716339, + 0.6961686313152313, + 0.6220754515379667, + 0.6641098521649837, + 1.7912505622953176, + 1.1441626977175474, + 0.4300472363829613, + 0.9764804039150476, + 1.444490760564804, + 0.9065314307808876, + 1.2660127710551023, + 1.015266865491867, + 1.2146407030522823, + 1.1663213204592466, + 0.09856515470892191, + 0.7610971722751856, + 1.0601346548646688, + 1.6409408785402775, + 3.0839964281767607, + 0.4317298661917448, + 0.5428387802094221, + 0.6752376705408096, + 0.45563939213752747, + 1.1012041866779327, + 1.2847608514130116 + ], + "unique_experts": 64, + "load_cv": 0.5273998149759515, + "normalized_load_entropy": 0.9642842560972323, + "max_load_share": 0.03968253968253968 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 106, + "ordered_topk_exact_tokens": 62, + "set_exact_tokens": 81, + "mean_set_jaccard": 0.9305929919137468, + "mean_token_weighted_tv": 0.012818952249187344, + "aggregate_load_tv": 0.020440251572327043 + }, + "system_bos": { + "tokens": 106, + "ordered_topk_exact_tokens": 61, + "set_exact_tokens": 76, + "mean_set_jaccard": 0.9171159029649595, + "mean_token_weighted_tv": 0.016664788645323156, + "aggregate_load_tv": 0.02987421383647798 + }, + "system_x": { + "tokens": 106, + "ordered_topk_exact_tokens": 56, + "set_exact_tokens": 68, + "mean_set_jaccard": 0.8975741239892184, + "mean_token_weighted_tv": 0.0195959836227011, + "aggregate_load_tv": 0.042452830188679236 + }, + "system_period": { + "tokens": 106, + "ordered_topk_exact_tokens": 47, + "set_exact_tokens": 68, + "mean_set_jaccard": 0.8915094339622642, + "mean_token_weighted_tv": 0.019997154318569403, + "aggregate_load_tv": 0.03930817610062893 + }, + "bos_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 57, + "set_exact_tokens": 71, + "mean_set_jaccard": 0.9056603773584907, + "mean_token_weighted_tv": 0.018092911163309834, + "aggregate_load_tv": 0.03930817610062892 + }, + "bos_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 53, + "set_exact_tokens": 67, + "mean_set_jaccard": 0.894878706199461, + "mean_token_weighted_tv": 0.01989378325887165, + "aggregate_load_tv": 0.036163522012578615 + }, + "x_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 47, + "set_exact_tokens": 63, + "mean_set_jaccard": 0.8820754716981132, + "mean_token_weighted_tv": 0.020156591164194188, + "aggregate_load_tv": 0.04088050314465408 + }, + "x_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 39, + "set_exact_tokens": 54, + "mean_set_jaccard": 0.8537735849056604, + "mean_token_weighted_tv": 0.02593761027948755, + "aggregate_load_tv": 0.05503144654088049 + }, + "period_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 61, + "set_exact_tokens": 76, + "mean_set_jaccard": 0.9171159029649596, + "mean_token_weighted_tv": 0.016580459037971385, + "aggregate_load_tv": 0.029874213836477988 + }, + "period_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 40, + "set_exact_tokens": 56, + "mean_set_jaccard": 0.8551212938005394, + "mean_token_weighted_tv": 0.02521416260245836, + "aggregate_load_tv": 0.056603773584905655 + } + } + }, + "layer_22": { + "layer": 22, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "80b1fdc4cc644380c9deccdc060f03d409306ed250bcda0c136e0304e6beaf8e", + "route_weight_sha256": "e2efde9cdbdc5e1568fd8cd4febc71faef49ad1d4a7e5d7051cfa30439ca9ea3", + "loads": [ + 2, + 4, + 30, + 12, + 25, + 36, + 6, + 7, + 30, + 0, + 35, + 8, + 25, + 6, + 8, + 8, + 20, + 10, + 16, + 3, + 25, + 4, + 11, + 7, + 11, + 12, + 18, + 2, + 15, + 1, + 10, + 8, + 6, + 5, + 1, + 1, + 13, + 9, + 17, + 9, + 3, + 8, + 8, + 0, + 3, + 0, + 11, + 11, + 6, + 14, + 6, + 4, + 6, + 9, + 1, + 1, + 15, + 9, + 8, + 17, + 4, + 3, + 8, + 5 + ], + "weighted_loads": [ + 0.11411748826503754, + 0.1514640413224697, + 2.9815246611833572, + 1.7859076485037804, + 2.533746834844351, + 2.74457535892725, + 0.3620434030890465, + 0.32954197749495506, + 1.414384052157402, + 0.0, + 2.5864196307957172, + 0.3885536026209593, + 1.4143841713666916, + 0.31662864051759243, + 0.3165293037891388, + 0.32289058715105057, + 1.166441023349762, + 0.6393762324005365, + 0.8910794463008642, + 0.14479001611471176, + 1.06502821482718, + 0.2722410708665848, + 0.5243068747222424, + 0.45172833278775215, + 0.6294760480523109, + 0.5511192306876183, + 0.8949023634195328, + 0.07274950295686722, + 1.0359529852867126, + 0.03245105594396591, + 0.4858007561415434, + 0.6409061010926962, + 0.23829195462167263, + 0.14188484475016594, + 0.056016676127910614, + 0.034844815731048584, + 0.7872749753296375, + 0.3921266794204712, + 1.3223937004804611, + 0.46128804236650467, + 0.17291001975536346, + 0.42526500672101974, + 0.9469721727073193, + 0.0, + 0.08228318206965923, + 0.0, + 0.8110223300755024, + 0.6264636926352978, + 0.507754435762763, + 2.3244003616273403, + 0.21176897548139095, + 0.1948702037334442, + 0.28057489916682243, + 0.30050297267735004, + 0.034293219447135925, + 0.02326238714158535, + 0.9830137677490711, + 0.5042157601565123, + 0.41056403517723083, + 1.3601923249661922, + 0.31796377152204514, + 0.11252668499946594, + 0.4160041119903326, + 0.18417351320385933 + ], + "unique_experts": 61, + "load_cv": 0.8469575731118278, + "normalized_load_entropy": 0.9198511397347502, + "max_load_share": 0.05660377358490566 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "1b1887c7a2b075e278bdc7977fa50758b62b1b62763439fb002eddb9b714aa9d", + "route_weight_sha256": "7f0fabb13fe817db154d97a16c2c2f436101f90b75b65de33b1367cb769e2909", + "loads": [ + 6, + 5, + 32, + 22, + 25, + 39, + 11, + 7, + 44, + 5, + 35, + 10, + 25, + 6, + 13, + 8, + 20, + 12, + 16, + 3, + 25, + 11, + 13, + 7, + 12, + 14, + 19, + 5, + 15, + 1, + 11, + 8, + 10, + 11, + 2, + 3, + 13, + 9, + 17, + 10, + 7, + 8, + 13, + 0, + 3, + 1, + 13, + 11, + 10, + 16, + 11, + 4, + 6, + 11, + 1, + 14, + 18, + 10, + 9, + 17, + 12, + 11, + 9, + 11 + ], + "weighted_loads": [ + 0.2889064298942685, + 0.19666631519794464, + 3.058424036949873, + 3.722091507166624, + 2.533746834844351, + 2.906521967612207, + 0.6910165166482329, + 0.32954197749495506, + 2.633169924840331, + 0.19242935813963413, + 2.5864196307957172, + 0.4180197836831212, + 1.4143841713666916, + 0.31662864051759243, + 0.8951710714027286, + 0.32289058715105057, + 1.166441023349762, + 0.7094024512916803, + 0.8910794463008642, + 0.14479001611471176, + 1.06502821482718, + 0.9320926740765572, + 0.5869238507002592, + 0.45172833278775215, + 0.6571273561567068, + 0.6114488877356052, + 0.9625194296240807, + 0.1972117405384779, + 1.0359529852867126, + 0.03245105594396591, + 0.5201179552823305, + 0.6409061010926962, + 0.36975983483716846, + 0.35495549626648426, + 0.12016153335571289, + 0.1134699285030365, + 0.7872749753296375, + 0.3921266794204712, + 1.3223937004804611, + 0.5257859900593758, + 0.41842399165034294, + 0.42526500672101974, + 1.3884486928582191, + 0.0, + 0.08228318206965923, + 0.03088296204805374, + 0.8797071501612663, + 0.6264636926352978, + 0.716929392889142, + 2.514021050184965, + 0.44623900577425957, + 0.1948702037334442, + 0.28057489916682243, + 0.4196308422833681, + 0.034293219447135925, + 1.1221371074207127, + 1.105173036456108, + 0.5298546683043242, + 0.5316645354032516, + 1.3601923249661922, + 1.4385400377213955, + 0.3935258127748966, + 0.4426577892154455, + 0.4054964780807495 + ], + "unique_experts": 63, + "load_cv": 0.7113722941999265, + "normalized_load_entropy": 0.9442451525679563, + "max_load_share": 0.05597964376590331 + } + }, + "s1_eos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "c026bf0450f19f6d69ec51aeed8a1718bebb557e741e0a2ac72fe0af8e13de41", + "route_weight_sha256": "28ddea8bfebc81a75bf4dc20a09dfd42f576dfe0ad06b79b735e5ab8c82b7363", + "loads": [ + 2, + 2, + 30, + 12, + 27, + 35, + 6, + 7, + 30, + 0, + 34, + 8, + 25, + 5, + 8, + 7, + 20, + 10, + 16, + 3, + 29, + 4, + 10, + 6, + 10, + 13, + 16, + 2, + 15, + 3, + 10, + 8, + 6, + 4, + 1, + 1, + 12, + 8, + 17, + 9, + 3, + 8, + 9, + 0, + 2, + 0, + 12, + 11, + 6, + 13, + 6, + 4, + 6, + 9, + 1, + 1, + 16, + 9, + 9, + 18, + 4, + 3, + 9, + 6 + ], + "weighted_loads": [ + 0.11306741461157799, + 0.07666759192943573, + 3.0112821105867624, + 1.7810152545571327, + 2.611817345023155, + 2.670624941587448, + 0.3652571029961109, + 0.32471964322030544, + 1.3998459428548813, + 0.0, + 2.5990582294762135, + 0.394648727029562, + 1.410657461732626, + 0.28442640230059624, + 0.31758129596710205, + 0.29153215885162354, + 1.1707744151353836, + 0.6426431182771921, + 0.8941738326102495, + 0.145607341080904, + 1.2408911734819412, + 0.27302396297454834, + 0.4814821146428585, + 0.4134704302996397, + 0.5953853614628315, + 0.5919180084019899, + 0.8208223208785057, + 0.07327189855277538, + 1.0264853928238153, + 0.10104422643780708, + 0.4834687318652868, + 0.6365378908813, + 0.22780244424939156, + 0.11222941987216473, + 0.0463065505027771, + 0.034013476222753525, + 0.7563441097736359, + 0.3552489597350359, + 1.3319630213081837, + 0.4666476510465145, + 0.17933456972241402, + 0.4206506237387657, + 0.9714730270206928, + 0.0, + 0.056791165843605995, + 0.0, + 0.8582686502486467, + 0.6369821298867464, + 0.5143134109675884, + 2.291009768843651, + 0.2192249372601509, + 0.19772442057728767, + 0.2776504345238209, + 0.30388339422643185, + 0.03417697921395302, + 0.02181072160601616, + 1.0132466610521078, + 0.4980277046561241, + 0.4514232762157917, + 1.3884912114590406, + 0.3194795325398445, + 0.11088472232222557, + 0.4329690784215927, + 0.21889740228652954 + ], + "unique_experts": 61, + "load_cv": 0.8580930726743932, + "normalized_load_entropy": 0.9180442184250458, + "max_load_share": 0.055031446540880505 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "27973f5769c7c1f28f369c37ed33e39d810d04cda7b9d97161ebff4a21a4bee1", + "route_weight_sha256": "07143d310bb89e625388cf35dc42d9802e73a6d003cbb571ce024b69a06311ba", + "loads": [ + 4, + 7, + 30, + 24, + 27, + 39, + 12, + 9, + 50, + 9, + 34, + 13, + 28, + 5, + 13, + 11, + 23, + 13, + 17, + 3, + 30, + 17, + 11, + 6, + 11, + 14, + 17, + 4, + 16, + 3, + 11, + 8, + 9, + 15, + 9, + 6, + 14, + 9, + 17, + 10, + 14, + 9, + 14, + 2, + 2, + 2, + 14, + 13, + 10, + 15, + 17, + 7, + 11, + 12, + 1, + 21, + 20, + 10, + 13, + 18, + 18, + 13, + 9, + 9 + ], + "weighted_loads": [ + 0.23974474426358938, + 0.5533686764538288, + 3.0112821105867624, + 3.981297466903925, + 2.611817345023155, + 2.852940754033625, + 0.7436464186757803, + 0.4055021349340677, + 3.082802217453718, + 0.4647060912102461, + 2.5990582294762135, + 0.695504036732018, + 1.551201932132244, + 0.28442640230059624, + 0.8933383729308844, + 0.5280294455587864, + 1.316080454736948, + 0.7431894354522228, + 0.934189947322011, + 0.145607341080904, + 1.2892654612660408, + 1.397344909608364, + 0.5244386121630669, + 0.4134704302996397, + 0.6263429056853056, + 0.6174750700592995, + 0.8905874937772751, + 0.1570818740874529, + 1.109097981825471, + 0.10104422643780708, + 0.5370650161057711, + 0.6365378908813, + 0.33934902027249336, + 0.5211856383830309, + 0.39136320911347866, + 0.2354896068572998, + 0.8465036228299141, + 0.38885204307734966, + 1.3319630213081837, + 0.5293751694262028, + 0.9021045677363873, + 0.4460937939584255, + 1.435355830937624, + 0.1360919177532196, + 0.056791165843605995, + 0.07559001818299294, + 0.924719912931323, + 0.7034788709133863, + 0.725906427949667, + 2.7535023167729378, + 0.7328364215791225, + 0.4094333201646805, + 0.8228295519948006, + 0.47298513539135456, + 0.03417697921395302, + 1.7281356640160084, + 1.2271405588835478, + 0.5230121053755283, + 0.6402660044841468, + 1.3884912114590406, + 2.236182238906622, + 0.5273699052631855, + 0.4329690784215927, + 0.36615559831261635 + ], + "unique_experts": 64, + "load_cv": 0.6563871907327573, + "normalized_load_entropy": 0.9529556677787329, + "max_load_share": 0.05668934240362812 + } + }, + "s0_bos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "07af8e567201385b7a27a92653f4456cef1c4ed278c9bf1243f7d50e0a335236", + "route_weight_sha256": "59091cd26b88b6aef9703b129b8dc0b88bf0e1b335a5d5cc58b61d619b7f02d1", + "loads": [ + 2, + 2, + 31, + 12, + 29, + 38, + 6, + 6, + 29, + 0, + 37, + 7, + 25, + 5, + 7, + 8, + 19, + 11, + 15, + 3, + 26, + 3, + 9, + 7, + 12, + 12, + 18, + 1, + 15, + 2, + 10, + 8, + 5, + 6, + 0, + 1, + 14, + 10, + 17, + 8, + 3, + 9, + 9, + 0, + 2, + 0, + 11, + 11, + 6, + 14, + 5, + 4, + 6, + 8, + 1, + 1, + 16, + 8, + 8, + 17, + 4, + 4, + 8, + 5 + ], + "weighted_loads": [ + 0.10776766762137413, + 0.08092525601387024, + 3.1019180938601494, + 1.7575336024165154, + 2.7245481237769127, + 2.92611744068563, + 0.3524560835212469, + 0.3035073336213827, + 1.4126350115984678, + 0.0, + 2.708540018647909, + 0.3547228705137968, + 1.4324050843715668, + 0.27078131027519703, + 0.2720385044813156, + 0.3177526332437992, + 1.129737664014101, + 0.6423478834331036, + 0.8617993984371424, + 0.14391497895121574, + 1.0876248851418495, + 0.2403324842453003, + 0.4436698481440544, + 0.4649885781109333, + 0.6552807241678238, + 0.5442593954503536, + 0.9102836698293686, + 0.02908659167587757, + 1.0362155381590128, + 0.0654989741742611, + 0.48379177041351795, + 0.6380481738597155, + 0.21099861897528172, + 0.1710428949445486, + 0.0, + 0.036332666873931885, + 0.8315920978784561, + 0.4296767860651016, + 1.3464413322508335, + 0.4058723449707031, + 0.17444423213601112, + 0.45385567471385, + 0.9364422857761383, + 0.0, + 0.05768481269478798, + 0.0, + 0.8309416100382805, + 0.6137402765452862, + 0.5026388633996248, + 2.3693211246281862, + 0.17403100430965424, + 0.19647664204239845, + 0.2737270873039961, + 0.25772213377058506, + 0.03380749374628067, + 0.021488144993782043, + 1.0297944620251656, + 0.4690482299774885, + 0.41749903187155724, + 1.3637419566512108, + 0.3140338771045208, + 0.14602954871952534, + 0.424666129052639, + 0.1851781290024519 + ], + "unique_experts": 60, + "load_cv": 0.8899537745400069, + "normalized_load_entropy": 0.9125165279166038, + "max_load_share": 0.059748427672955975 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "c170865c817a3124bd64e8ed52c2910e6394a10a68417873e0645c90466a0417", + "route_weight_sha256": "846aa77794bbecfd6eda06d24f2fafc7fd8ac7a06000139d37bb3ff449cd1135", + "loads": [ + 6, + 2, + 33, + 21, + 29, + 40, + 10, + 7, + 42, + 5, + 38, + 8, + 25, + 5, + 9, + 9, + 19, + 13, + 15, + 3, + 26, + 10, + 10, + 7, + 15, + 14, + 19, + 5, + 15, + 2, + 10, + 8, + 8, + 12, + 1, + 5, + 14, + 12, + 17, + 9, + 7, + 9, + 14, + 0, + 2, + 1, + 13, + 11, + 11, + 16, + 9, + 4, + 6, + 10, + 1, + 13, + 19, + 10, + 9, + 17, + 13, + 12, + 8, + 13 + ], + "weighted_loads": [ + 0.2825566092506051, + 0.08092525601387024, + 3.178817469626665, + 2.7978557497262955, + 2.7245481237769127, + 3.0418813163414598, + 0.6629383508116007, + 1.2316559609025717, + 2.594859419390559, + 0.19242935813963413, + 2.7258167173713446, + 0.36717598233371973, + 1.4324050843715668, + 0.27078131027519703, + 0.6911062300205231, + 0.3595830053091049, + 1.129737664014101, + 0.7222162261605263, + 0.8617993984371424, + 0.14391497895121574, + 1.0876248851418495, + 0.8884323984384537, + 0.47231934405863285, + 0.4649885781109333, + 0.7099972520954907, + 0.6045890524983406, + 0.9747097417712212, + 0.18848394975066185, + 1.0362155381590128, + 0.0654989741742611, + 0.48379177041351795, + 0.6380481738597155, + 0.3422135729342699, + 0.38479332625865936, + 0.06414485722780228, + 0.21246782690286636, + 0.8315920978784561, + 0.5147031843662262, + 1.3464413322508335, + 0.4700332060456276, + 0.4031786620616913, + 0.45385567471385, + 1.2712139759678394, + 0.0, + 0.05768481269478798, + 0.03088296204805374, + 0.8992798272520304, + 0.6137402765452862, + 0.8125943038612604, + 2.499058563960716, + 0.3535423446446657, + 0.19647664204239845, + 0.2737270873039961, + 0.3691916186362505, + 0.03380749374628067, + 1.1137706600129604, + 1.1519537307322025, + 0.5018748133443296, + 0.5438928417861462, + 1.3637419566512108, + 1.548764429986477, + 0.427028676494956, + 0.424666129052639, + 0.5124997440725565 + ], + "unique_experts": 63, + "load_cv": 0.735853050377254, + "normalized_load_entropy": 0.9404588510103127, + "max_load_share": 0.05343511450381679 + } + }, + "s1_bos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "fd70cebf7b4e5e8168ed6aa92722aae35dc685f055dc980a9ae3074497958a8c", + "route_weight_sha256": "b7b9a1e65f638c5b9711bb7df08c6690c59ad607a6b49907a3e6566cc9a33f03", + "loads": [ + 2, + 3, + 30, + 12, + 29, + 34, + 6, + 6, + 33, + 0, + 38, + 7, + 25, + 5, + 9, + 7, + 19, + 11, + 14, + 3, + 25, + 3, + 10, + 6, + 11, + 14, + 17, + 2, + 15, + 2, + 10, + 7, + 6, + 5, + 0, + 1, + 13, + 10, + 17, + 9, + 3, + 8, + 8, + 0, + 2, + 0, + 12, + 11, + 6, + 12, + 5, + 4, + 6, + 9, + 1, + 1, + 15, + 9, + 9, + 19, + 4, + 2, + 8, + 6 + ], + "weighted_loads": [ + 0.11058268696069717, + 0.11713604256510735, + 3.0472803078591824, + 1.723163515329361, + 2.6740711499005556, + 2.6514493860304356, + 0.35760651901364326, + 0.30654532089829445, + 1.5275692883878946, + 0.0, + 2.7587709426879883, + 0.35020296089351177, + 1.4137066677212715, + 0.2772653792053461, + 0.34317958541214466, + 0.28383518010377884, + 1.1202133782207966, + 0.6501526292413473, + 0.8134837057441473, + 0.1498250886797905, + 1.095034521073103, + 0.22971811890602112, + 0.47384197264909744, + 0.41603079810738564, + 0.6354357320815325, + 0.5932470336556435, + 0.870929054915905, + 0.06365559622645378, + 1.043827548623085, + 0.06828656792640686, + 0.4929759278893471, + 0.6045811586081982, + 0.24550978280603886, + 0.14542640559375286, + 0.0, + 0.03722838684916496, + 0.773603767156601, + 0.4394427761435509, + 1.369384977966547, + 0.43584248796105385, + 0.17930524051189423, + 0.4235655553638935, + 0.8882211148738861, + 0.0, + 0.054162539541721344, + 0.0, + 0.8396437633782625, + 0.6261855363845825, + 0.5130915250629187, + 2.271158989518881, + 0.18886765465140343, + 0.20488565415143967, + 0.28170434571802616, + 0.30349482223391533, + 0.032524269074201584, + 0.018014663830399513, + 0.9812452867627144, + 0.5055571608245373, + 0.4592664483934641, + 1.4399217814207077, + 0.3144663833081722, + 0.06780488789081573, + 0.4103104956448078, + 0.21600586734712124 + ], + "unique_experts": 60, + "load_cv": 0.8829928860697622, + "normalized_load_entropy": 0.9136906525104591, + "max_load_share": 0.059748427672955975 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "fc622c703b9b8ff994aa772404c352159c0aad5c7f94d574d4d0c248e95d83ed", + "route_weight_sha256": "bf94b269da6000a304f665f9fe56cb4f603427db4b8ac1e607bf9b7e729c892a", + "loads": [ + 4, + 7, + 30, + 24, + 29, + 36, + 11, + 8, + 53, + 9, + 38, + 12, + 28, + 5, + 13, + 12, + 22, + 14, + 15, + 3, + 26, + 15, + 12, + 6, + 12, + 15, + 18, + 5, + 16, + 2, + 11, + 7, + 8, + 16, + 8, + 7, + 15, + 12, + 17, + 10, + 14, + 9, + 13, + 2, + 2, + 0, + 14, + 13, + 12, + 15, + 15, + 7, + 11, + 13, + 1, + 20, + 19, + 10, + 12, + 19, + 19, + 12, + 8, + 11 + ], + "weighted_loads": [ + 0.23726001661270857, + 0.5548929795622826, + 3.0472803078591824, + 3.0511547178030014, + 2.6740711499005556, + 2.7639393201097846, + 0.7185298502445221, + 0.38732781261205673, + 3.2010650616139174, + 0.4647060912102461, + 2.7587709426879883, + 0.6794208800420165, + 1.5542511381208897, + 0.2772653792053461, + 0.8836279176175594, + 0.5633904747664928, + 1.265519417822361, + 0.7730960100889206, + 0.8534998204559088, + 0.1498250886797905, + 1.1434088088572025, + 1.3018893860280514, + 0.5641447678208351, + 0.41603079810738564, + 0.6673561539500952, + 0.618804095312953, + 0.9393298253417015, + 0.18803123757243156, + 1.1264401376247406, + 0.06828656792640686, + 0.5311979614198208, + 0.6045811586081982, + 0.34402800165116787, + 0.5487113241106272, + 0.34505665861070156, + 0.289611853659153, + 0.8637632802128792, + 0.5259735807776451, + 1.369384977966547, + 0.4972708970308304, + 0.8959146030247211, + 0.4490087255835533, + 1.3437320813536644, + 0.1360919177532196, + 0.054162539541721344, + 0.0, + 0.9062285106629133, + 0.6926822774112225, + 0.8977352511137724, + 2.802740205079317, + 0.6635958105325699, + 0.4165945537388325, + 0.8268834631890059, + 0.5129832401871681, + 0.032524269074201584, + 1.7178825046867132, + 1.1951391845941544, + 0.5305415615439415, + 0.648603143170476, + 1.4399217814207077, + 2.3728782571852207, + 0.48429007083177567, + 0.4103104956448078, + 0.46952675841748714 + ], + "unique_experts": 63, + "load_cv": 0.6696640778170705, + "normalized_load_entropy": 0.9506521376855273, + "max_load_share": 0.060090702947845805 + } + }, + "s0_x": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "abe5a0faa5ee2a2fda87196e1080636e2674fc8da42260f0ba48ff01f18695d8", + "route_weight_sha256": "e687150783fea56392003d36cf247444574129a6a265b02a5b5f79dd86c31525", + "loads": [ + 2, + 4, + 31, + 12, + 28, + 34, + 6, + 10, + 29, + 0, + 36, + 7, + 25, + 5, + 8, + 8, + 20, + 10, + 16, + 3, + 26, + 4, + 11, + 7, + 12, + 13, + 17, + 0, + 15, + 1, + 10, + 8, + 3, + 4, + 0, + 1, + 12, + 10, + 17, + 9, + 3, + 8, + 9, + 0, + 1, + 0, + 10, + 11, + 6, + 13, + 5, + 3, + 6, + 9, + 1, + 2, + 16, + 9, + 8, + 19, + 4, + 4, + 9, + 6 + ], + "weighted_loads": [ + 0.11512251943349838, + 0.15273244306445122, + 3.0549290888011456, + 1.7746375985443592, + 2.685312367975712, + 2.763442225754261, + 0.34960252419114113, + 0.3928188569843769, + 1.3216371200978756, + 0.0, + 2.678245734423399, + 0.35230371356010437, + 1.4052401036024094, + 0.27520569413900375, + 0.32286790013313293, + 0.31379545852541924, + 1.1542847864329815, + 0.617532841861248, + 0.8952195346355438, + 0.1421537883579731, + 1.0969042386859655, + 0.26933033764362335, + 0.517632070928812, + 0.4396904185414314, + 0.662701677531004, + 0.5694593787193298, + 0.8630332052707672, + 0.0, + 1.0288875941187143, + 0.0333065539598465, + 0.4745118636637926, + 0.6417737938463688, + 0.14064407534897327, + 0.12122021242976189, + 0.0, + 0.036656420677900314, + 0.742317222058773, + 0.4384097717702389, + 1.334181897342205, + 0.46104734390974045, + 0.17254726961255074, + 0.424100361764431, + 0.9467267952859402, + 0.0, + 0.030418716371059418, + 0.0, + 0.7615540139377117, + 0.6156000215560198, + 0.48454444855451584, + 2.349357381463051, + 0.18153825402259827, + 0.16128430888056755, + 0.2706722058355808, + 0.29769490472972393, + 0.03397751599550247, + 0.03996247798204422, + 1.023416006937623, + 0.49432894960045815, + 0.42343153432011604, + 1.4203734919428825, + 0.3251812383532524, + 0.15538732707500458, + 0.4344349391758442, + 0.2137176413089037 + ], + "unique_experts": 59, + "load_cv": 0.8670809864866695, + "normalized_load_entropy": 0.9135480673484523, + "max_load_share": 0.05660377358490566 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "93ac184fd34252d77fd34b8fe72372f7d89d8d7c83e9cffcfe94fd30c39fff7e", + "route_weight_sha256": "c4d7f33a0cfcdb8839cdc4ad103e9462d92087c2ebea5e57ca82bd36b77dc41a", + "loads": [ + 6, + 6, + 33, + 22, + 28, + 37, + 11, + 10, + 42, + 6, + 36, + 8, + 25, + 5, + 11, + 8, + 20, + 13, + 16, + 3, + 26, + 12, + 12, + 7, + 12, + 15, + 18, + 2, + 15, + 1, + 11, + 8, + 6, + 12, + 2, + 3, + 12, + 10, + 17, + 10, + 7, + 8, + 14, + 0, + 1, + 1, + 12, + 11, + 8, + 15, + 10, + 3, + 6, + 11, + 1, + 16, + 19, + 10, + 9, + 19, + 12, + 13, + 10, + 13 + ], + "weighted_loads": [ + 0.28991146106272936, + 0.23249758407473564, + 3.1318284645676613, + 2.9176786839962006, + 2.685312367975712, + 2.9001164445653558, + 0.7382571175694466, + 0.3928188569843769, + 2.503169856965542, + 0.22343317978084087, + 2.678245734423399, + 0.3647568253800273, + 1.4052401036024094, + 0.27520569413900375, + 0.7722013145685196, + 0.31379545852541924, + 1.1542847864329815, + 0.7372367642819881, + 0.8952195346355438, + 0.1421537883579731, + 1.0969042386859655, + 0.9928791895508766, + 0.5462815668433905, + 0.4396904185414314, + 0.662701677531004, + 0.6297890357673168, + 0.92298349365592, + 0.07163579948246479, + 1.0288875941187143, + 0.0333065539598465, + 0.5193713288754225, + 0.6417737938463688, + 0.26792500726878643, + 0.4231627378612757, + 0.09277216717600822, + 0.12183854356408119, + 0.742317222058773, + 0.4384097717702389, + 1.334181897342205, + 0.5245701670646667, + 0.42622627317905426, + 0.424100361764431, + 1.3624614030122757, + 0.0, + 0.030418716371059418, + 0.03088296204805374, + 0.828800281509757, + 0.6156000215560198, + 0.6169076561927795, + 2.60121613740921, + 0.4305944927036762, + 0.16128430888056755, + 0.2706722058355808, + 0.41128202341496944, + 0.03397751599550247, + 1.3421848006546497, + 1.14557527564466, + 0.51996785774827, + 0.5287824384868145, + 1.4203734919428825, + 1.4689961560070515, + 0.4915864020586014, + 0.4638304505497217, + 0.46772907860577106 + ], + "unique_experts": 63, + "load_cv": 0.7207758109285751, + "normalized_load_entropy": 0.9409262202074069, + "max_load_share": 0.05343511450381679 + } + }, + "s1_x": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "4a68812304a151e2260841a1eeff6986bc440092948a4dcad616cae512adaf2e", + "route_weight_sha256": "539d72328326fbc1c87ff3c4254feb3b79f239d071355cf4a203fb974bbd750c", + "loads": [ + 2, + 2, + 30, + 12, + 29, + 32, + 6, + 7, + 35, + 0, + 37, + 7, + 25, + 5, + 8, + 8, + 19, + 11, + 14, + 3, + 22, + 4, + 10, + 7, + 11, + 13, + 17, + 1, + 15, + 1, + 12, + 8, + 5, + 4, + 0, + 2, + 13, + 10, + 16, + 9, + 4, + 8, + 8, + 0, + 1, + 0, + 10, + 11, + 7, + 12, + 6, + 3, + 6, + 9, + 1, + 2, + 15, + 9, + 8, + 18, + 4, + 6, + 8, + 8 + ], + "weighted_loads": [ + 0.11056139320135117, + 0.0866200365126133, + 3.017244003713131, + 1.7684139497578144, + 2.67160726711154, + 2.564875489100814, + 0.3596909213811159, + 0.3155469335615635, + 1.5632984340190887, + 0.0, + 2.7269139364361763, + 0.34971646033227444, + 1.3889688290655613, + 0.2627812158316374, + 0.32766843400895596, + 0.31350431963801384, + 1.1035919040441513, + 0.6588960271328688, + 0.8159566465765238, + 0.13722514733672142, + 0.9650181289762259, + 0.26441100239753723, + 0.45705448649823666, + 0.4185632672160864, + 0.6424189433455467, + 0.5681681893765926, + 0.8726966790854931, + 0.03504737466573715, + 1.0064775552600622, + 0.029495488852262497, + 0.5467473659664392, + 0.6319676339626312, + 0.20742632448673248, + 0.12054423987865448, + 0.0, + 0.06905793771147728, + 0.7681145071983337, + 0.4457826018333435, + 1.306276898831129, + 0.4764000438153744, + 0.21244357526302338, + 0.4315287508070469, + 0.8984688818454742, + 0.0, + 0.032098438590765, + 0.0, + 0.7489739209413528, + 0.623630229383707, + 0.5155268386006355, + 2.28186896443367, + 0.22171791456639767, + 0.17103588208556175, + 0.2759567406028509, + 0.30324387177824974, + 0.03232347220182419, + 0.039752187207341194, + 0.9558869823813438, + 0.5083559639751911, + 0.4106555972248316, + 1.40221431478858, + 0.33000944182276726, + 0.22979401424527168, + 0.39892883598804474, + 0.28368050791323185 + ], + "unique_experts": 60, + "load_cv": 0.862690443228957, + "normalized_load_entropy": 0.916826453540909, + "max_load_share": 0.05817610062893082 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "47292f365d983ed788160947a605007f9476229f44bf4dbf363ea1af0bfec431", + "route_weight_sha256": "f1db074e1debfffa8330596de7849c8a6a3c76d9168e4e816d9a0a10e16b6a00", + "loads": [ + 5, + 7, + 30, + 24, + 29, + 35, + 12, + 9, + 57, + 10, + 37, + 11, + 28, + 5, + 12, + 12, + 22, + 14, + 15, + 3, + 23, + 17, + 11, + 7, + 11, + 14, + 18, + 3, + 16, + 1, + 12, + 8, + 7, + 13, + 8, + 6, + 15, + 11, + 16, + 10, + 16, + 9, + 13, + 2, + 2, + 0, + 11, + 13, + 10, + 15, + 17, + 6, + 11, + 14, + 1, + 25, + 19, + 10, + 11, + 18, + 18, + 18, + 8, + 11 + ], + "weighted_loads": [ + 0.2628790223971009, + 0.5594473071396351, + 3.017244003713131, + 3.1308261193335056, + 2.67160726711154, + 2.687598622404039, + 0.7632333058863878, + 0.3963294252753258, + 3.3135335333645344, + 0.513301556929946, + 2.7269139364361763, + 0.633382766507566, + 1.5295132994651794, + 0.2627812158316374, + 0.8469011411070824, + 0.5500016063451767, + 1.2488979436457157, + 0.747700959444046, + 0.8559727612882853, + 0.13722514733672142, + 1.0133924167603254, + 1.3947088532149792, + 0.500010984018445, + 0.4185632672160864, + 0.6424189433455467, + 0.5937252510339022, + 0.9297408014535904, + 0.10567997023463249, + 1.0890901442617178, + 0.029495488852262497, + 0.5467473659664392, + 0.6319676339626312, + 0.31396331265568733, + 0.4526767134666443, + 0.34505665861070156, + 0.22951683029532433, + 0.858274020254612, + 0.4771709255874157, + 1.306276898831129, + 0.5392459817230701, + 0.9668395556509495, + 0.4569719210267067, + 1.4098695144057274, + 0.1360919177532196, + 0.08476515486836433, + 0.0, + 0.7834862396121025, + 0.690126970410347, + 0.676043763756752, + 2.8281229734420776, + 0.741335766389966, + 0.38274478167295456, + 0.8211358580738306, + 0.5237408019602299, + 0.03232347220182419, + 2.1140822675079107, + 1.1697808802127838, + 0.5333403646945953, + 0.5816467273980379, + 1.40221431478858, + 2.2960273921489716, + 0.7998203858733177, + 0.39892883598804474, + 0.43093870393931866 + ], + "unique_experts": 63, + "load_cv": 0.6904715361630979, + "normalized_load_entropy": 0.9480758475676706, + "max_load_share": 0.06462585034013606 + } + }, + "s0_period": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "fd3b68fbf231e2becdf25733fe3ff49778455039a96d45ad88f68d0324a41417", + "route_weight_sha256": "259a3f1ebebcf0f47df7f16f49d595ec0836220c1c41e142489e4814c4fca34f", + "loads": [ + 2, + 4, + 31, + 12, + 29, + 34, + 5, + 7, + 30, + 0, + 37, + 7, + 25, + 5, + 8, + 9, + 20, + 11, + 17, + 3, + 26, + 4, + 10, + 6, + 13, + 14, + 17, + 0, + 14, + 2, + 11, + 8, + 3, + 4, + 1, + 1, + 13, + 10, + 17, + 9, + 3, + 7, + 7, + 0, + 2, + 0, + 12, + 11, + 6, + 13, + 6, + 3, + 6, + 8, + 1, + 2, + 16, + 9, + 7, + 18, + 4, + 0, + 9, + 7 + ], + "weighted_loads": [ + 0.10761161521077156, + 0.15327243134379387, + 3.0795163214206696, + 1.7748927511274815, + 2.693786136806011, + 2.7572167478501797, + 0.32886814698576927, + 0.33340352959930897, + 1.395387165248394, + 0.0, + 2.7523779049515724, + 0.35073618590831757, + 1.4223039150238037, + 0.2770462539047003, + 0.309477336704731, + 0.3513106666505337, + 1.1514118388295174, + 0.6502692345529795, + 0.9044942427426577, + 0.15127526223659515, + 1.0785227548331022, + 0.27609775215387344, + 0.47934744879603386, + 0.42736077308654785, + 0.6973210666328669, + 0.5974698383361101, + 0.8788764774799347, + 0.0, + 0.9992805309593678, + 0.06697749719023705, + 0.4965349826961756, + 0.6226093228906393, + 0.1434401012957096, + 0.11507528088986874, + 0.04932878911495209, + 0.03651821240782738, + 0.7921781688928604, + 0.4323301874101162, + 1.332434982061386, + 0.45711613819003105, + 0.16919487342238426, + 0.37388357147574425, + 0.8623007051646709, + 0.0, + 0.052125174552202225, + 0.0, + 0.8494321350008249, + 0.6199080664664507, + 0.4814235679805279, + 2.3410254791378975, + 0.204646123573184, + 0.16410424932837486, + 0.2730488032102585, + 0.2670823186635971, + 0.03299858421087265, + 0.03967026434838772, + 1.0222785640507936, + 0.49720591120421886, + 0.3773384392261505, + 1.3955198805779219, + 0.3310812935233116, + 0.0, + 0.4454240333288908, + 0.2571575026959181 + ], + "unique_experts": 59, + "load_cv": 0.8829928860697622, + "normalized_load_entropy": 0.911286690757135, + "max_load_share": 0.05817610062893082 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "6143b9a1ef95f4e541150d4d13a10654e4dbe9fb8ec02a65304a8612c7cda8aa", + "route_weight_sha256": "bc34b205325649fc773470fb21180766c6164b693e91fe1c6d0b22cad0044ddd", + "loads": [ + 7, + 6, + 33, + 21, + 29, + 36, + 9, + 7, + 43, + 5, + 37, + 8, + 25, + 5, + 12, + 9, + 20, + 14, + 17, + 3, + 26, + 13, + 11, + 6, + 14, + 16, + 18, + 2, + 14, + 2, + 11, + 8, + 6, + 10, + 2, + 3, + 13, + 10, + 17, + 11, + 8, + 7, + 12, + 0, + 3, + 1, + 14, + 11, + 10, + 15, + 11, + 3, + 6, + 11, + 1, + 15, + 19, + 10, + 8, + 18, + 13, + 8, + 9, + 14 + ], + "weighted_loads": [ + 0.30662022810429335, + 0.28352415189146996, + 3.1564156971871853, + 2.8203779086470604, + 2.693786136806011, + 2.8829750707373023, + 0.6452211067080498, + 0.33340352959930897, + 2.5779565945267677, + 0.19242935813963413, + 2.7523779049515724, + 0.3631892977282405, + 1.4223039150238037, + 0.2770462539047003, + 0.793260034173727, + 0.3513106666505337, + 1.1514118388295174, + 0.7970476690679789, + 0.9044942427426577, + 0.15127526223659515, + 1.0785227548331022, + 1.0434884540736675, + 0.5079969447106123, + 0.42736077308654785, + 0.7253929991275072, + 0.6577994953840971, + 0.9396682269871235, + 0.07163579948246479, + 0.9992805309593678, + 0.06697749719023705, + 0.4965349826961756, + 0.6226093228906393, + 0.2707860879600048, + 0.3330208621919155, + 0.11347364634275436, + 0.12266658246517181, + 0.7921781688928604, + 0.4323301874101162, + 1.332434982061386, + 0.5538659282028675, + 0.4747941829264164, + 0.37388357147574425, + 1.2429197207093239, + 0.0, + 0.07712135091423988, + 0.03088296204805374, + 0.9179112184792757, + 0.6199080664664507, + 0.674482449889183, + 2.5158615447580814, + 0.5017357710748911, + 0.16410424932837486, + 0.2730488032102585, + 0.42351267859339714, + 0.03299858421087265, + 1.241105543449521, + 1.1444378327578306, + 0.5228448193520308, + 0.48875001072883606, + 1.3955198805779219, + 1.534398090094328, + 0.2809991277754307, + 0.4454240333288908, + 0.5214904341846704 + ], + "unique_experts": 63, + "load_cv": 0.7255032584479782, + "normalized_load_entropy": 0.9413960103697434, + "max_load_share": 0.054707379134860054 + } + }, + "s1_period": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "99d1bd04a6f2877d5272dfb26e0a4c84c26e49c5ae87d0702fa3abc894e258b5", + "route_weight_sha256": "6844e9254be4cbf84cc68aca68640a32f539d9e30d73f386bc701d988bf764ad", + "loads": [ + 2, + 2, + 31, + 12, + 29, + 32, + 6, + 9, + 33, + 0, + 36, + 7, + 25, + 5, + 7, + 8, + 19, + 11, + 14, + 3, + 23, + 4, + 10, + 6, + 11, + 13, + 18, + 1, + 15, + 2, + 11, + 8, + 5, + 3, + 0, + 1, + 12, + 10, + 16, + 10, + 4, + 9, + 8, + 0, + 2, + 0, + 11, + 11, + 7, + 12, + 5, + 3, + 6, + 9, + 1, + 2, + 15, + 9, + 10, + 19, + 4, + 4, + 8, + 7 + ], + "weighted_loads": [ + 0.113039281219244, + 0.0820750780403614, + 3.0476361587643623, + 1.7589082978665829, + 2.6917242780327797, + 2.5776505190879107, + 0.3781611490994692, + 0.3788870144635439, + 1.4425683729350567, + 0.0, + 2.764920823276043, + 0.3526308685541153, + 1.4059075862169266, + 0.2601745277643204, + 0.2846276182681322, + 0.31163957342505455, + 1.1152914427220821, + 0.6463668141514063, + 0.8177691027522087, + 0.1468256674706936, + 0.9937289170920849, + 0.26285644993185997, + 0.46446315199136734, + 0.3910027705132961, + 0.657307056710124, + 0.5703596919775009, + 0.900707084685564, + 0.03314991295337677, + 1.023290030658245, + 0.06638075038790703, + 0.5190769545733929, + 0.633750619366765, + 0.20153630338609219, + 0.09049807488918304, + 0.0, + 0.03519684448838234, + 0.7271742932498455, + 0.44902968779206276, + 1.316827978938818, + 0.5108149722218513, + 0.2197856865823269, + 0.47395623475313187, + 0.8930937498807907, + 0.0, + 0.05643351376056671, + 0.0, + 0.7995176706463099, + 0.6358270812779665, + 0.518347816541791, + 2.3288324885070324, + 0.18852422758936882, + 0.1707204394042492, + 0.2770141288638115, + 0.30448813177645206, + 0.03201219066977501, + 0.040068263188004494, + 0.9484815262258053, + 0.5094257108867168, + 0.4839913882315159, + 1.434000439941883, + 0.32674305886030197, + 0.1527130827307701, + 0.40838607028126717, + 0.25343253649771214 + ], + "unique_experts": 60, + "load_cv": 0.8597509581150967, + "normalized_load_entropy": 0.9167100186182355, + "max_load_share": 0.05660377358490566 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "2867ee0e11d60f2d3bfddee0e937e21d44c493ebef7760230ecb004f7b69a097", + "route_weight_sha256": "da69a593b78910c023e4af8fcae5a9587a6535b64ed24456bd9fd7924c7bb5a1", + "loads": [ + 5, + 7, + 31, + 23, + 29, + 35, + 11, + 11, + 54, + 9, + 36, + 11, + 28, + 5, + 11, + 12, + 22, + 14, + 15, + 3, + 24, + 18, + 11, + 6, + 12, + 14, + 19, + 3, + 16, + 2, + 12, + 8, + 8, + 14, + 8, + 6, + 14, + 10, + 16, + 11, + 17, + 10, + 13, + 2, + 2, + 0, + 12, + 13, + 10, + 14, + 17, + 6, + 11, + 13, + 1, + 24, + 19, + 10, + 13, + 19, + 19, + 15, + 8, + 10 + ], + "weighted_loads": [ + 0.26709396857768297, + 0.5754736997187138, + 3.0476361587643623, + 3.0625602528452873, + 2.6917242780327797, + 2.7026675203815103, + 0.7377999629825354, + 0.4596695061773062, + 3.169965922832489, + 0.4647060912102461, + 2.764920823276043, + 0.6362971747294068, + 1.5464520566165447, + 0.2601745277643204, + 0.8672362081706524, + 0.5481368601322174, + 1.2605974823236465, + 0.7284906767308712, + 0.8577852174639702, + 0.1468256674706936, + 1.0421032048761845, + 1.433968462049961, + 0.5074196495115757, + 0.3910027705132961, + 0.6877234093844891, + 0.5959167536348104, + 0.9570656642317772, + 0.10332721471786499, + 1.1059026196599007, + 0.06638075038790703, + 0.5558158531785011, + 0.633750619366765, + 0.33467984199523926, + 0.5071134977042675, + 0.34505665861070156, + 0.23143915832042694, + 0.8173338063061237, + 0.44902968779206276, + 1.316827978938818, + 0.5726410374045372, + 1.0370287261903286, + 0.49939940497279167, + 1.3850797787308693, + 0.1360919177532196, + 0.05643351376056671, + 0.0, + 0.8340299893170595, + 0.7023238223046064, + 0.6739921439439058, + 2.7913250364363194, + 0.7893913425505161, + 0.382429338991642, + 0.8221932463347912, + 0.5135953556746244, + 0.03201219066977501, + 2.0225308258086443, + 1.1623754240572453, + 0.5344101116061211, + 0.6722331754863262, + 1.434000439941883, + 2.337050922214985, + 0.6107513718307018, + 0.40838607028126717, + 0.40069073252379894 + ], + "unique_experts": 63, + "load_cv": 0.6723614117479316, + "normalized_load_entropy": 0.9499881660684476, + "max_load_share": 0.061224489795918366 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 106, + "ordered_topk_exact_tokens": 69, + "set_exact_tokens": 80, + "mean_set_jaccard": 0.9299191374663074, + "mean_token_weighted_tv": 0.013670821779600854, + "aggregate_load_tv": 0.02515723270440251 + }, + "system_bos": { + "tokens": 106, + "ordered_topk_exact_tokens": 61, + "set_exact_tokens": 79, + "mean_set_jaccard": 0.9211590296495957, + "mean_token_weighted_tv": 0.017204164404351758, + "aggregate_load_tv": 0.0330188679245283 + }, + "system_x": { + "tokens": 106, + "ordered_topk_exact_tokens": 62, + "set_exact_tokens": 78, + "mean_set_jaccard": 0.9164420485175202, + "mean_token_weighted_tv": 0.01879090347485441, + "aggregate_load_tv": 0.036163522012578615 + }, + "system_period": { + "tokens": 106, + "ordered_topk_exact_tokens": 60, + "set_exact_tokens": 74, + "mean_set_jaccard": 0.9076819407008087, + "mean_token_weighted_tv": 0.01959009002015557, + "aggregate_load_tv": 0.04088050314465409 + }, + "bos_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 61, + "set_exact_tokens": 75, + "mean_set_jaccard": 0.914420485175202, + "mean_token_weighted_tv": 0.018834789485653054, + "aggregate_load_tv": 0.031446540880503145 + }, + "bos_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 58, + "set_exact_tokens": 76, + "mean_set_jaccard": 0.9191374663072777, + "mean_token_weighted_tv": 0.017274563350134862, + "aggregate_load_tv": 0.03144654088050314 + }, + "x_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 57, + "set_exact_tokens": 70, + "mean_set_jaccard": 0.9029649595687332, + "mean_token_weighted_tv": 0.019299134550581, + "aggregate_load_tv": 0.031446540880503145 + }, + "x_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 47, + "set_exact_tokens": 66, + "mean_set_jaccard": 0.8800539083557952, + "mean_token_weighted_tv": 0.02439275336504545, + "aggregate_load_tv": 0.04559748427672955 + }, + "period_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 58, + "set_exact_tokens": 72, + "mean_set_jaccard": 0.9063342318059299, + "mean_token_weighted_tv": 0.01926304682878391, + "aggregate_load_tv": 0.03930817610062892 + }, + "period_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 55, + "set_exact_tokens": 71, + "mean_set_jaccard": 0.9016172506738546, + "mean_token_weighted_tv": 0.021748219906651187, + "aggregate_load_tv": 0.042452830188679236 + } + } + }, + "layer_23": { + "layer": 23, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "4c64531f2f28d4e6653290ec4958d515f611a18d589880c1c5028661abbee915", + "route_weight_sha256": "9587dea6782370867852ff2f3c9bdc74d4e68baaefdaba711dd2b7d22fe97da8", + "loads": [ + 8, + 12, + 14, + 11, + 5, + 8, + 5, + 3, + 17, + 10, + 15, + 15, + 5, + 1, + 9, + 5, + 0, + 19, + 23, + 17, + 13, + 0, + 13, + 2, + 14, + 5, + 12, + 19, + 19, + 11, + 16, + 3, + 2, + 3, + 1, + 24, + 13, + 10, + 4, + 7, + 4, + 18, + 6, + 14, + 5, + 13, + 4, + 14, + 15, + 12, + 0, + 2, + 5, + 7, + 5, + 6, + 21, + 3, + 3, + 53, + 4, + 10, + 18, + 1 + ], + "weighted_loads": [ + 0.71674794703722, + 0.7351686842739582, + 0.631306029856205, + 1.7843546438962221, + 0.2232946641743183, + 0.389764990657568, + 0.3754541464149952, + 0.12715307250618935, + 1.5454888008534908, + 0.367043761536479, + 0.6126906126737595, + 0.6116535365581512, + 0.1858601812273264, + 0.04811883345246315, + 0.7646212913095951, + 0.2530227266252041, + 0.0, + 1.4067138209939003, + 1.6733650639653206, + 1.1622279360890388, + 0.6943771410733461, + 0.0, + 0.8950882777571678, + 0.3156181126832962, + 0.5390945579856634, + 0.14982532151043415, + 0.5393869690597057, + 1.090976770967245, + 1.2185690850019455, + 0.5987336933612823, + 0.6645701434463263, + 0.15824664756655693, + 0.10734151303768158, + 0.14224649220705032, + 0.025993607938289642, + 1.9914546608924866, + 0.6161829717457294, + 0.4288580846041441, + 0.30445606634020805, + 0.31663331016898155, + 0.17644217982888222, + 1.0451721902936697, + 0.2078592237085104, + 0.6761027928441763, + 0.343741986900568, + 1.6753015629947186, + 0.18253793753683567, + 1.3734398856759071, + 1.233393307775259, + 0.4989876262843609, + 0.0, + 0.17202571034431458, + 0.19586342945694923, + 0.29504843428730965, + 0.3347322940826416, + 0.23345795646309853, + 1.540220383554697, + 0.1338294856250286, + 0.09695356152951717, + 3.661474235355854, + 0.20331332460045815, + 0.7393513545393944, + 1.309024242684245, + 0.04077081382274628 + ], + "unique_experts": 61, + "load_cv": 0.8354843485981661, + "normalized_load_entropy": 0.9250783459546663, + "max_load_share": 0.08333333333333333 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "4e0fc4e643837e7f1fa577d3d06f14fe7fb3fd448834add9aba3a17e85d04b18", + "route_weight_sha256": "24c9bfbcd9605d511b57288293ef34953969949a8ec9cd6e67a82ebaadfb7714", + "loads": [ + 13, + 15, + 14, + 22, + 11, + 11, + 11, + 8, + 18, + 18, + 15, + 15, + 6, + 6, + 11, + 5, + 4, + 19, + 23, + 17, + 13, + 0, + 14, + 12, + 18, + 5, + 12, + 19, + 19, + 11, + 16, + 3, + 4, + 8, + 1, + 24, + 14, + 10, + 8, + 9, + 10, + 18, + 7, + 14, + 5, + 20, + 16, + 18, + 16, + 12, + 0, + 3, + 5, + 8, + 16, + 7, + 21, + 13, + 5, + 53, + 4, + 10, + 22, + 1 + ], + "weighted_loads": [ + 0.9101105113513768, + 0.9054897576570511, + 0.631306029856205, + 2.116902138805017, + 0.4800583552569151, + 0.5158855561167002, + 0.7889639623463154, + 0.32524538040161133, + 1.5462335947086103, + 0.6628683153539896, + 0.6126906126737595, + 0.6116535365581512, + 0.19612314365804195, + 0.2845131531357765, + 0.8765960372984409, + 0.2530227266252041, + 0.07809572434052825, + 1.4067138209939003, + 1.6733650639653206, + 1.1622279360890388, + 0.6943771410733461, + 0.0, + 0.913728779181838, + 1.6143734827637672, + 0.6799750681966543, + 0.14982532151043415, + 0.5393869690597057, + 1.090976770967245, + 1.2185690850019455, + 0.5987336933612823, + 0.6645701434463263, + 0.15824664756655693, + 0.1974920518696308, + 0.4680085558211431, + 0.025993607938289642, + 1.9914546608924866, + 0.6633141227066517, + 0.4288580846041441, + 0.5209267484024167, + 0.36825413070619106, + 0.4539596661925316, + 1.0451721902936697, + 0.23270352184772491, + 0.6761027928441763, + 0.343741986900568, + 3.8022889588028193, + 1.1911413352936506, + 1.5284983834717423, + 1.2729128897190094, + 0.4989876262843609, + 0.0, + 0.2622397467494011, + 0.19586342945694923, + 0.36622702702879906, + 1.3013746552169323, + 0.26777319610118866, + 1.540220383554697, + 1.1697134021669626, + 0.20856651477515697, + 3.661474235355854, + 0.20331332460045815, + 0.7393513545393944, + 1.4862782657146454, + 0.04077081382274628 + ], + "unique_experts": 62, + "load_cv": 0.65083766324791, + "normalized_load_entropy": 0.951198438365905, + "max_load_share": 0.06743002544529263 + } + }, + "s1_eos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "4135d63f89723fd7a3d6c389b1429bcb24077a81ff8bdcc3811c1dc68af92d39", + "route_weight_sha256": "38c22617484d071f9d90d4b5e2817b90ea29c96ae3bc3f1b1029fd2783f7a176", + "loads": [ + 8, + 12, + 13, + 11, + 5, + 8, + 5, + 3, + 17, + 11, + 17, + 18, + 5, + 1, + 10, + 5, + 0, + 19, + 23, + 17, + 13, + 0, + 13, + 2, + 15, + 5, + 10, + 18, + 19, + 11, + 16, + 3, + 2, + 3, + 1, + 26, + 11, + 11, + 4, + 7, + 4, + 18, + 6, + 13, + 6, + 13, + 4, + 14, + 15, + 7, + 0, + 3, + 4, + 5, + 5, + 7, + 21, + 3, + 3, + 53, + 4, + 10, + 19, + 1 + ], + "weighted_loads": [ + 0.7062787376344204, + 0.7350549139082432, + 0.6001788135617971, + 1.8011149056255817, + 0.2130342312157154, + 0.3883955553174019, + 0.3740648403763771, + 0.1301642544567585, + 1.5691288076341152, + 0.40969013795256615, + 0.6818834207952023, + 0.697762206196785, + 0.19484942965209484, + 0.04923831298947334, + 0.796421704813838, + 0.2556112203747034, + 0.0, + 1.3986891508102417, + 1.6941409222781658, + 1.1378108095377684, + 0.713056294247508, + 0.0, + 0.8939924761652946, + 0.31899236887693405, + 0.5725388322025537, + 0.14773476496338844, + 0.5019414257258177, + 1.0654722787439823, + 1.227486152201891, + 0.5972614996135235, + 0.6761515885591507, + 0.15302304551005363, + 0.10943625867366791, + 0.13226522877812386, + 0.028768455609679222, + 2.1154192071408033, + 0.5533741991966963, + 0.46003120951354504, + 0.31147727742791176, + 0.31552383676171303, + 0.1702849641442299, + 1.051845921203494, + 0.20988530479371548, + 0.6439757272601128, + 0.37853556498885155, + 1.6520343832671642, + 0.18817340023815632, + 1.3669087700545788, + 1.2474900670349598, + 0.33906647749245167, + 0.0, + 0.20716499164700508, + 0.16081690602004528, + 0.21559598110616207, + 0.33262335881590843, + 0.26058737374842167, + 1.5433553289622068, + 0.13353245332837105, + 0.09480175003409386, + 3.670407924801111, + 0.196982117369771, + 0.7472932934761047, + 1.3482441194355488, + 0.04118044674396515 + ], + "unique_experts": 61, + "load_cv": 0.8456488800919536, + "normalized_load_entropy": 0.9238464666245466, + "max_load_share": 0.08333333333333333 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "3aa3502f31e6e6cf6accfaf2734095e4680f9f778ae00ba2adc11d61f1116753", + "route_weight_sha256": "f9a5fc3bb2bd80d3637f05ef320c2b528372ce4e6cdaaeeec946822a74961cbb", + "loads": [ + 14, + 17, + 19, + 22, + 10, + 11, + 17, + 10, + 19, + 16, + 19, + 19, + 6, + 6, + 12, + 8, + 5, + 20, + 25, + 17, + 14, + 0, + 14, + 16, + 18, + 5, + 10, + 18, + 19, + 12, + 16, + 3, + 4, + 15, + 1, + 26, + 17, + 12, + 11, + 8, + 13, + 18, + 8, + 13, + 8, + 23, + 21, + 19, + 21, + 10, + 0, + 13, + 10, + 7, + 16, + 7, + 21, + 19, + 5, + 53, + 6, + 11, + 26, + 3 + ], + "weighted_loads": [ + 1.0266726408153772, + 1.0552499368786812, + 0.9194103088229895, + 2.373655165778473, + 0.4314956273883581, + 0.510954724624753, + 1.1018721964210272, + 0.3704315721988678, + 1.6034433722961694, + 0.6177731081843376, + 0.7768650762736797, + 0.7290224097669125, + 0.20505269058048725, + 0.28991299867630005, + 0.9311051163822412, + 0.3784048967063427, + 0.11940955417230725, + 1.4569720551371574, + 1.7846109680831432, + 1.1378108095377684, + 0.759777246043086, + 0.0, + 0.9124239943921566, + 2.1583871319890022, + 0.6982460636645555, + 0.14773476496338844, + 0.5019414257258177, + 1.0654722787439823, + 1.227486152201891, + 0.6430013999342918, + 0.6761515885591507, + 0.15302304551005363, + 0.19515342265367508, + 0.8425659111235291, + 0.028768455609679222, + 2.1154192071408033, + 0.9851379040628672, + 0.5078096855431795, + 0.7638180777430534, + 0.34051366709172726, + 0.5228628944605589, + 1.051845921203494, + 0.2630455922335386, + 0.6439757272601128, + 0.48049865290522575, + 3.889714812859893, + 1.842862168326974, + 1.6750016475562006, + 1.5112325735390186, + 0.49123273976147175, + 0.0, + 0.8247006367892027, + 0.8021872248500586, + 0.3177293110638857, + 1.3334641642868519, + 0.26058737374842167, + 1.5433553289622068, + 1.749859170988202, + 0.23007326945662498, + 3.670407924801111, + 0.2714946363121271, + 0.8726947158575058, + 1.6353966556489468, + 0.11980248242616653 + ], + "unique_experts": 62, + "load_cv": 0.5901227123988164, + "normalized_load_entropy": 0.958093426624395, + "max_load_share": 0.060090702947845805 + } + }, + "s0_bos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "99fdd99a0ba4ca0ac8113e22ed2c0ba761cb09d3f265c159e2c996f250f4e258", + "route_weight_sha256": "7a7758c1fb367c5d053c614243dbbc4d38e834ab04e8902ae32806ade7c885e5", + "loads": [ + 8, + 12, + 12, + 11, + 6, + 10, + 5, + 3, + 17, + 11, + 15, + 14, + 5, + 1, + 10, + 4, + 0, + 20, + 23, + 18, + 13, + 0, + 13, + 2, + 16, + 2, + 15, + 19, + 18, + 12, + 14, + 3, + 2, + 3, + 1, + 24, + 14, + 10, + 4, + 7, + 4, + 17, + 6, + 13, + 5, + 12, + 3, + 14, + 15, + 10, + 0, + 3, + 5, + 6, + 5, + 6, + 22, + 3, + 3, + 53, + 4, + 10, + 19, + 1 + ], + "weighted_loads": [ + 0.7234743386507034, + 0.7387913838028908, + 0.5523531548678875, + 1.8171947188675404, + 0.24577108770608902, + 0.4351719804108143, + 0.38625214248895645, + 0.12737955898046494, + 1.5594026036560535, + 0.3967125080525875, + 0.6018304247409105, + 0.5580107849091291, + 0.20091864094138145, + 0.048113808035850525, + 0.8046025279909372, + 0.22426755726337433, + 0.0, + 1.4619724117219448, + 1.685823231935501, + 1.1972447261214256, + 0.6959020085632801, + 0.0, + 0.9026441108435392, + 0.2957015410065651, + 0.585308900102973, + 0.06876882910728455, + 0.6592601239681244, + 1.1126220747828484, + 1.1984369903802872, + 0.6476170420646667, + 0.622007992118597, + 0.15784206986427307, + 0.09799731895327568, + 0.13718963041901588, + 0.024706175550818443, + 2.0049043856561184, + 0.6696726344525814, + 0.4285511430352926, + 0.31028956919908524, + 0.3161185346543789, + 0.1786416582763195, + 1.022638438269496, + 0.2081078626215458, + 0.6437077429145575, + 0.34549130499362946, + 1.5925614908337593, + 0.14753305725753307, + 1.3502443935722113, + 1.2404295913875103, + 0.46419995464384556, + 0.0, + 0.20811576396226883, + 0.2068399991840124, + 0.2559831477701664, + 0.3210736885666847, + 0.2343116533011198, + 1.6155304573476315, + 0.13288213685154915, + 0.0944428239017725, + 3.773030821233988, + 0.19576003961265087, + 0.7458143569529057, + 1.347331015393138, + 0.04200431704521179 + ], + "unique_experts": 61, + "load_cv": 0.8428376953605595, + "normalized_load_entropy": 0.9233831786153479, + "max_load_share": 0.08333333333333333 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "f2d43644afe203b75167955de9832ab0a31885a2cad58c17ba76e3e15186b797", + "route_weight_sha256": "2eecaa314bb936542948f5262f93e145b3864d5f145a2d19150aca8a9bfa5cd3", + "loads": [ + 11, + 15, + 12, + 21, + 11, + 13, + 11, + 8, + 17, + 19, + 15, + 14, + 7, + 6, + 11, + 4, + 3, + 20, + 23, + 19, + 13, + 0, + 14, + 13, + 20, + 2, + 16, + 19, + 18, + 12, + 14, + 3, + 3, + 6, + 1, + 24, + 14, + 11, + 7, + 9, + 12, + 17, + 8, + 14, + 5, + 18, + 15, + 17, + 16, + 10, + 1, + 4, + 5, + 8, + 15, + 8, + 22, + 14, + 6, + 54, + 4, + 10, + 23, + 1 + ], + "weighted_loads": [ + 0.845941704697907, + 0.9091124571859837, + 0.5523531548678875, + 2.1393862678669393, + 0.4853140953928232, + 0.5589334387332201, + 0.7902328483760357, + 0.32929258421063423, + 1.5594026036560535, + 0.6880910806357861, + 0.6018304247409105, + 0.5580107849091291, + 0.24346929043531418, + 0.2970098406076431, + 0.8777918685227633, + 0.22426755726337433, + 0.05152639327570796, + 1.4619724117219448, + 1.685823231935501, + 1.3677411302924156, + 0.6959020085632801, + 0.0, + 0.9212846122682095, + 1.699538204818964, + 0.7347237076610327, + 0.06876882910728455, + 0.781316265463829, + 1.1126220747828484, + 1.1984369903802872, + 0.6476170420646667, + 0.622007992118597, + 0.15784206986427307, + 0.15280437096953392, + 0.4195171929895878, + 0.024706175550818443, + 2.0049043856561184, + 0.6696726344525814, + 0.4677151832729578, + 0.4872983815148473, + 0.3672149386256933, + 0.5397821012884378, + 1.022638438269496, + 0.2679277639836073, + 0.6920962017029524, + 0.34549130499362946, + 2.7483622189611197, + 1.1522393617779016, + 1.4994853399693966, + 1.2799491733312607, + 0.46419995464384556, + 0.0507768839597702, + 0.29832980036735535, + 0.2068399991840124, + 0.3741013668477535, + 1.2440829426050186, + 0.3153203967958689, + 1.6155304573476315, + 1.2000325489789248, + 0.26022967137396336, + 4.033422950655222, + 0.19576003961265087, + 0.7458143569529057, + 1.5275228321552277, + 0.04200431704521179 + ], + "unique_experts": 63, + "load_cv": 0.6617292838462545, + "normalized_load_entropy": 0.9501847242622814, + "max_load_share": 0.06870229007633588 + } + }, + "s1_bos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "a6d62bab1bbae54b4a803b535197cf8cb31659fe0eda08ba7896c37b42f0a6ad", + "route_weight_sha256": "5b27d4a747b609b31384038bd0db02143d2cac4cc3ae1a6a358affb1cd649406", + "loads": [ + 8, + 12, + 12, + 11, + 6, + 11, + 5, + 2, + 17, + 11, + 13, + 16, + 6, + 1, + 11, + 4, + 0, + 19, + 23, + 17, + 13, + 0, + 13, + 2, + 13, + 4, + 13, + 19, + 20, + 12, + 15, + 3, + 2, + 3, + 1, + 25, + 14, + 10, + 4, + 7, + 4, + 18, + 6, + 13, + 5, + 12, + 4, + 13, + 15, + 10, + 0, + 2, + 5, + 4, + 5, + 7, + 22, + 3, + 3, + 53, + 4, + 10, + 19, + 1 + ], + "weighted_loads": [ + 0.743970425799489, + 0.7271864898502827, + 0.565493006259203, + 1.7756856381893158, + 0.24755665846168995, + 0.4664646051824093, + 0.38783004507422447, + 0.08156921714544296, + 1.5979628264904022, + 0.39906211383640766, + 0.5245247446000576, + 0.6588674653321505, + 0.23256009072065353, + 0.04928518459200859, + 0.8263162281364202, + 0.21771832555532455, + 0.0, + 1.4281875900924206, + 1.6822362206876278, + 1.1578076016157866, + 0.722516493871808, + 0.0, + 0.8931292779743671, + 0.28862109780311584, + 0.4990825317800045, + 0.12237668968737125, + 0.58473608084023, + 1.0914247035980225, + 1.2520355433225632, + 0.6565912179648876, + 0.6518382988870144, + 0.15708927810192108, + 0.09632063284516335, + 0.13158686831593513, + 0.02654997818171978, + 2.020697869360447, + 0.6782644428312778, + 0.4336507599800825, + 0.31067152693867683, + 0.30897464603185654, + 0.17515594139695168, + 1.0587068777531385, + 0.20879204012453556, + 0.6401331033557653, + 0.34051167592406273, + 1.5276931412518024, + 0.18875743448734283, + 1.30235855281353, + 1.2436830699443817, + 0.4620435144752264, + 0.0, + 0.17441581934690475, + 0.20099709928035736, + 0.16867215186357498, + 0.33137109503149986, + 0.2659622635692358, + 1.5837842039763927, + 0.13414406403899193, + 0.09928811155259609, + 3.72248413041234, + 0.18838097341358662, + 0.7324998304247856, + 1.335182273760438, + 0.04382789507508278 + ], + "unique_experts": 61, + "load_cv": 0.8432130614963472, + "normalized_load_entropy": 0.9234994738667266, + "max_load_share": 0.08333333333333333 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "a05be228df2176bb0061567834beb1212b65ed9b7572b7584147f1f8d70ad245", + "route_weight_sha256": "185840f451c306dd156aac9a1a3df8600c41b127adfbaf84ae7ecaa4e1fdeb32", + "loads": [ + 13, + 17, + 19, + 20, + 13, + 14, + 17, + 11, + 18, + 16, + 15, + 17, + 7, + 6, + 12, + 7, + 5, + 20, + 25, + 17, + 14, + 0, + 15, + 17, + 15, + 4, + 13, + 19, + 20, + 13, + 16, + 3, + 3, + 13, + 1, + 25, + 20, + 12, + 10, + 7, + 13, + 18, + 9, + 13, + 7, + 20, + 21, + 17, + 21, + 13, + 0, + 12, + 11, + 8, + 15, + 8, + 22, + 20, + 6, + 53, + 6, + 11, + 26, + 3 + ], + "weighted_loads": [ + 1.063576183281839, + 1.0473815128207207, + 0.928410142660141, + 2.3169277939014137, + 0.5687696039676666, + 0.5789975058287382, + 1.118293983861804, + 0.389651395380497, + 1.6315555982291698, + 0.6058172304183245, + 0.6195064000785351, + 0.690127668902278, + 0.24276335164904594, + 0.30082835257053375, + 0.924543647095561, + 0.34051200188696384, + 0.11940955417230725, + 1.4864704944193363, + 1.7727062664926052, + 1.1578076016157866, + 0.769237445667386, + 0.0, + 0.9592603258788586, + 2.243567768484354, + 0.5787315145134926, + 0.12237668968737125, + 0.58473608084023, + 1.0914247035980225, + 1.2520355433225632, + 0.702331118285656, + 0.7055377885699272, + 0.15708927810192108, + 0.14045046642422676, + 0.7862098012119532, + 0.02654997818171978, + 2.020697869360447, + 1.1100281476974487, + 0.5336332079023123, + 0.6978549137711525, + 0.30897464603185654, + 0.5601686704903841, + 1.0587068777531385, + 0.2977731581777334, + 0.6401331033557653, + 0.44247476384043694, + 2.7588713224977255, + 1.8386301659047604, + 1.6054592858999968, + 1.5074255764484406, + 0.6142097767442465, + 0.0, + 0.7919514644891024, + 0.8423674181103706, + 0.3846816383302212, + 1.289900902658701, + 0.3149917181581259, + 1.5837842039763927, + 1.7711092922836542, + 0.28090463019907475, + 3.72248413041234, + 0.2628934923559427, + 0.8579012528061867, + 1.6351324301213026, + 0.14365337789058685 + ], + "unique_experts": 62, + "load_cv": 0.5795724963859638, + "normalized_load_entropy": 0.9592866182824618, + "max_load_share": 0.060090702947845805 + } + }, + "s0_x": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "fe92d6ac057189c09833f6c3f1ccd2729bb78ab2fc1c39ca0e1b1e4e077b9485", + "route_weight_sha256": "89ab75f9dc86062efd58c2426de099c13748d228ccd77cb6324e43ba2dd50d5f", + "loads": [ + 8, + 12, + 12, + 11, + 6, + 10, + 5, + 2, + 16, + 10, + 14, + 15, + 5, + 1, + 9, + 5, + 0, + 20, + 23, + 17, + 12, + 0, + 13, + 2, + 16, + 3, + 13, + 19, + 20, + 12, + 13, + 3, + 2, + 3, + 1, + 25, + 14, + 11, + 5, + 8, + 4, + 18, + 6, + 13, + 6, + 12, + 4, + 13, + 15, + 11, + 0, + 2, + 5, + 6, + 5, + 7, + 22, + 3, + 3, + 52, + 4, + 10, + 18, + 1 + ], + "weighted_loads": [ + 0.7235150076448917, + 0.7331021577119827, + 0.55796954408288, + 1.8026462607085705, + 0.24438275955617428, + 0.43938381411135197, + 0.3897022567689419, + 0.08402598649263382, + 1.5070684216916561, + 0.3692738302052021, + 0.5721315462142229, + 0.6087684780359268, + 0.19614898227155209, + 0.04809153825044632, + 0.7643574103713036, + 0.2468822505325079, + 0.0, + 1.447206461802125, + 1.6734850890934467, + 1.148479277268052, + 0.6792411506175995, + 0.0, + 0.8963699676096439, + 0.2834194600582123, + 0.5802354030311108, + 0.10080510005354881, + 0.5843399688601494, + 1.1012090668082237, + 1.261594370007515, + 0.6420401483774185, + 0.5790081229060888, + 0.15334231406450272, + 0.10088953748345375, + 0.1411805972456932, + 0.026537733152508736, + 2.052155017852783, + 0.6665756683796644, + 0.44858670234680176, + 0.340029314160347, + 0.34858377277851105, + 0.16845868155360222, + 1.051530996337533, + 0.20844311080873013, + 0.6364576779305935, + 0.3632055427879095, + 1.6116024479269981, + 0.18280458636581898, + 1.3119919802993536, + 1.2394872270524502, + 0.47687296010553837, + 0.0, + 0.1701441928744316, + 0.20002595148980618, + 0.25588740035891533, + 0.33483101800084114, + 0.2697643041610718, + 1.589972160756588, + 0.13298748806118965, + 0.09296726807951927, + 3.673714891076088, + 0.19544008933007717, + 0.7515774928033352, + 1.2913838252425194, + 0.0431726835668087 + ], + "unique_experts": 61, + "load_cv": 0.8311172622699231, + "normalized_load_entropy": 0.9251107679396281, + "max_load_share": 0.08176100628930817 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "c00b2aa6f4539011b848829d11b27ff59d658868bc58c98928eedefb3e667310", + "route_weight_sha256": "98bc142ebbc6b3c36b1d3dde93b39e6c722ce5d68d5bafc5819302d7cf6af744", + "loads": [ + 12, + 15, + 12, + 22, + 10, + 13, + 12, + 6, + 16, + 18, + 14, + 15, + 6, + 6, + 11, + 5, + 4, + 20, + 23, + 17, + 12, + 0, + 14, + 13, + 19, + 3, + 14, + 19, + 20, + 12, + 13, + 3, + 3, + 7, + 1, + 25, + 15, + 11, + 10, + 9, + 10, + 18, + 7, + 13, + 6, + 20, + 18, + 16, + 16, + 11, + 0, + 3, + 5, + 7, + 17, + 8, + 22, + 13, + 5, + 52, + 4, + 10, + 24, + 1 + ], + "weighted_loads": [ + 0.9139970848336816, + 0.9034232310950756, + 0.55796954408288, + 2.249429905321449, + 0.42081356421113014, + 0.5445477403700352, + 0.8542473874986172, + 0.2328430376946926, + 1.5070684216916561, + 0.6488007735460997, + 0.5721315462142229, + 0.6087684780359268, + 0.20641194470226765, + 0.28671708330512047, + 0.8821992874145508, + 0.2468822505325079, + 0.08095138100907207, + 1.447206461802125, + 1.6734850890934467, + 1.148479277268052, + 0.6792411506175995, + 0.0, + 0.9150104690343142, + 1.6457339338958263, + 0.6820557005703449, + 0.10080510005354881, + 0.6215826719999313, + 1.1012090668082237, + 1.261594370007515, + 0.6420401483774185, + 0.5790081229060888, + 0.15334231406450272, + 0.155696589499712, + 0.4769960641860962, + 0.026537733152508736, + 2.052155017852783, + 0.705319045111537, + 0.44858670234680176, + 0.6023288303986192, + 0.3752841055393219, + 0.404464291408658, + 1.051530996337533, + 0.23328740894794464, + 0.6364576779305935, + 0.3632055427879095, + 2.8500564228743315, + 1.3481908421963453, + 1.4574144594371319, + 1.2790068089962006, + 0.47687296010553837, + 0.0, + 0.2603582292795181, + 0.20002595148980618, + 0.3064719997346401, + 1.4543277509510517, + 0.3040795437991619, + 1.589972160756588, + 1.1877379436045885, + 0.19247042387723923, + 3.673714891076088, + 0.19544008933007717, + 0.7515774928033352, + 1.5305708814412355, + 0.0431726835668087 + ], + "unique_experts": 62, + "load_cv": 0.6565427912183546, + "normalized_load_entropy": 0.9496594716474077, + "max_load_share": 0.06615776081424936 + } + }, + "s1_x": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "ece6f1703210b3abe4b2a9a17585b0bc88ab0ff7e04aaf162acd9e45ae06c2dc", + "route_weight_sha256": "f90d94811934a54b69319ca4b79df7e733ce656f05cfe950dcfd0848d7d3eaf5", + "loads": [ + 8, + 12, + 13, + 11, + 6, + 11, + 5, + 2, + 17, + 9, + 16, + 14, + 5, + 1, + 9, + 4, + 0, + 19, + 23, + 17, + 13, + 1, + 13, + 2, + 17, + 3, + 12, + 18, + 19, + 12, + 13, + 4, + 2, + 3, + 1, + 26, + 13, + 12, + 5, + 7, + 4, + 17, + 7, + 13, + 5, + 12, + 5, + 14, + 15, + 9, + 0, + 2, + 5, + 4, + 5, + 8, + 21, + 3, + 3, + 53, + 4, + 10, + 18, + 1 + ], + "weighted_loads": [ + 0.7554773855954409, + 0.7197004109621048, + 0.5994026474654675, + 1.775697287172079, + 0.2437239047139883, + 0.4561232030391693, + 0.3809066377580166, + 0.08257363736629486, + 1.534063681960106, + 0.35106339678168297, + 0.6438948102295399, + 0.5808048080652952, + 0.19807714223861694, + 0.047933291643857956, + 0.7444120887666941, + 0.22140266001224518, + 0.0, + 1.4119715802371502, + 1.6874493770301342, + 1.158319691196084, + 0.7181574124842882, + 0.02636145055294037, + 0.8752210587263107, + 0.2910385727882385, + 0.6090146340429783, + 0.09825115092098713, + 0.5271562207490206, + 1.0267431326210499, + 1.1964580900967121, + 0.6448833085596561, + 0.5835558101534843, + 0.17466696351766586, + 0.09220469743013382, + 0.13414952903985977, + 0.02531713992357254, + 2.073468057438731, + 0.6212684754282236, + 0.4891509898006916, + 0.34350188449025154, + 0.30836324393749237, + 0.16142626851797104, + 1.0139342211186886, + 0.23095007240772247, + 0.6277460530400276, + 0.3368532136082649, + 1.5618959702551365, + 0.22722738981246948, + 1.3698386065661907, + 1.2403814867138863, + 0.38489755243062973, + 0.0, + 0.1612428054213524, + 0.19110685400664806, + 0.1733844205737114, + 0.34966758638620377, + 0.2926174886524677, + 1.5364917032420635, + 0.1255449876189232, + 0.11003351584076881, + 3.64259135350585, + 0.1934752482920885, + 0.7371616177260876, + 1.3177570682018995, + 0.04507138580083847 + ], + "unique_experts": 62, + "load_cv": 0.8368089381711957, + "normalized_load_entropy": 0.925702269263933, + "max_load_share": 0.08333333333333333 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "f56713c6b38292912fdb3855caa194a3112c10bbf4dece717201ab727c1cb2ed", + "route_weight_sha256": "472c832a8c967a4328af2a68f8a7e75f29b4140262dfc455f6a87a8cc038d285", + "loads": [ + 13, + 17, + 19, + 21, + 10, + 14, + 18, + 9, + 18, + 13, + 18, + 15, + 6, + 7, + 10, + 7, + 7, + 20, + 25, + 17, + 14, + 1, + 14, + 18, + 20, + 3, + 12, + 18, + 19, + 13, + 13, + 4, + 3, + 13, + 1, + 26, + 19, + 13, + 12, + 7, + 12, + 17, + 9, + 13, + 7, + 22, + 24, + 18, + 22, + 12, + 0, + 13, + 11, + 6, + 19, + 8, + 21, + 19, + 4, + 53, + 6, + 11, + 26, + 2 + ], + "weighted_loads": [ + 1.0678061312064528, + 1.0398954339325428, + 0.9186341427266598, + 2.3762691388837993, + 0.4036943018436432, + 0.5464481133967638, + 1.1632628310471773, + 0.30130880512297153, + 1.5676564536988735, + 0.510339830070734, + 0.7388764657080173, + 0.6120650116354227, + 0.20828040316700935, + 0.32165900245308876, + 0.8426395077258348, + 0.34419633634388447, + 0.18333327630534768, + 1.470254484564066, + 1.7779194228351116, + 1.158319691196084, + 0.7648783642798662, + 0.02636145055294037, + 0.8936525769531727, + 2.26732325181365, + 0.7418827824294567, + 0.09825115092098713, + 0.5271562207490206, + 1.0267431326210499, + 1.1964580900967121, + 0.6906232088804245, + 0.5835558101534843, + 0.17466696351766586, + 0.13633453100919724, + 0.8010580074042082, + 0.02531713992357254, + 2.073468057438731, + 1.0530321802943945, + 0.5369294658303261, + 0.7996935993432999, + 0.30836324393749237, + 0.44921197183430195, + 1.0139342211186886, + 0.2841103598475456, + 0.6277460530400276, + 0.43881630152463913, + 2.8624472729861736, + 2.1251401342451572, + 1.6685384381562471, + 1.5674869120121002, + 0.5370638146996498, + 0.0, + 0.8775469306856394, + 0.8324771728366613, + 0.2562108784914017, + 1.609444908797741, + 0.2926174886524677, + 1.5364917032420635, + 1.7407577615231276, + 0.19053633883595467, + 3.64259135350585, + 0.2679877672344446, + 0.8625630401074886, + 1.621477959677577, + 0.08734288066625595 + ], + "unique_experts": 63, + "load_cv": 0.5941519082210619, + "normalized_load_entropy": 0.9577923824208353, + "max_load_share": 0.060090702947845805 + } + }, + "s0_period": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "ad5b35962af562e1da57db1f31b8e663ad1511abcc3a9228b6098503df07b559", + "route_weight_sha256": "57f947ea06580bda968df9c43ab2a5245f73ea722047aea642ae73223ce5044b", + "loads": [ + 8, + 12, + 11, + 11, + 7, + 9, + 5, + 3, + 17, + 9, + 14, + 13, + 5, + 1, + 9, + 5, + 0, + 20, + 23, + 17, + 12, + 0, + 13, + 2, + 15, + 4, + 14, + 19, + 19, + 12, + 14, + 3, + 2, + 3, + 1, + 24, + 15, + 10, + 4, + 8, + 4, + 17, + 6, + 13, + 6, + 13, + 4, + 13, + 15, + 11, + 0, + 2, + 5, + 7, + 5, + 7, + 22, + 3, + 3, + 53, + 4, + 10, + 19, + 1 + ], + "weighted_loads": [ + 0.741071991622448, + 0.7365731857717037, + 0.5106206461787224, + 1.8058361522853374, + 0.28122081607580185, + 0.41340938955545425, + 0.38524842262268066, + 0.12967560440301895, + 1.5768442526459694, + 0.3416575863957405, + 0.5689149871468544, + 0.530979260802269, + 0.19911896251142025, + 0.0474499836564064, + 0.7471291813999414, + 0.2447890341281891, + 0.0, + 1.4320903737097979, + 1.672945462167263, + 1.1688884664326906, + 0.675442123785615, + 0.0, + 0.8965210914611816, + 0.2876005545258522, + 0.5363760814070702, + 0.13048819825053215, + 0.6123287566006184, + 1.097967203706503, + 1.2273662686347961, + 0.6402297429740429, + 0.6169741377234459, + 0.15767529234290123, + 0.09999781101942062, + 0.14035482704639435, + 0.026803577318787575, + 2.0230192877352238, + 0.6898215319961309, + 0.42058134637773037, + 0.3012348599731922, + 0.3437913805246353, + 0.16667935997247696, + 1.0167556069791317, + 0.21088329702615738, + 0.6322593614459038, + 0.36818898655474186, + 1.646263014525175, + 0.18307079002261162, + 1.3088633455336094, + 1.2365826331079006, + 0.4974135756492615, + 0.0, + 0.1787986233830452, + 0.20443757623434067, + 0.293565109372139, + 0.32418593019247055, + 0.27003570832312107, + 1.5824156608432531, + 0.13644082471728325, + 0.0912606231868267, + 3.7440262101590633, + 0.19757534191012383, + 0.7522594146430492, + 1.3505985271185637, + 0.04248605668544769 + ], + "unique_experts": 61, + "load_cv": 0.8330188085690319, + "normalized_load_entropy": 0.9258133073752728, + "max_load_share": 0.08333333333333333 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "1cf667e271dd3a673f1f8913e3d3770e5dafd922e71582b9086f119fea0e7da1", + "route_weight_sha256": "a5840ebb1bad4f643caa88d4c7f3966b2271b7009140ff9e927466fa8c3ec1a0", + "loads": [ + 12, + 15, + 12, + 20, + 13, + 12, + 13, + 7, + 17, + 17, + 14, + 13, + 6, + 6, + 10, + 5, + 3, + 20, + 23, + 17, + 12, + 0, + 14, + 13, + 18, + 4, + 15, + 19, + 19, + 12, + 14, + 3, + 3, + 7, + 1, + 24, + 15, + 10, + 9, + 9, + 12, + 17, + 7, + 13, + 6, + 20, + 16, + 16, + 16, + 11, + 0, + 3, + 5, + 9, + 17, + 8, + 22, + 14, + 5, + 53, + 4, + 10, + 25, + 1 + ], + "weighted_loads": [ + 0.9399835439398885, + 0.9068942591547966, + 0.5556684695184231, + 2.105774415191263, + 0.554085286334157, + 0.5193689335137606, + 0.9190603643655777, + 0.2835676781833172, + 1.5768442526459694, + 0.6304135732352734, + 0.5689149871468544, + 0.530979260802269, + 0.2093819249421358, + 0.28847554326057434, + 0.8203185219317675, + 0.2447890341281891, + 0.05152639327570796, + 1.4320903737097979, + 1.672945462167263, + 1.1688884664326906, + 0.675442123785615, + 0.0, + 0.9151615928858519, + 1.6463322378695011, + 0.6381963789463043, + 0.13048819825053215, + 0.6369529869407415, + 1.097967203706503, + 1.2273662686347961, + 0.6402297429740429, + 0.6169741377234459, + 0.15767529234290123, + 0.15480486303567886, + 0.48947423323988914, + 0.026803577318787575, + 2.0230192877352238, + 0.6898215319961309, + 0.42058134637773037, + 0.6754794577136636, + 0.37049171328544617, + 0.49558258429169655, + 1.0167556069791317, + 0.2357275951653719, + 0.6322593614459038, + 0.36818898655474186, + 2.8389125671237707, + 1.1920051127672195, + 1.4511773455888033, + 1.276102215051651, + 0.4974135756492615, + 0.0, + 0.2690126597881317, + 0.20443757623434067, + 0.3790181763470173, + 1.3402749598026276, + 0.3043509479612112, + 1.5824156608432531, + 1.2374878991395235, + 0.1896311528980732, + 3.7440262101590633, + 0.19757534191012383, + 0.7522594146430492, + 1.5715072266757488, + 0.04248605668544769 + ], + "unique_experts": 62, + "load_cv": 0.65369645119229, + "normalized_load_entropy": 0.9505209336129427, + "max_load_share": 0.06743002544529263 + } + }, + "s1_period": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "c7898ed1f168eb2ca2fae1f776c4108486f7e2f8de9a5ea6a1606b71c332efee", + "route_weight_sha256": "a928a5eedbcfb10162b72df83022f55401e5352639e39fcddee0fe743725ec81", + "loads": [ + 9, + 12, + 12, + 12, + 6, + 11, + 5, + 2, + 16, + 9, + 16, + 16, + 5, + 1, + 9, + 4, + 0, + 19, + 23, + 17, + 13, + 0, + 13, + 2, + 15, + 3, + 11, + 19, + 18, + 12, + 17, + 4, + 2, + 3, + 1, + 26, + 12, + 10, + 5, + 7, + 4, + 17, + 7, + 13, + 5, + 12, + 4, + 14, + 15, + 9, + 0, + 2, + 5, + 5, + 5, + 7, + 21, + 3, + 2, + 54, + 4, + 10, + 20, + 1 + ], + "weighted_loads": [ + 0.7928791269659996, + 0.7155238650739193, + 0.5556666776537895, + 1.8274289481341839, + 0.2623698152601719, + 0.45526944287121296, + 0.3769151158630848, + 0.0854618288576603, + 1.4874218069016933, + 0.3524434622377157, + 0.6411610338836908, + 0.63886733725667, + 0.19998045451939106, + 0.0486488863825798, + 0.7253155093640089, + 0.21116985380649567, + 0.0, + 1.4152979403734207, + 1.694660261273384, + 1.1866785362362862, + 0.7295768409967422, + 0.0, + 0.8578723482787609, + 0.2896405905485153, + 0.5471591036766768, + 0.09705987200140953, + 0.5088423602283001, + 1.0625167824327946, + 1.156908331438899, + 0.6432345025241375, + 0.7031406629830599, + 0.176804443821311, + 0.08685141429305077, + 0.13190680369734764, + 0.02792518027126789, + 2.1028847377747297, + 0.5923414304852486, + 0.42186231166124344, + 0.33659999817609787, + 0.3057899586856365, + 0.16445418819785118, + 1.0133865624666214, + 0.23358578234910965, + 0.6223857272416353, + 0.33759966120123863, + 1.5751641429960728, + 0.19210394844412804, + 1.3525875117629766, + 1.2388268820941448, + 0.3868347220122814, + 0.0, + 0.1699928194284439, + 0.19975649937987328, + 0.21307454258203506, + 0.348989088088274, + 0.26225372962653637, + 1.5386696681380272, + 0.12739980220794678, + 0.0630060937255621, + 3.7074430901557207, + 0.19437076337635517, + 0.7367754653096199, + 1.3783174995332956, + 0.043248534202575684 + ], + "unique_experts": 61, + "load_cv": 0.8525435038821357, + "normalized_load_entropy": 0.9226296333792173, + "max_load_share": 0.08490566037735849 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "6acdb317c2cd0c9afe6aac9adc7feca57c18573c084aef4d039d2fa1996c0517", + "route_weight_sha256": "b3ebd66cd5c9124c3cec9f73f1b18b049008e351f03371d50bbe32ecea5865c0", + "loads": [ + 14, + 17, + 19, + 22, + 10, + 14, + 19, + 9, + 17, + 14, + 18, + 17, + 6, + 6, + 10, + 7, + 6, + 20, + 25, + 17, + 14, + 0, + 14, + 17, + 18, + 3, + 11, + 19, + 18, + 13, + 17, + 4, + 3, + 15, + 1, + 26, + 18, + 11, + 13, + 7, + 12, + 17, + 9, + 13, + 7, + 22, + 23, + 18, + 21, + 12, + 0, + 12, + 11, + 8, + 18, + 7, + 21, + 19, + 3, + 54, + 6, + 11, + 27, + 2 + ], + "weighted_loads": [ + 1.0997707033529878, + 1.0357188880443573, + 0.9176807887852192, + 2.395874116104096, + 0.4246756788343191, + 0.5470730550587177, + 1.2257010731846094, + 0.3060011528432369, + 1.521014578640461, + 0.549103757366538, + 0.7361426893621683, + 0.6701275408267975, + 0.21018371544778347, + 0.28883572667837143, + 0.8235429283231497, + 0.33396353013813496, + 0.14400976011529565, + 1.4735808447003365, + 1.7851303070783615, + 1.1866785362362862, + 0.7762977927923203, + 0.0, + 0.8763038665056229, + 2.191209815442562, + 0.678336339071393, + 0.09705987200140953, + 0.5088423602283001, + 1.0625167824327946, + 1.156908331438899, + 0.6889744028449059, + 0.7031406629830599, + 0.176804443821311, + 0.13098124787211418, + 0.9409197960048914, + 0.02792518027126789, + 2.1028847377747297, + 1.0241051353514194, + 0.4696407876908779, + 0.9520744048058987, + 0.3057899586856365, + 0.459774075075984, + 1.0133865624666214, + 0.2867460697889328, + 0.6223857272416353, + 0.43956274911761284, + 2.8841753024607897, + 1.9310590960085392, + 1.642636526376009, + 1.5025693885982037, + 0.5390009842813015, + 0.0, + 0.7875284645706415, + 0.8411268182098866, + 0.3389665000140667, + 1.4944830909371376, + 0.26225372962653637, + 1.5386696681380272, + 1.7413958217948675, + 0.14350891672074795, + 3.7074430901557207, + 0.2688832823187113, + 0.862176887691021, + 1.6431262139230967, + 0.08552002906799316 + ], + "unique_experts": 62, + "load_cv": 0.603221487274767, + "normalized_load_entropy": 0.9559151593997715, + "max_load_share": 0.061224489795918366 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 106, + "ordered_topk_exact_tokens": 72, + "set_exact_tokens": 87, + "mean_set_jaccard": 0.9467654986522911, + "mean_token_weighted_tv": 0.01120813255075295, + "aggregate_load_tv": 0.023584905660377357 + }, + "system_bos": { + "tokens": 106, + "ordered_topk_exact_tokens": 68, + "set_exact_tokens": 87, + "mean_set_jaccard": 0.9487870619946092, + "mean_token_weighted_tv": 0.012556019362132504, + "aggregate_load_tv": 0.022012578616352203 + }, + "system_x": { + "tokens": 106, + "ordered_topk_exact_tokens": 58, + "set_exact_tokens": 78, + "mean_set_jaccard": 0.9245283018867925, + "mean_token_weighted_tv": 0.01671478805079494, + "aggregate_load_tv": 0.025157232704402514 + }, + "system_period": { + "tokens": 106, + "ordered_topk_exact_tokens": 49, + "set_exact_tokens": 73, + "mean_set_jaccard": 0.9070080862533693, + "mean_token_weighted_tv": 0.018782204790216573, + "aggregate_load_tv": 0.034591194968553465 + }, + "bos_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 66, + "set_exact_tokens": 84, + "mean_set_jaccard": 0.940700808625337, + "mean_token_weighted_tv": 0.01325420421144029, + "aggregate_load_tv": 0.026729559748427674 + }, + "bos_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 61, + "set_exact_tokens": 79, + "mean_set_jaccard": 0.9252021563342318, + "mean_token_weighted_tv": 0.01648693876165264, + "aggregate_load_tv": 0.03144654088050314 + }, + "x_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 61, + "set_exact_tokens": 80, + "mean_set_jaccard": 0.9299191374663072, + "mean_token_weighted_tv": 0.01544287208608299, + "aggregate_load_tv": 0.026729559748427674 + }, + "x_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 53, + "set_exact_tokens": 75, + "mean_set_jaccard": 0.9144204851752021, + "mean_token_weighted_tv": 0.018984521247165383, + "aggregate_load_tv": 0.033018867924528295 + }, + "period_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 60, + "set_exact_tokens": 80, + "mean_set_jaccard": 0.9299191374663073, + "mean_token_weighted_tv": 0.014998011273454945, + "aggregate_load_tv": 0.023584905660377364 + }, + "period_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 53, + "set_exact_tokens": 76, + "mean_set_jaccard": 0.9191374663072776, + "mean_token_weighted_tv": 0.0190502993744921, + "aggregate_load_tv": 0.02987421383647798 + } + } + }, + "layer_24": { + "layer": 24, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "e8d492eda2fb26594cc4ce23525b36d4265f4a5a981f51c511901bb3b6e2a06f", + "route_weight_sha256": "d61c1ff58e72464fab8b07eb8fcf73d92d33fba67457a0e3bc9c692966f428a9", + "loads": [ + 2, + 13, + 4, + 9, + 7, + 16, + 28, + 12, + 15, + 21, + 19, + 3, + 12, + 26, + 3, + 6, + 0, + 2, + 4, + 7, + 11, + 18, + 5, + 3, + 6, + 25, + 0, + 8, + 2, + 14, + 51, + 8, + 6, + 8, + 3, + 12, + 1, + 2, + 13, + 19, + 3, + 2, + 6, + 1, + 7, + 5, + 4, + 3, + 20, + 14, + 4, + 4, + 4, + 12, + 10, + 14, + 27, + 15, + 17, + 7, + 7, + 0, + 5, + 21 + ], + "weighted_loads": [ + 0.08677079528570175, + 0.6083250977098942, + 0.11797256581485271, + 0.30368906259536743, + 0.46993905305862427, + 0.8844469543546438, + 1.3005702067166567, + 0.45953586138784885, + 1.6925877034664154, + 1.1521015129983425, + 1.4873883407562971, + 0.2834210768342018, + 0.9895881600677967, + 1.3183380085974932, + 0.12470616772770882, + 0.19180214405059814, + 0.0, + 0.07858606241643429, + 0.137409046292305, + 0.2155920248478651, + 0.5251581948250532, + 0.8910480421036482, + 0.2062114253640175, + 0.11125755682587624, + 0.22345134802162647, + 1.070343479514122, + 0.0, + 0.3435582034289837, + 0.06581628695130348, + 0.7947241459041834, + 4.085255187004805, + 0.2554824985563755, + 0.4114857651293278, + 0.6343395803123713, + 0.09251037426292896, + 0.7878031581640244, + 0.03366352990269661, + 0.07988666743040085, + 0.4139460511505604, + 0.9180939290672541, + 0.30694595351815224, + 0.07443217560648918, + 0.21148338168859482, + 0.036471977829933167, + 0.2952445074915886, + 0.3158455863595009, + 0.15918278694152832, + 0.09238505363464355, + 1.813448205590248, + 1.1872875653207302, + 0.15945341065526009, + 0.3230074271559715, + 0.10432308353483677, + 0.9547654986381531, + 0.5995032209903002, + 0.7974032238125801, + 1.6672163531184196, + 0.5761113837361336, + 0.952887574210763, + 0.22467806190252304, + 0.3195501621812582, + 0.0, + 0.2752387188374996, + 0.8406765852123499 + ], + "unique_experts": 61, + "load_cv": 0.89385651575003, + "normalized_load_entropy": 0.9152670576630696, + "max_load_share": 0.08018867924528301 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "8fbca42c6f281facfd6ad81fe344662c3832ebfa1e759ef76067f906071475a4", + "route_weight_sha256": "ca298e555baf063b8bc61c24984e59149e0b9f435648beab9a3a73ef02c164ba", + "loads": [ + 2, + 14, + 7, + 9, + 7, + 22, + 28, + 13, + 24, + 21, + 30, + 3, + 13, + 26, + 6, + 6, + 0, + 2, + 4, + 8, + 12, + 18, + 11, + 3, + 14, + 25, + 0, + 8, + 9, + 19, + 51, + 11, + 7, + 12, + 10, + 13, + 2, + 4, + 13, + 19, + 3, + 4, + 9, + 3, + 7, + 8, + 4, + 9, + 20, + 14, + 9, + 10, + 7, + 16, + 10, + 14, + 27, + 15, + 27, + 8, + 10, + 15, + 7, + 24 + ], + "weighted_loads": [ + 0.08677079528570175, + 0.6524073407053947, + 0.2224223855882883, + 0.30368906259536743, + 0.46993905305862427, + 1.178934596828185, + 1.3005702067166567, + 0.5144380573183298, + 2.095423921942711, + 1.1521015129983425, + 1.8814570249523968, + 0.2834210768342018, + 0.9923208758700639, + 1.3183380085974932, + 0.22863533906638622, + 0.19180214405059814, + 0.0, + 0.07858606241643429, + 0.137409046292305, + 0.24534697271883488, + 0.5585743170231581, + 0.8910480421036482, + 0.7449950464069843, + 0.11125755682587624, + 0.5257404954172671, + 1.070343479514122, + 0.0, + 0.3435582034289837, + 0.348584558814764, + 0.994155889376998, + 4.085255187004805, + 0.35722018778324127, + 0.4399665482342243, + 0.8189431317150593, + 0.3045402429997921, + 0.8338154554367065, + 0.1299383006989956, + 0.9856198541820049, + 0.4139460511505604, + 0.9180939290672541, + 0.30694595351815224, + 0.19323980808258057, + 0.28630704060196877, + 0.1910312883555889, + 0.2952445074915886, + 0.5730241276323795, + 0.15918278694152832, + 0.5331744073191658, + 1.813448205590248, + 1.1872875653207302, + 0.35838671401143074, + 0.7791104763746262, + 0.18845833837985992, + 1.1333176866173744, + 0.5995032209903002, + 0.7974032238125801, + 1.6672163531184196, + 0.5761113837361336, + 1.270728261442855, + 0.2652231529355049, + 0.4283760003745556, + 1.298405280802399, + 0.2781418499071151, + 2.825716594234109 + ], + "unique_experts": 62, + "load_cv": 0.7303419572712652, + "normalized_load_entropy": 0.9402184616370142, + "max_load_share": 0.0648854961832061 + } + }, + "s1_eos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "0e17d651b496d55b2786abe1b114a294b4e64d1dd4454b7a179778e577657092", + "route_weight_sha256": "6329b229134363eaaf0aa6c34563455d9f34f8aed217be63cf279723f087e2c8", + "loads": [ + 2, + 15, + 4, + 9, + 6, + 15, + 26, + 9, + 15, + 21, + 20, + 3, + 11, + 26, + 3, + 6, + 0, + 2, + 3, + 7, + 12, + 18, + 4, + 3, + 6, + 22, + 0, + 9, + 7, + 14, + 52, + 8, + 6, + 8, + 4, + 12, + 2, + 2, + 12, + 19, + 3, + 2, + 7, + 1, + 7, + 5, + 2, + 3, + 21, + 14, + 5, + 4, + 6, + 11, + 10, + 15, + 26, + 14, + 16, + 8, + 7, + 0, + 5, + 21 + ], + "weighted_loads": [ + 0.08473969623446465, + 0.6745203416794538, + 0.11519406922161579, + 0.30063390731811523, + 0.43734072521328926, + 0.8688441962003708, + 1.2477761059999466, + 0.36276126839220524, + 1.6876520197838545, + 1.1649412401020527, + 1.5347182881087065, + 0.28357674181461334, + 0.9642484821379185, + 1.3243152741342783, + 0.12500810995697975, + 0.20461577363312244, + 0.0, + 0.08460023812949657, + 0.10828414000570774, + 0.21189626306295395, + 0.562417097389698, + 0.8918252848088741, + 0.17237132042646408, + 0.11407477036118507, + 0.22574958950281143, + 0.9873239323496819, + 0.0, + 0.36421853490173817, + 0.21224649623036385, + 0.8066852577030659, + 4.129355864599347, + 0.2588997520506382, + 0.41139553487300873, + 0.6359559986740351, + 0.12107461504638195, + 0.8056988585740328, + 0.06635949201881886, + 0.0779525600373745, + 0.3818138428032398, + 0.9186389166861773, + 0.31130553036928177, + 0.07017392106354237, + 0.23508784361183643, + 0.03756142035126686, + 0.3020300380885601, + 0.29376284778118134, + 0.1062006801366806, + 0.10145686939358711, + 1.8432660307735205, + 1.1786684356629848, + 0.18819567561149597, + 0.3301718197762966, + 0.14494800008833408, + 0.9245107993483543, + 0.5856797304004431, + 0.8554443288594484, + 1.624850545078516, + 0.5400712378323078, + 0.9080372843891382, + 0.2674393020570278, + 0.32303231582045555, + 0.0, + 0.2687608376145363, + 0.8463599905371666 + ], + "unique_experts": 61, + "load_cv": 0.8804806825526634, + "normalized_load_entropy": 0.918617604942772, + "max_load_share": 0.08176100628930817 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "3b3aa8e4c0ffa3b51cd5279348200d35c1ac093c54a58d3786ae6658e1d0e242", + "route_weight_sha256": "3e4786ada78357e3997af15a5dc8379d4feebd1ee9646b109f84b5d7534266a7", + "loads": [ + 2, + 16, + 5, + 10, + 8, + 25, + 26, + 10, + 25, + 24, + 28, + 5, + 14, + 26, + 5, + 6, + 1, + 2, + 4, + 10, + 16, + 18, + 16, + 4, + 16, + 22, + 0, + 9, + 28, + 19, + 52, + 11, + 6, + 14, + 11, + 14, + 9, + 5, + 13, + 19, + 4, + 10, + 11, + 4, + 9, + 7, + 2, + 11, + 21, + 14, + 10, + 18, + 12, + 15, + 12, + 17, + 26, + 15, + 31, + 9, + 13, + 19, + 12, + 26 + ], + "weighted_loads": [ + 0.08473969623446465, + 0.7172944229096174, + 0.14070198871195316, + 0.4154520034790039, + 0.49863313883543015, + 1.2928172558313236, + 1.2477761059999466, + 0.40020094998180866, + 2.3197883018292487, + 1.295516412705183, + 1.8540884766262025, + 0.3506949543952942, + 1.0259084983263165, + 1.3243152741342783, + 0.2048255242407322, + 0.20461577363312244, + 0.028864020481705666, + 0.08460023812949657, + 0.14025161229074, + 0.30511385574936867, + 0.7446378618478775, + 0.8918252848088741, + 1.006307352334261, + 0.13924182206392288, + 0.5797424972988665, + 0.9873239323496819, + 0.0, + 0.36421853490173817, + 1.2299209460616112, + 1.0262188073247671, + 4.129355864599347, + 0.3981430120766163, + 0.41139553487300873, + 0.9511174466460943, + 0.3606313788332045, + 0.9061133358627558, + 0.591851195320487, + 1.0237971879541874, + 0.4337601624429226, + 0.9186389166861773, + 0.4251704439520836, + 0.5468192212283611, + 0.3462323173880577, + 0.34947581961750984, + 0.39713098853826523, + 0.508643165230751, + 0.1062006801366806, + 0.6706514887046069, + 1.8432660307735205, + 1.1786684356629848, + 0.39308357797563076, + 1.3435719013214111, + 0.31823679991066456, + 1.2127393335103989, + 0.7603550869971514, + 0.9534990396350622, + 1.624850545078516, + 0.5836119651794434, + 1.5042675194563344, + 0.3134942390024662, + 0.5252185165882111, + 1.9662269772961736, + 0.6182062053121626, + 2.92349761351943 + ], + "unique_experts": 63, + "load_cv": 0.6572639710365613, + "normalized_load_entropy": 0.9494418556882793, + "max_load_share": 0.05895691609977324 + } + }, + "s0_bos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "0fb42b2221c513b94f3a9c480a96454584ba0c6f91737d9baafa99dfe733905e", + "route_weight_sha256": "10fb5f4fcd763fd1229c569cfcc926265ef69d649ccfcbffd8e9eb57d84b928c", + "loads": [ + 2, + 12, + 3, + 6, + 6, + 16, + 25, + 11, + 14, + 20, + 18, + 3, + 12, + 26, + 3, + 5, + 0, + 2, + 6, + 6, + 12, + 18, + 5, + 3, + 6, + 27, + 0, + 8, + 3, + 14, + 55, + 9, + 5, + 8, + 5, + 13, + 1, + 2, + 11, + 19, + 3, + 2, + 4, + 1, + 6, + 5, + 3, + 5, + 21, + 14, + 6, + 5, + 4, + 12, + 10, + 13, + 28, + 15, + 18, + 7, + 7, + 1, + 5, + 21 + ], + "weighted_loads": [ + 0.08457217365503311, + 0.5712514854967594, + 0.08891842514276505, + 0.20330685935914516, + 0.4265945255756378, + 0.8905351236462593, + 1.2406741939485073, + 0.41178036853671074, + 1.6972450651228428, + 1.121421456336975, + 1.4511782955378294, + 0.28178682178258896, + 0.9941966272890568, + 1.32977438531816, + 0.12703155353665352, + 0.16976159252226353, + 0.0, + 0.07840250246226788, + 0.19923801347613335, + 0.19477093778550625, + 0.5654779598116875, + 0.878675976768136, + 0.20817174389958382, + 0.11304229125380516, + 0.2300003580749035, + 1.141819754615426, + 0.0, + 0.35026468709111214, + 0.08843204937875271, + 0.8031086586415768, + 4.28550838958472, + 0.2834872901439667, + 0.3877546712756157, + 0.6201512329280376, + 0.14758713357150555, + 0.8316865675151348, + 0.032553330063819885, + 0.08248777687549591, + 0.3591231908649206, + 0.9305145796388388, + 0.29865581914782524, + 0.06693397648632526, + 0.14647601544857025, + 0.03666016459465027, + 0.27076044492423534, + 0.2824308853596449, + 0.151319932192564, + 0.1621571984142065, + 1.890972200781107, + 1.1920479834079742, + 0.2182441744953394, + 0.3588039129972458, + 0.1023316103965044, + 0.9551799483597279, + 0.6039957050234079, + 0.7861365601420403, + 1.7135304752737284, + 0.5648169405758381, + 0.9942203853279352, + 0.23467211052775383, + 0.3172704931348562, + 0.03367765247821808, + 0.2795391324907541, + 0.8372607976198196 + ], + "unique_experts": 62, + "load_cv": 0.918475889145435, + "normalized_load_entropy": 0.9151545704530196, + "max_load_share": 0.08647798742138364 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "5d7537ceb2d6dad97a2ec5ce1db5974db2f02b4a120734b9f060b9b5308787e2", + "route_weight_sha256": "64287e1d7b353030e1085f4bc11f21f63d15c876e7fde07850c1e38864d30144", + "loads": [ + 2, + 13, + 6, + 6, + 6, + 22, + 26, + 12, + 22, + 20, + 27, + 3, + 13, + 26, + 6, + 5, + 0, + 2, + 6, + 7, + 13, + 18, + 13, + 3, + 14, + 27, + 1, + 8, + 10, + 19, + 56, + 12, + 6, + 12, + 12, + 13, + 2, + 4, + 11, + 19, + 3, + 4, + 8, + 2, + 6, + 8, + 4, + 9, + 21, + 14, + 13, + 11, + 7, + 16, + 10, + 13, + 28, + 15, + 27, + 8, + 10, + 17, + 6, + 23 + ], + "weighted_loads": [ + 0.08457217365503311, + 0.6168633289635181, + 0.1811664868146181, + 0.20330685935914516, + 0.4265945255756378, + 1.1712925269966945, + 1.308788064867258, + 0.4666825644671917, + 2.096488943323493, + 1.121421456336975, + 1.8068605873268098, + 0.28178682178258896, + 0.996929343091324, + 1.32977438531816, + 0.2299132477492094, + 0.16976159252226353, + 0.0, + 0.07840250246226788, + 0.19923801347613335, + 0.22877720929682255, + 0.5988940820097923, + 0.878675976768136, + 0.9114419482648373, + 0.11304229125380516, + 0.5322895054705441, + 1.141819754615426, + 0.4364488422870636, + 0.35026468709111214, + 0.37120032124221325, + 1.0025404021143913, + 4.3267420856282115, + 0.3743766862899065, + 0.41623545438051224, + 0.8047547843307257, + 0.34590631164610386, + 0.8316865675151348, + 0.12882810086011887, + 0.9886464327573776, + 0.3591231908649206, + 0.9305145796388388, + 0.29865581914782524, + 0.16961637325584888, + 0.3256294019520283, + 0.1563648134469986, + 0.27076044492423534, + 0.5751468893140554, + 0.21302776783704758, + 0.5432787555037066, + 1.890972200781107, + 1.1920479834079742, + 0.5179452896118164, + 0.7797275632619858, + 0.18646686524152756, + 1.1302525140345097, + 0.6039957050234079, + 0.7861365601420403, + 1.7135304752737284, + 0.5648169405758381, + 1.312765458598733, + 0.2735629081726074, + 0.4249580707401037, + 1.4027193174697459, + 0.2812443805160001, + 1.8526889234781265 + ], + "unique_experts": 63, + "load_cv": 0.7543445721143389, + "normalized_load_entropy": 0.9385466250952407, + "max_load_share": 0.07124681933842239 + } + }, + "s1_bos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "d09b32cc99f7e531800b66480b82017a737684ea645f4d81864849ff78897958", + "route_weight_sha256": "0316c35bac9f3f975ef346dc0e2d2b7e48c47a45fd35de1fdb649d91b12b9902", + "loads": [ + 1, + 14, + 5, + 6, + 6, + 16, + 27, + 10, + 16, + 20, + 19, + 3, + 12, + 26, + 3, + 4, + 0, + 5, + 3, + 7, + 11, + 16, + 5, + 3, + 7, + 23, + 0, + 8, + 4, + 14, + 52, + 11, + 5, + 7, + 4, + 13, + 1, + 2, + 11, + 20, + 3, + 1, + 6, + 1, + 8, + 4, + 3, + 5, + 21, + 15, + 5, + 4, + 4, + 13, + 10, + 14, + 27, + 12, + 17, + 9, + 7, + 0, + 5, + 22 + ], + "weighted_loads": [ + 0.048271991312503815, + 0.624217489734292, + 0.1495024599134922, + 0.20241717621684074, + 0.4200189746916294, + 0.8844544123858213, + 1.2778324540704489, + 0.3813956715166569, + 1.7206444777548313, + 1.1139333620667458, + 1.4390147738158703, + 0.2726641707122326, + 0.9941652491688728, + 1.3226212933659554, + 0.12418734654784203, + 0.14083749055862427, + 0.0, + 0.19660761579871178, + 0.10819493979215622, + 0.21762518025934696, + 0.538164084777236, + 0.8203770369291306, + 0.20364731177687645, + 0.11855287849903107, + 0.2588927038013935, + 1.017591131851077, + 0.0, + 0.3395255096256733, + 0.13787602074444294, + 0.8059956058859825, + 4.1645081005990505, + 0.34062305092811584, + 0.3840551860630512, + 0.594101307913661, + 0.126189686357975, + 0.8125142846256495, + 0.03443581983447075, + 0.07951787859201431, + 0.3637447003275156, + 0.9544857330620289, + 0.30059871450066566, + 0.02506491355597973, + 0.22825925052165985, + 0.03706996142864227, + 0.3178288396447897, + 0.24340127781033516, + 0.1536269448697567, + 0.16329979710280895, + 1.8722289483994246, + 1.2181454356759787, + 0.1890560630708933, + 0.343512199819088, + 0.10028114169836044, + 0.9613655302673578, + 0.5861943066120148, + 0.8276993483304977, + 1.6941477339714766, + 0.4723159112036228, + 0.9389034546911716, + 0.29029998928308487, + 0.3210556451231241, + 0.0, + 0.28251695074141026, + 0.8631452023983002 + ], + "unique_experts": 61, + "load_cv": 0.8927938237223382, + "normalized_load_entropy": 0.915961382405461, + "max_load_share": 0.08176100628930817 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "303a2dd5848f0b975ece9824d075db49b80a29c5cb233d360606ae247391ca53", + "route_weight_sha256": "0546c776774e080f9221db57ff91b352bf673c5e78bc7628856068e9416f4dfa", + "loads": [ + 1, + 15, + 7, + 7, + 8, + 26, + 27, + 11, + 25, + 23, + 27, + 5, + 15, + 26, + 6, + 4, + 1, + 5, + 4, + 11, + 15, + 16, + 18, + 4, + 16, + 23, + 0, + 8, + 25, + 19, + 52, + 15, + 5, + 13, + 11, + 15, + 8, + 5, + 12, + 20, + 4, + 9, + 11, + 5, + 9, + 7, + 3, + 12, + 21, + 15, + 11, + 18, + 10, + 17, + 12, + 16, + 27, + 13, + 31, + 10, + 11, + 20, + 11, + 25 + ], + "weighted_loads": [ + 0.048271991312503815, + 0.6789204459637403, + 0.19690433703362942, + 0.3172352723777294, + 0.4813113883137703, + 1.2843066122150049, + 1.2778324540704489, + 0.4188353531062603, + 2.353544160723686, + 1.244508534669876, + 1.7820339992176741, + 0.33978238329291344, + 1.0558252653572708, + 1.3226212933659554, + 0.23064502701163292, + 0.14083749055862427, + 0.028864020481705666, + 0.19660761579871178, + 0.1401624120771885, + 0.3413744755089283, + 0.7203848492354155, + 0.8203770369291306, + 1.2031029649078846, + 0.14371993020176888, + 0.5777940624393523, + 1.017591131851077, + 0.0, + 0.3395255096256733, + 1.159082805737853, + 1.0255291555076838, + 4.1645081005990505, + 0.5171026885509491, + 0.3840551860630512, + 0.9092627558857203, + 0.3650916558690369, + 0.9129287619143724, + 0.5599275231361389, + 1.0298625081777573, + 0.4099069405347109, + 0.9544857330620289, + 0.4144636280834675, + 0.48676392063498497, + 0.47304542921483517, + 0.4205012768507004, + 0.35745290108025074, + 0.518370732665062, + 0.1536269448697567, + 0.7691771833924577, + 1.8722289483994246, + 1.2181454356759787, + 0.5082999039441347, + 1.3051715940237045, + 0.2735699415206909, + 1.2495940644294024, + 0.7608696632087231, + 0.9257540591061115, + 1.6941477339714766, + 0.515274990350008, + 1.5316203627735376, + 0.3288559205830097, + 0.45711851119995117, + 2.0040574269369245, + 0.6306839828612283, + 1.922963336110115 + ], + "unique_experts": 63, + "load_cv": 0.6536239387208495, + "normalized_load_entropy": 0.9502346152117501, + "max_load_share": 0.05895691609977324 + } + }, + "s0_x": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "d991137f3846ecfdbb976f086b16c9dee6945d2571a40f38a17f5a30ac81f4ce", + "route_weight_sha256": "effafa17f13385847076a15b791a497f7b8a5aa776f8da015f6bb3a41ee049f0", + "loads": [ + 2, + 11, + 3, + 9, + 6, + 15, + 24, + 10, + 16, + 20, + 18, + 3, + 11, + 25, + 3, + 3, + 0, + 2, + 4, + 7, + 14, + 19, + 6, + 3, + 6, + 25, + 0, + 9, + 3, + 14, + 52, + 10, + 5, + 8, + 3, + 12, + 1, + 2, + 12, + 19, + 3, + 2, + 6, + 1, + 8, + 4, + 3, + 3, + 21, + 15, + 5, + 6, + 3, + 12, + 10, + 13, + 28, + 16, + 19, + 8, + 7, + 0, + 5, + 23 + ], + "weighted_loads": [ + 0.08433463051915169, + 0.5482613518834114, + 0.08987644501030445, + 0.2873321585357189, + 0.4147813506424427, + 0.8455020636320114, + 1.1728814132511616, + 0.4027456045150757, + 1.727592496201396, + 1.1087155416607857, + 1.467108678072691, + 0.27086005732417107, + 0.9702769480645657, + 1.2963467612862587, + 0.12467135488986969, + 0.10249999351799488, + 0.0, + 0.07838235422968864, + 0.1446346417069435, + 0.2111948076635599, + 0.6298696529120207, + 0.9025582727044821, + 0.23388556763529778, + 0.11402851715683937, + 0.2163655012845993, + 1.0937913935631514, + 0.0, + 0.3669173549860716, + 0.09362094104290009, + 0.782501045614481, + 4.109706562943757, + 0.3157863225787878, + 0.36823078244924545, + 0.6092805098742247, + 0.08643028885126114, + 0.796754464507103, + 0.03197038173675537, + 0.07965748757123947, + 0.3852127566933632, + 0.924709802493453, + 0.27886664494872093, + 0.06981474161148071, + 0.2063184417784214, + 0.03550399839878082, + 0.3211693912744522, + 0.25378087535500526, + 0.13516003265976906, + 0.09955648891627789, + 1.8476677611470222, + 1.1997137777507305, + 0.1811404675245285, + 0.3965424783527851, + 0.07225408963859081, + 0.9400887750089169, + 0.585352411493659, + 0.7775603737682104, + 1.714975267648697, + 0.5915953479707241, + 1.017074540257454, + 0.27085580863058567, + 0.3276732601225376, + 0.0, + 0.27245619893074036, + 0.9022577255964279 + ], + "unique_experts": 61, + "load_cv": 0.9003820679909378, + "normalized_load_entropy": 0.9140559846510432, + "max_load_share": 0.08176100628930817 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "4869d12841f2f1a91642099308e6c55c572d1c23005a5cd448f7f831d2bfdcba", + "route_weight_sha256": "c069d10c155e6fc62c5ee3f3b338cbbb00a0805babc258e0c664a75dd10c00bd", + "loads": [ + 2, + 12, + 5, + 9, + 6, + 22, + 24, + 11, + 25, + 20, + 28, + 3, + 13, + 25, + 7, + 3, + 0, + 2, + 4, + 8, + 15, + 19, + 13, + 3, + 14, + 26, + 0, + 9, + 10, + 19, + 52, + 12, + 6, + 12, + 11, + 13, + 3, + 4, + 13, + 19, + 3, + 3, + 8, + 2, + 8, + 7, + 3, + 8, + 21, + 15, + 11, + 12, + 6, + 17, + 10, + 13, + 28, + 16, + 28, + 8, + 10, + 15, + 7, + 25 + ], + "weighted_loads": [ + 0.08433463051915169, + 0.5844028666615486, + 0.15603202767670155, + 0.2873321585357189, + 0.4147813506424427, + 1.1598213672405109, + 1.1728814132511616, + 0.45764780044555664, + 2.2132551074028015, + 1.1087155416607857, + 1.8798993683885783, + 0.27086005732417107, + 1.0069144547451288, + 1.2963467612862587, + 0.26107232458889484, + 0.10249999351799488, + 0.0, + 0.07838235422968864, + 0.1446346417069435, + 0.23654849268496037, + 0.6632857751101255, + 0.9025582727044821, + 0.8595992811024189, + 0.11402851715683937, + 0.5186546486802399, + 1.12948446162045, + 0.0, + 0.3669173549860716, + 0.3763892129063606, + 0.9819327890872955, + 4.109706562943757, + 0.3904197048395872, + 0.396711565554142, + 0.7938840612769127, + 0.34560725279152393, + 0.8332986794412136, + 0.16986674815416336, + 0.9789732024073601, + 0.4237995147705078, + 0.924709802493453, + 0.27886664494872093, + 0.12884092330932617, + 0.24745380133390427, + 0.13947997987270355, + 0.3211693912744522, + 0.46617620438337326, + 0.13516003265976906, + 0.5073557923315093, + 1.8476677611470222, + 1.1997137777507305, + 0.39094085432589054, + 0.8588347919285297, + 0.15638934448361397, + 1.1727577671408653, + 0.585352411493659, + 0.7775603737682104, + 1.714975267648697, + 0.5915953479707241, + 1.3319211546331644, + 0.27085580863058567, + 0.4448961168527603, + 1.3809833810664713, + 0.32208101463038474, + 1.9176858514547348 + ], + "unique_experts": 62, + "load_cv": 0.7414629033751426, + "normalized_load_entropy": 0.9376361162054677, + "max_load_share": 0.06615776081424936 + } + }, + "s1_x": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "7dfdbfe2659d9bd1a448fe23f24f0035b4dd5a45850af0be08b3d9f1850478ae", + "route_weight_sha256": "3282331068cec51a0262b7ae29fbbc912d0b5f0fe44c6ec18b28472498372b58", + "loads": [ + 1, + 12, + 4, + 10, + 6, + 15, + 26, + 11, + 16, + 21, + 20, + 3, + 12, + 26, + 3, + 2, + 0, + 4, + 3, + 7, + 12, + 18, + 5, + 3, + 7, + 22, + 0, + 9, + 5, + 14, + 51, + 11, + 5, + 7, + 2, + 13, + 2, + 2, + 10, + 19, + 3, + 2, + 6, + 1, + 9, + 2, + 3, + 3, + 21, + 14, + 6, + 5, + 4, + 12, + 10, + 15, + 28, + 12, + 17, + 10, + 7, + 1, + 5, + 21 + ], + "weighted_loads": [ + 0.046396397054195404, + 0.5819217786192894, + 0.11967131681740284, + 0.33766193501651287, + 0.4188774451613426, + 0.8365774173289537, + 1.2127755433321, + 0.4157594982534647, + 1.7127458304166794, + 1.130493588745594, + 1.4789141025394201, + 0.2639099285006523, + 1.0022853631526232, + 1.318807691335678, + 0.12289877980947495, + 0.07165220566093922, + 0.0, + 0.1581126730889082, + 0.10773587971925735, + 0.22021217085421085, + 0.5585559979081154, + 0.8691897578537464, + 0.20622148923575878, + 0.11525138467550278, + 0.2496736142784357, + 0.9980340451002121, + 0.0, + 0.35294933058321476, + 0.16684594191610813, + 0.7577681858092546, + 4.046221222728491, + 0.34558997489511967, + 0.37491942569613457, + 0.5708552934229374, + 0.05415128543972969, + 0.8024787865579128, + 0.0654471218585968, + 0.07242804393172264, + 0.33928151801228523, + 0.9125365130603313, + 0.2711406238377094, + 0.06372908130288124, + 0.21090085059404373, + 0.035260267555713654, + 0.364731865003705, + 0.20135211944580078, + 0.13420840725302696, + 0.10332520119845867, + 1.8367970008403063, + 1.1793884839862585, + 0.1991477981209755, + 0.38045278936624527, + 0.09534562937915325, + 0.9092163555324078, + 0.5702644977718592, + 0.85913011059165, + 1.7092633601278067, + 0.4701688401401043, + 0.927663205191493, + 0.3305402137339115, + 0.3235589303076267, + 0.04040434956550598, + 0.262951023876667, + 0.8670718967914581 + ], + "unique_experts": 62, + "load_cv": 0.8854979623642352, + "normalized_load_entropy": 0.916830659989389, + "max_load_share": 0.08018867924528301 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "2c0739c6429d78c237d3a1396af8679ffbb5af06b4d601a0e61e7a6390d97cd4", + "route_weight_sha256": "15c9eff794d9e1eecc952182670e0277b6066084b97e2bf8db821210406c7563", + "loads": [ + 1, + 13, + 5, + 11, + 8, + 26, + 26, + 12, + 26, + 24, + 27, + 5, + 15, + 26, + 5, + 2, + 2, + 4, + 4, + 11, + 17, + 18, + 16, + 4, + 16, + 22, + 0, + 9, + 27, + 20, + 51, + 15, + 5, + 14, + 9, + 16, + 11, + 5, + 10, + 19, + 4, + 10, + 10, + 4, + 10, + 4, + 3, + 9, + 21, + 14, + 10, + 19, + 10, + 18, + 12, + 17, + 28, + 12, + 32, + 10, + 12, + 21, + 11, + 24 + ], + "weighted_loads": [ + 0.046396397054195404, + 0.6157772205770016, + 0.1451792363077402, + 0.45248003117740154, + 0.4801698587834835, + 1.2754517592256889, + 1.2127755433321, + 0.4531991798430681, + 2.395175538957119, + 1.2610687613487244, + 1.7853345486801118, + 0.33102814108133316, + 1.0639453793410212, + 1.318807691335678, + 0.20078318566083908, + 0.07165220566093922, + 0.061884934082627296, + 0.1581126730889082, + 0.13970335200428963, + 0.35624697990715504, + 0.7729647904634476, + 0.8691897578537464, + 1.027227582409978, + 0.14041843637824059, + 0.5685749729163945, + 0.9980340451002121, + 0.0, + 0.35294933058321476, + 1.2414517868310213, + 1.0107094831764698, + 4.046221222728491, + 0.5114083290100098, + 0.37491942569613457, + 0.9260225184261799, + 0.28999582724645734, + 0.9557778276503086, + 0.7124388553202152, + 1.0166540741920471, + 0.33928151801228523, + 0.9125365130603313, + 0.38500553742051125, + 0.5323597062379122, + 0.3107245545834303, + 0.31623489409685135, + 0.40435592643916607, + 0.3831389546394348, + 0.13420840725302696, + 0.5850958226947114, + 1.8367970008403063, + 1.1793884839862585, + 0.3748735263943672, + 1.3940855786204338, + 0.2686344292014837, + 1.266625577583909, + 0.7449398543685675, + 0.9571848213672638, + 1.7092633601278067, + 0.4701688401401043, + 1.5707126539200544, + 0.3305402137339115, + 0.49458996392786503, + 2.038549912162125, + 0.611118055996485, + 1.926890030503273 + ], + "unique_experts": 63, + "load_cv": 0.664484218270333, + "normalized_load_entropy": 0.9478055898382327, + "max_load_share": 0.05782312925170068 + } + }, + "s0_period": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "c8d90960180f88013aafd8b69867378bcea586b496ee1de43b35d98f68d739a3", + "route_weight_sha256": "d23f5853824199e431b0616a7466003f50368bafd6f4dc158d9e4d34060b3b65", + "loads": [ + 2, + 13, + 5, + 6, + 6, + 16, + 25, + 10, + 15, + 20, + 18, + 3, + 12, + 26, + 3, + 4, + 0, + 1, + 5, + 7, + 12, + 20, + 4, + 3, + 6, + 25, + 0, + 9, + 2, + 14, + 51, + 9, + 5, + 8, + 4, + 13, + 0, + 2, + 13, + 20, + 3, + 2, + 7, + 1, + 8, + 5, + 3, + 3, + 22, + 14, + 5, + 5, + 3, + 12, + 10, + 14, + 27, + 15, + 18, + 8, + 7, + 0, + 5, + 22 + ], + "weighted_loads": [ + 0.08257696032524109, + 0.5999819226562977, + 0.1509311329573393, + 0.2073021661490202, + 0.4163597300648689, + 0.8807458337396383, + 1.2075069844722748, + 0.3903878666460514, + 1.6998638343065977, + 1.1133928522467613, + 1.4650078751146793, + 0.27293800190091133, + 0.9911377802491188, + 1.3157745134085417, + 0.1251545175909996, + 0.13305787928402424, + 0.0, + 0.05061676725745201, + 0.1761628407984972, + 0.21389836445450783, + 0.5641126222908497, + 0.9327712822705507, + 0.17605778574943542, + 0.11615752056241035, + 0.22213587537407875, + 1.0978175438940525, + 0.0, + 0.3720179330557585, + 0.07047189399600029, + 0.799971217289567, + 4.139115002937615, + 0.28040303476154804, + 0.376080434769392, + 0.6085587907582521, + 0.10945137031376362, + 0.8289247266948223, + 0.0, + 0.07856559753417969, + 0.4221804831176996, + 0.9462918341159821, + 0.28307514265179634, + 0.07159498706459999, + 0.24716589599847794, + 0.03634173050522804, + 0.31841290555894375, + 0.2701683025807142, + 0.1343955285847187, + 0.10087842494249344, + 1.870750728994608, + 1.1849854066967964, + 0.18594864010810852, + 0.361760176718235, + 0.07172805443406105, + 0.9495336972177029, + 0.5875517036765814, + 0.8090934306383133, + 1.6823350619524717, + 0.5736515019088984, + 0.9724070765078068, + 0.2605424243956804, + 0.3272121772170067, + 0.0, + 0.2783573493361473, + 0.8821563366800547 + ], + "unique_experts": 60, + "load_cv": 0.8980947093914455, + "normalized_load_entropy": 0.9127991550503247, + "max_load_share": 0.08018867924528301 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "30086c91bbf25cfaf8f0d8863c5b7f23c62c0cec38adb7822fd11a6160798168", + "route_weight_sha256": "8c428429d047b1e29dc888166d670c1d97ff0c864ebd86d4703bcff52b37bf50", + "loads": [ + 2, + 14, + 7, + 6, + 6, + 23, + 25, + 12, + 23, + 20, + 27, + 3, + 13, + 26, + 7, + 4, + 0, + 1, + 5, + 8, + 13, + 20, + 11, + 3, + 14, + 25, + 0, + 9, + 10, + 19, + 51, + 11, + 6, + 13, + 11, + 13, + 1, + 5, + 13, + 20, + 3, + 4, + 10, + 3, + 8, + 7, + 3, + 8, + 22, + 14, + 11, + 12, + 6, + 16, + 10, + 14, + 27, + 15, + 28, + 8, + 9, + 16, + 8, + 24 + ], + "weighted_loads": [ + 0.08257696032524109, + 0.6478064991533756, + 0.21708671562373638, + 0.2073021661490202, + 0.4163597300648689, + 1.1991087164497003, + 1.2075069844722748, + 0.4822891615331173, + 2.0989782363176346, + 1.1133928522467613, + 1.8234498135279864, + 0.27293800190091133, + 0.993870496051386, + 1.3157745134085417, + 0.25787058658897877, + 0.13305787928402424, + 0.0, + 0.05061676725745201, + 0.1761628407984972, + 0.24224630184471607, + 0.5975287444889545, + 0.9327712822705507, + 0.7764918431639671, + 0.11615752056241035, + 0.5244250227697194, + 1.0978175438940525, + 0.0, + 0.3720179330557585, + 0.3834720868617296, + 0.9994029607623816, + 4.139115002937615, + 0.35918780602514744, + 0.40456121787428856, + 0.8276967033743858, + 0.33236057683825493, + 0.8289247266948223, + 0.09627477079629898, + 1.0082705058157444, + 0.4221804831176996, + 0.9462918341159821, + 0.28307514265179634, + 0.19172140583395958, + 0.32370568066835403, + 0.1694968417286873, + 0.31841290555894375, + 0.4616746958345175, + 0.1343955285847187, + 0.5139949916629121, + 1.870750728994608, + 1.1849854066967964, + 0.45445895940065384, + 0.9119088836014271, + 0.1558633092790842, + 1.1229069791734219, + 0.5875517036765814, + 0.8090934306383133, + 1.6823350619524717, + 0.5736515019088984, + 1.3207646049559116, + 0.2605424243956804, + 0.408884946256876, + 1.4480374106206, + 0.35726238426286727, + 1.8975844625383615 + ], + "unique_experts": 62, + "load_cv": 0.7296323964054258, + "normalized_load_entropy": 0.9388093259089458, + "max_load_share": 0.0648854961832061 + } + }, + "s1_period": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "662c7200613e821f3188699471ab0ded100b7142a7c920f257a7513fca7316c5", + "route_weight_sha256": "c24cde10478784a63e4816e3c348cc4070839824bcdbd61ca4a83bc82563ea53", + "loads": [ + 3, + 13, + 4, + 9, + 6, + 15, + 25, + 12, + 15, + 21, + 19, + 3, + 12, + 26, + 3, + 3, + 0, + 4, + 3, + 7, + 13, + 18, + 5, + 3, + 7, + 25, + 0, + 8, + 3, + 14, + 51, + 12, + 5, + 7, + 2, + 12, + 1, + 2, + 11, + 21, + 3, + 1, + 5, + 1, + 8, + 2, + 3, + 4, + 21, + 15, + 6, + 5, + 4, + 12, + 10, + 14, + 27, + 11, + 18, + 9, + 7, + 1, + 5, + 21 + ], + "weighted_loads": [ + 0.11581508815288544, + 0.6181940082460642, + 0.12324302643537521, + 0.3022449053823948, + 0.41201433166861534, + 0.8377070110291243, + 1.1661463864147663, + 0.4398889448493719, + 1.701953910291195, + 1.139643419533968, + 1.4479512311518192, + 0.2628418058156967, + 1.0170642510056496, + 1.3211530055850744, + 0.1219918318092823, + 0.10469798743724823, + 0.0, + 0.1529269814491272, + 0.10874214395880699, + 0.21881199441850185, + 0.5872001927345991, + 0.8670947197824717, + 0.20047068782150745, + 0.11721891537308693, + 0.2446225117892027, + 1.0818618442863226, + 0.0, + 0.33406485617160797, + 0.10792082734405994, + 0.7770142871886492, + 4.0557201355695724, + 0.3709075041115284, + 0.3732827417552471, + 0.581877339631319, + 0.04571632482111454, + 0.7701271586120129, + 0.03272818773984909, + 0.07280337810516357, + 0.36192226223647594, + 0.9689091183245182, + 0.27403921633958817, + 0.025295164436101913, + 0.18309667520225048, + 0.03513478487730026, + 0.3293223846703768, + 0.1877819150686264, + 0.13517561927437782, + 0.1353741679340601, + 1.858200328424573, + 1.202841131016612, + 0.19637452065944672, + 0.3902365230023861, + 0.10139021091163158, + 0.9319121763110161, + 0.5699378419667482, + 0.831144668161869, + 1.7095417845994234, + 0.4454935919493437, + 0.9734462071210146, + 0.30372102186083794, + 0.3198771681636572, + 0.0352448970079422, + 0.26690239645540714, + 0.8675693925470114 + ], + "unique_experts": 62, + "load_cv": 0.8911974097071355, + "normalized_load_entropy": 0.9157633056716474, + "max_load_share": 0.08018867924528301 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "0467aa37cd6d6156104a7dbdade2e134b554b1cb21955d8154b50ca3498f7cf0", + "route_weight_sha256": "01fd5264eeed5eee389f19bb98af20ceb239910fb54c15e1ff343acf7f1f6526", + "loads": [ + 3, + 14, + 5, + 10, + 8, + 26, + 25, + 13, + 24, + 24, + 26, + 5, + 15, + 26, + 6, + 3, + 1, + 4, + 4, + 11, + 17, + 18, + 16, + 4, + 16, + 25, + 0, + 8, + 25, + 19, + 51, + 15, + 5, + 13, + 9, + 14, + 8, + 6, + 12, + 21, + 4, + 10, + 8, + 5, + 9, + 5, + 3, + 11, + 21, + 15, + 12, + 20, + 10, + 18, + 12, + 16, + 27, + 11, + 33, + 9, + 12, + 21, + 11, + 24 + ], + "weighted_loads": [ + 0.11581508815288544, + 0.6527758967131376, + 0.14875094592571259, + 0.41706300154328346, + 0.4733067452907562, + 1.2720714438473806, + 1.1661463864147663, + 0.47732862643897533, + 2.329592779278755, + 1.2702185921370983, + 1.7543716772925109, + 0.32996001839637756, + 1.0787242671940476, + 1.3211530055850744, + 0.22816874273121357, + 0.10469798743724823, + 0.028864020481705666, + 0.1529269814491272, + 0.14070961624383926, + 0.35878964327275753, + 0.7694209571927786, + 0.8670947197824717, + 1.0230322126299143, + 0.14238596707582474, + 0.5635238704271615, + 1.0818618442863226, + 0.0, + 0.33406485617160797, + 1.1973527055233717, + 0.9965478368103504, + 4.0557201355695724, + 0.5101507641375065, + 0.3732827417552471, + 0.8970387876033783, + 0.27580454433336854, + 0.8705416359007359, + 0.5582198910415173, + 1.0547745153307915, + 0.4006484169512987, + 0.9689091183245182, + 0.38790412992239, + 0.5390029605478048, + 0.25710833072662354, + 0.35789068043231964, + 0.3689464461058378, + 0.4208504445850849, + 0.13517561927437782, + 0.668912377092056, + 1.858200328424573, + 1.202841131016612, + 0.47595956176519394, + 1.439264502376318, + 0.27467901073396206, + 1.2976653650403023, + 0.7446131985634565, + 0.9291993789374828, + 1.7095417845994234, + 0.4454935919493437, + 1.6288129072636366, + 0.30372102186083794, + 0.4946935623884201, + 2.011673388071358, + 0.6150694285752252, + 1.9273875262588263 + ], + "unique_experts": 63, + "load_cv": 0.6563871907327573, + "normalized_load_entropy": 0.949716220442797, + "max_load_share": 0.05782312925170068 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 106, + "ordered_topk_exact_tokens": 63, + "set_exact_tokens": 75, + "mean_set_jaccard": 0.9128481581311769, + "mean_token_weighted_tv": 0.013505362475044885, + "aggregate_load_tv": 0.031446540880503145 + }, + "system_bos": { + "tokens": 106, + "ordered_topk_exact_tokens": 51, + "set_exact_tokens": 71, + "mean_set_jaccard": 0.9036388140161725, + "mean_token_weighted_tv": 0.015307431702308779, + "aggregate_load_tv": 0.04402515723270441 + }, + "system_x": { + "tokens": 106, + "ordered_topk_exact_tokens": 53, + "set_exact_tokens": 71, + "mean_set_jaccard": 0.9036388140161725, + "mean_token_weighted_tv": 0.01688763434682393, + "aggregate_load_tv": 0.04245283018867924 + }, + "system_period": { + "tokens": 106, + "ordered_topk_exact_tokens": 54, + "set_exact_tokens": 70, + "mean_set_jaccard": 0.9009433962264153, + "mean_token_weighted_tv": 0.017044738686274527, + "aggregate_load_tv": 0.040880503144654086 + }, + "bos_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 53, + "set_exact_tokens": 71, + "mean_set_jaccard": 0.9036388140161724, + "mean_token_weighted_tv": 0.016086232668351172, + "aggregate_load_tv": 0.03616352201257861 + }, + "bos_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 53, + "set_exact_tokens": 69, + "mean_set_jaccard": 0.9002695417789759, + "mean_token_weighted_tv": 0.016856778949007112, + "aggregate_load_tv": 0.04402515723270441 + }, + "x_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 47, + "set_exact_tokens": 65, + "mean_set_jaccard": 0.885893980233603, + "mean_token_weighted_tv": 0.01853765624153586, + "aggregate_load_tv": 0.037735849056603765 + }, + "x_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 43, + "set_exact_tokens": 63, + "mean_set_jaccard": 0.8760107816711591, + "mean_token_weighted_tv": 0.02146605586738519, + "aggregate_load_tv": 0.03930817610062892 + }, + "period_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 50, + "set_exact_tokens": 64, + "mean_set_jaccard": 0.8831985624438454, + "mean_token_weighted_tv": 0.018534418621610076, + "aggregate_load_tv": 0.02987421383647798 + }, + "period_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 49, + "set_exact_tokens": 63, + "mean_set_jaccard": 0.8780323450134772, + "mean_token_weighted_tv": 0.02065375306696262, + "aggregate_load_tv": 0.04874213836477987 + } + } + }, + "layer_25": { + "layer": 25, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "08502856ac45a921a044c58f6a99c791c6203b34815ede6ec7c28933745bd40f", + "route_weight_sha256": "d5730954efd33f5902299a1e6425705f32a7331c8a00e5f8d01f877cb0c4fd9d", + "loads": [ + 13, + 5, + 7, + 15, + 4, + 19, + 4, + 18, + 5, + 4, + 2, + 3, + 5, + 4, + 25, + 26, + 20, + 14, + 9, + 5, + 19, + 8, + 4, + 1, + 6, + 16, + 5, + 10, + 1, + 2, + 12, + 13, + 3, + 8, + 9, + 18, + 5, + 7, + 13, + 3, + 12, + 11, + 5, + 4, + 3, + 4, + 9, + 20, + 25, + 3, + 13, + 21, + 12, + 4, + 4, + 12, + 15, + 2, + 36, + 10, + 13, + 14, + 9, + 5 + ], + "weighted_loads": [ + 0.6120821759104729, + 0.40994483418762684, + 0.23900250904262066, + 0.7273005992174149, + 0.16001795791089535, + 1.299442745745182, + 0.2572642043232918, + 1.2196248453110456, + 0.175771189853549, + 0.15520013123750687, + 0.09829366952180862, + 0.1224689856171608, + 0.22556714713573456, + 0.13127460703253746, + 2.0299437437206507, + 0.9998490400612354, + 1.166745675727725, + 0.8622094169259071, + 0.4514722842723131, + 0.3192886933684349, + 1.0852257385849953, + 0.25951768830418587, + 0.16642729192972183, + 0.03199540078639984, + 0.29011951573193073, + 1.3313472159206867, + 0.15320043079555035, + 0.49995823577046394, + 0.08434732258319855, + 0.1005833949893713, + 0.6232142299413681, + 1.062998877838254, + 0.08834448270499706, + 0.2764428574591875, + 0.24449674971401691, + 1.5024751424789429, + 0.5581168010830879, + 0.27747150510549545, + 1.5178567692637444, + 0.7303248085081577, + 0.5546784084290266, + 0.47983788326382637, + 0.2255271039903164, + 0.12327747978270054, + 0.1888015829026699, + 0.3248411640524864, + 0.32285880483686924, + 1.4674171973019838, + 1.7926145661622286, + 0.10025337338447571, + 0.7683673202991486, + 1.29748310521245, + 1.3545661978423595, + 0.21671905554831028, + 0.14230073057115078, + 0.5959612522274256, + 0.5056404545903206, + 0.07793906331062317, + 1.903656430542469, + 0.3502559568732977, + 0.6982702668756247, + 1.2360477149486542, + 0.7110411524772644, + 0.16837383806705475 + ], + "unique_experts": 64, + "load_cv": 0.7271430369350493, + "normalized_load_entropy": 0.9405986189041178, + "max_load_share": 0.05660377358490566 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "547a7f2f6c9be8eb86425e348ebe694c7fbe45067cb7e2fdeeab83e18460a7b8", + "route_weight_sha256": "b1fc375d5ea4f0ebef0c5d6e7452e4632221e3da7949013460d6f4105cb229cd", + "loads": [ + 15, + 23, + 12, + 16, + 4, + 19, + 11, + 18, + 5, + 4, + 11, + 7, + 7, + 4, + 25, + 26, + 20, + 17, + 10, + 5, + 19, + 8, + 4, + 7, + 6, + 16, + 5, + 10, + 2, + 7, + 12, + 14, + 5, + 10, + 11, + 18, + 5, + 8, + 25, + 5, + 19, + 12, + 5, + 6, + 8, + 14, + 12, + 20, + 25, + 3, + 23, + 21, + 18, + 4, + 13, + 12, + 16, + 4, + 36, + 10, + 15, + 14, + 15, + 5 + ], + "weighted_loads": [ + 0.7176449224352837, + 1.8588785594329238, + 0.5369763728231192, + 0.7860293090343475, + 0.16001795791089535, + 1.299442745745182, + 0.71849475055933, + 1.2196248453110456, + 0.175771189853549, + 0.15520013123750687, + 1.0458512976765633, + 0.81335294758901, + 0.5181074738502502, + 0.13127460703253746, + 2.0299437437206507, + 0.9998490400612354, + 1.166745675727725, + 0.9609044566750526, + 0.4777167495340109, + 0.3192886933684349, + 1.0852257385849953, + 0.25951768830418587, + 0.16642729192972183, + 0.29169759526848793, + 0.29011951573193073, + 1.3313472159206867, + 0.15320043079555035, + 0.49995823577046394, + 0.12544658407568932, + 0.2793259993195534, + 0.6232142299413681, + 1.1600067559629679, + 0.28981935046613216, + 0.38303241319954395, + 0.3303940277546644, + 1.5024751424789429, + 0.5581168010830879, + 0.3485705107450485, + 3.051146889105439, + 0.930526364594698, + 0.8366395756602287, + 0.5222136862576008, + 0.2255271039903164, + 0.19403704814612865, + 0.6113437637686729, + 1.1880362164229155, + 0.414171043317765, + 1.4674171973019838, + 1.7926145661622286, + 0.10025337338447571, + 1.3749786391854286, + 1.29748310521245, + 1.66431180620566, + 0.21671905554831028, + 0.5992036480456591, + 0.5959612522274256, + 0.575110673904419, + 0.14861373230814934, + 1.903656430542469, + 0.3502559568732977, + 0.7949926387518644, + 1.2360477149486542, + 1.1568758133798838, + 0.16837383806705475 + ], + "unique_experts": 64, + "load_cv": 0.5837074700414017, + "normalized_load_entropy": 0.9597583577774208, + "max_load_share": 0.04580152671755725 + } + }, + "s1_eos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "3d4ed338df973f678a024f9d3843fcb75321a0b64750e6f89aae78102a2f8dbd", + "route_weight_sha256": "c12bc8a81c4affbd5c0403d06d2d7f4ff05bd59833d462f968d8cd7ba4e52dfd", + "loads": [ + 14, + 5, + 7, + 14, + 4, + 18, + 4, + 17, + 6, + 3, + 3, + 2, + 5, + 3, + 25, + 31, + 18, + 15, + 9, + 5, + 20, + 8, + 4, + 3, + 6, + 16, + 5, + 10, + 1, + 1, + 12, + 12, + 4, + 6, + 9, + 18, + 5, + 7, + 12, + 3, + 9, + 11, + 5, + 3, + 3, + 4, + 10, + 22, + 25, + 4, + 13, + 21, + 13, + 4, + 4, + 11, + 12, + 2, + 37, + 11, + 13, + 14, + 9, + 6 + ], + "weighted_loads": [ + 0.639429360628128, + 0.4089179988950491, + 0.2403968684375286, + 0.6959938108921051, + 0.162962069734931, + 1.2715580072253942, + 0.2550036758184433, + 1.1673679184168577, + 0.19719355180859566, + 0.10551320761442184, + 0.13288320414721966, + 0.09403696283698082, + 0.22761430218815804, + 0.09558623656630516, + 2.0483450908213854, + 1.1610429007560015, + 1.1077989153563976, + 0.8560534790158272, + 0.46039247140288353, + 0.32309047505259514, + 1.1132822018116713, + 0.25807869620621204, + 0.16446064412593842, + 0.10756631940603256, + 0.28846945986151695, + 1.3517530523240566, + 0.1553075946867466, + 0.49961914867162704, + 0.0830266922712326, + 0.07230031490325928, + 0.6399180684238672, + 1.066386889666319, + 0.12206132896244526, + 0.20722244307398796, + 0.252429710701108, + 1.486911129206419, + 0.5649891011416912, + 0.2822628915309906, + 1.4744171425700188, + 0.7174752727150917, + 0.4527278132736683, + 0.49621877260506153, + 0.22096048295497894, + 0.09190934896469116, + 0.18807825073599815, + 0.3278323858976364, + 0.34728620760142803, + 1.5672987159341574, + 1.7759782392531633, + 0.13457678444683552, + 0.7749405056238174, + 1.2918617874383926, + 1.389824340119958, + 0.21763204596936703, + 0.14100019074976444, + 0.5769595764577389, + 0.41910175047814846, + 0.07194001041352749, + 1.9274916667491198, + 0.378611559048295, + 0.7014836650341749, + 1.2513622902333736, + 0.7115219980478287, + 0.1972903087735176 + ], + "unique_experts": 64, + "load_cv": 0.7485862101523775, + "normalized_load_entropy": 0.9389713060276051, + "max_load_share": 0.05817610062893082 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "e2e229f809f96a9007f4578586f9994024dd6e4159beebda65ad46acbf3196d7", + "route_weight_sha256": "c2374fb9fd696d33776b02887c6c3d14c1e350d4e51e02f4134fdc6eff6ca9b5", + "loads": [ + 17, + 29, + 15, + 15, + 4, + 19, + 11, + 17, + 8, + 4, + 25, + 6, + 10, + 3, + 25, + 31, + 18, + 23, + 10, + 6, + 23, + 15, + 4, + 12, + 6, + 16, + 6, + 10, + 2, + 7, + 12, + 15, + 10, + 6, + 11, + 18, + 6, + 14, + 23, + 7, + 16, + 12, + 6, + 4, + 12, + 18, + 13, + 22, + 25, + 5, + 25, + 21, + 21, + 10, + 17, + 12, + 15, + 5, + 37, + 12, + 17, + 15, + 14, + 9 + ], + "weighted_loads": [ + 0.8979623317718506, + 2.400036240927875, + 0.6407473888248205, + 0.7700270116329193, + 0.162962069734931, + 1.3093592505902052, + 0.859914168715477, + 1.1673679184168577, + 0.31211667880415916, + 0.1340617910027504, + 2.0880297403782606, + 0.8517985418438911, + 0.6811954379081726, + 0.09558623656630516, + 2.0483450908213854, + 1.1610429007560015, + 1.1077989153563976, + 1.5017050504684448, + 0.5121401697397232, + 0.3467461410909891, + 1.3705246951431036, + 0.9010304473340511, + 0.16446064412593842, + 0.4560701549053192, + 0.28846945986151695, + 1.3517530523240566, + 0.1885077990591526, + 0.49961914867162704, + 0.12862134724855423, + 0.30028451420366764, + 0.6399180684238672, + 1.5328869484364986, + 0.4629280250519514, + 0.20722244307398796, + 0.3495402168482542, + 1.486911129206419, + 0.6091265492141247, + 0.6329012457281351, + 3.2284540086984634, + 1.0987639240920544, + 0.7702968008816242, + 0.5216946229338646, + 0.3077094107866287, + 0.12218562886118889, + 0.9028452672064304, + 1.640027454122901, + 0.4393456826219335, + 1.5672987159341574, + 1.7759782392531633, + 0.18369814567267895, + 1.5046975668519735, + 1.2918617874383926, + 1.864731484092772, + 0.6908398102968931, + 0.9943563211709261, + 0.6032390370965004, + 0.5646494012326002, + 0.183984212577343, + 1.9274916667491198, + 0.46533470042049885, + 0.9394693803042173, + 1.2943799830973148, + 1.1451252456754446, + 0.2970155980437994 + ], + "unique_experts": 64, + "load_cv": 0.5448928163060354, + "normalized_load_entropy": 0.9642627478939267, + "max_load_share": 0.04195011337868481 + } + }, + "s0_bos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "39a7eefa4d3b63f78fb2c75713b99a1fdfe03e80ae133a3d8903446919c2e7cc", + "route_weight_sha256": "b2db5c6f868ab8d2c30419096d93be075634770e4dd75ec0c9d2877d678cb340", + "loads": [ + 14, + 5, + 6, + 15, + 4, + 20, + 4, + 18, + 5, + 4, + 2, + 5, + 5, + 3, + 25, + 24, + 19, + 14, + 9, + 5, + 20, + 8, + 4, + 2, + 6, + 15, + 5, + 10, + 1, + 1, + 12, + 12, + 3, + 6, + 7, + 18, + 6, + 9, + 13, + 4, + 12, + 12, + 5, + 2, + 3, + 4, + 10, + 22, + 25, + 4, + 14, + 22, + 13, + 3, + 4, + 12, + 10, + 2, + 35, + 11, + 15, + 14, + 9, + 5 + ], + "weighted_loads": [ + 0.6534525472670794, + 0.425979670137167, + 0.20686771161854267, + 0.7323553524911404, + 0.1532075572758913, + 1.3589180670678616, + 0.247385049238801, + 1.2406028341501951, + 0.16727379150688648, + 0.13923608511686325, + 0.09203245863318443, + 0.16710404679179192, + 0.2261359579861164, + 0.08902222290635109, + 2.0603879038244486, + 0.9276839140802622, + 1.1379851512610912, + 0.8597220107913017, + 0.46439865976572037, + 0.3225242756307125, + 1.1286158673465252, + 0.2582556791603565, + 0.16076268255710602, + 0.06077997758984566, + 0.30003662779927254, + 1.314371731132269, + 0.15697402134537697, + 0.5065793618559837, + 0.08015383780002594, + 0.0687231495976448, + 0.6445805300027132, + 1.063982181251049, + 0.09082606062293053, + 0.20709598436951637, + 0.202199874445796, + 1.5010056644678116, + 0.5907944831997156, + 0.3335664812475443, + 1.49654133990407, + 0.7273866403847933, + 0.5782719179987907, + 0.5378142185509205, + 0.22914185374975204, + 0.0633209366351366, + 0.19392095878720284, + 0.32807815447449684, + 0.3450818080455065, + 1.5372121315449476, + 1.775368805974722, + 0.1418189462274313, + 0.8154427725821733, + 1.335045948624611, + 1.3950819093734026, + 0.19129648432135582, + 0.14523464441299438, + 0.6135180164128542, + 0.36672905646264553, + 0.06980745308101177, + 1.8754612412303686, + 0.37369409389793873, + 0.7379527352750301, + 1.2675549574196339, + 0.7071134895086288, + 0.1709223110228777 + ], + "unique_experts": 64, + "load_cv": 0.7256182838879023, + "normalized_load_entropy": 0.9402774495597133, + "max_load_share": 0.055031446540880505 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "46c1e27673f06198a3f28e10a1d538d802e91ba7ebaf803de7f2bd54f2a80400", + "route_weight_sha256": "d4656fdab4c138793469bd76f5ba31c4f331e48f3936382642e1fa049b7f5637", + "loads": [ + 15, + 23, + 12, + 16, + 4, + 20, + 11, + 19, + 6, + 4, + 12, + 8, + 8, + 3, + 25, + 24, + 19, + 17, + 10, + 5, + 20, + 8, + 4, + 8, + 6, + 15, + 5, + 10, + 2, + 5, + 13, + 13, + 5, + 7, + 9, + 18, + 6, + 10, + 24, + 5, + 19, + 14, + 5, + 4, + 8, + 13, + 12, + 22, + 25, + 5, + 24, + 22, + 18, + 3, + 14, + 12, + 11, + 5, + 35, + 11, + 16, + 14, + 15, + 5 + ], + "weighted_loads": [ + 0.707193786278367, + 1.8378971153870225, + 0.6194097604602575, + 0.8641936592757702, + 0.1532075572758913, + 1.3589180670678616, + 0.7081150691956282, + 1.2925153877586126, + 0.22371130995452404, + 0.13923608511686325, + 1.1528347544372082, + 0.8769127912819386, + 0.5942571125924587, + 0.08902222290635109, + 2.0603879038244486, + 0.9276839140802622, + 1.1379851512610912, + 0.9584170505404472, + 0.49064312502741814, + 0.3225242756307125, + 1.1286158673465252, + 0.2582556791603565, + 0.16076268255710602, + 0.3102871384471655, + 0.30003662779927254, + 1.314371731132269, + 0.15697402134537697, + 0.5065793618559837, + 0.12125309929251671, + 0.21054429933428764, + 0.8718091417104006, + 1.160990059375763, + 0.2786187417805195, + 0.2660347633063793, + 0.3031932171434164, + 1.5010056644678116, + 0.5907944831997156, + 0.40138659067451954, + 2.112283458933234, + 0.8823801297694445, + 0.8602330852299929, + 0.6252077966928482, + 0.22914185374975204, + 0.13256158493459225, + 0.6192038953304291, + 1.1480424515902996, + 0.43506566993892193, + 1.5372121315449476, + 1.775368805974722, + 0.18513883836567402, + 1.4220540914684534, + 1.335045948624611, + 1.6991722416132689, + 0.19129648432135582, + 0.6603842601180077, + 0.6135180164128542, + 0.4340257626026869, + 0.1851638425141573, + 1.8754612412303686, + 0.37369409389793873, + 0.7913895212113857, + 1.2675549574196339, + 1.1529481504112482, + 0.1709223110228777 + ], + "unique_experts": 64, + "load_cv": 0.5808609131705621, + "normalized_load_entropy": 0.9598612850784619, + "max_load_share": 0.044529262086514 + } + }, + "s1_bos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "e56c0843a6febd8b9ed2b5c7943db076092afec996c3f40427a2938ff071697d", + "route_weight_sha256": "10286430294284d6219477a8692d7e50db04bbc1e95c3ee54cf25e7b04d1dd8a", + "loads": [ + 14, + 5, + 7, + 18, + 5, + 19, + 4, + 18, + 6, + 1, + 3, + 4, + 5, + 3, + 24, + 26, + 18, + 14, + 10, + 4, + 19, + 9, + 5, + 3, + 5, + 16, + 5, + 10, + 1, + 1, + 13, + 12, + 3, + 7, + 7, + 18, + 6, + 8, + 13, + 4, + 12, + 11, + 5, + 2, + 3, + 4, + 8, + 22, + 26, + 2, + 14, + 22, + 12, + 3, + 4, + 12, + 12, + 2, + 35, + 9, + 13, + 15, + 9, + 6 + ], + "weighted_loads": [ + 0.6488940641283989, + 0.4229255560785532, + 0.24662361666560173, + 0.8224338460713625, + 0.20574322901666164, + 1.328097440302372, + 0.22722508385777473, + 1.2017730586230755, + 0.20021973550319672, + 0.03508699685335159, + 0.12691366113722324, + 0.14622855558991432, + 0.22282897867262363, + 0.08793492987751961, + 1.999707281589508, + 1.0075274761766195, + 1.1035546250641346, + 0.8571745790541172, + 0.5046993438154459, + 0.27920839190483093, + 1.1011197194457054, + 0.2914354782551527, + 0.19653845578432083, + 0.11216909065842628, + 0.25518988259136677, + 1.3109839111566544, + 0.15942863747477531, + 0.5074382349848747, + 0.0810927301645279, + 0.07129945605993271, + 0.6777687147259712, + 1.0729801505804062, + 0.08885837346315384, + 0.23832127451896667, + 0.2043730542063713, + 1.5049410741776228, + 0.5975111983716488, + 0.3276763781905174, + 1.4901809990406036, + 0.7194262687116861, + 0.5551776811480522, + 0.49918464571237564, + 0.22578531503677368, + 0.0663509014993906, + 0.18132970482110977, + 0.32008009031414986, + 0.28069197945296764, + 1.5392373725771904, + 1.7642485406249762, + 0.08954031765460968, + 0.8165629878640175, + 1.3078774362802505, + 1.3432904817163944, + 0.1926928460597992, + 0.13428926467895508, + 0.6024582032114267, + 0.42880640737712383, + 0.06992986798286438, + 1.872279666364193, + 0.3201516605913639, + 0.6873400490731001, + 1.2588903345167637, + 0.7099761180579662, + 0.20760851725935936 + ], + "unique_experts": 64, + "load_cv": 0.7336418005561558, + "normalized_load_entropy": 0.9386393646774476, + "max_load_share": 0.055031446540880505 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "587d1d6e883c03c515e42895c3d6ccdced9af2fb88421e5161e8ce43b852c19c", + "route_weight_sha256": "b651aeed9574360006b54aa9a0a8f328875a3e75dc65a88bef6ce7f6b81b637b", + "loads": [ + 16, + 30, + 16, + 19, + 5, + 20, + 11, + 18, + 10, + 2, + 26, + 7, + 12, + 3, + 24, + 26, + 18, + 22, + 11, + 5, + 22, + 16, + 5, + 12, + 5, + 16, + 6, + 10, + 2, + 6, + 13, + 15, + 10, + 7, + 10, + 18, + 7, + 15, + 23, + 7, + 19, + 11, + 6, + 3, + 12, + 18, + 9, + 22, + 26, + 4, + 26, + 22, + 19, + 9, + 17, + 13, + 15, + 5, + 35, + 10, + 16, + 16, + 14, + 9 + ], + "weighted_loads": [ + 0.8465522862970829, + 2.3919032653793693, + 0.7601640578359365, + 0.8724150005728006, + 0.20574322901666164, + 1.365898683667183, + 0.8302656374871731, + 1.2017730586230755, + 0.3985966332256794, + 0.06363558024168015, + 2.240397648885846, + 0.8907910771667957, + 0.7842930741608143, + 0.08793492987751961, + 1.999707281589508, + 1.0075274761766195, + 1.1035546250641346, + 1.5028261505067348, + 0.5564470421522856, + 0.3028640579432249, + 1.3583622127771378, + 0.9343872293829918, + 0.19653845578432083, + 0.45804097689688206, + 0.25518988259136677, + 1.3109839111566544, + 0.19262884184718132, + 0.5074382349848747, + 0.12668738514184952, + 0.26301993429660797, + 0.6777687147259712, + 1.539480209350586, + 0.5005156546831131, + 0.23832127451896667, + 0.35592493787407875, + 1.5049410741776228, + 0.6416486464440823, + 0.6799534726887941, + 2.34248036891222, + 1.0489580910652876, + 0.8727466687560081, + 0.49918464571237564, + 0.31253424286842346, + 0.09662718139588833, + 0.8826137855648994, + 1.5847697407007217, + 0.3223734814673662, + 1.5392373725771904, + 1.7642485406249762, + 0.1824655570089817, + 1.5463200490921736, + 1.3078774362802505, + 1.8164909891784191, + 0.6659006103873253, + 0.9832821786403656, + 0.6287376638501883, + 0.5908805709332228, + 0.20307746529579163, + 1.872279666364193, + 0.40687480196356773, + 0.8630334790796041, + 1.3019080273807049, + 1.1435793656855822, + 0.2987628970295191 + ], + "unique_experts": 64, + "load_cv": 0.5394299986498908, + "normalized_load_entropy": 0.9638597282319784, + "max_load_share": 0.03968253968253968 + } + }, + "s0_x": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "0d60d4165d016809036c1e1a7cc14c407be67394e1748048bbb2fe40d5f89565", + "route_weight_sha256": "ca475ffb7eceacc0f86209a0b78e328059385f0f22ecc6f801c93e6230a5637d", + "loads": [ + 15, + 4, + 6, + 15, + 5, + 18, + 4, + 16, + 6, + 6, + 2, + 5, + 5, + 4, + 25, + 27, + 19, + 14, + 10, + 4, + 19, + 7, + 4, + 3, + 7, + 16, + 4, + 10, + 1, + 1, + 13, + 12, + 3, + 8, + 6, + 18, + 6, + 9, + 14, + 4, + 12, + 11, + 5, + 2, + 3, + 5, + 9, + 21, + 24, + 2, + 13, + 21, + 11, + 3, + 5, + 12, + 11, + 3, + 35, + 11, + 12, + 14, + 9, + 7 + ], + "weighted_loads": [ + 0.665207838639617, + 0.39648938924074173, + 0.19886824116110802, + 0.7277961056679487, + 0.17882956750690937, + 1.2601729314774275, + 0.23676512204110622, + 1.1245022919028997, + 0.19645976833999157, + 0.20406866259872913, + 0.09847728908061981, + 0.17035521008074284, + 0.2181453239172697, + 0.13035505078732967, + 2.003734242171049, + 1.030549669638276, + 1.1312312576919794, + 0.8909928351640701, + 0.5075017213821411, + 0.28691691160202026, + 1.071909599006176, + 0.22723443433642387, + 0.1603233553469181, + 0.1058447640389204, + 0.33141715079545975, + 1.3163039106875658, + 0.13113690540194511, + 0.5027616359293461, + 0.08261328190565109, + 0.07066255807876587, + 0.6591825503855944, + 1.0463153086602688, + 0.08920018747448921, + 0.2771165072917938, + 0.16973265632987022, + 1.4958904795348644, + 0.5886680036783218, + 0.3311465661972761, + 1.542982092127204, + 0.7004042435437441, + 0.5836094580590725, + 0.4826528951525688, + 0.2233818918466568, + 0.0644722431898117, + 0.18922699615359306, + 0.3592391423881054, + 0.3170829005539417, + 1.459697637706995, + 1.7336164563894272, + 0.05688553489744663, + 0.7749661467969418, + 1.2883004546165466, + 1.3176726624369621, + 0.18898789957165718, + 0.1606860626488924, + 0.6043721847236156, + 0.39407142624258995, + 0.11143439449369907, + 1.86540262773633, + 0.3804751802235842, + 0.6558024547994137, + 1.2416978757828474, + 0.7077678889036179, + 0.23572473227977753 + ], + "unique_experts": 64, + "load_cv": 0.7104134814205563, + "normalized_load_entropy": 0.9432266549078164, + "max_load_share": 0.055031446540880505 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "497052780f9297a676fb8b3b4f1539c36e57c62efe473ab48912057a129710bb", + "route_weight_sha256": "ce053da88a6de4e2d5d24e3a895c33b6acbba97976b355cce02340f52372d1d4", + "loads": [ + 17, + 23, + 9, + 16, + 5, + 18, + 13, + 16, + 6, + 6, + 11, + 8, + 8, + 4, + 25, + 27, + 19, + 17, + 12, + 4, + 19, + 7, + 4, + 9, + 7, + 16, + 4, + 10, + 2, + 4, + 13, + 14, + 5, + 9, + 7, + 18, + 6, + 10, + 26, + 5, + 20, + 12, + 5, + 3, + 9, + 14, + 12, + 21, + 25, + 2, + 23, + 21, + 17, + 3, + 15, + 12, + 12, + 5, + 35, + 11, + 13, + 14, + 16, + 7 + ], + "weighted_loads": [ + 0.7563148122280836, + 1.9339575851336122, + 0.42958954721689224, + 0.7640089262276888, + 0.17882956750690937, + 1.2601729314774275, + 0.8228230457752943, + 1.1245022919028997, + 0.19645976833999157, + 0.20406866259872913, + 1.0852965414524078, + 0.8377006966620684, + 0.5108866039663553, + 0.13035505078732967, + 2.003734242171049, + 1.030549669638276, + 1.1312312576919794, + 0.9896878749132156, + 0.5610965359956026, + 0.28691691160202026, + 1.071909599006176, + 0.22723443433642387, + 0.1603233553469181, + 0.3678533397614956, + 0.33141715079545975, + 1.3163039106875658, + 0.13113690540194511, + 0.5027616359293461, + 0.12371254339814186, + 0.1717273537069559, + 0.6591825503855944, + 1.234972182661295, + 0.26186853274703026, + 0.33605528622865677, + 0.2236509881913662, + 1.4958904795348644, + 0.5886680036783218, + 0.4174311887472868, + 2.2960554733872414, + 0.8553977329283953, + 0.9117488171905279, + 0.5236909873783588, + 0.2233818918466568, + 0.09715244174003601, + 0.6753040738403797, + 1.2309114895761013, + 0.45892851427197456, + 1.459697637706995, + 1.775636002421379, + 0.05688553489744663, + 1.3815774656832218, + 1.2883004546165466, + 1.7530740089714527, + 0.18898789957165718, + 0.6973874475806952, + 0.6043721847236156, + 0.4505072236061096, + 0.1747786607593298, + 1.86540262773633, + 0.3804751802235842, + 0.7092392407357693, + 1.2416978757828474, + 1.1918928269296885, + 0.23572473227977753 + ], + "unique_experts": 64, + "load_cv": 0.5844169428715534, + "normalized_load_entropy": 0.9591724422997527, + "max_load_share": 0.044529262086514 + } + }, + "s1_x": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "c2fb74a24c50d17d4373bc60e5c19514e9dd4e3c4ccff3b9b1311fc346a86a18", + "route_weight_sha256": "7b5d1592e38c2c73a74107fd9fcfb3d9e0c2acebf6e71e30610401e9280f678b", + "loads": [ + 12, + 5, + 6, + 16, + 5, + 18, + 4, + 18, + 5, + 8, + 3, + 2, + 5, + 2, + 23, + 30, + 19, + 14, + 10, + 4, + 20, + 10, + 5, + 3, + 5, + 15, + 5, + 10, + 1, + 1, + 13, + 12, + 3, + 8, + 7, + 18, + 5, + 8, + 13, + 4, + 12, + 11, + 4, + 2, + 3, + 5, + 9, + 20, + 21, + 3, + 14, + 21, + 12, + 3, + 4, + 11, + 13, + 4, + 36, + 9, + 12, + 15, + 9, + 8 + ], + "weighted_loads": [ + 0.5468298811465502, + 0.42666687071323395, + 0.20835017040371895, + 0.7529845144599676, + 0.20691503025591373, + 1.2485287878662348, + 0.24848182499408722, + 1.1965445932000875, + 0.17513225972652435, + 0.2592996172606945, + 0.14780277386307716, + 0.08659957721829414, + 0.22951075434684753, + 0.05459749139845371, + 1.9120386727154255, + 1.131468715146184, + 1.1223620064556599, + 0.89659608528018, + 0.47373083606362343, + 0.2724737524986267, + 1.1006025616079569, + 0.32623869366943836, + 0.19398433342576027, + 0.10399402678012848, + 0.23992085084319115, + 1.2550460752099752, + 0.1555379331111908, + 0.49452585726976395, + 0.08492665737867355, + 0.06605667620897293, + 0.6732405927032232, + 1.048170294612646, + 0.09254415147006512, + 0.27162064239382744, + 0.19763647206127644, + 1.4951079487800598, + 0.5411335062235594, + 0.29697092808783054, + 1.5316801443696022, + 0.6844159793108702, + 0.571483600884676, + 0.4778478555381298, + 0.17819883301854134, + 0.06024691089987755, + 0.16972539201378822, + 0.36676333099603653, + 0.30384767800569534, + 1.4326466005295515, + 1.5863294154405594, + 0.11880533210933208, + 0.8104133363813162, + 1.2690843790769577, + 1.3342062383890152, + 0.19000189006328583, + 0.1288770865648985, + 0.5475257281213999, + 0.4580631833523512, + 0.143528388813138, + 1.897234484553337, + 0.31788838095963, + 0.6608241535723209, + 1.2333015110343695, + 0.7085540033876896, + 0.2526266500353813 + ], + "unique_experts": 64, + "load_cv": 0.7181662939999242, + "normalized_load_entropy": 0.9422506214077511, + "max_load_share": 0.05660377358490566 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "0e5fe61addda92e29b054459cb11b859ec2de76fc57dff7c540faa76dbf14990", + "route_weight_sha256": "e87342a7b309c11c536ac765dedefb403cb133f760cf3648efc956b5f47a9cef", + "loads": [ + 14, + 30, + 14, + 17, + 5, + 19, + 13, + 18, + 7, + 9, + 25, + 5, + 12, + 2, + 23, + 30, + 19, + 23, + 11, + 5, + 23, + 17, + 5, + 12, + 5, + 15, + 6, + 10, + 2, + 3, + 14, + 16, + 9, + 8, + 9, + 18, + 6, + 14, + 24, + 7, + 19, + 11, + 5, + 3, + 13, + 19, + 10, + 20, + 21, + 4, + 28, + 21, + 21, + 9, + 18, + 12, + 15, + 7, + 36, + 10, + 15, + 16, + 14, + 11 + ], + "weighted_loads": [ + 0.7444881033152342, + 2.4466044092550874, + 0.599326066672802, + 0.8136292826384306, + 0.20691503025591373, + 1.2863300312310457, + 1.066735252737999, + 1.1965445932000875, + 0.29005538672208786, + 0.28784820064902306, + 2.184473689645529, + 0.8173093013465405, + 0.7327774297446012, + 0.05459749139845371, + 1.9120386727154255, + 1.131468715146184, + 1.1223620064556599, + 1.5903448201715946, + 0.5254785344004631, + 0.2961294185370207, + 1.3578450549393892, + 0.9691904447972775, + 0.19398433342576027, + 0.4544928576797247, + 0.23992085084319115, + 1.2550460752099752, + 0.1887381374835968, + 0.49452585726976395, + 0.13052131235599518, + 0.1357838176190853, + 0.7065608706325293, + 1.6236548908054829, + 0.39809259213507175, + 0.27162064239382744, + 0.30064977891743183, + 1.4951079487800598, + 0.5852709542959929, + 0.6012856811285019, + 2.4677335135638714, + 1.0139478016644716, + 0.8890525884926319, + 0.4778478555381298, + 0.2649477608501911, + 0.09052319079637527, + 0.9020858537405729, + 1.6778667643666267, + 0.3455291800200939, + 1.4326466005295515, + 1.5863294154405594, + 0.16792669333517551, + 1.6828926466405392, + 1.2690843790769577, + 1.9842950999736786, + 0.6632096543908119, + 1.0863502081483603, + 0.5738051887601614, + 0.5381075944751501, + 0.25199178978800774, + 1.897234484553337, + 0.40461152233183384, + 0.836517583578825, + 1.2763192038983107, + 1.1421572510153055, + 0.34824311919510365 + ], + "unique_experts": 64, + "load_cv": 0.546400573033655, + "normalized_load_entropy": 0.9633088117216038, + "max_load_share": 0.04081632653061224 + } + }, + "s0_period": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "73e7e4ed4951de9e7a181b4a274f0114354d6cc8944fa64912690399c55afb53", + "route_weight_sha256": "fad4b4d6668d56ced0caa188b71a9d44470e2e6bcc851a678c8e448834d6ec03", + "loads": [ + 14, + 4, + 7, + 15, + 4, + 19, + 4, + 17, + 7, + 5, + 2, + 4, + 5, + 4, + 26, + 29, + 19, + 14, + 10, + 4, + 20, + 7, + 4, + 3, + 5, + 17, + 5, + 10, + 1, + 1, + 11, + 12, + 2, + 7, + 8, + 19, + 6, + 7, + 13, + 3, + 12, + 11, + 5, + 2, + 3, + 5, + 10, + 20, + 25, + 3, + 13, + 22, + 11, + 4, + 5, + 12, + 12, + 2, + 36, + 10, + 12, + 13, + 8, + 6 + ], + "weighted_loads": [ + 0.6459181476384401, + 0.3960632011294365, + 0.23170511238276958, + 0.7353020384907722, + 0.1562290620058775, + 1.2949856016784906, + 0.23920108564198017, + 1.1752073168754578, + 0.23110807687044144, + 0.16782502457499504, + 0.10166901350021362, + 0.15059287287294865, + 0.22294392064213753, + 0.13051063939929008, + 2.064315762370825, + 1.0858480650931597, + 1.1379068307578564, + 0.8656519018113613, + 0.5001285057514906, + 0.28702230006456375, + 1.1097512654960155, + 0.22377723827958107, + 0.16506025567650795, + 0.10611659847199917, + 0.2551171276718378, + 1.3350646253675222, + 0.15800423361361027, + 0.5005288235843182, + 0.08063565939664841, + 0.06594303250312805, + 0.6039020083844662, + 1.0532891266047955, + 0.06079338304698467, + 0.24220292456448078, + 0.22280522622168064, + 1.5320020280778408, + 0.5885202791541815, + 0.27655185386538506, + 1.5019866861402988, + 0.685568243265152, + 0.5857470966875553, + 0.4882424399256706, + 0.22183184698224068, + 0.06623191758990288, + 0.19265278428792953, + 0.35374952107667923, + 0.3499069605022669, + 1.4664880111813545, + 1.781960166990757, + 0.10202826745808125, + 0.7854209169745445, + 1.3256281707435846, + 1.309733610600233, + 0.21712260879576206, + 0.16575643979012966, + 0.5940329246222973, + 0.42938656359910965, + 0.06871476210653782, + 1.9191363081336021, + 0.3489434029906988, + 0.6617733929306269, + 1.2138246465474367, + 0.6685469746589661, + 0.20458513870835304 + ], + "unique_experts": 64, + "load_cv": 0.7411516732604663, + "normalized_load_entropy": 0.9393003617233912, + "max_load_share": 0.05660377358490566 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "53858b65b1534bf488850c8ea34168fb6473d234820fd68410bda3bf1ef8bb77", + "route_weight_sha256": "5530b46925b996e3e12d1f0a710297f61ac404112c61503b760ffeef5e3c3daf", + "loads": [ + 16, + 23, + 11, + 16, + 4, + 19, + 11, + 17, + 7, + 5, + 12, + 7, + 8, + 4, + 26, + 30, + 19, + 17, + 11, + 4, + 20, + 7, + 4, + 9, + 5, + 17, + 5, + 10, + 2, + 5, + 11, + 13, + 4, + 8, + 10, + 19, + 6, + 8, + 24, + 4, + 19, + 12, + 5, + 3, + 9, + 15, + 13, + 20, + 25, + 3, + 23, + 22, + 17, + 4, + 15, + 12, + 13, + 4, + 36, + 10, + 14, + 13, + 14, + 7 + ], + "weighted_loads": [ + 0.7437361050397158, + 2.000434652902186, + 0.49014229886233807, + 0.7724280059337616, + 0.1562290620058775, + 1.2949856016784906, + 0.6991206537932158, + 1.1752073168754578, + 0.23110807687044144, + 0.16782502457499504, + 1.1806243769824505, + 0.8175656516104937, + 0.5199079029262066, + 0.13051063939929008, + 2.064315762370825, + 1.1289776619523764, + 1.1379068307578564, + 0.9643469415605068, + 0.5263729710131884, + 0.28702230006456375, + 1.1097512654960155, + 0.22377723827958107, + 0.16506025567650795, + 0.3673747777938843, + 0.2551171276718378, + 1.3350646253675222, + 0.15800423361361027, + 0.5005288235843182, + 0.12173492088913918, + 0.20884512178599834, + 0.6039020083844662, + 1.1502970047295094, + 0.20095142535865307, + 0.3011417035013437, + 0.3160408940166235, + 1.5320020280778408, + 0.5885202791541815, + 0.37527693435549736, + 2.127799665555358, + 0.8405617326498032, + 0.8677082639187574, + 0.5209800526499748, + 0.22183184698224068, + 0.09891211614012718, + 0.6552003808319569, + 1.3379994481801987, + 0.49480837397277355, + 1.4664880111813545, + 1.781960166990757, + 0.10202826745808125, + 1.3920322358608246, + 1.3256281707435846, + 1.6550410836935043, + 0.21712260879576206, + 0.6666952688246965, + 0.5940329246222973, + 0.4805291183292866, + 0.13309707306325436, + 1.9191363081336021, + 0.3489434029906988, + 0.7529693674296141, + 1.2138246465474367, + 1.1143816355615854, + 0.324483010917902 + ], + "unique_experts": 64, + "load_cv": 0.5994675492294005, + "normalized_load_entropy": 0.9577231277490728, + "max_load_share": 0.04580152671755725 + } + }, + "s1_period": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "dbcab87817cfd4e193fb144145f0edba729cf68ee16d30018fe4daef97341054", + "route_weight_sha256": "5874f53caee250d926de47a975ac95cf155511c71e0af99a2ac6cc4cab907b16", + "loads": [ + 13, + 4, + 6, + 17, + 5, + 19, + 4, + 18, + 6, + 6, + 3, + 3, + 5, + 3, + 24, + 27, + 18, + 14, + 10, + 4, + 19, + 10, + 5, + 3, + 4, + 16, + 4, + 10, + 1, + 1, + 13, + 12, + 2, + 6, + 7, + 18, + 6, + 9, + 13, + 4, + 12, + 11, + 4, + 2, + 3, + 5, + 9, + 20, + 21, + 3, + 14, + 22, + 12, + 3, + 4, + 12, + 14, + 3, + 35, + 10, + 14, + 15, + 9, + 7 + ], + "weighted_loads": [ + 0.5807405952364206, + 0.40473346412181854, + 0.21188032999634743, + 0.798517657443881, + 0.2019009068608284, + 1.2907374445348978, + 0.2293502502143383, + 1.1897201854735613, + 0.1987787000834942, + 0.20446376129984856, + 0.13697776198387146, + 0.11917748674750328, + 0.2226905282586813, + 0.08649584464728832, + 1.9538227077573538, + 1.0297914147377014, + 1.0954509172588587, + 0.8689365461468697, + 0.4880874790251255, + 0.2691948004066944, + 1.0875117033720016, + 0.3283873572945595, + 0.19776648841798306, + 0.10873541608452797, + 0.2059658970683813, + 1.2938683163374662, + 0.12911084294319153, + 0.49454550072550774, + 0.08222810178995132, + 0.0655551552772522, + 0.6726015228778124, + 1.0556284803897142, + 0.05987030640244484, + 0.20939451828598976, + 0.19909593276679516, + 1.4963150303810835, + 0.5819148067384958, + 0.34378881752491, + 1.520802117884159, + 0.6885877046734095, + 0.5741062797605991, + 0.4817945919930935, + 0.17537199705839157, + 0.06550301797688007, + 0.18092259019613266, + 0.3605104796588421, + 0.30287831276655197, + 1.458970570936799, + 1.5881629101932049, + 0.11942465044558048, + 0.8031772468239069, + 1.300303839147091, + 1.322106245905161, + 0.18993087857961655, + 0.12256025895476341, + 0.5908452235162258, + 0.48255089297890663, + 0.10053101554512978, + 1.8900361955165863, + 0.34427984803915024, + 0.7215638067573309, + 1.2533055245876312, + 0.7190268598496914, + 0.22571112774312496 + ], + "unique_experts": 64, + "load_cv": 0.7135247151188803, + "normalized_load_entropy": 0.9418553113258703, + "max_load_share": 0.055031446540880505 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "c8b308b63b5ff99777ade3fa64f83497057503ce64e9989e54b6f54d810db546", + "route_weight_sha256": "118a4223c482bc20ec686a0deb5948ad577ba266ab597c22a2995e9819fff5ce", + "loads": [ + 16, + 29, + 13, + 18, + 5, + 20, + 11, + 18, + 8, + 7, + 25, + 6, + 13, + 3, + 24, + 28, + 18, + 22, + 12, + 5, + 22, + 17, + 5, + 11, + 4, + 16, + 5, + 10, + 2, + 3, + 14, + 15, + 8, + 6, + 10, + 18, + 7, + 16, + 23, + 7, + 19, + 11, + 5, + 3, + 14, + 20, + 10, + 20, + 21, + 4, + 26, + 22, + 20, + 9, + 18, + 13, + 17, + 6, + 35, + 11, + 18, + 16, + 14, + 10 + ], + "weighted_loads": [ + 0.8500359933823347, + 2.482134790159762, + 0.5726078730076551, + 0.8645898010581732, + 0.2019009068608284, + 1.3285386878997087, + 0.842836894094944, + 1.1897201854735613, + 0.3137018270790577, + 0.2330123446881771, + 2.14645304530859, + 0.8394105695188046, + 0.7420188449323177, + 0.08649584464728832, + 1.9538227077573538, + 1.0784925483167171, + 1.0954509172588587, + 1.5145881175994873, + 0.5659156795591116, + 0.2928504664450884, + 1.344754196703434, + 0.9713391084223986, + 0.19776648841798306, + 0.4251060839742422, + 0.2059658970683813, + 1.2938683163374662, + 0.16231104731559753, + 0.49454550072550774, + 0.12782275676727295, + 0.13528229668736458, + 0.7087170388549566, + 1.522128539159894, + 0.36137042939662933, + 0.20939451828598976, + 0.34595960192382336, + 1.4963150303810835, + 0.6260522548109293, + 0.6696840282529593, + 2.378727860748768, + 1.018119527027011, + 0.8916752673685551, + 0.4817945919930935, + 0.26212092489004135, + 0.0957792978733778, + 0.9927818812429905, + 1.7178672663867474, + 0.34455981478095055, + 1.458970570936799, + 1.5881629101932049, + 0.1685460116714239, + 1.532934308052063, + 1.300303839147091, + 1.85361909866333, + 0.6631386429071426, + 1.0308178775012493, + 0.6171246841549873, + 0.6274223029613495, + 0.21517086401581764, + 1.8900361955165863, + 0.43100298941135406, + 0.9501028526574373, + 1.2963232174515724, + 1.1526301074773073, + 0.5116256400942802 + ], + "unique_experts": 64, + "load_cv": 0.5366777380646326, + "normalized_load_entropy": 0.9639130898179312, + "max_load_share": 0.03968253968253968 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 106, + "ordered_topk_exact_tokens": 64, + "set_exact_tokens": 77, + "mean_set_jaccard": 0.9218328840970351, + "mean_token_weighted_tv": 0.012898092351432116, + "aggregate_load_tv": 0.03301886792452831 + }, + "system_bos": { + "tokens": 106, + "ordered_topk_exact_tokens": 61, + "set_exact_tokens": 80, + "mean_set_jaccard": 0.9278975741239892, + "mean_token_weighted_tv": 0.014123074218349636, + "aggregate_load_tv": 0.033018867924528295 + }, + "system_x": { + "tokens": 106, + "ordered_topk_exact_tokens": 55, + "set_exact_tokens": 69, + "mean_set_jaccard": 0.8962264150943396, + "mean_token_weighted_tv": 0.018441750659203192, + "aggregate_load_tv": 0.04088050314465409 + }, + "system_period": { + "tokens": 106, + "ordered_topk_exact_tokens": 48, + "set_exact_tokens": 69, + "mean_set_jaccard": 0.8982479784366577, + "mean_token_weighted_tv": 0.018302421630272327, + "aggregate_load_tv": 0.04088050314465408 + }, + "bos_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 52, + "set_exact_tokens": 74, + "mean_set_jaccard": 0.9117250673854448, + "mean_token_weighted_tv": 0.015719673772043776, + "aggregate_load_tv": 0.0330188679245283 + }, + "bos_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 52, + "set_exact_tokens": 68, + "mean_set_jaccard": 0.8955525606469005, + "mean_token_weighted_tv": 0.017961821184968047, + "aggregate_load_tv": 0.04088050314465409 + }, + "x_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 46, + "set_exact_tokens": 69, + "mean_set_jaccard": 0.8962264150943396, + "mean_token_weighted_tv": 0.017638674032224237, + "aggregate_load_tv": 0.040880503144654086 + }, + "x_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 53, + "set_exact_tokens": 61, + "mean_set_jaccard": 0.8726415094339622, + "mean_token_weighted_tv": 0.02261350455008588, + "aggregate_load_tv": 0.04874213836477988 + }, + "period_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 55, + "set_exact_tokens": 74, + "mean_set_jaccard": 0.9117250673854448, + "mean_token_weighted_tv": 0.01557405902740528, + "aggregate_load_tv": 0.033018867924528295 + }, + "period_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 48, + "set_exact_tokens": 61, + "mean_set_jaccard": 0.8746630727762804, + "mean_token_weighted_tv": 0.021962457582495123, + "aggregate_load_tv": 0.05188679245283019 + } + } + }, + "layer_26": { + "layer": 26, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "c831d05f1f24b16b20908a2919d01b18c788680c44c236570af0d3dc71f7c1e8", + "route_weight_sha256": "3cf6450d685c339c83dfd1d8ee1531f048c0a9575f97259772f152dfda890c26", + "loads": [ + 11, + 16, + 20, + 8, + 12, + 4, + 20, + 9, + 10, + 4, + 5, + 10, + 16, + 3, + 8, + 6, + 18, + 12, + 1, + 23, + 15, + 15, + 0, + 17, + 5, + 9, + 4, + 3, + 4, + 2, + 1, + 6, + 17, + 7, + 2, + 20, + 4, + 16, + 7, + 7, + 10, + 29, + 4, + 8, + 20, + 18, + 5, + 3, + 0, + 9, + 22, + 9, + 6, + 13, + 4, + 10, + 6, + 12, + 13, + 16, + 19, + 3, + 7, + 13 + ], + "weighted_loads": [ + 0.479740584269166, + 1.5082298964262009, + 1.349743064492941, + 0.2891831211745739, + 0.7427148018032312, + 0.13823440857231617, + 1.5044791959226131, + 0.34451936185359955, + 0.6388064716011286, + 0.17538397945463657, + 0.23176641017198563, + 1.773566447198391, + 1.119084671139717, + 0.11036621779203415, + 0.5147912446409464, + 0.40499134361743927, + 1.1318585984408855, + 1.6555570736527443, + 0.026610033586621284, + 1.4941010102629662, + 1.2848215699195862, + 1.102228844538331, + 0.0, + 0.9866329319775105, + 0.3642242029309273, + 0.3268865831196308, + 0.1327069140970707, + 0.18903206288814545, + 0.17248175665736198, + 0.061020608991384506, + 0.029635678976774216, + 0.19968957640230656, + 1.0189665108919144, + 0.22734258510172367, + 0.2540273293852806, + 1.5272753797471523, + 0.25502828508615494, + 0.7967528365552425, + 0.41731337271630764, + 0.5208729933947325, + 0.4626585692167282, + 2.0498799607157707, + 0.2005219217389822, + 0.3654281236231327, + 0.7470385916531086, + 1.0627332720905542, + 0.16602735593914986, + 0.22204051911830902, + 0.0, + 0.5313917100429535, + 1.077088950201869, + 0.449122654274106, + 0.3839889355003834, + 0.472541281953454, + 0.16076788119971752, + 0.5440845880657434, + 0.7174146436154842, + 1.9526370726525784, + 0.6735916063189507, + 0.7250984497368336, + 1.0600226819515228, + 0.21276609227061272, + 0.33658574521541595, + 0.45517652854323387 + ], + "unique_experts": 62, + "load_cv": 0.6588782025080806, + "normalized_load_entropy": 0.9450426062056956, + "max_load_share": 0.04559748427672956 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "a3e18b6262cf1e7e1566b1148e58f13bd911d58272131196c9a234dd46a0dd90", + "route_weight_sha256": "d1c84c2ae899590597c26016cae618f37e721b4776495bd893ec6940e97d2d61", + "loads": [ + 11, + 16, + 20, + 9, + 12, + 4, + 20, + 11, + 10, + 9, + 9, + 15, + 16, + 4, + 23, + 8, + 18, + 24, + 1, + 23, + 15, + 16, + 1, + 17, + 11, + 9, + 9, + 11, + 4, + 2, + 7, + 6, + 21, + 9, + 6, + 20, + 9, + 16, + 7, + 7, + 10, + 29, + 5, + 11, + 20, + 18, + 9, + 3, + 1, + 10, + 30, + 9, + 12, + 13, + 5, + 10, + 21, + 21, + 19, + 18, + 20, + 3, + 8, + 15 + ], + "weighted_loads": [ + 0.479740584269166, + 1.5082298964262009, + 1.349743064492941, + 0.3167625106871128, + 0.7427148018032312, + 0.13823440857231617, + 1.5044791959226131, + 0.5233670882880688, + 0.6388064716011286, + 0.5015168879181147, + 0.5114191845059395, + 2.0775985929649323, + 1.119084671139717, + 0.17148148640990257, + 1.196084942203015, + 0.500833623111248, + 1.1318585984408855, + 2.3556266392115504, + 0.026610033586621284, + 1.4941010102629662, + 1.2848215699195862, + 1.1337528321892023, + 0.06081964820623398, + 0.9866329319775105, + 0.7425028309226036, + 0.3268865831196308, + 1.2040224596858025, + 0.5847859475761652, + 0.17248175665736198, + 0.061020608991384506, + 0.6729810237884521, + 0.19968957640230656, + 1.1997148096561432, + 0.3186733592301607, + 0.4684327244758606, + 1.5272753797471523, + 0.538628589361906, + 0.7967528365552425, + 0.41731337271630764, + 0.5208729933947325, + 0.4626585692167282, + 2.0498799607157707, + 0.2516107130795717, + 0.5151593126356602, + 0.7470385916531086, + 1.0627332720905542, + 0.39191926270723343, + 0.22204051911830902, + 0.03408527374267578, + 1.5177424252033234, + 1.4239347744733095, + 0.449122654274106, + 0.9328861348330975, + 0.472541281953454, + 0.20821847952902317, + 0.5440845880657434, + 1.8806597832590342, + 2.3784701405093074, + 0.9090094864368439, + 1.0494435541331768, + 1.0608334644930437, + 0.21276609227061272, + 0.3777763843536377, + 0.5364659950137138 + ], + "unique_experts": 64, + "load_cv": 0.55997568261477, + "normalized_load_entropy": 0.9599215223443702, + "max_load_share": 0.03816793893129771 + } + }, + "s1_eos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "a72748ada4b7feb32eeef5ff6a4377e57cbd062c3458f410bffd38d45536140b", + "route_weight_sha256": "8115a673dd775f902c8b3276418ce621be3d520379a7d1b638de9d0d1d026965", + "loads": [ + 11, + 16, + 19, + 4, + 12, + 4, + 20, + 8, + 10, + 4, + 5, + 10, + 16, + 4, + 8, + 6, + 18, + 13, + 1, + 23, + 17, + 15, + 0, + 18, + 5, + 10, + 5, + 4, + 4, + 3, + 1, + 5, + 15, + 7, + 2, + 20, + 4, + 18, + 7, + 6, + 10, + 28, + 3, + 8, + 19, + 17, + 7, + 3, + 0, + 9, + 22, + 8, + 6, + 13, + 6, + 10, + 6, + 12, + 13, + 16, + 19, + 3, + 6, + 14 + ], + "weighted_loads": [ + 0.4819102827459574, + 1.5064752325415611, + 1.319803822785616, + 0.16097857244312763, + 0.7358938883990049, + 0.13658119179308414, + 1.524788361042738, + 0.31523292511701584, + 0.6333760879933834, + 0.1816446054726839, + 0.23091904819011688, + 1.7576608881354332, + 1.1205503791570663, + 0.14593758061528206, + 0.5314925648272038, + 0.4049778878688812, + 1.1314187347888947, + 1.7036028951406479, + 0.0267045795917511, + 1.4771743305027485, + 1.331786209717393, + 1.1034516990184784, + 0.0, + 1.0135169997811317, + 0.3563128747045994, + 0.35994720458984375, + 0.17134349420666695, + 0.22679155692458153, + 0.1755433939397335, + 0.09850628115236759, + 0.029691021889448166, + 0.16799591481685638, + 0.9445500802248716, + 0.23353205434978008, + 0.26168612390756607, + 1.5289093106985092, + 0.25729426369071007, + 0.8524708840996027, + 0.4162141866981983, + 0.4861743338406086, + 0.46611639112234116, + 2.0179187823086977, + 0.17690075561404228, + 0.3640958406031132, + 0.7150228749960661, + 1.044445177540183, + 0.22456811740994453, + 0.22004706412553787, + 0.0, + 0.5340635981410742, + 1.0768350325524807, + 0.4183661974966526, + 0.38827747106552124, + 0.45953699573874474, + 0.22570950351655483, + 0.5447569880634546, + 0.7089903615415096, + 1.929471641778946, + 0.6604530699551105, + 0.7342790309339762, + 1.075533650815487, + 0.21095992624759674, + 0.30522114410996437, + 0.49005694687366486 + ], + "unique_experts": 62, + "load_cv": 0.6528471538373174, + "normalized_load_entropy": 0.9460332530770246, + "max_load_share": 0.0440251572327044 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "297464664ae60c27666c2532129a4896d616edf5ea2bf2f19df705dcefe65db0", + "route_weight_sha256": "a07995287e94ba5e934f9a5e83b63cc6ee16ff08b8855710f74111bb8f9eec30", + "loads": [ + 12, + 16, + 19, + 5, + 15, + 4, + 20, + 10, + 10, + 12, + 12, + 17, + 16, + 5, + 23, + 11, + 18, + 20, + 2, + 23, + 17, + 20, + 8, + 18, + 14, + 11, + 16, + 15, + 4, + 5, + 10, + 6, + 21, + 8, + 9, + 20, + 15, + 23, + 10, + 7, + 11, + 28, + 5, + 12, + 19, + 18, + 11, + 4, + 1, + 12, + 29, + 8, + 18, + 15, + 9, + 12, + 24, + 23, + 23, + 23, + 22, + 3, + 9, + 16 + ], + "weighted_loads": [ + 0.5337455477565527, + 1.5064752325415611, + 1.319803822785616, + 0.1900885161012411, + 0.9183060266077518, + 0.13658119179308414, + 1.524788361042738, + 0.5434515103697777, + 0.6333760879933834, + 0.6953145992010832, + 0.9352258667349815, + 2.3713858579285443, + 1.1205503791570663, + 0.19925513491034508, + 1.3311434862553142, + 0.7139896862208843, + 1.1314187347888947, + 2.2135839745169505, + 0.08047550171613693, + 1.4771743305027485, + 1.331786209717393, + 1.4269746858626604, + 0.5585163459181786, + 1.0135169997811317, + 0.8331279531121254, + 0.42917513847351074, + 1.7514065280556679, + 0.7271570693701506, + 0.1755433939397335, + 0.16750474832952023, + 0.9566166773438454, + 0.24699050188064575, + 1.21607562340796, + 0.3009189050644636, + 0.6234077736735344, + 1.5289093106985092, + 0.8656122982501984, + 1.1573655474931002, + 0.7056636735796928, + 0.5202229805290699, + 0.497212678194046, + 2.0179187823086977, + 0.2679719999432564, + 0.5658530741930008, + 0.7150228749960661, + 1.0622615683823824, + 0.5023189075291157, + 0.2621179334819317, + 0.03590665012598038, + 1.6725250240415335, + 1.3754781186580658, + 0.4183661974966526, + 1.3163383789360523, + 0.658258531242609, + 0.4372565131634474, + 0.6637913379818201, + 2.4726522155106068, + 2.733344360254705, + 1.223627395927906, + 1.2812099009752274, + 1.3146815891377628, + 0.21095992624759674, + 0.42776953615248203, + 0.5694541111588478 + ], + "unique_experts": 64, + "load_cv": 0.48768652182715244, + "normalized_load_entropy": 0.9687587683759085, + "max_load_share": 0.032879818594104306 + } + }, + "s0_bos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "77a0317f4396a5bb4ade56c97b7c37123c94adcf46f88a2e783c471501660ae1", + "route_weight_sha256": "1235d1e251019087f99228ed3645265c153b01d710080ed717de185b62a27f32", + "loads": [ + 12, + 16, + 20, + 8, + 11, + 3, + 19, + 9, + 10, + 4, + 5, + 10, + 16, + 3, + 7, + 6, + 18, + 13, + 2, + 24, + 16, + 14, + 0, + 18, + 7, + 11, + 1, + 3, + 4, + 3, + 1, + 6, + 16, + 6, + 2, + 19, + 4, + 17, + 6, + 7, + 10, + 29, + 4, + 7, + 20, + 17, + 5, + 3, + 0, + 9, + 19, + 9, + 7, + 14, + 6, + 10, + 6, + 12, + 13, + 16, + 18, + 3, + 8, + 14 + ], + "weighted_loads": [ + 0.5279681514948606, + 1.5255469158291817, + 1.36347097158432, + 0.2974664643406868, + 0.7114443778991699, + 0.10903644189238548, + 1.515306020155549, + 0.3397505581378937, + 0.6429640278220177, + 0.17088109627366066, + 0.22606809064745903, + 1.786585383117199, + 1.125030592083931, + 0.10548383742570877, + 0.513948529958725, + 0.3948436565697193, + 1.1452675070613623, + 1.6766546294093132, + 0.054674165323376656, + 1.5286282524466515, + 1.3748418726027012, + 1.073516771197319, + 0.0, + 1.0243093147873878, + 0.4246889799833298, + 0.3997635804116726, + 0.03454325348138809, + 0.1857534684240818, + 0.1735483966767788, + 0.09615306742489338, + 0.02977013774216175, + 0.2095835618674755, + 0.9938791617751122, + 0.1953483633697033, + 0.2600857689976692, + 1.4881493505090475, + 0.2602793201804161, + 0.8342114649713039, + 0.37630484998226166, + 0.5405185371637344, + 0.45699144154787064, + 2.0262613371014595, + 0.19974168948829174, + 0.35412525199353695, + 0.7476055845618248, + 1.0645079798996449, + 0.16136391833424568, + 0.2257395200431347, + 0.0, + 0.5344212651252747, + 0.9679395761340857, + 0.43501774221658707, + 0.4043585751205683, + 0.5000633094459772, + 0.22773824073374271, + 0.551075043156743, + 0.7428049854934216, + 1.9486833941191435, + 0.6820215359330177, + 0.7251054476946592, + 1.0323458164930344, + 0.20303670689463615, + 0.3683950174599886, + 0.4840301647782326 + ], + "unique_experts": 62, + "load_cv": 0.6506622915656327, + "normalized_load_entropy": 0.9457855397858967, + "max_load_share": 0.04559748427672956 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "578ece78e9ee2b4f5bb50c61ad5f62b733c732fc5b09872d3054a1cb939ee103", + "route_weight_sha256": "77c1ecfdd18d123df3047b8a1b401f84b89db9e48a6a7f8397b012a5f70e2ea5", + "loads": [ + 13, + 16, + 20, + 8, + 11, + 3, + 19, + 11, + 10, + 10, + 8, + 14, + 16, + 4, + 20, + 8, + 18, + 23, + 2, + 24, + 16, + 15, + 2, + 18, + 13, + 11, + 7, + 12, + 4, + 3, + 9, + 6, + 19, + 7, + 7, + 19, + 9, + 17, + 6, + 7, + 10, + 30, + 6, + 10, + 23, + 17, + 8, + 3, + 1, + 9, + 27, + 9, + 13, + 14, + 7, + 10, + 20, + 20, + 19, + 18, + 18, + 3, + 9, + 17 + ], + "weighted_loads": [ + 0.5534100867807865, + 1.5255469158291817, + 1.36347097158432, + 0.2974664643406868, + 0.7114443778991699, + 0.10903644189238548, + 1.515306020155549, + 0.509381365031004, + 0.6429640278220177, + 0.5299226753413677, + 0.43910642713308334, + 2.08856588229537, + 1.125030592083931, + 0.1665991060435772, + 1.1155479177832603, + 0.5079204589128494, + 1.1452675070613623, + 2.314515959471464, + 0.054674165323376656, + 1.5286282524466515, + 1.3748418726027012, + 1.1050407588481903, + 0.09426367655396461, + 1.0243093147873878, + 0.7957420237362385, + 0.3997635804116726, + 1.2731468193233013, + 0.66358064673841, + 0.1735483966767788, + 0.09615306742489338, + 0.8509388025850058, + 0.2095835618674755, + 1.1340410895645618, + 0.2594698779284954, + 0.5470558442175388, + 1.4881493505090475, + 0.5474671274423599, + 0.8342114649713039, + 0.37630484998226166, + 0.5405185371637344, + 0.45699144154787064, + 2.3687993064522743, + 0.2989647965878248, + 0.5038564410060644, + 0.8875746317207813, + 1.0645079798996449, + 0.344793189316988, + 0.2257395200431347, + 0.06665542721748352, + 0.5344212651252747, + 1.3147854004055262, + 0.43501774221658707, + 0.9586631711572409, + 0.5000633094459772, + 0.27518883906304836, + 0.551075043156743, + 1.87710384093225, + 2.3681266121566296, + 0.917439416050911, + 1.0571169313043356, + 1.0323458164930344, + 0.20303670689463615, + 0.40958565659821033, + 0.621362529695034 + ], + "unique_experts": 64, + "load_cv": 0.5392421260036299, + "normalized_load_entropy": 0.9630599797384434, + "max_load_share": 0.03816793893129771 + } + }, + "s1_bos": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "7c6e6cf4071b84a879ba0709511196f000f5a8095046281d7b335141c86a162a", + "route_weight_sha256": "2880e4eb1b9bd40dc0b16c591b9228521ac38081357ff6011a321ba4af19b5e6", + "loads": [ + 12, + 16, + 20, + 6, + 10, + 4, + 19, + 8, + 10, + 4, + 5, + 10, + 16, + 4, + 7, + 5, + 19, + 12, + 3, + 24, + 15, + 15, + 0, + 17, + 6, + 8, + 4, + 4, + 4, + 3, + 1, + 6, + 15, + 6, + 2, + 22, + 4, + 18, + 6, + 8, + 10, + 28, + 3, + 7, + 18, + 18, + 5, + 4, + 0, + 9, + 19, + 10, + 6, + 13, + 6, + 11, + 6, + 11, + 13, + 16, + 19, + 3, + 6, + 17 + ], + "weighted_loads": [ + 0.5274675227701664, + 1.5310625061392784, + 1.3640309795737267, + 0.23460494726896286, + 0.6729599181562662, + 0.14531949907541275, + 1.5119799990206957, + 0.3178637623786926, + 0.6364523824304342, + 0.1774015873670578, + 0.23154957592487335, + 1.7357748672366142, + 1.1352939046919346, + 0.13427896611392498, + 0.5367304515093565, + 0.37314803153276443, + 1.1632737964391708, + 1.5915684960782528, + 0.08050267770886421, + 1.5370874628424644, + 1.2889688685536385, + 1.111065337434411, + 0.0, + 0.9833178073167801, + 0.3850119896233082, + 0.3042520396411419, + 0.12859364226460457, + 0.2355344258248806, + 0.1734338477253914, + 0.1005296092480421, + 0.02950306236743927, + 0.20416168496012688, + 0.9513030722737312, + 0.19635113142430782, + 0.26386700570583344, + 1.5771376341581345, + 0.262422539293766, + 0.8724123407155275, + 0.37663447856903076, + 0.5547030754387379, + 0.4628184661269188, + 1.9867846835404634, + 0.17744800448417664, + 0.35675961524248123, + 0.6982975602149963, + 1.0620239283889532, + 0.15688891150057316, + 0.25518542900681496, + 0.0, + 0.5280121266841888, + 0.9594441745430231, + 0.47237137146294117, + 0.3896142803132534, + 0.4681352376937866, + 0.22790017165243626, + 0.5723940692842007, + 0.7034844011068344, + 1.8967019505798817, + 0.6686661168932915, + 0.7343258894979954, + 1.0694481544196606, + 0.20944752544164658, + 0.28670672699809074, + 0.5906722284853458 + ], + "unique_experts": 62, + "load_cv": 0.6496888831977606, + "normalized_load_entropy": 0.9473996426304011, + "max_load_share": 0.0440251572327044 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "0ddff945d423b4fcfab7cdac932266506cbfdf3226f3d222f5fb06b85446f163", + "route_weight_sha256": "77b3de0e694cec4f97341954275d769927ee86bc590cfc5cd81cbac9151ced85", + "loads": [ + 12, + 16, + 20, + 7, + 13, + 4, + 19, + 10, + 10, + 13, + 13, + 16, + 16, + 6, + 20, + 10, + 19, + 18, + 3, + 24, + 15, + 20, + 8, + 17, + 15, + 9, + 16, + 14, + 4, + 5, + 12, + 7, + 20, + 8, + 10, + 22, + 15, + 23, + 9, + 9, + 11, + 28, + 6, + 11, + 20, + 19, + 8, + 5, + 1, + 11, + 26, + 10, + 18, + 15, + 9, + 13, + 24, + 21, + 23, + 23, + 21, + 3, + 9, + 20 + ], + "weighted_loads": [ + 0.5274675227701664, + 1.5310625061392784, + 1.3640309795737267, + 0.2635314129292965, + 0.8553720563650131, + 0.14531949907541275, + 1.5119799990206957, + 0.5333080664277077, + 0.6364523824304342, + 0.7145063430070877, + 0.9878265932202339, + 2.3472147770226, + 1.1352939046919346, + 0.23793901316821575, + 1.2744749207049608, + 0.6920233145356178, + 1.1632737964391708, + 2.1052536368370056, + 0.08050267770886421, + 1.5370874628424644, + 1.2889688685536385, + 1.434588324278593, + 0.5469904877245426, + 0.9833178073167801, + 0.8708120323717594, + 0.3734799735248089, + 1.926756925880909, + 0.6957109104841948, + 0.1734338477253914, + 0.16952807642519474, + 1.1098981648683548, + 0.28315627202391624, + 1.178370002657175, + 0.31519688479602337, + 0.6922263819724321, + 1.5771376341581345, + 0.87432561814785, + 1.177307004109025, + 0.6660839654505253, + 0.5887517221271992, + 0.49391475319862366, + 1.9867846835404634, + 0.32352040708065033, + 0.5585168488323689, + 0.7857465669512749, + 1.0798403192311525, + 0.36955261416733265, + 0.29725629836320877, + 0.03590665012598038, + 0.6817999333143234, + 1.2580872606486082, + 0.47237137146294117, + 1.2884421907365322, + 0.6668567731976509, + 0.4394471812993288, + 0.6914284192025661, + 2.480710305273533, + 2.6964533124119043, + 1.231840442866087, + 1.2903236988931894, + 1.3076644353568554, + 0.20944752544164658, + 0.4092551190406084, + 0.7418869584798813 + ], + "unique_experts": 64, + "load_cv": 0.4664757900384385, + "normalized_load_entropy": 0.9716440164051968, + "max_load_share": 0.031746031746031744 + } + }, + "s0_x": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "32171c4ade6969b5fbcb618f7ad65775860a903e8551be2d8ae1dc1d14a73b77", + "route_weight_sha256": "adb80e9cae13d6b3359a04b0bdd7b618c167a9ad39f88b62d4fe3106fd4ade65", + "loads": [ + 12, + 16, + 20, + 7, + 13, + 4, + 19, + 6, + 10, + 4, + 5, + 10, + 16, + 3, + 7, + 5, + 19, + 13, + 1, + 24, + 14, + 15, + 0, + 18, + 7, + 9, + 3, + 4, + 4, + 3, + 1, + 5, + 16, + 7, + 2, + 20, + 4, + 15, + 7, + 7, + 10, + 28, + 4, + 8, + 19, + 18, + 5, + 4, + 0, + 9, + 23, + 7, + 7, + 12, + 5, + 11, + 7, + 11, + 13, + 16, + 19, + 3, + 8, + 14 + ], + "weighted_loads": [ + 0.5106476098299026, + 1.5014123395085335, + 1.3538270443677902, + 0.2700934838503599, + 0.7717699930071831, + 0.14633789286017418, + 1.4721654690802097, + 0.2406360860913992, + 0.6542886029928923, + 0.16275846026837826, + 0.21889743581414223, + 1.792762041091919, + 1.1111837290227413, + 0.10667981579899788, + 0.5086728129535913, + 0.3690335229039192, + 1.1719645969569683, + 1.6634489390999079, + 0.030250679701566696, + 1.5296695623546839, + 1.2549722082912922, + 1.0928695369511843, + 0.0, + 1.0219879299402237, + 0.43277070112526417, + 0.3337838836014271, + 0.09696873277425766, + 0.22940237075090408, + 0.17087441682815552, + 0.09603434056043625, + 0.02924298122525215, + 0.17321517132222652, + 0.9900941792875528, + 0.2238888144493103, + 0.2557661756873131, + 1.5345613583922386, + 0.27922485023736954, + 0.7564701996743679, + 0.4087411146610975, + 0.5240058712661266, + 0.45684032142162323, + 1.9944287184625864, + 0.19974693097174168, + 0.35635809041559696, + 0.7156249023973942, + 1.0773096568882465, + 0.16409138031303883, + 0.25466243363916874, + 0.0, + 0.5272845234721899, + 1.06844094209373, + 0.3597825262695551, + 0.42184486240148544, + 0.43112028762698174, + 0.19994580745697021, + 0.577371746301651, + 0.7606509141623974, + 1.9099437929689884, + 0.6918352097272873, + 0.7374792229384184, + 1.0654474198818207, + 0.19484752789139748, + 0.35583848133683205, + 0.48596190474927425 + ], + "unique_experts": 62, + "load_cv": 0.6547831333371835, + "normalized_load_entropy": 0.9460261795595943, + "max_load_share": 0.0440251572327044 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "499a590c8126521283bce16920ed57d8749b9f6fb4927ebe8bff0f3b17538b0a", + "route_weight_sha256": "444dcf73dd911661f649f4f845abf3a53b54eb905067434cd294cabaa9d115f6", + "loads": [ + 12, + 16, + 20, + 8, + 13, + 4, + 19, + 8, + 10, + 9, + 9, + 16, + 16, + 4, + 21, + 7, + 19, + 26, + 1, + 24, + 14, + 16, + 0, + 18, + 13, + 9, + 8, + 13, + 4, + 4, + 7, + 5, + 19, + 8, + 5, + 20, + 9, + 15, + 7, + 7, + 10, + 28, + 5, + 13, + 19, + 18, + 8, + 4, + 0, + 9, + 31, + 7, + 14, + 12, + 6, + 11, + 24, + 20, + 19, + 18, + 19, + 3, + 9, + 16 + ], + "weighted_loads": [ + 0.5106476098299026, + 1.5014123395085335, + 1.3538270443677902, + 0.29810331016778946, + 0.7717699930071831, + 0.14633789286017418, + 1.4721654690802097, + 0.39338315464556217, + 0.6542886029928923, + 0.4876248259097338, + 0.49238644912838936, + 2.2416577227413654, + 1.1111837290227413, + 0.1677950844168663, + 1.213170314207673, + 0.46322398260235786, + 1.1719645969569683, + 2.487619372084737, + 0.030250679701566696, + 1.5296695623546839, + 1.2549722082912922, + 1.1243935246020555, + 0.0, + 1.0219879299402237, + 0.803364833816886, + 0.3337838836014271, + 1.1723014079034328, + 0.6545847523957491, + 0.17087441682815552, + 0.1419028639793396, + 0.712133064866066, + 0.17321517132222652, + 1.1196280475705862, + 0.27250271290540695, + 0.43233857676386833, + 1.5345613583922386, + 0.5599017813801765, + 0.7564701996743679, + 0.4087411146610975, + 0.5240058712661266, + 0.45684032142162323, + 1.9944287184625864, + 0.25239323638379574, + 0.5998355653136969, + 0.7156249023973942, + 1.0773096568882465, + 0.330631161108613, + 0.25466243363916874, + 0.0, + 0.5272845234721899, + 1.4152867663651705, + 0.3597825262695551, + 0.9533791523426771, + 0.43112028762698174, + 0.24739640578627586, + 0.577371746301651, + 2.0815397892147303, + 2.447744119912386, + 0.9272530898451805, + 1.0688797887414694, + 1.0654474198818207, + 0.19484752789139748, + 0.3970291204750538, + 0.554735578596592 + ], + "unique_experts": 62, + "load_cv": 0.5696961788398796, + "normalized_load_entropy": 0.9575680200068875, + "max_load_share": 0.039440203562340966 + } + }, + "s1_x": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "f1742d11185e9a3be694d72c5d43aff10e66691d183ed2f1f7d84ed9dd666dfe", + "route_weight_sha256": "301448e8ea6ca498fe494469ce471a8d09c9dda474806c603c4feae130d3fe1d", + "loads": [ + 12, + 16, + 20, + 5, + 11, + 5, + 18, + 8, + 10, + 3, + 5, + 10, + 16, + 2, + 7, + 5, + 20, + 13, + 2, + 24, + 15, + 15, + 0, + 17, + 5, + 8, + 4, + 4, + 5, + 3, + 1, + 5, + 15, + 8, + 2, + 20, + 4, + 15, + 7, + 7, + 10, + 29, + 3, + 7, + 19, + 17, + 6, + 4, + 0, + 9, + 19, + 9, + 7, + 14, + 6, + 12, + 6, + 11, + 13, + 18, + 20, + 3, + 6, + 16 + ], + "weighted_loads": [ + 0.5133728366345167, + 1.4910531416535378, + 1.3516792841255665, + 0.2033153660595417, + 0.7048836424946785, + 0.1830504611134529, + 1.4609521478414536, + 0.2979496568441391, + 0.6227956060320139, + 0.12878281995654106, + 0.2180093675851822, + 1.7407819628715515, + 1.1165289171040058, + 0.06516769900918007, + 0.5207566227763891, + 0.36948058009147644, + 1.1820609904825687, + 1.6054254081100225, + 0.07762619853019714, + 1.5313090533018112, + 1.2063677944242954, + 1.0794604923576117, + 0.0, + 0.9850958585739136, + 0.3608067575842142, + 0.29019516706466675, + 0.139061126857996, + 0.2362101525068283, + 0.2050032578408718, + 0.10796578973531723, + 0.029613612219691277, + 0.17216214910149574, + 0.9271240476518869, + 0.2589473221451044, + 0.2582439035177231, + 1.5505438223481178, + 0.2853667214512825, + 0.7443127799779177, + 0.408973328769207, + 0.5032757967710495, + 0.4570839162915945, + 2.0043869856745005, + 0.1738663613796234, + 0.3438912872225046, + 0.7180443480610847, + 1.0290042385458946, + 0.1856369897723198, + 0.2471174020320177, + 0.0, + 0.5270405635237694, + 0.967726893723011, + 0.3998639341443777, + 0.4085369147360325, + 0.48501915484666824, + 0.2206596527248621, + 0.6042406428605318, + 0.6915155500173569, + 1.8626508712768555, + 0.6825937181711197, + 0.8036894965916872, + 1.086427941918373, + 0.19830293953418732, + 0.2769796624779701, + 0.5580156836658716 + ], + "unique_experts": 62, + "load_cv": 0.6545414490497818, + "normalized_load_entropy": 0.946129978902681, + "max_load_share": 0.04559748427672956 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "885715716fd2be7e1c788485d6febca289a7ef19b028c313321bd95b0bd621bc", + "route_weight_sha256": "42131d6dc3f086be395bababc90cd8ccca5ab9f5d61862b82586d5b8103de559", + "loads": [ + 12, + 16, + 20, + 5, + 14, + 8, + 18, + 10, + 10, + 11, + 13, + 18, + 16, + 3, + 22, + 10, + 20, + 20, + 2, + 24, + 15, + 20, + 6, + 17, + 14, + 9, + 15, + 15, + 5, + 6, + 10, + 6, + 21, + 8, + 8, + 20, + 15, + 20, + 10, + 8, + 11, + 29, + 5, + 11, + 19, + 18, + 9, + 5, + 1, + 11, + 26, + 9, + 18, + 16, + 9, + 14, + 26, + 23, + 24, + 26, + 22, + 3, + 9, + 18 + ], + "weighted_loads": [ + 0.5133728366345167, + 1.4910531416535378, + 1.3516792841255665, + 0.2033153660595417, + 0.8872957807034254, + 0.29467534460127354, + 1.4609521478414536, + 0.5070741474628448, + 0.6227956060320139, + 0.627096563577652, + 0.9989847540855408, + 2.5129768885672092, + 1.1165289171040058, + 0.11848525330424309, + 1.4111467991024256, + 0.6812089718878269, + 1.1820609904825687, + 2.1935088355094194, + 0.07762619853019714, + 1.5313090533018112, + 1.2063677944242954, + 1.4029834792017937, + 0.4537028521299362, + 0.9850958585739136, + 0.8243817966431379, + 0.35942310094833374, + 1.6689907386898994, + 0.7232673820108175, + 0.2050032578408718, + 0.24616122618317604, + 0.9677494559437037, + 0.2511567361652851, + 1.161850843578577, + 0.2589473221451044, + 0.5956027507781982, + 1.5505438223481178, + 0.8950702883303165, + 1.0492074433714151, + 0.6984228156507015, + 0.5373244434595108, + 0.48818020336329937, + 2.0043869856745005, + 0.2653568424284458, + 0.5456485208123922, + 0.7180443480610847, + 1.046820629388094, + 0.3856441155076027, + 0.2891882713884115, + 0.03590665012598038, + 0.680828370153904, + 1.2663699798285961, + 0.3998639341443777, + 1.251916728913784, + 0.6837406903505325, + 0.43220666237175465, + 0.7232749927788973, + 2.5975061990320683, + 2.819427166134119, + 1.308796714991331, + 1.4322122745215893, + 1.324644222855568, + 0.19830293953418732, + 0.3995280545204878, + 0.6320490650832653 + ], + "unique_experts": 64, + "load_cv": 0.49004255988769274, + "normalized_load_entropy": 0.9688119804347969, + "max_load_share": 0.032879818594104306 + } + }, + "s0_period": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "fdf1428db7957e2999b2b5bb972d13f6abc2d7422ca5af5f037d7f6de0098683", + "route_weight_sha256": "799c75f702fc8736e87ea044a6a8671d42b656e45dfd24fbae28740ecea869eb", + "loads": [ + 12, + 16, + 20, + 6, + 13, + 4, + 19, + 8, + 10, + 4, + 5, + 10, + 16, + 4, + 8, + 5, + 19, + 13, + 1, + 24, + 15, + 15, + 0, + 17, + 6, + 8, + 4, + 3, + 4, + 3, + 1, + 5, + 16, + 7, + 2, + 20, + 4, + 15, + 6, + 7, + 10, + 27, + 4, + 6, + 21, + 19, + 7, + 4, + 0, + 9, + 21, + 8, + 7, + 12, + 5, + 11, + 6, + 11, + 13, + 15, + 19, + 3, + 7, + 16 + ], + "weighted_loads": [ + 0.5130313690751791, + 1.514085065573454, + 1.3448288887739182, + 0.23202204331755638, + 0.7598170191049576, + 0.14821133390069008, + 1.4695489257574081, + 0.3000440988689661, + 0.6500114779919386, + 0.16786707378923893, + 0.22329680994153023, + 1.785293124616146, + 1.1243238300085068, + 0.13089283555746078, + 0.5451439991593361, + 0.3642760179936886, + 1.1768270321190357, + 1.670063829049468, + 0.02855641581118107, + 1.5234605763107538, + 1.2870285511016846, + 1.1066278889775276, + 0.0, + 0.9816032946109772, + 0.3995716404169798, + 0.290755920112133, + 0.12797950394451618, + 0.1754678525030613, + 0.17116903886198997, + 0.09639121405780315, + 0.029838044196367264, + 0.17708944343030453, + 0.9724760111421347, + 0.22447971068322659, + 0.2560677081346512, + 1.5209996439516544, + 0.2686384655535221, + 0.7749410513788462, + 0.37970733642578125, + 0.5355254095047712, + 0.47105327993631363, + 1.9762270133942366, + 0.199605418369174, + 0.30817529559135437, + 0.7905459273606539, + 1.122211493551731, + 0.22198533080518246, + 0.2555703166872263, + 0.0, + 0.5243311375379562, + 1.03703298792243, + 0.3942954447120428, + 0.41254627890884876, + 0.4314813707023859, + 0.19057950749993324, + 0.5809796452522278, + 0.7313492149114609, + 1.91583751142025, + 0.6724474057555199, + 0.7134639285504818, + 1.0534394718706608, + 0.20030396059155464, + 0.32167930342257023, + 0.5494107585400343 + ], + "unique_experts": 62, + "load_cv": 0.6516342458619923, + "normalized_load_entropy": 0.946361323946836, + "max_load_share": 0.04245283018867924 + }, + "full_input": { + "tokens": 131, + "top_k": 6, + "decisions": 786, + "ordered_route_sha256": "e749f50dce72afa52086e1515552cbfe33f820d76be1e8b4bd62da51fc9b7360", + "route_weight_sha256": "ad8b82ad66a33c5deb6b7be372408553a7bed52f858edd135a4717a03c075fee", + "loads": [ + 12, + 16, + 20, + 6, + 13, + 4, + 19, + 10, + 10, + 9, + 9, + 14, + 16, + 5, + 22, + 6, + 19, + 25, + 1, + 24, + 15, + 16, + 0, + 17, + 13, + 8, + 9, + 11, + 4, + 3, + 9, + 5, + 20, + 8, + 6, + 20, + 10, + 15, + 6, + 7, + 10, + 27, + 5, + 9, + 22, + 19, + 11, + 4, + 1, + 9, + 29, + 8, + 15, + 12, + 6, + 11, + 22, + 19, + 19, + 17, + 19, + 3, + 8, + 19 + ], + "weighted_loads": [ + 0.5130313690751791, + 1.514085065573454, + 1.3448288887739182, + 0.23202204331755638, + 0.7598170191049576, + 0.14821133390069008, + 1.4695489257574081, + 0.4721403028815985, + 0.6500114779919386, + 0.5022705439478159, + 0.5131158791482449, + 2.0872736237943172, + 1.1243238300085068, + 0.1920081041753292, + 1.188514657318592, + 0.4212239980697632, + 1.1768270321190357, + 2.4393654409796, + 0.02855641581118107, + 1.5234605763107538, + 1.2870285511016846, + 1.138151876628399, + 0.0, + 0.9816032946109772, + 0.8695021998137236, + 0.290755920112133, + 1.1767365839332342, + 0.5641597267240286, + 0.17116903886198997, + 0.09639121405780315, + 0.7806251123547554, + 0.17708944343030453, + 1.1507091987878084, + 0.2769687157124281, + 0.45947270654141903, + 1.5209996439516544, + 0.6097592636942863, + 0.7749410513788462, + 0.37970733642578125, + 0.5355254095047712, + 0.47105327993631363, + 1.9762270133942366, + 0.2523301262408495, + 0.45790648460388184, + 0.8293402995914221, + 1.122211493551731, + 0.4245165940374136, + 0.2555703166872263, + 0.03775276243686676, + 0.5243311375379562, + 1.3838788121938705, + 0.3942954447120428, + 1.049412401393056, + 0.4314813707023859, + 0.2380301058292389, + 0.5809796452522278, + 2.0677280593663454, + 2.336178082972765, + 0.9078652858734131, + 1.049470443278551, + 1.0534394718706608, + 0.20030396059155464, + 0.36286994256079197, + 0.6989555228501558 + ], + "unique_experts": 63, + "load_cv": 0.5590499301970974, + "normalized_load_entropy": 0.9592766896926236, + "max_load_share": 0.03689567430025445 + } + }, + "s1_period": { + "target_content": { + "tokens": 106, + "top_k": 6, + "decisions": 636, + "ordered_route_sha256": "a42a0151948191f0b302f6e7e3167b79b79bc3f7816c27c686ae6be0c63c0e9c", + "route_weight_sha256": "8aad7143fbe8de23befb4469dbedd3aea9933ab6b2bbe0a0ff174c757a82fab8", + "loads": [ + 12, + 16, + 20, + 5, + 10, + 5, + 19, + 8, + 10, + 4, + 5, + 10, + 16, + 1, + 7, + 6, + 20, + 13, + 2, + 25, + 14, + 15, + 0, + 18, + 6, + 8, + 4, + 4, + 5, + 3, + 1, + 5, + 15, + 7, + 3, + 21, + 4, + 15, + 7, + 7, + 10, + 27, + 3, + 7, + 17, + 17, + 7, + 4, + 0, + 9, + 20, + 11, + 6, + 15, + 4, + 12, + 6, + 11, + 13, + 18, + 19, + 2, + 6, + 16 + ], + "weighted_loads": [ + 0.5170557610690594, + 1.4920555353164673, + 1.3480890579521656, + 0.19640374556183815, + 0.6691770292818546, + 0.18333592638373375, + 1.4883595816791058, + 0.3100172821432352, + 0.6229286268353462, + 0.16640877351164818, + 0.22413216158747673, + 1.7578206211328506, + 1.1115899309515953, + 0.029842577874660492, + 0.5340028367936611, + 0.40140653401613235, + 1.1734420638531446, + 1.5851058848202229, + 0.07318379543721676, + 1.5697488114237785, + 1.1827045790851116, + 1.0987764578312635, + 0.0, + 1.0198205597698689, + 0.3884071558713913, + 0.2910585217177868, + 0.13495256006717682, + 0.2266555316746235, + 0.20646820589900017, + 0.10665654949843884, + 0.03019852377474308, + 0.17569918744266033, + 0.9225399997085333, + 0.22961776331067085, + 0.28325225971639156, + 1.560911476612091, + 0.2930760681629181, + 0.7599197998642921, + 0.41175349801778793, + 0.518336359411478, + 0.4648139700293541, + 1.941346200183034, + 0.17499282956123352, + 0.33823018334805965, + 0.66654422134161, + 1.039718957617879, + 0.2183024976402521, + 0.24786840938031673, + 0.0, + 0.5214446932077408, + 0.9929728377610445, + 0.46145731769502163, + 0.3759296275675297, + 0.5128969587385654, + 0.1674174703657627, + 0.6113984193652868, + 0.6514672301709652, + 1.8896561302244663, + 0.6961633265018463, + 0.8077063467353582, + 1.059421095997095, + 0.1668468341231346, + 0.2790660262107849, + 0.5664482526481152 + ], + "unique_experts": 62, + "load_cv": 0.6530894651210948, + "normalized_load_entropy": 0.9458063496178364, + "max_load_share": 0.04245283018867924 + }, + "full_input": { + "tokens": 147, + "top_k": 6, + "decisions": 882, + "ordered_route_sha256": "4807f3371458c04c7725fbc93855d4ea49f518d5ea5ed577269602ded834ac32", + "route_weight_sha256": "a9575db07fef3046cb133367372a49db7cb3793a008cc32232455aa36b625985", + "loads": [ + 12, + 16, + 20, + 6, + 13, + 7, + 19, + 10, + 10, + 12, + 13, + 16, + 16, + 2, + 21, + 11, + 20, + 20, + 2, + 25, + 14, + 20, + 6, + 18, + 16, + 9, + 15, + 15, + 5, + 5, + 10, + 6, + 21, + 8, + 9, + 21, + 16, + 20, + 10, + 8, + 11, + 27, + 6, + 11, + 17, + 18, + 11, + 5, + 1, + 11, + 27, + 11, + 18, + 17, + 8, + 14, + 26, + 21, + 23, + 25, + 21, + 2, + 9, + 19 + ], + "weighted_loads": [ + 0.5170557610690594, + 1.4920555353164673, + 1.3480890579521656, + 0.22421949915587902, + 0.8515891674906015, + 0.26402347162365913, + 1.4883595816791058, + 0.5206750575453043, + 0.6229286268353462, + 0.6589713227003813, + 1.0236766636371613, + 2.3692605309188366, + 1.1115899309515953, + 0.08316013216972351, + 1.366570807993412, + 0.701592642813921, + 1.1734420638531446, + 2.210127364844084, + 0.07318379543721676, + 1.5697488114237785, + 1.1827045790851116, + 1.4222994446754456, + 0.4537028521299362, + 1.0198205597698689, + 0.9329562447965145, + 0.3602864556014538, + 1.6188406832516193, + 0.703720323741436, + 0.20646820589900017, + 0.17565501667559147, + 0.9555596690624952, + 0.2546937745064497, + 1.158444257453084, + 0.2601539511233568, + 0.61780827306211, + 1.560911476612091, + 0.9606896601617336, + 1.0648144632577896, + 0.7012029848992825, + 0.5523850060999393, + 0.49591025710105896, + 1.941346200183034, + 0.2964498847723007, + 0.5399874169379473, + 0.66654422134161, + 1.0575353484600782, + 0.4637150224298239, + 0.28993927873671055, + 0.03590665012598038, + 0.6752324998378754, + 1.2916159238666296, + 0.46145731769502163, + 1.2685269564390182, + 0.7116184942424297, + 0.4203440509736538, + 0.7304327692836523, + 2.651363827288151, + 2.6889664456248283, + 1.2593376524746418, + 1.3988388888537884, + 1.29763737693429, + 0.1668468341231346, + 0.4016144182533026, + 0.7178268432617188 + ], + "unique_experts": 64, + "load_cv": 0.4820874477086488, + "normalized_load_entropy": 0.9691062907235576, + "max_load_share": 0.030612244897959183 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 106, + "ordered_topk_exact_tokens": 70, + "set_exact_tokens": 84, + "mean_set_jaccard": 0.9386792452830188, + "mean_token_weighted_tv": 0.01147618877508168, + "aggregate_load_tv": 0.02515723270440251 + }, + "system_bos": { + "tokens": 106, + "ordered_topk_exact_tokens": 69, + "set_exact_tokens": 78, + "mean_set_jaccard": 0.9245283018867925, + "mean_token_weighted_tv": 0.014444219844661793, + "aggregate_load_tv": 0.03459119496855346 + }, + "system_x": { + "tokens": 106, + "ordered_topk_exact_tokens": 60, + "set_exact_tokens": 71, + "mean_set_jaccard": 0.9016172506738545, + "mean_token_weighted_tv": 0.01882131519850414, + "aggregate_load_tv": 0.034591194968553465 + }, + "system_period": { + "tokens": 106, + "ordered_topk_exact_tokens": 57, + "set_exact_tokens": 69, + "mean_set_jaccard": 0.8921832884097036, + "mean_token_weighted_tv": 0.01998034960432154, + "aggregate_load_tv": 0.03459119496855346 + }, + "bos_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 69, + "set_exact_tokens": 81, + "mean_set_jaccard": 0.9305929919137466, + "mean_token_weighted_tv": 0.014126793885568404, + "aggregate_load_tv": 0.028301886792452827 + }, + "bos_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 59, + "set_exact_tokens": 74, + "mean_set_jaccard": 0.9097035040431267, + "mean_token_weighted_tv": 0.01670690884216214, + "aggregate_load_tv": 0.03459119496855345 + }, + "x_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 59, + "set_exact_tokens": 73, + "mean_set_jaccard": 0.9090296495956873, + "mean_token_weighted_tv": 0.016971581009269324, + "aggregate_load_tv": 0.02830188679245283 + }, + "x_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 55, + "set_exact_tokens": 71, + "mean_set_jaccard": 0.8975741239892183, + "mean_token_weighted_tv": 0.020308282718343555, + "aggregate_load_tv": 0.03616352201257861 + }, + "period_at_s0": { + "tokens": 106, + "ordered_topk_exact_tokens": 59, + "set_exact_tokens": 72, + "mean_set_jaccard": 0.9063342318059299, + "mean_token_weighted_tv": 0.016515497030374013, + "aggregate_load_tv": 0.029874213836477984 + }, + "period_at_s1": { + "tokens": 106, + "ordered_topk_exact_tokens": 55, + "set_exact_tokens": 65, + "mean_set_jaccard": 0.881401617250674, + "mean_token_weighted_tv": 0.021661920481765608, + "aggregate_load_tv": 0.040880503144654086 + } + } + } + } + }, + { + "id": "gsm8k/test/1228", + "domain": "math", + "label": "Grade-school math", + "within_domain_index": 1, + "selection_rank": "002201d4cbc0b85d338597dcb68c3ffd4d00ef12b7b44e352c5bc1911d6fa984", + "source_text_sha256": "3931b6363f3a060ca7cb0774662127e64007e9f34ce209edddca77425e20a479", + "source_characters": 152, + "source_tokens": 36, + "content_token_ids_sha256": "293a0ffdedad6508bd41e76e8d3cc23a311524a092c6425d28126c76b50b50f6", + "prompt_tokens_by_condition": { + "s0_eos": 59, + "s1_eos": 75, + "s0_bos": 59, + "s1_bos": 75, + "s0_x": 59, + "s1_x": 75, + "s0_period": 59, + "s1_period": 75 + }, + "batch_prompt_tokens": 75, + "content_tokens": 34, + "boundary_crossing_tokens_by_condition": { + "s0_eos": 1, + "s1_eos": 1, + "s0_bos": 1, + "s1_bos": 1, + "s0_x": 1, + "s1_x": 1, + "s0_period": 1, + "s1_period": 1 + }, + "forward_seconds": 0.6444225989980623, + "peak_cuda_memory_allocated_bytes": 27603516416, + "hidden_stages": { + "embedding": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "85a4855ce1d42ef117f5f4a1f3b76c380d52cc4d74db7f657cba5deec857f7d6", + "mean": -0.0006341966800391674, + "std": 0.09833911806344986, + "rms": 0.09834116697311401, + "max_abs": 1.7109375 + }, + "full_input": { + "shape": [ + 59, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "718bf6dfbb84a514c8af0de44ead9e0d3c612732a5801e4e71a9a1887c23b7f9", + "mean": -0.0007045405800454319, + "std": 0.09487203508615494, + "rms": 0.09487465023994446, + "max_abs": 2.046875 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "85a4855ce1d42ef117f5f4a1f3b76c380d52cc4d74db7f657cba5deec857f7d6", + "mean": -0.0006341966800391674, + "std": 0.09833911806344986, + "rms": 0.09834116697311401, + "max_abs": 1.7109375 + }, + "full_input": { + "shape": [ + 75, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4d5b97fb38ebc208c23bcfb5355f7ef831d7649ee6f04e5f8c501a455508728b", + "mean": -0.0010229481849819422, + "std": 0.09706692397594452, + "rms": 0.09707231819629669, + "max_abs": 2.046875 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "85a4855ce1d42ef117f5f4a1f3b76c380d52cc4d74db7f657cba5deec857f7d6", + "mean": -0.0006341966800391674, + "std": 0.09833911806344986, + "rms": 0.09834116697311401, + "max_abs": 1.7109375 + }, + "full_input": { + "shape": [ + 59, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2a25c277143dfd6e14832cd7a58ff9216eeb03b100570e75d93edddd22a91bd4", + "mean": -0.0006785542936995625, + "std": 0.09453756362199783, + "rms": 0.09453999996185303, + "max_abs": 2.046875 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "85a4855ce1d42ef117f5f4a1f3b76c380d52cc4d74db7f657cba5deec857f7d6", + "mean": -0.0006341966800391674, + "std": 0.09833911806344986, + "rms": 0.09834116697311401, + "max_abs": 1.7109375 + }, + "full_input": { + "shape": [ + 75, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6d0938a801d832afab87ca8c89ab8cf821d00ab2a6d806e5fb649d96a42bd49f", + "mean": -0.0010025056544691324, + "std": 0.09680993109941483, + "rms": 0.09681512415409088, + "max_abs": 2.046875 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "85a4855ce1d42ef117f5f4a1f3b76c380d52cc4d74db7f657cba5deec857f7d6", + "mean": -0.0006341966800391674, + "std": 0.09833911806344986, + "rms": 0.09834116697311401, + "max_abs": 1.7109375 + }, + "full_input": { + "shape": [ + 59, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "670f414ac46b1b85587a58ddee5c29989a05c6ec00a21a735e269cc4442822fc", + "mean": -0.000742324918974191, + "std": 0.0947631374001503, + "rms": 0.0947660505771637, + "max_abs": 2.046875 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "85a4855ce1d42ef117f5f4a1f3b76c380d52cc4d74db7f657cba5deec857f7d6", + "mean": -0.0006341966800391674, + "std": 0.09833911806344986, + "rms": 0.09834116697311401, + "max_abs": 1.7109375 + }, + "full_input": { + "shape": [ + 75, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9fc21f18fc3e873bfceb2ca8252152b5f7de25dc87916f2506d8acad3ecbd186", + "mean": -0.0010526719270274043, + "std": 0.09698310494422913, + "rms": 0.09698881953954697, + "max_abs": 2.046875 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "85a4855ce1d42ef117f5f4a1f3b76c380d52cc4d74db7f657cba5deec857f7d6", + "mean": -0.0006341966800391674, + "std": 0.09833911806344986, + "rms": 0.09834116697311401, + "max_abs": 1.7109375 + }, + "full_input": { + "shape": [ + 59, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3b124f2c024409d3cd65da9388e625e3184295971f2c7142a0877d8c42fee0d0", + "mean": -0.0007437000167556107, + "std": 0.094506174325943, + "rms": 0.09450910240411758, + "max_abs": 2.046875 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "85a4855ce1d42ef117f5f4a1f3b76c380d52cc4d74db7f657cba5deec857f7d6", + "mean": -0.0006341966800391674, + "std": 0.09833911806344986, + "rms": 0.09834116697311401, + "max_abs": 1.7109375 + }, + "full_input": { + "shape": [ + 75, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "55e9de28ae8fc5f9fa13b001922731c682488d599844ca0dc74eb4f81b83b933", + "mean": -0.0010537536581978202, + "std": 0.09678565710783005, + "rms": 0.09679139405488968, + "max_abs": 2.046875 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 34, + "exact_hidden_rows": 34, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999999403953552, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "system_bos": { + "tokens": 34, + "exact_hidden_rows": 34, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999999403953552, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "system_x": { + "tokens": 34, + "exact_hidden_rows": 34, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999999403953552, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "system_period": { + "tokens": 34, + "exact_hidden_rows": 34, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999999403953552, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "bos_at_s0": { + "tokens": 34, + "exact_hidden_rows": 34, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999999403953552, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "bos_at_s1": { + "tokens": 34, + "exact_hidden_rows": 34, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999999403953552, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "x_at_s0": { + "tokens": 34, + "exact_hidden_rows": 34, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999999403953552, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "x_at_s1": { + "tokens": 34, + "exact_hidden_rows": 34, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999999403953552, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "period_at_s0": { + "tokens": 34, + "exact_hidden_rows": 34, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999999403953552, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "period_at_s1": { + "tokens": 34, + "exact_hidden_rows": 34, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999999403953552, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + } + } + }, + "layer_00": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "201fc48dc113402325ee71503bbd416cb03a15b95b6631f91bd95d6acbe06538", + "mean": -0.0012226338731124997, + "std": 0.09475334733724594, + "rms": 0.09476123005151749, + "max_abs": 2.34375 + }, + "full_input": { + "shape": [ + 59, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f55ffb694630d34eaf1e1574287b76489f4761f1a6e277e016f61d9fccfe306c", + "mean": -0.0012957537546753883, + "std": 0.09430306404829025, + "rms": 0.09431196004152298, + "max_abs": 2.4375 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d4b3c4e5f4666b4741e95819a718fbc5bc5ec30df4ca4fcdba24c519d6715106", + "mean": -0.0012284750118851662, + "std": 0.09471648186445236, + "rms": 0.09472444653511047, + "max_abs": 2.34375 + }, + "full_input": { + "shape": [ + 75, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d8a6b30b70556eadd30e1f9819ab87eb6bc7989850e75e4b6acf26b97fba20b1", + "mean": -0.0015166786033660173, + "std": 0.0950750932097435, + "rms": 0.09508718550205231, + "max_abs": 2.4375 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "749aa83cbb95e58ba4bcafeb3a13012dd5a334faf6452ce3a3c1eda313471a4d", + "mean": -0.0012480458244681358, + "std": 0.09354046732187271, + "rms": 0.09354878962039948, + "max_abs": 2.265625 + }, + "full_input": { + "shape": [ + 59, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0b265cb2cc697cd916f461a067581508bd8f5a4794cfff07b89c88f29abd8ca3", + "mean": -0.0012857795227319002, + "std": 0.09293319284915924, + "rms": 0.09294208139181137, + "max_abs": 2.4375 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "56c3dec22ddadb2c24659372fc7d9fed66941238dbd1853121e4340c08268657", + "mean": -0.0012474614195525646, + "std": 0.09330177307128906, + "rms": 0.09331011027097702, + "max_abs": 2.28125 + }, + "full_input": { + "shape": [ + 75, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "282c8cb9b994b95f065f73879142d8b7719669ab7491a8151aced5308e92f8e9", + "mean": -0.001504526473581791, + "std": 0.09395555406808853, + "rms": 0.09396760165691376, + "max_abs": 2.4375 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f8edda743d96173af2e63d2ef93056923157a21177fd4887e2cc05d50e4d9514", + "mean": -0.0012501011369749904, + "std": 0.09318193048238754, + "rms": 0.09319031238555908, + "max_abs": 2.25 + }, + "full_input": { + "shape": [ + 59, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d3e315d9346684dc25634d3a5220c3bd188ee639432d89c9f670c19350fa96bb", + "mean": -0.0013249218463897705, + "std": 0.09294356405735016, + "rms": 0.09295300394296646, + "max_abs": 2.4375 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c5098435aa062f761205a09a3c681053d8bc72081116757f8667f87b026dd204", + "mean": -0.0012546504149213433, + "std": 0.09308482706546783, + "rms": 0.09309328347444534, + "max_abs": 2.265625 + }, + "full_input": { + "shape": [ + 75, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3713e2511c20ea0b8e6f9e7b1db2bf1d16e07dc58da584c223f605ffcaf22e7c", + "mean": -0.0015435629757121205, + "std": 0.09406017512083054, + "rms": 0.0940728411078453, + "max_abs": 2.4375 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "393d1061b36eca4f8aa8e108ef2bcb7618b54212f5e07f890f98b4fdb77c41f1", + "mean": -0.0012413010699674487, + "std": 0.09316804260015488, + "rms": 0.09317632019519806, + "max_abs": 2.265625 + }, + "full_input": { + "shape": [ + 59, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d5793e4182d568b8ca760f51a22ac5ccbe5bb87deee6ef7cbe2eb9bffe547aea", + "mean": -0.001319065340794623, + "std": 0.09256505221128464, + "rms": 0.09257444739341736, + "max_abs": 2.4375 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f61a1a01944e0f85387785aba36bf5e5590d5e4cb16a845b12edc682bb225eb9", + "mean": -0.0012530977837741375, + "std": 0.09309247881174088, + "rms": 0.093100905418396, + "max_abs": 2.265625 + }, + "full_input": { + "shape": [ + 75, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5ddb1028365cce16657b9aa650ae9004fc992e318971a83bad4d93117d5907f7", + "mean": -0.001538329292088747, + "std": 0.09374060481786728, + "rms": 0.09375322610139847, + "max_abs": 2.4375 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9993159174919128, + "min_cosine_similarity": 0.9934075474739075, + "mean_relative_l2": 0.03109721839427948, + "max_abs_delta": 0.0859375 + }, + "system_bos": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9989205598831177, + "min_cosine_similarity": 0.9878026247024536, + "mean_relative_l2": 0.03935915604233742, + "max_abs_delta": 0.1484375 + }, + "system_x": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9990308284759521, + "min_cosine_similarity": 0.9910357594490051, + "mean_relative_l2": 0.038472436368465424, + "max_abs_delta": 0.09375 + }, + "system_period": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9990952610969543, + "min_cosine_similarity": 0.991447925567627, + "mean_relative_l2": 0.03709244728088379, + "max_abs_delta": 0.09375 + }, + "bos_at_s0": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9845542907714844, + "min_cosine_similarity": 0.9580883979797363, + "mean_relative_l2": 0.17070773243904114, + "max_abs_delta": 0.2158203125 + }, + "bos_at_s1": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9870592951774597, + "min_cosine_similarity": 0.9688511490821838, + "mean_relative_l2": 0.15700261294841766, + "max_abs_delta": 0.2080078125 + }, + "x_at_s0": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9852886199951172, + "min_cosine_similarity": 0.9634765386581421, + "mean_relative_l2": 0.16688327491283417, + "max_abs_delta": 0.224609375 + }, + "x_at_s1": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9875043034553528, + "min_cosine_similarity": 0.970641016960144, + "mean_relative_l2": 0.154469832777977, + "max_abs_delta": 0.216796875 + }, + "period_at_s0": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.985672116279602, + "min_cosine_similarity": 0.9650515913963318, + "mean_relative_l2": 0.16504652798175812, + "max_abs_delta": 0.2255859375 + }, + "period_at_s1": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9877151250839233, + "min_cosine_similarity": 0.9713593125343323, + "mean_relative_l2": 0.15340274572372437, + "max_abs_delta": 0.220703125 + } + } + }, + "layer_01": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3a3a33b2fb6cd0eb68bcc4d61102de1d5f3eff06df6f15455db03a9ab0ca7174", + "mean": -0.0013599152443930507, + "std": 0.10594059526920319, + "rms": 0.10594932734966278, + "max_abs": 2.78125 + }, + "full_input": { + "shape": [ + 59, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4009a157d95ea47779f021f312d892ba525b7e7c3410f2eef91bf77c6e2e905e", + "mean": -0.006142889615148306, + "std": 1.0423427820205688, + "rms": 1.0423609018325806, + "max_abs": 126.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ef44692254435844cb05e2b1268437930d97aa3ad7460c2f83c57c6e2a36f639", + "mean": -0.0013593127951025963, + "std": 0.1060677245259285, + "rms": 0.1060764342546463, + "max_abs": 2.71875 + }, + "full_input": { + "shape": [ + 75, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4b17abc8e3437a398abb832cea73dbaf5b52be571e518dc4255f810f7126dade", + "mean": -0.00575319305062294, + "std": 0.9602996706962585, + "rms": 0.9603168368339539, + "max_abs": 135.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2800115034b0e60c228d35132af8deb12b90cf535f335cc67996027aa02860f8", + "mean": -0.0015605386579409242, + "std": 0.10462932288646698, + "rms": 0.10464095324277878, + "max_abs": 2.65625 + }, + "full_input": { + "shape": [ + 59, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c62f81b8c75a86ad10af4f99bd9f9411f18b89a53d49935a8dbb7cec087a6781", + "mean": -0.001455781515687704, + "std": 0.11004585027694702, + "rms": 0.11005547642707825, + "max_abs": 4.6875 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8fbe94e7f1bdf9204df44d069770ef2b111088e0687cd3addf7f367e07c1cff9", + "mean": -0.001670720987021923, + "std": 0.1040780320763588, + "rms": 0.10409144312143326, + "max_abs": 2.640625 + }, + "full_input": { + "shape": [ + 75, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ee7b0774ca06638a60b46c0853c868f4f35d084297ed37622bf05f378e797cf0", + "mean": -0.0019079629564657807, + "std": 0.11059823632240295, + "rms": 0.11061469465494156, + "max_abs": 4.6875 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "093131edf5e5bc20febe9951b373393611fe3fa3a6f4e77939b6da1f3d63f666", + "mean": -0.001447509042918682, + "std": 0.10466772317886353, + "rms": 0.1046777293086052, + "max_abs": 2.765625 + }, + "full_input": { + "shape": [ + 59, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5589f3103a6c1d1547e90c004320c4a28f7fc910ee9e4d16013bb2cd0f1bc698", + "mean": -0.001391619211062789, + "std": 0.11010120809078217, + "rms": 0.11010999977588654, + "max_abs": 4.6875 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "09f9301a0f42c8b9fe140910586d38311d407a25acf3c0cb9fd001ecc2e56fa4", + "mean": -0.0016590366140007973, + "std": 0.10395648330450058, + "rms": 0.10396971553564072, + "max_abs": 2.71875 + }, + "full_input": { + "shape": [ + 75, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7e2eafb6cde8e2aa2adb0b4a8b8d1c905042a107160c99288374ca95846d030c", + "mean": -0.0019139706855639815, + "std": 0.11063266545534134, + "rms": 0.1106492206454277, + "max_abs": 4.6875 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "59a70bdb6523afe6df5d57beb2d4b9b6390a00f16305558a219c341bbe1444bf", + "mean": -0.0014595473185181618, + "std": 0.10450036823749542, + "rms": 0.10451056063175201, + "max_abs": 2.75 + }, + "full_input": { + "shape": [ + 59, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "914b10a417af582ce29e26e119327b5efa3d1d1b6e84928e6ad593e425224845", + "mean": -0.0014306248631328344, + "std": 0.10946259647607803, + "rms": 0.10947194695472717, + "max_abs": 4.6875 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "18eb4fac763bb2ce007bc136d41cc65c3ec06958503839b30d5e9e5902b2b4bd", + "mean": -0.0016722994623705745, + "std": 0.10390472412109375, + "rms": 0.1039181798696518, + "max_abs": 2.703125 + }, + "full_input": { + "shape": [ + 75, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0e799e921f67bc7fef3914ad0c9be9c4196c4a313b97d8d6e75321606a66390c", + "mean": -0.0019371315138414502, + "std": 0.1101830005645752, + "rms": 0.11020002514123917, + "max_abs": 4.6875 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9984390139579773, + "min_cosine_similarity": 0.9874873757362366, + "mean_relative_l2": 0.05037577450275421, + "max_abs_delta": 0.0673828125 + }, + "system_bos": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9936927556991577, + "min_cosine_similarity": 0.9374023675918579, + "mean_relative_l2": 0.09940756112337112, + "max_abs_delta": 0.3330078125 + }, + "system_x": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.991031289100647, + "min_cosine_similarity": 0.9365339279174805, + "mean_relative_l2": 0.12311573326587677, + "max_abs_delta": 0.3212890625 + }, + "system_period": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9912591576576233, + "min_cosine_similarity": 0.9408228397369385, + "mean_relative_l2": 0.12196142226457596, + "max_abs_delta": 0.2998046875 + }, + "bos_at_s0": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9826422333717346, + "min_cosine_similarity": 0.9213206171989441, + "mean_relative_l2": 0.17851436138153076, + "max_abs_delta": 0.3740234375 + }, + "bos_at_s1": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.983325183391571, + "min_cosine_similarity": 0.9634706974029541, + "mean_relative_l2": 0.17708547413349152, + "max_abs_delta": 0.19140625 + }, + "x_at_s0": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9844674468040466, + "min_cosine_similarity": 0.9251190423965454, + "mean_relative_l2": 0.16838327050209045, + "max_abs_delta": 0.361328125 + }, + "x_at_s1": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9813252687454224, + "min_cosine_similarity": 0.9599121809005737, + "mean_relative_l2": 0.18759369850158691, + "max_abs_delta": 0.2578125 + }, + "period_at_s0": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9850172400474548, + "min_cosine_similarity": 0.9327934980392456, + "mean_relative_l2": 0.1661807745695114, + "max_abs_delta": 0.326171875 + }, + "period_at_s1": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9815391302108765, + "min_cosine_similarity": 0.961402177810669, + "mean_relative_l2": 0.18686188757419586, + "max_abs_delta": 0.26171875 + } + } + }, + "layer_02": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "368218cfd43e2591d2416b92f0f6aa1a352db597c50b17d9f51d3619b87a8864", + "mean": -0.0014048164011910558, + "std": 0.1254202127456665, + "rms": 0.12542806565761566, + "max_abs": 3.5625 + }, + "full_input": { + "shape": [ + 59, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f1c3905519db957f4f46ca867a6f2c22d93ca9b0ac15f371593e6d96bec0e6f6", + "mean": -0.017375897616147995, + "std": 3.1272058486938477, + "rms": 3.127254009246826, + "max_abs": 392.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "039937a5c76b301dd2127f44aa3fe0a3edeb8e65d36a98db351e83b1e7cd2ca0", + "mean": -0.0013090568827465177, + "std": 0.1252623349428177, + "rms": 0.12526918947696686, + "max_abs": 3.46875 + }, + "full_input": { + "shape": [ + 75, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9b0ba968a25fd7f2ecbd1b61297d120b0510ccdb53fac236e7fbe4986f6b2bf3", + "mean": -0.01635265350341797, + "std": 3.0676963329315186, + "rms": 3.067739963531494, + "max_abs": 436.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "163b6262120f934fd773ac5cf29e86cbf84ba73faf08cda2d0c7ca5f633f7f49", + "mean": -0.0016165992710739374, + "std": 0.12317945063114166, + "rms": 0.12319006025791168, + "max_abs": 3.4375 + }, + "full_input": { + "shape": [ + 59, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5b9c7bfac6be4dc74d0775c41b48ebd8a9b95190edd234ba6d7073e1e1cf479c", + "mean": -0.002050408162176609, + "std": 0.24639397859573364, + "rms": 0.24640248715877533, + "max_abs": 23.75 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "eb918e6cc002efef52ef69894d5e857e30a088c518869d03d412bacfdb66dfd4", + "mean": -0.0014589140191674232, + "std": 0.12335171550512314, + "rms": 0.12336035072803497, + "max_abs": 3.40625 + }, + "full_input": { + "shape": [ + 75, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "00f70946e99c137c033ed45bd3f54251b5cfa5d84042f9f74d7ed73a02295beb", + "mean": -0.0020388781558722258, + "std": 0.22729073464870453, + "rms": 0.22729986906051636, + "max_abs": 23.75 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8b69af1f7af0f815cdfbdc41e01233cde73409e56406dc89691c47dcf6d7ae84", + "mean": -0.0014682599576190114, + "std": 0.12264887243509293, + "rms": 0.1226576641201973, + "max_abs": 3.40625 + }, + "full_input": { + "shape": [ + 59, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "05586fb85f858a956288c5f2ec3d9c97499be0f935f4c156b831d9bbfe8139c2", + "mean": -0.001980684930458665, + "std": 0.2462817132472992, + "rms": 0.2462896704673767, + "max_abs": 23.75 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f7b24697344a9dccb3342c64d72d43f23a956adaf775cfedb15bf907d8ca3f5d", + "mean": -0.0013926367973908782, + "std": 0.12242840975522995, + "rms": 0.12243631482124329, + "max_abs": 3.34375 + }, + "full_input": { + "shape": [ + 75, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "619d041577a239e9195748a12f5d70c68142b7f6fe875096bcd63514bf65b690", + "mean": -0.002019154839217663, + "std": 0.22712932527065277, + "rms": 0.22713828086853027, + "max_abs": 23.75 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2eecc9a1f55dd480e777831e8f6492798e165d9ede3e671a9753fff9ca054239", + "mean": -0.001432830817066133, + "std": 0.12233304232358932, + "rms": 0.12234143167734146, + "max_abs": 3.359375 + }, + "full_input": { + "shape": [ + 59, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1166a85e617df6c17e7cddf30bc479d1aa0f899e1f791bf41f31c53969a6e09f", + "mean": -0.002052664291113615, + "std": 0.2457462102174759, + "rms": 0.24575476348400116, + "max_abs": 23.75 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a3a76e7b8bbdf39bf9256bbdb44bea25b9f5959719b9223bc7163839fd2fbee8", + "mean": -0.0013957908377051353, + "std": 0.12226279824972153, + "rms": 0.12227077782154083, + "max_abs": 3.34375 + }, + "full_input": { + "shape": [ + 75, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "54c81f09243b04d2b5648e9eb6dd29740a5ba16959078c63135c1be79ae43526", + "mean": -0.0020766062662005424, + "std": 0.22665908932685852, + "rms": 0.2266685962677002, + "max_abs": 23.75 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9983014464378357, + "min_cosine_similarity": 0.9915233850479126, + "mean_relative_l2": 0.05435040965676308, + "max_abs_delta": 0.09375 + }, + "system_bos": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9931402802467346, + "min_cosine_similarity": 0.9313043355941772, + "mean_relative_l2": 0.10573984682559967, + "max_abs_delta": 0.404296875 + }, + "system_x": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9900038242340088, + "min_cosine_similarity": 0.9288668036460876, + "mean_relative_l2": 0.13185083866119385, + "max_abs_delta": 0.384765625 + }, + "system_period": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9904835820198059, + "min_cosine_similarity": 0.938865065574646, + "mean_relative_l2": 0.12974059581756592, + "max_abs_delta": 0.3349609375 + }, + "bos_at_s0": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9837880730628967, + "min_cosine_similarity": 0.9071905612945557, + "mean_relative_l2": 0.17075975239276886, + "max_abs_delta": 0.5 + }, + "bos_at_s1": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9832921624183655, + "min_cosine_similarity": 0.9609974026679993, + "mean_relative_l2": 0.1782824546098709, + "max_abs_delta": 0.3046875 + }, + "x_at_s0": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9834869503974915, + "min_cosine_similarity": 0.9041864275932312, + "mean_relative_l2": 0.1717134714126587, + "max_abs_delta": 0.53125 + }, + "x_at_s1": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9786590337753296, + "min_cosine_similarity": 0.9502742290496826, + "mean_relative_l2": 0.2007841020822525, + "max_abs_delta": 0.38671875 + }, + "period_at_s0": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9839351773262024, + "min_cosine_similarity": 0.9176000356674194, + "mean_relative_l2": 0.1711885929107666, + "max_abs_delta": 0.515625 + }, + "period_at_s1": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9786167144775391, + "min_cosine_similarity": 0.9523029327392578, + "mean_relative_l2": 0.20121484994888306, + "max_abs_delta": 0.3984375 + } + } + }, + "layer_03": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3e4e84a0493bfa2c5a69ada295240149f90833fef9cdee2364247c764610fe38", + "mean": -0.0018474293174222112, + "std": 0.1538112461566925, + "rms": 0.15382233262062073, + "max_abs": 4.3125 + }, + "full_input": { + "shape": [ + 59, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "da94d1ff90b99c41c6027333b4fbbef7fc317bf4e1e4a234b5b021a3ba59824d", + "mean": -0.0231646616011858, + "std": 9.378304481506348, + "rms": 9.378334045410156, + "max_abs": 1136.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d02e0874034ee9878750f9cc6f24241b9db37570c32de0856062f4550a9f5a40", + "mean": -0.0017800499917939305, + "std": 0.15430797636508942, + "rms": 0.15431824326515198, + "max_abs": 4.28125 + }, + "full_input": { + "shape": [ + 75, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "879b1506a57f13c5007aa276554717ecceb7bb0ec18d29b6ef47f911ee579457", + "mean": -0.021434620022773743, + "std": 8.587450981140137, + "rms": 8.587477684020996, + "max_abs": 1136.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1fdc406379d001a3ba352f21f419a7a6b4cf4945145e33ab09de0c81136a84d9", + "mean": -0.0020026385318487883, + "std": 0.15518994629383087, + "rms": 0.15520286560058594, + "max_abs": 4.4375 + }, + "full_input": { + "shape": [ + 59, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "62cb2b640a236668c7fd716a05cab6bf987b39acfd7ff409147cb06e206ccbbc", + "mean": -0.006027199327945709, + "std": 8.362943649291992, + "rms": 8.362946510314941, + "max_abs": 1136.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3ad648e38e7d66761272f957b70dd3a5d7d51441297d4e8aa04c111d36955be8", + "mean": -0.001947473967447877, + "std": 0.15574268996715546, + "rms": 0.15575486421585083, + "max_abs": 4.4375 + }, + "full_input": { + "shape": [ + 75, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4d29cac015faba79cec6f7304c6ccf060aeb7b1b7e3014548371e6714cedfda7", + "mean": -0.005560046061873436, + "std": 7.417785167694092, + "rms": 7.417787075042725, + "max_abs": 1136.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e438ce882d2241a3e140f36d6cd702d4150cebf867f2c617d6c5599297ec89da", + "mean": -0.0021794880740344524, + "std": 0.1519896686077118, + "rms": 0.15200529992580414, + "max_abs": 4.40625 + }, + "full_input": { + "shape": [ + 59, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e08624bdf5db9aaab2683ef11e803c20f6244c4cea635a7e17422100f69fc6f5", + "mean": -0.006244136020541191, + "std": 8.362892150878906, + "rms": 8.362895011901855, + "max_abs": 1136.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0affba94cc9f360c2bd00f111365e60c67a873560ca4e71cef57746f3fabad6c", + "mean": -0.002044349443167448, + "std": 0.15362277626991272, + "rms": 0.1536363810300827, + "max_abs": 4.375 + }, + "full_input": { + "shape": [ + 75, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9766928f4de1fab679c56e67ff503ebb7468921b4851b7349e08af09b97fc414", + "mean": -0.005690291989594698, + "std": 7.417754650115967, + "rms": 7.417757034301758, + "max_abs": 1136.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "76c5463a22606bc00a5f24ddffc19c13af7ad310b8b46e064468f77b1bf97436", + "mean": -0.0021057534031569958, + "std": 0.15196722745895386, + "rms": 0.15198181569576263, + "max_abs": 4.4375 + }, + "full_input": { + "shape": [ + 59, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "31a4dff379e80d22256b6ce59aec78d7bc0d6c38bcd5f426aefd9233fd09c2fb", + "mean": -0.006209740415215492, + "std": 8.36288070678711, + "rms": 8.362882614135742, + "max_abs": 1136.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4de0a6799f6f42c3a00e5c48c79fa20680be2c3b09a6cb2f837f420a9005b69f", + "mean": -0.001993383513763547, + "std": 0.15404918789863586, + "rms": 0.15406209230422974, + "max_abs": 4.4375 + }, + "full_input": { + "shape": [ + 75, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "94796a1d40cc936ed16d7d688614f0845629eecfd43fcb92b8661d13fed79a44", + "mean": -0.0056592244654893875, + "std": 7.417747974395752, + "rms": 7.417750358581543, + "max_abs": 1136.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9985274076461792, + "min_cosine_similarity": 0.995280385017395, + "mean_relative_l2": 0.05241435021162033, + "max_abs_delta": 0.09375 + }, + "system_bos": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9944462776184082, + "min_cosine_similarity": 0.9657951593399048, + "mean_relative_l2": 0.09903448820114136, + "max_abs_delta": 0.31298828125 + }, + "system_x": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9902388453483582, + "min_cosine_similarity": 0.9543344974517822, + "mean_relative_l2": 0.13499756157398224, + "max_abs_delta": 0.2861328125 + }, + "system_period": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9906972050666809, + "min_cosine_similarity": 0.961388349533081, + "mean_relative_l2": 0.13307499885559082, + "max_abs_delta": 0.259765625 + }, + "bos_at_s0": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9866320490837097, + "min_cosine_similarity": 0.9445552825927734, + "mean_relative_l2": 0.15959657728672028, + "max_abs_delta": 0.3984375 + }, + "bos_at_s1": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9855152368545532, + "min_cosine_similarity": 0.9601258039474487, + "mean_relative_l2": 0.16835640370845795, + "max_abs_delta": 0.34375 + }, + "x_at_s0": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9852283596992493, + "min_cosine_similarity": 0.9213732481002808, + "mean_relative_l2": 0.16379523277282715, + "max_abs_delta": 0.435546875 + }, + "x_at_s1": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9803358912467957, + "min_cosine_similarity": 0.9297468066215515, + "mean_relative_l2": 0.1928292214870453, + "max_abs_delta": 0.37890625 + }, + "period_at_s0": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9860360622406006, + "min_cosine_similarity": 0.9353100061416626, + "mean_relative_l2": 0.160480797290802, + "max_abs_delta": 0.3828125 + }, + "period_at_s1": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9805217981338501, + "min_cosine_similarity": 0.9412587881088257, + "mean_relative_l2": 0.19278870522975922, + "max_abs_delta": 0.40625 + } + } + }, + "layer_04": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c6411a750ec47794f3fde58cd03704975589f9cc01c493d57e16053c670560fd", + "mean": -0.002193814143538475, + "std": 0.18515104055404663, + "rms": 0.18516403436660767, + "max_abs": 5.25 + }, + "full_input": { + "shape": [ + 59, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1f017d4215d8b836e58042a03b98629271e23f9f1fdf73884ce961c6c5de1763", + "mean": -0.022991200909018517, + "std": 9.784412384033203, + "rms": 9.784439086914062, + "max_abs": 1152.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3f2799e05e24bef9329f0be061e3d3b70a384d6314977366ad403b118023f1cf", + "mean": -0.0021351545583456755, + "std": 0.1861564815044403, + "rms": 0.18616873025894165, + "max_abs": 5.25 + }, + "full_input": { + "shape": [ + 75, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8e45b063172641bcd23303e827fb9a4d9a3a33dc1ab3dc4a807f92a6c4265aee", + "mean": -0.02137870155274868, + "std": 8.937488555908203, + "rms": 8.93751335144043, + "max_abs": 1152.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "880d2fbc0b26b7aadbfd6d3a526c03d627d393f2598c16a36e3460953d0614ea", + "mean": -0.002421875949949026, + "std": 0.1873030811548233, + "rms": 0.18731872737407684, + "max_abs": 5.34375 + }, + "full_input": { + "shape": [ + 59, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0534f0c3ef9d540144d7658523c7c160cf494ac3552d887a52fb712f82a18997", + "mean": -0.005941856186836958, + "std": 8.769990921020508, + "rms": 8.769993782043457, + "max_abs": 1152.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8926f705c7a8351c1ffa78b9320de0d0a9bedfebc6a4319ec35f8d4f72fc684b", + "mean": -0.0024330816231667995, + "std": 0.18655237555503845, + "rms": 0.1865682452917099, + "max_abs": 5.3125 + }, + "full_input": { + "shape": [ + 75, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "176084e3e8669a3b6b6212878c362fd6d116fdf7e1454a4ead144ea62628c92b", + "mean": -0.005551973357796669, + "std": 7.772615909576416, + "rms": 7.772617340087891, + "max_abs": 1152.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ba1c90024cf8a65c1333ab6daf1459ba8a54eca309dcd0852f48616d2cb32e78", + "mean": -0.0021453602239489555, + "std": 0.1830185204744339, + "rms": 0.1830310970544815, + "max_abs": 5.1875 + }, + "full_input": { + "shape": [ + 59, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1c3989541ccf57d7a809663b4cae9462ec0703ac8eedb7d03ca79c81d4bdd712", + "mean": -0.00571310892701149, + "std": 8.76990032196045, + "rms": 8.769903182983398, + "max_abs": 1152.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1a628b1f1549b9a4b7c99713905e8fdcf8c0d0a860cffd0aa6e71ed089a1d9f9", + "mean": -0.0022244954016059637, + "std": 0.18318182229995728, + "rms": 0.1831953376531601, + "max_abs": 5.09375 + }, + "full_input": { + "shape": [ + 75, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "dfa1a16da2285eb06087dc49f52835f80c91f4a6b37ef7ce4c1a7745be032cf1", + "mean": -0.005421229172497988, + "std": 7.772543907165527, + "rms": 7.772545337677002, + "max_abs": 1152.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "183c0bc9e01d2c58c424d972b4f75bbc7c344c3ed3601798e30d24238d9d5fe2", + "mean": -0.002107377164065838, + "std": 0.18313178420066833, + "rms": 0.18314389884471893, + "max_abs": 5.15625 + }, + "full_input": { + "shape": [ + 59, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e7d00eda2f65696eb25f91f35c7db012c22709d6f1aa9f42cfc3277056dfc52f", + "mean": -0.005706684663891792, + "std": 8.769890785217285, + "rms": 8.769892692565918, + "max_abs": 1152.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c02bdf74292512faa619b9f2b1842c6e8d6cd08c91413347d71dfeafd1f577f3", + "mean": -0.0022540579084306955, + "std": 0.18303050100803375, + "rms": 0.18304437398910522, + "max_abs": 5.09375 + }, + "full_input": { + "shape": [ + 75, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3d14059a1a0b41dedf008d71882ca52e1ebb37ba062cea0bab41c6fd9dbb1578", + "mean": -0.005432686768472195, + "std": 7.772532939910889, + "rms": 7.772533893585205, + "max_abs": 1152.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9983740448951721, + "min_cosine_similarity": 0.9884213209152222, + "mean_relative_l2": 0.05243632197380066, + "max_abs_delta": 0.1044921875 + }, + "system_bos": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9955973625183105, + "min_cosine_similarity": 0.9775747060775757, + "mean_relative_l2": 0.08952316641807556, + "max_abs_delta": 0.3203125 + }, + "system_x": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9920672178268433, + "min_cosine_similarity": 0.9692227244377136, + "mean_relative_l2": 0.12068748474121094, + "max_abs_delta": 0.2841796875 + }, + "system_period": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9921198487281799, + "min_cosine_similarity": 0.9727187156677246, + "mean_relative_l2": 0.12044013291597366, + "max_abs_delta": 0.2626953125 + }, + "bos_at_s0": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9908965826034546, + "min_cosine_similarity": 0.9587055444717407, + "mean_relative_l2": 0.13237231969833374, + "max_abs_delta": 0.375 + }, + "bos_at_s1": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9895272254943848, + "min_cosine_similarity": 0.9662074446678162, + "mean_relative_l2": 0.1420070379972458, + "max_abs_delta": 0.34375 + }, + "x_at_s0": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9886817932128906, + "min_cosine_similarity": 0.9373051524162292, + "mean_relative_l2": 0.14373043179512024, + "max_abs_delta": 0.39453125 + }, + "x_at_s1": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9841517210006714, + "min_cosine_similarity": 0.9333535432815552, + "mean_relative_l2": 0.17219455540180206, + "max_abs_delta": 0.5400390625 + }, + "period_at_s0": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9892181158065796, + "min_cosine_similarity": 0.9457463026046753, + "mean_relative_l2": 0.14097906649112701, + "max_abs_delta": 0.35546875 + }, + "period_at_s1": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.983935534954071, + "min_cosine_similarity": 0.941260814666748, + "mean_relative_l2": 0.17384251952171326, + "max_abs_delta": 0.5400390625 + } + } + }, + "layer_05": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "96f7856b2d609bdc0063335cf1436133f42d51f96770c4613785035814140ae2", + "mean": -0.0019423578632995486, + "std": 0.2158842384815216, + "rms": 0.2158929854631424, + "max_abs": 6.4375 + }, + "full_input": { + "shape": [ + 59, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c22cf0b24394de5c06ca734eb4a66e5d563740e3ace02f78a19652e1262f9a20", + "mean": -0.02544032223522663, + "std": 10.084049224853516, + "rms": 10.084081649780273, + "max_abs": 1152.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "af08638af793f82713eb5605ad268267798adc7f85fbaf604774eae5c60f9c80", + "mean": -0.0019105533137917519, + "std": 0.2179006189107895, + "rms": 0.21790899336338043, + "max_abs": 6.4375 + }, + "full_input": { + "shape": [ + 75, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d2b8051a26ffc2f9d42eb9913cf19254a84452020fae7b720e047442696211ad", + "mean": -0.023109741508960724, + "std": 9.213603973388672, + "rms": 9.213632583618164, + "max_abs": 1152.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f4e01b65598d248309db3b71073a19e05166041eeb154fcad7fa0a415ef2df89", + "mean": -0.0022441139444708824, + "std": 0.2189519852399826, + "rms": 0.21896348893642426, + "max_abs": 6.5 + }, + "full_input": { + "shape": [ + 59, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1dae1f1fc2967c6cafb0af81755b8e42a5d95f9b58c6530bb1c79e6089310847", + "mean": -0.0067319744266569614, + "std": 8.925475120544434, + "rms": 8.925477981567383, + "max_abs": 1152.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "713fcb442495b9cbbb1fe0bd74d23cd11a7ec857b8e2c84156a009a7a6256e3b", + "mean": -0.002341519808396697, + "std": 0.21882635354995728, + "rms": 0.2188388854265213, + "max_abs": 6.53125 + }, + "full_input": { + "shape": [ + 75, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1b593474cf44c8322a34068ae36e3e002e41669a047fa0ac348bc38a8b7641ac", + "mean": -0.005976182408630848, + "std": 7.907860279083252, + "rms": 7.907862663269043, + "max_abs": 1152.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "671ffbfbe82ed6c23260e5c7791f7df93a97ff7bedacab118028482b59be1e0b", + "mean": -0.0021560173481702805, + "std": 0.21460697054862976, + "rms": 0.2146178036928177, + "max_abs": 6.5 + }, + "full_input": { + "shape": [ + 59, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d5d3dd2aae5f0c7bf003265334fe5bf1ee045fc3b167d81ab5b89e3290d72e7d", + "mean": -0.006522210780531168, + "std": 8.925374984741211, + "rms": 8.92537784576416, + "max_abs": 1152.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6098866555a6b1382fc3ed8d30e8167c30a45b28a2584efa8dad3302de211747", + "mean": -0.002371964743360877, + "std": 0.21416468918323517, + "rms": 0.21417783200740814, + "max_abs": 6.5625 + }, + "full_input": { + "shape": [ + 75, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5a861037437f0b2306d310c82136ed23e19fe89da9859948cf132033b33da897", + "mean": -0.005912047810852528, + "std": 7.907763957977295, + "rms": 7.907765865325928, + "max_abs": 1152.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "30b11004d5553026d06e38b7f302761935d2041cfd8686a171b0117a5c6b3292", + "mean": -0.0021659338381141424, + "std": 0.21486248075962067, + "rms": 0.21487340331077576, + "max_abs": 6.5625 + }, + "full_input": { + "shape": [ + 59, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1c5e3fb7e6a94c21589907c7f93e44d00af82263bd83f24bb477f499f6de8c8b", + "mean": -0.006551338359713554, + "std": 8.925360679626465, + "rms": 8.925363540649414, + "max_abs": 1152.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e377693834ef0bc64b7fe76b4c191b05af9fc19fc06861d92c190591b22eeb12", + "mean": -0.0024709647987037897, + "std": 0.21383735537528992, + "rms": 0.21385163068771362, + "max_abs": 6.625 + }, + "full_input": { + "shape": [ + 75, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ea543cad5863c2fa0350d4463c1eed4e47eec233521c542e3227ab523b2b47f9", + "mean": -0.005992137361317873, + "std": 7.907744884490967, + "rms": 7.907746315002441, + "max_abs": 1152.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9983530640602112, + "min_cosine_similarity": 0.9913973808288574, + "mean_relative_l2": 0.05540517345070839, + "max_abs_delta": 0.13037109375 + }, + "system_bos": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9957285523414612, + "min_cosine_similarity": 0.9822324514389038, + "mean_relative_l2": 0.08917548507452011, + "max_abs_delta": 0.3125 + }, + "system_x": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9920876622200012, + "min_cosine_similarity": 0.9724432229995728, + "mean_relative_l2": 0.12162723392248154, + "max_abs_delta": 0.3125 + }, + "system_period": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9917957186698914, + "min_cosine_similarity": 0.9732953310012817, + "mean_relative_l2": 0.12401992827653885, + "max_abs_delta": 0.328125 + }, + "bos_at_s0": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9915214776992798, + "min_cosine_similarity": 0.964515209197998, + "mean_relative_l2": 0.12864267826080322, + "max_abs_delta": 0.40625 + }, + "bos_at_s1": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9901250004768372, + "min_cosine_similarity": 0.9705414772033691, + "mean_relative_l2": 0.13846616446971893, + "max_abs_delta": 0.453125 + }, + "x_at_s0": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.989234447479248, + "min_cosine_similarity": 0.9513301849365234, + "mean_relative_l2": 0.14136898517608643, + "max_abs_delta": 0.46875 + }, + "x_at_s1": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9845843315124512, + "min_cosine_similarity": 0.9397202134132385, + "mean_relative_l2": 0.1704096794128418, + "max_abs_delta": 0.564453125 + }, + "period_at_s0": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9897950291633606, + "min_cosine_similarity": 0.9573462009429932, + "mean_relative_l2": 0.1376393437385559, + "max_abs_delta": 0.390625 + }, + "period_at_s1": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9842024445533752, + "min_cosine_similarity": 0.9466102123260498, + "mean_relative_l2": 0.17325624823570251, + "max_abs_delta": 0.58203125 + } + } + }, + "layer_06": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f41123a75a09247e8d242cc85fa4df90f34182dbab280dcb091d9e05049af11e", + "mean": -0.004201176576316357, + "std": 0.2585141360759735, + "rms": 0.2585482895374298, + "max_abs": 8.5 + }, + "full_input": { + "shape": [ + 59, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3e57a8f65614dadec2771f6f0ac3eda51c9628fa54db9fde16c422e6d7481fde", + "mean": -0.028019480407238007, + "std": 10.26797103881836, + "rms": 10.268009185791016, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fadd4fcb6d2efaff5cc86b32de9abff915275322f8140c945d6cd2956c0e3aa9", + "mean": -0.004228719975799322, + "std": 0.2597409188747406, + "rms": 0.2597753405570984, + "max_abs": 8.5 + }, + "full_input": { + "shape": [ + 75, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7436906b74c17b61384af17b62df173b594595e994b2cb0b5040ee882a9f22bb", + "mean": -0.025438563898205757, + "std": 9.381197929382324, + "rms": 9.381233215332031, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "73b9f5fd5fff5ec11b53ecce5a581b5b2129741c9b7db7ab632bb3f9134f7a5c", + "mean": -0.004337836988270283, + "std": 0.26250359416007996, + "rms": 0.26253944635391235, + "max_abs": 8.5 + }, + "full_input": { + "shape": [ + 59, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "63d98962534e3f09216ea160bde4a4a2f079ea1435e14156f13349f25f27354b", + "mean": -0.008676921017467976, + "std": 9.069031715393066, + "rms": 9.069035530090332, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "19420a9f5b42e415f4f17c9e9a5708d2501b1314b66f5e73e10107c03d763e98", + "mean": -0.0043616644106805325, + "std": 0.2627412676811218, + "rms": 0.2627774775028229, + "max_abs": 8.625 + }, + "full_input": { + "shape": [ + 75, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "578bf0d0bf97931dbac39c64d292a6d716666ad85ea9a030438b5111a06334fa", + "mean": -0.007707882672548294, + "std": 8.035322189331055, + "rms": 8.035326957702637, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a7d983d5e6346463c78c5c2b4c6bdf7997855cd72c919a7f03c661b3eb68abe4", + "mean": -0.004009266849607229, + "std": 0.25941771268844604, + "rms": 0.25944867730140686, + "max_abs": 8.5 + }, + "full_input": { + "shape": [ + 59, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a62b494668efebbf09cb2515ac20773437ea4bd4d2986a17d4c68bdcb60c5b67", + "mean": -0.008258418180048466, + "std": 9.068927764892578, + "rms": 9.068931579589844, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "09a3b8b206ba6fbd70bc9281dfdccff528f9c9369b29b6cac3bc8f38ccac764b", + "mean": -0.004088428802788258, + "std": 0.25808271765708923, + "rms": 0.25811508297920227, + "max_abs": 8.6875 + }, + "full_input": { + "shape": [ + 75, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3268ade85f764777e947d48ffe71c54d71ea2892889a2ebf4c451a672057df08", + "mean": -0.00741565553471446, + "std": 8.035197257995605, + "rms": 8.035201072692871, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e68d70ebbe8e66790622cbbb881c1bd344923fbd27df2bf1f4966a930211689a", + "mean": -0.004161039832979441, + "std": 0.25884732604026794, + "rms": 0.25888076424598694, + "max_abs": 8.625 + }, + "full_input": { + "shape": [ + 59, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "535aa39a8c71c0390713e617fabd3257dcbfaf149aefa02ccfcd8e44f1a43935", + "mean": -0.008315922692418098, + "std": 9.068906784057617, + "rms": 9.068910598754883, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "46eb1467859e329e5fe342a2b854bb2cbc514e8ef9ee977b8c265f1eb251fff5", + "mean": -0.0042686499655246735, + "std": 0.2572477459907532, + "rms": 0.25728318095207214, + "max_abs": 8.8125 + }, + "full_input": { + "shape": [ + 75, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5db85fdd7348dccb8cb36d384833c7b930dfd98144e5684a83727eaa8bb27e18", + "mean": -0.007517202757298946, + "std": 8.035172462463379, + "rms": 8.035175323486328, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9983004331588745, + "min_cosine_similarity": 0.9943343997001648, + "mean_relative_l2": 0.054470162838697433, + "max_abs_delta": 0.1875 + }, + "system_bos": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9964085817337036, + "min_cosine_similarity": 0.9849644303321838, + "mean_relative_l2": 0.08079665899276733, + "max_abs_delta": 0.3125 + }, + "system_x": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9934837222099304, + "min_cosine_similarity": 0.9770318269729614, + "mean_relative_l2": 0.10897951573133469, + "max_abs_delta": 0.328125 + }, + "system_period": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9930057525634766, + "min_cosine_similarity": 0.9762237071990967, + "mean_relative_l2": 0.1130918338894844, + "max_abs_delta": 0.359375 + }, + "bos_at_s0": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9936449527740479, + "min_cosine_similarity": 0.9684150815010071, + "mean_relative_l2": 0.1112668439745903, + "max_abs_delta": 0.46875 + }, + "bos_at_s1": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9923415184020996, + "min_cosine_similarity": 0.9768877029418945, + "mean_relative_l2": 0.12229935079813004, + "max_abs_delta": 0.46875 + }, + "x_at_s0": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9914676547050476, + "min_cosine_similarity": 0.9608275294303894, + "mean_relative_l2": 0.12598642706871033, + "max_abs_delta": 0.625 + }, + "x_at_s1": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9876025915145874, + "min_cosine_similarity": 0.9531140327453613, + "mean_relative_l2": 0.15199406445026398, + "max_abs_delta": 0.5625 + }, + "period_at_s0": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9918190240859985, + "min_cosine_similarity": 0.9648563861846924, + "mean_relative_l2": 0.12336748838424683, + "max_abs_delta": 0.4375 + }, + "period_at_s1": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9869444370269775, + "min_cosine_similarity": 0.9562149047851562, + "mean_relative_l2": 0.15607097744941711, + "max_abs_delta": 0.578125 + } + } + }, + "layer_07": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d0df1d9fb80871b0200cb796e0be4a7774a305123012225c5eecebaa71599011", + "mean": -0.004074012394994497, + "std": 0.27076905965805054, + "rms": 0.2707996964454651, + "max_abs": 7.59375 + }, + "full_input": { + "shape": [ + 59, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8b4bc412926c80fae7717477676aca85bc259367663a3af27b88e3b608bad072", + "mean": -0.02783195488154888, + "std": 10.297160148620605, + "rms": 10.297197341918945, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8526abcf33ab97423e7d32fad5a6f3632a543bc4eacc71ed6e1df8f7727ed5d5", + "mean": -0.004078596830368042, + "std": 0.2723141610622406, + "rms": 0.2723446786403656, + "max_abs": 7.625 + }, + "full_input": { + "shape": [ + 75, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e353b9a7ad019a1db943539c14ca0a4424ff4a495459c108aeecc7c77602d5cd", + "mean": -0.02599135786294937, + "std": 9.408970832824707, + "rms": 9.40900707244873, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ae96cd71b640378869609e545a4b9c9a8ddd8efc54695b54bc78b02b6fe19133", + "mean": -0.004059603903442621, + "std": 0.27402397990226746, + "rms": 0.27405405044555664, + "max_abs": 7.6875 + }, + "full_input": { + "shape": [ + 59, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f10e3775c45d729459eac8371088f9cce16a63e73dc58564a2bb2b41127415b1", + "mean": -0.008361700922250748, + "std": 9.08559513092041, + "rms": 9.085598945617676, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1a8f26f085a4b9de484b77e11c9f661e8eda3d865f8480a114d9bd02b990a35d", + "mean": -0.004151654429733753, + "std": 0.27410250902175903, + "rms": 0.27413395047187805, + "max_abs": 7.8125 + }, + "full_input": { + "shape": [ + 75, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "05cf869d15c6438284049168a371688662240245c7a9eb9a3acff45baf933ca0", + "mean": -0.008151387795805931, + "std": 8.050195693969727, + "rms": 8.050200462341309, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7e242b70590354aed87bd458066e55879d233184c6156f43095f5588c807dee4", + "mean": -0.003724975511431694, + "std": 0.2709416151046753, + "rms": 0.2709672152996063, + "max_abs": 7.8125 + }, + "full_input": { + "shape": [ + 59, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2be304ebab80f74996ea0d97a14518abb5e3dcc9537350057d4498f24605601d", + "mean": -0.008222316391766071, + "std": 9.085474967956543, + "rms": 9.085478782653809, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "52f6e87c41b6a232314abffa39524a5be666fcc6da330afe5bec19725f8feeec", + "mean": -0.003860985627397895, + "std": 0.27069905400276184, + "rms": 0.27072659134864807, + "max_abs": 8.0625 + }, + "full_input": { + "shape": [ + 75, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9492a69ff7daacdc884cb158cb9f383db7db02861a5600c2e5fc6abe599cd34b", + "mean": -0.008010154590010643, + "std": 8.050076484680176, + "rms": 8.050080299377441, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a53f6767643df3fed52035932a2dd3a2eb9389a3258568dda6b08c51f773321b", + "mean": -0.003861595643684268, + "std": 0.2707895040512085, + "rms": 0.2708170413970947, + "max_abs": 7.875 + }, + "full_input": { + "shape": [ + 59, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "77b823d6e0f19ee33659e073331b6cff96a57c753b18cc8c5a91ce335241e205", + "mean": -0.008110055699944496, + "std": 9.085474014282227, + "rms": 9.085477828979492, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e4a97c8b89d6ee81f24db55aa661ae8cb0bc426087dac98766c90cd128db9438", + "mean": -0.004069142509251833, + "std": 0.2701539695262909, + "rms": 0.27018460631370544, + "max_abs": 8.125 + }, + "full_input": { + "shape": [ + 75, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "15d1f91262808c4928ac797f7db3e4b8b4f15798cc6319f864a82697ff0d6412", + "mean": -0.008013175800442696, + "std": 8.050066947937012, + "rms": 8.050070762634277, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9980897307395935, + "min_cosine_similarity": 0.9925185441970825, + "mean_relative_l2": 0.05738591030240059, + "max_abs_delta": 0.21875 + }, + "system_bos": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9963927268981934, + "min_cosine_similarity": 0.985785722732544, + "mean_relative_l2": 0.08107050508260727, + "max_abs_delta": 0.25 + }, + "system_x": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9934942722320557, + "min_cosine_similarity": 0.9785249829292297, + "mean_relative_l2": 0.10932362079620361, + "max_abs_delta": 0.40625 + }, + "system_period": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9927918910980225, + "min_cosine_similarity": 0.9753352403640747, + "mean_relative_l2": 0.11434672027826309, + "max_abs_delta": 0.40625 + }, + "bos_at_s0": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9931914210319519, + "min_cosine_similarity": 0.9684048891067505, + "mean_relative_l2": 0.11474408209323883, + "max_abs_delta": 0.3828125 + }, + "bos_at_s1": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9922894835472107, + "min_cosine_similarity": 0.9767173528671265, + "mean_relative_l2": 0.12191063165664673, + "max_abs_delta": 0.4375 + }, + "x_at_s0": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9909592866897583, + "min_cosine_similarity": 0.9616662859916687, + "mean_relative_l2": 0.12983877956867218, + "max_abs_delta": 0.53125 + }, + "x_at_s1": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9876179695129395, + "min_cosine_similarity": 0.952036440372467, + "mean_relative_l2": 0.1523389369249344, + "max_abs_delta": 0.71875 + }, + "period_at_s0": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9914347529411316, + "min_cosine_similarity": 0.9661984443664551, + "mean_relative_l2": 0.12643961608409882, + "max_abs_delta": 0.46875 + }, + "period_at_s1": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9869164824485779, + "min_cosine_similarity": 0.9544347524642944, + "mean_relative_l2": 0.15619413554668427, + "max_abs_delta": 0.62109375 + } + } + }, + "layer_08": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "029c4fed597a8b05c89f40069389a6850bd7c4b25b28bd9bdd9da4acb5f13397", + "mean": -0.004877958446741104, + "std": 0.31071701645851135, + "rms": 0.31075531244277954, + "max_abs": 8.875 + }, + "full_input": { + "shape": [ + 59, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c9b6432d703e73bfcc2032387aac970282e24f1aa015ae944d84612dbc91969a", + "mean": -0.028683286160230637, + "std": 10.331984519958496, + "rms": 10.332022666931152, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e64a48f3e15253a9db70994ed41da613128a5871e098c9bde6326fac8f54f710", + "mean": -0.004683515056967735, + "std": 0.31157565116882324, + "rms": 0.3116108775138855, + "max_abs": 9.0 + }, + "full_input": { + "shape": [ + 75, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8bcf90df6e3c529c9c94afdf5b39be757faa38d7d18b7cc154ef3ee8bf11b6dc", + "mean": -0.026250123977661133, + "std": 9.441399574279785, + "rms": 9.441435813903809, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3541306efa5586ad75f232efc19824cc36424c1ff6563fdff0e1767b256009fc", + "mean": -0.00491430563852191, + "std": 0.31413063406944275, + "rms": 0.3141690492630005, + "max_abs": 9.125 + }, + "full_input": { + "shape": [ + 59, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "25e24a328a22e329174e935e52e90025c32e1eff8a7644268efd034841f3eac4", + "mean": -0.00940494704991579, + "std": 9.105086326599121, + "rms": 9.10509204864502, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "beaf5782f80bdbbbb1e039e14065b9e0f63d8aaf991ca47f2be63e587edbca8f", + "mean": -0.004986570216715336, + "std": 0.3147907555103302, + "rms": 0.3148302435874939, + "max_abs": 9.25 + }, + "full_input": { + "shape": [ + 75, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b51a298f07bd9958903daa3afc3da9c0a342db2d9093a783ac1b2162b2a29989", + "mean": -0.008675841614603996, + "std": 8.06763744354248, + "rms": 8.067642211914062, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "19bcf25dc101b4d35e521c7d413104894d2236678375fa5d4b449ff99d06a03e", + "mean": -0.004755876027047634, + "std": 0.31224140524864197, + "rms": 0.312277615070343, + "max_abs": 9.125 + }, + "full_input": { + "shape": [ + 59, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ca3bb8e4377f96a09d4b8abb090317da86de067d06b4cd8af1d14fe188140973", + "mean": -0.009272558614611626, + "std": 9.104994773864746, + "rms": 9.104999542236328, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0bf01f1b8860cdbc6ff500e649d0d7ef9db74f77df91887cc657d52ea192714b", + "mean": -0.004748670384287834, + "std": 0.31134068965911865, + "rms": 0.3113768696784973, + "max_abs": 9.375 + }, + "full_input": { + "shape": [ + 75, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3454ba1d02a745a25c860eca7d8228862dd56bba7ea4fdac7c717e1e67666a37", + "mean": -0.008420203812420368, + "std": 8.067525863647461, + "rms": 8.067530632019043, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "07863e74cc0d8d7a5eb07462e6c216b4632ac359dcebb2a21c55d26111d19483", + "mean": -0.004875189624726772, + "std": 0.31207045912742615, + "rms": 0.3121085464954376, + "max_abs": 9.0625 + }, + "full_input": { + "shape": [ + 59, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8907bcc57ff20afac1c2e355c2b786333d92948f8c59edc57ab4b107e78cdd59", + "mean": -0.009343230165541172, + "std": 9.104992866516113, + "rms": 9.104997634887695, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "43fbdb35bdd1bbc5136c86474f40b89f48ab6ad5aa8d77283c5fe8c8742ef4bb", + "mean": -0.004904182627797127, + "std": 0.31095337867736816, + "rms": 0.310992032289505, + "max_abs": 9.375 + }, + "full_input": { + "shape": [ + 75, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "eb7d13982413534d65d656cfd53935ab87001be4b9223d9cedbd29902b78c873", + "mean": -0.008465374819934368, + "std": 8.067512512207031, + "rms": 8.067516326904297, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9980969429016113, + "min_cosine_similarity": 0.9927186965942383, + "mean_relative_l2": 0.057850778102874756, + "max_abs_delta": 0.21875 + }, + "system_bos": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9961943626403809, + "min_cosine_similarity": 0.9837839007377625, + "mean_relative_l2": 0.08265633136034012, + "max_abs_delta": 0.34375 + }, + "system_x": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9935915470123291, + "min_cosine_similarity": 0.9775209426879883, + "mean_relative_l2": 0.10847773402929306, + "max_abs_delta": 0.5 + }, + "system_period": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9922743439674377, + "min_cosine_similarity": 0.9710114002227783, + "mean_relative_l2": 0.11772526055574417, + "max_abs_delta": 0.5625 + }, + "bos_at_s0": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9928753972053528, + "min_cosine_similarity": 0.9740456938743591, + "mean_relative_l2": 0.11578723043203354, + "max_abs_delta": 0.46875 + }, + "bos_at_s1": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9918457269668579, + "min_cosine_similarity": 0.9759605526924133, + "mean_relative_l2": 0.12430388480424881, + "max_abs_delta": 0.46875 + }, + "x_at_s0": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9911542534828186, + "min_cosine_similarity": 0.963625431060791, + "mean_relative_l2": 0.12820640206336975, + "max_abs_delta": 0.71875 + }, + "x_at_s1": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9873281121253967, + "min_cosine_similarity": 0.9509682655334473, + "mean_relative_l2": 0.15293067693710327, + "max_abs_delta": 1.0625 + }, + "period_at_s0": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9913121461868286, + "min_cosine_similarity": 0.9672443270683289, + "mean_relative_l2": 0.12666906416416168, + "max_abs_delta": 0.6875 + }, + "period_at_s1": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9865913391113281, + "min_cosine_similarity": 0.9474040269851685, + "mean_relative_l2": 0.15664079785346985, + "max_abs_delta": 0.9375 + } + } + }, + "layer_09": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c5bdfe7ff1c1620f93779f29f139d8e6f1ef282585b5e92431c5dc645799cbac", + "mean": -0.004241647198796272, + "std": 0.37404248118400574, + "rms": 0.3740665316581726, + "max_abs": 12.125 + }, + "full_input": { + "shape": [ + 59, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6fcdb628ffc0a9a3cf4c0152c8eeb9b5e0ca3b6f9d99d9b6af6610e0fbc21c5d", + "mean": -0.027754126116633415, + "std": 10.334456443786621, + "rms": 10.334494590759277, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b456c957d1526600efc54737970865d69b94b9cf6fcec71ee4552fcfeccb110b", + "mean": -0.0040128701366484165, + "std": 0.37420302629470825, + "rms": 0.3742245137691498, + "max_abs": 12.25 + }, + "full_input": { + "shape": [ + 75, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1ac563da0d8e89cd18265b845ef08853a1fc5978d199970fc09f4e7c22dd40c6", + "mean": -0.026407701894640923, + "std": 9.443778038024902, + "rms": 9.443814277648926, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4f5a1a2a04ec81c48cb3fff7f9874540c4c8bd880b1f09b754639184c2151ee2", + "mean": -0.004392986185848713, + "std": 0.3785061240196228, + "rms": 0.3785316050052643, + "max_abs": 12.375 + }, + "full_input": { + "shape": [ + 59, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b88d513c1ffa94617a00f6d5a6c68e544993df9157094b81dd016545048e76cb", + "mean": -0.008762601763010025, + "std": 9.107771873474121, + "rms": 9.107775688171387, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a37bed2c25d81f7f60ebdbb4d9420fd0f95e27a665bb790a57613c469ca2b598", + "mean": -0.004332780838012695, + "std": 0.37931028008461, + "rms": 0.3793350160121918, + "max_abs": 12.4375 + }, + "full_input": { + "shape": [ + 75, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "036c4cfefc7e5f2fcbb31997b0f2a0c73ba1bfaff0a413de4fa54d19907513fd", + "mean": -0.009060676209628582, + "std": 8.070396423339844, + "rms": 8.070401191711426, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "dcc4bfae62179d3c77672b98cc6d6411b1c9b8f5bc6546e935f60999727a2e37", + "mean": -0.004298294894397259, + "std": 0.3758322596549988, + "rms": 0.37585684657096863, + "max_abs": 12.375 + }, + "full_input": { + "shape": [ + 59, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d40495979dd073da6cae4138f5b35ec44925395154bab738aece4656c3bb0d26", + "mean": -0.00866632629185915, + "std": 9.107651710510254, + "rms": 9.107656478881836, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a2be3d1f1861f9430a14822c37f1e522839b322f42285ef67356ec0442ea8d7e", + "mean": -0.004000827204436064, + "std": 0.3726869523525238, + "rms": 0.37270843982696533, + "max_abs": 12.5 + }, + "full_input": { + "shape": [ + 75, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "39467f603f60dbcc146791ea1cb87f27f20d08c061b93b8e1acbd915881a526c", + "mean": -0.008873858489096165, + "std": 8.070185661315918, + "rms": 8.0701904296875, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f2f28a84670a3c63c7ef3474b540e0af4d83fe068c04033546c7f46b0ff0b98f", + "mean": -0.004432642832398415, + "std": 0.375605970621109, + "rms": 0.3756321370601654, + "max_abs": 12.3125 + }, + "full_input": { + "shape": [ + 59, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "866d7710075f9ab632e704058ca70e68a812afec659e30fde99bcec6425a6435", + "mean": -0.008556081913411617, + "std": 9.107613563537598, + "rms": 9.107617378234863, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d6cdfc003a25cabd6ea62dbc629b53a5aaf01ad217aedbabcc2d6e1cb19c5d50", + "mean": -0.004092145711183548, + "std": 0.3718206584453583, + "rms": 0.3718431890010834, + "max_abs": 12.5 + }, + "full_input": { + "shape": [ + 75, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "926854caa021d0c24b60b17e930f484a58fdd5d4e1e819569138fd94f1bbac7c", + "mean": -0.008754107169806957, + "std": 8.070134162902832, + "rms": 8.070138931274414, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9984824061393738, + "min_cosine_similarity": 0.9948736429214478, + "mean_relative_l2": 0.05176069959998131, + "max_abs_delta": 0.3125 + }, + "system_bos": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9970011115074158, + "min_cosine_similarity": 0.9891690015792847, + "mean_relative_l2": 0.07411354035139084, + "max_abs_delta": 0.375 + }, + "system_x": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9947096705436707, + "min_cosine_similarity": 0.9836769104003906, + "mean_relative_l2": 0.09860660880804062, + "max_abs_delta": 0.5 + }, + "system_period": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9938356876373291, + "min_cosine_similarity": 0.9782934188842773, + "mean_relative_l2": 0.10531787574291229, + "max_abs_delta": 0.5625 + }, + "bos_at_s0": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.994434118270874, + "min_cosine_similarity": 0.9802413582801819, + "mean_relative_l2": 0.1028708815574646, + "max_abs_delta": 0.46875 + }, + "bos_at_s1": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9935043454170227, + "min_cosine_similarity": 0.9792553186416626, + "mean_relative_l2": 0.11166150122880936, + "max_abs_delta": 0.75 + }, + "x_at_s0": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9931424260139465, + "min_cosine_similarity": 0.9722237586975098, + "mean_relative_l2": 0.1128457635641098, + "max_abs_delta": 0.5625 + }, + "x_at_s1": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9896256923675537, + "min_cosine_similarity": 0.963514506816864, + "mean_relative_l2": 0.13790832459926605, + "max_abs_delta": 0.78125 + }, + "period_at_s0": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9932953119277954, + "min_cosine_similarity": 0.974958062171936, + "mean_relative_l2": 0.11133939027786255, + "max_abs_delta": 0.53125 + }, + "period_at_s1": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9895881414413452, + "min_cosine_similarity": 0.9608842134475708, + "mean_relative_l2": 0.13810807466506958, + "max_abs_delta": 0.6875 + } + } + }, + "layer_10": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2b3e6809ab0b1aedafa78bc14f99b6d97bfc462ad5210837fb38d95abd5275ea", + "mean": -0.0010030405828729272, + "std": 0.4110115170478821, + "rms": 0.41101276874542236, + "max_abs": 13.5625 + }, + "full_input": { + "shape": [ + 59, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "053a1145ee1daf3a321c050bbea3de8955d8323d02e83fa096fafcc7c4177be0", + "mean": -0.026570748537778854, + "std": 10.344310760498047, + "rms": 10.344345092773438, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c8e76033bddd4838c195be643ac6a5e037eb040cd33a64fec7db5cd8baef1a6f", + "mean": -0.000885001674760133, + "std": 0.41072604060173035, + "rms": 0.41072699427604675, + "max_abs": 13.625 + }, + "full_input": { + "shape": [ + 75, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "156a6f9a6f84bff9c3d2bc92b73df5773dbd8f1ac19c70da4d735a0bccd15411", + "mean": -0.025844134390354156, + "std": 9.452884674072266, + "rms": 9.452919960021973, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9a934ef16c8194342b33816f25463140062e1c728c98a2eeb0884e51214414ed", + "mean": -0.0008511464111506939, + "std": 0.4150201976299286, + "rms": 0.4150210916996002, + "max_abs": 13.75 + }, + "full_input": { + "shape": [ + 59, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a5f1934c9c9861f75bf76af43f1d646fe7c8ca929c72b685f28788d5eef7e32b", + "mean": -0.007541696075350046, + "std": 9.118437767028809, + "rms": 9.118440628051758, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ccc82808a1900168409b776ba496b55842cf70da9778846d0575eac970b88bea", + "mean": -0.0006447158521041274, + "std": 0.41655975580215454, + "rms": 0.41656026244163513, + "max_abs": 13.875 + }, + "full_input": { + "shape": [ + 75, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "152c78f80ce52e070ccceee71bb6732227ebaca548ca6dfa0588917ee2845955", + "mean": -0.0082541573792696, + "std": 8.08036994934082, + "rms": 8.08037281036377, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "930c5fa467d6275dadcb3081e8761f2be973fe1dfba0bd1a988fda465f58cb8a", + "mean": -0.0008146495674736798, + "std": 0.41386616230010986, + "rms": 0.41386693716049194, + "max_abs": 13.75 + }, + "full_input": { + "shape": [ + 59, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "66008bc696013ac67833fc7ad1ee296d3247100b517bacab028545369eb0d89f", + "mean": -0.007492464035749435, + "std": 9.118331909179688, + "rms": 9.118335723876953, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d667f0d9ee27457b940a1c696e2a880f431df22aa1c8579e53f45f4e9d897be4", + "mean": -0.00029757749871350825, + "std": 0.41220661997795105, + "rms": 0.4122067391872406, + "max_abs": 14.0 + }, + "full_input": { + "shape": [ + 75, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "dbf4d7a8ff8cdfdd7b1aef34ad4f32f411cda23243027e02d5e5997cc09a8c3e", + "mean": -0.00804363377392292, + "std": 8.080154418945312, + "rms": 8.080157279968262, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f73bc111eacb4c5e8ff30a141e304c64065d1d304c2cd4f2311d0fba06a76749", + "mean": -0.0009761698311194777, + "std": 0.4136376976966858, + "rms": 0.4136388599872589, + "max_abs": 13.75 + }, + "full_input": { + "shape": [ + 59, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "317e4bf93e3607954b5b154114dbaa5cfe29d1f7fc15996c57680ada5d287353", + "mean": -0.0073203882202506065, + "std": 9.118284225463867, + "rms": 9.118287086486816, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "16708e21a3076fd4923a36804e30ec4b329f75daaf8997040d8273ef30c0b961", + "mean": -0.00038835383020341396, + "std": 0.41162386536598206, + "rms": 0.41162407398223877, + "max_abs": 14.0 + }, + "full_input": { + "shape": [ + 75, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8a2676d5fb5b5de896671e380cc586f2ccd8407d8434d1ee35825eed8aa104e8", + "mean": -0.007990595884621143, + "std": 8.080118179321289, + "rms": 8.080121994018555, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9982836246490479, + "min_cosine_similarity": 0.9956855177879333, + "mean_relative_l2": 0.05530476197600365, + "max_abs_delta": 0.25 + }, + "system_bos": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.997067391872406, + "min_cosine_similarity": 0.9905393719673157, + "mean_relative_l2": 0.07421499490737915, + "max_abs_delta": 0.4375 + }, + "system_x": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9944368004798889, + "min_cosine_similarity": 0.9839176535606384, + "mean_relative_l2": 0.10143303871154785, + "max_abs_delta": 0.4375 + }, + "system_period": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9937389492988586, + "min_cosine_similarity": 0.9815305471420288, + "mean_relative_l2": 0.1067880317568779, + "max_abs_delta": 0.5 + }, + "bos_at_s0": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.994659423828125, + "min_cosine_similarity": 0.9847186803817749, + "mean_relative_l2": 0.1009017676115036, + "max_abs_delta": 0.375 + }, + "bos_at_s1": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9934661984443665, + "min_cosine_similarity": 0.9817106127738953, + "mean_relative_l2": 0.11289745569229126, + "max_abs_delta": 0.625 + }, + "x_at_s0": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9932320713996887, + "min_cosine_similarity": 0.9751185178756714, + "mean_relative_l2": 0.1122266948223114, + "max_abs_delta": 0.46875 + }, + "x_at_s1": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9892899990081787, + "min_cosine_similarity": 0.9645617008209229, + "mean_relative_l2": 0.1414424031972885, + "max_abs_delta": 0.703125 + }, + "period_at_s0": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9933434724807739, + "min_cosine_similarity": 0.9774229526519775, + "mean_relative_l2": 0.11142684519290924, + "max_abs_delta": 0.375 + }, + "period_at_s1": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.989425539970398, + "min_cosine_similarity": 0.9656805992126465, + "mean_relative_l2": 0.14070236682891846, + "max_abs_delta": 0.71875 + } + } + }, + "layer_11": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c291980c130e935e5e93fd702213d6e7f26e510f929f3dd43b4785f9bec31f8f", + "mean": -0.0027937411796301603, + "std": 0.508080244064331, + "rms": 0.5080879330635071, + "max_abs": 17.75 + }, + "full_input": { + "shape": [ + 59, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "86ed27a6a86d2a2c9d5c06da65e34357d5afa87e68b3e069b3150a657aee35db", + "mean": -0.026834487915039062, + "std": 10.401371002197266, + "rms": 10.401405334472656, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "21bdc96a8aa6eedf7e659cfce862bf590f0fad5a52df8f7722320a439692504b", + "mean": -0.0025139471981674433, + "std": 0.5056242942810059, + "rms": 0.505630612373352, + "max_abs": 17.625 + }, + "full_input": { + "shape": [ + 75, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "06f2cff599e995dcc09e6fd7b2527a5049e867cf212de5295295716ef4ba0320", + "mean": -0.02606796659529209, + "std": 9.504236221313477, + "rms": 9.504271507263184, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0ab41815283c3eee32dcb3cc2f1636d920349eaa3a4799eb66e2caf13c1a50a9", + "mean": -0.002766817342489958, + "std": 0.5111684799194336, + "rms": 0.5111759305000305, + "max_abs": 17.875 + }, + "full_input": { + "shape": [ + 59, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "48769ddb340501c752c04bc7adc0e7facd28d8b71590573dfdbd88653eb18ed0", + "mean": -0.007742200046777725, + "std": 9.165424346923828, + "rms": 9.165428161621094, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e34e5ad1b8bf95f72a0f51780c1e99d5f6b8b5afd3319d956649d3146e90c37b", + "mean": -0.0025804704055190086, + "std": 0.5115406513214111, + "rms": 0.5115470886230469, + "max_abs": 17.75 + }, + "full_input": { + "shape": [ + 75, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1377d248434518e3143124f8ae9c8ddcc29a58e884c1e5c7f415f31e50e877d2", + "mean": -0.008509264327585697, + "std": 8.122851371765137, + "rms": 8.122856140136719, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "66fa1805465b1e38aaf943d975698abbfe232cf6b91eb80329b4f4c179cd800a", + "mean": -0.002594245597720146, + "std": 0.5120227932929993, + "rms": 0.5120294094085693, + "max_abs": 18.0 + }, + "full_input": { + "shape": [ + 59, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ba1c9b838ee2f466f92a8ba1c30e7ce19b90c98389a5e9a748506cdfd8cde62a", + "mean": -0.007515888195484877, + "std": 9.165404319763184, + "rms": 9.165407180786133, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6a5cca635035d95ae88fb22aff5d3644e91339c7e15f85544e4a4dca0b5d266c", + "mean": -0.0021863961592316628, + "std": 0.5065966248512268, + "rms": 0.5066013336181641, + "max_abs": 17.75 + }, + "full_input": { + "shape": [ + 75, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "de0f77a07d2a6e135ec34b92bf19b94190537196a31d555b8fb248f7ff96bdb7", + "mean": -0.008162383921444416, + "std": 8.122536659240723, + "rms": 8.122540473937988, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "967bb54f309f59417cd43d384d07a1abc11a8f76939fac76a5e4839749c909e6", + "mean": -0.002900193678215146, + "std": 0.5100580453872681, + "rms": 0.5100662708282471, + "max_abs": 18.0 + }, + "full_input": { + "shape": [ + 59, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a9857e935d40c8ff132a3707ab57413e4d85e74972da69b6970dc3c728d8ca77", + "mean": -0.0074562500230968, + "std": 9.165266990661621, + "rms": 9.16526985168457, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1318ff362382071a2e676811a84815ebdfbdbc224b00dd1521aaf597e3f2027a", + "mean": -0.002430850639939308, + "std": 0.5059337019920349, + "rms": 0.5059395432472229, + "max_abs": 17.75 + }, + "full_input": { + "shape": [ + 75, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "dd769b50ccbb29e9682c369422a8891045bec615c2b445c7d3b55bb4fa98c13c", + "mean": -0.008118238300085068, + "std": 8.122485160827637, + "rms": 8.122488975524902, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9981896877288818, + "min_cosine_similarity": 0.9939916729927063, + "mean_relative_l2": 0.05662758648395538, + "max_abs_delta": 0.5 + }, + "system_bos": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9969688653945923, + "min_cosine_similarity": 0.9896401166915894, + "mean_relative_l2": 0.07396384328603745, + "max_abs_delta": 0.5 + }, + "system_x": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9950593113899231, + "min_cosine_similarity": 0.9876103401184082, + "mean_relative_l2": 0.09713175892829895, + "max_abs_delta": 1.3125 + }, + "system_period": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9944039583206177, + "min_cosine_similarity": 0.9866201281547546, + "mean_relative_l2": 0.10280252248048782, + "max_abs_delta": 0.8125 + }, + "bos_at_s0": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9952520728111267, + "min_cosine_similarity": 0.9865683317184448, + "mean_relative_l2": 0.09426330775022507, + "max_abs_delta": 0.6875 + }, + "bos_at_s1": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9944005012512207, + "min_cosine_similarity": 0.9858142137527466, + "mean_relative_l2": 0.10364960134029388, + "max_abs_delta": 0.875 + }, + "x_at_s0": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9938143491744995, + "min_cosine_similarity": 0.9799987077713013, + "mean_relative_l2": 0.10768213123083115, + "max_abs_delta": 0.875 + }, + "x_at_s1": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.990347683429718, + "min_cosine_similarity": 0.9737013578414917, + "mean_relative_l2": 0.13529938459396362, + "max_abs_delta": 1.125 + }, + "period_at_s0": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9938181638717651, + "min_cosine_similarity": 0.9815607070922852, + "mean_relative_l2": 0.10723128914833069, + "max_abs_delta": 0.875 + }, + "period_at_s1": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9904268980026245, + "min_cosine_similarity": 0.9769155383110046, + "mean_relative_l2": 0.13520589470863342, + "max_abs_delta": 1.0 + } + } + }, + "layer_12": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a20e985188bc266cd4e8cb72ea457ac6cfcb50470190396495642d129d76bc39", + "mean": -0.0030118708964437246, + "std": 0.5131739974021912, + "rms": 0.5131828188896179, + "max_abs": 16.0 + }, + "full_input": { + "shape": [ + 59, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8fab4845d04b5162074ae54c21536538f543830e7c4acae751a6ebf106ba6ad0", + "mean": -0.028148237615823746, + "std": 10.472914695739746, + "rms": 10.472952842712402, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "541cf1f2ca6acbf95677f234d07ddab5ba6c90528f35aebe8c2ce859e80f65c7", + "mean": -0.002706763567402959, + "std": 0.5112770795822144, + "rms": 0.5112842917442322, + "max_abs": 15.875 + }, + "full_input": { + "shape": [ + 75, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7a095ef019b04eec679034af1ca6b36b3125bb968917ef6dd3641eb89587fedb", + "mean": -0.026548177003860474, + "std": 9.573064804077148, + "rms": 9.573101997375488, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "edd7d7767773d5b28b6926871ca196a296537ca0d2c73721fc84c798d117ee71", + "mean": -0.0030365879647433758, + "std": 0.5154193639755249, + "rms": 0.5154282450675964, + "max_abs": 15.8125 + }, + "full_input": { + "shape": [ + 59, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "41a1abfeed7744957e4249cce75229bd719d9caf1ca981ca2fb696fef6ede595", + "mean": -0.008733753114938736, + "std": 9.180683135986328, + "rms": 9.18068790435791, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "002a6d5fb7469d8aabf04a386cc7cd6f940051b884c4e27024191d81db345b7e", + "mean": -0.002631161594763398, + "std": 0.5165523886680603, + "rms": 0.5165590643882751, + "max_abs": 16.125 + }, + "full_input": { + "shape": [ + 75, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3b1852f0e9f84e7e7ea3ab4cf35b84ea0ed7303788e8f0566beeb1b311b8d458", + "mean": -0.008870669640600681, + "std": 8.137368202209473, + "rms": 8.137373924255371, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f8e3e8f9412a3aa2d1e0c5849aa1efd75791af726afcb3044eb61095e968fbce", + "mean": -0.002742363139986992, + "std": 0.5161011815071106, + "rms": 0.5161084532737732, + "max_abs": 15.875 + }, + "full_input": { + "shape": [ + 59, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "872c7a81eb6b3ad34cd911a697d4dd2b6e300a05fdeb1588cf5d4b5c1a216a0e", + "mean": -0.008781475946307182, + "std": 9.18062686920166, + "rms": 9.180631637573242, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4c976da3cc5b763219253ff10824f686f91d51a4b3241b6e621d7ce8f7055deb", + "mean": -0.0022428149823099375, + "std": 0.5098303556442261, + "rms": 0.5098352432250977, + "max_abs": 15.875 + }, + "full_input": { + "shape": [ + 75, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c7e09631fad0e02e49f4101b0a7e76b4a754e30d9e96e3bb120041b8931a6061", + "mean": -0.008675336837768555, + "std": 8.136856079101562, + "rms": 8.136860847473145, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2b5e87169860ac5cfcb5f6b0f401b282dec7f22a68c7743898b7dc229d04890b", + "mean": -0.003089039120823145, + "std": 0.5149728655815125, + "rms": 0.5149821043014526, + "max_abs": 16.0 + }, + "full_input": { + "shape": [ + 59, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f034a3a8dc75e7220977967ede68bdb137a113f7f667c91baf05ccdb73acddf9", + "mean": -0.008541815914213657, + "std": 9.180506706237793, + "rms": 9.180510520935059, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e05fe66caff3c5f43cc86b998d1c2d19df9d89fe799ea068b9c30ab9dfc51ac3", + "mean": -0.002532268175855279, + "std": 0.5104109048843384, + "rms": 0.5104172229766846, + "max_abs": 16.0 + }, + "full_input": { + "shape": [ + 75, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7415a0f64a7d8a92ae8f9fd51ba746715d6fc1436154072ef3ac8a0efd57edc1", + "mean": -0.008442671038210392, + "std": 8.136892318725586, + "rms": 8.136897087097168, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9978177547454834, + "min_cosine_similarity": 0.9893097877502441, + "mean_relative_l2": 0.06163505092263222, + "max_abs_delta": 0.3125 + }, + "system_bos": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9964767694473267, + "min_cosine_similarity": 0.9891130328178406, + "mean_relative_l2": 0.08036073297262192, + "max_abs_delta": 0.6875 + }, + "system_x": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9943475127220154, + "min_cosine_similarity": 0.9860014915466309, + "mean_relative_l2": 0.10300655663013458, + "max_abs_delta": 1.0 + }, + "system_period": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.99378901720047, + "min_cosine_similarity": 0.9844805598258972, + "mean_relative_l2": 0.10783383250236511, + "max_abs_delta": 0.84375 + }, + "bos_at_s0": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9943795204162598, + "min_cosine_similarity": 0.9822877049446106, + "mean_relative_l2": 0.10224582254886627, + "max_abs_delta": 0.625 + }, + "bos_at_s1": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9937488436698914, + "min_cosine_similarity": 0.9838364124298096, + "mean_relative_l2": 0.10932768136262894, + "max_abs_delta": 1.0625 + }, + "x_at_s0": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9930599331855774, + "min_cosine_similarity": 0.9764297604560852, + "mean_relative_l2": 0.11449581384658813, + "max_abs_delta": 0.8125 + }, + "x_at_s1": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9891891479492188, + "min_cosine_similarity": 0.9715345501899719, + "mean_relative_l2": 0.14323440194129944, + "max_abs_delta": 1.1875 + }, + "period_at_s0": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9928780794143677, + "min_cosine_similarity": 0.9788905382156372, + "mean_relative_l2": 0.1155511885881424, + "max_abs_delta": 0.9375 + }, + "period_at_s1": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9892789125442505, + "min_cosine_similarity": 0.9744575023651123, + "mean_relative_l2": 0.14316894114017487, + "max_abs_delta": 1.0625 + } + } + }, + "layer_13": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1a89bd311cce82815ee9b459e8b6d4a4be9705000984a1e9cd90332edf537e11", + "mean": -0.0028060211334377527, + "std": 0.5269836783409119, + "rms": 0.5269911885261536, + "max_abs": 16.625 + }, + "full_input": { + "shape": [ + 59, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6df6f4a7720c9c899fcf7e66db2dccbbd4aeb932465d231795fb6d6b11c003cf", + "mean": -0.02818068489432335, + "std": 10.480976104736328, + "rms": 10.481014251708984, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c98cbe78a88aeb2c03c15dd158fc77bb44cc644cebb54ac1ced05a54befbb4c1", + "mean": -0.002670214045792818, + "std": 0.5250962376594543, + "rms": 0.5251030325889587, + "max_abs": 16.625 + }, + "full_input": { + "shape": [ + 75, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f0da67710cc0a0283f5771e568c3ae5e5675be7e77aa1701cbb3007b781c960a", + "mean": -0.027529194951057434, + "std": 9.58108901977539, + "rms": 9.58112907409668, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8dee3f4125a3d607c53b828b6615d063b2c2338145a40a59f496bc6ebb0f16df", + "mean": -0.002793261781334877, + "std": 0.5300933718681335, + "rms": 0.5301007032394409, + "max_abs": 16.875 + }, + "full_input": { + "shape": [ + 59, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "949a9d69237f24951e06554e28f538f19ba1189cb34ce97543251b0bf9093857", + "mean": -0.008740606717765331, + "std": 9.187719345092773, + "rms": 9.187723159790039, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "40fbeff04e90eb0b87b64f73d4df3038f4251c5d8d4202063c260c9c30ff8ff4", + "mean": -0.002264532959088683, + "std": 0.5306766033172607, + "rms": 0.5306814312934875, + "max_abs": 16.75 + }, + "full_input": { + "shape": [ + 75, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "21a0959898387c55158a09518e6485bdb46f84df875828049825efa4bd960776", + "mean": -0.009612800553441048, + "std": 8.144579887390137, + "rms": 8.144585609436035, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2a2aa6026827140dc0428c286383bcf48e855afeea892664f2eb2c06efdbb747", + "mean": -0.0026132205966860056, + "std": 0.5304563641548157, + "rms": 0.5304628014564514, + "max_abs": 17.125 + }, + "full_input": { + "shape": [ + 59, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a27c8d133fdb37b1473a1b8a174850dc83aa6d62523213e850ac87bf039c3177", + "mean": -0.008966682478785515, + "std": 9.187729835510254, + "rms": 9.187734603881836, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "51e21a163da1fbd4d852f44720715175a9af9804282a092692c94b1ceb9ea54c", + "mean": -0.0019792162347584963, + "std": 0.5239116549491882, + "rms": 0.5239154100418091, + "max_abs": 17.0 + }, + "full_input": { + "shape": [ + 75, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "400477598556ad903d2aa06e7b74e9bf1a288790ed818b207065900dd642e194", + "mean": -0.009511271491646767, + "std": 8.14408016204834, + "rms": 8.144085884094238, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2ac480a4a91a32776719c3990321a4ed51f7208d9cb38768dc03eaeff8ea4faa", + "mean": -0.0029125979635864496, + "std": 0.5289930105209351, + "rms": 0.5290010571479797, + "max_abs": 17.0 + }, + "full_input": { + "shape": [ + 59, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "85ebbe985ccb3f69320d98841f3f3bf7fc25cd9569161a01e038ef9150dd379d", + "mean": -0.00861113891005516, + "std": 9.187556266784668, + "rms": 9.18756103515625, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "dc66c59c3fff210f5a01ea977afc4356a8ba95db059db93769d32188f1372a93", + "mean": -0.0020825278479605913, + "std": 0.5249003767967224, + "rms": 0.5249044895172119, + "max_abs": 17.0 + }, + "full_input": { + "shape": [ + 75, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "96a94424385993c56dbb7c9f9286771e06bd3911106e7df886d139ecd36af0e7", + "mean": -0.009269731119275093, + "std": 8.144125938415527, + "rms": 8.144131660461426, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9976628422737122, + "min_cosine_similarity": 0.9883567094802856, + "mean_relative_l2": 0.0642232671380043, + "max_abs_delta": 0.375 + }, + "system_bos": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9963766932487488, + "min_cosine_similarity": 0.988747239112854, + "mean_relative_l2": 0.08199387788772583, + "max_abs_delta": 0.625 + }, + "system_x": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9939637780189514, + "min_cosine_similarity": 0.9855190515518188, + "mean_relative_l2": 0.10642465204000473, + "max_abs_delta": 1.0 + }, + "system_period": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9935629367828369, + "min_cosine_similarity": 0.9839699268341064, + "mean_relative_l2": 0.10996507853269577, + "max_abs_delta": 0.9375 + }, + "bos_at_s0": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9942426085472107, + "min_cosine_similarity": 0.9827455282211304, + "mean_relative_l2": 0.10368411242961884, + "max_abs_delta": 0.5 + }, + "bos_at_s1": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9938037991523743, + "min_cosine_similarity": 0.9845386743545532, + "mean_relative_l2": 0.10935582965612411, + "max_abs_delta": 1.1875 + }, + "x_at_s0": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9928627014160156, + "min_cosine_similarity": 0.9765955209732056, + "mean_relative_l2": 0.11645585298538208, + "max_abs_delta": 1.0 + }, + "x_at_s1": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9890565276145935, + "min_cosine_similarity": 0.9697156548500061, + "mean_relative_l2": 0.14440284669399261, + "max_abs_delta": 1.4375 + }, + "period_at_s0": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.992806613445282, + "min_cosine_similarity": 0.9796339273452759, + "mean_relative_l2": 0.11693426221609116, + "max_abs_delta": 1.125 + }, + "period_at_s1": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9891732335090637, + "min_cosine_similarity": 0.973363995552063, + "mean_relative_l2": 0.14442798495292664, + "max_abs_delta": 1.25 + } + } + }, + "layer_14": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a59f968e89966adccf2b60b5f36894260882c1fb7fa3d1a1153121302d27fbb9", + "mean": -0.0011673766421154141, + "std": 0.5930827856063843, + "rms": 0.5930839776992798, + "max_abs": 20.375 + }, + "full_input": { + "shape": [ + 59, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5aa3fee811c723271e5a12d4ba5d38b3ad156cb6808377306405e1d806812ade", + "mean": -0.026059510186314583, + "std": 10.502137184143066, + "rms": 10.502169609069824, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "26dcc9f93ee5880bbb7bbb0ba9571fcaf8949149c0720c34b3f8755c13721475", + "mean": -0.0013185511343181133, + "std": 0.5910687446594238, + "rms": 0.5910701751708984, + "max_abs": 20.25 + }, + "full_input": { + "shape": [ + 75, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "19d796538606b660bde28fdf97cbc7ff473c2845f41b90466e43b5825f998f8f", + "mean": -0.026369251310825348, + "std": 9.599952697753906, + "rms": 9.59998893737793, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d455a88ff0258359d3b785b825abe387f602bac44b9d585636d80c61b48639c9", + "mean": -0.0011490394826978445, + "std": 0.5963249802589417, + "rms": 0.5963261127471924, + "max_abs": 20.5 + }, + "full_input": { + "shape": [ + 59, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e68c69108868c41ea627dfcd76370e7a03411176524299925922a20aab934ed1", + "mean": -0.006696806289255619, + "std": 9.210640907287598, + "rms": 9.21064281463623, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "17b7c885f20570f7f76acb0fbac3cbdb6c936e9b326d1bf7fd3c56a5b77dfb25", + "mean": -0.000853961450047791, + "std": 0.5968469381332397, + "rms": 0.5968475937843323, + "max_abs": 20.375 + }, + "full_input": { + "shape": [ + 75, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8b7f5be0e9a94247c1100ea2db4325077c1e7690ccc94a7eb531c2f1d6ba07d6", + "mean": -0.008328900672495365, + "std": 8.165617942810059, + "rms": 8.165621757507324, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "399970005e90e00bd9936ebc900062b03ad68808f7d3b659413dbf9de10748f5", + "mean": -0.0012738542864099145, + "std": 0.5964689254760742, + "rms": 0.596470296382904, + "max_abs": 21.0 + }, + "full_input": { + "shape": [ + 59, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b4d4020495203ff6ed933dfd45526b41c23646100f41ac02e4b14146545bca8d", + "mean": -0.007070282939821482, + "std": 9.21069049835205, + "rms": 9.210693359375, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "84f78ef493bd3d6f61d7bc664402fa5eb2631a33c6a51579d61d092c1788848b", + "mean": -0.0011774179292842746, + "std": 0.5893797278404236, + "rms": 0.5893809199333191, + "max_abs": 20.75 + }, + "full_input": { + "shape": [ + 75, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d095f4f83a9063b6d26c8b1054eaf0bd9e3d4d617ac9563de093840ce1b9eb17", + "mean": -0.008647119626402855, + "std": 8.16511058807373, + "rms": 8.165114402770996, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7a3bad1e5c9cc67c9db97d4167823eea7cf8f1d105212e77520cf3d40c150df5", + "mean": -0.0014839619398117065, + "std": 0.595741331577301, + "rms": 0.5957431793212891, + "max_abs": 20.75 + }, + "full_input": { + "shape": [ + 59, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "260fd0f1df375458837a04ccad3034573045f1c8f9ec9fe00e46b3ebe45bb675", + "mean": -0.006646216381341219, + "std": 9.2105073928833, + "rms": 9.210509300231934, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "294972bf0fb53f4634013b65cd293e4db05c9e7927d031c23e36db146e199a93", + "mean": -0.0010403048945590854, + "std": 0.5898354053497314, + "rms": 0.5898362994194031, + "max_abs": 20.625 + }, + "full_input": { + "shape": [ + 75, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "96b35647413a76d7cf44f42101cca6576a2eaf2de2f634f44f92b0d33362e963", + "mean": -0.008377821184694767, + "std": 8.165074348449707, + "rms": 8.165078163146973, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9975762367248535, + "min_cosine_similarity": 0.9886776208877563, + "mean_relative_l2": 0.06532852351665497, + "max_abs_delta": 0.4375 + }, + "system_bos": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9964770078659058, + "min_cosine_similarity": 0.9897259473800659, + "mean_relative_l2": 0.08109334856271744, + "max_abs_delta": 0.5625 + }, + "system_x": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9935324192047119, + "min_cosine_similarity": 0.9816420078277588, + "mean_relative_l2": 0.11009502410888672, + "max_abs_delta": 1.5 + }, + "system_period": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9929754734039307, + "min_cosine_similarity": 0.9812744855880737, + "mean_relative_l2": 0.1147545650601387, + "max_abs_delta": 1.25 + }, + "bos_at_s0": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9945728182792664, + "min_cosine_similarity": 0.9825838804244995, + "mean_relative_l2": 0.10072042793035507, + "max_abs_delta": 0.53125 + }, + "bos_at_s1": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9939552545547485, + "min_cosine_similarity": 0.9836022853851318, + "mean_relative_l2": 0.10846930742263794, + "max_abs_delta": 1.125 + }, + "x_at_s0": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.993328332901001, + "min_cosine_similarity": 0.9737521409988403, + "mean_relative_l2": 0.11186901479959488, + "max_abs_delta": 0.875 + }, + "x_at_s1": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.989279568195343, + "min_cosine_similarity": 0.968368649482727, + "mean_relative_l2": 0.14244525134563446, + "max_abs_delta": 1.3125 + }, + "period_at_s0": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9934065341949463, + "min_cosine_similarity": 0.9772742986679077, + "mean_relative_l2": 0.11149509996175766, + "max_abs_delta": 1.0625 + }, + "period_at_s1": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9893947839736938, + "min_cosine_similarity": 0.9717507362365723, + "mean_relative_l2": 0.14232242107391357, + "max_abs_delta": 1.5 + } + } + }, + "layer_15": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1ea0dcae3aeadc401ee1db7a14709e5b94bdaf2db656d8fd2c32bbfff695b6e6", + "mean": -0.005509066395461559, + "std": 0.6506134271621704, + "rms": 0.6506367325782776, + "max_abs": 23.5 + }, + "full_input": { + "shape": [ + 59, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0f70853e5c8e5e4d59ada871573b82e66938266f9277fabd77c20b5fd73d7435", + "mean": -0.0278409905731678, + "std": 10.510294914245605, + "rms": 10.510332107543945, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f890b28fab6247c4a597ef198a3b43e9265b72f640a39d8a6e13937bcd748959", + "mean": -0.005533111281692982, + "std": 0.6479902863502502, + "rms": 0.6480138897895813, + "max_abs": 23.25 + }, + "full_input": { + "shape": [ + 75, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a3ebcabaf99b9fa6e01318085168e0d9e1f065093af149dbfeab46badceb9655", + "mean": -0.028090301901102066, + "std": 9.608683586120605, + "rms": 9.608725547790527, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e418402367d46a3bd8555bf2543d35aab2940c154b2390993322712b5034082a", + "mean": -0.005426932591944933, + "std": 0.653691828250885, + "rms": 0.6537143588066101, + "max_abs": 23.25 + }, + "full_input": { + "shape": [ + 59, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b2dd9e797120e62f044bb7042c3ea3ddaf647e7e90bf56b0ff59dde5614900c1", + "mean": -0.008422170765697956, + "std": 9.219059944152832, + "rms": 9.219063758850098, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9a8095a2242c69355700b1ffc5922f3e8fb650d1a705df12b62f6e958cc5894b", + "mean": -0.005038795061409473, + "std": 0.6534487009048462, + "rms": 0.653468132019043, + "max_abs": 23.125 + }, + "full_input": { + "shape": [ + 75, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1b3db2eb14ec0a444dca6ed49e313a6fce3937e86cc39bb708f77bcfe8d6b3fb", + "mean": -0.010113930329680443, + "std": 8.174827575683594, + "rms": 8.174834251403809, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "dffaa6d45a6dcd6a50cebeb4ad431b1571ba6f2a121d2ffdc64e0dbd08333bc9", + "mean": -0.00573638966307044, + "std": 0.6541681885719299, + "rms": 0.6541933417320251, + "max_abs": 24.0 + }, + "full_input": { + "shape": [ + 59, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fc329a0641e3a884c5048652d62b097bc2667d6cd3b3b1341a19f9dacbe9420c", + "mean": -0.008720624260604382, + "std": 9.219078063964844, + "rms": 9.219082832336426, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1c6b073308b2c2bfb0ca24e0784ccfd23177bec1dc674c3bbac25dcc9a72a9a4", + "mean": -0.0057626329362392426, + "std": 0.6458688974380493, + "rms": 0.6458945870399475, + "max_abs": 23.25 + }, + "full_input": { + "shape": [ + 75, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a8d2eb9099ce18c99108263cf7b2e8755d32c83df98e8b42aaf83bf613b5915c", + "mean": -0.010535091161727905, + "std": 8.17419147491455, + "rms": 8.174199104309082, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ae2c6e2634b4bef6a39fb2b9af3cdd1c793084b8e6f20f8c375ec68e35f78410", + "mean": -0.00587838189676404, + "std": 0.6533935070037842, + "rms": 0.6534199118614197, + "max_abs": 23.875 + }, + "full_input": { + "shape": [ + 59, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9c0f0cc54192a998e1835cc59014958e757f8a7010c46236520cb79d99f9fe07", + "mean": -0.008244042284786701, + "std": 9.218889236450195, + "rms": 9.218893051147461, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "623a8098034871ecab5ab673e0ddeec07a0e2c33103e29e4de54ee0ccdc8ee20", + "mean": -0.005574058275669813, + "std": 0.646551787853241, + "rms": 0.6465758085250854, + "max_abs": 23.25 + }, + "full_input": { + "shape": [ + 75, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "52e32d0c1c77613aae2d5ce0fce015144bd74b56215dbcef10ac21fd4aff2870", + "mean": -0.010162437334656715, + "std": 8.174213409423828, + "rms": 8.174220085144043, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9976236820220947, + "min_cosine_similarity": 0.9902725219726562, + "mean_relative_l2": 0.06548324972391129, + "max_abs_delta": 0.5 + }, + "system_bos": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.996541440486908, + "min_cosine_similarity": 0.9893771409988403, + "mean_relative_l2": 0.08041910827159882, + "max_abs_delta": 0.625 + }, + "system_x": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9929434657096863, + "min_cosine_similarity": 0.9820661544799805, + "mean_relative_l2": 0.11557089537382126, + "max_abs_delta": 1.625 + }, + "system_period": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9924435615539551, + "min_cosine_similarity": 0.9807791709899902, + "mean_relative_l2": 0.11962782591581345, + "max_abs_delta": 1.625 + }, + "bos_at_s0": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9948674440383911, + "min_cosine_similarity": 0.9854388236999512, + "mean_relative_l2": 0.09802782535552979, + "max_abs_delta": 0.625 + }, + "bos_at_s1": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9943090081214905, + "min_cosine_similarity": 0.985916256904602, + "mean_relative_l2": 0.10536579042673111, + "max_abs_delta": 1.375 + }, + "x_at_s0": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9935347437858582, + "min_cosine_similarity": 0.9769850969314575, + "mean_relative_l2": 0.10993994772434235, + "max_abs_delta": 0.9375 + }, + "x_at_s1": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9895085692405701, + "min_cosine_similarity": 0.9679499864578247, + "mean_relative_l2": 0.14119945466518402, + "max_abs_delta": 1.625 + }, + "period_at_s0": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9937361478805542, + "min_cosine_similarity": 0.9801278710365295, + "mean_relative_l2": 0.10850996524095535, + "max_abs_delta": 0.8125 + }, + "period_at_s1": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9896283745765686, + "min_cosine_similarity": 0.9734719395637512, + "mean_relative_l2": 0.14118331670761108, + "max_abs_delta": 1.75 + } + } + }, + "layer_16": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4c57f10c2127b4597b37cfa241429ed05857342c4cbfeeda347272ab365b7b6b", + "mean": -0.005660584196448326, + "std": 0.7200601696968079, + "rms": 0.7200824022293091, + "max_abs": 25.125 + }, + "full_input": { + "shape": [ + 59, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1a257eb8f2dd1089f2918b9c00a2ec21e0efccef3d8fba152d95031bad48da3e", + "mean": -0.02834111638367176, + "std": 10.520013809204102, + "rms": 10.520051956176758, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7d49feab4dfabfc7dd1108ebe04553a2fcffa5c77b5cf52c86db076ab8f66167", + "mean": -0.005954301916062832, + "std": 0.7193055748939514, + "rms": 0.7193301916122437, + "max_abs": 25.0 + }, + "full_input": { + "shape": [ + 75, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9056eeb389dfe7356d16a3b9774d9dc52a639978e0a5671d340a3dde8b517751", + "mean": -0.0279100202023983, + "std": 9.618546485900879, + "rms": 9.618587493896484, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cf5b762ac657f8f527ccc8e066f5049dfe6a8c473dd346cf493faf72ada3a0d7", + "mean": -0.005812415387481451, + "std": 0.7222023606300354, + "rms": 0.7222256660461426, + "max_abs": 24.625 + }, + "full_input": { + "shape": [ + 59, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5322c5d205aa17bbdccd1f78f723bb1697cc7745076a8cd241812bfae9dd9eea", + "mean": -0.008874522522091866, + "std": 9.228679656982422, + "rms": 9.228684425354004, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "66fe0f4920bac03e1795f11d0ba3ffcea3e22fa25a99b9591a66eabb4947edcb", + "mean": -0.005478786304593086, + "std": 0.7235578894615173, + "rms": 0.7235786318778992, + "max_abs": 24.75 + }, + "full_input": { + "shape": [ + 75, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d50ca919d910bfe0850d51ba9b67b510842c44def28b7f5c51f3c24399000aba", + "mean": -0.009806237183511257, + "std": 8.185275077819824, + "rms": 8.185280799865723, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bdd683297a8be6c5da3e619e31e21e97ad67ea9a3b946bfc2414a993df8c356d", + "mean": -0.006120956037193537, + "std": 0.7236741185188293, + "rms": 0.7236999869346619, + "max_abs": 25.625 + }, + "full_input": { + "shape": [ + 59, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "dfc124d45e9564c3c22df8d02454e37161aa063a89fa514effd0908e83b0af64", + "mean": -0.009315531700849533, + "std": 9.228901863098145, + "rms": 9.228906631469727, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d8d4e0145d26a91406dd31d19013933b85fc6eece9ef1eac292eeb2cd533c85d", + "mean": -0.006294069346040487, + "std": 0.7190656661987305, + "rms": 0.7190932035446167, + "max_abs": 25.0 + }, + "full_input": { + "shape": [ + 75, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f17013c45442213b55c7a6325ad97deac654b624bf57ba2a810b2609c0f77ad5", + "mean": -0.010356455110013485, + "std": 8.184834480285645, + "rms": 8.18484115600586, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "85a02964b8bd3aec2767186b53e465acebb8553930984671bece766993257b8a", + "mean": -0.006297711282968521, + "std": 0.7225291132926941, + "rms": 0.7225565910339355, + "max_abs": 25.5 + }, + "full_input": { + "shape": [ + 59, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "23ec0fe2302135b8ea9a7f7f0a1510195ffd27c781b4cdf16e941f3c8121b83c", + "mean": -0.008814896456897259, + "std": 9.228534698486328, + "rms": 9.228538513183594, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6bc0c805c978af407271da9171f041912b755fd04d8808ddb623333b77344403", + "mean": -0.00627515884116292, + "std": 0.7203852534294128, + "rms": 0.72041255235672, + "max_abs": 24.875 + }, + "full_input": { + "shape": [ + 75, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "16dd47f955fdf65c37cc39009ac4465c2803bcd48f78fb7b3608e074a8a61b06", + "mean": -0.009849193505942822, + "std": 8.184699058532715, + "rms": 8.18470573425293, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9976152777671814, + "min_cosine_similarity": 0.9902976751327515, + "mean_relative_l2": 0.06556453555822372, + "max_abs_delta": 0.5 + }, + "system_bos": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9965144991874695, + "min_cosine_similarity": 0.9903027415275574, + "mean_relative_l2": 0.08024867624044418, + "max_abs_delta": 0.6875 + }, + "system_x": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.992856502532959, + "min_cosine_similarity": 0.9809586405754089, + "mean_relative_l2": 0.11565658450126648, + "max_abs_delta": 1.625 + }, + "system_period": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9922086000442505, + "min_cosine_similarity": 0.9796756505966187, + "mean_relative_l2": 0.120685875415802, + "max_abs_delta": 1.5 + }, + "bos_at_s0": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9950487613677979, + "min_cosine_similarity": 0.9861565828323364, + "mean_relative_l2": 0.09643962979316711, + "max_abs_delta": 0.625 + }, + "bos_at_s1": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9945246577262878, + "min_cosine_similarity": 0.9852131605148315, + "mean_relative_l2": 0.10274392366409302, + "max_abs_delta": 1.1875 + }, + "x_at_s0": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.993740975856781, + "min_cosine_similarity": 0.9771565198898315, + "mean_relative_l2": 0.10808908194303513, + "max_abs_delta": 1.0625 + }, + "x_at_s1": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9897723197937012, + "min_cosine_similarity": 0.9668198823928833, + "mean_relative_l2": 0.13911044597625732, + "max_abs_delta": 2.0625 + }, + "period_at_s0": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.993912398815155, + "min_cosine_similarity": 0.9811943769454956, + "mean_relative_l2": 0.10680903494358063, + "max_abs_delta": 0.9375 + }, + "period_at_s1": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9898114800453186, + "min_cosine_similarity": 0.972596287727356, + "mean_relative_l2": 0.1394938975572586, + "max_abs_delta": 1.625 + } + } + }, + "layer_17": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "00c8080b72b080929f2b1f63c86946cf37d7ddc3cd57c6f561b724143e74c04d", + "mean": -0.008965997956693172, + "std": 0.8445484042167664, + "rms": 0.8445959687232971, + "max_abs": 30.0 + }, + "full_input": { + "shape": [ + 59, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "41efb7bd2eb89166e64880515c9ad2290770e1c3a6e4047975dbb0231d9a2008", + "mean": -0.03084847703576088, + "std": 10.533262252807617, + "rms": 10.533307075500488, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "13802a2060963fccea14bcf52c1966cd7d81ef2ae97fd3e28ceaa5c4d7a158b8", + "mean": -0.009091006591916084, + "std": 0.8428412675857544, + "rms": 0.8428902626037598, + "max_abs": 29.875 + }, + "full_input": { + "shape": [ + 75, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6a229d67ca0c8dfa19b07a2847a94879a044450d0bd590dfc3a22e10a6c2ed7d", + "mean": -0.031015770509839058, + "std": 9.632506370544434, + "rms": 9.632556915283203, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3a2751248bcd033b9d1e8b58dc93f2455ea628e89f507b5d73f9cf330a0fd628", + "mean": -0.009012216702103615, + "std": 0.8463213443756104, + "rms": 0.8463693261146545, + "max_abs": 30.0 + }, + "full_input": { + "shape": [ + 59, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "09bd3468ce966dbe05dff43cbe5bfed4f572663bbe32629acc3e2372f3aeb308", + "mean": -0.011363516561686993, + "std": 9.2428617477417, + "rms": 9.24286937713623, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fabc18833046c7f408b4860f05c88006273351894bc32e8b3d27d91cbd423079", + "mean": -0.008582329377532005, + "std": 0.8466930389404297, + "rms": 0.8467365503311157, + "max_abs": 30.125 + }, + "full_input": { + "shape": [ + 75, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8349a2721cd0e90467b3914257fd5be80d8f9b1189a186fa33f19db50b1e5dff", + "mean": -0.01307150349020958, + "std": 8.20094108581543, + "rms": 8.20095157623291, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d0eafd7dd160b24f44afbb61bf33d85fbef05956847fe5a3743057eab082e812", + "mean": -0.00940489862114191, + "std": 0.847364068031311, + "rms": 0.8474162817001343, + "max_abs": 30.625 + }, + "full_input": { + "shape": [ + 59, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0f6b96cfceb94879b103fcf43a7fe1ed781a06df766d4dde4ddaa02901ac97ff", + "mean": -0.011964257806539536, + "std": 9.243138313293457, + "rms": 9.243144989013672, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "691b803185a9b6caa58f990a316938008f38ed14e90f07fc5efedf3ae111a6d6", + "mean": -0.009255762211978436, + "std": 0.842257022857666, + "rms": 0.8423079252243042, + "max_abs": 30.375 + }, + "full_input": { + "shape": [ + 75, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c9e0f5f1179dec7ed387eecd9a6bbcf534b8cefdeadfdf6908b6800c5f0b1390", + "mean": -0.013634031638503075, + "std": 8.200408935546875, + "rms": 8.200420379638672, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9d59a2fabd72c22017971d0f4f1f58bab2b3c687d0e2d9e496d2b6e5e0c1dc14", + "mean": -0.009527498856186867, + "std": 0.846125602722168, + "rms": 0.8461792469024658, + "max_abs": 30.625 + }, + "full_input": { + "shape": [ + 59, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f2a8a12113fedb135f70a601e1da5c92a91068f86a503bb33c8c3405d442a62b", + "mean": -0.011427812278270721, + "std": 9.24262809753418, + "rms": 9.242635726928711, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f5d58a0633042879d0ecdea41f4c43c8dd44125ca3b224002fd4af75593a470e", + "mean": -0.009043058380484581, + "std": 0.8429640531539917, + "rms": 0.8430125713348389, + "max_abs": 30.25 + }, + "full_input": { + "shape": [ + 75, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0b5d2143f5acc56447db1c3e792ebc8aed70bcef9ae465ed1d4625aa79809777", + "mean": -0.012891767546534538, + "std": 8.200295448303223, + "rms": 8.200304985046387, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9975808262825012, + "min_cosine_similarity": 0.9896199703216553, + "mean_relative_l2": 0.06530062854290009, + "max_abs_delta": 0.5 + }, + "system_bos": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9965527653694153, + "min_cosine_similarity": 0.9895138740539551, + "mean_relative_l2": 0.07919228821992874, + "max_abs_delta": 0.6875 + }, + "system_x": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9927816987037659, + "min_cosine_similarity": 0.9776839017868042, + "mean_relative_l2": 0.11424709111452103, + "max_abs_delta": 1.625 + }, + "system_period": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.992132842540741, + "min_cosine_similarity": 0.9760698080062866, + "mean_relative_l2": 0.11951665580272675, + "max_abs_delta": 1.5 + }, + "bos_at_s0": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9954140782356262, + "min_cosine_similarity": 0.9866839647293091, + "mean_relative_l2": 0.09227965772151947, + "max_abs_delta": 0.75 + }, + "bos_at_s1": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9948141574859619, + "min_cosine_similarity": 0.9841681718826294, + "mean_relative_l2": 0.0989614948630333, + "max_abs_delta": 1.375 + }, + "x_at_s0": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9939286708831787, + "min_cosine_similarity": 0.9773656129837036, + "mean_relative_l2": 0.10567305237054825, + "max_abs_delta": 1.0 + }, + "x_at_s1": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.989856481552124, + "min_cosine_similarity": 0.9658656716346741, + "mean_relative_l2": 0.13661827147006989, + "max_abs_delta": 1.875 + }, + "period_at_s0": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9941926002502441, + "min_cosine_similarity": 0.9811125993728638, + "mean_relative_l2": 0.10345344245433807, + "max_abs_delta": 0.875 + }, + "period_at_s1": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9900599122047424, + "min_cosine_similarity": 0.9711130857467651, + "mean_relative_l2": 0.13562828302383423, + "max_abs_delta": 1.625 + } + } + }, + "layer_18": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0d2c8b68ee2fbc617d549a59609a0d78c06728930adfc5d12e344349c040fa11", + "mean": -0.012661226093769073, + "std": 0.9538359045982361, + "rms": 0.9539198875427246, + "max_abs": 31.25 + }, + "full_input": { + "shape": [ + 59, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "391fa545caea557622e5dd5166b1a103f2437ca06ec221d69cb458e42b9adc7a", + "mean": -0.03284921124577522, + "std": 10.551084518432617, + "rms": 10.551136016845703, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4ed8c00e8ccdf6ed55c4076db985ab62fd06a3d77f38629a1e761719539ad8ef", + "mean": -0.012868527323007584, + "std": 0.952407956123352, + "rms": 0.9524948596954346, + "max_abs": 30.875 + }, + "full_input": { + "shape": [ + 75, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e4748afb05aa76ce42425e59329ed652c8a6c949d2692f344f43ee02b6e1e2c9", + "mean": -0.032362714409828186, + "std": 9.651054382324219, + "rms": 9.651108741760254, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b5c9d8cb7180efa4a7dc84f77fb813dff00d68f6d2906f098702264668e04674", + "mean": -0.012927745468914509, + "std": 0.9554269909858704, + "rms": 0.9555144309997559, + "max_abs": 31.0 + }, + "full_input": { + "shape": [ + 59, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5a01680f847ac5ff8fab12c2790cba1884d4eb7da02c1c642e4553cd49d99174", + "mean": -0.01347709447145462, + "std": 9.259522438049316, + "rms": 9.25953197479248, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7665697378ee9b009037bf7f188a5e6a276c139dd9d3b381149ec2e10f784f48", + "mean": -0.012574725784361362, + "std": 0.9562917947769165, + "rms": 0.95637446641922, + "max_abs": 30.625 + }, + "full_input": { + "shape": [ + 75, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1885f2399c6927f2ef8fb96ad58863fd47212c70e3e242d314b59eced59a5fed", + "mean": -0.01441772747784853, + "std": 8.21937370300293, + "rms": 8.219386100769043, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b167d8f6c5b5e323ddefaf126831d7d31c4ab75e4062988c962e26c58d31c40d", + "mean": -0.01340919453650713, + "std": 0.9576787948608398, + "rms": 0.9577726125717163, + "max_abs": 31.875 + }, + "full_input": { + "shape": [ + 59, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3683dbeb31b83b19bf99a63b664386d54958c7bbeacc541e8aa53d12789e1654", + "mean": -0.014208415523171425, + "std": 9.259942054748535, + "rms": 9.259952545166016, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "45a67e210f0bcee3738b2c6eadbfc5ef4c1cf20fc1ff044c3a3f46f5eea54eac", + "mean": -0.01330089196562767, + "std": 0.9522479772567749, + "rms": 0.952340841293335, + "max_abs": 30.875 + }, + "full_input": { + "shape": [ + 75, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2ad3ac0139e30a57b88a58201e5f604490fa11e353ddd11ff4f8156dbcd4bfe7", + "mean": -0.015061452053487301, + "std": 8.219032287597656, + "rms": 8.219046592712402, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "56f1797a94878806e38e271ff1135d86fda9a66201929f63301739a781d76488", + "mean": -0.013613015413284302, + "std": 0.9574756622314453, + "rms": 0.9575724601745605, + "max_abs": 31.875 + }, + "full_input": { + "shape": [ + 59, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0ab97ab1106cb0fceab227893413c310f3b93c6b562e023a3d00b64d399a3070", + "mean": -0.013710994273424149, + "std": 9.259498596191406, + "rms": 9.259509086608887, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "de80cfccb096f63cf9dbd37c5d196610e82eab2bc830f8cafb400583269cbfc1", + "mean": -0.013285499066114426, + "std": 0.9522344470024109, + "rms": 0.9523271322250366, + "max_abs": 30.625 + }, + "full_input": { + "shape": [ + 75, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "10ebb642d2f19105e5d704947aadcf313c8e8ee936ef838e3f4fbb2764994f98", + "mean": -0.014408331364393234, + "std": 8.218548774719238, + "rms": 8.218560218811035, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9976251125335693, + "min_cosine_similarity": 0.9904477596282959, + "mean_relative_l2": 0.06503280997276306, + "max_abs_delta": 1.125 + }, + "system_bos": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9968338012695312, + "min_cosine_similarity": 0.9891648292541504, + "mean_relative_l2": 0.07596352696418762, + "max_abs_delta": 0.75 + }, + "system_x": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9931061863899231, + "min_cosine_similarity": 0.9772073030471802, + "mean_relative_l2": 0.11214615404605865, + "max_abs_delta": 1.875 + }, + "system_period": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9924566745758057, + "min_cosine_similarity": 0.9775213003158569, + "mean_relative_l2": 0.11768838763237, + "max_abs_delta": 1.875 + }, + "bos_at_s0": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9958789944648743, + "min_cosine_similarity": 0.9876019358634949, + "mean_relative_l2": 0.087517149746418, + "max_abs_delta": 1.0 + }, + "bos_at_s1": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9951803684234619, + "min_cosine_similarity": 0.9834613800048828, + "mean_relative_l2": 0.09491994976997375, + "max_abs_delta": 1.5 + }, + "x_at_s0": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9944794774055481, + "min_cosine_similarity": 0.9779962301254272, + "mean_relative_l2": 0.10061739385128021, + "max_abs_delta": 1.25 + }, + "x_at_s1": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9905357360839844, + "min_cosine_similarity": 0.9657207131385803, + "mean_relative_l2": 0.13181011378765106, + "max_abs_delta": 1.875 + }, + "period_at_s0": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.994754433631897, + "min_cosine_similarity": 0.9820815324783325, + "mean_relative_l2": 0.09840291738510132, + "max_abs_delta": 1.25 + }, + "period_at_s1": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9907375574111938, + "min_cosine_similarity": 0.9700459241867065, + "mean_relative_l2": 0.13085460662841797, + "max_abs_delta": 1.875 + } + } + }, + "layer_19": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5292de0db38ba9a310f2ec6c9acb582d408158e57b633af6e2f483d333861202", + "mean": -0.015653356909751892, + "std": 1.0296900272369385, + "rms": 1.0298089981079102, + "max_abs": 28.875 + }, + "full_input": { + "shape": [ + 59, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5a626ff62804dec98d279062990712767d615d90b6fbb255752aa22de0199bc9", + "mean": -0.03371116518974304, + "std": 10.555863380432129, + "rms": 10.555917739868164, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b700813905ad3a3a5915580973fdf6462a64b44e54883884e1a8ef843e16cdd5", + "mean": -0.01545118261128664, + "std": 1.027576208114624, + "rms": 1.027692437171936, + "max_abs": 29.125 + }, + "full_input": { + "shape": [ + 75, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "02bc6e25b758350a5410ae28ad55c86a89323991dcb8e38b463c40331d163688", + "mean": -0.032161060720682144, + "std": 9.658270835876465, + "rms": 9.6583251953125, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ee38977e75449b5da6e487dc98c7d2cdb0e76d14bcf57f9465f67809688ec672", + "mean": -0.016036078333854675, + "std": 1.0304899215698242, + "rms": 1.0306146144866943, + "max_abs": 28.875 + }, + "full_input": { + "shape": [ + 59, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "177e9d86ae562de2e7b476021690bde6bd8a26b075e2c762d6ef06ec506161bb", + "mean": -0.014773883856832981, + "std": 9.265264511108398, + "rms": 9.265275955200195, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2c13e48319bd4064de73f80b4a6d70af0e6970a041e9d48fca213fd20d29ad73", + "mean": -0.015960486605763435, + "std": 1.0322102308273315, + "rms": 1.0323336124420166, + "max_abs": 28.875 + }, + "full_input": { + "shape": [ + 75, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e30dcc231ddadc5e40c874bc28d556dc25eaea95d921fb58bb1422ac217794ec", + "mean": -0.014621633104979992, + "std": 8.227751731872559, + "rms": 8.227765083312988, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7bc6b2e4bf1655d5377017c337a33a1ffc34ed016cc1e7d6f16dae9d8c355c15", + "mean": -0.016299791634082794, + "std": 1.0317527055740356, + "rms": 1.0318814516067505, + "max_abs": 29.25 + }, + "full_input": { + "shape": [ + 59, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3dd816069460374afe85ba4d7920a277474ecd75169a8af33c8e5fa0a59a3eab", + "mean": -0.015272976830601692, + "std": 9.266035079956055, + "rms": 9.266047477722168, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1c06128386186bc7cdf58a6bf2a8ffa44461498d3412f429e051ca6081e50777", + "mean": -0.016499551013112068, + "std": 1.0278050899505615, + "rms": 1.027937412261963, + "max_abs": 28.75 + }, + "full_input": { + "shape": [ + 75, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c9ff00afccf74dcccb3be05b1c7bf4d54bdfa9d078ae5a6e5f4c231534ff6900", + "mean": -0.01483607105910778, + "std": 8.227335929870605, + "rms": 8.227350234985352, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "339d9e2099fe8e976c8f1219dfc3dadf88e8952b7f6208127cf9ec1d8bf2d181", + "mean": -0.016652638092637062, + "std": 1.0321913957595825, + "rms": 1.0323257446289062, + "max_abs": 29.0 + }, + "full_input": { + "shape": [ + 59, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b905051c0c862ba3eb1f579e2869beb787c119c5a9dde44c96dd6b2a85ac3fc4", + "mean": -0.014989744871854782, + "std": 9.265390396118164, + "rms": 9.265402793884277, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "82be336afe61597cee00edf0d3fbadce94aca207e35c2c8642f37bc6ab1fd484", + "mean": -0.016436632722616196, + "std": 1.028007984161377, + "rms": 1.028139352798462, + "max_abs": 28.375 + }, + "full_input": { + "shape": [ + 75, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5e0648d4fdcb0390e8b04483b36aee1be3ecc5e557c33ed45811e77ea851d2b3", + "mean": -0.0145227937027812, + "std": 8.226971626281738, + "rms": 8.226984024047852, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.99725341796875, + "min_cosine_similarity": 0.9861462116241455, + "mean_relative_l2": 0.06898335367441177, + "max_abs_delta": 1.375 + }, + "system_bos": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9965999722480774, + "min_cosine_similarity": 0.9890118837356567, + "mean_relative_l2": 0.07881168276071548, + "max_abs_delta": 0.875 + }, + "system_x": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.992821991443634, + "min_cosine_similarity": 0.9744018316268921, + "mean_relative_l2": 0.11474228650331497, + "max_abs_delta": 1.265625 + }, + "system_period": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9922484159469604, + "min_cosine_similarity": 0.9770833253860474, + "mean_relative_l2": 0.12009197473526001, + "max_abs_delta": 1.5625 + }, + "bos_at_s0": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9958192110061646, + "min_cosine_similarity": 0.9875075817108154, + "mean_relative_l2": 0.08841963857412338, + "max_abs_delta": 1.0 + }, + "bos_at_s1": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9949053525924683, + "min_cosine_similarity": 0.9817473292350769, + "mean_relative_l2": 0.09715543687343597, + "max_abs_delta": 1.25 + }, + "x_at_s0": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.994357168674469, + "min_cosine_similarity": 0.9799885153770447, + "mean_relative_l2": 0.10225750505924225, + "max_abs_delta": 1.125 + }, + "x_at_s1": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.98985356092453, + "min_cosine_similarity": 0.9550143480300903, + "mean_relative_l2": 0.1357044279575348, + "max_abs_delta": 1.875 + }, + "period_at_s0": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9947347044944763, + "min_cosine_similarity": 0.9840195178985596, + "mean_relative_l2": 0.09896868467330933, + "max_abs_delta": 1.5 + }, + "period_at_s1": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9900925755500793, + "min_cosine_similarity": 0.9528598785400391, + "mean_relative_l2": 0.13450701534748077, + "max_abs_delta": 1.875 + } + } + }, + "layer_20": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9dd569cd2ed83cc867171611330c9325b2e5b43f8a0c55af04b349afaec18603", + "mean": -0.016970526427030563, + "std": 1.1989033222198486, + "rms": 1.1990234851837158, + "max_abs": 35.5 + }, + "full_input": { + "shape": [ + 59, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8dc7b7f5ebf05a32933a79bc73bdfdddfecc9e69790797a07c78f4acb76f4a54", + "mean": -0.03458797559142113, + "std": 10.888517379760742, + "rms": 10.888571739196777, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f00bad12f3946448864c9ff03193a81920f4ce3eba65a708432df3f1d095b2e1", + "mean": -0.016857625916600227, + "std": 1.1979635953903198, + "rms": 1.1980822086334229, + "max_abs": 35.5 + }, + "full_input": { + "shape": [ + 75, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b5e16bd883a8779be13c692bebf9d7e43efe28c45afd15cc0a0a44867fd8baaf", + "mean": -0.03280681371688843, + "std": 9.97718334197998, + "rms": 9.9772367477417, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8faf0c3ffb351f59beae5b7e11601dbb47bb520e55adee8251bf500a1b65ccd2", + "mean": -0.016975056380033493, + "std": 1.1970901489257812, + "rms": 1.1972105503082275, + "max_abs": 35.5 + }, + "full_input": { + "shape": [ + 59, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bb95db29166e400d41e2440c9341e3ef5edcf8d2c6babf74b3359bb1c7ae1b8f", + "mean": -0.016414692625403404, + "std": 9.285089492797852, + "rms": 9.285103797912598, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "38292cc397df10bdf5945db7172b1bfbf1b0b19b3b7d53e7e0c4aca6155790b3", + "mean": -0.016719192266464233, + "std": 1.199958324432373, + "rms": 1.2000747919082642, + "max_abs": 36.25 + }, + "full_input": { + "shape": [ + 75, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8f90d066d012ab5eabbad5f0da8ecd2033b51a569053197870c9e52871f33b24", + "mean": -0.01580101251602173, + "std": 8.251114845275879, + "rms": 8.251130104064941, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c5c983fd6fc35d7d6bdc461299691fd84423739350e0b853b34a6856c398ae14", + "mean": -0.017550086602568626, + "std": 1.1996259689331055, + "rms": 1.1997543573379517, + "max_abs": 36.25 + }, + "full_input": { + "shape": [ + 59, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e2ace71b612e3eb0b3d41ff6dd01c1d36e8b15b69fe462cd42b5ea73c485ab27", + "mean": -0.017418725416064262, + "std": 9.286306381225586, + "rms": 9.286322593688965, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5e9143d227ff7b016371b19ef7c9678e933b185a7f006cf68bb0792f3ae58d19", + "mean": -0.017201054841279984, + "std": 1.1987452507019043, + "rms": 1.198868751525879, + "max_abs": 36.5 + }, + "full_input": { + "shape": [ + 75, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f1c9621670a443f53d3b23cd95a6ebf25ac13688d169730a6029f1c5526b165f", + "mean": -0.016145482659339905, + "std": 8.251043319702148, + "rms": 8.251058578491211, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bf2750c9076d737a6abf1599db7691b1cd6fd9bc197bba3b1393532413563583", + "mean": -0.01773768663406372, + "std": 1.2009804248809814, + "rms": 1.2011114358901978, + "max_abs": 36.25 + }, + "full_input": { + "shape": [ + 59, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7c55e405062194dde2bb5cb40e601f129765893e5401df666a331a56a815d8cc", + "mean": -0.016884300857782364, + "std": 9.28555965423584, + "rms": 9.285573959350586, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3cf143f855341d58324a5ec6b43dde79c0b10a031986d23b16c7e8e0df48652a", + "mean": -0.01750754937529564, + "std": 1.1982253789901733, + "rms": 1.1983531713485718, + "max_abs": 36.5 + }, + "full_input": { + "shape": [ + 75, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "60d2ea3f2c524a36b830fb8fd7ec68e3597baafa5db8e07e698ea1b7bc989ca0", + "mean": -0.01587681844830513, + "std": 8.25048542022705, + "rms": 8.250500679016113, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9974522590637207, + "min_cosine_similarity": 0.9887522459030151, + "mean_relative_l2": 0.06750034540891647, + "max_abs_delta": 1.5 + }, + "system_bos": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.996737003326416, + "min_cosine_similarity": 0.987766444683075, + "mean_relative_l2": 0.07732683420181274, + "max_abs_delta": 1.375 + }, + "system_x": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9929141998291016, + "min_cosine_similarity": 0.9747622013092041, + "mean_relative_l2": 0.11507432162761688, + "max_abs_delta": 1.375 + }, + "system_period": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9921239018440247, + "min_cosine_similarity": 0.9779016971588135, + "mean_relative_l2": 0.12178641557693481, + "max_abs_delta": 1.71875 + }, + "bos_at_s0": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.996157705783844, + "min_cosine_similarity": 0.9893308877944946, + "mean_relative_l2": 0.08484739065170288, + "max_abs_delta": 1.0 + }, + "bos_at_s1": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9953670501708984, + "min_cosine_similarity": 0.984319806098938, + "mean_relative_l2": 0.0932731032371521, + "max_abs_delta": 1.0 + }, + "x_at_s0": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9948958158493042, + "min_cosine_similarity": 0.9843707084655762, + "mean_relative_l2": 0.0980280265212059, + "max_abs_delta": 1.625 + }, + "x_at_s1": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9903841614723206, + "min_cosine_similarity": 0.9605752825737, + "mean_relative_l2": 0.13365045189857483, + "max_abs_delta": 2.625 + }, + "period_at_s0": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9952911138534546, + "min_cosine_similarity": 0.9877634644508362, + "mean_relative_l2": 0.09436938166618347, + "max_abs_delta": 1.625 + }, + "period_at_s1": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.990454375743866, + "min_cosine_similarity": 0.9589787721633911, + "mean_relative_l2": 0.1333310455083847, + "max_abs_delta": 2.25 + } + } + }, + "layer_21": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d17992b5229db26aef0b9d7988b8bcbcd38171e0c2350833338a954f260b2baf", + "mean": -0.025501100346446037, + "std": 1.2756798267364502, + "rms": 1.2759348154067993, + "max_abs": 44.5 + }, + "full_input": { + "shape": [ + 59, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "eb6fac9aa1818f7861f62a3160788d8e1ffbdd99bad8459cfc920b9f35fe24bc", + "mean": -0.03873341903090477, + "std": 11.000754356384277, + "rms": 11.000823020935059, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6d9a526d52cf6f37a6bdf9f28fb5149645993926d3097fec754588b6d4ded855", + "mean": -0.025569863617420197, + "std": 1.2748589515686035, + "rms": 1.2751153707504272, + "max_abs": 45.0 + }, + "full_input": { + "shape": [ + 75, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e72acba2aa3ca68d53c0cbab1d892f4a41c4d9d86e7e3378c11ebd824e38a141", + "mean": -0.035274747759103775, + "std": 10.07387924194336, + "rms": 10.073941230773926, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9e8b1a575344b2e558c99f7fe042df0bea577f84a64e030a7a697f1b675cb6b9", + "mean": -0.025989262387156487, + "std": 1.2720633745193481, + "rms": 1.2723287343978882, + "max_abs": 44.5 + }, + "full_input": { + "shape": [ + 59, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8363a049a0a50ec5ecf81b9c8c7cc5d2f6905b2fe31c06e16465be1106f01169", + "mean": -0.020635686814785004, + "std": 9.274898529052734, + "rms": 9.274920463562012, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e09f5e513415e24e0d255537ac62212ce736a8f10de30f84ab08d5f386f0f8ad", + "mean": -0.02554742991924286, + "std": 1.2781753540039062, + "rms": 1.278430700302124, + "max_abs": 46.0 + }, + "full_input": { + "shape": [ + 75, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b39bc0ed80ae3b180447b986e0bfaf119d50bc6b74d5987c7c3e5797c99be7c5", + "mean": -0.018297825008630753, + "std": 8.250372886657715, + "rms": 8.25039291381836, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "221cb9f1345b4caa276ef294a3bacb7d7d48e8a34f4fe2c962284f72e951b689", + "mean": -0.027097372338175774, + "std": 1.2808420658111572, + "rms": 1.2811286449432373, + "max_abs": 45.75 + }, + "full_input": { + "shape": [ + 59, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a9461831e8ded62102e4e3a805ed2d8db12e3c7a19cb39ddc9b89564d84f446f", + "mean": -0.02191934920847416, + "std": 9.277128219604492, + "rms": 9.277153015136719, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0edee43ee1ce223ea43b069992f1b380acb87376b5b4977aab70bcc9b0c763ea", + "mean": -0.027094092220067978, + "std": 1.288517951965332, + "rms": 1.2888027429580688, + "max_abs": 47.0 + }, + "full_input": { + "shape": [ + 75, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3072f2f94ca98f46488253460be064008ed35d20a31b233371ee90cde3192632", + "mean": -0.019387228414416313, + "std": 8.251858711242676, + "rms": 8.25188159942627, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "dab9ca68bd981bd085ea98c3f43a68ee4148831b91cf26f870ea031e985aa8cc", + "mean": -0.0273639764636755, + "std": 1.2822785377502441, + "rms": 1.2825706005096436, + "max_abs": 45.5 + }, + "full_input": { + "shape": [ + 59, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fadea9ff00cbb808fa4f047457d4c6b62ff129c09da803d0491a05e10f392c6f", + "mean": -0.021563097834587097, + "std": 9.275693893432617, + "rms": 9.275718688964844, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b2452267d0481fd30fdb4baf7fcca20a2728286e0bbfdd65d3c33f38ebc31f72", + "mean": -0.026976369321346283, + "std": 1.2887133359909058, + "rms": 1.2889955043792725, + "max_abs": 47.0 + }, + "full_input": { + "shape": [ + 75, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "711287b21c0a22c036e548b38c7efcce6288738174333de5ae54129cb63ae12e", + "mean": -0.01867768168449402, + "std": 8.25068473815918, + "rms": 8.25070571899414, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9969065189361572, + "min_cosine_similarity": 0.9843904376029968, + "mean_relative_l2": 0.07457568496465683, + "max_abs_delta": 1.625 + }, + "system_bos": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.996073305606842, + "min_cosine_similarity": 0.983029305934906, + "mean_relative_l2": 0.0851096510887146, + "max_abs_delta": 1.84375 + }, + "system_x": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9906585812568665, + "min_cosine_similarity": 0.9651874899864197, + "mean_relative_l2": 0.13356219232082367, + "max_abs_delta": 2.0 + }, + "system_period": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9897059202194214, + "min_cosine_similarity": 0.9686253070831299, + "mean_relative_l2": 0.14036419987678528, + "max_abs_delta": 2.328125 + }, + "bos_at_s0": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9957454800605774, + "min_cosine_similarity": 0.9895579218864441, + "mean_relative_l2": 0.08973711729049683, + "max_abs_delta": 1.5 + }, + "bos_at_s1": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9948711395263672, + "min_cosine_similarity": 0.9776307344436646, + "mean_relative_l2": 0.09823085367679596, + "max_abs_delta": 1.375 + }, + "x_at_s0": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9942678809165955, + "min_cosine_similarity": 0.9847812056541443, + "mean_relative_l2": 0.10469991713762283, + "max_abs_delta": 2.0 + }, + "x_at_s1": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9883740544319153, + "min_cosine_similarity": 0.9455714225769043, + "mean_relative_l2": 0.14873339235782623, + "max_abs_delta": 2.375 + }, + "period_at_s0": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9947270750999451, + "min_cosine_similarity": 0.9847944974899292, + "mean_relative_l2": 0.10020363330841064, + "max_abs_delta": 1.875 + }, + "period_at_s1": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9880964756011963, + "min_cosine_similarity": 0.9434797167778015, + "mean_relative_l2": 0.15077561140060425, + "max_abs_delta": 2.0 + } + } + }, + "layer_22": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "87df44854976037237c49cf284fe4bb29f40ec4fb062a664566466e12fd75f04", + "mean": -0.032993972301483154, + "std": 1.4761079549789429, + "rms": 1.4764765501022339, + "max_abs": 56.5 + }, + "full_input": { + "shape": [ + 59, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "80a08eebe8b1353ff22c87b3db378053ba86fdd4778c976fb3360714578bb095", + "mean": -0.04271647334098816, + "std": 11.023658752441406, + "rms": 11.023741722106934, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "87dd86b9edc9f1043eee63f231f0a935e56d6b3ee3e01f1ff72edca716c409a5", + "mean": -0.03277580812573433, + "std": 1.4787577390670776, + "rms": 1.4791209697723389, + "max_abs": 56.25 + }, + "full_input": { + "shape": [ + 75, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0101a285f6e13f4c2bb1e56a9b2a5dd78077a88302a08f8b618ad267c9f94102", + "mean": -0.038910962641239166, + "std": 10.10507583618164, + "rms": 10.10515022277832, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7524d733b9d1c67741b1f10b2548d20a1f8195fa63f91d61f64eebc86bbdd218", + "mean": -0.03342101350426674, + "std": 1.4705779552459717, + "rms": 1.4709577560424805, + "max_abs": 56.0 + }, + "full_input": { + "shape": [ + 59, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3d895d085d081187dc8b2d99df697029710201f871c5451f97208b939423dec6", + "mean": -0.024974757805466652, + "std": 9.30235767364502, + "rms": 9.302391052246094, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d7e0d9d148f69869d4d0f1edcc03d9c9b4adffc391df04fb51bb5da7dd83b1a4", + "mean": -0.03282976523041725, + "std": 1.4796417951583862, + "rms": 1.4800059795379639, + "max_abs": 56.25 + }, + "full_input": { + "shape": [ + 75, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "850d47091a739e732ebf5c07d22d4e750998671ce9b98d6407d6bce20785f72e", + "mean": -0.022065451368689537, + "std": 8.288797378540039, + "rms": 8.288825988769531, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "50310ab50cd6e8fb2586477a6c6b3a2c3647fdd595b7f4c4b698d3c259e6f3ba", + "mean": -0.03453446924686432, + "std": 1.4877418279647827, + "rms": 1.488142490386963, + "max_abs": 57.75 + }, + "full_input": { + "shape": [ + 59, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "28fd3e1046b8e88395bd785ab1d1de0d86bd05998b5c5291bda5bf8647ae7804", + "mean": -0.026231961324810982, + "std": 9.305978775024414, + "rms": 9.306015014648438, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7c2599609fe59bf5a785ebd34f6f20eb5d51071fd450db967da2765d337c85ba", + "mean": -0.034487150609493256, + "std": 1.5007092952728271, + "rms": 1.5011054277420044, + "max_abs": 57.5 + }, + "full_input": { + "shape": [ + 75, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "45bbbaee8c42accf2acf44d1414c577a93b681f97930f2567db973420358922f", + "mean": -0.022983938455581665, + "std": 8.29203987121582, + "rms": 8.292071342468262, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "202034c46e9d6b41c55b99e965dc2746a48d68b37e00cb204041669ddfb94034", + "mean": -0.034813325852155685, + "std": 1.4881901741027832, + "rms": 1.4885971546173096, + "max_abs": 57.5 + }, + "full_input": { + "shape": [ + 59, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "718717ea29d02775aa44cd2af866f257b66a94ecfea128c5ec65a6e033e921f0", + "mean": -0.026352476328611374, + "std": 9.304159164428711, + "rms": 9.30419635772705, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f539d451f26078f710427ef100ec319848709e30b2dd337f950cc2795dd7019f", + "mean": -0.03429093584418297, + "std": 1.4988435506820679, + "rms": 1.4992358684539795, + "max_abs": 57.75 + }, + "full_input": { + "shape": [ + 75, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "98c780b3ec5db7813228236b5b44e402e17702c02213e31712af1a60cfb8f77b", + "mean": -0.022319329902529716, + "std": 8.290380477905273, + "rms": 8.290410041809082, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9968631863594055, + "min_cosine_similarity": 0.9801602959632874, + "mean_relative_l2": 0.07452314347028732, + "max_abs_delta": 2.25 + }, + "system_bos": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9961099028587341, + "min_cosine_similarity": 0.9807568788528442, + "mean_relative_l2": 0.08476389199495316, + "max_abs_delta": 1.75 + }, + "system_x": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9904925227165222, + "min_cosine_similarity": 0.9551816582679749, + "mean_relative_l2": 0.1342831254005432, + "max_abs_delta": 3.25 + }, + "system_period": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9895327091217041, + "min_cosine_similarity": 0.9642329812049866, + "mean_relative_l2": 0.14130531251430511, + "max_abs_delta": 3.203125 + }, + "bos_at_s0": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.99598628282547, + "min_cosine_similarity": 0.9896938800811768, + "mean_relative_l2": 0.08728326857089996, + "max_abs_delta": 1.75 + }, + "bos_at_s1": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9949862360954285, + "min_cosine_similarity": 0.97478848695755, + "mean_relative_l2": 0.09665586799383163, + "max_abs_delta": 1.5 + }, + "x_at_s0": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9943726658821106, + "min_cosine_similarity": 0.9846706986427307, + "mean_relative_l2": 0.10387935489416122, + "max_abs_delta": 3.0 + }, + "x_at_s1": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.988305926322937, + "min_cosine_similarity": 0.9347520470619202, + "mean_relative_l2": 0.14917883276939392, + "max_abs_delta": 5.0 + }, + "period_at_s0": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.99488765001297, + "min_cosine_similarity": 0.9841666221618652, + "mean_relative_l2": 0.09901938587427139, + "max_abs_delta": 2.5 + }, + "period_at_s1": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9879925847053528, + "min_cosine_similarity": 0.9376387596130371, + "mean_relative_l2": 0.1514119952917099, + "max_abs_delta": 3.5 + } + } + }, + "layer_23": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c32724a1d68989c30bafc58daaab22c5356b04ff6788b4108c7e85a05f4e5000", + "mean": -0.04847412928938866, + "std": 1.9268862009048462, + "rms": 1.9274958372116089, + "max_abs": 93.0 + }, + "full_input": { + "shape": [ + 59, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "376c0f4ed700f5a98bf2a4c61db870b90adb43926b1d7fd38cc40c8497e0e8b7", + "mean": -0.05179307237267494, + "std": 11.038457870483398, + "rms": 11.038578987121582, + "max_abs": 1160.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "973e429c2b9569230fe2c8ccdbdaf82b4eb1c5fbbc9777b8935a3a473c734408", + "mean": -0.04870352894067764, + "std": 1.9294323921203613, + "rms": 1.9300469160079956, + "max_abs": 94.0 + }, + "full_input": { + "shape": [ + 75, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "52b70881e1f149689a296ef82247086bce6ee626b198edfbe92443d414a66f45", + "mean": -0.044335778802633286, + "std": 10.132768630981445, + "rms": 10.132864952087402, + "max_abs": 1160.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5149af51ab4ad1599d2507ea9ef9b904c269ae617f8e6b87075f4684d155bc25", + "mean": -0.049518879503011703, + "std": 1.9172359704971313, + "rms": 1.9178752899169922, + "max_abs": 91.0 + }, + "full_input": { + "shape": [ + 59, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9b75f23b9b7405f25e2b8ed8a54017de3a2e4596193b9cf651bab1b1a1947bfd", + "mean": -0.03451991826295853, + "std": 9.333517074584961, + "rms": 9.33358097076416, + "max_abs": 1160.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5fa4af32620b86f3c06699490f3cfc0ba8e796f78af8fbb174bebbd24e6472e3", + "mean": -0.04930507764220238, + "std": 1.9269280433654785, + "rms": 1.9275587797164917, + "max_abs": 92.5 + }, + "full_input": { + "shape": [ + 75, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5cc07bee4058057077262d47774c243cb121d82b4c2bb7ffc196daa02e690664", + "mean": -0.027878236025571823, + "std": 8.33896541595459, + "rms": 8.339012145996094, + "max_abs": 1160.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "62e3eeac69f4e8ea0a7966284d80bd85ed535d3802378ef63e53ab91e0a278c2", + "mean": -0.05087027698755264, + "std": 1.9372478723526, + "rms": 1.9379156827926636, + "max_abs": 93.0 + }, + "full_input": { + "shape": [ + 59, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "00f2e77ce35b68ce4cb5f211e3445e053c867aa0707fb5c8bd58c951b152dfa3", + "mean": -0.03556141257286072, + "std": 9.339481353759766, + "rms": 9.33954906463623, + "max_abs": 1160.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "77f492f90aadecb755e5f7fe3c0e2fab586b47c8803ca6c75ca97ef8efab76f1", + "mean": -0.05195408686995506, + "std": 1.9442591667175293, + "rms": 1.9449530839920044, + "max_abs": 94.5 + }, + "full_input": { + "shape": [ + 75, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "58490aa3ab884535d392d03aea23522b3017f7d2086fe51f160dd731472a676a", + "mean": -0.02931760437786579, + "std": 8.343633651733398, + "rms": 8.343684196472168, + "max_abs": 1160.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bb85fbda80b9141946aa429a4d92b2946adda6f243ce17322b217e3cfb60f617", + "mean": -0.05114647001028061, + "std": 1.938780426979065, + "rms": 1.9394550323486328, + "max_abs": 92.5 + }, + "full_input": { + "shape": [ + 59, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8a41439529b5c8f1a8d7d4cfb6e171a7f4e81978bfb62a851252266c79003561", + "mean": -0.03625873103737831, + "std": 9.33635425567627, + "rms": 9.336424827575684, + "max_abs": 1160.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2a31b64ee5ab7ff62339408a58921435f83fc4b6a60c10fd28672420a9fe732f", + "mean": -0.05164770036935806, + "std": 1.941314697265625, + "rms": 1.9420017004013062, + "max_abs": 95.5 + }, + "full_input": { + "shape": [ + 75, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3f99d9ab62e661fd32907632949f44f7e3bb46009cad1c0ce1d2233da2672a30", + "mean": -0.02835775353014469, + "std": 8.34152603149414, + "rms": 8.341573715209961, + "max_abs": 1160.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9972645044326782, + "min_cosine_similarity": 0.9802924990653992, + "mean_relative_l2": 0.06861887872219086, + "max_abs_delta": 3.0 + }, + "system_bos": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9966747164726257, + "min_cosine_similarity": 0.9785248637199402, + "mean_relative_l2": 0.07761189341545105, + "max_abs_delta": 2.75 + }, + "system_x": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.99220871925354, + "min_cosine_similarity": 0.9590465426445007, + "mean_relative_l2": 0.12064169347286224, + "max_abs_delta": 3.5 + }, + "system_period": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9914422035217285, + "min_cosine_similarity": 0.9665086269378662, + "mean_relative_l2": 0.12691561877727509, + "max_abs_delta": 3.2734375 + }, + "bos_at_s0": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9967998266220093, + "min_cosine_similarity": 0.9910078644752502, + "mean_relative_l2": 0.077812559902668, + "max_abs_delta": 2.0 + }, + "bos_at_s1": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.995755672454834, + "min_cosine_similarity": 0.9750486016273499, + "mean_relative_l2": 0.08825355768203735, + "max_abs_delta": 2.5 + }, + "x_at_s0": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9955189824104309, + "min_cosine_similarity": 0.9881315231323242, + "mean_relative_l2": 0.09226284921169281, + "max_abs_delta": 3.5 + }, + "x_at_s1": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9903464317321777, + "min_cosine_similarity": 0.9405840039253235, + "mean_relative_l2": 0.13390015065670013, + "max_abs_delta": 6.0 + }, + "period_at_s0": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9959661960601807, + "min_cosine_similarity": 0.9862896203994751, + "mean_relative_l2": 0.08765950798988342, + "max_abs_delta": 3.25 + }, + "period_at_s1": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9900773167610168, + "min_cosine_similarity": 0.9417746067047119, + "mean_relative_l2": 0.13616624474525452, + "max_abs_delta": 5.0 + } + } + }, + "layer_24": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "95c48cca5c4f97d2fc4ef83d62628d820c14b52a87384df221ae238658504a98", + "mean": -0.0579393245279789, + "std": 2.3724939823150635, + "rms": 2.373201370239258, + "max_abs": 116.0 + }, + "full_input": { + "shape": [ + 59, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a7efabb1593ba39d7c48aedc0b7753e91ae5254a1d5710ff050f38f6a071eedb", + "mean": -0.061046939343214035, + "std": 10.396839141845703, + "rms": 10.397018432617188, + "max_abs": 1008.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "58ae4e11aa9e095ccbac57cbe84f79a98ff1d4aedd4753651856826ad641a693", + "mean": -0.05829540267586708, + "std": 2.3744795322418213, + "rms": 2.375195026397705, + "max_abs": 117.0 + }, + "full_input": { + "shape": [ + 75, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cd300eda7f29fd991ca5a5f6f0d6b1da5b0262e84f7b8c31d7979d0d0c436277", + "mean": -0.051062945276498795, + "std": 9.862052917480469, + "rms": 9.862184524536133, + "max_abs": 1120.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fe7b557926b3ba13fd5059a4e461dcf4d400191e659bde54db5050cbd8d7c8ec", + "mean": -0.059388455003499985, + "std": 2.3608334064483643, + "rms": 2.3615801334381104, + "max_abs": 114.0 + }, + "full_input": { + "shape": [ + 59, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "57c0a87356ab60e03a600ae6fffd547bf6070fe4a318741d2b74f91cd42fcf79", + "mean": -0.041429996490478516, + "std": 6.611939430236816, + "rms": 6.612069606781006, + "max_abs": 840.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7c4e98eaf14186951cf827e2a7d0557be2c3e209a006e33542a35259d4f23b5c", + "mean": -0.05932670459151268, + "std": 2.3720109462738037, + "rms": 2.3727526664733887, + "max_abs": 116.0 + }, + "full_input": { + "shape": [ + 75, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "15a123c8390d3295ae5ceee51b206ef28eb369de8ccb989851d503045442bd4e", + "mean": -0.03264543041586876, + "std": 6.009838581085205, + "rms": 6.009927272796631, + "max_abs": 840.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "15d82d1caed1e19e0d1507b725c8ade442736c8c4d8261d2d157b4b1b7e1abd9", + "mean": -0.06045282632112503, + "std": 2.3865950107574463, + "rms": 2.3873605728149414, + "max_abs": 116.0 + }, + "full_input": { + "shape": [ + 59, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a3a6dbd2f935ee0953bb3bfaf7b1193f0b418437e771d9ddd47038379fc1a0ed", + "mean": -0.04233494773507118, + "std": 6.624149322509766, + "rms": 6.624284744262695, + "max_abs": 840.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f1f423824be3a7f3d640cb95bc55a28c22166722d5e06a68ae3bd6d5c4136118", + "mean": -0.06056961417198181, + "std": 2.3944640159606934, + "rms": 2.3952300548553467, + "max_abs": 118.0 + }, + "full_input": { + "shape": [ + 75, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c115c4120322dc6c36f5dceaea8779a0a91ba6191011673f6683fc9f15a182e2", + "mean": -0.03370298072695732, + "std": 6.019214153289795, + "rms": 6.019309043884277, + "max_abs": 840.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1ee1ad29415ae92e0a18b3aa55154aa7faa68ac58c36c7757f98bfd3628cc023", + "mean": -0.06079994887113571, + "std": 2.3885650634765625, + "rms": 2.389338493347168, + "max_abs": 116.0 + }, + "full_input": { + "shape": [ + 59, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3f273bd608c6a000577c931c13f78bfb7927e360e77bd1fad0f2cb4036be95dd", + "mean": -0.042665038257837296, + "std": 6.619046688079834, + "rms": 6.6191840171813965, + "max_abs": 840.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d93ebc3175b93cdb898a94b9657d2e49707ccab3d3942db0bd4cfd3585ea626e", + "mean": -0.06021639704704285, + "std": 2.3889224529266357, + "rms": 2.389681100845337, + "max_abs": 119.0 + }, + "full_input": { + "shape": [ + 75, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a353c1e38dd7947eaa333614ff3c3f8f1ce688a255be7cfe1b37c7a25732b4e2", + "mean": -0.03267119079828262, + "std": 6.015138626098633, + "rms": 6.015227317810059, + "max_abs": 840.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9977409243583679, + "min_cosine_similarity": 0.9847420454025269, + "mean_relative_l2": 0.06309643387794495, + "max_abs_delta": 4.0 + }, + "system_bos": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9972500801086426, + "min_cosine_similarity": 0.9840584397315979, + "mean_relative_l2": 0.07159990072250366, + "max_abs_delta": 3.5 + }, + "system_x": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9934769868850708, + "min_cosine_similarity": 0.9671108722686768, + "mean_relative_l2": 0.11142506450414658, + "max_abs_delta": 5.0 + }, + "system_period": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9929908514022827, + "min_cosine_similarity": 0.9730281233787537, + "mean_relative_l2": 0.11560824513435364, + "max_abs_delta": 5.0 + }, + "bos_at_s0": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9973501563072205, + "min_cosine_similarity": 0.9929090738296509, + "mean_relative_l2": 0.07109425961971283, + "max_abs_delta": 2.5 + }, + "bos_at_s1": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9965764284133911, + "min_cosine_similarity": 0.9811319708824158, + "mean_relative_l2": 0.08016332983970642, + "max_abs_delta": 2.5 + }, + "x_at_s0": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9962790012359619, + "min_cosine_similarity": 0.9908506274223328, + "mean_relative_l2": 0.08446820080280304, + "max_abs_delta": 4.5 + }, + "x_at_s1": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9920033812522888, + "min_cosine_similarity": 0.9540404677391052, + "mean_relative_l2": 0.12384721636772156, + "max_abs_delta": 10.25 + }, + "period_at_s0": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.996677041053772, + "min_cosine_similarity": 0.9894665479660034, + "mean_relative_l2": 0.08008958399295807, + "max_abs_delta": 4.5 + }, + "period_at_s1": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9919121861457825, + "min_cosine_similarity": 0.9554756283760071, + "mean_relative_l2": 0.12456871569156647, + "max_abs_delta": 8.75 + } + } + }, + "layer_25": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0b30ba3cc045eb6d77ceab3b71db4abe0c4acbd55726d70f07a33372385867de", + "mean": -0.10121431946754456, + "std": 3.2534589767456055, + "rms": 3.255033016204834, + "max_abs": 157.0 + }, + "full_input": { + "shape": [ + 59, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "563bb7fecdc52d941680a1c58d62b31fc61e98faa3a23586592e39eb5f0ce9bf", + "mean": -0.09248077124357224, + "std": 8.060242652893066, + "rms": 8.060772895812988, + "max_abs": 872.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7a0260599ca39afb3c0f0473cb7c4f072105a5167a83759c4912841c957afb29", + "mean": -0.09966611117124557, + "std": 3.2556276321411133, + "rms": 3.257152557373047, + "max_abs": 158.0 + }, + "full_input": { + "shape": [ + 75, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fc877bb0c996841447644b77cb7d144ff149e89151981fdc2478e0a9755dd659", + "mean": -0.07772278785705566, + "std": 7.9338531494140625, + "rms": 7.934233665466309, + "max_abs": 984.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "86f0e6616449bc893f44ce299f835140d4b6c087cd23e521d50c9e76196b75a0", + "mean": -0.1039838120341301, + "std": 3.2364439964294434, + "rms": 3.2381138801574707, + "max_abs": 155.0 + }, + "full_input": { + "shape": [ + 59, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "be4bc5fd1fa9b0ab8d73c39db9310c61933b096626c99a06d08021fc96bbf5b2", + "mean": -0.07240690290927887, + "std": 3.7147738933563232, + "rms": 3.7154793739318848, + "max_abs": 248.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9141602710d0923f16124909a718252c59c2071469be9f3ee5a89783da596694", + "mean": -0.10233043134212494, + "std": 3.254807472229004, + "rms": 3.256415605545044, + "max_abs": 157.0 + }, + "full_input": { + "shape": [ + 75, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b3165f352d5ea9e87ddc7a86254ffa573f8615e1290285cead930161d8e0a1d2", + "mean": -0.059019215404987335, + "std": 3.7238733768463135, + "rms": 3.7243409156799316, + "max_abs": 248.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fcf281e8c37d6b6b6684988f9c152323a789bb87166d951ec36b802876126585", + "mean": -0.10428452491760254, + "std": 3.268864393234253, + "rms": 3.2705276012420654, + "max_abs": 157.0 + }, + "full_input": { + "shape": [ + 59, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "872a901ea412a96fcec6c22d4fece3b0103b37b86a64426e001224870b326fdb", + "mean": -0.07388918101787567, + "std": 3.7558677196502686, + "rms": 3.756594181060791, + "max_abs": 248.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "480b64d79443ba3876d55aecd3f622922862ae77e6c077fe80d79241ff45f56b", + "mean": -0.10162730515003204, + "std": 3.2814619541168213, + "rms": 3.2830352783203125, + "max_abs": 160.0 + }, + "full_input": { + "shape": [ + 75, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "599f10acac8fd8bf683dec04369cd8f499f86234292640872726797229ffde0a", + "mean": -0.05869707837700844, + "std": 3.749718427658081, + "rms": 3.7501778602600098, + "max_abs": 248.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2af87119e35894401f20f9ac14bf56e2e990a3f7ddf8d861f1a38bd5dade9adb", + "mean": -0.10513563454151154, + "std": 3.2779171466827393, + "rms": 3.2796027660369873, + "max_abs": 157.0 + }, + "full_input": { + "shape": [ + 59, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9dc2ed54e890dfb4a4436d82874866996b0d504e9aad92d757f4f8ecc8b64a4c", + "mean": -0.07361411303281784, + "std": 3.7429823875427246, + "rms": 3.743705987930298, + "max_abs": 248.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f3f69ab9aad27b3d41a88245e21fb3b7eae9a9e84a0add3f71fe96a0ebc7e596", + "mean": -0.10133440047502518, + "std": 3.2720086574554443, + "rms": 3.2735774517059326, + "max_abs": 162.0 + }, + "full_input": { + "shape": [ + 75, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9e46e56496ce37a3478d0f85a0995589b5af0752da29d1238ee4875bc44539a7", + "mean": -0.057520076632499695, + "std": 3.7366483211517334, + "rms": 3.737090826034546, + "max_abs": 248.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9984320402145386, + "min_cosine_similarity": 0.9895702004432678, + "mean_relative_l2": 0.05316649377346039, + "max_abs_delta": 6.5 + }, + "system_bos": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9981517791748047, + "min_cosine_similarity": 0.9903092384338379, + "mean_relative_l2": 0.06022324413061142, + "max_abs_delta": 6.0 + }, + "system_x": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9951893091201782, + "min_cosine_similarity": 0.9784078598022461, + "mean_relative_l2": 0.0974956750869751, + "max_abs_delta": 9.5 + }, + "system_period": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9948636293411255, + "min_cosine_similarity": 0.982531726360321, + "mean_relative_l2": 0.100705087184906, + "max_abs_delta": 9.0 + }, + "bos_at_s0": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9982269406318665, + "min_cosine_similarity": 0.9946598410606384, + "mean_relative_l2": 0.05865686759352684, + "max_abs_delta": 4.0 + }, + "bos_at_s1": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.997762143611908, + "min_cosine_similarity": 0.9870917201042175, + "mean_relative_l2": 0.06592193245887756, + "max_abs_delta": 4.5 + }, + "x_at_s0": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9975636601448059, + "min_cosine_similarity": 0.9939901232719421, + "mean_relative_l2": 0.06905907392501831, + "max_abs_delta": 6.0 + }, + "x_at_s1": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9944478273391724, + "min_cosine_similarity": 0.9683874249458313, + "mean_relative_l2": 0.10548093914985657, + "max_abs_delta": 15.5 + }, + "period_at_s0": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9977710843086243, + "min_cosine_similarity": 0.9921391606330872, + "mean_relative_l2": 0.06647302210330963, + "max_abs_delta": 7.5 + }, + "period_at_s1": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9943850040435791, + "min_cosine_similarity": 0.9698483943939209, + "mean_relative_l2": 0.1065812036395073, + "max_abs_delta": 14.5 + } + } + }, + "layer_26": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "890389c73da07704e3ca18871c6adb6fd5e4f6ef14db23a968ee14e714429857", + "mean": -0.15544140338897705, + "std": 3.87125825881958, + "rms": 3.874377489089966, + "max_abs": 204.0 + }, + "full_input": { + "shape": [ + 59, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b52b7568419a8a5a54b7bbfc485a9aaa5256f07d746a08c2093660ce6fd89c23", + "mean": -0.14097312092781067, + "std": 8.294722557067871, + "rms": 8.295920372009277, + "max_abs": 840.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "51a06cef6643f1fa6e1a56c199c720ccbc45b87b484422721d80d797dda0df47", + "mean": -0.14864017069339752, + "std": 3.754577875137329, + "rms": 3.757519006729126, + "max_abs": 198.0 + }, + "full_input": { + "shape": [ + 75, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "61ac41a3a9cfc9bf54caa1cd5da189c44159b04e257c941393fdef6b43ff9795", + "mean": -0.10650884360074997, + "std": 8.188385963439941, + "rms": 8.189079284667969, + "max_abs": 872.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e3652241b883dd86b0736d18893622578de72d5c0e2ba1909d2815a3abb5e04b", + "mean": -0.15698404610157013, + "std": 3.808570384979248, + "rms": 3.8118042945861816, + "max_abs": 204.0 + }, + "full_input": { + "shape": [ + 59, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ea51c08604daeff39bb8b916a8199628525c8800b6bbf8239f204aa0b6728666", + "mean": -0.11649645864963531, + "std": 5.029644012451172, + "rms": 5.0309929847717285, + "max_abs": 772.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "acb212e846ecffab84b9b46c92d6704831b887500455328819a7260afa5789b3", + "mean": -0.14995555579662323, + "std": 3.7133235931396484, + "rms": 3.7163500785827637, + "max_abs": 198.0 + }, + "full_input": { + "shape": [ + 75, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0253f803bfedbeec40517f1984c4592411e5ff1b96c758b86f64e9fd511ed661", + "mean": -0.08492332696914673, + "std": 5.07605504989624, + "rms": 5.076765537261963, + "max_abs": 772.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "768aedbb3c3816b9cc42e0e7c944a49d18866fe464d6f37526ce8abe038d262a", + "mean": -0.15670520067214966, + "std": 3.8603200912475586, + "rms": 3.863499402999878, + "max_abs": 202.0 + }, + "full_input": { + "shape": [ + 59, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9e61dd60cc29d60b0c32dce68bf922a429883f95bf1b368e038ae9f6546e0fae", + "mean": -0.11843090504407883, + "std": 5.080516338348389, + "rms": 5.0818963050842285, + "max_abs": 772.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "669f3ef5f83afd60d479b86476bd789636465a58391e082c0370cfa2fe8ce0dc", + "mean": -0.13945329189300537, + "std": 3.5398807525634766, + "rms": 3.5426266193389893, + "max_abs": 191.0 + }, + "full_input": { + "shape": [ + 75, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "852db51bd9c550d416b83d72cef5617f68fbed914cb840621a7647afe33298c2", + "mean": -0.07873470336198807, + "std": 5.022047519683838, + "rms": 5.022664546966553, + "max_abs": 772.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "20d5e34e1c7684473a1507aee04bd53b1e6c2c4ce719cc60924014ab522cad05", + "mean": -0.15742598474025726, + "std": 3.8468856811523438, + "rms": 3.8501055240631104, + "max_abs": 202.0 + }, + "full_input": { + "shape": [ + 59, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0c7c55cbef466326567fe6d2d0ce875c8aea7b24e4258f91e4fe0131fbbef638", + "mean": -0.1175357848405838, + "std": 5.039973258972168, + "rms": 5.041343688964844, + "max_abs": 772.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ce5c949e142796e0bc38521c0383e72639c8a549a316d7996522571d77a04a14", + "mean": -0.13717561960220337, + "std": 3.4514737129211426, + "rms": 3.4541985988616943, + "max_abs": 186.0 + }, + "full_input": { + "shape": [ + 75, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3795c80b86e77f56bf769ad8168265825f6cf19beb772f93b6a3e403a7205f3a", + "mean": -0.07606497406959534, + "std": 4.968466281890869, + "rms": 4.969048500061035, + "max_abs": 772.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.998074471950531, + "min_cosine_similarity": 0.9888916611671448, + "mean_relative_l2": 0.06676383316516876, + "max_abs_delta": 13.5 + }, + "system_bos": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9977921843528748, + "min_cosine_similarity": 0.989814281463623, + "mean_relative_l2": 0.070353664457798, + "max_abs_delta": 16.5 + }, + "system_x": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.992514431476593, + "min_cosine_similarity": 0.9670565724372864, + "mean_relative_l2": 0.14240333437919617, + "max_abs_delta": 28.0 + }, + "system_period": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9915878176689148, + "min_cosine_similarity": 0.969258725643158, + "mean_relative_l2": 0.1601180136203766, + "max_abs_delta": 35.0 + }, + "bos_at_s0": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9980801939964294, + "min_cosine_similarity": 0.9917859435081482, + "mean_relative_l2": 0.06321855634450912, + "max_abs_delta": 11.0 + }, + "bos_at_s1": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9973434209823608, + "min_cosine_similarity": 0.9824849963188171, + "mean_relative_l2": 0.07223270833492279, + "max_abs_delta": 12.0 + }, + "x_at_s0": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.997626006603241, + "min_cosine_similarity": 0.9916503429412842, + "mean_relative_l2": 0.06945891678333282, + "max_abs_delta": 8.0 + }, + "x_at_s1": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9931398034095764, + "min_cosine_similarity": 0.9720612168312073, + "mean_relative_l2": 0.1283615678548813, + "max_abs_delta": 24.0 + }, + "period_at_s0": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9976977109909058, + "min_cosine_similarity": 0.9932788014411926, + "mean_relative_l2": 0.0674380287528038, + "max_abs_delta": 7.0 + }, + "period_at_s1": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9924728274345398, + "min_cosine_similarity": 0.9731684327125549, + "mean_relative_l2": 0.14478667080402374, + "max_abs_delta": 31.0 + } + } + }, + "final_norm": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a06069c9c7b6488b7feede6c41a655cea1f0cd8277728bca089672b6c684d0a3", + "mean": -0.02780080959200859, + "std": 0.6456193923950195, + "rms": 0.6462176442146301, + "max_abs": 14.6875 + }, + "full_input": { + "shape": [ + 59, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3c72addb90357fbe356a31ebe0b8953d7d34f1c9e88076afe34159fbe0b7568c", + "mean": -0.019587747752666473, + "std": 0.6343023180961609, + "rms": 0.6346046328544617, + "max_abs": 22.5 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "195349e28a9663f7aa0b870cdf47d3ffe188f5cbb6c2bb0c975a532fccbc42f5", + "mean": -0.027582768350839615, + "std": 0.6469045281410217, + "rms": 0.6474923491477966, + "max_abs": 15.0 + }, + "full_input": { + "shape": [ + 75, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6d1331ee7fcc600d00d21a4c44328b3498f80fd317ae574823a035472f9e4186", + "mean": -0.014037221670150757, + "std": 0.6057424545288086, + "rms": 0.6059050559997559, + "max_abs": 22.5 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "45584862b96baa6e98155d2df86dd1e654059b1b75614445c38b719c2cd68ae4", + "mean": -0.02872757986187935, + "std": 0.6532054543495178, + "rms": 0.6538368463516235, + "max_abs": 15.1875 + }, + "full_input": { + "shape": [ + 59, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "897ab0ce26f7ff16409b1dda45aa217199b0d767ade9dec88f1c2a1f04f1f20e", + "mean": -0.019986242055892944, + "std": 0.640404462814331, + "rms": 0.6407161951065063, + "max_abs": 22.375 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "561969f8acc3480b30be77cec8c378045aad3565ea7d4dbad04f51733d0aa23d", + "mean": -0.028454892337322235, + "std": 0.6600576043128967, + "rms": 0.6606706380844116, + "max_abs": 15.75 + }, + "full_input": { + "shape": [ + 75, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d5d4118d41d4829ba9cf447c9ad4830248d4424e190e840eb3a9724bc239a985", + "mean": -0.014449321664869785, + "std": 0.6127038598060608, + "rms": 0.6128742694854736, + "max_abs": 23.625 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a96ab763c7d639836899ad10acb32c567521cf3551cd1f2a78ff72aab4ff270b", + "mean": -0.02802138775587082, + "std": 0.6465038657188416, + "rms": 0.6471108198165894, + "max_abs": 15.0 + }, + "full_input": { + "shape": [ + 59, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "073050d09f7e6a80771cc6b9019245f2ce75ad77c5b78a7fd66a50b543f070c3", + "mean": -0.01972040720283985, + "std": 0.6332840323448181, + "rms": 0.6335910558700562, + "max_abs": 22.5 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bbc43e57d33647657f1b587ad9d3b7000aed57acce3451fd7e3cf1c1cc4ce319", + "mean": -0.027639910578727722, + "std": 0.6530256867408752, + "rms": 0.653610348701477, + "max_abs": 15.1875 + }, + "full_input": { + "shape": [ + 75, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "32b20a0e079115dfcba5fa6d5ec1ca79957e4ed316247b75aea48fe65f9ae652", + "mean": -0.013809039257466793, + "std": 0.6059665679931641, + "rms": 0.6061238646507263, + "max_abs": 21.75 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "832dfc3bc7b0cd66c4ca782b976bccd80f5093bd4c720fbbb7e09549bd343b9a", + "mean": -0.02851659432053566, + "std": 0.654944896697998, + "rms": 0.6555653810501099, + "max_abs": 15.0 + }, + "full_input": { + "shape": [ + 59, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b0cdf15262398a464858fca3bf860f6e1ae88bc1592aaace56558b96830422a9", + "mean": -0.020009860396385193, + "std": 0.6416458487510681, + "rms": 0.6419577598571777, + "max_abs": 22.25 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 34, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ae54a5bb2bab9f0932235662e82764f5944bc7f56e42d8062ed8a24334510c7e", + "mean": -0.028176818042993546, + "std": 0.6650583148002625, + "rms": 0.6656548976898193, + "max_abs": 15.875 + }, + "full_input": { + "shape": [ + 75, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d02c3f818365b9647ceab5f47de879faafa60d52d456717d1b18f062984ca22f", + "mean": -0.013861392624676228, + "std": 0.6157991290092468, + "rms": 0.615955114364624, + "max_abs": 23.25 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9971538782119751, + "min_cosine_similarity": 0.9814972877502441, + "mean_relative_l2": 0.07032168656587601, + "max_abs_delta": 1.60546875 + }, + "system_bos": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9968199729919434, + "min_cosine_similarity": 0.9818713068962097, + "mean_relative_l2": 0.07687158137559891, + "max_abs_delta": 1.93359375 + }, + "system_x": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9890932440757751, + "min_cosine_similarity": 0.9227017760276794, + "mean_relative_l2": 0.1398915946483612, + "max_abs_delta": 2.71875 + }, + "system_period": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9878856539726257, + "min_cosine_similarity": 0.9225471615791321, + "mean_relative_l2": 0.15059182047843933, + "max_abs_delta": 3.0859375 + }, + "bos_at_s0": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9974066615104675, + "min_cosine_similarity": 0.9911441206932068, + "mean_relative_l2": 0.07050123810768127, + "max_abs_delta": 1.5 + }, + "bos_at_s1": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9964351654052734, + "min_cosine_similarity": 0.9726381301879883, + "mean_relative_l2": 0.08261088281869888, + "max_abs_delta": 2.625 + }, + "x_at_s0": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9964784979820251, + "min_cosine_similarity": 0.9855337142944336, + "mean_relative_l2": 0.08025354892015457, + "max_abs_delta": 2.2578125 + }, + "x_at_s1": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9903484582901001, + "min_cosine_similarity": 0.9521206617355347, + "mean_relative_l2": 0.1336580216884613, + "max_abs_delta": 3.09375 + }, + "period_at_s0": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9969233274459839, + "min_cosine_similarity": 0.9918790459632874, + "mean_relative_l2": 0.07803038507699966, + "max_abs_delta": 1.4375 + }, + "period_at_s1": { + "tokens": 34, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9894593358039856, + "min_cosine_similarity": 0.9505764245986938, + "mean_relative_l2": 0.1445857286453247, + "max_abs_delta": 3.203125 + } + } + } + }, + "router_layers": { + "layer_01": { + "layer": 1, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "969289a4279433e1e640a54db4d514af99aa20ace5cedc9c21597ef27af0cb5b", + "route_weight_sha256": "5b62b2f72deb9a78797c1effb5b07101d34122ab680d1c9ab96567af9cd78ee1", + "loads": [ + 4, + 8, + 4, + 0, + 4, + 7, + 2, + 2, + 15, + 6, + 0, + 0, + 1, + 8, + 0, + 3, + 3, + 8, + 0, + 0, + 0, + 0, + 0, + 4, + 3, + 2, + 4, + 7, + 6, + 2, + 4, + 9, + 1, + 3, + 0, + 1, + 0, + 3, + 5, + 4, + 10, + 4, + 3, + 3, + 6, + 3, + 4, + 0, + 2, + 0, + 1, + 4, + 2, + 1, + 0, + 1, + 0, + 5, + 1, + 6, + 1, + 4, + 3, + 7 + ], + "weighted_loads": [ + 0.3724374230951071, + 0.2652711197733879, + 0.21961721777915955, + 0.0, + 0.39242369309067726, + 0.5865878686308861, + 0.11064545437693596, + 0.047359973192214966, + 0.6645848173648119, + 0.37810108810663223, + 0.0, + 0.0, + 0.02511383406817913, + 0.614321731030941, + 0.0, + 0.1131491120904684, + 0.06365970522165298, + 0.24740970693528652, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.1920415423810482, + 0.12951872125267982, + 0.07058380730450153, + 0.10188684985041618, + 0.3183609377592802, + 0.1797797828912735, + 0.10745137557387352, + 0.2319917380809784, + 0.894524123519659, + 0.02720903791487217, + 0.08149783499538898, + 0.0, + 0.023625288158655167, + 0.0, + 0.13257769867777824, + 0.15173937752842903, + 0.3275097981095314, + 0.6430020034313202, + 0.0919827539473772, + 0.19730954989790916, + 0.21497511863708496, + 0.1636611372232437, + 0.16804253682494164, + 0.28504861891269684, + 0.0, + 0.055234720930457115, + 0.0, + 0.04151805862784386, + 0.47258488833904266, + 0.06718630716204643, + 0.028796084225177765, + 0.0, + 0.025347791612148285, + 0.0, + 0.1873969454318285, + 0.05297578126192093, + 0.3036310989409685, + 0.0304906964302063, + 0.3887121379375458, + 0.13614602386951447, + 0.5779066942632198 + ], + "unique_experts": 49, + "load_cv": 0.9426051248409345, + "normalized_load_entropy": 0.8871045612886771, + "max_load_share": 0.07352941176470588 + }, + "full_input": { + "tokens": 59, + "top_k": 6, + "decisions": 354, + "ordered_route_sha256": "60b97e1ffa0ee37c9b0c279c9036db0fba1a7268e716ce446597a443f8562d9d", + "route_weight_sha256": "3bec0bea2ada02914b7651cf54f34ae3d10f72aaaa6d7f96116ad78b51f4dfcd", + "loads": [ + 4, + 8, + 6, + 0, + 8, + 7, + 4, + 4, + 32, + 6, + 2, + 0, + 1, + 8, + 0, + 12, + 3, + 10, + 0, + 0, + 3, + 0, + 1, + 4, + 3, + 6, + 16, + 7, + 6, + 2, + 5, + 15, + 2, + 5, + 0, + 1, + 0, + 3, + 5, + 7, + 11, + 15, + 3, + 8, + 7, + 14, + 5, + 0, + 2, + 1, + 5, + 5, + 6, + 1, + 4, + 5, + 3, + 13, + 1, + 18, + 2, + 8, + 4, + 7 + ], + "weighted_loads": [ + 0.3724374230951071, + 0.2652711197733879, + 0.3222527429461479, + 0.0, + 0.5014686845242977, + 0.5865878686308861, + 0.21098563447594643, + 0.31501320749521255, + 1.5898392032831907, + 0.37810108810663223, + 0.2746249735355377, + 0.0, + 0.02511383406817913, + 0.614321731030941, + 0.0, + 0.7277268711477518, + 0.06365970522165298, + 0.3587980028241873, + 0.0, + 0.0, + 0.27199537307024, + 0.0, + 0.03026885911822319, + 0.1920415423810482, + 0.12951872125267982, + 0.2345984596759081, + 0.8878416381776333, + 0.3183609377592802, + 0.1797797828912735, + 0.10745137557387352, + 0.26714203506708145, + 1.4061581642599776, + 0.08917579613626003, + 0.2841451968997717, + 0.0, + 0.023625288158655167, + 0.0, + 0.13257769867777824, + 0.15173937752842903, + 0.5561540424823761, + 0.7040664553642273, + 0.524888401851058, + 0.19730954989790916, + 0.32470407598884776, + 1.1479546576738358, + 0.9848747385549359, + 0.32189422845840454, + 0.0, + 0.055234720930457115, + 0.0220884308218956, + 0.1539337206631899, + 0.473191877710633, + 0.3473007567226887, + 0.028796084225177765, + 0.069148962124018, + 0.5514220148324966, + 0.275292731821537, + 0.6726972106844187, + 0.05297578126192093, + 1.0420263893902302, + 0.12104079872369766, + 0.592204112559557, + 0.1562230959534645, + 0.5779066942632198 + ], + "unique_experts": 55, + "load_cv": 0.9907323755596792, + "normalized_load_entropy": 0.8954626305086142, + "max_load_share": 0.0903954802259887 + } + }, + "s1_eos": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "58e989d6988b8cb7069fcaa638be481fbfceb40d7915efcb56f9427cc4e4468f", + "route_weight_sha256": "bf70e61980859cfb07c0b59d5ba2abfe50bb8301a0b910554680014b079c653c", + "loads": [ + 4, + 7, + 4, + 0, + 4, + 7, + 2, + 2, + 12, + 6, + 0, + 1, + 0, + 8, + 0, + 3, + 2, + 8, + 0, + 0, + 0, + 0, + 0, + 4, + 3, + 1, + 2, + 7, + 6, + 2, + 6, + 9, + 1, + 3, + 3, + 1, + 0, + 3, + 3, + 4, + 9, + 4, + 3, + 3, + 7, + 3, + 4, + 0, + 4, + 0, + 1, + 4, + 2, + 1, + 0, + 1, + 1, + 5, + 3, + 6, + 1, + 4, + 3, + 7 + ], + "weighted_loads": [ + 0.3756877090781927, + 0.23875315859913826, + 0.22205209359526634, + 0.0, + 0.3881199099123478, + 0.5893113501369953, + 0.11540722474455833, + 0.048642849549651146, + 0.5032966025173664, + 0.378805011510849, + 0.0, + 0.021700894460082054, + 0.0, + 0.6182254925370216, + 0.0, + 0.13248693197965622, + 0.03986474312841892, + 0.23625993728637695, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.1934027597308159, + 0.1339827310293913, + 0.0451747365295887, + 0.04815816134214401, + 0.2975596133619547, + 0.18064439855515957, + 0.11102855391800404, + 0.28430947475135326, + 0.8970743417739868, + 0.027525754645466805, + 0.08334875293076038, + 0.07292122580111027, + 0.024029500782489777, + 0.0, + 0.13831870257854462, + 0.10104475729167461, + 0.32671862840652466, + 0.60297348536551, + 0.0896233394742012, + 0.20117302611470222, + 0.2148573137819767, + 0.1999230682849884, + 0.17172302678227425, + 0.28617529943585396, + 0.0, + 0.10443240776658058, + 0.0, + 0.044503770768642426, + 0.47349150851368904, + 0.06739946454763412, + 0.02875521220266819, + 0.0, + 0.025046678259968758, + 0.02357051521539688, + 0.19407358206808567, + 0.09641976468265057, + 0.30355151928961277, + 0.031016921624541283, + 0.39462675899267197, + 0.13620424829423428, + 0.5892086029052734 + ], + "unique_experts": 51, + "load_cv": 0.8678547441698324, + "normalized_load_entropy": 0.8994171931699435, + "max_load_share": 0.058823529411764705 + }, + "full_input": { + "tokens": 75, + "top_k": 6, + "decisions": 450, + "ordered_route_sha256": "1194a00e2807b26df08f247697600af441e42ab10c30a27f492b1bbe7ae86a93", + "route_weight_sha256": "26089755f61a6568d7fcb0a3f50b6d9d85f63260869f34237584c71f711393ab", + "loads": [ + 6, + 7, + 7, + 0, + 11, + 9, + 4, + 5, + 35, + 6, + 5, + 2, + 0, + 9, + 0, + 15, + 2, + 14, + 1, + 1, + 3, + 2, + 4, + 5, + 5, + 6, + 20, + 8, + 6, + 4, + 8, + 17, + 2, + 5, + 3, + 1, + 1, + 4, + 3, + 9, + 10, + 17, + 6, + 9, + 9, + 14, + 5, + 3, + 6, + 1, + 10, + 9, + 7, + 1, + 6, + 5, + 10, + 17, + 5, + 18, + 3, + 9, + 4, + 11 + ], + "weighted_loads": [ + 0.4804568272083998, + 0.23875315859913826, + 0.3882847726345062, + 0.0, + 0.7315490655601025, + 0.7271448113024235, + 0.19900384545326233, + 0.2858734093606472, + 1.845414962619543, + 0.378805011510849, + 0.4631795398890972, + 0.16973655484616756, + 0.0, + 0.6580934897065163, + 0.0, + 0.8342275656759739, + 0.03986474312841892, + 0.47499954514205456, + 0.03927401453256607, + 0.06569653004407883, + 0.21041836962103844, + 0.204641692340374, + 0.270440973341465, + 0.22788413986563683, + 0.2057881262153387, + 0.23532610014081, + 1.305515818297863, + 0.33946354128420353, + 0.18064439855515957, + 0.27360313944518566, + 0.4066914524883032, + 1.6293053869449068, + 0.07690691761672497, + 0.24119745753705502, + 0.07292122580111027, + 0.024029500782489777, + 0.25945332646369934, + 0.17204778268933296, + 0.10104475729167461, + 0.674251351505518, + 0.6612444389611483, + 0.68386335298419, + 0.40785092301666737, + 0.41319941729307175, + 1.3421745002269745, + 0.9402774731861427, + 0.32267189025878906, + 0.08250534001854248, + 0.25578223913908005, + 0.022169560194015503, + 0.44899303279817104, + 0.8390511682955548, + 0.4147683419287205, + 0.02875521220266819, + 0.11803326677181758, + 0.5296765062958002, + 0.45652635022997856, + 0.9036707617342472, + 0.171762028709054, + 0.996184078976512, + 0.14638970233500004, + 0.6903539076447487, + 0.1561753824353218, + 1.0813713744282722 + ], + "unique_experts": 61, + "load_cv": 0.8436370409068841, + "normalized_load_entropy": 0.92439424578817, + "max_load_share": 0.07777777777777778 + } + }, + "s0_bos": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "0f3d619bcf3c432f7891834f6e1b9ce6efd3b580bd7374f6aa822786ac4c94fc", + "route_weight_sha256": "cf50f4cc4b1980028a573e5d5d5730f887f08e3358bfeb510a4f1073429bbfcd", + "loads": [ + 5, + 7, + 4, + 0, + 4, + 7, + 2, + 2, + 15, + 6, + 1, + 2, + 3, + 8, + 1, + 3, + 0, + 9, + 0, + 0, + 0, + 0, + 1, + 4, + 4, + 1, + 5, + 6, + 4, + 2, + 6, + 9, + 0, + 2, + 2, + 0, + 0, + 3, + 2, + 4, + 5, + 2, + 3, + 5, + 6, + 3, + 6, + 0, + 2, + 0, + 1, + 4, + 2, + 1, + 0, + 1, + 1, + 5, + 1, + 7, + 1, + 4, + 3, + 7 + ], + "weighted_loads": [ + 0.4262534864246845, + 0.22427789494395256, + 0.243911262601614, + 0.0, + 0.3479792848229408, + 0.5731518380343914, + 0.13569755107164383, + 0.047166794538497925, + 0.544086130335927, + 0.4173656441271305, + 0.028505757451057434, + 0.05254589766263962, + 0.07555551826953888, + 0.5523567646741867, + 0.02998237870633602, + 0.1148623414337635, + 0.0, + 0.31884071230888367, + 0.0, + 0.0, + 0.0, + 0.0, + 0.019423846155405045, + 0.22696475684642792, + 0.16858294419944286, + 0.04811004921793938, + 0.13803385198116302, + 0.27522760815918446, + 0.13264809362590313, + 0.12699594348669052, + 0.27829107642173767, + 0.8640877045691013, + 0.0, + 0.06744521856307983, + 0.05680020526051521, + 0.0, + 0.0, + 0.15802616253495216, + 0.08804992213845253, + 0.2900952771306038, + 0.3667939379811287, + 0.04872392490506172, + 0.20167436823248863, + 0.26660084538161755, + 0.16659474186599255, + 0.15768803283572197, + 0.3322235606610775, + 0.0, + 0.05833466909825802, + 0.0, + 0.041103072464466095, + 0.47101251780986786, + 0.06482970342040062, + 0.02815234661102295, + 0.0, + 0.027351221069693565, + 0.03007258102297783, + 0.164446284994483, + 0.05047790706157684, + 0.324212197214365, + 0.026481477543711662, + 0.3991569057106972, + 0.13361354544758797, + 0.5640247389674187 + ], + "unique_experts": 52, + "load_cv": 0.9060011805606213, + "normalized_load_entropy": 0.8976964220405911, + "max_load_share": 0.07352941176470588 + }, + "full_input": { + "tokens": 59, + "top_k": 6, + "decisions": 354, + "ordered_route_sha256": "45cf7c34b9046a8612cea824b8106ee8211e03a5b1be59ea234566a1d6a8a312", + "route_weight_sha256": "17544e531505a06ae0ca2036d9b6e3f50ac40d657a50f5db8b4990348c1af7d1", + "loads": [ + 6, + 7, + 6, + 0, + 8, + 7, + 4, + 4, + 30, + 7, + 3, + 3, + 3, + 8, + 1, + 12, + 0, + 13, + 2, + 0, + 2, + 0, + 2, + 4, + 5, + 5, + 17, + 6, + 4, + 2, + 7, + 14, + 1, + 4, + 2, + 0, + 0, + 3, + 2, + 7, + 6, + 13, + 4, + 9, + 6, + 13, + 8, + 0, + 2, + 0, + 5, + 4, + 6, + 1, + 3, + 5, + 5, + 14, + 1, + 17, + 3, + 8, + 3, + 7 + ], + "weighted_loads": [ + 0.44995754212141037, + 0.22427789494395256, + 0.32901962101459503, + 0.0, + 0.4707383494824171, + 0.5731518380343914, + 0.24624650552868843, + 0.307164691388607, + 1.364815292879939, + 0.4387118238955736, + 0.289519801735878, + 0.07730402052402496, + 0.07555551826953888, + 0.5523567646741867, + 0.02998237870633602, + 0.7294401004910469, + 0.0, + 0.5229395031929016, + 0.0465526208281517, + 0.0, + 0.23473158478736877, + 0.0, + 0.049692705273628235, + 0.22696475684642792, + 0.2008917722851038, + 0.21930285543203354, + 0.9239886403083801, + 0.27522760815918446, + 0.13264809362590313, + 0.12699594348669052, + 0.31202874705195427, + 1.3983340077102184, + 0.06196675822138786, + 0.270669586956501, + 0.05680020526051521, + 0.0, + 0.0, + 0.15802616253495216, + 0.08804992213845253, + 0.5243843160569668, + 0.4063674360513687, + 0.4838683530688286, + 0.24450182542204857, + 0.3758502695709467, + 0.16659474186599255, + 0.9740191362798214, + 0.3962458670139313, + 0.0, + 0.05833466909825802, + 0.0, + 0.16301861964166164, + 0.47101251780986786, + 0.33298857510089874, + 0.02815234661102295, + 0.0694530364125967, + 0.5574075933545828, + 0.37061678245663643, + 0.7204037271440029, + 0.05047790706157684, + 1.0077116303145885, + 0.22196405194699764, + 0.6085120476782322, + 0.13361354544758797, + 0.5640247389674187 + ], + "unique_experts": 56, + "load_cv": 0.9431982999203535, + "normalized_load_entropy": 0.9042278610038392, + "max_load_share": 0.0847457627118644 + } + }, + "s1_bos": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "e4d809601140a2f0ea5bcbdedd7d6a661d85fa96a1120d7c0483650738b958b6", + "route_weight_sha256": "f2a06ad550e263bc3f2822c4a3091ccd7d6070f012790fc55c3350795c6848cc", + "loads": [ + 5, + 7, + 4, + 0, + 4, + 7, + 2, + 2, + 14, + 6, + 0, + 2, + 1, + 8, + 1, + 4, + 0, + 6, + 0, + 0, + 0, + 0, + 0, + 4, + 3, + 1, + 12, + 6, + 4, + 2, + 6, + 9, + 0, + 2, + 3, + 0, + 0, + 3, + 2, + 4, + 5, + 4, + 3, + 3, + 8, + 3, + 6, + 0, + 2, + 0, + 1, + 4, + 2, + 1, + 0, + 1, + 0, + 4, + 1, + 7, + 1, + 4, + 3, + 7 + ], + "weighted_loads": [ + 0.3963786792010069, + 0.22681044228374958, + 0.22726425528526306, + 0.0, + 0.34592779725790024, + 0.6214431673288345, + 0.12208996340632439, + 0.04872938431799412, + 0.48964011669158936, + 0.4037327505648136, + 0.0, + 0.051461752504110336, + 0.028156496584415436, + 0.5645517818629742, + 0.027873650193214417, + 0.16241257265210152, + 0.0, + 0.20361008308827877, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.20606185495853424, + 0.1391158364713192, + 0.04849142208695412, + 0.3308125399053097, + 0.26086192578077316, + 0.13175791315734386, + 0.12327229790389538, + 0.2885407358407974, + 0.8865395672619343, + 0.0, + 0.06286106444895267, + 0.09289338998496532, + 0.0, + 0.0, + 0.15018032118678093, + 0.08538486063480377, + 0.2947378233075142, + 0.33634187653660774, + 0.10222883522510529, + 0.19217949733138084, + 0.21257962845265865, + 0.229353379458189, + 0.15900294482707977, + 0.33306354843080044, + 0.0, + 0.062110407277941704, + 0.0, + 0.04601042717695236, + 0.471492201089859, + 0.06158791109919548, + 0.028607875108718872, + 0.0, + 0.026367681100964546, + 0.0, + 0.15405060723423958, + 0.04324661195278168, + 0.33353216573596, + 0.027374621480703354, + 0.39265961199998856, + 0.13366670534014702, + 0.553050521761179 + ], + "unique_experts": 49, + "load_cv": 0.9507276801882868, + "normalized_load_entropy": 0.885346911379476, + "max_load_share": 0.06862745098039216 + }, + "full_input": { + "tokens": 75, + "top_k": 6, + "decisions": 450, + "ordered_route_sha256": "029fe0f9d0bf20374de8b0ea8ca89fc78acd9b5fb2e3cc477c3cd2c9670325c8", + "route_weight_sha256": "55f531080c712647d29920f1b759743db8d1f65cb4ececfb9891d4fe3160319e", + "loads": [ + 8, + 7, + 7, + 1, + 11, + 9, + 4, + 5, + 36, + 6, + 5, + 4, + 1, + 9, + 1, + 16, + 0, + 13, + 3, + 1, + 2, + 2, + 4, + 5, + 5, + 6, + 31, + 7, + 4, + 4, + 8, + 16, + 2, + 4, + 3, + 0, + 1, + 4, + 2, + 9, + 5, + 17, + 7, + 9, + 9, + 13, + 8, + 2, + 4, + 0, + 10, + 8, + 7, + 1, + 5, + 5, + 10, + 17, + 3, + 17, + 4, + 9, + 3, + 11 + ], + "weighted_loads": [ + 0.5232058763504028, + 0.22681044228374958, + 0.3797650523483753, + 0.03184477984905243, + 0.7031368669122458, + 0.7592766284942627, + 0.21006052568554878, + 0.2772382125258446, + 1.7554444558918476, + 0.4037327505648136, + 0.44716041907668114, + 0.22368040680885315, + 0.028156496584415436, + 0.6044197790324688, + 0.027873650193214417, + 0.8641532063484192, + 0.0, + 0.4983670450747013, + 0.08634346537292004, + 0.06569653004407883, + 0.17422982305288315, + 0.204641692340374, + 0.270440973341465, + 0.24054323509335518, + 0.21092123165726662, + 0.24925756640732288, + 1.6083312388509512, + 0.302765853703022, + 0.13175791315734386, + 0.285846883431077, + 0.41033536940813065, + 1.6426778249442577, + 0.08434819802641869, + 0.22233647294342518, + 0.09289338998496532, + 0.0, + 0.25945332646369934, + 0.18390940129756927, + 0.08538486063480377, + 0.6501445285975933, + 0.33634187653660774, + 0.6990795787423849, + 0.43526272661983967, + 0.4109217319637537, + 0.38250113651156425, + 0.9270962476730347, + 0.40217979811131954, + 0.08219292014837265, + 0.21346023865044117, + 0.0, + 0.46668287366628647, + 0.8367450907826424, + 0.37813593819737434, + 0.028607875108718872, + 0.12201868370175362, + 0.5322444681078196, + 0.48640182241797447, + 0.9317395724356174, + 0.1185888759791851, + 0.9704502634704113, + 0.24478331953287125, + 0.692771952599287, + 0.13366670534014702, + 1.0452132932841778 + ], + "unique_experts": 61, + "load_cv": 0.9223801738899126, + "normalized_load_entropy": 0.9157578146675113, + "max_load_share": 0.08 + } + }, + "s0_x": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "2656ad41d25e5a9bac849f81257a57e073b2b9082fcfbc2e9ad5ac69436c0fa0", + "route_weight_sha256": "00661b233353cc8e6b10ab8322f172eca6fd529da933655aff2f03ec4c87135b", + "loads": [ + 5, + 7, + 4, + 0, + 4, + 7, + 2, + 1, + 14, + 6, + 1, + 2, + 3, + 8, + 1, + 2, + 0, + 8, + 0, + 0, + 0, + 0, + 1, + 4, + 4, + 1, + 6, + 5, + 3, + 2, + 6, + 9, + 0, + 2, + 2, + 1, + 0, + 3, + 2, + 4, + 7, + 3, + 3, + 5, + 7, + 3, + 4, + 0, + 4, + 0, + 1, + 4, + 2, + 1, + 0, + 1, + 1, + 5, + 2, + 6, + 1, + 4, + 3, + 7 + ], + "weighted_loads": [ + 0.41692809015512466, + 0.23698125779628754, + 0.23731955140829086, + 0.0, + 0.36608463898301125, + 0.6448253244161606, + 0.12640640139579773, + 0.025906160473823547, + 0.5454048328101635, + 0.4039456583559513, + 0.02815551497042179, + 0.04562220722436905, + 0.08391112834215164, + 0.5667945072054863, + 0.031199848279356956, + 0.08675480633974075, + 0.0, + 0.2858337163925171, + 0.0, + 0.0, + 0.0, + 0.0, + 0.01907391846179962, + 0.22035016864538193, + 0.17762749455869198, + 0.04755735397338867, + 0.16426139697432518, + 0.24719509482383728, + 0.09906424954533577, + 0.11935548856854439, + 0.2774024698883295, + 0.893231388181448, + 0.0, + 0.060523148626089096, + 0.055264897644519806, + 0.02035403624176979, + 0.0, + 0.17602349445223808, + 0.08174117282032967, + 0.28602828830480576, + 0.47157771699130535, + 0.07393487356603146, + 0.2102404423058033, + 0.2711335066705942, + 0.19291327893733978, + 0.15842943638563156, + 0.2833459675312042, + 0.0, + 0.10103356279432774, + 0.0, + 0.0383630134165287, + 0.48626600578427315, + 0.059997742995619774, + 0.02770630642771721, + 0.0, + 0.028035756200551987, + 0.026715748012065887, + 0.17318066768348217, + 0.08088272623717785, + 0.3037429265677929, + 0.028738941997289658, + 0.38742227107286453, + 0.1310731377452612, + 0.5856019370257854 + ], + "unique_experts": 53, + "load_cv": 0.8749141771499257, + "normalized_load_entropy": 0.903041813021391, + "max_load_share": 0.06862745098039216 + }, + "full_input": { + "tokens": 59, + "top_k": 6, + "decisions": 354, + "ordered_route_sha256": "b80cfbe6933649189cf5027fcdcb0459e3feeb3d103c253dec0c3c0a6eac3dc7", + "route_weight_sha256": "e83d7fbc7be591e3c0a8189876e157636311ec3fb4b3aeb844c3c0f989696b89", + "loads": [ + 5, + 7, + 6, + 0, + 8, + 7, + 4, + 4, + 29, + 8, + 3, + 2, + 3, + 8, + 2, + 12, + 0, + 11, + 1, + 0, + 2, + 0, + 3, + 4, + 4, + 5, + 19, + 5, + 3, + 2, + 7, + 14, + 1, + 4, + 2, + 1, + 0, + 3, + 2, + 7, + 8, + 15, + 3, + 9, + 7, + 14, + 5, + 0, + 5, + 0, + 5, + 4, + 6, + 1, + 3, + 5, + 4, + 13, + 2, + 17, + 2, + 8, + 3, + 7 + ], + "weighted_loads": [ + 0.41692809015512466, + 0.23698125779628754, + 0.3315988518297672, + 0.0, + 0.49014500342309475, + 0.6448253244161606, + 0.2346012108027935, + 0.32502444088459015, + 1.3689320236444473, + 0.4515303336083889, + 0.3021757993847132, + 0.04562220722436905, + 0.08391112834215164, + 0.5667945072054863, + 0.055331598967313766, + 0.8190836869180202, + 0.0, + 0.4459327682852745, + 0.021701963618397713, + 0.0, + 0.23473158478736877, + 0.0, + 0.08038846217095852, + 0.22035016864538193, + 0.17762749455869198, + 0.2234695963561535, + 0.9799291584640741, + 0.24719509482383728, + 0.09906424954533577, + 0.11935548856854439, + 0.311539763584733, + 1.4499109871685505, + 0.06196675822138786, + 0.2629239819943905, + 0.055264897644519806, + 0.02035403624176979, + 0.0, + 0.17602349445223808, + 0.08174117282032967, + 0.5434612333774567, + 0.519185034558177, + 0.5641547683626413, + 0.2102404423058033, + 0.38038293085992336, + 0.19291327893733978, + 1.008439812809229, + 0.32144926860928535, + 0.0, + 0.1339122112840414, + 0.0, + 0.1628955937922001, + 0.48626600578427315, + 0.30790858529508114, + 0.02770630642771721, + 0.06828298419713974, + 0.5783014111220837, + 0.21912632510066032, + 0.6498408857733011, + 0.08088272623717785, + 1.0852079428732395, + 0.11928904429078102, + 0.5926695950329304, + 0.1310731377452612, + 0.5856019370257854 + ], + "unique_experts": 57, + "load_cv": 0.94428060907972, + "normalized_load_entropy": 0.9055088271310449, + "max_load_share": 0.08192090395480225 + } + }, + "s1_x": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "4dac8d22472a72ef459280f18255a221718c061edd5f47e3c7c160f9307a1c8e", + "route_weight_sha256": "8c3f60249cb672a7c2096bd4e8924f6bd2d83341c518aca682a09a5ac35a078a", + "loads": [ + 5, + 7, + 4, + 0, + 4, + 7, + 2, + 2, + 12, + 6, + 0, + 2, + 1, + 8, + 1, + 4, + 0, + 5, + 0, + 0, + 0, + 0, + 0, + 4, + 3, + 1, + 13, + 6, + 4, + 2, + 6, + 9, + 0, + 2, + 3, + 0, + 0, + 3, + 3, + 4, + 5, + 5, + 3, + 4, + 7, + 3, + 6, + 0, + 2, + 0, + 1, + 4, + 2, + 1, + 0, + 1, + 0, + 5, + 1, + 6, + 1, + 4, + 3, + 7 + ], + "weighted_loads": [ + 0.381386948749423, + 0.23291154578328133, + 0.21463225036859512, + 0.0, + 0.3567880466580391, + 0.6328487806022167, + 0.11922415345907211, + 0.04876449331641197, + 0.4289386719465256, + 0.38615449145436287, + 0.0, + 0.04704754427075386, + 0.02667858637869358, + 0.5685888454318047, + 0.028059599921107292, + 0.1577136032283306, + 0.0, + 0.17635987512767315, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.20040248706936836, + 0.1427868902683258, + 0.04799812287092209, + 0.3841704037040472, + 0.25581113807857037, + 0.13221464306116104, + 0.11941024102270603, + 0.2897857241332531, + 0.8886895701289177, + 0.0, + 0.059062715619802475, + 0.09001182205975056, + 0.0, + 0.0, + 0.1580469086766243, + 0.10641759820282459, + 0.29590319842100143, + 0.36295803263783455, + 0.12839895114302635, + 0.19095414504408836, + 0.23124058358371258, + 0.20838926918804646, + 0.15684450045228004, + 0.3306502867490053, + 0.0, + 0.0624993983656168, + 0.0, + 0.04627329483628273, + 0.47507070004940033, + 0.05866405367851257, + 0.028662100434303284, + 0.0, + 0.026692301034927368, + 0.0, + 0.17505264654755592, + 0.04351295158267021, + 0.3092399463057518, + 0.029356401413679123, + 0.3832633048295975, + 0.13267086073756218, + 0.5577270947396755 + ], + "unique_experts": 49, + "load_cv": 0.9211513448271643, + "normalized_load_entropy": 0.8889158093775656, + "max_load_share": 0.06372549019607843 + }, + "full_input": { + "tokens": 75, + "top_k": 6, + "decisions": 450, + "ordered_route_sha256": "108d30ecb858c59f2011ee082de5621326732ae37c34b6c2fb316b1dba785f9d", + "route_weight_sha256": "4100674e30ca9a8a557f7e6b703031e07b8f7f44d988d11ac48d17069979a7a2", + "loads": [ + 7, + 7, + 7, + 0, + 11, + 9, + 4, + 6, + 33, + 7, + 5, + 3, + 1, + 9, + 1, + 17, + 0, + 12, + 3, + 1, + 2, + 2, + 4, + 5, + 5, + 6, + 33, + 7, + 4, + 4, + 8, + 16, + 2, + 4, + 3, + 0, + 1, + 4, + 3, + 9, + 5, + 19, + 6, + 10, + 8, + 14, + 8, + 2, + 5, + 0, + 10, + 8, + 7, + 1, + 5, + 5, + 9, + 17, + 3, + 17, + 3, + 9, + 3, + 11 + ], + "weighted_loads": [ + 0.4861560668796301, + 0.23291154578328133, + 0.37434519082307816, + 0.0, + 0.713796591386199, + 0.7706822417676449, + 0.20712798088788986, + 0.3151240963488817, + 1.6596750319004059, + 0.4110540598630905, + 0.44669635221362114, + 0.19508320465683937, + 0.02667858637869358, + 0.6084568426012993, + 0.028059599921107292, + 0.96982242166996, + 0.0, + 0.4676785245537758, + 0.08245500177145004, + 0.06569653004407883, + 0.17422982305288315, + 0.204641692340374, + 0.270440973341465, + 0.2348838672041893, + 0.21459228545427322, + 0.25373624451458454, + 1.7010771334171295, + 0.2977150660008192, + 0.13221464306116104, + 0.28198482654988766, + 0.41261767596006393, + 1.6562127768993378, + 0.08459030836820602, + 0.2190619558095932, + 0.09001182205975056, + 0.0, + 0.25945332646369934, + 0.19177598878741264, + 0.10641759820282459, + 0.6703852340579033, + 0.36295803263783455, + 0.7903731949627399, + 0.3976320419460535, + 0.4295826870948076, + 0.3615370262414217, + 0.9596431851387024, + 0.4044314827769995, + 0.08219292014837265, + 0.24813724122941494, + 0.0, + 0.4759321343153715, + 0.8403235897421837, + 0.35476116463541985, + 0.028662100434303284, + 0.12013442814350128, + 0.5438061133027077, + 0.3574327901005745, + 0.8696722164750099, + 0.11885521560907364, + 1.0405468046665192, + 0.14472918212413788, + 0.6806202605366707, + 0.13267086073756218, + 1.0498898662626743 + ], + "unique_experts": 60, + "load_cv": 0.9234075381333431, + "normalized_load_entropy": 0.9139241360907701, + "max_load_share": 0.07333333333333333 + } + }, + "s0_period": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "93a238ffe7f749bb472bfa3da5fe26376445849d293e165a6580557965c5eb11", + "route_weight_sha256": "ab71cbb634481249101c8c5c68e85b8579aa871c9dcde370cb2ff3100fe89ad2", + "loads": [ + 5, + 7, + 4, + 0, + 4, + 7, + 2, + 1, + 14, + 6, + 1, + 1, + 3, + 8, + 1, + 2, + 0, + 8, + 0, + 0, + 0, + 0, + 1, + 4, + 4, + 1, + 6, + 5, + 3, + 2, + 6, + 9, + 0, + 2, + 2, + 1, + 0, + 3, + 2, + 4, + 7, + 3, + 3, + 5, + 7, + 3, + 4, + 0, + 4, + 0, + 1, + 4, + 2, + 1, + 0, + 1, + 1, + 5, + 2, + 7, + 1, + 4, + 3, + 7 + ], + "weighted_loads": [ + 0.4196547716856003, + 0.23410004749894142, + 0.2381516471505165, + 0.0, + 0.35722198337316513, + 0.6424071379005909, + 0.12525761872529984, + 0.026062577962875366, + 0.5331038534641266, + 0.4069102257490158, + 0.028527777642011642, + 0.024149591103196144, + 0.0852896012365818, + 0.5697720497846603, + 0.03028898499906063, + 0.08796096965670586, + 0.0, + 0.2812186237424612, + 0.0, + 0.0, + 0.0, + 0.0, + 0.01897674985229969, + 0.22134308144450188, + 0.17618991434574127, + 0.04747512564063072, + 0.16593433171510696, + 0.2491675205528736, + 0.0980636477470398, + 0.11983704566955566, + 0.27753574028611183, + 0.8939341828227043, + 0.0, + 0.060782164335250854, + 0.05483240634202957, + 0.021334543824195862, + 0.0, + 0.17599240317940712, + 0.08233388885855675, + 0.2851659506559372, + 0.47811339795589447, + 0.07576037012040615, + 0.21001680940389633, + 0.27043050341308117, + 0.19013917818665504, + 0.15789204463362694, + 0.2850799784064293, + 0.0, + 0.10100436396896839, + 0.0, + 0.038726806640625, + 0.47887418791651726, + 0.059464169666171074, + 0.027658281847834587, + 0.0, + 0.027716757729649544, + 0.028584390878677368, + 0.16920088417828083, + 0.07990743033587933, + 0.32464909739792347, + 0.02871616743505001, + 0.38823387026786804, + 0.13214008510112762, + 0.5914899595081806 + ], + "unique_experts": 53, + "load_cv": 0.8836591638622547, + "normalized_load_entropy": 0.9012920503987796, + "max_load_share": 0.06862745098039216 + }, + "full_input": { + "tokens": 59, + "top_k": 6, + "decisions": 354, + "ordered_route_sha256": "c7922b66516f09ba37ee2bb37d9e0410b2e35adf98875805b0db9ee013bfd232", + "route_weight_sha256": "4bcef36e43fdb1393e78336f32507ae5681d1b5a49055659eeed157d7ee2bbd6", + "loads": [ + 5, + 7, + 6, + 0, + 9, + 7, + 4, + 3, + 29, + 8, + 3, + 3, + 3, + 8, + 2, + 11, + 0, + 11, + 1, + 0, + 2, + 0, + 2, + 4, + 5, + 5, + 18, + 5, + 3, + 2, + 7, + 14, + 1, + 4, + 2, + 2, + 0, + 3, + 2, + 7, + 8, + 14, + 3, + 10, + 7, + 13, + 5, + 0, + 5, + 0, + 5, + 5, + 6, + 1, + 3, + 5, + 4, + 12, + 2, + 18, + 2, + 8, + 3, + 7 + ], + "weighted_loads": [ + 0.4196547716856003, + 0.23410004749894142, + 0.3238923251628876, + 0.0, + 0.6030594501644373, + 0.6424071379005909, + 0.23558162152767181, + 0.27800875902175903, + 1.3336408641189337, + 0.453781196847558, + 0.30110376700758934, + 0.18415156565606594, + 0.0852896012365818, + 0.5697720497846603, + 0.05393755994737148, + 0.7025387287139893, + 0.0, + 0.4442285653203726, + 0.021838638931512833, + 0.0, + 0.23473158478736877, + 0.0, + 0.04924560897052288, + 0.22134308144450188, + 0.2100784331560135, + 0.22287366166710854, + 0.9518891200423241, + 0.2491675205528736, + 0.0980636477470398, + 0.11983704566955566, + 0.3117828220129013, + 1.4514135494828224, + 0.06196675822138786, + 0.26319242641329765, + 0.05483240634202957, + 0.04258434846997261, + 0.0, + 0.17599240317940712, + 0.08233388885855675, + 0.5227261409163475, + 0.5249983854591846, + 0.5103617385029793, + 0.21001680940389633, + 0.4055169988423586, + 0.19013917818665504, + 0.9742231480777264, + 0.32293330505490303, + 0.0, + 0.12198620103299618, + 0.0, + 0.1630647461861372, + 0.5320697724819183, + 0.3205506559461355, + 0.027658281847834587, + 0.0683728326112032, + 0.580440865829587, + 0.22135816141963005, + 0.6174274459481239, + 0.07990743033587933, + 1.038256661966443, + 0.11926626972854137, + 0.5911994613707066, + 0.13214008510112762, + 0.5914899595081806 + ], + "unique_experts": 57, + "load_cv": 0.92901354603981, + "normalized_load_entropy": 0.9080683152355493, + "max_load_share": 0.08192090395480225 + } + }, + "s1_period": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "ad78925c3b85c19780cb29a00a99bb25d9b3c86ac440f4fd5f08e6b391649c47", + "route_weight_sha256": "3e15fdbb39c9d53e9bee271c644503d02c16a8a814f3adaa3d8f86f65e7ffc2d", + "loads": [ + 5, + 7, + 4, + 0, + 4, + 7, + 2, + 2, + 12, + 6, + 0, + 1, + 1, + 8, + 1, + 4, + 0, + 5, + 0, + 0, + 0, + 0, + 0, + 4, + 3, + 1, + 13, + 6, + 4, + 2, + 6, + 9, + 0, + 2, + 3, + 0, + 0, + 3, + 3, + 4, + 5, + 5, + 3, + 3, + 8, + 3, + 6, + 0, + 2, + 0, + 1, + 4, + 2, + 1, + 0, + 1, + 0, + 5, + 1, + 7, + 1, + 4, + 3, + 7 + ], + "weighted_loads": [ + 0.3814773838967085, + 0.23212637566030025, + 0.2137172482907772, + 0.0, + 0.3485926575958729, + 0.6252338886260986, + 0.11948705464601517, + 0.0491358395665884, + 0.4208719804883003, + 0.387157890945673, + 0.0, + 0.025138812139630318, + 0.02796747162938118, + 0.5704677551984787, + 0.027521887794137, + 0.16046492010354996, + 0.0, + 0.1730730440467596, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0, + 0.20260393619537354, + 0.14110438525676727, + 0.04759954661130905, + 0.38400938734412193, + 0.2561735734343529, + 0.13141268864274025, + 0.1193692721426487, + 0.29001603089272976, + 0.8908913135528564, + 0.0, + 0.05933678522706032, + 0.09056042321026325, + 0.0, + 0.0, + 0.15690477564930916, + 0.1068921685218811, + 0.2958410605788231, + 0.3652866929769516, + 0.12935833632946014, + 0.19083204120397568, + 0.21060852147638798, + 0.22820978984236717, + 0.15761270001530647, + 0.3324152622371912, + 0.0, + 0.06282573565840721, + 0.0, + 0.04618621617555618, + 0.46788879483938217, + 0.05786347575485706, + 0.02884380705654621, + 0.0, + 0.026369335129857063, + 0.0, + 0.17280634492635727, + 0.04319651797413826, + 0.32940384186804295, + 0.029135985299944878, + 0.3822844848036766, + 0.13271637074649334, + 0.5626264177262783 + ], + "unique_experts": 49, + "load_cv": 0.9360563342964715, + "normalized_load_entropy": 0.8862645736767188, + "max_load_share": 0.06372549019607843 + }, + "full_input": { + "tokens": 75, + "top_k": 6, + "decisions": 450, + "ordered_route_sha256": "9810efa1a5f7f78c0410b5059dda965b388bb3ca35d733e45c8ddd67d6708ead", + "route_weight_sha256": "e6c1e69ed5aca55def66e7d33ba7ef2386c1b97aa2a0b04848264fcdd7ffd802", + "loads": [ + 7, + 7, + 7, + 0, + 12, + 9, + 4, + 5, + 32, + 6, + 5, + 4, + 1, + 9, + 1, + 16, + 0, + 12, + 3, + 1, + 2, + 2, + 4, + 5, + 5, + 6, + 33, + 7, + 4, + 4, + 9, + 16, + 2, + 4, + 3, + 0, + 2, + 4, + 3, + 9, + 5, + 19, + 6, + 9, + 9, + 13, + 7, + 2, + 5, + 0, + 10, + 9, + 8, + 1, + 5, + 5, + 9, + 17, + 3, + 17, + 3, + 9, + 3, + 11 + ], + "weighted_loads": [ + 0.48624650202691555, + 0.23212637566030025, + 0.3632386326789856, + 0.0, + 0.8247898146510124, + 0.7630673497915268, + 0.2080894634127617, + 0.2658693976700306, + 1.6105403378605843, + 0.387157890945673, + 0.44531041011214256, + 0.3400701526552439, + 0.02796747162938118, + 0.6103357523679733, + 0.027521887794137, + 0.8622055537998676, + 0.0, + 0.46546879410743713, + 0.08298060670495033, + 0.06569653004407883, + 0.17422982305288315, + 0.204641692340374, + 0.270440973341465, + 0.23708531633019447, + 0.2129097804427147, + 0.25241738744080067, + 1.691713446751237, + 0.2980775013566017, + 0.13141268864274025, + 0.2819438576698303, + 0.433871204033494, + 1.6604113280773163, + 0.08441052213311195, + 0.21914130449295044, + 0.09056042321026325, + 0.0, + 0.28143387846648693, + 0.1906338557600975, + 0.1068921685218811, + 0.6512215882539749, + 0.3652866929769516, + 0.7604544218629599, + 0.3975099381059408, + 0.408950624987483, + 0.3813575468957424, + 0.9257060028612614, + 0.3723879437893629, + 0.08219292014837265, + 0.24834635108709335, + 0.0, + 0.47518002055585384, + 0.8761192820966244, + 0.38864414021372795, + 0.02884380705654621, + 0.12029889971017838, + 0.5442831609398127, + 0.36055532470345497, + 0.8666935004293919, + 0.11853878200054169, + 0.9663219396024942, + 0.14450876601040363, + 0.6750571504235268, + 0.13271637074649334, + 1.0547891892492771 + ], + "unique_experts": 60, + "load_cv": 0.9089187715815608, + "normalized_load_entropy": 0.9161767423828048, + "max_load_share": 0.07333333333333333 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 34, + "ordered_topk_exact_tokens": 16, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.8571428571428572, + "mean_token_weighted_tv": 0.017382462782894865, + "aggregate_load_tv": 0.0588235294117647 + }, + "system_bos": { + "tokens": 34, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 18, + "mean_set_jaccard": 0.8592436974789917, + "mean_token_weighted_tv": 0.021079833153635263, + "aggregate_load_tv": 0.06372549019607843 + }, + "system_x": { + "tokens": 34, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.8340336134453783, + "mean_token_weighted_tv": 0.024575514527147308, + "aggregate_load_tv": 0.08823529411764708 + }, + "system_period": { + "tokens": 34, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.8277310924369748, + "mean_token_weighted_tv": 0.02538368905730107, + "aggregate_load_tv": 0.09313725490196079 + }, + "bos_at_s0": { + "tokens": 34, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8004201680672269, + "mean_token_weighted_tv": 0.033204133403213584, + "aggregate_load_tv": 0.10294117647058823 + }, + "bos_at_s1": { + "tokens": 34, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.8151260504201682, + "mean_token_weighted_tv": 0.029506629798561335, + "aggregate_load_tv": 0.10294117647058824 + }, + "x_at_s0": { + "tokens": 34, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 13, + "mean_set_jaccard": 0.7920168067226891, + "mean_token_weighted_tv": 0.03181253222967772, + "aggregate_load_tv": 0.10784313725490195 + }, + "x_at_s1": { + "tokens": 34, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8018207282913167, + "mean_token_weighted_tv": 0.030747904387467048, + "aggregate_load_tv": 0.09803921568627451 + }, + "period_at_s0": { + "tokens": 34, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 13, + "mean_set_jaccard": 0.7920168067226891, + "mean_token_weighted_tv": 0.03182707028463483, + "aggregate_load_tv": 0.10784313725490195 + }, + "period_at_s1": { + "tokens": 34, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 14, + "mean_set_jaccard": 0.8018207282913167, + "mean_token_weighted_tv": 0.030780966256690377, + "aggregate_load_tv": 0.09803921568627451 + } + } + }, + "layer_02": { + "layer": 2, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "e7e57c43e8413c91581e4836b11fded6499f7b3f2e45284238723067ebdaf192", + "route_weight_sha256": "641954ef936032aac22b67201f42f769604cbe6c2242b0e8db2d12b79e3ae3de", + "loads": [ + 4, + 5, + 1, + 6, + 1, + 7, + 4, + 7, + 4, + 2, + 4, + 1, + 3, + 3, + 5, + 4, + 5, + 9, + 4, + 2, + 1, + 1, + 0, + 3, + 7, + 5, + 0, + 6, + 1, + 5, + 1, + 0, + 2, + 0, + 2, + 5, + 3, + 0, + 5, + 0, + 0, + 0, + 1, + 4, + 6, + 4, + 5, + 8, + 3, + 4, + 2, + 2, + 5, + 0, + 1, + 1, + 5, + 0, + 8, + 3, + 5, + 2, + 2, + 5 + ], + "weighted_loads": [ + 0.3633633852005005, + 0.2957063689827919, + 0.03670463711023331, + 0.34317756444215775, + 0.026716886088252068, + 0.5320359617471695, + 0.11191367357969284, + 0.29300422966480255, + 0.23503722622990608, + 0.0751408189535141, + 0.11411178670823574, + 0.028452586382627487, + 0.10856230556964874, + 0.10147154331207275, + 0.16392979957163334, + 0.3370664231479168, + 0.20297380909323692, + 0.8272640891373158, + 0.21469546854496002, + 0.1871257033199072, + 0.03252875432372093, + 0.052878670394420624, + 0.0, + 0.08917339332401752, + 0.28228368051350117, + 0.7533910199999809, + 0.0, + 0.520360603928566, + 0.030163120478391647, + 0.4016974922269583, + 0.03889768198132515, + 0.0, + 0.06037876568734646, + 0.0, + 0.27918392419815063, + 0.6521121934056282, + 0.16567403078079224, + 0.0, + 0.5948495902121067, + 0.0, + 0.0, + 0.0, + 0.08296937495470047, + 0.15055932849645615, + 0.3264168053865433, + 0.5272064805030823, + 0.2899378351867199, + 0.4464099369943142, + 0.08833406865596771, + 0.16434444300830364, + 0.05794051103293896, + 0.0761270746588707, + 0.15801031328737736, + 0.0, + 0.02573240175843239, + 0.03327139839529991, + 0.3288726173341274, + 0.0, + 0.8730392754077911, + 0.2689407095313072, + 0.3698140159249306, + 0.2912629693746567, + 0.08925655111670494, + 0.30775825306773186 + ], + "unique_experts": 54, + "load_cv": 0.7375781519138834, + "normalized_load_entropy": 0.9210103395970517, + "max_load_share": 0.04411764705882353 + }, + "full_input": { + "tokens": 59, + "top_k": 6, + "decisions": 354, + "ordered_route_sha256": "29dea71939df9dfa2a1a5442fc25d9f08cd2209a7275dd3cb596e75703ee3a12", + "route_weight_sha256": "be531817801c2da7003c586561bc315e5a29c5c0407d3fc94b18ad0ed654b568", + "loads": [ + 4, + 15, + 1, + 8, + 1, + 7, + 5, + 8, + 7, + 2, + 7, + 1, + 3, + 5, + 12, + 4, + 5, + 10, + 5, + 6, + 3, + 10, + 0, + 3, + 10, + 5, + 1, + 9, + 3, + 5, + 1, + 1, + 2, + 0, + 7, + 21, + 3, + 0, + 8, + 0, + 0, + 0, + 8, + 4, + 6, + 4, + 8, + 12, + 4, + 4, + 2, + 8, + 5, + 1, + 1, + 1, + 5, + 8, + 16, + 5, + 17, + 4, + 7, + 16 + ], + "weighted_loads": [ + 0.3633633852005005, + 1.2389115020632744, + 0.03670463711023331, + 2.0413091853260994, + 0.026716886088252068, + 0.5320359617471695, + 0.13548476807773113, + 0.33966563269495964, + 0.3974913880228996, + 0.0751408189535141, + 0.2397544216364622, + 0.028452586382627487, + 0.10856230556964874, + 0.1510122586041689, + 0.4548716340214014, + 0.3370664231479168, + 0.20297380909323692, + 0.8279623432899825, + 0.21628180681727827, + 0.917466601356864, + 0.3455064259469509, + 0.7455971017479897, + 0.0, + 0.08917339332401752, + 0.4314150605350733, + 0.7533910199999809, + 0.0008468095329590142, + 0.8223603330552578, + 0.23824913427233696, + 0.4016974922269583, + 0.03889768198132515, + 0.00069721246836707, + 0.06037876568734646, + 0.0, + 0.5025164484977722, + 2.7328082770109177, + 0.16567403078079224, + 0.0, + 0.6834852658212185, + 0.0, + 0.0, + 0.0, + 0.8104095943272114, + 0.15055932849645615, + 0.3264168053865433, + 0.5272064805030823, + 0.38699922896921635, + 0.6889232471585274, + 0.11408639512956142, + 0.16434444300830364, + 0.05794051103293896, + 0.707505114376545, + 0.15801031328737736, + 0.001316620851866901, + 0.02573240175843239, + 0.03327139839529991, + 0.3288726173341274, + 0.452926579862833, + 1.2364323399960995, + 0.35470012575387955, + 1.2779047647491097, + 0.3777068220078945, + 0.4933477398008108, + 0.904608765617013 + ], + "unique_experts": 58, + "load_cv": 0.8290852173038602, + "normalized_load_entropy": 0.916873366138096, + "max_load_share": 0.059322033898305086 + } + }, + "s1_eos": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "6e7a5e7e4deeb52a1a92854915f271d6224af1e11b96d4dddecd70ed3e286990", + "route_weight_sha256": "dbb060d23206c0dc5e98242aaadae69919593da487f9cefb4afb4de24e3e426a", + "loads": [ + 4, + 5, + 1, + 6, + 3, + 7, + 3, + 7, + 4, + 2, + 7, + 1, + 3, + 2, + 5, + 3, + 5, + 9, + 4, + 1, + 1, + 2, + 0, + 3, + 6, + 5, + 0, + 6, + 1, + 6, + 0, + 0, + 2, + 0, + 2, + 5, + 3, + 0, + 5, + 0, + 0, + 1, + 1, + 4, + 6, + 4, + 5, + 8, + 3, + 3, + 2, + 2, + 4, + 0, + 1, + 1, + 5, + 0, + 8, + 3, + 5, + 2, + 2, + 5 + ], + "weighted_loads": [ + 0.36753323674201965, + 0.29587921872735023, + 0.03823094442486763, + 0.33310625329613686, + 0.0880705751478672, + 0.547803983092308, + 0.08307459577918053, + 0.29359153658151627, + 0.2370268851518631, + 0.07522813603281975, + 0.2035854384303093, + 0.028325123712420464, + 0.10903149470686913, + 0.06990787386894226, + 0.15707632526755333, + 0.3099247142672539, + 0.20668738894164562, + 0.8240996450185776, + 0.2138412781059742, + 0.15655292570590973, + 0.03347751870751381, + 0.07991969585418701, + 0.0, + 0.0903805997222662, + 0.24335989728569984, + 0.7640772871673107, + 0.0, + 0.5393809154629707, + 0.030424760654568672, + 0.43890275061130524, + 0.0, + 0.0, + 0.0602395236492157, + 0.0, + 0.273623988032341, + 0.6233817413449287, + 0.1747284233570099, + 0.0, + 0.5585437454283237, + 0.0, + 0.0, + 0.031129274517297745, + 0.08316466212272644, + 0.15280147641897202, + 0.32552871480584145, + 0.539315976202488, + 0.2930266596376896, + 0.4351059626787901, + 0.09174039214849472, + 0.1379632093012333, + 0.06132390536367893, + 0.0727337896823883, + 0.12219958379864693, + 0.0, + 0.02632761001586914, + 0.03512164577841759, + 0.3174877464771271, + 0.0, + 0.8580516949295998, + 0.27176761627197266, + 0.3614004887640476, + 0.29339738190174103, + 0.0902353934943676, + 0.32341814786195755 + ], + "unique_experts": 54, + "load_cv": 0.7417364831128525, + "normalized_load_entropy": 0.920957290931798, + "max_load_share": 0.04411764705882353 + }, + "full_input": { + "tokens": 75, + "top_k": 6, + "decisions": 450, + "ordered_route_sha256": "5ad96e19660a67a8591112b7a0ba24be1a4a1b6688493574710a59d5fe85b67f", + "route_weight_sha256": "7e8b3596fc79d1516297b0bacabbb3e5abfe7f5b24a2ccb6bdd9b93ea350e5c2", + "loads": [ + 8, + 16, + 4, + 9, + 4, + 8, + 3, + 10, + 13, + 3, + 14, + 1, + 3, + 5, + 16, + 4, + 7, + 10, + 5, + 7, + 3, + 13, + 1, + 3, + 12, + 6, + 1, + 10, + 5, + 6, + 1, + 2, + 2, + 0, + 11, + 23, + 3, + 1, + 10, + 3, + 0, + 1, + 11, + 5, + 9, + 4, + 13, + 15, + 5, + 4, + 3, + 10, + 5, + 4, + 1, + 1, + 9, + 8, + 10, + 11, + 17, + 7, + 12, + 19 + ], + "weighted_loads": [ + 0.8881253935396671, + 1.3045229949057102, + 0.10668639093637466, + 2.0653884410858154, + 0.11840591207146645, + 0.6884264796972275, + 0.08307459577918053, + 0.4043014198541641, + 0.9375852327793837, + 0.19260020926594734, + 0.5087874941527843, + 0.028325123712420464, + 0.10903149470686913, + 0.12381329364143312, + 0.7045033946633339, + 0.3421039991080761, + 0.27081900276243687, + 0.8246845983085223, + 0.21522580180317163, + 0.9244036804884672, + 0.3228710927069187, + 0.8731488306075335, + 0.038416601717472076, + 0.0903805997222662, + 0.5161760896444321, + 0.8142909109592438, + 0.0008276571170426905, + 1.2403822056949139, + 0.24929877929389477, + 0.43890275061130524, + 0.03366532921791077, + 0.04288736544549465, + 0.0602395236492157, + 0.0, + 0.641373198479414, + 2.479916539043188, + 0.1747284233570099, + 0.04178895801305771, + 0.7101606437936425, + 0.35542916506528854, + 0.0, + 0.031129274517297745, + 1.2587057761847973, + 0.3343197777867317, + 0.9710059203207493, + 0.539315976202488, + 0.9329317715018988, + 0.8008620254695415, + 0.16060352511703968, + 0.1813453584909439, + 0.08766864240169525, + 0.9564112834632397, + 0.2996303476393223, + 0.1849734471179545, + 0.02632761001586914, + 0.03512164577841759, + 0.5732693523168564, + 0.38436025008559227, + 0.9684541039168835, + 0.6319724656641483, + 1.1136504942551255, + 0.658376719802618, + 0.9400777909904718, + 1.3192518204450607 + ], + "unique_experts": 62, + "load_cv": 0.7316883908021009, + "normalized_load_entropy": 0.9336902565744147, + "max_load_share": 0.051111111111111114 + } + }, + "s0_bos": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "4b6e8b5a81afcbe5921d4225805f50075263cda2a9443ca56f32be4d191a0db5", + "route_weight_sha256": "36edef6f24537fc3567ac5b6ddafbfbb8fec198c572ef42e82e9aafd34b1aad3", + "loads": [ + 4, + 5, + 1, + 6, + 1, + 7, + 3, + 8, + 4, + 2, + 2, + 1, + 2, + 3, + 3, + 4, + 5, + 9, + 4, + 1, + 2, + 2, + 1, + 1, + 6, + 5, + 0, + 7, + 6, + 4, + 2, + 0, + 2, + 0, + 2, + 5, + 3, + 0, + 5, + 0, + 1, + 3, + 1, + 2, + 5, + 4, + 5, + 8, + 3, + 3, + 3, + 2, + 3, + 0, + 1, + 1, + 5, + 0, + 8, + 3, + 5, + 2, + 3, + 5 + ], + "weighted_loads": [ + 0.406025193631649, + 0.32755227386951447, + 0.03823027387261391, + 0.3641863465309143, + 0.0291355662047863, + 0.5423074308782816, + 0.07965349033474922, + 0.30822310596704483, + 0.26713066175580025, + 0.07995361089706421, + 0.05019316263496876, + 0.025914130732417107, + 0.06722559407353401, + 0.1053925696760416, + 0.09285682626068592, + 0.3433775343000889, + 0.2164040207862854, + 0.837086845189333, + 0.2155504785478115, + 0.15643993020057678, + 0.06389611214399338, + 0.08195591904222965, + 0.02785649709403515, + 0.035152845084667206, + 0.24138187803328037, + 0.7418206632137299, + 0.0, + 0.5233403705060482, + 0.17556043714284897, + 0.4021378494799137, + 0.07213406078517437, + 0.0, + 0.06169082969427109, + 0.0, + 0.2932934910058975, + 0.611201636493206, + 0.13904975727200508, + 0.0, + 0.6020515412092209, + 0.0, + 0.026563342660665512, + 0.0884423702955246, + 0.09257239103317261, + 0.0724969394505024, + 0.30568645149469376, + 0.5513973981142044, + 0.30347130075097084, + 0.43245028890669346, + 0.09126225672662258, + 0.1341807246208191, + 0.08458996191620827, + 0.07340216636657715, + 0.09518726915121078, + 0.0, + 0.02767997607588768, + 0.03247247636318207, + 0.337212260812521, + 0.0, + 0.8403471782803535, + 0.30668624863028526, + 0.4088994413614273, + 0.3058302477002144, + 0.17334435507655144, + 0.3124360777437687 + ], + "unique_experts": 57, + "load_cv": 0.7099555682443793, + "normalized_load_entropy": 0.9317099538882768, + "max_load_share": 0.04411764705882353 + }, + "full_input": { + "tokens": 59, + "top_k": 6, + "decisions": 354, + "ordered_route_sha256": "a8fead8e24657272201a161355407a771e8f48c3f70c5e1381a7ef7f401663e1", + "route_weight_sha256": "bdbffe9c3465651e65f5cf42bd98a97e6c4010973732100461beef2bf6a3c015", + "loads": [ + 4, + 15, + 1, + 7, + 1, + 7, + 3, + 9, + 7, + 2, + 5, + 1, + 3, + 4, + 9, + 4, + 6, + 9, + 4, + 5, + 4, + 11, + 1, + 1, + 8, + 5, + 0, + 10, + 8, + 4, + 2, + 0, + 2, + 0, + 7, + 22, + 3, + 0, + 9, + 0, + 1, + 3, + 9, + 2, + 5, + 4, + 8, + 12, + 4, + 3, + 5, + 8, + 3, + 0, + 1, + 1, + 5, + 9, + 16, + 5, + 17, + 4, + 9, + 17 + ], + "weighted_loads": [ + 0.406025193631649, + 1.270757406949997, + 0.03823027387261391, + 1.0895280241966248, + 0.0291355662047863, + 0.5423074308782816, + 0.07965349033474922, + 0.3548845089972019, + 0.4461047127842903, + 0.07995361089706421, + 0.17583579756319523, + 0.025914130732417107, + 0.09920130670070648, + 0.13138181902468204, + 0.3292807564139366, + 0.3433775343000889, + 0.24653247743844986, + 0.837086845189333, + 0.2155504785478115, + 0.8448613286018372, + 0.3546755388379097, + 0.7852695528417826, + 0.02785649709403515, + 0.035152845084667206, + 0.35159377194941044, + 0.7418206632137299, + 0.0, + 0.8248205818235874, + 0.4343718960881233, + 0.4021378494799137, + 0.07213406078517437, + 0.0, + 0.06169082969427109, + 0.0, + 0.5166260153055191, + 2.7783870734274387, + 0.13904975727200508, + 0.0, + 0.785742960870266, + 0.0, + 0.026563342660665512, + 0.0884423702955246, + 0.8735765367746353, + 0.0724969394505024, + 0.30568645149469376, + 0.5513973981142044, + 0.4037479031831026, + 0.6748486030846834, + 0.1170145832002163, + 0.1341807246208191, + 0.13250654190778732, + 0.7110164482146502, + 0.09518726915121078, + 0.0, + 0.02767997607588768, + 0.03247247636318207, + 0.337212260812521, + 0.46209902688860893, + 1.2037402428686619, + 0.3924456648528576, + 1.3248354392126203, + 0.3922741003334522, + 0.6496809888631105, + 1.1800725888460875 + ], + "unique_experts": 58, + "load_cv": 0.8461571943263816, + "normalized_load_entropy": 0.9152247639234179, + "max_load_share": 0.062146892655367235 + } + }, + "s1_bos": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "207befbbf0aae73bc6209c6e21d48c2ef5dd3ac489242a784dfd0a83b8309c21", + "route_weight_sha256": "61b9ced4ad1b11d614cef77f04ca17f75e0eede6ebe10b573f20a8ab66697efa", + "loads": [ + 4, + 5, + 1, + 6, + 1, + 7, + 5, + 7, + 4, + 2, + 2, + 1, + 3, + 1, + 2, + 4, + 5, + 9, + 4, + 1, + 2, + 2, + 1, + 1, + 5, + 5, + 0, + 7, + 6, + 4, + 2, + 0, + 2, + 0, + 2, + 5, + 3, + 0, + 5, + 0, + 1, + 3, + 2, + 2, + 5, + 4, + 5, + 8, + 3, + 3, + 3, + 2, + 4, + 0, + 1, + 1, + 5, + 0, + 8, + 3, + 5, + 2, + 3, + 5 + ], + "weighted_loads": [ + 0.4201175570487976, + 0.3206809386610985, + 0.04010393097996712, + 0.3524128571152687, + 0.026651708409190178, + 0.5679388456046581, + 0.13432946242392063, + 0.29237447679042816, + 0.2864193059504032, + 0.07496707886457443, + 0.05342188477516174, + 0.026489172130823135, + 0.11007658764719963, + 0.04352454096078873, + 0.062296004965901375, + 0.37245331332087517, + 0.22491834685206413, + 0.8395363353192806, + 0.22013471275568008, + 0.15165013074874878, + 0.06556889042258263, + 0.08326252549886703, + 0.03226488083600998, + 0.03401822969317436, + 0.1960378661751747, + 0.7643263079226017, + 0.0, + 0.5216527134180069, + 0.1707730758935213, + 0.40212493389844894, + 0.0739378109574318, + 0.0, + 0.05689987912774086, + 0.0, + 0.3005822151899338, + 0.577351026237011, + 0.1477649323642254, + 0.0, + 0.5680895745754242, + 0.0, + 0.02746661938726902, + 0.08716071955859661, + 0.11295920982956886, + 0.07682008296251297, + 0.30769577622413635, + 0.5665929615497589, + 0.3141101412475109, + 0.4258878733962774, + 0.09284437634050846, + 0.13370977714657784, + 0.08354151621460915, + 0.06672852858901024, + 0.11518751084804535, + 0.0, + 0.02886102721095085, + 0.0349859744310379, + 0.3280286341905594, + 0.0, + 0.8509071581065655, + 0.3118293508887291, + 0.3822445124387741, + 0.314312607049942, + 0.1433475762605667, + 0.3156062699854374 + ], + "unique_experts": 57, + "load_cv": 0.7012374408724574, + "normalized_load_entropy": 0.9324482480937837, + "max_load_share": 0.04411764705882353 + }, + "full_input": { + "tokens": 75, + "top_k": 6, + "decisions": 450, + "ordered_route_sha256": "750115cd2c7d824f119901b9567c696b7bd6f51859071d3e041c33e31b61c9ac", + "route_weight_sha256": "e64daaa0f1de5784571c17c51a02a8c527170011a2b1acda47cbddaca3312d12", + "loads": [ + 8, + 16, + 2, + 9, + 2, + 8, + 5, + 10, + 13, + 3, + 9, + 1, + 4, + 3, + 13, + 5, + 8, + 9, + 4, + 7, + 4, + 13, + 2, + 1, + 10, + 6, + 0, + 10, + 10, + 4, + 3, + 2, + 2, + 0, + 11, + 24, + 3, + 1, + 11, + 3, + 1, + 3, + 13, + 3, + 8, + 4, + 13, + 15, + 5, + 4, + 6, + 10, + 5, + 3, + 1, + 1, + 9, + 8, + 10, + 11, + 17, + 7, + 14, + 20 + ], + "weighted_loads": [ + 0.9407097138464451, + 1.3293247148394585, + 0.06549356319010258, + 1.1418025083839893, + 0.05698704533278942, + 0.7085613422095776, + 0.13432946242392063, + 0.403084360063076, + 1.0177601370960474, + 0.19233915209770203, + 0.3586239404976368, + 0.026489172130823135, + 0.13754775933921337, + 0.09452672302722931, + 0.5702530443668365, + 0.4046325981616974, + 0.317867424339056, + 0.8395363353192806, + 0.22013471275568008, + 0.8669649343937635, + 0.34078216180205345, + 0.8993529360741377, + 0.07068148255348206, + 0.03401822969317436, + 0.4408308379352093, + 0.8145399317145348, + 0.0, + 1.206859603524208, + 0.43768386356532574, + 0.40212493389844894, + 0.10760314017534256, + 0.04288736544549465, + 0.05689987912774086, + 0.0, + 0.6683314256370068, + 2.5364217944443226, + 0.1477649323642254, + 0.04178895801305771, + 0.8321931967511773, + 0.35542916506528854, + 0.02746661938726902, + 0.08716071955859661, + 1.3411033190786839, + 0.2583383843302727, + 0.9531729817390442, + 0.5665929615497589, + 0.9619602002203465, + 0.7946738861501217, + 0.16170750930905342, + 0.17709192633628845, + 0.15686901845037937, + 0.9914514608681202, + 0.2926182746887207, + 0.1838802509009838, + 0.02886102721095085, + 0.0349859744310379, + 0.5838102400302887, + 0.3410638812929392, + 0.9613095670938492, + 0.6720342002809048, + 1.1374613204970956, + 0.679291944950819, + 1.0712699312716722, + 1.535380557179451 + ], + "unique_experts": 62, + "load_cv": 0.7316883908021009, + "normalized_load_entropy": 0.9345954393764963, + "max_load_share": 0.05333333333333334 + } + }, + "s0_x": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "1c9f5d1c7acfbd1611718944783878c482c4616131eecd478277897d82803ae1", + "route_weight_sha256": "74615a5bc3d6bd64392e10993fec545bd51821823e5d83e3ff029c6346d4faa4", + "loads": [ + 4, + 5, + 1, + 6, + 2, + 7, + 4, + 7, + 4, + 2, + 3, + 1, + 2, + 3, + 3, + 3, + 5, + 9, + 4, + 1, + 1, + 1, + 1, + 2, + 6, + 5, + 0, + 6, + 4, + 4, + 2, + 0, + 2, + 0, + 2, + 5, + 3, + 0, + 5, + 0, + 0, + 3, + 1, + 4, + 5, + 4, + 5, + 7, + 4, + 4, + 3, + 2, + 4, + 0, + 1, + 1, + 5, + 0, + 8, + 3, + 5, + 2, + 3, + 5 + ], + "weighted_loads": [ + 0.4255419224500656, + 0.32442349940538406, + 0.03845001384615898, + 0.35560090094804764, + 0.06158280745148659, + 0.5487896054983139, + 0.10810250602662563, + 0.2822094913572073, + 0.2762555107474327, + 0.0802065059542656, + 0.07710954360663891, + 0.028149792924523354, + 0.0679428018629551, + 0.10444247536361217, + 0.09949440509080887, + 0.3179355449974537, + 0.2127185333520174, + 0.8357637599110603, + 0.20226836949586868, + 0.15720528364181519, + 0.034177593886852264, + 0.05548249930143356, + 0.02610679157078266, + 0.057282812893390656, + 0.23952868953347206, + 0.7437100224196911, + 0.0, + 0.5129438377916813, + 0.11663144268095493, + 0.37914711236953735, + 0.07207371667027473, + 0.0, + 0.061394866555929184, + 0.0, + 0.2865590900182724, + 0.6263664588332176, + 0.1466061994433403, + 0.0, + 0.5717752389609814, + 0.0, + 0.0, + 0.08625129796564579, + 0.08411423116922379, + 0.13925759308040142, + 0.3009506780654192, + 0.5608708634972572, + 0.3053169623017311, + 0.3960319012403488, + 0.10379137098789215, + 0.1634160354733467, + 0.08364777825772762, + 0.07420805841684341, + 0.12892084382474422, + 0.0, + 0.029028883203864098, + 0.031991250813007355, + 0.33114636689424515, + 0.0, + 0.806260246783495, + 0.29959527030587196, + 0.364135779440403, + 0.3104693219065666, + 0.1719899233430624, + 0.3012011684477329 + ], + "unique_experts": 56, + "load_cv": 0.6812138339623611, + "normalized_load_entropy": 0.9332281651218747, + "max_load_share": 0.04411764705882353 + }, + "full_input": { + "tokens": 59, + "top_k": 6, + "decisions": 354, + "ordered_route_sha256": "dc779d5a9fa113188c2a9e4c65c93d8f367a52cd65d9575e5190b90d6c4bfcaa", + "route_weight_sha256": "2069f66ff7cdbf13a540684f9b95e5e35014463b491f416107e3b565e22f542f", + "loads": [ + 4, + 15, + 1, + 7, + 2, + 7, + 6, + 8, + 7, + 2, + 8, + 2, + 3, + 4, + 7, + 3, + 6, + 9, + 4, + 5, + 3, + 11, + 1, + 2, + 8, + 5, + 0, + 9, + 6, + 4, + 2, + 0, + 2, + 0, + 7, + 21, + 3, + 0, + 8, + 0, + 0, + 3, + 8, + 4, + 5, + 4, + 7, + 12, + 5, + 4, + 5, + 7, + 4, + 0, + 1, + 2, + 5, + 8, + 17, + 5, + 18, + 4, + 8, + 16 + ], + "weighted_loads": [ + 0.4255419224500656, + 1.2676286324858665, + 0.03845001384615898, + 1.080942578613758, + 0.06158280745148659, + 0.5487896054983139, + 0.16753059066832066, + 0.3288708943873644, + 0.45125504210591316, + 0.0802065059542656, + 0.3113164808601141, + 0.06320717744529247, + 0.09789860062301159, + 0.13300804793834686, + 0.28780004382133484, + 0.3179355449974537, + 0.2438813727349043, + 0.8357637599110603, + 0.20226836949586868, + 0.8563554286956787, + 0.33562708646059036, + 1.0562415346503258, + 0.02610679157078266, + 0.057282812893390656, + 0.349250003695488, + 0.7437100224196911, + 0.0, + 0.8095803819596767, + 0.3786271009594202, + 0.37914711236953735, + 0.07207371667027473, + 0.0, + 0.061394866555929184, + 0.0, + 0.509891614317894, + 2.732325080782175, + 0.1466061994433403, + 0.0, + 0.665333092212677, + 0.0, + 0.0, + 0.08625129796564579, + 0.7762352414429188, + 0.13925759308040142, + 0.3009506780654192, + 0.5608708634972572, + 0.37204248271882534, + 0.6693092808127403, + 0.12954369746148586, + 0.1634160354733467, + 0.13826758600771427, + 0.6344538666307926, + 0.12892084382474422, + 0.0, + 0.029028883203864098, + 0.05233701132237911, + 0.33114636689424515, + 0.4173791669309139, + 1.2985801547765732, + 0.3853546865284443, + 1.3294480526819825, + 0.39691317453980446, + 0.5970879197120667, + 0.8443856276571751 + ], + "unique_experts": 57, + "load_cv": 0.8141672242334052, + "normalized_load_entropy": 0.9213188496819106, + "max_load_share": 0.059322033898305086 + } + }, + "s1_x": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "fe009421541b598b35a0b364b1bdaa7f381c2eb2c0f6eb067e7b43fb6adc020f", + "route_weight_sha256": "87398cb4e82138fd6eb0cb701076b5785e7af1a946c49681fc00cd7d189ae515", + "loads": [ + 4, + 5, + 1, + 6, + 1, + 7, + 4, + 7, + 4, + 2, + 2, + 1, + 3, + 1, + 2, + 4, + 5, + 10, + 4, + 1, + 2, + 2, + 1, + 2, + 4, + 5, + 0, + 7, + 4, + 4, + 3, + 2, + 1, + 0, + 2, + 5, + 4, + 0, + 3, + 0, + 1, + 4, + 2, + 3, + 4, + 4, + 5, + 8, + 3, + 3, + 4, + 1, + 3, + 0, + 1, + 2, + 5, + 0, + 8, + 3, + 5, + 2, + 3, + 5 + ], + "weighted_loads": [ + 0.4413968548178673, + 0.3147246278822422, + 0.03987883776426315, + 0.34587226063013077, + 0.02736731618642807, + 0.5868847779929638, + 0.1065446026623249, + 0.29258619621396065, + 0.29776720330119133, + 0.07336450740695, + 0.05265052430331707, + 0.02636590041220188, + 0.1077893041074276, + 0.040244728326797485, + 0.05937293730676174, + 0.3880999907851219, + 0.2208331823348999, + 0.8711600974202156, + 0.21441957354545593, + 0.15168091654777527, + 0.0651814416050911, + 0.08223110251128674, + 0.03435470163822174, + 0.057235682383179665, + 0.15859938599169254, + 0.7607999369502068, + 0.0, + 0.5219746306538582, + 0.11267221346497536, + 0.39183085784316063, + 0.11294043436646461, + 0.055636169388890266, + 0.0304594486951828, + 0.0, + 0.2979447990655899, + 0.6030895486474037, + 0.17659464851021767, + 0.0, + 0.46296384185552597, + 0.0, + 0.027288392186164856, + 0.11210339702665806, + 0.11048190854489803, + 0.11738261580467224, + 0.2723489888012409, + 0.5592838525772095, + 0.3169380612671375, + 0.4189525321125984, + 0.08942230604588985, + 0.1330846045166254, + 0.10944237001240253, + 0.03215683624148369, + 0.08740377239882946, + 0.0, + 0.029237093403935432, + 0.06158405356109142, + 0.31977003440260887, + 0.0, + 0.8437533192336559, + 0.30575166270136833, + 0.35606734082102776, + 0.3179491460323334, + 0.1476013995707035, + 0.2981240637600422 + ], + "unique_experts": 58, + "load_cv": 0.6834676493307206, + "normalized_load_entropy": 0.9377615597473932, + "max_load_share": 0.049019607843137254 + }, + "full_input": { + "tokens": 75, + "top_k": 6, + "decisions": 450, + "ordered_route_sha256": "f714fd710eb966a12509d798ec236db72d4db4999df70e3dad2b58f9914e5252", + "route_weight_sha256": "a31df1c21ea708ddcdb34d21a5e8686e3fbdba535a95ef717f94c9640da567d7", + "loads": [ + 8, + 16, + 4, + 8, + 2, + 8, + 4, + 10, + 13, + 3, + 11, + 2, + 4, + 3, + 10, + 5, + 8, + 10, + 4, + 7, + 4, + 14, + 2, + 2, + 9, + 6, + 0, + 10, + 8, + 4, + 4, + 4, + 1, + 0, + 11, + 24, + 4, + 1, + 8, + 3, + 1, + 4, + 12, + 4, + 7, + 4, + 13, + 16, + 5, + 4, + 7, + 8, + 4, + 3, + 1, + 2, + 9, + 7, + 11, + 12, + 18, + 7, + 13, + 19 + ], + "weighted_loads": [ + 0.9619890116155148, + 1.3233684040606022, + 0.11141820251941681, + 1.1027420796453953, + 0.05770265311002731, + 0.7275072745978832, + 0.1065446026623249, + 0.4032960794866085, + 1.0310961473733187, + 0.1907365806400776, + 0.4718960430473089, + 0.06145082227885723, + 0.13411063700914383, + 0.09281199984252453, + 0.49130770191550255, + 0.42027927562594414, + 0.3188171423971653, + 0.8711600974202156, + 0.21441957354545593, + 0.8768951576203108, + 0.34213054925203323, + 1.1808093823492527, + 0.07277130335569382, + 0.057235682383179665, + 0.4041179846972227, + 0.8110135607421398, + 0.0, + 1.2049754336476326, + 0.380963072180748, + 0.39183085784316063, + 0.14660576358437538, + 0.09852353483438492, + 0.0304594486951828, + 0.0, + 0.6656940095126629, + 2.538349434733391, + 0.17659464851021767, + 0.04178895801305771, + 0.6067953603342175, + 0.35542916506528854, + 0.027288392186164856, + 0.11210339702665806, + 1.2784299049526453, + 0.29890091717243195, + 0.9178261943161488, + 0.5592838525772095, + 0.9654867425560951, + 0.8181329425424337, + 0.15828543901443481, + 0.17646675370633602, + 0.18831737898290157, + 0.8902623318135738, + 0.2648345362395048, + 0.1838802509009838, + 0.029237093403935432, + 0.06158405356109142, + 0.5755516402423382, + 0.31140121072530746, + 1.0601195767521858, + 0.697741623967886, + 1.1573534375056624, + 0.6829284839332104, + 1.024262247607112, + 1.238495010882616 + ], + "unique_experts": 62, + "load_cv": 0.7084254842018789, + "normalized_load_entropy": 0.9402336666092574, + "max_load_share": 0.05333333333333334 + } + }, + "s0_period": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "a0fdccbd2457507d2032b6418d8cce6d1ce44c8a124e5119fccb0fca3b6031ed", + "route_weight_sha256": "600730a3e317cb5a5efdffef49ad3c8469cf2653d584e3090fe5179d9a767e09", + "loads": [ + 4, + 5, + 1, + 6, + 2, + 7, + 4, + 7, + 4, + 2, + 2, + 1, + 2, + 3, + 3, + 3, + 5, + 9, + 4, + 1, + 1, + 1, + 1, + 1, + 5, + 5, + 0, + 6, + 6, + 4, + 1, + 0, + 2, + 0, + 2, + 5, + 3, + 0, + 5, + 0, + 0, + 3, + 1, + 5, + 6, + 4, + 5, + 7, + 4, + 3, + 4, + 2, + 4, + 0, + 1, + 1, + 5, + 0, + 8, + 3, + 5, + 2, + 3, + 5 + ], + "weighted_loads": [ + 0.4370366707444191, + 0.31875917315483093, + 0.0387708842754364, + 0.3601723834872246, + 0.06275519169867039, + 0.5449184142053127, + 0.10817825049161911, + 0.2797142956405878, + 0.2662178613245487, + 0.07877092063426971, + 0.04925753176212311, + 0.028042223304510117, + 0.06845513358712196, + 0.10283047519624233, + 0.09263478964567184, + 0.3192501924932003, + 0.21608156524598598, + 0.8359270468354225, + 0.20441363751888275, + 0.15718838572502136, + 0.0345098040997982, + 0.05509902164340019, + 0.026261623948812485, + 0.03416798263788223, + 0.2113654948771, + 0.7421364113688469, + 0.0, + 0.5154340974986553, + 0.1661074124276638, + 0.39109518378973007, + 0.04037851467728615, + 0.0, + 0.06127775087952614, + 0.0, + 0.2836059033870697, + 0.6212708204984665, + 0.14529135450720787, + 0.0, + 0.5729949586093426, + 0.0, + 0.0, + 0.08782517910003662, + 0.08336126059293747, + 0.17024042457342148, + 0.32515328004956245, + 0.5606334134936333, + 0.2964610084891319, + 0.39240950904786587, + 0.10454034432768822, + 0.13618005067110062, + 0.11121177859604359, + 0.07490302249789238, + 0.12804397381842136, + 0.0, + 0.028945812955498695, + 0.032384734600782394, + 0.3366010822355747, + 0.0, + 0.8056482747197151, + 0.29774194583296776, + 0.36363571137189865, + 0.3044939935207367, + 0.16962851770222187, + 0.2928217053413391 + ], + "unique_experts": 56, + "load_cv": 0.7012374408724574, + "normalized_load_entropy": 0.9296623742913189, + "max_load_share": 0.04411764705882353 + }, + "full_input": { + "tokens": 59, + "top_k": 6, + "decisions": 354, + "ordered_route_sha256": "74608bd79da0a7a4bac28b50a6549b1388b3991215e7dfc3fd77f08dfe7cfe7c", + "route_weight_sha256": "6ba9525bc08d95d9e1e91bd389a19a0ac388e53ca11d3d7f4f069de3ec96f0de", + "loads": [ + 5, + 15, + 1, + 8, + 2, + 7, + 4, + 8, + 8, + 2, + 5, + 1, + 2, + 4, + 8, + 4, + 5, + 9, + 4, + 5, + 3, + 10, + 1, + 1, + 8, + 5, + 0, + 9, + 8, + 4, + 1, + 0, + 2, + 1, + 7, + 20, + 3, + 0, + 9, + 0, + 0, + 3, + 8, + 5, + 6, + 4, + 8, + 12, + 6, + 3, + 6, + 7, + 4, + 0, + 1, + 2, + 5, + 8, + 16, + 5, + 19, + 4, + 8, + 15 + ], + "weighted_loads": [ + 0.7306600883603096, + 1.2619643062353134, + 0.0387708842754364, + 1.1185077987611294, + 0.06275519169867039, + 0.5449184142053127, + 0.10817825049161911, + 0.3263756986707449, + 0.48720864951610565, + 0.07877092063426971, + 0.17490016669034958, + 0.028042223304510117, + 0.06845513358712196, + 0.13129784353077412, + 0.30517868883907795, + 0.36375346034765244, + 0.21608156524598598, + 0.8359270468354225, + 0.20441363751888275, + 0.8824991434812546, + 0.2783544100821018, + 0.9268331490457058, + 0.026261623948812485, + 0.03416798263788223, + 0.35050575993955135, + 0.7421364113688469, + 0.0, + 0.8145834393799305, + 0.3966771252453327, + 0.39109518378973007, + 0.04037851467728615, + 0.0, + 0.06127775087952614, + 0.04806160554289818, + 0.5069384276866913, + 2.6723284907639027, + 0.14529135450720787, + 0.0, + 0.7267925553023815, + 0.0, + 0.0, + 0.08782517910003662, + 0.7909068055450916, + 0.17024042457342148, + 0.32515328004956245, + 0.5606334134936333, + 0.38909797742962837, + 0.6690418962389231, + 0.15662569738924503, + 0.13618005067110062, + 0.16662641800940037, + 0.6145650073885918, + 0.12804397381842136, + 0.0, + 0.028945812955498695, + 0.05250417813658714, + 0.3366010822355747, + 0.41190872341394424, + 1.1690413393080235, + 0.3835013620555401, + 1.3322190446779132, + 0.39093784615397453, + 0.5974144376814365, + 0.7896101791411638 + ], + "unique_experts": 58, + "load_cv": 0.8091334415105091, + "normalized_load_entropy": 0.9208894557585412, + "max_load_share": 0.05649717514124294 + } + }, + "s1_period": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "21b1818edc27b3c9176bc1d139efd063bd19647451d1cbed17b9802cecd0d639", + "route_weight_sha256": "eb45de15c1912b03fca35e7f5171de26ee886a0980e4edc06688577d44e33b01", + "loads": [ + 4, + 5, + 1, + 6, + 2, + 7, + 4, + 7, + 4, + 2, + 2, + 1, + 3, + 1, + 1, + 4, + 5, + 10, + 4, + 1, + 2, + 2, + 1, + 2, + 4, + 5, + 0, + 7, + 4, + 4, + 3, + 2, + 2, + 0, + 2, + 5, + 4, + 0, + 3, + 0, + 1, + 4, + 1, + 3, + 4, + 4, + 5, + 8, + 3, + 3, + 4, + 2, + 3, + 0, + 1, + 1, + 5, + 0, + 8, + 3, + 5, + 2, + 3, + 5 + ], + "weighted_loads": [ + 0.4491734728217125, + 0.3135896399617195, + 0.03976428508758545, + 0.3492548353970051, + 0.05195796117186546, + 0.5863197594881058, + 0.10797873698174953, + 0.2923594266176224, + 0.2905264087021351, + 0.0729830153286457, + 0.05236871726810932, + 0.026941657066345215, + 0.10702688619494438, + 0.03980182483792305, + 0.025418343022465706, + 0.3865544721484184, + 0.22125927545130253, + 0.866460831835866, + 0.21548297069966793, + 0.1517956405878067, + 0.06607738882303238, + 0.0818589348345995, + 0.034326616674661636, + 0.057355670258402824, + 0.1595610696822405, + 0.7554393820464611, + 0.0, + 0.5205457359552383, + 0.11326608993113041, + 0.39935047924518585, + 0.11192724294960499, + 0.05537335202097893, + 0.0564320832490921, + 0.0, + 0.294867604970932, + 0.599099911749363, + 0.17978282272815704, + 0.0, + 0.4648502767086029, + 0.0, + 0.027161506935954094, + 0.11266136914491653, + 0.08442655950784683, + 0.11791231855750084, + 0.2732190527021885, + 0.5592492520809174, + 0.3095204643905163, + 0.4173393193632364, + 0.08965594507753849, + 0.13473031111061573, + 0.11070094630122185, + 0.06235027313232422, + 0.08647019602358341, + 0.0, + 0.02909564971923828, + 0.036557815968990326, + 0.32203853502869606, + 0.0, + 0.8412037082016468, + 0.30697791278362274, + 0.3524828553199768, + 0.3120834678411484, + 0.14819661155343056, + 0.2924051657319069 + ], + "unique_experts": 58, + "load_cv": 0.6834676493307206, + "normalized_load_entropy": 0.9377615597473932, + "max_load_share": 0.049019607843137254 + }, + "full_input": { + "tokens": 75, + "top_k": 6, + "decisions": 450, + "ordered_route_sha256": "2698c3e866edf9988e039bedd86da89da5eacc196332251f1bc47859d7d6fc1d", + "route_weight_sha256": "3f351dbb35269697a7da6f8f89ca08cbbc51830a9246740a226127958693bcb9", + "loads": [ + 9, + 16, + 4, + 9, + 3, + 8, + 4, + 10, + 14, + 3, + 9, + 1, + 3, + 3, + 9, + 6, + 8, + 10, + 4, + 7, + 4, + 13, + 2, + 2, + 9, + 6, + 0, + 10, + 8, + 4, + 4, + 4, + 2, + 1, + 11, + 22, + 4, + 1, + 9, + 3, + 1, + 4, + 11, + 4, + 7, + 4, + 14, + 16, + 6, + 4, + 7, + 9, + 4, + 3, + 1, + 1, + 9, + 7, + 10, + 12, + 19, + 7, + 13, + 18 + ], + "weighted_loads": [ + 1.2370569370687008, + 1.3222334161400795, + 0.1111464574933052, + 1.1417465955018997, + 0.0822932980954647, + 0.7269422560930252, + 0.10797873698174953, + 0.40306930989027023, + 1.0665365848690271, + 0.1903550885617733, + 0.3575707729905844, + 0.026941657066345215, + 0.10702688619494438, + 0.09230882301926613, + 0.45689075253903866, + 0.45371943339705467, + 0.3180206697434187, + 0.866460831835866, + 0.21548297069966793, + 0.9072469603270292, + 0.30018172413110733, + 1.008575975894928, + 0.07274321839213371, + 0.057355670258402824, + 0.4045694116503, + 0.8056530058383942, + 0.0, + 1.2061884999275208, + 0.349707817658782, + 0.39935047924518585, + 0.14559257216751575, + 0.09826071746647358, + 0.0564320832490921, + 0.040147244930267334, + 0.662616815418005, + 2.4397391714155674, + 0.17978282272815704, + 0.04178895801305771, + 0.677084063179791, + 0.35542916506528854, + 0.027161506935954094, + 0.11266136914491653, + 1.2651218250393867, + 0.29943061992526054, + 0.9186962582170963, + 0.5592492520809174, + 0.9839455708861351, + 0.8202627003192902, + 0.18273872882127762, + 0.17811246030032635, + 0.18990187533199787, + 0.8904005661606789, + 0.26390095986425877, + 0.1838802509009838, + 0.02909564971923828, + 0.036557815968990326, + 0.5778201408684254, + 0.3068147264420986, + 0.9516061171889305, + 0.6982129421085119, + 1.167327736504376, + 0.6770628057420254, + 1.026558754965663, + 1.1778746098279953 + ], + "unique_experts": 63, + "load_cv": 0.6898917431626144, + "normalized_load_entropy": 0.942945390870734, + "max_load_share": 0.04888888888888889 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 34, + "ordered_topk_exact_tokens": 24, + "set_exact_tokens": 26, + "mean_set_jaccard": 0.9327731092436975, + "mean_token_weighted_tv": 0.012913875583121005, + "aggregate_load_tv": 0.0392156862745098 + }, + "system_bos": { + "tokens": 34, + "ordered_topk_exact_tokens": 20, + "set_exact_tokens": 29, + "mean_set_jaccard": 0.9579831932773111, + "mean_token_weighted_tv": 0.014575161669841585, + "aggregate_load_tv": 0.024509803921568624 + }, + "system_x": { + "tokens": 34, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 18, + "mean_set_jaccard": 0.8592436974789917, + "mean_token_weighted_tv": 0.028114523574271622, + "aggregate_load_tv": 0.0784313725490196 + }, + "system_period": { + "tokens": 34, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.8508403361344539, + "mean_token_weighted_tv": 0.028950837139478502, + "aggregate_load_tv": 0.07352941176470588 + }, + "bos_at_s0": { + "tokens": 34, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.8151260504201682, + "mean_token_weighted_tv": 0.03450929603594191, + "aggregate_load_tv": 0.08333333333333334 + }, + "bos_at_s1": { + "tokens": 34, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.8235294117647058, + "mean_token_weighted_tv": 0.03373067223412149, + "aggregate_load_tv": 0.09313725490196079 + }, + "x_at_s0": { + "tokens": 34, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.8298319327731093, + "mean_token_weighted_tv": 0.031092686249929315, + "aggregate_load_tv": 0.058823529411764705 + }, + "x_at_s1": { + "tokens": 34, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 12, + "mean_set_jaccard": 0.7773109243697479, + "mean_token_weighted_tv": 0.03990480503724778, + "aggregate_load_tv": 0.11764705882352941 + }, + "period_at_s0": { + "tokens": 34, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.8319327731092437, + "mean_token_weighted_tv": 0.030749476021703553, + "aggregate_load_tv": 0.07352941176470588 + }, + "period_at_s1": { + "tokens": 34, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 12, + "mean_set_jaccard": 0.7773109243697479, + "mean_token_weighted_tv": 0.039841479183558154, + "aggregate_load_tv": 0.10784313725490197 + } + } + }, + "layer_03": { + "layer": 3, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "428bd223fd1b6c3fe9a96f207ecd5be85fe7541b68017a4ed98f3c0c7fa5a933", + "route_weight_sha256": "16b0d71838cceec87b6b384ad65f7480b9987f475f9741d526b993516b3757ab", + "loads": [ + 0, + 6, + 8, + 5, + 7, + 0, + 10, + 0, + 1, + 0, + 0, + 1, + 10, + 2, + 5, + 1, + 7, + 3, + 1, + 3, + 4, + 4, + 4, + 0, + 4, + 3, + 10, + 5, + 4, + 2, + 5, + 2, + 4, + 3, + 5, + 1, + 1, + 1, + 7, + 0, + 0, + 3, + 0, + 4, + 2, + 2, + 5, + 2, + 0, + 4, + 2, + 4, + 5, + 4, + 1, + 5, + 2, + 1, + 3, + 2, + 1, + 1, + 10, + 2 + ], + "weighted_loads": [ + 0.0, + 0.3787859044969082, + 0.7101285569369793, + 0.24804836511611938, + 0.7536662518978119, + 0.0, + 0.7511491309851408, + 0.0, + 0.019097262993454933, + 0.0, + 0.0, + 0.028659220784902573, + 0.6558028366416693, + 0.06887267157435417, + 0.6661621555685997, + 0.028287537395954132, + 0.6551448404788971, + 0.13363799825310707, + 0.030600516125559807, + 0.13076679781079292, + 0.22876129671931267, + 0.29393514059484005, + 0.17902030795812607, + 0.0, + 0.24914449825882912, + 0.11558017879724503, + 1.0650464426726103, + 0.3169694170355797, + 0.3095897473394871, + 0.08815694972872734, + 0.40769631788134575, + 0.05741593986749649, + 0.3207801282405853, + 0.2345476783812046, + 0.27192745357751846, + 0.02937977761030197, + 0.03075018711388111, + 0.033529333770275116, + 0.5299666449427605, + 0.0, + 0.0, + 0.10680683329701424, + 0.0, + 0.28979622572660446, + 0.10550816357135773, + 0.23598753660917282, + 0.31357307359576225, + 0.2003621906042099, + 0.0, + 0.21608489006757736, + 0.08056982606649399, + 0.19853992387652397, + 0.21191897243261337, + 0.48918889462947845, + 0.04088274762034416, + 0.34719033911824226, + 0.12033903785049915, + 0.029279375448822975, + 0.25767554342746735, + 0.20179783925414085, + 0.03411317244172096, + 0.034665338695049286, + 1.2488368563354015, + 0.12890613824129105 + ], + "unique_experts": 54, + "load_cv": 0.8426811351742862, + "normalized_load_entropy": 0.9088455627374827, + "max_load_share": 0.049019607843137254 + }, + "full_input": { + "tokens": 59, + "top_k": 6, + "decisions": 354, + "ordered_route_sha256": "907f1fc584a3311d109895a20d5a22d1b245e18f1a414a0733a14968b3cb0520", + "route_weight_sha256": "74d3568406d4ec03c7d76396ba7a72e7a7e522bb858f39f3f932a5dfd1f9031d", + "loads": [ + 9, + 6, + 8, + 16, + 10, + 2, + 10, + 7, + 1, + 5, + 1, + 2, + 12, + 6, + 12, + 1, + 7, + 3, + 1, + 3, + 6, + 7, + 9, + 1, + 4, + 5, + 10, + 12, + 4, + 6, + 6, + 2, + 4, + 3, + 14, + 1, + 1, + 1, + 8, + 0, + 0, + 4, + 9, + 5, + 2, + 2, + 21, + 2, + 7, + 14, + 3, + 4, + 6, + 4, + 5, + 5, + 2, + 2, + 3, + 2, + 8, + 1, + 13, + 4 + ], + "weighted_loads": [ + 1.2777690067887306, + 0.3787859044969082, + 0.7101285569369793, + 0.8732369504868984, + 0.8352102063363418, + 0.0862988606095314, + 0.7511491309851408, + 1.1506293378770351, + 0.019097262993454933, + 0.21577719517517835, + 0.035993028432130814, + 0.029532843036577106, + 0.6678143974277191, + 0.41858773306012154, + 1.168429870158434, + 0.028287537395954132, + 0.6551448404788971, + 0.13363799825310707, + 0.030600516125559807, + 0.13076679781079292, + 0.2975908424705267, + 0.6229098867624998, + 0.534741148352623, + 0.02741943672299385, + 0.24914449825882912, + 0.12926991580752656, + 1.0650464426726103, + 0.5776234269142151, + 0.3095897473394871, + 0.26774499751627445, + 0.4543294124305248, + 0.05741593986749649, + 0.3207801282405853, + 0.2345476783812046, + 1.3017413690686226, + 0.02937977761030197, + 0.03075018711388111, + 0.033529333770275116, + 0.577866155654192, + 0.0, + 0.0, + 0.11820611450821161, + 0.5429053194820881, + 0.3241892233490944, + 0.10550816357135773, + 0.23598753660917282, + 2.067313302308321, + 0.2003621906042099, + 0.7896894961595535, + 0.8313903659582138, + 0.11035577207803726, + 0.19853992387652397, + 0.22665996849536896, + 0.48918889462947845, + 1.8718902729451656, + 0.34719033911824226, + 0.12033903785049915, + 0.04208251740783453, + 0.25767554342746735, + 0.20179783925414085, + 0.5203539412468672, + 0.034665338695049286, + 1.5738049484789371, + 0.20183391869068146 + ], + "unique_experts": 62, + "load_cv": 0.7847821657348789, + "normalized_load_entropy": 0.9288090155647265, + "max_load_share": 0.059322033898305086 + } + }, + "s1_eos": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "e510a0b37071a4584de039c0a8e1ccef31cb9af56e0a378c5217dd8a59383388", + "route_weight_sha256": "ce2b56c2ac9f49b8486248ee5155b8e4ac5cd8da89ba7282a6b298e80419dcb5", + "loads": [ + 0, + 6, + 8, + 5, + 7, + 1, + 10, + 0, + 1, + 0, + 0, + 2, + 10, + 2, + 5, + 1, + 7, + 3, + 1, + 3, + 4, + 4, + 4, + 0, + 4, + 3, + 10, + 5, + 4, + 2, + 5, + 1, + 4, + 3, + 6, + 1, + 1, + 0, + 8, + 0, + 0, + 2, + 0, + 4, + 2, + 2, + 5, + 2, + 0, + 4, + 2, + 4, + 5, + 4, + 1, + 5, + 2, + 1, + 3, + 2, + 1, + 1, + 9, + 2 + ], + "weighted_loads": [ + 0.0, + 0.3754900246858597, + 0.7126321047544479, + 0.2428313698619604, + 0.750613771378994, + 0.03266056627035141, + 0.7657253704965115, + 0.0, + 0.019559284672141075, + 0.0, + 0.0, + 0.05850011110305786, + 0.6458346117287874, + 0.06814667955040932, + 0.6535491645336151, + 0.02871635928750038, + 0.6580065749585629, + 0.1357077695429325, + 0.028985831886529922, + 0.1292448341846466, + 0.2265690714120865, + 0.3006201200187206, + 0.18060101568698883, + 0.0, + 0.2511458583176136, + 0.11886799335479736, + 1.0489487387239933, + 0.3169340118765831, + 0.31512637808918953, + 0.08869520202279091, + 0.4113260842859745, + 0.030968336388468742, + 0.32067715376615524, + 0.23465680703520775, + 0.30147303454577923, + 0.02971842885017395, + 0.029887083917856216, + 0.0, + 0.5653108470141888, + 0.0, + 0.0, + 0.07718829810619354, + 0.0, + 0.27955272048711777, + 0.10282927379012108, + 0.23473431915044785, + 0.30475908145308495, + 0.20356768369674683, + 0.0, + 0.21423763036727905, + 0.08009835332632065, + 0.19487223029136658, + 0.213656734675169, + 0.4970538541674614, + 0.04101858660578728, + 0.3501218780875206, + 0.12304502725601196, + 0.029742533341050148, + 0.25675706937909126, + 0.20472821965813637, + 0.033533670008182526, + 0.033828556537628174, + 1.2319411151111126, + 0.12665433809161186 + ], + "unique_experts": 54, + "load_cv": 0.8445041359748247, + "normalized_load_entropy": 0.90818885796834, + "max_load_share": 0.049019607843137254 + }, + "full_input": { + "tokens": 75, + "top_k": 6, + "decisions": 450, + "ordered_route_sha256": "e0a2cd4bf5553454b89857b35a883ed2ce71c9b9e36497f7e83d6f7402e406f8", + "route_weight_sha256": "4e5ea2f478d56c4ec408fffb00c6662a84e6e1bb6e0b55d0a6e27d5e405989e5", + "loads": [ + 13, + 8, + 8, + 17, + 9, + 5, + 10, + 10, + 1, + 8, + 4, + 3, + 14, + 7, + 14, + 2, + 9, + 3, + 2, + 3, + 6, + 10, + 14, + 1, + 6, + 6, + 10, + 8, + 4, + 5, + 6, + 1, + 4, + 5, + 14, + 1, + 1, + 5, + 9, + 1, + 1, + 3, + 14, + 7, + 2, + 5, + 25, + 2, + 9, + 14, + 2, + 10, + 9, + 9, + 7, + 9, + 2, + 2, + 10, + 3, + 13, + 2, + 14, + 9 + ], + "weighted_loads": [ + 1.6589244678616524, + 0.4498263746500015, + 0.7126321047544479, + 0.9322908539324999, + 0.8037892173742875, + 0.2206810861825943, + 0.7657253704965115, + 1.220090264454484, + 0.019559284672141075, + 0.4005799397127703, + 0.11328450590372086, + 0.059373733354732394, + 0.7349414007621817, + 0.4785749651491642, + 1.33094622194767, + 0.0776229128241539, + 0.8705655820667744, + 0.1357077695429325, + 0.08459489792585373, + 0.1292448341846466, + 0.2928861118853092, + 0.7298347763717175, + 1.0335569605231285, + 0.02891962230205536, + 0.35453759878873825, + 0.17571717052487656, + 1.0489487387239933, + 0.4126927573233843, + 0.31512637808918953, + 0.22787322476506233, + 0.4527941718697548, + 0.030968336388468742, + 0.32067715376615524, + 0.30731602758169174, + 1.2208207789808512, + 0.02971842885017395, + 0.029887083917856216, + 0.41566865891218185, + 0.6167992278933525, + 0.05054463818669319, + 0.07496336102485657, + 0.08603381551802158, + 0.6702608093619347, + 0.38562724739313126, + 0.10282927379012108, + 0.47630295157432556, + 2.642911223694682, + 0.20356768369674683, + 1.09943662956357, + 0.6805750243365765, + 0.08009835332632065, + 0.9762765802443027, + 0.4248997028917074, + 1.21053346991539, + 2.0133646931499243, + 0.5829691309481859, + 0.12304502725601196, + 0.038801426999270916, + 0.7419201321899891, + 0.23505615442991257, + 0.7769120670855045, + 0.08409051969647408, + 1.645261112600565, + 0.5684648640453815 + ], + "unique_experts": 64, + "load_cv": 0.6912647203353046, + "normalized_load_entropy": 0.9425628032993045, + "max_load_share": 0.05555555555555555 + } + }, + "s0_bos": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "7d230ffa92984697351a5aa41ec3ac95bdcc1ebdbc6109746b96453c4e71910e", + "route_weight_sha256": "8b58dfcfda9cd18de16795e0b1df384753132ccd1a14efadce1f2640a99c0f24", + "loads": [ + 0, + 5, + 10, + 5, + 7, + 2, + 9, + 0, + 0, + 0, + 0, + 1, + 10, + 2, + 5, + 1, + 7, + 3, + 0, + 3, + 4, + 4, + 4, + 1, + 5, + 3, + 9, + 5, + 4, + 2, + 5, + 2, + 4, + 3, + 5, + 1, + 0, + 1, + 8, + 0, + 0, + 3, + 0, + 4, + 2, + 2, + 4, + 2, + 0, + 4, + 2, + 4, + 5, + 4, + 1, + 5, + 3, + 0, + 3, + 3, + 1, + 0, + 10, + 2 + ], + "weighted_loads": [ + 0.0, + 0.3525489829480648, + 0.7961345110088587, + 0.24895520880818367, + 0.8068019077181816, + 0.06704061850905418, + 0.7182176485657692, + 0.0, + 0.0, + 0.0, + 0.0, + 0.027887975797057152, + 0.6301847118884325, + 0.07014701887965202, + 0.6574146077036858, + 0.027563665062189102, + 0.6618929915130138, + 0.12886967882514, + 0.0, + 0.12909222021698952, + 0.21671678498387337, + 0.29872626438736916, + 0.19407477229833603, + 0.027593383565545082, + 0.27256519347429276, + 0.11110909841954708, + 1.015759289264679, + 0.3084724545478821, + 0.35649548843503, + 0.08964454755187035, + 0.3981782756745815, + 0.05971374362707138, + 0.31552203744649887, + 0.2379421852529049, + 0.26312341168522835, + 0.030881164595484734, + 0.0, + 0.03686845302581787, + 0.5447157435119152, + 0.0, + 0.0, + 0.09987261518836021, + 0.0, + 0.26467255875468254, + 0.10826588422060013, + 0.2431781366467476, + 0.26701174676418304, + 0.19123011827468872, + 0.0, + 0.20281490683555603, + 0.08328481763601303, + 0.1880405880510807, + 0.20341893285512924, + 0.4490925669670105, + 0.037479840219020844, + 0.3647637106478214, + 0.13514326699078083, + 0.0, + 0.2696848474442959, + 0.251597598195076, + 0.0402977280318737, + 0.0, + 1.20486431568861, + 0.12356686592102051 + ], + "unique_experts": 51, + "load_cv": 0.8535607395952516, + "normalized_load_entropy": 0.9024750356973507, + "max_load_share": 0.049019607843137254 + }, + "full_input": { + "tokens": 59, + "top_k": 6, + "decisions": 354, + "ordered_route_sha256": "b92d861bb68e2c6f1231b9612199a0d61465c3ed85546244bcb36ff04314402d", + "route_weight_sha256": "15225b15eedeefa2d4ed29ae5a07fe44ea6d548c3aaa48d9f70b4a8fcc51571a", + "loads": [ + 10, + 5, + 10, + 16, + 10, + 4, + 9, + 7, + 0, + 5, + 2, + 2, + 11, + 6, + 12, + 1, + 7, + 3, + 1, + 3, + 6, + 7, + 9, + 2, + 5, + 4, + 9, + 12, + 4, + 7, + 6, + 2, + 4, + 3, + 13, + 1, + 0, + 1, + 9, + 0, + 0, + 3, + 10, + 5, + 2, + 3, + 19, + 2, + 8, + 14, + 3, + 4, + 5, + 4, + 4, + 6, + 3, + 0, + 3, + 3, + 8, + 0, + 13, + 4 + ], + "weighted_loads": [ + 1.3779405914247036, + 0.3525489829480648, + 0.7961345110088587, + 0.8755530491471291, + 0.8820144034689292, + 0.16296570375561714, + 0.7182176485657692, + 1.1005028448998928, + 0.0, + 0.23329216532874852, + 0.06848542392253876, + 0.028761598048731685, + 0.6306588735315017, + 0.4352240823209286, + 1.1760263554751873, + 0.027563665062189102, + 0.6618929915130138, + 0.12886967882514, + 0.03692387416958809, + 0.12909222021698952, + 0.2891217488795519, + 0.6242056153714657, + 0.5459945872426033, + 0.05501282028853893, + 0.27256519347429276, + 0.11163526884047315, + 1.015759289264679, + 0.5691264644265175, + 0.35649548843503, + 0.3142204061150551, + 0.4448113702237606, + 0.05971374362707138, + 0.31552203744649887, + 0.2379421852529049, + 1.255741748958826, + 0.030881164595484734, + 0.0, + 0.03686845302581787, + 0.5946941263973713, + 0.0, + 0.0, + 0.09987261518836021, + 0.6650148220360279, + 0.2987419255077839, + 0.10826588422060013, + 0.28791575878858566, + 1.9918754268437624, + 0.19123011827468872, + 0.8626945652067661, + 0.8181203827261925, + 0.11431431025266647, + 0.1880405880510807, + 0.20341893285512924, + 0.4490925669670105, + 1.168314978480339, + 0.4049121104180813, + 0.13514326699078083, + 0.0, + 0.2696848474442959, + 0.251597598195076, + 0.5211641993373632, + 0.0, + 1.5298324078321457, + 0.20197788998484612 + ], + "unique_experts": 58, + "load_cv": 0.7683408106198736, + "normalized_load_entropy": 0.9259570814487601, + "max_load_share": 0.05367231638418079 + } + }, + "s1_bos": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "e02079992a5465d7c1b3a604b8792fda308daf5863f287c5fd0f8f12745aa664", + "route_weight_sha256": "f96abbbc8ac257347f1edb635a15b28f217b8bdcd22b747050d010bda205cecd", + "loads": [ + 0, + 5, + 9, + 4, + 8, + 2, + 9, + 0, + 0, + 0, + 0, + 1, + 10, + 2, + 5, + 1, + 7, + 3, + 1, + 3, + 4, + 4, + 4, + 1, + 6, + 3, + 9, + 5, + 4, + 2, + 5, + 3, + 4, + 3, + 5, + 1, + 0, + 1, + 8, + 0, + 0, + 2, + 0, + 4, + 2, + 2, + 4, + 2, + 0, + 4, + 2, + 3, + 4, + 4, + 1, + 5, + 3, + 0, + 3, + 4, + 1, + 0, + 10, + 2 + ], + "weighted_loads": [ + 0.0, + 0.3515689969062805, + 0.7506108619272709, + 0.2086514662951231, + 0.8134992737323046, + 0.06752208434045315, + 0.7132105343043804, + 0.0, + 0.0, + 0.0, + 0.0, + 0.029157130047678947, + 0.6271939035505056, + 0.06867361813783646, + 0.6494793742895126, + 0.02866392768919468, + 0.6426493376493454, + 0.1303156241774559, + 0.028872545808553696, + 0.127755519002676, + 0.21588239446282387, + 0.3015259876847267, + 0.19150878116488457, + 0.026674574241042137, + 0.29858306236565113, + 0.1257108673453331, + 1.0065160281956196, + 0.3106739707291126, + 0.36625901609659195, + 0.08232663571834564, + 0.39215829223394394, + 0.08980765752494335, + 0.3116251155734062, + 0.2409989908337593, + 0.26472146064043045, + 0.028940744698047638, + 0.0, + 0.03512398526072502, + 0.5652446523308754, + 0.0, + 0.0, + 0.07294072583317757, + 0.0, + 0.24788371473550797, + 0.10074177384376526, + 0.24605804681777954, + 0.2755265235900879, + 0.18889956176280975, + 0.0, + 0.19434743374586105, + 0.08906060829758644, + 0.15428873524069786, + 0.1614811085164547, + 0.45540644228458405, + 0.03682710975408554, + 0.3613786920905113, + 0.13649149611592293, + 0.0, + 0.2678358405828476, + 0.27675165981054306, + 0.04077157750725746, + 0.0, + 1.171276418492198, + 0.12924636900424957 + ], + "unique_experts": 52, + "load_cv": 0.8445041359748247, + "normalized_load_entropy": 0.905465711195128, + "max_load_share": 0.049019607843137254 + }, + "full_input": { + "tokens": 75, + "top_k": 6, + "decisions": 450, + "ordered_route_sha256": "42f653aa43f41850dcd91358e7a0d4b0bd1856f160417b3251086c6d05ff7d97", + "route_weight_sha256": "8b9ff216c2d75aff67c387041708f7bf0613a99027888e28b1ae24fafa903683", + "loads": [ + 14, + 7, + 9, + 16, + 10, + 7, + 9, + 10, + 0, + 8, + 4, + 2, + 13, + 7, + 14, + 2, + 9, + 3, + 3, + 3, + 6, + 10, + 14, + 1, + 8, + 5, + 9, + 8, + 4, + 6, + 6, + 3, + 4, + 5, + 13, + 1, + 0, + 6, + 9, + 1, + 1, + 2, + 15, + 7, + 2, + 6, + 23, + 2, + 10, + 14, + 3, + 9, + 7, + 9, + 5, + 10, + 3, + 0, + 10, + 5, + 13, + 1, + 15, + 9 + ], + "weighted_loads": [ + 1.7121091298758984, + 0.42590534687042236, + 0.7506108619272709, + 0.8983982298523188, + 0.8625106088584289, + 0.2922247387468815, + 0.7132105343043804, + 1.1731489542871714, + 0.0, + 0.418283975799568, + 0.11328450590372086, + 0.03003075229935348, + 0.7083618651959114, + 0.49918757379055023, + 1.3360387608408928, + 0.0775704812258482, + 0.8552083447575569, + 0.1303156241774559, + 0.12125708907842636, + 0.127755519002676, + 0.2862630560994148, + 0.6993274316191673, + 1.0433173812925816, + 0.026674574241042137, + 0.4019748028367758, + 0.17370282782940194, + 1.0065160281956196, + 0.4064327161759138, + 0.36625901609659195, + 0.2541296258568764, + 0.43362637981772423, + 0.08980765752494335, + 0.3116251155734062, + 0.3136582113802433, + 1.1927257552742958, + 0.028940744698047638, + 0.0, + 0.4507926441729069, + 0.6164129264652729, + 0.05054463818669319, + 0.07496336102485657, + 0.07294072583317757, + 0.8174298033118248, + 0.3550693839788437, + 0.10074177384376526, + 0.5405773930251598, + 2.5960363671183586, + 0.18889956176280975, + 1.1479585506021976, + 0.6606848277151585, + 0.11980289965867996, + 0.935693085193634, + 0.3623014949262142, + 1.1688860580325127, + 1.1888510659337044, + 0.6311624255031347, + 0.13649149611592293, + 0.0, + 0.7529989033937454, + 0.30707959458231926, + 0.774951983243227, + 0.0502619631588459, + 1.5845964159816504, + 0.5768005847930908 + ], + "unique_experts": 61, + "load_cv": 0.6778761312973898, + "normalized_load_entropy": 0.9404071846466313, + "max_load_share": 0.051111111111111114 + } + }, + "s0_x": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "29f05c33cd8900ce75801fadc23a3770b5482a02e32fb34542e2ee8b86ea389e", + "route_weight_sha256": "5b4fc27cb4a9fab099665c337459213ebb5f4ba313c501d99a6eb9d6cdaf1f17", + "loads": [ + 0, + 6, + 10, + 5, + 7, + 2, + 10, + 0, + 0, + 0, + 0, + 1, + 10, + 2, + 5, + 1, + 7, + 3, + 1, + 3, + 4, + 4, + 4, + 1, + 4, + 4, + 8, + 5, + 4, + 2, + 5, + 2, + 4, + 3, + 6, + 1, + 0, + 1, + 9, + 0, + 0, + 2, + 0, + 4, + 2, + 2, + 4, + 2, + 0, + 4, + 1, + 4, + 4, + 4, + 1, + 5, + 2, + 0, + 3, + 3, + 1, + 0, + 10, + 2 + ], + "weighted_loads": [ + 0.0, + 0.3905632235109806, + 0.7771535739302635, + 0.23567934520542622, + 0.7591401562094688, + 0.06357789784669876, + 0.7526939772069454, + 0.0, + 0.0, + 0.0, + 0.0, + 0.02754155360162258, + 0.6051467135548592, + 0.0680202841758728, + 0.6531169787049294, + 0.027856117114424706, + 0.6678916066884995, + 0.12221244350075722, + 0.030956020578742027, + 0.135847557336092, + 0.21957772597670555, + 0.29415134340524673, + 0.1932268925011158, + 0.03158489242196083, + 0.22549673169851303, + 0.1504580620676279, + 0.961745873093605, + 0.32050079479813576, + 0.36247069388628006, + 0.08495493978261948, + 0.4035063683986664, + 0.06003798171877861, + 0.3127260208129883, + 0.24607405811548233, + 0.29223189875483513, + 0.03194504976272583, + 0.0, + 0.037316612899303436, + 0.5912393480539322, + 0.0, + 0.0, + 0.07674349844455719, + 0.0, + 0.2490093782544136, + 0.114890206605196, + 0.2355712652206421, + 0.25329330191016197, + 0.18932568281888962, + 0.0, + 0.20205026119947433, + 0.045679572969675064, + 0.1935405358672142, + 0.17969264835119247, + 0.4692250117659569, + 0.03926393389701843, + 0.366420716047287, + 0.10728740319609642, + 0.0, + 0.2733657471835613, + 0.24356252700090408, + 0.03862076625227928, + 0.0, + 1.223277986049652, + 0.12044302001595497 + ], + "unique_experts": 52, + "load_cv": 0.8696249749622229, + "normalized_load_entropy": 0.9016529102559216, + "max_load_share": 0.049019607843137254 + }, + "full_input": { + "tokens": 59, + "top_k": 6, + "decisions": 354, + "ordered_route_sha256": "2b29fbaa17180f79c005915d2d6935848aff21a077b92d97878271af8c4d677a", + "route_weight_sha256": "901fd66603b052045a147c417360b62dfff5d9ed40aa155ea05a6b4006670745", + "loads": [ + 7, + 6, + 10, + 17, + 11, + 3, + 10, + 8, + 0, + 5, + 1, + 2, + 11, + 6, + 12, + 1, + 7, + 3, + 2, + 3, + 5, + 7, + 9, + 2, + 4, + 5, + 9, + 13, + 4, + 7, + 6, + 2, + 4, + 3, + 15, + 1, + 1, + 1, + 10, + 0, + 0, + 2, + 10, + 5, + 2, + 3, + 19, + 2, + 6, + 15, + 2, + 4, + 4, + 4, + 4, + 6, + 2, + 0, + 3, + 3, + 8, + 0, + 13, + 4 + ], + "weighted_loads": [ + 1.039281290024519, + 0.3905632235109806, + 0.7771535739302635, + 0.9919044300913811, + 0.866440225741826, + 0.11119173094630241, + 0.7526939772069454, + 1.137513130903244, + 0.0, + 0.25428775616455823, + 0.035993028432130814, + 0.028415175853297114, + 0.6056208751979284, + 0.43197251856327057, + 1.1324854493141174, + 0.027856117114424706, + 0.6678916066884995, + 0.12221244350075722, + 0.07274083979427814, + 0.135847557336092, + 0.24656767584383488, + 0.6170017719268799, + 0.55278654769063, + 0.05900432914495468, + 0.22549673169851303, + 0.15098423248855397, + 1.0040252804756165, + 0.629006277769804, + 0.36247069388628006, + 0.31291084364056587, + 0.45013946294784546, + 0.06003798171877861, + 0.3127260208129883, + 0.24607405811548233, + 1.38655711337924, + 0.03194504976272583, + 0.047862179577350616, + 0.037316612899303436, + 0.6330974474549294, + 0.0, + 0.0, + 0.07674349844455719, + 0.6221187971532345, + 0.28288519009947777, + 0.114890206605196, + 0.28433142229914665, + 1.9898045398294926, + 0.18932568281888962, + 0.7020078860223293, + 0.8809686005115509, + 0.07660527899861336, + 0.1935405358672142, + 0.17969264835119247, + 0.4692250117659569, + 1.1476936750113964, + 0.4106887951493263, + 0.10728740319609642, + 0.0, + 0.2733657471835613, + 0.24356252700090408, + 0.5414578896015882, + 0.0, + 1.5482460781931877, + 0.19678518548607826 + ], + "unique_experts": 59, + "load_cv": 0.8034327386095818, + "normalized_load_entropy": 0.9223052337290509, + "max_load_share": 0.05367231638418079 + } + }, + "s1_x": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "28f20244bd180f1b4dca842c50e1b187f4b6a4aebb80fdead6661437b0978e8b", + "route_weight_sha256": "2fce49835a2f041802e472fc24c7cbb4f25247ded99f7e22ecb45646b3acf12e", + "loads": [ + 0, + 5, + 8, + 3, + 7, + 2, + 9, + 0, + 0, + 0, + 0, + 1, + 10, + 2, + 5, + 1, + 7, + 3, + 1, + 3, + 4, + 4, + 4, + 1, + 6, + 3, + 9, + 5, + 4, + 2, + 5, + 4, + 4, + 3, + 5, + 1, + 0, + 1, + 9, + 0, + 0, + 2, + 0, + 4, + 2, + 2, + 6, + 2, + 0, + 4, + 2, + 4, + 4, + 4, + 1, + 5, + 2, + 0, + 3, + 4, + 1, + 0, + 9, + 2 + ], + "weighted_loads": [ + 0.0, + 0.35267990455031395, + 0.7113360781222582, + 0.17973460629582405, + 0.7560963369905949, + 0.06352867744863033, + 0.7070491537451744, + 0.0, + 0.0, + 0.0, + 0.0, + 0.028012430295348167, + 0.6171588022261858, + 0.06263708136975765, + 0.6591753587126732, + 0.029115717858076096, + 0.6518102884292603, + 0.12790080159902573, + 0.0326770655810833, + 0.13357548415660858, + 0.2126752994954586, + 0.2953624650835991, + 0.19191017746925354, + 0.028248988091945648, + 0.2846884783357382, + 0.1276165284216404, + 0.9931213408708572, + 0.32964103296399117, + 0.36639581620693207, + 0.08228344097733498, + 0.39825666695833206, + 0.119442543014884, + 0.31672392040491104, + 0.24086551740765572, + 0.2586478851735592, + 0.02837766893208027, + 0.0, + 0.03606778383255005, + 0.6015450544655323, + 0.0, + 0.0, + 0.07397257909178734, + 0.0, + 0.2372536100447178, + 0.10318135842680931, + 0.2446896880865097, + 0.3394300900399685, + 0.1854318380355835, + 0.0, + 0.1954282782971859, + 0.08754198625683784, + 0.18833957239985466, + 0.15372171625494957, + 0.467431865632534, + 0.03716142848134041, + 0.36499887704849243, + 0.11859660223126411, + 0.0, + 0.2664022371172905, + 0.2678731381893158, + 0.04291712865233421, + 0.0, + 1.147099807858467, + 0.12647873908281326 + ], + "unique_experts": 52, + "load_cv": 0.8335063257581287, + "normalized_load_entropy": 0.9063141356081096, + "max_load_share": 0.049019607843137254 + }, + "full_input": { + "tokens": 75, + "top_k": 6, + "decisions": 450, + "ordered_route_sha256": "c7c791b05d717ada240e565a80d070d4695e431a21309be8abf172de1a24e1e1", + "route_weight_sha256": "c55a9bf78ab7639e14a457a20d50d04954a231b9e944b52ab0e76a6f77fb3c60", + "loads": [ + 11, + 7, + 8, + 16, + 10, + 6, + 9, + 10, + 0, + 8, + 4, + 2, + 13, + 7, + 14, + 2, + 9, + 3, + 3, + 3, + 5, + 10, + 14, + 2, + 8, + 5, + 10, + 9, + 4, + 7, + 6, + 4, + 4, + 5, + 13, + 1, + 1, + 6, + 10, + 1, + 1, + 2, + 15, + 7, + 2, + 6, + 24, + 2, + 9, + 15, + 2, + 10, + 7, + 9, + 5, + 10, + 2, + 0, + 10, + 5, + 13, + 1, + 14, + 9 + ], + "weighted_loads": [ + 1.3993641436100006, + 0.4270162545144558, + 0.7113360781222582, + 1.0160550326108932, + 0.8351645584916696, + 0.23840036429464817, + 0.7070491537451744, + 1.1635135505348444, + 0.0, + 0.4402195505099371, + 0.11328450590372086, + 0.0288860525470227, + 0.6983267638715915, + 0.4900150503963232, + 1.3223554976284504, + 0.07802227139472961, + 0.8643692955374718, + 0.12790080159902573, + 0.12801441550254822, + 0.13357548415660858, + 0.24476714059710503, + 0.6886905878782272, + 1.0471922531723976, + 0.06022198125720024, + 0.38808021880686283, + 0.17560848890570924, + 1.03208776563406, + 0.4702665228396654, + 0.36639581620693207, + 0.2952245268970728, + 0.43972475454211235, + 0.119442543014884, + 0.31672392040491104, + 0.3135247379541397, + 1.2303296215832233, + 0.02837766893208027, + 0.040548793971538544, + 0.4517364427447319, + 0.6492631621658802, + 0.05054463818669319, + 0.07496336102485657, + 0.07397257909178734, + 0.7315642237663269, + 0.3437301516532898, + 0.10318135842680931, + 0.5493703186511993, + 2.631120327860117, + 0.1854318380355835, + 1.021755326539278, + 0.7209909670054913, + 0.08754198625683784, + 0.9697439223527908, + 0.3545421026647091, + 1.1809114813804626, + 1.1700514107942581, + 0.6379380617290735, + 0.11859660223126411, + 0.0, + 0.7515652999281883, + 0.298201072961092, + 0.8208444081246853, + 0.0502619631588459, + 1.5604198053479195, + 0.573248852044344 + ], + "unique_experts": 62, + "load_cv": 0.6778761312973898, + "normalized_load_entropy": 0.941902344365296, + "max_load_share": 0.05333333333333334 + } + }, + "s0_period": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "f0a8f8a122223ead90a08b6ab0802ef9d4f73295c5a2edd17de6f130f5f5ca75", + "route_weight_sha256": "efcef244761b19331e906b18a483eb81558ef85c0c2c3be0eb08faaa5b5b0146", + "loads": [ + 0, + 5, + 9, + 5, + 7, + 2, + 10, + 0, + 0, + 0, + 0, + 1, + 10, + 2, + 5, + 1, + 7, + 3, + 1, + 3, + 4, + 4, + 4, + 1, + 4, + 4, + 8, + 5, + 4, + 2, + 5, + 2, + 4, + 3, + 6, + 1, + 0, + 1, + 9, + 0, + 0, + 2, + 0, + 4, + 2, + 2, + 4, + 2, + 0, + 4, + 2, + 4, + 4, + 4, + 1, + 5, + 2, + 0, + 3, + 4, + 1, + 0, + 10, + 2 + ], + "weighted_loads": [ + 0.0, + 0.3522745110094547, + 0.7422791216522455, + 0.2348510231822729, + 0.7631403058767319, + 0.062061503529548645, + 0.7485203538089991, + 0.0, + 0.0, + 0.0, + 0.0, + 0.027716785669326782, + 0.6112489830702543, + 0.0659267008304596, + 0.6423847749829292, + 0.027658110484480858, + 0.6683964803814888, + 0.12398148328065872, + 0.030132973566651344, + 0.13522063568234444, + 0.21828048303723335, + 0.2943795248866081, + 0.18502338230609894, + 0.029670096933841705, + 0.22654854506254196, + 0.15396466851234436, + 0.961410403251648, + 0.32335566356778145, + 0.3698901981115341, + 0.08784037455916405, + 0.3993293084204197, + 0.060583386570215225, + 0.3157593011856079, + 0.24615375697612762, + 0.29422440752387047, + 0.03246082738041878, + 0.0, + 0.03702382370829582, + 0.5944140963256359, + 0.0, + 0.0, + 0.07496397942304611, + 0.0, + 0.2511488273739815, + 0.11311724409461021, + 0.23363173007965088, + 0.24234792962670326, + 0.18898293375968933, + 0.0, + 0.20544711500406265, + 0.0814477950334549, + 0.19524581730365753, + 0.18220530822873116, + 0.46623218804597855, + 0.03822304308414459, + 0.36020246520638466, + 0.1092522069811821, + 0.0, + 0.27515188977122307, + 0.27893504686653614, + 0.04030529409646988, + 0.0, + 1.2012331672012806, + 0.12238035723567009 + ], + "unique_experts": 52, + "load_cv": 0.851757122704842, + "normalized_load_entropy": 0.9043857353931328, + "max_load_share": 0.049019607843137254 + }, + "full_input": { + "tokens": 59, + "top_k": 6, + "decisions": 354, + "ordered_route_sha256": "fad7c652cca3a336ff402097ddae152dcb5703d4718f10c2c8d32797a01e4447", + "route_weight_sha256": "f3a16e61ddddeb299d8b21d1886de7bd6787db2bf9efc2cb26c9841b6e37892f", + "loads": [ + 7, + 6, + 9, + 17, + 11, + 3, + 10, + 8, + 0, + 6, + 1, + 2, + 11, + 6, + 12, + 1, + 7, + 3, + 2, + 3, + 5, + 7, + 10, + 2, + 4, + 5, + 8, + 12, + 4, + 7, + 6, + 2, + 4, + 3, + 14, + 1, + 0, + 1, + 10, + 0, + 0, + 2, + 10, + 5, + 2, + 4, + 19, + 2, + 6, + 14, + 3, + 4, + 4, + 4, + 4, + 6, + 2, + 0, + 4, + 4, + 8, + 0, + 13, + 4 + ], + "weighted_loads": [ + 0.9720869772136211, + 0.4983501322567463, + 0.7422791216522455, + 0.9279543105512857, + 0.8789044379955158, + 0.1096753366291523, + 0.7485203538089991, + 1.1782700717449188, + 0.0, + 0.4123497261898592, + 0.035993028432130814, + 0.028590407921001315, + 0.6117231447133236, + 0.42928170412778854, + 1.2530885301530361, + 0.027658110484480858, + 0.6683964803814888, + 0.12398148328065872, + 0.07116658054292202, + 0.13522063568234444, + 0.24527043290436268, + 0.609253965318203, + 0.599120020866394, + 0.057089533656835556, + 0.22654854506254196, + 0.15449083893327042, + 0.961410403251648, + 0.5840096734464169, + 0.3698901981115341, + 0.30881239101290703, + 0.44596240296959877, + 0.060583386570215225, + 0.3157593011856079, + 0.24615375697612762, + 1.2868427447974682, + 0.03246082738041878, + 0.0, + 0.03702382370829582, + 0.6416207626461983, + 0.0, + 0.0, + 0.07496397942304611, + 0.6253604851663113, + 0.28599751740694046, + 0.11311724409461021, + 0.3331746831536293, + 1.9697494376450777, + 0.18898293375968933, + 0.7022999934852123, + 0.8207525908946991, + 0.11468997597694397, + 0.19524581730365753, + 0.18220530822873116, + 0.46623218804597855, + 1.1414923034608364, + 0.40500399842858315, + 0.1092522069811821, + 0.0, + 0.3141256161034107, + 0.27893504686653614, + 0.5057941805571318, + 0.0, + 1.5262012593448162, + 0.19812601059675217 + ], + "unique_experts": 58, + "load_cv": 0.7828274357024951, + "normalized_load_entropy": 0.9241065105017628, + "max_load_share": 0.05367231638418079 + } + }, + "s1_period": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "06dfbddb7b664b9626967fdf3c7034750e56b2dd5b466eee5e148ed81e6c919a", + "route_weight_sha256": "358f4675ac2e98b57026a92ae0cd0adf8373af403678e6434630591d01edda49", + "loads": [ + 0, + 5, + 9, + 3, + 7, + 2, + 8, + 0, + 0, + 0, + 0, + 1, + 10, + 2, + 5, + 1, + 7, + 3, + 1, + 3, + 4, + 4, + 4, + 0, + 6, + 5, + 9, + 5, + 4, + 2, + 5, + 4, + 4, + 3, + 5, + 1, + 0, + 1, + 9, + 0, + 0, + 2, + 0, + 4, + 2, + 2, + 6, + 2, + 0, + 4, + 2, + 4, + 4, + 4, + 1, + 5, + 1, + 0, + 3, + 4, + 1, + 0, + 9, + 2 + ], + "weighted_loads": [ + 0.0, + 0.35388149693608284, + 0.7496337890625, + 0.17940863966941833, + 0.7534319050610065, + 0.0636390931904316, + 0.6726795509457588, + 0.0, + 0.0, + 0.0, + 0.0, + 0.0280742309987545, + 0.6195264849811792, + 0.06109038554131985, + 0.6582266017794609, + 0.02916024625301361, + 0.6558807790279388, + 0.1305723339319229, + 0.034466225653886795, + 0.1376570202410221, + 0.21069426834583282, + 0.29379861801862717, + 0.18661287799477577, + 0.0, + 0.2841913104057312, + 0.1874972451478243, + 0.9868961945176125, + 0.33259595185518265, + 0.36785978823900223, + 0.08299469575285912, + 0.4002867713570595, + 0.11842788755893707, + 0.31674254685640335, + 0.240753386169672, + 0.2593574486672878, + 0.028455322608351707, + 0.0, + 0.035294316709041595, + 0.6014051586389542, + 0.0, + 0.0, + 0.07083189114928246, + 0.0, + 0.23841599002480507, + 0.10322776064276695, + 0.24323632568120956, + 0.337663646787405, + 0.18595542013645172, + 0.0, + 0.19574809074401855, + 0.08799878135323524, + 0.1908261552453041, + 0.15645954757928848, + 0.46765071153640747, + 0.03680704906582832, + 0.36199260130524635, + 0.09379719942808151, + 0.0, + 0.2708897441625595, + 0.27165496349334717, + 0.04388875141739845, + 0.0, + 1.149319788441062, + 0.12707819417119026 + ], + "unique_experts": 51, + "load_cv": 0.8445041359748247, + "normalized_load_entropy": 0.902347834160174, + "max_load_share": 0.049019607843137254 + }, + "full_input": { + "tokens": 75, + "top_k": 6, + "decisions": 450, + "ordered_route_sha256": "f7e607de18265d86ef4d3ab67b8ce54d7809e24ee7aaf1fb811aa10d9edaa00c", + "route_weight_sha256": "8c41c9178cc85e03f15512f94132dcd5b0ea009fae9b80d9641f32914884fbd7", + "loads": [ + 10, + 8, + 9, + 16, + 10, + 6, + 8, + 11, + 0, + 9, + 4, + 2, + 13, + 7, + 14, + 2, + 9, + 3, + 3, + 3, + 5, + 10, + 15, + 0, + 8, + 7, + 9, + 8, + 4, + 6, + 6, + 4, + 4, + 5, + 12, + 1, + 0, + 6, + 10, + 1, + 1, + 2, + 16, + 7, + 2, + 7, + 24, + 2, + 8, + 14, + 3, + 10, + 7, + 9, + 5, + 10, + 1, + 0, + 11, + 5, + 14, + 1, + 14, + 9 + ], + "weighted_loads": [ + 1.3022742941975594, + 0.5363297276198864, + 0.7496337890625, + 0.9272397309541702, + 0.8365629914915189, + 0.23921706527471542, + 0.6726795509457588, + 1.250208431854844, + 0.0, + 0.5643295116024092, + 0.11328450590372086, + 0.028947853250429034, + 0.700694446626585, + 0.48718892596662045, + 1.4076555743813515, + 0.07806679978966713, + 0.8684397861361504, + 0.1305723339319229, + 0.13083889335393906, + 0.1376570202410221, + 0.24278610944747925, + 0.6761970371007919, + 1.1120665483176708, + 0.0, + 0.38758305087685585, + 0.23548920563189313, + 0.9868961945176125, + 0.42835469730198383, + 0.36785978823900223, + 0.2612810768187046, + 0.44175485894083977, + 0.11842788755893707, + 0.31674254685640335, + 0.313412606716156, + 1.1398487351834774, + 0.028455322608351707, + 0.0, + 0.45096297562122345, + 0.6561166420578957, + 0.05054463818669319, + 0.07496336102485657, + 0.07083189114928246, + 0.8224625512957573, + 0.34561437368392944, + 0.10322776064276695, + 0.6099423542618752, + 2.6196571700274944, + 0.18595542013645172, + 0.9792870879173279, + 0.662085484713316, + 0.12093378975987434, + 0.9722305051982403, + 0.357279933989048, + 1.181130327284336, + 1.1608318611979485, + 0.6351111251860857, + 0.09379719942808151, + 0.0, + 0.8041352964937687, + 0.30198289826512337, + 0.8119301442056894, + 0.0502619631588459, + 1.5626397859305143, + 0.574177872389555 + ], + "unique_experts": 60, + "load_cv": 0.6903497056198277, + "normalized_load_entropy": 0.9373585813109798, + "max_load_share": 0.05333333333333334 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 34, + "ordered_topk_exact_tokens": 26, + "set_exact_tokens": 30, + "mean_set_jaccard": 0.9663865546218489, + "mean_token_weighted_tv": 0.008482440730885547, + "aggregate_load_tv": 0.019607843137254898 + }, + "system_bos": { + "tokens": 34, + "ordered_topk_exact_tokens": 23, + "set_exact_tokens": 28, + "mean_set_jaccard": 0.9495798319327731, + "mean_token_weighted_tv": 0.014394084512091735, + "aggregate_load_tv": 0.024509803921568624 + }, + "system_x": { + "tokens": 34, + "ordered_topk_exact_tokens": 18, + "set_exact_tokens": 22, + "mean_set_jaccard": 0.8928571428571429, + "mean_token_weighted_tv": 0.022375518812195343, + "aggregate_load_tv": 0.044117647058823525 + }, + "system_period": { + "tokens": 34, + "ordered_topk_exact_tokens": 19, + "set_exact_tokens": 23, + "mean_set_jaccard": 0.9012605042016807, + "mean_token_weighted_tv": 0.020996327402398866, + "aggregate_load_tv": 0.0392156862745098 + }, + "bos_at_s0": { + "tokens": 34, + "ordered_topk_exact_tokens": 19, + "set_exact_tokens": 23, + "mean_set_jaccard": 0.9012605042016808, + "mean_token_weighted_tv": 0.02445658718181007, + "aggregate_load_tv": 0.044117647058823525 + }, + "bos_at_s1": { + "tokens": 34, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.8676470588235294, + "mean_token_weighted_tv": 0.02789918048416867, + "aggregate_load_tv": 0.06372549019607843 + }, + "x_at_s0": { + "tokens": 34, + "ordered_topk_exact_tokens": 16, + "set_exact_tokens": 23, + "mean_set_jaccard": 0.9012605042016807, + "mean_token_weighted_tv": 0.024131273850798607, + "aggregate_load_tv": 0.04901960784313725 + }, + "x_at_s1": { + "tokens": 34, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 20, + "mean_set_jaccard": 0.8697478991596639, + "mean_token_weighted_tv": 0.029557432431508514, + "aggregate_load_tv": 0.0588235294117647 + }, + "period_at_s0": { + "tokens": 34, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 22, + "mean_set_jaccard": 0.8928571428571429, + "mean_token_weighted_tv": 0.025411696282818037, + "aggregate_load_tv": 0.04901960784313726 + }, + "period_at_s1": { + "tokens": 34, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.8550420168067228, + "mean_token_weighted_tv": 0.03149706177303896, + "aggregate_load_tv": 0.06862745098039216 + } + } + }, + "layer_04": { + "layer": 4, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "1ffe5bb13231c4bb0ee25d6c3cc253abdec475a8ef5c1010f273174fcbabb54c", + "route_weight_sha256": "ba03b4a3ac2d12205a76f41658beef644f37377dc47b86ca0cb2b792d1c501c1", + "loads": [ + 2, + 0, + 2, + 2, + 3, + 5, + 3, + 10, + 6, + 4, + 6, + 5, + 0, + 1, + 1, + 0, + 4, + 2, + 0, + 5, + 0, + 0, + 5, + 1, + 5, + 0, + 2, + 5, + 3, + 7, + 4, + 2, + 7, + 6, + 0, + 0, + 0, + 5, + 4, + 6, + 8, + 0, + 0, + 0, + 13, + 3, + 5, + 11, + 0, + 5, + 1, + 1, + 5, + 2, + 3, + 3, + 2, + 5, + 1, + 0, + 0, + 8, + 4, + 1 + ], + "weighted_loads": [ + 0.08490554615855217, + 0.0, + 0.07793166860938072, + 0.1068793423473835, + 0.15334552526474, + 0.2821964994072914, + 0.14871039986610413, + 0.5427241735160351, + 0.48402220383286476, + 0.3784162998199463, + 0.5139639116823673, + 0.17775989696383476, + 0.0, + 0.05610708147287369, + 0.02998664788901806, + 0.0, + 0.39400279708206654, + 0.2855760455131531, + 0.0, + 0.24870098382234573, + 0.0, + 0.0, + 0.3522164933383465, + 0.05224774405360222, + 0.36274225637316704, + 0.0, + 0.07389812171459198, + 0.17919461987912655, + 0.1354602463543415, + 0.3243681285530329, + 0.29083748161792755, + 0.07345525175333023, + 0.3827362023293972, + 0.4120812751352787, + 0.0, + 0.0, + 0.0, + 0.71316247433424, + 0.3013056591153145, + 0.4828822389245033, + 0.696893960237503, + 0.0, + 0.0, + 0.0, + 0.6618396453559399, + 0.1363258920609951, + 0.17397396638989449, + 0.7441457733511925, + 0.0, + 0.3787800222635269, + 0.0411103293299675, + 0.05274370685219765, + 0.4943443387746811, + 0.1044820249080658, + 0.3506007194519043, + 0.17962082475423813, + 0.17416831105947495, + 0.22320424765348434, + 0.06503080576658249, + 0.0, + 0.0, + 0.3583109471946955, + 0.2341066412627697, + 0.0577218122780323 + ], + "unique_experts": 48, + "load_cv": 0.9261463277348662, + "normalized_load_entropy": 0.8857994979694177, + "max_load_share": 0.06372549019607843 + }, + "full_input": { + "tokens": 59, + "top_k": 6, + "decisions": 354, + "ordered_route_sha256": "d27563b61e3e48511766276e17c177a745afcc233db0ade6dbf913bdf4bf106b", + "route_weight_sha256": "190fc9636169be46316183a7c329aef0320e3b23a64b2f39d57f8f81df7775a5", + "loads": [ + 2, + 3, + 4, + 6, + 4, + 5, + 5, + 10, + 6, + 4, + 16, + 7, + 0, + 14, + 4, + 3, + 4, + 2, + 4, + 5, + 0, + 2, + 7, + 1, + 5, + 6, + 7, + 6, + 3, + 24, + 4, + 4, + 7, + 9, + 10, + 0, + 0, + 8, + 6, + 6, + 11, + 2, + 8, + 0, + 13, + 4, + 16, + 11, + 2, + 8, + 2, + 2, + 5, + 2, + 3, + 3, + 2, + 5, + 1, + 11, + 4, + 8, + 7, + 1 + ], + "weighted_loads": [ + 0.08490554615855217, + 0.1713748723268509, + 0.19952266290783882, + 0.5002111321955454, + 0.2426629737019539, + 0.2821964994072914, + 0.23869381472468376, + 0.5427241735160351, + 0.48402220383286476, + 0.3784162998199463, + 1.170388426631689, + 0.2043211879208684, + 0.0, + 0.9936416633427143, + 0.10514899156987667, + 0.18151367455720901, + 0.39400279708206654, + 0.2855760455131531, + 0.2548832886677701, + 0.24870098382234573, + 0.0, + 1.066235989332199, + 0.47426024451851845, + 0.05224774405360222, + 0.36274225637316704, + 0.4602077379822731, + 0.5651901587843895, + 0.18716091196984053, + 0.1354602463543415, + 1.5894730191503186, + 0.29083748161792755, + 0.10436761938035488, + 0.3827362023293972, + 0.5084385257214308, + 0.9835708872415125, + 0.0, + 0.0, + 0.9794365987181664, + 1.325319990515709, + 0.4828822389245033, + 0.8375380225479603, + 0.13986652344465256, + 0.3620007373392582, + 0.0, + 0.6618396453559399, + 0.16652941890060902, + 1.3250302262604237, + 0.7441457733511925, + 0.0813572034239769, + 0.4861336089670658, + 0.08780763670802116, + 0.09095242246985435, + 0.4943443387746811, + 0.1044820249080658, + 0.3506007194519043, + 0.17962082475423813, + 0.17416831105947495, + 0.22320424765348434, + 0.06503080576658249, + 0.6200750358402729, + 0.3802652636077255, + 0.3583109471946955, + 0.4559823274612427, + 0.0577218122780323 + ], + "unique_experts": 59, + "load_cv": 0.7989707381876175, + "normalized_load_entropy": 0.9275927949558653, + "max_load_share": 0.06779661016949153 + } + }, + "s1_eos": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "e9334ade71bc89c41ea777d24fdd52fd72067694eb9c1adeaa2af776aa9145c3", + "route_weight_sha256": "7eac4c82b689cdb480720f34e704233c38ca0aa286fe8f28e1ea2ad8758c3adc", + "loads": [ + 2, + 0, + 2, + 2, + 3, + 5, + 3, + 10, + 6, + 4, + 6, + 5, + 0, + 1, + 1, + 0, + 4, + 2, + 0, + 4, + 0, + 0, + 5, + 1, + 5, + 0, + 2, + 4, + 2, + 7, + 4, + 3, + 7, + 6, + 0, + 0, + 0, + 5, + 4, + 6, + 8, + 0, + 0, + 0, + 13, + 3, + 3, + 11, + 2, + 5, + 2, + 1, + 5, + 3, + 4, + 3, + 2, + 4, + 1, + 0, + 0, + 8, + 4, + 1 + ], + "weighted_loads": [ + 0.0838465467095375, + 0.0, + 0.0755746103823185, + 0.10558231174945831, + 0.15558772534132004, + 0.2880835235118866, + 0.15309704467654228, + 0.5462853852659464, + 0.4856021888554096, + 0.37589719146490097, + 0.5224139653146267, + 0.17890294827520847, + 0.0, + 0.055985286831855774, + 0.029941482469439507, + 0.0, + 0.39404478296637535, + 0.28901970386505127, + 0.0, + 0.20063000917434692, + 0.0, + 0.0, + 0.34802522510290146, + 0.049699798226356506, + 0.3549031186848879, + 0.0, + 0.07147195190191269, + 0.1438265386968851, + 0.09149831533432007, + 0.3282471336424351, + 0.28485265374183655, + 0.10500524193048477, + 0.3798486702144146, + 0.4056444428861141, + 0.0, + 0.0, + 0.0, + 0.7137864828109741, + 0.30072121322155, + 0.4890025742352009, + 0.6855517700314522, + 0.0, + 0.0, + 0.0, + 0.65755570307374, + 0.13916396722197533, + 0.11505528166890144, + 0.7419679462909698, + 0.07020126655697823, + 0.37186773866415024, + 0.08592116087675095, + 0.05428681895136833, + 0.490143246948719, + 0.1422734446823597, + 0.3746924214065075, + 0.1737683303654194, + 0.1737629920244217, + 0.18930476531386375, + 0.06580452620983124, + 0.0, + 0.0, + 0.35792803950607777, + 0.23617931082844734, + 0.05791611596941948 + ], + "unique_experts": 49, + "load_cv": 0.9060011805606213, + "normalized_load_entropy": 0.8920770097305155, + "max_load_share": 0.06372549019607843 + }, + "full_input": { + "tokens": 75, + "top_k": 6, + "decisions": 450, + "ordered_route_sha256": "6513463e8b01133f60b1cf1eb4c889d780046bf52c43d250b44973d74a99fec9", + "route_weight_sha256": "c91332f885c305a169de912f22d92d0057ba3ee9aa5ae6035edf14591cfd7adc", + "loads": [ + 2, + 2, + 5, + 11, + 4, + 5, + 7, + 10, + 6, + 13, + 15, + 7, + 1, + 15, + 4, + 4, + 6, + 4, + 7, + 6, + 1, + 3, + 11, + 2, + 5, + 10, + 10, + 5, + 2, + 29, + 4, + 5, + 7, + 9, + 14, + 0, + 0, + 9, + 7, + 9, + 11, + 5, + 9, + 0, + 14, + 5, + 13, + 15, + 4, + 9, + 4, + 2, + 9, + 7, + 10, + 3, + 7, + 6, + 1, + 13, + 7, + 10, + 8, + 2 + ], + "weighted_loads": [ + 0.0838465467095375, + 0.14927857369184494, + 0.24484452605247498, + 0.9636457746964879, + 0.24325387179851532, + 0.2880835235118866, + 0.3967999294400215, + 0.5462853852659464, + 0.4856021888554096, + 1.4532344415783882, + 1.11193473264575, + 0.20537512470036745, + 0.10675177723169327, + 1.0523078367114067, + 0.1046884786337614, + 0.263695664703846, + 0.7590443007647991, + 0.3598648626357317, + 0.5890575740486383, + 0.2911192812025547, + 0.04870850592851639, + 1.0973596572875977, + 0.7872031144797802, + 0.14217498898506165, + 0.3549031186848879, + 0.7379538230597973, + 0.8432037457823753, + 0.15211918484419584, + 0.09149831533432007, + 1.5714388228952885, + 0.28485265374183655, + 0.13560007512569427, + 0.3798486702144146, + 0.5046490775421262, + 1.312601833109511, + 0.0, + 0.0, + 1.0206669941544533, + 1.4899186305701733, + 0.6996976025402546, + 0.8452034369111061, + 0.23827480181353167, + 0.4280889742076397, + 0.0, + 0.6952911801636219, + 0.16934664841392078, + 1.3122849129140377, + 1.0794931054115295, + 0.14155294932425022, + 0.5160165932029486, + 0.1781768463551998, + 0.09447553381323814, + 0.9259257912635803, + 0.3256143257021904, + 0.9276235364377499, + 0.1737683303654194, + 0.5980793684720993, + 0.26248512603342533, + 0.06580452620983124, + 0.7336329203099012, + 0.8743280358612537, + 0.5526077020913363, + 0.5316214710474014, + 0.10185565054416656 + ], + "unique_experts": 61, + "load_cv": 0.6958217453016023, + "normalized_load_entropy": 0.9426389227208395, + "max_load_share": 0.06444444444444444 + } + }, + "s0_bos": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "4c03848c4ea4ca43afec3cea79202c51ba4765b313c0b2d17c69b67b0ce34a70", + "route_weight_sha256": "e5cf8ae910d9ee70b5d5a79438f767a6de7d1b6720cfcd1a51294ed0c3a73ad2", + "loads": [ + 2, + 0, + 3, + 2, + 3, + 6, + 3, + 9, + 6, + 4, + 6, + 3, + 0, + 1, + 0, + 0, + 4, + 2, + 0, + 4, + 0, + 0, + 5, + 1, + 4, + 0, + 1, + 4, + 3, + 5, + 4, + 4, + 7, + 6, + 0, + 0, + 1, + 5, + 4, + 6, + 8, + 0, + 0, + 0, + 14, + 2, + 3, + 11, + 0, + 6, + 1, + 1, + 5, + 4, + 6, + 3, + 2, + 5, + 1, + 1, + 0, + 7, + 4, + 2 + ], + "weighted_loads": [ + 0.09438947215676308, + 0.0, + 0.10594140738248825, + 0.1096261776983738, + 0.1540227308869362, + 0.3242812678217888, + 0.15203043445944786, + 0.5078540369868279, + 0.48079146817326546, + 0.3748992159962654, + 0.5005880519747734, + 0.11652405932545662, + 0.0, + 0.05824842303991318, + 0.0, + 0.0, + 0.38300589472055435, + 0.29614704847335815, + 0.0, + 0.21761514991521835, + 0.0, + 0.0, + 0.33792589232325554, + 0.05225460231304169, + 0.33015983551740646, + 0.0, + 0.03532002121210098, + 0.1586158238351345, + 0.13372259959578514, + 0.2237271647900343, + 0.2876638285815716, + 0.1487545557320118, + 0.3979557268321514, + 0.4237068444490433, + 0.0, + 0.0, + 0.025514092296361923, + 0.7389080822467804, + 0.28709712997078896, + 0.5154085345566273, + 0.6536534354090691, + 0.0, + 0.0, + 0.0, + 0.6712859217077494, + 0.09808488935232162, + 0.10823149606585503, + 0.7645148411393166, + 0.0, + 0.41137154772877693, + 0.04180134832859039, + 0.05123480036854744, + 0.4723740741610527, + 0.17083092406392097, + 0.4435010924935341, + 0.1674668788909912, + 0.16116196662187576, + 0.22556383535265923, + 0.05384727567434311, + 0.048919569700956345, + 0.0, + 0.3374137356877327, + 0.2529431954026222, + 0.09022464975714684 + ], + "unique_experts": 49, + "load_cv": 0.9127656323378338, + "normalized_load_entropy": 0.8905922542556899, + "max_load_share": 0.06862745098039216 + }, + "full_input": { + "tokens": 59, + "top_k": 6, + "decisions": 354, + "ordered_route_sha256": "bfb88dfe86d235bcad05031c3a602ce2e61d7ae3f1a455f45e76d84534383ba0", + "route_weight_sha256": "a773476ac0b81520c38817a410d4f53f02be4d441ceb512682d2acc3a4eb7912", + "loads": [ + 2, + 3, + 5, + 7, + 4, + 6, + 4, + 9, + 6, + 4, + 16, + 4, + 0, + 14, + 3, + 3, + 4, + 2, + 5, + 4, + 0, + 1, + 7, + 1, + 4, + 6, + 6, + 4, + 3, + 24, + 4, + 5, + 7, + 8, + 11, + 0, + 1, + 8, + 6, + 6, + 11, + 2, + 8, + 0, + 14, + 3, + 14, + 11, + 2, + 8, + 3, + 2, + 5, + 4, + 6, + 3, + 2, + 5, + 1, + 12, + 5, + 7, + 7, + 2 + ], + "weighted_loads": [ + 0.09438947215676308, + 0.17237810790538788, + 0.22753240168094635, + 0.5072645782202017, + 0.25209537893533707, + 0.3242812678217888, + 0.20542144030332565, + 0.5078540369868279, + 0.48079146817326546, + 0.3748992159962654, + 1.1570125669240952, + 0.1336475182324648, + 0.0, + 0.9826251044869423, + 0.07516234368085861, + 0.18296074867248535, + 0.38300589472055435, + 0.29614704847335815, + 0.3818303935986478, + 0.21761514991521835, + 0.0, + 0.2910352647304535, + 0.4502849169075489, + 0.05225460231304169, + 0.33015983551740646, + 0.46338555216789246, + 0.5369525775313377, + 0.1586158238351345, + 0.13372259959578514, + 1.677388350275578, + 0.2876638285815716, + 0.16712326370179653, + 0.3979557268321514, + 0.5078990459442139, + 1.0511484728194773, + 0.0, + 0.025514092296361923, + 1.0085592418909073, + 1.3148529883474112, + 0.5154085345566273, + 0.7942974977195263, + 0.13985684514045715, + 0.3620007373392582, + 0.0, + 0.6712859217077494, + 0.12828841619193554, + 1.2592877559363842, + 0.7645148411393166, + 0.08047846704721451, + 0.4969205055385828, + 0.1211327463388443, + 0.08899800479412079, + 0.4723740741610527, + 0.17083092406392097, + 0.4435010924935341, + 0.1674668788909912, + 0.16116196662187576, + 0.22556383535265923, + 0.05384727567434311, + 0.6694245003163815, + 0.5738440731074661, + 0.3374137356877327, + 0.4829516038298607, + 0.09022464975714684 + ], + "unique_experts": 60, + "load_cv": 0.7854326613473542, + "normalized_load_entropy": 0.9313118346915814, + "max_load_share": 0.06779661016949153 + } + }, + "s1_bos": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "b068bf13ecfee3347cd06c206a60acb3e3b022bafff3cd1dd71327c7c25c5d0f", + "route_weight_sha256": "beb6582bd2d2177ab390df3d94292a7a9598e2a533d489ce6e39b668b45108a4", + "loads": [ + 3, + 0, + 3, + 2, + 3, + 5, + 3, + 9, + 6, + 4, + 6, + 3, + 0, + 1, + 1, + 0, + 4, + 2, + 0, + 4, + 0, + 1, + 5, + 1, + 4, + 0, + 1, + 4, + 4, + 5, + 4, + 3, + 8, + 6, + 0, + 0, + 1, + 5, + 4, + 6, + 8, + 0, + 0, + 0, + 12, + 3, + 3, + 11, + 0, + 6, + 0, + 2, + 5, + 3, + 5, + 3, + 2, + 5, + 1, + 1, + 0, + 6, + 4, + 3 + ], + "weighted_loads": [ + 0.13724523782730103, + 0.0, + 0.10047596879303455, + 0.10961665585637093, + 0.16100269183516502, + 0.30131593346595764, + 0.1645818054676056, + 0.5201416853815317, + 0.47938554733991623, + 0.36185451596975327, + 0.5193307287991047, + 0.11502659320831299, + 0.0, + 0.05543561279773712, + 0.028994910418987274, + 0.0, + 0.40475726686418056, + 0.306670218706131, + 0.0, + 0.2094322182238102, + 0.0, + 0.028845569118857384, + 0.340347595512867, + 0.046049755066633224, + 0.3170931041240692, + 0.0, + 0.03112347424030304, + 0.16357002407312393, + 0.17715369910001755, + 0.19748539477586746, + 0.2813418619334698, + 0.10982096754014492, + 0.4267929159104824, + 0.4374552518129349, + 0.0, + 0.0, + 0.02821570821106434, + 0.7393419146537781, + 0.28430188819766045, + 0.5206860490143299, + 0.6489255018532276, + 0.0, + 0.0, + 0.0, + 0.5810909792780876, + 0.14225106313824654, + 0.10902215167880058, + 0.7407875619828701, + 0.0, + 0.41573018580675125, + 0.0, + 0.08653512597084045, + 0.4638241082429886, + 0.14283665642142296, + 0.4236445762217045, + 0.15976529195904732, + 0.15483033284544945, + 0.22169674187898636, + 0.05789542198181152, + 0.04608527570962906, + 0.0, + 0.2924074660986662, + 0.2641487792134285, + 0.11711729504168034 + ], + "unique_experts": 50, + "load_cv": 0.8607374144175675, + "normalized_load_entropy": 0.8994626234188912, + "max_load_share": 0.058823529411764705 + }, + "full_input": { + "tokens": 75, + "top_k": 6, + "decisions": 450, + "ordered_route_sha256": "5b64e3f4b01522c269ea75cb9c9a237d9c95d9f34fb631555b8c65a65185b189", + "route_weight_sha256": "35e576d2ef7ce93041b7120c5276e63bf9ef258f11b038eec69ceb671fb522ca", + "loads": [ + 3, + 2, + 6, + 12, + 4, + 5, + 6, + 9, + 6, + 13, + 15, + 4, + 1, + 15, + 4, + 4, + 6, + 4, + 8, + 6, + 1, + 3, + 11, + 2, + 4, + 10, + 9, + 4, + 4, + 27, + 4, + 4, + 8, + 8, + 15, + 0, + 2, + 9, + 7, + 9, + 11, + 5, + 9, + 0, + 13, + 5, + 14, + 15, + 2, + 9, + 3, + 3, + 9, + 7, + 11, + 3, + 7, + 7, + 1, + 14, + 8, + 8, + 8, + 4 + ], + "weighted_loads": [ + 0.13724523782730103, + 0.15353410691022873, + 0.26974588446319103, + 0.9638355931383558, + 0.26095666363835335, + 0.30131593346595764, + 0.3586958944797516, + 0.5201416853815317, + 0.47938554733991623, + 1.4391917660832405, + 1.108851496130228, + 0.13215005211532116, + 0.10675177723169327, + 1.032577771693468, + 0.10374190658330917, + 0.2790965363383293, + 0.7697567846626043, + 0.3775153774768114, + 0.7099853027611971, + 0.299921490252018, + 0.04870850592851639, + 0.3603140916675329, + 0.7716565802693367, + 0.13852494582533836, + 0.3170931041240692, + 0.7007506862282753, + 0.8126282244920731, + 0.16357002407312393, + 0.17715369910001755, + 1.4959078263491392, + 0.2813418619334698, + 0.12818967550992966, + 0.4267929159104824, + 0.5238066539168358, + 1.3328570970043074, + 0.0, + 0.05297507159411907, + 1.0569058805704117, + 1.4734993055462837, + 0.7313810773193836, + 0.8085771687328815, + 0.24156027688877657, + 0.4280889742076397, + 0.0, + 0.6188264563679695, + 0.17243374433019198, + 1.3544781878590584, + 1.0783127211034298, + 0.06843470968306065, + 0.535992918536067, + 0.12388303130865097, + 0.126376923173666, + 0.8996066525578499, + 0.32617753744125366, + 0.9765756912529469, + 0.15976529195904732, + 0.5791467092931271, + 0.29487710259854794, + 0.05789542198181152, + 0.7788647022098303, + 1.064164225012064, + 0.4870871286839247, + 0.581699799746275, + 0.16105682961642742 + ], + "unique_experts": 62, + "load_cv": 0.6755409355143148, + "normalized_load_entropy": 0.9465649059358006, + "max_load_share": 0.06 + } + }, + "s0_x": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "2177ad8bce9fee4c1c09428fde9da03d74089097c899b0eaa76ef29e7188ea3e", + "route_weight_sha256": "f361c8f23c1b9af27a9fc370ca4024ad152afc2cf328c25f198d6c3763fa964a", + "loads": [ + 2, + 0, + 2, + 2, + 3, + 5, + 3, + 9, + 6, + 4, + 6, + 5, + 0, + 1, + 0, + 0, + 4, + 2, + 2, + 4, + 0, + 0, + 5, + 1, + 4, + 0, + 1, + 5, + 4, + 3, + 4, + 4, + 7, + 6, + 0, + 0, + 1, + 5, + 4, + 6, + 7, + 1, + 0, + 0, + 14, + 2, + 3, + 11, + 1, + 6, + 0, + 1, + 5, + 4, + 5, + 3, + 2, + 5, + 1, + 1, + 0, + 6, + 4, + 2 + ], + "weighted_loads": [ + 0.08620114997029305, + 0.0, + 0.07386772707104683, + 0.11778804287314415, + 0.14926676824688911, + 0.2827685587108135, + 0.16166598722338676, + 0.49031434766948223, + 0.47166626155376434, + 0.38739585876464844, + 0.5236844085156918, + 0.18273121118545532, + 0.0, + 0.06520313024520874, + 0.0, + 0.0, + 0.3822493776679039, + 0.29626207053661346, + 0.06327490136027336, + 0.21700727567076683, + 0.0, + 0.0, + 0.36858905479311943, + 0.05143597349524498, + 0.3290579505264759, + 0.0, + 0.032199565321207047, + 0.1979023851454258, + 0.1746176928281784, + 0.14078757166862488, + 0.2867247834801674, + 0.14482968114316463, + 0.38534836657345295, + 0.42003387957811356, + 0.0, + 0.0, + 0.029493924230337143, + 0.7149833291769028, + 0.29541535302996635, + 0.509514007717371, + 0.6168026998639107, + 0.04091760888695717, + 0.0, + 0.0, + 0.6732619851827621, + 0.09642482548952103, + 0.10734450817108154, + 0.80986313149333, + 0.027487773448228836, + 0.4144466295838356, + 0.0, + 0.049324069172143936, + 0.5113110095262527, + 0.16876767948269844, + 0.4202864095568657, + 0.16956206411123276, + 0.16453814506530762, + 0.2372812144458294, + 0.05621662363409996, + 0.051208458840847015, + 0.0, + 0.3036107122898102, + 0.2658078297972679, + 0.08945177868008614 + ], + "unique_experts": 51, + "load_cv": 0.8836591638622547, + "normalized_load_entropy": 0.8989179312044998, + "max_load_share": 0.06862745098039216 + }, + "full_input": { + "tokens": 59, + "top_k": 6, + "decisions": 354, + "ordered_route_sha256": "f6187aa8a86b6736d66831913801ef1c882e95cc6e8be0d652c55dacce103ebc", + "route_weight_sha256": "5ed490d4ecada18d1aedef1862bbfd8a4d9c09f5805a5b2f6feee634744dfc9b", + "loads": [ + 2, + 4, + 6, + 6, + 4, + 5, + 3, + 9, + 6, + 4, + 17, + 6, + 0, + 13, + 3, + 3, + 4, + 2, + 6, + 4, + 0, + 1, + 7, + 1, + 4, + 6, + 6, + 5, + 4, + 18, + 4, + 5, + 7, + 8, + 9, + 0, + 1, + 8, + 6, + 6, + 11, + 3, + 9, + 0, + 14, + 3, + 17, + 11, + 4, + 8, + 2, + 1, + 5, + 4, + 5, + 3, + 2, + 5, + 1, + 13, + 5, + 6, + 7, + 2 + ], + "weighted_loads": [ + 0.08620114997029305, + 0.21479398384690285, + 0.2573448717594147, + 0.488673461106373, + 0.24464206025004387, + 0.2827685587108135, + 0.16166598722338676, + 0.49031434766948223, + 0.47166626155376434, + 0.38739585876464844, + 1.397995326668024, + 0.1998546700924635, + 0.0, + 0.9507444649934769, + 0.07516234368085861, + 0.19277185201644897, + 0.3822493776679039, + 0.29626207053661346, + 0.3030046478670556, + 0.21700727567076683, + 0.0, + 0.2910352647304535, + 0.5104815922677517, + 0.05143597349524498, + 0.3290579505264759, + 0.40254320949316025, + 0.5699799098074436, + 0.1979023851454258, + 0.1746176928281784, + 1.2998567491595168, + 0.2867247834801674, + 0.16319838911294937, + 0.38534836657345295, + 0.5002383776009083, + 0.8271087170578539, + 0.0, + 0.029493924230337143, + 0.9801857769489288, + 1.316338187083602, + 0.509514007717371, + 0.8142692558467388, + 0.18257450684905052, + 0.3978166989982128, + 0.0, + 0.6732619851827621, + 0.12662835232913494, + 1.5387148447334766, + 0.80986313149333, + 0.15307310596108437, + 0.4992957841604948, + 0.08104604110121727, + 0.049324069172143936, + 0.5113110095262527, + 0.16876767948269844, + 0.4202864095568657, + 0.16956206411123276, + 0.16453814506530762, + 0.2372812144458294, + 0.05621662363409996, + 0.7484019659459591, + 0.40563392057083547, + 0.3036107122898102, + 0.49025411531329155, + 0.08945177868008614 + ], + "unique_experts": 60, + "load_cv": 0.7412765253517536, + "normalized_load_entropy": 0.935235920023989, + "max_load_share": 0.05084745762711865 + } + }, + "s1_x": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "25cf8dead1f7c7408ccf2ef1acdfaffc82322c759e3f7def816c6d6452b86f08", + "route_weight_sha256": "9d6e0806fd4afdf018480c91651774cbe120c0c0bb87bce07133f56af4f58381", + "loads": [ + 3, + 0, + 2, + 2, + 3, + 5, + 3, + 9, + 5, + 4, + 6, + 4, + 0, + 1, + 1, + 0, + 4, + 2, + 2, + 4, + 0, + 0, + 5, + 1, + 4, + 0, + 0, + 3, + 4, + 3, + 4, + 3, + 8, + 6, + 0, + 0, + 3, + 5, + 4, + 6, + 8, + 1, + 0, + 0, + 14, + 3, + 3, + 11, + 0, + 6, + 0, + 1, + 5, + 3, + 5, + 3, + 2, + 5, + 1, + 1, + 0, + 6, + 4, + 3 + ], + "weighted_loads": [ + 0.1314178705215454, + 0.0, + 0.07386161759495735, + 0.11738007143139839, + 0.16186592355370522, + 0.2955182455480099, + 0.16116734221577644, + 0.5233243815600872, + 0.4495852515101433, + 0.36429788917303085, + 0.5407633222639561, + 0.1445249356329441, + 0.0, + 0.05402389541268349, + 0.02864675037562847, + 0.0, + 0.40358448028564453, + 0.3074088841676712, + 0.05732363276183605, + 0.20710091292858124, + 0.0, + 0.0, + 0.3512660413980484, + 0.04571671783924103, + 0.31212764233350754, + 0.0, + 0.0, + 0.13438976556062698, + 0.18114222958683968, + 0.11849034950137138, + 0.28008126094937325, + 0.10502923652529716, + 0.4136983957141638, + 0.42689184099435806, + 0.0, + 0.0, + 0.08982093818485737, + 0.7176624983549118, + 0.28829269483685493, + 0.5240106955170631, + 0.6547451354563236, + 0.035744667053222656, + 0.0, + 0.0, + 0.6556771453469992, + 0.15137092396616936, + 0.11054853349924088, + 0.7762550674378872, + 0.0, + 0.4089721105992794, + 0.0, + 0.05543431639671326, + 0.4892651066184044, + 0.14178932458162308, + 0.42146120220422745, + 0.1592332012951374, + 0.1530274786055088, + 0.22819208726286888, + 0.05775175243616104, + 0.05473710969090462, + 0.0, + 0.2868444621562958, + 0.27384957298636436, + 0.11942530423402786 + ], + "unique_experts": 50, + "load_cv": 0.8853977964608342, + "normalized_load_entropy": 0.8982138232571353, + "max_load_share": 0.06862745098039216 + }, + "full_input": { + "tokens": 75, + "top_k": 6, + "decisions": 450, + "ordered_route_sha256": "a34b50a872493d813de5a965c38e8e71da036e3ec09ce796ed29f1cdc10447a5", + "route_weight_sha256": "c7928b425b4b65e7c94e73636d12e77e48128fa4a29415eb2b58f2a09b7c063a", + "loads": [ + 3, + 3, + 7, + 11, + 4, + 5, + 5, + 9, + 5, + 13, + 16, + 5, + 1, + 14, + 4, + 4, + 6, + 4, + 9, + 6, + 1, + 2, + 11, + 2, + 4, + 10, + 8, + 3, + 4, + 22, + 4, + 4, + 8, + 8, + 14, + 0, + 4, + 9, + 7, + 9, + 12, + 6, + 10, + 0, + 15, + 5, + 16, + 15, + 1, + 9, + 3, + 2, + 9, + 7, + 11, + 3, + 7, + 7, + 1, + 15, + 8, + 8, + 8, + 4 + ], + "weighted_loads": [ + 0.1314178705215454, + 0.1986812837421894, + 0.3090281132608652, + 0.9332681594532914, + 0.2584364749491215, + 0.2955182455480099, + 0.30562086403369904, + 0.5233243815600872, + 0.4495852515101433, + 1.441635139286518, + 1.3198183812201023, + 0.16164839453995228, + 0.10675177723169327, + 0.9886218085885048, + 0.10339374653995037, + 0.28128404542803764, + 0.7685839980840683, + 0.37825404293835163, + 0.6103078573942184, + 0.297590184956789, + 0.04870850592851639, + 0.33146852254867554, + 0.7996556423604488, + 0.13819190859794617, + 0.31212764233350754, + 0.649498637765646, + 0.8021904677152634, + 0.13438976556062698, + 0.18114222958683968, + 1.2102504055947065, + 0.28008126094937325, + 0.1233979444950819, + 0.4136983957141638, + 0.509642519056797, + 1.1483878069266211, + 0.0, + 0.11524026282131672, + 1.0236153453588486, + 1.4774901121854782, + 0.7347057238221169, + 0.8689592890441418, + 0.2767908538808115, + 0.4679337255656719, + 0.0, + 0.6934126224368811, + 0.1815536051581148, + 1.603427466005087, + 1.1137802265584469, + 0.02973080240190029, + 0.528331832960248, + 0.1253058761358261, + 0.09311241284012794, + 0.9250476509332657, + 0.3251302056014538, + 0.9743923172354698, + 0.1592332012951374, + 0.5773438550531864, + 0.30137244798243046, + 0.05775175243616104, + 0.8570848237723112, + 0.875169649720192, + 0.48152412474155426, + 0.5800738222897053, + 0.16336483880877495 + ], + "unique_experts": 62, + "load_cv": 0.6517289446418278, + "normalized_load_entropy": 0.9474694877461113, + "max_load_share": 0.04888888888888889 + } + }, + "s0_period": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "94a45474c45f2d2b61911d2b6e743479f69faa86c8a3aae0119332cb91685ecf", + "route_weight_sha256": "807efc7698d0801f44f80a99754352514ee15c0deb271854fd6a265675d15396", + "loads": [ + 2, + 0, + 2, + 2, + 3, + 5, + 3, + 9, + 6, + 4, + 6, + 4, + 0, + 1, + 0, + 0, + 4, + 2, + 2, + 4, + 0, + 0, + 5, + 1, + 4, + 0, + 1, + 5, + 3, + 3, + 4, + 6, + 7, + 6, + 0, + 0, + 1, + 5, + 4, + 6, + 7, + 1, + 0, + 0, + 14, + 2, + 3, + 11, + 1, + 6, + 1, + 1, + 5, + 3, + 5, + 3, + 2, + 5, + 1, + 1, + 0, + 6, + 4, + 2 + ], + "weighted_loads": [ + 0.08664532378315926, + 0.0, + 0.07438761368393898, + 0.11580680683255196, + 0.14841685444116592, + 0.28081297501921654, + 0.15524974837899208, + 0.4952688720077276, + 0.47475915402173996, + 0.39642710983753204, + 0.5100819021463394, + 0.1484430655837059, + 0.0, + 0.06671585887670517, + 0.0, + 0.0, + 0.3853886555880308, + 0.2954576760530472, + 0.06407826393842697, + 0.21753742173314095, + 0.0, + 0.0, + 0.3594498708844185, + 0.04950268194079399, + 0.3269154839217663, + 0.0, + 0.03194749727845192, + 0.1995009146630764, + 0.13389571011066437, + 0.1335715763270855, + 0.2865326479077339, + 0.2143542319536209, + 0.3793192468583584, + 0.42301885038614273, + 0.0, + 0.0, + 0.029496904462575912, + 0.7264739871025085, + 0.297824714332819, + 0.5139706693589687, + 0.6129259392619133, + 0.04110834002494812, + 0.0, + 0.0, + 0.6728350017219782, + 0.09299042075872421, + 0.1061243787407875, + 0.7906285226345062, + 0.026971587911248207, + 0.412788562476635, + 0.04093816876411438, + 0.047859493643045425, + 0.5196027085185051, + 0.13180755078792572, + 0.41619714349508286, + 0.16801117360591888, + 0.16627220064401627, + 0.23239463940262794, + 0.05830581486225128, + 0.04794237017631531, + 0.0, + 0.29955803230404854, + 0.26941753923892975, + 0.08582155779004097 + ], + "unique_experts": 52, + "load_cv": 0.8819171036881969, + "normalized_load_entropy": 0.9010340181863487, + "max_load_share": 0.06862745098039216 + }, + "full_input": { + "tokens": 59, + "top_k": 6, + "decisions": 354, + "ordered_route_sha256": "8a97ca2f4affd438aeace4965127a30afaea049b1b6f8c53e3e113ca859d6963", + "route_weight_sha256": "e532c7656ab1107f9fdbe0a237cf293a5427e79ea7b5c95d836ca84f9945b456", + "loads": [ + 2, + 4, + 5, + 6, + 4, + 5, + 3, + 9, + 6, + 4, + 16, + 5, + 0, + 13, + 3, + 3, + 4, + 2, + 6, + 4, + 0, + 1, + 8, + 1, + 4, + 6, + 7, + 5, + 3, + 19, + 4, + 7, + 7, + 8, + 9, + 0, + 1, + 8, + 6, + 6, + 10, + 3, + 8, + 0, + 14, + 3, + 16, + 11, + 4, + 8, + 3, + 2, + 6, + 3, + 5, + 3, + 2, + 5, + 1, + 13, + 5, + 6, + 7, + 2 + ], + "weighted_loads": [ + 0.08664532378315926, + 0.22459780797362328, + 0.224586371332407, + 0.4903385466604959, + 0.24585378915071487, + 0.28081297501921654, + 0.15524974837899208, + 0.4952688720077276, + 0.47475915402173996, + 0.39642710983753204, + 1.1665064170956612, + 0.16556652449071407, + 0.0, + 0.9329056441783905, + 0.07516234368085861, + 0.1768028326332569, + 0.3853886555880308, + 0.2954576760530472, + 0.31190480969962664, + 0.21753742173314095, + 0.0, + 0.2910352647304535, + 0.5380830951035023, + 0.04950268194079399, + 0.3269154839217663, + 0.38214150816202164, + 0.8336586989462376, + 0.1995009146630764, + 0.13389571011066437, + 1.3198889091436286, + 0.2865326479077339, + 0.23272293992340565, + 0.3793192468583584, + 0.508404079824686, + 0.8226608992554247, + 0.0, + 0.029496904462575912, + 1.0044424086809158, + 1.3185834474861622, + 0.5139706693589687, + 0.7535700015723705, + 0.17664407938718796, + 0.3620007373392582, + 0.0, + 0.6728350017219782, + 0.12319394759833813, + 1.452778723090887, + 0.7906285226345062, + 0.16292418725788593, + 0.49881346337497234, + 0.12120307609438896, + 0.17487556114792824, + 0.5845522210001945, + 0.13180755078792572, + 0.41619714349508286, + 0.16801117360591888, + 0.16627220064401627, + 0.23239463940262794, + 0.05830581486225128, + 0.7496751509606838, + 0.40825628279708326, + 0.29955803230404854, + 0.49557120725512505, + 0.08582155779004097 + ], + "unique_experts": 60, + "load_cv": 0.7301699811324722, + "normalized_load_entropy": 0.9370197989269659, + "max_load_share": 0.05367231638418079 + } + }, + "s1_period": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "5befe5c8375647b4cb073c99613e447a9b718b1c09aa34f989b037a957b9c26b", + "route_weight_sha256": "c33566768b60a99141e963b75b860e413c6e79b62593ccfecb2853a9406e7631", + "loads": [ + 3, + 0, + 2, + 2, + 3, + 5, + 3, + 9, + 5, + 4, + 6, + 4, + 0, + 1, + 1, + 0, + 4, + 2, + 2, + 4, + 0, + 1, + 5, + 1, + 4, + 0, + 0, + 3, + 2, + 3, + 4, + 4, + 7, + 6, + 0, + 0, + 3, + 5, + 4, + 6, + 8, + 1, + 0, + 0, + 14, + 3, + 3, + 11, + 0, + 6, + 1, + 1, + 5, + 3, + 5, + 3, + 2, + 5, + 1, + 1, + 0, + 6, + 4, + 3 + ], + "weighted_loads": [ + 0.13031090795993805, + 0.0, + 0.07446138560771942, + 0.11754022538661957, + 0.1613781936466694, + 0.2961167134344578, + 0.14917264506220818, + 0.523502791300416, + 0.4483495503664017, + 0.36896299570798874, + 0.5343933142721653, + 0.14642232656478882, + 0.0, + 0.05484478548169136, + 0.02871122770011425, + 0.0, + 0.40187173895537853, + 0.30151505768299103, + 0.05848576873540878, + 0.2065984234213829, + 0.0, + 0.02885333076119423, + 0.34514253586530685, + 0.044665951281785965, + 0.30967942997813225, + 0.0, + 0.0, + 0.1353605091571808, + 0.0991641953587532, + 0.10982071235775948, + 0.2818848341703415, + 0.14668378420174122, + 0.38053604774177074, + 0.43246617168188095, + 0.0, + 0.0, + 0.08820736967027187, + 0.724164217710495, + 0.28300705924630165, + 0.5288822054862976, + 0.6548612155020237, + 0.03486906364560127, + 0.0, + 0.0, + 0.6579526159912348, + 0.15204907953739166, + 0.10943395271897316, + 0.7637811712920666, + 0.0, + 0.4126908779144287, + 0.04309578984975815, + 0.05406530573964119, + 0.4904381036758423, + 0.1423763707280159, + 0.41679785400629044, + 0.1595945991575718, + 0.15502812713384628, + 0.22330956906080246, + 0.05902952700853348, + 0.05337969586253166, + 0.0, + 0.2846769317984581, + 0.2742103710770607, + 0.11499518528580666 + ], + "unique_experts": 52, + "load_cv": 0.8696249749622229, + "normalized_load_entropy": 0.9040172571196845, + "max_load_share": 0.06862745098039216 + }, + "full_input": { + "tokens": 75, + "top_k": 6, + "decisions": 450, + "ordered_route_sha256": "44600154c535fc6725e389ccd793774dbcaf11762f334a7faca273ede96cf7d6", + "route_weight_sha256": "98107d737a244d5f979a89097a9a4ed0effd37c1eaa84c3e76d064e1f13f47cc", + "loads": [ + 3, + 3, + 6, + 11, + 4, + 5, + 5, + 9, + 5, + 13, + 15, + 5, + 1, + 14, + 4, + 4, + 6, + 4, + 9, + 6, + 1, + 3, + 12, + 2, + 4, + 10, + 9, + 3, + 2, + 22, + 4, + 5, + 7, + 8, + 13, + 0, + 4, + 10, + 7, + 9, + 11, + 6, + 9, + 0, + 15, + 5, + 15, + 15, + 1, + 9, + 4, + 3, + 10, + 7, + 11, + 3, + 7, + 7, + 1, + 15, + 8, + 8, + 8, + 5 + ], + "weighted_loads": [ + 0.13031090795993805, + 0.18774249777197838, + 0.27393939159810543, + 0.9370817950111814, + 0.25622710958123207, + 0.2961167134344578, + 0.29362616688013077, + 0.523502791300416, + 0.4483495503664017, + 1.446300245821476, + 1.1239140816032887, + 0.163545785471797, + 0.10675177723169327, + 0.9642351716756821, + 0.10345822386443615, + 0.29132605344057083, + 0.7668712567538023, + 0.37236021645367146, + 0.615554990246892, + 0.2970876954495907, + 0.04870850592851639, + 0.36032185330986977, + 0.8279460482299328, + 0.1371411420404911, + 0.30967942997813225, + 0.6169548761099577, + 1.1056447699666023, + 0.1353605091571808, + 0.0991641953587532, + 1.189277844503522, + 0.2818848341703415, + 0.16505249217152596, + 0.38053604774177074, + 0.5204210244119167, + 1.092868930165423, + 0.0, + 0.11410176195204258, + 1.0844154246151447, + 1.472204476594925, + 0.7395772337913513, + 0.8145128823816776, + 0.27038825332419947, + 0.4280889742076397, + 0.0, + 0.6956880930811167, + 0.1822317607293371, + 1.4522439017891884, + 1.1013063304126263, + 0.02973080240190029, + 0.5346357841044664, + 0.1678801253437996, + 0.1878756284713745, + 0.978864636272192, + 0.3257172517478466, + 0.9697289690375328, + 0.1595945991575718, + 0.5793445035815239, + 0.29648992978036404, + 0.05902952700853348, + 0.9121507834643126, + 0.8752601630985737, + 0.4793565943837166, + 0.5947141051292419, + 0.18967149779200554 + ], + "unique_experts": 62, + "load_cv": 0.6375105905680468, + "normalized_load_entropy": 0.9494277508203628, + "max_load_share": 0.04888888888888889 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 34, + "ordered_topk_exact_tokens": 23, + "set_exact_tokens": 27, + "mean_set_jaccard": 0.934873949579832, + "mean_token_weighted_tv": 0.012309233904542291, + "aggregate_load_tv": 0.029411764705882353 + }, + "system_bos": { + "tokens": 34, + "ordered_topk_exact_tokens": 22, + "set_exact_tokens": 26, + "mean_set_jaccard": 0.9327731092436975, + "mean_token_weighted_tv": 0.01563126248691012, + "aggregate_load_tv": 0.03921568627450981 + }, + "system_x": { + "tokens": 34, + "ordered_topk_exact_tokens": 22, + "set_exact_tokens": 26, + "mean_set_jaccard": 0.9215686274509804, + "mean_token_weighted_tv": 0.019455053186153665, + "aggregate_load_tv": 0.039215686274509796 + }, + "system_period": { + "tokens": 34, + "ordered_topk_exact_tokens": 19, + "set_exact_tokens": 25, + "mean_set_jaccard": 0.9131652661064427, + "mean_token_weighted_tv": 0.020247420049546397, + "aggregate_load_tv": 0.0392156862745098 + }, + "bos_at_s0": { + "tokens": 34, + "ordered_topk_exact_tokens": 16, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.8613445378151261, + "mean_token_weighted_tv": 0.027213529984959784, + "aggregate_load_tv": 0.06862745098039216 + }, + "bos_at_s1": { + "tokens": 34, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 20, + "mean_set_jaccard": 0.8697478991596639, + "mean_token_weighted_tv": 0.028483997099101543, + "aggregate_load_tv": 0.06862745098039215 + }, + "x_at_s0": { + "tokens": 34, + "ordered_topk_exact_tokens": 17, + "set_exact_tokens": 21, + "mean_set_jaccard": 0.8529411764705882, + "mean_token_weighted_tv": 0.030543905737645486, + "aggregate_load_tv": 0.0784313725490196 + }, + "x_at_s1": { + "tokens": 34, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 18, + "mean_set_jaccard": 0.846638655462185, + "mean_token_weighted_tv": 0.03193153755958466, + "aggregate_load_tv": 0.08333333333333334 + }, + "period_at_s0": { + "tokens": 34, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 20, + "mean_set_jaccard": 0.8445378151260504, + "mean_token_weighted_tv": 0.031194465043132797, + "aggregate_load_tv": 0.0784313725490196 + }, + "period_at_s1": { + "tokens": 34, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.8382352941176472, + "mean_token_weighted_tv": 0.03290065566954367, + "aggregate_load_tv": 0.0784313725490196 + } + } + }, + "layer_05": { + "layer": 5, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "7fbd42ada8781a5186348e3483af3902252f7428cd2ef314fdf94d445ef396ce", + "route_weight_sha256": "744ed545d82501884eb79835c873520d66144f55aeaa5eecb451f9a8314747a0", + "loads": [ + 2, + 5, + 0, + 0, + 3, + 0, + 0, + 3, + 0, + 1, + 1, + 4, + 5, + 3, + 19, + 0, + 5, + 1, + 0, + 2, + 1, + 3, + 1, + 0, + 1, + 5, + 1, + 5, + 0, + 2, + 4, + 4, + 4, + 12, + 6, + 1, + 4, + 1, + 0, + 0, + 8, + 0, + 6, + 5, + 5, + 9, + 0, + 4, + 0, + 0, + 1, + 6, + 1, + 4, + 6, + 1, + 5, + 4, + 1, + 19, + 3, + 4, + 3, + 0 + ], + "weighted_loads": [ + 0.22706115990877151, + 0.236192524433136, + 0.0, + 0.0, + 0.10050534829497337, + 0.0, + 0.0, + 0.13014856725931168, + 0.0, + 0.03117181733250618, + 0.027930419892072678, + 0.1305776908993721, + 0.3253817483782768, + 0.13087598234415054, + 1.8481032960116863, + 0.0, + 0.48550110310316086, + 0.040849171578884125, + 0.0, + 0.15638862550258636, + 0.033498287200927734, + 0.20585889369249344, + 0.03422447293996811, + 0.0, + 0.10586149245500565, + 0.3295712471008301, + 0.05861569568514824, + 0.5368679687380791, + 0.0, + 0.0750352144241333, + 0.21385957300662994, + 0.14147227071225643, + 0.11664783209562302, + 1.0557830352336168, + 0.43299852684140205, + 0.033693790435791016, + 0.20596236176788807, + 0.030401043593883514, + 0.0, + 0.0, + 0.7329152412712574, + 0.0, + 0.6913693025708199, + 0.32203828543424606, + 0.34744757413864136, + 0.7670291103422642, + 0.0, + 0.15514618903398514, + 0.0, + 0.0, + 0.03486904874444008, + 0.31906524300575256, + 0.03491454944014549, + 0.1988311931490898, + 0.2636597082018852, + 0.03403175249695778, + 0.25950829312205315, + 0.1451239064335823, + 0.06261005997657776, + 2.028057288378477, + 0.22345177456736565, + 0.20410379767417908, + 0.13119764998555183, + 0.0 + ], + "unique_experts": 48, + "load_cv": 1.1944701498445516, + "normalized_load_entropy": 0.8551953434672477, + "max_load_share": 0.09313725490196079 + }, + "full_input": { + "tokens": 59, + "top_k": 6, + "decisions": 354, + "ordered_route_sha256": "9796e913b65c8383edb8f8392b2ec756c909a89fdd65ce3f1cabc478ab50abde", + "route_weight_sha256": "09ddfaad5779f32d699c99dafce2c5804a2fbe0f6f6a60455ddc629aa69a1c53", + "loads": [ + 2, + 6, + 0, + 0, + 4, + 1, + 2, + 4, + 1, + 2, + 11, + 4, + 8, + 3, + 19, + 12, + 8, + 7, + 9, + 3, + 3, + 3, + 1, + 0, + 1, + 13, + 1, + 5, + 0, + 3, + 4, + 4, + 4, + 12, + 6, + 6, + 4, + 1, + 11, + 7, + 12, + 7, + 15, + 6, + 7, + 9, + 0, + 7, + 0, + 4, + 8, + 6, + 3, + 12, + 9, + 11, + 5, + 4, + 1, + 20, + 3, + 5, + 3, + 2 + ], + "weighted_loads": [ + 0.22706115990877151, + 0.23968839738518, + 0.0, + 0.0, + 0.10226463223807514, + 0.03675416484475136, + 0.07854211702942848, + 0.1331971667241305, + 0.0033411819022148848, + 0.035689054522663355, + 0.6157123185694218, + 0.1305776908993721, + 0.5079427920281887, + 0.13087598234415054, + 1.8481032960116863, + 1.9775498411618173, + 0.7116029039025307, + 0.3397075906395912, + 0.8163013979792595, + 0.16946921218186617, + 0.0489350410643965, + 0.20585889369249344, + 0.03422447293996811, + 0.0, + 0.10586149245500565, + 1.2255659066140652, + 0.05861569568514824, + 0.5368679687380791, + 0.0, + 0.11225678026676178, + 0.21385957300662994, + 0.14147227071225643, + 0.11664783209562302, + 1.0557830352336168, + 0.43299852684140205, + 0.45702601596713066, + 0.20596236176788807, + 0.030401043593883514, + 1.0532295554876328, + 0.5604575350880623, + 0.9083352200686932, + 0.7241936177015305, + 1.5426316447556019, + 0.3570078909397125, + 0.5361028760671616, + 0.7670291103422642, + 0.0, + 0.21162404911592603, + 0.0, + 0.20877540670335293, + 0.753507774323225, + 0.31906524300575256, + 1.6645362935960293, + 0.7424636073410511, + 0.2805197994457558, + 0.7698039300739765, + 0.25950829312205315, + 0.1451239064335823, + 0.06261005997657776, + 2.074090525507927, + 0.22345177456736565, + 0.23977785930037498, + 0.13119764998555183, + 0.9360589496791363 + ], + "unique_experts": 58, + "load_cv": 0.8179222311136267, + "normalized_load_entropy": 0.9186310581842685, + "max_load_share": 0.05649717514124294 + } + }, + "s1_eos": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "9a1b6250c69e01f4daeb951f506c4e4b16a31fc0e4aacca3a7ae45f8511f6ea1", + "route_weight_sha256": "a523cbc3b0e874d25c14c891ce69a4707f1fb82eb2d5ccfc759dfbc79dad7686", + "loads": [ + 2, + 5, + 0, + 0, + 3, + 0, + 0, + 3, + 0, + 1, + 1, + 3, + 5, + 3, + 19, + 0, + 5, + 1, + 0, + 2, + 1, + 3, + 0, + 0, + 1, + 6, + 1, + 5, + 0, + 2, + 4, + 4, + 4, + 11, + 6, + 1, + 4, + 1, + 0, + 0, + 9, + 0, + 6, + 5, + 5, + 9, + 0, + 5, + 0, + 0, + 1, + 6, + 1, + 4, + 6, + 1, + 5, + 4, + 1, + 19, + 3, + 4, + 3, + 0 + ], + "weighted_loads": [ + 0.22500131279230118, + 0.23377026617527008, + 0.0, + 0.0, + 0.10033989325165749, + 0.0, + 0.0, + 0.13496872037649155, + 0.0, + 0.031009642407298088, + 0.02661479264497757, + 0.0990767627954483, + 0.3292309232056141, + 0.129704799503088, + 1.8623427711427212, + 0.0, + 0.49840113520622253, + 0.04028565436601639, + 0.0, + 0.15257012099027634, + 0.034669991582632065, + 0.20510898903012276, + 0.0, + 0.0, + 0.10670649260282516, + 0.35514132492244244, + 0.05359765887260437, + 0.5363701060414314, + 0.0, + 0.07812877371907234, + 0.20963620394468307, + 0.13989172130823135, + 0.11958945356309414, + 1.0194206088781357, + 0.4326492380350828, + 0.03296985477209091, + 0.2092069499194622, + 0.03169635310769081, + 0.0, + 0.0, + 0.757907472550869, + 0.0, + 0.683711588382721, + 0.32627227529883385, + 0.34434764459729195, + 0.7683548852801323, + 0.0, + 0.19471240416169167, + 0.0, + 0.0, + 0.03465884178876877, + 0.3226494640111923, + 0.034660741686820984, + 0.19627800583839417, + 0.26583774015307426, + 0.034503959119319916, + 0.24736230447888374, + 0.14281659200787544, + 0.062498439103364944, + 2.045494556427002, + 0.2244543544948101, + 0.1985190324485302, + 0.13263732939958572, + 0.0 + ], + "unique_experts": 47, + "load_cv": 1.1983263992625508, + "normalized_load_entropy": 0.8520677410850357, + "max_load_share": 0.09313725490196079 + }, + "full_input": { + "tokens": 75, + "top_k": 6, + "decisions": 450, + "ordered_route_sha256": "ca391f3367077bcf566874fae67b73dde28cdc19aa148c2f7440d5c4e436d80d", + "route_weight_sha256": "f22aa138594f1cb94f687df06af489778ffa4914480aa1f827777b3c16cf416e", + "loads": [ + 3, + 7, + 0, + 6, + 4, + 2, + 9, + 5, + 1, + 2, + 14, + 6, + 10, + 3, + 20, + 14, + 9, + 12, + 12, + 12, + 3, + 3, + 1, + 0, + 2, + 14, + 1, + 7, + 0, + 5, + 4, + 4, + 5, + 12, + 7, + 6, + 5, + 4, + 12, + 11, + 12, + 12, + 19, + 9, + 7, + 9, + 0, + 9, + 0, + 14, + 10, + 7, + 3, + 14, + 10, + 11, + 5, + 4, + 2, + 20, + 4, + 5, + 3, + 4 + ], + "weighted_loads": [ + 0.26187095791101456, + 0.25788137898780406, + 0.0, + 0.4141514152288437, + 0.10211327858269215, + 0.07399554550647736, + 1.021423313766718, + 0.18911727843806148, + 0.003352703060954809, + 0.035433427430689335, + 0.8166521098464727, + 0.4696930944919586, + 0.7407926917076111, + 0.129704799503088, + 1.8953772000968456, + 2.468179479241371, + 0.8055812567472458, + 0.7175906524062157, + 1.1687778607010841, + 1.0046422826126218, + 0.05001370934769511, + 0.20510898903012276, + 0.037704676389694214, + 0.0, + 0.1825757995247841, + 1.0710400324314833, + 0.05359765887260437, + 0.710664302110672, + 0.0, + 0.20037447661161423, + 0.20963620394468307, + 0.13989172130823135, + 0.23870867304503918, + 1.0620361119508743, + 0.46702158637344837, + 0.5857581123709679, + 0.2545393444597721, + 0.1830359250307083, + 1.1983755379915237, + 1.0161224342882633, + 0.8831542283296585, + 1.1236182786524296, + 1.8352600522339344, + 0.5620709396898746, + 0.5068699456751347, + 0.7683548852801323, + 0.0, + 0.2840042067691684, + 0.0, + 0.8476983476430178, + 1.158957328647375, + 0.3707709200680256, + 1.6639828532934189, + 1.0025092922151089, + 0.3204737971536815, + 0.6491885706782341, + 0.24736230447888374, + 0.14281659200787544, + 0.13300536945462227, + 2.093013994395733, + 0.2704457566142082, + 0.23307476937770844, + 0.13263732939958572, + 1.176942404359579 + ], + "unique_experts": 59, + "load_cv": 0.7155279497780505, + "normalized_load_entropy": 0.9331763763799966, + "max_load_share": 0.044444444444444446 + } + }, + "s0_bos": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "0aadddf058218a8bd90b5e457789f9a2c418e8ed08eb3b92b1c16176561cb6ac", + "route_weight_sha256": "43e6c4bf1020c0f507e20d58269b069737263dfd6dd26fbb70d65a43f33f6eab", + "loads": [ + 2, + 6, + 0, + 0, + 3, + 0, + 0, + 3, + 0, + 1, + 0, + 5, + 5, + 3, + 19, + 0, + 5, + 1, + 0, + 2, + 1, + 3, + 0, + 0, + 1, + 4, + 2, + 5, + 0, + 2, + 4, + 5, + 3, + 11, + 6, + 1, + 2, + 1, + 0, + 0, + 8, + 0, + 6, + 5, + 5, + 10, + 0, + 5, + 0, + 0, + 1, + 6, + 1, + 4, + 6, + 2, + 5, + 5, + 1, + 19, + 3, + 4, + 2, + 0 + ], + "weighted_loads": [ + 0.2241862416267395, + 0.2692096587270498, + 0.0, + 0.0, + 0.09984159469604492, + 0.0, + 0.0, + 0.13918470963835716, + 0.0, + 0.031066566705703735, + 0.0, + 0.15705588832497597, + 0.3143337853252888, + 0.14047209173440933, + 1.9787056259810925, + 0.0, + 0.4944377765059471, + 0.037248581647872925, + 0.0, + 0.16459834203124046, + 0.024669118225574493, + 0.21448147296905518, + 0.0, + 0.0, + 0.1023583635687828, + 0.30469030141830444, + 0.07424206472933292, + 0.5165276974439621, + 0.0, + 0.08039474114775658, + 0.21736996620893478, + 0.17442595586180687, + 0.09528954699635506, + 1.016277275979519, + 0.44207245483994484, + 0.03428041189908981, + 0.1618773154914379, + 0.030178267508745193, + 0.0, + 0.0, + 0.7184088043868542, + 0.0, + 0.739926390349865, + 0.32796429470181465, + 0.32991234585642815, + 0.7286041807383299, + 0.0, + 0.19916047528386116, + 0.0, + 0.0, + 0.03554251044988632, + 0.3037492595613003, + 0.03207660838961601, + 0.2075444981455803, + 0.26986582577228546, + 0.06586937420070171, + 0.24881626293063164, + 0.17792773246765137, + 0.06280698627233505, + 2.13973306119442, + 0.23226848617196083, + 0.20068184658885002, + 0.09441249817609787, + 0.0 + ], + "unique_experts": 46, + "load_cv": 1.2034488437691884, + "normalized_load_entropy": 0.8499231133320764, + "max_load_share": 0.09313725490196079 + }, + "full_input": { + "tokens": 59, + "top_k": 6, + "decisions": 354, + "ordered_route_sha256": "72df069da10df839e79fbad75ff0a5c4f43e5da78b943aaddb1387e03efa12c6", + "route_weight_sha256": "d48e13bb5a1fd1268522a860c53275bf2347dcced3d6c952dfd4f9af5bf3495d", + "loads": [ + 2, + 7, + 0, + 0, + 3, + 1, + 2, + 4, + 1, + 1, + 10, + 5, + 8, + 3, + 19, + 13, + 8, + 7, + 9, + 3, + 2, + 3, + 0, + 0, + 1, + 12, + 2, + 5, + 0, + 3, + 4, + 5, + 3, + 11, + 6, + 6, + 2, + 1, + 12, + 8, + 12, + 7, + 16, + 6, + 7, + 10, + 0, + 7, + 0, + 5, + 8, + 6, + 2, + 12, + 8, + 13, + 5, + 5, + 1, + 20, + 3, + 5, + 2, + 2 + ], + "weighted_loads": [ + 0.2241862416267395, + 0.27270553167909384, + 0.0, + 0.0, + 0.09984159469604492, + 0.03675416484475136, + 0.0767618864774704, + 0.142233309103176, + 0.0033411819022148848, + 0.031066566705703735, + 0.5936021208763123, + 0.15705588832497597, + 0.49641103297472, + 0.14047209173440933, + 1.9787056259810925, + 2.031943758483976, + 0.7314648926258087, + 0.33610700070858, + 0.8831495270133018, + 0.17767892871052027, + 0.03721895255148411, + 0.21448147296905518, + 0.0, + 0.0, + 0.1023583635687828, + 1.2006849609315395, + 0.07424206472933292, + 0.5165276974439621, + 0.0, + 0.11098027601838112, + 0.21736996620893478, + 0.17442595586180687, + 0.09528954699635506, + 1.016277275979519, + 0.44207245483994484, + 0.4679223857820034, + 0.1618773154914379, + 0.030178267508745193, + 1.2402863092720509, + 0.5995497331023216, + 0.8938287831842899, + 0.7538037225604057, + 1.6688919588923454, + 0.36921094730496407, + 0.5102217309176922, + 0.7286041807383299, + 0.0, + 0.24919651169329882, + 0.0, + 0.2406678032130003, + 0.7382401414215565, + 0.3037492595613003, + 0.6970505826175213, + 0.7511769123375416, + 0.28482572990469635, + 0.8050675000995398, + 0.24881626293063164, + 0.17792773246765137, + 0.06280698627233505, + 2.1857662983238697, + 0.23226848617196083, + 0.23853684216737747, + 0.09441249817609787, + 0.9360589496791363 + ], + "unique_experts": 57, + "load_cv": 0.8431339800008001, + "normalized_load_entropy": 0.9125346961057712, + "max_load_share": 0.05649717514124294 + } + }, + "s1_bos": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "40e5c73e7844cb821895ba2d45eed81c6ef5c06bb833e7bb843d94dd9a415119", + "route_weight_sha256": "43fd62253023176e342b5ebd3baa1da63062353558800301bdc275edfe179991", + "loads": [ + 2, + 5, + 0, + 0, + 2, + 0, + 0, + 3, + 0, + 1, + 0, + 3, + 5, + 5, + 19, + 0, + 5, + 1, + 0, + 2, + 2, + 3, + 0, + 0, + 1, + 5, + 2, + 5, + 0, + 3, + 4, + 4, + 2, + 11, + 6, + 1, + 3, + 1, + 0, + 0, + 8, + 0, + 6, + 5, + 5, + 11, + 0, + 5, + 0, + 0, + 1, + 5, + 1, + 4, + 6, + 1, + 5, + 4, + 1, + 19, + 3, + 4, + 2, + 2 + ], + "weighted_loads": [ + 0.22516852617263794, + 0.22906315699219704, + 0.0, + 0.0, + 0.06750423647463322, + 0.0, + 0.0, + 0.14091885089874268, + 0.0, + 0.03189433738589287, + 0.0, + 0.09145504981279373, + 0.3132075183093548, + 0.2096663173288107, + 1.9735651016235352, + 0.0, + 0.5007426142692566, + 0.039177410304546356, + 0.0, + 0.16453876346349716, + 0.056687504053115845, + 0.2206098474562168, + 0.0, + 0.0, + 0.10696262866258621, + 0.32873429730534554, + 0.07917384803295135, + 0.5136813372373581, + 0.0, + 0.10525738261640072, + 0.223380658775568, + 0.15075184404850006, + 0.06526535749435425, + 1.0245938785374165, + 0.44705889374017715, + 0.03364663943648338, + 0.18970942310988903, + 0.031986307352781296, + 0.0, + 0.0, + 0.7157633975148201, + 0.0, + 0.747804582118988, + 0.34138788282871246, + 0.3294423669576645, + 0.7616308256983757, + 0.0, + 0.2099577561020851, + 0.0, + 0.0, + 0.033458150923252106, + 0.27594346925616264, + 0.031154349446296692, + 0.21242466941475868, + 0.2695079706609249, + 0.035214900970458984, + 0.24977199360728264, + 0.13968802616000175, + 0.06087541580200195, + 2.136710111051798, + 0.2296820729970932, + 0.19720878452062607, + 0.090974111109972, + 0.05905064195394516 + ], + "unique_experts": 47, + "load_cv": 1.1996090610150925, + "normalized_load_entropy": 0.853661220095214, + "max_load_share": 0.09313725490196079 + }, + "full_input": { + "tokens": 75, + "top_k": 6, + "decisions": 450, + "ordered_route_sha256": "89658eec0fe88fca871c084d0dee510edd840204bc4973b4f9dcc99d62d7141e", + "route_weight_sha256": "3738a12166e4e0951e802c38dc31af20bac84aa6c60611849d486c58a1bbfd48", + "loads": [ + 3, + 7, + 0, + 6, + 2, + 2, + 9, + 5, + 1, + 1, + 13, + 6, + 10, + 5, + 20, + 15, + 10, + 12, + 14, + 12, + 3, + 3, + 1, + 0, + 2, + 13, + 2, + 7, + 0, + 6, + 4, + 4, + 3, + 12, + 7, + 6, + 4, + 4, + 13, + 11, + 10, + 12, + 20, + 9, + 7, + 11, + 0, + 8, + 0, + 13, + 11, + 6, + 2, + 14, + 9, + 12, + 5, + 4, + 2, + 20, + 4, + 5, + 2, + 6 + ], + "weighted_loads": [ + 0.2620381712913513, + 0.253174269804731, + 0.0, + 0.4141514152288437, + 0.06750423647463322, + 0.07399554550647736, + 1.0178625769913197, + 0.1950674089603126, + 0.003352703060954809, + 0.03189433738589287, + 0.7883758675307035, + 0.46207138150930405, + 0.730863057076931, + 0.2096663173288107, + 2.0065995305776596, + 2.52708650380373, + 0.8601054772734642, + 0.7164824083447456, + 1.2943759933114052, + 1.0166109250858426, + 0.06923733837902546, + 0.2206098474562168, + 0.037704676389694214, + 0.0, + 0.18283193558454514, + 1.0446330048143864, + 0.07917384803295135, + 0.6879755333065987, + 0.0, + 0.21700317785143852, + 0.223380658775568, + 0.15075184404850006, + 0.18438457697629929, + 1.067209381610155, + 0.4814312420785427, + 0.5831514187157154, + 0.23504181765019894, + 0.1833258792757988, + 1.3617980405688286, + 1.0082412473857403, + 0.8073881305754185, + 1.146043311804533, + 1.9481447227299213, + 0.5867872983217239, + 0.48402587324380875, + 0.7616308256983757, + 0.0, + 0.29288115818053484, + 0.0, + 0.8128563333302736, + 1.2040402367711067, + 0.3240649253129959, + 0.696128323674202, + 1.0186559557914734, + 0.32214867882430553, + 0.6725372597575188, + 0.24977199360728264, + 0.13968802616000175, + 0.13138234615325928, + 2.184229549020529, + 0.2756734751164913, + 0.23575083911418915, + 0.090974111109972, + 1.2359930463135242 + ], + "unique_experts": 59, + "load_cv": 0.7316883908021009, + "normalized_load_entropy": 0.9302319174687069, + "max_load_share": 0.044444444444444446 + } + }, + "s0_x": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "809857cdbedc8480dd656f7b71285e6a8f7182c9382799cea463bdf04b350356", + "route_weight_sha256": "d252b2047b8311a02a73271ff9aa1b8c68d81200ddd8d612b722ad08781f939a", + "loads": [ + 2, + 6, + 0, + 0, + 4, + 0, + 0, + 3, + 0, + 1, + 1, + 3, + 5, + 5, + 19, + 0, + 5, + 1, + 0, + 2, + 1, + 3, + 0, + 0, + 1, + 5, + 1, + 5, + 0, + 3, + 4, + 4, + 1, + 12, + 6, + 1, + 2, + 1, + 0, + 0, + 9, + 0, + 6, + 5, + 5, + 9, + 0, + 5, + 0, + 0, + 1, + 6, + 1, + 4, + 6, + 1, + 5, + 4, + 1, + 19, + 3, + 4, + 3, + 0 + ], + "weighted_loads": [ + 0.21747895330190659, + 0.27288493141531944, + 0.0, + 0.0, + 0.1300069410353899, + 0.0, + 0.0, + 0.13696995750069618, + 0.0, + 0.03005269356071949, + 0.03270807862281799, + 0.0988873839378357, + 0.32587118446826935, + 0.2085758838802576, + 1.8692287802696228, + 0.0, + 0.45859960466623306, + 0.03751552850008011, + 0.0, + 0.16658790037035942, + 0.02601257897913456, + 0.2077920250594616, + 0.0, + 0.0, + 0.10313598066568375, + 0.3413241058588028, + 0.056059084832668304, + 0.5218782424926758, + 0.0, + 0.09393571689724922, + 0.21941471844911575, + 0.15258654579520226, + 0.03619803488254547, + 1.0377568416297436, + 0.4483404643833637, + 0.03562265634536743, + 0.15385116264224052, + 0.02950509451329708, + 0.0, + 0.0, + 0.763330839574337, + 0.0, + 0.70319052785635, + 0.33252765983343124, + 0.3284838870167732, + 0.6717866137623787, + 0.0, + 0.19466868788003922, + 0.0, + 0.0, + 0.03872132673859596, + 0.2883134074509144, + 0.034112561494112015, + 0.20918269082903862, + 0.2614618241786957, + 0.034241557121276855, + 0.26299185678362846, + 0.14566002041101456, + 0.059511929750442505, + 2.07609748467803, + 0.23266570642590523, + 0.19257380068302155, + 0.12006917968392372, + 0.0 + ], + "unique_experts": 47, + "load_cv": 1.2136288725838262, + "normalized_load_entropy": 0.8489463724772605, + "max_load_share": 0.09313725490196079 + }, + "full_input": { + "tokens": 59, + "top_k": 6, + "decisions": 354, + "ordered_route_sha256": "2c829db08da7c76d1d2c649cdd8a7724d399397b005d4866d768ce2b574460ca", + "route_weight_sha256": "465119c7fd00f42532128fa6fa94588bce702c9601bfe06d260fe1d7561e1b41", + "loads": [ + 2, + 7, + 0, + 0, + 4, + 2, + 2, + 4, + 1, + 1, + 12, + 3, + 8, + 5, + 19, + 13, + 8, + 7, + 9, + 3, + 2, + 3, + 0, + 0, + 1, + 14, + 1, + 5, + 0, + 3, + 4, + 4, + 1, + 12, + 6, + 6, + 2, + 1, + 10, + 7, + 15, + 7, + 15, + 6, + 7, + 9, + 0, + 7, + 0, + 3, + 8, + 6, + 2, + 14, + 8, + 12, + 5, + 4, + 1, + 20, + 3, + 5, + 3, + 2 + ], + "weighted_loads": [ + 0.21747895330190659, + 0.27638080436736345, + 0.0, + 0.0, + 0.1300069410353899, + 0.07008851319551468, + 0.07521848008036613, + 0.14001855696551502, + 0.0033411819022148848, + 0.03005269356071949, + 0.7140941768884659, + 0.0988873839378357, + 0.5086031667888165, + 0.2085758838802576, + 1.8692287802696228, + 2.215585311409086, + 0.6946431174874306, + 0.3363739475607872, + 0.7873620688915253, + 0.17966848704963923, + 0.038562413305044174, + 0.2077920250594616, + 0.0, + 0.0, + 0.10313598066568375, + 1.3235345371067524, + 0.056059084832668304, + 0.5218782424926758, + 0.0, + 0.09393571689724922, + 0.21941471844911575, + 0.15258654579520226, + 0.03619803488254547, + 1.0377568416297436, + 0.4483404643833637, + 0.4627635218203068, + 0.15385116264224052, + 0.02950509451329708, + 0.914290938526392, + 0.5766865536570549, + 1.0545377358794212, + 0.722077239304781, + 1.4577767476439476, + 0.36880967020988464, + 0.5056299641728401, + 0.6717866137623787, + 0.0, + 0.2430702382698655, + 0.0, + 0.1614543665200472, + 0.7276935167610645, + 0.2883134074509144, + 0.6990865357220173, + 0.8665044233202934, + 0.27642172831110656, + 0.8475529924035072, + 0.26299185678362846, + 0.14566002041101456, + 0.059511929750442505, + 2.12213072180748, + 0.23266570642590523, + 0.23269038274884224, + 0.12006917968392372, + 0.9360589496791363 + ], + "unique_experts": 57, + "load_cv": 0.8693775324225194, + "normalized_load_entropy": 0.9084074604035254, + "max_load_share": 0.05649717514124294 + } + }, + "s1_x": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "86ad46d6e4c6f40198fab8db6e96fa31770ce2225e139eed4f1163b27d7e022c", + "route_weight_sha256": "c27c451a7961597e0d85be192fe5c388a822084215ba09e463e03f9bdd98f87e", + "loads": [ + 2, + 5, + 0, + 0, + 3, + 0, + 0, + 3, + 0, + 2, + 0, + 2, + 4, + 5, + 19, + 0, + 5, + 1, + 0, + 2, + 1, + 3, + 0, + 0, + 1, + 5, + 2, + 5, + 0, + 2, + 4, + 5, + 0, + 11, + 6, + 1, + 2, + 1, + 0, + 0, + 9, + 0, + 6, + 5, + 5, + 11, + 0, + 5, + 0, + 1, + 1, + 5, + 3, + 4, + 6, + 0, + 6, + 4, + 1, + 19, + 3, + 4, + 2, + 2 + ], + "weighted_loads": [ + 0.21670763194561005, + 0.22509098425507545, + 0.0, + 0.0, + 0.0973624736070633, + 0.0, + 0.0, + 0.1379951760172844, + 0.0, + 0.055835578590631485, + 0.0, + 0.06524937972426414, + 0.2763565443456173, + 0.21377986297011375, + 1.8996873162686825, + 0.0, + 0.4859217181801796, + 0.03887465223670006, + 0.0, + 0.1671699956059456, + 0.027121616527438164, + 0.21762627363204956, + 0.0, + 0.0, + 0.10480089485645294, + 0.33083099126815796, + 0.07902836799621582, + 0.5009662583470345, + 0.0, + 0.07149345427751541, + 0.22453808039426804, + 0.1915472447872162, + 0.0, + 0.9886040911078453, + 0.43981187976896763, + 0.034624699503183365, + 0.15827219560742378, + 0.03153800219297409, + 0.0, + 0.0, + 0.7601428031921387, + 0.0, + 0.724421925842762, + 0.3413825109601021, + 0.328178234398365, + 0.7276795003563166, + 0.0, + 0.20753251761198044, + 0.0, + 0.036574918776750565, + 0.03515079244971275, + 0.2605169378221035, + 0.09826891124248505, + 0.212393369525671, + 0.2670707106590271, + 0.0, + 0.2924583740532398, + 0.14148666709661484, + 0.06001490354537964, + 2.110964085906744, + 0.2302039973437786, + 0.19252446666359901, + 0.08883746340870857, + 0.06050324812531471 + ], + "unique_experts": 46, + "load_cv": 1.2136288725838262, + "normalized_load_entropy": 0.8490251318266621, + "max_load_share": 0.09313725490196079 + }, + "full_input": { + "tokens": 75, + "top_k": 6, + "decisions": 450, + "ordered_route_sha256": "f05a1242367eff1e8dae39b7cfb2e1f18ad73f3a1e1b989de357ac8d9d8a2bfc", + "route_weight_sha256": "655df6d8d7270c98039561fc329997d017f4e86ca1346826d9dd839b094a0440", + "loads": [ + 3, + 7, + 0, + 6, + 3, + 3, + 9, + 5, + 1, + 2, + 15, + 5, + 9, + 5, + 20, + 15, + 10, + 12, + 13, + 12, + 2, + 3, + 1, + 0, + 2, + 14, + 2, + 7, + 0, + 4, + 4, + 5, + 1, + 13, + 7, + 7, + 3, + 4, + 11, + 11, + 12, + 11, + 18, + 9, + 7, + 11, + 0, + 8, + 0, + 14, + 9, + 6, + 4, + 16, + 9, + 11, + 6, + 4, + 2, + 20, + 4, + 5, + 2, + 6 + ], + "weighted_loads": [ + 0.2535772770643234, + 0.24920209706760943, + 0.0, + 0.4141514152288437, + 0.0973624736070633, + 0.10908589512109756, + 1.0190800353884697, + 0.19214373407885432, + 0.003352703060954809, + 0.055835578590631485, + 0.9207953307777643, + 0.43586571142077446, + 0.6970177739858627, + 0.21377986297011375, + 1.932721745222807, + 2.737961992621422, + 0.8598852045834064, + 0.7161796502768993, + 1.1271052099764347, + 1.019242157228291, + 0.03967145085334778, + 0.21762627363204956, + 0.037704676389694214, + 0.0, + 0.18067020177841187, + 1.1249322667717934, + 0.07902836799621582, + 0.675260454416275, + 0.0, + 0.1580316238105297, + 0.22453808039426804, + 0.1915472447872162, + 0.11911921948194504, + 1.0743240639567375, + 0.4741842281073332, + 0.6328418664634228, + 0.2036045901477337, + 0.1828775741159916, + 1.0320553593337536, + 1.017447266727686, + 0.9258141256868839, + 1.069337334483862, + 1.7368105836212635, + 0.5795186534523964, + 0.479874923825264, + 0.7276795003563166, + 0.0, + 0.2873127134516835, + 0.0, + 0.8429273944348097, + 1.072921920567751, + 0.30863839387893677, + 0.7632428854703903, + 1.1315314322710037, + 0.3197114188224077, + 0.7097402811050415, + 0.2924583740532398, + 0.14148666709661484, + 0.13052183389663696, + 2.158483523875475, + 0.2761953994631767, + 0.23183000832796097, + 0.08883746340870857, + 1.2374456524848938 + ], + "unique_experts": 59, + "load_cv": 0.729525467278153, + "normalized_load_entropy": 0.9307145246783549, + "max_load_share": 0.044444444444444446 + } + }, + "s0_period": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "8759d89327071319ff466a168b9f23eefe7aa0e2810a93849373036457aac607", + "route_weight_sha256": "be6f398ec716e286467db19b175309e08e261ed994a57da381560129899e9557", + "loads": [ + 2, + 7, + 0, + 0, + 4, + 0, + 0, + 3, + 0, + 1, + 1, + 3, + 5, + 4, + 19, + 0, + 5, + 1, + 0, + 2, + 1, + 3, + 0, + 0, + 1, + 5, + 1, + 5, + 0, + 2, + 4, + 4, + 1, + 13, + 6, + 1, + 2, + 1, + 0, + 0, + 9, + 0, + 6, + 5, + 5, + 9, + 0, + 5, + 0, + 0, + 1, + 5, + 1, + 4, + 6, + 2, + 5, + 4, + 1, + 19, + 3, + 4, + 3, + 0 + ], + "weighted_loads": [ + 0.22001168876886368, + 0.2985331192612648, + 0.0, + 0.0, + 0.1282885130494833, + 0.0, + 0.0, + 0.13754938915371895, + 0.0, + 0.030098622664809227, + 0.03274322301149368, + 0.097720205783844, + 0.32235780358314514, + 0.18110904470086098, + 1.8861787617206573, + 0.0, + 0.46990425139665604, + 0.0381837859749794, + 0.0, + 0.16686007753014565, + 0.025709498673677444, + 0.20915092155337334, + 0.0, + 0.0, + 0.10052308440208435, + 0.334226556122303, + 0.05352235585451126, + 0.5222854465246201, + 0.0, + 0.07097011059522629, + 0.2223663218319416, + 0.15611868724226952, + 0.03681858628988266, + 1.0578519087284803, + 0.44259659200906754, + 0.03499704971909523, + 0.15627694875001907, + 0.02983679249882698, + 0.0, + 0.0, + 0.7507126070559025, + 0.0, + 0.6997440606355667, + 0.3323327302932739, + 0.32862765714526176, + 0.6608770564198494, + 0.0, + 0.19708825275301933, + 0.0, + 0.0, + 0.038543347269296646, + 0.25240469351410866, + 0.03363513574004173, + 0.2061426341533661, + 0.25938498973846436, + 0.06247309595346451, + 0.25895899161696434, + 0.14453517273068428, + 0.06108791008591652, + 2.061271194368601, + 0.23392615839838982, + 0.18854227289557457, + 0.12180810794234276, + 0.0 + ], + "unique_experts": 47, + "load_cv": 1.223724217774896, + "normalized_load_entropy": 0.848159433530556, + "max_load_share": 0.09313725490196079 + }, + "full_input": { + "tokens": 59, + "top_k": 6, + "decisions": 354, + "ordered_route_sha256": "71cd313dda26a8f676043e33abd00c2aa4700fe0c5991d7edfb3b00407d2e24b", + "route_weight_sha256": "cb37532e0b56b07385020329824adb77c8433bf09537464c7e8f0702e2857d50", + "loads": [ + 2, + 8, + 0, + 0, + 4, + 2, + 2, + 4, + 1, + 1, + 12, + 3, + 8, + 4, + 19, + 13, + 9, + 8, + 9, + 3, + 2, + 3, + 0, + 0, + 1, + 13, + 1, + 5, + 0, + 2, + 4, + 4, + 1, + 13, + 6, + 7, + 2, + 1, + 10, + 7, + 14, + 7, + 15, + 6, + 8, + 9, + 0, + 7, + 0, + 3, + 8, + 5, + 2, + 12, + 8, + 13, + 5, + 4, + 1, + 20, + 3, + 5, + 3, + 2 + ], + "weighted_loads": [ + 0.22001168876886368, + 0.3020289922133088, + 0.0, + 0.0, + 0.1282885130494833, + 0.06827780976891518, + 0.07537525147199631, + 0.14059798861853778, + 0.0033411819022148848, + 0.030098622664809227, + 0.7134302854537964, + 0.097720205783844, + 0.5037202760577202, + 0.18110904470086098, + 1.8861787617206573, + 2.049717967864126, + 0.7488146461546421, + 0.3941783420741558, + 0.731894064694643, + 0.17994066420942545, + 0.03825933299958706, + 0.20915092155337334, + 0.0, + 0.0, + 0.10052308440208435, + 1.230221215635538, + 0.05352235585451126, + 0.5222854465246201, + 0.0, + 0.07097011059522629, + 0.2223663218319416, + 0.15611868724226952, + 0.03681858628988266, + 1.0578519087284803, + 0.44259659200906754, + 0.506700161844492, + 0.15627694875001907, + 0.02983679249882698, + 0.8801044933497906, + 0.5684789270162582, + 0.983234353363514, + 0.7555282860994339, + 1.457187969237566, + 0.36743978783488274, + 0.5660126619040966, + 0.6608770564198494, + 0.0, + 0.24572463054209948, + 0.0, + 0.1577697042375803, + 0.7328610420227051, + 0.25240469351410866, + 0.698609109967947, + 0.7497750483453274, + 0.27434489387087524, + 1.0068318247795105, + 0.25895899161696434, + 0.14453517273068428, + 0.06108791008591652, + 2.1073044314980507, + 0.23392615839838982, + 0.2281695231795311, + 0.12180810794234276, + 0.9360589496791363 + ], + "unique_experts": 57, + "load_cv": 0.8670245800774191, + "normalized_load_entropy": 0.9080104784123428, + "max_load_share": 0.05649717514124294 + } + }, + "s1_period": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "b254bd4a2d444c29e288439395a350408ef279a23fde23c34ad7c6fe7396774c", + "route_weight_sha256": "529d1402857aa23e208deb7763261b189119ec374a1dd76ca322f8d93b4fc26f", + "loads": [ + 2, + 5, + 0, + 0, + 3, + 0, + 0, + 3, + 0, + 2, + 0, + 2, + 5, + 6, + 19, + 0, + 5, + 1, + 0, + 2, + 1, + 3, + 0, + 0, + 1, + 5, + 1, + 5, + 0, + 2, + 4, + 5, + 2, + 14, + 5, + 1, + 2, + 1, + 0, + 0, + 7, + 0, + 6, + 5, + 5, + 10, + 0, + 5, + 0, + 1, + 1, + 5, + 2, + 4, + 6, + 0, + 5, + 4, + 1, + 19, + 3, + 4, + 2, + 2 + ], + "weighted_loads": [ + 0.2170492336153984, + 0.2199299857020378, + 0.0, + 0.0, + 0.0969660859555006, + 0.0, + 0.0, + 0.13984405994415283, + 0.0, + 0.0562568511813879, + 0.0, + 0.0649043396115303, + 0.3199051544070244, + 0.2502507343888283, + 1.9171766638755798, + 0.0, + 0.49231360107660294, + 0.03975822404026985, + 0.0, + 0.16433118656277657, + 0.026931382715702057, + 0.21700957417488098, + 0.0, + 0.0, + 0.09972277283668518, + 0.3248821869492531, + 0.0542336031794548, + 0.5053916200995445, + 0.0, + 0.07055174931883812, + 0.22954414784908295, + 0.19878971949219704, + 0.06462986394762993, + 1.0890921000391245, + 0.40647245943546295, + 0.0342509001493454, + 0.1597716324031353, + 0.03179369866847992, + 0.0, + 0.0, + 0.6716289110481739, + 0.0, + 0.7256236895918846, + 0.34309257566928864, + 0.32958341389894485, + 0.7011148519814014, + 0.0, + 0.2146172933280468, + 0.0, + 0.036528896540403366, + 0.03551796078681946, + 0.2605370320379734, + 0.06270697712898254, + 0.21100395172834396, + 0.26733340695500374, + 0.0, + 0.2456977814435959, + 0.14067630842328072, + 0.0609174519777298, + 2.0917072892189026, + 0.2348172590136528, + 0.19314201176166534, + 0.09028090164065361, + 0.06064462848007679 + ], + "unique_experts": 47, + "load_cv": 1.223724217774896, + "normalized_load_entropy": 0.8502575402159879, + "max_load_share": 0.09313725490196079 + }, + "full_input": { + "tokens": 75, + "top_k": 6, + "decisions": 450, + "ordered_route_sha256": "8826e2d3628539d59b75e5859b1f20926e079e510b497e1e9af1a3638dbed73a", + "route_weight_sha256": "4412b9ccf7494f9e9e8c4944b6fe930815d66332d93c80f121ffb271acda7267", + "loads": [ + 3, + 7, + 0, + 6, + 3, + 3, + 9, + 5, + 1, + 2, + 15, + 5, + 10, + 6, + 20, + 16, + 10, + 13, + 13, + 12, + 2, + 3, + 1, + 0, + 2, + 13, + 1, + 7, + 0, + 4, + 4, + 5, + 3, + 15, + 6, + 7, + 3, + 4, + 11, + 11, + 10, + 12, + 18, + 9, + 8, + 10, + 0, + 8, + 0, + 14, + 9, + 6, + 3, + 14, + 9, + 11, + 5, + 4, + 2, + 20, + 4, + 5, + 2, + 6 + ], + "weighted_loads": [ + 0.2539188787341118, + 0.24404109851457179, + 0.0, + 0.4141514152288437, + 0.0969660859555006, + 0.10850872099399567, + 1.0168652385473251, + 0.19399261800572276, + 0.003352703060954809, + 0.0562568511813879, + 0.9316731560975313, + 0.4355206713080406, + 0.7422783598303795, + 0.2502507343888283, + 1.9502110928297043, + 2.6024628058075905, + 0.8947286158800125, + 0.758938554674387, + 1.0929484143853188, + 1.016403348185122, + 0.03948121704161167, + 0.21700957417488098, + 0.037704676389694214, + 0.0, + 0.1755920797586441, + 1.040780894458294, + 0.0542336031794548, + 0.6796858161687851, + 0.0, + 0.15708991885185242, + 0.22954414784908295, + 0.19878971949219704, + 0.18374908342957497, + 1.1317076031118631, + 0.4408448077738285, + 0.6534516662359238, + 0.2051040269434452, + 0.18313327059149742, + 0.9908030554652214, + 1.0126036815345287, + 0.8147388100624084, + 1.183283243328333, + 1.7521999776363373, + 0.5808327458798885, + 0.5310010574758053, + 0.7011148519814014, + 0.0, + 0.29563792888075113, + 0.0, + 0.8413815405219793, + 1.0575175285339355, + 0.30865848809480667, + 0.7276809513568878, + 1.0172352381050587, + 0.31997411511838436, + 0.7952370345592499, + 0.2456977814435959, + 0.14067630842328072, + 0.13142438232898712, + 2.1392267271876335, + 0.2808086611330509, + 0.2334754429757595, + 0.09028090164065361, + 1.2375870328396559 + ], + "unique_experts": 59, + "load_cv": 0.7299585646958596, + "normalized_load_entropy": 0.930779795178115, + "max_load_share": 0.044444444444444446 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 34, + "ordered_topk_exact_tokens": 27, + "set_exact_tokens": 31, + "mean_set_jaccard": 0.9747899159663866, + "mean_token_weighted_tv": 0.007506734883303151, + "aggregate_load_tv": 0.014705882352941176 + }, + "system_bos": { + "tokens": 34, + "ordered_topk_exact_tokens": 21, + "set_exact_tokens": 25, + "mean_set_jaccard": 0.9243697478991596, + "mean_token_weighted_tv": 0.014775981907458866, + "aggregate_load_tv": 0.04411764705882353 + }, + "system_x": { + "tokens": 34, + "ordered_topk_exact_tokens": 18, + "set_exact_tokens": 22, + "mean_set_jaccard": 0.8991596638655464, + "mean_token_weighted_tv": 0.02085741121760186, + "aggregate_load_tv": 0.05392156862745098 + }, + "system_period": { + "tokens": 34, + "ordered_topk_exact_tokens": 18, + "set_exact_tokens": 22, + "mean_set_jaccard": 0.8991596638655461, + "mean_token_weighted_tv": 0.02086356295930112, + "aggregate_load_tv": 0.05392156862745098 + }, + "bos_at_s0": { + "tokens": 34, + "ordered_topk_exact_tokens": 16, + "set_exact_tokens": 22, + "mean_set_jaccard": 0.8991596638655464, + "mean_token_weighted_tv": 0.023516123977434987, + "aggregate_load_tv": 0.0392156862745098 + }, + "bos_at_s1": { + "tokens": 34, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 20, + "mean_set_jaccard": 0.8823529411764706, + "mean_token_weighted_tv": 0.02476514026741771, + "aggregate_load_tv": 0.04411764705882353 + }, + "x_at_s0": { + "tokens": 34, + "ordered_topk_exact_tokens": 16, + "set_exact_tokens": 25, + "mean_set_jaccard": 0.9180672268907564, + "mean_token_weighted_tv": 0.021199894904652062, + "aggregate_load_tv": 0.03431372549019608 + }, + "x_at_s1": { + "tokens": 34, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.8613445378151261, + "mean_token_weighted_tv": 0.029657441766603905, + "aggregate_load_tv": 0.06372549019607843 + }, + "period_at_s0": { + "tokens": 34, + "ordered_topk_exact_tokens": 16, + "set_exact_tokens": 24, + "mean_set_jaccard": 0.9096638655462186, + "mean_token_weighted_tv": 0.02191713550949798, + "aggregate_load_tv": 0.0392156862745098 + }, + "period_at_s1": { + "tokens": 34, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.8676470588235294, + "mean_token_weighted_tv": 0.028437683194437447, + "aggregate_load_tv": 0.06372549019607844 + } + } + }, + "layer_06": { + "layer": 6, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "2aed613feb9cb63628ca93ea249851047ca8b07f0a0da7ac81f0383c09d9bf0a", + "route_weight_sha256": "09269577b0cd88fb36f6e32aa7f8d17b56fe88d8e2656dc8ad13935dacac0dd2", + "loads": [ + 4, + 2, + 0, + 4, + 0, + 2, + 8, + 5, + 14, + 1, + 0, + 7, + 5, + 5, + 1, + 0, + 4, + 1, + 6, + 2, + 6, + 7, + 2, + 3, + 0, + 7, + 4, + 6, + 14, + 4, + 1, + 2, + 0, + 1, + 3, + 0, + 3, + 0, + 4, + 0, + 3, + 5, + 0, + 1, + 0, + 3, + 0, + 0, + 2, + 2, + 2, + 12, + 7, + 0, + 8, + 1, + 0, + 0, + 5, + 7, + 2, + 4, + 1, + 1 + ], + "weighted_loads": [ + 0.19540821947157383, + 0.06905779987573624, + 0.0, + 0.15920984372496605, + 0.0, + 0.14458734169602394, + 0.593738779425621, + 0.3060087114572525, + 1.1879016421735287, + 0.03498009964823723, + 0.0, + 0.3807026818394661, + 0.6180305257439613, + 0.40901651233434677, + 0.03974920138716698, + 0.0, + 0.24580027535557747, + 0.031184811145067215, + 0.48133448511362076, + 0.12820330262184143, + 0.33107298612594604, + 0.7358172163367271, + 0.08390751853585243, + 0.11386535689234734, + 0.0, + 0.5741711221635342, + 0.13548735715448856, + 0.3947916850447655, + 0.93358264118433, + 0.19269179552793503, + 0.024993151426315308, + 0.09478254243731499, + 0.0, + 0.029890401288866997, + 0.30610326677560806, + 0.0, + 0.14368275925517082, + 0.0, + 0.35932618007063866, + 0.0, + 0.17863846570253372, + 0.4844915196299553, + 0.0, + 0.055089257657527924, + 0.0, + 0.09882444888353348, + 0.0, + 0.0, + 0.0807824358344078, + 0.27774354815483093, + 0.08366570994257927, + 0.8726958148181438, + 0.342415165156126, + 0.0, + 0.5640568435192108, + 0.05376255884766579, + 0.0, + 0.0, + 0.18730923905968666, + 0.3814152739942074, + 0.10762326791882515, + 0.1650271750986576, + 0.034197140485048294, + 0.0330454483628273 + ], + "unique_experts": 48, + "load_cv": 1.032907230671837, + "normalized_load_entropy": 0.8716829205620262, + "max_load_share": 0.06862745098039216 + }, + "full_input": { + "tokens": 59, + "top_k": 6, + "decisions": 354, + "ordered_route_sha256": "282c87f9fabcb60634305d0f62ce890cbc9fb68c4aad19984cc3b1c90c874aaf", + "route_weight_sha256": "dfb41aecb23f607b7c077cad30a163a4f076bb75eaaaebdc24d1689c835023b4", + "loads": [ + 4, + 5, + 0, + 4, + 1, + 2, + 15, + 5, + 14, + 1, + 0, + 13, + 5, + 8, + 3, + 0, + 9, + 2, + 6, + 10, + 7, + 11, + 5, + 4, + 0, + 8, + 4, + 7, + 14, + 7, + 1, + 2, + 3, + 1, + 4, + 5, + 3, + 7, + 4, + 10, + 3, + 11, + 2, + 1, + 0, + 8, + 11, + 2, + 7, + 2, + 9, + 19, + 7, + 1, + 8, + 11, + 9, + 0, + 5, + 16, + 2, + 4, + 1, + 1 + ], + "weighted_loads": [ + 0.19540821947157383, + 0.13849314721301198, + 0.0, + 0.15920984372496605, + 0.028760550543665886, + 0.14458734169602394, + 1.4003128930926323, + 0.3060087114572525, + 1.1879016421735287, + 0.03498009964823723, + 0.0, + 0.818015493452549, + 0.6180305257439613, + 0.5285388194024563, + 0.1793873906135559, + 0.0, + 0.5954733826220036, + 0.035218299366533756, + 0.48133448511362076, + 0.6121913604438305, + 0.3749897629022598, + 1.0203545168042183, + 1.6061205212026834, + 0.1495746150612831, + 0.0, + 0.6020179763436317, + 0.13548735715448856, + 0.500441700220108, + 0.93358264118433, + 0.3607317619025707, + 0.024993151426315308, + 0.09478254243731499, + 0.09948251023888588, + 0.029890401288866997, + 0.3409934714436531, + 0.4606996029615402, + 0.14368275925517082, + 0.6147144921123981, + 0.35932618007063866, + 0.4024564865976572, + 0.17863846570253372, + 1.0088064149022102, + 0.05798942968249321, + 0.055089257657527924, + 0.0, + 0.23355492390692234, + 1.2148140221834183, + 0.022327867103740573, + 0.33303834311664104, + 0.27774354815483093, + 0.6323555149137974, + 1.1770406179130077, + 0.342415165156126, + 0.041719745844602585, + 0.5640568435192108, + 0.8189204148948193, + 1.099829126149416, + 0.0, + 0.18730923905968666, + 1.3495638705790043, + 0.10762326791882515, + 0.1650271750986576, + 0.034197140485048294, + 0.0330454483628273 + ], + "unique_experts": 58, + "load_cv": 0.8122832113548482, + "normalized_load_entropy": 0.9167462929113119, + "max_load_share": 0.05367231638418079 + } + }, + "s1_eos": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "39ebe6f475e1bf357dc019629e40c186c4e650804a8a524ba6451a0df27e9c0b", + "route_weight_sha256": "2d52bb3ace26365e760ae4fbd6027be898cff7807db61e42626919864781dbc6", + "loads": [ + 4, + 2, + 0, + 4, + 0, + 2, + 8, + 6, + 14, + 1, + 0, + 7, + 5, + 5, + 1, + 0, + 4, + 0, + 6, + 2, + 6, + 6, + 2, + 3, + 0, + 7, + 4, + 6, + 13, + 4, + 1, + 2, + 0, + 1, + 3, + 0, + 3, + 0, + 4, + 0, + 2, + 5, + 0, + 1, + 0, + 3, + 0, + 0, + 2, + 2, + 2, + 12, + 7, + 0, + 8, + 1, + 2, + 0, + 6, + 7, + 2, + 4, + 1, + 1 + ], + "weighted_loads": [ + 0.1935227233916521, + 0.07018904387950897, + 0.0, + 0.16347168013453484, + 0.0, + 0.14579974859952927, + 0.6079623848199844, + 0.32431837916374207, + 1.2088401429355145, + 0.033248718827962875, + 0.0, + 0.3868848569691181, + 0.6166431978344917, + 0.4050970785319805, + 0.04060957208275795, + 0.0, + 0.24863532185554504, + 0.0, + 0.4773080237209797, + 0.1306929737329483, + 0.33287497237324715, + 0.6933129355311394, + 0.08466661348938942, + 0.11153355613350868, + 0.0, + 0.5614227317273617, + 0.1388978287577629, + 0.3933500200510025, + 0.9040432907640934, + 0.19617077335715294, + 0.02532709762454033, + 0.09453407302498817, + 0.0, + 0.029458915814757347, + 0.3101979047060013, + 0.0, + 0.1444620117545128, + 0.0, + 0.35829392448067665, + 0.0, + 0.13983729109168053, + 0.48737938702106476, + 0.0, + 0.05475519597530365, + 0.0, + 0.10066460631787777, + 0.0, + 0.0, + 0.08055160939693451, + 0.27995361387729645, + 0.08317561820149422, + 0.8719693087041378, + 0.3457852639257908, + 0.0, + 0.5636138394474983, + 0.056489214301109314, + 0.07264256477355957, + 0.0, + 0.2219177782535553, + 0.38670872524380684, + 0.10663100704550743, + 0.16660409048199654, + 0.03851880505681038, + 0.03294099494814873 + ], + "unique_experts": 48, + "load_cv": 1.0179095962680322, + "normalized_load_entropy": 0.8735567608115619, + "max_load_share": 0.06862745098039216 + }, + "full_input": { + "tokens": 75, + "top_k": 6, + "decisions": 450, + "ordered_route_sha256": "552da36101f95f208edd01ce85041f13c32fe786177341140208c978fd59120b", + "route_weight_sha256": "5dd89a6053ef516db88c56e2ac016bd46b92453c7ab37ac7c976e6fcdb58bda7", + "loads": [ + 4, + 4, + 3, + 5, + 2, + 2, + 21, + 7, + 19, + 7, + 0, + 17, + 9, + 8, + 10, + 1, + 14, + 1, + 8, + 12, + 8, + 11, + 4, + 4, + 1, + 9, + 4, + 8, + 14, + 7, + 1, + 5, + 7, + 2, + 7, + 7, + 4, + 15, + 4, + 10, + 2, + 12, + 2, + 1, + 1, + 7, + 14, + 2, + 6, + 2, + 10, + 18, + 8, + 4, + 8, + 12, + 18, + 0, + 6, + 18, + 7, + 4, + 1, + 1 + ], + "weighted_loads": [ + 0.1935227233916521, + 0.10974052175879478, + 0.14067289233207703, + 0.200913455337286, + 0.1503196395933628, + 0.14579974859952927, + 1.7866933941841125, + 0.38578009605407715, + 1.5483881533145905, + 0.7390867285430431, + 0.0, + 1.091741781681776, + 0.9460804164409637, + 0.527687719091773, + 0.7145668379962444, + 0.11124693602323532, + 1.021362692117691, + 0.004056115634739399, + 0.6241605393588543, + 0.8176502622663975, + 0.4246683157980442, + 1.0556748993694782, + 1.5770773328840733, + 0.14686234667897224, + 0.03250625357031822, + 0.639941893517971, + 0.1388978287577629, + 0.5279211010783911, + 0.9400649070739746, + 0.38980837911367416, + 0.02532709762454033, + 0.2920594774186611, + 0.22696568816900253, + 0.0635362584143877, + 0.5691329725086689, + 0.6744679510593414, + 0.17913920059800148, + 1.188633494079113, + 0.35829392448067665, + 0.5095844678580761, + 0.13983729109168053, + 1.0502942502498627, + 0.057936109602451324, + 0.05475519597530365, + 0.08418368548154831, + 0.19997082627378404, + 1.5253989398479462, + 0.02235178928822279, + 0.2930394448339939, + 0.27995361387729645, + 0.7254376448690891, + 1.112598355859518, + 0.38331176713109016, + 0.20832139253616333, + 0.5636138394474983, + 1.068198960274458, + 1.786502692848444, + 0.0, + 0.2219177782535553, + 1.440501419827342, + 0.3698793388903141, + 0.16660409048199654, + 0.03851880505681038, + 0.03294099494814873 + ], + "unique_experts": 62, + "load_cv": 0.7571616915563636, + "normalized_load_entropy": 0.9296454365095282, + "max_load_share": 0.04666666666666667 + } + }, + "s0_bos": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "be699d281d8e4b7c02b1a637a2b1a23bc87784bb5b9d9d6f87d7f8ace4b7a5cb", + "route_weight_sha256": "649245957ab333d41b06477731af9ecd68e0bdf46122a59607e135ec0ba7cdd1", + "loads": [ + 4, + 2, + 0, + 3, + 0, + 2, + 9, + 5, + 14, + 1, + 0, + 7, + 5, + 5, + 1, + 0, + 4, + 0, + 6, + 2, + 6, + 7, + 3, + 3, + 0, + 7, + 3, + 6, + 14, + 4, + 0, + 3, + 0, + 0, + 3, + 0, + 3, + 1, + 4, + 0, + 3, + 5, + 0, + 1, + 0, + 3, + 0, + 0, + 3, + 2, + 2, + 13, + 6, + 0, + 8, + 1, + 0, + 0, + 6, + 7, + 2, + 4, + 0, + 1 + ], + "weighted_loads": [ + 0.19311620853841305, + 0.06772973947227001, + 0.0, + 0.13080963119864464, + 0.0, + 0.14887375384569168, + 0.6028863973915577, + 0.2825807258486748, + 1.2329699881374836, + 0.03705325350165367, + 0.0, + 0.3845965899527073, + 0.6051960289478302, + 0.41937125846743584, + 0.04290155693888664, + 0.0, + 0.23683472350239754, + 0.0, + 0.47906822711229324, + 0.13441140949726105, + 0.3483968414366245, + 0.7376255057752132, + 0.10628983192145824, + 0.10224821791052818, + 0.0, + 0.5435489788651466, + 0.10614699311554432, + 0.4017783459275961, + 0.9630321860313416, + 0.18927177414298058, + 0.0, + 0.1232844740152359, + 0.0, + 0.0, + 0.31617385149002075, + 0.0, + 0.14799490571022034, + 0.030498040840029716, + 0.36121752485632896, + 0.0, + 0.18130096420645714, + 0.4599758982658386, + 0.0, + 0.04938821867108345, + 0.0, + 0.0942501425743103, + 0.0, + 0.0, + 0.1120324544608593, + 0.2697499245405197, + 0.08201158419251442, + 0.8959972746670246, + 0.3082335125654936, + 0.0, + 0.5666772276163101, + 0.05301600322127342, + 0.0, + 0.0, + 0.217306986451149, + 0.36391565203666687, + 0.10779286175966263, + 0.16581086069345474, + 0.0, + 0.036680158227682114 + ], + "unique_experts": 45, + "load_cv": 1.0608187446842336, + "normalized_load_entropy": 0.8625747882656273, + "max_load_share": 0.06862745098039216 + }, + "full_input": { + "tokens": 59, + "top_k": 6, + "decisions": 354, + "ordered_route_sha256": "3423f51d644cc917123ded6334b45243f8a1ea7b7b5681814e47f1d99537a7bf", + "route_weight_sha256": "47bf49efdb29382c30a88d25a815c4c569a34a9016579ed99c99e2b2e03898b2", + "loads": [ + 4, + 5, + 0, + 3, + 1, + 2, + 16, + 5, + 14, + 1, + 0, + 13, + 5, + 7, + 4, + 1, + 10, + 0, + 6, + 10, + 7, + 11, + 5, + 4, + 0, + 8, + 3, + 7, + 14, + 8, + 0, + 3, + 2, + 0, + 4, + 5, + 3, + 9, + 4, + 10, + 3, + 11, + 2, + 1, + 0, + 7, + 12, + 1, + 8, + 2, + 9, + 20, + 6, + 1, + 8, + 11, + 9, + 0, + 6, + 16, + 2, + 4, + 0, + 1 + ], + "weighted_loads": [ + 0.19311620853841305, + 0.16912494599819183, + 0.0, + 0.13080963119864464, + 0.028760550543665886, + 0.14887375384569168, + 1.409460511058569, + 0.2825807258486748, + 1.2329699881374836, + 0.03705325350165367, + 0.0, + 0.8281644321978092, + 0.6051960289478302, + 0.5431021824479103, + 0.2326812669634819, + 0.04739544540643692, + 0.6105925254523754, + 0.0, + 0.47906822711229324, + 0.6141796931624413, + 0.3923136182129383, + 1.0306298546493053, + 0.6805394180119038, + 0.13795747607946396, + 0.0, + 0.5713958330452442, + 0.10614699311554432, + 0.5150848310440779, + 0.9630321860313416, + 0.40492601320147514, + 0.0, + 0.1232844740152359, + 0.06019560992717743, + 0.0, + 0.3510640561580658, + 0.4713081046938896, + 0.14799490571022034, + 0.7092252764850855, + 0.36121752485632896, + 0.3949143122881651, + 0.18130096420645714, + 0.9778323099017143, + 0.05798942968249321, + 0.04938821867108345, + 0.0, + 0.22496307082474232, + 1.4715265557169914, + 0.01908714324235916, + 0.36524990387260914, + 0.2697499245405197, + 0.6626976393163204, + 1.2003420777618885, + 0.3082335125654936, + 0.03659724071621895, + 0.5666772276163101, + 0.8181738592684269, + 1.1529079675674438, + 0.0, + 0.217306986451149, + 1.3320642486214638, + 0.10779286175966263, + 0.16581086069345474, + 0.0, + 0.036680158227682114 + ], + "unique_experts": 55, + "load_cv": 0.8509719973980231, + "normalized_load_entropy": 0.9063077375966778, + "max_load_share": 0.05649717514124294 + } + }, + "s1_bos": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "40801d820b6231eb3890c099d66e83c5238328df4d90dddd819276335958ada5", + "route_weight_sha256": "6cd603c7ab658499f79ea1452d42547f37afe4460e3385d1522b61d8f921764d", + "loads": [ + 4, + 2, + 0, + 4, + 0, + 3, + 9, + 5, + 14, + 0, + 0, + 7, + 5, + 5, + 1, + 0, + 4, + 0, + 6, + 2, + 6, + 7, + 2, + 2, + 0, + 7, + 4, + 6, + 13, + 4, + 0, + 2, + 0, + 0, + 3, + 0, + 3, + 1, + 4, + 0, + 2, + 5, + 0, + 1, + 0, + 2, + 0, + 0, + 3, + 3, + 2, + 13, + 6, + 0, + 8, + 1, + 1, + 0, + 5, + 7, + 2, + 5, + 2, + 1 + ], + "weighted_loads": [ + 0.18549791537225246, + 0.06826886348426342, + 0.0, + 0.16779553145170212, + 0.0, + 0.1830852683633566, + 0.6100159622728825, + 0.28080201148986816, + 1.2493079118430614, + 0.0, + 0.0, + 0.3852594718337059, + 0.6130527034401894, + 0.4256252832710743, + 0.045472122728824615, + 0.0, + 0.2452319711446762, + 0.0, + 0.48021119832992554, + 0.1378193125128746, + 0.3535918891429901, + 0.7378817498683929, + 0.07752741128206253, + 0.06992531567811966, + 0.0, + 0.5305349752306938, + 0.14338204450905323, + 0.39369600266218185, + 0.9083763547241688, + 0.19979480281472206, + 0.0, + 0.08966448530554771, + 0.0, + 0.0, + 0.32993020862340927, + 0.0, + 0.14526734873652458, + 0.02949223667383194, + 0.36024394631385803, + 0.0, + 0.14464613422751427, + 0.46830935031175613, + 0.0, + 0.05025753006339073, + 0.0, + 0.06724605709314346, + 0.0, + 0.0, + 0.11102227494120598, + 0.3006663639098406, + 0.08337114006280899, + 0.8976822383701801, + 0.31106626987457275, + 0.0, + 0.581319659948349, + 0.05370340123772621, + 0.04340115189552307, + 0.0, + 0.18572408705949783, + 0.3666718937456608, + 0.10306563228368759, + 0.2067042551934719, + 0.07131152972579002, + 0.03574789687991142 + ], + "unique_experts": 46, + "load_cv": 1.041802182649822, + "normalized_load_entropy": 0.8668739583140284, + "max_load_share": 0.06862745098039216 + }, + "full_input": { + "tokens": 75, + "top_k": 6, + "decisions": 450, + "ordered_route_sha256": "4ae219cea1a2482eb64c2c9a8760621cdebdb4e1cf3c6f563b17cf24d3027236", + "route_weight_sha256": "f7c331e1295e296d26945ff750242dc4af04221fd22b2786ad91da79cdabf953", + "loads": [ + 4, + 3, + 3, + 5, + 2, + 3, + 23, + 6, + 19, + 6, + 0, + 17, + 9, + 7, + 10, + 2, + 15, + 0, + 8, + 12, + 8, + 12, + 3, + 3, + 1, + 9, + 4, + 8, + 14, + 7, + 0, + 5, + 7, + 1, + 7, + 7, + 4, + 16, + 4, + 10, + 2, + 12, + 2, + 1, + 1, + 5, + 15, + 2, + 7, + 3, + 11, + 19, + 7, + 4, + 8, + 12, + 17, + 0, + 5, + 18, + 7, + 5, + 2, + 1 + ], + "weighted_loads": [ + 0.18549791537225246, + 0.10306097008287907, + 0.14067289233207703, + 0.20523730665445328, + 0.1503196395933628, + 0.1830852683633566, + 1.8332216814160347, + 0.34226372838020325, + 1.5888559222221375, + 0.7058380097150803, + 0.0, + 1.101895835250616, + 0.9424899220466614, + 0.5495308414101601, + 0.7324928008019924, + 0.16450830176472664, + 1.0421925522387028, + 0.0, + 0.6270637139678001, + 0.8234623968601227, + 0.44538523256778717, + 1.1078508831560612, + 0.6238514855504036, + 0.10525410622358322, + 0.03250625357031822, + 0.6090541370213032, + 0.14338204450905323, + 0.526790639385581, + 0.94439797103405, + 0.3933124393224716, + 0.0, + 0.28718988969922066, + 0.22483397275209427, + 0.034077342599630356, + 0.5888652764260769, + 0.6848966404795647, + 0.17994453758001328, + 1.2719467282295227, + 0.36024394631385803, + 0.5065362192690372, + 0.14464613422751427, + 1.0277458876371384, + 0.057936109602451324, + 0.05025753006339073, + 0.08418368548154831, + 0.1627824380993843, + 1.7353710234165192, + 0.0757661685347557, + 0.33431245386600494, + 0.3006663639098406, + 0.8028734065592289, + 1.1383112855255604, + 0.34859277307987213, + 0.20557643100619316, + 0.581319659948349, + 1.0654131472110748, + 1.8344249986112118, + 0.0, + 0.18572408705949783, + 1.420464588329196, + 0.36631396412849426, + 0.2067042551934719, + 0.07131152972579002, + 0.03574789687991142 + ], + "unique_experts": 60, + "load_cv": 0.786641556410291, + "normalized_load_entropy": 0.9243548812405871, + "max_load_share": 0.051111111111111114 + } + }, + "s0_x": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "d63bfab24d3edd439a06c21f236ef465e8493b4d626e97d588bd1ab8e6a37e86", + "route_weight_sha256": "5a3090b73e6ce090d8f5da079873ad22ffbe57e56b5a857d1e9269e9c6bb1aaa", + "loads": [ + 4, + 2, + 0, + 3, + 0, + 2, + 9, + 5, + 14, + 1, + 0, + 6, + 5, + 5, + 1, + 1, + 4, + 0, + 6, + 2, + 6, + 8, + 2, + 3, + 0, + 7, + 5, + 5, + 13, + 4, + 0, + 3, + 0, + 0, + 3, + 0, + 3, + 1, + 4, + 0, + 2, + 5, + 0, + 1, + 0, + 2, + 0, + 0, + 1, + 3, + 2, + 12, + 7, + 0, + 8, + 1, + 1, + 0, + 6, + 7, + 3, + 4, + 1, + 1 + ], + "weighted_loads": [ + 0.19278507493436337, + 0.07427042350172997, + 0.0, + 0.125846978276968, + 0.0, + 0.14522847533226013, + 0.6230163928121328, + 0.2748911641538143, + 1.2146131843328476, + 0.03419043496251106, + 0.0, + 0.33802828192710876, + 0.6002948433160782, + 0.4152531288564205, + 0.042244359850883484, + 0.03415011242032051, + 0.24952427670359612, + 0.0, + 0.48109448701143265, + 0.13244066014885902, + 0.3436771407723427, + 0.7755967825651169, + 0.08582989126443863, + 0.10123851522803307, + 0.0, + 0.5427205264568329, + 0.17187260650098324, + 0.37975406646728516, + 0.9095428436994553, + 0.18490538373589516, + 0.0, + 0.1275610774755478, + 0.0, + 0.0, + 0.3168199807405472, + 0.0, + 0.15322960540652275, + 0.030236011371016502, + 0.35835205391049385, + 0.0, + 0.14236433804035187, + 0.4704332947731018, + 0.0, + 0.05193591117858887, + 0.0, + 0.06378477811813354, + 0.0, + 0.0, + 0.0445285402238369, + 0.2880496419966221, + 0.08448512479662895, + 0.8414540737867355, + 0.33945230953395367, + 0.0, + 0.5495079718530178, + 0.05257604271173477, + 0.04083513841032982, + 0.0, + 0.22564972192049026, + 0.3628542982041836, + 0.13465560786426067, + 0.16368009522557259, + 0.038670651614665985, + 0.035807300359010696 + ], + "unique_experts": 48, + "load_cv": 1.0299251754250116, + "normalized_load_entropy": 0.8711450986549243, + "max_load_share": 0.06862745098039216 + }, + "full_input": { + "tokens": 59, + "top_k": 6, + "decisions": 354, + "ordered_route_sha256": "dc6f28fe8f4576a293cc31c8bd448f696453a62a4424cd1be2b6f3d6abc86b58", + "route_weight_sha256": "7bf8b4e4fe814ab567854e5fb35263e50c36d9c83f01ebf4dec2c11a590f8059", + "loads": [ + 4, + 4, + 0, + 3, + 1, + 2, + 19, + 5, + 14, + 1, + 0, + 11, + 5, + 7, + 4, + 2, + 9, + 0, + 6, + 11, + 7, + 12, + 4, + 4, + 0, + 8, + 5, + 6, + 13, + 7, + 0, + 3, + 2, + 0, + 4, + 5, + 3, + 10, + 4, + 8, + 2, + 13, + 2, + 1, + 0, + 6, + 12, + 1, + 5, + 3, + 7, + 20, + 7, + 1, + 8, + 12, + 9, + 0, + 6, + 17, + 3, + 4, + 1, + 1 + ], + "weighted_loads": [ + 0.19278507493436337, + 0.13897360675036907, + 0.0, + 0.125846978276968, + 0.028760550543665886, + 0.14522847533226013, + 1.7728248853236437, + 0.2748911641538143, + 1.2146131843328476, + 0.03419043496251106, + 0.0, + 0.7002528235316277, + 0.6002948433160782, + 0.526049479842186, + 0.22668392211198807, + 0.07747668772935867, + 0.5709128901362419, + 0.0, + 0.48109448701143265, + 0.6812824793159962, + 0.38759391754865646, + 1.056709922850132, + 0.6600794773548841, + 0.13694777339696884, + 0.0, + 0.5705673806369305, + 0.17187260650098324, + 0.48076827079057693, + 0.9095428436994553, + 0.3557095639407635, + 0.0, + 0.1275610774755478, + 0.06019560992717743, + 0.0, + 0.3517101854085922, + 0.49341030418872833, + 0.15322960540652275, + 0.6951235216110945, + 0.35835205391049385, + 0.31580118276178837, + 0.14236433804035187, + 1.1272546462714672, + 0.05798942968249321, + 0.05193591117858887, + 0.0, + 0.19449770636856556, + 1.2640185207128525, + 0.01908714324235916, + 0.254349110648036, + 0.2880496419966221, + 0.5505714565515518, + 1.1807235516607761, + 0.33945230953395367, + 0.03709789738059044, + 0.5495079718530178, + 0.8731325082480907, + 1.0628941059112549, + 0.0, + 0.22564972192049026, + 1.4040957801043987, + 0.13465560786426067, + 0.16368009522557259, + 0.038670651614665985, + 0.035807300359010696 + ], + "unique_experts": 56, + "load_cv": 0.8658457060857341, + "normalized_load_entropy": 0.9076359093273695, + "max_load_share": 0.05649717514124294 + } + }, + "s1_x": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "76e43c033236d5611cd007ec4f075b37933ab13684c97228a3cebe7958fa98f8", + "route_weight_sha256": "1b988403f3657e568ad12dc72f257a6c58306347312588b38e21c075bc04a821", + "loads": [ + 4, + 2, + 0, + 3, + 0, + 3, + 9, + 5, + 14, + 0, + 0, + 6, + 5, + 5, + 1, + 1, + 4, + 0, + 6, + 2, + 6, + 6, + 2, + 2, + 0, + 7, + 3, + 5, + 13, + 4, + 0, + 3, + 0, + 0, + 3, + 0, + 3, + 1, + 4, + 0, + 2, + 5, + 0, + 1, + 0, + 3, + 0, + 0, + 2, + 3, + 3, + 13, + 6, + 0, + 8, + 1, + 1, + 0, + 5, + 7, + 3, + 6, + 2, + 1 + ], + "weighted_loads": [ + 0.18213520757853985, + 0.07325129583477974, + 0.0, + 0.13041257113218307, + 0.0, + 0.1867230162024498, + 0.6464861556887627, + 0.26432596147060394, + 1.2397723570466042, + 0.0, + 0.0, + 0.34422818943858147, + 0.6112795621156693, + 0.420735239982605, + 0.04466748237609863, + 0.034170616418123245, + 0.2575046308338642, + 0.0, + 0.4882064536213875, + 0.1421518325805664, + 0.3563491404056549, + 0.6951162703335285, + 0.07799084112048149, + 0.07358234748244286, + 0.0, + 0.524144571274519, + 0.11163750849664211, + 0.36890122666954994, + 0.8980274051427841, + 0.19198699295520782, + 0.0, + 0.12020477280020714, + 0.0, + 0.0, + 0.33184899389743805, + 0.0, + 0.14101969823241234, + 0.029591578990221024, + 0.34571271762251854, + 0.0, + 0.14341221377253532, + 0.46490276604890823, + 0.0, + 0.0508880615234375, + 0.0, + 0.10725400224328041, + 0.0, + 0.0, + 0.07653535716235638, + 0.3057515285909176, + 0.12731580436229706, + 0.8885887898504734, + 0.30677971988916397, + 0.0, + 0.5624874383211136, + 0.05531339719891548, + 0.044502511620521545, + 0.0, + 0.18490851297974586, + 0.3626331016421318, + 0.1285812295973301, + 0.2452823519706726, + 0.06776729971170425, + 0.035533975809812546 + ], + "unique_experts": 47, + "load_cv": 1.023935010913483, + "normalized_load_entropy": 0.8721917535667533, + "max_load_share": 0.06862745098039216 + }, + "full_input": { + "tokens": 75, + "top_k": 6, + "decisions": 450, + "ordered_route_sha256": "2259d59f80bbb7c8b377fbfb23f48c63fda4213e8c29209f9faa1997dd921a2e", + "route_weight_sha256": "e0fcbbb28c76d3d8c850e14b12f89c20db1d58ba13fee62b7826ca84b7c9a45c", + "loads": [ + 4, + 3, + 3, + 4, + 2, + 3, + 26, + 6, + 19, + 6, + 0, + 15, + 9, + 7, + 10, + 3, + 13, + 0, + 8, + 14, + 8, + 11, + 3, + 3, + 1, + 9, + 3, + 7, + 14, + 7, + 0, + 6, + 5, + 1, + 7, + 7, + 4, + 16, + 4, + 10, + 2, + 14, + 2, + 1, + 1, + 6, + 14, + 2, + 5, + 3, + 11, + 20, + 7, + 3, + 8, + 13, + 16, + 0, + 5, + 19, + 8, + 6, + 2, + 1 + ], + "weighted_loads": [ + 0.18213520757853985, + 0.10804340243339539, + 0.14067289233207703, + 0.16785434633493423, + 0.1503196395933628, + 0.1867230162024498, + 2.2351064905524254, + 0.325787678360939, + 1.5793203674256802, + 0.7058380097150803, + 0.0, + 0.9849184826016426, + 0.9407167807221413, + 0.5369098000228405, + 0.7350559718906879, + 0.21272528544068336, + 0.9612753726541996, + 0.0, + 0.6350589692592621, + 0.9155948311090469, + 0.44814248383045197, + 1.050728440284729, + 0.6243149153888226, + 0.10891113802790642, + 0.03250625357031822, + 0.6026637330651283, + 0.11163750849664211, + 0.4987089205533266, + 0.9340490214526653, + 0.38373446837067604, + 0.0, + 0.3177301771938801, + 0.14755545556545258, + 0.034077342599630356, + 0.5907840617001057, + 0.6788499876856804, + 0.17569688707590103, + 1.1686589419841766, + 0.34571271762251854, + 0.506923858076334, + 0.14341221377253532, + 1.1526946239173412, + 0.057936109602451324, + 0.0508880615234375, + 0.08418368548154831, + 0.20279038324952126, + 1.5083084478974342, + 0.05600382387638092, + 0.25331822223961353, + 0.3057515285909176, + 0.756296169012785, + 1.1584860794246197, + 0.34430622309446335, + 0.16891761869192123, + 0.5624874383211136, + 1.1378803923726082, + 1.6619221977889538, + 0.0, + 0.18490851297974586, + 1.488842824473977, + 0.39182956144213676, + 0.2452823519706726, + 0.06776729971170425, + 0.035533975809812546 + ], + "unique_experts": 60, + "load_cv": 0.8092184920657922, + "normalized_load_entropy": 0.9220067520377067, + "max_load_share": 0.057777777777777775 + } + }, + "s0_period": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "187b195714129d9150b444f8d6741a6d74f0a37a1120326a1204a2e6a0841bff", + "route_weight_sha256": "20ef1ae174e071102ea2084c9007b6d01d16c944bd0ce3bdee892ed6ef891423", + "loads": [ + 4, + 2, + 0, + 3, + 0, + 2, + 9, + 5, + 14, + 1, + 0, + 6, + 5, + 5, + 1, + 0, + 4, + 0, + 6, + 2, + 6, + 8, + 2, + 3, + 0, + 7, + 5, + 5, + 13, + 4, + 0, + 3, + 0, + 0, + 3, + 0, + 3, + 1, + 4, + 0, + 2, + 5, + 0, + 1, + 0, + 2, + 0, + 0, + 2, + 3, + 2, + 12, + 7, + 0, + 8, + 1, + 1, + 0, + 6, + 7, + 3, + 4, + 1, + 1 + ], + "weighted_loads": [ + 0.18930930644273758, + 0.0732932947576046, + 0.0, + 0.12617792934179306, + 0.0, + 0.14485744014382362, + 0.6070589032024145, + 0.275952260941267, + 1.2229144014418125, + 0.035061534494161606, + 0.0, + 0.34397805854678154, + 0.5982325077056885, + 0.41004829481244087, + 0.04334640875458717, + 0.0, + 0.24985259398818016, + 0.0, + 0.47327420487999916, + 0.13684791326522827, + 0.34609751030802727, + 0.7650494948029518, + 0.0867856815457344, + 0.10471589304506779, + 0.0, + 0.5367964170873165, + 0.17051700502634048, + 0.3691040463745594, + 0.8966070003807545, + 0.1864645630121231, + 0.0, + 0.12964853271842003, + 0.0, + 0.0, + 0.32063616812229156, + 0.0, + 0.1531708613038063, + 0.03220273554325104, + 0.35059360042214394, + 0.0, + 0.14275285229086876, + 0.4733348563313484, + 0.0, + 0.05005677416920662, + 0.0, + 0.066062917932868, + 0.0, + 0.0, + 0.07735925540328026, + 0.2911152355372906, + 0.0860438235104084, + 0.8315633125603199, + 0.3359138201922178, + 0.0, + 0.5437458120286465, + 0.053090907633304596, + 0.0423344150185585, + 0.0, + 0.22104711458086967, + 0.36994002014398575, + 0.13479186035692692, + 0.16062214970588684, + 0.03858063742518425, + 0.035928525030612946 + ], + "unique_experts": 47, + "load_cv": 1.0314172807715616, + "normalized_load_entropy": 0.8695111117268197, + "max_load_share": 0.06862745098039216 + }, + "full_input": { + "tokens": 59, + "top_k": 6, + "decisions": 354, + "ordered_route_sha256": "d9dd9ba7f6f147e102b5f11382a7609c621425907107cfe6b7bebbcda9830fb1", + "route_weight_sha256": "e4d06fe52c9456c4cb7249406a2174602f5a691abc62a8aca39fe2a5cdfaa228", + "loads": [ + 4, + 4, + 0, + 3, + 1, + 2, + 19, + 5, + 14, + 1, + 0, + 11, + 6, + 7, + 3, + 1, + 9, + 0, + 6, + 12, + 7, + 12, + 4, + 4, + 0, + 8, + 5, + 6, + 14, + 7, + 0, + 3, + 2, + 0, + 4, + 5, + 3, + 10, + 4, + 8, + 2, + 12, + 2, + 1, + 0, + 6, + 12, + 1, + 6, + 3, + 7, + 20, + 7, + 1, + 8, + 12, + 9, + 0, + 6, + 16, + 3, + 4, + 1, + 1 + ], + "weighted_loads": [ + 0.18930930644273758, + 0.1379964780062437, + 0.0, + 0.12617792934179306, + 0.028760550543665886, + 0.14485744014382362, + 1.6327279638499022, + 0.275952260941267, + 1.2229144014418125, + 0.035061534494161606, + 0.0, + 0.6967620886862278, + 0.6514498703181744, + 0.5226344093680382, + 0.18485401943325996, + 0.037723056972026825, + 0.5610721670091152, + 0.0, + 0.47327420487999916, + 0.779088344424963, + 0.39001428708434105, + 1.044807456433773, + 0.6610352676361799, + 0.14042515121400356, + 0.0, + 0.5646432712674141, + 0.17051700502634048, + 0.4703696258366108, + 1.000443335622549, + 0.36058031022548676, + 0.0, + 0.12964853271842003, + 0.06019560992717743, + 0.0, + 0.3555263727903366, + 0.49113260954618454, + 0.1531708613038063, + 0.7836311869323254, + 0.35059360042214394, + 0.31580118276178837, + 0.14275285229086876, + 1.0487458482384682, + 0.05798942968249321, + 0.05005677416920662, + 0.0, + 0.19677584618330002, + 1.282641164958477, + 0.01908714324235916, + 0.28265213035047054, + 0.2911152355372906, + 0.5527803748846054, + 1.1697535961866379, + 0.3359138201922178, + 0.03632344305515289, + 0.5437458120286465, + 0.9678042083978653, + 1.0631687343120575, + 0.0, + 0.22104711458086967, + 1.3380886167287827, + 0.13479186035692692, + 0.16062214970588684, + 0.03858063742518425, + 0.035928525030612946 + ], + "unique_experts": 56, + "load_cv": 0.8670245800774191, + "normalized_load_entropy": 0.9066259391248631, + "max_load_share": 0.05649717514124294 + } + }, + "s1_period": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "617745c97869ff5ea00a373029124e12b1dbf08de684bbcc0591cb30cafc981c", + "route_weight_sha256": "8ace0b84f66e55c9c4b8e6b015fd9252b6255cbf814ec58e2e40d989c9bed7ca", + "loads": [ + 4, + 2, + 0, + 4, + 0, + 3, + 9, + 5, + 14, + 0, + 0, + 6, + 5, + 5, + 1, + 1, + 4, + 0, + 6, + 2, + 6, + 6, + 2, + 2, + 0, + 7, + 3, + 5, + 13, + 4, + 0, + 2, + 0, + 0, + 3, + 0, + 3, + 1, + 4, + 0, + 2, + 5, + 0, + 1, + 0, + 3, + 0, + 0, + 3, + 3, + 3, + 13, + 6, + 0, + 8, + 1, + 1, + 0, + 6, + 7, + 3, + 5, + 1, + 1 + ], + "weighted_loads": [ + 0.17826210148632526, + 0.07243947871029377, + 0.0, + 0.16145002096891403, + 0.0, + 0.18610261008143425, + 0.640807842835784, + 0.2653319872915745, + 1.2513427399098873, + 0.0, + 0.0, + 0.35343849658966064, + 0.6051240786910057, + 0.42060088366270065, + 0.0456700399518013, + 0.02862890437245369, + 0.26132334396243095, + 0.0, + 0.46956561133265495, + 0.1483866348862648, + 0.35830700024962425, + 0.6762467473745346, + 0.07883181422948837, + 0.07489129900932312, + 0.0, + 0.5259958766400814, + 0.11082596518099308, + 0.35413437709212303, + 0.8898713663220406, + 0.19332578033208847, + 0.0, + 0.08942025527358055, + 0.0, + 0.0, + 0.33279944956302643, + 0.0, + 0.14024879783391953, + 0.031565383076667786, + 0.34070635959506035, + 0.0, + 0.14387312158942223, + 0.46813851594924927, + 0.0, + 0.05179919674992561, + 0.0, + 0.11046336032450199, + 0.0, + 0.0, + 0.11049269884824753, + 0.2997265625745058, + 0.13595262169837952, + 0.8908290192484856, + 0.3105442710220814, + 0.0, + 0.5558391585946083, + 0.05615770444273949, + 0.047979358583688736, + 0.0, + 0.22089674323797226, + 0.3690718449652195, + 0.12963499873876572, + 0.2043181173503399, + 0.039486732333898544, + 0.03490675613284111 + ], + "unique_experts": 47, + "load_cv": 1.0269344607979214, + "normalized_load_entropy": 0.8711745047940108, + "max_load_share": 0.06862745098039216 + }, + "full_input": { + "tokens": 75, + "top_k": 6, + "decisions": 450, + "ordered_route_sha256": "c7406fb25f6d9a10f6c439e5a0c91f347089f1e0f733572396643831193f5560", + "route_weight_sha256": "055b0c3358fdc78915dff1efad7b692ab7d9c1fdd7294c753a3d3b99bb42d3a8", + "loads": [ + 4, + 3, + 3, + 5, + 2, + 3, + 26, + 6, + 19, + 6, + 0, + 15, + 10, + 7, + 10, + 3, + 13, + 0, + 8, + 14, + 8, + 11, + 3, + 3, + 1, + 9, + 3, + 7, + 15, + 7, + 0, + 5, + 5, + 1, + 7, + 7, + 4, + 17, + 4, + 10, + 2, + 13, + 2, + 1, + 1, + 6, + 15, + 2, + 5, + 3, + 10, + 20, + 7, + 3, + 8, + 13, + 16, + 0, + 6, + 18, + 8, + 5, + 1, + 1 + ], + "weighted_loads": [ + 0.17826210148632526, + 0.10723158530890942, + 0.14067289233207703, + 0.1988917961716652, + 0.1503196395933628, + 0.18610261008143425, + 2.0841934997588396, + 0.32679370418190956, + 1.5908907502889633, + 0.7058380097150803, + 0.0, + 0.9839767403900623, + 1.0001950487494469, + 0.5376789085566998, + 0.7350674010813236, + 0.1931435465812683, + 0.9563855566084385, + 0.0, + 0.6164181269705296, + 1.0246908403933048, + 0.4501003436744213, + 1.0363910309970379, + 0.6251558884978294, + 0.11022008955478668, + 0.03250625357031822, + 0.6045150384306908, + 0.11082596518099308, + 0.4844020549207926, + 1.0499691031873226, + 0.386087317019701, + 0.0, + 0.2869456596672535, + 0.14755545556545258, + 0.034077342599630356, + 0.591734517365694, + 0.6867461800575256, + 0.17492598667740822, + 1.3173431493341923, + 0.34070635959506035, + 0.5069199651479721, + 0.14387312158942223, + 1.0656054764986038, + 0.057936109602451324, + 0.05179919674992561, + 0.08418368548154831, + 0.20599974133074284, + 1.5692416429519653, + 0.05663682892918587, + 0.21370156109333038, + 0.2997265625745058, + 0.7027015872299671, + 1.1644522845745087, + 0.34807077422738075, + 0.16891761869192123, + 0.5558391585946083, + 1.196958638727665, + 1.6457984000444412, + 0.0, + 0.22089674323797226, + 1.4228645395487547, + 0.3928833305835724, + 0.2043181173503399, + 0.039486732333898544, + 0.03490675613284111 + ], + "unique_experts": 60, + "load_cv": 0.8131147247194307, + "normalized_load_entropy": 0.9209684490474243, + "max_load_share": 0.057777777777777775 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 34, + "ordered_topk_exact_tokens": 27, + "set_exact_tokens": 27, + "mean_set_jaccard": 0.9411764705882353, + "mean_token_weighted_tv": 0.011026099762495826, + "aggregate_load_tv": 0.01960784313725491 + }, + "system_bos": { + "tokens": 34, + "ordered_topk_exact_tokens": 22, + "set_exact_tokens": 25, + "mean_set_jaccard": 0.9243697478991596, + "mean_token_weighted_tv": 0.014704744221971315, + "aggregate_load_tv": 0.03921568627450981 + }, + "system_x": { + "tokens": 34, + "ordered_topk_exact_tokens": 25, + "set_exact_tokens": 26, + "mean_set_jaccard": 0.9327731092436975, + "mean_token_weighted_tv": 0.01609364094431786, + "aggregate_load_tv": 0.0392156862745098 + }, + "system_period": { + "tokens": 34, + "ordered_topk_exact_tokens": 24, + "set_exact_tokens": 25, + "mean_set_jaccard": 0.9243697478991597, + "mean_token_weighted_tv": 0.017197451745981678, + "aggregate_load_tv": 0.0392156862745098 + }, + "bos_at_s0": { + "tokens": 34, + "ordered_topk_exact_tokens": 20, + "set_exact_tokens": 26, + "mean_set_jaccard": 0.9264705882352944, + "mean_token_weighted_tv": 0.01702732466818655, + "aggregate_load_tv": 0.03431372549019608 + }, + "bos_at_s1": { + "tokens": 34, + "ordered_topk_exact_tokens": 19, + "set_exact_tokens": 24, + "mean_set_jaccard": 0.9096638655462186, + "mean_token_weighted_tv": 0.019243709469104513, + "aggregate_load_tv": 0.044117647058823525 + }, + "x_at_s0": { + "tokens": 34, + "ordered_topk_exact_tokens": 19, + "set_exact_tokens": 24, + "mean_set_jaccard": 0.9096638655462186, + "mean_token_weighted_tv": 0.019750678007874417, + "aggregate_load_tv": 0.04901960784313726 + }, + "x_at_s1": { + "tokens": 34, + "ordered_topk_exact_tokens": 19, + "set_exact_tokens": 22, + "mean_set_jaccard": 0.892857142857143, + "mean_token_weighted_tv": 0.023379333865116623, + "aggregate_load_tv": 0.05882352941176471 + }, + "period_at_s0": { + "tokens": 34, + "ordered_topk_exact_tokens": 20, + "set_exact_tokens": 25, + "mean_set_jaccard": 0.9180672268907564, + "mean_token_weighted_tv": 0.019397512023501536, + "aggregate_load_tv": 0.04411764705882353 + }, + "period_at_s1": { + "tokens": 34, + "ordered_topk_exact_tokens": 20, + "set_exact_tokens": 24, + "mean_set_jaccard": 0.9096638655462185, + "mean_token_weighted_tv": 0.022022367811159176, + "aggregate_load_tv": 0.04901960784313726 + } + } + }, + "layer_07": { + "layer": 7, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "35863761279eb14f5eb002c34ad8e23a5795ecc7d053dd3099c10543d034d6c8", + "route_weight_sha256": "17cdd04eeaa8172b9ad4d2e0e87c6bb5ff1e8943ad2bf37e3a37f83051132c12", + "loads": [ + 1, + 1, + 12, + 0, + 2, + 8, + 2, + 6, + 3, + 7, + 0, + 1, + 2, + 3, + 17, + 0, + 2, + 4, + 3, + 2, + 0, + 6, + 6, + 5, + 4, + 4, + 0, + 0, + 1, + 0, + 3, + 2, + 1, + 8, + 3, + 7, + 6, + 0, + 1, + 5, + 6, + 0, + 4, + 1, + 0, + 2, + 6, + 1, + 0, + 4, + 1, + 12, + 0, + 1, + 0, + 4, + 5, + 1, + 1, + 4, + 7, + 6, + 0, + 0 + ], + "weighted_loads": [ + 0.03659530729055405, + 0.04673459753394127, + 0.7379067651927471, + 0.0, + 0.1308421604335308, + 0.5217290259897709, + 0.11043240875005722, + 0.3380170203745365, + 0.12870726734399796, + 0.35688803158700466, + 0.0, + 0.03341299667954445, + 0.11695843562483788, + 0.11293454840779305, + 1.2170730717480183, + 0.0, + 0.0997001901268959, + 0.13979433849453926, + 0.12003625929355621, + 0.06995636969804764, + 0.0, + 0.5290720872581005, + 0.315907571464777, + 0.3794560134410858, + 0.13881420716643333, + 0.31026051193475723, + 0.0, + 0.0, + 0.05107484385371208, + 0.0, + 0.18922455236315727, + 0.06205435283482075, + 0.04951789602637291, + 0.5221194177865982, + 0.12019351124763489, + 0.33635159209370613, + 0.617585364729166, + 0.0, + 0.0363343320786953, + 0.2077937237918377, + 0.5873148329555988, + 0.0, + 0.299251314252615, + 0.03649525344371796, + 0.0, + 0.08374820649623871, + 0.7786694336682558, + 0.05099119991064072, + 0.0, + 0.29995615035295486, + 0.05245266109704971, + 0.9975969232618809, + 0.0, + 0.10401250422000885, + 0.0, + 0.19890893623232841, + 0.21026775613427162, + 0.03864271193742752, + 0.028299331665039062, + 0.1958756186068058, + 0.7500731088221073, + 0.31108302250504494, + 0.0, + 0.0 + ], + "unique_experts": 49, + "load_cv": 1.0564606896489563, + "normalized_load_entropy": 0.870524970683003, + "max_load_share": 0.08333333333333333 + }, + "full_input": { + "tokens": 59, + "top_k": 6, + "decisions": 354, + "ordered_route_sha256": "2c8e77b08ea489746bdf773c5204385742b385437b7a23164a3e9d37aa8a8bb4", + "route_weight_sha256": "c0b0b678016e4f4171b9f14386bac1298d9b0faefae6196a2b4637415ac4dc5d", + "loads": [ + 1, + 1, + 12, + 3, + 2, + 9, + 7, + 6, + 10, + 7, + 1, + 4, + 2, + 8, + 17, + 0, + 16, + 6, + 6, + 3, + 0, + 6, + 9, + 8, + 8, + 4, + 4, + 0, + 4, + 0, + 3, + 2, + 4, + 9, + 4, + 7, + 6, + 0, + 10, + 8, + 6, + 10, + 9, + 4, + 4, + 2, + 9, + 2, + 0, + 4, + 16, + 12, + 0, + 3, + 0, + 11, + 5, + 2, + 5, + 4, + 7, + 12, + 3, + 7 + ], + "weighted_loads": [ + 0.03659530729055405, + 0.04673459753394127, + 0.7379067651927471, + 0.11060141026973724, + 0.1308421604335308, + 0.5632968544960022, + 0.5915458351373672, + 0.3380170203745365, + 0.7377563044428825, + 0.35688803158700466, + 0.03316297009587288, + 0.5401524342596531, + 0.11695843562483788, + 0.4014416877180338, + 1.2170730717480183, + 0.0, + 2.058832410722971, + 0.25898680463433266, + 0.2015739530324936, + 0.1347547248005867, + 0.0, + 0.5290720872581005, + 0.48840128257870674, + 0.6273718774318695, + 0.26889067329466343, + 0.31026051193475723, + 0.3425995334982872, + 0.0, + 0.11433987598866224, + 0.0, + 0.18922455236315727, + 0.06205435283482075, + 0.16454588994383812, + 0.5715505480766296, + 0.16080030426383018, + 0.33635159209370613, + 0.617585364729166, + 0.0, + 0.8028939701616764, + 0.34847211837768555, + 0.5873148329555988, + 0.9974606819450855, + 0.6514740623533726, + 0.12713804561644793, + 1.5154290944337845, + 0.08374820649623871, + 1.032867869362235, + 0.14111801981925964, + 0.0, + 0.29995615035295486, + 1.0426855720579624, + 0.9975969232618809, + 0.0, + 0.17904478684067726, + 0.0, + 0.8576584793627262, + 0.21026775613427162, + 0.07824701443314552, + 0.11327388882637024, + 0.1958756186068058, + 0.7500731088221073, + 0.6093322709202766, + 0.04846948478370905, + 0.26880551502108574 + ], + "unique_experts": 56, + "load_cv": 0.7494984331574681, + "normalized_load_entropy": 0.9248205461054425, + "max_load_share": 0.0480225988700565 + } + }, + "s1_eos": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "942e11ae5081d9774bfe385a0d4ff841b6a136e6496ab5ebf4bedb67fc4de346", + "route_weight_sha256": "af9a528e18b4740ef23e7e462800eb13e8e32c3153030e4d42ae4d2ff3aee3e0", + "loads": [ + 0, + 1, + 12, + 0, + 2, + 8, + 2, + 6, + 3, + 10, + 0, + 1, + 2, + 2, + 17, + 0, + 2, + 4, + 3, + 2, + 0, + 6, + 7, + 5, + 4, + 3, + 0, + 0, + 1, + 0, + 3, + 2, + 1, + 8, + 3, + 7, + 6, + 0, + 1, + 5, + 6, + 0, + 4, + 1, + 0, + 2, + 6, + 1, + 0, + 4, + 1, + 12, + 0, + 1, + 0, + 4, + 5, + 1, + 1, + 4, + 7, + 5, + 0, + 0 + ], + "weighted_loads": [ + 0.0, + 0.04642245173454285, + 0.7247970476746559, + 0.0, + 0.13320258259773254, + 0.518040245398879, + 0.11031199432909489, + 0.34311021119356155, + 0.12876978516578674, + 0.4604693539440632, + 0.0, + 0.033602163195610046, + 0.11238666996359825, + 0.0731159970164299, + 1.2189554534852505, + 0.0, + 0.10305316746234894, + 0.13806121237576008, + 0.11932585388422012, + 0.0708102136850357, + 0.0, + 0.5269405543804169, + 0.3545375168323517, + 0.37964780628681183, + 0.14026422426104546, + 0.2738906927406788, + 0.0, + 0.0, + 0.049268513917922974, + 0.0, + 0.19594669342041016, + 0.06213531270623207, + 0.05099565163254738, + 0.5098110772669315, + 0.1211090125143528, + 0.33554450049996376, + 0.6188941895961761, + 0.0, + 0.036492135375738144, + 0.2091444879770279, + 0.5902277305722237, + 0.0, + 0.3003360964357853, + 0.038082897663116455, + 0.0, + 0.08356760442256927, + 0.7664916254580021, + 0.053971994668245316, + 0.0, + 0.30273616313934326, + 0.05463775619864464, + 1.0203804224729538, + 0.0, + 0.10258940607309341, + 0.0, + 0.19326025247573853, + 0.20854132622480392, + 0.038681510835886, + 0.029650278389453888, + 0.20389415696263313, + 0.744028277695179, + 0.27578524872660637, + 0.0, + 0.0 + ], + "unique_experts": 48, + "load_cv": 1.0851838511389578, + "normalized_load_entropy": 0.8641447652788719, + "max_load_share": 0.08333333333333333 + }, + "full_input": { + "tokens": 75, + "top_k": 6, + "decisions": 450, + "ordered_route_sha256": "b0b2f7069dc895fb34c55b8b470045509bed57488b223b66e5e2c242037d843d", + "route_weight_sha256": "0ff4aa53cec7fcdb0399ef21d16665909f311a0c9ba28a02c651649698157ed2", + "loads": [ + 0, + 1, + 12, + 2, + 3, + 9, + 9, + 6, + 18, + 12, + 6, + 6, + 2, + 8, + 19, + 2, + 17, + 7, + 6, + 3, + 0, + 6, + 9, + 9, + 9, + 3, + 8, + 0, + 4, + 6, + 3, + 2, + 7, + 16, + 4, + 7, + 6, + 4, + 17, + 8, + 8, + 15, + 14, + 5, + 11, + 2, + 9, + 6, + 0, + 4, + 23, + 12, + 0, + 2, + 4, + 13, + 5, + 8, + 4, + 4, + 7, + 11, + 4, + 3 + ], + "weighted_loads": [ + 0.0, + 0.04642245173454285, + 0.7247970476746559, + 0.06281207501888275, + 0.1798313744366169, + 0.5622303392738104, + 0.5916853342205286, + 0.34311021119356155, + 1.4628423005342484, + 0.5623206533491611, + 0.5212119407951832, + 0.6591937653720379, + 0.11238666996359825, + 0.40840522944927216, + 1.2874564193189144, + 0.09858720749616623, + 2.4813152477145195, + 0.30055668018758297, + 0.20503509044647217, + 0.1340305432677269, + 0.0, + 0.5269405543804169, + 0.47302139922976494, + 0.6674428097903728, + 0.29406674299389124, + 0.2738906927406788, + 0.6929055824875832, + 0.0, + 0.11268192622810602, + 0.7777210250496864, + 0.19594669342041016, + 0.06213531270623207, + 0.43574298545718193, + 1.0509473979473114, + 0.16245366632938385, + 0.33554450049996376, + 0.6188941895961761, + 0.22794578224420547, + 1.63747950643301, + 0.365166112780571, + 0.8129010945558548, + 1.4623796567320824, + 1.089943129569292, + 0.1689302995800972, + 2.0869619343429804, + 0.08356760442256927, + 1.0372814238071442, + 0.3435826115310192, + 0.0, + 0.30273616313934326, + 1.508606730028987, + 1.0203804224729538, + 0.0, + 0.14452380314469337, + 0.2065368928015232, + 0.9641554579138756, + 0.20854132622480392, + 0.6109413206577301, + 0.08689869102090597, + 0.20389415696263313, + 0.744028277695179, + 0.5678263753652573, + 0.0831102798692882, + 0.09100686386227608 + ], + "unique_experts": 59, + "load_cv": 0.7299585646958596, + "normalized_load_entropy": 0.9338461501740368, + "max_load_share": 0.051111111111111114 + } + }, + "s0_bos": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "d704351b2e900a16060908395e291bcfa3e0db07b5b437623f68788fe341f900", + "route_weight_sha256": "7395ed8b79abe6b92bfd1ddac953aea756027b9a12cdcddd00b4d3d16719964c", + "loads": [ + 1, + 1, + 13, + 1, + 2, + 7, + 2, + 5, + 3, + 8, + 0, + 2, + 2, + 3, + 18, + 0, + 2, + 3, + 3, + 2, + 0, + 7, + 9, + 5, + 5, + 4, + 0, + 0, + 1, + 0, + 2, + 0, + 1, + 7, + 3, + 4, + 6, + 0, + 1, + 5, + 6, + 1, + 4, + 1, + 0, + 3, + 5, + 1, + 0, + 4, + 1, + 12, + 0, + 1, + 0, + 4, + 6, + 1, + 0, + 4, + 7, + 5, + 0, + 0 + ], + "weighted_loads": [ + 0.03643491119146347, + 0.04356677085161209, + 0.7626520842313766, + 0.02911834418773651, + 0.13382089138031006, + 0.4921812638640404, + 0.10416434332728386, + 0.30581314116716385, + 0.12336330115795135, + 0.40201326459646225, + 0.0, + 0.06689436733722687, + 0.10931673273444176, + 0.10192316956818104, + 1.239902812987566, + 0.0, + 0.10056881234049797, + 0.10236518271267414, + 0.12401384860277176, + 0.06969769299030304, + 0.0, + 0.5681225452572107, + 0.40616991370916367, + 0.3647698163986206, + 0.16851509734988213, + 0.3139270432293415, + 0.0, + 0.0, + 0.04893238842487335, + 0.0, + 0.15945535525679588, + 0.0, + 0.048131875693798065, + 0.49993526190519333, + 0.11960691958665848, + 0.2138032354414463, + 0.6375486180186272, + 0.0, + 0.0376531146466732, + 0.20150874182581902, + 0.6093527190387249, + 0.03276532515883446, + 0.29015443846583366, + 0.03833494335412979, + 0.0, + 0.11910457164049149, + 0.746599480509758, + 0.046047359704971313, + 0.0, + 0.31467054784297943, + 0.05190197378396988, + 0.9944397434592247, + 0.0, + 0.10750459879636765, + 0.0, + 0.2046322114765644, + 0.23603655584156513, + 0.03612270951271057, + 0.0, + 0.198938749730587, + 0.7645917572081089, + 0.26796549558639526, + 0.0, + 0.0 + ], + "unique_experts": 49, + "load_cv": 1.0922466256631729, + "normalized_load_entropy": 0.8669437072618948, + "max_load_share": 0.08823529411764706 + }, + "full_input": { + "tokens": 59, + "top_k": 6, + "decisions": 354, + "ordered_route_sha256": "ac28f73502293ad9be8728867f9bf1c6d523924b8d0f3219e2f07e3b8d2325fb", + "route_weight_sha256": "ed2e8a2b7930d265cba68c3bbe36e526a6beb14830d73a8083b7a624e2092453", + "loads": [ + 1, + 1, + 13, + 4, + 2, + 8, + 8, + 5, + 10, + 8, + 1, + 6, + 2, + 8, + 18, + 0, + 16, + 5, + 7, + 3, + 0, + 7, + 12, + 8, + 8, + 4, + 5, + 0, + 3, + 0, + 2, + 0, + 4, + 8, + 4, + 4, + 6, + 0, + 10, + 8, + 6, + 11, + 9, + 3, + 4, + 3, + 8, + 3, + 0, + 4, + 16, + 12, + 0, + 4, + 0, + 11, + 6, + 1, + 3, + 4, + 7, + 11, + 2, + 7 + ], + "weighted_loads": [ + 0.03643491119146347, + 0.04356677085161209, + 0.7626520842313766, + 0.13971975445747375, + 0.13382089138031006, + 0.5337490923702717, + 0.6777315698564053, + 0.30581314116716385, + 0.7274596206843853, + 0.40201326459646225, + 0.03316297009587288, + 0.6300804242491722, + 0.10931673273444176, + 0.3904303088784218, + 1.239902812987566, + 0.0, + 2.0719486474990845, + 0.21591822616755962, + 0.2524670995771885, + 0.13624926656484604, + 0.0, + 0.5681225452572107, + 0.5786636248230934, + 0.6196803078055382, + 0.29151992686092854, + 0.3139270432293415, + 0.39206213131546974, + 0.0, + 0.0990886278450489, + 0.0, + 0.15945535525679588, + 0.0, + 0.16315986961126328, + 0.5493663921952248, + 0.16151633113622665, + 0.2138032354414463, + 0.6375486180186272, + 0.0, + 0.8404589705169201, + 0.34525084495544434, + 0.6093527190387249, + 1.0261212587356567, + 0.6428432501852512, + 0.11597665585577488, + 0.689912673085928, + 0.11910457164049149, + 1.0150906927883625, + 0.16999229788780212, + 0.0, + 0.31467054784297943, + 1.1592476293444633, + 0.9944397434592247, + 0.0, + 0.22575829923152924, + 0.0, + 0.8633817546069622, + 0.23603655584156513, + 0.03612270951271057, + 0.06998162902891636, + 0.198938749730587, + 0.7645917572081089, + 0.566214744001627, + 0.04285083245486021, + 0.26880551502108574 + ], + "unique_experts": 55, + "load_cv": 0.7789032590473471, + "normalized_load_entropy": 0.9186424123132331, + "max_load_share": 0.05084745762711865 + } + }, + "s1_bos": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "f6aec169280edb368117c07e553dd6b0ad9f2f42e5935014f2bd13cb7260ca72", + "route_weight_sha256": "9800ce2ae0d205202fea895fc7d0ed7b26d733dbdc51d210b30da1612610a5b1", + "loads": [ + 1, + 1, + 13, + 0, + 2, + 8, + 2, + 5, + 3, + 8, + 0, + 1, + 2, + 3, + 18, + 0, + 2, + 3, + 3, + 2, + 0, + 7, + 9, + 5, + 5, + 4, + 0, + 0, + 1, + 0, + 3, + 0, + 1, + 7, + 5, + 5, + 6, + 0, + 1, + 4, + 6, + 0, + 4, + 1, + 0, + 3, + 5, + 1, + 0, + 4, + 1, + 11, + 0, + 1, + 0, + 4, + 6, + 1, + 0, + 4, + 7, + 5, + 0, + 0 + ], + "weighted_loads": [ + 0.03536823019385338, + 0.043772853910923004, + 0.7743664868175983, + 0.0, + 0.13526387885212898, + 0.5301858726888895, + 0.09883699007332325, + 0.3036094754934311, + 0.12451246753334999, + 0.3958571143448353, + 0.0, + 0.032534897327423096, + 0.1169268861413002, + 0.10071456618607044, + 1.2239770218729973, + 0.0, + 0.10455553233623505, + 0.10154039971530437, + 0.13035676255822182, + 0.0765397660434246, + 0.0, + 0.5679721236228943, + 0.40703839994966984, + 0.3696909621357918, + 0.16897285357117653, + 0.31282034516334534, + 0.0, + 0.0, + 0.044012147933244705, + 0.0, + 0.20391862094402313, + 0.0, + 0.050131116062402725, + 0.48604003340005875, + 0.18988842517137527, + 0.23983633145689964, + 0.6252015121281147, + 0.0, + 0.03690351918339729, + 0.17077066376805305, + 0.6158957406878471, + 0.0, + 0.2926068939268589, + 0.038986969739198685, + 0.0, + 0.11801387742161751, + 0.7405692040920258, + 0.049402814358472824, + 0.0, + 0.3150933161377907, + 0.055249325931072235, + 0.9714723564684391, + 0.0, + 0.1083298772573471, + 0.0, + 0.21924977377057076, + 0.2360841240733862, + 0.034232497215270996, + 0.0, + 0.1929791159927845, + 0.760978601872921, + 0.2624616213142872, + 0.0, + 0.0 + ], + "unique_experts": 47, + "load_cv": 1.0978641316995623, + "normalized_load_entropy": 0.8612309998955632, + "max_load_share": 0.08823529411764706 + }, + "full_input": { + "tokens": 75, + "top_k": 6, + "decisions": 450, + "ordered_route_sha256": "ffbafc685e314b61e3cceaa5a2c64f06891608b69e2d0ef10ff6c298502bc285", + "route_weight_sha256": "3244b1b358212b7d7bf3ab80f3d1271c93608d31c83917f6e79dd2619323ab48", + "loads": [ + 1, + 1, + 13, + 2, + 3, + 9, + 10, + 5, + 18, + 10, + 7, + 6, + 2, + 9, + 20, + 2, + 17, + 6, + 7, + 3, + 0, + 7, + 11, + 10, + 9, + 4, + 9, + 0, + 3, + 6, + 3, + 0, + 7, + 15, + 6, + 5, + 6, + 4, + 17, + 7, + 8, + 15, + 14, + 4, + 11, + 3, + 9, + 7, + 0, + 4, + 23, + 11, + 0, + 1, + 4, + 13, + 6, + 7, + 2, + 4, + 7, + 11, + 3, + 3 + ], + "weighted_loads": [ + 0.03536823019385338, + 0.043772853910923004, + 0.7743664868175983, + 0.06281207501888275, + 0.18189267069101334, + 0.5743759665638208, + 0.702884154394269, + 0.3036094754934311, + 1.4505977407097816, + 0.49770841374993324, + 0.5564056895673275, + 0.6805205717682838, + 0.1169268861413002, + 0.4360037986189127, + 1.2924779877066612, + 0.09858720749616623, + 2.493135042488575, + 0.2594932746142149, + 0.2576077952980995, + 0.13918403908610344, + 0.0, + 0.5679721236228943, + 0.5255222823470831, + 0.7091069407761097, + 0.3155550565570593, + 0.31282034516334534, + 0.7634184621274471, + 0.0, + 0.09374724514782429, + 0.7777210250496864, + 0.20391862094402313, + 0.0, + 0.4348784498870373, + 1.0271763540804386, + 0.23302815482020378, + 0.23983633145689964, + 0.6252015121281147, + 0.22794578224420547, + 1.672522433102131, + 0.3301261328160763, + 0.8385691046714783, + 1.455565981566906, + 1.0906532518565655, + 0.15134206600487232, + 1.2567338924854994, + 0.11801387742161751, + 1.0595962516963482, + 0.3744574934244156, + 0.0, + 0.3150933161377907, + 1.6734399292618036, + 0.9714723564684391, + 0.0, + 0.1083298772573471, + 0.2065368928015232, + 0.9901449792087078, + 0.2360841240733862, + 0.5671420954167843, + 0.04163798503577709, + 0.1929791159927845, + 0.760978601872921, + 0.5545027479529381, + 0.07755599077790976, + 0.09100686386227608 + ], + "unique_experts": 59, + "load_cv": 0.7415565877527528, + "normalized_load_entropy": 0.9309903943802347, + "max_load_share": 0.051111111111111114 + } + }, + "s0_x": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "607b7e1da7ce40fb67db76dc39c416519f4cb3c3468cf922407233d3990c1e2b", + "route_weight_sha256": "428a0420987d67f63b39ddd64c789d9e4a921bdaa13f297df4ee4b52bbbce3fb", + "loads": [ + 0, + 1, + 13, + 0, + 2, + 7, + 2, + 5, + 3, + 8, + 0, + 1, + 2, + 5, + 17, + 0, + 2, + 4, + 3, + 2, + 0, + 6, + 10, + 5, + 5, + 3, + 1, + 0, + 1, + 0, + 4, + 1, + 1, + 7, + 4, + 4, + 6, + 0, + 1, + 4, + 6, + 0, + 4, + 1, + 1, + 3, + 5, + 0, + 0, + 4, + 1, + 12, + 0, + 1, + 0, + 4, + 5, + 1, + 0, + 4, + 7, + 5, + 0, + 0 + ], + "weighted_loads": [ + 0.0, + 0.046594858169555664, + 0.769897099584341, + 0.0, + 0.1352531500160694, + 0.5018750764429569, + 0.10462839715182781, + 0.29424702748656273, + 0.13284534215927124, + 0.39191659167408943, + 0.0, + 0.030840152874588966, + 0.11949634552001953, + 0.18430128879845142, + 1.1852468475699425, + 0.0, + 0.10240664705634117, + 0.13779861852526665, + 0.12260698899626732, + 0.0758519172668457, + 0.0, + 0.5332608502358198, + 0.4534850772470236, + 0.37024397403001785, + 0.16522894985973835, + 0.28045203909277916, + 0.03497816249728203, + 0.0, + 0.049001846462488174, + 0.0, + 0.2380918525159359, + 0.028904112055897713, + 0.05383877083659172, + 0.5287250876426697, + 0.15395600721240044, + 0.21543293073773384, + 0.6295059397816658, + 0.0, + 0.038206152617931366, + 0.16868499666452408, + 0.5943287275731564, + 0.0, + 0.3157452791929245, + 0.036963917315006256, + 0.04883426055312157, + 0.11452173627912998, + 0.7679879069328308, + 0.0, + 0.0, + 0.3127669021487236, + 0.05399405583739281, + 1.0101368315517902, + 0.0, + 0.09615496546030045, + 0.0, + 0.2096986249089241, + 0.19025268591940403, + 0.03533473238348961, + 0.0, + 0.1982586346566677, + 0.744626622647047, + 0.28080591931939125, + 0.0, + 0.0 + ], + "unique_experts": 48, + "load_cv": 1.0795003614510434, + "normalized_load_entropy": 0.8656638418804458, + "max_load_share": 0.08333333333333333 + }, + "full_input": { + "tokens": 59, + "top_k": 6, + "decisions": 354, + "ordered_route_sha256": "775bd53c28b41c665f4db56982a2b3ec0411472f784356efdc69fec07800f409", + "route_weight_sha256": "29676974df45ce98c40e09b36cb0cc3de2dec1dd8a0510b3cfd732ec53a35860", + "loads": [ + 0, + 1, + 13, + 3, + 2, + 9, + 6, + 5, + 10, + 8, + 1, + 5, + 2, + 11, + 17, + 0, + 17, + 6, + 6, + 2, + 0, + 6, + 13, + 8, + 8, + 3, + 5, + 1, + 3, + 0, + 4, + 1, + 4, + 8, + 6, + 4, + 6, + 0, + 10, + 7, + 6, + 10, + 9, + 3, + 4, + 3, + 9, + 3, + 0, + 4, + 15, + 12, + 0, + 2, + 0, + 11, + 5, + 1, + 3, + 4, + 7, + 12, + 2, + 8 + ], + "weighted_loads": [ + 0.0, + 0.046594858169555664, + 0.769897099584341, + 0.11060141026973724, + 0.1352531500160694, + 0.5976324379444122, + 0.46187428943812847, + 0.29424702748656273, + 0.7033078446984291, + 0.39191659167408943, + 0.03316297009587288, + 0.603880176320672, + 0.11949634552001953, + 0.5075731053948402, + 1.1852468475699425, + 0.0, + 2.3394054770469666, + 0.262188408523798, + 0.20745943114161491, + 0.0758519172668457, + 0.0, + 0.5332608502358198, + 0.6259787883609533, + 0.6128049194812775, + 0.28823377937078476, + 0.28045203909277916, + 0.40879901871085167, + 0.033628884702920914, + 0.09915808588266373, + 0.0, + 0.2380918525159359, + 0.028904112055897713, + 0.16886676475405693, + 0.5781562179327011, + 0.25581057742238045, + 0.21543293073773384, + 0.6295059397816658, + 0.0, + 0.7803568989038467, + 0.3120711222290993, + 0.5943287275731564, + 0.9001095145940781, + 0.6681530587375164, + 0.09639406763017178, + 0.6907460577785969, + 0.11452173627912998, + 1.0729669034481049, + 0.17150316014885902, + 0.0, + 0.3127669021487236, + 0.9957475624978542, + 1.0101368315517902, + 0.0, + 0.12748387455940247, + 0.0, + 0.8684481680393219, + 0.19025268591940403, + 0.03533473238348961, + 0.06998162902891636, + 0.1982586346566677, + 0.744626622647047, + 0.6316117607057095, + 0.04285083245486021, + 0.34920235350728035 + ], + "unique_experts": 56, + "load_cv": 0.7860826186647613, + "normalized_load_entropy": 0.918435618953011, + "max_load_share": 0.0480225988700565 + } + }, + "s1_x": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "09840d50d9c9abf5ee1415824f183c1eea69bbcf44ad77ccb493d3c2eae4f0d2", + "route_weight_sha256": "dd4f68655cdbcf3765fb9cf8752883e2b57b348b785fcb483a6fc6f2a6c3ab36", + "loads": [ + 0, + 1, + 13, + 0, + 2, + 8, + 2, + 5, + 3, + 8, + 0, + 1, + 2, + 4, + 18, + 0, + 2, + 4, + 3, + 2, + 0, + 6, + 9, + 5, + 5, + 3, + 1, + 0, + 1, + 0, + 3, + 1, + 1, + 7, + 5, + 5, + 6, + 0, + 0, + 4, + 6, + 0, + 4, + 1, + 0, + 3, + 5, + 1, + 0, + 4, + 1, + 12, + 0, + 1, + 0, + 4, + 6, + 0, + 0, + 4, + 7, + 5, + 0, + 0 + ], + "weighted_loads": [ + 0.0, + 0.04528987407684326, + 0.7456219606101513, + 0.0, + 0.1347828172147274, + 0.5263163726776838, + 0.09583282843232155, + 0.2969396337866783, + 0.1332964412868023, + 0.37986859679222107, + 0.0, + 0.03165316581726074, + 0.12124736607074738, + 0.14000630006194115, + 1.1904393509030342, + 0.0, + 0.10781125351786613, + 0.13304172456264496, + 0.1298014633357525, + 0.0826164074242115, + 0.0, + 0.536174114793539, + 0.4086244869977236, + 0.36311112344264984, + 0.1652703583240509, + 0.27815255150198936, + 0.03863595798611641, + 0.0, + 0.044110726565122604, + 0.0, + 0.20341698452830315, + 0.029349789023399353, + 0.053291600197553635, + 0.4990831986069679, + 0.19149768352508545, + 0.2512323632836342, + 0.621580321341753, + 0.0, + 0.0, + 0.16668563708662987, + 0.6013612225651741, + 0.0, + 0.3079177737236023, + 0.03829574957489967, + 0.0, + 0.11675852909684181, + 0.7435876950621605, + 0.049571141600608826, + 0.0, + 0.30896924436092377, + 0.06032837927341461, + 1.029009148478508, + 0.0, + 0.09975887835025787, + 0.0, + 0.21050330251455307, + 0.23251430131495, + 0.0, + 0.0, + 0.20140185207128525, + 0.7271158695220947, + 0.2750209830701351, + 0.0, + 0.0 + ], + "unique_experts": 46, + "load_cv": 1.1090137837160214, + "normalized_load_entropy": 0.857906485801279, + "max_load_share": 0.08823529411764706 + }, + "full_input": { + "tokens": 75, + "top_k": 6, + "decisions": 450, + "ordered_route_sha256": "e3791a4262b0f76e1ce30ff9bdb8285cd1a5eb88a8e116593c265b25d25069bd", + "route_weight_sha256": "d42e3cf728c7ec618532dea677644f3ad7d82d3da40135074af2d7c6af90387c", + "loads": [ + 0, + 1, + 13, + 2, + 3, + 10, + 8, + 5, + 18, + 10, + 7, + 6, + 2, + 11, + 20, + 2, + 18, + 8, + 6, + 2, + 0, + 6, + 11, + 10, + 10, + 3, + 9, + 0, + 3, + 6, + 3, + 1, + 7, + 15, + 6, + 5, + 6, + 4, + 15, + 7, + 8, + 14, + 14, + 4, + 10, + 3, + 10, + 8, + 0, + 4, + 22, + 12, + 0, + 1, + 4, + 13, + 6, + 6, + 2, + 4, + 7, + 12, + 3, + 4 + ], + "weighted_loads": [ + 0.0, + 0.04528987407684326, + 0.7456219606101513, + 0.06281207501888275, + 0.18141160905361176, + 0.6239493172615767, + 0.47873102501034737, + 0.2969396337866783, + 1.4381167590618134, + 0.48171989619731903, + 0.5601822398602962, + 0.6998094134032726, + 0.12124736607074738, + 0.5054640732705593, + 1.2589403167366982, + 0.09858720749616623, + 2.7590564601123333, + 0.3568262793123722, + 0.22028299793601036, + 0.0826164074242115, + 0.0, + 0.536174114793539, + 0.5271083693951368, + 0.6761256568133831, + 0.3442044872790575, + 0.27815255150198936, + 0.7615335248410702, + 0.0, + 0.09384582377970219, + 0.7777210250496864, + 0.20341698452830315, + 0.029349789023399353, + 0.4380389340221882, + 1.0402195192873478, + 0.23020538315176964, + 0.2512323632836342, + 0.621580321341753, + 0.22794578224420547, + 1.5709200389683247, + 0.31978313997387886, + 0.8240345865488052, + 1.2977069020271301, + 1.1017897240817547, + 0.13449149765074253, + 1.2217114511877298, + 0.11675852909684181, + 1.1020093336701393, + 0.4473455511033535, + 0.0, + 0.30896924436092377, + 1.4517242331057787, + 1.029009148478508, + 0.0, + 0.09975887835025787, + 0.2065368928015232, + 0.9813985079526901, + 0.23251430131495, + 0.5329095982015133, + 0.04163798503577709, + 0.20140185207128525, + 0.7271158695220947, + 0.62032850086689, + 0.07755599077790976, + 0.15988097712397575 + ], + "unique_experts": 59, + "load_cv": 0.7377108403369285, + "normalized_load_entropy": 0.9307739777714094, + "max_load_share": 0.04888888888888889 + } + }, + "s0_period": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "7ed7accb2a70a14283f88aed61f728d7d11d5734e524e15d6b6a7a657d7088b5", + "route_weight_sha256": "fb3b77d195e7403a73481990bd6ccbf50ebc66665895df57bd2703700f8d0af1", + "loads": [ + 0, + 1, + 12, + 0, + 2, + 7, + 2, + 5, + 3, + 9, + 0, + 1, + 2, + 4, + 18, + 0, + 2, + 4, + 3, + 2, + 0, + 6, + 10, + 5, + 5, + 4, + 0, + 0, + 1, + 0, + 2, + 1, + 1, + 8, + 3, + 5, + 6, + 0, + 1, + 5, + 6, + 0, + 4, + 1, + 0, + 2, + 5, + 1, + 0, + 4, + 1, + 12, + 0, + 2, + 0, + 4, + 5, + 1, + 0, + 4, + 7, + 5, + 0, + 0 + ], + "weighted_loads": [ + 0.0, + 0.047366365790367126, + 0.717101264744997, + 0.0, + 0.13877321407198906, + 0.49834126606583595, + 0.10695513151586056, + 0.2978516221046448, + 0.13410476595163345, + 0.4297061190009117, + 0.0, + 0.030747808516025543, + 0.1240670271217823, + 0.14435788802802563, + 1.2014404274523258, + 0.0, + 0.10399318858981133, + 0.13590306416153908, + 0.12550000101327896, + 0.07453364878892899, + 0.0, + 0.5297794509679079, + 0.44621971622109413, + 0.37250979989767075, + 0.16765889339148998, + 0.3211960829794407, + 0.0, + 0.0, + 0.04846270754933357, + 0.0, + 0.15550583228468895, + 0.02911343425512314, + 0.05432593822479248, + 0.5629636347293854, + 0.12110215798020363, + 0.2498782854527235, + 0.6215242519974709, + 0.0, + 0.040422823280096054, + 0.2031862810254097, + 0.6007745191454887, + 0.0, + 0.31323133036494255, + 0.03766154870390892, + 0.0, + 0.08543172478675842, + 0.7540384754538536, + 0.047924503684043884, + 0.0, + 0.3127630054950714, + 0.05408656969666481, + 0.993079412728548, + 0.0, + 0.1368478201329708, + 0.0, + 0.21032090112566948, + 0.19445319846272469, + 0.036391835659742355, + 0.0, + 0.19970393925905228, + 0.7375948317348957, + 0.27525442466139793, + 0.0, + 0.0 + ], + "unique_experts": 47, + "load_cv": 1.104845849959279, + "normalized_load_entropy": 0.8605836058278507, + "max_load_share": 0.08823529411764706 + }, + "full_input": { + "tokens": 59, + "top_k": 6, + "decisions": 354, + "ordered_route_sha256": "6828a1ae668231d4a905bdf1800f0df9ec2137b322912d6274ae8ad1a82b711e", + "route_weight_sha256": "627afaff50ca333703cdf8ac9165f0fae03a7636cb8a0e3dd0378ca7b862d13c", + "loads": [ + 0, + 1, + 12, + 3, + 2, + 8, + 6, + 5, + 11, + 9, + 1, + 5, + 2, + 9, + 18, + 0, + 17, + 6, + 6, + 2, + 0, + 6, + 14, + 8, + 8, + 4, + 4, + 1, + 3, + 0, + 2, + 1, + 4, + 9, + 5, + 5, + 6, + 0, + 11, + 8, + 6, + 11, + 9, + 3, + 3, + 2, + 7, + 4, + 0, + 4, + 17, + 12, + 0, + 3, + 0, + 11, + 5, + 1, + 3, + 4, + 7, + 11, + 2, + 7 + ], + "weighted_loads": [ + 0.0, + 0.047366365790367126, + 0.717101264744997, + 0.11060141026973724, + 0.13877321407198906, + 0.5399090945720673, + 0.4607862662523985, + 0.2978516221046448, + 0.7868052572011948, + 0.4297061190009117, + 0.03316297009587288, + 0.6073249354958534, + 0.1240670271217823, + 0.4328650273382664, + 1.2014404274523258, + 0.0, + 2.3310157358646393, + 0.2538931742310524, + 0.2110290303826332, + 0.07453364878892899, + 0.0, + 0.5297794509679079, + 0.662516538053751, + 0.610509604215622, + 0.2906637229025364, + 0.3211960829794407, + 0.3708376884460449, + 0.034671708941459656, + 0.09861894696950912, + 0.0, + 0.15550583228468895, + 0.02911343425512314, + 0.1693539321422577, + 0.6123947650194168, + 0.22188540920615196, + 0.2498782854527235, + 0.6215242519974709, + 0.0, + 0.8972851894795895, + 0.34882593527436256, + 0.6007745191454887, + 0.9621788635849953, + 0.6602911949157715, + 0.09660753048956394, + 0.6426219195127487, + 0.08543172478675842, + 0.9788145050406456, + 0.21232501044869423, + 0.0, + 0.3127630054950714, + 1.3364711999893188, + 0.993079412728548, + 0.0, + 0.16817672923207283, + 0.0, + 0.8690704442560673, + 0.19445319846272469, + 0.036391835659742355, + 0.06998162902891636, + 0.19970393925905228, + 0.7375948317348957, + 0.5735036730766296, + 0.04285083245486021, + 0.26880551502108574 + ], + "unique_experts": 56, + "load_cv": 0.8085020150345821, + "normalized_load_entropy": 0.9158103763293237, + "max_load_share": 0.05084745762711865 + } + }, + "s1_period": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "15ec1b5b4e4543b2745a743b21470c61a7e576f9ff5dcb19ea6ff8f17b782669", + "route_weight_sha256": "8232bea7e1dac08a2a0660a38c3fca40a526996d948b3456c8fecd9d79b1ff8e", + "loads": [ + 0, + 1, + 12, + 0, + 2, + 8, + 2, + 5, + 3, + 8, + 0, + 1, + 2, + 4, + 18, + 0, + 2, + 4, + 3, + 2, + 0, + 6, + 9, + 5, + 5, + 3, + 2, + 0, + 1, + 0, + 3, + 1, + 1, + 7, + 4, + 6, + 6, + 0, + 0, + 4, + 6, + 0, + 4, + 1, + 0, + 3, + 5, + 1, + 0, + 4, + 1, + 12, + 0, + 1, + 0, + 4, + 6, + 0, + 0, + 4, + 7, + 5, + 0, + 0 + ], + "weighted_loads": [ + 0.0, + 0.04464414343237877, + 0.6843049228191376, + 0.0, + 0.1355360969901085, + 0.5197301469743252, + 0.09919904917478561, + 0.2984688803553581, + 0.13652073591947556, + 0.3778745271265507, + 0.0, + 0.031356919556856155, + 0.12327630817890167, + 0.1421400886029005, + 1.190148364752531, + 0.0, + 0.1086585745215416, + 0.13192078471183777, + 0.13250821083784103, + 0.08295415341854095, + 0.0, + 0.5262780208140612, + 0.4069723542779684, + 0.36199867725372314, + 0.16750719770789146, + 0.28279075026512146, + 0.07523578032851219, + 0.0, + 0.044115617871284485, + 0.0, + 0.20406704023480415, + 0.029598388820886612, + 0.056515611708164215, + 0.5007644295692444, + 0.157258503139019, + 0.2911687605082989, + 0.6138565801084042, + 0.0, + 0.0, + 0.16496680676937103, + 0.6031795293092728, + 0.0, + 0.3078843876719475, + 0.03851354867219925, + 0.0, + 0.1131330281496048, + 0.7338742017745972, + 0.05008668825030327, + 0.0, + 0.30956605821847916, + 0.05800747871398926, + 1.025823850184679, + 0.0, + 0.10118357837200165, + 0.0, + 0.21769725903868675, + 0.2336866520345211, + 0.0, + 0.0, + 0.19440394639968872, + 0.7255435846745968, + 0.2730771191418171, + 0.0, + 0.0 + ], + "unique_experts": 46, + "load_cv": 1.0950589808190747, + "normalized_load_entropy": 0.8601905317749121, + "max_load_share": 0.08823529411764706 + }, + "full_input": { + "tokens": 75, + "top_k": 6, + "decisions": 450, + "ordered_route_sha256": "2d3205bbab970fcf88e9d5ad69b48cf90d70ba98b94eaade9bff1d04f5f34372", + "route_weight_sha256": "4e469db4498be564a4dcd7a6da8f6e79386f75f8932da045a1ef3a298ff5aada", + "loads": [ + 0, + 1, + 12, + 2, + 3, + 9, + 9, + 5, + 19, + 10, + 7, + 6, + 2, + 10, + 20, + 2, + 18, + 8, + 6, + 2, + 0, + 6, + 12, + 9, + 9, + 3, + 10, + 0, + 3, + 6, + 3, + 1, + 8, + 15, + 5, + 6, + 6, + 4, + 16, + 7, + 8, + 16, + 14, + 4, + 10, + 3, + 8, + 7, + 0, + 4, + 24, + 12, + 0, + 1, + 4, + 13, + 6, + 6, + 2, + 4, + 7, + 11, + 3, + 3 + ], + "weighted_loads": [ + 0.0, + 0.04464414343237877, + 0.6843049228191376, + 0.06281207501888275, + 0.18216488882899284, + 0.5639202408492565, + 0.5138756260275841, + 0.2984688803553581, + 1.503244288265705, + 0.47972582653164864, + 0.5599797926843166, + 0.6464337669312954, + 0.12327630817890167, + 0.47742932103574276, + 1.258649330586195, + 0.09858720749616623, + 2.6994317546486855, + 0.348253283649683, + 0.22324995324015617, + 0.08295415341854095, + 0.0, + 0.5262780208140612, + 0.5581371206790209, + 0.6392022930085659, + 0.3140894006937742, + 0.28279075026512146, + 0.7931808121502399, + 0.0, + 0.09385071508586407, + 0.7777210250496864, + 0.20406704023480415, + 0.029598388820886612, + 0.47396328300237656, + 1.0419007502496243, + 0.1942085325717926, + 0.2911687605082989, + 0.6138565801084042, + 0.22794578224420547, + 1.6587615571916103, + 0.32079416513442993, + 0.8258528932929039, + 1.404211400076747, + 1.0952854491770267, + 0.13234599120914936, + 1.2230432126671076, + 0.1131330281496048, + 1.0113418065011501, + 0.3809188976883888, + 0.0, + 0.30956605821847916, + 1.8820581901818514, + 1.025823850184679, + 0.0, + 0.10118357837200165, + 0.2065368928015232, + 0.9885924644768238, + 0.2336866520345211, + 0.5329095982015133, + 0.04163798503577709, + 0.19440394639968872, + 0.7255435846745968, + 0.565118245780468, + 0.07755599077790976, + 0.09100686386227608 + ], + "unique_experts": 59, + "load_cv": 0.7609091378406377, + "normalized_load_entropy": 0.9283881867325251, + "max_load_share": 0.05333333333333334 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 34, + "ordered_topk_exact_tokens": 27, + "set_exact_tokens": 30, + "mean_set_jaccard": 0.9663865546218489, + "mean_token_weighted_tv": 0.008888794218792635, + "aggregate_load_tv": 0.0196078431372549 + }, + "system_bos": { + "tokens": 34, + "ordered_topk_exact_tokens": 23, + "set_exact_tokens": 28, + "mean_set_jaccard": 0.9495798319327731, + "mean_token_weighted_tv": 0.012307435657609911, + "aggregate_load_tv": 0.024509803921568624 + }, + "system_x": { + "tokens": 34, + "ordered_topk_exact_tokens": 20, + "set_exact_tokens": 27, + "mean_set_jaccard": 0.9411764705882353, + "mean_token_weighted_tv": 0.01609405699898215, + "aggregate_load_tv": 0.029411764705882356 + }, + "system_period": { + "tokens": 34, + "ordered_topk_exact_tokens": 19, + "set_exact_tokens": 24, + "mean_set_jaccard": 0.9159663865546219, + "mean_token_weighted_tv": 0.01938368396504837, + "aggregate_load_tv": 0.0392156862745098 + }, + "bos_at_s0": { + "tokens": 34, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 21, + "mean_set_jaccard": 0.8732492997198879, + "mean_token_weighted_tv": 0.023411851841956377, + "aggregate_load_tv": 0.06372549019607843 + }, + "bos_at_s1": { + "tokens": 34, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 21, + "mean_set_jaccard": 0.8732492997198881, + "mean_token_weighted_tv": 0.025496789445991024, + "aggregate_load_tv": 0.06372549019607843 + }, + "x_at_s0": { + "tokens": 34, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 18, + "mean_set_jaccard": 0.8529411764705883, + "mean_token_weighted_tv": 0.027805821750970447, + "aggregate_load_tv": 0.06862745098039216 + }, + "x_at_s1": { + "tokens": 34, + "ordered_topk_exact_tokens": 16, + "set_exact_tokens": 22, + "mean_set_jaccard": 0.8865546218487395, + "mean_token_weighted_tv": 0.025212756467654425, + "aggregate_load_tv": 0.058823529411764705 + }, + "period_at_s0": { + "tokens": 34, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 21, + "mean_set_jaccard": 0.8781512605042017, + "mean_token_weighted_tv": 0.024395116988350365, + "aggregate_load_tv": 0.04901960784313726 + }, + "period_at_s1": { + "tokens": 34, + "ordered_topk_exact_tokens": 16, + "set_exact_tokens": 23, + "mean_set_jaccard": 0.8949579831932772, + "mean_token_weighted_tv": 0.024375678259221947, + "aggregate_load_tv": 0.05392156862745098 + } + } + }, + "layer_08": { + "layer": 8, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "5440a897c61668e33cde3ceeb3512e38f9ff02653b3f049692fd646f1abbcacf", + "route_weight_sha256": "9a52f5c82ea226a543dca3179c1320c029d7b6b502a15494f105e2cbb6d9e2cc", + "loads": [ + 3, + 16, + 0, + 7, + 0, + 1, + 2, + 21, + 0, + 0, + 6, + 4, + 4, + 5, + 0, + 1, + 0, + 7, + 2, + 8, + 7, + 2, + 4, + 0, + 4, + 0, + 0, + 0, + 2, + 0, + 5, + 0, + 7, + 4, + 2, + 2, + 6, + 18, + 0, + 4, + 0, + 1, + 4, + 0, + 11, + 5, + 1, + 1, + 5, + 1, + 0, + 1, + 1, + 2, + 1, + 2, + 0, + 0, + 0, + 3, + 8, + 0, + 3, + 0 + ], + "weighted_loads": [ + 0.11000721156597137, + 0.8808257803320885, + 0.0, + 0.5398029126226902, + 0.0, + 0.032912008464336395, + 0.11073938384652138, + 1.7080338969826698, + 0.0, + 0.0, + 0.5046292953193188, + 0.19533898681402206, + 0.4181860461831093, + 0.33668168261647224, + 0.0, + 0.062148310244083405, + 0.0, + 0.645769014954567, + 0.06617828644812107, + 0.3821083977818489, + 0.5844716355204582, + 0.14455505087971687, + 0.1771901473402977, + 0.0, + 0.18785382434725761, + 0.0, + 0.0, + 0.0, + 0.09453893825411797, + 0.0, + 0.270093459635973, + 0.0, + 0.6548258736729622, + 0.1703387126326561, + 0.20672909170389175, + 0.10817410051822662, + 0.2578456215560436, + 1.2498649060726166, + 0.0, + 0.1846177577972412, + 0.0, + 0.03678828105330467, + 0.2896956689655781, + 0.0, + 0.45157491602003574, + 0.23036972805857658, + 0.03799593448638916, + 0.04452553763985634, + 0.27218782901763916, + 0.04592989757657051, + 0.0, + 0.07646041363477707, + 0.03208449110388756, + 0.12405147030949593, + 0.032240334898233414, + 0.07674464583396912, + 0.0, + 0.0, + 0.0, + 0.16376657411456108, + 0.4854174852371216, + 0.0, + 0.13692041486501694, + 0.0 + ], + "unique_experts": 43, + "load_cv": 1.340092441164061, + "normalized_load_entropy": 0.8214828380901593, + "max_load_share": 0.10294117647058823 + }, + "full_input": { + "tokens": 59, + "top_k": 6, + "decisions": 354, + "ordered_route_sha256": "30e1a98581c446e7504f5a6847d7d347cbb66f815b00e15f740536492a47425f", + "route_weight_sha256": "aa721aaf0e12786c03dcf7cffd83ab397cd26eb7aed71ee079a6dce8cd446e8e", + "loads": [ + 3, + 22, + 2, + 9, + 3, + 1, + 7, + 22, + 8, + 0, + 7, + 7, + 10, + 12, + 0, + 1, + 0, + 10, + 2, + 8, + 7, + 2, + 6, + 0, + 4, + 11, + 0, + 0, + 2, + 0, + 9, + 0, + 11, + 18, + 2, + 2, + 6, + 18, + 0, + 12, + 6, + 1, + 4, + 0, + 11, + 11, + 7, + 5, + 6, + 4, + 3, + 1, + 12, + 2, + 5, + 10, + 0, + 0, + 5, + 3, + 8, + 0, + 4, + 2 + ], + "weighted_loads": [ + 0.11000721156597137, + 1.2507345490157604, + 0.038984570652246475, + 0.6305359862744808, + 0.11592249060049653, + 0.032912008464336395, + 0.5482597462832928, + 1.7532275095582008, + 0.5231363251805305, + 0.0, + 0.5683249793946743, + 0.31369488406926394, + 0.7561347261071205, + 0.8448161743581295, + 0.0, + 0.062148310244083405, + 0.0, + 0.782336875796318, + 0.06617828644812107, + 0.3821083977818489, + 0.5844716355204582, + 0.14455505087971687, + 0.25042807683348656, + 0.0, + 0.18785382434725761, + 0.7736368849873543, + 0.0, + 0.0, + 0.09453893825411797, + 0.0, + 0.4143369481898844, + 0.0, + 0.8265401758253574, + 1.3598931021988392, + 0.20672909170389175, + 0.10817410051822662, + 0.2578456215560436, + 1.2498649060726166, + 0.0, + 0.4849576852284372, + 0.3594466298818588, + 0.03678828105330467, + 0.2896956689655781, + 0.0, + 0.45157491602003574, + 0.7444689013063908, + 0.6454429738223553, + 0.16548308730125427, + 0.31140289455652237, + 0.1900758408010006, + 0.17050263285636902, + 0.07646041363477707, + 0.6888541113585234, + 0.12405147030949593, + 1.6131362970918417, + 0.576663987711072, + 0.0, + 0.0, + 0.15661899303086102, + 0.16376657411456108, + 0.4854174852371216, + 0.0, + 0.18314654380083084, + 0.16744542866945267 + ], + "unique_experts": 51, + "load_cv": 0.9662008076823697, + "normalized_load_entropy": 0.8846821777860375, + "max_load_share": 0.062146892655367235 + } + }, + "s1_eos": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "ce3357195b2564698a2cd2b9c4dc4484a968136564f786ad780b9594351aca99", + "route_weight_sha256": "48771ad1e114df08c43b12a93c845aa69a99986d0eb526d786ffe1974c1e6f17", + "loads": [ + 3, + 16, + 0, + 7, + 0, + 1, + 2, + 21, + 0, + 0, + 6, + 4, + 4, + 5, + 0, + 1, + 0, + 7, + 2, + 8, + 7, + 2, + 4, + 0, + 4, + 0, + 0, + 0, + 2, + 0, + 5, + 0, + 7, + 4, + 2, + 2, + 6, + 18, + 0, + 4, + 0, + 1, + 4, + 0, + 11, + 6, + 1, + 1, + 5, + 1, + 0, + 1, + 0, + 2, + 1, + 2, + 0, + 0, + 0, + 4, + 7, + 0, + 3, + 0 + ], + "weighted_loads": [ + 0.1106455810368061, + 0.87349883466959, + 0.0, + 0.542868047952652, + 0.0, + 0.032356858253479004, + 0.10929696261882782, + 1.6909191496670246, + 0.0, + 0.0, + 0.5051051527261734, + 0.19635512307286263, + 0.42025037854909897, + 0.3374158702790737, + 0.0, + 0.06310026347637177, + 0.0, + 0.6338771842420101, + 0.06516452133655548, + 0.39014059863984585, + 0.5888684503734112, + 0.1465679332613945, + 0.1765587367117405, + 0.0, + 0.1908831037580967, + 0.0, + 0.0, + 0.0, + 0.09025176987051964, + 0.0, + 0.2676335945725441, + 0.0, + 0.664253581315279, + 0.18165764771401882, + 0.21456347405910492, + 0.11423053964972496, + 0.253597617149353, + 1.249140627682209, + 0.0, + 0.18149175122380257, + 0.0, + 0.03795879706740379, + 0.28747719898819923, + 0.0, + 0.45957101136446, + 0.2678225263953209, + 0.037501830607652664, + 0.04466346651315689, + 0.27394402027130127, + 0.04528021439909935, + 0.0, + 0.07733481377363205, + 0.0, + 0.12168904393911362, + 0.03521965444087982, + 0.07751994021236897, + 0.0, + 0.0, + 0.0, + 0.19430143386125565, + 0.449439849704504, + 0.0, + 0.13848787546157837, + 0.0 + ], + "unique_experts": 42, + "load_cv": 1.3412395352676618, + "normalized_load_entropy": 0.8191979267485499, + "max_load_share": 0.10294117647058823 + }, + "full_input": { + "tokens": 75, + "top_k": 6, + "decisions": 450, + "ordered_route_sha256": "af4109fc727122eb44449ff8198c6dbd417526f4a95ffdd55bd7ba42058d8190", + "route_weight_sha256": "6a78d6c28e3cf7302678226fe00c55cafd95753923a3041ad5c3135f9fd6a780", + "loads": [ + 4, + 21, + 10, + 9, + 2, + 2, + 13, + 21, + 13, + 0, + 9, + 9, + 13, + 12, + 0, + 1, + 0, + 21, + 3, + 8, + 7, + 2, + 5, + 4, + 4, + 11, + 0, + 2, + 3, + 0, + 9, + 0, + 11, + 23, + 2, + 2, + 6, + 18, + 6, + 10, + 13, + 1, + 6, + 0, + 11, + 18, + 15, + 5, + 9, + 6, + 4, + 1, + 9, + 8, + 5, + 13, + 0, + 0, + 3, + 6, + 7, + 4, + 5, + 5 + ], + "weighted_loads": [ + 0.14953355491161346, + 1.15410216152668, + 0.6202357746660709, + 0.646531268954277, + 0.09229090064764023, + 0.07708844542503357, + 1.055496133863926, + 1.6909191496670246, + 0.8365980312228203, + 0.0, + 0.6603921353816986, + 0.3697500699199736, + 0.9559157975018024, + 0.8198742642998695, + 0.0, + 0.06310026347637177, + 0.0, + 1.5999884009361267, + 0.11152466014027596, + 0.39014059863984585, + 0.5888684503734112, + 0.1465679332613945, + 0.21531111374497414, + 0.1893187928944826, + 0.1908831037580967, + 1.1123641952872276, + 0.0, + 0.1193368062376976, + 0.13157280161976814, + 0.0, + 0.41322297137230635, + 0.0, + 0.8099765703082085, + 1.6338572762906551, + 0.21456347405910492, + 0.11423053964972496, + 0.253597617149353, + 1.249140627682209, + 0.3906531408429146, + 0.3982057706452906, + 0.6245661303400993, + 0.03795879706740379, + 0.457035169005394, + 0.0, + 0.45957101136446, + 1.3464328832924366, + 1.023995392024517, + 0.15755107626318932, + 0.6203197576105595, + 0.36295894533395767, + 0.22009092941880226, + 0.07733481377363205, + 0.5197326391935349, + 0.8013934642076492, + 1.620936056599021, + 0.8123014587908983, + 0.0, + 0.0, + 0.1008406849578023, + 0.2664298564195633, + 0.449439849704504, + 0.18716509267687798, + 0.2368307113647461, + 0.2925117202103138 + ], + "unique_experts": 55, + "load_cv": 0.8458818176215376, + "normalized_load_entropy": 0.9082349476109774, + "max_load_share": 0.051111111111111114 + } + }, + "s0_bos": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "3c47954d4bcc328c26c014999c30473cbe85cebb27a44509c7de671e046f6d80", + "route_weight_sha256": "34b06143048c280fe29282e231e89f254fcafd76a69732645bf43c7dc3045176", + "loads": [ + 3, + 15, + 0, + 7, + 0, + 1, + 3, + 20, + 0, + 0, + 7, + 4, + 4, + 5, + 0, + 1, + 0, + 7, + 2, + 8, + 7, + 2, + 4, + 0, + 4, + 0, + 0, + 0, + 2, + 0, + 5, + 0, + 7, + 2, + 2, + 2, + 5, + 19, + 0, + 3, + 1, + 1, + 4, + 0, + 11, + 3, + 1, + 1, + 5, + 1, + 0, + 1, + 0, + 2, + 2, + 3, + 0, + 0, + 0, + 4, + 9, + 0, + 4, + 0 + ], + "weighted_loads": [ + 0.10910004377365112, + 0.8529707454144955, + 0.0, + 0.5523911453783512, + 0.0, + 0.033916350454092026, + 0.158372450619936, + 1.6791444085538387, + 0.0, + 0.0, + 0.5586230605840683, + 0.19182661175727844, + 0.41754839569330215, + 0.34301381930708885, + 0.0, + 0.060325898230075836, + 0.0, + 0.640946377068758, + 0.06496253609657288, + 0.38150371611118317, + 0.6028713248670101, + 0.14754289016127586, + 0.17973318323493004, + 0.0, + 0.18805605918169022, + 0.0, + 0.0, + 0.0, + 0.08987991884350777, + 0.0, + 0.2674093060195446, + 0.0, + 0.6585598886013031, + 0.10634561255574226, + 0.22262709587812424, + 0.1206200048327446, + 0.203659575432539, + 1.3124752901494503, + 0.0, + 0.14528777077794075, + 0.03589800372719765, + 0.03756719455122948, + 0.2972496375441551, + 0.0, + 0.45008149184286594, + 0.13650432974100113, + 0.04074305295944214, + 0.04131387174129486, + 0.27705349773168564, + 0.04266509413719177, + 0.0, + 0.07705283910036087, + 0.0, + 0.12890386953949928, + 0.06990867108106613, + 0.11894347704946995, + 0.0, + 0.0, + 0.0, + 0.19155536592006683, + 0.5207266323268414, + 0.0, + 0.17776024341583252, + 0.0 + ], + "unique_experts": 43, + "load_cv": 1.3262499273008512, + "normalized_load_entropy": 0.8238306631342405, + "max_load_share": 0.09803921568627451 + }, + "full_input": { + "tokens": 59, + "top_k": 6, + "decisions": 354, + "ordered_route_sha256": "3e68f923783a646766f2c6460bae5aba46c58325a309c26b4f50fd861fb182ec", + "route_weight_sha256": "09d9c8bd95f5db6aa9f49398ca4e57c47ecc6095fb41f062c49b672498047856", + "loads": [ + 3, + 21, + 2, + 9, + 1, + 1, + 8, + 21, + 8, + 0, + 8, + 7, + 10, + 12, + 0, + 2, + 0, + 10, + 2, + 8, + 7, + 2, + 6, + 0, + 5, + 11, + 0, + 0, + 2, + 0, + 9, + 0, + 11, + 17, + 2, + 2, + 5, + 19, + 1, + 10, + 8, + 1, + 4, + 0, + 11, + 10, + 7, + 4, + 6, + 4, + 3, + 1, + 11, + 2, + 6, + 11, + 0, + 0, + 3, + 4, + 9, + 0, + 5, + 2 + ], + "weighted_loads": [ + 0.10910004377365112, + 1.2228795140981674, + 0.038984570652246475, + 0.645628098398447, + 0.0608762763440609, + 0.033916350454092026, + 0.5901235453784466, + 1.7243380211293697, + 0.5300933383405209, + 0.0, + 0.6246870830655098, + 0.31083301920443773, + 0.7554970756173134, + 0.8538229800760746, + 0.0, + 0.10664142295718193, + 0.0, + 0.7803560122847557, + 0.06496253609657288, + 0.38150371611118317, + 0.6028713248670101, + 0.14754289016127586, + 0.2529711127281189, + 0.0, + 0.23567086085677147, + 0.7736368849873543, + 0.0, + 0.0, + 0.08987991884350777, + 0.0, + 0.4632102809846401, + 0.0, + 0.8302741907536983, + 1.379191368818283, + 0.22262709587812424, + 0.1206200048327446, + 0.203659575432539, + 1.3124752901494503, + 0.040638282895088196, + 0.46856354735791683, + 0.46857913956046104, + 0.03756719455122948, + 0.2972496375441551, + 0.0, + 0.45008149184286594, + 0.7074855305254459, + 0.6265115737915039, + 0.15289979800581932, + 0.31626856327056885, + 0.2000892087817192, + 0.17050263285636902, + 0.07705283910036087, + 0.6567696202546358, + 0.12890386953949928, + 0.779487507417798, + 0.6386916860938072, + 0.0, + 0.0, + 0.11107692494988441, + 0.19155536592006683, + 0.5207266323268414, + 0.0, + 0.22398637235164642, + 0.16744542866945267 + ], + "unique_experts": 52, + "load_cv": 0.9448212987330609, + "normalized_load_entropy": 0.8881952880140564, + "max_load_share": 0.059322033898305086 + } + }, + "s1_bos": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "88f58e04e918607eeb61d0da10697feba7f6f4fb887a71cd5117531deab6be42", + "route_weight_sha256": "7009089b7d0814ab1914819cb69ecc114f77f3ea54758e45c2de3ce70ca0cd4f", + "loads": [ + 3, + 15, + 0, + 7, + 0, + 1, + 3, + 19, + 0, + 0, + 7, + 4, + 4, + 5, + 0, + 1, + 1, + 7, + 3, + 7, + 7, + 2, + 5, + 0, + 4, + 1, + 0, + 0, + 2, + 0, + 5, + 0, + 6, + 2, + 2, + 3, + 5, + 19, + 0, + 2, + 1, + 1, + 4, + 0, + 11, + 3, + 1, + 1, + 5, + 1, + 0, + 1, + 0, + 2, + 2, + 3, + 0, + 0, + 0, + 3, + 9, + 0, + 4, + 0 + ], + "weighted_loads": [ + 0.10994354635477066, + 0.8538002669811249, + 0.0, + 0.5507838763296604, + 0.0, + 0.033539511263370514, + 0.156618844717741, + 1.6494489274919033, + 0.0, + 0.0, + 0.5577645674347878, + 0.1925639696419239, + 0.413576602935791, + 0.33194462582468987, + 0.0, + 0.0634474828839302, + 0.03592271730303764, + 0.6371959447860718, + 0.09987609088420868, + 0.3499002456665039, + 0.6119118556380272, + 0.14618051424622536, + 0.2302216775715351, + 0.0, + 0.18526429682970047, + 0.03131217882037163, + 0.0, + 0.0, + 0.08909754082560539, + 0.0, + 0.2671339809894562, + 0.0, + 0.6099429242312908, + 0.10335023328661919, + 0.22173232585191727, + 0.15449699759483337, + 0.20156063325703144, + 1.310573235154152, + 0.0, + 0.10833270847797394, + 0.03693104162812233, + 0.038163915276527405, + 0.2984156645834446, + 0.0, + 0.4533038903027773, + 0.13971959799528122, + 0.044911328703165054, + 0.04440281540155411, + 0.2785741612315178, + 0.0425088070333004, + 0.0, + 0.07689043134450912, + 0.0, + 0.12486445531249046, + 0.07050139829516411, + 0.12080746330320835, + 0.0, + 0.0, + 0.0, + 0.16719697415828705, + 0.5179558843374252, + 0.0, + 0.17495647817850113, + 0.0 + ], + "unique_experts": 45, + "load_cv": 1.2921851286741495, + "normalized_load_entropy": 0.8328982682479892, + "max_load_share": 0.09313725490196079 + }, + "full_input": { + "tokens": 75, + "top_k": 6, + "decisions": 450, + "ordered_route_sha256": "b96156cc2380e05357ab06f1538a76123437cfb33ab58d4b3430d210da5623f3", + "route_weight_sha256": "d228e3bf083017e09220180c4c67c8349ef7ae2ec654a841d88f04a527ade606", + "loads": [ + 4, + 20, + 10, + 9, + 3, + 2, + 14, + 19, + 13, + 0, + 10, + 8, + 13, + 12, + 0, + 1, + 1, + 22, + 4, + 7, + 7, + 2, + 6, + 4, + 4, + 12, + 0, + 2, + 3, + 0, + 9, + 0, + 10, + 23, + 2, + 3, + 5, + 19, + 6, + 7, + 14, + 1, + 6, + 0, + 11, + 16, + 15, + 4, + 9, + 7, + 4, + 1, + 9, + 8, + 5, + 14, + 0, + 0, + 2, + 4, + 9, + 4, + 6, + 5 + ], + "weighted_loads": [ + 0.14883152022957802, + 1.1344035938382149, + 0.6202357746660709, + 0.6564991734921932, + 0.1287124752998352, + 0.07827109843492508, + 1.0999338142573833, + 1.6494489274919033, + 0.8517554365098476, + 0.0, + 0.7142387703061104, + 0.3620096454396844, + 0.9492420218884945, + 0.8180642351508141, + 0.0, + 0.0634474828839302, + 0.03592271730303764, + 1.6512220576405525, + 0.14623622968792915, + 0.3499002456665039, + 0.6119118556380272, + 0.14618051424622536, + 0.26897405460476875, + 0.1893187928944826, + 0.18526429682970047, + 1.1436763741075993, + 0.0, + 0.1193368062376976, + 0.1304185725748539, + 0.0, + 0.45186322927474976, + 0.0, + 0.7556659132242203, + 1.6760419886559248, + 0.22173232585191727, + 0.15449699759483337, + 0.20156063325703144, + 1.310573235154152, + 0.3906531408429146, + 0.3390763942152262, + 0.7062686197459698, + 0.038163915276527405, + 0.46797363460063934, + 0.0, + 0.4533038903027773, + 1.2936685495078564, + 1.0210152752697468, + 0.14820769801735878, + 0.624949898570776, + 0.414607010781765, + 0.22009092941880226, + 0.07689043134450912, + 0.5197326391935349, + 0.8045688755810261, + 0.7417853306978941, + 0.8723395261913538, + 0.0, + 0.0, + 0.09793615341186523, + 0.2001590132713318, + 0.5179558843374252, + 0.18716509267687798, + 0.27329931408166885, + 0.2925117202103138 + ], + "unique_experts": 56, + "load_cv": 0.8364888404796048, + "normalized_load_entropy": 0.9108639526699821, + "max_load_share": 0.051111111111111114 + } + }, + "s0_x": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "c0dec39fc3c0f13100c919bcd36b03967eecce121b6d4d6c3e041c991d3ff3ef", + "route_weight_sha256": "d0ec0227e0f75b6f7a995ddd710ac0d05299a6168cbc0d77baedca0dcd58fcea", + "loads": [ + 2, + 15, + 0, + 7, + 0, + 1, + 2, + 21, + 0, + 0, + 6, + 4, + 4, + 5, + 0, + 1, + 0, + 7, + 2, + 8, + 7, + 2, + 3, + 0, + 4, + 0, + 0, + 0, + 2, + 0, + 5, + 0, + 7, + 4, + 2, + 2, + 4, + 19, + 0, + 3, + 0, + 1, + 4, + 0, + 10, + 7, + 1, + 1, + 5, + 1, + 0, + 1, + 0, + 2, + 2, + 1, + 0, + 0, + 0, + 4, + 9, + 1, + 5, + 0 + ], + "weighted_loads": [ + 0.08395635336637497, + 0.8684044927358627, + 0.0, + 0.5498150587081909, + 0.0, + 0.032206617295742035, + 0.10689390078186989, + 1.7095739543437958, + 0.0, + 0.0, + 0.5153979286551476, + 0.19551756978034973, + 0.4127328172326088, + 0.33792291581630707, + 0.0, + 0.05714293569326401, + 0.0, + 0.6554204002022743, + 0.0674920342862606, + 0.37972945161163807, + 0.5895579569041729, + 0.14509160444140434, + 0.14005107432603836, + 0.0, + 0.18576890975236893, + 0.0, + 0.0, + 0.0, + 0.08433441072702408, + 0.0, + 0.2679530456662178, + 0.0, + 0.6628903932869434, + 0.17152582667768002, + 0.22506732493638992, + 0.11722470447421074, + 0.171408262103796, + 1.2963182721287012, + 0.0, + 0.14880241081118584, + 0.0, + 0.038810327649116516, + 0.2903291694819927, + 0.0, + 0.4187925662845373, + 0.30595851317048073, + 0.050104137510061264, + 0.0408400222659111, + 0.28643158078193665, + 0.04166501387953758, + 0.0, + 0.0718928873538971, + 0.0, + 0.12851711735129356, + 0.07088343799114227, + 0.05311432108283043, + 0.0, + 0.0, + 0.0, + 0.19271092675626278, + 0.5286493077874184, + 0.03642210364341736, + 0.2024018969386816, + 0.0 + ], + "unique_experts": 43, + "load_cv": 1.345818134580174, + "normalized_load_entropy": 0.8203905082140551, + "max_load_share": 0.10294117647058823 + }, + "full_input": { + "tokens": 59, + "top_k": 6, + "decisions": 354, + "ordered_route_sha256": "e2569bdf920c2c1c8dd04e311e9c69cd5260adf9e2e04ee9de18531f4ccddcd5", + "route_weight_sha256": "4071caeaa9510caa479bb9d159e84733e0fb95d8b5b268fc01fad2bc96f7f4bb", + "loads": [ + 2, + 22, + 3, + 9, + 2, + 1, + 8, + 22, + 9, + 0, + 7, + 7, + 10, + 13, + 0, + 1, + 0, + 10, + 2, + 8, + 7, + 2, + 5, + 0, + 4, + 12, + 0, + 0, + 2, + 0, + 8, + 0, + 12, + 18, + 2, + 2, + 4, + 19, + 0, + 9, + 6, + 1, + 4, + 0, + 10, + 13, + 7, + 4, + 6, + 5, + 4, + 1, + 11, + 2, + 4, + 9, + 0, + 0, + 3, + 4, + 9, + 1, + 6, + 2 + ], + "weighted_loads": [ + 0.08395635336637497, + 1.2914297617971897, + 0.07908514514565468, + 0.6451885141432285, + 0.10205066204071045, + 0.032206617295742035, + 0.5691306553781033, + 1.7547675669193268, + 0.5994484312832355, + 0.0, + 0.5777318179607391, + 0.30751747731119394, + 0.75068149715662, + 0.9356873705983162, + 0.0, + 0.05714293569326401, + 0.0, + 0.7895030938088894, + 0.0674920342862606, + 0.37972945161163807, + 0.5895579569041729, + 0.14509160444140434, + 0.21328900381922722, + 0.0, + 0.18576890975236893, + 0.87398312240839, + 0.0, + 0.0, + 0.08433441072702408, + 0.0, + 0.3992072716355324, + 0.0, + 0.8768048770725727, + 1.2531859297305346, + 0.22506732493638992, + 0.11722470447421074, + 0.171408262103796, + 1.2963182721287012, + 0.0, + 0.4007235746830702, + 0.3718107044696808, + 0.038810327649116516, + 0.2903291694819927, + 0.0, + 0.4187925662845373, + 0.8616236969828606, + 0.6517674960196018, + 0.15242594853043556, + 0.32564664632081985, + 0.2605699263513088, + 0.22377359122037888, + 0.0718928873538971, + 0.6567696202546358, + 0.12851711735129356, + 0.6964296977967024, + 0.5601070504635572, + 0.0, + 0.0, + 0.11107692494988441, + 0.19271092675626278, + 0.5286493077874184, + 0.03642210364341736, + 0.2486280258744955, + 0.16744542866945267 + ], + "unique_experts": 52, + "load_cv": 0.9756687563758303, + "normalized_load_entropy": 0.8846869272780813, + "max_load_share": 0.062146892655367235 + } + }, + "s1_x": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "371fdcb57a2ae7a4ff13d23ac80283113f87aa7b43095755f1fdb53c245d8b10", + "route_weight_sha256": "455730755b71550814b6ff845f0525b5065ba5802bf336c47140c19714cc81b6", + "loads": [ + 2, + 15, + 0, + 7, + 0, + 1, + 2, + 21, + 0, + 0, + 6, + 4, + 4, + 5, + 0, + 1, + 1, + 7, + 2, + 7, + 7, + 2, + 3, + 0, + 4, + 1, + 0, + 0, + 2, + 0, + 5, + 0, + 7, + 3, + 2, + 3, + 3, + 20, + 0, + 1, + 1, + 1, + 4, + 0, + 12, + 5, + 1, + 1, + 5, + 0, + 0, + 1, + 0, + 2, + 2, + 2, + 0, + 0, + 0, + 4, + 9, + 1, + 5, + 0 + ], + "weighted_loads": [ + 0.07692469656467438, + 0.8581669516861439, + 0.0, + 0.5419544018805027, + 0.0, + 0.03334684297442436, + 0.1067521944642067, + 1.758027508854866, + 0.0, + 0.0, + 0.503882747143507, + 0.19423232600092888, + 0.40800517052412033, + 0.32986269518733025, + 0.0, + 0.057935185730457306, + 0.034179456532001495, + 0.6382745131850243, + 0.06852798163890839, + 0.3465012237429619, + 0.591731920838356, + 0.14276524633169174, + 0.13555777817964554, + 0.0, + 0.1881878599524498, + 0.03180582448840141, + 0.0, + 0.0, + 0.08193744719028473, + 0.0, + 0.26605628058314323, + 0.0, + 0.6552834697067738, + 0.12683436647057533, + 0.23149391263723373, + 0.1527865044772625, + 0.12466565519571304, + 1.3073043767362833, + 0.0, + 0.0709473043680191, + 0.03579926863312721, + 0.03883977606892586, + 0.2875302992761135, + 0.0, + 0.5038874037563801, + 0.245857585221529, + 0.057515133172273636, + 0.04348521679639816, + 0.2789010591804981, + 0.0, + 0.0, + 0.07702899724245071, + 0.0, + 0.1227143295109272, + 0.07168430835008621, + 0.08233287185430527, + 0.0, + 0.0, + 0.0, + 0.1962254960089922, + 0.516771923750639, + 0.036638423800468445, + 0.20345336198806763, + 0.0 + ], + "unique_experts": 45, + "load_cv": 1.363978846230485, + "normalized_load_entropy": 0.8231293777558337, + "max_load_share": 0.10294117647058823 + }, + "full_input": { + "tokens": 75, + "top_k": 6, + "decisions": 450, + "ordered_route_sha256": "abfcfec125bdc7db7d480e3f01cdf1dfb8338c16ef3de21dc3dd359f86638650", + "route_weight_sha256": "06c91009aa5a346a94e7c323922a91d3295ecd4a78b7ca79d26fc2526762ef61", + "loads": [ + 3, + 21, + 11, + 9, + 1, + 2, + 14, + 21, + 13, + 0, + 10, + 8, + 13, + 15, + 0, + 1, + 1, + 21, + 3, + 7, + 7, + 2, + 4, + 4, + 4, + 14, + 0, + 2, + 3, + 0, + 8, + 0, + 12, + 22, + 2, + 3, + 3, + 20, + 6, + 5, + 13, + 1, + 6, + 0, + 12, + 17, + 14, + 4, + 9, + 6, + 5, + 1, + 9, + 8, + 4, + 12, + 0, + 0, + 2, + 5, + 9, + 5, + 8, + 5 + ], + "weighted_loads": [ + 0.11581267043948174, + 1.1832287572324276, + 0.656770683825016, + 0.6499358788132668, + 0.03920196741819382, + 0.07807843014597893, + 1.0937399305403233, + 1.758027508854866, + 0.8719322457909584, + 0.0, + 0.7004541978240013, + 0.3478482225909829, + 0.9436705894768238, + 0.9915007166564465, + 0.0, + 0.057935185730457306, + 0.034179456532001495, + 1.6101086474955082, + 0.11488812044262886, + 0.3465012237429619, + 0.591731920838356, + 0.14276524633169174, + 0.17431015521287918, + 0.1893187928944826, + 0.1881878599524498, + 1.3120310045778751, + 0.0, + 0.1193368062376976, + 0.12325847893953323, + 0.0, + 0.3877587951719761, + 0.0, + 0.8428773321211338, + 1.4091856237500906, + 0.23149391263723373, + 0.1527865044772625, + 0.12466565519571304, + 1.3073043767362833, + 0.3906531408429146, + 0.23097936250269413, + 0.6328622400760651, + 0.03883977606892586, + 0.45708826929330826, + 0.0, + 0.5038874037563801, + 1.330181822180748, + 0.9999044090509415, + 0.14729009941220284, + 0.6252767965197563, + 0.39110787212848663, + 0.29208049550652504, + 0.07702899724245071, + 0.5197326391935349, + 0.8024187497794628, + 0.6967593859881163, + 0.7268625870347023, + 0.0, + 0.0, + 0.09793615341186523, + 0.22918753512203693, + 0.516771923750639, + 0.22380351647734642, + 0.35169416293501854, + 0.2925117202103138 + ], + "unique_experts": 56, + "load_cv": 0.8647271745583998, + "normalized_load_entropy": 0.9053775130736942, + "max_load_share": 0.04888888888888889 + } + }, + "s0_period": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "299a3e88e9865b2e41c954dc2bbecbb6dc1d36804c660299ba1fad5b7ae4b9b9", + "route_weight_sha256": "6cb3a5223f8d20bb355037732b7bfc01d7f9a7d25c598957d5cc4d802686ca36", + "loads": [ + 3, + 15, + 0, + 7, + 0, + 1, + 3, + 20, + 0, + 0, + 6, + 4, + 4, + 5, + 0, + 1, + 0, + 7, + 3, + 7, + 7, + 2, + 4, + 0, + 4, + 0, + 0, + 0, + 2, + 0, + 5, + 0, + 7, + 4, + 2, + 2, + 5, + 18, + 0, + 2, + 1, + 1, + 4, + 0, + 11, + 3, + 1, + 1, + 5, + 1, + 0, + 1, + 0, + 2, + 2, + 3, + 0, + 0, + 0, + 4, + 9, + 0, + 5, + 0 + ], + "weighted_loads": [ + 0.11220181174576283, + 0.8646377958357334, + 0.0, + 0.545343641191721, + 0.0, + 0.03207521140575409, + 0.15802403166890144, + 1.6770040355622768, + 0.0, + 0.0, + 0.5097673125565052, + 0.19456306844949722, + 0.4202304631471634, + 0.3381243087351322, + 0.0, + 0.05927398055791855, + 0.0, + 0.6347310468554497, + 0.09960458800196648, + 0.3466511070728302, + 0.5755476020276546, + 0.14748381078243256, + 0.17516230419278145, + 0.0, + 0.1877509318292141, + 0.0, + 0.0, + 0.0, + 0.08528643846511841, + 0.0, + 0.2644241787493229, + 0.0, + 0.662159588187933, + 0.17129895649850368, + 0.22582567483186722, + 0.1200638860464096, + 0.20349680073559284, + 1.247220702469349, + 0.0, + 0.10916030406951904, + 0.03692980855703354, + 0.03671368584036827, + 0.2935539782047272, + 0.0, + 0.4512823708355427, + 0.14428476989269257, + 0.04422225058078766, + 0.0400620698928833, + 0.2888779975473881, + 0.042377572506666183, + 0.0, + 0.07275600731372833, + 0.0, + 0.12788204103708267, + 0.07143499329686165, + 0.1220787800848484, + 0.0, + 0.0, + 0.0, + 0.1903406772762537, + 0.5234525687992573, + 0.0, + 0.20332436822354794, + 0.0 + ], + "unique_experts": 43, + "load_cv": 1.300489364611014, + "normalized_load_entropy": 0.8275337327835074, + "max_load_share": 0.09803921568627451 + }, + "full_input": { + "tokens": 59, + "top_k": 6, + "decisions": 354, + "ordered_route_sha256": "34e164846c0a471d6b7f3c4a78fd74aec9badcc0c7a0850d3809f5ef00291773", + "route_weight_sha256": "9b73079c31a1b8d3d5d4c0b15acb65602f5151b6c3b05531424cf3ba88723507", + "loads": [ + 3, + 21, + 2, + 9, + 2, + 1, + 10, + 21, + 8, + 0, + 7, + 7, + 10, + 13, + 0, + 1, + 0, + 11, + 3, + 7, + 7, + 2, + 6, + 0, + 4, + 12, + 0, + 0, + 2, + 0, + 8, + 0, + 11, + 18, + 2, + 2, + 5, + 18, + 0, + 8, + 7, + 1, + 4, + 0, + 11, + 9, + 8, + 4, + 6, + 6, + 3, + 1, + 11, + 2, + 4, + 11, + 0, + 0, + 3, + 4, + 9, + 0, + 6, + 3 + ], + "weighted_loads": [ + 0.11220181174576283, + 1.2345465645194054, + 0.038984570652246475, + 0.6432686485350132, + 0.10551707074046135, + 0.03207521140575409, + 0.7290963232517242, + 1.7221976481378078, + 0.6253763064742088, + 0.0, + 0.5737004391849041, + 0.30480667296797037, + 0.7581791430711746, + 0.8876338563859463, + 0.0, + 0.05927398055791855, + 0.0, + 0.813580084592104, + 0.09960458800196648, + 0.3466511070728302, + 0.5755476020276546, + 0.14748381078243256, + 0.2484002336859703, + 0.0, + 0.1877509318292141, + 0.8651474863290787, + 0.0, + 0.0, + 0.08528643846511841, + 0.0, + 0.39409971237182617, + 0.0, + 0.8338738903403282, + 1.2565792482346296, + 0.22582567483186722, + 0.1200638860464096, + 0.20349680073559284, + 1.247220702469349, + 0.0, + 0.3638459574431181, + 0.40121976286172867, + 0.03671368584036827, + 0.2935539782047272, + 0.0, + 0.4512823708355427, + 0.6892724856734276, + 0.7087633460760117, + 0.15164799615740776, + 0.3280930630862713, + 0.2941356599330902, + 0.17050263285636902, + 0.07275600731372833, + 0.6567696202546358, + 0.12788204103708267, + 0.6969812531024218, + 0.615877503529191, + 0.0, + 0.0, + 0.11107692494988441, + 0.1903406772762537, + 0.5234525687992573, + 0.0, + 0.24955049715936184, + 0.2938371077179909 + ], + "unique_experts": 51, + "load_cv": 0.9480589610744646, + "normalized_load_entropy": 0.886928714849314, + "max_load_share": 0.059322033898305086 + } + }, + "s1_period": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "195c2941576f5ab40770a6a2ccf0353bd9d336c4c1291b1ca3978374844c714f", + "route_weight_sha256": "6cc4b80bc9b7fec48f8bc4441da66173c0f669191529f551e005f30370f708db", + "loads": [ + 2, + 15, + 0, + 7, + 0, + 1, + 2, + 21, + 0, + 0, + 6, + 4, + 4, + 5, + 0, + 1, + 1, + 7, + 2, + 8, + 7, + 2, + 3, + 0, + 4, + 1, + 0, + 0, + 2, + 0, + 5, + 0, + 7, + 3, + 2, + 4, + 3, + 20, + 0, + 1, + 0, + 2, + 4, + 0, + 13, + 4, + 1, + 1, + 5, + 0, + 0, + 1, + 0, + 2, + 2, + 3, + 0, + 0, + 0, + 3, + 9, + 1, + 3, + 0 + ], + "weighted_loads": [ + 0.07610968500375748, + 0.8494352772831917, + 0.0, + 0.5421588160097599, + 0.0, + 0.0327826589345932, + 0.10770641639828682, + 1.7551141642034054, + 0.0, + 0.0, + 0.4988681748509407, + 0.19444578513503075, + 0.4141867607831955, + 0.3290049470961094, + 0.0, + 0.058607425540685654, + 0.034848060458898544, + 0.6275307610630989, + 0.06938882544636726, + 0.3786647915840149, + 0.5847265124320984, + 0.14225691929459572, + 0.1341034434735775, + 0.0, + 0.18761108443140984, + 0.0326186828315258, + 0.0, + 0.0, + 0.08543271943926811, + 0.0, + 0.26779184862971306, + 0.0, + 0.657624252140522, + 0.13042215630412102, + 0.2284935861825943, + 0.1865619607269764, + 0.12336475402116776, + 1.2917803209275007, + 0.0, + 0.0729614868760109, + 0.0, + 0.07276620715856552, + 0.2923221215605736, + 0.0, + 0.5309781599789858, + 0.20391589403152466, + 0.047749113291502, + 0.04326746240258217, + 0.2819410562515259, + 0.0, + 0.0, + 0.07744418829679489, + 0.0, + 0.12410438060760498, + 0.07247870787978172, + 0.12857146002352238, + 0.0, + 0.0, + 0.0, + 0.16496164351701736, + 0.5284237489104271, + 0.0367804691195488, + 0.13982434943318367, + 0.0 + ], + "unique_experts": 44, + "load_cv": 1.3763253372890516, + "normalized_load_entropy": 0.8200859333700246, + "max_load_share": 0.10294117647058823 + }, + "full_input": { + "tokens": 75, + "top_k": 6, + "decisions": 450, + "ordered_route_sha256": "b1f0fef8eee0975485af82bdddfd83bddbf21d05d0ea24188cf2f41227d976f5", + "route_weight_sha256": "48b18ed80665f9fe0593148f70c8f88bd6be5cf8b1ed334d6b8824b8de27cd13", + "loads": [ + 3, + 20, + 10, + 10, + 2, + 2, + 15, + 21, + 13, + 0, + 9, + 7, + 13, + 13, + 0, + 1, + 1, + 22, + 3, + 8, + 7, + 2, + 4, + 4, + 4, + 14, + 0, + 2, + 3, + 0, + 7, + 0, + 11, + 21, + 2, + 4, + 3, + 20, + 7, + 5, + 12, + 2, + 6, + 0, + 13, + 16, + 16, + 4, + 9, + 7, + 4, + 1, + 9, + 8, + 4, + 14, + 0, + 0, + 2, + 4, + 9, + 5, + 6, + 6 + ], + "weighted_loads": [ + 0.11499765887856483, + 1.1300386041402817, + 0.6202357746660709, + 0.6935029774904251, + 0.07872580364346504, + 0.07751424610614777, + 1.2088280580937862, + 1.7551141642034054, + 0.8976112827658653, + 0.0, + 0.6523137465119362, + 0.3099376196041703, + 0.949852179735899, + 0.8536644950509071, + 0.0, + 0.058607425540685654, + 0.034848060458898544, + 1.665337909013033, + 0.11574896425008774, + 0.3786647915840149, + 0.5847265124320984, + 0.14225691929459572, + 0.17285582050681114, + 0.1893187928944826, + 0.18761108443140984, + 1.2726324461400509, + 0.0, + 0.1193368062376976, + 0.12675375118851662, + 0.0, + 0.34719469770789146, + 0.0, + 0.8033472411334515, + 1.3753477800637484, + 0.2284935861825943, + 0.1865619607269764, + 0.12336475402116776, + 1.2917803209275007, + 0.43132803961634636, + 0.23393536917865276, + 0.6019960381090641, + 0.07276620715856552, + 0.4618800915777683, + 0.0, + 0.5309781599789858, + 1.3047940209507942, + 1.142747201025486, + 0.14707234501838684, + 0.6283167935907841, + 0.4391176663339138, + 0.22009092941880226, + 0.07744418829679489, + 0.5197326391935349, + 0.8038088008761406, + 0.6975537855178118, + 0.8162427116185427, + 0.0, + 0.0, + 0.09793615341186523, + 0.1979236826300621, + 0.5284237489104271, + 0.22394556179642677, + 0.28779689595103264, + 0.37113547697663307 + ], + "unique_experts": 56, + "load_cv": 0.8566486523541883, + "normalized_load_entropy": 0.9075750684387065, + "max_load_share": 0.04888888888888889 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 34, + "ordered_topk_exact_tokens": 30, + "set_exact_tokens": 32, + "mean_set_jaccard": 0.9831932773109244, + "mean_token_weighted_tv": 0.006384667255641783, + "aggregate_load_tv": 0.009803921568627449 + }, + "system_bos": { + "tokens": 34, + "ordered_topk_exact_tokens": 26, + "set_exact_tokens": 28, + "mean_set_jaccard": 0.9495798319327731, + "mean_token_weighted_tv": 0.01127337508232278, + "aggregate_load_tv": 0.024509803921568624 + }, + "system_x": { + "tokens": 34, + "ordered_topk_exact_tokens": 20, + "set_exact_tokens": 25, + "mean_set_jaccard": 0.9243697478991596, + "mean_token_weighted_tv": 0.016474120264105937, + "aggregate_load_tv": 0.0392156862745098 + }, + "system_period": { + "tokens": 34, + "ordered_topk_exact_tokens": 17, + "set_exact_tokens": 22, + "mean_set_jaccard": 0.8865546218487396, + "mean_token_weighted_tv": 0.02164818291716716, + "aggregate_load_tv": 0.06372549019607843 + }, + "bos_at_s0": { + "tokens": 34, + "ordered_topk_exact_tokens": 22, + "set_exact_tokens": 24, + "mean_set_jaccard": 0.9096638655462186, + "mean_token_weighted_tv": 0.018951921066378847, + "aggregate_load_tv": 0.044117647058823525 + }, + "bos_at_s1": { + "tokens": 34, + "ordered_topk_exact_tokens": 17, + "set_exact_tokens": 21, + "mean_set_jaccard": 0.8781512605042018, + "mean_token_weighted_tv": 0.024065485717180896, + "aggregate_load_tv": 0.06862745098039215 + }, + "x_at_s0": { + "tokens": 34, + "ordered_topk_exact_tokens": 20, + "set_exact_tokens": 25, + "mean_set_jaccard": 0.9180672268907565, + "mean_token_weighted_tv": 0.018626196967328295, + "aggregate_load_tv": 0.04411764705882353 + }, + "x_at_s1": { + "tokens": 34, + "ordered_topk_exact_tokens": 16, + "set_exact_tokens": 20, + "mean_set_jaccard": 0.8760504201680673, + "mean_token_weighted_tv": 0.02534978899776059, + "aggregate_load_tv": 0.06372549019607843 + }, + "period_at_s0": { + "tokens": 34, + "ordered_topk_exact_tokens": 20, + "set_exact_tokens": 25, + "mean_set_jaccard": 0.9180672268907564, + "mean_token_weighted_tv": 0.019607194507604137, + "aggregate_load_tv": 0.044117647058823525 + }, + "period_at_s1": { + "tokens": 34, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 21, + "mean_set_jaccard": 0.8781512605042018, + "mean_token_weighted_tv": 0.025789730798672226, + "aggregate_load_tv": 0.06862745098039216 + } + } + }, + "layer_09": { + "layer": 9, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "065f1f07dbddf50d4f676567758f507558ad62f143844d78315c5f0d0490e458", + "route_weight_sha256": "896867c975ae68f0156dc5c1411bdcb98bb5a1684d31d8cff9c6a15c6cb499a9", + "loads": [ + 4, + 7, + 4, + 1, + 3, + 2, + 1, + 0, + 1, + 1, + 1, + 5, + 0, + 5, + 0, + 3, + 5, + 1, + 4, + 4, + 0, + 0, + 2, + 3, + 0, + 1, + 0, + 0, + 13, + 4, + 8, + 4, + 1, + 3, + 9, + 4, + 0, + 6, + 1, + 5, + 0, + 2, + 3, + 0, + 0, + 0, + 3, + 0, + 5, + 3, + 3, + 6, + 4, + 0, + 2, + 4, + 26, + 4, + 7, + 7, + 2, + 2, + 4, + 1 + ], + "weighted_loads": [ + 0.2260931171476841, + 0.5447786040604115, + 0.4558742046356201, + 0.030070140957832336, + 0.15733304619789124, + 0.07432602718472481, + 0.03271305561065674, + 0.0, + 0.10891470313072205, + 0.038586270064115524, + 0.03451007977128029, + 0.2644707038998604, + 0.0, + 0.306738443672657, + 0.0, + 0.13300006464123726, + 0.26876572892069817, + 0.020008817315101624, + 0.3872019946575165, + 0.393000740557909, + 0.0, + 0.0, + 0.07636696100234985, + 0.178132314234972, + 0.0, + 0.030161168426275253, + 0.0, + 0.0, + 1.2130667679011822, + 0.18363042548298836, + 0.49226108007133007, + 0.15545903705060482, + 0.030424218624830246, + 0.14013409055769444, + 0.4833303540945053, + 0.22581462934613228, + 0.0, + 0.35477240011096, + 0.041603926569223404, + 0.2061343416571617, + 0.0, + 0.0737263597548008, + 0.17979733645915985, + 0.0, + 0.0, + 0.0, + 0.17680954933166504, + 0.0, + 0.38881415873765945, + 0.10518573224544525, + 0.12380814179778099, + 0.3787185326218605, + 0.24101348221302032, + 0.0, + 0.07953960821032524, + 0.21092013642191887, + 2.2252542823553085, + 0.12892768159508705, + 0.5640966407954693, + 0.3383892551064491, + 0.16093435510993004, + 0.09865264594554901, + 0.1679395455867052, + 0.05803893133997917 + ], + "unique_experts": 49, + "load_cv": 1.218686998687085, + "normalized_load_entropy": 0.8629632271081262, + "max_load_share": 0.12745098039215685 + }, + "full_input": { + "tokens": 59, + "top_k": 6, + "decisions": 354, + "ordered_route_sha256": "637697eba48c99508ab2914a8dd6770b39198a8d7af49c2437580594bf5cf941", + "route_weight_sha256": "1ca2cbcd5e56dbc099a3c7fc88cdfe02302a1c2e86f5111feec7aa6243acc2c8", + "loads": [ + 11, + 10, + 4, + 1, + 5, + 2, + 1, + 0, + 3, + 1, + 12, + 5, + 4, + 10, + 0, + 3, + 7, + 3, + 4, + 13, + 0, + 0, + 7, + 6, + 4, + 3, + 0, + 1, + 13, + 4, + 10, + 10, + 2, + 3, + 18, + 11, + 0, + 6, + 4, + 5, + 0, + 11, + 3, + 0, + 4, + 8, + 13, + 0, + 8, + 3, + 8, + 7, + 4, + 2, + 2, + 9, + 30, + 4, + 9, + 11, + 2, + 2, + 6, + 2 + ], + "weighted_loads": [ + 0.7520668469369411, + 0.7487577088177204, + 0.4558742046356201, + 0.030070140957832336, + 0.3959982171654701, + 0.07432602718472481, + 0.03271305561065674, + 0.0, + 0.20520885661244392, + 0.038586270064115524, + 1.2118950299918652, + 0.2644707038998604, + 0.0935267168097198, + 0.5718813179992139, + 0.0, + 0.13300006464123726, + 0.3735935464501381, + 0.09316681139171124, + 0.3872019946575165, + 1.247443363070488, + 0.0, + 0.0, + 1.668480096384883, + 0.4480619505047798, + 0.1670001707971096, + 0.1480337642133236, + 0.0, + 0.013010287657380104, + 1.2130667679011822, + 0.18363042548298836, + 0.5926351081579924, + 0.3447499449830502, + 0.03414775454439223, + 0.14013409055769444, + 0.9731289092451334, + 0.6715762950479984, + 0.0, + 0.35477240011096, + 0.15893802791833878, + 0.2061343416571617, + 0.0, + 0.9830238930881023, + 0.17979733645915985, + 0.0, + 0.2691219327971339, + 0.6557225771248341, + 0.9475323967635632, + 0.0, + 0.5824975669384003, + 0.10518573224544525, + 0.41771887615323067, + 0.41282838582992554, + 0.24101348221302032, + 0.08776186034083366, + 0.07953960821032524, + 0.45350468903779984, + 2.4300994500517845, + 0.12892768159508705, + 0.7052306346595287, + 0.5139869563281536, + 0.16093435510993004, + 0.09865264594554901, + 0.22376554645597935, + 0.09426720067858696 + ], + "unique_experts": 55, + "load_cv": 0.9383124598297186, + "normalized_load_entropy": 0.9012159230051155, + "max_load_share": 0.0847457627118644 + } + }, + "s1_eos": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "caffbdd63993c2833ac5d2feb703999f47060378c7201065b18859bc0f44fb4d", + "route_weight_sha256": "0c2b7f988cc9a562c3156021f2877e010f1fbdbd20f94f304fa7450eecf40619", + "loads": [ + 4, + 7, + 4, + 1, + 3, + 2, + 0, + 0, + 1, + 1, + 1, + 5, + 0, + 5, + 0, + 3, + 5, + 1, + 4, + 4, + 0, + 0, + 2, + 3, + 1, + 0, + 0, + 0, + 13, + 4, + 8, + 4, + 1, + 3, + 9, + 4, + 0, + 6, + 1, + 5, + 0, + 2, + 4, + 0, + 1, + 0, + 3, + 0, + 5, + 2, + 2, + 6, + 4, + 0, + 2, + 4, + 26, + 4, + 7, + 7, + 3, + 2, + 4, + 1 + ], + "weighted_loads": [ + 0.22173215448856354, + 0.5387207828462124, + 0.4632569029927254, + 0.029137834906578064, + 0.15503806248307228, + 0.07563601806759834, + 0.0, + 0.0, + 0.11163952201604843, + 0.0379033237695694, + 0.03506556153297424, + 0.26512610912323, + 0.0, + 0.3089662082493305, + 0.0, + 0.13413572497665882, + 0.2715751603245735, + 0.020379388704895973, + 0.3862256109714508, + 0.40059034526348114, + 0.0, + 0.0, + 0.07669233903288841, + 0.1808360479772091, + 0.03792756050825119, + 0.0, + 0.0, + 0.0, + 1.1958278827369213, + 0.18807393312454224, + 0.4864613488316536, + 0.1555179636925459, + 0.030937371775507927, + 0.13906067609786987, + 0.48386161774396896, + 0.22550760209560394, + 0.0, + 0.3542911857366562, + 0.03843050077557564, + 0.21358565613627434, + 0.0, + 0.07235759496688843, + 0.21604062616825104, + 0.0, + 0.04552918300032616, + 0.0, + 0.1706152781844139, + 0.0, + 0.38668837770819664, + 0.0654633641242981, + 0.08311277255415916, + 0.37956106290221214, + 0.23704302683472633, + 0.0, + 0.08074146509170532, + 0.21439939364790916, + 2.212995894253254, + 0.1305301282554865, + 0.5621247701346874, + 0.3395048975944519, + 0.19365269318223, + 0.10287778079509735, + 0.1680135354399681, + 0.05728304013609886 + ], + "unique_experts": 49, + "load_cv": 1.2199482533570416, + "normalized_load_entropy": 0.8625627164907461, + "max_load_share": 0.12745098039215685 + }, + "full_input": { + "tokens": 75, + "top_k": 6, + "decisions": 450, + "ordered_route_sha256": "7c5b247b153f4b29f3704e5c2fdcef6f89311926fcd70764798b5b054f123dcd", + "route_weight_sha256": "be55e4b907fb786b739f07df36ccf60104125f253f22ba958976ed5c74d1e1ce", + "loads": [ + 15, + 12, + 4, + 1, + 5, + 2, + 0, + 0, + 7, + 3, + 12, + 7, + 4, + 9, + 1, + 3, + 7, + 2, + 4, + 13, + 0, + 3, + 7, + 14, + 6, + 9, + 4, + 1, + 19, + 4, + 11, + 9, + 2, + 6, + 15, + 16, + 0, + 9, + 6, + 6, + 6, + 16, + 6, + 0, + 7, + 13, + 22, + 0, + 12, + 7, + 5, + 7, + 4, + 3, + 3, + 8, + 31, + 4, + 12, + 12, + 3, + 3, + 6, + 2 + ], + "weighted_loads": [ + 0.976404931396246, + 0.8275602273643017, + 0.4632569029927254, + 0.029137834906578064, + 0.41589879617094994, + 0.07563601806759834, + 0.0, + 0.0, + 0.49234525486826897, + 0.12964842841029167, + 1.126768071204424, + 0.36184702441096306, + 0.09121898701414466, + 0.5144333450589329, + 0.0392376147210598, + 0.13413572497665882, + 0.3791155591607094, + 0.07676615752279758, + 0.3862256109714508, + 1.350698821246624, + 0.0, + 0.1263238713145256, + 1.6647238992154598, + 1.0410432256758213, + 0.23084721714258194, + 0.4766731709241867, + 0.25377771630883217, + 0.013010287657380104, + 1.6200484558939934, + 0.18807393312454224, + 0.6935923099517822, + 0.30272385152056813, + 0.03456638799980283, + 0.3609367087483406, + 0.7898545153439045, + 0.9941022172570229, + 0.0, + 0.49597377330064774, + 0.27288929745554924, + 0.280603613704443, + 0.40047842264175415, + 1.4951810017228127, + 0.3080327659845352, + 0.0, + 0.26656668446958065, + 1.0795256681740284, + 1.779493235051632, + 0.0, + 0.8188187405467033, + 0.39332108572125435, + 0.29279185831546783, + 0.4130580201745033, + 0.23704302683472633, + 0.14895657822489738, + 0.12178602069616318, + 0.3980622384697199, + 2.4475344829261303, + 0.1305301282554865, + 0.8669452220201492, + 0.5569633543491364, + 0.19365269318223, + 0.1408829763531685, + 0.3245848510414362, + 0.09330565109848976 + ], + "unique_experts": 58, + "load_cv": 0.8349761584531532, + "normalized_load_entropy": 0.9189559648282085, + "max_load_share": 0.06888888888888889 + } + }, + "s0_bos": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "2b3261d99dcf6846dcb9ee78b2997c12d21dfcf6bce28a6d02f60f174ed3f443", + "route_weight_sha256": "7cb3f03cb6430373626b9edeec2d3326f5fca81536734b4716acae72a2aa9237", + "loads": [ + 3, + 7, + 4, + 1, + 3, + 1, + 0, + 0, + 1, + 1, + 1, + 5, + 0, + 5, + 0, + 2, + 5, + 0, + 4, + 4, + 1, + 0, + 2, + 3, + 1, + 1, + 0, + 0, + 13, + 4, + 7, + 4, + 1, + 3, + 9, + 4, + 0, + 6, + 2, + 4, + 0, + 2, + 4, + 0, + 1, + 0, + 3, + 0, + 6, + 2, + 2, + 6, + 3, + 0, + 2, + 5, + 26, + 5, + 7, + 8, + 3, + 2, + 4, + 1 + ], + "weighted_loads": [ + 0.18654632940888405, + 0.551987536251545, + 0.46711648255586624, + 0.03078347258269787, + 0.1583961732685566, + 0.039617858827114105, + 0.0, + 0.0, + 0.1075543761253357, + 0.0396481454372406, + 0.03367301821708679, + 0.2679332569241524, + 0.0, + 0.30027395114302635, + 0.0, + 0.10313503071665764, + 0.26300249621272087, + 0.0, + 0.38760261982679367, + 0.42987154237926006, + 0.03843976557254791, + 0.0, + 0.0765860415995121, + 0.1864713579416275, + 0.034919582307338715, + 0.036215782165527344, + 0.0, + 0.0, + 1.2314581088721752, + 0.18940186128020287, + 0.4715486653149128, + 0.15580955892801285, + 0.03234481438994408, + 0.1352985594421625, + 0.4760420545935631, + 0.2241787277162075, + 0.0, + 0.3551158607006073, + 0.07537972554564476, + 0.17411712929606438, + 0.0, + 0.07229624316096306, + 0.21741781383752823, + 0.0, + 0.04690375551581383, + 0.0, + 0.19376390799880028, + 0.0, + 0.4201226234436035, + 0.0669434480369091, + 0.08458833396434784, + 0.3881962411105633, + 0.20283465832471848, + 0.0, + 0.07890358567237854, + 0.24436119198799133, + 2.2442364618182182, + 0.1575424112379551, + 0.5732119083404541, + 0.37783079966902733, + 0.197063397616148, + 0.09633583575487137, + 0.16589822247624397, + 0.05491748824715614 + ], + "unique_experts": 50, + "load_cv": 1.221208205413335, + "normalized_load_entropy": 0.8639804758808683, + "max_load_share": 0.12745098039215685 + }, + "full_input": { + "tokens": 59, + "top_k": 6, + "decisions": 354, + "ordered_route_sha256": "783d33740afe460488943296b36f16b0ac5fbe25eb8714a8547181b7cbd933cb", + "route_weight_sha256": "8adde3d627fcb248b15af3801816f048aaefb5bbbe5e3f3828befaef83bdc893", + "loads": [ + 11, + 10, + 4, + 1, + 7, + 1, + 0, + 0, + 3, + 1, + 12, + 5, + 2, + 9, + 0, + 2, + 7, + 4, + 4, + 13, + 1, + 0, + 6, + 6, + 5, + 2, + 0, + 1, + 13, + 4, + 9, + 9, + 1, + 3, + 18, + 11, + 0, + 6, + 4, + 6, + 0, + 11, + 4, + 0, + 4, + 8, + 13, + 0, + 9, + 2, + 9, + 7, + 3, + 2, + 2, + 10, + 30, + 5, + 9, + 12, + 3, + 2, + 6, + 2 + ], + "weighted_loads": [ + 0.7519600093364716, + 0.7534685395658016, + 0.46711648255586624, + 0.03078347258269787, + 0.5048376582562923, + 0.039617858827114105, + 0.0, + 0.0, + 0.20384852960705757, + 0.0396481454372406, + 1.2110579684376717, + 0.2679332569241524, + 0.045841531828045845, + 0.580902710556984, + 0.0, + 0.10313503071665764, + 0.3650278113782406, + 0.14946040324866772, + 0.38760261982679367, + 1.284314164891839, + 0.03843976557254791, + 0.0, + 0.73280811868608, + 0.499319925904274, + 0.20191975310444832, + 0.11260189861059189, + 0.0, + 0.013010287657380104, + 1.2314581088721752, + 0.18940186128020287, + 0.5751731358468533, + 0.3423762498423457, + 0.03234481438994408, + 0.1352985594421625, + 0.9658406097441912, + 0.6558558717370033, + 0.0, + 0.3551158607006073, + 0.1534566543996334, + 0.2580000087618828, + 0.0, + 1.000162746757269, + 0.21741781383752823, + 0.0, + 0.3083468647673726, + 0.7881961204111576, + 0.9532471969723701, + 0.0, + 0.6151192560791969, + 0.0669434480369091, + 0.45836392045021057, + 0.4223060943186283, + 0.20283465832471848, + 0.08995136991143227, + 0.07890358567237854, + 0.4913175441324711, + 2.449081629514694, + 0.1575424112379551, + 0.715909481048584, + 0.5534285008907318, + 0.197063397616148, + 0.09633583575487137, + 0.2217242233455181, + 0.09114575758576393 + ], + "unique_experts": 55, + "load_cv": 0.9485974971131086, + "normalized_load_entropy": 0.897732199907195, + "max_load_share": 0.0847457627118644 + } + }, + "s1_bos": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "21eabbc9ad7d6200c783a619f09822e4b1ec682941d74b8741ceaeabec68fdc8", + "route_weight_sha256": "81610c35d72c92fe882d0a79ba3e3e09dcb6b9cd7c20986b38ba5f0214bc13f5", + "loads": [ + 4, + 7, + 4, + 0, + 4, + 1, + 0, + 0, + 1, + 1, + 1, + 5, + 0, + 5, + 0, + 2, + 5, + 1, + 4, + 4, + 1, + 0, + 2, + 2, + 0, + 3, + 0, + 0, + 13, + 3, + 7, + 4, + 1, + 3, + 9, + 4, + 0, + 6, + 2, + 4, + 0, + 2, + 4, + 0, + 0, + 0, + 3, + 0, + 6, + 3, + 2, + 6, + 3, + 0, + 2, + 5, + 26, + 4, + 7, + 8, + 4, + 2, + 3, + 1 + ], + "weighted_loads": [ + 0.21034572087228298, + 0.5505617037415504, + 0.46533582359552383, + 0.0, + 0.20245062932372093, + 0.03829861432313919, + 0.0, + 0.0, + 0.11166977137327194, + 0.03835291415452957, + 0.03470069169998169, + 0.272651843726635, + 0.0, + 0.2973180413246155, + 0.0, + 0.10280826687812805, + 0.26371974498033524, + 0.021876497194170952, + 0.3898122012615204, + 0.396615631878376, + 0.029096096754074097, + 0.0, + 0.0719623826444149, + 0.14958946406841278, + 0.0, + 0.11050816252827644, + 0.0, + 0.0, + 1.2156925536692142, + 0.15586170554161072, + 0.4508724920451641, + 0.15388554893434048, + 0.03313476964831352, + 0.1341611072421074, + 0.48395903781056404, + 0.22409414872527122, + 0.0, + 0.34526141732931137, + 0.07544579356908798, + 0.167465440928936, + 0.0, + 0.07246238365769386, + 0.2211957424879074, + 0.0, + 0.0, + 0.0, + 0.1947934813797474, + 0.0, + 0.41718991100788116, + 0.09615471586585045, + 0.08389311656355858, + 0.39054810255765915, + 0.20235666632652283, + 0.0, + 0.07602506130933762, + 0.24350421875715256, + 2.264949221163988, + 0.1383412927389145, + 0.5672779455780983, + 0.3693729229271412, + 0.22760308533906937, + 0.0948723703622818, + 0.1395609714090824, + 0.05208704620599747 + ], + "unique_experts": 48, + "load_cv": 1.223724217774896, + "normalized_load_entropy": 0.8603935808436437, + "max_load_share": 0.12745098039215685 + }, + "full_input": { + "tokens": 75, + "top_k": 6, + "decisions": 450, + "ordered_route_sha256": "d945db29726f41f5187944e0e9a72b5b1ff0bb0ae3fb3076ad1511a5083c0c43", + "route_weight_sha256": "6a11b012c6c7b938ed5890c03a4375f8d6fca537f291e83fac16716fa5ec8729", + "loads": [ + 16, + 12, + 4, + 0, + 8, + 1, + 0, + 0, + 7, + 3, + 12, + 7, + 2, + 9, + 1, + 2, + 7, + 4, + 4, + 13, + 1, + 3, + 6, + 13, + 5, + 11, + 4, + 1, + 19, + 3, + 10, + 8, + 1, + 6, + 15, + 16, + 0, + 9, + 6, + 6, + 6, + 16, + 6, + 0, + 4, + 13, + 22, + 0, + 13, + 8, + 7, + 7, + 3, + 3, + 3, + 10, + 31, + 4, + 12, + 13, + 4, + 3, + 5, + 2 + ], + "weighted_loads": [ + 1.0346207413822412, + 0.8369934074580669, + 0.46533582359552383, + 0.0, + 0.5654683075845242, + 0.03829861432313919, + 0.0, + 0.0, + 0.4923755042254925, + 0.13009801879525185, + 1.1264032013714314, + 0.36937275901436806, + 0.04704953543841839, + 0.5539631955325603, + 0.0392376147210598, + 0.10280826687812805, + 0.36953434720635414, + 0.16399111784994602, + 0.3898122012615204, + 1.3467241078615189, + 0.029096096754074097, + 0.1263238713145256, + 0.7304269857704639, + 1.0175314396619797, + 0.19291965663433075, + 0.5437032245099545, + 0.25377771630883217, + 0.013010287657380104, + 1.6399131268262863, + 0.15586170554161072, + 0.660882007330656, + 0.29826429206877947, + 0.03313476964831352, + 0.3560371398925781, + 0.7899519354104996, + 0.9768560230731964, + 0.0, + 0.4869440048933029, + 0.26585395634174347, + 0.2811478227376938, + 0.40047842264175415, + 1.5217294953763485, + 0.3131878823041916, + 0.0, + 0.16924539301544428, + 1.2481717355549335, + 1.8003004528582096, + 0.0, + 0.8586111441254616, + 0.4240124374628067, + 0.37166485004127026, + 0.42404505982995033, + 0.20235666632652283, + 0.1535033844411373, + 0.11706961691379547, + 0.47089571692049503, + 2.4994878098368645, + 0.1383412927389145, + 0.8710560388863087, + 0.5868313796818256, + 0.22760308533906937, + 0.13287756592035294, + 0.2961322870105505, + 0.08810965716838837 + ], + "unique_experts": 58, + "load_cv": 0.8507251808506278, + "normalized_load_entropy": 0.9149045244186111, + "max_load_share": 0.06888888888888889 + } + }, + "s0_x": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "023c4e3374966523a70f1492f8de6704278a55e1de78eea5569f1dcf5ac2bf79", + "route_weight_sha256": "fbd75f8c8e6c394ef101e4b73e982124251d666c70bd6d2fda14228fdf80ff96", + "loads": [ + 4, + 7, + 4, + 2, + 3, + 1, + 0, + 1, + 1, + 1, + 1, + 5, + 0, + 4, + 0, + 2, + 5, + 0, + 4, + 5, + 1, + 0, + 2, + 3, + 0, + 2, + 0, + 0, + 13, + 3, + 7, + 3, + 1, + 3, + 10, + 4, + 0, + 6, + 1, + 4, + 0, + 2, + 5, + 0, + 0, + 0, + 3, + 0, + 5, + 2, + 3, + 6, + 4, + 0, + 2, + 5, + 26, + 3, + 7, + 8, + 3, + 2, + 4, + 1 + ], + "weighted_loads": [ + 0.2273751012980938, + 0.5564148239791393, + 0.4679716192185879, + 0.06029512733221054, + 0.15693747997283936, + 0.03931768238544464, + 0.0, + 0.040797676891088486, + 0.10702802240848541, + 0.03950359299778938, + 0.03287357836961746, + 0.27003882080316544, + 0.0, + 0.25955887138843536, + 0.0, + 0.10915877670049667, + 0.26111704856157303, + 0.0, + 0.39428064227104187, + 0.4535365700721741, + 0.029540779069066048, + 0.0, + 0.0741387102752924, + 0.18435216695070267, + 0.0, + 0.08524168655276299, + 0.0, + 0.0, + 1.195683591067791, + 0.15060260519385338, + 0.4466298036277294, + 0.11105482093989849, + 0.03293800354003906, + 0.13515031896531582, + 0.5294784177094698, + 0.23099977523088455, + 0.0, + 0.34644481912255287, + 0.04315609857439995, + 0.16216429322957993, + 0.0, + 0.07508251443505287, + 0.2500182241201401, + 0.0, + 0.0, + 0.0, + 0.20494455844163895, + 0.0, + 0.39364324510097504, + 0.06424704566597939, + 0.12167766690254211, + 0.3855072818696499, + 0.2368212454020977, + 0.0, + 0.0816989354789257, + 0.24444689601659775, + 2.256702199578285, + 0.10005160607397556, + 0.551158107817173, + 0.38081512972712517, + 0.1895940564572811, + 0.09442726150155067, + 0.15580646879971027, + 0.051639214158058167 + ], + "unique_experts": 49, + "load_cv": 1.2262350677454565, + "normalized_load_entropy": 0.862101720643671, + "max_load_share": 0.12745098039215685 + }, + "full_input": { + "tokens": 59, + "top_k": 6, + "decisions": 354, + "ordered_route_sha256": "9600603e8ba8d9235bafd29f7d6cf3a54df7aa6dd2eccc2cc65f882f738fd771", + "route_weight_sha256": "701a03d21ed75872d3543c20603c60adc32f7a947527674e1a523b8dbd6c3e01", + "loads": [ + 13, + 10, + 4, + 2, + 5, + 1, + 0, + 1, + 3, + 1, + 13, + 5, + 2, + 8, + 0, + 2, + 8, + 4, + 4, + 14, + 1, + 0, + 6, + 6, + 4, + 5, + 0, + 1, + 13, + 3, + 9, + 8, + 1, + 3, + 20, + 10, + 0, + 6, + 4, + 5, + 0, + 11, + 5, + 0, + 3, + 8, + 13, + 0, + 7, + 2, + 8, + 7, + 4, + 1, + 2, + 10, + 30, + 3, + 9, + 13, + 3, + 2, + 6, + 2 + ], + "weighted_loads": [ + 0.9218250252306461, + 0.7619352340698242, + 0.4679716192185879, + 0.06029512733221054, + 0.4062613397836685, + 0.03931768238544464, + 0.0, + 0.040797676891088486, + 0.2033221758902073, + 0.03950359299778938, + 1.360108122229576, + 0.27003882080316544, + 0.045841531828045845, + 0.4980641156435013, + 0.0, + 0.10915877670049667, + 0.40109074115753174, + 0.16640239395201206, + 0.39428064227104187, + 1.307979192584753, + 0.029540779069066048, + 0.0, + 0.7328831367194653, + 0.4523629955947399, + 0.1670001707971096, + 0.2412968948483467, + 0.0, + 0.013010287657380104, + 1.195683591067791, + 0.15060260519385338, + 0.5445583499968052, + 0.29762151185423136, + 0.03293800354003906, + 0.13515031896531582, + 1.1150202862918377, + 0.6317157074809074, + 0.0, + 0.34644481912255287, + 0.16687119007110596, + 0.1955861747264862, + 0.0, + 0.9738479070365429, + 0.2500182241201401, + 0.0, + 0.2614431092515588, + 0.6074691116809845, + 0.9632212221622467, + 0.0, + 0.548995703458786, + 0.06424704566597939, + 0.41174377128481865, + 0.4196171350777149, + 0.2368212454020977, + 0.044809553772211075, + 0.0816989354789257, + 0.4977652207016945, + 2.461547367274761, + 0.10005160607397556, + 0.6882312893867493, + 0.5958904735744, + 0.1895940564572811, + 0.09442726150155067, + 0.2116324696689844, + 0.08786748349666595 + ], + "unique_experts": 56, + "load_cv": 0.9688400745450035, + "normalized_load_entropy": 0.8970648292780269, + "max_load_share": 0.0847457627118644 + } + }, + "s1_x": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "62e53a5ba7b943a54a82cd09b1b5be65ff3c5b471877d115ff4a0609d7ba9efb", + "route_weight_sha256": "4314b62ad303d046ead0b766f5530c81a91672421231c670e1e0a4a8bbeb428e", + "loads": [ + 6, + 7, + 4, + 1, + 3, + 2, + 0, + 0, + 1, + 1, + 1, + 5, + 0, + 4, + 0, + 2, + 4, + 1, + 4, + 5, + 1, + 0, + 2, + 3, + 0, + 3, + 0, + 0, + 13, + 3, + 7, + 4, + 1, + 2, + 9, + 4, + 0, + 6, + 2, + 5, + 0, + 2, + 4, + 0, + 0, + 0, + 3, + 0, + 5, + 2, + 3, + 6, + 3, + 0, + 2, + 4, + 26, + 4, + 7, + 8, + 3, + 2, + 3, + 1 + ], + "weighted_loads": [ + 0.28859137929975986, + 0.5454264171421528, + 0.4564048796892166, + 0.03215799480676651, + 0.15614858269691467, + 0.070558812469244, + 0.0, + 0.0, + 0.11412854492664337, + 0.03869578242301941, + 0.03199245035648346, + 0.2711785323917866, + 0.0, + 0.25937100127339363, + 0.0, + 0.10512719303369522, + 0.21296308562159538, + 0.022388368844985962, + 0.3880489394068718, + 0.43032658472657204, + 0.03101801499724388, + 0.0, + 0.07351862452924252, + 0.1811646744608879, + 0.0, + 0.13695355504751205, + 0.0, + 0.0, + 1.1672991514205933, + 0.15628816559910774, + 0.4363487549126148, + 0.149338835850358, + 0.03443320095539093, + 0.10300006344914436, + 0.5004446655511856, + 0.23221279308199883, + 0.0, + 0.33608608320355415, + 0.06739267334342003, + 0.19692138209939003, + 0.0, + 0.0768815241754055, + 0.2233448512852192, + 0.0, + 0.0, + 0.0, + 0.21617337688803673, + 0.0, + 0.3888886608183384, + 0.0625634491443634, + 0.12105465307831764, + 0.3901926018297672, + 0.198578841984272, + 0.0, + 0.07669375464320183, + 0.19973980262875557, + 2.239865407347679, + 0.13529549539089203, + 0.5419256277382374, + 0.3800538368523121, + 0.1872783713042736, + 0.09508894756436348, + 0.13220376521348953, + 0.05085032060742378 + ], + "unique_experts": 49, + "load_cv": 1.2174244373549323, + "normalized_load_entropy": 0.8640620653172327, + "max_load_share": 0.12745098039215685 + }, + "full_input": { + "tokens": 75, + "top_k": 6, + "decisions": 450, + "ordered_route_sha256": "1e10e4e20b2ed573a98539f4e6b84c5fb8971f9e5ecd9821b14a61bf4b81ea48", + "route_weight_sha256": "375a388981c972a44dc1e6112ed0b683b7e1dfe277e95927983d4ee984796bfd", + "loads": [ + 20, + 12, + 4, + 1, + 5, + 2, + 0, + 0, + 8, + 3, + 13, + 7, + 2, + 7, + 1, + 2, + 7, + 2, + 4, + 15, + 1, + 3, + 6, + 14, + 5, + 13, + 5, + 1, + 19, + 3, + 10, + 8, + 1, + 5, + 16, + 15, + 0, + 9, + 7, + 7, + 6, + 16, + 6, + 0, + 3, + 11, + 22, + 0, + 12, + 7, + 6, + 7, + 3, + 2, + 3, + 9, + 31, + 4, + 12, + 14, + 3, + 3, + 5, + 2 + ], + "weighted_loads": [ + 1.2721205446869135, + 0.8166366927325726, + 0.4564048796892166, + 0.03215799480676651, + 0.4230389893054962, + 0.070558812469244, + 0.0, + 0.0, + 0.5363011248409748, + 0.13044088706374168, + 1.283783931285143, + 0.36789944767951965, + 0.04704953543841839, + 0.44122908264398575, + 0.0392376147210598, + 0.10512719303369522, + 0.35402726382017136, + 0.07877513766288757, + 0.3880489394068718, + 1.4260852187871933, + 0.03101801499724388, + 0.1263238713145256, + 0.7306296061724424, + 1.0401791743934155, + 0.19291965663433075, + 0.6573592126369476, + 0.300034049898386, + 0.013010287657380104, + 1.5915197245776653, + 0.15628816559910774, + 0.6427946053445339, + 0.293717578984797, + 0.03443320095539093, + 0.3248760960996151, + 0.8675027973949909, + 0.9417520835995674, + 0.0, + 0.4777686707675457, + 0.311095517128706, + 0.30699266493320465, + 0.40047842264175415, + 1.434703666716814, + 0.31533699110150337, + 0.0, + 0.12992811668664217, + 0.9052903614938259, + 1.805511735379696, + 0.0, + 0.8476138226687908, + 0.39042117074131966, + 0.32728539407253265, + 0.4236895591020584, + 0.198578841984272, + 0.10034523904323578, + 0.11773831024765968, + 0.43301195837557316, + 2.4744039960205555, + 0.13529549539089203, + 0.8298559859395027, + 0.650477696210146, + 0.1872783713042736, + 0.13309414312243462, + 0.2887750808149576, + 0.08687293156981468 + ], + "unique_experts": 59, + "load_cv": 0.8777862165557788, + "normalized_load_entropy": 0.911949466448708, + "max_load_share": 0.06888888888888889 + } + }, + "s0_period": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "d57dbf0521c308a3b05637a292236a73d97b38319f32db2377a21d63a1d66f36", + "route_weight_sha256": "f85b4fa81a5b63befaee4be32ebd2fa959a8fbcd52de58c201ae6429c6326650", + "loads": [ + 4, + 7, + 4, + 2, + 3, + 1, + 0, + 1, + 1, + 1, + 1, + 5, + 0, + 4, + 0, + 2, + 5, + 0, + 4, + 4, + 0, + 0, + 2, + 3, + 1, + 3, + 0, + 0, + 13, + 3, + 7, + 3, + 2, + 3, + 9, + 4, + 0, + 6, + 2, + 5, + 0, + 2, + 4, + 0, + 0, + 0, + 3, + 0, + 5, + 2, + 3, + 6, + 3, + 0, + 2, + 4, + 26, + 5, + 7, + 8, + 3, + 2, + 3, + 1 + ], + "weighted_loads": [ + 0.22820556163787842, + 0.5410424992442131, + 0.46830837056040764, + 0.059734439477324486, + 0.15878018364310265, + 0.03828287497162819, + 0.0, + 0.0392642542719841, + 0.11067228019237518, + 0.03999832645058632, + 0.032486408948898315, + 0.2675914019346237, + 0.0, + 0.2570588141679764, + 0.0, + 0.10729663074016571, + 0.25862274318933487, + 0.0, + 0.39301396161317825, + 0.4156212955713272, + 0.0, + 0.0, + 0.07600904069840908, + 0.18865784630179405, + 0.03497753292322159, + 0.11926448345184326, + 0.0, + 0.0, + 1.1875045634806156, + 0.1508261263370514, + 0.4564460813999176, + 0.11217312142252922, + 0.06037457659840584, + 0.13935479149222374, + 0.4957520551979542, + 0.2254539392888546, + 0.0, + 0.34119416400790215, + 0.07898865640163422, + 0.2070212960243225, + 0.0, + 0.07263432070612907, + 0.22179776802659035, + 0.0, + 0.0, + 0.0, + 0.20317551121115685, + 0.0, + 0.3851098604500294, + 0.06539939343929291, + 0.12714224681258202, + 0.3812481537461281, + 0.199607253074646, + 0.0, + 0.083124540746212, + 0.2065976820886135, + 2.266770802438259, + 0.1529257521033287, + 0.5478474199771881, + 0.37587512098252773, + 0.18931765109300613, + 0.09741661697626114, + 0.13177721574902534, + 0.05286912992596626 + ], + "unique_experts": 49, + "load_cv": 1.2110918875829222, + "normalized_load_entropy": 0.8660149734263529, + "max_load_share": 0.12745098039215685 + }, + "full_input": { + "tokens": 59, + "top_k": 6, + "decisions": 354, + "ordered_route_sha256": "bbd68a4dffc40f7cb6dbe4703c4db739afb4610137c36fe799a9a3b365d9f5f5", + "route_weight_sha256": "25e4a66c101a6b51ff9d2b3d034eb60637de27ade5dcacdaac5d106c41940672", + "loads": [ + 13, + 10, + 4, + 2, + 5, + 1, + 0, + 1, + 3, + 1, + 13, + 5, + 2, + 8, + 0, + 2, + 7, + 4, + 4, + 13, + 0, + 0, + 6, + 6, + 5, + 5, + 0, + 1, + 13, + 3, + 9, + 8, + 2, + 3, + 19, + 10, + 0, + 6, + 5, + 5, + 0, + 12, + 4, + 0, + 4, + 8, + 14, + 0, + 7, + 2, + 8, + 7, + 3, + 1, + 2, + 9, + 31, + 5, + 9, + 12, + 3, + 2, + 5, + 2 + ], + "weighted_loads": [ + 0.8991515412926674, + 0.7321704141795635, + 0.46830837056040764, + 0.059734439477324486, + 0.4056428112089634, + 0.03828287497162819, + 0.0, + 0.0392642542719841, + 0.20696643367409706, + 0.03999832645058632, + 1.3040577992796898, + 0.2675914019346237, + 0.045841531828045845, + 0.4983387030661106, + 0.0, + 0.10729663074016571, + 0.36293649300932884, + 0.1800177600234747, + 0.39301396161317825, + 1.2700639180839062, + 0.0, + 0.0, + 0.7336776591837406, + 0.45955784246325493, + 0.2019777037203312, + 0.23786545172333717, + 0.0, + 0.013010287657380104, + 1.1875045634806156, + 0.1508261263370514, + 0.5596272051334381, + 0.2987398123368621, + 0.06037457659840584, + 0.13935479149222374, + 1.0408363323658705, + 0.619014672935009, + 0.0, + 0.34119416400790215, + 0.19964484125375748, + 0.2070212960243225, + 0.0, + 1.0253691636025906, + 0.22179776802659035, + 0.0, + 0.29456974286586046, + 0.6185197494924068, + 1.0778399556875229, + 0.0, + 0.5388646833598614, + 0.06539939343929291, + 0.4197256602346897, + 0.4153580069541931, + 0.199607253074646, + 0.044809553772211075, + 0.083124540746212, + 0.46905553340911865, + 2.509338829666376, + 0.1529257521033287, + 0.6824041903018951, + 0.5514728222042322, + 0.18931765109300613, + 0.09741661697626114, + 0.18760321661829948, + 0.08909739926457405 + ], + "unique_experts": 55, + "load_cv": 0.9693670656155122, + "normalized_load_entropy": 0.8970408876945938, + "max_load_share": 0.08757062146892655 + } + }, + "s1_period": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "77d14b81fdcd76fad50591254b7eb978719a277d35dfabe54e29b481873fcb63", + "route_weight_sha256": "15f03b141acba59824daaa44f47704bd3bddef36fe8a6d2f5a4fb100aa9c7ae5", + "loads": [ + 4, + 7, + 4, + 1, + 3, + 2, + 0, + 0, + 1, + 1, + 1, + 5, + 0, + 5, + 0, + 2, + 5, + 1, + 4, + 4, + 0, + 0, + 2, + 3, + 0, + 4, + 0, + 0, + 13, + 3, + 7, + 4, + 1, + 2, + 9, + 4, + 0, + 6, + 2, + 5, + 0, + 2, + 4, + 0, + 0, + 0, + 3, + 0, + 5, + 2, + 3, + 6, + 3, + 0, + 2, + 4, + 26, + 5, + 7, + 8, + 3, + 2, + 3, + 1 + ], + "weighted_loads": [ + 0.20865860767662525, + 0.5389186143875122, + 0.4597863219678402, + 0.03120890073478222, + 0.1568809524178505, + 0.07174904271960258, + 0.0, + 0.0, + 0.11358930170536041, + 0.038534458726644516, + 0.03255809098482132, + 0.2715405337512493, + 0.0, + 0.3015780635178089, + 0.0, + 0.10554173588752747, + 0.2562118098139763, + 0.02294681780040264, + 0.40083858370780945, + 0.4003044366836548, + 0.0, + 0.0, + 0.07542055286467075, + 0.18051565438508987, + 0.0, + 0.17199115455150604, + 0.0, + 0.0, + 1.1556705869734287, + 0.15328632295131683, + 0.4381464272737503, + 0.15031198970973492, + 0.03565847873687744, + 0.10697497799992561, + 0.49993880838155746, + 0.23402885347604752, + 0.0, + 0.3292733058333397, + 0.06460114754736423, + 0.19597862288355827, + 0.0, + 0.07506416365504265, + 0.22084588184952736, + 0.0, + 0.0, + 0.0, + 0.20507445558905602, + 0.0, + 0.38521990552544594, + 0.06198783591389656, + 0.1277821734547615, + 0.38642992451786995, + 0.1953151896595955, + 0.0, + 0.07683482393622398, + 0.20466939359903336, + 2.2319930531084538, + 0.16315207444131374, + 0.5375553742051125, + 0.382241677492857, + 0.1887790709733963, + 0.09609104320406914, + 0.13539664819836617, + 0.05122898519039154 + ], + "unique_experts": 48, + "load_cv": 1.2199482533570416, + "normalized_load_entropy": 0.8616481613610373, + "max_load_share": 0.12745098039215685 + }, + "full_input": { + "tokens": 75, + "top_k": 6, + "decisions": 450, + "ordered_route_sha256": "bb84099ee87822ce329a269b753d75174d6710adbe60d915acf684edc0ee3944", + "route_weight_sha256": "4f898332ea74d62c16271e20129cdaabe0057652e757701e96f6860af6ed80fd", + "loads": [ + 17, + 12, + 4, + 1, + 5, + 2, + 0, + 0, + 7, + 3, + 13, + 7, + 2, + 9, + 1, + 2, + 7, + 3, + 4, + 13, + 0, + 3, + 6, + 14, + 5, + 14, + 4, + 1, + 19, + 3, + 10, + 8, + 1, + 5, + 15, + 16, + 0, + 9, + 7, + 6, + 6, + 17, + 6, + 0, + 3, + 10, + 24, + 0, + 12, + 7, + 6, + 7, + 3, + 3, + 3, + 10, + 32, + 5, + 12, + 13, + 3, + 3, + 5, + 2 + ], + "weighted_loads": [ + 1.0844508428126574, + 0.8028221912682056, + 0.4597863219678402, + 0.03120890073478222, + 0.4338342323899269, + 0.07174904271960258, + 0.0, + 0.0, + 0.49429503455758095, + 0.1302795633673668, + 1.194509956985712, + 0.3682614490389824, + 0.04704953543841839, + 0.519813384860754, + 0.0392376147210598, + 0.10554173588752747, + 0.3553391098976135, + 0.13199391402304173, + 0.40083858370780945, + 1.3504129126667976, + 0.0, + 0.1263238713145256, + 0.734396306797862, + 1.0214470066130161, + 0.19291965663433075, + 0.6932654194533825, + 0.25377771630883217, + 0.013010287657380104, + 1.5798911601305008, + 0.15328632295131683, + 0.6510682329535484, + 0.2946907328441739, + 0.03565847873687744, + 0.32885101065039635, + 0.805931705981493, + 0.9895048402249813, + 0.0, + 0.47095589339733124, + 0.3260426055639982, + 0.2629965804517269, + 0.40047842264175415, + 1.5293887481093407, + 0.31283802166581154, + 0.0, + 0.12992811668664217, + 0.8368276916444302, + 2.0175284445285797, + 0.0, + 0.8319706059992313, + 0.3898455575108528, + 0.3330250009894371, + 0.41992688179016113, + 0.1953151896595955, + 0.14829598367214203, + 0.11787937954068184, + 0.4794736709445715, + 2.5075293742120266, + 0.16315207444131374, + 0.826246801763773, + 0.5997001342475414, + 0.1887790709733963, + 0.13409623876214027, + 0.29196796379983425, + 0.08725159615278244 + ], + "unique_experts": 58, + "load_cv": 0.8835282803748968, + "normalized_load_entropy": 0.9111561588417627, + "max_load_share": 0.07111111111111111 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 34, + "ordered_topk_exact_tokens": 27, + "set_exact_tokens": 30, + "mean_set_jaccard": 0.9663865546218489, + "mean_token_weighted_tv": 0.00845572053838302, + "aggregate_load_tv": 0.0196078431372549 + }, + "system_bos": { + "tokens": 34, + "ordered_topk_exact_tokens": 20, + "set_exact_tokens": 25, + "mean_set_jaccard": 0.9243697478991597, + "mean_token_weighted_tv": 0.014349938315503737, + "aggregate_load_tv": 0.03431372549019608 + }, + "system_x": { + "tokens": 34, + "ordered_topk_exact_tokens": 21, + "set_exact_tokens": 25, + "mean_set_jaccard": 0.9180672268907564, + "mean_token_weighted_tv": 0.016793542212861425, + "aggregate_load_tv": 0.044117647058823525 + }, + "system_period": { + "tokens": 34, + "ordered_topk_exact_tokens": 21, + "set_exact_tokens": 26, + "mean_set_jaccard": 0.9264705882352944, + "mean_token_weighted_tv": 0.01630978614968412, + "aggregate_load_tv": 0.02450980392156863 + }, + "bos_at_s0": { + "tokens": 34, + "ordered_topk_exact_tokens": 19, + "set_exact_tokens": 23, + "mean_set_jaccard": 0.907563025210084, + "mean_token_weighted_tv": 0.01865319603615824, + "aggregate_load_tv": 0.049019607843137254 + }, + "bos_at_s1": { + "tokens": 34, + "ordered_topk_exact_tokens": 18, + "set_exact_tokens": 21, + "mean_set_jaccard": 0.8907563025210083, + "mean_token_weighted_tv": 0.021279522382161197, + "aggregate_load_tv": 0.053921568627450976 + }, + "x_at_s0": { + "tokens": 34, + "ordered_topk_exact_tokens": 21, + "set_exact_tokens": 21, + "mean_set_jaccard": 0.8907563025210085, + "mean_token_weighted_tv": 0.020905281827949426, + "aggregate_load_tv": 0.053921568627450976 + }, + "x_at_s1": { + "tokens": 34, + "ordered_topk_exact_tokens": 19, + "set_exact_tokens": 22, + "mean_set_jaccard": 0.8991596638655464, + "mean_token_weighted_tv": 0.022532671963905588, + "aggregate_load_tv": 0.04901960784313725 + }, + "period_at_s0": { + "tokens": 34, + "ordered_topk_exact_tokens": 21, + "set_exact_tokens": 22, + "mean_set_jaccard": 0.8991596638655461, + "mean_token_weighted_tv": 0.019279043765409905, + "aggregate_load_tv": 0.053921568627450976 + }, + "period_at_s1": { + "tokens": 34, + "ordered_topk_exact_tokens": 19, + "set_exact_tokens": 24, + "mean_set_jaccard": 0.9159663865546219, + "mean_token_weighted_tv": 0.02017011077088468, + "aggregate_load_tv": 0.0392156862745098 + } + } + }, + "layer_10": { + "layer": 10, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "97c42e890bf6c1d096c6dfa7cfd3271bba1f1e26495d2cf03b30f50b848f0084", + "route_weight_sha256": "fbe926a976bc0a509a63aa134855d1decd5213de398590a1763330f82d214c09", + "loads": [ + 0, + 0, + 1, + 2, + 6, + 1, + 7, + 1, + 2, + 8, + 2, + 7, + 1, + 0, + 5, + 1, + 1, + 1, + 6, + 2, + 2, + 21, + 0, + 1, + 1, + 4, + 3, + 0, + 3, + 7, + 3, + 6, + 2, + 9, + 0, + 4, + 0, + 1, + 5, + 6, + 0, + 0, + 5, + 2, + 3, + 8, + 7, + 9, + 0, + 1, + 0, + 1, + 2, + 4, + 0, + 3, + 2, + 5, + 3, + 0, + 5, + 0, + 6, + 6 + ], + "weighted_loads": [ + 0.0, + 0.0, + 0.04065924882888794, + 0.0887051671743393, + 0.7786021418869495, + 0.0403551384806633, + 0.42848918959498405, + 0.03701125830411911, + 0.09143175929784775, + 0.3421531021595001, + 0.11711307242512703, + 0.7871057093143463, + 0.057476989924907684, + 0.0, + 0.444735512137413, + 0.030301926657557487, + 0.06165483966469765, + 0.048401206731796265, + 0.2248991411179304, + 0.09825494885444641, + 0.05745476670563221, + 1.6240788958966732, + 0.0, + 0.03618892282247543, + 0.03538940101861954, + 0.2226025126874447, + 0.13004396483302116, + 0.0, + 0.14316631853580475, + 0.40978027507662773, + 0.21889124065637589, + 0.282463900744915, + 0.07106630504131317, + 0.38390243612229824, + 0.0, + 0.3843589350581169, + 0.0, + 0.08331763744354248, + 0.2432088516652584, + 0.5351342670619488, + 0.0, + 0.0, + 0.45813334733247757, + 0.09461917728185654, + 0.15718872100114822, + 0.4335823468863964, + 0.5253790244460106, + 0.7011487483978271, + 0.0, + 0.06687101721763611, + 0.0, + 0.05723471939563751, + 0.1844504401087761, + 0.1845339797437191, + 0.0, + 0.1284935213625431, + 0.07163964584469795, + 0.4196724519133568, + 0.11926876753568649, + 0.0, + 0.29009537026286125, + 0.0, + 0.32265834510326385, + 0.2915499582886696 + ], + "unique_experts": 50, + "load_cv": 1.0866000786272478, + "normalized_load_entropy": 0.8722510936512502, + "max_load_share": 0.10294117647058823 + }, + "full_input": { + "tokens": 59, + "top_k": 6, + "decisions": 354, + "ordered_route_sha256": "920c7c8febf76f87abfb242581734f7324584191f5a6d1ffd72e2c0dbbd15ecc", + "route_weight_sha256": "a1c02ae1a55d7ab52f907eaa0fac4b30e0dfcfdc67ccd4dc3e009f964833be50", + "loads": [ + 0, + 0, + 3, + 2, + 6, + 1, + 7, + 5, + 2, + 10, + 4, + 8, + 2, + 3, + 8, + 1, + 1, + 4, + 13, + 5, + 5, + 23, + 1, + 1, + 1, + 6, + 3, + 6, + 4, + 8, + 7, + 7, + 2, + 17, + 1, + 5, + 0, + 1, + 5, + 6, + 0, + 8, + 10, + 4, + 7, + 11, + 13, + 13, + 0, + 3, + 2, + 7, + 2, + 6, + 0, + 12, + 2, + 12, + 3, + 11, + 10, + 12, + 6, + 6 + ], + "weighted_loads": [ + 0.0, + 0.0, + 0.05967645114287734, + 0.0887051671743393, + 0.7786021418869495, + 0.0403551384806633, + 0.42848918959498405, + 0.2140234149992466, + 0.09143175929784775, + 0.36656574066728354, + 0.21404718235135078, + 0.8324492797255516, + 0.09022768586874008, + 1.4161331169307232, + 0.6624590195715427, + 0.030301926657557487, + 0.06165483966469765, + 0.22248826175928116, + 0.6096280911006033, + 0.32606881856918335, + 0.1707788985222578, + 1.7077242508530617, + 0.0037237585056573153, + 0.03618892282247543, + 0.03538940101861954, + 0.2861604355275631, + 0.13004396483302116, + 0.6934341937303543, + 0.19005274400115013, + 0.45130038261413574, + 0.5888113155961037, + 0.29623748175799847, + 0.07106630504131317, + 0.8153487537056208, + 0.029899246990680695, + 0.4213644303381443, + 0.0, + 0.08331763744354248, + 0.2432088516652584, + 0.5351342670619488, + 0.0, + 0.806584183126688, + 0.6316383443772793, + 0.1924079805612564, + 0.35724540427327156, + 0.5816737227141857, + 0.7947718016803265, + 0.9042209126055241, + 0.0, + 0.16290247812867165, + 0.09202998876571655, + 0.37011710926890373, + 0.1844504401087761, + 0.2856747955083847, + 0.0, + 0.8174559995532036, + 0.07163964584469795, + 0.8050739392638206, + 0.11926876753568649, + 0.7678029797971249, + 0.6323161423206329, + 1.0300476923584938, + 0.32265834510326385, + 0.2915499582886696 + ], + "unique_experts": 58, + "load_cv": 0.8346107225843298, + "normalized_load_entropy": 0.9153549655194927, + "max_load_share": 0.06497175141242938 + } + }, + "s1_eos": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "8ec085a826637f7e65d488d998981c7454b9480b09239d3a58ac6dadf8c4faa4", + "route_weight_sha256": "e538e737940f0239ff3c4415e300db8ef347a7335a77da04a5fa26c0299bd658", + "loads": [ + 1, + 0, + 2, + 1, + 6, + 1, + 7, + 2, + 2, + 8, + 2, + 7, + 1, + 0, + 5, + 1, + 1, + 1, + 5, + 2, + 1, + 21, + 0, + 1, + 1, + 4, + 3, + 0, + 3, + 7, + 3, + 6, + 2, + 10, + 1, + 4, + 0, + 1, + 5, + 6, + 0, + 0, + 5, + 2, + 3, + 8, + 7, + 9, + 0, + 1, + 0, + 1, + 2, + 4, + 0, + 2, + 2, + 5, + 3, + 0, + 4, + 0, + 7, + 5 + ], + "weighted_loads": [ + 0.032565969973802567, + 0.0, + 0.07415642030537128, + 0.05321689322590828, + 0.7774358615279198, + 0.03965391218662262, + 0.4356568939983845, + 0.0687779076397419, + 0.09181618317961693, + 0.339717585593462, + 0.11703963950276375, + 0.7889103293418884, + 0.05568772181868553, + 0.0, + 0.44659480452537537, + 0.03036595694720745, + 0.06104935705661774, + 0.04817260056734085, + 0.19590947031974792, + 0.095878966152668, + 0.029791230335831642, + 1.6171624101698399, + 0.0, + 0.03818739950656891, + 0.03623416647315025, + 0.22356266528367996, + 0.131223414093256, + 0.0, + 0.1437140889465809, + 0.40935467556118965, + 0.21719014644622803, + 0.2797793112695217, + 0.07329822331666946, + 0.4194359574466944, + 0.02843790501356125, + 0.38330062478780746, + 0.0, + 0.08346333354711533, + 0.24137065559625626, + 0.5400414206087589, + 0.0, + 0.0, + 0.45337607711553574, + 0.10172345861792564, + 0.15634622424840927, + 0.4390726126730442, + 0.5306874588131905, + 0.6966503299772739, + 0.0, + 0.06941916048526764, + 0.0, + 0.05951182171702385, + 0.1872950792312622, + 0.18495840206742287, + 0.0, + 0.08186778426170349, + 0.06765375286340714, + 0.4177108630537987, + 0.1197226271033287, + 0.0, + 0.2532612010836601, + 0.0, + 0.3602098375558853, + 0.25528812408447266 + ], + "unique_experts": 52, + "load_cv": 1.0851838511389578, + "normalized_load_entropy": 0.8766082273525667, + "max_load_share": 0.10294117647058823 + }, + "full_input": { + "tokens": 75, + "top_k": 6, + "decisions": 450, + "ordered_route_sha256": "895260a5d5b2500c83aafcee43a9de3c1da545190242b9f99fded324fcad3d2d", + "route_weight_sha256": "db67f70b142fddefaa15c4e5cd8f8aedc74d0881f85f3daa844e813346ec75fd", + "loads": [ + 1, + 0, + 4, + 1, + 11, + 1, + 7, + 4, + 2, + 10, + 4, + 10, + 5, + 2, + 9, + 1, + 1, + 6, + 11, + 4, + 2, + 23, + 1, + 1, + 2, + 7, + 5, + 20, + 3, + 10, + 13, + 7, + 7, + 28, + 3, + 6, + 2, + 3, + 6, + 6, + 1, + 14, + 10, + 4, + 6, + 13, + 13, + 13, + 8, + 4, + 3, + 14, + 3, + 7, + 0, + 15, + 3, + 12, + 3, + 19, + 14, + 10, + 7, + 5 + ], + "weighted_loads": [ + 0.032565969973802567, + 0.0, + 0.09328072844073176, + 0.05321689322590828, + 1.0139523148536682, + 0.03965391218662262, + 0.4356568939983845, + 0.15110143274068832, + 0.09181618317961693, + 0.36478592175990343, + 0.19456781446933746, + 0.96156807243824, + 0.2553427889943123, + 1.3752819895744324, + 0.7458978481590748, + 0.03036595694720745, + 0.06104935705661774, + 0.33159314468503, + 0.5597094506956637, + 0.2672061398625374, + 0.07003399543464184, + 1.7039206810295582, + 0.00389368599280715, + 0.03818739950656891, + 0.07834283262491226, + 0.5505291502922773, + 0.2021863516420126, + 1.3013546653091908, + 0.1437140889465809, + 0.5429422147572041, + 1.026510525494814, + 0.29355289228260517, + 0.566069670021534, + 1.3541249074041843, + 0.17134439013898373, + 0.5483631566166878, + 0.08492380008101463, + 0.16996293514966965, + 0.279215756803751, + 0.5400414206087589, + 0.042586799710989, + 1.179131157696247, + 0.6097898399457335, + 0.16978609189391136, + 0.33352911472320557, + 0.7052311338484287, + 0.8551354631781578, + 0.8961905911564827, + 0.6446705125272274, + 0.24067162722349167, + 0.17776433378458023, + 0.8280762359499931, + 0.2570278123021126, + 0.33596955984830856, + 0.0, + 1.0298895239830017, + 0.14073725789785385, + 0.8168381378054619, + 0.1197226271033287, + 1.2536497935652733, + 0.9901494532823563, + 0.8940789960324764, + 0.3602098375558853, + 0.25528812408447266 + ], + "unique_experts": 62, + "load_cv": 0.8273712648361333, + "normalized_load_entropy": 0.9222761727856116, + "max_load_share": 0.06222222222222222 + } + }, + "s0_bos": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "ef7acc2172820c1d877d589ff81085d0a87cc7ae10ce9ea00d87634eb7aca0cb", + "route_weight_sha256": "6506d3779cf0d6185b358f0497b6007da164b89ea5517a2ffef05f344a15eb01", + "loads": [ + 0, + 0, + 1, + 3, + 6, + 2, + 7, + 0, + 2, + 9, + 2, + 7, + 1, + 1, + 5, + 1, + 1, + 1, + 4, + 2, + 2, + 22, + 0, + 1, + 1, + 4, + 3, + 0, + 2, + 7, + 3, + 6, + 1, + 9, + 0, + 4, + 0, + 1, + 5, + 6, + 0, + 0, + 5, + 2, + 3, + 9, + 7, + 9, + 0, + 1, + 0, + 1, + 2, + 4, + 0, + 2, + 2, + 5, + 3, + 0, + 5, + 0, + 6, + 6 + ], + "weighted_loads": [ + 0.0, + 0.0, + 0.040701884776353836, + 0.1296488754451275, + 0.7652428932487965, + 0.0770246684551239, + 0.45260073617100716, + 0.0, + 0.08740917593240738, + 0.38339271768927574, + 0.11922770366072655, + 0.8004113994538784, + 0.061093784868717194, + 0.035068340599536896, + 0.44398093968629837, + 0.029424022883176804, + 0.06148707494139671, + 0.05236230045557022, + 0.15244433656334877, + 0.09097916632890701, + 0.0603121817111969, + 1.6759853698313236, + 0.0, + 0.03918469324707985, + 0.035192761570215225, + 0.22548643127083778, + 0.12699999660253525, + 0.0, + 0.08685275167226791, + 0.4112667888402939, + 0.21884030103683472, + 0.281276386231184, + 0.037955235689878464, + 0.39070896804332733, + 0.0, + 0.38110265135765076, + 0.0, + 0.0770467221736908, + 0.24631496891379356, + 0.5372066684067249, + 0.0, + 0.0, + 0.4612507000565529, + 0.07977906800806522, + 0.1518567055463791, + 0.46481989696621895, + 0.5026484355330467, + 0.6995417177677155, + 0.0, + 0.06606357544660568, + 0.0, + 0.054372336715459824, + 0.18635515123605728, + 0.1840641312301159, + 0.0, + 0.0875786729156971, + 0.07119107618927956, + 0.4433804899454117, + 0.11682505905628204, + 0.0, + 0.2867303676903248, + 0.0, + 0.3252548649907112, + 0.30346181616187096 + ], + "unique_experts": 50, + "load_cv": 1.1227951609584634, + "normalized_load_entropy": 0.8684416024330003, + "max_load_share": 0.10784313725490197 + }, + "full_input": { + "tokens": 59, + "top_k": 6, + "decisions": 354, + "ordered_route_sha256": "b487e0e488989105a6398a9401c452b346a2d8ff569ffefeef052433002983b9", + "route_weight_sha256": "6dcbeb53a3f1fbb7b5b259ee4975854bf24be2377f208ce43fdc428178f92909", + "loads": [ + 0, + 0, + 2, + 3, + 6, + 2, + 7, + 4, + 2, + 10, + 4, + 8, + 2, + 4, + 9, + 1, + 1, + 4, + 10, + 5, + 6, + 24, + 0, + 1, + 1, + 6, + 3, + 7, + 3, + 8, + 7, + 7, + 1, + 17, + 1, + 5, + 0, + 1, + 5, + 6, + 0, + 9, + 10, + 4, + 6, + 12, + 13, + 13, + 0, + 4, + 2, + 7, + 2, + 5, + 0, + 11, + 2, + 12, + 3, + 12, + 10, + 12, + 6, + 6 + ], + "weighted_loads": [ + 0.0, + 0.0, + 0.05485489033162594, + 0.1296488754451275, + 0.7652428932487965, + 0.0770246684551239, + 0.45260073617100716, + 0.1770121566951275, + 0.08740917593240738, + 0.39961697719991207, + 0.2161618135869503, + 0.8457549698650837, + 0.09384448081254959, + 0.5805272348225117, + 0.7208654172718525, + 0.029424022883176804, + 0.06148707494139671, + 0.2307715304195881, + 0.5552679374814034, + 0.3158324919641018, + 0.24647578969597816, + 1.759630724787712, + 0.0, + 0.03918469324707985, + 0.035192761570215225, + 0.2890443541109562, + 0.12699999660253525, + 0.8217024095356464, + 0.1337391771376133, + 0.4527868963778019, + 0.578616838902235, + 0.29504996724426746, + 0.037955235689878464, + 0.8203513361513615, + 0.029899246990680695, + 0.41810814663767815, + 0.0, + 0.0770467221736908, + 0.24631496891379356, + 0.5372066684067249, + 0.0, + 1.0177765414118767, + 0.6791648790240288, + 0.1775678712874651, + 0.3408883661031723, + 0.6129112727940083, + 0.7720412127673626, + 0.9088252782821655, + 0.0, + 0.23855889588594437, + 0.09202998876571655, + 0.3406546078622341, + 0.18635515123605728, + 0.2502398155629635, + 0.0, + 0.7837300412356853, + 0.07119107618927956, + 0.8287819772958755, + 0.11682505905628204, + 0.8064068369567394, + 0.6267815828323364, + 1.0300476923584938, + 0.3252548649907112, + 0.30346181616187096 + ], + "unique_experts": 57, + "load_cv": 0.8443445647028892, + "normalized_load_entropy": 0.9131088902398125, + "max_load_share": 0.06779661016949153 + } + }, + "s1_bos": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "f78ea5804ca4afa4121ece7fe734566187e80f98542c23765e8c46732d965824", + "route_weight_sha256": "fb6e797a1f0b8fc807d4f1a05d2966d294c4b398355abdd75a21c64b6a9856a6", + "loads": [ + 0, + 0, + 1, + 3, + 6, + 1, + 7, + 1, + 2, + 10, + 2, + 7, + 1, + 1, + 5, + 0, + 2, + 1, + 3, + 2, + 2, + 22, + 0, + 1, + 1, + 4, + 3, + 0, + 2, + 7, + 3, + 6, + 1, + 9, + 0, + 4, + 0, + 1, + 4, + 7, + 0, + 0, + 5, + 2, + 3, + 9, + 7, + 9, + 0, + 1, + 0, + 1, + 2, + 4, + 0, + 2, + 2, + 5, + 3, + 0, + 5, + 0, + 6, + 6 + ], + "weighted_loads": [ + 0.0, + 0.0, + 0.0412217415869236, + 0.12849504128098488, + 0.7589156776666641, + 0.03855505958199501, + 0.45005447417497635, + 0.033969368785619736, + 0.08714581653475761, + 0.4105687811970711, + 0.11727886646986008, + 0.8139294423162937, + 0.06194966286420822, + 0.0383126400411129, + 0.43877289444208145, + 0.0, + 0.0903962105512619, + 0.053859103471040726, + 0.12212537974119186, + 0.09405346214771271, + 0.05970485135912895, + 1.6678592525422573, + 0.0, + 0.0378260537981987, + 0.036443278193473816, + 0.22352591902017593, + 0.12470763176679611, + 0.0, + 0.09955933317542076, + 0.4139634892344475, + 0.221178337931633, + 0.286670733243227, + 0.04014889523386955, + 0.39093630760908127, + 0.0, + 0.38786957412958145, + 0.0, + 0.07529737055301666, + 0.194805558770895, + 0.583648007363081, + 0.0, + 0.0, + 0.4560402035713196, + 0.08705244958400726, + 0.15167775750160217, + 0.479716170579195, + 0.531769160181284, + 0.6935605555772781, + 0.0, + 0.05980592593550682, + 0.0, + 0.05759729817509651, + 0.17953579872846603, + 0.18800195679068565, + 0.0, + 0.08640237152576447, + 0.06906405463814735, + 0.4329362139105797, + 0.12273154780268669, + 0.0, + 0.28568093106150627, + 0.0, + 0.3204973228275776, + 0.30138445273041725 + ], + "unique_experts": 50, + "load_cv": 1.133699649056766, + "normalized_load_entropy": 0.8668264779120071, + "max_load_share": 0.10784313725490197 + }, + "full_input": { + "tokens": 75, + "top_k": 6, + "decisions": 450, + "ordered_route_sha256": "b935bd68f288565e3e70ea2088cec0c633aa58b0de33d5b0e013ad225feb28e7", + "route_weight_sha256": "efd3c1100994f4030ee84ab1208c1e96c8a9d79a20a9c8b52c9dd7efa26f3ca9", + "loads": [ + 0, + 0, + 2, + 3, + 11, + 1, + 7, + 3, + 2, + 11, + 4, + 10, + 5, + 3, + 10, + 0, + 2, + 5, + 8, + 5, + 4, + 24, + 0, + 1, + 2, + 7, + 5, + 21, + 2, + 10, + 13, + 7, + 6, + 27, + 2, + 6, + 2, + 3, + 5, + 7, + 1, + 15, + 8, + 4, + 6, + 14, + 13, + 13, + 8, + 5, + 3, + 14, + 3, + 7, + 0, + 15, + 3, + 12, + 3, + 20, + 15, + 10, + 6, + 6 + ], + "weighted_loads": [ + 0.0, + 0.0, + 0.0553747471421957, + 0.12849504128098488, + 0.9954321309924126, + 0.03855505958199501, + 0.45005447417497635, + 0.11629289388656616, + 0.08714581653475761, + 0.4267930407077074, + 0.1948070414364338, + 0.9865871854126453, + 0.261604730039835, + 0.5473797135055065, + 0.798887025564909, + 0.0, + 0.0903962105512619, + 0.29506221041083336, + 0.5211890749633312, + 0.30497852712869644, + 0.152783565223217, + 1.7546175234019756, + 0.0, + 0.0378260537981987, + 0.07855194434523582, + 0.5504924040287733, + 0.1956705693155527, + 1.402086514979601, + 0.09955933317542076, + 0.5475510284304619, + 1.019704643636942, + 0.30044431425631046, + 0.532920341938734, + 1.3322120029479265, + 0.14290648512542248, + 0.5529321059584618, + 0.08492380008101463, + 0.16179697215557098, + 0.23265065997838974, + 0.583648007363081, + 0.042586799710989, + 1.4345365911722183, + 0.5629526656121016, + 0.15511508285999298, + 0.3671570122241974, + 0.7458746917545795, + 0.8562171645462513, + 0.9031120613217354, + 0.6446705125272274, + 0.29900649935007095, + 0.17776433378458023, + 0.7981828078627586, + 0.2492685317993164, + 0.34222234413027763, + 0.0, + 1.0471987798810005, + 0.14214755967259407, + 0.8320634886622429, + 0.12273154780268669, + 1.3155151717364788, + 1.0195856355130672, + 0.8940789960324764, + 0.3204973228275776, + 0.30138445273041725 + ], + "unique_experts": 59, + "load_cv": 0.8451342212050413, + "normalized_load_entropy": 0.9173565453691099, + "max_load_share": 0.06 + } + }, + "s0_x": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "b78c7a9cb0602e29c0c9de20cea3dbc09c4cf941b32283dbd9aabe22ab8a0a2b", + "route_weight_sha256": "2abf61c212c862f68058dde6a87a0322e6c3646af7bf2fc9aaf0d17a335c777c", + "loads": [ + 0, + 0, + 1, + 2, + 6, + 2, + 7, + 2, + 2, + 8, + 2, + 7, + 1, + 0, + 5, + 1, + 1, + 1, + 5, + 3, + 2, + 22, + 0, + 1, + 1, + 4, + 3, + 0, + 1, + 7, + 3, + 6, + 1, + 7, + 0, + 4, + 0, + 1, + 4, + 6, + 0, + 1, + 5, + 2, + 3, + 9, + 7, + 9, + 0, + 1, + 0, + 1, + 2, + 4, + 1, + 3, + 2, + 5, + 3, + 1, + 5, + 0, + 5, + 6 + ], + "weighted_loads": [ + 0.0, + 0.0, + 0.04078001156449318, + 0.08422048762440681, + 0.7771942913532257, + 0.07536078244447708, + 0.4449501857161522, + 0.07023144885897636, + 0.08916391804814339, + 0.3451959379017353, + 0.11912339553236961, + 0.7990560717880726, + 0.0669839009642601, + 0.0, + 0.43102509528398514, + 0.029503336176276207, + 0.060347262769937515, + 0.05223248526453972, + 0.18948602303862572, + 0.13150080293416977, + 0.06047771871089935, + 1.6795832067728043, + 0.0, + 0.036646392196416855, + 0.034567758440971375, + 0.2204794269055128, + 0.12705201283097267, + 0.0, + 0.049265384674072266, + 0.4000655710697174, + 0.2248043268918991, + 0.27831338718533516, + 0.03847635164856911, + 0.3023450393229723, + 0.0, + 0.3894515633583069, + 0.0, + 0.08183547109365463, + 0.2020362839102745, + 0.5434369370341301, + 0.0, + 0.041040025651454926, + 0.45161324739456177, + 0.0800859909504652, + 0.1511395424604416, + 0.4737357385456562, + 0.5078906193375587, + 0.6753741465508938, + 0.0, + 0.0656432956457138, + 0.0, + 0.056053657084703445, + 0.1833392232656479, + 0.18252242356538773, + 0.037726160138845444, + 0.13053515553474426, + 0.06695353984832764, + 0.44149430096149445, + 0.11767461895942688, + 0.03729454427957535, + 0.28871839866042137, + 0.0, + 0.27381277829408646, + 0.3054151050746441 + ], + "unique_experts": 53, + "load_cv": 1.0866000786272478, + "normalized_load_entropy": 0.8803308284128084, + "max_load_share": 0.10784313725490197 + }, + "full_input": { + "tokens": 59, + "top_k": 6, + "decisions": 354, + "ordered_route_sha256": "062c9aaf42b001370bc8ddd655ce8891a5652b08a6c537761c5ff876d855e362", + "route_weight_sha256": "a62185b402fb152d379d18fb31880c9f36a3522ba457fd897986374c2a56c329", + "loads": [ + 0, + 0, + 2, + 2, + 6, + 2, + 7, + 7, + 2, + 9, + 4, + 8, + 2, + 2, + 8, + 1, + 1, + 5, + 10, + 6, + 5, + 24, + 0, + 1, + 1, + 6, + 3, + 5, + 2, + 8, + 7, + 7, + 1, + 16, + 1, + 5, + 0, + 1, + 4, + 6, + 0, + 8, + 9, + 4, + 7, + 13, + 14, + 14, + 0, + 3, + 2, + 7, + 2, + 6, + 1, + 12, + 2, + 13, + 3, + 13, + 10, + 13, + 5, + 6 + ], + "weighted_loads": [ + 0.0, + 0.0, + 0.05493301711976528, + 0.08422048762440681, + 0.7771942913532257, + 0.07536078244447708, + 0.4449501857161522, + 0.28715933859348297, + 0.08916391804814339, + 0.36142019741237164, + 0.21605750545859337, + 0.8443996421992779, + 0.0997345969080925, + 0.5039308778941631, + 0.652702771127224, + 0.029503336176276207, + 0.060347262769937515, + 0.2783906012773514, + 0.5274150893092155, + 0.3473077714443207, + 0.17380185052752495, + 1.7632285617291927, + 0.0, + 0.036646392196416855, + 0.034567758440971375, + 0.2840373497456312, + 0.12705201283097267, + 0.6591851785778999, + 0.09615181013941765, + 0.4415856786072254, + 0.5667292661964893, + 0.2920869681984186, + 0.03847635164856911, + 0.7763000000268221, + 0.029899246990680695, + 0.4264570586383343, + 0.0, + 0.08183547109365463, + 0.2020362839102745, + 0.5434369370341301, + 0.0, + 0.8000609949231148, + 0.6205561310052872, + 0.17787479422986507, + 0.3516921438276768, + 0.6950983218848705, + 0.8269912041723728, + 0.9245546720921993, + 0.0, + 0.16065917909145355, + 0.09202998876571655, + 0.3823239356279373, + 0.1833392232656479, + 0.29163869842886925, + 0.037726160138845444, + 0.8088071011006832, + 0.06695353984832764, + 0.8886926993727684, + 0.11767461895942688, + 0.8353585451841354, + 0.6432545259594917, + 1.1169167160987854, + 0.27381277829408646, + 0.3054151050746441 + ], + "unique_experts": 58, + "load_cv": 0.8640743794258227, + "normalized_load_entropy": 0.9108603003708595, + "max_load_share": 0.06779661016949153 + } + }, + "s1_x": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "7d9883ed5c253714a4bcdf71aae80089b9a4a5db1ba29b78a999b3627d0f9f9e", + "route_weight_sha256": "1efa2bf149f4d2d44c152a3f0aa37dd6a54ba059ebedd775ecd338e0f3cd764f", + "loads": [ + 0, + 0, + 2, + 3, + 6, + 2, + 7, + 1, + 2, + 10, + 2, + 7, + 1, + 0, + 5, + 0, + 1, + 1, + 4, + 2, + 1, + 22, + 0, + 1, + 1, + 3, + 2, + 0, + 1, + 7, + 5, + 6, + 1, + 8, + 1, + 4, + 0, + 1, + 4, + 6, + 0, + 1, + 5, + 2, + 3, + 9, + 7, + 9, + 0, + 2, + 0, + 1, + 2, + 4, + 1, + 2, + 2, + 5, + 2, + 1, + 5, + 0, + 6, + 5 + ], + "weighted_loads": [ + 0.0, + 0.0, + 0.06930594146251678, + 0.12092626839876175, + 0.7554737664759159, + 0.0763639323413372, + 0.440971989184618, + 0.035141754895448685, + 0.08649541810154915, + 0.4107815884053707, + 0.11587032675743103, + 0.8031033128499985, + 0.059247396886348724, + 0.0, + 0.42191028594970703, + 0.0, + 0.058566562831401825, + 0.05588121712207794, + 0.15715863928198814, + 0.09012895077466965, + 0.02968524768948555, + 1.6636792160570621, + 0.0, + 0.03544871136546135, + 0.03636950999498367, + 0.18711405247449875, + 0.0904710590839386, + 0.0, + 0.05240877345204353, + 0.3992092087864876, + 0.2951112203299999, + 0.2722017765045166, + 0.04200449585914612, + 0.3430562950670719, + 0.028663918375968933, + 0.39620015025138855, + 0.0, + 0.08101856708526611, + 0.18885914608836174, + 0.5435836724936962, + 0.0, + 0.045195817947387695, + 0.4452226310968399, + 0.08648381009697914, + 0.15073297917842865, + 0.4815836697816849, + 0.527447409927845, + 0.6712108179926872, + 0.0, + 0.08921832963824272, + 0.0, + 0.062117867171764374, + 0.1761079952120781, + 0.18493937328457832, + 0.03865906223654747, + 0.08582388982176781, + 0.06616391614079475, + 0.4404064416885376, + 0.08672702684998512, + 0.035716377198696136, + 0.2882635369896889, + 0.0, + 0.30520322546362877, + 0.2707950323820114 + ], + "unique_experts": 53, + "load_cv": 1.1117837256733205, + "normalized_load_entropy": 0.8759982026056352, + "max_load_share": 0.10784313725490197 + }, + "full_input": { + "tokens": 75, + "top_k": 6, + "decisions": 450, + "ordered_route_sha256": "f234e8987772defb7b8d2f34e75a433e9fdd2616eb16d7eca1b6a72d3af4030a", + "route_weight_sha256": "31ad8713d81af29e8e3538a21d8bd22dd4976abf7a6954f0abd4ad00691b64fb", + "loads": [ + 0, + 0, + 3, + 3, + 11, + 2, + 7, + 4, + 2, + 11, + 5, + 10, + 5, + 1, + 10, + 0, + 1, + 6, + 8, + 4, + 2, + 24, + 0, + 1, + 2, + 6, + 4, + 18, + 1, + 10, + 15, + 7, + 6, + 27, + 3, + 6, + 2, + 3, + 5, + 6, + 1, + 15, + 9, + 4, + 5, + 15, + 14, + 14, + 8, + 5, + 5, + 14, + 3, + 7, + 1, + 14, + 3, + 13, + 2, + 20, + 15, + 11, + 6, + 5 + ], + "weighted_loads": [ + 0.0, + 0.0, + 0.08345894701778889, + 0.12092626839876175, + 0.9919902198016644, + 0.0763639323413372, + 0.440971989184618, + 0.1670062616467476, + 0.08649541810154915, + 0.42700584791600704, + 0.24276065081357956, + 0.9757610559463501, + 0.2589024640619755, + 0.4690502882003784, + 0.7841562479734421, + 0.0, + 0.058566562831401825, + 0.36080310121178627, + 0.4814921095967293, + 0.23584211990237236, + 0.06992801278829575, + 1.7504374869167805, + 0.0, + 0.03544871136546135, + 0.07847817614674568, + 0.5140805374830961, + 0.1614339966326952, + 1.2225074879825115, + 0.05240877345204353, + 0.532796747982502, + 1.0703924857079983, + 0.28597535751760006, + 0.5347759425640106, + 1.32178976200521, + 0.1715704035013914, + 0.5612626820802689, + 0.08492380008101463, + 0.16751816868782043, + 0.22670424729585648, + 0.5435836724936962, + 0.042586799710989, + 1.2255766242742538, + 0.5924445185810328, + 0.15454644337296486, + 0.29379769414663315, + 0.8112153634428978, + 0.9181908294558525, + 0.9263167195022106, + 0.6446705125272274, + 0.267804853618145, + 0.25686924904584885, + 0.8361735828220844, + 0.24584072828292847, + 0.34513917565345764, + 0.03865906223654747, + 0.9466645419597626, + 0.13924742117524147, + 0.8910354189574718, + 0.08672702684998512, + 1.2717941664159298, + 1.0308881625533104, + 0.9791698269546032, + 0.30520322546362877, + 0.2707950323820114 + ], + "unique_experts": 60, + "load_cv": 0.8481206529588279, + "normalized_load_entropy": 0.9164421892010456, + "max_load_share": 0.06 + } + }, + "s0_period": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "c4087062c5580ef9e61a5453655728b0f3cd69b199baa5d0b124b87768e002b6", + "route_weight_sha256": "beb771f00825ddb0a125cb8859d2ed7ddeaab1abd5f88294a0fba797eb64cca4", + "loads": [ + 0, + 0, + 1, + 2, + 6, + 2, + 7, + 2, + 2, + 8, + 2, + 7, + 1, + 0, + 5, + 0, + 1, + 1, + 5, + 3, + 2, + 22, + 0, + 1, + 1, + 4, + 3, + 0, + 2, + 7, + 3, + 6, + 2, + 10, + 0, + 4, + 0, + 1, + 4, + 7, + 0, + 1, + 5, + 1, + 3, + 8, + 7, + 9, + 0, + 2, + 0, + 1, + 2, + 4, + 0, + 2, + 2, + 5, + 2, + 1, + 5, + 0, + 4, + 6 + ], + "weighted_loads": [ + 0.0, + 0.0, + 0.04193931072950363, + 0.08352069929242134, + 0.7781482972204685, + 0.0781388133764267, + 0.45173564553260803, + 0.06880906596779823, + 0.08993326500058174, + 0.34898030012845993, + 0.11747844144701958, + 0.7969894595444202, + 0.06465793401002884, + 0.0, + 0.43347425758838654, + 0.0, + 0.05983545631170273, + 0.052128780633211136, + 0.18912801891565323, + 0.1374339535832405, + 0.06288717687129974, + 1.6617127507925034, + 0.0, + 0.03489300236105919, + 0.0339035727083683, + 0.21731054596602917, + 0.1297914832830429, + 0.0, + 0.08458662033081055, + 0.3977859802544117, + 0.21753112971782684, + 0.28868455812335014, + 0.07223760336637497, + 0.41594165563583374, + 0.0, + 0.38113661855459213, + 0.0, + 0.08454830944538116, + 0.19823434948921204, + 0.5752461608499289, + 0.0, + 0.03654821962118149, + 0.45384230464696884, + 0.05201597884297371, + 0.15215053036808968, + 0.43917619809508324, + 0.5101002417504787, + 0.6833324208855629, + 0.0, + 0.09572144038975239, + 0.0, + 0.057795945554971695, + 0.18311186134815216, + 0.18108224868774414, + 0.0, + 0.08560570701956749, + 0.06828919053077698, + 0.4427856430411339, + 0.08429557457566261, + 0.03984568268060684, + 0.28841913491487503, + 0.0, + 0.24249552190303802, + 0.306696780025959 + ], + "unique_experts": 51, + "load_cv": 1.1090137837160214, + "normalized_load_entropy": 0.8737452357226105, + "max_load_share": 0.10784313725490197 + }, + "full_input": { + "tokens": 59, + "top_k": 6, + "decisions": 354, + "ordered_route_sha256": "377502ce2e7930b50326b9c92490454878a3f4bf9f4932f5e9cb5ea39db81934", + "route_weight_sha256": "6765530566c0930244e70d67b04cead63bec1259a140879dc88634d0ba4a15d5", + "loads": [ + 0, + 0, + 2, + 2, + 6, + 2, + 7, + 6, + 2, + 9, + 4, + 8, + 3, + 2, + 8, + 0, + 1, + 4, + 10, + 6, + 5, + 24, + 0, + 1, + 1, + 6, + 3, + 6, + 3, + 8, + 8, + 7, + 2, + 18, + 1, + 5, + 0, + 1, + 4, + 7, + 0, + 9, + 9, + 3, + 6, + 12, + 13, + 13, + 0, + 5, + 2, + 8, + 2, + 6, + 0, + 11, + 2, + 13, + 2, + 13, + 11, + 12, + 4, + 6 + ], + "weighted_loads": [ + 0.0, + 0.0, + 0.056092316284775734, + 0.08352069929242134, + 0.7781482972204685, + 0.0781388133764267, + 0.45173564553260803, + 0.24582122266292572, + 0.08993326500058174, + 0.36520455963909626, + 0.21441255137324333, + 0.8423330299556255, + 0.13422995805740356, + 0.5039308778941631, + 0.6567237973213196, + 0.0, + 0.05983545631170273, + 0.2579970806837082, + 0.5270570851862431, + 0.3671337105333805, + 0.17621130868792534, + 1.7453581057488918, + 0.0, + 0.03489300236105919, + 0.0339035727083683, + 0.2808684688061476, + 0.1297914832830429, + 0.6873365864157677, + 0.13147304579615593, + 0.4393060877919197, + 0.6260835118591785, + 0.3024581391364336, + 0.07223760336637497, + 0.8362401537597179, + 0.029899246990680695, + 0.4181421138346195, + 0.0, + 0.08454830944538116, + 0.19823434948921204, + 0.5752461608499289, + 0.0, + 0.8657956719398499, + 0.6196217611432076, + 0.14980478212237358, + 0.3102499209344387, + 0.6301264278590679, + 0.7794930189847946, + 0.8943123407661915, + 0.0, + 0.24719535000622272, + 0.09202998876571655, + 0.4577501118183136, + 0.18311186134815216, + 0.28928065299987793, + 0.0, + 0.764132596552372, + 0.06828919053077698, + 0.9016408696770668, + 0.08429557457566261, + 0.856045302003622, + 0.6959292590618134, + 1.0300476923584938, + 0.24249552190303802, + 0.306696780025959 + ], + "unique_experts": 56, + "load_cv": 0.8652556667780006, + "normalized_load_entropy": 0.9087461265997369, + "max_load_share": 0.06779661016949153 + } + }, + "s1_period": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "cc53604483e1912fef21eae4791dc0ca613d10e745fa617d674fee4f0b20e7f9", + "route_weight_sha256": "179f696ef519f4a9d1c615650429624ebeffef01c7608cc7e7aca3d412f542d8", + "loads": [ + 0, + 0, + 2, + 3, + 6, + 2, + 7, + 1, + 2, + 10, + 2, + 7, + 1, + 0, + 5, + 1, + 1, + 2, + 4, + 2, + 1, + 22, + 0, + 1, + 1, + 4, + 3, + 0, + 1, + 7, + 4, + 6, + 1, + 9, + 0, + 4, + 0, + 1, + 4, + 6, + 0, + 1, + 5, + 1, + 3, + 9, + 7, + 9, + 0, + 2, + 0, + 1, + 2, + 4, + 1, + 2, + 2, + 5, + 2, + 0, + 4, + 0, + 6, + 5 + ], + "weighted_loads": [ + 0.0, + 0.0, + 0.07064520567655563, + 0.12177815288305283, + 0.7603674717247486, + 0.07700233533978462, + 0.44213683903217316, + 0.03384866565465927, + 0.08754154294729233, + 0.41203663870692253, + 0.11455725878477097, + 0.8098077140748501, + 0.06025615334510803, + 0.0, + 0.4379574880003929, + 0.02872598171234131, + 0.05964169651269913, + 0.09945190325379372, + 0.15581724047660828, + 0.1010802611708641, + 0.03023635782301426, + 1.6479449979960918, + 0.0, + 0.03609589487314224, + 0.03581101819872856, + 0.21429305896162987, + 0.12819472700357437, + 0.0, + 0.04961922764778137, + 0.39593787118792534, + 0.26527099311351776, + 0.27918655425310135, + 0.042339954525232315, + 0.3676559142768383, + 0.0, + 0.39126764237880707, + 0.0, + 0.08001764863729477, + 0.18587857857346535, + 0.5423353388905525, + 0.0, + 0.03775276616215706, + 0.4461122527718544, + 0.04802447929978371, + 0.15404988080263138, + 0.4841870814561844, + 0.534711305052042, + 0.6649472154676914, + 0.0, + 0.09064755961298943, + 0.0, + 0.06279899179935455, + 0.17763397097587585, + 0.18675999343395233, + 0.0377357192337513, + 0.08735485374927521, + 0.06697354093194008, + 0.44496824592351913, + 0.08578041940927505, + 0.0, + 0.2567107677459717, + 0.0, + 0.3104820027947426, + 0.26823733001947403 + ], + "unique_experts": 52, + "load_cv": 1.1186785745565422, + "normalized_load_entropy": 0.8732939182395345, + "max_load_share": 0.10784313725490197 + }, + "full_input": { + "tokens": 75, + "top_k": 6, + "decisions": 450, + "ordered_route_sha256": "22fd8ccc86f7796cbc2807c061ef403c4639b6375f2ab4a6a36e58105fb73f89", + "route_weight_sha256": "d2c0b9c02f4623c0672eb1e4dfb69e22bddf3563de7aaa39eaa1cb6e5c28a24b", + "loads": [ + 1, + 0, + 3, + 4, + 11, + 2, + 7, + 3, + 2, + 11, + 4, + 10, + 5, + 1, + 10, + 1, + 1, + 7, + 8, + 4, + 2, + 24, + 0, + 1, + 2, + 7, + 5, + 18, + 1, + 10, + 15, + 7, + 6, + 27, + 2, + 6, + 2, + 3, + 5, + 6, + 1, + 17, + 8, + 3, + 5, + 15, + 13, + 13, + 8, + 6, + 4, + 15, + 3, + 6, + 1, + 15, + 3, + 13, + 2, + 19, + 14, + 11, + 6, + 5 + ], + "weighted_loads": [ + 0.03604007139801979, + 0.0, + 0.08479821123182774, + 0.18357833847403526, + 0.996883925050497, + 0.07700233533978462, + 0.44213683903217316, + 0.1161721907556057, + 0.08754154294729233, + 0.42826089821755886, + 0.19208543375134468, + 0.9824654571712017, + 0.2599112205207348, + 0.4690502882003784, + 0.7803516909480095, + 0.02872598171234131, + 0.05964169651269913, + 0.4530673325061798, + 0.4801507107913494, + 0.27426905930042267, + 0.07047912292182446, + 1.7347032688558102, + 0.0, + 0.03609589487314224, + 0.07791968435049057, + 0.5412595439702272, + 0.19915766455233097, + 1.2195005677640438, + 0.04961922764778137, + 0.5295254103839397, + 1.1395478211343288, + 0.2929601352661848, + 0.5351114012300968, + 1.2914292123168707, + 0.14290648512542248, + 0.5563301742076874, + 0.08492380008101463, + 0.1665172502398491, + 0.22372367978096008, + 0.5423353388905525, + 0.042586799710989, + 1.3135857805609703, + 0.5565162841230631, + 0.11608711257576942, + 0.2971145957708359, + 0.7887266464531422, + 0.8591593094170094, + 0.8772318847477436, + 0.6446705125272274, + 0.3028782345354557, + 0.22274456545710564, + 0.9350731335580349, + 0.24736670404672623, + 0.2969820089638233, + 0.0377357192337513, + 0.9832056276500225, + 0.1400570459663868, + 0.9760383293032646, + 0.08578041940927505, + 1.2235130853950977, + 0.9923611730337143, + 0.9445127174258232, + 0.3104820027947426, + 0.26823733001947403 + ], + "unique_experts": 62, + "load_cv": 0.8458818176215376, + "normalized_load_entropy": 0.918677621202255, + "max_load_share": 0.06 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 34, + "ordered_topk_exact_tokens": 26, + "set_exact_tokens": 28, + "mean_set_jaccard": 0.9495798319327731, + "mean_token_weighted_tv": 0.0092701635816518, + "aggregate_load_tv": 0.029411764705882353 + }, + "system_bos": { + "tokens": 34, + "ordered_topk_exact_tokens": 24, + "set_exact_tokens": 29, + "mean_set_jaccard": 0.9579831932773111, + "mean_token_weighted_tv": 0.010666424435946871, + "aggregate_load_tv": 0.0196078431372549 + }, + "system_x": { + "tokens": 34, + "ordered_topk_exact_tokens": 19, + "set_exact_tokens": 22, + "mean_set_jaccard": 0.8928571428571429, + "mean_token_weighted_tv": 0.01906897932948435, + "aggregate_load_tv": 0.04901960784313725 + }, + "system_period": { + "tokens": 34, + "ordered_topk_exact_tokens": 20, + "set_exact_tokens": 23, + "mean_set_jaccard": 0.907563025210084, + "mean_token_weighted_tv": 0.01758695371887263, + "aggregate_load_tv": 0.053921568627450976 + }, + "bos_at_s0": { + "tokens": 34, + "ordered_topk_exact_tokens": 20, + "set_exact_tokens": 26, + "mean_set_jaccard": 0.9327731092436975, + "mean_token_weighted_tv": 0.015006106867290595, + "aggregate_load_tv": 0.02941176470588236 + }, + "bos_at_s1": { + "tokens": 34, + "ordered_topk_exact_tokens": 17, + "set_exact_tokens": 22, + "mean_set_jaccard": 0.8928571428571429, + "mean_token_weighted_tv": 0.020185583764139342, + "aggregate_load_tv": 0.05882352941176472 + }, + "x_at_s0": { + "tokens": 34, + "ordered_topk_exact_tokens": 21, + "set_exact_tokens": 26, + "mean_set_jaccard": 0.9264705882352943, + "mean_token_weighted_tv": 0.01701829198967008, + "aggregate_load_tv": 0.03921568627450981 + }, + "x_at_s1": { + "tokens": 34, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.8627450980392156, + "mean_token_weighted_tv": 0.02722977797555573, + "aggregate_load_tv": 0.06862745098039216 + }, + "period_at_s0": { + "tokens": 34, + "ordered_topk_exact_tokens": 20, + "set_exact_tokens": 25, + "mean_set_jaccard": 0.9180672268907564, + "mean_token_weighted_tv": 0.017907477175707325, + "aggregate_load_tv": 0.04411764705882353 + }, + "period_at_s1": { + "tokens": 34, + "ordered_topk_exact_tokens": 16, + "set_exact_tokens": 21, + "mean_set_jaccard": 0.884453781512605, + "mean_token_weighted_tv": 0.023803689106203178, + "aggregate_load_tv": 0.05882352941176471 + } + } + }, + "layer_11": { + "layer": 11, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "cd0b4733d4d1e0199c9beee52b3d60be2a607210b8b265b63531de540b91ff2e", + "route_weight_sha256": "115c2f52f9e0145e0fdaa88511b4f89fc62b7a9610b542ac70983470c74149a7", + "loads": [ + 4, + 0, + 2, + 4, + 0, + 8, + 5, + 4, + 5, + 0, + 3, + 10, + 11, + 4, + 22, + 5, + 2, + 7, + 0, + 4, + 0, + 1, + 0, + 7, + 0, + 1, + 1, + 2, + 0, + 4, + 11, + 8, + 0, + 3, + 0, + 6, + 2, + 0, + 0, + 0, + 2, + 0, + 0, + 0, + 10, + 0, + 2, + 2, + 0, + 4, + 2, + 0, + 5, + 1, + 0, + 0, + 2, + 7, + 4, + 3, + 4, + 7, + 0, + 3 + ], + "weighted_loads": [ + 0.25300535932183266, + 0.0, + 0.092628363519907, + 0.18032560497522354, + 0.0, + 0.5692733749747276, + 0.201058654114604, + 0.2440306320786476, + 0.2877589128911495, + 0.0, + 0.15195203572511673, + 0.4011392053216696, + 0.9020181968808174, + 0.2554740570485592, + 1.4226401820778847, + 0.19596048817038536, + 0.07172241434454918, + 0.294102743268013, + 0.0, + 0.29524145647883415, + 0.0, + 0.056675102561712265, + 0.0, + 0.5055822506546974, + 0.0, + 0.033924635499715805, + 0.03489336743950844, + 0.0944216437637806, + 0.0, + 0.1633460521697998, + 0.5943628679960966, + 0.5735911205410957, + 0.0, + 0.1840270310640335, + 0.0, + 0.6362795159220695, + 0.06855885311961174, + 0.0, + 0.0, + 0.0, + 0.09851721301674843, + 0.0, + 0.0, + 0.0, + 0.9408401530236006, + 0.0, + 0.14729851111769676, + 0.06786241568624973, + 0.0, + 0.24228619411587715, + 0.08388357982039452, + 0.0, + 0.23282025754451752, + 0.03273257613182068, + 0.0, + 0.0, + 0.05819725804030895, + 0.5878772735595703, + 0.20147030428051949, + 0.14901602640748024, + 0.16960659995675087, + 0.6802858933806419, + 0.0, + 0.1266617625951767 + ], + "unique_experts": 42, + "load_cv": 1.2123610436949577, + "normalized_load_entropy": 0.8390093071209608, + "max_load_share": 0.10784313725490197 + }, + "full_input": { + "tokens": 59, + "top_k": 6, + "decisions": 354, + "ordered_route_sha256": "6a36e5ddc3431b10150182f6ab38f1e5da6f6b10a76cedfb5bde60eb69f44026", + "route_weight_sha256": "2854c4654e8e9a3f76aa87aa15800d460cf8a8efade7d7ea2bbdd79675d1a981", + "loads": [ + 4, + 0, + 3, + 4, + 5, + 8, + 5, + 4, + 9, + 1, + 6, + 13, + 11, + 4, + 22, + 11, + 9, + 9, + 12, + 4, + 0, + 1, + 1, + 12, + 0, + 1, + 2, + 3, + 6, + 4, + 17, + 16, + 2, + 3, + 4, + 10, + 2, + 0, + 0, + 0, + 10, + 0, + 0, + 22, + 13, + 0, + 2, + 10, + 0, + 6, + 2, + 0, + 5, + 1, + 4, + 1, + 2, + 7, + 7, + 5, + 5, + 12, + 8, + 4 + ], + "weighted_loads": [ + 0.25300535932183266, + 0.0, + 0.1516096368432045, + 0.18032560497522354, + 0.22429493069648743, + 0.5692733749747276, + 0.201058654114604, + 0.2440306320786476, + 0.4807314798235893, + 0.030993279069662094, + 0.22415834944695234, + 0.45498126931488514, + 0.9020181968808174, + 0.2554740570485592, + 1.4226401820778847, + 0.42861030623316765, + 0.6977362148463726, + 0.32392326928675175, + 2.075351011008024, + 0.29524145647883415, + 0.0, + 0.056675102561712265, + 0.0039239381439983845, + 0.7604677230119705, + 0.0, + 0.033924635499715805, + 0.03824438573792577, + 0.10701719019562006, + 0.49824095889925957, + 0.1633460521697998, + 0.8885122016072273, + 0.928595419973135, + 0.06482563354074955, + 0.1840270310640335, + 0.1636492982506752, + 0.9684012830257416, + 0.06855885311961174, + 0.0, + 0.0, + 0.0, + 0.5189042538404465, + 0.0, + 0.0, + 2.076544761657715, + 1.103868992999196, + 0.0, + 0.14729851111769676, + 0.650421941652894, + 0.0, + 0.3557187654078007, + 0.08388357982039452, + 0.0, + 0.23282025754451752, + 0.03273257613182068, + 0.19278614595532417, + 0.049319081008434296, + 0.05819725804030895, + 0.5878772735595703, + 0.3357832320034504, + 0.26761287078261375, + 0.21887508407235146, + 1.0276382733136415, + 0.4670776054263115, + 0.1546289622783661 + ], + "unique_experts": 53, + "load_cv": 0.950748590822988, + "normalized_load_entropy": 0.8903304850350324, + "max_load_share": 0.062146892655367235 + } + }, + "s1_eos": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "5006c76715cfcb6fc19c71bc0c83b1e8198083e4e140d985adec485474deaac2", + "route_weight_sha256": "ed7594441031f3c79f731272c10497405e56288c874290ea3b45ae1629fae2b3", + "loads": [ + 4, + 0, + 3, + 4, + 0, + 9, + 4, + 4, + 5, + 0, + 3, + 11, + 11, + 4, + 23, + 5, + 2, + 7, + 0, + 4, + 0, + 1, + 1, + 7, + 0, + 1, + 2, + 2, + 0, + 3, + 10, + 8, + 0, + 3, + 0, + 6, + 2, + 1, + 0, + 0, + 1, + 0, + 0, + 0, + 9, + 0, + 2, + 2, + 0, + 3, + 2, + 0, + 5, + 1, + 0, + 0, + 2, + 7, + 4, + 3, + 3, + 7, + 0, + 3 + ], + "weighted_loads": [ + 0.25970838963985443, + 0.0, + 0.13587480410933495, + 0.18427688255906105, + 0.0, + 0.6098607890307903, + 0.17920377850532532, + 0.24521060287952423, + 0.2896837033331394, + 0.0, + 0.15550275146961212, + 0.4423244558274746, + 0.9011498279869556, + 0.25272852927446365, + 1.4609777554869652, + 0.19480068236589432, + 0.07445195317268372, + 0.292192280292511, + 0.0, + 0.2934012822806835, + 0.0, + 0.057292379438877106, + 0.02656383067369461, + 0.4975893497467041, + 0.0, + 0.03309240564703941, + 0.06431703455746174, + 0.09511281177401543, + 0.0, + 0.1309451386332512, + 0.5507756266742945, + 0.5767511054873466, + 0.0, + 0.1851687654852867, + 0.0, + 0.6352460980415344, + 0.06918270513415337, + 0.03662937507033348, + 0.0, + 0.0, + 0.0540941096842289, + 0.0, + 0.0, + 0.0, + 0.9065180569887161, + 0.0, + 0.14642272517085075, + 0.0675506480038166, + 0.0, + 0.19669034704566002, + 0.08322332799434662, + 0.0, + 0.23543059453368187, + 0.03309250995516777, + 0.0, + 0.0, + 0.06189260631799698, + 0.5782281123101711, + 0.2030001115053892, + 0.15174302086234093, + 0.13401345908641815, + 0.6846922934055328, + 0.0, + 0.1282297670841217 + ], + "unique_experts": 44, + "load_cv": 1.224980286073512, + "normalized_load_entropy": 0.8429441862136112, + "max_load_share": 0.11274509803921569 + }, + "full_input": { + "tokens": 75, + "top_k": 6, + "decisions": 450, + "ordered_route_sha256": "cd05d2993bdbf5fdb4769f1e4df93ffec6dc32d72cf10f8f4027143e37a5bb65", + "route_weight_sha256": "8168ea53bea8786d5be5ca6bd86853b6950c0179a88b5cfd5e78122bc3c934a9", + "loads": [ + 6, + 1, + 4, + 4, + 11, + 12, + 4, + 6, + 15, + 0, + 7, + 14, + 11, + 4, + 24, + 6, + 20, + 9, + 11, + 5, + 1, + 2, + 4, + 12, + 0, + 1, + 6, + 4, + 10, + 3, + 17, + 14, + 1, + 3, + 4, + 13, + 2, + 1, + 0, + 1, + 9, + 0, + 0, + 26, + 11, + 0, + 3, + 15, + 0, + 7, + 2, + 0, + 5, + 6, + 18, + 7, + 8, + 8, + 6, + 9, + 5, + 16, + 11, + 5 + ], + "weighted_loads": [ + 0.4082181379199028, + 0.03295338153839111, + 0.18222707882523537, + 0.18427688255906105, + 0.5733567029237747, + 0.7170532532036304, + 0.17920377850532532, + 0.3752994053065777, + 0.8413063399493694, + 0.0, + 0.27064578933641315, + 0.4954811669886112, + 0.9011498279869556, + 0.25272852927446365, + 1.4958488494157791, + 0.23505965620279312, + 1.7130663245916367, + 0.3211845578625798, + 2.0730233751237392, + 0.3321850262582302, + 0.07266479730606079, + 0.12792734056711197, + 0.13958511734381318, + 0.722165409475565, + 0.0, + 0.03309240564703941, + 0.18343222048133612, + 0.14600468520075083, + 0.8078266382217407, + 0.1309451386332512, + 0.9156206212937832, + 0.8497723266482353, + 0.0323200561106205, + 0.1851687654852867, + 0.18603377789258957, + 1.2343769744038582, + 0.06918270513415337, + 0.03662937507033348, + 0.0, + 0.04651694372296333, + 0.4505639299750328, + 0.0, + 0.0, + 2.4075100384652615, + 1.0413625314831734, + 0.0, + 0.19270896911621094, + 1.0663702972233295, + 0.0, + 0.4716706648468971, + 0.08322332799434662, + 0.0, + 0.23543059453368187, + 0.33615292981266975, + 1.1053591519594193, + 0.3327276185154915, + 0.5326434411108494, + 0.6209962666034698, + 0.3057835381478071, + 0.422831567004323, + 0.22467626631259918, + 1.2127173356711864, + 0.5524536184966564, + 0.19886042177677155 + ], + "unique_experts": 56, + "load_cv": 0.8621649465512551, + "normalized_load_entropy": 0.9071174549216442, + "max_load_share": 0.057777777777777775 + } + }, + "s0_bos": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "e78cccaea7766a0e748bd2069c747b63d95fb2831b9e2898023231ffb0ea82cd", + "route_weight_sha256": "dabb98f215709516fb0bede8340abfac20dd454a5f507a3ca608016097bfea8e", + "loads": [ + 4, + 0, + 3, + 4, + 0, + 10, + 5, + 4, + 4, + 1, + 3, + 10, + 11, + 4, + 23, + 5, + 2, + 7, + 0, + 4, + 0, + 1, + 0, + 7, + 0, + 1, + 1, + 2, + 0, + 3, + 10, + 8, + 0, + 3, + 0, + 6, + 2, + 0, + 0, + 0, + 2, + 0, + 0, + 0, + 10, + 0, + 3, + 2, + 0, + 3, + 1, + 0, + 5, + 1, + 0, + 0, + 2, + 7, + 4, + 3, + 3, + 7, + 0, + 3 + ], + "weighted_loads": [ + 0.2551257349550724, + 0.0, + 0.1359093002974987, + 0.17982841655611992, + 0.0, + 0.6353185512125492, + 0.20831328071653843, + 0.25128766521811485, + 0.24389832466840744, + 0.036589041352272034, + 0.1493263989686966, + 0.38969967141747475, + 0.8945678137242794, + 0.26240359991788864, + 1.4789902903139591, + 0.1892898939549923, + 0.07614127174019814, + 0.30056621320545673, + 0.0, + 0.28603508323431015, + 0.0, + 0.060591913759708405, + 0.0, + 0.5040617100894451, + 0.0, + 0.033816173672676086, + 0.03663511201739311, + 0.09288067743182182, + 0.0, + 0.13643978536128998, + 0.5436766110360622, + 0.5818004794418812, + 0.0, + 0.17856376618146896, + 0.0, + 0.6488672345876694, + 0.0671461820602417, + 0.0, + 0.0, + 0.0, + 0.09852650389075279, + 0.0, + 0.0, + 0.0, + 0.9490157533437014, + 0.0, + 0.1943078264594078, + 0.06932706758379936, + 0.0, + 0.20046410337090492, + 0.04079664871096611, + 0.0, + 0.23214156925678253, + 0.03286454826593399, + 0.0, + 0.0, + 0.06087628751993179, + 0.60549096763134, + 0.20592302829027176, + 0.15154242888092995, + 0.12676191329956055, + 0.6576273515820503, + 0.0, + 0.12875212728977203 + ], + "unique_experts": 43, + "load_cv": 1.2362274718547541, + "normalized_load_entropy": 0.8386138491892546, + "max_load_share": 0.11274509803921569 + }, + "full_input": { + "tokens": 59, + "top_k": 6, + "decisions": 354, + "ordered_route_sha256": "610ae181ee2d2710bb2b62af4a338d9faf9c8a11feb1fc3e34d312f88bf3b50c", + "route_weight_sha256": "4fcf4f3cf1c8bd8d427a138f843cce3c4e492cc5de126af4306ff3b2c717eb70", + "loads": [ + 4, + 0, + 4, + 4, + 5, + 10, + 5, + 4, + 8, + 3, + 5, + 12, + 11, + 4, + 23, + 12, + 9, + 8, + 11, + 4, + 0, + 1, + 0, + 12, + 0, + 1, + 1, + 4, + 6, + 3, + 16, + 16, + 2, + 3, + 4, + 10, + 2, + 0, + 0, + 0, + 11, + 0, + 0, + 23, + 13, + 0, + 3, + 10, + 0, + 5, + 1, + 0, + 5, + 1, + 3, + 0, + 2, + 7, + 7, + 5, + 4, + 14, + 9, + 4 + ], + "weighted_loads": [ + 0.2551257349550724, + 0.0, + 0.1948905736207962, + 0.17982841655611992, + 0.22429493069648743, + 0.6353185512125492, + 0.20831328071653843, + 0.25128766521811485, + 0.4376137740910053, + 0.10346859320998192, + 0.21642540022730827, + 0.4314802447333932, + 0.8945678137242794, + 0.26240359991788864, + 1.4789902903139591, + 0.4535529240965843, + 0.7502658441662788, + 0.3154115742072463, + 1.1790230385959148, + 0.28603508323431015, + 0.0, + 0.060591913759708405, + 0.0, + 0.7589471824467182, + 0.0, + 0.033816173672676086, + 0.03663511201739311, + 0.15209029335528612, + 0.49306110851466656, + 0.13643978536128998, + 0.837825944647193, + 0.9368047788739204, + 0.06482563354074955, + 0.17856376618146896, + 0.16118557751178741, + 0.9825335592031479, + 0.0671461820602417, + 0.0, + 0.0, + 0.0, + 0.6011024191975594, + 0.0, + 0.0, + 2.2744882740080357, + 1.1120445933192968, + 0.0, + 0.1943078264594078, + 0.6430338509380817, + 0.0, + 0.3135407082736492, + 0.04079664871096611, + 0.0, + 0.23214156925678253, + 0.03286454826593399, + 0.15846002474427223, + 0.0, + 0.06087628751993179, + 0.60549096763134, + 0.34023595601320267, + 0.27051130309700966, + 0.1818946860730648, + 1.1222318429499865, + 0.5282549038529396, + 0.1558792907744646 + ], + "unique_experts": 51, + "load_cv": 0.9767150853136657, + "normalized_load_entropy": 0.8841141332024347, + "max_load_share": 0.06497175141242938 + } + }, + "s1_bos": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "50488fc61fed9c198f62b61adaa2bf8ab68608c4418caef0282ee88261ed8976", + "route_weight_sha256": "0d493d02888ba7ea10a6626e2a9fd236eab359cebdf99925bb191dccf4d30131", + "loads": [ + 4, + 0, + 3, + 4, + 0, + 10, + 5, + 4, + 5, + 0, + 3, + 10, + 11, + 4, + 23, + 3, + 2, + 7, + 0, + 4, + 0, + 1, + 0, + 7, + 0, + 1, + 1, + 2, + 0, + 4, + 11, + 8, + 1, + 3, + 0, + 6, + 2, + 0, + 0, + 0, + 1, + 0, + 0, + 0, + 9, + 0, + 3, + 2, + 0, + 3, + 1, + 0, + 5, + 1, + 0, + 0, + 2, + 6, + 5, + 3, + 4, + 7, + 0, + 3 + ], + "weighted_loads": [ + 0.2544094808399677, + 0.0, + 0.1348930522799492, + 0.1749795824289322, + 0.0, + 0.6443521119654179, + 0.2094137705862522, + 0.25291551277041435, + 0.29206395521759987, + 0.0, + 0.15201951935887337, + 0.39702791906893253, + 0.8962959088385105, + 0.2624725364148617, + 1.478232242166996, + 0.1261962354183197, + 0.07287561148405075, + 0.2880511898547411, + 0.0, + 0.27707724645733833, + 0.0, + 0.05993989109992981, + 0.0, + 0.5046282559633255, + 0.0, + 0.032649680972099304, + 0.03698962554335594, + 0.09070998430252075, + 0.0, + 0.16319464519619942, + 0.5691860541701317, + 0.5681790597736835, + 0.03246302157640457, + 0.17985984310507774, + 0.0, + 0.6477885879576206, + 0.06505728326737881, + 0.0, + 0.0, + 0.0, + 0.0506039597094059, + 0.0, + 0.0, + 0.0, + 0.9219577051699162, + 0.0, + 0.1945803388953209, + 0.07032331079244614, + 0.0, + 0.20222124829888344, + 0.0390770398080349, + 0.0, + 0.23917540907859802, + 0.03367548808455467, + 0.0, + 0.0, + 0.060116805136203766, + 0.5609797239303589, + 0.23280823789536953, + 0.15300187095999718, + 0.16304881498217583, + 0.6549939028918743, + 0.0, + 0.1288806013762951 + ], + "unique_experts": 43, + "load_cv": 1.2374708490580124, + "normalized_load_entropy": 0.8379132328147114, + "max_load_share": 0.11274509803921569 + }, + "full_input": { + "tokens": 75, + "top_k": 6, + "decisions": 450, + "ordered_route_sha256": "f102a3d2614afec799f938b8e64023a172c6bee35800434333e35edae8345a91", + "route_weight_sha256": "0284d6473f609048e7198cc570b404893a94194039513ea3a51998a3757a5cc9", + "loads": [ + 6, + 1, + 4, + 4, + 11, + 13, + 5, + 6, + 15, + 1, + 6, + 12, + 11, + 4, + 24, + 5, + 20, + 8, + 10, + 5, + 1, + 2, + 2, + 12, + 0, + 1, + 4, + 4, + 9, + 4, + 18, + 14, + 2, + 3, + 4, + 13, + 2, + 0, + 0, + 1, + 10, + 0, + 0, + 27, + 11, + 0, + 4, + 16, + 0, + 7, + 1, + 0, + 5, + 6, + 17, + 7, + 8, + 7, + 7, + 9, + 6, + 18, + 12, + 5 + ], + "weighted_loads": [ + 0.4029192291200161, + 0.03295338153839111, + 0.1812453269958496, + 0.1749795824289322, + 0.5733567029237747, + 0.751544576138258, + 0.2094137705862522, + 0.3830043151974678, + 0.8452947847545147, + 0.0336257703602314, + 0.2620426379144192, + 0.43880155589431524, + 0.8962959088385105, + 0.2624725364148617, + 1.51310333609581, + 0.19799893349409103, + 1.768871869891882, + 0.30289655085653067, + 1.1744742952287197, + 0.315860990434885, + 0.07266479730606079, + 0.13057485222816467, + 0.10925761237740517, + 0.7292043156921864, + 0.0, + 0.032649680972099304, + 0.15294532850384712, + 0.14160185772925615, + 0.7633024454116821, + 0.16319464519619942, + 0.9340310487896204, + 0.8412002809345722, + 0.06478307768702507, + 0.17985984310507774, + 0.1825052686035633, + 1.251780990511179, + 0.06505728326737881, + 0.0, + 0.0, + 0.04651694372296333, + 0.5486970692873001, + 0.0, + 0.0, + 2.6727284342050552, + 1.0568021796643734, + 0.0, + 0.24086658284068108, + 1.0977722890675068, + 0.0, + 0.47733040526509285, + 0.0390770398080349, + 0.0, + 0.23917540907859802, + 0.33673590794205666, + 1.0698700547218323, + 0.3327276185154915, + 0.5308676399290562, + 0.6037478782236576, + 0.33559166453778744, + 0.425075838342309, + 0.2569926492869854, + 1.2915924862027168, + 0.5919083841145039, + 0.19917374104261398 + ], + "unique_experts": 56, + "load_cv": 0.8777862165557788, + "normalized_load_entropy": 0.9051648054178223, + "max_load_share": 0.06 + } + }, + "s0_x": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "183e535d1e6f7631407603ee6b901771b00fc96731f6e764a1d7563d06dca671", + "route_weight_sha256": "f0e640b4ef4a9c322a619751db4ce517d66da037aa825e135c98756f5826a7ae", + "loads": [ + 4, + 0, + 2, + 4, + 0, + 10, + 3, + 4, + 5, + 0, + 3, + 10, + 11, + 4, + 22, + 6, + 1, + 6, + 0, + 4, + 0, + 1, + 0, + 7, + 0, + 1, + 1, + 1, + 0, + 3, + 10, + 8, + 2, + 3, + 0, + 6, + 2, + 0, + 0, + 0, + 2, + 0, + 0, + 0, + 10, + 0, + 3, + 2, + 0, + 4, + 1, + 0, + 6, + 1, + 0, + 0, + 2, + 8, + 4, + 3, + 4, + 7, + 0, + 3 + ], + "weighted_loads": [ + 0.24636594578623772, + 0.0, + 0.10415878891944885, + 0.1691896840929985, + 0.0, + 0.6494194157421589, + 0.13881827145814896, + 0.2592678889632225, + 0.2874590940773487, + 0.0, + 0.14376934990286827, + 0.39561866968870163, + 0.8941731229424477, + 0.262299619615078, + 1.425454419106245, + 0.22213205695152283, + 0.03356792777776718, + 0.25275662913918495, + 0.0, + 0.2950774133205414, + 0.0, + 0.058549877256155014, + 0.0, + 0.5046401619911194, + 0.0, + 0.034551188349723816, + 0.040411729365587234, + 0.050416797399520874, + 0.0, + 0.13422810658812523, + 0.5374294519424438, + 0.5746174454689026, + 0.06143373250961304, + 0.182786975055933, + 0.0, + 0.6715968064963818, + 0.06395714916288853, + 0.0, + 0.0, + 0.0, + 0.09883477166295052, + 0.0, + 0.0, + 0.0, + 0.9400357026606798, + 0.0, + 0.19503983482718468, + 0.0687048677355051, + 0.0, + 0.24554457888007164, + 0.04118527099490166, + 0.0, + 0.26977044716477394, + 0.03780585154891014, + 0.0, + 0.0, + 0.06088893488049507, + 0.6398902758955956, + 0.20619231835007668, + 0.15756819397211075, + 0.1689593568444252, + 0.6361126638948917, + 0.0, + 0.13224638998508453 + ], + "unique_experts": 43, + "load_cv": 1.2224668588836345, + "normalized_load_entropy": 0.8381539874476835, + "max_load_share": 0.10784313725490197 + }, + "full_input": { + "tokens": 59, + "top_k": 6, + "decisions": 354, + "ordered_route_sha256": "d5fd77dcdc0a8eeb3f422988ca23136974aae039e7a1ca969f1e1bada6004d51", + "route_weight_sha256": "0b4c51d03c2f66a153e64e0733ed89211b64892561257b8915e2d88ad0deb66c", + "loads": [ + 4, + 0, + 3, + 4, + 5, + 10, + 3, + 4, + 10, + 1, + 5, + 12, + 11, + 4, + 22, + 12, + 6, + 8, + 12, + 4, + 0, + 1, + 0, + 12, + 0, + 1, + 1, + 2, + 6, + 3, + 16, + 17, + 4, + 3, + 5, + 10, + 2, + 0, + 0, + 0, + 9, + 0, + 0, + 22, + 13, + 0, + 3, + 10, + 0, + 8, + 1, + 0, + 6, + 2, + 3, + 0, + 2, + 8, + 8, + 5, + 5, + 13, + 9, + 4 + ], + "weighted_loads": [ + 0.24636594578623772, + 0.0, + 0.16314006224274635, + 0.1691896840929985, + 0.22429493069648743, + 0.6494194157421589, + 0.13881827145814896, + 0.2592678889632225, + 0.5361477993428707, + 0.030993279069662094, + 0.21086835116147995, + 0.4373992430046201, + 0.8941731229424477, + 0.262299619615078, + 1.425454419106245, + 0.4547818750143051, + 0.5718588456511497, + 0.3038413757458329, + 1.271314088255167, + 0.2950774133205414, + 0.0, + 0.058549877256155014, + 0.0, + 0.7595256343483925, + 0.0, + 0.034551188349723816, + 0.040411729365587234, + 0.06301234383136034, + 0.502978477627039, + 0.13422810658812523, + 0.8315787855535746, + 0.977763369679451, + 0.1262593660503626, + 0.182786975055933, + 0.24860969930887222, + 0.9909252375364304, + 0.06395714916288853, + 0.0, + 0.0, + 0.0, + 0.49145256355404854, + 0.0, + 0.0, + 2.003450483083725, + 1.1030645426362753, + 0.0, + 0.19503983482718468, + 0.6617038380354643, + 0.0, + 0.4497527927160263, + 0.04118527099490166, + 0.0, + 0.26977044716477394, + 0.09296045079827309, + 0.15846002474427223, + 0.0, + 0.06088893488049507, + 0.6398902758955956, + 0.40021927654743195, + 0.2799834795296192, + 0.21164614707231522, + 1.0338030066341162, + 0.48056188598275185, + 0.15917297825217247 + ], + "unique_experts": 51, + "load_cv": 0.9662008076823697, + "normalized_load_entropy": 0.8843900651964164, + "max_load_share": 0.062146892655367235 + } + }, + "s1_x": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "e5747234b09ff60ae4c62b70620eadebb97b53fb396ac7643e362a91f469f6de", + "route_weight_sha256": "b7d9ad2bb68c67da64f1cf6b1a812be0e4ad51666113a54268553e0927a972f7", + "loads": [ + 4, + 0, + 2, + 3, + 0, + 10, + 4, + 4, + 5, + 0, + 3, + 11, + 11, + 4, + 23, + 6, + 1, + 5, + 0, + 4, + 0, + 1, + 0, + 7, + 0, + 0, + 1, + 1, + 0, + 3, + 10, + 8, + 2, + 3, + 0, + 6, + 1, + 0, + 0, + 0, + 1, + 0, + 0, + 0, + 11, + 0, + 3, + 2, + 0, + 4, + 1, + 0, + 6, + 1, + 0, + 0, + 1, + 7, + 6, + 3, + 5, + 7, + 0, + 3 + ], + "weighted_loads": [ + 0.2507297731935978, + 0.0, + 0.09651106968522072, + 0.1283346712589264, + 0.0, + 0.6289272718131542, + 0.179048927500844, + 0.2540360763669014, + 0.29627951234579086, + 0.0, + 0.14928776398301125, + 0.4285766240209341, + 0.8948543779551983, + 0.26492566615343094, + 1.470049198716879, + 0.2203203160315752, + 0.03417633846402168, + 0.21250840462744236, + 0.0, + 0.28462477773427963, + 0.0, + 0.05821754410862923, + 0.0, + 0.4928960017859936, + 0.0, + 0.0, + 0.041129954159259796, + 0.04840829595923424, + 0.0, + 0.13383661583065987, + 0.5101151429116726, + 0.5800213031470776, + 0.06365068070590496, + 0.17757265642285347, + 0.0, + 0.6438786201179028, + 0.03304371237754822, + 0.0, + 0.0, + 0.0, + 0.05320901423692703, + 0.0, + 0.0, + 0.0, + 0.9803456552326679, + 0.0, + 0.19247394427657127, + 0.07261191681027412, + 0.0, + 0.24182096496224403, + 0.04148097708821297, + 0.0, + 0.26948925480246544, + 0.03473033756017685, + 0.0, + 0.0, + 0.032241854816675186, + 0.5880559496581554, + 0.28048561327159405, + 0.16293740645051003, + 0.19343877956271172, + 0.6308488585054874, + 0.0, + 0.12935348600149155 + ], + "unique_experts": 42, + "load_cv": 1.2717919739750216, + "normalized_load_entropy": 0.8279627059976501, + "max_load_share": 0.11274509803921569 + }, + "full_input": { + "tokens": 75, + "top_k": 6, + "decisions": 450, + "ordered_route_sha256": "431376cc252da8cd365def4507fb8521d9a8408a75e4ab05831506968f431aac", + "route_weight_sha256": "81d94592059e3d5b80a81eb8cb94d9f626d8e5b4baba8d17a9bfdead9b010c40", + "loads": [ + 6, + 1, + 3, + 3, + 11, + 13, + 4, + 6, + 15, + 0, + 6, + 13, + 11, + 4, + 24, + 7, + 20, + 6, + 11, + 5, + 1, + 2, + 2, + 12, + 0, + 0, + 4, + 4, + 10, + 3, + 17, + 15, + 3, + 3, + 5, + 13, + 1, + 0, + 0, + 1, + 7, + 0, + 0, + 26, + 13, + 0, + 4, + 15, + 0, + 9, + 1, + 0, + 6, + 7, + 18, + 7, + 7, + 8, + 9, + 8, + 8, + 16, + 11, + 5 + ], + "weighted_loads": [ + 0.39923952147364616, + 0.03295338153839111, + 0.14286334440112114, + 0.1283346712589264, + 0.5733567029237747, + 0.7361197359859943, + 0.179048927500844, + 0.38412487879395485, + 0.8818720541894436, + 0.0, + 0.25931088253855705, + 0.4703502608463168, + 0.8948543779551983, + 0.26492566615343094, + 1.5049202926456928, + 0.260579289868474, + 1.7187289372086525, + 0.22735376562923193, + 1.251731801778078, + 0.3234085217118263, + 0.07266479730606079, + 0.1288525052368641, + 0.10925761237740517, + 0.7174720615148544, + 0.0, + 0.0, + 0.15708565711975098, + 0.14261787105351686, + 0.7984267994761467, + 0.13383661583065987, + 0.8749601375311613, + 0.9029363803565502, + 0.09597073681652546, + 0.17757265642285347, + 0.25266290083527565, + 1.2175297252833843, + 0.03304371237754822, + 0.0, + 0.0, + 0.04651694372296333, + 0.35632432997226715, + 0.0, + 0.0, + 2.306457594037056, + 1.1151901297271252, + 0.0, + 0.23876018822193146, + 1.0517050996422768, + 0.0, + 0.5622031353414059, + 0.04148097708821297, + 0.0, + 0.26948925480246544, + 0.3895222842693329, + 1.0988311134278774, + 0.3327276185154915, + 0.5029926896095276, + 0.6308241039514542, + 0.4302800316363573, + 0.4015978332608938, + 0.3174975514411926, + 1.1701030917465687, + 0.5704792253673077, + 0.20009860210120678 + ], + "unique_experts": 54, + "load_cv": 0.8759841026800361, + "normalized_load_entropy": 0.9017821676135916, + "max_load_share": 0.057777777777777775 + } + }, + "s0_period": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "9bef0ab6fb76491ccb8be57d08c5637621dadba7a98ef68cf00033480f059e80", + "route_weight_sha256": "27b15124a12257fe7b83a0e1d4c609e4958c757088e3d79b90c9f4e49da27292", + "loads": [ + 5, + 0, + 2, + 3, + 0, + 10, + 4, + 4, + 5, + 0, + 3, + 11, + 11, + 4, + 22, + 6, + 1, + 6, + 0, + 4, + 0, + 1, + 0, + 7, + 0, + 1, + 1, + 2, + 0, + 3, + 10, + 8, + 1, + 3, + 0, + 6, + 2, + 0, + 0, + 0, + 2, + 0, + 0, + 0, + 10, + 0, + 3, + 1, + 0, + 3, + 1, + 0, + 6, + 1, + 0, + 0, + 2, + 7, + 5, + 3, + 4, + 7, + 0, + 3 + ], + "weighted_loads": [ + 0.2810300141572952, + 0.0, + 0.10177449882030487, + 0.1371573843061924, + 0.0, + 0.6401058360934258, + 0.17268218100070953, + 0.25900378078222275, + 0.2847573086619377, + 0.0, + 0.1490749455988407, + 0.4347450155764818, + 0.888937421143055, + 0.2633862718939781, + 1.424278274178505, + 0.2246200367808342, + 0.04022590070962906, + 0.2499686125665903, + 0.0, + 0.2825838141143322, + 0.0, + 0.05878148972988129, + 0.0, + 0.49943870306015015, + 0.0, + 0.03504718467593193, + 0.040012724697589874, + 0.0912371315062046, + 0.0, + 0.13080934807658195, + 0.5347340498119593, + 0.5810356214642525, + 0.03559431806206703, + 0.18102290481328964, + 0.0, + 0.6621762029826641, + 0.06619699858129025, + 0.0, + 0.0, + 0.0, + 0.09649116545915604, + 0.0, + 0.0, + 0.0, + 0.9419974815100431, + 0.0, + 0.19755885750055313, + 0.03818581998348236, + 0.0, + 0.20291819795966148, + 0.040923379361629486, + 0.0, + 0.2614048458635807, + 0.036584097892045975, + 0.0, + 0.0, + 0.06029866822063923, + 0.5981013104319572, + 0.2465086244046688, + 0.15644657239317894, + 0.16598538681864738, + 0.6368203833699226, + 0.0, + 0.132777888327837 + ], + "unique_experts": 43, + "load_cv": 1.2312414067795765, + "normalized_load_entropy": 0.8361440856816893, + "max_load_share": 0.10784313725490197 + }, + "full_input": { + "tokens": 59, + "top_k": 6, + "decisions": 354, + "ordered_route_sha256": "c5770eaf2465de80ffe3d1b18d892bbd679c0249258ec86e06b1dfb114775aa1", + "route_weight_sha256": "df060b0778c30af1ab02b66216a81dd0320ab69f36884bf7b5d2132a2bce1b29", + "loads": [ + 5, + 0, + 3, + 3, + 6, + 10, + 4, + 4, + 10, + 1, + 5, + 13, + 11, + 4, + 22, + 13, + 7, + 7, + 12, + 4, + 0, + 1, + 0, + 12, + 0, + 1, + 1, + 3, + 7, + 3, + 16, + 17, + 3, + 3, + 4, + 11, + 2, + 0, + 0, + 0, + 9, + 0, + 0, + 23, + 13, + 0, + 3, + 9, + 0, + 6, + 1, + 0, + 6, + 1, + 3, + 1, + 2, + 7, + 8, + 5, + 5, + 13, + 7, + 4 + ], + "weighted_loads": [ + 0.2810300141572952, + 0.0, + 0.16075577214360237, + 0.1371573843061924, + 0.3081227168440819, + 0.6401058360934258, + 0.17268218100070953, + 0.25900378078222275, + 0.5325609482824802, + 0.030993279069662094, + 0.2161739468574524, + 0.47652558889240026, + 0.888937421143055, + 0.2633862718939781, + 1.424278274178505, + 0.4984035901725292, + 0.627737145870924, + 0.2648139735683799, + 1.2212125547230244, + 0.2825838141143322, + 0.0, + 0.05878148972988129, + 0.0, + 0.7543241754174232, + 0.0, + 0.03504718467593193, + 0.040012724697589874, + 0.10383267793804407, + 0.5438798777759075, + 0.13080934807658195, + 0.82888338342309, + 0.9757944941520691, + 0.10041995160281658, + 0.18102290481328964, + 0.1808241829276085, + 1.1256029643118382, + 0.06619699858129025, + 0.0, + 0.0, + 0.0, + 0.48709646984934807, + 0.0, + 0.0, + 2.081941843032837, + 1.1050263214856386, + 0.0, + 0.19755885750055313, + 0.6278967894613743, + 0.0, + 0.3657201938331127, + 0.040923379361629486, + 0.0, + 0.2614048458635807, + 0.036584097892045975, + 0.15846002474427223, + 0.03873997554183006, + 0.06029866822063923, + 0.5981013104319572, + 0.3808215521275997, + 0.2774011455476284, + 0.2139245569705963, + 1.0380353834480047, + 0.4145776927471161, + 0.15859159268438816 + ], + "unique_experts": 52, + "load_cv": 0.9767150853136657, + "normalized_load_entropy": 0.8844467955434876, + "max_load_share": 0.06497175141242938 + } + }, + "s1_period": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "b08235ee68fb2d6164f0b4632dfe09c23325234979f6b33c7416cb2c00a6edb4", + "route_weight_sha256": "42674b2cb0b52dec529b755d273d8d16ab56422ef8c564fc2586eb002523de33", + "loads": [ + 5, + 0, + 1, + 3, + 0, + 10, + 5, + 4, + 5, + 0, + 3, + 11, + 11, + 4, + 22, + 6, + 1, + 5, + 0, + 4, + 0, + 1, + 0, + 7, + 0, + 0, + 1, + 2, + 0, + 3, + 10, + 8, + 1, + 3, + 0, + 6, + 2, + 0, + 0, + 0, + 1, + 0, + 0, + 0, + 11, + 0, + 3, + 2, + 0, + 4, + 1, + 0, + 6, + 0, + 0, + 0, + 1, + 7, + 6, + 3, + 5, + 7, + 0, + 3 + ], + "weighted_loads": [ + 0.28628935292363167, + 0.0, + 0.057687241584062576, + 0.1289985179901123, + 0.0, + 0.6431729272007942, + 0.20812617801129818, + 0.2561764568090439, + 0.29255684092640877, + 0.0, + 0.1516648568212986, + 0.4391855001449585, + 0.8899821229279041, + 0.2679241672158241, + 1.4410832151770592, + 0.21787571348249912, + 0.0333097018301487, + 0.21319688856601715, + 0.0, + 0.2850045822560787, + 0.0, + 0.057442110031843185, + 0.0, + 0.486307755112648, + 0.0, + 0.0, + 0.041168686002492905, + 0.08798646181821823, + 0.0, + 0.12985679879784584, + 0.509975865483284, + 0.5835663788020611, + 0.033639490604400635, + 0.17733057215809822, + 0.0, + 0.6487254202365875, + 0.06370926089584827, + 0.0, + 0.0, + 0.0, + 0.052636537700891495, + 0.0, + 0.0, + 0.0, + 0.981561129912734, + 0.0, + 0.19204870611429214, + 0.07347660884261131, + 0.0, + 0.2396521456539631, + 0.040341854095458984, + 0.0, + 0.2687573507428169, + 0.0, + 0.0, + 0.0, + 0.033357564359903336, + 0.5754777602851391, + 0.2784081008285284, + 0.15788203850388527, + 0.2008562795817852, + 0.6335366442799568, + 0.0, + 0.13195959106087685 + ], + "unique_experts": 41, + "load_cv": 1.2547487651589142, + "normalized_load_entropy": 0.8269129906630236, + "max_load_share": 0.10784313725490197 + }, + "full_input": { + "tokens": 75, + "top_k": 6, + "decisions": 450, + "ordered_route_sha256": "8b06d23f709014b79539c7bce4461fcbb82467e7114a479c6affc63afeda4a1e", + "route_weight_sha256": "231b0b9b5be9917fbc4462923986af78864e3b402c992d7621a4079740c091a8", + "loads": [ + 7, + 1, + 2, + 3, + 12, + 15, + 5, + 6, + 15, + 0, + 6, + 13, + 11, + 4, + 24, + 9, + 20, + 6, + 10, + 5, + 1, + 2, + 2, + 12, + 0, + 0, + 4, + 4, + 11, + 3, + 17, + 14, + 2, + 3, + 5, + 14, + 2, + 0, + 0, + 1, + 6, + 0, + 0, + 26, + 13, + 0, + 4, + 15, + 0, + 9, + 1, + 0, + 6, + 5, + 17, + 7, + 7, + 8, + 8, + 8, + 8, + 16, + 10, + 5 + ], + "weighted_loads": [ + 0.43479910120368004, + 0.03295338153839111, + 0.104039516299963, + 0.1289985179901123, + 0.6425124928355217, + 0.8206884581595659, + 0.20812617801129818, + 0.38626525923609734, + 0.8831275217235088, + 0.0, + 0.2616879753768444, + 0.4809591369703412, + 0.8899821229279041, + 0.2679241672158241, + 1.5154237300157547, + 0.32745965756475925, + 1.7118501476943493, + 0.22804224956780672, + 1.1744742952287197, + 0.3237883262336254, + 0.07266479730606079, + 0.12807707116007805, + 0.10925761237740517, + 0.7108838148415089, + 0.0, + 0.0, + 0.15712438896298409, + 0.13887833524495363, + 0.8679792732000351, + 0.12985679879784584, + 0.8748208601027727, + 0.8565875999629498, + 0.06595954671502113, + 0.17733057215809822, + 0.24741073325276375, + 1.2947541736066341, + 0.06370926089584827, + 0.0, + 0.0, + 0.04651694372296333, + 0.3158573843538761, + 0.0, + 0.0, + 2.3046519309282303, + 1.1164056044071913, + 0.0, + 0.23833495005965233, + 1.0638694018125534, + 0.0, + 0.5513760671019554, + 0.040341854095458984, + 0.0, + 0.2687573507428169, + 0.303060419857502, + 1.0698700547218323, + 0.3327276185154915, + 0.5041083991527557, + 0.6182459145784378, + 0.3811915274709463, + 0.39249072037637234, + 0.32694394886493683, + 1.164140660315752, + 0.5181495472788811, + 0.20468070544302464 + ], + "unique_experts": 54, + "load_cv": 0.8785060270175571, + "normalized_load_entropy": 0.9012782432415598, + "max_load_share": 0.057777777777777775 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 34, + "ordered_topk_exact_tokens": 22, + "set_exact_tokens": 27, + "mean_set_jaccard": 0.9411764705882355, + "mean_token_weighted_tv": 0.010807172258329742, + "aggregate_load_tv": 0.03431372549019608 + }, + "system_bos": { + "tokens": 34, + "ordered_topk_exact_tokens": 22, + "set_exact_tokens": 25, + "mean_set_jaccard": 0.9243697478991597, + "mean_token_weighted_tv": 0.013682948452804019, + "aggregate_load_tv": 0.029411764705882356 + }, + "system_x": { + "tokens": 34, + "ordered_topk_exact_tokens": 23, + "set_exact_tokens": 27, + "mean_set_jaccard": 0.9411764705882353, + "mean_token_weighted_tv": 0.013744570835329154, + "aggregate_load_tv": 0.03431372549019608 + }, + "system_period": { + "tokens": 34, + "ordered_topk_exact_tokens": 20, + "set_exact_tokens": 27, + "mean_set_jaccard": 0.9411764705882353, + "mean_token_weighted_tv": 0.013395665076506488, + "aggregate_load_tv": 0.029411764705882353 + }, + "bos_at_s0": { + "tokens": 34, + "ordered_topk_exact_tokens": 20, + "set_exact_tokens": 27, + "mean_set_jaccard": 0.9411764705882353, + "mean_token_weighted_tv": 0.013865779784014997, + "aggregate_load_tv": 0.029411764705882353 + }, + "bos_at_s1": { + "tokens": 34, + "ordered_topk_exact_tokens": 16, + "set_exact_tokens": 24, + "mean_set_jaccard": 0.9159663865546218, + "mean_token_weighted_tv": 0.016900718896923697, + "aggregate_load_tv": 0.0392156862745098 + }, + "x_at_s0": { + "tokens": 34, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 24, + "mean_set_jaccard": 0.9096638655462186, + "mean_token_weighted_tv": 0.018879569162998128, + "aggregate_load_tv": 0.0392156862745098 + }, + "x_at_s1": { + "tokens": 34, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 20, + "mean_set_jaccard": 0.8697478991596639, + "mean_token_weighted_tv": 0.025259106502156046, + "aggregate_load_tv": 0.06372549019607843 + }, + "period_at_s0": { + "tokens": 34, + "ordered_topk_exact_tokens": 16, + "set_exact_tokens": 23, + "mean_set_jaccard": 0.9012605042016807, + "mean_token_weighted_tv": 0.01990252804449376, + "aggregate_load_tv": 0.04411764705882353 + }, + "period_at_s1": { + "tokens": 34, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.8676470588235294, + "mean_token_weighted_tv": 0.02531224669998183, + "aggregate_load_tv": 0.06862745098039215 + } + } + }, + "layer_12": { + "layer": 12, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "e74019772ec75e065c28ab442844d3b4c52de53344b698d34cb3dd6df43b5f91", + "route_weight_sha256": "e207743348310718084f1c1473578660e2e36592ab1c3af9d85725e0205dfc8e", + "loads": [ + 2, + 0, + 4, + 2, + 1, + 7, + 21, + 4, + 4, + 0, + 2, + 4, + 0, + 2, + 0, + 2, + 1, + 1, + 4, + 2, + 3, + 4, + 5, + 8, + 0, + 6, + 0, + 9, + 0, + 0, + 0, + 1, + 1, + 2, + 0, + 5, + 0, + 7, + 1, + 5, + 3, + 1, + 3, + 1, + 1, + 0, + 3, + 1, + 1, + 3, + 2, + 16, + 5, + 2, + 8, + 0, + 9, + 7, + 4, + 0, + 0, + 2, + 8, + 4 + ], + "weighted_loads": [ + 0.08073922619223595, + 0.0, + 0.17611655965447426, + 0.05729003995656967, + 0.1426893174648285, + 0.3887924700975418, + 1.2329878322780132, + 0.3050983175635338, + 0.17046544328331947, + 0.0, + 0.12129930034279823, + 0.21730900928378105, + 0.0, + 0.07378990948200226, + 0.0, + 0.07581755146384239, + 0.046721067279577255, + 0.04215317219495773, + 0.2262747958302498, + 0.07074051722884178, + 0.18655763193964958, + 0.25106603279709816, + 0.4144405908882618, + 0.3380474802106619, + 0.0, + 0.321248821914196, + 0.0, + 0.7123631052672863, + 0.0, + 0.0, + 0.0, + 0.043606117367744446, + 0.036682259291410446, + 0.09501751139760017, + 0.0, + 0.20576922968029976, + 0.0, + 0.33343178778886795, + 0.034298125654459, + 0.2352494690567255, + 0.1166815385222435, + 0.032793786376714706, + 0.15121447294950485, + 0.07052113860845566, + 0.05470612645149231, + 0.0, + 0.23592431098222733, + 0.03139054775238037, + 0.03627214953303337, + 0.14013785123825073, + 0.10758301988244057, + 1.8978981524705887, + 0.3005216754972935, + 0.05855508893728256, + 0.368900615721941, + 0.0, + 0.6174424774944782, + 0.3268138263374567, + 0.15171681717038155, + 0.0, + 0.0, + 0.09981107711791992, + 0.30782635882496834, + 0.22111556306481361 + ], + "unique_experts": 49, + "load_cv": 1.1815250898182612, + "normalized_load_entropy": 0.8588237141190919, + "max_load_share": 0.10294117647058823 + }, + "full_input": { + "tokens": 59, + "top_k": 6, + "decisions": 354, + "ordered_route_sha256": "794a58b8baafeaef9ff3f6da1e9dc437e91d2610214b5422d8599f2698e40a02", + "route_weight_sha256": "c0f9992da7f915ffb6efc9ee01682009e1b1f0fb5b9f8f81ffac7b2a13020189", + "loads": [ + 2, + 0, + 4, + 8, + 3, + 8, + 21, + 5, + 10, + 0, + 2, + 4, + 5, + 2, + 0, + 2, + 4, + 1, + 4, + 2, + 4, + 5, + 7, + 15, + 0, + 6, + 1, + 15, + 15, + 10, + 2, + 7, + 2, + 4, + 0, + 12, + 0, + 11, + 15, + 5, + 3, + 6, + 9, + 2, + 3, + 1, + 4, + 5, + 4, + 3, + 3, + 16, + 5, + 2, + 8, + 0, + 13, + 8, + 5, + 4, + 0, + 7, + 13, + 7 + ], + "weighted_loads": [ + 0.08073922619223595, + 0.0, + 0.17611655965447426, + 0.21153609524480999, + 1.695809930562973, + 0.39280662406235933, + 1.2329878322780132, + 0.3807665929198265, + 0.7055293675512075, + 0.0, + 0.12129930034279823, + 0.21730900928378105, + 0.22010605409741402, + 0.07378990948200226, + 0.0, + 0.07581755146384239, + 0.22621000930666924, + 0.04215317219495773, + 0.2262747958302498, + 0.07074051722884178, + 0.18886182247661054, + 0.2929156981408596, + 0.5559065565466881, + 0.8618474919348955, + 0.0, + 0.321248821914196, + 0.03282621502876282, + 1.076684720814228, + 1.840192936360836, + 1.561852052807808, + 0.062333038076758385, + 0.3271443694829941, + 0.08303267508745193, + 0.1909625306725502, + 0.0, + 0.6987596750259399, + 0.0, + 0.4462554855272174, + 1.1736974939703941, + 0.2352494690567255, + 0.1166815385222435, + 0.49827615171670914, + 0.5271718688309193, + 0.14332344383001328, + 0.14503806829452515, + 0.03724302724003792, + 0.27145756781101227, + 0.2558961398899555, + 0.18229807913303375, + 0.14013785123825073, + 0.12052061688154936, + 1.8978981524705887, + 0.3005216754972935, + 0.05855508893728256, + 0.368900615721941, + 0.0, + 0.8501238087192178, + 0.3998477924615145, + 0.2204354740679264, + 0.14304546359926462, + 0.0, + 0.339495537802577, + 0.5021733436733484, + 0.3166915439069271 + ], + "unique_experts": 56, + "load_cv": 0.8605207876897312, + "normalized_load_entropy": 0.9105274185783021, + "max_load_share": 0.059322033898305086 + } + }, + "s1_eos": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "ec9ce08066e9bf6deea5b11e186ade8a8631eee351b1d96963af3aab3eb65c2a", + "route_weight_sha256": "404c823fb580f49d5cb8ea965e218d2e2a08b0dd5cc11cbcf43b193d8eda51be", + "loads": [ + 2, + 0, + 4, + 2, + 1, + 7, + 22, + 4, + 4, + 0, + 2, + 4, + 0, + 2, + 0, + 2, + 1, + 1, + 4, + 3, + 3, + 4, + 5, + 7, + 0, + 6, + 0, + 8, + 0, + 0, + 0, + 0, + 1, + 2, + 0, + 5, + 0, + 7, + 1, + 5, + 3, + 1, + 3, + 1, + 1, + 0, + 3, + 2, + 1, + 3, + 2, + 16, + 6, + 2, + 7, + 0, + 9, + 7, + 4, + 0, + 0, + 2, + 8, + 4 + ], + "weighted_loads": [ + 0.0781073346734047, + 0.0, + 0.17989328503608704, + 0.05838976800441742, + 0.14690469205379486, + 0.3971135802567005, + 1.2564819268882275, + 0.3073800802230835, + 0.1667250581085682, + 0.0, + 0.12208075076341629, + 0.21155143156647682, + 0.0, + 0.07794853299856186, + 0.0, + 0.07643460109829903, + 0.049168605357408524, + 0.04289141669869423, + 0.22517096996307373, + 0.10270269587635994, + 0.1909000128507614, + 0.2489098161458969, + 0.3941171392798424, + 0.3009667284786701, + 0.0, + 0.3203501868993044, + 0.0, + 0.6802517659962177, + 0.0, + 0.0, + 0.0, + 0.0, + 0.036488570272922516, + 0.09394900500774384, + 0.0, + 0.20861202478408813, + 0.0, + 0.3279912509024143, + 0.03623379021883011, + 0.23252420127391815, + 0.117913618683815, + 0.031163383275270462, + 0.1541787050664425, + 0.06985022127628326, + 0.055350687354803085, + 0.0, + 0.23543304204940796, + 0.06067553162574768, + 0.03497227653861046, + 0.1424613744020462, + 0.11352076753973961, + 1.9389319904148579, + 0.3493353985249996, + 0.05828852951526642, + 0.33755354955792427, + 0.0, + 0.6052719615399837, + 0.31394126638770103, + 0.1541454903781414, + 0.0, + 0.0, + 0.1020260639488697, + 0.3014493230730295, + 0.21933140978217125 + ], + "unique_experts": 48, + "load_cv": 1.1906014104517855, + "normalized_load_entropy": 0.8577636686456067, + "max_load_share": 0.10784313725490197 + }, + "full_input": { + "tokens": 75, + "top_k": 6, + "decisions": 450, + "ordered_route_sha256": "ff962f391f07f23301294e64f884c6ba4ccb4fe50b1937f1822dbbffeb6939ad", + "route_weight_sha256": "cb1e033644cc78298acc97d1e223ba66b6b8aa5c75672e4b174a48126e702b22", + "loads": [ + 6, + 0, + 4, + 5, + 5, + 8, + 22, + 9, + 12, + 3, + 3, + 4, + 4, + 2, + 0, + 2, + 5, + 3, + 5, + 3, + 4, + 7, + 8, + 13, + 0, + 6, + 3, + 15, + 17, + 15, + 11, + 5, + 5, + 7, + 5, + 12, + 0, + 10, + 19, + 5, + 3, + 12, + 11, + 4, + 14, + 4, + 6, + 8, + 8, + 3, + 4, + 16, + 6, + 5, + 7, + 1, + 13, + 13, + 5, + 5, + 2, + 11, + 13, + 4 + ], + "weighted_loads": [ + 0.2699914686381817, + 0.0, + 0.17989328503608704, + 0.12029124679975212, + 1.7689383924007416, + 0.40102857211604714, + 1.2564819268882275, + 0.5674133412539959, + 0.9015813916921616, + 0.3195958808064461, + 0.1655624508857727, + 0.21155143156647682, + 0.1640276126563549, + 0.07794853299856186, + 0.0, + 0.07643460109829903, + 0.33935893326997757, + 0.15793177112936974, + 0.2609555162489414, + 0.10270269587635994, + 0.19322109874337912, + 0.3830077238380909, + 0.5743077583611012, + 0.767331525683403, + 0.0, + 0.3203501868993044, + 0.1229870580136776, + 1.0560189224779606, + 2.151754479855299, + 2.3684101179242134, + 0.8592300768941641, + 0.23121013306081295, + 0.21430456638336182, + 0.38629788905382156, + 0.24958111345767975, + 0.7729254327714443, + 0.0, + 0.465807662345469, + 1.430142804980278, + 0.23252420127391815, + 0.117913618683815, + 0.974556814879179, + 0.6345800720155239, + 0.2477431781589985, + 1.2535459510982037, + 0.30943066999316216, + 0.36278364434838295, + 0.3779946994036436, + 0.37054123543202877, + 0.1424613744020462, + 0.1791835045441985, + 1.9389319904148579, + 0.3493353985249996, + 0.21657224372029305, + 0.33755354955792427, + 0.03151680529117584, + 0.812125064432621, + 0.6053073555231094, + 0.22256800159811974, + 0.16949330363422632, + 0.07218622043728828, + 0.5761523619294167, + 0.5195270273834467, + 0.21933140978217125 + ], + "unique_experts": 60, + "load_cv": 0.6998976997557977, + "normalized_load_entropy": 0.9400043284234261, + "max_load_share": 0.04888888888888889 + } + }, + "s0_bos": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "fabae56f043fe77ac90334e10399f4c23f319815f48b0344b7d89c75bbeaaa2c", + "route_weight_sha256": "ca8fc33cc2aa0fafe8141aa9f0f4b6920f9b257eed180a08e6d19c14c652b744", + "loads": [ + 2, + 0, + 4, + 2, + 2, + 7, + 21, + 5, + 3, + 1, + 2, + 4, + 0, + 2, + 1, + 2, + 1, + 2, + 4, + 3, + 4, + 5, + 5, + 5, + 0, + 6, + 0, + 8, + 0, + 0, + 0, + 0, + 1, + 2, + 0, + 6, + 0, + 7, + 1, + 3, + 3, + 1, + 2, + 1, + 1, + 0, + 3, + 0, + 1, + 3, + 3, + 16, + 6, + 2, + 8, + 0, + 10, + 7, + 2, + 0, + 0, + 1, + 8, + 5 + ], + "weighted_loads": [ + 0.07260937057435513, + 0.0, + 0.19379518181085587, + 0.05951510742306709, + 0.1893712319433689, + 0.39663832262158394, + 1.2451757322996855, + 0.3442509099841118, + 0.12384242936968803, + 0.04002407565712929, + 0.11776936799287796, + 0.20712098851799965, + 0.0, + 0.07587248459458351, + 0.02788645774126053, + 0.08400018140673637, + 0.05269099771976471, + 0.07191352173686028, + 0.22840414941310883, + 0.1041404977440834, + 0.23305219784379005, + 0.27733610942959785, + 0.39387670531868935, + 0.21109371073544025, + 0.0, + 0.32543206959962845, + 0.0, + 0.6970906406641006, + 0.0, + 0.0, + 0.0, + 0.0, + 0.038114652037620544, + 0.09644121676683426, + 0.0, + 0.26129334792494774, + 0.0, + 0.32832682877779007, + 0.03530661016702652, + 0.18700644746422768, + 0.11925854906439781, + 0.03310476616024971, + 0.11695263162255287, + 0.07021002471446991, + 0.052792880684137344, + 0.0, + 0.23097705841064453, + 0.0, + 0.03461841121315956, + 0.13974543288350105, + 0.1501496136188507, + 1.8833725303411484, + 0.3498445823788643, + 0.056630220264196396, + 0.3587627336382866, + 0.0, + 0.6475274432450533, + 0.32081808522343636, + 0.07708292827010155, + 0.0, + 0.0, + 0.04761441424489021, + 0.30086688697338104, + 0.26283079013228416 + ], + "unique_experts": 49, + "load_cv": 1.176307178193776, + "normalized_load_entropy": 0.8602129327381035, + "max_load_share": 0.10294117647058823 + }, + "full_input": { + "tokens": 59, + "top_k": 6, + "decisions": 354, + "ordered_route_sha256": "bff7371409d6a92f81f2248a8dd857f5bb997dfaf72fc1d5eb319253515655ba", + "route_weight_sha256": "6610cc23427359ee6e096d8a2772506d6bfee499145efa431803fa31c86153a9", + "loads": [ + 2, + 0, + 4, + 7, + 3, + 7, + 21, + 6, + 9, + 1, + 2, + 4, + 6, + 2, + 1, + 2, + 6, + 2, + 4, + 3, + 4, + 6, + 7, + 12, + 0, + 6, + 2, + 14, + 16, + 10, + 2, + 6, + 3, + 4, + 0, + 13, + 0, + 11, + 15, + 3, + 3, + 5, + 7, + 3, + 3, + 1, + 4, + 4, + 5, + 3, + 4, + 16, + 6, + 2, + 8, + 0, + 13, + 8, + 3, + 4, + 0, + 6, + 12, + 8 + ], + "weighted_loads": [ + 0.07260937057435513, + 0.0, + 0.19379518181085587, + 0.21068488340824842, + 0.7917162217199802, + 0.39663832262158394, + 1.2451757322996855, + 0.4199191853404045, + 0.6980954464524984, + 0.04002407565712929, + 0.11776936799287796, + 0.20712098851799965, + 0.28615206852555275, + 0.07587248459458351, + 0.02788645774126053, + 0.08400018140673637, + 0.2931959256529808, + 0.07191352173686028, + 0.22840414941310883, + 0.1041404977440834, + 0.23305219784379005, + 0.3237277679145336, + 0.5408862009644508, + 0.7348937224596739, + 0.0, + 0.32543206959962845, + 0.07491516321897507, + 1.0614122562110424, + 1.8691511452198029, + 1.6686432175338268, + 0.062333038076758385, + 0.29362234845757484, + 0.12289012596011162, + 0.19906582310795784, + 0.0, + 0.7542837932705879, + 0.0, + 0.4411505265161395, + 1.2504570223391056, + 0.18700644746422768, + 0.11925854906439781, + 0.4770543985068798, + 0.4587818682193756, + 0.1958276554942131, + 0.14422674849629402, + 0.03724302724003792, + 0.26761987060308456, + 0.21659604087471962, + 0.21323519945144653, + 0.13974543288350105, + 0.1630872106179595, + 1.8833725303411484, + 0.3498445823788643, + 0.056630220264196396, + 0.3587627336382866, + 0.0, + 0.8719565365463495, + 0.39235110953450203, + 0.14557277783751488, + 0.20079127978533506, + 0.0, + 0.2807136345654726, + 0.44769435189664364, + 0.35840677097439766 + ], + "unique_experts": 58, + "load_cv": 0.8241425572717999, + "normalized_load_entropy": 0.9202622778868546, + "max_load_share": 0.059322033898305086 + } + }, + "s1_bos": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "7d454ec7ad3bd55e26f8a72163fac98c3f4d549cd023e173761fce13204eee5c", + "route_weight_sha256": "ec8b649f49c434c12345c1b678b3d518b9300699309339b22edf5a54278b8bca", + "loads": [ + 2, + 0, + 4, + 2, + 2, + 7, + 22, + 4, + 4, + 0, + 2, + 3, + 0, + 2, + 1, + 2, + 1, + 2, + 4, + 6, + 3, + 5, + 5, + 5, + 0, + 6, + 0, + 8, + 0, + 0, + 0, + 0, + 1, + 2, + 0, + 6, + 0, + 7, + 1, + 3, + 3, + 1, + 3, + 1, + 1, + 0, + 3, + 0, + 1, + 3, + 2, + 16, + 6, + 2, + 9, + 0, + 8, + 6, + 3, + 0, + 0, + 2, + 8, + 4 + ], + "weighted_loads": [ + 0.07496170327067375, + 0.0, + 0.1730601154267788, + 0.058328889310359955, + 0.18796226382255554, + 0.38885555416345596, + 1.2678860202431679, + 0.31450866162776947, + 0.16191504150629044, + 0.0, + 0.1254097931087017, + 0.15648256614804268, + 0.0, + 0.07696359977126122, + 0.02740298956632614, + 0.0850851871073246, + 0.05104120448231697, + 0.06876039132475853, + 0.22075898945331573, + 0.19472063519060612, + 0.19383401423692703, + 0.2776257395744324, + 0.3901396803557873, + 0.21937952935695648, + 0.0, + 0.323197890073061, + 0.0, + 0.6985480040311813, + 0.0, + 0.0, + 0.0, + 0.0, + 0.036328744143247604, + 0.09943636134266853, + 0.0, + 0.2620627358555794, + 0.0, + 0.31936127319931984, + 0.034833163022994995, + 0.18105699121952057, + 0.11488994210958481, + 0.03384123370051384, + 0.15915578231215477, + 0.06876995414495468, + 0.052835963666439056, + 0.0, + 0.23910992592573166, + 0.0, + 0.03423867002129555, + 0.1463700756430626, + 0.11349375918507576, + 1.8803222998976707, + 0.3527497686445713, + 0.055357325822114944, + 0.4023630451411009, + 0.0, + 0.5686450116336346, + 0.2964817024767399, + 0.1149001270532608, + 0.0, + 0.0, + 0.0954122319817543, + 0.30476496927440166, + 0.22071245312690735 + ], + "unique_experts": 48, + "load_cv": 1.1893090340486863, + "normalized_load_entropy": 0.8585115063465071, + "max_load_share": 0.10784313725490197 + }, + "full_input": { + "tokens": 75, + "top_k": 6, + "decisions": 450, + "ordered_route_sha256": "adbbd9ee4c4a63885ba0c626cb23b509cb171f0499ccfa6cdf46bf4ad91caafe", + "route_weight_sha256": "69df9201efa1345fac630431c87e32f50218c5437e3068895b888f452353f387", + "loads": [ + 6, + 0, + 4, + 4, + 6, + 7, + 22, + 9, + 12, + 3, + 3, + 3, + 4, + 2, + 1, + 2, + 5, + 4, + 5, + 6, + 3, + 8, + 8, + 11, + 0, + 7, + 3, + 15, + 17, + 17, + 11, + 5, + 5, + 7, + 5, + 13, + 0, + 10, + 19, + 3, + 3, + 12, + 10, + 5, + 14, + 4, + 6, + 6, + 9, + 3, + 4, + 16, + 6, + 5, + 9, + 1, + 11, + 12, + 4, + 5, + 2, + 11, + 13, + 4 + ], + "weighted_loads": [ + 0.26684583723545074, + 0.0, + 0.1730601154267788, + 0.1173060080036521, + 0.8934385664761066, + 0.38885555416345596, + 1.2678860202431679, + 0.5745419226586819, + 0.9546860828995705, + 0.3195958808064461, + 0.16889149323105812, + 0.15648256614804268, + 0.19947253540158272, + 0.07696359977126122, + 0.02740298956632614, + 0.0850851871073246, + 0.3321528881788254, + 0.18380074575543404, + 0.2565435357391834, + 0.19472063519060612, + 0.19383401423692703, + 0.4123522788286209, + 0.5751805007457733, + 0.6857443265616894, + 0.0, + 0.3653043806552887, + 0.1229870580136776, + 1.0743151605129242, + 2.2689736410975456, + 2.591241329908371, + 0.8592300768941641, + 0.22898690216243267, + 0.2141447402536869, + 0.39510542154312134, + 0.24958111345767975, + 0.8263761438429356, + 0.0, + 0.4571776846423745, + 1.543829757720232, + 0.18105699121952057, + 0.11488994210958481, + 0.9801113940775394, + 0.6050059832632542, + 0.2956813648343086, + 1.25040602684021, + 0.30943066999316216, + 0.3668179400265217, + 0.3238279055804014, + 0.39918108098208904, + 0.1463700756430626, + 0.17915649618953466, + 1.8803222998976707, + 0.3527497686445713, + 0.21364104002714157, + 0.4023630451411009, + 0.03151680529117584, + 0.7567189186811447, + 0.5921433940529823, + 0.18432392179965973, + 0.2020172094926238, + 0.07218622043728828, + 0.5651721842586994, + 0.5228426735848188, + 0.22071245312690735 + ], + "unique_experts": 61, + "load_cv": 0.6971830444946752, + "normalized_load_entropy": 0.9415045982149771, + "max_load_share": 0.04888888888888889 + } + }, + "s0_x": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "e17516b5921ff4afb96a27a25e1caf509aebe4c39f556759cd3d5306791393cc", + "route_weight_sha256": "a882ed17cfd778541ad78f037d3a3a44d8b30afc5d5c6acae8e018ceb32cff08", + "loads": [ + 2, + 0, + 4, + 2, + 2, + 7, + 21, + 4, + 4, + 0, + 2, + 3, + 0, + 2, + 1, + 2, + 1, + 1, + 4, + 3, + 4, + 5, + 5, + 6, + 0, + 6, + 0, + 8, + 0, + 0, + 0, + 0, + 1, + 2, + 0, + 6, + 0, + 7, + 1, + 3, + 2, + 1, + 3, + 1, + 1, + 0, + 3, + 2, + 2, + 4, + 2, + 16, + 6, + 2, + 9, + 0, + 7, + 6, + 3, + 0, + 0, + 3, + 8, + 4 + ], + "weighted_loads": [ + 0.07638277485966682, + 0.0, + 0.1807863786816597, + 0.05604627542197704, + 0.1977705992758274, + 0.39497774466872215, + 1.2396135702729225, + 0.3068777322769165, + 0.16465085744857788, + 0.0, + 0.12290968000888824, + 0.1565641686320305, + 0.0, + 0.08172092959284782, + 0.029023008421063423, + 0.07792238518595695, + 0.0446925088763237, + 0.04173813760280609, + 0.22446831315755844, + 0.10142317041754723, + 0.22830489464104176, + 0.2698845509439707, + 0.398031122982502, + 0.2521405667066574, + 0.0, + 0.3225790672004223, + 0.0, + 0.6988003142178059, + 0.0, + 0.0, + 0.0, + 0.0, + 0.03720589354634285, + 0.09829063713550568, + 0.0, + 0.26506343111395836, + 0.0, + 0.31979393772780895, + 0.034484557807445526, + 0.1807735189795494, + 0.07650590315461159, + 0.04216983914375305, + 0.1595580317080021, + 0.07017763704061508, + 0.05149044096469879, + 0.0, + 0.24067877233028412, + 0.06087959557771683, + 0.06618057191371918, + 0.17326722852885723, + 0.10511483624577522, + 1.8167312256991863, + 0.35237951949238777, + 0.05761282704770565, + 0.40186621248722076, + 0.0, + 0.5499375015497208, + 0.3059246689081192, + 0.11148645728826523, + 0.0, + 0.0, + 0.1406913623213768, + 0.3071520198136568, + 0.2276531122624874 + ], + "unique_experts": 49, + "load_cv": 1.1525342752694585, + "normalized_load_entropy": 0.8655228407042387, + "max_load_share": 0.10294117647058823 + }, + "full_input": { + "tokens": 59, + "top_k": 6, + "decisions": 354, + "ordered_route_sha256": "b707bc759a0c8da7d8c5c242966302a1a6f3728d48ea2b3bde5e78fc6f01d1d3", + "route_weight_sha256": "8bf61d49c8fb5a886761d8d922459a112d00acc88f01b7893a663f472847e2aa", + "loads": [ + 2, + 0, + 4, + 7, + 3, + 7, + 21, + 6, + 10, + 0, + 2, + 3, + 5, + 2, + 1, + 2, + 2, + 1, + 4, + 3, + 4, + 6, + 7, + 14, + 0, + 6, + 1, + 15, + 17, + 10, + 3, + 6, + 2, + 4, + 0, + 14, + 0, + 11, + 15, + 3, + 2, + 5, + 8, + 3, + 3, + 2, + 4, + 6, + 6, + 4, + 3, + 16, + 6, + 2, + 9, + 0, + 10, + 7, + 4, + 3, + 0, + 9, + 12, + 7 + ], + "weighted_loads": [ + 0.07638277485966682, + 0.0, + 0.1807863786816597, + 0.20721605140715837, + 0.8001155890524387, + 0.39497774466872215, + 1.2396135702729225, + 0.42769602313637733, + 0.6940289046615362, + 0.0, + 0.12290968000888824, + 0.1565641686320305, + 0.22926755249500275, + 0.08172092959284782, + 0.029023008421063423, + 0.07792238518595695, + 0.12961259484291077, + 0.04173813760280609, + 0.22446831315755844, + 0.10142317041754723, + 0.22830489464104176, + 0.31241237185895443, + 0.5371148772537708, + 0.929828118532896, + 0.0, + 0.3225790672004223, + 0.03282621502876282, + 1.1199856474995613, + 2.1066420264542103, + 1.435038324445486, + 0.11451893486082554, + 0.292068786919117, + 0.08355630934238434, + 0.19152794405817986, + 0.0, + 0.8328514993190765, + 0.0, + 0.4326176354661584, + 1.1533095613121986, + 0.1807735189795494, + 0.07650590315461159, + 0.4911040738224983, + 0.5023830197751522, + 0.19042550772428513, + 0.13937396928668022, + 0.08970878645777702, + 0.27894265204668045, + 0.26108499988913536, + 0.2519086115062237, + 0.17326722852885723, + 0.11805243324488401, + 1.8167312256991863, + 0.35237951949238777, + 0.05761282704770565, + 0.40186621248722076, + 0.0, + 0.7852853313088417, + 0.382290318608284, + 0.1796753704547882, + 0.1327212369069457, + 0.0, + 0.4516672920435667, + 0.4539794847369194, + 0.3232290931046009 + ], + "unique_experts": 57, + "load_cv": 0.8575482125034434, + "normalized_load_entropy": 0.9130721602669525, + "max_load_share": 0.059322033898305086 + } + }, + "s1_x": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "5e742198894849597dbe7ffff884f795c18248c0cf056b47a806501d1e329149", + "route_weight_sha256": "a43a01a713194389f724370e9cde5ff3a5dbc0125235d31ae4aafdb000f739f6", + "loads": [ + 2, + 0, + 4, + 1, + 2, + 6, + 22, + 5, + 4, + 0, + 2, + 3, + 0, + 2, + 0, + 2, + 1, + 3, + 4, + 4, + 4, + 5, + 5, + 7, + 0, + 6, + 0, + 8, + 0, + 0, + 0, + 0, + 1, + 2, + 0, + 7, + 0, + 6, + 0, + 3, + 1, + 1, + 3, + 1, + 1, + 0, + 3, + 1, + 2, + 4, + 2, + 15, + 6, + 1, + 10, + 0, + 7, + 6, + 4, + 1, + 0, + 3, + 7, + 4 + ], + "weighted_loads": [ + 0.07357262820005417, + 0.0, + 0.17073163017630577, + 0.032165855169296265, + 0.19984230026602745, + 0.35707737877964973, + 1.269105538725853, + 0.35120000690221786, + 0.1665368787944317, + 0.0, + 0.12150326743721962, + 0.15497763827443123, + 0.0, + 0.08432716503739357, + 0.0, + 0.0832090824842453, + 0.04641525447368622, + 0.09288381040096283, + 0.2200176641345024, + 0.12843903340399265, + 0.23327180743217468, + 0.2636427506804466, + 0.39309532567858696, + 0.3033516611903906, + 0.0, + 0.3238385245203972, + 0.0, + 0.6999948881566525, + 0.0, + 0.0, + 0.0, + 0.0, + 0.036027297377586365, + 0.09892996028065681, + 0.0, + 0.3061249777674675, + 0.0, + 0.2934918627142906, + 0.0, + 0.16983891278505325, + 0.041011955589056015, + 0.04881509765982628, + 0.168355293571949, + 0.0686558336019516, + 0.051855139434337616, + 0.0, + 0.24859569221735, + 0.03150855004787445, + 0.06783352047204971, + 0.1763260681182146, + 0.1072424091398716, + 1.7159207686781883, + 0.35649656504392624, + 0.0291826780885458, + 0.4394114576280117, + 0.0, + 0.5368501655757427, + 0.30360472574830055, + 0.14598435908555984, + 0.02920466847717762, + 0.0, + 0.13846534118056297, + 0.27406461723148823, + 0.2114858441054821 + ], + "unique_experts": 48, + "load_cv": 1.1749990797316576, + "normalized_load_entropy": 0.8592578227072094, + "max_load_share": 0.10784313725490197 + }, + "full_input": { + "tokens": 75, + "top_k": 6, + "decisions": 450, + "ordered_route_sha256": "cefaf6b462dda14ede84ae9969eb86e7aa39835d73320b33015e7c583c08fed3", + "route_weight_sha256": "ce7aed54ff64338d27b811e820642e518e6df9e030d4e85cb6f23dd6697a1b6a", + "loads": [ + 6, + 0, + 4, + 3, + 5, + 6, + 22, + 11, + 12, + 3, + 3, + 3, + 3, + 2, + 0, + 2, + 4, + 5, + 5, + 4, + 4, + 9, + 8, + 14, + 0, + 7, + 3, + 16, + 19, + 15, + 12, + 5, + 5, + 7, + 5, + 15, + 0, + 9, + 17, + 3, + 1, + 11, + 10, + 5, + 14, + 5, + 6, + 7, + 9, + 4, + 4, + 15, + 6, + 4, + 10, + 1, + 9, + 12, + 5, + 5, + 2, + 13, + 12, + 4 + ], + "weighted_loads": [ + 0.26545676216483116, + 0.0, + 0.17073163017630577, + 0.0911429738625884, + 0.8713078610599041, + 0.35707737877964973, + 1.269105538725853, + 0.677004236727953, + 0.8153611533343792, + 0.3195958808064461, + 0.16498496755957603, + 0.15497763827443123, + 0.13547464087605476, + 0.08432716503739357, + 0.0, + 0.0832090824842453, + 0.2569473311305046, + 0.20792416483163834, + 0.2558022104203701, + 0.12843903340399265, + 0.23327180743217468, + 0.4372635446488857, + 0.5760143175721169, + 0.900311129167676, + 0.0, + 0.3705626018345356, + 0.1229870580136776, + 1.15226274356246, + 2.496978674083948, + 2.0759545788168907, + 0.9053851794451475, + 0.25465659238398075, + 0.21384329348802567, + 0.3827659413218498, + 0.24958111345767975, + 0.9679046086966991, + 0.0, + 0.4313082741573453, + 1.3635345660150051, + 0.16983891278505325, + 0.041011955589056015, + 0.9601623900234699, + 0.6124474741518497, + 0.3013148568570614, + 1.2505298890173435, + 0.35135192424058914, + 0.3856252431869507, + 0.3180739227682352, + 0.3918259385973215, + 0.1763260681182146, + 0.1729051461443305, + 1.7159207686781883, + 0.35649656504392624, + 0.18746639229357243, + 0.4394114576280117, + 0.03151680529117584, + 0.7025672644376755, + 0.589943777769804, + 0.21863820403814316, + 0.19673667196184397, + 0.07218622043728828, + 0.6577802002429962, + 0.4921423215419054, + 0.2114858441054821 + ], + "unique_experts": 60, + "load_cv": 0.714201617624382, + "normalized_load_entropy": 0.9371329963669613, + "max_load_share": 0.04888888888888889 + } + }, + "s0_period": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "95f32ba0b2c920b9b82d31042d739275187d0f042dd105a04ed85b6930733631", + "route_weight_sha256": "1e2c51ece267b56d5442e6ef63b9aed34246254c1576502cde61c091f2a0152c", + "loads": [ + 2, + 0, + 4, + 2, + 2, + 7, + 21, + 5, + 3, + 0, + 2, + 3, + 0, + 2, + 1, + 2, + 1, + 1, + 4, + 4, + 3, + 5, + 5, + 7, + 0, + 6, + 0, + 8, + 0, + 0, + 0, + 0, + 1, + 2, + 0, + 6, + 0, + 6, + 1, + 3, + 2, + 1, + 2, + 1, + 1, + 0, + 3, + 2, + 1, + 3, + 3, + 16, + 6, + 2, + 8, + 0, + 8, + 6, + 4, + 0, + 0, + 3, + 8, + 5 + ], + "weighted_loads": [ + 0.07532186433672905, + 0.0, + 0.1791301891207695, + 0.055773500353097916, + 0.18857630714774132, + 0.39723968878388405, + 1.2446103319525719, + 0.34301604703068733, + 0.12951640039682388, + 0.0, + 0.12346114590764046, + 0.1587580069899559, + 0.0, + 0.07825495675206184, + 0.027384156361222267, + 0.08149555698037148, + 0.04940176382660866, + 0.040825363248586655, + 0.2226424627006054, + 0.1334456019103527, + 0.1908269915729761, + 0.27431671507656574, + 0.3853522129356861, + 0.2893096785992384, + 0.0, + 0.32473137229681015, + 0.0, + 0.6985144875943661, + 0.0, + 0.0, + 0.0, + 0.0, + 0.037424009293317795, + 0.09847442060709, + 0.0, + 0.2694548889994621, + 0.0, + 0.2853723354637623, + 0.03834028169512749, + 0.18311132490634918, + 0.07493793219327927, + 0.04064905270934105, + 0.11932527273893356, + 0.085700623691082, + 0.05292575806379318, + 0.0, + 0.2400999590754509, + 0.06149577349424362, + 0.03397057205438614, + 0.14735014736652374, + 0.13759596645832062, + 1.818116657435894, + 0.349095243960619, + 0.05666220560669899, + 0.3648111913353205, + 0.0, + 0.5662752967327833, + 0.31511930376291275, + 0.14184700138866901, + 0.0, + 0.0, + 0.1374104619026184, + 0.31570394337177277, + 0.25203682482242584 + ], + "unique_experts": 49, + "load_cv": 1.1565303610242061, + "normalized_load_entropy": 0.8640576781358946, + "max_load_share": 0.10294117647058823 + }, + "full_input": { + "tokens": 59, + "top_k": 6, + "decisions": 354, + "ordered_route_sha256": "d2e7a20c58199aa59a9afd292b4aa38f4c126421c237bf80f8fbb1ea5a25453b", + "route_weight_sha256": "1a0e19fb28bf724bc3e3ab7999ced5b535b3c1bf30b896445d2a9fe564fcf517", + "loads": [ + 2, + 0, + 4, + 7, + 3, + 7, + 21, + 7, + 9, + 0, + 2, + 3, + 5, + 2, + 1, + 2, + 4, + 1, + 4, + 4, + 3, + 6, + 7, + 15, + 0, + 6, + 1, + 15, + 16, + 9, + 2, + 6, + 2, + 4, + 0, + 14, + 0, + 10, + 15, + 3, + 2, + 6, + 7, + 3, + 3, + 1, + 4, + 7, + 3, + 3, + 4, + 16, + 6, + 2, + 8, + 0, + 11, + 8, + 5, + 3, + 0, + 9, + 13, + 8 + ], + "weighted_loads": [ + 0.07532186433672905, + 0.0, + 0.1791301891207695, + 0.20694327633827925, + 0.7909212969243526, + 0.39723968878388405, + 1.2446103319525719, + 0.46799109876155853, + 0.6600483618676662, + 0.0, + 0.12346114590764046, + 0.1587580069899559, + 0.23332198709249496, + 0.07825495675206184, + 0.027384156361222267, + 0.08149555698037148, + 0.2224971354007721, + 0.040825363248586655, + 0.2226424627006054, + 0.1334456019103527, + 0.1908269915729761, + 0.31811042688786983, + 0.5257880836725235, + 0.8739035148173571, + 0.0, + 0.32473137229681015, + 0.03282621502876282, + 1.1003097631037235, + 2.13212351500988, + 1.3883916325867176, + 0.062333038076758385, + 0.2915193736553192, + 0.08377442508935928, + 0.18835872039198875, + 0.0, + 0.8100447282195091, + 0.0, + 0.3981960332021117, + 1.1733042374253273, + 0.18311132490634918, + 0.07493793219327927, + 0.5776060111820698, + 0.4623578414320946, + 0.2080901525914669, + 0.1426556631922722, + 0.03724302724003792, + 0.2778560146689415, + 0.29511683806777, + 0.15061887353658676, + 0.14735014736652374, + 0.1505335634574294, + 1.818116657435894, + 0.349095243960619, + 0.05666220560669899, + 0.3648111913353205, + 0.0, + 0.8034922238439322, + 0.42969557642936707, + 0.2046446744352579, + 0.1345242252573371, + 0.0, + 0.43338694982230663, + 0.5116526950150728, + 0.34761280566453934 + ], + "unique_experts": 57, + "load_cv": 0.8587384773487052, + "normalized_load_entropy": 0.9123083252329465, + "max_load_share": 0.059322033898305086 + } + }, + "s1_period": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "f7ba27b92bef4488ca58571c5d27af631e03ba4bac44aa176f8b3ac2abb185a9", + "route_weight_sha256": "7feac68b0a4c7bf9899f9e1501bdc98a724c9e1e4f6fc150783c8cbab2f3c3fb", + "loads": [ + 2, + 0, + 4, + 1, + 2, + 7, + 22, + 5, + 4, + 0, + 2, + 3, + 0, + 2, + 0, + 2, + 1, + 3, + 4, + 6, + 4, + 5, + 5, + 6, + 0, + 6, + 0, + 8, + 0, + 0, + 0, + 0, + 1, + 2, + 0, + 6, + 0, + 6, + 1, + 3, + 2, + 1, + 2, + 1, + 1, + 0, + 3, + 1, + 1, + 4, + 2, + 15, + 6, + 1, + 10, + 0, + 7, + 6, + 4, + 0, + 0, + 2, + 8, + 4 + ], + "weighted_loads": [ + 0.06972064450383186, + 0.0, + 0.17171776667237282, + 0.03213181346654892, + 0.19198179617524147, + 0.38668711483478546, + 1.2649716287851334, + 0.3562828302383423, + 0.1671077013015747, + 0.0, + 0.12087085843086243, + 0.15745165199041367, + 0.0, + 0.09035447984933853, + 0.0, + 0.0838712640106678, + 0.045744895935058594, + 0.09138204343616962, + 0.2200302854180336, + 0.1927697528153658, + 0.2237690482288599, + 0.2726048771291971, + 0.39645033329725266, + 0.27826155349612236, + 0.0, + 0.32410433515906334, + 0.0, + 0.7092199996113777, + 0.0, + 0.0, + 0.0, + 0.0, + 0.037455614656209946, + 0.09680721908807755, + 0.0, + 0.27323946729302406, + 0.0, + 0.29194630309939384, + 0.0375344417989254, + 0.17093751206994057, + 0.07089370489120483, + 0.04831849783658981, + 0.1295153871178627, + 0.07684137672185898, + 0.054249584674835205, + 0.0, + 0.248379684984684, + 0.03193213790655136, + 0.03197217360138893, + 0.17571023106575012, + 0.10702928528189659, + 1.7462796904146671, + 0.35960037633776665, + 0.02898212894797325, + 0.44147774018347263, + 0.0, + 0.5370344333350658, + 0.3098275177180767, + 0.14623625576496124, + 0.0, + 0.0, + 0.10446473956108093, + 0.29508791491389275, + 0.21261021867394447 + ], + "unique_experts": 48, + "load_cv": 1.182825971125935, + "normalized_load_entropy": 0.8574548765507386, + "max_load_share": 0.10784313725490197 + }, + "full_input": { + "tokens": 75, + "top_k": 6, + "decisions": 450, + "ordered_route_sha256": "635cffff694a96db132086b6626702104b9fa6317b7d81866b310d8fbae8c341", + "route_weight_sha256": "027897c92777db92c944efd5c5fb6bf3054742b43c0183e4c37665ec1b4eb6d1", + "loads": [ + 6, + 0, + 4, + 3, + 5, + 7, + 22, + 12, + 12, + 3, + 3, + 3, + 3, + 2, + 0, + 2, + 4, + 5, + 5, + 6, + 4, + 8, + 8, + 13, + 0, + 7, + 3, + 16, + 19, + 14, + 11, + 5, + 5, + 7, + 5, + 14, + 0, + 9, + 19, + 3, + 2, + 12, + 10, + 4, + 14, + 4, + 7, + 7, + 7, + 4, + 4, + 15, + 6, + 4, + 10, + 1, + 9, + 12, + 5, + 4, + 2, + 12, + 14, + 4 + ], + "weighted_loads": [ + 0.26160477846860886, + 0.0, + 0.17171776667237282, + 0.09110893215984106, + 0.8634473569691181, + 0.38668711483478546, + 1.2649716287851334, + 0.7294773124158382, + 0.8204874731600285, + 0.3195958808064461, + 0.16435255855321884, + 0.15745165199041367, + 0.12377281486988068, + 0.09035447984933853, + 0.0, + 0.0838712640106678, + 0.26611609011888504, + 0.20642239786684513, + 0.2558148317039013, + 0.1927697528153658, + 0.2237690482288599, + 0.4140216391533613, + 0.578534934669733, + 0.7969138249754906, + 0.0, + 0.3707527443766594, + 0.1229870580136776, + 1.1139505077153444, + 2.53334653750062, + 2.0159446075558662, + 0.8592300768941641, + 0.2564253266900778, + 0.21527161076664925, + 0.3834414593875408, + 0.24958111345767975, + 0.8936146162450314, + 0.0, + 0.4297627145424485, + 1.4305299520492554, + 0.17093751206994057, + 0.07089370489120483, + 1.0673472359776497, + 0.6279449313879013, + 0.24535708129405975, + 1.2583475857973099, + 0.30943066999316216, + 0.4301988147199154, + 0.32191131077706814, + 0.3191667776554823, + 0.17571023106575012, + 0.1726920222863555, + 1.7462796904146671, + 0.35960037633776665, + 0.18726584315299988, + 0.44147774018347263, + 0.03151680529117584, + 0.6937661617994308, + 0.588826559484005, + 0.22086649388074875, + 0.17615150567144156, + 0.07218622043728828, + 0.6274540908634663, + 0.5512374527752399, + 0.21261021867394447 + ], + "unique_experts": 60, + "load_cv": 0.7164108070405167, + "normalized_load_entropy": 0.9374493358051895, + "max_load_share": 0.04888888888888889 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 34, + "ordered_topk_exact_tokens": 30, + "set_exact_tokens": 31, + "mean_set_jaccard": 0.9684873949579833, + "mean_token_weighted_tv": 0.009313957464388189, + "aggregate_load_tv": 0.019607843137254905 + }, + "system_bos": { + "tokens": 34, + "ordered_topk_exact_tokens": 18, + "set_exact_tokens": 24, + "mean_set_jaccard": 0.9159663865546218, + "mean_token_weighted_tv": 0.016425033291692242, + "aggregate_load_tv": 0.04411764705882354 + }, + "system_x": { + "tokens": 34, + "ordered_topk_exact_tokens": 19, + "set_exact_tokens": 25, + "mean_set_jaccard": 0.9180672268907564, + "mean_token_weighted_tv": 0.01669055689126253, + "aggregate_load_tv": 0.04901960784313726 + }, + "system_period": { + "tokens": 34, + "ordered_topk_exact_tokens": 17, + "set_exact_tokens": 24, + "mean_set_jaccard": 0.9159663865546219, + "mean_token_weighted_tv": 0.01701733289176927, + "aggregate_load_tv": 0.04901960784313726 + }, + "bos_at_s0": { + "tokens": 34, + "ordered_topk_exact_tokens": 18, + "set_exact_tokens": 20, + "mean_set_jaccard": 0.8634453781512605, + "mean_token_weighted_tv": 0.024994165883125627, + "aggregate_load_tv": 0.06372549019607843 + }, + "bos_at_s1": { + "tokens": 34, + "ordered_topk_exact_tokens": 20, + "set_exact_tokens": 23, + "mean_set_jaccard": 0.9012605042016807, + "mean_token_weighted_tv": 0.01840942059917485, + "aggregate_load_tv": 0.04901960784313726 + }, + "x_at_s0": { + "tokens": 34, + "ordered_topk_exact_tokens": 16, + "set_exact_tokens": 20, + "mean_set_jaccard": 0.8823529411764706, + "mean_token_weighted_tv": 0.022845049690016928, + "aggregate_load_tv": 0.058823529411764705 + }, + "x_at_s1": { + "tokens": 34, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.8424369747899161, + "mean_token_weighted_tv": 0.02915950075668447, + "aggregate_load_tv": 0.0784313725490196 + }, + "period_at_s0": { + "tokens": 34, + "ordered_topk_exact_tokens": 19, + "set_exact_tokens": 20, + "mean_set_jaccard": 0.8760504201680673, + "mean_token_weighted_tv": 0.0239022463450537, + "aggregate_load_tv": 0.05882352941176471 + }, + "period_at_s1": { + "tokens": 34, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.8676470588235294, + "mean_token_weighted_tv": 0.025771810152732274, + "aggregate_load_tv": 0.06862745098039216 + } + } + }, + "layer_13": { + "layer": 13, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "d4b337f18b416ea392a31d0a846946ae7836bda7fc326ba4e44d9a375f6cece1", + "route_weight_sha256": "92d7a8d3b6cb8a52a60bca5d0572dfe79bbc78e3be721ace8b6fea7fdfa3824c", + "loads": [ + 11, + 3, + 1, + 0, + 14, + 1, + 3, + 4, + 2, + 1, + 7, + 0, + 6, + 6, + 4, + 6, + 0, + 1, + 2, + 0, + 0, + 5, + 3, + 1, + 2, + 5, + 1, + 5, + 8, + 0, + 2, + 3, + 0, + 2, + 1, + 4, + 1, + 0, + 0, + 23, + 7, + 0, + 3, + 1, + 0, + 2, + 2, + 10, + 5, + 0, + 0, + 0, + 2, + 0, + 3, + 1, + 2, + 0, + 2, + 3, + 4, + 5, + 6, + 8 + ], + "weighted_loads": [ + 1.0899937935173512, + 0.20495611801743507, + 0.03297365456819534, + 0.0, + 0.5318904146552086, + 0.043058741837739944, + 0.13768992573022842, + 0.18780413456261158, + 0.09192637354135513, + 0.03261834755539894, + 0.3374269213527441, + 0.0, + 0.42525165528059006, + 0.22724827006459236, + 0.14926506578922272, + 0.5742147825658321, + 0.0, + 0.03515656292438507, + 0.10024663060903549, + 0.0, + 0.0, + 0.2588399276137352, + 0.15873968973755836, + 0.03142133355140686, + 0.08194979280233383, + 0.3412661477923393, + 0.03249445930123329, + 0.19253693707287312, + 0.30954865366220474, + 0.0, + 0.0855034701526165, + 0.24023949727416039, + 0.0, + 0.06562603078782558, + 0.09841180592775345, + 0.22805235907435417, + 0.03831924870610237, + 0.0, + 0.0, + 1.287956215441227, + 0.576723113656044, + 0.0, + 0.10101203620433807, + 0.03196015581488609, + 0.0, + 0.09730083495378494, + 0.07993807643651962, + 0.31537301652133465, + 0.26674804277718067, + 0.0, + 0.0, + 0.0, + 0.08266144245862961, + 0.0, + 0.11829697526991367, + 0.030095309019088745, + 0.07143152877688408, + 0.0, + 0.08383455127477646, + 0.11227444931864738, + 0.2403646931052208, + 0.25778354331851006, + 0.3630782179534435, + 0.413858313113451 + ], + "unique_experts": 48, + "load_cv": 1.2199482533570416, + "normalized_load_entropy": 0.8528450680528931, + "max_load_share": 0.11274509803921569 + }, + "full_input": { + "tokens": 59, + "top_k": 6, + "decisions": 354, + "ordered_route_sha256": "e83852f99d11c168b2b302a372a4d7a0df7a71e5640839788282d699c77f5394", + "route_weight_sha256": "74263169b2aa55bdd9f39714b75d0603c0965c332b40eccb62316a7180db2ba5", + "loads": [ + 11, + 8, + 1, + 0, + 14, + 1, + 17, + 4, + 2, + 3, + 18, + 6, + 6, + 6, + 5, + 13, + 0, + 3, + 3, + 1, + 0, + 7, + 3, + 1, + 6, + 5, + 4, + 5, + 8, + 12, + 2, + 3, + 0, + 8, + 2, + 5, + 5, + 1, + 0, + 24, + 8, + 2, + 6, + 3, + 11, + 12, + 4, + 12, + 6, + 0, + 1, + 0, + 7, + 3, + 6, + 1, + 5, + 0, + 9, + 8, + 4, + 7, + 6, + 10 + ], + "weighted_loads": [ + 1.0899937935173512, + 0.5300575420260429, + 0.03297365456819534, + 0.0, + 0.5318904146552086, + 0.043058741837739944, + 1.362390175461769, + 0.18780413456261158, + 0.09192637354135513, + 0.10875836946070194, + 1.0389058366417885, + 0.31365148443728685, + 0.42525165528059006, + 0.22724827006459236, + 0.19460705667734146, + 0.9985299371182919, + 0.0, + 0.08314647153019905, + 0.14156418293714523, + 0.04128880426287651, + 0.0, + 0.35161855071783066, + 0.15873968973755836, + 0.03142133355140686, + 0.1941215805709362, + 0.3412661477923393, + 0.15725521370768547, + 0.19253693707287312, + 0.30954865366220474, + 0.9166010729968548, + 0.0855034701526165, + 0.24023949727416039, + 0.0, + 0.7350874897092581, + 0.12125438638031483, + 0.26522570103406906, + 0.3548040892928839, + 0.03378814458847046, + 0.0, + 1.322987426072359, + 0.6937596499919891, + 0.08123406395316124, + 0.23779741674661636, + 0.1270499788224697, + 0.6875684037804604, + 1.0533349849283695, + 0.1448769010603428, + 1.5074935983866453, + 0.2988158967345953, + 0.0, + 0.03700879588723183, + 0.0, + 0.25978613644838333, + 0.13706761598587036, + 0.2664166186004877, + 0.030095309019088745, + 0.23758800700306892, + 0.0, + 0.4381508268415928, + 0.35060882568359375, + 0.2403646931052208, + 0.34923449344933033, + 0.3630782179534435, + 0.5201650448143482 + ], + "unique_experts": 56, + "load_cv": 0.8769810294440012, + "normalized_load_entropy": 0.9080271190126123, + "max_load_share": 0.06779661016949153 + } + }, + "s1_eos": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "cbbfa524c1d99a61c8602d1e74bc02186f994ff4db8b9c74df3078915d7c7a01", + "route_weight_sha256": "1b9d8b31aabfac41af4e6c8876c9a63837b155ebc9481e9a6740f4eadaf625dd", + "loads": [ + 11, + 5, + 1, + 0, + 16, + 1, + 3, + 3, + 2, + 1, + 5, + 0, + 6, + 8, + 3, + 6, + 0, + 1, + 2, + 0, + 0, + 5, + 3, + 1, + 2, + 6, + 1, + 5, + 9, + 0, + 2, + 3, + 0, + 2, + 1, + 4, + 1, + 0, + 0, + 22, + 7, + 0, + 3, + 0, + 0, + 2, + 2, + 8, + 5, + 0, + 0, + 0, + 2, + 0, + 3, + 1, + 1, + 0, + 2, + 3, + 4, + 5, + 7, + 8 + ], + "weighted_loads": [ + 1.0827582404017448, + 0.2678195796906948, + 0.03410385921597481, + 0.0, + 0.5847259256988764, + 0.04283976927399635, + 0.14683938398957253, + 0.16211912035942078, + 0.09153382480144501, + 0.031557846814394, + 0.2771124318242073, + 0.0, + 0.42526453733444214, + 0.28608393855392933, + 0.11294608376920223, + 0.5749960467219353, + 0.0, + 0.033601682633161545, + 0.10452784597873688, + 0.0, + 0.0, + 0.25756245851516724, + 0.15801150724291801, + 0.03184868022799492, + 0.08177247643470764, + 0.38228343427181244, + 0.03328321501612663, + 0.19713927060365677, + 0.3393503837287426, + 0.0, + 0.0832144245505333, + 0.24020693078637123, + 0.0, + 0.06859613209962845, + 0.10025585442781448, + 0.22969892621040344, + 0.03594287484884262, + 0.0, + 0.0, + 1.2601416930556297, + 0.5829741656780243, + 0.0, + 0.09654761478304863, + 0.0, + 0.0, + 0.09321293234825134, + 0.08271393552422523, + 0.2610783986747265, + 0.25707555562257767, + 0.0, + 0.0, + 0.0, + 0.08346834406256676, + 0.0, + 0.11359887756407261, + 0.030673397704958916, + 0.034520383924245834, + 0.0, + 0.08397497981786728, + 0.1114463061094284, + 0.2357221245765686, + 0.25392715260386467, + 0.3952508680522442, + 0.4134320542216301 + ], + "unique_experts": 47, + "load_cv": 1.233736958175637, + "normalized_load_entropy": 0.8471854285526615, + "max_load_share": 0.10784313725490197 + }, + "full_input": { + "tokens": 75, + "top_k": 6, + "decisions": 450, + "ordered_route_sha256": "e3047327dd6890a062e44429f74ad7d79bd1549128a7d1f1fcd4c7550bc72a04", + "route_weight_sha256": "40f6e71309fc3a8bbc8bea810ee333a5200963d1801a6670c16190361c2d6bee", + "loads": [ + 16, + 9, + 1, + 0, + 16, + 3, + 30, + 3, + 2, + 3, + 16, + 13, + 6, + 8, + 4, + 14, + 0, + 3, + 4, + 3, + 0, + 11, + 3, + 4, + 6, + 6, + 5, + 5, + 9, + 19, + 9, + 4, + 0, + 13, + 4, + 6, + 6, + 1, + 1, + 23, + 10, + 4, + 11, + 1, + 15, + 13, + 5, + 11, + 7, + 4, + 1, + 0, + 4, + 2, + 6, + 3, + 4, + 11, + 11, + 8, + 5, + 8, + 7, + 10 + ], + "weighted_loads": [ + 1.2847579903900623, + 0.5724417977035046, + 0.03410385921597481, + 0.0, + 0.5847259256988764, + 0.11051683500409126, + 2.3270501624792814, + 0.16211912035942078, + 0.09153382480144501, + 0.12127328105270863, + 0.9722790755331516, + 0.8653950481675565, + 0.42526453733444214, + 0.28608393855392933, + 0.1562099363654852, + 1.0617973357439041, + 0.0, + 0.086198590695858, + 0.17063224129378796, + 0.1226910687983036, + 0.0, + 0.5502546578645706, + 0.15801150724291801, + 0.15275803580880165, + 0.21253960020840168, + 0.38228343427181244, + 0.1942107379436493, + 0.19713927060365677, + 0.3393503837287426, + 1.6668646149337292, + 0.47468726336956024, + 0.2798079252243042, + 0.0, + 1.2371034882962704, + 0.32592192478477955, + 0.32020336762070656, + 0.4518368821591139, + 0.03334196284413338, + 0.04256937652826309, + 1.302534706890583, + 0.7838430665433407, + 0.1664704717695713, + 0.7564174048602581, + 0.07540357112884521, + 1.1096187829971313, + 1.0563036873936653, + 0.19058522209525108, + 1.4922041408717632, + 0.509748563170433, + 0.20218246430158615, + 0.03642287850379944, + 0.0, + 0.15822306275367737, + 0.08212430402636528, + 0.24304549396038055, + 0.10282676480710506, + 0.1938255988061428, + 0.7056881338357925, + 0.5191812124103308, + 0.3514714166522026, + 0.2646061200648546, + 0.3974280674010515, + 0.3952508680522442, + 0.5323748402297497 + ], + "unique_experts": 59, + "load_cv": 0.833081443412362, + "normalized_load_entropy": 0.9198663423240128, + "max_load_share": 0.06666666666666667 + } + }, + "s0_bos": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "dc4607b5f039a77adfa070278ff29beff3f5d2ced8f1cfe8d80f5d0129d0e7cd", + "route_weight_sha256": "be7b28d5b55b844334e56ceb2543bcfe95c143855ad0c125f2bddbd48eaa2095", + "loads": [ + 11, + 5, + 2, + 0, + 16, + 1, + 3, + 4, + 2, + 1, + 4, + 0, + 5, + 7, + 3, + 6, + 0, + 0, + 2, + 0, + 0, + 5, + 3, + 0, + 2, + 5, + 1, + 5, + 9, + 0, + 2, + 3, + 0, + 2, + 1, + 4, + 1, + 0, + 0, + 23, + 7, + 0, + 3, + 1, + 0, + 2, + 2, + 10, + 5, + 0, + 0, + 0, + 3, + 0, + 2, + 1, + 2, + 0, + 2, + 3, + 4, + 5, + 6, + 8 + ], + "weighted_loads": [ + 1.0822969824075699, + 0.26985783129930496, + 0.0736033134162426, + 0.0, + 0.6124964412301779, + 0.04324938729405403, + 0.14402025192975998, + 0.18082734942436218, + 0.09332671388983727, + 0.03229377418756485, + 0.23571686074137688, + 0.0, + 0.3903983999043703, + 0.26743127033114433, + 0.11160352639853954, + 0.5520251058042049, + 0.0, + 0.0, + 0.09633234515786171, + 0.0, + 0.0, + 0.2632742039859295, + 0.15560175105929375, + 0.0, + 0.08601006120443344, + 0.3384106121957302, + 0.03249979019165039, + 0.19329643622040749, + 0.3428365495055914, + 0.0, + 0.08447404205799103, + 0.23589282855391502, + 0.0, + 0.06493560411036015, + 0.09945061802864075, + 0.23609790578484535, + 0.03562159463763237, + 0.0, + 0.0, + 1.3129208087921143, + 0.5843146294355392, + 0.0, + 0.10069290734827518, + 0.037276193499565125, + 0.0, + 0.09069593250751495, + 0.07498422637581825, + 0.31550807878375053, + 0.25502826645970345, + 0.0, + 0.0, + 0.0, + 0.13812094554305077, + 0.0, + 0.09339560568332672, + 0.03260582685470581, + 0.07664519548416138, + 0.0, + 0.0810183584690094, + 0.10169651359319687, + 0.24012240022420883, + 0.2516767606139183, + 0.3620355874300003, + 0.4187917225062847 + ], + "unique_experts": 46, + "load_cv": 1.2547487651589142, + "normalized_load_entropy": 0.8451440165460351, + "max_load_share": 0.11274509803921569 + }, + "full_input": { + "tokens": 59, + "top_k": 6, + "decisions": 354, + "ordered_route_sha256": "030e1ffa4294f1592f877629a591aca812a5e6563344124a2d5899d4e07670d7", + "route_weight_sha256": "26227f5bf106fc6972e757b9eb50e54b25b4cd5f8441334c5b480bbf779c2917", + "loads": [ + 11, + 10, + 3, + 0, + 17, + 1, + 17, + 4, + 2, + 5, + 14, + 4, + 5, + 7, + 3, + 13, + 0, + 1, + 3, + 1, + 0, + 8, + 3, + 0, + 5, + 5, + 4, + 5, + 9, + 13, + 2, + 3, + 0, + 7, + 2, + 5, + 4, + 1, + 0, + 24, + 8, + 2, + 7, + 3, + 11, + 12, + 4, + 11, + 6, + 0, + 1, + 0, + 8, + 4, + 5, + 1, + 6, + 0, + 9, + 8, + 4, + 7, + 6, + 10 + ], + "weighted_loads": [ + 1.0822969824075699, + 0.6257067285478115, + 0.14200366660952568, + 0.0, + 0.6603878047317266, + 0.04324938729405403, + 1.4200672172009945, + 0.18082734942436218, + 0.09332671388983727, + 0.21173718012869358, + 0.8292474430054426, + 0.27995575219392776, + 0.3903983999043703, + 0.26743127033114433, + 0.11160352639853954, + 0.9763009808957577, + 0.0, + 0.03497763350605965, + 0.13764989748597145, + 0.04128880426287651, + 0.0, + 0.39713672921061516, + 0.15560175105929375, + 0.0, + 0.18980775959789753, + 0.3384106121957302, + 0.15726054459810257, + 0.19329643622040749, + 0.3428365495055914, + 0.9580640867352486, + 0.08447404205799103, + 0.23589282855391502, + 0.0, + 0.6650335174053907, + 0.12229319848120213, + 0.2753526568412781, + 0.3427157048135996, + 0.03378814458847046, + 0.0, + 1.3479520194232464, + 0.7007758021354675, + 0.08335942029953003, + 0.3011599574238062, + 0.1438302993774414, + 0.7010585777461529, + 1.0467300824820995, + 0.13992305099964142, + 0.676401000469923, + 0.2870961204171181, + 0.0, + 0.03700879588723183, + 0.0, + 0.3152456395328045, + 0.2025861218571663, + 0.2381657287478447, + 0.03260582685470581, + 0.3592793941497803, + 0.0, + 0.43416881188750267, + 0.34003088995814323, + 0.24012240022420883, + 0.33979334123432636, + 0.3620355874300003, + 0.5198656879365444 + ], + "unique_experts": 55, + "load_cv": 0.8816275113957976, + "normalized_load_entropy": 0.9055532250551135, + "max_load_share": 0.06779661016949153 + } + }, + "s1_bos": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "18e9fb42461048a058d1c8e0321e4d9fc1f8c24d37febcfdb31c81c8ccdb51a3", + "route_weight_sha256": "e80dfda316ae9890e5e79821a478f93206732fc7f4ef9eb4cd7c2b7f89cf12af", + "loads": [ + 11, + 5, + 2, + 0, + 17, + 1, + 3, + 4, + 2, + 0, + 3, + 0, + 5, + 7, + 3, + 6, + 0, + 0, + 2, + 0, + 0, + 5, + 3, + 1, + 2, + 6, + 1, + 5, + 9, + 0, + 2, + 3, + 0, + 2, + 1, + 4, + 1, + 0, + 0, + 23, + 7, + 0, + 2, + 1, + 0, + 2, + 2, + 9, + 5, + 0, + 0, + 0, + 3, + 0, + 3, + 1, + 2, + 0, + 2, + 2, + 4, + 5, + 7, + 8 + ], + "weighted_loads": [ + 1.0835956186056137, + 0.2734121195971966, + 0.07589344307780266, + 0.0, + 0.62678162753582, + 0.04253392666578293, + 0.14679188653826714, + 0.18316075764596462, + 0.09487494826316833, + 0.0, + 0.20252950116991997, + 0.0, + 0.3931713104248047, + 0.2590409629046917, + 0.11102735064923763, + 0.5359512940049171, + 0.0, + 0.0, + 0.09856578707695007, + 0.0, + 0.0, + 0.26257986947894096, + 0.14925899729132652, + 0.03343157470226288, + 0.0849941074848175, + 0.36766764894127846, + 0.03231516852974892, + 0.20183876156806946, + 0.334744555875659, + 0.0, + 0.08239379152655602, + 0.23912928998470306, + 0.0, + 0.06127740815281868, + 0.09750840812921524, + 0.23306658491492271, + 0.039340272545814514, + 0.0, + 0.0, + 1.3229528553783894, + 0.5967141538858414, + 0.0, + 0.06696536764502525, + 0.031220395117998123, + 0.0, + 0.08936799690127373, + 0.07039342820644379, + 0.29074676148593426, + 0.2531711123883724, + 0.0, + 0.0, + 0.0, + 0.13361641392111778, + 0.0, + 0.11726227216422558, + 0.03392708674073219, + 0.07557190582156181, + 0.0, + 0.08358350396156311, + 0.07377614453434944, + 0.23742131516337395, + 0.2516879290342331, + 0.40001005679368973, + 0.40789569169282913 + ], + "unique_experts": 46, + "load_cv": 1.2705821834762678, + "normalized_load_entropy": 0.8428247711658641, + "max_load_share": 0.11274509803921569 + }, + "full_input": { + "tokens": 75, + "top_k": 6, + "decisions": 450, + "ordered_route_sha256": "d47d9c1abc817dc0d1a1d899784ecb2b66636f6c6a062a94410e26daae253d34", + "route_weight_sha256": "88abe04ec80ddb61418a035e3a2cf08d03b160b864a3131b6e7b38048f18c072", + "loads": [ + 16, + 11, + 3, + 0, + 17, + 3, + 29, + 4, + 2, + 3, + 15, + 11, + 5, + 7, + 3, + 14, + 0, + 1, + 4, + 3, + 0, + 10, + 3, + 4, + 6, + 6, + 5, + 5, + 9, + 19, + 9, + 4, + 0, + 13, + 4, + 6, + 7, + 1, + 1, + 24, + 10, + 4, + 10, + 2, + 15, + 13, + 5, + 11, + 7, + 4, + 1, + 0, + 5, + 2, + 6, + 3, + 6, + 11, + 11, + 7, + 5, + 8, + 7, + 10 + ], + "weighted_loads": [ + 1.2855953685939312, + 0.6955864429473877, + 0.12570065632462502, + 0.0, + 0.62678162753582, + 0.11021099239587784, + 2.3805851470679045, + 0.18316075764596462, + 0.09487494826316833, + 0.14168708585202694, + 0.9290476217865944, + 0.8211821615695953, + 0.3931713104248047, + 0.2590409629046917, + 0.11102735064923763, + 1.0252903252840042, + 0.0, + 0.038916394114494324, + 0.16467018239200115, + 0.1226910687983036, + 0.0, + 0.5269315466284752, + 0.14925899729132652, + 0.1543409302830696, + 0.273336635902524, + 0.36766764894127846, + 0.19324269145727158, + 0.20183876156806946, + 0.334744555875659, + 1.6890853382647038, + 0.47386663034558296, + 0.27873028442263603, + 0.0, + 1.2101047337055206, + 0.3231744784861803, + 0.3229796104133129, + 0.5330821592360735, + 0.03334196284413338, + 0.04256937652826309, + 1.3653458692133427, + 0.7965982742607594, + 0.1668466255068779, + 0.7465446330606937, + 0.10610024258494377, + 1.117847502231598, + 1.0524587519466877, + 0.17826471477746964, + 0.6911600064486265, + 0.5058441199362278, + 0.20218246430158615, + 0.03642287850379944, + 0.0, + 0.2083711326122284, + 0.08212430402636528, + 0.2432537041604519, + 0.10608045384287834, + 0.2743191756308079, + 0.7056881338357925, + 0.483593363314867, + 0.31380125507712364, + 0.26630531065165997, + 0.39454168267548084, + 0.40001005679368973, + 0.523557897657156 + ], + "unique_experts": 59, + "load_cv": 0.8223903731962856, + "normalized_load_entropy": 0.9220035226534525, + "max_load_share": 0.06444444444444444 + } + }, + "s0_x": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "95d63a620eb5482f1a86047e85fb09ed1652deea75c24a832f462c95173c8bf1", + "route_weight_sha256": "8bfbac577bb0b139e66c5a01e6d18e3ad774d7ae2fb342efdfd7fa059e41c0c1", + "loads": [ + 11, + 5, + 2, + 0, + 17, + 1, + 3, + 4, + 2, + 1, + 3, + 0, + 7, + 8, + 2, + 6, + 0, + 1, + 2, + 0, + 0, + 5, + 3, + 1, + 2, + 6, + 1, + 4, + 9, + 0, + 2, + 3, + 0, + 2, + 1, + 4, + 1, + 0, + 0, + 22, + 7, + 0, + 3, + 0, + 0, + 2, + 2, + 8, + 6, + 1, + 0, + 0, + 3, + 0, + 2, + 0, + 2, + 0, + 2, + 2, + 4, + 4, + 7, + 8 + ], + "weighted_loads": [ + 1.0719512328505516, + 0.2751198187470436, + 0.07338567078113556, + 0.0, + 0.6317162308841944, + 0.04372154921293259, + 0.13961665704846382, + 0.18302947282791138, + 0.08890023455023766, + 0.03164560720324516, + 0.20854352042078972, + 0.0, + 0.45556288957595825, + 0.287561671808362, + 0.08430694043636322, + 0.5586966685950756, + 0.0, + 0.03685382753610611, + 0.09818242490291595, + 0.0, + 0.0, + 0.2632012590765953, + 0.1504930779337883, + 0.03393084928393364, + 0.08391986414790154, + 0.3842761963605881, + 0.03156512603163719, + 0.16646362841129303, + 0.3309901747852564, + 0.0, + 0.0923774279654026, + 0.2380986325442791, + 0.0, + 0.06246574781835079, + 0.0976199060678482, + 0.24075759574770927, + 0.04158909618854523, + 0.0, + 0.0, + 1.2380726151168346, + 0.5943556390702724, + 0.0, + 0.10296347364783287, + 0.0, + 0.0, + 0.09154903516173363, + 0.07153232768177986, + 0.26349405758082867, + 0.29728441312909126, + 0.031033378094434738, + 0.0, + 0.0, + 0.126897931098938, + 0.0, + 0.08962460607290268, + 0.0, + 0.07815881818532944, + 0.0, + 0.08177974820137024, + 0.0823766216635704, + 0.239827748388052, + 0.21395187452435493, + 0.4011756591498852, + 0.40787845849990845 + ], + "unique_experts": 47, + "load_cv": 1.2498365906261402, + "normalized_load_entropy": 0.8462131933781641, + "max_load_share": 0.10784313725490197 + }, + "full_input": { + "tokens": 59, + "top_k": 6, + "decisions": 354, + "ordered_route_sha256": "7bc6b887e6ddc336afa5f24e81550964db7d3bb0672bdc4aa89e0aca115140d7", + "route_weight_sha256": "e6e52008f4022ef95e4badca773dffe1b6126aa5a02b5050963f1e5789360073", + "loads": [ + 11, + 9, + 2, + 0, + 17, + 1, + 19, + 4, + 2, + 3, + 14, + 5, + 7, + 8, + 2, + 14, + 0, + 2, + 3, + 1, + 0, + 8, + 3, + 1, + 7, + 6, + 4, + 4, + 9, + 12, + 2, + 3, + 0, + 8, + 2, + 4, + 4, + 1, + 0, + 23, + 8, + 2, + 6, + 1, + 13, + 13, + 5, + 9, + 7, + 1, + 1, + 0, + 8, + 3, + 5, + 0, + 5, + 0, + 8, + 7, + 4, + 6, + 7, + 10 + ], + "weighted_loads": [ + 1.0719512328505516, + 0.5459052361547947, + 0.07338567078113556, + 0.0, + 0.6317162308841944, + 0.04372154921293259, + 1.3932805825024843, + 0.18302947282791138, + 0.08890023455023766, + 0.10778562910854816, + 0.8078887406736612, + 0.3240271285176277, + 0.45556288957595825, + 0.287561671808362, + 0.08430694043636322, + 1.1977947168052197, + 0.0, + 0.07183146104216576, + 0.1394999772310257, + 0.04128880426287651, + 0.0, + 0.41135700792074203, + 0.1504930779337883, + 0.03393084928393364, + 0.2764441277831793, + 0.3842761963605881, + 0.15632588043808937, + 0.16646362841129303, + 0.3309901747852564, + 0.9424307867884636, + 0.0923774279654026, + 0.2380986325442791, + 0.0, + 0.7533965911716223, + 0.12046248652040958, + 0.24075759574770927, + 0.32766192965209484, + 0.03378814458847046, + 0.0, + 1.2731038257479668, + 0.7215894274413586, + 0.08532879129052162, + 0.2345421314239502, + 0.045387834310531616, + 0.8888416364789009, + 1.2482883259654045, + 0.16480780579149723, + 0.6243869792670012, + 0.3293522670865059, + 0.031033378094434738, + 0.03700879588723183, + 0.0, + 0.3040226250886917, + 0.13706761598587036, + 0.2303144596517086, + 0.0, + 0.24431529641151428, + 0.0, + 0.4081152118742466, + 0.32071099802851677, + 0.239827748388052, + 0.30721417628228664, + 0.4011756591498852, + 0.5132522583007812 + ], + "unique_experts": 56, + "load_cv": 0.8959924749915423, + "normalized_load_entropy": 0.9037642550372237, + "max_load_share": 0.06497175141242938 + } + }, + "s1_x": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "e06fd2706b6913c79cc46e9fe6ce9351d809828c7573dd37a5a7fd9102e98675", + "route_weight_sha256": "dc2d3aa0c671f1d1c274430c67b99ee129652364796f05181ca11a8faaeb79ef", + "loads": [ + 11, + 5, + 1, + 0, + 16, + 1, + 3, + 4, + 2, + 1, + 3, + 0, + 6, + 6, + 2, + 6, + 0, + 0, + 2, + 0, + 0, + 5, + 3, + 1, + 2, + 7, + 1, + 5, + 8, + 0, + 2, + 3, + 0, + 2, + 1, + 4, + 1, + 0, + 0, + 24, + 7, + 0, + 2, + 0, + 0, + 2, + 2, + 9, + 6, + 1, + 0, + 0, + 3, + 0, + 3, + 0, + 2, + 0, + 2, + 2, + 5, + 6, + 7, + 7 + ], + "weighted_loads": [ + 1.0777014549821615, + 0.2677786163985729, + 0.0327930822968483, + 0.0, + 0.5958984512835741, + 0.04226624593138695, + 0.14932532608509064, + 0.1859667468816042, + 0.08636512979865074, + 0.030173147097229958, + 0.20459844917058945, + 0.0, + 0.4156901687383652, + 0.22207608073949814, + 0.080977912992239, + 0.5356919690966606, + 0.0, + 0.0, + 0.10354750230908394, + 0.0, + 0.0, + 0.2690337225794792, + 0.14738333225250244, + 0.0356985442340374, + 0.08663613721728325, + 0.41489409282803535, + 0.03175590559840202, + 0.20858531072735786, + 0.2900418248027563, + 0.0, + 0.08304053172469139, + 0.22715844959020615, + 0.0, + 0.0638574417680502, + 0.08890382200479507, + 0.23817871138453484, + 0.04040927812457085, + 0.0, + 0.0, + 1.3582613840699196, + 0.6012763790786266, + 0.0, + 0.06303936615586281, + 0.0, + 0.0, + 0.09239903092384338, + 0.06956620886921883, + 0.28498322516679764, + 0.29140515625476837, + 0.03364478051662445, + 0.0, + 0.0, + 0.11470542475581169, + 0.0, + 0.11191700026392937, + 0.0, + 0.07810629531741142, + 0.0, + 0.08249137178063393, + 0.07968195155262947, + 0.27724234014749527, + 0.28700270876288414, + 0.39026080816984177, + 0.3700455091893673 + ], + "unique_experts": 46, + "load_cv": 1.2802284974827784, + "normalized_load_entropy": 0.8410374976935545, + "max_load_share": 0.11764705882352941 + }, + "full_input": { + "tokens": 75, + "top_k": 6, + "decisions": 450, + "ordered_route_sha256": "f68abe4d7569bca930f40cc292a78461bb5b86d6a405cb9a241e98e1d17cecf8", + "route_weight_sha256": "ef3ec6534141084bad8815a418b76fb1251024d3e6107309e482c8fbb019f529", + "loads": [ + 16, + 9, + 1, + 0, + 16, + 3, + 30, + 4, + 2, + 2, + 13, + 11, + 6, + 6, + 2, + 15, + 0, + 1, + 4, + 3, + 0, + 11, + 3, + 4, + 7, + 7, + 6, + 5, + 8, + 19, + 9, + 4, + 0, + 14, + 4, + 5, + 7, + 1, + 1, + 25, + 10, + 4, + 10, + 0, + 17, + 14, + 6, + 11, + 8, + 5, + 1, + 0, + 5, + 2, + 6, + 3, + 5, + 11, + 8, + 7, + 7, + 10, + 7, + 9 + ], + "weighted_loads": [ + 1.279701204970479, + 0.5468841232359409, + 0.0327930822968483, + 0.0, + 0.5958984512835741, + 0.10994331166148186, + 2.2851557228714228, + 0.1859667468816042, + 0.08636512979865074, + 0.06072933226823807, + 0.8140182066708803, + 0.8248607218265533, + 0.4156901687383652, + 0.22207608073949814, + 0.080977912992239, + 1.1576542556285858, + 0.0, + 0.038916394114494324, + 0.16965189762413502, + 0.1226910687983036, + 0.0, + 0.5731339119374752, + 0.14738333225250244, + 0.15660789981484413, + 0.28136696107685566, + 0.41489409282803535, + 0.2251996323466301, + 0.20858531072735786, + 0.2900418248027563, + 1.6607191301882267, + 0.47451337054371834, + 0.2667594440281391, + 0.0, + 1.2803803253918886, + 0.31456989236176014, + 0.2915908433496952, + 0.48120651952922344, + 0.03334196284413338, + 0.04256937652826309, + 1.400654397904873, + 0.8164258450269699, + 0.17284085601568222, + 0.7195553071796894, + 0.0, + 1.3608606047928333, + 1.2016165927052498, + 0.2202373407781124, + 0.6853964701294899, + 0.5440781638026237, + 0.2358272448182106, + 0.03642287850379944, + 0.0, + 0.1894601434469223, + 0.08212430402636528, + 0.22478857077658176, + 0.1137559525668621, + 0.2374115101993084, + 0.7056881338357925, + 0.35445377230644226, + 0.31970706209540367, + 0.34323433600366116, + 0.46561199240386486, + 0.39026080816984177, + 0.48929572850465775 + ], + "unique_experts": 58, + "load_cv": 0.848865619227315, + "normalized_load_entropy": 0.9160739133541809, + "max_load_share": 0.06666666666666667 + } + }, + "s0_period": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "6667a5a2637d5ad06af9c35032844ca345ebcad68008a40383d3d5823e47e51d", + "route_weight_sha256": "b287d7c1ee47dad13b8c2c63b60de28345acfc40d7fa649c2e31e112a6dcddc8", + "loads": [ + 11, + 4, + 1, + 0, + 16, + 1, + 3, + 4, + 2, + 1, + 4, + 0, + 7, + 9, + 2, + 5, + 0, + 1, + 2, + 0, + 0, + 5, + 3, + 1, + 2, + 6, + 1, + 4, + 8, + 0, + 2, + 3, + 0, + 2, + 1, + 4, + 1, + 0, + 0, + 24, + 7, + 0, + 2, + 1, + 0, + 2, + 2, + 7, + 6, + 1, + 0, + 0, + 3, + 0, + 3, + 1, + 2, + 0, + 2, + 2, + 4, + 5, + 7, + 7 + ], + "weighted_loads": [ + 1.0681925006210804, + 0.23574873059988022, + 0.033967338502407074, + 0.0, + 0.6034822799265385, + 0.04190880432724953, + 0.14187785238027573, + 0.18240323290228844, + 0.08812360465526581, + 0.03219030797481537, + 0.23909687623381615, + 0.0, + 0.45738870464265347, + 0.3302563577890396, + 0.08365019038319588, + 0.5259515792131424, + 0.0, + 0.026794899255037308, + 0.10009603202342987, + 0.0, + 0.0, + 0.26331494376063347, + 0.15504954382777214, + 0.030456645414233208, + 0.08520092070102692, + 0.37419264391064644, + 0.03041456639766693, + 0.17032082378864288, + 0.31125268898904324, + 0.0, + 0.0832650326192379, + 0.2408757358789444, + 0.0, + 0.06274468451738358, + 0.0956588014960289, + 0.2375350035727024, + 0.04123573750257492, + 0.0, + 0.0, + 1.3324116356670856, + 0.5744907185435295, + 0.0, + 0.06681179068982601, + 0.031971823424100876, + 0.0, + 0.09086441993713379, + 0.07209178060293198, + 0.2274085134267807, + 0.2941621392965317, + 0.03143368661403656, + 0.0, + 0.0, + 0.1275947317481041, + 0.0, + 0.12007157318294048, + 0.03030603937804699, + 0.07693101838231087, + 0.0, + 0.08187932893633842, + 0.0784967914223671, + 0.23617953062057495, + 0.2543741837143898, + 0.3903815299272537, + 0.37998922914266586 + ], + "unique_experts": 49, + "load_cv": 1.2645158695989198, + "normalized_load_entropy": 0.8502224393072618, + "max_load_share": 0.11764705882352941 + }, + "full_input": { + "tokens": 59, + "top_k": 6, + "decisions": 354, + "ordered_route_sha256": "56c13d19e0e11e0f0ed8e59109acb36b5b9d4f60c9ab8b2bc9c74e5cd582fbb2", + "route_weight_sha256": "21da83a676ecd72562279f7a554ad06d64d46f297153bcbed99d6194b4eece0a", + "loads": [ + 11, + 10, + 1, + 0, + 16, + 1, + 18, + 4, + 2, + 3, + 14, + 5, + 7, + 9, + 4, + 12, + 0, + 2, + 3, + 1, + 0, + 7, + 3, + 1, + 5, + 6, + 4, + 4, + 8, + 13, + 2, + 3, + 0, + 9, + 2, + 5, + 5, + 1, + 0, + 25, + 8, + 3, + 5, + 3, + 12, + 12, + 4, + 8, + 7, + 1, + 1, + 0, + 8, + 3, + 6, + 1, + 5, + 0, + 7, + 7, + 4, + 7, + 7, + 9 + ], + "weighted_loads": [ + 1.0681925006210804, + 0.7342728115618229, + 0.033967338502407074, + 0.0, + 0.6034822799265385, + 0.04190880432724953, + 1.3800914771854877, + 0.18240323290228844, + 0.08812360465526581, + 0.10833032988011837, + 0.8539890591055155, + 0.34076156467199326, + 0.45738870464265347, + 0.3302563577890396, + 0.15552135929465294, + 0.9436863213777542, + 0.0, + 0.061772532761096954, + 0.1414135843515396, + 0.04128880426287651, + 0.0, + 0.37439070641994476, + 0.15504954382777214, + 0.030456645414233208, + 0.2668024208396673, + 0.37419264391064644, + 0.1551753208041191, + 0.17032082378864288, + 0.31125268898904324, + 1.0036796890199184, + 0.0832650326192379, + 0.2408757358789444, + 0.0, + 0.7716069445014, + 0.11850138194859028, + 0.2749717943370342, + 0.37985329888761044, + 0.03378814458847046, + 0.0, + 1.3674428462982178, + 0.7021730914711952, + 0.127726461738348, + 0.19133304245769978, + 0.13883719965815544, + 0.8162243701517582, + 1.0468985699117184, + 0.13703060522675514, + 0.5883014351129532, + 0.3262299932539463, + 0.03143368661403656, + 0.03700879588723183, + 0.0, + 0.3047194257378578, + 0.13706761598587036, + 0.26016942597925663, + 0.03030603937804699, + 0.2430874966084957, + 0.0, + 0.3568655364215374, + 0.31683116778731346, + 0.23617953062057495, + 0.35011772997677326, + 0.3903815299272537, + 0.48185595124959946 + ], + "unique_experts": 57, + "load_cv": 0.8787263394092856, + "normalized_load_entropy": 0.9093818146630797, + "max_load_share": 0.07062146892655367 + } + }, + "s1_period": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "159fd7d60b222b9d0e4df6f2b46393584c3866bb68f14e18510103023d076ccd", + "route_weight_sha256": "3b2a86d6ec7a15cf50e5945f10f2a8977053f57ff2d560e0528722af03d277ba", + "loads": [ + 11, + 5, + 1, + 0, + 16, + 1, + 3, + 4, + 2, + 1, + 3, + 0, + 6, + 8, + 2, + 6, + 0, + 0, + 2, + 0, + 0, + 5, + 3, + 1, + 2, + 7, + 1, + 5, + 8, + 0, + 2, + 3, + 0, + 2, + 1, + 4, + 1, + 0, + 0, + 24, + 7, + 0, + 2, + 0, + 0, + 2, + 3, + 8, + 6, + 1, + 0, + 0, + 3, + 0, + 2, + 0, + 2, + 0, + 2, + 2, + 4, + 6, + 7, + 7 + ], + "weighted_loads": [ + 1.0790556073188782, + 0.2613863628357649, + 0.0345727801322937, + 0.0, + 0.5866766162216663, + 0.04210393503308296, + 0.14745678007602692, + 0.18699805811047554, + 0.09217116236686707, + 0.03018263541162014, + 0.20319832488894463, + 0.0, + 0.415947362780571, + 0.28491097316145897, + 0.08040742576122284, + 0.5372413024306297, + 0.0, + 0.0, + 0.10277464240789413, + 0.0, + 0.0, + 0.2685804218053818, + 0.1490548513829708, + 0.035157155245542526, + 0.08538924157619476, + 0.42384379357099533, + 0.031265851110219955, + 0.20334721356630325, + 0.2966187819838524, + 0.0, + 0.08799038827419281, + 0.22755909711122513, + 0.0, + 0.0610817726701498, + 0.09616024047136307, + 0.23016365990042686, + 0.040763117372989655, + 0.0, + 0.0, + 1.3531917594373226, + 0.6051123179495335, + 0.0, + 0.0647032130509615, + 0.0, + 0.0, + 0.0916823223233223, + 0.0999065637588501, + 0.2578366044908762, + 0.28680781088769436, + 0.03731159493327141, + 0.0, + 0.0, + 0.12263444066047668, + 0.0, + 0.07938865199685097, + 0.0, + 0.07425675168633461, + 0.0, + 0.08310374617576599, + 0.07990225404500961, + 0.23746968805789948, + 0.2851293031126261, + 0.39022190496325493, + 0.36970940977334976 + ], + "unique_experts": 46, + "load_cv": 1.2814291809799612, + "normalized_load_entropy": 0.8407505209711236, + "max_load_share": 0.11764705882352941 + }, + "full_input": { + "tokens": 75, + "top_k": 6, + "decisions": 450, + "ordered_route_sha256": "567e1ad95b8f271e4828dfa87ee702e35238bf84f72988f5c769c7cef0b651d7", + "route_weight_sha256": "b9c778cc09b88829283eb666d19ce74dee7d2daa012113fab71d9d5c3c6376bd", + "loads": [ + 16, + 10, + 1, + 0, + 16, + 3, + 29, + 4, + 2, + 2, + 13, + 12, + 6, + 8, + 2, + 14, + 0, + 1, + 4, + 3, + 0, + 11, + 3, + 4, + 6, + 7, + 5, + 5, + 8, + 20, + 9, + 4, + 0, + 15, + 4, + 6, + 7, + 1, + 1, + 25, + 10, + 4, + 10, + 1, + 17, + 14, + 6, + 10, + 8, + 5, + 1, + 0, + 5, + 2, + 5, + 2, + 5, + 11, + 8, + 7, + 6, + 10, + 7, + 9 + ], + "weighted_loads": [ + 1.2810553573071957, + 0.698487801477313, + 0.0345727801322937, + 0.0, + 0.5866766162216663, + 0.10978100076317787, + 2.2367189172655344, + 0.18699805811047554, + 0.09217116236686707, + 0.06073882058262825, + 0.8468236289918423, + 0.8662742972373962, + 0.415947362780571, + 0.28491097316145897, + 0.08040742576122284, + 1.016867384314537, + 0.0, + 0.038916394114494324, + 0.1688790377229452, + 0.1226910687983036, + 0.0, + 0.5565090999007225, + 0.1490548513829708, + 0.15606651082634926, + 0.34299623034894466, + 0.42384379357099533, + 0.19219337403774261, + 0.20334721356630325, + 0.2966187819838524, + 1.7626603282988071, + 0.47946322709321976, + 0.2671600915491581, + 0.0, + 1.33025804720819, + 0.32182631082832813, + 0.31941501051187515, + 0.49835008569061756, + 0.03334196284413338, + 0.04256937652826309, + 1.395584773272276, + 0.8162152990698814, + 0.17198995500802994, + 0.7090339865535498, + 0.037394385784864426, + 1.3374967686831951, + 1.090342953801155, + 0.20777785032987595, + 0.6582498494535685, + 0.5394808184355497, + 0.23949405923485756, + 0.03642287850379944, + 0.0, + 0.1973891593515873, + 0.08212430402636528, + 0.1920320112258196, + 0.07215336710214615, + 0.23356196656823158, + 0.7056881338357925, + 0.3659575320780277, + 0.3199273645877838, + 0.3030125666409731, + 0.46167685836553574, + 0.39022190496325493, + 0.4839686118066311 + ], + "unique_experts": 59, + "load_cv": 0.8466287538901452, + "normalized_load_entropy": 0.9168977113246881, + "max_load_share": 0.06444444444444444 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 34, + "ordered_topk_exact_tokens": 19, + "set_exact_tokens": 25, + "mean_set_jaccard": 0.9243697478991596, + "mean_token_weighted_tv": 0.012119842528858605, + "aggregate_load_tv": 0.044117647058823525 + }, + "system_bos": { + "tokens": 34, + "ordered_topk_exact_tokens": 21, + "set_exact_tokens": 26, + "mean_set_jaccard": 0.9327731092436975, + "mean_token_weighted_tv": 0.012944143895498094, + "aggregate_load_tv": 0.024509803921568627 + }, + "system_x": { + "tokens": 34, + "ordered_topk_exact_tokens": 19, + "set_exact_tokens": 24, + "mean_set_jaccard": 0.9159663865546218, + "mean_token_weighted_tv": 0.016390556990004638, + "aggregate_load_tv": 0.04411764705882353 + }, + "system_period": { + "tokens": 34, + "ordered_topk_exact_tokens": 18, + "set_exact_tokens": 25, + "mean_set_jaccard": 0.9243697478991597, + "mean_token_weighted_tv": 0.015465957249569543, + "aggregate_load_tv": 0.03431372549019608 + }, + "bos_at_s0": { + "tokens": 34, + "ordered_topk_exact_tokens": 17, + "set_exact_tokens": 20, + "mean_set_jaccard": 0.8823529411764707, + "mean_token_weighted_tv": 0.020383442067267263, + "aggregate_load_tv": 0.0392156862745098 + }, + "bos_at_s1": { + "tokens": 34, + "ordered_topk_exact_tokens": 20, + "set_exact_tokens": 25, + "mean_set_jaccard": 0.9243697478991597, + "mean_token_weighted_tv": 0.016551399220000294, + "aggregate_load_tv": 0.039215686274509796 + }, + "x_at_s0": { + "tokens": 34, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.8382352941176472, + "mean_token_weighted_tv": 0.02650018540375373, + "aggregate_load_tv": 0.07352941176470588 + }, + "x_at_s1": { + "tokens": 34, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 22, + "mean_set_jaccard": 0.8865546218487396, + "mean_token_weighted_tv": 0.02308041205191437, + "aggregate_load_tv": 0.053921568627450976 + }, + "period_at_s0": { + "tokens": 34, + "ordered_topk_exact_tokens": 16, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.8613445378151261, + "mean_token_weighted_tv": 0.02331575721173602, + "aggregate_load_tv": 0.06372549019607843 + }, + "period_at_s1": { + "tokens": 34, + "ordered_topk_exact_tokens": 16, + "set_exact_tokens": 23, + "mean_set_jaccard": 0.9012605042016807, + "mean_token_weighted_tv": 0.020393674261868, + "aggregate_load_tv": 0.049019607843137254 + } + } + }, + "layer_14": { + "layer": 14, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "ea2e46e5c0babffb3e480af8fa16ba2c7d8ac3c30a7c223acaa9f88846706f43", + "route_weight_sha256": "45e77f2387e1a8bdc1256cb8ce3968a24a5a235ac33280189c337581fb3924f7", + "loads": [ + 2, + 0, + 0, + 2, + 5, + 0, + 10, + 1, + 1, + 0, + 1, + 0, + 0, + 4, + 0, + 6, + 14, + 4, + 1, + 5, + 0, + 2, + 0, + 0, + 1, + 6, + 10, + 0, + 2, + 3, + 5, + 0, + 2, + 0, + 0, + 0, + 2, + 2, + 4, + 9, + 0, + 0, + 9, + 0, + 5, + 4, + 4, + 7, + 1, + 11, + 3, + 2, + 6, + 0, + 20, + 4, + 6, + 4, + 2, + 5, + 2, + 0, + 1, + 4 + ], + "weighted_loads": [ + 0.06706884317100048, + 0.0, + 0.0, + 0.07199719175696373, + 0.3987623527646065, + 0.0, + 0.9559753257781267, + 0.04050463065505028, + 0.04681089520454407, + 0.0, + 0.018661482259631157, + 0.0, + 0.0, + 0.19568180665373802, + 0.0, + 0.3142876364290714, + 0.700100913643837, + 0.13763106241822243, + 0.0500343032181263, + 0.630098469555378, + 0.0, + 0.05805935710668564, + 0.0, + 0.0, + 0.03134715557098389, + 0.4109720289707184, + 0.5271503236144781, + 0.0, + 0.07641994580626488, + 0.14502687007188797, + 0.30355197936296463, + 0.0, + 0.05570543743669987, + 0.0, + 0.0, + 0.0, + 0.07886026427149773, + 0.06492378376424313, + 0.24933145195245743, + 0.5143592655658722, + 0.0, + 0.0, + 0.5131965652108192, + 0.0, + 0.1507723182439804, + 0.12949594296514988, + 0.25326964259147644, + 0.8834459595382214, + 0.035894304513931274, + 0.9810820557177067, + 0.13190486282110214, + 0.0719313882291317, + 0.3113471083343029, + 0.0, + 2.9188923873007298, + 0.2527247704565525, + 0.507828451693058, + 0.1923081986606121, + 0.06600711867213249, + 0.2312066461890936, + 0.0780174508690834, + 0.0, + 0.04498440399765968, + 0.292882464826107 + ], + "unique_experts": 44, + "load_cv": 1.2021702788995554, + "normalized_load_entropy": 0.8420210109303026, + "max_load_share": 0.09803921568627451 + }, + "full_input": { + "tokens": 59, + "top_k": 6, + "decisions": 354, + "ordered_route_sha256": "a248520cbfb384ba5683153c5b5cf0b721796f0197d6ff7658a244603fc46cfd", + "route_weight_sha256": "0b4f65255b841168d250c3aceb16258485f5615e6a96277b31bd42234009ad94", + "loads": [ + 8, + 0, + 0, + 3, + 6, + 11, + 10, + 4, + 1, + 6, + 3, + 3, + 0, + 4, + 0, + 10, + 14, + 4, + 5, + 7, + 0, + 2, + 0, + 11, + 2, + 9, + 16, + 7, + 9, + 3, + 7, + 4, + 2, + 7, + 0, + 0, + 2, + 4, + 6, + 10, + 0, + 0, + 10, + 0, + 7, + 4, + 11, + 10, + 1, + 12, + 8, + 8, + 12, + 7, + 20, + 7, + 6, + 4, + 2, + 16, + 2, + 1, + 1, + 5 + ], + "weighted_loads": [ + 0.734347565099597, + 0.0, + 0.0, + 0.1116751953959465, + 0.44698138907551765, + 0.9633467700332403, + 0.9559753257781267, + 0.17166684567928314, + 0.04681089520454407, + 0.36814703047275543, + 0.08603661693632603, + 0.18649956211447716, + 0.0, + 0.19568180665373802, + 0.0, + 0.4465716052800417, + 0.700100913643837, + 0.13763106241822243, + 0.33454205095767975, + 0.7965946607291698, + 0.0, + 0.05805935710668564, + 0.0, + 0.46611166559159756, + 0.053953951224684715, + 0.6028823964297771, + 0.8645717110484838, + 0.4909361833706498, + 1.3698386959731579, + 0.14502687007188797, + 0.45729226619005203, + 0.15819172747433186, + 0.05570543743669987, + 0.8222124166786671, + 0.0, + 0.0, + 0.07886026427149773, + 0.1520602460950613, + 0.3834918811917305, + 0.5923844501376152, + 0.0, + 0.0, + 0.5650376826524734, + 0.0, + 0.21805616468191147, + 0.12949594296514988, + 0.7261784002184868, + 1.01407290995121, + 0.035894304513931274, + 1.0233606360852718, + 0.35464389994740486, + 1.4134991858154535, + 1.0501264594495296, + 0.47686663642525673, + 2.9188923873007298, + 0.5074499845504761, + 0.507828451693058, + 0.1923081986606121, + 0.06600711867213249, + 0.7458320055156946, + 0.0780174508690834, + 0.005031066946685314, + 0.04498440399765968, + 0.36075659841299057 + ], + "unique_experts": 53, + "load_cv": 0.8358336520887747, + "normalized_load_entropy": 0.9061191683448689, + "max_load_share": 0.05649717514124294 + } + }, + "s1_eos": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "97e0582be474c7d1640d017ed513914151a6e47021964bd7829809a746bf029f", + "route_weight_sha256": "3e6b3aa3d999d81bf16f899008cce1c5550f25d940d8fd1c11a2a9d75bfc54b1", + "loads": [ + 2, + 0, + 0, + 1, + 5, + 0, + 10, + 2, + 1, + 0, + 1, + 1, + 0, + 5, + 0, + 4, + 14, + 4, + 1, + 5, + 0, + 2, + 0, + 0, + 1, + 6, + 9, + 0, + 2, + 2, + 5, + 0, + 2, + 0, + 0, + 0, + 2, + 2, + 4, + 8, + 0, + 0, + 9, + 0, + 5, + 4, + 5, + 7, + 1, + 10, + 4, + 2, + 6, + 1, + 20, + 4, + 6, + 4, + 2, + 5, + 2, + 1, + 1, + 4 + ], + "weighted_loads": [ + 0.06897376850247383, + 0.0, + 0.0, + 0.04021446034312248, + 0.39599135145545006, + 0.0, + 0.9584342781454325, + 0.0713647622615099, + 0.044297948479652405, + 0.0, + 0.019987422972917557, + 0.03038114309310913, + 0.0, + 0.2220572493970394, + 0.0, + 0.2496754787862301, + 0.7006748076528311, + 0.14060652814805508, + 0.05313783511519432, + 0.6329419538378716, + 0.0, + 0.058997705578804016, + 0.0, + 0.0, + 0.031635113060474396, + 0.41459571570158005, + 0.5004751831293106, + 0.0, + 0.07366302981972694, + 0.10787567868828773, + 0.31944888085126877, + 0.0, + 0.0552224051207304, + 0.0, + 0.0, + 0.0, + 0.0801815614104271, + 0.06625550612807274, + 0.24598771706223488, + 0.48895104974508286, + 0.0, + 0.0, + 0.5047067105770111, + 0.0, + 0.14793413691222668, + 0.13224352337419987, + 0.29613183438777924, + 0.8680097088217735, + 0.03686489537358284, + 0.9409971386194229, + 0.17087333276867867, + 0.07283766940236092, + 0.30905213952064514, + 0.03768843784928322, + 2.941573280841112, + 0.24943894892930984, + 0.49786781892180443, + 0.19292998313903809, + 0.07052432373166084, + 0.2260514572262764, + 0.0762321688234806, + 0.03422045335173607, + 0.045712605118751526, + 0.29233039170503616 + ], + "unique_experts": 47, + "load_cv": 1.1671197011320102, + "normalized_load_entropy": 0.8533396521597065, + "max_load_share": 0.09803921568627451 + }, + "full_input": { + "tokens": 75, + "top_k": 6, + "decisions": 450, + "ordered_route_sha256": "55f7a9008882d1a7b6144797c0546e1875066638007bfc40133f66e3000cb504", + "route_weight_sha256": "8e043f64eee07268e32117dbc3319f525a7a7052690e59e525daffbb1681ffb3", + "loads": [ + 8, + 1, + 0, + 3, + 9, + 16, + 10, + 7, + 3, + 10, + 1, + 4, + 6, + 5, + 0, + 9, + 14, + 4, + 8, + 10, + 2, + 6, + 0, + 10, + 6, + 11, + 14, + 8, + 14, + 3, + 9, + 3, + 4, + 11, + 1, + 1, + 2, + 5, + 7, + 10, + 0, + 0, + 11, + 1, + 7, + 4, + 12, + 9, + 3, + 10, + 20, + 6, + 14, + 11, + 22, + 7, + 7, + 5, + 3, + 24, + 5, + 3, + 3, + 8 + ], + "weighted_loads": [ + 0.7766129989176989, + 0.05065322667360306, + 0.0, + 0.12103121355175972, + 0.649045817553997, + 1.1223688069730997, + 0.9584342781454325, + 0.2924464363604784, + 0.2091214880347252, + 0.7142122723162174, + 0.019987422972917557, + 0.24729176610708237, + 0.39396440982818604, + 0.2220572493970394, + 0.0, + 0.43905013240873814, + 0.7006748076528311, + 0.14060652814805508, + 0.5076680090278387, + 0.9571618307381868, + 0.23273877799510956, + 0.20868670009076595, + 0.0, + 0.415097139775753, + 0.2701571639627218, + 0.679888179525733, + 0.8722415044903755, + 0.38156369235366583, + 1.9215085841715336, + 0.15648934990167618, + 0.5292957127094269, + 0.08611230552196503, + 0.13576083071529865, + 1.2994557060301304, + 0.04824246093630791, + 0.0802900567650795, + 0.0801815614104271, + 0.422516904771328, + 0.4551503397524357, + 0.6393628679215908, + 0.0, + 0.0, + 0.6018591150641441, + 0.04622427746653557, + 0.20993073657155037, + 0.13224352337419987, + 0.7893040962517262, + 0.9365544077008963, + 0.16348928958177567, + 0.9409971386194229, + 1.1622670702636242, + 1.3580704927444458, + 1.139271929860115, + 0.7640357688069344, + 3.02454025298357, + 0.48521680012345314, + 0.5477373115718365, + 0.23122307285666466, + 0.17999548092484474, + 1.3052214607596397, + 0.32580218091607094, + 0.08026884635910392, + 0.14820825308561325, + 0.4614974968135357 + ], + "unique_experts": 59, + "load_cv": 0.7504533609183054, + "normalized_load_entropy": 0.9292454784107876, + "max_load_share": 0.05333333333333334 + } + }, + "s0_bos": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "45094a51b645a083b01783cd69641ef4f5831f03b9e9d7274ba8e4dfac4aeb34", + "route_weight_sha256": "ca4081bc81ca3ccb825265b09497a62f8592b5c472f3a17c647bab5b3d85b8a3", + "loads": [ + 0, + 0, + 0, + 3, + 5, + 0, + 9, + 1, + 2, + 0, + 2, + 1, + 0, + 5, + 0, + 6, + 13, + 2, + 1, + 5, + 0, + 2, + 0, + 0, + 1, + 6, + 10, + 0, + 1, + 2, + 5, + 0, + 2, + 0, + 0, + 0, + 1, + 3, + 4, + 9, + 0, + 0, + 9, + 0, + 6, + 4, + 4, + 7, + 1, + 11, + 4, + 2, + 6, + 1, + 20, + 4, + 6, + 4, + 2, + 5, + 2, + 0, + 1, + 4 + ], + "weighted_loads": [ + 0.0, + 0.0, + 0.0, + 0.10710589587688446, + 0.4058165103197098, + 0.0, + 0.9374938011169434, + 0.04169164225459099, + 0.08195632323622704, + 0.0, + 0.04355394281446934, + 0.0306871235370636, + 0.0, + 0.223678732290864, + 0.0, + 0.3233621306717396, + 0.6854043491184711, + 0.06905978173017502, + 0.046030670404434204, + 0.6122722998261452, + 0.0, + 0.058020537719130516, + 0.0, + 0.0, + 0.03288761526346207, + 0.4296554923057556, + 0.5503684058785439, + 0.0, + 0.03878828510642052, + 0.09950167313218117, + 0.3133319206535816, + 0.0, + 0.05606883578002453, + 0.0, + 0.0, + 0.0, + 0.0429241769015789, + 0.09979132749140263, + 0.25574829056859016, + 0.5160915441811085, + 0.0, + 0.0, + 0.5264471173286438, + 0.0, + 0.1833783108741045, + 0.12692694552242756, + 0.24720752239227295, + 0.8544654250144958, + 0.03520583361387253, + 0.971952773630619, + 0.1619628667831421, + 0.06756740063428879, + 0.3043871968984604, + 0.03919709846377373, + 2.9842153415083885, + 0.25736162438988686, + 0.48758205957710743, + 0.1943695843219757, + 0.06883203610777855, + 0.22568371146917343, + 0.07886630669236183, + 0.0, + 0.04100024327635765, + 0.26589004695415497 + ], + "unique_experts": 45, + "load_cv": 1.1841254232850391, + "normalized_load_entropy": 0.8455973454928337, + "max_load_share": 0.09803921568627451 + }, + "full_input": { + "tokens": 59, + "top_k": 6, + "decisions": 354, + "ordered_route_sha256": "5e931d3149906a4a18d353d22f25f6b223a4c95ad9a24b2d552391757ab95e5f", + "route_weight_sha256": "0c25634f63151daa86f5560760be655138f8b6d38e9862eeaa52f6fa8f3a0558", + "loads": [ + 6, + 0, + 0, + 5, + 6, + 11, + 9, + 3, + 2, + 7, + 4, + 4, + 0, + 5, + 0, + 10, + 13, + 2, + 6, + 7, + 0, + 2, + 0, + 10, + 2, + 9, + 16, + 6, + 9, + 2, + 7, + 4, + 2, + 7, + 0, + 0, + 1, + 4, + 6, + 10, + 0, + 0, + 10, + 0, + 9, + 4, + 11, + 10, + 1, + 12, + 8, + 8, + 12, + 8, + 20, + 7, + 6, + 5, + 3, + 15, + 2, + 0, + 1, + 5 + ], + "weighted_loads": [ + 0.6672787219285965, + 0.0, + 0.0, + 0.18867852538824081, + 0.4514084979891777, + 0.9633467700332403, + 0.9374938011169434, + 0.12844140082597733, + 0.08195632323622704, + 0.43466993048787117, + 0.11092907749116421, + 0.21718668565154076, + 0.0, + 0.223678732290864, + 0.0, + 0.4747579637914896, + 0.6854043491184711, + 0.06905978173017502, + 0.42656970396637917, + 0.77897834405303, + 0.0, + 0.058020537719130516, + 0.0, + 0.43847955018281937, + 0.055494410917162895, + 0.6425453834235668, + 0.8877897933125496, + 0.49219334311783314, + 1.3838560469448566, + 0.09950167313218117, + 0.465364757925272, + 0.20552987232804298, + 0.05606883578002453, + 0.8340522386133671, + 0.0, + 0.0, + 0.0429241769015789, + 0.1431583557277918, + 0.39107396826148033, + 0.6168388165533543, + 0.0, + 0.0, + 0.5816813595592976, + 0.0, + 0.32923789508640766, + 0.12692694552242756, + 0.677269134670496, + 0.9929828941822052, + 0.03520583361387253, + 1.0142313539981842, + 0.34941741079092026, + 0.6052046585828066, + 1.0431665480136871, + 0.5160637348890305, + 2.9842153415083885, + 0.5485604181885719, + 0.48758205957710743, + 0.23826191946864128, + 0.11372604966163635, + 0.6861288733780384, + 0.07886630669236183, + 0.0, + 0.04100024327635765, + 0.3280854858458042 + ], + "unique_experts": 52, + "load_cv": 0.8235226389425133, + "normalized_load_entropy": 0.9061958653192093, + "max_load_share": 0.05649717514124294 + } + }, + "s1_bos": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "56dd119e12a7176ea0ee129043a176aa405936472c5e6c063ff73475eb37dd93", + "route_weight_sha256": "156c0c106b3afc51f8b6a35ff5d5336484d08312da5c407b9a4d70ef3b827538", + "loads": [ + 1, + 0, + 0, + 2, + 5, + 0, + 9, + 1, + 2, + 0, + 2, + 0, + 0, + 5, + 0, + 5, + 15, + 2, + 1, + 5, + 0, + 2, + 0, + 0, + 1, + 6, + 12, + 0, + 1, + 2, + 5, + 0, + 2, + 0, + 0, + 0, + 2, + 2, + 4, + 9, + 0, + 0, + 9, + 0, + 5, + 3, + 4, + 7, + 1, + 11, + 4, + 2, + 6, + 1, + 20, + 4, + 7, + 5, + 1, + 5, + 2, + 0, + 1, + 3 + ], + "weighted_loads": [ + 0.029616862535476685, + 0.0, + 0.0, + 0.06779333762824535, + 0.4030173532664776, + 0.0, + 0.9210684914141893, + 0.04160110652446747, + 0.07920493558049202, + 0.0, + 0.043130265548825264, + 0.0, + 0.0, + 0.2247317172586918, + 0.0, + 0.29735634103417397, + 0.7485220897942781, + 0.06711711548268795, + 0.04717617481946945, + 0.6027976460754871, + 0.0, + 0.05718956142663956, + 0.0, + 0.0, + 0.03174120560288429, + 0.42909691110253334, + 0.608400147408247, + 0.0, + 0.040174700319767, + 0.1009589396417141, + 0.32807812839746475, + 0.0, + 0.053277453407645226, + 0.0, + 0.0, + 0.0, + 0.08195407688617706, + 0.06904910877346992, + 0.24502426013350487, + 0.5212377309799194, + 0.0, + 0.0, + 0.5194754227995872, + 0.0, + 0.152175297960639, + 0.113913020119071, + 0.24749428033828735, + 0.8509077876806259, + 0.038831256330013275, + 0.9931372813880444, + 0.16846146062016487, + 0.06688538566231728, + 0.30335427075624466, + 0.044252458959817886, + 2.9254293106496334, + 0.26345063745975494, + 0.5276092234998941, + 0.22606435045599937, + 0.034018147736787796, + 0.2261558435857296, + 0.07474740035831928, + 0.0, + 0.04080721363425255, + 0.22864868491888046 + ], + "unique_experts": 45, + "load_cv": 1.232489814103351, + "normalized_load_entropy": 0.8388579725166845, + "max_load_share": 0.09803921568627451 + }, + "full_input": { + "tokens": 75, + "top_k": 6, + "decisions": 450, + "ordered_route_sha256": "54d400d4d036fea6e25d42ebdffe752c61248e33e8e5b13d69ff9e43f511edc8", + "route_weight_sha256": "85a5ed6ba45457708c11889233e9c4f2cd15d111f6b2c71332908947e992ad80", + "loads": [ + 7, + 1, + 0, + 4, + 9, + 16, + 9, + 5, + 4, + 10, + 3, + 3, + 6, + 5, + 0, + 9, + 15, + 2, + 8, + 10, + 2, + 5, + 0, + 9, + 6, + 11, + 17, + 8, + 14, + 3, + 10, + 3, + 4, + 10, + 1, + 1, + 2, + 5, + 7, + 11, + 0, + 0, + 10, + 1, + 7, + 4, + 11, + 11, + 3, + 11, + 20, + 7, + 14, + 11, + 22, + 7, + 8, + 7, + 2, + 23, + 5, + 1, + 3, + 7 + ], + "weighted_loads": [ + 0.7372560929507017, + 0.05065322667360306, + 0.0, + 0.16124906577169895, + 0.655631996691227, + 1.1223688069730997, + 0.9210684914141893, + 0.2196306623518467, + 0.2440284751355648, + 0.7122320085763931, + 0.07505191303789616, + 0.21691062301397324, + 0.39396440982818604, + 0.2247317172586918, + 0.0, + 0.46063482016324997, + 0.7485220897942781, + 0.06711711548268795, + 0.47494314052164555, + 0.9305608626455069, + 0.23273877799510956, + 0.15836275182664394, + 0.0, + 0.38744519278407097, + 0.2702632565051317, + 0.7160328608006239, + 0.9801664687693119, + 0.43396109342575073, + 1.9959282949566841, + 0.14957261085510254, + 0.5659916531294584, + 0.135252945125103, + 0.13381587900221348, + 1.3073029331862926, + 0.04824246093630791, + 0.0802900567650795, + 0.08195407688617706, + 0.42531050741672516, + 0.4683224819600582, + 0.6770688183605671, + 0.0, + 0.0, + 0.5717335790395737, + 0.04622427746653557, + 0.2141718976199627, + 0.15493996627628803, + 0.7268865816295147, + 1.0078170616179705, + 0.1654556505382061, + 0.9931372813880444, + 1.1678383015096188, + 0.5599051304161549, + 1.1335740610957146, + 0.770599789917469, + 3.0083962827920914, + 0.5487493276596069, + 0.5774787161499262, + 0.3070956990122795, + 0.1434893049299717, + 1.2562105096876621, + 0.3243174124509096, + 0.04125838354229927, + 0.14330286160111427, + 0.39764347299933434 + ], + "unique_experts": 59, + "load_cv": 0.7609091378406377, + "normalized_load_entropy": 0.9271198993691101, + "max_load_share": 0.051111111111111114 + } + }, + "s0_x": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "39220e6e1b3531a38f91f586bb917d5e954d8c3831e714dc012262093eed695b", + "route_weight_sha256": "24bd449696841b5448e5c38d70ca2973ef5c8a35d53f9f43fd49752411e85cd7", + "loads": [ + 2, + 0, + 0, + 2, + 5, + 0, + 9, + 1, + 1, + 0, + 0, + 0, + 0, + 5, + 0, + 6, + 13, + 3, + 1, + 5, + 0, + 2, + 0, + 0, + 1, + 6, + 11, + 0, + 1, + 3, + 5, + 0, + 2, + 0, + 0, + 0, + 2, + 1, + 4, + 9, + 0, + 0, + 9, + 0, + 5, + 3, + 5, + 7, + 1, + 11, + 4, + 2, + 7, + 0, + 21, + 4, + 7, + 4, + 2, + 5, + 2, + 0, + 1, + 4 + ], + "weighted_loads": [ + 0.06697075255215168, + 0.0, + 0.0, + 0.06961194053292274, + 0.4020141251385212, + 0.0, + 0.9064401127398014, + 0.04213380441069603, + 0.047724075615406036, + 0.0, + 0.0, + 0.0, + 0.0, + 0.2392464242875576, + 0.0, + 0.32989851012825966, + 0.6485231555998325, + 0.10250085778534412, + 0.04590005800127983, + 0.627967469394207, + 0.0, + 0.05693788453936577, + 0.0, + 0.0, + 0.030429907143115997, + 0.4283815659582615, + 0.5862608943134546, + 0.0, + 0.039072971791028976, + 0.14503321424126625, + 0.31829724088311195, + 0.0, + 0.05288117751479149, + 0.0, + 0.0, + 0.0, + 0.0837210863828659, + 0.03347502276301384, + 0.26023589447140694, + 0.5100055914372206, + 0.0, + 0.0, + 0.5112087167799473, + 0.0, + 0.14032739028334618, + 0.10901023261249065, + 0.30019231885671616, + 0.8693613074719906, + 0.03819432854652405, + 0.9759128391742706, + 0.16664434969425201, + 0.06711410731077194, + 0.332354124635458, + 0.0, + 2.8843926191329956, + 0.2729760557413101, + 0.5090189445763826, + 0.1997980810701847, + 0.06530313938856125, + 0.22812139801681042, + 0.08177849650382996, + 0.0, + 0.04106014966964722, + 0.2831767648458481 + ], + "unique_experts": 43, + "load_cv": 1.2312414067795765, + "normalized_load_entropy": 0.8346640258983843, + "max_load_share": 0.10294117647058823 + }, + "full_input": { + "tokens": 59, + "top_k": 6, + "decisions": 354, + "ordered_route_sha256": "d0a47e020979d132c1334b03e2b6acbf7712fe57de1917214c20d5ac01954ee0", + "route_weight_sha256": "4ff66e31b4f53031ff439c3405b065a358b19b9523c9bd2ee5ceaf9b473b4551", + "loads": [ + 9, + 0, + 0, + 3, + 6, + 13, + 9, + 3, + 1, + 6, + 2, + 3, + 0, + 5, + 0, + 9, + 13, + 3, + 4, + 8, + 0, + 2, + 0, + 10, + 2, + 9, + 18, + 5, + 8, + 3, + 8, + 4, + 2, + 7, + 0, + 0, + 2, + 4, + 6, + 10, + 0, + 0, + 10, + 0, + 7, + 3, + 12, + 9, + 1, + 12, + 9, + 6, + 13, + 8, + 21, + 7, + 7, + 5, + 2, + 17, + 2, + 0, + 1, + 5 + ], + "weighted_loads": [ + 0.8427041117101908, + 0.0, + 0.0, + 0.10928994417190552, + 0.44942257180809975, + 1.096954571083188, + 0.9064401127398014, + 0.13556615635752678, + 0.047724075615406036, + 0.32126348465681076, + 0.06737513467669487, + 0.18649956211447716, + 0.0, + 0.2392464242875576, + 0.0, + 0.4337011445313692, + 0.6485231555998325, + 0.10250085778534412, + 0.25162366032600403, + 0.8639499805867672, + 0.0, + 0.05693788453936577, + 0.0, + 0.43847955018281937, + 0.053036702796816826, + 0.667464129626751, + 1.0370294991880655, + 0.4153762701898813, + 1.1214596219360828, + 0.14503321424126625, + 0.4996976088732481, + 0.20280348137021065, + 0.05288117751479149, + 0.9408768974244595, + 0.0, + 0.0, + 0.0837210863828659, + 0.18807000666856766, + 0.38976382091641426, + 0.5823104958981276, + 0.0, + 0.0, + 0.5610047355294228, + 0.0, + 0.20761123672127724, + 0.10901023261249065, + 0.7698675841093063, + 0.9559479914605618, + 0.03819432854652405, + 1.0181914195418358, + 0.3984401933848858, + 0.5418029148131609, + 1.0711334757506847, + 0.5651835985481739, + 2.8843926191329956, + 0.5181955955922604, + 0.5090189445763826, + 0.24168722331523895, + 0.06530313938856125, + 0.808487256988883, + 0.08177849650382996, + 0.0, + 0.04106014966964722, + 0.3541085869073868 + ], + "unique_experts": 52, + "load_cv": 0.8769810294440012, + "normalized_load_entropy": 0.899220910465558, + "max_load_share": 0.059322033898305086 + } + }, + "s1_x": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "4c5c42b49330c3f817283a07230c0aeb21a3e7132a2087205e3b43b170291c46", + "route_weight_sha256": "e0a3c659d8d50e42baa90d68a1e69603e939682c7f5047b275942533907c69d0", + "loads": [ + 1, + 0, + 0, + 0, + 5, + 0, + 10, + 2, + 2, + 0, + 0, + 0, + 0, + 5, + 0, + 5, + 15, + 3, + 1, + 5, + 0, + 2, + 0, + 0, + 1, + 6, + 10, + 0, + 1, + 3, + 5, + 0, + 1, + 0, + 0, + 0, + 4, + 3, + 4, + 8, + 0, + 0, + 9, + 0, + 5, + 3, + 4, + 7, + 1, + 11, + 3, + 1, + 6, + 1, + 22, + 4, + 8, + 4, + 0, + 6, + 2, + 0, + 1, + 4 + ], + "weighted_loads": [ + 0.030633561313152313, + 0.0, + 0.0, + 0.0, + 0.3968777395784855, + 0.0, + 0.9479666780680418, + 0.07093053311109543, + 0.08086811378598213, + 0.0, + 0.0, + 0.0, + 0.0, + 0.24470699205994606, + 0.0, + 0.29221588000655174, + 0.7350273132324219, + 0.09680104441940784, + 0.045635372400283813, + 0.6077871918678284, + 0.0, + 0.06016581878066063, + 0.0, + 0.0, + 0.030355529859662056, + 0.43588002398610115, + 0.5773103944957256, + 0.0, + 0.03863948956131935, + 0.15096640959382057, + 0.33165132254362106, + 0.0, + 0.024575766175985336, + 0.0, + 0.0, + 0.0, + 0.14874008670449257, + 0.09646502882242203, + 0.24565786495804787, + 0.47725385800004005, + 0.0, + 0.0, + 0.5036852434277534, + 0.0, + 0.15101534873247147, + 0.11389804817736149, + 0.25157449021935463, + 0.8538982942700386, + 0.03718419745564461, + 0.997662290930748, + 0.13386424630880356, + 0.034809064120054245, + 0.2949284017086029, + 0.04367230087518692, + 2.8826719634234905, + 0.270093884319067, + 0.545445304363966, + 0.18556303903460503, + 0.0, + 0.25645818188786507, + 0.07504250854253769, + 0.0, + 0.04001151770353317, + 0.26386870443820953 + ], + "unique_experts": 42, + "load_cv": 1.2778237458926367, + "normalized_load_entropy": 0.826657835520814, + "max_load_share": 0.10784313725490197 + }, + "full_input": { + "tokens": 75, + "top_k": 6, + "decisions": 450, + "ordered_route_sha256": "e1188f7fe2e9c58fcc48f5135dea7acf68472707809233654a67e430b5876fd4", + "route_weight_sha256": "d068c4bb0a875bb0d1324ffc0e78a5f45bff9bd6489796f47e54bd58f63086e7", + "loads": [ + 8, + 1, + 0, + 1, + 9, + 18, + 10, + 7, + 4, + 10, + 0, + 4, + 6, + 5, + 0, + 9, + 15, + 3, + 7, + 10, + 2, + 5, + 0, + 10, + 6, + 10, + 16, + 8, + 13, + 4, + 10, + 2, + 3, + 11, + 1, + 1, + 4, + 7, + 6, + 10, + 0, + 0, + 11, + 1, + 7, + 3, + 11, + 9, + 3, + 11, + 18, + 4, + 14, + 12, + 24, + 7, + 9, + 5, + 1, + 27, + 5, + 1, + 3, + 8 + ], + "weighted_loads": [ + 0.8154986705631018, + 0.05065322667360306, + 0.0, + 0.04369684308767319, + 0.6486635766923428, + 1.3080177921801805, + 0.9479666780680418, + 0.3126286417245865, + 0.24569165334105492, + 0.6676053591072559, + 0.0, + 0.2649059295654297, + 0.39396440982818604, + 0.24470699205994606, + 0.0, + 0.4587603136897087, + 0.7350273132324219, + 0.09680104441940784, + 0.47354098595678806, + 0.9313621614128351, + 0.23273877799510956, + 0.16133900918066502, + 0.0, + 0.4405524469912052, + 0.2688775807619095, + 0.6814911644905806, + 1.0563960187137127, + 0.3883402869105339, + 1.5423828177154064, + 0.19958008080720901, + 0.5781223624944687, + 0.0752878487110138, + 0.10511419177055359, + 1.4078809022903442, + 0.04824246093630791, + 0.0802900567650795, + 0.14874008670449257, + 0.5501170046627522, + 0.3872336335480213, + 0.6273622736334801, + 0.0, + 0.0, + 0.6129878424108028, + 0.04622427746653557, + 0.21301194839179516, + 0.11389804817736149, + 0.7147769406437874, + 0.9224429931491613, + 0.16380859166383743, + 0.997662290930748, + 1.1039377376437187, + 0.4864172115921974, + 1.1251481920480728, + 0.8901866264641285, + 2.9656389355659485, + 0.4663819782435894, + 0.595314797013998, + 0.2238561287522316, + 0.1094711571931839, + 1.4200388193130493, + 0.324612520635128, + 0.04125838354229927, + 0.1425071656703949, + 0.42600011453032494 + ], + "unique_experts": 58, + "load_cv": 0.8092184920657922, + "normalized_load_entropy": 0.9188016943055403, + "max_load_share": 0.06 + } + }, + "s0_period": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "3fe0eb619f061027072d0792d3b0f3023f7a5287d6e5e3ea254bd9e0601c59c8", + "route_weight_sha256": "a0f4ec8c2436ba2e3481e329ce833410026d3d63fae42ed4c166d6c489366dc2", + "loads": [ + 2, + 0, + 0, + 1, + 5, + 0, + 10, + 2, + 2, + 0, + 1, + 0, + 0, + 5, + 0, + 5, + 15, + 3, + 1, + 5, + 0, + 2, + 0, + 0, + 1, + 6, + 10, + 0, + 1, + 3, + 5, + 0, + 2, + 0, + 0, + 0, + 2, + 2, + 4, + 9, + 0, + 0, + 8, + 0, + 5, + 4, + 4, + 7, + 1, + 11, + 4, + 2, + 6, + 0, + 20, + 4, + 7, + 4, + 2, + 4, + 2, + 0, + 1, + 4 + ], + "weighted_loads": [ + 0.0659999530762434, + 0.0, + 0.0, + 0.040487319231033325, + 0.4066135063767433, + 0.0, + 0.9506030939519405, + 0.06978487595915794, + 0.08372439071536064, + 0.0, + 0.019794806838035583, + 0.0, + 0.0, + 0.2414364293217659, + 0.0, + 0.3053527809679508, + 0.7372428327798843, + 0.10278131999075413, + 0.04686770588159561, + 0.6264385022222996, + 0.0, + 0.058196065947413445, + 0.0, + 0.0, + 0.031037406995892525, + 0.420715618878603, + 0.5474829599261284, + 0.0, + 0.041361089795827866, + 0.1463112086057663, + 0.3149949125945568, + 0.0, + 0.05479772202670574, + 0.0, + 0.0, + 0.0, + 0.08091507479548454, + 0.06280203349888325, + 0.25654763728380203, + 0.5299538988620043, + 0.0, + 0.0, + 0.4767943248152733, + 0.0, + 0.15167992003262043, + 0.13089340180158615, + 0.2535832077264786, + 0.8590798266232014, + 0.033465467393398285, + 0.9765210822224617, + 0.1577235795557499, + 0.06742355972528458, + 0.2946461848914623, + 0.0, + 2.8669252395629883, + 0.2700587250292301, + 0.509948369115591, + 0.20139269530773163, + 0.063341049477458, + 0.19516030326485634, + 0.08109110966324806, + 0.0, + 0.04277533292770386, + 0.27963846921920776 + ], + "unique_experts": 44, + "load_cv": 1.2110918875829222, + "normalized_load_entropy": 0.8411936907239899, + "max_load_share": 0.09803921568627451 + }, + "full_input": { + "tokens": 59, + "top_k": 6, + "decisions": 354, + "ordered_route_sha256": "6bcb8c77b8ab87a81f98f38d21b1496fef08969e942e1e8c41daded7b75524b4", + "route_weight_sha256": "0eda207933671a47132b9777a97c6c64fa2120118b6b5772e813d8c687431514", + "loads": [ + 9, + 0, + 0, + 2, + 6, + 12, + 10, + 5, + 2, + 6, + 3, + 3, + 0, + 5, + 0, + 8, + 15, + 3, + 5, + 7, + 0, + 2, + 0, + 10, + 2, + 9, + 17, + 6, + 8, + 3, + 8, + 4, + 2, + 7, + 0, + 0, + 2, + 4, + 6, + 10, + 0, + 0, + 8, + 0, + 7, + 4, + 10, + 10, + 1, + 13, + 9, + 6, + 12, + 8, + 20, + 7, + 7, + 5, + 2, + 16, + 2, + 0, + 1, + 5 + ], + "weighted_loads": [ + 0.781723553314805, + 0.0, + 0.0, + 0.0801653228700161, + 0.4536399133503437, + 1.0323165785521269, + 0.9506030939519405, + 0.21029605716466904, + 0.08372439071536064, + 0.32737114652991295, + 0.08716994151473045, + 0.18649956211447716, + 0.0, + 0.2414364293217659, + 0.0, + 0.40935580618679523, + 0.7372428327798843, + 0.10278131999075413, + 0.3191508799791336, + 0.7837618514895439, + 0.0, + 0.058196065947413445, + 0.0, + 0.43847955018281937, + 0.05364420264959335, + 0.6722168326377869, + 0.9397938288748264, + 0.45887223817408085, + 1.1759888045489788, + 0.1463112086057663, + 0.5021733976900578, + 0.19771887734532356, + 0.05479772202670574, + 0.9048547707498074, + 0.0, + 0.0, + 0.08091507479548454, + 0.16428892128169537, + 0.3762524574995041, + 0.6144751030951738, + 0.0, + 0.0, + 0.4767943248152733, + 0.0, + 0.2189637664705515, + 0.13089340180158615, + 0.6535571925342083, + 1.012776616960764, + 0.033465467393398285, + 1.0667667426168919, + 0.4092234820127487, + 0.5412578154355288, + 1.033425536006689, + 0.5617912597954273, + 2.8669252395629883, + 0.5825144425034523, + 0.509948369115591, + 0.240671094506979, + 0.063341049477458, + 0.7542448006570339, + 0.08109110966324806, + 0.0, + 0.04277533292770386, + 0.35099636018276215 + ], + "unique_experts": 52, + "load_cv": 0.8455534162042236, + "normalized_load_entropy": 0.9040962004638932, + "max_load_share": 0.05649717514124294 + } + }, + "s1_period": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "51a605ef1b081f667b9b101d049fa3372bb4b2688255cb6944c9667155c28453", + "route_weight_sha256": "2544c9b8e1aaced3d06185ab2a09f29f8319c9fe876bc9f87be9bb2cbc7e36f6", + "loads": [ + 0, + 0, + 0, + 1, + 5, + 0, + 9, + 2, + 2, + 0, + 1, + 1, + 0, + 5, + 0, + 5, + 15, + 3, + 1, + 5, + 0, + 2, + 0, + 0, + 1, + 6, + 11, + 0, + 1, + 2, + 5, + 0, + 1, + 0, + 0, + 0, + 4, + 3, + 4, + 8, + 0, + 0, + 9, + 0, + 4, + 3, + 4, + 7, + 1, + 11, + 3, + 1, + 7, + 1, + 22, + 4, + 8, + 4, + 0, + 5, + 2, + 0, + 1, + 4 + ], + "weighted_loads": [ + 0.0, + 0.0, + 0.0, + 0.04158518463373184, + 0.39249373599886894, + 0.0, + 0.9152177534997463, + 0.06966348737478256, + 0.08230920135974884, + 0.0, + 0.019943956285715103, + 0.030665038153529167, + 0.0, + 0.24451132118701935, + 0.0, + 0.2999679110944271, + 0.737093448638916, + 0.09582767263054848, + 0.045851223170757294, + 0.6017414517700672, + 0.0, + 0.05609924905002117, + 0.0, + 0.0, + 0.0310511514544487, + 0.4481397420167923, + 0.6188931576907635, + 0.0, + 0.036790572106838226, + 0.10578194633126259, + 0.32795095816254616, + 0.0, + 0.02431759610772133, + 0.0, + 0.0, + 0.0, + 0.1468903347849846, + 0.09605562128126621, + 0.2483532316982746, + 0.48702912777662277, + 0.0, + 0.0, + 0.5060352943837643, + 0.0, + 0.11884090304374695, + 0.11106411181390285, + 0.24940067529678345, + 0.8411882519721985, + 0.0344478003680706, + 1.0067291893064976, + 0.13372503593564034, + 0.03305782750248909, + 0.33261243253946304, + 0.04132268577814102, + 2.9179710280150175, + 0.2666904032230377, + 0.5600592885166407, + 0.1936633475124836, + 0.0, + 0.2237523552030325, + 0.07479476369917393, + 0.0, + 0.04460960254073143, + 0.2769193910062313 + ], + "unique_experts": 44, + "load_cv": 1.2730006147552495, + "normalized_load_entropy": 0.83154218367128, + "max_load_share": 0.10784313725490197 + }, + "full_input": { + "tokens": 75, + "top_k": 6, + "decisions": 450, + "ordered_route_sha256": "b61b6eafc46594895a238e3fccf6de0405d8a1db9bbbfbae24806c61fb61efe9", + "route_weight_sha256": "bfdcd02c9ab35c278d8f8ea47ead4e028046eb15f063715ef57e9d48ab9f4a84", + "loads": [ + 7, + 1, + 0, + 2, + 9, + 17, + 9, + 7, + 4, + 11, + 1, + 4, + 6, + 5, + 0, + 8, + 15, + 3, + 7, + 10, + 2, + 5, + 0, + 9, + 7, + 11, + 17, + 7, + 13, + 3, + 10, + 4, + 3, + 10, + 1, + 1, + 4, + 7, + 6, + 10, + 0, + 0, + 10, + 1, + 6, + 3, + 9, + 11, + 3, + 12, + 19, + 4, + 15, + 13, + 24, + 7, + 9, + 6, + 1, + 24, + 5, + 1, + 3, + 8 + ], + "weighted_loads": [ + 0.7666410487145185, + 0.05065322667360306, + 0.0, + 0.08528202772140503, + 0.6416161991655827, + 1.1759873200207949, + 0.9152177534997463, + 0.3156047984957695, + 0.24713274091482162, + 0.7523595318198204, + 0.019943956285715103, + 0.2475756611675024, + 0.39396440982818604, + 0.24451132118701935, + 0.0, + 0.4388260804116726, + 0.737093448638916, + 0.09582767263054848, + 0.5108886528760195, + 0.9196618627756834, + 0.23273877799510956, + 0.15727243945002556, + 0.0, + 0.38744519278407097, + 0.3066975977271795, + 0.719645457342267, + 1.0363050997257233, + 0.3422102853655815, + 1.5147474966943264, + 0.15439561754465103, + 0.5779938586056232, + 0.1569090262055397, + 0.10485602170228958, + 1.3537390641868114, + 0.04824246093630791, + 0.0802900567650795, + 0.1468903347849846, + 0.5468626897782087, + 0.38992900028824806, + 0.6505891941487789, + 0.0, + 0.0, + 0.5582934506237507, + 0.04622427746653557, + 0.18083750270307064, + 0.11106411181390285, + 0.6070204675197601, + 0.996573792770505, + 0.16107219457626343, + 1.04778316244483, + 1.152956422418356, + 0.4752112776041031, + 1.162832222878933, + 0.8928267396986485, + 3.0009380001574755, + 0.5587837286293507, + 0.6099287811666727, + 0.2780899479985237, + 0.1094711571931839, + 1.2954491283744574, + 0.32436477579176426, + 0.04125838354229927, + 0.14710525050759315, + 0.44115592166781425 + ], + "unique_experts": 59, + "load_cv": 0.7882470002057308, + "normalized_load_entropy": 0.9230145426843739, + "max_load_share": 0.05333333333333334 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 34, + "ordered_topk_exact_tokens": 24, + "set_exact_tokens": 26, + "mean_set_jaccard": 0.9327731092436974, + "mean_token_weighted_tv": 0.013551687246517223, + "aggregate_load_tv": 0.03431372549019608 + }, + "system_bos": { + "tokens": 34, + "ordered_topk_exact_tokens": 19, + "set_exact_tokens": 24, + "mean_set_jaccard": 0.9159663865546218, + "mean_token_weighted_tv": 0.015540922608445673, + "aggregate_load_tv": 0.03921568627450981 + }, + "system_x": { + "tokens": 34, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.8676470588235294, + "mean_token_weighted_tv": 0.023216645479859674, + "aggregate_load_tv": 0.06372549019607845 + }, + "system_period": { + "tokens": 34, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 20, + "mean_set_jaccard": 0.8823529411764707, + "mean_token_weighted_tv": 0.022691547185839975, + "aggregate_load_tv": 0.05882352941176471 + }, + "bos_at_s0": { + "tokens": 34, + "ordered_topk_exact_tokens": 20, + "set_exact_tokens": 24, + "mean_set_jaccard": 0.9159663865546219, + "mean_token_weighted_tv": 0.01973359182696132, + "aggregate_load_tv": 0.044117647058823525 + }, + "bos_at_s1": { + "tokens": 34, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.8613445378151261, + "mean_token_weighted_tv": 0.025761900332701558, + "aggregate_load_tv": 0.058823529411764705 + }, + "x_at_s0": { + "tokens": 34, + "ordered_topk_exact_tokens": 21, + "set_exact_tokens": 25, + "mean_set_jaccard": 0.9117647058823529, + "mean_token_weighted_tv": 0.019800963126780355, + "aggregate_load_tv": 0.03431372549019608 + }, + "x_at_s1": { + "tokens": 34, + "ordered_topk_exact_tokens": 16, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.8508403361344539, + "mean_token_weighted_tv": 0.028457797926795834, + "aggregate_load_tv": 0.06862745098039216 + }, + "period_at_s0": { + "tokens": 34, + "ordered_topk_exact_tokens": 24, + "set_exact_tokens": 27, + "mean_set_jaccard": 0.934873949579832, + "mean_token_weighted_tv": 0.017973972073591808, + "aggregate_load_tv": 0.029411764705882353 + }, + "period_at_s1": { + "tokens": 34, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.8508403361344539, + "mean_token_weighted_tv": 0.02823114540318356, + "aggregate_load_tv": 0.06862745098039215 + } + } + }, + "layer_15": { + "layer": 15, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "50a1bdc0d952db7a934c65862520d474c8d1fccfae7257d1758c2bf0714e9773", + "route_weight_sha256": "196e96e903e3845da5aaebe6ca30c06c9a03f96ab718dbd5e6efad1ce2f6114f", + "loads": [ + 0, + 0, + 1, + 17, + 1, + 1, + 0, + 9, + 0, + 0, + 9, + 0, + 8, + 2, + 3, + 0, + 0, + 1, + 0, + 5, + 0, + 2, + 0, + 3, + 3, + 6, + 1, + 7, + 5, + 0, + 6, + 4, + 4, + 8, + 2, + 3, + 5, + 3, + 2, + 3, + 3, + 0, + 3, + 3, + 3, + 1, + 0, + 9, + 0, + 0, + 5, + 0, + 8, + 9, + 1, + 1, + 4, + 2, + 6, + 13, + 0, + 2, + 4, + 3 + ], + "weighted_loads": [ + 0.0, + 0.0, + 0.03095903992652893, + 0.663200706243515, + 0.035580556839704514, + 0.04353208839893341, + 0.0, + 0.35519666597247124, + 0.0, + 0.0, + 1.299820952117443, + 0.0, + 0.5546888262033463, + 0.14022813737392426, + 0.10256502032279968, + 0.0, + 0.0, + 0.031045854091644287, + 0.0, + 0.28791791945695877, + 0.0, + 0.12340370193123817, + 0.0, + 0.1596289649605751, + 0.12183215841650963, + 0.4319584406912327, + 0.02839103899896145, + 0.4582180827856064, + 0.18403750658035278, + 0.0, + 0.21911364048719406, + 0.13377027213573456, + 0.1768757440149784, + 0.46461096592247486, + 0.09860194846987724, + 0.09859492629766464, + 0.23863092437386513, + 0.17195935174822807, + 0.07780454680323601, + 0.12317916378378868, + 0.104864951223135, + 0.0, + 0.14065967500209808, + 0.14754718355834484, + 0.14295680075883865, + 0.048640038818120956, + 0.0, + 0.6564736254513264, + 0.0, + 0.0, + 0.21673054620623589, + 0.0, + 1.032183825969696, + 0.5087847877293825, + 0.03301141411066055, + 0.030995076522231102, + 0.19486180320382118, + 0.23580636829137802, + 0.5534197129309177, + 0.7801461964845657, + 0.0, + 0.198063462972641, + 0.25008535757660866, + 0.1837308071553707 + ], + "unique_experts": 46, + "load_cv": 1.0922466256631729, + "normalized_load_entropy": 0.8599197313596753, + "max_load_share": 0.08333333333333333 + }, + "full_input": { + "tokens": 59, + "top_k": 6, + "decisions": 354, + "ordered_route_sha256": "c5d4f0fbae0e869b9a364b570462c3bf678469cee8da39b3e8bc43f8d92eb996", + "route_weight_sha256": "cb5b9475e27113e018912dfab07dad47e6c63ce749cd7460f44756740842174f", + "loads": [ + 3, + 0, + 1, + 17, + 6, + 4, + 8, + 11, + 3, + 1, + 14, + 1, + 14, + 3, + 13, + 1, + 7, + 3, + 0, + 6, + 0, + 2, + 0, + 8, + 7, + 7, + 11, + 7, + 9, + 0, + 10, + 4, + 9, + 10, + 2, + 3, + 10, + 3, + 3, + 3, + 9, + 1, + 3, + 6, + 3, + 1, + 0, + 11, + 1, + 8, + 9, + 2, + 15, + 9, + 1, + 6, + 4, + 2, + 7, + 14, + 0, + 4, + 5, + 9 + ], + "weighted_loads": [ + 0.09618605300784111, + 0.0, + 0.03095903992652893, + 0.663200706243515, + 0.49061788246035576, + 0.11646530870348215, + 0.6362254023551941, + 0.41998834908008575, + 0.2518307529389858, + 0.03152821213006973, + 1.4937708768993616, + 0.030252840369939804, + 1.0475805029273033, + 0.1720753163099289, + 0.46908016223460436, + 0.035746876150369644, + 0.6427658572793007, + 0.09840204939246178, + 0.0, + 0.3539510667324066, + 0.0, + 0.12340370193123817, + 0.0, + 0.4411691091954708, + 0.2100783376954496, + 0.460398618131876, + 0.6768050622195005, + 0.4582180827856064, + 0.332088690251112, + 0.0, + 0.3944130167365074, + 0.13377027213573456, + 0.5960009209811687, + 0.5620139967650175, + 0.09860194846987724, + 0.09859492629766464, + 0.9663853468373418, + 0.17195935174822807, + 0.10911509022116661, + 0.12317916378378868, + 0.3933660569600761, + 0.00425106193870306, + 0.14065967500209808, + 0.27336216904222965, + 0.14295680075883865, + 0.048640038818120956, + 0.0, + 0.7623623348772526, + 0.013507796451449394, + 1.5528564378619194, + 0.4034917876124382, + 0.08802806586027145, + 1.5104548782110214, + 0.5087847877293825, + 0.03301141411066055, + 1.7367572914808989, + 0.19486180320382118, + 0.23580636829137802, + 0.6023751012980938, + 0.8587019369006157, + 0.0, + 0.3048339672386646, + 0.28321026638150215, + 0.4372576791793108 + ], + "unique_experts": 57, + "load_cv": 0.7976912966610232, + "normalized_load_entropy": 0.915714425756503, + "max_load_share": 0.0480225988700565 + } + }, + "s1_eos": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "99d46728432c6db637c00c9bdf5b3f4b788cf0c0bba6eb86d0caafad74c454e0", + "route_weight_sha256": "04c43aca4a03793701dd6f976abd9d1f9ebd4d7db03ed81366a02829f36f4521", + "loads": [ + 0, + 0, + 1, + 18, + 1, + 1, + 0, + 8, + 0, + 0, + 9, + 0, + 8, + 2, + 3, + 0, + 0, + 1, + 0, + 5, + 0, + 2, + 0, + 3, + 3, + 6, + 1, + 7, + 5, + 0, + 6, + 3, + 4, + 8, + 2, + 3, + 5, + 4, + 2, + 2, + 2, + 0, + 2, + 5, + 3, + 1, + 0, + 9, + 0, + 0, + 5, + 0, + 8, + 9, + 1, + 0, + 5, + 2, + 7, + 13, + 0, + 2, + 4, + 3 + ], + "weighted_loads": [ + 0.0, + 0.0, + 0.03036300092935562, + 0.7025637533515692, + 0.039681144058704376, + 0.04266921430826187, + 0.0, + 0.32889399491250515, + 0.0, + 0.0, + 1.3048494160175323, + 0.0, + 0.5601284839212894, + 0.14537257701158524, + 0.10193409770727158, + 0.0, + 0.0, + 0.029713686555624008, + 0.0, + 0.2917008623480797, + 0.0, + 0.124032411724329, + 0.0, + 0.1715468280017376, + 0.11999824643135071, + 0.42895568162202835, + 0.02938329428434372, + 0.45069602504372597, + 0.17664065025746822, + 0.0, + 0.2172977402806282, + 0.10259657725691795, + 0.18304351344704628, + 0.4529333543032408, + 0.10277540609240532, + 0.09888043068349361, + 0.23199104517698288, + 0.2076740488409996, + 0.08224140852689743, + 0.08719723671674728, + 0.06805123016238213, + 0.0, + 0.10340942814946175, + 0.2068602629005909, + 0.14156977273523808, + 0.051829785108566284, + 0.0, + 0.6569566987454891, + 0.0, + 0.0, + 0.22797474265098572, + 0.0, + 1.016892433166504, + 0.4934349190443754, + 0.03152993693947792, + 0.0, + 0.22828929498791695, + 0.23979401588439941, + 0.5905503537505865, + 0.79530094191432, + 0.0, + 0.1943569779396057, + 0.24521777406334877, + 0.1795995607972145 + ], + "unique_experts": 45, + "load_cv": 1.1200524511253116, + "normalized_load_entropy": 0.8538871356880894, + "max_load_share": 0.08823529411764706 + }, + "full_input": { + "tokens": 75, + "top_k": 6, + "decisions": 450, + "ordered_route_sha256": "7370234698e5ea982420effce16324cc0965a91e27c8fb223e4fc3c95b6cce60", + "route_weight_sha256": "c94280473c1fc907b9fc7236441539c585ae05d30bf17c477e458c0ed3eb6820", + "loads": [ + 19, + 1, + 1, + 18, + 8, + 6, + 13, + 9, + 9, + 1, + 14, + 5, + 15, + 3, + 9, + 10, + 12, + 5, + 1, + 8, + 1, + 3, + 0, + 8, + 4, + 7, + 11, + 9, + 11, + 1, + 12, + 7, + 9, + 10, + 4, + 3, + 12, + 4, + 4, + 3, + 8, + 2, + 2, + 7, + 3, + 2, + 0, + 11, + 3, + 12, + 12, + 2, + 11, + 10, + 1, + 6, + 5, + 8, + 9, + 18, + 0, + 11, + 7, + 10 + ], + "weighted_loads": [ + 1.1712595373392105, + 0.026864785701036453, + 0.03036300092935562, + 0.7025637533515692, + 0.5873290747404099, + 0.249957375228405, + 1.0612841434776783, + 0.362323185428977, + 0.4855985511094332, + 0.030964476987719536, + 1.5376118570566177, + 0.37836543656885624, + 1.1532160509377718, + 0.22787800431251526, + 0.3107519941404462, + 0.6603249842301011, + 1.1188028007745743, + 0.1932634525001049, + 0.052798643708229065, + 0.5157035235315561, + 0.029031595215201378, + 0.2064901851117611, + 0.0, + 0.4115706719458103, + 0.12365246610715985, + 0.457386901602149, + 0.7358154505491257, + 0.5722601749002934, + 0.6020247805863619, + 0.03800554573535919, + 0.4462504256516695, + 0.5431144461035728, + 0.5778324902057648, + 0.5674150865525007, + 0.2515902891755104, + 0.09888043068349361, + 0.973130508325994, + 0.2076740488409996, + 0.14636695384979248, + 0.12313984334468842, + 0.3114118648227304, + 0.09134507272392511, + 0.10340942814946175, + 0.48003360256552696, + 0.14156977273523808, + 0.0916018933057785, + 0.0, + 0.7637782953679562, + 0.1436628419905901, + 2.393866825848818, + 0.5210844613611698, + 0.0729406327009201, + 1.368253318592906, + 0.6250057052820921, + 0.03152993693947792, + 1.7319711614400148, + 0.22828929498791695, + 0.9002894014120102, + 0.673193896189332, + 1.0517794899642467, + 0.0, + 0.6559106707572937, + 0.40385014563798904, + 0.4279194241389632 + ], + "unique_experts": 61, + "load_cv": 0.6769430196492552, + "normalized_load_entropy": 0.9381326932804774, + "max_load_share": 0.042222222222222223 + } + }, + "s0_bos": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "a4327b4fae0c20e3dcd31b3a36f0478916daecb096027637864cba0d05ed13c2", + "route_weight_sha256": "155c96f82304c7c0707aa7e2de218fbf0a56129b0b7d70b2fb18c44654d46a48", + "loads": [ + 0, + 0, + 1, + 17, + 1, + 1, + 0, + 7, + 0, + 0, + 9, + 0, + 8, + 2, + 3, + 1, + 0, + 1, + 0, + 5, + 0, + 2, + 0, + 4, + 3, + 5, + 1, + 7, + 3, + 0, + 6, + 4, + 4, + 8, + 2, + 4, + 5, + 4, + 2, + 2, + 2, + 1, + 3, + 4, + 2, + 1, + 0, + 9, + 0, + 0, + 4, + 0, + 8, + 10, + 1, + 1, + 4, + 2, + 6, + 14, + 0, + 2, + 5, + 3 + ], + "weighted_loads": [ + 0.0, + 0.0, + 0.03186774626374245, + 0.6648789867758751, + 0.038238175213336945, + 0.038449373096227646, + 0.0, + 0.2813461758196354, + 0.0, + 0.0, + 1.2929019182920456, + 0.0, + 0.5601578615605831, + 0.14254146814346313, + 0.11423016339540482, + 0.02758360095322132, + 0.0, + 0.030740099027752876, + 0.0, + 0.2938486784696579, + 0.0, + 0.13262134045362473, + 0.0, + 0.19902056828141212, + 0.12757637724280357, + 0.38536337018013, + 0.02913067676126957, + 0.4618995822966099, + 0.1222144365310669, + 0.0, + 0.21406507305800915, + 0.13583129085600376, + 0.18029315397143364, + 0.4837117027491331, + 0.10972121357917786, + 0.1244690902531147, + 0.2481943592429161, + 0.20421425625681877, + 0.0773155502974987, + 0.09319660812616348, + 0.07208215072751045, + 0.029687922447919846, + 0.14035119488835335, + 0.17772181704640388, + 0.10506469011306763, + 0.049871690571308136, + 0.0, + 0.6517461277544498, + 0.0, + 0.0, + 0.19111578166484833, + 0.0, + 0.9636583812534809, + 0.5413733776658773, + 0.03161199763417244, + 0.03354893624782562, + 0.19361549615859985, + 0.23265959322452545, + 0.5565887317061424, + 0.8079955615103245, + 0.0, + 0.18895195424556732, + 0.29650675132870674, + 0.18632572144269943 + ], + "unique_experts": 48, + "load_cv": 1.0936537072458308, + "normalized_load_entropy": 0.864028989584365, + "max_load_share": 0.08333333333333333 + }, + "full_input": { + "tokens": 59, + "top_k": 6, + "decisions": 354, + "ordered_route_sha256": "2089a662667e3fc4f56356770a64b80e36133e48191a97f2b0043ed4c600a1da", + "route_weight_sha256": "4cd6b0a43d60d78cbbe00abe3a23fa4ed53f749320e2a09eb955c283176174be", + "loads": [ + 4, + 0, + 1, + 18, + 5, + 4, + 8, + 9, + 2, + 1, + 14, + 2, + 14, + 3, + 12, + 2, + 7, + 3, + 0, + 6, + 0, + 2, + 0, + 9, + 5, + 6, + 11, + 7, + 7, + 0, + 10, + 4, + 9, + 10, + 2, + 5, + 10, + 4, + 3, + 2, + 9, + 1, + 3, + 7, + 2, + 1, + 0, + 11, + 1, + 8, + 9, + 3, + 15, + 10, + 3, + 3, + 4, + 2, + 7, + 15, + 0, + 4, + 6, + 9 + ], + "weighted_loads": [ + 0.1679998841136694, + 0.0, + 0.03186774626374245, + 0.6976278945803642, + 0.4295191392302513, + 0.14859511516988277, + 0.5840580463409424, + 0.3461378589272499, + 0.20754152163863182, + 0.03152821213006973, + 1.4868518430739641, + 0.07218669354915619, + 1.068188589066267, + 0.17536307126283646, + 0.47069229930639267, + 0.06333047710359097, + 0.6625393070280552, + 0.09809629432857037, + 0.0, + 0.35988182574510574, + 0.0, + 0.13262134045362473, + 0.0, + 0.48056071251630783, + 0.1818002052605152, + 0.4138035476207733, + 0.6775446999818087, + 0.4618995822966099, + 0.2702656202018261, + 0.0, + 0.3893644493073225, + 0.13583129085600376, + 0.599418330937624, + 0.5811147335916758, + 0.10972121357917786, + 0.22709090635180473, + 0.9990482935681939, + 0.20421425625681877, + 0.1086260937154293, + 0.09319660812616348, + 0.4503970257937908, + 0.029687922447919846, + 0.14035119488835335, + 0.30368325859308243, + 0.10506469011306763, + 0.049871690571308136, + 0.0, + 0.7652590088546276, + 0.013507796451449394, + 1.499892197549343, + 0.47935700602829456, + 0.1354878507554531, + 1.3973085759207606, + 0.5413733776658773, + 0.1354403831064701, + 0.672910138964653, + 0.19361549615859985, + 0.23265959322452545, + 0.6055441200733185, + 0.8875733204185963, + 0.0, + 0.29120955616235733, + 0.34118514880537987, + 0.4564257487654686 + ], + "unique_experts": 57, + "load_cv": 0.7931969993508033, + "normalized_load_entropy": 0.918352663984014, + "max_load_share": 0.05084745762711865 + } + }, + "s1_bos": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "a228406ae92e674f32340d3fef04116d2f3e2a8525cb078b0108d221d5c4299c", + "route_weight_sha256": "ee8974a3073d175c4bccd3aad6192b46dba7671aa2df946b7f1b1dc72b42be65", + "loads": [ + 0, + 0, + 0, + 16, + 1, + 1, + 0, + 7, + 1, + 0, + 10, + 0, + 8, + 2, + 3, + 0, + 0, + 2, + 0, + 5, + 0, + 2, + 0, + 4, + 3, + 5, + 1, + 7, + 3, + 0, + 6, + 3, + 3, + 7, + 2, + 3, + 5, + 4, + 1, + 2, + 3, + 0, + 3, + 6, + 3, + 1, + 0, + 9, + 0, + 0, + 4, + 0, + 8, + 10, + 1, + 1, + 5, + 2, + 7, + 14, + 0, + 2, + 5, + 3 + ], + "weighted_loads": [ + 0.0, + 0.0, + 0.0, + 0.6225339379161596, + 0.041985515505075455, + 0.035486456006765366, + 0.0, + 0.2735049817711115, + 0.03241700306534767, + 0.0, + 1.3370903804898262, + 0.0, + 0.556968979537487, + 0.15205300599336624, + 0.11142558977007866, + 0.0, + 0.0, + 0.0612489040941, + 0.0, + 0.290124524384737, + 0.0, + 0.13250087201595306, + 0.0, + 0.20682470500469208, + 0.12054597958922386, + 0.3992388993501663, + 0.03143109753727913, + 0.45789654180407524, + 0.112270163372159, + 0.0, + 0.21710987575352192, + 0.10273651406168938, + 0.145265381783247, + 0.4489520974457264, + 0.11120910942554474, + 0.09632967412471771, + 0.2449556589126587, + 0.2088480107486248, + 0.044404417276382446, + 0.09031514823436737, + 0.10955191031098366, + 0.0, + 0.13572446256875992, + 0.2410863321274519, + 0.13690652698278427, + 0.051149945706129074, + 0.0, + 0.6445123441517353, + 0.0, + 0.0, + 0.18446457386016846, + 0.0, + 0.976131945848465, + 0.5376616567373276, + 0.030306559056043625, + 0.03298287093639374, + 0.22611166164278984, + 0.22559981048107147, + 0.5879801511764526, + 0.8177080042660236, + 0.0, + 0.19562920182943344, + 0.2909175604581833, + 0.18806453049182892 + ], + "unique_experts": 46, + "load_cv": 1.0936537072458308, + "normalized_load_entropy": 0.8592167881720304, + "max_load_share": 0.0784313725490196 + }, + "full_input": { + "tokens": 75, + "top_k": 6, + "decisions": 450, + "ordered_route_sha256": "4399e287fba953c81fcd792ef066ee63edb3f3281055e9a3438687abc1a71f3a", + "route_weight_sha256": "f10a43bde528a00884628a692c4e22716a28a09937a32535ea2efe0d7b4d6944", + "loads": [ + 20, + 1, + 0, + 17, + 8, + 6, + 13, + 8, + 8, + 1, + 15, + 5, + 15, + 4, + 8, + 10, + 12, + 6, + 1, + 8, + 1, + 3, + 0, + 9, + 4, + 6, + 11, + 9, + 9, + 1, + 13, + 7, + 8, + 9, + 4, + 3, + 13, + 4, + 3, + 3, + 9, + 1, + 3, + 8, + 3, + 2, + 0, + 11, + 3, + 12, + 12, + 2, + 12, + 11, + 1, + 5, + 5, + 8, + 9, + 19, + 0, + 11, + 8, + 9 + ], + "weighted_loads": [ + 1.2484859935939312, + 0.026864785701036453, + 0.0, + 0.6557339485734701, + 0.5110878758132458, + 0.27994546853005886, + 0.9762574546039104, + 0.30693417228758335, + 0.4397523980587721, + 0.030964476987719536, + 1.5698528215289116, + 0.3772203419357538, + 1.1649504695087671, + 0.26552421785891056, + 0.3087219223380089, + 0.6603249842301011, + 1.1404135301709175, + 0.2247986700385809, + 0.052798643708229065, + 0.5141271855682135, + 0.029031595215201378, + 0.21495864540338516, + 0.0, + 0.4468485489487648, + 0.1721131168305874, + 0.427670119330287, + 0.7378632538020611, + 0.5794606916606426, + 0.5376542937010527, + 0.03800554573535919, + 0.49504387006163597, + 0.5432543829083443, + 0.5400543585419655, + 0.5634338296949863, + 0.2600239925086498, + 0.09632967412471771, + 1.0405028937384486, + 0.2088480107486248, + 0.1085299625992775, + 0.1262577548623085, + 0.4886344224214554, + 0.08713863044977188, + 0.13572446256875992, + 0.514259671792388, + 0.13690652698278427, + 0.0909220539033413, + 0.0, + 0.755846980959177, + 0.1436628419905901, + 2.350521069020033, + 0.5414609108120203, + 0.0729406327009201, + 1.3118264051154256, + 0.6692324429750443, + 0.030306559056043625, + 0.7934439964592457, + 0.22611166164278984, + 0.8860951960086823, + 0.6706236936151981, + 1.074704322963953, + 0.0, + 0.6566326059401035, + 0.4545079842209816, + 0.4444771781563759 + ], + "unique_experts": 60, + "load_cv": 0.6930911257850407, + "normalized_load_entropy": 0.9350110835249047, + "max_load_share": 0.044444444444444446 + } + }, + "s0_x": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "7386ad2c14f5dc143dd00600615dfbfd6345d5d572202b26bde62b35b636e21a", + "route_weight_sha256": "61811df41b212996ad01bc065be63b8e4dc670328c80ddea4607ddc7662cf24f", + "loads": [ + 1, + 0, + 1, + 18, + 1, + 1, + 0, + 8, + 1, + 0, + 10, + 0, + 8, + 2, + 3, + 0, + 0, + 1, + 0, + 5, + 0, + 2, + 0, + 4, + 2, + 6, + 1, + 7, + 3, + 0, + 6, + 2, + 3, + 7, + 2, + 4, + 5, + 3, + 2, + 2, + 2, + 0, + 3, + 5, + 3, + 1, + 0, + 10, + 1, + 0, + 5, + 0, + 9, + 10, + 1, + 1, + 4, + 2, + 6, + 11, + 0, + 2, + 4, + 3 + ], + "weighted_loads": [ + 0.03414725884795189, + 0.0, + 0.03200878947973251, + 0.7191193215548992, + 0.03381074219942093, + 0.03345894813537598, + 0.0, + 0.31368788331747055, + 0.029809044674038887, + 0.0, + 1.2692613191902637, + 0.0, + 0.5394938662648201, + 0.14646340161561966, + 0.10387234017252922, + 0.0, + 0.0, + 0.03064119815826416, + 0.0, + 0.2641715630888939, + 0.0, + 0.12261354178190231, + 0.0, + 0.1891654059290886, + 0.08608919382095337, + 0.434556744992733, + 0.03154582902789116, + 0.4735308177769184, + 0.11699045076966286, + 0.0, + 0.21367266215384007, + 0.06833228468894958, + 0.1450890302658081, + 0.45475203543901443, + 0.11052847653627396, + 0.13054806552827358, + 0.25041480734944344, + 0.17614230886101723, + 0.07695567235350609, + 0.09376645088195801, + 0.07258733734488487, + 0.0, + 0.14671842753887177, + 0.2068987488746643, + 0.1326967142522335, + 0.049635451287031174, + 0.0, + 0.6876657567918301, + 0.028810439631342888, + 0.0, + 0.22217952087521553, + 0.0, + 1.0672397762537003, + 0.5382832176983356, + 0.03069925867021084, + 0.03191785514354706, + 0.1879693754017353, + 0.22958461940288544, + 0.5486495830118656, + 0.6625061705708504, + 0.0, + 0.2166871577501297, + 0.2549294978380203, + 0.18474924191832542 + ], + "unique_experts": 49, + "load_cv": 1.100662133387152, + "normalized_load_entropy": 0.8646406337720041, + "max_load_share": 0.08823529411764706 + }, + "full_input": { + "tokens": 59, + "top_k": 6, + "decisions": 354, + "ordered_route_sha256": "bda8967870d4aaa550cdb327f8516b19c5a2214d640df718c16416b38e11eab5", + "route_weight_sha256": "b6706dea03c00e734802e07bedf303d10f70c3daf5cd95a6d6dcdce9eab90544", + "loads": [ + 4, + 0, + 1, + 19, + 6, + 2, + 8, + 10, + 4, + 1, + 16, + 2, + 14, + 3, + 12, + 1, + 7, + 3, + 0, + 7, + 0, + 2, + 0, + 10, + 4, + 7, + 12, + 7, + 7, + 0, + 10, + 2, + 8, + 9, + 2, + 4, + 10, + 3, + 3, + 2, + 8, + 0, + 3, + 9, + 3, + 1, + 0, + 12, + 2, + 8, + 9, + 2, + 16, + 10, + 1, + 4, + 4, + 2, + 7, + 12, + 0, + 5, + 5, + 9 + ], + "weighted_loads": [ + 0.14900112338364124, + 0.0, + 0.03200878947973251, + 0.7505476288497448, + 0.4567441940307617, + 0.052202412858605385, + 0.6198151335120201, + 0.37847956642508507, + 0.28488206677138805, + 0.03152821213006973, + 1.5292767714709044, + 0.07383449375629425, + 1.047076866030693, + 0.17978178709745407, + 0.4603344760835171, + 0.035746876150369644, + 0.6648136265575886, + 0.09799739345908165, + 0.0, + 0.3778056725859642, + 0.0, + 0.12261354178190231, + 0.0, + 0.5689987875521183, + 0.140313021838665, + 0.4629969224333763, + 0.7935638688504696, + 0.4735308177769184, + 0.26504163444042206, + 0.0, + 0.3889720384031534, + 0.06833228468894958, + 0.5642142072319984, + 0.5521550662815571, + 0.11052847653627396, + 0.13054806552827358, + 0.9721630336716771, + 0.17614230886101723, + 0.10826621577143669, + 0.09376645088195801, + 0.3765348121523857, + 0.0, + 0.14671842753887177, + 0.41032302007079124, + 0.1326967142522335, + 0.049635451287031174, + 0.0, + 0.7910966388881207, + 0.04231823608279228, + 1.4510386623442173, + 0.4134825188666582, + 0.08802806586027145, + 1.5638979654759169, + 0.5382832176983356, + 0.03069925867021084, + 0.7209386080503464, + 0.1879693754017353, + 0.22958461940288544, + 0.5976049713790417, + 0.740468867123127, + 0.0, + 0.39185716956853867, + 0.2880804091691971, + 0.42182596400380135 + ], + "unique_experts": 56, + "load_cv": 0.8266175815509524, + "normalized_load_entropy": 0.9115158100478528, + "max_load_share": 0.05367231638418079 + } + }, + "s1_x": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "d25d9771b29bae6a5e5947030abb1c5da41abc9d01ad6d383cd67720af7c2937", + "route_weight_sha256": "1b46daf802618f2dc3db2647b26cd622455c197baaba40d229c65e83e1fb6dc9", + "loads": [ + 1, + 0, + 1, + 17, + 2, + 1, + 0, + 7, + 2, + 0, + 10, + 0, + 8, + 2, + 3, + 0, + 0, + 1, + 0, + 6, + 0, + 3, + 0, + 4, + 3, + 6, + 1, + 7, + 3, + 0, + 5, + 2, + 3, + 6, + 2, + 2, + 5, + 3, + 2, + 1, + 2, + 1, + 3, + 5, + 2, + 1, + 1, + 9, + 0, + 0, + 7, + 0, + 8, + 9, + 0, + 1, + 5, + 3, + 7, + 13, + 0, + 2, + 3, + 3 + ], + "weighted_loads": [ + 0.037982597947120667, + 0.0, + 0.03090016171336174, + 0.6650187745690346, + 0.0717091728001833, + 0.03195861354470253, + 0.0, + 0.2839285433292389, + 0.05871178209781647, + 0.0, + 1.3147355169057846, + 0.0, + 0.5292794033885002, + 0.15447400510311127, + 0.1078147292137146, + 0.0, + 0.0, + 0.03037422150373459, + 0.0, + 0.29570799320936203, + 0.0, + 0.16464274004101753, + 0.0, + 0.195876345038414, + 0.11878835409879684, + 0.43546345829963684, + 0.030986562371253967, + 0.4650246985256672, + 0.11328192427754402, + 0.0, + 0.1738489679992199, + 0.07262970134615898, + 0.1468501277267933, + 0.40946631133556366, + 0.10748507082462311, + 0.07793766260147095, + 0.24042661488056183, + 0.17756929993629456, + 0.08146018162369728, + 0.05034703388810158, + 0.07460923865437508, + 0.030751988291740417, + 0.13660994172096252, + 0.19597109407186508, + 0.1033957339823246, + 0.05469280481338501, + 0.03314102068543434, + 0.6385498717427254, + 0.0, + 0.0, + 0.29235625453293324, + 0.0, + 1.0061341114342213, + 0.4980708062648773, + 0.0, + 0.03232358396053314, + 0.21535270288586617, + 0.24456792138516903, + 0.572209931910038, + 0.7698086388409138, + 0.0, + 0.19228483736515045, + 0.21592500060796738, + 0.17938776686787605 + ], + "unique_experts": 49, + "load_cv": 1.0795003614510434, + "normalized_load_entropy": 0.8677953875819315, + "max_load_share": 0.08333333333333333 + }, + "full_input": { + "tokens": 75, + "top_k": 6, + "decisions": 450, + "ordered_route_sha256": "bf73dc1889438f86dbf8854a3036f04590edab46bd9ade34189fdb5de026680d", + "route_weight_sha256": "23815158271b031536cff54ea05b3757aab098d4b3f47e82b3f9042cefc77750", + "loads": [ + 20, + 1, + 1, + 18, + 8, + 5, + 13, + 8, + 11, + 1, + 16, + 4, + 15, + 4, + 8, + 10, + 12, + 5, + 1, + 10, + 1, + 4, + 0, + 10, + 3, + 7, + 12, + 9, + 9, + 1, + 11, + 6, + 9, + 8, + 4, + 2, + 12, + 3, + 4, + 2, + 6, + 2, + 3, + 8, + 2, + 2, + 1, + 11, + 3, + 12, + 14, + 3, + 12, + 10, + 0, + 5, + 5, + 9, + 9, + 18, + 0, + 12, + 6, + 9 + ], + "weighted_loads": [ + 1.2698988541960716, + 0.026864785701036453, + 0.03090016171336174, + 0.6963612698018551, + 0.4261226896196604, + 0.22425335831940174, + 1.0299605578184128, + 0.31735773384571075, + 0.5729910749942064, + 0.030964476987719536, + 1.6016339249908924, + 0.3314542640000582, + 1.121232671663165, + 0.2688377574086189, + 0.3051110617816448, + 0.6603249842301011, + 1.0975519642233849, + 0.19392398744821548, + 0.052798643708229065, + 0.570533974096179, + 0.029031595215201378, + 0.24710051342844963, + 0.0, + 0.5091194361448288, + 0.11878835409879684, + 0.4638946782797575, + 0.8634977862238884, + 0.5865888483822346, + 0.5386660546064377, + 0.03800554573535919, + 0.4028016533702612, + 0.5131475701928139, + 0.5938919894397259, + 0.5239480435848236, + 0.2562999539077282, + 0.07793766260147095, + 0.94645722117275, + 0.17756929993629456, + 0.14558572694659233, + 0.08628964051604271, + 0.31315433233976364, + 0.1178906187415123, + 0.13660994172096252, + 0.6006819754838943, + 0.1033957339823246, + 0.09446491301059723, + 0.03314102068543434, + 0.7397183477878571, + 0.1436628419905901, + 2.2151458747684956, + 0.5630947444587946, + 0.1074746586382389, + 1.3856350891292095, + 0.629641592502594, + 0.0, + 0.7556655816733837, + 0.21535270288586617, + 0.9050633069127798, + 0.6548534743487835, + 1.0209988169372082, + 0.0, + 0.6974606700241566, + 0.3863774314522743, + 0.40655985660851 + ], + "unique_experts": 61, + "load_cv": 0.7048474136600134, + "normalized_load_entropy": 0.9344104458159058, + "max_load_share": 0.044444444444444446 + } + }, + "s0_period": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "4c0bebae95594b07698edb2122815385a4b3ff785f9c2d2875d1d166a5f73e24", + "route_weight_sha256": "415731c85ecf759aa54d061ca92c1191dea837a70818d77dc498bba022b42e8f", + "loads": [ + 1, + 0, + 1, + 19, + 1, + 1, + 0, + 9, + 2, + 0, + 10, + 0, + 8, + 2, + 3, + 0, + 0, + 1, + 0, + 5, + 0, + 2, + 0, + 4, + 2, + 6, + 1, + 7, + 3, + 0, + 6, + 2, + 3, + 7, + 2, + 4, + 5, + 3, + 2, + 2, + 1, + 0, + 3, + 5, + 1, + 1, + 0, + 10, + 1, + 0, + 4, + 0, + 8, + 10, + 1, + 1, + 5, + 2, + 6, + 12, + 0, + 2, + 4, + 3 + ], + "weighted_loads": [ + 0.032335080206394196, + 0.0, + 0.03287218511104584, + 0.7637375369668007, + 0.03790298476815224, + 0.035629794001579285, + 0.0, + 0.34902825951576233, + 0.05490650795400143, + 0.0, + 1.2837730012834072, + 0.0, + 0.5484355911612511, + 0.14641481637954712, + 0.10742614045739174, + 0.0, + 0.0, + 0.02998589165508747, + 0.0, + 0.27313079684972763, + 0.0, + 0.1271764524281025, + 0.0, + 0.18927643448114395, + 0.08645454421639442, + 0.4361715316772461, + 0.031019989401102066, + 0.4708359129726887, + 0.11599988117814064, + 0.0, + 0.20229250378906727, + 0.06882117874920368, + 0.14285416156053543, + 0.4531602803617716, + 0.11114885285496712, + 0.12677141465246677, + 0.25142255052924156, + 0.17324449494481087, + 0.08183037117123604, + 0.09560299292206764, + 0.038412585854530334, + 0.0, + 0.1438799649477005, + 0.20697657763957977, + 0.06332001090049744, + 0.05098817124962807, + 0.0, + 0.6985377185046673, + 0.029114099219441414, + 0.0, + 0.1780799813568592, + 0.0, + 1.0093705914914608, + 0.5481156967580318, + 0.03071863204240799, + 0.03167503699660301, + 0.22673314809799194, + 0.2255406230688095, + 0.5419750399887562, + 0.7131845466792583, + 0.0, + 0.21907513588666916, + 0.25688283890485764, + 0.18482669442892075 + ], + "unique_experts": 49, + "load_cv": 1.1364094220268315, + "normalized_load_entropy": 0.8598506930604463, + "max_load_share": 0.09313725490196079 + }, + "full_input": { + "tokens": 59, + "top_k": 6, + "decisions": 354, + "ordered_route_sha256": "ed80dde10d943b6ec3ff60eef957681e82527b45aacd5cab58a61b7918b1fa7e", + "route_weight_sha256": "5b496f72e7bd4a39ab487639884ab3126c45eecd8916cdbcabb8ffe31369e548", + "loads": [ + 4, + 0, + 1, + 20, + 6, + 2, + 9, + 11, + 6, + 1, + 15, + 3, + 14, + 3, + 12, + 1, + 7, + 3, + 0, + 6, + 0, + 2, + 0, + 10, + 4, + 7, + 12, + 7, + 7, + 0, + 10, + 2, + 8, + 9, + 2, + 4, + 10, + 3, + 3, + 2, + 7, + 0, + 3, + 7, + 1, + 1, + 0, + 12, + 2, + 8, + 8, + 2, + 14, + 10, + 1, + 5, + 5, + 2, + 8, + 13, + 0, + 5, + 5, + 9 + ], + "weighted_loads": [ + 0.15554444305598736, + 0.0, + 0.03287218511104584, + 0.7953066453337669, + 0.49637020006775856, + 0.05437325872480869, + 0.6410820744931698, + 0.41381994262337685, + 0.35668408311903477, + 0.03152821213006973, + 1.4777229260653257, + 0.1007365807890892, + 1.0205606743693352, + 0.17817556858062744, + 0.4638882763683796, + 0.035746876150369644, + 0.6316492184996605, + 0.09734208695590496, + 0.0, + 0.3391639441251755, + 0.0, + 0.1271764524281025, + 0.0, + 0.5581093989312649, + 0.14067837223410606, + 0.4646117091178894, + 0.7224377132952213, + 0.4708359129726887, + 0.26405106484889984, + 0.0, + 0.3775918800383806, + 0.06882117874920368, + 0.5619793385267258, + 0.5505633112043142, + 0.11114885285496712, + 0.12677141465246677, + 1.0199869023635983, + 0.17324449494481087, + 0.11314091458916664, + 0.09560299292206764, + 0.43695593997836113, + 0.0, + 0.1438799649477005, + 0.29100872576236725, + 0.06332001090049744, + 0.05098817124962807, + 0.0, + 0.8022906519472599, + 0.04262189567089081, + 1.511501494795084, + 0.36662300676107407, + 0.08802806586027145, + 1.4675659071654081, + 0.5481156967580318, + 0.03071863204240799, + 0.7675203308463097, + 0.22673314809799194, + 0.2255406230688095, + 0.6434339247643948, + 0.7878853492438793, + 0.0, + 0.4753107577562332, + 0.29369739070534706, + 0.42246172577142715 + ], + "unique_experts": 56, + "load_cv": 0.8216600776987151, + "normalized_load_entropy": 0.9118621348533531, + "max_load_share": 0.05649717514124294 + } + }, + "s1_period": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "22c2dc5c9dcc228f2d576b0c987742f2753c9a2a57db1a08abbf61469721f3ec", + "route_weight_sha256": "c9190ee2594e1a43db596b885a23000e3093b85fa81a8cf4deb40546712040fc", + "loads": [ + 1, + 0, + 1, + 16, + 1, + 1, + 0, + 8, + 2, + 0, + 10, + 0, + 8, + 2, + 3, + 0, + 0, + 1, + 0, + 5, + 0, + 3, + 0, + 4, + 3, + 6, + 1, + 7, + 4, + 0, + 5, + 3, + 4, + 6, + 2, + 2, + 5, + 3, + 2, + 1, + 2, + 0, + 3, + 5, + 2, + 1, + 1, + 9, + 0, + 0, + 7, + 0, + 8, + 9, + 0, + 1, + 4, + 2, + 7, + 13, + 0, + 3, + 4, + 3 + ], + "weighted_loads": [ + 0.03567761555314064, + 0.0, + 0.03185718506574631, + 0.6227082572877407, + 0.04547549784183502, + 0.03316279128193855, + 0.0, + 0.30419539101421833, + 0.05864063277840614, + 0.0, + 1.3061905913054943, + 0.0, + 0.5354206636548042, + 0.1587621346116066, + 0.10478396713733673, + 0.0, + 0.0, + 0.029900845140218735, + 0.0, + 0.28460903465747833, + 0.0, + 0.1611828003078699, + 0.0, + 0.19817722961306572, + 0.11767255887389183, + 0.42261919006705284, + 0.033610712736845016, + 0.47108498960733414, + 0.14351270347833633, + 0.0, + 0.17622313648462296, + 0.10186824947595596, + 0.18190559558570385, + 0.4063025526702404, + 0.11027519404888153, + 0.07418281584978104, + 0.23645689710974693, + 0.17598924413323402, + 0.08500998094677925, + 0.05016137659549713, + 0.07179122045636177, + 0.0, + 0.13955999165773392, + 0.19760351814329624, + 0.10407564043998718, + 0.049793537706136703, + 0.03209490329027176, + 0.6317357495427132, + 0.0, + 0.0, + 0.29474235884845257, + 0.0, + 0.987797923386097, + 0.5019252728670835, + 0.0, + 0.032157719135284424, + 0.18529097363352776, + 0.2160499095916748, + 0.5820072554051876, + 0.7829534895718098, + 0.0, + 0.2474335189908743, + 0.2585287056863308, + 0.19360286742448807 + ], + "unique_experts": 48, + "load_cv": 1.0680426534428489, + "normalized_load_entropy": 0.8662904061802265, + "max_load_share": 0.0784313725490196 + }, + "full_input": { + "tokens": 75, + "top_k": 6, + "decisions": 450, + "ordered_route_sha256": "4a150eb9e53ea1131c4b94e1ce72ff8aea5c3db7e59a0fb4698eadb1d26d5587", + "route_weight_sha256": "e85083c0f25c6bff64e396f255891b37f77ec168b064e12d3bde316f2b2dde3f", + "loads": [ + 21, + 1, + 1, + 17, + 8, + 4, + 13, + 9, + 12, + 1, + 15, + 4, + 15, + 3, + 8, + 11, + 12, + 6, + 1, + 8, + 1, + 4, + 0, + 9, + 3, + 7, + 12, + 9, + 10, + 1, + 11, + 7, + 9, + 10, + 4, + 2, + 12, + 3, + 4, + 2, + 7, + 2, + 3, + 8, + 2, + 2, + 1, + 11, + 3, + 11, + 14, + 2, + 11, + 10, + 0, + 4, + 4, + 8, + 10, + 18, + 0, + 13, + 7, + 9 + ], + "weighted_loads": [ + 1.2958926521241665, + 0.026864785701036453, + 0.03185718506574631, + 0.6554554551839828, + 0.47844158113002777, + 0.1861839685589075, + 1.0698513090610504, + 0.3376245815306902, + 0.5938948821276426, + 0.030964476987719536, + 1.5389530323445797, + 0.3314542640000582, + 1.1077343318611383, + 0.24126756191253662, + 0.30208029970526695, + 0.6968673588708043, + 1.105475589632988, + 0.24395367875695229, + 0.052798643708229065, + 0.5086116958409548, + 0.029031595215201378, + 0.243640573695302, + 0.0, + 0.43820107355713844, + 0.11767255887389183, + 0.4510504100471735, + 0.7919207848608494, + 0.5926491394639015, + 0.56889683380723, + 0.03800554573535919, + 0.40517582185566425, + 0.5423861183226109, + 0.5766945723444223, + 0.5814399868249893, + 0.2590900771319866, + 0.07418281584978104, + 1.0896387798711658, + 0.17598924413323402, + 0.1491355262696743, + 0.08610398322343826, + 0.41471754759550095, + 0.13489577174186707, + 0.13955999165773392, + 0.5202359203249216, + 0.10407564043998718, + 0.08956564590334892, + 0.03209490329027176, + 0.7321537509560585, + 0.1436628419905901, + 2.1789496801793575, + 0.5690019633620977, + 0.0729406327009201, + 1.3167450185865164, + 0.6334960591048002, + 0.0, + 0.7211601249873638, + 0.18529097363352776, + 0.8765452951192856, + 0.7260937541723251, + 1.0284119807183743, + 0.0, + 0.8823981378227472, + 0.4328457936644554, + 0.4223864357918501 + ], + "unique_experts": 61, + "load_cv": 0.711097222086586, + "normalized_load_entropy": 0.9329390348668676, + "max_load_share": 0.04666666666666667 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 34, + "ordered_topk_exact_tokens": 21, + "set_exact_tokens": 28, + "mean_set_jaccard": 0.9495798319327731, + "mean_token_weighted_tv": 0.011220751028946218, + "aggregate_load_tv": 0.029411764705882363 + }, + "system_bos": { + "tokens": 34, + "ordered_topk_exact_tokens": 17, + "set_exact_tokens": 23, + "mean_set_jaccard": 0.9075630252100841, + "mean_token_weighted_tv": 0.01674305447651183, + "aggregate_load_tv": 0.044117647058823525 + }, + "system_x": { + "tokens": 34, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.8424369747899161, + "mean_token_weighted_tv": 0.027026800931814837, + "aggregate_load_tv": 0.06862745098039216 + }, + "system_period": { + "tokens": 34, + "ordered_topk_exact_tokens": 16, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.8676470588235294, + "mean_token_weighted_tv": 0.024298989597488854, + "aggregate_load_tv": 0.06862745098039216 + }, + "bos_at_s0": { + "tokens": 34, + "ordered_topk_exact_tokens": 17, + "set_exact_tokens": 23, + "mean_set_jaccard": 0.9075630252100839, + "mean_token_weighted_tv": 0.01923177528249867, + "aggregate_load_tv": 0.04411764705882354 + }, + "bos_at_s1": { + "tokens": 34, + "ordered_topk_exact_tokens": 16, + "set_exact_tokens": 21, + "mean_set_jaccard": 0.8907563025210085, + "mean_token_weighted_tv": 0.02226647164891748, + "aggregate_load_tv": 0.05392156862745098 + }, + "x_at_s0": { + "tokens": 34, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 20, + "mean_set_jaccard": 0.8760504201680673, + "mean_token_weighted_tv": 0.024874445379656905, + "aggregate_load_tv": 0.058823529411764705 + }, + "x_at_s1": { + "tokens": 34, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 18, + "mean_set_jaccard": 0.8529411764705882, + "mean_token_weighted_tv": 0.028801111148341614, + "aggregate_load_tv": 0.07352941176470588 + }, + "period_at_s0": { + "tokens": 34, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.8676470588235294, + "mean_token_weighted_tv": 0.025670854867819476, + "aggregate_load_tv": 0.06862745098039215 + }, + "period_at_s1": { + "tokens": 34, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 18, + "mean_set_jaccard": 0.865546218487395, + "mean_token_weighted_tv": 0.025640673688886798, + "aggregate_load_tv": 0.05882352941176471 + } + } + }, + "layer_16": { + "layer": 16, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "0dc5749942b409d5b0940bb0487c2a6dc1a8d26f28ff920f8fe71286bc8024c0", + "route_weight_sha256": "9460d190971f399d575b3bb6aa9e9fd2eb6da37a6d49b774ce2458191d2bb22e", + "loads": [ + 3, + 1, + 0, + 3, + 4, + 3, + 13, + 5, + 9, + 3, + 0, + 1, + 0, + 1, + 7, + 3, + 1, + 4, + 7, + 1, + 0, + 11, + 0, + 0, + 0, + 5, + 2, + 1, + 2, + 0, + 2, + 5, + 0, + 0, + 1, + 1, + 8, + 2, + 5, + 0, + 2, + 1, + 5, + 1, + 3, + 5, + 6, + 0, + 1, + 4, + 3, + 16, + 2, + 1, + 1, + 1, + 8, + 3, + 2, + 4, + 9, + 3, + 7, + 2 + ], + "weighted_loads": [ + 0.1640552096068859, + 0.042588766664266586, + 0.0, + 0.13332227990031242, + 0.1281566135585308, + 0.10532566905021667, + 0.5981731247156858, + 0.38098030909895897, + 0.6020443290472031, + 0.11946548707783222, + 0.0, + 0.03035183995962143, + 0.0, + 0.03376293554902077, + 0.43323731422424316, + 0.5801103860139847, + 0.0319410040974617, + 0.358923751860857, + 0.4370555654168129, + 0.036109570413827896, + 0.0, + 1.0837440304458141, + 0.0, + 0.0, + 0.0, + 0.2320510372519493, + 0.07409925013780594, + 0.024324866011738777, + 0.07221795618534088, + 0.0, + 0.05379452183842659, + 0.22647478431463242, + 0.0, + 0.0, + 0.030670298263430595, + 0.06735275685787201, + 0.43068663217127323, + 0.16162879765033722, + 0.3996673747897148, + 0.0, + 0.0740005150437355, + 0.047562845051288605, + 0.33973973989486694, + 0.06060841307044029, + 0.1156282089650631, + 0.3300357758998871, + 0.25789501145482063, + 0.0, + 0.0900728777050972, + 0.1805465016514063, + 0.12162582948803902, + 0.9824505262076855, + 0.10097993165254593, + 0.040509965270757675, + 0.03125445172190666, + 0.022841056808829308, + 0.5977476350963116, + 0.10194803774356842, + 0.06128398887813091, + 0.24680718779563904, + 1.4566750302910805, + 0.1031765267252922, + 0.5813669227063656, + 0.08366405963897705 + ], + "unique_experts": 52, + "load_cv": 1.0447503376280174, + "normalized_load_entropy": 0.8783011412269203, + "max_load_share": 0.0784313725490196 + }, + "full_input": { + "tokens": 59, + "top_k": 6, + "decisions": 354, + "ordered_route_sha256": "555a7db9f158d1eb210311379bd06b78368f6da74eeaf0895f68e153d7f1a76b", + "route_weight_sha256": "25558ed7d189ca6d733899652f37ba66ceb033abcca122a662904a2d812b78c9", + "loads": [ + 3, + 1, + 0, + 3, + 4, + 12, + 17, + 5, + 9, + 5, + 5, + 1, + 0, + 2, + 7, + 10, + 8, + 9, + 13, + 2, + 11, + 13, + 2, + 0, + 7, + 5, + 7, + 1, + 2, + 0, + 4, + 5, + 1, + 7, + 1, + 1, + 8, + 12, + 6, + 0, + 5, + 8, + 8, + 1, + 5, + 7, + 6, + 1, + 1, + 4, + 3, + 18, + 2, + 12, + 1, + 11, + 8, + 4, + 2, + 4, + 13, + 5, + 7, + 9 + ], + "weighted_loads": [ + 0.1640552096068859, + 0.042588766664266586, + 0.0, + 0.13332227990031242, + 0.1281566135585308, + 0.9382195211946964, + 0.7694605719298124, + 0.38098030909895897, + 0.6020443290472031, + 1.4479099083691835, + 0.23459012433886528, + 0.03035183995962143, + 0.0, + 0.05285819247364998, + 0.43323731422424316, + 1.0308441706001759, + 0.39531620778143406, + 0.7931849006563425, + 1.2090677041560411, + 0.03857918386347592, + 0.9615954905748367, + 1.164529025554657, + 0.12779001146554947, + 0.0, + 0.6956347040832043, + 0.2320510372519493, + 0.3582157976925373, + 0.024324866011738777, + 0.07221795618534088, + 0.0, + 0.14634241722524166, + 0.22647478431463242, + 0.03981924429535866, + 0.3741697557270527, + 0.030670298263430595, + 0.06735275685787201, + 0.43068663217127323, + 0.6643425226211548, + 0.4312581308186054, + 0.0, + 0.20747558027505875, + 1.5003897622227669, + 0.46114927530288696, + 0.06060841307044029, + 0.20334356650710106, + 0.46412498503923416, + 0.25789501145482063, + 0.037502020597457886, + 0.0900728777050972, + 0.1805465016514063, + 0.12162582948803902, + 1.0807322524487972, + 0.10097993165254593, + 0.8117591422051191, + 0.03125445172190666, + 0.8157913442701101, + 0.5977476350963116, + 0.1251756027340889, + 0.06128398887813091, + 0.24680718779563904, + 2.0408397167921066, + 0.1493668913608417, + 0.5813669227063656, + 0.4795836405828595 + ], + "unique_experts": 59, + "load_cv": 0.7847821657348789, + "normalized_load_entropy": 0.9211987065601719, + "max_load_share": 0.05084745762711865 + } + }, + "s1_eos": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "2340d67554939787cbb03a28bc3842b4c21e7fc9b0417de8734d8f3a9126ca7e", + "route_weight_sha256": "74c54d85700f3c6c9b60745414e852b41c85c6847fb8ad43854fb0ba1a923839", + "loads": [ + 3, + 1, + 0, + 3, + 4, + 3, + 13, + 5, + 9, + 4, + 0, + 2, + 0, + 1, + 7, + 3, + 1, + 4, + 7, + 1, + 1, + 12, + 0, + 0, + 0, + 5, + 2, + 1, + 1, + 0, + 1, + 4, + 0, + 0, + 1, + 1, + 8, + 2, + 5, + 0, + 2, + 1, + 5, + 2, + 3, + 5, + 6, + 0, + 1, + 4, + 2, + 16, + 2, + 1, + 1, + 0, + 8, + 2, + 2, + 4, + 9, + 3, + 7, + 3 + ], + "weighted_loads": [ + 0.1679885908961296, + 0.040985964238643646, + 0.0, + 0.1326637975871563, + 0.12772452645003796, + 0.10652764141559601, + 0.5921065621078014, + 0.37830958142876625, + 0.5944014079868793, + 0.16428068280220032, + 0.0, + 0.054832905530929565, + 0.0, + 0.03387818858027458, + 0.4444783143699169, + 0.6086935847997665, + 0.035695742815732956, + 0.35909704118967056, + 0.4416388161480427, + 0.03594043105840683, + 0.022646931931376457, + 1.126902051270008, + 0.0, + 0.0, + 0.0, + 0.23521962761878967, + 0.07386155053973198, + 0.024587608873844147, + 0.037108730524778366, + 0.0, + 0.03134657070040703, + 0.17950725182890892, + 0.0, + 0.0, + 0.031124135479331017, + 0.06903007626533508, + 0.4228719212114811, + 0.16140233725309372, + 0.389593955129385, + 0.0, + 0.07607922703027725, + 0.04492679983377457, + 0.3330339156091213, + 0.08910436742007732, + 0.11525008082389832, + 0.3204603921622038, + 0.26202043518424034, + 0.0, + 0.08898463100194931, + 0.1900486946105957, + 0.09157522767782211, + 0.9665914885699749, + 0.09802328050136566, + 0.04110199958086014, + 0.03183160722255707, + 0.0, + 0.5863649249076843, + 0.06424399092793465, + 0.06071140989661217, + 0.23730183579027653, + 1.430753406137228, + 0.10221154801547527, + 0.5778323002159595, + 0.11831751465797424 + ], + "unique_experts": 52, + "load_cv": 1.0564606896489563, + "normalized_load_entropy": 0.8767926553405805, + "max_load_share": 0.0784313725490196 + }, + "full_input": { + "tokens": 75, + "top_k": 6, + "decisions": 450, + "ordered_route_sha256": "8afa9e82572550f762230b5c4621f5d5914ee670a7a58174acfd14ecd814a6ef", + "route_weight_sha256": "3ed2998d22c79d611282eee3fe36fb4486b8e484d24c0775cda5671fe31e5b2a", + "loads": [ + 3, + 4, + 0, + 5, + 4, + 12, + 17, + 6, + 9, + 7, + 7, + 2, + 0, + 5, + 8, + 14, + 10, + 16, + 16, + 3, + 12, + 14, + 2, + 1, + 14, + 5, + 13, + 1, + 1, + 0, + 5, + 4, + 5, + 6, + 2, + 3, + 8, + 11, + 8, + 3, + 6, + 15, + 9, + 4, + 5, + 11, + 7, + 7, + 3, + 8, + 8, + 17, + 2, + 13, + 1, + 11, + 10, + 3, + 2, + 5, + 14, + 4, + 10, + 9 + ], + "weighted_loads": [ + 0.1679885908961296, + 0.1613282822072506, + 0.0, + 0.22311852872371674, + 0.12772452645003796, + 1.0074490122497082, + 0.7986736260354519, + 0.40343734808266163, + 0.5944014079868793, + 1.527605812996626, + 0.23885695077478886, + 0.054832905530929565, + 0.0, + 0.15363370440900326, + 0.4976036958396435, + 1.56303396448493, + 0.40565114095807076, + 1.2780541963875294, + 1.4639806244522333, + 0.07272303150966763, + 0.9666708465665579, + 1.2172674760222435, + 0.08385311812162399, + 0.07640542834997177, + 1.2101884074509144, + 0.23521962761878967, + 1.281387373805046, + 0.024587608873844147, + 0.037108730524778366, + 0.0, + 0.18815195001661777, + 0.17950725182890892, + 0.21914435550570488, + 0.32923777867108583, + 0.06601100228726864, + 0.1955750361084938, + 0.4228719212114811, + 0.6315024476498365, + 0.5467540137469769, + 0.17814069241285324, + 0.23433652892708778, + 2.5182956531643867, + 0.48853546753525734, + 0.17955640144646168, + 0.18322412483394146, + 0.6204655040055513, + 0.2935528866946697, + 0.33135149627923965, + 0.17913220450282097, + 0.3855553977191448, + 0.3508834131062031, + 1.007931474596262, + 0.09802328050136566, + 1.1065809056162834, + 0.03183160722255707, + 0.9311189614236355, + 0.6937729194760323, + 0.0873449295759201, + 0.06071140989661217, + 0.43210319615900517, + 1.988444048911333, + 0.10405273328069597, + 0.9040351808071136, + 0.482766336761415 + ], + "unique_experts": 61, + "load_cv": 0.6708461581474806, + "normalized_load_entropy": 0.9410455184154072, + "max_load_share": 0.03777777777777778 + } + }, + "s0_bos": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "e4343b9e1f0b4e045f0208a1a0b2bc849859a1f0c6dc9eac915f719fe9b10d3a", + "route_weight_sha256": "23992f8935985c48a4518389dca68c3dfa5765cb71c99971423d946ed66f6c87", + "loads": [ + 3, + 1, + 0, + 3, + 4, + 3, + 11, + 5, + 9, + 4, + 0, + 0, + 0, + 1, + 7, + 3, + 1, + 4, + 6, + 1, + 0, + 11, + 0, + 1, + 0, + 5, + 3, + 1, + 1, + 0, + 2, + 5, + 1, + 0, + 1, + 1, + 7, + 2, + 5, + 0, + 2, + 1, + 5, + 2, + 3, + 5, + 6, + 0, + 1, + 4, + 3, + 15, + 3, + 1, + 1, + 0, + 8, + 3, + 1, + 4, + 9, + 3, + 7, + 5 + ], + "weighted_loads": [ + 0.1755639612674713, + 0.039336197078228, + 0.0, + 0.1298113837838173, + 0.13119779340922832, + 0.09427221119403839, + 0.5129317156970501, + 0.38575852662324905, + 0.5914384331554174, + 0.16257306188344955, + 0.0, + 0.0, + 0.0, + 0.035605765879154205, + 0.4197009075433016, + 0.5939825475215912, + 0.03177260980010033, + 0.36242756620049477, + 0.3955936077982187, + 0.03337937965989113, + 0.0, + 1.0918724723160267, + 0.0, + 0.023463895544409752, + 0.0, + 0.23317723348736763, + 0.1163274422287941, + 0.02454167976975441, + 0.03634631261229515, + 0.0, + 0.05764991044998169, + 0.22105548717081547, + 0.029241342097520828, + 0.0, + 0.028014756739139557, + 0.06647522002458572, + 0.3986429776996374, + 0.15625900030136108, + 0.39333663508296013, + 0.0, + 0.0721711553633213, + 0.05154762789607048, + 0.3396979235112667, + 0.09413091838359833, + 0.11895883083343506, + 0.3298632148653269, + 0.2934956066310406, + 0.0, + 0.08757063746452332, + 0.18532326817512512, + 0.12892571464180946, + 0.9203724041581154, + 0.14985234290361404, + 0.03990112990140915, + 0.03081533871591091, + 0.0, + 0.5924257263541222, + 0.09887592867016792, + 0.028942527249455452, + 0.24060304276645184, + 1.4019310846924782, + 0.10937203466892242, + 0.5838273502886295, + 0.17507031746208668 + ], + "unique_experts": 52, + "load_cv": 0.9903416705234815, + "normalized_load_entropy": 0.8844893002267314, + "max_load_share": 0.07352941176470588 + }, + "full_input": { + "tokens": 59, + "top_k": 6, + "decisions": 354, + "ordered_route_sha256": "c47e17138e2a8c3088c8862156a7f077cc91b1dfaf627d9d42e6928b10cb4e5f", + "route_weight_sha256": "5a56f27f60c714ed2be98757ede2003c521682776215a1f4563ebc1f99962d41", + "loads": [ + 3, + 1, + 1, + 3, + 4, + 13, + 15, + 5, + 9, + 6, + 5, + 1, + 1, + 2, + 7, + 10, + 7, + 9, + 12, + 2, + 11, + 13, + 2, + 1, + 6, + 5, + 7, + 1, + 1, + 0, + 4, + 5, + 2, + 6, + 2, + 1, + 7, + 12, + 6, + 0, + 5, + 9, + 8, + 2, + 5, + 7, + 6, + 1, + 1, + 5, + 4, + 17, + 3, + 12, + 1, + 10, + 8, + 4, + 1, + 4, + 12, + 4, + 7, + 10 + ], + "weighted_loads": [ + 0.1755639612674713, + 0.039336197078228, + 0.04276729002594948, + 0.1298113837838173, + 0.13119779340922832, + 0.9644762612879276, + 0.6842191629111767, + 0.38575852662324905, + 0.5914384331554174, + 0.5820300243794918, + 0.23105105943977833, + 0.04106830433011055, + 0.07866401225328445, + 0.05470102280378342, + 0.4197009075433016, + 1.0575496032834053, + 0.8388593215495348, + 0.7968822885304689, + 1.1506189741194248, + 0.06703328713774681, + 0.9615954905748367, + 1.1726574674248695, + 0.12779001146554947, + 0.023463895544409752, + 0.6453250832855701, + 0.23317723348736763, + 0.3422536849975586, + 0.02454167976975441, + 0.03634631261229515, + 0.0, + 0.15019780583679676, + 0.22105548717081547, + 0.06906058639287949, + 0.36857443302869797, + 0.13713274896144867, + 0.06647522002458572, + 0.3986429776996374, + 0.6600837279111147, + 0.4244329072535038, + 0.0, + 0.20444248616695404, + 1.5324257742613554, + 0.45854918472468853, + 0.09413091838359833, + 0.19299246184527874, + 0.47121712006628513, + 0.2934956066310406, + 0.05086426064372063, + 0.08757063746452332, + 0.22992408275604248, + 0.17548317089676857, + 1.0186541303992271, + 0.14985234290361404, + 0.8111503068357706, + 0.03081533871591091, + 0.7929502874612808, + 0.5924257263541222, + 0.12091274186968803, + 0.028942527249455452, + 0.24060304276645184, + 1.8826768770813942, + 0.1537231206893921, + 0.5838273502886295, + 0.48933302983641624 + ], + "unique_experts": 62, + "load_cv": 0.7392067596218168, + "normalized_load_entropy": 0.9316680845204981, + "max_load_share": 0.0480225988700565 + } + }, + "s1_bos": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "3d1d35f758a8527b1f4fb698d053d9d1bdb2feaddab2bb4728273df21fd85af7", + "route_weight_sha256": "f09bc6adec38c5d2155e32b8d660985673698ba158e5e215b26c022070f39e13", + "loads": [ + 3, + 1, + 0, + 3, + 4, + 4, + 12, + 5, + 9, + 4, + 0, + 1, + 0, + 1, + 7, + 3, + 0, + 4, + 8, + 1, + 0, + 11, + 0, + 1, + 1, + 5, + 3, + 1, + 1, + 0, + 1, + 5, + 1, + 0, + 0, + 1, + 6, + 2, + 5, + 0, + 2, + 1, + 5, + 1, + 3, + 5, + 6, + 0, + 2, + 4, + 3, + 16, + 3, + 1, + 2, + 0, + 8, + 2, + 1, + 3, + 8, + 3, + 7, + 4 + ], + "weighted_loads": [ + 0.1840020790696144, + 0.03720177710056305, + 0.0, + 0.13518588244915009, + 0.12936264090240002, + 0.1293887235224247, + 0.5631734449416399, + 0.3668033927679062, + 0.5840267986059189, + 0.16319076530635357, + 0.0, + 0.02720138616859913, + 0.0, + 0.03657371550798416, + 0.436141949146986, + 0.5988447219133377, + 0.0, + 0.3622252307832241, + 0.4553476497530937, + 0.03532581403851509, + 0.0, + 1.1009160280227661, + 0.0, + 0.02472955361008644, + 0.029042212292551994, + 0.22767456620931625, + 0.11467332020401955, + 0.026424109935760498, + 0.03831023722887039, + 0.0, + 0.030826754868030548, + 0.21275653317570686, + 0.03141568973660469, + 0.0, + 0.0, + 0.06637046486139297, + 0.35251475498080254, + 0.15508606284856796, + 0.3851960636675358, + 0.0, + 0.07734418287873268, + 0.049842312932014465, + 0.34030723571777344, + 0.061282411217689514, + 0.11680430546402931, + 0.3234007488936186, + 0.2879165783524513, + 0.0, + 0.1203890759497881, + 0.18079575523734093, + 0.1269998997449875, + 0.9387454185634851, + 0.12897000275552273, + 0.04101337864995003, + 0.05879024416208267, + 0.0, + 0.5814455132931471, + 0.06202836148440838, + 0.02931615151464939, + 0.2154267281293869, + 1.3933166861534119, + 0.10668018646538258, + 0.5747885257005692, + 0.1473696231842041 + ], + "unique_experts": 52, + "load_cv": 1.0194192887494868, + "normalized_load_entropy": 0.8813707497156764, + "max_load_share": 0.0784313725490196 + }, + "full_input": { + "tokens": 75, + "top_k": 6, + "decisions": 450, + "ordered_route_sha256": "0d66d28025f7ba5cc633c4aa9b1041c0aecde94bf5d85f787b1e075843414bf0", + "route_weight_sha256": "9e89bbc4b3e4ed137ea36dfcc688c6826a9a42f6ae77592be0aced191e675165", + "loads": [ + 3, + 4, + 0, + 5, + 4, + 13, + 16, + 6, + 9, + 7, + 7, + 1, + 0, + 5, + 8, + 14, + 9, + 15, + 17, + 1, + 11, + 13, + 2, + 2, + 14, + 5, + 14, + 1, + 1, + 0, + 5, + 5, + 6, + 6, + 2, + 3, + 6, + 11, + 8, + 3, + 6, + 16, + 9, + 3, + 7, + 11, + 7, + 7, + 4, + 9, + 9, + 17, + 3, + 13, + 2, + 11, + 10, + 3, + 1, + 4, + 14, + 3, + 10, + 9 + ], + "weighted_loads": [ + 0.1840020790696144, + 0.15754409506917, + 0.0, + 0.22564061358571053, + 0.12936264090240002, + 1.0203038454055786, + 0.7697405088692904, + 0.39193115942180157, + 0.5840267986059189, + 0.6160817313939333, + 0.23587723076343536, + 0.02720138616859913, + 0.0, + 0.15632923133671284, + 0.48926733061671257, + 1.5591058395802975, + 0.8063352536410093, + 1.2312398925423622, + 1.5112882237881422, + 0.03532581403851509, + 0.9440239146351814, + 1.1912814527750015, + 0.08385311812162399, + 0.10113498196005821, + 1.1619169134646654, + 0.22767456620931625, + 1.3170079067349434, + 0.026424109935760498, + 0.03831023722887039, + 0.0, + 0.1876321341842413, + 0.21275653317570686, + 0.25056004524230957, + 0.37937627360224724, + 0.07821553200483322, + 0.1929154247045517, + 0.35251475498080254, + 0.625830952078104, + 0.5439448766410351, + 0.17814069241285324, + 0.2363649345934391, + 2.5979235023260117, + 0.4937147982418537, + 0.15173444524407387, + 0.2594348695129156, + 0.628585958853364, + 0.3194490298628807, + 0.3396187424659729, + 0.21053664945065975, + 0.41349175199866295, + 0.39385804906487465, + 0.9800854045897722, + 0.12897000275552273, + 1.1064922846853733, + 0.05879024416208267, + 0.9311189614236355, + 0.688853507861495, + 0.08553298562765121, + 0.02931615151464939, + 0.41022808849811554, + 1.9862408488988876, + 0.10668018646538258, + 0.9009914062917233, + 0.482371324673295 + ], + "unique_experts": 61, + "load_cv": 0.6741359352973696, + "normalized_load_entropy": 0.9400471112932026, + "max_load_share": 0.03777777777777778 + } + }, + "s0_x": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "2d06b55ac57b7f855b71f51a994fb540f622fded7f6d93d85c24674892c22561", + "route_weight_sha256": "c9678cdc47c6b7f273dd2703b8a515d58af71842b21e52e37a678d80e704d12f", + "loads": [ + 3, + 1, + 0, + 3, + 4, + 3, + 12, + 5, + 9, + 3, + 0, + 0, + 1, + 1, + 6, + 3, + 0, + 4, + 7, + 1, + 1, + 11, + 0, + 0, + 0, + 5, + 3, + 1, + 2, + 0, + 0, + 6, + 1, + 0, + 1, + 1, + 7, + 2, + 6, + 0, + 2, + 1, + 5, + 1, + 3, + 5, + 6, + 1, + 1, + 5, + 3, + 16, + 2, + 1, + 1, + 0, + 8, + 3, + 1, + 4, + 9, + 2, + 7, + 4 + ], + "weighted_loads": [ + 0.17015566676855087, + 0.04044819623231888, + 0.0, + 0.13197780027985573, + 0.12740852124989033, + 0.10267701558768749, + 0.5824682116508484, + 0.37487922608852386, + 0.5829850137233734, + 0.11996483616530895, + 0.0, + 0.0, + 0.024993740022182465, + 0.032669734209775925, + 0.36871227249503136, + 0.5587335526943207, + 0.0, + 0.35388050973415375, + 0.4342045020312071, + 0.03339695557951927, + 0.023531099781394005, + 1.0889873914420605, + 0.0, + 0.0, + 0.0, + 0.22805802151560783, + 0.11131579801440239, + 0.02742454782128334, + 0.07564107701182365, + 0.0, + 0.0, + 0.268395122140646, + 0.03096592240035534, + 0.0, + 0.02987205795943737, + 0.060765743255615234, + 0.38387973234057426, + 0.16330455243587494, + 0.4288741908967495, + 0.0, + 0.07669588178396225, + 0.04957037419080734, + 0.3417932875454426, + 0.05797058343887329, + 0.11508326604962349, + 0.3303490821272135, + 0.2839679904282093, + 0.0468469001352787, + 0.08408399671316147, + 0.20823507942259312, + 0.13160274922847748, + 0.9425310119986534, + 0.11302787810564041, + 0.03898683562874794, + 0.028319688513875008, + 0.0, + 0.5880360547453165, + 0.10396850854158401, + 0.03233623877167702, + 0.23497306741774082, + 1.4576241187751293, + 0.08336127549409866, + 0.588477935642004, + 0.14011726528406143 + ], + "unique_experts": 52, + "load_cv": 1.032907230671837, + "normalized_load_entropy": 0.8784371557601199, + "max_load_share": 0.0784313725490196 + }, + "full_input": { + "tokens": 59, + "top_k": 6, + "decisions": 354, + "ordered_route_sha256": "b8c03c9d9e5a70ab9cd97949dc4ff3f8a5e14a997b866621ad8bdc9eaf84e1f1", + "route_weight_sha256": "1d189fa0a0f3eb2003550786ac7a42ef99f63c338ef09a88853d7ce3133600bd", + "loads": [ + 3, + 1, + 0, + 3, + 4, + 12, + 16, + 5, + 9, + 4, + 4, + 0, + 1, + 2, + 6, + 10, + 6, + 10, + 13, + 1, + 13, + 14, + 2, + 0, + 7, + 5, + 7, + 1, + 2, + 0, + 3, + 6, + 3, + 5, + 1, + 1, + 7, + 13, + 7, + 0, + 5, + 9, + 8, + 1, + 4, + 7, + 6, + 2, + 1, + 5, + 4, + 18, + 2, + 13, + 1, + 11, + 8, + 4, + 1, + 4, + 13, + 3, + 7, + 10 + ], + "weighted_loads": [ + 0.17015566676855087, + 0.04044819623231888, + 0.0, + 0.13197780027985573, + 0.12740852124989033, + 0.9374897722154856, + 0.753755658864975, + 0.37487922608852386, + 0.5829850137233734, + 0.4981338959187269, + 0.2068409062922001, + 0.0, + 0.024993740022182465, + 0.051764991134405136, + 0.36871227249503136, + 1.0428598932921886, + 0.26363096199929714, + 0.8642694000154734, + 1.258658416569233, + 0.03339695557951927, + 1.2282732333987951, + 1.2039346285164356, + 0.12779001146554947, + 0.0, + 0.7439443692564964, + 0.22805802151560783, + 0.3388754688203335, + 0.02742454782128334, + 0.07564107701182365, + 0.0, + 0.13754409737884998, + 0.268395122140646, + 0.14731289632618427, + 0.32687563449144363, + 0.02987205795943737, + 0.060765743255615234, + 0.38387973234057426, + 0.6999011393636465, + 0.4595672246068716, + 0.0, + 0.2045714408159256, + 1.4660118408501148, + 0.4934188164770603, + 0.05797058343887329, + 0.15993089228868484, + 0.46794346906244755, + 0.2839679904282093, + 0.09393227472901344, + 0.08408399671316147, + 0.20823507942259312, + 0.16486910358071327, + 1.0408127382397652, + 0.11302787810564041, + 0.9426349606364965, + 0.028319688513875008, + 0.9060508534312248, + 0.5880360547453165, + 0.1318147163838148, + 0.03233623877167702, + 0.23497306741774082, + 2.0330210365355015, + 0.12771236151456833, + 0.588477935642004, + 0.5039193388074636 + ], + "unique_experts": 59, + "load_cv": 0.8047030515544317, + "normalized_load_entropy": 0.9185883836169807, + "max_load_share": 0.05084745762711865 + } + }, + "s1_x": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "8fbc67cfc4690bd12bef7e150a8b7b12ac99083bc292af3dc3bd81026bb7f68c", + "route_weight_sha256": "af0225298c1ad861b2ccb9614620b107871c9e2d344868a7f5c3cf34c772e5a0", + "loads": [ + 3, + 1, + 0, + 3, + 4, + 2, + 12, + 5, + 9, + 4, + 0, + 0, + 1, + 1, + 7, + 3, + 0, + 4, + 6, + 1, + 1, + 12, + 0, + 0, + 2, + 5, + 3, + 1, + 1, + 1, + 0, + 6, + 1, + 0, + 0, + 1, + 6, + 2, + 5, + 0, + 2, + 1, + 5, + 1, + 3, + 5, + 6, + 1, + 2, + 4, + 3, + 16, + 3, + 1, + 2, + 0, + 8, + 2, + 1, + 4, + 8, + 2, + 7, + 4 + ], + "weighted_loads": [ + 0.1899712271988392, + 0.04069478437304497, + 0.0, + 0.12903281673789024, + 0.12478949688374996, + 0.07681462913751602, + 0.5845946259796619, + 0.38026219233870506, + 0.5788444764912128, + 0.1573693361133337, + 0.0, + 0.0, + 0.028201725333929062, + 0.0313471257686615, + 0.41414898820221424, + 0.6045962274074554, + 0.0, + 0.3628060594201088, + 0.3848665691912174, + 0.031073201447725296, + 0.02498398907482624, + 1.1799929793924093, + 0.0, + 0.0, + 0.05814673565328121, + 0.22150213085114956, + 0.11763137951493263, + 0.02993331290781498, + 0.03745315223932266, + 0.024459723383188248, + 0.0, + 0.2350990977138281, + 0.03267586603760719, + 0.0, + 0.0, + 0.0684102326631546, + 0.329735828563571, + 0.16020820289850235, + 0.385795496404171, + 0.0, + 0.07759200409054756, + 0.04838933050632477, + 0.3187379650771618, + 0.0515090711414814, + 0.10994457453489304, + 0.3191374186426401, + 0.2712288871407509, + 0.047927726060152054, + 0.12553702294826508, + 0.179673345759511, + 0.11611061543226242, + 0.8907477520406246, + 0.13287276774644852, + 0.04057740792632103, + 0.059929633513092995, + 0.0, + 0.5731215383857489, + 0.06575287505984306, + 0.033027227967977524, + 0.2523878179490566, + 1.4220770001411438, + 0.0832441970705986, + 0.5939996652305126, + 0.14782504551112652 + ], + "unique_experts": 53, + "load_cv": 1.0194192887494868, + "normalized_load_entropy": 0.8839312589203056, + "max_load_share": 0.0784313725490196 + }, + "full_input": { + "tokens": 75, + "top_k": 6, + "decisions": 450, + "ordered_route_sha256": "92b8c4d06fee286dbab7610a602ae96843c04965491b6e8f7f0c2888e5cbfb54", + "route_weight_sha256": "358fecd64e646e1f2d4581fa5f77d0b88bf7bbf3342b9b25fb42841c2b088fb2", + "loads": [ + 3, + 4, + 0, + 5, + 4, + 11, + 16, + 6, + 9, + 6, + 7, + 0, + 1, + 5, + 8, + 14, + 9, + 16, + 15, + 1, + 15, + 15, + 3, + 1, + 16, + 5, + 13, + 1, + 1, + 1, + 4, + 6, + 7, + 4, + 1, + 3, + 6, + 11, + 8, + 3, + 6, + 15, + 9, + 3, + 5, + 11, + 7, + 8, + 4, + 8, + 8, + 17, + 3, + 14, + 2, + 12, + 10, + 4, + 1, + 5, + 13, + 3, + 10, + 8 + ], + "weighted_loads": [ + 0.1899712271988392, + 0.16103710234165192, + 0.0, + 0.21948754787445068, + 0.12478949688374996, + 0.9566212967038155, + 0.7911616899073124, + 0.40538995899260044, + 0.5788444764912128, + 0.5718744117766619, + 0.23980761133134365, + 0.0, + 0.028201725333929062, + 0.15110264159739017, + 0.4672743696719408, + 1.577956985682249, + 0.3214233089238405, + 1.2942929118871689, + 1.3559508118778467, + 0.031073201447725296, + 1.350575651973486, + 1.3071212116628885, + 0.11501983739435673, + 0.07640542834997177, + 1.3134169410914183, + 0.22150213085114956, + 1.2602094821631908, + 0.02993331290781498, + 0.03745315223932266, + 0.024459723383188248, + 0.15680537931621075, + 0.2350990977138281, + 0.3176620677113533, + 0.2557537667453289, + 0.03488686680793762, + 0.19495519250631332, + 0.329735828563571, + 0.6310596037656069, + 0.5387910045683384, + 0.17814069241285324, + 0.23389047756791115, + 2.4304817095398903, + 0.48152779415249825, + 0.14196110516786575, + 0.17791861854493618, + 0.6260193642228842, + 0.30276133865118027, + 0.3808174394071102, + 0.21568459644913673, + 0.3751800488680601, + 0.3355366550385952, + 0.9320877380669117, + 0.13287276774644852, + 1.2013603411614895, + 0.059929633513092995, + 1.0623407177627087, + 0.6805295329540968, + 0.15457529574632645, + 0.033027227967977524, + 0.44718917831778526, + 1.9409426487982273, + 0.12318187952041626, + 0.9202025458216667, + 0.43853989616036415 + ], + "unique_experts": 62, + "load_cv": 0.6839103255057152, + "normalized_load_entropy": 0.9394225140326191, + "max_load_share": 0.03777777777777778 + } + }, + "s0_period": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "bd39d459d3ad05e75c23705ea675bd8267a6ef39b07b059744f91f8808ef9b14", + "route_weight_sha256": "2a333e7e06870724d47c6d972606b92375848d49529d55b7f82d4040d16a4746", + "loads": [ + 3, + 1, + 0, + 3, + 4, + 4, + 12, + 5, + 9, + 3, + 0, + 0, + 1, + 0, + 6, + 3, + 1, + 4, + 8, + 1, + 0, + 11, + 0, + 0, + 0, + 5, + 2, + 1, + 2, + 0, + 0, + 6, + 1, + 0, + 0, + 1, + 7, + 2, + 6, + 0, + 2, + 1, + 5, + 2, + 3, + 5, + 6, + 1, + 1, + 4, + 3, + 15, + 2, + 1, + 2, + 0, + 8, + 3, + 1, + 5, + 9, + 2, + 7, + 4 + ], + "weighted_loads": [ + 0.1733463630080223, + 0.04262230545282364, + 0.0, + 0.13367792963981628, + 0.12697209604084492, + 0.12729880400002003, + 0.5709603279829025, + 0.36786994710564613, + 0.5831676833331585, + 0.1251656711101532, + 0.0, + 0.0, + 0.02418365143239498, + 0.0, + 0.3783254623413086, + 0.5658861696720123, + 0.02663413994014263, + 0.3590068072080612, + 0.4637978859245777, + 0.03263077512383461, + 0.0, + 1.0882690325379372, + 0.0, + 0.0, + 0.0, + 0.2344761099666357, + 0.07380129396915436, + 0.027477774769067764, + 0.07430103793740273, + 0.0, + 0.0, + 0.2652793563902378, + 0.030866775661706924, + 0.0, + 0.0, + 0.06741034984588623, + 0.3822787385433912, + 0.1657164841890335, + 0.43098704516887665, + 0.0, + 0.07645716518163681, + 0.055213071405887604, + 0.33803633973002434, + 0.08831651508808136, + 0.11408932879567146, + 0.32679078355431557, + 0.2811628468334675, + 0.046593621373176575, + 0.08584841340780258, + 0.18118015676736832, + 0.13269266858696938, + 0.930002398788929, + 0.11042363569140434, + 0.0393521822988987, + 0.05684031546115875, + 0.0, + 0.579119112342596, + 0.10207343101501465, + 0.030887164175510406, + 0.27409871853888035, + 1.4256905019283295, + 0.08458133786916733, + 0.5900797136127949, + 0.15269602835178375 + ], + "unique_experts": 50, + "load_cv": 1.0254358325484614, + "normalized_load_entropy": 0.875624982986102, + "max_load_share": 0.07352941176470588 + }, + "full_input": { + "tokens": 59, + "top_k": 6, + "decisions": 354, + "ordered_route_sha256": "41c5455c5278f110462fa377cff9a2bc745d7a6320ca3b9d2dc52089c415c413", + "route_weight_sha256": "30f2cd0955509ad6602eae0d0a66aa4b8e544627df099354b18f49548637ca4e", + "loads": [ + 3, + 1, + 0, + 3, + 4, + 14, + 16, + 5, + 9, + 4, + 5, + 0, + 1, + 1, + 6, + 10, + 7, + 10, + 14, + 1, + 13, + 13, + 3, + 0, + 8, + 5, + 6, + 1, + 2, + 0, + 3, + 6, + 2, + 4, + 0, + 1, + 7, + 11, + 7, + 0, + 5, + 8, + 8, + 2, + 5, + 7, + 6, + 3, + 1, + 4, + 3, + 17, + 2, + 12, + 2, + 11, + 8, + 4, + 1, + 5, + 13, + 4, + 7, + 10 + ], + "weighted_loads": [ + 0.1733463630080223, + 0.04262230545282364, + 0.0, + 0.13367792963981628, + 0.12697209604084492, + 1.0064242500811815, + 0.7422477751970291, + 0.36786994710564613, + 0.5831676833331585, + 0.5033347308635712, + 0.25659187510609627, + 0.0, + 0.02418365143239498, + 0.01909525692462921, + 0.3783254623413086, + 1.0192217230796814, + 0.3427976295351982, + 0.966711750254035, + 1.2208803500980139, + 0.03263077512383461, + 1.073953352868557, + 1.16905402764678, + 0.17086853086948395, + 0.0, + 0.7958788797259331, + 0.2344761099666357, + 0.32679782062768936, + 0.027477774769067764, + 0.07430103793740273, + 0.0, + 0.1539799440652132, + 0.2652793563902378, + 0.07068601995706558, + 0.2903677746653557, + 0.0, + 0.06741034984588623, + 0.3822787385433912, + 0.6462857946753502, + 0.46502935141324997, + 0.0, + 0.20733455568552017, + 1.4802805110812187, + 0.48749447613954544, + 0.08831651508808136, + 0.20012815669178963, + 0.4668046496808529, + 0.2811628468334675, + 0.13247548788785934, + 0.08584841340780258, + 0.18118015676736832, + 0.13269266858696938, + 1.0282841250300407, + 0.11042363569140434, + 0.8106013592332602, + 0.05684031546115875, + 0.855369683355093, + 0.579119112342596, + 0.12530951388180256, + 0.030887164175510406, + 0.27409871853888035, + 1.9900151044130325, + 0.16660356894135475, + 0.5900797136127949, + 0.49606417305767536 + ], + "unique_experts": 58, + "load_cv": 0.7912630575302602, + "normalized_load_entropy": 0.9196443060149757, + "max_load_share": 0.0480225988700565 + } + }, + "s1_period": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "e1dda3fbc0d841ad9be1c3ab34fa878b0030a32bd79c9feea425831ae65dbe7e", + "route_weight_sha256": "2cbe3973ea9111dd0d9edf157c74f2de91dd2ddaa5936aaaf77679384001e126", + "loads": [ + 3, + 1, + 0, + 3, + 4, + 2, + 12, + 5, + 9, + 4, + 0, + 0, + 1, + 1, + 7, + 3, + 1, + 4, + 7, + 1, + 1, + 11, + 0, + 0, + 1, + 5, + 3, + 1, + 1, + 1, + 1, + 5, + 1, + 0, + 0, + 1, + 6, + 2, + 6, + 0, + 2, + 1, + 5, + 1, + 3, + 4, + 6, + 1, + 2, + 4, + 3, + 16, + 3, + 1, + 2, + 0, + 8, + 2, + 1, + 4, + 8, + 2, + 7, + 4 + ], + "weighted_loads": [ + 0.19088969007134438, + 0.042611557990312576, + 0.0, + 0.13361894339323044, + 0.12189263105392456, + 0.07556195557117462, + 0.5677606742829084, + 0.38557229563593864, + 0.5773207955062389, + 0.15997998788952827, + 0.0, + 0.0, + 0.02612718939781189, + 0.03212149813771248, + 0.426732549443841, + 0.6138390749692917, + 0.02579452283680439, + 0.3593284599483013, + 0.4107289668172598, + 0.03018512949347496, + 0.02751937322318554, + 1.150315847247839, + 0.0, + 0.0, + 0.03198167309165001, + 0.22417942620813847, + 0.11480898782610893, + 0.028115633875131607, + 0.03792336955666542, + 0.02482938952744007, + 0.029430991038680077, + 0.2069366779178381, + 0.03300982341170311, + 0.0, + 0.0, + 0.06433840095996857, + 0.32469177804887295, + 0.15644043684005737, + 0.4325735755264759, + 0.0, + 0.07838468998670578, + 0.05158587917685509, + 0.32080573216080666, + 0.05073796212673187, + 0.1080388817936182, + 0.28799625486135483, + 0.274572528898716, + 0.046059880405664444, + 0.12356232106685638, + 0.18419337831437588, + 0.11652223207056522, + 0.9049602448940277, + 0.13138486072421074, + 0.04046003147959709, + 0.06030508689582348, + 0.0, + 0.5791749786585569, + 0.06613602116703987, + 0.03369883447885513, + 0.2567421644926071, + 1.3971199989318848, + 0.08271049708127975, + 0.5988659001886845, + 0.15173917636275291 + ], + "unique_experts": 55, + "load_cv": 1.0042202374354414, + "normalized_load_entropy": 0.8891875769170411, + "max_load_share": 0.0784313725490196 + }, + "full_input": { + "tokens": 75, + "top_k": 6, + "decisions": 450, + "ordered_route_sha256": "0e3238229f217e5f37a36e1bed55cce32645c99e0c9526a04407cd6be1fa1f70", + "route_weight_sha256": "96501a976dcb17d6922dca7241dc0d69f60b3583c2ae3d3a12e329303e8de15c", + "loads": [ + 3, + 4, + 0, + 5, + 4, + 12, + 17, + 6, + 9, + 6, + 7, + 0, + 1, + 5, + 8, + 14, + 9, + 17, + 16, + 1, + 13, + 13, + 2, + 1, + 16, + 5, + 13, + 1, + 1, + 1, + 6, + 5, + 7, + 4, + 1, + 3, + 6, + 10, + 10, + 3, + 6, + 15, + 9, + 3, + 5, + 10, + 7, + 7, + 4, + 8, + 8, + 17, + 3, + 14, + 3, + 12, + 10, + 3, + 1, + 5, + 13, + 3, + 10, + 9 + ], + "weighted_loads": [ + 0.19088969007134438, + 0.16295387595891953, + 0.0, + 0.22407367452979088, + 0.12189263105392456, + 0.9773399233818054, + 0.8104159291833639, + 0.410700062289834, + 0.5773207955062389, + 0.5744850635528564, + 0.2505603265017271, + 0.0, + 0.02612718939781189, + 0.15187701396644115, + 0.47985793091356754, + 1.6050381772220135, + 0.3182323444634676, + 1.3577699810266495, + 1.42783610150218, + 0.03018512949347496, + 1.0336519945412874, + 1.2406812720000744, + 0.08385311812162399, + 0.07640542834997177, + 1.357353299856186, + 0.22417942620813847, + 1.2855415008962154, + 0.028115633875131607, + 0.03792336955666542, + 0.02482938952744007, + 0.25443537905812263, + 0.2069366779178381, + 0.2896547503769398, + 0.28066411241889, + 0.03488686680793762, + 0.1908833608031273, + 0.32469177804887295, + 0.604017885401845, + 0.6405807603150606, + 0.17814069241285324, + 0.23375527933239937, + 2.312613394111395, + 0.4719144720584154, + 0.14118999615311623, + 0.17601292580366135, + 0.5939202345907688, + 0.30610498040914536, + 0.34179116412997246, + 0.21370989456772804, + 0.379700081422925, + 0.335948271676898, + 0.9463002309203148, + 0.13138486072421074, + 1.165074523538351, + 0.1000827495008707, + 0.9780390001833439, + 0.6865829732269049, + 0.09284906089305878, + 0.03369883447885513, + 0.45154352486133575, + 1.9397141337394714, + 0.14315228536725044, + 0.9250687807798386, + 0.4480805993080139 + ], + "unique_experts": 62, + "load_cv": 0.6852952864493012, + "normalized_load_entropy": 0.9392608179748321, + "max_load_share": 0.03777777777777778 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 34, + "ordered_topk_exact_tokens": 24, + "set_exact_tokens": 28, + "mean_set_jaccard": 0.9495798319327733, + "mean_token_weighted_tv": 0.010798605076749535, + "aggregate_load_tv": 0.029411764705882353 + }, + "system_bos": { + "tokens": 34, + "ordered_topk_exact_tokens": 21, + "set_exact_tokens": 25, + "mean_set_jaccard": 0.9117647058823529, + "mean_token_weighted_tv": 0.016629805596654907, + "aggregate_load_tv": 0.044117647058823525 + }, + "system_x": { + "tokens": 34, + "ordered_topk_exact_tokens": 17, + "set_exact_tokens": 23, + "mean_set_jaccard": 0.9012605042016807, + "mean_token_weighted_tv": 0.021158664624261504, + "aggregate_load_tv": 0.04411764705882353 + }, + "system_period": { + "tokens": 34, + "ordered_topk_exact_tokens": 17, + "set_exact_tokens": 23, + "mean_set_jaccard": 0.9012605042016808, + "mean_token_weighted_tv": 0.020743095973397, + "aggregate_load_tv": 0.05392156862745098 + }, + "bos_at_s0": { + "tokens": 34, + "ordered_topk_exact_tokens": 17, + "set_exact_tokens": 22, + "mean_set_jaccard": 0.8928571428571428, + "mean_token_weighted_tv": 0.020084079574136174, + "aggregate_load_tv": 0.044117647058823525 + }, + "bos_at_s1": { + "tokens": 34, + "ordered_topk_exact_tokens": 17, + "set_exact_tokens": 21, + "mean_set_jaccard": 0.8907563025210085, + "mean_token_weighted_tv": 0.020099374629995403, + "aggregate_load_tv": 0.058823529411764705 + }, + "x_at_s0": { + "tokens": 34, + "ordered_topk_exact_tokens": 19, + "set_exact_tokens": 22, + "mean_set_jaccard": 0.8991596638655462, + "mean_token_weighted_tv": 0.01965653890853419, + "aggregate_load_tv": 0.04901960784313726 + }, + "x_at_s1": { + "tokens": 34, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 20, + "mean_set_jaccard": 0.8697478991596638, + "mean_token_weighted_tv": 0.026364212526994592, + "aggregate_load_tv": 0.06862745098039216 + }, + "period_at_s0": { + "tokens": 34, + "ordered_topk_exact_tokens": 16, + "set_exact_tokens": 21, + "mean_set_jaccard": 0.884453781512605, + "mean_token_weighted_tv": 0.02207267325481071, + "aggregate_load_tv": 0.0588235294117647 + }, + "period_at_s1": { + "tokens": 34, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 21, + "mean_set_jaccard": 0.8781512605042017, + "mean_token_weighted_tv": 0.025233717087437126, + "aggregate_load_tv": 0.06372549019607843 + } + } + }, + "layer_17": { + "layer": 17, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "2f02e3ccdb47d19a3e6a467435f683951104af98416bcf49cde66e5a195aa0fe", + "route_weight_sha256": "d61e0636597e5af6a74bb6db02623f3f0e9497496b4a49f1023029f48e3121b0", + "loads": [ + 8, + 0, + 0, + 8, + 0, + 2, + 1, + 5, + 8, + 9, + 3, + 0, + 5, + 11, + 8, + 9, + 0, + 5, + 3, + 0, + 4, + 4, + 0, + 0, + 0, + 11, + 3, + 3, + 0, + 3, + 0, + 5, + 1, + 3, + 0, + 8, + 1, + 0, + 2, + 6, + 0, + 5, + 4, + 0, + 0, + 0, + 5, + 6, + 9, + 0, + 2, + 4, + 7, + 0, + 1, + 3, + 0, + 0, + 5, + 4, + 4, + 1, + 3, + 2 + ], + "weighted_loads": [ + 0.36857563629746437, + 0.0, + 0.0, + 0.8550323583185673, + 0.0, + 0.09294799715280533, + 0.04753578081727028, + 0.2396557256579399, + 0.43677953630685806, + 1.7814465910196304, + 0.1607700102031231, + 0.0, + 0.15385951288044453, + 0.9056369196623564, + 0.43268223851919174, + 0.8785587251186371, + 0.0, + 0.28337034955620766, + 0.9045217782258987, + 0.0, + 0.22480112314224243, + 0.24432836845517159, + 0.0, + 0.0, + 0.0, + 0.9572015330195427, + 0.10022063367068768, + 0.12131598591804504, + 0.0, + 0.11745576933026314, + 0.0, + 0.5948541238903999, + 0.028063982725143433, + 0.13732346892356873, + 0.0, + 0.49400417506694794, + 0.037701673805713654, + 0.0, + 0.08953114226460457, + 0.32917849346995354, + 0.0, + 0.17971919476985931, + 0.3858208879828453, + 0.0, + 0.0, + 0.0, + 0.3198338449001312, + 0.2978057023137808, + 1.1214341688901186, + 0.0, + 0.05714233219623566, + 0.7597947493195534, + 0.48414450138807297, + 0.0, + 0.03704991936683655, + 0.19546053558588028, + 0.0, + 0.0, + 0.3330529350787401, + 0.1385064534842968, + 0.2241656258702278, + 0.04052692651748657, + 0.141277763992548, + 0.08509565144777298 + ], + "unique_experts": 43, + "load_cv": 0.9918933231326854, + "normalized_load_entropy": 0.8639719618560455, + "max_load_share": 0.05392156862745098 + }, + "full_input": { + "tokens": 59, + "top_k": 6, + "decisions": 354, + "ordered_route_sha256": "94f445459448f902eb5d098fa8f2793751cb03376b845718341099ba66c4cb46", + "route_weight_sha256": "77355ccd840371d94f51946d059bbfd38dd9db9881fc6285941ecf20b785b988", + "loads": [ + 17, + 1, + 2, + 15, + 0, + 2, + 3, + 5, + 9, + 14, + 11, + 1, + 8, + 19, + 9, + 13, + 0, + 12, + 5, + 0, + 7, + 4, + 0, + 6, + 6, + 18, + 12, + 6, + 4, + 5, + 0, + 5, + 9, + 3, + 0, + 8, + 1, + 0, + 5, + 6, + 7, + 11, + 5, + 2, + 0, + 4, + 5, + 6, + 9, + 0, + 3, + 4, + 9, + 0, + 1, + 8, + 0, + 4, + 5, + 4, + 4, + 2, + 8, + 2 + ], + "weighted_loads": [ + 0.6694930279627442, + 0.035801004618406296, + 0.09514197334647179, + 1.4370629452168941, + 0.0, + 0.09294799715280533, + 0.14340687543153763, + 0.2396557256579399, + 0.4718528874218464, + 2.408138645812869, + 0.6227217130362988, + 0.018488973379135132, + 0.2559832725673914, + 1.5055479351431131, + 0.4741520844399929, + 1.134478934109211, + 0.0, + 0.9580282233655453, + 0.9600365832448006, + 0.0, + 0.5084887444972992, + 0.24432836845517159, + 0.0, + 0.27005068585276604, + 0.45481179282069206, + 1.5615243576467037, + 1.7343312669545412, + 0.2623431980609894, + 0.15160494297742844, + 0.15410723583772779, + 0.0, + 0.5948541238903999, + 0.34368546353653073, + 0.13732346892356873, + 0.0, + 0.49400417506694794, + 0.037701673805713654, + 0.0, + 0.22159788385033607, + 0.32917849346995354, + 1.0186759866774082, + 0.36995637882500887, + 0.49577072262763977, + 0.022035300731658936, + 0.0, + 0.8916079476475716, + 0.3198338449001312, + 0.2978057023137808, + 1.1214341688901186, + 0.0, + 0.125750333070755, + 0.7597947493195534, + 0.6674747616052628, + 0.0, + 0.03704991936683655, + 0.4639859516173601, + 0.0, + 0.20017883740365505, + 0.3330529350787401, + 0.1385064534842968, + 0.2241656258702278, + 0.10516957193613052, + 0.5086949095129967, + 0.08509565144777298 + ], + "unique_experts": 53, + "load_cv": 0.8569524601237749, + "normalized_load_entropy": 0.9046503430053243, + "max_load_share": 0.05367231638418079 + } + }, + "s1_eos": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "e7abaf27b9ee0c0705410270f6f27bdd8c97fbce41a0239a29d32f118c6674f4", + "route_weight_sha256": "9acf735c731886c8cca685c4c9cf8b8c2476f55b1c6aaaa3247b87da87b0d811", + "loads": [ + 8, + 0, + 0, + 8, + 0, + 3, + 1, + 5, + 8, + 9, + 3, + 0, + 3, + 11, + 8, + 9, + 0, + 4, + 3, + 0, + 5, + 4, + 0, + 0, + 0, + 10, + 4, + 3, + 0, + 4, + 0, + 5, + 0, + 3, + 0, + 8, + 1, + 1, + 2, + 6, + 0, + 4, + 4, + 1, + 0, + 0, + 6, + 6, + 8, + 0, + 2, + 4, + 7, + 0, + 1, + 3, + 0, + 0, + 5, + 4, + 4, + 1, + 3, + 2 + ], + "weighted_loads": [ + 0.36615368723869324, + 0.0, + 0.0, + 0.8737972192466259, + 0.0, + 0.13083379715681076, + 0.04613649472594261, + 0.24432580545544624, + 0.43973928689956665, + 1.7710177395492792, + 0.16157306730747223, + 0.0, + 0.0973882656544447, + 0.9162114225327969, + 0.44335154816508293, + 0.8585317358374596, + 0.0, + 0.2511007972061634, + 0.9023082554340363, + 0.0, + 0.25334393605589867, + 0.2381412759423256, + 0.0, + 0.0, + 0.0, + 0.8941713087260723, + 0.1344231367111206, + 0.12414464354515076, + 0.0, + 0.15579452738165855, + 0.0, + 0.6230325177311897, + 0.0, + 0.1348940096795559, + 0.0, + 0.49392735958099365, + 0.03965132683515549, + 0.03649767115712166, + 0.09242356941103935, + 0.32643021643161774, + 0.0, + 0.1454844605177641, + 0.3856574296951294, + 0.02825995162129402, + 0.0, + 0.0, + 0.3309240899980068, + 0.292653676122427, + 1.0821343883872032, + 0.0, + 0.056080207228660583, + 0.7478544823825359, + 0.48184457421302795, + 0.0, + 0.02447638101875782, + 0.19034070894122124, + 0.0, + 0.0, + 0.33377104438841343, + 0.1365790106356144, + 0.21810239553451538, + 0.03999368101358414, + 0.1472894698381424, + 0.08556631207466125 + ], + "unique_experts": 44, + "load_cv": 0.9667680812251804, + "normalized_load_entropy": 0.8694318787580888, + "max_load_share": 0.05392156862745098 + }, + "full_input": { + "tokens": 75, + "top_k": 6, + "decisions": 450, + "ordered_route_sha256": "5046ab0bbdd9cd5923c688143049725ba2a62a570ad29f2c0b447a620ffd0792", + "route_weight_sha256": "95ca94db5692601929636cf36f25d858808116aca5317738a5c820b8c6040d6f", + "loads": [ + 17, + 1, + 2, + 14, + 6, + 3, + 4, + 6, + 9, + 16, + 12, + 2, + 3, + 19, + 9, + 17, + 2, + 11, + 5, + 0, + 6, + 5, + 0, + 10, + 10, + 31, + 17, + 6, + 1, + 6, + 2, + 6, + 4, + 3, + 0, + 8, + 5, + 3, + 5, + 7, + 12, + 11, + 6, + 2, + 2, + 5, + 8, + 8, + 8, + 1, + 3, + 10, + 11, + 0, + 2, + 12, + 7, + 12, + 6, + 6, + 5, + 6, + 12, + 2 + ], + "weighted_loads": [ + 0.7262515798211098, + 0.04312310367822647, + 0.07973958551883698, + 1.4930293187499046, + 0.4009688664227724, + 0.13083379715681076, + 0.16269891522824764, + 0.30181241035461426, + 0.47793886065483093, + 2.435346506536007, + 0.736304983496666, + 0.06768923252820969, + 0.0973882656544447, + 1.5315820015966892, + 0.4931463934481144, + 1.2968523278832436, + 0.17135136388242245, + 0.8501884117722511, + 0.9690487198531628, + 0.0, + 0.3232254795730114, + 0.3147868812084198, + 0.0, + 0.7002795357257128, + 0.5772509269881994, + 2.434569491073489, + 1.953900070860982, + 0.257535457611084, + 0.052097272127866745, + 0.24157702829688787, + 0.09584978595376015, + 0.662678174674511, + 0.11144859716296196, + 0.1348940096795559, + 0.0, + 0.49392735958099365, + 0.2684608958661556, + 0.10949867963790894, + 0.3888351731002331, + 0.36013952642679214, + 1.69883206859231, + 0.5298231421038508, + 0.484211090952158, + 0.0470708254724741, + 0.24135316163301468, + 1.320493996143341, + 0.5475642196834087, + 0.4254290200769901, + 1.0821343883872032, + 0.03474729135632515, + 0.19437886774539948, + 1.0420266781002283, + 0.7522942125797272, + 0.0, + 0.11168902553617954, + 0.7332927286624908, + 0.619331493973732, + 0.6241148188710213, + 0.3574438560754061, + 0.22542250156402588, + 0.2503710091114044, + 0.3352227658033371, + 0.8720386363565922, + 0.08556631207466125 + ], + "unique_experts": 60, + "load_cv": 0.7946363404603686, + "normalized_load_entropy": 0.9275328771175093, + "max_load_share": 0.06888888888888889 + } + }, + "s0_bos": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "a429ae2311b83fae970960ea596c9c2c5fd312f425de64fbc58d470c771f6b82", + "route_weight_sha256": "1ee2b869053b63bf79ba86a4cda8cda5bde7555304b74859e9aef919d6c276ae", + "loads": [ + 7, + 0, + 0, + 7, + 0, + 2, + 1, + 5, + 8, + 8, + 3, + 1, + 5, + 10, + 8, + 8, + 0, + 4, + 4, + 0, + 4, + 3, + 0, + 0, + 0, + 11, + 4, + 4, + 0, + 4, + 1, + 5, + 1, + 3, + 0, + 8, + 1, + 0, + 2, + 6, + 0, + 4, + 3, + 1, + 0, + 0, + 5, + 6, + 9, + 0, + 2, + 4, + 7, + 0, + 2, + 3, + 0, + 0, + 4, + 4, + 5, + 1, + 4, + 2 + ], + "weighted_loads": [ + 0.33073094114661217, + 0.0, + 0.0, + 0.8259265627712011, + 0.0, + 0.09317214787006378, + 0.04172520712018013, + 0.24151095375418663, + 0.43764859437942505, + 1.7201542183756828, + 0.16370462998747826, + 0.03032536990940571, + 0.1565125547349453, + 0.872429184615612, + 0.4575558193027973, + 0.8361227698624134, + 0.0, + 0.24156199395656586, + 0.965697892010212, + 0.0, + 0.21794846281409264, + 0.20335496962070465, + 0.0, + 0.0, + 0.0, + 0.9636691249907017, + 0.13065502978861332, + 0.14711742475628853, + 0.0, + 0.16643065214157104, + 0.023844225332140923, + 0.601419772952795, + 0.03319155424833298, + 0.13940473273396492, + 0.0, + 0.484698623418808, + 0.04159478843212128, + 0.0, + 0.09005003795027733, + 0.329062782227993, + 0.0, + 0.14863373339176178, + 0.33884141966700554, + 0.030900824815034866, + 0.0, + 0.0, + 0.30885838717222214, + 0.3046238049864769, + 1.1375277135521173, + 0.0, + 0.05866248533129692, + 0.7477125376462936, + 0.47084853425621986, + 0.0, + 0.06285643763840199, + 0.1929803267121315, + 0.0, + 0.0, + 0.31205708533525467, + 0.1398186944425106, + 0.26428668200969696, + 0.037673160433769226, + 0.20242541655898094, + 0.08203588798642159 + ], + "unique_experts": 46, + "load_cv": 0.9311145153399033, + "normalized_load_entropy": 0.8787383764219407, + "max_load_share": 0.05392156862745098 + }, + "full_input": { + "tokens": 59, + "top_k": 6, + "decisions": 354, + "ordered_route_sha256": "466901fe2e3e20c5604ce41c4b6ea4eb54989743a359cb6bf713f3eb8017725f", + "route_weight_sha256": "5b8ee0b84e54a4f800bd0604761012f6ec7fec1b4050c0c0e6c4dffb820f07c8", + "loads": [ + 15, + 2, + 1, + 14, + 0, + 2, + 3, + 5, + 9, + 13, + 11, + 2, + 9, + 18, + 9, + 12, + 0, + 11, + 6, + 1, + 7, + 3, + 0, + 6, + 6, + 18, + 12, + 6, + 4, + 5, + 1, + 5, + 7, + 3, + 0, + 8, + 1, + 0, + 5, + 6, + 8, + 9, + 4, + 2, + 0, + 4, + 5, + 6, + 9, + 1, + 4, + 4, + 9, + 1, + 2, + 8, + 0, + 4, + 4, + 5, + 5, + 2, + 10, + 2 + ], + "weighted_loads": [ + 0.6457418091595173, + 0.08492850884795189, + 0.05258471518754959, + 1.407957149669528, + 0.0, + 0.09317214787006378, + 0.13759630173444748, + 0.24151095375418663, + 0.48156381770968437, + 2.3311044182628393, + 0.6227358132600784, + 0.04881434328854084, + 0.41108832135796547, + 1.4723402000963688, + 0.506062675267458, + 1.1117899306118488, + 0.0, + 0.9162198677659035, + 1.0212126970291138, + 0.05901722609996796, + 0.5144516639411449, + 0.20335496962070465, + 0.0, + 0.27005068585276604, + 0.4470219574868679, + 1.5494818910956383, + 0.836653983220458, + 0.23545878753066063, + 0.14934508129954338, + 0.1977340467274189, + 0.023844225332140923, + 0.601419772952795, + 0.29811645671725273, + 0.13940473273396492, + 0.0, + 0.484698623418808, + 0.04159478843212128, + 0.0, + 0.22211677953600883, + 0.329062782227993, + 1.063389167189598, + 0.329055342823267, + 0.4487912543118, + 0.04971169866621494, + 0.0, + 0.8172543458640575, + 0.30885838717222214, + 0.3046238049864769, + 1.1375277135521173, + 0.16578945517539978, + 0.17841826751828194, + 0.7477125376462936, + 0.6516147069633007, + 0.052990298718214035, + 0.06285643763840199, + 0.45494251884520054, + 0.0, + 0.1942062620073557, + 0.31205708533525467, + 0.1837596595287323, + 0.26428668200969696, + 0.12479718774557114, + 0.6489662975072861, + 0.08203588798642159 + ], + "unique_experts": 57, + "load_cv": 0.7989707381876175, + "normalized_load_entropy": 0.91853457113102, + "max_load_share": 0.05084745762711865 + } + }, + "s1_bos": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "29ef2ad3bf1441fa430bbde20f1110e18e280bcd3d8dc72284b177a18df49e1b", + "route_weight_sha256": "fd7ccd31faca59ac756b8b5d38a89df552d59880011c612c2c7cb56b95ba4b05", + "loads": [ + 8, + 0, + 0, + 8, + 0, + 3, + 2, + 5, + 8, + 9, + 3, + 0, + 3, + 10, + 8, + 9, + 0, + 4, + 3, + 0, + 3, + 4, + 0, + 0, + 0, + 11, + 4, + 3, + 0, + 4, + 1, + 5, + 0, + 3, + 0, + 8, + 1, + 0, + 2, + 6, + 0, + 3, + 3, + 1, + 0, + 1, + 6, + 6, + 9, + 1, + 2, + 4, + 7, + 0, + 1, + 3, + 0, + 0, + 4, + 4, + 4, + 1, + 4, + 2 + ], + "weighted_loads": [ + 0.3629235178232193, + 0.0, + 0.0, + 0.8863454516977072, + 0.0, + 0.12786531075835228, + 0.07406825199723244, + 0.2496955692768097, + 0.43334299698472023, + 1.7660596445202827, + 0.16043919324874878, + 0.0, + 0.09588988125324249, + 0.8785702139139175, + 0.4577539637684822, + 0.8676257506012917, + 0.0, + 0.23804780840873718, + 0.9041316509246826, + 0.0, + 0.18010058254003525, + 0.2396785393357277, + 0.0, + 0.0, + 0.0, + 0.9054230339825153, + 0.1285020150244236, + 0.1140744574368, + 0.0, + 0.15382222086191177, + 0.023683758452534676, + 0.6039714366197586, + 0.0, + 0.14080162346363068, + 0.0, + 0.4772257376462221, + 0.044296108186244965, + 0.0, + 0.091850146651268, + 0.32674239203333855, + 0.0, + 0.11642256751656532, + 0.3539319932460785, + 0.0290686022490263, + 0.0, + 0.022239327430725098, + 0.33186171762645245, + 0.30079715698957443, + 1.119292251765728, + 0.035443685948848724, + 0.05819428712129593, + 0.71550078317523, + 0.47468761168420315, + 0.0, + 0.029090913012623787, + 0.19632890075445175, + 0.0, + 0.0, + 0.31090857088565826, + 0.14132767543196678, + 0.2330273911356926, + 0.037367161363363266, + 0.20232092589139938, + 0.08220769837498665 + ], + "unique_experts": 46, + "load_cv": 0.9587814257566785, + "normalized_load_entropy": 0.875298039649891, + "max_load_share": 0.05392156862745098 + }, + "full_input": { + "tokens": 75, + "top_k": 6, + "decisions": 450, + "ordered_route_sha256": "42ff03f66569968930de93e260f80111425ad6bc3f9183a354ec99a909aa8e87", + "route_weight_sha256": "a46281e183943535d70078a75e92711b580e604baa58f45d5301019fe928add4", + "loads": [ + 15, + 3, + 2, + 14, + 6, + 3, + 5, + 6, + 9, + 17, + 12, + 2, + 5, + 18, + 9, + 17, + 2, + 11, + 5, + 0, + 4, + 5, + 0, + 10, + 9, + 32, + 16, + 6, + 0, + 5, + 3, + 6, + 3, + 3, + 0, + 8, + 5, + 2, + 5, + 7, + 13, + 9, + 5, + 2, + 2, + 6, + 8, + 8, + 9, + 2, + 5, + 10, + 11, + 0, + 2, + 11, + 7, + 12, + 5, + 6, + 5, + 6, + 14, + 2 + ], + "weighted_loads": [ + 0.6578265521675348, + 0.14661331474781036, + 0.07973958551883698, + 1.505577551200986, + 0.4009688664227724, + 0.12786531075835228, + 0.19063067249953747, + 0.3071821741759777, + 0.4766782224178314, + 2.4816637840121984, + 0.7363394908607006, + 0.06768923252820969, + 0.19626885652542114, + 1.49394079297781, + 0.5042160674929619, + 1.3149110972881317, + 0.17135136388242245, + 0.8371354229748249, + 0.9708721153438091, + 0.0, + 0.2772829532623291, + 0.3163241446018219, + 0.0, + 0.7002795357257128, + 0.5705114603042603, + 2.428978933021426, + 1.0443099532276392, + 0.24221821501851082, + 0.0, + 0.2343730628490448, + 0.11953354440629482, + 0.6436170935630798, + 0.10703675448894501, + 0.14080162346363068, + 0.0, + 0.4772257376462221, + 0.2731056772172451, + 0.07300100848078728, + 0.38826175034046173, + 0.36045170202851295, + 1.7588363885879517, + 0.5128182806074619, + 0.45248565450310707, + 0.047879476100206375, + 0.24135316163301468, + 1.459194853901863, + 0.5485018473118544, + 0.4335725009441376, + 1.119292251765728, + 0.0771990492939949, + 0.29906702786684036, + 1.0096729788929224, + 0.7471154984086752, + 0.0, + 0.11630355753004551, + 0.6950953677296638, + 0.619331493973732, + 0.6223785616457462, + 0.3345813825726509, + 0.23017116636037827, + 0.26529600471258163, + 0.3370763845741749, + 1.0225465521216393, + 0.08220769837498665 + ], + "unique_experts": 59, + "load_cv": 0.7898491807902708, + "normalized_load_entropy": 0.9289691589881154, + "max_load_share": 0.07111111111111111 + } + }, + "s0_x": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "469060b758a70db6ecc897c48458bf3cd66807f639a826231aa1eccf79f0c799", + "route_weight_sha256": "00415563559dadfc3df006767803756abb9e3e94e1a387345e24b881d20baaf9", + "loads": [ + 6, + 0, + 0, + 8, + 0, + 3, + 4, + 5, + 8, + 8, + 3, + 1, + 4, + 10, + 8, + 9, + 0, + 4, + 3, + 0, + 4, + 3, + 0, + 0, + 0, + 10, + 4, + 3, + 0, + 3, + 1, + 5, + 1, + 3, + 0, + 8, + 1, + 1, + 2, + 6, + 0, + 3, + 3, + 1, + 0, + 1, + 6, + 6, + 8, + 1, + 2, + 4, + 6, + 0, + 1, + 3, + 0, + 0, + 4, + 4, + 5, + 1, + 4, + 2 + ], + "weighted_loads": [ + 0.28652382642030716, + 0.0, + 0.0, + 0.8494948428124189, + 0.0, + 0.12600043788552284, + 0.1442902348935604, + 0.24191828817129135, + 0.43243762850761414, + 1.738615058362484, + 0.16046521812677383, + 0.030858764424920082, + 0.12920871749520302, + 0.8858302272856236, + 0.47718650847673416, + 0.8587290793657303, + 0.0, + 0.25445952638983727, + 0.8597824722528458, + 0.0, + 0.21406583115458488, + 0.2120472639799118, + 0.0, + 0.0, + 0.0, + 0.9011125601828098, + 0.1272907331585884, + 0.1172371618449688, + 0.0, + 0.12204661592841148, + 0.022951258346438408, + 0.5719342790544033, + 0.03191812336444855, + 0.13891547918319702, + 0.0, + 0.508671285584569, + 0.03869195282459259, + 0.03950756788253784, + 0.0911627821624279, + 0.34051673486828804, + 0.0, + 0.1115978118032217, + 0.3509910777211189, + 0.026890844106674194, + 0.0, + 0.021966034546494484, + 0.33208894543349743, + 0.3013022281229496, + 1.1024919301271439, + 0.03503245487809181, + 0.05866245925426483, + 0.7191617749631405, + 0.45068274810910225, + 0.0, + 0.0307135209441185, + 0.20233936235308647, + 0.0, + 0.0, + 0.312239907681942, + 0.14189234003424644, + 0.2691787779331207, + 0.041237201541662216, + 0.2105601653456688, + 0.08019952848553658 + ], + "unique_experts": 49, + "load_cv": 0.8991858421802432, + "normalized_load_entropy": 0.8891178197588867, + "max_load_share": 0.049019607843137254 + }, + "full_input": { + "tokens": 59, + "top_k": 6, + "decisions": 354, + "ordered_route_sha256": "c9ac73b68780e11d5874a24a50b70408791a80058d6982aa8245b1d4af292a28", + "route_weight_sha256": "11751824e7a6bfa3ba33a316b8f3f11f3c4749d5e82247e4dad0f687eb1d64b9", + "loads": [ + 13, + 1, + 2, + 16, + 0, + 3, + 7, + 5, + 9, + 14, + 13, + 2, + 6, + 19, + 9, + 13, + 0, + 12, + 5, + 0, + 6, + 3, + 0, + 7, + 6, + 18, + 11, + 5, + 4, + 4, + 1, + 5, + 7, + 3, + 0, + 8, + 1, + 1, + 5, + 6, + 7, + 8, + 5, + 2, + 0, + 5, + 6, + 6, + 9, + 1, + 4, + 4, + 8, + 0, + 1, + 9, + 0, + 3, + 4, + 4, + 5, + 2, + 9, + 2 + ], + "weighted_loads": [ + 0.5322281457483768, + 0.035801004618406296, + 0.1012955792248249, + 1.5813983585685492, + 0.0, + 0.12600043788552284, + 0.27770014107227325, + 0.24191828817129135, + 0.46638480946421623, + 2.409132221713662, + 0.8267763555049896, + 0.049347737804055214, + 0.19512933492660522, + 1.5243740566074848, + 0.5201530531048775, + 1.1173790469765663, + 0.0, + 0.9737148098647594, + 0.9152972772717476, + 0.0, + 0.4146695174276829, + 0.2120472639799118, + 0.0, + 0.32679879292845726, + 0.4731024317443371, + 1.526926077902317, + 0.7477869912981987, + 0.2055785246193409, + 0.1593608856201172, + 0.15335001051425934, + 0.022951258346438408, + 0.5719342790544033, + 0.2968430258333683, + 0.13891547918319702, + 0.0, + 0.508671285584569, + 0.03869195282459259, + 0.03950756788253784, + 0.2232295237481594, + 0.34051673486828804, + 1.0584081336855888, + 0.29900034330785275, + 0.49821488186717033, + 0.04570171795785427, + 0.0, + 0.9343001190572977, + 0.33208894543349743, + 0.3013022281229496, + 1.1422411724925041, + 0.03503245487809181, + 0.18938591331243515, + 0.7191617749631405, + 0.6324290074408054, + 0.0, + 0.0307135209441185, + 0.529828255996108, + 0.0, + 0.149509459733963, + 0.312239907681942, + 0.14189234003424644, + 0.2691787779331207, + 0.1288321055471897, + 0.5841173864901066, + 0.08019952848553658 + ], + "unique_experts": 56, + "load_cv": 0.8204160210359964, + "normalized_load_entropy": 0.9147183566409565, + "max_load_share": 0.05367231638418079 + } + }, + "s1_x": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "646c3ee6743550c5836a89fa5778acc1fb727c7139c385d13b6ea69bf8c2aad8", + "route_weight_sha256": "042ca2925f8bda9ed3c5d789ed516dbfc01f538e4887f77b2bb397831d56e07a", + "loads": [ + 7, + 0, + 0, + 10, + 0, + 3, + 4, + 5, + 8, + 8, + 3, + 0, + 3, + 11, + 8, + 9, + 0, + 4, + 3, + 0, + 3, + 3, + 0, + 0, + 0, + 11, + 4, + 2, + 0, + 3, + 0, + 5, + 2, + 3, + 0, + 8, + 1, + 1, + 2, + 7, + 1, + 2, + 4, + 1, + 0, + 1, + 6, + 6, + 7, + 0, + 2, + 4, + 7, + 0, + 1, + 3, + 0, + 0, + 4, + 3, + 4, + 1, + 4, + 2 + ], + "weighted_loads": [ + 0.3316196799278259, + 0.0, + 0.0, + 0.9674646183848381, + 0.0, + 0.1282208114862442, + 0.1410468239337206, + 0.25245946273207664, + 0.44006117805838585, + 1.7362549602985382, + 0.1580035611987114, + 0.0, + 0.09943132847547531, + 0.9153373818844557, + 0.4580358900129795, + 0.8549763523042202, + 0.0, + 0.23695451766252518, + 0.889586478471756, + 0.0, + 0.1562230996787548, + 0.18827849254012108, + 0.0, + 0.0, + 0.0, + 0.8566704951226711, + 0.1358523890376091, + 0.06851433031260967, + 0.0, + 0.10573144257068634, + 0.0, + 0.5874669030308723, + 0.0613680612295866, + 0.15142224356532097, + 0.0, + 0.4975202698260546, + 0.0479099303483963, + 0.04002855345606804, + 0.09116765856742859, + 0.38460396230220795, + 0.03330337628722191, + 0.08938492834568024, + 0.41058699786663055, + 0.02672543190419674, + 0.0, + 0.024153506383299828, + 0.3209657594561577, + 0.2976641822606325, + 1.033779513090849, + 0.0, + 0.05363656394183636, + 0.7038687206804752, + 0.47822463512420654, + 0.0, + 0.028501898050308228, + 0.20607915148139, + 0.0, + 0.0, + 0.3165082633495331, + 0.11330534890294075, + 0.23571504652500153, + 0.04107759892940521, + 0.21473009139299393, + 0.08703293651342392 + ], + "unique_experts": 47, + "load_cv": 0.9571760978399155, + "normalized_load_entropy": 0.878206719275764, + "max_load_share": 0.05392156862745098 + }, + "full_input": { + "tokens": 75, + "top_k": 6, + "decisions": 450, + "ordered_route_sha256": "1fe4c1d61acbcdf54cf6efb807704c9ac9a46ee77a817a4f7c270df47a4fde02", + "route_weight_sha256": "32375c5747ce93477bc8dcd46759b2b01275ffde87a7ceb1294f6dfc9601057a", + "loads": [ + 13, + 1, + 3, + 17, + 6, + 3, + 8, + 6, + 9, + 16, + 13, + 2, + 3, + 20, + 9, + 17, + 2, + 12, + 5, + 0, + 3, + 4, + 0, + 11, + 9, + 33, + 14, + 4, + 0, + 4, + 2, + 6, + 6, + 3, + 0, + 8, + 5, + 3, + 5, + 8, + 13, + 8, + 6, + 2, + 2, + 6, + 8, + 8, + 8, + 0, + 4, + 10, + 12, + 0, + 2, + 11, + 7, + 12, + 6, + 5, + 5, + 7, + 13, + 2 + ], + "weighted_loads": [ + 0.5748691987246275, + 0.04312310367822647, + 0.1312190741300583, + 1.750088844448328, + 0.4009688664227724, + 0.1282208114862442, + 0.2968187890946865, + 0.30994606763124466, + 0.4814687892794609, + 2.4331234004348516, + 0.8883773423731327, + 0.06768923252820969, + 0.09943132847547531, + 1.5902905333787203, + 0.5171496458351612, + 1.2965669631958008, + 0.17135136388242245, + 0.8860924504697323, + 0.9563269428908825, + 0.0, + 0.1562230996787548, + 0.2649240978062153, + 0.0, + 0.7298495750874281, + 0.6130610927939415, + 2.4155221190303564, + 0.9170498382300138, + 0.14626274071633816, + 0.0, + 0.18628228455781937, + 0.09584978595376015, + 0.6271125599741936, + 0.21938093565404415, + 0.15142224356532097, + 0.0, + 0.4975202698260546, + 0.27671949937939644, + 0.11302956193685532, + 0.3875792622566223, + 0.41831327229738235, + 1.709469348192215, + 0.4631922300904989, + 0.5091406591236591, + 0.045536305755376816, + 0.24135316163301468, + 1.260636193677783, + 0.5376058891415596, + 0.43043952621519566, + 1.0738255828619003, + 0.0, + 0.27911186777055264, + 0.9980409163981676, + 0.7896619141101837, + 0.0, + 0.11571454256772995, + 0.7063915766775608, + 0.619331493973732, + 0.6240838803350925, + 0.3918800614774227, + 0.20214883983135223, + 0.26798366010189056, + 0.3750599268823862, + 0.9623911939561367, + 0.08703293651342392 + ], + "unique_experts": 58, + "load_cv": 0.8181520882489838, + "normalized_load_entropy": 0.9230281757068066, + "max_load_share": 0.07333333333333333 + } + }, + "s0_period": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "67d5ea6ca9ed19b12d98bfd02be66d92e6776290fe058bd0c39e0defd3ac1a2f", + "route_weight_sha256": "7548d4e79d1c5ff3146b2d4927e1a0d9dd6b91f6c66bf538066cd54ea74d974f", + "loads": [ + 6, + 0, + 0, + 7, + 0, + 3, + 3, + 4, + 8, + 8, + 3, + 0, + 4, + 10, + 8, + 9, + 0, + 4, + 3, + 0, + 3, + 3, + 0, + 0, + 0, + 10, + 4, + 4, + 0, + 3, + 1, + 5, + 1, + 3, + 0, + 8, + 1, + 1, + 2, + 6, + 0, + 3, + 4, + 1, + 0, + 0, + 6, + 6, + 9, + 1, + 3, + 4, + 7, + 0, + 2, + 3, + 0, + 0, + 4, + 4, + 5, + 1, + 4, + 2 + ], + "weighted_loads": [ + 0.29392408579587936, + 0.0, + 0.0, + 0.8323596529662609, + 0.0, + 0.12506264820694923, + 0.10672490298748016, + 0.21016797795891762, + 0.4356895349919796, + 1.7276034280657768, + 0.1588764823973179, + 0.0, + 0.13150032237172127, + 0.8785490728914738, + 0.4667600281536579, + 0.8818911649286747, + 0.0, + 0.2552993930876255, + 0.8552839607000351, + 0.0, + 0.1703026294708252, + 0.22057081758975983, + 0.0, + 0.0, + 0.0, + 0.9126241728663445, + 0.1264625657349825, + 0.1459507755935192, + 0.0, + 0.12117188051342964, + 0.02278081141412258, + 0.5626663155853748, + 0.03262491151690483, + 0.13719787076115608, + 0.0, + 0.5032785795629025, + 0.039563875645399094, + 0.03953662887215614, + 0.09080559387803078, + 0.33331505581736565, + 0.0, + 0.11559529416263103, + 0.3761831410229206, + 0.02881934493780136, + 0.0, + 0.0, + 0.3336863461881876, + 0.30132116191089153, + 1.1153990887105465, + 0.03412770852446556, + 0.09077331610023975, + 0.7251864299178123, + 0.4763174243271351, + 0.0, + 0.06600206717848778, + 0.20043020322918892, + 0.0, + 0.0, + 0.3142189309000969, + 0.1407856121659279, + 0.27638524025678635, + 0.04384226351976395, + 0.21027354523539543, + 0.08448072895407677 + ], + "unique_experts": 47, + "load_cv": 0.909389696102371, + "normalized_load_entropy": 0.8846506907187013, + "max_load_share": 0.049019607843137254 + }, + "full_input": { + "tokens": 59, + "top_k": 6, + "decisions": 354, + "ordered_route_sha256": "e5b9295a9b7d3df3da2f7cd80ad4c11eab9281c79ed79737a0e5063b6b045d29", + "route_weight_sha256": "51e27cae9c5edfd44d463e219de4b2065c2aabf43f208d7dec00dab446189a7b", + "loads": [ + 12, + 1, + 3, + 15, + 0, + 3, + 6, + 4, + 9, + 13, + 12, + 1, + 6, + 18, + 9, + 12, + 0, + 11, + 5, + 0, + 6, + 3, + 0, + 6, + 6, + 18, + 12, + 7, + 4, + 4, + 1, + 5, + 8, + 3, + 0, + 8, + 1, + 1, + 5, + 6, + 7, + 8, + 6, + 2, + 0, + 4, + 6, + 6, + 9, + 1, + 5, + 4, + 9, + 0, + 2, + 10, + 0, + 5, + 4, + 4, + 5, + 2, + 9, + 2 + ], + "weighted_loads": [ + 0.49619755521416664, + 0.035801004618406296, + 0.1511927768588066, + 1.4617646597325802, + 0.0, + 0.12506264820694923, + 0.23918208479881287, + 0.21016797795891762, + 0.4724205210804939, + 2.3496353533118963, + 0.6694833673536777, + 0.018488973379135132, + 0.19742093980312347, + 1.4784600883722305, + 0.5131570622324944, + 1.0974953882396221, + 0.0, + 0.9299572668969631, + 0.9107987657189369, + 0.0, + 0.42104019597172737, + 0.22057081758975983, + 0.0, + 0.27005068585276604, + 0.48208971694111824, + 1.5114626362919807, + 0.7837289590388536, + 0.2718909904360771, + 0.1522865854203701, + 0.1524752750992775, + 0.02278081141412258, + 0.5626663155853748, + 0.3467690609395504, + 0.13719787076115608, + 0.0, + 0.5032785795629025, + 0.039563875645399094, + 0.03953662887215614, + 0.22287233546376228, + 0.33331505581736565, + 1.0441154018044472, + 0.3213075418025255, + 0.5340979136526585, + 0.04763021878898144, + 0.0, + 0.9644038677215576, + 0.3336863461881876, + 0.30132116191089153, + 1.1153990887105465, + 0.03412770852446556, + 0.22556557692587376, + 0.7251864299178123, + 0.6617623679339886, + 0.0, + 0.06600206717848778, + 0.6847421135753393, + 0.0, + 0.22151313349604607, + 0.3142189309000969, + 0.1407856121659279, + 0.27638524025678635, + 0.13148664683103561, + 0.6231660470366478, + 0.08448072895407677 + ], + "unique_experts": 56, + "load_cv": 0.7893243773285816, + "normalized_load_entropy": 0.918615724459072, + "max_load_share": 0.05084745762711865 + } + }, + "s1_period": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "867ac9bd00ed093695705dc0ed704fc4228fb17de02568673686be876f005f72", + "route_weight_sha256": "ce53b54714bbbec41e91334bd8b2461b77dda67625dace335865f6d9651771f5", + "loads": [ + 7, + 0, + 0, + 10, + 0, + 3, + 3, + 5, + 8, + 8, + 3, + 0, + 4, + 11, + 8, + 9, + 0, + 4, + 3, + 0, + 4, + 3, + 0, + 0, + 0, + 11, + 4, + 3, + 0, + 2, + 0, + 5, + 1, + 3, + 0, + 8, + 1, + 1, + 2, + 7, + 1, + 2, + 4, + 1, + 0, + 1, + 6, + 6, + 7, + 0, + 2, + 4, + 7, + 0, + 1, + 3, + 0, + 0, + 4, + 3, + 4, + 1, + 4, + 2 + ], + "weighted_loads": [ + 0.33249663934111595, + 0.0, + 0.0, + 0.9700910579413176, + 0.0, + 0.13046199083328247, + 0.10778527334332466, + 0.2567097172141075, + 0.4485088586807251, + 1.7340909577906132, + 0.15851367264986038, + 0.0, + 0.12179676070809364, + 0.9150491468608379, + 0.44240323081612587, + 0.8839061111211777, + 0.0, + 0.24687138199806213, + 0.9099395126104355, + 0.0, + 0.1996709667146206, + 0.19933442026376724, + 0.0, + 0.0, + 0.0, + 0.8843907453119755, + 0.13423404842615128, + 0.10496318526566029, + 0.0, + 0.07395823299884796, + 0.0, + 0.5954804010689259, + 0.03269699215888977, + 0.14858264103531837, + 0.0, + 0.49717194959521294, + 0.04769899323582649, + 0.040159936994314194, + 0.08971695229411125, + 0.37571481615304947, + 0.03333839401602745, + 0.09112934395670891, + 0.4103379398584366, + 0.025442831218242645, + 0.0, + 0.024308254942297935, + 0.3198568616062403, + 0.29964262805879116, + 1.048395361751318, + 0.0, + 0.054419636726379395, + 0.7073523923754692, + 0.4756208062171936, + 0.0, + 0.028568733483552933, + 0.2015899308025837, + 0.0, + 0.0, + 0.3099166005849838, + 0.11217231303453445, + 0.23705964535474777, + 0.04169727489352226, + 0.22056318819522858, + 0.0828772485256195 + ], + "unique_experts": 47, + "load_cv": 0.9603840702947809, + "normalized_load_entropy": 0.8771894705030217, + "max_load_share": 0.05392156862745098 + }, + "full_input": { + "tokens": 75, + "top_k": 6, + "decisions": 450, + "ordered_route_sha256": "2a266cbfd7671fe4deb183a719e9891c822599487177bbf6f66d31b50566b521", + "route_weight_sha256": "7bd9ea2078f45e06ee8a734d52ff64044d30d00fbfc228bc379f600261205de6", + "loads": [ + 13, + 1, + 3, + 17, + 6, + 3, + 7, + 6, + 9, + 15, + 11, + 2, + 4, + 19, + 9, + 16, + 3, + 11, + 5, + 0, + 4, + 4, + 0, + 10, + 10, + 34, + 15, + 5, + 1, + 3, + 2, + 6, + 5, + 3, + 0, + 8, + 5, + 3, + 5, + 8, + 14, + 8, + 8, + 2, + 2, + 6, + 8, + 8, + 7, + 0, + 4, + 10, + 12, + 0, + 2, + 13, + 7, + 13, + 5, + 5, + 5, + 6, + 12, + 2 + ], + "weighted_loads": [ + 0.5765499491244555, + 0.04312310367822647, + 0.12997876480221748, + 1.6395965497940779, + 0.4009688664227724, + 0.13046199083328247, + 0.25969197787344456, + 0.31419632211327553, + 0.49057822301983833, + 2.380323575809598, + 0.6891031861305237, + 0.06768923252820969, + 0.12179676070809364, + 1.5304197259247303, + 0.5050587169826031, + 1.2870806828141212, + 0.22297304682433605, + 0.8459589965641499, + 0.976679977029562, + 0.0, + 0.1996709667146206, + 0.27598002552986145, + 0.0, + 0.7002795357257128, + 0.6454493459314108, + 2.5365525130182505, + 0.9496207628399134, + 0.18271159566938877, + 0.031066013500094414, + 0.154509074985981, + 0.09584978595376015, + 0.6351260580122471, + 0.20200692862272263, + 0.14858264103531837, + 0.0, + 0.49717194959521294, + 0.27650856226682663, + 0.11316094547510147, + 0.386128555983305, + 0.4094241261482239, + 1.7418311201035976, + 0.4779220335185528, + 0.5891360305249691, + 0.04425370506942272, + 0.24135316163301468, + 1.401224872097373, + 0.5364969912916422, + 0.4324179720133543, + 1.048395361751318, + 0.0, + 0.2578674256801605, + 1.0015245880931616, + 0.7868205346167088, + 0.0, + 0.11578137800097466, + 0.9124036692082882, + 0.619331493973732, + 0.6848955862224102, + 0.33358941227197647, + 0.20101580396294594, + 0.2693282589316368, + 0.3478122092783451, + 0.8341641910374165, + 0.0828772485256195 + ], + "unique_experts": 59, + "load_cv": 0.8142799591368142, + "normalized_load_entropy": 0.925715039596547, + "max_load_share": 0.07555555555555556 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 34, + "ordered_topk_exact_tokens": 21, + "set_exact_tokens": 25, + "mean_set_jaccard": 0.9243697478991596, + "mean_token_weighted_tv": 0.014888489810640322, + "aggregate_load_tv": 0.034313725490196074 + }, + "system_bos": { + "tokens": 34, + "ordered_topk_exact_tokens": 18, + "set_exact_tokens": 24, + "mean_set_jaccard": 0.9096638655462186, + "mean_token_weighted_tv": 0.018162425086997887, + "aggregate_load_tv": 0.049019607843137254 + }, + "system_x": { + "tokens": 34, + "ordered_topk_exact_tokens": 18, + "set_exact_tokens": 24, + "mean_set_jaccard": 0.9096638655462186, + "mean_token_weighted_tv": 0.022434394313570333, + "aggregate_load_tv": 0.04901960784313726 + }, + "system_period": { + "tokens": 34, + "ordered_topk_exact_tokens": 16, + "set_exact_tokens": 22, + "mean_set_jaccard": 0.8991596638655461, + "mean_token_weighted_tv": 0.023719782365814727, + "aggregate_load_tv": 0.05392156862745099 + }, + "bos_at_s0": { + "tokens": 34, + "ordered_topk_exact_tokens": 19, + "set_exact_tokens": 22, + "mean_set_jaccard": 0.8928571428571429, + "mean_token_weighted_tv": 0.02163971998893163, + "aggregate_load_tv": 0.049019607843137254 + }, + "bos_at_s1": { + "tokens": 34, + "ordered_topk_exact_tokens": 21, + "set_exact_tokens": 25, + "mean_set_jaccard": 0.9243697478991596, + "mean_token_weighted_tv": 0.018009686787777087, + "aggregate_load_tv": 0.03431372549019608 + }, + "x_at_s0": { + "tokens": 34, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 17, + "mean_set_jaccard": 0.850840336134454, + "mean_token_weighted_tv": 0.027787659618565264, + "aggregate_load_tv": 0.06862745098039216 + }, + "x_at_s1": { + "tokens": 34, + "ordered_topk_exact_tokens": 16, + "set_exact_tokens": 21, + "mean_set_jaccard": 0.8844537815126051, + "mean_token_weighted_tv": 0.02816113500910647, + "aggregate_load_tv": 0.058823529411764705 + }, + "period_at_s0": { + "tokens": 34, + "ordered_topk_exact_tokens": 16, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.8676470588235294, + "mean_token_weighted_tv": 0.02526420519194182, + "aggregate_load_tv": 0.06862745098039216 + }, + "period_at_s1": { + "tokens": 34, + "ordered_topk_exact_tokens": 17, + "set_exact_tokens": 23, + "mean_set_jaccard": 0.9012605042016808, + "mean_token_weighted_tv": 0.025028082651688772, + "aggregate_load_tv": 0.05392156862745098 + } + } + }, + "layer_18": { + "layer": 18, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "1a4589668a09126525b9ee300ff096f24c89dc63a28114cc596fd9b4aefdd5af", + "route_weight_sha256": "49aa7efd4c55705c23f81e7356b57aee020e4c139ad72d3f0a64ead84fcd1d15", + "loads": [ + 2, + 4, + 4, + 3, + 0, + 6, + 0, + 0, + 2, + 0, + 3, + 10, + 0, + 5, + 0, + 0, + 3, + 0, + 0, + 0, + 8, + 0, + 11, + 2, + 3, + 2, + 2, + 0, + 0, + 0, + 1, + 3, + 2, + 2, + 2, + 0, + 4, + 1, + 12, + 6, + 2, + 0, + 3, + 0, + 2, + 6, + 2, + 9, + 0, + 5, + 14, + 4, + 7, + 3, + 7, + 3, + 5, + 5, + 4, + 3, + 8, + 0, + 7, + 2 + ], + "weighted_loads": [ + 0.07592454925179482, + 0.18071340397000313, + 0.27282435819506645, + 0.12364199757575989, + 0.0, + 0.4594494439661503, + 0.0, + 0.0, + 0.15110255777835846, + 0.0, + 0.09812803752720356, + 0.6194636691361666, + 0.0, + 0.771304614841938, + 0.0, + 0.0, + 0.09918868727982044, + 0.0, + 0.0, + 0.0, + 0.41451960429549217, + 0.0, + 1.023307267576456, + 0.10545217245817184, + 0.08956744894385338, + 0.1488586626946926, + 0.07049623131752014, + 0.0, + 0.0, + 0.0, + 0.04771466925740242, + 0.11607682332396507, + 0.23168917000293732, + 0.07968437299132347, + 0.17465859279036522, + 0.0, + 0.1614310536533594, + 0.03035828098654747, + 0.6458094194531441, + 0.2441201638430357, + 0.08472078666090965, + 0.0, + 0.09504306875169277, + 0.0, + 0.10429145768284798, + 0.39324014261364937, + 0.08589117974042892, + 0.5410549603402615, + 0.0, + 0.5636602863669395, + 0.8043317310512066, + 0.25510259345173836, + 0.5419661439955235, + 0.11562478542327881, + 0.28425946459174156, + 0.12426399812102318, + 0.21443001180887222, + 0.423705380409956, + 0.2099980190396309, + 0.17527804523706436, + 0.29710425063967705, + 0.0, + 0.3741435371339321, + 0.08317667618393898 + ], + "unique_experts": 45, + "load_cv": 1.0269344607979214, + "normalized_load_entropy": 0.8679195827487347, + "max_load_share": 0.06862745098039216 + }, + "full_input": { + "tokens": 59, + "top_k": 6, + "decisions": 354, + "ordered_route_sha256": "185313128c7865ea8696dda2e72b84da44ecb2f824d357869d1d76344367e0f0", + "route_weight_sha256": "143bce3977c160490d05d84afa35b447a071c2c949dda66108a60dfeba659310", + "loads": [ + 8, + 5, + 17, + 3, + 0, + 8, + 0, + 0, + 10, + 1, + 4, + 15, + 1, + 5, + 5, + 4, + 3, + 0, + 18, + 0, + 8, + 1, + 11, + 2, + 3, + 2, + 2, + 0, + 0, + 0, + 8, + 3, + 4, + 2, + 2, + 3, + 5, + 3, + 12, + 9, + 7, + 0, + 7, + 0, + 2, + 7, + 9, + 9, + 2, + 17, + 17, + 6, + 16, + 11, + 7, + 3, + 7, + 8, + 5, + 6, + 8, + 2, + 7, + 4 + ], + "weighted_loads": [ + 0.4741109386086464, + 0.25416669622063637, + 1.4601111188530922, + 0.12364199757575989, + 0.0, + 0.5074697975069284, + 0.0, + 0.0, + 0.6392580755054951, + 0.027828000485897064, + 0.10897612571716309, + 1.0676602143794298, + 0.03782612085342407, + 0.771304614841938, + 0.9351083673536777, + 0.13695485703647137, + 0.09918868727982044, + 0.0, + 1.0890147872269154, + 0.0, + 0.41451960429549217, + 0.02394253946840763, + 1.023307267576456, + 0.10545217245817184, + 0.08956744894385338, + 0.1488586626946926, + 0.07049623131752014, + 0.0, + 0.0, + 0.0, + 0.28606847673654556, + 0.11607682332396507, + 0.3192405216395855, + 0.07968437299132347, + 0.17465859279036522, + 0.19617768377065659, + 0.18499061278998852, + 0.09500979818403721, + 0.6458094194531441, + 0.3262944873422384, + 0.2842351756989956, + 0.0, + 0.21292521059513092, + 0.0, + 0.10429145768284798, + 0.46879636868834496, + 1.8866070583462715, + 0.5410549603402615, + 0.11281540244817734, + 1.12779969163239, + 1.0622279904782772, + 0.46047383174300194, + 1.153071254491806, + 0.8395736217498779, + 0.28425946459174156, + 0.12426399812102318, + 1.2130983546376228, + 0.5779155157506466, + 0.23933185636997223, + 0.2543714512139559, + 0.29710425063967705, + 0.05402558855712414, + 0.3741435371339321, + 0.17804834991693497 + ], + "unique_experts": 54, + "load_cv": 0.8693775324225194, + "normalized_load_entropy": 0.9045266373053824, + "max_load_share": 0.05084745762711865 + } + }, + "s1_eos": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "a87c35f5fb645e75c6689d5144d549b355ebafa88591e73fdbfcff1e25bf29f0", + "route_weight_sha256": "cbc3dced6805df6ae282a800fd97086327cc349517a97cd642ae05b122b4dbfa", + "loads": [ + 3, + 3, + 4, + 3, + 1, + 6, + 0, + 0, + 2, + 0, + 2, + 10, + 0, + 5, + 0, + 0, + 1, + 0, + 1, + 0, + 9, + 0, + 11, + 3, + 3, + 3, + 2, + 0, + 0, + 0, + 1, + 2, + 2, + 2, + 2, + 1, + 3, + 1, + 12, + 6, + 2, + 0, + 3, + 0, + 2, + 6, + 1, + 9, + 0, + 5, + 13, + 4, + 7, + 2, + 7, + 4, + 3, + 5, + 4, + 3, + 9, + 1, + 8, + 2 + ], + "weighted_loads": [ + 0.10634701512753963, + 0.14144133776426315, + 0.27540223300457, + 0.1126989796757698, + 0.02125365287065506, + 0.4573301188647747, + 0.0, + 0.0, + 0.1502220630645752, + 0.0, + 0.06336931884288788, + 0.6181591432541609, + 0.0, + 0.7470389492809772, + 0.0, + 0.0, + 0.03503117710351944, + 0.0, + 0.0245363749563694, + 0.0, + 0.4476710110902786, + 0.0, + 1.0419202279299498, + 0.13999446108937263, + 0.08721140585839748, + 0.1851317174732685, + 0.07113715261220932, + 0.0, + 0.0, + 0.0, + 0.05015521124005318, + 0.0883701927959919, + 0.2272527515888214, + 0.07492836192250252, + 0.16706988587975502, + 0.036243192851543427, + 0.1299876794219017, + 0.029996059834957123, + 0.6397671885788441, + 0.24314159713685513, + 0.08371472731232643, + 0.0, + 0.09582369215786457, + 0.0, + 0.10312489047646523, + 0.3851507678627968, + 0.05247873440384865, + 0.5336273685097694, + 0.0, + 0.5544154867529869, + 0.7879049777984619, + 0.26065946742892265, + 0.547091644257307, + 0.08195847272872925, + 0.27930548787117004, + 0.15365422144532204, + 0.14236833155155182, + 0.41821445524692535, + 0.21585675328969955, + 0.17929378896951675, + 0.3397498819977045, + 0.03962085396051407, + 0.408737113699317, + 0.08253910765051842 + ], + "unique_experts": 49, + "load_cv": 1.0209267487799853, + "normalized_load_entropy": 0.874982360505015, + "max_load_share": 0.06372549019607843 + }, + "full_input": { + "tokens": 75, + "top_k": 6, + "decisions": 450, + "ordered_route_sha256": "be20cdaf822a0f910814ce84b1f9d2266ceba67a4a207351c393a5bc6d2e0d01", + "route_weight_sha256": "cdcb092c412ed69b1618542eefdf20e51500c67df9483620151dbcbff2a970e5", + "loads": [ + 11, + 6, + 18, + 3, + 2, + 8, + 0, + 2, + 12, + 1, + 3, + 15, + 0, + 6, + 9, + 3, + 1, + 10, + 24, + 1, + 9, + 0, + 12, + 3, + 3, + 3, + 2, + 0, + 0, + 1, + 12, + 4, + 5, + 3, + 6, + 15, + 4, + 6, + 13, + 9, + 7, + 0, + 6, + 5, + 2, + 7, + 18, + 12, + 3, + 19, + 15, + 7, + 15, + 13, + 9, + 5, + 6, + 13, + 8, + 7, + 9, + 3, + 8, + 8 + ], + "weighted_loads": [ + 0.5499509535729885, + 0.28480806574225426, + 1.4812549278140068, + 0.1126989796757698, + 0.05793952941894531, + 0.5155562814325094, + 0.0, + 0.07015068829059601, + 1.0362839810550213, + 0.03707471862435341, + 0.07515035476535559, + 1.0404665935784578, + 0.0, + 0.7921065725386143, + 1.1435240674763918, + 0.08120915479958057, + 0.03503117710351944, + 0.5844930559396744, + 1.8794173244386911, + 0.1361183524131775, + 0.4476710110902786, + 0.0, + 1.0766237247735262, + 0.13999446108937263, + 0.08721140585839748, + 0.1851317174732685, + 0.07113715261220932, + 0.0, + 0.0, + 0.03722378984093666, + 0.5955923236906528, + 0.33207061141729355, + 0.3682313933968544, + 0.15148155763745308, + 0.5770338512957096, + 1.3527511432766914, + 0.15345339849591255, + 0.24816397204995155, + 0.6769563108682632, + 0.3236256670206785, + 0.2524243351072073, + 0.0, + 0.1872924417257309, + 0.45899755507707596, + 0.10312489047646523, + 0.46913885325193405, + 3.050647836178541, + 0.6864606440067291, + 0.09551547653973103, + 1.2036485355347395, + 1.0028746854513884, + 0.5081932730972767, + 1.0912629198282957, + 0.9063321948051453, + 0.39566896110773087, + 0.18873926252126694, + 1.1555005125701427, + 0.792727192863822, + 0.6079169064760208, + 0.40889072604477406, + 0.3397498819977045, + 0.10422316379845142, + 0.408737113699317, + 0.31228572130203247 + ], + "unique_experts": 58, + "load_cv": 0.7761252285362011, + "normalized_load_entropy": 0.9227105843849017, + "max_load_share": 0.05333333333333334 + } + }, + "s0_bos": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "8e0e0052535a8c284b316a42b4e55830f3c44b0e75413bd84f24018a29ea401b", + "route_weight_sha256": "390dbfd9fe111b14baf47557bc536befdc5e5213206a73e9e90cfcdf622ccec7", + "loads": [ + 1, + 3, + 4, + 3, + 0, + 6, + 0, + 0, + 2, + 0, + 1, + 11, + 0, + 5, + 0, + 0, + 2, + 0, + 0, + 0, + 8, + 0, + 11, + 2, + 2, + 3, + 2, + 0, + 0, + 0, + 1, + 2, + 2, + 3, + 2, + 0, + 3, + 1, + 12, + 7, + 2, + 0, + 4, + 0, + 2, + 6, + 2, + 9, + 0, + 6, + 15, + 4, + 7, + 2, + 5, + 5, + 6, + 5, + 4, + 3, + 8, + 0, + 8, + 2 + ], + "weighted_loads": [ + 0.037608347833156586, + 0.13826948776841164, + 0.2773993946611881, + 0.12116707116365433, + 0.0, + 0.4554424211382866, + 0.0, + 0.0, + 0.14888064563274384, + 0.0, + 0.038471296429634094, + 0.6615999843925238, + 0.0, + 0.7713577523827553, + 0.0, + 0.0, + 0.06931041553616524, + 0.0, + 0.0, + 0.0, + 0.4173365719616413, + 0.0, + 1.0047647319734097, + 0.10616594180464745, + 0.06561058387160301, + 0.19047920778393745, + 0.07351095601916313, + 0.0, + 0.0, + 0.0, + 0.04882437363266945, + 0.09934449195861816, + 0.2178792655467987, + 0.11410784535109997, + 0.1849321871995926, + 0.0, + 0.13969074748456478, + 0.030431604012846947, + 0.6558539196848869, + 0.28388650715351105, + 0.0836075060069561, + 0.0, + 0.11784066818654537, + 0.0, + 0.10698748752474785, + 0.3872314691543579, + 0.0861552506685257, + 0.5245279893279076, + 0.0, + 0.5839487221091986, + 0.8388610910624266, + 0.260305505245924, + 0.5405258797109127, + 0.08280852437019348, + 0.2228926233947277, + 0.18498402275145054, + 0.23787669092416763, + 0.40997372195124626, + 0.21253294125199318, + 0.1877872347831726, + 0.31805353984236717, + 0.0, + 0.4023015759885311, + 0.07565351203083992 + ], + "unique_experts": 45, + "load_cv": 1.073786789811221, + "normalized_load_entropy": 0.8599714741499672, + "max_load_share": 0.07352941176470588 + }, + "full_input": { + "tokens": 59, + "top_k": 6, + "decisions": 354, + "ordered_route_sha256": "4f318ced6be466ce84a468255eba4bf9b90ba1e1ca3ba28ee4ef84c272a69a68", + "route_weight_sha256": "85a9b19f5a68e1582c39a6bc5c7c16cf854af539aeb61ace0e03b7595ccb3da7", + "loads": [ + 7, + 4, + 16, + 3, + 0, + 8, + 0, + 0, + 10, + 1, + 1, + 15, + 1, + 5, + 5, + 3, + 2, + 0, + 19, + 0, + 8, + 1, + 11, + 3, + 2, + 3, + 3, + 0, + 0, + 0, + 7, + 2, + 4, + 3, + 2, + 4, + 3, + 3, + 12, + 11, + 8, + 1, + 8, + 0, + 2, + 7, + 10, + 9, + 2, + 17, + 18, + 6, + 16, + 10, + 5, + 5, + 7, + 8, + 5, + 6, + 8, + 2, + 8, + 4 + ], + "weighted_loads": [ + 0.43579473719000816, + 0.21172278001904488, + 1.4279560148715973, + 0.12116707116365433, + 0.0, + 0.5034627746790648, + 0.0, + 0.0, + 0.6370361633598804, + 0.03067946247756481, + 0.038471296429634094, + 0.9671019483357668, + 0.1612740308046341, + 0.7713577523827553, + 0.8437523990869522, + 0.09733249433338642, + 0.06931041553616524, + 0.0, + 1.1177123226225376, + 0.0, + 0.4173365719616413, + 0.02394253946840763, + 1.0047647319734097, + 0.1545109711587429, + 0.06561058387160301, + 0.19047920778393745, + 0.12142902985215187, + 0.0, + 0.0, + 0.0, + 0.30055470019578934, + 0.09934449195861816, + 0.3025575317442417, + 0.11410784535109997, + 0.1849321871995926, + 0.2602800019085407, + 0.13969074748456478, + 0.09508312121033669, + 0.6558539196848869, + 0.46701622381806374, + 0.3386008143424988, + 0.06446677446365356, + 0.2604125328361988, + 0.0, + 0.10698748752474785, + 0.477782666683197, + 1.9335560277104378, + 0.5245279893279076, + 0.11281540244817734, + 1.0988230295479298, + 1.0848185997456312, + 0.4667343236505985, + 1.1516309902071953, + 0.8092745095491409, + 0.2228926233947277, + 0.18498402275145054, + 0.46101195365190506, + 0.5631299242377281, + 0.24186677858233452, + 0.318066855892539, + 0.31805353984236717, + 0.05402558855712414, + 0.4023015759885311, + 0.1705251857638359 + ], + "unique_experts": 55, + "load_cv": 0.8839415932473089, + "normalized_load_entropy": 0.9033172603665599, + "max_load_share": 0.05367231638418079 + } + }, + "s1_bos": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "44fd563d4a12e37e78e55137d0e7f805bf419673936b8d9bf0a809fb0e734953", + "route_weight_sha256": "0c67f8dc76817ebace00b4ad6e4e6c88a8a6cb8d2313ddfc12b9642dcb2907d2", + "loads": [ + 1, + 3, + 4, + 3, + 0, + 6, + 0, + 0, + 2, + 0, + 0, + 10, + 0, + 5, + 0, + 0, + 3, + 0, + 0, + 0, + 9, + 0, + 11, + 2, + 1, + 3, + 2, + 0, + 0, + 0, + 2, + 3, + 2, + 2, + 2, + 0, + 3, + 1, + 12, + 6, + 2, + 0, + 4, + 0, + 2, + 6, + 2, + 9, + 0, + 5, + 15, + 4, + 8, + 2, + 8, + 4, + 4, + 5, + 4, + 3, + 9, + 0, + 8, + 2 + ], + "weighted_loads": [ + 0.03652359917759895, + 0.13476505503058434, + 0.27100277319550514, + 0.11232294514775276, + 0.0, + 0.4479537755250931, + 0.0, + 0.0, + 0.14734718203544617, + 0.0, + 0.0, + 0.6257436387240887, + 0.0, + 0.7421714998781681, + 0.0, + 0.0, + 0.09586493112146854, + 0.0, + 0.0, + 0.0, + 0.44149238243699074, + 0.0, + 1.047778245061636, + 0.10704084485769272, + 0.021653853356838226, + 0.18846182525157928, + 0.07515603303909302, + 0.0, + 0.0, + 0.0, + 0.07764927297830582, + 0.12492814101278782, + 0.2220408394932747, + 0.07824843376874924, + 0.1829616017639637, + 0.0, + 0.13048194535076618, + 0.029755685478448868, + 0.6667119786143303, + 0.24889991246163845, + 0.0808040238916874, + 0.0, + 0.11587203480303288, + 0.0, + 0.11319717019796371, + 0.39227404445409775, + 0.08669218420982361, + 0.5167602635920048, + 0.0, + 0.5438951626420021, + 0.8476861827075481, + 0.2668055556714535, + 0.5858509130775928, + 0.08498365059494972, + 0.3047256339341402, + 0.16206150129437447, + 0.17293566837906837, + 0.42376671731472015, + 0.2164081707596779, + 0.18834098428487778, + 0.35068947263062, + 0.0, + 0.4055183529853821, + 0.07284416258335114 + ], + "unique_experts": 44, + "load_cv": 1.0866000786272478, + "normalized_load_entropy": 0.856248691237861, + "max_load_share": 0.07352941176470588 + }, + "full_input": { + "tokens": 75, + "top_k": 6, + "decisions": 450, + "ordered_route_sha256": "f75d57efbf063d99819af85568ad9adc1eac48fa3392cfbefa55570916d78a84", + "route_weight_sha256": "685720d40ce08b8f0ee2d2f2f1c15474b1576d0b4b597726bbb48dcffd7442e9", + "loads": [ + 9, + 6, + 16, + 3, + 1, + 8, + 0, + 2, + 12, + 2, + 0, + 15, + 0, + 6, + 9, + 4, + 3, + 10, + 24, + 1, + 9, + 0, + 12, + 2, + 1, + 3, + 2, + 0, + 0, + 1, + 11, + 5, + 5, + 3, + 6, + 13, + 3, + 6, + 13, + 9, + 8, + 1, + 8, + 5, + 2, + 7, + 20, + 12, + 3, + 19, + 17, + 7, + 16, + 13, + 10, + 5, + 6, + 13, + 8, + 7, + 9, + 3, + 8, + 8 + ], + "weighted_loads": [ + 0.48012753762304783, + 0.27813178300857544, + 1.4085299335420132, + 0.11232294514775276, + 0.03668587654829025, + 0.5061799380928278, + 0.0, + 0.07015068829059601, + 1.0334091000258923, + 0.06778068281710148, + 0.0, + 1.027096439152956, + 0.0, + 0.7872391231358051, + 1.2100105229765177, + 0.11614504642784595, + 0.09586493112146854, + 0.5844930559396744, + 1.8857152592390776, + 0.1361183524131775, + 0.44149238243699074, + 0.0, + 1.0824817419052124, + 0.10704084485769272, + 0.021653853356838226, + 0.18846182525157928, + 0.07515603303909302, + 0.0, + 0.0, + 0.03722378984093666, + 0.6135454140603542, + 0.36862855963408947, + 0.3698866069316864, + 0.1548016294836998, + 0.5929255671799183, + 1.2817891500890255, + 0.13048194535076618, + 0.2479235976934433, + 0.7039011009037495, + 0.32826788909733295, + 0.2950919307768345, + 0.04540276899933815, + 0.2590945288538933, + 0.45899755507707596, + 0.11319717019796371, + 0.4867282584309578, + 3.147264041006565, + 0.6695935390889645, + 0.09551547653973103, + 1.2019196692854166, + 1.0578073505312204, + 0.5135046504437923, + 1.1300221886485815, + 0.8980519659817219, + 0.421089107170701, + 0.19714654237031937, + 0.43376943469047546, + 0.8066908624023199, + 0.6084683239459991, + 0.4800198096781969, + 0.35068947263062, + 0.10667445324361324, + 0.4055183529853821, + 0.3025907762348652 + ], + "unique_experts": 58, + "load_cv": 0.7846301322562398, + "normalized_load_entropy": 0.9207690634100386, + "max_load_share": 0.05333333333333334 + } + }, + "s0_x": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "3fa436f7f01ede80df615775a8c3bd230a99f334659d7a2c85e74c0f407c9d00", + "route_weight_sha256": "ad2301265e2d0ba0089d3ab58da981566078919e3097eb22e850225e397eb717", + "loads": [ + 2, + 4, + 4, + 3, + 0, + 6, + 0, + 0, + 2, + 0, + 1, + 10, + 0, + 5, + 0, + 0, + 4, + 0, + 0, + 0, + 8, + 0, + 10, + 2, + 2, + 2, + 2, + 0, + 0, + 0, + 1, + 3, + 2, + 3, + 2, + 0, + 3, + 1, + 13, + 4, + 2, + 0, + 4, + 0, + 2, + 6, + 2, + 9, + 0, + 5, + 15, + 4, + 7, + 3, + 6, + 3, + 5, + 5, + 4, + 3, + 9, + 0, + 8, + 3 + ], + "weighted_loads": [ + 0.08809743821620941, + 0.18580928817391396, + 0.2781338170170784, + 0.11880751326680183, + 0.0, + 0.45212268084287643, + 0.0, + 0.0, + 0.14816227555274963, + 0.0, + 0.03622925281524658, + 0.6017296407371759, + 0.0, + 0.7309218198060989, + 0.0, + 0.0, + 0.12956676818430424, + 0.0, + 0.0, + 0.0, + 0.4154828451573849, + 0.0, + 0.9481313079595566, + 0.10449687018990517, + 0.06750805489718914, + 0.15428295359015465, + 0.0740726850926876, + 0.0, + 0.0, + 0.0, + 0.052019353955984116, + 0.12336977012455463, + 0.22483035176992416, + 0.11306197196245193, + 0.1622946783900261, + 0.0, + 0.12717174738645554, + 0.03305867314338684, + 0.728448823094368, + 0.16426158510148525, + 0.07914111018180847, + 0.0, + 0.1290692687034607, + 0.0, + 0.10611274093389511, + 0.38442377746105194, + 0.08810495212674141, + 0.541890662163496, + 0.0, + 0.5508781746029854, + 0.8360439073294401, + 0.259603563696146, + 0.5414467491209507, + 0.12053686752915382, + 0.25082549825310707, + 0.1268164962530136, + 0.1997733935713768, + 0.4053019769489765, + 0.21329227089881897, + 0.15838294103741646, + 0.35000657103955746, + 0.0, + 0.42106246016919613, + 0.1104543823748827 + ], + "unique_experts": 45, + "load_cv": 1.053545304471348, + "normalized_load_entropy": 0.864632362080127, + "max_load_share": 0.07352941176470588 + }, + "full_input": { + "tokens": 59, + "top_k": 6, + "decisions": 354, + "ordered_route_sha256": "4ff75f2504f8e488376385acadf768588284e3434382cf53fae035d07fe2a7af", + "route_weight_sha256": "3e0a954275724efa502ee57db91a852db26d607af6230a48f71cd2d4597cdc1f", + "loads": [ + 9, + 5, + 17, + 3, + 0, + 8, + 0, + 0, + 10, + 2, + 1, + 15, + 0, + 5, + 5, + 3, + 4, + 0, + 18, + 0, + 8, + 2, + 10, + 2, + 2, + 2, + 2, + 0, + 0, + 0, + 8, + 3, + 4, + 3, + 2, + 4, + 3, + 3, + 13, + 6, + 6, + 0, + 7, + 0, + 2, + 7, + 9, + 9, + 3, + 17, + 18, + 7, + 17, + 11, + 6, + 3, + 6, + 8, + 7, + 4, + 9, + 2, + 8, + 6 + ], + "weighted_loads": [ + 0.5304151251912117, + 0.2592625804245472, + 1.6085023321211338, + 0.11880751326680183, + 0.0, + 0.5001430343836546, + 0.0, + 0.0, + 0.6363177932798862, + 0.04975388944149017, + 0.03622925281524658, + 1.0218748431652784, + 0.0, + 0.7309218198060989, + 0.9358026869595051, + 0.09733249433338642, + 0.12956676818430424, + 0.0, + 1.0751338601112366, + 0.0, + 0.4154828451573849, + 0.04654880054295063, + 0.9481313079595566, + 0.10449687018990517, + 0.06750805489718914, + 0.15428295359015465, + 0.0740726850926876, + 0.0, + 0.0, + 0.0, + 0.3426581509411335, + 0.12336977012455463, + 0.32887985929846764, + 0.11306197196245193, + 0.1622946783900261, + 0.2532508112490177, + 0.12717174738645554, + 0.09771019034087658, + 0.728448823094368, + 0.21186036430299282, + 0.25144824385643005, + 0.0, + 0.21505971066653728, + 0.0, + 0.10611274093389511, + 0.4591575637459755, + 1.9657619930803776, + 0.541890662163496, + 0.1517796479165554, + 1.1107475142925978, + 1.082299042493105, + 0.5044889971613884, + 1.2493360713124275, + 0.7597933448851109, + 0.25082549825310707, + 0.1268164962530136, + 0.4229086562991142, + 0.5845562368631363, + 0.34635428711771965, + 0.19541581720113754, + 0.35000657103955746, + 0.05402558855712414, + 0.42106246016919613, + 0.2865735124796629 + ], + "unique_experts": 53, + "load_cv": 0.8868257041554982, + "normalized_load_entropy": 0.9014185218781461, + "max_load_share": 0.05084745762711865 + } + }, + "s1_x": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "2ede97ae6fa4e9dbe85af8b1a93a389b89176aa14ca4baea5d98104ea25d41a4", + "route_weight_sha256": "f3831c51a7e1ef2f03dce5e7793791177a9f2fda077f6b0002aef453c0f1cec6", + "loads": [ + 4, + 3, + 4, + 2, + 1, + 6, + 0, + 0, + 2, + 0, + 1, + 10, + 0, + 5, + 0, + 0, + 2, + 0, + 0, + 0, + 7, + 0, + 10, + 3, + 1, + 3, + 2, + 0, + 1, + 0, + 1, + 3, + 2, + 3, + 2, + 0, + 3, + 0, + 14, + 4, + 2, + 0, + 4, + 0, + 2, + 6, + 2, + 9, + 0, + 5, + 14, + 5, + 8, + 2, + 6, + 4, + 5, + 5, + 4, + 3, + 8, + 1, + 8, + 2 + ], + "weighted_loads": [ + 0.13915682584047318, + 0.13595154881477356, + 0.2735307812690735, + 0.06942307576537132, + 0.02167709730565548, + 0.4449800830334425, + 0.0, + 0.0, + 0.14474612474441528, + 0.0, + 0.033826179802417755, + 0.5977629981935024, + 0.0, + 0.7087490074336529, + 0.0, + 0.0, + 0.06749231554567814, + 0.0, + 0.0, + 0.0, + 0.38909363001585007, + 0.0, + 0.9947567768394947, + 0.1532496176660061, + 0.02289118617773056, + 0.1899195984005928, + 0.07395804300904274, + 0.0, + 0.032611265778541565, + 0.0, + 0.047885242849588394, + 0.12193350307643414, + 0.22093698382377625, + 0.1091336403042078, + 0.1766843944787979, + 0.0, + 0.13140710815787315, + 0.0, + 0.7510353270918131, + 0.16670174524188042, + 0.07429241761565208, + 0.0, + 0.131375377997756, + 0.0, + 0.10687021538615227, + 0.369753360748291, + 0.10630936548113823, + 0.5584017373621464, + 0.0, + 0.542205236852169, + 0.8203734047710896, + 0.303094994276762, + 0.5840612836182117, + 0.09141779690980911, + 0.22912587225437164, + 0.1561671979725361, + 0.197377547621727, + 0.4325355999171734, + 0.2173558473587036, + 0.18195127323269844, + 0.3152447883039713, + 0.032900240272283554, + 0.42194526456296444, + 0.07544080168008804 + ], + "unique_experts": 47, + "load_cv": 1.041802182649822, + "normalized_load_entropy": 0.869352712973147, + "max_load_share": 0.06862745098039216 + }, + "full_input": { + "tokens": 75, + "top_k": 6, + "decisions": 450, + "ordered_route_sha256": "3f1ef2fef92659fdd6d86b49776c63ea24765e6e72ee1e2210741c5d9d783cab", + "route_weight_sha256": "7321c4026adeff7c52ab83cbf4f9df61c4655cec8b9fe9b876ba7dd23fb4c49d", + "loads": [ + 14, + 6, + 17, + 2, + 2, + 8, + 0, + 2, + 13, + 2, + 1, + 15, + 0, + 6, + 9, + 3, + 2, + 10, + 23, + 1, + 7, + 0, + 11, + 3, + 1, + 3, + 2, + 0, + 1, + 1, + 10, + 5, + 5, + 4, + 6, + 12, + 3, + 5, + 15, + 7, + 7, + 0, + 6, + 6, + 2, + 7, + 19, + 12, + 4, + 20, + 16, + 9, + 17, + 13, + 8, + 5, + 7, + 13, + 8, + 6, + 8, + 3, + 8, + 9 + ], + "weighted_loads": [ + 0.7522044610232115, + 0.27931827679276466, + 1.5442224517464638, + 0.06942307576537132, + 0.05836297385394573, + 0.5032062456011772, + 0.0, + 0.07015068829059601, + 1.0716491267085075, + 0.0708112008869648, + 0.033826179802417755, + 0.9519317075610161, + 0.0, + 0.7538166306912899, + 1.1073610503226519, + 0.08120915479958057, + 0.06749231554567814, + 0.5844930559396744, + 1.849011642858386, + 0.1361183524131775, + 0.38909363001585007, + 0.0, + 1.0294602736830711, + 0.1532496176660061, + 0.02289118617773056, + 0.1899195984005928, + 0.07395804300904274, + 0.0, + 0.032611265778541565, + 0.03722378984093666, + 0.6371456161141396, + 0.3656339216977358, + 0.3598431721329689, + 0.18568683601915836, + 0.5866483598947525, + 1.2687596417963505, + 0.13140710815787315, + 0.21816791221499443, + 0.7882244493812323, + 0.24633214995265007, + 0.24051292799413204, + 0.0, + 0.18644363060593605, + 0.5091987662017345, + 0.10687021538615227, + 0.466827929019928, + 3.2128486074507236, + 0.7112350128591061, + 0.13385764323174953, + 1.1966608855873346, + 1.019572438672185, + 0.5959041304886341, + 1.2046666648238897, + 0.7311072424054146, + 0.34548934549093246, + 0.191252239048481, + 0.4582113139331341, + 0.8296293560415506, + 0.6094160005450249, + 0.38289749808609486, + 0.3152447883039713, + 0.09750255011022091, + 0.42194526456296444, + 0.37026336416602135 + ], + "unique_experts": 59, + "load_cv": 0.7862396832430762, + "normalized_load_entropy": 0.9220597768713162, + "max_load_share": 0.051111111111111114 + } + }, + "s0_period": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "ad2e142f2856600be1a034d6db4ca5720beffd5032b51f2fdcb70d4c40e270df", + "route_weight_sha256": "90601edd6caa0210c581db91513fc1ed03c6549b84a0ee7f0e7bf3512739b1db", + "loads": [ + 2, + 3, + 4, + 3, + 0, + 6, + 0, + 0, + 2, + 0, + 1, + 11, + 0, + 5, + 0, + 0, + 3, + 0, + 0, + 0, + 7, + 0, + 10, + 2, + 3, + 2, + 2, + 0, + 0, + 0, + 1, + 3, + 2, + 3, + 2, + 0, + 3, + 1, + 13, + 7, + 2, + 0, + 3, + 0, + 2, + 6, + 2, + 9, + 0, + 5, + 15, + 4, + 7, + 3, + 5, + 4, + 5, + 5, + 4, + 3, + 9, + 0, + 8, + 2 + ], + "weighted_loads": [ + 0.07766319066286087, + 0.13694626465439796, + 0.27677738294005394, + 0.11755117401480675, + 0.0, + 0.4478713646531105, + 0.0, + 0.0, + 0.14532262086868286, + 0.0, + 0.0353517085313797, + 0.6425307095050812, + 0.0, + 0.7386937439441681, + 0.0, + 0.0, + 0.09709515981376171, + 0.0, + 0.0, + 0.0, + 0.3935685120522976, + 0.0, + 0.9671833775937557, + 0.10710891708731651, + 0.09598652087152004, + 0.15020261704921722, + 0.07310237362980843, + 0.0, + 0.0, + 0.0, + 0.053190454840660095, + 0.12406114861369133, + 0.22279660403728485, + 0.11627023667097092, + 0.17563551664352417, + 0.0, + 0.12510554865002632, + 0.03132161125540733, + 0.7136470526456833, + 0.2728879563510418, + 0.08080897852778435, + 0.0, + 0.08796722441911697, + 0.0, + 0.10968466103076935, + 0.3866976499557495, + 0.09258315712213516, + 0.5256792679429054, + 0.0, + 0.547155536711216, + 0.831191336736083, + 0.25938649475574493, + 0.534315038472414, + 0.12254776060581207, + 0.2077805008739233, + 0.1563072856515646, + 0.19835781678557396, + 0.41480180248618126, + 0.21361569315195084, + 0.16718127205967903, + 0.3452313896268606, + 0.0, + 0.4220723509788513, + 0.07837049476802349 + ], + "unique_experts": 45, + "load_cv": 1.0637141952955955, + "normalized_load_entropy": 0.8632050122113525, + "max_load_share": 0.07352941176470588 + }, + "full_input": { + "tokens": 59, + "top_k": 6, + "decisions": 354, + "ordered_route_sha256": "20e048c5119f473c434230f16485ab337a39d6206274d334111d53c17fa8350e", + "route_weight_sha256": "52ba90eb50aa268d9acb2d4159ed0a2916cdaf7f651d7b01411c85bdfa225a63", + "loads": [ + 9, + 4, + 16, + 3, + 0, + 8, + 0, + 0, + 10, + 1, + 1, + 16, + 0, + 5, + 5, + 3, + 3, + 0, + 19, + 0, + 7, + 2, + 10, + 2, + 3, + 2, + 2, + 0, + 0, + 0, + 7, + 4, + 4, + 3, + 2, + 3, + 3, + 3, + 13, + 10, + 7, + 0, + 6, + 0, + 2, + 7, + 10, + 9, + 2, + 17, + 18, + 6, + 17, + 12, + 5, + 4, + 6, + 9, + 6, + 5, + 9, + 2, + 8, + 4 + ], + "weighted_loads": [ + 0.5235115066170692, + 0.2103995569050312, + 1.4310045912861824, + 0.11755117401480675, + 0.0, + 0.49589171819388866, + 0.0, + 0.0, + 0.6334781385958195, + 0.029472021386027336, + 0.0353517085313797, + 1.0419658683240414, + 0.0, + 0.7386937439441681, + 1.0619355477392673, + 0.09733249433338642, + 0.09709515981376171, + 0.0, + 1.1049301233142614, + 0.0, + 0.3935685120522976, + 0.055546125397086143, + 0.9671833775937557, + 0.10710891708731651, + 0.09598652087152004, + 0.15020261704921722, + 0.07310237362980843, + 0.0, + 0.0, + 0.0, + 0.3562302738428116, + 0.15138734504580498, + 0.3178657554090023, + 0.11627023667097092, + 0.17563551664352417, + 0.2589210271835327, + 0.12510554865002632, + 0.09597312845289707, + 0.7136470526456833, + 0.35055636428296566, + 0.2680895607918501, + 0.0, + 0.17395766638219357, + 0.0, + 0.10968466103076935, + 0.4675524979829788, + 2.174237422645092, + 0.5256792679429054, + 0.11281540244817734, + 1.0946654248982668, + 1.0845016296952963, + 0.4626644477248192, + 1.211634911596775, + 0.7696628794074059, + 0.2077805008739233, + 0.1563072856515646, + 0.4214930795133114, + 0.6305491663515568, + 0.2820068784058094, + 0.22537807747721672, + 0.3452313896268606, + 0.05402558855712414, + 0.4220723509788513, + 0.17324216850101948 + ], + "unique_experts": 53, + "load_cv": 0.9061942598821544, + "normalized_load_entropy": 0.89809179162128, + "max_load_share": 0.05367231638418079 + } + }, + "s1_period": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "91caea21bcc173c018cf7284d08a355daab4b6824c1058bf202c9aa46aaca784", + "route_weight_sha256": "bb38731ce5c48827e1060cad127fad2b502cd7129f30b5f3757d3fe53f9c9c9f", + "loads": [ + 3, + 3, + 4, + 2, + 1, + 6, + 0, + 0, + 2, + 0, + 0, + 9, + 0, + 5, + 0, + 0, + 1, + 0, + 0, + 0, + 8, + 0, + 11, + 3, + 2, + 3, + 2, + 0, + 1, + 0, + 2, + 3, + 3, + 3, + 2, + 0, + 3, + 0, + 13, + 6, + 2, + 0, + 4, + 0, + 2, + 6, + 2, + 9, + 0, + 5, + 15, + 4, + 8, + 2, + 5, + 4, + 4, + 5, + 4, + 3, + 8, + 0, + 8, + 3 + ], + "weighted_loads": [ + 0.10916494205594063, + 0.13069716468453407, + 0.27041810750961304, + 0.06821268051862717, + 0.021797433495521545, + 0.4426043275743723, + 0.0, + 0.0, + 0.15288300812244415, + 0.0, + 0.0, + 0.5756355673074722, + 0.0, + 0.7311723753809929, + 0.0, + 0.0, + 0.03697158768773079, + 0.0, + 0.0, + 0.0, + 0.42736751586198807, + 0.0, + 1.0358068868517876, + 0.14918435364961624, + 0.06698081456124783, + 0.18897581100463867, + 0.0713612549006939, + 0.0, + 0.03301644325256348, + 0.0, + 0.07660062238574028, + 0.12036585435271263, + 0.24996580556035042, + 0.10755469836294651, + 0.18218538910150528, + 0.0, + 0.12948966026306152, + 0.0, + 0.695735976099968, + 0.23282581008970737, + 0.0751798264682293, + 0.0, + 0.11434441991150379, + 0.0, + 0.11081981658935547, + 0.3696790412068367, + 0.11011968925595284, + 0.5520759411156178, + 0.0, + 0.5335788056254387, + 0.8375798389315605, + 0.26234380155801773, + 0.5850968658924103, + 0.09231715649366379, + 0.18892124108970165, + 0.1578955240547657, + 0.1688857264816761, + 0.4368997886776924, + 0.2184758335351944, + 0.18223213776946068, + 0.3129406310617924, + 0.0, + 0.43356035463511944, + 0.11685377545654774 + ], + "unique_experts": 45, + "load_cv": 1.0520845823761813, + "normalized_load_entropy": 0.865062528373275, + "max_load_share": 0.07352941176470588 + }, + "full_input": { + "tokens": 75, + "top_k": 6, + "decisions": 450, + "ordered_route_sha256": "8a60d3e7559995f4ee5f4690ce3f5259710306fb31679309063c91334d3a87fb", + "route_weight_sha256": "fe1d1de6fcecc761968b56f96d79b53274502809e7e9425482f3db0a615f3533", + "loads": [ + 11, + 6, + 16, + 2, + 2, + 8, + 0, + 2, + 12, + 2, + 0, + 14, + 0, + 6, + 9, + 3, + 1, + 10, + 23, + 1, + 8, + 0, + 12, + 3, + 2, + 3, + 2, + 0, + 1, + 1, + 10, + 5, + 6, + 4, + 6, + 13, + 3, + 5, + 14, + 9, + 8, + 0, + 6, + 6, + 2, + 7, + 20, + 12, + 3, + 20, + 17, + 9, + 17, + 14, + 7, + 5, + 6, + 14, + 8, + 5, + 8, + 3, + 8, + 10 + ], + "weighted_loads": [ + 0.5527688805013895, + 0.2740638926625252, + 1.4071548357605934, + 0.06821268051862717, + 0.0584833100438118, + 0.500830490142107, + 0.0, + 0.07015068829059601, + 1.0389449261128902, + 0.08049721270799637, + 0.0, + 0.9927985742688179, + 0.0, + 0.7762399986386299, + 1.151254141703248, + 0.08120915479958057, + 0.03697158768773079, + 0.5844930559396744, + 1.8670454937964678, + 0.1361183524131775, + 0.42736751586198807, + 0.0, + 1.070510383695364, + 0.14918435364961624, + 0.06698081456124783, + 0.18897581100463867, + 0.0713612549006939, + 0.0, + 0.03301644325256348, + 0.03722378984093666, + 0.586345236748457, + 0.3640662729740143, + 0.38013492710888386, + 0.18410789407789707, + 0.5921493545174599, + 1.265091810375452, + 0.12948966026306152, + 0.21816791221499443, + 0.7329250983893871, + 0.3336000572890043, + 0.26152748614549637, + 0.0, + 0.16941267251968384, + 0.4867270961403847, + 0.11081981658935547, + 0.4724244624376297, + 3.236626137048006, + 0.7049092166125774, + 0.09551547653973103, + 1.2059694398194551, + 1.030139496549964, + 0.6126487366855145, + 1.1812966335564852, + 0.7972922213375568, + 0.3052847143262625, + 0.1929805651307106, + 0.4297194927930832, + 0.8698602188378572, + 0.6105359867215157, + 0.3607228100299835, + 0.3129406310617924, + 0.09359430707991123, + 0.43356035463511944, + 0.37767371721565723 + ], + "unique_experts": 58, + "load_cv": 0.7918473478027329, + "normalized_load_entropy": 0.9199235785640486, + "max_load_share": 0.051111111111111114 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 34, + "ordered_topk_exact_tokens": 16, + "set_exact_tokens": 22, + "mean_set_jaccard": 0.8991596638655462, + "mean_token_weighted_tv": 0.016328593716025352, + "aggregate_load_tv": 0.05392156862745098 + }, + "system_bos": { + "tokens": 34, + "ordered_topk_exact_tokens": 18, + "set_exact_tokens": 24, + "mean_set_jaccard": 0.9159663865546219, + "mean_token_weighted_tv": 0.016142269897767726, + "aggregate_load_tv": 0.04411764705882354 + }, + "system_x": { + "tokens": 34, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 21, + "mean_set_jaccard": 0.8907563025210083, + "mean_token_weighted_tv": 0.021446440478458124, + "aggregate_load_tv": 0.053921568627450976 + }, + "system_period": { + "tokens": 34, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.8739495798319328, + "mean_token_weighted_tv": 0.023254477665485704, + "aggregate_load_tv": 0.058823529411764705 + }, + "bos_at_s0": { + "tokens": 34, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 21, + "mean_set_jaccard": 0.8907563025210083, + "mean_token_weighted_tv": 0.019382229567888903, + "aggregate_load_tv": 0.05392156862745098 + }, + "bos_at_s1": { + "tokens": 34, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 20, + "mean_set_jaccard": 0.8697478991596638, + "mean_token_weighted_tv": 0.02255032175932737, + "aggregate_load_tv": 0.05392156862745098 + }, + "x_at_s0": { + "tokens": 34, + "ordered_topk_exact_tokens": 18, + "set_exact_tokens": 22, + "mean_set_jaccard": 0.8991596638655462, + "mean_token_weighted_tv": 0.020421111654928503, + "aggregate_load_tv": 0.0392156862745098 + }, + "x_at_s1": { + "tokens": 34, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.8487394957983193, + "mean_token_weighted_tv": 0.0283174933591748, + "aggregate_load_tv": 0.06862745098039216 + }, + "period_at_s0": { + "tokens": 34, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 21, + "mean_set_jaccard": 0.8907563025210083, + "mean_token_weighted_tv": 0.020869681858183706, + "aggregate_load_tv": 0.0392156862745098 + }, + "period_at_s1": { + "tokens": 34, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 20, + "mean_set_jaccard": 0.8697478991596639, + "mean_token_weighted_tv": 0.024853799492120743, + "aggregate_load_tv": 0.06372549019607844 + } + } + }, + "layer_19": { + "layer": 19, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "d8a186b88a3d517cbd1c89e922d49d73f466d49ca0131f31769a099c020c2d8c", + "route_weight_sha256": "f1766bf53ff1eeb62dc64cc8c547c52056de686e5557ab8a3bbb6e2394cc870e", + "loads": [ + 0, + 0, + 8, + 8, + 0, + 0, + 2, + 6, + 4, + 14, + 2, + 2, + 2, + 8, + 5, + 4, + 1, + 0, + 2, + 3, + 0, + 6, + 0, + 1, + 1, + 0, + 0, + 6, + 3, + 0, + 7, + 13, + 0, + 0, + 6, + 0, + 1, + 6, + 2, + 1, + 1, + 1, + 0, + 5, + 9, + 0, + 2, + 5, + 1, + 5, + 0, + 10, + 3, + 3, + 2, + 1, + 5, + 7, + 3, + 7, + 3, + 0, + 5, + 2 + ], + "weighted_loads": [ + 0.0, + 0.0, + 0.776010874658823, + 0.8212923295795918, + 0.0, + 0.0, + 0.07074581831693649, + 0.2550956793129444, + 0.22751596197485924, + 0.9163500778377056, + 0.08818124234676361, + 0.09672116115689278, + 0.118038609623909, + 0.32062414661049843, + 0.39711324870586395, + 0.15682167746126652, + 0.02813607081770897, + 0.0, + 0.059738775715231895, + 0.09601548500359058, + 0.0, + 0.3287806734442711, + 0.0, + 0.031667228788137436, + 0.03413938358426094, + 0.0, + 0.0, + 0.3081367388367653, + 0.11311152577400208, + 0.0, + 0.35811014845967293, + 1.2563371397554874, + 0.0, + 0.0, + 0.6323307175189257, + 0.0, + 0.03269398584961891, + 0.22637674771249294, + 0.11005454137921333, + 0.03363792225718498, + 0.04340407997369766, + 0.028571192175149918, + 0.0, + 0.14748889952898026, + 0.7464041225612164, + 0.0, + 0.12027072533965111, + 0.3631983995437622, + 0.029003968462347984, + 0.5626000612974167, + 0.0, + 0.4832284301519394, + 0.1927707903087139, + 0.26475192606449127, + 0.0967525951564312, + 0.04273277521133423, + 0.24304597824811935, + 0.37579092010855675, + 0.21380306035280228, + 0.78069275803864, + 0.12547066435217857, + 0.0, + 0.24696635827422142, + 0.07901005819439888 + ], + "unique_experts": 47, + "load_cv": 1.0343950344399984, + "normalized_load_entropy": 0.8670972077706243, + "max_load_share": 0.06862745098039216 + }, + "full_input": { + "tokens": 59, + "top_k": 6, + "decisions": 354, + "ordered_route_sha256": "7e7158bf321a3bb0dff50c155bfa4d1bf3387294460d2a1e43b56c56b96e12d6", + "route_weight_sha256": "f0e43b13776cb44cd14d6e0c4453b3a5873c81e0be36b1c545ba55daa16ac4a0", + "loads": [ + 2, + 3, + 11, + 8, + 5, + 1, + 13, + 6, + 4, + 20, + 2, + 2, + 11, + 9, + 10, + 4, + 4, + 1, + 2, + 7, + 0, + 6, + 5, + 10, + 9, + 0, + 0, + 8, + 3, + 4, + 12, + 13, + 0, + 0, + 6, + 2, + 3, + 11, + 4, + 1, + 5, + 3, + 8, + 6, + 10, + 0, + 2, + 10, + 2, + 6, + 0, + 10, + 3, + 8, + 8, + 1, + 5, + 7, + 9, + 7, + 5, + 4, + 11, + 2 + ], + "weighted_loads": [ + 0.04301663814112544, + 0.2725894972681999, + 1.173040321096778, + 0.8212923295795918, + 0.8424728289246559, + 0.013181102462112904, + 0.5199460228905082, + 0.2550956793129444, + 0.22751596197485924, + 1.261708427220583, + 0.08818124234676361, + 0.09672116115689278, + 0.7079647369682789, + 0.3597186617553234, + 0.9022437110543251, + 0.15682167746126652, + 0.1423158459365368, + 0.06157170236110687, + 0.059738775715231895, + 0.27484496124088764, + 0.0, + 0.3287806734442711, + 0.1818158719688654, + 0.3378053642809391, + 0.5258590229786932, + 0.0, + 0.0, + 0.3810344487428665, + 0.11311152577400208, + 0.16086744144558907, + 0.5545341297984123, + 1.2563371397554874, + 0.0, + 0.0, + 0.6323307175189257, + 0.09229726344347, + 0.07484651287086308, + 0.4726122748106718, + 0.1845150925219059, + 0.03363792225718498, + 0.1576797291636467, + 0.13702194765210152, + 0.5894753560423851, + 0.20531325414776802, + 0.757115725427866, + 0.0, + 0.12027072533965111, + 0.9443841315805912, + 0.06659720651805401, + 0.6225281395018101, + 0.0, + 0.4832284301519394, + 0.1927707903087139, + 0.5895798727869987, + 1.8268203623592854, + 0.04273277521133423, + 0.24304597824811935, + 0.37579092010855675, + 0.4853663332760334, + 0.78069275803864, + 0.2180577777326107, + 0.2289197687059641, + 0.757294051349163, + 0.07901005819439888 + ], + "unique_experts": 57, + "load_cv": 0.7494984331574681, + "normalized_load_entropy": 0.9254413751789616, + "max_load_share": 0.05649717514124294 + } + }, + "s1_eos": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "5d89724c597bb23b5e4ec410398091e72056745c19cfb449d5fd25755f9ab963", + "route_weight_sha256": "84b9b207a18bb4cdbd90dbc8d85256c4ca406cd365c0b235d34a3422b2cecf69", + "loads": [ + 0, + 0, + 8, + 6, + 0, + 0, + 2, + 6, + 4, + 14, + 2, + 2, + 2, + 8, + 5, + 6, + 1, + 0, + 2, + 1, + 0, + 6, + 0, + 1, + 0, + 0, + 0, + 7, + 3, + 0, + 6, + 13, + 0, + 0, + 6, + 0, + 1, + 6, + 2, + 1, + 1, + 1, + 0, + 4, + 9, + 0, + 2, + 4, + 1, + 5, + 1, + 11, + 4, + 4, + 2, + 1, + 6, + 7, + 3, + 7, + 4, + 0, + 5, + 1 + ], + "weighted_loads": [ + 0.0, + 0.0, + 0.7848165743052959, + 0.7432753033936024, + 0.0, + 0.0, + 0.07283705845475197, + 0.2505407240241766, + 0.2185467779636383, + 0.9360516015440226, + 0.09418859705328941, + 0.0925528034567833, + 0.11374478414654732, + 0.31925936602056026, + 0.3918938376009464, + 0.23089785315096378, + 0.028331996873021126, + 0.0, + 0.06024765595793724, + 0.04274001345038414, + 0.0, + 0.32297560200095177, + 0.0, + 0.033048197627067566, + 0.0, + 0.0, + 0.0, + 0.3378317207098007, + 0.11353069171309471, + 0.0, + 0.3088526055216789, + 1.2571878246963024, + 0.0, + 0.0, + 0.6575241852551699, + 0.0, + 0.032117459923028946, + 0.23252941109240055, + 0.1090480275452137, + 0.033079199492931366, + 0.044939637184143066, + 0.027989696711301804, + 0.0, + 0.12793132849037647, + 0.7371115833520889, + 0.0, + 0.118055809289217, + 0.31421877071261406, + 0.031226783990859985, + 0.5578303784132004, + 0.03505336493253708, + 0.5090049467980862, + 0.21116127260029316, + 0.2942963168025017, + 0.10035809129476547, + 0.04332869127392769, + 0.2723450716584921, + 0.3718818984925747, + 0.21859266236424446, + 0.7937827855348587, + 0.16484099626541138, + 0.0, + 0.24663181975483894, + 0.041389670222997665 + ], + "unique_experts": 47, + "load_cv": 1.0462212997611058, + "normalized_load_entropy": 0.8642252139494205, + "max_load_share": 0.06862745098039216 + }, + "full_input": { + "tokens": 75, + "top_k": 6, + "decisions": 450, + "ordered_route_sha256": "610ce8ccf6beacb0ca0824103f51705482afa14fe06bcdddcfcc13e8990a72ff", + "route_weight_sha256": "9981ac3d6e7020f4e27b0811aefad1058533e0cf49b29082ed1b7ea0d92229f0", + "loads": [ + 2, + 7, + 11, + 6, + 12, + 2, + 14, + 6, + 4, + 20, + 3, + 10, + 14, + 8, + 16, + 8, + 4, + 5, + 3, + 8, + 4, + 7, + 6, + 8, + 13, + 0, + 0, + 9, + 4, + 1, + 10, + 13, + 3, + 0, + 6, + 2, + 4, + 9, + 3, + 3, + 6, + 8, + 9, + 5, + 10, + 0, + 2, + 16, + 2, + 7, + 6, + 11, + 7, + 16, + 7, + 1, + 8, + 9, + 12, + 8, + 7, + 8, + 14, + 3 + ], + "weighted_loads": [ + 0.025603522546589375, + 0.4601423889398575, + 1.1803476233035326, + 0.7432753033936024, + 1.4986704736948013, + 0.09115006495267153, + 0.6317421356216073, + 0.2505407240241766, + 0.2185467779636383, + 1.267505133524537, + 0.1606302745640278, + 0.8444772511720657, + 0.7894678935408592, + 0.31925936602056026, + 1.301810273900628, + 0.33894998766481876, + 0.4305311683565378, + 0.22980165109038353, + 0.15809130296111107, + 0.38422439247369766, + 0.3317092955112457, + 0.37720494717359543, + 0.24981775879859924, + 0.2670565005391836, + 0.8605490764603019, + 0.0, + 0.0, + 0.43502575531601906, + 0.15058713778853416, + 0.035085514187812805, + 0.4586477726697922, + 1.2571878246963024, + 0.11836288496851921, + 0.0, + 0.6575241852551699, + 0.06743595376610756, + 0.11535862693563104, + 0.3780232146382332, + 0.1533237360417843, + 0.1366710029542446, + 0.19428054755553603, + 0.36009199172258377, + 0.7077616788446903, + 0.165619483217597, + 0.7478231862187386, + 0.0, + 0.118055809289217, + 1.3033567667007446, + 0.06655143201351166, + 0.6666690073907375, + 0.37224575132131577, + 0.5090049467980862, + 0.3588440716266632, + 1.179727092385292, + 1.8137336000800133, + 0.04332869127392769, + 0.3556641470640898, + 0.4594592973589897, + 0.6838603317737579, + 0.8282043747603893, + 0.2937610149383545, + 0.3783957939594984, + 0.9441196992993355, + 0.20895230025053024 + ], + "unique_experts": 60, + "load_cv": 0.6439231608173736, + "normalized_load_entropy": 0.9448165679673053, + "max_load_share": 0.044444444444444446 + } + }, + "s0_bos": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "ef9bafc41cb9c3ab9e5872f93bbb12f4296f87d9aac2991ef5bdeac2b82edb75", + "route_weight_sha256": "41447cd1ca6c6c05075982dd38b9f3a6f5c55aa7be9fcb4864ece6f4cc44fcf9", + "loads": [ + 0, + 0, + 8, + 8, + 1, + 0, + 2, + 6, + 4, + 14, + 3, + 2, + 2, + 8, + 5, + 3, + 0, + 0, + 2, + 2, + 0, + 7, + 0, + 1, + 0, + 0, + 0, + 6, + 2, + 0, + 6, + 13, + 0, + 1, + 6, + 0, + 0, + 6, + 2, + 1, + 1, + 1, + 0, + 4, + 9, + 0, + 2, + 5, + 0, + 5, + 0, + 12, + 3, + 3, + 2, + 2, + 5, + 7, + 3, + 7, + 5, + 0, + 5, + 2 + ], + "weighted_loads": [ + 0.0, + 0.0, + 0.7697448134422302, + 0.8031722754240036, + 0.025960281491279602, + 0.0, + 0.06949888169765472, + 0.25491957925260067, + 0.22442856058478355, + 0.9192632157355547, + 0.13444149121642113, + 0.10738631710410118, + 0.10962625592947006, + 0.31489085778594017, + 0.40224872156977654, + 0.12518596276640892, + 0.0, + 0.0, + 0.061901338398456573, + 0.0717503484338522, + 0.0, + 0.3628245033323765, + 0.0, + 0.0330699160695076, + 0.0, + 0.0, + 0.0, + 0.29768362268805504, + 0.07821709662675858, + 0.0, + 0.3158842585980892, + 1.2357121370732784, + 0.0, + 0.03791161626577377, + 0.6432336065918207, + 0.0, + 0.0, + 0.22815104387700558, + 0.10080889984965324, + 0.03509038686752319, + 0.04480192810297012, + 0.029326505959033966, + 0.0, + 0.12205251678824425, + 0.7553727813065052, + 0.0, + 0.12393126636743546, + 0.3667062111198902, + 0.0, + 0.5481356233358383, + 0.0, + 0.5741917062550783, + 0.18639101833105087, + 0.27350975573062897, + 0.10486386343836784, + 0.06814237497746944, + 0.2451939396560192, + 0.37399129197001457, + 0.19872918352484703, + 0.7990189585834742, + 0.21524471789598465, + 0.0, + 0.24147836863994598, + 0.07277137041091919 + ], + "unique_experts": 45, + "load_cv": 1.0637141952955955, + "normalized_load_entropy": 0.8597071901581924, + "max_load_share": 0.06862745098039216 + }, + "full_input": { + "tokens": 59, + "top_k": 6, + "decisions": 354, + "ordered_route_sha256": "a64ffdf4cab2c89e948d47e4b9deaa79624c986c3f9179abff07901145cd020a", + "route_weight_sha256": "e3e6fbe4be725bfdbb96cec870f90ed172173eb92e955db5d929d0f9a546e91f", + "loads": [ + 1, + 3, + 11, + 8, + 6, + 1, + 12, + 6, + 4, + 19, + 3, + 2, + 11, + 11, + 10, + 3, + 3, + 1, + 2, + 7, + 0, + 7, + 5, + 7, + 8, + 0, + 1, + 8, + 2, + 4, + 13, + 13, + 0, + 1, + 6, + 3, + 0, + 11, + 4, + 1, + 4, + 4, + 8, + 5, + 10, + 1, + 2, + 10, + 2, + 6, + 0, + 12, + 4, + 7, + 7, + 2, + 5, + 7, + 9, + 7, + 7, + 4, + 11, + 2 + ], + "weighted_loads": [ + 0.038595519959926605, + 0.2582978457212448, + 1.141455402597785, + 0.8031722754240036, + 0.7332860678434372, + 0.013181102462112904, + 0.47860029246658087, + 0.25491957925260067, + 0.22442856058478355, + 1.2263248395174742, + 0.13444149121642113, + 0.10738631710410118, + 0.6903350092470646, + 0.4357800595462322, + 0.9011335782706738, + 0.12518596276640892, + 0.11417977511882782, + 0.7182164192199707, + 0.061901338398456573, + 0.4769193846732378, + 0.0, + 0.3628245033323765, + 0.1818158719688654, + 0.2540117520838976, + 0.6141277942806482, + 0.0, + 0.03740096837282181, + 0.37689268216490746, + 0.07821709662675858, + 0.16086744144558907, + 0.5954323709011078, + 1.2357121370732784, + 0.0, + 0.03791161626577377, + 0.6432336065918207, + 0.10929363034665585, + 0.0, + 0.466979106888175, + 0.1752694509923458, + 0.03509038686752319, + 0.16331498883664608, + 0.17198748141527176, + 0.5894753560423851, + 0.179876871407032, + 0.7660843841731548, + 0.02837376855313778, + 0.12393126636743546, + 0.9434007629752159, + 0.07587803900241852, + 0.6115458831191063, + 0.0, + 0.5741917062550783, + 0.2178501971065998, + 0.5305545032024384, + 0.8910821862518787, + 0.06814237497746944, + 0.2451939396560192, + 0.37399129197001457, + 0.47029245644807816, + 0.7990189585834742, + 0.3071315363049507, + 0.22812294028699398, + 0.7518060617148876, + 0.07277137041091919 + ], + "unique_experts": 59, + "load_cv": 0.7405872461647637, + "normalized_load_entropy": 0.9285597776900484, + "max_load_share": 0.05367231638418079 + } + }, + "s1_bos": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "926d803c147e94abe2b068af59a42d75e4c76cf9080e4c36b6a3ffe00fcb7bcb", + "route_weight_sha256": "2addef93b02ab17ce414daebc57dd4b0cb55ef67755be09e51ec1382ddc204b5", + "loads": [ + 0, + 0, + 8, + 8, + 1, + 0, + 2, + 6, + 4, + 13, + 3, + 2, + 2, + 7, + 5, + 4, + 0, + 0, + 2, + 1, + 0, + 7, + 0, + 2, + 0, + 0, + 0, + 7, + 2, + 0, + 6, + 13, + 0, + 1, + 6, + 0, + 0, + 6, + 2, + 1, + 1, + 1, + 0, + 4, + 9, + 0, + 2, + 5, + 0, + 5, + 1, + 12, + 4, + 3, + 2, + 2, + 5, + 7, + 2, + 6, + 5, + 0, + 5, + 2 + ], + "weighted_loads": [ + 0.0, + 0.0, + 0.7827753722667694, + 0.8501612991094589, + 0.028752896934747696, + 0.0, + 0.07118918001651764, + 0.24852636456489563, + 0.21460025385022163, + 0.8998732306063175, + 0.10370764322578907, + 0.10401323065161705, + 0.11108582839369774, + 0.28861285001039505, + 0.3835066705942154, + 0.17014145106077194, + 0.0, + 0.0, + 0.059994710609316826, + 0.04357447102665901, + 0.0, + 0.35524376295506954, + 0.0, + 0.06396574527025223, + 0.0, + 0.0, + 0.0, + 0.333461694419384, + 0.0762738361954689, + 0.0, + 0.3078059069812298, + 1.2847130745649338, + 0.0, + 0.03677719458937645, + 0.6451278682798147, + 0.0, + 0.0, + 0.23338730074465275, + 0.10218283161520958, + 0.03531531244516373, + 0.04194467142224312, + 0.030367426574230194, + 0.0, + 0.12396768294274807, + 0.72661217674613, + 0.0, + 0.11902271583676338, + 0.35451309382915497, + 0.0, + 0.5407402589917183, + 0.03762141242623329, + 0.5744287576526403, + 0.2120367530733347, + 0.28132594376802444, + 0.10231997072696686, + 0.07179340906441212, + 0.2532760463654995, + 0.37133482843637466, + 0.17323430627584457, + 0.7580508403480053, + 0.19907056912779808, + 0.0, + 0.24242525547742844, + 0.07225145399570465 + ], + "unique_experts": 46, + "load_cv": 1.040324972147632, + "normalized_load_entropy": 0.864454274002195, + "max_load_share": 0.06372549019607843 + }, + "full_input": { + "tokens": 75, + "top_k": 6, + "decisions": 450, + "ordered_route_sha256": "385a2938186cf72b6d3cc476e07cf575a073bc204b600e7bfccf52578b4fbc08", + "route_weight_sha256": "b93f0e57006549847aa2af86549fb01f9b6254881f5119b2adf4e50dcfddd37f", + "loads": [ + 1, + 7, + 12, + 8, + 13, + 2, + 12, + 6, + 4, + 20, + 4, + 10, + 14, + 9, + 16, + 6, + 3, + 5, + 3, + 9, + 4, + 8, + 6, + 7, + 12, + 0, + 0, + 9, + 3, + 1, + 11, + 13, + 3, + 1, + 6, + 3, + 3, + 9, + 3, + 4, + 5, + 9, + 9, + 5, + 10, + 0, + 2, + 16, + 1, + 7, + 6, + 12, + 8, + 14, + 6, + 2, + 7, + 9, + 11, + 7, + 8, + 8, + 14, + 4 + ], + "weighted_loads": [ + 0.021207641810178757, + 0.4684589095413685, + 1.1887809578329325, + 0.8501612991094589, + 1.6185865886509418, + 0.09115006495267153, + 0.5510522248223424, + 0.24852636456489563, + 0.21460025385022163, + 1.2920400723814964, + 0.17014932073652744, + 0.8559376783668995, + 0.7843585200607777, + 0.36713333427906036, + 1.2896303068846464, + 0.2781935855746269, + 0.4021991714835167, + 0.22980165109038353, + 0.15783835761249065, + 0.6162796020507812, + 0.3317092955112457, + 0.4094731081277132, + 0.24981775879859924, + 0.24840540252625942, + 0.9511522799730301, + 0.0, + 0.0, + 0.42656033858656883, + 0.11333028227090836, + 0.035085514187812805, + 0.5052815116941929, + 1.2847130745649338, + 0.11836288496851921, + 0.03677719458937645, + 0.6451278682798147, + 0.12673120014369488, + 0.11489475145936012, + 0.36924534663558006, + 0.14645854011178017, + 0.17460691183805466, + 0.1856809388846159, + 0.4027189128100872, + 0.7077616788446903, + 0.1616558376699686, + 0.7373237796127796, + 0.0, + 0.11902271583676338, + 1.304329790174961, + 0.03532464802265167, + 0.6502138487994671, + 0.374813798815012, + 0.5744287576526403, + 0.3923160247504711, + 1.095046915113926, + 0.8742982298135757, + 0.07179340906441212, + 0.3365951217710972, + 0.4589122273027897, + 0.638501975685358, + 0.7924724295735359, + 0.33249618113040924, + 0.3753835167735815, + 0.939913135021925, + 0.23981408402323723 + ], + "unique_experts": 61, + "load_cv": 0.6345290856169064, + "normalized_load_entropy": 0.9466236651415373, + "max_load_share": 0.044444444444444446 + } + }, + "s0_x": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "208e0e2fc703a7b2495d985f4d6d6518443ed0492580596ba4777fb6a0a78356", + "route_weight_sha256": "afcb74301596ca08aba0051e3ef1382286969b12b2283348032c241c59f92c19", + "loads": [ + 0, + 0, + 8, + 8, + 1, + 0, + 1, + 6, + 5, + 15, + 2, + 2, + 2, + 8, + 5, + 3, + 0, + 0, + 3, + 1, + 0, + 6, + 0, + 1, + 0, + 0, + 0, + 7, + 3, + 0, + 6, + 13, + 0, + 1, + 6, + 0, + 1, + 6, + 2, + 1, + 1, + 1, + 0, + 3, + 10, + 1, + 2, + 5, + 0, + 5, + 0, + 10, + 3, + 3, + 2, + 2, + 5, + 7, + 2, + 6, + 5, + 0, + 6, + 2 + ], + "weighted_loads": [ + 0.0, + 0.0, + 0.7944407910108566, + 0.7799210995435715, + 0.03017514944076538, + 0.0, + 0.03653872013092041, + 0.25608714669942856, + 0.2556681539863348, + 0.9358111508190632, + 0.08805305510759354, + 0.1055409237742424, + 0.1167200319468975, + 0.32062074542045593, + 0.38822171092033386, + 0.12520156428217888, + 0.0, + 0.0, + 0.09156105667352676, + 0.044689759612083435, + 0.0, + 0.3334800563752651, + 0.0, + 0.031409576535224915, + 0.0, + 0.0, + 0.0, + 0.34954720735549927, + 0.11698303744196892, + 0.0, + 0.30946259573102, + 1.248732265084982, + 0.0, + 0.037876445800065994, + 0.6382001526653767, + 0.0, + 0.033275306224823, + 0.2307171579450369, + 0.10869479179382324, + 0.032758984714746475, + 0.04103243723511696, + 0.02923567220568657, + 0.0, + 0.09111245349049568, + 0.7942022122442722, + 0.032221585512161255, + 0.12190615385770798, + 0.36225638538599014, + 0.0, + 0.5547477900981903, + 0.0, + 0.4919053688645363, + 0.18591463938355446, + 0.27813413366675377, + 0.10916333645582199, + 0.067690784111619, + 0.2602097950875759, + 0.37349486723542213, + 0.17990897595882416, + 0.7038496546447277, + 0.21574841998517513, + 0.0, + 0.27214792370796204, + 0.07185816392302513 + ], + "unique_experts": 47, + "load_cv": 1.0637141952955955, + "normalized_load_entropy": 0.8627194205847869, + "max_load_share": 0.07352941176470588 + }, + "full_input": { + "tokens": 59, + "top_k": 6, + "decisions": 354, + "ordered_route_sha256": "366b6b62850fd0215ffb5ca393c5a71e5333f990c0a35cfc59bd54ba53c47d45", + "route_weight_sha256": "8f167fa30efe4a34d554ce8648a25627dc6ebc370170a2f8a10099bed626b6da", + "loads": [ + 1, + 4, + 11, + 8, + 6, + 2, + 12, + 6, + 5, + 19, + 2, + 2, + 13, + 9, + 11, + 3, + 3, + 0, + 3, + 5, + 0, + 6, + 6, + 8, + 7, + 0, + 0, + 9, + 3, + 4, + 12, + 13, + 0, + 1, + 6, + 2, + 1, + 10, + 4, + 2, + 5, + 3, + 9, + 4, + 11, + 1, + 2, + 11, + 1, + 6, + 0, + 10, + 3, + 7, + 7, + 2, + 5, + 7, + 9, + 6, + 7, + 4, + 13, + 2 + ], + "weighted_loads": [ + 0.038595519959926605, + 0.3056512139737606, + 1.2103054355829954, + 0.7799210995435715, + 0.8387971892952919, + 0.09897023905068636, + 0.5017876094207168, + 0.25608714669942856, + 0.2556681539863348, + 1.207365732640028, + 0.08805305510759354, + 0.1055409237742424, + 0.8917471617460251, + 0.3597152605652809, + 0.9475076422095299, + 0.12520156428217888, + 0.11417977511882782, + 0.0, + 0.09156105667352676, + 0.2223542183637619, + 0.0, + 0.3334800563752651, + 0.23074707202613354, + 0.28742136247456074, + 0.491131579503417, + 0.0, + 0.0, + 0.42052824422717094, + 0.11698303744196892, + 0.16086744144558907, + 0.5369477458298206, + 1.248732265084982, + 0.0, + 0.037876445800065994, + 0.6382001526653767, + 0.0903129130601883, + 0.033275306224823, + 0.39694404788315296, + 0.1831553429365158, + 0.06499043479561806, + 0.2039454523473978, + 0.14197036251425743, + 0.7387700453400612, + 0.14893680810928345, + 0.8049138151109219, + 0.032221585512161255, + 0.12190615385770798, + 1.0906836651265621, + 0.037593238055706024, + 0.6131195351481438, + 0.0, + 0.4919053688645363, + 0.18591463938355446, + 0.5102639310061932, + 0.8953816592693329, + 0.067690784111619, + 0.2602097950875759, + 0.37349486723542213, + 0.4986640065908432, + 0.7038496546447277, + 0.3254717942327261, + 0.22797234542667866, + 0.8315215185284615, + 0.07185816392302513 + ], + "unique_experts": 58, + "load_cv": 0.7501795246213806, + "normalized_load_entropy": 0.9265070176866284, + "max_load_share": 0.05367231638418079 + } + }, + "s1_x": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "631470dff15648eafedf95cf4f994a45e222ef33d084223f953517ab2e8abf0d", + "route_weight_sha256": "e0506ca5397cee7f6bb1d7c568e05062311afd47c0ab019514cdc925d6ee34a5", + "loads": [ + 0, + 0, + 9, + 7, + 1, + 0, + 1, + 6, + 4, + 13, + 2, + 2, + 2, + 7, + 5, + 4, + 0, + 0, + 1, + 1, + 0, + 7, + 0, + 2, + 0, + 0, + 0, + 7, + 3, + 0, + 5, + 13, + 0, + 1, + 6, + 0, + 0, + 6, + 2, + 1, + 1, + 1, + 0, + 5, + 10, + 0, + 2, + 5, + 0, + 5, + 2, + 10, + 3, + 5, + 2, + 2, + 5, + 7, + 2, + 6, + 5, + 0, + 6, + 2 + ], + "weighted_loads": [ + 0.0, + 0.0, + 0.8146739974617958, + 0.7809636183083057, + 0.033171478658914566, + 0.0, + 0.039335399866104126, + 0.23858586326241493, + 0.20945466682314873, + 0.9015036411583424, + 0.08220890164375305, + 0.09258680790662766, + 0.11468116194009781, + 0.2886671628803015, + 0.36078766733407974, + 0.16839178651571274, + 0.0, + 0.0, + 0.02818102017045021, + 0.04108351841568947, + 0.0, + 0.36565129086375237, + 0.0, + 0.06885532289743423, + 0.0, + 0.0, + 0.0, + 0.3418813869357109, + 0.11484883353114128, + 0.0, + 0.2484954483807087, + 1.317592192441225, + 0.0, + 0.03634770214557648, + 0.6439686380326748, + 0.0, + 0.0, + 0.21844741888344288, + 0.11056046560406685, + 0.032581452280282974, + 0.04056001454591751, + 0.030329490080475807, + 0.0, + 0.16890783049166203, + 0.7509638778865337, + 0.0, + 0.11483518406748772, + 0.3472377248108387, + 0.0, + 0.5622364655137062, + 0.07029149681329727, + 0.4802335165441036, + 0.17512061819434166, + 0.347978787496686, + 0.10122770071029663, + 0.07330061867833138, + 0.2557702548801899, + 0.3695937544107437, + 0.1775851510465145, + 0.7313231155276299, + 0.18981005623936653, + 0.0, + 0.27796829119324684, + 0.06920604035258293 + ], + "unique_experts": 46, + "load_cv": 1.0343950344399984, + "normalized_load_entropy": 0.8642175278482978, + "max_load_share": 0.06372549019607843 + }, + "full_input": { + "tokens": 75, + "top_k": 6, + "decisions": 450, + "ordered_route_sha256": "335f596044adf43eb676e8d70f9684428f66431401d1571cd6ced9df876303e3", + "route_weight_sha256": "84f4e302798ba0cae48244c830b53d00d599a825dc99bafe253998d2edc1987b", + "loads": [ + 1, + 8, + 12, + 7, + 13, + 4, + 12, + 6, + 4, + 19, + 3, + 10, + 16, + 7, + 17, + 6, + 3, + 6, + 2, + 7, + 4, + 8, + 7, + 7, + 11, + 0, + 0, + 9, + 4, + 1, + 9, + 13, + 4, + 1, + 6, + 0, + 2, + 8, + 3, + 3, + 4, + 9, + 10, + 6, + 11, + 0, + 2, + 17, + 1, + 7, + 7, + 10, + 7, + 16, + 6, + 2, + 7, + 9, + 12, + 7, + 8, + 9, + 16, + 4 + ], + "weighted_loads": [ + 0.021207641810178757, + 0.4754376783967018, + 1.2096059303730726, + 0.7809636183083057, + 1.4930646903812885, + 0.166711681522429, + 0.5510942162945867, + 0.23858586326241493, + 0.20945466682314873, + 1.22824003174901, + 0.14865057915449142, + 0.8445112556219101, + 0.9273684583604336, + 0.2886671628803015, + 1.3611229863017797, + 0.2764439210295677, + 0.4021991714835167, + 0.2689552567899227, + 0.12602466717362404, + 0.3358009085059166, + 0.3317092955112457, + 0.419880636036396, + 0.2849087230861187, + 0.25329498015344143, + 0.8414678499102592, + 0.0, + 0.0, + 0.44888053461909294, + 0.15190527960658073, + 0.035085514187812805, + 0.3950749672949314, + 1.317592192441225, + 0.15761039406061172, + 0.03634770214557648, + 0.6439686380326748, + 0.0, + 0.07930568605661392, + 0.2838338576257229, + 0.15483617410063744, + 0.13617325574159622, + 0.15229136683046818, + 0.4308024812489748, + 0.8931768126785755, + 0.20659598521888256, + 0.7616754807531834, + 0.0, + 0.11483518406748772, + 1.39445286616683, + 0.03532464802265167, + 0.6694914288818836, + 0.40748388320207596, + 0.4802335165441036, + 0.3538743928074837, + 1.1212585419416428, + 0.8732059597969055, + 0.07330061867833138, + 0.3390893302857876, + 0.45717115327715874, + 0.6750014163553715, + 0.7657447047531605, + 0.34165315702557564, + 0.4298975709825754, + 1.062704659998417, + 0.2367686703801155 + ], + "unique_experts": 60, + "load_cv": 0.6627887211539503, + "normalized_load_entropy": 0.9415711429229274, + "max_load_share": 0.042222222222222223 + } + }, + "s0_period": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "90b6052d5aea9477177e0054f0ee65e2e1cac37ceb88f113316d20fd13f65072", + "route_weight_sha256": "1cf80ef0e042d969e5c644cd311920e4b8e4bcf26d983e628d05cac52dcd12c5", + "loads": [ + 0, + 0, + 7, + 8, + 1, + 0, + 1, + 6, + 4, + 14, + 3, + 2, + 2, + 9, + 5, + 4, + 0, + 0, + 2, + 1, + 0, + 6, + 0, + 1, + 0, + 0, + 0, + 7, + 3, + 0, + 7, + 13, + 0, + 1, + 6, + 0, + 1, + 6, + 2, + 1, + 1, + 1, + 0, + 2, + 9, + 1, + 2, + 5, + 0, + 5, + 0, + 12, + 3, + 3, + 3, + 2, + 6, + 7, + 2, + 5, + 5, + 0, + 5, + 2 + ], + "weighted_loads": [ + 0.0, + 0.0, + 0.7363482005894184, + 0.8004462271928787, + 0.029567690566182137, + 0.0, + 0.03727870434522629, + 0.2578205782920122, + 0.2240675799548626, + 0.8973189052194357, + 0.125326968729496, + 0.1001015305519104, + 0.11789418756961823, + 0.3429387416690588, + 0.39387524873018265, + 0.15582048706710339, + 0.0, + 0.0, + 0.06074400432407856, + 0.042573291808366776, + 0.0, + 0.3269613366574049, + 0.0, + 0.03161773085594177, + 0.0, + 0.0, + 0.0, + 0.341196421533823, + 0.117610152810812, + 0.0, + 0.3509001396596432, + 1.2470529787242413, + 0.0, + 0.037805233150720596, + 0.6457293126732111, + 0.0, + 0.03211449086666107, + 0.23130535334348679, + 0.10519935563206673, + 0.03278951346874237, + 0.04437017813324928, + 0.028107665479183197, + 0.0, + 0.060670675709843636, + 0.7592341639101505, + 0.032971445471048355, + 0.12203117087483406, + 0.3640590198338032, + 0.0, + 0.5548808798193932, + 0.0, + 0.5553975384682417, + 0.18516218662261963, + 0.27811194956302643, + 0.1289778370410204, + 0.06740172766149044, + 0.2764729745686054, + 0.37302495911717415, + 0.1760653331875801, + 0.7030879184603691, + 0.2089604064822197, + 0.0, + 0.24634141102433205, + 0.07159100472927094 + ], + "unique_experts": 47, + "load_cv": 1.062267456516199, + "normalized_load_entropy": 0.8628274438613098, + "max_load_share": 0.06862745098039216 + }, + "full_input": { + "tokens": 59, + "top_k": 6, + "decisions": 354, + "ordered_route_sha256": "cd7e42fc2b8416b0544308c80aaeb85b730986af446c4b3861dabf31058f790e", + "route_weight_sha256": "7770eedc89e28149d18fcd2e769fe80031c573b9292b0eb3b998325cfc7b6d4a", + "loads": [ + 1, + 4, + 10, + 8, + 6, + 2, + 11, + 6, + 4, + 18, + 3, + 2, + 12, + 10, + 11, + 4, + 4, + 0, + 2, + 5, + 0, + 6, + 5, + 8, + 7, + 0, + 0, + 9, + 3, + 4, + 13, + 13, + 0, + 1, + 7, + 2, + 2, + 11, + 4, + 1, + 5, + 3, + 8, + 3, + 10, + 1, + 2, + 12, + 1, + 6, + 0, + 12, + 3, + 7, + 8, + 2, + 6, + 7, + 8, + 5, + 7, + 5, + 12, + 2 + ], + "weighted_loads": [ + 0.038595519959926605, + 0.31407127901911736, + 1.1451192293316126, + 0.8004462271928787, + 0.894214415922761, + 0.08523205388337374, + 0.44638011511415243, + 0.2578205782920122, + 0.2240675799548626, + 1.1761701758950949, + 0.125326968729496, + 0.1001015305519104, + 0.7684567123651505, + 0.3820332568138838, + 0.9606628231704235, + 0.15582048706710339, + 0.14417502842843533, + 0.0, + 0.06074400432407856, + 0.21945824846625328, + 0.0, + 0.3269613366574049, + 0.1818158719688654, + 0.28423778899013996, + 0.5488761942833662, + 0.0, + 0.0, + 0.42318497225642204, + 0.117610152810812, + 0.16086744144558907, + 0.5839710235595703, + 1.2470529787242413, + 0.0, + 0.037805233150720596, + 0.7049878556281328, + 0.09180748090147972, + 0.08854985609650612, + 0.43330808356404305, + 0.1796599067747593, + 0.03278951346874237, + 0.21079459227621555, + 0.13808896392583847, + 0.5894753560423851, + 0.1184950303286314, + 0.7699457667768002, + 0.032971445471048355, + 0.12203117087483406, + 1.1479163020849228, + 0.037593238055706024, + 0.6142020709812641, + 0.0, + 0.5553975384682417, + 0.18516218662261963, + 0.5388121921569109, + 0.9151961598545313, + 0.06740172766149044, + 0.2764729745686054, + 0.37302495911717415, + 0.44762860611081123, + 0.7030879184603691, + 0.31144650653004646, + 0.31749854050576687, + 0.7891577444970608, + 0.07159100472927094 + ], + "unique_experts": 58, + "load_cv": 0.7398973248540958, + "normalized_load_entropy": 0.9275926240799675, + "max_load_share": 0.05084745762711865 + } + }, + "s1_period": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "3fac7f4e7b8999e5a210217e565fcbd85a4ee240f684da52f15c709d7e2a7c01", + "route_weight_sha256": "9f4c5ec0383d6a115924976822d6879f4ce36774edb8897e8d75f3c7e8f78e78", + "loads": [ + 0, + 0, + 7, + 8, + 1, + 0, + 1, + 6, + 4, + 12, + 3, + 2, + 2, + 7, + 5, + 6, + 0, + 0, + 1, + 2, + 0, + 6, + 0, + 2, + 0, + 0, + 0, + 7, + 3, + 0, + 6, + 13, + 0, + 1, + 6, + 0, + 1, + 5, + 2, + 1, + 1, + 1, + 0, + 6, + 9, + 0, + 2, + 5, + 0, + 5, + 1, + 10, + 3, + 3, + 2, + 2, + 6, + 7, + 2, + 5, + 6, + 0, + 6, + 2 + ], + "weighted_loads": [ + 0.0, + 0.0, + 0.73871248960495, + 0.8276507705450058, + 0.034924134612083435, + 0.0, + 0.04049789160490036, + 0.24796796962618828, + 0.21079663559794426, + 0.8687435258179903, + 0.10907834954559803, + 0.09348827227950096, + 0.1171281598508358, + 0.2835183646529913, + 0.3632664270699024, + 0.22530992701649666, + 0.0, + 0.0, + 0.02815335802733898, + 0.06290681287646294, + 0.0, + 0.3319820426404476, + 0.0, + 0.07106268405914307, + 0.0, + 0.0, + 0.0, + 0.3379341885447502, + 0.11387951299548149, + 0.0, + 0.27858589962124825, + 1.2933100871741772, + 0.0, + 0.037406738847494125, + 0.6437206324189901, + 0.0, + 0.03219197690486908, + 0.1939510777592659, + 0.1094408892095089, + 0.0312880277633667, + 0.036945998668670654, + 0.03005857765674591, + 0.0, + 0.19534390978515148, + 0.7335275523364544, + 0.0, + 0.11546610295772552, + 0.34306498244404793, + 0.0, + 0.5620153769850731, + 0.037050217390060425, + 0.47706785798072815, + 0.17552442848682404, + 0.28850625827908516, + 0.10115960612893105, + 0.07264576479792595, + 0.27850924991071224, + 0.37260811030864716, + 0.17686797305941582, + 0.6958880424499512, + 0.23393728025257587, + 0.0, + 0.2740742973983288, + 0.07033407688140869 + ], + "unique_experts": 47, + "load_cv": 1.0026876608271056, + "normalized_load_entropy": 0.8701300916817397, + "max_load_share": 0.06372549019607843 + }, + "full_input": { + "tokens": 75, + "top_k": 6, + "decisions": 450, + "ordered_route_sha256": "e04dccc02c9eecaae3411659a711cba7867c99ecf8c0f644458292a09017d730", + "route_weight_sha256": "d65a7c5d300748734b865c23ddaea2394495f781a46df0fd76605d8d266ef0b4", + "loads": [ + 1, + 6, + 11, + 8, + 13, + 4, + 11, + 6, + 4, + 18, + 4, + 10, + 15, + 7, + 18, + 8, + 3, + 5, + 2, + 9, + 4, + 7, + 6, + 7, + 9, + 0, + 0, + 9, + 4, + 1, + 11, + 13, + 3, + 1, + 7, + 0, + 3, + 6, + 3, + 4, + 5, + 10, + 10, + 7, + 10, + 0, + 2, + 18, + 1, + 7, + 6, + 10, + 7, + 15, + 6, + 2, + 8, + 9, + 11, + 6, + 9, + 10, + 16, + 4 + ], + "weighted_loads": [ + 0.021207641810178757, + 0.3884717635810375, + 1.163609279319644, + 0.8276507705450058, + 1.4781284108757973, + 0.17716476414352655, + 0.5203609364107251, + 0.24796796962618828, + 0.21079663559794426, + 1.239775249734521, + 0.1755200270563364, + 0.8454127199947834, + 0.8385866582393646, + 0.2835183646529913, + 1.4149235617369413, + 0.33336206153035164, + 0.4021991714835167, + 0.22980165109038353, + 0.1259970050305128, + 0.3965010419487953, + 0.3317092955112457, + 0.3862113878130913, + 0.24981775879859924, + 0.25550234131515026, + 0.6701806932687759, + 0.0, + 0.0, + 0.46231261268258095, + 0.15093595907092094, + 0.035085514187812805, + 0.4709918312728405, + 1.2933100871741772, + 0.11836288496851921, + 0.037406738847494125, + 0.7099581565707922, + 0.0, + 0.111497662961483, + 0.2238317746669054, + 0.15371659770607948, + 0.1792449951171875, + 0.19404208101332188, + 0.490876030176878, + 0.7439655251801014, + 0.23303206451237202, + 0.744239155203104, + 0.0, + 0.11546610295772552, + 1.4293386153876781, + 0.03532464802265167, + 0.6723433844745159, + 0.3742426037788391, + 0.47706785798072815, + 0.35715373791754246, + 1.149956926703453, + 0.8731378652155399, + 0.07264576479792595, + 0.36182832531630993, + 0.4601855091750622, + 0.6421356424689293, + 0.7303096316754818, + 0.37862527929246426, + 0.4699255209416151, + 1.0146575383841991, + 0.23789670690894127 + ], + "unique_experts": 60, + "load_cv": 0.6512438241691959, + "normalized_load_entropy": 0.9433564764011231, + "max_load_share": 0.04 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 34, + "ordered_topk_exact_tokens": 20, + "set_exact_tokens": 24, + "mean_set_jaccard": 0.9033613445378151, + "mean_token_weighted_tv": 0.018093168324626544, + "aggregate_load_tv": 0.04411764705882353 + }, + "system_bos": { + "tokens": 34, + "ordered_topk_exact_tokens": 20, + "set_exact_tokens": 24, + "mean_set_jaccard": 0.9159663865546218, + "mean_token_weighted_tv": 0.01697784193846233, + "aggregate_load_tv": 0.024509803921568634 + }, + "system_x": { + "tokens": 34, + "ordered_topk_exact_tokens": 16, + "set_exact_tokens": 20, + "mean_set_jaccard": 0.8760504201680672, + "mean_token_weighted_tv": 0.025622540783575353, + "aggregate_load_tv": 0.049019607843137254 + }, + "system_period": { + "tokens": 34, + "ordered_topk_exact_tokens": 19, + "set_exact_tokens": 21, + "mean_set_jaccard": 0.8844537815126051, + "mean_token_weighted_tv": 0.023544980213046074, + "aggregate_load_tv": 0.05392156862745098 + }, + "bos_at_s0": { + "tokens": 34, + "ordered_topk_exact_tokens": 18, + "set_exact_tokens": 21, + "mean_set_jaccard": 0.8907563025210085, + "mean_token_weighted_tv": 0.022310196997269112, + "aggregate_load_tv": 0.04411764705882354 + }, + "bos_at_s1": { + "tokens": 34, + "ordered_topk_exact_tokens": 19, + "set_exact_tokens": 20, + "mean_set_jaccard": 0.8823529411764706, + "mean_token_weighted_tv": 0.021016460761208746, + "aggregate_load_tv": 0.058823529411764705 + }, + "x_at_s0": { + "tokens": 34, + "ordered_topk_exact_tokens": 18, + "set_exact_tokens": 21, + "mean_set_jaccard": 0.8795518207282913, + "mean_token_weighted_tv": 0.02373066421269494, + "aggregate_load_tv": 0.058823529411764705 + }, + "x_at_s1": { + "tokens": 34, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.8277310924369748, + "mean_token_weighted_tv": 0.030508733874953845, + "aggregate_load_tv": 0.0735294117647059 + }, + "period_at_s0": { + "tokens": 34, + "ordered_topk_exact_tokens": 18, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.8627450980392157, + "mean_token_weighted_tv": 0.02486464794834747, + "aggregate_load_tv": 0.06372549019607843 + }, + "period_at_s1": { + "tokens": 34, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 18, + "mean_set_jaccard": 0.846638655462185, + "mean_token_weighted_tv": 0.028697102221057695, + "aggregate_load_tv": 0.07352941176470588 + } + } + }, + "layer_20": { + "layer": 20, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "3f4e687b6967cf3e9edee0f55b2be1b2cdee9ee33cad3d9a9e059926ce4318d0", + "route_weight_sha256": "8b2c5b77b321d50b8876ce0f8609a44075d79b7d7f548663e8d56bb1ef49cfb7", + "loads": [ + 5, + 7, + 5, + 1, + 3, + 12, + 9, + 1, + 2, + 3, + 0, + 1, + 6, + 0, + 0, + 3, + 0, + 0, + 5, + 8, + 0, + 5, + 4, + 3, + 6, + 1, + 5, + 1, + 1, + 4, + 2, + 5, + 3, + 0, + 0, + 1, + 10, + 3, + 3, + 0, + 2, + 1, + 10, + 4, + 1, + 2, + 0, + 2, + 7, + 3, + 0, + 4, + 5, + 8, + 2, + 6, + 2, + 1, + 1, + 1, + 2, + 12, + 0, + 0 + ], + "weighted_loads": [ + 0.2084592804312706, + 0.27235490269958973, + 0.20913728512823582, + 0.034416563808918, + 0.09881913103163242, + 1.1202250495553017, + 1.2571859806776047, + 0.04568133503198624, + 0.10926467180252075, + 0.2551797293126583, + 0.0, + 0.03219093754887581, + 0.5247958563268185, + 0.0, + 0.0, + 0.16412512958049774, + 0.0, + 0.0, + 0.16047771275043488, + 0.6612160075455904, + 0.0, + 0.350664421916008, + 0.18436210975050926, + 0.14563975855708122, + 0.4776358790695667, + 0.04342740774154663, + 0.16990625113248825, + 0.02940209209918976, + 0.02787892520427704, + 0.10573432967066765, + 0.06974336877465248, + 0.1586468257009983, + 0.0951923131942749, + 0.0, + 0.0, + 0.04585602134466171, + 0.6163541041314602, + 0.12642903253436089, + 0.10290109552443027, + 0.0, + 0.08234994299709797, + 0.037664853036403656, + 0.8220977373421192, + 0.14963357523083687, + 0.06435097754001617, + 0.12077138386666775, + 0.0, + 0.08108112774789333, + 0.2745667062699795, + 0.17908379063010216, + 0.0, + 0.13628750294446945, + 0.19593944773077965, + 0.9112250246107578, + 0.10078033059835434, + 0.25258178263902664, + 0.12877624481916428, + 0.03766576573252678, + 0.058993861079216, + 0.0328645296394825, + 0.08018883317708969, + 0.5278981290757656, + 0.0, + 0.0 + ], + "unique_experts": 51, + "load_cv": 0.9667680812251804, + "normalized_load_entropy": 0.8848275372336575, + "max_load_share": 0.058823529411764705 + }, + "full_input": { + "tokens": 59, + "top_k": 6, + "decisions": 354, + "ordered_route_sha256": "e0a5eb65bebf071b59685e4a3ab7ad5218f20939961ee49ecf70befeb1264f3d", + "route_weight_sha256": "61ea6460414b455bac85df16a784384f7993aeec8915e15753f77a97a15509ae", + "loads": [ + 5, + 9, + 5, + 9, + 11, + 15, + 14, + 7, + 2, + 3, + 0, + 2, + 10, + 0, + 0, + 6, + 1, + 0, + 15, + 8, + 6, + 5, + 11, + 3, + 7, + 9, + 6, + 1, + 1, + 6, + 2, + 5, + 3, + 1, + 1, + 1, + 13, + 5, + 5, + 0, + 4, + 4, + 12, + 7, + 11, + 2, + 0, + 2, + 10, + 4, + 8, + 4, + 5, + 16, + 2, + 10, + 2, + 6, + 1, + 1, + 14, + 16, + 0, + 0 + ], + "weighted_loads": [ + 0.2084592804312706, + 0.31714161299169064, + 0.20913728512823582, + 0.6331880986690521, + 0.5010666083544493, + 1.2438625134527683, + 1.4064372163265944, + 0.44545045122504234, + 0.10926467180252075, + 0.2551797293126583, + 0.0, + 0.07623373717069626, + 0.629197183996439, + 0.0, + 0.0, + 0.2846171222627163, + 0.03664497286081314, + 0.0, + 1.0387166179716587, + 0.6612160075455904, + 0.1958028362132609, + 0.350664421916008, + 0.5991945751011372, + 0.14563975855708122, + 0.5294653661549091, + 0.7021453529596329, + 0.18735192343592644, + 0.02940209209918976, + 0.02787892520427704, + 0.1736561842262745, + 0.06974336877465248, + 0.1586468257009983, + 0.0951923131942749, + 0.02312881499528885, + 0.04456191509962082, + 0.04585602134466171, + 0.7528595048934221, + 0.18481575138866901, + 1.4215632919222116, + 0.0, + 0.1712536085397005, + 0.19194788858294487, + 1.0086413137614727, + 0.21421869494952261, + 0.4352119453251362, + 0.12077138386666775, + 0.0, + 0.08108112774789333, + 0.34719108405988663, + 0.22575430572032928, + 1.2924568429589272, + 0.13628750294446945, + 0.19593944773077965, + 1.410431420430541, + 0.10078033059835434, + 0.7394130900502205, + 0.12877624481916428, + 0.19182702153921127, + 0.058993861079216, + 0.0328645296394825, + 1.3903233541641384, + 0.7298609018325806, + 0.0, + 0.0 + ], + "unique_experts": 56, + "load_cv": 0.8370547949061522, + "normalized_load_entropy": 0.9082636097862703, + "max_load_share": 0.04519774011299435 + } + }, + "s1_eos": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "52f7894c4a3ba3f1db82503594de73fac94d33e9b8bcad5b04b7859fdbddd532", + "route_weight_sha256": "e06a9d2e94f8d63404b7c857da1dbd514b4e4a0d3b3e0133a92ffccc56c589ef", + "loads": [ + 4, + 6, + 5, + 1, + 3, + 13, + 9, + 2, + 2, + 3, + 0, + 1, + 6, + 0, + 0, + 3, + 0, + 0, + 3, + 9, + 1, + 5, + 3, + 3, + 6, + 2, + 4, + 1, + 1, + 4, + 2, + 6, + 3, + 0, + 0, + 1, + 10, + 3, + 3, + 0, + 1, + 1, + 10, + 4, + 1, + 2, + 0, + 2, + 8, + 3, + 0, + 4, + 4, + 8, + 2, + 5, + 3, + 2, + 1, + 1, + 2, + 12, + 0, + 0 + ], + "weighted_loads": [ + 0.17944765090942383, + 0.242909649387002, + 0.22178080677986145, + 0.03480497747659683, + 0.09623454511165619, + 1.14144878834486, + 1.2593624163419008, + 0.07977315783500671, + 0.10863115265965462, + 0.24334171041846275, + 0.0, + 0.03401513770222664, + 0.5163369961082935, + 0.0, + 0.0, + 0.16682369634509087, + 0.0, + 0.0, + 0.0943561140447855, + 0.7046664264053106, + 0.030345330014824867, + 0.3471067547798157, + 0.15266266092658043, + 0.14527993649244308, + 0.46797190979123116, + 0.07776808738708496, + 0.14246149733662605, + 0.02756415493786335, + 0.02813274785876274, + 0.11275750771164894, + 0.07152068801224232, + 0.1863196138292551, + 0.0961488950997591, + 0.0, + 0.0, + 0.043835461139678955, + 0.6093634888529778, + 0.12834438681602478, + 0.1049908772110939, + 0.0, + 0.05779862776398659, + 0.0392901711165905, + 0.8141799457371235, + 0.15324442461133003, + 0.05727265030145645, + 0.11769486218690872, + 0.0, + 0.08380194753408432, + 0.29730608128011227, + 0.17725030332803726, + 0.0, + 0.14077750593423843, + 0.16765111312270164, + 0.9144382625818253, + 0.1032613143324852, + 0.22487065941095352, + 0.15757014229893684, + 0.06417684815824032, + 0.06055974215269089, + 0.03424862027168274, + 0.08264388516545296, + 0.5256257671862841, + 0.0, + 0.0 + ], + "unique_experts": 52, + "load_cv": 0.9715285601441173, + "normalized_load_entropy": 0.8883827675895194, + "max_load_share": 0.06372549019607843 + }, + "full_input": { + "tokens": 75, + "top_k": 6, + "decisions": 450, + "ordered_route_sha256": "aed4b553c370b4166ec3f38c1a25b825fe6952def14ec5a11b03988a14bdb69a", + "route_weight_sha256": "8fb984b41477fd40faa2601092464cb59ef3ae1896690f3fb49e284c5ca73680", + "loads": [ + 9, + 8, + 5, + 12, + 11, + 19, + 11, + 12, + 2, + 5, + 2, + 1, + 8, + 1, + 1, + 15, + 5, + 0, + 13, + 10, + 7, + 6, + 14, + 5, + 8, + 16, + 5, + 2, + 1, + 9, + 2, + 7, + 4, + 0, + 3, + 3, + 14, + 7, + 6, + 4, + 5, + 3, + 12, + 10, + 15, + 3, + 0, + 2, + 11, + 8, + 12, + 4, + 4, + 18, + 3, + 17, + 5, + 9, + 3, + 3, + 15, + 14, + 1, + 0 + ], + "weighted_loads": [ + 0.41061856783926487, + 0.2871442027390003, + 0.22178080677986145, + 0.7922049723565578, + 0.5304637067019939, + 1.369888186454773, + 1.3285803869366646, + 0.7170650884509087, + 0.10863115265965462, + 0.4773005172610283, + 0.09044338390231133, + 0.03401513770222664, + 0.5704821590334177, + 0.28377774357795715, + 0.05852897837758064, + 0.8562065288424492, + 0.29874911718070507, + 0.0, + 1.0725314002484083, + 0.7425864841789007, + 0.21842398261651397, + 0.38210729882121086, + 0.8307403512299061, + 0.3190179094672203, + 0.5455103293061256, + 1.0985345616936684, + 0.15990716964006424, + 0.05175532028079033, + 0.02813274785876274, + 0.2678951509296894, + 0.07152068801224232, + 0.21701222844421864, + 0.14418421871960163, + 0.0, + 0.14697551354765892, + 0.2214406430721283, + 0.7987731546163559, + 0.2877401188015938, + 1.4624031856656075, + 0.19692612066864967, + 0.23700803890824318, + 0.170046865940094, + 1.0001635886728764, + 0.373794250190258, + 0.9130663964897394, + 0.19006484001874924, + 0.0, + 0.08380194753408432, + 0.3653962870594114, + 0.4796360097825527, + 1.8291207663714886, + 0.14077750593423843, + 0.16765111312270164, + 1.4651137311011553, + 0.1315015647560358, + 1.3574003502726555, + 0.243346456438303, + 0.6101569849997759, + 0.13409347459673882, + 0.08564303256571293, + 1.5050282625015825, + 0.6199167836457491, + 0.05945008993148804, + 0.0 + ], + "unique_experts": 60, + "load_cv": 0.7290921125907036, + "normalized_load_entropy": 0.9304922279651789, + "max_load_share": 0.042222222222222223 + } + }, + "s0_bos": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "219ab471e6ef5e5da625304d360f60a607abfc54b6f92346207b90472473b3f6", + "route_weight_sha256": "30e373efbd9d573994104eb29ebe7edc8fb6d5399e517c0dbca71cdea0e3a9b6", + "loads": [ + 4, + 6, + 5, + 1, + 3, + 13, + 9, + 2, + 1, + 3, + 0, + 2, + 6, + 0, + 1, + 3, + 0, + 0, + 3, + 9, + 0, + 5, + 4, + 3, + 6, + 2, + 5, + 1, + 1, + 2, + 2, + 6, + 2, + 0, + 0, + 1, + 10, + 3, + 4, + 1, + 1, + 1, + 10, + 3, + 1, + 2, + 0, + 2, + 6, + 3, + 0, + 3, + 5, + 9, + 2, + 6, + 2, + 3, + 1, + 1, + 2, + 12, + 0, + 0 + ], + "weighted_loads": [ + 0.17424225993454456, + 0.2463807389140129, + 0.2120825070887804, + 0.03506971523165703, + 0.09903640672564507, + 1.16911930590868, + 1.2572995368391275, + 0.08013135567307472, + 0.056170202791690826, + 0.2505842000246048, + 0.0, + 0.05808175168931484, + 0.5202320218086243, + 0.0, + 0.0476040318608284, + 0.1748427376151085, + 0.0, + 0.0, + 0.09195269644260406, + 0.7315929085016251, + 0.0, + 0.3506840616464615, + 0.20076964423060417, + 0.1516735628247261, + 0.4675914663821459, + 0.07384241372346878, + 0.17903960682451725, + 0.028588328510522842, + 0.030895523726940155, + 0.05776635929942131, + 0.06008724868297577, + 0.1849692389369011, + 0.06634541787207127, + 0.0, + 0.0, + 0.04906231909990311, + 0.5848314948379993, + 0.12884562090039253, + 0.13465085066854954, + 0.0469292514026165, + 0.05831171199679375, + 0.037223946303129196, + 0.8317243568599224, + 0.10587983205914497, + 0.06676619499921799, + 0.12471119314432144, + 0.0, + 0.07896791771054268, + 0.23173193633556366, + 0.17035608366131783, + 0.0, + 0.10353421047329903, + 0.2116395179182291, + 0.940062403678894, + 0.09811360016465187, + 0.24476267769932747, + 0.11692195385694504, + 0.09723588824272156, + 0.05078146606683731, + 0.033528391271829605, + 0.07874073460698128, + 0.5369398575276136, + 0.0, + 0.0 + ], + "unique_experts": 53, + "load_cv": 0.9731102112688281, + "normalized_load_entropy": 0.8896869930846927, + "max_load_share": 0.06372549019607843 + }, + "full_input": { + "tokens": 59, + "top_k": 6, + "decisions": 354, + "ordered_route_sha256": "a630e4dd360b2736b03676162ddee910edcf3cb75f3470c1dc4bc321dd9ab9a0", + "route_weight_sha256": "337dadc761799141efe0156d6d586fa4c8b709b2ee05a1e08ff794dd4b867809", + "loads": [ + 4, + 7, + 5, + 9, + 11, + 16, + 14, + 9, + 1, + 3, + 0, + 3, + 10, + 0, + 1, + 6, + 1, + 0, + 13, + 9, + 5, + 5, + 12, + 3, + 7, + 11, + 8, + 1, + 1, + 4, + 3, + 7, + 2, + 1, + 1, + 1, + 13, + 5, + 5, + 1, + 3, + 4, + 12, + 6, + 12, + 2, + 1, + 3, + 7, + 3, + 8, + 3, + 5, + 16, + 2, + 10, + 2, + 7, + 1, + 1, + 13, + 15, + 0, + 0 + ], + "weighted_loads": [ + 0.17424225993454456, + 0.27051107212901115, + 0.2120825070887804, + 0.6338412500917912, + 0.5012838840484619, + 1.3063724860548973, + 1.4065507724881172, + 0.5005993321537971, + 0.056170202791690826, + 0.2505842000246048, + 0.0, + 0.7115182932466269, + 0.6246333494782448, + 0.0, + 0.0476040318608284, + 0.3453936502337456, + 0.03664497286081314, + 0.0, + 0.9701916016638279, + 0.7315929085016251, + 0.18632648512721062, + 0.3506840616464615, + 0.6618427559733391, + 0.1516735628247261, + 0.5289272125810385, + 0.7954552099108696, + 0.28188137896358967, + 0.028588328510522842, + 0.030895523726940155, + 0.12568821385502815, + 0.09879868477582932, + 0.19879026897251606, + 0.06634541787207127, + 0.02312881499528885, + 0.042092688381671906, + 0.04906231909990311, + 0.7179406676441431, + 0.18723233975470066, + 0.4992010537534952, + 0.0469292514026165, + 0.14128133282065392, + 0.16180985607206821, + 1.017762716859579, + 0.2545810714364052, + 0.4719718247652054, + 0.12471119314432144, + 0.14089588820934296, + 0.09272918105125427, + 0.26624467596411705, + 0.17035608366131783, + 1.2565396837890148, + 0.10353421047329903, + 0.2116395179182291, + 1.3952390886843204, + 0.09811360016465187, + 0.728237196803093, + 0.11692195385694504, + 0.21585042774677277, + 0.05078146606683731, + 0.033528391271829605, + 1.3874977324157953, + 0.6986718103289604, + 0.0, + 0.0 + ], + "unique_experts": 59, + "load_cv": 0.8278523188591473, + "normalized_load_entropy": 0.9129671799254586, + "max_load_share": 0.04519774011299435 + } + }, + "s1_bos": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "9734d682eec0f53753638bef6b93646a4b1c0f3cb2047e7aaf9db86e8af89c31", + "route_weight_sha256": "9326d9ca8826a92286f7b844672e1d451b9a02c9b220d63dd1d0ac929a0b259b", + "loads": [ + 3, + 7, + 4, + 0, + 3, + 11, + 9, + 4, + 2, + 3, + 0, + 2, + 6, + 0, + 0, + 3, + 0, + 0, + 4, + 7, + 0, + 5, + 3, + 3, + 6, + 2, + 5, + 1, + 1, + 4, + 2, + 7, + 3, + 0, + 0, + 1, + 10, + 3, + 4, + 1, + 2, + 1, + 10, + 4, + 1, + 2, + 0, + 2, + 6, + 3, + 0, + 4, + 5, + 8, + 2, + 5, + 1, + 3, + 1, + 1, + 2, + 12, + 0, + 0 + ], + "weighted_loads": [ + 0.14929683320224285, + 0.28835284151136875, + 0.18654718063771725, + 0.0, + 0.10053254291415215, + 1.050457201898098, + 1.2673175614327192, + 0.15187916904687881, + 0.10530687868595123, + 0.2486717402935028, + 0.0, + 0.059280961751937866, + 0.5289936400949955, + 0.0, + 0.0, + 0.16163548082113266, + 0.0, + 0.0, + 0.12144543044269085, + 0.6769339963793755, + 0.0, + 0.34618236869573593, + 0.1519361026585102, + 0.14971159398555756, + 0.45560664497315884, + 0.08055504038929939, + 0.1781001128256321, + 0.026556631550192833, + 0.03143778443336487, + 0.11158974654972553, + 0.0685715451836586, + 0.2142123579978943, + 0.09145668894052505, + 0.0, + 0.0, + 0.04889847710728645, + 0.5806006249040365, + 0.12810244038701057, + 0.1396959312260151, + 0.0462079755961895, + 0.08620197884738445, + 0.03846488147974014, + 0.8129629530012608, + 0.15628914907574654, + 0.060660578310489655, + 0.12310256436467171, + 0.0, + 0.0797065906226635, + 0.22996416687965393, + 0.17106466367840767, + 0.0, + 0.1411931961774826, + 0.20263930410146713, + 0.8964756540954113, + 0.0983237773180008, + 0.2203471176326275, + 0.07741862535476685, + 0.09487814269959927, + 0.050249725580215454, + 0.032854460179805756, + 0.07926338911056519, + 0.528297770768404, + 0.0, + 0.0 + ], + "unique_experts": 51, + "load_cv": 0.9294614034895162, + "normalized_load_entropy": 0.891881021031226, + "max_load_share": 0.058823529411764705 + }, + "full_input": { + "tokens": 75, + "top_k": 6, + "decisions": 450, + "ordered_route_sha256": "1c565e5595d06585b89d587ba76be4109d5a93395a31fd9d36bc66d548aef005", + "route_weight_sha256": "24366bc45fc9a46e51d649e83817acbb18cacf8925525e5a70f763666c5777c1", + "loads": [ + 7, + 8, + 4, + 11, + 11, + 18, + 11, + 13, + 2, + 5, + 2, + 2, + 8, + 1, + 1, + 16, + 5, + 0, + 14, + 8, + 7, + 6, + 15, + 5, + 8, + 16, + 8, + 2, + 1, + 8, + 2, + 8, + 4, + 0, + 2, + 3, + 14, + 8, + 6, + 6, + 6, + 5, + 12, + 10, + 16, + 3, + 0, + 2, + 6, + 8, + 13, + 4, + 5, + 19, + 3, + 17, + 2, + 10, + 2, + 3, + 14, + 13, + 1, + 0 + ], + "weighted_loads": [ + 0.34427888318896294, + 0.312483174726367, + 0.18654718063771725, + 0.757399994879961, + 0.5347617045044899, + 1.3413709700107574, + 1.336535532027483, + 0.7399030514061451, + 0.10530687868595123, + 0.48263054713606834, + 0.09044338390231133, + 0.059280961751937866, + 0.5831388030201197, + 0.28377774357795715, + 0.05852897837758064, + 0.9146790876984596, + 0.29874911718070507, + 0.0, + 1.0996207166463137, + 0.7148540541529655, + 0.25429125130176544, + 0.3811829127371311, + 0.8689633458852768, + 0.3234495669603348, + 0.5375488679856062, + 1.1770112961530685, + 0.2816907688975334, + 0.05074779689311981, + 0.03143778443336487, + 0.21739099733531475, + 0.0685715451836586, + 0.24490497261285782, + 0.13949201256036758, + 0.0, + 0.07765371724963188, + 0.2265036590397358, + 0.7665571477264166, + 0.3318071588873863, + 0.546321589499712, + 0.30476122349500656, + 0.2658341396600008, + 0.23096656426787376, + 0.9962964616715908, + 0.46153037063777447, + 0.9533576387912035, + 0.19547254219651222, + 0.0, + 0.0797065906226635, + 0.22996416687965393, + 0.5119993016123772, + 1.8384574688971043, + 0.1411931961774826, + 0.20263930410146713, + 1.5111949685961008, + 0.1265640277415514, + 1.375647183507681, + 0.12328926101326942, + 0.6408582795411348, + 0.08715378120541573, + 0.08424887247383595, + 1.499778177589178, + 0.5900349467992783, + 0.05945008993148804, + 0.0 + ], + "unique_experts": 60, + "load_cv": 0.7347057864156187, + "normalized_load_entropy": 0.9298433439497262, + "max_load_share": 0.042222222222222223 + } + }, + "s0_x": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "6c41dcc93615d0a77b146484000722966c26442b77a5305f091d9536c68a60c6", + "route_weight_sha256": "2ce6d22baca63289dbe0e4f865200238c2921e3e2d3cf7d58ac4e4ee90e3b204", + "loads": [ + 5, + 8, + 5, + 0, + 5, + 12, + 8, + 3, + 2, + 3, + 0, + 2, + 6, + 0, + 0, + 3, + 0, + 0, + 3, + 8, + 1, + 5, + 3, + 3, + 6, + 2, + 4, + 1, + 0, + 4, + 2, + 7, + 2, + 0, + 0, + 1, + 10, + 4, + 3, + 1, + 1, + 1, + 10, + 4, + 1, + 2, + 0, + 2, + 6, + 3, + 0, + 4, + 5, + 7, + 2, + 5, + 2, + 3, + 1, + 1, + 1, + 11, + 0, + 0 + ], + "weighted_loads": [ + 0.19875411689281464, + 0.3078309353441, + 0.20307965949177742, + 0.0, + 0.1870950683951378, + 1.1560108289122581, + 1.218218382447958, + 0.10775330290198326, + 0.10731950774788857, + 0.24959051981568336, + 0.0, + 0.059184061363339424, + 0.5126425884664059, + 0.0, + 0.0, + 0.17616790533065796, + 0.0, + 0.0, + 0.09712237305939198, + 0.6751677915453911, + 0.03056577406823635, + 0.3413878381252289, + 0.15055841021239758, + 0.14236724004149437, + 0.4594398308545351, + 0.07754869386553764, + 0.14585504308342934, + 0.026267649605870247, + 0.0, + 0.1075932439416647, + 0.07292425818741322, + 0.20738266222178936, + 0.0682394728064537, + 0.0, + 0.0, + 0.04131821170449257, + 0.5836603287607431, + 0.16187009401619434, + 0.10482792183756828, + 0.05168110132217407, + 0.0577138252556324, + 0.03873583301901817, + 0.8285818658769131, + 0.14710326492786407, + 0.06952714920043945, + 0.11993331089615822, + 0.0, + 0.07638014480471611, + 0.22877713292837143, + 0.1705869361758232, + 0.0, + 0.13540544360876083, + 0.20440298318862915, + 0.851977501064539, + 0.09689683839678764, + 0.21863535046577454, + 0.10207442566752434, + 0.10041554272174835, + 0.0505242645740509, + 0.031050078570842743, + 0.04556357488036156, + 0.5116099379956722, + 0.0, + 0.0 + ], + "unique_experts": 51, + "load_cv": 0.9360563342964715, + "normalized_load_entropy": 0.890015347845502, + "max_load_share": 0.058823529411764705 + }, + "full_input": { + "tokens": 59, + "top_k": 6, + "decisions": 354, + "ordered_route_sha256": "c46b437a9985ce87727f2391c8b82fc37ea0043c336848cce5008386ac7428ed", + "route_weight_sha256": "d720e48118cf02cea9c0e8dbfb34e7f1eac7741ac250b9e4c4096fde727fdd90", + "loads": [ + 5, + 10, + 5, + 8, + 14, + 14, + 14, + 11, + 2, + 3, + 0, + 2, + 10, + 1, + 0, + 4, + 1, + 0, + 14, + 8, + 5, + 5, + 10, + 3, + 7, + 11, + 5, + 1, + 0, + 8, + 2, + 7, + 2, + 1, + 1, + 1, + 14, + 6, + 4, + 1, + 3, + 3, + 12, + 5, + 13, + 2, + 0, + 2, + 7, + 4, + 8, + 4, + 5, + 14, + 2, + 10, + 2, + 9, + 1, + 1, + 13, + 14, + 0, + 0 + ], + "weighted_loads": [ + 0.19875411689281464, + 0.3717470560222864, + 0.20307965949177742, + 0.5987715348601341, + 0.7126481719315052, + 1.2315675616264343, + 1.402739791199565, + 0.5527260899543762, + 0.10731950774788857, + 0.24959051981568336, + 0.0, + 0.059184061363339424, + 0.6170439161360264, + 0.028082728385925293, + 0.0, + 0.2160825952887535, + 0.03664497286081314, + 0.0, + 1.075798099860549, + 0.6751677915453911, + 0.19020362757146358, + 0.3413878381252289, + 0.571620324626565, + 0.14236724004149437, + 0.5093421656638384, + 0.8561573661863804, + 0.16330071538686752, + 0.026267649605870247, + 0.0, + 0.24077642895281315, + 0.07292425818741322, + 0.20738266222178936, + 0.0682394728064537, + 0.02312881499528885, + 0.035287268459796906, + 0.04131821170449257, + 0.7507518641650677, + 0.22025681287050247, + 0.46937812492251396, + 0.05168110132217407, + 0.1221506092697382, + 0.15305836126208305, + 1.0133577324450016, + 0.18403353542089462, + 0.5407338514924049, + 0.11993331089615822, + 0.0, + 0.07638014480471611, + 0.2632898725569248, + 0.20902187749743462, + 1.1549391187727451, + 0.13540544360876083, + 0.20440298318862915, + 1.3117933720350266, + 0.09689683839678764, + 0.7799018919467926, + 0.10207442566752434, + 0.3092639558017254, + 0.0505242645740509, + 0.031050078570842743, + 1.5466314274817705, + 0.674321610480547, + 0.0, + 0.0 + ], + "unique_experts": 57, + "load_cv": 0.8376646987494708, + "normalized_load_entropy": 0.9081522568604848, + "max_load_share": 0.03954802259887006 + } + }, + "s1_x": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "b0f01b1df01f33c8caffafb104186a86a178a1d1729241ef7a153c8364156e36", + "route_weight_sha256": "b055bb43505d63372b22cbda2c0d568e27ca14d9ce07f427e121772613e4a476", + "loads": [ + 5, + 7, + 4, + 0, + 5, + 13, + 9, + 2, + 2, + 3, + 0, + 2, + 6, + 0, + 0, + 3, + 0, + 0, + 4, + 7, + 1, + 5, + 4, + 3, + 6, + 2, + 4, + 0, + 1, + 4, + 2, + 6, + 2, + 0, + 0, + 1, + 8, + 4, + 3, + 1, + 2, + 1, + 10, + 4, + 2, + 2, + 0, + 2, + 6, + 3, + 0, + 4, + 5, + 7, + 2, + 6, + 2, + 2, + 1, + 1, + 1, + 12, + 0, + 0 + ], + "weighted_loads": [ + 0.20320618897676468, + 0.27953147515654564, + 0.17917073518037796, + 0.0, + 0.19261158257722855, + 1.1266363859176636, + 1.2509525064378977, + 0.09793470427393913, + 0.10361339896917343, + 0.2408161386847496, + 0.0, + 0.05984271503984928, + 0.5448181852698326, + 0.0, + 0.0, + 0.16830049082636833, + 0.0, + 0.0, + 0.11836828105151653, + 0.6750509832054377, + 0.03285816311836243, + 0.3392298072576523, + 0.18109240382909775, + 0.14496546983718872, + 0.4492821618914604, + 0.08531416580080986, + 0.1377457045018673, + 0.0, + 0.032701049000024796, + 0.11154468357563019, + 0.07130696810781956, + 0.17492814548313618, + 0.06818244978785515, + 0.0, + 0.0, + 0.04452718049287796, + 0.5145846754312515, + 0.16066106781363487, + 0.1045476607978344, + 0.046258702874183655, + 0.08527032285928726, + 0.040840886533260345, + 0.8042715564370155, + 0.16177895292639732, + 0.113039780408144, + 0.11995506100356579, + 0.0, + 0.082780372351408, + 0.22234976291656494, + 0.17571116238832474, + 0.0, + 0.13525376841425896, + 0.1991070043295622, + 0.8552350997924805, + 0.10033776983618736, + 0.2428225316107273, + 0.10310149006545544, + 0.06565552018582821, + 0.04940938204526901, + 0.034050505608320236, + 0.04930717498064041, + 0.5250099617987871, + 0.0, + 0.0 + ], + "unique_experts": 51, + "load_cv": 0.9344119652897142, + "normalized_load_entropy": 0.8918174588745374, + "max_load_share": 0.06372549019607843 + }, + "full_input": { + "tokens": 75, + "top_k": 6, + "decisions": 450, + "ordered_route_sha256": "7e3f0bb4caafdcd5bd7ba392d03dbd12b3e6267d39eef68e88071aa0852c098c", + "route_weight_sha256": "8769919d4d248f398fc16d59dcdde6baf7690b5fcb5d03877be7235a9d2211c5", + "loads": [ + 9, + 8, + 4, + 12, + 15, + 21, + 12, + 12, + 2, + 5, + 2, + 2, + 9, + 1, + 1, + 16, + 7, + 0, + 15, + 8, + 5, + 7, + 15, + 5, + 9, + 15, + 5, + 2, + 1, + 8, + 2, + 7, + 3, + 0, + 1, + 3, + 12, + 9, + 5, + 5, + 5, + 3, + 12, + 8, + 17, + 3, + 0, + 2, + 7, + 7, + 13, + 4, + 5, + 16, + 3, + 18, + 3, + 10, + 2, + 3, + 14, + 14, + 1, + 0 + ], + "weighted_loads": [ + 0.39818823896348476, + 0.3036618083715439, + 0.17917073518037796, + 0.7903781235218048, + 0.776348777115345, + 1.4301747493445873, + 1.358576163649559, + 0.7035522349178791, + 0.10361339896917343, + 0.47477494552731514, + 0.09044338390231133, + 0.05984271503984928, + 0.6324772853404284, + 0.28377774357795715, + 0.05852897837758064, + 0.8937744610011578, + 0.4656483307480812, + 0.0, + 1.2081538084894419, + 0.7129710409790277, + 0.1983179748058319, + 0.40691911429166794, + 0.9119910448789597, + 0.31870344281196594, + 0.5611477643251419, + 1.1567093692719936, + 0.15519137680530548, + 0.05785396881401539, + 0.032701049000024796, + 0.2173459343612194, + 0.07130696810781956, + 0.2056207600980997, + 0.11621777340769768, + 0.0, + 0.028812836855649948, + 0.2221323624253273, + 0.6961803659796715, + 0.36034227907657623, + 0.5111733190715313, + 0.24318482354283333, + 0.22395308688282967, + 0.16336802765727043, + 0.9893262684345245, + 0.3482675477862358, + 1.0179797653108835, + 0.1923250388354063, + 0.0, + 0.082780372351408, + 0.26181378960609436, + 0.4099898524582386, + 1.660339318215847, + 0.13525376841425896, + 0.1991070043295622, + 1.2806039322167635, + 0.12857802025973797, + 1.3822683095932007, + 0.14897212572395802, + 0.6578235980123281, + 0.08631343767046928, + 0.08544491790235043, + 1.561971005052328, + 0.6518806498497725, + 0.05945008993148804, + 0.0 + ], + "unique_experts": 60, + "load_cv": 0.7617394000445604, + "normalized_load_entropy": 0.9257182119723765, + "max_load_share": 0.04666666666666667 + } + }, + "s0_period": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "5949e2dce4900a396fef0ad44cae28b3b27c6b58661f3a47d54e3e47f255277a", + "route_weight_sha256": "d57ba7685ef2f81699669af4cab6e8d58eea4b4cc64608368628a107d0906b8c", + "loads": [ + 5, + 8, + 5, + 1, + 4, + 12, + 8, + 3, + 2, + 3, + 0, + 1, + 6, + 0, + 1, + 3, + 0, + 0, + 2, + 7, + 1, + 5, + 4, + 3, + 6, + 1, + 5, + 1, + 1, + 4, + 2, + 7, + 2, + 0, + 0, + 1, + 10, + 3, + 3, + 1, + 1, + 1, + 10, + 4, + 1, + 2, + 0, + 2, + 7, + 4, + 0, + 3, + 5, + 7, + 2, + 6, + 2, + 2, + 1, + 1, + 1, + 11, + 0, + 0 + ], + "weighted_loads": [ + 0.19796215556561947, + 0.3084577862173319, + 0.21201390400528908, + 0.03423390910029411, + 0.14022709429264069, + 1.1375565230846405, + 1.212267816066742, + 0.113497294485569, + 0.10689263418316841, + 0.24623045697808266, + 0.0, + 0.029642028734087944, + 0.512008536607027, + 0.0, + 0.039520978927612305, + 0.17858803644776344, + 0.0, + 0.0, + 0.06509502232074738, + 0.6412661597132683, + 0.033889275044202805, + 0.34063320606946945, + 0.19424359872937202, + 0.14270012080669403, + 0.45751926861703396, + 0.04201898351311684, + 0.17351090908050537, + 0.02499084547162056, + 0.029349688440561295, + 0.11237066984176636, + 0.06007099524140358, + 0.21567260846495628, + 0.06654650345444679, + 0.0, + 0.0, + 0.04447555914521217, + 0.5747141782194376, + 0.14163774624466896, + 0.09940737672150135, + 0.050400812178850174, + 0.05942428112030029, + 0.03756141662597656, + 0.8139349296689034, + 0.14660015888512135, + 0.06626541912555695, + 0.12090571038424969, + 0.0, + 0.07991791516542435, + 0.2587771899998188, + 0.20692008174955845, + 0.0, + 0.09933970868587494, + 0.20355261489748955, + 0.859870195388794, + 0.098695769906044, + 0.24189831875264645, + 0.1052403450012207, + 0.0644409004598856, + 0.04930967092514038, + 0.03268074616789818, + 0.04560622572898865, + 0.49612785317003727, + 0.0, + 0.0 + ], + "unique_experts": 54, + "load_cv": 0.9327646974326507, + "normalized_load_entropy": 0.8947673466771665, + "max_load_share": 0.058823529411764705 + }, + "full_input": { + "tokens": 59, + "top_k": 6, + "decisions": 354, + "ordered_route_sha256": "97d0497263dfcc1f90f832fbfd9dead5811368602ad5be5ba143e15a63e74627", + "route_weight_sha256": "de9bfbfb07ffdfa1152f3ca06a8203a618f2249c2fef336eb1b39c4dd2a10459", + "loads": [ + 5, + 10, + 5, + 9, + 13, + 14, + 14, + 12, + 2, + 3, + 0, + 1, + 10, + 0, + 1, + 4, + 1, + 0, + 12, + 7, + 7, + 5, + 11, + 3, + 7, + 10, + 6, + 1, + 1, + 7, + 2, + 7, + 2, + 1, + 1, + 1, + 13, + 5, + 4, + 2, + 3, + 3, + 12, + 5, + 15, + 2, + 0, + 2, + 8, + 5, + 9, + 3, + 5, + 14, + 2, + 10, + 2, + 6, + 1, + 1, + 12, + 15, + 0, + 0 + ], + "weighted_loads": [ + 0.19796215556561947, + 0.37495660223066807, + 0.21201390400528908, + 0.6330054439604282, + 0.5861993655562401, + 1.2131132557988167, + 1.4125929195433855, + 0.714405007660389, + 0.10689263418316841, + 0.24623045697808266, + 0.0, + 0.029642028734087944, + 0.6164098642766476, + 0.0, + 0.039520978927612305, + 0.218502726405859, + 0.03664497286081314, + 0.0, + 0.9433339275419712, + 0.6412661597132683, + 0.28049885481595993, + 0.34063320606946945, + 0.6369130611419678, + 0.14270012080669403, + 0.5103593487292528, + 0.8667491879314184, + 0.19095658138394356, + 0.02499084547162056, + 0.029349688440561295, + 0.21514582633972168, + 0.06007099524140358, + 0.21567260846495628, + 0.06654650345444679, + 0.02312881499528885, + 0.03490549698472023, + 0.04447555914521217, + 0.7088434547185898, + 0.2000244650989771, + 0.46395757980644703, + 0.08990944176912308, + 0.148912126198411, + 0.1546783372759819, + 1.0012927502393723, + 0.1835304293781519, + 0.6194164976477623, + 0.12090571038424969, + 0.0, + 0.07991791516542435, + 0.2932899296283722, + 0.26741199381649494, + 1.1442905850708485, + 0.09933970868587494, + 0.20355261489748955, + 1.2790637258440256, + 0.098695769906044, + 0.7742209006100893, + 0.1052403450012207, + 0.1830554399639368, + 0.04930967092514038, + 0.03268074616789818, + 1.3543632235378027, + 0.7080179695039988, + 0.0, + 0.0 + ], + "unique_experts": 58, + "load_cv": 0.8309311350038412, + "normalized_load_entropy": 0.9104607781023591, + "max_load_share": 0.0423728813559322 + } + }, + "s1_period": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "bd0556e1c19fdbcc08fd158e0066248501a31ad9d39135efac429537e2ff4c8e", + "route_weight_sha256": "b88cb3de4209db1033dc3b88abe10d3b5e94df9fb5fa361501d6bddcffbce812", + "loads": [ + 5, + 7, + 4, + 0, + 5, + 12, + 9, + 2, + 3, + 3, + 0, + 2, + 6, + 0, + 0, + 3, + 0, + 0, + 4, + 7, + 1, + 5, + 4, + 3, + 6, + 2, + 4, + 1, + 1, + 4, + 1, + 6, + 2, + 0, + 0, + 1, + 8, + 4, + 3, + 1, + 3, + 1, + 10, + 4, + 1, + 2, + 0, + 2, + 5, + 3, + 0, + 4, + 5, + 8, + 2, + 5, + 1, + 3, + 1, + 1, + 2, + 12, + 0, + 0 + ], + "weighted_loads": [ + 0.2056382168084383, + 0.2762672584503889, + 0.17861119657754898, + 0.0, + 0.18781344592571259, + 1.0747578740119934, + 1.2587812021374702, + 0.09130629524588585, + 0.15145232155919075, + 0.24060587212443352, + 0.0, + 0.05671337805688381, + 0.5507582426071167, + 0.0, + 0.0, + 0.169972725212574, + 0.0, + 0.0, + 0.11991765350103378, + 0.6630855482071638, + 0.0344230979681015, + 0.33991987258195877, + 0.17677615210413933, + 0.14224069565534592, + 0.44581050984561443, + 0.08695446327328682, + 0.13916481472551823, + 0.023448502644896507, + 0.02815675176680088, + 0.1133258119225502, + 0.0280478335916996, + 0.18431318923830986, + 0.07051495090126991, + 0.0, + 0.0, + 0.04401681199669838, + 0.512000834569335, + 0.16523752734065056, + 0.100211501121521, + 0.04638415575027466, + 0.12497690692543983, + 0.03967362642288208, + 0.8150940090417862, + 0.16326862946152687, + 0.06759040802717209, + 0.12625844031572342, + 0.0, + 0.07758943364024162, + 0.1824073512107134, + 0.1713540144264698, + 0.0, + 0.13871001824736595, + 0.1952375676482916, + 0.8992715291678905, + 0.10022162273526192, + 0.21652190014719963, + 0.07875475287437439, + 0.09557162411510944, + 0.04794666916131973, + 0.03599921241402626, + 0.08065495267510414, + 0.5129844285547733, + 0.0, + 0.0 + ], + "unique_experts": 52, + "load_cv": 0.9161291283312679, + "normalized_load_entropy": 0.8953086821873425, + "max_load_share": 0.058823529411764705 + }, + "full_input": { + "tokens": 75, + "top_k": 6, + "decisions": 450, + "ordered_route_sha256": "4343eaa03c3667e37a2d6d097108dddc6197a67ca3e984babacdfd3c5e309cb4", + "route_weight_sha256": "de4ed569bce2bf7610fb4d0a5081afe8594f5b651704858df42bab991056d3b4", + "loads": [ + 10, + 8, + 4, + 11, + 14, + 18, + 12, + 12, + 3, + 5, + 2, + 2, + 10, + 1, + 1, + 16, + 5, + 0, + 14, + 8, + 7, + 6, + 15, + 5, + 8, + 16, + 5, + 2, + 1, + 8, + 1, + 7, + 3, + 0, + 1, + 3, + 12, + 9, + 5, + 7, + 8, + 3, + 12, + 8, + 16, + 3, + 0, + 2, + 5, + 8, + 13, + 4, + 5, + 17, + 3, + 18, + 2, + 10, + 2, + 3, + 15, + 15, + 1, + 0 + ], + "weighted_loads": [ + 0.430493351072073, + 0.30039759166538715, + 0.17861119657754898, + 0.757399994879961, + 0.661431048065424, + 1.3031972721219063, + 1.3661678228527308, + 0.7362855151295662, + 0.15145232155919075, + 0.47456467896699905, + 0.09044338390231133, + 0.05671337805688381, + 0.6839197594672441, + 0.28377774357795715, + 0.05852897837758064, + 0.9012019447982311, + 0.29874911718070507, + 0.0, + 1.0980929397046566, + 0.7010056059807539, + 0.27162111923098564, + 0.37492041662335396, + 0.9325880818068981, + 0.31597866863012314, + 0.5275830123573542, + 1.1886612549424171, + 0.1566104870289564, + 0.047639667987823486, + 0.02815675176680088, + 0.21912706270813942, + 0.0280478335916996, + 0.2150058038532734, + 0.11855027452111244, + 0.0, + 0.028812836855649948, + 0.22162199392914772, + 0.685285335406661, + 0.3638034872710705, + 0.5068371593952179, + 0.3334088586270809, + 0.336814071983099, + 0.1638035662472248, + 1.0030623003840446, + 0.34975722432136536, + 0.9563205931335688, + 0.19862841814756393, + 0.0, + 0.07758943364024162, + 0.1824073512107134, + 0.49158938974142075, + 1.6975311823189259, + 0.13871001824736595, + 0.1952375676482916, + 1.340667286887765, + 0.12846187315881252, + 1.3370818607509136, + 0.12462538853287697, + 0.641551760956645, + 0.08485072478652, + 0.08739362470805645, + 1.5391108803451061, + 0.6872516609728336, + 0.05945008993148804, + 0.0 + ], + "unique_experts": 60, + "load_cv": 0.7512951779723096, + "normalized_load_entropy": 0.9262002210502561, + "max_load_share": 0.04 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 34, + "ordered_topk_exact_tokens": 19, + "set_exact_tokens": 23, + "mean_set_jaccard": 0.9075630252100839, + "mean_token_weighted_tv": 0.014723493608043474, + "aggregate_load_tv": 0.044117647058823525 + }, + "system_bos": { + "tokens": 34, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 18, + "mean_set_jaccard": 0.865546218487395, + "mean_token_weighted_tv": 0.022414699552909416, + "aggregate_load_tv": 0.058823529411764705 + }, + "system_x": { + "tokens": 34, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 23, + "mean_set_jaccard": 0.9012605042016808, + "mean_token_weighted_tv": 0.019797877819441697, + "aggregate_load_tv": 0.044117647058823525 + }, + "system_period": { + "tokens": 34, + "ordered_topk_exact_tokens": 16, + "set_exact_tokens": 18, + "mean_set_jaccard": 0.865546218487395, + "mean_token_weighted_tv": 0.023914010647465202, + "aggregate_load_tv": 0.07352941176470588 + }, + "bos_at_s0": { + "tokens": 34, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 15, + "mean_set_jaccard": 0.8340336134453782, + "mean_token_weighted_tv": 0.026943874216693288, + "aggregate_load_tv": 0.058823529411764705 + }, + "bos_at_s1": { + "tokens": 34, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 22, + "mean_set_jaccard": 0.8991596638655464, + "mean_token_weighted_tv": 0.01877232829985373, + "aggregate_load_tv": 0.058823529411764705 + }, + "x_at_s0": { + "tokens": 34, + "ordered_topk_exact_tokens": 17, + "set_exact_tokens": 20, + "mean_set_jaccard": 0.8648459383753502, + "mean_token_weighted_tv": 0.02408100730356048, + "aggregate_load_tv": 0.06862745098039215 + }, + "x_at_s1": { + "tokens": 34, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 21, + "mean_set_jaccard": 0.8781512605042017, + "mean_token_weighted_tv": 0.024102766915936682, + "aggregate_load_tv": 0.06372549019607843 + }, + "period_at_s0": { + "tokens": 34, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 18, + "mean_set_jaccard": 0.8592436974789917, + "mean_token_weighted_tv": 0.023869782247964072, + "aggregate_load_tv": 0.053921568627450976 + }, + "period_at_s1": { + "tokens": 34, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 20, + "mean_set_jaccard": 0.8760504201680673, + "mean_token_weighted_tv": 0.02453523490797071, + "aggregate_load_tv": 0.06862745098039216 + } + } + }, + "layer_21": { + "layer": 21, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "61fa4275ac53351e73cb7ff4dceac338c45bd28b5df725a1b26ca6b93fdd89ee", + "route_weight_sha256": "bb241a4253f9b86ad248e92efed2a29f611be12bc921f057379a8742350740b0", + "loads": [ + 0, + 4, + 1, + 1, + 1, + 6, + 0, + 2, + 10, + 11, + 10, + 7, + 0, + 2, + 1, + 2, + 6, + 1, + 2, + 6, + 5, + 2, + 6, + 4, + 5, + 0, + 0, + 0, + 3, + 4, + 9, + 5, + 0, + 4, + 0, + 4, + 0, + 1, + 7, + 7, + 8, + 2, + 0, + 6, + 0, + 2, + 7, + 3, + 0, + 1, + 1, + 4, + 5, + 0, + 0, + 2, + 1, + 10, + 4, + 1, + 1, + 1, + 3, + 3 + ], + "weighted_loads": [ + 0.0, + 0.2381833717226982, + 0.03621730953454971, + 0.03017314523458481, + 0.04373975843191147, + 0.1879564020782709, + 0.0, + 0.11872408911585808, + 0.45790936052799225, + 1.0441956669092178, + 0.6729885004460812, + 0.276955958455801, + 0.0, + 0.08896536380052567, + 0.0391584187746048, + 0.07646353170275688, + 0.2530803270637989, + 0.03707265108823776, + 0.07037363201379776, + 0.1824772208929062, + 0.29458907060325146, + 0.05741792358458042, + 0.4039255157113075, + 0.4440665766596794, + 0.294161943718791, + 0.0, + 0.0, + 0.0, + 0.10557019710540771, + 0.34927595406770706, + 0.7693342752754688, + 0.18381849490106106, + 0.0, + 0.40881185233592987, + 0.0, + 0.15914570540189743, + 0.0, + 0.05186602845788002, + 0.35576973110437393, + 0.3003263585269451, + 0.30656823702156544, + 0.06700105965137482, + 0.0, + 0.5790376476943493, + 0.0, + 0.090399831533432, + 0.4019519090652466, + 0.37984611839056015, + 0.0, + 0.046042509377002716, + 0.05832447484135628, + 0.22173736616969109, + 0.19366127997636795, + 0.0, + 0.0, + 0.06781241483986378, + 0.07409846782684326, + 0.758633803576231, + 0.1542882863432169, + 0.06500846147537231, + 0.03153115510940552, + 0.04459492117166519, + 0.0775831788778305, + 0.18771298602223396 + ], + "unique_experts": 50, + "load_cv": 0.9474870139882015, + "normalized_load_entropy": 0.8834321318234677, + "max_load_share": 0.05392156862745098 + }, + "full_input": { + "tokens": 59, + "top_k": 6, + "decisions": 354, + "ordered_route_sha256": "3f7de8253170a7861575ae32174e5bfd6b3038544ed94740f384d3b6c47f7bbf", + "route_weight_sha256": "0df353469ba1b899f70b28f4b328cd88ea4c7a6b955e7ae03d22890bd44c596d", + "loads": [ + 0, + 4, + 4, + 1, + 7, + 8, + 2, + 2, + 11, + 11, + 18, + 7, + 3, + 7, + 3, + 8, + 7, + 4, + 2, + 10, + 5, + 10, + 6, + 4, + 6, + 1, + 9, + 5, + 7, + 4, + 13, + 5, + 1, + 5, + 1, + 15, + 0, + 1, + 7, + 9, + 9, + 2, + 5, + 6, + 0, + 2, + 7, + 3, + 10, + 3, + 1, + 11, + 15, + 1, + 4, + 6, + 3, + 10, + 8, + 5, + 1, + 1, + 5, + 3 + ], + "weighted_loads": [ + 0.0, + 0.2381833717226982, + 0.11205896898172796, + 0.03017314523458481, + 0.26888345927000046, + 0.2571838069707155, + 0.21747974678874016, + 0.11872408911585808, + 0.5162553004920483, + 1.0441956669092178, + 1.2431596107780933, + 0.276955958455801, + 0.15582414716482162, + 0.4022561013698578, + 0.1262847948819399, + 0.2803595084697008, + 0.2663443433120847, + 0.12226647231727839, + 0.07037363201379776, + 1.7375803850591183, + 0.29458907060325146, + 0.5383707182481885, + 0.4039255157113075, + 0.4440665766596794, + 0.3304369170218706, + 0.03667991980910301, + 0.395935432985425, + 0.5415333174169064, + 0.20784645760431886, + 0.34927595406770706, + 1.0359496772289276, + 0.18381849490106106, + 0.02283613570034504, + 0.4513065852224827, + 0.04932541772723198, + 0.764350026845932, + 0.0, + 0.05186602845788002, + 0.35576973110437393, + 0.39715780317783356, + 0.36659581772983074, + 0.06700105965137482, + 0.3056508041918278, + 0.5790376476943493, + 0.0, + 0.090399831533432, + 0.4019519090652466, + 0.37984611839056015, + 0.5543308593332767, + 0.3004451170563698, + 0.05832447484135628, + 0.5485272258520126, + 0.8085919730365276, + 0.013009678572416306, + 0.12061383482068777, + 0.4833597894757986, + 0.15015219151973724, + 0.758633803576231, + 0.36852611042559147, + 0.23781942576169968, + 0.03153115510940552, + 0.04459492117166519, + 0.16692117974162102, + 0.18771298602223396 + ], + "unique_experts": 61, + "load_cv": 0.7231417722621104, + "normalized_load_entropy": 0.9346227112606843, + "max_load_share": 0.05084745762711865 + } + }, + "s1_eos": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "e282cea1c67af89afb68c384ec3a233d6a57d1f8bc74005389128b882a37c155", + "route_weight_sha256": "dcbe035ff6f88a61dd64ee5ccef5ec2cff6b27b1a0dde745a870af719effb9c5", + "loads": [ + 0, + 4, + 1, + 1, + 1, + 3, + 1, + 2, + 10, + 11, + 10, + 6, + 0, + 2, + 1, + 2, + 6, + 1, + 2, + 8, + 5, + 1, + 6, + 3, + 5, + 0, + 0, + 0, + 3, + 4, + 9, + 6, + 1, + 4, + 0, + 5, + 0, + 1, + 7, + 8, + 8, + 1, + 0, + 6, + 0, + 2, + 7, + 3, + 0, + 1, + 1, + 4, + 5, + 0, + 0, + 2, + 2, + 10, + 5, + 1, + 1, + 1, + 1, + 3 + ], + "weighted_loads": [ + 0.0, + 0.24241723865270615, + 0.04675240069627762, + 0.03134243190288544, + 0.045877523720264435, + 0.10378457419574261, + 0.045007552951574326, + 0.12844153493642807, + 0.45864231139421463, + 1.013254303485155, + 0.6829498447477818, + 0.24075109511613846, + 0.0, + 0.09902079030871391, + 0.03914541378617287, + 0.07217348739504814, + 0.24861609190702438, + 0.04084198176860809, + 0.07049991749227047, + 0.24986913800239563, + 0.2872030586004257, + 0.029989274218678474, + 0.40539374202489853, + 0.40231766179203987, + 0.28815747424960136, + 0.0, + 0.0, + 0.0, + 0.1054016463458538, + 0.3474826216697693, + 0.7626732736825943, + 0.21819100342690945, + 0.031002435833215714, + 0.3938828147947788, + 0.0, + 0.18256827630102634, + 0.0, + 0.05811849236488342, + 0.3447323739528656, + 0.29539174772799015, + 0.3030985891819, + 0.03421848267316818, + 0.0, + 0.5784680172801018, + 0.0, + 0.0980621762573719, + 0.4189010001718998, + 0.3706582710146904, + 0.0, + 0.04483180493116379, + 0.056704457849264145, + 0.21072731725871563, + 0.19528033398091793, + 0.0, + 0.0, + 0.07000352069735527, + 0.11134649068117142, + 0.7464315369725227, + 0.1813833136111498, + 0.06942276656627655, + 0.03065631352365017, + 0.049229033291339874, + 0.030984774231910706, + 0.18080220744013786 + ], + "unique_experts": 52, + "load_cv": 0.9603840702947809, + "normalized_load_entropy": 0.8841988319314793, + "max_load_share": 0.05392156862745098 + }, + "full_input": { + "tokens": 75, + "top_k": 6, + "decisions": 450, + "ordered_route_sha256": "f77d504d412e801dd96f556a8e12f96a31ed60f25e225559da84a877d8641e98", + "route_weight_sha256": "83057dd0d9bb2e779530095b650aebe12bad49c575d11bcbbe65485beaa515ca", + "loads": [ + 7, + 7, + 4, + 1, + 1, + 4, + 5, + 3, + 13, + 13, + 20, + 6, + 5, + 12, + 7, + 7, + 7, + 9, + 4, + 13, + 6, + 10, + 7, + 8, + 7, + 2, + 8, + 9, + 7, + 5, + 17, + 6, + 2, + 9, + 0, + 21, + 1, + 2, + 8, + 10, + 8, + 4, + 8, + 7, + 1, + 3, + 7, + 3, + 10, + 6, + 3, + 14, + 15, + 1, + 11, + 12, + 7, + 10, + 9, + 7, + 2, + 2, + 3, + 4 + ], + "weighted_loads": [ + 0.47332737408578396, + 0.36597586050629616, + 0.7399681597016752, + 0.03134243190288544, + 0.045877523720264435, + 0.11959373764693737, + 0.23417799547314644, + 0.2068076878786087, + 0.5979256294667721, + 1.1598370485007763, + 1.2993934750556946, + 0.24075109511613846, + 0.23844607174396515, + 0.6344892866909504, + 0.28005867823958397, + 0.2470230981707573, + 0.26188010815531015, + 0.31657755794003606, + 0.1232061367481947, + 1.8143850769847631, + 0.3335127867758274, + 0.5313041931949556, + 0.4355881102383137, + 0.8901208806782961, + 0.36601080000400543, + 0.07666055113077164, + 0.2895758729428053, + 0.9421937763690948, + 0.178956582210958, + 0.39739714935421944, + 1.1679615303874016, + 0.21819100342690945, + 0.053685201331973076, + 1.026360884308815, + 0.0, + 1.06508800201118, + 0.07001567631959915, + 0.09915412589907646, + 0.40047330036759377, + 0.3938294295221567, + 0.3030985891819, + 0.1976400427520275, + 0.424577746540308, + 0.6229876093566418, + 0.06878439337015152, + 0.15639229118824005, + 0.4189010001718998, + 0.3706582710146904, + 0.7918591424822807, + 1.117247674614191, + 0.13706489652395248, + 0.9198098946362734, + 0.808745251968503, + 0.013009678572416306, + 0.6944566881284118, + 0.7724409941583872, + 0.3078201897442341, + 0.7464315369725227, + 0.3980526067316532, + 0.36481242813169956, + 0.05306352861225605, + 0.11105749011039734, + 0.10705795884132385, + 0.27286745980381966 + ], + "unique_experts": 63, + "load_cv": 0.6419568848258492, + "normalized_load_entropy": 0.9497283033503197, + "max_load_share": 0.04666666666666667 + } + }, + "s0_bos": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "809fc3b4faa2647678a1a8d2e2c601153e180bceb5d0e8ee58e16b081cde1609", + "route_weight_sha256": "11eabaf60222d853d27fc954ab03a247e10d7dc0f11d2bc6611255534622a95a", + "loads": [ + 0, + 4, + 1, + 1, + 1, + 2, + 1, + 2, + 9, + 11, + 11, + 5, + 0, + 2, + 1, + 3, + 6, + 0, + 2, + 7, + 5, + 2, + 6, + 4, + 5, + 0, + 0, + 0, + 4, + 4, + 9, + 8, + 1, + 3, + 0, + 3, + 0, + 1, + 7, + 8, + 9, + 1, + 0, + 6, + 0, + 2, + 7, + 4, + 0, + 1, + 1, + 3, + 4, + 1, + 0, + 2, + 1, + 10, + 6, + 1, + 1, + 1, + 1, + 3 + ], + "weighted_loads": [ + 0.0, + 0.22673022374510765, + 0.04251088201999664, + 0.030948780477046967, + 0.043119363486766815, + 0.06073169410228729, + 0.04666968435049057, + 0.1298615261912346, + 0.4272148534655571, + 1.029205296188593, + 0.6915123574435711, + 0.1912621408700943, + 0.0, + 0.09657672047615051, + 0.03868049383163452, + 0.1102005522698164, + 0.2514316253364086, + 0.0, + 0.07184551656246185, + 0.22320480085909367, + 0.31099897250533104, + 0.0565476156771183, + 0.392831202596426, + 0.45282692834734917, + 0.2898973524570465, + 0.0, + 0.0, + 0.0, + 0.1419869177043438, + 0.3526106923818588, + 0.800170011818409, + 0.294329134747386, + 0.030802669003605843, + 0.36129753291606903, + 0.0, + 0.12637014500796795, + 0.0, + 0.05252894386649132, + 0.34640665724873543, + 0.292117677628994, + 0.3412183467298746, + 0.03619184345006943, + 0.0, + 0.5885079316794872, + 0.0, + 0.09996409714221954, + 0.40941981598734856, + 0.42661385983228683, + 0.0, + 0.047153979539871216, + 0.05722462385892868, + 0.1853482946753502, + 0.16321688890457153, + 0.025204453617334366, + 0.0, + 0.06590899638831615, + 0.07436332106590271, + 0.7711960934102535, + 0.23290653340518475, + 0.06464993208646774, + 0.03133609890937805, + 0.041686635464429855, + 0.03000938519835472, + 0.18970626592636108 + ], + "unique_experts": 52, + "load_cv": 0.9715285601441173, + "normalized_load_entropy": 0.8828946943216531, + "max_load_share": 0.05392156862745098 + }, + "full_input": { + "tokens": 59, + "top_k": 6, + "decisions": 354, + "ordered_route_sha256": "9a939c675d29698df8d0c7bce5e0483b87dc515916074538b68a42022a41e5b0", + "route_weight_sha256": "af233542f954f6714a74957674e2f1317935f21a9378c4cfa441f56da68c142b", + "loads": [ + 0, + 7, + 3, + 2, + 6, + 3, + 2, + 2, + 11, + 11, + 18, + 5, + 3, + 7, + 3, + 8, + 7, + 2, + 3, + 9, + 5, + 9, + 6, + 4, + 6, + 1, + 9, + 5, + 7, + 4, + 13, + 10, + 2, + 4, + 1, + 14, + 0, + 1, + 7, + 11, + 11, + 1, + 5, + 6, + 0, + 3, + 7, + 4, + 10, + 3, + 1, + 10, + 14, + 2, + 4, + 6, + 3, + 10, + 9, + 5, + 1, + 1, + 4, + 3 + ], + "weighted_loads": [ + 0.0, + 0.3431180864572525, + 0.11584337800741196, + 0.1994032934308052, + 0.23289012536406517, + 0.09516271203756332, + 0.21711187809705734, + 0.1298615261912346, + 0.5266517326235771, + 1.029205296188593, + 1.1628586910665035, + 0.1912621408700943, + 0.15638761222362518, + 0.37616177648305893, + 0.12404096685349941, + 0.2977641299366951, + 0.2646956415846944, + 0.08120047673583031, + 0.1270306520164013, + 0.8025518786162138, + 0.31099897250533104, + 0.5372764961794019, + 0.392831202596426, + 0.45282692834734917, + 0.33269064128398895, + 0.03667991980910301, + 0.395935432985425, + 0.520967036485672, + 0.24072843696922064, + 0.3526106923818588, + 1.0698170885443687, + 0.44823083095252514, + 0.05363880470395088, + 0.400041863322258, + 0.04932541772723198, + 0.7315771169960499, + 0.0, + 0.05252894386649132, + 0.34640665724873543, + 0.4329901747405529, + 0.4764645900577307, + 0.03619184345006943, + 0.29699917137622833, + 0.5885079316794872, + 0.0, + 0.21600762009620667, + 0.40941981598734856, + 0.42661385983228683, + 0.5543308593332767, + 0.3223237991333008, + 0.05722462385892868, + 0.5121381543576717, + 0.7781475819647312, + 0.03821413218975067, + 0.12061383482068777, + 0.49252250231802464, + 0.15534073114395142, + 0.7711960934102535, + 0.3723544832319021, + 0.23413998633623123, + 0.03133609890937805, + 0.041686635464429855, + 0.17624440416693687, + 0.18970626592636108 + ], + "unique_experts": 61, + "load_cv": 0.7167574639230748, + "normalized_load_entropy": 0.9360888294928457, + "max_load_share": 0.05084745762711865 + } + }, + "s1_bos": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "edb490e047c9d0ce38b10500846e317b406e508a48940d722860204b6c10f35a", + "route_weight_sha256": "31cbe67ae880389c3fd55f54aaa38fadc0101528b7716cd55511911d1cf86eaf", + "loads": [ + 0, + 4, + 1, + 1, + 1, + 4, + 1, + 2, + 9, + 11, + 9, + 6, + 0, + 3, + 1, + 2, + 6, + 1, + 2, + 8, + 5, + 0, + 6, + 3, + 5, + 0, + 0, + 0, + 3, + 4, + 9, + 6, + 0, + 5, + 0, + 3, + 0, + 1, + 7, + 9, + 8, + 1, + 0, + 7, + 0, + 2, + 7, + 4, + 0, + 2, + 2, + 3, + 4, + 0, + 0, + 2, + 1, + 10, + 5, + 1, + 1, + 1, + 2, + 3 + ], + "weighted_loads": [ + 0.0, + 0.2291092611849308, + 0.03716779500246048, + 0.030709778890013695, + 0.04431495815515518, + 0.12183728255331516, + 0.04611465707421303, + 0.11379554867744446, + 0.42342613637447357, + 0.9912553615868092, + 0.6441483125090599, + 0.2308516763150692, + 0.0, + 0.12946534156799316, + 0.037951886653900146, + 0.08051786571741104, + 0.2622466813772917, + 0.0389573872089386, + 0.07003166899085045, + 0.25545136630535126, + 0.28372893668711185, + 0.0, + 0.392817135900259, + 0.41446899622678757, + 0.28722806088626385, + 0.0, + 0.0, + 0.0, + 0.10708421096205711, + 0.3406857028603554, + 0.7905083708465099, + 0.21528010070323944, + 0.0, + 0.4488300010561943, + 0.0, + 0.13091121427714825, + 0.0, + 0.05769653618335724, + 0.32792932726442814, + 0.3274171780794859, + 0.31850339099764824, + 0.03467876836657524, + 0.0, + 0.60433647967875, + 0.0, + 0.09775004908442497, + 0.41045356169342995, + 0.4182630404829979, + 0.0, + 0.07253926619887352, + 0.08830081485211849, + 0.18312950246036053, + 0.16172238066792488, + 0.0, + 0.0, + 0.07424858771264553, + 0.07704906165599823, + 0.760991994291544, + 0.18674656003713608, + 0.06447125971317291, + 0.031001463532447815, + 0.043842606246471405, + 0.05924277566373348, + 0.1877806093543768 + ], + "unique_experts": 50, + "load_cv": 0.9539573376604032, + "normalized_load_entropy": 0.8822083338767422, + "max_load_share": 0.05392156862745098 + }, + "full_input": { + "tokens": 75, + "top_k": 6, + "decisions": 450, + "ordered_route_sha256": "dca5a0e89cb58b684f69af9b7a56b945da9e96835c322abba47bda1ac8562b04", + "route_weight_sha256": "7efe4eff7087cb6acebf0d07701d3ccc612739f384470307bdd85196dd56009a", + "loads": [ + 7, + 6, + 3, + 1, + 4, + 6, + 5, + 4, + 12, + 13, + 18, + 7, + 5, + 12, + 6, + 8, + 7, + 7, + 5, + 11, + 6, + 8, + 7, + 8, + 7, + 2, + 8, + 10, + 5, + 5, + 17, + 8, + 1, + 9, + 0, + 19, + 1, + 2, + 8, + 12, + 9, + 4, + 9, + 8, + 1, + 3, + 7, + 4, + 10, + 7, + 4, + 13, + 14, + 1, + 11, + 12, + 6, + 10, + 7, + 7, + 2, + 2, + 5, + 4 + ], + "weighted_loads": [ + 0.47332737408578396, + 0.3278251588344574, + 0.7277096509933472, + 0.030709778890013695, + 0.15659789741039276, + 0.1692215148359537, + 0.264483992010355, + 0.2282586395740509, + 0.5674537271261215, + 1.1378381066024303, + 1.212352842092514, + 0.2841997481882572, + 0.24164306372404099, + 0.5819327868521214, + 0.2522816080600023, + 0.3337986674159765, + 0.27551069762557745, + 0.27593670785427094, + 0.18736951425671577, + 0.848749153316021, + 0.33003866486251354, + 0.49300720635801554, + 0.42301150411367416, + 0.9022722151130438, + 0.3683094996958971, + 0.07666055113077164, + 0.2895758729428053, + 0.937054131180048, + 0.13817544747143984, + 0.3906002305448055, + 1.2140130922198296, + 0.34807104244828224, + 0.022682765498757362, + 1.0403190180659294, + 0.0, + 1.0134309399873018, + 0.07001567631959915, + 0.09873216971755028, + 0.3836702536791563, + 0.44385918974876404, + 0.3639332316815853, + 0.19810032844543457, + 0.4566492959856987, + 0.64885607175529, + 0.06878439337015152, + 0.15608016401529312, + 0.41045356169342995, + 0.4182630404829979, + 0.7918591424822807, + 1.1825482733547688, + 0.16866125352680683, + 0.8922120798379183, + 0.77518729865551, + 0.013009678572416306, + 0.6944566881284118, + 0.8141789883375168, + 0.2764304019510746, + 0.760991994291544, + 0.28843930922448635, + 0.36479964666068554, + 0.053408678621053696, + 0.10567106306552887, + 0.21024522744119167, + 0.2798458617180586 + ], + "unique_experts": 63, + "load_cv": 0.5917456911232756, + "normalized_load_entropy": 0.9558400527547157, + "max_load_share": 0.042222222222222223 + } + }, + "s0_x": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "ee503f5f29337e0d3301d066dbce99e2100385c4a0553428f525fc5c6e96a5de", + "route_weight_sha256": "65ae0ef53efd6cf185e9eac2c3e849a3b6d1d47b3a3ff44ed9473905cd286443", + "loads": [ + 1, + 4, + 1, + 1, + 1, + 2, + 1, + 2, + 9, + 11, + 8, + 5, + 0, + 2, + 1, + 3, + 6, + 1, + 2, + 8, + 5, + 0, + 6, + 3, + 5, + 0, + 0, + 0, + 4, + 4, + 9, + 7, + 1, + 3, + 0, + 4, + 0, + 1, + 7, + 10, + 7, + 1, + 0, + 6, + 0, + 2, + 8, + 4, + 0, + 2, + 2, + 3, + 4, + 0, + 0, + 3, + 2, + 10, + 5, + 1, + 1, + 1, + 1, + 3 + ], + "weighted_loads": [ + 0.02619609236717224, + 0.23086578026413918, + 0.03743497654795647, + 0.029355017468333244, + 0.046230241656303406, + 0.06416667439043522, + 0.043286606669425964, + 0.11362605541944504, + 0.42216039821505547, + 1.0153303667902946, + 0.615019453689456, + 0.19293686375021935, + 0.0, + 0.09225006029009819, + 0.03677478805184364, + 0.10756133124232292, + 0.2661856282502413, + 0.033704373985528946, + 0.07421504519879818, + 0.25051686353981495, + 0.2903649006038904, + 0.0, + 0.3855563849210739, + 0.40947356075048447, + 0.2851074282079935, + 0.0, + 0.0, + 0.0, + 0.14139846339821815, + 0.33802909404039383, + 0.8079793751239777, + 0.24858642928302288, + 0.03188761696219444, + 0.34168921411037445, + 0.0, + 0.1838448066264391, + 0.0, + 0.051125552505254745, + 0.350334832444787, + 0.37611163407564163, + 0.2890446148812771, + 0.032948266714811325, + 0.0, + 0.5356154926121235, + 0.0, + 0.09866835549473763, + 0.44801425002515316, + 0.409225944429636, + 0.0, + 0.07767645083367825, + 0.08299183659255505, + 0.1797469276934862, + 0.16121762245893478, + 0.0, + 0.0, + 0.1063614971935749, + 0.10841395705938339, + 0.758646484464407, + 0.1993212290108204, + 0.07013872265815735, + 0.029675768688321114, + 0.04432302340865135, + 0.031106408685445786, + 0.1813074443489313 + ], + "unique_experts": 52, + "load_cv": 0.9409722000550452, + "normalized_load_entropy": 0.8882125365576369, + "max_load_share": 0.05392156862745098 + }, + "full_input": { + "tokens": 59, + "top_k": 6, + "decisions": 354, + "ordered_route_sha256": "9285f40543ab3bf9f41b400794cbb37b9975b26ea6dbae63bf18423ab6075461", + "route_weight_sha256": "f522cca04093a679175fabef67a158f7aa11c7c10ccdc04d0dd93885fa25ca15", + "loads": [ + 1, + 5, + 3, + 1, + 6, + 2, + 3, + 2, + 10, + 11, + 18, + 5, + 4, + 6, + 3, + 9, + 7, + 5, + 2, + 10, + 5, + 6, + 6, + 3, + 6, + 1, + 9, + 5, + 8, + 4, + 13, + 7, + 2, + 3, + 1, + 16, + 0, + 1, + 7, + 12, + 7, + 1, + 7, + 6, + 0, + 2, + 8, + 4, + 11, + 5, + 2, + 10, + 15, + 1, + 4, + 7, + 5, + 10, + 8, + 5, + 1, + 1, + 3, + 3 + ], + "weighted_loads": [ + 0.02619609236717224, + 0.2871430590748787, + 0.11076747253537178, + 0.029355017468333244, + 0.23600100353360176, + 0.06416667439043522, + 0.2566096894443035, + 0.11362605541944504, + 0.4805063381791115, + 1.0153303667902946, + 1.2583902906626463, + 0.19293686375021935, + 0.18997351825237274, + 0.35238010808825493, + 0.12059344165027142, + 0.3190248180180788, + 0.27944964449852705, + 0.1831372044980526, + 0.07421504519879818, + 0.8298639412969351, + 0.2903649006038904, + 0.4384292559698224, + 0.3855563849210739, + 0.40947356075048447, + 0.3220971543341875, + 0.03667991980910301, + 0.395935432985425, + 0.46132682263851166, + 0.291668857447803, + 0.33802909404039383, + 1.097381118685007, + 0.24858642928302288, + 0.05472375266253948, + 0.34168921411037445, + 0.04932541772723198, + 0.8920119199901819, + 0.0, + 0.051125552505254745, + 0.350334832444787, + 0.46966008841991425, + 0.2890446148812771, + 0.032948266714811325, + 0.3732796609401703, + 0.5356154926121235, + 0.0, + 0.09866835549473763, + 0.44801425002515316, + 0.409225944429636, + 0.6526911370456219, + 0.34872485138475895, + 0.08299183659255505, + 0.5065367873758078, + 0.9661624394357204, + 0.013009678572416306, + 0.12061383482068777, + 0.5592485666275024, + 0.23339995741844177, + 0.758646484464407, + 0.33688993379473686, + 0.25375887379050255, + 0.029675768688321114, + 0.04432302340865135, + 0.1137472577393055, + 0.1813074443489313 + ], + "unique_experts": 62, + "load_cv": 0.7238476639777507, + "normalized_load_entropy": 0.9367104175754744, + "max_load_share": 0.05084745762711865 + } + }, + "s1_x": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "90f1213f51fece597e22f3cfd4e965637dc85e420b57976d7b2931fcfbebcb77", + "route_weight_sha256": "ac59ab22490c58842e3b72710bd546e5dabc173d9cffaf5de022ad6c887176bc", + "loads": [ + 2, + 4, + 0, + 1, + 1, + 2, + 1, + 2, + 10, + 11, + 8, + 5, + 0, + 3, + 1, + 3, + 6, + 0, + 2, + 9, + 4, + 0, + 6, + 3, + 5, + 0, + 0, + 0, + 4, + 4, + 9, + 7, + 1, + 4, + 0, + 4, + 0, + 1, + 6, + 8, + 7, + 1, + 0, + 6, + 0, + 2, + 8, + 3, + 0, + 1, + 2, + 4, + 4, + 1, + 0, + 2, + 2, + 10, + 4, + 3, + 1, + 2, + 1, + 3 + ], + "weighted_loads": [ + 0.05959039740264416, + 0.21840561740100384, + 0.0, + 0.030936336144804955, + 0.04531003534793854, + 0.06865399330854416, + 0.045032624155282974, + 0.10682307556271553, + 0.4335265103727579, + 0.9686028361320496, + 0.6350214406847954, + 0.19211450591683388, + 0.0, + 0.12629693932831287, + 0.03373110294342041, + 0.104679299518466, + 0.26916895993053913, + 0.0, + 0.0695169698446989, + 0.2940940484404564, + 0.2231864482164383, + 0.0, + 0.3904215656220913, + 0.42305658012628555, + 0.28414460830390453, + 0.0, + 0.0, + 0.0, + 0.14282428473234177, + 0.3362739086151123, + 0.7987054735422134, + 0.2363656610250473, + 0.03419485688209534, + 0.39379800483584404, + 0.0, + 0.18207321874797344, + 0.0, + 0.05969059467315674, + 0.2887260131537914, + 0.302225636318326, + 0.28265067003667355, + 0.0333344042301178, + 0.0, + 0.5360375083982944, + 0.0, + 0.10109182074666023, + 0.4322777781635523, + 0.34833047538995743, + 0.0, + 0.04643890634179115, + 0.080183831974864, + 0.22468375600874424, + 0.16169507429003716, + 0.027758626267313957, + 0.0, + 0.07877731695771217, + 0.11201649531722069, + 0.719934593886137, + 0.16944054700434208, + 0.12259764038026333, + 0.028122562915086746, + 0.07998175360262394, + 0.03096611425280571, + 0.18067982979118824 + ], + "unique_experts": 51, + "load_cv": 0.9294614034895162, + "normalized_load_entropy": 0.8893244568182167, + "max_load_share": 0.05392156862745098 + }, + "full_input": { + "tokens": 75, + "top_k": 6, + "decisions": 450, + "ordered_route_sha256": "03b7986e314582434babee45887c76595431963b8f85b584c0552c5ef1ea2b70", + "route_weight_sha256": "c81056eb230102686ea1786e8d3de931ab0f973120b078fd74551d7939528a58", + "loads": [ + 9, + 5, + 2, + 1, + 2, + 4, + 5, + 4, + 13, + 13, + 18, + 5, + 7, + 12, + 7, + 7, + 7, + 6, + 5, + 12, + 5, + 7, + 7, + 9, + 7, + 4, + 8, + 9, + 7, + 5, + 17, + 7, + 2, + 8, + 0, + 21, + 1, + 2, + 7, + 9, + 7, + 5, + 10, + 7, + 2, + 3, + 8, + 3, + 13, + 6, + 4, + 14, + 15, + 2, + 11, + 11, + 7, + 10, + 6, + 9, + 2, + 3, + 2, + 4 + ], + "weighted_loads": [ + 0.5329177714884281, + 0.2667700406163931, + 0.6905418559908867, + 0.030936336144804955, + 0.07615614123642445, + 0.13349614292383194, + 0.19059033319354057, + 0.21310492977499962, + 0.6181567516177893, + 1.1151855811476707, + 1.2474586516618729, + 0.19211450591683388, + 0.31795095279812813, + 0.6317529063671827, + 0.2817947920411825, + 0.2957864925265312, + 0.2824329761788249, + 0.23697932064533234, + 0.16534043662250042, + 0.8873918354511261, + 0.26949617639184, + 0.4540850939229131, + 0.42061593383550644, + 0.9636486191302538, + 0.3679648917168379, + 0.17224401608109474, + 0.2895758729428053, + 0.8096049353480339, + 0.21774006728082895, + 0.38618843629956245, + 1.2076990269124508, + 0.2363656610250473, + 0.0568776223808527, + 0.9852870218455791, + 0.0, + 1.134160267189145, + 0.07001567631959915, + 0.10072622820734978, + 0.3444669395685196, + 0.3334974329918623, + 0.28265067003667355, + 0.27381667867302895, + 0.5010202527046204, + 0.5805571004748344, + 0.10269748046994209, + 0.15942193567752838, + 0.4322777781635523, + 0.34833047538995743, + 1.0464086271822453, + 1.0509597547352314, + 0.16054427064955235, + 0.933766333386302, + 0.9727505370974541, + 0.04076830483973026, + 0.6944566881284118, + 0.7127561029046774, + 0.311177060008049, + 0.719934593886137, + 0.258782260119915, + 0.4316411092877388, + 0.05052977800369263, + 0.1418102104216814, + 0.06659666076302528, + 0.27274508215487003 + ], + "unique_experts": 63, + "load_cv": 0.6173619703781047, + "normalized_load_entropy": 0.9542338235755217, + "max_load_share": 0.04666666666666667 + } + }, + "s0_period": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "7b486d129da9d2bc63b10908c50e905a5b35059877588853a527ffb55f4e5596", + "route_weight_sha256": "772d61faed78a1cbf9ce1913e5f324f8b54cfafa14a6359d34f3488bd3538350", + "loads": [ + 0, + 4, + 1, + 1, + 1, + 4, + 1, + 2, + 10, + 11, + 10, + 5, + 0, + 2, + 1, + 3, + 6, + 0, + 2, + 7, + 5, + 2, + 6, + 3, + 5, + 0, + 0, + 0, + 4, + 4, + 9, + 7, + 1, + 3, + 0, + 3, + 0, + 1, + 7, + 9, + 7, + 1, + 0, + 6, + 0, + 2, + 7, + 4, + 0, + 1, + 1, + 3, + 5, + 0, + 0, + 3, + 2, + 10, + 4, + 1, + 1, + 1, + 2, + 3 + ], + "weighted_loads": [ + 0.0, + 0.22388352826237679, + 0.037356458604335785, + 0.029944855719804764, + 0.04393444582819939, + 0.12006278149783611, + 0.04518359899520874, + 0.1156592033803463, + 0.4553128406405449, + 1.0093049220740795, + 0.6754791028797626, + 0.19317728281021118, + 0.0, + 0.09806161001324654, + 0.037684302777051926, + 0.10493772849440575, + 0.2706946898251772, + 0.0, + 0.07158699817955494, + 0.21638569608330727, + 0.31145855225622654, + 0.05423793941736221, + 0.3888239376246929, + 0.4102900493890047, + 0.2857586331665516, + 0.0, + 0.0, + 0.0, + 0.1435663066804409, + 0.34095829725265503, + 0.7950919270515442, + 0.2451042104512453, + 0.03106309473514557, + 0.3443259224295616, + 0.0, + 0.15063172206282616, + 0.0, + 0.05108540132641792, + 0.3443649783730507, + 0.34812345914542675, + 0.2881328221410513, + 0.032997239381074905, + 0.0, + 0.5606605745851994, + 0.0, + 0.10099155828356743, + 0.41927941516041756, + 0.41657399386167526, + 0.0, + 0.04777299612760544, + 0.0550604909658432, + 0.1775914616882801, + 0.20317360013723373, + 0.0, + 0.0, + 0.1033268366008997, + 0.10623987391591072, + 0.7527529522776604, + 0.15759122744202614, + 0.0673925131559372, + 0.029855888336896896, + 0.04389599710702896, + 0.050892386585474014, + 0.18592150323092937 + ], + "unique_experts": 51, + "load_cv": 0.9491087302181136, + "normalized_load_entropy": 0.885535136753843, + "max_load_share": 0.05392156862745098 + }, + "full_input": { + "tokens": 59, + "top_k": 6, + "decisions": 354, + "ordered_route_sha256": "e4dabc948774e61565a297afcfcdb1b6d02af093b4dd3337d2d6f011f1dcd295", + "route_weight_sha256": "d9c53272703153783042f4cc830737d7a9702ad609b9905faa5f678abaea06c9", + "loads": [ + 0, + 5, + 3, + 1, + 7, + 4, + 3, + 2, + 11, + 11, + 18, + 5, + 5, + 8, + 3, + 9, + 7, + 3, + 3, + 9, + 5, + 8, + 6, + 3, + 6, + 1, + 9, + 5, + 9, + 4, + 13, + 7, + 2, + 3, + 1, + 14, + 0, + 1, + 7, + 10, + 7, + 1, + 6, + 6, + 0, + 2, + 7, + 4, + 11, + 4, + 1, + 11, + 15, + 1, + 4, + 8, + 4, + 10, + 6, + 6, + 1, + 1, + 4, + 3 + ], + "weighted_loads": [ + 0.0, + 0.26486819982528687, + 0.1106889545917511, + 0.029944855719804764, + 0.26891616359353065, + 0.12006278149783611, + 0.293914757668972, + 0.1156592033803463, + 0.5136587806046009, + 1.0093049220740795, + 1.2203110940754414, + 0.19317728281021118, + 0.22772637754678726, + 0.4358046241104603, + 0.1212808471173048, + 0.344869801774621, + 0.28395870607346296, + 0.11693762987852097, + 0.10482478328049183, + 0.7957327738404274, + 0.31145855225622654, + 0.4926671953871846, + 0.3888239376246929, + 0.4102900493890047, + 0.32359565049409866, + 0.03667991980910301, + 0.395935432985425, + 0.44220244884490967, + 0.3300397312268615, + 0.34095829725265503, + 1.087758880108595, + 0.2451042104512453, + 0.05389923043549061, + 0.3443259224295616, + 0.04932541772723198, + 0.783872302621603, + 0.0, + 0.05108540132641792, + 0.3443649783730507, + 0.4035720657557249, + 0.2881328221410513, + 0.032997239381074905, + 0.3389936164021492, + 0.5606605745851994, + 0.0, + 0.10099155828356743, + 0.41927941516041756, + 0.41657399386167526, + 0.6250499151647091, + 0.37075069546699524, + 0.0550604909658432, + 0.5815234184265137, + 0.8181042931973934, + 0.013009678572416306, + 0.12061383482068777, + 0.5729332957416773, + 0.18264415115118027, + 0.7527529522776604, + 0.2560106851160526, + 0.352307491004467, + 0.029855888336896896, + 0.04389599710702896, + 0.14554675295948982, + 0.18592150323092937 + ], + "unique_experts": 61, + "load_cv": 0.7131859314450429, + "normalized_load_entropy": 0.9362692835278094, + "max_load_share": 0.05084745762711865 + } + }, + "s1_period": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "a840c77d7525db41af3bca8826377507f262f9ed62e3c6bb2cf1de41d631b6e5", + "route_weight_sha256": "a2c7ac09fa44c6d94a1fda1731e233d81bf6183ee6413893216de830b88bccff", + "loads": [ + 2, + 4, + 0, + 1, + 1, + 3, + 1, + 2, + 11, + 11, + 7, + 6, + 0, + 3, + 1, + 2, + 6, + 0, + 2, + 8, + 4, + 0, + 6, + 3, + 5, + 0, + 0, + 0, + 3, + 4, + 9, + 7, + 1, + 3, + 1, + 4, + 0, + 1, + 6, + 8, + 7, + 1, + 0, + 6, + 0, + 2, + 8, + 4, + 0, + 2, + 2, + 3, + 4, + 0, + 0, + 3, + 1, + 10, + 4, + 2, + 1, + 2, + 3, + 3 + ], + "weighted_loads": [ + 0.0592203289270401, + 0.21787566505372524, + 0.0, + 0.032125670462846756, + 0.04336002096533775, + 0.0980168804526329, + 0.047469865530729294, + 0.11067168787121773, + 0.46915156207978725, + 0.9741488806903362, + 0.6014467105269432, + 0.22961727902293205, + 0.0, + 0.13116306625306606, + 0.036006856709718704, + 0.07693491503596306, + 0.2608727291226387, + 0.0, + 0.06762020848691463, + 0.25307175144553185, + 0.2394571639597416, + 0.0, + 0.39539784938097, + 0.4230070039629936, + 0.28096823766827583, + 0.0, + 0.0, + 0.0, + 0.10663653910160065, + 0.33390916138887405, + 0.7861699797213078, + 0.23192769475281239, + 0.03423377498984337, + 0.3535907156765461, + 0.031321775168180466, + 0.1746235154569149, + 0.0, + 0.060421932488679886, + 0.29270896315574646, + 0.3179233483970165, + 0.2840441409498453, + 0.033192310482263565, + 0.0, + 0.5503161624073982, + 0.0, + 0.10033657401800156, + 0.4444631952792406, + 0.39776337891817093, + 0.0, + 0.07480414398014545, + 0.08470231480896473, + 0.17367846332490444, + 0.16555434465408325, + 0.0, + 0.0, + 0.1141039039939642, + 0.07660619914531708, + 0.7323909550905228, + 0.17619292624294758, + 0.10727652907371521, + 0.029085440561175346, + 0.07806139439344406, + 0.07905685715377331, + 0.18514285795390606 + ], + "unique_experts": 51, + "load_cv": 0.924484332088336, + "normalized_load_entropy": 0.8908592416761095, + "max_load_share": 0.05392156862745098 + }, + "full_input": { + "tokens": 75, + "top_k": 6, + "decisions": 450, + "ordered_route_sha256": "6e3512c77befad7379ad711e2ce7a8137e6d221037cbfd22a32501ae7e1ad332", + "route_weight_sha256": "b1e2de9c88cf34b13e36c0c03bd9bc872a96d02c8f38a2625bd8744e29187582", + "loads": [ + 9, + 5, + 2, + 1, + 2, + 4, + 5, + 3, + 14, + 13, + 16, + 6, + 7, + 13, + 8, + 7, + 7, + 7, + 6, + 12, + 5, + 7, + 7, + 9, + 7, + 2, + 8, + 9, + 5, + 5, + 17, + 7, + 2, + 8, + 1, + 22, + 1, + 2, + 7, + 8, + 7, + 4, + 9, + 7, + 1, + 3, + 8, + 4, + 12, + 7, + 4, + 14, + 14, + 1, + 12, + 13, + 6, + 10, + 6, + 8, + 2, + 3, + 5, + 4 + ], + "weighted_loads": [ + 0.5325477030128241, + 0.2662400882691145, + 0.6905418559908867, + 0.032125670462846756, + 0.08457329869270325, + 0.11382604390382767, + 0.2225116305053234, + 0.18903784081339836, + 0.6514706779271364, + 1.1207316257059574, + 1.1762250512838364, + 0.22961727902293205, + 0.3355119489133358, + 0.669846361503005, + 0.339520251378417, + 0.28401884995400906, + 0.2741367453709245, + 0.27549145370721817, + 0.22027640230953693, + 0.8767319060862064, + 0.2857668921351433, + 0.4540850939229131, + 0.42559221759438515, + 0.9678255412727594, + 0.3683339022099972, + 0.07666055113077164, + 0.2895758729428053, + 0.8262969180941582, + 0.13772777561098337, + 0.3838236890733242, + 1.1833528578281403, + 0.23192769475281239, + 0.05691654048860073, + 0.9741367176175117, + 0.031321775168180466, + 1.1390668079257011, + 0.07001567631959915, + 0.10145756602287292, + 0.3484498895704746, + 0.3179233483970165, + 0.2840441409498453, + 0.1966138705611229, + 0.4760081060230732, + 0.5948357544839382, + 0.06878439337015152, + 0.1586666889488697, + 0.4444631952792406, + 0.39776337891817093, + 0.888749074190855, + 1.168957306072116, + 0.16506275348365307, + 0.9489582348614931, + 0.7790192626416683, + 0.013009678572416306, + 0.7232305752113461, + 0.775990441441536, + 0.2763344682753086, + 0.7323909550905228, + 0.26221898943185806, + 0.4175559375435114, + 0.05149265564978123, + 0.13988985121250153, + 0.16216903366148472, + 0.27720811031758785 + ], + "unique_experts": 64, + "load_cv": 0.620425978712794, + "normalized_load_entropy": 0.954150543167575, + "max_load_share": 0.04888888888888889 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 34, + "ordered_topk_exact_tokens": 19, + "set_exact_tokens": 25, + "mean_set_jaccard": 0.9180672268907564, + "mean_token_weighted_tv": 0.015175937674939632, + "aggregate_load_tv": 0.04411764705882353 + }, + "system_bos": { + "tokens": 34, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.8739495798319328, + "mean_token_weighted_tv": 0.021771755398196334, + "aggregate_load_tv": 0.06372549019607843 + }, + "system_x": { + "tokens": 34, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 21, + "mean_set_jaccard": 0.8718487394957984, + "mean_token_weighted_tv": 0.024152537670863027, + "aggregate_load_tv": 0.049019607843137254 + }, + "system_period": { + "tokens": 34, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 21, + "mean_set_jaccard": 0.8718487394957983, + "mean_token_weighted_tv": 0.023343946812126565, + "aggregate_load_tv": 0.06862745098039215 + }, + "bos_at_s0": { + "tokens": 34, + "ordered_topk_exact_tokens": 12, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.8613445378151261, + "mean_token_weighted_tv": 0.02398134088691543, + "aggregate_load_tv": 0.07352941176470588 + }, + "bos_at_s1": { + "tokens": 34, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 23, + "mean_set_jaccard": 0.9012605042016808, + "mean_token_weighted_tv": 0.01933091873412623, + "aggregate_load_tv": 0.044117647058823525 + }, + "x_at_s0": { + "tokens": 34, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.8361344537815126, + "mean_token_weighted_tv": 0.02670008407029159, + "aggregate_load_tv": 0.09313725490196079 + }, + "x_at_s1": { + "tokens": 34, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 18, + "mean_set_jaccard": 0.8466386554621849, + "mean_token_weighted_tv": 0.028226130313294774, + "aggregate_load_tv": 0.06372549019607843 + }, + "period_at_s0": { + "tokens": 34, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 20, + "mean_set_jaccard": 0.8760504201680673, + "mean_token_weighted_tv": 0.02261552828199723, + "aggregate_load_tv": 0.058823529411764705 + }, + "period_at_s1": { + "tokens": 34, + "ordered_topk_exact_tokens": 9, + "set_exact_tokens": 18, + "mean_set_jaccard": 0.8354341736694679, + "mean_token_weighted_tv": 0.029780144282781026, + "aggregate_load_tv": 0.07352941176470588 + } + } + }, + "layer_22": { + "layer": 22, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "81b2598136f85c53bfcbc1618b99a934b4342deaf648908cd9fe6e38f4466609", + "route_weight_sha256": "f6476983fbcb69c94a8515c7298ec1e32aa87488832e1c3fea749081436906c9", + "loads": [ + 0, + 1, + 8, + 0, + 7, + 7, + 1, + 0, + 7, + 1, + 6, + 0, + 5, + 0, + 0, + 5, + 7, + 1, + 6, + 1, + 6, + 2, + 2, + 1, + 1, + 6, + 14, + 1, + 3, + 1, + 11, + 0, + 6, + 6, + 1, + 4, + 3, + 4, + 6, + 2, + 5, + 3, + 5, + 2, + 2, + 6, + 9, + 1, + 1, + 0, + 3, + 4, + 1, + 0, + 1, + 0, + 4, + 0, + 2, + 5, + 2, + 5, + 0, + 0 + ], + "weighted_loads": [ + 0.0, + 0.04021794721484184, + 0.914667047560215, + 0.0, + 0.955812618136406, + 0.3301909565925598, + 0.044491469860076904, + 0.0, + 0.36107464879751205, + 0.038508299738168716, + 0.2889949530363083, + 0.0, + 0.2520821541547775, + 0.0, + 0.0, + 0.20479654520750046, + 0.37586022913455963, + 0.04927230626344681, + 0.2869021724909544, + 0.03597840294241905, + 0.22523661889135838, + 0.10960030555725098, + 0.08740783110260963, + 0.026504894718527794, + 0.03526080399751663, + 0.25058211013674736, + 0.9787321984767914, + 0.038546934723854065, + 0.19155045226216316, + 0.0468129962682724, + 0.47133059054613113, + 0.0, + 0.21542662382125854, + 0.23857489600777626, + 0.029127592220902443, + 0.24298114329576492, + 0.1230054460465908, + 0.1779085323214531, + 0.4595141038298607, + 0.08567307144403458, + 0.30177127569913864, + 0.290255106985569, + 0.7042323648929596, + 0.08407144248485565, + 0.09509091079235077, + 0.21210848726332188, + 0.6899027917534113, + 0.042703405022621155, + 0.029507620260119438, + 0.0, + 0.11928393319249153, + 0.21721776202321053, + 0.07640746980905533, + 0.0, + 0.03618498146533966, + 0.0, + 0.2740619294345379, + 0.0, + 0.1281861662864685, + 0.23808369040489197, + 0.12345932051539421, + 0.18680885434150696, + 0.0, + 0.0 + ], + "unique_experts": 51, + "load_cv": 0.9507276801882868, + "normalized_load_entropy": 0.8855614357253958, + "max_load_share": 0.06862745098039216 + }, + "full_input": { + "tokens": 59, + "top_k": 6, + "decisions": 354, + "ordered_route_sha256": "975540c63b7514fc787ec8dc17c3b2ede47d5afcffbf595df31a6dc29564aa8d", + "route_weight_sha256": "df3482d6f4045abe00b53fdef6b7e008548056a9ee09af262ce10c47fe4b0d69", + "loads": [ + 4, + 3, + 10, + 9, + 7, + 11, + 6, + 1, + 21, + 6, + 6, + 2, + 5, + 0, + 5, + 5, + 7, + 2, + 6, + 1, + 7, + 9, + 3, + 2, + 1, + 8, + 15, + 5, + 3, + 1, + 11, + 0, + 10, + 12, + 2, + 6, + 3, + 5, + 7, + 2, + 9, + 3, + 10, + 2, + 2, + 7, + 9, + 1, + 4, + 2, + 9, + 4, + 1, + 2, + 1, + 13, + 8, + 1, + 4, + 5, + 10, + 12, + 1, + 5 + ], + "weighted_loads": [ + 0.1742690559476614, + 0.11617803014814854, + 0.9938132651150227, + 1.8816552199423313, + 0.955812618136406, + 0.5344402296468616, + 0.3145688846707344, + 0.08909731358289719, + 1.6160854902118444, + 0.2304700519889593, + 0.2889949530363083, + 0.029388858936727047, + 0.2520821541547775, + 0.0, + 0.7718380261212587, + 0.20479654520750046, + 0.37586022913455963, + 0.07510164566338062, + 0.2869021724909544, + 0.03597840294241905, + 0.27217809297144413, + 0.8171986155211926, + 0.11607635952532291, + 0.054950932040810585, + 0.03526080399751663, + 0.31052858009934425, + 1.03109622746706, + 0.1876434776932001, + 0.19155045226216316, + 0.0468129962682724, + 0.47133059054613113, + 0.0, + 0.31552619580179453, + 0.4549989774823189, + 0.0958924014121294, + 0.31364630721509457, + 0.1230054460465908, + 0.210781492292881, + 0.5040410980582237, + 0.08567307144403458, + 0.5769621040672064, + 0.290255106985569, + 1.2192522063851357, + 0.08407144248485565, + 0.09509091079235077, + 0.2434090469032526, + 0.6899027917534113, + 0.042703405022621155, + 0.1553373597562313, + 0.18189044296741486, + 0.3973809964954853, + 0.21721776202321053, + 0.07640746980905533, + 0.1098162978887558, + 0.03618498146533966, + 1.103713364340365, + 0.4306887537240982, + 0.02549641765654087, + 0.18586541153490543, + 0.23808369040489197, + 1.317088596522808, + 0.43535943143069744, + 0.026734109967947006, + 0.1815178543329239 + ], + "unique_experts": 62, + "load_cv": 0.7474514350367635, + "normalized_load_entropy": 0.9331761115667668, + "max_load_share": 0.059322033898305086 + } + }, + "s1_eos": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "a7b9982ca74f2237f773b101502ad6297bee4942ac2d123be6e0f0261f47d969", + "route_weight_sha256": "721bc1aa8e82521f1323a9a1e43f97c9fd840b29f2ec11cb9c10ae13ae10b786", + "loads": [ + 1, + 1, + 8, + 0, + 7, + 8, + 1, + 0, + 7, + 1, + 6, + 1, + 5, + 0, + 0, + 4, + 7, + 2, + 6, + 0, + 7, + 2, + 2, + 0, + 1, + 6, + 14, + 1, + 3, + 1, + 11, + 0, + 6, + 6, + 1, + 5, + 3, + 2, + 5, + 2, + 5, + 3, + 5, + 1, + 2, + 5, + 9, + 1, + 1, + 0, + 4, + 4, + 1, + 0, + 1, + 0, + 5, + 0, + 2, + 5, + 2, + 5, + 0, + 0 + ], + "weighted_loads": [ + 0.021716896444559097, + 0.04157155752182007, + 0.9012387171387672, + 0.0, + 0.9535365402698517, + 0.3806195482611656, + 0.04643358662724495, + 0.0, + 0.36109522730112076, + 0.04257996752858162, + 0.29170316457748413, + 0.03851498290896416, + 0.24847053363919258, + 0.0, + 0.0, + 0.1524796448647976, + 0.37593402713537216, + 0.09182650968432426, + 0.2806617524474859, + 0.0, + 0.2554204426705837, + 0.10865563154220581, + 0.08434627577662468, + 0.0, + 0.034117441624403, + 0.257239006459713, + 0.9803177118301392, + 0.039248522371053696, + 0.18839187920093536, + 0.05082627758383751, + 0.4702206812798977, + 0.0, + 0.22168088518083096, + 0.23885728791356087, + 0.031307727098464966, + 0.2724929749965668, + 0.12235075607895851, + 0.10004475712776184, + 0.42921382933855057, + 0.08486627414822578, + 0.29970933124423027, + 0.28829360753297806, + 0.6973028257489204, + 0.04933105409145355, + 0.09138336777687073, + 0.1740155927836895, + 0.7160844095051289, + 0.041215576231479645, + 0.0312126986682415, + 0.0, + 0.16071342676877975, + 0.20788561925292015, + 0.06796593964099884, + 0.0, + 0.03996185585856438, + 0.0, + 0.30831486731767654, + 0.0, + 0.1325603686273098, + 0.23685481026768684, + 0.12301391363143921, + 0.1877235658466816, + 0.0, + 0.0 + ], + "unique_experts": 51, + "load_cv": 0.9587814257566785, + "normalized_load_entropy": 0.8842994186435608, + "max_load_share": 0.06862745098039216 + }, + "full_input": { + "tokens": 75, + "top_k": 6, + "decisions": 450, + "ordered_route_sha256": "e23edbb3cbea8ceed615df79659ef354ed7bb101f39132bdf6e016151796e7f9", + "route_weight_sha256": "4af2c390bede1dbf98b451a3f8d0f6fca124ebbf4c9e797a70765c3e19d62435", + "loads": [ + 3, + 7, + 8, + 11, + 7, + 12, + 7, + 2, + 28, + 10, + 6, + 6, + 8, + 0, + 5, + 8, + 10, + 4, + 7, + 0, + 9, + 14, + 3, + 0, + 1, + 7, + 15, + 4, + 4, + 1, + 12, + 0, + 9, + 15, + 8, + 10, + 5, + 3, + 6, + 3, + 16, + 4, + 10, + 3, + 2, + 7, + 10, + 3, + 5, + 2, + 15, + 7, + 6, + 3, + 1, + 21, + 9, + 1, + 6, + 5, + 16, + 15, + 1, + 4 + ], + "weighted_loads": [ + 0.1500756721943617, + 0.5180639997124672, + 0.9012387171387672, + 2.1430493611842394, + 0.9535365402698517, + 0.5660148067399859, + 0.3706819685176015, + 0.08239160478115082, + 2.134180871769786, + 0.5094189569354057, + 0.29170316457748413, + 0.3375387964770198, + 0.3880870193243027, + 0.0, + 0.660887448117137, + 0.3828590363264084, + 0.5179368034005165, + 0.14216452650725842, + 0.3208089005202055, + 0.0, + 0.3549846410751343, + 1.2406530790030956, + 0.12671338021755219, + 0.0, + 0.034117441624403, + 0.28275560215115547, + 1.0340493470430374, + 0.15172862447798252, + 0.26977407187223434, + 0.05082627758383751, + 0.523297693580389, + 0.0, + 0.31445357762277126, + 0.5631611496210098, + 0.33988881297409534, + 0.4722347930073738, + 0.21164269745349884, + 0.1372804082930088, + 0.4808596670627594, + 0.13171515986323357, + 1.0685289558023214, + 0.31371437571942806, + 1.246286753565073, + 0.1838613748550415, + 0.09138336777687073, + 0.24369921907782555, + 0.7501206919550896, + 0.1107054278254509, + 0.19838668406009674, + 0.45635855197906494, + 0.6844582390040159, + 0.41051172465085983, + 0.6177623122930527, + 0.18264182284474373, + 0.03996185585856438, + 1.729296365287155, + 0.5182233080267906, + 0.025044014677405357, + 0.2474924041889608, + 0.23685481026768684, + 2.1280931271612644, + 0.6112158130854368, + 0.028353942558169365, + 0.18643001466989517 + ], + "unique_experts": 60, + "load_cv": 0.7667020925792704, + "normalized_load_entropy": 0.930011577587187, + "max_load_share": 0.06222222222222222 + } + }, + "s0_bos": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "7f8029addd89eba9418b52117eb06963bde892729c3db1f4934683af88f5c729", + "route_weight_sha256": "8c5de692e9e3e1ddf166c3827714f1f3556672668e45c1e7602cc02c8ee49bfa", + "loads": [ + 0, + 1, + 8, + 0, + 7, + 7, + 1, + 0, + 5, + 1, + 6, + 0, + 5, + 0, + 0, + 5, + 7, + 1, + 6, + 0, + 7, + 2, + 2, + 0, + 1, + 6, + 14, + 1, + 3, + 1, + 10, + 0, + 5, + 6, + 2, + 5, + 3, + 3, + 5, + 3, + 5, + 3, + 5, + 1, + 2, + 7, + 9, + 1, + 2, + 0, + 3, + 4, + 2, + 0, + 1, + 0, + 5, + 0, + 2, + 5, + 2, + 6, + 0, + 0 + ], + "weighted_loads": [ + 0.0, + 0.03875455632805824, + 0.9046128578484058, + 0.0, + 0.9662313163280487, + 0.3348284587264061, + 0.04478300362825394, + 0.0, + 0.2853374630212784, + 0.03998501971364021, + 0.2954799383878708, + 0.0, + 0.25346317887306213, + 0.0, + 0.0, + 0.1990021988749504, + 0.3714258559048176, + 0.050095085054636, + 0.2852873429656029, + 0.0, + 0.25238466262817383, + 0.11560650169849396, + 0.08215649053454399, + 0.0, + 0.034442055970430374, + 0.2531031519174576, + 0.9975591190159321, + 0.03630795702338219, + 0.19162052497267723, + 0.0492551252245903, + 0.43578106723725796, + 0.0, + 0.19409896805882454, + 0.2264958694577217, + 0.061059365049004555, + 0.2831577695906162, + 0.12170636653900146, + 0.1357678771018982, + 0.43439969792962074, + 0.12670038640499115, + 0.3093128949403763, + 0.3085106834769249, + 0.7053304463624954, + 0.04685657098889351, + 0.08999521657824516, + 0.2582690827548504, + 0.6804229952394962, + 0.040425386279821396, + 0.05893141217529774, + 0.0, + 0.11443131789565086, + 0.2130172774195671, + 0.11079435423016548, + 0.0, + 0.03318061679601669, + 0.0, + 0.30347323790192604, + 0.0, + 0.12211010605096817, + 0.24565422162413597, + 0.12441202625632286, + 0.22626613080501556, + 0.0, + 0.0 + ], + "unique_experts": 49, + "load_cv": 0.9426051248409345, + "normalized_load_entropy": 0.8837346142487945, + "max_load_share": 0.06862745098039216 + }, + "full_input": { + "tokens": 59, + "top_k": 6, + "decisions": 354, + "ordered_route_sha256": "18b65b2134e770dcf0c643e769e13b7c5fea8fbfe17486c61425583bedf2e8de", + "route_weight_sha256": "e197d590d518b875a9a07d8777db345ff094b3fb611d0ee9143c329e4b776025", + "loads": [ + 4, + 2, + 10, + 8, + 7, + 10, + 5, + 1, + 18, + 6, + 7, + 2, + 5, + 0, + 2, + 6, + 7, + 2, + 6, + 0, + 8, + 9, + 3, + 1, + 2, + 8, + 15, + 5, + 3, + 1, + 10, + 0, + 7, + 12, + 3, + 9, + 3, + 5, + 6, + 3, + 10, + 3, + 10, + 1, + 2, + 9, + 9, + 1, + 6, + 2, + 8, + 4, + 2, + 2, + 1, + 12, + 9, + 2, + 3, + 5, + 11, + 13, + 1, + 7 + ], + "weighted_loads": [ + 0.1742690559476614, + 0.070764921605587, + 0.9837590754032135, + 0.9904545582830906, + 0.9662313163280487, + 0.46533843223005533, + 0.29845329001545906, + 0.9169666171073914, + 1.4820165950804949, + 0.2319467719644308, + 0.30978727992624044, + 0.057182435877621174, + 0.25346317887306213, + 0.0, + 0.5613211691379547, + 0.24223168194293976, + 0.3714258559048176, + 0.07592442445456982, + 0.2852873429656029, + 0.0, + 0.3030710443854332, + 0.8085626028478146, + 0.11082501895725727, + 0.02844603732228279, + 0.0391037086956203, + 0.3130496218800545, + 1.048517070710659, + 0.18551272712647915, + 0.19162052497267723, + 0.0492551252245903, + 0.43578106723725796, + 0.0, + 0.2619204632937908, + 0.44291995093226433, + 0.12782417424023151, + 0.4456349164247513, + 0.12170636653900146, + 0.21571892499923706, + 0.48986972495913506, + 0.12670038640499115, + 0.6208455953747034, + 0.3085106834769249, + 1.1172190746292472, + 0.04685657098889351, + 0.08999521657824516, + 0.32117073982954025, + 0.6804229952394962, + 0.040425386279821396, + 0.2804060373455286, + 0.13120771991088986, + 0.35052214190363884, + 0.2130172774195671, + 0.11079435423016548, + 0.10663962364196777, + 0.03318061679601669, + 1.09712468739599, + 0.46010006219148636, + 0.03435531351715326, + 0.15119691379368305, + 0.24565422162413597, + 1.390412263572216, + 0.47481670789420605, + 0.024766091257333755, + 0.2857004776597023 + ], + "unique_experts": 61, + "load_cv": 0.7224351908197199, + "normalized_load_entropy": 0.9339877823073862, + "max_load_share": 0.05084745762711865 + } + }, + "s1_bos": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "26086be1e03ba1fce2b63cf2b116d425f6a7923e0c88a4a1fa502c5e3c9ae8c9", + "route_weight_sha256": "9a48785c8607ee8f21b8cbddfe702528bdbb137bc325b434b8b9b62c0d2a3753", + "loads": [ + 0, + 2, + 7, + 0, + 7, + 7, + 1, + 0, + 6, + 1, + 6, + 0, + 5, + 0, + 0, + 5, + 7, + 1, + 6, + 1, + 7, + 2, + 2, + 0, + 1, + 6, + 15, + 1, + 3, + 1, + 10, + 0, + 6, + 6, + 2, + 5, + 2, + 2, + 5, + 3, + 5, + 3, + 5, + 1, + 2, + 6, + 9, + 1, + 1, + 0, + 4, + 4, + 1, + 0, + 1, + 0, + 5, + 0, + 2, + 5, + 2, + 6, + 0, + 0 + ], + "weighted_loads": [ + 0.0, + 0.08068135380744934, + 0.8730296269059181, + 0.0, + 0.9500162675976753, + 0.3460506573319435, + 0.04407769441604614, + 0.0, + 0.34664419665932655, + 0.04676435515284538, + 0.30280498787760735, + 0.0, + 0.2506852112710476, + 0.0, + 0.0, + 0.18311777710914612, + 0.36870062723755836, + 0.049768343567848206, + 0.2781957872211933, + 0.03424951434135437, + 0.24822217784821987, + 0.11092842370271683, + 0.08523894846439362, + 0.0, + 0.03421613201498985, + 0.2657518442720175, + 1.0177909806370735, + 0.03609836474061012, + 0.18901585042476654, + 0.046497803181409836, + 0.4381612688302994, + 0.0, + 0.224694661796093, + 0.22379019111394882, + 0.05989236198365688, + 0.27857597917318344, + 0.07410196959972382, + 0.08542530611157417, + 0.4215199798345566, + 0.12593330815434456, + 0.2990596108138561, + 0.28589898347854614, + 0.6844326481223106, + 0.0473482720553875, + 0.09674298763275146, + 0.22018061764538288, + 0.68327322229743, + 0.04014021158218384, + 0.03352295234799385, + 0.0, + 0.15403742715716362, + 0.20585209503769875, + 0.07661154121160507, + 0.0, + 0.03784513846039772, + 0.0, + 0.29799047484993935, + 0.0, + 0.12844038382172585, + 0.240329060703516, + 0.12451048195362091, + 0.22581961005926132, + 0.0, + 0.0 + ], + "unique_experts": 50, + "load_cv": 0.9571760978399155, + "normalized_load_entropy": 0.8834521211254791, + "max_load_share": 0.07352941176470588 + }, + "full_input": { + "tokens": 75, + "top_k": 6, + "decisions": 450, + "ordered_route_sha256": "f5de65ff5290efc34eadf5c5b70815497daf74cbdd72a29b53bf1695a34fdfa1", + "route_weight_sha256": "df43bc165ba0970619d85cac5d9ea1a95f18bc56062bb41d3d7ba357ca8247e0", + "loads": [ + 2, + 8, + 7, + 10, + 7, + 10, + 6, + 2, + 26, + 10, + 6, + 5, + 8, + 0, + 4, + 10, + 10, + 3, + 7, + 1, + 9, + 14, + 3, + 0, + 1, + 7, + 16, + 5, + 4, + 1, + 11, + 0, + 8, + 15, + 9, + 12, + 4, + 4, + 6, + 4, + 17, + 4, + 10, + 3, + 2, + 6, + 10, + 3, + 7, + 3, + 14, + 7, + 6, + 4, + 1, + 19, + 9, + 1, + 4, + 5, + 17, + 16, + 2, + 5 + ], + "weighted_loads": [ + 0.1283587757498026, + 0.5610997397452593, + 0.8730296269059181, + 1.2474281210452318, + 0.9500162675976753, + 0.4725393811240792, + 0.35594451799988747, + 0.08239160478115082, + 2.0584773179143667, + 0.5136033445596695, + 0.30280498787760735, + 0.33050303626805544, + 0.3903016969561577, + 0.0, + 0.6006731521338224, + 0.45531730726361275, + 0.5107034035027027, + 0.10010636039078236, + 0.3183429352939129, + 0.03424951434135437, + 0.3490645531564951, + 1.2507536448538303, + 0.12760605290532112, + 0.0, + 0.03421613201498985, + 0.29126843996345997, + 1.0697802789509296, + 0.18823888711631298, + 0.2703980430960655, + 0.046497803181409836, + 0.4765062779188156, + 0.0, + 0.3098088540136814, + 0.5480940528213978, + 0.36847344785928726, + 0.5700835417956114, + 0.16339391097426414, + 0.16723981127142906, + 0.4803539328277111, + 0.17278219386935234, + 1.0963169541209936, + 0.31131975166499615, + 1.2161459811031818, + 0.18187859281897545, + 0.09674298763275146, + 0.22018061764538288, + 0.7173095047473907, + 0.10963006317615509, + 0.3668493330478668, + 0.5288320258259773, + 0.6420416608452797, + 0.4084782004356384, + 0.6264079138636589, + 0.21074261516332626, + 0.03784513846039772, + 1.6976720606908202, + 0.5078989155590534, + 0.025044014677405357, + 0.20523563772439957, + 0.240329060703516, + 2.2202938683331013, + 0.6493118572980165, + 0.05404006689786911, + 0.25693782046437263 + ], + "unique_experts": 61, + "load_cv": 0.7432594216700079, + "normalized_load_entropy": 0.934159046894436, + "max_load_share": 0.057777777777777775 + } + }, + "s0_x": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "f076908dafc4bafb877e33515d29cd1dcffbea5a7316990bed39414f4baf49eb", + "route_weight_sha256": "5bfa1d532825037e65fb88d07a225d7abaee2a75c5cf8197f36f417cf0dd4f7d", + "loads": [ + 0, + 1, + 8, + 0, + 7, + 8, + 1, + 0, + 5, + 1, + 6, + 0, + 5, + 0, + 0, + 5, + 7, + 1, + 5, + 1, + 7, + 2, + 2, + 1, + 1, + 6, + 14, + 1, + 3, + 1, + 10, + 0, + 6, + 6, + 1, + 5, + 3, + 2, + 5, + 4, + 5, + 3, + 5, + 1, + 2, + 5, + 9, + 1, + 1, + 0, + 4, + 4, + 1, + 0, + 1, + 0, + 5, + 0, + 2, + 5, + 2, + 7, + 0, + 0 + ], + "weighted_loads": [ + 0.0, + 0.03688143566250801, + 0.8856333177536726, + 0.0, + 0.9451684206724167, + 0.37377942726016045, + 0.04359382018446922, + 0.0, + 0.29197240248322487, + 0.04031330347061157, + 0.2928805910050869, + 0.0, + 0.25396155193448067, + 0.0, + 0.0, + 0.1917954981327057, + 0.37498147413134575, + 0.052872464060783386, + 0.25389784574508667, + 0.03499528393149376, + 0.2530924715101719, + 0.1104823499917984, + 0.09036974608898163, + 0.027894791215658188, + 0.03260757029056549, + 0.26216701604425907, + 0.9631163813173771, + 0.041826020926237106, + 0.18710055574774742, + 0.04915839061141014, + 0.4351083990186453, + 0.0, + 0.21783809177577496, + 0.23241722024977207, + 0.03116927295923233, + 0.2733519971370697, + 0.12132489681243896, + 0.09110011905431747, + 0.41623012721538544, + 0.17547475174069405, + 0.2994306795299053, + 0.28840261697769165, + 0.7039782404899597, + 0.04754284769296646, + 0.10585752129554749, + 0.18133491836488247, + 0.7092763260006905, + 0.03632568195462227, + 0.030823897570371628, + 0.0, + 0.15971536561846733, + 0.20154151320457458, + 0.06578664481639862, + 0.0, + 0.03590279817581177, + 0.0, + 0.2974540404975414, + 0.0, + 0.12054182589054108, + 0.23740888014435768, + 0.12143505364656448, + 0.2873417902737856, + 0.0, + 0.0 + ], + "unique_experts": 51, + "load_cv": 0.9474870139882015, + "normalized_load_entropy": 0.8852185043556441, + "max_load_share": 0.06862745098039216 + }, + "full_input": { + "tokens": 59, + "top_k": 6, + "decisions": 354, + "ordered_route_sha256": "d7d524efbb8ae1daea7959449d320a4fa24b035ba64d89c5f177312d9bad8b3b", + "route_weight_sha256": "9f4f12f863b55c5d8649b498e05b24dee3d617ca08aef6bd413cc6004301eb0d", + "loads": [ + 4, + 3, + 10, + 9, + 7, + 11, + 6, + 0, + 18, + 7, + 6, + 1, + 5, + 0, + 3, + 5, + 7, + 3, + 5, + 1, + 8, + 10, + 3, + 2, + 1, + 8, + 15, + 3, + 3, + 1, + 11, + 0, + 9, + 14, + 2, + 7, + 3, + 2, + 6, + 4, + 10, + 3, + 11, + 1, + 2, + 6, + 9, + 1, + 3, + 2, + 10, + 4, + 1, + 2, + 1, + 14, + 9, + 1, + 4, + 5, + 10, + 15, + 1, + 6 + ], + "weighted_loads": [ + 0.1742690559476614, + 0.11116534471511841, + 0.9647795353084803, + 1.07724404707551, + 0.9451684206724167, + 0.5161222768947482, + 0.3719406723976135, + 0.0, + 1.508369905874133, + 0.26400902308523655, + 0.2928805910050869, + 0.012452770955860615, + 0.25396155193448067, + 0.0, + 0.5081852227449417, + 0.1917954981327057, + 0.37498147413134575, + 0.11441891081631184, + 0.25389784574508667, + 0.03499528393149376, + 0.29913708940148354, + 0.8432111255824566, + 0.11903827451169491, + 0.05634082853794098, + 0.03260757029056549, + 0.32211348600685596, + 1.008893083781004, + 0.11331712640821934, + 0.18710055574774742, + 0.04915839061141014, + 0.4785794746130705, + 0.0, + 0.325879143550992, + 0.5340415704995394, + 0.09793408215045929, + 0.36226658895611763, + 0.12132489681243896, + 0.09110011905431747, + 0.4584530368447304, + 0.17547475174069405, + 0.6245959755033255, + 0.28840261697769165, + 1.2426996286958456, + 0.04754284769296646, + 0.10585752129554749, + 0.2126354780048132, + 0.7092763260006905, + 0.03632568195462227, + 0.11025537922978401, + 0.24991238862276077, + 0.47829555720090866, + 0.20154151320457458, + 0.06578664481639862, + 0.13119643926620483, + 0.03590279817581177, + 1.3082851460203528, + 0.45408086478710175, + 0.02549641765654087, + 0.1724740844219923, + 0.23740888014435768, + 1.317414615303278, + 0.590018019080162, + 0.029986141249537468, + 0.21352118253707886 + ], + "unique_experts": 61, + "load_cv": 0.7756179456899347, + "normalized_load_entropy": 0.9260351923492293, + "max_load_share": 0.05084745762711865 + } + }, + "s1_x": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "e38e59f0fe05d793e23a96adc9205a459157f1ed16b82db21cecfdc4039b18f4", + "route_weight_sha256": "76e05a7a381979f3c244679ccca64ab296326dfb97d5a77473c35e54767aaae0", + "loads": [ + 0, + 1, + 8, + 0, + 7, + 7, + 1, + 0, + 9, + 1, + 6, + 0, + 5, + 0, + 0, + 3, + 8, + 1, + 5, + 0, + 6, + 2, + 2, + 1, + 1, + 6, + 14, + 1, + 3, + 1, + 10, + 0, + 5, + 5, + 2, + 5, + 2, + 1, + 5, + 4, + 5, + 3, + 5, + 1, + 2, + 6, + 9, + 1, + 1, + 0, + 4, + 4, + 1, + 0, + 1, + 0, + 5, + 0, + 2, + 5, + 3, + 7, + 0, + 1 + ], + "weighted_loads": [ + 0.0, + 0.03847735375165939, + 0.8610381688922644, + 0.0, + 0.9319540187716484, + 0.35441912710666656, + 0.04318752512335777, + 0.0, + 0.4583175405859947, + 0.040604546666145325, + 0.2917690984904766, + 0.0, + 0.2513042576611042, + 0.0, + 0.0, + 0.10285262390971184, + 0.4004940055310726, + 0.051493655890226364, + 0.2393079623579979, + 0.0, + 0.21627191454172134, + 0.10631492733955383, + 0.08714330568909645, + 0.027231205254793167, + 0.035429760813713074, + 0.2713003605604172, + 0.9656522199511528, + 0.03846623748540878, + 0.18177425116300583, + 0.048051849007606506, + 0.4328667800873518, + 0.0, + 0.20149047672748566, + 0.1952296495437622, + 0.06498999521136284, + 0.2753431499004364, + 0.07445511594414711, + 0.05788968876004219, + 0.414444874972105, + 0.17894890159368515, + 0.2823186255991459, + 0.2754853367805481, + 0.6827060505747795, + 0.04716602340340614, + 0.09877239167690277, + 0.21152405813336372, + 0.7335020340979099, + 0.03919978812336922, + 0.034159064292907715, + 0.0, + 0.17151756584644318, + 0.189408078789711, + 0.06983184814453125, + 0.0, + 0.03767940402030945, + 0.0, + 0.2861363850533962, + 0.0, + 0.12211456149816513, + 0.2401592768728733, + 0.15675153955817223, + 0.3239991143345833, + 0.0, + 0.033010415732860565 + ], + "unique_experts": 51, + "load_cv": 0.9603840702947809, + "normalized_load_entropy": 0.8835656550204282, + "max_load_share": 0.06862745098039216 + }, + "full_input": { + "tokens": 75, + "top_k": 6, + "decisions": 450, + "ordered_route_sha256": "ec792f11b95bb666cad98f6ad47e4116891f0674a78ed812974d1b4082d83351", + "route_weight_sha256": "9622a2d4f6a351a2ab02d632993da72ec8daf84f3170e835114c2bb3a0713736", + "loads": [ + 2, + 6, + 8, + 11, + 7, + 10, + 6, + 2, + 31, + 11, + 6, + 4, + 8, + 0, + 4, + 7, + 11, + 3, + 6, + 0, + 8, + 15, + 3, + 1, + 1, + 7, + 15, + 3, + 4, + 1, + 10, + 0, + 7, + 15, + 9, + 10, + 4, + 2, + 6, + 5, + 17, + 4, + 10, + 3, + 2, + 8, + 10, + 3, + 5, + 3, + 15, + 7, + 6, + 4, + 1, + 23, + 9, + 1, + 3, + 6, + 17, + 19, + 1, + 4 + ], + "weighted_loads": [ + 0.1283587757498026, + 0.48559178225696087, + 0.8610381688922644, + 1.2965205516666174, + 0.9319540187716484, + 0.48211286682635546, + 0.3596152737736702, + 0.08239160478115082, + 2.2584758158773184, + 0.554240956902504, + 0.2917690984904766, + 0.28180717024952173, + 0.3909207433462143, + 0.0, + 0.5657937806099653, + 0.33323201537132263, + 0.542496781796217, + 0.10183167271316051, + 0.27945511043071747, + 0.0, + 0.3153090216219425, + 1.2478259094059467, + 0.12951041013002396, + 0.027231205254793167, + 0.035429760813713074, + 0.29681695625185966, + 1.0068709664046764, + 0.1189897321164608, + 0.2631564438343048, + 0.048051849007606506, + 0.4328667800873518, + 0.0, + 0.31134099140763283, + 0.5535521358251572, + 0.3735710810869932, + 0.49407386034727097, + 0.16374705731868744, + 0.10061884298920631, + 0.4697003625333309, + 0.22579778730869293, + 1.0875934902578592, + 0.3009061049669981, + 1.2634299658238888, + 0.1816963441669941, + 0.09877239167690277, + 0.2926037088036537, + 0.7675383165478706, + 0.10868963971734047, + 0.2311263531446457, + 0.5362135395407677, + 0.7021822202950716, + 0.3920341841876507, + 0.6196282207965851, + 0.18476532027125359, + 0.03767940402030945, + 2.0419085389003158, + 0.4960448257625103, + 0.025044014677405357, + 0.17023972049355507, + 0.27649806812405586, + 2.176816739141941, + 0.9139831680804491, + 0.028353942558169365, + 0.1807747334241867 + ], + "unique_experts": 61, + "load_cv": 0.8319425431252621, + "normalized_load_entropy": 0.9236429968111958, + "max_load_share": 0.06888888888888889 + } + }, + "s0_period": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "52ae356407b70960afe53323dedd999c8bdf2325806cd081df570584ec7ea75a", + "route_weight_sha256": "6ed24c0fd2126a904b91f07995ccefb2def6ddfa3990e3446e6275ef2023ad8f", + "loads": [ + 1, + 1, + 8, + 0, + 7, + 8, + 1, + 0, + 6, + 1, + 6, + 0, + 5, + 0, + 0, + 5, + 7, + 1, + 5, + 0, + 7, + 2, + 2, + 1, + 1, + 6, + 14, + 1, + 3, + 1, + 10, + 0, + 5, + 6, + 1, + 5, + 3, + 3, + 5, + 3, + 5, + 3, + 5, + 1, + 2, + 6, + 9, + 0, + 1, + 0, + 4, + 4, + 1, + 0, + 1, + 0, + 5, + 0, + 2, + 5, + 2, + 7, + 0, + 0 + ], + "weighted_loads": [ + 0.022745056077837944, + 0.039156850427389145, + 0.8877349961549044, + 0.0, + 0.9540099427103996, + 0.3764104098081589, + 0.045673370361328125, + 0.0, + 0.3115514814853668, + 0.04003579169511795, + 0.2832961641252041, + 0.0, + 0.2552492097020149, + 0.0, + 0.0, + 0.1930198222398758, + 0.3732638359069824, + 0.04996122419834137, + 0.24885913357138634, + 0.0, + 0.2505208868533373, + 0.1160443052649498, + 0.08856258541345596, + 0.02684340626001358, + 0.03380531445145607, + 0.2639915179461241, + 0.9456296041607857, + 0.040736887603998184, + 0.1905282586812973, + 0.05234754458069801, + 0.4375926721841097, + 0.0, + 0.19272374734282494, + 0.2301449291408062, + 0.03192439302802086, + 0.27153002098202705, + 0.12152427434921265, + 0.13972147554159164, + 0.4189843498170376, + 0.12232562154531479, + 0.29206644371151924, + 0.29191385954618454, + 0.6969831213355064, + 0.04553159698843956, + 0.10192666202783585, + 0.2216539066284895, + 0.7009021900594234, + 0.0, + 0.03168678283691406, + 0.0, + 0.1609293483197689, + 0.19935514405369759, + 0.0669182538986206, + 0.0, + 0.03400283679366112, + 0.0, + 0.29572921991348267, + 0.0, + 0.11864474788308144, + 0.243263129144907, + 0.1262393519282341, + 0.26299394108355045, + 0.0, + 0.0 + ], + "unique_experts": 50, + "load_cv": 0.9539573376604032, + "normalized_load_entropy": 0.8824326305531791, + "max_load_share": 0.06862745098039216 + }, + "full_input": { + "tokens": 59, + "top_k": 6, + "decisions": 354, + "ordered_route_sha256": "380f973bb91f0c1034d2a9783e884cb829c55d2488e4cac8668ef7b46e1eb862", + "route_weight_sha256": "8d0acb279038e7b347b90d87be2399f47e4f2ece7d1c493305c8b25fac574236", + "loads": [ + 5, + 3, + 11, + 8, + 7, + 11, + 5, + 0, + 19, + 6, + 6, + 1, + 5, + 0, + 4, + 5, + 7, + 3, + 5, + 0, + 8, + 10, + 3, + 2, + 1, + 8, + 15, + 4, + 3, + 2, + 10, + 0, + 8, + 12, + 2, + 7, + 3, + 5, + 6, + 3, + 11, + 3, + 10, + 1, + 2, + 8, + 9, + 0, + 4, + 1, + 11, + 4, + 1, + 3, + 1, + 13, + 9, + 1, + 3, + 5, + 11, + 14, + 0, + 6 + ], + "weighted_loads": [ + 0.19701411202549934, + 0.16862227395176888, + 0.9952184520661831, + 0.9904545582830906, + 0.9540099427103996, + 0.5206447513774037, + 0.3044339008629322, + 0.0, + 1.5146229322999716, + 0.23199754394590855, + 0.2832961641252041, + 0.012452770955860615, + 0.2552492097020149, + 0.0, + 0.6014590859413147, + 0.1930198222398758, + 0.3732638359069824, + 0.12751572392880917, + 0.24885913357138634, + 0.0, + 0.29731437005102634, + 0.8383547253906727, + 0.11723111383616924, + 0.05528944358229637, + 0.03380531445145607, + 0.32393798790872097, + 0.9924397431313992, + 0.15240907855331898, + 0.1905282586812973, + 0.10260216146707535, + 0.4375926721841097, + 0.0, + 0.3041713386774063, + 0.4465690106153488, + 0.09868920221924782, + 0.35810792446136475, + 0.12152427434921265, + 0.20139470137655735, + 0.46343429386615753, + 0.12232562154531479, + 0.6550421584397554, + 0.29191385954618454, + 1.1785925030708313, + 0.04553159698843956, + 0.10192666202783585, + 0.29514811374247074, + 0.7009021900594234, + 0.0, + 0.15593543648719788, + 0.12666331231594086, + 0.5597727447748184, + 0.19935514405369759, + 0.0669182538986206, + 0.17052772268652916, + 0.03400283679366112, + 1.2144784471020103, + 0.452356044203043, + 0.02549641765654087, + 0.1446547992527485, + 0.243263129144907, + 1.3974636979401112, + 0.5115445181727409, + 0.0, + 0.22757375240325928 + ], + "unique_experts": 58, + "load_cv": 0.7690052139743042, + "normalized_load_entropy": 0.9236110601072743, + "max_load_share": 0.05367231638418079 + } + }, + "s1_period": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "26a0d1b941a253bb02bf01762e607e06eeac1e7394370d20b543b6273c39d051", + "route_weight_sha256": "9b1847af9a936c94bcf3e8663bbb1c0055336400108660d35d0a46d0502ba6bc", + "loads": [ + 0, + 1, + 8, + 1, + 7, + 7, + 1, + 0, + 5, + 1, + 6, + 0, + 5, + 0, + 0, + 4, + 8, + 1, + 5, + 0, + 6, + 2, + 2, + 1, + 1, + 6, + 14, + 1, + 3, + 1, + 11, + 0, + 5, + 5, + 2, + 5, + 3, + 2, + 4, + 5, + 4, + 3, + 5, + 1, + 2, + 6, + 9, + 1, + 1, + 0, + 4, + 4, + 1, + 0, + 1, + 0, + 5, + 0, + 3, + 5, + 3, + 6, + 0, + 1 + ], + "weighted_loads": [ + 0.0, + 0.0390506237745285, + 0.85611717030406, + 0.040669653564691544, + 0.9532792866230011, + 0.3611196540296078, + 0.04568865895271301, + 0.0, + 0.27594447135925293, + 0.046767476946115494, + 0.30425088480114937, + 0.0, + 0.25491099804639816, + 0.0, + 0.0, + 0.13997113332152367, + 0.40507202595472336, + 0.05099233612418175, + 0.2476017326116562, + 0.0, + 0.21747073903679848, + 0.10523774474859238, + 0.09186997264623642, + 0.02847617119550705, + 0.036409683525562286, + 0.2706032879650593, + 0.9567050747573376, + 0.03767547011375427, + 0.18873585015535355, + 0.05071049556136131, + 0.4614889994263649, + 0.0, + 0.19965362921357155, + 0.19497885182499886, + 0.06410076282918453, + 0.2807401940226555, + 0.11511567234992981, + 0.09079716727137566, + 0.36958861351013184, + 0.22720688953995705, + 0.2505964860320091, + 0.2780452147126198, + 0.675895519554615, + 0.04623391106724739, + 0.10864237323403358, + 0.21740149892866611, + 0.7067877501249313, + 0.037674855440855026, + 0.03421102464199066, + 0.0, + 0.15898225083947182, + 0.1930314004421234, + 0.06664924323558807, + 0.0, + 0.03633502498269081, + 0.0, + 0.28569940850138664, + 0.0, + 0.1613975577056408, + 0.23737698793411255, + 0.15390662103891373, + 0.26053675822913647, + 0.0, + 0.036164503544569016 + ], + "unique_experts": 52, + "load_cv": 0.9311145153399033, + "normalized_load_entropy": 0.8909853283086282, + "max_load_share": 0.06862745098039216 + }, + "full_input": { + "tokens": 75, + "top_k": 6, + "decisions": 450, + "ordered_route_sha256": "cc5dd047c6dc4f4742d8c1ea9be161aa17f1c67a8222044d7dd2fa5cc1c68adb", + "route_weight_sha256": "03c345e83639121b10957073306ed8c533c10f01a345c484f11cf3b8ae74df0d", + "loads": [ + 2, + 7, + 8, + 11, + 7, + 9, + 5, + 2, + 26, + 10, + 6, + 4, + 8, + 0, + 4, + 8, + 11, + 3, + 6, + 0, + 8, + 15, + 3, + 1, + 2, + 7, + 15, + 3, + 4, + 1, + 12, + 0, + 7, + 17, + 9, + 10, + 5, + 3, + 5, + 7, + 16, + 4, + 10, + 3, + 2, + 7, + 11, + 3, + 5, + 2, + 16, + 7, + 6, + 4, + 1, + 21, + 9, + 1, + 4, + 6, + 18, + 17, + 1, + 5 + ], + "weighted_loads": [ + 0.1283587757498026, + 0.5351960826665163, + 0.85611717030406, + 1.2880977746099234, + 0.9532792866230011, + 0.45019140373915434, + 0.32399873062968254, + 0.08239160478115082, + 2.02776818908751, + 0.5136064663529396, + 0.30425088480114937, + 0.28180717024952173, + 0.39452748373150826, + 0.0, + 0.5289189796894789, + 0.37035052478313446, + 0.5470748022198677, + 0.1013303529471159, + 0.28774888068437576, + 0.0, + 0.3193730190396309, + 1.25076337531209, + 0.13423707708716393, + 0.02847617119550705, + 0.0632654894143343, + 0.29611988365650177, + 1.000476110726595, + 0.11778571829199791, + 0.2701180428266525, + 0.05071049556136131, + 0.503032423555851, + 0.0, + 0.29451489821076393, + 0.617490116506815, + 0.3726818487048149, + 0.49101509526371956, + 0.20440761372447014, + 0.13168086484074593, + 0.42888143658638, + 0.31588035821914673, + 1.0616835076361895, + 0.3034659828990698, + 1.235926914960146, + 0.18076423183083534, + 0.10864237323403358, + 0.25961128808557987, + 0.7823208719491959, + 0.10716470703482628, + 0.22659160196781158, + 0.45635855197906494, + 0.7564922068268061, + 0.3956575058400631, + 0.6164456158876419, + 0.20492751151323318, + 0.03633502498269081, + 1.910600340925157, + 0.4956078492105007, + 0.025044014677405357, + 0.20952271670103073, + 0.2763759680092335, + 2.2218614667654037, + 0.7260362468659878, + 0.028353942558169365, + 0.22315968573093414 + ], + "unique_experts": 61, + "load_cv": 0.7769392305072738, + "normalized_load_entropy": 0.9295958159660641, + "max_load_share": 0.057777777777777775 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 34, + "ordered_topk_exact_tokens": 18, + "set_exact_tokens": 27, + "mean_set_jaccard": 0.9299719887955182, + "mean_token_weighted_tv": 0.014592905830153647, + "aggregate_load_tv": 0.0392156862745098 + }, + "system_bos": { + "tokens": 34, + "ordered_topk_exact_tokens": 23, + "set_exact_tokens": 29, + "mean_set_jaccard": 0.9516806722689075, + "mean_token_weighted_tv": 0.012784988427644266, + "aggregate_load_tv": 0.029411764705882346 + }, + "system_x": { + "tokens": 34, + "ordered_topk_exact_tokens": 18, + "set_exact_tokens": 27, + "mean_set_jaccard": 0.9299719887955182, + "mean_token_weighted_tv": 0.017845736515215215, + "aggregate_load_tv": 0.044117647058823525 + }, + "system_period": { + "tokens": 34, + "ordered_topk_exact_tokens": 17, + "set_exact_tokens": 24, + "mean_set_jaccard": 0.9033613445378151, + "mean_token_weighted_tv": 0.02125260020222734, + "aggregate_load_tv": 0.04901960784313726 + }, + "bos_at_s0": { + "tokens": 34, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 25, + "mean_set_jaccard": 0.9180672268907564, + "mean_token_weighted_tv": 0.01705958984573098, + "aggregate_load_tv": 0.04411764705882353 + }, + "bos_at_s1": { + "tokens": 34, + "ordered_topk_exact_tokens": 19, + "set_exact_tokens": 26, + "mean_set_jaccard": 0.9201680672268907, + "mean_token_weighted_tv": 0.018070461995461407, + "aggregate_load_tv": 0.0392156862745098 + }, + "x_at_s0": { + "tokens": 34, + "ordered_topk_exact_tokens": 20, + "set_exact_tokens": 25, + "mean_set_jaccard": 0.9180672268907564, + "mean_token_weighted_tv": 0.018935416222495192, + "aggregate_load_tv": 0.04411764705882353 + }, + "x_at_s1": { + "tokens": 34, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 24, + "mean_set_jaccard": 0.9047619047619049, + "mean_token_weighted_tv": 0.02244079249965794, + "aggregate_load_tv": 0.058823529411764705 + }, + "period_at_s0": { + "tokens": 34, + "ordered_topk_exact_tokens": 16, + "set_exact_tokens": 25, + "mean_set_jaccard": 0.9180672268907564, + "mean_token_weighted_tv": 0.017483642543939984, + "aggregate_load_tv": 0.04411764705882353 + }, + "period_at_s1": { + "tokens": 34, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 21, + "mean_set_jaccard": 0.8732492997198881, + "mean_token_weighted_tv": 0.027314278160167092, + "aggregate_load_tv": 0.058823529411764705 + } + } + }, + "layer_23": { + "layer": 23, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "9964a22cfa0af38875b2c146006d4860d299ee575b15206d1ca4333eed4dce11", + "route_weight_sha256": "bda929592621ec65ca28a6ff119219127793ea5f5feedb30cc6c59c3e24d4221", + "loads": [ + 2, + 3, + 2, + 0, + 1, + 1, + 5, + 2, + 6, + 3, + 3, + 6, + 0, + 3, + 1, + 0, + 1, + 5, + 7, + 14, + 13, + 1, + 0, + 3, + 0, + 0, + 1, + 3, + 6, + 4, + 4, + 2, + 7, + 3, + 1, + 8, + 12, + 8, + 3, + 11, + 1, + 0, + 3, + 0, + 0, + 7, + 1, + 0, + 8, + 5, + 0, + 0, + 1, + 1, + 3, + 3, + 3, + 0, + 3, + 0, + 0, + 10, + 0, + 0 + ], + "weighted_loads": [ + 0.1338808797299862, + 0.15404854342341423, + 0.08638989552855492, + 0.0, + 0.04466509073972702, + 0.026482226327061653, + 0.3491526171565056, + 0.056596770882606506, + 0.4844204783439636, + 0.16563531383872032, + 0.16534602269530296, + 0.2438128013163805, + 0.0, + 0.1677742749452591, + 0.042236100882291794, + 0.0, + 0.02473488077521324, + 0.19868123903870583, + 0.386467382311821, + 1.1512786149978638, + 0.6916334647685289, + 0.03761616349220276, + 0.0, + 0.34011269360780716, + 0.0, + 0.0, + 0.0568990632891655, + 0.18417081236839294, + 0.3463844321668148, + 0.22118797153234482, + 0.15309623256325722, + 0.049473123624920845, + 0.325450886040926, + 0.0869735348969698, + 0.03178240731358528, + 0.7072873897850513, + 0.8595070037990808, + 0.2613979522138834, + 0.28217068314552307, + 0.5314782354980707, + 0.036576882004737854, + 0.0, + 0.0936849769204855, + 0.0, + 0.0, + 0.3830926399677992, + 0.04331478476524353, + 0.0, + 0.7335348799824715, + 0.2684018798172474, + 0.0, + 0.0, + 0.0747123509645462, + 0.04907824471592903, + 0.14263104274868965, + 0.19694774970412254, + 0.20928036607801914, + 0.0, + 0.12289712950587273, + 0.0, + 0.0, + 0.8172872215509415, + 0.0, + 0.0 + ], + "unique_experts": 47, + "load_cv": 1.0936537072458308, + "normalized_load_entropy": 0.8589438467543961, + "max_load_share": 0.06862745098039216 + }, + "full_input": { + "tokens": 59, + "top_k": 6, + "decisions": 354, + "ordered_route_sha256": "fc300c9db4ca31664ac29a1fd67ee1dbf12026407500d26435c1b87a31da1c6c", + "route_weight_sha256": "5e5ccb744052e415b05f3cc690cd463dddcbda4879fde3cf73bc5d9e6740c282", + "loads": [ + 7, + 6, + 2, + 9, + 5, + 3, + 11, + 6, + 8, + 11, + 3, + 6, + 1, + 7, + 2, + 0, + 5, + 5, + 7, + 14, + 13, + 1, + 1, + 13, + 4, + 0, + 2, + 3, + 6, + 4, + 5, + 2, + 9, + 8, + 1, + 8, + 13, + 8, + 8, + 13, + 7, + 0, + 4, + 0, + 0, + 14, + 13, + 4, + 10, + 6, + 1, + 1, + 1, + 3, + 13, + 3, + 3, + 11, + 5, + 0, + 0, + 10, + 5, + 0 + ], + "weighted_loads": [ + 0.3207146276254207, + 0.32366521283984184, + 0.08638989552855492, + 0.2703700214624405, + 0.20438672229647636, + 0.08137636119499803, + 0.7962249536067247, + 0.22487985529005527, + 0.5706060868687928, + 0.4519559219479561, + 0.16534602269530296, + 0.2438128013163805, + 0.010172571986913681, + 0.34157758951187134, + 0.11592762544751167, + 0.0, + 0.0969167617149651, + 0.19868123903870583, + 0.386467382311821, + 1.1512786149978638, + 0.6916334647685289, + 0.03761616349220276, + 0.01863253302872181, + 1.7679223828017712, + 0.14229988306760788, + 0.0, + 0.08259689807891846, + 0.18417081236839294, + 0.3463844321668148, + 0.22118797153234482, + 0.1919429898262024, + 0.049473123624920845, + 0.41834986209869385, + 0.3867810944793746, + 0.03178240731358528, + 0.7072873897850513, + 0.8966913688927889, + 0.2613979522138834, + 0.5781027870252728, + 0.5823400896042585, + 0.2756355553865433, + 0.0, + 0.11980299092829227, + 0.0, + 0.0, + 2.5045115631073713, + 1.0860547125339508, + 0.12457704916596413, + 0.8491665422916412, + 0.323586318641901, + 0.06796451658010483, + 0.09073854982852936, + 0.0747123509645462, + 0.15510137751698494, + 1.058186773210764, + 0.19694774970412254, + 0.20928036607801914, + 1.0253923423588276, + 0.22802670672535896, + 0.0, + 0.0, + 0.8172872215509415, + 0.14654397033154964, + 0.0 + ], + "unique_experts": 56, + "load_cv": 0.7696690437943613, + "normalized_load_entropy": 0.9182164278997996, + "max_load_share": 0.03954802259887006 + } + }, + "s1_eos": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "9f69bfa74cc3d22ed3b2be93df2c68ad610828955bfddd539b13d08d4cc423f4", + "route_weight_sha256": "2f1df3625c89213b1f7b185fd7fef91d1bbc4e896317f799fc95e902432b8164", + "loads": [ + 2, + 2, + 2, + 0, + 0, + 1, + 5, + 1, + 6, + 3, + 3, + 6, + 0, + 5, + 2, + 0, + 1, + 5, + 6, + 13, + 14, + 1, + 0, + 3, + 0, + 0, + 1, + 3, + 6, + 5, + 5, + 2, + 7, + 3, + 1, + 9, + 9, + 8, + 3, + 11, + 1, + 0, + 3, + 0, + 0, + 7, + 1, + 1, + 8, + 4, + 0, + 0, + 2, + 0, + 3, + 3, + 4, + 0, + 3, + 0, + 0, + 10, + 0, + 0 + ], + "weighted_loads": [ + 0.12682577967643738, + 0.11967920511960983, + 0.08681714907288551, + 0.0, + 0.0, + 0.02755378931760788, + 0.33587801456451416, + 0.029008381068706512, + 0.4885373152792454, + 0.18782804906368256, + 0.1681891530752182, + 0.23911083489656448, + 0.0, + 0.24720457941293716, + 0.0773797519505024, + 0.0, + 0.023886386305093765, + 0.19762904196977615, + 0.3490481600165367, + 1.092197459191084, + 0.7483539320528507, + 0.03691985458135605, + 0.0, + 0.36260633170604706, + 0.0, + 0.0, + 0.054194800555706024, + 0.18226727470755577, + 0.336029551923275, + 0.2498179879039526, + 0.18338442966341972, + 0.049940066412091255, + 0.3336825668811798, + 0.08798587322235107, + 0.032944079488515854, + 0.7593249529600143, + 0.7316881492733955, + 0.26688236370682716, + 0.27424535900354385, + 0.5258293133229017, + 0.03583461418747902, + 0.0, + 0.09390723519027233, + 0.0, + 0.0, + 0.38695513643324375, + 0.041359368711709976, + 0.04147679731249809, + 0.7179667726159096, + 0.22031767666339874, + 0.0, + 0.0, + 0.10476963967084885, + 0.0, + 0.14547167718410492, + 0.1889733411371708, + 0.2391258031129837, + 0.0, + 0.12368638254702091, + 0.0, + 0.0, + 0.8089154027402401, + 0.0, + 0.0 + ], + "unique_experts": 46, + "load_cv": 1.0723536403039464, + "normalized_load_entropy": 0.8598817478903317, + "max_load_share": 0.06862745098039216 + }, + "full_input": { + "tokens": 75, + "top_k": 6, + "decisions": 450, + "ordered_route_sha256": "bb68840e6fc94f81198b19908ee7a6260b4fd77c32a857639296c5e498d05abc", + "route_weight_sha256": "e2dd9e028378bb1f73a562585d845ecfcf8dd22684539833fedc5a51fd04cefd", + "loads": [ + 8, + 7, + 9, + 8, + 6, + 4, + 18, + 9, + 9, + 8, + 5, + 7, + 1, + 9, + 4, + 3, + 7, + 6, + 8, + 13, + 15, + 1, + 1, + 17, + 2, + 0, + 2, + 3, + 6, + 7, + 5, + 2, + 8, + 15, + 1, + 9, + 15, + 9, + 11, + 11, + 8, + 0, + 5, + 0, + 2, + 17, + 18, + 6, + 15, + 8, + 0, + 10, + 8, + 2, + 13, + 4, + 4, + 16, + 5, + 0, + 2, + 11, + 6, + 1 + ], + "weighted_loads": [ + 0.44916289485991, + 0.43257027864456177, + 0.43263673409819603, + 0.46569194667972624, + 0.20989867486059666, + 0.1185365472920239, + 1.1329485401511192, + 0.2941947188228369, + 0.6126597449183464, + 0.36995939165353775, + 0.25960545241832733, + 0.2693310920149088, + 0.010235452093183994, + 0.4227283075451851, + 0.20956339314579964, + 0.12105459719896317, + 0.16642363695427775, + 0.25605789572000504, + 0.4379703924059868, + 1.092197459191084, + 0.7954757921397686, + 0.03691985458135605, + 0.018400786444544792, + 2.35128278657794, + 0.08063488639891148, + 0.0, + 0.08222596533596516, + 0.18226727470755577, + 0.336029551923275, + 0.3468910660594702, + 0.18338442966341972, + 0.049940066412091255, + 0.37873097881674767, + 0.8102312190458179, + 0.032944079488515854, + 0.7593249529600143, + 1.1621559895575047, + 0.3144018426537514, + 0.7988147251307964, + 0.5258293133229017, + 0.3144706580787897, + 0.0, + 0.1483582742512226, + 0.0, + 0.10261036083102226, + 2.600480178371072, + 1.730009213089943, + 0.32665828079916537, + 1.0602441653609276, + 0.4175199344754219, + 0.0, + 0.6170322690159082, + 0.7492972277104855, + 0.10747144743800163, + 1.117126815021038, + 0.22043878585100174, + 0.2391258031129837, + 1.5988817811012268, + 0.2500172797590494, + 0.0, + 0.07520119473338127, + 0.9352358095347881, + 0.23482929170131683, + 0.038915932178497314 + ], + "unique_experts": 59, + "load_cv": 0.7119855734424142, + "normalized_load_entropy": 0.9317874099266451, + "max_load_share": 0.04 + } + }, + "s0_bos": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "6b9018f45df82971fb89f0da6849f44712e756284400b7171d8500431b132a72", + "route_weight_sha256": "d5a652f7385bdfda148c1ffc9a424e2504bd05a4414be37166f199784d51881f", + "loads": [ + 2, + 3, + 2, + 0, + 0, + 1, + 5, + 3, + 6, + 3, + 3, + 6, + 0, + 5, + 1, + 0, + 0, + 5, + 7, + 13, + 13, + 1, + 0, + 3, + 0, + 0, + 1, + 3, + 6, + 4, + 4, + 2, + 7, + 2, + 1, + 8, + 11, + 10, + 3, + 11, + 1, + 0, + 3, + 0, + 0, + 6, + 1, + 0, + 8, + 6, + 0, + 0, + 1, + 2, + 3, + 2, + 4, + 0, + 2, + 0, + 0, + 10, + 0, + 0 + ], + "weighted_loads": [ + 0.13167304545640945, + 0.15380248427391052, + 0.08866318315267563, + 0.0, + 0.0, + 0.02608630247414112, + 0.35096490755677223, + 0.08032344654202461, + 0.5154535509645939, + 0.15540104359388351, + 0.16579056158661842, + 0.2537668328732252, + 0.0, + 0.2448057197034359, + 0.04049185663461685, + 0.0, + 0.0, + 0.1951916627585888, + 0.38421119563281536, + 1.1216823533177376, + 0.6947552338242531, + 0.0310080386698246, + 0.0, + 0.34646283835172653, + 0.0, + 0.0, + 0.055204953998327255, + 0.18180790916085243, + 0.3494175374507904, + 0.22541248425841331, + 0.15003272891044617, + 0.0481903962790966, + 0.3350033089518547, + 0.060493217781186104, + 0.03077453002333641, + 0.6860425136983395, + 0.8258805107325315, + 0.33893231488764286, + 0.2895885109901428, + 0.544692188501358, + 0.038861121982336044, + 0.0, + 0.09592289850115776, + 0.0, + 0.0, + 0.34573445841670036, + 0.043409306555986404, + 0.0, + 0.7177798002958298, + 0.3130444064736366, + 0.0, + 0.0, + 0.07001999020576477, + 0.09637320414185524, + 0.14437662810087204, + 0.1475299745798111, + 0.2288053873926401, + 0.0, + 0.07688538543879986, + 0.0, + 0.0, + 0.8215698152780533, + 0.0, + 0.0 + ], + "unique_experts": 45, + "load_cv": 1.0922466256631729, + "normalized_load_entropy": 0.8545282080960183, + "max_load_share": 0.06372549019607843 + }, + "full_input": { + "tokens": 59, + "top_k": 6, + "decisions": 354, + "ordered_route_sha256": "b839c3d04a8aa0d18f5a2d6b0af95294b00817aa42ab0f6f19955c4648e6881b", + "route_weight_sha256": "dd3fe68fe4f2443f0d4bef3c2d48ffcbee2f6ffa04eb15cdb8f380d951a177c7", + "loads": [ + 5, + 6, + 2, + 8, + 5, + 3, + 11, + 7, + 7, + 10, + 3, + 7, + 2, + 9, + 2, + 0, + 3, + 5, + 7, + 14, + 13, + 1, + 2, + 14, + 4, + 0, + 3, + 3, + 6, + 5, + 4, + 2, + 8, + 5, + 1, + 8, + 11, + 10, + 7, + 13, + 9, + 0, + 4, + 1, + 0, + 12, + 13, + 3, + 10, + 7, + 1, + 1, + 1, + 4, + 13, + 3, + 4, + 12, + 5, + 1, + 0, + 10, + 4, + 0 + ], + "weighted_loads": [ + 0.2543134270235896, + 0.32341915369033813, + 0.08866318315267563, + 0.266840148717165, + 0.21088002249598503, + 0.0809804373420775, + 0.8235165383666754, + 0.2579120583832264, + 0.6106709353625774, + 0.40209585428237915, + 0.16579056158661842, + 0.2764942888170481, + 0.049615513533353806, + 0.41860903427004814, + 0.11418338119983673, + 0.0, + 0.04946626769378781, + 0.1951916627585888, + 0.38421119563281536, + 1.2596341744065285, + 0.6947552338242531, + 0.0310080386698246, + 0.06504600308835506, + 1.845298957079649, + 0.14067914336919785, + 0.0, + 0.20147490687668324, + 0.18180790916085243, + 0.3494175374507904, + 0.2799586281180382, + 0.15003272891044617, + 0.0481903962790966, + 0.3897751681506634, + 0.31859043426811695, + 0.03077453002333641, + 0.6860425136983395, + 0.8258805107325315, + 0.33893231488764286, + 0.5413462659344077, + 0.5955540426075459, + 0.36026252806186676, + 0.0, + 0.12204091250896454, + 0.05120854824781418, + 0.0, + 1.4766507484018803, + 1.0773164555430412, + 0.11867108289152384, + 0.8392103612422943, + 0.3649846874177456, + 0.0534825474023819, + 0.09073854982852936, + 0.07001999020576477, + 0.2059764675796032, + 1.0599323585629463, + 0.1938783936202526, + 0.2288053873926401, + 1.073057010769844, + 0.23044672049582005, + 0.2556598484516144, + 0.0, + 0.8215698152780533, + 0.12630809098482132, + 0.0 + ], + "unique_experts": 58, + "load_cv": 0.7481343900624926, + "normalized_load_entropy": 0.9249296986924711, + "max_load_share": 0.03954802259887006 + } + }, + "s1_bos": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "4b167ee9999812413f595fe62496617d0c173afa7e0d8c878fa2327e963dbba2", + "route_weight_sha256": "75f06036966d8dc1564714e8b2130ff536e7d0929bbdb0898ee9e6b68ee22d21", + "loads": [ + 2, + 2, + 2, + 0, + 0, + 1, + 5, + 2, + 6, + 3, + 3, + 6, + 0, + 4, + 2, + 0, + 0, + 5, + 7, + 13, + 14, + 1, + 0, + 3, + 0, + 0, + 2, + 3, + 6, + 4, + 6, + 1, + 6, + 2, + 1, + 8, + 10, + 10, + 3, + 9, + 1, + 0, + 3, + 0, + 0, + 8, + 1, + 1, + 8, + 5, + 0, + 0, + 1, + 2, + 3, + 3, + 4, + 0, + 2, + 0, + 0, + 10, + 0, + 0 + ], + "weighted_loads": [ + 0.11742110550403595, + 0.11283957585692406, + 0.08763807266950607, + 0.0, + 0.0, + 0.02532060071825981, + 0.3356085680425167, + 0.05431603267788887, + 0.4980839975178242, + 0.1641797125339508, + 0.1671934388577938, + 0.24530248530209064, + 0.0, + 0.20454008504748344, + 0.08444081246852875, + 0.0, + 0.0, + 0.1959885936230421, + 0.37942733615636826, + 1.0944628790020943, + 0.7610250785946846, + 0.03151087090373039, + 0.0, + 0.329164981842041, + 0.0, + 0.0, + 0.07634888030588627, + 0.17009493336081505, + 0.330840602517128, + 0.2239859774708748, + 0.23214134573936462, + 0.024523403495550156, + 0.2888922467827797, + 0.0613366924226284, + 0.03266994655132294, + 0.6752710230648518, + 0.7595195304602385, + 0.33816669322550297, + 0.2718655467033386, + 0.46294073201715946, + 0.03721301257610321, + 0.0, + 0.09613550081849098, + 0.0, + 0.0, + 0.40375490114092827, + 0.04623154178261757, + 0.045405350625514984, + 0.6947712153196335, + 0.27251311764121056, + 0.0, + 0.0, + 0.06526383012533188, + 0.09359003603458405, + 0.13976861536502838, + 0.19618047773838043, + 0.22862558253109455, + 0.0, + 0.07733966410160065, + 0.0, + 0.0, + 0.803565438836813, + 0.0, + 0.0 + ], + "unique_experts": 46, + "load_cv": 1.0780748073640214, + "normalized_load_entropy": 0.8590772350827506, + "max_load_share": 0.06862745098039216 + }, + "full_input": { + "tokens": 75, + "top_k": 6, + "decisions": 450, + "ordered_route_sha256": "dce1c4fcdd29696b8a5f970f08cd8a62bc5fc6419e0023ade5075b3370aa0cef", + "route_weight_sha256": "d68f222e3f1c922f03142630bf96bbd153cb3ae04ffcf8eb556a5e74ea5238f0", + "loads": [ + 7, + 7, + 8, + 7, + 7, + 3, + 17, + 10, + 8, + 7, + 5, + 6, + 1, + 8, + 3, + 3, + 6, + 6, + 9, + 13, + 15, + 1, + 2, + 18, + 3, + 0, + 2, + 3, + 6, + 6, + 7, + 1, + 7, + 12, + 1, + 8, + 16, + 12, + 10, + 9, + 11, + 0, + 5, + 0, + 2, + 16, + 18, + 5, + 15, + 9, + 0, + 10, + 7, + 6, + 13, + 5, + 4, + 17, + 5, + 0, + 2, + 11, + 7, + 2 + ], + "weighted_loads": [ + 0.44414231460541487, + 0.425730649381876, + 0.3983786404132843, + 0.462206544354558, + 0.26408697851002216, + 0.06932982848957181, + 1.1328295804560184, + 0.3372527025640011, + 0.6257981210947037, + 0.32334527373313904, + 0.25860973820090294, + 0.24530248530209064, + 0.010235452093183994, + 0.38006381317973137, + 0.18054306507110596, + 0.12105459719896317, + 0.14272670587524772, + 0.254417447373271, + 0.46834956854581833, + 1.0944628790020943, + 0.8081469386816025, + 0.03151087090373039, + 0.07049239985644817, + 2.393717121332884, + 0.12173452787101269, + 0.0, + 0.07634888030588627, + 0.17009493336081505, + 0.330840602517128, + 0.32737112045288086, + 0.2833026461303234, + 0.024523403495550156, + 0.33394065871834755, + 0.7280843239277601, + 0.03266994655132294, + 0.6752710230648518, + 1.1899873707443476, + 0.43082778714597225, + 0.7495452128350735, + 0.46294073201715946, + 0.43597136810421944, + 0.0, + 0.15058653987944126, + 0.0, + 0.10261036083102226, + 1.593349028378725, + 1.7250025905668736, + 0.32648361567407846, + 1.0401153191924095, + 0.46200431883335114, + 0.0, + 0.6170322690159082, + 0.7097914181649685, + 0.32854798808693886, + 1.1114237532019615, + 0.27656327560544014, + 0.22862558253109455, + 1.61815844476223, + 0.2503408379852772, + 0.0, + 0.07520119473338127, + 0.929885845631361, + 0.266023863106966, + 0.08815625682473183 + ], + "unique_experts": 59, + "load_cv": 0.7017016354442857, + "normalized_load_entropy": 0.9342797353117868, + "max_load_share": 0.04 + } + }, + "s0_x": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "86e4825cd1cf3cbdbe8a26f646a0ff3a7dcfcfb1146bfc03730a7943effdd7bb", + "route_weight_sha256": "b434a11d8bfa579aab5be348f7dc7e5b0dd5ed46d1845ec5b1f07b63513b449c", + "loads": [ + 2, + 2, + 2, + 0, + 0, + 1, + 5, + 1, + 6, + 3, + 3, + 4, + 0, + 5, + 1, + 0, + 2, + 5, + 6, + 13, + 14, + 1, + 0, + 3, + 0, + 0, + 1, + 3, + 5, + 4, + 6, + 2, + 6, + 3, + 1, + 8, + 12, + 8, + 3, + 12, + 1, + 0, + 2, + 0, + 0, + 7, + 1, + 0, + 8, + 5, + 0, + 0, + 2, + 3, + 3, + 3, + 3, + 0, + 3, + 0, + 0, + 10, + 0, + 0 + ], + "weighted_loads": [ + 0.1339770220220089, + 0.11595526337623596, + 0.08586788922548294, + 0.0, + 0.0, + 0.02613387256860733, + 0.3470895476639271, + 0.028800351545214653, + 0.48366231471300125, + 0.1573362872004509, + 0.16096079349517822, + 0.1836297381669283, + 0.0, + 0.2451406940817833, + 0.03738461434841156, + 0.0, + 0.05047583766281605, + 0.1916730049997568, + 0.3514583446085453, + 1.126833789050579, + 0.7255846634507179, + 0.03918332979083061, + 0.0, + 0.32159338891506195, + 0.0, + 0.0, + 0.044224813580513, + 0.1720791757106781, + 0.3012891113758087, + 0.22288784384727478, + 0.23176346346735954, + 0.05233931541442871, + 0.2804422527551651, + 0.08490932919085026, + 0.03368275985121727, + 0.6771012730896473, + 0.8349050115793943, + 0.2629642430692911, + 0.274252213537693, + 0.577587328851223, + 0.036667559295892715, + 0.0, + 0.0608589593321085, + 0.0, + 0.0, + 0.37829392217099667, + 0.04377424716949463, + 0.0, + 0.7131633907556534, + 0.258977135643363, + 0.0, + 0.0, + 0.09991544857621193, + 0.14513998851180077, + 0.14454366639256477, + 0.19486837461590767, + 0.20105542987585068, + 0.0, + 0.10794781148433685, + 0.0, + 0.0, + 0.8150262292474508, + 0.0, + 0.0 + ], + "unique_experts": 46, + "load_cv": 1.0950589808190747, + "normalized_load_entropy": 0.8582231651827369, + "max_load_share": 0.06862745098039216 + }, + "full_input": { + "tokens": 59, + "top_k": 6, + "decisions": 354, + "ordered_route_sha256": "c4f1ed5bbbb89dca94509bd534033b88c7dddb141d6ffc8abe332b47628df6a2", + "route_weight_sha256": "b5f4139051cf75db07066438a7e72bb865a452dc62db0bf077414e00f518bc10", + "loads": [ + 6, + 5, + 2, + 10, + 4, + 3, + 12, + 6, + 7, + 10, + 3, + 4, + 1, + 9, + 3, + 0, + 7, + 5, + 6, + 13, + 14, + 1, + 1, + 14, + 3, + 0, + 2, + 3, + 5, + 4, + 6, + 2, + 8, + 8, + 1, + 8, + 13, + 8, + 8, + 14, + 6, + 0, + 3, + 0, + 0, + 14, + 16, + 3, + 10, + 6, + 0, + 1, + 2, + 4, + 14, + 3, + 3, + 11, + 5, + 0, + 0, + 10, + 4, + 0 + ], + "weighted_loads": [ + 0.321381657384336, + 0.2855719327926636, + 0.08586788922548294, + 0.4110940583050251, + 0.15393644198775291, + 0.0810280074365437, + 0.8966798577457666, + 0.204600116237998, + 0.563558354973793, + 0.3870511297136545, + 0.16096079349517822, + 0.1836297381669283, + 0.010172571986913681, + 0.41894400864839554, + 0.1578884832561016, + 0.0, + 0.15261481003835797, + 0.1916730049997568, + 0.3514583446085453, + 1.126833789050579, + 0.7255846634507179, + 0.03918332979083061, + 0.01863253302872181, + 1.7367603853344917, + 0.101881492882967, + 0.0, + 0.067986611276865, + 0.1720791757106781, + 0.3012891113758087, + 0.22288784384727478, + 0.23176346346735954, + 0.05233931541442871, + 0.37763188406825066, + 0.46939616464078426, + 0.03368275985121727, + 0.6771012730896473, + 0.8732815105468035, + 0.2629642430692911, + 0.6073190411552787, + 0.6284491829574108, + 0.22836892493069172, + 0.0, + 0.08697697333991528, + 0.0, + 0.0, + 1.5591307524591684, + 1.283961659297347, + 0.1139043914154172, + 0.8264726027846336, + 0.2984835337847471, + 0.0, + 0.09073854982852936, + 0.09991544857621193, + 0.20583366975188255, + 1.193816665560007, + 0.19486837461590767, + 0.20105542987585068, + 1.0573336966335773, + 0.2086852304637432, + 0.0, + 0.0, + 0.8150262292474508, + 0.12841708026826382, + 0.0 + ], + "unique_experts": 55, + "load_cv": 0.8078700950396164, + "normalized_load_entropy": 0.912774092532747, + "max_load_share": 0.04519774011299435 + } + }, + "s1_x": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "0098f32cae89d295060eda88a94229cd553ae0655dff67d0011eff4c24cad71b", + "route_weight_sha256": "e9a0fac714ebb86cfc3083ab92f2cdc244386231564db72970a170444e9e9281", + "loads": [ + 2, + 3, + 2, + 0, + 0, + 1, + 5, + 1, + 6, + 3, + 3, + 4, + 0, + 5, + 2, + 0, + 0, + 5, + 6, + 14, + 14, + 1, + 0, + 3, + 0, + 0, + 0, + 3, + 5, + 5, + 6, + 2, + 5, + 4, + 1, + 8, + 10, + 9, + 3, + 10, + 1, + 0, + 2, + 0, + 0, + 8, + 1, + 1, + 8, + 6, + 0, + 0, + 1, + 1, + 3, + 3, + 3, + 0, + 3, + 1, + 0, + 10, + 1, + 0 + ], + "weighted_loads": [ + 0.12023580446839333, + 0.1434146035462618, + 0.08528043329715729, + 0.0, + 0.0, + 0.02575821615755558, + 0.33395952731370926, + 0.02821635641157627, + 0.47620371729135513, + 0.16984203457832336, + 0.1640383005142212, + 0.19040871784090996, + 0.0, + 0.2248102631419897, + 0.08162588253617287, + 0.0, + 0.0, + 0.20345322042703629, + 0.35003337636590004, + 1.109950490295887, + 0.764097772538662, + 0.037865784019231796, + 0.0, + 0.33300240337848663, + 0.0, + 0.0, + 0.0, + 0.17693261429667473, + 0.27055399492383003, + 0.25518990866839886, + 0.23611855879426003, + 0.055235082283616066, + 0.24254748970270157, + 0.11488555185496807, + 0.03417479246854782, + 0.6511635072529316, + 0.7278933078050613, + 0.2924109175801277, + 0.26184722036123276, + 0.5315004605799913, + 0.04025185480713844, + 0.0, + 0.06182281859219074, + 0.0, + 0.0, + 0.4017651826143265, + 0.05124768242239952, + 0.039040710777044296, + 0.6876274794340134, + 0.2854332160204649, + 0.0, + 0.0, + 0.07241208106279373, + 0.04563578963279724, + 0.1372324489057064, + 0.19819608703255653, + 0.18581540882587433, + 0.0, + 0.11498434282839298, + 0.0266104806214571, + 0.0, + 0.8022355027496815, + 0.02822684496641159, + 0.0 + ], + "unique_experts": 47, + "load_cv": 1.0823458368621632, + "normalized_load_entropy": 0.860405103104091, + "max_load_share": 0.06862745098039216 + }, + "full_input": { + "tokens": 75, + "top_k": 6, + "decisions": 450, + "ordered_route_sha256": "1137171aad51a33f3136727c1b9f488bf09294e7b7cceb805441c018ffef4172", + "route_weight_sha256": "1c721a7e09c438d2a99a24be1f742ff737b3a73d468ca00cf9f15789fc0dd82a", + "loads": [ + 7, + 8, + 8, + 8, + 4, + 4, + 18, + 8, + 8, + 6, + 5, + 5, + 1, + 9, + 3, + 3, + 6, + 6, + 8, + 15, + 15, + 1, + 1, + 19, + 3, + 0, + 0, + 3, + 5, + 7, + 6, + 2, + 7, + 14, + 1, + 8, + 17, + 10, + 11, + 10, + 8, + 0, + 4, + 0, + 2, + 16, + 21, + 5, + 16, + 9, + 0, + 11, + 7, + 3, + 16, + 5, + 3, + 16, + 5, + 1, + 2, + 11, + 8, + 1 + ], + "weighted_loads": [ + 0.43480224814265966, + 0.4563056770712137, + 0.3960210010409355, + 0.5217905919998884, + 0.1316117737442255, + 0.12105134734883904, + 1.169248502701521, + 0.276180287823081, + 0.5945773087441921, + 0.2846641391515732, + 0.2554545998573303, + 0.22506308555603027, + 0.010235452093183994, + 0.40033399127423763, + 0.17772813513875008, + 0.12105459719896317, + 0.14591080648824573, + 0.26188207417726517, + 0.4389556087553501, + 1.1412250846624374, + 0.8112196326255798, + 0.037865784019231796, + 0.018400786444544792, + 2.365330293774605, + 0.12649902887642384, + 0.0, + 0.0, + 0.17693261429667473, + 0.27055399492383003, + 0.354541452601552, + 0.23611855879426003, + 0.055235082283616066, + 0.34157973155379295, + 0.8197991102933884, + 0.03417479246854782, + 0.6511635072529316, + 1.1952208019793034, + 0.3399303965270519, + 0.8013943210244179, + 0.5315004605799913, + 0.2913773041218519, + 0.0, + 0.11627385765314102, + 0.0, + 0.10261036083102226, + 1.596862442791462, + 2.0160060431808233, + 0.31243126932531595, + 1.079502873122692, + 0.4332612846046686, + 0.0, + 0.7012466434389353, + 0.7169396691024303, + 0.11608606204390526, + 1.3531322330236435, + 0.265455212444067, + 0.18581540882587433, + 1.5972163900732994, + 0.2511568907648325, + 0.0266104806214571, + 0.07520119473338127, + 0.9285559095442295, + 0.29648497700691223, + 0.038915932178497314 + ], + "unique_experts": 59, + "load_cv": 0.7609091378406377, + "normalized_load_entropy": 0.9258171782504975, + "max_load_share": 0.04666666666666667 + } + }, + "s0_period": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "7fc5ae234fed59f8dca8cb8be27fec0997d9cb8d8570d5df34331126b76ad496", + "route_weight_sha256": "2fb9d65456945d7d76c6b86635b390680c05989ff408c42614c319d0f3448261", + "loads": [ + 2, + 2, + 2, + 0, + 0, + 1, + 5, + 2, + 6, + 4, + 3, + 5, + 0, + 5, + 1, + 0, + 0, + 5, + 6, + 13, + 12, + 1, + 0, + 3, + 0, + 0, + 1, + 3, + 6, + 4, + 6, + 2, + 7, + 3, + 2, + 8, + 11, + 8, + 3, + 12, + 1, + 0, + 3, + 0, + 0, + 7, + 1, + 0, + 8, + 5, + 0, + 0, + 1, + 3, + 3, + 3, + 3, + 0, + 2, + 0, + 0, + 10, + 0, + 0 + ], + "weighted_loads": [ + 0.12961145490407944, + 0.11288726702332497, + 0.08361203595995903, + 0.0, + 0.0, + 0.026034245267510414, + 0.35161104798316956, + 0.05437300726771355, + 0.490628644824028, + 0.19607415050268173, + 0.15495482087135315, + 0.21833456680178642, + 0.0, + 0.24159832298755646, + 0.03733676299452782, + 0.0, + 0.0, + 0.18950235284864902, + 0.3517313487827778, + 1.1117194183170795, + 0.6336797401309013, + 0.04093319922685623, + 0.0, + 0.33404386788606644, + 0.0, + 0.0, + 0.04635651782155037, + 0.1795700378715992, + 0.33905384317040443, + 0.22556882351636887, + 0.21854940988123417, + 0.05057091824710369, + 0.324405524879694, + 0.08382956124842167, + 0.05767652206122875, + 0.678651038557291, + 0.809253504499793, + 0.26374365761876106, + 0.27571045607328415, + 0.5635700728744268, + 0.03735247626900673, + 0.0, + 0.08859087899327278, + 0.0, + 0.0, + 0.3809927888214588, + 0.043882571160793304, + 0.0, + 0.7113782167434692, + 0.26280877739191055, + 0.0, + 0.0, + 0.06756676733493805, + 0.14233992248773575, + 0.13745715096592903, + 0.1958293728530407, + 0.1998204067349434, + 0.0, + 0.07900719717144966, + 0.0, + 0.0, + 0.8050468545407057, + 0.0, + 0.0 + ], + "unique_experts": 45, + "load_cv": 1.0694815798662465, + "normalized_load_entropy": 0.8585112568098255, + "max_load_share": 0.06372549019607843 + }, + "full_input": { + "tokens": 59, + "top_k": 6, + "decisions": 354, + "ordered_route_sha256": "5a0ab86100e5e01002bf261f192fea7d9deff4eae3dc68618d88e4584b806a80", + "route_weight_sha256": "4c1caac73fe9182590339bffc9ca6016029aef94ce3e9cb39b2a0b6414d86fb5", + "loads": [ + 6, + 5, + 3, + 8, + 5, + 4, + 13, + 7, + 7, + 12, + 3, + 5, + 1, + 9, + 2, + 0, + 4, + 5, + 6, + 13, + 12, + 1, + 1, + 13, + 3, + 0, + 1, + 3, + 6, + 5, + 6, + 2, + 9, + 7, + 2, + 8, + 11, + 8, + 9, + 14, + 9, + 0, + 4, + 0, + 0, + 13, + 14, + 3, + 10, + 5, + 0, + 1, + 1, + 5, + 14, + 3, + 3, + 12, + 4, + 0, + 0, + 10, + 4, + 0 + ], + "weighted_loads": [ + 0.3218489168211818, + 0.2825039364397526, + 0.12846612930297852, + 0.266840148717165, + 0.2015940025448799, + 0.12188501516357064, + 0.9526236969977617, + 0.2539065908640623, + 0.5765258297324181, + 0.4899277426302433, + 0.15495482087135315, + 0.21833456680178642, + 0.010172571986913681, + 0.4154016375541687, + 0.1110282875597477, + 0.0, + 0.07422880502417684, + 0.18950235284864902, + 0.3517313487827778, + 1.1117194183170795, + 0.6336797401309013, + 0.04093319922685623, + 0.01863253302872181, + 1.7130256108939648, + 0.101881492882967, + 0.0, + 0.04635651782155037, + 0.1795700378715992, + 0.33905384317040443, + 0.272899504750967, + 0.21854940988123417, + 0.05057091824710369, + 0.4210377521812916, + 0.43818933703005314, + 0.05767652206122875, + 0.678651038557291, + 0.809253504499793, + 0.26374365761876106, + 0.7379256775602698, + 0.6144319269806147, + 0.34732114523649216, + 0.0, + 0.11470889300107956, + 0.0, + 0.0, + 1.5250699259340763, + 1.1238978616893291, + 0.12028479296714067, + 0.8244296908378601, + 0.26280877739191055, + 0.0, + 0.09073854982852936, + 0.06756676733493805, + 0.23407677933573723, + 1.0956831574440002, + 0.1958293728530407, + 0.1998204067349434, + 1.0789045505225658, + 0.181417103856802, + 0.0, + 0.0, + 0.8050468545407057, + 0.12410919554531574, + 0.0 + ], + "unique_experts": 55, + "load_cv": 0.783479554260483, + "normalized_load_entropy": 0.9152481561498416, + "max_load_share": 0.03954802259887006 + } + }, + "s1_period": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "7651e4c30ce1983539ccf731855dd723686c5341bfbe7adea96b28440596254e", + "route_weight_sha256": "ad93a8ead6930f15a84c752ab9c33b2e2646cbdda3a72928b3dc1d1786df4fb9", + "loads": [ + 2, + 2, + 2, + 0, + 1, + 1, + 5, + 1, + 6, + 3, + 4, + 5, + 0, + 4, + 2, + 0, + 0, + 6, + 6, + 14, + 13, + 1, + 0, + 3, + 0, + 0, + 0, + 3, + 5, + 5, + 7, + 2, + 6, + 3, + 1, + 8, + 10, + 8, + 3, + 11, + 1, + 0, + 2, + 0, + 0, + 7, + 1, + 0, + 8, + 4, + 0, + 0, + 1, + 3, + 3, + 3, + 3, + 0, + 3, + 1, + 0, + 10, + 1, + 0 + ], + "weighted_loads": [ + 0.11660034582018852, + 0.11513106897473335, + 0.08648068830370903, + 0.0, + 0.04262350872159004, + 0.02552475780248642, + 0.3332075700163841, + 0.028381096199154854, + 0.4615049175918102, + 0.1560850664973259, + 0.18547235429286957, + 0.2180821169167757, + 0.0, + 0.20038264244794846, + 0.08273093029856682, + 0.0, + 0.0, + 0.2351608332246542, + 0.3418113812804222, + 1.1319598518311977, + 0.7185106128454208, + 0.03660131245851517, + 0.0, + 0.3281761631369591, + 0.0, + 0.0, + 0.0, + 0.18435531854629517, + 0.2783157005906105, + 0.25372117571532726, + 0.27475566416978836, + 0.055393822491168976, + 0.2873387783765793, + 0.08898319490253925, + 0.03399072587490082, + 0.661554791033268, + 0.7217872701585293, + 0.2609233856201172, + 0.262388713657856, + 0.5579409878700972, + 0.03833623230457306, + 0.0, + 0.061632877215743065, + 0.0, + 0.0, + 0.37219380773603916, + 0.04382909834384918, + 0.0, + 0.6871776729822159, + 0.20030785351991653, + 0.0, + 0.0, + 0.0713668242096901, + 0.1313176155090332, + 0.1407928429543972, + 0.20038313046097755, + 0.18373916298151016, + 0.0, + 0.1121920682489872, + 0.025976069271564484, + 0.0, + 0.8086585439741611, + 0.02515394054353237, + 0.0 + ], + "unique_experts": 47, + "load_cv": 1.0680426534428489, + "normalized_load_entropy": 0.8626995661513815, + "max_load_share": 0.06862745098039216 + }, + "full_input": { + "tokens": 75, + "top_k": 6, + "decisions": 450, + "ordered_route_sha256": "713ae0f46fd74819d5d27629cf9979bcd71675367fa96b050adc09e6c24b5f26", + "route_weight_sha256": "fa76ca16788fd79fa108c9b5f52a678b6c4ffcab41c1ba3d36a9b2a637a88b4b", + "loads": [ + 7, + 7, + 9, + 8, + 5, + 3, + 19, + 9, + 8, + 8, + 6, + 5, + 1, + 8, + 3, + 3, + 7, + 7, + 8, + 14, + 14, + 1, + 1, + 17, + 3, + 0, + 1, + 3, + 5, + 7, + 7, + 2, + 8, + 14, + 1, + 8, + 16, + 9, + 12, + 11, + 8, + 0, + 4, + 0, + 2, + 15, + 20, + 4, + 15, + 8, + 0, + 10, + 7, + 5, + 15, + 5, + 3, + 16, + 6, + 1, + 2, + 11, + 7, + 1 + ], + "weighted_loads": [ + 0.4196504531428218, + 0.4280221424996853, + 0.4412112347781658, + 0.4998397994786501, + 0.17423528246581554, + 0.06953398557379842, + 1.2279695011675358, + 0.32098847813904285, + 0.5795152857899666, + 0.3285242132842541, + 0.2768886536359787, + 0.2180821169167757, + 0.010235452093183994, + 0.3759063705801964, + 0.17883318290114403, + 0.12105459719896317, + 0.18050115508958697, + 0.2935896869748831, + 0.4307336136698723, + 1.1319598518311977, + 0.7656324729323387, + 0.03660131245851517, + 0.018400786444544792, + 2.3241953290998936, + 0.1298773605376482, + 0.0, + 0.03700348734855652, + 0.18435531854629517, + 0.2783157005906105, + 0.3592768181115389, + 0.27475566416978836, + 0.055393822491168976, + 0.3818623870611191, + 0.8716018237173557, + 0.03399072587490082, + 0.661554791033268, + 1.1522551104426384, + 0.3084428645670414, + 0.9632668159902096, + 0.5579409878700972, + 0.30034452490508556, + 0.0, + 0.11608391627669334, + 0.0, + 0.10261036083102226, + 1.5535892564803362, + 1.8128884956240654, + 0.2681543128564954, + 1.028611309826374, + 0.4018147774040699, + 0.0, + 0.6170322690159082, + 0.7158944122493267, + 0.2027403600513935, + 1.2290514335036278, + 0.2634013704955578, + 0.18373916298151016, + 1.5942169204354286, + 0.27331672981381416, + 0.025976069271564484, + 0.07520119473338127, + 0.9349789507687092, + 0.2599832322448492, + 0.038915932178497314 + ], + "unique_experts": 60, + "load_cv": 0.7243080989621904, + "normalized_load_entropy": 0.9315197203440363, + "max_load_share": 0.044444444444444446 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 34, + "ordered_topk_exact_tokens": 20, + "set_exact_tokens": 24, + "mean_set_jaccard": 0.9159663865546218, + "mean_token_weighted_tv": 0.016621316043550476, + "aggregate_load_tv": 0.04901960784313726 + }, + "system_bos": { + "tokens": 34, + "ordered_topk_exact_tokens": 20, + "set_exact_tokens": 24, + "mean_set_jaccard": 0.9159663865546219, + "mean_token_weighted_tv": 0.017685132950325224, + "aggregate_load_tv": 0.04411764705882354 + }, + "system_x": { + "tokens": 34, + "ordered_topk_exact_tokens": 20, + "set_exact_tokens": 20, + "mean_set_jaccard": 0.8697478991596639, + "mean_token_weighted_tv": 0.024173038052942825, + "aggregate_load_tv": 0.05392156862745099 + }, + "system_period": { + "tokens": 34, + "ordered_topk_exact_tokens": 16, + "set_exact_tokens": 18, + "mean_set_jaccard": 0.865546218487395, + "mean_token_weighted_tv": 0.025666965226478437, + "aggregate_load_tv": 0.05392156862745098 + }, + "bos_at_s0": { + "tokens": 34, + "ordered_topk_exact_tokens": 20, + "set_exact_tokens": 24, + "mean_set_jaccard": 0.9159663865546219, + "mean_token_weighted_tv": 0.01691730586154496, + "aggregate_load_tv": 0.0392156862745098 + }, + "bos_at_s1": { + "tokens": 34, + "ordered_topk_exact_tokens": 20, + "set_exact_tokens": 23, + "mean_set_jaccard": 0.9012605042016808, + "mean_token_weighted_tv": 0.02056913053178612, + "aggregate_load_tv": 0.05392156862745098 + }, + "x_at_s0": { + "tokens": 34, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 21, + "mean_set_jaccard": 0.884453781512605, + "mean_token_weighted_tv": 0.021210219053661123, + "aggregate_load_tv": 0.04901960784313727 + }, + "x_at_s1": { + "tokens": 34, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 18, + "mean_set_jaccard": 0.865546218487395, + "mean_token_weighted_tv": 0.02660184824729667, + "aggregate_load_tv": 0.05882352941176472 + }, + "period_at_s0": { + "tokens": 34, + "ordered_topk_exact_tokens": 17, + "set_exact_tokens": 23, + "mean_set_jaccard": 0.9012605042016808, + "mean_token_weighted_tv": 0.01857425080721869, + "aggregate_load_tv": 0.044117647058823525 + }, + "period_at_s1": { + "tokens": 34, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 18, + "mean_set_jaccard": 0.8592436974789917, + "mean_token_weighted_tv": 0.028099158422692734, + "aggregate_load_tv": 0.05882352941176472 + } + } + }, + "layer_24": { + "layer": 24, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "06c49a1abc0075c889080491b4bb63cfd541090ca4823ed5cde24cc1dba0b517", + "route_weight_sha256": "a878794c80a418f09a7a227c84b65f3fb4ae338441258953b3ca4aa0278bc1b6", + "loads": [ + 5, + 0, + 1, + 5, + 0, + 9, + 3, + 0, + 1, + 7, + 2, + 1, + 3, + 7, + 4, + 2, + 0, + 4, + 2, + 5, + 10, + 8, + 1, + 10, + 1, + 0, + 8, + 0, + 6, + 5, + 9, + 0, + 1, + 8, + 1, + 5, + 0, + 2, + 2, + 0, + 3, + 0, + 3, + 0, + 5, + 3, + 0, + 0, + 0, + 9, + 1, + 5, + 2, + 1, + 1, + 5, + 2, + 0, + 5, + 3, + 8, + 0, + 2, + 8 + ], + "weighted_loads": [ + 0.19628024101257324, + 0.0, + 0.03188202902674675, + 0.19675135612487793, + 0.0, + 0.83284517750144, + 0.1289466843008995, + 0.0, + 0.07531019300222397, + 0.3323584273457527, + 0.08980529755353928, + 0.045416172593832016, + 0.09580772742629051, + 0.3148644920438528, + 0.21709874086081982, + 0.0628427267074585, + 0.0, + 0.18624907732009888, + 0.07498953118920326, + 0.17194560170173645, + 0.9535535555332899, + 0.31115912459790707, + 0.04462701082229614, + 0.8263958506286144, + 0.02432805299758911, + 0.0, + 0.3840823210775852, + 0.0, + 0.18863409385085106, + 0.24712789244949818, + 0.4807508513331413, + 0.0, + 0.031793441623449326, + 0.4914323054254055, + 0.03744260221719742, + 0.3385935090482235, + 0.0, + 0.08605800196528435, + 0.07945712842047215, + 0.0, + 0.3198425844311714, + 0.0, + 0.15864719077944756, + 0.0, + 0.2432318478822708, + 0.126261031255126, + 0.0, + 0.0, + 0.0, + 0.6257472187280655, + 0.057415664196014404, + 0.37708431109786034, + 0.0515816044062376, + 0.07699963450431824, + 0.027704818174242973, + 0.2626199293881655, + 0.07412596046924591, + 0.0, + 0.36326535791158676, + 0.08975282125174999, + 0.3862685225903988, + 0.0, + 0.1090744212269783, + 0.36121512204408646 + ], + "unique_experts": 48, + "load_cv": 0.9603840702947809, + "normalized_load_entropy": 0.876894934337786, + "max_load_share": 0.049019607843137254 + }, + "full_input": { + "tokens": 59, + "top_k": 6, + "decisions": 354, + "ordered_route_sha256": "fea12e4ec29639d7393821c214296dc3d086b57bd2e2dda14d7b08dcdfbbe751", + "route_weight_sha256": "a82b0e00d2ec516d719ea3557f2d57420772afb4a481c95a1438933245ec94eb", + "loads": [ + 5, + 0, + 4, + 5, + 0, + 15, + 3, + 1, + 9, + 7, + 11, + 1, + 4, + 7, + 7, + 2, + 1, + 4, + 2, + 5, + 12, + 8, + 7, + 10, + 9, + 0, + 8, + 0, + 14, + 11, + 9, + 3, + 2, + 12, + 6, + 6, + 1, + 4, + 3, + 0, + 3, + 2, + 7, + 1, + 5, + 6, + 0, + 5, + 0, + 10, + 6, + 11, + 5, + 4, + 1, + 5, + 2, + 0, + 12, + 4, + 12, + 17, + 6, + 12 + ], + "weighted_loads": [ + 0.19628024101257324, + 0.0, + 0.12734919786453247, + 0.19675135612487793, + 0.0, + 1.0967467478476465, + 0.1289466843008995, + 0.058506764471530914, + 0.43944918643683195, + 0.3323584273457527, + 0.42714501544833183, + 0.045416172593832016, + 0.09854810475371778, + 0.3148644920438528, + 0.31284976191818714, + 0.0628427267074585, + 0.04019973427057266, + 0.18624907732009888, + 0.07498953118920326, + 0.17194560170173645, + 1.0202457699924707, + 0.31115912459790707, + 0.6006793789565563, + 0.8263958506286144, + 0.32716895663179457, + 0.0, + 0.3840823210775852, + 0.0, + 0.5035038366913795, + 0.5128152351826429, + 0.4807508513331413, + 0.113488107919693, + 0.060115378350019455, + 0.6717923153191805, + 0.1830829307436943, + 0.38170548528432846, + 0.09743402153253555, + 0.9762703198939562, + 0.12098359502851963, + 0.0, + 0.3198425844311714, + 0.12240075320005417, + 0.2684708188753575, + 0.15416817367076874, + 0.2432318478822708, + 0.37550739012658596, + 0.0, + 0.36402962531428784, + 0.0, + 0.6698221452534199, + 0.24220963567495346, + 0.8437121957540512, + 0.1360443588346243, + 0.22088997066020966, + 0.027704818174242973, + 0.2626199293881655, + 0.07412596046924591, + 0.0, + 0.5720820992719382, + 0.13095362298190594, + 0.5818504430353642, + 1.4072480108588934, + 0.1946201390819624, + 2.3766237311065197 + ], + "unique_experts": 56, + "load_cv": 0.7709949887558597, + "normalized_load_entropy": 0.9193786758789261, + "max_load_share": 0.0480225988700565 + } + }, + "s1_eos": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "21f60298f44ff98bcdd42e0c9fe0bf885cd429da551d7efc825c6a34bad47fc9", + "route_weight_sha256": "a0e13baf05649c51fc26ece358feeb7f26f00394e99b163c250804b43ff5fa50", + "loads": [ + 5, + 1, + 2, + 5, + 0, + 9, + 3, + 0, + 1, + 7, + 2, + 1, + 3, + 6, + 4, + 3, + 0, + 4, + 1, + 7, + 11, + 7, + 1, + 10, + 1, + 0, + 8, + 1, + 6, + 6, + 9, + 0, + 1, + 7, + 1, + 5, + 0, + 2, + 2, + 1, + 3, + 0, + 3, + 0, + 4, + 3, + 0, + 0, + 0, + 8, + 1, + 5, + 1, + 1, + 1, + 5, + 1, + 0, + 5, + 2, + 8, + 0, + 2, + 8 + ], + "weighted_loads": [ + 0.1988394372165203, + 0.03113919496536255, + 0.056892042979598045, + 0.19951157830655575, + 0.0, + 0.8334806114435196, + 0.13051017373800278, + 0.0, + 0.0773123949766159, + 0.3255057521164417, + 0.08927245438098907, + 0.04447883740067482, + 0.09750203043222427, + 0.28132989071309566, + 0.2140484433621168, + 0.1027069017291069, + 0.0, + 0.19768955372273922, + 0.03282769024372101, + 0.23013481311500072, + 0.9819285478442907, + 0.28230245411396027, + 0.047402698546648026, + 0.8075704202055931, + 0.024991847574710846, + 0.0, + 0.3913859352469444, + 0.02769319713115692, + 0.1955058015882969, + 0.26352312602102757, + 0.4765522200614214, + 0.0, + 0.03765794262290001, + 0.4720775671303272, + 0.040275976061820984, + 0.33569588884711266, + 0.0, + 0.09058332070708275, + 0.07692615129053593, + 0.02912648767232895, + 0.31887340545654297, + 0.0, + 0.15326059982180595, + 0.0, + 0.18856824189424515, + 0.1239510290324688, + 0.0, + 0.0, + 0.0, + 0.5718606822192669, + 0.07678971439599991, + 0.3480667360126972, + 0.024745848029851913, + 0.07766062021255493, + 0.027698563411831856, + 0.25926525332033634, + 0.05006880685687065, + 0.0, + 0.3614054024219513, + 0.0652475468814373, + 0.38534171879291534, + 0.0, + 0.10965020209550858, + 0.3679461032152176 + ], + "unique_experts": 51, + "load_cv": 0.9474870139882015, + "normalized_load_entropy": 0.8835953106961961, + "max_load_share": 0.05392156862745098 + }, + "full_input": { + "tokens": 75, + "top_k": 6, + "decisions": 450, + "ordered_route_sha256": "86024cc24657962832e69157793ae09fbb35d931eddf094d1477dda53d83da02", + "route_weight_sha256": "b19270102a16f6f104e6a1172841fb9d161338d748ebdaada80b97ff338d9e9b", + "loads": [ + 5, + 1, + 3, + 6, + 2, + 18, + 3, + 1, + 10, + 10, + 9, + 3, + 6, + 6, + 6, + 3, + 0, + 4, + 2, + 9, + 17, + 7, + 12, + 11, + 10, + 0, + 8, + 1, + 27, + 12, + 9, + 4, + 1, + 13, + 6, + 8, + 7, + 5, + 3, + 1, + 4, + 8, + 8, + 3, + 6, + 5, + 0, + 10, + 0, + 9, + 6, + 19, + 7, + 5, + 4, + 7, + 1, + 1, + 18, + 3, + 14, + 19, + 10, + 14 + ], + "weighted_loads": [ + 0.1988394372165203, + 0.03113919496536255, + 0.08260552026331425, + 0.31133696995675564, + 0.059451526030898094, + 1.1810032813809812, + 0.13051017373800278, + 0.03724854066967964, + 0.6705174902454019, + 0.45570334047079086, + 0.38152622152119875, + 0.11067182198166847, + 0.15856043505482376, + 0.28132989071309566, + 0.287457475438714, + 0.1027069017291069, + 0.0, + 0.19768955372273922, + 0.06448230519890785, + 0.287355650216341, + 1.2314598020166159, + 0.28230245411396027, + 0.9306650254875422, + 0.8330304082483053, + 0.344989305594936, + 0.0, + 0.3913859352469444, + 0.02769319713115692, + 1.2141249421983957, + 0.5504408329725266, + 0.4765522200614214, + 0.1750151626765728, + 0.03765794262290001, + 0.7756095472723246, + 0.20106865698471665, + 0.4674835614860058, + 0.5168403834104538, + 1.0314364358782768, + 0.12603372149169445, + 0.02912648767232895, + 0.43208226561546326, + 0.4899079445749521, + 0.30840520560741425, + 0.35927123948931694, + 0.28014055266976357, + 0.3327387496829033, + 0.0, + 0.6576277886051685, + 0.0, + 0.6157650351524353, + 0.27099356800317764, + 1.369296744465828, + 0.2003300040960312, + 0.36423519253730774, + 0.2347591407597065, + 0.35549172945320606, + 0.05006880685687065, + 0.039832524955272675, + 0.8850482521229424, + 0.1078520156443119, + 0.630150081589818, + 1.9950568918138742, + 0.503136487910524, + 2.4699493385851383 + ], + "unique_experts": 60, + "load_cv": 0.7878459459614559, + "normalized_load_entropy": 0.9255106724416179, + "max_load_share": 0.06 + } + }, + "s0_bos": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "e5eee6b1c23a274fedd90d607f6591d37743aec94d7c6cc3eda3133ee9594c1e", + "route_weight_sha256": "7245e97639d15a7d925eabb33230b4c4b3fba1177bc5f70ad2938be7fae455a2", + "loads": [ + 5, + 1, + 2, + 5, + 0, + 9, + 3, + 0, + 1, + 7, + 2, + 1, + 3, + 6, + 4, + 1, + 0, + 4, + 2, + 6, + 12, + 8, + 1, + 10, + 1, + 0, + 8, + 0, + 6, + 6, + 9, + 0, + 0, + 7, + 0, + 4, + 0, + 2, + 2, + 1, + 3, + 0, + 3, + 0, + 5, + 2, + 0, + 0, + 0, + 9, + 1, + 5, + 2, + 1, + 2, + 5, + 2, + 0, + 5, + 3, + 8, + 0, + 2, + 7 + ], + "weighted_loads": [ + 0.20492727309465408, + 0.039134372025728226, + 0.05917078256607056, + 0.20208997651934624, + 0.0, + 0.827879399061203, + 0.14527859166264534, + 0.0, + 0.07484500855207443, + 0.3284216895699501, + 0.0932617075741291, + 0.045707933604717255, + 0.09925215318799019, + 0.290787722915411, + 0.22960539162158966, + 0.032724011689424515, + 0.0, + 0.19462638720870018, + 0.07396211102604866, + 0.20493516698479652, + 1.0701841972768307, + 0.30944677256047726, + 0.04561833664774895, + 0.8248578868806362, + 0.024907846003770828, + 0.0, + 0.38009949401021004, + 0.0, + 0.19578293524682522, + 0.2738331984728575, + 0.47956178337335587, + 0.0, + 0.0, + 0.46299586817622185, + 0.0, + 0.2910872995853424, + 0.0, + 0.0886961929500103, + 0.07944070920348167, + 0.029348187148571014, + 0.32040709257125854, + 0.0, + 0.16044114157557487, + 0.0, + 0.24368017725646496, + 0.09536910802125931, + 0.0, + 0.0, + 0.0, + 0.6223993375897408, + 0.0574328750371933, + 0.3730868548154831, + 0.0510464571416378, + 0.07427215576171875, + 0.054582640528678894, + 0.26942550763487816, + 0.07901482284069061, + 0.0, + 0.3789913207292557, + 0.08955947123467922, + 0.37788594141602516, + 0.0, + 0.11363383755087852, + 0.3237138334661722 + ], + "unique_experts": 48, + "load_cv": 0.9699443298848343, + "normalized_load_entropy": 0.8765703676697382, + "max_load_share": 0.058823529411764705 + }, + "full_input": { + "tokens": 59, + "top_k": 6, + "decisions": 354, + "ordered_route_sha256": "4e993ddc26527ae907e80376b11da6b8a4119a17d1872ddf8e18243dc57bb895", + "route_weight_sha256": "6d88f21a22f622a0f9de631b95ccdac64d434ff47ed707f8f427af8a62722522", + "loads": [ + 5, + 1, + 5, + 5, + 0, + 15, + 4, + 1, + 8, + 7, + 10, + 1, + 4, + 6, + 7, + 1, + 0, + 4, + 2, + 6, + 13, + 8, + 8, + 10, + 10, + 0, + 9, + 1, + 14, + 12, + 10, + 3, + 1, + 11, + 5, + 5, + 1, + 4, + 2, + 1, + 3, + 2, + 8, + 1, + 5, + 5, + 1, + 4, + 0, + 10, + 7, + 11, + 5, + 4, + 2, + 5, + 2, + 0, + 11, + 4, + 12, + 18, + 4, + 10 + ], + "weighted_loads": [ + 0.20492727309465408, + 0.039134372025728226, + 0.15463795140385628, + 0.20208997651934624, + 0.0, + 1.094235499855131, + 0.24815137311816216, + 0.058506764471530914, + 0.4345005638897419, + 0.3284216895699501, + 0.4171645790338516, + 0.045707933604717255, + 0.10199253051541746, + 0.290787722915411, + 0.32564664259552956, + 0.032724011689424515, + 0.0, + 0.19462638720870018, + 0.07396211102604866, + 0.20493516698479652, + 1.1030746139585972, + 0.30944677256047726, + 0.7290730178356171, + 0.8248578868806362, + 0.35295076691545546, + 0.0, + 0.7693174071609974, + 0.04383370280265808, + 0.5021097008138895, + 0.5416891667991877, + 0.5225679650902748, + 0.09408887848258018, + 0.02832193672657013, + 0.6433558780699968, + 0.13584638014435768, + 0.32665111124515533, + 0.09743402153253555, + 0.9805474411696196, + 0.07944070920348167, + 0.029348187148571014, + 0.32040709257125854, + 0.1329318806529045, + 0.364762521116063, + 0.14966578781604767, + 0.24368017725646496, + 0.3562784902751446, + 0.0573786199092865, + 0.3545583402737975, + 0.0, + 0.6714243702590466, + 0.3192629925906658, + 0.8094206303358078, + 0.1355092115700245, + 0.21816249191761017, + 0.054582640528678894, + 0.26942550763487816, + 0.07901482284069061, + 0.0, + 0.5870115179568529, + 0.13637096993625164, + 0.5642013549804688, + 1.463429981842637, + 0.16630620043724775, + 1.368904210627079 + ], + "unique_experts": 59, + "load_cv": 0.7709949887558597, + "normalized_load_entropy": 0.9229970686158042, + "max_load_share": 0.05084745762711865 + } + }, + "s1_bos": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "bbedba4d69ca17115020e753ea4a4a16457b4ddde48dd521221f207f756d97cf", + "route_weight_sha256": "63940d16517c41fcd4c70a7ed9834dff5ab728e9e13cb43f484195d81ce01943", + "loads": [ + 5, + 2, + 2, + 5, + 0, + 9, + 3, + 0, + 1, + 7, + 3, + 1, + 3, + 6, + 4, + 2, + 0, + 4, + 1, + 7, + 12, + 8, + 0, + 10, + 1, + 0, + 7, + 0, + 6, + 5, + 8, + 0, + 0, + 7, + 0, + 4, + 0, + 2, + 2, + 1, + 3, + 0, + 3, + 0, + 6, + 3, + 0, + 0, + 0, + 8, + 1, + 5, + 2, + 1, + 1, + 5, + 2, + 0, + 6, + 3, + 8, + 0, + 2, + 7 + ], + "weighted_loads": [ + 0.20254086330533028, + 0.06307644955813885, + 0.05929194949567318, + 0.20246770419180393, + 0.0, + 0.8258491158485413, + 0.1442139558494091, + 0.0, + 0.07960641384124756, + 0.3250507153570652, + 0.1267784982919693, + 0.04845290631055832, + 0.09790270030498505, + 0.28272900730371475, + 0.21895372867584229, + 0.06897009536623955, + 0.0, + 0.20574862696230412, + 0.03489689901471138, + 0.24905366078019142, + 1.0094274412840605, + 0.3171464465558529, + 0.0, + 0.7894369959831238, + 0.025642767548561096, + 0.0, + 0.34257278963923454, + 0.0, + 0.19099020026624203, + 0.2494309153407812, + 0.4545760191977024, + 0.0, + 0.0, + 0.46430854871869087, + 0.0, + 0.2754319794476032, + 0.0, + 0.08781521022319794, + 0.07869675569236279, + 0.030605854466557503, + 0.31614216417074203, + 0.0, + 0.15682275593280792, + 0.0, + 0.27320246770977974, + 0.12362664565443993, + 0.0, + 0.0, + 0.0, + 0.5807911865413189, + 0.06322415173053741, + 0.3308285903185606, + 0.05147159844636917, + 0.07986308634281158, + 0.02739313244819641, + 0.25886544585227966, + 0.07716956734657288, + 0.0, + 0.40599729865789413, + 0.09063427895307541, + 0.37683863937854767, + 0.0, + 0.10424518585205078, + 0.34304325841367245 + ], + "unique_experts": 47, + "load_cv": 0.9571760978399155, + "normalized_load_entropy": 0.8764523501756738, + "max_load_share": 0.058823529411764705 + }, + "full_input": { + "tokens": 75, + "top_k": 6, + "decisions": 450, + "ordered_route_sha256": "b78c8138f19034e9fcba2d8329495e558b6d25e253ed577a44cc5396e0da86cc", + "route_weight_sha256": "31d0e7d3dc6db9ea3740a9292b5efdd5043c0c040cd20af0710491cd0cd11bde", + "loads": [ + 5, + 2, + 5, + 6, + 2, + 19, + 3, + 1, + 9, + 10, + 9, + 3, + 6, + 6, + 6, + 2, + 0, + 4, + 2, + 10, + 18, + 8, + 12, + 11, + 10, + 0, + 7, + 0, + 27, + 11, + 8, + 4, + 0, + 13, + 6, + 7, + 7, + 5, + 3, + 1, + 4, + 8, + 8, + 4, + 7, + 6, + 0, + 8, + 0, + 9, + 7, + 19, + 8, + 5, + 4, + 7, + 2, + 0, + 18, + 4, + 14, + 20, + 9, + 11 + ], + "weighted_loads": [ + 0.20254086330533028, + 0.06307644955813885, + 0.1502578854560852, + 0.3142930958420038, + 0.059451526030898094, + 1.216066790279001, + 0.1442139558494091, + 0.03724854066967964, + 0.6684340462088585, + 0.45524830371141434, + 0.4059062749147415, + 0.11464589089155197, + 0.15896110492758453, + 0.28272900730371475, + 0.29460451006889343, + 0.06897009536623955, + 0.0, + 0.20574862696230412, + 0.06655151396989822, + 0.3378079514950514, + 1.2589586954563856, + 0.3171464465558529, + 0.9469169024378061, + 0.814896984025836, + 0.34564022556878626, + 0.0, + 0.34257278963923454, + 0.0, + 1.2053628750145435, + 0.5410100556910038, + 0.4545760191977024, + 0.1745273470878601, + 0.0, + 0.7678405288606882, + 0.2008968242444098, + 0.4120342507958412, + 0.5168403834104538, + 1.0269577279686928, + 0.12211303599178791, + 0.030605854466557503, + 0.4293510243296623, + 0.4901832062751055, + 0.40007007867097855, + 0.4242504797875881, + 0.31262313947081566, + 0.36634349822998047, + 0.0, + 0.6274195881560445, + 0.0, + 0.62926921620965, + 0.36571918055415154, + 1.314455596730113, + 0.22705575451254845, + 0.3664376586675644, + 0.23445370979607105, + 0.3550919219851494, + 0.07716956734657288, + 0.0, + 0.9288736768066883, + 0.1402542181313038, + 0.6137538906186819, + 2.0580857899039984, + 0.4938436830416322, + 1.4291755687445402 + ], + "unique_experts": 57, + "load_cv": 0.7890484971560351, + "normalized_load_entropy": 0.9236322456686069, + "max_load_share": 0.06 + } + }, + "s0_x": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "4ca9d074f3bf6c3ddfd841e75fcfd761d7b6fab091c910fcd681096bcabe8eb6", + "route_weight_sha256": "7f302dbf96933c854fa265ffadd8c470c75807347d7215df69035995d2cbdcfc", + "loads": [ + 5, + 1, + 1, + 5, + 0, + 9, + 3, + 0, + 1, + 7, + 2, + 1, + 3, + 7, + 4, + 3, + 0, + 3, + 1, + 5, + 11, + 8, + 1, + 10, + 1, + 0, + 7, + 0, + 7, + 6, + 9, + 0, + 1, + 7, + 0, + 4, + 0, + 2, + 2, + 1, + 3, + 0, + 3, + 0, + 5, + 3, + 0, + 0, + 0, + 8, + 1, + 5, + 3, + 1, + 1, + 5, + 2, + 0, + 5, + 3, + 8, + 0, + 3, + 7 + ], + "weighted_loads": [ + 0.20427504181861877, + 0.035809677094221115, + 0.029817434027791023, + 0.20162030681967735, + 0.0, + 0.8297348581254482, + 0.1405509077012539, + 0.0, + 0.07985812425613403, + 0.3250894136726856, + 0.0892547070980072, + 0.053400106728076935, + 0.10126711055636406, + 0.3127907421439886, + 0.22264459542930126, + 0.1017521321773529, + 0.0, + 0.17010104283690453, + 0.03528851270675659, + 0.17111006006598473, + 1.009707123041153, + 0.3238895069807768, + 0.040520112961530685, + 0.7868511937558651, + 0.024788595736026764, + 0.0, + 0.35471127927303314, + 0.0, + 0.22765586338937283, + 0.2672397345304489, + 0.4789157286286354, + 0.0, + 0.03177971765398979, + 0.44326306506991386, + 0.0, + 0.2920449562370777, + 0.0, + 0.08383308351039886, + 0.07611871883273125, + 0.03092178888618946, + 0.3211407884955406, + 0.0, + 0.15099621564149857, + 0.0, + 0.2416862938553095, + 0.11199936084449291, + 0.0, + 0.0, + 0.0, + 0.6003003269433975, + 0.05543643236160278, + 0.35067683085799217, + 0.07741369120776653, + 0.07814991474151611, + 0.028630349785089493, + 0.24767612293362617, + 0.07403512857854366, + 0.0, + 0.35427949018776417, + 0.08868534676730633, + 0.3794047050178051, + 0.0, + 0.13762629218399525, + 0.33146400563418865 + ], + "unique_experts": 49, + "load_cv": 0.9442352257125103, + "normalized_load_entropy": 0.8812157278667493, + "max_load_share": 0.05392156862745098 + }, + "full_input": { + "tokens": 59, + "top_k": 6, + "decisions": 354, + "ordered_route_sha256": "1bf1e95f305ead18a56d34ed92789faa5221c014a30d8a1d5b6cbbbc5ac6905f", + "route_weight_sha256": "87d95ca7fa7038239118f9399b8f3d88da272a2a2ea89675861601513ae533a2", + "loads": [ + 5, + 1, + 4, + 5, + 0, + 16, + 3, + 1, + 9, + 7, + 11, + 1, + 5, + 7, + 7, + 3, + 0, + 3, + 1, + 5, + 13, + 8, + 6, + 10, + 9, + 0, + 7, + 0, + 16, + 12, + 9, + 3, + 2, + 11, + 7, + 5, + 2, + 4, + 3, + 1, + 3, + 2, + 5, + 1, + 5, + 6, + 0, + 5, + 0, + 9, + 6, + 11, + 7, + 5, + 1, + 5, + 2, + 0, + 12, + 4, + 12, + 17, + 4, + 10 + ], + "weighted_loads": [ + 0.20427504181861877, + 0.035809677094221115, + 0.12528460286557674, + 0.20162030681967735, + 0.0, + 1.146953723859042, + 0.1405509077012539, + 0.058506764471530914, + 0.5222316719591618, + 0.3250894136726856, + 0.46740536019206047, + 0.053400106728076935, + 0.13705964176915586, + 0.3127907421439886, + 0.3193651344627142, + 0.1017521321773529, + 0.0, + 0.17010104283690453, + 0.03528851270675659, + 0.17111006006598473, + 1.081627782434225, + 0.3238895069807768, + 0.45004233717918396, + 0.7868511937558651, + 0.3276294993702322, + 0.0, + 0.35471127927303314, + 0.0, + 0.571810694411397, + 0.5284510143101215, + 0.4789157286286354, + 0.09994585625827312, + 0.06010165438055992, + 0.6236230749636889, + 0.23245688900351524, + 0.3269677460193634, + 0.13925839960575104, + 0.9768564496189356, + 0.11297738552093506, + 0.03092178888618946, + 0.3211407884955406, + 0.13645139336585999, + 0.19112830492667854, + 0.12410087883472443, + 0.2416862938553095, + 0.3427781481295824, + 0.0, + 0.3901829784736037, + 0.0, + 0.6427993923425674, + 0.23625806346535683, + 0.8291589990258217, + 0.18728401698172092, + 0.2700636014342308, + 0.028630349785089493, + 0.24767612293362617, + 0.07403512857854366, + 0.0, + 0.5917233694344759, + 0.13179988227784634, + 0.5841034054756165, + 1.498205652460456, + 0.1393337408080697, + 1.377493379637599 + ], + "unique_experts": 57, + "load_cv": 0.7789032590473471, + "normalized_load_entropy": 0.9204802557461768, + "max_load_share": 0.0480225988700565 + } + }, + "s1_x": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "c7fe133377f5d38a32d5745bc751c0d48c944ec544d0b6c88a594d6e231389f0", + "route_weight_sha256": "e7d7065b259cb389c406567b9c79b0554b0d7cf1ad55afd391ce3dddfc5c2f8d", + "loads": [ + 5, + 1, + 0, + 4, + 1, + 10, + 3, + 1, + 1, + 7, + 2, + 1, + 3, + 7, + 4, + 2, + 0, + 4, + 1, + 7, + 12, + 8, + 0, + 10, + 1, + 0, + 8, + 0, + 6, + 4, + 9, + 0, + 1, + 7, + 0, + 5, + 0, + 2, + 2, + 1, + 3, + 0, + 3, + 0, + 5, + 3, + 0, + 0, + 0, + 8, + 1, + 4, + 3, + 1, + 1, + 4, + 2, + 0, + 5, + 3, + 7, + 1, + 2, + 8 + ], + "weighted_loads": [ + 0.2106042243540287, + 0.038768935948610306, + 0.0, + 0.1517229750752449, + 0.03266015648841858, + 0.8486538697034121, + 0.145467359572649, + 0.03005465865135193, + 0.08024080097675323, + 0.3263170197606087, + 0.08831984177231789, + 0.05486070737242699, + 0.10128631815314293, + 0.3040542546659708, + 0.20332269556820393, + 0.06646833941340446, + 0.0, + 0.2087241020053625, + 0.034255120903253555, + 0.24652260169386864, + 0.9758962579071522, + 0.3210850115865469, + 0.0, + 0.7172087710350752, + 0.024635130539536476, + 0.0, + 0.38357099890708923, + 0.0, + 0.1947981771081686, + 0.20951278693974018, + 0.47014231607317924, + 0.0, + 0.03323860839009285, + 0.4476688653230667, + 0.0, + 0.32288406789302826, + 0.0, + 0.08147323504090309, + 0.07921160198748112, + 0.03063792735338211, + 0.3189583122730255, + 0.0, + 0.1516077257692814, + 0.0, + 0.22049090266227722, + 0.11621630191802979, + 0.0, + 0.0, + 0.0, + 0.5734638534486294, + 0.06960627436637878, + 0.2819182835519314, + 0.07685782760381699, + 0.07762950658798218, + 0.026635652408003807, + 0.2271021343767643, + 0.08075682818889618, + 0.0, + 0.3490784168243408, + 0.0884782113134861, + 0.3491435684263706, + 0.03613618016242981, + 0.10420791804790497, + 0.3732674177736044 + ], + "unique_experts": 50, + "load_cv": 0.9667680812251804, + "normalized_load_entropy": 0.8804717002888633, + "max_load_share": 0.058823529411764705 + }, + "full_input": { + "tokens": 75, + "top_k": 6, + "decisions": 450, + "ordered_route_sha256": "67306d9b56a6f7ed18f565a98eb11dee8ac2fe66c0087c63e31ab3f21bea4349", + "route_weight_sha256": "5744bae008c076a58f04929d4f33cc4db25897ed31bda33c897d567f974a1284", + "loads": [ + 5, + 1, + 1, + 5, + 3, + 20, + 3, + 2, + 10, + 10, + 8, + 3, + 6, + 7, + 6, + 2, + 0, + 4, + 2, + 10, + 21, + 8, + 11, + 11, + 10, + 0, + 8, + 0, + 28, + 10, + 9, + 5, + 1, + 14, + 6, + 8, + 9, + 5, + 2, + 1, + 4, + 8, + 7, + 3, + 6, + 5, + 0, + 8, + 0, + 9, + 5, + 18, + 9, + 6, + 4, + 6, + 2, + 0, + 18, + 3, + 13, + 21, + 8, + 12 + ], + "weighted_loads": [ + 0.2106042243540287, + 0.038768935948610306, + 0.025713477283716202, + 0.2635483667254448, + 0.09211168251931667, + 1.2211601021699607, + 0.145467359572649, + 0.06730319932103157, + 0.7174477502703667, + 0.4565146081149578, + 0.3674476183950901, + 0.12105369195342064, + 0.1623447227757424, + 0.3040542546659708, + 0.27858646400272846, + 0.06646833941340446, + 0.0, + 0.2087241020053625, + 0.0659097358584404, + 0.3425724636763334, + 1.3216604012995958, + 0.3210850115865469, + 0.7808299139142036, + 0.7426687590777874, + 0.34463258855976164, + 0.0, + 0.38357099890708923, + 0.0, + 1.2468687072396278, + 0.49029162153601646, + 0.47014231607317924, + 0.20597153715789318, + 0.03323860839009285, + 0.7902625482529402, + 0.19826364004984498, + 0.4675333946943283, + 0.6399696879088879, + 1.0266093835234642, + 0.07921160198748112, + 0.03063792735338211, + 0.4321671724319458, + 0.48537483997642994, + 0.2737927660346031, + 0.27347880974411964, + 0.25991157442331314, + 0.3121640346944332, + 0.0, + 0.6303000086918473, + 0.0, + 0.6257652677595615, + 0.23532767966389656, + 1.303476970642805, + 0.25244198366999626, + 0.39678746834397316, + 0.23369622975587845, + 0.323328610509634, + 0.08075682818889618, + 0.0, + 0.9184487387537956, + 0.0884782113134861, + 0.5798718351870775, + 2.1109769362956285, + 0.45398029405623674, + 1.4588714931160212 + ], + "unique_experts": 58, + "load_cv": 0.8250761281748191, + "normalized_load_entropy": 0.919266322063653, + "max_load_share": 0.06222222222222222 + } + }, + "s0_period": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "1289308e171e35cf3e1aec20d7d94e87f5e1985b9609c298b758719a0f7fc4b0", + "route_weight_sha256": "09ee07ad1190a76a5024b36ea6647019cd5a16ea835432b5c3ee80bff75e86cd", + "loads": [ + 5, + 1, + 2, + 5, + 0, + 9, + 3, + 0, + 1, + 7, + 2, + 1, + 3, + 7, + 4, + 3, + 0, + 3, + 1, + 5, + 12, + 8, + 1, + 10, + 1, + 0, + 7, + 0, + 7, + 6, + 9, + 0, + 1, + 7, + 0, + 4, + 0, + 2, + 2, + 0, + 3, + 0, + 3, + 0, + 5, + 3, + 0, + 0, + 0, + 8, + 1, + 5, + 3, + 1, + 1, + 5, + 2, + 0, + 5, + 2, + 8, + 0, + 2, + 8 + ], + "weighted_loads": [ + 0.2064795345067978, + 0.03488374873995781, + 0.05764448828995228, + 0.19030676037073135, + 0.0, + 0.8303392864763737, + 0.1475970596075058, + 0.0, + 0.07904691994190216, + 0.3259736895561218, + 0.08946217969059944, + 0.048707231879234314, + 0.09998146817088127, + 0.3112903758883476, + 0.223497049883008, + 0.09539524652063847, + 0.0, + 0.16712422668933868, + 0.03461853042244911, + 0.17025500908493996, + 1.0046476647257805, + 0.3207989577203989, + 0.04344111308455467, + 0.784823440015316, + 0.02493385598063469, + 0.0, + 0.3534189313650131, + 0.0, + 0.22972450405359268, + 0.2654863130301237, + 0.48689669370651245, + 0.0, + 0.031855467706918716, + 0.4530724994838238, + 0.0, + 0.2903835140168667, + 0.0, + 0.08261656016111374, + 0.08018526434898376, + 0.0, + 0.3194747418165207, + 0.0, + 0.1537969410419464, + 0.0, + 0.23833820037543774, + 0.11198920011520386, + 0.0, + 0.0, + 0.0, + 0.5890556164085865, + 0.05916149169206619, + 0.3454115353524685, + 0.07623842358589172, + 0.0778217688202858, + 0.028261829167604446, + 0.24974318034946918, + 0.07601995766162872, + 0.0, + 0.35328073613345623, + 0.0637701191008091, + 0.3757447600364685, + 0.0, + 0.11114765703678131, + 0.3519759252667427 + ], + "unique_experts": 48, + "load_cv": 0.9683575078326075, + "normalized_load_entropy": 0.8764734543823428, + "max_load_share": 0.058823529411764705 + }, + "full_input": { + "tokens": 59, + "top_k": 6, + "decisions": 354, + "ordered_route_sha256": "da864e9826aadb1a67dcbbce63c5ead2838bbc763a72e30c14909b94abf4d7dc", + "route_weight_sha256": "990b6306ae9206d405887f300bea901beb4b6b6856188a8d9fb984a909ab981b", + "loads": [ + 5, + 1, + 5, + 5, + 0, + 15, + 3, + 2, + 8, + 7, + 10, + 1, + 4, + 7, + 8, + 3, + 0, + 3, + 1, + 5, + 14, + 8, + 7, + 10, + 9, + 0, + 7, + 0, + 15, + 12, + 9, + 2, + 2, + 11, + 6, + 4, + 1, + 5, + 2, + 0, + 3, + 3, + 7, + 2, + 5, + 5, + 0, + 5, + 0, + 9, + 7, + 12, + 7, + 4, + 1, + 5, + 2, + 0, + 11, + 3, + 12, + 18, + 5, + 11 + ], + "weighted_loads": [ + 0.2064795345067978, + 0.03488374873995781, + 0.153111657127738, + 0.19030676037073135, + 0.0, + 1.1059136330150068, + 0.1475970596075058, + 0.09803823754191399, + 0.4387024752795696, + 0.3259736895561218, + 0.41336505115032196, + 0.048707231879234314, + 0.10272184549830854, + 0.3112903758883476, + 0.35325111262500286, + 0.09539524652063847, + 0.0, + 0.16712422668933868, + 0.03461853042244911, + 0.17025500908493996, + 1.0702882781624794, + 0.3207989577203989, + 0.48789414018392563, + 0.784823440015316, + 0.32777475961484015, + 0.0, + 0.3534189313650131, + 0.0, + 0.5347550641745329, + 0.52599404938519, + 0.48689669370651245, + 0.0633398313075304, + 0.060177404433488846, + 0.6334325093775988, + 0.19791560247540474, + 0.2903835140168667, + 0.09743402153253555, + 1.0109394751489162, + 0.08018526434898376, + 0.0, + 0.3194747418165207, + 0.1973358690738678, + 0.2590610038023442, + 0.15176352858543396, + 0.23833820037543774, + 0.3254469744861126, + 0.0, + 0.41110759507864714, + 0.0, + 0.6314026452600956, + 0.33077774941921234, + 0.8873869776725769, + 0.18997887335717678, + 0.22171210497617722, + 0.028261829167604446, + 0.24974318034946918, + 0.07601995766162872, + 0.0, + 0.5613009333610535, + 0.1052379384636879, + 0.5773290134966373, + 1.5514902900904417, + 0.18773607071489096, + 1.398544080555439 + ], + "unique_experts": 56, + "load_cv": 0.783479554260483, + "normalized_load_entropy": 0.9185601231667501, + "max_load_share": 0.05084745762711865 + } + }, + "s1_period": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "0894638ef72d6581314c7efc310e6fffc22dd8c79136354861c3e321e6514ee9", + "route_weight_sha256": "b63ddcbd3477f4d17f2aa10b0010e368822ac678be2d934e54549b35654eac2f", + "loads": [ + 5, + 1, + 2, + 4, + 1, + 9, + 3, + 1, + 1, + 7, + 2, + 1, + 3, + 7, + 4, + 1, + 0, + 3, + 2, + 6, + 12, + 8, + 0, + 10, + 1, + 0, + 8, + 0, + 7, + 4, + 9, + 0, + 1, + 7, + 0, + 5, + 0, + 2, + 2, + 1, + 3, + 0, + 3, + 0, + 5, + 3, + 0, + 1, + 0, + 8, + 1, + 4, + 3, + 1, + 1, + 5, + 2, + 0, + 5, + 2, + 7, + 0, + 3, + 7 + ], + "weighted_loads": [ + 0.21105461940169334, + 0.042814578860998154, + 0.05435100011527538, + 0.1463258694857359, + 0.031280267983675, + 0.8388923779129982, + 0.14237812533974648, + 0.031781286001205444, + 0.08323338627815247, + 0.3215944543480873, + 0.08689549937844276, + 0.05242514982819557, + 0.10124989971518517, + 0.3100563008338213, + 0.210402961820364, + 0.027533331885933876, + 0.0, + 0.17945805191993713, + 0.07187262177467346, + 0.21695391461253166, + 0.9526133947074413, + 0.33380034752190113, + 0.0, + 0.7297773510217667, + 0.024438614025712013, + 0.0, + 0.3854302614927292, + 0.0, + 0.22371497005224228, + 0.20848990604281425, + 0.4815141297876835, + 0.0, + 0.033519890159368515, + 0.44609176740050316, + 0.0, + 0.3136635236442089, + 0.0, + 0.08784977719187737, + 0.07737069576978683, + 0.029084529727697372, + 0.31815335154533386, + 0.0, + 0.1584092266857624, + 0.0, + 0.22330243699252605, + 0.1192781887948513, + 0.0, + 0.033221740275621414, + 0.0, + 0.5740134790539742, + 0.06727548688650131, + 0.27273646369576454, + 0.0767495259642601, + 0.08058732748031616, + 0.026635248214006424, + 0.25734903663396835, + 0.08145966194570065, + 0.0, + 0.3492536395788193, + 0.06435657106339931, + 0.35138973593711853, + 0.0, + 0.14508965238928795, + 0.3351764492690563 + ], + "unique_experts": 51, + "load_cv": 0.9442352257125103, + "normalized_load_entropy": 0.8859242685118119, + "max_load_share": 0.058823529411764705 + }, + "full_input": { + "tokens": 75, + "top_k": 6, + "decisions": 450, + "ordered_route_sha256": "4d37bc028167727eca8d893d3e41aaa98480c33b694834fa059c3c94d376ff86", + "route_weight_sha256": "29498b52d9e4e80a8c220cfa281cdfda244082ee694641bbcfa3a800d3e1ae2d", + "loads": [ + 5, + 1, + 3, + 5, + 3, + 19, + 3, + 3, + 9, + 10, + 8, + 3, + 6, + 7, + 7, + 1, + 0, + 3, + 3, + 8, + 18, + 8, + 10, + 11, + 10, + 0, + 8, + 0, + 29, + 10, + 9, + 4, + 1, + 13, + 6, + 8, + 7, + 6, + 3, + 1, + 4, + 9, + 7, + 4, + 6, + 5, + 0, + 9, + 0, + 9, + 7, + 18, + 9, + 6, + 4, + 7, + 2, + 0, + 19, + 2, + 13, + 20, + 9, + 12 + ], + "weighted_loads": [ + 0.21105461940169334, + 0.042814578860998154, + 0.08006447739899158, + 0.2581512611359358, + 0.0907317940145731, + 1.2232233635149896, + 0.14237812533974648, + 0.10869558155536652, + 0.6720610186457634, + 0.45179204270243645, + 0.366023276001215, + 0.11861813440918922, + 0.16230830433778465, + 0.3100563008338213, + 0.31318242102861404, + 0.027533331885933876, + 0.0, + 0.17945805191993713, + 0.1035272367298603, + 0.27417475171387196, + 1.2021446488797665, + 0.33380034752190113, + 0.724623566493392, + 0.7552373390644789, + 0.3444360720459372, + 0.0, + 0.3854302614927292, + 0.0, + 1.2898287009447813, + 0.4932247418910265, + 0.4815141297876835, + 0.18482141196727753, + 0.033519890159368515, + 0.7496237475425005, + 0.21308818319812417, + 0.44715742766857147, + 0.5168403834104538, + 1.074753526598215, + 0.1158633753657341, + 0.029084529727697372, + 0.43136221170425415, + 0.5115052256733179, + 0.2616156693547964, + 0.311066459864378, + 0.262723108753562, + 0.30533417314291, + 0.0, + 0.6367067145183682, + 0.0, + 0.6264949403703213, + 0.3456503823399544, + 1.3105902709066868, + 0.2523336820304394, + 0.4148215837776661, + 0.23369582556188107, + 0.3535755127668381, + 0.08145966194570065, + 0.0, + 0.9444116838276386, + 0.06435657106339931, + 0.5716876517981291, + 2.063014468178153, + 0.4948620283976197, + 1.4594285152852535 + ], + "unique_experts": 58, + "load_cv": 0.8017634884166432, + "normalized_load_entropy": 0.9233889063585465, + "max_load_share": 0.06444444444444444 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 34, + "ordered_topk_exact_tokens": 20, + "set_exact_tokens": 24, + "mean_set_jaccard": 0.9159663865546218, + "mean_token_weighted_tv": 0.015116245896719834, + "aggregate_load_tv": 0.04411764705882353 + }, + "system_bos": { + "tokens": 34, + "ordered_topk_exact_tokens": 19, + "set_exact_tokens": 24, + "mean_set_jaccard": 0.9159663865546218, + "mean_token_weighted_tv": 0.01695785701603574, + "aggregate_load_tv": 0.03431372549019608 + }, + "system_x": { + "tokens": 34, + "ordered_topk_exact_tokens": 16, + "set_exact_tokens": 22, + "mean_set_jaccard": 0.8991596638655461, + "mean_token_weighted_tv": 0.020997970529338893, + "aggregate_load_tv": 0.053921568627450976 + }, + "system_period": { + "tokens": 34, + "ordered_topk_exact_tokens": 18, + "set_exact_tokens": 22, + "mean_set_jaccard": 0.8991596638655461, + "mean_token_weighted_tv": 0.020565516781061888, + "aggregate_load_tv": 0.044117647058823525 + }, + "bos_at_s0": { + "tokens": 34, + "ordered_topk_exact_tokens": 21, + "set_exact_tokens": 26, + "mean_set_jaccard": 0.9327731092436975, + "mean_token_weighted_tv": 0.013651865397525184, + "aggregate_load_tv": 0.0392156862745098 + }, + "bos_at_s1": { + "tokens": 34, + "ordered_topk_exact_tokens": 17, + "set_exact_tokens": 22, + "mean_set_jaccard": 0.8991596638655462, + "mean_token_weighted_tv": 0.018322159892276806, + "aggregate_load_tv": 0.04901960784313725 + }, + "x_at_s0": { + "tokens": 34, + "ordered_topk_exact_tokens": 18, + "set_exact_tokens": 27, + "mean_set_jaccard": 0.934873949579832, + "mean_token_weighted_tv": 0.014927686986458652, + "aggregate_load_tv": 0.0392156862745098 + }, + "x_at_s1": { + "tokens": 34, + "ordered_topk_exact_tokens": 17, + "set_exact_tokens": 20, + "mean_set_jaccard": 0.8760504201680673, + "mean_token_weighted_tv": 0.023788922411554, + "aggregate_load_tv": 0.0588235294117647 + }, + "period_at_s0": { + "tokens": 34, + "ordered_topk_exact_tokens": 21, + "set_exact_tokens": 27, + "mean_set_jaccard": 0.9348739495798319, + "mean_token_weighted_tv": 0.01480434278902762, + "aggregate_load_tv": 0.0392156862745098 + }, + "period_at_s1": { + "tokens": 34, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 20, + "mean_set_jaccard": 0.8697478991596638, + "mean_token_weighted_tv": 0.025236673680517602, + "aggregate_load_tv": 0.06372549019607843 + } + } + }, + "layer_25": { + "layer": 25, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "5171d36cdfc2fc8a5553d325d8e7fa64e725d70fdaf3684cd5c4f001462d69c8", + "route_weight_sha256": "cf1d24b8669071cd59565c73adad16beaf2e321e2423d396bd5ebeae4d4786c4", + "loads": [ + 9, + 4, + 8, + 4, + 0, + 5, + 2, + 2, + 2, + 1, + 3, + 3, + 3, + 0, + 2, + 2, + 6, + 6, + 10, + 2, + 3, + 1, + 1, + 0, + 2, + 7, + 0, + 0, + 3, + 13, + 0, + 0, + 0, + 1, + 0, + 1, + 4, + 0, + 0, + 3, + 8, + 0, + 5, + 4, + 1, + 1, + 5, + 2, + 2, + 4, + 8, + 7, + 1, + 0, + 2, + 5, + 3, + 1, + 6, + 6, + 3, + 4, + 8, + 5 + ], + "weighted_loads": [ + 0.8127946183085442, + 0.2740435525774956, + 0.268264789134264, + 0.13668441586196423, + 0.0, + 0.28448555432260036, + 0.07553375512361526, + 0.05086236819624901, + 0.08532366901636124, + 0.036678899079561234, + 0.09145301766693592, + 0.09328402578830719, + 0.17558345943689346, + 0.0, + 0.0533047653734684, + 0.06216089054942131, + 0.25078111328184605, + 0.47928643599152565, + 0.6600142847746611, + 0.06691796705126762, + 0.14074797555804253, + 0.025423886254429817, + 0.0302775576710701, + 0.0, + 0.05722595192492008, + 0.7650366183370352, + 0.0, + 0.0, + 0.09988712146878242, + 0.6501426305621862, + 0.0, + 0.0, + 0.0, + 0.04010656848549843, + 0.0, + 0.03651079535484314, + 0.6645555049180984, + 0.0, + 0.0, + 0.8432117253541946, + 0.36420920491218567, + 0.0, + 0.3371196184307337, + 0.1210596114397049, + 0.037070658057928085, + 0.10005819797515869, + 0.16735278628766537, + 0.10879339277744293, + 0.11208472028374672, + 0.12489805370569229, + 0.47059036791324615, + 0.49692511186003685, + 0.11933375149965286, + 0.0, + 0.04782913066446781, + 0.3432266917079687, + 0.11228661611676216, + 0.03568185493350029, + 0.20265142619609833, + 0.2089550942182541, + 0.10434434190392494, + 0.26358083076775074, + 0.6581973619759083, + 0.17738538049161434 + ], + "unique_experts": 51, + "load_cv": 0.9110792278814858, + "normalized_load_entropy": 0.8937018595987669, + "max_load_share": 0.06372549019607843 + }, + "full_input": { + "tokens": 59, + "top_k": 6, + "decisions": 354, + "ordered_route_sha256": "8ac548e3649a1d87f3beae72cb38068c78789b27f3ad01e979b60f1cacc12921", + "route_weight_sha256": "f9f74992489ea324e82651e78d814dfa8294ec2042270e3e6e3a7411d3f2e9ff", + "loads": [ + 12, + 22, + 14, + 6, + 0, + 5, + 9, + 2, + 3, + 1, + 12, + 7, + 6, + 0, + 2, + 2, + 6, + 10, + 10, + 2, + 3, + 1, + 1, + 4, + 2, + 7, + 0, + 0, + 4, + 15, + 0, + 1, + 2, + 2, + 2, + 1, + 4, + 1, + 11, + 6, + 14, + 0, + 5, + 5, + 7, + 11, + 8, + 2, + 2, + 4, + 19, + 7, + 6, + 0, + 11, + 6, + 5, + 3, + 6, + 6, + 6, + 4, + 14, + 5 + ], + "weighted_loads": [ + 0.9903919994831085, + 1.7911578270141035, + 0.6236282214522362, + 0.2611879836767912, + 0.0, + 0.28448555432260036, + 0.576174683868885, + 0.05086236819624901, + 0.13512230664491653, + 0.036678899079561234, + 1.058017896488309, + 0.7668584766797721, + 0.431166710332036, + 0.0, + 0.0533047653734684, + 0.06216089054942131, + 0.25078111328184605, + 0.6090616080909967, + 0.6600142847746611, + 0.06691796705126762, + 0.14074797555804253, + 0.025423886254429817, + 0.0302775576710701, + 0.1802653782069683, + 0.05722595192492008, + 0.7650366183370352, + 0.0, + 0.0, + 0.14184004440903664, + 0.7198657412081957, + 0.0, + 0.0972217246890068, + 0.16746649146080017, + 0.10356686636805534, + 0.09905785694718361, + 0.03651079535484314, + 0.6645555049180984, + 0.03994222730398178, + 1.4651995711028576, + 1.0726521387696266, + 0.6210648715496063, + 0.0, + 0.3371196184307337, + 0.1538497619330883, + 0.4973677396774292, + 1.0054883230477571, + 0.257607156294398, + 0.10879339277744293, + 0.11208472028374672, + 0.12489805370569229, + 1.1301625445485115, + 0.49692511186003685, + 0.39697780506685376, + 0.0, + 0.4983462877571583, + 0.39148164726793766, + 0.23039546236395836, + 0.10623250901699066, + 0.20265142619609833, + 0.2089550942182541, + 0.24086486920714378, + 0.26358083076775074, + 1.1062351502478123, + 0.17738538049161434 + ], + "unique_experts": 57, + "load_cv": 0.8734799476065235, + "normalized_load_entropy": 0.9089110040607764, + "max_load_share": 0.062146892655367235 + } + }, + "s1_eos": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "a9a84af1d23492bdf6c910b0f5f17b55ffd6bf5175630eb575fb9bce5b5d74dc", + "route_weight_sha256": "273ce87f4b643eb1daf90d6957165deb7a6f421819f16b523c94c757094bd8d0", + "loads": [ + 9, + 4, + 10, + 4, + 0, + 5, + 2, + 2, + 2, + 1, + 3, + 3, + 3, + 0, + 2, + 2, + 6, + 6, + 8, + 2, + 3, + 2, + 1, + 0, + 2, + 8, + 0, + 0, + 3, + 13, + 0, + 0, + 0, + 1, + 0, + 1, + 4, + 0, + 1, + 4, + 6, + 0, + 5, + 5, + 1, + 1, + 5, + 2, + 1, + 4, + 8, + 7, + 2, + 0, + 2, + 5, + 3, + 0, + 6, + 6, + 2, + 4, + 8, + 4 + ], + "weighted_loads": [ + 0.7873986084014177, + 0.24345548078417778, + 0.34753890708088875, + 0.14094113744795322, + 0.0, + 0.29269492626190186, + 0.07791798561811447, + 0.05045877583324909, + 0.08172428235411644, + 0.03307072073221207, + 0.09630829468369484, + 0.09732695296406746, + 0.16801762208342552, + 0.0, + 0.056179799139499664, + 0.06392715126276016, + 0.2442699447274208, + 0.4713168479502201, + 0.579039178788662, + 0.0661818515509367, + 0.14116107672452927, + 0.05313095822930336, + 0.029282649978995323, + 0.0, + 0.05469079688191414, + 0.7958798594772816, + 0.0, + 0.0, + 0.10194908827543259, + 0.6629043631255627, + 0.0, + 0.0, + 0.0, + 0.03882686421275139, + 0.0, + 0.03780343011021614, + 0.6483860686421394, + 0.0, + 0.03907136619091034, + 0.8529831226915121, + 0.28811938129365444, + 0.0, + 0.33014425449073315, + 0.149546779692173, + 0.03754489868879318, + 0.10271221399307251, + 0.18002076260745525, + 0.10741225257515907, + 0.07498783618211746, + 0.12789409793913364, + 0.47711270302534103, + 0.488279365003109, + 0.15266333147883415, + 0.0, + 0.04593597166240215, + 0.3275085333734751, + 0.10240766033530235, + 0.0, + 0.2079666703939438, + 0.2098693586885929, + 0.07845236733555794, + 0.26490778662264347, + 0.6551810000091791, + 0.1535838507115841 + ], + "unique_experts": 51, + "load_cv": 0.9043021613804083, + "normalized_load_entropy": 0.8950511116039982, + "max_load_share": 0.06372549019607843 + }, + "full_input": { + "tokens": 75, + "top_k": 6, + "decisions": 450, + "ordered_route_sha256": "c4724cec085940eee52a74186d36281f51326c448ac3c5e4affe215f4d27b27f", + "route_weight_sha256": "5d631593ab350e680fab0949e267029947f7911421539b0293a4f5b50751e6e5", + "loads": [ + 13, + 28, + 19, + 6, + 0, + 6, + 11, + 2, + 5, + 2, + 26, + 8, + 9, + 0, + 2, + 2, + 6, + 14, + 9, + 3, + 6, + 9, + 1, + 6, + 2, + 8, + 1, + 0, + 4, + 16, + 0, + 3, + 6, + 2, + 3, + 1, + 5, + 7, + 10, + 9, + 13, + 0, + 6, + 6, + 11, + 16, + 7, + 2, + 1, + 4, + 21, + 7, + 8, + 6, + 15, + 7, + 6, + 4, + 6, + 7, + 5, + 5, + 13, + 4 + ], + "weighted_loads": [ + 1.1134058851748705, + 2.310868155444041, + 0.8102794159203768, + 0.2855904195457697, + 0.0, + 0.33094606548547745, + 0.7867945767939091, + 0.05045877583324909, + 0.24015584960579872, + 0.06196870654821396, + 2.1501762978732586, + 0.8807184221222997, + 0.6058788727968931, + 0.0, + 0.056179799139499664, + 0.06392715126276016, + 0.2442699447274208, + 1.1208474971354008, + 0.6314185671508312, + 0.090235510841012, + 0.4011070430278778, + 0.6927580963820219, + 0.029282649978995323, + 0.265578743070364, + 0.05469079688191414, + 0.7958798594772816, + 0.03295785188674927, + 0.0, + 0.1492403969168663, + 0.7684296853840351, + 0.0, + 0.4688234105706215, + 0.3356340862810612, + 0.08807788416743279, + 0.1445530578494072, + 0.03780343011021614, + 0.6943678483366966, + 0.30686492659151554, + 1.6909708380699158, + 1.2626647558063269, + 0.6068544816225767, + 0.0, + 0.41788689605891705, + 0.1793396919965744, + 0.7698278315365314, + 1.4821575470268726, + 0.2231104844249785, + 0.10741225257515907, + 0.07498783618211746, + 0.12789409793913364, + 1.2794546093791723, + 0.488279365003109, + 0.5564992614090443, + 0.47206608578562737, + 0.8692679591476917, + 0.40398109145462513, + 0.25547404401004314, + 0.14936211705207825, + 0.2079666703939438, + 0.3007112331688404, + 0.29054897651076317, + 0.3080815989524126, + 1.0829499196261168, + 0.1535838507115841 + ], + "unique_experts": 59, + "load_cv": 0.8451342212050413, + "normalized_load_entropy": 0.9189626487924071, + "max_load_share": 0.06222222222222222 + } + }, + "s0_bos": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "f85d95de92bc8341a5b5ccf33c5db554dd239d8c7e7e913ae8a602117d5e0750", + "route_weight_sha256": "540af009e752c31fe619680a0618bd00e7361c50f2799904fb8ebf289aed289d", + "loads": [ + 10, + 4, + 9, + 4, + 0, + 5, + 1, + 3, + 2, + 1, + 2, + 2, + 3, + 0, + 2, + 2, + 6, + 5, + 9, + 2, + 3, + 2, + 1, + 0, + 2, + 8, + 0, + 0, + 4, + 13, + 0, + 0, + 0, + 2, + 1, + 1, + 4, + 0, + 1, + 3, + 8, + 0, + 5, + 4, + 0, + 1, + 6, + 2, + 1, + 3, + 8, + 7, + 2, + 0, + 2, + 5, + 2, + 0, + 6, + 6, + 3, + 4, + 7, + 5 + ], + "weighted_loads": [ + 0.8468761034309864, + 0.2718338966369629, + 0.3128385040909052, + 0.13380500301718712, + 0.0, + 0.28407085686922073, + 0.03467406705021858, + 0.07724723033607006, + 0.0839516632258892, + 0.03227275609970093, + 0.06194516643881798, + 0.06423167884349823, + 0.17742163129150867, + 0.0, + 0.058109285309910774, + 0.06289197504520416, + 0.25305289402604103, + 0.46180253848433495, + 0.6214091964066029, + 0.0714882779866457, + 0.14936891570687294, + 0.05342541262507439, + 0.030399465933442116, + 0.0, + 0.0587434358894825, + 0.788615919649601, + 0.0, + 0.0, + 0.1317099891602993, + 0.6790233049541712, + 0.0, + 0.0, + 0.0, + 0.0677628293633461, + 0.02287706732749939, + 0.038425859063863754, + 0.6577537693083286, + 0.0, + 0.03761880844831467, + 0.8432234525680542, + 0.3667939528822899, + 0.0, + 0.3367395233362913, + 0.12479494884610176, + 0.0, + 0.10166750848293304, + 0.20135833323001862, + 0.1006113588809967, + 0.08370761573314667, + 0.09629237651824951, + 0.477176908403635, + 0.47587641328573227, + 0.1507117748260498, + 0.0, + 0.04866957105696201, + 0.33994223922491074, + 0.07207721471786499, + 0.0, + 0.20809108018875122, + 0.2061894815415144, + 0.11149599403142929, + 0.2679923977702856, + 0.6266859024763107, + 0.1828048676252365 + ], + "unique_experts": 51, + "load_cv": 0.9194803206034003, + "normalized_load_entropy": 0.8928688939054221, + "max_load_share": 0.06372549019607843 + }, + "full_input": { + "tokens": 59, + "top_k": 6, + "decisions": 354, + "ordered_route_sha256": "8f68881c4ba02afa8c951727875124cb7488af7b612d3570d1223053bd8ab133", + "route_weight_sha256": "4f5d493daa167cf48766b442c0ea86ccd6fdafcdb6a2fc6c0d55c3754223baa7", + "loads": [ + 12, + 22, + 16, + 6, + 0, + 5, + 8, + 4, + 3, + 1, + 12, + 5, + 7, + 0, + 2, + 2, + 6, + 9, + 9, + 2, + 3, + 2, + 1, + 4, + 2, + 8, + 0, + 0, + 5, + 15, + 1, + 1, + 2, + 3, + 3, + 1, + 4, + 0, + 11, + 5, + 14, + 1, + 5, + 6, + 6, + 10, + 8, + 2, + 1, + 4, + 19, + 7, + 6, + 0, + 12, + 6, + 3, + 3, + 6, + 6, + 4, + 4, + 13, + 6 + ], + "weighted_loads": [ + 0.9796288534998894, + 1.7869223135057837, + 0.7788147795945406, + 0.31371041759848595, + 0.0, + 0.28407085686922073, + 0.5175569988787174, + 0.1193715687841177, + 0.12866033986210823, + 0.03227275609970093, + 1.1001674570143223, + 0.7469863593578339, + 0.4615822434425354, + 0.0, + 0.058109285309910774, + 0.06289197504520416, + 0.25305289402604103, + 0.591577710583806, + 0.6214091964066029, + 0.0714882779866457, + 0.14936891570687294, + 0.05342541262507439, + 0.030399465933442116, + 0.17772019281983376, + 0.0587434358894825, + 0.788615919649601, + 0.0, + 0.0, + 0.1736629121005535, + 0.7562864404171705, + 0.3642760217189789, + 0.0972217246890068, + 0.1667444407939911, + 0.13122312724590302, + 0.13748770579695702, + 0.038425859063863754, + 0.6577537693083286, + 0.0, + 0.5928886272013187, + 1.0282035488635302, + 0.6236496195197105, + 0.04125859588384628, + 0.3367395233362913, + 0.1945112720131874, + 0.46853959932923317, + 0.9679598174989223, + 0.290293175727129, + 0.1006113588809967, + 0.08370761573314667, + 0.1397034041583538, + 1.1351187266409397, + 0.47587641328573227, + 0.4241643659770489, + 0.0, + 0.5326586030423641, + 0.39330707117915154, + 0.12777236849069595, + 0.11508216336369514, + 0.20809108018875122, + 0.2061894815415144, + 0.16491370275616646, + 0.2679923977702856, + 1.0747236907482147, + 0.22024916112422943 + ], + "unique_experts": 58, + "load_cv": 0.8670245800774191, + "normalized_load_entropy": 0.9123556506809996, + "max_load_share": 0.062146892655367235 + } + }, + "s1_bos": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "8ffebc60a3444c9143a2e7e99d4d524adc1bbacd151bb7a0953e12f8502ad33d", + "route_weight_sha256": "5329727ae62a8d99011f1b8448eb8fd96c3c8653f4416c12ebf89f3385e65887", + "loads": [ + 10, + 4, + 10, + 4, + 0, + 5, + 2, + 3, + 2, + 1, + 2, + 2, + 3, + 0, + 2, + 3, + 6, + 6, + 8, + 1, + 3, + 2, + 0, + 0, + 2, + 6, + 0, + 0, + 4, + 13, + 0, + 0, + 0, + 1, + 1, + 1, + 4, + 0, + 2, + 4, + 6, + 0, + 5, + 4, + 1, + 1, + 7, + 2, + 1, + 3, + 8, + 7, + 2, + 0, + 2, + 5, + 2, + 0, + 6, + 6, + 4, + 3, + 8, + 4 + ], + "weighted_loads": [ + 0.7926867958158255, + 0.2543450966477394, + 0.3549635596573353, + 0.1367970947176218, + 0.0, + 0.28844408318400383, + 0.07497328519821167, + 0.0762280821800232, + 0.08684493601322174, + 0.02975594811141491, + 0.06454665213823318, + 0.061860864982008934, + 0.15726178884506226, + 0.0, + 0.05709608271718025, + 0.09079287387430668, + 0.23857360891997814, + 0.48955878987908363, + 0.5633560679852962, + 0.04081154242157936, + 0.14623553678393364, + 0.05501828342676163, + 0.0, + 0.0, + 0.054824044927954674, + 0.731226772069931, + 0.0, + 0.0, + 0.13338918425142765, + 0.6818214599043131, + 0.0, + 0.0, + 0.0, + 0.04088452458381653, + 0.024575095623731613, + 0.04014182090759277, + 0.6681690253317356, + 0.0, + 0.06543275155127048, + 0.8405015803873539, + 0.2866975646466017, + 0.0, + 0.31767273135483265, + 0.1276093479245901, + 0.03640316426753998, + 0.10413351655006409, + 0.2333708293735981, + 0.09555678069591522, + 0.07885851711034775, + 0.09506418369710445, + 0.4771450459957123, + 0.47316111624240875, + 0.14876839891076088, + 0.0, + 0.049175769090652466, + 0.32074810564517975, + 0.07257001474499702, + 0.0, + 0.21551129035651684, + 0.20357945561408997, + 0.13684587366878986, + 0.2428714781999588, + 0.658550314605236, + 0.14245209842920303 + ], + "unique_experts": 51, + "load_cv": 0.909389696102371, + "normalized_load_entropy": 0.8945348252921115, + "max_load_share": 0.06372549019607843 + }, + "full_input": { + "tokens": 75, + "top_k": 6, + "decisions": 450, + "ordered_route_sha256": "56a03c9b446b2656199a6a52718a506de6e3dcf3f7d8647a30deb48bd4bec70d", + "route_weight_sha256": "22a94ff186b7d59bacfe064af07af9bac2eddcdc11128f5b13ae069b5e2c8ab0", + "loads": [ + 14, + 29, + 19, + 5, + 0, + 6, + 11, + 3, + 7, + 2, + 26, + 6, + 9, + 0, + 2, + 3, + 6, + 14, + 9, + 2, + 6, + 9, + 0, + 7, + 2, + 6, + 1, + 0, + 5, + 17, + 0, + 3, + 7, + 2, + 4, + 1, + 5, + 6, + 10, + 8, + 13, + 0, + 6, + 5, + 11, + 15, + 8, + 2, + 1, + 4, + 21, + 7, + 7, + 6, + 15, + 7, + 5, + 4, + 6, + 7, + 6, + 4, + 13, + 5 + ], + "weighted_loads": [ + 1.111646631732583, + 2.358492754632607, + 0.8654047157615423, + 0.20303619839251041, + 0.0, + 0.3266952224075794, + 0.7693069614470005, + 0.0762280821800232, + 0.3282754682004452, + 0.0586539339274168, + 2.2073905132710934, + 0.834125192835927, + 0.5712571702897549, + 0.0, + 0.05709608271718025, + 0.09079287387430668, + 0.23857360891997814, + 1.1390894390642643, + 0.6157354563474655, + 0.06486520171165466, + 0.4061815030872822, + 0.6946454215794802, + 0.0, + 0.3122100755572319, + 0.054824044927954674, + 0.731226772069931, + 0.03295785188674927, + 0.0, + 0.18068049289286137, + 0.8333853241056204, + 0.0, + 0.4688234105706215, + 0.39255301281809807, + 0.09013554453849792, + 0.1850680634379387, + 0.04014182090759277, + 0.7141508050262928, + 0.2727291490882635, + 0.8148727808147669, + 1.1988228801637888, + 0.605432664975524, + 0.0, + 0.40541537292301655, + 0.1574022602289915, + 0.7910987213253975, + 1.4295963756740093, + 0.2751411087810993, + 0.09555678069591522, + 0.07885851711034775, + 0.13961779512465, + 1.2807932626456022, + 0.47316111624240875, + 0.5484599955379963, + 0.47206608578562737, + 0.8622305672615767, + 0.39955657348036766, + 0.24006827734410763, + 0.16858845204114914, + 0.21551129035651684, + 0.29442133009433746, + 0.28457274474203587, + 0.28604529052972794, + 1.0863192342221737, + 0.1755794994533062 + ], + "unique_experts": 58, + "load_cv": 0.854062188732309, + "normalized_load_entropy": 0.9174640781665498, + "max_load_share": 0.06444444444444444 + } + }, + "s0_x": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "05bdba30b92a6e271cec442ace9920fd6cd4e48b8e79a2ea60a91ad23cd9891d", + "route_weight_sha256": "24f565e209154bfa0055e89fbae332a3fa433cdbb20d3f6072d959b2dd53a344", + "loads": [ + 9, + 4, + 9, + 4, + 0, + 5, + 1, + 3, + 2, + 1, + 2, + 2, + 3, + 0, + 2, + 2, + 6, + 6, + 10, + 2, + 3, + 1, + 1, + 0, + 2, + 6, + 2, + 0, + 4, + 13, + 0, + 0, + 0, + 2, + 0, + 1, + 4, + 1, + 2, + 3, + 6, + 0, + 5, + 6, + 1, + 1, + 4, + 2, + 2, + 3, + 8, + 7, + 1, + 0, + 2, + 5, + 3, + 0, + 6, + 6, + 3, + 3, + 9, + 3 + ], + "weighted_loads": [ + 0.8020441718399525, + 0.26619579270482063, + 0.30081859044730663, + 0.13446654938161373, + 0.0, + 0.28678441792726517, + 0.034421876072883606, + 0.0754074938595295, + 0.07860983535647392, + 0.0315035879611969, + 0.06242096796631813, + 0.06487598642706871, + 0.15946356020867825, + 0.0, + 0.05807879567146301, + 0.06183665245771408, + 0.2491542063653469, + 0.48351552709937096, + 0.6333587672561407, + 0.06870556436479092, + 0.1406882479786873, + 0.025645360350608826, + 0.02984519861638546, + 0.0, + 0.06011604331433773, + 0.7042962536215782, + 0.049189165234565735, + 0.0, + 0.13165361806750298, + 0.640498386695981, + 0.0, + 0.0, + 0.0, + 0.0706059243530035, + 0.0, + 0.03917725756764412, + 0.6636030115187168, + 0.028810864314436913, + 0.06608741357922554, + 0.8085679113864899, + 0.2925446443259716, + 0.0, + 0.33039190620183945, + 0.17306497879326344, + 0.03881620243191719, + 0.1017971858382225, + 0.1490084771066904, + 0.09807484224438667, + 0.10976172238588333, + 0.092726094648242, + 0.4855086915194988, + 0.4847310967743397, + 0.12278273701667786, + 0.0, + 0.0519103929400444, + 0.33140166103839874, + 0.09591983631253242, + 0.0, + 0.21462813578546047, + 0.20613561011850834, + 0.11479007080197334, + 0.24327538162469864, + 0.6766448076814413, + 0.11335967294871807 + ], + "unique_experts": 53, + "load_cv": 0.8974739208898672, + "normalized_load_entropy": 0.9006691004992333, + "max_load_share": 0.06372549019607843 + }, + "full_input": { + "tokens": 59, + "top_k": 6, + "decisions": 354, + "ordered_route_sha256": "39b6044547061453f45137d3872139a1cba914e9b82b1078bb232db74724ec26", + "route_weight_sha256": "c32676ee475f073debd459074bfc1eef93ae1b9aa40b59306d6cb725190eb3ff", + "loads": [ + 12, + 23, + 14, + 6, + 0, + 5, + 10, + 3, + 2, + 1, + 11, + 5, + 6, + 0, + 2, + 2, + 6, + 10, + 10, + 2, + 3, + 1, + 1, + 5, + 2, + 6, + 2, + 0, + 5, + 16, + 0, + 2, + 2, + 3, + 1, + 1, + 4, + 2, + 13, + 5, + 13, + 0, + 5, + 7, + 7, + 10, + 6, + 2, + 3, + 3, + 19, + 7, + 6, + 0, + 12, + 6, + 4, + 2, + 6, + 6, + 4, + 3, + 16, + 3 + ], + "weighted_loads": [ + 0.9553377293050289, + 1.8937920371536165, + 0.5871139150112867, + 0.2304255086928606, + 0.0, + 0.28678441792726517, + 0.6564838141202927, + 0.0754074938595295, + 0.07860983535647392, + 0.0315035879611969, + 1.0321257151663303, + 0.7579655684530735, + 0.3690158110111952, + 0.0, + 0.05807879567146301, + 0.06183665245771408, + 0.2491542063653469, + 0.613290699198842, + 0.6333587672561407, + 0.06870556436479092, + 0.1406882479786873, + 0.025645360350608826, + 0.02984519861638546, + 0.22681422159075737, + 0.06011604331433773, + 0.7042962536215782, + 0.049189165234565735, + 0.0, + 0.1736065410077572, + 0.7559335064142942, + 0.0, + 0.19110337644815445, + 0.133836567401886, + 0.13406622223556042, + 0.07009178400039673, + 0.03917725756764412, + 0.6636030115187168, + 0.07987234182655811, + 0.7324550226330757, + 0.9948425106704235, + 0.6014824919402599, + 0.0, + 0.33039190620183945, + 0.20585512928664684, + 0.5045262724161148, + 1.0151897333562374, + 0.23794331960380077, + 0.09807484224438667, + 0.1533375345170498, + 0.092726094648242, + 1.1437102369964123, + 0.4847310967743397, + 0.5094537697732449, + 0.0, + 0.577612990513444, + 0.3870823308825493, + 0.155716422945261, + 0.06380403600633144, + 0.21462813578546047, + 0.20613561011850834, + 0.1682077795267105, + 0.24327538162469864, + 1.1623471323400736, + 0.11335967294871807 + ], + "unique_experts": 58, + "load_cv": 0.8948517639978969, + "normalized_load_entropy": 0.909044708108492, + "max_load_share": 0.06497175141242938 + } + }, + "s1_x": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "8530c0548d1a39bb2d08301f9c3c2bf23ef71813e2831616582854432723cde2", + "route_weight_sha256": "01b0998b89ce55f7ffea8c3392692396f25cdd23d167e21c3b3bf2e3268af1c2", + "loads": [ + 9, + 4, + 12, + 4, + 0, + 5, + 2, + 3, + 2, + 1, + 2, + 2, + 3, + 0, + 2, + 4, + 6, + 6, + 8, + 1, + 3, + 2, + 0, + 0, + 2, + 7, + 0, + 0, + 1, + 11, + 0, + 0, + 0, + 2, + 1, + 1, + 4, + 0, + 1, + 3, + 5, + 0, + 4, + 5, + 1, + 2, + 5, + 2, + 1, + 4, + 8, + 7, + 2, + 1, + 2, + 4, + 2, + 0, + 6, + 6, + 7, + 3, + 9, + 4 + ], + "weighted_loads": [ + 0.7186260689049959, + 0.2586000878363848, + 0.40859423391520977, + 0.14224720746278763, + 0.0, + 0.2909603863954544, + 0.07771340385079384, + 0.0760568380355835, + 0.08308524265885353, + 0.028523916378617287, + 0.07808472216129303, + 0.06224489398300648, + 0.13521992228925228, + 0.0, + 0.05780409835278988, + 0.11581768095493317, + 0.21871691197156906, + 0.48101817816495895, + 0.5349783897399902, + 0.037659358233213425, + 0.14144354313611984, + 0.055162014439702034, + 0.0, + 0.0, + 0.0540133286267519, + 0.7051304094493389, + 0.0, + 0.0, + 0.03247077390551567, + 0.5831248499453068, + 0.0, + 0.0, + 0.0, + 0.06764414347708225, + 0.02551615983247757, + 0.03897201269865036, + 0.6619595885276794, + 0.0, + 0.040893785655498505, + 0.749612957239151, + 0.2232719212770462, + 0.0, + 0.27156023122370243, + 0.14711679331958294, + 0.041523277759552, + 0.1525198109447956, + 0.1821255087852478, + 0.08977093175053596, + 0.07821544259786606, + 0.12462028302252293, + 0.46361885592341423, + 0.47528550401329994, + 0.1514059230685234, + 0.02353435382246971, + 0.050379056483507156, + 0.25684507191181183, + 0.06966650485992432, + 0.0, + 0.22314747236669064, + 0.2020050287246704, + 0.2302258275449276, + 0.24217484891414642, + 0.6875378508120775, + 0.14830086193978786 + ], + "unique_experts": 52, + "load_cv": 0.9025999440379533, + "normalized_load_entropy": 0.8969250564815993, + "max_load_share": 0.058823529411764705 + }, + "full_input": { + "tokens": 75, + "top_k": 6, + "decisions": 450, + "ordered_route_sha256": "e168de77280369f9887bb96162a9fa1ec01f7416fdd2d6fd39322b378c148e03", + "route_weight_sha256": "a6c5dcb9f3c9855eeb4c4a6401634bf836c7cb6493ee801ced89697f0c0835cc", + "loads": [ + 12, + 29, + 20, + 5, + 0, + 6, + 13, + 3, + 4, + 2, + 25, + 6, + 9, + 0, + 2, + 4, + 6, + 15, + 9, + 2, + 6, + 9, + 0, + 8, + 2, + 7, + 2, + 0, + 2, + 13, + 0, + 4, + 6, + 3, + 3, + 1, + 5, + 6, + 10, + 7, + 12, + 0, + 5, + 6, + 11, + 16, + 7, + 2, + 1, + 4, + 23, + 7, + 9, + 7, + 17, + 6, + 3, + 4, + 6, + 7, + 9, + 4, + 14, + 4 + ], + "weighted_loads": [ + 0.9855979103595018, + 2.3759845739696175, + 0.8180870488286018, + 0.1990964077413082, + 0.0, + 0.32921152561903, + 0.9770485684275627, + 0.0760568380355835, + 0.19455943256616592, + 0.05742190219461918, + 2.2283614315092564, + 0.8577132653445005, + 0.5336634200066328, + 0.0, + 0.05780409835278988, + 0.11581768095493317, + 0.21871691197156906, + 1.1773341856896877, + 0.5873577781021595, + 0.06171301752328873, + 0.4013895094394684, + 0.6947891525924206, + 0.0, + 0.35294897854328156, + 0.0540133286267519, + 0.7051304094493389, + 0.08990390971302986, + 0.0, + 0.07976208254694939, + 0.6536123789846897, + 0.0, + 0.5737970694899559, + 0.2786202244460583, + 0.11689516343176365, + 0.13831474259495735, + 0.03897201269865036, + 0.7079413682222366, + 0.30005193315446377, + 0.8515118956565857, + 1.110324453562498, + 0.5420070216059685, + 0.0, + 0.35930287279188633, + 0.17690970562398434, + 0.7585343886166811, + 1.5520811080932617, + 0.27811960130929947, + 0.08977093175053596, + 0.07821544259786606, + 0.12462028302252293, + 1.4017743300646544, + 0.47528550401329994, + 0.7126346752047539, + 0.4956004396080971, + 0.9737418349832296, + 0.3306024335324764, + 0.09932159073650837, + 0.14237765967845917, + 0.22314747236669064, + 0.2928469032049179, + 0.3779526986181736, + 0.28534866124391556, + 1.1153067704290152, + 0.14830086193978786 + ], + "unique_experts": 58, + "load_cv": 0.8680103543787032, + "normalized_load_entropy": 0.9154942443363927, + "max_load_share": 0.06444444444444444 + } + }, + "s0_period": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "29cb924c968e740fa2850ddeb95b290af9245009383caccb68c3b24655a5f6e6", + "route_weight_sha256": "5dfbdcc8199fa1473eb433073d5a70b903388113b15c0928b16927b3323b9002", + "loads": [ + 9, + 4, + 9, + 4, + 0, + 5, + 1, + 3, + 2, + 1, + 2, + 2, + 3, + 0, + 1, + 3, + 6, + 6, + 10, + 2, + 3, + 2, + 1, + 0, + 2, + 6, + 1, + 0, + 4, + 13, + 0, + 0, + 0, + 2, + 0, + 1, + 4, + 0, + 2, + 3, + 6, + 0, + 4, + 6, + 1, + 2, + 4, + 2, + 2, + 3, + 8, + 7, + 1, + 0, + 2, + 5, + 3, + 0, + 6, + 7, + 3, + 3, + 9, + 3 + ], + "weighted_loads": [ + 0.7825711648911238, + 0.26867255568504333, + 0.30162232369184494, + 0.14016706869006157, + 0.0, + 0.28213622607290745, + 0.03281445428729057, + 0.07507512532174587, + 0.07922220230102539, + 0.030344858765602112, + 0.06578617170453072, + 0.06643431447446346, + 0.15738485008478165, + 0.0, + 0.03285328671336174, + 0.08588193170726299, + 0.2569670230150223, + 0.4563499242067337, + 0.6248708572238684, + 0.06563232652842999, + 0.13746784627437592, + 0.05478299595415592, + 0.030029982328414917, + 0.0, + 0.05992603488266468, + 0.7034097462892532, + 0.025899415835738182, + 0.0, + 0.13507734052836895, + 0.652453038841486, + 0.0, + 0.0, + 0.0, + 0.06852263398468494, + 0.0, + 0.03852787986397743, + 0.6709881573915482, + 0.0, + 0.06675524637103081, + 0.8182571232318878, + 0.29637638106942177, + 0.0, + 0.2906055450439453, + 0.17523326352238655, + 0.039348844438791275, + 0.14225010201334953, + 0.15201826393604279, + 0.10036908835172653, + 0.10852219723165035, + 0.09275676123797894, + 0.4755459912121296, + 0.49835260584950447, + 0.12295452505350113, + 0.0, + 0.04792612046003342, + 0.3257361724972725, + 0.09566804394125938, + 0.0, + 0.20675061084330082, + 0.2257454115897417, + 0.11424152553081512, + 0.2427886798977852, + 0.671573543921113, + 0.12059192731976509 + ], + "unique_experts": 52, + "load_cv": 0.9043021613804083, + "normalized_load_entropy": 0.8979836785402439, + "max_load_share": 0.06372549019607843 + }, + "full_input": { + "tokens": 59, + "top_k": 6, + "decisions": 354, + "ordered_route_sha256": "11d7fdbc6574ac994a12094c56ca3bffee3ab720ae8a0c853841643ab1f30377", + "route_weight_sha256": "47790c3b7aaa967dcb0fa1770ee151a938ea0e2ce15c9b9a067fa09f23582f17", + "loads": [ + 12, + 23, + 13, + 5, + 0, + 5, + 8, + 3, + 2, + 1, + 12, + 5, + 8, + 1, + 1, + 4, + 6, + 10, + 10, + 2, + 3, + 2, + 1, + 5, + 2, + 6, + 1, + 0, + 5, + 16, + 0, + 1, + 2, + 3, + 2, + 1, + 4, + 1, + 12, + 5, + 12, + 0, + 4, + 7, + 7, + 12, + 6, + 2, + 2, + 3, + 19, + 7, + 6, + 0, + 12, + 6, + 4, + 2, + 6, + 7, + 5, + 3, + 15, + 4 + ], + "weighted_loads": [ + 0.9523955415934324, + 1.9490290882531554, + 0.5608291439712048, + 0.20589783415198326, + 0.0, + 0.28213622607290745, + 0.5320630930364132, + 0.07507512532174587, + 0.07922220230102539, + 0.030344858765602112, + 1.0839192382991314, + 0.7785471882671118, + 0.4630010277032852, + 0.035790327936410904, + 0.03285328671336174, + 0.12830393202602863, + 0.2569670230150223, + 0.5861250963062048, + 0.6248708572238684, + 0.06563232652842999, + 0.13746784627437592, + 0.05478299595415592, + 0.030029982328414917, + 0.23724115639925003, + 0.05992603488266468, + 0.7034097462892532, + 0.025899415835738182, + 0.0, + 0.17703026346862316, + 0.7637507487088442, + 0.0, + 0.0972217246890068, + 0.1487705409526825, + 0.13198293186724186, + 0.10596727579832077, + 0.03852787986397743, + 0.6709881573915482, + 0.05521225556731224, + 0.6220250651240349, + 1.0038085840642452, + 0.5532320477068424, + 0.0, + 0.2906055450439453, + 0.20802341401576996, + 0.49816185235977173, + 1.155882142484188, + 0.24095310643315315, + 0.10036908835172653, + 0.10852219723165035, + 0.09275676123797894, + 1.131664838641882, + 0.49835260584950447, + 0.43393000960350037, + 0.0, + 0.5366147253662348, + 0.3781270831823349, + 0.14522838220000267, + 0.06592849642038345, + 0.20675061084330082, + 0.2257454115897417, + 0.2069612219929695, + 0.2427886798977852, + 1.119611332193017, + 0.27683672681450844 + ], + "unique_experts": 59, + "load_cv": 0.8839415932473089, + "normalized_load_entropy": 0.9109267283849152, + "max_load_share": 0.06497175141242938 + } + }, + "s1_period": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "eadc61e72ce4adabc38efd40ded157d30a1888f9271b464aaa6a9fd39645ccac", + "route_weight_sha256": "e0acd27621ce5792e91914c24565b940c7a83bdbfac979ee6a2ce38116c31980", + "loads": [ + 10, + 4, + 10, + 4, + 0, + 5, + 2, + 2, + 2, + 0, + 1, + 4, + 3, + 0, + 2, + 4, + 6, + 5, + 8, + 1, + 3, + 2, + 0, + 0, + 2, + 9, + 1, + 0, + 4, + 11, + 0, + 0, + 0, + 1, + 1, + 1, + 4, + 1, + 2, + 3, + 6, + 0, + 4, + 5, + 1, + 2, + 5, + 2, + 1, + 3, + 8, + 7, + 2, + 0, + 2, + 4, + 2, + 0, + 6, + 6, + 4, + 3, + 9, + 4 + ], + "weighted_loads": [ + 0.7483368832617998, + 0.2534614186733961, + 0.3456461578607559, + 0.1428377665579319, + 0.0, + 0.28406713530421257, + 0.08045502007007599, + 0.05412164330482483, + 0.08149771392345428, + 0.0, + 0.044883083552122116, + 0.1157854963093996, + 0.14313281513750553, + 0.0, + 0.055973418056964874, + 0.11723319813609123, + 0.22782392799854279, + 0.40203604474663734, + 0.5351484268903732, + 0.03714881092309952, + 0.13867542147636414, + 0.0512419231235981, + 0.0, + 0.0, + 0.05479348637163639, + 0.758441049605608, + 0.026272697374224663, + 0.0, + 0.1312233917415142, + 0.586037578061223, + 0.0, + 0.0, + 0.0, + 0.03658081591129303, + 0.02567696012556553, + 0.0390196293592453, + 0.6615456007421017, + 0.027386657893657684, + 0.06779955700039864, + 0.7263131737709045, + 0.2616775594651699, + 0.0, + 0.2721657082438469, + 0.15179626271128654, + 0.04283149167895317, + 0.1513126976788044, + 0.18742550909519196, + 0.09080132842063904, + 0.0769014060497284, + 0.10036888346076012, + 0.46206649392843246, + 0.47876282036304474, + 0.1562841646373272, + 0.0, + 0.04898063838481903, + 0.25703591108322144, + 0.07052706182003021, + 0.0, + 0.22533391416072845, + 0.20370491221547127, + 0.14030377008020878, + 0.23775430768728256, + 0.689775025472045, + 0.1501300372183323 + ], + "unique_experts": 52, + "load_cv": 0.8905933293471188, + "normalized_load_entropy": 0.8984642370532603, + "max_load_share": 0.05392156862745098 + }, + "full_input": { + "tokens": 75, + "top_k": 6, + "decisions": 450, + "ordered_route_sha256": "dcb3c2113ddfaecfbf4c59810def2a6c4f5f9785d29ae24737a1cc25027bd174", + "route_weight_sha256": "5f0ef65b03004fa7cbfa9f9df7304060624763eff3b674b0a385c10602f21594", + "loads": [ + 14, + 29, + 17, + 6, + 0, + 6, + 11, + 2, + 5, + 1, + 24, + 8, + 10, + 0, + 2, + 5, + 6, + 13, + 10, + 2, + 6, + 9, + 0, + 7, + 2, + 9, + 2, + 0, + 5, + 13, + 0, + 3, + 6, + 2, + 4, + 1, + 5, + 7, + 10, + 7, + 13, + 0, + 5, + 6, + 12, + 17, + 6, + 2, + 2, + 3, + 21, + 7, + 8, + 6, + 16, + 6, + 4, + 4, + 6, + 7, + 7, + 4, + 14, + 5 + ], + "weighted_loads": [ + 1.0839001704007387, + 2.382048653671518, + 0.7585721965879202, + 0.2529282160103321, + 0.0, + 0.32231827452778816, + 0.7826015613973141, + 0.05412164330482483, + 0.23563877865672112, + 0.028897985816001892, + 2.1177274137735367, + 0.9057953786104918, + 0.6293401345610619, + 0.0, + 0.055973418056964874, + 0.16417716816067696, + 0.22782392799854279, + 1.051566693931818, + 0.6142501644790173, + 0.06120247021317482, + 0.3986213877797127, + 0.6908690612763166, + 0.0, + 0.302621204406023, + 0.05479348637163639, + 0.758441049605608, + 0.05923054926097393, + 0.0, + 0.17851470038294792, + 0.656525107100606, + 0.0, + 0.4688234105706215, + 0.2819824554026127, + 0.08583183586597443, + 0.18725776486098766, + 0.0390196293592453, + 0.7075273804366589, + 0.32611305080354214, + 0.817239586263895, + 1.0831879321485758, + 0.5804126597940922, + 0.0, + 0.3599083498120308, + 0.18158917501568794, + 0.8148184325546026, + 1.5676847025752068, + 0.22919578850269318, + 0.09080132842063904, + 0.1129753403365612, + 0.10036888346076012, + 1.2577617298811674, + 0.47876282036304474, + 0.613094724714756, + 0.47206608578562737, + 0.9061731230467558, + 0.33546047285199165, + 0.15829488821327686, + 0.14910883456468582, + 0.22533391416072845, + 0.29454678669571877, + 0.337791146710515, + 0.2809281200170517, + 1.1175439450889826, + 0.38308418169617653 + ], + "unique_experts": 58, + "load_cv": 0.8342187888403864, + "normalized_load_entropy": 0.9196968268736279, + "max_load_share": 0.06444444444444444 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 34, + "ordered_topk_exact_tokens": 18, + "set_exact_tokens": 24, + "mean_set_jaccard": 0.9096638655462185, + "mean_token_weighted_tv": 0.016319865223896855, + "aggregate_load_tv": 0.0392156862745098 + }, + "system_bos": { + "tokens": 34, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 23, + "mean_set_jaccard": 0.9012605042016807, + "mean_token_weighted_tv": 0.017629502971163568, + "aggregate_load_tv": 0.049019607843137254 + }, + "system_x": { + "tokens": 34, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.8424369747899161, + "mean_token_weighted_tv": 0.02760931890567436, + "aggregate_load_tv": 0.09313725490196079 + }, + "system_period": { + "tokens": 34, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.8550420168067226, + "mean_token_weighted_tv": 0.025158678427996004, + "aggregate_load_tv": 0.0784313725490196 + }, + "bos_at_s0": { + "tokens": 34, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 21, + "mean_set_jaccard": 0.8907563025210085, + "mean_token_weighted_tv": 0.018501536811099333, + "aggregate_load_tv": 0.05392156862745097 + }, + "bos_at_s1": { + "tokens": 34, + "ordered_topk_exact_tokens": 17, + "set_exact_tokens": 24, + "mean_set_jaccard": 0.9159663865546218, + "mean_token_weighted_tv": 0.014901431715663742, + "aggregate_load_tv": 0.049019607843137254 + }, + "x_at_s0": { + "tokens": 34, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 19, + "mean_set_jaccard": 0.8739495798319328, + "mean_token_weighted_tv": 0.020533346297109827, + "aggregate_load_tv": 0.05882352941176472 + }, + "x_at_s1": { + "tokens": 34, + "ordered_topk_exact_tokens": 11, + "set_exact_tokens": 18, + "mean_set_jaccard": 0.8529411764705882, + "mean_token_weighted_tv": 0.027718901305514222, + "aggregate_load_tv": 0.07352941176470588 + }, + "period_at_s0": { + "tokens": 34, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 18, + "mean_set_jaccard": 0.8592436974789918, + "mean_token_weighted_tv": 0.02234790057820432, + "aggregate_load_tv": 0.06862745098039216 + }, + "period_at_s1": { + "tokens": 34, + "ordered_topk_exact_tokens": 10, + "set_exact_tokens": 16, + "mean_set_jaccard": 0.8361344537815126, + "mean_token_weighted_tv": 0.028452191666206893, + "aggregate_load_tv": 0.06862745098039216 + } + } + }, + "layer_26": { + "layer": 26, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "798a9929aa500c0d8df5811f02ed625ff3dd2f14d14c4c6163d1b2be3964eef3", + "route_weight_sha256": "2357abb2312e2a49d42508231900f5c0854590331da1a978e157b6ee09c1ddc6", + "loads": [ + 2, + 0, + 6, + 2, + 3, + 2, + 4, + 3, + 7, + 1, + 0, + 1, + 0, + 3, + 8, + 3, + 4, + 9, + 1, + 0, + 12, + 5, + 1, + 0, + 2, + 6, + 0, + 4, + 1, + 2, + 0, + 3, + 8, + 0, + 3, + 12, + 2, + 1, + 1, + 0, + 2, + 8, + 0, + 5, + 0, + 3, + 7, + 5, + 1, + 7, + 2, + 0, + 9, + 3, + 4, + 5, + 2, + 2, + 5, + 2, + 3, + 3, + 0, + 4 + ], + "weighted_loads": [ + 0.08104555308818817, + 0.0, + 0.3384731188416481, + 0.08220027014613152, + 0.2932835519313812, + 0.09560002386569977, + 0.1645755935460329, + 0.19031624495983124, + 0.40360578522086143, + 0.04383020102977753, + 0.0, + 0.06947560608386993, + 0.0, + 0.09144861437380314, + 0.7367108128964901, + 0.20427558571100235, + 0.22263755463063717, + 0.4351014010608196, + 0.03025587648153305, + 0.0, + 0.8431697450578213, + 0.2323468215763569, + 0.062035273760557175, + 0.0, + 0.12218938395380974, + 0.26808951795101166, + 0.0, + 0.168348653241992, + 0.047379929572343826, + 0.1696156356483698, + 0.0, + 0.12384660169482231, + 0.8024776726961136, + 0.0, + 0.3419288694858551, + 0.9353080876171589, + 0.1039680503308773, + 0.03827342391014099, + 0.03484748676419258, + 0.0, + 0.08693871647119522, + 0.5721532739698887, + 0.0, + 0.41106217354536057, + 0.0, + 0.18989006616175175, + 0.2802276276051998, + 0.31135309115052223, + 0.041310857981443405, + 0.5770057067275047, + 0.11290422827005386, + 0.0, + 0.6152137443423271, + 0.10624807327985764, + 0.32675866410136223, + 0.2605501562356949, + 0.24977165460586548, + 0.16962746158242226, + 0.24151217006146908, + 0.07205962017178535, + 0.14338067546486855, + 0.274342380464077, + 0.0, + 0.17310114949941635 + ], + "unique_experts": 51, + "load_cv": 0.9261463277348662, + "normalized_load_entropy": 0.8925702115630992, + "max_load_share": 0.058823529411764705 + }, + "full_input": { + "tokens": 59, + "top_k": 6, + "decisions": 354, + "ordered_route_sha256": "e44f194a5fc1e6e8f4c50a4fdc21de72e92bcb5c732c0e127f03d72a950ba363", + "route_weight_sha256": "08b285b12393ca38ef999bfcf0db9fd6a8872f00a4e523d18e1ee3c2b6ba3f4e", + "loads": [ + 2, + 0, + 6, + 2, + 3, + 2, + 4, + 5, + 7, + 6, + 4, + 6, + 0, + 4, + 24, + 5, + 4, + 21, + 1, + 0, + 12, + 7, + 2, + 0, + 9, + 6, + 5, + 12, + 1, + 3, + 6, + 3, + 12, + 0, + 6, + 12, + 7, + 2, + 1, + 0, + 2, + 8, + 1, + 9, + 2, + 3, + 10, + 5, + 2, + 8, + 9, + 0, + 15, + 3, + 5, + 5, + 17, + 11, + 11, + 3, + 4, + 3, + 1, + 5 + ], + "weighted_loads": [ + 0.08104555308818817, + 0.0, + 0.3384731188416481, + 0.08220027014613152, + 0.2932835519313812, + 0.09560002386569977, + 0.1645755935460329, + 0.33405984938144684, + 0.40360578522086143, + 0.3923193886876106, + 0.24788737297058105, + 0.3816630563233048, + 0.0, + 0.15165244974195957, + 1.5400205042096786, + 0.3037782460451126, + 0.22263755463063717, + 1.1852645352482796, + 0.03025587648153305, + 0.0, + 0.8431697450578213, + 0.3081788420677185, + 0.12996772304177284, + 0.0, + 0.497749388217926, + 0.26808951795101166, + 1.0210579745471478, + 0.556438697502017, + 0.047379929572343826, + 0.20950756035745144, + 0.6358509808778763, + 0.12384660169482231, + 0.9398695733398199, + 0.0, + 0.5358225628733635, + 0.9353080876171589, + 0.3691237233579159, + 0.0846119150519371, + 0.03484748676419258, + 0.0, + 0.08693871647119522, + 0.5721532739698887, + 0.046861667186021805, + 0.6522380039095879, + 0.0638564471155405, + 0.18989006616175175, + 0.4488515369594097, + 0.31135309115052223, + 0.09067220613360405, + 1.5632487758994102, + 0.4183286540210247, + 0.0, + 1.1569426003843546, + 0.10624807327985764, + 0.3739882856607437, + 0.2605501562356949, + 1.4244153313338757, + 0.6004819604568183, + 0.4736715015023947, + 0.12170666456222534, + 0.14420365722617134, + 0.274342380464077, + 0.04062630236148834, + 0.2154475338757038 + ], + "unique_experts": 57, + "load_cv": 0.8982695512284233, + "normalized_load_entropy": 0.9084776933806546, + "max_load_share": 0.06779661016949153 + } + }, + "s1_eos": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "7af63988dc1be692dc27843bd5063e121befc8a74ddec505b3b09e70ba237de1", + "route_weight_sha256": "9b3ce0c5c374e2bdd13cbb212813ab71dcbc48e10c90e30466f707a6fd7028f9", + "loads": [ + 2, + 0, + 6, + 1, + 3, + 2, + 4, + 3, + 7, + 1, + 0, + 1, + 0, + 3, + 8, + 3, + 4, + 10, + 2, + 0, + 11, + 5, + 1, + 0, + 2, + 5, + 1, + 4, + 1, + 2, + 0, + 3, + 8, + 0, + 3, + 12, + 1, + 1, + 1, + 0, + 1, + 8, + 0, + 5, + 0, + 3, + 8, + 5, + 2, + 7, + 2, + 0, + 8, + 3, + 4, + 5, + 2, + 2, + 4, + 2, + 4, + 3, + 0, + 5 + ], + "weighted_loads": [ + 0.08406725525856018, + 0.0, + 0.34087884426116943, + 0.04513779282569885, + 0.28473369777202606, + 0.09925442934036255, + 0.16308588720858097, + 0.18134848400950432, + 0.4115343317389488, + 0.0465419702231884, + 0.0, + 0.07141882181167603, + 0.0, + 0.09176900796592236, + 0.7307252958416939, + 0.2070370502769947, + 0.21678061969578266, + 0.48729389905929565, + 0.06605635210871696, + 0.0, + 0.800952535122633, + 0.23236249573528767, + 0.059414543211460114, + 0.0, + 0.11337978765368462, + 0.2292620614171028, + 0.03549487143754959, + 0.16295496374368668, + 0.043096017092466354, + 0.1613813005387783, + 0.0, + 0.12532050907611847, + 0.7797072567045689, + 0.0, + 0.33934373408555984, + 0.9460420049726963, + 0.07098037004470825, + 0.037263158708810806, + 0.036274898797273636, + 0.0, + 0.055955491960048676, + 0.5769400782883167, + 0.0, + 0.41172980889678, + 0.0, + 0.18854728527367115, + 0.3023384977132082, + 0.3088529631495476, + 0.0787968635559082, + 0.5665060207247734, + 0.1074657253921032, + 0.0, + 0.5664326511323452, + 0.10610881447792053, + 0.31541891396045685, + 0.260621577501297, + 0.23535720258951187, + 0.17191511020064354, + 0.20726072043180466, + 0.0696287639439106, + 0.17861580103635788, + 0.26973188668489456, + 0.0, + 0.21332353726029396 + ], + "unique_experts": 52, + "load_cv": 0.9161291283312679, + "normalized_load_entropy": 0.895112431961129, + "max_load_share": 0.058823529411764705 + }, + "full_input": { + "tokens": 75, + "top_k": 6, + "decisions": 450, + "ordered_route_sha256": "02296077648e66188729ea8e6b0da019c181c24abcfce28145521a8dd30aaeaa", + "route_weight_sha256": "7d79ffce1659997553b2dc0ce3b6f030e37d48f0cd6a9810d3d1c543e26131f0", + "loads": [ + 3, + 0, + 6, + 2, + 6, + 2, + 4, + 5, + 7, + 9, + 7, + 8, + 0, + 4, + 23, + 8, + 4, + 18, + 3, + 0, + 11, + 11, + 9, + 0, + 11, + 8, + 12, + 15, + 1, + 5, + 9, + 4, + 14, + 1, + 9, + 12, + 12, + 6, + 4, + 1, + 2, + 8, + 2, + 10, + 0, + 4, + 11, + 6, + 3, + 10, + 9, + 0, + 18, + 5, + 7, + 8, + 20, + 12, + 14, + 8, + 7, + 3, + 3, + 6 + ], + "weighted_loads": [ + 0.13045454025268555, + 0.0, + 0.34087884426116943, + 0.07563178241252899, + 0.463902173563838, + 0.09925442934036255, + 0.16308588720858097, + 0.3692982755601406, + 0.4115343317389488, + 0.5514789782464504, + 0.7117003910243511, + 0.6873307845089585, + 0.0, + 0.14430536143481731, + 1.6248663663864136, + 0.5036720521748066, + 0.21678061969578266, + 1.067849837243557, + 0.11588680744171143, + 0.0, + 0.800952535122633, + 0.5947455242276192, + 0.6232253462076187, + 0.0, + 0.5574787985533476, + 0.3724557124078274, + 1.6063574515283108, + 0.6402328480035067, + 0.043096017092466354, + 0.26873522251844406, + 0.9525489173829556, + 0.20481076836585999, + 1.013357250019908, + 0.0522669181227684, + 0.6878715716302395, + 0.9460420049726963, + 0.6693884991109371, + 0.3361472636461258, + 0.3249756172299385, + 0.033492375165224075, + 0.08621105551719666, + 0.5769400782883167, + 0.0949382483959198, + 0.7045747935771942, + 0.0, + 0.20592382922768593, + 0.5154431480914354, + 0.35061997920274734, + 0.11318493261933327, + 1.7025741524994373, + 0.39754752814769745, + 0.0, + 1.4326562136411667, + 0.2944500036537647, + 0.5299956984817982, + 0.42017511278390884, + 1.9637844152748585, + 0.9329258482903242, + 0.7901975698769093, + 0.36508683674037457, + 0.4172364826663397, + 0.26973188668489456, + 0.1298817042261362, + 0.2572782561182976 + ], + "unique_experts": 58, + "load_cv": 0.7308239895513172, + "normalized_load_entropy": 0.9304658897652819, + "max_load_share": 0.051111111111111114 + } + }, + "s0_bos": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "9fe8286bcb5c913d2e2463a224796a9bad2fbfb8867f9b5b725ece60d17a0078", + "route_weight_sha256": "70a639543cd9cdc82eec2d6c7de5a283643ee32cfc58d0903273f9b7a4903f33", + "loads": [ + 2, + 0, + 6, + 3, + 3, + 2, + 4, + 3, + 6, + 1, + 0, + 1, + 0, + 3, + 8, + 3, + 4, + 10, + 1, + 0, + 11, + 5, + 1, + 0, + 2, + 6, + 0, + 3, + 1, + 3, + 1, + 3, + 8, + 0, + 3, + 12, + 2, + 1, + 1, + 0, + 2, + 8, + 0, + 5, + 0, + 2, + 7, + 5, + 0, + 8, + 2, + 0, + 9, + 2, + 2, + 5, + 2, + 2, + 4, + 3, + 4, + 4, + 0, + 5 + ], + "weighted_loads": [ + 0.08488522097468376, + 0.0, + 0.3295269310474396, + 0.12363262102007866, + 0.2904910296201706, + 0.09579186886548996, + 0.16881314478814602, + 0.19375528022646904, + 0.36460601538419724, + 0.04492836073040962, + 0.0, + 0.06753209233283997, + 0.0, + 0.0905761569738388, + 0.7308930158615112, + 0.20240435004234314, + 0.23053929954767227, + 0.45801209285855293, + 0.030688488855957985, + 0.0, + 0.8354207202792168, + 0.23504171334207058, + 0.060250673443078995, + 0.0, + 0.11750748008489609, + 0.2800511159002781, + 0.0, + 0.1317722089588642, + 0.0452236533164978, + 0.18106551840901375, + 0.03161383047699928, + 0.1195947416126728, + 0.8005645200610161, + 0.0, + 0.3338077813386917, + 0.9356886669993401, + 0.10689875483512878, + 0.038836196064949036, + 0.03692992404103279, + 0.0, + 0.08544081076979637, + 0.5885639637708664, + 0.0, + 0.4275294505059719, + 0.0, + 0.16304582729935646, + 0.27206944301724434, + 0.32112814486026764, + 0.0, + 0.6061042621731758, + 0.10680598393082619, + 0.0, + 0.6194531247019768, + 0.06856517866253853, + 0.25642163306474686, + 0.27355778589844704, + 0.2742452397942543, + 0.16589608043432236, + 0.21075985208153725, + 0.11007029563188553, + 0.172671377658844, + 0.30715010687708855, + 0.0, + 0.20230286568403244 + ], + "unique_experts": 51, + "load_cv": 0.924484332088336, + "normalized_load_entropy": 0.8926266169325685, + "max_load_share": 0.058823529411764705 + }, + "full_input": { + "tokens": 59, + "top_k": 6, + "decisions": 354, + "ordered_route_sha256": "5ca6466bbe92abf168701a814276a040a754c815590b12f36da1edc6a226e5bd", + "route_weight_sha256": "9bea2e88e9b484f9d411c63479f81036d859c2063c9f48e9e17f545dc2596b93", + "loads": [ + 4, + 0, + 6, + 3, + 3, + 2, + 4, + 5, + 6, + 7, + 2, + 5, + 0, + 4, + 22, + 5, + 4, + 20, + 1, + 0, + 12, + 7, + 3, + 0, + 9, + 6, + 6, + 12, + 1, + 4, + 9, + 3, + 11, + 1, + 7, + 12, + 7, + 1, + 1, + 0, + 2, + 9, + 2, + 9, + 3, + 2, + 9, + 5, + 1, + 8, + 9, + 0, + 15, + 2, + 3, + 5, + 16, + 9, + 10, + 4, + 4, + 4, + 1, + 7 + ], + "weighted_loads": [ + 0.15333783254027367, + 0.0, + 0.3295269310474396, + 0.12363262102007866, + 0.2904910296201706, + 0.09579186886548996, + 0.16881314478814602, + 0.30633149668574333, + 0.36460601538419724, + 0.4359772093594074, + 0.16074660420417786, + 0.3776589632034302, + 0.0, + 0.15077999234199524, + 1.4610917642712593, + 0.32174907624721527, + 0.23053929954767227, + 1.121423378586769, + 0.030688488855957985, + 0.0, + 0.862704424187541, + 0.3150998670607805, + 0.16192229837179184, + 0.0, + 0.5015501640737057, + 0.2800511159002781, + 1.1571956686675549, + 0.5896464549005032, + 0.0452236533164978, + 0.2209574431180954, + 0.8036071844398975, + 0.1195947416126728, + 0.9063983131200075, + 0.061359114944934845, + 0.6010213792324066, + 0.9356886669993401, + 0.37566933780908585, + 0.038836196064949036, + 0.03692992404103279, + 0.0, + 0.08544081076979637, + 1.0200919955968857, + 0.11072049662470818, + 0.6732948981225491, + 0.12393570132553577, + 0.16304582729935646, + 0.39744647964835167, + 0.32112814486026764, + 0.05754495784640312, + 0.6061042621731758, + 0.412230409681797, + 0.0, + 1.1585925221443176, + 0.06856517866253853, + 0.30365125462412834, + 0.27355778589844704, + 1.4175552986562252, + 0.5629153978079557, + 0.44291918352246284, + 0.15971734002232552, + 0.172671377658844, + 0.30715010687708855, + 0.04062630236148834, + 0.3258584998548031 + ], + "unique_experts": 58, + "load_cv": 0.8509719973980231, + "normalized_load_entropy": 0.9150056237016412, + "max_load_share": 0.062146892655367235 + } + }, + "s1_bos": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "677637658b8dab54d405913ddc90b083b9b708c22c947525dededb85b9cd13cb", + "route_weight_sha256": "f95bb764f5b2749574beca7d6aebd3c621daf60bbcb54c449173586e99030e7d", + "loads": [ + 2, + 0, + 6, + 3, + 3, + 3, + 3, + 3, + 6, + 1, + 0, + 1, + 0, + 3, + 8, + 3, + 3, + 10, + 1, + 0, + 11, + 5, + 2, + 0, + 2, + 6, + 0, + 3, + 1, + 3, + 0, + 3, + 8, + 0, + 3, + 12, + 2, + 1, + 1, + 0, + 1, + 8, + 0, + 5, + 0, + 4, + 6, + 5, + 0, + 7, + 2, + 0, + 9, + 1, + 4, + 6, + 2, + 2, + 4, + 3, + 4, + 5, + 0, + 4 + ], + "weighted_loads": [ + 0.08746787905693054, + 0.0, + 0.32578425109386444, + 0.11658218130469322, + 0.282687284052372, + 0.1286555677652359, + 0.13483677804470062, + 0.18498723581433296, + 0.38196171820163727, + 0.04403676837682724, + 0.0, + 0.07078491896390915, + 0.0, + 0.09493234008550644, + 0.7333671692758799, + 0.21074743941426277, + 0.18337423354387283, + 0.4820374585688114, + 0.03145678713917732, + 0.0, + 0.8089783675968647, + 0.2353066299110651, + 0.09280258044600487, + 0.0, + 0.11771237477660179, + 0.2592180483043194, + 0.0, + 0.13159913569688797, + 0.04063447192311287, + 0.16912676952779293, + 0.0, + 0.12221908569335938, + 0.7670881226658821, + 0.0, + 0.33816003054380417, + 0.9517772421240807, + 0.11075478419661522, + 0.0373699851334095, + 0.03577107936143875, + 0.0, + 0.051712583750486374, + 0.5853805653750896, + 0.0, + 0.4016212746500969, + 0.0, + 0.23556892946362495, + 0.23321071080863476, + 0.320171095430851, + 0.0, + 0.5436818227171898, + 0.10737284272909164, + 0.0, + 0.5972290821373463, + 0.036960359662771225, + 0.30181344598531723, + 0.30778779834508896, + 0.25348544865846634, + 0.17200707644224167, + 0.2083776816725731, + 0.11531012132763863, + 0.17759334668517113, + 0.3375532813370228, + 0.0, + 0.1628296710550785 + ], + "unique_experts": 50, + "load_cv": 0.9194803206034003, + "normalized_load_entropy": 0.8912585025202259, + "max_load_share": 0.058823529411764705 + }, + "full_input": { + "tokens": 75, + "top_k": 6, + "decisions": 450, + "ordered_route_sha256": "6898e40d8633b135932a379e54c577bf302a81b6bd8bbdc8cf7d4db20b8e2018", + "route_weight_sha256": "a7b09ba9dda7b31ae0e169e5fb61c470e43c45493906bab567ae32b654739254", + "loads": [ + 3, + 0, + 6, + 3, + 6, + 3, + 3, + 5, + 6, + 10, + 7, + 7, + 0, + 4, + 21, + 8, + 3, + 17, + 1, + 0, + 12, + 11, + 10, + 0, + 13, + 9, + 12, + 13, + 1, + 6, + 11, + 4, + 13, + 2, + 10, + 12, + 13, + 6, + 4, + 1, + 2, + 8, + 3, + 10, + 2, + 5, + 9, + 6, + 1, + 9, + 9, + 0, + 19, + 3, + 7, + 8, + 20, + 10, + 14, + 9, + 6, + 5, + 3, + 6 + ], + "weighted_loads": [ + 0.1364320106804371, + 0.0, + 0.32578425109386444, + 0.11658218130469322, + 0.4618557598441839, + 0.1286555677652359, + 0.13483677804470062, + 0.3544234521687031, + 0.38196171820163727, + 0.6089856438338757, + 0.7278377637267113, + 0.6844227202236652, + 0.0, + 0.1474686935544014, + 1.5686941947788, + 0.5245735943317413, + 0.18337423354387283, + 1.0470229275524616, + 0.03145678713917732, + 0.0, + 0.8395585231482983, + 0.5984441079199314, + 0.6316578201949596, + 0.0, + 0.6476594861596823, + 0.40241169929504395, + 1.7080302275717258, + 0.562271935865283, + 0.04063447192311287, + 0.2764806915074587, + 1.062680821865797, + 0.2017093449831009, + 0.968161765486002, + 0.10859326273202896, + 0.7581116408109665, + 0.9517772421240807, + 0.7120268307626247, + 0.3362540900707245, + 0.3244717977941036, + 0.033492375165224075, + 0.08196814730763435, + 0.5853805653750896, + 0.14586585015058517, + 0.7013471834361553, + 0.07922413572669029, + 0.25294547341763973, + 0.44009423069655895, + 0.36193811148405075, + 0.034388069063425064, + 0.6949345953762531, + 0.3974546454846859, + 0.0, + 1.442519187927246, + 0.22530154883861542, + 0.5163902305066586, + 0.4243467152118683, + 1.9901510663330555, + 0.8992249015718699, + 0.7913145311176777, + 0.4107681941241026, + 0.41529356315732, + 0.3375532813370228, + 0.1298817042261362, + 0.291226364672184 + ], + "unique_experts": 59, + "load_cv": 0.7146440018517723, + "normalized_load_entropy": 0.9332559750663114, + "max_load_share": 0.04666666666666667 + } + }, + "s0_x": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "bdbf5fbb15a4157d8133cfbad8faef8b9e84203fa8c8347f9f0289d08da89b7d", + "route_weight_sha256": "7ecf31d2e34ced545e6080df727f6085ec02441790958957ded96009d97b8d1e", + "loads": [ + 2, + 0, + 6, + 3, + 3, + 3, + 4, + 3, + 7, + 1, + 0, + 1, + 0, + 2, + 8, + 3, + 4, + 10, + 2, + 0, + 11, + 5, + 1, + 0, + 2, + 6, + 0, + 4, + 1, + 3, + 0, + 3, + 8, + 0, + 3, + 12, + 2, + 1, + 1, + 0, + 2, + 8, + 0, + 5, + 0, + 3, + 6, + 5, + 0, + 8, + 3, + 0, + 9, + 1, + 3, + 5, + 2, + 2, + 5, + 2, + 3, + 3, + 0, + 4 + ], + "weighted_loads": [ + 0.08661848306655884, + 0.0, + 0.3298632353544235, + 0.1206660307943821, + 0.2750542163848877, + 0.12584346160292625, + 0.1600137259811163, + 0.1882217675447464, + 0.42924007773399353, + 0.03996800258755684, + 0.0, + 0.07002218812704086, + 0.0, + 0.0639153178781271, + 0.7340609580278397, + 0.20653178170323372, + 0.22290780395269394, + 0.4692374989390373, + 0.06259843334555626, + 0.0, + 0.8048588745296001, + 0.2354468535631895, + 0.05317215621471405, + 0.0, + 0.12215214222669601, + 0.26390280947089195, + 0.0, + 0.16319625824689865, + 0.04532364383339882, + 0.17093215882778168, + 0.0, + 0.12572317942976952, + 0.7781188227236271, + 0.0, + 0.33045613020658493, + 0.9213584400713444, + 0.10732139647006989, + 0.03591313585639, + 0.035319309681653976, + 0.0, + 0.08006037026643753, + 0.6001570001244545, + 0.0, + 0.40429358184337616, + 0.0, + 0.1919233724474907, + 0.23018200136721134, + 0.3277438320219517, + 0.0, + 0.5909432023763657, + 0.15201914682984352, + 0.0, + 0.6013113409280777, + 0.033254675567150116, + 0.2806242145597935, + 0.2700570113956928, + 0.2520859092473984, + 0.1678006388247013, + 0.24452341347932816, + 0.06655225157737732, + 0.1453687734901905, + 0.26570576429367065, + 0.0, + 0.16262546554207802 + ], + "unique_experts": 50, + "load_cv": 0.9261463277348662, + "normalized_load_entropy": 0.8907764024664815, + "max_load_share": 0.058823529411764705 + }, + "full_input": { + "tokens": 59, + "top_k": 6, + "decisions": 354, + "ordered_route_sha256": "1210fe94d964a1c5242f14b7be279c0d0ac31bc7cd866958cd46218a345f3bd0", + "route_weight_sha256": "5cfb4f900f31779c063f64b1ebcf971dc082e0b04c3a4662da202dee4db24215", + "loads": [ + 3, + 0, + 6, + 3, + 3, + 3, + 4, + 5, + 7, + 6, + 3, + 7, + 0, + 3, + 23, + 5, + 4, + 23, + 2, + 0, + 11, + 7, + 2, + 0, + 9, + 6, + 5, + 13, + 1, + 5, + 6, + 3, + 11, + 1, + 6, + 12, + 7, + 1, + 1, + 0, + 2, + 8, + 1, + 11, + 0, + 3, + 8, + 5, + 0, + 8, + 10, + 0, + 15, + 1, + 4, + 5, + 19, + 11, + 11, + 3, + 3, + 3, + 1, + 5 + ], + "weighted_loads": [ + 0.12733417004346848, + 0.0, + 0.3298632353544235, + 0.1206660307943821, + 0.2750542163848877, + 0.12584346160292625, + 0.1600137259811163, + 0.3274149149656296, + 0.42924007773399353, + 0.41397301480174065, + 0.2118053212761879, + 0.5299707092344761, + 0.0, + 0.12411915324628353, + 1.5499318838119507, + 0.30285313352942467, + 0.22290780395269394, + 1.3126364890486002, + 0.06259843334555626, + 0.0, + 0.8048588745296001, + 0.30923292972147465, + 0.10310041531920433, + 0.0, + 0.5227119736373425, + 0.26390280947089195, + 0.981219407171011, + 0.5814782865345478, + 0.04532364383339882, + 0.2613912783563137, + 0.608372587710619, + 0.12572317942976952, + 0.8867593817412853, + 0.05524030327796936, + 0.5194728672504425, + 0.9213584400713444, + 0.36828751489520073, + 0.03591313585639, + 0.035319309681653976, + 0.0, + 0.08006037026643753, + 0.6001570001244545, + 0.05672542005777359, + 0.7417174428701401, + 0.0, + 0.1919233724474907, + 0.35555903799831867, + 0.3277438320219517, + 0.0, + 0.5909432023763657, + 0.45744357258081436, + 0.0, + 1.128959869965911, + 0.033254675567150116, + 0.32785383611917496, + 0.2700570113956928, + 1.5554407723248005, + 0.7034774012863636, + 0.47668274492025375, + 0.1161992959678173, + 0.1453687734901905, + 0.26570576429367065, + 0.04062630236148834, + 0.20497184991836548 + ], + "unique_experts": 56, + "load_cv": 0.9301123611891113, + "normalized_load_entropy": 0.9017259242211421, + "max_load_share": 0.06497175141242938 + } + }, + "s1_x": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "d12a1cfb305ffab7b5b9aa0bb6c293e7fb5075ae113b1355f92a9650a4e19f1d", + "route_weight_sha256": "0a0bcb38391c61b8e1d9cd21daee187897c17a371003e3db74f0282c9eaf9a26", + "loads": [ + 2, + 0, + 6, + 3, + 3, + 3, + 3, + 3, + 7, + 1, + 0, + 1, + 0, + 3, + 8, + 4, + 3, + 10, + 2, + 0, + 10, + 5, + 2, + 0, + 2, + 5, + 1, + 4, + 1, + 3, + 0, + 3, + 8, + 0, + 3, + 12, + 2, + 1, + 1, + 0, + 1, + 8, + 1, + 5, + 0, + 4, + 7, + 5, + 0, + 6, + 2, + 0, + 9, + 1, + 2, + 5, + 2, + 2, + 4, + 2, + 4, + 5, + 0, + 4 + ], + "weighted_loads": [ + 0.08575532585382462, + 0.0, + 0.3436785340309143, + 0.11581067740917206, + 0.25649116933345795, + 0.12914195097982883, + 0.13465163484215736, + 0.17575516924262047, + 0.43748241290450096, + 0.038490913808345795, + 0.0, + 0.07486822456121445, + 0.0, + 0.09990483522415161, + 0.7191583905369043, + 0.2561788484454155, + 0.17993420362472534, + 0.5109291262924671, + 0.06467545032501221, + 0.0, + 0.7186383157968521, + 0.23520268127322197, + 0.08822877891361713, + 0.0, + 0.11973299086093903, + 0.19804124347865582, + 0.03162079304456711, + 0.16033830493688583, + 0.03712857514619827, + 0.17492758110165596, + 0.0, + 0.12429828196763992, + 0.7204632237553596, + 0.0, + 0.33352290093898773, + 0.921435609459877, + 0.12351742386817932, + 0.0330534391105175, + 0.03440619260072708, + 0.0, + 0.049452945590019226, + 0.5951063707470894, + 0.03386252000927925, + 0.35054319351911545, + 0.0, + 0.2231837548315525, + 0.2658668775111437, + 0.31959160044789314, + 0.0, + 0.47840218245983124, + 0.10903973877429962, + 0.0, + 0.5687407050281763, + 0.031747251749038696, + 0.2210293412208557, + 0.2706492096185684, + 0.26001809537410736, + 0.1727272942662239, + 0.21281681209802628, + 0.07313121110200882, + 0.18046211451292038, + 0.32725165970623493, + 0.0, + 0.156547661870718 + ], + "unique_experts": 52, + "load_cv": 0.8957587278823859, + "normalized_load_entropy": 0.898413477170823, + "max_load_share": 0.058823529411764705 + }, + "full_input": { + "tokens": 75, + "top_k": 6, + "decisions": 450, + "ordered_route_sha256": "d2454b2e1c5f82d8e37a5459808731f5de3073f57b11a510d7481d78f17f1547", + "route_weight_sha256": "43398e7d30de36fa3dc3720825b580c95524eecf6f96ac86f17ca551f1c24df9", + "loads": [ + 2, + 0, + 6, + 3, + 6, + 4, + 3, + 5, + 7, + 9, + 7, + 9, + 0, + 4, + 23, + 9, + 3, + 17, + 2, + 0, + 11, + 11, + 9, + 0, + 11, + 8, + 13, + 15, + 1, + 7, + 9, + 4, + 12, + 0, + 10, + 12, + 13, + 6, + 4, + 1, + 2, + 8, + 3, + 10, + 0, + 5, + 10, + 6, + 1, + 8, + 9, + 0, + 19, + 3, + 5, + 7, + 22, + 12, + 15, + 9, + 6, + 5, + 3, + 6 + ], + "weighted_loads": [ + 0.08575532585382462, + 0.0, + 0.3436785340309143, + 0.11581067740917206, + 0.4356596451252699, + 0.19219050742685795, + 0.13465163484215736, + 0.403865497559309, + 0.43748241290450096, + 0.5587231665849686, + 0.7106647789478302, + 0.8452461399137974, + 0.0, + 0.15244118869304657, + 1.6990245934575796, + 0.5590550489723682, + 0.17993420362472534, + 1.0716173313558102, + 0.06467545032501221, + 0.0, + 0.7498485818505287, + 0.601713752374053, + 0.5849730204790831, + 0.0, + 0.5785638149827719, + 0.3412348944693804, + 1.7448527812957764, + 0.6315240804105997, + 0.03712857514619827, + 0.36120104789733887, + 0.9304095208644867, + 0.20378854125738144, + 0.8846207521855831, + 0.0, + 0.7217894215136766, + 0.921435609459877, + 0.7164002396166325, + 0.3319375440478325, + 0.32310691103339195, + 0.033492375165224075, + 0.0797085091471672, + 0.5951063707470894, + 0.12742186337709427, + 0.6368146277964115, + 0.0, + 0.24056029878556728, + 0.4889330770820379, + 0.3613586165010929, + 0.034388069063425064, + 0.6296549551188946, + 0.3991215415298939, + 0.0, + 1.402022821828723, + 0.2200884409248829, + 0.43560612574219704, + 0.38720812648534775, + 2.0300584696233273, + 1.056025544181466, + 0.860493864864111, + 0.41405355744063854, + 0.4181623309850693, + 0.32725165970623493, + 0.1298817042261362, + 0.225959200412035 + ], + "unique_experts": 57, + "load_cv": 0.7512951779723096, + "normalized_load_entropy": 0.9263781435996093, + "max_load_share": 0.051111111111111114 + } + }, + "s0_period": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "a2b5a56676c1b0c496078d019675c929b93cda0807830fcd7739bb525cff4197", + "route_weight_sha256": "3526f476b9af0edbfa71b15837cb1c0a60ae9f0e8f04744acda3db5a0095fcb1", + "loads": [ + 2, + 0, + 6, + 2, + 3, + 3, + 4, + 3, + 7, + 1, + 0, + 1, + 0, + 3, + 8, + 3, + 4, + 10, + 2, + 0, + 11, + 5, + 1, + 0, + 2, + 5, + 0, + 3, + 1, + 2, + 1, + 3, + 8, + 0, + 3, + 12, + 2, + 1, + 1, + 0, + 2, + 8, + 1, + 5, + 0, + 3, + 6, + 5, + 1, + 8, + 2, + 0, + 9, + 2, + 3, + 5, + 2, + 1, + 4, + 2, + 4, + 4, + 0, + 4 + ], + "weighted_loads": [ + 0.08451062813401222, + 0.0, + 0.3526389002799988, + 0.08103899657726288, + 0.28373005241155624, + 0.1257564276456833, + 0.1568845473229885, + 0.18910889327526093, + 0.4140682630240917, + 0.04337248206138611, + 0.0, + 0.07109899818897247, + 0.0, + 0.0952807329595089, + 0.7284637112170458, + 0.2061481736600399, + 0.2208970058709383, + 0.48806146159768105, + 0.06348491832613945, + 0.0, + 0.7996899001300335, + 0.2360844872891903, + 0.05543449521064758, + 0.0, + 0.12451354786753654, + 0.22327736020088196, + 0.0, + 0.13568992912769318, + 0.04428664222359657, + 0.13614706322550774, + 0.029259273782372475, + 0.12417571991682053, + 0.7777345515787601, + 0.0, + 0.3323245644569397, + 0.9270483292639256, + 0.11127737537026405, + 0.039605073630809784, + 0.034214068204164505, + 0.0, + 0.08264849334955215, + 0.5942494459450245, + 0.03292768821120262, + 0.401714064180851, + 0.0, + 0.19106385484337807, + 0.22862371429800987, + 0.3208179324865341, + 0.03922916203737259, + 0.566333843395114, + 0.11297677829861641, + 0.0, + 0.5995157137513161, + 0.06615384668111801, + 0.2797885946929455, + 0.27533796429634094, + 0.2581910416483879, + 0.13424251973628998, + 0.20185060799121857, + 0.06646015122532845, + 0.17118350602686405, + 0.29954063333570957, + 0.0, + 0.16945691779255867 + ], + "unique_experts": 53, + "load_cv": 0.909389696102371, + "normalized_load_entropy": 0.8987620540276068, + "max_load_share": 0.058823529411764705 + }, + "full_input": { + "tokens": 59, + "top_k": 6, + "decisions": 354, + "ordered_route_sha256": "ca0053c18a1920181112d8ccdc80191c93ebed02748d9cbb5fc4f293e1110869", + "route_weight_sha256": "1051716f616e63f2af2833d5d354e2b70f643b951aa6d3e9fb9e8e291588d462", + "loads": [ + 2, + 0, + 6, + 2, + 3, + 4, + 4, + 5, + 7, + 6, + 3, + 5, + 0, + 4, + 22, + 4, + 4, + 22, + 3, + 0, + 11, + 7, + 2, + 0, + 11, + 5, + 5, + 11, + 1, + 3, + 8, + 3, + 12, + 2, + 6, + 12, + 8, + 1, + 1, + 0, + 2, + 8, + 2, + 9, + 1, + 4, + 9, + 5, + 1, + 8, + 9, + 0, + 15, + 2, + 4, + 5, + 18, + 9, + 10, + 3, + 4, + 4, + 1, + 6 + ], + "weighted_loads": [ + 0.08451062813401222, + 0.0, + 0.3526389002799988, + 0.08103899657726288, + 0.28373005241155624, + 0.1646578647196293, + 0.1568845473229885, + 0.3400552347302437, + 0.4140682630240917, + 0.41209571063518524, + 0.2272777110338211, + 0.3812258690595627, + 0.0, + 0.15548456832766533, + 1.4458408746868372, + 0.26570964232087135, + 0.2208970058709383, + 1.2848473098129034, + 0.09646488353610039, + 0.0, + 0.7996899001300335, + 0.3141515403985977, + 0.1101137325167656, + 0.0, + 0.6575203202664852, + 0.22327736020088196, + 0.9848792217671871, + 0.521718755364418, + 0.04428664222359657, + 0.17603898793458939, + 0.7122619915753603, + 0.12417571991682053, + 0.9221394751220942, + 0.08712972328066826, + 0.5228876210749149, + 0.9270483292639256, + 0.42994702979922295, + 0.039605073630809784, + 0.034214068204164505, + 0.0, + 0.08264849334955215, + 0.5942494459450245, + 0.09403526037931442, + 0.6442434713244438, + 0.03602386265993118, + 0.22156162932515144, + 0.39252137392759323, + 0.3208179324865341, + 0.03922916203737259, + 0.566333843395114, + 0.41840120404958725, + 0.0, + 1.1582104489207268, + 0.06615384668111801, + 0.32701821625232697, + 0.27533796429634094, + 1.5572282001376152, + 0.5583907943218946, + 0.43400993943214417, + 0.11610719561576843, + 0.17118350602686405, + 0.29954063333570957, + 0.04062630236148834, + 0.3088901713490486 + ], + "unique_experts": 58, + "load_cv": 0.8793073395732028, + "normalized_load_entropy": 0.9127067812290017, + "max_load_share": 0.062146892655367235 + } + }, + "s1_period": { + "target_content": { + "tokens": 34, + "top_k": 6, + "decisions": 204, + "ordered_route_sha256": "32aa13aace5355debd869598187f1e9bf76251b238456bce17e22f6ea54b7875", + "route_weight_sha256": "89b503d3e851726cd66257991469ee71f950647a539267d6d6e386cd8475fb74", + "loads": [ + 2, + 0, + 6, + 1, + 3, + 4, + 3, + 3, + 7, + 1, + 0, + 1, + 0, + 3, + 8, + 4, + 3, + 10, + 1, + 0, + 11, + 5, + 2, + 0, + 2, + 6, + 0, + 4, + 1, + 3, + 0, + 3, + 8, + 0, + 3, + 12, + 2, + 1, + 1, + 0, + 1, + 8, + 0, + 5, + 0, + 4, + 7, + 5, + 1, + 6, + 2, + 0, + 9, + 1, + 2, + 5, + 2, + 2, + 4, + 2, + 4, + 5, + 0, + 5 + ], + "weighted_loads": [ + 0.0879889614880085, + 0.0, + 0.35278840735554695, + 0.039995092898607254, + 0.25753267854452133, + 0.16535735502839088, + 0.13380758464336395, + 0.17349820584058762, + 0.43833763897418976, + 0.04127121344208717, + 0.0, + 0.07778406143188477, + 0.0, + 0.10127578116953373, + 0.7060805857181549, + 0.25466688349843025, + 0.17905406281352043, + 0.5177874714136124, + 0.036009881645441055, + 0.0, + 0.7435335516929626, + 0.23765185847878456, + 0.08612538315355778, + 0.0, + 0.12344429641962051, + 0.2247518841177225, + 0.0, + 0.1674450021237135, + 0.03460966795682907, + 0.15543513372540474, + 0.0, + 0.12784508243203163, + 0.7302394546568394, + 0.0, + 0.33268655091524124, + 0.9392266571521759, + 0.120527483522892, + 0.03407405689358711, + 0.03431582823395729, + 0.0, + 0.05191772058606148, + 0.6058772206306458, + 0.0, + 0.34865448996424675, + 0.0, + 0.22351770475506783, + 0.2658850811421871, + 0.32422134652733803, + 0.040609877556562424, + 0.4865804612636566, + 0.11159104481339455, + 0.0, + 0.5720008537173271, + 0.032280441373586655, + 0.21959488093852997, + 0.2689036764204502, + 0.24069391936063766, + 0.17625873163342476, + 0.21776294708251953, + 0.07107962667942047, + 0.18126371130347252, + 0.32878418639302254, + 0.0, + 0.1945527009665966 + ], + "unique_experts": 51, + "load_cv": 0.9261463277348662, + "normalized_load_entropy": 0.8911957754909728, + "max_load_share": 0.058823529411764705 + }, + "full_input": { + "tokens": 75, + "top_k": 6, + "decisions": 450, + "ordered_route_sha256": "e5a1b2b8fc81ed2cca2f58899866918ab4c89ae56c1886ae3468a96cc8e788bd", + "route_weight_sha256": "3b0d5aa1109a66a359d85ab584b7387e0d08d456b114b325f64e5998a7644fe4", + "loads": [ + 2, + 0, + 6, + 1, + 6, + 5, + 3, + 5, + 7, + 9, + 8, + 7, + 0, + 4, + 22, + 9, + 3, + 17, + 1, + 0, + 12, + 11, + 9, + 0, + 12, + 9, + 11, + 15, + 1, + 6, + 9, + 4, + 13, + 0, + 9, + 12, + 14, + 7, + 4, + 1, + 2, + 8, + 3, + 10, + 0, + 5, + 11, + 6, + 2, + 8, + 9, + 0, + 20, + 3, + 6, + 7, + 22, + 10, + 14, + 8, + 6, + 5, + 3, + 8 + ], + "weighted_loads": [ + 0.0879889614880085, + 0.0, + 0.35278840735554695, + 0.039995092898607254, + 0.4367011543363333, + 0.22727691009640694, + 0.13380758464336395, + 0.3686527907848358, + 0.43833763897418976, + 0.5300909839570522, + 0.7774109169840813, + 0.6914218626916409, + 0.0, + 0.1538121346384287, + 1.6428404562175274, + 0.5498422496020794, + 0.17905406281352043, + 1.1401638351380825, + 0.036009881645441055, + 0.0, + 0.7820032685995102, + 0.6063419226557016, + 0.59154905192554, + 0.0, + 0.6654937211424112, + 0.3679455351084471, + 1.6198226548731327, + 0.6168269254267216, + 0.03460966795682907, + 0.2627890557050705, + 0.948698453605175, + 0.20733534172177315, + 0.9260122925043106, + 0.0, + 0.6805091500282288, + 0.9392266571521759, + 0.771581768989563, + 0.3630692604929209, + 0.32301654666662216, + 0.033492375165224075, + 0.08217328414320946, + 0.6058772206306458, + 0.12525301054120064, + 0.6410003304481506, + 0.0, + 0.2408942487090826, + 0.5354860760271549, + 0.3659883625805378, + 0.07499794661998749, + 0.63783323392272, + 0.4016728475689888, + 0.0, + 1.451574370265007, + 0.22062163054943085, + 0.4727608822286129, + 0.38546259328722954, + 2.163906041532755, + 0.9034765567630529, + 0.8006997965276241, + 0.36653769947588444, + 0.4189639277756214, + 0.32878418639302254, + 0.1298817042261362, + 0.3514366541057825 + ], + "unique_experts": 57, + "load_cv": 0.7504533609183054, + "normalized_load_entropy": 0.9257425125404827, + "max_load_share": 0.04888888888888889 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 34, + "ordered_topk_exact_tokens": 24, + "set_exact_tokens": 27, + "mean_set_jaccard": 0.9348739495798319, + "mean_token_weighted_tv": 0.014193458674365984, + "aggregate_load_tv": 0.03431372549019608 + }, + "system_bos": { + "tokens": 34, + "ordered_topk_exact_tokens": 22, + "set_exact_tokens": 25, + "mean_set_jaccard": 0.9243697478991596, + "mean_token_weighted_tv": 0.01741803703172242, + "aggregate_load_tv": 0.0392156862745098 + }, + "system_x": { + "tokens": 34, + "ordered_topk_exact_tokens": 16, + "set_exact_tokens": 23, + "mean_set_jaccard": 0.9012605042016808, + "mean_token_weighted_tv": 0.023028592551674915, + "aggregate_load_tv": 0.049019607843137254 + }, + "system_period": { + "tokens": 34, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 22, + "mean_set_jaccard": 0.8928571428571429, + "mean_token_weighted_tv": 0.02369436397052863, + "aggregate_load_tv": 0.053921568627450976 + }, + "bos_at_s0": { + "tokens": 34, + "ordered_topk_exact_tokens": 21, + "set_exact_tokens": 23, + "mean_set_jaccard": 0.9075630252100841, + "mean_token_weighted_tv": 0.018361253006493345, + "aggregate_load_tv": 0.044117647058823525 + }, + "bos_at_s1": { + "tokens": 34, + "ordered_topk_exact_tokens": 22, + "set_exact_tokens": 23, + "mean_set_jaccard": 0.8949579831932774, + "mean_token_weighted_tv": 0.020933963577536976, + "aggregate_load_tv": 0.06372549019607844 + }, + "x_at_s0": { + "tokens": 34, + "ordered_topk_exact_tokens": 19, + "set_exact_tokens": 25, + "mean_set_jaccard": 0.9243697478991597, + "mean_token_weighted_tv": 0.017013846321360153, + "aggregate_load_tv": 0.03431372549019607 + }, + "x_at_s1": { + "tokens": 34, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 21, + "mean_set_jaccard": 0.884453781512605, + "mean_token_weighted_tv": 0.026360554428880707, + "aggregate_load_tv": 0.058823529411764705 + }, + "period_at_s0": { + "tokens": 34, + "ordered_topk_exact_tokens": 20, + "set_exact_tokens": 24, + "mean_set_jaccard": 0.9096638655462186, + "mean_token_weighted_tv": 0.019226538373486084, + "aggregate_load_tv": 0.039215686274509796 + }, + "period_at_s1": { + "tokens": 34, + "ordered_topk_exact_tokens": 19, + "set_exact_tokens": 25, + "mean_set_jaccard": 0.9131652661064427, + "mean_token_weighted_tv": 0.023720720344606566, + "aggregate_load_tv": 0.053921568627450976 + } + } + } + } + }, + { + "id": "gsm8k/test/0144", + "domain": "math", + "label": "Grade-school math", + "within_domain_index": 2, + "selection_rank": "004a245538bdc42cc175a178c73dfaaaebc9713e3215ffcdfb9400fb63b3a941", + "source_text_sha256": "8f2ecd574d8c8738ec87b6ba3a3af24f9cbf35d832733c98e65546f7ee59725d", + "source_characters": 615, + "source_tokens": 131, + "content_token_ids_sha256": "eb11c5f163d8bd4a0f4ef34db9d62f5380ded55677f5767d1262696fe23b6f08", + "prompt_tokens_by_condition": { + "s0_eos": 155, + "s1_eos": 171, + "s0_bos": 155, + "s1_bos": 171, + "s0_x": 155, + "s1_x": 171, + "s0_period": 155, + "s1_period": 171 + }, + "batch_prompt_tokens": 171, + "content_tokens": 130, + "boundary_crossing_tokens_by_condition": { + "s0_eos": 1, + "s1_eos": 1, + "s0_bos": 1, + "s1_bos": 1, + "s0_x": 1, + "s1_x": 1, + "s0_period": 1, + "s1_period": 1 + }, + "forward_seconds": 0.9673534749890678, + "peak_cuda_memory_allocated_bytes": 27734153728, + "hidden_stages": { + "embedding": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d013642ae3d0bc2e062754070e0427b9535809e88c1dce5c7c1ee2b63a0c4e30", + "mean": -0.0008402697858400643, + "std": 0.09087657183408737, + "rms": 0.09088046103715897, + "max_abs": 1.7109375 + }, + "full_input": { + "shape": [ + 155, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1fe2dac2bd586c2da1d8be906ece9478703225a1addb0b2f2531cfe211e88c58", + "mean": -0.0008182969759218395, + "std": 0.09065280109643936, + "rms": 0.09065648913383484, + "max_abs": 2.046875 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d013642ae3d0bc2e062754070e0427b9535809e88c1dce5c7c1ee2b63a0c4e30", + "mean": -0.0008402697858400643, + "std": 0.09087657183408737, + "rms": 0.09088046103715897, + "max_abs": 1.7109375 + }, + "full_input": { + "shape": [ + 171, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1fac2e9a6634a21d259e3a81f7cf43d2ea04b3897ff178ff7ccb1299ff31c980", + "mean": -0.0009473055833950639, + "std": 0.09206488728523254, + "rms": 0.09206975996494293, + "max_abs": 2.046875 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d013642ae3d0bc2e062754070e0427b9535809e88c1dce5c7c1ee2b63a0c4e30", + "mean": -0.0008402697858400643, + "std": 0.09087657183408737, + "rms": 0.09088046103715897, + "max_abs": 1.7109375 + }, + "full_input": { + "shape": [ + 155, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4032fa81f419e351e332dde3330a21845f4526efdc1f9fbd9ad75313b1de9209", + "mean": -0.0008084053988568485, + "std": 0.09051971137523651, + "rms": 0.09052331745624542, + "max_abs": 2.046875 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d013642ae3d0bc2e062754070e0427b9535809e88c1dce5c7c1ee2b63a0c4e30", + "mean": -0.0008402697858400643, + "std": 0.09087657183408737, + "rms": 0.09088046103715897, + "max_abs": 1.7109375 + }, + "full_input": { + "shape": [ + 171, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8903618da1b48eb043cbdd8583594ffd450f1ccbec5173721e699b36822694c9", + "mean": -0.0009383395663462579, + "std": 0.09194611757993698, + "rms": 0.0919509083032608, + "max_abs": 2.046875 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d013642ae3d0bc2e062754070e0427b9535809e88c1dce5c7c1ee2b63a0c4e30", + "mean": -0.0008402697858400643, + "std": 0.09087657183408737, + "rms": 0.09088046103715897, + "max_abs": 1.7109375 + }, + "full_input": { + "shape": [ + 155, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "38a0370552aa67cfd9effea482429c753a087074e79305a2b5e8d3a389fce9ba", + "mean": -0.0008326793904416263, + "std": 0.09060941636562347, + "rms": 0.0906132385134697, + "max_abs": 2.046875 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d013642ae3d0bc2e062754070e0427b9535809e88c1dce5c7c1ee2b63a0c4e30", + "mean": -0.0008402697858400643, + "std": 0.09087657183408737, + "rms": 0.09088046103715897, + "max_abs": 1.7109375 + }, + "full_input": { + "shape": [ + 171, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "684f966697c76b5f4e1efc51fbdc06e819dc1bccf65f4c55f58c671c082fe61c", + "mean": -0.0009603422950021923, + "std": 0.09202614426612854, + "rms": 0.09203115850687027, + "max_abs": 2.046875 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d013642ae3d0bc2e062754070e0427b9535809e88c1dce5c7c1ee2b63a0c4e30", + "mean": -0.0008402697858400643, + "std": 0.09087657183408737, + "rms": 0.09088046103715897, + "max_abs": 1.7109375 + }, + "full_input": { + "shape": [ + 155, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0fa48568da191959199ceed7eea24d6766cd41238dc5417a4b55a3cb065afcbb", + "mean": -0.0008332028519362211, + "std": 0.09050720185041428, + "rms": 0.09051103889942169, + "max_abs": 2.046875 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d013642ae3d0bc2e062754070e0427b9535809e88c1dce5c7c1ee2b63a0c4e30", + "mean": -0.0008402697858400643, + "std": 0.09087657183408737, + "rms": 0.09088046103715897, + "max_abs": 1.7109375 + }, + "full_input": { + "shape": [ + 171, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5f09511fe755006ef0a077358807b40168bca3dbb84f98a7d972559fe305a943", + "mean": -0.0009608167456462979, + "std": 0.0919349268078804, + "rms": 0.09193994849920273, + "max_abs": 2.046875 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 130, + "exact_hidden_rows": 130, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999998807907104, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "system_bos": { + "tokens": 130, + "exact_hidden_rows": 130, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999998807907104, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "system_x": { + "tokens": 130, + "exact_hidden_rows": 130, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999998807907104, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "system_period": { + "tokens": 130, + "exact_hidden_rows": 130, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999998807907104, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "bos_at_s0": { + "tokens": 130, + "exact_hidden_rows": 130, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999998807907104, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "bos_at_s1": { + "tokens": 130, + "exact_hidden_rows": 130, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999998807907104, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "x_at_s0": { + "tokens": 130, + "exact_hidden_rows": 130, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999998807907104, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "x_at_s1": { + "tokens": 130, + "exact_hidden_rows": 130, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999998807907104, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "period_at_s0": { + "tokens": 130, + "exact_hidden_rows": 130, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999998807907104, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "period_at_s1": { + "tokens": 130, + "exact_hidden_rows": 130, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999998807907104, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + } + } + }, + "layer_00": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "87c94967b9aafd3b92d7b9eb5d966b11eb360e7abf2bd9f049c0b7f702f6c21b", + "mean": -0.0013487152755260468, + "std": 0.0861312747001648, + "rms": 0.08614183217287064, + "max_abs": 2.515625 + }, + "full_input": { + "shape": [ + 155, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "aa2e48f31dc599e33a1c26125f276f3e24d97b6b791c66557be7082b0ab499cb", + "mean": -0.001364820054732263, + "std": 0.08717333525419235, + "rms": 0.08718401938676834, + "max_abs": 2.515625 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1c2c457117b9853d1bfb10450b2479145dcdeb45e8d0908f663f8fc0ad2b09a3", + "mean": -0.0013473929138854146, + "std": 0.08629484474658966, + "rms": 0.08630536496639252, + "max_abs": 2.515625 + }, + "full_input": { + "shape": [ + 171, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8fc7559e0f718b262bb9d4111f39793293a79ac6246155481aa7401e561f4c83", + "mean": -0.0014526284066960216, + "std": 0.08839113265275955, + "rms": 0.08840306103229523, + "max_abs": 2.515625 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3af798a68a2dc5759530cc512620a3319f0b99751010997bbb8d7dc53e37e4ba", + "mean": -0.0012715753400698304, + "std": 0.08569701015949249, + "rms": 0.0857064425945282, + "max_abs": 2.453125 + }, + "full_input": { + "shape": [ + 155, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "530d49ffa1912faa4f9db8ad911494ac576cc33774811429207671fa31732df6", + "mean": -0.001288532861508429, + "std": 0.08657238632440567, + "rms": 0.08658196777105331, + "max_abs": 2.453125 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cc1fd052d4d50105d58aa1a0d0cfa403f7859f6c2ff5662f0b54fe74518a7713", + "mean": -0.00129831547383219, + "std": 0.08579958975315094, + "rms": 0.08580940961837769, + "max_abs": 2.453125 + }, + "full_input": { + "shape": [ + 171, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b8f951a6b5c2e30db68e6b0558cf58e0185c74f0c239059fd91c8f36dcfa37fb", + "mean": -0.001406000112183392, + "std": 0.08781933039426804, + "rms": 0.08783058077096939, + "max_abs": 2.453125 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "11332efd53a896c5780643dfa7647dc29b15b24ebdef154cc72cfb300c61416b", + "mean": -0.0012814084766432643, + "std": 0.08542225509881973, + "rms": 0.08543186634778976, + "max_abs": 2.46875 + }, + "full_input": { + "shape": [ + 155, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ffd541a566ebb70ae1facca2ead8957ee1457e71eae0f90f36c487483c37bb58", + "mean": -0.0013115375768393278, + "std": 0.08644414693117142, + "rms": 0.08645410090684891, + "max_abs": 2.46875 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "651ab357b1372e2190efe8fc8d686991f6fbdbdb65d68a59d1dc0ad7177beee4", + "mean": -0.0013170323800295591, + "std": 0.08560120314359665, + "rms": 0.08561132848262787, + "max_abs": 2.46875 + }, + "full_input": { + "shape": [ + 171, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4f9a7e761044a17860666d43e85ee5dd57b8d2a90c0ec59357eb0a18b3614181", + "mean": -0.0014359148917719722, + "std": 0.08777379989624023, + "rms": 0.08778554201126099, + "max_abs": 2.46875 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4cd1c7d4cb9919756cd0fe5d28ce441fe6eb96aa4f23714d23cd79a9681d7abc", + "mean": -0.0012785557191818953, + "std": 0.08542398363351822, + "rms": 0.08543355017900467, + "max_abs": 2.46875 + }, + "full_input": { + "shape": [ + 155, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fb66c6b9472996524bb7b20d21f177fa78b3fd8c654fd8bcc6bb81d86b813a47", + "mean": -0.0013087091501802206, + "std": 0.08630011230707169, + "rms": 0.08631002902984619, + "max_abs": 2.46875 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "756a1fd8a0285f0b554b54986b5ecbfea7899412bb513c5579c296f84dd99b73", + "mean": -0.0013142775278538465, + "std": 0.0856025293469429, + "rms": 0.08561261743307114, + "max_abs": 2.484375 + }, + "full_input": { + "shape": [ + 171, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e13a1f0da618b8a56e62a64db1107eb05bb9a0e0ffea185cb0d08bdd2537741d", + "mean": -0.001431753276847303, + "std": 0.08762302249670029, + "rms": 0.08763471990823746, + "max_abs": 2.484375 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9998283982276917, + "min_cosine_similarity": 0.998396098613739, + "mean_relative_l2": 0.01512408908456564, + "max_abs_delta": 0.08203125 + }, + "system_bos": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.999642014503479, + "min_cosine_similarity": 0.9977258443832397, + "mean_relative_l2": 0.0241080354899168, + "max_abs_delta": 0.0703125 + }, + "system_x": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9996427297592163, + "min_cosine_similarity": 0.9977073669433594, + "mean_relative_l2": 0.024338165298104286, + "max_abs_delta": 0.078125 + }, + "system_period": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9996688961982727, + "min_cosine_similarity": 0.9979510307312012, + "mean_relative_l2": 0.02357204258441925, + "max_abs_delta": 0.06640625 + }, + "bos_at_s0": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9899135828018188, + "min_cosine_similarity": 0.9691148996353149, + "mean_relative_l2": 0.13892801105976105, + "max_abs_delta": 0.217529296875 + }, + "bos_at_s1": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9913923740386963, + "min_cosine_similarity": 0.974449634552002, + "mean_relative_l2": 0.1283986121416092, + "max_abs_delta": 0.2158203125 + }, + "x_at_s0": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9907726645469666, + "min_cosine_similarity": 0.9690510034561157, + "mean_relative_l2": 0.13223600387573242, + "max_abs_delta": 0.21875 + }, + "x_at_s1": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9920722246170044, + "min_cosine_similarity": 0.974696695804596, + "mean_relative_l2": 0.12268967181444168, + "max_abs_delta": 0.22216796875 + }, + "period_at_s0": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9908671379089355, + "min_cosine_similarity": 0.9708429574966431, + "mean_relative_l2": 0.13169912993907928, + "max_abs_delta": 0.22412109375 + }, + "period_at_s1": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9921265840530396, + "min_cosine_similarity": 0.9749835729598999, + "mean_relative_l2": 0.12237779051065445, + "max_abs_delta": 0.22607421875 + } + } + }, + "layer_01": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fa515fc5569a22b2ef024e72c46e1f3d2b2cbfd40b998843a2b7f82d8be3e72c", + "mean": -0.0019382162718102336, + "std": 0.09926984459161758, + "rms": 0.09928876906633377, + "max_abs": 3.09375 + }, + "full_input": { + "shape": [ + 155, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7f790b6f5b6232254d0d8fa5a515eb035f95e3e314718970d833fc066c4cb054", + "mean": -0.0036649457179009914, + "std": 0.6470836997032166, + "rms": 0.6470940113067627, + "max_abs": 126.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "030bedbb20ef6b93509d7561c739408968c677708140210c460008bfc025fc6c", + "mean": -0.0019530587596818805, + "std": 0.09956926852464676, + "rms": 0.09958841651678085, + "max_abs": 3.109375 + }, + "full_input": { + "shape": [ + 171, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b504dfee79bada88d15eac0a36a435eeb71f24ea685ff9ad2804b106a937b7db", + "mean": -0.0037344363518059254, + "std": 0.6376044154167175, + "rms": 0.6376153230667114, + "max_abs": 134.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d2195d922502439d2fefbde61994e3881680abcd980321bed247dd5b5c7af4eb", + "mean": -0.002019683364778757, + "std": 0.09911584854125977, + "rms": 0.09913641959428787, + "max_abs": 3.09375 + }, + "full_input": { + "shape": [ + 155, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8775e6e670e7e93cc18c2f30a683dcb9d17fedf27ca05b247c4e74e6e505d653", + "mean": -0.001893413020297885, + "std": 0.10211329162120819, + "rms": 0.10213084518909454, + "max_abs": 4.71875 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "199a8011bd9dca0eb9d26afea178c49cf9786e1b11ec34c0cbf3f87533960cd1", + "mean": -0.002094746334478259, + "std": 0.0988755002617836, + "rms": 0.09889768809080124, + "max_abs": 3.09375 + }, + "full_input": { + "shape": [ + 171, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d740426277747eb275b62b8204ff192478ccc2b8faed40dcef973362d350256c", + "mean": -0.002087451983243227, + "std": 0.10310283303260803, + "rms": 0.10312396287918091, + "max_abs": 4.71875 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "05a79f2abd723f5d630480a04a20016abd944bf147640b3e3e0396d6746b050e", + "mean": -0.002043370623141527, + "std": 0.09908559173345566, + "rms": 0.09910666197538376, + "max_abs": 3.125 + }, + "full_input": { + "shape": [ + 155, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "da18b3faeba67d78a1e34b79fedaa8732f17d9565fe815a46fc216d25605c44b", + "mean": -0.0019172833999618888, + "std": 0.10210928320884705, + "rms": 0.10212727636098862, + "max_abs": 4.71875 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ace1c0901a0e1c5cc592a302fd105f3593df8b71c51ee25edc5d2fedc1c5f8fb", + "mean": -0.0021158980671316385, + "std": 0.09874293953180313, + "rms": 0.09876559674739838, + "max_abs": 3.09375 + }, + "full_input": { + "shape": [ + 171, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "687824bf931a94bd1983de5670571ffbb8cf7a78a79516f4ce0264357a44ebe2", + "mean": -0.0021080109290778637, + "std": 0.10304374247789383, + "rms": 0.10306530445814133, + "max_abs": 4.71875 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "66c28d4321fa13d27440c892f6bbe4defed42515e652b7b1ffcd07a2b2f46b8c", + "mean": -0.002037454629316926, + "std": 0.0990346223115921, + "rms": 0.09905556589365005, + "max_abs": 3.125 + }, + "full_input": { + "shape": [ + 155, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "474e22f3d3b4fb2ee2891639ce8b7e51471aeba45107e043861e61216a997741", + "mean": -0.0019226589938625693, + "std": 0.10184427350759506, + "rms": 0.10186241567134857, + "max_abs": 4.71875 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "964ca6856f5778f862d3e49a3e87e4f88c1184b4b06b9ce607fa3921216a1708", + "mean": -0.00211654556915164, + "std": 0.09871918708086014, + "rms": 0.09874187409877777, + "max_abs": 3.109375 + }, + "full_input": { + "shape": [ + 171, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3f66888a241d3e1f7fa985c1079116099b4d9963c768c18509326ccb9ef66073", + "mean": -0.002115634037181735, + "std": 0.10282711684703827, + "rms": 0.10284887999296188, + "max_abs": 4.71875 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9994208812713623, + "min_cosine_similarity": 0.9904501438140869, + "mean_relative_l2": 0.02981625311076641, + "max_abs_delta": 0.1015625 + }, + "system_bos": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9965173602104187, + "min_cosine_similarity": 0.9789352416992188, + "mean_relative_l2": 0.07915342599153519, + "max_abs_delta": 0.140625 + }, + "system_x": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9955359697341919, + "min_cosine_similarity": 0.97581946849823, + "mean_relative_l2": 0.08841497451066971, + "max_abs_delta": 0.1640625 + }, + "system_period": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9955336451530457, + "min_cosine_similarity": 0.9750429391860962, + "mean_relative_l2": 0.08865820616483688, + "max_abs_delta": 0.171875 + }, + "bos_at_s0": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9897069931030273, + "min_cosine_similarity": 0.970323920249939, + "mean_relative_l2": 0.1401946097612381, + "max_abs_delta": 0.169921875 + }, + "bos_at_s1": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9896579384803772, + "min_cosine_similarity": 0.9696451425552368, + "mean_relative_l2": 0.1396217942237854, + "max_abs_delta": 0.185546875 + }, + "x_at_s0": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9913148283958435, + "min_cosine_similarity": 0.9690202474594116, + "mean_relative_l2": 0.12734924256801605, + "max_abs_delta": 0.2421875 + }, + "x_at_s1": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9888601303100586, + "min_cosine_similarity": 0.9632172584533691, + "mean_relative_l2": 0.14368051290512085, + "max_abs_delta": 0.24609375 + }, + "period_at_s0": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9913964867591858, + "min_cosine_similarity": 0.9716820120811462, + "mean_relative_l2": 0.12706345319747925, + "max_abs_delta": 0.234375 + }, + "period_at_s1": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9888908863067627, + "min_cosine_similarity": 0.9650521874427795, + "mean_relative_l2": 0.14358453452587128, + "max_abs_delta": 0.24609375 + } + } + }, + "layer_02": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "30ffa3cce7acde4f6cfc69857e14f9d3f4a31c493a9e7f1f4b17dda24c3f5d10", + "mean": -0.001876818249002099, + "std": 0.11959700286388397, + "rms": 0.11961173266172409, + "max_abs": 3.546875 + }, + "full_input": { + "shape": [ + 155, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cdb643668ccd21bf3071ad7838e6f5e583b9ad91828f82c314468ac346b5519d", + "mean": -0.007871375419199467, + "std": 1.929736852645874, + "rms": 1.9297527074813843, + "max_abs": 392.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c17a4bc71f6d41b09d6d7b73cf514884def2f2f3a88bea0c6ae98f56f633b51f", + "mean": -0.001821492100134492, + "std": 0.11992783844470978, + "rms": 0.11994167417287827, + "max_abs": 3.5625 + }, + "full_input": { + "shape": [ + 171, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3c09a1ed77226709007ffb41cf07c5d249786efb10f9480ff6876b404d3728e7", + "mean": -0.008320564404129982, + "std": 2.039947032928467, + "rms": 2.039963960647583, + "max_abs": 436.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0c78c202e4224fdfbe6792cc78cd6b32196ea2d283595380b35078304e6a8d35", + "mean": -0.0019275133963674307, + "std": 0.1198902279138565, + "rms": 0.11990571767091751, + "max_abs": 3.59375 + }, + "full_input": { + "shape": [ + 155, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4e8c7037cd8b76416a291c27246e4f455170d74fa0a9fe08646643cee17d459f", + "mean": -0.0020376855973154306, + "std": 0.1789058893918991, + "rms": 0.17891748249530792, + "max_abs": 23.875 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8b35dc9221a394766ecead35b51d28ff449df52c1b3d7c6df66b63387fb29b0f", + "mean": -0.0018107491778209805, + "std": 0.11965908855199814, + "rms": 0.11967279016971588, + "max_abs": 3.59375 + }, + "full_input": { + "shape": [ + 171, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3f7211fc4fa81b9e3c1354d73f6bbefe221f28615c9c4fd58779aa7cc4f28015", + "mean": -0.001974565675482154, + "std": 0.1751403510570526, + "rms": 0.17515146732330322, + "max_abs": 23.875 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5c6c92689f961d05385fae1507d6e3e4ced0d82a0c47a13f1a4482deb7de9105", + "mean": -0.001958922017365694, + "std": 0.11960665881633759, + "rms": 0.11962269991636276, + "max_abs": 3.609375 + }, + "full_input": { + "shape": [ + 155, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9f4019ec1293deb790a4170aee1cdffb2ce961b61189c93827fc32e2a8a1fcd9", + "mean": -0.002070062095299363, + "std": 0.17877286672592163, + "rms": 0.17878486216068268, + "max_abs": 23.875 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "553c07c837982589bcb34a6e45f99cf3cff8263007a3b9511c5d6c8c2f393764", + "mean": -0.0017973020439967513, + "std": 0.11906848102807999, + "rms": 0.11908204853534698, + "max_abs": 3.578125 + }, + "full_input": { + "shape": [ + 171, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7daf521713e07c70d4cb49ce216308709b68f58f0b113b465144477266f9821b", + "mean": -0.001969381468370557, + "std": 0.17487893998622894, + "rms": 0.17489002645015717, + "max_abs": 23.875 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "73b8434db7355b08953b547b25bc6f3d2961636609ffe6b1b14f5eae20878058", + "mean": -0.0019146703416481614, + "std": 0.11942881345748901, + "rms": 0.11944416165351868, + "max_abs": 3.59375 + }, + "full_input": { + "shape": [ + 155, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "696b491532d6dab7146eaef9e77e1305070b4e36b34f115a60c85786fc85e648", + "mean": -0.002070559887215495, + "std": 0.17844270169734955, + "rms": 0.17845472693443298, + "max_abs": 23.875 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f2c3e4ee4ec9664ac387422c1faed892e9316b06348dce8cba18e2fb7d7d57ff", + "mean": -0.0017897317884489894, + "std": 0.11900322139263153, + "rms": 0.11901667714118958, + "max_abs": 3.5625 + }, + "full_input": { + "shape": [ + 171, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "85c6380eea73e9b76589b8326bee51bf61313774407eeb40e38e10086baa4047", + "mean": -0.0019889366813004017, + "std": 0.1746014505624771, + "rms": 0.17461276054382324, + "max_abs": 23.875 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9992956519126892, + "min_cosine_similarity": 0.9933272004127502, + "mean_relative_l2": 0.034545719623565674, + "max_abs_delta": 0.140625 + }, + "system_bos": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.996346116065979, + "min_cosine_similarity": 0.9835163354873657, + "mean_relative_l2": 0.08267121762037277, + "max_abs_delta": 0.15625 + }, + "system_x": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9949917197227478, + "min_cosine_similarity": 0.9786900877952576, + "mean_relative_l2": 0.09600955992937088, + "max_abs_delta": 0.171875 + }, + "system_period": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9951149821281433, + "min_cosine_similarity": 0.9778499603271484, + "mean_relative_l2": 0.0953214094042778, + "max_abs_delta": 0.171875 + }, + "bos_at_s0": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9914951920509338, + "min_cosine_similarity": 0.973863959312439, + "mean_relative_l2": 0.12781813740730286, + "max_abs_delta": 0.2158203125 + }, + "bos_at_s1": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9897957444190979, + "min_cosine_similarity": 0.9680214524269104, + "mean_relative_l2": 0.13912013173103333, + "max_abs_delta": 0.3125 + }, + "x_at_s0": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9918697476387024, + "min_cosine_similarity": 0.9674769043922424, + "mean_relative_l2": 0.12275029718875885, + "max_abs_delta": 0.3359375 + }, + "x_at_s1": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9880529642105103, + "min_cosine_similarity": 0.9563978910446167, + "mean_relative_l2": 0.14873436093330383, + "max_abs_delta": 0.40234375 + }, + "period_at_s0": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9918599128723145, + "min_cosine_similarity": 0.9691022634506226, + "mean_relative_l2": 0.12315911799669266, + "max_abs_delta": 0.34375 + }, + "period_at_s1": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9879787564277649, + "min_cosine_similarity": 0.9547716379165649, + "mean_relative_l2": 0.14931221306324005, + "max_abs_delta": 0.404296875 + } + } + }, + "layer_03": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9a9383c3c7305b03a475de84153733033806c1282260ce01039e075b74d18961", + "mean": -0.002460988238453865, + "std": 0.1466802954673767, + "rms": 0.1467009335756302, + "max_abs": 4.5625 + }, + "full_input": { + "shape": [ + 155, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "678ec3e01c7c2ee91dedbf696817f06e31920f3fa969fcb8d897e3cea65c70f0", + "mean": -0.010477043688297272, + "std": 5.786855697631836, + "rms": 5.786865234375, + "max_abs": 1136.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "137e8c5703c7e75c9a281b564e322a80efd69934cc5c445aca79d40ba9796b8b", + "mean": -0.0024326955899596214, + "std": 0.14707034826278687, + "rms": 0.14709047973155975, + "max_abs": 4.5625 + }, + "full_input": { + "shape": [ + 171, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "97a70dbb053913150d362b76d1fe6b623f35f32a25955c536004f6d1671c1cda", + "mean": -0.010931696742773056, + "std": 5.6944661140441895, + "rms": 5.694476127624512, + "max_abs": 1136.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2c1e0014ad39bfc277fa97b40eea18f106d530afdce609aae4ba98a31eb6b545", + "mean": -0.0025203125551342964, + "std": 0.14777535200119019, + "rms": 0.1477968394756317, + "max_abs": 4.5625 + }, + "full_input": { + "shape": [ + 155, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8f935ba026129a07be21a836fa172cb0231de6dba484a9c01d6fa283562ae7ca", + "mean": -0.003959492780268192, + "std": 5.1612725257873535, + "rms": 5.161273956298828, + "max_abs": 1136.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "faab605f9d3a46b12cba39fbbdffc6e8118658836d391c7f5044c39069067b22", + "mean": -0.0025537845212966204, + "std": 0.14808258414268494, + "rms": 0.14810460805892944, + "max_abs": 4.625 + }, + "full_input": { + "shape": [ + 171, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0cf1fcde5fc672a2f774a242aa484db21d76b6086b4b21a6ea8b3427438ffa60", + "mean": -0.0039801825769245625, + "std": 4.914106845855713, + "rms": 4.9141082763671875, + "max_abs": 1136.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fb72ea7d60128d8d7e61062dd63430b9fcf79b4ad8d2f73cfcdc28922c0a053a", + "mean": -0.0026290130335837603, + "std": 0.146823450922966, + "rms": 0.1468469798564911, + "max_abs": 4.625 + }, + "full_input": { + "shape": [ + 155, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "293607865b8be0228109a57d0a28ded1301c84648f8c6e30e243a2aaaaefc9e2", + "mean": -0.00409510126337409, + "std": 5.161238193511963, + "rms": 5.161240100860596, + "max_abs": 1136.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7048a5457dc2decd400b1b2de5405cd5007ad481741b920e62714dbef9478eb5", + "mean": -0.0026468608994036913, + "std": 0.1469992846250534, + "rms": 0.14702311158180237, + "max_abs": 4.65625 + }, + "full_input": { + "shape": [ + 171, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "46d7bf9dfdd271a071b9aafbf447fd627428fc5b00661eb6b05fda7a5e4935ad", + "mean": -0.004090731497853994, + "std": 4.91407585144043, + "rms": 4.914077281951904, + "max_abs": 1136.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cf3d3786f7ad2b549c8aa2a58f624579a8268f5598faa6558a0d72120f8b98a2", + "mean": -0.0026003813836723566, + "std": 0.1467227339744568, + "rms": 0.14674578607082367, + "max_abs": 4.625 + }, + "full_input": { + "shape": [ + 155, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f1182b367e3f252506abf638faf2f62189b986f30a11babdcc3abd2015f0fc2f", + "mean": -0.004078334663063288, + "std": 5.161228656768799, + "rms": 5.161230087280273, + "max_abs": 1136.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7feb19dbdd5f39a4d8cc4db9fe66882ec5a5374ef0e8d34bbe95402b425c6365", + "mean": -0.002639192622154951, + "std": 0.14712867140769958, + "rms": 0.14715233445167542, + "max_abs": 4.6875 + }, + "full_input": { + "shape": [ + 171, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d100022ff72202561e81d0006a45abaa34a2bf6d7be0e42fef6c7325c2d7e730", + "mean": -0.0040849000215530396, + "std": 4.914072513580322, + "rms": 4.914073944091797, + "max_abs": 1136.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9992809295654297, + "min_cosine_similarity": 0.9954967498779297, + "mean_relative_l2": 0.03520357981324196, + "max_abs_delta": 0.09375 + }, + "system_bos": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.996759831905365, + "min_cosine_similarity": 0.9884356260299683, + "mean_relative_l2": 0.078071229159832, + "max_abs_delta": 0.203125 + }, + "system_x": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9954695701599121, + "min_cosine_similarity": 0.981810986995697, + "mean_relative_l2": 0.09168261289596558, + "max_abs_delta": 0.25 + }, + "system_period": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.995478093624115, + "min_cosine_similarity": 0.9846383333206177, + "mean_relative_l2": 0.0922822505235672, + "max_abs_delta": 0.25 + }, + "bos_at_s0": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9927984476089478, + "min_cosine_similarity": 0.9775195121765137, + "mean_relative_l2": 0.1182812824845314, + "max_abs_delta": 0.234375 + }, + "bos_at_s1": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9913111925125122, + "min_cosine_similarity": 0.9727146625518799, + "mean_relative_l2": 0.12942509353160858, + "max_abs_delta": 0.30078125 + }, + "x_at_s0": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9928215742111206, + "min_cosine_similarity": 0.9718802571296692, + "mean_relative_l2": 0.11565447598695755, + "max_abs_delta": 0.31640625 + }, + "x_at_s1": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9894827008247375, + "min_cosine_similarity": 0.9594013690948486, + "mean_relative_l2": 0.1402183622121811, + "max_abs_delta": 0.39453125 + }, + "period_at_s0": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9928697943687439, + "min_cosine_similarity": 0.9724184274673462, + "mean_relative_l2": 0.11548146605491638, + "max_abs_delta": 0.31640625 + }, + "period_at_s1": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9892963171005249, + "min_cosine_similarity": 0.957451343536377, + "mean_relative_l2": 0.14144688844680786, + "max_abs_delta": 0.416015625 + } + } + }, + "layer_04": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8728c34c8dd456cfe143f71e209f8e3c59cfb04563d7d755ee247c677e4b87f7", + "mean": -0.0028026343788951635, + "std": 0.17628411948680878, + "rms": 0.17630639672279358, + "max_abs": 5.28125 + }, + "full_input": { + "shape": [ + 155, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6ec4a451eb605bc429ba023f44b187a208679636c145ddb3ebf556815a8db3a4", + "mean": -0.010623191483318806, + "std": 6.0378336906433105, + "rms": 6.037843227386475, + "max_abs": 1152.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "29b8cf436b7a53643f8e8ccce112f3a8f7a728a52d615fd03b4a35bf26724436", + "mean": -0.0027746190316975117, + "std": 0.17645971477031708, + "rms": 0.17648151516914368, + "max_abs": 5.28125 + }, + "full_input": { + "shape": [ + 171, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6398e8cba7367a06e7b496a39636fa2dd3f9483ad77f53c999bd5a89e9bf01ea", + "mean": -0.011102109216153622, + "std": 5.926857948303223, + "rms": 5.926867961883545, + "max_abs": 1152.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d502c2d63c60c48a109900c744639e715c324b69f5008ca1f975c2e3b2074c07", + "mean": -0.0029808871913701296, + "std": 0.1779823899269104, + "rms": 0.1780073493719101, + "max_abs": 5.3125 + }, + "full_input": { + "shape": [ + 155, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ad5a7d7a2ab6269b714fc9b481eddec0cda8f74a6bcb59c5f1f8b49fc2b53318", + "mean": -0.004227630794048309, + "std": 5.412874698638916, + "rms": 5.412876129150391, + "max_abs": 1152.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f580bda8c37ecf17d32b27a3cb8e0117db5953db587ad0be0537bc7e27b24227", + "mean": -0.0030041777063161135, + "std": 0.17791013419628143, + "rms": 0.17793548107147217, + "max_abs": 5.3125 + }, + "full_input": { + "shape": [ + 171, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c25a0fea441273bd0effd37872e7a72745a97b030ab20cd9212ca5c17aaa84ee", + "mean": -0.004236503504216671, + "std": 5.149473190307617, + "rms": 5.14947509765625, + "max_abs": 1152.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2ecb18ac9a35bcbcddefed90868198d0349c58bcd61d7cd8dccfba3e3ac4f05a", + "mean": -0.0030108457431197166, + "std": 0.17628681659698486, + "rms": 0.17631252110004425, + "max_abs": 5.3125 + }, + "full_input": { + "shape": [ + 155, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6528ac991b055dc03c4acc5906fbb1cff5d0eba2c3f4de0de59b9e97fd3759be", + "mean": -0.004225126933306456, + "std": 5.41280460357666, + "rms": 5.412806034088135, + "max_abs": 1152.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "88857728fc7be67ba1fdf43ba509998f2b62e02dbed84034820695eb38b675e2", + "mean": -0.0030013183131814003, + "std": 0.17644281685352325, + "rms": 0.17646834254264832, + "max_abs": 5.3125 + }, + "full_input": { + "shape": [ + 171, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "20ee3019d07fcfa5ca1e1b420f88d3dee7f00ac2b0512d382018821b2a5a5b86", + "mean": -0.004220281261950731, + "std": 5.149411678314209, + "rms": 5.149413585662842, + "max_abs": 1152.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "758b08fbec46ab230a9626fa6b70174ace04abedeca4e220ff2623f61e04e061", + "mean": -0.0029234504327178, + "std": 0.17610138654708862, + "rms": 0.1761256456375122, + "max_abs": 5.34375 + }, + "full_input": { + "shape": [ + 155, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "db51296671fc2f1f21131fd092c1f3b467251064666e17f5df8240ffba1f1329", + "mean": -0.004162061959505081, + "std": 5.412792205810547, + "rms": 5.41279411315918, + "max_abs": 1152.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ca7c6b03ee3f57ebaf4c769afb8e885a682c4931e004b72f89346585f8fc5268", + "mean": -0.0030044037848711014, + "std": 0.17638489603996277, + "rms": 0.1764104813337326, + "max_abs": 5.34375 + }, + "full_input": { + "shape": [ + 171, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5bae8dec7daff6002499dbe29f903e04c9b8ba6d63da3084848e74e14e0c4364", + "mean": -0.004223643336445093, + "std": 5.149404048919678, + "rms": 5.149405479431152, + "max_abs": 1152.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9992262721061707, + "min_cosine_similarity": 0.9949719905853271, + "mean_relative_l2": 0.03598719835281372, + "max_abs_delta": 0.109375 + }, + "system_bos": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9970199465751648, + "min_cosine_similarity": 0.9888390302658081, + "mean_relative_l2": 0.07481954991817474, + "max_abs_delta": 0.2109375 + }, + "system_x": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9957178235054016, + "min_cosine_similarity": 0.9848839044570923, + "mean_relative_l2": 0.08979956060647964, + "max_abs_delta": 0.1875 + }, + "system_period": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9956457018852234, + "min_cosine_similarity": 0.9839558601379395, + "mean_relative_l2": 0.09090091288089752, + "max_abs_delta": 0.203125 + }, + "bos_at_s0": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9942371249198914, + "min_cosine_similarity": 0.9816645383834839, + "mean_relative_l2": 0.10608811676502228, + "max_abs_delta": 0.34375 + }, + "bos_at_s1": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9926876425743103, + "min_cosine_similarity": 0.9773536920547485, + "mean_relative_l2": 0.11892686039209366, + "max_abs_delta": 0.3203125 + }, + "x_at_s0": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9934386014938354, + "min_cosine_similarity": 0.9752122163772583, + "mean_relative_l2": 0.1113143190741539, + "max_abs_delta": 0.34375 + }, + "x_at_s1": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9900496006011963, + "min_cosine_similarity": 0.9665682315826416, + "mean_relative_l2": 0.13736888766288757, + "max_abs_delta": 0.46484375 + }, + "period_at_s0": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9933780431747437, + "min_cosine_similarity": 0.9708592891693115, + "mean_relative_l2": 0.11182641237974167, + "max_abs_delta": 0.328125 + }, + "period_at_s1": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9896345734596252, + "min_cosine_similarity": 0.9574495553970337, + "mean_relative_l2": 0.1398838460445404, + "max_abs_delta": 0.50390625 + } + } + }, + "layer_05": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8a426c16589508400889debe1887d43f81df435e29ba462de2f6bb54de5b7f23", + "mean": -0.0021780559327453375, + "std": 0.20074962079524994, + "rms": 0.20076143741607666, + "max_abs": 5.9375 + }, + "full_input": { + "shape": [ + 155, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0f5961bb7f1f1a3af114471d0bff1ee1217961f3e36628ca0e5617874c998ecf", + "mean": -0.01108300220221281, + "std": 6.223031044006348, + "rms": 6.223041534423828, + "max_abs": 1152.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2993be280e98046d88a1cfeaf251729536a6d3f5694922c00d7d070f0f81b024", + "mean": -0.002212913241237402, + "std": 0.20087990164756775, + "rms": 0.20089209079742432, + "max_abs": 5.9375 + }, + "full_input": { + "shape": [ + 171, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f96ea4562ecf5932234e5eee63d4a7d5f1461beb2b689dc75ec5c3aa046fd746", + "mean": -0.011475631035864353, + "std": 6.110248565673828, + "rms": 6.110259532928467, + "max_abs": 1152.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0dc7dd9f2c5c2c708362d106f7b3840ad4d0734998cea708b54f83087e4191df", + "mean": -0.002336075296625495, + "std": 0.20202568173408508, + "rms": 0.2020391821861267, + "max_abs": 5.875 + }, + "full_input": { + "shape": [ + 155, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "14707d458ddec982c507482d7716bf95f59ee45b2915b00a122b3373c9995489", + "mean": -0.004026492591947317, + "std": 5.509197235107422, + "rms": 5.509199142456055, + "max_abs": 1152.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "802c615af8c17feab3d0a42093bbd57960680bb7c3b54be77bf3a71d0a72d9b7", + "mean": -0.002516429638490081, + "std": 0.20191921293735504, + "rms": 0.20193488895893097, + "max_abs": 6.0 + }, + "full_input": { + "shape": [ + 171, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5d5de826a2983018426d10bcbcf0c5bed3c877787e401ef3799f09910c708f59", + "mean": -0.004064024426043034, + "std": 5.239429473876953, + "rms": 5.239430904388428, + "max_abs": 1152.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f6325d9dee8bd5362a26c092648b95d31756a83e0877a4225ee1c73bac34f3c3", + "mean": -0.002480872441083193, + "std": 0.20128832757472992, + "rms": 0.2013036161661148, + "max_abs": 6.03125 + }, + "full_input": { + "shape": [ + 155, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9afb2058e940a4f326d48c297521c152acd7d2fdec79e97ddfec3cd5b8d27128", + "mean": -0.004098200239241123, + "std": 5.509152412414551, + "rms": 5.509154796600342, + "max_abs": 1152.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "89e0b757d93370d674bf0a840f50d67236176bf1fc19b59c68235a2d4c11605c", + "mean": -0.0027236943133175373, + "std": 0.20045368373394012, + "rms": 0.20047219097614288, + "max_abs": 6.0625 + }, + "full_input": { + "shape": [ + 171, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bdaf571e9d03551ac4fb4aa54ae81826174a723a4b4ecfe505ecd2843c5d24bb", + "mean": -0.004189989063888788, + "std": 5.239363193511963, + "rms": 5.239365100860596, + "max_abs": 1152.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "551b8e0e0dc34ab92d13dc2785241362c6989075675413f46cfa3bb818659ac6", + "mean": -0.002474283566698432, + "std": 0.2011229395866394, + "rms": 0.20113815367221832, + "max_abs": 6.03125 + }, + "full_input": { + "shape": [ + 155, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7f3fc058815b729ec23e993d494502655d9673bf710d47c589a78646e3669c57", + "mean": -0.004100588615983725, + "std": 5.50913667678833, + "rms": 5.509139060974121, + "max_abs": 1152.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "37d8d61d37966b57f56928ff41bf0ee933128292e934535586ab4c7d6a10733f", + "mean": -0.002755478722974658, + "std": 0.2002139538526535, + "rms": 0.20023292303085327, + "max_abs": 6.09375 + }, + "full_input": { + "shape": [ + 171, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "091c4d42f04eb8830eaba30a7cfd1ab49f61c956926e8aa7c5d788105a339216", + "mean": -0.00422759959474206, + "std": 5.239346981048584, + "rms": 5.239348888397217, + "max_abs": 1152.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.998775064945221, + "min_cosine_similarity": 0.9919889569282532, + "mean_relative_l2": 0.04564415663480759, + "max_abs_delta": 0.15625 + }, + "system_bos": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9962367415428162, + "min_cosine_similarity": 0.9877015948295593, + "mean_relative_l2": 0.08482570201158524, + "max_abs_delta": 0.296875 + }, + "system_x": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9943002462387085, + "min_cosine_similarity": 0.9836195111274719, + "mean_relative_l2": 0.10374651849269867, + "max_abs_delta": 0.28125 + }, + "system_period": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9939327239990234, + "min_cosine_similarity": 0.9832373857498169, + "mean_relative_l2": 0.10714807361364365, + "max_abs_delta": 0.2890625 + }, + "bos_at_s0": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9938550591468811, + "min_cosine_similarity": 0.9793046712875366, + "mean_relative_l2": 0.1094014123082161, + "max_abs_delta": 0.359375 + }, + "bos_at_s1": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9920212030410767, + "min_cosine_similarity": 0.974395751953125, + "mean_relative_l2": 0.12454957515001297, + "max_abs_delta": 0.5 + }, + "x_at_s0": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9927213191986084, + "min_cosine_similarity": 0.9692684412002563, + "mean_relative_l2": 0.11789154261350632, + "max_abs_delta": 0.453125 + }, + "x_at_s1": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9884347915649414, + "min_cosine_similarity": 0.9618936777114868, + "mean_relative_l2": 0.14858289062976837, + "max_abs_delta": 0.578125 + }, + "period_at_s0": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9927362203598022, + "min_cosine_similarity": 0.9656212329864502, + "mean_relative_l2": 0.11803563684225082, + "max_abs_delta": 0.34375 + }, + "period_at_s1": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.987906813621521, + "min_cosine_similarity": 0.952499508857727, + "mean_relative_l2": 0.15186935663223267, + "max_abs_delta": 0.5703125 + } + } + }, + "layer_06": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b53334991995a69a9375f43edb1e17431c29149294fa075284fc270d39d64fb8", + "mean": -0.0044414387084543705, + "std": 0.23817849159240723, + "rms": 0.23821988701820374, + "max_abs": 7.75 + }, + "full_input": { + "shape": [ + 155, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cf7cb333324aa620e9e98debe2048827be578e7a38b264a38b80978fe1a4cc0d", + "mean": -0.013453883118927479, + "std": 6.337188243865967, + "rms": 6.337202072143555, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "81eec126be0f116568cf0544e4a316bb3039d9c76fc2e440788d65f6d98b64a8", + "mean": -0.004504138603806496, + "std": 0.23862825334072113, + "rms": 0.23867075145244598, + "max_abs": 7.75 + }, + "full_input": { + "shape": [ + 171, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3027b22d9923d1aa73521656105aa832acb68ecc66a22e12bb29155661a776cf", + "mean": -0.013750738464295864, + "std": 6.221619606018066, + "rms": 6.221634864807129, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fe5337020388d795b45d0ac627a3b674e6b2e0e44bfc41d94b625a2a9da0ea61", + "mean": -0.004392434377223253, + "std": 0.23908652365207672, + "rms": 0.23912686109542847, + "max_abs": 7.6875 + }, + "full_input": { + "shape": [ + 155, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "45f943a338e7e9a702c75878b39d086ea331d091052b5fc19f306c08a6c67ff1", + "mean": -0.006033331621438265, + "std": 5.598540782928467, + "rms": 5.598543643951416, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "78f1f3dcbe1378bac60488e46f02de104bb508357cbed6fcff042ca7978b1857", + "mean": -0.004565743263810873, + "std": 0.23987627029418945, + "rms": 0.2399197220802307, + "max_abs": 7.9375 + }, + "full_input": { + "shape": [ + 171, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4f6111383dae8832891983a73d2d2112d1d89a05d9e91c0614200f55c298f2ac", + "mean": -0.005965420976281166, + "std": 5.324611663818359, + "rms": 5.324615478515625, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fa692764caa9b7d1825ea591d1affd4a2c9b01111c0793400793e25d16c51cbd", + "mean": -0.004498024005442858, + "std": 0.23914921283721924, + "rms": 0.23919151723384857, + "max_abs": 7.8125 + }, + "full_input": { + "shape": [ + 155, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5db1c4a4b63fa7e7db6cbf1dbcd22fd4b876f9d93abd423c6b27b3f58d2e0643", + "mean": -0.006052314303815365, + "std": 5.59851598739624, + "rms": 5.598519325256348, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3d46007ef83bb07af33fdadf0ff35d3684fae2c148d0cb450fcd5fd0d706cb30", + "mean": -0.0047025615349411964, + "std": 0.238783061504364, + "rms": 0.2388293594121933, + "max_abs": 7.9375 + }, + "full_input": { + "shape": [ + 171, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "402d303bbec15177a33fd5805f104f055f31365d58a6d61b34dc99508d2e1992", + "mean": -0.0060040028765797615, + "std": 5.3245439529418945, + "rms": 5.32454776763916, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cc9098e02d8b3f2d70e0844a6e3b514fe39e9e119537344da1da8007ea6f7eaf", + "mean": -0.0045740725472569466, + "std": 0.23893138766288757, + "rms": 0.2389751672744751, + "max_abs": 7.78125 + }, + "full_input": { + "shape": [ + 155, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1690aa2671a322cabfa4ddc3b873a541ea3bc4b415afafd2964ec8aae4a9fe36", + "mean": -0.006106396671384573, + "std": 5.598502159118652, + "rms": 5.598505020141602, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0bd2828de88b6d844283dfb9f39a8ff8e2141c36991424b79422c58e4129429a", + "mean": -0.00482977693900466, + "std": 0.23873528838157654, + "rms": 0.23878414928913116, + "max_abs": 7.90625 + }, + "full_input": { + "shape": [ + 171, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c97d779447c088280cac0ec7710bfcde7a10b2af8e9da95a0e0de94b0eb6e6a7", + "mean": -0.006107059307396412, + "std": 5.3245368003845215, + "rms": 5.324540615081787, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9986709356307983, + "min_cosine_similarity": 0.9918286800384521, + "mean_relative_l2": 0.047310296446084976, + "max_abs_delta": 0.1875 + }, + "system_bos": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9962927103042603, + "min_cosine_similarity": 0.9862035512924194, + "mean_relative_l2": 0.08389846980571747, + "max_abs_delta": 0.4375 + }, + "system_x": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9945245385169983, + "min_cosine_similarity": 0.9846847057342529, + "mean_relative_l2": 0.1016400009393692, + "max_abs_delta": 0.5 + }, + "system_period": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9940831065177917, + "min_cosine_similarity": 0.9818755388259888, + "mean_relative_l2": 0.10565987229347229, + "max_abs_delta": 0.3359375 + }, + "bos_at_s0": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9945977926254272, + "min_cosine_similarity": 0.9841774702072144, + "mean_relative_l2": 0.10207805037498474, + "max_abs_delta": 0.375 + }, + "bos_at_s1": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9931595921516418, + "min_cosine_similarity": 0.9808235764503479, + "mean_relative_l2": 0.11528453230857849, + "max_abs_delta": 0.5 + }, + "x_at_s0": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9933702945709229, + "min_cosine_similarity": 0.9772045016288757, + "mean_relative_l2": 0.11278907209634781, + "max_abs_delta": 0.5625 + }, + "x_at_s1": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9893578290939331, + "min_cosine_similarity": 0.9683554768562317, + "mean_relative_l2": 0.1428956240415573, + "max_abs_delta": 0.78125 + }, + "period_at_s0": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9933344721794128, + "min_cosine_similarity": 0.9743167161941528, + "mean_relative_l2": 0.11329121887683868, + "max_abs_delta": 0.5625 + }, + "period_at_s1": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.988761305809021, + "min_cosine_similarity": 0.9570502042770386, + "mean_relative_l2": 0.14657704532146454, + "max_abs_delta": 0.84375 + } + } + }, + "layer_07": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9970e61769ae56eb326343e834d3b4dc6117a08c0b5ebc94877e9902783b0297", + "mean": -0.004860613960772753, + "std": 0.2591465711593628, + "rms": 0.25919216871261597, + "max_abs": 7.71875 + }, + "full_input": { + "shape": [ + 155, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9c046b8c3b8cf02bf9b5850fd934eded4128f89f92e9318844d60dfa23a53ff3", + "mean": -0.013749170117080212, + "std": 6.355777263641357, + "rms": 6.355792045593262, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d0b072d8195a55c4228613fcc34d609a967a646135d87bbd9d363ab36393358b", + "mean": -0.004866860341280699, + "std": 0.25963231921195984, + "rms": 0.259677916765213, + "max_abs": 7.875 + }, + "full_input": { + "shape": [ + 171, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "aa40cc1ed7520e51b523451c54062e14c2c846d115ff52657f33f10e409ce7fb", + "mean": -0.014290016144514084, + "std": 6.24053955078125, + "rms": 6.240556240081787, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f6a23110810a1408386349b162ec333a4fab49027d6cf10a9ae01c9cec7d2971", + "mean": -0.004759347531944513, + "std": 0.2597489356994629, + "rms": 0.2597925364971161, + "max_abs": 7.75 + }, + "full_input": { + "shape": [ + 155, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "23c89248dac03e79d61dca8597274c5b81afa39375e23a547d5901a8b039eacf", + "mean": -0.00625867722555995, + "std": 5.609408378601074, + "rms": 5.609411716461182, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9a942dc342e0191aab2da1620d00d4468591e486582e34345fd85d9aa416fe79", + "mean": -0.00501970062032342, + "std": 0.2602638602256775, + "rms": 0.2603122591972351, + "max_abs": 8.0625 + }, + "full_input": { + "shape": [ + 171, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3d74eb0fd4766771b2d1c116d7546f75c305d056cb14ae7318f37932b70f007e", + "mean": -0.0065359692089259624, + "std": 5.3350701332092285, + "rms": 5.335074424743652, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b2fb54a69d3a20d7af4789f6689b4e9169677fab1df53014833efcbd8b097c30", + "mean": -0.004917372018098831, + "std": 0.25879815220832825, + "rms": 0.25884485244750977, + "max_abs": 7.71875 + }, + "full_input": { + "shape": [ + 155, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "73815611d21875624066b7ca6e4a1b3a20584fd9683073788d3e8bf5b674cbb3", + "mean": -0.006425866857171059, + "std": 5.609334945678711, + "rms": 5.609339237213135, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "55b5877bf2ec1eac3bf956eba80e5afa522b1e2a77929192d3b0d717df17be64", + "mean": -0.005144206341356039, + "std": 0.2593090236186981, + "rms": 0.25936007499694824, + "max_abs": 8.125 + }, + "full_input": { + "shape": [ + 171, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e3f6a073008f321609b88fb45ef35a854d3a26678c0993f0dcd1a852305dc549", + "mean": -0.006645700428634882, + "std": 5.334995269775391, + "rms": 5.334999084472656, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "930f069c983d2219ad1cdd18286b96745661c1a17214b28ad11f73820f1a8ca3", + "mean": -0.004907019902020693, + "std": 0.25873225927352905, + "rms": 0.25877878069877625, + "max_abs": 7.75 + }, + "full_input": { + "shape": [ + 155, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7c15787fae6deca0ee3c318bf7d06d525afa1f1f21e93482f8277de0a993c47d", + "mean": -0.0063453917391598225, + "std": 5.6093316078186035, + "rms": 5.609335422515869, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4feb8ed5f685afc22eda17c83159723b5b746c0a42d94efd918d4d0fb9ffeebd", + "mean": -0.00524730421602726, + "std": 0.25931474566459656, + "rms": 0.25936782360076904, + "max_abs": 8.125 + }, + "full_input": { + "shape": [ + 171, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "457f55cbe7dfbe2c45269e2ed6de7e9a6fbe886310952e8d7a4b53e92dbda3ad", + "mean": -0.0066768028773367405, + "std": 5.334999084472656, + "rms": 5.335003852844238, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9982688426971436, + "min_cosine_similarity": 0.9875861406326294, + "mean_relative_l2": 0.05390145629644394, + "max_abs_delta": 0.359375 + }, + "system_bos": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9959067702293396, + "min_cosine_similarity": 0.9851270318031311, + "mean_relative_l2": 0.0875450149178505, + "max_abs_delta": 0.59375 + }, + "system_x": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9939249157905579, + "min_cosine_similarity": 0.9768606424331665, + "mean_relative_l2": 0.10654338449239731, + "max_abs_delta": 0.59375 + }, + "system_period": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9933573603630066, + "min_cosine_similarity": 0.971032440662384, + "mean_relative_l2": 0.11143773794174194, + "max_abs_delta": 0.546875 + }, + "bos_at_s0": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9941990971565247, + "min_cosine_similarity": 0.9837478399276733, + "mean_relative_l2": 0.10536105930805206, + "max_abs_delta": 0.671875 + }, + "bos_at_s1": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9930026531219482, + "min_cosine_similarity": 0.9761946201324463, + "mean_relative_l2": 0.11620429158210754, + "max_abs_delta": 0.578125 + }, + "x_at_s0": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9926720261573792, + "min_cosine_similarity": 0.9763946533203125, + "mean_relative_l2": 0.11774051934480667, + "max_abs_delta": 0.734375 + }, + "x_at_s1": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9884682297706604, + "min_cosine_similarity": 0.9641076326370239, + "mean_relative_l2": 0.14818885922431946, + "max_abs_delta": 0.9375 + }, + "period_at_s0": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9926337599754333, + "min_cosine_similarity": 0.9723910093307495, + "mean_relative_l2": 0.11789814382791519, + "max_abs_delta": 0.609375 + }, + "period_at_s1": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9878643155097961, + "min_cosine_similarity": 0.9540194272994995, + "mean_relative_l2": 0.15186144411563873, + "max_abs_delta": 1.0 + } + } + }, + "layer_08": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c4e38fbc5919db442c5c25e5cb1b8df2227d9dd3d755b136ab251bc9613c853f", + "mean": -0.007531864568591118, + "std": 0.2995601296424866, + "rms": 0.2996547818183899, + "max_abs": 8.75 + }, + "full_input": { + "shape": [ + 155, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6ff791df8e8ae5f51e59a6ee1e988d9176bd652966be4b931b5067bd84f84e9a", + "mean": -0.016210375353693962, + "std": 6.378343105316162, + "rms": 6.378363609313965, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "718e79499fe27297a6e4df4018910a1b5e59d87c96ee49096b3c5418392bbb93", + "mean": -0.007482633925974369, + "std": 0.2997175455093384, + "rms": 0.29981091618537903, + "max_abs": 8.875 + }, + "full_input": { + "shape": [ + 171, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f43f2b74b11a561705664fcb441cee776140385abd1125ae8ea70eb9d8abfbc3", + "mean": -0.016351206228137016, + "std": 6.263026714324951, + "rms": 6.263047695159912, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3370706586113266dc2f1bc08a8b3b46ed4797285c72fe4a2bae3f93f8d69ac1", + "mean": -0.007561794947832823, + "std": 0.3010839521884918, + "rms": 0.301178902387619, + "max_abs": 8.75 + }, + "full_input": { + "shape": [ + 155, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3f17a71997bd3173edf1f83e3e0678c8ef3a583adef177288d5a1d8da95db1ec", + "mean": -0.008856263011693954, + "std": 5.622687339782715, + "rms": 5.62269401550293, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6bcffa4dacdb289491c5e379a4daa78f199b4f009b096b42cf98ef887e01e445", + "mean": -0.007711614016443491, + "std": 0.30209457874298096, + "rms": 0.3021929860115051, + "max_abs": 8.9375 + }, + "full_input": { + "shape": [ + 171, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "27693c8a6fa34023056d120c62389a83accd578083de3a0afc975cb4c94d5c86", + "mean": -0.008704643696546555, + "std": 5.34784460067749, + "rms": 5.347851276397705, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b99bc85c28fa0ddc887cfce0e47b07415c5b1f7f96bda4fd5b1321b1ceb14fe0", + "mean": -0.007647245656698942, + "std": 0.30067959427833557, + "rms": 0.30077680945396423, + "max_abs": 8.875 + }, + "full_input": { + "shape": [ + 155, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "50d86494ba8b93188a9f8b66c076d9c4d3b0fb31a4c5816631359794d5a71388", + "mean": -0.008945652283728123, + "std": 5.622645378112793, + "rms": 5.622652530670166, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7fe5de15119bb97e543b4ecc821f9e3a85ab2e8a9c5229130b44763c71b83753", + "mean": -0.00768303731456399, + "std": 0.30098891258239746, + "rms": 0.3010869324207306, + "max_abs": 9.0625 + }, + "full_input": { + "shape": [ + 171, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b9056ec453835c36f3b24ff579b54f98b514072e6b5595964157a2e7947ca736", + "mean": -0.008647640235722065, + "std": 5.3477678298950195, + "rms": 5.347774028778076, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "10aa0cb07f151712b7c4bad00f126a809d86b44df21ee62d84386410db330f5b", + "mean": -0.007643439341336489, + "std": 0.3005635142326355, + "rms": 0.3006606996059418, + "max_abs": 8.875 + }, + "full_input": { + "shape": [ + 155, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "05e078d7e385a1cf38f99ebe7ebebda71dfffb21856dd28967d51525df1262b2", + "mean": -0.008928966708481312, + "std": 5.622641563415527, + "rms": 5.622648239135742, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4ffe95dabdc774ae3dd120338004a001ab02d3d730d230f17d9bc42fe90f8642", + "mean": -0.0077894642017781734, + "std": 0.3005406856536865, + "rms": 0.30064159631729126, + "max_abs": 9.0 + }, + "full_input": { + "shape": [ + 171, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c4865247da0e971595cddcbc917c88d1e9cba09f8286b1df7cae115c3165fd20", + "mean": -0.008680067025125027, + "std": 5.347751140594482, + "rms": 5.347757816314697, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9977213740348816, + "min_cosine_similarity": 0.9833636283874512, + "mean_relative_l2": 0.06114565208554268, + "max_abs_delta": 0.375 + }, + "system_bos": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9951595664024353, + "min_cosine_similarity": 0.9821873903274536, + "mean_relative_l2": 0.09461682289838791, + "max_abs_delta": 0.625 + }, + "system_x": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9928213357925415, + "min_cosine_similarity": 0.9745842218399048, + "mean_relative_l2": 0.11572735011577606, + "max_abs_delta": 0.75 + }, + "system_period": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.99186110496521, + "min_cosine_similarity": 0.9704493880271912, + "mean_relative_l2": 0.12264169007539749, + "max_abs_delta": 0.75 + }, + "bos_at_s0": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9935585856437683, + "min_cosine_similarity": 0.9740474820137024, + "mean_relative_l2": 0.11039181053638458, + "max_abs_delta": 0.78125 + }, + "bos_at_s1": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9921665787696838, + "min_cosine_similarity": 0.9672959446907043, + "mean_relative_l2": 0.12246628105640411, + "max_abs_delta": 0.6875 + }, + "x_at_s0": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9915859699249268, + "min_cosine_similarity": 0.9709294438362122, + "mean_relative_l2": 0.12596073746681213, + "max_abs_delta": 0.96875 + }, + "x_at_s1": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9872546792030334, + "min_cosine_similarity": 0.9530652165412903, + "mean_relative_l2": 0.1555444449186325, + "max_abs_delta": 1.125 + }, + "period_at_s0": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9916234016418457, + "min_cosine_similarity": 0.9628980755805969, + "mean_relative_l2": 0.1257159411907196, + "max_abs_delta": 0.84375 + }, + "period_at_s1": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9863240122795105, + "min_cosine_similarity": 0.9510619640350342, + "mean_relative_l2": 0.16089850664138794, + "max_abs_delta": 1.1875 + } + } + }, + "layer_09": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3ebe7a85edce64b328f9bfde3ca32cfa041819b6aed81d23e1c0f870867e56a8", + "mean": -0.007829399779438972, + "std": 0.3517417013645172, + "rms": 0.35182881355285645, + "max_abs": 12.25 + }, + "full_input": { + "shape": [ + 155, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "dddc02d4bbeeaaa57b582cc85108a5364de95730bdf85f16466b84ac4ef123b2", + "mean": -0.016276011243462563, + "std": 6.381354331970215, + "rms": 6.381374835968018, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e8d8d0eb2657547bd0646cdc33db3582e3014f7311b6d50a34d90cefa6774113", + "mean": -0.007713566534221172, + "std": 0.35103046894073486, + "rms": 0.3511151969432831, + "max_abs": 12.1875 + }, + "full_input": { + "shape": [ + 171, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "30675b42f713e86261b7a9f6e19d266141accef6a7c0689dd142cab28e2c2cbe", + "mean": -0.016735995188355446, + "std": 6.265949726104736, + "rms": 6.265971660614014, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "54bf5c7b958a4fe56bae05001e51cdf8fef69f4f192fb022e4110d8c780aa53c", + "mean": -0.007867978885769844, + "std": 0.35360944271087646, + "rms": 0.35369694232940674, + "max_abs": 12.375 + }, + "full_input": { + "shape": [ + 155, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0b180b49ea85f95c5bd7ffb38576b5dfec52d7a2e74c38d5fdc04e5fe13df006", + "mean": -0.008995486423373222, + "std": 5.626049041748047, + "rms": 5.626056671142578, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "efd0df205f8d915384e74f371bb297d3ea64582de7000bf93e17efda6036aa8d", + "mean": -0.00791966449469328, + "std": 0.3539160192012787, + "rms": 0.3540046215057373, + "max_abs": 12.5 + }, + "full_input": { + "shape": [ + 171, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fb58b89c84968f76da3b9e757001cf02b0de4fa8c3f5da12b67755957fffe785", + "mean": -0.009171216748654842, + "std": 5.351261615753174, + "rms": 5.351269721984863, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e30d50a44c150b86a27da25b15eaa171d3afffcc224107af2ce9869f93474ffe", + "mean": -0.008019944652915001, + "std": 0.3542577922344208, + "rms": 0.3543485701084137, + "max_abs": 12.5 + }, + "full_input": { + "shape": [ + 155, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "933e272485da7a066eeb45522e9130265a04b38e46b2ebcd71194b900adaa137", + "mean": -0.009149850346148014, + "std": 5.626059055328369, + "rms": 5.626065731048584, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f59018458a0f6771732a5a18ee40f8184cf240f3ebf93a17840a8fa95960e52b", + "mean": -0.008080692030489445, + "std": 0.35312268137931824, + "rms": 0.35321512818336487, + "max_abs": 12.625 + }, + "full_input": { + "shape": [ + 171, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "eff3c6da668e9319a15beeb6c41ad2f338852f213ece006b80a4bd9669cdc914", + "mean": -0.009313629008829594, + "std": 5.351174831390381, + "rms": 5.35118293762207, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bbc6ae7bd855b244f46eda24d913ce3abb2ea175762a148ef5762d1741f7d5e7", + "mean": -0.008053398691117764, + "std": 0.3533356785774231, + "rms": 0.3534274399280548, + "max_abs": 12.375 + }, + "full_input": { + "shape": [ + 155, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9a817a2578f1410ea175b8c0c76c8364b6cea0fa2b7657461389597560ba653e", + "mean": -0.00910781230777502, + "std": 5.625987529754639, + "rms": 5.625994682312012, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "455e7432ffc629afefb0a64c6af619bfe38aaea30148ab8f3213f7caf696c3bb", + "mean": -0.008267643861472607, + "std": 0.35303962230682373, + "rms": 0.3531363904476166, + "max_abs": 12.5 + }, + "full_input": { + "shape": [ + 171, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3ba480b713ba8f314a2507cd9b746f584e3ec3f216a9e3afb7e4eb349bb62dc1", + "mean": -0.009362610056996346, + "std": 5.351149559020996, + "rms": 5.351158142089844, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9979562759399414, + "min_cosine_similarity": 0.9866265058517456, + "mean_relative_l2": 0.05813635513186455, + "max_abs_delta": 0.34375 + }, + "system_bos": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9958189725875854, + "min_cosine_similarity": 0.9852526783943176, + "mean_relative_l2": 0.08756330609321594, + "max_abs_delta": 0.6875 + }, + "system_x": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9935754537582397, + "min_cosine_similarity": 0.9749874472618103, + "mean_relative_l2": 0.10942769050598145, + "max_abs_delta": 0.8125 + }, + "system_period": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9929065704345703, + "min_cosine_similarity": 0.973513126373291, + "mean_relative_l2": 0.11463543772697449, + "max_abs_delta": 0.875 + }, + "bos_at_s0": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9946587085723877, + "min_cosine_similarity": 0.9801270365715027, + "mean_relative_l2": 0.10052338987588882, + "max_abs_delta": 0.78125 + }, + "bos_at_s1": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9934618473052979, + "min_cosine_similarity": 0.9763251543045044, + "mean_relative_l2": 0.11179906874895096, + "max_abs_delta": 0.6875 + }, + "x_at_s0": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9929845929145813, + "min_cosine_similarity": 0.9768531322479248, + "mean_relative_l2": 0.11480879783630371, + "max_abs_delta": 0.90625 + }, + "x_at_s1": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9893463253974915, + "min_cosine_similarity": 0.9670358300209045, + "mean_relative_l2": 0.1423598974943161, + "max_abs_delta": 1.125 + }, + "period_at_s0": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9930528998374939, + "min_cosine_similarity": 0.9708090424537659, + "mean_relative_l2": 0.11416726559400558, + "max_abs_delta": 0.9375 + }, + "period_at_s1": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9886130690574646, + "min_cosine_similarity": 0.9611220359802246, + "mean_relative_l2": 0.14722339808940887, + "max_abs_delta": 1.21875 + } + } + }, + "layer_10": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "57cdf8297d8f03b09021c6f9f401487b05dcbfd2ecbde9b2039544367f0d7bcc", + "mean": -0.00627168919891119, + "std": 0.3890114426612854, + "rms": 0.3890620172023773, + "max_abs": 12.9375 + }, + "full_input": { + "shape": [ + 155, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "70c21cdd22c3a32284ccee1b649cc1c98a8b3d56931ef48deb288f2b344ea6cc", + "mean": -0.015125831589102745, + "std": 6.388749599456787, + "rms": 6.388767719268799, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "25753e287019287246dad3b46a597cb64f4e53c507a10008451c904bada70847", + "mean": -0.006254247389733791, + "std": 0.3887815773487091, + "rms": 0.38883185386657715, + "max_abs": 13.0 + }, + "full_input": { + "shape": [ + 171, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4191de9122a4911c6319611bc5b164a3c8299d76a14e2ce8b484b2144cb11ec4", + "mean": -0.015874512493610382, + "std": 6.2731828689575195, + "rms": 6.273202896118164, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "15c462b755d5bec3c62eafea4bd01d8850ac2c4e5e9592de0cb192ff1a89f874", + "mean": -0.006241415161639452, + "std": 0.3904804587364197, + "rms": 0.3905303478240967, + "max_abs": 13.0 + }, + "full_input": { + "shape": [ + 155, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9a59bbf171f4f6d4111aac0508fffd41cc4c80d357d596f8f8e70165cb0a287f", + "mean": -0.00787934847176075, + "std": 5.634099960327148, + "rms": 5.634105682373047, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "59383fc67a68e83e28ff68d30b84089499c31b19a4b28dc74e922df97c482567", + "mean": -0.00634915241971612, + "std": 0.39119282364845276, + "rms": 0.3912443518638611, + "max_abs": 13.125 + }, + "full_input": { + "shape": [ + 171, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8b735933f04f19f94808fd96e19353899c1bec0dde0ff610f3cae66cfa93f28b", + "mean": -0.008275792002677917, + "std": 5.359270095825195, + "rms": 5.359276294708252, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0c8bcbc43ab4a05d9c48f8d750c9e8ca6a9c9f8b36d39f793d3b9b8a4d07e336", + "mean": -0.006360434461385012, + "std": 0.39094728231430054, + "rms": 0.3909990191459656, + "max_abs": 13.125 + }, + "full_input": { + "shape": [ + 155, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "90494d360c85937afde7c2e89cefdb8d4854d980af893ba6739a60886a0df019", + "mean": -0.008006757125258446, + "std": 5.634096145629883, + "rms": 5.634101867675781, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "28110d4e96c126b71d5d56214ac4122794c173452b5895c37e2d7ad8285a5333", + "mean": -0.006590715143829584, + "std": 0.3906252682209015, + "rms": 0.39068084955215454, + "max_abs": 13.25 + }, + "full_input": { + "shape": [ + 171, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f32b96c891549f615325dfc33ada88f33c61243e083294d529c13c50d8c1e5db", + "mean": -0.008516838774085045, + "std": 5.359165668487549, + "rms": 5.359172344207764, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "15df77ec6bead999bd0235e50a65c503a8ec8f5ebb5378ac01b8b3b5c1971050", + "mean": -0.0063291206024587154, + "std": 0.39042019844055176, + "rms": 0.39047151803970337, + "max_abs": 13.125 + }, + "full_input": { + "shape": [ + 155, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8b1246397ed9bd696474ce9740c131d9750005123abfdc4a89488b37c209f321", + "mean": -0.007878893986344337, + "std": 5.634039878845215, + "rms": 5.634045600891113, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a3d38d5069f08a6f2cd3f7c231d844e5c92eeabfa18a9c901b6c372c9dbc3c8e", + "mean": -0.006717602722346783, + "std": 0.39021816849708557, + "rms": 0.3902759850025177, + "max_abs": 13.25 + }, + "full_input": { + "shape": [ + 171, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8c94451afe676ad4f7ea57f14ce19fa7ff4a203a2aa35e019af5ec43ab42cba6", + "mean": -0.008534860797226429, + "std": 5.359121322631836, + "rms": 5.359128475189209, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9976637363433838, + "min_cosine_similarity": 0.9878249168395996, + "mean_relative_l2": 0.06216907501220703, + "max_abs_delta": 0.375 + }, + "system_bos": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9954900741577148, + "min_cosine_similarity": 0.9851127862930298, + "mean_relative_l2": 0.0909750759601593, + "max_abs_delta": 0.65625 + }, + "system_x": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9932352900505066, + "min_cosine_similarity": 0.9747017025947571, + "mean_relative_l2": 0.11264114826917648, + "max_abs_delta": 0.625 + }, + "system_period": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.992613673210144, + "min_cosine_similarity": 0.9761508703231812, + "mean_relative_l2": 0.11745239794254303, + "max_abs_delta": 0.75 + }, + "bos_at_s0": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9941937923431396, + "min_cosine_similarity": 0.9760261178016663, + "mean_relative_l2": 0.10455803573131561, + "max_abs_delta": 0.6875 + }, + "bos_at_s1": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9929476380348206, + "min_cosine_similarity": 0.9718047380447388, + "mean_relative_l2": 0.11533655226230621, + "max_abs_delta": 0.71875 + }, + "x_at_s0": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9925561547279358, + "min_cosine_similarity": 0.9755526781082153, + "mean_relative_l2": 0.1182572990655899, + "max_abs_delta": 0.6875 + }, + "x_at_s1": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9888538122177124, + "min_cosine_similarity": 0.9663249254226685, + "mean_relative_l2": 0.14574705064296722, + "max_abs_delta": 1.125 + }, + "period_at_s0": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9926658272743225, + "min_cosine_similarity": 0.9726414680480957, + "mean_relative_l2": 0.11769112199544907, + "max_abs_delta": 1.0625 + }, + "period_at_s1": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9882723093032837, + "min_cosine_similarity": 0.9618111848831177, + "mean_relative_l2": 0.14927434921264648, + "max_abs_delta": 1.15625 + } + } + }, + "layer_11": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "26dee4c3424c673d34a8d2e127d8dc77908138f6b4f2c4b919277c009accb5a9", + "mean": -0.012424243614077568, + "std": 0.47987622022628784, + "rms": 0.48003700375556946, + "max_abs": 17.125 + }, + "full_input": { + "shape": [ + 155, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "652a7b238b818c9a2dbe84d4a6b7d93baf39f64c70301fe9c8c33579ea33d014", + "mean": -0.019915591925382614, + "std": 6.427504062652588, + "rms": 6.427534580230713, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d4e1e290411038ebf5e084f51545db1ba2e73dac3f1b03910dc3d4ecd12d6975", + "mean": -0.012534544803202152, + "std": 0.4789254069328308, + "rms": 0.4790893793106079, + "max_abs": 17.125 + }, + "full_input": { + "shape": [ + 171, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e9ff928957398a541b3f4cef223ff5dc76c0a2689c3bfb78c7e1f082d9901bc3", + "mean": -0.020370585843920708, + "std": 6.310478687286377, + "rms": 6.310511589050293, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1a02916fffcbfe3d004398ef93855180885a3637182bd8eaebeb4a671b465581", + "mean": -0.012250286526978016, + "std": 0.48094794154167175, + "rms": 0.48110392689704895, + "max_abs": 16.875 + }, + "full_input": { + "shape": [ + 155, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a6426a83ee9f09743e9addfa141fa7260b9bd7aca880aeb3f57ff0d03a0e07e0", + "mean": -0.012517689727246761, + "std": 5.667154312133789, + "rms": 5.667167663574219, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "38c96f47c5384d49dae9c6ec3a02034a6d9623338c10ad0b8b1d86cdc98e7ca1", + "mean": -0.012467187829315662, + "std": 0.48166167736053467, + "rms": 0.48182302713394165, + "max_abs": 17.0 + }, + "full_input": { + "shape": [ + 171, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ef63c2bf0ce3d1027dfa1d2658d946d6ab603859874cc6dad64eca9ce9cc8acb", + "mean": -0.012633834965527058, + "std": 5.391302585601807, + "rms": 5.391316890716553, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "22048944d8e0de6313c64fb79aed9c5e7292b42bfeb55824fb946ba37fdf5b31", + "mean": -0.012461450882256031, + "std": 0.48282039165496826, + "rms": 0.4829811453819275, + "max_abs": 17.25 + }, + "full_input": { + "shape": [ + 155, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "566fa23a83b2a3efe4349ef1e791f9fa6f28075fda8b0c7738bc219a1a8d74fa", + "mean": -0.012658159248530865, + "std": 5.667252540588379, + "rms": 5.667266845703125, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1de63c70662df7abf202abb0cae465c8e95f4de2c23fe6e98774d6a7bb3f5a03", + "mean": -0.012499392032623291, + "std": 0.4807315468788147, + "rms": 0.48089399933815, + "max_abs": 17.0 + }, + "full_input": { + "shape": [ + 171, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ab323ecbf62390b793b13fb838aa7e50d9334db574a3fe0dc6b117fe1ace1294", + "mean": -0.012655661441385746, + "std": 5.391106605529785, + "rms": 5.3911213874816895, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ba9fcbed59841ddc24feeeccf3507312b26203d215236972444410a8416ca080", + "mean": -0.012392327189445496, + "std": 0.4808768630027771, + "rms": 0.481036514043808, + "max_abs": 17.25 + }, + "full_input": { + "shape": [ + 155, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d06ac188043bf5dd5d8b8e7a70f21df54aa2aa32e20ea5c8797fd8ce5356e044", + "mean": -0.012499271892011166, + "std": 5.667074203491211, + "rms": 5.667087554931641, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1741eba2d1003296ed8507ce3b83e78e3aaa5d7135b10448cf1de89f2c1056df", + "mean": -0.012657355517148972, + "std": 0.4790765047073364, + "rms": 0.4792436361312866, + "max_abs": 16.875 + }, + "full_input": { + "shape": [ + 171, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b66f6883ab83defad0cace8df5b87b963d4b891232777a335707b45ca0ce2204", + "mean": -0.012673375196754932, + "std": 5.390961170196533, + "rms": 5.3909759521484375, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9978082776069641, + "min_cosine_similarity": 0.9817674160003662, + "mean_relative_l2": 0.06065206602215767, + "max_abs_delta": 0.4375 + }, + "system_bos": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9960644245147705, + "min_cosine_similarity": 0.9850434064865112, + "mean_relative_l2": 0.08516056090593338, + "max_abs_delta": 0.9375 + }, + "system_x": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9938153624534607, + "min_cosine_similarity": 0.9813121557235718, + "mean_relative_l2": 0.10826265811920166, + "max_abs_delta": 0.8125 + }, + "system_period": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9931749701499939, + "min_cosine_similarity": 0.979598343372345, + "mean_relative_l2": 0.11382939666509628, + "max_abs_delta": 0.875 + }, + "bos_at_s0": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9951964020729065, + "min_cosine_similarity": 0.9812230467796326, + "mean_relative_l2": 0.0950530543923378, + "max_abs_delta": 1.0625 + }, + "bos_at_s1": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9941381812095642, + "min_cosine_similarity": 0.9772344827651978, + "mean_relative_l2": 0.10555439442396164, + "max_abs_delta": 1.0625 + }, + "x_at_s0": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9938912987709045, + "min_cosine_similarity": 0.9788100719451904, + "mean_relative_l2": 0.10749754309654236, + "max_abs_delta": 1.125 + }, + "x_at_s1": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.990472674369812, + "min_cosine_similarity": 0.9683462381362915, + "mean_relative_l2": 0.1353701949119568, + "max_abs_delta": 1.3125 + }, + "period_at_s0": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9938008189201355, + "min_cosine_similarity": 0.9796942472457886, + "mean_relative_l2": 0.10822682082653046, + "max_abs_delta": 1.25 + }, + "period_at_s1": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9898808598518372, + "min_cosine_similarity": 0.9583873748779297, + "mean_relative_l2": 0.13921725749969482, + "max_abs_delta": 1.5625 + } + } + }, + "layer_12": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4a146a41d534b43b25a1eb0a3199cc8ad1b856dcf829975798ce565ea2a0ec5f", + "mean": -0.011587669141590595, + "std": 0.4952505826950073, + "rms": 0.49538612365722656, + "max_abs": 15.6875 + }, + "full_input": { + "shape": [ + 155, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2b9d84665cc08a088655da19e1573dfbadf457368320cc525cbec1c5a544e08d", + "mean": -0.01958598382771015, + "std": 6.472404479980469, + "rms": 6.4724345207214355, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d167af31cb7e8e53c41c28fa32c86ff468b036fb1ccd2bd251a08344ef71fbc6", + "mean": -0.011665722355246544, + "std": 0.49531427025794983, + "rms": 0.4954516291618347, + "max_abs": 15.625 + }, + "full_input": { + "shape": [ + 171, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1dcc471cb6cc065222f1bc6c61c0a0f974b78dc5715c73741ae549335c7c8720", + "mean": -0.019826054573059082, + "std": 6.356735706329346, + "rms": 6.356766700744629, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e741211d05cb9454a72e7191c43daefa33c2e3ee2d6e79e67daeb45cf1b82d5b", + "mean": -0.011537625454366207, + "std": 0.4968257546424866, + "rms": 0.49695971608161926, + "max_abs": 15.1875 + }, + "full_input": { + "shape": [ + 155, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bcba8cf9c1476579de329cbc003c50c9c313b2a94401db87add64362d74e08e0", + "mean": -0.012182052247226238, + "std": 5.6775994300842285, + "rms": 5.677612781524658, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "28a322bfe80d9cbb4651a9594951dce85c2343b383cd952c2c7b2bcdfca856c1", + "mean": -0.01168263889849186, + "std": 0.49728530645370483, + "rms": 0.4974225163459778, + "max_abs": 15.375 + }, + "full_input": { + "shape": [ + 171, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "93fd34f1c268b95684891525202498228b05c05b73ecde9001eaf6ee43d43a4c", + "mean": -0.012132534757256508, + "std": 5.401824474334717, + "rms": 5.401838302612305, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "049cc88b19f722279692bef7e777a6cc943cd07aba27b8baba768e70078d67b0", + "mean": -0.011668290011584759, + "std": 0.49736401438713074, + "rms": 0.49750083684921265, + "max_abs": 15.5625 + }, + "full_input": { + "shape": [ + 155, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "50c44536ac435b4f10a5aa4db4596e3a560b73b820632f64e4bb63718c197904", + "mean": -0.012434196658432484, + "std": 5.677602767944336, + "rms": 5.677616119384766, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5440c19b24852dc353075b8e42e68a48e9eb488ba40be22d708afa0e7292ae00", + "mean": -0.011705533601343632, + "std": 0.49613699316978455, + "rms": 0.49627506732940674, + "max_abs": 15.625 + }, + "full_input": { + "shape": [ + 171, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "93619cefa61dc3b5b019a02c892292f207b66f760323931f3edcdaf430bfe3fd", + "mean": -0.012192260473966599, + "std": 5.401523113250732, + "rms": 5.40153694152832, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cb008b38ffc24593df21c80d6b927e46285c78adea0b12f9155c34bdeb496d03", + "mean": -0.011664657853543758, + "std": 0.496367484331131, + "rms": 0.4965045154094696, + "max_abs": 15.4375 + }, + "full_input": { + "shape": [ + 155, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "36b56c6ad86d065b9fed449d90e622242eb1d11b64cccb1c6661ce934df197d8", + "mean": -0.012260439805686474, + "std": 5.677468776702881, + "rms": 5.677482604980469, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b4ad0f3a8c82c6400af3eaab616de2b1b76addb6e68820eb783be84f8b486f2e", + "mean": -0.011782489717006683, + "std": 0.4955862760543823, + "rms": 0.4957263171672821, + "max_abs": 15.5 + }, + "full_input": { + "shape": [ + 171, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0c02d89418c63db59ad170862ce2426df48168fea605c246c66f4b44d6a68247", + "mean": -0.012086603790521622, + "std": 5.401482582092285, + "rms": 5.401495933532715, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9975671768188477, + "min_cosine_similarity": 0.9832701683044434, + "mean_relative_l2": 0.06440746784210205, + "max_abs_delta": 0.5 + }, + "system_bos": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9957365989685059, + "min_cosine_similarity": 0.9839073419570923, + "mean_relative_l2": 0.08867236971855164, + "max_abs_delta": 0.875 + }, + "system_x": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.993408203125, + "min_cosine_similarity": 0.9798171520233154, + "mean_relative_l2": 0.11176932603120804, + "max_abs_delta": 0.75 + }, + "system_period": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9926941990852356, + "min_cosine_similarity": 0.9768795967102051, + "mean_relative_l2": 0.11784693598747253, + "max_abs_delta": 0.9375 + }, + "bos_at_s0": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9947899580001831, + "min_cosine_similarity": 0.9806658625602722, + "mean_relative_l2": 0.09895338863134384, + "max_abs_delta": 0.625 + }, + "bos_at_s1": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9936098456382751, + "min_cosine_similarity": 0.9768376350402832, + "mean_relative_l2": 0.11010605096817017, + "max_abs_delta": 0.8125 + }, + "x_at_s0": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9933651089668274, + "min_cosine_similarity": 0.9797061681747437, + "mean_relative_l2": 0.11188973486423492, + "max_abs_delta": 0.9375 + }, + "x_at_s1": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9898378849029541, + "min_cosine_similarity": 0.9699636697769165, + "mean_relative_l2": 0.13972227275371552, + "max_abs_delta": 1.125 + }, + "period_at_s0": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.993316650390625, + "min_cosine_similarity": 0.978840708732605, + "mean_relative_l2": 0.11235737800598145, + "max_abs_delta": 1.1875 + }, + "period_at_s1": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9891133308410645, + "min_cosine_similarity": 0.9613485336303711, + "mean_relative_l2": 0.1444445550441742, + "max_abs_delta": 1.4375 + } + } + }, + "layer_13": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2b2e44f3bffc40592d8df849dc4e9713655c271eed51a5e819220751d2736b34", + "mean": -0.015206226147711277, + "std": 0.523065984249115, + "rms": 0.5232869982719421, + "max_abs": 15.875 + }, + "full_input": { + "shape": [ + 155, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "74225bd3a50426da2fddb790a80bef96a5aad43a0065511a822f59337d869990", + "mean": -0.0226739551872015, + "std": 6.478932857513428, + "rms": 6.478972434997559, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "41c63f2ed6f9b0b665a596c050d0d3ad0dbe9393eabd4ce3b903af903f863db5", + "mean": -0.01517834048718214, + "std": 0.5230487585067749, + "rms": 0.5232689380645752, + "max_abs": 15.9375 + }, + "full_input": { + "shape": [ + 171, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9a9fe043dc0ae8add8869c55e60bec9124be1f0ed85527903f485b88c09685e5", + "mean": -0.02294425666332245, + "std": 6.363513946533203, + "rms": 6.36355447769165, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ad0bef9919ca396889a668eac18e4e0d64a30f753f98a1876bb48e996a0c9900", + "mean": -0.015151306055486202, + "std": 0.5242411494255066, + "rms": 0.5244600176811218, + "max_abs": 15.5 + }, + "full_input": { + "shape": [ + 155, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "281bf476b5ced1d292c2f122b49415a4ee22505237fbb8674cea97de40752bc9", + "mean": -0.015247169882059097, + "std": 5.683692455291748, + "rms": 5.683712482452393, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f06ccff3482a0fc3e14c8a4e8d5170704a5fa98da2dae895a1fa6ebecf5001e1", + "mean": -0.015251008793711662, + "std": 0.5247267484664917, + "rms": 0.5249483585357666, + "max_abs": 15.875 + }, + "full_input": { + "shape": [ + 171, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "260fa0fd53cd47ce64599c51b9250eee8fe80226b346ee6fc1f1e26eb234dc85", + "mean": -0.015231028199195862, + "std": 5.408287525177002, + "rms": 5.408308982849121, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "32f9af9feae8eb8b54ba36332360e8e03e413466a218ff62fb62574c37115e51", + "mean": -0.015347563661634922, + "std": 0.5251707434654236, + "rms": 0.5253949165344238, + "max_abs": 16.25 + }, + "full_input": { + "shape": [ + 155, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d182f65a13e7e0bc6f5e34ab52174630c9abad6802b36ce694d9706e7f6bf057", + "mean": -0.015605875290930271, + "std": 5.683778762817383, + "rms": 5.683799743652344, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c961066f28f7f3b7068a4142678daf65a5559e535769a28271584b764c0e3389", + "mean": -0.015282823704183102, + "std": 0.5243614315986633, + "rms": 0.5245841145515442, + "max_abs": 16.25 + }, + "full_input": { + "shape": [ + 171, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4ddb2ccb143270ad5e0bb238e175a83d7e689cff1b2cd1505cd22d4957194e07", + "mean": -0.015284174121916294, + "std": 5.4080634117126465, + "rms": 5.408085346221924, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bf945212a4b5de1f731d10da960a121ae7ece0f42f12d4a539455437027be688", + "mean": -0.015291291289031506, + "std": 0.5238749980926514, + "rms": 0.5240980982780457, + "max_abs": 16.25 + }, + "full_input": { + "shape": [ + 155, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4a1a1addf199b49e98ab038982521e487608a8f858442d20e293739f5b5397e8", + "mean": -0.015366600826382637, + "std": 5.683600902557373, + "rms": 5.683621406555176, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "56659c10f34cbee8ca35ee97f93196de02ffc870694a4cdf609311193e7f8e92", + "mean": -0.015311423689126968, + "std": 0.5238775014877319, + "rms": 0.524101197719574, + "max_abs": 16.25 + }, + "full_input": { + "shape": [ + 171, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c46b531afe81b5f06427435442cd8994753b8055561a9cbf3b7e5d9a052e4360", + "mean": -0.015172972343862057, + "std": 5.408017635345459, + "rms": 5.40803861618042, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.997328519821167, + "min_cosine_similarity": 0.9804682731628418, + "mean_relative_l2": 0.06745976209640503, + "max_abs_delta": 0.5 + }, + "system_bos": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9958221316337585, + "min_cosine_similarity": 0.9811165928840637, + "mean_relative_l2": 0.08778461813926697, + "max_abs_delta": 0.8125 + }, + "system_x": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9935750961303711, + "min_cosine_similarity": 0.9825094938278198, + "mean_relative_l2": 0.11045338958501816, + "max_abs_delta": 0.9375 + }, + "system_period": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9928121566772461, + "min_cosine_similarity": 0.9800392389297485, + "mean_relative_l2": 0.11712131649255753, + "max_abs_delta": 1.0 + }, + "bos_at_s0": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9948346614837646, + "min_cosine_similarity": 0.9829903841018677, + "mean_relative_l2": 0.09848790615797043, + "max_abs_delta": 0.625 + }, + "bos_at_s1": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9937102198600769, + "min_cosine_similarity": 0.9688999652862549, + "mean_relative_l2": 0.10871603339910507, + "max_abs_delta": 0.9375 + }, + "x_at_s0": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9934584498405457, + "min_cosine_similarity": 0.9795863628387451, + "mean_relative_l2": 0.1112578734755516, + "max_abs_delta": 1.0625 + }, + "x_at_s1": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9901190996170044, + "min_cosine_similarity": 0.9660159945487976, + "mean_relative_l2": 0.13763611018657684, + "max_abs_delta": 1.3125 + }, + "period_at_s0": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9935991764068604, + "min_cosine_similarity": 0.979723334312439, + "mean_relative_l2": 0.10996481031179428, + "max_abs_delta": 1.25 + }, + "period_at_s1": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9893330335617065, + "min_cosine_similarity": 0.9517107009887695, + "mean_relative_l2": 0.14259381592273712, + "max_abs_delta": 1.4375 + } + } + }, + "layer_14": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "075edca7d69275e5e379bbc080e4bdbdb8e9467a87485a476e152e8f61a4ffb3", + "mean": -0.015710309147834778, + "std": 0.6083332896232605, + "rms": 0.6085361838340759, + "max_abs": 19.125 + }, + "full_input": { + "shape": [ + 155, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4d26822529cb9a4faee2521c15b354c566e5f6cf52c522f3725f682a6788262b", + "mean": -0.022652840241789818, + "std": 6.49704647064209, + "rms": 6.4970855712890625, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3de5595f4ea4758a4c38b222e9bfb7bbabda97f512d7b3dcde25831b860e3c96", + "mean": -0.01581229455769062, + "std": 0.6084873080253601, + "rms": 0.6086927056312561, + "max_abs": 19.0 + }, + "full_input": { + "shape": [ + 171, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "43a32187c6e443912cf6ac814ec4b0528e432620ca2a41446a7aa6aebdb75e4b", + "mean": -0.02318708412349224, + "std": 6.380674839019775, + "rms": 6.3807172775268555, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "27aa8b00ac666b872a4844a33337e990179f4bb21e80f8b62c08f3753c06c8bc", + "mean": -0.015862591564655304, + "std": 0.6104750037193298, + "rms": 0.6106810569763184, + "max_abs": 18.875 + }, + "full_input": { + "shape": [ + 155, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3061251884a045ac4395666e007ca7fdbf5deb047b6fa737f4c15f955a4af265", + "mean": -0.015424225479364395, + "std": 5.703628063201904, + "rms": 5.703648567199707, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "394bb6575de6833ed4cd13f218e8b720e36c24bb2b9b670598e035459f43ddee", + "mean": -0.016319695860147476, + "std": 0.611236035823822, + "rms": 0.6114538908004761, + "max_abs": 19.25 + }, + "full_input": { + "shape": [ + 171, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "61fb19670a79da7a70ff206ee4620a90de3c32a9640a05cf9e6a9ab0179b2ea7", + "mean": -0.015779584646224976, + "std": 5.427792072296143, + "rms": 5.4278154373168945, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "263cb805788d08662db680f090e9838ba119adb27435ec44179001f43f9a1f81", + "mean": -0.015954913571476936, + "std": 0.6100902557373047, + "rms": 0.6102988123893738, + "max_abs": 19.25 + }, + "full_input": { + "shape": [ + 155, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "acf079f82fbeebb9d4c91f67712a5fa5bec4f2c4f2d104dbd2c7a833c0a7455e", + "mean": -0.01569119468331337, + "std": 5.7036261558532715, + "rms": 5.703647136688232, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bfbe803464c5300d948092b399570a1bb6716575cfc9b3a82903c1208829e8c2", + "mean": -0.016288360580801964, + "std": 0.6093944311141968, + "rms": 0.6096121072769165, + "max_abs": 19.625 + }, + "full_input": { + "shape": [ + 171, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5eb952ccc0df5438df82b56e0057a0f5712daeda1f5ef41b8b98b9252f6899f6", + "mean": -0.015820616856217384, + "std": 5.427449703216553, + "rms": 5.427473068237305, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1c51694fde870233f18daafeada1bbeda6dff5b08dfc1bbf3246da20ae21951d", + "mean": -0.015979597344994545, + "std": 0.6092860102653503, + "rms": 0.6094955205917358, + "max_abs": 19.25 + }, + "full_input": { + "shape": [ + 155, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "67408deb1f9be958d1754c52121ce519abbe401f17dc65ba6f44381614731a6f", + "mean": -0.015535954385995865, + "std": 5.703455924987793, + "rms": 5.703476905822754, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4a0ced22fe3c1bc1742ae46c059b070acb48a9e4a63939921c6d0a51f4ee9a8a", + "mean": -0.016328435391187668, + "std": 0.608947217464447, + "rms": 0.6091660857200623, + "max_abs": 19.25 + }, + "full_input": { + "shape": [ + 171, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b9abe1ef1a79cc705c2c313052d4575ca5a5ff378e292f5085123c0f2d2b2ef6", + "mean": -0.01577211730182171, + "std": 5.427346706390381, + "rms": 5.427369594573975, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9974948763847351, + "min_cosine_similarity": 0.9814739227294922, + "mean_relative_l2": 0.0658840462565422, + "max_abs_delta": 0.6875 + }, + "system_bos": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9962557554244995, + "min_cosine_similarity": 0.9845393896102905, + "mean_relative_l2": 0.08365321159362793, + "max_abs_delta": 0.8125 + }, + "system_x": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9940671324729919, + "min_cosine_similarity": 0.9811453223228455, + "mean_relative_l2": 0.10617952048778534, + "max_abs_delta": 1.0625 + }, + "system_period": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9932013750076294, + "min_cosine_similarity": 0.9794477224349976, + "mean_relative_l2": 0.11400148272514343, + "max_abs_delta": 1.125 + }, + "bos_at_s0": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9953106045722961, + "min_cosine_similarity": 0.9852569699287415, + "mean_relative_l2": 0.09406168758869171, + "max_abs_delta": 0.75 + }, + "bos_at_s1": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.994244396686554, + "min_cosine_similarity": 0.9687671661376953, + "mean_relative_l2": 0.10412545502185822, + "max_abs_delta": 1.0 + }, + "x_at_s0": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9941233992576599, + "min_cosine_similarity": 0.982319176197052, + "mean_relative_l2": 0.10540948808193207, + "max_abs_delta": 1.1875 + }, + "x_at_s1": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9909762144088745, + "min_cosine_similarity": 0.9672989845275879, + "mean_relative_l2": 0.1312786042690277, + "max_abs_delta": 1.375 + }, + "period_at_s0": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9942556619644165, + "min_cosine_similarity": 0.9829834699630737, + "mean_relative_l2": 0.10444531589746475, + "max_abs_delta": 1.125 + }, + "period_at_s1": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9901227355003357, + "min_cosine_similarity": 0.9542626738548279, + "mean_relative_l2": 0.13710302114486694, + "max_abs_delta": 1.625 + } + } + }, + "layer_15": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "77cd4557f197ebdc968b55061ac30b0505058b1dd4f4f09ab60e821fdb8cd781", + "mean": -0.020229896530508995, + "std": 0.6802261471748352, + "rms": 0.6805269122123718, + "max_abs": 23.125 + }, + "full_input": { + "shape": [ + 155, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ac98051f45725024787626c11ea12fb00b4ebe6f8078e2a334474d781be25d64", + "mean": -0.026081398129463196, + "std": 6.506837368011475, + "rms": 6.506889820098877, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "162c695f9bcd7f2de8c4061f95e63c970ab3f99e8979fcc6eadce2ae90237248", + "mean": -0.020293820649385452, + "std": 0.6784688234329224, + "rms": 0.6787722706794739, + "max_abs": 22.875 + }, + "full_input": { + "shape": [ + 171, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c7697634a99aeec849e6a5e75ab34c28592d2739759da70d7003f102904e02aa", + "mean": -0.026518642902374268, + "std": 6.390765190124512, + "rms": 6.390820026397705, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cec8fc082c83c8b0ae1d139eb6b62c5116d5b63fb7d9a0129bce1edd78bff74c", + "mean": -0.02035955712199211, + "std": 0.6834180355072021, + "rms": 0.6837212443351746, + "max_abs": 23.0 + }, + "full_input": { + "shape": [ + 155, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2d780aef36ae85de4afbcad929d1cca29f166c65822224eb760af41717e8b285", + "mean": -0.018831370398402214, + "std": 5.71437931060791, + "rms": 5.714410781860352, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ab691113a281ac2dfe68d0a58344487b4cec74b4b58215654a669e09015283d2", + "mean": -0.02097732573747635, + "std": 0.6832371950149536, + "rms": 0.6835591793060303, + "max_abs": 23.25 + }, + "full_input": { + "shape": [ + 171, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8472391ff486fb979f07587f94ba9e1053b577908ea894d8a755387511204893", + "mean": -0.01928047090768814, + "std": 5.43912410736084, + "rms": 5.4391584396362305, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5de44d1012e5b5969b48dd7727b84f36864efb1e4f6a3046af3fb0803f95ff9b", + "mean": -0.020583782345056534, + "std": 0.6832860112190247, + "rms": 0.6835960149765015, + "max_abs": 23.125 + }, + "full_input": { + "shape": [ + 155, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d6bf2d8c811fd6b7d872135c802d3357dfbca477756c568bf09c73edfa92f5a9", + "mean": -0.0192043986171484, + "std": 5.714353084564209, + "rms": 5.714385986328125, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6e4ee95ac1bd78f769a166d98e89eca8275ca792289c28ae34e4d73f7f86376e", + "mean": -0.021268511191010475, + "std": 0.6810280084609985, + "rms": 0.6813600659370422, + "max_abs": 23.75 + }, + "full_input": { + "shape": [ + 171, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b867c1ff997694b1579b7f90e3e8cb2d44608bc06b3672af434d63bc18cf935c", + "mean": -0.019573340192437172, + "std": 5.438680171966553, + "rms": 5.43871545791626, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d086f8f83e98d14397b538ca7d863f648b39b51398a2b2e7a866980643962424", + "mean": -0.020619036629796028, + "std": 0.6824160814285278, + "rms": 0.682727575302124, + "max_abs": 22.75 + }, + "full_input": { + "shape": [ + 155, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3bac13d224e342c737ad23bed842bfb805bf8334898d7e66bfb55608b2102e96", + "mean": -0.019060185179114342, + "std": 5.714175701141357, + "rms": 5.714208126068115, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "26723bc23a59cec7e4ac5b50d7108e6670b85b5bb9687a3dea69bb29bad68aa4", + "mean": -0.02133234217762947, + "std": 0.6804736256599426, + "rms": 0.6808079481124878, + "max_abs": 23.375 + }, + "full_input": { + "shape": [ + 171, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "88bbee613ac13e32fd3f2ec58f34c75c3a8f72c746e4bf8aa88684cfca416129", + "mean": -0.019499942660331726, + "std": 5.438577651977539, + "rms": 5.438612937927246, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9975113868713379, + "min_cosine_similarity": 0.981325626373291, + "mean_relative_l2": 0.06549760699272156, + "max_abs_delta": 1.0625 + }, + "system_bos": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9964116215705872, + "min_cosine_similarity": 0.9829336404800415, + "mean_relative_l2": 0.08169049769639969, + "max_abs_delta": 1.3125 + }, + "system_x": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9943526983261108, + "min_cosine_similarity": 0.9808624982833862, + "mean_relative_l2": 0.10372783988714218, + "max_abs_delta": 1.0 + }, + "system_period": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9934022426605225, + "min_cosine_similarity": 0.9807230234146118, + "mean_relative_l2": 0.11213589459657669, + "max_abs_delta": 1.125 + }, + "bos_at_s0": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9956210851669312, + "min_cosine_similarity": 0.9835574626922607, + "mean_relative_l2": 0.09113278239965439, + "max_abs_delta": 0.9375 + }, + "bos_at_s1": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9944823980331421, + "min_cosine_similarity": 0.9694913625717163, + "mean_relative_l2": 0.10201156139373779, + "max_abs_delta": 1.5 + }, + "x_at_s0": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9946109652519226, + "min_cosine_similarity": 0.9840649962425232, + "mean_relative_l2": 0.10124313831329346, + "max_abs_delta": 1.5 + }, + "x_at_s1": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9914371371269226, + "min_cosine_similarity": 0.9645845890045166, + "mean_relative_l2": 0.12809638679027557, + "max_abs_delta": 1.75 + }, + "period_at_s0": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9945700764656067, + "min_cosine_similarity": 0.9814377427101135, + "mean_relative_l2": 0.10137642920017242, + "max_abs_delta": 1.5 + }, + "period_at_s1": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9905695915222168, + "min_cosine_similarity": 0.9496998190879822, + "mean_relative_l2": 0.13405939936637878, + "max_abs_delta": 2.25 + } + } + }, + "layer_16": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9225732fbf4d08ebeb9f27e08d205ce5f6b71b2eb03ceaae9ca0de7e55bee2b3", + "mean": -0.02305373176932335, + "std": 0.7688184380531311, + "rms": 0.769163966178894, + "max_abs": 24.875 + }, + "full_input": { + "shape": [ + 155, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "dc34311ab9a9d48b901c09d1a5265e0b411ded9f8890db0b1977e0eddf9f826a", + "mean": -0.02851482480764389, + "std": 6.519430637359619, + "rms": 6.519493103027344, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "380195791da8558a35a40d421dd1497a153fc5b2484994b5c6b6f3906a74c028", + "mean": -0.023082157596945763, + "std": 0.7684791684150696, + "rms": 0.7688257098197937, + "max_abs": 24.875 + }, + "full_input": { + "shape": [ + 171, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c048c26428d88941a2d055a0a570ca4ec0471b8d600693d323f8b94780321d32", + "mean": -0.02852340042591095, + "std": 6.403465270996094, + "rms": 6.403528690338135, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b08f3014a5d238bba85a655f6e3a07929f66daaf145efda8249e8c614c9d8e39", + "mean": -0.023098304867744446, + "std": 0.7711275815963745, + "rms": 0.7714734077453613, + "max_abs": 24.75 + }, + "full_input": { + "shape": [ + 155, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "269fba4219bbf7768ac809d18ed042fa182ca4063ba2981926e299e183b6e8cb", + "mean": -0.02111760340631008, + "std": 5.727797985076904, + "rms": 5.727837562561035, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e609cf906ea87b10895eadbe4d43e4c52b53f8325aab5f16cbc4b21fab278b72", + "mean": -0.023776445537805557, + "std": 0.7724243998527527, + "rms": 0.7727901935577393, + "max_abs": 25.0 + }, + "full_input": { + "shape": [ + 171, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a588dadc32bfe157a4bb413e97552fe9ac57dd49394f5d1b5a723c123c27c5d2", + "mean": -0.021169370040297508, + "std": 5.453283786773682, + "rms": 5.453325271606445, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "26ebfe40a0a8281f155cf3fc12aa8b70f15c8c6fbfc73b4f8c56a2c391bab824", + "mean": -0.023329291492700577, + "std": 0.7716376781463623, + "rms": 0.7719902396202087, + "max_abs": 24.75 + }, + "full_input": { + "shape": [ + 155, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2f66b2ca58a3dc41d8f8df6cee0bbaff1a08356af8bdd7de9c4ec7f949d46214", + "mean": -0.021473808214068413, + "std": 5.727916240692139, + "rms": 5.727956771850586, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "478c96122f2cece87a6046162de4f2d2b8744a75a9c4845a82f28913c9341dc4", + "mean": -0.024207767099142075, + "std": 0.7713541388511658, + "rms": 0.7717338800430298, + "max_abs": 25.375 + }, + "full_input": { + "shape": [ + 171, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b6f856298a0c8d041192225ba03762e29eca3f6979543361b50061ba11430075", + "mean": -0.021579064428806305, + "std": 5.453012466430664, + "rms": 5.453055381774902, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "19c8cd8bd86bc42aadc3a6d5f001af49ca878ac80869be50da964daaed45c0c8", + "mean": -0.023456525057554245, + "std": 0.7706598043441772, + "rms": 0.7710167169570923, + "max_abs": 24.375 + }, + "full_input": { + "shape": [ + 155, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8bd4f096d231f368aecc0f803c1fdc9958dd96692d4eb6d5afcf90a44af061c7", + "mean": -0.021379776298999786, + "std": 5.727607727050781, + "rms": 5.727647304534912, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a5a7ff431edae8d50705baf5bcec910672914a90a9acff2ea0b392a6fbbaa2ed", + "mean": -0.024319201707839966, + "std": 0.7717077136039734, + "rms": 0.7720907926559448, + "max_abs": 25.25 + }, + "full_input": { + "shape": [ + 171, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "00425b0122dc70f47d43ec254963ef10e9e0b6eff5c6094bd19d6e8bd791daa4", + "mean": -0.021418409422039986, + "std": 5.452892303466797, + "rms": 5.452934265136719, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9975807666778564, + "min_cosine_similarity": 0.9801334142684937, + "mean_relative_l2": 0.06492909044027328, + "max_abs_delta": 1.0 + }, + "system_bos": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9965807199478149, + "min_cosine_similarity": 0.9841210246086121, + "mean_relative_l2": 0.08001460134983063, + "max_abs_delta": 1.0 + }, + "system_x": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9945959448814392, + "min_cosine_similarity": 0.9837479591369629, + "mean_relative_l2": 0.10166515409946442, + "max_abs_delta": 1.125 + }, + "system_period": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9936376810073853, + "min_cosine_similarity": 0.9820611476898193, + "mean_relative_l2": 0.1102098673582077, + "max_abs_delta": 1.3125 + }, + "bos_at_s0": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9958693385124207, + "min_cosine_similarity": 0.9819416999816895, + "mean_relative_l2": 0.08838993310928345, + "max_abs_delta": 0.75 + }, + "bos_at_s1": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9947558045387268, + "min_cosine_similarity": 0.9699536561965942, + "mean_relative_l2": 0.09940429776906967, + "max_abs_delta": 1.25 + }, + "x_at_s0": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9949264526367188, + "min_cosine_similarity": 0.9855741262435913, + "mean_relative_l2": 0.09822157025337219, + "max_abs_delta": 1.375 + }, + "x_at_s1": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9919449090957642, + "min_cosine_similarity": 0.963699460029602, + "mean_relative_l2": 0.12408818304538727, + "max_abs_delta": 1.5 + }, + "period_at_s0": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9948724508285522, + "min_cosine_similarity": 0.978499174118042, + "mean_relative_l2": 0.09831870347261429, + "max_abs_delta": 1.25 + }, + "period_at_s1": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9910545945167542, + "min_cosine_similarity": 0.949913740158081, + "mean_relative_l2": 0.13041862845420837, + "max_abs_delta": 1.875 + } + } + }, + "layer_17": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fb731a8c20298845f6aac0fcd6d680a217f99facf1b1c432ea91f9f994a481f6", + "mean": -0.027885081246495247, + "std": 0.892637312412262, + "rms": 0.8930727243423462, + "max_abs": 27.5 + }, + "full_input": { + "shape": [ + 155, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "dead58cac381db14a055fd36638e881cae06d18b88f1c9375ba4617f6ae5de5b", + "mean": -0.03287718817591667, + "std": 6.537524223327637, + "rms": 6.537606716156006, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "09e24170cf9a4bb583a61b6309f73a668898188bc3b4aee2816978224faa8327", + "mean": -0.027876930311322212, + "std": 0.8921439051628113, + "rms": 0.8925793766975403, + "max_abs": 27.25 + }, + "full_input": { + "shape": [ + 171, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a2be7bf84c48f7fed97372786bb7b657691edc6cc17bef0f183f0232d65d1fd8", + "mean": -0.03290581330657005, + "std": 6.421834945678711, + "rms": 6.421918869018555, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c1cc346366ab046c7f6a86b287b6592e6977318c358a3bad7677090ca85639e6", + "mean": -0.027710378170013428, + "std": 0.896020233631134, + "rms": 0.8964486122131348, + "max_abs": 27.625 + }, + "full_input": { + "shape": [ + 155, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d9ba921193671c310420cdedcd2fcfee790410452bfab46d9a57ca1895408b52", + "mean": -0.025228725746273994, + "std": 5.747979640960693, + "rms": 5.748034477233887, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "da8c54da10227c3fce66e66667fe4c7ee8f68b81293948be295f489b892b558d", + "mean": -0.028393318876624107, + "std": 0.8974564075469971, + "rms": 0.8979054689407349, + "max_abs": 27.75 + }, + "full_input": { + "shape": [ + 171, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2a08d2ef64309093590923f265ba2860ea7d5f3d4c6d9c259148918af7a99875", + "mean": -0.025466959923505783, + "std": 5.474592208862305, + "rms": 5.474651336669922, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "08a72adfafda06df8ed5722e340e1609ec3e016fdec4a2f05547cdeb9683fcbb", + "mean": -0.028056146577000618, + "std": 0.8965932130813599, + "rms": 0.8970320820808411, + "max_abs": 27.5 + }, + "full_input": { + "shape": [ + 155, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "55f467ab51b3196aaa9fd050ca70fd0ff41cd7bc9ae5f52426fcf841d1c44b91", + "mean": -0.025789886713027954, + "std": 5.748140335083008, + "rms": 5.74819803237915, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7ac8e9ddab5ca509a2f6b40cdc26b79cb83fc39795d574eba091fc24c7fb3464", + "mean": -0.028886815533041954, + "std": 0.8954264521598816, + "rms": 0.8958922624588013, + "max_abs": 28.0 + }, + "full_input": { + "shape": [ + 171, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2d073910f00d503ce60cdca44d2da940a41ee6e7458a0afaea12274302e21458", + "mean": -0.02596353180706501, + "std": 5.474173069000244, + "rms": 5.474234580993652, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "24816e723b16e774d95f11eca479aa7ce0ebd5f36506b1ab52de58de9335c17a", + "mean": -0.028119511902332306, + "std": 0.8954804539680481, + "rms": 0.8959218263626099, + "max_abs": 27.5 + }, + "full_input": { + "shape": [ + 155, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "43bed1f74e99bc17b3bd2c2aa65e8468b887f438404a5e0b7e634ad21b4a249d", + "mean": -0.025591794401407242, + "std": 5.7477569580078125, + "rms": 5.747813701629639, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b01b55609b51dd59dd2f787b3b6f05f9252c67a49cde8bcedbd1f5249f3aa8c0", + "mean": -0.028968770056962967, + "std": 0.8961625099182129, + "rms": 0.896630585193634, + "max_abs": 28.0 + }, + "full_input": { + "shape": [ + 171, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "76bb5dca0008b955f429daacbe91d25fccee29fd622eda3ac6883837b0efae05", + "mean": -0.02577928826212883, + "std": 5.474109172821045, + "rms": 5.474170207977295, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9976565837860107, + "min_cosine_similarity": 0.9797210693359375, + "mean_relative_l2": 0.06360559910535812, + "max_abs_delta": 1.25 + }, + "system_bos": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9968517422676086, + "min_cosine_similarity": 0.9870730638504028, + "mean_relative_l2": 0.07674922049045563, + "max_abs_delta": 1.0625 + }, + "system_x": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9948792457580566, + "min_cosine_similarity": 0.9848942756652832, + "mean_relative_l2": 0.09847983717918396, + "max_abs_delta": 1.0 + }, + "system_period": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9940648078918457, + "min_cosine_similarity": 0.9824998378753662, + "mean_relative_l2": 0.10608416050672531, + "max_abs_delta": 1.375 + }, + "bos_at_s0": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9961830973625183, + "min_cosine_similarity": 0.9796061515808105, + "mean_relative_l2": 0.08468060940504074, + "max_abs_delta": 1.0 + }, + "bos_at_s1": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9950602650642395, + "min_cosine_similarity": 0.9688642024993896, + "mean_relative_l2": 0.09637553989887238, + "max_abs_delta": 1.5 + }, + "x_at_s0": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9953650832176208, + "min_cosine_similarity": 0.9861936569213867, + "mean_relative_l2": 0.09372573345899582, + "max_abs_delta": 1.25 + }, + "x_at_s1": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9925121665000916, + "min_cosine_similarity": 0.9636732339859009, + "mean_relative_l2": 0.11929897964000702, + "max_abs_delta": 1.75 + }, + "period_at_s0": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9953547716140747, + "min_cosine_similarity": 0.9812294244766235, + "mean_relative_l2": 0.09339382499456406, + "max_abs_delta": 1.5 + }, + "period_at_s1": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9915569424629211, + "min_cosine_similarity": 0.9472947120666504, + "mean_relative_l2": 0.12580645084381104, + "max_abs_delta": 2.0 + } + } + }, + "layer_18": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cfb60831839e0c999f730c8a4dfd6f80436b4cbbe7044e564626433c9f0663cd", + "mean": -0.03209153190255165, + "std": 1.0195180177688599, + "rms": 1.0200228691101074, + "max_abs": 37.75 + }, + "full_input": { + "shape": [ + 155, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "06b49e414c9093697cfba9080eb7ea1339208689ea23e8eeb795818c420aa71e", + "mean": -0.036426834762096405, + "std": 6.560823917388916, + "rms": 6.560925483703613, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9d71d9a9791666bc350d0148808387240252dc93ac95906e009a23edfdccee28", + "mean": -0.03214910998940468, + "std": 1.018477201461792, + "rms": 1.0189844369888306, + "max_abs": 38.0 + }, + "full_input": { + "shape": [ + 171, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "73792d49afaa646477edeff4b72999b5df52fe8b45d881bedcc281031fb6d83d", + "mean": -0.036112990230321884, + "std": 6.445377826690674, + "rms": 6.445478916168213, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9f5b02ded2234506a0faa69a122f6cfd8d6ca8d4a772a60691b21de8809a31b6", + "mean": -0.0321468822658062, + "std": 1.0233207941055298, + "rms": 1.0238256454467773, + "max_abs": 38.0 + }, + "full_input": { + "shape": [ + 155, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6480ec98d656794f995b22d7900b3fd747b8816902d566754cfdea18aa9fcaf3", + "mean": -0.028945229947566986, + "std": 5.772332191467285, + "rms": 5.77240514755249, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "90ca543b0536b7cf9723d5df8cded95cffc0e923b22fcd769855a1fc06fe2d32", + "mean": -0.03277194872498512, + "std": 1.0232936143875122, + "rms": 1.0238183736801147, + "max_abs": 37.75 + }, + "full_input": { + "shape": [ + 171, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b15004bf3623da2a973109bbe3a170cf4e1ba491b82c3e3be739cdfd0fbc05b0", + "mean": -0.02871391549706459, + "std": 5.49997615814209, + "rms": 5.500051021575928, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "09d80cfe31565f6e49554220139820d1b85f51f27aa38adaf03144b7bb108a10", + "mean": -0.03240819647908211, + "std": 1.0239500999450684, + "rms": 1.0244628190994263, + "max_abs": 37.75 + }, + "full_input": { + "shape": [ + 155, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "816b922aab4b58cc348cd418e9d8f780b4de2ed62a4bf0f49fe6da15c8af9caa", + "mean": -0.029405178502202034, + "std": 5.772550106048584, + "rms": 5.772624969482422, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f39171fd8e2c35d359a0a317ffc087fee153eaf5eff6acdb95f31c9609338667", + "mean": -0.033372510224580765, + "std": 1.0207867622375488, + "rms": 1.0213321447372437, + "max_abs": 38.25 + }, + "full_input": { + "shape": [ + 171, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e0ae4a553b8f286402c641cf8e6214b553b75f857a9cb692985ace844df39676", + "mean": -0.029210714623332024, + "std": 5.499531269073486, + "rms": 5.499608993530273, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "88f445739f7742768e14fcbe7bbcfd95bc3683731ba91f37cb6810ee5ef0bb9e", + "mean": -0.03258291259407997, + "std": 1.0222829580307007, + "rms": 1.0228019952774048, + "max_abs": 37.75 + }, + "full_input": { + "shape": [ + 155, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cc8125d82a647d4a80fc8d8583cdd25a8af70f5e03e654d4ca75da15c440fccd", + "mean": -0.02929469384253025, + "std": 5.772039890289307, + "rms": 5.772114276885986, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2a84673519de298c899b20ce33e673ba2ee4f9f8b49af9a0ad978602b618bc78", + "mean": -0.03356325626373291, + "std": 1.0205590724945068, + "rms": 1.0211108922958374, + "max_abs": 37.75 + }, + "full_input": { + "shape": [ + 171, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "edafd2e4e39549514b29267558f1cb3a3ed31869c398858858acee388be757ea", + "mean": -0.029137980192899704, + "std": 5.499196529388428, + "rms": 5.499273777008057, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9978448748588562, + "min_cosine_similarity": 0.9822553992271423, + "mean_relative_l2": 0.06140652298927307, + "max_abs_delta": 1.625 + }, + "system_bos": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9971430897712708, + "min_cosine_similarity": 0.9885401725769043, + "mean_relative_l2": 0.07320689409971237, + "max_abs_delta": 1.0 + }, + "system_x": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9951105117797852, + "min_cosine_similarity": 0.9831327199935913, + "mean_relative_l2": 0.09615068882703781, + "max_abs_delta": 1.375 + }, + "system_period": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9942521452903748, + "min_cosine_similarity": 0.9822410345077515, + "mean_relative_l2": 0.10431168228387833, + "max_abs_delta": 1.75 + }, + "bos_at_s0": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9965735673904419, + "min_cosine_similarity": 0.9830019474029541, + "mean_relative_l2": 0.08050297200679779, + "max_abs_delta": 1.875 + }, + "bos_at_s1": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9954848289489746, + "min_cosine_similarity": 0.9734123945236206, + "mean_relative_l2": 0.092391237616539, + "max_abs_delta": 2.25 + }, + "x_at_s0": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9958022832870483, + "min_cosine_similarity": 0.9867977499961853, + "mean_relative_l2": 0.08948155492544174, + "max_abs_delta": 2.0 + }, + "x_at_s1": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9929772019386292, + "min_cosine_similarity": 0.967287540435791, + "mean_relative_l2": 0.11538344621658325, + "max_abs_delta": 2.5 + }, + "period_at_s0": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9958031177520752, + "min_cosine_similarity": 0.9814798831939697, + "mean_relative_l2": 0.0889420434832573, + "max_abs_delta": 2.5 + }, + "period_at_s1": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.992066502571106, + "min_cosine_similarity": 0.9531718492507935, + "mean_relative_l2": 0.1218518316745758, + "max_abs_delta": 3.125 + } + } + }, + "layer_19": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "098584e0162b7f1487defe0b765cc9a2ab8894e27281d7436a08da1b702816db", + "mean": -0.034797102212905884, + "std": 1.1241918802261353, + "rms": 1.1247303485870361, + "max_abs": 30.5 + }, + "full_input": { + "shape": [ + 155, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "92e468997bff46442263cf59d2aa703cddb15d3396b6a867de4852f075c6399f", + "mean": -0.03836692497134209, + "std": 6.575440883636475, + "rms": 6.5755534172058105, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "66b869b5e47bbfdf8556a4fae5dd69ac092afb52922fecedb1f87ea37896ce32", + "mean": -0.03471144661307335, + "std": 1.1236401796340942, + "rms": 1.1241761445999146, + "max_abs": 30.5 + }, + "full_input": { + "shape": [ + 171, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "96d340669c396ee5129376cc0ae3b2e86777a53d8378a2fc244355a7c8dbfde8", + "mean": -0.0374215729534626, + "std": 6.46103572845459, + "rms": 6.461143970489502, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bce70c42e7c5b90dbc039cbfec64a69654e465d5d333a84dac7dde537608f7a6", + "mean": -0.03491503745317459, + "std": 1.1280503273010254, + "rms": 1.12859046459198, + "max_abs": 30.625 + }, + "full_input": { + "shape": [ + 155, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d4e2f4881dc82de109394268da34102278727e9582a0bfe3e6c53cc72a66e2c4", + "mean": -0.031085368245840073, + "std": 5.789254188537598, + "rms": 5.789338111877441, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "003bc2aba8f7d1496bca9e47fbd3fd723d8d5a00a449bad8b89a0bd9cfc85563", + "mean": -0.03560919314622879, + "std": 1.1287147998809814, + "rms": 1.1292763948440552, + "max_abs": 30.75 + }, + "full_input": { + "shape": [ + 171, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "13a09999dcdf45988da019db5efa42eb0ab495200c34b2eb1f8a61bf6c2d1fad", + "mean": -0.030301712453365326, + "std": 5.518344402313232, + "rms": 5.518428325653076, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "43ee7b66944b7e68b9e9fcb6c327badf880bb4fef7279c679721962f879b69dc", + "mean": -0.035148534923791885, + "std": 1.1289767026901245, + "rms": 1.129523754119873, + "max_abs": 30.75 + }, + "full_input": { + "shape": [ + 155, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fa7b6e156fa287bf5615a1661e4cd5c9d5526e2bd61a103fdc612d4faea46f7b", + "mean": -0.0314621664583683, + "std": 5.789748668670654, + "rms": 5.789834499359131, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "494c211ec76adcdce8ef2291a38198501a83f565cd71741e0eb4ecc42ae2970d", + "mean": -0.03626567870378494, + "std": 1.1268998384475708, + "rms": 1.1274832487106323, + "max_abs": 31.0 + }, + "full_input": { + "shape": [ + 171, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "37f954d1407a51c90bc6e0e6663cb3276be05027c0068e14f1762e6a08b2813f", + "mean": -0.030712425708770752, + "std": 5.518091201782227, + "rms": 5.518176555633545, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "82cf9e7cf1ac4c1d62575753607ccf9d69d6edb4fbe791a837961dfca4277ca6", + "mean": -0.035363469272851944, + "std": 1.12738037109375, + "rms": 1.1279348134994507, + "max_abs": 30.75 + }, + "full_input": { + "shape": [ + 155, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fa2fddb259aa3447d4a40032aeec5a2008f78aceaa051a1e8b3c74ea1c6961db", + "mean": -0.03149225935339928, + "std": 5.789135456085205, + "rms": 5.78922176361084, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8e350dacf935e5ab697c48f1083d757efdcf22086bb1c06b3476ae12aaa85a8c", + "mean": -0.03657090291380882, + "std": 1.127935528755188, + "rms": 1.1285282373428345, + "max_abs": 30.75 + }, + "full_input": { + "shape": [ + 171, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2b59a0ed48340e074399a4c8eb41a769c3e43ec08c0f74acb82712a3e19206c4", + "mean": -0.030842816457152367, + "std": 5.517977237701416, + "rms": 5.518063545227051, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9978132843971252, + "min_cosine_similarity": 0.9815284609794617, + "mean_relative_l2": 0.06176944077014923, + "max_abs_delta": 1.375 + }, + "system_bos": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.997154712677002, + "min_cosine_similarity": 0.9902021884918213, + "mean_relative_l2": 0.07322388887405396, + "max_abs_delta": 1.125 + }, + "system_x": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9952085018157959, + "min_cosine_similarity": 0.9856009483337402, + "mean_relative_l2": 0.09556388109922409, + "max_abs_delta": 1.171875 + }, + "system_period": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9943720698356628, + "min_cosine_similarity": 0.9849389791488647, + "mean_relative_l2": 0.10376439243555069, + "max_abs_delta": 1.5 + }, + "bos_at_s0": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9966314435005188, + "min_cosine_similarity": 0.9856572151184082, + "mean_relative_l2": 0.0800698772072792, + "max_abs_delta": 1.375 + }, + "bos_at_s1": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9955291748046875, + "min_cosine_similarity": 0.972477912902832, + "mean_relative_l2": 0.09177221357822418, + "max_abs_delta": 1.75 + }, + "x_at_s0": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9958319067955017, + "min_cosine_similarity": 0.9881072044372559, + "mean_relative_l2": 0.08933838456869125, + "max_abs_delta": 1.5 + }, + "x_at_s1": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9930946826934814, + "min_cosine_similarity": 0.9656256437301636, + "mean_relative_l2": 0.1145705059170723, + "max_abs_delta": 2.5 + }, + "period_at_s0": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9958676695823669, + "min_cosine_similarity": 0.9828401207923889, + "mean_relative_l2": 0.08848696202039719, + "max_abs_delta": 2.0 + }, + "period_at_s1": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9922699928283691, + "min_cosine_similarity": 0.9514190554618835, + "mean_relative_l2": 0.12048088759183884, + "max_abs_delta": 2.75 + } + } + }, + "layer_20": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8dc34064a40d472511d7b4c37bfabfcdd5ec8a00c6ea00f95e1593d3671c1e2a", + "mean": -0.03932003304362297, + "std": 1.3253304958343506, + "rms": 1.3259135484695435, + "max_abs": 42.5 + }, + "full_input": { + "shape": [ + 155, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bbe83e48cdfd8bb63a275f507d999c436ac1bef4845d0d864976d8e96e255716", + "mean": -0.04239538311958313, + "std": 6.803269386291504, + "rms": 6.803401470184326, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2a88666f2a7307bfab525c726dccf78ae5940f6f8830fd268018e3abda6b2d43", + "mean": -0.03928155452013016, + "std": 1.3257988691329956, + "rms": 1.3263806104660034, + "max_abs": 42.5 + }, + "full_input": { + "shape": [ + 171, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "acb8ca4bb8a7830430bb2f3e626b078a55b4d6a1404d61deb0c3fd6b0a6efd80", + "mean": -0.041143663227558136, + "std": 6.69482421875, + "rms": 6.694950580596924, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c8c719327518f6f45b89117b478ec87d01c12e2728ef085cf935c443670fca3f", + "mean": -0.0393611416220665, + "std": 1.3284331560134888, + "rms": 1.3290162086486816, + "max_abs": 42.5 + }, + "full_input": { + "shape": [ + 155, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "62cd541cefd6f6d5785dcb233b892a9d1a96260efe843cbded295c1f29378404", + "mean": -0.035379763692617416, + "std": 5.83016300201416, + "rms": 5.830270290374756, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "978f0dfb0109178d08ebc6248ffa11fefa73b63700c9e56b29cf3ade92f28f23", + "mean": -0.04014379903674126, + "std": 1.3293205499649048, + "rms": 1.3299264907836914, + "max_abs": 42.5 + }, + "full_input": { + "shape": [ + 171, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f8602b88d90aade0b02632adc36958cbe5c1f06cf9e524644450eac44666c86c", + "mean": -0.03426285460591316, + "std": 5.561004161834717, + "rms": 5.56110954284668, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "94b51a0c6fd5a1db681706f849f7f2e8cde492ddd0fb6129ae842dbbd6be610c", + "mean": -0.03964067995548248, + "std": 1.3288302421569824, + "rms": 1.3294214010238647, + "max_abs": 42.75 + }, + "full_input": { + "shape": [ + 155, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2dda0f31b685035320c7a36a7e05cd461d5c20100594561d1d5ee19578a58f6a", + "mean": -0.03595772758126259, + "std": 5.830813884735107, + "rms": 5.8309245109558105, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5a83ffd51771e68bb6c782b2a4ba253dcab89f772945e0c52925a52e518f01ef", + "mean": -0.04042045772075653, + "std": 1.3280357122421265, + "rms": 1.328650712966919, + "max_abs": 43.25 + }, + "full_input": { + "shape": [ + 171, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a720f6cf88ca390dc70a0e2b534fe90d145c72fdda84a15cc8a536b5617b4b25", + "mean": -0.034397318959236145, + "std": 5.560941219329834, + "rms": 5.561047077178955, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "837b13afeea4dbdbdea7c501cd75e519510038ca09fe2fab01b5a4d88970f2bf", + "mean": -0.03969768434762955, + "std": 1.3279637098312378, + "rms": 1.328557014465332, + "max_abs": 43.0 + }, + "full_input": { + "shape": [ + 155, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b6fb5ffddf48b2aa3a8b9dba1a39f4f9c016ccd0cf3d5f9e6f8caacf8aa5c1e7", + "mean": -0.03577915206551552, + "std": 5.830247402191162, + "rms": 5.830357074737549, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f9acbf0b914ef6e19632acec18ef1aa5ffd429ea39d9d93efbede3f5a642c247", + "mean": -0.041201453655958176, + "std": 1.329567551612854, + "rms": 1.3302056789398193, + "max_abs": 42.75 + }, + "full_input": { + "shape": [ + 171, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "278f4305896c07aedbddcc5c169e92d382d176cbd663dda69364ac90ca603ae0", + "mean": -0.03487555310130119, + "std": 5.560772895812988, + "rms": 5.560882091522217, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9980257749557495, + "min_cosine_similarity": 0.9833189845085144, + "mean_relative_l2": 0.058977995067834854, + "max_abs_delta": 1.0 + }, + "system_bos": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9975147843360901, + "min_cosine_similarity": 0.9914279580116272, + "mean_relative_l2": 0.06872490793466568, + "max_abs_delta": 1.375 + }, + "system_x": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9955371618270874, + "min_cosine_similarity": 0.9880529642105103, + "mean_relative_l2": 0.09233929216861725, + "max_abs_delta": 1.625 + }, + "system_period": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9947553277015686, + "min_cosine_similarity": 0.9825183749198914, + "mean_relative_l2": 0.10019313544034958, + "max_abs_delta": 2.0 + }, + "bos_at_s0": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9970468282699585, + "min_cosine_similarity": 0.9885806441307068, + "mean_relative_l2": 0.07504896074533463, + "max_abs_delta": 1.375 + }, + "bos_at_s1": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9960054755210876, + "min_cosine_similarity": 0.9755219221115112, + "mean_relative_l2": 0.08654230833053589, + "max_abs_delta": 1.75 + }, + "x_at_s0": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9962567687034607, + "min_cosine_similarity": 0.9888930320739746, + "mean_relative_l2": 0.08444830775260925, + "max_abs_delta": 1.75 + }, + "x_at_s1": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9935818910598755, + "min_cosine_similarity": 0.9695788621902466, + "mean_relative_l2": 0.11034328490495682, + "max_abs_delta": 2.875 + }, + "period_at_s0": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9963651299476624, + "min_cosine_similarity": 0.9848731756210327, + "mean_relative_l2": 0.08288196474313736, + "max_abs_delta": 2.125 + }, + "period_at_s1": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9928114414215088, + "min_cosine_similarity": 0.9576609134674072, + "mean_relative_l2": 0.11603031307458878, + "max_abs_delta": 3.0 + } + } + }, + "layer_21": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4fe743832470c8110df5c1f9f0fead78785f3050da5d49ed14bf01ed04c4ae69", + "mean": -0.047394007444381714, + "std": 1.4350380897521973, + "rms": 1.4358205795288086, + "max_abs": 53.5 + }, + "full_input": { + "shape": [ + 155, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e8d59f31f093aedf9d066545b719d0836e19abd7f0243b03a95a3994beddcb0f", + "mean": -0.04879288747906685, + "std": 6.887421131134033, + "rms": 6.887593746185303, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b3f25c43dc1e61c635e193c6fafd77926604f34f363d819ab861cf0030eca81d", + "mean": -0.04728984087705612, + "std": 1.4370076656341553, + "rms": 1.4377856254577637, + "max_abs": 53.75 + }, + "full_input": { + "shape": [ + 171, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6c6d26b870aeb020a9a7173d98485e78c8d4aa7ee34687a75ccaa9963ab44962", + "mean": -0.046508874744176865, + "std": 6.7746477127075195, + "rms": 6.774806976318359, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7342d7123c8b8b3bdcd398f1ccbf2099b7d458a887a5708828b867c14175887c", + "mean": -0.04766165465116501, + "std": 1.437232255935669, + "rms": 1.4380223751068115, + "max_abs": 53.5 + }, + "full_input": { + "shape": [ + 155, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6b3f7084754f20f852b6aa99d4d0086573341922dafcab2348f5e52515108c9a", + "mean": -0.04192787781357765, + "std": 5.84244966506958, + "rms": 5.842600345611572, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cab121b01fb032f68f7cd884381f63c04cbea551dbd781ef17ed119726467809", + "mean": -0.04858975112438202, + "std": 1.4384794235229492, + "rms": 1.4392998218536377, + "max_abs": 53.5 + }, + "full_input": { + "shape": [ + 171, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3f569c40a16b15defff1bdc3ae2ab3a5bf6a0955d5dab09fc39e24b8d14b3de5", + "mean": -0.03996102884411812, + "std": 5.578064918518066, + "rms": 5.5782084465026855, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cc29e4410942ab5d16c42db09dd0dc7ac6515b85aa8e995b906cd57ad7c44382", + "mean": -0.04827599227428436, + "std": 1.4400981664657593, + "rms": 1.4409070014953613, + "max_abs": 53.75 + }, + "full_input": { + "shape": [ + 155, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "48c6d929ca5c7d116844c29473b6d368c5db4164f5541baa2ac679fa46f74d57", + "mean": -0.04276594519615173, + "std": 5.843971252441406, + "rms": 5.844127178192139, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c012911a501f7264bbc539d3fd7ff3b269118546b2aff1ab21d2ff8a6d55cbcd", + "mean": -0.049782391637563705, + "std": 1.4414024353027344, + "rms": 1.442261815071106, + "max_abs": 54.5 + }, + "full_input": { + "shape": [ + 171, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "24792b96634f92909b78804e20fb76e481ca25c7e1b0edec7046aef23e6d5959", + "mean": -0.04099931940436363, + "std": 5.579292297363281, + "rms": 5.579442977905273, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "54a6ca4cd039fa02c5725a2ff78ca9f03b6d8c73ddfe6017c380079c8d285966", + "mean": -0.04846804961562157, + "std": 1.4378901720046997, + "rms": 1.438706874847412, + "max_abs": 54.0 + }, + "full_input": { + "shape": [ + 155, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9a5db3c71675de449799735d55a32d79fa00d83fdab251d3330e3a76c7e4e566", + "mean": -0.042791128158569336, + "std": 5.842767715454102, + "rms": 5.84292459487915, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6db05cca36916bf2cf05e54a83960690afb0aa552c3e58653d241c83aa217b0d", + "mean": -0.05081088840961456, + "std": 1.444006085395813, + "rms": 1.4448996782302856, + "max_abs": 54.0 + }, + "full_input": { + "shape": [ + 171, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f2e16f49b3eded85529c652f9fddceb41851b77d9d074668c26cdd43e37b689e", + "mean": -0.04158133268356323, + "std": 5.578819274902344, + "rms": 5.57897424697876, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9979331493377686, + "min_cosine_similarity": 0.9846404194831848, + "mean_relative_l2": 0.06082269549369812, + "max_abs_delta": 1.75 + }, + "system_bos": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9974241852760315, + "min_cosine_similarity": 0.9918057918548584, + "mean_relative_l2": 0.0700717642903328, + "max_abs_delta": 1.375 + }, + "system_x": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9950275421142578, + "min_cosine_similarity": 0.9843930006027222, + "mean_relative_l2": 0.09751570969820023, + "max_abs_delta": 2.0 + }, + "system_period": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9941199421882629, + "min_cosine_similarity": 0.9798089265823364, + "mean_relative_l2": 0.1061265841126442, + "max_abs_delta": 2.75 + }, + "bos_at_s0": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.997056245803833, + "min_cosine_similarity": 0.9893906116485596, + "mean_relative_l2": 0.07528763264417648, + "max_abs_delta": 1.5 + }, + "bos_at_s1": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9959233403205872, + "min_cosine_similarity": 0.9784265756607056, + "mean_relative_l2": 0.08769677579402924, + "max_abs_delta": 1.75 + }, + "x_at_s0": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9962125420570374, + "min_cosine_similarity": 0.9892857670783997, + "mean_relative_l2": 0.08530695736408234, + "max_abs_delta": 1.875 + }, + "x_at_s1": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9931720495223999, + "min_cosine_similarity": 0.9733450412750244, + "mean_relative_l2": 0.11394653469324112, + "max_abs_delta": 3.0 + }, + "period_at_s0": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9963688850402832, + "min_cosine_similarity": 0.9858123660087585, + "mean_relative_l2": 0.08321695029735565, + "max_abs_delta": 2.25 + }, + "period_at_s1": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9923670887947083, + "min_cosine_similarity": 0.9619525074958801, + "mean_relative_l2": 0.1200345829129219, + "max_abs_delta": 3.0 + } + } + }, + "layer_22": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f5fba2ba946029cf17b1668e534c2772900d0a550ce9101fca6cec4093fdbfba", + "mean": -0.05873722955584526, + "std": 1.6653107404708862, + "rms": 1.6663461923599243, + "max_abs": 67.0 + }, + "full_input": { + "shape": [ + 155, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c8929172eb236c6d30bcac666317b8b59219d7ad57d196eb8e066becdded7c2b", + "mean": -0.058250416070222855, + "std": 6.935746192932129, + "rms": 6.935990810394287, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "47b590a3817ae4a8cff56dd3f3f931bc12a0d229b302298ed28e959409f7e14f", + "mean": -0.05837109684944153, + "std": 1.6691417694091797, + "rms": 1.6701622009277344, + "max_abs": 67.0 + }, + "full_input": { + "shape": [ + 171, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5ff84cc2a8f7b814334d6d0586552a3da2e48d744b133ee3d0be3ba11c1ceae1", + "mean": -0.05504927039146423, + "std": 6.827132225036621, + "rms": 6.827354431152344, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "106d85bb17086c3825b2843b2acb6eaf8d8b58016884580f3bc859866633a7a7", + "mean": -0.05885559320449829, + "std": 1.6672552824020386, + "rms": 1.668293833732605, + "max_abs": 67.0 + }, + "full_input": { + "shape": [ + 155, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3213404386f9cb33af57747f9de901a410a554215715b99a81791be49aca2421", + "mean": -0.05137879028916359, + "std": 5.899631977081299, + "rms": 5.899856090545654, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "df68e3f67de7dba70756f0f27aaa36c27d2f101056af64f84aa2bab3f731fe6c", + "mean": -0.05978870019316673, + "std": 1.6686017513275146, + "rms": 1.6696726083755493, + "max_abs": 67.5 + }, + "full_input": { + "shape": [ + 171, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2be1797fabd87876bdd883b39f7ec63f2de899971b1c164e455bbc33135faaa7", + "mean": -0.04871397465467453, + "std": 5.641517639160156, + "rms": 5.641727924346924, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ffaa3b7db52473260933f35a06cb2109aa548719e80800999ac5df6f72182b50", + "mean": -0.059333231300115585, + "std": 1.6716678142547607, + "rms": 1.6727203130722046, + "max_abs": 68.0 + }, + "full_input": { + "shape": [ + 155, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e1ae4948ea6b760a308ebe9c44219dc48e130dcb2b382aa3e794a77b87794977", + "mean": -0.05208703503012657, + "std": 5.901882171630859, + "rms": 5.902111530303955, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e6e97640e8c93580748dcf3f9f26ec62145ba2a3df14ec3e3667119d0aa67beb", + "mean": -0.06073538586497307, + "std": 1.6746087074279785, + "rms": 1.6757097244262695, + "max_abs": 67.5 + }, + "full_input": { + "shape": [ + 171, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9a90223474366e6f93c2b57d05d3dd6d04b7d63a68139074e5e8a9c280870178", + "mean": -0.04940120503306389, + "std": 5.643974304199219, + "rms": 5.644190788269043, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1a4b8ff3fb3f1e395768ace47dd1593e02d03c682f2f54efe9695ba116051de4", + "mean": -0.05950416997075081, + "std": 1.6684296131134033, + "rms": 1.6694903373718262, + "max_abs": 67.0 + }, + "full_input": { + "shape": [ + 155, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f0a63f0dec8b26a4356205e67aff94ca971328284414e82c7990fb7b0a9193a8", + "mean": -0.052220042794942856, + "std": 5.900166034698486, + "rms": 5.900397300720215, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4e812b96cad47c8acca723ca0554d2b2a7e118a1d6fe64fcbd83f2bbcc6178c1", + "mean": -0.06180552765727043, + "std": 1.6774312257766724, + "rms": 1.6785694360733032, + "max_abs": 67.5 + }, + "full_input": { + "shape": [ + 171, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "96184e3b6f41f8caec6a6824b6641f86375f23e5e93aba67954d637183ba9d45", + "mean": -0.05006994307041168, + "std": 5.643393516540527, + "rms": 5.64361572265625, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9980114102363586, + "min_cosine_similarity": 0.9868979454040527, + "mean_relative_l2": 0.059670526534318924, + "max_abs_delta": 2.25 + }, + "system_bos": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9975348711013794, + "min_cosine_similarity": 0.9914214611053467, + "mean_relative_l2": 0.06836246699094772, + "max_abs_delta": 2.0 + }, + "system_x": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9952263236045837, + "min_cosine_similarity": 0.9835559725761414, + "mean_relative_l2": 0.09533140063285828, + "max_abs_delta": 2.75 + }, + "system_period": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9943547248840332, + "min_cosine_similarity": 0.9795700311660767, + "mean_relative_l2": 0.10380008071660995, + "max_abs_delta": 3.5 + }, + "bos_at_s0": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9972133636474609, + "min_cosine_similarity": 0.9908583760261536, + "mean_relative_l2": 0.07316328585147858, + "max_abs_delta": 1.5 + }, + "bos_at_s1": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9961526989936829, + "min_cosine_similarity": 0.9823335409164429, + "mean_relative_l2": 0.08520704507827759, + "max_abs_delta": 2.5 + }, + "x_at_s0": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9964472651481628, + "min_cosine_similarity": 0.9908955693244934, + "mean_relative_l2": 0.08261863887310028, + "max_abs_delta": 2.0 + }, + "x_at_s1": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.993560791015625, + "min_cosine_similarity": 0.97734534740448, + "mean_relative_l2": 0.11067284643650055, + "max_abs_delta": 2.375 + }, + "period_at_s0": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9965958595275879, + "min_cosine_similarity": 0.9878042340278625, + "mean_relative_l2": 0.08065015822649002, + "max_abs_delta": 3.0 + }, + "period_at_s1": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9927769303321838, + "min_cosine_similarity": 0.9679310321807861, + "mean_relative_l2": 0.11683754622936249, + "max_abs_delta": 2.75 + } + } + }, + "layer_23": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c03917e8368ff146707169555b1084971fa8651fef2e70a8886fd6d48648f2eb", + "mean": -0.08157867193222046, + "std": 2.128129005432129, + "rms": 2.1296920776367188, + "max_abs": 96.5 + }, + "full_input": { + "shape": [ + 155, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bd5c1050e4b7df1546af443d2de2ca345cf986f10d632bb9089c75f4fcb80d02", + "mean": -0.07746641337871552, + "std": 7.026158332824707, + "rms": 7.026586055755615, + "max_abs": 1160.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e95bc58efec98be63f3b226af042713fd6e3a69d56f3a51c838e3d754b17f8f8", + "mean": -0.08117406070232391, + "std": 2.1335644721984863, + "rms": 2.13510799407959, + "max_abs": 97.0 + }, + "full_input": { + "shape": [ + 171, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "69e5cc15ffb1b283f41fbadb3cd4fe51f9b22b1d54ea6c7262137ea59dfa2864", + "mean": -0.07162576168775558, + "std": 6.920589923858643, + "rms": 6.920960903167725, + "max_abs": 1160.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7b415748e756ee34e75e24b4a5acec8227753bc05d38741c978a56b1a007d30f", + "mean": -0.08169393241405487, + "std": 2.128994941711426, + "rms": 2.1305618286132812, + "max_abs": 97.0 + }, + "full_input": { + "shape": [ + 155, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c7a60c530fda2ad64649f62c00dd2baf07eb698c94caa1e64f24b78fe5bcc1ba", + "mean": -0.07064607739448547, + "std": 6.013858318328857, + "rms": 6.014273643493652, + "max_abs": 1160.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "700a78bc771b07096c235cb4ae8dd52e2744a5de9734e90f8eb0f0a28e002c10", + "mean": -0.08285654336214066, + "std": 2.130718946456909, + "rms": 2.132329225540161, + "max_abs": 98.0 + }, + "full_input": { + "shape": [ + 171, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9a3ac4fff98b62c3166225771da2dbaff44e784d7807764bd968426f6ab85ebe", + "mean": -0.06559181958436966, + "std": 5.764342308044434, + "rms": 5.764715671539307, + "max_abs": 1160.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ca8dd63caeeef7be2e8bce2952bcb38485f62f195d98554ea25b9bd1fbd4884d", + "mean": -0.08197430521249771, + "std": 2.1317365169525146, + "rms": 2.133312225341797, + "max_abs": 98.0 + }, + "full_input": { + "shape": [ + 155, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "de18c6c0590ca8ff18174d35d00a79fe7852844df2d045160c7d0258b0b8e88d", + "mean": -0.0710814967751503, + "std": 6.0166826248168945, + "rms": 6.0171027183532715, + "max_abs": 1160.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "eaa3da64b653a043d6381054f412006a7d11b5f95ae4691a23cfc55da26b53a1", + "mean": -0.08308616280555725, + "std": 2.1306674480438232, + "rms": 2.132286787033081, + "max_abs": 98.5 + }, + "full_input": { + "shape": [ + 171, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ffcc6c8fdeb6e4749c5ab3e1de4c7402531d93deb4206c30549d6c92d8b5d28e", + "mean": -0.06573499739170074, + "std": 5.766603946685791, + "rms": 5.766978740692139, + "max_abs": 1160.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3be0ed317a00c77a6eb3fe2632f78a6e36a330c9b4d65e57867595348fb71b37", + "mean": -0.08256019651889801, + "std": 2.127706289291382, + "rms": 2.129307508468628, + "max_abs": 97.0 + }, + "full_input": { + "shape": [ + 155, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ed98852a677a7c0b1a5e32e7e348e86768a4202df2c50bde6b4a72e21b96b9a8", + "mean": -0.07173768430948257, + "std": 6.013912200927734, + "rms": 6.014340400695801, + "max_abs": 1160.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "48bd44d2847413a4065e5dd7f13be2e46b01c7f9b51fb0b0ab51698eeeb086ae", + "mean": -0.08455302566289902, + "std": 2.136735439300537, + "rms": 2.1384077072143555, + "max_abs": 98.5 + }, + "full_input": { + "shape": [ + 171, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b0754cc527b7fefbe7a381d92df2047fe7dcecad33af08a7e5f20f6d30728750", + "mean": -0.0666038915514946, + "std": 5.766584396362305, + "rms": 5.766969203948975, + "max_abs": 1160.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9983687400817871, + "min_cosine_similarity": 0.9900404214859009, + "mean_relative_l2": 0.05425010249018669, + "max_abs_delta": 3.5 + }, + "system_bos": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9979931116104126, + "min_cosine_similarity": 0.9920164346694946, + "mean_relative_l2": 0.061700206249952316, + "max_abs_delta": 2.375 + }, + "system_x": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9960730671882629, + "min_cosine_similarity": 0.9835342168807983, + "mean_relative_l2": 0.08622881025075912, + "max_abs_delta": 3.5 + }, + "system_period": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9953857660293579, + "min_cosine_similarity": 0.9814744591712952, + "mean_relative_l2": 0.09373927861452103, + "max_abs_delta": 3.5 + }, + "bos_at_s0": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9977092146873474, + "min_cosine_similarity": 0.9923931360244751, + "mean_relative_l2": 0.06636121869087219, + "max_abs_delta": 2.0 + }, + "bos_at_s1": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9968461394309998, + "min_cosine_similarity": 0.9859201312065125, + "mean_relative_l2": 0.0770011618733406, + "max_abs_delta": 3.5 + }, + "x_at_s0": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9970493912696838, + "min_cosine_similarity": 0.9913290143013, + "mean_relative_l2": 0.07503565400838852, + "max_abs_delta": 2.5 + }, + "x_at_s1": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9947999119758606, + "min_cosine_similarity": 0.9811627864837646, + "mean_relative_l2": 0.0990074872970581, + "max_abs_delta": 3.5 + }, + "period_at_s0": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.997215747833252, + "min_cosine_similarity": 0.9900208115577698, + "mean_relative_l2": 0.07291670888662338, + "max_abs_delta": 4.0 + }, + "period_at_s1": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9941649436950684, + "min_cosine_similarity": 0.9725349545478821, + "mean_relative_l2": 0.10467548668384552, + "max_abs_delta": 3.375 + } + } + }, + "layer_24": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "abd6ca7df5132f234497666231a2f2be9d951d424e259a1688aae0f1f61f4045", + "mean": -0.10447245091199875, + "std": 2.630075454711914, + "rms": 2.6321496963500977, + "max_abs": 128.0 + }, + "full_input": { + "shape": [ + 155, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3850ddbe9fdb12acc91109e6f661f80d215c774111df3aa1f67d37f57ac0324f", + "mean": -0.09819454699754715, + "std": 6.76079797744751, + "rms": 6.761511325836182, + "max_abs": 1008.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e2eb8758e7f6f88b55e0a11fb2d911e6093a8932033fc96677d98972aefccc89", + "mean": -0.10409488528966904, + "std": 2.636615514755249, + "rms": 2.638669490814209, + "max_abs": 128.0 + }, + "full_input": { + "shape": [ + 171, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0042930d4cd6a333bcecd294617d44ce75a1374b26e570987d088bf8c8e9a635", + "mean": -0.09013718366622925, + "std": 6.860240936279297, + "rms": 6.860832691192627, + "max_abs": 1120.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e4770573710a243c0199b4fb7022027dbc249ab6739c112451763f9260d3e00d", + "mean": -0.10444293916225433, + "std": 2.630119562149048, + "rms": 2.632192373275757, + "max_abs": 127.0 + }, + "full_input": { + "shape": [ + 155, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ff8b25c4fa678e5d6bc7df28e061591a1b91e431e753774a887161d810b4383d", + "mean": -0.09032886475324631, + "std": 4.607817649841309, + "rms": 4.608703136444092, + "max_abs": 840.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "32392b3a9bdcdf260443b429f0478c2d90c3cce09074cb727492910fa94a7f0d", + "mean": -0.10569701343774796, + "std": 2.6314051151275635, + "rms": 2.6335272789001465, + "max_abs": 126.0 + }, + "full_input": { + "shape": [ + 171, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "eb29ef69d868c685ee2e84b5a08aa691ed9a03f9b04b9d7877582a67d47154d7", + "mean": -0.08319371193647385, + "std": 4.472642421722412, + "rms": 4.473415851593018, + "max_abs": 840.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a5f94c272d79eca14a4104c206837a9b4cb4f259d4c0a0c7f4b103b175695696", + "mean": -0.10461409389972687, + "std": 2.6315760612487793, + "rms": 2.6336545944213867, + "max_abs": 127.5 + }, + "full_input": { + "shape": [ + 155, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "994222b0618f432a8a3913f479b4cdcf1c4803af352fd73589d08d816684c34c", + "mean": -0.09071994572877884, + "std": 4.611950397491455, + "rms": 4.612842559814453, + "max_abs": 840.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "767c768acc4b9f55e3a0491fd95346f0b5a43f01b0a51fba10443dfb3a0b9a13", + "mean": -0.10502615571022034, + "std": 2.6308364868164062, + "rms": 2.63293194770813, + "max_abs": 126.0 + }, + "full_input": { + "shape": [ + 171, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2360c975753b7f117714fbe401e6c85379dec94beb56516e4ee410f8b822968f", + "mean": -0.08275531977415085, + "std": 4.476667404174805, + "rms": 4.4774322509765625, + "max_abs": 840.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "54921301212f3ddcdbb12b3964472688a6c62b370867e4811124ada975c9ad08", + "mean": -0.10536661744117737, + "std": 2.6276180744171143, + "rms": 2.629729747772217, + "max_abs": 127.0 + }, + "full_input": { + "shape": [ + 155, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b9692c8fd43ef42871313dfcab4df6a42c3bfb8c81a63d96bb6d659c6e36f267", + "mean": -0.09132701903581619, + "std": 4.607804298400879, + "rms": 4.608709335327148, + "max_abs": 840.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "25cf3de5fdfb8134b76f3f7cd2fb089144879dbf6e9d9f51c0f6505bdad07790", + "mean": -0.10634014755487442, + "std": 2.636418342590332, + "rms": 2.638561964035034, + "max_abs": 126.0 + }, + "full_input": { + "shape": [ + 171, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2273ffa538f3431c890ec4f8cbccee19afb0a0ddc4d47873ac491675abb9a602", + "mean": -0.08333046734333038, + "std": 4.476396560668945, + "rms": 4.477172374725342, + "max_abs": 840.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9986520409584045, + "min_cosine_similarity": 0.9922805428504944, + "mean_relative_l2": 0.04944169521331787, + "max_abs_delta": 4.0 + }, + "system_bos": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.998361349105835, + "min_cosine_similarity": 0.9934629797935486, + "mean_relative_l2": 0.05581677705049515, + "max_abs_delta": 2.875 + }, + "system_x": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9968189001083374, + "min_cosine_similarity": 0.98548424243927, + "mean_relative_l2": 0.07787565886974335, + "max_abs_delta": 4.0 + }, + "system_period": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9963130354881287, + "min_cosine_similarity": 0.9849182367324829, + "mean_relative_l2": 0.08399394154548645, + "max_abs_delta": 4.28125 + }, + "bos_at_s0": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.998119056224823, + "min_cosine_similarity": 0.9944026470184326, + "mean_relative_l2": 0.06015140190720558, + "max_abs_delta": 2.5 + }, + "bos_at_s1": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.997412919998169, + "min_cosine_similarity": 0.9888395667076111, + "mean_relative_l2": 0.06973397731781006, + "max_abs_delta": 4.5 + }, + "x_at_s0": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9975823163986206, + "min_cosine_similarity": 0.9923256635665894, + "mean_relative_l2": 0.06795301288366318, + "max_abs_delta": 4.0 + }, + "x_at_s1": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9957573413848877, + "min_cosine_similarity": 0.9848495721817017, + "mean_relative_l2": 0.08962023258209229, + "max_abs_delta": 5.5 + }, + "period_at_s0": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9977333545684814, + "min_cosine_similarity": 0.9918086528778076, + "mean_relative_l2": 0.06583316624164581, + "max_abs_delta": 4.5 + }, + "period_at_s1": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9952734112739563, + "min_cosine_similarity": 0.9781983494758606, + "mean_relative_l2": 0.09429430961608887, + "max_abs_delta": 4.75 + } + } + }, + "layer_25": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "67fb8dc1e8c66d0831cc41fdb7aa22b3f3592bc0734c2a4820d87f2984e5d196", + "mean": -0.15475040674209595, + "std": 3.575225353240967, + "rms": 3.578572988510132, + "max_abs": 182.0 + }, + "full_input": { + "shape": [ + 155, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7a1712121e54e7e7786fd5c61f96281fcdda7c73af48329ace8717f22716c349", + "mean": -0.14298976957798004, + "std": 5.753327369689941, + "rms": 5.7551045417785645, + "max_abs": 872.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8c36ce8e4d118e72eadfc54666159db6a44a2794ff112d972ffa99605bf8d67b", + "mean": -0.15263605117797852, + "std": 3.581295967102051, + "rms": 3.584547281265259, + "max_abs": 181.0 + }, + "full_input": { + "shape": [ + 171, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "17a65f5586804d46e4bae256ec5fbc6f8cdcd70928a82afe13de320a62395024", + "mean": -0.13069741427898407, + "std": 5.955406188964844, + "rms": 5.956839561462402, + "max_abs": 984.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0a9b007a4ae859f1dcb6a239a149a0f82e7baa9fd87e864559866a039d075a25", + "mean": -0.15593022108078003, + "std": 3.5742435455322266, + "rms": 3.5776431560516357, + "max_abs": 180.0 + }, + "full_input": { + "shape": [ + 155, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1016c39d0f7c9a9842435a2593bcb01c66a09d27993e181212fefe41f101700b", + "mean": -0.13558778166770935, + "std": 3.6964354515075684, + "rms": 3.6989212036132812, + "max_abs": 248.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9838788bf8ec72876bc84156b9d7cf9bf660dae59be7e06b941ae8a5f8c7a0aa", + "mean": -0.15611205995082855, + "std": 3.5750036239624023, + "rms": 3.5784106254577637, + "max_abs": 180.0 + }, + "full_input": { + "shape": [ + 171, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a7a2c391b3a1682809961b065eaea005583858c52d18d6f212095ca3a6ef9b4b", + "mean": -0.12467265129089355, + "std": 3.701704978942871, + "rms": 3.703803777694702, + "max_abs": 248.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "53786a3239bf85bd03851cf57b6aa2472f854f42475962014364f6e79001b610", + "mean": -0.1552077829837799, + "std": 3.5733909606933594, + "rms": 3.5767600536346436, + "max_abs": 181.0 + }, + "full_input": { + "shape": [ + 155, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a3d2dbd18287132fa3430ba04540334f033275bdfff495a0447fd05e5918f7f7", + "mean": -0.13553309440612793, + "std": 3.7041571140289307, + "rms": 3.7066354751586914, + "max_abs": 248.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c105750c7e568fd1cee283db37c2cd4953a0984dff29fb30e2a4ee89b2301403", + "mean": -0.15345966815948486, + "std": 3.5659193992614746, + "rms": 3.5692200660705566, + "max_abs": 178.0 + }, + "full_input": { + "shape": [ + 171, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "37079f18ecf54feb9acf6c1efd634ccfd082db257a28b5125f5483e00c74a6cc", + "mean": -0.1227891594171524, + "std": 3.7044897079467773, + "rms": 3.706523895263672, + "max_abs": 248.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8e7e3dc0d9fade5389b4a31995a532e5734c667b045916489c58001ab106ef41", + "mean": -0.15613557398319244, + "std": 3.570807695388794, + "rms": 3.5742199420928955, + "max_abs": 181.0 + }, + "full_input": { + "shape": [ + 155, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e5d5c438d11617de9c3011d372cec028cf2d851bfb26b1f4b3519e27e4e5f3d0", + "mean": -0.13613969087600708, + "std": 3.697197914123535, + "rms": 3.6997034549713135, + "max_abs": 248.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "65e2202ed06516f8a50f427060ac37b10c4469abdd5e4ef1d290729f97a8d1d8", + "mean": -0.1551021933555603, + "std": 3.5727779865264893, + "rms": 3.5761430263519287, + "max_abs": 178.0 + }, + "full_input": { + "shape": [ + 171, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1c93c8ea6cebaa73530b1c53a8c419924084361a9636e1e7bd06178f43e6f30c", + "mean": -0.12339600920677185, + "std": 3.7040820121765137, + "rms": 3.706136703491211, + "max_abs": 248.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9990602731704712, + "min_cosine_similarity": 0.9947875738143921, + "mean_relative_l2": 0.04163442924618721, + "max_abs_delta": 7.0 + }, + "system_bos": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9988718032836914, + "min_cosine_similarity": 0.9952694773674011, + "mean_relative_l2": 0.04667254909873009, + "max_abs_delta": 3.75 + }, + "system_x": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.997623860836029, + "min_cosine_similarity": 0.9897700548171997, + "mean_relative_l2": 0.067441426217556, + "max_abs_delta": 8.5 + }, + "system_period": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9972575306892395, + "min_cosine_similarity": 0.9895450472831726, + "mean_relative_l2": 0.07252893596887589, + "max_abs_delta": 11.0 + }, + "bos_at_s0": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9987669587135315, + "min_cosine_similarity": 0.9964451789855957, + "mean_relative_l2": 0.048997413367033005, + "max_abs_delta": 4.0 + }, + "bos_at_s1": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9983016848564148, + "min_cosine_similarity": 0.9925172328948975, + "mean_relative_l2": 0.056789007037878036, + "max_abs_delta": 6.0 + }, + "x_at_s0": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.998382568359375, + "min_cosine_similarity": 0.9952349066734314, + "mean_relative_l2": 0.05581491440534592, + "max_abs_delta": 5.0 + }, + "x_at_s1": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9969874620437622, + "min_cosine_similarity": 0.9897396564483643, + "mean_relative_l2": 0.07576430588960648, + "max_abs_delta": 10.0 + }, + "period_at_s0": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9985141754150391, + "min_cosine_similarity": 0.9944455027580261, + "mean_relative_l2": 0.05368933454155922, + "max_abs_delta": 5.0 + }, + "period_at_s1": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9967211484909058, + "min_cosine_similarity": 0.9853463768959045, + "mean_relative_l2": 0.07887792587280273, + "max_abs_delta": 8.0 + } + } + }, + "layer_26": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "546a076611dfd83927c1464ca9a716f436941a7723ed48c6b53cdf4481ecad11", + "mean": -0.20949093997478485, + "std": 3.856661558151245, + "rms": 3.86234712600708, + "max_abs": 208.0 + }, + "full_input": { + "shape": [ + 155, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8d54dc2d7564328e58ca8f5701578b23291beba6a819224f9bfd27a214422149", + "mean": -0.19518537819385529, + "std": 5.939541816711426, + "rms": 5.942748069763184, + "max_abs": 840.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c528cbd97f41db6cad4b3bc5ebb0fd9b02d6270dfbc0636a1dc64770f1b0320a", + "mean": -0.20522236824035645, + "std": 3.816725015640259, + "rms": 3.8222384452819824, + "max_abs": 206.0 + }, + "full_input": { + "shape": [ + 171, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "efa91513800745395be467f7b910a3df72302e73e31cefd66d1a1920837b6ebb", + "mean": -0.17338302731513977, + "std": 6.151074409484863, + "rms": 6.153517246246338, + "max_abs": 872.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d6e6feec5ba232498ddbfbc7542c6b56b92eb63e0e6b0131ab372450744fde1a", + "mean": -0.20975084602832794, + "std": 3.8399617671966553, + "rms": 3.845686197280884, + "max_abs": 212.0 + }, + "full_input": { + "shape": [ + 155, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ba04d8fa9dc0111b85be93691ebad4294569efc3725e680844d83f5fb3ee9554", + "mean": -0.18558229506015778, + "std": 4.32795524597168, + "rms": 4.331932067871094, + "max_abs": 772.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "896d07ae5b4a772c8fd183e2ff6561b3f6d2600661e238d35aaa61aa05aa6565", + "mean": -0.20713339745998383, + "std": 3.7901549339294434, + "rms": 3.7958104610443115, + "max_abs": 214.0 + }, + "full_input": { + "shape": [ + 171, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bdbdf9595016865fc5dae5825828a6ce3c044f2048c9515812d38d13c24720c5", + "mean": -0.16499175131320953, + "std": 4.409737586975098, + "rms": 4.412822723388672, + "max_abs": 772.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "65cac17137ef186307d2eeed04a69ca461dfb5d0e10e01256d8a2c96eb254814", + "mean": -0.20868225395679474, + "std": 3.8469576835632324, + "rms": 3.8526134490966797, + "max_abs": 212.0 + }, + "full_input": { + "shape": [ + 155, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0c2ff9a2655c0f68a830afa55bb1683ae550ee38863a372b583e6719c1280971", + "mean": -0.18527238070964813, + "std": 4.340909004211426, + "rms": 4.344861030578613, + "max_abs": 772.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "81115abf19770338ba8d09d7c25068b7a056d9bcb4f407a04c7c9a25cfba3551", + "mean": -0.2000785917043686, + "std": 3.6967592239379883, + "rms": 3.702169895172119, + "max_abs": 212.0 + }, + "full_input": { + "shape": [ + 171, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "13fd817f1548229e23acabe10958f14f6f83d40e56783a217796c487981bea40", + "mean": -0.15940925478935242, + "std": 4.35786771774292, + "rms": 4.360782146453857, + "max_abs": 772.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "45316865b3e286bee6abb1ce961660c992288bc275115744230f8f174216f68a", + "mean": -0.20909157395362854, + "std": 3.8264994621276855, + "rms": 3.8322079181671143, + "max_abs": 210.0 + }, + "full_input": { + "shape": [ + 155, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c850f5d1b4ed44381f08ac80d04a1973260ffb567d1a58bff2f2ae2f6c15a458", + "mean": -0.1853129267692566, + "std": 4.316827297210693, + "rms": 4.320803165435791, + "max_abs": 772.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8d324a84946a240a77e3117d2d480a0e6ab1da97d8dcd3789c6561d355b5ab35", + "mean": -0.2004365772008896, + "std": 3.67073917388916, + "rms": 3.6762075424194336, + "max_abs": 212.0 + }, + "full_input": { + "shape": [ + 171, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b6e4037a337a43eb75f4847599aeb9364cd3a79299c4a082215267526d37c7cd", + "mean": -0.15897928178310394, + "std": 4.328841686248779, + "rms": 4.331759929656982, + "max_abs": 772.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9987449049949646, + "min_cosine_similarity": 0.9921899437904358, + "mean_relative_l2": 0.05023587495088577, + "max_abs_delta": 16.5 + }, + "system_bos": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9985511302947998, + "min_cosine_similarity": 0.994597852230072, + "mean_relative_l2": 0.056072771549224854, + "max_abs_delta": 10.0 + }, + "system_x": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9961706399917603, + "min_cosine_similarity": 0.9781748652458191, + "mean_relative_l2": 0.09315994381904602, + "max_abs_delta": 22.5 + }, + "system_period": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9955717921257019, + "min_cosine_similarity": 0.9728044271469116, + "mean_relative_l2": 0.10067123919725418, + "max_abs_delta": 22.5 + }, + "bos_at_s0": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9985986351966858, + "min_cosine_similarity": 0.9956538081169128, + "mean_relative_l2": 0.05349346995353699, + "max_abs_delta": 9.0 + }, + "bos_at_s1": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9979508519172668, + "min_cosine_similarity": 0.9924418926239014, + "mean_relative_l2": 0.06444999575614929, + "max_abs_delta": 13.5 + }, + "x_at_s0": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9981637597084045, + "min_cosine_similarity": 0.9942173957824707, + "mean_relative_l2": 0.060919225215911865, + "max_abs_delta": 16.0 + }, + "x_at_s1": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9958102703094482, + "min_cosine_similarity": 0.9756072163581848, + "mean_relative_l2": 0.09424502402544022, + "max_abs_delta": 23.375 + }, + "period_at_s0": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9983533620834351, + "min_cosine_similarity": 0.9932273030281067, + "mean_relative_l2": 0.05828603357076645, + "max_abs_delta": 14.0 + }, + "period_at_s1": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9955594539642334, + "min_cosine_similarity": 0.984918475151062, + "mean_relative_l2": 0.10054705291986465, + "max_abs_delta": 24.0 + } + } + }, + "final_norm": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "11e53348ab1687260b609f20825beb2dc5060e946189e1a085c2167d4d50a086", + "mean": -0.03878166899085045, + "std": 0.7387930154800415, + "rms": 0.7398102283477783, + "max_abs": 16.75 + }, + "full_input": { + "shape": [ + 155, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "575ec7af7bed99970a19af57d6300f52118f5997251bf203daab26084df4fd3b", + "mean": -0.03378445655107498, + "std": 0.7216503024101257, + "rms": 0.7224407196044922, + "max_abs": 24.25 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "40aab94f435b8043f97986412e64957b9e8bb5b0c07af3cdacc3a4bc0086e05a", + "mean": -0.03840866684913635, + "std": 0.7373231053352356, + "rms": 0.7383227944374084, + "max_abs": 16.5 + }, + "full_input": { + "shape": [ + 171, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "54956ce0aa7b63d8dd961780157c543096f3cc7d69cae92d69ffea7668c360a7", + "mean": -0.029813984408974648, + "std": 0.7014901638031006, + "rms": 0.7021234035491943, + "max_abs": 24.625 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9e39881d5b3d553d937db2f33510666eec0d610c176dc91fb9e757c3b5951231", + "mean": -0.039023637771606445, + "std": 0.7427104115486145, + "rms": 0.7437349557876587, + "max_abs": 16.75 + }, + "full_input": { + "shape": [ + 155, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f714c3f2015913b45bfd9a9a1034ab36d0a424ef1b5b5bd2300050d327fbffcb", + "mean": -0.03388994559645653, + "std": 0.7250948548316956, + "rms": 0.7258864045143127, + "max_abs": 23.75 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7ab85fd192ea182412688d8fc972e438ea50375b178dde04bd2fdea230b1b56d", + "mean": -0.03919614851474762, + "std": 0.7454585433006287, + "rms": 0.7464882731437683, + "max_abs": 17.125 + }, + "full_input": { + "shape": [ + 171, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7b8abe482cf8de592abcae94d09225001ddb2957374c8b4ec2c51ef0fc223723", + "mean": -0.030476117506623268, + "std": 0.7080684900283813, + "rms": 0.7087240219116211, + "max_abs": 24.625 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "48c7850a749aa0328f344dd5b61abe1bb39f2820023eeecff1654e830194a53a", + "mean": -0.03860653564333916, + "std": 0.7346989512443542, + "rms": 0.7357126474380493, + "max_abs": 16.625 + }, + "full_input": { + "shape": [ + 155, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7789b482017d130471e5eeb3bcd766c35e3a1cd71066b3d0a76c846e9c1998d5", + "mean": -0.0335988886654377, + "std": 0.7171324491500854, + "rms": 0.717919111251831, + "max_abs": 24.5 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e7287903508ce700e665fe337b144eb88198e62e8cc4af10db2e8232269ead54", + "mean": -0.03855244442820549, + "std": 0.7312265038490295, + "rms": 0.7322421073913574, + "max_abs": 16.625 + }, + "full_input": { + "shape": [ + 171, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "06ce72187e689cd7e8e6163b9b242e9129d232de4b88e419ab31e7b8c65148c7", + "mean": -0.029847778379917145, + "std": 0.6952498555183411, + "rms": 0.6958902478218079, + "max_abs": 24.75 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "22a336d392f2658ed6e68e9d8fc5a2b8b5e95d87442ba9c623fc2a8eeaadd855", + "mean": -0.03906344622373581, + "std": 0.7418869733810425, + "rms": 0.742914617061615, + "max_abs": 16.75 + }, + "full_input": { + "shape": [ + 155, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ceb4886aa0497c971777f2fd23e3950c7570fac2f44c485785897f891f44537e", + "mean": -0.03399930149316788, + "std": 0.724487841129303, + "rms": 0.7252852320671082, + "max_abs": 24.5 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 130, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4a0199f8ce3c1fee20b600f51c390cf6d9687cb3ad117e31c1c004fbdbfc4c53", + "mean": -0.03907276317477226, + "std": 0.7417058944702148, + "rms": 0.7427343130111694, + "max_abs": 17.625 + }, + "full_input": { + "shape": [ + 171, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3b413f124f0e9867100aaa64e27057f613443d52f34eb90d26bb54fae283d58d", + "mean": -0.03017372265458107, + "std": 0.7048308253288269, + "rms": 0.7054764032363892, + "max_abs": 25.75 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9986108541488647, + "min_cosine_similarity": 0.9837595224380493, + "mean_relative_l2": 0.048874929547309875, + "max_abs_delta": 1.65625 + }, + "system_bos": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9984084963798523, + "min_cosine_similarity": 0.9913074374198914, + "mean_relative_l2": 0.055449917912483215, + "max_abs_delta": 1.3125 + }, + "system_x": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9960227608680725, + "min_cosine_similarity": 0.9517324566841125, + "mean_relative_l2": 0.08355994522571564, + "max_abs_delta": 2.5 + }, + "system_period": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9954720139503479, + "min_cosine_similarity": 0.9408908486366272, + "mean_relative_l2": 0.08996208012104034, + "max_abs_delta": 2.75 + }, + "bos_at_s0": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9985854029655457, + "min_cosine_similarity": 0.994620144367218, + "mean_relative_l2": 0.052728988230228424, + "max_abs_delta": 1.3125 + }, + "bos_at_s1": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.997923731803894, + "min_cosine_similarity": 0.9882256388664246, + "mean_relative_l2": 0.06382325291633606, + "max_abs_delta": 1.640625 + }, + "x_at_s0": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9980770349502563, + "min_cosine_similarity": 0.993447482585907, + "mean_relative_l2": 0.06051243841648102, + "max_abs_delta": 1.46875 + }, + "x_at_s1": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9957668781280518, + "min_cosine_similarity": 0.973854124546051, + "mean_relative_l2": 0.08796986192464828, + "max_abs_delta": 2.4375 + }, + "period_at_s0": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.998363196849823, + "min_cosine_similarity": 0.9931762218475342, + "mean_relative_l2": 0.055925916880369186, + "max_abs_delta": 1.1875 + }, + "period_at_s1": { + "tokens": 130, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9955756664276123, + "min_cosine_similarity": 0.9712404012680054, + "mean_relative_l2": 0.09062659740447998, + "max_abs_delta": 2.5625 + } + } + } + }, + "router_layers": { + "layer_01": { + "layer": 1, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "398a2e6f84316e2e049796d8cfb0e407a389608148c3548b6edd1680ab989c24", + "route_weight_sha256": "a89b5d78ebe3290694f5bf990700a0f36b9d84417da0f3517ab9ee72b3173cc1", + "loads": [ + 17, + 17, + 13, + 10, + 12, + 26, + 6, + 18, + 21, + 16, + 15, + 6, + 10, + 13, + 9, + 9, + 17, + 5, + 22, + 17, + 4, + 22, + 9, + 9, + 16, + 13, + 11, + 14, + 8, + 6, + 13, + 7, + 4, + 8, + 14, + 15, + 14, + 18, + 12, + 4, + 19, + 13, + 11, + 18, + 9, + 10, + 4, + 9, + 14, + 7, + 8, + 15, + 7, + 17, + 11, + 7, + 6, + 9, + 11, + 19, + 5, + 15, + 17, + 19 + ], + "weighted_loads": [ + 1.0193033907562494, + 0.5852307584136724, + 0.8943798430263996, + 0.5102443657815456, + 1.1216013617813587, + 1.721633655950427, + 0.19011675752699375, + 0.8154963050037622, + 0.791429853066802, + 1.1337746605277061, + 1.1810039840638638, + 0.20104269869625568, + 0.25947960279881954, + 1.0095465555787086, + 0.4231660310178995, + 0.38167915493249893, + 0.417839951813221, + 0.17281997203826904, + 1.0838377587497234, + 1.3350281491875648, + 0.15557772479951382, + 1.5414477325975895, + 0.3173951096832752, + 0.6225380897521973, + 0.8292966783046722, + 0.5268850885331631, + 0.34150570072233677, + 0.7312789466232061, + 0.24777519516646862, + 0.3880015555769205, + 0.3691017534583807, + 0.7421357519924641, + 0.12775833904743195, + 0.30715094320476055, + 0.5950455497950315, + 0.8161618020385504, + 0.47669526748359203, + 0.8739493954926729, + 1.014250110834837, + 0.3083770051598549, + 1.1847769618034363, + 0.50840774923563, + 0.7651126682758331, + 1.1549182310700417, + 0.33953130804002285, + 0.9426750708371401, + 0.19300752133131027, + 0.4454264286905527, + 0.890061816200614, + 0.38398961909115314, + 0.42428397201001644, + 1.4039613753557205, + 0.7029992565512657, + 0.7883205637335777, + 0.7596149705350399, + 0.26875285618007183, + 0.20196251012384892, + 0.3136843293905258, + 0.421269454061985, + 1.2608486823737621, + 0.23955311253666878, + 1.2952252645045519, + 1.6602425165474415, + 1.6343772634863853 + ], + "unique_experts": 64, + "load_cv": 0.42210455469626484, + "normalized_load_entropy": 0.9780316465370497, + "max_load_share": 0.03333333333333333 + }, + "full_input": { + "tokens": 155, + "top_k": 6, + "decisions": 930, + "ordered_route_sha256": "7fcd2289390fcb44866b77f31e00db4a456e4ea063db6b102809be1a8c79de72", + "route_weight_sha256": "0cbdedbc4819d65323ec138c1996974bfb7501855ea3ba7fe2eaa33cf084cf11", + "loads": [ + 17, + 17, + 15, + 10, + 16, + 26, + 7, + 20, + 38, + 16, + 17, + 6, + 10, + 13, + 10, + 18, + 17, + 6, + 22, + 17, + 6, + 22, + 10, + 9, + 16, + 17, + 24, + 14, + 8, + 6, + 14, + 13, + 6, + 11, + 14, + 16, + 14, + 18, + 12, + 7, + 20, + 23, + 11, + 23, + 10, + 21, + 5, + 10, + 14, + 8, + 12, + 16, + 11, + 17, + 14, + 11, + 9, + 17, + 11, + 30, + 6, + 19, + 18, + 19 + ], + "weighted_loads": [ + 1.0193033907562494, + 0.5852307584136724, + 0.9968486353754997, + 0.5102443657815456, + 1.2822942603379488, + 1.721633655950427, + 0.2517750430852175, + 1.0836314056068659, + 1.7072888892143965, + 1.1337746605277061, + 1.4323544539511204, + 0.20104269869625568, + 0.25947960279881954, + 1.0095465555787086, + 0.4450525902211666, + 0.9989953748881817, + 0.417839951813221, + 0.24453304708003998, + 1.0838377587497234, + 1.3350281491875648, + 0.39092559181153774, + 1.5414477325975895, + 0.34746301732957363, + 0.6225380897521973, + 0.8292966783046722, + 0.696015190333128, + 1.1513766217976809, + 0.7312789466232061, + 0.24777519516646862, + 0.3880015555769205, + 0.45348563604056835, + 1.2176877712481655, + 0.21923406794667244, + 0.5446172449737787, + 0.5950455497950315, + 0.8366268333047628, + 0.47669526748359203, + 0.8739493954926729, + 1.014250110834837, + 0.5493341460824013, + 1.2238030284643173, + 0.9206305481493473, + 0.7651126682758331, + 1.2644329590839334, + 1.323849206790328, + 1.7613857096876018, + 0.26194214820861816, + 0.4648854359984398, + 0.890061816200614, + 0.4095063954591751, + 0.5837315451353788, + 1.404567112447694, + 0.9779555797576904, + 0.7883205637335777, + 0.8049808883224614, + 0.7858798112720251, + 0.4785489682108164, + 0.7908366173505783, + 0.421269454061985, + 1.9777300991117954, + 0.33037780597805977, + 1.5147024858742952, + 1.7154071442782879, + 1.6343772634863853 + ], + "unique_experts": 64, + "load_cv": 0.42975792243157585, + "normalized_load_entropy": 0.9786271531195211, + "max_load_share": 0.04086021505376344 + } + }, + "s1_eos": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "edf9b773dee54e9f1015b95ee6664543ce540db1ea084d26aa02a3091fcba049", + "route_weight_sha256": "327abd7bb1c6b01f00bde7e1ee0beea17c67c9b366d3363d28c17e99e5e996e0", + "loads": [ + 18, + 16, + 13, + 11, + 12, + 26, + 7, + 21, + 15, + 16, + 15, + 8, + 6, + 13, + 8, + 10, + 12, + 5, + 22, + 17, + 4, + 21, + 10, + 9, + 15, + 13, + 5, + 15, + 9, + 6, + 16, + 7, + 5, + 7, + 14, + 15, + 14, + 18, + 12, + 4, + 19, + 13, + 11, + 18, + 13, + 10, + 4, + 10, + 16, + 8, + 8, + 15, + 7, + 18, + 11, + 8, + 7, + 9, + 11, + 19, + 5, + 14, + 17, + 19 + ], + "weighted_loads": [ + 1.0410373266786337, + 0.5566860940307379, + 0.8940878733992577, + 0.5453701671212912, + 1.1240201592445374, + 1.7234737165272236, + 0.21657960303127766, + 0.8794568106532097, + 0.559052586555481, + 1.1298338919878006, + 1.1939595267176628, + 0.2576467450708151, + 0.16350360587239265, + 1.0207529813051224, + 0.3956069350242615, + 0.40921360813081264, + 0.30957874469459057, + 0.16799995116889477, + 1.093195952475071, + 1.3407399877905846, + 0.15449127927422523, + 1.52541683614254, + 0.3412697073072195, + 0.6244471557438374, + 0.7940685860812664, + 0.5296061523258686, + 0.18774624913930893, + 0.7468662429600954, + 0.276096448302269, + 0.39178596809506416, + 0.4361720774322748, + 0.740092758089304, + 0.15302443876862526, + 0.2797451615333557, + 0.603806534782052, + 0.8257920872420073, + 0.47881377674639225, + 0.8902683109045029, + 1.017528671771288, + 0.3058723285794258, + 1.186815582215786, + 0.5075019299983978, + 0.7712579183280468, + 1.1479337699711323, + 0.4390364736318588, + 0.9410515744239092, + 0.19319993630051613, + 0.47981942258775234, + 0.9324295427650213, + 0.42693720757961273, + 0.4322333801537752, + 1.3881706781685352, + 0.7020896188914776, + 0.8367864601314068, + 0.7680830173194408, + 0.2903470955789089, + 0.22680438309907913, + 0.31444450095295906, + 0.4255436360836029, + 1.2559762001037598, + 0.24464781023561954, + 1.2787970006465912, + 1.6376066282391548, + 1.652200534939766 + ], + "unique_experts": 64, + "load_cv": 0.41582755744171424, + "normalized_load_entropy": 0.97864727851377, + "max_load_share": 0.03333333333333333 + }, + "full_input": { + "tokens": 171, + "top_k": 6, + "decisions": 1026, + "ordered_route_sha256": "0298f5d521c5f14a3bc85b7b7fe27fc4b0aa92e5a1dacdf174c2c5b350923198", + "route_weight_sha256": "7f3b25bff16c5ffa80da73ea4b07fe575d9ae196979f0d88855d44649e14523e", + "loads": [ + 20, + 16, + 16, + 11, + 19, + 28, + 8, + 24, + 38, + 16, + 20, + 9, + 6, + 14, + 9, + 22, + 12, + 10, + 23, + 18, + 6, + 23, + 15, + 10, + 17, + 18, + 24, + 16, + 9, + 8, + 18, + 15, + 7, + 10, + 14, + 16, + 15, + 19, + 12, + 9, + 20, + 25, + 14, + 24, + 15, + 21, + 5, + 13, + 18, + 10, + 17, + 19, + 12, + 18, + 16, + 12, + 16, + 21, + 13, + 30, + 7, + 19, + 18, + 23 + ], + "weighted_loads": [ + 1.1462708469480276, + 0.5566860940307379, + 1.059920497238636, + 0.5453701671212912, + 1.5213984418660402, + 1.8605091720819473, + 0.26197526417672634, + 1.1167918611317873, + 1.8898100778460503, + 1.1298338919878006, + 1.6374234557151794, + 0.40422423742711544, + 0.16350360587239265, + 1.0607547387480736, + 0.4166150167584419, + 1.112527398392558, + 0.30957874469459057, + 0.36873890459537506, + 1.1321532614529133, + 1.4067677110433578, + 0.32934992387890816, + 1.7297934368252754, + 0.6122472936694976, + 0.658655796200037, + 0.8658480849117041, + 0.7253660298883915, + 1.4631850607693195, + 0.789097623899579, + 0.276096448302269, + 0.5537416711449623, + 0.6069183591753244, + 1.4348107773112133, + 0.23139636777341366, + 0.46837901696562767, + 0.603806534782052, + 0.8464068099856377, + 0.7396770808845758, + 0.9238028861582279, + 1.017528671771288, + 0.665181327611208, + 1.226691085845232, + 1.0813297759741545, + 0.9786422941833735, + 1.345890710130334, + 1.579922154545784, + 1.708903806458693, + 0.26230834051966667, + 0.563018581160577, + 1.083734942600131, + 0.47190662287175655, + 0.8711703903973103, + 1.753034956753254, + 1.0409959219396114, + 0.8367864601314068, + 0.8618877289409284, + 0.7863804139196873, + 0.66040925309062, + 1.0168822091072798, + 0.5007233694195747, + 1.9276415556669235, + 0.36038099601864815, + 1.5898092575371265, + 1.6925325393676758, + 2.1447498574852943 + ], + "unique_experts": 64, + "load_cv": 0.39094878195475335, + "normalized_load_entropy": 0.9817501426248189, + "max_load_share": 0.037037037037037035 + } + }, + "s0_bos": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "c1170e6babeef0195f8846a1afc1b5d39f60a6f8f0e57dce96d748ccefa37c89", + "route_weight_sha256": "be1c93007463333efb54902dba4dc1031d19f43bc3b912ba6f1991e01e666de8", + "loads": [ + 20, + 16, + 13, + 12, + 12, + 25, + 9, + 22, + 12, + 16, + 15, + 10, + 9, + 13, + 9, + 7, + 6, + 11, + 19, + 17, + 4, + 19, + 12, + 9, + 17, + 13, + 11, + 13, + 9, + 7, + 14, + 7, + 5, + 9, + 14, + 13, + 13, + 16, + 14, + 4, + 18, + 7, + 11, + 18, + 13, + 9, + 6, + 10, + 12, + 9, + 9, + 15, + 7, + 14, + 11, + 8, + 9, + 9, + 10, + 22, + 5, + 15, + 17, + 20 + ], + "weighted_loads": [ + 1.146079421043396, + 0.5708372518420219, + 0.8978660777211189, + 0.5716985762119293, + 1.0159019753336906, + 1.4988706950098276, + 0.2929001450538635, + 0.9021908398717642, + 0.40507834404706955, + 1.1836314015090466, + 1.1635084189474583, + 0.3257142025977373, + 0.24437247589230537, + 0.9524579495191574, + 0.40398681722581387, + 0.36473158560693264, + 0.15948484651744366, + 0.39743502624332905, + 0.8934739585965872, + 1.3066912740468979, + 0.1414180789142847, + 1.3481779769062996, + 0.39212477393448353, + 0.6524038426578045, + 0.861479178071022, + 0.51008290797472, + 0.3467657845467329, + 0.6935541443526745, + 0.2889525890350342, + 0.4660425204783678, + 0.39306202344596386, + 0.7241210043430328, + 0.17943556047976017, + 0.39426766335964203, + 0.6251991521567106, + 0.7314986195415258, + 0.4564976952970028, + 0.7678042128682137, + 1.1375338733196259, + 0.30292922258377075, + 1.092097394168377, + 0.277247067540884, + 0.7631619721651077, + 1.101309360936284, + 0.4383849259465933, + 0.8371040150523186, + 0.2549746837466955, + 0.46418421901762486, + 0.7943585086613894, + 0.4626023843884468, + 0.510106647387147, + 1.3842514529824257, + 0.723946139216423, + 0.6900902837514877, + 0.782641839236021, + 0.28869371488690376, + 0.30024148523807526, + 0.27054155990481377, + 0.34724706411361694, + 1.2840421330183744, + 0.21434233523905277, + 1.3012430351227522, + 1.6514890249818563, + 1.6046850550919771 + ], + "unique_experts": 64, + "load_cv": 0.3826273406178617, + "normalized_load_entropy": 0.9823672212024644, + "max_load_share": 0.03205128205128205 + }, + "full_input": { + "tokens": 155, + "top_k": 6, + "decisions": 930, + "ordered_route_sha256": "00a96b3b55ce3d44ab763102fc78390254dfc0fc03bcbabd3263d2afa9fb1e0a", + "route_weight_sha256": "4bccba60e2e21fc71f4e337e6b93a1312e455f7f8ccce2619b6a3f30a1fac8cd", + "loads": [ + 21, + 16, + 15, + 12, + 16, + 25, + 10, + 24, + 27, + 16, + 17, + 11, + 10, + 13, + 10, + 16, + 6, + 13, + 19, + 17, + 6, + 19, + 13, + 9, + 17, + 17, + 24, + 13, + 9, + 7, + 15, + 12, + 7, + 12, + 14, + 14, + 13, + 16, + 14, + 7, + 19, + 17, + 12, + 22, + 13, + 19, + 8, + 10, + 12, + 10, + 13, + 15, + 11, + 15, + 13, + 12, + 13, + 18, + 10, + 32, + 7, + 19, + 18, + 20 + ], + "weighted_loads": [ + 1.1696261446923018, + 0.5708372518420219, + 0.9831563606858253, + 0.5716985762119293, + 1.167637960985303, + 1.4988706950098276, + 0.35455843061208725, + 1.1619177963584661, + 1.2215727902948856, + 1.1836314015090466, + 1.4101812057197094, + 0.35030300356447697, + 0.2905857227742672, + 0.9524579495191574, + 0.42570484429597855, + 0.9820478055626154, + 0.15948484651744366, + 0.5039113219827414, + 0.8934739585965872, + 1.3066912740468979, + 0.37676594592630863, + 1.3481779769062996, + 0.42219268158078194, + 0.6524038426578045, + 0.861479178071022, + 0.6843481138348579, + 1.1551896519958973, + 0.6935541443526745, + 0.2889525890350342, + 0.4660425204783678, + 0.46742657385766506, + 1.2241017445921898, + 0.2695936691015959, + 0.6316773518919945, + 0.6251991521567106, + 0.7501138728111982, + 0.4564976952970028, + 0.7678042128682137, + 1.1375338733196259, + 0.5482935681939125, + 1.1301229484379292, + 0.6894698664546013, + 0.8059538938105106, + 1.2103402074426413, + 0.4383849259465933, + 1.6553128808736801, + 0.35268884897232056, + 0.46418421901762486, + 0.7943585086613894, + 0.48427826166152954, + 0.6666279919445515, + 1.3842514529824257, + 0.987625390291214, + 0.7081398665904999, + 0.8275562282651663, + 0.8114537335932255, + 0.6414625123143196, + 0.8247160967439413, + 0.34724706411361694, + 1.967607593163848, + 0.4101530406624079, + 1.5237029995769262, + 1.7017473671585321, + 1.6046850550919771 + ], + "unique_experts": 64, + "load_cv": 0.35757821605756857, + "normalized_load_entropy": 0.9851014996100363, + "max_load_share": 0.034408602150537634 + } + }, + "s1_bos": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "a68e581f74302ee6ca28ad72e2c98b6e47c5166426474f3f25d380b23ac00bf0", + "route_weight_sha256": "5dd6a342ccc2374aedeb227ee9bcade26ef930d65207011e5e664544be4ea193", + "loads": [ + 18, + 15, + 14, + 12, + 12, + 26, + 7, + 23, + 9, + 16, + 15, + 10, + 5, + 13, + 7, + 8, + 6, + 7, + 19, + 17, + 4, + 21, + 10, + 9, + 16, + 13, + 23, + 14, + 10, + 7, + 15, + 8, + 4, + 8, + 16, + 12, + 12, + 17, + 14, + 4, + 19, + 15, + 11, + 15, + 15, + 9, + 5, + 11, + 13, + 8, + 9, + 15, + 7, + 14, + 11, + 8, + 7, + 9, + 8, + 19, + 5, + 15, + 17, + 19 + ], + "weighted_loads": [ + 1.020476346835494, + 0.5472884140908718, + 0.8778514079749584, + 0.5757288169115782, + 1.0479811877012253, + 1.6737002320587635, + 0.22329149208962917, + 0.9407803993672132, + 0.31065421365201473, + 1.1354521550238132, + 1.139440342783928, + 0.32633970864117146, + 0.14498881064355373, + 0.9601982049643993, + 0.3114464432001114, + 0.39246304892003536, + 0.16047722660005093, + 0.24879288487136364, + 0.8713693972676992, + 1.3007972836494446, + 0.14622344821691513, + 1.4828353896737099, + 0.35145716927945614, + 0.6121404133737087, + 0.8224544208496809, + 0.5173680000007153, + 0.6811925675719976, + 0.7096925619989634, + 0.313187662512064, + 0.45250396244227886, + 0.4265924133360386, + 0.7565008644014597, + 0.12965315021574497, + 0.3251775950193405, + 0.6819202210754156, + 0.7042343951761723, + 0.4367656856775284, + 0.7723243851214647, + 1.1173139996826649, + 0.29810795187950134, + 1.064192371442914, + 0.5232914201915264, + 0.74181754514575, + 1.017349487170577, + 0.4947005659341812, + 0.8549130409955978, + 0.23359070345759392, + 0.5080983620136976, + 0.8436223603785038, + 0.4306245297193527, + 0.507853377610445, + 1.3939669206738472, + 0.7171939834952354, + 0.6993829738348722, + 0.7905059047043324, + 0.2904768008738756, + 0.24540265649557114, + 0.27377125807106495, + 0.2598406095057726, + 1.2457656171172857, + 0.21885202080011368, + 1.2902874164283276, + 1.609904346987605, + 1.5630470886826515 + ], + "unique_experts": 64, + "load_cv": 0.41582755744171424, + "normalized_load_entropy": 0.9789902862422287, + "max_load_share": 0.03333333333333333 + }, + "full_input": { + "tokens": 171, + "top_k": 6, + "decisions": 1026, + "ordered_route_sha256": "9ef007843cfb86e0b1fecf0e748768bdf865fabf1513a8e6695ec3d3287b56ab", + "route_weight_sha256": "ad14889e7334c4edc2273b690d8a27fb7826315f6c5a3b250f9479c66a0226d1", + "loads": [ + 21, + 15, + 17, + 13, + 19, + 28, + 8, + 26, + 30, + 16, + 20, + 11, + 6, + 14, + 8, + 20, + 6, + 13, + 20, + 18, + 6, + 23, + 14, + 10, + 18, + 18, + 42, + 15, + 10, + 9, + 17, + 15, + 5, + 11, + 16, + 13, + 13, + 18, + 14, + 9, + 20, + 27, + 15, + 21, + 16, + 19, + 7, + 14, + 15, + 9, + 18, + 19, + 12, + 14, + 15, + 12, + 17, + 23, + 10, + 29, + 8, + 20, + 18, + 23 + ], + "weighted_loads": [ + 1.147923681885004, + 0.5472884140908718, + 1.0302417576313019, + 0.6074819471687078, + 1.4390542227774858, + 1.8107356876134872, + 0.26868715323507786, + 1.1689453050494194, + 1.530897879973054, + 1.1354521550238132, + 1.5781951770186424, + 0.4729172009974718, + 0.19174227304756641, + 1.0001999624073505, + 0.3328532837331295, + 1.0957768391817808, + 0.16047722660005093, + 0.47716072760522366, + 0.9103267062455416, + 1.3668250069022179, + 0.32108209282159805, + 1.6872119903564453, + 0.6221240274608135, + 0.6463490538299084, + 0.8942339196801186, + 0.7208997383713722, + 1.9547376651316881, + 0.751923942938447, + 0.313187662512064, + 0.614459665492177, + 0.5886534936726093, + 1.472758898511529, + 0.1790961679071188, + 0.5083104632794857, + 0.6819202210754156, + 0.7237976361066103, + 0.697628989815712, + 0.8058589603751898, + 1.1173139996826649, + 0.6624838002026081, + 1.1009018328040838, + 1.097119266167283, + 0.9856302943080664, + 1.2153064273297787, + 0.6466149538755417, + 1.6222973391413689, + 0.3382566124200821, + 0.6097931191325188, + 0.9949277602136135, + 0.4528112094849348, + 0.9519550055265427, + 1.758831199258566, + 1.0285934433341026, + 0.6993829738348722, + 0.8838892634958029, + 0.7871589902788401, + 0.7313397042453289, + 1.0751080233603716, + 0.3350203428417444, + 1.882850905880332, + 0.4371709618717432, + 1.603678185492754, + 1.6616505850106478, + 2.05559641122818 + ], + "unique_experts": 64, + "load_cv": 0.4147926462293645, + "normalized_load_entropy": 0.9801238398303171, + "max_load_share": 0.04093567251461988 + } + }, + "s0_x": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "9bdc484286beb8f6500beccfe52f99522a5ac1ed9019c3a4e6108cfe012fa7ba", + "route_weight_sha256": "e71db5e0b7f8198f76593694d55325ef35166392dd8ab6a9bbb9d969a6e364db", + "loads": [ + 19, + 16, + 13, + 11, + 12, + 26, + 9, + 16, + 18, + 16, + 15, + 8, + 7, + 13, + 9, + 7, + 5, + 11, + 18, + 17, + 3, + 20, + 10, + 9, + 17, + 12, + 21, + 14, + 9, + 7, + 15, + 7, + 6, + 8, + 14, + 14, + 12, + 16, + 13, + 4, + 20, + 12, + 11, + 20, + 13, + 9, + 4, + 9, + 15, + 7, + 9, + 15, + 7, + 13, + 11, + 8, + 7, + 9, + 10, + 17, + 5, + 15, + 17, + 20 + ], + "weighted_loads": [ + 1.0848432425409555, + 0.5838532596826553, + 0.864779818803072, + 0.5176997873932123, + 1.033846240490675, + 1.657503966242075, + 0.28783024474978447, + 0.7707818504422903, + 0.5776855926960707, + 1.1545607969164848, + 1.2055785059928894, + 0.25334582291543484, + 0.20267230831086636, + 0.9939329326152802, + 0.3928295373916626, + 0.3475849200040102, + 0.13536309078335762, + 0.3772757537662983, + 0.8943843767046928, + 1.2933550924062729, + 0.12286583706736565, + 1.4227341003715992, + 0.34939212165772915, + 0.6247662976384163, + 0.8816745970398188, + 0.48831397853791714, + 0.6296276766806841, + 0.7240134384483099, + 0.2814286518841982, + 0.44261834770441055, + 0.4199785478413105, + 0.73960742354393, + 0.2191884145140648, + 0.3450523316860199, + 0.6044461000710726, + 0.7809841707348824, + 0.43471455201506615, + 0.8140140771865845, + 1.061390247195959, + 0.29629820585250854, + 1.3097450360655785, + 0.43143691308796406, + 0.7574691995978355, + 1.1687478832900524, + 0.4386376924812794, + 0.860597625374794, + 0.194319237023592, + 0.43743812292814255, + 0.9033534061163664, + 0.3803733289241791, + 0.4792795106768608, + 1.4133852049708366, + 0.7073773890733719, + 0.668431906029582, + 0.7917087636888027, + 0.2868717107921839, + 0.24020817317068577, + 0.28040870651602745, + 0.3540363684296608, + 1.1875521019101143, + 0.22416487522423267, + 1.2677549496293068, + 1.6401409767568111, + 1.6246046219021082 + ], + "unique_experts": 64, + "load_cv": 0.40088659140908867, + "normalized_load_entropy": 0.9801865238467189, + "max_load_share": 0.03333333333333333 + }, + "full_input": { + "tokens": 155, + "top_k": 6, + "decisions": 930, + "ordered_route_sha256": "02e82fce01a676231546dc612f455679d31701566c2586812230d7a4ee372486", + "route_weight_sha256": "c8bb88cb5bc5c70a9cbad09c35e282f45a0a37f164acd5106143d8fb5c626046", + "loads": [ + 19, + 16, + 15, + 11, + 16, + 26, + 10, + 19, + 33, + 17, + 17, + 8, + 8, + 13, + 10, + 17, + 5, + 12, + 18, + 17, + 5, + 20, + 12, + 9, + 17, + 16, + 35, + 14, + 9, + 7, + 16, + 12, + 8, + 11, + 14, + 15, + 12, + 16, + 13, + 7, + 21, + 23, + 11, + 24, + 13, + 20, + 5, + 9, + 15, + 8, + 13, + 15, + 11, + 13, + 13, + 12, + 10, + 17, + 10, + 29, + 6, + 19, + 18, + 20 + ], + "weighted_loads": [ + 1.0848432425409555, + 0.5838532596826553, + 0.9593089930713177, + 0.5176997873932123, + 1.187489254400134, + 1.657503966242075, + 0.3494885303080082, + 1.0696978941559792, + 1.3976226281374693, + 1.180846069008112, + 1.4582294449210167, + 0.25334582291543484, + 0.2516943830996752, + 0.9939329326152802, + 0.4158479943871498, + 1.0822473298758268, + 0.13536309078335762, + 0.44898882880806923, + 0.8943843767046928, + 1.2933550924062729, + 0.35821370407938957, + 1.4227341003715992, + 0.4103324171155691, + 0.6247662976384163, + 0.8816745970398188, + 0.6671762224286795, + 1.4690762963145971, + 0.7240134384483099, + 0.2814286518841982, + 0.44261834770441055, + 0.4968314878642559, + 1.259250558912754, + 0.30987650342285633, + 0.5839872658252716, + 0.6044461000710726, + 0.7990579530596733, + 0.43471455201506615, + 0.8140140771865845, + 1.061390247195959, + 0.5645509362220764, + 1.3515418246388435, + 0.8994989935308695, + 0.7574691995978355, + 1.2777787297964096, + 0.4386376924812794, + 1.7125404626131058, + 0.2672267071902752, + 0.43743812292814255, + 0.9033534061163664, + 0.4025058373808861, + 0.6379966679960489, + 1.4133852049708366, + 0.9551464393734932, + 0.668431906029582, + 0.836623152717948, + 0.8300583977252245, + 0.4324716795235872, + 0.7540700230747461, + 0.3540363684296608, + 1.9868977516889572, + 0.31498956866562366, + 1.4862011820077896, + 1.6901215426623821, + 1.6246046219021082 + ], + "unique_experts": 64, + "load_cv": 0.42368866201688204, + "normalized_load_entropy": 0.9795428490692059, + "max_load_share": 0.03763440860215054 + } + }, + "s1_x": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "948ebc501fc5bb6f266adb78827b96cd251be30e60c9261d23f3556263a23018", + "route_weight_sha256": "9cf2b23ba7fb81bb734647729ba463325755c3a38f2a267289c4ba140976962c", + "loads": [ + 18, + 15, + 14, + 11, + 12, + 26, + 8, + 22, + 9, + 16, + 15, + 10, + 5, + 13, + 6, + 8, + 6, + 7, + 19, + 17, + 4, + 21, + 8, + 9, + 16, + 12, + 26, + 14, + 10, + 7, + 16, + 8, + 4, + 8, + 14, + 12, + 12, + 17, + 14, + 4, + 20, + 15, + 11, + 15, + 16, + 9, + 4, + 10, + 15, + 8, + 9, + 15, + 7, + 15, + 11, + 8, + 7, + 9, + 9, + 18, + 5, + 15, + 17, + 19 + ], + "weighted_loads": [ + 0.9959131367504597, + 0.5501202587038279, + 0.8408505376428366, + 0.5392985492944717, + 1.0569793209433556, + 1.7077637128531933, + 0.2505087163299322, + 0.9108947347849607, + 0.30530184879899025, + 1.1091800928115845, + 1.1375686042010784, + 0.31961107067763805, + 0.14161399565637112, + 0.9831342697143555, + 0.272744482383132, + 0.3850234393030405, + 0.16070875339210033, + 0.23620778508484364, + 0.8654929362237453, + 1.2781636118888855, + 0.14808794297277927, + 1.5042626988142729, + 0.30503500811755657, + 0.5925563871860504, + 0.8360695373266935, + 0.4924341235309839, + 0.796747475862503, + 0.7048391383141279, + 0.3117377106100321, + 0.4370904713869095, + 0.45565466210246086, + 0.7613939642906189, + 0.13056405819952488, + 0.31343454495072365, + 0.6287226472049952, + 0.7132765110582113, + 0.4288767818361521, + 0.7815287504345179, + 1.0971675273030996, + 0.29534148424863815, + 1.1645746231079102, + 0.563643591478467, + 0.7304663322865963, + 1.0122283343225718, + 0.5222710780799389, + 0.858575452119112, + 0.19699883833527565, + 0.4818490520119667, + 0.8986413981765509, + 0.4243081770837307, + 0.4991362076252699, + 1.3931190706789494, + 0.7124979197978973, + 0.7382804658263922, + 0.7746851556003094, + 0.29077686183154583, + 0.2472739741206169, + 0.2778868731111288, + 0.27399816177785397, + 1.2306719310581684, + 0.22762168757617474, + 1.266912892460823, + 1.6052287127822638, + 1.5648141764104366 + ], + "unique_experts": 64, + "load_cv": 0.42779805616357197, + "normalized_load_entropy": 0.9778735976357515, + "max_load_share": 0.03333333333333333 + }, + "full_input": { + "tokens": 171, + "top_k": 6, + "decisions": 1026, + "ordered_route_sha256": "bc48586a8031493a4b94c68ecf2d82d97fe07aa8f121575d619060a638b77458", + "route_weight_sha256": "2c6c9b0596b37a4bb154b0c02aae185444c1ea8e83cc05a3d06c080894804dbd", + "loads": [ + 20, + 15, + 17, + 11, + 19, + 28, + 9, + 26, + 30, + 17, + 20, + 11, + 5, + 14, + 7, + 21, + 6, + 13, + 20, + 18, + 6, + 23, + 12, + 10, + 18, + 17, + 47, + 15, + 10, + 9, + 18, + 15, + 5, + 11, + 14, + 13, + 13, + 18, + 14, + 9, + 21, + 28, + 14, + 21, + 17, + 20, + 6, + 13, + 17, + 9, + 18, + 19, + 12, + 15, + 15, + 12, + 16, + 21, + 11, + 29, + 7, + 20, + 18, + 23 + ], + "weighted_loads": [ + 1.1011466570198536, + 0.5501202587038279, + 1.000403607264161, + 0.5392985492944717, + 1.4478738773614168, + 1.844799168407917, + 0.2959043774753809, + 1.1763303615152836, + 1.5262724608182907, + 1.1340331546962261, + 1.5750684775412083, + 0.4661885630339384, + 0.14161399565637112, + 1.0231360271573067, + 0.2946193665266037, + 1.1995989177376032, + 0.16070875339210033, + 0.4651146959513426, + 0.9044502452015877, + 1.3441913351416588, + 0.3229465875774622, + 1.7086392994970083, + 0.575701866298914, + 0.6267650276422501, + 0.9078490361571312, + 0.7004268411546946, + 2.1552548576146364, + 0.7470705192536116, + 0.3117377106100321, + 0.5990461744368076, + 0.6213480345904827, + 1.4867543652653694, + 0.1800070758908987, + 0.4969409927725792, + 0.6287226472049952, + 0.7319086920469999, + 0.6897400859743357, + 0.8150633256882429, + 1.0971675273030996, + 0.6775902919471264, + 1.2021460682153702, + 1.2041348293423653, + 0.937850708141923, + 1.2101852744817734, + 0.6741854660212994, + 1.660559020936489, + 0.30632374435663223, + 0.5829064529389143, + 1.0499467980116606, + 0.4466394707560539, + 0.9470972120761871, + 1.757983349263668, + 1.0092328488826752, + 0.7382804658263922, + 0.8680685143917799, + 0.7988169696182013, + 0.6054928712546825, + 0.9743977095931768, + 0.3491778951138258, + 1.9620128236711025, + 0.34335487335920334, + 1.5766414813697338, + 1.6575448792427778, + 2.057363498955965 + ], + "unique_experts": 64, + "load_cv": 0.4421772823476927, + "normalized_load_entropy": 0.9779629030345881, + "max_load_share": 0.04580896686159844 + } + }, + "s0_period": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "31d20924716250e36ae46e2f65fade8bbb69802ca4722c3072f7a01368c2a1ed", + "route_weight_sha256": "c15c4e872a50141678ee972575b14bc1ed3d74c9a4e92d10553a54c40d247397", + "loads": [ + 19, + 16, + 13, + 10, + 12, + 26, + 9, + 18, + 18, + 16, + 15, + 8, + 7, + 13, + 9, + 7, + 6, + 11, + 20, + 17, + 3, + 20, + 10, + 9, + 17, + 12, + 21, + 14, + 9, + 7, + 15, + 7, + 5, + 8, + 14, + 14, + 12, + 16, + 13, + 4, + 20, + 12, + 11, + 21, + 13, + 9, + 4, + 9, + 12, + 6, + 9, + 15, + 7, + 13, + 11, + 8, + 7, + 9, + 10, + 17, + 5, + 15, + 17, + 20 + ], + "weighted_loads": [ + 1.0803217105567455, + 0.5818276256322861, + 0.8644535206258297, + 0.49327651783823967, + 1.0254486128687859, + 1.653459994122386, + 0.28852203860878944, + 0.8193540573120117, + 0.5696900933980942, + 1.1551829688251019, + 1.1984317414462566, + 0.251349750906229, + 0.19919426925480366, + 0.9901480339467525, + 0.3941156193614006, + 0.3487695213407278, + 0.1585571300238371, + 0.3743939511477947, + 0.9599629826843739, + 1.2947502806782722, + 0.12440801225602627, + 1.4247340876609087, + 0.3496824651956558, + 0.6301066912710667, + 0.8872741535305977, + 0.4884273987263441, + 0.631513986736536, + 0.7265303377062082, + 0.2788336332887411, + 0.4400933161377907, + 0.41990302316844463, + 0.741107638925314, + 0.1721195299178362, + 0.34033458679914474, + 0.6048199832439423, + 0.781940558925271, + 0.43496808782219887, + 0.8195128943771124, + 1.0627114232629538, + 0.29644399136304855, + 1.3048493526875973, + 0.4336515571922064, + 0.7556426823139191, + 1.1927971448749304, + 0.4360408913344145, + 0.8580714389681816, + 0.19500047340989113, + 0.43934677354991436, + 0.8231346253305674, + 0.35581746883690357, + 0.48729919642210007, + 1.4049667567014694, + 0.7040334492921829, + 0.6685754451900721, + 0.7946369871497154, + 0.2888789754360914, + 0.24780516140162945, + 0.2778104729950428, + 0.3555873855948448, + 1.1891270503401756, + 0.223793251439929, + 1.2718266043812037, + 1.6330197658389807, + 1.634904133155942 + ], + "unique_experts": 64, + "load_cv": 0.40996784723432084, + "normalized_load_entropy": 0.9794004809734994, + "max_load_share": 0.03333333333333333 + }, + "full_input": { + "tokens": 155, + "top_k": 6, + "decisions": 930, + "ordered_route_sha256": "800bda450b10605894895957774c8660844b1aabf694ab774aa1e5472ffcc2f9", + "route_weight_sha256": "850794e059f0bc5ca7192b839238e27df0b042527b3ef78e1f42f365f1cd3b0e", + "loads": [ + 19, + 16, + 15, + 10, + 17, + 26, + 10, + 20, + 33, + 17, + 17, + 10, + 8, + 13, + 10, + 16, + 6, + 12, + 20, + 17, + 5, + 20, + 11, + 9, + 17, + 16, + 34, + 14, + 9, + 7, + 16, + 12, + 7, + 11, + 14, + 16, + 12, + 16, + 13, + 7, + 21, + 22, + 11, + 26, + 13, + 19, + 5, + 9, + 13, + 7, + 13, + 16, + 11, + 13, + 13, + 12, + 10, + 16, + 10, + 29, + 6, + 19, + 18, + 20 + ], + "weighted_loads": [ + 1.0803217105567455, + 0.5818276256322861, + 0.9499300494790077, + 0.49327651783823967, + 1.3008359652012587, + 1.653459994122386, + 0.35018032416701317, + 1.0709246769547462, + 1.3666148148477077, + 1.180839927867055, + 1.4485952444374561, + 0.4121023342013359, + 0.24722800217568874, + 0.9901480339467525, + 0.4168191161006689, + 0.9660857412964106, + 0.1585571300238371, + 0.44610702618956566, + 0.9599629826843739, + 1.2947502806782722, + 0.3597558792680502, + 1.4247340876609087, + 0.37975037284195423, + 0.6301066912710667, + 0.8872741535305977, + 0.6669213008135557, + 1.4410179667174816, + 0.7265303377062082, + 0.2788336332887411, + 0.4400933161377907, + 0.4975349586457014, + 1.2606830708682537, + 0.26273720525205135, + 0.57882284745574, + 0.6048199832439423, + 0.8212567511945963, + 0.43496808782219887, + 0.8195128943771124, + 1.0627114232629538, + 0.5444364249706268, + 1.3456242829561234, + 0.8458743561059237, + 0.7556426823139191, + 1.327552793547511, + 0.4360408913344145, + 1.6762803047895432, + 0.26787957921624184, + 0.43934677354991436, + 0.8442335836589336, + 0.37795977108180523, + 0.6460914891213179, + 1.457805447280407, + 0.9652889780700207, + 0.6685754451900721, + 0.8395513761788607, + 0.8343033846467733, + 0.44041249714791775, + 0.7227612808346748, + 0.3555873855948448, + 1.9201192259788513, + 0.31461794488132, + 1.4875155854970217, + 1.6830692570656538, + 1.634904133155942 + ], + "unique_experts": 64, + "load_cv": 0.4243866848437079, + "normalized_load_entropy": 0.9794536854999804, + "max_load_share": 0.03655913978494624 + } + }, + "s1_period": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "1d76e2b73c65b42af0749d194ca9b735783e04093673c69d0ad6d5e543f2aebc", + "route_weight_sha256": "2f8fe2fdcdbf4aa1fc0d1e7a756fbedbbae137a6a23eb129b0380584052956f0", + "loads": [ + 18, + 15, + 14, + 10, + 12, + 26, + 8, + 23, + 8, + 16, + 15, + 10, + 5, + 13, + 6, + 8, + 6, + 7, + 19, + 17, + 4, + 21, + 9, + 9, + 16, + 12, + 27, + 14, + 10, + 7, + 13, + 8, + 3, + 8, + 14, + 13, + 12, + 17, + 14, + 4, + 20, + 16, + 11, + 14, + 17, + 9, + 4, + 11, + 15, + 8, + 9, + 15, + 7, + 16, + 11, + 8, + 7, + 8, + 9, + 18, + 5, + 15, + 17, + 19 + ], + "weighted_loads": [ + 0.9948706142604351, + 0.5516286231577396, + 0.8412636108696461, + 0.5131725072860718, + 1.050248570740223, + 1.7013804577291012, + 0.25097792223095894, + 0.9394234139472246, + 0.2741516176611185, + 1.1081917323172092, + 1.1329035609960556, + 0.3175545707345009, + 0.14199648052453995, + 0.9848747849464417, + 0.274320425465703, + 0.3860130086541176, + 0.160740178078413, + 0.23359229415655136, + 0.8682955950498581, + 1.2800018824636936, + 0.14785590395331383, + 1.5033907741308212, + 0.3323183488100767, + 0.5989876016974449, + 0.8356460426002741, + 0.49100145511329174, + 0.8167530167847872, + 0.7050031069666147, + 0.31037116050720215, + 0.43436224944889545, + 0.3788122236728668, + 0.7613744717091322, + 0.10255157016217709, + 0.3093932271003723, + 0.6297226641327143, + 0.738532368093729, + 0.4303488563746214, + 0.7879421804100275, + 1.0970799550414085, + 0.29486140608787537, + 1.165324792265892, + 0.5910514388233423, + 0.7319106422364712, + 0.9936268236488104, + 0.544221917167306, + 0.8558714836835861, + 0.19764164462685585, + 0.512454254552722, + 0.8949938379228115, + 0.42207454331219196, + 0.5028252601623535, + 1.3877958953380585, + 0.7101552337408066, + 0.7607386782765388, + 0.7791909463703632, + 0.2903367653489113, + 0.24637377075850964, + 0.25609813816845417, + 0.2763403095304966, + 1.2298462875187397, + 0.22710111178457737, + 1.269044479355216, + 1.6045610792934895, + 1.573199026286602 + ], + "unique_experts": 64, + "load_cv": 0.4372828661889909, + "normalized_load_entropy": 0.9769115966045735, + "max_load_share": 0.03461538461538462 + }, + "full_input": { + "tokens": 171, + "top_k": 6, + "decisions": 1026, + "ordered_route_sha256": "5d3b742cdd650af66301209396ffddc0e4ed2d80e5a9356eb97366cb12b450e9", + "route_weight_sha256": "d965e8e54fb108102cdee552ae9b7f57b19cd6c7c54a977726a45835e8add498", + "loads": [ + 20, + 15, + 17, + 10, + 20, + 28, + 9, + 26, + 28, + 16, + 20, + 13, + 5, + 14, + 7, + 20, + 6, + 13, + 20, + 18, + 6, + 23, + 13, + 10, + 18, + 17, + 48, + 15, + 10, + 9, + 16, + 15, + 4, + 11, + 14, + 14, + 14, + 18, + 14, + 9, + 21, + 29, + 14, + 20, + 18, + 19, + 5, + 14, + 17, + 9, + 18, + 20, + 13, + 16, + 15, + 12, + 16, + 20, + 11, + 28, + 7, + 20, + 18, + 23 + ], + "weighted_loads": [ + 1.100104134529829, + 0.5516286231577396, + 0.9906017072498798, + 0.5131725072860718, + 1.5605017710477114, + 1.838415913283825, + 0.2963735833764076, + 1.1551206968724728, + 1.4539350811392069, + 1.1081917323172092, + 1.5686981901526451, + 0.6312083937227726, + 0.14199648052453995, + 1.0248765423893929, + 0.29627763479948044, + 1.089326798915863, + 0.160740178078413, + 0.46237375028431416, + 0.9072529040277004, + 1.346029605716467, + 0.32271454855799675, + 1.7077673748135567, + 0.6029852069914341, + 0.6331962421536446, + 0.9074255414307117, + 0.698051517829299, + 2.1657710410654545, + 0.7472344879060984, + 0.31037116050720215, + 0.5963179524987936, + 0.5668091680854559, + 1.4871758352965117, + 0.1519945878535509, + 0.4929952919483185, + 0.6297226641327143, + 0.7570856846868992, + 0.7132122665643692, + 0.8214767556637526, + 1.0970799550414085, + 0.6577562876045704, + 1.2024840414524078, + 1.2001218274235725, + 0.9392950180917978, + 1.191583763808012, + 0.6961363051086664, + 1.6232557818293571, + 0.2729884944856167, + 0.6133250258862972, + 1.0462992377579212, + 0.444421861320734, + 0.9504935722798109, + 1.7953957431018353, + 1.04158834554255, + 0.7607386782765388, + 0.8725743051618338, + 0.7994109243154526, + 0.6081162709742785, + 0.9523363243788481, + 0.35152004286646843, + 1.866931576281786, + 0.342834297567606, + 1.5742479134351015, + 1.6565739251673222, + 2.0657483488321304 + ], + "unique_experts": 64, + "load_cv": 0.4420397653556687, + "normalized_load_entropy": 0.9778598990283144, + "max_load_share": 0.04678362573099415 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 130, + "ordered_topk_exact_tokens": 92, + "set_exact_tokens": 102, + "mean_set_jaccard": 0.9305860805860805, + "mean_token_weighted_tv": 0.008720765420450614, + "aggregate_load_tv": 0.03461538461538462 + }, + "system_bos": { + "tokens": 130, + "ordered_topk_exact_tokens": 75, + "set_exact_tokens": 88, + "mean_set_jaccard": 0.8978021978021978, + "mean_token_weighted_tv": 0.015452896674665121, + "aggregate_load_tv": 0.04871794871794872 + }, + "system_x": { + "tokens": 130, + "ordered_topk_exact_tokens": 74, + "set_exact_tokens": 89, + "mean_set_jaccard": 0.9003663003663004, + "mean_token_weighted_tv": 0.015910904152462116, + "aggregate_load_tv": 0.044871794871794865 + }, + "system_period": { + "tokens": 130, + "ordered_topk_exact_tokens": 68, + "set_exact_tokens": 84, + "mean_set_jaccard": 0.8840659340659339, + "mean_token_weighted_tv": 0.017145521852832576, + "aggregate_load_tv": 0.05128205128205128 + }, + "bos_at_s0": { + "tokens": 130, + "ordered_topk_exact_tokens": 44, + "set_exact_tokens": 62, + "mean_set_jaccard": 0.8282051282051284, + "mean_token_weighted_tv": 0.026514517816786584, + "aggregate_load_tv": 0.06538461538461537 + }, + "bos_at_s1": { + "tokens": 130, + "ordered_topk_exact_tokens": 55, + "set_exact_tokens": 75, + "mean_set_jaccard": 0.8538461538461538, + "mean_token_weighted_tv": 0.02324458291897407, + "aggregate_load_tv": 0.05512820512820514 + }, + "x_at_s0": { + "tokens": 130, + "ordered_topk_exact_tokens": 55, + "set_exact_tokens": 69, + "mean_set_jaccard": 0.8432234432234432, + "mean_token_weighted_tv": 0.022735234923087634, + "aggregate_load_tv": 0.05769230769230769 + }, + "x_at_s1": { + "tokens": 130, + "ordered_topk_exact_tokens": 57, + "set_exact_tokens": 74, + "mean_set_jaccard": 0.8595238095238096, + "mean_token_weighted_tv": 0.02243449567602231, + "aggregate_load_tv": 0.05512820512820513 + }, + "period_at_s0": { + "tokens": 130, + "ordered_topk_exact_tokens": 56, + "set_exact_tokens": 70, + "mean_set_jaccard": 0.8424908424908427, + "mean_token_weighted_tv": 0.02270699503043523, + "aggregate_load_tv": 0.05512820512820512 + }, + "period_at_s1": { + "tokens": 130, + "ordered_topk_exact_tokens": 53, + "set_exact_tokens": 72, + "mean_set_jaccard": 0.8518315018315018, + "mean_token_weighted_tv": 0.023078229564886827, + "aggregate_load_tv": 0.06153846153846154 + } + } + }, + "layer_02": { + "layer": 2, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "20c59f4356ccd9f8a47148b56548fbb0a10ad188f0659b8b84f9c225165b7b30", + "route_weight_sha256": "1df73d76dbf2773a39ebcef77774e54679896ed30085e1c817ace85e42deefb5", + "loads": [ + 15, + 17, + 10, + 13, + 9, + 24, + 7, + 15, + 12, + 12, + 16, + 9, + 9, + 16, + 8, + 20, + 20, + 21, + 13, + 7, + 15, + 3, + 7, + 14, + 22, + 18, + 19, + 13, + 13, + 9, + 7, + 9, + 15, + 20, + 12, + 4, + 17, + 8, + 6, + 9, + 12, + 7, + 7, + 8, + 16, + 23, + 16, + 11, + 12, + 15, + 8, + 3, + 15, + 10, + 9, + 18, + 17, + 7, + 16, + 10, + 7, + 12, + 4, + 4 + ], + "weighted_loads": [ + 1.3429904580116272, + 0.981584956869483, + 0.3349877391010523, + 0.7265714332461357, + 0.31518709659576416, + 1.6326937265694141, + 0.2363432850688696, + 1.0961916502565145, + 0.7702421508729458, + 0.9282004293054342, + 0.5728889144957066, + 0.343904796987772, + 0.6256456822156906, + 0.5217700488865376, + 0.2545559536665678, + 1.6796111948788166, + 1.0483892802149057, + 2.050999227911234, + 0.7270152363926172, + 0.5107254423201084, + 1.7023906353861094, + 0.28761994279921055, + 0.7286198493093252, + 0.5387905705720186, + 1.34597840718925, + 1.4774924367666245, + 1.34382776170969, + 0.7540278881788254, + 0.39200118742883205, + 0.4247595127671957, + 0.3749198503792286, + 0.43015595339238644, + 1.115967072546482, + 1.7633409798145294, + 1.1089855656027794, + 0.2732890360057354, + 1.7068010345101357, + 0.9104526117444038, + 0.6302777752280235, + 0.6914756596088409, + 0.5449983607977629, + 0.2337188832461834, + 0.681709099560976, + 0.37327422201633453, + 1.662465114146471, + 1.7758756633847952, + 1.0568135417997837, + 0.5164613332599401, + 0.8880883976817131, + 0.6283469144254923, + 0.3570621479302645, + 0.12684594094753265, + 1.2675092704594135, + 0.8044569790363312, + 0.47521746531128883, + 1.1424306388944387, + 1.6356749162077904, + 0.5821957979351282, + 1.6673158779740334, + 0.6962214279919863, + 0.30888610891997814, + 1.1925398223102093, + 0.15633469633758068, + 0.22666210681200027 + ], + "unique_experts": 64, + "load_cv": 0.4233487860013419, + "normalized_load_entropy": 0.9776868943440455, + "max_load_share": 0.03076923076923077 + }, + "full_input": { + "tokens": 155, + "top_k": 6, + "decisions": 930, + "ordered_route_sha256": "4aae3066a12942f3806c7aef931ac801be0237909e6ad5d87eac7ee3053bca90", + "route_weight_sha256": "790025a31982b5d32a52fe80acd3f4073f2cf8c0827744d9690869cf62a8c492", + "loads": [ + 15, + 27, + 11, + 15, + 9, + 24, + 8, + 17, + 15, + 12, + 19, + 9, + 9, + 18, + 15, + 20, + 20, + 22, + 14, + 11, + 17, + 12, + 7, + 14, + 25, + 18, + 20, + 15, + 15, + 9, + 7, + 10, + 15, + 20, + 17, + 20, + 17, + 8, + 9, + 9, + 12, + 7, + 14, + 8, + 16, + 23, + 18, + 15, + 13, + 15, + 8, + 9, + 15, + 11, + 9, + 18, + 17, + 15, + 24, + 12, + 19, + 14, + 9, + 15 + ], + "weighted_loads": [ + 1.3429904580116272, + 1.9293855596333742, + 0.36137006245553493, + 2.428104393184185, + 0.31518709659576416, + 1.6326937265694141, + 0.26985570974648, + 1.1855476442724466, + 0.9520318731665611, + 0.9282004293054342, + 0.69886839017272, + 0.343904796987772, + 0.6256456822156906, + 0.5709786415100098, + 0.5460548344999552, + 1.6796111948788166, + 1.0483892802149057, + 2.051699446514249, + 0.7286086551612243, + 1.24015187099576, + 2.015044027939439, + 0.9832628685981035, + 0.7286198493093252, + 0.5387905705720186, + 1.4889916982501745, + 1.4774924367666245, + 1.3446771333692595, + 1.0042221248149872, + 0.5994582008570433, + 0.4247595127671957, + 0.3749198503792286, + 0.4308558011543937, + 1.115967072546482, + 1.7633409798145294, + 1.3331786766648293, + 2.4029506240040064, + 1.7068010345101357, + 0.9104526117444038, + 0.7257084716111422, + 0.6914756596088409, + 0.5449983607977629, + 0.2337188832461834, + 1.4056225083768368, + 0.37327422201633453, + 1.662465114146471, + 1.7758756633847952, + 1.1238346584141254, + 0.7640577349811792, + 0.9134935326874256, + 0.6283469144254923, + 0.3570621479302645, + 0.7835772335529327, + 1.2675092704594135, + 0.8057750186417252, + 0.47521746531128883, + 1.1424306388944387, + 1.6356749162077904, + 1.0175590086728334, + 2.0306930132210255, + 0.7816749978810549, + 1.2383599746972322, + 1.2793195992708206, + 0.5568281840533018, + 0.867028497159481 + ], + "unique_experts": 64, + "load_cv": 0.33844160752178637, + "normalized_load_entropy": 0.9862162788476917, + "max_load_share": 0.02903225806451613 + } + }, + "s1_eos": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "7694b9b99cf85d48de41bd8654419587f5a583292a2bde405e229b13b627af68", + "route_weight_sha256": "7e8a0200146b4b7e0de40f6051a5c3c06235f3b917b5cebbeeec988e785e1dd1", + "loads": [ + 16, + 17, + 11, + 14, + 11, + 24, + 7, + 15, + 12, + 11, + 14, + 9, + 10, + 14, + 5, + 20, + 20, + 21, + 13, + 7, + 15, + 3, + 7, + 14, + 22, + 18, + 19, + 13, + 12, + 10, + 7, + 8, + 15, + 21, + 11, + 4, + 17, + 9, + 6, + 9, + 14, + 9, + 7, + 8, + 16, + 23, + 16, + 10, + 13, + 13, + 6, + 3, + 16, + 10, + 9, + 18, + 17, + 7, + 16, + 10, + 7, + 13, + 4, + 4 + ], + "weighted_loads": [ + 1.387859020382166, + 0.9804265294224024, + 0.36855372600257397, + 0.7696860656142235, + 0.380757637321949, + 1.6556420382112265, + 0.23401913233101368, + 1.0932118315249681, + 0.7830337099730968, + 0.9140138663351536, + 0.5241812784224749, + 0.34889700450003147, + 0.6648909263312817, + 0.4601132292300463, + 0.17385711148381233, + 1.6814877651631832, + 1.0619047861546278, + 2.0926073528826237, + 0.7211255915462971, + 0.49809933453798294, + 1.71858611702919, + 0.287651838734746, + 0.7350238300859928, + 0.5390541777014732, + 1.331771157681942, + 1.483265932649374, + 1.350501388311386, + 0.7494066562503576, + 0.3705194778740406, + 0.45753405429422855, + 0.3804772887378931, + 0.4070913214236498, + 1.1116343513131142, + 1.7718219831585884, + 1.0878022015094757, + 0.26933277025818825, + 1.7081344798207283, + 0.9162101577967405, + 0.620258741080761, + 0.6814794838428497, + 0.6144193075597286, + 0.3052422273904085, + 0.676537286490202, + 0.3809799272567034, + 1.6673991288989782, + 1.7812801916152239, + 1.0656918548047543, + 0.47356149926781654, + 0.9200483709573746, + 0.5677663013339043, + 0.3033208530396223, + 0.1364678032696247, + 1.280865851789713, + 0.803814310580492, + 0.4715819042176008, + 1.1583132836967707, + 1.6147636696696281, + 0.5574563499540091, + 1.671937558799982, + 0.7024338357150555, + 0.30845168977975845, + 1.2233917657285929, + 0.1495070829987526, + 0.23305834084749222 + ], + "unique_experts": 64, + "load_cv": 0.4268133377092946, + "normalized_load_entropy": 0.977208581218865, + "max_load_share": 0.03076923076923077 + }, + "full_input": { + "tokens": 171, + "top_k": 6, + "decisions": 1026, + "ordered_route_sha256": "8a57a5ba44745533cfe78d8bcbbd0ccf3e206f275c763596af57c5d3d79d7a12", + "route_weight_sha256": "4a4832926a89c3f9050c08bf9b817843136519419cc2ae23a016916d3a1c6e2b", + "loads": [ + 20, + 28, + 13, + 17, + 12, + 25, + 8, + 19, + 21, + 12, + 21, + 9, + 10, + 17, + 16, + 21, + 22, + 22, + 14, + 13, + 17, + 13, + 8, + 14, + 29, + 19, + 20, + 16, + 16, + 10, + 8, + 10, + 15, + 21, + 20, + 22, + 18, + 10, + 11, + 12, + 14, + 9, + 17, + 9, + 19, + 23, + 22, + 17, + 15, + 14, + 8, + 11, + 17, + 14, + 9, + 18, + 21, + 15, + 18, + 19, + 18, + 18, + 14, + 18 + ], + "weighted_loads": [ + 1.9064702838659286, + 1.9864455070346594, + 0.4205850940197706, + 2.5060540847480297, + 0.410976042971015, + 1.7977942284196615, + 0.2676942739635706, + 1.2458474356681108, + 1.5082220770418644, + 1.0304488055408, + 0.8298906031996012, + 0.34889700450003147, + 0.6648909263312817, + 0.51243076112587, + 0.7187813799828291, + 1.7142163924872875, + 1.1255834642797709, + 2.093190001323819, + 0.7225007672095671, + 1.2632488831877708, + 2.0074737817049026, + 1.0587868969887495, + 0.7735028155148029, + 0.5390541777014732, + 1.6370008811354637, + 1.5336481221020222, + 1.3513196750427596, + 1.4027972724288702, + 0.5912899132817984, + 0.45753405429422855, + 0.4142326321452856, + 0.44969032891094685, + 1.1116343513131142, + 1.7718219831585884, + 1.4546706322580576, + 2.184242380782962, + 1.7375964689999819, + 0.958283444866538, + 0.7770255552604795, + 1.0340210944414139, + 0.6144193075597286, + 0.3052422273904085, + 1.8468499034643173, + 0.5627366323024035, + 2.3160159196704626, + 1.7812801916152239, + 1.6393731981515884, + 0.8406019769608974, + 0.9890186879783869, + 0.6105407662689686, + 0.34977650083601475, + 1.0501080565154552, + 1.457247767597437, + 0.9884142735973, + 0.4715819042176008, + 1.1583132836967707, + 1.8680472634732723, + 0.9250060860067606, + 1.7830177992582321, + 1.0848114378750324, + 1.05376903899014, + 1.586973974481225, + 0.9970180783420801, + 1.2819272391498089 + ], + "unique_experts": 64, + "load_cv": 0.3093402040222561, + "normalized_load_entropy": 0.9883207086333026, + "max_load_share": 0.028265107212475632 + } + }, + "s0_bos": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "946cf8fb1b35bc7166eed2e3b3f949aa2a8744215b608cd098bc2ec1bf7bfca9", + "route_weight_sha256": "2cfb81c8a40c9d3d864225ef4e85dc65734f49fb81ca650b12e681e801e73a86", + "loads": [ + 15, + 14, + 10, + 15, + 13, + 23, + 8, + 15, + 12, + 11, + 12, + 8, + 10, + 12, + 4, + 21, + 22, + 21, + 15, + 7, + 14, + 2, + 7, + 12, + 23, + 18, + 19, + 12, + 19, + 9, + 8, + 11, + 15, + 21, + 11, + 4, + 17, + 8, + 5, + 9, + 16, + 10, + 7, + 6, + 15, + 24, + 16, + 8, + 12, + 15, + 7, + 3, + 16, + 10, + 9, + 18, + 18, + 7, + 16, + 10, + 6, + 12, + 4, + 3 + ], + "weighted_loads": [ + 1.3795303478837013, + 0.8886388260871172, + 0.3489685319364071, + 0.858750844374299, + 0.4497372843325138, + 1.6118801534175873, + 0.257982462644577, + 1.0743532869964838, + 0.7537179589271545, + 0.8833119869232178, + 0.4491137880831957, + 0.3077436611056328, + 0.651963260024786, + 0.40555643290281296, + 0.12721985206007957, + 1.7619244400411844, + 1.1755157765001059, + 2.0738703310489655, + 0.8014835212379694, + 0.4504391960799694, + 1.7099584192037582, + 0.263740636408329, + 0.708513256162405, + 0.45464085787534714, + 1.3497807923704386, + 1.5304950773715973, + 1.3721397165209055, + 0.7120311111211777, + 0.6032490655779839, + 0.425201240926981, + 0.40730768628418446, + 0.5029585845768452, + 1.1410714015364647, + 1.7329365015029907, + 1.0574148371815681, + 0.2628055289387703, + 1.699330672621727, + 0.91001370921731, + 0.6074888333678246, + 0.7098676301538944, + 0.725634541362524, + 0.3337059058248997, + 0.7146535143256187, + 0.3138458803296089, + 1.6081333421170712, + 1.8400574773550034, + 1.0226792432367802, + 0.40851193107664585, + 0.9469388425350189, + 0.6483131945133209, + 0.3558858670294285, + 0.13091273605823517, + 1.3059199284762144, + 0.8182465881109238, + 0.49848100915551186, + 1.1892177611589432, + 1.719634497538209, + 0.5045315437018871, + 1.6341483611613512, + 0.7204157132655382, + 0.2709112074226141, + 1.2022521626204252, + 0.21707827225327492, + 0.18080713972449303 + ], + "unique_experts": 64, + "load_cv": 0.44985204668349066, + "normalized_load_entropy": 0.9744386986929473, + "max_load_share": 0.03076923076923077 + }, + "full_input": { + "tokens": 155, + "top_k": 6, + "decisions": 930, + "ordered_route_sha256": "246ed6d356037b513e1e4963071a343916e6074f68b6dd57a7981bea533e099e", + "route_weight_sha256": "f230b7fc812e00f92d668045b349952cc0edef69a4b31b33b2bd56775379a133", + "loads": [ + 15, + 24, + 10, + 16, + 13, + 23, + 9, + 17, + 15, + 11, + 15, + 8, + 11, + 13, + 9, + 21, + 23, + 21, + 15, + 11, + 16, + 11, + 7, + 12, + 25, + 18, + 19, + 14, + 21, + 9, + 8, + 11, + 15, + 21, + 16, + 21, + 17, + 8, + 9, + 9, + 16, + 10, + 15, + 6, + 15, + 24, + 18, + 12, + 13, + 15, + 9, + 8, + 16, + 10, + 9, + 18, + 18, + 17, + 24, + 13, + 18, + 14, + 10, + 15 + ], + "weighted_loads": [ + 1.3795303478837013, + 1.8364394288510084, + 0.3489685319364071, + 1.5875761155039072, + 0.4497372843325138, + 1.6118801534175873, + 0.289274413138628, + 1.1620636340230703, + 0.943272840231657, + 0.8833119869232178, + 0.5750932637602091, + 0.3077436611056328, + 0.6840295642614365, + 0.4308037180453539, + 0.3243808392435312, + 1.7619244400411844, + 1.2053826469928026, + 2.0738703310489655, + 0.8014835212379694, + 1.1426461301743984, + 2.00080806016922, + 0.9700877219438553, + 0.708513256162405, + 0.45464085787534714, + 1.4509735126048326, + 1.5304950773715973, + 1.3721397165209055, + 0.9732310324907303, + 0.8609779700636864, + 0.425201240926981, + 0.40730768628418446, + 0.5029585845768452, + 1.1410714015364647, + 1.7329365015029907, + 1.281607948243618, + 2.4370100889354944, + 1.699330672621727, + 0.91001370921731, + 0.7925075460225344, + 0.7098676301538944, + 0.725634541362524, + 0.3337059058248997, + 1.484838169068098, + 0.3138458803296089, + 1.6081333421170712, + 1.8400574773550034, + 1.089700359851122, + 0.6558915767818689, + 0.9723439775407314, + 0.6483131945133209, + 0.40437117777764797, + 0.7689999639987946, + 1.3059199284762144, + 0.8182465881109238, + 0.49848100915551186, + 1.1892177611589432, + 1.719634497538209, + 0.9821697697043419, + 1.9975254964083433, + 0.8351821955293417, + 1.210942491889, + 1.2890319395810366, + 0.7086411118507385, + 1.0925699807703495 + ], + "unique_experts": 64, + "load_cv": 0.33580767389831917, + "normalized_load_entropy": 0.9864417436674696, + "max_load_share": 0.026881720430107527 + } + }, + "s1_bos": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "ee73b3d53f07d2bd3dddbba54505d0a9428bfdc160d256c23da916db8eb4a13a", + "route_weight_sha256": "7c8a3536c450400d956ef6a4c0e51dcd283b3935cae39a43e4eefd4ccd52e899", + "loads": [ + 15, + 15, + 11, + 15, + 11, + 23, + 9, + 15, + 12, + 11, + 14, + 7, + 10, + 9, + 1, + 21, + 24, + 21, + 15, + 6, + 14, + 4, + 7, + 11, + 23, + 22, + 19, + 12, + 17, + 10, + 7, + 11, + 15, + 21, + 11, + 4, + 17, + 8, + 6, + 9, + 17, + 11, + 7, + 6, + 15, + 24, + 16, + 5, + 11, + 13, + 8, + 3, + 15, + 10, + 12, + 19, + 19, + 7, + 16, + 9, + 6, + 11, + 4, + 3 + ], + "weighted_loads": [ + 1.382973987609148, + 0.9377816505730152, + 0.3872066345065832, + 0.870183726772666, + 0.3810444436967373, + 1.6549503318965435, + 0.2755852900445461, + 1.0908459145575762, + 0.7768205590546131, + 0.902036938816309, + 0.5220055114477873, + 0.28761980310082436, + 0.6800180487334728, + 0.3142803721129894, + 0.0336347334086895, + 1.8399296458810568, + 1.2316935118287802, + 2.0794198885560036, + 0.8152609765529633, + 0.40375443175435066, + 1.7509745322167873, + 0.3252146355807781, + 0.7459658049046993, + 0.411694535985589, + 1.3454717639833689, + 1.6618346739560366, + 1.3651775494217873, + 0.6807469949126244, + 0.554993623867631, + 0.47213517874479294, + 0.38755003549158573, + 0.5383280012756586, + 1.1114151161164045, + 1.7991492487490177, + 1.0484108924865723, + 0.2607252448797226, + 1.700357772409916, + 0.8994524087756872, + 0.6197935845702887, + 0.6707080639898777, + 0.7684209141880274, + 0.3717992939054966, + 0.6738359481096268, + 0.32269033044576645, + 1.617898277938366, + 1.846760081127286, + 1.044026106595993, + 0.3005561791360378, + 0.920107364654541, + 0.5798332635313272, + 0.3755436707288027, + 0.11824516393244267, + 1.2464556843042374, + 0.8076897636055946, + 0.6128345802426338, + 1.2802951782941818, + 1.7276272140443325, + 0.4872901439666748, + 1.64894531480968, + 0.6899016983807087, + 0.26218464598059654, + 1.198509231209755, + 0.20014694705605507, + 0.18013913184404373 + ], + "unique_experts": 64, + "load_cv": 0.46863490259088064, + "normalized_load_entropy": 0.9721939405410619, + "max_load_share": 0.03076923076923077 + }, + "full_input": { + "tokens": 171, + "top_k": 6, + "decisions": 1026, + "ordered_route_sha256": "a36a9a5879d1df31775dce068ceb5adaf759ed7047fce33e736fe380b02b4f8d", + "route_weight_sha256": "5309b1f6341b003a1becd8f1093935dd8bd522cef429384db3c819819c854f21", + "loads": [ + 19, + 26, + 14, + 18, + 12, + 24, + 9, + 19, + 21, + 12, + 21, + 7, + 11, + 11, + 10, + 22, + 27, + 21, + 15, + 12, + 17, + 14, + 8, + 11, + 29, + 23, + 19, + 16, + 21, + 10, + 8, + 13, + 15, + 21, + 20, + 23, + 17, + 9, + 12, + 12, + 17, + 11, + 18, + 7, + 18, + 24, + 23, + 12, + 13, + 14, + 11, + 11, + 16, + 13, + 12, + 19, + 23, + 13, + 18, + 18, + 17, + 16, + 15, + 18 + ], + "weighted_loads": [ + 1.9015852510929108, + 1.9438006281852722, + 0.46062191389501095, + 1.6631697956472635, + 0.41126284934580326, + 1.7971025221049786, + 0.2755852900445461, + 1.2424839455634356, + 1.5146801471710205, + 1.0184718780219555, + 0.8277148362249136, + 0.28761980310082436, + 0.7075918894261122, + 0.3624521717429161, + 0.49253103882074356, + 1.872658273205161, + 1.3238481264561415, + 2.0794198885560036, + 0.8152609765529633, + 1.1217566169798374, + 2.055878572165966, + 1.1187280751764774, + 0.7844447903335094, + 0.411694535985589, + 1.6170165408402681, + 1.7122168634086847, + 1.3651775494217873, + 1.3819501753896475, + 0.8223594836890697, + 0.47213517874479294, + 0.42130537889897823, + 0.5809270087629557, + 1.1114151161164045, + 1.7991492487490177, + 1.4152793232351542, + 2.2322787065058947, + 1.700357772409916, + 0.9415256958454847, + 0.8864144263789058, + 1.0232496745884418, + 0.7684209141880274, + 0.3717992939054966, + 1.897131446748972, + 0.5044470354914665, + 2.2665150687098503, + 1.846760081127286, + 1.655097957700491, + 0.6680001616477966, + 0.9890776816755533, + 0.6226077284663916, + 0.45319811813533306, + 1.072941267862916, + 1.4228376001119614, + 0.9912127964198589, + 0.6128345802426338, + 1.2802951782941818, + 1.9809108078479767, + 0.7580748349428177, + 1.76002555526793, + 1.0722793005406857, + 1.0104508381336927, + 1.562091439962387, + 1.1377695221453905, + 1.4409895204007626 + ], + "unique_experts": 64, + "load_cv": 0.3241206051983809, + "normalized_load_entropy": 0.987310728403973, + "max_load_share": 0.028265107212475632 + } + }, + "s0_x": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "505aa004a3231e9182387a7f6667018a59999dab9f49427ecc5bc28e99ce6608", + "route_weight_sha256": "45683308d23c72182d809cafee5865050216440b7ee223a6082f6746f6d5a036", + "loads": [ + 15, + 15, + 11, + 15, + 13, + 24, + 8, + 15, + 12, + 11, + 11, + 7, + 9, + 15, + 5, + 21, + 23, + 21, + 15, + 7, + 14, + 3, + 7, + 10, + 23, + 20, + 19, + 12, + 14, + 9, + 7, + 11, + 14, + 20, + 12, + 4, + 17, + 8, + 5, + 10, + 16, + 8, + 7, + 6, + 15, + 24, + 16, + 9, + 11, + 16, + 7, + 4, + 15, + 10, + 10, + 18, + 19, + 7, + 16, + 9, + 6, + 12, + 4, + 3 + ], + "weighted_loads": [ + 1.4023900218307972, + 0.9114144276827574, + 0.3811267875134945, + 0.8540112692862749, + 0.44373758137226105, + 1.6647252459079027, + 0.2492369208484888, + 1.109552338719368, + 0.7773303650319576, + 0.9080039635300636, + 0.4036955386400223, + 0.28245637379586697, + 0.6146861054003239, + 0.5095825083553791, + 0.1602787971496582, + 1.788850387558341, + 1.1604993715882301, + 2.1061480343341827, + 0.7779089789837599, + 0.4596177637577057, + 1.6778653468936682, + 0.285497834905982, + 0.7076173722743988, + 0.39431763626635075, + 1.3400594666600227, + 1.5938989967107773, + 1.3594277258962393, + 0.704968199133873, + 0.4308335594832897, + 0.4162279460579157, + 0.3829629272222519, + 0.5010187402367592, + 1.1194932498037815, + 1.6717035602778196, + 1.0998505987226963, + 0.2729956731200218, + 1.7023329064249992, + 0.9043325111269951, + 0.5651628449559212, + 0.7346536442637444, + 0.6995248533785343, + 0.2663993462920189, + 0.6754099056124687, + 0.3235546760261059, + 1.6057711578905582, + 1.8219084702432156, + 1.0458349660038948, + 0.4270318541675806, + 0.9054575078189373, + 0.682545019313693, + 0.3378022164106369, + 0.15994148701429367, + 1.289579650387168, + 0.8083034474402666, + 0.5227542016655207, + 1.1777901090681553, + 1.7126684058457613, + 0.4947914257645607, + 1.62259741127491, + 0.6855665110051632, + 0.2623699251562357, + 1.2356834188103676, + 0.20094160735607147, + 0.17568973451852798 + ], + "unique_experts": 64, + "load_cv": 0.4505530241973882, + "normalized_load_entropy": 0.9749449830632789, + "max_load_share": 0.03076923076923077 + }, + "full_input": { + "tokens": 155, + "top_k": 6, + "decisions": 930, + "ordered_route_sha256": "0848ba925b2bd788fcf5c64e71eb6b1151290028ebb266ffb6f183bce989a423", + "route_weight_sha256": "80bd839daed93945a968d5c5a6beb44e689d19cc83f36afbaa187e499b19ec24", + "loads": [ + 15, + 25, + 11, + 16, + 13, + 24, + 10, + 17, + 15, + 11, + 16, + 8, + 10, + 16, + 10, + 21, + 24, + 21, + 15, + 11, + 17, + 13, + 7, + 10, + 25, + 20, + 19, + 14, + 16, + 9, + 7, + 11, + 14, + 20, + 17, + 20, + 17, + 8, + 8, + 10, + 16, + 8, + 14, + 6, + 15, + 24, + 18, + 14, + 12, + 16, + 9, + 9, + 15, + 10, + 10, + 18, + 19, + 15, + 25, + 11, + 18, + 14, + 9, + 14 + ], + "weighted_loads": [ + 1.4023900218307972, + 1.8592150304466486, + 0.3811267875134945, + 1.582836540415883, + 0.44373758137226105, + 1.6647252459079027, + 0.3164385911077261, + 1.1971010714769363, + 0.9629285521805286, + 0.9080039635300636, + 0.6381311118602753, + 0.3175856713205576, + 0.6444066446274519, + 0.5351244136691093, + 0.35647384263575077, + 1.788850387558341, + 1.1909901332110167, + 2.1061480343341827, + 0.7779089789837599, + 1.159308061003685, + 2.0079803988337517, + 1.2887506615370512, + 0.7076173722743988, + 0.39431763626635075, + 1.4395521841943264, + 1.5938989967107773, + 1.3594277258962393, + 0.9593351185321808, + 0.6911298744380474, + 0.4162279460579157, + 0.3829629272222519, + 0.5010187402367592, + 1.1194932498037815, + 1.6717035602778196, + 1.3240437097847462, + 2.3834657799452543, + 1.7023329064249992, + 0.9043325111269951, + 0.66061438806355, + 0.7346536442637444, + 0.6995248533785343, + 0.2663993462920189, + 1.3597939349710941, + 0.3235546760261059, + 1.6057711578905582, + 1.8219084702432156, + 1.1128560826182365, + 0.7067865077406168, + 0.9308626428246498, + 0.682545019313693, + 0.3911861479282379, + 0.7539504244923592, + 1.289579650387168, + 0.8083034474402666, + 0.5227542016655207, + 1.1777901090681553, + 1.7126684058457613, + 0.8930337131023407, + 2.1150348000228405, + 0.7710200808942318, + 1.2167556323111057, + 1.322463195770979, + 0.6412758305668831, + 0.7592238895595074 + ], + "unique_experts": 64, + "load_cv": 0.34235451432882746, + "normalized_load_entropy": 0.9859612764653806, + "max_load_share": 0.026881720430107527 + } + }, + "s1_x": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "615981359c8e1bf26aebc50b7e48fc8649f996be3e7830615790905b36ae4be4", + "route_weight_sha256": "11c544f811d121b74090a021f0418b7a79fecfb1582c164f7c1a5bf0b5ab9594", + "loads": [ + 16, + 15, + 10, + 14, + 12, + 23, + 8, + 14, + 12, + 11, + 15, + 8, + 11, + 11, + 1, + 21, + 23, + 21, + 15, + 6, + 14, + 4, + 7, + 8, + 23, + 22, + 19, + 12, + 15, + 10, + 7, + 11, + 15, + 21, + 11, + 5, + 17, + 8, + 6, + 9, + 15, + 11, + 7, + 6, + 15, + 23, + 16, + 6, + 11, + 13, + 8, + 3, + 15, + 10, + 15, + 20, + 18, + 7, + 16, + 9, + 5, + 13, + 4, + 3 + ], + "weighted_loads": [ + 1.446633007377386, + 0.9177517369389534, + 0.3710559904575348, + 0.829339288175106, + 0.40730253979563713, + 1.6978718116879463, + 0.2351822406053543, + 1.059991268441081, + 0.8044911175966263, + 0.9163842312991619, + 0.5464712716639042, + 0.3241201639175415, + 0.7010028697550297, + 0.364876976236701, + 0.034809552133083344, + 1.863458726555109, + 1.16221752949059, + 2.0992844477295876, + 0.8050888944417238, + 0.411269698292017, + 1.756610156968236, + 0.32413136772811413, + 0.7549641653895378, + 0.32945822179317474, + 1.3266234546899796, + 1.6620283797383308, + 1.3679684735834599, + 0.6776765584945679, + 0.47286576218903065, + 0.46427900716662407, + 0.3869924582540989, + 0.5388993639498949, + 1.1013991590589285, + 1.7681255862116814, + 1.0553049482405186, + 0.3012218177318573, + 1.6803745850920677, + 0.8880428057163954, + 0.5921149756759405, + 0.671714048832655, + 0.677642347291112, + 0.370970843359828, + 0.6474063917994499, + 0.32585661113262177, + 1.6339933797717094, + 1.8092179670929909, + 1.0744884461164474, + 0.32793860509991646, + 0.9037246368825436, + 0.571628388017416, + 0.37282201834023, + 0.1304800771176815, + 1.2354675121605396, + 0.8012491427361965, + 0.7086505778133869, + 1.3125634528696537, + 1.6669783685356379, + 0.4828465115278959, + 1.6525117736309767, + 0.6953515950590372, + 0.2301193829625845, + 1.2643522787839174, + 0.19011875987052917, + 0.17246494442224503 + ], + "unique_experts": 64, + "load_cv": 0.46002601189925296, + "normalized_load_entropy": 0.9730674588493592, + "max_load_share": 0.029487179487179487 + }, + "full_input": { + "tokens": 171, + "top_k": 6, + "decisions": 1026, + "ordered_route_sha256": "b69107121013b6419cf104f3c735feebf7ab67ec2ccf8d28d962fa8164a62c5b", + "route_weight_sha256": "f9d1b4fa78b4986400e8b731a468088849475a9cb44301eccdda796d627b4ad7", + "loads": [ + 20, + 26, + 13, + 16, + 13, + 24, + 8, + 18, + 21, + 12, + 24, + 9, + 12, + 14, + 8, + 22, + 26, + 21, + 15, + 12, + 17, + 15, + 8, + 8, + 29, + 23, + 19, + 15, + 19, + 10, + 8, + 13, + 15, + 21, + 20, + 24, + 17, + 9, + 11, + 12, + 15, + 11, + 17, + 7, + 18, + 23, + 23, + 14, + 13, + 14, + 11, + 10, + 16, + 13, + 16, + 20, + 22, + 13, + 19, + 18, + 17, + 18, + 14, + 17 + ], + "weighted_loads": [ + 1.9652442708611488, + 1.9237707145512104, + 0.4454339686781168, + 1.5900621227920055, + 0.4375209454447031, + 1.8400240018963814, + 0.2351822406053543, + 1.2063743863254786, + 1.5433773696422577, + 1.0328191705048084, + 0.9658478386700153, + 0.35910533368587494, + 0.7276479434221983, + 0.4459103848785162, + 0.4356171377003193, + 1.8961873538792133, + 1.2599455136805773, + 2.0992844477295876, + 0.8050888944417238, + 1.1334620751440525, + 2.0623831674456596, + 1.3997719567269087, + 0.7934431508183479, + 0.32945822179317474, + 1.5965637974441051, + 1.712410569190979, + 1.3679684735834599, + 1.3471232056617737, + 0.7419966198503971, + 0.46427900716662407, + 0.4207478016614914, + 0.581498371437192, + 1.1013991590589285, + 1.7681255862116814, + 1.4221733789891005, + 2.258361315354705, + 1.6803745850920677, + 0.9301160927861929, + 0.7410871153697371, + 1.024255659431219, + 0.677642347291112, + 0.370970843359828, + 1.8001665361225605, + 0.5076133161783218, + 2.282610170543194, + 1.8092179670929909, + 1.6833022385835648, + 0.723851403221488, + 0.9726949539035559, + 0.6144028529524803, + 0.4525886084884405, + 1.0274142287671566, + 1.4118494279682636, + 0.9847721755504608, + 0.7382068131119013, + 1.3125634528696537, + 1.920261962339282, + 0.753712547942996, + 1.8698955867439508, + 1.0777291972190142, + 1.0274084880948067, + 1.6279344875365496, + 1.0730154011398554, + 1.1541905999183655 + ], + "unique_experts": 64, + "load_cv": 0.3248700450779524, + "normalized_load_entropy": 0.987173850587648, + "max_load_share": 0.028265107212475632 + } + }, + "s0_period": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "81a077cb4ff07fbddb778010dbb1178cdb2692f6a43ee89cc4c9c9d79593aa79", + "route_weight_sha256": "74d039141a4ca3f6163363a074215aef3a459ed1f774b0d5a0c4493a1473461b", + "loads": [ + 15, + 15, + 11, + 15, + 12, + 24, + 7, + 15, + 12, + 11, + 10, + 7, + 10, + 14, + 6, + 21, + 23, + 21, + 15, + 7, + 14, + 3, + 7, + 12, + 23, + 19, + 19, + 12, + 14, + 8, + 7, + 11, + 15, + 20, + 11, + 4, + 17, + 7, + 6, + 10, + 16, + 9, + 7, + 6, + 15, + 24, + 16, + 10, + 11, + 16, + 8, + 3, + 15, + 10, + 10, + 18, + 19, + 7, + 16, + 9, + 6, + 12, + 4, + 3 + ], + "weighted_loads": [ + 1.4113271236419678, + 0.9083811119198799, + 0.3805280663073063, + 0.8484988585114479, + 0.4129830729216337, + 1.6511950474232435, + 0.22368104755878448, + 1.1073392201215029, + 0.7755916863679886, + 0.9115604273974895, + 0.372826786711812, + 0.2835589461028576, + 0.6408950388431549, + 0.47302914783358574, + 0.17146704345941544, + 1.788199383765459, + 1.1627872660756111, + 2.101004049181938, + 0.7821350824087858, + 0.4605383761227131, + 1.6795626264065504, + 0.28678989224135876, + 0.7072953041642904, + 0.4576594978570938, + 1.3353720530867577, + 1.5627534370869398, + 1.352629143744707, + 0.705664437264204, + 0.4352218806743622, + 0.3881369810551405, + 0.38356699980795383, + 0.49709901213645935, + 1.1579672284424305, + 1.6809014286845922, + 1.0696948766708374, + 0.27415017038583755, + 1.7065139077603817, + 0.8786502592265606, + 0.5878856424242258, + 0.7353561110794544, + 0.70573440939188, + 0.3001761622726917, + 0.6666373610496521, + 0.32151276618242264, + 1.6047936826944351, + 1.8337484318763018, + 1.0421386770904064, + 0.4549643471837044, + 0.9045112617313862, + 0.6882925890386105, + 0.3683734107762575, + 0.1231000479310751, + 1.286938551813364, + 0.8087607901543379, + 0.5209364704787731, + 1.190122438594699, + 1.704662762582302, + 0.49454943276941776, + 1.6303318124264479, + 0.6800683289766312, + 0.2639284674078226, + 1.2121660728007555, + 0.20457236096262932, + 0.17596162110567093 + ], + "unique_experts": 64, + "load_cv": 0.44750752494049695, + "normalized_load_entropy": 0.9752072806233999, + "max_load_share": 0.03076923076923077 + }, + "full_input": { + "tokens": 155, + "top_k": 6, + "decisions": 930, + "ordered_route_sha256": "2a9859e02d5d3d6e3660ea3c4020a37881f249a02a6b42f3ef0a1d13a36d4e41", + "route_weight_sha256": "772b82211736cd9caaf6485df7bb9d5bd7816693e93beeffd9344be583a6904b", + "loads": [ + 16, + 25, + 11, + 17, + 12, + 24, + 8, + 17, + 16, + 11, + 13, + 7, + 10, + 15, + 11, + 22, + 23, + 21, + 15, + 11, + 17, + 12, + 7, + 12, + 26, + 19, + 19, + 14, + 16, + 8, + 7, + 11, + 15, + 21, + 16, + 19, + 17, + 7, + 10, + 10, + 16, + 9, + 14, + 6, + 15, + 24, + 19, + 15, + 13, + 16, + 10, + 8, + 15, + 10, + 10, + 18, + 19, + 15, + 24, + 11, + 19, + 14, + 9, + 13 + ], + "weighted_loads": [ + 1.7053447365760803, + 1.8561817146837711, + 0.3805280663073063, + 1.6102368980646133, + 0.4129830729216337, + 1.6511950474232435, + 0.2558167576789856, + 1.195825831964612, + 1.008641455322504, + 0.9115604273974895, + 0.4988062623888254, + 0.2835589461028576, + 0.6408950388431549, + 0.4985111001878977, + 0.36728842929005623, + 1.833398349583149, + 1.1627872660756111, + 2.101004049181938, + 0.7821350824087858, + 1.1857079900801182, + 1.951707100495696, + 1.160172937437892, + 0.7072953041642904, + 0.4576594978570938, + 1.464520987123251, + 1.5627534370869398, + 1.352629143744707, + 0.9616015814244747, + 0.6662214770913124, + 0.3881369810551405, + 0.38356699980795383, + 0.49709901213645935, + 1.1579672284424305, + 1.7289752904325724, + 1.2938879877328873, + 2.324906514957547, + 1.7065139077603817, + 0.8786502592265606, + 0.7439213916659355, + 0.7353561110794544, + 0.70573440939188, + 0.3001761622726917, + 1.3683881871402264, + 0.32151276618242264, + 1.6047936826944351, + 1.8337484318763018, + 1.1352172307670116, + 0.73642148822546, + 0.955858176574111, + 0.6882925890386105, + 0.42152782529592514, + 0.6945521514862776, + 1.286938551813364, + 0.8087607901543379, + 0.5209364704787731, + 1.190122438594699, + 1.704662762582302, + 0.891402380540967, + 1.99370894767344, + 0.7655218988656998, + 1.2199040576815605, + 1.2989458497613668, + 0.6460342481732368, + 0.7132608480751514 + ], + "unique_experts": 64, + "load_cv": 0.3447238711585173, + "normalized_load_entropy": 0.985693247189638, + "max_load_share": 0.02795698924731183 + } + }, + "s1_period": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "58dcf4111b0d8eae61f91977632f9982ef4f99de911c54034c107429fab74c2d", + "route_weight_sha256": "3c6b3c9dc12daf53484d00a00245fff369b8e9e8feb2cb6cdcbf369f8f42b29c", + "loads": [ + 15, + 15, + 11, + 14, + 11, + 24, + 8, + 14, + 12, + 11, + 15, + 8, + 11, + 11, + 1, + 21, + 23, + 21, + 15, + 6, + 14, + 4, + 7, + 8, + 23, + 22, + 19, + 12, + 15, + 11, + 7, + 11, + 15, + 21, + 11, + 5, + 17, + 8, + 6, + 9, + 15, + 11, + 7, + 6, + 15, + 23, + 16, + 6, + 11, + 12, + 8, + 3, + 15, + 10, + 15, + 20, + 19, + 7, + 16, + 9, + 5, + 12, + 4, + 3 + ], + "weighted_loads": [ + 1.4184647537767887, + 0.9215011671185493, + 0.3994509745389223, + 0.8205415327101946, + 0.37766135670244694, + 1.7266336753964424, + 0.24976359121501446, + 1.0624621007591486, + 0.7920357212424278, + 0.9228537119925022, + 0.5452500265091658, + 0.32722317427396774, + 0.7020385004580021, + 0.36481389217078686, + 0.035142265260219574, + 1.856735872104764, + 1.162565965205431, + 2.0925758741796017, + 0.8008497729897499, + 0.41029488295316696, + 1.754138397052884, + 0.3241113629192114, + 0.7537839747965336, + 0.3295842166990042, + 1.3269447311758995, + 1.6684597078710794, + 1.3658841866999865, + 0.6793355196714401, + 0.4723093993961811, + 0.49045047350227833, + 0.3873946387320757, + 0.537418631836772, + 1.1053400039672852, + 1.7570749372243881, + 1.0553063340485096, + 0.30157263576984406, + 1.6784651950001717, + 0.8860668186098337, + 0.5968906693160534, + 0.6798025965690613, + 0.6816518362611532, + 0.3707902207970619, + 0.6393419578671455, + 0.32582397013902664, + 1.6290682815015316, + 1.8035532888025045, + 1.062681082636118, + 0.3287758883088827, + 0.9052257351577282, + 0.5433983150869608, + 0.37392808124423027, + 0.11224250495433807, + 1.2336618639528751, + 0.7982273958623409, + 0.7087107338011265, + 1.3231508303433657, + 1.698812060058117, + 0.4780099634081125, + 1.6554799489676952, + 0.6926199924200773, + 0.22966435551643372, + 1.2078763265162706, + 0.1914961338043213, + 0.17178447917103767 + ], + "unique_experts": 64, + "load_cv": 0.46253453768727715, + "normalized_load_entropy": 0.9729000858694747, + "max_load_share": 0.03076923076923077 + }, + "full_input": { + "tokens": 171, + "top_k": 6, + "decisions": 1026, + "ordered_route_sha256": "633a84c86aa25807383e8e62c24b4d1627711cc9207a4d08f6d391c4ed6c0390", + "route_weight_sha256": "fb80a40fb625af9e882e81f85394c5cf292e4aa3978bf5cc1da1d46b2323238b", + "loads": [ + 20, + 26, + 14, + 17, + 12, + 25, + 8, + 18, + 22, + 12, + 22, + 8, + 11, + 14, + 8, + 23, + 26, + 21, + 15, + 12, + 17, + 14, + 8, + 8, + 29, + 23, + 19, + 15, + 19, + 11, + 8, + 13, + 15, + 22, + 20, + 22, + 17, + 9, + 12, + 12, + 15, + 11, + 17, + 7, + 18, + 23, + 24, + 14, + 14, + 13, + 11, + 10, + 16, + 13, + 16, + 20, + 23, + 13, + 18, + 18, + 18, + 17, + 14, + 16 + ], + "weighted_loads": [ + 2.2053326815366745, + 1.9275201447308064, + 0.47323441691696644, + 1.6165073458105326, + 0.4078797623515129, + 1.8687858656048775, + 0.24976359121501446, + 1.211615500971675, + 1.5738148353993893, + 1.0392886511981487, + 0.8509593512862921, + 0.32722317427396774, + 0.7020385004580021, + 0.4462707955390215, + 0.4359498508274555, + 1.9242780264467, + 1.2589919120073318, + 2.0925758741796017, + 0.8008497729897499, + 1.1647995486855507, + 2.0178183168172836, + 1.226485600695014, + 0.7922629602253437, + 0.3295842166990042, + 1.596885435283184, + 1.7188418973237276, + 1.3658841866999865, + 1.3520523607730865, + 0.7108930256217718, + 0.49045047350227833, + 0.4211499821394682, + 0.580017639324069, + 1.1053400039672852, + 1.7968977876007557, + 1.4221747647970915, + 2.1659311782568693, + 1.6784651950001717, + 0.9281401056796312, + 0.8148850435391068, + 1.0323442071676254, + 0.6816518362611532, + 0.3707902207970619, + 1.8056809268891811, + 0.5075806751847267, + 2.277685072273016, + 1.8035532888025045, + 1.697183359414339, + 0.7287624049931765, + 0.9987090490758419, + 0.5861727800220251, + 0.45408007502555847, + 0.9765027910470963, + 1.4100437797605991, + 0.9817504286766052, + 0.7382145747542381, + 1.3231508303433657, + 1.952095653861761, + 0.7489423807710409, + 1.7665601894259453, + 1.0749975945800543, + 1.0395856611430645, + 1.5714585352689028, + 1.0754598509520292, + 1.0967936217784882 + ], + "unique_experts": 64, + "load_cv": 0.3274795785246805, + "normalized_load_entropy": 0.9869689034634511, + "max_load_share": 0.028265107212475632 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 130, + "ordered_topk_exact_tokens": 98, + "set_exact_tokens": 110, + "mean_set_jaccard": 0.9560439560439561, + "mean_token_weighted_tv": 0.008128210243124228, + "aggregate_load_tv": 0.020512820512820513 + }, + "system_bos": { + "tokens": 130, + "ordered_topk_exact_tokens": 79, + "set_exact_tokens": 95, + "mean_set_jaccard": 0.9230769230769231, + "mean_token_weighted_tv": 0.01598368390248372, + "aggregate_load_tv": 0.029487179487179487 + }, + "system_x": { + "tokens": 130, + "ordered_topk_exact_tokens": 83, + "set_exact_tokens": 93, + "mean_set_jaccard": 0.9153846153846154, + "mean_token_weighted_tv": 0.018176132196990342, + "aggregate_load_tv": 0.037179487179487186 + }, + "system_period": { + "tokens": 130, + "ordered_topk_exact_tokens": 80, + "set_exact_tokens": 93, + "mean_set_jaccard": 0.9170329670329671, + "mean_token_weighted_tv": 0.017887704554372108, + "aggregate_load_tv": 0.03589743589743591 + }, + "bos_at_s0": { + "tokens": 130, + "ordered_topk_exact_tokens": 61, + "set_exact_tokens": 81, + "mean_set_jaccard": 0.8791208791208792, + "mean_token_weighted_tv": 0.025431947574879113, + "aggregate_load_tv": 0.043589743589743594 + }, + "bos_at_s1": { + "tokens": 130, + "ordered_topk_exact_tokens": 54, + "set_exact_tokens": 76, + "mean_set_jaccard": 0.8697802197802199, + "mean_token_weighted_tv": 0.027534036030276463, + "aggregate_load_tv": 0.04871794871794872 + }, + "x_at_s0": { + "tokens": 130, + "ordered_topk_exact_tokens": 64, + "set_exact_tokens": 84, + "mean_set_jaccard": 0.8857142857142857, + "mean_token_weighted_tv": 0.023386686768096226, + "aggregate_load_tv": 0.041025641025641026 + }, + "x_at_s1": { + "tokens": 130, + "ordered_topk_exact_tokens": 60, + "set_exact_tokens": 79, + "mean_set_jaccard": 0.8780219780219781, + "mean_token_weighted_tv": 0.026444709114730357, + "aggregate_load_tv": 0.04743589743589744 + }, + "period_at_s0": { + "tokens": 130, + "ordered_topk_exact_tokens": 65, + "set_exact_tokens": 84, + "mean_set_jaccard": 0.8857142857142857, + "mean_token_weighted_tv": 0.02337084303681667, + "aggregate_load_tv": 0.038461538461538464 + }, + "period_at_s1": { + "tokens": 130, + "ordered_topk_exact_tokens": 59, + "set_exact_tokens": 75, + "mean_set_jaccard": 0.8659340659340661, + "mean_token_weighted_tv": 0.027827126239068235, + "aggregate_load_tv": 0.04871794871794871 + } + } + }, + "layer_03": { + "layer": 3, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "da3c0f285222b83f2a52a189a077eb7313e37de75deafc3171327739915cc02e", + "route_weight_sha256": "18f926ebd7fa8bdc1ebf5d645db9b7da93508c50d3d672056d29dce75417d4ae", + "loads": [ + 0, + 14, + 25, + 9, + 25, + 9, + 25, + 1, + 8, + 2, + 6, + 8, + 23, + 11, + 8, + 11, + 19, + 6, + 10, + 23, + 23, + 14, + 12, + 3, + 13, + 3, + 41, + 10, + 7, + 17, + 22, + 8, + 5, + 18, + 9, + 13, + 10, + 8, + 9, + 9, + 8, + 14, + 1, + 24, + 12, + 8, + 9, + 11, + 2, + 6, + 10, + 15, + 22, + 17, + 19, + 18, + 12, + 7, + 8, + 17, + 4, + 16, + 14, + 9 + ], + "weighted_loads": [ + 0.0, + 0.6591873653233051, + 1.5131641402840614, + 0.35600028000772, + 2.109610430896282, + 0.4280887059867382, + 1.5850022602826357, + 0.04103810340166092, + 0.6571501828730106, + 0.06853022053837776, + 0.2199051883071661, + 0.287456639111042, + 1.6510638277977705, + 0.5960976667702198, + 0.5552257262170315, + 0.8023587521165609, + 1.5636950358748436, + 0.19525331258773804, + 0.3842379115521908, + 1.7143353037536144, + 1.9246898852288723, + 1.2286552041769028, + 0.823880136013031, + 0.0867984127253294, + 1.8222578950226307, + 0.15863773599267006, + 3.393271090462804, + 0.7586660645902157, + 0.4029560200870037, + 1.3730325996875763, + 2.297730792313814, + 0.2585469614714384, + 0.2672259509563446, + 1.595439150929451, + 0.5001565534621477, + 0.6011072974652052, + 0.36001043021678925, + 0.6026969384402037, + 0.6681915782392025, + 0.6093943193554878, + 0.40550732612609863, + 0.4349880423396826, + 0.04095131531357765, + 1.4512004610151052, + 0.9210297614336014, + 0.7243434265255928, + 0.3758739698678255, + 1.0191064402461052, + 0.07462514936923981, + 0.26733430474996567, + 0.4308054558932781, + 1.2654249165207148, + 1.867515154182911, + 0.9219494238495827, + 1.7138410955667496, + 1.3949038535356522, + 1.7513799741864204, + 0.22074976563453674, + 0.5942174103111029, + 1.1339334324002266, + 0.11947109922766685, + 1.2500891648232937, + 1.9785855766385794, + 0.5043029394000769 + ], + "unique_experts": 63, + "load_cv": 0.6127936910770216, + "normalized_load_entropy": 0.9548310069789521, + "max_load_share": 0.052564102564102565 + }, + "full_input": { + "tokens": 155, + "top_k": 6, + "decisions": 930, + "ordered_route_sha256": "daf96a9b4098b1eba427701727a3a719b13daf1601ef516a2ea5cf489c1b0231", + "route_weight_sha256": "cfe10f496c877924c2773d5cd0dff40c623c9053e3268fc9d64143d39b4957c2", + "loads": [ + 9, + 14, + 25, + 20, + 27, + 10, + 26, + 8, + 8, + 7, + 8, + 9, + 25, + 15, + 15, + 11, + 19, + 6, + 10, + 23, + 25, + 18, + 18, + 5, + 13, + 5, + 41, + 16, + 7, + 20, + 23, + 8, + 5, + 18, + 18, + 13, + 10, + 8, + 9, + 9, + 8, + 15, + 10, + 25, + 12, + 8, + 23, + 11, + 9, + 16, + 10, + 15, + 23, + 17, + 23, + 20, + 12, + 8, + 9, + 17, + 11, + 16, + 17, + 11 + ], + "weighted_loads": [ + 1.2753825038671494, + 0.6591873653233051, + 1.5131641402840614, + 1.0202695224434137, + 2.138323576946277, + 0.4757944941520691, + 1.6344544496387243, + 1.1866082586348057, + 0.6571501828730106, + 0.2923237041104585, + 0.2926529999822378, + 0.2883337241364643, + 1.663130171742523, + 0.9418633691966534, + 1.1181131526827812, + 0.8023587521165609, + 1.5636950358748436, + 0.19525331258773804, + 0.3842379115521908, + 1.7143353037536144, + 1.9939978998154402, + 1.6256874203681946, + 1.2696773894131184, + 0.14421076700091362, + 1.8222578950226307, + 0.17236145352944732, + 3.393271090462804, + 0.9830324854701757, + 0.4029560200870037, + 1.5192425958812237, + 2.3442524820566177, + 0.2585469614714384, + 0.2672259509563446, + 1.595439150929451, + 1.5331774111837149, + 0.6011072974652052, + 0.36001043021678925, + 0.6026969384402037, + 0.6681915782392025, + 0.6093943193554878, + 0.40550732612609863, + 0.44645041786134243, + 0.5853139944374561, + 1.485151642933488, + 0.9210297614336014, + 0.7243434265255928, + 2.0457882191985846, + 1.0191064402461052, + 0.8444817699491978, + 0.8819680698215961, + 0.4308054558932781, + 1.2654249165207148, + 1.8822986613959074, + 0.9219494238495827, + 3.5457905158400536, + 1.5028398260474205, + 1.7513799741864204, + 0.23361246939748526, + 0.6318099033087492, + 1.1339334324002266, + 0.62985266931355, + 1.2500891648232937, + 2.3031919356435537, + 0.5740242004394531 + ], + "unique_experts": 64, + "load_cv": 0.48063914744499736, + "normalized_load_entropy": 0.9738611270722132, + "max_load_share": 0.04408602150537634 + } + }, + "s1_eos": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "8a1552b1145f01bd86050d2f1da92a60ac897b806d3f9ea0cab4c3763a7f69dc", + "route_weight_sha256": "4a16bd2471b7a98b51cc4ce964cddfcc80bef0456ec911edacd7bad3ed942e96", + "loads": [ + 0, + 14, + 24, + 7, + 25, + 9, + 26, + 1, + 8, + 2, + 6, + 10, + 23, + 11, + 8, + 12, + 19, + 6, + 10, + 23, + 23, + 14, + 12, + 3, + 13, + 3, + 40, + 11, + 7, + 16, + 22, + 10, + 5, + 18, + 8, + 13, + 9, + 8, + 9, + 10, + 8, + 16, + 1, + 23, + 12, + 8, + 7, + 11, + 2, + 6, + 10, + 15, + 21, + 16, + 19, + 18, + 12, + 7, + 8, + 18, + 4, + 16, + 14, + 10 + ], + "weighted_loads": [ + 0.0, + 0.6560893412679434, + 1.459565868601203, + 0.29956822469830513, + 2.0984049290418625, + 0.43894315883517265, + 1.6211372148245573, + 0.04146018624305725, + 0.6531603187322617, + 0.06815320812165737, + 0.22109482437372208, + 0.3504570070654154, + 1.6340883448719978, + 0.5947176292538643, + 0.5561208017170429, + 0.8311792556196451, + 1.5619121454656124, + 0.1965393554419279, + 0.3790587019175291, + 1.7162870410829782, + 1.9132383167743683, + 1.225184004753828, + 0.8314234763383865, + 0.08651569671928883, + 1.8244130052626133, + 0.15968007408082485, + 3.38667843490839, + 0.7991071529686451, + 0.40130146965384483, + 1.338782800361514, + 2.301357325166464, + 0.3218130264431238, + 0.2705465257167816, + 1.5913254544138908, + 0.477543406188488, + 0.6036537438631058, + 0.32355362363159657, + 0.6045621447265148, + 0.6757449023425579, + 0.6581902466714382, + 0.40949680656194687, + 0.5001518689095974, + 0.04126882553100586, + 1.415890982374549, + 0.9148379005491734, + 0.733218252658844, + 0.32830470241606236, + 1.0259207040071487, + 0.07798206433653831, + 0.2672094814479351, + 0.43820453621447086, + 1.2648362629115582, + 1.8552035633474588, + 0.8991047535091639, + 1.696233656257391, + 1.4020178392529488, + 1.751730851829052, + 0.22113900259137154, + 0.5817032717168331, + 1.160025741904974, + 0.10957416892051697, + 1.2519353311508894, + 1.9429896622896194, + 0.5292157046496868 + ], + "unique_experts": 63, + "load_cv": 0.6053671844491486, + "normalized_load_entropy": 0.955397659324379, + "max_load_share": 0.05128205128205128 + }, + "full_input": { + "tokens": 171, + "top_k": 6, + "decisions": 1026, + "ordered_route_sha256": "02bfd09ba1f8cbf14c9f26b658db79c36c389f574375b47b0c0380487f657c92", + "route_weight_sha256": "f21d7d439d79af0ffdfd9e1bede5b6f199518db8b3ee840f66bd78b0479a9f97", + "loads": [ + 13, + 16, + 24, + 19, + 26, + 12, + 27, + 11, + 8, + 10, + 9, + 11, + 27, + 16, + 17, + 13, + 21, + 6, + 11, + 23, + 25, + 21, + 23, + 4, + 15, + 6, + 40, + 14, + 7, + 19, + 23, + 10, + 5, + 20, + 16, + 13, + 9, + 13, + 9, + 11, + 9, + 17, + 15, + 26, + 12, + 11, + 25, + 11, + 12, + 16, + 10, + 21, + 25, + 21, + 24, + 24, + 12, + 8, + 16, + 19, + 17, + 17, + 19, + 16 + ], + "weighted_loads": [ + 1.6478406302630901, + 0.7303023114800453, + 1.459565868601203, + 1.0405046939849854, + 2.09894151968183, + 0.586551982909441, + 1.6670675929635763, + 1.2572658378630877, + 0.6531603187322617, + 0.4740983333904296, + 0.30657258816063404, + 0.35133409209083766, + 1.7231201298127417, + 1.002339232712984, + 1.293712206184864, + 0.8801720906049013, + 1.7758069224655628, + 0.1965393554419279, + 0.4348513949662447, + 1.7162870410829782, + 1.9796799048781395, + 1.7064069546759129, + 1.785850465297699, + 0.11681676283478737, + 1.9279548674821854, + 0.2171283126808703, + 3.38667843490839, + 0.8956924770027399, + 0.40130146965384483, + 1.4765873868018389, + 2.342879544943571, + 0.3218130264431238, + 0.2705465257167816, + 1.6641524322330952, + 1.3915782049298286, + 0.6036537438631058, + 0.32355362363159657, + 1.019031647592783, + 0.6757449023425579, + 0.7086103707551956, + 0.48510486632585526, + 0.5089483195915818, + 0.71477229334414, + 1.5224921833723783, + 0.9148379005491734, + 0.9749699123203754, + 2.5719627775251865, + 1.0259207040071487, + 1.1916272789239883, + 0.7317960448563099, + 0.43820453621447086, + 2.0436203703284264, + 2.0670388601720333, + 1.6127494368702173, + 3.6395790092647076, + 1.7396073434501886, + 1.751730851829052, + 0.2301384825259447, + 1.1038876175880432, + 1.190708253532648, + 0.9130584225058556, + 1.3022828307002783, + 2.3558318950235844, + 0.9405596479773521 + ], + "unique_experts": 64, + "load_cv": 0.4263572784199679, + "normalized_load_entropy": 0.9783495380190392, + "max_load_share": 0.03898635477582846 + } + }, + "s0_bos": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "ffce6d8b1fa37a46887c85fbea0b2f3ec2d7338598fe1a1960a5147df560164a", + "route_weight_sha256": "45d8868a85fa475e3f72e78c5e942fb1e62ff79e361bbe526f4f8e2aadc0dd46", + "loads": [ + 0, + 14, + 22, + 7, + 24, + 8, + 25, + 1, + 9, + 2, + 7, + 9, + 21, + 10, + 8, + 9, + 19, + 6, + 10, + 24, + 24, + 15, + 12, + 5, + 13, + 8, + 40, + 9, + 8, + 18, + 22, + 9, + 5, + 18, + 6, + 14, + 9, + 9, + 10, + 10, + 8, + 15, + 1, + 23, + 12, + 8, + 8, + 11, + 2, + 6, + 10, + 14, + 21, + 17, + 18, + 18, + 12, + 6, + 8, + 18, + 5, + 16, + 14, + 10 + ], + "weighted_loads": [ + 0.0, + 0.640762846916914, + 1.4209494162350893, + 0.30917688831686974, + 2.191244827583432, + 0.35891020484268665, + 1.5697609167546034, + 0.04061510041356087, + 0.6923709250986576, + 0.068035077303648, + 0.24404911883175373, + 0.3254811353981495, + 1.5697358194738626, + 0.5611462481319904, + 0.5545777436345816, + 0.7346250433474779, + 1.5743095315992832, + 0.19987750053405762, + 0.38301522471010685, + 1.7357771340757608, + 1.9824027866125107, + 1.2387010343372822, + 0.814840991050005, + 0.15300773456692696, + 1.8568197768181562, + 0.3106323555111885, + 3.183457002043724, + 0.7284005768597126, + 0.4374946001917124, + 1.3759902399033308, + 2.2456031255424023, + 0.2959623858332634, + 0.2727958522737026, + 1.6148825641721487, + 0.3894810266792774, + 0.674614729359746, + 0.32927602902054787, + 0.6598233096301556, + 0.713727317750454, + 0.6422739736735821, + 0.4257201664149761, + 0.4869614150375128, + 0.04482916370034218, + 1.4649675339460373, + 0.9287917744368315, + 0.7467742934823036, + 0.351578526198864, + 1.0357833877205849, + 0.07523149251937866, + 0.2612188346683979, + 0.4893810674548149, + 1.1985557693988085, + 1.8264584876596928, + 0.9212534446269274, + 1.6419584099203348, + 1.4108998998999596, + 1.7811041306704283, + 0.19251472875475883, + 0.6030437313020229, + 1.2125789616256952, + 0.15251224115490913, + 1.254362840205431, + 1.9512742552906275, + 0.5408316999673843 + ], + "unique_experts": 63, + "load_cv": 0.5904121071580121, + "normalized_load_entropy": 0.9580284547385768, + "max_load_share": 0.05128205128205128 + }, + "full_input": { + "tokens": 155, + "top_k": 6, + "decisions": 930, + "ordered_route_sha256": "567713c0bdd14cdcf0b1585eae03da07bc5eaa1e97d8b40e7cf60c70c0e3b967", + "route_weight_sha256": "e0e84bf92765e8e0394829081e0033efc72939243c46ab70163cf0d81d0b165c", + "loads": [ + 9, + 14, + 22, + 18, + 26, + 10, + 26, + 9, + 9, + 7, + 9, + 10, + 22, + 14, + 15, + 9, + 19, + 6, + 11, + 24, + 26, + 19, + 18, + 6, + 13, + 9, + 40, + 15, + 8, + 22, + 23, + 9, + 5, + 18, + 14, + 14, + 9, + 9, + 10, + 10, + 8, + 15, + 11, + 24, + 12, + 10, + 22, + 11, + 10, + 16, + 11, + 14, + 21, + 17, + 21, + 20, + 12, + 6, + 9, + 18, + 11, + 16, + 17, + 12 + ], + "weighted_loads": [ + 1.365659922361374, + 0.640762846916914, + 1.4209494162350893, + 0.967886820435524, + 2.219957973633427, + 0.4549459870904684, + 1.6258188877254725, + 1.1821972392499447, + 0.6923709250986576, + 0.31270133634097874, + 0.31679693050682545, + 0.32635822042357177, + 1.5702115503663663, + 0.9265026785433292, + 1.1466143522411585, + 0.7346250433474779, + 1.5743095315992832, + 0.19987750053405762, + 0.41918124444782734, + 1.7357771340757608, + 2.054212348535657, + 1.6419996432960033, + 1.2716383710503578, + 0.18030260503292084, + 1.8568197768181562, + 0.31116073997691274, + 3.183457002043724, + 0.9527669977396727, + 0.4374946001917124, + 1.5671252701431513, + 2.292124815285206, + 0.2959623858332634, + 0.2727958522737026, + 1.6148825641721487, + 1.3848940953612328, + 0.674614729359746, + 0.32927602902054787, + 0.6598233096301556, + 0.713727317750454, + 0.6422739736735821, + 0.4257201664149761, + 0.4869614150375128, + 0.7103748805820942, + 1.500295452773571, + 0.9287917744368315, + 0.8422704227268696, + 2.018388520926237, + 1.0357833877205849, + 0.9304787963628769, + 0.8758525997400284, + 0.5197647232562304, + 1.1985557693988085, + 1.8264584876596928, + 0.9212534446269274, + 2.773353548720479, + 1.5409128479659557, + 1.7811041306704283, + 0.19251472875475883, + 0.6407529823482037, + 1.2125789616256952, + 0.5823148544877768, + 1.254362840205431, + 2.275880614295602, + 0.6139651499688625 + ], + "unique_experts": 64, + "load_cv": 0.44714119988026363, + "normalized_load_entropy": 0.9776068826041945, + "max_load_share": 0.043010752688172046 + } + }, + "s1_bos": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "05d0d35eb43afd2b92566ba7cebf2c926cacdb7352985fb193894165e50596c5", + "route_weight_sha256": "2efff78fd4d1aaaefd0352e9c5632f802fd133a5eb5ec61a748fdb6eea541012", + "loads": [ + 0, + 14, + 25, + 7, + 23, + 9, + 26, + 2, + 10, + 2, + 7, + 10, + 22, + 10, + 8, + 9, + 19, + 4, + 12, + 24, + 24, + 14, + 12, + 5, + 13, + 5, + 40, + 8, + 6, + 16, + 21, + 7, + 6, + 18, + 7, + 13, + 10, + 9, + 10, + 10, + 8, + 16, + 1, + 23, + 12, + 8, + 8, + 11, + 2, + 6, + 9, + 15, + 20, + 16, + 18, + 18, + 12, + 7, + 8, + 18, + 6, + 16, + 13, + 12 + ], + "weighted_loads": [ + 0.0, + 0.6347238179296255, + 1.4864922631531954, + 0.3034357689321041, + 2.1353913992643356, + 0.4111192896962166, + 1.601440418511629, + 0.07668765261769295, + 0.7294022925198078, + 0.06827550195157528, + 0.24876054748892784, + 0.35916659608483315, + 1.606277722865343, + 0.5614643730223179, + 0.5709444414824247, + 0.7369476016610861, + 1.5755100920796394, + 0.1507417019456625, + 0.4272792302072048, + 1.75756461545825, + 1.9565715789794922, + 1.1855240650475025, + 0.8106689676642418, + 0.1405716836452484, + 1.7998238317668438, + 0.23662219010293484, + 3.2390018105506897, + 0.6929189413785934, + 0.37736596912145615, + 1.3096036296337843, + 2.2272853925824165, + 0.24072061851620674, + 0.31689059920609, + 1.6063174977898598, + 0.4170315321534872, + 0.6602505333721638, + 0.365617960691452, + 0.6634438261389732, + 0.705736305564642, + 0.6211712434887886, + 0.43533366173505783, + 0.5039214361459017, + 0.0488114170730114, + 1.4414221085608006, + 0.9260154608637094, + 0.7420385405421257, + 0.3548755496740341, + 1.0503750443458557, + 0.0756281167268753, + 0.26635466516017914, + 0.46352360397577286, + 1.2277487758547068, + 1.856564525514841, + 0.9005715381354094, + 1.6440396159887314, + 1.401238113641739, + 1.7733925003558397, + 0.2258143275976181, + 0.586689930409193, + 1.2242437601089478, + 0.16851521469652653, + 1.2657049614936113, + 1.8889912106096745, + 0.6144457124173641 + ], + "unique_experts": 63, + "load_cv": 0.5937876947444939, + "normalized_load_entropy": 0.9579089646717192, + "max_load_share": 0.05128205128205128 + }, + "full_input": { + "tokens": 171, + "top_k": 6, + "decisions": 1026, + "ordered_route_sha256": "5456cba033fe146085dbaafa3d893c3dd66fdaf79d052bec83dea0e109f35e32", + "route_weight_sha256": "66d52477a8582494a6aa97c4db39029b03cd74b1d964f20414c82473f438f7a5", + "loads": [ + 13, + 16, + 25, + 19, + 24, + 14, + 27, + 12, + 10, + 10, + 10, + 11, + 25, + 15, + 17, + 10, + 21, + 4, + 14, + 24, + 26, + 21, + 23, + 5, + 15, + 7, + 40, + 11, + 6, + 19, + 22, + 7, + 6, + 20, + 15, + 13, + 10, + 14, + 10, + 11, + 9, + 16, + 16, + 26, + 12, + 13, + 26, + 11, + 12, + 16, + 10, + 21, + 23, + 21, + 22, + 24, + 12, + 7, + 16, + 19, + 18, + 17, + 18, + 19 + ], + "weighted_loads": [ + 1.688740637153387, + 0.7089367881417274, + 1.4864922631531954, + 1.0370535403490067, + 2.135927989904303, + 0.6355264410376549, + 1.6621942929923534, + 1.261325677856803, + 0.7294022925198078, + 0.5019726429600269, + 0.3342383112758398, + 0.3600436811102554, + 1.687400806840742, + 0.9928272515535355, + 1.3371890876442194, + 0.7859404366463423, + 1.7894048690795898, + 0.1507417019456625, + 0.5194053240120411, + 1.75756461545825, + 2.026838466525078, + 1.6469888649880886, + 1.7688164375722408, + 0.1405716836452484, + 1.9033656939864159, + 0.28528406331315637, + 3.2390018105506897, + 0.7895042654126883, + 0.37736596912145615, + 1.4501811359077692, + 2.2688076123595238, + 0.24072061851620674, + 0.31689059920609, + 1.679144475609064, + 1.3393204677850008, + 0.6602505333721638, + 0.365617960691452, + 1.0779133290052414, + 0.705736305564642, + 0.671591367572546, + 0.5109417214989662, + 0.5039214361459017, + 0.8693182226270437, + 1.5468670204281807, + 0.9260154608637094, + 1.0929310470819473, + 2.605542875826359, + 1.0503750443458557, + 1.2200955711305141, + 0.7309412285685539, + 0.4951372891664505, + 2.006532883271575, + 2.058041103184223, + 1.6142162214964628, + 2.7972785010933876, + 1.7526018265634775, + 1.7733925003558397, + 0.2258143275976181, + 1.1137155778706074, + 1.2549262717366219, + 0.874365670606494, + 1.3160524610430002, + 2.3018334433436394, + 1.057911030948162 + ], + "unique_experts": 64, + "load_cv": 0.4197465484094433, + "normalized_load_entropy": 0.9788956885193196, + "max_load_share": 0.03898635477582846 + } + }, + "s0_x": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "1228a356d7bdfd9b4bf23d109c194bcbeadee3deae071ff1ba2dfbda99311645", + "route_weight_sha256": "455e167762d9de4dda6b114b84cd6c8f994015a30f52d195e9ba5d913d0626a6", + "loads": [ + 0, + 14, + 22, + 8, + 24, + 7, + 25, + 1, + 9, + 2, + 6, + 8, + 23, + 11, + 8, + 9, + 19, + 7, + 10, + 24, + 24, + 15, + 12, + 4, + 13, + 8, + 41, + 10, + 8, + 16, + 21, + 9, + 6, + 18, + 7, + 15, + 6, + 9, + 10, + 10, + 8, + 16, + 1, + 23, + 12, + 8, + 8, + 11, + 2, + 6, + 10, + 14, + 21, + 17, + 18, + 18, + 13, + 6, + 8, + 18, + 2, + 16, + 14, + 11 + ], + "weighted_loads": [ + 0.0, + 0.6592244226485491, + 1.4392537493258715, + 0.3276046756654978, + 2.16281945630908, + 0.3186042085289955, + 1.5700191352516413, + 0.04129566624760628, + 0.6991618201136589, + 0.06775598041713238, + 0.22258759289979935, + 0.2970135398209095, + 1.6204207725822926, + 0.589966306462884, + 0.5616280268877745, + 0.7172534596174955, + 1.5964585691690445, + 0.23456458933651447, + 0.3884335346519947, + 1.735911950469017, + 1.9559402018785477, + 1.2496626265347004, + 0.8243447355926037, + 0.11764294095337391, + 1.7913222778588533, + 0.31752120703458786, + 3.25715765170753, + 0.7791436836123466, + 0.4348517432808876, + 1.3088564574718475, + 2.2318972796201706, + 0.29176096618175507, + 0.30472807586193085, + 1.6339322049170732, + 0.42341840267181396, + 0.7043399419635534, + 0.22113844752311707, + 0.6625786200165749, + 0.706627706065774, + 0.6352063044905663, + 0.4198867604136467, + 0.5105505622923374, + 0.0426957905292511, + 1.4612718932330608, + 0.9401469491422176, + 0.7529108077287674, + 0.33822315372526646, + 1.0382213331758976, + 0.07389912381768227, + 0.2690238170325756, + 0.44695516489446163, + 1.224169071763754, + 1.8529677875339985, + 0.9253453463315964, + 1.653738234192133, + 1.4013469703495502, + 1.778800617903471, + 0.1907416544854641, + 0.6134090572595596, + 1.1612505540251732, + 0.06578608229756355, + 1.2537538707256317, + 1.9669249951839447, + 0.586616626009345 + ], + "unique_experts": 63, + "load_cv": 0.6024058712048418, + "normalized_load_entropy": 0.9560895524259325, + "max_load_share": 0.052564102564102565 + }, + "full_input": { + "tokens": 155, + "top_k": 6, + "decisions": 930, + "ordered_route_sha256": "08b750f5fbf914c01c825960da51557f0a07533e635d049dcb40ee88e9ee4554", + "route_weight_sha256": "f8f89c12e7040fccc71bfaad09c8099ffaf0669577797309e3cade62ad783d7d", + "loads": [ + 7, + 14, + 22, + 20, + 27, + 8, + 26, + 9, + 9, + 7, + 8, + 9, + 24, + 15, + 15, + 9, + 19, + 7, + 10, + 24, + 25, + 19, + 18, + 6, + 13, + 9, + 42, + 17, + 8, + 20, + 22, + 9, + 6, + 18, + 16, + 15, + 7, + 9, + 10, + 10, + 8, + 16, + 11, + 24, + 12, + 10, + 22, + 11, + 8, + 17, + 10, + 14, + 21, + 17, + 21, + 20, + 13, + 6, + 9, + 18, + 8, + 16, + 17, + 13 + ], + "weighted_loads": [ + 1.0567214451730251, + 0.6592244226485491, + 1.4392537493258715, + 1.1105055306106806, + 2.222427824337501, + 0.3663099966943264, + 1.6366538424044847, + 1.1816671192646027, + 0.6991618201136589, + 0.3350506250280887, + 0.29533540457487106, + 0.2978906248463318, + 1.6208965034747962, + 0.9512130785733461, + 1.1107995118945837, + 0.7172534596174955, + 1.5964585691690445, + 0.23456458933651447, + 0.3884335346519947, + 1.735911950469017, + 1.9828495625406504, + 1.62141128256917, + 1.2749301195144653, + 0.17635751701891422, + 1.7913222778588533, + 0.3180495915003121, + 3.2999993730336428, + 1.0510880146175623, + 0.4348517432808876, + 1.507855013012886, + 2.278418969362974, + 0.29176096618175507, + 0.30472807586193085, + 1.6339322049170732, + 1.520099874585867, + 0.7043399419635534, + 0.26932770758867264, + 0.6625786200165749, + 0.706627706065774, + 0.6352063044905663, + 0.4198867604136467, + 0.5105505622923374, + 0.6660439148545265, + 1.497252956032753, + 0.9401469491422176, + 0.8570449389517307, + 2.014482542872429, + 1.0382213331758976, + 0.7623314931988716, + 0.9466806501150131, + 0.44695516489446163, + 1.224169071763754, + 1.8529677875339985, + 0.9253453463315964, + 2.763443723320961, + 1.5440246239304543, + 1.778800617903471, + 0.1907416544854641, + 0.6543439775705338, + 1.1612505540251732, + 0.5280033145099878, + 1.2537538707256317, + 2.291531354188919, + 0.6577985975891352 + ], + "unique_experts": 64, + "load_cv": 0.46768631482424344, + "normalized_load_entropy": 0.9755447564146734, + "max_load_share": 0.04516129032258064 + } + }, + "s1_x": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "fb4ac4e786b0d06f4c3641779c11f193d447356e28c02ccebdc8a61d1298e698", + "route_weight_sha256": "aadba256a98757ef81304f81c6927f3edab81fdce0e54cdc53df62159ac6f350", + "loads": [ + 0, + 14, + 23, + 7, + 23, + 7, + 24, + 2, + 10, + 2, + 7, + 11, + 22, + 10, + 8, + 9, + 19, + 5, + 12, + 24, + 24, + 13, + 12, + 4, + 13, + 7, + 40, + 9, + 8, + 16, + 21, + 10, + 6, + 18, + 7, + 14, + 8, + 9, + 10, + 10, + 8, + 16, + 1, + 23, + 12, + 8, + 7, + 11, + 2, + 6, + 9, + 14, + 20, + 16, + 19, + 18, + 12, + 7, + 8, + 19, + 5, + 16, + 13, + 12 + ], + "weighted_loads": [ + 0.0, + 0.6458151508122683, + 1.4464246667921543, + 0.3007769361138344, + 2.0736615136265755, + 0.33776307106018066, + 1.528168123215437, + 0.07761979848146439, + 0.7361387796700001, + 0.06932302378118038, + 0.2501783687621355, + 0.38696844689548016, + 1.5839079599827528, + 0.5603765808045864, + 0.5758078712970018, + 0.7293969467282295, + 1.5721925795078278, + 0.17708844505250454, + 0.4281488060951233, + 1.7652597669512033, + 1.9548524282872677, + 1.1314184069633484, + 0.8271395415067673, + 0.1146779116243124, + 1.754053182899952, + 0.2956007346510887, + 3.2696669287979603, + 0.7484236545860767, + 0.4370483886450529, + 1.3184631206095219, + 2.2449106611311436, + 0.32924642972648144, + 0.32038829289376736, + 1.6228781510144472, + 0.4178293738514185, + 0.681661831215024, + 0.29019868560135365, + 0.6740825399756432, + 0.7067479696124792, + 0.6114275008440018, + 0.4340641964226961, + 0.5016135983169079, + 0.04767224192619324, + 1.420918421819806, + 0.9249463155865669, + 0.7466396018862724, + 0.33262949995696545, + 1.0598608665168285, + 0.07592235319316387, + 0.27361972630023956, + 0.45006149262189865, + 1.2062412407249212, + 1.8647653795778751, + 0.901039345189929, + 1.6771509889513254, + 1.410381842404604, + 1.7754210643470287, + 0.22333434224128723, + 0.5741454251110554, + 1.2138455286622047, + 0.13578514754772186, + 1.2657463140785694, + 1.8858372941613197, + 0.6252714600414038 + ], + "unique_experts": 63, + "load_cv": 0.5845029131576757, + "normalized_load_entropy": 0.9589998559579407, + "max_load_share": 0.05128205128205128 + }, + "full_input": { + "tokens": 171, + "top_k": 6, + "decisions": 1026, + "ordered_route_sha256": "9b507ee772b79d94f4f92b1fdf9545fc38f5090b19f6177637ca30a762f5c4ca", + "route_weight_sha256": "fb8fb8743a855d3645d109cc703f0e10125f9f1de082aee11f52e785329bed5d", + "loads": [ + 11, + 16, + 23, + 20, + 25, + 11, + 25, + 12, + 10, + 10, + 10, + 12, + 25, + 15, + 17, + 10, + 21, + 5, + 13, + 24, + 25, + 20, + 23, + 5, + 15, + 9, + 41, + 13, + 8, + 20, + 22, + 10, + 6, + 20, + 15, + 14, + 9, + 14, + 10, + 11, + 9, + 16, + 16, + 26, + 12, + 13, + 24, + 11, + 11, + 17, + 9, + 20, + 23, + 21, + 23, + 24, + 12, + 7, + 16, + 20, + 17, + 17, + 18, + 19 + ], + "weighted_loads": [ + 1.4115287736058235, + 0.7200281210243702, + 1.4464246667921543, + 1.1941709779202938, + 2.1047609465313144, + 0.512712499126792, + 1.5687156952917576, + 1.2535925302654505, + 0.7361387796700001, + 0.519701809855178, + 0.33565613254904747, + 0.38784553192090243, + 1.6650310439581517, + 0.9851472526788712, + 1.3313323576003313, + 0.7783897817134857, + 1.7860873565077782, + 0.17708844505250454, + 0.4839414991438389, + 1.7652597669512033, + 1.9869200959801674, + 1.580088533461094, + 1.7828622497618198, + 0.14913796447217464, + 1.857595045119524, + 0.34426260786131024, + 3.3088818676769733, + 0.8901913855224848, + 0.4370483886450529, + 1.5056536830961704, + 2.286432880908251, + 0.32924642972648144, + 0.32038829289376736, + 1.6957051288336515, + 1.3839238453656435, + 0.681661831215024, + 0.3301285933703184, + 1.0885520428419113, + 0.7067479696124792, + 0.6618476249277592, + 0.5096722561866045, + 0.5016135983169079, + 0.7821877431124449, + 1.5269372034817934, + 0.9249463155865669, + 1.1088674999773502, + 2.56186649389565, + 1.0598608665168285, + 1.0982330534607172, + 0.7976837195456028, + 0.45006149262189865, + 1.9850253481417894, + 2.0662419572472572, + 1.6146840285509825, + 2.8100089225918055, + 1.7667426262050867, + 1.7754210643470287, + 0.22333434224128723, + 1.0955161973834038, + 1.2445280402898788, + 0.8923874832689762, + 1.3160938136279583, + 2.2986795268952847, + 1.0697771068662405 + ], + "unique_experts": 64, + "load_cv": 0.4097788596673532, + "normalized_load_entropy": 0.9802663984057225, + "max_load_share": 0.03996101364522417 + } + }, + "s0_period": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "807dd3baaacfc2730ccc0cea9af73244923b57fbcf731bf1e4f93da7eaf75fd0", + "route_weight_sha256": "57196e0ea3eaffc4c047103d23f3e9b2e59329dffbecbacfbc9b649337317fe7", + "loads": [ + 0, + 14, + 22, + 8, + 24, + 7, + 25, + 1, + 9, + 2, + 6, + 8, + 23, + 11, + 8, + 9, + 19, + 6, + 10, + 24, + 24, + 16, + 12, + 4, + 13, + 9, + 41, + 10, + 7, + 16, + 22, + 10, + 6, + 19, + 6, + 15, + 7, + 9, + 9, + 10, + 8, + 15, + 1, + 23, + 12, + 8, + 8, + 11, + 2, + 6, + 10, + 14, + 21, + 17, + 18, + 18, + 13, + 6, + 8, + 18, + 2, + 16, + 14, + 10 + ], + "weighted_loads": [ + 0.0, + 0.6614687275141478, + 1.4448688961565495, + 0.3267719652503729, + 2.178744003176689, + 0.3179103583097458, + 1.5694902557879686, + 0.04026373103260994, + 0.6981300786137581, + 0.06756826117634773, + 0.22450422123074532, + 0.2989914696663618, + 1.6152202934026718, + 0.5855905823409557, + 0.5584421791136265, + 0.7121601961553097, + 1.5968619734048843, + 0.21097946725785732, + 0.3862977623939514, + 1.7238215450197458, + 1.9397489000111818, + 1.2796776294708252, + 0.8007539883255959, + 0.11699837818741798, + 1.7871293630450964, + 0.3456271458417177, + 3.252306953072548, + 0.771632008254528, + 0.4067977536469698, + 1.309496495872736, + 2.2679321877658367, + 0.3237859196960926, + 0.30823742039501667, + 1.6477659847587347, + 0.39531633630394936, + 0.7080751769244671, + 0.2598356120288372, + 0.6485017128288746, + 0.6774397492408752, + 0.6315405666828156, + 0.4225966576486826, + 0.4832981787621975, + 0.041278690099716187, + 1.4580152425915003, + 0.9398647025227547, + 0.7434941977262497, + 0.3321921806782484, + 1.0413034483790398, + 0.07429520413279533, + 0.27098406851291656, + 0.4372301306575537, + 1.218356465920806, + 1.8538987059146166, + 0.9239754192531109, + 1.6519899554550648, + 1.3779276199638844, + 1.7889282740652561, + 0.19239601865410805, + 0.6080749239772558, + 1.156024033203721, + 0.06610511243343353, + 1.250566516071558, + 1.9512857347726822, + 0.5504842456430197 + ], + "unique_experts": 63, + "load_cv": 0.6065823466989118, + "normalized_load_entropy": 0.9555071943869788, + "max_load_share": 0.052564102564102565 + }, + "full_input": { + "tokens": 155, + "top_k": 6, + "decisions": 930, + "ordered_route_sha256": "d38008dcdf44a5923a701894158f662638523f5ec017fc4fa1b8c2f44da98904", + "route_weight_sha256": "5de2d82bf285bb6d9cfff6420434d6d60f629a38b384fea349995980e20ecc66", + "loads": [ + 7, + 15, + 22, + 20, + 27, + 8, + 26, + 9, + 9, + 8, + 8, + 9, + 24, + 15, + 15, + 9, + 19, + 6, + 10, + 24, + 25, + 20, + 19, + 6, + 13, + 10, + 41, + 16, + 7, + 20, + 23, + 10, + 6, + 19, + 14, + 15, + 7, + 9, + 9, + 10, + 8, + 15, + 11, + 24, + 12, + 11, + 22, + 11, + 8, + 16, + 10, + 14, + 21, + 17, + 21, + 20, + 13, + 6, + 10, + 18, + 8, + 16, + 17, + 12 + ], + "weighted_loads": [ + 0.9917403422296047, + 0.8094696681946516, + 1.4448688961565495, + 1.0463817287236452, + 2.2469751702737994, + 0.3656161464750767, + 1.6386618707329035, + 1.22482855245471, + 0.6981300786137581, + 0.4907927841413766, + 0.29725203290581703, + 0.2998685546917841, + 1.6156960242951754, + 0.9465102516114712, + 1.2309958413243294, + 0.7121601961553097, + 1.5968619734048843, + 0.21097946725785732, + 0.3862977623939514, + 1.7238215450197458, + 1.9666582606732845, + 1.6523549556732178, + 1.3025057017803192, + 0.17542319931089878, + 1.7871293630450964, + 0.34615553030744195, + 3.252306953072548, + 0.9959984291344881, + 0.4067977536469698, + 1.500983640551567, + 2.3144538775086403, + 0.3237859196960926, + 0.30823742039501667, + 1.6477659847587347, + 1.3907294049859047, + 0.7080751769244671, + 0.2598356120288372, + 0.6485017128288746, + 0.6774397492408752, + 0.6315405666828156, + 0.4225966576486826, + 0.4832981787621975, + 0.668879359960556, + 1.4939378816634417, + 0.9398647025227547, + 0.898560494184494, + 2.0011261124163866, + 1.0413034483790398, + 0.7630305998027325, + 0.885617833584547, + 0.4372301306575537, + 1.218356465920806, + 1.8538987059146166, + 0.9239754192531109, + 2.757454078644514, + 1.5183047838509083, + 1.7889282740652561, + 0.19239601865410805, + 0.6916990671306849, + 1.156024033203721, + 0.4872650410979986, + 1.250566516071558, + 2.2758920937776566, + 0.6213165167719126 + ], + "unique_experts": 64, + "load_cv": 0.4651479176240321, + "normalized_load_entropy": 0.975658000387866, + "max_load_share": 0.04408602150537634 + } + }, + "s1_period": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "0346eaedc15184db40db2598c1bb5284467f3c4c585e7a00d0ad693caa67a51e", + "route_weight_sha256": "3ebdf446c602d07e725fdca704800122f590d416e2f5a29b35bee4b56af53ebb", + "loads": [ + 0, + 14, + 24, + 7, + 23, + 8, + 24, + 2, + 10, + 2, + 7, + 11, + 22, + 10, + 8, + 9, + 19, + 5, + 12, + 24, + 24, + 13, + 12, + 4, + 13, + 7, + 40, + 10, + 8, + 16, + 21, + 10, + 6, + 18, + 7, + 14, + 8, + 9, + 10, + 10, + 8, + 16, + 1, + 23, + 12, + 8, + 7, + 11, + 2, + 6, + 9, + 13, + 20, + 16, + 19, + 18, + 12, + 5, + 8, + 19, + 5, + 16, + 13, + 12 + ], + "weighted_loads": [ + 0.0, + 0.6484623625874519, + 1.4902037978172302, + 0.2981827091425657, + 2.0878694225102663, + 0.3703509699553251, + 1.5265433471649885, + 0.07593976333737373, + 0.7376008611172438, + 0.06912150979042053, + 0.2513718940317631, + 0.3890709653496742, + 1.5879176445305347, + 0.5572494603693485, + 0.576903710141778, + 0.7239674534648657, + 1.5744643844664097, + 0.1772114783525467, + 0.42717839404940605, + 1.7621715404093266, + 1.9429951533675194, + 1.1319583170115948, + 0.8031172007322311, + 0.11415999382734299, + 1.7531927302479744, + 0.2928563691675663, + 3.2719238512218, + 0.7818479165434837, + 0.4391098078340292, + 1.3170852679759264, + 2.2301802299916744, + 0.33040726743638515, + 0.32234690710902214, + 1.614995053038001, + 0.4199952632188797, + 0.6842652373015881, + 0.2885438036173582, + 0.6708037257194519, + 0.7053016647696495, + 0.6156249344348907, + 0.4373837560415268, + 0.5012334678322077, + 0.04787101224064827, + 1.4184309858828783, + 0.924120120704174, + 0.7413832098245621, + 0.32834893465042114, + 1.0603874735534191, + 0.07622095569968224, + 0.27300814166665077, + 0.4588020592927933, + 1.1706885732710361, + 1.868646778166294, + 0.8963597994297743, + 1.6844607964158058, + 1.393653217703104, + 1.7739631719887257, + 0.1709996610879898, + 0.574263259768486, + 1.2095172330737114, + 0.13638386875391006, + 1.2661535050719976, + 1.881726648658514, + 0.6281712427735329 + ], + "unique_experts": 63, + "load_cv": 0.587196282370932, + "normalized_load_entropy": 0.9586159777620972, + "max_load_share": 0.05128205128205128 + }, + "full_input": { + "tokens": 171, + "top_k": 6, + "decisions": 1026, + "ordered_route_sha256": "62d640e6868a93e123e0ce0af45ad00e05fd59b7b89fdf36d48619cdc5a0787c", + "route_weight_sha256": "6365258cc254c16710db45491ad019a6d5f27077ffef5fbeb55eafd69306de61", + "loads": [ + 10, + 17, + 24, + 20, + 25, + 12, + 25, + 13, + 10, + 11, + 10, + 12, + 25, + 15, + 17, + 10, + 21, + 5, + 13, + 24, + 25, + 20, + 24, + 5, + 15, + 9, + 40, + 13, + 8, + 20, + 22, + 10, + 6, + 20, + 14, + 14, + 8, + 14, + 10, + 11, + 9, + 16, + 17, + 26, + 12, + 14, + 24, + 11, + 10, + 16, + 9, + 19, + 23, + 21, + 23, + 24, + 12, + 5, + 17, + 20, + 17, + 17, + 18, + 19 + ], + "weighted_loads": [ + 1.314295545220375, + 0.8313033077865839, + 1.4902037978172302, + 1.1069249380379915, + 2.1253768520546146, + 0.5463551171123981, + 1.5685935001820326, + 1.3420267086476088, + 0.7376008611172438, + 0.6448654711712152, + 0.33684965781867504, + 0.3899480503750965, + 1.6690407285059337, + 0.9796552732586861, + 1.4189491253346205, + 0.7729602884501219, + 1.78835916146636, + 0.1772114783525467, + 0.48297108709812164, + 1.7621715404093266, + 1.975062821060419, + 1.5811144970357418, + 1.8268901519477367, + 0.14847379177808762, + 1.8567345924675465, + 0.34151824237778783, + 3.2719238512218, + 0.8784332405775785, + 0.4391098078340292, + 1.498078627511859, + 2.2717024497687817, + 0.33040726743638515, + 0.32234690710902214, + 1.6878220308572054, + 1.2944917306303978, + 0.6842652373015881, + 0.2885438036173582, + 1.08527322858572, + 0.7053016647696495, + 0.6660450585186481, + 0.5129918158054352, + 0.5012334678322077, + 0.8756943363696337, + 1.5241575222462416, + 0.924120120704174, + 1.165939349681139, + 2.5472885258495808, + 1.0603874735534191, + 1.0573582146316767, + 0.7375947050750256, + 0.4588020592927933, + 1.9494726806879044, + 2.070123355835676, + 1.6100044827908278, + 2.8090532906353474, + 1.7469166945666075, + 1.7739631719887257, + 0.1709996610879898, + 1.1473975218832493, + 1.2401997447013855, + 0.8501489423215389, + 1.3165010046213865, + 2.294568881392479, + 1.0722686536610126 + ], + "unique_experts": 64, + "load_cv": 0.41155540605686963, + "normalized_load_entropy": 0.9797789334363058, + "max_load_share": 0.03898635477582846 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 130, + "ordered_topk_exact_tokens": 102, + "set_exact_tokens": 112, + "mean_set_jaccard": 0.9604395604395605, + "mean_token_weighted_tv": 0.007134690092733273, + "aggregate_load_tv": 0.015384615384615385 + }, + "system_bos": { + "tokens": 130, + "ordered_topk_exact_tokens": 86, + "set_exact_tokens": 98, + "mean_set_jaccard": 0.9296703296703297, + "mean_token_weighted_tv": 0.013885662317849122, + "aggregate_load_tv": 0.02564102564102564 + }, + "system_x": { + "tokens": 130, + "ordered_topk_exact_tokens": 80, + "set_exact_tokens": 95, + "mean_set_jaccard": 0.9230769230769231, + "mean_token_weighted_tv": 0.016008192852426033, + "aggregate_load_tv": 0.02435897435897436 + }, + "system_period": { + "tokens": 130, + "ordered_topk_exact_tokens": 75, + "set_exact_tokens": 90, + "mean_set_jaccard": 0.9120879120879122, + "mean_token_weighted_tv": 0.01709763018700939, + "aggregate_load_tv": 0.029487179487179487 + }, + "bos_at_s0": { + "tokens": 130, + "ordered_topk_exact_tokens": 81, + "set_exact_tokens": 91, + "mean_set_jaccard": 0.9109890109890111, + "mean_token_weighted_tv": 0.018928755411448388, + "aggregate_load_tv": 0.03076923076923077 + }, + "bos_at_s1": { + "tokens": 130, + "ordered_topk_exact_tokens": 73, + "set_exact_tokens": 85, + "mean_set_jaccard": 0.8978021978021977, + "mean_token_weighted_tv": 0.020874950239578118, + "aggregate_load_tv": 0.028205128205128202 + }, + "x_at_s0": { + "tokens": 130, + "ordered_topk_exact_tokens": 78, + "set_exact_tokens": 90, + "mean_set_jaccard": 0.9104395604395604, + "mean_token_weighted_tv": 0.018133516910557562, + "aggregate_load_tv": 0.032051282051282055 + }, + "x_at_s1": { + "tokens": 130, + "ordered_topk_exact_tokens": 74, + "set_exact_tokens": 88, + "mean_set_jaccard": 0.9060439560439559, + "mean_token_weighted_tv": 0.02049601706317984, + "aggregate_load_tv": 0.02948717948717949 + }, + "period_at_s0": { + "tokens": 130, + "ordered_topk_exact_tokens": 78, + "set_exact_tokens": 90, + "mean_set_jaccard": 0.9087912087912089, + "mean_token_weighted_tv": 0.018333091035198708, + "aggregate_load_tv": 0.03076923076923077 + }, + "period_at_s1": { + "tokens": 130, + "ordered_topk_exact_tokens": 78, + "set_exact_tokens": 90, + "mean_set_jaccard": 0.9104395604395604, + "mean_token_weighted_tv": 0.02005062078913817, + "aggregate_load_tv": 0.02948717948717949 + } + } + }, + "layer_04": { + "layer": 4, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "011669e0d33c95fefea50bd8434a04fbac95234a6861dae48b6945486f495fc6", + "route_weight_sha256": "55ee9ddd60b9e1df73b5a73f19cfd3f7161db6d805a908e244f7c1d1ba2a1403", + "loads": [ + 12, + 8, + 4, + 7, + 20, + 8, + 11, + 44, + 26, + 16, + 10, + 26, + 5, + 3, + 5, + 13, + 13, + 18, + 6, + 16, + 7, + 9, + 17, + 15, + 5, + 1, + 4, + 5, + 4, + 11, + 18, + 27, + 20, + 5, + 1, + 6, + 9, + 5, + 20, + 17, + 29, + 11, + 2, + 12, + 10, + 7, + 10, + 27, + 20, + 6, + 12, + 8, + 17, + 15, + 15, + 12, + 8, + 19, + 6, + 6, + 2, + 19, + 17, + 13 + ], + "weighted_loads": [ + 0.8594491481781006, + 0.34455242939293385, + 0.12342716194689274, + 0.41144759953022003, + 2.0349057875573635, + 0.4889424964785576, + 0.6599567905068398, + 3.9214756172150373, + 2.0621564276516438, + 1.098339043557644, + 0.8566348403692245, + 1.1406116634607315, + 0.23611614480614662, + 0.14631330221891403, + 0.16541367955505848, + 0.9779754392802715, + 1.5800549276173115, + 1.310763269662857, + 0.2844216749072075, + 1.1352684814482927, + 0.5172033756971359, + 0.4966089278459549, + 1.2596445307135582, + 1.139946836978197, + 0.2496081069111824, + 0.03775809705257416, + 0.20578572899103165, + 0.21996504440903664, + 0.2451680228114128, + 0.5087197162210941, + 1.3456076234579086, + 1.7379519324749708, + 1.9921515192836523, + 0.2118007056415081, + 0.058334916830062866, + 0.2435073610395193, + 0.4865490961819887, + 0.2741297110915184, + 1.5981474220752716, + 1.522204663604498, + 2.488133117556572, + 0.6545283012092113, + 0.16154780611395836, + 0.9564492851495743, + 0.43449727818369865, + 0.2758601177483797, + 0.46312411688268185, + 2.182545367628336, + 0.680718120187521, + 0.23298773355782032, + 0.7690285220742226, + 0.4112416673451662, + 1.6287728399038315, + 1.1425389498472214, + 0.9879033043980598, + 0.6730415523052216, + 0.5156797356903553, + 1.3758472688496113, + 0.3768264353275299, + 0.4606715962290764, + 0.10910317674279213, + 1.1171633563935757, + 1.4081196337938309, + 0.6545797679573298 + ], + "unique_experts": 64, + "load_cv": 0.6568708320064367, + "normalized_load_entropy": 0.9508963519147985, + "max_load_share": 0.05641025641025641 + }, + "full_input": { + "tokens": 155, + "top_k": 6, + "decisions": 930, + "ordered_route_sha256": "78576b839e3caeeb31bff2038ccf73419d166c40ad809f2386fac26d83487716", + "route_weight_sha256": "e31c16d9bb0b83a8c1c629a2055faf7208081471b12b90763957d4355c65d0e6", + "loads": [ + 12, + 11, + 7, + 11, + 20, + 8, + 12, + 44, + 26, + 16, + 20, + 28, + 5, + 16, + 7, + 16, + 13, + 18, + 10, + 16, + 7, + 11, + 19, + 15, + 5, + 7, + 9, + 6, + 5, + 29, + 18, + 29, + 20, + 8, + 11, + 6, + 9, + 8, + 21, + 17, + 32, + 13, + 10, + 12, + 10, + 8, + 22, + 27, + 21, + 9, + 13, + 8, + 17, + 15, + 15, + 12, + 8, + 19, + 6, + 18, + 7, + 19, + 20, + 13 + ], + "weighted_loads": [ + 0.8594491481781006, + 0.5135294441133738, + 0.28627648763358593, + 0.7221429066848941, + 2.0349057875573635, + 0.4889424964785576, + 0.7166302278637886, + 3.9214756172150373, + 2.0621564276516438, + 1.098339043557644, + 1.5146955456584692, + 1.1671359622851014, + 0.23611614480614662, + 1.0746956206858158, + 0.21193108335137367, + 1.1725012958049774, + 1.5800549276173115, + 1.310763269662857, + 0.5138459495792631, + 1.1352684814482927, + 0.5172033756971359, + 1.5619501918554306, + 1.3897910043597221, + 1.139946836978197, + 0.2496081069111824, + 0.4800298400223255, + 0.6918286755681038, + 0.2279142076149583, + 0.2780436649918556, + 1.8158166984503623, + 1.3456076234579086, + 1.7688757125288248, + 1.9921515192836523, + 0.2977322293445468, + 1.0498217129497789, + 0.2435073610395193, + 0.4865490961819887, + 0.5293634943664074, + 2.5948579609394073, + 1.522204663604498, + 2.6281351409852505, + 0.7820765040814877, + 0.5202639196068048, + 0.9564492851495743, + 0.43449727818369865, + 0.30593290366232395, + 1.6682379562407732, + 2.182545367628336, + 0.7174887582659721, + 0.35284202732145786, + 0.8156972266733646, + 0.4112416673451662, + 1.6287728399038315, + 1.1425389498472214, + 0.9879033043980598, + 0.6730415523052216, + 0.5156797356903553, + 1.3758472688496113, + 0.3768264353275299, + 1.1160701140761375, + 0.5373578446742613, + 1.1171633563935757, + 1.626186776906252, + 0.6545797679573298 + ], + "unique_experts": 64, + "load_cv": 0.5236680575306979, + "normalized_load_entropy": 0.9698253316652214, + "max_load_share": 0.047311827956989246 + } + }, + "s1_eos": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "b235d11225aec000c8177fddd98b608db73b5144e0120be6d44fae88a610c335", + "route_weight_sha256": "8a265bbdff0426c8d5a4ca6c7ca49c5e3754ef0c2eb5dcb8abbcde19a439a935", + "loads": [ + 12, + 8, + 5, + 7, + 20, + 8, + 11, + 44, + 26, + 16, + 10, + 26, + 5, + 3, + 4, + 13, + 13, + 18, + 5, + 16, + 7, + 9, + 17, + 15, + 6, + 1, + 4, + 5, + 4, + 12, + 18, + 25, + 20, + 6, + 1, + 5, + 10, + 6, + 20, + 17, + 29, + 11, + 2, + 12, + 10, + 7, + 11, + 27, + 18, + 6, + 11, + 8, + 17, + 17, + 14, + 12, + 8, + 19, + 6, + 6, + 2, + 19, + 17, + 13 + ], + "weighted_loads": [ + 0.8547309935092926, + 0.3428620621562004, + 0.15579471178352833, + 0.4041777178645134, + 2.0321920588612556, + 0.48026643320918083, + 0.6644668839871883, + 3.9068131800740957, + 2.0728701762855053, + 1.106430683284998, + 0.8676392249763012, + 1.1361350752413273, + 0.2390654142946005, + 0.1417703814804554, + 0.1307878252118826, + 0.991230309009552, + 1.584873490035534, + 1.310441356152296, + 0.24532945081591606, + 1.162877468392253, + 0.5146243721246719, + 0.4929010905325413, + 1.2414810918271542, + 1.1441919170320034, + 0.2807438261806965, + 0.03821822255849838, + 0.20693593844771385, + 0.21818476542830467, + 0.24482537433505058, + 0.5558346621692181, + 1.3309094049036503, + 1.6533598490059376, + 1.9729457441717386, + 0.2475469373166561, + 0.060735564678907394, + 0.21277821622788906, + 0.5327675249427557, + 0.31829364597797394, + 1.5664923712611198, + 1.5299122519791126, + 2.502804894000292, + 0.6499933637678623, + 0.1612233705818653, + 0.9567634761333466, + 0.4326567258685827, + 0.28180781938135624, + 0.4951186515390873, + 2.1737471632659435, + 0.6163904722779989, + 0.23237839341163635, + 0.7220717445015907, + 0.40083196572959423, + 1.6077302731573582, + 1.2041173223406076, + 0.9435942247509956, + 0.6719162911176682, + 0.5192141197621822, + 1.3660056423395872, + 0.3767913281917572, + 0.4526844322681427, + 0.10800528153777122, + 1.1101483423262835, + 1.4200479239225388, + 0.664454398676753 + ], + "unique_experts": 64, + "load_cv": 0.6493004377898843, + "normalized_load_entropy": 0.9518916068340517, + "max_load_share": 0.05641025641025641 + }, + "full_input": { + "tokens": 171, + "top_k": 6, + "decisions": 1026, + "ordered_route_sha256": "8cb9253a1e9f7363eb4cd9d55cbab7fc1b2af63636a8ec340565a8f12cb52fd2", + "route_weight_sha256": "75f32eff83fdbc5efdcfadcbe7ec8158dc6a944e8bb0e3fe045c96d3e1217e5b", + "loads": [ + 12, + 10, + 9, + 16, + 20, + 8, + 14, + 44, + 26, + 24, + 19, + 28, + 6, + 17, + 7, + 17, + 15, + 20, + 12, + 18, + 8, + 12, + 22, + 16, + 6, + 11, + 12, + 6, + 4, + 33, + 18, + 27, + 20, + 9, + 16, + 5, + 11, + 11, + 23, + 20, + 32, + 16, + 11, + 12, + 12, + 9, + 22, + 31, + 18, + 10, + 13, + 8, + 21, + 21, + 20, + 12, + 13, + 21, + 6, + 19, + 10, + 21, + 21, + 15 + ], + "weighted_loads": [ + 0.8547309935092926, + 0.48726530373096466, + 0.36624125204980373, + 1.1775103789404966, + 2.0321920588612556, + 0.48026643320918083, + 0.8769914582371712, + 3.9068131800740957, + 2.0728701762855053, + 2.147830333560705, + 1.45790521427989, + 1.1626137467101216, + 0.34503469429910183, + 1.1277096830308437, + 0.20548448525369167, + 1.264441817998886, + 1.949668474495411, + 1.381248127669096, + 0.8061805600882508, + 1.2529291082173586, + 0.5639483295381069, + 1.5883125215768814, + 1.662473376840353, + 1.2380970008671284, + 0.2807438261806965, + 0.7549657821655273, + 0.9742251373827457, + 0.226473493501544, + 0.24482537433505058, + 1.776161989197135, + 1.3309094049036503, + 1.6840023817494512, + 1.9729457441717386, + 0.33611221611499786, + 1.4061170753557235, + 0.21277821622788906, + 0.5600124932825565, + 0.6473998185247183, + 2.75334469974041, + 1.7411368116736412, + 2.6624304205179214, + 0.8757871453271946, + 0.5928266681730747, + 0.9567634761333466, + 0.502112815156579, + 0.3124584226461593, + 1.7475950382649899, + 2.5114610493183136, + 0.6163904722779989, + 0.39039198867976665, + 0.8147007972002029, + 0.40083196572959423, + 2.0432529412209988, + 1.3864642698317766, + 1.495625153183937, + 0.6719162911176682, + 0.9450334571301937, + 1.4395977333188057, + 0.3767913281917572, + 1.1920090410858393, + 1.013604685664177, + 1.30563292093575, + 1.711421400308609, + 0.7402909584343433 + ], + "unique_experts": 64, + "load_cv": 0.47875100799197595, + "normalized_load_entropy": 0.9736121993705005, + "max_load_share": 0.042884990253411304 + } + }, + "s0_bos": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "8f141fa0291c2ffdb4b6588e928936f4119dbb939170293392101c92728f57a7", + "route_weight_sha256": "dce20174765ead2b22f168164e9ca2b663e648bb43d57a55ff9edd88d9a41c11", + "loads": [ + 12, + 7, + 4, + 8, + 19, + 8, + 11, + 45, + 24, + 14, + 10, + 24, + 4, + 3, + 5, + 12, + 13, + 18, + 6, + 16, + 7, + 11, + 17, + 15, + 5, + 2, + 4, + 5, + 4, + 9, + 18, + 28, + 19, + 5, + 0, + 4, + 11, + 4, + 20, + 17, + 28, + 13, + 2, + 13, + 12, + 7, + 10, + 27, + 19, + 7, + 12, + 11, + 17, + 16, + 16, + 12, + 8, + 20, + 5, + 6, + 2, + 17, + 20, + 12 + ], + "weighted_loads": [ + 0.8684551753103733, + 0.32030926644802094, + 0.13470041938126087, + 0.4673415720462799, + 1.963961560279131, + 0.4935585483908653, + 0.6930832080543041, + 4.0201765187084675, + 1.9602505303919315, + 1.0285885781049728, + 0.8616061471402645, + 1.0696375593543053, + 0.20797991007566452, + 0.14824189618229866, + 0.15986455418169498, + 0.9734674319624901, + 1.5681664496660233, + 1.318204753100872, + 0.2719682715833187, + 1.1738110817968845, + 0.5247310381382704, + 0.5738884396851063, + 1.2468779422342777, + 1.1008883975446224, + 0.2511165589094162, + 0.0623637530952692, + 0.20880188792943954, + 0.2055317424237728, + 0.23464681580662727, + 0.3823179006576538, + 1.352604679763317, + 1.8481340873986483, + 1.9418445713818073, + 0.21996331214904785, + 0.0, + 0.17662444338202477, + 0.575434198603034, + 0.24607418477535248, + 1.6323052234947681, + 1.5166804902255535, + 2.3947679065167904, + 0.7223704718053341, + 0.1655127890408039, + 1.039202693849802, + 0.49209174513816833, + 0.27874025516211987, + 0.45266338996589184, + 2.207211583852768, + 0.6501923874020576, + 0.27042449824512005, + 0.7938754893839359, + 0.5068469755351543, + 1.5909901969134808, + 1.1764282137155533, + 1.0571635942906141, + 0.6792226880788803, + 0.5182330273091793, + 1.4599167369306087, + 0.3380351662635803, + 0.5041043851524591, + 0.10922213643789291, + 1.0214261952787638, + 1.5388566497713327, + 0.6256833337247372 + ], + "unique_experts": 63, + "load_cv": 0.6552674346508244, + "normalized_load_entropy": 0.9503093284639723, + "max_load_share": 0.057692307692307696 + }, + "full_input": { + "tokens": 155, + "top_k": 6, + "decisions": 930, + "ordered_route_sha256": "b9c5119917eb20d2498db7692a88a0b4895b59371d589ff059bebee4e686eb29", + "route_weight_sha256": "c34337fefc538a7b602976ddb1c8c7ce3cc4ec245685c0f8d60095f3d00051a8", + "loads": [ + 12, + 10, + 7, + 13, + 19, + 8, + 12, + 45, + 24, + 14, + 20, + 25, + 4, + 16, + 7, + 15, + 13, + 18, + 11, + 16, + 7, + 12, + 19, + 15, + 5, + 8, + 9, + 5, + 5, + 28, + 18, + 29, + 19, + 7, + 11, + 4, + 11, + 7, + 22, + 17, + 31, + 15, + 10, + 13, + 12, + 8, + 22, + 27, + 20, + 9, + 13, + 11, + 17, + 16, + 16, + 12, + 8, + 20, + 5, + 18, + 8, + 17, + 23, + 12 + ], + "weighted_loads": [ + 0.8684551753103733, + 0.4842814430594444, + 0.2977576721459627, + 0.8155512118828483, + 1.963961560279131, + 0.4935585483908653, + 0.7457110397517681, + 4.0201765187084675, + 1.9602505303919315, + 1.0285885781049728, + 1.5196668524295092, + 1.0867122188210487, + 0.20797991007566452, + 1.0640711523592472, + 0.20638195797801018, + 1.167202666401863, + 1.5681664496660233, + 1.318204753100872, + 0.634406919736648, + 1.1738110817968845, + 0.5247310381382704, + 0.8635275848209858, + 1.3700403459370136, + 1.1008883975446224, + 0.2511165589094162, + 0.5118951592594385, + 0.7109630256891251, + 0.2055317424237728, + 0.26849446073174477, + 1.844907073158538, + 1.352604679763317, + 1.8665272649377584, + 1.9418445713818073, + 0.2947257589548826, + 1.0624416479258798, + 0.17662444338202477, + 0.575434198603034, + 0.5137303732335567, + 2.6595441829413176, + 1.5166804902255535, + 2.534769929945469, + 0.8506451584398746, + 0.5242289025336504, + 1.039202693849802, + 0.49209174513816833, + 0.3088130410760641, + 1.65607694350183, + 2.207211583852768, + 0.6869630254805088, + 0.3655584864318371, + 0.840544193983078, + 0.5068469755351543, + 1.5909901969134808, + 1.1764282137155533, + 1.0571635942906141, + 0.6792226880788803, + 0.5182330273091793, + 1.4599167369306087, + 0.3380351662635803, + 1.1612754333764315, + 0.7545918824907858, + 1.0214261952787638, + 1.7634123992174864, + 0.6256833337247372 + ], + "unique_experts": 64, + "load_cv": 0.5178421390544228, + "normalized_load_entropy": 0.9700161415863786, + "max_load_share": 0.04838709677419355 + } + }, + "s1_bos": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "1758465ca42598b7c870d5fc5f8ad9a69316796b24300a5bf71eec51aa65fa18", + "route_weight_sha256": "bf781fdba5d59ae2faf453b191e104d0a089a83ba7245acb3f6d80603cd052a8", + "loads": [ + 11, + 8, + 6, + 8, + 19, + 8, + 12, + 44, + 25, + 14, + 10, + 23, + 4, + 3, + 6, + 12, + 13, + 18, + 6, + 17, + 7, + 10, + 17, + 15, + 4, + 1, + 4, + 5, + 7, + 9, + 18, + 28, + 19, + 6, + 0, + 4, + 11, + 5, + 20, + 17, + 29, + 14, + 2, + 13, + 13, + 7, + 9, + 27, + 13, + 7, + 11, + 10, + 17, + 18, + 15, + 13, + 8, + 18, + 5, + 5, + 2, + 17, + 21, + 12 + ], + "weighted_loads": [ + 0.8378586433827877, + 0.34148284420371056, + 0.19184826128184795, + 0.4534205198287964, + 1.9421978183090687, + 0.49064308032393456, + 0.7322629615664482, + 4.036294775083661, + 2.0065465569496155, + 1.049373921006918, + 0.8946022018790245, + 1.0285934172570705, + 0.21262835711240768, + 0.14196691289544106, + 0.19209703244268894, + 0.9961176477372646, + 1.586861688643694, + 1.332317154854536, + 0.26717211306095123, + 1.2159021124243736, + 0.5130842439830303, + 0.539756502956152, + 1.2216784730553627, + 1.1043068133294582, + 0.21151697635650635, + 0.036095909774303436, + 0.20461616665124893, + 0.2002819012850523, + 0.3681284487247467, + 0.3606327008455992, + 1.3452016562223434, + 1.7995782792568207, + 1.9319666102528572, + 0.24754926562309265, + 0.0, + 0.161638755351305, + 0.58784618973732, + 0.2783152926713228, + 1.5610760860145092, + 1.534318532794714, + 2.4230239000171423, + 0.7353156469762325, + 0.15671150386333466, + 1.0531452856957912, + 0.5172572080045938, + 0.2789693456143141, + 0.44300715811550617, + 2.176383711397648, + 0.4283019732683897, + 0.27451054006814957, + 0.7689475379884243, + 0.48305533453822136, + 1.5975062623620033, + 1.2428769059479237, + 1.026926239952445, + 0.70594297721982, + 0.5155252888798714, + 1.3834405019879341, + 0.3372694402933121, + 0.44660715013742447, + 0.10887395590543747, + 1.0196728855371475, + 1.578904328867793, + 0.6207186933606863 + ], + "unique_experts": 63, + "load_cv": 0.6457263543133672, + "normalized_load_entropy": 0.9516263779328464, + "max_load_share": 0.05641025641025641 + }, + "full_input": { + "tokens": 171, + "top_k": 6, + "decisions": 1026, + "ordered_route_sha256": "bdfa59291e23ce4b6082f2e5b0bbf35c91cfef74adb06e657401dbeeaee6dbbf", + "route_weight_sha256": "6d99c624411161a3fa1ef918a66937f0bfac61dc38703cceb5cc0b2ad42100d2", + "loads": [ + 11, + 10, + 10, + 18, + 20, + 8, + 15, + 44, + 25, + 22, + 19, + 24, + 5, + 17, + 9, + 16, + 15, + 20, + 14, + 19, + 8, + 12, + 22, + 16, + 4, + 11, + 12, + 5, + 8, + 30, + 18, + 29, + 19, + 8, + 15, + 4, + 12, + 10, + 23, + 20, + 32, + 19, + 11, + 13, + 15, + 9, + 21, + 31, + 13, + 10, + 13, + 10, + 21, + 22, + 21, + 13, + 13, + 20, + 5, + 18, + 11, + 19, + 25, + 14 + ], + "weighted_loads": [ + 0.8378586433827877, + 0.4809076748788357, + 0.40338904969394207, + 1.2536377329961397, + 1.9765206724405289, + 0.49064308032393456, + 0.9266296252608299, + 4.036294775083661, + 2.0065465569496155, + 2.090773571282625, + 1.4848681911826134, + 1.045668076723814, + 0.318597637116909, + 1.1098252795636654, + 0.266793692484498, + 1.2793879210948944, + 1.951656673103571, + 1.403123926371336, + 0.9466288509429432, + 1.3059537522494793, + 0.5624082013964653, + 0.8698017373681068, + 1.6243632920086384, + 1.1982118971645832, + 0.21151697635650635, + 0.7250861898064613, + 0.9905497506260872, + 0.2002819012850523, + 0.40227482095360756, + 1.621486734598875, + 1.3452016562223434, + 1.8179714567959309, + 1.9319666102528572, + 0.32511343620717525, + 1.331823029788211, + 0.161638755351305, + 0.6150911580771208, + 0.624140053987503, + 2.747928414493799, + 1.7455430924892426, + 2.582649426534772, + 0.9631776128517231, + 0.5883148014545441, + 1.0531452856957912, + 0.5867132972925901, + 0.30961994887911715, + 1.7412915658205748, + 2.514097597450018, + 0.4283019732683897, + 0.4098183009773493, + 0.8615765906870365, + 0.48305533453822136, + 2.033028930425644, + 1.4252238534390926, + 1.5789571683853865, + 0.70594297721982, + 0.9413446262478828, + 1.4570325929671526, + 0.3372694402933121, + 1.1866744365543127, + 1.2175031416118145, + 1.215157464146614, + 1.8887587431818247, + 0.695531327277422 + ], + "unique_experts": 64, + "load_cv": 0.46783219621369265, + "normalized_load_entropy": 0.9744829257737428, + "max_load_share": 0.042884990253411304 + } + }, + "s0_x": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "781643bc0496905f7bf81ac1d1d603d73e876bdf41da0412aabe19b462baf788", + "route_weight_sha256": "3a7d5833cbe01debae1851e3e2a4a4d1f80224d3f84e9c3156fcc2fbb45bd7e7", + "loads": [ + 12, + 7, + 3, + 8, + 19, + 8, + 13, + 41, + 25, + 14, + 10, + 22, + 4, + 3, + 7, + 13, + 13, + 18, + 6, + 16, + 7, + 11, + 17, + 15, + 5, + 2, + 4, + 6, + 5, + 9, + 18, + 27, + 20, + 7, + 0, + 4, + 10, + 4, + 20, + 17, + 29, + 14, + 2, + 13, + 12, + 6, + 9, + 27, + 18, + 7, + 13, + 11, + 17, + 14, + 15, + 13, + 8, + 20, + 6, + 6, + 1, + 17, + 20, + 12 + ], + "weighted_loads": [ + 0.8736486732959747, + 0.29061366245150566, + 0.09958539716899395, + 0.48818548396229744, + 1.9634013697504997, + 0.4922507628798485, + 0.79054019972682, + 3.8069610502570868, + 2.001078102737665, + 1.0405231155455112, + 0.8881507962942123, + 0.9895911049097776, + 0.21175211295485497, + 0.1498332843184471, + 0.22842873819172382, + 0.9812179282307625, + 1.582776952534914, + 1.324754387140274, + 0.2908932715654373, + 1.1711282450705767, + 0.5259714126586914, + 0.5737935863435268, + 1.3203154802322388, + 1.1183210834860802, + 0.2502024210989475, + 0.06255453452467918, + 0.21005019173026085, + 0.2498495876789093, + 0.2812999449670315, + 0.3443258944898844, + 1.3756261318922043, + 1.771883212029934, + 1.9579820428043604, + 0.2763085197657347, + 0.0, + 0.18101192265748978, + 0.5336127690970898, + 0.23637888580560684, + 1.7070602588355541, + 1.5282325521111488, + 2.48752436414361, + 0.7684876993298531, + 0.15678101032972336, + 1.0308099910616875, + 0.4933305401355028, + 0.25037502869963646, + 0.4489473532885313, + 2.220222420990467, + 0.6187775898724794, + 0.26386670768260956, + 0.8263570629060268, + 0.5023658443242311, + 1.6741361767053604, + 1.121341023594141, + 1.0166962761431932, + 0.7198963835835457, + 0.5246560014784336, + 1.4655630551278591, + 0.37577158957719803, + 0.4853903129696846, + 0.07185506075620651, + 1.0149774122983217, + 1.5164096746593714, + 0.6160245630890131 + ], + "unique_experts": 63, + "load_cv": 0.6300600557873438, + "normalized_load_entropy": 0.9524939767435666, + "max_load_share": 0.052564102564102565 + }, + "full_input": { + "tokens": 155, + "top_k": 6, + "decisions": 930, + "ordered_route_sha256": "6a93a6c2ec524d1658cf30376e3296964468490ab2df938ff21b7bf964d2a0a4", + "route_weight_sha256": "f01a0d050f1ed527f3f69d2ec6c27b143061afebee1829f2a97c4159aadb6a7d", + "loads": [ + 12, + 11, + 7, + 12, + 20, + 8, + 13, + 41, + 25, + 14, + 21, + 23, + 4, + 15, + 9, + 16, + 13, + 18, + 10, + 16, + 7, + 12, + 19, + 15, + 5, + 8, + 9, + 6, + 6, + 24, + 18, + 28, + 20, + 9, + 9, + 4, + 10, + 7, + 21, + 17, + 33, + 16, + 11, + 13, + 12, + 7, + 23, + 27, + 20, + 9, + 14, + 11, + 17, + 14, + 15, + 13, + 8, + 20, + 6, + 19, + 6, + 17, + 23, + 14 + ], + "weighted_loads": [ + 0.8736486732959747, + 0.4996764734387398, + 0.29441675543785095, + 0.8029509166372009, + 1.996759183704853, + 0.4922507628798485, + 0.79054019972682, + 3.8069610502570868, + 2.001078102737665, + 1.0405231155455112, + 1.7625636961311102, + 1.006665764376521, + 0.21175211295485497, + 1.0268983654677868, + 0.274946141988039, + 1.1849846988916397, + 1.582776952534914, + 1.324754387140274, + 0.5108112684974913, + 1.1711282450705767, + 0.5259714126586914, + 0.8634327314794064, + 1.4623495489358902, + 1.1183210834860802, + 0.2502024210989475, + 0.44491448998451233, + 0.7503782920539379, + 0.2498495876789093, + 0.31545838341116905, + 1.5073283089732286, + 1.3756261318922043, + 1.7902763895690441, + 1.9579820428043604, + 0.3476800173521042, + 0.8357159206061624, + 0.18101192265748978, + 0.5336127690970898, + 0.4942384697496891, + 2.70377079769969, + 1.5282325521111488, + 2.684253666549921, + 0.8982107862830162, + 0.5510591100901365, + 1.0308099910616875, + 0.4933305401355028, + 0.2804478146135807, + 1.9034704100340605, + 2.220222420990467, + 0.6985654179006815, + 0.3608935531228781, + 0.8730257675051689, + 0.5023658443242311, + 1.6741361767053604, + 1.121341023594141, + 1.0166962761431932, + 0.7198963835835457, + 0.5246560014784336, + 1.4655630551278591, + 0.37577158957719803, + 1.2193169444799423, + 0.511964794510277, + 1.0149774122983217, + 1.7325606476515532, + 0.6722459141165018 + ], + "unique_experts": 64, + "load_cv": 0.49504890555616576, + "normalized_load_entropy": 0.9720756537679328, + "max_load_share": 0.04408602150537634 + } + }, + "s1_x": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "6498048bf2310338091fc5303e814fb64c32e50d59bf90e204cfd31b7d92465a", + "route_weight_sha256": "8b88785f225950fff6b60c57cedfb62e674ae5fb7399bc36937497bb76e84e90", + "loads": [ + 11, + 7, + 9, + 8, + 19, + 8, + 12, + 42, + 25, + 14, + 11, + 21, + 4, + 3, + 6, + 12, + 13, + 18, + 6, + 17, + 7, + 12, + 17, + 15, + 4, + 2, + 4, + 6, + 7, + 8, + 18, + 28, + 19, + 7, + 0, + 4, + 11, + 4, + 20, + 17, + 29, + 14, + 2, + 14, + 13, + 6, + 8, + 27, + 12, + 7, + 14, + 11, + 17, + 17, + 15, + 12, + 8, + 18, + 5, + 6, + 2, + 16, + 21, + 10 + ], + "weighted_loads": [ + 0.8299910500645638, + 0.29946217127144337, + 0.27418712712824345, + 0.4715662710368633, + 1.921965878456831, + 0.485465444624424, + 0.7409656830132008, + 3.882937639951706, + 2.0106232315301895, + 1.0519193522632122, + 0.9531379770487547, + 0.9567714165896177, + 0.21523495018482208, + 0.1413789503276348, + 0.1943477988243103, + 0.9920485690236092, + 1.5906534604728222, + 1.3313944302499294, + 0.2768567390739918, + 1.2118129637092352, + 0.5042504910379648, + 0.6029005106538534, + 1.2645392045378685, + 1.0967249646782875, + 0.20999545976519585, + 0.07225972041487694, + 0.2039111889898777, + 0.23427702113986015, + 0.3719228357076645, + 0.3131811488419771, + 1.3604834713041782, + 1.7719780579209328, + 1.9116299878805876, + 0.2700671683996916, + 0.0, + 0.16581984050571918, + 0.5812201928347349, + 0.24431610107421875, + 1.6059590615332127, + 1.5464325472712517, + 2.4627543557435274, + 0.7427142206579447, + 0.1537516787648201, + 1.1033790968358517, + 0.5155766103416681, + 0.24879827722907066, + 0.42146965488791466, + 2.1878269650042057, + 0.40244471840560436, + 0.2708992473781109, + 0.8875976949930191, + 0.5035428516566753, + 1.6675910465419292, + 1.2220072038471699, + 1.029702665284276, + 0.6891430802643299, + 0.5195350535213947, + 1.3931528013199568, + 0.32875629141926765, + 0.471329677850008, + 0.10568828880786896, + 0.9858433529734612, + 1.573807181790471, + 0.5464414022862911 + ], + "unique_experts": 63, + "load_cv": 0.627383030895498, + "normalized_load_entropy": 0.9539454977711226, + "max_load_share": 0.05384615384615385 + }, + "full_input": { + "tokens": 171, + "top_k": 6, + "decisions": 1026, + "ordered_route_sha256": "87457bffe56adc517d338b69c1afac216788da8ffebd129e46c52d050720b130", + "route_weight_sha256": "38139e36206e7e0b315cdd8deeaee79030ef4ffe6a60bc592e1af321ec8633aa", + "loads": [ + 11, + 10, + 14, + 17, + 20, + 8, + 14, + 42, + 25, + 22, + 21, + 22, + 5, + 16, + 9, + 16, + 15, + 20, + 13, + 19, + 8, + 14, + 22, + 16, + 4, + 12, + 12, + 6, + 8, + 27, + 18, + 29, + 19, + 9, + 14, + 4, + 13, + 9, + 23, + 20, + 33, + 19, + 12, + 14, + 15, + 8, + 21, + 31, + 12, + 10, + 16, + 11, + 21, + 21, + 21, + 12, + 13, + 20, + 5, + 20, + 10, + 18, + 25, + 12 + ], + "weighted_loads": [ + 0.8299910500645638, + 0.487111596390605, + 0.5224232282489538, + 1.2347211111919023, + 1.9510701335966587, + 0.485465444624424, + 0.8855435624718666, + 3.882937639951706, + 2.0106232315301895, + 2.0933190025389194, + 1.732869816944003, + 0.9738460760563612, + 0.3212042301893234, + 1.0688041634857655, + 0.2690444588661194, + 1.276641920208931, + 1.9554484449326992, + 1.4022012017667294, + 0.8029394904733635, + 1.3018646035343409, + 0.5535744484513998, + 0.9329457450658083, + 1.6736395470798016, + 1.1906300485134125, + 0.20999545976519585, + 0.7028817534446716, + 1.0125815235078335, + 0.23427702113986015, + 0.4060591086745262, + 1.4030236825346947, + 1.3604834713041782, + 1.790371235460043, + 1.9116299878805876, + 0.3510608822107315, + 1.1491759654600173, + 0.16581984050571918, + 0.6388894859701395, + 0.5893267076462507, + 2.7928113900125027, + 1.7576571069657803, + 2.6764929573982954, + 0.9704394087748369, + 0.6256611719727516, + 1.1033790968358517, + 0.5850326996296644, + 0.27944888049387373, + 1.9520439952611923, + 2.5255408510565758, + 0.40244471840560436, + 0.411521403118968, + 0.9802267476916313, + 0.5035428516566753, + 2.10311371460557, + 1.4043541513383389, + 1.5817335937172174, + 0.6891430802643299, + 0.9453543908894062, + 1.4667448922991753, + 0.32875629141926765, + 1.2796339970082045, + 0.9916194602847099, + 1.1813279315829277, + 1.8722115214914083, + 0.6239185556769371 + ], + "unique_experts": 64, + "load_cv": 0.45304341791942465, + "normalized_load_entropy": 0.9758259573667345, + "max_load_share": 0.04093567251461988 + } + }, + "s0_period": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "3cbf0228b89415cbcdce9cb579c1af3631a8b08518790e4bef558c0f6ac54a02", + "route_weight_sha256": "76072ffa96fe935cfecffba71606c7e1df186e4fadac938b7de3965941452394", + "loads": [ + 12, + 7, + 4, + 8, + 19, + 8, + 13, + 42, + 25, + 14, + 10, + 21, + 5, + 3, + 8, + 13, + 13, + 18, + 6, + 16, + 7, + 10, + 17, + 15, + 5, + 2, + 4, + 6, + 4, + 9, + 18, + 27, + 19, + 7, + 0, + 4, + 10, + 4, + 20, + 17, + 29, + 14, + 2, + 13, + 12, + 6, + 9, + 27, + 19, + 7, + 13, + 11, + 17, + 15, + 15, + 13, + 8, + 20, + 5, + 6, + 1, + 17, + 20, + 11 + ], + "weighted_loads": [ + 0.8749813847243786, + 0.31151435896754265, + 0.12973269633948803, + 0.4846239946782589, + 1.9529778100550175, + 0.48894065245985985, + 0.7859284617006779, + 3.8419212009757757, + 1.9974614456295967, + 1.0492549128830433, + 0.8835042342543602, + 0.9645213577896357, + 0.24320626445114613, + 0.15019036084413528, + 0.2638367433100939, + 0.9932555332779884, + 1.5730545669794083, + 1.3213353008031845, + 0.2948177307844162, + 1.1650252025574446, + 0.5150789637118578, + 0.5461568608880043, + 1.3015993535518646, + 1.1212159283459187, + 0.24919357150793076, + 0.07536979019641876, + 0.21142059937119484, + 0.247808575630188, + 0.24490262940526009, + 0.3424594383686781, + 1.3756203390657902, + 1.773126270622015, + 1.9078226536512375, + 0.28075595758855343, + 0.0, + 0.17870477586984634, + 0.5364649184048176, + 0.2416899912059307, + 1.6789774745702744, + 1.5247470140457153, + 2.4698621463030577, + 0.7618054654449224, + 0.1631610356271267, + 1.0320423692464828, + 0.4976034350693226, + 0.2480207122862339, + 0.44743036292493343, + 2.1971511393785477, + 0.6428316719830036, + 0.2695686034858227, + 0.8137467093765736, + 0.5051222071051598, + 1.6802093759179115, + 1.1559670232236385, + 1.0216594263911247, + 0.7192897368222475, + 0.5266114994883537, + 1.4591980688273907, + 0.3359612822532654, + 0.486631503328681, + 0.07001783698797226, + 1.0089709982275963, + 1.5335552040487528, + 0.5764130763709545 + ], + "unique_experts": 63, + "load_cv": 0.6328919878182817, + "normalized_load_entropy": 0.9524797635166583, + "max_load_share": 0.05384615384615385 + }, + "full_input": { + "tokens": 155, + "top_k": 6, + "decisions": 930, + "ordered_route_sha256": "bf4b0f0d48186dd9e37eeee1aead6aae6c92cbcd23e41032ef307afcfe7d7b2a", + "route_weight_sha256": "62460a627478365d936e92848709c3264ed86e2a4777cdb355c1a83a7616f12c", + "loads": [ + 12, + 11, + 7, + 12, + 20, + 8, + 13, + 42, + 25, + 14, + 20, + 22, + 5, + 15, + 10, + 16, + 13, + 18, + 10, + 16, + 7, + 11, + 20, + 15, + 5, + 8, + 10, + 6, + 5, + 26, + 18, + 28, + 19, + 9, + 9, + 4, + 10, + 7, + 21, + 17, + 32, + 16, + 10, + 13, + 12, + 7, + 22, + 27, + 21, + 9, + 14, + 12, + 18, + 15, + 15, + 13, + 8, + 20, + 5, + 19, + 6, + 17, + 23, + 12 + ], + "weighted_loads": [ + 0.8749813847243786, + 0.529434859752655, + 0.29309054277837276, + 0.8054485300672241, + 1.9845311231911182, + 0.48894065245985985, + 0.7859284617006779, + 3.8419212009757757, + 1.9974614456295967, + 1.0492549128830433, + 1.5415649395436049, + 0.9815960172563791, + 0.24320626445114613, + 1.0034598596394062, + 0.3103541471064091, + 1.1799557693302631, + 1.5730545669794083, + 1.3213353008031845, + 0.5213086746225599, + 1.1650252025574446, + 0.5150789637118578, + 0.8357960060238838, + 1.478770226240158, + 1.1212159283459187, + 0.24919357150793076, + 0.43995198979973793, + 1.0190461538732052, + 0.247808575630188, + 0.27912842854857445, + 1.5609700585191604, + 1.3756203390657902, + 1.7915194481611252, + 1.9078226536512375, + 0.3569568134844303, + 0.8312125512748025, + 0.17870477586984634, + 0.5364649184048176, + 0.5128737427294254, + 2.67568801343441, + 1.5247470140457153, + 2.609864169731736, + 0.889954736456275, + 0.5218771491199732, + 1.0320423692464828, + 0.4976034350693226, + 0.27809349820017815, + 1.816380375996232, + 2.1971511393785477, + 0.7337121404707432, + 0.3662193063646555, + 0.8604154139757156, + 0.6308418735861778, + 1.74551572650671, + 1.1559670232236385, + 1.0216594263911247, + 0.7192897368222475, + 0.5266114994883537, + 1.4591980688273907, + 0.3359612822532654, + 1.2271578181535006, + 0.514653612190159, + 1.0089709982275963, + 1.7495974097400904, + 0.6047157552093267 + ], + "unique_experts": 64, + "load_cv": 0.49832648597353413, + "normalized_load_entropy": 0.9717889625843312, + "max_load_share": 0.04516129032258064 + } + }, + "s1_period": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "603d4ef4158489f2a5384d73d210bda2e061459612a7278de05a9284ec3a5100", + "route_weight_sha256": "5990bcb7ac6d6b30e7be01c044cfc91ff7c1450eb490c4d691c8f08db1356781", + "loads": [ + 11, + 6, + 11, + 8, + 19, + 8, + 12, + 42, + 25, + 14, + 11, + 20, + 5, + 3, + 6, + 12, + 13, + 18, + 6, + 17, + 7, + 11, + 17, + 15, + 4, + 2, + 4, + 6, + 7, + 8, + 18, + 29, + 19, + 7, + 0, + 4, + 11, + 5, + 20, + 17, + 29, + 14, + 2, + 14, + 12, + 6, + 8, + 27, + 11, + 7, + 13, + 12, + 17, + 17, + 14, + 12, + 8, + 18, + 6, + 6, + 2, + 17, + 21, + 9 + ], + "weighted_loads": [ + 0.8333925269544125, + 0.2716349847614765, + 0.33590289391577244, + 0.46933818608522415, + 1.9199923239648342, + 0.48339955508708954, + 0.7289876881986856, + 3.9011732023209333, + 2.0091238729655743, + 1.059067826718092, + 0.9510199874639511, + 0.9281764943152666, + 0.24519401416182518, + 0.14081428572535515, + 0.1962616965174675, + 0.9960751459002495, + 1.5843093730509281, + 1.3337461650371552, + 0.2797804996371269, + 1.2201282121241093, + 0.5009432211518288, + 0.5691447407007217, + 1.2425775453448296, + 1.0940978787839413, + 0.208580881357193, + 0.0720895379781723, + 0.20393281057476997, + 0.23422115668654442, + 0.37543611600995064, + 0.29962258972227573, + 1.3596076518297195, + 1.8060637637972832, + 1.9082352332770824, + 0.2739363554865122, + 0.0, + 0.16475613601505756, + 0.5823355503380299, + 0.2784264739602804, + 1.589483667165041, + 1.5424882359802723, + 2.4463321156799793, + 0.7359225377440453, + 0.15301526337862015, + 1.099735775962472, + 0.49376815371215343, + 0.2456956785172224, + 0.42017754539847374, + 2.1972164027392864, + 0.3713724482804537, + 0.27647928707301617, + 0.8424507230520248, + 0.5412556752562523, + 1.6458597481250763, + 1.2116010580211878, + 0.9998978339135647, + 0.6899091899394989, + 0.5198346823453903, + 1.3892299961298704, + 0.3739286735653877, + 0.4750731289386749, + 0.10481760650873184, + 1.008521581068635, + 1.581001928076148, + 0.5007142014801502 + ], + "unique_experts": 63, + "load_cv": 0.625872172517169, + "normalized_load_entropy": 0.9545384812930365, + "max_load_share": 0.05384615384615385 + }, + "full_input": { + "tokens": 171, + "top_k": 6, + "decisions": 1026, + "ordered_route_sha256": "8aea62fabe2f31f3a2575b3ed1735471ed6460675bd7ae1faa8ddf959d6fe439", + "route_weight_sha256": "e2a31b1e4e6bfcca7b134315e010808da1ce441fa3f2fbef7714d7d2f65de80f", + "loads": [ + 11, + 9, + 15, + 17, + 20, + 8, + 14, + 42, + 25, + 22, + 20, + 21, + 6, + 16, + 9, + 16, + 15, + 20, + 13, + 19, + 8, + 13, + 23, + 16, + 4, + 12, + 13, + 6, + 8, + 27, + 18, + 30, + 19, + 9, + 13, + 4, + 13, + 11, + 23, + 20, + 32, + 19, + 11, + 14, + 14, + 8, + 20, + 31, + 11, + 10, + 15, + 13, + 22, + 21, + 20, + 12, + 13, + 20, + 6, + 20, + 10, + 19, + 25, + 12 + ], + "weighted_loads": [ + 0.8333925269544125, + 0.447493277490139, + 0.547936549410224, + 1.2377338242367841, + 1.9482479132711887, + 0.48339955508708954, + 0.8735655676573515, + 3.9011732023209333, + 2.0091238729655743, + 2.100467476993799, + 1.54128597676754, + 0.9452511537820101, + 0.3511632941663265, + 1.0413662679493427, + 0.2709583565592766, + 1.2875125482678413, + 1.9491043575108051, + 1.404552936553955, + 0.8108226853073575, + 1.310179851949215, + 0.5502671785652637, + 0.8991899751126766, + 1.6843809001147747, + 1.1880029626190662, + 0.208580881357193, + 0.6739996168762445, + 1.3143748231232166, + 0.23422115668654442, + 0.40946318209171295, + 1.3776062279939651, + 1.3596076518297195, + 1.8244569413363934, + 1.9082352332770824, + 0.362473551183939, + 1.0977435756940395, + 0.16475613601505756, + 0.6407745834439993, + 0.6845045313239098, + 2.776335995644331, + 1.7537127956748009, + 2.605957642197609, + 0.960669378619059, + 0.5846185609698296, + 1.099735775962472, + 0.5632242430001497, + 0.27634628178202547, + 1.7961427196860313, + 2.5349302887916565, + 0.3713724482804537, + 0.4196520894765854, + 0.935079775750637, + 0.6373900473117828, + 2.1338535845279694, + 1.3939480055123568, + 1.5519287623465061, + 0.6899091899394989, + 0.9456540197134018, + 1.462822087109089, + 0.3739286735653877, + 1.3402457628399134, + 0.993715438991785, + 1.2040061596781015, + 1.891974976286292, + 0.6084350626915693 + ], + "unique_experts": 64, + "load_cv": 0.4488640079027518, + "normalized_load_entropy": 0.9764600585050578, + "max_load_share": 0.04093567251461988 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 130, + "ordered_topk_exact_tokens": 107, + "set_exact_tokens": 118, + "mean_set_jaccard": 0.9736263736263737, + "mean_token_weighted_tv": 0.006438051651303585, + "aggregate_load_tv": 0.011538461538461543 + }, + "system_bos": { + "tokens": 130, + "ordered_topk_exact_tokens": 95, + "set_exact_tokens": 106, + "mean_set_jaccard": 0.9472527472527472, + "mean_token_weighted_tv": 0.012370249320967839, + "aggregate_load_tv": 0.024358974358974363 + }, + "system_x": { + "tokens": 130, + "ordered_topk_exact_tokens": 92, + "set_exact_tokens": 101, + "mean_set_jaccard": 0.9346153846153846, + "mean_token_weighted_tv": 0.015021027775051501, + "aggregate_load_tv": 0.028205128205128202 + }, + "system_period": { + "tokens": 130, + "ordered_topk_exact_tokens": 88, + "set_exact_tokens": 98, + "mean_set_jaccard": 0.9280219780219781, + "mean_token_weighted_tv": 0.01561378833766167, + "aggregate_load_tv": 0.03076923076923077 + }, + "bos_at_s0": { + "tokens": 130, + "ordered_topk_exact_tokens": 80, + "set_exact_tokens": 97, + "mean_set_jaccard": 0.9258241758241759, + "mean_token_weighted_tv": 0.01821533883563601, + "aggregate_load_tv": 0.02948717948717948 + }, + "bos_at_s1": { + "tokens": 130, + "ordered_topk_exact_tokens": 75, + "set_exact_tokens": 87, + "mean_set_jaccard": 0.9038461538461539, + "mean_token_weighted_tv": 0.021053070976183964, + "aggregate_load_tv": 0.04102564102564103 + }, + "x_at_s0": { + "tokens": 130, + "ordered_topk_exact_tokens": 78, + "set_exact_tokens": 93, + "mean_set_jaccard": 0.9170329670329671, + "mean_token_weighted_tv": 0.01899193817606339, + "aggregate_load_tv": 0.03717948717948718 + }, + "x_at_s1": { + "tokens": 130, + "ordered_topk_exact_tokens": 69, + "set_exact_tokens": 78, + "mean_set_jaccard": 0.8824175824175824, + "mean_token_weighted_tv": 0.024370214020690093, + "aggregate_load_tv": 0.05641025641025641 + }, + "period_at_s0": { + "tokens": 130, + "ordered_topk_exact_tokens": 79, + "set_exact_tokens": 93, + "mean_set_jaccard": 0.9170329670329671, + "mean_token_weighted_tv": 0.018861626711888957, + "aggregate_load_tv": 0.035897435897435895 + }, + "period_at_s1": { + "tokens": 130, + "ordered_topk_exact_tokens": 67, + "set_exact_tokens": 76, + "mean_set_jaccard": 0.8796703296703297, + "mean_token_weighted_tv": 0.02463559039080372, + "aggregate_load_tv": 0.05641025641025642 + } + } + }, + "layer_05": { + "layer": 5, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "77887568f2321fca7add3386c844899bb130e89198b47cfef72efdbd3bffc81d", + "route_weight_sha256": "27d4e2e6ea6f2f36ae474c5ac3792a197ebb6a2a9bd0883303e42abd4fc8b8ac", + "loads": [ + 7, + 14, + 16, + 11, + 15, + 3, + 3, + 7, + 4, + 7, + 7, + 5, + 15, + 6, + 69, + 5, + 21, + 5, + 1, + 5, + 9, + 15, + 13, + 8, + 14, + 12, + 7, + 18, + 0, + 15, + 17, + 12, + 11, + 31, + 18, + 9, + 17, + 15, + 0, + 3, + 14, + 0, + 8, + 15, + 9, + 32, + 15, + 8, + 7, + 1, + 4, + 27, + 5, + 11, + 6, + 9, + 17, + 8, + 11, + 49, + 15, + 14, + 19, + 6 + ], + "weighted_loads": [ + 0.404742032289505, + 0.7366344928741455, + 1.33165374211967, + 0.9825856573879719, + 0.8992547653615475, + 0.11542118713259697, + 0.1749187856912613, + 0.4929756298661232, + 0.14655577577650547, + 0.270406611263752, + 0.3665380943566561, + 0.2123166024684906, + 1.2160301804542542, + 0.3589624986052513, + 5.350358981639147, + 0.4375345166772604, + 1.8491347171366215, + 0.239524994045496, + 0.07643163949251175, + 0.20887947268784046, + 0.34643607027828693, + 1.3314578011631966, + 1.177388984709978, + 0.5830805264413357, + 1.247819423675537, + 0.8121623285114765, + 0.3599527068436146, + 1.5297067612409592, + 0.0, + 1.0504159294068813, + 1.0090875141322613, + 0.47535281255841255, + 0.4473067857325077, + 2.0680444072932005, + 1.5693808179348707, + 0.3629250321537256, + 0.9204811677336693, + 1.202631376683712, + 0.0, + 0.17544707655906677, + 0.9057783745229244, + 0.0, + 0.5534831210970879, + 1.2816830836236477, + 0.44317755475640297, + 2.693220481276512, + 1.1086870543658733, + 0.3286167122423649, + 0.47354557178914547, + 0.033734533935785294, + 0.21506233140826225, + 1.8674170039594173, + 0.20397013053297997, + 0.6886475328356028, + 0.21024385653436184, + 0.3398576769977808, + 0.9981832951307297, + 0.4267550893127918, + 0.9269542023539543, + 4.978337991982698, + 1.4406444653868675, + 1.1099677607417107, + 1.185961052775383, + 0.24768888391554356 + ], + "unique_experts": 61, + "load_cv": 0.896233626909828, + "normalized_load_entropy": 0.9248616413940275, + "max_load_share": 0.08846153846153847 + }, + "full_input": { + "tokens": 155, + "top_k": 6, + "decisions": 930, + "ordered_route_sha256": "69f68250c50b2866349fc150642c8e9940e49ed1464d2591969b0550016375f3", + "route_weight_sha256": "c1f820c0bdc13048e06d21e918f540829f2a61dc91a15963b11a58d472cd2d11", + "loads": [ + 7, + 15, + 16, + 11, + 16, + 4, + 4, + 8, + 5, + 8, + 17, + 5, + 18, + 6, + 69, + 17, + 24, + 11, + 10, + 6, + 11, + 15, + 13, + 8, + 14, + 20, + 7, + 18, + 0, + 16, + 17, + 12, + 11, + 31, + 18, + 14, + 17, + 15, + 10, + 10, + 19, + 8, + 17, + 16, + 11, + 32, + 15, + 11, + 7, + 4, + 11, + 27, + 7, + 20, + 10, + 18, + 17, + 8, + 11, + 50, + 15, + 15, + 19, + 8 + ], + "weighted_loads": [ + 0.404742032289505, + 0.7401325525715947, + 1.33165374211967, + 0.9825856573879719, + 0.9010103276232257, + 0.1524723581969738, + 0.2069476768374443, + 0.49602414667606354, + 0.14989857096225023, + 0.274922335986048, + 0.9562455639243126, + 0.2123166024684906, + 1.4056567437946796, + 0.3589624986052513, + 5.350358981639147, + 2.41822820995003, + 2.034155063331127, + 0.5380585938692093, + 0.8713246993720531, + 0.2219448033720255, + 0.3618836523965001, + 1.3314578011631966, + 1.177388984709978, + 0.5830805264413357, + 1.247819423675537, + 1.715847685933113, + 0.3599527068436146, + 1.5297067612409592, + 0.0, + 1.0849265195429325, + 1.0090875141322613, + 0.47535281255841255, + 0.4473067857325077, + 2.0680444072932005, + 1.5693808179348707, + 0.8057469557970762, + 0.9204811677336693, + 1.202631376683712, + 1.030035525560379, + 0.8145387396216393, + 1.1129296645522118, + 0.7921871431171894, + 1.3948513194918633, + 1.3268775194883347, + 0.6357553191483021, + 2.693220481276512, + 1.1086870543658733, + 0.389596916269511, + 0.47354557178914547, + 0.20844205748289824, + 0.8735967241227627, + 1.8674170039594173, + 1.8335390649735928, + 1.2859730031341314, + 0.27613618678878993, + 1.0273761134594679, + 0.9981832951307297, + 0.4267550893127918, + 0.9269542023539543, + 5.024148903787136, + 1.4406444653868675, + 1.1516544334590435, + 1.185961052775383, + 1.18334979750216 + ], + "unique_experts": 63, + "load_cv": 0.7086176512084046, + "normalized_load_entropy": 0.953435710640906, + "max_load_share": 0.07419354838709677 + } + }, + "s1_eos": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "8b3738555fdd31f099ff198ad441470b75391f5ab68a3c3d65a85ae8b5955129", + "route_weight_sha256": "930899191b0ada10222dfe15e38ff61831ab1566591e39ae242915437b692b5c", + "loads": [ + 7, + 14, + 17, + 11, + 16, + 3, + 3, + 7, + 4, + 7, + 7, + 5, + 15, + 6, + 69, + 5, + 21, + 5, + 1, + 5, + 8, + 14, + 14, + 8, + 14, + 13, + 8, + 18, + 0, + 15, + 17, + 11, + 10, + 30, + 17, + 9, + 17, + 15, + 0, + 3, + 14, + 0, + 8, + 15, + 9, + 32, + 15, + 9, + 7, + 1, + 4, + 26, + 5, + 11, + 6, + 9, + 16, + 7, + 12, + 50, + 15, + 14, + 19, + 7 + ], + "weighted_loads": [ + 0.4058043360710144, + 0.7338632717728615, + 1.3604071624577045, + 0.9901068694889545, + 0.9284426532685757, + 0.11548667028546333, + 0.17715629935264587, + 0.4959910251200199, + 0.14416620321571827, + 0.2730623222887516, + 0.36112125776708126, + 0.2055965382605791, + 1.2081366069614887, + 0.3547160401940346, + 5.322067569941282, + 0.43783244863152504, + 1.8517746925354004, + 0.24218742549419403, + 0.07471960783004761, + 0.20965521223843098, + 0.31214808113873005, + 1.2706976681947708, + 1.2161178812384605, + 0.5866805613040924, + 1.2536594048142433, + 0.8351471852511168, + 0.3867992516607046, + 1.521626316010952, + 0.0, + 1.056784301996231, + 1.0274894945323467, + 0.4390392620116472, + 0.41191019490361214, + 2.0308748204261065, + 1.546726819127798, + 0.3620002642273903, + 0.9174209553748369, + 1.1995598003268242, + 0.0, + 0.17219439521431923, + 0.9114623740315437, + 0.0, + 0.5521494746208191, + 1.2930591776967049, + 0.44910917058587074, + 2.696914952248335, + 1.1148492526262999, + 0.35681924037635326, + 0.4759924430400133, + 0.03315463662147522, + 0.2181093692779541, + 1.8579452447593212, + 0.19987398386001587, + 0.688944024965167, + 0.20576749928295612, + 0.3421785943210125, + 0.963935237377882, + 0.3965225499123335, + 0.9645219631493092, + 5.041519425809383, + 1.4439734816551208, + 1.105533353984356, + 1.1873253248631954, + 0.286768501624465 + ], + "unique_experts": 61, + "load_cv": 0.8959988494404184, + "normalized_load_entropy": 0.9251515430400649, + "max_load_share": 0.08846153846153847 + }, + "full_input": { + "tokens": 171, + "top_k": 6, + "decisions": 1026, + "ordered_route_sha256": "44986940b6e3ac1800c35b50e61a2b6cae11d89995e4f14ebee04dcae8c3ecb0", + "route_weight_sha256": "737e69df8afa24190beb6153260f530daf7bb7e8acaaca6809ba9b47cf3fb448", + "loads": [ + 8, + 16, + 17, + 17, + 17, + 5, + 11, + 9, + 5, + 8, + 20, + 8, + 21, + 6, + 70, + 19, + 25, + 16, + 13, + 15, + 10, + 14, + 15, + 8, + 15, + 21, + 8, + 20, + 0, + 18, + 17, + 11, + 11, + 31, + 18, + 14, + 18, + 18, + 11, + 14, + 18, + 13, + 19, + 19, + 11, + 32, + 15, + 13, + 7, + 15, + 13, + 27, + 7, + 21, + 11, + 19, + 16, + 7, + 13, + 51, + 16, + 15, + 19, + 11 + ], + "weighted_loads": [ + 0.4422922395169735, + 0.757773004937917, + 1.3604071624577045, + 1.403251189738512, + 0.9302115490427241, + 0.18775521591305733, + 1.1596708819270134, + 0.5501398919150233, + 0.14752461411990225, + 0.2774830306880176, + 1.1463658194988966, + 0.5720716435462236, + 1.6822030916810036, + 0.3547160401940346, + 5.35593219473958, + 2.9281269051134586, + 2.119837176054716, + 0.9222150780260563, + 1.2141565158963203, + 1.055809022858739, + 0.32749940501526, + 1.2706976681947708, + 1.2542713582515717, + 0.5866805613040924, + 1.330224834382534, + 1.5536195281893015, + 0.3867992516607046, + 1.6960170939564705, + 0.0, + 1.1786572933197021, + 1.0274894945323467, + 0.4390392620116472, + 0.5306865833699703, + 2.0739511717110872, + 1.5810412429273129, + 0.9309595301747322, + 0.9632764477282763, + 1.3518014326691628, + 1.174212146550417, + 1.2664629854261875, + 1.0750843025743961, + 1.1930270306766033, + 1.6010804437100887, + 1.5425430312752724, + 0.6164674609899521, + 2.696914952248335, + 1.1148492526262999, + 0.4499390001874417, + 0.4759924430400133, + 0.8805952100083232, + 1.2734697461128235, + 1.9062501341104507, + 1.8291584849357605, + 1.492258818820119, + 0.3097510957159102, + 0.9629468694329262, + 0.963935237377882, + 0.3965225499123335, + 1.0345148779451847, + 5.089162740856409, + 1.4901053234934807, + 1.1461191698908806, + 1.1873253248631954, + 1.466410854831338 + ], + "unique_experts": 63, + "load_cv": 0.6278588730555134, + "normalized_load_entropy": 0.9626759744956379, + "max_load_share": 0.0682261208576998 + } + }, + "s0_bos": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "9b440fad1f7d992911bb51f8b48cefe0e313e9ef70292344ebdc5637dcdd6d9e", + "route_weight_sha256": "7074b03f262bf1ad785c62059572a190005f4c8ee8e1099627f82ecf24eef34b", + "loads": [ + 6, + 13, + 15, + 11, + 17, + 3, + 3, + 7, + 3, + 6, + 7, + 5, + 15, + 7, + 70, + 5, + 22, + 4, + 1, + 7, + 7, + 15, + 13, + 8, + 15, + 12, + 8, + 18, + 1, + 14, + 17, + 9, + 10, + 29, + 18, + 8, + 21, + 15, + 0, + 3, + 14, + 0, + 7, + 15, + 8, + 32, + 15, + 9, + 7, + 1, + 4, + 30, + 4, + 13, + 5, + 9, + 16, + 10, + 12, + 49, + 15, + 13, + 19, + 5 + ], + "weighted_loads": [ + 0.3500952683389187, + 0.6841949783265591, + 1.288987385109067, + 0.9491144455969334, + 0.9824678897857666, + 0.1132760290056467, + 0.18096541985869408, + 0.46310980245471, + 0.11138548329472542, + 0.22802478820085526, + 0.36340755596756935, + 0.21536478027701378, + 1.2150266468524933, + 0.3944221939891577, + 5.363296251744032, + 0.4765611533075571, + 1.8684700392186642, + 0.20876024290919304, + 0.07903993129730225, + 0.27978199534118176, + 0.27314992621541023, + 1.416332934051752, + 1.1451542750000954, + 0.593491118401289, + 1.3200258892029524, + 0.8125309832394123, + 0.39768873155117035, + 1.525023903697729, + 0.03172940015792847, + 1.0469743311405182, + 1.006962239742279, + 0.385446485131979, + 0.4042139407247305, + 1.9599869083613157, + 1.5755153615027666, + 0.3394910469651222, + 1.10517524369061, + 1.231030959635973, + 0.0, + 0.16533686220645905, + 0.9087251424789429, + 0.0, + 0.538184929639101, + 1.3241546675562859, + 0.427839282900095, + 2.6965772435069084, + 1.0828325301408768, + 0.3520366419106722, + 0.48447597213089466, + 0.030781932175159454, + 0.2229156568646431, + 2.0114011019468307, + 0.15838416293263435, + 0.7574335038661957, + 0.18187230825424194, + 0.3205806352198124, + 0.9503893852233887, + 0.5072257835417986, + 0.9660164248198271, + 4.961618712171912, + 1.4418867975473404, + 1.0273900926113129, + 1.207857895642519, + 0.21378221362829208 + ], + "unique_experts": 62, + "load_cv": 0.9119413801708145, + "normalized_load_entropy": 0.9229269126202679, + "max_load_share": 0.08974358974358974 + }, + "full_input": { + "tokens": 155, + "top_k": 6, + "decisions": 930, + "ordered_route_sha256": "ed8fed8f87541532e797d4f0010d7962aa5cb552f87ff55b94994c5863ddc12d", + "route_weight_sha256": "80fdb9e0e39b324eff186767e509d1bfb13a61baef7ddd893781264e2a172b09", + "loads": [ + 6, + 14, + 15, + 11, + 17, + 4, + 4, + 9, + 4, + 6, + 18, + 5, + 18, + 7, + 70, + 18, + 25, + 10, + 10, + 8, + 8, + 15, + 13, + 8, + 15, + 20, + 8, + 18, + 1, + 15, + 17, + 9, + 10, + 29, + 18, + 13, + 21, + 15, + 11, + 11, + 18, + 7, + 16, + 16, + 10, + 32, + 15, + 11, + 7, + 6, + 11, + 30, + 5, + 22, + 8, + 19, + 16, + 10, + 12, + 50, + 15, + 14, + 19, + 7 + ], + "weighted_loads": [ + 0.3500952683389187, + 0.6876930380240083, + 1.288987385109067, + 0.9491144455969334, + 0.9824678897857666, + 0.15032720007002354, + 0.2129943110048771, + 0.504639271646738, + 0.11472827848047018, + 0.22802478820085526, + 0.9991589765995741, + 0.21536478027701378, + 1.4117059893906116, + 0.3944221939891577, + 5.363296251744032, + 2.509965085424483, + 2.0682199597358704, + 0.5072938427329063, + 0.964602880179882, + 0.2928473260253668, + 0.28572238702327013, + 1.416332934051752, + 1.1451542750000954, + 0.593491118401289, + 1.3200258892029524, + 1.716216340661049, + 0.39768873155117035, + 1.525023903697729, + 0.03172940015792847, + 1.0846357643604279, + 1.006962239742279, + 0.385446485131979, + 0.4042139407247305, + 1.9599869083613157, + 1.5755153615027666, + 0.7869487516582012, + 1.10517524369061, + 1.231030959635973, + 1.199706256389618, + 0.8227102719247341, + 1.0844219587743282, + 0.7811628878116608, + 1.3530493676662445, + 1.370757158845663, + 0.6148700825870037, + 2.6965772435069084, + 1.0828325301408768, + 0.4088377645239234, + 0.48447597213089466, + 0.28402854036539793, + 0.8701441660523415, + 2.0114011019468307, + 0.8232023306190968, + 1.3547589741647243, + 0.24685261608101428, + 1.0073399133980274, + 0.9503893852233887, + 0.5072257835417986, + 0.9660164248198271, + 5.00742962397635, + 1.4418867975473404, + 1.0714667215943336, + 1.207857895642519, + 1.1494431272149086 + ], + "unique_experts": 64, + "load_cv": 0.7223726018988407, + "normalized_load_entropy": 0.9523321244018947, + "max_load_share": 0.07526881720430108 + } + }, + "s1_bos": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "2ecb19fad46217adac4317efc575991cf9fbaf0b4e6b4763df2b1898b8885212", + "route_weight_sha256": "02f0e08552c6eda95c103e3b0a7627482adeb62d4d3eac8c4186601e4782d15f", + "loads": [ + 6, + 14, + 14, + 11, + 17, + 3, + 3, + 8, + 3, + 7, + 6, + 5, + 15, + 7, + 68, + 5, + 22, + 5, + 1, + 5, + 8, + 16, + 14, + 8, + 16, + 13, + 9, + 18, + 1, + 15, + 18, + 12, + 10, + 28, + 17, + 8, + 19, + 16, + 0, + 2, + 14, + 0, + 7, + 15, + 8, + 33, + 14, + 9, + 7, + 1, + 4, + 26, + 4, + 11, + 6, + 6, + 17, + 10, + 13, + 49, + 14, + 15, + 19, + 5 + ], + "weighted_loads": [ + 0.35485846921801567, + 0.7138537690043449, + 1.2462169155478477, + 0.9674792550504208, + 0.9405031036585569, + 0.11221824586391449, + 0.18123864382505417, + 0.5364381782710552, + 0.11729449033737183, + 0.26428572833538055, + 0.3148447908461094, + 0.21319395676255226, + 1.1887463591992855, + 0.3997439406812191, + 5.096361115574837, + 0.4781086165457964, + 1.92681604065001, + 0.25749922916293144, + 0.0726727545261383, + 0.21798966079950333, + 0.304758382961154, + 1.4331109151244164, + 1.2004435993731022, + 0.588490929454565, + 1.3633712604641914, + 0.8376499582082033, + 0.4384057465940714, + 1.5001367218792439, + 0.03095104917883873, + 1.0969595592468977, + 1.066777165979147, + 0.4790284391492605, + 0.4059599172323942, + 1.9123208709061146, + 1.5538939200341702, + 0.32712414488196373, + 1.0281079411506653, + 1.2859023157507181, + 0.0, + 0.12087837234139442, + 0.9134170599281788, + 0.0, + 0.5273580513894558, + 1.3420804031193256, + 0.42229171469807625, + 2.7194676026701927, + 1.0516056045889854, + 0.3615061976015568, + 0.4865207299590111, + 0.03095822036266327, + 0.22239331156015396, + 1.83146283775568, + 0.15446848422288895, + 0.7057552933692932, + 0.2229486107826233, + 0.2029371429234743, + 0.9910796657204628, + 0.505857115611434, + 0.9872003681957722, + 4.956770660355687, + 1.3907012678682804, + 1.1169783975929022, + 1.2043276391923428, + 0.20968933030962944 + ], + "unique_experts": 62, + "load_cv": 0.8923518998775036, + "normalized_load_entropy": 0.9246229753282807, + "max_load_share": 0.08717948717948718 + }, + "full_input": { + "tokens": 171, + "top_k": 6, + "decisions": 1026, + "ordered_route_sha256": "869d1f107ad31727ce57581a5197455027509ab1cf3086c44afc8bde296f00c2", + "route_weight_sha256": "24d8a6be6f65c6de6f0cdb89ea7e7985003bcd8bdc5a520966b122e1bf975f67", + "loads": [ + 7, + 16, + 14, + 17, + 17, + 5, + 11, + 11, + 4, + 7, + 19, + 8, + 21, + 7, + 69, + 20, + 27, + 16, + 15, + 15, + 9, + 16, + 15, + 8, + 17, + 21, + 9, + 20, + 1, + 18, + 18, + 12, + 11, + 29, + 18, + 13, + 20, + 19, + 12, + 13, + 17, + 12, + 19, + 19, + 10, + 33, + 14, + 12, + 7, + 14, + 14, + 27, + 5, + 21, + 10, + 17, + 17, + 10, + 14, + 50, + 15, + 16, + 19, + 9 + ], + "weighted_loads": [ + 0.39134637266397476, + 0.7377635021694005, + 1.2462169155478477, + 1.3806235752999783, + 0.9405031036585569, + 0.18448679149150848, + 1.1637532263994217, + 0.6319742454215884, + 0.12065290124155581, + 0.26428572833538055, + 1.1105062253773212, + 0.5796690620481968, + 1.6815447844564915, + 0.3997439406812191, + 5.130225740373135, + 3.0268945936113596, + 2.25309089012444, + 0.9375268816947937, + 1.3751797787845135, + 1.0641434714198112, + 0.3173308437690139, + 1.4331109151244164, + 1.2385970763862133, + 0.588490929454565, + 1.4399366900324821, + 1.556122301146388, + 0.4384057465940714, + 1.6745274998247623, + 0.03095104917883873, + 1.2163859885185957, + 1.066777165979147, + 0.4790284391492605, + 0.5247363056987524, + 1.9553972221910954, + 1.588208343833685, + 0.9027700088918209, + 1.0739634335041046, + 1.4381439480930567, + 1.3174170926213264, + 1.1793381907045841, + 1.0417872741818428, + 1.1571614481508732, + 1.559839878231287, + 1.5946812592446804, + 0.5829684287309647, + 2.7194676026701927, + 1.0516056045889854, + 0.4468305008485913, + 0.4865207299590111, + 0.846280480735004, + 1.2935448326170444, + 1.8797677271068096, + 0.8192866519093513, + 1.509070087224245, + 0.3228395599871874, + 0.8450534176081419, + 0.9910796657204628, + 0.505857115611434, + 1.0571932829916477, + 5.004413975402713, + 1.4368331097066402, + 1.1651826817542315, + 1.2043276391923428, + 1.3893316835165024 + ], + "unique_experts": 64, + "load_cv": 0.621337193697489, + "normalized_load_entropy": 0.9634445547510204, + "max_load_share": 0.06725146198830409 + } + }, + "s0_x": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "5bb1777224069e05133aafdedfa213bcd9bd29cd15d2750e0707b6073bf05930", + "route_weight_sha256": "82eebffe7aeec00eb9e500f4b70eea0e0e35aecb1a9879a68919aae310c045b8", + "loads": [ + 6, + 15, + 14, + 11, + 17, + 3, + 3, + 7, + 3, + 6, + 7, + 5, + 15, + 7, + 70, + 5, + 21, + 5, + 1, + 6, + 8, + 16, + 14, + 8, + 16, + 12, + 9, + 17, + 1, + 14, + 17, + 12, + 10, + 27, + 17, + 8, + 20, + 15, + 0, + 2, + 14, + 0, + 7, + 15, + 8, + 32, + 15, + 10, + 7, + 2, + 4, + 28, + 5, + 12, + 5, + 7, + 17, + 9, + 12, + 49, + 15, + 13, + 18, + 6 + ], + "weighted_loads": [ + 0.35227159783244133, + 0.7637915872037411, + 1.2487564571201801, + 0.9570468738675117, + 0.9685996305197477, + 0.114366689696908, + 0.18617385625839233, + 0.4538811892271042, + 0.11611716821789742, + 0.2232639268040657, + 0.37503158301115036, + 0.21369906142354012, + 1.2269660346210003, + 0.3929512817412615, + 5.324346041306853, + 0.4347424004226923, + 1.8323205783963203, + 0.2556387819349766, + 0.07833635061979294, + 0.2735348045825958, + 0.3099654521793127, + 1.4295658096671104, + 1.1906298249959946, + 0.5876848958432674, + 1.3322665467858315, + 0.8178760334849358, + 0.42490391433238983, + 1.46514143794775, + 0.02987964265048504, + 1.0463885255157948, + 1.0105915404856205, + 0.5068685803562403, + 0.4099024385213852, + 1.8867216370999813, + 1.5341336093842983, + 0.32591044902801514, + 1.053179457783699, + 1.238032128661871, + 0.0, + 0.124394491314888, + 0.9099034480750561, + 0.0, + 0.506913922727108, + 1.2973720282316208, + 0.42381564900279045, + 2.6183649264276028, + 1.0769165474921465, + 0.36701921932399273, + 0.48168187215924263, + 0.06674943119287491, + 0.22946010157465935, + 1.9041466433554888, + 0.20270812138915062, + 0.7198332063853741, + 0.17958269640803337, + 0.2509712688624859, + 0.98066146671772, + 0.46950107254087925, + 0.9730493053793907, + 4.898791329935193, + 1.4484956413507462, + 1.0397171303629875, + 1.151893313974142, + 0.23009229451417923 + ], + "unique_experts": 62, + "load_cv": 0.8992801562772472, + "normalized_load_entropy": 0.9253335800279856, + "max_load_share": 0.08974358974358974 + }, + "full_input": { + "tokens": 155, + "top_k": 6, + "decisions": 930, + "ordered_route_sha256": "a2e15bb1058a3dcb5e44b58355f3afccc86233c1993b583eb7947debe32ee740", + "route_weight_sha256": "632948b2a6006c1651f066992a188551f80ff868cf950157d91f387b902805ab", + "loads": [ + 6, + 16, + 14, + 11, + 17, + 4, + 4, + 9, + 4, + 6, + 19, + 5, + 18, + 7, + 70, + 18, + 24, + 11, + 10, + 7, + 9, + 16, + 14, + 8, + 16, + 21, + 9, + 17, + 1, + 15, + 17, + 12, + 10, + 27, + 17, + 13, + 20, + 15, + 9, + 9, + 20, + 7, + 15, + 16, + 10, + 32, + 15, + 12, + 7, + 5, + 11, + 28, + 6, + 23, + 8, + 17, + 17, + 9, + 12, + 50, + 15, + 14, + 18, + 8 + ], + "weighted_loads": [ + 0.35227159783244133, + 0.7672896469011903, + 1.2487564571201801, + 0.9570468738675117, + 0.9685996305197477, + 0.15141786076128483, + 0.21820274740457535, + 0.497281014919281, + 0.11945996340364218, + 0.2232639268040657, + 1.10535185970366, + 0.21369906142354012, + 1.427995078265667, + 0.3929512817412615, + 5.324346041306853, + 2.6508823232725263, + 2.031058382242918, + 0.5541723817586899, + 0.8648827038705349, + 0.28660013526678085, + 0.3225379129871726, + 1.4295658096671104, + 1.1906298249959946, + 0.5876848958432674, + 1.3322665467858315, + 1.8081412352621555, + 0.42490391433238983, + 1.46514143794775, + 0.02987964265048504, + 1.0780548490583897, + 1.0105915404856205, + 0.5068685803562403, + 0.4099024385213852, + 1.8867216370999813, + 1.5341336093842983, + 0.7615232430398464, + 1.053179457783699, + 1.238032128661871, + 0.8800809532403946, + 0.7361307442188263, + 1.2009805254638195, + 0.7470485493540764, + 1.1895819678902626, + 1.3422954604029655, + 0.6023353599011898, + 2.6183649264276028, + 1.0769165474921465, + 0.4178968211635947, + 0.48168187215924263, + 0.23677660431712866, + 0.8472820073366165, + 1.9041466433554888, + 0.867526289075613, + 1.4302316009998322, + 0.23219019011594355, + 1.014754693955183, + 0.98066146671772, + 0.46950107254087925, + 0.9730493053793907, + 4.944602241739631, + 1.4484956413507462, + 1.0874222740530968, + 1.151893313974142, + 1.1657532081007957 + ], + "unique_experts": 64, + "load_cv": 0.7154764697704855, + "normalized_load_entropy": 0.9532501893056691, + "max_load_share": 0.07526881720430108 + } + }, + "s1_x": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "f2e9ab10759e0df31588b16ab2ad1c3c28df289e129bddb93521a903265643a4", + "route_weight_sha256": "1351be2ed771979d7a387e121fd5d23afb6242e26be74ba4996169b04b61ab11", + "loads": [ + 6, + 14, + 13, + 11, + 15, + 3, + 3, + 8, + 3, + 6, + 6, + 5, + 15, + 7, + 67, + 5, + 21, + 6, + 1, + 6, + 7, + 18, + 13, + 8, + 15, + 13, + 9, + 18, + 1, + 16, + 20, + 13, + 10, + 29, + 17, + 8, + 17, + 15, + 0, + 2, + 14, + 0, + 7, + 15, + 7, + 33, + 16, + 12, + 8, + 2, + 4, + 25, + 4, + 11, + 7, + 6, + 17, + 10, + 13, + 48, + 14, + 13, + 18, + 6 + ], + "weighted_loads": [ + 0.3506979010999203, + 0.7222789414227009, + 1.2174458168447018, + 0.949578408151865, + 0.8624830134212971, + 0.11246738955378532, + 0.18092557787895203, + 0.521399337798357, + 0.12350917607545853, + 0.22262800112366676, + 0.32440967485308647, + 0.21081905625760555, + 1.1939915269613266, + 0.40804053097963333, + 5.005901066586375, + 0.4560687895864248, + 1.8960935175418854, + 0.28882843255996704, + 0.07341970503330231, + 0.25548216328024864, + 0.2797364182770252, + 1.5057589337229729, + 1.1445222795009613, + 0.5833360701799393, + 1.3131350353360176, + 0.8319363333284855, + 0.43079739809036255, + 1.4759998433291912, + 0.031088143587112427, + 1.1305493898689747, + 1.157208327203989, + 0.5435338485985994, + 0.3942371755838394, + 1.9490998536348343, + 1.5402692258358002, + 0.31830132007598877, + 0.9323060475289822, + 1.2572184912860394, + 0.0, + 0.11702606827020645, + 0.9117648713290691, + 0.0, + 0.505740575492382, + 1.3131088241934776, + 0.3772904500365257, + 2.6649804562330246, + 1.1117305308580399, + 0.4393827635794878, + 0.5127920769155025, + 0.0720858983695507, + 0.22888874262571335, + 1.7607204802334309, + 0.1625107191503048, + 0.7027928903698921, + 0.2511959969997406, + 0.2079065591096878, + 0.9823289439082146, + 0.5035558771342039, + 0.9944979082792997, + 4.883292771875858, + 1.397380493581295, + 1.0631439313292503, + 1.1534464918076992, + 0.22875961661338806 + ], + "unique_experts": 62, + "load_cv": 0.8762930710390702, + "normalized_load_entropy": 0.9272414751988517, + "max_load_share": 0.0858974358974359 + }, + "full_input": { + "tokens": 171, + "top_k": 6, + "decisions": 1026, + "ordered_route_sha256": "ecc98d16c8927b07ed3727838546abd7c07f268258e486d71c46925e4165487a", + "route_weight_sha256": "b23a8ecf997d45e588149761780da9f671b8b7ac080a786fda4faa4b7856cd35", + "loads": [ + 7, + 16, + 13, + 17, + 15, + 5, + 11, + 11, + 4, + 6, + 20, + 8, + 21, + 7, + 68, + 20, + 26, + 17, + 14, + 16, + 8, + 18, + 14, + 8, + 16, + 22, + 9, + 20, + 1, + 18, + 20, + 13, + 11, + 31, + 18, + 14, + 18, + 18, + 10, + 13, + 18, + 11, + 18, + 20, + 9, + 33, + 16, + 15, + 8, + 15, + 12, + 26, + 5, + 23, + 11, + 17, + 17, + 10, + 14, + 49, + 15, + 14, + 18, + 10 + ], + "weighted_loads": [ + 0.38718580454587936, + 0.7461886745877564, + 1.2174458168447018, + 1.3627227284014225, + 0.8624830134212971, + 0.18473593518137932, + 1.1634401604533195, + 0.6177557101473212, + 0.1268675869796425, + 0.22262800112366676, + 1.2116718143224716, + 0.5772941615432501, + 1.692064817994833, + 0.40804053097963333, + 5.039765691384673, + 3.2132526990026236, + 2.234459836035967, + 0.9688560850918293, + 1.2086441293358803, + 1.1016359739005566, + 0.2923088790848851, + 1.5057589337229729, + 1.1826757565140724, + 0.5833360701799393, + 1.3897004649043083, + 1.6283920630812645, + 0.43079739809036255, + 1.6503906212747097, + 0.031088143587112427, + 1.2171314433217049, + 1.157208327203989, + 0.5435338485985994, + 0.5130135640501976, + 2.0364061407744884, + 1.574583649635315, + 0.9313730783760548, + 0.9781615398824215, + 1.409460123628378, + 0.9989387840032578, + 1.1784025356173515, + 1.114227719604969, + 1.0790011323988438, + 1.4234850704669952, + 1.5945061035454273, + 0.5346864946186543, + 2.6649804562330246, + 1.1117305308580399, + 0.5196071742102504, + 0.5127920769155025, + 0.8769488027319312, + 1.1693662591278553, + 1.8090253695845604, + 0.8273288868367672, + 1.6155425012111664, + 0.3405212853103876, + 0.9216749705374241, + 0.9823289439082146, + 0.5035558771342039, + 1.0644908230751753, + 4.930936086922884, + 1.4435123354196548, + 1.1127131320536137, + 1.1534464918076992, + 1.408401969820261 + ], + "unique_experts": 64, + "load_cv": 0.6169182597237065, + "normalized_load_entropy": 0.9634620188607101, + "max_load_share": 0.06627680311890838 + } + }, + "s0_period": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "3cd4941de476a0b9c30c890f73136e7baa8c605c673f42a7333482cb5bcdcb6f", + "route_weight_sha256": "4efba0a24bb5855ee82cf8dcba9add6cac7a5c237744aeb3d1a035171e63f137", + "loads": [ + 6, + 14, + 15, + 11, + 16, + 3, + 3, + 7, + 3, + 7, + 8, + 5, + 15, + 7, + 70, + 5, + 21, + 5, + 1, + 6, + 8, + 15, + 13, + 8, + 16, + 12, + 8, + 17, + 0, + 15, + 17, + 14, + 10, + 29, + 17, + 8, + 18, + 15, + 0, + 3, + 14, + 0, + 8, + 15, + 7, + 32, + 15, + 9, + 7, + 2, + 4, + 26, + 5, + 12, + 6, + 8, + 16, + 9, + 12, + 50, + 15, + 13, + 18, + 6 + ], + "weighted_loads": [ + 0.34726186841726303, + 0.729197084903717, + 1.2957371398806572, + 0.9621382430195808, + 0.9388627670705318, + 0.11446360312402248, + 0.18396972864866257, + 0.4532933458685875, + 0.11598625592887402, + 0.2624833658337593, + 0.40217220038175583, + 0.21444908156991005, + 1.2136499509215355, + 0.38673744909465313, + 5.304387874901295, + 0.4163623508065939, + 1.8234833143651485, + 0.24965179711580276, + 0.08020781725645065, + 0.2674805782735348, + 0.31241054460406303, + 1.3745016157627106, + 1.154200904071331, + 0.5864216163754463, + 1.3281275685876608, + 0.8138973899185658, + 0.39345987141132355, + 1.4540008753538132, + 0.0, + 1.0779764838516712, + 1.024257231503725, + 0.5669768750667572, + 0.4043427538126707, + 1.9672044031322002, + 1.5346986502408981, + 0.32735376060009, + 0.9727685302495956, + 1.2323180735111237, + 0.0, + 0.16098162904381752, + 0.9064385965466499, + 0.0, + 0.5391821824014187, + 1.286244124174118, + 0.39218568056821823, + 2.5996282882988453, + 1.072557844221592, + 0.3379915114492178, + 0.46933988854289055, + 0.06864004209637642, + 0.23117533698678017, + 1.828359130769968, + 0.20479575917124748, + 0.729489304125309, + 0.2106855884194374, + 0.2882241737097502, + 0.9424967505037785, + 0.46912625804543495, + 0.9774428475648165, + 4.920669982209802, + 1.4421353116631508, + 1.044482596218586, + 1.1448893323540688, + 0.2330456841737032 + ], + "unique_experts": 61, + "load_cv": 0.8996310150178889, + "normalized_load_entropy": 0.9253148285924696, + "max_load_share": 0.08974358974358974 + }, + "full_input": { + "tokens": 155, + "top_k": 6, + "decisions": 930, + "ordered_route_sha256": "b24d832a62379563f8401534dc4775e8a215053ad4c6c7d4802945edeeb1b3a0", + "route_weight_sha256": "d06e3cef95fcf9df0e9efc1d3384f78e599d92fdffed01289b0c7a8263236d52", + "loads": [ + 6, + 15, + 15, + 11, + 16, + 4, + 4, + 9, + 4, + 7, + 20, + 5, + 18, + 7, + 70, + 18, + 25, + 12, + 10, + 7, + 9, + 15, + 13, + 8, + 16, + 20, + 8, + 17, + 0, + 16, + 17, + 14, + 10, + 29, + 17, + 14, + 18, + 15, + 9, + 10, + 19, + 7, + 16, + 16, + 10, + 32, + 15, + 11, + 7, + 5, + 11, + 26, + 6, + 21, + 9, + 18, + 16, + 9, + 12, + 51, + 15, + 14, + 18, + 8 + ], + "weighted_loads": [ + 0.34726186841726303, + 0.7326951446011662, + 1.2957371398806572, + 0.9621382430195808, + 0.9388627670705318, + 0.15151477418839931, + 0.21599861979484558, + 0.49621957540512085, + 0.11932905111461878, + 0.2624833658337593, + 1.1316604409366846, + 0.21444908156991005, + 1.4099655710160732, + 0.38673744909465313, + 5.304387874901295, + 2.47007189784199, + 2.063567727804184, + 0.6056673713028431, + 0.814857292920351, + 0.2805459089577198, + 0.32498300541192293, + 1.3745016157627106, + 1.154200904071331, + 0.5864216163754463, + 1.3281275685876608, + 1.7175827473402023, + 0.39345987141132355, + 1.4540008753538132, + 0.0, + 1.1081177406013012, + 1.024257231503725, + 0.5669768750667572, + 0.4043427538126707, + 1.9672044031322002, + 1.5346986502408981, + 0.8111290633678436, + 0.9727685302495956, + 1.2323180735111237, + 0.8469270095229149, + 0.7673932276666164, + 1.1394204869866371, + 0.7835106253623962, + 1.2388934753835201, + 1.3311125189065933, + 0.6288562379777431, + 2.5996282882988453, + 1.072557844221592, + 0.39373121317476034, + 0.46933988854289055, + 0.23581659328192472, + 0.8693406134843826, + 1.828359130769968, + 0.8696139268577099, + 1.3268147744238377, + 0.2655377446208149, + 1.1795151326805353, + 0.9424967505037785, + 0.46912625804543495, + 0.9774428475648165, + 4.966480894014239, + 1.4421353116631508, + 1.0917064547538757, + 1.1448893323540688, + 1.1687065977603197 + ], + "unique_experts": 63, + "load_cv": 0.7170261422091947, + "normalized_load_entropy": 0.9526599718677659, + "max_load_share": 0.07526881720430108 + } + }, + "s1_period": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "b832c24f1d164fb45417eefdb3d118caaece07de97cb4305ece65a911dc6a86d", + "route_weight_sha256": "058d255059edfcc7f01e58cad8282a1e246e9dd24b4d190c38af6a96d3e05757", + "loads": [ + 6, + 14, + 13, + 11, + 15, + 3, + 3, + 8, + 4, + 5, + 6, + 5, + 15, + 7, + 66, + 5, + 21, + 6, + 1, + 7, + 9, + 18, + 13, + 8, + 15, + 13, + 8, + 18, + 0, + 15, + 20, + 16, + 10, + 28, + 17, + 7, + 17, + 15, + 0, + 2, + 14, + 0, + 7, + 15, + 8, + 33, + 15, + 11, + 7, + 2, + 4, + 26, + 4, + 11, + 7, + 6, + 17, + 10, + 13, + 49, + 14, + 13, + 18, + 6 + ], + "weighted_loads": [ + 0.35018907487392426, + 0.7151549570262432, + 1.219017080962658, + 0.9651179946959019, + 0.8629454914480448, + 0.11311085894703865, + 0.178802490234375, + 0.5321523882448673, + 0.1531151831150055, + 0.19049696624279022, + 0.32397735118865967, + 0.21006695181131363, + 1.1941037513315678, + 0.4075283668935299, + 4.995161838829517, + 0.4318980351090431, + 1.8913378827273846, + 0.28748118691146374, + 0.07249226421117783, + 0.28390880674123764, + 0.3506484441459179, + 1.50006765127182, + 1.1587141677737236, + 0.5802384912967682, + 1.3081446643918753, + 0.8298247791826725, + 0.4003759026527405, + 1.4737745225429535, + 0.0, + 1.111274216324091, + 1.1610230952501297, + 0.6400744095444679, + 0.3964608255773783, + 1.9085941072553396, + 1.5351506359875202, + 0.2859419398009777, + 0.9140999652445316, + 1.2584625445306301, + 0.0, + 0.11713046953082085, + 0.9217634350061417, + 0.0, + 0.5072779729962349, + 1.3070070669054985, + 0.4158346001058817, + 2.6640775352716446, + 1.0774472914636135, + 0.4067845456302166, + 0.47704000771045685, + 0.07292681559920311, + 0.22840125486254692, + 1.8137584067881107, + 0.14986378327012062, + 0.7130536884069443, + 0.2511516809463501, + 0.20746778137981892, + 0.9800794124603271, + 0.49899356067180634, + 0.9926739986985922, + 4.919871222227812, + 1.3951964564621449, + 1.0673912651836872, + 1.1521228216588497, + 0.23231923766434193 + ], + "unique_experts": 61, + "load_cv": 0.8743702533297638, + "normalized_load_entropy": 0.9265991627892296, + "max_load_share": 0.08461538461538462 + }, + "full_input": { + "tokens": 171, + "top_k": 6, + "decisions": 1026, + "ordered_route_sha256": "8fae2f8d142e3c0d0deb21addda3c3e59d0291feb8224d25ad16d96596cfd47d", + "route_weight_sha256": "f15418ce37cbbf6b4674a4a9a9ff660def2095fe6a2c6e7917d119e04b890ab4", + "loads": [ + 7, + 16, + 13, + 17, + 15, + 6, + 11, + 11, + 5, + 5, + 20, + 8, + 21, + 7, + 67, + 21, + 26, + 18, + 14, + 17, + 10, + 18, + 14, + 8, + 16, + 21, + 8, + 20, + 0, + 17, + 20, + 16, + 11, + 29, + 18, + 13, + 18, + 18, + 10, + 13, + 18, + 12, + 18, + 19, + 11, + 33, + 15, + 14, + 7, + 15, + 12, + 27, + 5, + 21, + 11, + 17, + 17, + 10, + 14, + 50, + 15, + 14, + 18, + 10 + ], + "weighted_loads": [ + 0.38667697831988335, + 0.7390646901912987, + 1.219017080962658, + 1.3782623149454594, + 0.8629454914480448, + 0.21682219579815865, + 1.1613170728087425, + 0.6285145496949553, + 0.15647359401918948, + 0.19049696624279022, + 1.2248276509344578, + 0.5765420570969582, + 1.6935414746403694, + 0.4075283668935299, + 5.029026463627815, + 3.057309702038765, + 2.255011972039938, + 1.0097426902502775, + 1.1738471761345863, + 1.1300626173615456, + 0.3632209049537778, + 1.50006765127182, + 1.1968676447868347, + 0.5802384912967682, + 1.384710093960166, + 1.5482971221208572, + 0.4003759026527405, + 1.648165300488472, + 0.0, + 1.1978562697768211, + 1.1610230952501297, + 0.6400744095444679, + 0.5152372140437365, + 1.9516704585403204, + 1.569465059787035, + 0.9251019023358822, + 0.959955457597971, + 1.4107041768729687, + 0.9596350528299809, + 1.1741862259805202, + 1.103083860129118, + 1.188457865267992, + 1.4424897693097591, + 1.553962904959917, + 0.6231996733695269, + 2.6640775352716446, + 1.0774472914636135, + 0.4925207691267133, + 0.47704000771045685, + 0.8718141904100776, + 1.1688485518097878, + 1.8620632961392403, + 0.814681950956583, + 1.5163684822618961, + 0.34475417621433735, + 1.0099094118922949, + 0.9800794124603271, + 0.49899356067180634, + 1.0626669134944677, + 4.9675145372748375, + 1.4413282983005047, + 1.118318296968937, + 1.1521228216588497, + 1.4119615908712149 + ], + "unique_experts": 63, + "load_cv": 0.61077758416738, + "normalized_load_entropy": 0.9635671727002951, + "max_load_share": 0.06530214424951267 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 130, + "ordered_topk_exact_tokens": 109, + "set_exact_tokens": 116, + "mean_set_jaccard": 0.9692307692307692, + "mean_token_weighted_tv": 0.007100684159936813, + "aggregate_load_tv": 0.011538461538461536 + }, + "system_bos": { + "tokens": 130, + "ordered_topk_exact_tokens": 93, + "set_exact_tokens": 103, + "mean_set_jaccard": 0.9373626373626374, + "mean_token_weighted_tv": 0.014074694028554054, + "aggregate_load_tv": 0.028205128205128216 + }, + "system_x": { + "tokens": 130, + "ordered_topk_exact_tokens": 94, + "set_exact_tokens": 102, + "mean_set_jaccard": 0.9351648351648352, + "mean_token_weighted_tv": 0.015067645692481445, + "aggregate_load_tv": 0.029487179487179487 + }, + "system_period": { + "tokens": 130, + "ordered_topk_exact_tokens": 87, + "set_exact_tokens": 100, + "mean_set_jaccard": 0.9324175824175824, + "mean_token_weighted_tv": 0.01612032865389035, + "aggregate_load_tv": 0.029487179487179487 + }, + "bos_at_s0": { + "tokens": 130, + "ordered_topk_exact_tokens": 84, + "set_exact_tokens": 98, + "mean_set_jaccard": 0.9263736263736263, + "mean_token_weighted_tv": 0.018089502885078008, + "aggregate_load_tv": 0.029487179487179487 + }, + "bos_at_s1": { + "tokens": 130, + "ordered_topk_exact_tokens": 76, + "set_exact_tokens": 89, + "mean_set_jaccard": 0.9032967032967033, + "mean_token_weighted_tv": 0.02191941331928739, + "aggregate_load_tv": 0.028205128205128216 + }, + "x_at_s0": { + "tokens": 130, + "ordered_topk_exact_tokens": 75, + "set_exact_tokens": 94, + "mean_set_jaccard": 0.9192307692307692, + "mean_token_weighted_tv": 0.01913754350434129, + "aggregate_load_tv": 0.029487179487179483 + }, + "x_at_s1": { + "tokens": 130, + "ordered_topk_exact_tokens": 70, + "set_exact_tokens": 83, + "mean_set_jaccard": 0.8901098901098901, + "mean_token_weighted_tv": 0.02481316120292132, + "aggregate_load_tv": 0.038461538461538464 + }, + "period_at_s0": { + "tokens": 130, + "ordered_topk_exact_tokens": 82, + "set_exact_tokens": 99, + "mean_set_jaccard": 0.9318681318681321, + "mean_token_weighted_tv": 0.017506193247838663, + "aggregate_load_tv": 0.021794871794871794 + }, + "period_at_s1": { + "tokens": 130, + "ordered_topk_exact_tokens": 68, + "set_exact_tokens": 84, + "mean_set_jaccard": 0.8906593406593407, + "mean_token_weighted_tv": 0.02515755109488964, + "aggregate_load_tv": 0.037179487179487186 + } + } + }, + "layer_06": { + "layer": 6, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "fb288971e5bd983fd63c2fbaadb1355a462f60c1d49f6af8a0f07c28e53c51df", + "route_weight_sha256": "8b661f42c71a9b6275576e11df02f01bd1136897419f1cc2a8d2027da939209a", + "loads": [ + 14, + 3, + 8, + 13, + 1, + 11, + 10, + 23, + 26, + 15, + 10, + 10, + 17, + 4, + 35, + 22, + 12, + 6, + 16, + 10, + 10, + 15, + 8, + 5, + 10, + 23, + 7, + 5, + 41, + 8, + 29, + 5, + 4, + 7, + 10, + 3, + 26, + 1, + 17, + 4, + 20, + 4, + 3, + 17, + 17, + 4, + 1, + 7, + 1, + 11, + 8, + 18, + 26, + 13, + 29, + 4, + 6, + 12, + 8, + 11, + 4, + 26, + 16, + 10 + ], + "weighted_loads": [ + 0.7799518369138241, + 0.11794896796345711, + 0.3973611183464527, + 0.7866201549768448, + 0.05041777715086937, + 0.9463859535753727, + 0.6902085617184639, + 1.6778218299150467, + 2.196448365226388, + 0.8839012645184994, + 0.7408057320863008, + 0.6924419514834881, + 1.8752468526363373, + 0.19786371290683746, + 2.164784949272871, + 1.146109078079462, + 0.9455116391181946, + 0.3250981941819191, + 1.2686206325888634, + 0.6189186498522758, + 0.6477397903800011, + 1.187478020787239, + 0.294040322303772, + 0.1954217031598091, + 0.45287924632430077, + 1.3599687088280916, + 0.26085113547742367, + 0.3318221941590309, + 3.6803595013916492, + 0.38281961902976036, + 2.2552713081240654, + 0.30350031331181526, + 0.14740508422255516, + 0.35002998635172844, + 1.0684271045029163, + 0.19572699442505836, + 2.505048982799053, + 0.08523362874984741, + 1.5802838169038296, + 0.13516277074813843, + 1.5622519627213478, + 0.2541271969676018, + 0.1274774931371212, + 1.151146974414587, + 1.3847643565386534, + 0.1563711315393448, + 0.039451923221349716, + 0.35877493396401405, + 0.02582450769841671, + 1.0181721542030573, + 0.5358795672655106, + 1.4993866551667452, + 1.9663887210190296, + 0.6449566520750523, + 2.1797566562891006, + 0.22724824026226997, + 0.453290693461895, + 0.7688119597733021, + 0.516783095896244, + 0.5876644849777222, + 0.22929717227816582, + 1.6358042899519205, + 0.729422315955162, + 0.6898772269487381 + ], + "unique_experts": 64, + "load_cv": 0.7188090083829949, + "normalized_load_entropy": 0.9407147756510922, + "max_load_share": 0.052564102564102565 + }, + "full_input": { + "tokens": 155, + "top_k": 6, + "decisions": 930, + "ordered_route_sha256": "5ddcb00cd5f5cc161d0c37e31012bec085f5193b9c8fc692e7c72199de19c715", + "route_weight_sha256": "f544a4f50e943b8d5f36dab1ae984217e4336275046e086b08d8ae50d50b3c44", + "loads": [ + 14, + 6, + 8, + 13, + 2, + 11, + 18, + 23, + 26, + 15, + 10, + 16, + 17, + 7, + 37, + 22, + 17, + 7, + 16, + 18, + 11, + 19, + 11, + 6, + 10, + 24, + 7, + 6, + 41, + 11, + 29, + 5, + 8, + 7, + 11, + 8, + 26, + 8, + 17, + 14, + 20, + 10, + 5, + 17, + 17, + 9, + 13, + 9, + 5, + 11, + 14, + 25, + 26, + 13, + 29, + 14, + 15, + 12, + 8, + 20, + 4, + 26, + 16, + 10 + ], + "weighted_loads": [ + 0.7799518369138241, + 0.18877664767205715, + 0.3973611183464527, + 0.7866201549768448, + 0.07909260503947735, + 0.9463859535753727, + 1.5608947575092316, + 1.6778218299150467, + 2.196448365226388, + 0.8839012645184994, + 0.7408057320863008, + 1.1023151874542236, + 1.8752468526363373, + 0.292737515643239, + 2.3092893101274967, + 1.146109078079462, + 1.30889056250453, + 0.3291430789977312, + 1.2686206325888634, + 1.1231009885668755, + 0.6921329982578754, + 1.4141751546412706, + 1.8159741163253784, + 0.23113302886486053, + 0.45287924632430077, + 1.3876120708882809, + 0.26085113547742367, + 0.5193980112671852, + 3.6803595013916492, + 0.5530927926301956, + 2.2552713081240654, + 0.30350031331181526, + 0.3078829012811184, + 0.35002998635172844, + 1.1029166132211685, + 0.6552344635128975, + 2.505048982799053, + 0.7000084854662418, + 1.5802838169038296, + 0.5386982318013906, + 1.5622519627213478, + 0.7569702006876469, + 0.18555809184908867, + 1.151146974414587, + 1.3847643565386534, + 0.2893180726096034, + 1.3543054014444351, + 0.3811249507125467, + 0.23947998695075512, + 1.0181721542030573, + 1.0512829571962357, + 1.8067611586302519, + 1.9663887210190296, + 0.6449566520750523, + 2.1797566562891006, + 0.9917839653789997, + 1.6939610354602337, + 0.7688119597733021, + 0.516783095896244, + 1.5447180531919003, + 0.22929717227816582, + 1.6358042899519205, + 0.729422315955162, + 0.6898772269487381 + ], + "unique_experts": 64, + "load_cv": 0.5474332839442492, + "normalized_load_entropy": 0.9660198452614408, + "max_load_share": 0.04408602150537634 + } + }, + "s1_eos": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "8fc7301cb8c91024587a15956f47fcd13ca913876fbc634a49fbc54201e8ea69", + "route_weight_sha256": "fc59f02d2a59114bcaeb8399717f76d5d1ccd240d9e52146ed8a42264137227f", + "loads": [ + 14, + 3, + 8, + 13, + 1, + 11, + 9, + 22, + 26, + 14, + 10, + 10, + 17, + 4, + 34, + 22, + 12, + 6, + 16, + 9, + 11, + 15, + 7, + 5, + 10, + 24, + 8, + 5, + 41, + 8, + 30, + 6, + 4, + 7, + 10, + 3, + 24, + 1, + 18, + 2, + 21, + 5, + 3, + 17, + 17, + 5, + 1, + 7, + 1, + 11, + 8, + 18, + 25, + 13, + 29, + 4, + 7, + 12, + 8, + 11, + 4, + 27, + 16, + 10 + ], + "weighted_loads": [ + 0.7774701081216335, + 0.11806407570838928, + 0.4018842428922653, + 0.7889542058110237, + 0.051999349147081375, + 0.9416721314191818, + 0.6382794827222824, + 1.6337519511580467, + 2.1772189680486917, + 0.8415553569793701, + 0.7257350608706474, + 0.686727873980999, + 1.8861020803451538, + 0.19718331471085548, + 2.1164201460778713, + 1.1642209067940712, + 0.9444936960935593, + 0.33483240753412247, + 1.2744233831763268, + 0.5773731358349323, + 0.6918541453778744, + 1.1774321272969246, + 0.2621189095079899, + 0.1926364880055189, + 0.4593186639249325, + 1.3982551433146, + 0.2931751646101475, + 0.3189086318016052, + 3.6521939635276794, + 0.38243793696165085, + 2.256439570337534, + 0.3355531692504883, + 0.14585945010185242, + 0.3579676542431116, + 1.0631943307816982, + 0.18892308697104454, + 2.429596785455942, + 0.08117614686489105, + 1.600503847002983, + 0.06620411947369576, + 1.581372920423746, + 0.2925746999680996, + 0.12028636783361435, + 1.1501365788280964, + 1.378139615058899, + 0.1863169763237238, + 0.040841907262802124, + 0.3593725301325321, + 0.02579716593027115, + 1.0106890723109245, + 0.5219097808003426, + 1.5165429413318634, + 1.92897854372859, + 0.6489245593547821, + 2.194786172360182, + 0.22551888041198254, + 0.48215651139616966, + 0.7632568851113319, + 0.5089664198458195, + 0.5898475237190723, + 0.22840029746294022, + 1.6869069319218397, + 0.7182744853198528, + 0.6924678198993206 + ], + "unique_experts": 64, + "load_cv": 0.7154351604237422, + "normalized_load_entropy": 0.9410337520258858, + "max_load_share": 0.052564102564102565 + }, + "full_input": { + "tokens": 171, + "top_k": 6, + "decisions": 1026, + "ordered_route_sha256": "b95bf4277c0033d9c502c14a1a8302aeb694f5c3f238b040b3c950b171bc014f", + "route_weight_sha256": "7ca33b5dce27b0c160b964415f34684cf5c8ec40e42b8365898cff8e65944d00", + "loads": [ + 14, + 5, + 11, + 14, + 3, + 11, + 23, + 23, + 31, + 20, + 10, + 20, + 21, + 7, + 43, + 23, + 22, + 7, + 18, + 19, + 13, + 20, + 9, + 6, + 11, + 25, + 8, + 7, + 42, + 11, + 30, + 9, + 11, + 8, + 14, + 10, + 25, + 16, + 18, + 12, + 21, + 11, + 5, + 17, + 18, + 9, + 17, + 9, + 4, + 11, + 16, + 24, + 26, + 16, + 29, + 15, + 23, + 12, + 8, + 22, + 10, + 27, + 16, + 10 + ], + "weighted_loads": [ + 0.7774701081216335, + 0.15766752557829022, + 0.5447166860103607, + 0.8265975452959538, + 0.20369331166148186, + 0.9416721314191818, + 1.8981046546250582, + 1.694805383682251, + 2.5162399504333735, + 1.546366848051548, + 0.7257350608706474, + 1.3572255559265614, + 2.2150072678923607, + 0.2974061965942383, + 2.7936771027743816, + 1.2754140123724937, + 1.7339726388454437, + 0.3389020557515323, + 1.4219111204147339, + 1.2783303074538708, + 0.7829632125794888, + 1.4828344266861677, + 1.7541113831102848, + 0.22798768989741802, + 0.49212105199694633, + 1.4335577078163624, + 0.2931751646101475, + 0.5355343371629715, + 3.6889258809387684, + 0.5745373442769051, + 2.256439570337534, + 0.5341946817934513, + 0.3978241868317127, + 0.3919952791184187, + 1.3206799738109112, + 0.8612289577722549, + 2.4641133174300194, + 1.2725357823073864, + 1.600503847002983, + 0.5803823284804821, + 1.581372920423746, + 0.8128722459077835, + 0.1782168298959732, + 1.1501365788280964, + 1.4630389288067818, + 0.2850595065392554, + 1.686501620337367, + 0.3817563659977168, + 0.2012205570936203, + 1.0106890723109245, + 1.1738822981715202, + 1.7559540905058384, + 1.965815857052803, + 0.8158861547708511, + 2.194786172360182, + 1.2428568918257952, + 2.341812063008547, + 0.7632568851113319, + 0.5089664198458195, + 1.641930427402258, + 0.5346454456448555, + 1.6869069319218397, + 0.7182744853198528, + 0.6924678198993206 + ], + "unique_experts": 64, + "load_cv": 0.5224717029505883, + "normalized_load_entropy": 0.9686624069754796, + "max_load_share": 0.04191033138401559 + } + }, + "s0_bos": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "5fb643c3652682dec59dd0346b1f2512d19a4651195ab02a180101e94dbbdfb2", + "route_weight_sha256": "7b75b44e909448b812bfb20807b976915289db5f2ddc1940fd4bb207a94dfe48", + "loads": [ + 12, + 4, + 7, + 14, + 2, + 13, + 10, + 22, + 28, + 16, + 10, + 9, + 17, + 4, + 31, + 21, + 12, + 5, + 16, + 11, + 9, + 15, + 8, + 5, + 10, + 23, + 5, + 4, + 42, + 8, + 32, + 7, + 3, + 6, + 10, + 3, + 24, + 2, + 17, + 4, + 20, + 5, + 3, + 16, + 17, + 4, + 1, + 6, + 1, + 12, + 8, + 20, + 27, + 13, + 28, + 4, + 7, + 12, + 7, + 10, + 5, + 27, + 15, + 11 + ], + "weighted_loads": [ + 0.7183273024857044, + 0.15507915243506432, + 0.3702973909676075, + 0.8303718902170658, + 0.08479424938559532, + 1.0143008530139923, + 0.7317488640546799, + 1.6250165067613125, + 2.254536397755146, + 0.929230161011219, + 0.7242257334291935, + 0.6183846779167652, + 1.8553169071674347, + 0.20423131994903088, + 1.9958071690052748, + 1.1290586069226265, + 0.966532364487648, + 0.3053337633609772, + 1.2838437631726265, + 0.6672274768352509, + 0.6064285077154636, + 1.186567772179842, + 0.28944206796586514, + 0.20116278156638145, + 0.4685213938355446, + 1.357718363404274, + 0.19874874502420425, + 0.2864246368408203, + 3.740530304610729, + 0.3853796049952507, + 2.3238809052854776, + 0.3667034711688757, + 0.11264010146260262, + 0.32273952290415764, + 1.0637445598840714, + 0.19418129324913025, + 2.440113939344883, + 0.11280594393610954, + 1.5872203893959522, + 0.1358104944229126, + 1.5329876691102982, + 0.29389818012714386, + 0.12198683619499207, + 1.144727686420083, + 1.3772299885749817, + 0.14921801164746284, + 0.03791840374469757, + 0.31674133613705635, + 0.02728770300745964, + 1.04030042886734, + 0.5615802519023418, + 1.5956019163131714, + 2.004717081785202, + 0.6561204008758068, + 2.193528223782778, + 0.2348259687423706, + 0.5157288983464241, + 0.7756146416068077, + 0.4809004683047533, + 0.5650594942271709, + 0.27539150044322014, + 1.720196297392249, + 0.6812159232795238, + 0.735598050057888 + ], + "unique_experts": 64, + "load_cv": 0.7191016383919144, + "normalized_load_entropy": 0.9414357454767202, + "max_load_share": 0.05384615384615385 + }, + "full_input": { + "tokens": 155, + "top_k": 6, + "decisions": 930, + "ordered_route_sha256": "d6b970d772b8c956ca814f46b213937dbf790ec3346dbdeeea92088219fd7bdc", + "route_weight_sha256": "50f0b3e5a125306d7fc8b5fcdb07dc2f34fc34632f620b74d31c5aa8af089f6d", + "loads": [ + 12, + 6, + 7, + 14, + 3, + 13, + 18, + 22, + 28, + 16, + 10, + 15, + 17, + 6, + 34, + 22, + 18, + 5, + 16, + 19, + 10, + 19, + 10, + 6, + 10, + 24, + 5, + 5, + 42, + 12, + 32, + 7, + 6, + 6, + 11, + 8, + 24, + 10, + 17, + 14, + 20, + 11, + 5, + 16, + 17, + 8, + 14, + 7, + 5, + 12, + 15, + 27, + 27, + 13, + 28, + 14, + 16, + 12, + 7, + 19, + 5, + 27, + 15, + 11 + ], + "weighted_loads": [ + 0.7183273024857044, + 0.2211808990687132, + 0.3702973909676075, + 0.8303718902170658, + 0.1134690772742033, + 1.0143008530139923, + 1.6006918475031853, + 1.6250165067613125, + 2.254536397755146, + 0.929230161011219, + 0.7242257334291935, + 1.039052426815033, + 1.8553169071674347, + 0.2954149693250656, + 2.1933420319110155, + 1.1757049411535263, + 1.3748664520680904, + 0.3053337633609772, + 1.2838437631726265, + 1.1587743163108826, + 0.650821715593338, + 1.422879347577691, + 0.8635629471391439, + 0.23687410727143288, + 0.4685213938355446, + 1.3853617254644632, + 0.19874874502420425, + 0.4910818934440613, + 3.740530304610729, + 0.6093484088778496, + 2.3238809052854776, + 0.3667034711688757, + 0.2281823456287384, + 0.32273952290415764, + 1.0982340686023235, + 0.6566442586481571, + 2.440113939344883, + 0.7866923287510872, + 1.5872203893959522, + 0.5321104284375906, + 1.5329876691102982, + 0.7945077382028103, + 0.18006743490695953, + 1.144727686420083, + 1.3772299885749817, + 0.2781368400901556, + 1.5585993342101574, + 0.3358443584293127, + 0.24048906192183495, + 1.04030042886734, + 1.149916585534811, + 1.902976419776678, + 2.004717081785202, + 0.6561204008758068, + 2.193528223782778, + 0.9993616938591003, + 1.7973661348223686, + 0.7756146416068077, + 0.4809004683047533, + 1.522113062441349, + 0.27539150044322014, + 1.720196297392249, + 0.6812159232795238, + 0.735598050057888 + ], + "unique_experts": 64, + "load_cv": 0.5592018162447961, + "normalized_load_entropy": 0.9644128473190551, + "max_load_share": 0.04516129032258064 + } + }, + "s1_bos": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "1183ed938f692769015a0300049550f7d3d98c3a2accf373e0b4c50f4faf0035", + "route_weight_sha256": "67d2eadc6fd457ae0f5cd990abb102660c12eed2e4d05f4de58fd0b5c6ae2aee", + "loads": [ + 12, + 3, + 7, + 13, + 2, + 13, + 11, + 22, + 27, + 15, + 8, + 9, + 17, + 4, + 32, + 22, + 13, + 6, + 16, + 11, + 11, + 16, + 8, + 5, + 11, + 22, + 6, + 3, + 41, + 7, + 32, + 6, + 3, + 6, + 10, + 4, + 24, + 2, + 16, + 2, + 21, + 5, + 2, + 16, + 17, + 5, + 0, + 8, + 1, + 11, + 8, + 18, + 26, + 13, + 29, + 4, + 7, + 12, + 7, + 10, + 7, + 28, + 16, + 11 + ], + "weighted_loads": [ + 0.6946693100035191, + 0.11596081778407097, + 0.36798523738980293, + 0.7903032638132572, + 0.0933016799390316, + 0.9886608365923166, + 0.7554548531770706, + 1.5955187007784843, + 2.193243881687522, + 0.8961981758475304, + 0.6418169271200895, + 0.6248014383018017, + 1.8567008897662163, + 0.20224120281636715, + 2.071819707751274, + 1.1438697446137667, + 1.007343977689743, + 0.34220879152417183, + 1.2927331514656544, + 0.6747948043048382, + 0.6979184746742249, + 1.219210159033537, + 0.2998611256480217, + 0.19680384173989296, + 0.526700884103775, + 1.296125115826726, + 0.22330757416784763, + 0.2320617362856865, + 3.612884573638439, + 0.3429882563650608, + 2.3071414157748222, + 0.33113742247223854, + 0.11092221736907959, + 0.32046450674533844, + 1.0607689432799816, + 0.21316422708332539, + 2.4164331257343292, + 0.10365813598036766, + 1.5228504091501236, + 0.06313571333885193, + 1.574039313942194, + 0.30443714931607246, + 0.09656788781285286, + 1.150035435333848, + 1.3638467770069838, + 0.17974877916276455, + 0.0, + 0.3802435081452131, + 0.02718479000031948, + 1.0091699361801147, + 0.5551306866109371, + 1.5223804246634245, + 1.942296702414751, + 0.6521865800023079, + 2.244487790390849, + 0.21189680695533752, + 0.5133067257702351, + 0.7808818370103836, + 0.4651661366224289, + 0.5620295740664005, + 0.35411452502012253, + 1.7537949550896883, + 0.7256879583001137, + 0.7164100483059883 + ], + "unique_experts": 63, + "load_cv": 0.7188090083829949, + "normalized_load_entropy": 0.9400852109017259, + "max_load_share": 0.052564102564102565 + }, + "full_input": { + "tokens": 171, + "top_k": 6, + "decisions": 1026, + "ordered_route_sha256": "755ca0de428fcce5a301a486c13b60f55dfe9d0e00032be6a0593623c797b4c7", + "route_weight_sha256": "b6a0c71b644b936bd72a0c33d533c5aa2508c55c92153b27d8197cda6d0b4d3e", + "loads": [ + 12, + 4, + 10, + 14, + 4, + 13, + 26, + 23, + 32, + 21, + 8, + 19, + 21, + 6, + 41, + 24, + 24, + 6, + 18, + 21, + 13, + 21, + 9, + 6, + 12, + 23, + 6, + 5, + 42, + 10, + 32, + 9, + 10, + 7, + 14, + 11, + 25, + 18, + 16, + 11, + 21, + 11, + 4, + 16, + 18, + 8, + 16, + 11, + 4, + 11, + 17, + 24, + 27, + 16, + 29, + 15, + 23, + 12, + 7, + 21, + 13, + 28, + 16, + 11 + ], + "weighted_loads": [ + 0.6946693100035191, + 0.1507994532585144, + 0.5108176805078983, + 0.8279466032981873, + 0.24499564245343208, + 0.9886608365923166, + 2.073857283219695, + 1.6565721333026886, + 2.5322648640722036, + 1.6010096669197083, + 0.6418169271200895, + 1.307317066937685, + 2.185606077313423, + 0.2956198751926422, + 2.761472187936306, + 1.3069466408342123, + 1.8404761403799057, + 0.34220879152417183, + 1.4402208887040615, + 1.3723889291286469, + 0.7890275418758392, + 1.5438376758247614, + 0.8460104987025261, + 0.23215504363179207, + 0.5595032721757889, + 1.3314276803284883, + 0.22330757416784763, + 0.4170933738350868, + 3.649616491049528, + 0.5436005368828773, + 2.3071414157748222, + 0.5297789350152016, + 0.3598882593214512, + 0.3544921316206455, + 1.3182545863091946, + 0.8921752031892538, + 2.4509496577084064, + 1.3700693435966969, + 1.5228504091501236, + 0.5385597571730614, + 1.574039313942194, + 0.8251244276762009, + 0.15449834987521172, + 1.150035435333848, + 1.4487460907548666, + 0.27472159266471863, + 1.772859638556838, + 0.493141233921051, + 0.20794900692999363, + 1.0091699361801147, + 1.2831365540623665, + 1.7617915738373995, + 1.979134015738964, + 0.8191481754183769, + 2.244487790390849, + 1.2292348183691502, + 2.414943389594555, + 0.7808818370103836, + 0.4651661366224289, + 1.614112477749586, + 0.6603596732020378, + 1.7537949550896883, + 0.7256879583001137, + 0.7164100483059883 + ], + "unique_experts": 64, + "load_cv": 0.5382906020582289, + "normalized_load_entropy": 0.9660412214267506, + "max_load_share": 0.04093567251461988 + } + }, + "s0_x": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "1ee425da866aca64f8f7d3d3999dd0350afb78797520d2e3583462a8392e43c9", + "route_weight_sha256": "71611b6e804a7f45dbc9e3850a04aa843c7b43ae45d36ed4405491bdb5cd986f", + "loads": [ + 12, + 3, + 7, + 14, + 2, + 13, + 10, + 21, + 27, + 15, + 10, + 9, + 17, + 4, + 32, + 21, + 13, + 5, + 16, + 11, + 9, + 15, + 8, + 5, + 10, + 22, + 4, + 5, + 42, + 7, + 34, + 8, + 3, + 6, + 10, + 3, + 25, + 2, + 17, + 4, + 20, + 5, + 3, + 16, + 17, + 4, + 1, + 7, + 1, + 12, + 8, + 19, + 27, + 14, + 28, + 4, + 6, + 12, + 7, + 10, + 6, + 27, + 14, + 11 + ], + "weighted_loads": [ + 0.7047542706131935, + 0.11652249842882156, + 0.3554535582661629, + 0.8348719216883183, + 0.08348169550299644, + 1.0067436173558235, + 0.705707598477602, + 1.5464722625911236, + 2.218128841370344, + 0.8800779934972525, + 0.7560487370938063, + 0.6423450075089931, + 1.82404275983572, + 0.2054703999310732, + 2.0460968781262636, + 1.1307317428290844, + 1.0042643994092941, + 0.30026059225201607, + 1.2902228347957134, + 0.6535798776894808, + 0.6152373179793358, + 1.1593523249030113, + 0.3065490238368511, + 0.2072511725127697, + 0.446372352540493, + 1.3140878789126873, + 0.15402742847800255, + 0.31768730096518993, + 3.674695484340191, + 0.3402029760181904, + 2.3709155432879925, + 0.3915718346834183, + 0.11208894476294518, + 0.31586145609617233, + 1.0639360286295414, + 0.20879586040973663, + 2.4816789627075195, + 0.11314146593213081, + 1.5873729921877384, + 0.1368611864745617, + 1.5257886536419392, + 0.291462242603302, + 0.11973380111157894, + 1.1409014910459518, + 1.3624988161027431, + 0.1488501913845539, + 0.03988870605826378, + 0.3489505760371685, + 0.025936512276530266, + 1.0419494193047285, + 0.586344450712204, + 1.55446108430624, + 1.9757987558841705, + 0.7138880044221878, + 2.129180047661066, + 0.21940527856349945, + 0.4572758860886097, + 0.7633272297680378, + 0.48262701369822025, + 0.5666211545467377, + 0.3046279363334179, + 1.6782005578279495, + 0.6531601846218109, + 0.7107542864978313 + ], + "unique_experts": 64, + "load_cv": 0.723331470016415, + "normalized_load_entropy": 0.9410218155544731, + "max_load_share": 0.05384615384615385 + }, + "full_input": { + "tokens": 155, + "top_k": 6, + "decisions": 930, + "ordered_route_sha256": "6e01f25729cf1c9a8b11efb9771be9dc7408e73a0a348d42cdac96b4b7286c19", + "route_weight_sha256": "a639ab43ac4712bc1474c89be8a58c58e0a53ca3d9bf3fc49e601653817fe91b", + "loads": [ + 12, + 5, + 7, + 14, + 3, + 13, + 20, + 21, + 27, + 15, + 10, + 14, + 17, + 6, + 35, + 22, + 18, + 5, + 16, + 20, + 10, + 19, + 10, + 6, + 10, + 23, + 4, + 6, + 42, + 10, + 34, + 8, + 6, + 6, + 11, + 8, + 25, + 10, + 17, + 13, + 20, + 13, + 5, + 16, + 17, + 8, + 13, + 8, + 5, + 12, + 13, + 27, + 27, + 14, + 28, + 15, + 14, + 12, + 7, + 20, + 6, + 27, + 14, + 11 + ], + "weighted_loads": [ + 0.7047542706131935, + 0.18262424506247044, + 0.3554535582661629, + 0.8348719216883183, + 0.11215652339160442, + 1.0067436173558235, + 1.8884393572807312, + 1.5464722625911236, + 2.218128841370344, + 0.8800779934972525, + 0.7560487370938063, + 1.001134216785431, + 1.82404275983572, + 0.28456807136535645, + 2.2427547108381987, + 1.1742887049913406, + 1.3608756549656391, + 0.30026059225201607, + 1.2902228347957134, + 1.2217925246804953, + 0.6596305258572102, + 1.3829227183014154, + 0.8806699030101299, + 0.24296249821782112, + 0.446372352540493, + 1.3417312409728765, + 0.15402742847800255, + 0.46443225257098675, + 3.674695484340191, + 0.5162921845912933, + 2.3709155432879925, + 0.3915718346834183, + 0.2214178517460823, + 0.31586145609617233, + 1.0984255373477936, + 0.6879572011530399, + 2.4816789627075195, + 0.7427838891744614, + 1.5873729921877384, + 0.4904699195176363, + 1.5257886536419392, + 0.9255078174173832, + 0.1778143998235464, + 1.1409014910459518, + 1.3624988161027431, + 0.27776901982724667, + 1.3051243871450424, + 0.36805359832942486, + 0.242346053943038, + 1.0419494193047285, + 1.0477887988090515, + 1.8972862176597118, + 1.9757987558841705, + 0.7138880044221878, + 2.129180047661066, + 1.0393197275698185, + 1.6038374528288841, + 0.7633272297680378, + 0.48262701369822025, + 1.5995712019503117, + 0.3046279363334179, + 1.6782005578279495, + 0.6531601846218109, + 0.7107542864978313 + ], + "unique_experts": 64, + "load_cv": 0.5652560435127733, + "normalized_load_entropy": 0.9639687097345151, + "max_load_share": 0.04516129032258064 + } + }, + "s1_x": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "0516d9a1655a20c6e575e9880c74b8772bd06b31cf71100128fec6fd6a03d2ca", + "route_weight_sha256": "4d0f20b846ac44eba0fd9f3604911d302bac3885ec2a2ed73bccf5a4c2e8d5a4", + "loads": [ + 12, + 3, + 8, + 12, + 2, + 13, + 11, + 21, + 27, + 16, + 8, + 9, + 17, + 4, + 33, + 20, + 13, + 5, + 16, + 11, + 10, + 16, + 8, + 5, + 11, + 22, + 6, + 5, + 41, + 8, + 32, + 5, + 3, + 6, + 11, + 3, + 24, + 2, + 16, + 2, + 21, + 5, + 3, + 17, + 16, + 5, + 1, + 9, + 1, + 11, + 8, + 18, + 26, + 13, + 29, + 4, + 7, + 12, + 8, + 10, + 7, + 26, + 15, + 11 + ], + "weighted_loads": [ + 0.6886478923261166, + 0.11295151337981224, + 0.3957859668880701, + 0.7535912580788136, + 0.09250187501311302, + 0.9739225097000599, + 0.7501573041081429, + 1.5101185590028763, + 2.1831692215055227, + 0.9149657990783453, + 0.6249631159007549, + 0.6260353550314903, + 1.8379867896437645, + 0.20619837380945683, + 2.1333784572780132, + 1.0874766949564219, + 1.0015134401619434, + 0.29181234538555145, + 1.300661239773035, + 0.6518504098057747, + 0.6624698638916016, + 1.1909150816500187, + 0.30326708406209946, + 0.19665204733610153, + 0.5230408050119877, + 1.2974885869771242, + 0.21880549378693104, + 0.31523463875055313, + 3.4948107842355967, + 0.378019817173481, + 2.2485573329031467, + 0.2910170704126358, + 0.10762592032551765, + 0.3211368005722761, + 1.1149556450545788, + 0.19014940410852432, + 2.4130071997642517, + 0.10398722067475319, + 1.52768025547266, + 0.06275907903909683, + 1.5647052079439163, + 0.30400654301047325, + 0.1252797208726406, + 1.1795210633426905, + 1.2892306856811047, + 0.17972051724791527, + 0.04243415594100952, + 0.4143725633621216, + 0.02644699439406395, + 1.007225014269352, + 0.560187354683876, + 1.518202230334282, + 1.9443143345415592, + 0.6563346050679684, + 2.193785408511758, + 0.2102868277579546, + 0.4667349047958851, + 0.763270229101181, + 0.48248582147061825, + 0.5661260783672333, + 0.3472588285803795, + 1.6419388055801392, + 0.6957348622381687, + 0.6980354450643063 + ], + "unique_experts": 64, + "load_cv": 0.7084908166969087, + "normalized_load_entropy": 0.9427378387674619, + "max_load_share": 0.052564102564102565 + }, + "full_input": { + "tokens": 171, + "top_k": 6, + "decisions": 1026, + "ordered_route_sha256": "86e0f85fa13e736a09c6e22934cb0ed055a59e4948a5f06a2759669f88fb18cc", + "route_weight_sha256": "c21c7fbbe3a97f9b409092efaba2b9e12a77390ee01d08d56c7514ee80377f01", + "loads": [ + 12, + 4, + 11, + 13, + 4, + 13, + 29, + 22, + 32, + 22, + 8, + 18, + 21, + 6, + 42, + 22, + 22, + 5, + 18, + 23, + 12, + 21, + 9, + 6, + 12, + 23, + 6, + 7, + 42, + 11, + 32, + 8, + 9, + 7, + 15, + 10, + 25, + 17, + 16, + 11, + 21, + 13, + 5, + 17, + 17, + 8, + 16, + 10, + 4, + 11, + 16, + 25, + 27, + 16, + 29, + 16, + 22, + 12, + 8, + 22, + 13, + 26, + 15, + 11 + ], + "weighted_loads": [ + 0.6886478923261166, + 0.14779014885425568, + 0.5386184100061655, + 0.7912345975637436, + 0.2441958375275135, + 0.9739225097000599, + 2.4695876594632864, + 1.5711719915270805, + 2.5221902038902044, + 1.6197772901505232, + 0.6249631159007549, + 1.2515877597033978, + 2.1668919771909714, + 0.28451837599277496, + 2.8237173594534397, + 1.2651900369673967, + 1.7471731901168823, + 0.29181234538555145, + 1.4481489770114422, + 1.4423582628369331, + 0.7535789310932159, + 1.5009484756737947, + 0.8494164571166039, + 0.23200324922800064, + 0.5558431930840015, + 1.3327911514788866, + 0.21880549378693104, + 0.45318741351366043, + 3.5315427016466856, + 0.5734521113336086, + 2.2485573329031467, + 0.48965858295559883, + 0.31250791251659393, + 0.3551644254475832, + 1.3724412880837917, + 0.8589296825230122, + 2.447523731738329, + 1.238030344247818, + 1.52768025547266, + 0.5381831228733063, + 1.5647052079439163, + 0.9542284049093723, + 0.18321018293499947, + 1.1795210633426905, + 1.3741299994289875, + 0.27469333074986935, + 1.5783393736928701, + 0.43347558565437794, + 0.2047760672867298, + 1.007225014269352, + 1.203687161207199, + 1.7866190150380135, + 1.9811516478657722, + 0.8232962004840374, + 2.193785408511758, + 1.297644978389144, + 2.1908413022756577, + 0.763270229101181, + 0.48248582147061825, + 1.6888912916183472, + 0.6535039767622948, + 1.6419388055801392, + 0.6957348622381687, + 0.6980354450643063 + ], + "unique_experts": 64, + "load_cv": 0.5387421941327749, + "normalized_load_entropy": 0.9663476940818838, + "max_load_share": 0.04093567251461988 + } + }, + "s0_period": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "3c6b2d9962b4327bab276179568ac5b360ef4cdfc36d7f5f83de5fcba620552b", + "route_weight_sha256": "fd56fcc8e288aaa2a8004b52f3c266fbb13a7586140d1664901e18534bc8014b", + "loads": [ + 12, + 3, + 7, + 13, + 2, + 13, + 10, + 22, + 27, + 15, + 10, + 9, + 17, + 4, + 32, + 22, + 13, + 5, + 16, + 11, + 9, + 15, + 9, + 5, + 10, + 22, + 5, + 4, + 41, + 6, + 33, + 7, + 3, + 6, + 10, + 3, + 24, + 3, + 17, + 4, + 20, + 5, + 3, + 16, + 17, + 4, + 1, + 7, + 1, + 12, + 8, + 19, + 26, + 15, + 28, + 4, + 6, + 13, + 7, + 10, + 6, + 26, + 16, + 11 + ], + "weighted_loads": [ + 0.7015494704246521, + 0.11713439971208572, + 0.34793202206492424, + 0.7877413779497147, + 0.08508071303367615, + 1.004327593371272, + 0.7014810666441917, + 1.5888693667948246, + 2.2346437387168407, + 0.8864987622946501, + 0.7492477763444185, + 0.6429266296327114, + 1.8220513761043549, + 0.2052400205284357, + 2.054620074108243, + 1.1547713354229927, + 0.9963158555328846, + 0.2994283400475979, + 1.280842587351799, + 0.6570793651044369, + 0.6180754005908966, + 1.1519590429961681, + 0.34504280239343643, + 0.2047016378492117, + 0.44175078719854355, + 1.2989879697561264, + 0.19779492542147636, + 0.267870519310236, + 3.5850852578878403, + 0.2974863089621067, + 2.3587478920817375, + 0.360953850671649, + 0.11122959479689598, + 0.3174245860427618, + 1.0653494372963905, + 0.20730634406208992, + 2.430463843047619, + 0.14827195182442665, + 1.5911073312163353, + 0.1366167776286602, + 1.5277957394719124, + 0.29110244289040565, + 0.12125525996088982, + 1.1323709189891815, + 1.3550893776118755, + 0.14673635736107826, + 0.04173829406499863, + 0.3454018570482731, + 0.026126768440008163, + 1.0451532416045666, + 0.591966487467289, + 1.5519375950098038, + 1.9399772807955742, + 0.7438090853393078, + 2.132956188172102, + 0.22511309757828712, + 0.4678914062678814, + 0.7947132922708988, + 0.4763137884438038, + 0.5633058063685894, + 0.2989225760102272, + 1.623733475804329, + 0.7167148217558861, + 0.7120915651321411 + ], + "unique_experts": 64, + "load_cv": 0.7132262265439429, + "normalized_load_entropy": 0.9421557499301297, + "max_load_share": 0.052564102564102565 + }, + "full_input": { + "tokens": 155, + "top_k": 6, + "decisions": 930, + "ordered_route_sha256": "97d0e71063c7355430f030d9da783d2414a8deca03b11c7a8a497ef8eeff98bd", + "route_weight_sha256": "9285c7b56dec57a993bf25f5ab6a5c195f1cee0524fddda7ef0381c2370f9057", + "loads": [ + 12, + 5, + 7, + 13, + 3, + 13, + 20, + 22, + 27, + 15, + 10, + 14, + 18, + 6, + 34, + 23, + 18, + 5, + 16, + 21, + 10, + 19, + 11, + 6, + 10, + 23, + 5, + 5, + 42, + 9, + 33, + 7, + 6, + 6, + 11, + 8, + 24, + 12, + 17, + 12, + 20, + 12, + 5, + 16, + 17, + 8, + 13, + 8, + 5, + 12, + 13, + 27, + 26, + 15, + 28, + 15, + 14, + 13, + 7, + 19, + 6, + 26, + 16, + 11 + ], + "weighted_loads": [ + 0.7015494704246521, + 0.1832361463457346, + 0.34793202206492424, + 0.7877413779497147, + 0.11375554092228413, + 1.004327593371272, + 1.7494873367249966, + 1.5888693667948246, + 2.2346437387168407, + 0.8864987622946501, + 0.7492477763444185, + 0.9932660758495331, + 1.8757690787315369, + 0.2916109599173069, + 2.208698423579335, + 1.1925708167254925, + 1.3439282961189747, + 0.2994283400475979, + 1.280842587351799, + 1.3200261145830154, + 0.662468608468771, + 1.3783391173928976, + 0.9191636815667152, + 0.24041296355426311, + 0.44175078719854355, + 1.3266313318163157, + 0.19779492542147636, + 0.4301527328789234, + 3.688838705420494, + 0.47493926435709, + 2.3587478920817375, + 0.360953850671649, + 0.22348996251821518, + 0.3174245860427618, + 1.0998389460146427, + 0.684089183807373, + 2.430463843047619, + 0.8937477543950081, + 1.5911073312163353, + 0.45451354421675205, + 1.5277957394719124, + 0.8470909520983696, + 0.17933585867285728, + 1.1323709189891815, + 1.3550893776118755, + 0.275655185803771, + 1.319244373589754, + 0.36450487934052944, + 0.23727427050471306, + 1.0451532416045666, + 1.0449243113398552, + 1.8933968096971512, + 1.9399772807955742, + 0.7438090853393078, + 2.132956188172102, + 1.13588822260499, + 1.6292274929583073, + 0.7947132922708988, + 0.4763137884438038, + 1.5203593745827675, + 0.2989225760102272, + 1.623733475804329, + 0.7167148217558861, + 0.7120915651321411 + ], + "unique_experts": 64, + "load_cv": 0.5586722611160337, + "normalized_load_entropy": 0.9645047824738535, + "max_load_share": 0.04516129032258064 + } + }, + "s1_period": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "5ded0031bc5eb32cfd44349900fe41d9c9c11b78c2e7c9ada561636a51d3006f", + "route_weight_sha256": "7d61db8b9602cbc8d3f754ed1f09f4878c07c8712ed2d8a4be09cfd032ef594e", + "loads": [ + 12, + 3, + 7, + 12, + 2, + 14, + 11, + 21, + 28, + 14, + 8, + 9, + 17, + 4, + 32, + 20, + 13, + 5, + 16, + 11, + 11, + 16, + 9, + 5, + 10, + 21, + 6, + 4, + 41, + 8, + 32, + 5, + 3, + 6, + 11, + 3, + 24, + 2, + 16, + 4, + 21, + 5, + 3, + 17, + 16, + 5, + 1, + 9, + 1, + 11, + 8, + 19, + 27, + 13, + 29, + 4, + 7, + 12, + 8, + 10, + 7, + 25, + 15, + 11 + ], + "weighted_loads": [ + 0.6772987768054008, + 0.11113614216446877, + 0.36070120707154274, + 0.7559552900493145, + 0.09477392211556435, + 1.008118873462081, + 0.7443484961986542, + 1.5230830758810043, + 2.2232953924685717, + 0.8494125492870808, + 0.6306211166083813, + 0.6315024830400944, + 1.8193761706352234, + 0.20370515063405037, + 2.098361723124981, + 1.0758325550705194, + 1.001871321350336, + 0.2928522042930126, + 1.279898215085268, + 0.6635984182357788, + 0.7067061252892017, + 1.1838696971535683, + 0.33460552617907524, + 0.1958657018840313, + 0.45608871802687645, + 1.2497116848826408, + 0.22064397111535072, + 0.2718321457505226, + 3.4849030673503876, + 0.3798108287155628, + 2.229979595169425, + 0.2930033728480339, + 0.1077314019203186, + 0.3140895552933216, + 1.1171559765934944, + 0.18619215488433838, + 2.4116066992282867, + 0.11259223148226738, + 1.5256137810647488, + 0.12323172390460968, + 1.5689969323575497, + 0.30195192992687225, + 0.12456009164452553, + 1.1699558179825544, + 1.3042801097035408, + 0.17913580499589443, + 0.04439057782292366, + 0.41467537358403206, + 0.026638692244887352, + 1.0015015602111816, + 0.5730180703103542, + 1.555016441270709, + 1.9851217046380043, + 0.6545730009675026, + 2.19082248583436, + 0.21208111383020878, + 0.4708770252764225, + 0.764756765216589, + 0.480957830324769, + 0.5677779838442802, + 0.3475327268242836, + 1.567205473780632, + 0.6828161515295506, + 0.697134543210268 + ], + "unique_experts": 64, + "load_cv": 0.7053659272939438, + "normalized_load_entropy": 0.9434495898887565, + "max_load_share": 0.052564102564102565 + }, + "full_input": { + "tokens": 171, + "top_k": 6, + "decisions": 1026, + "ordered_route_sha256": "f703a019bc444cbed08a6f020b28fbf87a0a15e142f276d8de26e3982ead3ba7", + "route_weight_sha256": "b809b23c7445cc9b199ad2a896d602512c71cf2864a03039876c50794fa88115", + "loads": [ + 12, + 4, + 10, + 13, + 4, + 14, + 29, + 22, + 33, + 20, + 8, + 18, + 22, + 6, + 41, + 22, + 22, + 5, + 18, + 23, + 13, + 21, + 10, + 6, + 11, + 22, + 6, + 6, + 43, + 11, + 32, + 8, + 9, + 7, + 15, + 10, + 25, + 18, + 16, + 13, + 21, + 11, + 5, + 17, + 17, + 8, + 17, + 10, + 4, + 11, + 15, + 26, + 28, + 16, + 29, + 16, + 22, + 12, + 8, + 21, + 13, + 25, + 15, + 11 + ], + "weighted_loads": [ + 0.6772987768054008, + 0.1459747776389122, + 0.5035336501896381, + 0.7935986295342445, + 0.24646788462996483, + 1.008118873462081, + 2.303124090656638, + 1.5841365084052086, + 2.5623163748532534, + 1.5542240403592587, + 0.6306211166083813, + 1.251701757311821, + 2.213097892701626, + 0.2871334087103605, + 2.7894928976893425, + 1.2406298723071814, + 1.7410960122942924, + 0.2928522042930126, + 1.4273859523236752, + 1.5498620048165321, + 0.7978151924908161, + 1.4998748283833265, + 0.8807548992335796, + 0.2312169037759304, + 0.4888911060988903, + 1.2850142493844032, + 0.22064397111535072, + 0.41955509781837463, + 3.64766738191247, + 0.5755998864769936, + 2.229979595169425, + 0.49164488539099693, + 0.31342656165361404, + 0.3481171801686287, + 1.3746416196227074, + 0.8628304116427898, + 2.446123231202364, + 1.3871053457260132, + 1.5256137810647488, + 0.5986557677388191, + 1.5689969323575497, + 0.8207427971065044, + 0.18249055370688438, + 1.1699558179825544, + 1.3891794234514236, + 0.2741086184978485, + 1.6299544926732779, + 0.4337783958762884, + 0.17434454895555973, + 1.0015015602111816, + 1.148921873420477, + 1.8281200807541609, + 2.0219590179622173, + 0.8215345963835716, + 2.19082248583436, + 1.3618119936436415, + 2.1843316964805126, + 0.764756765216589, + 0.480957830324769, + 1.6198608875274658, + 0.6537778750061989, + 1.567205473780632, + 0.6828161515295506, + 0.697134543210268 + ], + "unique_experts": 64, + "load_cv": 0.54121921515253, + "normalized_load_entropy": 0.9660531234969492, + "max_load_share": 0.04191033138401559 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 130, + "ordered_topk_exact_tokens": 104, + "set_exact_tokens": 116, + "mean_set_jaccard": 0.9692307692307692, + "mean_token_weighted_tv": 0.007773658955613008, + "aggregate_load_tv": 0.01410256410256411 + }, + "system_bos": { + "tokens": 130, + "ordered_topk_exact_tokens": 89, + "set_exact_tokens": 100, + "mean_set_jaccard": 0.9324175824175824, + "mean_token_weighted_tv": 0.014858436613128736, + "aggregate_load_tv": 0.025641025641025637 + }, + "system_x": { + "tokens": 130, + "ordered_topk_exact_tokens": 82, + "set_exact_tokens": 97, + "mean_set_jaccard": 0.9241758241758242, + "mean_token_weighted_tv": 0.017621485280016294, + "aggregate_load_tv": 0.026923076923076925 + }, + "system_period": { + "tokens": 130, + "ordered_topk_exact_tokens": 81, + "set_exact_tokens": 93, + "mean_set_jaccard": 0.9170329670329671, + "mean_token_weighted_tv": 0.01830366008843367, + "aggregate_load_tv": 0.025641025641025644 + }, + "bos_at_s0": { + "tokens": 130, + "ordered_topk_exact_tokens": 75, + "set_exact_tokens": 94, + "mean_set_jaccard": 0.9208791208791209, + "mean_token_weighted_tv": 0.01777869823317115, + "aggregate_load_tv": 0.03205128205128205 + }, + "bos_at_s1": { + "tokens": 130, + "ordered_topk_exact_tokens": 80, + "set_exact_tokens": 95, + "mean_set_jaccard": 0.9230769230769231, + "mean_token_weighted_tv": 0.01828979471555123, + "aggregate_load_tv": 0.03076923076923077 + }, + "x_at_s0": { + "tokens": 130, + "ordered_topk_exact_tokens": 75, + "set_exact_tokens": 91, + "mean_set_jaccard": 0.9142857142857144, + "mean_token_weighted_tv": 0.018863087928352448, + "aggregate_load_tv": 0.03333333333333334 + }, + "x_at_s1": { + "tokens": 130, + "ordered_topk_exact_tokens": 67, + "set_exact_tokens": 86, + "mean_set_jaccard": 0.9032967032967034, + "mean_token_weighted_tv": 0.02247203798391498, + "aggregate_load_tv": 0.03205128205128205 + }, + "period_at_s0": { + "tokens": 130, + "ordered_topk_exact_tokens": 77, + "set_exact_tokens": 92, + "mean_set_jaccard": 0.9164835164835164, + "mean_token_weighted_tv": 0.018672865407111553, + "aggregate_load_tv": 0.03076923076923077 + }, + "period_at_s1": { + "tokens": 130, + "ordered_topk_exact_tokens": 69, + "set_exact_tokens": 86, + "mean_set_jaccard": 0.9016483516483517, + "mean_token_weighted_tv": 0.023089714692189144, + "aggregate_load_tv": 0.03717948717948718 + } + } + }, + "layer_07": { + "layer": 7, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "852b481c7d37228d88267362cb3408a1dc7b49f75080dca3659a1f4b05479780", + "route_weight_sha256": "d1872531ba91f68e93cc4e7d492c9de7d59da28be5a675e38291c1820e5f25cd", + "loads": [ + 8, + 12, + 44, + 11, + 12, + 12, + 3, + 15, + 3, + 11, + 14, + 7, + 11, + 7, + 32, + 10, + 3, + 16, + 3, + 11, + 14, + 15, + 13, + 9, + 2, + 14, + 9, + 6, + 1, + 8, + 20, + 7, + 6, + 14, + 10, + 44, + 14, + 12, + 7, + 5, + 12, + 1, + 15, + 1, + 2, + 33, + 8, + 1, + 11, + 20, + 2, + 24, + 9, + 35, + 13, + 11, + 1, + 4, + 1, + 13, + 24, + 10, + 1, + 53 + ], + "weighted_loads": [ + 0.5507317967712879, + 0.6569809578359127, + 2.7316902559250593, + 0.5660804454237223, + 0.7664635181427002, + 0.6560327634215355, + 0.13274326547980309, + 1.0331627242267132, + 0.20185036212205887, + 0.5397573485970497, + 0.8759899660944939, + 0.34424224868416786, + 0.7205966804176569, + 0.2378614041954279, + 2.5148461498320103, + 0.6407644711434841, + 0.1357695311307907, + 0.6908056419342756, + 0.10625798627734184, + 0.5152939520776272, + 0.67973842471838, + 1.3606193736195564, + 0.6430844813585281, + 0.5165440179407597, + 0.08985476940870285, + 1.0276753827929497, + 0.5582885220646858, + 0.4525190368294716, + 0.03663453832268715, + 0.5791329145431519, + 1.2019712924957275, + 0.2675749193876982, + 0.6009073629975319, + 0.9418362118303776, + 0.4503080379217863, + 3.9053533915430307, + 0.8825304806232452, + 0.8529967479407787, + 0.3662472255527973, + 0.2782804109156132, + 0.6992335375398397, + 0.09314281493425369, + 1.211041908711195, + 0.02987721376121044, + 0.08536195382475853, + 2.22230520285666, + 0.42421829141676426, + 0.028508450835943222, + 0.6799375750124454, + 1.2500707283616066, + 0.2027168944478035, + 1.6820892505347729, + 0.6611879840493202, + 3.0690983459353447, + 0.8923291303217411, + 0.6709340251982212, + 0.06129520758986473, + 0.18697316572070122, + 0.04580957442522049, + 0.6677046772092581, + 1.8096498921513557, + 0.670819478109479, + 0.0337691493332386, + 5.4336656872183084 + ], + "unique_experts": 64, + "load_cv": 0.8839425163004679, + "normalized_load_entropy": 0.9199144956001244, + "max_load_share": 0.06794871794871794 + }, + "full_input": { + "tokens": 155, + "top_k": 6, + "decisions": 930, + "ordered_route_sha256": "7d8754c5edc820e3bbb793c2445410aad07fe8b831e3a70efe1f46b8a983cbe3", + "route_weight_sha256": "6cd22f9d0aa73e98c4276b7afaa18389d97a7f7832bcd1dc33c9d6e9d7746b62", + "loads": [ + 8, + 12, + 44, + 14, + 12, + 13, + 8, + 15, + 10, + 11, + 15, + 11, + 11, + 12, + 32, + 10, + 17, + 18, + 6, + 11, + 14, + 15, + 16, + 12, + 6, + 14, + 13, + 6, + 4, + 8, + 20, + 7, + 9, + 15, + 11, + 44, + 14, + 12, + 16, + 9, + 12, + 11, + 20, + 4, + 5, + 33, + 10, + 3, + 11, + 20, + 17, + 24, + 9, + 37, + 13, + 18, + 1, + 4, + 5, + 13, + 24, + 16, + 5, + 60 + ], + "weighted_loads": [ + 0.5507317967712879, + 0.6569809578359127, + 2.7316902559250593, + 0.6748762223869562, + 0.7664635181427002, + 0.6975944750010967, + 0.6442592814564705, + 1.0331627242267132, + 0.7648671679198742, + 0.5397573485970497, + 0.9091312251985073, + 0.8741325177252293, + 0.7205966804176569, + 0.5230713374912739, + 2.5148461498320103, + 0.6407644711434841, + 2.107702784240246, + 0.8053552452474833, + 0.21747248712927103, + 0.5152939520776272, + 0.67973842471838, + 1.3606193736195564, + 0.8160592019557953, + 0.719196729362011, + 0.22314986353740096, + 1.0276753827929497, + 0.9571090489625931, + 0.4525190368294716, + 0.09996765665709972, + 0.5791329145431519, + 1.2019712924957275, + 0.2675749193876982, + 0.7151671759784222, + 0.9913848266005516, + 0.5281775128096342, + 3.9053533915430307, + 0.8825304806232452, + 0.8529967479407787, + 1.1613654419779778, + 0.45882548391819, + 0.6992335375398397, + 1.021161686629057, + 1.6285154968500137, + 0.10202754754573107, + 1.5674332454800606, + 2.22230520285666, + 0.6644256953150034, + 0.15910659357905388, + 0.6799375750124454, + 1.2500707283616066, + 1.2261003535240889, + 1.6820892505347729, + 0.6611879840493202, + 3.1390742138028145, + 0.8923291303217411, + 1.3253545872867107, + 0.06129520758986473, + 0.18697316572070122, + 0.13124794699251652, + 0.6677046772092581, + 1.8096498921513557, + 0.9670767094939947, + 0.1253548227250576, + 5.702778737992048 + ], + "unique_experts": 64, + "load_cv": 0.7136124207269938, + "normalized_load_entropy": 0.9506658698690397, + "max_load_share": 0.06451612903225806 + } + }, + "s1_eos": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "e69628c0cde11f0724a64f1dbdb9ba2b65b12340b7693105a12ed8457dde2f29", + "route_weight_sha256": "93ff64bd914179bb4c6af2e974259e0754076eedc0d0d6f6c4fefe43d92d70ad", + "loads": [ + 8, + 14, + 43, + 11, + 11, + 12, + 4, + 16, + 3, + 13, + 14, + 7, + 10, + 5, + 31, + 9, + 3, + 16, + 3, + 11, + 15, + 15, + 13, + 8, + 2, + 14, + 9, + 6, + 2, + 8, + 20, + 8, + 6, + 11, + 10, + 44, + 14, + 11, + 7, + 5, + 12, + 1, + 15, + 1, + 2, + 33, + 7, + 1, + 12, + 20, + 2, + 24, + 9, + 36, + 13, + 11, + 2, + 4, + 1, + 13, + 24, + 10, + 1, + 54 + ], + "weighted_loads": [ + 0.5550197027623653, + 0.714834226295352, + 2.692734759300947, + 0.5616326276212931, + 0.7264535501599312, + 0.6556770317256451, + 0.18096522614359856, + 1.051286505535245, + 0.1978449635207653, + 0.6082662679255009, + 0.8665107917040586, + 0.35033052787184715, + 0.6900719851255417, + 0.1746983826160431, + 2.4724174346774817, + 0.6155083812773228, + 0.13185425847768784, + 0.6847659628838301, + 0.10448854602873325, + 0.5177309922873974, + 0.7295757792890072, + 1.355021234601736, + 0.645867433398962, + 0.4689171575009823, + 0.08928883820772171, + 1.012235788628459, + 0.5369955152273178, + 0.4442766271531582, + 0.0688350759446621, + 0.5735404044389725, + 1.1857234239578247, + 0.29627555795013905, + 0.5918177738785744, + 0.8160890955477953, + 0.4532310552895069, + 3.9057767037302256, + 0.8812298439443111, + 0.8119180724024773, + 0.36187038384377956, + 0.27721935510635376, + 0.6933964099735022, + 0.09104982018470764, + 1.2053787931799889, + 0.029602935537695885, + 0.08573124185204506, + 2.194845685735345, + 0.4024462588131428, + 0.028357982635498047, + 0.7071892563253641, + 1.242020882666111, + 0.20690291747450829, + 1.672264326363802, + 0.654876597225666, + 3.082384832203388, + 0.8980303667485714, + 0.6638053562492132, + 0.10165787860751152, + 0.18371400609612465, + 0.04629864916205406, + 0.6764506064355373, + 1.786468006670475, + 0.6583661995828152, + 0.03857035934925079, + 5.46677883528173 + ], + "unique_experts": 64, + "load_cv": 0.8852506080502032, + "normalized_load_entropy": 0.920675621611757, + "max_load_share": 0.06923076923076923 + }, + "full_input": { + "tokens": 171, + "top_k": 6, + "decisions": 1026, + "ordered_route_sha256": "1682b22079e54873853e13b5beaf024066b31e3805a9be966d46c5a5e4c7d3eb", + "route_weight_sha256": "2808a93aa8db8d9c34f19e7baaa507180dcc9527b12e63f550b9d5f70951e120", + "loads": [ + 8, + 14, + 43, + 13, + 12, + 13, + 11, + 16, + 18, + 15, + 21, + 12, + 10, + 11, + 33, + 10, + 18, + 19, + 6, + 11, + 15, + 15, + 15, + 12, + 7, + 14, + 17, + 6, + 5, + 14, + 20, + 8, + 12, + 19, + 11, + 44, + 14, + 15, + 23, + 9, + 14, + 16, + 25, + 5, + 13, + 33, + 10, + 7, + 12, + 20, + 24, + 24, + 9, + 36, + 17, + 20, + 2, + 10, + 4, + 13, + 24, + 16, + 6, + 57 + ], + "weighted_loads": [ + 0.5550197027623653, + 0.714834226295352, + 2.692734759300947, + 0.625549579039216, + 0.7735263258218765, + 0.7000052966177464, + 0.6922123339027166, + 1.051286505535245, + 1.4777293615043163, + 0.7094277702271938, + 1.4268931429833174, + 0.9741457439959049, + 0.6900719851255417, + 0.5081955268979073, + 2.5410113651305437, + 0.669390257447958, + 2.527031671255827, + 0.8498645592480898, + 0.22203116957098246, + 0.5177309922873974, + 0.7295757792890072, + 1.355021234601736, + 0.7665490247309208, + 0.705086637288332, + 0.24421218829229474, + 1.012235788628459, + 1.2917846590280533, + 0.4442766271531582, + 0.13230892177671194, + 1.3474537134170532, + 1.1857234239578247, + 0.29627555795013905, + 0.9773027263581753, + 1.3591154161840677, + 0.5308415032923222, + 3.9057767037302256, + 0.8812298439443111, + 1.040763372555375, + 2.01302239112556, + 0.4724903777241707, + 0.9148740228265524, + 1.5033754780888557, + 2.0529682636260986, + 0.13931099325418472, + 2.1703354846686125, + 2.194845685735345, + 0.6924774572253227, + 0.35656028240919113, + 0.7071892563253641, + 1.242020882666111, + 1.677109969779849, + 1.672264326363802, + 0.654876597225666, + 3.082384832203388, + 1.104782897979021, + 1.4320910796523094, + 0.10165787860751152, + 0.7278507985174656, + 0.10348752792924643, + 0.6764506064355373, + 1.786468006670475, + 0.9488692097365856, + 0.16718753520399332, + 5.556184139102697 + ], + "unique_experts": 64, + "load_cv": 0.6164253116453313, + "normalized_load_entropy": 0.9612158754983285, + "max_load_share": 0.05555555555555555 + } + }, + "s0_bos": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "ffb38d77331299ff4ef2ed79e06c4e280f96acbdeaf02ba8303edf63277f4733", + "route_weight_sha256": "b2b43ed52c45aed07d698a235b363f9c8b56f70e544391d6936c83babdf77a70", + "loads": [ + 8, + 13, + 44, + 12, + 12, + 12, + 3, + 14, + 3, + 12, + 13, + 8, + 11, + 6, + 32, + 10, + 3, + 15, + 2, + 10, + 15, + 15, + 13, + 9, + 2, + 13, + 12, + 6, + 1, + 8, + 21, + 8, + 6, + 16, + 9, + 45, + 13, + 12, + 7, + 5, + 13, + 1, + 15, + 0, + 2, + 32, + 9, + 0, + 11, + 20, + 2, + 24, + 9, + 34, + 13, + 10, + 1, + 3, + 1, + 13, + 23, + 10, + 2, + 53 + ], + "weighted_loads": [ + 0.5461031198501587, + 0.6845371201634407, + 2.831173572689295, + 0.6154878884553909, + 0.7717519216239452, + 0.6627384573221207, + 0.13719870150089264, + 0.9589143339544535, + 0.20858628675341606, + 0.5824380870908499, + 0.8400136865675449, + 0.3941399361938238, + 0.7224820647388697, + 0.2186406124383211, + 2.5138089060783386, + 0.6321321465075016, + 0.1549367792904377, + 0.6815653890371323, + 0.07022898085415363, + 0.49194541573524475, + 0.7346490435302258, + 1.3655260056257248, + 0.644798219203949, + 0.5293760634958744, + 0.08921823278069496, + 0.9872157499194145, + 0.6864693686366081, + 0.4417549818754196, + 0.03420615941286087, + 0.5773413553833961, + 1.2142898105084896, + 0.3055587261915207, + 0.6093653589487076, + 1.0444790702313185, + 0.42070778273046017, + 3.8570962511003017, + 0.8830430470407009, + 0.8417674601078033, + 0.3883037269115448, + 0.2746411822736263, + 0.7400612980127335, + 0.08908120542764664, + 1.2144448347389698, + 0.0, + 0.07689132913947105, + 2.1658403258770704, + 0.44917919859290123, + 0.0, + 0.691157627850771, + 1.2707911096513271, + 0.2183864265680313, + 1.664152305573225, + 0.656177993863821, + 3.022210694849491, + 0.9002286791801453, + 0.6450263522565365, + 0.05688187852501869, + 0.156404547393322, + 0.04611721262335777, + 0.6637344397604465, + 1.7004318740218878, + 0.6701137311756611, + 0.06376826204359531, + 5.380264326930046 + ], + "unique_experts": 62, + "load_cv": 0.8850129169949233, + "normalized_load_entropy": 0.9180483196369469, + "max_load_share": 0.06794871794871794 + }, + "full_input": { + "tokens": 155, + "top_k": 6, + "decisions": 930, + "ordered_route_sha256": "881738101f88efe0d429384c45c0c8c434ee1d9f1025652f05018e8ec21dcbcf", + "route_weight_sha256": "5086dca7fc4650a903871eaa051973960f3892307e4368a08cf4a97083cee5b0", + "loads": [ + 8, + 13, + 44, + 15, + 12, + 13, + 9, + 14, + 10, + 12, + 14, + 12, + 11, + 11, + 32, + 10, + 17, + 17, + 6, + 11, + 15, + 15, + 16, + 12, + 5, + 13, + 17, + 6, + 3, + 8, + 21, + 8, + 9, + 17, + 10, + 45, + 13, + 12, + 16, + 9, + 13, + 11, + 20, + 2, + 5, + 32, + 12, + 2, + 11, + 20, + 16, + 24, + 9, + 37, + 13, + 17, + 1, + 3, + 4, + 13, + 23, + 16, + 5, + 60 + ], + "weighted_loads": [ + 0.5461031198501587, + 0.6845371201634407, + 2.831173572689295, + 0.7242836654186249, + 0.7717519216239452, + 0.7043001689016819, + 0.7466663010418415, + 0.9589143339544535, + 0.7739905081689358, + 0.5824380870908499, + 0.8731549456715584, + 0.9522528257220984, + 0.7224820647388697, + 0.5038505457341671, + 2.5138089060783386, + 0.6321321465075016, + 2.1395003385841846, + 0.7908589355647564, + 0.2245462229475379, + 0.5501754954457283, + 0.7346490435302258, + 1.3655260056257248, + 0.8177729398012161, + 0.7417346127331257, + 0.21545134112238884, + 0.9872157499194145, + 1.1460254192352295, + 0.4417549818754196, + 0.08442540653049946, + 0.5773413553833961, + 1.2142898105084896, + 0.3055587261915207, + 0.7236251719295979, + 1.0940276850014925, + 0.49039013497531414, + 3.8570962511003017, + 0.8830430470407009, + 0.8417674601078033, + 1.2370372153818607, + 0.45391811802983284, + 0.7400612980127335, + 1.0365099720656872, + 1.6221311911940575, + 0.05475862696766853, + 0.7310021780431271, + 2.1658403258770704, + 0.7371265031397343, + 0.13254064321517944, + 0.691157627850771, + 1.2707911096513271, + 1.2978533785790205, + 1.664152305573225, + 0.656177993863821, + 3.1368749886751175, + 0.9002286791801453, + 1.299446914345026, + 0.05688187852501869, + 0.156404547393322, + 0.11654439941048622, + 0.6637344397604465, + 1.7004318740218878, + 0.9663709625601768, + 0.14950746577233076, + 5.649377377703786 + ], + "unique_experts": 64, + "load_cv": 0.7199099389980937, + "normalized_load_entropy": 0.9485649853381122, + "max_load_share": 0.06451612903225806 + } + }, + "s1_bos": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "2358fa2da3ef168911776598a2ed9822e65fe13a1e3dca9ddfe2c9d96980f149", + "route_weight_sha256": "4f14ff12ce54af1e2573250b7168847f07086694b47bc7e5e31b9f73e13b1f81", + "loads": [ + 8, + 13, + 46, + 12, + 11, + 12, + 3, + 16, + 3, + 11, + 14, + 7, + 11, + 6, + 31, + 10, + 3, + 14, + 2, + 12, + 18, + 15, + 13, + 9, + 3, + 13, + 11, + 6, + 1, + 8, + 21, + 9, + 6, + 16, + 9, + 44, + 13, + 12, + 6, + 5, + 11, + 1, + 15, + 0, + 2, + 32, + 7, + 0, + 11, + 20, + 2, + 24, + 9, + 34, + 12, + 10, + 1, + 3, + 1, + 12, + 24, + 11, + 1, + 54 + ], + "weighted_loads": [ + 0.5491388887166977, + 0.7010420113801956, + 2.83856800198555, + 0.6164288185536861, + 0.7320918813347816, + 0.6583044826984406, + 0.138504970818758, + 1.030667120590806, + 0.20176686719059944, + 0.5360931046307087, + 0.8713685572147369, + 0.3533468060195446, + 0.7320410832762718, + 0.19991449266672134, + 2.449380051344633, + 0.630758173763752, + 0.14551831036806107, + 0.6462834123522043, + 0.06644303165376186, + 0.5855510402470827, + 0.8685460388660431, + 1.3355180360376835, + 0.6517685651779175, + 0.5167521089315414, + 0.12892522662878036, + 0.9786200597882271, + 0.6686330512166023, + 0.44506941363215446, + 0.03274809941649437, + 0.5709593668580055, + 1.2243364993482828, + 0.337527047842741, + 0.5885981172323227, + 1.0287540666759014, + 0.4122632257640362, + 3.720363572239876, + 0.8586718253791332, + 0.8218436390161514, + 0.3457787074148655, + 0.27857956662774086, + 0.6646549515426159, + 0.0870923325419426, + 1.2095634639263153, + 0.0, + 0.06991757825016975, + 2.1400925926864147, + 0.3881158512085676, + 0.0, + 0.6716738156974316, + 1.2690418027341366, + 0.20189421623945236, + 1.6425663754343987, + 0.6570695675909519, + 3.0190652702003717, + 0.8797496818006039, + 0.6406222246587276, + 0.06493214517831802, + 0.14197451248764992, + 0.04648040607571602, + 0.6444825530052185, + 1.7165504731237888, + 0.6938503794372082, + 0.039125941693782806, + 5.43225996568799 + ], + "unique_experts": 62, + "load_cv": 0.896585677842353, + "normalized_load_entropy": 0.9162982721732443, + "max_load_share": 0.06923076923076923 + }, + "full_input": { + "tokens": 171, + "top_k": 6, + "decisions": 1026, + "ordered_route_sha256": "808f0f3b929839501024a134313089e3382de453c0a25f97fa468f3cc5df5a1c", + "route_weight_sha256": "cbc5d4530fdffdbe824f716026452a11c37d11e57111c756ada509fba9b7911c", + "loads": [ + 8, + 13, + 46, + 14, + 12, + 13, + 11, + 16, + 18, + 13, + 22, + 12, + 11, + 12, + 33, + 11, + 18, + 17, + 6, + 13, + 18, + 15, + 15, + 14, + 7, + 13, + 20, + 6, + 3, + 14, + 21, + 9, + 12, + 24, + 10, + 44, + 13, + 16, + 22, + 9, + 13, + 16, + 25, + 3, + 12, + 32, + 11, + 6, + 11, + 20, + 24, + 24, + 9, + 34, + 16, + 19, + 1, + 9, + 3, + 12, + 24, + 17, + 4, + 57 + ], + "weighted_loads": [ + 0.5491388887166977, + 0.7010420113801956, + 2.83856800198555, + 0.6803457699716091, + 0.779164656996727, + 0.7026327475905418, + 0.7674896772950888, + 1.030667120590806, + 1.4830508716404438, + 0.6372546069324017, + 1.4673109725117683, + 1.0090821646153927, + 0.7320410832762718, + 0.5334116369485855, + 2.517973981797695, + 0.6846400499343872, + 2.5490581803023815, + 0.8071339819580317, + 0.2093108231201768, + 0.6459327545017004, + 0.8685460388660431, + 1.3355180360376835, + 0.7724501565098763, + 0.8147831223905087, + 0.27666187286376953, + 0.9786200597882271, + 1.4972443990409374, + 0.44506941363215446, + 0.08251883648335934, + 1.3448726758360863, + 1.2243364993482828, + 0.337527047842741, + 0.9740830697119236, + 1.5717803873121738, + 0.4836418367922306, + 3.720363572239876, + 0.8586718253791332, + 1.0506889391690493, + 2.034818183630705, + 0.4754176512360573, + 0.8861325643956661, + 1.5078294575214386, + 2.0521284826099873, + 0.09442340955138206, + 1.2816403079777956, + 2.1400925926864147, + 0.7190164383500814, + 0.336676511913538, + 0.6716738156974316, + 1.2690418027341366, + 1.8243338968604803, + 1.6425663754343987, + 0.6570695675909519, + 3.0190652702003717, + 1.0865022130310535, + 1.4089079480618238, + 0.06493214517831802, + 0.6861113049089909, + 0.08814509399235249, + 0.6444825530052185, + 1.7165504731237888, + 0.9843533895909786, + 0.11757125798612833, + 5.521665269508958 + ], + "unique_experts": 64, + "load_cv": 0.63220133942114, + "normalized_load_entropy": 0.9577986136005474, + "max_load_share": 0.05555555555555555 + } + }, + "s0_x": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "501a9abe087f83ce29e70b92996932f0308bfbcd32e4c2e979c2ce486e1514c6", + "route_weight_sha256": "2dac0d3d3e1ac4d8a2efd957e907016237dc6ac14c00614f52062cf64054fdfd", + "loads": [ + 8, + 13, + 43, + 14, + 12, + 12, + 2, + 16, + 3, + 11, + 14, + 7, + 11, + 7, + 31, + 10, + 3, + 15, + 3, + 11, + 17, + 15, + 14, + 10, + 2, + 12, + 13, + 6, + 1, + 8, + 21, + 8, + 6, + 14, + 10, + 44, + 13, + 12, + 6, + 5, + 14, + 1, + 15, + 0, + 2, + 33, + 8, + 0, + 11, + 20, + 2, + 24, + 9, + 32, + 12, + 10, + 1, + 3, + 1, + 11, + 22, + 11, + 1, + 54 + ], + "weighted_loads": [ + 0.5368034727871418, + 0.6964159347116947, + 2.780692046508193, + 0.706373792141676, + 0.7548153735697269, + 0.6797920595854521, + 0.08882466331124306, + 1.0188349653035402, + 0.21339651942253113, + 0.5352931320667267, + 0.8662247397005558, + 0.3570117615163326, + 0.7292369958013296, + 0.2312872875481844, + 2.466642040759325, + 0.6244776844978333, + 0.14127561077475548, + 0.6936334930360317, + 0.1060570776462555, + 0.5399947874248028, + 0.8136859200894833, + 1.3423287644982338, + 0.6848564837127924, + 0.5760104097425938, + 0.09124986827373505, + 0.9423580579459667, + 0.7862412501126528, + 0.4442357122898102, + 0.03449632599949837, + 0.5744271539151669, + 1.2282751575112343, + 0.2995077781379223, + 0.6007503122091293, + 0.9736211020499468, + 0.44792559929192066, + 3.7802619077265263, + 0.8766060136258602, + 0.8141778446733952, + 0.3664857782423496, + 0.2704504728317261, + 0.7846690565347672, + 0.08630946278572083, + 1.2363278158009052, + 0.0, + 0.07421305775642395, + 2.1884960029274225, + 0.42113324627280235, + 0.0, + 0.6965536549687386, + 1.2558700256049633, + 0.2139977402985096, + 1.662840560078621, + 0.6468968540430069, + 2.915000945329666, + 0.8621411882340908, + 0.6448986381292343, + 0.061069563031196594, + 0.15302051603794098, + 0.04918411374092102, + 0.5936896447092295, + 1.6565220337361097, + 0.7217756751924753, + 0.03635117784142494, + 5.412036867812276 + ], + "unique_experts": 62, + "load_cv": 0.8791694125797251, + "normalized_load_entropy": 0.9181887436387882, + "max_load_share": 0.06923076923076923 + }, + "full_input": { + "tokens": 155, + "top_k": 6, + "decisions": 930, + "ordered_route_sha256": "a5a27348c267a20334848492bbe012e4066c64b435c95eff4a5a6e101234e846", + "route_weight_sha256": "4fc5c6a80dec4a019fbd0f7105048c98ef2e443cccad23775c2ca7c605445b99", + "loads": [ + 8, + 13, + 43, + 17, + 12, + 14, + 6, + 16, + 10, + 11, + 15, + 11, + 11, + 13, + 31, + 10, + 18, + 17, + 6, + 12, + 17, + 15, + 17, + 13, + 5, + 12, + 17, + 6, + 3, + 8, + 21, + 8, + 9, + 16, + 11, + 44, + 13, + 12, + 15, + 9, + 14, + 11, + 20, + 2, + 4, + 33, + 12, + 3, + 11, + 20, + 15, + 24, + 9, + 34, + 12, + 17, + 1, + 3, + 4, + 11, + 22, + 18, + 3, + 62 + ], + "weighted_loads": [ + 0.5368034727871418, + 0.6964159347116947, + 2.780692046508193, + 0.8151695691049099, + 0.7548153735697269, + 0.7770063523203135, + 0.4759349077939987, + 1.0188349653035402, + 0.7671499848365784, + 0.5352931320667267, + 0.8993659988045692, + 0.9235098771750927, + 0.7292369958013296, + 0.550223808735609, + 2.466642040759325, + 0.6244776844978333, + 2.3951914086937904, + 0.8132171221077442, + 0.20099290180951357, + 0.6006354317069054, + 0.8136859200894833, + 1.3423287644982338, + 0.8578312043100595, + 0.7748823165893555, + 0.21748297661542892, + 0.9423580579459667, + 1.1830284763127565, + 0.4442357122898102, + 0.08471557311713696, + 0.5744271539151669, + 1.2282751575112343, + 0.2995077781379223, + 0.7150101251900196, + 1.0709884222596884, + 0.5200642663985491, + 3.7802619077265263, + 0.8766060136258602, + 0.8141778446733952, + 1.1386499740183353, + 0.4474477395415306, + 0.7846690565347672, + 0.9718167781829834, + 1.6330035887658596, + 0.05605180189013481, + 0.6787217073142529, + 2.1884960029274225, + 0.7184675484895706, + 0.18294629827141762, + 0.6965536549687386, + 1.2558700256049633, + 1.1296966020017862, + 1.662840560078621, + 0.6468968540430069, + 2.9825269915163517, + 0.8621411882340908, + 1.2993192002177238, + 0.061069563031196594, + 0.15302051603794098, + 0.11961130052804947, + 0.5936896447092295, + 1.6565220337361097, + 1.0702175702899694, + 0.07945357728749514, + 5.760504696518183 + ], + "unique_experts": 64, + "load_cv": 0.7215526481637685, + "normalized_load_entropy": 0.9479687681574038, + "max_load_share": 0.06666666666666667 + } + }, + "s1_x": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "1a28fbd35c8a88162870f23d2d476144ebde61679d59de21843e2b02297d8293", + "route_weight_sha256": "b8588c84e37aa90633dafee36b75b3d91b1c5b461443ad23bfe6910e0ca4ef0e", + "loads": [ + 8, + 14, + 46, + 16, + 11, + 15, + 3, + 16, + 3, + 9, + 14, + 8, + 11, + 5, + 30, + 9, + 3, + 13, + 3, + 12, + 17, + 15, + 14, + 10, + 3, + 12, + 11, + 6, + 1, + 8, + 21, + 8, + 6, + 15, + 10, + 44, + 12, + 12, + 6, + 5, + 12, + 1, + 15, + 0, + 2, + 32, + 7, + 0, + 11, + 20, + 2, + 24, + 9, + 33, + 12, + 10, + 1, + 3, + 1, + 12, + 23, + 11, + 1, + 53 + ], + "weighted_loads": [ + 0.5569065064191818, + 0.7486168835312128, + 2.7993941083550453, + 0.7955562174320221, + 0.711714893579483, + 0.7797408234328032, + 0.13117827102541924, + 1.0119433589279652, + 0.20969824865460396, + 0.45625884272158146, + 0.8341575786471367, + 0.3863082379102707, + 0.739345720037818, + 0.16592518985271454, + 2.3877246789634228, + 0.5899809412658215, + 0.14327619969844818, + 0.6407538019120693, + 0.10438871756196022, + 0.5993964150547981, + 0.8089924491941929, + 1.3160347491502762, + 0.6834054030478001, + 0.5420112162828445, + 0.1302301548421383, + 0.9408965185284615, + 0.7075833417475224, + 0.43938135355710983, + 0.03261455148458481, + 0.5610246770083904, + 1.2439530156552792, + 0.3127488549798727, + 0.5843069404363632, + 1.0071353800594807, + 0.4382820911705494, + 3.6370906848460436, + 0.8067675307393074, + 0.8017929587513208, + 0.3696693852543831, + 0.2740846015512943, + 0.705684918910265, + 0.08149033039808273, + 1.2297949083149433, + 0.0, + 0.06944959983229637, + 2.1140566747635603, + 0.3905973769724369, + 0.0, + 0.6778422482311726, + 1.2511116601526737, + 0.1958196610212326, + 1.646605171263218, + 0.6485488004982471, + 2.9127938225865364, + 0.8608344756066799, + 0.6454250663518906, + 0.06623663008213043, + 0.13639597222208977, + 0.047532882541418076, + 0.6550253443419933, + 1.6624961104243994, + 0.7068531457334757, + 0.03798429295420647, + 5.296701475977898 + ], + "unique_experts": 62, + "load_cv": 0.8857257988023363, + "normalized_load_entropy": 0.9177165156717794, + "max_load_share": 0.06794871794871794 + }, + "full_input": { + "tokens": 171, + "top_k": 6, + "decisions": 1026, + "ordered_route_sha256": "7fb4b1c59d2a021ba94345ada8fdfc5074beafa40332424783c6173d1a8c25ba", + "route_weight_sha256": "2fb2e8f11a5afa8044db8b0f7d381dc30668f19b2d62fb573744afac5afa2984", + "loads": [ + 8, + 14, + 46, + 18, + 12, + 17, + 9, + 16, + 17, + 11, + 22, + 13, + 11, + 12, + 32, + 10, + 19, + 17, + 6, + 13, + 17, + 15, + 16, + 15, + 8, + 12, + 19, + 6, + 3, + 14, + 21, + 8, + 12, + 24, + 11, + 44, + 12, + 16, + 21, + 8, + 14, + 15, + 25, + 2, + 12, + 32, + 12, + 7, + 11, + 20, + 23, + 24, + 9, + 33, + 16, + 19, + 1, + 9, + 3, + 12, + 23, + 18, + 4, + 57 + ], + "weighted_loads": [ + 0.5569065064191818, + 0.7486168835312128, + 2.7993941083550453, + 0.8594731688499451, + 0.7587876692414284, + 0.8785418104380369, + 0.5291873421519995, + 1.0119433589279652, + 1.4211406223475933, + 0.5574203450232744, + 1.4318435788154602, + 1.0617779232561588, + 0.739345720037818, + 0.5295249484479427, + 2.456318609416485, + 0.6438628174364567, + 2.81043441593647, + 0.8594990745186806, + 0.1989337457343936, + 0.6628516614437103, + 0.8089924491941929, + 1.3160347491502762, + 0.8040869943797588, + 0.8141392134130001, + 0.3113585561513901, + 0.9408965185284615, + 1.450602676719427, + 0.43938135355710983, + 0.08238528855144978, + 1.3349379859864712, + 1.2439530156552792, + 0.3127488549798727, + 0.9697918929159641, + 1.5959647484123707, + 0.49363695830106735, + 3.6370906848460436, + 0.8067675307393074, + 1.0306382589042187, + 1.990073673427105, + 0.42084066197276115, + 0.9271625317633152, + 1.3734145686030388, + 2.070141986012459, + 0.058533262461423874, + 1.282202197238803, + 2.1140566747635603, + 0.7448193691670895, + 0.4051084630191326, + 0.6778422482311726, + 1.2511116601526737, + 1.6047369595617056, + 1.646605171263218, + 0.6485488004982471, + 2.9127938225865364, + 1.0675870068371296, + 1.4137107897549868, + 0.06623663008213043, + 0.6805327646434307, + 0.08919757045805454, + 0.6550253443419933, + 1.6624961104243994, + 1.0501676555722952, + 0.11642960924655199, + 5.454431256279349 + ], + "unique_experts": 64, + "load_cv": 0.6285363382935111, + "normalized_load_entropy": 0.9579079385278912, + "max_load_share": 0.05555555555555555 + } + }, + "s0_period": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "9387f884c20716d3562aa6853f041320ae81d05880162b01295725d55dbeba2d", + "route_weight_sha256": "f248a64907a528805218cc436c874e880754fa8fa3c7a8c4128c6754a7f44f1d", + "loads": [ + 8, + 12, + 43, + 15, + 12, + 13, + 2, + 16, + 3, + 10, + 13, + 6, + 11, + 6, + 32, + 10, + 3, + 14, + 3, + 11, + 16, + 15, + 13, + 9, + 2, + 12, + 12, + 6, + 1, + 8, + 21, + 8, + 6, + 16, + 10, + 46, + 14, + 12, + 8, + 5, + 14, + 1, + 15, + 0, + 2, + 32, + 8, + 0, + 11, + 20, + 2, + 23, + 9, + 32, + 12, + 10, + 1, + 3, + 1, + 12, + 23, + 11, + 1, + 54 + ], + "weighted_loads": [ + 0.5422913618385792, + 0.6622322835028172, + 2.8027179911732674, + 0.7569436803460121, + 0.7524805888533592, + 0.7130756881088018, + 0.08988623321056366, + 1.022708522155881, + 0.21460966393351555, + 0.506209421902895, + 0.8280764892697334, + 0.31394146755337715, + 0.7333354335278273, + 0.1944003477692604, + 2.5045626424252987, + 0.6399320401251316, + 0.13929598405957222, + 0.6504642236977816, + 0.10620232112705708, + 0.5292205959558487, + 0.7746332287788391, + 1.3514457531273365, + 0.6546274945139885, + 0.5176495388150215, + 0.09185175225138664, + 0.9463581293821335, + 0.751912072300911, + 0.43204182013869286, + 0.03702743723988533, + 0.5672117583453655, + 1.229010932147503, + 0.3023275211453438, + 0.5995551720261574, + 1.0291672609746456, + 0.4508592151105404, + 3.8500614929944277, + 0.9186559710651636, + 0.8265355043113232, + 0.4611319564282894, + 0.26871761307120323, + 0.7819740232080221, + 0.09098357707262039, + 1.2344867996871471, + 0.0, + 0.07300055772066116, + 2.159903621301055, + 0.41823882050812244, + 0.0, + 0.6903491839766502, + 1.2505594193935394, + 0.2125057578086853, + 1.6052326373755932, + 0.6443020440638065, + 2.917927635833621, + 0.8598169274628162, + 0.6517127901315689, + 0.06127440184354782, + 0.15136481076478958, + 0.049648478627204895, + 0.6622131578624249, + 1.7097929194569588, + 0.70726134814322, + 0.036459896713495255, + 5.40900219604373 + ], + "unique_experts": 62, + "load_cv": 0.887268411135593, + "normalized_load_entropy": 0.9172622583939221, + "max_load_share": 0.06923076923076923 + }, + "full_input": { + "tokens": 155, + "top_k": 6, + "decisions": 930, + "ordered_route_sha256": "99d3479675588a7ecb7bf0d63a030c7c065c920de87096f4f94d4fa7d332aa97", + "route_weight_sha256": "9b50ef5976ff968af06a3d758ae4cd1c0445cb171869f1cfac29695eef0e14f5", + "loads": [ + 8, + 12, + 43, + 18, + 12, + 14, + 7, + 16, + 11, + 10, + 14, + 10, + 11, + 11, + 32, + 10, + 18, + 16, + 6, + 12, + 16, + 15, + 17, + 12, + 5, + 12, + 16, + 6, + 3, + 8, + 21, + 8, + 9, + 18, + 11, + 46, + 14, + 12, + 18, + 9, + 14, + 12, + 20, + 2, + 4, + 32, + 10, + 2, + 11, + 20, + 17, + 23, + 9, + 34, + 12, + 17, + 1, + 3, + 4, + 12, + 23, + 17, + 3, + 61 + ], + "weighted_loads": [ + 0.5422913618385792, + 0.6622322835028172, + 2.8027179911732674, + 0.8657394573092461, + 0.7524805888533592, + 0.7546373996883631, + 0.5095926187932491, + 1.022708522155881, + 0.8538803458213806, + 0.506209421902895, + 0.8612177483737469, + 0.8879492990672588, + 0.7333354335278273, + 0.4796102810651064, + 2.5045626424252987, + 0.6399320401251316, + 2.379765696823597, + 0.7637644466012716, + 0.20798213686794043, + 0.5869791209697723, + 0.7746332287788391, + 1.3514457531273365, + 0.8713405542075634, + 0.7181006036698818, + 0.21808486059308052, + 0.9463581293821335, + 1.1371349543333054, + 0.43204182013869286, + 0.08724668435752392, + 0.5672117583453655, + 1.229010932147503, + 0.3023275211453438, + 0.7138149850070477, + 1.124128706753254, + 0.5225865729153156, + 3.8500614929944277, + 0.9186559710651636, + 0.8265355043113232, + 1.345952995121479, + 0.44857655838131905, + 0.7819740232080221, + 1.0342256166040897, + 1.6307095177471638, + 0.058316320180892944, + 0.6775092072784901, + 2.159903621301055, + 0.6351218987256289, + 0.1346246898174286, + 0.6903491839766502, + 1.2505594193935394, + 1.4622723292559385, + 1.6052326373755932, + 0.6443020440638065, + 2.9863203074783087, + 0.8598169274628162, + 1.3061333522200584, + 0.06127440184354782, + 0.15136481076478958, + 0.12007566541433334, + 0.6622131578624249, + 1.7097929194569588, + 1.0035185795277357, + 0.07956229615956545, + 5.67811524681747 + ], + "unique_experts": 64, + "load_cv": 0.7253371640959012, + "normalized_load_entropy": 0.9471320431969543, + "max_load_share": 0.06559139784946237 + } + }, + "s1_period": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "9149fceee44d5c2a592f6cac0da7232a6b43e4c6e20f7969326a38b15d2886d6", + "route_weight_sha256": "c935810924ab9023af4976661f0441fa6a215e1e21afd1d94bd584e0df551c8f", + "loads": [ + 8, + 14, + 46, + 15, + 11, + 15, + 3, + 16, + 3, + 11, + 14, + 7, + 11, + 5, + 30, + 10, + 3, + 15, + 3, + 12, + 16, + 15, + 14, + 9, + 2, + 12, + 11, + 6, + 1, + 8, + 21, + 8, + 6, + 14, + 10, + 44, + 12, + 12, + 6, + 5, + 12, + 1, + 15, + 0, + 2, + 32, + 7, + 0, + 12, + 20, + 2, + 24, + 9, + 32, + 12, + 11, + 1, + 3, + 1, + 12, + 22, + 11, + 1, + 54 + ], + "weighted_loads": [ + 0.5608768835663795, + 0.7507711965590715, + 2.79827675037086, + 0.7542522586882114, + 0.7060302011668682, + 0.7624743431806564, + 0.1321534551680088, + 1.016314260661602, + 0.20925361290574074, + 0.5132065862417221, + 0.848835788667202, + 0.34178899973630905, + 0.7407523170113564, + 0.1655245628207922, + 2.3876960165798664, + 0.6438294723629951, + 0.1412469670176506, + 0.7127407845109701, + 0.10399762354791164, + 0.5858907196670771, + 0.7751180976629257, + 1.3181835077703, + 0.6881890445947647, + 0.4855896048247814, + 0.0883517637848854, + 0.9440521113574505, + 0.7100299559533596, + 0.4443979039788246, + 0.032933153212070465, + 0.5618968196213245, + 1.2424045130610466, + 0.3145811576396227, + 0.5838404297828674, + 0.9681911822408438, + 0.4367304611951113, + 3.6140650920569897, + 0.8108422569930553, + 0.8001627940684557, + 0.380122784525156, + 0.2783721946179867, + 0.7093483172357082, + 0.08471566438674927, + 1.23093880712986, + 0.0, + 0.06910378485918045, + 2.1268262416124344, + 0.3885313607752323, + 0.0, + 0.7049198299646378, + 1.2509307824075222, + 0.1928352303802967, + 1.642304576933384, + 0.654150053858757, + 2.893707128241658, + 0.8680969290435314, + 0.6827846542000771, + 0.06826771050691605, + 0.13428566977381706, + 0.047381337732076645, + 0.6563397571444511, + 1.6342575512826443, + 0.7021755576133728, + 0.03824460133910179, + 5.3616674821823835 + ], + "unique_experts": 62, + "load_cv": 0.8871498438800426, + "normalized_load_entropy": 0.9174345204331572, + "max_load_share": 0.06923076923076923 + }, + "full_input": { + "tokens": 171, + "top_k": 6, + "decisions": 1026, + "ordered_route_sha256": "6212fb081a3f338e1d900ae77fe72f78d45197fcab746b3825d370c777ef4e2d", + "route_weight_sha256": "cdc62f46dd21e7d42cf6ca7cc3c11a841d4f96c13c185e5f2f013a133fdc7e9a", + "loads": [ + 8, + 14, + 46, + 17, + 12, + 16, + 10, + 16, + 19, + 13, + 22, + 12, + 11, + 11, + 32, + 11, + 19, + 19, + 6, + 12, + 16, + 15, + 17, + 13, + 6, + 12, + 19, + 6, + 3, + 14, + 21, + 8, + 13, + 22, + 11, + 44, + 12, + 16, + 23, + 9, + 14, + 16, + 25, + 2, + 12, + 32, + 10, + 6, + 12, + 20, + 25, + 24, + 9, + 32, + 16, + 20, + 1, + 9, + 3, + 12, + 22, + 17, + 4, + 57 + ], + "weighted_loads": [ + 0.5608768835663795, + 0.7507711965590715, + 2.79827675037086, + 0.8181692101061344, + 0.7531029768288136, + 0.8068026080727577, + 0.5614815708249807, + 1.016314260661602, + 1.541427694261074, + 0.6143680885434151, + 1.4461594931781292, + 0.9734109118580818, + 0.7407523170113564, + 0.49902170710265636, + 2.4562899470329285, + 0.6977113485336304, + 2.7529851347208023, + 0.9261400680989027, + 0.20619667414575815, + 0.5858907196670771, + 0.7751180976629257, + 1.3181835077703, + 0.8416099213063717, + 0.7228424251079559, + 0.23608841001987457, + 0.9440521113574505, + 1.4437018297612667, + 0.4443979039788246, + 0.08270389027893543, + 1.3358101285994053, + 1.2424045130610466, + 0.3145811576396227, + 1.002570703625679, + 1.5112175028771162, + 0.49159895814955235, + 3.6140650920569897, + 0.8108422569930553, + 1.0290080942213535, + 2.123161718249321, + 0.46999309957027435, + 0.9308259300887585, + 1.4569672495126724, + 2.0645871572196484, + 0.058533262461423874, + 1.2812181022018194, + 2.1268262416124344, + 0.6714947447180748, + 0.33960646390914917, + 0.7049198299646378, + 1.2509307824075222, + 2.0255827326327562, + 1.642304576933384, + 0.654150053858757, + 2.893707128241658, + 1.074849460273981, + 1.4510703776031733, + 0.06826771050691605, + 0.678422462195158, + 0.08904602564871311, + 0.6563397571444511, + 1.6342575512826443, + 0.9926785677671432, + 0.11668991763144732, + 5.451072786003351 + ], + "unique_experts": 64, + "load_cv": 0.63008209501188, + "normalized_load_entropy": 0.9574923991498363, + "max_load_share": 0.05555555555555555 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 130, + "ordered_topk_exact_tokens": 96, + "set_exact_tokens": 109, + "mean_set_jaccard": 0.9538461538461539, + "mean_token_weighted_tv": 0.00951897412395248, + "aggregate_load_tv": 0.016666666666666677 + }, + "system_bos": { + "tokens": 130, + "ordered_topk_exact_tokens": 90, + "set_exact_tokens": 109, + "mean_set_jaccard": 0.9505494505494506, + "mean_token_weighted_tv": 0.013692029651540977, + "aggregate_load_tv": 0.019230769230769242 + }, + "system_x": { + "tokens": 130, + "ordered_topk_exact_tokens": 78, + "set_exact_tokens": 101, + "mean_set_jaccard": 0.9362637362637364, + "mean_token_weighted_tv": 0.016215192884779895, + "aggregate_load_tv": 0.0217948717948718 + }, + "system_period": { + "tokens": 130, + "ordered_topk_exact_tokens": 76, + "set_exact_tokens": 101, + "mean_set_jaccard": 0.9362637362637364, + "mean_token_weighted_tv": 0.016503521527808446, + "aggregate_load_tv": 0.021794871794871794 + }, + "bos_at_s0": { + "tokens": 130, + "ordered_topk_exact_tokens": 85, + "set_exact_tokens": 97, + "mean_set_jaccard": 0.9258241758241759, + "mean_token_weighted_tv": 0.01688844571606471, + "aggregate_load_tv": 0.02051282051282052 + }, + "bos_at_s1": { + "tokens": 130, + "ordered_topk_exact_tokens": 81, + "set_exact_tokens": 101, + "mean_set_jaccard": 0.9316849816849817, + "mean_token_weighted_tv": 0.017628253229822102, + "aggregate_load_tv": 0.030769230769230774 + }, + "x_at_s0": { + "tokens": 130, + "ordered_topk_exact_tokens": 81, + "set_exact_tokens": 93, + "mean_set_jaccard": 0.9120879120879121, + "mean_token_weighted_tv": 0.020451348668967303, + "aggregate_load_tv": 0.025641025641025644 + }, + "x_at_s1": { + "tokens": 130, + "ordered_topk_exact_tokens": 67, + "set_exact_tokens": 86, + "mean_set_jaccard": 0.8954212454212453, + "mean_token_weighted_tv": 0.025034088383500394, + "aggregate_load_tv": 0.03717948717948718 + }, + "period_at_s0": { + "tokens": 130, + "ordered_topk_exact_tokens": 79, + "set_exact_tokens": 92, + "mean_set_jaccard": 0.9102564102564104, + "mean_token_weighted_tv": 0.020954506736821855, + "aggregate_load_tv": 0.028205128205128212 + }, + "period_at_s1": { + "tokens": 130, + "ordered_topk_exact_tokens": 66, + "set_exact_tokens": 88, + "mean_set_jaccard": 0.9014652014652016, + "mean_token_weighted_tv": 0.023800509680922215, + "aggregate_load_tv": 0.030769230769230764 + } + } + }, + "layer_08": { + "layer": 8, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "59f9a54e162743ae617a42dcd807ae522da90be28f33fc1c6da0da153b8fe409", + "route_weight_sha256": "8f547f4f95e0a0e15c4c51b7c58981a5241fa3581fbc8016487c375a9c6255ee", + "loads": [ + 6, + 62, + 12, + 15, + 0, + 12, + 4, + 37, + 1, + 13, + 15, + 6, + 9, + 3, + 5, + 12, + 3, + 37, + 9, + 15, + 14, + 17, + 29, + 2, + 11, + 5, + 3, + 13, + 13, + 16, + 1, + 18, + 12, + 5, + 6, + 2, + 20, + 76, + 1, + 1, + 5, + 13, + 18, + 10, + 22, + 12, + 2, + 6, + 14, + 5, + 7, + 17, + 8, + 3, + 3, + 7, + 4, + 13, + 1, + 5, + 18, + 23, + 19, + 4 + ], + "weighted_loads": [ + 0.24466784670948982, + 3.368921272456646, + 0.6113464795053005, + 1.1371037997305393, + 0.0, + 0.7233160398900509, + 0.24021266400814056, + 2.446073517203331, + 0.031029600650072098, + 0.7649991530925035, + 1.2447470277547836, + 0.23399986699223518, + 0.7033413387835026, + 0.1598108559846878, + 0.23728235810995102, + 0.818867901340127, + 0.11206110566854477, + 2.7574089113622904, + 0.47528770565986633, + 0.7709726821631193, + 1.264125034213066, + 1.0313083790242672, + 1.9045833349227905, + 0.14926476404070854, + 0.692377258092165, + 0.24941620230674744, + 0.12038394436240196, + 0.588369932025671, + 0.7118124514818192, + 1.0511077977716923, + 0.0740315318107605, + 1.3054840434342623, + 0.7787266559898853, + 0.2489122711122036, + 0.4322674982249737, + 0.06801808252930641, + 1.701978910714388, + 6.461141616106033, + 0.046867381781339645, + 0.07116230577230453, + 0.18493711203336716, + 0.6278593763709068, + 1.2157391533255577, + 0.4142082631587982, + 1.6748614199459553, + 0.8465641979128122, + 0.0700404979288578, + 0.2327210158109665, + 0.8174796737730503, + 0.20344997197389603, + 0.35484372079372406, + 1.4571310579776764, + 0.44824573025107384, + 0.22187833860516548, + 0.09765122458338737, + 0.41728998348116875, + 0.1519368216395378, + 0.8275517337024212, + 0.04191417619585991, + 0.2697403058409691, + 1.1487398035824299, + 0.9784219246357679, + 1.1598447766155005, + 0.18319288827478886 + ], + "unique_experts": 63, + "load_cv": 1.068526485137901, + "normalized_load_entropy": 0.8997301961976535, + "max_load_share": 0.09743589743589744 + }, + "full_input": { + "tokens": 155, + "top_k": 6, + "decisions": 930, + "ordered_route_sha256": "d0fac9329381897df97165c01f84f122460bac5b4a8cae54284530ad4c772a5d", + "route_weight_sha256": "420cab946f0edbf6fa5a17cb0035e7b9ac891453a0084378ae979f45e44e33d5", + "loads": [ + 6, + 68, + 14, + 15, + 4, + 12, + 9, + 38, + 10, + 13, + 16, + 9, + 16, + 11, + 5, + 12, + 3, + 39, + 9, + 15, + 14, + 17, + 31, + 2, + 11, + 16, + 3, + 13, + 13, + 16, + 5, + 18, + 16, + 18, + 6, + 2, + 20, + 76, + 1, + 9, + 12, + 13, + 18, + 10, + 22, + 18, + 8, + 10, + 14, + 8, + 10, + 17, + 19, + 3, + 7, + 15, + 4, + 13, + 5, + 5, + 18, + 23, + 20, + 7 + ], + "weighted_loads": [ + 0.24466784670948982, + 3.737940287217498, + 0.650215825997293, + 1.1371037997305393, + 0.16188502218574286, + 0.7233160398900509, + 0.7305510193109512, + 2.4915323816239834, + 0.672418225556612, + 0.7649991530925035, + 1.2980630658566952, + 0.3595906849950552, + 1.0873008333146572, + 0.7389196678996086, + 0.23728235810995102, + 0.818867901340127, + 0.11206110566854477, + 2.838966703042388, + 0.47528770565986633, + 0.7709726821631193, + 1.264125034213066, + 1.0313083790242672, + 1.9780714064836502, + 0.14926476404070854, + 0.692377258092165, + 1.019868578761816, + 0.12038394436240196, + 0.588369932025671, + 0.7118124514818192, + 1.0511077977716923, + 0.2305905153043568, + 1.3054840434342623, + 0.9494889229536057, + 1.3844580128788948, + 0.4322674982249737, + 0.06801808252930641, + 1.701978910714388, + 6.461141616106033, + 0.046867381781339645, + 0.40740975039079785, + 0.5770301669836044, + 0.6278593763709068, + 1.2157391533255577, + 0.4142082631587982, + 1.6748614199459553, + 1.3770065698772669, + 0.7305663712322712, + 0.3526996076107025, + 0.8174796737730503, + 0.36347850412130356, + 0.5260707251727581, + 1.4571310579776764, + 1.1075825411826372, + 0.22187833860516548, + 1.674920167773962, + 0.928434057161212, + 0.1519368216395378, + 0.8275517337024212, + 0.1587130401749164, + 0.2697403058409691, + 1.1487398035824299, + 0.9784219246357679, + 1.206388944759965, + 0.38996979780495167 + ], + "unique_experts": 64, + "load_cv": 0.8787650443875021, + "normalized_load_entropy": 0.9328764890295445, + "max_load_share": 0.08172043010752689 + } + }, + "s1_eos": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "3b5e51110b2940f0f90a2dcaf05da8a02cc60148e9a625ab9cb9008dd862e2f4", + "route_weight_sha256": "40df63e74095662bb220c69c8afb87816f689fcad8d80a02b9e6e2bab588bdf8", + "loads": [ + 5, + 60, + 12, + 15, + 0, + 12, + 4, + 37, + 1, + 14, + 15, + 5, + 9, + 3, + 5, + 10, + 2, + 36, + 10, + 15, + 14, + 17, + 29, + 2, + 11, + 6, + 3, + 13, + 15, + 16, + 1, + 18, + 12, + 5, + 6, + 2, + 20, + 77, + 3, + 1, + 5, + 13, + 18, + 9, + 23, + 13, + 2, + 5, + 14, + 5, + 7, + 17, + 8, + 3, + 3, + 7, + 3, + 13, + 1, + 4, + 18, + 23, + 21, + 4 + ], + "weighted_loads": [ + 0.20672021061182022, + 3.2400865852832794, + 0.6190441828221083, + 1.1364925801753998, + 0.0, + 0.7166852876543999, + 0.23720446228981018, + 2.452575473114848, + 0.03326210752129555, + 0.8021225854754448, + 1.2421717941761017, + 0.1982918120920658, + 0.7002429068088531, + 0.15843506157398224, + 0.23253530263900757, + 0.7588352207094431, + 0.08000581711530685, + 2.770747806876898, + 0.5122273117303848, + 0.7723362613469362, + 1.2564840987324715, + 1.0066017266362906, + 1.8930001463741064, + 0.1507759839296341, + 0.6875517927110195, + 0.2888917103409767, + 0.12342749536037445, + 0.5804494693875313, + 0.796127449721098, + 1.0477743372321129, + 0.07281521707773209, + 1.2945750504732132, + 0.780578225851059, + 0.2566276639699936, + 0.4379570707678795, + 0.06801551207900047, + 1.7286319341510534, + 6.496278557926416, + 0.12134787440299988, + 0.0716426819562912, + 0.1857161894440651, + 0.6101393215358257, + 1.1929933056235313, + 0.37509511411190033, + 1.714982295408845, + 0.8713941816240549, + 0.08032547309994698, + 0.19814742542803288, + 0.8128480687737465, + 0.20773151889443398, + 0.3551819249987602, + 1.462188731878996, + 0.45308202877640724, + 0.21625392884016037, + 0.09565270692110062, + 0.4157649166882038, + 0.11777597665786743, + 0.8223978392779827, + 0.040798868983983994, + 0.22123116627335548, + 1.1374626569449902, + 1.0047407560050488, + 1.2378828283399343, + 0.18954728171229362 + ], + "unique_experts": 63, + "load_cv": 1.068034133315822, + "normalized_load_entropy": 0.8992795326214139, + "max_load_share": 0.09871794871794871 + }, + "full_input": { + "tokens": 171, + "top_k": 6, + "decisions": 1026, + "ordered_route_sha256": "4540fbc1ecef986bbd24f1f706f08687bf1f910bac4ba194d96a1abe87092ac8", + "route_weight_sha256": "ad29d346e807cb802f94c63596db296719f821aa9c97f5802a99548aaf43b7f9", + "loads": [ + 6, + 65, + 22, + 16, + 3, + 13, + 15, + 37, + 15, + 14, + 18, + 10, + 18, + 11, + 5, + 10, + 2, + 49, + 11, + 15, + 14, + 17, + 30, + 6, + 11, + 17, + 3, + 15, + 16, + 16, + 5, + 18, + 16, + 24, + 6, + 2, + 20, + 77, + 9, + 7, + 18, + 13, + 20, + 9, + 23, + 25, + 16, + 9, + 17, + 10, + 12, + 17, + 16, + 9, + 7, + 18, + 3, + 13, + 4, + 6, + 18, + 27, + 23, + 9 + ], + "weighted_loads": [ + 0.2454955317080021, + 3.5195496194064617, + 1.2397082420066, + 1.191604807972908, + 0.1365811787545681, + 0.7609441131353378, + 1.2375358492136002, + 2.452575473114848, + 0.9783157296478748, + 0.8021225854754448, + 1.3832298144698143, + 0.38086240692064166, + 1.2346178106963634, + 0.7141051702201366, + 0.23253530263900757, + 0.7588352207094431, + 0.08000581711530685, + 3.6841141283512115, + 0.5590521357953548, + 0.7723362613469362, + 1.2564840987324715, + 1.0066017266362906, + 1.9323210511356592, + 0.34064238518476486, + 0.6875517927110195, + 1.3993040919303894, + 0.12342749536037445, + 0.7006371654570103, + 0.8381267935037613, + 1.0477743372321129, + 0.2348891543224454, + 1.2945750504732132, + 0.9249420911073685, + 1.673117158934474, + 0.4379570707678795, + 0.06801551207900047, + 1.7286319341510534, + 6.496278557926416, + 0.521580096334219, + 0.3293085237964988, + 0.8053292967379093, + 0.6101393215358257, + 1.3613472878932953, + 0.37509511411190033, + 1.714982295408845, + 1.9697157051414251, + 1.1288079880177975, + 0.3116019582375884, + 1.1272479146718979, + 0.5310174711048603, + 0.6122010480612516, + 1.462188731878996, + 0.947959179058671, + 0.8888971582055092, + 1.6789914537221193, + 1.1612932048738003, + 0.11777597665786743, + 0.8223978392779827, + 0.14161873469129205, + 0.2946929819881916, + 1.1374626569449902, + 1.1931014955043793, + 1.3379470203071833, + 0.4837619252502918 + ], + "unique_experts": 64, + "load_cv": 0.8042134708877083, + "normalized_load_entropy": 0.9409163991928159, + "max_load_share": 0.07504873294346978 + } + }, + "s0_bos": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "118269dc4ac95504e0636c1fe549be38b186c53f735bf87b9cf0ac1ec94c7d5c", + "route_weight_sha256": "758f56c2ee65b18c9602b14e38d9ddb23a2858ae48b612ada1fc9f8a28901428", + "loads": [ + 7, + 61, + 10, + 15, + 0, + 13, + 4, + 37, + 1, + 16, + 15, + 6, + 9, + 3, + 5, + 12, + 3, + 36, + 9, + 15, + 14, + 17, + 28, + 2, + 11, + 6, + 2, + 14, + 11, + 16, + 1, + 19, + 11, + 6, + 8, + 1, + 20, + 77, + 1, + 1, + 5, + 13, + 18, + 11, + 22, + 12, + 2, + 4, + 13, + 5, + 7, + 17, + 9, + 3, + 2, + 7, + 3, + 14, + 1, + 6, + 18, + 21, + 19, + 5 + ], + "weighted_loads": [ + 0.2675404641777277, + 3.390177285298705, + 0.5318635683506727, + 1.1443214640021324, + 0.0, + 0.76989521458745, + 0.25762491300702095, + 2.4441239908337593, + 0.030130602419376373, + 0.8762318193912506, + 1.2571066692471504, + 0.23873523250222206, + 0.7091562561690807, + 0.16885148361325264, + 0.2288920171558857, + 0.848459979519248, + 0.12548811361193657, + 2.6764518879354, + 0.4730340614914894, + 0.7618252485990524, + 1.2762156948447227, + 1.025163410231471, + 1.8532797265797853, + 0.15814616903662682, + 0.6998821049928665, + 0.27605830505490303, + 0.08310812339186668, + 0.6255662553012371, + 0.6575329601764679, + 1.0642809458076954, + 0.07106776535511017, + 1.34500852227211, + 0.7404813803732395, + 0.28228212147951126, + 0.5356135852634907, + 0.035242464393377304, + 1.7157337553799152, + 6.666189856827259, + 0.045221034437417984, + 0.07062756270170212, + 0.18378476426005363, + 0.6214195303618908, + 1.1938863601535559, + 0.45323315262794495, + 1.6717838272452354, + 0.8354523256421089, + 0.07660464942455292, + 0.16643904894590378, + 0.7747173886746168, + 0.20315940491855145, + 0.35439426079392433, + 1.4323099441826344, + 0.4741921555250883, + 0.21782781556248665, + 0.07133209705352783, + 0.42538127303123474, + 0.11713001504540443, + 0.8855581544339657, + 0.04263187572360039, + 0.2987912390381098, + 1.1535378359258175, + 0.8821685928851366, + 1.1566727235913277, + 0.2300359643995762 + ], + "unique_experts": 63, + "load_cv": 1.0662597843298594, + "normalized_load_entropy": 0.8993762693380863, + "max_load_share": 0.09871794871794871 + }, + "full_input": { + "tokens": 155, + "top_k": 6, + "decisions": 930, + "ordered_route_sha256": "451522cfc870010d82a9f145f8cb8e8421c2c829d1b87100610ec780520931ec", + "route_weight_sha256": "d8f5c46edfb2dbfd98d5a66041045022778790fa2294a6d8623ea046c5b5c996", + "loads": [ + 7, + 67, + 12, + 15, + 2, + 13, + 9, + 38, + 10, + 16, + 16, + 9, + 16, + 11, + 5, + 13, + 3, + 39, + 9, + 15, + 14, + 17, + 30, + 2, + 12, + 17, + 2, + 14, + 11, + 16, + 5, + 19, + 15, + 21, + 8, + 1, + 20, + 77, + 1, + 8, + 11, + 13, + 18, + 11, + 22, + 19, + 8, + 7, + 13, + 8, + 10, + 17, + 20, + 3, + 6, + 15, + 3, + 14, + 4, + 6, + 18, + 21, + 20, + 8 + ], + "weighted_loads": [ + 0.2675404641777277, + 3.759196300059557, + 0.5707329148426652, + 1.1443214640021324, + 0.11122797802090645, + 0.76989521458745, + 0.7272798158228397, + 2.4895828552544117, + 0.6767565011978149, + 0.8762318193912506, + 1.3160153813660145, + 0.3631035815924406, + 1.0931157507002354, + 0.7507670857012272, + 0.2288920171558857, + 0.894816568121314, + 0.12548811361193657, + 2.8017555326223373, + 0.4730340614914894, + 0.7618252485990524, + 1.2762156948447227, + 1.025163410231471, + 1.926767798140645, + 0.15814616903662682, + 0.7458315528929234, + 1.0465106815099716, + 0.08310812339186668, + 0.6255662553012371, + 0.6575329601764679, + 1.0642809458076954, + 0.27111678570508957, + 1.34500852227211, + 0.9112436473369598, + 1.5821350403130054, + 0.5356135852634907, + 0.035242464393377304, + 1.7157337553799152, + 6.666189856827259, + 0.045221034437417984, + 0.41860890854150057, + 0.5626700408756733, + 0.6214195303618908, + 1.1938863601535559, + 0.45323315262794495, + 1.6717838272452354, + 1.4511081017553806, + 0.7118703424930573, + 0.27703880053013563, + 0.7747173886746168, + 0.3802888821810484, + 0.5256212651729584, + 1.4323099441826344, + 1.1335289664566517, + 0.21782781556248665, + 0.7789671458303928, + 0.950402719900012, + 0.11713001504540443, + 0.8855581544339657, + 0.15638917312026024, + 0.2987912390381098, + 1.1535378359258175, + 0.8821685928851366, + 1.2032168917357922, + 0.436812873929739 + ], + "unique_experts": 64, + "load_cv": 0.8844724949957332, + "normalized_load_entropy": 0.930528614943934, + "max_load_share": 0.08279569892473118 + } + }, + "s1_bos": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "1fa1accc6219445362f594e52c78e52e8e8e443f251ee3151d02e38868f32c47", + "route_weight_sha256": "c2521b9b49a49a3bf6de484c4a3b68ff8c9123671cb16e6305bc4ca95d1bb257", + "loads": [ + 10, + 60, + 10, + 15, + 0, + 11, + 4, + 37, + 1, + 14, + 15, + 7, + 9, + 3, + 5, + 12, + 2, + 38, + 9, + 15, + 14, + 16, + 28, + 2, + 12, + 7, + 2, + 12, + 11, + 16, + 1, + 18, + 12, + 3, + 8, + 1, + 21, + 79, + 3, + 2, + 4, + 13, + 18, + 11, + 22, + 12, + 2, + 3, + 14, + 4, + 7, + 17, + 9, + 3, + 2, + 7, + 3, + 14, + 1, + 6, + 16, + 24, + 19, + 4 + ], + "weighted_loads": [ + 0.3749438188970089, + 3.225942485034466, + 0.5612849369645119, + 1.1335052624344826, + 0.0, + 0.6888873111456633, + 0.24471860006451607, + 2.4517341796308756, + 0.03194577619433403, + 0.7963294424116611, + 1.2481206879019737, + 0.26160780154168606, + 0.7153362259268761, + 0.16468919068574905, + 0.2275320179760456, + 0.8604097068309784, + 0.08736922591924667, + 2.8662519939243793, + 0.4605694152414799, + 0.7535495795309544, + 1.261785838752985, + 0.9397938195616007, + 1.838987149298191, + 0.1537424474954605, + 0.7524180449545383, + 0.31545715034008026, + 0.08695846423506737, + 0.5359622482210398, + 0.6581041757017374, + 1.0591811873018742, + 0.07046014070510864, + 1.2674783989787102, + 0.782488502562046, + 0.17587418481707573, + 0.5310683213174343, + 0.035913705825805664, + 1.7816985752433538, + 6.74270386248827, + 0.13152555376291275, + 0.09705370850861073, + 0.15003365278244019, + 0.6071889251470566, + 1.1872430853545666, + 0.43747638165950775, + 1.683886917307973, + 0.8269826769828796, + 0.08172263950109482, + 0.13542057946324348, + 0.7981800325214863, + 0.18105654418468475, + 0.36099671572446823, + 1.467854056507349, + 0.48354213684797287, + 0.20799807459115982, + 0.07383351773023605, + 0.4204486683011055, + 0.12114088982343674, + 0.855472557246685, + 0.04272405058145523, + 0.29390500113368034, + 1.0733700804412365, + 1.0350825246423483, + 1.1781882233917713, + 0.18936550617218018 + ], + "unique_experts": 63, + "load_cv": 1.0815407715383047, + "normalized_load_entropy": 0.8976838978490115, + "max_load_share": 0.10128205128205128 + }, + "full_input": { + "tokens": 171, + "top_k": 6, + "decisions": 1026, + "ordered_route_sha256": "1a232f35741ba7c26a26b3bf433a52b37b9e5c6b9f47fd5b7b57d8ff3a0bf9bf", + "route_weight_sha256": "cfaa2189618471ad0cd57c61d83237407fd50b606c086c8e54bb70622886cedf", + "loads": [ + 11, + 65, + 20, + 16, + 3, + 12, + 15, + 37, + 15, + 14, + 18, + 11, + 18, + 11, + 5, + 13, + 2, + 52, + 10, + 15, + 14, + 16, + 29, + 6, + 12, + 18, + 2, + 14, + 12, + 16, + 5, + 18, + 16, + 25, + 8, + 1, + 21, + 79, + 9, + 7, + 16, + 13, + 20, + 11, + 22, + 25, + 16, + 6, + 17, + 10, + 12, + 17, + 17, + 9, + 5, + 18, + 3, + 14, + 3, + 7, + 16, + 28, + 21, + 9 + ], + "weighted_loads": [ + 0.41371913999319077, + 3.505405519157648, + 1.1819489961490035, + 1.1886174902319908, + 0.13522327318787575, + 0.7331461366266012, + 1.2175391353666782, + 2.4517341796308756, + 0.9783007688820362, + 0.7963294424116611, + 1.3954896330833435, + 0.4335714131593704, + 1.2497111298143864, + 0.7353772595524788, + 0.2275320179760456, + 0.9005276784300804, + 0.08736922591924667, + 3.8261178731918335, + 0.5073942393064499, + 0.7535495795309544, + 1.261785838752985, + 0.9397938195616007, + 1.8783080540597439, + 0.3436088487505913, + 0.7524180449545383, + 1.425869531929493, + 0.08695846423506737, + 0.6561499442905188, + 0.7001035194844007, + 1.0591811873018742, + 0.2620828188955784, + 1.2674783989787102, + 0.9268523678183556, + 1.7817116025835276, + 0.5310683213174343, + 0.035913705825805664, + 1.7816985752433538, + 6.74270386248827, + 0.5317577756941319, + 0.3463000087067485, + 0.7631661891937256, + 0.6071889251470566, + 1.3555970676243305, + 0.43747638165950775, + 1.683886917307973, + 2.0185590498149395, + 1.0995861999690533, + 0.23984292428940535, + 1.1125798784196377, + 0.5698621869087219, + 0.6180158387869596, + 1.467854056507349, + 0.9784192871302366, + 0.8806413039565086, + 0.7428175862878561, + 1.177386287599802, + 0.12114088982343674, + 0.855472557246685, + 0.14064226672053337, + 0.32745344191789627, + 1.0733700804412365, + 1.2234432641416788, + 1.2782524153590202, + 0.4835801497101784 + ], + "unique_experts": 64, + "load_cv": 0.8198613506653621, + "normalized_load_entropy": 0.9389859910135896, + "max_load_share": 0.0769980506822612 + } + }, + "s0_x": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "0bfffb1d7f937b5be1275294c4109254841672348218d27bb139c425d24b68fb", + "route_weight_sha256": "621933b240b96071371961103ff4112c9d1baf2a469c8b243964ea763c3e3c24", + "loads": [ + 7, + 61, + 11, + 15, + 0, + 11, + 4, + 37, + 1, + 14, + 15, + 7, + 9, + 3, + 5, + 10, + 4, + 35, + 9, + 15, + 14, + 17, + 28, + 2, + 11, + 5, + 2, + 16, + 11, + 16, + 1, + 17, + 12, + 6, + 8, + 1, + 21, + 78, + 2, + 1, + 6, + 12, + 18, + 10, + 22, + 12, + 3, + 4, + 13, + 4, + 7, + 17, + 9, + 3, + 4, + 7, + 2, + 14, + 1, + 6, + 18, + 23, + 19, + 4 + ], + "weighted_loads": [ + 0.28035968728363514, + 3.406353970989585, + 0.5927554219961166, + 1.1383834406733513, + 0.0, + 0.6818929668515921, + 0.2512930706143379, + 2.4619432520121336, + 0.031472619622945786, + 0.8062124792486429, + 1.2503362372517586, + 0.266294676810503, + 0.7144523374736309, + 0.16626136377453804, + 0.23301314562559128, + 0.777880672365427, + 0.16483407840132713, + 2.6785973999649286, + 0.4822096899151802, + 0.7532965540885925, + 1.2585687041282654, + 1.003898348659277, + 1.8315734267234802, + 0.15616140887141228, + 0.6946542896330357, + 0.23034556210041046, + 0.0826978050172329, + 0.7055139783769846, + 0.6551665030419827, + 1.0518380142748356, + 0.07330458611249924, + 1.2813275083899498, + 0.7981287762522697, + 0.2858981192111969, + 0.5269513726234436, + 0.03419655188918114, + 1.7394006177783012, + 6.684443596750498, + 0.10269153863191605, + 0.07047572731971741, + 0.2128821574151516, + 0.5933846682310104, + 1.193921308964491, + 0.40811271592974663, + 1.6451330110430717, + 0.8745500110089779, + 0.12978286854922771, + 0.16594621166586876, + 0.7800536826252937, + 0.17986659705638885, + 0.36120108515024185, + 1.4612074680626392, + 0.4685736149549484, + 0.21150511875748634, + 0.13160010799765587, + 0.4339819550514221, + 0.07842716574668884, + 0.8744927048683167, + 0.04201008006930351, + 0.2933044768869877, + 1.170542862266302, + 0.9654987007379532, + 1.1538605745881796, + 0.17622554674744606 + ], + "unique_experts": 63, + "load_cv": 1.0694121471936895, + "normalized_load_entropy": 0.9002948670087726, + "max_load_share": 0.1 + }, + "full_input": { + "tokens": 155, + "top_k": 6, + "decisions": 930, + "ordered_route_sha256": "ded3cc66fca926502d920ca311c6ff7a25159ea35aa6ef69343f8d0f9276ed88", + "route_weight_sha256": "33b13872adbc973126787e9943f6c688af93cc96554941ff4e6089e00ac20a61", + "loads": [ + 7, + 68, + 14, + 15, + 2, + 11, + 10, + 38, + 11, + 14, + 16, + 10, + 16, + 12, + 5, + 10, + 4, + 37, + 9, + 15, + 14, + 17, + 30, + 2, + 11, + 17, + 2, + 16, + 11, + 16, + 4, + 17, + 17, + 20, + 8, + 1, + 21, + 78, + 2, + 7, + 12, + 12, + 18, + 10, + 22, + 18, + 9, + 7, + 13, + 8, + 11, + 17, + 20, + 3, + 6, + 15, + 2, + 14, + 4, + 6, + 18, + 23, + 20, + 7 + ], + "weighted_loads": [ + 0.28035968728363514, + 3.8273517340421677, + 0.6734462408348918, + 1.1383834406733513, + 0.11290759220719337, + 0.6818929668515921, + 0.7458195351064205, + 2.507402116432786, + 0.7275304831564426, + 0.8062124792486429, + 1.3058421798050404, + 0.3799798581749201, + 1.0984118320047855, + 0.8444538749754429, + 0.23301314562559128, + 0.777880672365427, + 0.16483407840132713, + 2.760155191645026, + 0.4822096899151802, + 0.7532965540885925, + 1.2585687041282654, + 1.003898348659277, + 1.90506149828434, + 0.15616140887141228, + 0.6946542896330357, + 1.1014343835413456, + 0.0826978050172329, + 0.7055139783769846, + 0.6551665030419827, + 1.0518380142748356, + 0.2050170972943306, + 1.2813275083899498, + 1.0125137455761433, + 1.411155167967081, + 0.5269513726234436, + 0.03419655188918114, + 1.7394006177783012, + 6.684443596750498, + 0.10269153863191605, + 0.33742152992635965, + 0.5585931688547134, + 0.5933846682310104, + 1.193921308964491, + 0.40811271592974663, + 1.6451330110430717, + 1.4516781717538834, + 0.7400700096040964, + 0.2765459632501006, + 0.7800536826252937, + 0.4157371297478676, + 0.5875130072236061, + 1.4612074680626392, + 1.1279104258865118, + 0.21150511875748634, + 0.7555688880383968, + 0.9560333248227835, + 0.07842716574668884, + 0.8744927048683167, + 0.15576737746596336, + 0.2933044768869877, + 1.170542862266302, + 0.9654987007379532, + 1.200404742732644, + 0.38300245627760887 + ], + "unique_experts": 64, + "load_cv": 0.8909742563329363, + "normalized_load_entropy": 0.9302023883849793, + "max_load_share": 0.08387096774193549 + } + }, + "s1_x": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "ce0b78ea5752c310ef1e2c85abf10adefbd2f65ab012852de5f142b40f5c8ea4", + "route_weight_sha256": "6ad2e19e34d403eb8a77173d1dad6c3b8516c265f181bc2d4d45341f94687d54", + "loads": [ + 7, + 60, + 12, + 15, + 0, + 11, + 4, + 37, + 1, + 13, + 15, + 8, + 9, + 3, + 4, + 11, + 3, + 36, + 9, + 15, + 14, + 18, + 29, + 2, + 12, + 6, + 2, + 12, + 10, + 16, + 1, + 18, + 12, + 6, + 8, + 1, + 20, + 80, + 3, + 2, + 4, + 12, + 18, + 11, + 23, + 12, + 2, + 4, + 13, + 4, + 7, + 17, + 8, + 3, + 3, + 7, + 3, + 14, + 1, + 5, + 17, + 25, + 18, + 4 + ], + "weighted_loads": [ + 0.2709195055067539, + 3.1851353887468576, + 0.6403111480176449, + 1.1332560181617737, + 0.0, + 0.6707061007618904, + 0.23944060131907463, + 2.458968786522746, + 0.0324522890150547, + 0.7557220794260502, + 1.2359599694609642, + 0.29820741340518, + 0.7117141261696815, + 0.16554605215787888, + 0.1948489174246788, + 0.8099371064454317, + 0.11757751181721687, + 2.712237074971199, + 0.45853685587644577, + 0.7459586542099714, + 1.2460800297558308, + 0.9910038132220507, + 1.8502719514071941, + 0.15113690868020058, + 0.7325617298483849, + 0.28744907304644585, + 0.08820967003703117, + 0.54194375872612, + 0.6219746936112642, + 1.0692347288131714, + 0.07154364883899689, + 1.2551561333239079, + 0.8020190522074699, + 0.2586026005446911, + 0.5216208733618259, + 0.03614461049437523, + 1.7815187815576792, + 6.7126917950809, + 0.13913190364837646, + 0.09621279127895832, + 0.15128375962376595, + 0.578427217900753, + 1.175444032996893, + 0.4543243758380413, + 1.715640814974904, + 0.8419030420482159, + 0.09553522430360317, + 0.16392176039516926, + 0.7503151223063469, + 0.18131950125098228, + 0.3669673539698124, + 1.4899797774851322, + 0.4415946491062641, + 0.19801203534007072, + 0.100394481793046, + 0.4319906160235405, + 0.11694616451859474, + 0.8529074341058731, + 0.04358650743961334, + 0.25544838048517704, + 1.094122502952814, + 1.0621255952864885, + 1.1488186120986938, + 0.17712706699967384 + ], + "unique_experts": 63, + "load_cv": 1.0846487234980413, + "normalized_load_entropy": 0.8984442989375603, + "max_load_share": 0.10256410256410256 + }, + "full_input": { + "tokens": 171, + "top_k": 6, + "decisions": 1026, + "ordered_route_sha256": "25428afd306ee7106fefe830577bc66ccd1ce1d5d8b2dd158797dbb4f1ee5678", + "route_weight_sha256": "fc9cfe909866e8f322f343ff772814f3d036ee93b03c697075ed31bc5b6de7b1", + "loads": [ + 8, + 66, + 23, + 17, + 2, + 12, + 16, + 37, + 14, + 13, + 19, + 13, + 18, + 13, + 4, + 11, + 3, + 50, + 10, + 15, + 14, + 18, + 30, + 6, + 12, + 19, + 2, + 14, + 11, + 16, + 4, + 18, + 17, + 25, + 8, + 1, + 20, + 80, + 9, + 6, + 16, + 12, + 20, + 11, + 23, + 24, + 15, + 7, + 16, + 10, + 13, + 17, + 16, + 9, + 5, + 17, + 3, + 14, + 3, + 6, + 17, + 29, + 20, + 9 + ], + "weighted_loads": [ + 0.3096948266029358, + 3.5092856232076883, + 1.297937254421413, + 1.241732269525528, + 0.08163386955857277, + 0.7149649262428284, + 1.219767116010189, + 2.458968786522746, + 0.9213453866541386, + 0.7557220794260502, + 1.4375307261943817, + 0.49466673471033573, + 1.2460890300571918, + 0.8772212229669094, + 0.1948489174246788, + 0.8099371064454317, + 0.11757751181721687, + 3.6685380823910236, + 0.5053616799414158, + 0.7459586542099714, + 1.2460800297558308, + 0.9910038132220507, + 1.889592856168747, + 0.34100330993533134, + 0.7325617298483849, + 1.5655478686094284, + 0.08820967003703117, + 0.662131454795599, + 0.6639740373939276, + 1.0692347288131714, + 0.2051829695701599, + 1.2551561333239079, + 0.9877484701573849, + 1.5502530727535486, + 0.5216208733618259, + 0.03614461049437523, + 1.7815187815576792, + 6.7126917950809, + 0.5393641255795956, + 0.27507639210671186, + 0.7202320247888565, + 0.578427217900753, + 1.3437980152666569, + 0.4543243758380413, + 1.715640814974904, + 1.9672207348048687, + 1.0429774057120085, + 0.2683441052213311, + 1.0647149682044983, + 0.5733288079500198, + 0.6951482612639666, + 1.4899797774851322, + 0.9364717993885279, + 0.8706552647054195, + 0.7238162085413933, + 1.0847923122346401, + 0.11694616451859474, + 0.8529074341058731, + 0.14150472357869148, + 0.28899682126939297, + 1.094122502952814, + 1.250486334785819, + 1.2488828040659428, + 0.47134171053767204 + ], + "unique_experts": 64, + "load_cv": 0.8296654457379021, + "normalized_load_entropy": 0.9372098142623224, + "max_load_share": 0.07797270955165692 + } + }, + "s0_period": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "7703c1b319d873feabb8e44c080aaca412ee326a6288a363212077965069eb42", + "route_weight_sha256": "7594539e3d5a880fc334590459338ca55bde1e14fcfab3fffb4c65b606ed7bb3", + "loads": [ + 8, + 63, + 11, + 15, + 0, + 11, + 4, + 36, + 1, + 15, + 15, + 7, + 9, + 3, + 5, + 11, + 2, + 36, + 10, + 14, + 14, + 17, + 29, + 2, + 12, + 6, + 2, + 16, + 13, + 16, + 1, + 18, + 11, + 6, + 8, + 1, + 21, + 76, + 2, + 1, + 4, + 12, + 18, + 9, + 22, + 13, + 2, + 3, + 13, + 4, + 7, + 17, + 9, + 3, + 3, + 7, + 2, + 14, + 1, + 5, + 18, + 22, + 20, + 4 + ], + "weighted_loads": [ + 0.3111853152513504, + 3.4445797745138407, + 0.577579490840435, + 1.140541173517704, + 0.0, + 0.6879181694239378, + 0.25350194051861763, + 2.404213637113571, + 0.03142435476183891, + 0.8344179335981607, + 1.2504879087209702, + 0.2623439282178879, + 0.7168211452662945, + 0.16432395577430725, + 0.22762245684862137, + 0.8147864472121, + 0.08643503114581108, + 2.7186428736895323, + 0.5081845670938492, + 0.7274748757481575, + 1.2550135925412178, + 1.0066216588020325, + 1.8614909630268812, + 0.15284227207303047, + 0.7597179040312767, + 0.27575302869081497, + 0.08398927003145218, + 0.6919184271246195, + 0.7219057958573103, + 1.0452551953494549, + 0.07280958443880081, + 1.321646735072136, + 0.7667401880025864, + 0.28248369693756104, + 0.5233342424035072, + 0.03493444621562958, + 1.7589285355061293, + 6.625784054398537, + 0.09628525748848915, + 0.06982669234275818, + 0.1439118143171072, + 0.5929970480501652, + 1.2099923864006996, + 0.3685317449271679, + 1.655522931367159, + 0.91239776276052, + 0.07393044233322144, + 0.13536982238292694, + 0.7775315791368484, + 0.17934762686491013, + 0.36564401164650917, + 1.4377622939646244, + 0.4793931357562542, + 0.2131292074918747, + 0.10058085806667805, + 0.4357623904943466, + 0.07775138318538666, + 0.8808124139904976, + 0.04247046634554863, + 0.2657229155302048, + 1.1737780161201954, + 0.9170145448297262, + 1.1914688274264336, + 0.17881524376571178 + ], + "unique_experts": 63, + "load_cv": 1.073437582990244, + "normalized_load_entropy": 0.8976150106394324, + "max_load_share": 0.09743589743589744 + }, + "full_input": { + "tokens": 155, + "top_k": 6, + "decisions": 930, + "ordered_route_sha256": "c10110463c3eaa85f9ed0e80d43b2fd5291eacccdb44c77d4746fee5f65a7927", + "route_weight_sha256": "b32ae04773ba6de3a10df8078414c7b04ba53364384e5e6bf4191001fb36bd6f", + "loads": [ + 8, + 69, + 13, + 15, + 2, + 11, + 12, + 37, + 10, + 15, + 17, + 10, + 16, + 12, + 5, + 11, + 2, + 38, + 10, + 14, + 14, + 17, + 31, + 2, + 12, + 18, + 2, + 16, + 13, + 16, + 4, + 18, + 15, + 20, + 8, + 1, + 21, + 76, + 2, + 7, + 9, + 12, + 18, + 9, + 22, + 19, + 9, + 6, + 13, + 9, + 10, + 17, + 20, + 3, + 5, + 15, + 2, + 14, + 4, + 5, + 18, + 22, + 21, + 8 + ], + "weighted_loads": [ + 0.3111853152513504, + 3.8135987892746925, + 0.6164488373324275, + 1.140541173517704, + 0.1185065321624279, + 0.6879181694239378, + 0.894596591591835, + 2.4496725015342236, + 0.7492432221770287, + 0.8344179335981607, + 1.3509472236037254, + 0.37459233589470387, + 1.1007806397974491, + 0.789862610399723, + 0.22762245684862137, + 0.8147864472121, + 0.08643503114581108, + 2.80020066536963, + 0.5081845670938492, + 0.7274748757481575, + 1.2550135925412178, + 1.0066216588020325, + 1.934979034587741, + 0.15284227207303047, + 0.7597179040312767, + 1.1370572783052921, + 0.08398927003145218, + 0.6919184271246195, + 0.7219057958573103, + 1.0452551953494549, + 0.2077140398323536, + 1.321646735072136, + 0.9375024549663067, + 1.4044276848435402, + 0.5233342424035072, + 0.03493444621562958, + 1.7589285355061293, + 6.625784054398537, + 0.09628525748848915, + 0.3453334281221032, + 0.4372678156942129, + 0.5929970480501652, + 1.2099923864006996, + 0.3685317449271679, + 1.655522931367159, + 1.475550951436162, + 0.7678522318601608, + 0.2459695739671588, + 0.7775315791368484, + 0.44338467717170715, + 0.5368710160255432, + 1.4377622939646244, + 1.1387299466878176, + 0.2131292074918747, + 0.724549638107419, + 0.9370231423527002, + 0.07775138318538666, + 0.8808124139904976, + 0.15622776374220848, + 0.2657229155302048, + 1.1737780161201954, + 0.9170145448297262, + 1.238012995570898, + 0.5092310439795256 + ], + "unique_experts": 64, + "load_cv": 0.8895612557077655, + "normalized_load_entropy": 0.9292453556439451, + "max_load_share": 0.08172043010752689 + } + }, + "s1_period": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "d2bff1f9be598d1240c0ea2880ce58e5dab5d6cb305d6e934e5dae0dbd23f075", + "route_weight_sha256": "7bb4f203958cc4587f72ed5d095f9970aeccf6afa1eedd0e4c5a1926295137d0", + "loads": [ + 8, + 59, + 11, + 15, + 0, + 11, + 4, + 37, + 1, + 14, + 15, + 7, + 9, + 3, + 5, + 11, + 2, + 37, + 8, + 15, + 14, + 17, + 30, + 2, + 12, + 7, + 2, + 13, + 11, + 16, + 1, + 18, + 12, + 4, + 8, + 1, + 21, + 80, + 2, + 2, + 5, + 13, + 18, + 12, + 24, + 12, + 1, + 3, + 13, + 4, + 7, + 17, + 9, + 3, + 2, + 7, + 2, + 13, + 1, + 5, + 16, + 26, + 18, + 4 + ], + "weighted_loads": [ + 0.3166898041963577, + 3.121552074328065, + 0.6196956187486649, + 1.140413075685501, + 0.0, + 0.6739411447197199, + 0.23701136931777, + 2.4611143954098225, + 0.03322295844554901, + 0.7941326797008514, + 1.2405219301581383, + 0.2601994052529335, + 0.712317630648613, + 0.1642683669924736, + 0.23124612867832184, + 0.822871170938015, + 0.08735691010951996, + 2.7509279884397984, + 0.4220014922320843, + 0.7493496928364038, + 1.2579575292766094, + 0.9623371176421642, + 1.896824922412634, + 0.15214478597044945, + 0.7344141751527786, + 0.328032024204731, + 0.08177806809544563, + 0.5717968642711639, + 0.6565174143761396, + 1.0598872378468513, + 0.07212498784065247, + 1.267317658290267, + 0.8028195463120937, + 0.17268500849604607, + 0.5215066745877266, + 0.03618986904621124, + 1.8170310910791159, + 6.679089991375804, + 0.09632687643170357, + 0.09605134651064873, + 0.179422153159976, + 0.6080184169113636, + 1.1755135506391525, + 0.4983993284404278, + 1.760023532435298, + 0.8328134305775166, + 0.05437617003917694, + 0.1363224908709526, + 0.75255286693573, + 0.1812577098608017, + 0.36635035276412964, + 1.4911652281880379, + 0.4720704536885023, + 0.20095431059598923, + 0.0717148520052433, + 0.43478066846728325, + 0.08654863759875298, + 0.8057828992605209, + 0.043936025351285934, + 0.25533747486770153, + 1.0663631297647953, + 1.1011703945696354, + 1.1352580524981022, + 0.17550322227180004 + ], + "unique_experts": 63, + "load_cv": 1.091223730849559, + "normalized_load_entropy": 0.8952247995849293, + "max_load_share": 0.10256410256410256 + }, + "full_input": { + "tokens": 171, + "top_k": 6, + "decisions": 1026, + "ordered_route_sha256": "b8f3d0fb19853a30032c29cf1240cc79f750fa4d37d00d987f6e22e9ecb89dca", + "route_weight_sha256": "ca58240d080a26bf06f8e0ee6d629d4f1624858f012abdfaf325b8cb039c0c49", + "loads": [ + 9, + 64, + 21, + 17, + 2, + 12, + 17, + 37, + 14, + 14, + 19, + 11, + 18, + 11, + 5, + 11, + 2, + 52, + 9, + 15, + 14, + 17, + 31, + 6, + 12, + 20, + 2, + 15, + 12, + 16, + 4, + 18, + 16, + 23, + 8, + 1, + 21, + 80, + 8, + 6, + 17, + 13, + 20, + 12, + 24, + 23, + 16, + 6, + 16, + 12, + 12, + 17, + 17, + 9, + 4, + 18, + 2, + 13, + 3, + 6, + 16, + 30, + 20, + 10 + ], + "weighted_loads": [ + 0.3554651252925396, + 3.401015108451247, + 1.2403596779331565, + 1.2512199394404888, + 0.08057734370231628, + 0.7181999702006578, + 1.3236732073128223, + 2.4611143954098225, + 0.9486425034701824, + 0.7941326797008514, + 1.4419782757759094, + 0.42133802734315395, + 1.2466925345361233, + 0.7365700006484985, + 0.23124612867832184, + 0.822871170938015, + 0.08735691010951996, + 3.7735134698450565, + 0.4688263162970543, + 0.7493496928364038, + 1.2579575292766094, + 0.9623371176421642, + 1.9361458271741867, + 0.3420111872255802, + 0.7344141751527786, + 1.5618511773645878, + 0.08177806809544563, + 0.6919845603406429, + 0.698516758158803, + 1.0598872378468513, + 0.20465198159217834, + 1.267317658290267, + 0.9471834115684032, + 1.450269227847457, + 0.5215066745877266, + 0.03618986904621124, + 1.8170310910791159, + 6.679089991375804, + 0.49655909836292267, + 0.28363764751702547, + 0.7531763184815645, + 0.6080184169113636, + 1.3438675329089165, + 0.4983993284404278, + 1.760023532435298, + 1.9129212237894535, + 1.159459538757801, + 0.24074483569711447, + 1.0669527128338814, + 0.6738188676536083, + 0.6233694758266211, + 1.4911652281880379, + 0.9669476039707661, + 0.873597539961338, + 0.6951365787535906, + 1.1297222524881363, + 0.08654863759875298, + 0.8057828992605209, + 0.14185424149036407, + 0.28888591565191746, + 1.0663631297647953, + 1.289531134068966, + 1.235322244465351, + 0.5457469131797552 + ], + "unique_experts": 64, + "load_cv": 0.8305443337208619, + "normalized_load_entropy": 0.9362628785344774, + "max_load_share": 0.07797270955165692 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 130, + "ordered_topk_exact_tokens": 101, + "set_exact_tokens": 113, + "mean_set_jaccard": 0.9593406593406594, + "mean_token_weighted_tv": 0.00925023783571445, + "aggregate_load_tv": 0.015384615384615377 + }, + "system_bos": { + "tokens": 130, + "ordered_topk_exact_tokens": 86, + "set_exact_tokens": 107, + "mean_set_jaccard": 0.9461538461538461, + "mean_token_weighted_tv": 0.013481984029595669, + "aggregate_load_tv": 0.024358974358974356 + }, + "system_x": { + "tokens": 130, + "ordered_topk_exact_tokens": 90, + "set_exact_tokens": 100, + "mean_set_jaccard": 0.9324175824175824, + "mean_token_weighted_tv": 0.016365803154901815, + "aggregate_load_tv": 0.023076923076923075 + }, + "system_period": { + "tokens": 130, + "ordered_topk_exact_tokens": 83, + "set_exact_tokens": 93, + "mean_set_jaccard": 0.9170329670329671, + "mean_token_weighted_tv": 0.018683196847828536, + "aggregate_load_tv": 0.028205128205128202 + }, + "bos_at_s0": { + "tokens": 130, + "ordered_topk_exact_tokens": 83, + "set_exact_tokens": 100, + "mean_set_jaccard": 0.9291208791208792, + "mean_token_weighted_tv": 0.015965902855476506, + "aggregate_load_tv": 0.021794871794871787 + }, + "bos_at_s1": { + "tokens": 130, + "ordered_topk_exact_tokens": 75, + "set_exact_tokens": 93, + "mean_set_jaccard": 0.9153846153846154, + "mean_token_weighted_tv": 0.018187649325969127, + "aggregate_load_tv": 0.03333333333333334 + }, + "x_at_s0": { + "tokens": 130, + "ordered_topk_exact_tokens": 74, + "set_exact_tokens": 88, + "mean_set_jaccard": 0.9027472527472528, + "mean_token_weighted_tv": 0.020043960199333154, + "aggregate_load_tv": 0.025641025641025644 + }, + "x_at_s1": { + "tokens": 130, + "ordered_topk_exact_tokens": 78, + "set_exact_tokens": 93, + "mean_set_jaccard": 0.9137362637362638, + "mean_token_weighted_tv": 0.020486507285386323, + "aggregate_load_tv": 0.028205128205128202 + }, + "period_at_s0": { + "tokens": 130, + "ordered_topk_exact_tokens": 77, + "set_exact_tokens": 91, + "mean_set_jaccard": 0.9076923076923077, + "mean_token_weighted_tv": 0.01911619481129142, + "aggregate_load_tv": 0.02692307692307692 + }, + "period_at_s1": { + "tokens": 130, + "ordered_topk_exact_tokens": 70, + "set_exact_tokens": 85, + "mean_set_jaccard": 0.8994505494505495, + "mean_token_weighted_tv": 0.022123503692161577, + "aggregate_load_tv": 0.03333333333333334 + } + } + }, + "layer_09": { + "layer": 9, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "185bc9d0ae304b78915a4998022fccfa9fc11159f0986d3557e74684aa9adce4", + "route_weight_sha256": "7d295572e00991aa14ab2757fcb60664233814c6c59aac8b943d6469babf403f", + "loads": [ + 6, + 16, + 5, + 17, + 5, + 18, + 26, + 7, + 8, + 13, + 1, + 31, + 13, + 7, + 5, + 10, + 7, + 3, + 16, + 7, + 19, + 9, + 9, + 2, + 3, + 3, + 7, + 10, + 26, + 4, + 23, + 11, + 3, + 9, + 31, + 11, + 18, + 19, + 6, + 16, + 18, + 4, + 14, + 2, + 7, + 2, + 5, + 14, + 16, + 8, + 9, + 27, + 21, + 2, + 9, + 5, + 72, + 23, + 16, + 9, + 15, + 11, + 7, + 4 + ], + "weighted_loads": [ + 0.3339907005429268, + 1.209159230813384, + 0.27903399989008904, + 0.8133630249649286, + 0.26628824695944786, + 0.8759816978126764, + 1.3963243067264557, + 0.4574853740632534, + 0.5693247467279434, + 0.7385335713624954, + 0.043422602117061615, + 2.1404570396989584, + 0.8845730498433113, + 0.40785203501582146, + 0.2720957174897194, + 0.501439293846488, + 0.3362740967422724, + 0.11401062086224556, + 0.9076472073793411, + 0.3941156826913357, + 0.9996085129678249, + 0.5453613139688969, + 0.3506852053105831, + 0.09956008568406105, + 0.1294194459915161, + 0.1388135366141796, + 0.2567432075738907, + 0.6312878392636776, + 2.3730818443000317, + 0.2424418292939663, + 1.5754716880619526, + 0.6299632042646408, + 0.10912851616740227, + 0.5672994516789913, + 2.1892763655632734, + 0.7803686819970608, + 1.1558652948588133, + 1.3094356674700975, + 0.26334021613001823, + 0.8409074023365974, + 1.0786487199366093, + 0.23926092311739922, + 0.7713449597358704, + 0.10589218884706497, + 0.29636567644774914, + 0.08678384870290756, + 0.35635025426745415, + 0.8941117823123932, + 1.254270352423191, + 0.3465307988226414, + 0.4617811441421509, + 2.161210184916854, + 1.2128918338567019, + 0.06550223752856255, + 0.5213440619409084, + 0.1755687277764082, + 4.923200819641352, + 1.5351693145930767, + 1.2916019670665264, + 0.423384390771389, + 1.0700747072696686, + 1.0336588993668556, + 0.371590469032526, + 0.24852538108825684 + ], + "unique_experts": 64, + "load_cv": 0.8712366236780166, + "normalized_load_entropy": 0.9303989930221697, + "max_load_share": 0.09230769230769231 + }, + "full_input": { + "tokens": 155, + "top_k": 6, + "decisions": 930, + "ordered_route_sha256": "07bfd48a22235b22d5ca678d8cd289def943261008c6d2364b6e6f5fec541794", + "route_weight_sha256": "af7cd5b3038b32857ae8e28e58fefb537defb23c31f3fcf8e850479b699543a3", + "loads": [ + 13, + 19, + 5, + 17, + 7, + 18, + 26, + 7, + 10, + 13, + 12, + 31, + 16, + 12, + 5, + 10, + 9, + 4, + 16, + 17, + 19, + 9, + 13, + 5, + 6, + 5, + 7, + 11, + 26, + 4, + 24, + 17, + 4, + 9, + 40, + 18, + 18, + 19, + 8, + 16, + 18, + 13, + 14, + 2, + 13, + 10, + 16, + 14, + 19, + 8, + 14, + 28, + 21, + 5, + 9, + 11, + 77, + 23, + 17, + 13, + 15, + 11, + 9, + 5 + ], + "weighted_loads": [ + 0.857185497879982, + 1.4265486616641283, + 0.27903399989008904, + 0.8133630249649286, + 0.5040299110114574, + 0.8759816978126764, + 1.3963243067264557, + 0.4574853740632534, + 0.6655171401798725, + 0.7385335713624954, + 1.2139020562171936, + 2.1404570396989584, + 0.9387044180184603, + 0.6596277728676796, + 0.2720957174897194, + 0.501439293846488, + 0.44161214493215084, + 0.15660900995135307, + 0.9076472073793411, + 1.2941070348024368, + 0.9996085129678249, + 0.5453613139688969, + 1.8861707784235477, + 0.37990305200219154, + 0.256552305072546, + 0.25982843711972237, + 0.2567432075738907, + 0.6442867275327444, + 2.3730818443000317, + 0.2424418292939663, + 1.6151335015892982, + 0.8178041528444737, + 0.1128575699403882, + 0.5672994516789913, + 2.687329227104783, + 1.2432100400328636, + 1.1558652948588133, + 1.3094356674700975, + 0.3494533598423004, + 0.8409074023365974, + 1.0786487199366093, + 1.1712783463299274, + 0.7713449597358704, + 0.10589218884706497, + 0.6495112655684352, + 0.8728343434631824, + 1.2307427562773228, + 0.8941117823123932, + 1.4688349775969982, + 0.3465307988226414, + 0.7537600845098495, + 2.1948457527905703, + 1.2128918338567019, + 0.1850878968834877, + 0.5213440619409084, + 0.5179476831108332, + 5.165203619748354, + 1.5351693145930767, + 1.3485958278179169, + 0.5949040874838829, + 1.0700747072696686, + 1.0336588993668556, + 0.42744606360793114, + 0.2847219258546829 + ], + "unique_experts": 64, + "load_cv": 0.7336548974918061, + "normalized_load_entropy": 0.951911208766065, + "max_load_share": 0.08279569892473118 + } + }, + "s1_eos": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "5bf6338ce878ca5df27653d3ee66705cf561d0d5a69687f8a5f26e1a6cfb6875", + "route_weight_sha256": "75821b97613d224bff78b5efa0251421c4b4eb36607d6c16c8808b8e22f90a08", + "loads": [ + 6, + 16, + 5, + 17, + 5, + 18, + 24, + 7, + 8, + 13, + 1, + 31, + 12, + 7, + 5, + 9, + 6, + 4, + 16, + 7, + 19, + 9, + 8, + 2, + 2, + 4, + 7, + 10, + 26, + 5, + 23, + 11, + 3, + 9, + 31, + 11, + 18, + 18, + 6, + 17, + 18, + 5, + 15, + 2, + 8, + 2, + 5, + 14, + 16, + 7, + 9, + 28, + 19, + 1, + 9, + 6, + 70, + 24, + 16, + 9, + 15, + 15, + 7, + 4 + ], + "weighted_loads": [ + 0.32160847447812557, + 1.2024675644934177, + 0.27953316271305084, + 0.8226432371884584, + 0.26314663887023926, + 0.8763472829014063, + 1.3423724863678217, + 0.46301622688770294, + 0.5621337778866291, + 0.7272188756614923, + 0.043377768248319626, + 2.146380640566349, + 0.8286681361496449, + 0.40529655292630196, + 0.2717549279332161, + 0.467211302369833, + 0.30813025310635567, + 0.15062032267451286, + 0.9069340825080872, + 0.39433602802455425, + 0.9930911771953106, + 0.5490483995527029, + 0.30309147760272026, + 0.09964002296328545, + 0.09045342355966568, + 0.16816473752260208, + 0.25601249374449253, + 0.6249622739851475, + 2.3712799102067947, + 0.2756740693002939, + 1.5815693326294422, + 0.6417763195931911, + 0.10897153615951538, + 0.5621693171560764, + 2.168332802131772, + 0.7753536254167557, + 1.1626986730843782, + 1.2765187490731478, + 0.26555920019745827, + 0.8688110262155533, + 1.0684524662792683, + 0.2716977521777153, + 0.7994544245302677, + 0.10708644241094589, + 0.3421229049563408, + 0.08705325797200203, + 0.3542448952794075, + 0.9034720733761787, + 1.2443696521222591, + 0.31566070951521397, + 0.4484661892056465, + 2.2107471637427807, + 1.1279210448265076, + 0.032160259783267975, + 0.5180558823049068, + 0.19813434034585953, + 4.860962143167853, + 1.5727077722549438, + 1.2830595523118973, + 0.430344108492136, + 1.0690999440848827, + 1.179151164367795, + 0.3757091648876667, + 0.2399156503379345 + ], + "unique_experts": 64, + "load_cv": 0.8546581185896902, + "normalized_load_entropy": 0.9318031642690539, + "max_load_share": 0.08974358974358974 + }, + "full_input": { + "tokens": 171, + "top_k": 6, + "decisions": 1026, + "ordered_route_sha256": "ff1e255c06ec841bbdaccc78a39f2f04abc738f9f8f34e7df84e82f55b5182d3", + "route_weight_sha256": "709ea6d081b251513ce49ee40eb3512db059d66f59cf50bcc8e4f2f08870e4b2", + "loads": [ + 17, + 21, + 5, + 17, + 7, + 18, + 24, + 7, + 15, + 15, + 12, + 33, + 15, + 12, + 6, + 9, + 8, + 5, + 16, + 17, + 19, + 12, + 12, + 13, + 7, + 13, + 11, + 11, + 32, + 5, + 25, + 16, + 4, + 12, + 37, + 23, + 18, + 21, + 10, + 18, + 24, + 19, + 17, + 2, + 14, + 15, + 25, + 14, + 23, + 12, + 12, + 29, + 19, + 4, + 10, + 12, + 75, + 24, + 20, + 13, + 15, + 16, + 9, + 5 + ], + "weighted_loads": [ + 1.0783305186778307, + 1.5084617361426353, + 0.27953316271305084, + 0.8226432371884584, + 0.5188632979989052, + 0.8763472829014063, + 1.3423724863678217, + 0.46301622688770294, + 0.9822240583598614, + 0.8178865928202868, + 1.1297655887901783, + 2.241958376020193, + 0.883086365647614, + 0.6533592666964978, + 0.31058957800269127, + 0.467211302369833, + 0.42180103436112404, + 0.2063366137444973, + 0.9069340825080872, + 1.3854830209165812, + 0.9930911771953106, + 0.6762103829532862, + 1.8366973754018545, + 0.9710450693964958, + 0.27859068661928177, + 0.6468661595135927, + 0.5087167304009199, + 0.6379611622542143, + 2.7944175861775875, + 0.2756740693002939, + 1.7213623374700546, + 0.7898908811621368, + 0.11256338562816381, + 0.7849433533847332, + 2.472501862794161, + 1.5598546117544174, + 1.1626986730843782, + 1.4180137496441603, + 0.4654980041086674, + 0.934908539056778, + 1.4715534783899784, + 1.6883922070264816, + 0.8917772062122822, + 0.10708644241094589, + 0.5702564716339111, + 1.2872781716287136, + 2.0532185584306717, + 0.9034720733761787, + 1.6912825517356396, + 0.646293031051755, + 0.6525371186435223, + 2.2436848990619183, + 1.1279210448265076, + 0.18038325011730194, + 0.5595963709056377, + 0.5173959024250507, + 5.093254217877984, + 1.5727077722549438, + 1.4957429803907871, + 0.6132606156170368, + 1.0690999440848827, + 1.2177220825105906, + 0.5386586785316467, + 0.27593091130256653 + ], + "unique_experts": 64, + "load_cv": 0.6504969970909288, + "normalized_load_entropy": 0.9594642057850745, + "max_load_share": 0.07309941520467836 + } + }, + "s0_bos": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "c53ced6d87fe12aa571a6ac59be41c98190a180ff46eff1b12343076a0e1b47d", + "route_weight_sha256": "199970ed5af8f90ada3bcd75158f7e90d0759d2099aca7515646cf156e3a824b", + "loads": [ + 5, + 15, + 5, + 17, + 5, + 17, + 26, + 6, + 8, + 12, + 1, + 31, + 14, + 6, + 5, + 8, + 6, + 5, + 17, + 7, + 19, + 10, + 9, + 3, + 4, + 6, + 7, + 10, + 25, + 6, + 23, + 11, + 2, + 9, + 29, + 11, + 18, + 19, + 6, + 17, + 18, + 5, + 15, + 3, + 6, + 2, + 5, + 14, + 16, + 7, + 8, + 27, + 21, + 2, + 9, + 5, + 70, + 24, + 16, + 9, + 15, + 13, + 7, + 3 + ], + "weighted_loads": [ + 0.27624286338686943, + 1.188210889697075, + 0.2852441146969795, + 0.8185444008558989, + 0.25755617022514343, + 0.8324612565338612, + 1.3782035037875175, + 0.38953689113259315, + 0.5799834653735161, + 0.7049713395535946, + 0.04375337064266205, + 2.16978807002306, + 0.8901122696697712, + 0.36770790070295334, + 0.2814587242901325, + 0.4383231271058321, + 0.30532293394207954, + 0.1898772157728672, + 0.9742664098739624, + 0.40043986961245537, + 1.010054837912321, + 0.5746455453336239, + 0.329458374530077, + 0.1572580486536026, + 0.14958187192678452, + 0.2418453637510538, + 0.26102058589458466, + 0.6252458430826664, + 2.3725790977478027, + 0.2996255215257406, + 1.5876006111502647, + 0.6398739702999592, + 0.0777403675019741, + 0.5753400810062885, + 2.190057897940278, + 0.7892198227345943, + 1.1959834545850754, + 1.3055069372057915, + 0.2704142928123474, + 0.8641667440533638, + 1.095194086432457, + 0.2658207379281521, + 0.7952789962291718, + 0.14637527987360954, + 0.2611696347594261, + 0.08573989197611809, + 0.38089701905846596, + 0.9014987275004387, + 1.2661125250160694, + 0.3118702135980129, + 0.45368099585175514, + 2.200526289641857, + 1.2097769901156425, + 0.06157737039029598, + 0.5254267156124115, + 0.17661437019705772, + 4.870601853355765, + 1.625213909894228, + 1.2968957088887691, + 0.42202581465244293, + 1.0757101401686668, + 1.0965665616095066, + 0.3737399596720934, + 0.1897505447268486 + ], + "unique_experts": 64, + "load_cv": 0.8489774179253955, + "normalized_load_entropy": 0.9335876072129421, + "max_load_share": 0.08974358974358974 + }, + "full_input": { + "tokens": 155, + "top_k": 6, + "decisions": 930, + "ordered_route_sha256": "d490365b6db05f2326ca73feaca7054808b17a765b950fcedda1526c57060493", + "route_weight_sha256": "605117fb733d36434f8e4376598753efb93dfc2e3635a9fead15c00106bc04b1", + "loads": [ + 13, + 18, + 5, + 17, + 8, + 17, + 26, + 6, + 10, + 12, + 12, + 31, + 16, + 11, + 5, + 8, + 8, + 9, + 17, + 16, + 19, + 10, + 12, + 6, + 7, + 7, + 7, + 11, + 25, + 6, + 24, + 16, + 2, + 9, + 38, + 18, + 18, + 19, + 7, + 18, + 18, + 14, + 15, + 3, + 11, + 10, + 15, + 14, + 19, + 7, + 15, + 28, + 21, + 5, + 9, + 11, + 75, + 24, + 18, + 13, + 15, + 13, + 9, + 4 + ], + "weighted_loads": [ + 0.8396592773497105, + 1.398194544017315, + 0.2852441146969795, + 0.8185444008558989, + 0.5493814125657082, + 0.8324612565338612, + 1.3782035037875175, + 0.38953689113259315, + 0.6761758588254452, + 0.7049713395535946, + 1.214232824742794, + 2.16978807002306, + 0.9368411377072334, + 0.6884512640535831, + 0.2814587242901325, + 0.4383231271058321, + 0.4067968912422657, + 0.3479212820529938, + 0.9742664098739624, + 1.2627274990081787, + 1.010054837912321, + 0.5746455453336239, + 0.9341533444821835, + 0.49400002509355545, + 0.2767147310078144, + 0.31883815862238407, + 0.26102058589458466, + 0.6382447313517332, + 2.3725790977478027, + 0.2996255215257406, + 1.6272624246776104, + 0.8249948853626847, + 0.0777403675019741, + 0.5753400810062885, + 2.6881107594817877, + 1.2395590282976627, + 1.1959834545850754, + 1.3055069372057915, + 0.3149626776576042, + 0.9091879241168499, + 1.095194086432457, + 1.2101405374705791, + 0.7952789962291718, + 0.14637527987360954, + 0.6089207781478763, + 1.0299415700137615, + 1.1614664904773235, + 0.9014987275004387, + 1.4827818796038628, + 0.3118702135980129, + 0.8257935903966427, + 2.2341618575155735, + 1.2097769901156425, + 0.18389604799449444, + 0.5254267156124115, + 0.5190218314528465, + 5.112604653462768, + 1.625213909894228, + 1.4195956215262413, + 0.5935455113649368, + 1.0757101401686668, + 1.0965665616095066, + 0.4295955542474985, + 0.2259470894932747 + ], + "unique_experts": 64, + "load_cv": 0.7116395163625325, + "normalized_load_entropy": 0.954429607933081, + "max_load_share": 0.08064516129032258 + } + }, + "s1_bos": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "b047e8dfce2ee28a82a2159ce507ff75cf87b7b365f549f1b41529ae2fc6decf", + "route_weight_sha256": "b60ce2ec955a9f1abd686fe01950663bdf8b6cbce3cf9e2a80145e339a04f04d", + "loads": [ + 5, + 15, + 5, + 19, + 5, + 19, + 23, + 6, + 8, + 12, + 1, + 32, + 14, + 5, + 5, + 9, + 6, + 5, + 15, + 7, + 18, + 10, + 9, + 3, + 3, + 6, + 9, + 10, + 25, + 6, + 23, + 10, + 3, + 9, + 29, + 11, + 18, + 18, + 6, + 19, + 18, + 4, + 15, + 2, + 6, + 2, + 5, + 14, + 16, + 7, + 9, + 27, + 20, + 2, + 8, + 5, + 72, + 26, + 15, + 9, + 15, + 12, + 7, + 3 + ], + "weighted_loads": [ + 0.288119874894619, + 1.1631633341312408, + 0.27872005477547646, + 0.9321685805916786, + 0.25793126598000526, + 0.9056245535612106, + 1.2767832446843386, + 0.3940717540681362, + 0.5765688829123974, + 0.6877594664692879, + 0.04412722587585449, + 2.1396118383854628, + 0.9234095513820648, + 0.33933164924383163, + 0.28542952984571457, + 0.466123865917325, + 0.30519217997789383, + 0.1837312914431095, + 0.8831566944718361, + 0.40345558896660805, + 0.954502996057272, + 0.5839706659317017, + 0.3439069762825966, + 0.1571725755929947, + 0.12060452997684479, + 0.24164096266031265, + 0.3152176607400179, + 0.6347851976752281, + 2.338348876684904, + 0.2907508835196495, + 1.5736608300358057, + 0.6323507577180862, + 0.1117037758231163, + 0.5511215962469578, + 2.119790229946375, + 0.7820404767990112, + 1.1822093818336725, + 1.2572166211903095, + 0.26350117288529873, + 0.9306164644658566, + 1.0837114825844765, + 0.23807885497808456, + 0.7990989051759243, + 0.1071784570813179, + 0.2631863486021757, + 0.092295091599226, + 0.3814289979636669, + 0.8983577005565166, + 1.2481712810695171, + 0.3142435606569052, + 0.49249759316444397, + 2.184172261506319, + 1.1589535139501095, + 0.06456880457699299, + 0.4855717718601227, + 0.17225924879312515, + 4.917755337432027, + 1.6912602428346872, + 1.2357461899518967, + 0.426245940849185, + 1.074601162225008, + 1.0465503744781017, + 0.37286136485636234, + 0.1895730458199978 + ], + "unique_experts": 64, + "load_cv": 0.8662720995318679, + "normalized_load_entropy": 0.9317443942548728, + "max_load_share": 0.09230769230769231 + }, + "full_input": { + "tokens": 171, + "top_k": 6, + "decisions": 1026, + "ordered_route_sha256": "a0f6a5b71461fe153f89bd724d2fe491b5c9dbb4f777bbd5dc464e35df4b01a0", + "route_weight_sha256": "cdde8699f13afd1b6ae9319c704a8fd76e9ef9b3eb970fb795b5973f3ac8f713", + "loads": [ + 17, + 20, + 5, + 19, + 8, + 19, + 23, + 6, + 15, + 14, + 12, + 34, + 16, + 10, + 6, + 9, + 8, + 9, + 15, + 16, + 18, + 13, + 12, + 14, + 8, + 14, + 13, + 11, + 31, + 6, + 25, + 14, + 3, + 12, + 35, + 23, + 18, + 21, + 9, + 21, + 24, + 18, + 17, + 2, + 11, + 15, + 24, + 14, + 23, + 12, + 14, + 28, + 20, + 5, + 9, + 11, + 77, + 26, + 20, + 13, + 15, + 13, + 9, + 4 + ], + "weighted_loads": [ + 1.1173216812312603, + 1.460910003632307, + 0.27872005477547646, + 0.9321685805916786, + 0.569763470441103, + 0.9056245535612106, + 1.2767832446843386, + 0.3940717540681362, + 0.9966591633856297, + 0.7784271836280823, + 1.1305150464177132, + 2.235189573839307, + 0.9709142539650202, + 0.6395298540592194, + 0.32426417991518974, + 0.466123865917325, + 0.4149341508746147, + 0.3679489567875862, + 0.8831566944718361, + 1.3581143766641617, + 0.954502996057272, + 0.7111326493322849, + 0.9476173538714647, + 1.0308051034808159, + 0.3087417930364609, + 0.6742360722273588, + 0.5679218973964453, + 0.6477840859442949, + 2.761486552655697, + 0.2907508835196495, + 1.7134538348764181, + 0.7776567386463284, + 0.1117037758231163, + 0.7738956324756145, + 2.4239592906087637, + 1.554061185568571, + 1.1822093818336725, + 1.398711621761322, + 0.41765896417200565, + 1.0472030192613602, + 1.4868124946951866, + 1.6835473403334618, + 0.8914216868579388, + 0.1071784570813179, + 0.48706613201647997, + 1.4298905655741692, + 1.999267801642418, + 0.8983577005565166, + 1.7026706896722317, + 0.6448758821934462, + 0.7689013015478849, + 2.2171099968254566, + 1.1589535139501095, + 0.21739796735346317, + 0.5271122604608536, + 0.4914986528456211, + 5.1500474121421576, + 1.6912602428346872, + 1.51758186891675, + 0.6091624479740858, + 1.074601162225008, + 1.0851212926208973, + 0.5358108785003424, + 0.22558830678462982 + ], + "unique_experts": 64, + "load_cv": 0.6564513803937764, + "normalized_load_entropy": 0.9594740508811277, + "max_load_share": 0.07504873294346978 + } + }, + "s0_x": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "9f425ee6860b03fc66c23fffcde8a80697e4ea1d49df42ff63c17c45f45e88e9", + "route_weight_sha256": "6ce4259ce23cb233c87b775cca04e3bd9ae7a7a02810aa2e783058bb822742c7", + "loads": [ + 6, + 16, + 6, + 16, + 5, + 19, + 24, + 6, + 8, + 13, + 1, + 32, + 12, + 6, + 4, + 8, + 6, + 4, + 17, + 7, + 19, + 10, + 9, + 3, + 2, + 6, + 7, + 11, + 26, + 5, + 22, + 11, + 3, + 9, + 29, + 11, + 18, + 19, + 6, + 17, + 18, + 5, + 14, + 2, + 5, + 2, + 6, + 14, + 16, + 6, + 8, + 29, + 23, + 3, + 9, + 4, + 71, + 23, + 16, + 9, + 15, + 13, + 7, + 3 + ], + "weighted_loads": [ + 0.314637603238225, + 1.2135981805622578, + 0.31400276347994804, + 0.7875481899827719, + 0.255461722612381, + 0.8949391860514879, + 1.2792625706642866, + 0.38126397132873535, + 0.589981198310852, + 0.7355982176959515, + 0.043721381574869156, + 2.1975171975791454, + 0.7842985764145851, + 0.36313948407769203, + 0.250593364238739, + 0.4344127010554075, + 0.30908079631626606, + 0.15022239089012146, + 0.9697814472019672, + 0.4033706933259964, + 1.0100875087082386, + 0.5742021277546883, + 0.32380744628608227, + 0.16133376210927963, + 0.07819648832082748, + 0.2530926652252674, + 0.25840278156101704, + 0.6996056772768497, + 2.39706552028656, + 0.2698417454957962, + 1.5302123464643955, + 0.6440863385796547, + 0.10656454786658287, + 0.5691813789308071, + 2.174859581515193, + 0.7979779504239559, + 1.1756072286516428, + 1.2898767814040184, + 0.2662474736571312, + 0.8799884840846062, + 1.063526701182127, + 0.2769921012222767, + 0.7594028487801552, + 0.10564708337187767, + 0.22796441242098808, + 0.08551337197422981, + 0.4070546254515648, + 0.8924299478530884, + 1.28532674908638, + 0.2772329691797495, + 0.44464031234383583, + 2.2516762912273407, + 1.2878388743847609, + 0.09652183949947357, + 0.51622224599123, + 0.14155223034322262, + 4.938349295407534, + 1.5524081028997898, + 1.2900593467056751, + 0.4309596512466669, + 1.075974278151989, + 1.1012138277292252, + 0.3636941611766815, + 0.18425814807415009 + ], + "unique_experts": 64, + "load_cv": 0.8650569180119851, + "normalized_load_entropy": 0.9311365970443767, + "max_load_share": 0.09102564102564102 + }, + "full_input": { + "tokens": 155, + "top_k": 6, + "decisions": 930, + "ordered_route_sha256": "f7c413ae998be37aa76f5ed9a926d5a28e1e99874554a5d1dc803f1eea2ce8dc", + "route_weight_sha256": "ff7438b0e2e1bfdc38c9bb48b855bd4825174de8dead37c96f1a8592cee10973", + "loads": [ + 15, + 19, + 6, + 16, + 7, + 19, + 24, + 6, + 10, + 13, + 13, + 32, + 14, + 11, + 4, + 8, + 9, + 6, + 17, + 16, + 19, + 10, + 12, + 6, + 5, + 9, + 7, + 12, + 26, + 5, + 23, + 16, + 3, + 9, + 39, + 17, + 18, + 19, + 8, + 17, + 18, + 14, + 14, + 2, + 9, + 10, + 17, + 14, + 19, + 6, + 13, + 30, + 23, + 6, + 9, + 10, + 76, + 23, + 17, + 14, + 15, + 13, + 9, + 4 + ], + "weighted_loads": [ + 1.0138378161936998, + 1.4350214935839176, + 0.31400276347994804, + 0.7875481899827719, + 0.48397012799978256, + 0.8949391860514879, + 1.2792625706642866, + 0.38126397132873535, + 0.6861735917627811, + 0.7355982176959515, + 1.36525784060359, + 2.1975171975791454, + 0.8310274444520473, + 0.6311675906181335, + 0.250593364238739, + 0.4344127010554075, + 0.44350644387304783, + 0.23174352943897247, + 0.9697814472019672, + 1.2656583227217197, + 1.0100875087082386, + 0.5742021277546883, + 0.9285024162381887, + 0.4477178081870079, + 0.20532934740185738, + 0.41755471378564835, + 0.25840278156101704, + 0.7126045655459166, + 2.39706552028656, + 0.2698417454957962, + 1.5698741599917412, + 0.8292072536423802, + 0.10656454786658287, + 0.5691813789308071, + 2.7687607277184725, + 1.2122287824749947, + 1.1756072286516428, + 1.2898767814040184, + 0.355904970318079, + 0.8799884840846062, + 1.063526701182127, + 1.1775214113295078, + 0.7594028487801552, + 0.10564708337187767, + 0.5216437419876456, + 0.7805186621844769, + 1.2322159595787525, + 0.8924299478530884, + 1.507555853575468, + 0.2772329691797495, + 0.7280489057302475, + 2.285311859101057, + 1.2878388743847609, + 0.21492143720388412, + 0.51622224599123, + 0.4838292468339205, + 5.180352095514536, + 1.5524081028997898, + 1.3470532074570656, + 0.6426895577460527, + 1.075974278151989, + 1.1012138277292252, + 0.41954975575208664, + 0.22045469284057617 + ], + "unique_experts": 64, + "load_cv": 0.7273746499387844, + "normalized_load_entropy": 0.9524236070467278, + "max_load_share": 0.08172043010752689 + } + }, + "s1_x": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "5949816f0411ef14b2e36db516fa44e457a935c12d8660600cd5731c6517c37b", + "route_weight_sha256": "7602127ec945d695f740f12f262748134b8b3eb17b836864681c3e311b66135d", + "loads": [ + 6, + 16, + 4, + 19, + 5, + 21, + 22, + 7, + 7, + 13, + 1, + 31, + 13, + 5, + 5, + 9, + 6, + 8, + 15, + 7, + 18, + 10, + 8, + 2, + 2, + 10, + 10, + 9, + 25, + 6, + 22, + 11, + 3, + 9, + 28, + 11, + 17, + 19, + 5, + 19, + 18, + 4, + 15, + 3, + 6, + 0, + 7, + 13, + 16, + 5, + 9, + 28, + 21, + 2, + 8, + 3, + 73, + 26, + 16, + 9, + 14, + 12, + 5, + 3 + ], + "weighted_loads": [ + 0.31865567341446877, + 1.1784607097506523, + 0.2446337342262268, + 0.9606200288981199, + 0.25172755122184753, + 0.957186046987772, + 1.2159129045903683, + 0.45369400829076767, + 0.5423287898302078, + 0.7165069915354252, + 0.04407259449362755, + 2.085119090974331, + 0.8823738992214203, + 0.32885822653770447, + 0.28969187289476395, + 0.4570279009640217, + 0.3064418565481901, + 0.2886878252029419, + 0.8717166222631931, + 0.4229239225387573, + 0.9565490018576384, + 0.5720741767436266, + 0.2979078684002161, + 0.08906208351254463, + 0.08704222738742828, + 0.39629340171813965, + 0.35250007547438145, + 0.6140734478831291, + 2.3388227559626102, + 0.29033375531435013, + 1.4904904514551163, + 0.6435392387211323, + 0.10480575636029243, + 0.5362751334905624, + 2.0558818504214287, + 0.789201807230711, + 1.1372939385473728, + 1.2583008296787739, + 0.2377474084496498, + 0.9226929806172848, + 1.0723677352070808, + 0.2404613383114338, + 0.7946773320436478, + 0.14432210475206375, + 0.2554212436079979, + 0.0, + 0.45839353650808334, + 0.8407301753759384, + 1.2664009667932987, + 0.24890132620930672, + 0.48055562749505043, + 2.180495500564575, + 1.1952653340995312, + 0.06412632018327713, + 0.4605223461985588, + 0.10907059721648693, + 5.0017443113029, + 1.6462744995951653, + 1.2758013010025024, + 0.43687764927744865, + 1.028655033558607, + 1.042302343994379, + 0.3069506771862507, + 0.18386833369731903 + ], + "unique_experts": 63, + "load_cv": 0.8761730185576302, + "normalized_load_entropy": 0.9287930584726556, + "max_load_share": 0.09358974358974359 + }, + "full_input": { + "tokens": 171, + "top_k": 6, + "decisions": 1026, + "ordered_route_sha256": "cc0aebfdd2717aa3186f2f3bd19484d0dc8d4cf9673e166de7416e6f4ac32056", + "route_weight_sha256": "edf975efe0926cb90109b01e70c8575607b561cbc6b1fa58646c72dbb81149ed", + "loads": [ + 20, + 21, + 4, + 19, + 7, + 21, + 22, + 7, + 15, + 15, + 13, + 33, + 15, + 9, + 6, + 9, + 9, + 9, + 15, + 17, + 18, + 13, + 11, + 13, + 7, + 20, + 15, + 10, + 31, + 6, + 25, + 15, + 3, + 12, + 35, + 22, + 17, + 22, + 10, + 21, + 24, + 18, + 17, + 3, + 9, + 11, + 25, + 13, + 23, + 10, + 12, + 29, + 21, + 4, + 9, + 9, + 78, + 26, + 21, + 14, + 14, + 13, + 7, + 4 + ], + "weighted_loads": [ + 1.312428679317236, + 1.4656074680387974, + 0.2446337342262268, + 0.9606200288981199, + 0.5168488621711731, + 0.957186046987772, + 1.2159129045903683, + 0.45369400829076767, + 1.003973051905632, + 0.8071747086942196, + 1.2886874414980412, + 2.180696826428175, + 0.9298786018043756, + 0.5523046068847179, + 0.3285265229642391, + 0.4570279009640217, + 0.4598087053745985, + 0.34440411627292633, + 0.8717166222631931, + 1.422777634114027, + 0.9565490018576384, + 0.6992361601442099, + 0.9016182459890842, + 0.965032871812582, + 0.2751794904470444, + 0.9222490470856428, + 0.6514038797467947, + 0.6270723361521959, + 2.761960431933403, + 0.29033375531435013, + 1.6676071137189865, + 0.7888452196493745, + 0.10480575636029243, + 0.7590491697192192, + 2.4196968879550695, + 1.5218451768159866, + 1.1372939385473728, + 1.3997958302497864, + 0.48517294973134995, + 1.0321772657334805, + 1.475468747317791, + 1.5895715579390526, + 0.8870001137256622, + 0.14432210475206375, + 0.38572247233241796, + 0.9609294049441814, + 1.9903631918132305, + 0.8407301753759384, + 1.735360261052847, + 0.5795336477458477, + 0.688829805701971, + 2.2134332358837128, + 1.1952653340995312, + 0.16395214945077896, + 0.5020628347992897, + 0.42256964929401875, + 5.234036386013031, + 1.6462744995951653, + 1.5589846037328243, + 0.6719854362308979, + 1.028655033558607, + 1.0808732621371746, + 0.4699001908302307, + 0.21988359466195107 + ], + "unique_experts": 64, + "load_cv": 0.6722829219200768, + "normalized_load_entropy": 0.957213938033879, + "max_load_share": 0.07602339181286549 + } + }, + "s0_period": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "11c7ffa883b26f14725417835fb818e2cd98c6ff0ce6fa08ce1bd2350cb3995d", + "route_weight_sha256": "a318477f36ee111f5a3b36abc78401dad40c8e70b2e98ec6691fe2ac61918165", + "loads": [ + 5, + 16, + 6, + 14, + 5, + 19, + 23, + 6, + 8, + 13, + 1, + 32, + 13, + 7, + 4, + 7, + 6, + 4, + 17, + 7, + 19, + 9, + 9, + 3, + 3, + 6, + 6, + 10, + 26, + 6, + 22, + 12, + 3, + 9, + 30, + 11, + 18, + 19, + 6, + 15, + 18, + 5, + 15, + 3, + 4, + 2, + 6, + 14, + 16, + 6, + 9, + 28, + 22, + 3, + 9, + 5, + 74, + 23, + 16, + 9, + 15, + 13, + 7, + 3 + ], + "weighted_loads": [ + 0.2814726736396551, + 1.207797097042203, + 0.3146527037024498, + 0.7096741273999214, + 0.2513268068432808, + 0.8870297949761152, + 1.2573048900812864, + 0.38444672152400017, + 0.5869928821921349, + 0.7372611686587334, + 0.04448908567428589, + 2.1900570187717676, + 0.8527387194335461, + 0.39583082497119904, + 0.2569664753973484, + 0.39393712766468525, + 0.3096612449735403, + 0.15455248206853867, + 0.9738723784685135, + 0.412989117205143, + 1.0114019196480513, + 0.5494074672460556, + 0.3235766552388668, + 0.17191829532384872, + 0.12543268501758575, + 0.24894302524626255, + 0.2264558970928192, + 0.6468460112810135, + 2.380249422043562, + 0.29900275357067585, + 1.5250063054263592, + 0.6724711451679468, + 0.10677226632833481, + 0.5679251812398434, + 2.2050283886492252, + 0.8011798448860645, + 1.1498620957136154, + 1.294443879276514, + 0.26596588641405106, + 0.7945932038128376, + 1.0636714026331902, + 0.27093006297945976, + 0.7929448559880257, + 0.14469929039478302, + 0.1946038454771042, + 0.08325129374861717, + 0.38962792977690697, + 0.8994654603302479, + 1.2829352542757988, + 0.27738767862319946, + 0.4687189348042011, + 2.1898661460727453, + 1.2470791600644588, + 0.09702677838504314, + 0.5251528173685074, + 0.1720520332455635, + 5.061769392341375, + 1.5559765473008156, + 1.2960798889398575, + 0.43102245405316353, + 1.056733101606369, + 1.10232475399971, + 0.36267316713929176, + 0.17840807512402534 + ], + "unique_experts": 64, + "load_cv": 0.8813205082512829, + "normalized_load_entropy": 0.9309392387301894, + "max_load_share": 0.09487179487179487 + }, + "full_input": { + "tokens": 155, + "top_k": 6, + "decisions": 930, + "ordered_route_sha256": "c932b3af0ae4aa0c9e5b0beb201301731874859a609adf1bc6d1019325d7fbdc", + "route_weight_sha256": "d5a7e76e63134a0030ac4b60eeedccf190ecd5c37795e1969c2cd8a7c99f974d", + "loads": [ + 14, + 19, + 6, + 14, + 7, + 19, + 23, + 6, + 10, + 13, + 13, + 32, + 15, + 12, + 4, + 7, + 8, + 7, + 17, + 16, + 19, + 9, + 12, + 6, + 6, + 8, + 6, + 11, + 26, + 6, + 23, + 17, + 3, + 9, + 40, + 17, + 18, + 19, + 8, + 15, + 18, + 15, + 15, + 3, + 8, + 10, + 17, + 14, + 19, + 6, + 14, + 29, + 22, + 5, + 9, + 11, + 80, + 23, + 18, + 13, + 15, + 13, + 9, + 4 + ], + "weighted_loads": [ + 0.9498046468943357, + 1.4196656737476587, + 0.3146527037024498, + 0.7096741273999214, + 0.482906274497509, + 0.8870297949761152, + 1.2573048900812864, + 0.38444672152400017, + 0.683185275644064, + 0.7372611686587334, + 1.311413697898388, + 2.1900570187717676, + 0.8994675874710083, + 0.6683566719293594, + 0.2569664753973484, + 0.39393712766468525, + 0.40853620506823063, + 0.28813497349619865, + 0.9738723784685135, + 1.2752767466008663, + 1.0114019196480513, + 0.5494074672460556, + 0.9282716251909733, + 0.45589425414800644, + 0.25256554409861565, + 0.37008010037243366, + 0.2264558970928192, + 0.6598448995500803, + 2.380249422043562, + 0.29900275357067585, + 1.5646681189537048, + 0.8575920602306724, + 0.10677226632833481, + 0.5679251812398434, + 2.7602501772344112, + 1.2088836431503296, + 1.1498620957136154, + 1.294443879276514, + 0.3568713031709194, + 0.7945932038128376, + 1.0636714026331902, + 1.228374071419239, + 0.7929448559880257, + 0.14469929039478302, + 0.48983880411833525, + 0.7855376712977886, + 1.2634234018623829, + 0.8994654603302479, + 1.5016017146408558, + 0.27738767862319946, + 0.7526505962014198, + 2.2235017139464617, + 1.2470791600644588, + 0.1732384990900755, + 0.5251528173685074, + 0.5300212800502777, + 5.342860959470272, + 1.5559765473008156, + 1.4188535697758198, + 0.6025421507656574, + 1.056733101606369, + 1.10232475399971, + 0.4185287617146969, + 0.21460461989045143 + ], + "unique_experts": 64, + "load_cv": 0.75267281090316, + "normalized_load_entropy": 0.9509284005237276, + "max_load_share": 0.08602150537634409 + } + }, + "s1_period": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "e2c74723e4da5a1965e5e157183603cb66e4d3ce1de32a0173ef54c6bafc72db", + "route_weight_sha256": "2dea0800f63541837661b0f934bfd08fca34703ca0447b274628a99b70eeb5cd", + "loads": [ + 5, + 16, + 4, + 19, + 5, + 20, + 22, + 7, + 9, + 13, + 1, + 30, + 13, + 5, + 5, + 9, + 6, + 7, + 17, + 7, + 18, + 10, + 8, + 3, + 3, + 9, + 10, + 9, + 25, + 6, + 22, + 12, + 2, + 9, + 28, + 11, + 17, + 18, + 5, + 20, + 18, + 4, + 15, + 3, + 5, + 0, + 7, + 13, + 16, + 6, + 9, + 28, + 20, + 2, + 8, + 3, + 73, + 26, + 16, + 9, + 14, + 12, + 5, + 3 + ], + "weighted_loads": [ + 0.29821801744401455, + 1.1820810362696648, + 0.24723349511623383, + 0.9344855826348066, + 0.24423154816031456, + 0.9078851379454136, + 1.1937157958745956, + 0.4591553509235382, + 0.6089040711522102, + 0.7174499966204166, + 0.04451460763812065, + 2.0500826500356197, + 0.892381627112627, + 0.3256183862686157, + 0.2896276265382767, + 0.460425129160285, + 0.30623133294284344, + 0.25598418712615967, + 0.9738252721726894, + 0.4176042303442955, + 0.9593629352748394, + 0.5744255073368549, + 0.2786902319639921, + 0.153307244181633, + 0.12829429656267166, + 0.36764345318078995, + 0.35167000256478786, + 0.6151327677071095, + 2.3151504062116146, + 0.29782189801335335, + 1.4919754676520824, + 0.6792053915560246, + 0.06895505636930466, + 0.5472715198993683, + 2.0654114466160536, + 0.7991237007081509, + 1.1298769861459732, + 1.2292951438575983, + 0.2360360100865364, + 0.9543408080935478, + 1.0838485695421696, + 0.2307753637433052, + 0.7968794479966164, + 0.1448684222996235, + 0.2222628202289343, + 0.0, + 0.44303193502128124, + 0.8380609825253487, + 1.2619582749903202, + 0.2828950546681881, + 0.47668060660362244, + 2.1789147034287453, + 1.1497586257755756, + 0.06714441999793053, + 0.4646342061460018, + 0.10933022014796734, + 4.978191182017326, + 1.6418281104415655, + 1.2816912829875946, + 0.43649781309068203, + 1.020384307950735, + 1.0344621874392033, + 0.30724237859249115, + 0.18734676763415337 + ], + "unique_experts": 63, + "load_cv": 0.8724431978443214, + "normalized_load_entropy": 0.9295097626782036, + "max_load_share": 0.09358974358974359 + }, + "full_input": { + "tokens": 171, + "top_k": 6, + "decisions": 1026, + "ordered_route_sha256": "3e4f65923d86e3cd5518f1c094ef418587087974a1c1501b92063d57712c7dfe", + "route_weight_sha256": "0c239f8434ec4032f45f33b1e873424ea7ccac38d5da8d08064ee3c36df9c9f6", + "loads": [ + 18, + 21, + 4, + 19, + 7, + 20, + 22, + 7, + 16, + 15, + 13, + 32, + 15, + 10, + 6, + 9, + 8, + 9, + 17, + 16, + 18, + 13, + 12, + 14, + 8, + 19, + 14, + 10, + 31, + 6, + 24, + 16, + 2, + 12, + 34, + 23, + 17, + 21, + 10, + 21, + 24, + 19, + 17, + 3, + 8, + 11, + 27, + 13, + 23, + 11, + 12, + 29, + 20, + 5, + 9, + 9, + 79, + 26, + 21, + 13, + 14, + 13, + 7, + 4 + ], + "weighted_loads": [ + 1.1811133045703173, + 1.4676861390471458, + 0.24723349511623383, + 0.9344855826348066, + 0.5079549439251423, + 0.9078851379454136, + 1.1937157958745956, + 0.4591553509235382, + 1.0289943516254425, + 0.808117713779211, + 1.2030209638178349, + 2.145660385489464, + 0.9398863296955824, + 0.5902520976960659, + 0.32846227660775185, + 0.460425129160285, + 0.4189522545784712, + 0.36395134776830673, + 0.9738252721726894, + 1.3722630180418491, + 0.9593629352748394, + 0.7015874907374382, + 0.9204010330140591, + 1.0221175514161587, + 0.31643155962228775, + 0.897989658638835, + 0.6043742392212152, + 0.6281316559761763, + 2.7382880821824074, + 0.29782189801335335, + 1.6317684724926949, + 0.8245113724842668, + 0.06895505636930466, + 0.770045556128025, + 2.3695805072784424, + 1.586057636886835, + 1.1298769861459732, + 1.3707901444286108, + 0.4943888708949089, + 1.0204383209347725, + 1.4869495816528797, + 1.658537294715643, + 0.8892022296786308, + 0.1448684222996235, + 0.35256404895335436, + 0.9392978735268116, + 2.183195414021611, + 0.8380609825253487, + 1.729515615850687, + 0.6135273762047291, + 0.6873681545257568, + 2.211852438747883, + 1.1497586257755756, + 0.21665072813630104, + 0.5061746947467327, + 0.42906597070395947, + 5.253582119941711, + 1.6418281104415655, + 1.5667234100401402, + 0.6194143202155828, + 1.020384307950735, + 1.0730331055819988, + 0.4701918922364712, + 0.2233620285987854 + ], + "unique_experts": 64, + "load_cv": 0.673728316908634, + "normalized_load_entropy": 0.957297876589113, + "max_load_share": 0.0769980506822612 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 130, + "ordered_topk_exact_tokens": 102, + "set_exact_tokens": 114, + "mean_set_jaccard": 0.964835164835165, + "mean_token_weighted_tv": 0.00829313093653092, + "aggregate_load_tv": 0.01794871794871795 + }, + "system_bos": { + "tokens": 130, + "ordered_topk_exact_tokens": 86, + "set_exact_tokens": 101, + "mean_set_jaccard": 0.9362637362637364, + "mean_token_weighted_tv": 0.014582584726695831, + "aggregate_load_tv": 0.02051282051282052 + }, + "system_x": { + "tokens": 130, + "ordered_topk_exact_tokens": 67, + "set_exact_tokens": 84, + "mean_set_jaccard": 0.8972527472527473, + "mean_token_weighted_tv": 0.020576235071684306, + "aggregate_load_tv": 0.042307692307692324 + }, + "system_period": { + "tokens": 130, + "ordered_topk_exact_tokens": 67, + "set_exact_tokens": 85, + "mean_set_jaccard": 0.9010989010989012, + "mean_token_weighted_tv": 0.020411928771780087, + "aggregate_load_tv": 0.04102564102564102 + }, + "bos_at_s0": { + "tokens": 130, + "ordered_topk_exact_tokens": 82, + "set_exact_tokens": 97, + "mean_set_jaccard": 0.9274725274725276, + "mean_token_weighted_tv": 0.01616443144157529, + "aggregate_load_tv": 0.02435897435897436 + }, + "bos_at_s1": { + "tokens": 130, + "ordered_topk_exact_tokens": 76, + "set_exact_tokens": 94, + "mean_set_jaccard": 0.9192307692307693, + "mean_token_weighted_tv": 0.018003624942726813, + "aggregate_load_tv": 0.03076923076923077 + }, + "x_at_s0": { + "tokens": 130, + "ordered_topk_exact_tokens": 81, + "set_exact_tokens": 94, + "mean_set_jaccard": 0.9208791208791209, + "mean_token_weighted_tv": 0.01820042420608493, + "aggregate_load_tv": 0.028205128205128202 + }, + "x_at_s1": { + "tokens": 130, + "ordered_topk_exact_tokens": 67, + "set_exact_tokens": 82, + "mean_set_jaccard": 0.8928571428571428, + "mean_token_weighted_tv": 0.02317308117277347, + "aggregate_load_tv": 0.04487179487179488 + }, + "period_at_s0": { + "tokens": 130, + "ordered_topk_exact_tokens": 80, + "set_exact_tokens": 95, + "mean_set_jaccard": 0.9214285714285716, + "mean_token_weighted_tv": 0.017839133467238682, + "aggregate_load_tv": 0.029487179487179476 + }, + "period_at_s1": { + "tokens": 130, + "ordered_topk_exact_tokens": 71, + "set_exact_tokens": 84, + "mean_set_jaccard": 0.8972527472527473, + "mean_token_weighted_tv": 0.02306171880605129, + "aggregate_load_tv": 0.04615384615384615 + } + } + }, + "layer_10": { + "layer": 10, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "c135649ae430ff325d53fdeb82ccb9298179fabcc224ad1b611e73ff6f905d67", + "route_weight_sha256": "6c197a41b767646a5f4bd7fe527f060bc8f06d0023cb8c21e4ac4afb5bcb08d0", + "loads": [ + 6, + 12, + 5, + 11, + 19, + 6, + 10, + 5, + 9, + 8, + 15, + 16, + 4, + 5, + 13, + 7, + 12, + 3, + 6, + 14, + 2, + 50, + 1, + 2, + 16, + 8, + 10, + 0, + 31, + 14, + 13, + 20, + 7, + 24, + 6, + 11, + 17, + 8, + 22, + 4, + 17, + 1, + 6, + 74, + 1, + 19, + 8, + 19, + 8, + 10, + 2, + 6, + 7, + 13, + 14, + 9, + 18, + 8, + 15, + 0, + 13, + 4, + 28, + 28 + ], + "weighted_loads": [ + 0.3299518749117851, + 0.6617040857672691, + 0.3227636106312275, + 0.617744117975235, + 1.651323989033699, + 0.3668982461094856, + 0.701447231695056, + 0.1931937336921692, + 0.5285889990627766, + 0.3852879907935858, + 1.1083816066384315, + 1.3109922967851162, + 0.2575474828481674, + 0.18431000784039497, + 0.9220439493656158, + 0.38875099271535873, + 0.6590709500014782, + 0.14306052401661873, + 0.40562560968101025, + 0.6680259462445974, + 0.09293782152235508, + 3.5379014126956463, + 0.034448638558387756, + 0.1161661446094513, + 0.9502515755593777, + 0.3894300255924463, + 0.7567920498549938, + 0.0, + 1.738778518512845, + 1.0266938358545303, + 0.7883862368762493, + 1.248197566717863, + 0.4099007099866867, + 0.990595456212759, + 0.3001455292105675, + 0.8928616158664227, + 0.8215174153447151, + 0.49152514338493347, + 1.3437945954501629, + 0.29393648356199265, + 0.9711715951561928, + 0.049439262598752975, + 0.30922888964414597, + 5.3890576139092445, + 0.049110159277915955, + 1.0250487737357616, + 0.32776655443012714, + 1.521329464390874, + 0.4618316479027271, + 0.7544046677649021, + 0.08015379309654236, + 0.3198371399194002, + 0.43187716603279114, + 0.838816624134779, + 1.0917483940720558, + 0.5922272205352783, + 1.1581510584801435, + 0.6019686125218868, + 0.7656657695770264, + 0.0, + 0.9278414882719517, + 0.35940560698509216, + 1.6403098665177822, + 1.525012731552124 + ], + "unique_experts": 62, + "load_cv": 0.9486902282852493, + "normalized_load_entropy": 0.9180524405448287, + "max_load_share": 0.09487179487179487 + }, + "full_input": { + "tokens": 155, + "top_k": 6, + "decisions": 930, + "ordered_route_sha256": "4bda6b648512b66ea73ffff559693a0a3aca124de54eaced4ae013da5840cbc3", + "route_weight_sha256": "b388b306f11d0de1c28ef827bed6dff24b840eebfb1b88cd8a3c1034133c2a43", + "loads": [ + 6, + 12, + 7, + 11, + 19, + 6, + 10, + 9, + 9, + 10, + 17, + 17, + 5, + 8, + 16, + 7, + 12, + 6, + 13, + 17, + 5, + 52, + 2, + 2, + 16, + 10, + 10, + 6, + 32, + 15, + 17, + 21, + 7, + 32, + 7, + 12, + 17, + 8, + 22, + 4, + 17, + 9, + 11, + 76, + 6, + 22, + 14, + 23, + 8, + 12, + 4, + 11, + 7, + 14, + 14, + 18, + 18, + 14, + 15, + 13, + 18, + 16, + 28, + 28 + ], + "weighted_loads": [ + 0.3299518749117851, + 0.6617040857672691, + 0.34181802347302437, + 0.617744117975235, + 1.651323989033699, + 0.3668982461094856, + 0.701447231695056, + 0.3676088899374008, + 0.5285889990627766, + 0.4097604528069496, + 1.2045084685087204, + 1.3590558506548405, + 0.29030410200357437, + 1.599915772676468, + 1.123173613101244, + 0.38875099271535873, + 0.6590709500014782, + 0.3246460519731045, + 0.7883422463200986, + 0.8328102137893438, + 0.2056239452213049, + 3.6219795756042004, + 0.03818341647274792, + 0.1161661446094513, + 0.9502515755593777, + 0.45304510183632374, + 0.7567920498549938, + 0.739629004150629, + 1.7854783069342375, + 1.0693113058805466, + 1.1703224070370197, + 1.2619714876636863, + 0.4099007099866867, + 1.4271490350365639, + 0.3300297800451517, + 0.9298230484127998, + 0.8215174153447151, + 0.49152514338493347, + 1.3437945954501629, + 0.29393648356199265, + 0.9711715951561928, + 0.8357276134192944, + 0.5069554718211293, + 5.486484006047249, + 0.30328013002872467, + 1.171490602195263, + 0.5980391446501017, + 1.711317166686058, + 0.4618316479027271, + 0.8399552758783102, + 0.17672975733876228, + 0.5846481081098318, + 0.43187716603279114, + 0.9068897627294064, + 1.0917483940720558, + 1.306631252169609, + 1.1581510584801435, + 0.9471652619540691, + 0.7656657695770264, + 0.9470894560217857, + 1.282645072788, + 1.3964634202420712, + 1.6403098665177822, + 1.525012731552124 + ], + "unique_experts": 64, + "load_cv": 0.7797144841807502, + "normalized_load_entropy": 0.9463566450080878, + "max_load_share": 0.08172043010752689 + } + }, + "s1_eos": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "8fafccf4791664d27ba80e0c388af5b7333125491c34874b491a043d93b29efa", + "route_weight_sha256": "8674b9f03e50d0e28f40de6efcb2dd5a5ff4e7d02df93b8725d91d27f54399a6", + "loads": [ + 6, + 11, + 5, + 12, + 19, + 8, + 10, + 6, + 9, + 7, + 15, + 17, + 4, + 5, + 13, + 7, + 12, + 3, + 6, + 15, + 2, + 51, + 1, + 2, + 16, + 7, + 10, + 0, + 33, + 14, + 12, + 19, + 7, + 22, + 7, + 11, + 14, + 9, + 21, + 4, + 18, + 1, + 5, + 74, + 1, + 19, + 7, + 18, + 8, + 10, + 2, + 6, + 7, + 14, + 16, + 9, + 19, + 7, + 16, + 1, + 13, + 4, + 28, + 25 + ], + "weighted_loads": [ + 0.33310970664024353, + 0.633055817335844, + 0.3183784671127796, + 0.6502866335213184, + 1.650340236723423, + 0.4265702962875366, + 0.7083272784948349, + 0.2367042414844036, + 0.5289775282144547, + 0.3529825322329998, + 1.1093442291021347, + 1.3510152101516724, + 0.2578047253191471, + 0.18383382260799408, + 0.9099567905068398, + 0.3824293836951256, + 0.6610766500234604, + 0.14486320689320564, + 0.4102895986288786, + 0.6778087671846151, + 0.09386835806071758, + 3.6036387719213963, + 0.03375875577330589, + 0.12477260082960129, + 0.9461763575673103, + 0.35473719239234924, + 0.7577225640416145, + 0.0, + 1.8047439381480217, + 1.0270231924951077, + 0.7498472779989243, + 1.2001519110053778, + 0.4048413969576359, + 0.9087374098598957, + 0.3243047874420881, + 0.8879359848797321, + 0.7184847742319107, + 0.5220827423036098, + 1.3132871724665165, + 0.28824789449572563, + 1.0115088559687138, + 0.048574887216091156, + 0.2711985819041729, + 5.4004135727882385, + 0.048398684710264206, + 1.0288297794759274, + 0.2984490767121315, + 1.4666999615728855, + 0.4469517692923546, + 0.7571933679282665, + 0.08050454035401344, + 0.3230050913989544, + 0.4325079768896103, + 0.8894092254340649, + 1.1668889485299587, + 0.6067302003502846, + 1.2141974680125713, + 0.5764703750610352, + 0.7987629994750023, + 0.029792513698339462, + 0.9251714199781418, + 0.3577435612678528, + 1.6423033401370049, + 1.425229586660862 + ], + "unique_experts": 63, + "load_cv": 0.9482465911529216, + "normalized_load_entropy": 0.9193141941234265, + "max_load_share": 0.09487179487179487 + }, + "full_input": { + "tokens": 171, + "top_k": 6, + "decisions": 1026, + "ordered_route_sha256": "271a503518e93b61f9a508760930d670a03ae7cf8378eeac2bad943c64854a0b", + "route_weight_sha256": "ef42f4e15d2b93930d74d7fad8f32c0bbc25d3f9c9000a9cfe7ad953e8a45dc1", + "loads": [ + 6, + 11, + 7, + 12, + 23, + 8, + 10, + 7, + 9, + 9, + 17, + 20, + 8, + 7, + 17, + 7, + 12, + 8, + 12, + 17, + 3, + 53, + 2, + 2, + 17, + 10, + 11, + 20, + 33, + 17, + 22, + 20, + 12, + 39, + 9, + 13, + 17, + 12, + 22, + 4, + 19, + 15, + 10, + 77, + 5, + 24, + 12, + 22, + 16, + 13, + 5, + 19, + 8, + 16, + 16, + 22, + 20, + 14, + 16, + 21, + 23, + 14, + 28, + 26 + ], + "weighted_loads": [ + 0.33310970664024353, + 0.633055817335844, + 0.33751057367771864, + 0.6502866335213184, + 1.8517561852931976, + 0.4265702962875366, + 0.7083272784948349, + 0.2753788232803345, + 0.5289775282144547, + 0.3780775163322687, + 1.1874655410647392, + 1.5184279344975948, + 0.45658503100275993, + 1.5589982718229294, + 1.188181083649397, + 0.3824293836951256, + 0.6610766500234604, + 0.4292620010674, + 0.7744935317896307, + 0.7879742179065943, + 0.13484294898808002, + 3.6908137686550617, + 0.03765088599175215, + 0.12477260082960129, + 0.9883700348436832, + 0.6777101624757051, + 0.799319963902235, + 1.3401079345494509, + 1.8047439381480217, + 1.157283190637827, + 1.5918508097529411, + 1.213925831951201, + 0.8947555907070637, + 1.8077735509723425, + 0.4662001598626375, + 1.0511711984872818, + 0.8312334734946489, + 0.6494372263550758, + 1.3494100011885166, + 0.28824789449572563, + 1.053993370383978, + 1.2028519362211227, + 0.4479686636477709, + 5.5137771256268024, + 0.2753717564046383, + 1.2796394191682339, + 0.5815728604793549, + 1.651955520734191, + 1.0990185923874378, + 0.919571666046977, + 0.25939569622278214, + 1.0988339260220528, + 0.5027723163366318, + 1.0003495067358017, + 1.1668889485299587, + 1.5666297003626823, + 1.2869496680796146, + 0.9658235721290112, + 0.7987629994750023, + 1.4150658547878265, + 1.6681658364832401, + 1.259178500622511, + 1.6423033401370049, + 1.4614699073135853 + ], + "unique_experts": 64, + "load_cv": 0.7241787547619266, + "normalized_load_entropy": 0.9508582309707772, + "max_load_share": 0.07504873294346978 + } + }, + "s0_bos": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "2fdc4cff129739d67e5c864a8215c26989370ac35ad6394c81fba4781a9a0e99", + "route_weight_sha256": "54277a0ab50c01fbaf2b78dace9751ce053c1085bb877b807be5e33df515b7e9", + "loads": [ + 6, + 13, + 5, + 10, + 20, + 6, + 10, + 4, + 8, + 8, + 15, + 18, + 4, + 5, + 12, + 7, + 9, + 3, + 5, + 14, + 2, + 53, + 2, + 2, + 16, + 9, + 11, + 0, + 29, + 14, + 12, + 19, + 7, + 25, + 6, + 11, + 15, + 9, + 22, + 4, + 18, + 0, + 8, + 74, + 2, + 18, + 8, + 19, + 8, + 9, + 1, + 6, + 6, + 14, + 15, + 8, + 19, + 8, + 16, + 1, + 13, + 5, + 25, + 29 + ], + "weighted_loads": [ + 0.33238011971116066, + 0.6804724894464016, + 0.32153386250138283, + 0.5656037777662277, + 1.7201375849545002, + 0.3590683192014694, + 0.6949201468378305, + 0.14915675297379494, + 0.5065183602273464, + 0.38303307816386223, + 1.1015423089265823, + 1.397601518779993, + 0.2664511799812317, + 0.18628457188606262, + 0.8854738026857376, + 0.3800876997411251, + 0.5294144488871098, + 0.14868365600705147, + 0.38187210634350777, + 0.648742314428091, + 0.10168468579649925, + 3.663122935220599, + 0.07678654789924622, + 0.11758801713585854, + 0.9636691585183144, + 0.4165394939482212, + 0.8146337941288948, + 0.0, + 1.6581721659749746, + 1.0137734226882458, + 0.7462690733373165, + 1.1906246300786734, + 0.42170989140868187, + 1.0626782793551683, + 0.30458522215485573, + 0.8900616466999054, + 0.761055413633585, + 0.5193035639822483, + 1.376961912959814, + 0.28907111287117004, + 0.996010135859251, + 0.0, + 0.3768076281994581, + 5.393644880503416, + 0.09414152801036835, + 0.9951848238706589, + 0.3253711126744747, + 1.5319779366254807, + 0.47763072326779366, + 0.7087356485426426, + 0.04641873762011528, + 0.3308723494410515, + 0.39016925916075706, + 0.8846173025667667, + 1.1528462693095207, + 0.5489833764731884, + 1.2382082659751177, + 0.6101838387548923, + 0.8050000965595245, + 0.02868708223104477, + 0.9318211153149605, + 0.40145910158753395, + 1.5037617981433868, + 1.5518943797796965 + ], + "unique_experts": 62, + "load_cv": 0.9576296619060323, + "normalized_load_entropy": 0.9175535387629082, + "max_load_share": 0.09487179487179487 + }, + "full_input": { + "tokens": 155, + "top_k": 6, + "decisions": 930, + "ordered_route_sha256": "dd3ca8e8f9f4cc495d1d73bd2aa6647b5c84f8bbc0737453d1a4bea546b6deb9", + "route_weight_sha256": "2b7c3bb5eb1d31274e1252d3732e79734d88a3b6a3d4ed7e3c7fcee203a3dce0", + "loads": [ + 6, + 13, + 6, + 10, + 20, + 6, + 10, + 8, + 8, + 9, + 17, + 19, + 5, + 8, + 16, + 7, + 9, + 6, + 11, + 17, + 6, + 55, + 2, + 2, + 16, + 11, + 11, + 7, + 30, + 15, + 16, + 20, + 7, + 33, + 7, + 12, + 15, + 9, + 22, + 4, + 18, + 8, + 13, + 76, + 6, + 21, + 14, + 23, + 8, + 12, + 3, + 11, + 6, + 15, + 15, + 17, + 19, + 14, + 16, + 15, + 18, + 17, + 25, + 29 + ], + "weighted_loads": [ + 0.33238011971116066, + 0.6804724894464016, + 0.3356896787881851, + 0.5656037777662277, + 1.7201375849545002, + 0.3590683192014694, + 0.6949201468378305, + 0.32357190921902657, + 0.5065183602273464, + 0.39927262999117374, + 1.1976691707968712, + 1.4456650726497173, + 0.29920779913663864, + 0.7322128191590309, + 1.1407652273774147, + 0.3800876997411251, + 0.5294144488871098, + 0.3379938118159771, + 0.781499695032835, + 0.8147880136966705, + 0.28509481251239777, + 3.7472010981291533, + 0.07678654789924622, + 0.11758801713585854, + 0.9636691585183144, + 0.4801545701920986, + 0.8146337941288948, + 0.8602218329906464, + 1.704871954396367, + 1.056390892714262, + 1.12283680960536, + 1.2043985510244966, + 0.42170989140868187, + 1.5042833518236876, + 0.33446947298943996, + 0.9270230792462826, + 0.761055413633585, + 0.5193035639822483, + 1.376961912959814, + 0.28907111287117004, + 0.996010135859251, + 0.969494890421629, + 0.6124562099575996, + 5.49107127264142, + 0.3368997126817703, + 1.1416266523301601, + 0.5956437028944492, + 1.7238127645105124, + 0.47763072326779366, + 0.8680259566754103, + 0.1429947018623352, + 0.571255948394537, + 0.39016925916075706, + 0.9558558724820614, + 1.1528462693095207, + 1.2726829387247562, + 1.2382082659751177, + 0.9553804881870747, + 0.8050000965595245, + 1.004554621875286, + 1.2816438004374504, + 1.438516914844513, + 1.5037617981433868, + 1.5518943797796965 + ], + "unique_experts": 64, + "load_cv": 0.7903657365146551, + "normalized_load_entropy": 0.9449711571147943, + "max_load_share": 0.08172043010752689 + } + }, + "s1_bos": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "b86c2d2a800c11b8125085e76477b0f35e2647ae2c1cfdd8b4e6cc4de67b6724", + "route_weight_sha256": "ade4f1c4c2b56df808486e86d72b94a25657d0e2989d5488d4609f0effd1f24c", + "loads": [ + 6, + 13, + 5, + 11, + 20, + 7, + 10, + 4, + 9, + 8, + 15, + 16, + 5, + 5, + 12, + 7, + 10, + 3, + 5, + 13, + 1, + 50, + 0, + 2, + 16, + 9, + 11, + 1, + 29, + 14, + 11, + 18, + 7, + 26, + 7, + 12, + 17, + 9, + 22, + 4, + 18, + 2, + 7, + 75, + 1, + 19, + 8, + 20, + 8, + 9, + 2, + 6, + 8, + 14, + 15, + 8, + 18, + 7, + 16, + 0, + 12, + 5, + 25, + 27 + ], + "weighted_loads": [ + 0.3354957588016987, + 0.7014017477631569, + 0.3074817396700382, + 0.5998709015548229, + 1.6985819824039936, + 0.3857611883431673, + 0.6929614506661892, + 0.14634676650166512, + 0.5333605408668518, + 0.38502218574285507, + 1.0983260981738567, + 1.317359734326601, + 0.2886346224695444, + 0.1894616037607193, + 0.8686118349432945, + 0.3752015456557274, + 0.5827232599258423, + 0.14526214078068733, + 0.38096579164266586, + 0.6175139974802732, + 0.06739499419927597, + 3.5559159852564335, + 0.0, + 0.12564802169799805, + 0.9518912620842457, + 0.40950913168489933, + 0.8317946903407574, + 0.028680186718702316, + 1.6291687078773975, + 1.0131532400846481, + 0.7193376012146473, + 1.1290231961756945, + 0.4231545440852642, + 1.118500679731369, + 0.33107277005910873, + 0.9396822415292263, + 0.8133548982441425, + 0.5261062942445278, + 1.3667865134775639, + 0.28703995794057846, + 1.0043400637805462, + 0.0955599881708622, + 0.33586184307932854, + 5.371361197903752, + 0.047485578805208206, + 1.0313594676554203, + 0.3294658586382866, + 1.5849214140325785, + 0.46985797584056854, + 0.7068039029836655, + 0.07873731292784214, + 0.3379209116101265, + 0.4756842851638794, + 0.8742137961089611, + 1.1457321494817734, + 0.5668169409036636, + 1.1892092898488045, + 0.5690915174782276, + 0.8094181790947914, + 0.0, + 0.8694941513240337, + 0.39163881354033947, + 1.4856737460941076, + 1.4710320811718702 + ], + "unique_experts": 62, + "load_cv": 0.9472476479299781, + "normalized_load_entropy": 0.9189963106234862, + "max_load_share": 0.09615384615384616 + }, + "full_input": { + "tokens": 171, + "top_k": 6, + "decisions": 1026, + "ordered_route_sha256": "bd423f0e6f9ada64b1eba80267266cbbe45e91492c887c7077751ccceb74ed52", + "route_weight_sha256": "0cc4801be363d41db9a68cd6429bafa412385a56bedb379a234c20b5d6f91509", + "loads": [ + 6, + 13, + 6, + 11, + 24, + 7, + 10, + 5, + 9, + 9, + 17, + 19, + 9, + 7, + 17, + 7, + 10, + 7, + 10, + 16, + 3, + 52, + 0, + 2, + 17, + 12, + 12, + 22, + 29, + 17, + 21, + 19, + 12, + 43, + 9, + 14, + 20, + 12, + 23, + 4, + 19, + 17, + 10, + 78, + 5, + 24, + 13, + 24, + 16, + 13, + 5, + 19, + 9, + 16, + 15, + 21, + 19, + 14, + 16, + 21, + 22, + 15, + 25, + 28 + ], + "weighted_loads": [ + 0.3354957588016987, + 0.7014017477631569, + 0.3216375559568405, + 0.5998709015548229, + 1.8999979309737682, + 0.3857611883431673, + 0.6929614506661892, + 0.18502134829759598, + 0.5333605408668518, + 0.4012617375701666, + 1.1764474101364613, + 1.4847724586725235, + 0.48741492815315723, + 0.6980230361223221, + 1.2054787278175354, + 0.3752015456557274, + 0.5827232599258423, + 0.3892788961529732, + 0.7797736413776875, + 0.7662086207419634, + 0.1640506312251091, + 3.643090981990099, + 0.0, + 0.12564802169799805, + 0.9940849393606186, + 0.7324821017682552, + 0.8733920902013779, + 1.4511962961405516, + 1.6291687078773975, + 1.1434132382273674, + 1.5512580759823322, + 1.1427971171215177, + 0.913068737834692, + 2.029075177386403, + 0.4729681424796581, + 1.102917455136776, + 0.9261035975068808, + 0.6534607782959938, + 1.402909342199564, + 0.28703995794057846, + 1.0468245781958103, + 1.5050106160342693, + 0.4628740232437849, + 5.484724750742316, + 0.3106583394110203, + 1.2821691073477268, + 0.61258964240551, + 1.7789796404540539, + 1.1219247989356518, + 0.9337723962962627, + 0.25762846879661083, + 1.0860638804733753, + 0.5459486246109009, + 0.9902150928974152, + 1.1457321494817734, + 1.549305684864521, + 1.2619614899158478, + 0.9584447145462036, + 0.8094181790947914, + 1.3897752836346626, + 1.6212127804756165, + 1.2930737528949976, + 1.4856737460941076, + 1.5072724018245935 + ], + "unique_experts": 63, + "load_cv": 0.7349289808616805, + "normalized_load_entropy": 0.9483073038503468, + "max_load_share": 0.07602339181286549 + } + }, + "s0_x": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "25a87c06106a150197d884fbf0e2c56218aa067f6fedfe3a3e7d9f411a35f203", + "route_weight_sha256": "bb58409a5d75ccac51465ebcad4d156bb1eec631c2ad3de06a19073ab370d513", + "loads": [ + 7, + 12, + 5, + 11, + 21, + 7, + 9, + 6, + 8, + 6, + 15, + 17, + 5, + 4, + 13, + 6, + 10, + 2, + 6, + 16, + 1, + 51, + 1, + 2, + 16, + 8, + 10, + 0, + 30, + 14, + 11, + 19, + 7, + 23, + 6, + 12, + 16, + 8, + 22, + 4, + 16, + 2, + 6, + 75, + 3, + 19, + 8, + 19, + 8, + 9, + 1, + 6, + 8, + 14, + 15, + 8, + 18, + 8, + 16, + 2, + 12, + 4, + 27, + 29 + ], + "weighted_loads": [ + 0.3664045222103596, + 0.6543803215026855, + 0.3190521374344826, + 0.5998001992702484, + 1.7365224920213223, + 0.38893151842057705, + 0.6911744996905327, + 0.22941455245018005, + 0.4969661310315132, + 0.2852423060685396, + 1.0861179195344448, + 1.3715621381998062, + 0.2995976321399212, + 0.1485561914741993, + 0.9164321757853031, + 0.32959481701254845, + 0.5664745979011059, + 0.09779389202594757, + 0.41229010187089443, + 0.7354305237531662, + 0.06570610404014587, + 3.629768632352352, + 0.03868482634425163, + 0.11164627969264984, + 0.9739642664790154, + 0.37865121476352215, + 0.7642682455480099, + 0.0, + 1.6806778833270073, + 1.0038473010063171, + 0.7055454179644585, + 1.1969030797481537, + 0.41721563041210175, + 0.9867002088576555, + 0.302809938788414, + 0.9471698626875877, + 0.776064770296216, + 0.4862172417342663, + 1.3815796039998531, + 0.29443345591425896, + 0.9129760786890984, + 0.09312136098742485, + 0.30597757548093796, + 5.424461042508483, + 0.1349441297352314, + 1.0292443186044693, + 0.3261773344129324, + 1.4902401864528656, + 0.46774450317025185, + 0.697523795068264, + 0.04859255254268646, + 0.3346768654882908, + 0.46884145215153694, + 0.873665951192379, + 1.14509017765522, + 0.5341968014836311, + 1.1846992056816816, + 0.5942329056560993, + 0.8223804570734501, + 0.06616083905100822, + 0.8894904628396034, + 0.3633371666073799, + 1.5775604918599129, + 1.5567396432161331 + ], + "unique_experts": 63, + "load_cv": 0.9568604151303326, + "normalized_load_entropy": 0.918728241819332, + "max_load_share": 0.09615384615384616 + }, + "full_input": { + "tokens": 155, + "top_k": 6, + "decisions": 930, + "ordered_route_sha256": "719e8abcf077f594ec0c0211c1f8feb921214c91683bb1576b1552611946e998", + "route_weight_sha256": "d1269e1378144af8cd6612b82a58cb3d47415f70f5a6a38a64920d90d6bd1faa", + "loads": [ + 7, + 12, + 6, + 11, + 21, + 7, + 9, + 11, + 8, + 7, + 17, + 18, + 6, + 6, + 16, + 6, + 10, + 6, + 11, + 19, + 4, + 53, + 1, + 2, + 16, + 10, + 10, + 5, + 31, + 15, + 15, + 20, + 7, + 32, + 7, + 13, + 16, + 8, + 22, + 4, + 16, + 9, + 10, + 77, + 8, + 23, + 15, + 24, + 8, + 11, + 3, + 11, + 8, + 15, + 15, + 17, + 18, + 15, + 16, + 16, + 17, + 17, + 27, + 29 + ], + "weighted_loads": [ + 0.3664045222103596, + 0.6543803215026855, + 0.33320795372128487, + 0.5998001992702484, + 1.7365224920213223, + 0.38893151842057705, + 0.6911744996905327, + 0.4436415135860443, + 0.4969661310315132, + 0.30148185789585114, + 1.1822447814047337, + 1.4196256920695305, + 0.33235425129532814, + 0.6524089574813843, + 1.1184527277946472, + 0.32959481701254845, + 0.5664745979011059, + 0.3325611390173435, + 0.7483915444463491, + 0.896529134362936, + 0.1783922277390957, + 3.713846795260906, + 0.03868482634425163, + 0.11164627969264984, + 0.9739642664790154, + 0.44226629100739956, + 0.7642682455480099, + 0.6852925233542919, + 1.7273776717483997, + 1.0464647710323334, + 1.0688668563961983, + 1.2106770006939769, + 0.41721563041210175, + 1.4566922318190336, + 0.33269418962299824, + 0.9841312952339649, + 0.776064770296216, + 0.4862172417342663, + 1.3815796039998531, + 0.29443345591425896, + 0.9129760786890984, + 0.8122053667902946, + 0.5005522314459085, + 5.521887434646487, + 0.3934325650334358, + 1.2449367977678776, + 0.6461736019700766, + 1.7200885359197855, + 0.46774450317025185, + 0.7824872191995382, + 0.1451685167849064, + 0.6119699776172638, + 0.46884145215153694, + 0.9451992884278297, + 1.14509017765522, + 1.2169993743300438, + 1.1846992056816816, + 1.002568680793047, + 0.8223804570734501, + 1.0055092945694923, + 1.2516261264681816, + 1.486121829599142, + 1.5775604918599129, + 1.5567396432161331 + ], + "unique_experts": 64, + "load_cv": 0.7956843939388125, + "normalized_load_entropy": 0.9435632751505599, + "max_load_share": 0.08279569892473118 + } + }, + "s1_x": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "41623e83d0b3f57a8b67c23e9fb2aa89a3e1529c3afcb3ed099d46222316e942", + "route_weight_sha256": "acbd9f41ee072d42b652d5f37e3df69dab7f58806f6a919d6557e1e85e24734c", + "loads": [ + 4, + 13, + 5, + 11, + 20, + 7, + 9, + 4, + 9, + 9, + 14, + 17, + 4, + 4, + 12, + 6, + 11, + 3, + 6, + 12, + 1, + 52, + 0, + 2, + 16, + 11, + 10, + 1, + 29, + 14, + 12, + 17, + 6, + 29, + 7, + 12, + 13, + 7, + 22, + 4, + 18, + 2, + 8, + 75, + 2, + 19, + 7, + 18, + 8, + 9, + 3, + 5, + 10, + 13, + 15, + 8, + 17, + 7, + 18, + 1, + 12, + 6, + 26, + 28 + ], + "weighted_loads": [ + 0.25601131469011307, + 0.7015130911022425, + 0.30596114322543144, + 0.5999801680445671, + 1.734344881027937, + 0.37993148155510426, + 0.6683868858963251, + 0.14370439387857914, + 0.5177111532539129, + 0.3846335392445326, + 1.04983576759696, + 1.3436770588159561, + 0.2631533145904541, + 0.14667444303631783, + 0.852242037653923, + 0.32350151613354683, + 0.6145463772118092, + 0.15157010778784752, + 0.4057802427560091, + 0.5738297514617443, + 0.06807439774274826, + 3.649190589785576, + 0.0, + 0.1215040273964405, + 0.9623497985303402, + 0.4799011629074812, + 0.7959684059023857, + 0.028436221182346344, + 1.6259975414723158, + 0.9984590709209442, + 0.7524888217449188, + 1.08291251398623, + 0.36857945099473, + 1.238321514800191, + 0.3258410766720772, + 0.9377247765660286, + 0.674009408801794, + 0.4494103640317917, + 1.3766276240348816, + 0.2786220610141754, + 0.9766116887331009, + 0.10978773236274719, + 0.3696534801274538, + 5.3395520728081465, + 0.09252197667956352, + 1.0245915688574314, + 0.2877301163971424, + 1.4686203114688396, + 0.44919855520129204, + 0.6883743964135647, + 0.11498347111046314, + 0.3032296150922775, + 0.5560637637972832, + 0.8366986662149429, + 1.132386464625597, + 0.5602292083203793, + 1.1420351583510637, + 0.5553951151669025, + 0.8925296701490879, + 0.03395529091358185, + 0.8597479499876499, + 0.42651965096592903, + 1.5211874060332775, + 1.5100143253803253 + ], + "unique_experts": 63, + "load_cv": 0.9610289248226742, + "normalized_load_entropy": 0.918438674088227, + "max_load_share": 0.09615384615384616 + }, + "full_input": { + "tokens": 171, + "top_k": 6, + "decisions": 1026, + "ordered_route_sha256": "c2bfead1a1f6f70e90442b07c49c283bde5601bccbe8ca6bcd05c843cf5fbee3", + "route_weight_sha256": "54a88a95ecff4a3c709beb29a6cf6c94028d51b3ab95beb8c675328105137644", + "loads": [ + 4, + 13, + 6, + 11, + 24, + 7, + 9, + 6, + 9, + 10, + 17, + 20, + 8, + 5, + 17, + 6, + 11, + 8, + 10, + 14, + 2, + 54, + 0, + 2, + 17, + 14, + 11, + 19, + 29, + 17, + 22, + 18, + 11, + 47, + 9, + 14, + 16, + 10, + 23, + 4, + 19, + 17, + 11, + 78, + 4, + 25, + 13, + 23, + 16, + 13, + 8, + 18, + 11, + 15, + 15, + 20, + 18, + 15, + 18, + 21, + 22, + 17, + 26, + 29 + ], + "weighted_loads": [ + 0.25601131469011307, + 0.7015130911022425, + 0.32011695951223373, + 0.5999801680445671, + 1.9357608295977116, + 0.37993148155510426, + 0.6683868858963251, + 0.23242946900427341, + 0.5177111532539129, + 0.4008730910718441, + 1.1771975345909595, + 1.5110897831618786, + 0.4619336202740669, + 0.6156262047588825, + 1.1911057867109776, + 0.32350151613354683, + 0.6145463772118092, + 0.44632986932992935, + 0.7300668712705374, + 0.6812628842890263, + 0.1090489886701107, + 3.7363655865192413, + 0.0, + 0.1215040273964405, + 1.004543475806713, + 0.8028741329908371, + 0.8375658057630062, + 1.2974414359778166, + 1.6259975414723158, + 1.1287190690636635, + 1.5649009570479393, + 1.096686434932053, + 0.8584936447441578, + 2.1625944077968597, + 0.46773644909262657, + 1.1009599901735783, + 0.7867581080645323, + 0.5767648480832577, + 1.4127504527568817, + 0.2786220610141754, + 1.019096203148365, + 1.304642666131258, + 0.5013656355440617, + 5.45291562564671, + 0.2395617663860321, + 1.3382761292159557, + 0.6358118616044521, + 1.7090721298009157, + 1.1012653782963753, + 0.8940842803567648, + 0.3754788916558027, + 1.0844483487308025, + 0.6263281032443047, + 0.9484743289649487, + 1.132386464625597, + 1.430449239909649, + 1.214787358418107, + 0.9946109056472778, + 0.8925296701490879, + 1.3658701851963997, + 1.6090453788638115, + 1.4129672572016716, + 1.5211874060332775, + 1.5462546460330486 + ], + "unique_experts": 63, + "load_cv": 0.7527471609287107, + "normalized_load_entropy": 0.9459552994081647, + "max_load_share": 0.07602339181286549 + } + }, + "s0_period": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "fc82497d916f29d44f3b0d124437d3849478e748cb7c85f4424fe0fb1a4f9ae8", + "route_weight_sha256": "63f835329d6966e7ca99871744044bce3c83592aaa53105d8e47f96c459ab710", + "loads": [ + 6, + 12, + 5, + 11, + 21, + 7, + 9, + 6, + 8, + 6, + 15, + 16, + 5, + 4, + 13, + 6, + 10, + 3, + 6, + 16, + 1, + 51, + 0, + 2, + 16, + 7, + 10, + 0, + 30, + 14, + 11, + 18, + 7, + 21, + 6, + 11, + 16, + 9, + 22, + 4, + 17, + 1, + 7, + 74, + 3, + 19, + 8, + 19, + 8, + 10, + 1, + 6, + 9, + 14, + 15, + 8, + 19, + 8, + 15, + 3, + 12, + 4, + 28, + 31 + ], + "weighted_loads": [ + 0.32206957414746284, + 0.6612536907196045, + 0.31404972076416016, + 0.605824951082468, + 1.731289453804493, + 0.3945295624434948, + 0.6864515729248524, + 0.22442305460572243, + 0.5021023340523243, + 0.2826108820736408, + 1.0899147260934114, + 1.3130280338227749, + 0.3010304383933544, + 0.14676650613546371, + 0.908896628767252, + 0.3345750942826271, + 0.5637526363134384, + 0.15088466182351112, + 0.42137457244098186, + 0.744740966707468, + 0.06549597531557083, + 3.627986326813698, + 0.0, + 0.11124983057379723, + 0.9768255762755871, + 0.348961329087615, + 0.7676163092255592, + 0.0, + 1.6682400330901146, + 0.9994245581328869, + 0.701713040471077, + 1.1656465493142605, + 0.4151642620563507, + 0.8849818948656321, + 0.29709164053201675, + 0.9017180986702442, + 0.7970214784145355, + 0.5134142339229584, + 1.3708076812326908, + 0.2901223637163639, + 0.9576980508863926, + 0.061240777373313904, + 0.3453758545219898, + 5.433939320966601, + 0.13458064198493958, + 1.030687503516674, + 0.32654518634080887, + 1.4969173725694418, + 0.4719848223030567, + 0.7362135387957096, + 0.048680178821086884, + 0.33536139130592346, + 0.5136725828051567, + 0.8727649562060833, + 1.1494241617619991, + 0.5354687869548798, + 1.229991365224123, + 0.6008835956454277, + 0.7697761133313179, + 0.09694667719304562, + 0.8860778510570526, + 0.3650350980460644, + 1.6210044510662556, + 1.6127419918775558 + ], + "unique_experts": 62, + "load_cv": 0.9528944797543698, + "normalized_load_entropy": 0.9182998396116492, + "max_load_share": 0.09487179487179487 + }, + "full_input": { + "tokens": 155, + "top_k": 6, + "decisions": 930, + "ordered_route_sha256": "b751de3e424f22f125170aab485d5d743aab53c755081cbfd64ea37dfa7583f8", + "route_weight_sha256": "39d30d7dc8122c88a391b26984530c207bc581a2df316a8b43e1d841bbeb5432", + "loads": [ + 6, + 12, + 6, + 11, + 21, + 7, + 9, + 10, + 8, + 7, + 17, + 17, + 7, + 6, + 16, + 6, + 10, + 6, + 11, + 19, + 4, + 53, + 0, + 2, + 16, + 9, + 10, + 6, + 31, + 15, + 16, + 19, + 7, + 29, + 7, + 12, + 16, + 9, + 22, + 4, + 17, + 9, + 11, + 76, + 7, + 23, + 14, + 23, + 8, + 13, + 3, + 12, + 9, + 15, + 15, + 17, + 19, + 15, + 15, + 17, + 18, + 16, + 28, + 31 + ], + "weighted_loads": [ + 0.32206957414746284, + 0.6612536907196045, + 0.32820553705096245, + 0.605824951082468, + 1.731289453804493, + 0.3945295624434948, + 0.6864515729248524, + 0.39883821085095406, + 0.5021023340523243, + 0.29885043390095234, + 1.1860415879637003, + 1.3610915876924992, + 0.37135909870266914, + 0.6506192721426487, + 1.1115165427327156, + 0.3345750942826271, + 0.5637526363134384, + 0.36889906600117683, + 0.7574760150164366, + 0.9061428755521774, + 0.17818209901452065, + 3.712064489722252, + 0.0, + 0.11124983057379723, + 0.9768255762755871, + 0.4125764053314924, + 0.7676163092255592, + 0.7199166715145111, + 1.714939821511507, + 1.0420420281589031, + 1.1342248320579529, + 1.1794204702600837, + 0.4151642620563507, + 1.3160643484443426, + 0.326975891366601, + 0.9386795312166214, + 0.7970214784145355, + 0.5134142339229584, + 1.3708076812326908, + 0.2901223637163639, + 0.9576980508863926, + 0.8690288625657558, + 0.5357191395014524, + 5.531365713104606, + 0.34571683406829834, + 1.2212718687951565, + 0.5968177765607834, + 1.680928885936737, + 0.4719848223030567, + 0.8741783760488033, + 0.1452561430633068, + 0.6838313117623329, + 0.5136725828051567, + 0.9453193880617619, + 1.1494241617619991, + 1.2363272979855537, + 1.229991365224123, + 1.0190240293741226, + 0.7697761133313179, + 1.0415051449090242, + 1.2973633222281933, + 1.4020929113030434, + 1.6210044510662556, + 1.6127419918775558 + ], + "unique_experts": 63, + "load_cv": 0.7886787087762398, + "normalized_load_entropy": 0.943550866084945, + "max_load_share": 0.08172043010752689 + } + }, + "s1_period": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "8678efce3ca1132ee30f208d3fe7557463d3ebf1cdc6b02a46b7b6e3a22cf970", + "route_weight_sha256": "9fac5670a7813a7133f95ab55658919e1c1e9963e55d09a40f758cb6925896b3", + "loads": [ + 4, + 14, + 5, + 11, + 22, + 7, + 9, + 3, + 8, + 8, + 14, + 17, + 5, + 4, + 12, + 7, + 11, + 3, + 5, + 14, + 1, + 50, + 0, + 2, + 15, + 11, + 10, + 2, + 29, + 14, + 12, + 16, + 7, + 29, + 7, + 12, + 16, + 8, + 22, + 4, + 19, + 2, + 7, + 75, + 2, + 19, + 7, + 18, + 8, + 9, + 2, + 6, + 9, + 12, + 14, + 8, + 17, + 7, + 17, + 3, + 12, + 4, + 26, + 27 + ], + "weighted_loads": [ + 0.25377368927001953, + 0.7297281213104725, + 0.30865705385804176, + 0.6085971929132938, + 1.7995421960949898, + 0.37966566160321236, + 0.6653396002948284, + 0.12184600532054901, + 0.48896466195583344, + 0.3605630360543728, + 1.0509369000792503, + 1.3445858508348465, + 0.294952355325222, + 0.1522890217602253, + 0.8497926071286201, + 0.3765239268541336, + 0.6144795641303062, + 0.1554020494222641, + 0.3716394677758217, + 0.6458625253289938, + 0.06464359909296036, + 3.555968590080738, + 0.0, + 0.12306329980492592, + 0.9268064014613628, + 0.4784625507891178, + 0.7950123138725758, + 0.06620401702821255, + 1.6325696483254433, + 0.9954381734132767, + 0.7521874569356441, + 1.0363646242767572, + 0.4162904657423496, + 1.223173500970006, + 0.32200877740979195, + 0.9428648427128792, + 0.781158585101366, + 0.4899943619966507, + 1.377847321331501, + 0.2796011343598366, + 1.0524411797523499, + 0.11364908888936043, + 0.3307425528764725, + 5.341385079547763, + 0.09190544858574867, + 1.022374626249075, + 0.29238924011588097, + 1.4668023325502872, + 0.4497978538274765, + 0.6954221613705158, + 0.0886763297021389, + 0.339373916387558, + 0.5147724412381649, + 0.7909780256450176, + 1.0921878032386303, + 0.5360175408422947, + 1.1459721699357033, + 0.5552613772451878, + 0.8471345640718937, + 0.0910678505897522, + 0.8519058935344219, + 0.35650037974119186, + 1.5244912952184677, + 1.4721303060650826 + ], + "unique_experts": 63, + "load_cv": 0.9520109171247914, + "normalized_load_entropy": 0.9199793687609904, + "max_load_share": 0.09615384615384616 + }, + "full_input": { + "tokens": 171, + "top_k": 6, + "decisions": 1026, + "ordered_route_sha256": "6238c1a21f238396f60ac551e5a73398c723c4929d5d1dafbe83e32183eccd53", + "route_weight_sha256": "2ebe3f98a9c6c94996722cdb757a98160a758c8177628b06af582a3bebe85541", + "loads": [ + 5, + 14, + 6, + 12, + 26, + 7, + 9, + 4, + 8, + 9, + 16, + 20, + 9, + 5, + 17, + 7, + 11, + 8, + 9, + 16, + 2, + 52, + 0, + 2, + 16, + 14, + 11, + 20, + 29, + 17, + 23, + 17, + 12, + 46, + 9, + 14, + 19, + 11, + 23, + 4, + 20, + 17, + 10, + 78, + 4, + 25, + 12, + 23, + 16, + 13, + 6, + 20, + 10, + 14, + 14, + 21, + 18, + 15, + 17, + 23, + 22, + 15, + 26, + 28 + ], + "weighted_loads": [ + 0.2894499748945236, + 0.7297281213104725, + 0.32281287014484406, + 0.6653607524931431, + 2.0009581446647644, + 0.37966566160321236, + 0.6653396002948284, + 0.16052058711647987, + 0.48896466195583344, + 0.3768025878816843, + 1.1290582120418549, + 1.511998575180769, + 0.49373266100883484, + 0.62124078348279, + 1.1813726462423801, + 0.3765239268541336, + 0.6144795641303062, + 0.5045780874788761, + 0.69592609629035, + 0.7792091052979231, + 0.1056181900203228, + 3.6431435868144035, + 0.0, + 0.12306329980492592, + 0.9690000787377357, + 0.8014355208724737, + 0.8366097137331963, + 1.3286931477487087, + 1.6325696483254433, + 1.125698171555996, + 1.6556840687990189, + 1.0501385452225804, + 0.9062046594917774, + 2.0913658626377583, + 0.46390414983034134, + 1.1061000563204288, + 0.8939072843641043, + 0.6173488460481167, + 1.4139701500535011, + 0.2796011343598366, + 1.094925694167614, + 1.316386952996254, + 0.457127558067441, + 5.454748632386327, + 0.23894523829221725, + 1.3116524331271648, + 0.5755130238831043, + 1.6916057150810957, + 1.1018646769225597, + 0.9044207949191332, + 0.31369541212916374, + 1.218350451439619, + 0.5850367806851864, + 0.9005861580371857, + 1.0921878032386303, + 1.454544223845005, + 1.2187243700027466, + 1.074877917766571, + 0.8471345640718937, + 1.389345671981573, + 1.5966803207993507, + 1.3060782589018345, + 1.5244912952184677, + 1.5083706267178059 + ], + "unique_experts": 63, + "load_cv": 0.7501581516506669, + "normalized_load_entropy": 0.9455762798104659, + "max_load_share": 0.07602339181286549 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 130, + "ordered_topk_exact_tokens": 92, + "set_exact_tokens": 107, + "mean_set_jaccard": 0.9494505494505496, + "mean_token_weighted_tv": 0.010152348675406896, + "aggregate_load_tv": 0.023076923076923085 + }, + "system_bos": { + "tokens": 130, + "ordered_topk_exact_tokens": 80, + "set_exact_tokens": 100, + "mean_set_jaccard": 0.9307692307692309, + "mean_token_weighted_tv": 0.01494677563269551, + "aggregate_load_tv": 0.02435897435897436 + }, + "system_x": { + "tokens": 130, + "ordered_topk_exact_tokens": 72, + "set_exact_tokens": 89, + "mean_set_jaccard": 0.9032967032967033, + "mean_token_weighted_tv": 0.019978437028252163, + "aggregate_load_tv": 0.04102564102564103 + }, + "system_period": { + "tokens": 130, + "ordered_topk_exact_tokens": 69, + "set_exact_tokens": 91, + "mean_set_jaccard": 0.910989010989011, + "mean_token_weighted_tv": 0.019299561272446926, + "aggregate_load_tv": 0.04102564102564103 + }, + "bos_at_s0": { + "tokens": 130, + "ordered_topk_exact_tokens": 73, + "set_exact_tokens": 91, + "mean_set_jaccard": 0.910989010989011, + "mean_token_weighted_tv": 0.01851892747128239, + "aggregate_load_tv": 0.02948717948717948 + }, + "bos_at_s1": { + "tokens": 130, + "ordered_topk_exact_tokens": 72, + "set_exact_tokens": 91, + "mean_set_jaccard": 0.9126373626373627, + "mean_token_weighted_tv": 0.018642755712454134, + "aggregate_load_tv": 0.037179487179487186 + }, + "x_at_s0": { + "tokens": 130, + "ordered_topk_exact_tokens": 70, + "set_exact_tokens": 86, + "mean_set_jaccard": 0.9, + "mean_token_weighted_tv": 0.020782754785166335, + "aggregate_load_tv": 0.02820512820512821 + }, + "x_at_s1": { + "tokens": 130, + "ordered_topk_exact_tokens": 59, + "set_exact_tokens": 81, + "mean_set_jaccard": 0.8877289377289379, + "mean_token_weighted_tv": 0.024048244308393734, + "aggregate_load_tv": 0.047435897435897434 + }, + "period_at_s0": { + "tokens": 130, + "ordered_topk_exact_tokens": 71, + "set_exact_tokens": 88, + "mean_set_jaccard": 0.906043956043956, + "mean_token_weighted_tv": 0.01947500050927584, + "aggregate_load_tv": 0.029487179487179487 + }, + "period_at_s1": { + "tokens": 130, + "ordered_topk_exact_tokens": 67, + "set_exact_tokens": 88, + "mean_set_jaccard": 0.9010989010989011, + "mean_token_weighted_tv": 0.022313969338742586, + "aggregate_load_tv": 0.04871794871794873 + } + } + }, + "layer_11": { + "layer": 11, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "cf10d4d8d060e854832663076cf1ac60cf4c8db449c495271ba9f393fc1dcded", + "route_weight_sha256": "42c2cca946702f1b49ff4fbe0b212e31e986831e3a766ca03b302941111d07d9", + "loads": [ + 15, + 7, + 8, + 23, + 8, + 9, + 21, + 10, + 16, + 7, + 10, + 18, + 20, + 22, + 80, + 11, + 3, + 16, + 3, + 9, + 16, + 14, + 11, + 8, + 3, + 14, + 8, + 10, + 1, + 19, + 56, + 11, + 7, + 27, + 3, + 11, + 13, + 11, + 3, + 20, + 6, + 26, + 11, + 1, + 17, + 7, + 15, + 2, + 3, + 3, + 6, + 10, + 21, + 0, + 3, + 4, + 8, + 17, + 5, + 7, + 9, + 11, + 1, + 5 + ], + "weighted_loads": [ + 0.8807081878185272, + 0.2907508797943592, + 0.38810401037335396, + 1.080712852999568, + 0.4039059616625309, + 0.3834880106151104, + 1.2602950632572174, + 0.5882657207548618, + 1.0080848336219788, + 0.2543366886675358, + 0.6091569326817989, + 1.027367366477847, + 1.2012838926166296, + 1.7359124794602394, + 5.326811112463474, + 0.5217080265283585, + 0.13366780057549477, + 0.6743198037147522, + 0.11432571709156036, + 0.4629082828760147, + 1.3979546390473843, + 1.0318080186843872, + 0.4316844083368778, + 0.6713437288999557, + 0.15086590126156807, + 0.7299040257930756, + 0.2864821832627058, + 0.5302633866667747, + 0.036494892090559006, + 1.2046003378927708, + 2.8296302370727062, + 0.6687383577227592, + 0.23867699317634106, + 1.5197345204651356, + 0.10596048086881638, + 1.0699398927390575, + 0.6689707785844803, + 0.4795435145497322, + 0.13163409754633904, + 0.9639194719493389, + 0.3107164166867733, + 1.1283258497714996, + 0.5812667850404978, + 0.031061001121997833, + 1.4543055146932602, + 0.41986045986413956, + 0.9315283447504044, + 0.08384595811367035, + 0.13859747722744942, + 0.20470847189426422, + 0.3224944584071636, + 0.7561545893549919, + 1.148918256163597, + 0.0, + 0.12976879999041557, + 0.18039866536855698, + 0.6068905703723431, + 1.0886492244899273, + 0.2190198227763176, + 0.28396816924214363, + 0.4779796600341797, + 1.017558990046382, + 0.05397452041506767, + 0.3171334005892277 + ], + "unique_experts": 63, + "load_cv": 0.996707267978298, + "normalized_load_entropy": 0.9163709790587395, + "max_load_share": 0.10256410256410256 + }, + "full_input": { + "tokens": 155, + "top_k": 6, + "decisions": 930, + "ordered_route_sha256": "5aecdda74bb8f43eebfbb91877e635a12ce0caa5b836fd58b0fa86aa4457d10d", + "route_weight_sha256": "59cbcec28d0327ff2991b66616686db5ed0954ebb586895af151ffb4dd5b6e07", + "loads": [ + 15, + 7, + 9, + 23, + 12, + 9, + 21, + 10, + 20, + 9, + 13, + 21, + 20, + 22, + 80, + 17, + 9, + 18, + 15, + 9, + 16, + 14, + 12, + 13, + 3, + 14, + 9, + 12, + 7, + 19, + 62, + 19, + 9, + 27, + 7, + 15, + 13, + 11, + 3, + 20, + 13, + 26, + 11, + 22, + 20, + 7, + 15, + 10, + 3, + 6, + 6, + 10, + 21, + 0, + 7, + 6, + 8, + 17, + 8, + 9, + 9, + 17, + 9, + 6 + ], + "weighted_loads": [ + 0.8807081878185272, + 0.2907508797943592, + 0.4463154412806034, + 1.080712852999568, + 0.6020927093923092, + 0.3834880106151104, + 1.2602950632572174, + 0.5882657207548618, + 1.216688234359026, + 0.31224774569272995, + 0.6815091115422547, + 1.0812343508005142, + 1.2012838926166296, + 1.7359124794602394, + 5.326811112463474, + 0.7522933185100555, + 0.7026929520070553, + 0.7042011199519038, + 2.1849223859608173, + 0.4629082828760147, + 1.3979546390473843, + 1.0318080186843872, + 0.4356166492216289, + 0.9211586937308311, + 0.15086590126156807, + 0.7299040257930756, + 0.28984724963083863, + 0.5832603611052036, + 0.5316448099911213, + 1.2046003378927708, + 3.1246304735541344, + 1.020572330802679, + 0.30370206385850906, + 1.5197345204651356, + 0.2740480899810791, + 1.3984296172857285, + 0.6689707785844803, + 0.4795435145497322, + 0.13163409754633904, + 0.9639194719493389, + 0.6789826788008213, + 1.1283258497714996, + 0.5812667850404978, + 2.181146703660488, + 1.6183491088449955, + 0.41986045986413956, + 0.9315283447504044, + 0.6778146177530289, + 0.13859747722744942, + 0.4184146970510483, + 0.3224944584071636, + 0.7561545893549919, + 1.148918256163597, + 0.0, + 0.33013896737247705, + 0.2710510566830635, + 0.6068905703723431, + 1.0886492244899273, + 0.35627567395567894, + 0.38701326958835125, + 0.4779796600341797, + 1.398419352248311, + 0.5213517472147942, + 0.3463135454803705 + ], + "unique_experts": 63, + "load_cv": 0.8169750668866467, + "normalized_load_entropy": 0.9439990473707858, + "max_load_share": 0.08602150537634409 + } + }, + "s1_eos": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "d1c4006c2cb5eb5ba7db9804890bb6d46b68e312de1634fe7cf4f8cc6d36ccf9", + "route_weight_sha256": "1d1d5d1df5ed48c5710008a09f27653f4ac15074af48820d0af900d768d022a8", + "loads": [ + 15, + 6, + 8, + 23, + 7, + 10, + 21, + 10, + 16, + 6, + 10, + 19, + 21, + 22, + 82, + 11, + 3, + 17, + 3, + 9, + 16, + 14, + 9, + 8, + 2, + 14, + 8, + 10, + 1, + 19, + 57, + 11, + 6, + 27, + 3, + 11, + 13, + 10, + 2, + 20, + 6, + 29, + 11, + 0, + 17, + 7, + 14, + 2, + 4, + 3, + 6, + 10, + 21, + 0, + 3, + 4, + 8, + 17, + 6, + 6, + 9, + 10, + 2, + 5 + ], + "weighted_loads": [ + 0.8899334669113159, + 0.2621133364737034, + 0.3829970769584179, + 1.0861350148916245, + 0.3666730485856533, + 0.42406717129051685, + 1.2604664787650108, + 0.5951921977102757, + 1.0097846686840057, + 0.21723785623908043, + 0.6060392297804356, + 1.064766775816679, + 1.2691461257636547, + 1.7457083202898502, + 5.467309799045324, + 0.5126461498439312, + 0.12826933711767197, + 0.7111041881144047, + 0.11788032576441765, + 0.4670402929186821, + 1.3806796707212925, + 1.04025436937809, + 0.36748645454645157, + 0.6730462238192558, + 0.1079915389418602, + 0.7443661894649267, + 0.28003873862326145, + 0.5255410000681877, + 0.03751359134912491, + 1.2175178118050098, + 2.8006710465997458, + 0.667209580540657, + 0.21538632549345493, + 1.5071807838976383, + 0.11431393027305603, + 1.0623031742870808, + 0.6647775247693062, + 0.4343893826007843, + 0.09454953670501709, + 0.9707969911396503, + 0.3017931580543518, + 1.2533592116087675, + 0.5744326021522284, + 0.0, + 1.4608686231076717, + 0.41841912642121315, + 0.87520532310009, + 0.08337827771902084, + 0.17807264998555183, + 0.20309046283364296, + 0.32346944883465767, + 0.7550287209451199, + 1.151409201323986, + 0.0, + 0.12217258289456367, + 0.18018531054258347, + 0.6033154390752316, + 1.1094481758773327, + 0.25374434143304825, + 0.25342682749032974, + 0.4732632450759411, + 0.9643508680164814, + 0.08598905801773071, + 0.3190952502191067 + ], + "unique_experts": 62, + "load_cv": 1.0260383845650807, + "normalized_load_entropy": 0.9118083377677172, + "max_load_share": 0.10512820512820513 + }, + "full_input": { + "tokens": 171, + "top_k": 6, + "decisions": 1026, + "ordered_route_sha256": "bb9e6a719d32885e0e7c5861263d2d4f2fdf55d7e453fd3ea0b1844a24f09827", + "route_weight_sha256": "37434b364d2c6c45eefcaa354a67364651cab6dcabf34594d6266bbc7e375761", + "loads": [ + 17, + 7, + 9, + 23, + 17, + 13, + 21, + 12, + 26, + 6, + 14, + 22, + 21, + 22, + 82, + 12, + 22, + 19, + 14, + 10, + 17, + 15, + 12, + 12, + 2, + 14, + 11, + 13, + 11, + 19, + 66, + 18, + 7, + 27, + 7, + 18, + 13, + 10, + 2, + 21, + 13, + 29, + 11, + 26, + 19, + 7, + 15, + 15, + 4, + 7, + 6, + 10, + 21, + 5, + 22, + 11, + 14, + 18, + 8, + 12, + 9, + 19, + 13, + 8 + ], + "weighted_loads": [ + 1.037302553653717, + 0.2957143560051918, + 0.4298632852733135, + 1.0861350148916245, + 0.9170872680842876, + 0.5309300068765879, + 1.2604664787650108, + 0.7239769846200943, + 1.5797293446958065, + 0.21723785623908043, + 0.7204866730608046, + 1.1178980991244316, + 1.2691461257636547, + 1.7457083202898502, + 5.467309799045324, + 0.5525254346430302, + 1.7917117476463318, + 0.7400888837873936, + 2.172346245497465, + 0.5055394656956196, + 1.4537996537983418, + 1.1127730756998062, + 0.4838865746278316, + 0.8517588824033737, + 0.1079915389418602, + 0.7443661894649267, + 0.36027544108219445, + 0.6194351501762867, + 0.8419405072927475, + 1.2175178118050098, + 3.249820565804839, + 0.9754996001720428, + 0.24773471616208553, + 1.5071807838976383, + 0.3022780418395996, + 1.644011426717043, + 0.6647775247693062, + 0.4343893826007843, + 0.09454953670501709, + 1.0174628272652626, + 0.6498846672475338, + 1.2533592116087675, + 0.5744326021522284, + 2.508984886109829, + 1.5953634418547153, + 0.41841912642121315, + 0.920692328363657, + 1.1013668216764927, + 0.17807264998555183, + 0.5367485694587231, + 0.32346944883465767, + 0.7550287209451199, + 1.151409201323986, + 0.304383534938097, + 1.258467365987599, + 0.5126829706132412, + 1.075543012470007, + 1.151880607008934, + 0.3555244170129299, + 0.5075126197189093, + 0.4732632450759411, + 1.4681659862399101, + 0.6471210084855556, + 0.4249226078391075 + ], + "unique_experts": 64, + "load_cv": 0.761180497319375, + "normalized_load_entropy": 0.9507116073817565, + "max_load_share": 0.07992202729044834 + } + }, + "s0_bos": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "fdfafd6b6afcc9b98307f35adda1b784113e53597ba379071aa4df06eaf0d28a", + "route_weight_sha256": "8acbcd07644ede4b017cf848e76375b7023943c0d083d9792dfcd7e53a5222cf", + "loads": [ + 15, + 8, + 11, + 23, + 7, + 9, + 20, + 10, + 16, + 7, + 10, + 19, + 21, + 22, + 80, + 12, + 3, + 16, + 2, + 9, + 16, + 14, + 11, + 8, + 2, + 14, + 8, + 10, + 1, + 18, + 59, + 11, + 5, + 26, + 2, + 11, + 14, + 8, + 2, + 20, + 8, + 24, + 10, + 0, + 17, + 7, + 14, + 2, + 4, + 3, + 7, + 9, + 20, + 0, + 3, + 4, + 8, + 18, + 5, + 8, + 12, + 10, + 2, + 5 + ], + "weighted_loads": [ + 0.8811646662652493, + 0.34688547253608704, + 0.49882546812295914, + 1.0757783185690641, + 0.38854021579027176, + 0.3838498815894127, + 1.2447364293038845, + 0.5916187576949596, + 1.0057853534817696, + 0.25488216802477837, + 0.6110927537083626, + 1.0330426450818777, + 1.2360922507941723, + 1.7654068283736706, + 5.28372472897172, + 0.5561831928789616, + 0.1335536204278469, + 0.6663124263286591, + 0.07044079713523388, + 0.47917552664875984, + 1.414982844144106, + 1.074234776198864, + 0.44098513573408127, + 0.6745348162949085, + 0.10712027177214622, + 0.7360182199627161, + 0.2925611585378647, + 0.5498699508607388, + 0.03614787757396698, + 1.1553451344370842, + 2.9559377301484346, + 0.6597126238048077, + 0.1984218880534172, + 1.5047968998551369, + 0.07590257003903389, + 1.0805729143321514, + 0.7049091942608356, + 0.3462849259376526, + 0.09173789247870445, + 0.9641465190798044, + 0.39194932393729687, + 1.0890149120241404, + 0.5462957173585892, + 0.0, + 1.4271384328603745, + 0.42368801310658455, + 0.9113354720175266, + 0.08464117348194122, + 0.17487183213233948, + 0.20464744418859482, + 0.3542175926268101, + 0.7508220560848713, + 1.1245484463870525, + 0.0, + 0.13260022178292274, + 0.18661297485232353, + 0.6097192578017712, + 1.1402402929961681, + 0.21452463418245316, + 0.3118130210787058, + 0.5844030678272247, + 0.9387318156659603, + 0.08294245786964893, + 0.31839773431420326 + ], + "unique_experts": 62, + "load_cv": 1.0087715236121388, + "normalized_load_entropy": 0.9139241739135516, + "max_load_share": 0.10256410256410256 + }, + "full_input": { + "tokens": 155, + "top_k": 6, + "decisions": 930, + "ordered_route_sha256": "4b2acb554783c5cad09722f00babda6cffaae17c1e7482f0ffb9f5a53d6afb05", + "route_weight_sha256": "f1de23ec9e347eeb71edf177c11affe2727cd0790eace73805c5f95b019cb131", + "loads": [ + 15, + 8, + 12, + 23, + 11, + 9, + 20, + 10, + 20, + 10, + 12, + 21, + 21, + 22, + 80, + 19, + 10, + 17, + 13, + 9, + 16, + 14, + 11, + 13, + 2, + 14, + 8, + 13, + 7, + 18, + 65, + 19, + 7, + 26, + 6, + 15, + 14, + 8, + 2, + 20, + 16, + 24, + 10, + 22, + 20, + 7, + 14, + 10, + 4, + 6, + 7, + 9, + 20, + 0, + 6, + 5, + 8, + 18, + 8, + 10, + 12, + 17, + 11, + 6 + ], + "weighted_loads": [ + 0.8811646662652493, + 0.34688547253608704, + 0.5570368990302086, + 1.0757783185690641, + 0.58672696352005, + 0.3838498815894127, + 1.2447364293038845, + 0.5916187576949596, + 1.2112183198332787, + 0.3489953689277172, + 0.6783303199335933, + 1.074836540967226, + 1.2360922507941723, + 1.7654068283736706, + 5.28372472897172, + 0.81861811876297, + 0.8126102760434151, + 0.6811552606523037, + 1.245074214413762, + 0.47917552664875984, + 1.414982844144106, + 1.074234776198864, + 0.44098513573408127, + 0.9243497811257839, + 0.10712027177214622, + 0.7360182199627161, + 0.2925611585378647, + 0.6472386531531811, + 0.515069417655468, + 1.1553451344370842, + 3.250937966629863, + 1.0115465968847275, + 0.2634469587355852, + 1.5047968998551369, + 0.2439579777419567, + 1.3986925706267357, + 0.7049091942608356, + 0.3462849259376526, + 0.09173789247870445, + 0.9641465190798044, + 0.8434114400297403, + 1.0890149120241404, + 0.5462957173585892, + 2.3326547369360924, + 1.5911820270121098, + 0.42368801310658455, + 0.9113354720175266, + 0.6791835874319077, + 0.17487183213233948, + 0.4133990779519081, + 0.3542175926268101, + 0.7508220560848713, + 1.1245484463870525, + 0.0, + 0.2975625107064843, + 0.22995073720812798, + 0.6097192578017712, + 1.1402402929961681, + 0.3517804853618145, + 0.41338609904050827, + 0.5844030678272247, + 1.3794389516115189, + 0.6216036733239889, + 0.3465390708297491 + ], + "unique_experts": 63, + "load_cv": 0.8291124460891385, + "normalized_load_entropy": 0.9424370644866124, + "max_load_share": 0.08602150537634409 + } + }, + "s1_bos": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "d840be2eeb1b46333ff05fcbab654e453cb423167adb08d9268bcc284f34d2a0", + "route_weight_sha256": "523cdeda6267bb8d35926ab44d3fc421f3cc1c346c958ec24fc2ccb4b630b45d", + "loads": [ + 15, + 7, + 10, + 22, + 8, + 9, + 21, + 8, + 16, + 6, + 10, + 19, + 21, + 22, + 83, + 10, + 3, + 17, + 3, + 9, + 16, + 14, + 11, + 8, + 2, + 14, + 8, + 10, + 1, + 20, + 55, + 11, + 6, + 26, + 3, + 11, + 12, + 9, + 2, + 20, + 7, + 25, + 11, + 1, + 17, + 7, + 14, + 1, + 3, + 3, + 6, + 10, + 20, + 0, + 4, + 3, + 8, + 19, + 4, + 9, + 14, + 10, + 1, + 5 + ], + "weighted_loads": [ + 0.8820192776620388, + 0.31099363043904305, + 0.4754212126135826, + 1.0329667758196592, + 0.41279442235827446, + 0.3838844485580921, + 1.2791020311415195, + 0.514834176748991, + 0.9995836727321148, + 0.22616205736994743, + 0.6052895821630955, + 1.044300775974989, + 1.2693374827504158, + 1.7559340335428715, + 5.49661616422236, + 0.4847703203558922, + 0.1344022937119007, + 0.6915773954242468, + 0.11404602415859699, + 0.4723777249455452, + 1.420397512614727, + 1.0430363081395626, + 0.43973029032349586, + 0.6770571321249008, + 0.10448051989078522, + 0.7560736127197742, + 0.2914379835128784, + 0.5376576781272888, + 0.03626643121242523, + 1.217631921172142, + 2.6908379681408405, + 0.6831953562796116, + 0.21997234597802162, + 1.498774154111743, + 0.10873072221875191, + 1.0780571848154068, + 0.6108791530132294, + 0.40085021406412125, + 0.09489104151725769, + 0.9693159032613039, + 0.35315921157598495, + 1.1235435083508492, + 0.5700932331383228, + 0.044545479118824005, + 1.4643031731247902, + 0.4381323903799057, + 0.8906963393092155, + 0.03944128006696701, + 0.12699494883418083, + 0.20201701298356056, + 0.328101322054863, + 0.7627534531056881, + 1.1215976774692535, + 0.0, + 0.17464875802397728, + 0.15307189896702766, + 0.599905826151371, + 1.1798626761883497, + 0.1830241121351719, + 0.3631276711821556, + 0.6559858173131943, + 0.9469352588057518, + 0.05386130511760712, + 0.31287090480327606 + ], + "unique_experts": 63, + "load_cv": 1.0168727763397998, + "normalized_load_entropy": 0.9132047551437669, + "max_load_share": 0.1064102564102564 + }, + "full_input": { + "tokens": 171, + "top_k": 6, + "decisions": 1026, + "ordered_route_sha256": "f2c2e33b3c06e55b7e8379b45dd144c58139c42516e4b05ba3513aea972dd89c", + "route_weight_sha256": "8d33325f0af7ae49c0626d5a23df0670c62e7fabcbb08a2535dc78c39f434cd5", + "loads": [ + 17, + 8, + 11, + 22, + 18, + 12, + 21, + 10, + 26, + 7, + 13, + 21, + 21, + 22, + 83, + 12, + 22, + 18, + 13, + 10, + 17, + 15, + 13, + 12, + 2, + 14, + 10, + 13, + 10, + 20, + 64, + 18, + 7, + 26, + 6, + 18, + 12, + 9, + 2, + 21, + 15, + 25, + 11, + 28, + 19, + 7, + 15, + 15, + 3, + 7, + 6, + 10, + 20, + 5, + 22, + 10, + 14, + 20, + 6, + 15, + 15, + 21, + 13, + 8 + ], + "weighted_loads": [ + 1.02938836440444, + 0.34459464997053146, + 0.5222874209284782, + 1.0329667758196592, + 0.9632086418569088, + 0.49074728414416313, + 1.2791020311415195, + 0.6436189636588097, + 1.575504381209612, + 0.2598721645772457, + 0.7145885219797492, + 1.0860551483929157, + 1.2693374827504158, + 1.7559340335428715, + 5.49661616422236, + 0.5558940321207047, + 1.8892076015472412, + 0.7064202297478914, + 1.2700916100293398, + 0.5108768977224827, + 1.4935174956917763, + 1.115555014461279, + 0.5523605570197105, + 0.8557697907090187, + 0.10448051989078522, + 0.7560736127197742, + 0.3685232475399971, + 0.6311593763530254, + 0.7785749509930611, + 1.217631921172142, + 3.139987487345934, + 0.9914853759109974, + 0.2523207366466522, + 1.498774154111743, + 0.2557620443403721, + 1.6663855277001858, + 0.6108791530132294, + 0.40085021406412125, + 0.09489104151725769, + 1.0159817393869162, + 0.801448006182909, + 1.1235435083508492, + 0.5700932331383228, + 2.7998819053173065, + 1.5987979918718338, + 0.4381323903799057, + 0.9361833445727825, + 1.0994372367858887, + 0.12699494883418083, + 0.5312778688967228, + 0.328101322054863, + 0.7627534531056881, + 1.1215976774692535, + 0.304383534938097, + 1.2756694937124848, + 0.4855695590376854, + 1.0721333995461464, + 1.222295107319951, + 0.28480418771505356, + 0.6173183266073465, + 0.6938019394874573, + 1.5600949302315712, + 0.6619477868080139, + 0.41742290183901787 + ], + "unique_experts": 64, + "load_cv": 0.757336910365484, + "normalized_load_entropy": 0.9508595838302863, + "max_load_share": 0.08089668615984405 + } + }, + "s0_x": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "a0cc88cb963c5e7fde862c5b0cd0f08d5f68084de468b593c70a1163c0a0830c", + "route_weight_sha256": "ad451040c1fda90e7c94742f3fb945316fccd14d7b14d644e35c9a2902e6b6e6", + "loads": [ + 15, + 7, + 10, + 22, + 7, + 10, + 21, + 9, + 16, + 6, + 10, + 20, + 21, + 22, + 83, + 10, + 4, + 17, + 2, + 9, + 16, + 14, + 10, + 8, + 2, + 14, + 8, + 11, + 0, + 17, + 61, + 11, + 7, + 28, + 4, + 11, + 14, + 7, + 2, + 20, + 5, + 27, + 10, + 1, + 17, + 7, + 14, + 2, + 4, + 3, + 6, + 9, + 20, + 0, + 3, + 4, + 8, + 17, + 5, + 6, + 11, + 9, + 1, + 5 + ], + "weighted_loads": [ + 0.8933686688542366, + 0.31326857954263687, + 0.45806747302412987, + 1.030055459588766, + 0.3794524408876896, + 0.4154906775802374, + 1.2807056941092014, + 0.5570128113031387, + 1.005775049328804, + 0.21557321026921272, + 0.6073588952422142, + 1.0669773109257221, + 1.2594920676201582, + 1.7556035034358501, + 5.393722120672464, + 0.4758426249027252, + 0.17396818101406097, + 0.6913199611008167, + 0.06989947333931923, + 0.47065528482198715, + 1.3914095051586628, + 1.0477616004645824, + 0.3977062962949276, + 0.677112240344286, + 0.11035900935530663, + 0.7498304881155491, + 0.28924544155597687, + 0.5858000218868256, + 0.0, + 1.1238317228853703, + 3.072635965421796, + 0.6785190626978874, + 0.2708355411887169, + 1.5496846828609705, + 0.14841413497924805, + 1.1031709648668766, + 0.7013099379837513, + 0.3084392137825489, + 0.09396370872855186, + 0.9570325314998627, + 0.2672029100358486, + 1.1830419600009918, + 0.5443836078047752, + 0.047512542456388474, + 1.4403645917773247, + 0.41112545132637024, + 0.8908492513000965, + 0.08887133002281189, + 0.17356903105974197, + 0.2052832841873169, + 0.3239521346986294, + 0.743460550904274, + 1.1063672602176666, + 0.0, + 0.12904394790530205, + 0.18911590799689293, + 0.6100964620709419, + 1.0924726873636246, + 0.21859082952141762, + 0.2525904104113579, + 0.5360802263021469, + 0.8847599290311337, + 0.05816876143217087, + 0.32013777643442154 + ], + "unique_experts": 62, + "load_cv": 1.049554553144475, + "normalized_load_entropy": 0.9092483668447289, + "max_load_share": 0.1064102564102564 + }, + "full_input": { + "tokens": 155, + "top_k": 6, + "decisions": 930, + "ordered_route_sha256": "06ee415875fa8ab165a1581af8d0e76798c5e581fdac540417371900aaab94fb", + "route_weight_sha256": "ef6ae78654df623887fa8904ea243c022e2d0f3a07de92c9dbf7a3c87b32cc45", + "loads": [ + 15, + 7, + 11, + 22, + 11, + 10, + 21, + 9, + 20, + 8, + 12, + 22, + 21, + 22, + 83, + 16, + 10, + 19, + 14, + 9, + 16, + 14, + 10, + 13, + 2, + 14, + 8, + 13, + 6, + 17, + 67, + 20, + 9, + 28, + 9, + 15, + 14, + 7, + 2, + 20, + 11, + 27, + 10, + 22, + 20, + 7, + 14, + 10, + 4, + 8, + 6, + 9, + 20, + 1, + 6, + 5, + 8, + 17, + 9, + 8, + 11, + 15, + 10, + 6 + ], + "weighted_loads": [ + 0.8933686688542366, + 0.31326857954263687, + 0.5162789039313793, + 1.030055459588766, + 0.5776391886174679, + 0.4154906775802374, + 1.2807056941092014, + 0.5570128113031387, + 1.2186194844543934, + 0.2734842672944069, + 0.6745964614674449, + 1.1087712068110704, + 1.2594920676201582, + 1.7556035034358501, + 5.393722120672464, + 0.7064279168844223, + 0.7708531469106674, + 0.7420055791735649, + 1.334721952676773, + 0.47065528482198715, + 1.3914095051586628, + 1.0477616004645824, + 0.3977062962949276, + 0.9269272051751614, + 0.11035900935530663, + 0.7498304881155491, + 0.28924544155597687, + 0.6422816216945648, + 0.4730096347630024, + 1.1238317228853703, + 3.367636201903224, + 1.0801335200667381, + 0.3358606118708849, + 1.5496846828609705, + 0.39589210227131844, + 1.4344408363103867, + 0.7013099379837513, + 0.3084392137825489, + 0.09396370872855186, + 0.9570325314998627, + 0.5918533280491829, + 1.1830419600009918, + 0.5443836078047752, + 2.0984241478145123, + 1.60440818592906, + 0.41112545132637024, + 0.8908492513000965, + 0.6901837885379791, + 0.17356903105974197, + 0.500209279358387, + 0.3239521346986294, + 0.743460550904274, + 1.1063672602176666, + 0.05452246963977814, + 0.2940062368288636, + 0.23245367035269737, + 0.6100964620709419, + 1.0924726873636246, + 0.41563019156455994, + 0.3561562206596136, + 0.5360802263021469, + 1.2574434839189053, + 0.547170776873827, + 0.35012385807931423 + ], + "unique_experts": 64, + "load_cv": 0.8608143073992975, + "normalized_load_entropy": 0.9402538469033869, + "max_load_share": 0.08924731182795699 + } + }, + "s1_x": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "098d5f4ac1bd73ef7bd5cee215ca63a3149e23794285a1ae0d5bf62f15ed347d", + "route_weight_sha256": "8d00523d949d2d69d1ee149a62d37c15e3616dcaedd32ac61adf1c81021cb60e", + "loads": [ + 15, + 7, + 8, + 20, + 8, + 11, + 21, + 11, + 16, + 6, + 10, + 20, + 26, + 22, + 84, + 9, + 3, + 18, + 3, + 9, + 17, + 14, + 8, + 8, + 2, + 14, + 7, + 11, + 0, + 19, + 49, + 11, + 7, + 28, + 2, + 11, + 12, + 8, + 2, + 21, + 5, + 27, + 11, + 1, + 17, + 7, + 14, + 3, + 2, + 3, + 6, + 10, + 21, + 0, + 3, + 4, + 9, + 19, + 6, + 7, + 12, + 9, + 1, + 5 + ], + "weighted_loads": [ + 0.8912817686796188, + 0.3170347958803177, + 0.39637669548392296, + 0.9387099891901016, + 0.40455131977796555, + 0.4519548509269953, + 1.2805623188614845, + 0.6103434525430202, + 1.0053294710814953, + 0.2227545715868473, + 0.5951873920857906, + 1.0727352015674114, + 1.458573693409562, + 1.761694885790348, + 5.528235623613, + 0.45278601348400116, + 0.13360636681318283, + 0.7236745469272137, + 0.10119466111063957, + 0.47407911717891693, + 1.4410465247929096, + 1.0228977520018816, + 0.32657815888524055, + 0.6803365722298622, + 0.10684434697031975, + 0.7588170785456896, + 0.2586255259811878, + 0.5754325874149799, + 0.0, + 1.173368625342846, + 2.4806849658489227, + 0.6829702518880367, + 0.24568545073270798, + 1.5593703519552946, + 0.07119999825954437, + 1.0550372675061226, + 0.6088470034301281, + 0.36113426089286804, + 0.09447624161839485, + 0.9922478869557381, + 0.24352655187249184, + 1.2088430300354958, + 0.5588612258434296, + 0.04873838648200035, + 1.4806768037378788, + 0.4242273196578026, + 0.8816080316901207, + 0.12685109302401543, + 0.08826469257473946, + 0.20483149588108063, + 0.3343370482325554, + 0.749931737780571, + 1.1500010639429092, + 0.0, + 0.13020985201001167, + 0.18581420928239822, + 0.6373337656259537, + 1.1939036585390568, + 0.24783103168010712, + 0.28967970237135887, + 0.5649696551263332, + 0.858331959694624, + 0.05115588754415512, + 0.31009262055158615 + ], + "unique_experts": 62, + "load_cv": 1.0142832669888737, + "normalized_load_entropy": 0.911982571884564, + "max_load_share": 0.1076923076923077 + }, + "full_input": { + "tokens": 171, + "top_k": 6, + "decisions": 1026, + "ordered_route_sha256": "7cca1aa5cee62b50cea2f5c21a9a3cc2cfbbc0fc8c6df946916f59b3be535031", + "route_weight_sha256": "91aa7fe0040d8c13707c348abd75ea5fe5ea21a1a9da16d8a74b2937090cff56", + "loads": [ + 17, + 8, + 9, + 20, + 18, + 14, + 21, + 13, + 26, + 6, + 13, + 22, + 26, + 22, + 84, + 10, + 22, + 19, + 14, + 10, + 18, + 15, + 10, + 12, + 2, + 14, + 10, + 15, + 10, + 19, + 59, + 19, + 8, + 28, + 6, + 18, + 12, + 8, + 2, + 22, + 11, + 27, + 11, + 27, + 19, + 7, + 15, + 16, + 2, + 8, + 6, + 10, + 21, + 6, + 22, + 11, + 15, + 20, + 9, + 12, + 13, + 18, + 12, + 7 + ], + "weighted_loads": [ + 1.03865085542202, + 0.3506358154118061, + 0.4432429037988186, + 0.9387099891901016, + 0.9549655392765999, + 0.5588176865130663, + 1.2805623188614845, + 0.7391282394528389, + 1.6055018901824951, + 0.2227545715868473, + 0.7044863319024444, + 1.1144895739853382, + 1.458573693409562, + 1.761694885790348, + 5.528235623613, + 0.49266529828310013, + 1.8133804574608803, + 0.7385173812508583, + 1.332911666482687, + 0.5125782899558544, + 1.5141665078699589, + 1.095416458323598, + 0.43920842558145523, + 0.8590492308139801, + 0.10684434697031975, + 0.7588170785456896, + 0.37464669719338417, + 0.7186639830470085, + 0.7846258282661438, + 1.173368625342846, + 2.9612722992897034, + 1.0402273386716843, + 0.2780338414013386, + 1.5593703519552946, + 0.28640059381723404, + 1.6198524497449398, + 0.6088470034301281, + 0.36113426089286804, + 0.09447624161839485, + 1.0389137230813503, + 0.5464380457997322, + 1.2088430300354958, + 0.5588612258434296, + 2.429141916334629, + 1.6151716224849224, + 0.4242273196578026, + 0.9270950369536877, + 1.1384774520993233, + 0.08826469257473946, + 0.5785251371562481, + 0.3343370482325554, + 0.749931737780571, + 1.1500010639429092, + 0.35469575226306915, + 1.2602727366611362, + 0.518311869353056, + 1.109561339020729, + 1.2363360896706581, + 0.39746616780757904, + 0.5206759292632341, + 0.5929457303136587, + 1.3664632625877857, + 0.6441461630165577, + 0.3856322467327118 + ], + "unique_experts": 64, + "load_cv": 0.7509681758735921, + "normalized_load_entropy": 0.9509443862434664, + "max_load_share": 0.08187134502923976 + } + }, + "s0_period": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "313ecfd97fb8c03b333d1b32cfffedfbb38ae20f9d650238895b6e5f6af28745", + "route_weight_sha256": "bc29b87829a59f77706d47e816bd942047029caeaa05d5f17b4a1480b42b4668", + "loads": [ + 15, + 6, + 10, + 21, + 7, + 10, + 21, + 10, + 16, + 4, + 10, + 19, + 22, + 22, + 83, + 9, + 4, + 18, + 1, + 9, + 16, + 14, + 9, + 8, + 2, + 14, + 8, + 10, + 0, + 18, + 59, + 11, + 7, + 28, + 4, + 11, + 13, + 8, + 3, + 20, + 6, + 26, + 10, + 1, + 17, + 7, + 15, + 2, + 4, + 3, + 6, + 10, + 21, + 0, + 3, + 4, + 8, + 17, + 4, + 8, + 12, + 10, + 1, + 5 + ], + "weighted_loads": [ + 0.8893957249820232, + 0.27460287138819695, + 0.4566711336374283, + 0.9813238270580769, + 0.37753015384078026, + 0.4204602278769016, + 1.2758506126701832, + 0.5869789868593216, + 1.0054697170853615, + 0.1488451100885868, + 0.6128949597477913, + 1.0486407652497292, + 1.304477073252201, + 1.7469686456024647, + 5.42802301235497, + 0.44916942343115807, + 0.17224057763814926, + 0.7179459724575281, + 0.04045819118618965, + 0.47369294613599777, + 1.3928133063018322, + 1.0390170514583588, + 0.3612810969352722, + 0.6764899119734764, + 0.10969001427292824, + 0.7450767178088427, + 0.28946221619844437, + 0.5367878526449203, + 0.0, + 1.1799309253692627, + 3.011263797059655, + 0.6707141101360321, + 0.2716701850295067, + 1.5489038154482841, + 0.15237406641244888, + 1.1075772419571877, + 0.6523372866213322, + 0.3477281555533409, + 0.12770061194896698, + 0.9503863845020533, + 0.30443073250353336, + 1.149307943880558, + 0.5424894243478775, + 0.04718881472945213, + 1.4306367635726929, + 0.417465653270483, + 0.9280580691993237, + 0.0875777080655098, + 0.1764565221965313, + 0.2075510174036026, + 0.32904698699712753, + 0.7752968482673168, + 1.1336335763335228, + 0.0, + 0.13406775891780853, + 0.17535629123449326, + 0.6039458401501179, + 1.0861050598323345, + 0.18186036869883537, + 0.33160266652703285, + 0.5647762641310692, + 0.9350570552051067, + 0.05341113731265068, + 0.3153180703520775 + ], + "unique_experts": 62, + "load_cv": 1.0402927823350039, + "normalized_load_entropy": 0.9097818653271651, + "max_load_share": 0.1064102564102564 + }, + "full_input": { + "tokens": 155, + "top_k": 6, + "decisions": 930, + "ordered_route_sha256": "6eb0d1fa61e8c66c249830d421b58dbfa8b9df1ae48594758cc644a795497c0f", + "route_weight_sha256": "60b88bb1dc37ee18188983e397d3d870912df7a0bd3ca90d1e5423ae1cb485f4", + "loads": [ + 15, + 6, + 11, + 21, + 12, + 10, + 21, + 10, + 20, + 6, + 12, + 21, + 22, + 22, + 83, + 16, + 11, + 19, + 13, + 9, + 16, + 14, + 9, + 13, + 2, + 14, + 8, + 12, + 7, + 18, + 65, + 20, + 9, + 28, + 8, + 16, + 13, + 8, + 3, + 20, + 12, + 26, + 10, + 23, + 20, + 7, + 15, + 10, + 4, + 7, + 6, + 10, + 21, + 0, + 6, + 6, + 8, + 17, + 7, + 10, + 12, + 16, + 8, + 6 + ], + "weighted_loads": [ + 0.8893957249820232, + 0.27460287138819695, + 0.5148825645446777, + 0.9813238270580769, + 0.659404169768095, + 0.4204602278769016, + 1.2758506126701832, + 0.5869789868593216, + 1.2207364365458488, + 0.20675616711378098, + 0.680132525973022, + 1.0904346611350775, + 1.304477073252201, + 1.7469686456024647, + 5.42802301235497, + 0.7196862436830997, + 0.8303952179849148, + 0.7327888067811728, + 1.2571794390678406, + 0.47369294613599777, + 1.3928133063018322, + 1.0390170514583588, + 0.3612810969352722, + 0.9263048768043518, + 0.10969001427292824, + 0.7450767178088427, + 0.28946221619844437, + 0.5934299379587173, + 0.5110337249934673, + 1.1799309253692627, + 3.3062640335410833, + 1.0618444867432117, + 0.3366952557116747, + 1.5489038154482841, + 0.32880884036421776, + 1.5726998075842857, + 0.6523372866213322, + 0.3477281555533409, + 0.12770061194896698, + 0.9503863845020533, + 0.6304876860231161, + 1.149307943880558, + 0.5424894243478775, + 2.176481492817402, + 1.5946803577244282, + 0.417465653270483, + 0.9280580691993237, + 0.6890718713402748, + 0.1764565221965313, + 0.46128662675619125, + 0.32904698699712753, + 0.7752968482673168, + 1.1336335763335228, + 0.0, + 0.2990300478413701, + 0.2584594674408436, + 0.6039458401501179, + 1.0861050598323345, + 0.3191162198781967, + 0.4317063260823488, + 0.5647762641310692, + 1.3090034127235413, + 0.47404172271490097, + 0.3446196783334017 + ], + "unique_experts": 63, + "load_cv": 0.85304267942838, + "normalized_load_entropy": 0.9402385513650188, + "max_load_share": 0.08924731182795699 + } + }, + "s1_period": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "26936a70e1b177107943bd35ae6963ac27c374e83cbb419892f0d8b5aa21b34d", + "route_weight_sha256": "913496fdc67f0b314194c69b10b7797f94b5ccf224a0f3c8434b1dba949fd2ae", + "loads": [ + 15, + 7, + 10, + 20, + 8, + 10, + 21, + 9, + 16, + 6, + 10, + 22, + 26, + 22, + 83, + 8, + 3, + 19, + 3, + 9, + 16, + 14, + 8, + 8, + 2, + 14, + 7, + 10, + 1, + 19, + 50, + 11, + 9, + 27, + 3, + 11, + 13, + 9, + 2, + 21, + 4, + 24, + 10, + 1, + 17, + 7, + 15, + 3, + 2, + 3, + 6, + 10, + 20, + 0, + 3, + 3, + 9, + 21, + 7, + 8, + 10, + 9, + 1, + 5 + ], + "weighted_loads": [ + 0.8931042701005936, + 0.310508631169796, + 0.47221391275525093, + 0.9390660710632801, + 0.401818685233593, + 0.42510546557605267, + 1.2802657969295979, + 0.5491201356053352, + 1.0029610395431519, + 0.22390731424093246, + 0.6020685285329819, + 1.1392857693135738, + 1.4874028507620096, + 1.7556804455816746, + 5.44695682823658, + 0.4075525775551796, + 0.13375040516257286, + 0.7533972319215536, + 0.10089068487286568, + 0.47442248836159706, + 1.3886378780007362, + 1.0343086458742619, + 0.32487767189741135, + 0.6759494282305241, + 0.10646598041057587, + 0.7546341922134161, + 0.2641470395028591, + 0.5252705514431, + 0.03459404781460762, + 1.177664801478386, + 2.4854824040085077, + 0.6856370717287064, + 0.3113225232809782, + 1.4990508258342743, + 0.11326036974787712, + 1.0567993149161339, + 0.648536991328001, + 0.40910375118255615, + 0.08934443071484566, + 1.0007658880203962, + 0.2146284282207489, + 1.0811530873179436, + 0.5297509469091892, + 0.04657541215419769, + 1.4812885001301765, + 0.4252201598137617, + 0.9233109392225742, + 0.12835101783275604, + 0.09165135398507118, + 0.20449934527277946, + 0.339956846088171, + 0.7513747029006481, + 1.1154464334249496, + 0.0, + 0.1313759796321392, + 0.14497825503349304, + 0.6279266476631165, + 1.264836598187685, + 0.27989850752055645, + 0.3368752710521221, + 0.5029001832008362, + 0.8606677390635014, + 0.05045413598418236, + 0.3101663403213024 + ], + "unique_experts": 63, + "load_cv": 1.0061611646666582, + "normalized_load_entropy": 0.9138443836659178, + "max_load_share": 0.1064102564102564 + }, + "full_input": { + "tokens": 171, + "top_k": 6, + "decisions": 1026, + "ordered_route_sha256": "eee9a26c7533cf11d8d2d4c07ac7c1d46249364edf929e0ebdf7bd0fc7c88185", + "route_weight_sha256": "b7dc2b3438ff7affe7ff87851dd22f05915c1904a97dfbc894aa2e1bae4a1480", + "loads": [ + 17, + 8, + 11, + 20, + 19, + 15, + 21, + 11, + 26, + 6, + 13, + 24, + 26, + 22, + 84, + 11, + 22, + 20, + 13, + 10, + 17, + 15, + 10, + 12, + 2, + 14, + 10, + 13, + 12, + 19, + 59, + 18, + 10, + 27, + 7, + 18, + 13, + 9, + 2, + 22, + 9, + 24, + 10, + 27, + 19, + 7, + 16, + 16, + 2, + 8, + 6, + 10, + 20, + 5, + 22, + 10, + 15, + 22, + 9, + 14, + 10, + 18, + 11, + 8 + ], + "weighted_loads": [ + 1.0404733568429947, + 0.3441096507012844, + 0.5190801210701466, + 0.9390660710632801, + 1.024177797138691, + 0.6045790910720825, + 1.2802657969295979, + 0.6779049225151539, + 1.6011699475347996, + 0.22390731424093246, + 0.7113674683496356, + 1.1810401417315006, + 1.4874028507620096, + 1.7556804455816746, + 5.486689679324627, + 0.5146962478756905, + 1.8167947381734848, + 0.7682400662451982, + 1.2569362707436085, + 0.5129216611385345, + 1.4617578610777855, + 1.1068273521959782, + 0.437507938593626, + 0.854662086814642, + 0.10646598041057587, + 0.7546341922134161, + 0.3830227814614773, + 0.6208323873579502, + 0.8737907037138939, + 1.177664801478386, + 2.934631923213601, + 0.9939270913600922, + 0.3436709139496088, + 1.4990508258342743, + 0.31968728452920914, + 1.6717081405222416, + 0.648536991328001, + 0.40910375118255615, + 0.08934443071484566, + 1.0474317241460085, + 0.48200294747948647, + 1.0811530873179436, + 0.5297509469091892, + 2.4372449330985546, + 1.6157833188772202, + 0.4252201598137617, + 0.9687979444861412, + 1.1471073664724827, + 0.09165135398507118, + 0.5679879151284695, + 0.339956846088171, + 0.7513747029006481, + 1.1154464334249496, + 0.304383534938097, + 1.2657326916232705, + 0.47747591510415077, + 1.1001542210578918, + 1.3072690293192863, + 0.3816785831004381, + 0.5918797925114632, + 0.5029001832008362, + 1.3616078235208988, + 0.5832766480743885, + 0.41644478030502796 + ], + "unique_experts": 64, + "load_cv": 0.7484542472625282, + "normalized_load_entropy": 0.9514054376707933, + "max_load_share": 0.08187134502923976 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 130, + "ordered_topk_exact_tokens": 95, + "set_exact_tokens": 112, + "mean_set_jaccard": 0.9604395604395606, + "mean_token_weighted_tv": 0.008859848976135254, + "aggregate_load_tv": 0.016666666666666673 + }, + "system_bos": { + "tokens": 130, + "ordered_topk_exact_tokens": 80, + "set_exact_tokens": 98, + "mean_set_jaccard": 0.9280219780219781, + "mean_token_weighted_tv": 0.01471719963189501, + "aggregate_load_tv": 0.026923076923076918 + }, + "system_x": { + "tokens": 130, + "ordered_topk_exact_tokens": 67, + "set_exact_tokens": 88, + "mean_set_jaccard": 0.9060439560439559, + "mean_token_weighted_tv": 0.018695281660900665, + "aggregate_load_tv": 0.034615384615384624 + }, + "system_period": { + "tokens": 130, + "ordered_topk_exact_tokens": 65, + "set_exact_tokens": 86, + "mean_set_jaccard": 0.9016483516483517, + "mean_token_weighted_tv": 0.019479053933173417, + "aggregate_load_tv": 0.03717948717948718 + }, + "bos_at_s0": { + "tokens": 130, + "ordered_topk_exact_tokens": 84, + "set_exact_tokens": 96, + "mean_set_jaccard": 0.9236263736263736, + "mean_token_weighted_tv": 0.015679436442084038, + "aggregate_load_tv": 0.026923076923076928 + }, + "bos_at_s1": { + "tokens": 130, + "ordered_topk_exact_tokens": 76, + "set_exact_tokens": 97, + "mean_set_jaccard": 0.9274725274725275, + "mean_token_weighted_tv": 0.015948381919700366, + "aggregate_load_tv": 0.026923076923076925 + }, + "x_at_s0": { + "tokens": 130, + "ordered_topk_exact_tokens": 75, + "set_exact_tokens": 95, + "mean_set_jaccard": 0.9230769230769232, + "mean_token_weighted_tv": 0.01713335271208332, + "aggregate_load_tv": 0.03076923076923077 + }, + "x_at_s1": { + "tokens": 130, + "ordered_topk_exact_tokens": 65, + "set_exact_tokens": 83, + "mean_set_jaccard": 0.8934065934065933, + "mean_token_weighted_tv": 0.021968402133251613, + "aggregate_load_tv": 0.03461538461538462 + }, + "period_at_s0": { + "tokens": 130, + "ordered_topk_exact_tokens": 68, + "set_exact_tokens": 88, + "mean_set_jaccard": 0.9076923076923077, + "mean_token_weighted_tv": 0.018601878481702163, + "aggregate_load_tv": 0.028205128205128202 + }, + "period_at_s1": { + "tokens": 130, + "ordered_topk_exact_tokens": 62, + "set_exact_tokens": 82, + "mean_set_jaccard": 0.8912087912087913, + "mean_token_weighted_tv": 0.022132435312064793, + "aggregate_load_tv": 0.039743589743589755 + } + } + }, + "layer_12": { + "layer": 12, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "934d8df3c56af1d9664710f84848304407d2a7012c1aeb1067dc5b5addd0b62a", + "route_weight_sha256": "0015940ec00b86d95ed26594dade8e79a3bd9a5b699a2959b2cad442d3c35c7e", + "loads": [ + 9, + 12, + 9, + 10, + 5, + 17, + 95, + 15, + 6, + 8, + 9, + 13, + 4, + 6, + 13, + 15, + 4, + 18, + 20, + 9, + 7, + 18, + 13, + 11, + 3, + 22, + 4, + 13, + 1, + 3, + 5, + 6, + 7, + 16, + 13, + 10, + 11, + 16, + 3, + 14, + 20, + 1, + 6, + 5, + 6, + 7, + 8, + 2, + 8, + 27, + 18, + 14, + 24, + 15, + 10, + 7, + 15, + 10, + 7, + 14, + 11, + 7, + 23, + 22 + ], + "weighted_loads": [ + 0.6406122148036957, + 0.4871834274381399, + 0.5023453384637833, + 0.5686284936964512, + 0.1926863193511963, + 0.8789227120578289, + 6.220667265355587, + 0.8743859231472015, + 0.32503044605255127, + 0.3446260020136833, + 0.6167571246623993, + 0.6441349610686302, + 0.1924915499985218, + 0.27352821826934814, + 0.47107733227312565, + 1.0436060298234224, + 0.35757148638367653, + 1.164178667590022, + 1.2423903420567513, + 0.4362417235970497, + 0.349963765591383, + 1.0830070283263922, + 0.7901705950498581, + 0.457207627594471, + 0.11170533113181591, + 1.2045499086380005, + 0.1296721938997507, + 0.9321387447416782, + 0.03674708306789398, + 0.17505833506584167, + 0.20177555829286575, + 0.29595881700515747, + 0.26117007061839104, + 0.9042490124702454, + 0.7803693227469921, + 0.37424394488334656, + 0.47888904996216297, + 0.9555792286992073, + 0.161686260253191, + 0.7742200084030628, + 0.9684686977416277, + 0.02987317182123661, + 0.299050010740757, + 0.2846666984260082, + 0.27858562767505646, + 0.4099707007408142, + 0.4595039002597332, + 0.07365630939602852, + 0.34401316568255424, + 1.6549491453915834, + 1.8292826637625694, + 1.205093890428543, + 1.4080740101635456, + 0.7494771182537079, + 0.4141843318939209, + 0.2919306084513664, + 0.631548535078764, + 0.438944298774004, + 0.2639074996113777, + 0.5646083187311888, + 0.5414453018456697, + 0.3033035844564438, + 0.943596463650465, + 1.12025361135602 + ], + "unique_experts": 64, + "load_cv": 0.9880149644715529, + "normalized_load_entropy": 0.9302961397184806, + "max_load_share": 0.12179487179487179 + }, + "full_input": { + "tokens": 155, + "top_k": 6, + "decisions": 930, + "ordered_route_sha256": "9283758184f36302f270614083d4e01c58e6f7e7c92e36866d4349f97f848cd3", + "route_weight_sha256": "94049ad9c4a126974ab2ad1d31f87a8205fc4aedd214abfa29c83200bcc67aa6", + "loads": [ + 9, + 12, + 9, + 15, + 9, + 18, + 95, + 17, + 11, + 8, + 9, + 13, + 9, + 6, + 13, + 15, + 6, + 18, + 20, + 9, + 8, + 19, + 15, + 16, + 3, + 22, + 5, + 20, + 16, + 14, + 8, + 11, + 9, + 18, + 13, + 17, + 11, + 20, + 17, + 14, + 20, + 6, + 11, + 7, + 7, + 8, + 9, + 7, + 11, + 27, + 19, + 14, + 24, + 15, + 10, + 7, + 19, + 10, + 8, + 18, + 11, + 12, + 27, + 26 + ], + "weighted_loads": [ + 0.6406122148036957, + 0.4871834274381399, + 0.5023453384637833, + 0.6941306774970144, + 1.8097015898674726, + 0.8829647130332887, + 6.220667265355587, + 0.9896773062646389, + 0.8017688672989607, + 0.3446260020136833, + 0.6167571246623993, + 0.6441349610686302, + 0.46794218569993973, + 0.27352821826934814, + 0.47107733227312565, + 1.0436060298234224, + 0.4688781090080738, + 1.164178667590022, + 1.2423903420567513, + 0.4362417235970497, + 0.3522801280487329, + 1.122679864987731, + 0.9008038900792599, + 0.9129914306104183, + 0.11170533113181591, + 1.2045499086380005, + 0.16254269145429134, + 1.327395835891366, + 1.9455133453011513, + 1.773059368133545, + 0.30860695615410805, + 0.5474802851676941, + 0.3501834124326706, + 1.007233176380396, + 0.7803693227469921, + 0.8714572191238403, + 0.47888904996216297, + 1.0691318660974503, + 1.3609843216836452, + 0.7742200084030628, + 0.9684686977416277, + 0.48336455784738064, + 0.6299728341400623, + 0.3988758772611618, + 0.3280927687883377, + 0.44929731637239456, + 0.5092282481491566, + 0.3374515511095524, + 0.4875074476003647, + 1.6549491453915834, + 1.8422259874641895, + 1.205093890428543, + 1.4080740101635456, + 0.7494771182537079, + 0.4141843318939209, + 0.2919306084513664, + 0.8467281246557832, + 0.438944298774004, + 0.33537304401397705, + 0.7083131400868297, + 0.5414453018456697, + 0.5457086805254221, + 1.0919861812144518, + 1.2466385588049889 + ], + "unique_experts": 64, + "load_cv": 0.7967067143076944, + "normalized_load_entropy": 0.9544439488130778, + "max_load_share": 0.10215053763440861 + } + }, + "s1_eos": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "d91b6dcc4969c74e9420c6384fc8f15bab971e3a0332ee7ab828ee856416daf0", + "route_weight_sha256": "65378c7dc8afe10e8ce45e593db0ecd9ecc5472bd906888458e8c02bd4360075", + "loads": [ + 8, + 11, + 9, + 11, + 5, + 17, + 96, + 15, + 6, + 7, + 10, + 13, + 6, + 6, + 12, + 15, + 3, + 18, + 20, + 10, + 6, + 16, + 14, + 11, + 2, + 22, + 3, + 13, + 1, + 3, + 4, + 6, + 7, + 16, + 13, + 10, + 10, + 17, + 3, + 15, + 21, + 1, + 6, + 5, + 5, + 7, + 7, + 2, + 8, + 28, + 18, + 14, + 24, + 15, + 9, + 8, + 14, + 11, + 7, + 15, + 12, + 7, + 24, + 22 + ], + "weighted_loads": [ + 0.612674955278635, + 0.44962457939982414, + 0.4987436830997467, + 0.6053087934851646, + 0.19496063515543938, + 0.8818661794066429, + 6.2542069386690855, + 0.8757918551564217, + 0.32934311404824257, + 0.31754541769623756, + 0.6571293920278549, + 0.6444610077887774, + 0.25450751185417175, + 0.2743806093931198, + 0.4361135922372341, + 1.0472667403519154, + 0.33635201305150986, + 1.1783364061266184, + 1.226177655160427, + 0.4721456803381443, + 0.3241273872554302, + 1.024301439523697, + 0.8196472749114037, + 0.45808621868491173, + 0.07777764648199081, + 1.19854349270463, + 0.09537309966981411, + 0.9501678980886936, + 0.0365697480738163, + 0.17393745854496956, + 0.14108827337622643, + 0.29938526451587677, + 0.25502970814704895, + 0.8975384421646595, + 0.7720516957342625, + 0.3751465491950512, + 0.45675369910895824, + 0.9829082898795605, + 0.1650569811463356, + 0.8027863316237926, + 1.0141820646822453, + 0.029698586091399193, + 0.3024456314742565, + 0.2800576686859131, + 0.251257149502635, + 0.41356290876865387, + 0.442440127953887, + 0.06887287274003029, + 0.33285821601748466, + 1.7431654334068298, + 1.8386268690228462, + 1.2049169968813658, + 1.412949275225401, + 0.7574297524988651, + 0.387624591588974, + 0.32082903757691383, + 0.605205187574029, + 0.4688688311725855, + 0.26203469932079315, + 0.5942812971770763, + 0.5693328026682138, + 0.3059920333325863, + 0.9701549671590328, + 1.1149827986955643 + ], + "unique_experts": 64, + "load_cv": 1.004172753629648, + "normalized_load_entropy": 0.9274882708343908, + "max_load_share": 0.12307692307692308 + }, + "full_input": { + "tokens": 171, + "top_k": 6, + "decisions": 1026, + "ordered_route_sha256": "fc1ccf745c146b33054c899d43b79bbc60870128eec13d47f602a091b7fd47a4", + "route_weight_sha256": "9c3e27de207811e09bccec7b814a6a34158acdc48adfab9476c59a3ed1a3db0e", + "loads": [ + 12, + 11, + 9, + 14, + 9, + 18, + 96, + 21, + 12, + 10, + 11, + 13, + 10, + 6, + 12, + 15, + 6, + 20, + 21, + 10, + 7, + 19, + 17, + 17, + 2, + 22, + 6, + 20, + 18, + 19, + 15, + 11, + 11, + 21, + 18, + 17, + 10, + 21, + 21, + 15, + 22, + 12, + 14, + 9, + 18, + 11, + 10, + 8, + 14, + 28, + 20, + 14, + 24, + 18, + 9, + 9, + 18, + 16, + 8, + 20, + 14, + 16, + 29, + 22 + ], + "weighted_loads": [ + 0.8021316602826118, + 0.44962457939982414, + 0.4987436830997467, + 0.6614352266769856, + 1.8207451067864895, + 0.885772857349366, + 6.2542069386690855, + 1.1723739765584469, + 0.940500445663929, + 0.6392566226422787, + 0.7009369842708111, + 0.6444610077887774, + 0.4705827832221985, + 0.2743806093931198, + 0.4361135922372341, + 1.0472667403519154, + 0.5565104261040688, + 1.2912224289029837, + 1.2619277201592922, + 0.4721456803381443, + 0.32645806949585676, + 1.1568646132946014, + 0.9722749814391136, + 0.9148694090545177, + 0.07777764648199081, + 1.19854349270463, + 0.21625026501715183, + 1.3111325316131115, + 2.242589458823204, + 2.578213881701231, + 1.0021016001701355, + 0.5344975274056196, + 0.4325004741549492, + 1.2021985203027725, + 1.0272748172283173, + 0.9392620474100113, + 0.45675369910895824, + 1.1563471890985966, + 1.63352669775486, + 0.8027863316237926, + 1.044027779251337, + 0.9690095987170935, + 0.7607959993183613, + 0.5015860460698605, + 1.4444604571908712, + 0.72508729621768, + 0.5790032017976046, + 0.3844708502292633, + 0.6231376938521862, + 1.7431654334068298, + 1.9036504365503788, + 1.2049169968813658, + 1.412949275225401, + 0.9119430892169476, + 0.387624591588974, + 0.3521319106221199, + 0.7966066696681082, + 0.6893227901309729, + 0.33623550832271576, + 0.763598027639091, + 0.6380753684788942, + 0.7887496165931225, + 1.1915493197739124, + 1.1149827986955643 + ], + "unique_experts": 64, + "load_cv": 0.7176004940704851, + "normalized_load_entropy": 0.961338545946751, + "max_load_share": 0.0935672514619883 + } + }, + "s0_bos": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "53812be88a4cc038a2f6a2d14876dbcd4f83219acf2f18e5d16e046324ddd801", + "route_weight_sha256": "bd054a6b54e5cf9f7d3ab4da9bb1133dad02472e31969ccb8557dc9a2c627923", + "loads": [ + 8, + 11, + 9, + 12, + 6, + 19, + 93, + 15, + 6, + 8, + 8, + 12, + 5, + 6, + 12, + 15, + 4, + 20, + 20, + 9, + 7, + 17, + 12, + 9, + 2, + 21, + 6, + 13, + 1, + 4, + 5, + 8, + 5, + 17, + 13, + 10, + 11, + 16, + 1, + 15, + 21, + 1, + 6, + 5, + 4, + 7, + 7, + 2, + 9, + 29, + 18, + 15, + 26, + 15, + 11, + 7, + 15, + 12, + 7, + 14, + 10, + 8, + 21, + 19 + ], + "weighted_loads": [ + 0.6112140230834484, + 0.4667751416563988, + 0.5012313462793827, + 0.6412215251475573, + 0.2244383879005909, + 0.9338156320154667, + 6.0499828308820724, + 0.8742821030318737, + 0.33663284592330456, + 0.3469711672514677, + 0.5666071809828281, + 0.6186507306993008, + 0.2344096191227436, + 0.28144316002726555, + 0.44118269719183445, + 1.053451156243682, + 0.3616965636610985, + 1.2504137009382248, + 1.2442132495343685, + 0.44581112638115883, + 0.3534745089709759, + 1.0572377666831017, + 0.7464976422488689, + 0.3703530728816986, + 0.07975549250841141, + 1.145197106525302, + 0.19227747805416584, + 0.9266266413033009, + 0.03463605046272278, + 0.21647311747074127, + 0.19712083972990513, + 0.3674555532634258, + 0.19825223460793495, + 0.9573267549276352, + 0.7583600021898746, + 0.3625609315931797, + 0.47223743237555027, + 0.9507454372942448, + 0.09384098649024963, + 0.8060094714164734, + 1.0192865654826164, + 0.03204771503806114, + 0.30438100919127464, + 0.2872440069913864, + 0.21536079794168472, + 0.41411928087472916, + 0.41824652068316936, + 0.07550204545259476, + 0.3854595012962818, + 1.7320778779685497, + 1.8628335073590279, + 1.201465291902423, + 1.4790575057268143, + 0.7437833938747644, + 0.45392027869820595, + 0.2881638128310442, + 0.642828680574894, + 0.5151100289076567, + 0.2604740783572197, + 0.5621481966227293, + 0.4954501800239086, + 0.35506047308444977, + 0.9049666933715343, + 1.0168800074607134 + ], + "unique_experts": 64, + "load_cv": 0.9761252546781651, + "normalized_load_entropy": 0.9299662329929029, + "max_load_share": 0.11923076923076924 + }, + "full_input": { + "tokens": 155, + "top_k": 6, + "decisions": 930, + "ordered_route_sha256": "806a8d31327621ee35db1f183bb46eef8687fe7a161d49fb15f61b9939994ed0", + "route_weight_sha256": "6500c1fd3d43c630165335d06549b4b8eeb04d397f8996575a121fe3c55ff635", + "loads": [ + 8, + 11, + 9, + 16, + 9, + 19, + 93, + 17, + 12, + 8, + 8, + 12, + 11, + 6, + 12, + 15, + 8, + 20, + 20, + 9, + 7, + 18, + 14, + 14, + 2, + 21, + 8, + 20, + 17, + 14, + 7, + 13, + 7, + 19, + 13, + 17, + 11, + 20, + 15, + 15, + 21, + 6, + 10, + 7, + 6, + 8, + 8, + 6, + 13, + 29, + 19, + 15, + 26, + 15, + 11, + 7, + 18, + 13, + 8, + 18, + 10, + 13, + 25, + 23 + ], + "weighted_loads": [ + 0.6112140230834484, + 0.4667751416563988, + 0.5012313462793827, + 0.7636400479823351, + 0.8909059632569551, + 0.9338156320154667, + 6.0499828308820724, + 0.9933280348777771, + 0.8927659504115582, + 0.3469711672514677, + 0.5666071809828281, + 0.6186507306993008, + 0.5772485993802547, + 0.28144316002726555, + 0.44118269719183445, + 1.053451156243682, + 0.5222011245787144, + 1.2504137009382248, + 1.2442132495343685, + 0.44581112638115883, + 0.3534745089709759, + 1.0994814597070217, + 0.8553170412778854, + 0.826136875897646, + 0.07975549250841141, + 1.145197106525302, + 0.26770121790468693, + 1.3218837324529886, + 1.9413900822401047, + 1.893502488732338, + 0.2608391847461462, + 0.6204786039888859, + 0.28632842749357224, + 1.0618624426424503, + 0.7583600021898746, + 0.8597742058336735, + 0.47223743237555027, + 1.0642980746924877, + 1.3775492459535599, + 0.8060094714164734, + 1.0192865654826164, + 0.4974951967597008, + 0.5961571410298347, + 0.3881273791193962, + 0.30735674127936363, + 0.4534458965063095, + 0.4651321340352297, + 0.29939305782318115, + 0.5545654743909836, + 1.7320778779685497, + 1.875776831060648, + 1.201465291902423, + 1.4790575057268143, + 0.7437833938747644, + 0.45392027869820595, + 0.2881638128310442, + 0.8431412111967802, + 0.5569301787763834, + 0.33205287903547287, + 0.7574182190001011, + 0.4954501800239086, + 0.5939881596714258, + 1.0533564109355211, + 1.1432649549096823 + ], + "unique_experts": 64, + "load_cv": 0.7831235281869944, + "normalized_load_entropy": 0.9549080386621405, + "max_load_share": 0.1 + } + }, + "s1_bos": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "cb921cf27182c0b635b90f62be40f64d367cda61f4da26abf9cd09c9a12382da", + "route_weight_sha256": "fa4e29b96747113de5a2a74b2c46d1a2392114df3a48034ddede8e3018c04cee", + "loads": [ + 11, + 10, + 9, + 11, + 5, + 17, + 96, + 15, + 6, + 9, + 10, + 12, + 4, + 6, + 13, + 15, + 3, + 16, + 20, + 10, + 6, + 17, + 12, + 9, + 2, + 21, + 3, + 13, + 1, + 4, + 4, + 8, + 7, + 18, + 13, + 10, + 10, + 17, + 2, + 14, + 21, + 1, + 5, + 6, + 4, + 7, + 7, + 2, + 12, + 28, + 20, + 14, + 26, + 15, + 12, + 8, + 14, + 11, + 7, + 12, + 10, + 7, + 22, + 20 + ], + "weighted_loads": [ + 0.7175505496561527, + 0.4180538486689329, + 0.49242133647203445, + 0.6065321359783411, + 0.1912114918231964, + 0.8368985634297132, + 6.214555013924837, + 0.8746385537087917, + 0.33920600078999996, + 0.3782114591449499, + 0.638601440936327, + 0.6163946483284235, + 0.19322410970926285, + 0.2799347825348377, + 0.46767842024564743, + 1.05720598064363, + 0.32693885266780853, + 1.0958127826452255, + 1.2337670512497425, + 0.49308618530631065, + 0.3219931535422802, + 1.0478427316993475, + 0.7441959455609322, + 0.3764946311712265, + 0.07878384180366993, + 1.1600211709737778, + 0.09956883266568184, + 0.9404647089540958, + 0.03455686941742897, + 0.22971194609999657, + 0.1621406003832817, + 0.36644477397203445, + 0.25264024920761585, + 0.9849581737071276, + 0.7696177735924721, + 0.3639187216758728, + 0.44875575974583626, + 0.9841587543487549, + 0.1373257413506508, + 0.7710798569023609, + 1.012021902948618, + 0.03725360333919525, + 0.2672709487378597, + 0.3183099590241909, + 0.22435513883829117, + 0.40442056581377983, + 0.4362216889858246, + 0.07179347053170204, + 0.4793533980846405, + 1.701071623712778, + 1.9268042482435703, + 1.1571365259587765, + 1.4821678586304188, + 0.7410301249474287, + 0.4802286457270384, + 0.31882596015930176, + 0.6216646004468203, + 0.4788931291550398, + 0.2538864742964506, + 0.49844357185065746, + 0.5023996252566576, + 0.3026021495461464, + 0.9322159290313721, + 1.0390923619270325 + ], + "unique_experts": 64, + "load_cv": 1.0018654526795736, + "normalized_load_entropy": 0.9277990900015323, + "max_load_share": 0.12307692307692308 + }, + "full_input": { + "tokens": 171, + "top_k": 6, + "decisions": 1026, + "ordered_route_sha256": "10df83a37a24f960b78774d4bd11fe69182596494580f4e381b4f8c8fed08326", + "route_weight_sha256": "e3b6e5e8865cf65a9b252fa4c4703dc91f00132430f3067d6755202bc5852fb2", + "loads": [ + 15, + 10, + 9, + 13, + 8, + 17, + 96, + 21, + 12, + 12, + 11, + 12, + 9, + 6, + 13, + 15, + 7, + 18, + 21, + 10, + 6, + 19, + 15, + 15, + 2, + 21, + 6, + 20, + 18, + 22, + 15, + 13, + 11, + 23, + 18, + 17, + 10, + 21, + 20, + 14, + 22, + 12, + 11, + 10, + 17, + 11, + 10, + 8, + 20, + 28, + 22, + 14, + 26, + 18, + 12, + 9, + 17, + 17, + 8, + 17, + 12, + 16, + 28, + 20 + ], + "weighted_loads": [ + 0.9070072546601295, + 0.4180538486689329, + 0.49242133647203445, + 0.6597283650189638, + 0.8664342612028122, + 0.8368985634297132, + 6.214555013924837, + 1.174698755145073, + 1.0242733601480722, + 0.699922664090991, + 0.6824090331792831, + 0.6163946483284235, + 0.4839777760207653, + 0.2799347825348377, + 0.46767842024564743, + 1.05720598064363, + 0.5820094235241413, + 1.2086988054215908, + 1.2695171162486076, + 0.49308618530631065, + 0.3219931535422802, + 1.1373876761645079, + 0.8897650390863419, + 0.8332778215408325, + 0.07878384180366993, + 1.1600211709737778, + 0.22044599801301956, + 1.3014293424785137, + 2.352221228182316, + 2.8762811198830605, + 1.0231539271771908, + 0.595373960211873, + 0.4301110152155161, + 1.2844726797193289, + 1.0248408950865269, + 0.9280342198908329, + 0.44875575974583626, + 1.157597653567791, + 1.7184736095368862, + 0.7710798569023609, + 1.0418676175177097, + 0.9779745116829872, + 0.65097601339221, + 0.525282233953476, + 1.4190838932991028, + 0.7159449532628059, + 0.5694234855473042, + 0.39255044609308243, + 0.8398836329579353, + 1.701071623712778, + 1.991827815771103, + 1.1571365259587765, + 1.4821678586304188, + 0.8955434616655111, + 0.4802286457270384, + 0.35012883320450783, + 0.7862882502377033, + 0.7427815031260252, + 0.3290906008332968, + 0.698246780782938, + 0.571142191067338, + 0.7839201912283897, + 1.1939407177269459, + 1.0390923619270325 + ], + "unique_experts": 64, + "load_cv": 0.7176852123033475, + "normalized_load_entropy": 0.9613761176133385, + "max_load_share": 0.0935672514619883 + } + }, + "s0_x": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "8eed289b07b8621bf88078d0ca4eaf4b4d8b06df9f5027020ccad4ab534d7d8e", + "route_weight_sha256": "70951f608c693af5a272d094862cde54621c80cabdd14630ca4cf174785837d7", + "loads": [ + 11, + 11, + 9, + 11, + 5, + 19, + 95, + 15, + 6, + 8, + 8, + 12, + 4, + 6, + 11, + 15, + 4, + 19, + 20, + 9, + 7, + 17, + 12, + 10, + 3, + 23, + 4, + 12, + 1, + 3, + 5, + 8, + 7, + 16, + 14, + 10, + 8, + 16, + 2, + 16, + 21, + 1, + 6, + 6, + 7, + 7, + 7, + 2, + 9, + 26, + 18, + 15, + 25, + 15, + 12, + 7, + 15, + 10, + 7, + 13, + 11, + 9, + 21, + 18 + ], + "weighted_loads": [ + 0.7078747320920229, + 0.46359943225979805, + 0.5023700185120106, + 0.5979205314069986, + 0.19550715759396553, + 0.9414734300225973, + 6.187710260972381, + 0.8780669309198856, + 0.33848096802830696, + 0.34951149486005306, + 0.575118899345398, + 0.6106312163174152, + 0.18760094419121742, + 0.29732419550418854, + 0.40906369499862194, + 1.0539605915546417, + 0.35075514018535614, + 1.1960323806852102, + 1.2549599893391132, + 0.4510347880423069, + 0.35294369608163834, + 1.0179434847086668, + 0.7426857873797417, + 0.42469752952456474, + 0.11840034835040569, + 1.2309284433722496, + 0.13000128977000713, + 0.9025772027671337, + 0.035358257591724396, + 0.21052223816514015, + 0.18982206284999847, + 0.3747965954244137, + 0.2557483073323965, + 0.900102324783802, + 0.8022499084472656, + 0.3610202483832836, + 0.377497810870409, + 0.9578868597745895, + 0.14125032350420952, + 0.8452391922473907, + 1.0334194339811802, + 0.038420386612415314, + 0.30676706321537495, + 0.3287472277879715, + 0.32666472904384136, + 0.42224614322185516, + 0.42877501621842384, + 0.07330448925495148, + 0.3728298991918564, + 1.6038994789123535, + 1.8435072414577007, + 1.1889070644974709, + 1.446626827120781, + 0.7431317046284676, + 0.4898766875267029, + 0.290425194427371, + 0.6621491052210331, + 0.4520154148340225, + 0.26458417624235153, + 0.5098623614758253, + 0.5332807432860136, + 0.3890916518867016, + 0.89181855507195, + 0.9821448717266321 + ], + "unique_experts": 64, + "load_cv": 0.9849224948398486, + "normalized_load_entropy": 0.9308577314069651, + "max_load_share": 0.12179487179487179 + }, + "full_input": { + "tokens": 155, + "top_k": 6, + "decisions": 930, + "ordered_route_sha256": "eb6b2105495e69f5d49400a86b92af28582b4c06f0ee5898d0087ba6fd25924a", + "route_weight_sha256": "e2f21a46158fbf90d026af997681739ae7d8f90edf5aec1dd91a8b807e45e33e", + "loads": [ + 11, + 11, + 9, + 15, + 8, + 19, + 95, + 18, + 12, + 8, + 8, + 12, + 9, + 6, + 11, + 15, + 5, + 19, + 20, + 9, + 7, + 18, + 14, + 16, + 3, + 23, + 5, + 20, + 18, + 13, + 8, + 13, + 9, + 18, + 14, + 18, + 8, + 20, + 16, + 16, + 21, + 5, + 10, + 8, + 9, + 9, + 8, + 6, + 13, + 26, + 19, + 15, + 25, + 15, + 12, + 7, + 18, + 10, + 8, + 16, + 11, + 15, + 25, + 22 + ], + "weighted_loads": [ + 0.7078747320920229, + 0.46359943225979805, + 0.5023700185120106, + 0.7203390542417765, + 0.8619747329503298, + 0.9414734300225973, + 6.187710260972381, + 1.037774246186018, + 0.8489578235894442, + 0.34951149486005306, + 0.575118899345398, + 0.6106312163174152, + 0.4587397798895836, + 0.29732419550418854, + 0.40906369499862194, + 1.0539605915546417, + 0.41921426355838776, + 1.1960323806852102, + 1.2549599893391132, + 0.4510347880423069, + 0.35294369608163834, + 1.0622743982821703, + 0.8533629104495049, + 1.0304888784885406, + 0.11840034835040569, + 1.2309284433722496, + 0.16287178732454777, + 1.3549188580363989, + 2.178633876144886, + 1.6349750682711601, + 0.30845052376389503, + 0.6292334161698818, + 0.3435009177774191, + 1.000439964234829, + 0.8022499084472656, + 0.9329924620687962, + 0.377497810870409, + 1.0714394971728325, + 1.286267526447773, + 0.8452391922473907, + 1.0334194339811802, + 0.47253311425447464, + 0.5951028224080801, + 0.4345956854522228, + 0.41750491224229336, + 0.5131899826228619, + 0.4756258726119995, + 0.27740542590618134, + 0.543823666870594, + 1.6038994789123535, + 1.8564505651593208, + 1.1889070644974709, + 1.446626827120781, + 0.7431317046284676, + 0.4898766875267029, + 0.290425194427371, + 0.8697427529841661, + 0.4520154148340225, + 0.33710817247629166, + 0.6430425830185413, + 0.5332807432860136, + 0.7027835305780172, + 1.0402082726359367, + 1.108529819175601 + ], + "unique_experts": 64, + "load_cv": 0.7946607583696258, + "normalized_load_entropy": 0.9543635115538651, + "max_load_share": 0.10215053763440861 + } + }, + "s1_x": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "4742fcf4d1cd7aa9d20e94f0bebe89142ce2f34e53fef078916742c69d719c86", + "route_weight_sha256": "10acceabca77ca1463e60533528341350b47c5f05a8c9342a40844e5a4ee9f7e", + "loads": [ + 11, + 12, + 10, + 10, + 6, + 15, + 96, + 15, + 6, + 8, + 9, + 11, + 5, + 6, + 14, + 15, + 4, + 17, + 20, + 9, + 6, + 17, + 12, + 10, + 2, + 21, + 3, + 13, + 1, + 3, + 5, + 8, + 6, + 18, + 14, + 11, + 11, + 17, + 2, + 14, + 20, + 2, + 6, + 4, + 5, + 7, + 10, + 3, + 11, + 27, + 19, + 13, + 26, + 15, + 13, + 7, + 15, + 9, + 7, + 12, + 9, + 8, + 20, + 19 + ], + "weighted_loads": [ + 0.6996075604110956, + 0.48799383267760277, + 0.523616123944521, + 0.5614816956222057, + 0.23702004551887512, + 0.7719963248819113, + 6.255638167262077, + 0.8734473548829556, + 0.33800603076815605, + 0.3542672675102949, + 0.6053209938108921, + 0.5738025102764368, + 0.21827176958322525, + 0.287997979670763, + 0.5054914448410273, + 1.020602909848094, + 0.3420659974217415, + 1.1550574116408825, + 1.2270456738770008, + 0.480933615937829, + 0.3190253786742687, + 1.0133957862854004, + 0.7594674900174141, + 0.41619977727532387, + 0.08089284412562847, + 1.1754639260470867, + 0.09599244222044945, + 0.9383504502475262, + 0.03543093800544739, + 0.18019326776266098, + 0.19892985001206398, + 0.3724495880305767, + 0.20848042517900467, + 0.9696565736085176, + 0.8058233074843884, + 0.39736356399953365, + 0.4815988689661026, + 0.9847386050969362, + 0.174358282238245, + 0.766722247004509, + 0.9877093248069286, + 0.0772257149219513, + 0.3100737240165472, + 0.2547522746026516, + 0.2536087781190872, + 0.41549383848905563, + 0.5462037958204746, + 0.10388867184519768, + 0.4674479067325592, + 1.6504952535033226, + 1.849697945639491, + 1.0791486948728561, + 1.4846148639917374, + 0.7427393421530724, + 0.534031929448247, + 0.3015453275293112, + 0.6637794394046068, + 0.40263643860816956, + 0.2578079476952553, + 0.4913431629538536, + 0.47026901319622993, + 0.34035032987594604, + 0.859636852517724, + 1.0072429850697517 + ], + "unique_experts": 64, + "load_cv": 0.9918404783616996, + "normalized_load_entropy": 0.9307268476049656, + "max_load_share": 0.12307692307692308 + }, + "full_input": { + "tokens": 171, + "top_k": 6, + "decisions": 1026, + "ordered_route_sha256": "709439a4ba0597db6371907de8c31a736787fb2a47c3f224bad05f545fa25bc4", + "route_weight_sha256": "c96db338a9a80618d12a13858c45b5c11371fdd26035d77b777d9b7b1f1af115", + "loads": [ + 15, + 12, + 10, + 12, + 9, + 15, + 96, + 21, + 12, + 11, + 10, + 11, + 9, + 6, + 14, + 15, + 7, + 19, + 21, + 9, + 6, + 21, + 15, + 17, + 2, + 21, + 6, + 21, + 20, + 19, + 17, + 13, + 10, + 23, + 19, + 20, + 11, + 21, + 19, + 14, + 21, + 13, + 13, + 7, + 18, + 12, + 14, + 8, + 18, + 27, + 21, + 13, + 26, + 18, + 13, + 8, + 17, + 14, + 8, + 15, + 11, + 18, + 25, + 19 + ], + "weighted_loads": [ + 0.8890642654150724, + 0.48799383267760277, + 0.523616123944521, + 0.6146779246628284, + 0.9122428148984909, + 0.7719963248819113, + 6.255638167262077, + 1.172676645219326, + 0.8811506889760494, + 0.675978472456336, + 0.6491285860538483, + 0.5738025102764368, + 0.4188695438206196, + 0.287997979670763, + 0.5054914448410273, + 1.020602909848094, + 0.5543646700680256, + 1.2679434344172478, + 1.262795738875866, + 0.480933615937829, + 0.3190253786742687, + 1.183251466602087, + 0.9097006171941757, + 1.0057253874838352, + 0.08089284412562847, + 1.1754639260470867, + 0.21686960756778717, + 1.3745591305196285, + 2.5782494731247425, + 2.388651341199875, + 1.1067532449960709, + 0.626186354085803, + 0.3859511911869049, + 1.2592148873955011, + 1.0610464289784431, + 1.1017084736377, + 0.4815988689661026, + 1.1581775043159723, + 1.5459199398756027, + 0.766722247004509, + 1.0175550393760204, + 1.0260896235704422, + 0.7485931906849146, + 0.42273304983973503, + 1.444673027843237, + 0.7690556198358536, + 0.7292984500527382, + 0.34969670325517654, + 0.7911959551274776, + 1.6504952535033226, + 1.9147215131670237, + 1.0791486948728561, + 1.4846148639917374, + 0.8972526788711548, + 0.534031929448247, + 0.33284820057451725, + 0.8092907294631004, + 0.6230903975665569, + 0.3349316865205765, + 0.6037500444799662, + 0.5390115790069103, + 0.8831394203007221, + 1.0810312051326036, + 1.0072429850697517 + ], + "unique_experts": 64, + "load_cv": 0.7138629384325513, + "normalized_load_entropy": 0.9617993431328332, + "max_load_share": 0.0935672514619883 + } + }, + "s0_period": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "4a83d777a8f300a47822248c3e0b9fda4ebb0e3e36045f0d4b941cf28ba34adc", + "route_weight_sha256": "102c55cdbf944722f584d0fe6826e7460906949890df957f562ff0f517743257", + "loads": [ + 11, + 11, + 9, + 12, + 6, + 21, + 96, + 15, + 5, + 9, + 9, + 12, + 4, + 6, + 13, + 15, + 3, + 18, + 19, + 7, + 7, + 18, + 13, + 10, + 2, + 22, + 4, + 12, + 1, + 3, + 5, + 9, + 7, + 18, + 15, + 10, + 9, + 16, + 3, + 14, + 19, + 1, + 5, + 6, + 6, + 7, + 6, + 2, + 9, + 27, + 18, + 14, + 24, + 15, + 12, + 7, + 14, + 11, + 7, + 12, + 10, + 7, + 23, + 19 + ], + "weighted_loads": [ + 0.7353313472121954, + 0.46176785603165627, + 0.5001561343669891, + 0.637548454105854, + 0.22903761267662048, + 1.0096172168850899, + 6.227652657777071, + 0.8761812597513199, + 0.3066666014492512, + 0.3799601346254349, + 0.6016767546534538, + 0.6171741653233767, + 0.18701792508363724, + 0.2945505902171135, + 0.45993209443986416, + 1.047702345997095, + 0.34478936344385147, + 1.168142294511199, + 1.1969614326953888, + 0.3824224192649126, + 0.3576290234923363, + 1.0668652281165123, + 0.7758932821452618, + 0.41667599603533745, + 0.08094991743564606, + 1.1938312780112028, + 0.12887367233633995, + 0.9038333669304848, + 0.035499297082424164, + 0.2050999440252781, + 0.19681423902511597, + 0.42367371916770935, + 0.2608561646193266, + 0.9652226772159338, + 0.8380773030221462, + 0.35964682698249817, + 0.41183139383792877, + 0.9573992751538754, + 0.18361848965287209, + 0.7745262309908867, + 0.9687233958393335, + 0.03457236662507057, + 0.275994498282671, + 0.3260420262813568, + 0.3013935536146164, + 0.4210618808865547, + 0.39744526520371437, + 0.07138253003358841, + 0.37331007421016693, + 1.657439675182104, + 1.844078004360199, + 1.1521045845001936, + 1.4010992832481861, + 0.7420041039586067, + 0.48300901986658573, + 0.289107384160161, + 0.6149548459798098, + 0.48919377475976944, + 0.2644488997757435, + 0.47848112881183624, + 0.4822179153561592, + 0.3217473514378071, + 0.9455989096313715, + 1.0201926529407501 + ], + "unique_experts": 64, + "load_cv": 0.9978675488111707, + "normalized_load_entropy": 0.9289650033295438, + "max_load_share": 0.12307692307692308 + }, + "full_input": { + "tokens": 155, + "top_k": 6, + "decisions": 930, + "ordered_route_sha256": "dae1233e02fdc2a3226a03f9e996ed3753456bf39144ffa5f943678ffcaaa23e", + "route_weight_sha256": "0f2bd6eb24d3ee9256be468a9501bce6474a79bd628b11c8b0655b53f8ddea02", + "loads": [ + 11, + 11, + 9, + 16, + 9, + 21, + 96, + 18, + 11, + 9, + 9, + 12, + 9, + 6, + 13, + 15, + 6, + 18, + 19, + 7, + 7, + 19, + 15, + 16, + 2, + 22, + 5, + 20, + 17, + 12, + 7, + 14, + 9, + 20, + 15, + 18, + 9, + 20, + 17, + 14, + 19, + 6, + 9, + 8, + 8, + 8, + 7, + 7, + 12, + 27, + 19, + 14, + 24, + 15, + 12, + 7, + 17, + 11, + 8, + 15, + 10, + 13, + 28, + 23 + ], + "weighted_loads": [ + 0.7353313472121954, + 0.46176785603165627, + 0.5001561343669891, + 0.7599669769406319, + 0.8955051880329847, + 1.0096172168850899, + 6.227652657777071, + 1.0416756309568882, + 0.8199772015213966, + 0.3799601346254349, + 0.6016767546534538, + 0.6171741653233767, + 0.47054867073893547, + 0.2945505902171135, + 0.45993209443986416, + 1.047702345997095, + 0.5043877698481083, + 1.168142294511199, + 1.1969614326953888, + 0.3824224192649126, + 0.3576290234923363, + 1.113500688225031, + 0.8856939077377319, + 0.9289171881973743, + 0.08094991743564606, + 1.1938312780112028, + 0.16174416989088058, + 1.3371550012379885, + 2.2090457007288933, + 1.5851373933255672, + 0.26053258404135704, + 0.6796215586364269, + 0.34929426945745945, + 1.0652827080339193, + 0.8380773030221462, + 0.9052130579948425, + 0.41183139383792877, + 1.0709519125521183, + 1.3398030251264572, + 0.7745262309908867, + 0.9687233958393335, + 0.5425794757902622, + 0.5666740536689758, + 0.4267277419567108, + 0.39251502230763435, + 0.46038849651813507, + 0.44641606882214546, + 0.3056956846266985, + 0.5227636955678463, + 1.657439675182104, + 1.857021328061819, + 1.1521045845001936, + 1.4010992832481861, + 0.7420041039586067, + 0.48300901986658573, + 0.289107384160161, + 0.8208939433097839, + 0.48919377475976944, + 0.3341859318315983, + 0.6120451632887125, + 0.4822179153561592, + 0.6138746943324804, + 1.144226137548685, + 1.146577600389719 + ], + "unique_experts": 64, + "load_cv": 0.8063082309814057, + "normalized_load_entropy": 0.9531384454030322, + "max_load_share": 0.1032258064516129 + } + }, + "s1_period": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "25bd705f840aa69747d6fca9a2d6037e4d57f7de93bedaaf162679de4ae919f5", + "route_weight_sha256": "c352e43014900e5732e84932ccaede6bd6f53c76e65575ada8073ef446a9d116", + "loads": [ + 12, + 10, + 10, + 10, + 5, + 15, + 98, + 15, + 6, + 9, + 10, + 11, + 6, + 6, + 14, + 15, + 3, + 16, + 20, + 9, + 6, + 17, + 12, + 10, + 2, + 22, + 3, + 13, + 1, + 3, + 5, + 8, + 6, + 18, + 14, + 11, + 10, + 17, + 2, + 14, + 20, + 2, + 6, + 4, + 5, + 7, + 9, + 3, + 10, + 27, + 18, + 14, + 26, + 15, + 13, + 7, + 16, + 9, + 7, + 12, + 8, + 8, + 21, + 19 + ], + "weighted_loads": [ + 0.7359421607106924, + 0.4108247235417366, + 0.5107357483357191, + 0.5558389090001583, + 0.1965431086719036, + 0.7771559748798609, + 6.362743264064193, + 0.881875853985548, + 0.33147298730909824, + 0.38358581997454166, + 0.6425961870700121, + 0.5745398309081793, + 0.24917463771998882, + 0.29286815971136093, + 0.5022741723805666, + 1.0222322661429644, + 0.30469248443841934, + 1.1207770705223083, + 1.2176863811910152, + 0.4639055971056223, + 0.32296595722436905, + 1.0414587575942278, + 0.7426763139665127, + 0.4203845225274563, + 0.08111694641411304, + 1.1984066553413868, + 0.09553090110421181, + 0.9442384392023087, + 0.03438274934887886, + 0.18290720134973526, + 0.20336216874420643, + 0.3673913571983576, + 0.20873993821442127, + 0.9645590241998434, + 0.797055821865797, + 0.39576985500752926, + 0.4426241032779217, + 0.9837494641542435, + 0.1711425743997097, + 0.765540823340416, + 0.992758072912693, + 0.0814477689564228, + 0.3068823851644993, + 0.2529383450746536, + 0.25416324660182, + 0.4138508550822735, + 0.516557889059186, + 0.10589029639959335, + 0.4184942226856947, + 1.6401625480502844, + 1.8292058873921633, + 1.1319146826863289, + 1.4888963848352432, + 0.743434950709343, + 0.5355999208986759, + 0.30470495112240314, + 0.6994211133569479, + 0.40415953285992146, + 0.25678274407982826, + 0.4991772659122944, + 0.435224711894989, + 0.3445665240287781, + 0.899888388812542, + 0.9964201413094997 + ], + "unique_experts": 64, + "load_cv": 1.0123108097528182, + "normalized_load_entropy": 0.9287053437784254, + "max_load_share": 0.12564102564102564 + }, + "full_input": { + "tokens": 171, + "top_k": 6, + "decisions": 1026, + "ordered_route_sha256": "7d17bd5d27355c1385891a85792278e2aebd7304babb6887bc3c7e8dc7a6daba", + "route_weight_sha256": "4bb1dad02ca198b9f40028cd1a2bbbe1acb7343a5e19cb71a371e2e8a5822251", + "loads": [ + 16, + 10, + 10, + 12, + 8, + 15, + 98, + 21, + 12, + 12, + 11, + 11, + 10, + 6, + 14, + 15, + 7, + 18, + 21, + 9, + 6, + 20, + 15, + 17, + 2, + 22, + 6, + 21, + 20, + 18, + 16, + 13, + 10, + 23, + 19, + 20, + 10, + 21, + 20, + 14, + 21, + 14, + 13, + 7, + 18, + 11, + 13, + 8, + 17, + 27, + 20, + 14, + 26, + 18, + 13, + 8, + 18, + 14, + 8, + 15, + 10, + 18, + 27, + 19 + ], + "weighted_loads": [ + 0.9253988657146692, + 0.4108247235417366, + 0.5107357483357191, + 0.609035138040781, + 0.8717658780515194, + 0.7771559748798609, + 6.362743264064193, + 1.1863188296556473, + 0.8930072654038668, + 0.7052970249205828, + 0.6864037793129683, + 0.5745398309081793, + 0.44716193340718746, + 0.29286815971136093, + 0.5022741723805666, + 1.0222322661429644, + 0.5668520294129848, + 1.2336630932986736, + 1.2534364461898804, + 0.4639055971056223, + 0.32296595722436905, + 1.1822924930602312, + 0.8880767896771431, + 0.9297580122947693, + 0.08111694641411304, + 1.1984066553413868, + 0.21640806645154953, + 1.3344635963439941, + 2.6042669862508774, + 2.2803526744246483, + 1.0643754955381155, + 0.6185213699936867, + 0.3862107042223215, + 1.2552075330168009, + 1.0522789433598518, + 1.0579030122607946, + 0.4426241032779217, + 1.1571883633732796, + 1.5700770653784275, + 0.765540823340416, + 1.0226037874817848, + 1.139503624290228, + 0.7492326311767101, + 0.4133709594607353, + 1.4548381455242634, + 0.7253752425312996, + 0.7081472780555487, + 0.3516983278095722, + 0.751950541511178, + 1.6401625480502844, + 1.8942294549196959, + 1.1319146826863289, + 1.4888963848352432, + 0.8979482874274254, + 0.5355999208986759, + 0.3360078241676092, + 0.8440682254731655, + 0.6246134918183088, + 0.3327889107167721, + 0.6115841474384069, + 0.5039672777056694, + 0.8874548375606537, + 1.1563727296888828, + 0.9964201413094997 + ], + "unique_experts": 64, + "load_cv": 0.7298652751843311, + "normalized_load_entropy": 0.9605491387360614, + "max_load_share": 0.09551656920077972 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 130, + "ordered_topk_exact_tokens": 92, + "set_exact_tokens": 107, + "mean_set_jaccard": 0.9478021978021979, + "mean_token_weighted_tv": 0.010587045829743147, + "aggregate_load_tv": 0.02051282051282052 + }, + "system_bos": { + "tokens": 130, + "ordered_topk_exact_tokens": 81, + "set_exact_tokens": 95, + "mean_set_jaccard": 0.9148351648351648, + "mean_token_weighted_tv": 0.015815956990879315, + "aggregate_load_tv": 0.03333333333333334 + }, + "system_x": { + "tokens": 130, + "ordered_topk_exact_tokens": 70, + "set_exact_tokens": 88, + "mean_set_jaccard": 0.9027472527472529, + "mean_token_weighted_tv": 0.018973923782603097, + "aggregate_load_tv": 0.037179487179487186 + }, + "system_period": { + "tokens": 130, + "ordered_topk_exact_tokens": 71, + "set_exact_tokens": 88, + "mean_set_jaccard": 0.9010989010989011, + "mean_token_weighted_tv": 0.019600481167435645, + "aggregate_load_tv": 0.03846153846153845 + }, + "bos_at_s0": { + "tokens": 130, + "ordered_topk_exact_tokens": 82, + "set_exact_tokens": 92, + "mean_set_jaccard": 0.90989010989011, + "mean_token_weighted_tv": 0.017171903964705193, + "aggregate_load_tv": 0.03333333333333333 + }, + "bos_at_s1": { + "tokens": 130, + "ordered_topk_exact_tokens": 75, + "set_exact_tokens": 91, + "mean_set_jaccard": 0.906043956043956, + "mean_token_weighted_tv": 0.01859535713895009, + "aggregate_load_tv": 0.03076923076923077 + }, + "x_at_s0": { + "tokens": 130, + "ordered_topk_exact_tokens": 64, + "set_exact_tokens": 86, + "mean_set_jaccard": 0.8950549450549451, + "mean_token_weighted_tv": 0.019968726450147536, + "aggregate_load_tv": 0.028205128205128206 + }, + "x_at_s1": { + "tokens": 130, + "ordered_topk_exact_tokens": 60, + "set_exact_tokens": 80, + "mean_set_jaccard": 0.8752747252747253, + "mean_token_weighted_tv": 0.02405942276550027, + "aggregate_load_tv": 0.046153846153846156 + }, + "period_at_s0": { + "tokens": 130, + "ordered_topk_exact_tokens": 69, + "set_exact_tokens": 88, + "mean_set_jaccard": 0.8994505494505496, + "mean_token_weighted_tv": 0.019392343574705033, + "aggregate_load_tv": 0.029487179487179493 + }, + "period_at_s1": { + "tokens": 130, + "ordered_topk_exact_tokens": 62, + "set_exact_tokens": 78, + "mean_set_jaccard": 0.8725274725274726, + "mean_token_weighted_tv": 0.02465854473412037, + "aggregate_load_tv": 0.04358974358974358 + } + } + }, + "layer_13": { + "layer": 13, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "498e2b652bb0a28332902d450ae0e3696541de47667410029ecaa53113f53f62", + "route_weight_sha256": "e09b52c1b636769db998fec7a89cc0ebe0c5e373a7a1bd4d4ae7e21eb6d326b5", + "loads": [ + 20, + 6, + 9, + 4, + 98, + 3, + 7, + 9, + 16, + 19, + 10, + 5, + 6, + 14, + 6, + 13, + 4, + 10, + 0, + 1, + 7, + 16, + 18, + 4, + 4, + 7, + 13, + 9, + 31, + 1, + 7, + 13, + 9, + 7, + 8, + 13, + 3, + 0, + 10, + 84, + 15, + 3, + 9, + 2, + 1, + 1, + 4, + 14, + 8, + 12, + 0, + 39, + 16, + 1, + 11, + 6, + 2, + 5, + 21, + 6, + 25, + 18, + 19, + 18 + ], + "weighted_loads": [ + 1.2220194414258003, + 0.2901808172464371, + 0.33768006786704063, + 0.1432579979300499, + 5.832087816670537, + 0.12890618667006493, + 0.2922681961208582, + 0.5293202735483646, + 0.7784740645438433, + 0.8143304046243429, + 0.45606904849410057, + 0.2010156214237213, + 0.22658863104879856, + 0.8881042283028364, + 0.2537177726626396, + 0.5695005431771278, + 0.17523079738020897, + 0.38766830787062645, + 0.0, + 0.03506246954202652, + 0.32269958406686783, + 0.8322879485785961, + 1.0086941309273243, + 0.1218167282640934, + 0.20197271555662155, + 0.32019732519984245, + 0.5015558414161205, + 0.46579100377857685, + 1.4315784573554993, + 0.04493965953588486, + 0.3146785572171211, + 0.9192650988698006, + 0.537208205088973, + 0.3376270495355129, + 0.39616667479276657, + 0.7998949289321899, + 0.10548640228807926, + 0.0, + 0.7241053394973278, + 5.398569889366627, + 0.8086961880326271, + 0.11535511910915375, + 0.41080004535615444, + 0.0723645593971014, + 0.04659917950630188, + 0.04301582649350166, + 0.14660055376589298, + 0.4760927651077509, + 0.39565364085137844, + 0.6027914136648178, + 0.0, + 1.563315449282527, + 0.6899521686136723, + 0.04275478050112724, + 0.4195229094475508, + 0.2729299645870924, + 0.0629633329808712, + 0.24726587533950806, + 0.8036849200725555, + 0.2827935144305229, + 1.3006522972136736, + 0.9463558718562126, + 1.095903169363737, + 0.9724848605692387 + ], + "unique_experts": 61, + "load_cv": 1.3194444271428076, + "normalized_load_entropy": 0.8737477879598029, + "max_load_share": 0.12564102564102564 + }, + "full_input": { + "tokens": 155, + "top_k": 6, + "decisions": 930, + "ordered_route_sha256": "ccad668e894fea97f5163544320ef55f9cf79534698913f1dd2f41ee992ec345", + "route_weight_sha256": "9a2980d96a9dc318b86d1e979ba8798f384a2dc746b42da0de5ccff8513b40b5", + "loads": [ + 20, + 10, + 9, + 4, + 99, + 3, + 24, + 9, + 16, + 21, + 21, + 11, + 6, + 14, + 7, + 20, + 4, + 12, + 1, + 2, + 7, + 18, + 18, + 4, + 8, + 7, + 16, + 9, + 31, + 15, + 7, + 13, + 9, + 13, + 9, + 14, + 6, + 1, + 10, + 87, + 16, + 4, + 12, + 4, + 11, + 12, + 5, + 17, + 10, + 12, + 1, + 39, + 19, + 4, + 13, + 6, + 5, + 5, + 28, + 10, + 25, + 19, + 19, + 19 + ], + "weighted_loads": [ + 1.2220194414258003, + 0.5201350338757038, + 0.33768006786704063, + 0.1432579979300499, + 5.874457256868482, + 0.12890618667006493, + 1.6109266337007284, + 0.5293202735483646, + 0.7784740645438433, + 0.891237411648035, + 1.2104836888611317, + 0.5177645604126155, + 0.22658863104879856, + 0.8881042283028364, + 0.29910603910684586, + 1.014888972043991, + 0.17523079738020897, + 0.4354714145883918, + 0.04250339791178703, + 0.08023402094841003, + 0.32269958406686783, + 0.9158330410718918, + 1.0086941309273243, + 0.1218167282640934, + 0.334741014521569, + 0.32019732519984245, + 0.6252312436699867, + 0.46579100377857685, + 1.4315784573554993, + 1.1980530992150307, + 0.3146785572171211, + 0.9192650988698006, + 0.537208205088973, + 0.9943158254027367, + 0.41899850964546204, + 0.8544455654919147, + 0.4130142852663994, + 0.03377975523471832, + 0.7241053394973278, + 5.5423335917294025, + 0.910325825214386, + 0.1648857593536377, + 0.5538153704255819, + 0.17055010609328747, + 0.7504274919629097, + 1.0586600862443447, + 0.17786778323352337, + 1.699953155592084, + 0.4963570851832628, + 0.6027914136648178, + 0.038269564509391785, + 1.563315449282527, + 0.7961809523403645, + 0.1806975044310093, + 0.5079851485788822, + 0.2729299645870924, + 0.22641995921730995, + 0.24726587533950806, + 1.154316958039999, + 0.4871445558965206, + 1.3006522972136736, + 0.9757598508149385, + 1.095903169363737, + 1.0100106671452522 + ], + "unique_experts": 64, + "load_cv": 1.1034898759606064, + "normalized_load_entropy": 0.9085591651191124, + "max_load_share": 0.1064516129032258 + } + }, + "s1_eos": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "ba453d49652f6db0a891cbb6396687563273a41c0088aa08523091f02999fd94", + "route_weight_sha256": "0051b1e9ddb519e857abeba97a9e783d2ee90290e31c7013791d93d499a635bb", + "loads": [ + 21, + 7, + 8, + 3, + 97, + 3, + 4, + 10, + 17, + 19, + 10, + 5, + 6, + 13, + 5, + 13, + 4, + 11, + 0, + 1, + 7, + 16, + 18, + 3, + 5, + 8, + 13, + 10, + 31, + 1, + 6, + 13, + 10, + 9, + 8, + 16, + 2, + 0, + 10, + 87, + 15, + 2, + 8, + 2, + 1, + 2, + 5, + 14, + 6, + 16, + 1, + 37, + 15, + 1, + 9, + 4, + 2, + 5, + 18, + 6, + 24, + 18, + 19, + 20 + ], + "weighted_loads": [ + 1.2382850982248783, + 0.33471186831593513, + 0.2980360761284828, + 0.11073962412774563, + 5.830703414976597, + 0.12679347395896912, + 0.18993029743433, + 0.5618883706629276, + 0.8092499133199453, + 0.7977076545357704, + 0.453357458114624, + 0.20051036030054092, + 0.22685007750988007, + 0.8627345766872168, + 0.22282864525914192, + 0.5649135336279869, + 0.1779545620083809, + 0.43149751983582973, + 0.0, + 0.03477828577160835, + 0.3417304717004299, + 0.826416864991188, + 1.0075113791972399, + 0.09250637888908386, + 0.23052457720041275, + 0.3640337809920311, + 0.508988507091999, + 0.50901616550982, + 1.4525185637176037, + 0.04295535385608673, + 0.2801220044493675, + 0.9126763083040714, + 0.585249662399292, + 0.40532359294593334, + 0.3923053443431854, + 0.9080174788832664, + 0.07174626551568508, + 0.0, + 0.7203109934926033, + 5.5218795500695705, + 0.8180021625012159, + 0.08127473667263985, + 0.3677317854017019, + 0.07391831837594509, + 0.04936938360333443, + 0.07651809975504875, + 0.18178216367959976, + 0.4822415001690388, + 0.32709574699401855, + 0.7284656893461943, + 0.03663581982254982, + 1.482093857601285, + 0.6649458166211843, + 0.042773663997650146, + 0.34082640893757343, + 0.20671991631388664, + 0.06170118413865566, + 0.24162165820598602, + 0.7026864755898714, + 0.28577544912695885, + 1.2695229314267635, + 0.9442206174135208, + 1.1080624535679817, + 1.0189299695193768 + ], + "unique_experts": 62, + "load_cv": 1.3292936832214564, + "normalized_load_entropy": 0.8722357851622882, + "max_load_share": 0.12435897435897436 + }, + "full_input": { + "tokens": 171, + "top_k": 6, + "decisions": 1026, + "ordered_route_sha256": "57879344260713c2658d6c8c4c22999d168a1aa9bd7199a2fbcac706c715b7f5", + "route_weight_sha256": "532bfd2c2df4adb7d46f5103f9195f93a2f77a29c71e0692a3c0708e465dd9ea", + "loads": [ + 26, + 11, + 8, + 3, + 98, + 5, + 32, + 10, + 17, + 21, + 22, + 17, + 6, + 13, + 6, + 21, + 4, + 14, + 2, + 4, + 7, + 21, + 18, + 6, + 10, + 8, + 17, + 10, + 31, + 20, + 13, + 14, + 10, + 20, + 11, + 18, + 7, + 1, + 11, + 89, + 18, + 5, + 16, + 3, + 17, + 14, + 6, + 17, + 9, + 21, + 2, + 37, + 16, + 3, + 11, + 6, + 5, + 16, + 27, + 10, + 25, + 20, + 19, + 21 + ], + "weighted_loads": [ + 1.4432358890771866, + 0.5955753475427628, + 0.2980360761284828, + 0.11073962412774563, + 5.872721720486879, + 0.19392170011997223, + 2.4036841467022896, + 0.5618883706629276, + 0.8092499133199453, + 0.8864194825291634, + 1.2614823821932077, + 1.0231667244806886, + 0.22685007750988007, + 0.8627345766872168, + 0.26632028818130493, + 1.0617108717560768, + 0.1779545620083809, + 0.5167633462697268, + 0.06763838604092598, + 0.15872886404395103, + 0.3417304717004299, + 1.0726341363042593, + 1.0075113791972399, + 0.21504920348525047, + 0.4036923903040588, + 0.3640337809920311, + 0.6642632093280554, + 0.50901616550982, + 1.4525185637176037, + 1.8434164579957724, + 0.6734974384307861, + 0.9525295123457909, + 0.585249662399292, + 1.5691198501735926, + 0.6171560771763325, + 1.0147632583975792, + 0.5205617062747478, + 0.03333931788802147, + 0.7647158354520798, + 5.638721369206905, + 0.9987858776003122, + 0.21328411623835564, + 1.0333973094820976, + 0.1485413145273924, + 1.2155621200799942, + 1.096111886203289, + 0.22206546738743782, + 1.7122202813625336, + 0.6477803476154804, + 0.9767023529857397, + 0.07298119738698006, + 1.482093857601285, + 0.7024638298898935, + 0.12436551600694656, + 0.412057438865304, + 0.27938562631607056, + 0.20931517891585827, + 0.9499743580818176, + 1.124825943261385, + 0.48041268438100815, + 1.2981406413018703, + 1.0281501710414886, + 1.1080624535679817, + 1.0719529390335083 + ], + "unique_experts": 64, + "load_cv": 0.9996313476019683, + "normalized_load_entropy": 0.9201499013220403, + "max_load_share": 0.09551656920077972 + } + }, + "s0_bos": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "71e5ef8128054f6706a67e6042109041f971f42b68b6b9989c359c823efc5b57", + "route_weight_sha256": "1aca15ee49f47c60ac981a19279123929fd7f1a95b202fea098d21c7189f77b1", + "loads": [ + 21, + 7, + 8, + 2, + 98, + 3, + 7, + 8, + 17, + 18, + 10, + 4, + 6, + 10, + 5, + 14, + 4, + 10, + 0, + 1, + 8, + 16, + 18, + 3, + 6, + 8, + 11, + 10, + 31, + 1, + 6, + 14, + 9, + 7, + 9, + 15, + 3, + 0, + 11, + 84, + 16, + 3, + 10, + 2, + 1, + 2, + 3, + 14, + 8, + 13, + 2, + 37, + 18, + 1, + 12, + 7, + 2, + 5, + 17, + 6, + 23, + 18, + 18, + 19 + ], + "weighted_loads": [ + 1.224826080724597, + 0.345148429274559, + 0.30380313470959663, + 0.08443230763077736, + 5.834941238164902, + 0.12745054066181183, + 0.2994411066174507, + 0.508506316691637, + 0.8267499729990959, + 0.7781421914696693, + 0.4775252565741539, + 0.16141579300165176, + 0.23093598894774914, + 0.7536430805921555, + 0.22751561924815178, + 0.607383381575346, + 0.1794629916548729, + 0.39297634549438953, + 0.0, + 0.0347476601600647, + 0.37661876156926155, + 0.8195831403136253, + 1.0260579399764538, + 0.09815178625285625, + 0.27131323516368866, + 0.36238641291856766, + 0.42614318430423737, + 0.5095721520483494, + 1.4842745140194893, + 0.04975524917244911, + 0.272580586373806, + 0.9432845655828714, + 0.5283784754574299, + 0.3460277356207371, + 0.43908338621258736, + 0.8923026397824287, + 0.10301771014928818, + 0.0, + 0.7523857280611992, + 5.269345499575138, + 0.8446154147386551, + 0.11696717888116837, + 0.42662456445395947, + 0.0738101601600647, + 0.04719756543636322, + 0.07620092108845711, + 0.11373522132635117, + 0.44852733239531517, + 0.4127058405429125, + 0.6436358634382486, + 0.07231063768267632, + 1.4889287650585175, + 0.7705430239439011, + 0.04239404946565628, + 0.4743284620344639, + 0.3137241844087839, + 0.06115909293293953, + 0.23352400213479996, + 0.6604947429150343, + 0.283576887100935, + 1.2593237850815058, + 0.9467029739171267, + 1.0542013626545668, + 1.0332992188632488 + ], + "unique_experts": 62, + "load_cv": 1.3120891392242438, + "normalized_load_entropy": 0.8761526746372471, + "max_load_share": 0.12564102564102564 + }, + "full_input": { + "tokens": 155, + "top_k": 6, + "decisions": 930, + "ordered_route_sha256": "d22061415c1a10486de9fcf2b22220650d050d27a9265112442be0b3c73aec9b", + "route_weight_sha256": "5d04b9116cef7f02509ef2fe1922e4f39cbc232973349aa65b86c2afedbf0446", + "loads": [ + 21, + 12, + 9, + 2, + 100, + 3, + 24, + 8, + 17, + 22, + 21, + 8, + 6, + 10, + 5, + 21, + 4, + 11, + 1, + 2, + 8, + 18, + 18, + 3, + 9, + 8, + 14, + 10, + 31, + 15, + 6, + 14, + 9, + 12, + 10, + 16, + 6, + 1, + 11, + 87, + 17, + 4, + 13, + 4, + 11, + 13, + 4, + 16, + 10, + 13, + 3, + 37, + 21, + 5, + 14, + 7, + 6, + 5, + 24, + 10, + 23, + 19, + 18, + 20 + ], + "weighted_loads": [ + 1.224826080724597, + 0.6297283582389355, + 0.3726886175572872, + 0.08443230763077736, + 5.927719842642546, + 0.12745054066181183, + 1.7003545239567757, + 0.508506316691637, + 0.8267499729990959, + 0.9590197820216417, + 1.181207224726677, + 0.4518920052796602, + 0.23093598894774914, + 0.7536430805921555, + 0.22751561924815178, + 1.0588781721889973, + 0.1794629916548729, + 0.4277218896895647, + 0.04250339791178703, + 0.07991921156644821, + 0.37661876156926155, + 0.9018259085714817, + 1.0260579399764538, + 0.09815178625285625, + 0.37890725769102573, + 0.36238641291856766, + 0.5498185865581036, + 0.5095721520483494, + 1.4842745140194893, + 1.1912764236330986, + 0.272580586373806, + 0.9432845655828714, + 0.5283784754574299, + 0.9252416603267193, + 0.4619152210652828, + 0.945300355553627, + 0.4071436282247305, + 0.03377975523471832, + 0.7523857280611992, + 5.409333895891905, + 0.9480569809675217, + 0.1664978191256523, + 0.5853931475430727, + 0.18231673538684845, + 0.7480648830533028, + 1.0938208773732185, + 0.14500245079398155, + 0.841586772352457, + 0.515179855749011, + 0.6436358634382486, + 0.1105802021920681, + 1.4889287650585175, + 0.8767718076705933, + 0.2436257228255272, + 0.5627907011657953, + 0.3137241844087839, + 0.3413786180317402, + 0.23352400213479996, + 1.0050890371203423, + 0.4879279285669327, + 1.2593237850815058, + 0.9761069528758526, + 1.0542013626545668, + 1.0708250254392624 + ], + "unique_experts": 64, + "load_cv": 1.1041602448127703, + "normalized_load_entropy": 0.9088852683768807, + "max_load_share": 0.10752688172043011 + } + }, + "s1_bos": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "03bac7ced1f7ebe42dc65c41cf219bdf52c444602f369eb3ea9e05d414470141", + "route_weight_sha256": "75a819947c080fdcd360a9a1657abf7505f1a8dda770be8b7bd740c4a785bb9e", + "loads": [ + 21, + 6, + 7, + 2, + 94, + 3, + 5, + 8, + 15, + 20, + 12, + 5, + 6, + 10, + 7, + 14, + 4, + 11, + 0, + 1, + 8, + 16, + 18, + 4, + 3, + 8, + 13, + 9, + 32, + 1, + 6, + 13, + 10, + 6, + 9, + 14, + 1, + 0, + 11, + 85, + 16, + 3, + 10, + 3, + 1, + 1, + 5, + 14, + 8, + 15, + 1, + 38, + 19, + 1, + 10, + 6, + 1, + 5, + 20, + 6, + 24, + 18, + 19, + 18 + ], + "weighted_loads": [ + 1.224035020917654, + 0.30799485370516777, + 0.27161630243062973, + 0.08363544940948486, + 5.5840056743472815, + 0.12901141494512558, + 0.2397308349609375, + 0.49857406690716743, + 0.7351503539830446, + 0.8783319294452667, + 0.5307051092386246, + 0.1952677071094513, + 0.23536242172122002, + 0.7569814547896385, + 0.2891578581184149, + 0.6033132635056973, + 0.1772429570555687, + 0.41771820932626724, + 0.0, + 0.03613373264670372, + 0.3825094811618328, + 0.8076453022658825, + 1.01242271438241, + 0.12749262154102325, + 0.16866538301110268, + 0.36244435608386993, + 0.5084928311407566, + 0.46578100323677063, + 1.5235104598104954, + 0.05321336165070534, + 0.2803243584930897, + 0.8826584592461586, + 0.5565620306879282, + 0.3086572028696537, + 0.4425562284886837, + 0.8385186083614826, + 0.038378238677978516, + 0.0, + 0.7353884764015675, + 5.3676072508096695, + 0.8339668698608875, + 0.11661393940448761, + 0.4107268825173378, + 0.10342685505747795, + 0.05179978162050247, + 0.040951408445835114, + 0.18541678227484226, + 0.45486457273364067, + 0.4087386727333069, + 0.7323436886072159, + 0.042037080973386765, + 1.5551636200398207, + 0.7926225401461124, + 0.04339490085840225, + 0.3836584407836199, + 0.27794881351292133, + 0.025905640795826912, + 0.2453421801328659, + 0.7590601891279221, + 0.27893630415201187, + 1.2881838344037533, + 0.956594742834568, + 1.085324078798294, + 0.9794925786554813 + ], + "unique_experts": 62, + "load_cv": 1.3021905379930614, + "normalized_load_entropy": 0.873804513836944, + "max_load_share": 0.12051282051282051 + }, + "full_input": { + "tokens": 171, + "top_k": 6, + "decisions": 1026, + "ordered_route_sha256": "c631551fb609c65a73e358de4b9ae472a10147e36926b581322e7391f8bdc558", + "route_weight_sha256": "0fcd1209676d0dc117c6c45407fcf1ce303bfb610f2d3560aedb4d46ac0d2002", + "loads": [ + 26, + 11, + 8, + 2, + 95, + 5, + 33, + 8, + 15, + 23, + 24, + 15, + 6, + 10, + 7, + 22, + 4, + 13, + 2, + 4, + 8, + 21, + 18, + 7, + 8, + 8, + 17, + 9, + 32, + 20, + 13, + 14, + 10, + 17, + 12, + 16, + 7, + 1, + 12, + 87, + 19, + 6, + 18, + 4, + 17, + 13, + 6, + 16, + 11, + 20, + 2, + 38, + 20, + 3, + 12, + 8, + 5, + 16, + 29, + 10, + 25, + 20, + 19, + 19 + ], + "weighted_loads": [ + 1.4289858117699623, + 0.6226354539394379, + 0.3202854134142399, + 0.08363544940948486, + 5.624172622337937, + 0.1961396411061287, + 2.554808385670185, + 0.49857406690716743, + 0.7351503539830446, + 1.0192263424396515, + 1.3317624535411596, + 0.9904913809150457, + 0.23536242172122002, + 0.7569814547896385, + 0.2891578581184149, + 1.1118529550731182, + 0.1772429570555687, + 0.48928113281726837, + 0.06763838604092598, + 0.1600843109190464, + 0.3825094811618328, + 1.0583642926067114, + 1.01242271438241, + 0.25003544613718987, + 0.37830626405775547, + 0.36244435608386993, + 0.6637675333768129, + 0.46578100323677063, + 1.5235104598104954, + 1.8671263102442026, + 0.6736997924745083, + 0.922511663287878, + 0.5565620306879282, + 1.4284406825900078, + 0.6674069613218307, + 0.9416753351688385, + 0.5467197466641665, + 0.03333931788802147, + 0.7797933183610439, + 5.476421643048525, + 1.0150503367185593, + 0.2486233189702034, + 1.0913775656372309, + 0.17874792590737343, + 1.2140370793640614, + 1.0627368576824665, + 0.22570008598268032, + 0.8549557849764824, + 0.7302543483674526, + 0.9805803522467613, + 0.078382458537817, + 1.5551636200398207, + 0.8301405534148216, + 0.12498675286769867, + 0.45488947071135044, + 0.35061452351510525, + 0.21439055167138577, + 0.9536948800086975, + 1.1608721930533648, + 0.4735735394060612, + 1.31680154427886, + 1.0405242964625359, + 1.085324078798294, + 1.0325155481696129 + ], + "unique_experts": 64, + "load_cv": 0.9803479190255944, + "normalized_load_entropy": 0.9218016565859004, + "max_load_share": 0.09259259259259259 + } + }, + "s0_x": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "c155d28596f196ce52d54b4d1da9fa49eb6ddf60b9aa10c8910563167a9723fe", + "route_weight_sha256": "5e733bbd0088a9cbe1737af7ccd1087761b942110a8d823ccf90f57de2913139", + "loads": [ + 23, + 6, + 8, + 3, + 93, + 3, + 8, + 8, + 17, + 17, + 10, + 5, + 5, + 14, + 6, + 14, + 4, + 10, + 0, + 1, + 6, + 16, + 19, + 3, + 4, + 8, + 11, + 12, + 30, + 1, + 6, + 13, + 10, + 7, + 9, + 16, + 2, + 0, + 11, + 84, + 16, + 2, + 10, + 3, + 1, + 2, + 7, + 13, + 7, + 12, + 1, + 36, + 18, + 1, + 11, + 6, + 2, + 5, + 18, + 6, + 23, + 18, + 19, + 20 + ], + "weighted_loads": [ + 1.301795793697238, + 0.31374653056263924, + 0.3143906444311142, + 0.11751275882124901, + 5.587883664295077, + 0.12500056996941566, + 0.3291230984032154, + 0.504302155226469, + 0.8293122723698616, + 0.7208606749773026, + 0.46601011976599693, + 0.19170894473791122, + 0.20502134412527084, + 0.8846529051661491, + 0.2573922127485275, + 0.606511615216732, + 0.18330451101064682, + 0.40019188076257706, + 0.0, + 0.03472614660859108, + 0.2796107493340969, + 0.8289462029933929, + 1.0563595313578844, + 0.09591938368976116, + 0.19603735394775867, + 0.3695708326995373, + 0.4308476783335209, + 0.5740837138146162, + 1.459169365465641, + 0.05018582195043564, + 0.2741100825369358, + 0.914474580436945, + 0.5609308164566755, + 0.3586037643253803, + 0.44688909128308296, + 0.9343206472694874, + 0.07124796509742737, + 0.0, + 0.7489646002650261, + 5.31632973626256, + 0.8408032823354006, + 0.0710914172232151, + 0.4084144663065672, + 0.09902738220989704, + 0.049093928188085556, + 0.08123229071497917, + 0.25375767424702644, + 0.4226653724908829, + 0.36077263206243515, + 0.5982953272759914, + 0.037508524954319, + 1.4619479663670063, + 0.778416097164154, + 0.04195718094706535, + 0.4359605014324188, + 0.2821325957775116, + 0.06178285554051399, + 0.2391994148492813, + 0.6817535161972046, + 0.2757444493472576, + 1.2802686616778374, + 0.9512988924980164, + 1.1008773371577263, + 1.0699232537299395 + ], + "unique_experts": 62, + "load_cv": 1.2784667839072867, + "normalized_load_entropy": 0.8788286564613679, + "max_load_share": 0.11923076923076924 + }, + "full_input": { + "tokens": 155, + "top_k": 6, + "decisions": 930, + "ordered_route_sha256": "944989122f7bd63b87071c64f4185b1b8c6ef8ecc1dbad5b0af08bf30692330e", + "route_weight_sha256": "d2280f5566203f7e2934e223a9357cddacb93d388fa0c8b18c79860cdd637c91", + "loads": [ + 23, + 10, + 8, + 3, + 94, + 3, + 25, + 8, + 17, + 19, + 22, + 10, + 5, + 14, + 6, + 22, + 4, + 11, + 1, + 2, + 6, + 18, + 19, + 3, + 9, + 8, + 14, + 12, + 30, + 14, + 6, + 13, + 10, + 13, + 10, + 17, + 5, + 1, + 11, + 87, + 17, + 3, + 13, + 4, + 13, + 14, + 9, + 15, + 9, + 12, + 2, + 36, + 21, + 4, + 13, + 6, + 5, + 5, + 24, + 10, + 23, + 19, + 19, + 21 + ], + "weighted_loads": [ + 1.301795793697238, + 0.5235605537891388, + 0.3143906444311142, + 0.11751275882124901, + 5.628455208614469, + 0.12500056996941566, + 1.6376558169722557, + 0.504302155226469, + 0.8293122723698616, + 0.7977676820009947, + 1.1800704635679722, + 0.5365923848003149, + 0.20502134412527084, + 0.8846529051661491, + 0.2573922127485275, + 1.27611742913723, + 0.18330451101064682, + 0.43493742495775223, + 0.04250339791178703, + 0.0798976980149746, + 0.2796107493340969, + 0.9116083905100822, + 1.0563595313578844, + 0.09591938368976116, + 0.38973668962717056, + 0.3695708326995373, + 0.5545230805873871, + 0.5740837138146162, + 1.459169365465641, + 1.1792920492589474, + 0.2741100825369358, + 0.914474580436945, + 0.5609308164566755, + 0.9911296330392361, + 0.4697209261357784, + 0.9974967651069164, + 0.36620025150477886, + 0.03377975523471832, + 0.7489646002650261, + 5.449893318116665, + 0.946312079206109, + 0.12062205746769905, + 0.5405067633837461, + 0.14500396139919758, + 0.8987086974084377, + 1.2934609688818455, + 0.3137616626918316, + 0.8157248124480247, + 0.4612062834203243, + 0.5982953272759914, + 0.07577808946371078, + 1.4619479663670063, + 0.8846448808908463, + 0.1798999048769474, + 0.5244227405637503, + 0.2821325957775116, + 0.22523948177695274, + 0.2391994148492813, + 0.994459168985486, + 0.4800954908132553, + 1.2802686616778374, + 0.9807028714567423, + 1.1008773371577263, + 1.107449060305953 + ], + "unique_experts": 64, + "load_cv": 1.0705423000887628, + "normalized_load_entropy": 0.9114469428687525, + "max_load_share": 0.1010752688172043 + } + }, + "s1_x": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "220b186dd711cb8d1cd71a291c05c9a1f54ec349712ed4ff003a171b0a4f892c", + "route_weight_sha256": "d5c16b0bcc269672929c926ed61dcf4e0b13a4ae957d5f77d08e69d3a071d68d", + "loads": [ + 21, + 6, + 7, + 2, + 95, + 3, + 9, + 6, + 16, + 17, + 9, + 5, + 6, + 11, + 6, + 13, + 4, + 10, + 1, + 1, + 7, + 16, + 18, + 2, + 4, + 8, + 14, + 11, + 31, + 1, + 7, + 13, + 9, + 8, + 8, + 14, + 1, + 0, + 11, + 85, + 15, + 3, + 9, + 3, + 1, + 2, + 7, + 17, + 7, + 16, + 1, + 38, + 17, + 1, + 8, + 6, + 2, + 5, + 21, + 6, + 24, + 19, + 18, + 18 + ], + "weighted_loads": [ + 1.203769562765956, + 0.2991483025252819, + 0.27886241115629673, + 0.08208861947059631, + 5.602803027257323, + 0.12778707966208458, + 0.38727170415222645, + 0.4354262463748455, + 0.7742025926709175, + 0.7281616311520338, + 0.422452948987484, + 0.19207198917865753, + 0.24125428684055805, + 0.7902969419956207, + 0.2552444636821747, + 0.5649868305772543, + 0.1771923005580902, + 0.3997848853468895, + 0.03027408756315708, + 0.03355734795331955, + 0.3135073557496071, + 0.8041638918220997, + 1.0117125622928143, + 0.06517929211258888, + 0.21385003253817558, + 0.35693570226430893, + 0.553995355963707, + 0.5232593063265085, + 1.4856705572456121, + 0.05042671412229538, + 0.3224485442042351, + 0.8835885636508465, + 0.5056367628276348, + 0.383540416136384, + 0.39979440346360207, + 0.822194866836071, + 0.03595472872257233, + 0.0, + 0.7450043484568596, + 5.376172631978989, + 0.8041015397757292, + 0.12207883223891258, + 0.38099582865834236, + 0.10379115678369999, + 0.05146772414445877, + 0.07529383525252342, + 0.2490439284592867, + 0.558545520529151, + 0.3681844640523195, + 0.7392722461372614, + 0.03895038738846779, + 1.5725792720913887, + 0.7138276621699333, + 0.04187551885843277, + 0.318665724247694, + 0.2728691641241312, + 0.06022453121840954, + 0.24299541860818863, + 0.8029642924666405, + 0.26554369553923607, + 1.2897694483399391, + 0.9997734725475311, + 1.0473689436912537, + 0.9797650761902332 + ], + "unique_experts": 63, + "load_cv": 1.3040472073512743, + "normalized_load_entropy": 0.8758973551549205, + "max_load_share": 0.12179487179487179 + }, + "full_input": { + "tokens": 171, + "top_k": 6, + "decisions": 1026, + "ordered_route_sha256": "5f6c92dd115e32ba6eae1a3d823a47f2cc9a7b45f78e753e6d6323e3f1ff111c", + "route_weight_sha256": "7f928bd024d237f2b90e2a744582db781eec3c232e6ffaf1ff2e69f265c258d9", + "loads": [ + 26, + 9, + 7, + 2, + 96, + 5, + 36, + 6, + 16, + 18, + 20, + 15, + 6, + 11, + 6, + 22, + 4, + 12, + 3, + 4, + 7, + 21, + 18, + 5, + 10, + 8, + 19, + 11, + 31, + 20, + 14, + 14, + 9, + 20, + 11, + 16, + 7, + 1, + 12, + 87, + 18, + 7, + 17, + 3, + 19, + 14, + 9, + 19, + 10, + 21, + 2, + 38, + 18, + 3, + 10, + 9, + 5, + 16, + 28, + 10, + 25, + 22, + 18, + 20 + ], + "weighted_loads": [ + 1.4087203536182642, + 0.4769008979201317, + 0.27886241115629673, + 0.08208861947059631, + 5.640699086710811, + 0.1949153058230877, + 2.551891101524234, + 0.4354262463748455, + 0.7742025926709175, + 0.7587365563958883, + 1.1324518341571093, + 0.9830406960099936, + 0.24125428684055805, + 0.7902969419956207, + 0.2552444636821747, + 1.2263112869113684, + 0.1771923005580902, + 0.4713478088378906, + 0.09791247360408306, + 0.15750792622566223, + 0.3135073557496071, + 1.057133810594678, + 1.0117125622928143, + 0.1877221167087555, + 0.44183788634836674, + 0.35693570226430893, + 0.7421406749635935, + 0.5232593063265085, + 1.4856705572456121, + 1.773685036227107, + 0.7158239781856537, + 0.9234417676925659, + 0.5056367628276348, + 1.5827947836369276, + 0.6246451362967491, + 0.9377651624381542, + 0.49403191544115543, + 0.03333931788802147, + 0.7894091904163361, + 5.4722713604569435, + 0.9875813145190477, + 0.28932950645685196, + 1.0432893801480532, + 0.10379115678369999, + 1.3670884892344475, + 1.1921353340148926, + 0.33187599293887615, + 0.9586367327719927, + 0.6836766134947538, + 0.9875089097768068, + 0.07529576495289803, + 1.5725792720913887, + 0.7513456754386425, + 0.12346737086772919, + 0.3898967541754246, + 0.3866767603904009, + 0.20783852599561214, + 0.9513481184840202, + 1.070626301690936, + 0.46018093079328537, + 1.318387158215046, + 1.1194420382380486, + 1.0473689436912537, + 1.0755901783704758 + ], + "unique_experts": 64, + "load_cv": 0.9872692984347411, + "normalized_load_entropy": 0.92086888863232, + "max_load_share": 0.0935672514619883 + } + }, + "s0_period": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "9cb03f0dc5566822c27a6b53f38af11d780c6f320cc13b07afe47275c794e147", + "route_weight_sha256": "fbbedb36ba068a275ba449cea491dd50799b0d1fa82b8cc49f426d138853cb31", + "loads": [ + 21, + 6, + 9, + 3, + 94, + 4, + 7, + 8, + 15, + 18, + 10, + 5, + 5, + 13, + 5, + 14, + 4, + 11, + 0, + 1, + 7, + 16, + 19, + 4, + 4, + 8, + 11, + 9, + 30, + 1, + 6, + 13, + 9, + 7, + 9, + 15, + 2, + 0, + 11, + 85, + 15, + 3, + 10, + 2, + 1, + 2, + 5, + 14, + 9, + 14, + 1, + 34, + 17, + 1, + 12, + 7, + 2, + 5, + 19, + 6, + 25, + 18, + 20, + 19 + ], + "weighted_loads": [ + 1.2283513229340315, + 0.2993769496679306, + 0.34742629900574684, + 0.11755809187889099, + 5.582089086994529, + 0.15619448944926262, + 0.30137233063578606, + 0.5059124790132046, + 0.766806036233902, + 0.7625549491494894, + 0.46088215708732605, + 0.19859907031059265, + 0.20615184679627419, + 0.8576625771820545, + 0.22589938342571259, + 0.6024178117513657, + 0.1811947338283062, + 0.42761892452836037, + 0.0, + 0.034393321722745895, + 0.33713943138718605, + 0.8315412662923336, + 1.0583731327205896, + 0.1219142246991396, + 0.21405762806534767, + 0.3688964359462261, + 0.4345180131494999, + 0.4725037310272455, + 1.4425573274493217, + 0.054103102535009384, + 0.278025358915329, + 0.9062652178108692, + 0.5269490666687489, + 0.35900384187698364, + 0.44670089706778526, + 0.8775132074952126, + 0.0687249656766653, + 0.0, + 0.7479873634874821, + 5.330534569919109, + 0.8211875073611736, + 0.11243409290909767, + 0.4294586293399334, + 0.07131410017609596, + 0.05119135603308678, + 0.07661513984203339, + 0.18275373429059982, + 0.4565127622336149, + 0.42262303456664085, + 0.6596490293741226, + 0.03937636688351631, + 1.4138526748865843, + 0.7460511960089207, + 0.0427665151655674, + 0.4656152091920376, + 0.3101570438593626, + 0.0637368131428957, + 0.24832799285650253, + 0.7029828187078238, + 0.27900197356939316, + 1.3309712950140238, + 0.9509633127599955, + 1.131793448701501, + 1.0260537583380938 + ], + "unique_experts": 62, + "load_cv": 1.2861779738463983, + "normalized_load_entropy": 0.8788906629680946, + "max_load_share": 0.12051282051282051 + }, + "full_input": { + "tokens": 155, + "top_k": 6, + "decisions": 930, + "ordered_route_sha256": "b5bdc7462a93d95164cb7abe7dcc4e60f038bd3d3f2dfebaf89884e01622664b", + "route_weight_sha256": "383f2bb0fcbe5eeed1b7aac1437b49caf23e0c43b0c8685994c4835f7a2a6686", + "loads": [ + 21, + 11, + 9, + 3, + 95, + 4, + 23, + 8, + 15, + 20, + 21, + 10, + 5, + 13, + 6, + 21, + 4, + 12, + 1, + 2, + 7, + 18, + 19, + 4, + 8, + 8, + 14, + 9, + 30, + 15, + 6, + 13, + 9, + 14, + 10, + 16, + 6, + 1, + 11, + 88, + 16, + 5, + 12, + 4, + 12, + 14, + 6, + 16, + 11, + 14, + 2, + 34, + 20, + 4, + 14, + 7, + 5, + 5, + 25, + 10, + 25, + 19, + 20, + 20 + ], + "weighted_loads": [ + 1.2283513229340315, + 0.6792669966816902, + 0.34742629900574684, + 0.11755809187889099, + 5.621277993544936, + 0.15619448944926262, + 1.5866143479943275, + 0.5059124790132046, + 0.766806036233902, + 0.8394619561731815, + 1.188121598213911, + 0.5503113698214293, + 0.20615184679627419, + 0.8576625771820545, + 0.2577068507671356, + 1.0479287132620811, + 0.1811947338283062, + 0.46236446872353554, + 0.04250339791178703, + 0.07956487312912941, + 0.33713943138718605, + 0.9112486690282822, + 1.0583731327205896, + 0.1219142246991396, + 0.4414680916815996, + 0.3688964359462261, + 0.5581934154033661, + 0.4725037310272455, + 1.4425573274493217, + 1.2473138347268105, + 0.278025358915329, + 0.9062652178108692, + 0.5269490666687489, + 1.0487772710621357, + 0.46953273192048073, + 0.9422152936458588, + 0.42375314980745316, + 0.03377975523471832, + 0.7479873634874821, + 5.462819758802652, + 0.9258590526878834, + 0.2052113488316536, + 0.5152567848563194, + 0.18143385276198387, + 0.8272855691611767, + 1.1292756497859955, + 0.2140209637582302, + 0.8495722021907568, + 0.5209104493260384, + 0.6596490293741226, + 0.0776459313929081, + 1.4138526748865843, + 0.8522799797356129, + 0.18070923909544945, + 0.554077448323369, + 0.3101570438593626, + 0.22719343937933445, + 0.24832799285650253, + 1.001495398581028, + 0.48335301503539085, + 1.3309712950140238, + 0.9803672917187214, + 1.131793448701501, + 1.0635795649141073 + ], + "unique_experts": 64, + "load_cv": 1.0732346350176014, + "normalized_load_entropy": 0.912893369694619, + "max_load_share": 0.10215053763440861 + } + }, + "s1_period": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "b512ec1d590ad35078720b4262b36bd59a2b2c6b4ccb5dc575acc08f919a6a99", + "route_weight_sha256": "6e864dc6487e6e00a677d278d39528573af88412938fe573ef3413709b5dfcf2", + "loads": [ + 20, + 6, + 7, + 2, + 93, + 3, + 6, + 8, + 16, + 19, + 10, + 5, + 5, + 10, + 6, + 12, + 4, + 9, + 1, + 1, + 7, + 16, + 18, + 4, + 3, + 9, + 13, + 11, + 32, + 1, + 7, + 13, + 9, + 7, + 8, + 15, + 1, + 0, + 12, + 86, + 15, + 3, + 9, + 3, + 1, + 1, + 7, + 17, + 7, + 15, + 1, + 37, + 18, + 1, + 8, + 6, + 2, + 5, + 20, + 7, + 25, + 19, + 19, + 19 + ], + "weighted_loads": [ + 1.188586138188839, + 0.2900230959057808, + 0.2777388636022806, + 0.08232265710830688, + 5.478361813351512, + 0.1265401691198349, + 0.2842722237110138, + 0.5048767924308777, + 0.7736400347203016, + 0.8088050801306963, + 0.44899785704910755, + 0.1882481761276722, + 0.20339532755315304, + 0.7565265186131, + 0.2553594149649143, + 0.5241163745522499, + 0.1741107515990734, + 0.3615179769694805, + 0.030929939821362495, + 0.03411830589175224, + 0.3260935992002487, + 0.8030511997640133, + 1.0205959267914295, + 0.12113292142748833, + 0.17719636857509613, + 0.4009384736418724, + 0.5167644582688808, + 0.5137416515499353, + 1.5166306216269732, + 0.04900887608528137, + 0.32520097121596336, + 0.8780510574579239, + 0.5103610828518867, + 0.3383515402674675, + 0.39968089759349823, + 0.8503126055002213, + 0.03582548722624779, + 0.0, + 0.7653630543500185, + 5.454180618748069, + 0.8089296370744705, + 0.12279845401644707, + 0.37842463329434395, + 0.10716468840837479, + 0.051689766347408295, + 0.04089834541082382, + 0.24730862863361835, + 0.5632349327206612, + 0.3696114867925644, + 0.7086639776825905, + 0.03649954870343208, + 1.5386882070451975, + 0.76225595921278, + 0.043193086981773376, + 0.3143574260175228, + 0.2770177312195301, + 0.05881696194410324, + 0.23550941422581673, + 0.7742175497114658, + 0.29738254845142365, + 1.3083713725209236, + 0.9947126246988773, + 1.091690355911851, + 1.003345750272274 + ], + "unique_experts": 63, + "load_cv": 1.2987122535122044, + "normalized_load_entropy": 0.8757754192453224, + "max_load_share": 0.11923076923076924 + }, + "full_input": { + "tokens": 171, + "top_k": 6, + "decisions": 1026, + "ordered_route_sha256": "7a31f97e6439f4e3cfc4efb189e41bd9efdf0182d3123cb7ed0c48691ece0e81", + "route_weight_sha256": "6f1aa0094dc8c90f3d0330c6a6472113e4e7fc85e74fffa7d64b4b8214f13a67", + "loads": [ + 25, + 11, + 7, + 2, + 94, + 5, + 34, + 8, + 16, + 20, + 20, + 16, + 5, + 10, + 6, + 20, + 4, + 11, + 3, + 4, + 7, + 20, + 18, + 7, + 8, + 9, + 17, + 11, + 32, + 21, + 14, + 14, + 9, + 20, + 11, + 17, + 7, + 1, + 13, + 88, + 18, + 7, + 17, + 4, + 19, + 13, + 8, + 19, + 10, + 20, + 2, + 37, + 19, + 3, + 10, + 8, + 5, + 16, + 27, + 11, + 26, + 23, + 19, + 20 + ], + "weighted_loads": [ + 1.3935369290411472, + 0.6808003447949886, + 0.2777388636022806, + 0.08232265710830688, + 5.514813086017966, + 0.193668395280838, + 2.468378022313118, + 0.5048767924308777, + 0.7736400347203016, + 0.8393800053745508, + 1.1544119343161583, + 1.006163826212287, + 0.20339532755315304, + 0.7565265186131, + 0.2553594149649143, + 1.032543309032917, + 0.1741107515990734, + 0.43308090046048164, + 0.09856832586228848, + 0.15806888416409492, + 0.3260935992002487, + 1.0199386645108461, + 1.0205959267914295, + 0.24367574602365494, + 0.4758367519825697, + 0.4009384736418724, + 0.6720391605049372, + 0.5137416515499353, + 1.5166306216269732, + 1.818884065374732, + 0.718576405197382, + 0.9179042614996433, + 0.5103610828518867, + 1.5876633934676647, + 0.6245316304266453, + 0.9685645885765553, + 0.513169290497899, + 0.03333931788802147, + 0.809767896309495, + 5.545882588252425, + 0.9893322624266148, + 0.288068737834692, + 1.030336556956172, + 0.14260604605078697, + 1.3396842703223228, + 1.0484134778380394, + 0.2875919323414564, + 0.9633261449635029, + 0.6861716546118259, + 0.9569006413221359, + 0.07284492626786232, + 1.5386882070451975, + 0.7997739724814892, + 0.1247849389910698, + 0.38558845594525337, + 0.349683441221714, + 0.20643095672130585, + 0.9438621141016483, + 1.0369700957089663, + 0.49201978370547295, + 1.3369890823960304, + 1.1504084169864655, + 1.091690355911851, + 1.0563687197864056 + ], + "unique_experts": 64, + "load_cv": 0.9767443575232027, + "normalized_load_entropy": 0.9225526550015644, + "max_load_share": 0.09161793372319688 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 130, + "ordered_topk_exact_tokens": 83, + "set_exact_tokens": 90, + "mean_set_jaccard": 0.9104395604395604, + "mean_token_weighted_tv": 0.01456165023577901, + "aggregate_load_tv": 0.033333333333333326 + }, + "system_bos": { + "tokens": 130, + "ordered_topk_exact_tokens": 73, + "set_exact_tokens": 91, + "mean_set_jaccard": 0.9126373626373626, + "mean_token_weighted_tv": 0.015691419046085616, + "aggregate_load_tv": 0.033333333333333326 + }, + "system_x": { + "tokens": 130, + "ordered_topk_exact_tokens": 64, + "set_exact_tokens": 83, + "mean_set_jaccard": 0.8888278388278389, + "mean_token_weighted_tv": 0.019829026996516265, + "aggregate_load_tv": 0.03717948717948716 + }, + "system_period": { + "tokens": 130, + "ordered_topk_exact_tokens": 63, + "set_exact_tokens": 85, + "mean_set_jaccard": 0.8882783882783882, + "mean_token_weighted_tv": 0.02012628295387213, + "aggregate_load_tv": 0.035897435897435895 + }, + "bos_at_s0": { + "tokens": 130, + "ordered_topk_exact_tokens": 68, + "set_exact_tokens": 86, + "mean_set_jaccard": 0.8917582417582419, + "mean_token_weighted_tv": 0.018921430072245688, + "aggregate_load_tv": 0.03205128205128205 + }, + "bos_at_s1": { + "tokens": 130, + "ordered_topk_exact_tokens": 60, + "set_exact_tokens": 82, + "mean_set_jaccard": 0.8862637362637363, + "mean_token_weighted_tv": 0.01997062323185114, + "aggregate_load_tv": 0.03717948717948717 + }, + "x_at_s0": { + "tokens": 130, + "ordered_topk_exact_tokens": 58, + "set_exact_tokens": 77, + "mean_set_jaccard": 0.8756410256410257, + "mean_token_weighted_tv": 0.021473324520943256, + "aggregate_load_tv": 0.03717948717948717 + }, + "x_at_s1": { + "tokens": 130, + "ordered_topk_exact_tokens": 54, + "set_exact_tokens": 75, + "mean_set_jaccard": 0.8675824175824176, + "mean_token_weighted_tv": 0.02376307439632141, + "aggregate_load_tv": 0.03717948717948718 + }, + "period_at_s0": { + "tokens": 130, + "ordered_topk_exact_tokens": 66, + "set_exact_tokens": 91, + "mean_set_jaccard": 0.9076923076923077, + "mean_token_weighted_tv": 0.017314246210914392, + "aggregate_load_tv": 0.02948717948717948 + }, + "period_at_s1": { + "tokens": 130, + "ordered_topk_exact_tokens": 58, + "set_exact_tokens": 79, + "mean_set_jaccard": 0.8747252747252748, + "mean_token_weighted_tv": 0.023337797340578757, + "aggregate_load_tv": 0.03846153846153846 + } + } + }, + "layer_14": { + "layer": 14, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "af03d37b4eb4a0243dbabc785466c07809c161525c5497d6262d3ca29a1f0e07", + "route_weight_sha256": "1bfe95131f6128be03695189d80704e0e965b4fd992409d7d45f8a6ac5b0b91b", + "loads": [ + 10, + 18, + 14, + 2, + 16, + 3, + 28, + 10, + 13, + 1, + 8, + 6, + 10, + 13, + 11, + 10, + 61, + 17, + 4, + 12, + 7, + 12, + 3, + 2, + 16, + 15, + 6, + 8, + 4, + 15, + 16, + 6, + 17, + 0, + 5, + 7, + 3, + 14, + 13, + 17, + 49, + 15, + 15, + 3, + 3, + 18, + 5, + 19, + 13, + 30, + 9, + 14, + 24, + 10, + 17, + 9, + 16, + 6, + 1, + 15, + 12, + 5, + 15, + 4 + ], + "weighted_loads": [ + 0.4642149247229099, + 0.9791386816650629, + 0.6002750471234322, + 0.06973189488053322, + 1.1182911247015, + 0.18109174631536007, + 2.2344902772456408, + 0.37052081897854805, + 0.8211899753659964, + 0.04761495068669319, + 0.2801738455891609, + 0.4337374418973923, + 0.5214004851877689, + 0.8033686280250549, + 0.4063232075423002, + 0.5559180416166782, + 4.111620364710689, + 0.9959663320332766, + 0.14100392162799835, + 0.6219100616872311, + 0.43298704363405704, + 0.5762260220944881, + 0.09405797719955444, + 0.07427152991294861, + 0.9947250187397003, + 0.8709480203688145, + 0.3169623240828514, + 0.30499690398573875, + 0.22005418315529823, + 0.7374397534877062, + 0.8333190064877272, + 0.2319761998951435, + 1.1493326872587204, + 0.0, + 0.33037570491433144, + 0.3592761177569628, + 0.0932746771723032, + 0.9907735176384449, + 1.303360901772976, + 1.002419836819172, + 2.260537978261709, + 0.6548710390925407, + 0.780792873352766, + 0.10761605016887188, + 0.11560743302106857, + 0.8276421651244164, + 0.23469264805316925, + 1.4281775690615177, + 0.7615846823900938, + 2.2871148213744164, + 0.37500109523534775, + 0.5411714315414429, + 2.120318714529276, + 0.5895764604210854, + 1.8114237897098064, + 0.511394452303648, + 1.1986757218837738, + 0.34186719357967377, + 0.042915862053632736, + 0.634588023647666, + 0.7103127222508192, + 0.21892347931861877, + 1.121517462655902, + 0.13073177635669708 + ], + "unique_experts": 63, + "load_cv": 0.8231847521028767, + "normalized_load_entropy": 0.9337670784017305, + "max_load_share": 0.0782051282051282 + }, + "full_input": { + "tokens": 155, + "top_k": 6, + "decisions": 930, + "ordered_route_sha256": "8403ebc664e39d7cc70333e8abeec90222fd5fa9d0b5aa266c9f8a6613a55edd", + "route_weight_sha256": "a44a301960c9dfe281f87a9dbc102a065d09372723d20b3b93f3658355c3e72d", + "loads": [ + 16, + 18, + 14, + 3, + 17, + 14, + 28, + 12, + 13, + 8, + 10, + 9, + 10, + 13, + 11, + 13, + 61, + 17, + 8, + 14, + 7, + 12, + 3, + 13, + 17, + 18, + 12, + 14, + 11, + 15, + 19, + 11, + 17, + 7, + 5, + 7, + 4, + 16, + 15, + 18, + 49, + 15, + 16, + 4, + 5, + 18, + 12, + 22, + 13, + 31, + 14, + 20, + 30, + 16, + 17, + 12, + 16, + 6, + 1, + 25, + 12, + 6, + 15, + 5 + ], + "weighted_loads": [ + 1.113894920796156, + 0.9791386816650629, + 0.6002750471234322, + 0.10961873084306717, + 1.1603510044515133, + 1.14124358817935, + 2.2344902772456408, + 0.4434969760477543, + 0.8211899753659964, + 0.5287566781044006, + 0.34665351547300816, + 0.625135101377964, + 0.5214004851877689, + 0.8033686280250549, + 0.4063232075423002, + 0.6733440421521664, + 4.111620364710689, + 0.9959663320332766, + 0.4195954166352749, + 0.9837117493152618, + 0.43298704363405704, + 0.5762260220944881, + 0.09405797719955444, + 0.5447769220918417, + 1.017344692721963, + 1.027556300163269, + 0.665525134652853, + 0.7500460352748632, + 1.4251795448362827, + 0.7374397534877062, + 1.0048527959734201, + 0.4367988891899586, + 1.1493326872587204, + 0.859270166605711, + 0.33037570491433144, + 0.3592761177569628, + 0.1452732067555189, + 1.0890426747500896, + 1.43940020352602, + 1.0542681477963924, + 2.260537978261709, + 0.6548710390925407, + 0.8411799445748329, + 0.1559258345514536, + 0.1789737343788147, + 0.8276421651244164, + 0.6280046757310629, + 1.5783683750778437, + 0.7615846823900938, + 2.3304970152676105, + 0.5812583453953266, + 1.883204085752368, + 2.866415936499834, + 1.0155054070055485, + 1.8114237897098064, + 0.7757019735872746, + 1.1986757218837738, + 0.34186719357967377, + 0.042915862053632736, + 1.093938136473298, + 0.7103127222508192, + 0.22393982904031873, + 1.121517462655902, + 0.21775703132152557 + ], + "unique_experts": 64, + "load_cv": 0.6579344871184426, + "normalized_load_entropy": 0.9574344628244242, + "max_load_share": 0.06559139784946237 + } + }, + "s1_eos": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "98a296ae61b86987a834595c23f1a9fc8c4c59a73c946b35e77ce79a62abc469", + "route_weight_sha256": "a6b7d86f7d924a8aa5fdaacc18f7ab21b0236d9735076f6dd451caf3987bf860", + "loads": [ + 10, + 21, + 15, + 2, + 16, + 3, + 28, + 12, + 13, + 1, + 10, + 7, + 11, + 11, + 12, + 10, + 59, + 17, + 4, + 12, + 8, + 12, + 3, + 1, + 16, + 15, + 5, + 8, + 4, + 14, + 16, + 6, + 15, + 0, + 5, + 7, + 3, + 14, + 13, + 17, + 53, + 14, + 16, + 3, + 3, + 16, + 4, + 19, + 12, + 31, + 8, + 15, + 24, + 9, + 17, + 10, + 15, + 6, + 1, + 13, + 12, + 5, + 15, + 3 + ], + "weighted_loads": [ + 0.45606474578380585, + 1.0652404967695475, + 0.6276447717100382, + 0.06913130357861519, + 1.1150713078677654, + 0.18426757864654064, + 2.244584897533059, + 0.4233285542577505, + 0.8147671520709991, + 0.04718112573027611, + 0.3529456853866577, + 0.4712166003882885, + 0.5517935678362846, + 0.6999368462711573, + 0.433894170448184, + 0.5630189031362534, + 4.016065334901214, + 0.9902293216437101, + 0.14077770337462425, + 0.6307822056114674, + 0.47049355879426, + 0.5764693729579449, + 0.09207893535494804, + 0.0405886210501194, + 0.9966331254690886, + 0.8729234486818314, + 0.2835010476410389, + 0.30324970930814743, + 0.218497596681118, + 0.7062713764607906, + 0.8446401115506887, + 0.2286118119955063, + 1.1066453531384468, + 0.0, + 0.3318464048206806, + 0.3676441106945276, + 0.09564220160245895, + 0.985201932489872, + 1.3067117892205715, + 1.0195113196969032, + 2.3879504352808, + 0.6277300789952278, + 0.7983411643654108, + 0.10837769135832787, + 0.11800821125507355, + 0.7588363010436296, + 0.20363016799092293, + 1.4104836899787188, + 0.7249118518084288, + 2.3290067054331303, + 0.3337779324501753, + 0.5550581905990839, + 2.131738629192114, + 0.570495031774044, + 1.7936157248914242, + 0.537445031106472, + 1.1893106754869223, + 0.3557235933840275, + 0.04270000010728836, + 0.5751819480210543, + 0.7039787918329239, + 0.21633855253458023, + 1.12328084371984, + 0.10608606040477753 + ], + "unique_experts": 63, + "load_cv": 0.8352364855840266, + "normalized_load_entropy": 0.9316813428553795, + "max_load_share": 0.07564102564102564 + }, + "full_input": { + "tokens": 171, + "top_k": 6, + "decisions": 1026, + "ordered_route_sha256": "caf8e6b4f3b276e6eff4c9549c09a8e70abe642958eae0ce104d5990438365c4", + "route_weight_sha256": "444b258bb3a3cb75dedd57a663b78e3c90aede024f0b2a0d89d1597e3b6dd4ae", + "loads": [ + 19, + 22, + 15, + 4, + 20, + 20, + 28, + 16, + 15, + 11, + 10, + 10, + 16, + 11, + 12, + 14, + 59, + 17, + 11, + 17, + 10, + 15, + 3, + 10, + 22, + 20, + 10, + 16, + 16, + 15, + 21, + 9, + 17, + 11, + 6, + 8, + 3, + 18, + 16, + 19, + 53, + 14, + 18, + 4, + 5, + 16, + 11, + 22, + 15, + 32, + 24, + 18, + 32, + 18, + 19, + 12, + 16, + 7, + 2, + 30, + 15, + 7, + 17, + 7 + ], + "weighted_loads": [ + 1.2565614078193903, + 1.1168228816241026, + 0.6276447717100382, + 0.14498808234930038, + 1.3660253137350082, + 1.340426493436098, + 2.244584897533059, + 0.5889297593384981, + 0.980981670320034, + 0.8205590546131134, + 0.3529456853866577, + 0.6886265091598034, + 0.9036334455013275, + 0.6999368462711573, + 0.433894170448184, + 0.742799311876297, + 4.016065334901214, + 0.9902293216437101, + 0.6060333233326674, + 1.1450005639344454, + 0.6992778107523918, + 0.6990182977169752, + 0.09207893535494804, + 0.41970669105648994, + 1.2764681950211525, + 1.1020974982529879, + 0.6440547555685043, + 0.6661435943096876, + 1.9682101607322693, + 0.7553994245827198, + 1.0703958757221699, + 0.3168900767341256, + 1.1853770352900028, + 1.3288128189742565, + 0.38065003603696823, + 0.44730655290186405, + 0.09564220160245895, + 1.4016780816018581, + 1.5269148871302605, + 1.1406508162617683, + 2.3879504352808, + 0.6277300789952278, + 0.8958192598074675, + 0.15485718101263046, + 0.1787856575101614, + 0.7588363010436296, + 0.6281305085867643, + 1.5477087702602148, + 0.8809264451265335, + 2.362973492592573, + 1.323941981419921, + 1.8024546336382627, + 2.9282250702381134, + 1.258205596357584, + 1.8772254846990108, + 0.7276276051998138, + 1.2426453884691, + 0.39397986605763435, + 0.15279557555913925, + 1.563142342492938, + 0.9571161009371281, + 0.2630139193497598, + 1.2266944367438555, + 0.30000196769833565 + ], + "unique_experts": 64, + "load_cv": 0.6095819213993986, + "normalized_load_entropy": 0.9615735286322716, + "max_load_share": 0.057504873294346975 + } + }, + "s0_bos": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "58fad7e11e24886118c375b377e1cbd3481841826f3e2a199a90b4e0dcf489be", + "route_weight_sha256": "250861bcd8b3bc02fcf94f786ec2d6b40cacc1bc6d159ffab4eaa65265f6c41e", + "loads": [ + 11, + 20, + 14, + 2, + 16, + 3, + 27, + 8, + 14, + 1, + 7, + 6, + 10, + 11, + 12, + 10, + 59, + 15, + 4, + 14, + 7, + 12, + 2, + 2, + 17, + 15, + 6, + 12, + 3, + 14, + 15, + 9, + 15, + 1, + 5, + 7, + 3, + 14, + 13, + 16, + 51, + 18, + 17, + 3, + 3, + 19, + 6, + 19, + 11, + 28, + 8, + 13, + 23, + 10, + 18, + 10, + 16, + 6, + 1, + 13, + 12, + 5, + 15, + 3 + ], + "weighted_loads": [ + 0.48583986051380634, + 1.08700430393219, + 0.6168213821947575, + 0.0677793137729168, + 1.129549641162157, + 0.1783718205988407, + 2.208539132028818, + 0.28820175491273403, + 0.8489572368562222, + 0.04779084026813507, + 0.2588730864226818, + 0.4326162189245224, + 0.5099419765174389, + 0.7310327403247356, + 0.425146272405982, + 0.5638312250375748, + 4.103879792615771, + 0.9257948659360409, + 0.13212642632424831, + 0.724215442314744, + 0.47990579158067703, + 0.578848272562027, + 0.06183168850839138, + 0.06496090069413185, + 1.0247814748436213, + 0.8520836345851421, + 0.33118051290512085, + 0.4388800077140331, + 0.197910338640213, + 0.7270901575684547, + 0.807502381503582, + 0.31203664653003216, + 1.0882458295673132, + 0.053951334208250046, + 0.3234252743422985, + 0.37116312608122826, + 0.09567148238420486, + 0.9962567500770092, + 1.3005848079919815, + 0.9678713791072369, + 2.373783962801099, + 0.7622714042663574, + 0.8331812676042318, + 0.10749122314155102, + 0.11924566328525543, + 0.8290624059736729, + 0.2737095393240452, + 1.4512175992131233, + 0.7137699499726295, + 2.19152944535017, + 0.3384903222322464, + 0.4989134855568409, + 2.056095350533724, + 0.5816432908177376, + 1.803238881751895, + 0.5297190938144922, + 1.18185506016016, + 0.3588401861488819, + 0.0412026047706604, + 0.5835500601679087, + 0.7131990864872932, + 0.21913185715675354, + 1.1303734071552753, + 0.1071892324835062 + ], + "unique_experts": 64, + "load_cv": 0.8153523618842612, + "normalized_load_entropy": 0.9348569451112732, + "max_load_share": 0.07564102564102564 + }, + "full_input": { + "tokens": 155, + "top_k": 6, + "decisions": 930, + "ordered_route_sha256": "56e6f4ef3624a7cb53f8e93e89497182623f7ed34b34653eb784ce1d41209388", + "route_weight_sha256": "c4e4302cb20b8795a9ca73f677c24c6f7c922c357700239534adc3c6eaaca0f6", + "loads": [ + 18, + 20, + 14, + 4, + 17, + 13, + 27, + 9, + 14, + 8, + 9, + 9, + 10, + 11, + 12, + 13, + 59, + 15, + 9, + 16, + 7, + 12, + 2, + 12, + 18, + 18, + 12, + 18, + 11, + 14, + 18, + 13, + 15, + 8, + 5, + 7, + 4, + 16, + 15, + 17, + 51, + 18, + 18, + 4, + 6, + 19, + 12, + 22, + 11, + 29, + 12, + 19, + 29, + 16, + 18, + 13, + 16, + 7, + 2, + 23, + 12, + 5, + 15, + 4 + ], + "weighted_loads": [ + 1.1692326497286558, + 1.08700430393219, + 0.6168213821947575, + 0.1498766839504242, + 1.1709748581051826, + 1.0972131695598364, + 2.208539132028818, + 0.32178146578371525, + 0.8489572368562222, + 0.5698634050786495, + 0.32535275630652905, + 0.6240138784050941, + 0.5099419765174389, + 0.7310327403247356, + 0.425146272405982, + 0.7108987085521221, + 4.103879792615771, + 0.9257948659360409, + 0.5109823551028967, + 1.0906055252999067, + 0.47990579158067703, + 0.578848272562027, + 0.06183168850839138, + 0.5077696666121483, + 1.0474011488258839, + 1.018970426172018, + 0.6797433234751225, + 0.9259517788887024, + 1.5045825093984604, + 0.7270901575684547, + 0.9807874690741301, + 0.5163909774273634, + 1.0882458295673132, + 0.8952142149209976, + 0.3234252743422985, + 0.37116312608122826, + 0.14767001196742058, + 1.093319844454527, + 1.4404812306165695, + 1.0307182632386684, + 2.373783962801099, + 0.7622714042663574, + 0.8908819649368525, + 0.15580100752413273, + 0.2577759027481079, + 0.8290624059736729, + 0.5931555833667517, + 1.606336472555995, + 0.7137699499726295, + 2.2349116392433643, + 0.5110473856329918, + 1.033814799040556, + 2.802192572504282, + 1.0075722374022007, + 1.803238881751895, + 0.8199084643274546, + 1.18185506016016, + 0.4018492102622986, + 0.08300894126296043, + 1.0429001729935408, + 0.7131990864872932, + 0.21913185715675354, + 1.1303734071552753, + 0.19733756966888905 + ], + "unique_experts": 64, + "load_cv": 0.6494445628835378, + "normalized_load_entropy": 0.9583836511702127, + "max_load_share": 0.06344086021505377 + } + }, + "s1_bos": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "951d0defaf1b4d1520dd298a4352d7314367ac148494bbc52bd45cc79a63dcac", + "route_weight_sha256": "afb2465cb0b86029da7d7d701f86e53d7c80ddbf223c0a40414105c539032258", + "loads": [ + 11, + 18, + 14, + 3, + 16, + 4, + 26, + 9, + 13, + 1, + 7, + 6, + 11, + 11, + 10, + 10, + 61, + 16, + 3, + 13, + 7, + 13, + 2, + 1, + 16, + 15, + 5, + 6, + 3, + 15, + 16, + 7, + 14, + 1, + 5, + 8, + 3, + 14, + 13, + 18, + 53, + 17, + 15, + 2, + 2, + 21, + 5, + 20, + 11, + 31, + 7, + 14, + 23, + 10, + 19, + 9, + 16, + 6, + 1, + 17, + 12, + 5, + 15, + 4 + ], + "weighted_loads": [ + 0.47781915590167046, + 0.9790734108537436, + 0.6100689955055714, + 0.09267008304595947, + 1.1224072948098183, + 0.20753458887338638, + 2.1978685408830643, + 0.3174874596297741, + 0.8110269289463758, + 0.05318977311253548, + 0.2696240898221731, + 0.44574282318353653, + 0.5449708215892315, + 0.7223372422158718, + 0.355440229177475, + 0.5672405585646629, + 4.156048404052854, + 0.9264464974403381, + 0.09364384599030018, + 0.6677154172211885, + 0.4584466777741909, + 0.615058483555913, + 0.05979781225323677, + 0.03850362449884415, + 0.9772829618304968, + 0.8496686071157455, + 0.291083212941885, + 0.21342477574944496, + 0.20140907168388367, + 0.7590963076800108, + 0.8403387889266014, + 0.25959217734634876, + 1.0409280247986317, + 0.05821336433291435, + 0.3306998535990715, + 0.39914087019860744, + 0.1023609172552824, + 0.994675699621439, + 1.324734315276146, + 1.048727173358202, + 2.454677600413561, + 0.722587225958705, + 0.7698981091380119, + 0.07747770473361015, + 0.08161913603544235, + 0.898371322080493, + 0.23271730728447437, + 1.4351113233715296, + 0.7061278261244297, + 2.270252350717783, + 0.2948991637676954, + 0.5155499670654535, + 2.0827059373259544, + 0.5645772777497768, + 1.8551719691604376, + 0.49492771178483963, + 1.228847250342369, + 0.3588223308324814, + 0.041963353753089905, + 0.7139514498412609, + 0.7273325957357883, + 0.21222347393631935, + 1.1066908407956362, + 0.14094967395067215 + ], + "unique_experts": 64, + "load_cv": 0.8519459876142182, + "normalized_load_entropy": 0.9297987109015444, + "max_load_share": 0.0782051282051282 + }, + "full_input": { + "tokens": 171, + "top_k": 6, + "decisions": 1026, + "ordered_route_sha256": "e59bcddd4818e78b0051f96ed21f380a096768ffb2ec42ead01a52815c794d5c", + "route_weight_sha256": "0e25ab9afe1b3e3c075ede06b620f7da1b00ba7ed6652f7bc24f66fa77dfab50", + "loads": [ + 21, + 19, + 14, + 5, + 20, + 20, + 26, + 12, + 15, + 11, + 7, + 9, + 16, + 11, + 10, + 14, + 61, + 16, + 10, + 18, + 9, + 15, + 2, + 9, + 22, + 20, + 10, + 14, + 16, + 16, + 21, + 10, + 16, + 12, + 6, + 9, + 3, + 17, + 16, + 20, + 53, + 17, + 17, + 3, + 5, + 22, + 12, + 23, + 14, + 32, + 23, + 18, + 31, + 19, + 21, + 11, + 17, + 8, + 2, + 34, + 15, + 6, + 17, + 8 + ], + "weighted_loads": [ + 1.3130742702633142, + 1.0306557957082987, + 0.6100689955055714, + 0.18174827098846436, + 1.3739654533565044, + 1.3256167154759169, + 2.1978685408830643, + 0.445740707218647, + 0.9772414471954107, + 0.8686240687966347, + 0.2696240898221731, + 0.6631527319550514, + 0.8968106992542744, + 0.7223372422158718, + 0.355440229177475, + 0.7563183270394802, + 4.156048404052854, + 0.9264464974403381, + 0.5340657457709312, + 1.1931626051664352, + 0.6872309297323227, + 0.6889796890318394, + 0.05979781225323677, + 0.3901815041899681, + 1.2571180313825607, + 1.0828182268887758, + 0.6516369208693504, + 0.6498683150857687, + 2.1033731773495674, + 0.80822435580194, + 1.0737615879625082, + 0.3975240867584944, + 1.1196597069501877, + 1.3683665618300438, + 0.3795034848153591, + 0.47880331240594387, + 0.1023609172552824, + 1.3522618561983109, + 1.5389575622975826, + 1.174122091382742, + 2.454677600413561, + 0.722587225958705, + 0.8831513524055481, + 0.12395719438791275, + 0.18261844478547573, + 0.9396658819168806, + 0.6383262351155281, + 1.574263235554099, + 0.8621424194425344, + 2.304219137877226, + 1.2806031610816717, + 0.975513456389308, + 2.879192378371954, + 1.2522878423333168, + 1.9387817289680243, + 0.7348044812679291, + 1.2821819633245468, + 0.43925681337714195, + 0.1520589292049408, + 1.7019118443131447, + 0.9804699048399925, + 0.25413474813103676, + 1.2101044338196516, + 0.3365090675652027 + ], + "unique_experts": 64, + "load_cv": 0.6287297657124308, + "normalized_load_entropy": 0.9591276568871717, + "max_load_share": 0.0594541910331384 + } + }, + "s0_x": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "14bc87fd895f800559ddf85f9cbb005d8cc17ff8da781a93158113b91e3b53ce", + "route_weight_sha256": "871eb89de22b5d34ee70936964bd2743bb501fc13de3989234b72cd4b82c3867", + "loads": [ + 10, + 19, + 14, + 4, + 16, + 3, + 26, + 7, + 15, + 1, + 6, + 6, + 10, + 12, + 11, + 10, + 61, + 16, + 4, + 12, + 9, + 12, + 2, + 2, + 16, + 16, + 6, + 7, + 3, + 12, + 15, + 7, + 14, + 1, + 5, + 8, + 3, + 14, + 12, + 18, + 52, + 17, + 16, + 3, + 3, + 19, + 6, + 20, + 12, + 29, + 9, + 13, + 26, + 10, + 19, + 10, + 16, + 6, + 1, + 14, + 11, + 5, + 14, + 4 + ], + "weighted_loads": [ + 0.4683324247598648, + 1.0195751264691353, + 0.6264575868844986, + 0.12113078311085701, + 1.1221311837434769, + 0.17665491811931133, + 2.143984381109476, + 0.26041935570538044, + 0.8694926612079144, + 0.051527902483940125, + 0.23589543625712395, + 0.44135931879282, + 0.5082464255392551, + 0.7734252624213696, + 0.39367228746414185, + 0.5801008865237236, + 4.207270825281739, + 0.9425028823316097, + 0.13345276564359665, + 0.6390954423695803, + 0.5412875507026911, + 0.5740483924746513, + 0.06190141476690769, + 0.08107486739754677, + 0.9951592870056629, + 0.9185522980988026, + 0.3309716060757637, + 0.25628259032964706, + 0.2021586410701275, + 0.6438916884362698, + 0.8090120889246464, + 0.2534481808543205, + 1.0355314034968615, + 0.05816621333360672, + 0.33209455013275146, + 0.39554513432085514, + 0.09570604376494884, + 0.9916810058057308, + 1.278511855751276, + 1.0516527779400349, + 2.4126085843890905, + 0.7357699945569038, + 0.8107655271887779, + 0.10663645155727863, + 0.11191517673432827, + 0.8415641840547323, + 0.2726151645183563, + 1.4389502219855785, + 0.751150444149971, + 2.268291838467121, + 0.37344837561249733, + 0.4902524799108505, + 2.1946149729192257, + 0.5944810546934605, + 1.8073009047657251, + 0.5344295054674149, + 1.1879857312887907, + 0.34779635816812515, + 0.04566025733947754, + 0.6192451491951942, + 0.685119267553091, + 0.21338601410388947, + 1.1009375602006912, + 0.1426647435873747 + ], + "unique_experts": 64, + "load_cv": 0.8367464620081182, + "normalized_load_entropy": 0.9334178126221809, + "max_load_share": 0.0782051282051282 + }, + "full_input": { + "tokens": 155, + "top_k": 6, + "decisions": 930, + "ordered_route_sha256": "74ec4dc4b3327c0c20ed57674da5121846876cd0e817d94f55bdec18eaaffe8c", + "route_weight_sha256": "3202874b9b272af9aaee25656f68c39838b25878605a317c51f7cfe79444c29b", + "loads": [ + 17, + 19, + 14, + 5, + 17, + 16, + 26, + 8, + 15, + 7, + 8, + 9, + 10, + 12, + 11, + 13, + 61, + 16, + 7, + 15, + 9, + 12, + 2, + 12, + 17, + 19, + 13, + 12, + 10, + 12, + 17, + 11, + 14, + 8, + 5, + 8, + 4, + 16, + 14, + 19, + 52, + 17, + 18, + 4, + 5, + 19, + 12, + 23, + 12, + 30, + 14, + 17, + 32, + 17, + 19, + 14, + 16, + 7, + 1, + 26, + 11, + 5, + 14, + 5 + ], + "weighted_loads": [ + 1.2256692945957184, + 1.0195751264691353, + 0.6264575868844986, + 0.16101761907339096, + 1.1636360734701157, + 1.279544934630394, + 2.143984381109476, + 0.29399906657636166, + 0.8694926612079144, + 0.48391057550907135, + 0.3023751061409712, + 0.6327569782733917, + 0.5082464255392551, + 0.7734252624213696, + 0.39367228746414185, + 0.7067002356052399, + 4.207270825281739, + 0.9425028823316097, + 0.3428780473768711, + 1.0607376899570227, + 0.5412875507026911, + 0.5740483924746513, + 0.06190141476690769, + 0.5238836333155632, + 1.0177789609879255, + 1.0908227674663067, + 0.7911927439272404, + 0.6754251383244991, + 1.2220309488475323, + 0.6438916884362698, + 0.9645801596343517, + 0.45330655947327614, + 1.0355314034968615, + 0.9267777167260647, + 0.33209455013275146, + 0.39554513432085514, + 0.14770457334816456, + 1.1085482984781265, + 1.4058227203786373, + 1.1124616041779518, + 2.4126085843890905, + 0.7357699945569038, + 0.9167254790663719, + 0.15494623593986034, + 0.1752814780920744, + 0.8415641840547323, + 0.6106533464044333, + 1.5782894250005484, + 0.751150444149971, + 2.3116740323603153, + 0.6029716022312641, + 0.9494351930916309, + 2.940712194889784, + 1.1042666137218475, + 1.8073009047657251, + 0.8325719200074673, + 1.1879857312887907, + 0.3887360394001007, + 0.04566025733947754, + 1.1592426970601082, + 0.685119267553091, + 0.21338601410388947, + 1.1009375602006912, + 0.22819115780293941 + ], + "unique_experts": 64, + "load_cv": 0.6748132152506601, + "normalized_load_entropy": 0.9557146423657301, + "max_load_share": 0.06559139784946237 + } + }, + "s1_x": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "5b95503f0ace5c120085545791493230d3a4d3b8afb65bde1b3955fcef6c6322", + "route_weight_sha256": "4ba6d6e65fa453407d4012f92fe6235b42ad9c7f4819a2619ef52d3ef2b5fd7a", + "loads": [ + 10, + 19, + 15, + 2, + 16, + 4, + 26, + 10, + 14, + 1, + 6, + 6, + 11, + 13, + 9, + 10, + 60, + 15, + 3, + 12, + 7, + 13, + 2, + 1, + 16, + 15, + 5, + 7, + 4, + 14, + 15, + 6, + 14, + 1, + 5, + 8, + 3, + 14, + 14, + 18, + 56, + 18, + 18, + 2, + 3, + 18, + 3, + 18, + 12, + 30, + 9, + 13, + 23, + 10, + 17, + 9, + 18, + 6, + 1, + 17, + 11, + 4, + 15, + 5 + ], + "weighted_loads": [ + 0.4503002166748047, + 0.9789217356592417, + 0.6539214923977852, + 0.06738737970590591, + 1.1084353439509869, + 0.22933585941791534, + 2.146539106965065, + 0.35419545508921146, + 0.8113179877400398, + 0.055784910917282104, + 0.225434934720397, + 0.436885979026556, + 0.5360757559537888, + 0.771393308416009, + 0.32644310779869556, + 0.5615422502160072, + 4.168019823729992, + 0.9065060149878263, + 0.10048802569508553, + 0.6267234552651644, + 0.4655241873115301, + 0.6223465949296951, + 0.058646636083722115, + 0.043253373354673386, + 0.9738761764019728, + 0.849674791097641, + 0.29697177186608315, + 0.24968536011874676, + 0.2419789806008339, + 0.7319197580218315, + 0.8189129717648029, + 0.2195515390485525, + 1.0286316014826298, + 0.05202193185687065, + 0.3313622921705246, + 0.3953319527208805, + 0.1037318967282772, + 0.9871681332588196, + 1.3223848957568407, + 1.0301555655896664, + 2.5880056377500296, + 0.7373925969004631, + 0.8451755233108997, + 0.08003929257392883, + 0.10787634551525116, + 0.8311474602669477, + 0.16720307059586048, + 1.3527854308485985, + 0.725249283015728, + 2.266980526968837, + 0.37485512532293797, + 0.491155207157135, + 2.046610029414296, + 0.5734946765005589, + 1.7955544032156467, + 0.48901794850826263, + 1.2978193536400795, + 0.34914176538586617, + 0.043520279228687286, + 0.7213438432663679, + 0.6902103200554848, + 0.16138248518109322, + 1.1044881008565426, + 0.17084085009992123 + ], + "unique_experts": 64, + "load_cv": 0.8578523096322317, + "normalized_load_entropy": 0.9292617468521363, + "max_load_share": 0.07692307692307693 + }, + "full_input": { + "tokens": 171, + "top_k": 6, + "decisions": 1026, + "ordered_route_sha256": "dcfe9f2d0d530b63a2e87bc703c778b89dfdc5a8583f7ba03701547679be7805", + "route_weight_sha256": "dbc72b3430ca12ba4c805a17c1afb5768fed731227b5ee5da37689ac225703c4", + "loads": [ + 20, + 20, + 15, + 3, + 20, + 23, + 26, + 13, + 16, + 10, + 6, + 10, + 16, + 13, + 9, + 13, + 60, + 15, + 9, + 17, + 9, + 15, + 2, + 10, + 22, + 20, + 11, + 15, + 16, + 15, + 20, + 8, + 16, + 12, + 6, + 9, + 3, + 18, + 17, + 20, + 56, + 18, + 20, + 3, + 5, + 18, + 10, + 21, + 15, + 31, + 25, + 15, + 31, + 20, + 19, + 12, + 19, + 7, + 2, + 36, + 14, + 5, + 17, + 9 + ], + "weighted_loads": [ + 1.3326536286622286, + 1.0305041205137968, + 0.6539214923977852, + 0.1062941625714302, + 1.3631186224520206, + 1.5732518639415503, + 2.146539106965065, + 0.4824487026780844, + 0.9775325059890747, + 0.7881383188068867, + 0.225434934720397, + 0.7030854262411594, + 0.8879156336188316, + 0.771393308416009, + 0.32644310779869556, + 0.7263896502554417, + 4.168019823729992, + 0.9065060149878263, + 0.4855474289506674, + 1.1504607945680618, + 0.6943084392696619, + 0.6962678004056215, + 0.058646636083722115, + 0.4465249329805374, + 1.2537112459540367, + 1.0886328648775816, + 0.7625266090035439, + 0.6223903186619282, + 1.8199566155672073, + 0.7810478061437607, + 1.0669699609279633, + 0.2970710936933756, + 1.1073632836341858, + 1.2876908257603645, + 0.3801659233868122, + 0.47499439492821693, + 0.1037318967282772, + 1.4417401067912579, + 1.5162698347121477, + 1.1596381776034832, + 2.5880056377500296, + 0.7373925969004631, + 0.9526394046843052, + 0.12651878222823143, + 0.168653791770339, + 0.8311474602669477, + 0.5921375304460526, + 1.4836670346558094, + 0.8812638763338327, + 2.3009473141282797, + 1.3835713509470224, + 0.8900572061538696, + 2.8430964704602957, + 1.3840973302721977, + 1.8791641630232334, + 0.7024382539093494, + 1.3511540666222572, + 0.38739803805947304, + 0.15361585468053818, + 1.7918341886252165, + 0.943347629159689, + 0.20329375937581062, + 1.207901693880558, + 0.3714084643870592 + ], + "unique_experts": 64, + "load_cv": 0.6433545936755086, + "normalized_load_entropy": 0.9569701102535155, + "max_load_share": 0.05847953216374269 + } + }, + "s0_period": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "8517f859ddae6b4e1ea8f55ea432a56c64af7dcd1e6542dbbbc7798d21713c46", + "route_weight_sha256": "8303fa5c91770637f9455421bf4e03f7c14e2ce81080e41f0473e3b0be3d20b5", + "loads": [ + 10, + 19, + 15, + 4, + 17, + 4, + 26, + 10, + 15, + 1, + 7, + 6, + 11, + 12, + 11, + 10, + 59, + 16, + 3, + 11, + 9, + 13, + 2, + 2, + 16, + 14, + 6, + 9, + 3, + 15, + 15, + 6, + 15, + 1, + 5, + 8, + 3, + 14, + 12, + 17, + 51, + 17, + 16, + 3, + 5, + 19, + 6, + 20, + 12, + 29, + 9, + 10, + 26, + 10, + 16, + 10, + 16, + 6, + 1, + 13, + 10, + 5, + 14, + 4 + ], + "weighted_loads": [ + 0.4588630832731724, + 1.01253267750144, + 0.6487030815333128, + 0.11915143206715584, + 1.1595870573073626, + 0.21359376050531864, + 2.134887557476759, + 0.3583979345858097, + 0.8662957567721605, + 0.05727507919073105, + 0.2535509280860424, + 0.4421396590769291, + 0.5517721995711327, + 0.7700635865330696, + 0.3913142252713442, + 0.5735998824238777, + 4.111781757324934, + 0.9536185711622238, + 0.09943359531462193, + 0.5862270630896091, + 0.5231228936463594, + 0.6017325650900602, + 0.0633687749505043, + 0.08095460757613182, + 0.9938178304582834, + 0.8267394937574863, + 0.33458980917930603, + 0.3357863109558821, + 0.20338601991534233, + 0.754651166498661, + 0.8074366338551044, + 0.22006782703101635, + 1.0699731092900038, + 0.058852728456258774, + 0.33034052699804306, + 0.3901689685881138, + 0.09397515095770359, + 0.9976446405053139, + 1.2801038697361946, + 1.006139189004898, + 2.387974428012967, + 0.7211290504783392, + 0.8165692798793316, + 0.10455944389104843, + 0.17178617045283318, + 0.841386353597045, + 0.2701763603836298, + 1.4362237229943275, + 0.7610765434801579, + 2.2500052712857723, + 0.3733226992189884, + 0.40941106528043747, + 2.2084577456116676, + 0.5842174403369427, + 1.735168930143118, + 0.5456183478236198, + 1.2090788669884205, + 0.3494514599442482, + 0.04537905752658844, + 0.5942136906087399, + 0.6569796837866306, + 0.21017921343445778, + 1.1008277088403702, + 0.14226681925356388 + ], + "unique_experts": 64, + "load_cv": 0.8134148114521945, + "normalized_load_entropy": 0.9363663431108152, + "max_load_share": 0.07564102564102564 + }, + "full_input": { + "tokens": 155, + "top_k": 6, + "decisions": 930, + "ordered_route_sha256": "60eba64a59557b6049eefa35d3333771654a1921b15f70a74aa121ae225722d5", + "route_weight_sha256": "778fff41ed4c6b5c11fd802aeed28085435c7937a1a4a9d792d4eae8e6497ccd", + "loads": [ + 17, + 19, + 15, + 5, + 18, + 16, + 26, + 11, + 15, + 7, + 9, + 9, + 11, + 12, + 11, + 13, + 59, + 16, + 7, + 13, + 9, + 13, + 2, + 12, + 17, + 17, + 13, + 15, + 10, + 15, + 18, + 10, + 15, + 8, + 5, + 8, + 5, + 16, + 14, + 18, + 51, + 17, + 17, + 4, + 7, + 19, + 11, + 24, + 12, + 31, + 14, + 14, + 32, + 17, + 16, + 14, + 16, + 7, + 1, + 23, + 10, + 5, + 14, + 5 + ], + "weighted_loads": [ + 1.1567803248763084, + 1.01253267750144, + 0.6487030815333128, + 0.1590382680296898, + 1.201970113441348, + 1.2401352114975452, + 2.134887557476759, + 0.3919776454567909, + 0.8662957567721605, + 0.5071259327232838, + 0.32003059796988964, + 0.6335373185575008, + 0.5517721995711327, + 0.7700635865330696, + 0.3913142252713442, + 0.7022470720112324, + 4.111781757324934, + 0.9536185711622238, + 0.36926830001175404, + 0.9393766894936562, + 0.5231228936463594, + 0.6017325650900602, + 0.0633687749505043, + 0.5237633734941483, + 1.016437504440546, + 1.0027682296931744, + 0.7360392101109028, + 0.799611946567893, + 1.3080140091478825, + 0.754651166498661, + 0.9871498327702284, + 0.41785611398518085, + 1.0699731092900038, + 0.8821236304938793, + 0.33034052699804306, + 0.3901689685881138, + 0.18989728204905987, + 1.0999207235872746, + 1.4049195498228073, + 1.0703964829444885, + 2.387974428012967, + 0.7211290504783392, + 0.8687884025275707, + 0.15286922827363014, + 0.2351524718105793, + 0.841386353597045, + 0.558901309967041, + 1.6437984239310026, + 0.7610765434801579, + 2.3395723812282085, + 0.6119866445660591, + 0.8732665814459324, + 2.954554967582226, + 1.0919385328888893, + 1.735168930143118, + 0.9157898090779781, + 1.2090788669884205, + 0.3886927254498005, + 0.04537905752658844, + 1.053563803434372, + 0.6569796837866306, + 0.21017921343445778, + 1.1008277088403702, + 0.23023456521332264 + ], + "unique_experts": 64, + "load_cv": 0.652400248268147, + "normalized_load_entropy": 0.9584089852413791, + "max_load_share": 0.06344086021505377 + } + }, + "s1_period": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "aa2fff766f606287b874732304f56ca5db932e7cd1970015be39097558d8842d", + "route_weight_sha256": "d63c6514c7de5ababd83d3c9d6f4542faacf56b8947400d243acd4ff864999be", + "loads": [ + 10, + 19, + 14, + 4, + 16, + 4, + 26, + 10, + 13, + 1, + 6, + 7, + 13, + 12, + 8, + 10, + 60, + 16, + 4, + 11, + 7, + 12, + 2, + 1, + 16, + 16, + 5, + 7, + 2, + 16, + 15, + 7, + 13, + 1, + 5, + 8, + 3, + 14, + 13, + 18, + 57, + 19, + 18, + 2, + 5, + 17, + 2, + 19, + 12, + 29, + 8, + 9, + 25, + 11, + 19, + 9, + 18, + 6, + 1, + 13, + 12, + 5, + 14, + 5 + ], + "weighted_loads": [ + 0.44408319890499115, + 0.9862594753503799, + 0.619246955960989, + 0.11970179714262486, + 1.1094058230519295, + 0.22820325195789337, + 2.1680753752589226, + 0.36646292358636856, + 0.7930416110903025, + 0.05035644769668579, + 0.2298878524452448, + 0.45835477486252785, + 0.5936534013599157, + 0.7539034560322762, + 0.2920569162815809, + 0.5649803355336189, + 4.1512526497244835, + 0.9232700914144516, + 0.12973103113472462, + 0.5832234788686037, + 0.4709807801991701, + 0.5702784862369299, + 0.05834674835205078, + 0.04029223695397377, + 0.9790559448301792, + 0.8707854989916086, + 0.29658957198262215, + 0.2609376981854439, + 0.14895223453640938, + 0.799244936555624, + 0.8132369332015514, + 0.25717969238758087, + 0.9903815444558859, + 0.049716245383024216, + 0.32721947878599167, + 0.3956965934485197, + 0.10339665971696377, + 0.975830189883709, + 1.3100421763956547, + 1.0212040189653635, + 2.657387023791671, + 0.7730764243751764, + 0.8473318852484226, + 0.07890810444951057, + 0.16874772123992443, + 0.7982883974909782, + 0.13574425876140594, + 1.3717494737356901, + 0.7288646008819342, + 2.2272021509706974, + 0.3312235940247774, + 0.3755091316998005, + 2.121018396690488, + 0.6039362624287605, + 1.8780841790139675, + 0.49074676632881165, + 1.3273683153092861, + 0.35034776106476784, + 0.0436118021607399, + 0.5656535066664219, + 0.7107816450297832, + 0.20489000156521797, + 1.0650772452354431, + 0.17450572364032269 + ], + "unique_experts": 64, + "load_cv": 0.8623774913233134, + "normalized_load_entropy": 0.9294365959289861, + "max_load_share": 0.07692307692307693 + }, + "full_input": { + "tokens": 171, + "top_k": 6, + "decisions": 1026, + "ordered_route_sha256": "2f5a9840c3d83f6b9e37aa0e07143779ca6c2daf30c7b7c612ccb87d4294c88e", + "route_weight_sha256": "46f4e5698378cb0051be6ef6f45197474853b47cf3357af1e7dab9e13c4719ca", + "loads": [ + 20, + 20, + 14, + 5, + 21, + 22, + 26, + 13, + 15, + 11, + 6, + 10, + 18, + 12, + 8, + 13, + 60, + 16, + 10, + 16, + 9, + 14, + 2, + 9, + 23, + 21, + 11, + 14, + 14, + 17, + 20, + 10, + 15, + 12, + 6, + 9, + 3, + 18, + 16, + 20, + 57, + 19, + 19, + 3, + 7, + 17, + 8, + 23, + 15, + 31, + 24, + 11, + 33, + 21, + 21, + 12, + 19, + 8, + 2, + 31, + 15, + 6, + 16, + 9 + ], + "weighted_loads": [ + 1.3032856564968824, + 1.037841860204935, + 0.619246955960989, + 0.15860858000814915, + 1.4032807983458042, + 1.433934846892953, + 2.1680753752589226, + 0.49471617117524147, + 0.9592561293393373, + 0.8471220508217812, + 0.2298878524452448, + 0.6757646836340427, + 0.9454932790249586, + 0.7539034560322762, + 0.2920569162815809, + 0.7219170443713665, + 4.1512526497244835, + 0.9232700914144516, + 0.5439620278775692, + 1.1174573451280594, + 0.6997650321573019, + 0.6441996917128563, + 0.05834674835205078, + 0.39197011664509773, + 1.2999189775437117, + 1.105067066848278, + 0.7064751945436001, + 0.5752414260059595, + 1.6478331163525581, + 0.8483729846775532, + 1.065424531698227, + 0.3716595619916916, + 1.069113226607442, + 1.2767451666295528, + 0.3760231100022793, + 0.47535903565585613, + 0.10339665971696377, + 1.4252209700644016, + 1.5009878426790237, + 1.1684529725462198, + 2.657387023791671, + 0.7730764243751764, + 0.8996615409851074, + 0.12538759410381317, + 0.22952516749501228, + 0.7982883974909782, + 0.5198385808616877, + 1.5483359526842833, + 0.8848791942000389, + 2.3043950833380222, + 1.3611837793141603, + 0.7744809873402119, + 2.9175048377364874, + 1.3829051665961742, + 1.9616939388215542, + 0.784526064991951, + 1.3807030282914639, + 0.434213288128376, + 0.1537073776125908, + 1.5952405780553818, + 0.9639189541339874, + 0.24680127575993538, + 1.1684908382594585, + 0.36423507519066334 + ], + "unique_experts": 64, + "load_cv": 0.6403234318725884, + "normalized_load_entropy": 0.9580684149860766, + "max_load_share": 0.05847953216374269 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 130, + "ordered_topk_exact_tokens": 82, + "set_exact_tokens": 97, + "mean_set_jaccard": 0.9274725274725275, + "mean_token_weighted_tv": 0.012952339376967686, + "aggregate_load_tv": 0.02564102564102564 + }, + "system_bos": { + "tokens": 130, + "ordered_topk_exact_tokens": 72, + "set_exact_tokens": 88, + "mean_set_jaccard": 0.9043956043956044, + "mean_token_weighted_tv": 0.017215740716514678, + "aggregate_load_tv": 0.035897435897435895 + }, + "system_x": { + "tokens": 130, + "ordered_topk_exact_tokens": 76, + "set_exact_tokens": 87, + "mean_set_jaccard": 0.8989010989010989, + "mean_token_weighted_tv": 0.019209350724346364, + "aggregate_load_tv": 0.035897435897435895 + }, + "system_period": { + "tokens": 130, + "ordered_topk_exact_tokens": 67, + "set_exact_tokens": 84, + "mean_set_jaccard": 0.8956043956043958, + "mean_token_weighted_tv": 0.019547726916005977, + "aggregate_load_tv": 0.03846153846153848 + }, + "bos_at_s0": { + "tokens": 130, + "ordered_topk_exact_tokens": 59, + "set_exact_tokens": 75, + "mean_set_jaccard": 0.8774725274725276, + "mean_token_weighted_tv": 0.021325209364295005, + "aggregate_load_tv": 0.03461538461538461 + }, + "bos_at_s1": { + "tokens": 130, + "ordered_topk_exact_tokens": 59, + "set_exact_tokens": 80, + "mean_set_jaccard": 0.8851648351648352, + "mean_token_weighted_tv": 0.020967929172687805, + "aggregate_load_tv": 0.03974358974358975 + }, + "x_at_s0": { + "tokens": 130, + "ordered_topk_exact_tokens": 65, + "set_exact_tokens": 80, + "mean_set_jaccard": 0.8851648351648351, + "mean_token_weighted_tv": 0.02115926665898699, + "aggregate_load_tv": 0.03333333333333333 + }, + "x_at_s1": { + "tokens": 130, + "ordered_topk_exact_tokens": 56, + "set_exact_tokens": 76, + "mean_set_jaccard": 0.8747252747252748, + "mean_token_weighted_tv": 0.023834549793257165, + "aggregate_load_tv": 0.04102564102564103 + }, + "period_at_s0": { + "tokens": 130, + "ordered_topk_exact_tokens": 60, + "set_exact_tokens": 82, + "mean_set_jaccard": 0.8895604395604395, + "mean_token_weighted_tv": 0.020493899221317127, + "aggregate_load_tv": 0.0358974358974359 + }, + "period_at_s1": { + "tokens": 130, + "ordered_topk_exact_tokens": 52, + "set_exact_tokens": 70, + "mean_set_jaccard": 0.8582417582417584, + "mean_token_weighted_tv": 0.025846462460378042, + "aggregate_load_tv": 0.048717948717948725 + } + } + }, + "layer_15": { + "layer": 15, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "db5965448dbe51fda3c8f518095e4aeedb5c0aa53d62533bc1147881ab2d822d", + "route_weight_sha256": "933402652e70c9f48055533c9ce47aea16fbacc6b56fd6e26c077f67965eef76", + "loads": [ + 3, + 12, + 13, + 8, + 3, + 8, + 0, + 25, + 2, + 8, + 23, + 13, + 14, + 16, + 16, + 1, + 7, + 16, + 1, + 17, + 0, + 16, + 3, + 4, + 5, + 10, + 0, + 33, + 11, + 22, + 10, + 14, + 11, + 10, + 12, + 0, + 5, + 14, + 1, + 19, + 16, + 6, + 12, + 16, + 11, + 25, + 19, + 39, + 2, + 4, + 5, + 18, + 25, + 11, + 8, + 13, + 17, + 9, + 11, + 59, + 15, + 4, + 22, + 7 + ], + "weighted_loads": [ + 0.14179507829248905, + 0.6207758504897356, + 0.8359959255903959, + 0.30042847990989685, + 0.0975977573543787, + 0.325110724195838, + 0.0, + 1.1798949129879475, + 0.0896039642393589, + 0.47839629650115967, + 2.5515014454722404, + 0.7764707505702972, + 0.814954798668623, + 0.6795345135033131, + 0.6883725430816412, + 0.04264448210597038, + 0.28084326535463333, + 0.6503709983080626, + 0.0279434435069561, + 1.0478838086128235, + 0.0, + 0.8305293340235949, + 0.14838072657585144, + 0.18157311901450157, + 0.18704095855355263, + 1.9288723729550838, + 0.0, + 2.355760544538498, + 0.5384943056851625, + 1.2465907521545887, + 0.44174002669751644, + 0.6053117997944355, + 0.5447987075895071, + 0.48621755093336105, + 0.77951280772686, + 0.0, + 0.29176415130496025, + 0.8553573358803988, + 0.03317901864647865, + 0.7906598281115294, + 0.591217715293169, + 0.251130186021328, + 1.0326928980648518, + 1.190153807401657, + 0.5516099333763123, + 1.6649655774235725, + 1.714256040751934, + 1.7118518091738224, + 0.08016851544380188, + 0.2032526433467865, + 0.3070201687514782, + 0.9481972195208073, + 1.12495082244277, + 0.5156692583113909, + 0.29749381728470325, + 0.4897450599819422, + 0.9833270236849785, + 0.652159933000803, + 0.88084626942873, + 3.165385005995631, + 0.8469508532434702, + 0.2177511304616928, + 1.228992821648717, + 0.2755108065903187 + ], + "unique_experts": 60, + "load_cv": 0.8208813275048676, + "normalized_load_entropy": 0.9247427244304502, + "max_load_share": 0.07564102564102564 + }, + "full_input": { + "tokens": 155, + "top_k": 6, + "decisions": 930, + "ordered_route_sha256": "9a562b9f8bdcb7bdaf7b391e9f22adc1373b065a4a6e1a3892d10e9ca1f1efb2", + "route_weight_sha256": "b42125a3b68bc7ed569f4991d50da450e8d48c8ade4874a962a3967d14e365b4", + "loads": [ + 5, + 12, + 13, + 8, + 8, + 11, + 7, + 27, + 7, + 9, + 28, + 15, + 20, + 16, + 26, + 2, + 14, + 17, + 1, + 19, + 0, + 16, + 3, + 10, + 8, + 11, + 10, + 33, + 14, + 22, + 14, + 14, + 16, + 12, + 12, + 0, + 10, + 14, + 1, + 19, + 22, + 7, + 12, + 19, + 11, + 25, + 19, + 41, + 3, + 12, + 10, + 20, + 32, + 11, + 8, + 18, + 17, + 9, + 12, + 60, + 15, + 7, + 22, + 14 + ], + "weighted_loads": [ + 0.26370630227029324, + 0.6207758504897356, + 0.8359959255903959, + 0.30042847990989685, + 0.5521991867572069, + 0.3964541256427765, + 0.5996358469128609, + 1.2440545931458473, + 0.4154703952372074, + 0.5099082961678505, + 2.7407592460513115, + 0.8422542940825224, + 1.3329585157334805, + 0.6795345135033131, + 1.06306008156389, + 0.07406579330563545, + 0.9357050731778145, + 0.6907849926501513, + 0.0279434435069561, + 1.155052725225687, + 0.0, + 0.8305293340235949, + 0.14838072657585144, + 0.4859502390027046, + 0.2508102480787784, + 1.957300491631031, + 0.6650096140801907, + 2.355760544538498, + 0.6521843243390322, + 1.2465907521545887, + 0.6168234497308731, + 0.6053117997944355, + 0.9445744659751654, + 0.5777870714664459, + 0.77951280772686, + 0.0, + 1.0620854580774903, + 0.8553573358803988, + 0.03317901864647865, + 0.7906598281115294, + 0.8530193238984793, + 0.2553700632415712, + 1.0326928980648518, + 1.3051328882575035, + 0.5516099333763123, + 1.6649655774235725, + 1.714256040751934, + 1.8463155515491962, + 0.0936727523803711, + 1.6639122851192951, + 0.516713896766305, + 1.033886156976223, + 1.686024577356875, + 0.5156692583113909, + 0.29749381728470325, + 2.184528036043048, + 0.9833270236849785, + 0.652159933000803, + 0.9328084327280521, + 3.231037287041545, + 0.8469508532434702, + 0.33498805202543736, + 1.228992821648717, + 0.5333937695249915 + ], + "unique_experts": 62, + "load_cv": 0.6809262359394089, + "normalized_load_entropy": 0.9479890424008074, + "max_load_share": 0.06451612903225806 + } + }, + "s1_eos": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "8591d9b200be2175cf9ea33c58fc36e0fac9595a5e885677a89e840586b66115", + "route_weight_sha256": "bf875347a66ba42ce1abad4f79de3f5f9864b068bd5ecfe751f235bcfec9d9e3", + "loads": [ + 3, + 10, + 14, + 6, + 4, + 10, + 0, + 23, + 2, + 8, + 25, + 13, + 14, + 15, + 19, + 2, + 7, + 15, + 1, + 18, + 0, + 16, + 3, + 5, + 5, + 12, + 1, + 32, + 11, + 21, + 10, + 15, + 11, + 10, + 13, + 0, + 5, + 12, + 0, + 19, + 14, + 6, + 13, + 16, + 12, + 25, + 18, + 39, + 2, + 3, + 5, + 19, + 24, + 11, + 6, + 12, + 17, + 9, + 11, + 60, + 15, + 5, + 22, + 6 + ], + "weighted_loads": [ + 0.13746020384132862, + 0.5531152430921793, + 0.8562331069260836, + 0.22137628868222237, + 0.1267943475395441, + 0.38376043550670147, + 0.0, + 1.1606880314648151, + 0.09216014668345451, + 0.4833950214087963, + 2.6731614880263805, + 0.76178078353405, + 0.7937180958688259, + 0.656541395932436, + 0.8021558281034231, + 0.06741542182862759, + 0.2839521951973438, + 0.6352157332003117, + 0.02766510657966137, + 1.096882987767458, + 0.0, + 0.8390135485678911, + 0.14576756209135056, + 0.21711301803588867, + 0.19273354671895504, + 1.9646625239402056, + 0.02179497666656971, + 2.3068122677505016, + 0.5303985923528671, + 1.2238716427236795, + 0.4400001522153616, + 0.6389062143862247, + 0.54613171890378, + 0.5017982982099056, + 0.8224814217537642, + 0.0, + 0.2897775415331125, + 0.7782270666211843, + 0.0, + 0.7697402872145176, + 0.5335901789367199, + 0.25674835965037346, + 1.064235832542181, + 1.195794504135847, + 0.5801967643201351, + 1.6762532033026218, + 1.6682480163872242, + 1.6954801604151726, + 0.07474472746253014, + 0.17341823130846024, + 0.30676640570163727, + 0.9721456784754992, + 1.0743246711790562, + 0.4852229654788971, + 0.2328916396945715, + 0.4533953480422497, + 0.9878807887434959, + 0.6364070251584053, + 0.887624591588974, + 3.247960804030299, + 0.8478754051029682, + 0.2584664672613144, + 1.2368706669658422, + 0.2444727085530758 + ], + "unique_experts": 60, + "load_cv": 0.8221618045574179, + "normalized_load_entropy": 0.9253151514883364, + "max_load_share": 0.07692307692307693 + }, + "full_input": { + "tokens": 171, + "top_k": 6, + "decisions": 1026, + "ordered_route_sha256": "d2fe4ad188560a6da58b20267dfadb4f9be2224a90b461acc6598970ce8d5d13", + "route_weight_sha256": "cd25655458c13c8d1f36a9773b63d8194b947ecdeb17bcdbee941bd9f5d92111", + "loads": [ + 21, + 11, + 14, + 6, + 11, + 15, + 13, + 24, + 10, + 9, + 30, + 18, + 21, + 16, + 24, + 12, + 19, + 19, + 2, + 23, + 1, + 17, + 3, + 10, + 9, + 13, + 11, + 34, + 17, + 22, + 16, + 19, + 17, + 12, + 15, + 0, + 11, + 12, + 2, + 20, + 20, + 8, + 13, + 19, + 12, + 26, + 18, + 41, + 5, + 15, + 12, + 21, + 27, + 12, + 6, + 17, + 17, + 15, + 13, + 65, + 15, + 13, + 24, + 13 + ], + "weighted_loads": [ + 1.3484901655465364, + 0.5801028050482273, + 0.8562331069260836, + 0.22137628868222237, + 0.6592070925980806, + 0.5890291724354029, + 1.1065983325242996, + 1.1919043716043234, + 0.5387436933815479, + 0.5144052356481552, + 2.904712453484535, + 1.130757663398981, + 1.4177038371562958, + 0.7368081621825695, + 0.9727884205058217, + 0.7394019057974219, + 1.4142250679433346, + 0.7962899766862392, + 0.07748443819582462, + 1.3899952322244644, + 0.028611402958631516, + 0.9203123990446329, + 0.14576756209135056, + 0.46492408215999603, + 0.2893167925067246, + 1.9930680096149445, + 0.7356243338435888, + 2.431336410343647, + 0.9472318030893803, + 1.2608535904437304, + 0.6651651188731194, + 1.0878280960023403, + 0.9732272066175938, + 0.6127444840967655, + 0.9709005672484636, + 0.0, + 1.0449214531108737, + 0.7782270666211843, + 0.06487156450748444, + 0.8057754039764404, + 0.7694744851905853, + 0.34931817185133696, + 1.064235832542181, + 1.5017012543976307, + 0.5801967643201351, + 1.7157359085977077, + 1.6682480163872242, + 1.837857872247696, + 0.219297144562006, + 2.4092143960297108, + 0.5933434572070837, + 1.039581548422575, + 1.5028300127014518, + 0.6333231329917908, + 0.2328916396945715, + 2.1369300074875355, + 0.9878807887434959, + 1.3027280122041702, + 0.96942188590765, + 3.4868200104683638, + 0.8478754051029682, + 0.6696219220757484, + 1.357474995777011, + 0.48731717467308044 + ], + "unique_experts": 63, + "load_cv": 0.6067828792685893, + "normalized_load_entropy": 0.9594833006560581, + "max_load_share": 0.06335282651072124 + } + }, + "s0_bos": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "f72713499acb0087287587830f61967d18cb38297dd4a8d29fc01e4a0264492e", + "route_weight_sha256": "c934880dcd48cb2fe067f5b13b64b533df6b922595374162cb86276a46d14383", + "loads": [ + 3, + 10, + 12, + 7, + 4, + 8, + 0, + 22, + 5, + 7, + 22, + 13, + 15, + 16, + 16, + 2, + 6, + 16, + 0, + 18, + 0, + 15, + 3, + 4, + 6, + 11, + 2, + 34, + 10, + 24, + 11, + 13, + 11, + 12, + 11, + 1, + 4, + 12, + 1, + 18, + 17, + 6, + 13, + 16, + 10, + 26, + 18, + 36, + 3, + 3, + 8, + 20, + 27, + 13, + 6, + 13, + 17, + 9, + 10, + 57, + 16, + 4, + 22, + 5 + ], + "weighted_loads": [ + 0.16203643381595612, + 0.5601306241005659, + 0.7828049045056105, + 0.28149210661649704, + 0.1291064340621233, + 0.3297367412596941, + 0.0, + 1.1424859482795, + 0.1767660528421402, + 0.4404618516564369, + 2.479786802083254, + 0.762771263718605, + 0.8343513663858175, + 0.6835829839110374, + 0.6671185921877623, + 0.07423208467662334, + 0.2549564801156521, + 0.646830853074789, + 0.0, + 1.0490983594208956, + 0.0, + 0.7817512098699808, + 0.14492715522646904, + 0.19559361413121223, + 0.226618692278862, + 1.9726123102009296, + 0.04932922497391701, + 2.3783109709620476, + 0.515307879075408, + 1.3165255934000015, + 0.4588603377342224, + 0.5517348535358906, + 0.5463910382241011, + 0.5724372938275337, + 0.7566804941743612, + 0.029579337686300278, + 0.2627938501536846, + 0.79071962274611, + 0.03552308678627014, + 0.7329961806535721, + 0.6327410936355591, + 0.24130776152014732, + 1.0706182718276978, + 1.1871624533087015, + 0.512779276818037, + 1.7022361736744642, + 1.6899544447660446, + 1.6339188031852245, + 0.10934673249721527, + 0.1750270314514637, + 0.40925295650959015, + 1.0622094012796879, + 1.2166468761861324, + 0.558798173442483, + 0.23579750210046768, + 0.4937569089233875, + 0.9872096106410027, + 0.6558754369616508, + 0.8436777964234352, + 3.0389932207763195, + 0.9031863287091255, + 0.23099325224757195, + 1.257016684859991, + 0.20112576335668564 + ], + "unique_experts": 61, + "load_cv": 0.7997205297519702, + "normalized_load_entropy": 0.9291906745986603, + "max_load_share": 0.07307692307692308 + }, + "full_input": { + "tokens": 155, + "top_k": 6, + "decisions": 930, + "ordered_route_sha256": "7e68e7b0fed55374cd6dc6f6374639520984a35977e0d67d8ab633448a69b279", + "route_weight_sha256": "813099d20d73c6bac10feaa3ef1817ab859c72c5a379fa56fed1ee5845da9ab2", + "loads": [ + 6, + 10, + 12, + 7, + 8, + 11, + 7, + 24, + 9, + 8, + 27, + 16, + 21, + 16, + 25, + 3, + 13, + 17, + 0, + 20, + 0, + 15, + 3, + 10, + 8, + 12, + 12, + 34, + 13, + 24, + 15, + 13, + 16, + 14, + 11, + 2, + 9, + 12, + 1, + 18, + 24, + 6, + 13, + 19, + 10, + 26, + 18, + 38, + 4, + 11, + 14, + 23, + 34, + 13, + 8, + 15, + 17, + 9, + 11, + 58, + 16, + 7, + 22, + 12 + ], + "weighted_loads": [ + 0.3682102896273136, + 0.5601306241005659, + 0.7828049045056105, + 0.28149210661649704, + 0.5446996968239546, + 0.4394074101001024, + 0.6188476830720901, + 1.2066456284373999, + 0.459346167743206, + 0.47197385132312775, + 2.669044602662325, + 0.8713647332042456, + 1.3458077441900969, + 0.6835829839110374, + 1.031776623800397, + 0.10565339587628841, + 0.933825146406889, + 0.6872448474168777, + 0.0, + 1.1562672760337591, + 0.0, + 0.7817512098699808, + 0.14492715522646904, + 0.4999707341194153, + 0.28310694731771946, + 2.001040428876877, + 0.7143388390541077, + 2.3783109709620476, + 0.6289978977292776, + 1.3165255934000015, + 0.6339437607675791, + 0.5517348535358906, + 0.9461667966097593, + 0.6640068143606186, + 0.7566804941743612, + 0.11681049689650536, + 1.0228797728195786, + 0.79071962274611, + 0.03552308678627014, + 0.7329961806535721, + 1.0127328410744667, + 0.24130776152014732, + 1.0706182718276978, + 1.3033541534096003, + 0.512779276818037, + 1.7022361736744642, + 1.6899544447660446, + 1.769663941115141, + 0.12285096943378448, + 1.5416555032134056, + 0.7263773251324892, + 1.1981770917773247, + 1.7645049998536706, + 0.558798173442483, + 0.33920818567276, + 1.1333724148571491, + 0.9872096106410027, + 0.6558754369616508, + 0.8956399597227573, + 3.1021823845803738, + 0.9031863287091255, + 0.34790378995239735, + 1.257016684859991, + 0.47893812227994204 + ], + "unique_experts": 62, + "load_cv": 0.6664272896635993, + "normalized_load_entropy": 0.9500460330656877, + "max_load_share": 0.06236559139784946 + } + }, + "s1_bos": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "67ef407feec29eb64ceb67395f1713cd507d9993db9fb17c364cab4bd52eb10b", + "route_weight_sha256": "4b857c230f8f585a14518e363db9f7f546983954e48a81a749a79e8b9ab2e9da", + "loads": [ + 3, + 10, + 13, + 7, + 4, + 9, + 1, + 23, + 3, + 8, + 24, + 13, + 16, + 15, + 16, + 1, + 7, + 13, + 0, + 18, + 0, + 15, + 3, + 3, + 6, + 11, + 2, + 33, + 9, + 25, + 11, + 13, + 11, + 11, + 12, + 0, + 5, + 13, + 1, + 18, + 15, + 6, + 12, + 15, + 11, + 26, + 18, + 35, + 1, + 3, + 8, + 19, + 28, + 16, + 4, + 13, + 16, + 10, + 11, + 58, + 18, + 4, + 22, + 5 + ], + "weighted_loads": [ + 0.17361951433122158, + 0.5558209978044033, + 0.8289634454995394, + 0.2648868039250374, + 0.13191888481378555, + 0.35998526215553284, + 0.043791938573122025, + 1.1602816991508007, + 0.12311135232448578, + 0.47364409267902374, + 2.5482232719659805, + 0.7501216903328896, + 0.8482274375855923, + 0.6362562905997038, + 0.6727504637092352, + 0.04328496754169464, + 0.2913375534117222, + 0.5465024746954441, + 0.0, + 1.0513750649988651, + 0.0, + 0.7885750271379948, + 0.14296191185712814, + 0.15795771405100822, + 0.21914623863995075, + 1.9722453728318214, + 0.04902905598282814, + 2.336157113313675, + 0.4592896569520235, + 1.3534919936209917, + 0.4628453031182289, + 0.562349708750844, + 0.5588893815875053, + 0.541634313762188, + 0.7995385881513357, + 0.0, + 0.29965528659522533, + 0.8168271128088236, + 0.032307740300893784, + 0.7325625568628311, + 0.5761306826025248, + 0.23618539795279503, + 1.010521411895752, + 1.1593961864709854, + 0.5479035675525665, + 1.6995531357824802, + 1.6721544302999973, + 1.5716080572456121, + 0.0345892496407032, + 0.15921763703227043, + 0.4185137264430523, + 1.0186225473880768, + 1.228959321975708, + 0.6693929024040699, + 0.1715407930314541, + 0.4846034534275532, + 0.9390632137656212, + 0.691125325858593, + 0.8869414683431387, + 3.0777812749147415, + 0.964499294757843, + 0.22301510348916054, + 1.2664452623575926, + 0.2000122182071209 + ], + "unique_experts": 61, + "load_cv": 0.8118614417851497, + "normalized_load_entropy": 0.9260031083047191, + "max_load_share": 0.07435897435897436 + }, + "full_input": { + "tokens": 171, + "top_k": 6, + "decisions": 1026, + "ordered_route_sha256": "a11748ba209d2f89029437869ac7add2073cc6da1e8922c6779b4b20e117c98b", + "route_weight_sha256": "128da362c35647d66198a765841a65ab20eaecd04219ce6d6aa4dea8c0298376", + "loads": [ + 22, + 11, + 13, + 7, + 11, + 14, + 14, + 24, + 11, + 9, + 29, + 19, + 23, + 16, + 20, + 11, + 19, + 17, + 1, + 22, + 1, + 16, + 3, + 8, + 10, + 12, + 12, + 35, + 15, + 26, + 18, + 17, + 17, + 13, + 14, + 0, + 12, + 13, + 3, + 19, + 21, + 7, + 12, + 17, + 11, + 27, + 18, + 37, + 4, + 15, + 16, + 21, + 31, + 17, + 4, + 17, + 16, + 16, + 13, + 63, + 18, + 12, + 24, + 12 + ], + "weighted_loads": [ + 1.488120285794139, + 0.5828085597604513, + 0.8289634454995394, + 0.2648868039250374, + 0.6145154610276222, + 0.6037297174334526, + 1.1291239075362682, + 1.191498039290309, + 0.5595599375665188, + 0.5046543069183826, + 2.779774237424135, + 1.171235080808401, + 1.4718463905155659, + 0.7165230568498373, + 0.8318531196564436, + 0.715271451510489, + 1.4431420788168907, + 0.7075767181813717, + 0.049819331616163254, + 1.3122201710939407, + 0.028611402958631516, + 0.8698738776147366, + 0.14296191185712814, + 0.4057687781751156, + 0.36483256332576275, + 2.0006508585065603, + 0.7628584131598473, + 2.4606812559068203, + 0.8761228676885366, + 1.3904739413410425, + 0.7377679850906134, + 1.0112715903669596, + 0.9859848693013191, + 0.6525804996490479, + 0.9479577336460352, + 0.0, + 1.0732115460559726, + 0.8168271128088236, + 0.09717930480837822, + 0.768597673624754, + 0.9483629334717989, + 0.3245573006570339, + 1.010521411895752, + 1.433016624301672, + 0.5479035675525665, + 1.7390358410775661, + 1.6721544302999973, + 1.7076384853571653, + 0.17914166674017906, + 2.2586505189538, + 0.7777984365820885, + 1.0860584173351526, + 1.6442211074754596, + 0.8174930699169636, + 0.1715407930314541, + 1.2414489686489105, + 0.9390632137656212, + 1.357446312904358, + 0.9687387626618147, + 3.3147094696760178, + 0.964499294757843, + 0.6362077854573727, + 1.3870495911687613, + 0.4674528520554304 + ], + "unique_experts": 63, + "load_cv": 0.5989165741696829, + "normalized_load_entropy": 0.9592306764230217, + "max_load_share": 0.06140350877192982 + } + }, + "s0_x": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "d00a6810efaefdf9e46c596b0cac497775887a3a675c9378c796842faa308eda", + "route_weight_sha256": "06248d7369f88fdf98f0723646c50018d3aaf3132b846b3092645fba999eabc0", + "loads": [ + 4, + 11, + 13, + 7, + 5, + 7, + 0, + 23, + 3, + 7, + 24, + 13, + 15, + 16, + 15, + 2, + 7, + 15, + 0, + 17, + 0, + 15, + 3, + 3, + 5, + 11, + 3, + 34, + 8, + 22, + 10, + 16, + 11, + 11, + 10, + 0, + 5, + 12, + 1, + 18, + 17, + 6, + 12, + 16, + 10, + 26, + 18, + 35, + 3, + 4, + 8, + 20, + 27, + 11, + 5, + 12, + 17, + 9, + 11, + 62, + 16, + 4, + 22, + 7 + ], + "weighted_loads": [ + 0.19358526542782784, + 0.5791388619691133, + 0.811391519382596, + 0.2753307893872261, + 0.17138089798390865, + 0.30095090717077255, + 0.0, + 1.1770507544279099, + 0.1132244486361742, + 0.4474971629679203, + 2.5522132124751806, + 0.7604197785258293, + 0.8343770802021027, + 0.6861783284693956, + 0.6263557653874159, + 0.07452600821852684, + 0.2921159863471985, + 0.6270311716943979, + 0.0, + 1.0280493162572384, + 0.0, + 0.7846778109669685, + 0.15132304280996323, + 0.15269266441464424, + 0.1879360657185316, + 1.966371200978756, + 0.07765022106468678, + 2.4187940154224634, + 0.44128729589283466, + 1.2148221619427204, + 0.4392727855592966, + 0.6592259835451841, + 0.5546832159161568, + 0.5290006995201111, + 0.7362867929041386, + 0.0, + 0.2835632711648941, + 0.7846829015761614, + 0.03417639061808586, + 0.7283382080495358, + 0.6424696706235409, + 0.23993003368377686, + 1.0421222038567066, + 1.1828758493065834, + 0.5212532170116901, + 1.6794679909944534, + 1.6778638251125813, + 1.5823422204703093, + 0.111580029129982, + 0.2072894163429737, + 0.41619423031806946, + 1.0533396638929844, + 1.2020103335380554, + 0.508765209466219, + 0.19741798378527164, + 0.45338633097708225, + 0.9807249046862125, + 0.6621325276792049, + 0.8800081070512533, + 3.2207543794065714, + 0.9128121137619019, + 0.22345831990242004, + 1.2630183286964893, + 0.2697043642401695 + ], + "unique_experts": 60, + "load_cv": 0.8281535270104227, + "normalized_load_entropy": 0.9264913639244087, + "max_load_share": 0.07948717948717948 + }, + "full_input": { + "tokens": 155, + "top_k": 6, + "decisions": 930, + "ordered_route_sha256": "501dc7f4188f8dc4781cf17d75be59af4f9170f3ce4d4a19dc11f8154dd8ee6c", + "route_weight_sha256": "af921f9fe64acf20fe36ef5a2bc1f1c11e72832d617295c2be382b1b4f3802ec", + "loads": [ + 6, + 11, + 13, + 7, + 10, + 8, + 7, + 25, + 8, + 8, + 30, + 16, + 21, + 16, + 24, + 3, + 14, + 16, + 0, + 20, + 0, + 15, + 3, + 10, + 7, + 12, + 14, + 34, + 11, + 22, + 14, + 16, + 16, + 13, + 10, + 0, + 10, + 12, + 1, + 18, + 23, + 6, + 12, + 19, + 10, + 26, + 18, + 37, + 4, + 12, + 13, + 22, + 35, + 11, + 5, + 16, + 17, + 9, + 12, + 63, + 16, + 8, + 22, + 13 + ], + "weighted_loads": [ + 0.34024883434176445, + 0.5791388619691133, + 0.811391519382596, + 0.2753307893872261, + 0.6248948443681002, + 0.31969696655869484, + 0.6895813643932343, + 1.2412104345858097, + 0.44478890113532543, + 0.47900916263461113, + 2.810842474922538, + 0.8686968591064215, + 1.342702940106392, + 0.6861783284693956, + 0.9910137970000505, + 0.10594731941819191, + 0.9574851356446743, + 0.6674451660364866, + 0.0, + 1.1836263723671436, + 0.0, + 0.7846778109669685, + 0.15132304280996323, + 0.5501616224646568, + 0.2524847351014614, + 1.9947993196547031, + 0.8603094052523375, + 2.4187940154224634, + 0.5549773145467043, + 1.2148221619427204, + 0.6143562085926533, + 0.6592259835451841, + 0.954458974301815, + 0.620570220053196, + 0.7362867929041386, + 0.0, + 1.020414245314896, + 0.7846829015761614, + 0.03417639061808586, + 0.7283382080495358, + 0.9392513036727905, + 0.23993003368377686, + 1.0421222038567066, + 1.3453537784516811, + 0.5212532170116901, + 1.6794679909944534, + 1.6778638251125813, + 1.7120598163455725, + 0.1250842660665512, + 1.4686446003615856, + 0.6253911145031452, + 1.1390286013484001, + 1.7705232361331582, + 0.508765209466219, + 0.19741798378527164, + 1.1743654739111662, + 0.9807249046862125, + 0.6621325276792049, + 0.9319702703505754, + 3.28457816131413, + 0.9128121137619019, + 0.40572857297956944, + 1.2630183286964893, + 0.4977706242352724 + ], + "unique_experts": 61, + "load_cv": 0.6978850828425858, + "normalized_load_entropy": 0.9459086759131764, + "max_load_share": 0.06774193548387097 + } + }, + "s1_x": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "a3c863dde2a6f40b58630bf99065cbfc815ff1f0e7dd1813bdeea2761f348ac8", + "route_weight_sha256": "3643e77da3b5504cf91f6720aecebf85f8cab0a9f4e39021174c3afc640eb571", + "loads": [ + 2, + 12, + 13, + 7, + 5, + 9, + 0, + 22, + 4, + 8, + 24, + 14, + 15, + 16, + 15, + 1, + 7, + 16, + 0, + 17, + 0, + 15, + 3, + 3, + 7, + 11, + 3, + 34, + 8, + 21, + 9, + 13, + 11, + 11, + 11, + 2, + 5, + 13, + 0, + 19, + 15, + 6, + 13, + 16, + 10, + 25, + 20, + 33, + 1, + 3, + 9, + 19, + 29, + 17, + 5, + 13, + 17, + 10, + 11, + 57, + 15, + 4, + 22, + 4 + ], + "weighted_loads": [ + 0.11396002769470215, + 0.6038275174796581, + 0.8378231823444366, + 0.2596030216664076, + 0.1754466276615858, + 0.3544303197413683, + 0.0, + 1.175665682181716, + 0.15276246517896652, + 0.47640652768313885, + 2.529242616146803, + 0.7749311216175556, + 0.8178507704287767, + 0.666009096428752, + 0.6179957818239927, + 0.03949491307139397, + 0.30098966881632805, + 0.6655422151088715, + 0.0, + 1.056291289627552, + 0.0, + 0.7887795940041542, + 0.14160307869315147, + 0.15467241778969765, + 0.25014487840235233, + 1.9727507159113884, + 0.08250158838927746, + 2.3588350377976894, + 0.4366492759436369, + 1.1832419596612453, + 0.3893684111535549, + 0.5663156565278769, + 0.5689462553709745, + 0.5519248619675636, + 0.7644194327294827, + 0.06389237195253372, + 0.28628719970583916, + 0.8172782454639673, + 0.0, + 0.7706861421465874, + 0.5763407349586487, + 0.2318713441491127, + 1.0373907387256622, + 1.1840102560818195, + 0.5223073475062847, + 1.6417701616883278, + 1.7307838834822178, + 1.470597080886364, + 0.03525684028863907, + 0.1629827618598938, + 0.4452086966484785, + 1.0231493152678013, + 1.262596370652318, + 0.6995459571480751, + 0.18523032404482365, + 0.4847532343119383, + 0.9432829469442368, + 0.6759231016039848, + 0.8838333021849394, + 3.060304591432214, + 0.8820296712219715, + 0.21607020869851112, + 1.26073507219553, + 0.15793208964169025 + ], + "unique_experts": 60, + "load_cv": 0.7966894024303155, + "normalized_load_entropy": 0.9276789054094685, + "max_load_share": 0.07307692307692308 + }, + "full_input": { + "tokens": 171, + "top_k": 6, + "decisions": 1026, + "ordered_route_sha256": "a8066334a4a010e40fc6638107bc02367442ddf76ebfe61e78ba3376b6a2f49a", + "route_weight_sha256": "930c730ecfe461dd853ff29a78139d071463d5d25ebb11bbbc30a12bf132888d", + "loads": [ + 21, + 13, + 13, + 7, + 11, + 12, + 13, + 23, + 14, + 9, + 30, + 21, + 22, + 17, + 19, + 11, + 19, + 20, + 1, + 22, + 1, + 16, + 3, + 9, + 9, + 12, + 14, + 36, + 14, + 22, + 15, + 17, + 18, + 13, + 13, + 2, + 11, + 13, + 2, + 20, + 19, + 7, + 13, + 19, + 10, + 26, + 20, + 35, + 4, + 15, + 16, + 22, + 32, + 18, + 5, + 17, + 17, + 16, + 13, + 62, + 15, + 13, + 25, + 9 + ], + "weighted_loads": [ + 1.4238521978259087, + 0.6308150794357061, + 0.8378231823444366, + 0.2596030216664076, + 0.5653948318213224, + 0.5057584587484598, + 1.165079154074192, + 1.2068820223212242, + 0.6813762690871954, + 0.5074167419224977, + 2.812188044190407, + 1.2134759165346622, + 1.4232330080121756, + 0.7462758626788855, + 0.7770984377712011, + 0.7114813970401883, + 1.4340128190815449, + 0.826616458594799, + 0.049819331616163254, + 1.3681135661900043, + 0.028611402958631516, + 0.870078444480896, + 0.14160307869315147, + 0.4783282019197941, + 0.3119199573993683, + 2.0011562015861273, + 0.920764746144414, + 2.483359180390835, + 0.85348248668015, + 1.2202239073812962, + 0.6145333778113127, + 1.0152375381439924, + 1.0457678120583296, + 0.6628710478544235, + 0.9128385782241821, + 0.06389237195253372, + 0.981893171556294, + 0.8172782454639673, + 0.06487156450748444, + 0.8067212589085102, + 0.8065536245703697, + 0.3202432468533516, + 1.0373907387256622, + 1.5877537280321121, + 0.5223073475062847, + 1.6812528669834137, + 1.7307838834822178, + 1.6107271760702133, + 0.17980925738811493, + 2.0608781464397907, + 0.7189580835402012, + 1.124793304130435, + 1.6593538643792272, + 0.8476461246609688, + 0.18523032404482365, + 1.2023301143199205, + 0.9432829469442368, + 1.3422440886497498, + 0.9656305965036154, + 3.3000868652015924, + 0.8820296712219715, + 0.6878405660390854, + 1.414162315428257, + 0.3527752701193094 + ], + "unique_experts": 64, + "load_cv": 0.5898127834331476, + "normalized_load_entropy": 0.9609363601058656, + "max_load_share": 0.06042884990253411 + } + }, + "s0_period": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "0d2f2ddce75c8d26b07d88137d9ee7034643a8675a41949371846ebcda263b0b", + "route_weight_sha256": "b46011bfaf9e53820d0dc3dd96ae8bc6d55c48751835cb383c5117ef774125e2", + "loads": [ + 4, + 11, + 13, + 7, + 5, + 6, + 0, + 24, + 4, + 7, + 25, + 13, + 15, + 16, + 13, + 2, + 7, + 15, + 0, + 17, + 0, + 15, + 3, + 3, + 5, + 11, + 3, + 34, + 8, + 22, + 10, + 15, + 11, + 12, + 11, + 0, + 5, + 13, + 1, + 19, + 17, + 6, + 12, + 16, + 11, + 25, + 18, + 34, + 3, + 4, + 8, + 19, + 28, + 12, + 5, + 12, + 17, + 9, + 10, + 60, + 16, + 4, + 22, + 7 + ], + "weighted_loads": [ + 0.18555518053472042, + 0.5740898232907057, + 0.8264977987855673, + 0.27192476764321327, + 0.1821887344121933, + 0.25820883736014366, + 0.0, + 1.2221072167158127, + 0.1465134397149086, + 0.43700389191508293, + 2.541718002408743, + 0.7664179466664791, + 0.8267856631428003, + 0.6831339169293642, + 0.5634806510061026, + 0.07403516955673695, + 0.2883652001619339, + 0.6288606207817793, + 0.0, + 0.9992340803146362, + 0.0, + 0.7878253143280745, + 0.14855222404003143, + 0.15031668543815613, + 0.1904368232935667, + 1.9592897854745388, + 0.08020704053342342, + 2.4058110900223255, + 0.44286941178143024, + 1.2645571790635586, + 0.43615563586354256, + 0.6320753674954176, + 0.5540518239140511, + 0.5658457987010479, + 0.7578643076121807, + 0.0, + 0.3032443169504404, + 0.8259383738040924, + 0.03448609262704849, + 0.7558130212128162, + 0.6296754628419876, + 0.2373262532055378, + 1.0393161587417126, + 1.1791127435863018, + 0.5449016708880663, + 1.6394579503685236, + 1.685197101905942, + 1.537520669400692, + 0.1140680555254221, + 0.20542465522885323, + 0.41443952172994614, + 1.0510621406137943, + 1.2294538393616676, + 0.5337568782269955, + 0.1960890982300043, + 0.4512593038380146, + 0.9850932210683823, + 0.6610314287245274, + 0.8585795424878597, + 3.167918063700199, + 0.8957014493644238, + 0.2304079644382, + 1.2572220489382744, + 0.26771280728280544 + ], + "unique_experts": 60, + "load_cv": 0.8143195753564312, + "normalized_load_entropy": 0.9278052713709335, + "max_load_share": 0.07692307692307693 + }, + "full_input": { + "tokens": 155, + "top_k": 6, + "decisions": 930, + "ordered_route_sha256": "a0beb924f81205ebfae54f4f04bbdb48517fc25a6f59e68fc31a9d600b1e6308", + "route_weight_sha256": "c662d277f327eba421c11cb93dc5856697fc0c80ceca6dde90ebfdc2b8d644d2", + "loads": [ + 6, + 11, + 13, + 7, + 10, + 7, + 8, + 26, + 9, + 8, + 30, + 17, + 21, + 16, + 22, + 3, + 14, + 16, + 0, + 19, + 0, + 15, + 3, + 10, + 7, + 12, + 14, + 34, + 11, + 22, + 14, + 15, + 16, + 14, + 11, + 0, + 11, + 13, + 1, + 19, + 23, + 6, + 12, + 18, + 11, + 25, + 18, + 36, + 4, + 12, + 13, + 21, + 35, + 12, + 5, + 16, + 17, + 9, + 12, + 61, + 16, + 8, + 22, + 13 + ], + "weighted_loads": [ + 0.31634646467864513, + 0.5740898232907057, + 0.8264977987855673, + 0.27192476764321327, + 0.680576141923666, + 0.27695489674806595, + 0.7271622605621815, + 1.2862668968737125, + 0.4907982796430588, + 0.46851589158177376, + 2.730975802987814, + 0.9026278387755156, + 1.287330413237214, + 0.6831339169293642, + 0.9281386826187372, + 0.10545648075640202, + 0.9526257067918777, + 0.669274615123868, + 0.0, + 1.1064029969274998, + 0.0, + 0.7878253143280745, + 0.14855222404003143, + 0.5491443239152431, + 0.25415511429309845, + 1.987717904150486, + 0.7871841918677092, + 2.4058110900223255, + 0.5565594304352999, + 1.2645571790635586, + 0.6112390588968992, + 0.6320753674954176, + 0.9538275822997093, + 0.6574153192341328, + 0.7578643076121807, + 0.0, + 1.1119725024327636, + 0.8259383738040924, + 0.03448609262704849, + 0.7558130212128162, + 1.0163024961948395, + 0.2373262532055378, + 1.0393161587417126, + 1.261699341237545, + 0.5449016708880663, + 1.6394579503685236, + 1.685197101905942, + 1.67377607524395, + 0.1275722924619913, + 1.4672202318906784, + 0.6291219368577003, + 1.13675107806921, + 1.7715769531205297, + 0.5337568782269955, + 0.1960890982300043, + 1.1877557709813118, + 0.9850932210683823, + 0.6610314287245274, + 0.960687804967165, + 3.2304702699184418, + 0.8957014493644238, + 0.4853861015290022, + 1.2572220489382744, + 0.49844052270054817 + ], + "unique_experts": 61, + "load_cv": 0.6797298028815751, + "normalized_load_entropy": 0.9478051510791636, + "max_load_share": 0.06559139784946237 + } + }, + "s1_period": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "f212127aed97280c1f42004b6ac2261527d0150863ed9bd9b384e7dfa2c547f6", + "route_weight_sha256": "678e633869e2104f160a9ded9d4f9680fc4dc918851b5ae815831f02c640681d", + "loads": [ + 3, + 12, + 13, + 7, + 5, + 7, + 0, + 22, + 3, + 8, + 24, + 14, + 15, + 15, + 11, + 1, + 7, + 17, + 0, + 18, + 0, + 15, + 4, + 3, + 6, + 11, + 3, + 33, + 10, + 23, + 9, + 16, + 12, + 11, + 11, + 0, + 5, + 12, + 0, + 18, + 12, + 6, + 13, + 16, + 11, + 26, + 19, + 34, + 2, + 4, + 9, + 19, + 28, + 13, + 5, + 14, + 17, + 11, + 11, + 60, + 16, + 4, + 22, + 4 + ], + "weighted_loads": [ + 0.14742448553442955, + 0.6019615102559328, + 0.8513875231146812, + 0.2544979117810726, + 0.17661832831799984, + 0.2724103145301342, + 0.0, + 1.1913805026561022, + 0.12322522141039371, + 0.4719827063381672, + 2.5167592726647854, + 0.779328215867281, + 0.8090178593993187, + 0.6399026773869991, + 0.4981821645051241, + 0.040059644728899, + 0.290620855987072, + 0.7202667202800512, + 0.0, + 1.0863133892416954, + 0.0, + 0.7921872474253178, + 0.17006965912878513, + 0.15401607379317284, + 0.22521928511559963, + 1.9819573685526848, + 0.08226905204355717, + 2.3305239267647266, + 0.4972239341586828, + 1.240673616528511, + 0.3970970120280981, + 0.6597351003438234, + 0.5831291247159243, + 0.5372964590787888, + 0.7586334683001041, + 0.0, + 0.2905548606067896, + 0.7620328478515148, + 0.0, + 0.7390864919871092, + 0.46625048853456974, + 0.22681519016623497, + 1.030042890459299, + 1.185250287875533, + 0.556821608915925, + 1.6670982204377651, + 1.7031875438988209, + 1.5010305847972631, + 0.07615899667143822, + 0.19707198441028595, + 0.4470986519008875, + 1.040889559313655, + 1.2316865306347609, + 0.5780756361782551, + 0.18811015971004963, + 0.51807033829391, + 0.9414223190397024, + 0.7007789108902216, + 0.8939547222107649, + 3.147953312844038, + 0.9281056262552738, + 0.21548764035105705, + 1.2623936217278242, + 0.15801809541881084 + ], + "unique_experts": 59, + "load_cv": 0.8147070237310865, + "normalized_load_entropy": 0.9258444003183254, + "max_load_share": 0.07692307692307693 + }, + "full_input": { + "tokens": 171, + "top_k": 6, + "decisions": 1026, + "ordered_route_sha256": "e16ce31a52e636b2f058e83eb34ea819588df1adf180fd5a2039343dfd2ae997", + "route_weight_sha256": "aae03579ee8651cfd2d080556b02cb0b1607e39e4eef2d0a0ee354bee96b609c", + "loads": [ + 22, + 13, + 13, + 7, + 12, + 10, + 13, + 23, + 14, + 9, + 29, + 20, + 22, + 16, + 15, + 12, + 19, + 21, + 1, + 22, + 1, + 16, + 4, + 8, + 8, + 12, + 14, + 35, + 16, + 24, + 15, + 20, + 18, + 14, + 13, + 0, + 11, + 12, + 2, + 19, + 17, + 7, + 13, + 19, + 11, + 27, + 19, + 36, + 5, + 16, + 16, + 21, + 31, + 14, + 5, + 18, + 17, + 17, + 14, + 65, + 16, + 13, + 25, + 9 + ], + "weighted_loads": [ + 1.4409929141402245, + 0.6289490722119808, + 0.8513875231146812, + 0.2544979117810726, + 0.6239646654576063, + 0.4237384535372257, + 1.1872343495488167, + 1.2225968427956104, + 0.6880243737250566, + 0.5029929205775261, + 2.74831023812294, + 1.1765829287469387, + 1.4079045541584492, + 0.7201694436371326, + 0.6572848204523325, + 0.7487756470218301, + 1.4101283550262451, + 0.8813409637659788, + 0.049819331616163254, + 1.347158495336771, + 0.028611402958631516, + 0.8734860979020596, + 0.17006965912878513, + 0.4018271379172802, + 0.2869943641126156, + 2.0103628542274237, + 0.8466887306421995, + 2.455048069357872, + 0.914057144895196, + 1.2776555642485619, + 0.6222619786858559, + 1.108656981959939, + 1.010224612429738, + 0.6774404551833868, + 0.9070526137948036, + 0.0, + 1.1325613586232066, + 0.7620328478515148, + 0.06487156450748444, + 0.775121608749032, + 0.788967939093709, + 0.31518709287047386, + 1.030042890459299, + 1.5087587777525187, + 0.556821608915925, + 1.706580925732851, + 1.7031875438988209, + 1.6391669940203428, + 0.22071141377091408, + 2.0712745655328035, + 0.7365533001720905, + 1.1083254292607307, + 1.6296008909121156, + 0.7261758036911488, + 0.18811015971004963, + 1.2437374833971262, + 0.9414223190397024, + 1.3670998979359865, + 1.034623535349965, + 3.385065969079733, + 0.9281056262552738, + 0.8142734430730343, + 1.4226382281631231, + 0.3579948488622904 + ], + "unique_experts": 63, + "load_cv": 0.6044739701537685, + "normalized_load_entropy": 0.9591182733051958, + "max_load_share": 0.06335282651072124 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 130, + "ordered_topk_exact_tokens": 81, + "set_exact_tokens": 99, + "mean_set_jaccard": 0.9302197802197804, + "mean_token_weighted_tv": 0.012672422826290131, + "aggregate_load_tv": 0.028205128205128202 + }, + "system_bos": { + "tokens": 130, + "ordered_topk_exact_tokens": 64, + "set_exact_tokens": 87, + "mean_set_jaccard": 0.903846153846154, + "mean_token_weighted_tv": 0.01704072796094876, + "aggregate_load_tv": 0.029487179487179473 + }, + "system_x": { + "tokens": 130, + "ordered_topk_exact_tokens": 59, + "set_exact_tokens": 79, + "mean_set_jaccard": 0.8862637362637363, + "mean_token_weighted_tv": 0.019870548659505754, + "aggregate_load_tv": 0.03589743589743588 + }, + "system_period": { + "tokens": 130, + "ordered_topk_exact_tokens": 60, + "set_exact_tokens": 81, + "mean_set_jaccard": 0.8906593406593407, + "mean_token_weighted_tv": 0.01987389215053274, + "aggregate_load_tv": 0.030769230769230764 + }, + "bos_at_s0": { + "tokens": 130, + "ordered_topk_exact_tokens": 60, + "set_exact_tokens": 86, + "mean_set_jaccard": 0.8983516483516484, + "mean_token_weighted_tv": 0.018533056773818456, + "aggregate_load_tv": 0.04102564102564102 + }, + "bos_at_s1": { + "tokens": 130, + "ordered_topk_exact_tokens": 61, + "set_exact_tokens": 78, + "mean_set_jaccard": 0.8774725274725276, + "mean_token_weighted_tv": 0.02145090980025438, + "aggregate_load_tv": 0.044871794871794865 + }, + "x_at_s0": { + "tokens": 130, + "ordered_topk_exact_tokens": 68, + "set_exact_tokens": 93, + "mean_set_jaccard": 0.9124542124542124, + "mean_token_weighted_tv": 0.017230991180986165, + "aggregate_load_tv": 0.03717948717948718 + }, + "x_at_s1": { + "tokens": 130, + "ordered_topk_exact_tokens": 49, + "set_exact_tokens": 67, + "mean_set_jaccard": 0.8516483516483517, + "mean_token_weighted_tv": 0.026026129980499926, + "aggregate_load_tv": 0.05128205128205127 + }, + "period_at_s0": { + "tokens": 130, + "ordered_topk_exact_tokens": 66, + "set_exact_tokens": 88, + "mean_set_jaccard": 0.9027472527472528, + "mean_token_weighted_tv": 0.018178374886226197, + "aggregate_load_tv": 0.03717948717948718 + }, + "period_at_s1": { + "tokens": 130, + "ordered_topk_exact_tokens": 52, + "set_exact_tokens": 73, + "mean_set_jaccard": 0.8648351648351649, + "mean_token_weighted_tv": 0.024791929269066225, + "aggregate_load_tv": 0.047435897435897434 + } + } + }, + "layer_16": { + "layer": 16, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "6be681527b462213f028c119cece9559fa6786bc230e0dd7eb0aa22dd34d85b6", + "route_weight_sha256": "da58798c4a911831c158edbee2039a6f8de39cdc45b33e0b3651c56cd5fdbaaf", + "loads": [ + 17, + 18, + 1, + 18, + 5, + 8, + 20, + 25, + 17, + 24, + 1, + 16, + 0, + 4, + 13, + 6, + 7, + 9, + 9, + 21, + 0, + 32, + 0, + 19, + 0, + 13, + 18, + 5, + 16, + 1, + 14, + 7, + 9, + 9, + 15, + 10, + 20, + 17, + 11, + 4, + 12, + 8, + 17, + 9, + 7, + 17, + 30, + 14, + 11, + 8, + 6, + 24, + 40, + 3, + 3, + 10, + 31, + 7, + 21, + 3, + 20, + 3, + 6, + 11 + ], + "weighted_loads": [ + 1.2253334894776344, + 1.1351394169032574, + 0.031238162890076637, + 1.1425261199474335, + 0.17985346913337708, + 0.32512480206787586, + 1.1630775444209576, + 2.0669501665979624, + 1.7255156710743904, + 1.008475173264742, + 0.03168264031410217, + 0.7154834959656, + 0.0, + 0.13166738487780094, + 0.8154763802886009, + 0.6465217769145966, + 0.4108742978423834, + 0.7850144580006599, + 0.4535179752856493, + 1.2821580562740564, + 0.0, + 2.3837095387279987, + 0.0, + 1.211152484640479, + 0.0, + 0.7553529925644398, + 0.7279541417956352, + 0.2016267292201519, + 1.0054410547018051, + 0.04027356579899788, + 0.6615970861166716, + 0.2578109838068485, + 0.3329749330878258, + 0.3903113789856434, + 0.7220955602824688, + 0.9249203912913799, + 0.7944923564791679, + 0.7636397536844015, + 0.6515367813408375, + 0.14904305152595043, + 0.5009195357561111, + 0.33559681847691536, + 0.9969830885529518, + 0.4675947781652212, + 0.2867628075182438, + 1.4708043187856674, + 1.690867006778717, + 0.6816280595958233, + 0.8045103289186954, + 0.36868293583393097, + 0.2728436756879091, + 1.2251766081899405, + 2.0215442925691605, + 0.30099156126379967, + 0.12751880660653114, + 0.5787734873592854, + 2.103850305080414, + 0.30468456260859966, + 1.0561697203665972, + 0.11734575219452381, + 0.9856253694742918, + 0.12260463275015354, + 0.4103523753583431, + 0.3849676977843046 + ], + "unique_experts": 60, + "load_cv": 0.7114541414580173, + "normalized_load_entropy": 0.9349795677932824, + "max_load_share": 0.05128205128205128 + }, + "full_input": { + "tokens": 155, + "top_k": 6, + "decisions": 930, + "ordered_route_sha256": "c78848eac0982f155c2f63ac1744d938ec9f96e502cb9036d71ff7267e65b23e", + "route_weight_sha256": "8da425106d191518d98e36939df2fedebfade5bd3fabaea57772723528e10d30", + "loads": [ + 17, + 18, + 1, + 18, + 5, + 17, + 24, + 25, + 17, + 26, + 5, + 16, + 0, + 5, + 13, + 13, + 15, + 14, + 15, + 23, + 11, + 34, + 2, + 19, + 7, + 13, + 23, + 5, + 16, + 1, + 16, + 7, + 10, + 16, + 15, + 10, + 20, + 26, + 11, + 4, + 15, + 15, + 20, + 9, + 9, + 19, + 31, + 15, + 11, + 8, + 6, + 26, + 40, + 15, + 3, + 20, + 31, + 7, + 21, + 3, + 24, + 5, + 6, + 18 + ], + "weighted_loads": [ + 1.2253334894776344, + 1.1351394169032574, + 0.031238162890076637, + 1.1425261199474335, + 0.17985346913337708, + 1.1795839164406061, + 1.3332578390836716, + 2.0669501665979624, + 1.7255156710743904, + 2.337225902825594, + 0.22439430840313435, + 0.7154834959656, + 0.0, + 0.15074585750699043, + 0.8154763802886009, + 1.1769007816910744, + 0.8194330409169197, + 1.2135856337845325, + 1.284936735406518, + 1.3240713169798255, + 0.9699862841516733, + 2.4639347791671753, + 0.12111100181937218, + 1.211152484640479, + 0.656781330704689, + 0.7553529925644398, + 1.0094230640679598, + 0.2016267292201519, + 1.0054410547018051, + 0.04027356579899788, + 0.7546436823904514, + 0.2578109838068485, + 0.3731125481426716, + 0.7910487838089466, + 0.7220955602824688, + 0.9249203912913799, + 0.7944923564791679, + 1.3141975700855255, + 0.6515367813408375, + 0.14904305152595043, + 0.6207439973950386, + 1.690959356725216, + 1.0908645689487457, + 0.4675947781652212, + 0.37592919915914536, + 1.5681415721774101, + 1.7259186655282974, + 0.7235643640160561, + 0.8045103289186954, + 0.36868293583393097, + 0.2728436756879091, + 1.32591394148767, + 2.0215442925691605, + 1.1099852174520493, + 0.12751880660653114, + 1.3878842070698738, + 2.103850305080414, + 0.30468456260859966, + 1.0561697203665972, + 0.11734575219452381, + 1.4884601589292288, + 0.16981445415876806, + 0.4103523753583431, + 0.7327347099781036 + ], + "unique_experts": 63, + "load_cv": 0.5899807067712927, + "normalized_load_entropy": 0.9547062400635647, + "max_load_share": 0.043010752688172046 + } + }, + "s1_eos": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "bd752b5eb6f37001c115536e21e45953f94d8d08f115232552851e46bf65d1ec", + "route_weight_sha256": "9f24bde80d79fcc7008d0cc8dff8e4cc00a5aace5634f340519093de42c7b374", + "loads": [ + 17, + 18, + 1, + 18, + 6, + 7, + 20, + 25, + 18, + 22, + 0, + 15, + 1, + 3, + 16, + 6, + 8, + 9, + 8, + 21, + 0, + 34, + 0, + 19, + 0, + 13, + 18, + 5, + 16, + 1, + 12, + 6, + 10, + 10, + 14, + 10, + 18, + 19, + 10, + 4, + 10, + 7, + 17, + 11, + 8, + 17, + 29, + 14, + 11, + 8, + 6, + 25, + 39, + 4, + 3, + 10, + 32, + 8, + 19, + 2, + 18, + 4, + 6, + 14 + ], + "weighted_loads": [ + 1.2352671772241592, + 1.1305598299950361, + 0.030900893732905388, + 1.1668601036071777, + 0.20799436047673225, + 0.2953065652400255, + 1.1807594913989305, + 2.061896212399006, + 1.7473572306334972, + 0.943091006949544, + 0.0, + 0.6849843598902225, + 0.03608057647943497, + 0.10264915600419044, + 0.9472527019679546, + 0.6433680728077888, + 0.4466396998614073, + 0.7865980044007301, + 0.42448144778609276, + 1.294316228479147, + 0.0, + 2.460481718182564, + 0.0, + 1.1978851966559887, + 0.0, + 0.7617189381271601, + 0.7057288847863674, + 0.20109912380576134, + 0.993227731436491, + 0.038840726017951965, + 0.6148506067693233, + 0.2231423370540142, + 0.3688513822853565, + 0.40873917005956173, + 0.687365997582674, + 0.9293333999812603, + 0.7378082703799009, + 0.8059949651360512, + 0.6174626369029284, + 0.15438050776720047, + 0.4409266412258148, + 0.3037813752889633, + 0.9740162622183561, + 0.5181614235043526, + 0.3229090180248022, + 1.4639803878962994, + 1.6614913176745176, + 0.6676917374134064, + 0.8031339943408966, + 0.36951134353876114, + 0.2697652094066143, + 1.2430646065622568, + 2.0024515744298697, + 0.3283412139862776, + 0.12975582852959633, + 0.5800558887422085, + 2.131049729883671, + 0.33503710851073265, + 1.0251581519842148, + 0.09792353212833405, + 0.9127253349870443, + 0.15001666732132435, + 0.4081776477396488, + 0.5008725915104151 + ], + "unique_experts": 60, + "load_cv": 0.7077480468573366, + "normalized_load_entropy": 0.9355231984608323, + "max_load_share": 0.05 + }, + "full_input": { + "tokens": 171, + "top_k": 6, + "decisions": 1026, + "ordered_route_sha256": "0271f0b9403368dfd9dcb0a63ec9fc1497c17f8c37aebe9e7c69585c952f048b", + "route_weight_sha256": "7c3d83acb064bfe316101c690bc774c0124f083f3b98b430aabb36f29d1ca864", + "loads": [ + 17, + 21, + 1, + 20, + 6, + 16, + 25, + 26, + 18, + 25, + 6, + 16, + 1, + 6, + 17, + 17, + 17, + 20, + 16, + 23, + 11, + 36, + 3, + 20, + 14, + 13, + 28, + 5, + 16, + 1, + 16, + 6, + 15, + 17, + 15, + 12, + 18, + 28, + 12, + 7, + 14, + 21, + 21, + 13, + 10, + 22, + 31, + 21, + 14, + 11, + 12, + 26, + 39, + 17, + 3, + 21, + 34, + 8, + 19, + 3, + 24, + 5, + 9, + 21 + ], + "weighted_loads": [ + 1.2352671772241592, + 1.250193851068616, + 0.030900893732905388, + 1.257531527429819, + 0.20799436047673225, + 1.1943352986127138, + 1.4247730281203985, + 2.0877638813108206, + 1.7473572306334972, + 2.3045282159000635, + 0.19859963003546, + 0.7164258249104023, + 0.03608057647943497, + 0.1936559807509184, + 0.9966344311833382, + 1.688123632222414, + 0.8211513152346015, + 1.663453385233879, + 1.4707271829247475, + 1.3311397759243846, + 0.9097363408654928, + 2.5505924224853516, + 0.11623852699995041, + 1.2738898061215878, + 1.1935060564428568, + 0.7617189381271601, + 1.866756310686469, + 0.20109912380576134, + 0.993227731436491, + 0.038840726017951965, + 0.7729011047631502, + 0.2231423370540142, + 0.586648577824235, + 0.7330425195395947, + 0.7227859869599342, + 1.0470949821174145, + 0.7378082703799009, + 1.3608776610344648, + 0.7419059332460165, + 0.33273920789361, + 0.5898487642407417, + 2.6396386437118053, + 1.1029978431761265, + 0.6125375851988792, + 0.39127692207694054, + 1.7024420835077763, + 1.7293366361409426, + 1.0016331262886524, + 0.9279222656041384, + 0.5337597541511059, + 0.5343544520437717, + 1.2815227154642344, + 2.0024515744298697, + 1.4487424679100513, + 0.12975582852959633, + 1.5375957787036896, + 2.238548904657364, + 0.33503710851073265, + 1.0251581519842148, + 0.2909630537033081, + 1.456348104402423, + 0.15187149262055755, + 0.7393999844789505, + 0.8386041326448321 + ], + "unique_experts": 64, + "load_cv": 0.5335258079783542, + "normalized_load_entropy": 0.9620138362162665, + "max_load_share": 0.038011695906432746 + } + }, + "s0_bos": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "0862b5b43437a0cf47b379ce297920a42a0a7b71ffcfd7e9862160dae6733cea", + "route_weight_sha256": "efba1f0a15c24bb0ba2fdcfeca4dcdc47d9782a333c0396c726e30bd75951168", + "loads": [ + 15, + 18, + 2, + 17, + 5, + 8, + 20, + 24, + 17, + 24, + 1, + 15, + 0, + 5, + 16, + 5, + 6, + 9, + 9, + 19, + 0, + 32, + 0, + 18, + 0, + 13, + 17, + 8, + 16, + 1, + 13, + 6, + 8, + 10, + 14, + 10, + 17, + 20, + 10, + 4, + 14, + 8, + 18, + 11, + 9, + 17, + 28, + 14, + 11, + 9, + 7, + 24, + 39, + 5, + 3, + 10, + 31, + 7, + 20, + 3, + 18, + 3, + 7, + 12 + ], + "weighted_loads": [ + 1.1690135300159454, + 1.1231655310839415, + 0.06421568430960178, + 1.0944201406091452, + 0.17477945052087307, + 0.34719529189169407, + 1.1622963231056929, + 2.032531887292862, + 1.7154476195573807, + 1.0091632045805454, + 0.03360112011432648, + 0.68512824177742, + 0.0, + 0.16323165595531464, + 0.8887736201286316, + 0.593177080154419, + 0.3661803528666496, + 0.812143437564373, + 0.4616859257221222, + 1.2455145865678787, + 0.0, + 2.3652308080345392, + 0.0, + 1.1764103379100561, + 0.0, + 0.7370153181254864, + 0.7002939376980066, + 0.315882109105587, + 0.9853485599160194, + 0.039082568138837814, + 0.6664988808333874, + 0.22049481980502605, + 0.31097753159701824, + 0.41857793368399143, + 0.7044634595513344, + 0.9406150281429291, + 0.6982435397803783, + 0.8712765220552683, + 0.6331839729100466, + 0.15559688955545425, + 0.5763757526874542, + 0.3360047899186611, + 1.032106565311551, + 0.513401722535491, + 0.34164836816489697, + 1.4749419838190079, + 1.6220170147717, + 0.6742709465324879, + 0.8015611320734024, + 0.3916663844138384, + 0.3224863186478615, + 1.2449985854327679, + 2.028739223256707, + 0.3644457869231701, + 0.12626591697335243, + 0.5870730057358742, + 2.08871678635478, + 0.3017173297703266, + 1.0400436837226152, + 0.12503631226718426, + 0.9286687225103378, + 0.1270939540117979, + 0.4432178344577551, + 0.4325736239552498 + ], + "unique_experts": 60, + "load_cv": 0.6830915529348849, + "normalized_load_entropy": 0.9396287671218393, + "max_load_share": 0.05 + }, + "full_input": { + "tokens": 155, + "top_k": 6, + "decisions": 930, + "ordered_route_sha256": "345a983054367b149c0e4fffc8cd2f51b074d1322cbf022bac09116025e8c9e8", + "route_weight_sha256": "fba389370e2585d8d1345da4efadc2fb76e82048fa94a7e7344e74c184ff0888", + "loads": [ + 15, + 18, + 2, + 17, + 5, + 18, + 24, + 24, + 17, + 26, + 4, + 16, + 1, + 7, + 16, + 12, + 14, + 14, + 15, + 21, + 11, + 34, + 2, + 18, + 6, + 13, + 21, + 8, + 16, + 1, + 15, + 6, + 9, + 15, + 15, + 10, + 17, + 29, + 10, + 4, + 17, + 16, + 21, + 11, + 12, + 19, + 29, + 15, + 11, + 10, + 8, + 26, + 39, + 17, + 3, + 20, + 31, + 7, + 20, + 3, + 21, + 4, + 7, + 17 + ], + "weighted_loads": [ + 1.1690135300159454, + 1.1231655310839415, + 0.06421568430960178, + 1.0944201406091452, + 0.17477945052087307, + 1.2376096043735743, + 1.3324766177684069, + 2.032531887292862, + 1.7154476195573807, + 1.4293871596455574, + 0.20788735151290894, + 0.7237800136208534, + 0.07405458390712738, + 0.22324548847973347, + 0.8887736201286316, + 1.171599492430687, + 1.2509368974715471, + 1.2592367194592953, + 1.232145108282566, + 1.3158952053636312, + 0.9699862841516733, + 2.445456048473716, + 0.12111100181937218, + 1.1764103379100561, + 0.6030621640384197, + 0.7370153181254864, + 0.9278760775923729, + 0.315882109105587, + 0.9853485599160194, + 0.039082568138837814, + 0.7595454771071672, + 0.22049481980502605, + 0.35111514665186405, + 0.7551235631108284, + 0.8256842270493507, + 0.9406150281429291, + 0.6982435397803783, + 1.4195164181292057, + 0.6331839729100466, + 0.15559688955545425, + 0.6988018155097961, + 1.7182258144021034, + 1.1265357490628958, + 0.513401722535491, + 0.4560214299708605, + 1.5778343975543976, + 1.6561404280364513, + 0.7295811995863914, + 0.8015611320734024, + 0.4359739739447832, + 0.3666417524218559, + 1.3457359187304974, + 2.028739223256707, + 1.1734185591340065, + 0.12626591697335243, + 1.3961837254464626, + 2.08871678635478, + 0.3017173297703266, + 1.0400436837226152, + 0.12503631226718426, + 1.3686023391783237, + 0.1724808644503355, + 0.4432178344577551, + 0.7206161301583052 + ], + "unique_experts": 64, + "load_cv": 0.5677378624813171, + "normalized_load_entropy": 0.958675634922884, + "max_load_share": 0.041935483870967745 + } + }, + "s1_bos": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "4bf5648be63a6b422102e6188bc792eb7253287bee53a758beb970fcf75152ac", + "route_weight_sha256": "df7793b4271e8afbdb1114bb8494f7fb602a2ee957ac122449390d12d926c52c", + "loads": [ + 16, + 19, + 2, + 16, + 5, + 9, + 20, + 22, + 18, + 25, + 0, + 15, + 0, + 3, + 17, + 5, + 6, + 9, + 8, + 21, + 0, + 31, + 0, + 19, + 0, + 13, + 17, + 5, + 17, + 1, + 11, + 6, + 9, + 10, + 14, + 10, + 17, + 19, + 9, + 4, + 15, + 8, + 18, + 9, + 8, + 18, + 28, + 15, + 12, + 9, + 8, + 23, + 42, + 4, + 3, + 10, + 31, + 8, + 21, + 3, + 17, + 4, + 6, + 12 + ], + "weighted_loads": [ + 1.2092008292675018, + 1.1625498104840517, + 0.06092984788119793, + 1.0601359903812408, + 0.17320495657622814, + 0.38500575721263885, + 1.1609880533069372, + 1.9360495880246162, + 1.7561925314366817, + 1.0280972439795732, + 0.0, + 0.6795515548437834, + 0.0, + 0.10263968631625175, + 0.9534926768392324, + 0.6238882429897785, + 0.3718921411782503, + 0.7833407931029797, + 0.42819397523999214, + 1.3135868571698666, + 0.0, + 2.3112735766917467, + 0.0, + 1.1815941520035267, + 0.0, + 0.7616489566862583, + 0.6948678754270077, + 0.21505963988602161, + 1.0400049164891243, + 0.03800518065690994, + 0.6180534586310387, + 0.21700514294207096, + 0.34067120030522346, + 0.4099024161696434, + 0.712021104991436, + 0.9345854818820953, + 0.7157400157302618, + 0.8177299462258816, + 0.5980513710528612, + 0.15756084769964218, + 0.5968509763479233, + 0.34808830358088017, + 1.0328857935965061, + 0.43898356705904007, + 0.31829642690718174, + 1.463821018114686, + 1.6190038286149502, + 0.708276005461812, + 0.8400731310248375, + 0.40256280824542046, + 0.349224254488945, + 1.1642644703388214, + 2.1245857682079077, + 0.3235330209136009, + 0.12924037128686905, + 0.5686006955802441, + 2.0904885716736317, + 0.32126516103744507, + 1.0859789662063122, + 0.12411432527005672, + 0.91166159696877, + 0.14712719060480595, + 0.4183995723724365, + 0.44492971524596214 + ], + "unique_experts": 59, + "load_cv": 0.7041718456212805, + "normalized_load_entropy": 0.9358551310515293, + "max_load_share": 0.05384615384615385 + }, + "full_input": { + "tokens": 171, + "top_k": 6, + "decisions": 1026, + "ordered_route_sha256": "de91ec8e82191aa58f8a407322cb3fe5d6de4175737715b62e9bc62632967bd6", + "route_weight_sha256": "878e7e64f6e1d4545849aee8d67dbc9d185f52e5fcb6dcc616e26d3ebf34b63e", + "loads": [ + 16, + 22, + 2, + 18, + 5, + 18, + 25, + 23, + 18, + 28, + 5, + 16, + 0, + 6, + 18, + 16, + 16, + 19, + 16, + 21, + 11, + 33, + 3, + 20, + 13, + 13, + 28, + 5, + 17, + 1, + 15, + 6, + 14, + 18, + 16, + 12, + 17, + 28, + 11, + 7, + 19, + 23, + 22, + 11, + 13, + 23, + 29, + 22, + 15, + 12, + 14, + 24, + 42, + 17, + 3, + 21, + 33, + 8, + 21, + 4, + 23, + 4, + 9, + 18 + ], + "weighted_loads": [ + 1.2092008292675018, + 1.2821838315576315, + 0.06092984788119793, + 1.1508074142038822, + 0.17320495657622814, + 1.2709452360868454, + 1.4050015900284052, + 1.961917256936431, + 1.7561925314366817, + 1.4792219419032335, + 0.18319385685026646, + 0.7109930198639631, + 0.0, + 0.1936465110629797, + 1.002874406054616, + 1.678803127259016, + 1.2230387143790722, + 1.6293948143720627, + 1.4551935568451881, + 1.3135868571698666, + 0.9097363408654928, + 2.4013842809945345, + 0.11623852699995041, + 1.2575987614691257, + 1.1156777311116457, + 0.7616489566862583, + 1.8851919900625944, + 0.21505963988602161, + 1.0400049164891243, + 0.03800518065690994, + 0.7761039566248655, + 0.21700514294207096, + 0.5584683958441019, + 0.8314661886543036, + 0.7918271459639072, + 1.0523470640182495, + 0.7157400157302618, + 1.3717969823628664, + 0.7224946673959494, + 0.3359195478260517, + 0.7453436031937599, + 2.7395922783762217, + 1.165623540058732, + 0.5333597287535667, + 0.49362902343273163, + 1.7013856451958418, + 1.650496132671833, + 1.0544629450887442, + 0.9648614022880793, + 0.5668112188577652, + 0.6208114437758923, + 1.202722579240799, + 2.1245857682079077, + 1.446247385814786, + 0.12924037128686905, + 1.5261405855417252, + 2.1979877464473248, + 0.32126516103744507, + 1.0859789662063122, + 0.3171538468450308, + 1.4736675377935171, + 0.14712719060480595, + 0.7496219091117382, + 0.7923689242452383 + ], + "unique_experts": 63, + "load_cv": 0.5313562696286941, + "normalized_load_entropy": 0.9618093558130869, + "max_load_share": 0.04093567251461988 + } + }, + "s0_x": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "c37513ee1285c6dc9b1731480a496bd3db077c6731f7c7afef9821652ab12166", + "route_weight_sha256": "3f971a562f9f252cadeff47bf4847dcb9da68658f284c824807c288cd64fe931", + "loads": [ + 17, + 18, + 1, + 18, + 4, + 8, + 19, + 24, + 18, + 23, + 0, + 15, + 0, + 4, + 15, + 5, + 7, + 9, + 9, + 19, + 0, + 33, + 0, + 19, + 0, + 14, + 19, + 6, + 16, + 1, + 12, + 5, + 8, + 10, + 14, + 10, + 19, + 19, + 11, + 4, + 14, + 6, + 17, + 9, + 7, + 18, + 28, + 14, + 11, + 11, + 8, + 25, + 38, + 5, + 3, + 10, + 32, + 6, + 21, + 3, + 19, + 3, + 6, + 13 + ], + "weighted_loads": [ + 1.2409825921058655, + 1.122869724407792, + 0.03415318578481674, + 1.126934727653861, + 0.1441366858780384, + 0.3396691828966141, + 1.1402224190533161, + 2.0298131704330444, + 1.7717703394591808, + 0.9782625287771225, + 0.0, + 0.6672605182975531, + 0.0, + 0.12588351592421532, + 0.856356656178832, + 0.626160703599453, + 0.4110411014407873, + 0.787265308201313, + 0.44439754635095596, + 1.2413290813565254, + 0.0, + 2.4213841129094362, + 0.0, + 1.2133768051862717, + 0.0, + 0.7818204686045647, + 0.7574230115860701, + 0.23297279328107834, + 0.9919574744999409, + 0.038811150938272476, + 0.6151552125811577, + 0.19353286176919937, + 0.30339363403618336, + 0.411193385720253, + 0.7386743482202291, + 0.9359409920871258, + 0.7783417105674744, + 0.831054350361228, + 0.665960293263197, + 0.15759427845478058, + 0.5590388868004084, + 0.26847539842128754, + 1.0152268633246422, + 0.45894089713692665, + 0.28777800127863884, + 1.514041680842638, + 1.6380792818963528, + 0.655395146459341, + 0.7901004888117313, + 0.4539673775434494, + 0.35130223259329796, + 1.2444227766245604, + 1.956388272345066, + 0.365926843136549, + 0.1282309852540493, + 0.5761285237967968, + 2.13945147767663, + 0.26465296372771263, + 1.075870392844081, + 0.11995809711515903, + 0.9780522249639034, + 0.12784523144364357, + 0.4178166016936302, + 0.4619471449404955 + ], + "unique_experts": 59, + "load_cv": 0.7032749538761542, + "normalized_load_entropy": 0.9348803610746205, + "max_load_share": 0.04871794871794872 + }, + "full_input": { + "tokens": 155, + "top_k": 6, + "decisions": 930, + "ordered_route_sha256": "2cc08c2b239148c7b4cad3563a8d30dea4b17200404cccbfdf61877c10c445ee", + "route_weight_sha256": "6329b97d890df6cada8417a23109c0890113ed3babe4be037cdac76da3df62e1", + "loads": [ + 17, + 18, + 1, + 18, + 4, + 17, + 23, + 24, + 18, + 24, + 3, + 15, + 0, + 5, + 15, + 12, + 14, + 15, + 15, + 20, + 12, + 36, + 2, + 19, + 7, + 14, + 24, + 6, + 16, + 1, + 15, + 5, + 10, + 15, + 14, + 10, + 19, + 29, + 11, + 4, + 17, + 13, + 20, + 9, + 9, + 20, + 28, + 15, + 11, + 11, + 9, + 27, + 38, + 18, + 3, + 21, + 32, + 6, + 21, + 3, + 23, + 4, + 6, + 19 + ], + "weighted_loads": [ + 1.2409825921058655, + 1.122869724407792, + 0.03415318578481674, + 1.126934727653861, + 0.1441366858780384, + 1.1863149926066399, + 1.3104027137160301, + 2.0298131704330444, + 1.7717703394591808, + 1.3563961833715439, + 0.17428623139858246, + 0.6672605182975531, + 0.0, + 0.1449619885534048, + 0.856356656178832, + 1.231195468455553, + 0.7463564816862345, + 1.25320640578866, + 1.2985482662916183, + 1.2807956635951996, + 1.2172325495630503, + 2.536425845697522, + 0.12111100181937218, + 1.2133768051862717, + 0.6709270812571049, + 0.7818204686045647, + 1.0464060604572296, + 0.23297279328107834, + 0.9919574744999409, + 0.038811150938272476, + 0.7548231352120638, + 0.19353286176919937, + 0.4176871608942747, + 0.7300884630531073, + 0.7386743482202291, + 0.9359409920871258, + 0.7783417105674744, + 1.4130591079592705, + 0.665960293263197, + 0.15759427845478058, + 0.6793246995657682, + 1.5498892664909363, + 1.121759869158268, + 0.45894089713692665, + 0.3661732077598572, + 1.6152405962347984, + 1.6380792818963528, + 0.7157167382538319, + 0.7901004888117313, + 0.4539673775434494, + 0.3862145021557808, + 1.3451601099222898, + 1.956388272345066, + 1.3076464869081974, + 0.1282309852540493, + 1.4958605021238327, + 2.13945147767663, + 0.26465296372771263, + 1.075870392844081, + 0.11995809711515903, + 1.4660084396600723, + 0.17323214188218117, + 0.4178166016936302, + 0.7926606796681881 + ], + "unique_experts": 63, + "load_cv": 0.5889764702094644, + "normalized_load_entropy": 0.9542028527116296, + "max_load_share": 0.04086021505376344 + } + }, + "s1_x": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "f5dd8183b242974ae07a0425978c5858cc7d09f7f8efc858584576a49eff2282", + "route_weight_sha256": "590eceda7cc35cfa5605984ecfb1cb98a6c9d4da43805c0a769ca5b5caebcbe0", + "loads": [ + 16, + 19, + 1, + 17, + 6, + 9, + 20, + 22, + 18, + 26, + 0, + 15, + 0, + 3, + 16, + 5, + 8, + 9, + 9, + 22, + 0, + 33, + 1, + 19, + 0, + 13, + 18, + 6, + 16, + 2, + 13, + 6, + 10, + 9, + 13, + 10, + 18, + 18, + 11, + 4, + 13, + 5, + 15, + 8, + 7, + 18, + 29, + 13, + 12, + 11, + 8, + 23, + 36, + 4, + 3, + 10, + 31, + 6, + 21, + 3, + 18, + 4, + 7, + 14 + ], + "weighted_loads": [ + 1.2175799757242203, + 1.1569967940449715, + 0.03329366818070412, + 1.099420515820384, + 0.20165622048079967, + 0.38499726727604866, + 1.1395878661423922, + 1.9026458654552698, + 1.7641882747411728, + 1.0740184169262648, + 0.0, + 0.6650322712957859, + 0.0, + 0.09730968438088894, + 0.9432875104248524, + 0.6124796569347382, + 0.45079487562179565, + 0.7786108590662479, + 0.4392006639391184, + 1.3677707128226757, + 0.0, + 2.3747274465858936, + 0.02936440147459507, + 1.1910957470536232, + 0.0, + 0.747262753546238, + 0.7344100754708052, + 0.2402850892394781, + 1.0092372968792915, + 0.08014728873968124, + 0.6414316333830357, + 0.22143881767988205, + 0.3669765256345272, + 0.35940155386924744, + 0.6828104723244905, + 0.9225397109985352, + 0.7552406881004572, + 0.7598609700798988, + 0.6683160550892353, + 0.1625705398619175, + 0.5152065865695477, + 0.23997972160577774, + 0.9088572263717651, + 0.4014194030314684, + 0.2974431551992893, + 1.456560604274273, + 1.6675773989409208, + 0.6197974476963282, + 0.8322722967714071, + 0.4624153394252062, + 0.3559530805796385, + 1.1702038533985615, + 1.8844205271452665, + 0.3279111888259649, + 0.1246836669743061, + 0.568026889115572, + 2.089223314076662, + 0.2596953585743904, + 1.086377877742052, + 0.120118647813797, + 0.9660468436777592, + 0.1439639925956726, + 0.43928928673267365, + 0.4998862221837044 + ], + "unique_experts": 60, + "load_cv": 0.6867775326520861, + "normalized_load_entropy": 0.9383550735626749, + "max_load_share": 0.046153846153846156 + }, + "full_input": { + "tokens": 171, + "top_k": 6, + "decisions": 1026, + "ordered_route_sha256": "4a1c49ac071b4763a03119a4220620bfa56eb940089f6829dc049b859e8132cc", + "route_weight_sha256": "b8561c1078fbb48fef85cede18136b4f9edc7320a9b351c8f20f60cbf9c4845b", + "loads": [ + 16, + 22, + 1, + 19, + 6, + 18, + 25, + 23, + 18, + 28, + 6, + 16, + 0, + 6, + 17, + 16, + 17, + 20, + 17, + 22, + 14, + 36, + 4, + 20, + 14, + 13, + 28, + 6, + 16, + 2, + 18, + 6, + 16, + 14, + 14, + 12, + 18, + 27, + 13, + 7, + 17, + 19, + 19, + 10, + 10, + 23, + 30, + 20, + 15, + 14, + 13, + 24, + 36, + 18, + 3, + 22, + 33, + 7, + 21, + 4, + 23, + 5, + 10, + 19 + ], + "weighted_loads": [ + 1.2175799757242203, + 1.2766308151185513, + 0.03329366818070412, + 1.1900919396430254, + 0.20165622048079967, + 1.2674203477799892, + 1.3836014028638601, + 1.9285135343670845, + 1.7641882747411728, + 1.4868739899247885, + 0.20953844860196114, + 0.6964737363159657, + 0.0, + 0.18831650912761688, + 0.9926692396402359, + 1.7239249907433987, + 0.8068102933466434, + 1.6524157412350178, + 1.4074172358959913, + 1.3677707128226757, + 1.2716794107109308, + 2.500125013291836, + 0.14560292847454548, + 1.2671003565192223, + 1.2166049797087908, + 0.747262753546238, + 1.8682916723191738, + 0.2402850892394781, + 1.0092372968792915, + 0.08014728873968124, + 0.8309269640594721, + 0.22143881767988205, + 0.6489209625869989, + 0.5809961725026369, + 0.7182304617017508, + 1.0403012931346893, + 0.7552406881004572, + 1.308980694040656, + 0.7927593514323235, + 0.340929239988327, + 0.6632063947618008, + 2.420757208019495, + 1.0478778183460236, + 0.49579556472599506, + 0.4004556443542242, + 1.7067574448883533, + 1.6990697029978037, + 0.954332796856761, + 0.9570605680346489, + 0.6266637500375509, + 0.5807806868106127, + 1.208661962300539, + 1.8844205271452665, + 1.544129639863968, + 0.1246836669743061, + 1.658906750380993, + 2.196722488850355, + 0.3216650225222111, + 1.086377877742052, + 0.31315816938877106, + 1.450029119849205, + 0.1836598627269268, + 0.7705116234719753, + 0.7970224525779486 + ], + "unique_experts": 63, + "load_cv": 0.5122479153764208, + "normalized_load_entropy": 0.9642361264087848, + "max_load_share": 0.03508771929824561 + } + }, + "s0_period": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "61da2887825b9e91c801f1df4e4d2e88bc822ed511638e133c158b7a6c12fd20", + "route_weight_sha256": "2cc27269c7b97e53038ed5ba5c37e7b24609c65d390bf26faddd85d5e48d9df3", + "loads": [ + 17, + 18, + 1, + 18, + 4, + 9, + 19, + 24, + 17, + 24, + 1, + 15, + 0, + 3, + 15, + 5, + 9, + 9, + 8, + 19, + 0, + 32, + 2, + 19, + 0, + 13, + 18, + 4, + 16, + 1, + 13, + 5, + 8, + 10, + 14, + 10, + 18, + 19, + 11, + 4, + 12, + 6, + 16, + 9, + 7, + 18, + 29, + 14, + 11, + 9, + 8, + 25, + 40, + 4, + 3, + 10, + 32, + 6, + 20, + 3, + 21, + 4, + 6, + 15 + ], + "weighted_loads": [ + 1.2397053465247154, + 1.1231944244354963, + 0.033182017505168915, + 1.1249413304030895, + 0.14771954156458378, + 0.37168940156698227, + 1.1594752073287964, + 2.024649951606989, + 1.7253294251859188, + 1.019668584689498, + 0.031458619982004166, + 0.6739977616816759, + 0.0, + 0.0980354156345129, + 0.848744809627533, + 0.6212731525301933, + 0.47240879014134407, + 0.7884506583213806, + 0.4203691016882658, + 1.240598525851965, + 0.0, + 2.353974599391222, + 0.05301208049058914, + 1.2096127029508352, + 0.0, + 0.7539727725088596, + 0.7282681986689568, + 0.18513591401278973, + 0.9885275363922119, + 0.03815794363617897, + 0.6675912253558636, + 0.19242925196886063, + 0.30940815806388855, + 0.41169485077261925, + 0.7174608632922173, + 0.9423860237002373, + 0.7428255937993526, + 0.8341980967670679, + 0.6566249057650566, + 0.15491194650530815, + 0.5035499688237906, + 0.2740451358258724, + 0.9843220598995686, + 0.45633669197559357, + 0.28782350942492485, + 1.5051874164491892, + 1.6816926933825016, + 0.6510123535990715, + 0.7849375456571579, + 0.4007278960198164, + 0.35063193552196026, + 1.2355782110244036, + 2.0593279264867306, + 0.3279871232807636, + 0.1270882487297058, + 0.5793224051594734, + 2.1432653926312923, + 0.2672076001763344, + 1.0488458592444658, + 0.11976304464042187, + 1.054656868800521, + 0.1504099890589714, + 0.42084594815969467, + 0.5183935724198818 + ], + "unique_experts": 61, + "load_cv": 0.7078966631741319, + "normalized_load_entropy": 0.9363833435933276, + "max_load_share": 0.05128205128205128 + }, + "full_input": { + "tokens": 155, + "top_k": 6, + "decisions": 930, + "ordered_route_sha256": "2ff1c8ea45c3bfe137ca825fb3cc94be332b76f7e7ca6d92f71394f68e81dca2", + "route_weight_sha256": "5a16d93c5879d6dfbaa16d537d207d147357899b0f7549cd5f0b87c7ab2dd110", + "loads": [ + 17, + 18, + 1, + 18, + 4, + 19, + 23, + 24, + 17, + 25, + 5, + 15, + 0, + 4, + 15, + 12, + 16, + 15, + 14, + 20, + 12, + 34, + 5, + 19, + 8, + 13, + 23, + 4, + 16, + 1, + 16, + 5, + 9, + 14, + 14, + 10, + 18, + 28, + 11, + 4, + 15, + 13, + 19, + 9, + 9, + 20, + 30, + 16, + 11, + 9, + 8, + 27, + 40, + 17, + 3, + 21, + 32, + 6, + 20, + 3, + 25, + 5, + 6, + 20 + ], + "weighted_loads": [ + 1.2397053465247154, + 1.1231944244354963, + 0.033182017505168915, + 1.1249413304030895, + 0.14771954156458378, + 1.2593112960457802, + 1.3296555019915104, + 2.024649951606989, + 1.7253294251859188, + 1.3978022392839193, + 0.2597094103693962, + 0.6739977616816759, + 0.0, + 0.11711388826370239, + 0.848744809627533, + 1.2311354614794254, + 0.8491151370108128, + 1.3640031702816486, + 1.2133650537580252, + 1.2800651080906391, + 1.04706677980721, + 2.4341998398303986, + 0.21499258652329445, + 1.2096127029508352, + 0.7514189556241035, + 0.7539727725088596, + 1.0286703202873468, + 0.18513591401278973, + 0.9885275363922119, + 0.03815794363617897, + 0.8259938601404428, + 0.19242925196886063, + 0.34954577311873436, + 0.6888412367552519, + 0.7174608632922173, + 0.9423860237002373, + 0.7428255937993526, + 1.3850725777447224, + 0.6566249057650566, + 0.15491194650530815, + 0.6247346270829439, + 1.536364872008562, + 1.0863793436437845, + 0.45633669197559357, + 0.3762391321361065, + 1.6060897912830114, + 1.7143705859780312, + 0.7455429695546627, + 0.7849375456571579, + 0.4007278960198164, + 0.35063193552196026, + 1.336315544322133, + 2.0593279264867306, + 1.1742121390998363, + 0.1270882487297058, + 1.4510574452579021, + 2.1432653926312923, + 0.2672076001763344, + 1.0488458592444658, + 0.11976304464042187, + 1.5382106956094503, + 0.195796899497509, + 0.42084594815969467, + 0.8183547426015139 + ], + "unique_experts": 63, + "load_cv": 0.5906074875084765, + "normalized_load_entropy": 0.9547855571788584, + "max_load_share": 0.043010752688172046 + } + }, + "s1_period": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "09eaa0f423a94ec3fed4e065ff0f31e940d4891bdc9f7db15ddd44646717c546", + "route_weight_sha256": "b105fd34fca6882ef4d59a814ffeee431a498f84caea09be9e727b044d0192ca", + "loads": [ + 16, + 19, + 1, + 17, + 6, + 10, + 18, + 22, + 18, + 25, + 0, + 14, + 0, + 6, + 16, + 5, + 7, + 9, + 7, + 25, + 1, + 33, + 0, + 19, + 1, + 13, + 17, + 6, + 16, + 2, + 12, + 6, + 9, + 9, + 13, + 10, + 17, + 16, + 11, + 5, + 12, + 5, + 16, + 8, + 8, + 18, + 28, + 14, + 12, + 11, + 8, + 26, + 39, + 3, + 4, + 10, + 32, + 6, + 21, + 3, + 16, + 4, + 6, + 13 + ], + "weighted_loads": [ + 1.2171657755970955, + 1.1585654933005571, + 0.03284226357936859, + 1.0875161364674568, + 0.20012574084103107, + 0.4128332082182169, + 1.1019323095679283, + 1.908098354935646, + 1.766704585403204, + 1.0540328603237867, + 0.0, + 0.6300349589437246, + 0.0, + 0.18979582376778126, + 0.9543799236416817, + 0.6297349482774734, + 0.4280474353581667, + 0.7704399190843105, + 0.3641143813729286, + 1.4548099748790264, + 0.0266987644135952, + 2.3493979908525944, + 0.0, + 1.2013000883162022, + 0.026984428986907005, + 0.7538676895201206, + 0.6909686699509621, + 0.25055654160678387, + 1.0055313780903816, + 0.08131253346800804, + 0.616546593606472, + 0.2178809642791748, + 0.3523861300200224, + 0.3608109671622515, + 0.6915889997035265, + 0.9117926359176636, + 0.7202355414628983, + 0.6988254524767399, + 0.6730976831167936, + 0.1899811550974846, + 0.4928265940397978, + 0.2356094792485237, + 0.9432201534509659, + 0.4117072429507971, + 0.32161923311650753, + 1.460186256095767, + 1.6269045770168304, + 0.6543249022215605, + 0.8396456278860569, + 0.4651303384453058, + 0.3488806188106537, + 1.2716826666146517, + 1.97948756814003, + 0.2846311666071415, + 0.153535608202219, + 0.57583012804389, + 2.1326035782694817, + 0.264247864484787, + 1.1011756286025047, + 0.12023499980568886, + 0.9054128769785166, + 0.14377662539482117, + 0.4034683108329773, + 0.45849887281656265 + ], + "unique_experts": 61, + "load_cv": 0.6966624670749105, + "normalized_load_entropy": 0.939032573628691, + "max_load_share": 0.05 + }, + "full_input": { + "tokens": 171, + "top_k": 6, + "decisions": 1026, + "ordered_route_sha256": "abffd69403f70245ddf4c6185de3b86c5cc9dcb580ace419da86916877799908", + "route_weight_sha256": "6ca03ef420601202061ac0d9c627530f3e71d10f9b2ef2b74696eac1de886580", + "loads": [ + 16, + 22, + 1, + 19, + 6, + 20, + 23, + 23, + 18, + 27, + 6, + 15, + 0, + 9, + 17, + 16, + 15, + 21, + 15, + 25, + 13, + 35, + 3, + 20, + 16, + 13, + 27, + 6, + 16, + 2, + 17, + 6, + 14, + 14, + 14, + 12, + 17, + 25, + 14, + 8, + 17, + 20, + 20, + 10, + 11, + 23, + 29, + 20, + 15, + 14, + 13, + 27, + 39, + 17, + 5, + 22, + 34, + 6, + 21, + 4, + 21, + 5, + 9, + 18 + ], + "weighted_loads": [ + 1.2171657755970955, + 1.278199514374137, + 0.03284226357936859, + 1.1781875602900982, + 0.20012574084103107, + 1.3196932394057512, + 1.3459458462893963, + 1.9339660238474607, + 1.766704585403204, + 1.4668884333223104, + 0.21659022383391857, + 0.6614764239639044, + 0.0, + 0.2808026485145092, + 1.0037616528570652, + 1.7430687919259071, + 0.7443918604403734, + 1.7160210236907005, + 1.358261775225401, + 1.4548099748790264, + 1.005586290732026, + 2.439508695155382, + 0.11623852699995041, + 1.2773046977818012, + 1.3218746706843376, + 0.7538676895201206, + 1.8499394487589598, + 0.25055654160678387, + 1.0055313780903816, + 0.08131253346800804, + 0.8374128621071577, + 0.2178809642791748, + 0.5701833255589008, + 0.5737102702260017, + 0.7270089890807867, + 1.0295542180538177, + 0.7202355414628983, + 1.2480033058673143, + 0.8512428682297468, + 0.3683398552238941, + 0.6804859098047018, + 2.3786334432661533, + 1.0771713592112064, + 0.5060834046453238, + 0.4236416667699814, + 1.7186327707022429, + 1.6583968810737133, + 0.948914160951972, + 0.9644338991492987, + 0.6293787490576506, + 0.5737082250416279, + 1.3101407755166292, + 1.97948756814003, + 1.4597789961844683, + 0.1954718753695488, + 1.5814008079469204, + 2.2401027530431747, + 0.264247864484787, + 1.1011756286025047, + 0.3132745213806629, + 1.4240281749516726, + 0.19826463982462883, + 0.734690647572279, + 0.7582420166581869 + ], + "unique_experts": 63, + "load_cv": 0.5128410096228376, + "normalized_load_entropy": 0.964653539974712, + "max_load_share": 0.038011695906432746 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 130, + "ordered_topk_exact_tokens": 78, + "set_exact_tokens": 95, + "mean_set_jaccard": 0.9230769230769231, + "mean_token_weighted_tv": 0.013094205394960368, + "aggregate_load_tv": 0.030769230769230767 + }, + "system_bos": { + "tokens": 130, + "ordered_topk_exact_tokens": 72, + "set_exact_tokens": 92, + "mean_set_jaccard": 0.9148351648351647, + "mean_token_weighted_tv": 0.015821841158545933, + "aggregate_load_tv": 0.02820512820512821 + }, + "system_x": { + "tokens": 130, + "ordered_topk_exact_tokens": 66, + "set_exact_tokens": 86, + "mean_set_jaccard": 0.9, + "mean_token_weighted_tv": 0.018845126770723326, + "aggregate_load_tv": 0.030769230769230764 + }, + "system_period": { + "tokens": 130, + "ordered_topk_exact_tokens": 66, + "set_exact_tokens": 76, + "mean_set_jaccard": 0.8780219780219781, + "mean_token_weighted_tv": 0.02186464531203875, + "aggregate_load_tv": 0.04102564102564103 + }, + "bos_at_s0": { + "tokens": 130, + "ordered_topk_exact_tokens": 73, + "set_exact_tokens": 90, + "mean_set_jaccard": 0.9104395604395604, + "mean_token_weighted_tv": 0.016730426882322017, + "aggregate_load_tv": 0.03205128205128205 + }, + "bos_at_s1": { + "tokens": 130, + "ordered_topk_exact_tokens": 69, + "set_exact_tokens": 87, + "mean_set_jaccard": 0.9021978021978021, + "mean_token_weighted_tv": 0.018218471539708285, + "aggregate_load_tv": 0.0358974358974359 + }, + "x_at_s0": { + "tokens": 130, + "ordered_topk_exact_tokens": 64, + "set_exact_tokens": 86, + "mean_set_jaccard": 0.9, + "mean_token_weighted_tv": 0.01793834071319837, + "aggregate_load_tv": 0.03076923076923077 + }, + "x_at_s1": { + "tokens": 130, + "ordered_topk_exact_tokens": 65, + "set_exact_tokens": 79, + "mean_set_jaccard": 0.8862637362637363, + "mean_token_weighted_tv": 0.021146569279237436, + "aggregate_load_tv": 0.035897435897435895 + }, + "period_at_s0": { + "tokens": 130, + "ordered_topk_exact_tokens": 65, + "set_exact_tokens": 89, + "mean_set_jaccard": 0.9082417582417583, + "mean_token_weighted_tv": 0.017134868582853905, + "aggregate_load_tv": 0.029487179487179487 + }, + "period_at_s1": { + "tokens": 130, + "ordered_topk_exact_tokens": 63, + "set_exact_tokens": 76, + "mean_set_jaccard": 0.8780219780219781, + "mean_token_weighted_tv": 0.022645146041535415, + "aggregate_load_tv": 0.04358974358974359 + } + } + }, + "layer_17": { + "layer": 17, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "a9b5f85dc2477b0af1eab92c95676661a63c5485f7cd353f3f4b2a71436a6b67", + "route_weight_sha256": "c0417742c3a97b4b2d50551572cbd471739a822b3d6f940f18b3fdcb84e34d1c", + "loads": [ + 12, + 9, + 1, + 15, + 8, + 17, + 10, + 13, + 25, + 21, + 5, + 7, + 5, + 21, + 16, + 5, + 15, + 13, + 4, + 6, + 9, + 9, + 7, + 8, + 10, + 23, + 9, + 24, + 3, + 4, + 12, + 7, + 8, + 25, + 16, + 19, + 24, + 13, + 11, + 24, + 8, + 4, + 5, + 5, + 12, + 7, + 10, + 26, + 37, + 2, + 12, + 8, + 23, + 7, + 16, + 8, + 13, + 7, + 16, + 15, + 14, + 15, + 5, + 12 + ], + "weighted_loads": [ + 0.5390824470669031, + 0.3688059151172638, + 0.045462898910045624, + 1.020459532737732, + 0.6182997301220894, + 0.8931770026683807, + 0.5392847564071417, + 0.72733548656106, + 1.6453902777284384, + 1.0832487605512142, + 0.22764160111546516, + 0.43981270492076874, + 0.17717814818024635, + 2.435041517019272, + 0.8282407354563475, + 0.30488523095846176, + 0.819597139954567, + 1.2258870098739862, + 0.7097603194415569, + 0.2609046269208193, + 0.4622118752449751, + 0.44607069343328476, + 0.49500588700175285, + 0.5317614860832691, + 0.6915232613682747, + 1.6401605308055878, + 0.4379294477403164, + 1.2903484795242548, + 0.12735442630946636, + 0.15017507039010525, + 1.2103657107800245, + 0.40092846006155014, + 0.31339438259601593, + 1.6921017076820135, + 0.9282803125679493, + 2.3574280831962824, + 1.893821820616722, + 0.600424287840724, + 0.4188757333904505, + 1.3847710900008678, + 0.3716013915836811, + 0.12331409379839897, + 0.6523956209421158, + 0.1916593499481678, + 0.8284057229757309, + 0.3761727325618267, + 0.5362916849553585, + 1.702954737469554, + 3.5306782964617014, + 0.05771615542471409, + 0.9891786333173513, + 0.42309520952403545, + 1.586087629199028, + 0.35075170919299126, + 0.6290951296687126, + 0.6118261739611626, + 0.6717266142368317, + 0.32799854315817356, + 1.1553285121917725, + 0.6477543376386166, + 0.7309629879891872, + 0.8263307381421328, + 1.0380459539592266, + 0.7497442215681076 + ], + "unique_experts": 64, + "load_cv": 0.5886277068332819, + "normalized_load_entropy": 0.9599979342686056, + "max_load_share": 0.047435897435897434 + }, + "full_input": { + "tokens": 155, + "top_k": 6, + "decisions": 930, + "ordered_route_sha256": "76cca6e6d236dfb2cc71bb4040349f93f8f60c0cd54e0b71edbdb39c71f68138", + "route_weight_sha256": "e693b5cf6933f6496766f55c2b11f0be6b048c0829a33e0c89b8b34f6e4335ff", + "loads": [ + 21, + 10, + 4, + 22, + 8, + 17, + 12, + 13, + 25, + 25, + 13, + 8, + 8, + 29, + 16, + 9, + 15, + 20, + 6, + 6, + 12, + 9, + 7, + 15, + 16, + 30, + 19, + 28, + 7, + 5, + 12, + 7, + 16, + 25, + 16, + 19, + 24, + 13, + 16, + 24, + 15, + 8, + 6, + 7, + 12, + 11, + 10, + 26, + 37, + 2, + 14, + 8, + 26, + 7, + 16, + 11, + 13, + 11, + 16, + 15, + 14, + 16, + 10, + 12 + ], + "weighted_loads": [ + 0.8235619971528649, + 0.4047481492161751, + 0.1722365766763687, + 1.6060149110853672, + 0.6182997301220894, + 0.8931770026683807, + 0.6354746837168932, + 0.72733548656106, + 1.6453902777284384, + 1.6574292499572039, + 0.7193000726401806, + 0.4582881350070238, + 0.27616126649081707, + 3.031169719994068, + 0.8282407354563475, + 0.5592310056090355, + 0.819597139954567, + 1.8854854088276625, + 0.7625566255301237, + 0.2609046269208193, + 0.7484371270984411, + 0.44607069343328476, + 0.49500588700175285, + 0.8298999723047018, + 1.1596066914498806, + 2.1558672599494457, + 2.1049510799348354, + 1.4661123901605606, + 0.2783368192613125, + 0.15543110156431794, + 1.2103657107800245, + 0.40092846006155014, + 0.6141723766922951, + 1.6921017076820135, + 0.9282803125679493, + 2.3574280831962824, + 1.893821820616722, + 0.600424287840724, + 0.6518352515995502, + 1.3847710900008678, + 1.457469653338194, + 0.2232796661555767, + 0.7573550045490265, + 0.21363669447600842, + 0.8284057229757309, + 1.4648301117122173, + 0.5362916849553585, + 1.702954737469554, + 3.5306782964617014, + 0.05771615542471409, + 1.0915825422853231, + 0.42309520952403545, + 1.8165484443306923, + 0.35075170919299126, + 0.6290951296687126, + 0.8326493091881275, + 0.6717266142368317, + 0.5225820858031511, + 1.1553285121917725, + 0.6477543376386166, + 0.7309629879891872, + 0.8873458635061979, + 1.410402413457632, + 0.7497442215681076 + ], + "unique_experts": 64, + "load_cv": 0.4996611176711964, + "normalized_load_entropy": 0.9708010239616147, + "max_load_share": 0.03978494623655914 + } + }, + "s1_eos": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "2cb91e75cf717c21eae3acf6c4919eaa0e6b38301bbdacf3c532a7804850e472", + "route_weight_sha256": "ec135e111596aa7f35e84d855602e4e72770e9146f6997bfa232885eff9da657", + "loads": [ + 12, + 11, + 1, + 14, + 8, + 16, + 11, + 13, + 24, + 22, + 5, + 8, + 4, + 23, + 16, + 7, + 15, + 14, + 4, + 5, + 7, + 8, + 7, + 7, + 9, + 23, + 11, + 23, + 3, + 4, + 11, + 7, + 9, + 25, + 16, + 18, + 25, + 12, + 10, + 25, + 8, + 3, + 6, + 4, + 12, + 7, + 10, + 26, + 37, + 3, + 12, + 9, + 23, + 8, + 15, + 8, + 12, + 7, + 17, + 12, + 13, + 16, + 6, + 13 + ], + "weighted_loads": [ + 0.5360035914927721, + 0.43088114634156227, + 0.04317675158381462, + 1.0057510882616043, + 0.6212918348610401, + 0.8557498212903738, + 0.5731024015694857, + 0.7333076763898134, + 1.6203035451471806, + 1.0921430215239525, + 0.2248359303921461, + 0.4705316573381424, + 0.14732144214212894, + 2.536266453564167, + 0.8380039762705564, + 0.3798087202012539, + 0.8213323019444942, + 1.2480733525007963, + 0.6812066473066807, + 0.23178470134735107, + 0.3818359971046448, + 0.3879242539405823, + 0.48406701907515526, + 0.4964883793145418, + 0.6760155037045479, + 1.6589287146925926, + 0.5033725202083588, + 1.2596644684672356, + 0.1252033282071352, + 0.15365197882056236, + 1.1584594454616308, + 0.4056919887661934, + 0.33210178278386593, + 1.711142722517252, + 0.9337685853242874, + 2.3406169563531876, + 1.9207167513668537, + 0.5716896243393421, + 0.3846614956855774, + 1.4277955703437328, + 0.37514884769916534, + 0.09416546672582626, + 0.700574591755867, + 0.16114736162126064, + 0.8381180576980114, + 0.3828808609396219, + 0.5186372697353363, + 1.712928518652916, + 3.5192157719284296, + 0.09913101606070995, + 0.9792798906564713, + 0.44236323051154613, + 1.597455870360136, + 0.38104039058089256, + 0.5864394512027502, + 0.602185532450676, + 0.6399418823421001, + 0.32914938405156136, + 1.1822701208293438, + 0.5440809521824121, + 0.6808498911559582, + 0.8259816020727158, + 1.0422377083450556, + 0.8157760798931122 + ], + "unique_experts": 64, + "load_cv": 0.5898773538377933, + "normalized_load_entropy": 0.9600544640668793, + "max_load_share": 0.047435897435897434 + }, + "full_input": { + "tokens": 171, + "top_k": 6, + "decisions": 1026, + "ordered_route_sha256": "e610129d8030d08bb14d13c203446ed2636a8f29107bb5347ceff840f08e364e", + "route_weight_sha256": "4384ecafdc0fff20e32c631c2e2f62d8a4b90f9c34e7702e1408bccfbab7ab59", + "loads": [ + 21, + 12, + 5, + 21, + 14, + 16, + 14, + 14, + 24, + 28, + 14, + 10, + 4, + 31, + 16, + 15, + 18, + 21, + 6, + 5, + 8, + 9, + 7, + 15, + 19, + 45, + 24, + 26, + 6, + 6, + 12, + 8, + 14, + 25, + 16, + 18, + 30, + 14, + 14, + 26, + 20, + 9, + 8, + 5, + 14, + 12, + 12, + 28, + 37, + 3, + 14, + 15, + 27, + 8, + 16, + 15, + 19, + 19, + 18, + 14, + 14, + 21, + 14, + 13 + ], + "weighted_loads": [ + 0.8764470238238573, + 0.4736407995223999, + 0.191962206736207, + 1.6755493246018887, + 1.0164469350129366, + 0.8557498212903738, + 0.6919116098433733, + 0.7876682709902525, + 1.6203035451471806, + 1.7090133037418127, + 0.819940710440278, + 0.5367660988122225, + 0.14732144214212894, + 3.1476105339825153, + 0.8380039762705564, + 0.8272361792623997, + 1.020499911159277, + 1.8571250196546316, + 0.7490005511790514, + 0.23178470134735107, + 0.4502715989947319, + 0.46549438685178757, + 0.48406701907515526, + 1.1246661096811295, + 1.2603877615183592, + 3.20541332103312, + 2.3086846191436052, + 1.3908181674778461, + 0.23886682279407978, + 0.2394870249554515, + 1.2186429519206285, + 0.44407234340906143, + 0.48266706382855773, + 1.711142722517252, + 0.9337685853242874, + 2.3406169563531876, + 2.18593293428421, + 0.6455970592796803, + 0.7465013265609741, + 1.4611497968435287, + 2.094670854508877, + 0.4316788874566555, + 0.7999272719025612, + 0.17995040491223335, + 1.0796841494739056, + 1.8236273471266031, + 0.7345604225993156, + 1.8437914177775383, + 3.5192157719284296, + 0.09913101606070995, + 1.1477456875145435, + 0.7421418149024248, + 1.8906745612621307, + 0.38104039058089256, + 0.6757369097322226, + 1.0734703708440065, + 1.2597052454948425, + 0.9668899476528168, + 1.2053301371634007, + 0.6361748147755861, + 0.712596882134676, + 1.1269958205521107, + 1.6956818252801895, + 0.8157760798931122 + ], + "unique_experts": 64, + "load_cv": 0.5081965183586034, + "normalized_load_entropy": 0.9699561985392883, + "max_load_share": 0.043859649122807015 + } + }, + "s0_bos": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "c359b728613728f859d2103267cfd81cae422336b0bb82789aa0dc0296277c84", + "route_weight_sha256": "48f7d4b4b622d88c2e85e41008f932690973d9ae8132a11d6053e9fb09c2a93b", + "loads": [ + 12, + 8, + 1, + 15, + 8, + 16, + 9, + 13, + 25, + 23, + 5, + 8, + 5, + 22, + 16, + 4, + 18, + 14, + 5, + 6, + 6, + 7, + 7, + 12, + 9, + 24, + 8, + 24, + 2, + 5, + 12, + 7, + 8, + 25, + 16, + 19, + 25, + 13, + 10, + 22, + 8, + 3, + 6, + 4, + 12, + 7, + 9, + 26, + 38, + 4, + 12, + 7, + 23, + 7, + 15, + 8, + 12, + 6, + 16, + 16, + 15, + 15, + 5, + 12 + ], + "weighted_loads": [ + 0.5305764153599739, + 0.3279533386230469, + 0.046707116067409515, + 1.0127022434026003, + 0.61800766736269, + 0.8545383308082819, + 0.4897281676530838, + 0.7148717921227217, + 1.6565208360552788, + 1.1464208085089922, + 0.22344833984971046, + 0.47099216654896736, + 0.1776955183595419, + 2.449498277157545, + 0.8330501616001129, + 0.27379239723086357, + 0.9211096819490194, + 1.275946756824851, + 0.6987322736531496, + 0.26046961918473244, + 0.36021515168249607, + 0.3632909990847111, + 0.5064415037631989, + 0.6738887093961239, + 0.7017563097178936, + 1.6741665378212929, + 0.37747350707650185, + 1.2710657455027103, + 0.10089485347270966, + 0.193132683634758, + 1.2206154726445675, + 0.41009360924363136, + 0.3098983634263277, + 1.7360254433006048, + 0.9370042514055967, + 2.413609813898802, + 1.8753123916685581, + 0.6010205280035734, + 0.3898633662611246, + 1.3051825482398272, + 0.3579823039472103, + 0.09667643718421459, + 0.702254556119442, + 0.15364566631615162, + 0.8290702663362026, + 0.37462261132895947, + 0.48457831889390945, + 1.7002007011324167, + 3.6271485183387995, + 0.12708042189478874, + 0.9730746932327747, + 0.3871854841709137, + 1.6001516990363598, + 0.34505306743085384, + 0.5684081930667162, + 0.6180015094578266, + 0.6332551091909409, + 0.2875240854918957, + 1.14634370803833, + 0.7170108817517757, + 0.7636279165744781, + 0.8284776452928782, + 1.0600482299923897, + 0.7950620464980602 + ], + "unique_experts": 64, + "load_cv": 0.6058882666927758, + "normalized_load_entropy": 0.9579116235707147, + "max_load_share": 0.04871794871794872 + }, + "full_input": { + "tokens": 155, + "top_k": 6, + "decisions": 930, + "ordered_route_sha256": "40e2ed94ef4792c7831ff39c5d1ec242fc51bcfa3823c7c1ba94c572196cce7d", + "route_weight_sha256": "c70e6c210c97ba736574483c6d69fb22594213d05f437f105ffbc9546af94b5b", + "loads": [ + 20, + 10, + 3, + 22, + 8, + 16, + 11, + 13, + 25, + 27, + 13, + 9, + 9, + 30, + 16, + 8, + 18, + 21, + 7, + 7, + 9, + 7, + 7, + 19, + 15, + 31, + 17, + 27, + 6, + 5, + 12, + 7, + 15, + 25, + 16, + 19, + 25, + 13, + 15, + 22, + 16, + 6, + 7, + 5, + 12, + 11, + 9, + 26, + 38, + 5, + 14, + 7, + 25, + 8, + 15, + 12, + 12, + 10, + 16, + 17, + 15, + 16, + 11, + 12 + ], + "weighted_loads": [ + 0.8407582566142082, + 0.41241342574357986, + 0.13375470787286758, + 1.5982576217502356, + 0.61800766736269, + 0.8545383308082819, + 0.5859180949628353, + 0.7148717921227217, + 1.6565208360552788, + 1.706863410770893, + 0.7107832059264183, + 0.48946759663522243, + 0.43939992412924767, + 3.0456264801323414, + 0.8330501616001129, + 0.5240807384252548, + 0.9211096819490194, + 1.9355451557785273, + 0.7515285797417164, + 0.3174291141331196, + 0.658149154856801, + 0.3632909990847111, + 0.5064415037631989, + 0.972224272787571, + 1.148242499679327, + 2.2088853158056736, + 1.105268657207489, + 1.4000305589288473, + 0.24953989870846272, + 0.193132683634758, + 1.2206154726445675, + 0.41009360924363136, + 0.6065794490277767, + 1.7360254433006048, + 0.9370042514055967, + 2.413609813898802, + 1.8753123916685581, + 0.6010205280035734, + 0.621658805757761, + 1.3051825482398272, + 1.4664638973772526, + 0.18916884250938892, + 0.8072139397263527, + 0.17244870960712433, + 0.8290702663362026, + 1.3308679331094027, + 0.48457831889390945, + 1.7002007011324167, + 3.6271485183387995, + 0.2783741466701031, + 1.0798093974590302, + 0.3871854841709137, + 1.7830010615289211, + 0.39578830264508724, + 0.5684081930667162, + 0.8829446248710155, + 0.6332551091909409, + 0.4809068664908409, + 1.14634370803833, + 0.7622387260198593, + 0.7636279165744781, + 0.9074224028736353, + 1.5436251126229763, + 0.7950620464980602 + ], + "unique_experts": 64, + "load_cv": 0.5103575154906208, + "normalized_load_entropy": 0.9699427289539969, + "max_load_share": 0.04086021505376344 + } + }, + "s1_bos": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "56e89443c74fa5e0915cee6957a9e9865fe67a588e3d6571e873b51af5a018fc", + "route_weight_sha256": "bc42553875ae80cc68c4524d74086ecae403adafaa42a9822d4b3a758c699b49", + "loads": [ + 10, + 7, + 1, + 15, + 9, + 17, + 9, + 13, + 28, + 23, + 6, + 7, + 5, + 22, + 16, + 4, + 16, + 14, + 5, + 6, + 6, + 8, + 8, + 11, + 9, + 23, + 8, + 24, + 3, + 5, + 11, + 7, + 7, + 24, + 16, + 18, + 25, + 13, + 9, + 24, + 7, + 4, + 6, + 4, + 13, + 8, + 9, + 26, + 37, + 4, + 12, + 7, + 23, + 7, + 15, + 8, + 12, + 8, + 16, + 15, + 15, + 15, + 5, + 12 + ], + "weighted_loads": [ + 0.48094742372632027, + 0.28965556249022484, + 0.043471090495586395, + 1.027915358543396, + 0.6614850796759129, + 0.8683752175420523, + 0.4753286615014076, + 0.7201308682560921, + 1.7470342423766851, + 1.1466455813497305, + 0.24810092337429523, + 0.43859896808862686, + 0.17640906386077404, + 2.49577147513628, + 0.8168640322983265, + 0.27217352762818336, + 0.8542857989668846, + 1.2864290960133076, + 0.6743463203310966, + 0.2519181314855814, + 0.3561155516654253, + 0.4025609754025936, + 0.5156254712492228, + 0.6256597526371479, + 0.7010499387979507, + 1.6018915753811598, + 0.38494423031806946, + 1.2799053024500608, + 0.1333355251699686, + 0.1807123739272356, + 1.1627888604998589, + 0.41152602061629295, + 0.25973945297300816, + 1.7007732596248388, + 0.9318524189293385, + 2.3918885439634323, + 1.915269648656249, + 0.602683287113905, + 0.34907410107553005, + 1.3772582430392504, + 0.3123619519174099, + 0.125264510512352, + 0.696585338562727, + 0.1557222492992878, + 0.8722947984933853, + 0.4172643590718508, + 0.46453311666846275, + 1.7166680842638016, + 3.5385635420680046, + 0.13043947145342827, + 0.9831963684409857, + 0.39290376752614975, + 1.59725696220994, + 0.33933379873633385, + 0.5873868465423584, + 0.6104915477335453, + 0.6275243572890759, + 0.3460053876042366, + 1.1341276168823242, + 0.6930136010050774, + 0.7518114894628525, + 0.8334827348589897, + 1.0839298889040947, + 0.763859074562788 + ], + "unique_experts": 64, + "load_cv": 0.6011822671563053, + "normalized_load_entropy": 0.9591230985407974, + "max_load_share": 0.047435897435897434 + }, + "full_input": { + "tokens": 171, + "top_k": 6, + "decisions": 1026, + "ordered_route_sha256": "5402a0e53467a6f924c806d8f3640514086df7d12dd4ac43f747f0aaac19fef7", + "route_weight_sha256": "9f0d1f1111e44ba6ec6c1903f1f0dc03defdcff0aab7028d64c515ec308dbab4", + "loads": [ + 18, + 10, + 5, + 22, + 15, + 17, + 12, + 14, + 28, + 30, + 15, + 9, + 7, + 30, + 16, + 12, + 19, + 21, + 7, + 6, + 7, + 9, + 8, + 19, + 18, + 44, + 20, + 27, + 4, + 6, + 12, + 8, + 11, + 24, + 16, + 18, + 30, + 15, + 13, + 25, + 20, + 9, + 8, + 5, + 15, + 13, + 11, + 28, + 37, + 5, + 15, + 13, + 26, + 7, + 16, + 15, + 19, + 20, + 17, + 17, + 16, + 20, + 15, + 12 + ], + "weighted_loads": [ + 0.8234524540603161, + 0.4362153336405754, + 0.19943065010011196, + 1.6977135948836803, + 1.0566401798278093, + 0.8683752175420523, + 0.5941378697752953, + 0.7744914628565311, + 1.7470342423766851, + 1.8071976117789745, + 0.8543902169913054, + 0.504833409562707, + 0.2845367584377527, + 3.1071155555546284, + 0.8168640322983265, + 0.7513347566127777, + 1.0534534081816673, + 1.8954807631671429, + 0.7421402242034674, + 0.2519181314855814, + 0.453550199046731, + 0.4801311083137989, + 0.5156254712492228, + 1.2538374830037355, + 1.2716974429786205, + 3.1229136548936367, + 1.2863382194191217, + 1.4046177584677935, + 0.16195957735180855, + 0.26130235381424427, + 1.2229723669588566, + 0.449906375259161, + 0.40586612932384014, + 1.7007732596248388, + 0.9318524189293385, + 2.3918885439634323, + 2.1804858315736055, + 0.6765907220542431, + 0.7125332038849592, + 1.4106124695390463, + 2.0385820865631104, + 0.46313447691500187, + 0.7959380187094212, + 0.1745252925902605, + 1.1138608902692795, + 1.907335178926587, + 0.6804562695324421, + 1.847530983388424, + 3.5385635420680046, + 0.17235887423157692, + 1.2139333244413137, + 0.6926823519170284, + 1.8405993208289146, + 0.33933379873633385, + 0.6766843050718307, + 1.0858686994761229, + 1.2472877204418182, + 0.9830549620091915, + 1.157187633216381, + 0.7851074635982513, + 0.7835584804415703, + 1.1276188381016254, + 1.8588960375636816, + 0.763859074562788 + ], + "unique_experts": 64, + "load_cv": 0.5048356613278258, + "normalized_load_entropy": 0.970630715946758, + "max_load_share": 0.042884990253411304 + } + }, + "s0_x": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "275828592cc683db2304612383da1ea470414b72603c58ad3e4268c3ee5a31e0", + "route_weight_sha256": "6b65ed8dab98778334499e6495d154063207556c79f22e7ce86f3b79999ef519", + "loads": [ + 11, + 7, + 1, + 15, + 7, + 17, + 9, + 13, + 27, + 26, + 6, + 5, + 5, + 22, + 16, + 9, + 15, + 13, + 7, + 6, + 7, + 7, + 7, + 9, + 9, + 24, + 6, + 23, + 2, + 4, + 13, + 7, + 9, + 26, + 16, + 19, + 24, + 12, + 10, + 24, + 8, + 2, + 6, + 5, + 12, + 7, + 9, + 26, + 37, + 3, + 11, + 8, + 23, + 8, + 16, + 9, + 14, + 7, + 16, + 12, + 15, + 16, + 5, + 10 + ], + "weighted_loads": [ + 0.48074773885309696, + 0.29198032990098, + 0.04327218234539032, + 1.0219372734427452, + 0.5662366524338722, + 0.8927329909056425, + 0.5002875849604607, + 0.7252119332551956, + 1.7279798220843077, + 1.2264708634465933, + 0.2484058514237404, + 0.3571377396583557, + 0.1757011078298092, + 2.4532684050500393, + 0.8710661623626947, + 0.46829813718795776, + 0.8348417971283197, + 1.2775073125958443, + 0.7925050631165504, + 0.2512741945683956, + 0.3907181918621063, + 0.35709332302212715, + 0.49677155911922455, + 0.5753541179001331, + 0.7188540808856487, + 1.6717901676893234, + 0.31326422467827797, + 1.2132910415530205, + 0.10797549039125443, + 0.15162554010748863, + 1.2603900022804737, + 0.4141845777630806, + 0.3336609750986099, + 1.7755706626921892, + 0.9195527583360672, + 2.4118292331695557, + 1.8699137028306723, + 0.5769098810851574, + 0.3810595106333494, + 1.382570080459118, + 0.372316911816597, + 0.0576567854732275, + 0.6918211989104748, + 0.19328578934073448, + 0.8382063880562782, + 0.38048580288887024, + 0.4826803132891655, + 1.7087755352258682, + 3.586514625698328, + 0.1023978590965271, + 0.9500320497900248, + 0.42243059910833836, + 1.5947147831320763, + 0.37343914434313774, + 0.6247143745422363, + 0.6360240802168846, + 0.6958606913685799, + 0.32022498548030853, + 1.1440515033900738, + 0.5787990111857653, + 0.7749423608183861, + 0.8515987079590559, + 1.094364769756794, + 0.7159068621695042 + ], + "unique_experts": 64, + "load_cv": 0.6110746507562265, + "normalized_load_entropy": 0.9573951679648763, + "max_load_share": 0.047435897435897434 + }, + "full_input": { + "tokens": 155, + "top_k": 6, + "decisions": 930, + "ordered_route_sha256": "f502bf34e34152b2fb9479a985093ffaa3b298e01d09b2dec9d4295d46e83de9", + "route_weight_sha256": "50c018f1fac6825814a1f32eb6bf35b7dbda64eeed07001764b0ad226e6dd4ef", + "loads": [ + 17, + 8, + 4, + 23, + 7, + 17, + 11, + 13, + 27, + 31, + 15, + 6, + 7, + 31, + 16, + 13, + 15, + 21, + 9, + 6, + 9, + 7, + 7, + 16, + 15, + 32, + 15, + 26, + 7, + 4, + 13, + 7, + 16, + 26, + 16, + 19, + 24, + 12, + 15, + 24, + 15, + 6, + 7, + 6, + 12, + 11, + 9, + 26, + 38, + 3, + 14, + 8, + 25, + 8, + 16, + 14, + 14, + 11, + 16, + 12, + 15, + 17, + 10, + 10 + ], + "weighted_loads": [ + 0.6844108793884516, + 0.3279225639998913, + 0.18618369102478027, + 1.7584799341857433, + 0.5662366524338722, + 0.8927329909056425, + 0.5964775122702122, + 0.7252119332551956, + 1.7279798220843077, + 1.8204891011118889, + 0.8887554667890072, + 0.3756131697446108, + 0.23886887915432453, + 3.087330937385559, + 0.8710661623626947, + 0.7242556400597095, + 0.8348417971283197, + 1.9826840497553349, + 0.8453013692051172, + 0.2512741945683956, + 0.5925242602825165, + 0.35709332302212715, + 0.49677155911922455, + 0.9042653888463974, + 1.2078563570976257, + 2.2705790884792805, + 1.002054762095213, + 1.3422558549791574, + 0.2947582323104143, + 0.15162554010748863, + 1.2603900022804737, + 0.4141845777630806, + 0.6303420607000589, + 1.7755706626921892, + 0.9195527583360672, + 2.4118292331695557, + 1.8699137028306723, + 0.5769098810851574, + 0.6156441569328308, + 1.382570080459118, + 1.4065089747309685, + 0.20713366381824017, + 0.7967805825173855, + 0.2120888326317072, + 0.8382063880562782, + 1.3392158597707748, + 0.4826803132891655, + 1.7087755352258682, + 3.626611541956663, + 0.1023978590965271, + 1.130265636369586, + 0.42243059910833836, + 1.7750440686941147, + 0.37343914434313774, + 0.6247143745422363, + 0.9410372041165829, + 0.6958606913685799, + 0.5036498047411442, + 1.1440515033900738, + 0.5787990111857653, + 0.7749423608183861, + 0.9293360840529203, + 1.4876941479742527, + 0.7159068621695042 + ], + "unique_experts": 64, + "load_cv": 0.5283105488948091, + "normalized_load_entropy": 0.9680172660557023, + "max_load_share": 0.04086021505376344 + } + }, + "s1_x": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "3a1fc939765e8908ed29e3b0500dfbab074220d26414d8f4ebe5c8d2e5290b8f", + "route_weight_sha256": "f407187eb3d004289659bcca5f78551e0b9ebf48d17e8abf6851a43489af9fac", + "loads": [ + 10, + 8, + 1, + 15, + 8, + 17, + 9, + 12, + 27, + 23, + 6, + 7, + 5, + 22, + 16, + 7, + 16, + 14, + 6, + 6, + 6, + 7, + 7, + 10, + 9, + 24, + 7, + 24, + 5, + 4, + 12, + 7, + 7, + 24, + 15, + 18, + 25, + 14, + 10, + 23, + 8, + 2, + 6, + 4, + 13, + 7, + 9, + 26, + 37, + 3, + 13, + 8, + 23, + 7, + 15, + 9, + 12, + 8, + 15, + 13, + 15, + 16, + 5, + 13 + ], + "weighted_loads": [ + 0.46784743294119835, + 0.32918424904346466, + 0.042677219957113266, + 1.0429841224104166, + 0.6316546052694321, + 0.8766331933438778, + 0.46197878010571003, + 0.7043729033321142, + 1.7160132452845573, + 1.1294439546763897, + 0.23969805799424648, + 0.4357260428369045, + 0.1751575581729412, + 2.479933939874172, + 0.8696983922272921, + 0.3952420800924301, + 0.8477287497371435, + 1.257877267897129, + 0.6762779280543327, + 0.2551502138376236, + 0.35960946790874004, + 0.3449219539761543, + 0.4785280376672745, + 0.6034344881772995, + 0.7016106247901917, + 1.6394124366343021, + 0.3539903573691845, + 1.2564098257571459, + 0.19592505507171154, + 0.16011792048811913, + 1.1772281136363745, + 0.41286296024918556, + 0.2542549390345812, + 1.6820793692022562, + 0.8816367816179991, + 2.405050866305828, + 1.9432941880077124, + 0.6339093297719955, + 0.37327698804438114, + 1.3941634129732847, + 0.38710176572203636, + 0.05370164290070534, + 0.7132828384637833, + 0.15499833971261978, + 0.8986201398074627, + 0.37148442305624485, + 0.4631703160703182, + 1.726494774222374, + 3.4859665166586637, + 0.104033213108778, + 1.0152419656515121, + 0.4182443581521511, + 1.5980751737952232, + 0.3343249708414078, + 0.572689414024353, + 0.6383601035922766, + 0.6308829002082348, + 0.3562834858894348, + 1.116463776677847, + 0.6149361375719309, + 0.7283886168152094, + 0.8798696342855692, + 1.050574891269207, + 0.8219819627702236 + ], + "unique_experts": 64, + "load_cv": 0.596615481590203, + "normalized_load_entropy": 0.9595099458273608, + "max_load_share": 0.047435897435897434 + }, + "full_input": { + "tokens": 171, + "top_k": 6, + "decisions": 1026, + "ordered_route_sha256": "69e8c1867f5c907f442e8f772d7e59a7e0d68aebf61fcba0985a6b7f8495431c", + "route_weight_sha256": "97091312d3d7329bdcb644eb4895179f8553ffe36447f632f9ba89c6d2be9d4d", + "loads": [ + 16, + 9, + 6, + 23, + 14, + 17, + 12, + 13, + 27, + 30, + 16, + 9, + 5, + 31, + 17, + 15, + 19, + 22, + 9, + 6, + 6, + 8, + 7, + 19, + 18, + 46, + 16, + 26, + 5, + 5, + 13, + 8, + 11, + 24, + 15, + 18, + 30, + 16, + 14, + 24, + 20, + 8, + 8, + 5, + 15, + 12, + 11, + 28, + 38, + 3, + 16, + 14, + 27, + 7, + 16, + 17, + 19, + 20, + 17, + 15, + 16, + 22, + 14, + 13 + ], + "weighted_loads": [ + 0.7204199247062206, + 0.3719439022243023, + 0.25784912146627903, + 1.8722893800586462, + 1.0268097054213285, + 0.8766331933438778, + 0.5807879883795977, + 0.7587334979325533, + 1.7160132452845573, + 1.7599715236574411, + 1.0014849063009024, + 0.5019604843109846, + 0.1751575581729412, + 3.1516146026551723, + 0.9046586398035288, + 0.809634231030941, + 1.0468963589519262, + 1.9170214086771011, + 0.7881829533725977, + 0.2551502138376236, + 0.35960946790874004, + 0.4224920868873596, + 0.4785280376672745, + 1.2607347965240479, + 1.3278536386787891, + 3.1960662100464106, + 1.0780167821794748, + 1.3313029427081347, + 0.19592505507171154, + 0.2407079003751278, + 1.2374116200953722, + 0.4512433148920536, + 0.40038161538541317, + 1.6820793692022562, + 0.8816367816179991, + 2.405050866305828, + 2.208510370925069, + 0.7078167647123337, + 0.7329395432025194, + 1.4275176394730806, + 2.027103438973427, + 0.40434965677559376, + 0.8126355186104774, + 0.1738013830035925, + 1.1401862315833569, + 1.69736616499722, + 0.6790934689342976, + 1.8573576733469963, + 3.52602325566113, + 0.104033213108778, + 1.2728631496429443, + 0.7180229425430298, + 1.8780848421156406, + 0.3343249708414078, + 0.6619868725538254, + 1.1537435241043568, + 1.2506462633609772, + 0.9911780953407288, + 1.1900371611118317, + 0.7070300001651049, + 0.7601356077939272, + 1.2081601284444332, + 1.788245102390647, + 0.8219819627702236 + ], + "unique_experts": 64, + "load_cv": 0.5203729170004432, + "normalized_load_entropy": 0.9687616370417227, + "max_load_share": 0.04483430799220273 + } + }, + "s0_period": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "ce0443749fb082e89e772a60995b23a294d47aca9fcaa19b6eeca08532702c94", + "route_weight_sha256": "677a89a7efcc47fd4242d91ac87f74fbe8821119a6a35cd2913ea5b4037d3236", + "loads": [ + 11, + 8, + 1, + 15, + 8, + 17, + 9, + 13, + 26, + 24, + 6, + 7, + 4, + 22, + 16, + 7, + 15, + 13, + 4, + 6, + 8, + 7, + 7, + 10, + 10, + 24, + 7, + 23, + 4, + 4, + 12, + 7, + 8, + 24, + 16, + 19, + 23, + 13, + 10, + 23, + 8, + 2, + 6, + 4, + 13, + 7, + 10, + 27, + 37, + 2, + 13, + 8, + 23, + 8, + 17, + 9, + 13, + 7, + 16, + 14, + 14, + 15, + 5, + 11 + ], + "weighted_loads": [ + 0.4836337920278311, + 0.3352304920554161, + 0.04412350803613663, + 1.0152662638574839, + 0.6085416600108147, + 0.8917000908404589, + 0.4940224289894104, + 0.7280596066266298, + 1.689105287194252, + 1.184450302273035, + 0.25179943442344666, + 0.4341919459402561, + 0.14863135665655136, + 2.4664378613233566, + 0.8477591350674629, + 0.39111965894699097, + 0.8364598471671343, + 1.2582139670848846, + 0.693850290030241, + 0.25358153134584427, + 0.4175749570131302, + 0.3546363487839699, + 0.49754320457577705, + 0.6015308313071728, + 0.7419346235692501, + 1.6713850013911724, + 0.36343215964734554, + 1.2101114224642515, + 0.16544723138213158, + 0.15518909320235252, + 1.2111786119639874, + 0.40945402905344963, + 0.30233331955969334, + 1.696006951853633, + 0.9317376669496298, + 2.400045320391655, + 1.838947854936123, + 0.612490838393569, + 0.3865316566079855, + 1.3286604676395655, + 0.37053152173757553, + 0.05685079097747803, + 0.7046067118644714, + 0.15618208423256874, + 0.8826318308711052, + 0.3837914150208235, + 0.5121909789741039, + 1.7259539682418108, + 3.571175891906023, + 0.07086775451898575, + 1.021181020885706, + 0.41686325147747993, + 1.5939531847834587, + 0.37649164348840714, + 0.6363960411399603, + 0.6321730334311724, + 0.6568485870957375, + 0.31971003860235214, + 1.1499838270246983, + 0.6614782810211182, + 0.73780357837677, + 0.8086456097662449, + 1.0791003443300724, + 0.7454083040356636 + ], + "unique_experts": 64, + "load_cv": 0.5974964203964638, + "normalized_load_entropy": 0.9587251382032991, + "max_load_share": 0.047435897435897434 + }, + "full_input": { + "tokens": 155, + "top_k": 6, + "decisions": 930, + "ordered_route_sha256": "8150c963529ddbf38f3cbe074c5bb1411dfc7653c47bda58cee4aa1ffa30a9a3", + "route_weight_sha256": "20d0fea0f2a50b7b0dda9a987882c0afd1b0e83aa1fcd84970f83d44d4dac02b", + "loads": [ + 18, + 9, + 4, + 23, + 8, + 17, + 11, + 13, + 26, + 28, + 13, + 8, + 6, + 30, + 16, + 11, + 15, + 20, + 7, + 6, + 11, + 7, + 7, + 16, + 16, + 33, + 15, + 27, + 9, + 4, + 12, + 7, + 15, + 24, + 16, + 19, + 23, + 13, + 15, + 23, + 15, + 6, + 8, + 5, + 13, + 11, + 10, + 27, + 37, + 2, + 16, + 8, + 26, + 8, + 17, + 15, + 13, + 11, + 16, + 14, + 14, + 16, + 10, + 11 + ], + "weighted_loads": [ + 0.732960058376193, + 0.3711727261543274, + 0.2069380059838295, + 1.6463262233883142, + 0.6085416600108147, + 0.8917000908404589, + 0.5902123562991619, + 0.7280596066266298, + 1.689105287194252, + 1.7490024957805872, + 0.7010256126523018, + 0.4526673760265112, + 0.2117991279810667, + 3.062566064298153, + 0.8477591350674629, + 0.6310687437653542, + 0.8364598471671343, + 1.9178123660385609, + 0.7841152306646109, + 0.25358153134584427, + 0.672783624380827, + 0.3546363487839699, + 0.49754320457577705, + 0.8723461665213108, + 1.2336471900343895, + 2.324096705764532, + 1.0049224141985178, + 1.3744976408779621, + 0.3548417929559946, + 0.15518909320235252, + 1.2111786119639874, + 0.40945402905344963, + 0.5990144051611423, + 1.696006951853633, + 0.9317376669496298, + 2.400045320391655, + 1.838947854936123, + 0.612490838393569, + 0.6167298555374146, + 1.3286604676395655, + 1.379776157438755, + 0.21278706938028336, + 0.855280190706253, + 0.17498512752354145, + 0.8826318308711052, + 1.3993318807333708, + 0.5121909789741039, + 1.7259539682418108, + 3.571175891906023, + 0.07086775451898575, + 1.2024626061320305, + 0.41686325147747993, + 1.807360453531146, + 0.37649164348840714, + 0.6363960411399603, + 1.0980418492108583, + 0.6568485870957375, + 0.5088451355695724, + 1.1499838270246983, + 0.6614782810211182, + 0.73780357837677, + 0.8801922313869, + 1.5053405947983265, + 0.7454083040356636 + ], + "unique_experts": 64, + "load_cv": 0.5132491338255177, + "normalized_load_entropy": 0.9693389470477938, + "max_load_share": 0.03978494623655914 + } + }, + "s1_period": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "c1ad1b19058e92b3be7e4ad915337ae3de9b4aefe4b100b5ae787a526422262c", + "route_weight_sha256": "e3fceb696198398f3a30dffd81a82f9ab3b87a113da4ede184b451ab2d50cc5b", + "loads": [ + 10, + 7, + 1, + 15, + 9, + 15, + 9, + 13, + 27, + 21, + 5, + 6, + 5, + 22, + 16, + 6, + 14, + 15, + 6, + 6, + 7, + 8, + 7, + 9, + 9, + 26, + 8, + 23, + 5, + 3, + 11, + 7, + 7, + 26, + 15, + 18, + 25, + 14, + 10, + 24, + 7, + 4, + 6, + 7, + 13, + 7, + 9, + 26, + 37, + 3, + 12, + 9, + 23, + 7, + 14, + 9, + 13, + 8, + 15, + 13, + 15, + 16, + 5, + 12 + ], + "weighted_loads": [ + 0.4612104333937168, + 0.29745303839445114, + 0.041292402893304825, + 1.0427060332149267, + 0.6586115695536137, + 0.8095436319708824, + 0.4616400618106127, + 0.7440398596227169, + 1.7239641137421131, + 1.0587147902697325, + 0.2131986077874899, + 0.4016040712594986, + 0.17907192185521126, + 2.521482903510332, + 0.8700776901096106, + 0.35659143328666687, + 0.7684114202857018, + 1.3195744939148426, + 0.6931830905377865, + 0.25265982933342457, + 0.3957793489098549, + 0.39164499193429947, + 0.471743855625391, + 0.5746389571577311, + 0.6853328198194504, + 1.6815694440156221, + 0.3964352663606405, + 1.2262605894356966, + 0.20072823017835617, + 0.12109049037098885, + 1.1566908583045006, + 0.4146585278213024, + 0.25142073072493076, + 1.7494182270020247, + 0.8935880679637194, + 2.417817708104849, + 1.9409973304718733, + 0.6321618501096964, + 0.37131490372121334, + 1.4352893643081188, + 0.3213023319840431, + 0.11993715912103653, + 0.7290292419493198, + 0.2530753128230572, + 0.8970780149102211, + 0.3715972024947405, + 0.47644854709506035, + 1.7272726334631443, + 3.4674864299595356, + 0.10385023802518845, + 0.9881745725870132, + 0.4463046509772539, + 1.6040721870958805, + 0.33259376883506775, + 0.551477026194334, + 0.6364169791340828, + 0.6656851787120104, + 0.3561937343329191, + 1.104874674230814, + 0.617200706154108, + 0.7337240166962147, + 0.8791791349649429, + 1.0347683131694794, + 0.7898615077137947 + ], + "unique_experts": 64, + "load_cv": 0.5960862933879817, + "normalized_load_entropy": 0.9602090301003378, + "max_load_share": 0.047435897435897434 + }, + "full_input": { + "tokens": 171, + "top_k": 6, + "decisions": 1026, + "ordered_route_sha256": "f5a160132b8936f1341d27135b272cdbca0a8cd59635240230f1f6ac592763dc", + "route_weight_sha256": "133c764b30ab341305263657c11efc5d68b58e71e4202fe4c0d217dabe98bfa9", + "loads": [ + 16, + 8, + 6, + 23, + 15, + 15, + 12, + 14, + 28, + 27, + 14, + 8, + 5, + 30, + 17, + 14, + 17, + 22, + 8, + 6, + 7, + 9, + 7, + 17, + 19, + 49, + 18, + 25, + 6, + 4, + 12, + 8, + 12, + 26, + 15, + 18, + 30, + 16, + 14, + 25, + 20, + 10, + 10, + 8, + 15, + 12, + 11, + 28, + 37, + 3, + 14, + 15, + 27, + 7, + 15, + 18, + 20, + 21, + 16, + 15, + 16, + 21, + 13, + 12 + ], + "weighted_loads": [ + 0.7097792327404022, + 0.3402126915752888, + 0.24883620627224445, + 1.7603025082498789, + 1.0537666697055101, + 0.8095436319708824, + 0.5804492700845003, + 0.798400454223156, + 1.7599980384111404, + 1.6586365811526775, + 0.8374939952045679, + 0.4678385127335787, + 0.17907192185521126, + 3.1328269839286804, + 0.9156062584370375, + 0.7718301005661488, + 0.9675790295004845, + 1.928626161068678, + 0.7609769944101572, + 0.25265982933342457, + 0.3957793489098549, + 0.46921512484550476, + 0.471743855625391, + 1.2028166875243187, + 1.3346507027745247, + 3.3136971332132816, + 1.1638403572142124, + 1.3011537063866854, + 0.23106591776013374, + 0.2016804702579975, + 1.2168743647634983, + 0.45303888246417046, + 0.43507963605225086, + 1.7494182270020247, + 0.8935880679637194, + 2.417817708104849, + 2.2062135133892298, + 0.7060692850500345, + 0.727062227204442, + 1.4686435908079147, + 1.9582400918006897, + 0.49397934414446354, + 0.9121008515357971, + 0.2718783561140299, + 1.1386441066861153, + 1.855947570875287, + 0.6923716999590397, + 1.8581355325877666, + 3.4674864299595356, + 0.10385023802518845, + 1.184091743081808, + 0.7460832353681326, + 1.8943291492760181, + 0.33259376883506775, + 0.6407744847238064, + 1.338636176660657, + 1.2854485418647528, + 1.0492267105728388, + 1.1279346905648708, + 0.709294568747282, + 0.7654710076749325, + 1.1745627336204052, + 1.6798984501510859, + 0.7898615077137947 + ], + "unique_experts": 64, + "load_cv": 0.5209567612489857, + "normalized_load_entropy": 0.969389433407209, + "max_load_share": 0.04775828460038986 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 130, + "ordered_topk_exact_tokens": 82, + "set_exact_tokens": 97, + "mean_set_jaccard": 0.9241758241758242, + "mean_token_weighted_tv": 0.014048342105860893, + "aggregate_load_tv": 0.02948717948717948 + }, + "system_bos": { + "tokens": 130, + "ordered_topk_exact_tokens": 77, + "set_exact_tokens": 94, + "mean_set_jaccard": 0.9208791208791208, + "mean_token_weighted_tv": 0.015728346931819733, + "aggregate_load_tv": 0.020512820512820516 + }, + "system_x": { + "tokens": 130, + "ordered_topk_exact_tokens": 72, + "set_exact_tokens": 89, + "mean_set_jaccard": 0.9082417582417581, + "mean_token_weighted_tv": 0.019629923483500115, + "aggregate_load_tv": 0.02948717948717948 + }, + "system_period": { + "tokens": 130, + "ordered_topk_exact_tokens": 62, + "set_exact_tokens": 85, + "mean_set_jaccard": 0.9010989010989012, + "mean_token_weighted_tv": 0.020693817254728995, + "aggregate_load_tv": 0.03717948717948718 + }, + "bos_at_s0": { + "tokens": 130, + "ordered_topk_exact_tokens": 77, + "set_exact_tokens": 92, + "mean_set_jaccard": 0.9148351648351648, + "mean_token_weighted_tv": 0.017196991244474283, + "aggregate_load_tv": 0.028205128205128202 + }, + "bos_at_s1": { + "tokens": 130, + "ordered_topk_exact_tokens": 62, + "set_exact_tokens": 82, + "mean_set_jaccard": 0.8912087912087913, + "mean_token_weighted_tv": 0.020491553520640502, + "aggregate_load_tv": 0.03974358974358974 + }, + "x_at_s0": { + "tokens": 130, + "ordered_topk_exact_tokens": 70, + "set_exact_tokens": 88, + "mean_set_jaccard": 0.9043956043956045, + "mean_token_weighted_tv": 0.018828043900430202, + "aggregate_load_tv": 0.0358974358974359 + }, + "x_at_s1": { + "tokens": 130, + "ordered_topk_exact_tokens": 57, + "set_exact_tokens": 83, + "mean_set_jaccard": 0.8934065934065935, + "mean_token_weighted_tv": 0.021880835380691747, + "aggregate_load_tv": 0.03717948717948717 + }, + "period_at_s0": { + "tokens": 130, + "ordered_topk_exact_tokens": 73, + "set_exact_tokens": 95, + "mean_set_jaccard": 0.9181318681318682, + "mean_token_weighted_tv": 0.01726968355047015, + "aggregate_load_tv": 0.024358974358974363 + }, + "period_at_s1": { + "tokens": 130, + "ordered_topk_exact_tokens": 56, + "set_exact_tokens": 78, + "mean_set_jaccard": 0.8807692307692307, + "mean_token_weighted_tv": 0.023942652258735438, + "aggregate_load_tv": 0.03974358974358974 + } + } + }, + "layer_18": { + "layer": 18, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "070e465fe772ee4278ad9646e5a5bad163dd065043e1737a2c6f5a2ca22ee704", + "route_weight_sha256": "62bbed1d2afd3e3892b7ad9d3ac692e45827f8bf03f28625d12b6f4d54802065", + "loads": [ + 6, + 7, + 13, + 7, + 5, + 25, + 4, + 13, + 5, + 5, + 9, + 17, + 26, + 17, + 8, + 5, + 19, + 6, + 4, + 12, + 27, + 1, + 17, + 3, + 12, + 9, + 12, + 11, + 13, + 13, + 4, + 8, + 7, + 10, + 7, + 1, + 20, + 5, + 27, + 6, + 9, + 30, + 20, + 13, + 12, + 23, + 9, + 23, + 15, + 8, + 22, + 14, + 22, + 10, + 16, + 13, + 7, + 11, + 12, + 11, + 27, + 9, + 15, + 3 + ], + "weighted_loads": [ + 0.26791591197252274, + 0.25836752727627754, + 0.6661947574466467, + 0.39018500596284866, + 0.17786640487611294, + 1.2424720227718353, + 0.30284153670072556, + 0.960684847086668, + 0.3663012944161892, + 0.22268877178430557, + 0.7236413806676865, + 1.0129733718931675, + 1.142976427450776, + 1.138031978160143, + 0.4134798236191273, + 0.1803951095789671, + 1.0810774601995945, + 0.21074796468019485, + 0.13067855685949326, + 0.8901653252542019, + 1.7878286354243755, + 0.033096905797719955, + 1.8217837996780872, + 0.08748995512723923, + 0.5763892289251089, + 0.39168697223067284, + 0.5461453069001436, + 0.5113835353404284, + 1.293643793091178, + 0.8237353228032589, + 0.2712266072630882, + 0.35426504723727703, + 0.2662687376141548, + 0.36312604136765003, + 0.5845388621091843, + 0.034001875668764114, + 0.9903837777674198, + 0.16650568135082722, + 1.4683238361030817, + 0.22738248109817505, + 0.45237142592668533, + 1.115215064957738, + 0.9026892781257629, + 0.6453493647277355, + 0.4993680529296398, + 1.4123863819986582, + 0.5113340578973293, + 1.6294560711830854, + 0.6448541134595871, + 0.43360509909689426, + 0.7585513032972813, + 0.8395844772458076, + 1.8843301851302385, + 0.4502013437449932, + 1.2017009761184454, + 1.0859720967710018, + 0.2435010727494955, + 0.8135988488793373, + 1.017100766301155, + 0.737027570605278, + 1.1091215424239635, + 0.2863019723445177, + 0.7636814247816801, + 0.12998797744512558 + ], + "unique_experts": 64, + "load_cv": 0.587196282370932, + "normalized_load_entropy": 0.9587344271874537, + "max_load_share": 0.038461538461538464 + }, + "full_input": { + "tokens": 155, + "top_k": 6, + "decisions": 930, + "ordered_route_sha256": "96fbb20ba3a636b5b7c868d1082467d7c917e25d5ecdf4a4da61b293a0ccf014", + "route_weight_sha256": "bcac904eecaa13c59ea3f69c53f486779ab3685a60c3db3988dd6f439e311231", + "loads": [ + 12, + 8, + 26, + 7, + 5, + 27, + 4, + 13, + 13, + 5, + 10, + 22, + 26, + 17, + 13, + 9, + 19, + 6, + 23, + 12, + 27, + 2, + 17, + 3, + 12, + 9, + 12, + 11, + 13, + 13, + 11, + 8, + 8, + 10, + 7, + 4, + 21, + 8, + 27, + 8, + 15, + 30, + 23, + 13, + 12, + 23, + 17, + 23, + 18, + 20, + 25, + 16, + 31, + 18, + 16, + 13, + 9, + 12, + 14, + 14, + 27, + 13, + 15, + 5 + ], + "weighted_loads": [ + 0.6479507312178612, + 0.3328871689736843, + 1.838411407545209, + 0.39018500596284866, + 0.17786640487611294, + 1.2915640138089657, + 0.30284153670072556, + 0.960684847086668, + 0.8463609255850315, + 0.22268877178430557, + 0.7345590274780989, + 1.4259675610810518, + 1.142976427450776, + 1.138031978160143, + 1.317999517545104, + 0.3105028308928013, + 1.0810774601995945, + 0.21074796468019485, + 1.3708800077438354, + 0.8901653252542019, + 1.7878286354243755, + 0.05875514633953571, + 1.8217837996780872, + 0.08748995512723923, + 0.5763892289251089, + 0.39168697223067284, + 0.5461453069001436, + 0.5113835353404284, + 1.293643793091178, + 0.8237353228032589, + 0.5092879114672542, + 0.35426504723727703, + 0.5180557444691658, + 0.36312604136765003, + 0.5845388621091843, + 0.24293233826756477, + 1.0139950942248106, + 0.24848584085702896, + 1.4683238361030817, + 0.27498356997966766, + 0.7023729141801596, + 1.115215064957738, + 0.9847265351563692, + 0.6453493647277355, + 0.4993680529296398, + 1.4123863819986582, + 2.4181799814105034, + 1.6294560711830854, + 0.7869444824755192, + 1.0479637514799833, + 0.9473825078457594, + 1.0240938812494278, + 2.493225447833538, + 1.0820824056863785, + 1.2017009761184454, + 1.0859720967710018, + 1.2409353610128164, + 0.856710821390152, + 1.104029217734933, + 0.8183175586163998, + 1.1091215424239635, + 0.39728506095707417, + 0.7636814247816801, + 0.22287167981266975 + ], + "unique_experts": 64, + "load_cv": 0.5005488951530057, + "normalized_load_entropy": 0.9692526300895771, + "max_load_share": 0.03333333333333333 + } + }, + "s1_eos": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "2cb7dff769bc94854ad61859330a9036aa9267f302a5dc31c0eb3a1ce6c39a4d", + "route_weight_sha256": "f2017e12d33be8d48b5a99ea12c3ca19b919617d4f35c51da69c330aa4edbc58", + "loads": [ + 6, + 8, + 14, + 6, + 6, + 25, + 4, + 13, + 6, + 5, + 9, + 16, + 29, + 17, + 7, + 5, + 19, + 6, + 3, + 11, + 27, + 2, + 17, + 3, + 10, + 8, + 12, + 11, + 12, + 13, + 4, + 10, + 6, + 11, + 7, + 0, + 19, + 4, + 26, + 6, + 9, + 29, + 25, + 13, + 11, + 23, + 9, + 23, + 16, + 8, + 19, + 14, + 24, + 10, + 15, + 13, + 5, + 11, + 13, + 12, + 26, + 10, + 16, + 3 + ], + "weighted_loads": [ + 0.2658449374139309, + 0.2973638828843832, + 0.6968822851777077, + 0.3641980029642582, + 0.2128719538450241, + 1.248993931338191, + 0.3092978149652481, + 0.9549626894295216, + 0.3948960695415735, + 0.2311711497604847, + 0.729688249528408, + 0.9792874455451965, + 1.2540778387337923, + 1.1239635720849037, + 0.3905876614153385, + 0.18547345884144306, + 1.0678087882697582, + 0.21160553023219109, + 0.10117041319608688, + 0.8530238121747971, + 1.8135555125772953, + 0.06201547756791115, + 1.8260645009577274, + 0.08991281315684319, + 0.504330376163125, + 0.3576591666787863, + 0.5584856290370226, + 0.5088479649275541, + 1.2366430908441544, + 0.8331456854939461, + 0.2731425426900387, + 0.4243025481700897, + 0.23205452784895897, + 0.37853448279201984, + 0.5949160754680634, + 0.0, + 0.9626788105815649, + 0.1381916143000126, + 1.4382552243769169, + 0.2229945082217455, + 0.44756212644279003, + 1.0632038544863462, + 1.063349450007081, + 0.6177081726491451, + 0.4643401764333248, + 1.4250979162752628, + 0.510673176497221, + 1.6277740262448788, + 0.6751355677843094, + 0.43401811085641384, + 0.6632144115865231, + 0.8447101823985577, + 1.981179716065526, + 0.44096921011805534, + 1.160170717164874, + 1.082187283784151, + 0.17746507190167904, + 0.8193893507122993, + 1.0352681800723076, + 0.767077349126339, + 1.086536917835474, + 0.3133042957633734, + 0.7902768161147833, + 0.13233132660388947 + ], + "unique_experts": 63, + "load_cv": 0.5987275571622347, + "normalized_load_entropy": 0.9566737629416298, + "max_load_share": 0.03717948717948718 + }, + "full_input": { + "tokens": 171, + "top_k": 6, + "decisions": 1026, + "ordered_route_sha256": "07120a6ffbdee6ffb2e79cf473f99a7f335239deab56c5ccda5141e2971833d9", + "route_weight_sha256": "a57dcc4ea6de3d1c2176c25b1c85e3dc3dda9827110a0eb3e983e7f15e97039b", + "loads": [ + 13, + 11, + 28, + 6, + 7, + 27, + 5, + 15, + 16, + 7, + 10, + 20, + 29, + 18, + 16, + 6, + 19, + 15, + 26, + 12, + 27, + 4, + 17, + 3, + 10, + 8, + 12, + 11, + 12, + 14, + 16, + 12, + 9, + 12, + 11, + 15, + 20, + 10, + 27, + 8, + 14, + 29, + 28, + 18, + 11, + 24, + 27, + 27, + 19, + 22, + 21, + 16, + 33, + 22, + 17, + 14, + 8, + 17, + 16, + 16, + 26, + 12, + 16, + 9 + ], + "weighted_loads": [ + 0.6610226817429066, + 0.43709793873131275, + 1.9236868917942047, + 0.3641980029642582, + 0.24995403364300728, + 1.306159008294344, + 0.3385832477360964, + 1.0234103687107563, + 1.2367544043809175, + 0.29317151941359043, + 0.7414492284879088, + 1.349215790629387, + 1.2540778387337923, + 1.1667540520429611, + 1.4730056170374155, + 0.21734543703496456, + 1.0678087882697582, + 0.7795922607183456, + 2.1052177380770445, + 0.9875765889883041, + 1.8135555125772953, + 0.11510991677641869, + 1.8260645009577274, + 0.08991281315684319, + 0.504330376163125, + 0.3576591666787863, + 0.5584856290370226, + 0.5088479649275541, + 1.2366430908441544, + 0.8699956610798836, + 0.8586257891729474, + 0.6663923040032387, + 0.5514887142926455, + 0.45487610436975956, + 1.0105421394109726, + 1.3345781061798334, + 0.9862502068281174, + 0.38371919840574265, + 1.4745099730789661, + 0.2707656901329756, + 0.638548007234931, + 1.0632038544863462, + 1.156227171421051, + 1.0767023749649525, + 0.4643401764333248, + 1.462618462741375, + 3.5796602070331573, + 1.8072979133576155, + 0.7699685171246529, + 1.125460708513856, + 0.812205059453845, + 1.0271982438862324, + 2.5823205318301916, + 1.2111570592969656, + 1.2801553662866354, + 1.1174951121211052, + 1.189356843009591, + 1.0944297648966312, + 1.428555078804493, + 1.0006939060986042, + 1.086536917835474, + 0.37723106145858765, + 0.7902768161147833, + 0.35699290223419666 + ], + "unique_experts": 64, + "load_cv": 0.4516994463502795, + "normalized_load_entropy": 0.9750140003744299, + "max_load_share": 0.03216374269005848 + } + }, + "s0_bos": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "eb1641cad265cc7474380c027ad53b6848c78f12ced947ab483cbbad610040bd", + "route_weight_sha256": "46ec0062564b2bb2a0dca4f6dce944da510e546cc588d47faab709c50f425f33", + "loads": [ + 6, + 7, + 12, + 7, + 8, + 24, + 4, + 11, + 5, + 5, + 9, + 15, + 26, + 17, + 9, + 5, + 19, + 11, + 4, + 13, + 27, + 1, + 16, + 3, + 12, + 8, + 13, + 10, + 14, + 13, + 4, + 8, + 7, + 10, + 7, + 0, + 19, + 4, + 27, + 5, + 10, + 27, + 21, + 13, + 11, + 24, + 9, + 20, + 16, + 9, + 21, + 14, + 23, + 10, + 16, + 14, + 5, + 11, + 14, + 12, + 26, + 12, + 13, + 4 + ], + "weighted_loads": [ + 0.26674122363328934, + 0.2548381146043539, + 0.664490383118391, + 0.39824624732136726, + 0.2739063985645771, + 1.2138633839786053, + 0.2594832628965378, + 0.9131089970469475, + 0.3792504630982876, + 0.23013778775930405, + 0.7147500291466713, + 0.9496969915926456, + 1.1737558841705322, + 1.1193540673702955, + 0.4527240917086601, + 0.19668378122150898, + 1.0736544504761696, + 0.35150295309722424, + 0.13031109981238842, + 0.9098892621695995, + 1.8393374606966972, + 0.03152740001678467, + 1.779225304722786, + 0.09024501778185368, + 0.5531497746706009, + 0.3630281798541546, + 0.5708952601999044, + 0.47808514162898064, + 1.301725335419178, + 0.8307112641632557, + 0.292685616761446, + 0.3546290919184685, + 0.2665416467934847, + 0.35740401968359947, + 0.5972483083605766, + 0.0, + 0.9601170122623444, + 0.1412708181887865, + 1.4486569855362177, + 0.19338452443480492, + 0.4859020449221134, + 1.0108178611844778, + 0.9016875103116035, + 0.6493389084935188, + 0.4499275013804436, + 1.4541260842233896, + 0.5008864067494869, + 1.536290854215622, + 0.6916732657700777, + 0.45738730765879154, + 0.736257066950202, + 0.8335753977298737, + 1.935518279671669, + 0.45025186240673065, + 1.2011039070785046, + 1.126156972721219, + 0.1747915167361498, + 0.8152206018567085, + 1.1045986227691174, + 0.7635621801018715, + 1.0924210883677006, + 0.3753735776990652, + 0.7160711213946342, + 0.17012755945324898 + ], + "unique_experts": 63, + "load_cv": 0.5665912468664169, + "normalized_load_entropy": 0.960182590848021, + "max_load_share": 0.03461538461538462 + }, + "full_input": { + "tokens": 155, + "top_k": 6, + "decisions": 930, + "ordered_route_sha256": "d32fbc2537709f0f71346edc813fa85f7784eb069e4572ca9ebb603a21a2ba55", + "route_weight_sha256": "bf5f8afd855bf1bc1548e181d63793738b0ca0ab9ecbb7f751cb728b1e99a5a3", + "loads": [ + 12, + 8, + 24, + 7, + 8, + 26, + 4, + 11, + 13, + 5, + 9, + 18, + 27, + 17, + 14, + 8, + 19, + 11, + 24, + 13, + 27, + 2, + 16, + 4, + 12, + 8, + 14, + 10, + 14, + 13, + 10, + 8, + 8, + 10, + 7, + 4, + 19, + 6, + 27, + 8, + 16, + 28, + 24, + 13, + 11, + 25, + 18, + 20, + 19, + 20, + 24, + 16, + 32, + 18, + 16, + 14, + 6, + 14, + 16, + 15, + 26, + 15, + 13, + 6 + ], + "weighted_loads": [ + 0.6467760428786278, + 0.3293577563017607, + 1.8080277889966965, + 0.39824624732136726, + 0.2739063985645771, + 1.2629553750157356, + 0.2594832628965378, + 0.9131089970469475, + 0.8593100942671299, + 0.23013778775930405, + 0.7147500291466713, + 1.2010377906262875, + 1.3523993492126465, + 1.1193540673702955, + 1.3077188860625029, + 0.29339126870036125, + 1.0736544504761696, + 0.35150295309722424, + 1.4112346600741148, + 0.9098892621695995, + 1.8393374606966972, + 0.057185640558600426, + 1.779225304722786, + 0.13916241563856602, + 0.5531497746706009, + 0.3630281798541546, + 0.619406646117568, + 0.47808514162898064, + 1.301725335419178, + 0.8307112641632557, + 0.5490774922072887, + 0.3546290919184685, + 0.5054424572736025, + 0.35740401968359947, + 0.5972483083605766, + 0.25440435111522675, + 0.9601170122623444, + 0.20180943235754967, + 1.4486569855362177, + 0.3366868980228901, + 0.7677397225052118, + 1.077080262824893, + 1.0139046479016542, + 0.6493389084935188, + 0.4499275013804436, + 1.4854949098080397, + 2.446207268163562, + 1.536290854215622, + 0.8337636347860098, + 1.016771798953414, + 0.9286081679165363, + 1.021357387304306, + 2.5444135423749685, + 1.0625711530447006, + 1.2011039070785046, + 1.126156972721219, + 0.39789065904915333, + 0.9027903098613024, + 1.1941373851150274, + 0.9038698226213455, + 1.0924210883677006, + 0.45785707235336304, + 0.7160711213946342, + 0.26301126182079315 + ], + "unique_experts": 64, + "load_cv": 0.48842776685156897, + "normalized_load_entropy": 0.9707225675099257, + "max_load_share": 0.034408602150537634 + } + }, + "s1_bos": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "75045748e512f5e8b7aadf75e77fd316bd80b6bb256e760a337621aeded5d532", + "route_weight_sha256": "0db2dd028549ed841e949ebae15761cbed5f3f019eec620e092f53d590feb0cc", + "loads": [ + 6, + 8, + 13, + 7, + 6, + 26, + 4, + 13, + 5, + 5, + 9, + 16, + 29, + 17, + 8, + 5, + 18, + 10, + 4, + 12, + 27, + 2, + 17, + 2, + 13, + 9, + 13, + 8, + 14, + 13, + 4, + 8, + 4, + 8, + 7, + 0, + 19, + 4, + 24, + 5, + 9, + 30, + 19, + 13, + 12, + 24, + 9, + 21, + 18, + 8, + 21, + 14, + 24, + 9, + 15, + 13, + 4, + 11, + 13, + 12, + 28, + 13, + 14, + 4 + ], + "weighted_loads": [ + 0.260151419788599, + 0.2956003937870264, + 0.6850154623389244, + 0.39667704328894615, + 0.21816985495388508, + 1.2295081783086061, + 0.2879587635397911, + 0.9934244677424431, + 0.367534801363945, + 0.22768179327249527, + 0.717153511941433, + 0.9736992344260216, + 1.3018629867583513, + 1.1101067811250687, + 0.4320600628852844, + 0.1944123487919569, + 1.0501541830599308, + 0.3349678982049227, + 0.1279260739684105, + 0.8875172324478626, + 1.8314849361777306, + 0.06651896238327026, + 1.8355504646897316, + 0.06351948902010918, + 0.5898971855640411, + 0.396212050691247, + 0.5696094036102295, + 0.3989957347512245, + 1.3150891698896885, + 0.8370322324335575, + 0.3033713884651661, + 0.35766420513391495, + 0.1657213382422924, + 0.2899779789149761, + 0.5858394950628281, + 0.0, + 0.9800165295600891, + 0.1406251545995474, + 1.3719127401709557, + 0.19163761287927628, + 0.44773850217461586, + 1.0963555630296469, + 0.8255023118108511, + 0.6468640714883804, + 0.4806836061179638, + 1.45889438316226, + 0.48089951276779175, + 1.6158975064754486, + 0.7677530776709318, + 0.42928661592304707, + 0.7389801517128944, + 0.8369641955941916, + 1.9633714463561773, + 0.3923352174460888, + 1.1692985408008099, + 1.110447358340025, + 0.14438673853874207, + 0.8151572644710541, + 1.0381988268345594, + 0.7444720789790154, + 1.1516925003379583, + 0.4062388092279434, + 0.7394841685891151, + 0.16254766285419464 + ], + "unique_experts": 63, + "load_cv": 0.5983760622719343, + "normalized_load_entropy": 0.9564359259899813, + "max_load_share": 0.038461538461538464 + }, + "full_input": { + "tokens": 171, + "top_k": 6, + "decisions": 1026, + "ordered_route_sha256": "7235cd0c5475b0caec7e578c52804a71ad15b3d26e399cd2c116aac6faac1cf4", + "route_weight_sha256": "fc4e86f624492ba4edc54677d3526989095cae06e936ec64f81b4b6941e53880", + "loads": [ + 13, + 11, + 25, + 7, + 7, + 28, + 5, + 15, + 15, + 7, + 9, + 20, + 29, + 18, + 17, + 7, + 18, + 19, + 29, + 13, + 27, + 4, + 17, + 2, + 13, + 9, + 13, + 8, + 14, + 14, + 14, + 10, + 7, + 9, + 11, + 14, + 19, + 9, + 25, + 7, + 14, + 31, + 23, + 18, + 12, + 25, + 28, + 25, + 21, + 22, + 23, + 16, + 33, + 21, + 17, + 14, + 6, + 19, + 16, + 16, + 28, + 16, + 14, + 10 + ], + "weighted_loads": [ + 0.6553291641175747, + 0.43533444963395596, + 1.856908243149519, + 0.39667704328894615, + 0.25525193475186825, + 1.286673255264759, + 0.3172441963106394, + 1.0618721470236778, + 1.209393136203289, + 0.289682162925601, + 0.717153511941433, + 1.3161344453692436, + 1.3018629867583513, + 1.152897261083126, + 1.629240220412612, + 0.25969219394028187, + 1.0501541830599308, + 0.9029546286910772, + 2.2082786541432142, + 1.0220700092613697, + 1.8314849361777306, + 0.1196134015917778, + 1.8355504646897316, + 0.06351948902010918, + 0.5898971855640411, + 0.396212050691247, + 0.5696094036102295, + 0.3989957347512245, + 1.3150891698896885, + 0.873882208019495, + 0.868782602250576, + 0.5997539609670639, + 0.48525523394346237, + 0.36631960049271584, + 1.0014655590057373, + 1.3204917758703232, + 0.9800165295600891, + 0.36432253010571003, + 1.408167488873005, + 0.23940879479050636, + 0.6653019543737173, + 1.1394931431859732, + 0.9741566888988018, + 1.1058582738041878, + 0.4806836061179638, + 1.492141630500555, + 3.544341577216983, + 1.7954213935881853, + 0.8625860270112753, + 1.1232365909963846, + 0.8928393963724375, + 1.0234086941927671, + 2.564512262120843, + 1.1081293765455484, + 1.2892831899225712, + 1.145755186676979, + 0.40455933287739754, + 1.1423926129937172, + 1.4369880128651857, + 1.0514902509748936, + 1.1516925003379583, + 0.5126820597797632, + 0.7394841685891151, + 0.38720923848450184 + ], + "unique_experts": 64, + "load_cv": 0.46010093084130044, + "normalized_load_entropy": 0.9737098057030686, + "max_load_share": 0.03216374269005848 + } + }, + "s0_x": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "4fa44f1cd8937b12675b09773ea93b896cd3f879225e49cd2fec01e6febeef12", + "route_weight_sha256": "bbef7b87628841d753798c09677d08e92ded3cb0865e1974ee90de54216b1bc0", + "loads": [ + 6, + 6, + 13, + 7, + 9, + 25, + 4, + 11, + 5, + 5, + 9, + 16, + 28, + 17, + 9, + 4, + 19, + 9, + 3, + 12, + 27, + 2, + 18, + 3, + 12, + 9, + 12, + 9, + 14, + 13, + 4, + 8, + 5, + 11, + 8, + 1, + 20, + 5, + 25, + 5, + 10, + 26, + 21, + 13, + 11, + 25, + 9, + 25, + 16, + 9, + 20, + 14, + 23, + 10, + 15, + 13, + 5, + 11, + 10, + 12, + 27, + 7, + 16, + 4 + ], + "weighted_loads": [ + 0.27160635218024254, + 0.2128373272716999, + 0.678456949070096, + 0.39329312928020954, + 0.30966070108115673, + 1.2601686380803585, + 0.28343241289258003, + 0.905847106128931, + 0.3697310611605644, + 0.2394537851214409, + 0.7179808337241411, + 0.9867521375417709, + 1.2682418432086706, + 1.1365688778460026, + 0.4560675397515297, + 0.17090891301631927, + 1.0650390852242708, + 0.3128755819052458, + 0.10248436033725739, + 0.8956751376390457, + 1.833424597978592, + 0.06824307516217232, + 1.8297743536531925, + 0.08915768936276436, + 0.5660689007490873, + 0.3892502598464489, + 0.5519723035395145, + 0.43374522775411606, + 1.3114573657512665, + 0.8276962358504534, + 0.2981859538704157, + 0.35671078227460384, + 0.2006547637283802, + 0.38521827198565006, + 0.6219126991927624, + 0.034297727048397064, + 0.989873643964529, + 0.16372009180486202, + 1.3781633861362934, + 0.19164665788412094, + 0.48510997369885445, + 0.9637462254613638, + 0.8949372638016939, + 0.6291277725249529, + 0.45038540102541447, + 1.5038921311497688, + 0.5244083516299725, + 1.7491282001137733, + 0.6895096767693758, + 0.46054408699274063, + 0.6855900678783655, + 0.8414915837347507, + 1.9379478991031647, + 0.45549165830016136, + 1.1676355358213186, + 1.0752670504152775, + 0.17876973003149033, + 0.8343433737754822, + 0.9370266012847424, + 0.7489154264330864, + 1.1206279750913382, + 0.21601297333836555, + 0.79037163592875, + 0.16158900037407875 + ], + "unique_experts": 64, + "load_cv": 0.5855817474153228, + "normalized_load_entropy": 0.9589805430185259, + "max_load_share": 0.035897435897435895 + }, + "full_input": { + "tokens": 155, + "top_k": 6, + "decisions": 930, + "ordered_route_sha256": "fdcb3742ca7a282dc2facf7decede175173e5c9775f28968fa9d27853797daf5", + "route_weight_sha256": "9893c2733b0a239f723e13c55e1ef485b5b80461229c1dc61a2e1b540aaef46d", + "loads": [ + 13, + 7, + 26, + 7, + 9, + 27, + 4, + 11, + 13, + 5, + 9, + 20, + 28, + 17, + 14, + 7, + 19, + 9, + 22, + 12, + 27, + 3, + 18, + 3, + 12, + 9, + 12, + 9, + 14, + 13, + 11, + 8, + 6, + 11, + 8, + 5, + 20, + 7, + 25, + 7, + 16, + 26, + 23, + 13, + 11, + 26, + 17, + 25, + 20, + 21, + 22, + 17, + 33, + 18, + 15, + 13, + 6, + 13, + 14, + 14, + 27, + 10, + 16, + 7 + ], + "weighted_loads": [ + 0.6931929290294647, + 0.2873569689691067, + 1.9789196010679007, + 0.39329312928020954, + 0.30966070108115673, + 1.3092606291174889, + 0.28343241289258003, + 0.905847106128931, + 0.8497906923294067, + 0.2394537851214409, + 0.7179808337241411, + 1.3641570135951042, + 1.2682418432086706, + 1.1365688778460026, + 1.409307250753045, + 0.26761640049517155, + 1.0650390852242708, + 0.3128755819052458, + 1.3472201265394688, + 0.8956751376390457, + 1.833424597978592, + 0.09390131570398808, + 1.8297743536531925, + 0.08915768936276436, + 0.5660689007490873, + 0.3892502598464489, + 0.5519723035395145, + 0.43374522775411606, + 1.3114573657512665, + 0.8276962358504534, + 0.5892307925969362, + 0.35671078227460384, + 0.4584500379860401, + 0.38521827198565006, + 0.6219126991927624, + 0.3094066195189953, + 0.989873643964529, + 0.22425870597362518, + 1.3781633861362934, + 0.23924774676561356, + 0.7261176612228155, + 0.9637462254613638, + 0.9497108832001686, + 0.6291277725249529, + 0.45038540102541447, + 1.5346386637538671, + 2.4152742978185415, + 1.7491282001137733, + 0.8726275730878115, + 1.0687216445803642, + 0.8264976367354393, + 1.0639331489801407, + 2.646465754136443, + 1.0300756953656673, + 1.1676355358213186, + 1.0752670504152775, + 0.40186887234449387, + 0.9059045668691397, + 1.1257208343595266, + 0.827104739844799, + 1.1206279750913382, + 0.29594722390174866, + 0.79037163592875, + 0.33499284088611603 + ], + "unique_experts": 64, + "load_cv": 0.49951300135700666, + "normalized_load_entropy": 0.969788619285988, + "max_load_share": 0.035483870967741936 + } + }, + "s1_x": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "41449f406d97c861a65d21a4b8dbcb75bbc2c088a3e670d6b027f5d881733c55", + "route_weight_sha256": "ebbe12e80484f326f64531e8c1c24437f346756c9be40e6e0fcc2d84edd48f74", + "loads": [ + 7, + 8, + 14, + 6, + 7, + 26, + 4, + 12, + 8, + 5, + 10, + 16, + 24, + 17, + 8, + 6, + 19, + 6, + 4, + 12, + 27, + 3, + 19, + 3, + 15, + 7, + 13, + 10, + 13, + 14, + 4, + 7, + 5, + 9, + 7, + 1, + 21, + 3, + 26, + 5, + 9, + 28, + 22, + 13, + 12, + 23, + 9, + 25, + 18, + 8, + 19, + 14, + 22, + 10, + 14, + 13, + 2, + 11, + 11, + 11, + 26, + 9, + 16, + 4 + ], + "weighted_loads": [ + 0.29697718657553196, + 0.2792126275599003, + 0.7001123186200857, + 0.3696451149880886, + 0.2399131115525961, + 1.2275472190231085, + 0.31217122822999954, + 0.9504822567105293, + 0.45993781089782715, + 0.22679998353123665, + 0.7468092888593674, + 0.974027082324028, + 1.1410729251801968, + 1.1060521993786097, + 0.42807649448513985, + 0.21501782909035683, + 1.0795232634991407, + 0.2029737550765276, + 0.13100171647965908, + 0.8972414843738079, + 1.845131278038025, + 0.09874777868390083, + 1.858961759135127, + 0.08563449420034885, + 0.6657338682562113, + 0.334779717028141, + 0.553631080314517, + 0.47905655950307846, + 1.3006223887205124, + 0.8657363802194595, + 0.28244272619485855, + 0.3350968174636364, + 0.19670521840453148, + 0.2968194466084242, + 0.5636118873953819, + 0.031845398247241974, + 1.0384438149631023, + 0.11398982256650925, + 1.4494685214012861, + 0.18173353001475334, + 0.4424484670162201, + 1.006680278107524, + 0.9108145795762539, + 0.6356102302670479, + 0.47546293772757053, + 1.4212049916386604, + 0.5150220058858395, + 1.8086649626493454, + 0.7586764357984066, + 0.43438744731247425, + 0.6895314045250416, + 0.8540376927703619, + 1.903524000197649, + 0.4225640408694744, + 1.1456563398241997, + 1.0816167928278446, + 0.08116317540407181, + 0.825087383389473, + 0.961306981742382, + 0.7078212425112724, + 1.0927803870290518, + 0.28419542871415615, + 0.805114921182394, + 0.15857189893722534 + ], + "unique_experts": 64, + "load_cv": 0.58612041989174, + "normalized_load_entropy": 0.9584772447486659, + "max_load_share": 0.035897435897435895 + }, + "full_input": { + "tokens": 171, + "top_k": 6, + "decisions": 1026, + "ordered_route_sha256": "27a515c2007dba2a510ecb20fb78b11322bd0a8583883af450499793ed61c7a0", + "route_weight_sha256": "aa76f93f3cc76eaec477c92c17b18f31991a5f8366321e1f7f91c595c4391a2b", + "loads": [ + 16, + 11, + 27, + 6, + 8, + 28, + 5, + 14, + 19, + 7, + 10, + 20, + 24, + 18, + 17, + 7, + 19, + 15, + 29, + 13, + 27, + 5, + 19, + 3, + 15, + 7, + 13, + 10, + 13, + 15, + 14, + 9, + 8, + 10, + 11, + 14, + 21, + 8, + 27, + 7, + 14, + 28, + 24, + 19, + 12, + 24, + 26, + 29, + 22, + 23, + 21, + 17, + 32, + 22, + 16, + 14, + 4, + 18, + 14, + 14, + 26, + 11, + 16, + 11 + ], + "weighted_loads": [ + 0.8540184516459703, + 0.41894668340682983, + 1.9718570802360773, + 0.3696451149880886, + 0.27699519135057926, + 1.2847122959792614, + 0.3414566610008478, + 1.018929935991764, + 1.3448854722082615, + 0.2888003531843424, + 0.7468092888593674, + 1.2750195562839508, + 1.1410729251801968, + 1.148842679336667, + 1.5498644355684519, + 0.24688980728387833, + 1.0795232634991407, + 0.7709604855626822, + 2.2168677113950253, + 1.031794261187315, + 1.845131278038025, + 0.15184221789240837, + 1.858961759135127, + 0.08563449420034885, + 0.6657338682562113, + 0.334779717028141, + 0.553631080314517, + 0.47905655950307846, + 1.3006223887205124, + 0.902586355805397, + 0.855911772698164, + 0.5771865732967854, + 0.5190030448138714, + 0.3731610681861639, + 0.9792379513382912, + 1.3442194759845734, + 1.0384438149631023, + 0.3376871980726719, + 1.4857232701033354, + 0.22950471192598343, + 0.6341158952564001, + 1.006680278107524, + 0.9636705424636602, + 1.144759401679039, + 0.47546293772757053, + 1.4724457077682018, + 3.4494466595351696, + 1.988188849762082, + 0.8927653282880783, + 1.1422685328871012, + 0.8212423976510763, + 1.084241846576333, + 2.5805889293551445, + 1.0724964197725058, + 1.265640988945961, + 1.1169246211647987, + 0.3413357697427273, + 1.1301593612879515, + 1.3550586141645908, + 0.9354708828032017, + 1.0927803870290518, + 0.3481221944093704, + 0.805114921182394, + 0.4459622520953417 + ], + "unique_experts": 64, + "load_cv": 0.4527749427505031, + "normalized_load_entropy": 0.97439269712751, + "max_load_share": 0.031189083820662766 + } + }, + "s0_period": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "32c6b76cb794937e9c40c2bd686dc2c0f0d939209551d9ab8fed622f09eb4406", + "route_weight_sha256": "0c81072e8f7a11482dbbeabf201a7cca665636e698f48d415694da33ead90b4a", + "loads": [ + 6, + 7, + 14, + 6, + 8, + 25, + 4, + 11, + 6, + 5, + 9, + 16, + 29, + 17, + 9, + 7, + 19, + 8, + 3, + 12, + 27, + 2, + 17, + 3, + 12, + 8, + 12, + 10, + 14, + 13, + 4, + 8, + 6, + 10, + 7, + 1, + 21, + 5, + 27, + 6, + 10, + 30, + 21, + 13, + 10, + 24, + 9, + 24, + 15, + 8, + 18, + 14, + 22, + 9, + 16, + 13, + 6, + 11, + 10, + 12, + 26, + 6, + 15, + 4 + ], + "weighted_loads": [ + 0.2627663053572178, + 0.245218550786376, + 0.7098545972257853, + 0.36535073444247246, + 0.2930418197065592, + 1.264821084216237, + 0.2778393141925335, + 0.904580395668745, + 0.4131380170583725, + 0.23477158322930336, + 0.71315479837358, + 0.98121302947402, + 1.302982922643423, + 1.1340707000344992, + 0.4603114202618599, + 0.25668334774672985, + 1.0671807583421469, + 0.2730695642530918, + 0.1031244546175003, + 0.8854538761079311, + 1.8317606411874294, + 0.06927060708403587, + 1.7991942390799522, + 0.08998078294098377, + 0.5604762323200703, + 0.358578085899353, + 0.5524057224392891, + 0.4696171507239342, + 1.3128349334001541, + 0.8258356116712093, + 0.28878311440348625, + 0.3584829233586788, + 0.23502812907099724, + 0.3540746383368969, + 0.5849847495555878, + 0.033880215138196945, + 1.024200463667512, + 0.16777998767793179, + 1.4266021754592657, + 0.22344089299440384, + 0.4913787432014942, + 1.1104369796812534, + 0.8904316667467356, + 0.627428425475955, + 0.4201381914317608, + 1.4654613360762596, + 0.5269734039902687, + 1.7062138691544533, + 0.6673558056354523, + 0.42442992702126503, + 0.6277858354151249, + 0.8415032438933849, + 1.8907789587974548, + 0.415119718760252, + 1.2030965983867645, + 1.065951906144619, + 0.20622197352349758, + 0.8288098238408566, + 0.9411433562636375, + 0.767387866973877, + 1.0848421938717365, + 0.17572605051100254, + 0.7678130213171244, + 0.1654912680387497 + ], + "unique_experts": 64, + "load_cv": 0.5904121071580121, + "normalized_load_entropy": 0.9592024722841513, + "max_load_share": 0.038461538461538464 + }, + "full_input": { + "tokens": 155, + "top_k": 6, + "decisions": 930, + "ordered_route_sha256": "a1f2fc3b2c9f7dcdc2d9e1a8803968462e9750c3b0cd5cbf396c9add77c935b9", + "route_weight_sha256": "e5142087a5caafacba78249eae983edf5571b994d313e88f31e6a4725ad2afac", + "loads": [ + 13, + 8, + 26, + 6, + 8, + 27, + 4, + 11, + 14, + 5, + 9, + 20, + 29, + 17, + 14, + 10, + 19, + 8, + 23, + 12, + 27, + 4, + 17, + 3, + 12, + 8, + 12, + 10, + 14, + 13, + 10, + 9, + 8, + 10, + 7, + 4, + 21, + 7, + 27, + 8, + 16, + 30, + 23, + 13, + 10, + 25, + 17, + 24, + 18, + 19, + 21, + 16, + 32, + 18, + 16, + 13, + 7, + 14, + 13, + 14, + 26, + 10, + 15, + 6 + ], + "weighted_loads": [ + 0.6898329816758633, + 0.31973819248378277, + 1.842412931844592, + 0.36535073444247246, + 0.2930418197065592, + 1.3139130752533674, + 0.2778393141925335, + 0.904580395668745, + 0.8931976482272148, + 0.23477158322930336, + 0.71315479837358, + 1.3469190187752247, + 1.302982922643423, + 1.1340707000344992, + 1.5245625022798777, + 0.3533908352255821, + 1.0671807583421469, + 0.2730695642530918, + 1.4155196622014046, + 0.8854538761079311, + 1.8317606411874294, + 0.1272618267685175, + 1.7991942390799522, + 0.08998078294098377, + 0.5604762323200703, + 0.358578085899353, + 0.5524057224392891, + 0.4696171507239342, + 1.3128349334001541, + 0.8258356116712093, + 0.5510583519935608, + 0.38877409137785435, + 0.5231483075767756, + 0.3540746383368969, + 0.5849847495555878, + 0.2705700956285, + 1.024200463667512, + 0.22831860184669495, + 1.4266021754592657, + 0.27104198187589645, + 0.7319512888789177, + 1.1104369796812534, + 0.9452052861452103, + 0.627428425475955, + 0.4201381914317608, + 1.496890440583229, + 2.5559425354003906, + 1.7062138691544533, + 0.8094461746513844, + 0.9947730377316475, + 0.8068045396357775, + 1.0288782678544521, + 2.574691003188491, + 1.0268600583076477, + 1.2030965983867645, + 1.065951906144619, + 0.4293211158365011, + 0.9541295021772385, + 1.0646179895848036, + 0.842845868319273, + 1.0848421938717365, + 0.2839205339550972, + 0.7678130213171244, + 0.25837497040629387 + ], + "unique_experts": 64, + "load_cv": 0.5005488951530057, + "normalized_load_entropy": 0.9699905831385149, + "max_load_share": 0.034408602150537634 + } + }, + "s1_period": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "578d024c823ae293a70fd073ebdd6c6b67b7b2e8205155c99a731df86c43b236", + "route_weight_sha256": "577ed38a0bcdcde4c11b6adc09f218c29fe18fc3d1a63ec4ccddffd39a675783", + "loads": [ + 7, + 7, + 14, + 6, + 6, + 26, + 4, + 12, + 6, + 5, + 11, + 17, + 27, + 17, + 8, + 6, + 19, + 7, + 3, + 12, + 28, + 2, + 17, + 2, + 12, + 7, + 12, + 10, + 14, + 14, + 4, + 8, + 4, + 7, + 7, + 0, + 21, + 4, + 25, + 5, + 9, + 29, + 24, + 13, + 11, + 24, + 9, + 26, + 17, + 8, + 19, + 13, + 24, + 10, + 14, + 13, + 5, + 11, + 11, + 11, + 27, + 9, + 16, + 4 + ], + "weighted_loads": [ + 0.29644637182354927, + 0.2533469423651695, + 0.6958656832575798, + 0.3682232052087784, + 0.21291323564946651, + 1.2625816352665424, + 0.32064544036984444, + 0.9461671486496925, + 0.3922335412353277, + 0.23002463951706886, + 0.7834194507449865, + 1.003147752955556, + 1.2368820179253817, + 1.0952653884887695, + 0.42441718839108944, + 0.21353643387556076, + 1.0744146667420864, + 0.23746440187096596, + 0.10167545638978481, + 0.8943499177694321, + 1.9007212445139885, + 0.06803548708558083, + 1.806981671601534, + 0.06352510303258896, + 0.5551741234958172, + 0.33490246906876564, + 0.5298555791378021, + 0.47754402086138725, + 1.3218965269625187, + 0.8763104826211929, + 0.2602895200252533, + 0.3705767020583153, + 0.1668160893023014, + 0.23895061947405338, + 0.5853757075965405, + 0.0, + 1.0648875422775745, + 0.14111615344882011, + 1.432759428396821, + 0.18573911488056183, + 0.43982330337166786, + 1.0563144963234663, + 0.9712655264884233, + 0.6487131752073765, + 0.44507573172450066, + 1.4597474467009306, + 0.47658615931868553, + 1.822584381327033, + 0.7376628015190363, + 0.4265781342983246, + 0.6918555814772844, + 0.8350417874753475, + 1.9490420799702406, + 0.42229054495692253, + 1.131702609360218, + 1.074129018932581, + 0.17676261067390442, + 0.8173008114099503, + 0.9515491761267185, + 0.7147179320454597, + 1.1420979723334312, + 0.27747171744704247, + 0.8137016706168652, + 0.16217298805713654 + ], + "unique_experts": 63, + "load_cv": 0.6131369207845759, + "normalized_load_entropy": 0.9546555687797884, + "max_load_share": 0.03717948717948718 + }, + "full_input": { + "tokens": 171, + "top_k": 6, + "decisions": 1026, + "ordered_route_sha256": "369b86ef5a3706c0e98d1c641f92c4b8484398c598a53ad66309a5bac07d8f23", + "route_weight_sha256": "c79e13ac815badad10fb8cc93dab9bea3abd336bac26d039e077724a9c88d1cd", + "loads": [ + 14, + 10, + 26, + 6, + 7, + 28, + 5, + 14, + 16, + 8, + 11, + 21, + 27, + 18, + 17, + 7, + 19, + 16, + 27, + 13, + 28, + 4, + 17, + 2, + 12, + 7, + 12, + 10, + 14, + 15, + 14, + 11, + 7, + 8, + 11, + 14, + 21, + 9, + 26, + 7, + 14, + 29, + 26, + 18, + 11, + 25, + 27, + 30, + 20, + 23, + 21, + 17, + 34, + 23, + 16, + 14, + 7, + 19, + 14, + 14, + 27, + 11, + 16, + 11 + ], + "weighted_loads": [ + 0.691624116152525, + 0.3930809982120991, + 1.8451050333678722, + 0.3682232052087784, + 0.24999531544744968, + 1.3197467122226954, + 0.3499308731406927, + 1.0146148279309273, + 1.2340918760746717, + 0.3370837476104498, + 0.7834194507449865, + 1.3653950411826372, + 1.2368820179253817, + 1.138055868446827, + 1.6663368605077267, + 0.24540841206908226, + 1.0744146667420864, + 0.8054511323571205, + 2.115641450509429, + 1.0289026945829391, + 1.9007212445139885, + 0.12112992629408836, + 1.806981671601534, + 0.06352510303258896, + 0.5551741234958172, + 0.33490246906876564, + 0.5298555791378021, + 0.47754402086138725, + 1.3218965269625187, + 0.9131604582071304, + 0.8127558715641499, + 0.6409194953739643, + 0.47539933398365974, + 0.3152922410517931, + 1.0010017715394497, + 1.3147819302976131, + 1.0648875422775745, + 0.36481352895498276, + 1.4690141770988703, + 0.23351029679179192, + 0.6274264939129353, + 1.0563144963234663, + 1.0241214893758297, + 1.1077073775231838, + 0.44507573172450066, + 1.5238705333322287, + 3.470631916075945, + 2.0021082684397697, + 0.8324957508593798, + 1.1414375454187393, + 0.828051496297121, + 1.136824268847704, + 2.6024723555892706, + 1.1249540634453297, + 1.2516872584819794, + 1.109436847269535, + 0.4369352050125599, + 1.176519237458706, + 1.3455150686204433, + 0.9477277919650078, + 1.1420979723334312, + 0.34139848314225674, + 0.8137016706168652, + 0.4163195751607418 + ], + "unique_experts": 64, + "load_cv": 0.4667913933059978, + "normalized_load_entropy": 0.9730871869175826, + "max_load_share": 0.03313840155945419 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 130, + "ordered_topk_exact_tokens": 83, + "set_exact_tokens": 99, + "mean_set_jaccard": 0.9285714285714286, + "mean_token_weighted_tv": 0.012805198605817098, + "aggregate_load_tv": 0.029487179487179487 + }, + "system_bos": { + "tokens": 130, + "ordered_topk_exact_tokens": 72, + "set_exact_tokens": 86, + "mean_set_jaccard": 0.9016483516483517, + "mean_token_weighted_tv": 0.01709294022562412, + "aggregate_load_tv": 0.033333333333333326 + }, + "system_x": { + "tokens": 130, + "ordered_topk_exact_tokens": 63, + "set_exact_tokens": 80, + "mean_set_jaccard": 0.8884615384615384, + "mean_token_weighted_tv": 0.01983503265163073, + "aggregate_load_tv": 0.041025641025641026 + }, + "system_period": { + "tokens": 130, + "ordered_topk_exact_tokens": 64, + "set_exact_tokens": 81, + "mean_set_jaccard": 0.8890109890109891, + "mean_token_weighted_tv": 0.020774852591924943, + "aggregate_load_tv": 0.033333333333333326 + }, + "bos_at_s0": { + "tokens": 130, + "ordered_topk_exact_tokens": 69, + "set_exact_tokens": 89, + "mean_set_jaccard": 0.9082417582417583, + "mean_token_weighted_tv": 0.016832822181570988, + "aggregate_load_tv": 0.033333333333333326 + }, + "bos_at_s1": { + "tokens": 130, + "ordered_topk_exact_tokens": 70, + "set_exact_tokens": 84, + "mean_set_jaccard": 0.8972527472527473, + "mean_token_weighted_tv": 0.018936171762358685, + "aggregate_load_tv": 0.03717948717948718 + }, + "x_at_s0": { + "tokens": 130, + "ordered_topk_exact_tokens": 64, + "set_exact_tokens": 86, + "mean_set_jaccard": 0.8967032967032968, + "mean_token_weighted_tv": 0.018829377274960278, + "aggregate_load_tv": 0.03461538461538462 + }, + "x_at_s1": { + "tokens": 130, + "ordered_topk_exact_tokens": 60, + "set_exact_tokens": 83, + "mean_set_jaccard": 0.8934065934065935, + "mean_token_weighted_tv": 0.02128954685221498, + "aggregate_load_tv": 0.038461538461538464 + }, + "period_at_s0": { + "tokens": 130, + "ordered_topk_exact_tokens": 58, + "set_exact_tokens": 89, + "mean_set_jaccard": 0.9065934065934066, + "mean_token_weighted_tv": 0.017985863668414263, + "aggregate_load_tv": 0.02820512820512821 + }, + "period_at_s1": { + "tokens": 130, + "ordered_topk_exact_tokens": 63, + "set_exact_tokens": 82, + "mean_set_jaccard": 0.8895604395604396, + "mean_token_weighted_tv": 0.021797321987553284, + "aggregate_load_tv": 0.030769230769230767 + } + } + }, + "layer_19": { + "layer": 19, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "eac378f21cf5aeb73e766389e4a50d1ccbee4735d53cf0e312b331dbd8bc09d9", + "route_weight_sha256": "fd5d2c4411cebc2c795681bbdf15e0758cafb8c84727a3f17d213540e2e3d5de", + "loads": [ + 3, + 3, + 12, + 16, + 5, + 2, + 8, + 23, + 15, + 14, + 3, + 4, + 4, + 16, + 12, + 7, + 16, + 2, + 12, + 5, + 16, + 21, + 2, + 11, + 3, + 11, + 1, + 21, + 13, + 5, + 16, + 29, + 4, + 8, + 14, + 2, + 3, + 10, + 19, + 9, + 10, + 2, + 5, + 6, + 27, + 9, + 7, + 13, + 4, + 28, + 3, + 90, + 23, + 16, + 12, + 21, + 6, + 24, + 3, + 32, + 2, + 4, + 19, + 14 + ], + "weighted_loads": [ + 0.09045028872787952, + 0.10948521271348, + 0.4945609122514725, + 1.097613137215376, + 0.18284605629742146, + 0.08244413509964943, + 0.3116504307836294, + 1.2951515708118677, + 0.740439822897315, + 0.5499508865177631, + 0.10703511908650398, + 0.21024960093200207, + 0.1745218075811863, + 0.563638374209404, + 0.7916360776871443, + 0.28453809581696987, + 0.7405411899089813, + 0.05946078710258007, + 0.5662244707345963, + 0.15102395601570606, + 0.9844508841633797, + 1.3762918636202812, + 0.09499848634004593, + 0.4098065607249737, + 0.2025843933224678, + 0.7499391473829746, + 0.03437512367963791, + 0.8508780431002378, + 0.9786315932869911, + 0.33309268951416016, + 0.9307532999664545, + 3.03285326436162, + 0.11927510239183903, + 0.3436796832829714, + 1.7371417358517647, + 0.11304114013910294, + 0.10709082707762718, + 0.31452157720923424, + 1.659705564379692, + 0.5156925022602081, + 0.3744309116154909, + 0.07983925938606262, + 0.16643723100423813, + 0.21086328849196434, + 1.9342932179570198, + 0.5531687084585428, + 0.26069749891757965, + 0.9256267510354519, + 0.12855874188244343, + 2.216526046395302, + 0.11728641390800476, + 5.26747240126133, + 1.4765122681856155, + 0.7045829147100449, + 0.6590297278016806, + 1.6392431389540434, + 0.23951389268040657, + 1.3705460391938686, + 0.1620758157223463, + 2.54095771163702, + 0.06877225264906883, + 0.17434458807110786, + 1.1332189682871103, + 0.6820244044065475 + ], + "unique_experts": 64, + "load_cv": 1.0299269425077455, + "normalized_load_entropy": 0.9121515864204142, + "max_load_share": 0.11538461538461539 + }, + "full_input": { + "tokens": 155, + "top_k": 6, + "decisions": 930, + "ordered_route_sha256": "f53d3f959d97744772fd8d1e438881e70be61c66cebc0c2c9a841ad23b4b8841", + "route_weight_sha256": "7142f6422d9668097300fceb1faa0c535b9292912348cdd6ab82fdcecfb62f22", + "loads": [ + 5, + 6, + 15, + 16, + 10, + 3, + 19, + 23, + 15, + 19, + 3, + 5, + 12, + 17, + 17, + 7, + 19, + 2, + 12, + 9, + 16, + 21, + 7, + 20, + 12, + 11, + 1, + 23, + 13, + 9, + 22, + 29, + 4, + 8, + 14, + 4, + 5, + 16, + 20, + 9, + 14, + 4, + 13, + 7, + 28, + 9, + 7, + 18, + 5, + 29, + 3, + 90, + 23, + 18, + 19, + 21, + 6, + 24, + 10, + 32, + 4, + 8, + 26, + 14 + ], + "weighted_loads": [ + 0.1339748208411038, + 0.4595276974141598, + 0.9842330198734999, + 1.097613137215376, + 1.0671486351639032, + 0.09563195984810591, + 0.7807327704504132, + 1.2951515708118677, + 0.740439822897315, + 0.8087063692510128, + 0.10703511908650398, + 0.24086653254926205, + 0.7097168155014515, + 0.6029503270983696, + 1.299928905442357, + 0.28453809581696987, + 0.8545967005193233, + 0.05946078710258007, + 0.5662244707345963, + 0.3253245558589697, + 0.9844508841633797, + 1.3762918636202812, + 0.27698112092912197, + 0.7254310650750995, + 0.7124087293632329, + 0.7499391473829746, + 0.03437512367963791, + 0.9212596472352743, + 0.9786315932869911, + 0.49551086500287056, + 1.1724962685257196, + 3.03285326436162, + 0.11927510239183903, + 0.3436796832829714, + 1.7371417358517647, + 0.20522959902882576, + 0.15066326456144452, + 0.5832879766821861, + 1.7012200057506561, + 0.5156925022602081, + 0.4725160556845367, + 0.19656257331371307, + 0.7520016320049763, + 0.2682776190340519, + 1.9450119696557522, + 0.5531687084585428, + 0.26069749891757965, + 1.368140447884798, + 0.16589426435530186, + 2.2412412725389004, + 0.11728641390800476, + 5.26747240126133, + 1.4765122681856155, + 0.9167560413479805, + 2.4310677517205477, + 1.6392431389540434, + 0.23951389268040657, + 1.3705460391938686, + 0.5631753541529179, + 2.54095771163702, + 0.1870638094842434, + 0.39906351268291473, + 1.6739552821964025, + 0.6820244044065475 + ], + "unique_experts": 64, + "load_cv": 0.8412506312513984, + "normalized_load_entropy": 0.9378278481358896, + "max_load_share": 0.0967741935483871 + } + }, + "s1_eos": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "55a966daaa8e7c8a08d4514d342cadd3198f2b328af0bfba02de0f69b68edeb4", + "route_weight_sha256": "34e55a8f97292857fc69d206c5658c10d6bf910bee24fa58248c7a13428261ab", + "loads": [ + 3, + 3, + 13, + 16, + 4, + 2, + 8, + 23, + 16, + 14, + 2, + 4, + 5, + 17, + 12, + 7, + 16, + 2, + 11, + 5, + 17, + 21, + 2, + 10, + 4, + 11, + 1, + 19, + 13, + 5, + 16, + 28, + 4, + 9, + 14, + 2, + 3, + 10, + 19, + 9, + 10, + 3, + 6, + 8, + 27, + 9, + 7, + 13, + 4, + 28, + 2, + 89, + 22, + 14, + 12, + 21, + 6, + 24, + 4, + 33, + 1, + 4, + 20, + 13 + ], + "weighted_loads": [ + 0.0882857833057642, + 0.1121322400867939, + 0.5084458701312542, + 1.1129269618541002, + 0.1592591442167759, + 0.08587448671460152, + 0.3039853759109974, + 1.3004687912762165, + 0.7791189420968294, + 0.5537243373692036, + 0.07473522797226906, + 0.21286799013614655, + 0.20266717672348022, + 0.5906356535851955, + 0.8024111650884151, + 0.2828934621065855, + 0.7386966366320848, + 0.05486000142991543, + 0.5320518594235182, + 0.1552320010960102, + 1.0164489801973104, + 1.3713172003626823, + 0.09417969360947609, + 0.37003111839294434, + 0.23016607947647572, + 0.7497317716479301, + 0.034142982214689255, + 0.8027948755770922, + 0.9951215460896492, + 0.33612564019858837, + 0.9166961759328842, + 3.0422670394182205, + 0.1107343714684248, + 0.3698779661208391, + 1.7586954683065414, + 0.12072793021798134, + 0.10621274635195732, + 0.307377390563488, + 1.644365604966879, + 0.5050783716142178, + 0.37632395699620247, + 0.11023933254182339, + 0.1981651559472084, + 0.2835702206939459, + 1.9334933944046497, + 0.5403507258743048, + 0.2646400071680546, + 0.9179142005741596, + 0.12878058850765228, + 2.2125318739563227, + 0.08280136436223984, + 5.267072742804885, + 1.4714631531387568, + 0.6440248060971498, + 0.6601864416152239, + 1.6347050424665213, + 0.24267494678497314, + 1.3584638573229313, + 0.18064842745661736, + 2.537684541195631, + 0.0352974459528923, + 0.1743554025888443, + 1.1806016340851784, + 0.6389755923300982 + ], + "unique_experts": 64, + "load_cv": 1.019455708124881, + "normalized_load_entropy": 0.9132316138717274, + "max_load_share": 0.1141025641025641 + }, + "full_input": { + "tokens": 171, + "top_k": 6, + "decisions": 1026, + "ordered_route_sha256": "e5bbb869fef96be65c6dcd521d01d965d67ae3ecd58233092be4a4092abaff1d", + "route_weight_sha256": "f277a443a296d9bdab0990887eebcd35a0dd6fe43615856a89541f711d0bf563", + "loads": [ + 5, + 9, + 16, + 16, + 16, + 4, + 23, + 23, + 16, + 20, + 3, + 11, + 17, + 17, + 23, + 9, + 19, + 7, + 12, + 13, + 20, + 22, + 8, + 16, + 17, + 11, + 1, + 21, + 14, + 6, + 21, + 28, + 6, + 9, + 14, + 3, + 6, + 14, + 20, + 11, + 15, + 10, + 16, + 8, + 28, + 9, + 7, + 25, + 5, + 30, + 7, + 89, + 25, + 24, + 17, + 21, + 8, + 26, + 14, + 34, + 4, + 13, + 29, + 15 + ], + "weighted_loads": [ + 0.11399871297180653, + 0.6094676554203033, + 0.9877496883273125, + 1.1129269618541002, + 1.7597915213555098, + 0.17860499303787947, + 1.0089337201789021, + 1.3004687912762165, + 0.7791189420968294, + 0.8445533066987991, + 0.1412791572511196, + 0.9398070983588696, + 0.8633016683161259, + 0.5906356535851955, + 1.7472321763634682, + 0.3909321967512369, + 1.1324759181588888, + 0.2802726235240698, + 0.6319251414388418, + 0.541586134582758, + 1.3185416217893362, + 1.4259194433689117, + 0.328221233561635, + 0.5677659725770354, + 1.01777772186324, + 0.7497317716479301, + 0.034142982214689255, + 0.889685707166791, + 1.0322764292359352, + 0.3735786061733961, + 1.122396631166339, + 3.0422670394182205, + 0.19647090882062912, + 0.3698779661208391, + 1.7586954683065414, + 0.1566147245466709, + 0.18930710339918733, + 0.48256248980760574, + 1.6873869709670544, + 0.6074100341647863, + 0.5090673482045531, + 0.4384204838424921, + 0.9359739553183317, + 0.2835702206939459, + 1.944212146103382, + 0.5403507258743048, + 0.2646400071680546, + 1.7756826244294643, + 0.16356641799211502, + 2.289124647155404, + 0.419243760406971, + 5.267072742804885, + 1.6172492504119873, + 1.4723733346909285, + 2.3719993624836206, + 1.6347050424665213, + 0.3226085603237152, + 1.4468771554529667, + 0.7714849896728992, + 2.572254080325365, + 0.19306926429271698, + 0.5679152309894562, + 1.9072795547544956, + 0.8022094536572695 + ], + "unique_experts": 64, + "load_cv": 0.7453610905023478, + "normalized_load_entropy": 0.9495691235735367, + "max_load_share": 0.08674463937621832 + } + }, + "s0_bos": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "6752ee35aeb190886454e06dd67b1833f6d5faa9e534f7066d706bdb57eb0e0d", + "route_weight_sha256": "717b23d7f7fc9ba333c59ca637e029a0c5c1774ef6a3d176797e6c981bfa9807", + "loads": [ + 3, + 5, + 14, + 16, + 5, + 2, + 9, + 24, + 14, + 14, + 3, + 2, + 4, + 16, + 13, + 7, + 18, + 2, + 10, + 5, + 16, + 21, + 2, + 13, + 2, + 11, + 1, + 18, + 14, + 3, + 14, + 28, + 3, + 9, + 15, + 2, + 3, + 8, + 19, + 8, + 7, + 2, + 5, + 6, + 28, + 9, + 7, + 13, + 5, + 28, + 3, + 91, + 23, + 17, + 11, + 21, + 8, + 24, + 5, + 33, + 2, + 4, + 18, + 14 + ], + "weighted_loads": [ + 0.0950224157422781, + 0.1627133134752512, + 0.5490737352520227, + 1.125701006501913, + 0.19659509509801865, + 0.0794108547270298, + 0.33988967165350914, + 1.3104735910892487, + 0.7064897380769253, + 0.5596849601715803, + 0.10371989011764526, + 0.16375647485256195, + 0.18033646419644356, + 0.5696677975356579, + 0.8356767520308495, + 0.2770235948264599, + 0.8014872875064611, + 0.059632427990436554, + 0.513190396130085, + 0.15833722054958344, + 0.9865971319377422, + 1.3476031105965376, + 0.09386958181858063, + 0.4667972754687071, + 0.16706955805420876, + 0.7454548068344593, + 0.03241172432899475, + 0.7528518885374069, + 1.0064957588911057, + 0.28540176898241043, + 0.8740509692579508, + 2.968228291720152, + 0.0980767160654068, + 0.3719815630465746, + 1.7707165703177452, + 0.11708461120724678, + 0.10515540465712547, + 0.2467733509838581, + 1.6517205871641636, + 0.49139693193137646, + 0.27793966606259346, + 0.08123113214969635, + 0.1610573623329401, + 0.22181765735149384, + 1.9645479507744312, + 0.5519524421542883, + 0.2616306934505701, + 0.9223048985004425, + 0.150042237713933, + 2.2218487821519375, + 0.12089797481894493, + 5.310115169733763, + 1.4856659453362226, + 0.7517430800944567, + 0.6365691237151623, + 1.660349192097783, + 0.3026117663830519, + 1.3729919884353876, + 0.20449721813201904, + 2.567924441769719, + 0.07059495151042938, + 0.16761412844061852, + 1.1376452706754208, + 0.6868794467300177 + ], + "unique_experts": 64, + "load_cv": 1.041202460668704, + "normalized_load_entropy": 0.9104594328932264, + "max_load_share": 0.11666666666666667 + }, + "full_input": { + "tokens": 155, + "top_k": 6, + "decisions": 930, + "ordered_route_sha256": "40efb607a21734eeb23e64bdcc723c2a7d65832ee7a750708851cb46ae94a0c9", + "route_weight_sha256": "5e72c6c9fc45dac52afe24b303cf41274fb04e6c701879c505f6b3dfb08e52b7", + "loads": [ + 4, + 8, + 16, + 16, + 9, + 3, + 19, + 24, + 14, + 18, + 3, + 3, + 12, + 19, + 18, + 7, + 21, + 3, + 10, + 10, + 16, + 21, + 7, + 19, + 11, + 11, + 2, + 20, + 14, + 7, + 22, + 28, + 3, + 9, + 15, + 4, + 3, + 14, + 20, + 9, + 10, + 5, + 13, + 7, + 29, + 10, + 7, + 18, + 7, + 29, + 3, + 92, + 23, + 19, + 17, + 21, + 8, + 24, + 12, + 33, + 4, + 8, + 25, + 14 + ], + "weighted_loads": [ + 0.13408795185387135, + 0.4518223125487566, + 0.9748930782079697, + 1.125701006501913, + 0.9075756743550301, + 0.09259867947548628, + 0.7742773210629821, + 1.3104735910892487, + 0.7064897380769253, + 0.7868082765489817, + 0.10371989011764526, + 0.19437340646982193, + 0.7106897868216038, + 0.6906360499560833, + 1.3636608682572842, + 0.2770235948264599, + 0.9155427981168032, + 0.7930316403508186, + 0.513190396130085, + 0.5631025172770023, + 0.9865971319377422, + 1.3476031105965376, + 0.27585221640765667, + 0.6965696979314089, + 0.7704423330724239, + 0.7454548068344593, + 0.06699902191758156, + 0.836395625025034, + 1.0064957588911057, + 0.44781994447112083, + 1.205665608868003, + 2.968228291720152, + 0.0980767160654068, + 0.3719815630465746, + 1.7707165703177452, + 0.1959784235805273, + 0.10515540465712547, + 0.5173791255801916, + 1.6932350285351276, + 0.5230940971523523, + 0.38358175940811634, + 0.23548539355397224, + 0.7466217633336782, + 0.2792319878935814, + 1.9752667024731636, + 0.5775431953370571, + 0.2616306934505701, + 1.3902222253382206, + 0.22369439713656902, + 2.2520791701972485, + 0.12089797481894493, + 5.325647014193237, + 1.4856659453362226, + 0.9300335291773081, + 1.4652793034911156, + 1.660349192097783, + 0.3026117663830519, + 1.3729919884353876, + 0.6075646188110113, + 2.567924441769719, + 0.18261278420686722, + 0.39312396943569183, + 1.678381584584713, + 0.6868794467300177 + ], + "unique_experts": 64, + "load_cv": 0.8545160681450069, + "normalized_load_entropy": 0.9371059892207799, + "max_load_share": 0.0989247311827957 + } + }, + "s1_bos": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "a6ab534e9d02429e509fc38ff5842419431277fef831be5cd63ab1f15e2a9321", + "route_weight_sha256": "8ed36771e300cab11f2ef564bf3aee9255e4e759198618b6d6383fcf47bc35c8", + "loads": [ + 3, + 5, + 13, + 16, + 6, + 2, + 8, + 24, + 14, + 15, + 2, + 3, + 4, + 18, + 12, + 7, + 15, + 2, + 9, + 5, + 16, + 22, + 2, + 9, + 5, + 11, + 1, + 20, + 13, + 5, + 15, + 28, + 4, + 8, + 15, + 2, + 3, + 6, + 19, + 9, + 9, + 3, + 7, + 8, + 28, + 9, + 7, + 13, + 4, + 28, + 2, + 92, + 23, + 15, + 12, + 21, + 6, + 24, + 3, + 33, + 1, + 4, + 17, + 15 + ], + "weighted_loads": [ + 0.09018640965223312, + 0.1543368436396122, + 0.5161092504858971, + 1.1062173079699278, + 0.21551346965134144, + 0.08453477919101715, + 0.30289048701524734, + 1.310551192611456, + 0.7151250205934048, + 0.5830609295517206, + 0.07432664558291435, + 0.18798434734344482, + 0.18241026252508163, + 0.63653264939785, + 0.806902090087533, + 0.2790873572230339, + 0.705520374700427, + 0.057428810745477676, + 0.49114395305514336, + 0.16056998260319233, + 0.990702522918582, + 1.3812846560031176, + 0.0919780395925045, + 0.3509874939918518, + 0.26559676229953766, + 0.7408122271299362, + 0.03288858011364937, + 0.8296943008899689, + 0.9628668949007988, + 0.33433904126286507, + 0.8717948943376541, + 3.008836407214403, + 0.1162082739174366, + 0.33602659963071346, + 1.795032549649477, + 0.1203131303191185, + 0.10613667964935303, + 0.19262231327593327, + 1.635244820266962, + 0.5213716682046652, + 0.3371202200651169, + 0.119207214564085, + 0.23219597712159157, + 0.27808549627661705, + 1.933702528476715, + 0.5420265793800354, + 0.2701242156326771, + 0.9199933558702469, + 0.12888902239501476, + 2.222892578691244, + 0.08565689995884895, + 5.361031571403146, + 1.5075140427798033, + 0.6561572812497616, + 0.6845646221190691, + 1.6502320319414139, + 0.24711700156331062, + 1.3541121054440737, + 0.15348541736602783, + 2.540360137820244, + 0.03508083149790764, + 0.1604544185101986, + 1.1128205936402082, + 0.7141344454139471 + ], + "unique_experts": 64, + "load_cv": 1.0479496903874579, + "normalized_load_entropy": 0.910561883267102, + "max_load_share": 0.11794871794871795 + }, + "full_input": { + "tokens": 171, + "top_k": 6, + "decisions": 1026, + "ordered_route_sha256": "7bd5f6b050b26617150e58071bf18a784f3e699500d1c587ab995c3d6806ba50", + "route_weight_sha256": "847ce767d8997724fb6467134adbd23e231172aa063ce937f129f702e5043429", + "loads": [ + 4, + 11, + 17, + 16, + 18, + 4, + 21, + 24, + 14, + 23, + 3, + 10, + 16, + 20, + 23, + 9, + 18, + 7, + 10, + 14, + 19, + 23, + 8, + 13, + 17, + 11, + 1, + 22, + 14, + 6, + 21, + 28, + 6, + 8, + 15, + 3, + 6, + 10, + 20, + 12, + 13, + 10, + 17, + 9, + 29, + 9, + 7, + 24, + 5, + 30, + 7, + 92, + 26, + 25, + 16, + 21, + 8, + 26, + 13, + 34, + 4, + 13, + 26, + 17 + ], + "weighted_loads": [ + 0.11154987290501595, + 0.6187194883823395, + 1.0191028714179993, + 1.1062173079699278, + 1.8840466924011707, + 0.1772652855142951, + 0.9333468759432435, + 1.310551192611456, + 0.7151250205934048, + 0.9483502004295588, + 0.1408705748617649, + 0.9149234555661678, + 0.8410950638353825, + 0.7145582176744938, + 1.7362043764442205, + 0.3871260918676853, + 1.099299656227231, + 0.28284143283963203, + 0.591017235070467, + 0.7751706521958113, + 1.2927951645106077, + 1.435886899009347, + 0.32601957954466343, + 0.4987718276679516, + 1.1090523824095726, + 0.7408122271299362, + 0.03288858011364937, + 0.9238158576190472, + 1.0000217780470848, + 0.3717920072376728, + 1.125210678204894, + 3.008836407214403, + 0.20194481126964092, + 0.33602659963071346, + 1.795032549649477, + 0.18475539982318878, + 0.22066650167107582, + 0.35518028028309345, + 1.6782661862671375, + 0.6657075136899948, + 0.4760619942098856, + 0.4480334743857384, + 0.9700047764927149, + 0.31550370529294014, + 1.9444212801754475, + 0.5420265793800354, + 0.2701242156326771, + 1.7320854626595974, + 0.1636748518794775, + 2.2985264733433723, + 0.4220992960035801, + 5.361031571403146, + 1.6533001400530338, + 1.4401236847043037, + 1.4546457324177027, + 1.6502320319414139, + 0.3270506151020527, + 1.442525403574109, + 0.7471255883574486, + 2.574929676949978, + 0.1913701742887497, + 0.5578505806624889, + 1.8394985143095255, + 0.8773683067411184 + ], + "unique_experts": 64, + "load_cv": 0.7673852678138285, + "normalized_load_entropy": 0.9474515114980001, + "max_load_share": 0.08966861598440545 + } + }, + "s0_x": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "1fad6df33a36d5aa0efd140d84f6122fe93e9100fc1978ae768cb99a0ad231a8", + "route_weight_sha256": "12bde0fa42a60a5c9742ec31d098e317e7e8b7ca2bca96cbbc941c19945e5ec7", + "loads": [ + 3, + 6, + 12, + 16, + 6, + 2, + 9, + 24, + 14, + 15, + 2, + 2, + 4, + 13, + 12, + 7, + 15, + 2, + 9, + 6, + 16, + 21, + 2, + 12, + 2, + 11, + 1, + 20, + 13, + 5, + 14, + 29, + 2, + 7, + 14, + 2, + 4, + 8, + 19, + 9, + 9, + 4, + 4, + 7, + 28, + 10, + 7, + 14, + 6, + 28, + 3, + 94, + 21, + 15, + 13, + 21, + 7, + 25, + 3, + 33, + 2, + 4, + 18, + 14 + ], + "weighted_loads": [ + 0.09155071154236794, + 0.1823966410011053, + 0.4773806966841221, + 1.1195491552352905, + 0.22196722403168678, + 0.08067409321665764, + 0.3374326042830944, + 1.2981619201600552, + 0.7045612204819918, + 0.5938254073262215, + 0.07462481781840324, + 0.15853628516197205, + 0.1752828061580658, + 0.47324029728770256, + 0.8014754336327314, + 0.2719271257519722, + 0.6956917308270931, + 0.06349221616983414, + 0.48107583075761795, + 0.18972449004650116, + 0.9702877383679152, + 1.3530062660574913, + 0.09410547092556953, + 0.436128132045269, + 0.16584112867712975, + 0.7364996559917927, + 0.031804442405700684, + 0.8205775786191225, + 0.9610095508396626, + 0.3325028233230114, + 0.8713423646986485, + 3.021170947700739, + 0.06220280006527901, + 0.30917868204414845, + 1.7257443368434906, + 0.11499377712607384, + 0.13503583893179893, + 0.26806080527603626, + 1.659000102430582, + 0.5262967441231012, + 0.33514382503926754, + 0.14680149406194687, + 0.12449093163013458, + 0.24159775860607624, + 1.9739991314709187, + 0.5885660424828529, + 0.2655412591993809, + 0.9597143121063709, + 0.18598862178623676, + 2.2215471230447292, + 0.12402921169996262, + 5.452863872051239, + 1.441178772598505, + 0.6774259544909, + 0.684288090094924, + 1.6388352997601032, + 0.27747811935842037, + 1.3943200279027224, + 0.15829048305749893, + 2.585372295230627, + 0.06967368349432945, + 0.16760389134287834, + 1.1631104052066803, + 0.7029593419283628 + ], + "unique_experts": 64, + "load_cv": 1.061414584621426, + "normalized_load_entropy": 0.9099800749364171, + "max_load_share": 0.12051282051282051 + }, + "full_input": { + "tokens": 155, + "top_k": 6, + "decisions": 930, + "ordered_route_sha256": "e0261320e9c611b86c7821eb0cdd9d7f28a10f15ec689d077fbabe82f23d361b", + "route_weight_sha256": "f2710bb087e2765f9042eb7127b96f4d08673472076b894207c637d32df13e4a", + "loads": [ + 5, + 9, + 14, + 16, + 11, + 4, + 20, + 24, + 14, + 19, + 2, + 3, + 14, + 14, + 18, + 7, + 18, + 2, + 9, + 10, + 16, + 21, + 8, + 18, + 10, + 11, + 1, + 22, + 13, + 9, + 20, + 29, + 2, + 7, + 14, + 3, + 4, + 13, + 20, + 11, + 13, + 6, + 13, + 8, + 29, + 10, + 7, + 20, + 7, + 29, + 3, + 94, + 21, + 18, + 19, + 21, + 7, + 25, + 10, + 33, + 4, + 8, + 26, + 14 + ], + "weighted_loads": [ + 0.17033625021576881, + 0.4745121728628874, + 0.8914268407970667, + 1.1195491552352905, + 1.0870921649038792, + 0.17549460660666227, + 0.8243210865184665, + 1.2981619201600552, + 0.7045612204819918, + 0.8298526294529438, + 0.07462481781840324, + 0.18915321677923203, + 0.8945219554007053, + 0.5125522501766682, + 1.3688965793699026, + 0.2719271257519722, + 0.8097472414374352, + 0.06349221616983414, + 0.48107583075761795, + 0.3617803007364273, + 0.9702877383679152, + 1.3530062660574913, + 0.3260828424245119, + 0.6659005545079708, + 0.6671207919716835, + 0.7364996559917927, + 0.031804442405700684, + 0.9032933991402388, + 0.9610095508396626, + 0.4949209988117218, + 1.1223606504499912, + 3.021170947700739, + 0.06220280006527901, + 0.30917868204414845, + 1.7257443368434906, + 0.1743147224187851, + 0.13503583893179893, + 0.4649155754595995, + 1.700514543801546, + 0.5926307123154402, + 0.4904460422694683, + 0.2658369392156601, + 0.8529486171901226, + 0.2990120891481638, + 1.984717883169651, + 0.5885660424828529, + 0.2655412591993809, + 1.501027949154377, + 0.2233241442590952, + 2.2494928557425737, + 0.12402921169996262, + 5.452863872051239, + 1.441178772598505, + 0.883432898670435, + 1.5129982698708773, + 1.6388352997601032, + 0.27747811935842037, + 1.3943200279027224, + 0.5758295524865389, + 2.585372295230627, + 0.17064173892140388, + 0.3918805606663227, + 1.7507736384868622, + 0.7029593419283628 + ], + "unique_experts": 64, + "load_cv": 0.8684311928601887, + "normalized_load_entropy": 0.9355700847340608, + "max_load_share": 0.1010752688172043 + } + }, + "s1_x": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "1e9beceeef3b50f48fff48077fbdab90e4b9fb94d24d2c4cfe3de72d45e2a69d", + "route_weight_sha256": "f35fb0875f33a67449e68d1a3878fd69733eecc85b7b93855430d56e34deef39", + "loads": [ + 3, + 5, + 11, + 16, + 6, + 2, + 8, + 24, + 15, + 16, + 2, + 2, + 4, + 14, + 12, + 7, + 17, + 2, + 12, + 5, + 16, + 23, + 2, + 9, + 3, + 10, + 1, + 20, + 13, + 5, + 15, + 28, + 5, + 7, + 14, + 2, + 3, + 8, + 20, + 6, + 9, + 3, + 4, + 10, + 27, + 9, + 7, + 14, + 5, + 28, + 3, + 88, + 21, + 17, + 12, + 22, + 8, + 24, + 3, + 35, + 2, + 4, + 19, + 13 + ], + "weighted_loads": [ + 0.0936575997620821, + 0.16145804151892662, + 0.45656867884099483, + 1.1283117085695267, + 0.21681145764887333, + 0.07939926534891129, + 0.30146919935941696, + 1.3012357857078314, + 0.7412160057574511, + 0.6071489602327347, + 0.07125161774456501, + 0.16528178751468658, + 0.1768656112253666, + 0.493479635566473, + 0.7937458287924528, + 0.28479808382689953, + 0.7435000613331795, + 0.062327517196536064, + 0.5853551160544157, + 0.1633755024522543, + 0.9804354291409254, + 1.4176231306046247, + 0.09415891021490097, + 0.3439042493700981, + 0.1916004754602909, + 0.7027446925640106, + 0.031224451959133148, + 0.8297860324382782, + 0.9461582452058792, + 0.32958605885505676, + 0.8446161635220051, + 2.9774475507438183, + 0.1434561051428318, + 0.307023236528039, + 1.7916920818388462, + 0.11884492263197899, + 0.10658736526966095, + 0.2466976959258318, + 1.6800674758851528, + 0.4254702068865299, + 0.33509697392582893, + 0.13078980892896652, + 0.12415028735995293, + 0.34483999386429787, + 1.8782754763960838, + 0.5444845445454121, + 0.2672683298587799, + 0.9332619048655033, + 0.16150088049471378, + 2.2182650212198496, + 0.11047463864088058, + 5.272267557680607, + 1.4531319309026003, + 0.7347028888761997, + 0.6842544861137867, + 1.6441175807267427, + 0.30113155394792557, + 1.3756901510059834, + 0.15445576794445515, + 2.609439082443714, + 0.06429131329059601, + 0.1674298383295536, + 1.1537346486002207, + 0.6599223427474499 + ], + "unique_experts": 64, + "load_cv": 1.0211053556178873, + "normalized_load_entropy": 0.9124195782139173, + "max_load_share": 0.11282051282051282 + }, + "full_input": { + "tokens": 171, + "top_k": 6, + "decisions": 1026, + "ordered_route_sha256": "45ef3435733983b40645ca18044717a4f3515f591949380cb6a753b10aba5f83", + "route_weight_sha256": "32be04bd30c49f822d39df4139a56b79d2127434e7af9dcbea26f5ce23065763", + "loads": [ + 5, + 12, + 14, + 16, + 18, + 5, + 22, + 24, + 15, + 22, + 3, + 9, + 19, + 14, + 24, + 9, + 20, + 8, + 13, + 12, + 19, + 24, + 9, + 13, + 14, + 10, + 1, + 22, + 14, + 6, + 20, + 28, + 8, + 7, + 14, + 2, + 5, + 11, + 21, + 8, + 12, + 11, + 15, + 10, + 28, + 9, + 7, + 25, + 6, + 30, + 8, + 88, + 24, + 27, + 16, + 22, + 10, + 26, + 14, + 36, + 4, + 14, + 29, + 15 + ], + "weighted_loads": [ + 0.16288754530251026, + 0.644756592810154, + 0.9239655453711748, + 1.1283117085695267, + 1.9246257804334164, + 0.2157164691016078, + 0.9525988223031163, + 1.3012357857078314, + 0.7412160057574511, + 0.8773704804480076, + 0.13779554702341557, + 0.8922208957374096, + 1.010573012754321, + 0.493479635566473, + 1.7839187067002058, + 0.39283681847155094, + 1.1372793428599834, + 0.32468499802052975, + 0.6852283980697393, + 0.5301496777683496, + 1.2825280707329512, + 1.4722253736108541, + 0.3627666924148798, + 0.4916885830461979, + 0.9025282915681601, + 0.7027446925640106, + 0.031224451959133148, + 0.9163268357515335, + 0.9833131283521652, + 0.3670390248298645, + 1.0547641050070524, + 2.9774475507438183, + 0.26578488759696484, + 0.307023236528039, + 1.7916920818388462, + 0.11884492263197899, + 0.18576523289084435, + 0.3428026307374239, + 1.7230888418853283, + 0.5278018694370985, + 0.4163521807640791, + 0.5002425797283649, + 1.0482881236821413, + 0.34483999386429787, + 1.8889942280948162, + 0.5444845445454121, + 0.2672683298587799, + 1.7911855168640614, + 0.19628670997917652, + 2.3015354964882135, + 0.4469170346856117, + 5.272267557680607, + 1.5989180281758308, + 1.492179624736309, + 1.4543355964124203, + 1.6441175807267427, + 0.38106516748666763, + 1.4641034491360188, + 0.7775941248983145, + 2.644008621573448, + 0.15717504173517227, + 0.6194267310202122, + 1.968091918155551, + 0.8231562040746212 + ], + "unique_experts": 64, + "load_cv": 0.7472347939000629, + "normalized_load_entropy": 0.9490219469218754, + "max_load_share": 0.08576998050682261 + } + }, + "s0_period": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "546ba2cebc25db5baca6601bf6a7225b724f38f5a65de3b3690fb3bcb5bcde20", + "route_weight_sha256": "26cc82673e055224788d8895f4787c8ca7d57dcde97c7aa8dc081d29d5e64af4", + "loads": [ + 4, + 6, + 12, + 16, + 6, + 2, + 7, + 24, + 13, + 14, + 2, + 2, + 4, + 14, + 13, + 8, + 17, + 2, + 10, + 5, + 16, + 21, + 2, + 12, + 3, + 11, + 1, + 21, + 14, + 6, + 15, + 29, + 2, + 9, + 15, + 2, + 5, + 8, + 19, + 8, + 8, + 3, + 5, + 5, + 28, + 9, + 9, + 13, + 4, + 28, + 3, + 92, + 22, + 15, + 11, + 21, + 7, + 24, + 4, + 34, + 1, + 4, + 16, + 14 + ], + "weighted_loads": [ + 0.12602460756897926, + 0.18367284536361694, + 0.48654498159885406, + 1.1270233895629644, + 0.22129981592297554, + 0.08365032449364662, + 0.2640799265354872, + 1.3126695696264505, + 0.6694226916879416, + 0.5542736556380987, + 0.07703314162790775, + 0.1643998771905899, + 0.179515078663826, + 0.5035704858601093, + 0.8261541351675987, + 0.30681964196264744, + 0.7577767763286829, + 0.06196841970086098, + 0.5137897916138172, + 0.16270625218749046, + 0.9809249304234982, + 1.3467667289078236, + 0.0947963260114193, + 0.4328354261815548, + 0.203818179666996, + 0.7429634965956211, + 0.031863629817962646, + 0.8637315202504396, + 1.0056971311569214, + 0.3657195642590523, + 0.8850620239973068, + 3.02128697745502, + 0.06199178285896778, + 0.372842401266098, + 1.7679223101586103, + 0.12468312680721283, + 0.16451352834701538, + 0.24963324517011642, + 1.6478780396282673, + 0.4887282531708479, + 0.3088765796273947, + 0.1175972018390894, + 0.1546772737056017, + 0.18331658840179443, + 1.9540405794978142, + 0.5555286221206188, + 0.3256441503763199, + 0.9217259399592876, + 0.12782850675284863, + 2.2178168185055256, + 0.12293066456913948, + 5.393317000940442, + 1.4638107754290104, + 0.6772136148065329, + 0.6250115744769573, + 1.6535081937909126, + 0.27949487045407295, + 1.370380375534296, + 0.18228153884410858, + 2.609508492052555, + 0.03417978808283806, + 0.1720929816365242, + 1.0859968066215515, + 0.7041662335395813 + ], + "unique_experts": 64, + "load_cv": 1.047849304852789, + "normalized_load_entropy": 0.9108023991342633, + "max_load_share": 0.11794871794871795 + }, + "full_input": { + "tokens": 155, + "top_k": 6, + "decisions": 930, + "ordered_route_sha256": "159818ae7da6fdc45d7d13c2ff58d16c96028828a94bf5349833ae9bcf806515", + "route_weight_sha256": "d3e947b5f0f19b18776a7d0208815994a613a26dfaf4ac73ed7f7c01128e3c06", + "loads": [ + 6, + 9, + 14, + 16, + 11, + 5, + 17, + 24, + 13, + 18, + 2, + 3, + 13, + 15, + 19, + 8, + 20, + 2, + 10, + 9, + 16, + 21, + 7, + 19, + 11, + 11, + 1, + 23, + 14, + 10, + 21, + 29, + 2, + 9, + 16, + 3, + 6, + 14, + 20, + 9, + 12, + 5, + 13, + 6, + 29, + 9, + 9, + 20, + 5, + 29, + 3, + 92, + 22, + 17, + 17, + 21, + 7, + 24, + 10, + 34, + 3, + 9, + 24, + 14 + ], + "weighted_loads": [ + 0.20555999130010605, + 0.4512557312846184, + 0.9054437186568975, + 1.1270233895629644, + 1.1034826375544071, + 0.2063451325520873, + 0.6948714638128877, + 1.3126695696264505, + 0.6694226916879416, + 0.8052557948976755, + 0.07703314162790775, + 0.19501680880784988, + 0.7724389620125294, + 0.5428824387490749, + 1.4030022956430912, + 0.30681964196264744, + 0.8718322869390249, + 0.06196841970086098, + 0.5137897916138172, + 0.33902692422270775, + 0.9809249304234982, + 1.3467667289078236, + 0.27677896060049534, + 0.6923231612890959, + 0.703963927924633, + 0.7429634965956211, + 0.031863629817962646, + 0.9523147996515036, + 1.0056971311569214, + 0.5281377397477627, + 1.1371298246085644, + 3.02128697745502, + 0.06199178285896778, + 0.372842401266098, + 1.831392539665103, + 0.1840040720999241, + 0.22124554961919785, + 0.4805833715945482, + 1.6893924809992313, + 0.5196765065193176, + 0.4633246287703514, + 0.23978457041084766, + 0.7402416747063398, + 0.240730918943882, + 1.9647593311965466, + 0.5555286221206188, + 0.3256441503763199, + 1.5322057008743286, + 0.16516402922570705, + 2.245462002232671, + 0.12293066456913948, + 5.393317000940442, + 1.4638107754290104, + 0.8822566922754049, + 1.4537217542529106, + 1.6535081937909126, + 0.27949487045407295, + 1.370380375534296, + 0.556980749592185, + 2.609508492052555, + 0.13380597159266472, + 0.49355895072221756, + 1.6659896560013294, + 0.7041662335395813 + ], + "unique_experts": 64, + "load_cv": 0.8540829823730718, + "normalized_load_entropy": 0.9368152463670141, + "max_load_share": 0.0989247311827957 + } + }, + "s1_period": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "ec6ed5e7d28047cdf5a53927e2fb026eb88ff4ad2ffd9278f4709b5aee0f0c54", + "route_weight_sha256": "b5f751aa959b1d42f7ad3e593a41e3391ba6e01749b45ba50ac42483c2609a68", + "loads": [ + 4, + 5, + 14, + 16, + 6, + 2, + 7, + 24, + 15, + 15, + 3, + 2, + 4, + 14, + 12, + 8, + 14, + 2, + 10, + 5, + 16, + 23, + 2, + 10, + 3, + 11, + 1, + 21, + 13, + 5, + 14, + 27, + 4, + 9, + 15, + 2, + 3, + 6, + 19, + 8, + 9, + 5, + 5, + 10, + 28, + 10, + 7, + 14, + 3, + 28, + 2, + 88, + 22, + 16, + 12, + 21, + 7, + 23, + 5, + 34, + 1, + 4, + 19, + 13 + ], + "weighted_loads": [ + 0.11932159587740898, + 0.15912875533103943, + 0.5550174228847027, + 1.1228193677961826, + 0.2163629699498415, + 0.07998660951852798, + 0.26239369437098503, + 1.3107675574719906, + 0.7601418066769838, + 0.5626941788941622, + 0.11159308440983295, + 0.1672198325395584, + 0.17945467308163643, + 0.48003075271844864, + 0.790168572217226, + 0.31746263802051544, + 0.6580707374960184, + 0.056216614320874214, + 0.5190158169716597, + 0.1630390603095293, + 0.9931797776371241, + 1.4202919825911522, + 0.09364383295178413, + 0.3730866815894842, + 0.18214886635541916, + 0.7372774351388216, + 0.031526632606983185, + 0.8594820536673069, + 0.9532595705240965, + 0.3239444140344858, + 0.7965973988175392, + 2.9558247718960047, + 0.12349772825837135, + 0.3687725830823183, + 1.8233707770705223, + 0.12097122147679329, + 0.10644269362092018, + 0.1931781880557537, + 1.6288205832242966, + 0.4855643790215254, + 0.34099503979086876, + 0.20104005187749863, + 0.16757718287408352, + 0.34965635277330875, + 1.9261122345924377, + 0.5901474840939045, + 0.2684029322117567, + 0.9450194574892521, + 0.1025637537240982, + 2.194525722414255, + 0.08270888030529022, + 5.289667529985309, + 1.4822651091963053, + 0.6920529566705227, + 0.6633180622011423, + 1.6153060030192137, + 0.27648409456014633, + 1.3412694428116083, + 0.22173348627984524, + 2.6331240870058537, + 0.03278646245598793, + 0.16604769974946976, + 1.152446761727333, + 0.660825977101922 + ], + "unique_experts": 64, + "load_cv": 1.0136608004048735, + "normalized_load_entropy": 0.9139689514371692, + "max_load_share": 0.11282051282051282 + }, + "full_input": { + "tokens": 171, + "top_k": 6, + "decisions": 1026, + "ordered_route_sha256": "a0ad958f44bbf12bc6b43270ce71dd09335d0c99f2921be25f2cd5c571f08a71", + "route_weight_sha256": "02e7a61880277450a685bea534dba18c3461a26f3c74846b03abf88331c346f7", + "loads": [ + 5, + 11, + 17, + 16, + 18, + 5, + 20, + 24, + 15, + 21, + 4, + 9, + 18, + 14, + 25, + 10, + 18, + 7, + 11, + 13, + 19, + 24, + 8, + 14, + 12, + 11, + 1, + 23, + 14, + 6, + 19, + 27, + 6, + 9, + 16, + 2, + 5, + 8, + 20, + 11, + 12, + 14, + 17, + 10, + 29, + 10, + 7, + 26, + 4, + 30, + 7, + 88, + 25, + 27, + 16, + 21, + 9, + 25, + 15, + 35, + 4, + 15, + 29, + 15 + ], + "weighted_loads": [ + 0.1406850591301918, + 0.5875434912741184, + 1.0069130584597588, + 1.1228193677961826, + 1.8950596787035465, + 0.22355405148118734, + 0.8844214351847768, + 1.3107675574719906, + 0.7601418066769838, + 0.851164972409606, + 0.1781370136886835, + 0.8941589407622814, + 0.9217791631817818, + 0.48003075271844864, + 1.7749183811247349, + 0.42550137266516685, + 1.0800180174410343, + 0.28162923641502857, + 0.6188890989869833, + 0.5761499609798193, + 1.2952724192291498, + 1.4748942255973816, + 0.32768537290394306, + 0.520871015265584, + 0.8036052733659744, + 0.7372774351388216, + 0.031526632606983185, + 0.9482780545949936, + 0.9904144536703825, + 0.36139738000929356, + 1.008725693449378, + 2.9558247718960047, + 0.20923426561057568, + 0.3687725830823183, + 1.8891156911849976, + 0.12097122147679329, + 0.18562056124210358, + 0.25510050170123577, + 1.671841949224472, + 0.6293188445270061, + 0.446597034111619, + 0.6383434981107712, + 0.9683619737625122, + 0.34965635277330875, + 1.9368309862911701, + 0.5901474840939045, + 0.2684029322117567, + 1.892852570861578, + 0.13734958320856094, + 2.282866023480892, + 0.41915127635002136, + 5.289667529985309, + 1.6280512064695358, + 1.520242366939783, + 1.4333991724997759, + 1.6153060030192137, + 0.3564177080988884, + 1.4296827409416437, + 0.8049242924898863, + 2.6676936261355877, + 0.17434652149677277, + 0.6557950042188168, + 1.9196367636322975, + 0.8240598384290934 + ], + "unique_experts": 64, + "load_cv": 0.7461763222736396, + "normalized_load_entropy": 0.948931084467087, + "max_load_share": 0.08576998050682261 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 130, + "ordered_topk_exact_tokens": 90, + "set_exact_tokens": 105, + "mean_set_jaccard": 0.9450549450549451, + "mean_token_weighted_tv": 0.010897595707613688, + "aggregate_load_tv": 0.017948717948717954 + }, + "system_bos": { + "tokens": 130, + "ordered_topk_exact_tokens": 79, + "set_exact_tokens": 93, + "mean_set_jaccard": 0.9170329670329671, + "mean_token_weighted_tv": 0.014750947423565846, + "aggregate_load_tv": 0.03333333333333333 + }, + "system_x": { + "tokens": 130, + "ordered_topk_exact_tokens": 73, + "set_exact_tokens": 87, + "mean_set_jaccard": 0.9021978021978022, + "mean_token_weighted_tv": 0.018081770565074224, + "aggregate_load_tv": 0.033333333333333326 + }, + "system_period": { + "tokens": 130, + "ordered_topk_exact_tokens": 73, + "set_exact_tokens": 90, + "mean_set_jaccard": 0.9054945054945055, + "mean_token_weighted_tv": 0.01854753288655327, + "aggregate_load_tv": 0.03333333333333333 + }, + "bos_at_s0": { + "tokens": 130, + "ordered_topk_exact_tokens": 78, + "set_exact_tokens": 90, + "mean_set_jaccard": 0.9120879120879122, + "mean_token_weighted_tv": 0.0157123570688642, + "aggregate_load_tv": 0.029487179487179487 + }, + "bos_at_s1": { + "tokens": 130, + "ordered_topk_exact_tokens": 79, + "set_exact_tokens": 90, + "mean_set_jaccard": 0.9104395604395604, + "mean_token_weighted_tv": 0.016707131818223458, + "aggregate_load_tv": 0.02564102564102564 + }, + "x_at_s0": { + "tokens": 130, + "ordered_topk_exact_tokens": 76, + "set_exact_tokens": 86, + "mean_set_jaccard": 0.9016483516483516, + "mean_token_weighted_tv": 0.017600364338320035, + "aggregate_load_tv": 0.033333333333333326 + }, + "x_at_s1": { + "tokens": 130, + "ordered_topk_exact_tokens": 66, + "set_exact_tokens": 77, + "mean_set_jaccard": 0.881868131868132, + "mean_token_weighted_tv": 0.020952925816751445, + "aggregate_load_tv": 0.03589743589743589 + }, + "period_at_s0": { + "tokens": 130, + "ordered_topk_exact_tokens": 81, + "set_exact_tokens": 90, + "mean_set_jaccard": 0.9104395604395604, + "mean_token_weighted_tv": 0.015969489658108123, + "aggregate_load_tv": 0.033333333333333326 + }, + "period_at_s1": { + "tokens": 130, + "ordered_topk_exact_tokens": 71, + "set_exact_tokens": 82, + "mean_set_jaccard": 0.8928571428571429, + "mean_token_weighted_tv": 0.02029766346542881, + "aggregate_load_tv": 0.0346153846153846 + } + } + }, + "layer_20": { + "layer": 20, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "8d996be28a9f0494ff9ed9ab530a69f438726c775999ae3f16a0e6f61ad9769a", + "route_weight_sha256": "532d420a8d0606591f6770784b3737f8b3c5c83553aa68ea7035c8cbb7531ccf", + "loads": [ + 19, + 25, + 11, + 17, + 0, + 34, + 25, + 12, + 5, + 11, + 9, + 53, + 16, + 11, + 11, + 6, + 0, + 12, + 8, + 31, + 9, + 19, + 9, + 15, + 30, + 8, + 33, + 4, + 10, + 13, + 3, + 5, + 1, + 6, + 5, + 6, + 5, + 0, + 9, + 1, + 4, + 3, + 26, + 5, + 6, + 11, + 46, + 8, + 9, + 8, + 2, + 10, + 3, + 9, + 18, + 8, + 17, + 10, + 19, + 19, + 1, + 9, + 15, + 7 + ], + "weighted_loads": [ + 0.7780985105782747, + 0.9551750104874372, + 0.5210117008537054, + 0.9455201495438814, + 0.0, + 2.7781784627586603, + 2.4586512707173824, + 0.4699924625456333, + 0.2753436490893364, + 0.9712519124150276, + 0.41586779803037643, + 3.6307053677737713, + 1.3787748124450445, + 0.8357083648443222, + 0.43278222531080246, + 0.2501756325364113, + 0.0, + 0.49505373276770115, + 0.3398734778165817, + 1.993725024163723, + 0.3203599192202091, + 1.0869081895798445, + 0.7671633884310722, + 0.8426893949508667, + 2.1855322755873203, + 0.2848857566714287, + 1.357650587335229, + 0.22124266624450684, + 0.9090095069259405, + 0.3688712399452925, + 0.1191939190030098, + 0.139072448015213, + 0.031431831419467926, + 0.40286462008953094, + 0.17315353080630302, + 0.4377109445631504, + 0.183616004884243, + 0.0, + 0.2844138853251934, + 0.024917855858802795, + 0.16740288212895393, + 0.19634903222322464, + 1.9468949064612389, + 0.5194866061210632, + 0.22140874899923801, + 0.6889651753008366, + 2.83092388138175, + 0.3389887288212776, + 0.34252551570534706, + 0.3035505637526512, + 0.06699009239673615, + 0.4408774860203266, + 0.10001573339104652, + 0.35759017802774906, + 1.0058036539703608, + 0.2893797289580107, + 0.6847190856933594, + 0.4364397469907999, + 0.7684073112905025, + 0.9269944038242102, + 0.04362303391098976, + 0.3587190452963114, + 0.8181401081383228, + 0.31345573626458645 + ], + "unique_experts": 61, + "load_cv": 0.8663935239428132, + "normalized_load_entropy": 0.9204193385208812, + "max_load_share": 0.06794871794871794 + }, + "full_input": { + "tokens": 155, + "top_k": 6, + "decisions": 930, + "ordered_route_sha256": "a9541960fa463c6365e98808423b9a77d5242714de043f8896607af69bf872cc", + "route_weight_sha256": "b5793a1fe2093a5f5c718ef43e1030a47b5c601892b1384664655294afd19482", + "loads": [ + 19, + 27, + 11, + 25, + 8, + 37, + 30, + 18, + 5, + 11, + 10, + 54, + 20, + 11, + 11, + 10, + 4, + 12, + 19, + 31, + 14, + 19, + 16, + 15, + 30, + 16, + 34, + 4, + 10, + 16, + 3, + 5, + 1, + 7, + 6, + 6, + 8, + 2, + 11, + 1, + 5, + 5, + 28, + 7, + 16, + 11, + 46, + 8, + 12, + 8, + 10, + 10, + 3, + 16, + 18, + 11, + 17, + 15, + 19, + 19, + 14, + 12, + 16, + 7 + ], + "weighted_loads": [ + 0.7780985105782747, + 0.9998422227799892, + 0.5210117008537054, + 1.5414313171058893, + 0.4030224122107029, + 2.9013972226530313, + 2.611596843227744, + 0.8324825391173363, + 0.2753436490893364, + 0.9712519124150276, + 0.44417529925704, + 3.6785628832876682, + 1.4889843240380287, + 0.8357083648443222, + 0.43278222531080246, + 0.41661179438233376, + 0.12087271176278591, + 0.49505373276770115, + 1.2677937895059586, + 1.993725024163723, + 0.4605404881294817, + 1.0869081895798445, + 1.159235056489706, + 0.8426893949508667, + 2.1855322755873203, + 0.9278757870197296, + 1.3750829342752695, + 0.22124266624450684, + 0.9090095069259405, + 0.4679200854152441, + 0.1191939190030098, + 0.139072448015213, + 0.031431831419467926, + 0.42597860284149647, + 0.21764716878533363, + 0.4377109445631504, + 0.6715789549052715, + 0.0574671383947134, + 1.6034492067992687, + 0.024917855858802795, + 0.2217453196644783, + 0.2751639299094677, + 2.146321564912796, + 0.5581355517497286, + 0.5532246083021164, + 0.6889651753008366, + 2.83092388138175, + 0.3389887288212776, + 0.4069942032219842, + 0.3035505637526512, + 1.4882367253303528, + 0.4408774860203266, + 0.10001573339104652, + 0.8284952323883772, + 1.0058036539703608, + 0.7963718120008707, + 0.6847190856933594, + 0.5967073105275631, + 0.7684073112905025, + 0.9269944038242102, + 1.344512056442909, + 0.5319954212754965, + 0.8536832481622696, + 0.31345573626458645 + ], + "unique_experts": 64, + "load_cv": 0.7130937645759629, + "normalized_load_entropy": 0.9452149785801632, + "max_load_share": 0.05806451612903226 + } + }, + "s1_eos": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "98c02b3782bb9ecdc8fc27a063024f3ede0b9d6a7247e673e8962bebdf6e094f", + "route_weight_sha256": "5eafa43511aa39a447c2b2d01fda93c4037bf3e89f63f3fd9536da5957abacc5", + "loads": [ + 19, + 25, + 11, + 18, + 1, + 33, + 25, + 9, + 5, + 11, + 9, + 52, + 16, + 11, + 11, + 4, + 0, + 10, + 9, + 31, + 9, + 19, + 9, + 15, + 30, + 9, + 35, + 4, + 10, + 10, + 2, + 5, + 1, + 7, + 6, + 6, + 4, + 0, + 10, + 3, + 5, + 3, + 27, + 4, + 8, + 12, + 46, + 8, + 9, + 8, + 2, + 10, + 3, + 8, + 17, + 7, + 18, + 9, + 20, + 19, + 2, + 9, + 15, + 7 + ], + "weighted_loads": [ + 0.7844469714909792, + 0.961738308891654, + 0.5133772268891335, + 0.9863590449094772, + 0.0339030921459198, + 2.7359564304351807, + 2.477980073541403, + 0.378836490213871, + 0.2764858491718769, + 0.9792024120688438, + 0.4166689086705446, + 3.5882994402199984, + 1.395673494786024, + 0.8195936102420092, + 0.41693302243947983, + 0.18446459248661995, + 0.0, + 0.4407000448554754, + 0.3807779774069786, + 1.9821727685630322, + 0.32722312584519386, + 1.0783195439726114, + 0.765032147988677, + 0.8433068357408047, + 2.1910483986139297, + 0.31091128662228584, + 1.4192674588412046, + 0.21738090366125107, + 0.9056927058845758, + 0.28844412975013256, + 0.09001640230417252, + 0.13900617510080338, + 0.03189997747540474, + 0.4372143894433975, + 0.1981575470417738, + 0.4338134452700615, + 0.15346025116741657, + 0.0, + 0.31956982985138893, + 0.08049856685101986, + 0.20847472175955772, + 0.20121513307094574, + 1.978003140538931, + 0.4748074561357498, + 0.2847713213413954, + 0.7123071756213903, + 2.8669886738061905, + 0.3314521797001362, + 0.33238751254975796, + 0.2977766878902912, + 0.06770019233226776, + 0.4464757461100817, + 0.09804429113864899, + 0.32821279391646385, + 0.9860357195138931, + 0.2591942623257637, + 0.7163744885474443, + 0.39972873590886593, + 0.7904840111732483, + 0.9298662152141333, + 0.07137065194547176, + 0.35494193248450756, + 0.7990809492766857, + 0.31434217654168606 + ], + "unique_experts": 62, + "load_cv": 0.8645703671706614, + "normalized_load_entropy": 0.9220759973411143, + "max_load_share": 0.06666666666666667 + }, + "full_input": { + "tokens": 171, + "top_k": 6, + "decisions": 1026, + "ordered_route_sha256": "236930dbdb9b58e79f5db153aef2509977721bca5f13184c96a070ae26ce620a", + "route_weight_sha256": "8ce13129f15de9a3a2a330c95fa0446c72f4ec773d37f03a77fd5138dbbaf51b", + "loads": [ + 24, + 27, + 11, + 29, + 9, + 38, + 27, + 18, + 5, + 13, + 12, + 52, + 18, + 12, + 12, + 15, + 7, + 10, + 20, + 32, + 14, + 20, + 20, + 17, + 31, + 23, + 36, + 6, + 10, + 16, + 2, + 6, + 2, + 7, + 9, + 8, + 8, + 6, + 13, + 7, + 8, + 4, + 29, + 9, + 22, + 13, + 46, + 8, + 11, + 13, + 15, + 10, + 3, + 17, + 18, + 18, + 20, + 16, + 22, + 22, + 16, + 11, + 16, + 7 + ], + "weighted_loads": [ + 1.017024528235197, + 1.0059331748634577, + 0.5133772268891335, + 1.7593768909573555, + 0.4412196949124336, + 2.9350601881742477, + 2.5486563686281443, + 0.9480712730437517, + 0.2764858491718769, + 1.2156909480690956, + 0.542687801644206, + 3.5882994402199984, + 1.459084240719676, + 1.1030534226447344, + 0.47714582830667496, + 0.8126465156674385, + 0.3628433123230934, + 0.4407000448554754, + 1.424810603260994, + 2.0180180221796036, + 0.46880561695434153, + 1.1118932869285345, + 1.4321673084050417, + 1.0160965584218502, + 2.2110048215836287, + 1.3450529761612415, + 1.4366998057812452, + 0.2777957245707512, + 0.9056927058845758, + 0.48507941886782646, + 0.09001640230417252, + 0.16925545036792755, + 0.07853681966662407, + 0.4372143894433975, + 0.34469154849648476, + 0.6092790924012661, + 0.6889929845929146, + 0.2175478097051382, + 1.6764280274510384, + 0.2793693523854017, + 0.3477843552827835, + 0.25504209846258163, + 2.1717880703508854, + 0.6615197968203574, + 1.1184902973473072, + 0.7853467222303152, + 2.8669886738061905, + 0.3314521797001362, + 0.36732235504314303, + 0.6091735027730465, + 2.0974193774163723, + 0.4464757461100817, + 0.09804429113864899, + 0.8879095613956451, + 1.0129112284630537, + 1.386202648282051, + 0.8008639086037874, + 0.9367332793772221, + 0.8671504780650139, + 1.0110054276883602, + 1.507223156047985, + 0.4425041750073433, + 0.8600352257490158, + 0.31434217654168606 + ], + "unique_experts": 64, + "load_cv": 0.6320089744841368, + "normalized_load_entropy": 0.955892119279354, + "max_load_share": 0.050682261208576995 + } + }, + "s0_bos": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "c137c06843e1f86021c5387c3cc9c4f164c85aa3824ff011668a43ee70bb4f88", + "route_weight_sha256": "05026705772e851ccc84b0774ea5f68b52cd5f4f5221d972c088c0e3861b1ae8", + "loads": [ + 19, + 25, + 11, + 18, + 2, + 35, + 25, + 11, + 5, + 11, + 8, + 54, + 18, + 12, + 11, + 6, + 0, + 11, + 7, + 30, + 8, + 19, + 9, + 15, + 30, + 9, + 33, + 5, + 9, + 12, + 2, + 8, + 1, + 6, + 3, + 7, + 6, + 0, + 8, + 2, + 4, + 3, + 26, + 4, + 7, + 11, + 46, + 8, + 9, + 7, + 2, + 10, + 3, + 9, + 17, + 8, + 16, + 10, + 17, + 19, + 1, + 11, + 15, + 6 + ], + "weighted_loads": [ + 0.7733170129358768, + 0.9657016973942518, + 0.522453598678112, + 0.9770906046032906, + 0.06371446698904037, + 2.8392081446945667, + 2.438772324472666, + 0.4384091030806303, + 0.26741505041718483, + 0.9818478375673294, + 0.3806330133229494, + 3.6679615508764982, + 1.4438503123819828, + 0.869244085624814, + 0.4302426837384701, + 0.24935711547732353, + 0.0, + 0.46287614665925503, + 0.3111376967281103, + 1.985746867954731, + 0.28883866034448147, + 1.0913858842104673, + 0.7729227878153324, + 0.8525302223861217, + 2.1826071701943874, + 0.32164354622364044, + 1.3689781595021486, + 0.24272063933312893, + 0.8850949071347713, + 0.33604315109550953, + 0.08738228678703308, + 0.22928936779499054, + 0.030499769374728203, + 0.44426327757537365, + 0.1157977283000946, + 0.45780283957719803, + 0.21126047149300575, + 0.0, + 0.26342198997735977, + 0.054171254858374596, + 0.16679965518414974, + 0.2007608860731125, + 1.9592625182121992, + 0.4805535785853863, + 0.2478100322186947, + 0.6901859939098358, + 2.9073221683502197, + 0.33591675758361816, + 0.3417219799011946, + 0.2795867770910263, + 0.07542429119348526, + 0.4340841490775347, + 0.10584366135299206, + 0.3863127622753382, + 0.9897987358272076, + 0.2979069799184799, + 0.6294450107961893, + 0.45163579657673836, + 0.6743535064160824, + 0.9266110360622406, + 0.0439271479845047, + 0.4174450021237135, + 0.8251106385141611, + 0.2812167387455702 + ], + "unique_experts": 62, + "load_cv": 0.8685762606579613, + "normalized_load_entropy": 0.9217955458346447, + "max_load_share": 0.06923076923076923 + }, + "full_input": { + "tokens": 155, + "top_k": 6, + "decisions": 930, + "ordered_route_sha256": "d9acfa9df9041e816ee0aaad179059ad42d74f30f9e14893bd51c7883d888a26", + "route_weight_sha256": "8993feb663a8e4f5e3af6b90726b7ace25c4741b88a82b2731f6725bdffb0091", + "loads": [ + 19, + 26, + 11, + 26, + 10, + 38, + 30, + 17, + 5, + 11, + 9, + 55, + 22, + 12, + 11, + 11, + 3, + 11, + 18, + 30, + 12, + 19, + 17, + 15, + 30, + 18, + 36, + 5, + 9, + 15, + 3, + 9, + 1, + 7, + 4, + 7, + 9, + 2, + 9, + 2, + 5, + 5, + 28, + 6, + 17, + 11, + 47, + 9, + 11, + 7, + 10, + 10, + 3, + 16, + 17, + 11, + 16, + 14, + 17, + 19, + 13, + 13, + 15, + 6 + ], + "weighted_loads": [ + 0.7733170129358768, + 0.9898090176284313, + 0.522453598678112, + 1.5730017721652985, + 0.46673687919974327, + 2.976379469037056, + 2.5917178969830275, + 0.7786177191883326, + 0.26741505041718483, + 0.9818478375673294, + 0.4105009436607361, + 4.369127346202731, + 1.554059823974967, + 0.869244085624814, + 0.4302426837384701, + 0.5118981301784515, + 0.09504924342036247, + 0.46287614665925503, + 1.2378619741648436, + 1.985746867954731, + 0.4336970802396536, + 1.0913858842104673, + 1.2249637320637703, + 0.8525302223861217, + 2.1826071701943874, + 0.9912408255040646, + 1.4688595179468393, + 0.24272063933312893, + 0.8850949071347713, + 0.4368759822100401, + 0.1266620196402073, + 0.24119076039642096, + 0.030499769374728203, + 0.4673772603273392, + 0.158159788697958, + 0.45780283957719803, + 0.6907272264361382, + 0.0574671383947134, + 0.6281590536236763, + 0.054171254858374596, + 0.21295957081019878, + 0.25653393659740686, + 2.1569428127259016, + 0.5994567759335041, + 0.5761670265346766, + 0.6901859939098358, + 3.048129826784134, + 0.3464105287566781, + 0.40731860883533955, + 0.2795867770910263, + 1.5321546532213688, + 0.4340841490775347, + 0.10584366135299206, + 0.8153961915522814, + 0.9897987358272076, + 0.8061267547309399, + 0.6294450107961893, + 0.5736511629074812, + 0.6743535064160824, + 0.9266110360622406, + 1.3455562889575958, + 0.5519915800541639, + 0.8251106385141611, + 0.2812167387455702 + ], + "unique_experts": 64, + "load_cv": 0.7243162719014684, + "normalized_load_entropy": 0.944531769354687, + "max_load_share": 0.05913978494623656 + } + }, + "s1_bos": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "ee56ecedbf5442d2df06d092a848b39ebbceb3d13de1687124b80999d27106b1", + "route_weight_sha256": "ca051ec25aefcf89e38b3be008ea9187f29a82e502da65d8b2d191af408d4b10", + "loads": [ + 17, + 25, + 10, + 19, + 2, + 34, + 25, + 11, + 5, + 11, + 8, + 53, + 16, + 12, + 11, + 5, + 0, + 12, + 5, + 29, + 9, + 19, + 9, + 16, + 30, + 9, + 36, + 4, + 10, + 11, + 2, + 7, + 1, + 6, + 5, + 8, + 6, + 0, + 8, + 2, + 4, + 3, + 27, + 4, + 8, + 11, + 46, + 8, + 8, + 7, + 2, + 10, + 3, + 8, + 17, + 8, + 16, + 10, + 19, + 20, + 1, + 10, + 16, + 6 + ], + "weighted_loads": [ + 0.7166340313851833, + 0.9710690379142761, + 0.4775907080620527, + 1.0070098489522934, + 0.06754612550139427, + 2.7494545709341764, + 2.459877461194992, + 0.4300087057054043, + 0.27751441299915314, + 0.9872926808893681, + 0.3842332009226084, + 3.6949033066630363, + 1.4168381243944168, + 0.8530565537512302, + 0.41754561476409435, + 0.2212774194777012, + 0.0, + 0.4919172041118145, + 0.26436798833310604, + 1.9231909271329641, + 0.32600596360862255, + 1.0924738328903913, + 0.7634278386831284, + 0.8739857748150826, + 2.1669596284627914, + 0.31156746856868267, + 1.4781438317149878, + 0.21726979687809944, + 0.9062666017562151, + 0.30758183263242245, + 0.08999816700816154, + 0.19049296155571938, + 0.031315408647060394, + 0.4529112409800291, + 0.16777740977704525, + 0.4676733538508415, + 0.2028869427740574, + 0.0, + 0.2826292756944895, + 0.0536330696195364, + 0.16963902115821838, + 0.2040964923799038, + 1.9886022116988897, + 0.4772672578692436, + 0.28038416244089603, + 0.6879621669650078, + 2.909103475511074, + 0.3391207233071327, + 0.30871501564979553, + 0.265596030279994, + 0.07827413827180862, + 0.4371747709810734, + 0.10756923817098141, + 0.342994874343276, + 0.9747604206204414, + 0.2929668612778187, + 0.616957388818264, + 0.44918899051845074, + 0.7524248547852039, + 0.9910314865410328, + 0.04105747118592262, + 0.3745623305439949, + 0.8466638755053282, + 0.29080734960734844 + ], + "unique_experts": 62, + "load_cv": 0.87111587434461, + "normalized_load_entropy": 0.9211502176943611, + "max_load_share": 0.06794871794871794 + }, + "full_input": { + "tokens": 171, + "top_k": 6, + "decisions": 1026, + "ordered_route_sha256": "45f09e8cef1423a84ec3f62450ef452453d8b9ec7c61d8fdec6388b5a7fbe346", + "route_weight_sha256": "290d4d569908eda273e617c9f20a78668ce78a26e8cc9d1c6f2f8fda15e4ce58", + "loads": [ + 21, + 26, + 10, + 30, + 10, + 40, + 27, + 19, + 5, + 13, + 11, + 53, + 18, + 13, + 12, + 17, + 6, + 12, + 16, + 30, + 15, + 20, + 21, + 18, + 31, + 23, + 39, + 6, + 10, + 16, + 2, + 8, + 2, + 6, + 7, + 10, + 10, + 6, + 10, + 7, + 9, + 6, + 29, + 9, + 22, + 12, + 46, + 8, + 8, + 12, + 15, + 10, + 3, + 19, + 18, + 19, + 17, + 17, + 20, + 23, + 14, + 11, + 17, + 6 + ], + "weighted_loads": [ + 0.9126759488135576, + 0.9951763581484556, + 0.4775907080620527, + 1.7800276950001717, + 0.4748627282679081, + 3.0117636006325483, + 2.5305537562817335, + 0.9515498019754887, + 0.27751441299915314, + 1.2237812168896198, + 0.5103868748992682, + 3.6949033066630363, + 1.4802488703280687, + 1.1365163661539555, + 0.4777584206312895, + 0.9292706027626991, + 0.3435567058622837, + 0.4919172041118145, + 1.3082978334277868, + 1.9590361807495356, + 0.5450858790427446, + 1.1260475758463144, + 1.4714079834520817, + 1.046775497496128, + 2.1869160514324903, + 1.3112706169486046, + 1.5808667819947004, + 0.27768461778759956, + 0.9062666017562151, + 0.4553591422736645, + 0.08999816700816154, + 0.22074223682284355, + 0.07795225083827972, + 0.4529112409800291, + 0.24579500779509544, + 0.6431390009820461, + 0.7419601622968912, + 0.22624586708843708, + 0.6888014953583479, + 0.31174696423113346, + 0.37107149697840214, + 0.3328767530620098, + 2.177987454459071, + 0.7460529841482639, + 1.1218159794807434, + 0.7610017135739326, + 2.909103475511074, + 0.3391207233071327, + 0.30871501564979553, + 0.5917159747332335, + 2.160120777785778, + 0.4371747709810734, + 0.10756923817098141, + 0.8978596832603216, + 1.001635929569602, + 1.4564440064132214, + 0.6618526093661785, + 0.9861935339868069, + 0.7906738929450512, + 1.0721706990152597, + 1.479722486808896, + 0.4350479282438755, + 0.9076181519776583, + 0.29080734960734844 + ], + "unique_experts": 64, + "load_cv": 0.641272209043909, + "normalized_load_entropy": 0.9552827688110962, + "max_load_share": 0.05165692007797271 + } + }, + "s0_x": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "48d4ffb962d3106f57cea909d74a78863c188a2d97abb772e7370587cad3bad5", + "route_weight_sha256": "2be766b4c1b3defedf27285d07a7b2f13cfbe1bf8b5e0eb3abcfcd31ce584902", + "loads": [ + 17, + 26, + 10, + 18, + 2, + 34, + 26, + 10, + 5, + 11, + 8, + 52, + 17, + 12, + 11, + 4, + 0, + 11, + 6, + 32, + 8, + 19, + 9, + 15, + 31, + 11, + 34, + 4, + 10, + 14, + 5, + 8, + 1, + 6, + 3, + 7, + 6, + 0, + 10, + 0, + 4, + 3, + 26, + 5, + 7, + 11, + 45, + 9, + 8, + 7, + 2, + 10, + 3, + 10, + 17, + 8, + 15, + 10, + 17, + 19, + 1, + 10, + 14, + 6 + ], + "weighted_loads": [ + 0.7010249961167574, + 0.983352042734623, + 0.4933253787457943, + 0.9802808500826359, + 0.07001569122076035, + 2.802642261609435, + 2.485504399985075, + 0.4079756885766983, + 0.2823830880224705, + 0.9940946325659752, + 0.3809880744665861, + 3.50755881331861, + 1.4491090960800648, + 0.8751456532627344, + 0.42733162455260754, + 0.177744060754776, + 0.0, + 0.46751878410577774, + 0.28092586249113083, + 2.0556604973971844, + 0.2862739935517311, + 1.0866218991577625, + 0.7580833155661821, + 0.8446242325007915, + 2.1901979632675648, + 0.36337816901504993, + 1.3534635063260794, + 0.21070575714111328, + 0.9092651642858982, + 0.3941290248185396, + 0.17278295941650867, + 0.22654781304299831, + 0.031154422089457512, + 0.44179725646972656, + 0.11227362416684628, + 0.4623006694018841, + 0.20582841895520687, + 0.0, + 0.32665279507637024, + 0.0, + 0.16505100019276142, + 0.1934746317565441, + 1.9706936404109001, + 0.5179010387510061, + 0.2643297705799341, + 0.6880725435912609, + 2.837506737560034, + 0.3552895486354828, + 0.30555637553334236, + 0.2793797515332699, + 0.08050736412405968, + 0.43731582164764404, + 0.11434015817940235, + 0.4244032856076956, + 0.9726736154407263, + 0.29755546897649765, + 0.6025635506957769, + 0.4511274266988039, + 0.6861158832907677, + 0.9238761868327856, + 0.040309615433216095, + 0.3840068969875574, + 0.7958357855677605, + 0.2824422623962164 + ], + "unique_experts": 61, + "load_cv": 0.8626214194804593, + "normalized_load_entropy": 0.9212758941914144, + "max_load_share": 0.06666666666666667 + }, + "full_input": { + "tokens": 155, + "top_k": 6, + "decisions": 930, + "ordered_route_sha256": "500945c244945bac87609d088d0ef73099a7976b0e6d5b583677e8c60b93e878", + "route_weight_sha256": "aa0aa23b32d7fdb86c4662bb78dfda35831ce036954949c8aa1b9b39c563b807", + "loads": [ + 17, + 28, + 10, + 26, + 12, + 36, + 32, + 16, + 5, + 11, + 8, + 52, + 21, + 13, + 11, + 8, + 4, + 11, + 18, + 32, + 12, + 19, + 16, + 15, + 31, + 20, + 35, + 4, + 10, + 19, + 5, + 8, + 1, + 7, + 4, + 7, + 10, + 2, + 11, + 0, + 5, + 4, + 28, + 6, + 18, + 11, + 45, + 9, + 9, + 8, + 10, + 10, + 3, + 16, + 17, + 12, + 15, + 15, + 17, + 19, + 14, + 12, + 14, + 6 + ], + "weighted_loads": [ + 0.7010249961167574, + 1.04426303319633, + 0.4933253787457943, + 1.5761920176446438, + 0.6315015815198421, + 2.877815378829837, + 2.677190935239196, + 0.7404984422028065, + 0.2823830880224705, + 0.9940946325659752, + 0.3809880744665861, + 3.50755881331861, + 1.559318607673049, + 0.9029299430549145, + 0.42733162455260754, + 0.32516527362167835, + 0.12710275128483772, + 0.46751878410577774, + 1.3097706250846386, + 2.0556604973971844, + 0.43351197987794876, + 1.0866218991577625, + 1.139043902978301, + 0.8446242325007915, + 2.1901979632675648, + 1.043664501979947, + 1.37089585326612, + 0.21070575714111328, + 0.9092651642858982, + 0.5622754488140345, + 0.17278295941650867, + 0.22654781304299831, + 0.031154422089457512, + 0.4649112392216921, + 0.14850579388439655, + 0.4623006694018841, + 0.7112772036343813, + 0.0574671383947134, + 0.6913898587226868, + 0.0, + 0.1969949509948492, + 0.2362222783267498, + 2.166566275060177, + 0.5548354890197515, + 0.6546140220016241, + 0.6880725435912609, + 2.837506737560034, + 0.3552895486354828, + 0.34072916954755783, + 0.31810272485017776, + 1.537015538662672, + 0.43731582164764404, + 0.11434015817940235, + 0.8093134369701147, + 0.9726736154407263, + 0.8859382010996342, + 0.6025635506957769, + 0.626646775752306, + 0.6861158832907677, + 0.9238761868327856, + 1.5237758606672287, + 0.5185534749180079, + 0.7958357855677605, + 0.2824422623962164 + ], + "unique_experts": 63, + "load_cv": 0.7121592316240944, + "normalized_load_entropy": 0.9443175474367065, + "max_load_share": 0.05591397849462366 + } + }, + "s1_x": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "716b3d8b7d1c21293f36162cb60e2c4335b2fd246f9d867bbc532f4c12570900", + "route_weight_sha256": "8c97492068980ee27d46c931ebe4993d1e76d0d624fde72d399a89f41d9c2f8c", + "loads": [ + 17, + 26, + 9, + 19, + 4, + 37, + 25, + 12, + 6, + 11, + 8, + 52, + 16, + 11, + 9, + 5, + 1, + 12, + 6, + 32, + 8, + 21, + 8, + 17, + 30, + 7, + 31, + 5, + 10, + 10, + 3, + 6, + 1, + 6, + 4, + 6, + 5, + 0, + 10, + 1, + 4, + 3, + 27, + 5, + 8, + 11, + 47, + 8, + 8, + 8, + 2, + 11, + 4, + 8, + 17, + 8, + 15, + 11, + 16, + 21, + 2, + 8, + 15, + 6 + ], + "weighted_loads": [ + 0.6859685387462378, + 0.9951623063534498, + 0.44032992608845234, + 0.9833086375147104, + 0.15255020186305046, + 2.9110906906425953, + 2.4552557710558176, + 0.4575423579663038, + 0.3207593895494938, + 0.981218982487917, + 0.3708471469581127, + 3.506768301129341, + 1.453852105885744, + 0.8049192745238543, + 0.33152901008725166, + 0.2055650446563959, + 0.0280934926122427, + 0.4863689113408327, + 0.28500916436314583, + 1.9960300121456385, + 0.2908928859978914, + 1.127925155684352, + 0.6840356290340424, + 0.892119325697422, + 2.161637146025896, + 0.23590264096856117, + 1.2834683265537024, + 0.24333127215504646, + 0.8999900631606579, + 0.2787424437701702, + 0.1220230907201767, + 0.16147817857563496, + 0.033439189195632935, + 0.46551720425486565, + 0.1369477864354849, + 0.41716544330120087, + 0.1761740129441023, + 0.0, + 0.3577135168015957, + 0.02436918579041958, + 0.1743375677615404, + 0.19701167941093445, + 2.0038156770169735, + 0.5132422149181366, + 0.32244802825152874, + 0.6814486123621464, + 2.882763985544443, + 0.33371542394161224, + 0.2993647139519453, + 0.2971834298223257, + 0.0781533420085907, + 0.4576020147651434, + 0.13827607408165932, + 0.34573108330368996, + 0.9626407194882631, + 0.2902978267520666, + 0.5659093875437975, + 0.4813780579715967, + 0.6620172318071127, + 1.0160250347107649, + 0.07205805554986, + 0.29702998511493206, + 0.8016127999871969, + 0.28669337928295135 + ], + "unique_experts": 63, + "load_cv": 0.8712366236780166, + "normalized_load_entropy": 0.9229625309354703, + "max_load_share": 0.06666666666666667 + }, + "full_input": { + "tokens": 171, + "top_k": 6, + "decisions": 1026, + "ordered_route_sha256": "2e32d9110845565c0591bd1b71a41a9d68c8ece2b79042ebaedfd3043e138c15", + "route_weight_sha256": "d5806f462773273413746fc76e2f7ac9d6ef7a9e75573d288704f9e55557f0b9", + "loads": [ + 21, + 27, + 9, + 31, + 15, + 44, + 28, + 20, + 6, + 13, + 10, + 52, + 18, + 12, + 10, + 17, + 8, + 12, + 18, + 33, + 12, + 23, + 19, + 19, + 32, + 21, + 32, + 8, + 10, + 14, + 3, + 7, + 2, + 6, + 5, + 8, + 9, + 6, + 12, + 5, + 8, + 4, + 29, + 9, + 23, + 12, + 47, + 8, + 8, + 12, + 15, + 11, + 4, + 18, + 18, + 19, + 16, + 19, + 17, + 24, + 16, + 10, + 16, + 6 + ], + "weighted_loads": [ + 0.882010456174612, + 1.0192696265876293, + 0.44032992608845234, + 1.7885694522410631, + 0.7480417899787426, + 3.1838513277471066, + 2.563348416239023, + 0.9461531024426222, + 0.3207593895494938, + 1.2177075184881687, + 0.465558223426342, + 3.506768301129341, + 1.517262851819396, + 1.0883790869265795, + 0.3917418159544468, + 0.8626062925904989, + 0.49353421851992607, + 0.4863689113408327, + 1.4434832707047462, + 2.03187526576221, + 0.4374342802911997, + 1.1932641360908747, + 1.3762322217226028, + 1.0649090483784676, + 2.2137376982718706, + 1.2622740715742111, + 1.300900673493743, + 0.3377634845674038, + 0.8999900631606579, + 0.3920233640819788, + 0.1220230907201767, + 0.19172745384275913, + 0.08007603138685226, + 0.46551720425486565, + 0.1658649556338787, + 0.5926310904324055, + 0.6793703027069569, + 0.22545523382723331, + 0.7638857364654541, + 0.22323997132480145, + 0.3433063980191946, + 0.25083864480257034, + 2.1861633993685246, + 0.6978922002017498, + 1.2006391659379005, + 0.7544881589710712, + 2.882763985544443, + 0.33371542394161224, + 0.2993647139519453, + 0.5343191754072905, + 1.9887602888047695, + 0.4576020147651434, + 0.13827607408165932, + 0.7875171806663275, + 0.9895162284374237, + 1.4798901211470366, + 0.610804608091712, + 1.0643020458519459, + 0.70026626996696, + 1.0971642471849918, + 1.5981335770338774, + 0.4129426646977663, + 0.862567076459527, + 0.28669337928295135 + ], + "unique_experts": 64, + "load_cv": 0.6509641446099766, + "normalized_load_entropy": 0.9540715169784912, + "max_load_share": 0.050682261208576995 + } + }, + "s0_period": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "89d0c7da46545ec5723c82832ba4309b458902f5787562651b481c9aacd9c7b4", + "route_weight_sha256": "bb8c7f5cb571d6230fefeb0cb1dafa5c119fb6f20d00638726388772e76953d8", + "loads": [ + 19, + 25, + 11, + 18, + 1, + 36, + 25, + 11, + 5, + 12, + 8, + 53, + 16, + 11, + 11, + 4, + 0, + 12, + 7, + 29, + 9, + 19, + 9, + 15, + 30, + 8, + 35, + 4, + 10, + 13, + 4, + 7, + 1, + 7, + 4, + 7, + 5, + 0, + 8, + 0, + 4, + 3, + 26, + 4, + 6, + 11, + 47, + 9, + 7, + 7, + 2, + 10, + 5, + 10, + 17, + 9, + 16, + 12, + 17, + 19, + 1, + 9, + 14, + 6 + ], + "weighted_loads": [ + 0.7631435673683882, + 0.9535887986421585, + 0.5195125080645084, + 0.9820808935910463, + 0.030786268413066864, + 2.833377817645669, + 2.445478666573763, + 0.43322749994695187, + 0.28491760417819023, + 1.014439906924963, + 0.3838468138128519, + 3.567941054701805, + 1.3925226330757141, + 0.8307790569961071, + 0.42410298623144627, + 0.20058786869049072, + 0.0, + 0.49217273108661175, + 0.30321622639894485, + 1.9290337897837162, + 0.328428715467453, + 1.0842377226799726, + 0.7509739380329847, + 0.841715719550848, + 2.166192464530468, + 0.27932247146964073, + 1.40623371116817, + 0.22120847925543785, + 0.8972472790628672, + 0.36579479835927486, + 0.14621162228286266, + 0.19988158158957958, + 0.03047768771648407, + 0.4761971291154623, + 0.14157024398446083, + 0.45731030590832233, + 0.17709099128842354, + 0.0, + 0.25637528486549854, + 0.0, + 0.16674314811825752, + 0.2018677033483982, + 1.976267609745264, + 0.48562007397413254, + 0.23594119772315025, + 0.6857957802712917, + 2.9396269395947456, + 0.35451081208884716, + 0.2809085212647915, + 0.281038835644722, + 0.07778394967317581, + 0.4460231699049473, + 0.1704417448490858, + 0.4284406304359436, + 0.9766203127801418, + 0.33407774940133095, + 0.6277586296200752, + 0.5222075209021568, + 0.7038575373589993, + 0.9153503347188234, + 0.04060470312833786, + 0.3515341319143772, + 0.7984425872564316, + 0.28438423946499825 + ], + "unique_experts": 61, + "load_cv": 0.8747311036061551, + "normalized_load_entropy": 0.9197899889690236, + "max_load_share": 0.06794871794871794 + }, + "full_input": { + "tokens": 155, + "top_k": 6, + "decisions": 930, + "ordered_route_sha256": "e0f134100448eb987872549494cd25f27d4fc7ca8b61e39783aa2b1eed12ab05", + "route_weight_sha256": "b54cb31431eb260645aa122534f0eac3c8828ecc957d5fa0fc86c35b1b85f1b0", + "loads": [ + 19, + 27, + 11, + 26, + 11, + 38, + 31, + 18, + 5, + 12, + 8, + 53, + 21, + 11, + 11, + 8, + 3, + 12, + 18, + 29, + 14, + 19, + 16, + 15, + 30, + 16, + 36, + 4, + 10, + 17, + 4, + 7, + 1, + 8, + 5, + 7, + 8, + 2, + 9, + 1, + 5, + 4, + 28, + 5, + 19, + 11, + 47, + 9, + 8, + 8, + 11, + 10, + 5, + 16, + 17, + 12, + 16, + 16, + 17, + 19, + 13, + 13, + 14, + 6 + ], + "weighted_loads": [ + 0.7631435673683882, + 1.0248705092817545, + 0.5195125080645084, + 1.5779920611530542, + 0.5107545498758554, + 2.9085509348660707, + 2.6543811578303576, + 0.9240990970283747, + 0.28491760417819023, + 1.014439906924963, + 0.3838468138128519, + 3.567941054701805, + 1.549937529489398, + 0.8307790569961071, + 0.42410298623144627, + 0.35640259832143784, + 0.08899407088756561, + 0.49217273108661175, + 1.2317297719419003, + 1.9290337897837162, + 0.5308594554662704, + 1.0842377226799726, + 1.1326028276234865, + 0.841715719550848, + 2.166192464530468, + 0.949439637362957, + 1.4236660581082106, + 0.22120847925543785, + 0.8972472790628672, + 0.500002833083272, + 0.14621162228286266, + 0.19988158158957958, + 0.03047768771648407, + 0.4993111118674278, + 0.17558761313557625, + 0.45731030590832233, + 0.6562288776040077, + 0.0574671383947134, + 0.6211123485118151, + 0.044413622468709946, + 0.22731315717101097, + 0.2446153499186039, + 2.170468967407942, + 0.522554524242878, + 0.6790004409849644, + 0.6857957802712917, + 2.9396269395947456, + 0.35451081208884716, + 0.31608131527900696, + 0.3407404311001301, + 1.5362910218536854, + 0.4460231699049473, + 0.1704417448490858, + 0.8119303099811077, + 0.9766203127801418, + 0.8708059638738632, + 0.6277586296200752, + 0.6442228872328997, + 0.7038575373589993, + 0.9153503347188234, + 1.3379831239581108, + 0.5556215438991785, + 0.7984425872564316, + 0.28438423946499825 + ], + "unique_experts": 64, + "load_cv": 0.7194986756883309, + "normalized_load_entropy": 0.9444776447400028, + "max_load_share": 0.05698924731182796 + } + }, + "s1_period": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "1109a8c33f770accdf4101c27260e05d082d3fc444c6a01a708c850b94663efd", + "route_weight_sha256": "2823798e59287eed051aff7149dd698d752d9ed80fdfd9908eb13cfb03a3b790", + "loads": [ + 16, + 25, + 9, + 18, + 4, + 37, + 25, + 11, + 5, + 11, + 9, + 52, + 16, + 11, + 10, + 5, + 1, + 12, + 5, + 31, + 10, + 21, + 8, + 17, + 30, + 7, + 33, + 4, + 10, + 9, + 3, + 7, + 1, + 7, + 4, + 6, + 4, + 0, + 11, + 1, + 4, + 3, + 27, + 5, + 8, + 11, + 48, + 8, + 9, + 8, + 2, + 10, + 4, + 7, + 17, + 8, + 16, + 10, + 18, + 20, + 1, + 9, + 15, + 6 + ], + "weighted_loads": [ + 0.6641063503921032, + 0.9549947120249271, + 0.42860481329262257, + 0.9566930327564478, + 0.14902055263519287, + 2.878796497359872, + 2.448901539668441, + 0.4122503772377968, + 0.2812912240624428, + 0.9791815429925919, + 0.397340415045619, + 3.526897456496954, + 1.461844764649868, + 0.8140837103128433, + 0.36018282547593117, + 0.20548639819025993, + 0.024271899834275246, + 0.4860744159668684, + 0.246990030631423, + 1.9858794901520014, + 0.3577701114118099, + 1.1441735364496708, + 0.6710863895714283, + 0.8905607238411903, + 2.159676369279623, + 0.24172435142099857, + 1.3217180594801903, + 0.21989262476563454, + 0.9079096764326096, + 0.2580365054309368, + 0.12455184943974018, + 0.19224760867655277, + 0.034340549260377884, + 0.4800986126065254, + 0.1373180951923132, + 0.4248894564807415, + 0.143629165366292, + 0.0, + 0.3933111224323511, + 0.024128638207912445, + 0.17968795634806156, + 0.19563747197389603, + 1.997143080458045, + 0.49596137180924416, + 0.30441000685095787, + 0.6772032827138901, + 2.9385162256658077, + 0.32609426975250244, + 0.3297962434589863, + 0.30681279487907887, + 0.06671816110610962, + 0.43883608281612396, + 0.1379540730267763, + 0.3101471737027168, + 0.9599323961883783, + 0.2967333775013685, + 0.5937619097530842, + 0.4505764301866293, + 0.7291023097932339, + 0.9852582272142172, + 0.0412592813372612, + 0.32185778208076954, + 0.8025776632130146, + 0.2937274035066366 + ], + "unique_experts": 63, + "load_cv": 0.8777324200366715, + "normalized_load_entropy": 0.9215092855568938, + "max_load_share": 0.06666666666666667 + }, + "full_input": { + "tokens": 171, + "top_k": 6, + "decisions": 1026, + "ordered_route_sha256": "5d377f4fc7231842666cf35fec46ee7069973f65def46691079b800618e39857", + "route_weight_sha256": "d3a744d0ce7c7bff84843a8b40c7719b6a533f8cb398757692f18ac40227b082", + "loads": [ + 21, + 26, + 9, + 29, + 14, + 42, + 28, + 19, + 5, + 13, + 11, + 52, + 20, + 12, + 11, + 16, + 7, + 12, + 16, + 32, + 15, + 22, + 19, + 19, + 31, + 21, + 34, + 6, + 10, + 14, + 3, + 8, + 2, + 7, + 6, + 8, + 8, + 6, + 13, + 6, + 9, + 4, + 30, + 9, + 22, + 12, + 48, + 8, + 9, + 13, + 15, + 10, + 4, + 17, + 18, + 20, + 17, + 17, + 19, + 23, + 15, + 12, + 16, + 6 + ], + "weighted_loads": [ + 0.8908351957798004, + 0.9791020322591066, + 0.42860481329262257, + 1.729710878804326, + 0.6315715350210667, + 3.077900255098939, + 2.5573775060474873, + 0.9536884240806103, + 0.2812912240624428, + 1.2156700789928436, + 0.4920514915138483, + 3.526897456496954, + 1.59998887963593, + 1.0975435227155685, + 0.4203956313431263, + 0.8440032862126827, + 0.35528775677084923, + 0.4860744159668684, + 1.289276609197259, + 2.021724743768573, + 0.5497168153524399, + 1.1777472794055939, + 1.3620756827294827, + 1.0633504465222359, + 2.179632792249322, + 1.2847406100481749, + 1.3391504064202309, + 0.28030744567513466, + 0.9079096764326096, + 0.4054391887038946, + 0.12455184943974018, + 0.22249688394367695, + 0.08097739145159721, + 0.4800986126065254, + 0.19635335355997086, + 0.6003551036119461, + 0.6404931172728539, + 0.22264106757938862, + 0.7994833420962095, + 0.27318038418889046, + 0.3941685985773802, + 0.24946443736553192, + 2.206898458302021, + 0.6806113570928574, + 1.1461247727274895, + 0.7502428293228149, + 2.9385162256658077, + 0.32609426975250244, + 0.3297962434589863, + 0.6345716807991266, + 1.91114641726017, + 0.43883608281612396, + 0.1379540730267763, + 0.7709975466132164, + 0.9868079051375389, + 1.4990169312804937, + 0.6386571303009987, + 0.9875809736549854, + 0.7673513479530811, + 1.0663974396884441, + 1.5151213090866804, + 0.4858576487749815, + 0.8635319396853447, + 0.2937274035066366 + ], + "unique_experts": 64, + "load_cv": 0.6414617960794298, + "normalized_load_entropy": 0.955455854222806, + "max_load_share": 0.050682261208576995 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 130, + "ordered_topk_exact_tokens": 75, + "set_exact_tokens": 94, + "mean_set_jaccard": 0.9179487179487179, + "mean_token_weighted_tv": 0.01302335702885802, + "aggregate_load_tv": 0.02435897435897436 + }, + "system_bos": { + "tokens": 130, + "ordered_topk_exact_tokens": 77, + "set_exact_tokens": 99, + "mean_set_jaccard": 0.9318681318681319, + "mean_token_weighted_tv": 0.012386195497730604, + "aggregate_load_tv": 0.021794871794871808 + }, + "system_x": { + "tokens": 130, + "ordered_topk_exact_tokens": 61, + "set_exact_tokens": 77, + "mean_set_jaccard": 0.8802197802197802, + "mean_token_weighted_tv": 0.019989347579674077, + "aggregate_load_tv": 0.03974358974358974 + }, + "system_period": { + "tokens": 130, + "ordered_topk_exact_tokens": 58, + "set_exact_tokens": 79, + "mean_set_jaccard": 0.8796703296703297, + "mean_token_weighted_tv": 0.020392477218634807, + "aggregate_load_tv": 0.03717948717948718 + }, + "bos_at_s0": { + "tokens": 130, + "ordered_topk_exact_tokens": 70, + "set_exact_tokens": 93, + "mean_set_jaccard": 0.9186813186813189, + "mean_token_weighted_tv": 0.014253725498341597, + "aggregate_load_tv": 0.024358974358974363 + }, + "bos_at_s1": { + "tokens": 130, + "ordered_topk_exact_tokens": 66, + "set_exact_tokens": 88, + "mean_set_jaccard": 0.9014652014652016, + "mean_token_weighted_tv": 0.01665582205527104, + "aggregate_load_tv": 0.030769230769230764 + }, + "x_at_s0": { + "tokens": 130, + "ordered_topk_exact_tokens": 60, + "set_exact_tokens": 78, + "mean_set_jaccard": 0.8857142857142858, + "mean_token_weighted_tv": 0.018600838223042395, + "aggregate_load_tv": 0.033333333333333326 + }, + "x_at_s1": { + "tokens": 130, + "ordered_topk_exact_tokens": 54, + "set_exact_tokens": 68, + "mean_set_jaccard": 0.852930402930403, + "mean_token_weighted_tv": 0.024338873010128735, + "aggregate_load_tv": 0.04487179487179488 + }, + "period_at_s0": { + "tokens": 130, + "ordered_topk_exact_tokens": 71, + "set_exact_tokens": 90, + "mean_set_jaccard": 0.9120879120879122, + "mean_token_weighted_tv": 0.015424935555515381, + "aggregate_load_tv": 0.025641025641025647 + }, + "period_at_s1": { + "tokens": 130, + "ordered_topk_exact_tokens": 58, + "set_exact_tokens": 75, + "mean_set_jaccard": 0.867948717948718, + "mean_token_weighted_tv": 0.022926917922897982, + "aggregate_load_tv": 0.03717948717948718 + } + } + }, + "layer_21": { + "layer": 21, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "95ddcb002033cb5f8d1a1bc100e54ea9b2e923a0f0e72a146605305cc616d3e0", + "route_weight_sha256": "d0d46e922050e0f6f5f106e5f1a377a90e1330d52b6f52fba3034b6180c817ba", + "loads": [ + 4, + 11, + 17, + 1, + 9, + 23, + 7, + 3, + 7, + 20, + 18, + 23, + 1, + 9, + 7, + 6, + 5, + 5, + 3, + 19, + 29, + 21, + 21, + 21, + 23, + 5, + 16, + 0, + 20, + 14, + 14, + 77, + 15, + 15, + 14, + 13, + 0, + 6, + 14, + 4, + 26, + 10, + 8, + 11, + 4, + 12, + 22, + 14, + 2, + 14, + 20, + 6, + 10, + 1, + 2, + 0, + 14, + 22, + 7, + 6, + 10, + 3, + 10, + 6 + ], + "weighted_loads": [ + 0.12715050019323826, + 0.4626759886741638, + 0.7883315291255713, + 0.03408648446202278, + 0.28996231593191624, + 1.2811191864311695, + 0.4705410376191139, + 0.14181724190711975, + 0.3335460443049669, + 1.438379243016243, + 0.7998106256127357, + 0.8898680154234171, + 0.033141545951366425, + 0.3664867430925369, + 0.28439413756132126, + 0.20019311644136906, + 0.24053608439862728, + 0.25182234309613705, + 0.09824127145111561, + 0.6194660048931837, + 1.7526563182473183, + 0.8700381834059954, + 1.5053937807679176, + 1.5993805583566427, + 1.727538026869297, + 0.1409689299762249, + 0.8410834185779095, + 0.0, + 0.692935049533844, + 0.7846504524350166, + 0.7665493916720152, + 3.304803442209959, + 0.766957126557827, + 0.8159075677394867, + 0.718358974903822, + 0.5298072379082441, + 0.0, + 0.2630946133285761, + 0.9979359619319439, + 0.14244696497917175, + 1.5948665849864483, + 0.5151470638811588, + 0.727437287569046, + 0.8916227594017982, + 0.16338207945227623, + 0.44684414751827717, + 1.2757915202528238, + 1.1095118634402752, + 0.07886439934372902, + 0.5991951934993267, + 1.4077178910374641, + 0.3412943035364151, + 0.4988665860146284, + 0.03498440235853195, + 0.06051299348473549, + 0.0, + 0.6916267070919275, + 1.234143940731883, + 0.3173539601266384, + 0.23475948348641396, + 0.38086594454944134, + 0.12482933327555656, + 0.35684572346508503, + 0.452214851975441 + ], + "unique_experts": 61, + "load_cv": 0.9051100455794366, + "normalized_load_entropy": 0.9208780290997828, + "max_load_share": 0.09871794871794871 + }, + "full_input": { + "tokens": 155, + "top_k": 6, + "decisions": 930, + "ordered_route_sha256": "20ea4e8de911419d48d72912c351d1085f803c4714fba159fd0b01918e7aaf19", + "route_weight_sha256": "17f7fc7a5e6613ab7ccdf292fe51c0e96b8a678b5aa138530d6eb42cd40c8c2f", + "loads": [ + 4, + 13, + 20, + 1, + 15, + 23, + 10, + 3, + 8, + 20, + 27, + 23, + 4, + 13, + 10, + 12, + 6, + 8, + 3, + 22, + 29, + 29, + 21, + 22, + 23, + 6, + 24, + 5, + 24, + 14, + 17, + 79, + 16, + 15, + 15, + 23, + 0, + 6, + 14, + 5, + 28, + 10, + 12, + 11, + 4, + 12, + 22, + 14, + 13, + 17, + 20, + 13, + 21, + 2, + 6, + 3, + 16, + 22, + 11, + 9, + 10, + 3, + 13, + 6 + ], + "weighted_loads": [ + 0.12715050019323826, + 0.6126237697899342, + 0.8646481544710696, + 0.03408648446202278, + 0.5181694831699133, + 1.2811191864311695, + 0.7915599197149277, + 0.14181724190711975, + 0.39603169076144695, + 1.438379243016243, + 1.6722123734652996, + 0.8898680154234171, + 0.19051562249660492, + 0.6811416447162628, + 0.3977113366127014, + 0.3999339435249567, + 0.2537984596565366, + 0.3350696200504899, + 0.09824127145111561, + 2.140638628974557, + 1.7526563182473183, + 1.3303842074237764, + 1.5053937807679176, + 1.6421452816575766, + 1.727538026869297, + 0.17608336731791496, + 1.213860098272562, + 0.5285599399358034, + 0.7906646970659494, + 0.7846504524350166, + 0.9240626245737076, + 3.381245579570532, + 0.7898097429424524, + 0.8159075677394867, + 0.7681078054010868, + 1.1078078355640173, + 0.0, + 0.2630946133285761, + 0.9979359619319439, + 0.18096856400370598, + 1.6993368454277515, + 0.5151470638811588, + 0.9816725365817547, + 0.8916227594017982, + 0.16338207945227623, + 0.44684414751827717, + 1.2757915202528238, + 1.1095118634402752, + 0.6669122017920017, + 0.9036445617675781, + 1.4077178910374641, + 0.661831796169281, + 1.1447421964257956, + 0.04799537640064955, + 0.18999977875500917, + 0.4687753841280937, + 0.8171342443674803, + 1.234143940731883, + 0.4650149289518595, + 0.35590584203600883, + 0.38086594454944134, + 0.12482933327555656, + 0.4811514187604189, + 0.452214851975441 + ], + "unique_experts": 63, + "load_cv": 0.7697813339616982, + "normalized_load_entropy": 0.941220581229445, + "max_load_share": 0.08494623655913978 + } + }, + "s1_eos": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "86b16aa52f74807a9b07cac7c0a241716e225029789bca6ca890ac39485fe3d8", + "route_weight_sha256": "79ce575cee9e5f21782b811e019a19e919e418366ec04f15c166c803fc8e45c7", + "loads": [ + 3, + 11, + 16, + 2, + 7, + 26, + 8, + 3, + 8, + 21, + 17, + 23, + 1, + 8, + 7, + 8, + 5, + 7, + 3, + 15, + 30, + 20, + 21, + 21, + 22, + 5, + 16, + 0, + 21, + 13, + 14, + 79, + 15, + 14, + 14, + 13, + 0, + 5, + 14, + 5, + 26, + 10, + 9, + 13, + 4, + 13, + 20, + 14, + 2, + 12, + 20, + 7, + 10, + 1, + 2, + 0, + 14, + 23, + 7, + 6, + 7, + 3, + 9, + 7 + ], + "weighted_loads": [ + 0.0982559397816658, + 0.46177724562585354, + 0.7522769514471292, + 0.06478656269609928, + 0.23306883871555328, + 1.3523729555308819, + 0.5060830377042294, + 0.1372528187930584, + 0.35957062244415283, + 1.4849147573113441, + 0.7520133424550295, + 0.886756781488657, + 0.03466542065143585, + 0.35551562905311584, + 0.2806611396372318, + 0.26319872587919235, + 0.24678561091423035, + 0.3015604838728905, + 0.0983135923743248, + 0.495339835062623, + 1.7922100611031055, + 0.8494982309639454, + 1.5114845484495163, + 1.6309331450611353, + 1.697159070521593, + 0.13911200128495693, + 0.8499484192579985, + 0.0, + 0.7301098722964525, + 0.7643230576068163, + 0.7357026692479849, + 3.364206900820136, + 0.7746265716850758, + 0.7788946349173784, + 0.7183227464556694, + 0.5406027659773827, + 0.0, + 0.23083331435918808, + 1.0025060884654522, + 0.1731132324784994, + 1.5744536761194468, + 0.5083355233073235, + 0.7548150643706322, + 0.9587843529880047, + 0.16117745451629162, + 0.47032572515308857, + 1.224973563104868, + 1.1006108596920967, + 0.08289656043052673, + 0.548737233504653, + 1.4261487536132336, + 0.38766155764460564, + 0.4978499598801136, + 0.03422063589096069, + 0.06189820542931557, + 0.0, + 0.6818460747599602, + 1.2632688600569963, + 0.32153288275003433, + 0.23664704337716103, + 0.27559924125671387, + 0.12428529560565948, + 0.32847598753869534, + 0.473477428779006 + ], + "unique_experts": 61, + "load_cv": 0.9187219204562882, + "normalized_load_entropy": 0.9208535544481201, + "max_load_share": 0.10128205128205128 + }, + "full_input": { + "tokens": 171, + "top_k": 6, + "decisions": 1026, + "ordered_route_sha256": "a4b22c6911949088151878029c62dcc5ee317287890242f320de7f9a30f9e274", + "route_weight_sha256": "bb48ded4a6997f5124b94ff472553ed40614e81aacc3de8980a6f3061477383c", + "loads": [ + 11, + 15, + 19, + 2, + 7, + 27, + 13, + 4, + 12, + 24, + 28, + 23, + 6, + 18, + 14, + 12, + 6, + 15, + 5, + 18, + 31, + 27, + 22, + 26, + 23, + 8, + 24, + 9, + 24, + 14, + 20, + 81, + 16, + 18, + 14, + 30, + 1, + 6, + 15, + 6, + 28, + 13, + 17, + 14, + 5, + 14, + 20, + 14, + 12, + 16, + 21, + 17, + 21, + 2, + 12, + 10, + 19, + 23, + 11, + 11, + 8, + 4, + 12, + 8 + ], + "weighted_loads": [ + 0.6106476318091154, + 0.7010999079793692, + 1.448767514899373, + 0.06478656269609928, + 0.23306883871555328, + 1.3677973439916968, + 0.7625969164073467, + 0.21820971742272377, + 0.5176147501915693, + 1.6626258678734303, + 1.708501124754548, + 0.886756781488657, + 0.2816063053905964, + 0.8892471939325333, + 0.5662295743823051, + 0.40074288472533226, + 0.26004798617213964, + 0.5816936865448952, + 0.15283199027180672, + 1.997459189966321, + 1.840110369026661, + 1.2793905581347644, + 1.542492488399148, + 2.1175198573619127, + 1.7333676517009735, + 0.23471903800964355, + 1.1474880911409855, + 0.9372856989502907, + 0.7655735863372684, + 0.8131992388516665, + 1.0175622701644897, + 3.438388066366315, + 0.7973436266183853, + 1.37505310960114, + 0.7183227464556694, + 1.4603177942335606, + 0.0693967193365097, + 0.272077489644289, + 1.0567973889410496, + 0.21511096321046352, + 1.6621383856981993, + 0.6750534549355507, + 1.1821982599794865, + 1.00068673864007, + 0.2247589584439993, + 0.5283593740314245, + 1.224973563104868, + 1.1006108596920967, + 0.8374400921165943, + 1.5625052768737078, + 1.4810679852962494, + 1.098231092095375, + 1.0936515629291534, + 0.04723160993307829, + 0.699103613384068, + 0.8639656938612461, + 0.9311011862009764, + 1.2632688600569963, + 0.4946256894618273, + 0.48320434242486954, + 0.2979939915239811, + 0.18646524101495743, + 0.4430465158075094, + 0.5608529131859541 + ], + "unique_experts": 64, + "load_cv": 0.6917167111478818, + "normalized_load_entropy": 0.953436252879183, + "max_load_share": 0.07894736842105263 + } + }, + "s0_bos": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "1656d0332922f5589396912595da6b4dee795f917aba97baa3b44cc41828d102", + "route_weight_sha256": "cc3857f3a9976ccb607afa9cff576051ddeea4a0c990b7f7b83a0ae63b1a9ab6", + "loads": [ + 3, + 11, + 16, + 3, + 8, + 21, + 11, + 2, + 9, + 20, + 19, + 22, + 1, + 9, + 8, + 7, + 5, + 8, + 2, + 16, + 29, + 20, + 21, + 21, + 23, + 3, + 17, + 0, + 18, + 14, + 15, + 79, + 15, + 14, + 12, + 13, + 1, + 7, + 14, + 7, + 29, + 10, + 8, + 11, + 2, + 11, + 21, + 14, + 2, + 13, + 19, + 5, + 9, + 1, + 1, + 0, + 14, + 23, + 11, + 3, + 9, + 3, + 10, + 7 + ], + "weighted_loads": [ + 0.0926705077290535, + 0.46346304938197136, + 0.7522513680160046, + 0.08904003538191319, + 0.2672392651438713, + 1.2114690095186234, + 0.6045410688966513, + 0.10527731478214264, + 0.40626363828778267, + 1.4542983919382095, + 0.8622689135372639, + 0.8526088315993547, + 0.03329478204250336, + 0.377684336155653, + 0.3168000094592571, + 0.2235695756971836, + 0.2365577518939972, + 0.3450863230973482, + 0.07256851717829704, + 0.5235624797642231, + 1.7512244060635567, + 0.8461893983185291, + 1.4865926168859005, + 1.6044033747166395, + 1.7314473502337933, + 0.08689672313630581, + 0.8895426541566849, + 0.0, + 0.6251615192741156, + 0.7989265862852335, + 0.8260057270526886, + 3.347819983959198, + 0.768253842368722, + 0.7838910482823849, + 0.6527540944516659, + 0.5219221822917461, + 0.022905424237251282, + 0.29648407548666, + 0.9826609287410975, + 0.23835576511919498, + 1.673118744045496, + 0.5212403181940317, + 0.7148245219141245, + 0.8923802152276039, + 0.10110476240515709, + 0.38104531541466713, + 1.2467772495001554, + 1.1148651726543903, + 0.08040264993906021, + 0.5819998141378164, + 1.4157190136611462, + 0.3084149844944477, + 0.4729771316051483, + 0.03464964032173157, + 0.03456902131438255, + 0.0, + 0.70778813585639, + 1.284449378028512, + 0.44962204061448574, + 0.1390460543334484, + 0.3465759977698326, + 0.1225332748144865, + 0.35006439313292503, + 0.4866720885038376 + ], + "unique_experts": 62, + "load_cv": 0.9160846278400766, + "normalized_load_entropy": 0.9206387540215905, + "max_load_share": 0.10128205128205128 + }, + "full_input": { + "tokens": 155, + "top_k": 6, + "decisions": 930, + "ordered_route_sha256": "709cd7a8af64a627668826f62f7bb36a74464d441f50631536baa885d5d76672", + "route_weight_sha256": "7e3460c400fdc809746b91a27b7ff77a3520e9c0497b0938bc7c87d0ce62f8ce", + "loads": [ + 3, + 13, + 18, + 4, + 13, + 21, + 14, + 2, + 11, + 20, + 27, + 22, + 4, + 13, + 10, + 12, + 6, + 10, + 3, + 18, + 29, + 27, + 21, + 22, + 23, + 4, + 25, + 5, + 21, + 14, + 19, + 82, + 16, + 14, + 13, + 24, + 1, + 7, + 14, + 10, + 32, + 10, + 12, + 11, + 2, + 12, + 21, + 14, + 13, + 15, + 19, + 12, + 20, + 2, + 5, + 3, + 16, + 23, + 14, + 6, + 9, + 3, + 14, + 7 + ], + "weighted_loads": [ + 0.0926705077290535, + 0.6137402839958668, + 0.8260434158146381, + 0.30169557966291904, + 0.45936014875769615, + 1.2114690095186234, + 0.8960710782557726, + 0.10527731478214264, + 0.5096663758158684, + 1.4542983919382095, + 1.6318270042538643, + 0.8526088315993547, + 0.1979208029806614, + 0.6475215554237366, + 0.40113840997219086, + 0.409932816401124, + 0.2498201271519065, + 0.4243206102401018, + 0.12936298549175262, + 1.1021925508975983, + 1.7512244060635567, + 1.3059216616675258, + 1.4865926168859005, + 1.6471680980175734, + 1.7314473502337933, + 0.12201116047799587, + 1.2623193338513374, + 0.5246735438704491, + 0.7183193480595946, + 0.7989265862852335, + 1.0328637585043907, + 3.5379709489643574, + 0.7911064587533474, + 0.7838910482823849, + 0.7025029249489307, + 1.1316980309784412, + 0.022905424237251282, + 0.29648407548666, + 0.9826609287410975, + 0.3593872766941786, + 1.8465894646942616, + 0.5212403181940317, + 0.9701613020151854, + 0.8923802152276039, + 0.10110476240515709, + 0.4830216355621815, + 1.2467772495001554, + 1.1148651726543903, + 0.6684504523873329, + 0.8558784630149603, + 1.4157190136611462, + 0.6289524771273136, + 1.1215394288301468, + 0.04766061436384916, + 0.16405580658465624, + 0.4216388165950775, + 0.8435913547873497, + 1.284449378028512, + 0.5437643714249134, + 0.2620357647538185, + 0.3465759977698326, + 0.1225332748144865, + 0.5317720249295235, + 0.4866720885038376 + ], + "unique_experts": 64, + "load_cv": 0.7819888314721095, + "normalized_load_entropy": 0.9418701233129811, + "max_load_share": 0.08817204301075268 + } + }, + "s1_bos": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "137f371274b333d460082535553d11693ba935ffa131fe8f623f17876d021d22", + "route_weight_sha256": "92316fb07ea13008a07187992a1fbd10571f042a9cab60dfc6643a5e086befa6", + "loads": [ + 4, + 11, + 15, + 3, + 8, + 22, + 11, + 3, + 8, + 20, + 19, + 23, + 1, + 10, + 8, + 6, + 7, + 7, + 1, + 15, + 28, + 21, + 21, + 20, + 23, + 3, + 16, + 0, + 20, + 16, + 14, + 79, + 15, + 14, + 13, + 13, + 0, + 7, + 14, + 7, + 29, + 9, + 10, + 11, + 2, + 10, + 20, + 14, + 2, + 12, + 20, + 7, + 8, + 0, + 2, + 0, + 13, + 23, + 9, + 4, + 9, + 4, + 10, + 6 + ], + "weighted_loads": [ + 0.1271219439804554, + 0.47132236883044243, + 0.7202866915613413, + 0.09026090614497662, + 0.25727179273962975, + 1.2490498293191195, + 0.6087896786630154, + 0.13496363162994385, + 0.36072875186800957, + 1.4573206789791584, + 0.829871691763401, + 0.878640616312623, + 0.03438413143157959, + 0.4076204616576433, + 0.3157115299254656, + 0.20026912167668343, + 0.29189930856227875, + 0.2974334955215454, + 0.03904254361987114, + 0.4967994261533022, + 1.7199720032513142, + 0.8903833217918873, + 1.4737396351993084, + 1.5897256471216679, + 1.7304813396185637, + 0.08584046177566051, + 0.8345144614577293, + 0.0, + 0.6963953543454409, + 0.8479083627462387, + 0.7704057730734348, + 3.370700467377901, + 0.7536290530115366, + 0.7721410505473614, + 0.6863865107297897, + 0.49682651832699776, + 0.0, + 0.3028872571885586, + 0.973585644736886, + 0.24089171923696995, + 1.6675222720950842, + 0.4913293905556202, + 0.7886865213513374, + 0.8544852696359158, + 0.10078421980142593, + 0.3533573169261217, + 1.2149302512407303, + 1.116860792040825, + 0.07819001376628876, + 0.5641132798045874, + 1.451169339939952, + 0.37514103949069977, + 0.43257635086774826, + 0.0, + 0.060785362496972084, + 0.0, + 0.67136693559587, + 1.2805544603616, + 0.39150497503578663, + 0.165145855396986, + 0.3431407120078802, + 0.13550706021487713, + 0.3588153012096882, + 0.4524146690964699 + ], + "unique_experts": 60, + "load_cv": 0.915280465237854, + "normalized_load_entropy": 0.9201048965540967, + "max_load_share": 0.10128205128205128 + }, + "full_input": { + "tokens": 171, + "top_k": 6, + "decisions": 1026, + "ordered_route_sha256": "ffb57acbc4ebb6c18e368ae4f97bf63b0e85d22c6f988683a7aa575715c5cd7f", + "route_weight_sha256": "846de8cee7ec270eb2e2a705a3c0a435c27ce0889b5fcf90024b5d7ea538bfab", + "loads": [ + 12, + 14, + 17, + 3, + 11, + 23, + 16, + 5, + 12, + 23, + 28, + 24, + 6, + 20, + 15, + 10, + 8, + 13, + 4, + 17, + 29, + 27, + 22, + 25, + 24, + 6, + 24, + 9, + 22, + 17, + 20, + 82, + 16, + 18, + 13, + 30, + 1, + 8, + 15, + 9, + 31, + 12, + 18, + 12, + 3, + 11, + 20, + 14, + 12, + 17, + 21, + 17, + 19, + 1, + 12, + 10, + 18, + 23, + 11, + 10, + 10, + 5, + 14, + 7 + ], + "weighted_loads": [ + 0.639513636007905, + 0.6717038229107857, + 1.4140986148267984, + 0.09026090614497662, + 0.36882852017879486, + 1.2644742177799344, + 0.9219125173985958, + 0.25238653644919395, + 0.5260514002293348, + 1.6350317895412445, + 1.6755486354231834, + 0.9308839496225119, + 0.2965070270001888, + 0.9084517359733582, + 0.6000218037515879, + 0.3715782407671213, + 0.30516168382018805, + 0.5384684950113297, + 0.15929578244686127, + 1.0591157171875238, + 1.7678723111748695, + 1.314742480404675, + 1.50474757514894, + 2.0763123594224453, + 1.766689920797944, + 0.18144749850034714, + 1.1320541333407164, + 0.9354089610278606, + 0.7274954793974757, + 0.8967845439910889, + 1.0604856200516224, + 3.54124940559268, + 0.7763461079448462, + 1.368299525231123, + 0.6863865107297897, + 1.4165415465831757, + 0.0693967193365097, + 0.3441314324736595, + 1.0278769452124834, + 0.3131516296416521, + 1.7605658490210772, + 0.6580473221838474, + 1.2194566056132317, + 0.896387655287981, + 0.1643657237291336, + 0.41139096580445766, + 1.2149302512407303, + 1.116860792040825, + 0.8327335454523563, + 1.6958675552159548, + 1.5060885716229677, + 1.0857105739414692, + 1.031396919861436, + 0.013010974042117596, + 0.6979907704517245, + 0.8176554627716541, + 0.926582220941782, + 1.2805544603616, + 0.45199580304324627, + 0.45189671963453293, + 0.36553546227514744, + 0.19768700562417507, + 0.5390489920973778, + 0.539790153503418 + ], + "unique_experts": 64, + "load_cv": 0.6899566008868321, + "normalized_load_entropy": 0.9542790102408568, + "max_load_share": 0.07992202729044834 + } + }, + "s0_x": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "067feda3a5e58db515e82ae25a15b30d07bb436c284bc604a239c8ecc3122d63", + "route_weight_sha256": "9f5c202c2228c90b996a0398ee1712fc6232d8d6d403ace4ce18561b4118bc76", + "loads": [ + 4, + 12, + 17, + 2, + 5, + 21, + 9, + 3, + 7, + 20, + 20, + 23, + 1, + 12, + 8, + 7, + 6, + 7, + 2, + 14, + 30, + 20, + 21, + 22, + 22, + 4, + 17, + 0, + 21, + 14, + 15, + 77, + 15, + 15, + 12, + 12, + 1, + 5, + 14, + 5, + 30, + 10, + 8, + 11, + 2, + 12, + 22, + 14, + 2, + 14, + 19, + 6, + 10, + 1, + 1, + 0, + 12, + 24, + 11, + 4, + 9, + 4, + 6, + 6 + ], + "weighted_loads": [ + 0.12912637554109097, + 0.4907492734491825, + 0.7824268490076065, + 0.06129631958901882, + 0.15787240490317345, + 1.2015225198119879, + 0.5508791096508503, + 0.13803670555353165, + 0.31629928946495056, + 1.4537943229079247, + 0.8754380326718092, + 0.8942658677697182, + 0.03458124026656151, + 0.45788076147437096, + 0.3099943548440933, + 0.22635419107973576, + 0.26977345906198025, + 0.30559965409338474, + 0.07160800695419312, + 0.4683614633977413, + 1.7819519732147455, + 0.8135728817433119, + 1.490269236266613, + 1.6726075634360313, + 1.6910970844328403, + 0.11588647775352001, + 0.884406253695488, + 0.0, + 0.7191406227648258, + 0.7904122658073902, + 0.8360690958797932, + 3.3515497241169214, + 0.7667092233896255, + 0.8116886802017689, + 0.6424192581325769, + 0.5141299664974213, + 0.02407182939350605, + 0.24044443853199482, + 0.9858323074877262, + 0.1734911072999239, + 1.7163178604096174, + 0.528319925069809, + 0.7256001085042953, + 0.8817997612059116, + 0.09645605832338333, + 0.41619280166924, + 1.2769857849925756, + 1.104311853647232, + 0.07789894938468933, + 0.6168536115437746, + 1.3640393875539303, + 0.3423955850303173, + 0.49885213002562523, + 0.03507397696375847, + 0.03303258493542671, + 0.0, + 0.6441150605678558, + 1.294074347242713, + 0.4469457194209099, + 0.1704728789627552, + 0.3426158167421818, + 0.14860401675105095, + 0.23081335611641407, + 0.44976356998085976 + ], + "unique_experts": 62, + "load_cv": 0.9145906202393772, + "normalized_load_entropy": 0.9196619229901056, + "max_load_share": 0.09871794871794871 + }, + "full_input": { + "tokens": 155, + "top_k": 6, + "decisions": 930, + "ordered_route_sha256": "9c323e156486b568de2b970c69c67ae4cab9647d4f1565926be10352fab2909e", + "route_weight_sha256": "19d791668bdc9230b9398f9866c238375c6d1fbd913d33b729bc8e614ff24c25", + "loads": [ + 4, + 13, + 19, + 2, + 10, + 21, + 12, + 3, + 8, + 20, + 30, + 23, + 5, + 15, + 10, + 11, + 7, + 11, + 2, + 16, + 30, + 26, + 21, + 23, + 22, + 5, + 25, + 5, + 25, + 14, + 18, + 78, + 16, + 15, + 13, + 24, + 1, + 5, + 14, + 6, + 31, + 10, + 14, + 11, + 2, + 12, + 22, + 14, + 15, + 17, + 19, + 13, + 22, + 2, + 5, + 3, + 15, + 24, + 15, + 8, + 9, + 4, + 9, + 6 + ], + "weighted_loads": [ + 0.12912637554109097, + 0.5712776966392994, + 0.8562188968062401, + 0.06129631958901882, + 0.3499932885169983, + 1.2015225198119879, + 0.8677412681281567, + 0.13803670555353165, + 0.3787849359214306, + 1.4537943229079247, + 1.7899778131395578, + 0.8942658677697182, + 0.2258233092725277, + 0.7092488743364811, + 0.393433541059494, + 0.37708906829357147, + 0.28303583431988955, + 0.4543249662965536, + 0.07160800695419312, + 1.0469915345311165, + 1.7819519732147455, + 1.2307147765532136, + 1.490269236266613, + 1.7153722867369652, + 1.6910970844328403, + 0.15100091509521008, + 1.2571829333901405, + 0.5297104604542255, + 0.8574092881754041, + 0.7904122658073902, + 0.9942082017660141, + 3.388380715623498, + 0.789561839774251, + 0.8116886802017689, + 0.6921680886298418, + 1.218493513762951, + 0.02407182939350605, + 0.24044443853199482, + 0.9858323074877262, + 0.21280757896602154, + 1.7670186068862677, + 0.528319925069809, + 1.0534356273710728, + 0.8817997612059116, + 0.09645605832338333, + 0.41619280166924, + 1.2769857849925756, + 1.104311853647232, + 0.7914149332791567, + 0.9350204784423113, + 1.3640393875539303, + 0.6629330776631832, + 1.3338708747178316, + 0.048084951005876064, + 0.1625193702057004, + 0.4381554387509823, + 0.8181880377233028, + 1.294074347242713, + 0.5812332909554243, + 0.3348391428589821, + 0.3426158167421818, + 0.14860401675105095, + 0.34823486395180225, + 0.44976356998085976 + ], + "unique_experts": 64, + "load_cv": 0.770261820457546, + "normalized_load_entropy": 0.9414144846221985, + "max_load_share": 0.08387096774193549 + } + }, + "s1_x": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "014478ecc78dce14bf73e7d9a907da7d052a059bd6a273d040ba6e10b5ac7615", + "route_weight_sha256": "c7170c84bd2596a0b217423dfd51902a579e413205e8e5497df88fd6e01981b4", + "loads": [ + 5, + 13, + 14, + 3, + 6, + 25, + 10, + 4, + 6, + 20, + 19, + 21, + 1, + 11, + 5, + 5, + 6, + 6, + 2, + 19, + 29, + 22, + 21, + 22, + 22, + 6, + 16, + 0, + 23, + 14, + 14, + 78, + 15, + 14, + 12, + 12, + 0, + 7, + 13, + 4, + 27, + 9, + 10, + 9, + 2, + 9, + 21, + 14, + 2, + 14, + 19, + 9, + 10, + 1, + 1, + 0, + 14, + 23, + 10, + 4, + 9, + 4, + 6, + 8 + ], + "weighted_loads": [ + 0.17090039514005184, + 0.525235379114747, + 0.6861040592193604, + 0.09114464558660984, + 0.18715585581958294, + 1.3281760476529598, + 0.5767001751810312, + 0.17044734582304955, + 0.283259617164731, + 1.4755734391510487, + 0.8354743365198374, + 0.80956088937819, + 0.03395869582891464, + 0.4277143385261297, + 0.1943271942436695, + 0.16518874280154705, + 0.25485290214419365, + 0.26181503385305405, + 0.07335647568106651, + 0.6051169242709875, + 1.7289064433425665, + 0.8891670871526003, + 1.4766213707625866, + 1.7330147437751293, + 1.6997899003326893, + 0.16737288609147072, + 0.8185820784419775, + 0.0, + 0.7766437698155642, + 0.801803432404995, + 0.7795791774988174, + 3.3652711380273104, + 0.7389482352882624, + 0.7691032849252224, + 0.6418529972434044, + 0.502579540014267, + 0.0, + 0.3104026038199663, + 0.931111216545105, + 0.1147246565669775, + 1.597850538790226, + 0.4798172824084759, + 0.8016015402972698, + 0.7968253903090954, + 0.10016747936606407, + 0.3132116161286831, + 1.2406204603612423, + 1.093337006866932, + 0.08000322803854942, + 0.6145884916186333, + 1.3782544359564781, + 0.4711623750627041, + 0.48715953901410103, + 0.034617792814970016, + 0.033728960901498795, + 0.0, + 0.6986102499067783, + 1.2529711686074734, + 0.4242796581238508, + 0.17679739743471146, + 0.35270635038614273, + 0.14379942417144775, + 0.2276584692299366, + 0.4950390197336674 + ], + "unique_experts": 61, + "load_cv": 0.916543832544671, + "normalized_load_entropy": 0.9197772600060226, + "max_load_share": 0.1 + }, + "full_input": { + "tokens": 171, + "top_k": 6, + "decisions": 1026, + "ordered_route_sha256": "9f089c53fe4da99d1a3d0656abd891fbd842e6276a40b91d8fcc193e0c5689c9", + "route_weight_sha256": "4e26c808e2231eb3bdf9c537b79058e44fd7043b85392d33877776064b4ea838", + "loads": [ + 13, + 16, + 16, + 3, + 7, + 27, + 14, + 5, + 10, + 23, + 30, + 21, + 9, + 21, + 12, + 8, + 7, + 11, + 5, + 21, + 30, + 27, + 22, + 28, + 23, + 11, + 24, + 8, + 25, + 15, + 20, + 79, + 16, + 18, + 12, + 30, + 1, + 8, + 14, + 4, + 28, + 13, + 19, + 10, + 4, + 10, + 21, + 14, + 15, + 19, + 20, + 19, + 22, + 2, + 11, + 9, + 19, + 23, + 12, + 10, + 10, + 5, + 8, + 9 + ], + "weighted_loads": [ + 0.6832920871675014, + 0.7024440858513117, + 1.3799159824848175, + 0.09114464558660984, + 0.21808191947638988, + 1.3808936653658748, + 0.7681255508214235, + 0.2514042444527149, + 0.45221294090151787, + 1.6532845497131348, + 1.763534352183342, + 0.80956088937819, + 0.4138321727514267, + 0.9428901840001345, + 0.48764074966311455, + 0.31474170461297035, + 0.26811527740210295, + 0.4643722176551819, + 0.1760401576757431, + 1.1674332153052092, + 1.7768067512661219, + 1.2753204284235835, + 1.5076293107122183, + 2.2665560841560364, + 1.7359984815120697, + 0.35408525355160236, + 1.1161217503249645, + 0.7899917103350163, + 0.807743894867599, + 0.8506796136498451, + 1.101555485278368, + 3.403297470882535, + 0.7616652902215719, + 1.365261759608984, + 0.6418529972434044, + 1.4923359714448452, + 0.0693967193365097, + 0.35164677910506725, + 0.9854025170207024, + 0.1147246565669775, + 1.6507156565785408, + 0.7197586633265018, + 1.2811868712306023, + 0.8387277759611607, + 0.19548851251602173, + 0.37124526500701904, + 1.2406204603612423, + 1.093337006866932, + 1.093710232526064, + 1.6548580043017864, + 1.433173667639494, + 1.1817319095134735, + 1.2872073650360107, + 0.04762876685708761, + 0.6709343688562512, + 0.7088340558111668, + 0.938799949362874, + 1.2529711686074734, + 0.4779153261333704, + 0.48723095655441284, + 0.37510110065340996, + 0.2059793695807457, + 0.2986784689128399, + 0.5824145041406155 + ], + "unique_experts": 64, + "load_cv": 0.6870425608652825, + "normalized_load_entropy": 0.9535357805261314, + "max_load_share": 0.0769980506822612 + } + }, + "s0_period": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "b96c09ae56e669c6a82bf00cea092f98b06bc9e7f9728f5fcd48ef4fcaf50998", + "route_weight_sha256": "562bfbc9d3128609e86f460b521ed63662133dd926493648a9642a5c1cb495a1", + "loads": [ + 4, + 12, + 17, + 2, + 7, + 21, + 8, + 3, + 8, + 21, + 18, + 23, + 1, + 11, + 8, + 8, + 5, + 7, + 2, + 16, + 29, + 20, + 21, + 21, + 22, + 4, + 16, + 0, + 19, + 14, + 15, + 77, + 15, + 15, + 12, + 13, + 1, + 6, + 14, + 2, + 30, + 10, + 8, + 11, + 2, + 13, + 22, + 14, + 2, + 12, + 19, + 7, + 10, + 1, + 1, + 0, + 13, + 24, + 8, + 4, + 12, + 4, + 8, + 7 + ], + "weighted_loads": [ + 0.12684889324009418, + 0.4820079691708088, + 0.786512540653348, + 0.0636900756508112, + 0.22548162937164307, + 1.212773535400629, + 0.5179117005318403, + 0.13818582892417908, + 0.35711571015417576, + 1.4901420697569847, + 0.808992974460125, + 0.88832863047719, + 0.0339360274374485, + 0.43323494121432304, + 0.3122523743659258, + 0.26469763182103634, + 0.23532205447554588, + 0.30222577042877674, + 0.07218218967318535, + 0.5250294785946608, + 1.7560710441321135, + 0.8158757425844669, + 1.492174282670021, + 1.6017761938273907, + 1.691625852137804, + 0.11311634816229343, + 0.8389218412339687, + 0.0, + 0.6648011729121208, + 0.7958850879222155, + 0.82401542365551, + 3.3457502461969852, + 0.7666793335229158, + 0.8132315054535866, + 0.6600125171244144, + 0.538913156837225, + 0.023685185238718987, + 0.26984260417521, + 0.9833639897406101, + 0.058354372158646584, + 1.721954233944416, + 0.5246708616614342, + 0.7346747741103172, + 0.8586021456867456, + 0.0973450057208538, + 0.442789938300848, + 1.274684775620699, + 1.1130839847028255, + 0.07933101803064346, + 0.5598730780184269, + 1.365945652127266, + 0.37744978815317154, + 0.4987702164798975, + 0.03592367097735405, + 0.033950455486774445, + 0.0, + 0.6593130473047495, + 1.3147743362933397, + 0.36235908046364784, + 0.16520724073052406, + 0.455653415992856, + 0.1454419419169426, + 0.2958239559084177, + 0.4776129238307476 + ], + "unique_experts": 62, + "load_cv": 0.9080109537754486, + "normalized_load_entropy": 0.9205748457288694, + "max_load_share": 0.09871794871794871 + }, + "full_input": { + "tokens": 155, + "top_k": 6, + "decisions": 930, + "ordered_route_sha256": "6f80859b63b4d838dd267005690f6065cf70be8200db73299363e0fa35f461db", + "route_weight_sha256": "9a078c2f2140806cc8e3331c2831cc3b6b4944c7e519e6cd89d59d8086e11d76", + "loads": [ + 4, + 13, + 19, + 2, + 14, + 21, + 11, + 3, + 9, + 21, + 26, + 23, + 6, + 15, + 10, + 13, + 6, + 11, + 2, + 18, + 29, + 26, + 21, + 22, + 22, + 5, + 24, + 5, + 23, + 14, + 19, + 78, + 16, + 15, + 13, + 24, + 1, + 6, + 14, + 3, + 32, + 10, + 13, + 11, + 2, + 13, + 22, + 14, + 14, + 15, + 19, + 15, + 21, + 2, + 5, + 4, + 15, + 24, + 10, + 8, + 12, + 4, + 11, + 7 + ], + "weighted_loads": [ + 0.12684889324009418, + 0.5700215213000774, + 0.8603045884519815, + 0.0636900756508112, + 0.4936681464314461, + 1.212773535400629, + 0.8729882296174765, + 0.13818582892417908, + 0.4196013566106558, + 1.4901420697569847, + 1.6344523504376411, + 0.88832863047719, + 0.2628866359591484, + 0.7218412533402443, + 0.3941873852163553, + 0.4806930758059025, + 0.24858442973345518, + 0.4511044453829527, + 0.07218218967318535, + 1.103659549728036, + 1.7560710441321135, + 1.2330176373943686, + 1.492174282670021, + 1.6445409171283245, + 1.691625852137804, + 0.1482307855039835, + 1.2116985209286213, + 0.49393701925873756, + 0.7996804984286427, + 0.7958850879222155, + 1.0295692887157202, + 3.3806578665971756, + 0.7895319499075413, + 0.8132315054535866, + 0.7097613476216793, + 1.1787619553506374, + 0.023685185238718987, + 0.26984260417521, + 0.9833639897406101, + 0.10174625180661678, + 1.8093335144221783, + 0.5246708616614342, + 1.0297032967209816, + 0.8586021456867456, + 0.0973450057208538, + 0.442789938300848, + 1.274684775620699, + 1.1130839847028255, + 0.740757666528225, + 0.9270878992974758, + 1.365945652127266, + 0.7577351108193398, + 1.1461967453360558, + 0.048934645019471645, + 0.16343724075704813, + 0.49529803171753883, + 0.7864824216812849, + 1.3147743362933397, + 0.41464126482605934, + 0.3724348545074463, + 0.455653415992856, + 0.1454419419169426, + 0.426459776237607, + 0.4776129238307476 + ], + "unique_experts": 64, + "load_cv": 0.7592311620657628, + "normalized_load_entropy": 0.9431137779137984, + "max_load_share": 0.08387096774193549 + } + }, + "s1_period": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "8efa6d9c366659a139cc643eee208d550189dc894f909c7ae30d1ccee8a3063d", + "route_weight_sha256": "846100006beac5bab717ef7e431aebe99c425a32f46b971c2166d6d5717e91b9", + "loads": [ + 5, + 10, + 14, + 3, + 7, + 24, + 9, + 4, + 6, + 20, + 18, + 21, + 1, + 9, + 7, + 6, + 5, + 5, + 2, + 17, + 28, + 22, + 20, + 23, + 23, + 5, + 15, + 0, + 24, + 16, + 14, + 78, + 15, + 14, + 12, + 12, + 0, + 7, + 13, + 5, + 26, + 10, + 9, + 9, + 3, + 9, + 23, + 14, + 2, + 12, + 20, + 8, + 10, + 1, + 2, + 0, + 14, + 23, + 11, + 4, + 10, + 4, + 9, + 8 + ], + "weighted_loads": [ + 0.17002882808446884, + 0.430862283334136, + 0.6929897330701351, + 0.09065554663538933, + 0.22297786734998226, + 1.301881605759263, + 0.5258270241320133, + 0.1696496307849884, + 0.28520987182855606, + 1.4840986877679825, + 0.8017358649522066, + 0.8067611902952194, + 0.03412657976150513, + 0.3740829825401306, + 0.26710252836346626, + 0.1994395460933447, + 0.234568877145648, + 0.23335814103484154, + 0.06191776506602764, + 0.5569365471601486, + 1.722195491194725, + 0.883612371981144, + 1.4483552128076553, + 1.780257584527135, + 1.7190649379044771, + 0.1416339948773384, + 0.7858823277056217, + 0.0, + 0.810172600671649, + 0.8612219709903002, + 0.7479269206523895, + 3.342166278511286, + 0.7419395670294762, + 0.7754349261522293, + 0.612355250865221, + 0.5013907421380281, + 0.0, + 0.31546153873205185, + 0.9203794505447149, + 0.16629604063928127, + 1.5539425499737263, + 0.5092179328203201, + 0.7657946310937405, + 0.77756467461586, + 0.12356683053076267, + 0.32291198894381523, + 1.3254708964377642, + 1.088753629475832, + 0.08408771455287933, + 0.5673642233014107, + 1.4126214813441038, + 0.41510068252682686, + 0.4839234594255686, + 0.034836627542972565, + 0.05559275113046169, + 0.0, + 0.6965116877108812, + 1.276248212903738, + 0.4534213989973068, + 0.16604678332805634, + 0.3886541295796633, + 0.1470640879124403, + 0.32049358636140823, + 0.5000304821878672 + ], + "unique_experts": 61, + "load_cv": 0.9110180995162969, + "normalized_load_entropy": 0.9217224154834653, + "max_load_share": 0.1 + }, + "full_input": { + "tokens": 171, + "top_k": 6, + "decisions": 1026, + "ordered_route_sha256": "0643223671a53bf472ddd5f4783052f420aa9696a5d23fafba23413927baf1c4", + "route_weight_sha256": "df805a608497a6bf555a59397a4415f865bd2438c7a1bcfd12a97e44f5d1833f", + "loads": [ + 13, + 12, + 16, + 3, + 8, + 26, + 14, + 5, + 10, + 23, + 27, + 21, + 8, + 20, + 14, + 9, + 6, + 10, + 6, + 19, + 29, + 27, + 21, + 29, + 25, + 8, + 23, + 8, + 26, + 17, + 19, + 79, + 16, + 18, + 12, + 31, + 1, + 8, + 14, + 5, + 27, + 13, + 18, + 10, + 4, + 10, + 23, + 14, + 14, + 17, + 21, + 19, + 21, + 2, + 13, + 11, + 19, + 23, + 14, + 11, + 11, + 5, + 11, + 9 + ], + "weighted_loads": [ + 0.6824205201119184, + 0.5838160719722509, + 1.3868016563355923, + 0.09065554663538933, + 0.26391824148595333, + 1.3496509501710534, + 0.8091464452445507, + 0.2506065294146538, + 0.4779032077640295, + 1.6618097983300686, + 1.6749439928680658, + 0.8067611902952194, + 0.38609491661190987, + 0.9368187822401524, + 0.5661951377987862, + 0.35188915207982063, + 0.2478312524035573, + 0.4359153248369694, + 0.21437853761017323, + 1.1192528381943703, + 1.7700957991182804, + 1.2697657132521272, + 1.479363152757287, + 2.3283245358616114, + 1.7774291690438986, + 0.23724103160202503, + 1.0834219995886087, + 0.7719232924282551, + 0.8412727257236838, + 0.9100981522351503, + 1.024850046262145, + 3.379693880677223, + 0.7646566219627857, + 1.371593400835991, + 0.612355250865221, + 1.5024139788001776, + 0.0693967193365097, + 0.3567057140171528, + 0.9746707510203123, + 0.16629604063928127, + 1.6097555346786976, + 0.6759358644485474, + 1.2628651708364487, + 0.8194670602679253, + 0.18714833445847034, + 0.3809456378221512, + 1.3254708964377642, + 1.088753629475832, + 0.936389148235321, + 1.6812244169414043, + 1.4675407130271196, + 1.1878695152699947, + 1.0819752309471369, + 0.04784760158509016, + 0.723261664621532, + 0.7610865496098995, + 0.949559785425663, + 1.276248212903738, + 0.5341008622199297, + 0.5423423573374748, + 0.4110488798469305, + 0.20924403332173824, + 0.3880351111292839, + 0.5874059665948153 + ], + "unique_experts": 64, + "load_cv": 0.6786733844662325, + "normalized_load_entropy": 0.9550777690556659, + "max_load_share": 0.0769980506822612 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 130, + "ordered_topk_exact_tokens": 77, + "set_exact_tokens": 92, + "mean_set_jaccard": 0.9148351648351649, + "mean_token_weighted_tv": 0.013622292023725235, + "aggregate_load_tv": 0.029487179487179493 + }, + "system_bos": { + "tokens": 130, + "ordered_topk_exact_tokens": 69, + "set_exact_tokens": 95, + "mean_set_jaccard": 0.9214285714285715, + "mean_token_weighted_tv": 0.013633874939897886, + "aggregate_load_tv": 0.026923076923076925 + }, + "system_x": { + "tokens": 130, + "ordered_topk_exact_tokens": 60, + "set_exact_tokens": 75, + "mean_set_jaccard": 0.8642857142857143, + "mean_token_weighted_tv": 0.021777553777568615, + "aggregate_load_tv": 0.04230769230769231 + }, + "system_period": { + "tokens": 130, + "ordered_topk_exact_tokens": 52, + "set_exact_tokens": 67, + "mean_set_jaccard": 0.8565934065934067, + "mean_token_weighted_tv": 0.022734801994206813, + "aggregate_load_tv": 0.048717948717948725 + }, + "bos_at_s0": { + "tokens": 130, + "ordered_topk_exact_tokens": 63, + "set_exact_tokens": 83, + "mean_set_jaccard": 0.8904761904761905, + "mean_token_weighted_tv": 0.017068346145634468, + "aggregate_load_tv": 0.041025641025641026 + }, + "bos_at_s1": { + "tokens": 130, + "ordered_topk_exact_tokens": 52, + "set_exact_tokens": 68, + "mean_set_jaccard": 0.8587912087912088, + "mean_token_weighted_tv": 0.021724088303744792, + "aggregate_load_tv": 0.04102564102564103 + }, + "x_at_s0": { + "tokens": 130, + "ordered_topk_exact_tokens": 57, + "set_exact_tokens": 77, + "mean_set_jaccard": 0.8802197802197802, + "mean_token_weighted_tv": 0.018992837740538213, + "aggregate_load_tv": 0.04102564102564103 + }, + "x_at_s1": { + "tokens": 130, + "ordered_topk_exact_tokens": 51, + "set_exact_tokens": 66, + "mean_set_jaccard": 0.8461538461538461, + "mean_token_weighted_tv": 0.025049130195895067, + "aggregate_load_tv": 0.05256410256410256 + }, + "period_at_s0": { + "tokens": 130, + "ordered_topk_exact_tokens": 69, + "set_exact_tokens": 84, + "mean_set_jaccard": 0.8956043956043956, + "mean_token_weighted_tv": 0.017401716514275623, + "aggregate_load_tv": 0.03461538461538462 + }, + "period_at_s1": { + "tokens": 130, + "ordered_topk_exact_tokens": 48, + "set_exact_tokens": 64, + "mean_set_jaccard": 0.845054945054945, + "mean_token_weighted_tv": 0.025438670871349482, + "aggregate_load_tv": 0.04487179487179487 + } + } + }, + "layer_22": { + "layer": 22, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "0df1b7c79c39e59b9ecac48a5c376e7bdc002ab4633b1def1806548881682013", + "route_weight_sha256": "16c925996151a77f71ac92bffea1afb83426cc82e6a16cf7f7995ba7ca90d107", + "loads": [ + 2, + 8, + 38, + 3, + 22, + 7, + 2, + 6, + 18, + 2, + 18, + 3, + 27, + 11, + 0, + 19, + 25, + 10, + 13, + 13, + 13, + 8, + 9, + 13, + 3, + 11, + 67, + 5, + 19, + 1, + 9, + 13, + 21, + 1, + 3, + 8, + 19, + 18, + 28, + 17, + 13, + 5, + 7, + 4, + 4, + 9, + 26, + 7, + 8, + 10, + 3, + 23, + 8, + 9, + 7, + 5, + 27, + 0, + 4, + 27, + 8, + 0, + 6, + 27 + ], + "weighted_loads": [ + 0.08131993561983109, + 0.27431148290634155, + 2.859713466838002, + 0.25615594908595085, + 1.9823705926537514, + 0.2622890342026949, + 0.05445490684360266, + 0.3059572000056505, + 0.7556118238717318, + 0.12565545737743378, + 0.9932184927165508, + 0.4139804281294346, + 1.4512928500771523, + 0.488774411380291, + 0.0, + 0.7135657481849194, + 1.464015755802393, + 0.9078659545630217, + 0.764706315472722, + 0.43336817622184753, + 0.5146764926612377, + 0.5113095678389072, + 0.34301522374153137, + 0.8698180727660656, + 0.10493901744484901, + 0.7448066845536232, + 4.040479574352503, + 0.19314546883106232, + 1.1324964761734009, + 0.05615554377436638, + 0.359455693513155, + 0.9996071048080921, + 0.6985063850879669, + 0.025611456483602524, + 0.13554716855287552, + 0.30611143074929714, + 1.1073011420667171, + 0.6841590609401464, + 2.1303456015884876, + 0.8051193337887526, + 0.7964888587594032, + 0.37542377784848213, + 0.6665701754391193, + 0.16696451790630817, + 0.16865371353924274, + 0.3112196931615472, + 1.9203752167522907, + 0.43072084710001945, + 0.34476290084421635, + 0.6379019655287266, + 0.08137424662709236, + 1.3322652075439692, + 0.3446192927658558, + 0.30458008497953415, + 0.305325698107481, + 0.22639211267232895, + 1.8140367567539215, + 0.0, + 0.15317595191299915, + 1.5768160447478294, + 0.6470787972211838, + 0.0, + 0.24138236232101917, + 0.9809833820909262 + ], + "unique_experts": 61, + "load_cv": 0.9081267973575581, + "normalized_load_entropy": 0.9151105817366803, + "max_load_share": 0.0858974358974359 + }, + "full_input": { + "tokens": 155, + "top_k": 6, + "decisions": 930, + "ordered_route_sha256": "9688265d232721dc36b220732d82a6d62f7fc0c0af69899946438bee340dceb1", + "route_weight_sha256": "9bae70d057040265f15f4cdf907694270b6930d234e7d67b3e880462c3014325", + "loads": [ + 7, + 9, + 40, + 12, + 22, + 11, + 7, + 6, + 32, + 7, + 18, + 5, + 27, + 11, + 5, + 19, + 25, + 11, + 13, + 13, + 13, + 15, + 10, + 13, + 3, + 13, + 68, + 8, + 19, + 1, + 10, + 14, + 25, + 9, + 5, + 9, + 19, + 19, + 28, + 18, + 17, + 5, + 12, + 4, + 4, + 11, + 27, + 7, + 12, + 12, + 7, + 23, + 8, + 11, + 7, + 18, + 31, + 1, + 5, + 27, + 16, + 8, + 6, + 32 + ], + "weighted_loads": [ + 0.3011954762041569, + 0.3195273280143738, + 2.942876560613513, + 2.1255512200295925, + 1.9823705926537514, + 0.5104899434372783, + 0.33996209781616926, + 0.3059572000056505, + 2.000502109527588, + 0.3223750926554203, + 0.9932184927165508, + 0.4434203300625086, + 1.4512928500771523, + 0.488774411380291, + 0.5522201340645552, + 0.7135657481849194, + 1.464015755802393, + 0.9336495921015739, + 0.764706315472722, + 0.43336817622184753, + 0.5146764926612377, + 1.1086402852088213, + 0.37315965816378593, + 0.8698180727660656, + 0.10493901744484901, + 0.8058276958763599, + 4.0954860262572765, + 0.31792823038995266, + 1.1324964761734009, + 0.05615554377436638, + 0.3926805146038532, + 1.026116380468011, + 0.8246265728957951, + 0.3129095211625099, + 0.22520834766328335, + 0.3477527778595686, + 1.1073011420667171, + 0.7093581426888704, + 2.1303456015884876, + 0.8350390456616879, + 1.0746466927230358, + 0.37542377784848213, + 1.2343409731984138, + 0.16696451790630817, + 0.16865371353924274, + 0.38168752286583185, + 1.962713897228241, + 0.43072084710001945, + 0.5368207097053528, + 0.8270810134708881, + 0.30540481582283974, + 1.3322652075439692, + 0.3446192927658558, + 0.3971497677266598, + 0.305325698107481, + 1.3230310906656086, + 1.9747390132397413, + 0.02548844739794731, + 0.19491630606353283, + 1.5768160447478294, + 1.8411764614284039, + 0.2831717152148485, + 0.24138236232101917, + 1.1627853885293007 + ], + "unique_experts": 64, + "load_cv": 0.746453440641127, + "normalized_load_entropy": 0.9441338428035032, + "max_load_share": 0.07311827956989247 + } + }, + "s1_eos": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "dd617a9545f4ab261b85213bb4234f9b4acf43ad41e612d781d7d9f38e1a233f", + "route_weight_sha256": "97059e7b557559ee3a341286f8c53213f358694f2ba54d7155b961efb4f9315c", + "loads": [ + 2, + 6, + 37, + 5, + 22, + 9, + 2, + 6, + 15, + 3, + 18, + 5, + 27, + 12, + 0, + 19, + 25, + 9, + 12, + 12, + 12, + 8, + 10, + 13, + 3, + 10, + 67, + 5, + 18, + 1, + 9, + 11, + 18, + 4, + 4, + 9, + 19, + 16, + 28, + 17, + 13, + 5, + 7, + 4, + 5, + 9, + 26, + 9, + 6, + 11, + 2, + 22, + 7, + 9, + 11, + 4, + 27, + 1, + 7, + 26, + 8, + 0, + 6, + 27 + ], + "weighted_loads": [ + 0.08099978417158127, + 0.2025772277265787, + 2.8493131268769503, + 0.3299793656915426, + 1.9591201953589916, + 0.30403839983046055, + 0.056039221584796906, + 0.3086909893900156, + 0.6373031008988619, + 0.1659124307334423, + 1.0263362545520067, + 0.46715138852596283, + 1.4569861516356468, + 0.5192601289600134, + 0.0, + 0.6860537752509117, + 1.4700039215385914, + 0.8557496666908264, + 0.738103810697794, + 0.388196574524045, + 0.4784553125500679, + 0.5060745514929295, + 0.3731564823538065, + 0.8808450140058994, + 0.10845093429088593, + 0.7167639285326004, + 4.028925307095051, + 0.1950724646449089, + 1.1032447572797537, + 0.05665097385644913, + 0.35674386844038963, + 0.92762615904212, + 0.618380943313241, + 0.11477649956941605, + 0.17446750402450562, + 0.33994660899043083, + 1.1024450846016407, + 0.6008901372551918, + 2.143794756382704, + 0.827175684273243, + 0.8078119792044163, + 0.36056702584028244, + 0.6666019149124622, + 0.16826731525361538, + 0.193023931235075, + 0.31174440775066614, + 1.8990468047559261, + 0.48866432905197144, + 0.2941537443548441, + 0.6610350552946329, + 0.06346921995282173, + 1.2841109149158, + 0.3253065440803766, + 0.3070305362343788, + 0.4365264605730772, + 0.192289799451828, + 1.8325653448700905, + 0.02813527174293995, + 0.24852676503360271, + 1.543842177838087, + 0.6326385103166103, + 0.0, + 0.24340894632041454, + 0.9968998767435551 + ], + "unique_experts": 62, + "load_cv": 0.8832281951497185, + "normalized_load_entropy": 0.922269260885486, + "max_load_share": 0.0858974358974359 + }, + "full_input": { + "tokens": 171, + "top_k": 6, + "decisions": 1026, + "ordered_route_sha256": "ac5847325e4a8096863ca09105093c5d51eae24e381da3fba1c73c542b98a926", + "route_weight_sha256": "c033d851338d2b87c0abbc4b12efef01d4aab9d4ac6e6259daa6e9afa8259efe", + "loads": [ + 5, + 12, + 37, + 16, + 22, + 12, + 8, + 7, + 36, + 12, + 18, + 10, + 30, + 12, + 5, + 23, + 28, + 11, + 13, + 12, + 13, + 21, + 12, + 13, + 4, + 11, + 68, + 7, + 19, + 1, + 10, + 11, + 21, + 13, + 12, + 13, + 21, + 17, + 29, + 19, + 24, + 6, + 12, + 6, + 5, + 12, + 27, + 11, + 10, + 13, + 11, + 25, + 12, + 12, + 11, + 25, + 32, + 2, + 10, + 26, + 22, + 10, + 6, + 32 + ], + "weighted_loads": [ + 0.2555143963545561, + 0.6966005004942417, + 2.8493131268769503, + 2.4640607219189405, + 1.9591201953589916, + 0.5187509143725038, + 0.3990496788173914, + 0.3505381066352129, + 2.4172918424010277, + 0.6232951879501343, + 1.0263362545520067, + 0.7706816475838423, + 1.5975056327879429, + 0.5192601289600134, + 0.5785723105072975, + 0.9210261330008507, + 1.616381499916315, + 0.9055927842855453, + 0.7774374336004257, + 0.388196574524045, + 0.5286422111093998, + 1.6100106313824654, + 0.45888043008744717, + 0.8808450140058994, + 0.1317728441208601, + 0.7422642912715673, + 4.085002947598696, + 0.2781444154679775, + 1.1868555527180433, + 0.05665097385644913, + 0.41132592409849167, + 0.92762615904212, + 0.7220213417895138, + 0.4456973746418953, + 0.5218143090605736, + 0.5036983899772167, + 1.1935072094202042, + 0.6229510493576527, + 2.1789356134831905, + 0.8961741682142019, + 1.5613304320722818, + 0.3860593866556883, + 1.2508916184306145, + 0.3063700031489134, + 0.193023931235075, + 0.4158415598794818, + 1.9335007891058922, + 0.5554197262972593, + 0.49079920910298824, + 1.124475160613656, + 0.5363482106477022, + 1.498233836144209, + 0.8762706946581602, + 0.44890908151865005, + 0.4365264605730772, + 1.8893823828548193, + 2.083799183368683, + 0.05318952351808548, + 0.3331750533543527, + 1.543842177838087, + 2.682888936251402, + 0.4162471741437912, + 0.24340894632041454, + 1.1958069819957018 + ], + "unique_experts": 64, + "load_cv": 0.6637276621084293, + "normalized_load_entropy": 0.9546272118639885, + "max_load_share": 0.06627680311890838 + } + }, + "s0_bos": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "fef74acd3e22b585b9a161d565e2d6441185e2f4928d1f09f742165991951003", + "route_weight_sha256": "50be6a636e29d87354853d9fc8b82af9ed4772e73271ae500d517b45f53f5fc6", + "loads": [ + 2, + 8, + 37, + 6, + 22, + 10, + 2, + 7, + 14, + 3, + 17, + 3, + 27, + 12, + 0, + 22, + 25, + 10, + 12, + 11, + 10, + 8, + 10, + 14, + 2, + 10, + 69, + 6, + 18, + 1, + 8, + 12, + 22, + 1, + 4, + 10, + 19, + 15, + 28, + 14, + 13, + 5, + 7, + 4, + 3, + 7, + 27, + 10, + 8, + 10, + 3, + 21, + 9, + 12, + 8, + 4, + 26, + 0, + 4, + 26, + 8, + 0, + 6, + 28 + ], + "weighted_loads": [ + 0.08474132418632507, + 0.2796932943165302, + 2.8595388252288103, + 0.37493542209267616, + 1.953236859291792, + 0.35379015654325485, + 0.05504529923200607, + 0.34210747480392456, + 0.6441029496490955, + 0.15772129595279694, + 0.9512717463076115, + 0.4125281013548374, + 1.4625378735363483, + 0.5178656280040741, + 0.0, + 0.8022904191166162, + 1.47256712988019, + 0.9323622919619083, + 0.7354344073683023, + 0.36137490160763264, + 0.4227724205702543, + 0.5047079659998417, + 0.3750546108931303, + 0.902210446074605, + 0.07511495798826218, + 0.7112861536443233, + 4.128759326413274, + 0.21464623138308525, + 1.1028183437883854, + 0.05197928473353386, + 0.3162180297076702, + 0.9571219570934772, + 0.7326243668794632, + 0.02593613602221012, + 0.17072076350450516, + 0.36686865240335464, + 1.1330081261694431, + 0.5753967557102442, + 2.15355172380805, + 0.7151505760848522, + 0.7912938967347145, + 0.36873775720596313, + 0.6625516302883625, + 0.16565585881471634, + 0.13606243953108788, + 0.2580712419003248, + 1.9472634810954332, + 0.5348197128623724, + 0.3491358794271946, + 0.6491129584610462, + 0.0818660669028759, + 1.273263357579708, + 0.3738261666148901, + 0.4094843603670597, + 0.34061012603342533, + 0.19480668008327484, + 1.7974507361650467, + 0.0, + 0.14952893741428852, + 1.553571866825223, + 0.6308834329247475, + 0.0, + 0.2356889508664608, + 1.005348477512598 + ], + "unique_experts": 61, + "load_cv": 0.9076633343195665, + "normalized_load_entropy": 0.9170984715274904, + "max_load_share": 0.08846153846153847 + }, + "full_input": { + "tokens": 155, + "top_k": 6, + "decisions": 930, + "ordered_route_sha256": "2503e9e8b743886b5a213d180a4fa4d53ee87a3e8988b1cba99c60e612e583bb", + "route_weight_sha256": "e107a82c1095e29aea583db5e5ab3b3e202cced253ea75b2e4c3ab4913338f21", + "loads": [ + 7, + 8, + 39, + 14, + 22, + 13, + 6, + 8, + 28, + 8, + 18, + 4, + 27, + 12, + 2, + 23, + 25, + 12, + 12, + 11, + 10, + 15, + 11, + 14, + 4, + 12, + 70, + 10, + 18, + 1, + 8, + 12, + 25, + 7, + 5, + 13, + 19, + 17, + 29, + 15, + 17, + 5, + 12, + 4, + 3, + 9, + 28, + 10, + 13, + 12, + 6, + 21, + 9, + 14, + 8, + 16, + 30, + 2, + 5, + 26, + 17, + 8, + 6, + 35 + ], + "weighted_loads": [ + 0.29742956906557083, + 0.2796932943165302, + 2.942701919004321, + 1.3532400615513325, + 1.953236859291792, + 0.5335243372246623, + 0.3335628807544708, + 1.2653040289878845, + 1.863831477239728, + 0.35444093123078346, + 0.9701654426753521, + 0.42498310655355453, + 1.4625378735363483, + 0.5178656280040741, + 0.4202946573495865, + 0.8447475042194128, + 1.47256712988019, + 0.9971733074635267, + 0.7354344073683023, + 0.36137490160763264, + 0.4227724205702543, + 1.104506628587842, + 0.40519904531538486, + 0.902210446074605, + 0.10252815019339323, + 0.7723071649670601, + 4.183371169492602, + 0.3750551212579012, + 1.1028183437883854, + 0.05197928473353386, + 0.3162180297076702, + 0.9571219570934772, + 0.85304144769907, + 0.24314689449965954, + 0.23583032935857773, + 0.4997030682861805, + 1.1330081261694431, + 0.6494374461472034, + 2.1879712268710136, + 0.7445112206041813, + 1.0754769258201122, + 0.36873775720596313, + 1.1006208322942257, + 0.16565585881471634, + 0.13606243953108788, + 0.3344062175601721, + 1.9896021615713835, + 0.5348197128623724, + 0.6440250091254711, + 0.7763947802595794, + 0.2588049918413162, + 1.273263357579708, + 0.3738261666148901, + 0.5000224970281124, + 0.34061012603342533, + 1.2848563874140382, + 1.9634240437299013, + 0.033775157295167446, + 0.19251294992864132, + 1.553571866825223, + 1.8928564749658108, + 0.2831717152148485, + 0.2356889508664608, + 1.2900000903755426 + ], + "unique_experts": 64, + "load_cv": 0.7533606826660612, + "normalized_load_entropy": 0.9436438786735564, + "max_load_share": 0.07526881720430108 + } + }, + "s1_bos": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "6e02ad4d08feeb0d56c77af72c5ffa8892ddd49c9d47bdded5cbe9752aafebdd", + "route_weight_sha256": "7968b51a7ad71df8b23c5630c72f83136953a0d7d61b3ea90d0e26b51dc5f65e", + "loads": [ + 3, + 8, + 37, + 5, + 23, + 7, + 2, + 6, + 18, + 2, + 17, + 5, + 27, + 11, + 0, + 18, + 25, + 9, + 12, + 11, + 10, + 8, + 7, + 13, + 4, + 10, + 70, + 6, + 19, + 1, + 9, + 13, + 20, + 1, + 3, + 8, + 19, + 19, + 28, + 15, + 13, + 6, + 7, + 4, + 4, + 6, + 28, + 10, + 7, + 9, + 1, + 21, + 9, + 11, + 9, + 5, + 28, + 0, + 6, + 26, + 8, + 0, + 6, + 27 + ], + "weighted_loads": [ + 0.10279547050595284, + 0.2722201608121395, + 2.8632460553199053, + 0.3342084437608719, + 1.9771761503070593, + 0.26190053299069405, + 0.054705675691366196, + 0.321608979254961, + 0.7620521895587444, + 0.1250825934112072, + 0.9594065230339766, + 0.499883184209466, + 1.4518769197165966, + 0.49148017540574074, + 0.0, + 0.6603386178612709, + 1.4731958881020546, + 0.8744165822863579, + 0.7237753812223673, + 0.36059301532804966, + 0.4248931724578142, + 0.49285322055220604, + 0.266291169449687, + 0.8677551001310349, + 0.1251776609569788, + 0.7120897620916367, + 4.156896686181426, + 0.21433011628687382, + 1.1349068004637957, + 0.05296998471021652, + 0.3466416448354721, + 0.9858608394861221, + 0.667152788490057, + 0.029088342562317848, + 0.13202915340662003, + 0.3024548925459385, + 1.1300129927694798, + 0.7026771865785122, + 2.132405733689666, + 0.7583901863545179, + 0.8032171912491322, + 0.4055994674563408, + 0.6639267466962337, + 0.1702296081930399, + 0.1606417242437601, + 0.22057541087269783, + 2.006363807246089, + 0.5017820186913013, + 0.32155520282685757, + 0.6124463304877281, + 0.03448041155934334, + 1.2877279426902533, + 0.38651404716074467, + 0.3668772801756859, + 0.37175386026501656, + 0.22445890679955482, + 1.8561755064874887, + 0.0, + 0.2192642167210579, + 1.5428030733019114, + 0.6148452833294868, + 0.0, + 0.23341215960681438, + 0.9912014361470938 + ], + "unique_experts": 61, + "load_cv": 0.9189508925575303, + "normalized_load_entropy": 0.9158470598486426, + "max_load_share": 0.08974358974358974 + }, + "full_input": { + "tokens": 171, + "top_k": 6, + "decisions": 1026, + "ordered_route_sha256": "f05ecdf7686ca4063b5c721f45ee24470447a30067df12feb57beb0f820528ca", + "route_weight_sha256": "8e0e5f4db36f14e07cb70d1489a486d0b3a7bad96e40790ba5cf1ce254a67d8d", + "loads": [ + 6, + 13, + 37, + 15, + 23, + 10, + 7, + 7, + 38, + 11, + 17, + 10, + 30, + 11, + 4, + 23, + 28, + 12, + 13, + 11, + 11, + 20, + 9, + 13, + 5, + 11, + 71, + 9, + 20, + 1, + 10, + 13, + 22, + 10, + 11, + 14, + 21, + 20, + 29, + 17, + 24, + 7, + 12, + 6, + 4, + 7, + 29, + 12, + 14, + 12, + 9, + 24, + 14, + 15, + 9, + 25, + 33, + 1, + 7, + 26, + 23, + 10, + 6, + 34 + ], + "weighted_loads": [ + 0.26062832213938236, + 0.7271742094308138, + 2.8632460553199053, + 1.5731852129101753, + 1.9771761503070593, + 0.4414097713306546, + 0.3971382640302181, + 0.3634560965001583, + 2.488781163468957, + 0.5824653506278992, + 0.9594065230339766, + 0.8342898916453123, + 1.5923964008688927, + 0.49148017540574074, + 0.4743860028684139, + 0.9375485815107822, + 1.6195734664797783, + 0.9760841429233551, + 0.763109004124999, + 0.36059301532804966, + 0.4750800710171461, + 1.5472792349755764, + 0.35220268554985523, + 0.8677551001310349, + 0.15172988548874855, + 0.7375901248306036, + 4.213099783286452, + 0.3377686906605959, + 1.2185175959020853, + 0.05296998471021652, + 0.3835339732468128, + 0.9858608394861221, + 0.7631633915007114, + 0.3600092176347971, + 0.479375958442688, + 0.5577019415795803, + 1.2210751175880432, + 0.7493051514029503, + 2.169727673754096, + 0.8277080729603767, + 1.5548981670290232, + 0.43109182827174664, + 1.2236261293292046, + 0.3083322960883379, + 0.1606417242437601, + 0.27213509753346443, + 2.040817791596055, + 0.5685374159365892, + 0.7275847569108009, + 1.1463812589645386, + 0.467333422973752, + 1.501850863918662, + 0.9374781977385283, + 0.5674286969006062, + 0.37175386026501656, + 1.918588505126536, + 2.1119096633046865, + 0.02505425177514553, + 0.26181215047836304, + 1.5428030733019114, + 2.750903107225895, + 0.4162471741437912, + 0.23341215960681438, + 1.3022405598312616 + ], + "unique_experts": 64, + "load_cv": 0.6979292544081359, + "normalized_load_entropy": 0.9501907373266961, + "max_load_share": 0.06920077972709551 + } + }, + "s0_x": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "2e4e449bb7cbaadafdac863e008cbbcae5806df54c461a53823115443ae2ca33", + "route_weight_sha256": "2b5ff44afe0dad980df0bfd3c10146de7b9ec1c2aa534fb02af9968fdc7a8a0a", + "loads": [ + 2, + 8, + 37, + 5, + 23, + 9, + 2, + 7, + 16, + 3, + 17, + 5, + 28, + 10, + 0, + 18, + 25, + 11, + 14, + 11, + 13, + 8, + 7, + 14, + 2, + 10, + 68, + 6, + 18, + 1, + 9, + 13, + 22, + 2, + 3, + 8, + 19, + 18, + 29, + 13, + 13, + 5, + 7, + 4, + 4, + 9, + 28, + 7, + 7, + 10, + 1, + 23, + 7, + 11, + 9, + 4, + 26, + 0, + 4, + 27, + 8, + 1, + 6, + 25 + ], + "weighted_loads": [ + 0.08366817235946655, + 0.27753927931189537, + 2.8466101326048374, + 0.33635086566209793, + 1.973731903359294, + 0.3277239724993706, + 0.0533331660553813, + 0.34443829022347927, + 0.7041211500763893, + 0.1627703532576561, + 0.9571973849087954, + 0.4967757146805525, + 1.4784099664539099, + 0.46049926057457924, + 0.0, + 0.6698018554598093, + 1.4653374552726746, + 0.9491936881095171, + 0.7937250509858131, + 0.37055934220552444, + 0.5056393947452307, + 0.4865889549255371, + 0.27058229595422745, + 0.8884176388382912, + 0.06938352063298225, + 0.7103500925004482, + 4.0723026636987925, + 0.2072176020592451, + 1.0815383046865463, + 0.050413962453603745, + 0.35332321748137474, + 0.9949272722005844, + 0.7173648588359356, + 0.05431606434285641, + 0.1279878094792366, + 0.30218135565519333, + 1.1472731940448284, + 0.6506663393229246, + 2.1588955000042915, + 0.6849936060607433, + 0.7846069931983948, + 0.378586009144783, + 0.6596131063997746, + 0.1679890975356102, + 0.16419756226241589, + 0.3078670920804143, + 1.9758269917219877, + 0.41551894694566727, + 0.31044538132846355, + 0.6439785342663527, + 0.033406659960746765, + 1.3279147520661354, + 0.31221188232302666, + 0.37048374488949776, + 0.382875120267272, + 0.20573139563202858, + 1.8000748343765736, + 0.0, + 0.15483331866562366, + 1.5847403444349766, + 0.6051875166594982, + 0.035172998905181885, + 0.23899673484265804, + 0.9067931100726128 + ], + "unique_experts": 62, + "load_cv": 0.9071996345112419, + "normalized_load_entropy": 0.917167465473977, + "max_load_share": 0.08717948717948718 + }, + "full_input": { + "tokens": 155, + "top_k": 6, + "decisions": 930, + "ordered_route_sha256": "c7848b29ae04621f8a05180506acb8e52c5595f0a02a6c0092ff388bcc8df0c5", + "route_weight_sha256": "175d42d3aeeedf59c2a6d331d79f31fdc95bcca41b990cac97deb634eef07afb", + "loads": [ + 7, + 9, + 39, + 15, + 23, + 11, + 7, + 7, + 30, + 9, + 17, + 6, + 28, + 10, + 3, + 18, + 25, + 14, + 14, + 11, + 13, + 16, + 8, + 14, + 3, + 12, + 69, + 8, + 18, + 1, + 10, + 13, + 25, + 10, + 4, + 10, + 19, + 18, + 29, + 14, + 17, + 5, + 12, + 4, + 4, + 11, + 29, + 7, + 10, + 12, + 5, + 23, + 7, + 13, + 9, + 19, + 30, + 1, + 5, + 27, + 16, + 10, + 6, + 31 + ], + "weighted_loads": [ + 0.29424262791872025, + 0.32181013375520706, + 2.929773226380348, + 1.4352481290698051, + 1.973731903359294, + 0.49757890682667494, + 0.39230926614254713, + 0.34443829022347927, + 1.9455309137701988, + 0.3896862380206585, + 0.9571973849087954, + 0.5092307198792696, + 1.4784099664539099, + 0.46049926057457924, + 0.48156096041202545, + 0.6698018554598093, + 1.4653374552726746, + 1.0520777888596058, + 0.7937250509858131, + 0.37055934220552444, + 0.5056393947452307, + 1.1564366985112429, + 0.300726730376482, + 0.8884176388382912, + 0.09264432452619076, + 0.771371103823185, + 4.125858748331666, + 0.2784140184521675, + 1.0815383046865463, + 0.050413962453603745, + 0.3977220542728901, + 0.9949272722005844, + 0.8446031510829926, + 0.3584532868117094, + 0.19309737533330917, + 0.36954167298972607, + 1.1472731940448284, + 0.6506663393229246, + 2.1588955000042915, + 0.7129689641296864, + 1.0555113665759563, + 0.378586009144783, + 1.2057997956871986, + 0.1679890975356102, + 0.16419756226241589, + 0.38100849930197, + 2.018165672197938, + 0.41551894694566727, + 0.45174413174390793, + 0.8954064529389143, + 0.2542858459055424, + 1.3279147520661354, + 0.31221188232302666, + 0.4684397652745247, + 0.382875120267272, + 1.535247034393251, + 1.9597753752022982, + 0.02548844739794731, + 0.19976543076336384, + 1.5847403444349766, + 1.8302870094776154, + 0.3736999686807394, + 0.23899673484265804, + 1.1214363146573305 + ], + "unique_experts": 64, + "load_cv": 0.747839992828276, + "normalized_load_entropy": 0.9438581417479417, + "max_load_share": 0.07419354838709677 + } + }, + "s1_x": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "e8026b65c2e52a0ae4dd30aaea7416954d792deb95f726e6b19643665f7e3590", + "route_weight_sha256": "f63882270665494e8ab16a59e4a9a820cf6cd0381aa117f695c36780741d0bef", + "loads": [ + 3, + 9, + 36, + 4, + 24, + 8, + 2, + 7, + 18, + 2, + 17, + 5, + 27, + 12, + 0, + 20, + 25, + 9, + 13, + 11, + 10, + 8, + 7, + 13, + 3, + 10, + 70, + 4, + 19, + 1, + 9, + 12, + 16, + 2, + 3, + 7, + 19, + 17, + 30, + 17, + 13, + 6, + 7, + 4, + 4, + 6, + 28, + 9, + 6, + 10, + 1, + 21, + 8, + 9, + 10, + 5, + 28, + 0, + 7, + 27, + 8, + 5, + 4, + 25 + ], + "weighted_loads": [ + 0.10895116627216339, + 0.29351507872343063, + 2.79759924672544, + 0.29100368916988373, + 1.9586367942392826, + 0.26973325572907925, + 0.05426671635359526, + 0.36013997718691826, + 0.8123136665672064, + 0.12868627905845642, + 0.9579502660781145, + 0.4779249094426632, + 1.4470558762550354, + 0.5184289664030075, + 0.0, + 0.7172161340713501, + 1.4519715644419193, + 0.8745323028415442, + 0.7538933157920837, + 0.3645760640501976, + 0.4156481437385082, + 0.4756927937269211, + 0.27346737682819366, + 0.8622326646000147, + 0.0963275209069252, + 0.7154057435691357, + 4.118542026728392, + 0.15435310080647469, + 1.1149499043822289, + 0.0521475188434124, + 0.35409895330667496, + 0.9369580689817667, + 0.551095750182867, + 0.05208534561097622, + 0.13345938362181187, + 0.24877920001745224, + 1.1029566675424576, + 0.6241983249783516, + 2.1929716262966394, + 0.828695522621274, + 0.798486951738596, + 0.406949196010828, + 0.6675491221249104, + 0.16909811459481716, + 0.15872193686664104, + 0.2179601900279522, + 2.00612966530025, + 0.4891854524612427, + 0.29024497605860233, + 0.6360920239239931, + 0.03459459915757179, + 1.2583715841174126, + 0.33671305887401104, + 0.30115142837166786, + 0.4055020585656166, + 0.25593816861510277, + 1.8444933518767357, + 0.0, + 0.26165699400007725, + 1.5886194966733456, + 0.5852258913218975, + 0.18339567258954048, + 0.17952264286577702, + 0.9411107767373323 + ], + "unique_experts": 62, + "load_cv": 0.9160846278400766, + "normalized_load_entropy": 0.9178855342390105, + "max_load_share": 0.08974358974358974 + }, + "full_input": { + "tokens": 171, + "top_k": 6, + "decisions": 1026, + "ordered_route_sha256": "d57b3c068351154b4b58b5dfa62d9c09e67dc97424956de65feedbf8e100edde", + "route_weight_sha256": "ec5de184027c3497c49d8e0525b00a89f4320d093a596255f5c33cf22037044f", + "loads": [ + 6, + 14, + 36, + 16, + 24, + 11, + 8, + 8, + 41, + 12, + 17, + 9, + 30, + 12, + 4, + 24, + 28, + 12, + 14, + 11, + 11, + 21, + 8, + 13, + 3, + 11, + 71, + 6, + 20, + 1, + 9, + 12, + 18, + 11, + 11, + 12, + 21, + 18, + 31, + 18, + 25, + 7, + 12, + 6, + 4, + 6, + 29, + 11, + 10, + 13, + 10, + 24, + 13, + 13, + 10, + 28, + 32, + 1, + 9, + 27, + 22, + 17, + 5, + 29 + ], + "weighted_loads": [ + 0.2704297434538603, + 0.7484691273421049, + 2.79759924672544, + 1.6180199719965458, + 1.9586367942392826, + 0.47099404875189066, + 0.4172105034813285, + 0.40198709443211555, + 2.664634235203266, + 0.6320432089269161, + 0.9579502660781145, + 0.7642418593168259, + 1.5875753574073315, + 0.5184289664030075, + 0.46424538269639015, + 0.9521884918212891, + 1.598349142819643, + 0.9631001334637403, + 0.7932269386947155, + 0.3645760640501976, + 0.4658350422978401, + 1.6034767553210258, + 0.3165196105837822, + 0.8622326646000147, + 0.0963275209069252, + 0.7409061063081026, + 4.170175094157457, + 0.2311810664832592, + 1.1985606998205185, + 0.0521475188434124, + 0.35409895330667496, + 0.9369580689817667, + 0.6429156139492989, + 0.38300622068345547, + 0.48080618865787983, + 0.43751851841807365, + 1.194018792361021, + 0.6535836458206177, + 2.2340250816196203, + 0.8695271592587233, + 1.5639866087585688, + 0.43244155682623386, + 1.2818258628249168, + 0.30720080249011517, + 0.15872193686664104, + 0.2179601900279522, + 2.040583649650216, + 0.5559408497065306, + 0.5063159223645926, + 1.1853638608008623, + 0.4988661725074053, + 1.4724945053458214, + 0.8876772094517946, + 0.4909869469702244, + 0.4055020585656166, + 2.2638225508853793, + 2.056196667253971, + 0.02505425177514553, + 0.3426766488701105, + 1.5886194966733456, + 2.604556906968355, + 0.7631006464362144, + 0.20733767747879028, + 1.1153568215668201 + ], + "unique_experts": 64, + "load_cv": 0.7032229597710711, + "normalized_load_entropy": 0.9490132618522531, + "max_load_share": 0.06920077972709551 + } + }, + "s0_period": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "1aef8dad61feb596e619bec17022271a2851ea3c1724029a00bc006ff9cab360", + "route_weight_sha256": "50dd696e34c54b664dd4b921fc14e0cd6a4543b2945109a4ba3e562d37b3197c", + "loads": [ + 1, + 10, + 37, + 5, + 23, + 8, + 2, + 6, + 17, + 2, + 17, + 4, + 28, + 10, + 0, + 18, + 25, + 9, + 14, + 12, + 10, + 8, + 7, + 14, + 2, + 10, + 69, + 5, + 19, + 1, + 9, + 13, + 22, + 2, + 3, + 8, + 18, + 19, + 29, + 15, + 13, + 5, + 7, + 4, + 4, + 7, + 28, + 10, + 7, + 10, + 2, + 23, + 7, + 12, + 8, + 4, + 27, + 0, + 3, + 26, + 8, + 0, + 5, + 29 + ], + "weighted_loads": [ + 0.04489739239215851, + 0.3329353518784046, + 2.8235334660857916, + 0.3240033332258463, + 1.9398060031235218, + 0.2963768430054188, + 0.05349563155323267, + 0.3305589631199837, + 0.7337696738541126, + 0.12978914752602577, + 0.9610143397003412, + 0.46667856723070145, + 1.4752247147262096, + 0.4657029062509537, + 0.0, + 0.6698226165026426, + 1.4657278470695019, + 0.8681517019867897, + 0.7889825161546469, + 0.40085348673164845, + 0.4206219669431448, + 0.49979492276906967, + 0.273604653775692, + 0.8868758473545313, + 0.07381826639175415, + 0.7112360708415508, + 4.156506437808275, + 0.17437738738954067, + 1.1184184588491917, + 0.05211902782320976, + 0.36023974791169167, + 0.9787127785384655, + 0.7453812621533871, + 0.053104093298316, + 0.1292633656412363, + 0.30815010145306587, + 1.1005664356052876, + 0.7089431583881378, + 2.1523161325603724, + 0.7430150546133518, + 0.783783171325922, + 0.3763350658118725, + 0.652612742036581, + 0.16970784962177277, + 0.16391422040760517, + 0.25816192384809256, + 2.006552444770932, + 0.5219137612730265, + 0.31690749153494835, + 0.6487784907221794, + 0.06246827356517315, + 1.3362666554749012, + 0.3107818216085434, + 0.408316308632493, + 0.3409499228000641, + 0.20053526759147644, + 1.8123305011540651, + 0.0, + 0.1109077800065279, + 1.5431810840964317, + 0.6280246451497078, + 0.0, + 0.21688995137810707, + 1.0475374963134527 + ], + "unique_experts": 61, + "load_cv": 0.9289697941103865, + "normalized_load_entropy": 0.9122995261238002, + "max_load_share": 0.08846153846153847 + }, + "full_input": { + "tokens": 155, + "top_k": 6, + "decisions": 930, + "ordered_route_sha256": "6f600e948e086953c477c1cb3c353523cfac1304ab5aaafa32a6990337603749", + "route_weight_sha256": "c777f6c07672fe0791960f260680abefb021ebf146df95c2a78f1c4f49631b70", + "loads": [ + 6, + 11, + 39, + 14, + 23, + 10, + 6, + 6, + 31, + 7, + 17, + 5, + 28, + 10, + 4, + 18, + 25, + 12, + 14, + 12, + 10, + 16, + 9, + 14, + 2, + 12, + 71, + 8, + 19, + 2, + 9, + 13, + 25, + 8, + 4, + 10, + 18, + 19, + 29, + 17, + 18, + 5, + 12, + 4, + 4, + 8, + 29, + 10, + 10, + 12, + 7, + 23, + 7, + 15, + 8, + 18, + 31, + 1, + 4, + 26, + 17, + 8, + 5, + 35 + ], + "weighted_loads": [ + 0.2493942603468895, + 0.4284600354731083, + 2.9066965598613024, + 1.3334704507142305, + 1.9398060031235218, + 0.47306235041469336, + 0.32306298334151506, + 0.3305589631199837, + 1.963439704850316, + 0.3265087828040123, + 0.9610143397003412, + 0.47913357242941856, + 1.4752247147262096, + 0.4657029062509537, + 0.5137210860848427, + 0.6698226165026426, + 1.4657278470695019, + 0.9983639176934958, + 0.7889825161546469, + 0.40085348673164845, + 0.4206219669431448, + 1.1812049876898527, + 0.3475639969110489, + 0.8868758473545313, + 0.07381826639175415, + 0.7722570821642876, + 4.235241008922458, + 0.28313757106661797, + 1.1184184588491917, + 0.09916513413190842, + 0.36023974791169167, + 0.9787127785384655, + 0.8705825805664062, + 0.2703148517757654, + 0.19437293149530888, + 0.3761993981897831, + 1.1005664356052876, + 0.7089431583881378, + 2.1523161325603724, + 0.8038691282272339, + 1.0996686182916164, + 0.3763350658118725, + 1.1651317775249481, + 0.16970784962177277, + 0.16391422040760517, + 0.289866148494184, + 2.0488911252468824, + 0.5219137612730265, + 0.478985071182251, + 0.7977644130587578, + 0.35100765340030193, + 1.3362666554749012, + 0.3107818216085434, + 0.5757667254656553, + 0.3409499228000641, + 1.4429977228865027, + 1.9740081988275051, + 0.02548844739794731, + 0.15626691840589046, + 1.5431810840964317, + 1.9013432525098324, + 0.2831717152148485, + 0.21688995137810707, + 1.272429320961237 + ], + "unique_experts": 64, + "load_cv": 0.7746683132094717, + "normalized_load_entropy": 0.940489806480703, + "max_load_share": 0.07634408602150537 + } + }, + "s1_period": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "1299dea7841ed6c31aa009e5d6c404d0e3c1b1d16b6eed521b5c37f1fe596fb7", + "route_weight_sha256": "f1a4392126dd3ea03ed4997f7078b3b01e1e76bb0b11b0caf41aa154580da4d0", + "loads": [ + 4, + 9, + 39, + 3, + 24, + 9, + 2, + 6, + 16, + 2, + 17, + 3, + 27, + 11, + 0, + 17, + 25, + 10, + 13, + 12, + 10, + 8, + 6, + 13, + 3, + 10, + 70, + 3, + 19, + 3, + 9, + 12, + 20, + 0, + 3, + 8, + 20, + 16, + 29, + 17, + 13, + 6, + 7, + 4, + 5, + 6, + 28, + 9, + 7, + 11, + 2, + 21, + 8, + 12, + 10, + 4, + 28, + 0, + 8, + 26, + 8, + 3, + 3, + 23 + ], + "weighted_loads": [ + 0.1255081668496132, + 0.29040645249187946, + 2.8616166692227125, + 0.25931575894355774, + 1.9641292672604322, + 0.30372958444058895, + 0.05254408158361912, + 0.33564986661076546, + 0.6765734273940325, + 0.12836170569062233, + 0.9652393534779549, + 0.44469858705997467, + 1.450557854026556, + 0.49040108546614647, + 0.0, + 0.6142036579549313, + 1.4613346830010414, + 0.9002546332776546, + 0.7593082804232836, + 0.393579700961709, + 0.41341808438301086, + 0.46258534118533134, + 0.2334424927830696, + 0.8726030513644218, + 0.09780817292630672, + 0.7173616662621498, + 4.159532088786364, + 0.12198590114712715, + 1.1183153130114079, + 0.10621784441173077, + 0.36067839711904526, + 0.9481337815523148, + 0.698424594476819, + 0.0, + 0.12829040177166462, + 0.2897020187228918, + 1.1381566915661097, + 0.584501326084137, + 2.161016821861267, + 0.8421693202108145, + 0.8074115216732025, + 0.42289749532938004, + 0.6675249822437763, + 0.17465098574757576, + 0.1885125171393156, + 0.2194165950641036, + 1.9859494157135487, + 0.47844306752085686, + 0.32344612292945385, + 0.6885542664676905, + 0.06086178682744503, + 1.2595477141439915, + 0.3477014843374491, + 0.3982115313410759, + 0.40388657711446285, + 0.21715139970183372, + 1.8386444747447968, + 0.0, + 0.30067517794668674, + 1.5603555534034967, + 0.5719876699149609, + 0.10241267830133438, + 0.15488643944263458, + 0.8567209541797638 + ], + "unique_experts": 61, + "load_cv": 0.9210090798579579, + "normalized_load_entropy": 0.916221677838915, + "max_load_share": 0.08974358974358974 + }, + "full_input": { + "tokens": 171, + "top_k": 6, + "decisions": 1026, + "ordered_route_sha256": "fc2efbdb1ae7bef59afacf4ef32ef4aefe7a5488d737c8d1dc7056bb95713a01", + "route_weight_sha256": "ef3789b5787c69001e57e2f573865a90bd04d94ef4b3fae7dcba116aeb3f00f0", + "loads": [ + 6, + 15, + 39, + 14, + 24, + 12, + 7, + 7, + 38, + 11, + 17, + 7, + 30, + 11, + 4, + 21, + 28, + 12, + 14, + 12, + 11, + 21, + 7, + 13, + 3, + 11, + 71, + 5, + 20, + 3, + 10, + 12, + 22, + 11, + 11, + 14, + 22, + 16, + 30, + 18, + 26, + 7, + 13, + 6, + 5, + 6, + 30, + 11, + 11, + 13, + 13, + 24, + 13, + 16, + 10, + 26, + 32, + 1, + 9, + 26, + 23, + 14, + 3, + 28 + ], + "weighted_loads": [ + 0.2512152064591646, + 0.801196500658989, + 2.8616166692227125, + 1.5385835729539394, + 1.9641292672604322, + 0.5064877206459641, + 0.3813302759081125, + 0.37749698385596275, + 2.4688915573060513, + 0.5857444629073143, + 0.9652393534779549, + 0.7310155369341373, + 1.591077335178852, + 0.49040108546614647, + 0.547550406306982, + 0.8491760157048702, + 1.607712261378765, + 0.9500977508723736, + 0.7986419033259153, + 0.393579700961709, + 0.46360498294234276, + 1.5861893706023693, + 0.27649472653865814, + 0.8726030513644218, + 0.09780817292630672, + 0.7428620290011168, + 4.208906922489405, + 0.19273559004068375, + 1.2019261084496975, + 0.10621784441173077, + 0.40071219578385353, + 0.9481337815523148, + 0.7914511244744062, + 0.3940944131463766, + 0.4756372068077326, + 0.513069486245513, + 1.2292188163846731, + 0.584501326084137, + 2.2091615460813046, + 0.8830009568482637, + 1.626814952120185, + 0.4483898561447859, + 1.304808508604765, + 0.31275367364287376, + 0.1885125171393156, + 0.2194165950641036, + 2.059654325246811, + 0.5451984647661448, + 0.5408941227942705, + 1.1519943717867136, + 0.6470254324376583, + 1.4736706353724003, + 0.8986656349152327, + 0.5968771912157536, + 0.40388657711446285, + 2.112711043097079, + 2.050347790122032, + 0.02505425177514553, + 0.3432231117039919, + 1.5603555534034967, + 2.6267663836479187, + 0.562182255089283, + 0.15488643944263458, + 1.063343008980155 + ], + "unique_experts": 64, + "load_cv": 0.7000168005179687, + "normalized_load_entropy": 0.9495371664435626, + "max_load_share": 0.06920077972709551 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 130, + "ordered_topk_exact_tokens": 86, + "set_exact_tokens": 95, + "mean_set_jaccard": 0.9214285714285714, + "mean_token_weighted_tv": 0.012750950953564965, + "aggregate_load_tv": 0.03333333333333334 + }, + "system_bos": { + "tokens": 130, + "ordered_topk_exact_tokens": 82, + "set_exact_tokens": 89, + "mean_set_jaccard": 0.9032967032967033, + "mean_token_weighted_tv": 0.01579937179787801, + "aggregate_load_tv": 0.035897435897435895 + }, + "system_x": { + "tokens": 130, + "ordered_topk_exact_tokens": 61, + "set_exact_tokens": 78, + "mean_set_jaccard": 0.8774725274725275, + "mean_token_weighted_tv": 0.02038991228104211, + "aggregate_load_tv": 0.0423076923076923 + }, + "system_period": { + "tokens": 130, + "ordered_topk_exact_tokens": 56, + "set_exact_tokens": 75, + "mean_set_jaccard": 0.8725274725274725, + "mean_token_weighted_tv": 0.02122717066667974, + "aggregate_load_tv": 0.04102564102564102 + }, + "bos_at_s0": { + "tokens": 130, + "ordered_topk_exact_tokens": 74, + "set_exact_tokens": 92, + "mean_set_jaccard": 0.9131868131868133, + "mean_token_weighted_tv": 0.01512450658931182, + "aggregate_load_tv": 0.039743589743589755 + }, + "bos_at_s1": { + "tokens": 130, + "ordered_topk_exact_tokens": 62, + "set_exact_tokens": 79, + "mean_set_jaccard": 0.8796703296703297, + "mean_token_weighted_tv": 0.019159402064262674, + "aggregate_load_tv": 0.039743589743589734 + }, + "x_at_s0": { + "tokens": 130, + "ordered_topk_exact_tokens": 74, + "set_exact_tokens": 91, + "mean_set_jaccard": 0.9093406593406593, + "mean_token_weighted_tv": 0.01612325506284833, + "aggregate_load_tv": 0.03205128205128205 + }, + "x_at_s1": { + "tokens": 130, + "ordered_topk_exact_tokens": 56, + "set_exact_tokens": 75, + "mean_set_jaccard": 0.8708791208791209, + "mean_token_weighted_tv": 0.02218616114786038, + "aggregate_load_tv": 0.04102564102564103 + }, + "period_at_s0": { + "tokens": 130, + "ordered_topk_exact_tokens": 65, + "set_exact_tokens": 90, + "mean_set_jaccard": 0.9087912087912089, + "mean_token_weighted_tv": 0.015864196720604712, + "aggregate_load_tv": 0.03461538461538462 + }, + "period_at_s1": { + "tokens": 130, + "ordered_topk_exact_tokens": 50, + "set_exact_tokens": 71, + "mean_set_jaccard": 0.8571428571428573, + "mean_token_weighted_tv": 0.023849817694952855, + "aggregate_load_tv": 0.04615384615384615 + } + } + }, + "layer_23": { + "layer": 23, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "359f858948a6324ae48611720541f39c68c09bc266526405a7078e6fe328053a", + "route_weight_sha256": "1830bc591b3c20c03595cd54671a62827d14d82ab9029f0a207c910cb632364d", + "loads": [ + 8, + 21, + 9, + 13, + 3, + 7, + 10, + 3, + 18, + 14, + 9, + 6, + 1, + 14, + 11, + 8, + 1, + 17, + 25, + 16, + 26, + 2, + 4, + 4, + 10, + 9, + 64, + 10, + 11, + 20, + 9, + 8, + 4, + 3, + 6, + 38, + 16, + 25, + 10, + 20, + 9, + 16, + 8, + 49, + 17, + 6, + 4, + 7, + 32, + 15, + 0, + 2, + 6, + 15, + 4, + 5, + 11, + 1, + 9, + 16, + 1, + 23, + 6, + 5 + ], + "weighted_loads": [ + 0.5226809121668339, + 1.7534238807857037, + 0.5424531325697899, + 0.643009377643466, + 0.10617196932435036, + 0.32256951183080673, + 0.8030918128788471, + 0.09609477408230305, + 1.2833009213209152, + 0.5589643232524395, + 0.3799259774386883, + 0.23610279709100723, + 0.030669283121824265, + 0.612709429115057, + 0.7629393823444843, + 0.5579872131347656, + 0.029044851660728455, + 0.9893920142203569, + 1.6354102455079556, + 1.262723719701171, + 1.3060742691159248, + 0.052601827308535576, + 0.38395360112190247, + 0.5198831260204315, + 0.4018957056105137, + 0.3081353083252907, + 3.629981929436326, + 0.5614072717726231, + 0.6254244837909937, + 1.318126391619444, + 0.3176658395677805, + 0.350792421028018, + 0.1598782017827034, + 0.11136794835329056, + 0.2870706655085087, + 2.766067635267973, + 0.9330600071698427, + 1.057751951739192, + 0.6511432863771915, + 1.007934806868434, + 0.3904678709805012, + 0.9319819882512093, + 0.3013719227164984, + 3.4434169325977564, + 1.0416641980409622, + 0.26630384288728237, + 0.1883299257606268, + 0.35303260385990143, + 2.303623406216502, + 0.6692183967679739, + 0.0, + 0.08891592919826508, + 0.29528848826885223, + 0.6111438889056444, + 0.2508901581168175, + 0.2691241391003132, + 0.8052466604858637, + 0.029972754418849945, + 0.49980173259973526, + 0.8834993317723274, + 0.029737379401922226, + 1.7187321744859219, + 0.3476744368672371, + 0.18514463678002357 + ], + "unique_experts": 63, + "load_cv": 0.9198662110077999, + "normalized_load_entropy": 0.9181864950222733, + "max_load_share": 0.08205128205128205 + }, + "full_input": { + "tokens": 155, + "top_k": 6, + "decisions": 930, + "ordered_route_sha256": "7bfb42c9c2562d049cadf09644d86edd555327c72db10cfdff3a733019b987c1", + "route_weight_sha256": "a3e9f96cf7bc3032d65b64b3c29232ed0cb37522debfde09a5950b6ff18af5ea", + "loads": [ + 13, + 24, + 10, + 21, + 8, + 9, + 16, + 8, + 20, + 24, + 9, + 7, + 2, + 19, + 13, + 8, + 4, + 17, + 25, + 16, + 26, + 2, + 5, + 14, + 14, + 9, + 65, + 10, + 11, + 20, + 9, + 8, + 7, + 8, + 6, + 39, + 17, + 25, + 14, + 22, + 14, + 16, + 10, + 50, + 17, + 13, + 16, + 11, + 34, + 15, + 0, + 3, + 6, + 16, + 14, + 5, + 11, + 10, + 11, + 16, + 1, + 23, + 9, + 5 + ], + "weighted_loads": [ + 0.7142311481293291, + 1.923690352588892, + 0.5854307673871517, + 0.970497525529936, + 0.2978045493364334, + 0.3787571466527879, + 1.2127648666501045, + 0.2876629214733839, + 1.3589485300472006, + 0.8825017586350441, + 0.3799259774386883, + 0.27652595564723015, + 0.040881311520934105, + 0.8212744556367397, + 0.873909056186676, + 0.5579872131347656, + 0.08065548585727811, + 0.9893920142203569, + 1.6354102455079556, + 1.262723719701171, + 1.3060742691159248, + 0.052601827308535576, + 0.40259591303765774, + 1.847759336233139, + 0.5472781043499708, + 0.3081353083252907, + 3.672650596126914, + 0.5614072717726231, + 0.6254244837909937, + 1.318126391619444, + 0.3176658395677805, + 0.350792421028018, + 0.29358433932065964, + 0.4164804092142731, + 0.2870706655085087, + 2.7970530670136213, + 0.9821357447654009, + 1.057751951739192, + 0.8495683688670397, + 1.0587113741785288, + 0.6098253801465034, + 0.9319819882512093, + 0.35272224992513657, + 3.4756888020783663, + 1.0416641980409622, + 2.395948590710759, + 1.2358565758913755, + 0.5151173972990364, + 2.4322788920253515, + 0.6692183967679739, + 0.0, + 0.17849333584308624, + 0.29528848826885223, + 0.6648272704333067, + 1.169656217098236, + 0.2691241391003132, + 0.8052466604858637, + 1.0603070184588432, + 0.6044460944831371, + 0.8834993317723274, + 0.029737379401922226, + 1.7187321744859219, + 0.444457046687603, + 0.18514463678002357 + ], + "unique_experts": 63, + "load_cv": 0.749125207634926, + "normalized_load_entropy": 0.9433799966963368, + "max_load_share": 0.06989247311827956 + } + }, + "s1_eos": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "8865cb7b6e6d9e5989ba33fea69739143f6e443fc0772833d144b5f010393276", + "route_weight_sha256": "777470f77c78c9d135703e52a5e20725003d347a76763d0f69dc23d71db1dcfa", + "loads": [ + 7, + 22, + 9, + 14, + 3, + 7, + 10, + 3, + 19, + 14, + 9, + 6, + 0, + 14, + 10, + 9, + 1, + 18, + 25, + 16, + 25, + 2, + 4, + 4, + 11, + 9, + 64, + 11, + 10, + 19, + 10, + 8, + 4, + 2, + 7, + 39, + 15, + 25, + 10, + 18, + 10, + 16, + 9, + 49, + 18, + 5, + 4, + 7, + 32, + 12, + 0, + 2, + 6, + 16, + 4, + 4, + 11, + 1, + 9, + 16, + 1, + 23, + 7, + 5 + ], + "weighted_loads": [ + 0.4961542673408985, + 1.7938276529312134, + 0.5422581024467945, + 0.6687681414186954, + 0.10535520315170288, + 0.3180902283638716, + 0.7918957062065601, + 0.0967870932072401, + 1.320611383765936, + 0.5567117836326361, + 0.3938594963401556, + 0.24013503640890121, + 0.0, + 0.6181014217436314, + 0.7334213480353355, + 0.588980745524168, + 0.030021503567695618, + 1.0130001548677683, + 1.6374226696789265, + 1.258959375321865, + 1.273925667628646, + 0.06295174360275269, + 0.3875229246914387, + 0.5372169017791748, + 0.4239934589713812, + 0.30586985126137733, + 3.6658944096416235, + 0.5920300632715225, + 0.5891908444464207, + 1.2926345206797123, + 0.3409320432692766, + 0.34633272513747215, + 0.16179735958576202, + 0.07553614303469658, + 0.3204774521291256, + 2.782276216894388, + 0.8825733866542578, + 1.0321926642209291, + 0.6494759656488895, + 0.9415503684431314, + 0.41875679045915604, + 0.9277441501617432, + 0.3287771511822939, + 3.490690667182207, + 1.090440385043621, + 0.23466540686786175, + 0.1865538489073515, + 0.34965258464217186, + 2.3105048201978207, + 0.5598610229790211, + 0.0, + 0.08639319613575935, + 0.30494503676891327, + 0.6392063293606043, + 0.25643014162778854, + 0.22849290445446968, + 0.8145349491387606, + 0.029212385416030884, + 0.4875338729470968, + 0.9092050362378359, + 0.030309194698929787, + 1.7187390476465225, + 0.38462886586785316, + 0.1836656592786312 + ], + "unique_experts": 62, + "load_cv": 0.9235184129404812, + "normalized_load_entropy": 0.9165041928027815, + "max_load_share": 0.08205128205128205 + }, + "full_input": { + "tokens": 171, + "top_k": 6, + "decisions": 1026, + "ordered_route_sha256": "3b903bb0dfc451daa6ed4cb1fd691ba812c7caf85531190e2762a442087ac7a0", + "route_weight_sha256": "efc82daefa3be49cd08d86e16bc1f3cc44045d3c70f0297f652c08c27a7406b5", + "loads": [ + 13, + 29, + 15, + 24, + 7, + 9, + 23, + 10, + 22, + 18, + 11, + 8, + 1, + 19, + 12, + 12, + 5, + 19, + 27, + 16, + 26, + 2, + 5, + 18, + 14, + 9, + 66, + 11, + 10, + 20, + 10, + 8, + 8, + 14, + 7, + 39, + 21, + 26, + 17, + 19, + 17, + 16, + 11, + 50, + 20, + 11, + 21, + 12, + 39, + 15, + 1, + 12, + 12, + 19, + 14, + 4, + 11, + 17, + 10, + 16, + 3, + 24, + 14, + 7 + ], + "weighted_loads": [ + 0.814584405394271, + 2.1619283724576235, + 0.8586312308907509, + 1.2909354355651885, + 0.26845047250390053, + 0.37518976209685206, + 1.5680538322776556, + 0.32242796942591667, + 1.4333614158676937, + 0.7107209395617247, + 0.48811409436166286, + 0.3050896152853966, + 0.010198124684393406, + 0.8278788160532713, + 0.8664745502173901, + 0.710537675768137, + 0.12117981677874923, + 1.0719144623726606, + 1.729028631001711, + 1.258959375321865, + 1.3226589690893888, + 0.06295174360275269, + 0.4059959836304188, + 2.424806084483862, + 0.5489905625581741, + 0.30586985126137733, + 3.742583019658923, + 0.5920300632715225, + 0.5891908444464207, + 1.338873017579317, + 0.3409320432692766, + 0.34633272513747215, + 0.32260543666779995, + 0.7634289666311815, + 0.3204774521291256, + 2.782276216894388, + 1.3206421602517366, + 1.080904832109809, + 1.0833321921527386, + 0.9647785760462284, + 0.6911971531808376, + 0.9277441501617432, + 0.38159764744341373, + 3.523680828511715, + 1.1942595057189465, + 2.356887886300683, + 1.8806962203234434, + 0.6711688227951527, + 2.6649354994297028, + 0.7087915129959583, + 0.027522914111614227, + 0.7007449381053448, + 0.9502202980220318, + 0.7600234616547823, + 1.2197862192988396, + 0.22849290445446968, + 0.8145349491387606, + 1.7073915414512157, + 0.5639358144253492, + 0.9092050362378359, + 0.10403189808130264, + 1.8421599715948105, + 0.6535792760550976, + 0.2615835443139076 + ], + "unique_experts": 64, + "load_cv": 0.6822472847367824, + "normalized_load_entropy": 0.9519265867621582, + "max_load_share": 0.06432748538011696 + } + }, + "s0_bos": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "f5e77ca1522f3fd2beb120903eb2bec73107a786cbd97be573ac40a9ca85d6f4", + "route_weight_sha256": "449868ba7202301930b8ba262884aa70d07f4d281d39d8ef65ec0c3e005baa65", + "loads": [ + 7, + 21, + 9, + 14, + 3, + 6, + 10, + 1, + 19, + 14, + 9, + 6, + 0, + 12, + 11, + 8, + 1, + 18, + 25, + 16, + 26, + 3, + 5, + 4, + 10, + 8, + 65, + 10, + 10, + 19, + 8, + 8, + 4, + 3, + 9, + 38, + 16, + 25, + 10, + 19, + 9, + 16, + 11, + 49, + 17, + 6, + 5, + 4, + 32, + 12, + 1, + 1, + 6, + 18, + 4, + 4, + 11, + 2, + 10, + 19, + 0, + 23, + 6, + 4 + ], + "weighted_loads": [ + 0.49527427181601524, + 1.772701945155859, + 0.5413877107203007, + 0.7095423210412264, + 0.10402989014983177, + 0.306635532528162, + 0.8068683296442032, + 0.040708765387535095, + 1.3409713506698608, + 0.5339208263903856, + 0.368070624768734, + 0.23198406398296356, + 0.0, + 0.5412599518895149, + 0.7842104136943817, + 0.5597699582576752, + 0.029775066301226616, + 1.0201380848884583, + 1.6357836686074734, + 1.2576278075575829, + 1.3081785421818495, + 0.08847700245678425, + 0.41879571601748466, + 0.5268539562821388, + 0.3840974047780037, + 0.2769058644771576, + 3.717688526958227, + 0.5556705221533775, + 0.6073123216629028, + 1.27906534075737, + 0.28405169397592545, + 0.34495040960609913, + 0.16049311310052872, + 0.11185412108898163, + 0.3867479171603918, + 2.721726421266794, + 0.9284789115190506, + 1.0631265323609114, + 0.6557021513581276, + 0.9756353702396154, + 0.3899902068078518, + 0.9172850176692009, + 0.3962596505880356, + 3.4713165927678347, + 1.0496503356844187, + 0.2713672071695328, + 0.22902571223676205, + 0.24395914562046528, + 2.3096887208521366, + 0.5878522992134094, + 0.028294721618294716, + 0.05686330050230026, + 0.3120701164007187, + 0.7236866820603609, + 0.2485402710735798, + 0.23293620347976685, + 0.800061397254467, + 0.0648338794708252, + 0.5291997510939837, + 1.0165367517620325, + 0.0, + 1.7123093754053116, + 0.3495462127029896, + 0.14867747947573662 + ], + "unique_experts": 62, + "load_cv": 0.9324735402964833, + "normalized_load_entropy": 0.9148860356145012, + "max_load_share": 0.08333333333333333 + }, + "full_input": { + "tokens": 155, + "top_k": 6, + "decisions": 930, + "ordered_route_sha256": "e5e6f7e6ac40542ddbb8c9a29d3fccebc5d10a86f09e4641e7e80236a948274e", + "route_weight_sha256": "e0dc457f55989e98eac945c7871027e3ecfb491dd9a0ac95716f99a0867f83f9", + "loads": [ + 10, + 24, + 10, + 21, + 9, + 9, + 16, + 6, + 20, + 23, + 9, + 7, + 2, + 17, + 12, + 8, + 4, + 18, + 25, + 17, + 26, + 3, + 7, + 15, + 14, + 8, + 67, + 10, + 10, + 19, + 8, + 8, + 5, + 6, + 9, + 39, + 16, + 25, + 14, + 21, + 15, + 16, + 13, + 51, + 17, + 12, + 17, + 7, + 34, + 12, + 2, + 2, + 6, + 19, + 14, + 6, + 11, + 12, + 12, + 20, + 0, + 23, + 8, + 4 + ], + "weighted_loads": [ + 0.615527309011668, + 1.9429684169590473, + 0.5907289236783981, + 1.0239853905513883, + 0.3616747818887234, + 0.4144344381056726, + 1.2495058290660381, + 0.24444753490388393, + 1.4208997562527657, + 0.8354041613638401, + 0.368070624768734, + 0.27545633167028427, + 0.04153934307396412, + 0.7498249784111977, + 0.8560875877737999, + 0.5597699582576752, + 0.08138570049777627, + 1.0201380848884583, + 1.6357836686074734, + 1.4275994971394539, + 1.3081785421818495, + 0.08847700245678425, + 0.4775515887886286, + 1.9262171536684036, + 0.5274424199014902, + 0.2769058644771576, + 3.8945827037096024, + 0.5556705221533775, + 0.6073123216629028, + 1.27906534075737, + 0.28405169397592545, + 0.34495040960609913, + 0.2142076976597309, + 0.3560470938682556, + 0.3867479171603918, + 2.7527118530124426, + 0.9284789115190506, + 1.0631265323609114, + 0.8407783396542072, + 1.0264119375497103, + 0.6705882791429758, + 0.9172850176692009, + 0.4476099777966738, + 3.546220200136304, + 1.0496503356844187, + 1.4308154992759228, + 1.2681498881429434, + 0.4013282973319292, + 2.4467868246138096, + 0.5878522992134094, + 0.08241056837141514, + 0.14644070714712143, + 0.3120701164007187, + 0.7699118386954069, + 1.1673063300549984, + 0.3095291443169117, + 0.800061397254467, + 1.1339010037481785, + 0.6417831536382437, + 1.2800909671932459, + 0.0, + 1.7123093754053116, + 0.41853274032473564, + 0.14867747947573662 + ], + "unique_experts": 63, + "load_cv": 0.7658299737006494, + "normalized_load_entropy": 0.9417473782800463, + "max_load_share": 0.07204301075268817 + } + }, + "s1_bos": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "22d04f59b1d57c1dd2d7728604df8e4b8b73951efdcd4722cfb34eadef539835", + "route_weight_sha256": "40f450086db6dffa75035f4dd985dd8f71109d3486dc9a031c74cc9c1eb6acbe", + "loads": [ + 7, + 21, + 10, + 12, + 3, + 7, + 10, + 2, + 19, + 12, + 8, + 6, + 0, + 13, + 10, + 8, + 1, + 18, + 25, + 16, + 26, + 3, + 4, + 4, + 10, + 8, + 65, + 10, + 11, + 19, + 9, + 8, + 6, + 4, + 7, + 37, + 15, + 25, + 10, + 20, + 9, + 16, + 11, + 49, + 18, + 7, + 4, + 4, + 32, + 13, + 0, + 2, + 6, + 14, + 4, + 4, + 11, + 2, + 10, + 19, + 1, + 23, + 6, + 6 + ], + "weighted_loads": [ + 0.49694668129086494, + 1.7637053057551384, + 0.5739803928881884, + 0.6269580293446779, + 0.11124883033335209, + 0.3330861050635576, + 0.7975009232759476, + 0.06832611374557018, + 1.3463517762720585, + 0.4703122228384018, + 0.34524778462946415, + 0.2395128384232521, + 0.0, + 0.5788713954389095, + 0.7439003363251686, + 0.554275069385767, + 0.029851896688342094, + 1.0195117052644491, + 1.626840528100729, + 1.2540526166558266, + 1.3194311782717705, + 0.08566823229193687, + 0.4023176208138466, + 0.5452661216259003, + 0.39505377039313316, + 0.27283190563321114, + 3.7879702132195234, + 0.5599393714219332, + 0.6319719143211842, + 1.2834115885198116, + 0.2991736810654402, + 0.3499775845557451, + 0.23426707461476326, + 0.1410541571676731, + 0.3222968876361847, + 2.722806604579091, + 0.8870273102074862, + 1.0662422347813845, + 0.6420338116586208, + 1.000429566949606, + 0.39409825950860977, + 0.9213568288832903, + 0.3956652097404003, + 3.481541307643056, + 1.096622757613659, + 0.30161087587475777, + 0.18681830167770386, + 0.24336448311805725, + 2.3090518917888403, + 0.5926889572292566, + 0.0, + 0.08520378544926643, + 0.30946309491991997, + 0.5580989103764296, + 0.2552996501326561, + 0.23202525824308395, + 0.8215321563184261, + 0.0640195831656456, + 0.530773127451539, + 1.0389287937432528, + 0.0294742900878191, + 1.7205768190324306, + 0.35565492138266563, + 0.22341329976916313 + ], + "unique_experts": 62, + "load_cv": 0.9230626779527612, + "normalized_load_entropy": 0.9178299804028447, + "max_load_share": 0.08333333333333333 + }, + "full_input": { + "tokens": 171, + "top_k": 6, + "decisions": 1026, + "ordered_route_sha256": "852dbaa7e516dbc808ab10776b3c6743db747049508c7f274fe6fd21bef1cc7d", + "route_weight_sha256": "4f4d26762fba2745178c39cfcf18b5e7ee3ec1793d50a8fd32429ede25b989c0", + "loads": [ + 12, + 28, + 17, + 21, + 8, + 9, + 22, + 9, + 21, + 17, + 10, + 8, + 1, + 18, + 11, + 11, + 5, + 19, + 27, + 16, + 27, + 3, + 6, + 19, + 12, + 8, + 67, + 10, + 11, + 20, + 11, + 8, + 7, + 14, + 7, + 37, + 21, + 27, + 17, + 21, + 17, + 16, + 13, + 49, + 20, + 12, + 21, + 8, + 39, + 16, + 1, + 12, + 12, + 19, + 14, + 5, + 11, + 19, + 12, + 19, + 3, + 24, + 13, + 8 + ], + "weighted_loads": [ + 0.8200019090436399, + 2.1318060252815485, + 0.9420154448598623, + 1.237785249017179, + 0.3359715212136507, + 0.4003288852982223, + 1.556710286065936, + 0.3216623440384865, + 1.461905874311924, + 0.6603707037866116, + 0.4395023826509714, + 0.31366732344031334, + 0.010198124684393406, + 0.7886487897485495, + 0.8413654118776321, + 0.675831999629736, + 0.1210102098993957, + 1.0784260127693415, + 1.7184464894235134, + 1.2540526166558266, + 1.3681644797325134, + 0.08566823229193687, + 0.46962444484233856, + 2.520037993788719, + 0.47325396724045277, + 0.27283190563321114, + 3.864064062014222, + 0.5599393714219332, + 0.6319719143211842, + 1.3296500854194164, + 0.3935124669224024, + 0.3499775845557451, + 0.2767852619290352, + 0.7755759097635746, + 0.3222968876361847, + 2.722806604579091, + 1.325096083804965, + 1.1639377307146788, + 1.0381243731826544, + 1.023657774552703, + 0.7344569228589535, + 0.9213568288832903, + 0.44848570600152016, + 3.481541307643056, + 1.2004418782889843, + 1.4538479298353195, + 1.875406175851822, + 0.5628792382776737, + 2.6682194638997316, + 0.7416194472461939, + 0.027522914111614227, + 0.6995555274188519, + 0.9547383561730385, + 0.7871430423110723, + 1.2186557278037071, + 0.2800683006644249, + 0.8215321563184261, + 1.7692561633884907, + 0.6612449046224356, + 1.0389287937432528, + 0.10319699347019196, + 1.8439977429807186, + 0.6269052475690842, + 0.315878227353096 + ], + "unique_experts": 64, + "load_cv": 0.6784045829567787, + "normalized_load_entropy": 0.952840879492325, + "max_load_share": 0.06530214424951267 + } + }, + "s0_x": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "fdfff6a61e1bb871feaeefe306d8b6dd7030848815669d01b06176b86a2b61f6", + "route_weight_sha256": "8dded89dd97fc68a758d8b8804f70da9e6c490d1fa3a7c8c24611d183cc4dded", + "loads": [ + 8, + 21, + 9, + 14, + 2, + 4, + 10, + 1, + 18, + 13, + 8, + 8, + 1, + 12, + 11, + 9, + 1, + 19, + 25, + 15, + 27, + 3, + 5, + 4, + 11, + 7, + 64, + 10, + 10, + 20, + 10, + 8, + 5, + 3, + 8, + 37, + 18, + 24, + 10, + 19, + 8, + 16, + 11, + 50, + 16, + 5, + 4, + 5, + 32, + 13, + 1, + 1, + 7, + 17, + 4, + 4, + 12, + 1, + 9, + 18, + 0, + 23, + 6, + 5 + ], + "weighted_loads": [ + 0.5348436199128628, + 1.7739366069436073, + 0.541097404435277, + 0.686630817130208, + 0.06907650828361511, + 0.2259979397058487, + 0.7978208102285862, + 0.04073652997612953, + 1.2994298934936523, + 0.5071440991014242, + 0.3502947483211756, + 0.2972060665488243, + 0.03089742735028267, + 0.5374397169798613, + 0.7933959327638149, + 0.5922536123543978, + 0.030209103599190712, + 1.0428044144064188, + 1.6322724744677544, + 1.2082595936954021, + 1.3383604604750872, + 0.08392167091369629, + 0.43196530640125275, + 0.5241893902420998, + 0.41797858849167824, + 0.2439398393034935, + 3.5506842881441116, + 0.5684935301542282, + 0.6003873534500599, + 1.307706007733941, + 0.3540242835879326, + 0.33935663290321827, + 0.19312938675284386, + 0.1108115091919899, + 0.36748795956373215, + 2.7248180992901325, + 1.0102012529969215, + 1.0351090654730797, + 0.6546499654650688, + 0.9733373522758484, + 0.34713509678840637, + 0.9269257299602032, + 0.41336464136838913, + 3.466328050941229, + 1.0331019200384617, + 0.24027365446090698, + 0.20042521134018898, + 0.2796463333070278, + 2.305433191359043, + 0.6099660228937864, + 0.030244868248701096, + 0.05846332386136055, + 0.3349699415266514, + 0.671922730281949, + 0.2561086677014828, + 0.23321490362286568, + 0.824909832328558, + 0.033714231103658676, + 0.48954179137945175, + 0.9860467482358217, + 0.0, + 1.7272747568786144, + 0.32376452162861824, + 0.18015368282794952 + ], + "unique_experts": 63, + "load_cv": 0.9277233485473146, + "normalized_load_entropy": 0.9156156349812594, + "max_load_share": 0.08205128205128205 + }, + "full_input": { + "tokens": 155, + "top_k": 6, + "decisions": 930, + "ordered_route_sha256": "98b6d247e0af0cc20d59e615943187e2c78d6f3869ddfd4431c083d1c33f9094", + "route_weight_sha256": "450448166a886e3823673d87102e5766b3207cb8f0474fd7e17aa44ab430825d", + "loads": [ + 12, + 24, + 10, + 23, + 6, + 7, + 17, + 7, + 19, + 23, + 8, + 9, + 2, + 17, + 13, + 9, + 5, + 19, + 25, + 15, + 27, + 3, + 6, + 15, + 15, + 7, + 65, + 10, + 10, + 20, + 10, + 8, + 6, + 7, + 8, + 38, + 19, + 24, + 15, + 21, + 14, + 16, + 13, + 50, + 16, + 12, + 18, + 8, + 34, + 13, + 1, + 2, + 7, + 17, + 15, + 4, + 12, + 10, + 10, + 18, + 0, + 23, + 8, + 5 + ], + "weighted_loads": [ + 0.7239763061515987, + 1.9442030787467957, + 0.5871968884021044, + 1.1710284175351262, + 0.23771237581968307, + 0.33213254576548934, + 1.273822844028473, + 0.26014609076082706, + 1.3713001683354378, + 0.8190068285912275, + 0.3502947483211756, + 0.3460681401193142, + 0.04110945574939251, + 0.746004743501544, + 0.9101148284971714, + 0.5922536123543978, + 0.11170977959409356, + 1.0428044144064188, + 1.6322724744677544, + 1.2082595936954021, + 1.3383604604750872, + 0.08392167091369629, + 0.450607618317008, + 1.913506891578436, + 0.5594363864511251, + 0.2439398393034935, + 3.5965254455804825, + 0.5684935301542282, + 0.6003873534500599, + 1.307706007733941, + 0.3540242835879326, + 0.33935663290321827, + 0.24684397131204605, + 0.3996574245393276, + 0.36748795956373215, + 2.755803531035781, + 1.0488162115216255, + 1.0351090654730797, + 0.907095018774271, + 1.0241139195859432, + 0.5735628213733435, + 0.9269257299602032, + 0.4647149685770273, + 3.466328050941229, + 1.0331019200384617, + 1.4162556640803814, + 1.4120766781270504, + 0.4343538247048855, + 2.428857408463955, + 0.6099660228937864, + 0.030244868248701096, + 0.14804073050618172, + 0.3349699415266514, + 0.671922730281949, + 1.3105306066572666, + 0.23321490362286568, + 0.824909832328558, + 1.0563011206686497, + 0.5464133247733116, + 0.9860467482358217, + 0.0, + 1.7272747568786144, + 0.3927510492503643, + 0.18015368282794952 + ], + "unique_experts": 63, + "load_cv": 0.7515905976046249, + "normalized_load_entropy": 0.9426288469095357, + "max_load_share": 0.06989247311827956 + } + }, + "s1_x": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "6caa66054963265e318726d5a130552a0b059ff4f04c48b345b0791ad8a41644", + "route_weight_sha256": "2f8f1828e5a540ca8e3ead18d234267cb3c5bad3b0cb782c5d993c5ac6a1f2df", + "loads": [ + 7, + 21, + 10, + 13, + 3, + 6, + 10, + 1, + 19, + 13, + 8, + 8, + 1, + 15, + 9, + 8, + 1, + 18, + 25, + 15, + 28, + 3, + 5, + 4, + 10, + 8, + 64, + 10, + 10, + 19, + 9, + 8, + 5, + 3, + 6, + 39, + 17, + 24, + 10, + 19, + 9, + 16, + 10, + 49, + 16, + 8, + 6, + 7, + 32, + 13, + 0, + 2, + 6, + 12, + 4, + 4, + 10, + 2, + 8, + 16, + 1, + 23, + 8, + 6 + ], + "weighted_loads": [ + 0.5116513706743717, + 1.7532819919288158, + 0.5707650911062956, + 0.6470095813274384, + 0.11040407791733742, + 0.2909773178398609, + 0.7909601144492626, + 0.040408261120319366, + 1.3383102491497993, + 0.5324366018176079, + 0.3600670285522938, + 0.29828430339694023, + 0.03265578672289848, + 0.631850054487586, + 0.7024022229015827, + 0.5539329871535301, + 0.029291268438100815, + 1.0158729385584593, + 1.6206956580281258, + 1.225280024111271, + 1.4003120176494122, + 0.09591366350650787, + 0.4383096806704998, + 0.5430117771029472, + 0.38533599488437176, + 0.2732303887605667, + 3.5444390848279, + 0.565151896327734, + 0.5939597114920616, + 1.2853541150689125, + 0.29630035534501076, + 0.34334677644073963, + 0.2003266178071499, + 0.10842365399003029, + 0.28693483024835587, + 2.811484230682254, + 0.9749567396938801, + 1.0318897515535355, + 0.6442583277821541, + 0.9615827277302742, + 0.376201756298542, + 0.9052339736372232, + 0.36347367614507675, + 3.4014749992638826, + 1.0509800277650356, + 0.3449066299945116, + 0.2583834119141102, + 0.3487598057836294, + 2.320951795205474, + 0.5856093689799309, + 0.0, + 0.09087850153446198, + 0.2978581190109253, + 0.45914350636303425, + 0.27137041464447975, + 0.2252761796116829, + 0.7715499214828014, + 0.06091083958745003, + 0.440071664750576, + 0.904796414077282, + 0.030753009021282196, + 1.7269165478646755, + 0.40583536028862, + 0.22677895799279213 + ], + "unique_experts": 63, + "load_cv": 0.9188364136393299, + "normalized_load_entropy": 0.9193472924971836, + "max_load_share": 0.08205128205128205 + }, + "full_input": { + "tokens": 171, + "top_k": 6, + "decisions": 1026, + "ordered_route_sha256": "69bfbd43b60da1f95c26fa2224673f66280b02a58bba2fc5ecd225b5a285a026", + "route_weight_sha256": "ab688677744dd030be6c53c57dc58d51d0ed93f13d18e5ca3e14fee084d9a1a5", + "loads": [ + 12, + 28, + 17, + 23, + 5, + 8, + 23, + 7, + 21, + 18, + 10, + 10, + 2, + 20, + 10, + 11, + 6, + 19, + 27, + 16, + 29, + 3, + 6, + 20, + 13, + 8, + 66, + 10, + 10, + 20, + 9, + 8, + 7, + 13, + 6, + 39, + 23, + 25, + 18, + 20, + 15, + 16, + 12, + 50, + 18, + 13, + 25, + 11, + 40, + 16, + 1, + 13, + 12, + 14, + 17, + 4, + 10, + 18, + 10, + 16, + 3, + 24, + 15, + 7 + ], + "weighted_loads": [ + 0.8268869793973863, + 2.121382711455226, + 0.9409788865596056, + 1.327473838813603, + 0.18814285844564438, + 0.3447434431873262, + 1.5790152493864298, + 0.23130067065358162, + 1.4451237358152866, + 0.713954508304596, + 0.45432162657380104, + 0.364362645894289, + 0.04285391140729189, + 0.841627448797226, + 0.7998672984540462, + 0.6754899173974991, + 0.15966430073603988, + 1.0747872460633516, + 1.7123016193509102, + 1.2565899044275284, + 1.449045319110155, + 0.09591366350650787, + 0.4567827396094799, + 2.5444662868976593, + 0.5044109411537647, + 0.2732303887605667, + 3.614229202270508, + 0.565151896327734, + 0.5939597114920616, + 1.3315926119685173, + 0.29630035534501076, + 0.34334677644073963, + 0.2890143617987633, + 0.7325851954519749, + 0.28693483024835587, + 2.811484230682254, + 1.413025513291359, + 1.0806019194424152, + 1.1183678396046162, + 0.9848109353333712, + 0.5963654164224863, + 0.9052339736372232, + 0.4162941724061966, + 3.4284356869757175, + 1.154799148440361, + 1.4816319849342108, + 2.2112875916063786, + 0.6512330193072557, + 2.7271789480000734, + 0.7345398589968681, + 0.027522914111614227, + 0.7832447588443756, + 0.9431333802640438, + 0.5298825036734343, + 1.4865287356078625, + 0.2252761796116829, + 0.7715499214828014, + 1.645107977092266, + 0.5571137741208076, + 0.904796414077282, + 0.10447571240365505, + 1.8503374718129635, + 0.6774949617683887, + 0.2663699500262737 + ], + "unique_experts": 64, + "load_cv": 0.6923316925882549, + "normalized_load_entropy": 0.950755764199002, + "max_load_share": 0.06432748538011696 + } + }, + "s0_period": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "1fc497258523bc4d3f483c497dcb0a0d2adaaab5d2d92f28f0a3350cf504cdfe", + "route_weight_sha256": "77a56963f9c5bae36cfed46e617b3bd6fe5210cafbc9605e05150db7b2cdd28f", + "loads": [ + 8, + 21, + 9, + 13, + 2, + 6, + 10, + 2, + 18, + 15, + 8, + 7, + 0, + 12, + 11, + 9, + 1, + 17, + 25, + 16, + 26, + 3, + 5, + 4, + 11, + 7, + 65, + 11, + 10, + 20, + 9, + 8, + 4, + 3, + 9, + 37, + 15, + 24, + 10, + 20, + 8, + 16, + 11, + 50, + 17, + 7, + 4, + 4, + 32, + 13, + 0, + 1, + 7, + 14, + 4, + 4, + 12, + 4, + 9, + 17, + 1, + 23, + 6, + 5 + ], + "weighted_loads": [ + 0.520711425691843, + 1.7535801008343697, + 0.5408239420503378, + 0.6462060082703829, + 0.07072967290878296, + 0.3022945411503315, + 0.7978208251297474, + 0.06818141229450703, + 1.3016613684594631, + 0.5706304591149092, + 0.35149011574685574, + 0.2585902940481901, + 0.0, + 0.5407694149762392, + 0.7655577678233385, + 0.5837577749043703, + 0.029537394642829895, + 0.979194700717926, + 1.6194962374866009, + 1.2327469289302826, + 1.3273712787777185, + 0.08462359942495823, + 0.43603354692459106, + 0.5314712971448898, + 0.4232662320137024, + 0.24251385778188705, + 3.6671968437731266, + 0.5919689573347569, + 0.6041716113686562, + 1.2954212538897991, + 0.32913318276405334, + 0.3404376655817032, + 0.1578505039215088, + 0.11235031485557556, + 0.4089066721498966, + 2.7468965519219637, + 0.9117812681943178, + 1.034395119175315, + 0.6453162990510464, + 1.0086881909519434, + 0.3509306386113167, + 0.9247435312718153, + 0.4072558023035526, + 3.478673454374075, + 1.0531252585351467, + 0.3017663285136223, + 0.19427837245166302, + 0.2547049541026354, + 2.2887019347399473, + 0.6070584058761597, + 0.0, + 0.05804452672600746, + 0.33985473215579987, + 0.5724679511040449, + 0.2516551688313484, + 0.2274722345173359, + 0.8304210603237152, + 0.12233835458755493, + 0.4849476832896471, + 0.9649952296167612, + 0.0291161946952343, + 1.7155733294785023, + 0.33806560933589935, + 0.1847757324576378 + ], + "unique_experts": 62, + "load_cv": 0.9252254198737403, + "normalized_load_entropy": 0.9172356887729777, + "max_load_share": 0.08333333333333333 + }, + "full_input": { + "tokens": 155, + "top_k": 6, + "decisions": 930, + "ordered_route_sha256": "99301590d403272aacff7471e558fcb6aa612199153ec4699cc3a37934903db9", + "route_weight_sha256": "1aa2fb24646ec17bd582a424b13cd5fba4a0f7cc5aee3892fd4118447e03fa1d", + "loads": [ + 12, + 24, + 11, + 20, + 8, + 9, + 18, + 7, + 19, + 24, + 8, + 8, + 1, + 17, + 12, + 9, + 4, + 17, + 25, + 16, + 26, + 3, + 6, + 15, + 15, + 7, + 66, + 11, + 10, + 20, + 10, + 8, + 5, + 7, + 9, + 38, + 15, + 24, + 16, + 22, + 15, + 16, + 13, + 50, + 17, + 13, + 16, + 7, + 34, + 13, + 0, + 2, + 7, + 15, + 15, + 5, + 12, + 14, + 10, + 17, + 1, + 23, + 8, + 5 + ], + "weighted_loads": [ + 0.7156843314878643, + 1.923846572637558, + 0.6390787605196238, + 0.9771635429933667, + 0.340776477009058, + 0.4122584923170507, + 1.3363356851041317, + 0.2567796092480421, + 1.3827338479459286, + 0.876350674778223, + 0.35149011574685574, + 0.30898468755185604, + 0.01021202839910984, + 0.7493344414979219, + 0.8374349419027567, + 0.5837577749043703, + 0.08114802883937955, + 0.979194700717926, + 1.6194962374866009, + 1.2327469289302826, + 1.3273712787777185, + 0.08462359942495823, + 0.45467585884034634, + 1.9234167858958244, + 0.5649401489645243, + 0.24251385778188705, + 3.7139696441590786, + 0.5919689573347569, + 0.6041716113686562, + 1.2954212538897991, + 0.3749897740781307, + 0.3404376655817032, + 0.21156508848071098, + 0.4014289975166321, + 0.4089066721498966, + 2.777881983667612, + 0.9117812681943178, + 1.034395119175315, + 1.0253875255584717, + 1.0594647582620382, + 0.6395190320909023, + 0.9247435312718153, + 0.4586061295121908, + 3.478673454374075, + 1.0531252585351467, + 1.449519108980894, + 1.24268071167171, + 0.41269426979124546, + 2.416848821565509, + 0.6070584058761597, + 0.0, + 0.14762193337082863, + 0.33985473215579987, + 0.6177083384245634, + 1.221569899469614, + 0.2603480741381645, + 0.8304210603237152, + 1.1554908156394958, + 0.541819216683507, + 0.9649952296167612, + 0.0291161946952343, + 1.7155733294785023, + 0.4070521369576454, + 0.1847757324576378 + ], + "unique_experts": 63, + "load_cv": 0.7511966789441366, + "normalized_load_entropy": 0.9428532885308814, + "max_load_share": 0.07096774193548387 + } + }, + "s1_period": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "2cb6ac1b3b35ed8f50c39278be6772ce35fe7e3b2c8b32e50e8f3dbf4782aece", + "route_weight_sha256": "99a2f5c51e65ef9fb68aa2ffa7ca629a06b511882a600f2ffba8409913817c0f", + "loads": [ + 7, + 21, + 9, + 14, + 3, + 5, + 10, + 1, + 19, + 12, + 9, + 7, + 1, + 14, + 10, + 9, + 1, + 18, + 25, + 15, + 28, + 2, + 5, + 4, + 11, + 9, + 63, + 10, + 10, + 19, + 9, + 9, + 5, + 4, + 8, + 38, + 16, + 26, + 10, + 19, + 9, + 16, + 10, + 49, + 16, + 8, + 5, + 4, + 32, + 13, + 0, + 2, + 6, + 13, + 4, + 4, + 11, + 2, + 9, + 15, + 1, + 23, + 7, + 6 + ], + "weighted_loads": [ + 0.5116610005497932, + 1.745695848017931, + 0.533924289047718, + 0.6727232988923788, + 0.10821116156876087, + 0.26183899864554405, + 0.7897607944905758, + 0.041523527354002, + 1.3320102579891682, + 0.4920170158147812, + 0.38989340886473656, + 0.2611390929669142, + 0.029601000249385834, + 0.5946204736828804, + 0.7385815568268299, + 0.5816394053399563, + 0.029737938195466995, + 1.0148692466318607, + 1.6263710409402847, + 1.2176093496382236, + 1.4101205207407475, + 0.07064010761678219, + 0.4376317858695984, + 0.5403605997562408, + 0.4111203793436289, + 0.29740054719150066, + 3.5713849402964115, + 0.568439906463027, + 0.5910748485475779, + 1.285378623753786, + 0.31428695656359196, + 0.3742485698312521, + 0.20328157022595406, + 0.13816091232001781, + 0.3674640841782093, + 2.7875768672674894, + 0.9356716275215149, + 1.0892409440129995, + 0.6354445442557335, + 0.975015789270401, + 0.37174445018172264, + 0.9105030540376902, + 0.35487305745482445, + 3.4141156673431396, + 1.048332367092371, + 0.34200683794915676, + 0.21721931174397469, + 0.251268045976758, + 2.319575661793351, + 0.5918578989803791, + 0.0, + 0.09026786126196384, + 0.304024625569582, + 0.49062876403331757, + 0.2647074833512306, + 0.2212575040757656, + 0.8135838340967894, + 0.06304977089166641, + 0.4721152242273092, + 0.8903493825346231, + 0.02989470586180687, + 1.7298504672944546, + 0.3681191951036453, + 0.22707226499915123 + ], + "unique_experts": 63, + "load_cv": 0.9132093669019726, + "normalized_load_entropy": 0.9193062446010825, + "max_load_share": 0.08076923076923077 + }, + "full_input": { + "tokens": 171, + "top_k": 6, + "decisions": 1026, + "ordered_route_sha256": "0493ee2ff65c84b8a7a408da1ae5efc04e00a594edae127abd944bdfa95d699a", + "route_weight_sha256": "a82d171540c87eca7de0b3ff44c46d90bbcd173b3faae4c3969a6733345cb56a", + "loads": [ + 12, + 28, + 16, + 23, + 5, + 7, + 24, + 9, + 22, + 18, + 11, + 9, + 2, + 19, + 11, + 12, + 6, + 19, + 27, + 15, + 29, + 2, + 6, + 18, + 13, + 9, + 65, + 10, + 10, + 20, + 9, + 9, + 6, + 15, + 8, + 38, + 22, + 27, + 18, + 20, + 16, + 16, + 13, + 49, + 18, + 13, + 25, + 8, + 39, + 16, + 1, + 12, + 12, + 16, + 16, + 4, + 11, + 18, + 11, + 15, + 3, + 24, + 14, + 7 + ], + "weighted_loads": [ + 0.81960574304685, + 2.113796567544341, + 0.8985009118914604, + 1.2992238132283092, + 0.18594994209706783, + 0.3121158196590841, + 1.6571242045611143, + 0.29866585694253445, + 1.4722164683043957, + 0.716085210442543, + 0.4841480068862438, + 0.3362899962812662, + 0.03979912493377924, + 0.8043978679925203, + 0.8360466323792934, + 0.7031963355839252, + 0.1551500423811376, + 1.073783554136753, + 1.7179770022630692, + 1.2176093496382236, + 1.4588538222014904, + 0.07064010761678219, + 0.4561048448085785, + 2.441792454570532, + 0.4893205761909485, + 0.29740054719150066, + 3.6328127309679985, + 0.568439906463027, + 0.5910748485475779, + 1.3316171206533909, + 0.31428695656359196, + 0.3742485698312521, + 0.24579975754022598, + 0.864109305664897, + 0.3674640841782093, + 2.7875768672674894, + 1.3737404011189938, + 1.1379531119018793, + 1.2523356638848782, + 0.998243996873498, + 0.6233576685190201, + 0.9105030540376902, + 0.45319143682718277, + 3.4141156673431396, + 1.1521514877676964, + 1.4818687532097101, + 2.046669375151396, + 0.5572887491434813, + 2.674175327643752, + 0.7407883889973164, + 0.027522914111614227, + 0.7046196032315493, + 0.9492998868227005, + 0.6022811308503151, + 1.3344684839248657, + 0.2212575040757656, + 0.8135838340967894, + 1.6782972179353237, + 0.596581319347024, + 0.8903493825346231, + 0.10361740924417973, + 1.8532713912427425, + 0.6330876518040895, + 0.26666325703263283 + ], + "unique_experts": 64, + "load_cv": 0.6803733278782207, + "normalized_load_entropy": 0.9518326407904217, + "max_load_share": 0.06335282651072124 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 130, + "ordered_topk_exact_tokens": 95, + "set_exact_tokens": 108, + "mean_set_jaccard": 0.9516483516483516, + "mean_token_weighted_tv": 0.00982982122267668, + "aggregate_load_tv": 0.019230769230769232 + }, + "system_bos": { + "tokens": 130, + "ordered_topk_exact_tokens": 86, + "set_exact_tokens": 99, + "mean_set_jaccard": 0.9285714285714286, + "mean_token_weighted_tv": 0.012851883599964472, + "aggregate_load_tv": 0.021794871794871794 + }, + "system_x": { + "tokens": 130, + "ordered_topk_exact_tokens": 63, + "set_exact_tokens": 84, + "mean_set_jaccard": 0.8923076923076925, + "mean_token_weighted_tv": 0.018983568752614352, + "aggregate_load_tv": 0.03333333333333333 + }, + "system_period": { + "tokens": 130, + "ordered_topk_exact_tokens": 65, + "set_exact_tokens": 80, + "mean_set_jaccard": 0.8835164835164836, + "mean_token_weighted_tv": 0.020194760616868736, + "aggregate_load_tv": 0.032051282051282035 + }, + "bos_at_s0": { + "tokens": 130, + "ordered_topk_exact_tokens": 87, + "set_exact_tokens": 94, + "mean_set_jaccard": 0.9175824175824175, + "mean_token_weighted_tv": 0.01422002796226969, + "aggregate_load_tv": 0.0282051282051282 + }, + "bos_at_s1": { + "tokens": 130, + "ordered_topk_exact_tokens": 86, + "set_exact_tokens": 97, + "mean_set_jaccard": 0.9241758241758241, + "mean_token_weighted_tv": 0.014923813373136979, + "aggregate_load_tv": 0.028205128205128206 + }, + "x_at_s0": { + "tokens": 130, + "ordered_topk_exact_tokens": 80, + "set_exact_tokens": 86, + "mean_set_jaccard": 0.8983516483516484, + "mean_token_weighted_tv": 0.017070808032384286, + "aggregate_load_tv": 0.03461538461538461 + }, + "x_at_s1": { + "tokens": 130, + "ordered_topk_exact_tokens": 77, + "set_exact_tokens": 95, + "mean_set_jaccard": 0.9131868131868132, + "mean_token_weighted_tv": 0.017867477524739047, + "aggregate_load_tv": 0.03205128205128205 + }, + "period_at_s0": { + "tokens": 130, + "ordered_topk_exact_tokens": 85, + "set_exact_tokens": 90, + "mean_set_jaccard": 0.9071428571428571, + "mean_token_weighted_tv": 0.015971425720132316, + "aggregate_load_tv": 0.028205128205128202 + }, + "period_at_s1": { + "tokens": 130, + "ordered_topk_exact_tokens": 72, + "set_exact_tokens": 87, + "mean_set_jaccard": 0.898901098901099, + "mean_token_weighted_tv": 0.019747334267370974, + "aggregate_load_tv": 0.028205128205128202 + } + } + }, + "layer_24": { + "layer": 24, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "64e1241aaa60fdc306391ca92cc90074a8b09ff73076b62cfb2206485fd0856c", + "route_weight_sha256": "1276a25363f1d657c522e4616d6684853e1298bdaf78c1dab8fb3ebd98b562fe", + "loads": [ + 15, + 12, + 6, + 16, + 24, + 32, + 19, + 7, + 7, + 26, + 16, + 11, + 10, + 24, + 10, + 10, + 0, + 6, + 12, + 10, + 25, + 27, + 6, + 15, + 5, + 5, + 1, + 1, + 4, + 17, + 51, + 5, + 11, + 17, + 13, + 10, + 3, + 8, + 8, + 24, + 8, + 8, + 8, + 1, + 12, + 2, + 15, + 12, + 10, + 27, + 5, + 15, + 2, + 1, + 12, + 9, + 20, + 14, + 26, + 4, + 13, + 2, + 5, + 20 + ], + "weighted_loads": [ + 0.5040510054677725, + 0.4343579728156328, + 0.2052469551563263, + 0.6127102747559547, + 1.3105871509760618, + 1.71763058565557, + 0.9100391361862421, + 0.2419978491961956, + 0.4710272438824177, + 1.3847390711307526, + 0.690986804664135, + 0.37141722440719604, + 0.8038082886487246, + 1.1575841754674911, + 0.5862348973751068, + 0.6645356211811304, + 0.0, + 0.2641946077346802, + 0.45270839147269726, + 0.33539709635078907, + 1.5703451819717884, + 1.0412380434572697, + 0.20815406553447247, + 0.7051498461514711, + 0.16422519087791443, + 0.18548284098505974, + 0.030764140188694, + 0.026605060324072838, + 0.12483350373804569, + 0.9588215965777636, + 4.01758985966444, + 0.1724402867257595, + 0.3645500149577856, + 1.071184914559126, + 0.37038346007466316, + 0.6553483419120312, + 0.07885969057679176, + 0.2937559634447098, + 0.2666847873479128, + 1.3614414893090725, + 0.7021293789148331, + 0.29333428107202053, + 0.2902944628149271, + 0.02646644599735737, + 0.6424067243933678, + 0.058991529047489166, + 0.5640357676893473, + 0.3998780734837055, + 0.7488280907273293, + 1.7529992423951626, + 0.20357082784175873, + 1.0543572269380093, + 0.05396145395934582, + 0.03986179083585739, + 0.6635985001921654, + 0.6061855815351009, + 1.2351132482290268, + 0.48528157360851765, + 1.5911209117621183, + 0.11790902726352215, + 0.5424613263458014, + 0.06879796087741852, + 0.20309868827462196, + 0.730453597381711 + ], + "unique_experts": 63, + "load_cv": 0.7479272255906655, + "normalized_load_entropy": 0.9365060889747068, + "max_load_share": 0.06538461538461539 + }, + "full_input": { + "tokens": 155, + "top_k": 6, + "decisions": 930, + "ordered_route_sha256": "62c104afb865cc090940ca9507bbfcfb0270d5a39aa971c6d55601f2d4f34950", + "route_weight_sha256": "38a759adfe73ff5c387c13413966d7f4b3254032b6396b64337099ce3b90f8ef", + "loads": [ + 15, + 12, + 9, + 16, + 24, + 38, + 19, + 8, + 16, + 26, + 26, + 11, + 11, + 24, + 13, + 10, + 0, + 6, + 12, + 11, + 26, + 27, + 12, + 15, + 13, + 6, + 1, + 1, + 12, + 22, + 51, + 8, + 12, + 21, + 19, + 11, + 4, + 9, + 8, + 24, + 9, + 10, + 11, + 3, + 12, + 5, + 15, + 19, + 10, + 27, + 9, + 21, + 5, + 5, + 12, + 9, + 20, + 14, + 33, + 4, + 17, + 19, + 8, + 24 + ], + "weighted_loads": [ + 0.5040510054677725, + 0.4343579728156328, + 0.3108098767697811, + 0.6127102747559547, + 1.3105871509760618, + 1.9805791372200474, + 0.9100391361862421, + 0.2976987883448601, + 0.9276428739540279, + 1.3847390711307526, + 1.0827804543077946, + 0.37141722440719604, + 0.8065597212407738, + 1.1575841754674911, + 0.6945542935281992, + 0.6645356211811304, + 0.0, + 0.2641946077346802, + 0.45270839147269726, + 0.38461109437048435, + 1.604439977556467, + 1.0412380434572697, + 0.7124184686690569, + 0.7051498461514711, + 0.46388351870700717, + 0.223056860268116, + 0.030764140188694, + 0.026605060324072838, + 0.4396686088293791, + 1.1561438348144293, + 4.01758985966444, + 0.2848091833293438, + 0.393192445859313, + 1.2567918244749308, + 0.5354480450041592, + 0.7039820030331612, + 0.1771654225885868, + 1.1566711217164993, + 0.2666847873479128, + 1.3614414893090725, + 0.738830853253603, + 0.3987326603382826, + 0.3652423406019807, + 0.14697478152811527, + 0.6424067243933678, + 0.23724829778075218, + 0.5640357676893473, + 0.8140604257350788, + 0.7488280907273293, + 1.7529992423951626, + 0.3566119559109211, + 1.4970010221004486, + 0.13853024877607822, + 0.2845274358987808, + 0.6635985001921654, + 0.6061855815351009, + 1.2351132482290268, + 0.48528157360851765, + 1.81008383911103, + 0.11790902726352215, + 0.7308671530336142, + 1.400995812844485, + 0.26511576725170016, + 2.7445768639445305 + ], + "unique_experts": 63, + "load_cv": 0.6317714461212374, + "normalized_load_entropy": 0.953599572147462, + "max_load_share": 0.054838709677419356 + } + }, + "s1_eos": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "3341e40f6dd1fd9ccbfed051668e9fead4f921959db53ebafec369af3f65a72f", + "route_weight_sha256": "eb690bdc351b657fa347057f94f44dadccdc815789f84f6d199a21653184ba60", + "loads": [ + 13, + 11, + 6, + 18, + 25, + 33, + 18, + 5, + 7, + 27, + 16, + 11, + 11, + 24, + 10, + 11, + 0, + 6, + 11, + 10, + 24, + 26, + 4, + 16, + 4, + 5, + 1, + 1, + 3, + 19, + 50, + 5, + 12, + 17, + 12, + 10, + 3, + 8, + 6, + 26, + 8, + 7, + 7, + 0, + 11, + 1, + 15, + 12, + 10, + 27, + 5, + 14, + 1, + 1, + 15, + 11, + 22, + 15, + 27, + 6, + 13, + 2, + 5, + 20 + ], + "weighted_loads": [ + 0.450745165348053, + 0.4029823187738657, + 0.2057693526148796, + 0.6883967518806458, + 1.3374258764088154, + 1.7469562720507383, + 0.8939258176833391, + 0.17883658036589622, + 0.4695586580783129, + 1.420743603259325, + 0.6983346845954657, + 0.3685304317623377, + 0.8321065474301577, + 1.1550461016595364, + 0.5824279226362705, + 0.7036472279578447, + 0.0, + 0.2639951929450035, + 0.41734211705625057, + 0.35072358697652817, + 1.5276625026017427, + 0.9786299094557762, + 0.14296208880841732, + 0.7500161305069923, + 0.13175412453711033, + 0.19118346273899078, + 0.030915092676877975, + 0.027324076741933823, + 0.10085033066570759, + 1.031774178147316, + 4.0003057308495045, + 0.17295045405626297, + 0.39846139401197433, + 1.0814064797013998, + 0.34089464880526066, + 0.6680386886000633, + 0.08081707917153835, + 0.291238646954298, + 0.205843398347497, + 1.4243145156651735, + 0.7254659198224545, + 0.26652535423636436, + 0.25663480162620544, + 0.0, + 0.6031864173710346, + 0.02677125483751297, + 0.5694450903683901, + 0.41176324151456356, + 0.7484490144997835, + 1.764110166579485, + 0.20200804620981216, + 1.0152503997087479, + 0.022654980421066284, + 0.040588051080703735, + 0.7585325259715319, + 0.6604076102375984, + 1.28503598831594, + 0.5293740928173065, + 1.612622706219554, + 0.16635948419570923, + 0.5391543973237276, + 0.0696283895522356, + 0.20461210422217846, + 0.7334068771451712 + ], + "unique_experts": 62, + "load_cv": 0.7664050664226225, + "normalized_load_entropy": 0.9312537618134147, + "max_load_share": 0.0641025641025641 + }, + "full_input": { + "tokens": 171, + "top_k": 6, + "decisions": 1026, + "ordered_route_sha256": "6cc10bdd3f2ad929ac673f0ee21c93019be8d04c4c177945de0baafcebf79efd", + "route_weight_sha256": "937174c0152fd3e09583299fc61f897e4a2fae1fbfd32fa5ee4ab4fa5b03eeec", + "loads": [ + 13, + 11, + 7, + 19, + 27, + 43, + 18, + 6, + 17, + 30, + 25, + 13, + 14, + 24, + 13, + 11, + 0, + 6, + 12, + 13, + 29, + 26, + 15, + 17, + 13, + 6, + 1, + 1, + 24, + 24, + 50, + 8, + 12, + 23, + 17, + 13, + 10, + 11, + 7, + 26, + 10, + 15, + 11, + 3, + 13, + 3, + 15, + 21, + 10, + 27, + 9, + 28, + 6, + 6, + 18, + 13, + 22, + 16, + 40, + 6, + 19, + 22, + 13, + 25 + ], + "weighted_loads": [ + 0.450745165348053, + 0.4029823187738657, + 0.2308207005262375, + 0.8019235581159592, + 1.399215817451477, + 2.1421958872815594, + 0.8939258176833391, + 0.21822070330381393, + 1.1686907117255032, + 1.5519429109990597, + 1.0882945330813527, + 0.43456294015049934, + 0.8921057572588325, + 1.1550461016595364, + 0.6948040295392275, + 0.7036472279578447, + 0.0, + 0.2639951929450035, + 0.45060098730027676, + 0.46104180440306664, + 1.7455266658216715, + 0.9786299094557762, + 0.9487961251288652, + 0.774487791582942, + 0.45682763820514083, + 0.21813771687448025, + 0.030915092676877975, + 0.027324076741933823, + 1.129358785226941, + 1.2481972984969616, + 4.0003057308495045, + 0.31167537719011307, + 0.39846139401197433, + 1.3942284546792507, + 0.5172169860452414, + 0.8044018782675266, + 0.6049839239567518, + 1.2264526057988405, + 0.2575328219681978, + 1.4243145156651735, + 0.8795787468552589, + 0.7475949823856354, + 0.3671458854805678, + 0.30329353362321854, + 0.6989925913512707, + 0.15576590597629547, + 0.5694450903683901, + 0.9619732050923631, + 0.7484490144997835, + 1.764110166579485, + 0.35728784650564194, + 2.024848286062479, + 0.16374970227479935, + 0.43300413340330124, + 0.9641310926526785, + 0.7584793418645859, + 1.28503598831594, + 0.5730696842074394, + 2.131037000915967, + 0.16635948419570923, + 0.7965494859963655, + 2.1047830739989877, + 0.602924927836284, + 2.7987619806081057 + ], + "unique_experts": 63, + "load_cv": 0.6133601910031748, + "normalized_load_entropy": 0.9547475642311615, + "max_load_share": 0.04873294346978557 + } + }, + "s0_bos": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "160e680c466989db1d70d1ea63d2ea96388b55d7d4a003be9ce1c5fa5c8be39b", + "route_weight_sha256": "ecb1075e01db8620ef09c5b50881599190774728bb9a08176d6830a43b7b751a", + "loads": [ + 12, + 12, + 6, + 15, + 23, + 31, + 18, + 7, + 8, + 26, + 14, + 11, + 11, + 24, + 10, + 11, + 0, + 9, + 11, + 13, + 26, + 26, + 6, + 16, + 4, + 5, + 1, + 1, + 3, + 18, + 50, + 6, + 10, + 16, + 12, + 10, + 3, + 8, + 7, + 26, + 8, + 8, + 6, + 0, + 12, + 2, + 15, + 11, + 7, + 27, + 6, + 15, + 1, + 1, + 14, + 10, + 21, + 15, + 28, + 6, + 15, + 1, + 5, + 20 + ], + "weighted_loads": [ + 0.42852338775992393, + 0.42728141136467457, + 0.199316143989563, + 0.5689215753227472, + 1.2671186048537493, + 1.6947213541716337, + 0.8804556615650654, + 0.2443429995328188, + 0.529723672196269, + 1.373256430029869, + 0.6315387412905693, + 0.37222846411168575, + 0.8330177124589682, + 1.160340417176485, + 0.6000599935650826, + 0.684858663007617, + 0.0, + 0.37428934313356876, + 0.42261526361107826, + 0.4252280741930008, + 1.6496452260762453, + 0.9929166696965694, + 0.1990726701915264, + 0.7288924735039473, + 0.12270953319966793, + 0.1874780561774969, + 0.03014279156923294, + 0.028244229033589363, + 0.09368566237390041, + 0.9805148784071207, + 3.9694493915885687, + 0.20483720302581787, + 0.32989167235791683, + 1.0339860282838345, + 0.3415877725929022, + 0.6560835652053356, + 0.0811696257442236, + 0.2939361594617367, + 0.23953395150601864, + 1.4217592850327492, + 0.6945991702377796, + 0.29692522063851357, + 0.2297414243221283, + 0.0, + 0.669177521020174, + 0.059370553120970726, + 0.5722489040344954, + 0.37766010500490665, + 0.6694294791668653, + 1.7751922234892845, + 0.2254281658679247, + 1.06033531203866, + 0.025781210511922836, + 0.04444195702672005, + 0.7246849685907364, + 0.6495019905269146, + 1.249056851491332, + 0.5377136096358299, + 1.6449519731104374, + 0.1721013616770506, + 0.5915477089583874, + 0.04058975353837013, + 0.20509964786469936, + 0.718502527102828 + ], + "unique_experts": 62, + "load_cv": 0.7493323787256935, + "normalized_load_entropy": 0.9344041815559878, + "max_load_share": 0.0641025641025641 + }, + "full_input": { + "tokens": 155, + "top_k": 6, + "decisions": 930, + "ordered_route_sha256": "e3fc820410c401e6b00c1cec52e7b3bf18063e0a2168f8524597217098233753", + "route_weight_sha256": "5dacdbadb4db1c3b87f2c9c103aac9859905b635ced1a29f4c86e6ccc49117ee", + "loads": [ + 12, + 12, + 9, + 15, + 23, + 36, + 19, + 8, + 16, + 26, + 23, + 11, + 12, + 24, + 13, + 11, + 0, + 9, + 11, + 15, + 27, + 26, + 13, + 16, + 12, + 5, + 2, + 1, + 11, + 23, + 51, + 10, + 11, + 20, + 19, + 11, + 4, + 10, + 7, + 26, + 9, + 9, + 10, + 1, + 12, + 5, + 16, + 16, + 7, + 27, + 11, + 21, + 4, + 5, + 14, + 10, + 21, + 15, + 34, + 6, + 19, + 19, + 7, + 22 + ], + "weighted_loads": [ + 0.42852338775992393, + 0.42728141136467457, + 0.2909999080002308, + 0.5689215753227472, + 1.2671186048537493, + 1.9323516817530617, + 0.9431634433567524, + 0.30004393868148327, + 0.9902496058493853, + 1.373256430029869, + 1.009503334760666, + 0.37222846411168575, + 0.8357691450510174, + 1.160340417176485, + 0.7080694269388914, + 0.684858663007617, + 0.0, + 0.37428934313356876, + 0.42261526361107826, + 0.4951348975300789, + 1.683740021660924, + 0.9929166696965694, + 0.8651363402605057, + 0.7288924735039473, + 0.42236786102876067, + 0.1874780561774969, + 0.4780573323369026, + 0.028244229033589363, + 0.41063876263797283, + 1.1778371166437864, + 4.009607532992959, + 0.34743702970445156, + 0.35853410325944424, + 1.2195929381996393, + 0.5350181316025555, + 0.6932700425386429, + 0.17947535775601864, + 1.1828011684119701, + 0.23953395150601864, + 1.4217592850327492, + 0.7287125997245312, + 0.356984905898571, + 0.4094602754339576, + 0.08828514069318771, + 0.669177521020174, + 0.2515081260353327, + 0.6338203754276037, + 0.728931775665842, + 0.6694294791668653, + 1.7751922234892845, + 0.44789584912359715, + 1.485042680054903, + 0.11035000532865524, + 0.28751876577734947, + 0.7246849685907364, + 0.6495019905269146, + 1.249056851491332, + 0.5377136096358299, + 1.863115230575204, + 0.1721013616770506, + 0.7760757990181446, + 1.4343997943215072, + 0.2642480352660641, + 1.735055224969983 + ], + "unique_experts": 63, + "load_cv": 0.6251779721170938, + "normalized_load_entropy": 0.9541059280247327, + "max_load_share": 0.054838709677419356 + } + }, + "s1_bos": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "1efafb8a688ce1f375eef6dfb51ead677ae4237a926e3184ef1492a7dcbcd3c0", + "route_weight_sha256": "bdf828c0235ea2f658384b95835d67f90e68e23d94a519253d1cb43b73b0e4a0", + "loads": [ + 14, + 12, + 6, + 18, + 23, + 31, + 19, + 7, + 8, + 26, + 12, + 11, + 10, + 24, + 10, + 9, + 0, + 9, + 9, + 13, + 26, + 26, + 4, + 18, + 4, + 5, + 1, + 1, + 3, + 19, + 49, + 7, + 10, + 16, + 9, + 10, + 3, + 8, + 5, + 28, + 8, + 9, + 7, + 1, + 13, + 2, + 14, + 12, + 9, + 27, + 5, + 15, + 4, + 1, + 14, + 11, + 21, + 15, + 28, + 5, + 11, + 1, + 5, + 19 + ], + "weighted_loads": [ + 0.48628656566143036, + 0.44028900749981403, + 0.20711610279977322, + 0.6753064375370741, + 1.2627666797488928, + 1.6879894901067019, + 0.9093524590134621, + 0.2447617221623659, + 0.5137562938034534, + 1.3827292248606682, + 0.5784246530383825, + 0.37069850228726864, + 0.8150982856750488, + 1.1643880791962147, + 0.5893103666603565, + 0.6349517162889242, + 0.0, + 0.3690372109413147, + 0.3577372580766678, + 0.41856853663921356, + 1.6022474560886621, + 0.979000560939312, + 0.1422047410160303, + 0.7863114401698112, + 0.12912657111883163, + 0.17968609370291233, + 0.030763838440179825, + 0.027480317279696465, + 0.10321902111172676, + 1.0137894954532385, + 3.8931718096137047, + 0.238039867952466, + 0.33624275401234627, + 1.0466127768158913, + 0.2572311367839575, + 0.6707754172384739, + 0.08209123462438583, + 0.2948370426893234, + 0.17477531172335148, + 1.4832639899104834, + 0.7297856993973255, + 0.3281424641609192, + 0.2511768229305744, + 0.027185536921024323, + 0.6905447132885456, + 0.057605694979429245, + 0.5495017692446709, + 0.40695999190211296, + 0.7195266392081976, + 1.7830119878053665, + 0.19618823006749153, + 1.058503683656454, + 0.10067344643175602, + 0.04295102134346962, + 0.7220285572111607, + 0.6692489124834538, + 1.2499998193234205, + 0.5497242696583271, + 1.6364024765789509, + 0.14365931041538715, + 0.47663622722029686, + 0.03912537917494774, + 0.20950653217732906, + 0.7112074308097363 + ], + "unique_experts": 63, + "load_cv": 0.7498937027455882, + "normalized_load_entropy": 0.9353840920949722, + "max_load_share": 0.06282051282051282 + }, + "full_input": { + "tokens": 171, + "top_k": 6, + "decisions": 1026, + "ordered_route_sha256": "2ce0e61aa9eddce66bb91604c9c8c9c71aec755d6190b9c20a12e959fb04e9fc", + "route_weight_sha256": "c0918116416f5c6cb39a1d3dcb8aa1340969dafd179e2c3dde3a04105a0e6eb2", + "loads": [ + 14, + 12, + 9, + 19, + 25, + 40, + 19, + 8, + 17, + 29, + 20, + 13, + 13, + 24, + 13, + 9, + 0, + 9, + 10, + 18, + 31, + 26, + 16, + 19, + 13, + 6, + 1, + 1, + 24, + 24, + 49, + 12, + 10, + 22, + 14, + 13, + 10, + 11, + 6, + 28, + 10, + 17, + 12, + 5, + 14, + 5, + 14, + 20, + 9, + 27, + 10, + 29, + 9, + 6, + 17, + 13, + 21, + 15, + 40, + 5, + 16, + 22, + 11, + 22 + ], + "weighted_loads": [ + 0.48628656566143036, + 0.44028900749981403, + 0.2983435336500406, + 0.7888332437723875, + 1.3245566207915545, + 2.048487506224774, + 0.9093524590134621, + 0.2841458451002836, + 1.2148747183382511, + 1.5139285326004028, + 0.956159196794033, + 0.4367310106754303, + 0.8750974955037236, + 1.1643880791962147, + 0.7025961894541979, + 0.6349517162889242, + 0.0, + 0.3690372109413147, + 0.39099612832069397, + 0.5805282723158598, + 1.8201116193085909, + 0.979000560939312, + 1.1305167842656374, + 0.8107831012457609, + 0.45420008478686213, + 0.2066403478384018, + 0.030763838440179825, + 0.027480317279696465, + 1.1355801820755005, + 1.230212615802884, + 3.8931718096137047, + 0.4599911253899336, + 0.33624275401234627, + 1.3594347517937422, + 0.43517098389565945, + 0.8068325780332088, + 0.6062580794095993, + 1.2345128878951073, + 0.22020691446959972, + 1.4832639899104834, + 0.8828590214252472, + 0.7987902015447617, + 0.4916256859432906, + 0.4210923984646797, + 0.7301588021218777, + 0.23218220844864845, + 0.5495017692446709, + 0.9819251004373655, + 0.7195266392081976, + 1.7830119878053665, + 0.4582730829715729, + 2.023913498967886, + 0.24176816828548908, + 0.43224256858229637, + 0.9276271238923073, + 0.7673206441104412, + 1.2499998193234205, + 0.5497242696583271, + 2.154054556041956, + 0.14365931041538715, + 0.694355521351099, + 2.100035364739597, + 0.5564799116691574, + 1.762329127639532 + ], + "unique_experts": 63, + "load_cv": 0.5870230472872002, + "normalized_load_entropy": 0.9588126706807989, + "max_load_share": 0.04775828460038986 + } + }, + "s0_x": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "e614a97a0c35471783ca23d5607faee6faded923c0d7a06a36468d5d7cfb2a16", + "route_weight_sha256": "cdc3635538057ef4a811f430431192adf9553d9c1fc409a6ab8c87d90b18beb7", + "loads": [ + 14, + 12, + 5, + 20, + 23, + 33, + 19, + 7, + 7, + 26, + 13, + 11, + 12, + 25, + 10, + 10, + 0, + 7, + 12, + 9, + 26, + 26, + 5, + 16, + 5, + 5, + 1, + 1, + 2, + 18, + 50, + 5, + 11, + 17, + 13, + 10, + 2, + 8, + 5, + 25, + 8, + 8, + 7, + 1, + 11, + 2, + 14, + 11, + 8, + 27, + 5, + 15, + 5, + 1, + 14, + 9, + 21, + 16, + 28, + 5, + 13, + 1, + 5, + 19 + ], + "weighted_loads": [ + 0.4714121948927641, + 0.42379116266965866, + 0.17788569629192352, + 0.7499351613223553, + 1.2445041593164206, + 1.7527437526732683, + 0.9048892538994551, + 0.23544586449861526, + 0.4958670139312744, + 1.3781745918095112, + 0.5994881093502045, + 0.3749765735119581, + 0.8563701752573252, + 1.1795130465179682, + 0.5866349600255489, + 0.678430711850524, + 0.0, + 0.298420375213027, + 0.44995242170989513, + 0.31354459933936596, + 1.6430285293608904, + 0.9843683056533337, + 0.1739391889423132, + 0.7387035172432661, + 0.14771711453795433, + 0.1875332985073328, + 0.03097384050488472, + 0.02804712764918804, + 0.06640079990029335, + 0.9821888543665409, + 3.859098942950368, + 0.17373926751315594, + 0.35123270377516747, + 1.039337795227766, + 0.3676804471760988, + 0.6669362597167492, + 0.05725273862481117, + 0.2934638485312462, + 0.17643705382943153, + 1.390762833878398, + 0.716141115874052, + 0.29034940153360367, + 0.24793208949267864, + 0.02707296796143055, + 0.6287359297275543, + 0.05733921378850937, + 0.530899353325367, + 0.38127931393682957, + 0.7034431826323271, + 1.7835761103779078, + 0.2009093351662159, + 1.0434015206992626, + 0.12378214858472347, + 0.04522576928138733, + 0.7362601608037949, + 0.616211548447609, + 1.2627269010990858, + 0.562257656827569, + 1.6358909234404564, + 0.1423347443342209, + 0.5466856192797422, + 0.04333609715104103, + 0.20065981149673462, + 0.7047641649842262 + ], + "unique_experts": 63, + "load_cv": 0.7611714560700708, + "normalized_load_entropy": 0.933554917407107, + "max_load_share": 0.0641025641025641 + }, + "full_input": { + "tokens": 155, + "top_k": 6, + "decisions": 930, + "ordered_route_sha256": "c2f935171b54e1f11137948f925c1cdfafc629a5fab683a912091505651b2454", + "route_weight_sha256": "7e248ad8ec7ee2ba6ed5491c66cec66ea66838b7acda77641a29400bd6dec65d", + "loads": [ + 14, + 12, + 7, + 20, + 23, + 39, + 19, + 8, + 16, + 26, + 23, + 11, + 14, + 25, + 13, + 10, + 0, + 7, + 12, + 9, + 27, + 26, + 11, + 16, + 13, + 6, + 1, + 1, + 11, + 23, + 50, + 7, + 12, + 21, + 21, + 11, + 4, + 9, + 6, + 25, + 9, + 10, + 10, + 2, + 11, + 5, + 14, + 17, + 8, + 27, + 9, + 21, + 8, + 6, + 14, + 9, + 21, + 16, + 35, + 5, + 17, + 18, + 7, + 22 + ], + "weighted_loads": [ + 0.4714121948927641, + 0.42379116266965866, + 0.24396716430783272, + 0.7499351613223553, + 1.2445041593164206, + 2.0145737467100844, + 0.9048892538994551, + 0.29114680364727974, + 1.0349562652409077, + 1.3781745918095112, + 1.0341583974659443, + 0.3749765735119581, + 0.8930345682892948, + 1.1795130465179682, + 0.6928206328302622, + 0.678430711850524, + 0.0, + 0.298420375213027, + 0.44995242170989513, + 0.31354459933936596, + 1.677123324945569, + 0.9843683056533337, + 0.6561428271234035, + 0.7387035172432661, + 0.44737544236704707, + 0.2267573270946741, + 0.03097384050488472, + 0.02804712764918804, + 0.4160221181809902, + 1.1795110926032066, + 3.859098942950368, + 0.24613109044730663, + 0.37987513467669487, + 1.224944705143571, + 0.6227063559927046, + 0.7034207545220852, + 0.1981787607073784, + 1.1563790068030357, + 0.21391232684254646, + 1.390762833878398, + 0.7482864707708359, + 0.39125365018844604, + 0.31731797847896814, + 0.10496390052139759, + 0.6287359297275543, + 0.2141885980963707, + 0.530899353325367, + 0.8022027801489457, + 0.7034431826323271, + 1.7835761103779078, + 0.3469270206987858, + 1.497000064700842, + 0.20835094340145588, + 0.33734290301799774, + 0.7362601608037949, + 0.616211548447609, + 1.2627269010990858, + 0.562257656827569, + 1.8850666880607605, + 0.1423347443342209, + 0.7323065605014563, + 1.4468972343020141, + 0.2538068121066317, + 1.7505698800086975 + ], + "unique_experts": 63, + "load_cv": 0.6373687092616356, + "normalized_load_entropy": 0.9526529760909427, + "max_load_share": 0.053763440860215055 + } + }, + "s1_x": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "e78408d2c4fb3da7b985a66229f828d15e04c3b0242efd3d6e587080d41816da", + "route_weight_sha256": "c1179e73f692ea118eee11f7c73117fba386186f1ca8aa392fd215b65cec91a6", + "loads": [ + 16, + 11, + 6, + 20, + 24, + 34, + 17, + 6, + 7, + 26, + 12, + 12, + 11, + 23, + 10, + 9, + 0, + 7, + 10, + 8, + 28, + 25, + 4, + 16, + 6, + 5, + 1, + 1, + 5, + 18, + 47, + 7, + 12, + 17, + 15, + 10, + 3, + 7, + 5, + 26, + 8, + 7, + 6, + 1, + 12, + 1, + 13, + 11, + 9, + 27, + 5, + 15, + 2, + 2, + 13, + 10, + 21, + 16, + 28, + 3, + 13, + 3, + 5, + 22 + ], + "weighted_loads": [ + 0.5462797619402409, + 0.3816900886595249, + 0.2061041072010994, + 0.7631903328001499, + 1.2655089665204287, + 1.7776867393404245, + 0.8525976911187172, + 0.21281862817704678, + 0.48470678366720676, + 1.3783905059099197, + 0.5709534045308828, + 0.4047273267060518, + 0.83341383934021, + 1.1236838959157467, + 0.5735109969973564, + 0.6315445099025965, + 0.0, + 0.3145270198583603, + 0.3799820486456156, + 0.2891205120831728, + 1.6941333264112473, + 0.9395603910088539, + 0.14170116558670998, + 0.7349504791200161, + 0.1869017630815506, + 0.18253357522189617, + 0.031489621847867966, + 0.026807012036442757, + 0.14945208095014095, + 0.9676863625645638, + 3.7375223487615585, + 0.23612966388463974, + 0.4009848963469267, + 1.0670896507799625, + 0.4151760898530483, + 0.6687290742993355, + 0.08178026787936687, + 0.2579951174557209, + 0.1789864506572485, + 1.414313416928053, + 0.7399268932640553, + 0.2562461793422699, + 0.2120789010077715, + 0.026560774073004723, + 0.6536431573331356, + 0.031174205243587494, + 0.5005625262856483, + 0.37542411126196384, + 0.7092258706688881, + 1.7918967939913273, + 0.19543885067105293, + 1.048656091094017, + 0.05156944505870342, + 0.06869393028318882, + 0.7056671269237995, + 0.6338600255548954, + 1.2291243392974138, + 0.5694812554866076, + 1.6460078358650208, + 0.09589135460555553, + 0.5456695724278688, + 0.10383648984134197, + 0.215852165594697, + 0.7992207240313292 + ], + "unique_experts": 63, + "load_cv": 0.7528337873489048, + "normalized_load_entropy": 0.934691990913658, + "max_load_share": 0.06025641025641026 + }, + "full_input": { + "tokens": 171, + "top_k": 6, + "decisions": 1026, + "ordered_route_sha256": "fbe654606e28b4a59f803a221792b60c73241db423b1263a96e97bd7ff0dcc1d", + "route_weight_sha256": "0753310ac18da02d545e82f838538416ee715759e992e0e9b1024dea64121674", + "loads": [ + 16, + 11, + 8, + 21, + 26, + 44, + 17, + 7, + 18, + 29, + 20, + 14, + 14, + 23, + 13, + 9, + 0, + 7, + 11, + 12, + 35, + 25, + 14, + 17, + 15, + 6, + 1, + 1, + 26, + 23, + 47, + 12, + 12, + 24, + 20, + 13, + 12, + 10, + 5, + 26, + 9, + 15, + 9, + 4, + 13, + 3, + 13, + 19, + 9, + 27, + 8, + 29, + 7, + 8, + 16, + 12, + 21, + 16, + 42, + 3, + 18, + 24, + 12, + 25 + ], + "weighted_loads": [ + 0.5462797619402409, + 0.3816900886595249, + 0.2568592019379139, + 0.8767171390354633, + 1.3272989075630903, + 2.166689913137816, + 0.8525976911187172, + 0.2522027511149645, + 1.2688067872077227, + 1.5095898136496544, + 0.9469876438379288, + 0.4707598350942135, + 0.8934130491688848, + 1.1236838959157467, + 0.6859886329621077, + 0.6315445099025965, + 0.0, + 0.3145270198583603, + 0.41324091888964176, + 0.4374895989894867, + 1.9821674712002277, + 0.9395603910088539, + 0.8706370145082474, + 0.7594221401959658, + 0.5119752767495811, + 0.20948782935738564, + 0.031489621847867966, + 0.026807012036442757, + 1.1851121913641691, + 1.1841094829142094, + 3.7375223487615585, + 0.4246513620018959, + 0.4009848963469267, + 1.4178559575229883, + 0.5805193670094013, + 0.8130985125899315, + 0.7254748996347189, + 1.1988816671073437, + 0.1789864506572485, + 1.414313416928053, + 0.8545950688421726, + 0.7237193733453751, + 0.28548302385024726, + 0.31337072513997555, + 0.6932572461664677, + 0.15360816568136215, + 0.5005625262856483, + 0.9265894911950454, + 0.7092258706688881, + 1.7918967939913273, + 0.32068201526999474, + 2.05005019903183, + 0.19266416691243649, + 0.482349643483758, + 0.9112656936049461, + 0.7319317571818829, + 1.2291243392974138, + 0.5694812554866076, + 2.2484056316316128, + 0.09589135460555553, + 0.7722047176212072, + 2.187125754542649, + 0.6070011624833569, + 1.850342420861125 + ], + "unique_experts": 63, + "load_cv": 0.6189843547482875, + "normalized_load_entropy": 0.9539687553951032, + "max_load_share": 0.04580896686159844 + } + }, + "s0_period": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "5fb7fa2093062b10637884a834e2e6ee0099cff1b9ad569c7b1f61f9475b5cdd", + "route_weight_sha256": "6a7ef2537d2aef64ca53070a04debddd47ec244a738ac20134511590aa264e31", + "loads": [ + 13, + 12, + 6, + 18, + 23, + 33, + 21, + 7, + 7, + 26, + 14, + 11, + 10, + 24, + 10, + 10, + 0, + 8, + 12, + 10, + 25, + 26, + 5, + 15, + 4, + 5, + 1, + 1, + 3, + 18, + 51, + 5, + 10, + 16, + 13, + 10, + 3, + 9, + 5, + 25, + 8, + 8, + 9, + 0, + 13, + 2, + 15, + 11, + 7, + 27, + 5, + 15, + 6, + 1, + 13, + 9, + 21, + 14, + 28, + 4, + 13, + 1, + 5, + 20 + ], + "weighted_loads": [ + 0.45830523408949375, + 0.4256649762392044, + 0.20719706825912, + 0.6891395207494497, + 1.2540384512394667, + 1.7401834186166525, + 0.9665095340460539, + 0.23869891837239265, + 0.49029622599482536, + 1.3760326504707336, + 0.6218666788190603, + 0.3707183375954628, + 0.7935895007103682, + 1.1482822876423597, + 0.5946379974484444, + 0.6805568113923073, + 0.0, + 0.3296454343944788, + 0.44910758547484875, + 0.33677804470062256, + 1.5776887834072113, + 0.9989898651838303, + 0.17439440451562405, + 0.710097249597311, + 0.12434077076613903, + 0.18714918196201324, + 0.03263763338327408, + 0.02757270075380802, + 0.0927632749080658, + 0.9792074281722307, + 3.9184583462774754, + 0.1741384994238615, + 0.331701522693038, + 1.0206096954643726, + 0.3667931128293276, + 0.6541171707212925, + 0.0832994244992733, + 0.3151937499642372, + 0.17426936514675617, + 1.3963981680572033, + 0.7332374826073647, + 0.28946802765130997, + 0.30338858254253864, + 0.0, + 0.6907529570162296, + 0.057036979123950005, + 0.5617298800498247, + 0.38128693774342537, + 0.6700157430022955, + 1.7746617514640093, + 0.2027091383934021, + 1.046160563826561, + 0.15437015146017075, + 0.04063776880502701, + 0.6957724895328283, + 0.6143498420715332, + 1.2551034316420555, + 0.5036887396126986, + 1.6337003353983164, + 0.12130007706582546, + 0.5403762068599463, + 0.04575301334261894, + 0.20298703387379646, + 0.7369292750954628 + ], + "unique_experts": 62, + "load_cv": 0.7602034400191587, + "normalized_load_entropy": 0.9337830509706694, + "max_load_share": 0.06538461538461539 + }, + "full_input": { + "tokens": 155, + "top_k": 6, + "decisions": 930, + "ordered_route_sha256": "112e486c522bb250aa7a546553b3a04075638e15d776d9de145b8eaff2037e59", + "route_weight_sha256": "a27dee9aa943fb6a431a86b9a808a41e74b128ffc4a943fd37c6bd9c8c77e451", + "loads": [ + 14, + 12, + 8, + 18, + 23, + 38, + 21, + 9, + 15, + 26, + 23, + 11, + 11, + 24, + 13, + 10, + 0, + 8, + 12, + 12, + 26, + 26, + 11, + 15, + 12, + 6, + 1, + 1, + 12, + 23, + 51, + 8, + 11, + 21, + 20, + 10, + 4, + 11, + 5, + 25, + 9, + 10, + 13, + 1, + 13, + 4, + 15, + 17, + 7, + 27, + 10, + 22, + 9, + 5, + 13, + 9, + 21, + 14, + 34, + 4, + 17, + 19, + 8, + 22 + ], + "weighted_loads": [ + 0.49497770704329014, + 0.4256649762392044, + 0.2732785362750292, + 0.6891395207494497, + 1.2540384512394667, + 1.9748220028122887, + 0.9665095340460539, + 0.3331214040517807, + 0.9439234808087349, + 1.3760326504707336, + 1.0001074206084013, + 0.3707183375954628, + 0.7963409333024174, + 1.1482822876423597, + 0.7018388975411654, + 0.6805568113923073, + 0.0, + 0.3296454343944788, + 0.44910758547484875, + 0.4061632566154003, + 1.61178357899189, + 0.9989898651838303, + 0.6463657505810261, + 0.710097249597311, + 0.42399909859523177, + 0.22577252238988876, + 0.03263763338327408, + 0.02757270075380802, + 0.4343340713530779, + 1.1765296664088964, + 3.9184583462774754, + 0.2775064427405596, + 0.3603439535945654, + 1.2419529724866152, + 0.5920019880868495, + 0.6541171707212925, + 0.18160515651106834, + 1.2089673560112715, + 0.17426936514675617, + 1.3963981680572033, + 0.7653920315206051, + 0.41389649733901024, + 0.41282850597053766, + 0.09039350599050522, + 0.6907529570162296, + 0.1876374576240778, + 0.5617298800498247, + 0.7954192053293809, + 0.6700157430022955, + 1.7746617514640093, + 0.431369137018919, + 1.584680750966072, + 0.23893894627690315, + 0.2809624969959259, + 0.6957724895328283, + 0.6143498420715332, + 1.2551034316420555, + 0.5036887396126986, + 1.8518635928630829, + 0.12130007706582546, + 0.7259073313325644, + 1.489327150862664, + 0.2880976361921057, + 1.7534819729626179 + ], + "unique_experts": 63, + "load_cv": 0.6332922563673069, + "normalized_load_entropy": 0.9527153609848292, + "max_load_share": 0.054838709677419356 + } + }, + "s1_period": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "4017130cc3f8faab2b72871dcff044878e3343e40839206c9f9415b5149123e2", + "route_weight_sha256": "2676fb9a53c38698b8a3cd9491cc62af7941878336ed6a0fcdb4ba0e8483fec2", + "loads": [ + 17, + 9, + 7, + 20, + 24, + 33, + 18, + 6, + 7, + 26, + 11, + 11, + 12, + 23, + 10, + 10, + 0, + 10, + 9, + 10, + 28, + 29, + 3, + 15, + 3, + 5, + 1, + 1, + 4, + 18, + 48, + 6, + 12, + 16, + 13, + 11, + 3, + 8, + 4, + 26, + 8, + 8, + 6, + 1, + 13, + 1, + 13, + 11, + 9, + 27, + 5, + 15, + 2, + 2, + 13, + 10, + 21, + 16, + 28, + 5, + 13, + 2, + 5, + 19 + ], + "weighted_loads": [ + 0.5802569314837456, + 0.3370160609483719, + 0.23759354278445244, + 0.7634425964206457, + 1.2453791424632072, + 1.7342109140008688, + 0.8866411298513412, + 0.21196860633790493, + 0.48804963007569313, + 1.3873642347753048, + 0.5417029149830341, + 0.38101258128881454, + 0.8641231209039688, + 1.1257183849811554, + 0.5746099315583706, + 0.6641610078513622, + 0.0, + 0.4042468871921301, + 0.35726374574005604, + 0.3398648854345083, + 1.6690407823771238, + 1.0562856364995241, + 0.10287763178348541, + 0.7197245880961418, + 0.09774530678987503, + 0.17933017387986183, + 0.03144334256649017, + 0.02751198410987854, + 0.1292415950447321, + 0.9691227413713932, + 3.756636628881097, + 0.2013780828565359, + 0.3964906334877014, + 1.0374976620078087, + 0.3745166268199682, + 0.7001528311520815, + 0.08150996267795563, + 0.2925759553909302, + 0.14209150709211826, + 1.409336069598794, + 0.7414525523781776, + 0.2877209857106209, + 0.21070629730820656, + 0.026964493095874786, + 0.7032503988593817, + 0.031580373644828796, + 0.49866267666220665, + 0.3809507302939892, + 0.7022448554635048, + 1.7911966480314732, + 0.1902510542422533, + 1.0441804826259613, + 0.05193706974387169, + 0.06944393366575241, + 0.70167475938797, + 0.6308301985263824, + 1.2290930692106485, + 0.5634536929428577, + 1.6594685968011618, + 0.14446844905614853, + 0.5461610462516546, + 0.06766774319112301, + 0.2174733504652977, + 0.7149080242961645 + ], + "unique_experts": 63, + "load_cv": 0.7617240557751961, + "normalized_load_entropy": 0.9331183661474654, + "max_load_share": 0.06153846153846154 + }, + "full_input": { + "tokens": 171, + "top_k": 6, + "decisions": 1026, + "ordered_route_sha256": "f4c75223886f03a0c6e086e6f25b8793b5cb217a53d39da796186362c93bbbc3", + "route_weight_sha256": "608bff390878d8923f4d78e8112aab9b744d0663e74ef425dc311cfe01febf8b", + "loads": [ + 17, + 9, + 8, + 21, + 26, + 43, + 18, + 7, + 16, + 29, + 19, + 13, + 15, + 23, + 14, + 10, + 0, + 10, + 10, + 14, + 33, + 29, + 14, + 16, + 12, + 6, + 1, + 1, + 25, + 23, + 48, + 9, + 12, + 22, + 18, + 15, + 10, + 12, + 4, + 26, + 9, + 16, + 10, + 5, + 14, + 4, + 13, + 19, + 9, + 27, + 10, + 30, + 7, + 8, + 16, + 12, + 21, + 16, + 42, + 5, + 18, + 23, + 12, + 22 + ], + "weighted_loads": [ + 0.5802569314837456, + 0.3370160609483719, + 0.2626448906958103, + 0.8769694026559591, + 1.307169083505869, + 2.1195260243257508, + 0.8866411298513412, + 0.25135272927582264, + 1.1950042136013508, + 1.5185635425150394, + 0.9167096596211195, + 0.4470450896769762, + 0.9241223307326436, + 1.1257183849811554, + 0.7109744623303413, + 0.6641610078513622, + 0.0, + 0.4042468871921301, + 0.3905226159840822, + 0.48909842036664486, + 1.8869049455970526, + 1.0562856364995241, + 0.9168832004070282, + 0.7441962491720915, + 0.42281882045790553, + 0.2062844280153513, + 0.03144334256649017, + 0.02751198410987854, + 1.1694374810904264, + 1.1855458617210388, + 3.756636628881097, + 0.340103005990386, + 0.3964906334877014, + 1.3503196369856596, + 0.5369915682822466, + 0.878625662997365, + 0.6056768074631691, + 1.2714230045676231, + 0.14209150709211826, + 1.409336069598794, + 0.856120727956295, + 0.7566858939826488, + 0.30977851967327297, + 0.33764975890517235, + 0.7428644876927137, + 0.1974680796265602, + 0.49866267666220665, + 0.9976649809395894, + 0.7022448554635048, + 1.7911966480314732, + 0.4219808578491211, + 2.087388798594475, + 0.19303179159760475, + 0.5042497180402279, + 0.9072733260691166, + 0.7289019301533699, + 1.2290930692106485, + 0.5634536929428577, + 2.252599870786071, + 0.14446844905614853, + 0.7684286404401064, + 2.113044918514788, + 0.6117616383126006, + 1.7660297211259604 + ], + "unique_experts": 63, + "load_cv": 0.6093824161883812, + "normalized_load_entropy": 0.9559084611660901, + "max_load_share": 0.04678362573099415 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 130, + "ordered_topk_exact_tokens": 84, + "set_exact_tokens": 99, + "mean_set_jaccard": 0.9302197802197801, + "mean_token_weighted_tv": 0.010848176307403125, + "aggregate_load_tv": 0.030769230769230774 + }, + "system_bos": { + "tokens": 130, + "ordered_topk_exact_tokens": 76, + "set_exact_tokens": 92, + "mean_set_jaccard": 0.9164835164835164, + "mean_token_weighted_tv": 0.012811184717485538, + "aggregate_load_tv": 0.029487179487179487 + }, + "system_x": { + "tokens": 130, + "ordered_topk_exact_tokens": 67, + "set_exact_tokens": 82, + "mean_set_jaccard": 0.8928571428571429, + "mean_token_weighted_tv": 0.01613670957203095, + "aggregate_load_tv": 0.035897435897435895 + }, + "system_period": { + "tokens": 130, + "ordered_topk_exact_tokens": 58, + "set_exact_tokens": 75, + "mean_set_jaccard": 0.8692307692307695, + "mean_token_weighted_tv": 0.019059061982597297, + "aggregate_load_tv": 0.04230769230769231 + }, + "bos_at_s0": { + "tokens": 130, + "ordered_topk_exact_tokens": 70, + "set_exact_tokens": 88, + "mean_set_jaccard": 0.9043956043956045, + "mean_token_weighted_tv": 0.014303239871962713, + "aggregate_load_tv": 0.03461538461538463 + }, + "bos_at_s1": { + "tokens": 130, + "ordered_topk_exact_tokens": 66, + "set_exact_tokens": 86, + "mean_set_jaccard": 0.9, + "mean_token_weighted_tv": 0.015717474521639255, + "aggregate_load_tv": 0.03974358974358974 + }, + "x_at_s0": { + "tokens": 130, + "ordered_topk_exact_tokens": 74, + "set_exact_tokens": 90, + "mean_set_jaccard": 0.9071428571428571, + "mean_token_weighted_tv": 0.014649710840044114, + "aggregate_load_tv": 0.030769230769230774 + }, + "x_at_s1": { + "tokens": 130, + "ordered_topk_exact_tokens": 57, + "set_exact_tokens": 80, + "mean_set_jaccard": 0.8802197802197803, + "mean_token_weighted_tv": 0.01920038267540244, + "aggregate_load_tv": 0.04102564102564102 + }, + "period_at_s0": { + "tokens": 130, + "ordered_topk_exact_tokens": 76, + "set_exact_tokens": 94, + "mean_set_jaccard": 0.9192307692307693, + "mean_token_weighted_tv": 0.013180273692481793, + "aggregate_load_tv": 0.025641025641025644 + }, + "period_at_s1": { + "tokens": 130, + "ordered_topk_exact_tokens": 52, + "set_exact_tokens": 78, + "mean_set_jaccard": 0.8758241758241758, + "mean_token_weighted_tv": 0.020062126821050276, + "aggregate_load_tv": 0.042307692307692296 + } + } + }, + "layer_25": { + "layer": 25, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "110b2b248f60b222011c29dc29a59a9d5551b113a4b4c6fa0aca138b94f60026", + "route_weight_sha256": "40d4423fe789c3e8edd16b4327e8c6fe90c084c95f83feec0984f731f7d7fd2f", + "loads": [ + 24, + 9, + 13, + 7, + 8, + 15, + 3, + 2, + 16, + 8, + 1, + 19, + 12, + 12, + 16, + 10, + 16, + 14, + 13, + 10, + 28, + 2, + 22, + 12, + 14, + 20, + 10, + 18, + 12, + 15, + 0, + 11, + 21, + 10, + 6, + 18, + 11, + 9, + 13, + 6, + 14, + 3, + 10, + 15, + 7, + 7, + 9, + 8, + 6, + 14, + 30, + 31, + 3, + 17, + 4, + 8, + 3, + 0, + 36, + 14, + 10, + 17, + 12, + 16 + ], + "weighted_loads": [ + 1.7280355785042048, + 0.7654174976050854, + 0.46300542168319225, + 0.28714684769511223, + 0.26371409371495247, + 1.0876797437667847, + 0.1051642894744873, + 0.057464903220534325, + 0.4754225593060255, + 0.27526187524199486, + 0.03905779868364334, + 0.7857251092791557, + 0.751964071765542, + 0.41602009534835815, + 1.1925825085490942, + 0.2827104330062866, + 0.9457528442144394, + 0.6759330872446299, + 0.6569746341556311, + 0.4663102962076664, + 1.6228989139199257, + 0.06532683223485947, + 0.8191202133893967, + 0.446167528629303, + 0.6734836678951979, + 1.5929208565503359, + 0.292323961853981, + 0.9243876654654741, + 0.5179978534579277, + 0.46116674318909645, + 0.0, + 0.9131705295294523, + 0.846594138070941, + 0.3500488307327032, + 0.1864313017576933, + 1.3869958743453026, + 1.2184757571667433, + 0.30123740434646606, + 0.5347541328519583, + 1.3000033050775528, + 0.6175797693431377, + 0.20271211117506027, + 0.5597829483449459, + 0.5595969837158918, + 0.28879513032734394, + 0.5556413903832436, + 0.2849398050457239, + 0.5479423217475414, + 0.22668365761637688, + 0.4744255840778351, + 1.652234898880124, + 1.594816317781806, + 0.4625210054218769, + 0.8907916359603405, + 0.12007411383092403, + 0.3970504645258188, + 0.09963059611618519, + 0.0, + 1.944643558934331, + 0.5567264538258314, + 0.6427853275090456, + 1.5122264362871647, + 0.737062456086278, + 0.5633816793560982 + ], + "unique_experts": 62, + "load_cv": 0.6055409283529769, + "normalized_load_entropy": 0.9539161998776459, + "max_load_share": 0.046153846153846156 + }, + "full_input": { + "tokens": 155, + "top_k": 6, + "decisions": 930, + "ordered_route_sha256": "d4dc09c8a086ef4f4560742c9080cbbfbc073c39ed9d0ade4f2179e1a9c229a3", + "route_weight_sha256": "15d168ff0da6de5606c87a15e4c12ac6b83bf829338d3e90e41279d2c765a0a0", + "loads": [ + 26, + 27, + 19, + 8, + 8, + 15, + 10, + 2, + 16, + 8, + 10, + 23, + 15, + 12, + 16, + 10, + 16, + 18, + 14, + 10, + 28, + 2, + 22, + 16, + 14, + 20, + 10, + 18, + 13, + 20, + 0, + 12, + 23, + 11, + 7, + 18, + 11, + 10, + 25, + 8, + 20, + 3, + 10, + 17, + 13, + 17, + 12, + 8, + 7, + 14, + 41, + 31, + 9, + 17, + 13, + 8, + 4, + 2, + 36, + 14, + 12, + 17, + 18, + 16 + ], + "weighted_loads": [ + 1.8331456687301397, + 2.191436927067116, + 0.7960964888334274, + 0.34768417477607727, + 0.26371409371495247, + 1.0876797437667847, + 0.6661952808499336, + 0.057464903220534325, + 0.4754225593060255, + 0.27526187524199486, + 0.9510873518884182, + 1.4867569180205464, + 1.0714729074388742, + 0.41602009534835815, + 1.1925825085490942, + 0.2827104330062866, + 0.9457528442144394, + 0.8049239851534367, + 0.6828426476567984, + 0.4663102962076664, + 1.6228989139199257, + 0.06532683223485947, + 0.8191202133893967, + 0.6929498799145222, + 0.6734836678951979, + 1.5929208565503359, + 0.292323961853981, + 0.9243876654654741, + 0.5589903369545937, + 0.6604022234678268, + 0.0, + 1.0084821190685034, + 0.965033458545804, + 0.41091487742960453, + 0.22244867496192455, + 1.3869958743453026, + 1.2184757571667433, + 0.3723973482847214, + 2.034776981920004, + 1.4994175806641579, + 0.8745814487338066, + 0.20271211117506027, + 0.5597829483449459, + 0.6317970287054777, + 0.7480476405471563, + 1.384014006704092, + 0.37619540852028877, + 0.5479423217475414, + 0.27867358550429344, + 0.4744255840778351, + 2.3249973487108946, + 1.594816317781806, + 0.8967768582515419, + 0.8907916359603405, + 0.5923256820533425, + 0.3970504645258188, + 0.16611149348318577, + 0.07142050936818123, + 1.944643558934331, + 0.5567264538258314, + 0.737896429374814, + 1.5122264362871647, + 1.1855870876461267, + 0.5633816793560982 + ], + "unique_experts": 63, + "load_cv": 0.5393992538862789, + "normalized_load_entropy": 0.9641065866223169, + "max_load_share": 0.04408602150537634 + } + }, + "s1_eos": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "83f3ee50ddabfd94192c98d8ca6d33f4c9105ce708739a4dcdadbffbe1be059e", + "route_weight_sha256": "757ffcebeebb8df82a88bc7eaa86a9db0388f6d28c17e6764ea900f40e171181", + "loads": [ + 23, + 9, + 14, + 7, + 9, + 15, + 3, + 2, + 15, + 7, + 1, + 17, + 13, + 12, + 16, + 9, + 16, + 14, + 12, + 10, + 29, + 5, + 21, + 11, + 14, + 22, + 10, + 19, + 12, + 16, + 0, + 11, + 20, + 9, + 9, + 19, + 9, + 7, + 12, + 6, + 13, + 3, + 10, + 16, + 7, + 7, + 6, + 8, + 5, + 14, + 30, + 32, + 3, + 17, + 3, + 8, + 2, + 1, + 37, + 15, + 11, + 17, + 12, + 18 + ], + "weighted_loads": [ + 1.6925591640174389, + 0.7616498302668333, + 0.4844723455607891, + 0.27953916415572166, + 0.28910099528729916, + 1.0845762565732002, + 0.10122266598045826, + 0.058001961559057236, + 0.44695541448891163, + 0.23328906670212746, + 0.0451495386660099, + 0.7332133334130049, + 0.7825948372483253, + 0.41758664697408676, + 1.1823336016386747, + 0.26012764871120453, + 0.9488520827144384, + 0.6602768376469612, + 0.643692459911108, + 0.47408333607017994, + 1.6459622606635094, + 0.1426011398434639, + 0.8002922479063272, + 0.42519040778279305, + 0.6712732799351215, + 1.6476968713104725, + 0.29363170452415943, + 0.955807413905859, + 0.5196704529225826, + 0.49152082949876785, + 0.0, + 0.9071680288761854, + 0.7991262376308441, + 0.3099846802651882, + 0.27130788564682007, + 1.4100471753627062, + 1.1993044093251228, + 0.2542501799762249, + 0.50295290350914, + 1.314702719449997, + 0.5816111601889133, + 0.2123495116829872, + 0.5592489950358868, + 0.5828615985810757, + 0.2902370449155569, + 0.5533245578408241, + 0.20559848472476006, + 0.5371643379330635, + 0.20117606967687607, + 0.47404067777097225, + 1.6552186720073223, + 1.632446175441146, + 0.45490921661257744, + 0.9080552849918604, + 0.09231054782867432, + 0.40231011621654034, + 0.0705699473619461, + 0.023427613079547882, + 2.001816038042307, + 0.587214719504118, + 0.6650465130805969, + 1.5163319744169712, + 0.7396065499633551, + 0.6201537251472473 + ], + "unique_experts": 63, + "load_cv": 0.6175815485417913, + "normalized_load_entropy": 0.9534766196417033, + "max_load_share": 0.047435897435897434 + }, + "full_input": { + "tokens": 171, + "top_k": 6, + "decisions": 1026, + "ordered_route_sha256": "61bca6a217981568e3d027a881b36d10c06fc75d7157213349fed267b48483f5", + "route_weight_sha256": "41c892f669a958516772f26df30b5406be29fc158dbb3a596bf77eba21bd0c71", + "loads": [ + 26, + 33, + 22, + 8, + 9, + 16, + 11, + 2, + 17, + 8, + 23, + 21, + 19, + 12, + 16, + 9, + 16, + 21, + 13, + 11, + 32, + 12, + 21, + 18, + 14, + 22, + 10, + 19, + 13, + 21, + 0, + 14, + 26, + 10, + 12, + 19, + 10, + 14, + 23, + 10, + 20, + 3, + 11, + 17, + 17, + 22, + 8, + 8, + 6, + 14, + 42, + 32, + 11, + 24, + 16, + 9, + 5, + 6, + 37, + 16, + 15, + 18, + 17, + 19 + ], + "weighted_loads": [ + 1.9572847597301006, + 2.78802636009641, + 0.8725057262927294, + 0.3522033877670765, + 0.28910099528729916, + 1.1232533417642117, + 0.8354440983384848, + 0.058001961559057236, + 0.5598893482238054, + 0.26146911829710007, + 2.024368032813072, + 1.4721909370273352, + 1.2194146700203419, + 0.41758664697408676, + 1.1823336016386747, + 0.26012764871120453, + 0.9488520827144384, + 1.271217904984951, + 0.6962696798145771, + 0.4977283515036106, + 1.904390662908554, + 0.7917524687945843, + 0.8002922479063272, + 0.7830658331513405, + 0.6712732799351215, + 1.6476968713104725, + 0.29363170452415943, + 0.955807413905859, + 0.5651300549507141, + 0.6855509132146835, + 0.0, + 1.377767888829112, + 1.1209041308611631, + 0.3598981387913227, + 0.4149402529001236, + 1.4100471753627062, + 1.2448540031909943, + 0.6042302027344704, + 2.234334658831358, + 1.6912488862872124, + 0.9009271040558815, + 0.2123495116829872, + 0.6453760005533695, + 0.6127042695879936, + 1.0400283057242632, + 1.8958416692912579, + 0.2484173869015649, + 0.5371643379330635, + 0.2502739764750004, + 0.47404067777097225, + 2.4403527416288853, + 1.632446175441146, + 1.0603257128968835, + 1.4212863761931658, + 0.9539494218770415, + 0.42845891788601875, + 0.22636072151362896, + 0.19525446742773056, + 2.001816038042307, + 0.6751936711370945, + 0.8998456709086895, + 1.5604700483381748, + 1.1687443926930428, + 0.6450354959815741 + ], + "unique_experts": 63, + "load_cv": 0.5067588803834105, + "normalized_load_entropy": 0.9683037388926516, + "max_load_share": 0.04093567251461988 + } + }, + "s0_bos": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "9c0fafede76f614fdbf0e05315f163fccc16d2d8eb9bd1880def1a33d9291658", + "route_weight_sha256": "0ea55bfea775419439bfc3d466109246cb7833c2bba792a68b537fed1cb233f3", + "loads": [ + 23, + 9, + 13, + 7, + 9, + 15, + 3, + 2, + 13, + 8, + 1, + 17, + 11, + 11, + 16, + 10, + 16, + 14, + 14, + 10, + 28, + 4, + 21, + 12, + 14, + 20, + 11, + 18, + 13, + 18, + 0, + 12, + 20, + 9, + 7, + 18, + 11, + 7, + 14, + 6, + 14, + 3, + 11, + 16, + 6, + 7, + 7, + 8, + 7, + 14, + 28, + 31, + 3, + 17, + 4, + 7, + 3, + 1, + 38, + 15, + 11, + 18, + 12, + 14 + ], + "weighted_loads": [ + 1.7179063372313976, + 0.7659304868429899, + 0.47518365643918514, + 0.29467717558145523, + 0.2939391452819109, + 1.0768105946481228, + 0.11411404237151146, + 0.0579777043312788, + 0.40012061782181263, + 0.2508074417710304, + 0.03613385930657387, + 0.7412767950445414, + 0.7290031127631664, + 0.38502240367233753, + 1.200317520648241, + 0.28392511792480946, + 0.9560101553797722, + 0.66783831641078, + 0.7067981157451868, + 0.4859868250787258, + 1.6373539734631777, + 0.11006269790232182, + 0.7992958854883909, + 0.4365003686398268, + 0.6851967927068472, + 1.584934487938881, + 0.31849161349236965, + 0.9258836656808853, + 0.5487101934850216, + 0.5413347687572241, + 0.0, + 0.9520235862582922, + 0.8073723204433918, + 0.31214940175414085, + 0.21595452912151814, + 1.402732938528061, + 1.1995292194187641, + 0.2610623501241207, + 0.565314257517457, + 1.3093844056129456, + 0.6290671825408936, + 0.19309484958648682, + 0.5857591200619936, + 0.5712878368794918, + 0.2586563304066658, + 0.5580975860357285, + 0.2395937293767929, + 0.5393989719450474, + 0.2610616609454155, + 0.48217595741152763, + 1.604276167228818, + 1.6005103960633278, + 0.4742063134908676, + 0.8963932283222675, + 0.1247363481670618, + 0.36988699063658714, + 0.10038620233535767, + 0.0230997446924448, + 2.0006119068711996, + 0.5852359235286713, + 0.6638177018612623, + 1.5421943366527557, + 0.7386753838509321, + 0.5153351482003927 + ], + "unique_experts": 63, + "load_cv": 0.6003067372849628, + "normalized_load_entropy": 0.9558731992219781, + "max_load_share": 0.04871794871794872 + }, + "full_input": { + "tokens": 155, + "top_k": 6, + "decisions": 930, + "ordered_route_sha256": "ceb52e489f24f30fa2eec3c83296ec26132f3c48399f8dc32c37d3fdc17e2724", + "route_weight_sha256": "40bc29a603ae0d48fcc97f1866174a87012cfebdc2ba7562d1b3dcec5bdcb4d6", + "loads": [ + 24, + 27, + 19, + 8, + 9, + 15, + 10, + 3, + 13, + 8, + 11, + 20, + 15, + 11, + 16, + 10, + 16, + 18, + 15, + 10, + 28, + 4, + 21, + 16, + 14, + 20, + 11, + 18, + 14, + 21, + 1, + 13, + 22, + 10, + 9, + 18, + 11, + 8, + 25, + 7, + 20, + 4, + 11, + 18, + 12, + 16, + 9, + 8, + 8, + 15, + 39, + 31, + 8, + 17, + 14, + 7, + 4, + 4, + 38, + 15, + 12, + 18, + 18, + 15 + ], + "weighted_loads": [ + 1.7702074870467186, + 2.1745194394607097, + 0.8731949105858803, + 0.4150916561484337, + 0.2939391452819109, + 1.0768105946481228, + 0.6708131916821003, + 0.10729401372373104, + 0.40012061782181263, + 0.2508074417710304, + 1.026800476014614, + 1.4517845530062914, + 1.1209068112075329, + 0.38502240367233753, + 1.200317520648241, + 0.28392511792480946, + 0.9560101553797722, + 0.7968292143195868, + 0.7326661292463541, + 0.4859868250787258, + 1.6373539734631777, + 0.11006269790232182, + 0.7992958854883909, + 0.697762468829751, + 0.6851967927068472, + 1.584934487938881, + 0.31849161349236965, + 0.9258836656808853, + 0.5897026769816875, + 0.6567271258682013, + 0.2994813323020935, + 1.0473351757973433, + 0.9459673911333084, + 0.3730154484510422, + 0.3093292582780123, + 1.402732938528061, + 1.1995292194187641, + 0.31956905871629715, + 1.1555676721036434, + 1.464001938700676, + 0.8860688619315624, + 0.23664777725934982, + 0.5857591200619936, + 0.6418218016624451, + 0.7237249910831451, + 1.355786643922329, + 0.32953590527176857, + 0.5393989719450474, + 0.31079595908522606, + 0.526390727609396, + 2.2788795959204435, + 1.6005103960633278, + 0.9093880169093609, + 0.8963932283222675, + 0.6406972317490727, + 0.36988699063658714, + 0.1587970368564129, + 0.14075629971921444, + 2.0006119068711996, + 0.5852359235286713, + 0.7178165148943663, + 1.5421943366527557, + 1.187200015410781, + 0.5470641981810331 + ], + "unique_experts": 64, + "load_cv": 0.5216860345548411, + "normalized_load_entropy": 0.9680168831911277, + "max_load_share": 0.041935483870967745 + } + }, + "s1_bos": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "f2d6d508f4708706dd6553f26bc71933932709aff19ca7ec2d6fddaacbfc50ad", + "route_weight_sha256": "a2d7710c689d459f6cad4c66ef455dc4763bfc67b8920d7b796932138b5182d4", + "loads": [ + 23, + 9, + 13, + 7, + 9, + 15, + 3, + 2, + 13, + 7, + 1, + 17, + 12, + 13, + 16, + 12, + 17, + 14, + 13, + 10, + 28, + 2, + 19, + 12, + 14, + 19, + 12, + 19, + 12, + 14, + 0, + 11, + 20, + 8, + 9, + 18, + 10, + 8, + 13, + 6, + 14, + 3, + 10, + 14, + 6, + 7, + 8, + 8, + 7, + 14, + 29, + 32, + 3, + 18, + 5, + 8, + 3, + 0, + 39, + 15, + 11, + 17, + 12, + 17 + ], + "weighted_loads": [ + 1.7373110428452492, + 0.7561730518937111, + 0.47971334867179394, + 0.2842878345400095, + 0.29516452737152576, + 1.085026016458869, + 0.10947399772703648, + 0.05949769169092178, + 0.38797528855502605, + 0.22016243264079094, + 0.039830341935157776, + 0.7191123887896538, + 0.7484587840735912, + 0.44124220311641693, + 1.1946609672158957, + 0.33782061748206615, + 0.9862987827509642, + 0.6738510131835938, + 0.6500036362558603, + 0.48496564477682114, + 1.607839060947299, + 0.06369931437075138, + 0.7421738505363464, + 0.4289469886571169, + 0.683892147615552, + 1.559846207499504, + 0.34123269841074944, + 0.958631819114089, + 0.5219995956867933, + 0.42818657122552395, + 0.0, + 0.9042063727974892, + 0.7980710733681917, + 0.28703744523227215, + 0.26932000927627087, + 1.3910791017115116, + 1.1961822602897882, + 0.28229798935353756, + 0.5392672754824162, + 1.2913464456796646, + 0.6223865859210491, + 0.1936657764017582, + 0.5569022856652737, + 0.5226492770016193, + 0.25886380299925804, + 0.5521228983998299, + 0.2685801796615124, + 0.5282765384763479, + 0.26879648491740227, + 0.4807274304330349, + 1.6425897758454084, + 1.6567277573049068, + 0.48945947363972664, + 0.93751235678792, + 0.1535001154989004, + 0.4055346343666315, + 0.10062123462557793, + 0.0, + 2.051117394119501, + 0.5862497240304947, + 0.6820508688688278, + 1.5143347904086113, + 0.731811948120594, + 0.6218958627432585 + ], + "unique_experts": 62, + "load_cv": 0.6079681295498338, + "normalized_load_entropy": 0.9543042816763542, + "max_load_share": 0.05 + }, + "full_input": { + "tokens": 171, + "top_k": 6, + "decisions": 1026, + "ordered_route_sha256": "651ce96e9812b6aefc342de67c8b81d55c3495c09038c9ac55d0d6b67c3c22f2", + "route_weight_sha256": "a2933b8c458da074957a1cbee2de19c703b7328836ca78315582192a866c28fc", + "loads": [ + 26, + 34, + 22, + 8, + 9, + 16, + 11, + 2, + 17, + 8, + 24, + 20, + 19, + 13, + 16, + 12, + 17, + 21, + 14, + 11, + 31, + 9, + 19, + 19, + 14, + 19, + 12, + 19, + 13, + 18, + 0, + 14, + 27, + 9, + 10, + 18, + 11, + 15, + 23, + 9, + 21, + 3, + 11, + 15, + 16, + 22, + 9, + 8, + 8, + 15, + 41, + 32, + 10, + 25, + 18, + 9, + 6, + 5, + 39, + 16, + 15, + 18, + 17, + 18 + ], + "weighted_loads": [ + 1.9821822568774223, + 2.7751403108704835, + 0.9815075621008873, + 0.33582534454762936, + 0.29516452737152576, + 1.1237031016498804, + 0.8421090673655272, + 0.05949769169092178, + 0.5850731562823057, + 0.24834248423576355, + 2.122339028865099, + 1.4669777899980545, + 1.2548601850867271, + 0.44124220311641693, + 1.1946609672158957, + 0.33782061748206615, + 0.9862987827509642, + 1.2847920805215836, + 0.7025808561593294, + 0.5086106602102518, + 1.8662674631923437, + 0.7128506433218718, + 0.7421738505363464, + 0.774962717667222, + 0.683892147615552, + 1.559846207499504, + 0.34123269841074944, + 0.958631819114089, + 0.5674591977149248, + 0.5898743588477373, + 0.0, + 1.3748062327504158, + 1.1495974883437157, + 0.33695090375840664, + 0.32341339252889156, + 1.3910791017115116, + 1.2417318541556597, + 0.6143911723047495, + 1.3722289018332958, + 1.6162238158285618, + 0.9417025297880173, + 0.1936657764017582, + 0.6430292911827564, + 0.5524919480085373, + 1.0158069916069508, + 1.8636000268161297, + 0.3100682906806469, + 0.5282765384763479, + 0.319006260484457, + 0.5236033648252487, + 2.4288130979985, + 1.6567277573049068, + 1.0902079828083515, + 1.4507434479892254, + 1.0065997003111988, + 0.4316834360361099, + 0.261426730081439, + 0.19229229167103767, + 2.051117394119501, + 0.6742286756634712, + 0.9119248948991299, + 1.558472864329815, + 1.1609497908502817, + 0.6467776335775852 + ], + "unique_experts": 63, + "load_cv": 0.5059183716436596, + "normalized_load_entropy": 0.9686580092703989, + "max_load_share": 0.03996101364522417 + } + }, + "s0_x": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "ce2432d2b253abf4dbef9367e5bd7e4fd792642b56db504ed284329861340eb3", + "route_weight_sha256": "ee6a1c52f0ac53b0895117d0b71f1ece76cffd272543b96f5be792e912e13184", + "loads": [ + 24, + 9, + 14, + 7, + 9, + 15, + 3, + 2, + 9, + 9, + 1, + 18, + 11, + 11, + 15, + 10, + 17, + 14, + 13, + 10, + 27, + 3, + 21, + 11, + 14, + 20, + 9, + 19, + 12, + 15, + 0, + 12, + 20, + 12, + 7, + 18, + 10, + 8, + 13, + 6, + 14, + 3, + 10, + 15, + 7, + 7, + 9, + 8, + 7, + 16, + 28, + 31, + 3, + 18, + 5, + 8, + 3, + 0, + 38, + 16, + 11, + 17, + 12, + 16 + ], + "weighted_loads": [ + 1.7522140219807625, + 0.7520048171281815, + 0.4928716141730547, + 0.28484540432691574, + 0.2954916600137949, + 1.077301811426878, + 0.1125686913728714, + 0.058148281648755074, + 0.269113264977932, + 0.29435135796666145, + 0.03865048661828041, + 0.7647263631224632, + 0.7171095907688141, + 0.3887624554336071, + 1.1564445085823536, + 0.2843128405511379, + 0.9842566959559917, + 0.6985389702022076, + 0.6540933828800917, + 0.4861127808690071, + 1.6042629964649677, + 0.08565039373934269, + 0.7940342966467142, + 0.3988066650927067, + 0.6903739217668772, + 1.5654628369957209, + 0.2683521043509245, + 0.963580921292305, + 0.5280027203261852, + 0.4508768692612648, + 0.0, + 0.9518756568431854, + 0.8022831305861473, + 0.40536268800497055, + 0.20651256665587425, + 1.3959133941680193, + 1.1434253007173538, + 0.2841762378811836, + 0.5422029159963131, + 1.2392201721668243, + 0.6358249895274639, + 0.1891954019665718, + 0.5527519322931767, + 0.5512973163276911, + 0.2873840257525444, + 0.5513830706477165, + 0.28499553725123405, + 0.5332932658493519, + 0.25056070275604725, + 0.5322391055524349, + 1.6112179141491652, + 1.6046511866152287, + 0.4957171529531479, + 0.9291426930576563, + 0.15524619817733765, + 0.40184286236763, + 0.09888474270701408, + 0.0, + 1.9944414626806974, + 0.622451962903142, + 0.6578278616070747, + 1.5270096734166145, + 0.7293418999761343, + 0.5735636912286282 + ], + "unique_experts": 62, + "load_cv": 0.6001314780337903, + "normalized_load_entropy": 0.9552091730033765, + "max_load_share": 0.04871794871794872 + }, + "full_input": { + "tokens": 155, + "top_k": 6, + "decisions": 930, + "ordered_route_sha256": "e8be7c897928e5496cf2889f88cee7bf4b9ce27e6f7ba86e2980ec2bd0759554", + "route_weight_sha256": "997a9fdf458050dcecdb2670b62ac773683e39104a7287b93a76a9f70dbde55c", + "loads": [ + 26, + 28, + 18, + 8, + 9, + 15, + 12, + 2, + 9, + 9, + 10, + 21, + 14, + 11, + 15, + 10, + 17, + 18, + 15, + 10, + 27, + 3, + 21, + 15, + 14, + 20, + 9, + 19, + 13, + 19, + 0, + 14, + 22, + 13, + 8, + 18, + 10, + 9, + 25, + 7, + 21, + 3, + 10, + 16, + 13, + 16, + 11, + 8, + 9, + 16, + 39, + 31, + 9, + 18, + 15, + 8, + 4, + 2, + 38, + 16, + 12, + 17, + 19, + 16 + ], + "weighted_loads": [ + 1.8412862420082092, + 2.2509259388316423, + 0.7514678128063679, + 0.3202200382947922, + 0.2954916600137949, + 1.077301811426878, + 0.7968210242688656, + 0.058148281648755074, + 0.269113264977932, + 0.29435135796666145, + 0.9678078405559063, + 1.47189562022686, + 1.0263986811041832, + 0.3887624554336071, + 1.1564445085823536, + 0.2843128405511379, + 0.9842566959559917, + 0.8275298681110144, + 0.7066279202699661, + 0.4861127808690071, + 1.6042629964649677, + 0.08565039373934269, + 0.7940342966467142, + 0.6520718894898891, + 0.6903739217668772, + 1.5654628369957209, + 0.2683521043509245, + 0.963580921292305, + 0.5689952038228512, + 0.5990396104753017, + 0.0, + 1.1403568387031555, + 0.9489533714950085, + 0.46622873470187187, + 0.25979677587747574, + 1.3959133941680193, + 1.1434253007173538, + 0.34612174704670906, + 1.2528115827590227, + 1.3938377052545547, + 0.9416213929653168, + 0.1891954019665718, + 0.5527519322931767, + 0.5840179305523634, + 0.7416603192687035, + 1.3809480294585228, + 0.3749377131462097, + 0.5332932658493519, + 0.34269643761217594, + 0.5322391055524349, + 2.2777372915297747, + 1.6046511866152287, + 1.0449590273201466, + 0.9291426930576563, + 0.7065505275968462, + 0.40184286236763, + 0.15191301703453064, + 0.06379878520965576, + 1.9944414626806974, + 0.622451962903142, + 0.7118266746401787, + 1.5270096734166145, + 1.2171073984354734, + 0.5735636912286282 + ], + "unique_experts": 63, + "load_cv": 0.5326348183264086, + "normalized_load_entropy": 0.9651305415186113, + "max_load_share": 0.041935483870967745 + } + }, + "s1_x": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "9dfe6cde37b808bca6f97d2905c70397cacfad4a17776ec967740dcd58e2cfc7", + "route_weight_sha256": "0503fbbb68509eb296746c63991f11516a4d3a0219e214167628672585840658", + "loads": [ + 24, + 9, + 12, + 7, + 9, + 15, + 3, + 3, + 8, + 9, + 1, + 18, + 11, + 13, + 14, + 12, + 16, + 14, + 13, + 10, + 29, + 4, + 22, + 12, + 13, + 20, + 12, + 19, + 12, + 14, + 0, + 12, + 20, + 9, + 7, + 18, + 10, + 9, + 13, + 6, + 14, + 3, + 10, + 13, + 7, + 7, + 9, + 8, + 6, + 15, + 28, + 33, + 3, + 19, + 5, + 8, + 2, + 0, + 39, + 14, + 11, + 17, + 11, + 16 + ], + "weighted_loads": [ + 1.7282209154218435, + 0.7368239369243383, + 0.41697634384036064, + 0.2829086259007454, + 0.2831214349716902, + 1.0872507765889168, + 0.10750363953411579, + 0.07901467569172382, + 0.2522376962006092, + 0.3067231569439173, + 0.04647739976644516, + 0.7398891057819128, + 0.7012711651623249, + 0.4456107076257467, + 1.100659066811204, + 0.34114878065884113, + 0.9591516796499491, + 0.7162048555910587, + 0.6241197884082794, + 0.4622776508331299, + 1.6091697998344898, + 0.11456421576440334, + 0.8174952920526266, + 0.4338942598551512, + 0.6511546298861504, + 1.6019347105175257, + 0.34879887849092484, + 0.9429103173315525, + 0.5096520371735096, + 0.4307418782263994, + 0.0, + 0.9248298276215792, + 0.789281340315938, + 0.30541052855551243, + 0.2104562185704708, + 1.3706481903791428, + 1.165946101769805, + 0.319472448900342, + 0.5358938872814178, + 1.2047922536730766, + 0.6229238584637642, + 0.18522116541862488, + 0.5472277458757162, + 0.48587087355554104, + 0.280718307942152, + 0.5360918045043945, + 0.29698891192674637, + 0.5313765965402126, + 0.22912088222801685, + 0.49734871089458466, + 1.6183073464781046, + 1.6792605109512806, + 0.4801955334842205, + 0.9742946531623602, + 0.14621901884675026, + 0.4052465222775936, + 0.06958919391036034, + 0.0, + 2.02816710062325, + 0.5618226900696754, + 0.6651668958365917, + 1.501933827996254, + 0.6940180733799934, + 0.6075196359306574 + ], + "unique_experts": 62, + "load_cv": 0.6145079225288769, + "normalized_load_entropy": 0.954266725105725, + "max_load_share": 0.05 + }, + "full_input": { + "tokens": 171, + "top_k": 6, + "decisions": 1026, + "ordered_route_sha256": "6cd7f8cdf345dd370620e939f931bee0b64bb8c605d8363dd65d40f371409b1b", + "route_weight_sha256": "aeb8d3e929ad3c1fc532ce83210fb36c9d1443b06350d4c709c826affae95c91", + "loads": [ + 26, + 34, + 19, + 7, + 9, + 16, + 13, + 4, + 10, + 10, + 23, + 21, + 17, + 13, + 14, + 12, + 16, + 22, + 14, + 11, + 32, + 11, + 22, + 20, + 13, + 20, + 13, + 19, + 13, + 18, + 0, + 16, + 26, + 10, + 9, + 18, + 11, + 15, + 24, + 9, + 21, + 3, + 11, + 14, + 18, + 21, + 10, + 8, + 7, + 15, + 42, + 33, + 12, + 26, + 19, + 9, + 3, + 5, + 39, + 15, + 14, + 18, + 16, + 17 + ], + "weighted_loads": [ + 1.9263728987425566, + 2.775534824701026, + 0.7694435585290194, + 0.2829086259007454, + 0.2831214349716902, + 1.1259278617799282, + 1.0400291811674833, + 0.10248604975640774, + 0.365171629935503, + 0.3349032085388899, + 2.042711067944765, + 1.4758443366736174, + 1.1161915175616741, + 0.4456107076257467, + 1.100659066811204, + 0.34114878065884113, + 0.9591516796499491, + 1.3750585801899433, + 0.6766970083117485, + 0.48592266626656055, + 1.8675982020795345, + 0.7637155447155237, + 0.8174952920526266, + 0.810412934049964, + 0.6511546298861504, + 1.6019347105175257, + 0.3876790255308151, + 0.9429103173315525, + 0.5551116392016411, + 0.5801535155624151, + 0.0, + 1.5062066335231066, + 1.0645075514912605, + 0.3553239870816469, + 0.31314246729016304, + 1.3706481903791428, + 1.2114956956356764, + 0.6209546457976103, + 1.4321889132261276, + 1.5296696238219738, + 0.9422398023307323, + 0.18522116541862488, + 0.633354751393199, + 0.515713544562459, + 1.0741646476089954, + 1.8528090193867683, + 0.3384770229458809, + 0.5313765965402126, + 0.27185059152543545, + 0.49734871089458466, + 2.5400550458580256, + 1.6792605109512806, + 1.245723444968462, + 1.4875257443636656, + 1.0986564347986132, + 0.43139532394707203, + 0.09983369521796703, + 0.16806534305214882, + 2.02816710062325, + 0.649801641702652, + 0.8420532755553722, + 1.5460719019174576, + 1.1231559161096811, + 0.6324014067649841 + ], + "unique_experts": 63, + "load_cv": 0.5131965371639418, + "normalized_load_entropy": 0.9681215677298863, + "max_load_share": 0.04093567251461988 + } + }, + "s0_period": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "38a99e658870c3f4206ee476e727863387c3a9d4662065cc54af8947b92b185d", + "route_weight_sha256": "a5d4a63fcf31075078e1b2049b1612d3160dcfaa13c4f7e9fa6a8917001c6b49", + "loads": [ + 24, + 9, + 15, + 7, + 9, + 15, + 3, + 2, + 11, + 8, + 1, + 18, + 12, + 12, + 15, + 14, + 17, + 14, + 13, + 10, + 27, + 3, + 20, + 12, + 13, + 19, + 11, + 19, + 14, + 14, + 0, + 12, + 21, + 9, + 8, + 18, + 10, + 7, + 13, + 6, + 15, + 3, + 10, + 15, + 7, + 7, + 8, + 8, + 6, + 16, + 28, + 31, + 3, + 16, + 5, + 8, + 3, + 0, + 36, + 15, + 10, + 17, + 12, + 16 + ], + "weighted_loads": [ + 1.7470385171473026, + 0.7576943319290876, + 0.522657060995698, + 0.28220631927251816, + 0.29175823740661144, + 1.0725928787142038, + 0.1064369510859251, + 0.0584827046841383, + 0.3296936545521021, + 0.2719696257263422, + 0.04418432340025902, + 0.7729732804000378, + 0.7416885253041983, + 0.4176018051803112, + 1.1671272311359644, + 0.3989427797496319, + 1.0013218652456999, + 0.6826233621686697, + 0.6495936457067728, + 0.4825111851096153, + 1.5956375561654568, + 0.0859740562736988, + 0.7687961757183075, + 0.43408855237066746, + 0.6517398860305548, + 1.5360464677214622, + 0.32052818685770035, + 0.9656645059585571, + 0.5854981318116188, + 0.4253032710403204, + 0.0, + 0.9297955259680748, + 0.8246584944427013, + 0.32151286862790585, + 0.23871513828635216, + 1.3999625071883202, + 1.1447225753217936, + 0.25558185391128063, + 0.5349483788013458, + 1.277674287557602, + 0.6680023465305567, + 0.1934344656765461, + 0.5463160499930382, + 0.553607851266861, + 0.29096116684377193, + 0.5517552420496941, + 0.2568466980010271, + 0.5236445963382721, + 0.22480276599526405, + 0.5313285458832979, + 1.6050343979150057, + 1.6047860123217106, + 0.4945843480527401, + 0.8660043179988861, + 0.15619482100009918, + 0.4036167562007904, + 0.10111118480563164, + 0.0, + 1.9572987128049135, + 0.5896687097847462, + 0.6318523362278938, + 1.516156580299139, + 0.7329703569412231, + 0.575895868241787 + ], + "unique_experts": 62, + "load_cv": 0.5896989949694519, + "normalized_load_entropy": 0.955977491489169, + "max_load_share": 0.046153846153846156 + }, + "full_input": { + "tokens": 155, + "top_k": 6, + "decisions": 930, + "ordered_route_sha256": "75d213f4d377f074d908ae3fd7aaf59e1b945e1db51e4cb11a66017e2f28e89a", + "route_weight_sha256": "1b15a4b71273679965bcd8467d71643077338f08fea3b486682a7d09a9a8a8c6", + "loads": [ + 26, + 28, + 19, + 7, + 9, + 15, + 10, + 2, + 11, + 8, + 11, + 21, + 17, + 13, + 15, + 15, + 17, + 18, + 14, + 10, + 27, + 3, + 20, + 16, + 13, + 19, + 11, + 19, + 15, + 18, + 0, + 13, + 23, + 10, + 10, + 18, + 10, + 8, + 24, + 7, + 21, + 3, + 10, + 17, + 12, + 17, + 10, + 8, + 7, + 16, + 39, + 31, + 9, + 16, + 15, + 8, + 4, + 2, + 36, + 15, + 12, + 17, + 18, + 17 + ], + "weighted_loads": [ + 1.8466093093156815, + 2.3303651560563594, + 0.7956151757389307, + 0.28220631927251816, + 0.29175823740661144, + 1.0725928787142038, + 0.6704647596925497, + 0.0584827046841383, + 0.3296936545521021, + 0.2719696257263422, + 1.0350342616438866, + 1.4879561178386211, + 1.1051181592047215, + 0.45356519520282745, + 1.1671272311359644, + 0.4472126141190529, + 1.0013218652456999, + 0.8116142600774765, + 0.6754616592079401, + 0.4825111851096153, + 1.5956375561654568, + 0.0859740562736988, + 0.7687961757183075, + 0.6866288240998983, + 0.6517398860305548, + 1.5360464677214622, + 0.32052818685770035, + 0.9656645059585571, + 0.6264906153082848, + 0.5750067699700594, + 0.0, + 1.0251071155071259, + 0.9777196422219276, + 0.38237891532480717, + 0.3318186514079571, + 1.3999625071883202, + 1.1447225753217936, + 0.32716636918485165, + 1.124285677447915, + 1.4322918206453323, + 0.9250040259212255, + 0.1934344656765461, + 0.5463160499930382, + 0.6193121485412121, + 0.7017025779932737, + 1.4932943433523178, + 0.34678887389600277, + 0.5236445963382721, + 0.2778521440923214, + 0.5313285458832979, + 2.276270477101207, + 1.6047860123217106, + 0.963802270591259, + 0.8660043179988861, + 0.6649432594422251, + 0.4036167562007904, + 0.14575548097491264, + 0.06598221138119698, + 1.9572987128049135, + 0.5896687097847462, + 0.7281407378613949, + 1.516156580299139, + 1.181494988501072, + 0.6982201784849167 + ], + "unique_experts": 63, + "load_cv": 0.5255018138109987, + "normalized_load_entropy": 0.9655914624535324, + "max_load_share": 0.041935483870967745 + } + }, + "s1_period": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "4e699a9337cef861c51344b159fd1f456e1b484f31e2ab05180e658eea80e2d2", + "route_weight_sha256": "51061440444031faa5bcbc0c88f25de85befc4b74311f6aa7b3bcefc3360b5eb", + "loads": [ + 24, + 8, + 12, + 7, + 8, + 15, + 3, + 3, + 9, + 9, + 1, + 18, + 12, + 12, + 15, + 13, + 15, + 14, + 12, + 10, + 29, + 3, + 21, + 12, + 12, + 22, + 12, + 18, + 12, + 14, + 0, + 12, + 20, + 9, + 8, + 18, + 9, + 9, + 12, + 6, + 14, + 3, + 10, + 15, + 6, + 7, + 10, + 8, + 7, + 14, + 29, + 33, + 3, + 19, + 5, + 8, + 3, + 0, + 38, + 15, + 11, + 17, + 11, + 16 + ], + "weighted_loads": [ + 1.7290751114487648, + 0.7113214880228043, + 0.4138325769454241, + 0.28838367387652397, + 0.2582872696220875, + 1.0824401210993528, + 0.1108318492770195, + 0.0815863274037838, + 0.2748233377933502, + 0.29363988153636456, + 0.04508164897561073, + 0.7526681832969189, + 0.7322441302239895, + 0.40855979919433594, + 1.1244892738759518, + 0.3708810955286026, + 0.9425123352557421, + 0.6871820632368326, + 0.582395650446415, + 0.4549745246767998, + 1.6206922363489866, + 0.08904009684920311, + 0.7869258839637041, + 0.4240975584834814, + 0.6313656456768513, + 1.650225369259715, + 0.3475139383226633, + 0.9111301489174366, + 0.5169788803905249, + 0.4320038724690676, + 0.0, + 0.9228026568889618, + 0.7813048977404833, + 0.31099929101765156, + 0.2369243260473013, + 1.3703922890126705, + 1.1409465298056602, + 0.3221678137779236, + 0.5042020995169878, + 1.1860008165240288, + 0.6332815922796726, + 0.19231847673654556, + 0.552716538310051, + 0.5457379221916199, + 0.2631695196032524, + 0.5307498872280121, + 0.32702076993882656, + 0.5326982885599136, + 0.26427748426795006, + 0.47305692359805107, + 1.6434522867202759, + 1.6963180862367153, + 0.48013870045542717, + 0.9807422291487455, + 0.15294510684907436, + 0.4077210370451212, + 0.10236479341983795, + 0.0, + 2.010380547493696, + 0.5908510498702526, + 0.6685166675597429, + 1.5067286528646946, + 0.6926269140094519, + 0.5963855590671301 + ], + "unique_experts": 62, + "load_cv": 0.6129653299547175, + "normalized_load_entropy": 0.954447951262938, + "max_load_share": 0.04871794871794872 + }, + "full_input": { + "tokens": 171, + "top_k": 6, + "decisions": 1026, + "ordered_route_sha256": "1c48ae17be8e797db3d667325d2ee006237c8ec71890f56cb0adf8beb5c9b82f", + "route_weight_sha256": "f07b54923078971a346000422022088cae2a2a863ad77b1ddb725aadde977ee8", + "loads": [ + 28, + 33, + 19, + 7, + 8, + 16, + 11, + 4, + 11, + 10, + 23, + 21, + 19, + 12, + 15, + 14, + 15, + 21, + 13, + 11, + 32, + 10, + 21, + 18, + 12, + 22, + 12, + 18, + 13, + 18, + 0, + 15, + 26, + 10, + 11, + 18, + 10, + 16, + 21, + 9, + 21, + 3, + 11, + 16, + 18, + 22, + 12, + 8, + 8, + 14, + 41, + 33, + 11, + 26, + 19, + 9, + 5, + 5, + 38, + 16, + 15, + 18, + 16, + 18 + ], + "weighted_loads": [ + 2.0399895273149014, + 2.8029990748036653, + 0.7851629052311182, + 0.28838367387652397, + 0.2582872696220875, + 1.1211172062903643, + 0.8341224007308483, + 0.105065843090415, + 0.387757271528244, + 0.32181993313133717, + 2.0189526230096817, + 1.4720697365701199, + 1.1995070651173592, + 0.40855979919433594, + 1.1244892738759518, + 0.4112967327237129, + 0.9425123352557421, + 1.2981231305748224, + 0.634972870349884, + 0.47861954011023045, + 1.8791206385940313, + 0.7381914258003235, + 0.7869258839637041, + 0.697196239605546, + 0.6313656456768513, + 1.650225369259715, + 0.3475139383226633, + 0.9111301489174366, + 0.5624384824186563, + 0.5848436448723078, + 0.0, + 1.3934025168418884, + 1.0637170188128948, + 0.36091274954378605, + 0.37908498011529446, + 1.3703922890126705, + 1.1864961236715317, + 0.6588500589132309, + 1.2945190761238337, + 1.510878186672926, + 0.9525975361466408, + 0.19231847673654556, + 0.6388435438275337, + 0.5755805931985378, + 1.1033260468393564, + 1.9087630361318588, + 0.42404833622276783, + 0.5326982885599136, + 0.3073953948915005, + 0.47305692359805107, + 2.4267728328704834, + 1.6963180862367153, + 1.1325521804392338, + 1.493973320350051, + 1.0701933859381825, + 0.4338698387145996, + 0.18866043351590633, + 0.17439306527376175, + 2.010380547493696, + 0.6788300015032291, + 0.8917862270027399, + 1.5508667267858982, + 1.1217647567391396, + 0.8533804975450039 + ], + "unique_experts": 63, + "load_cv": 0.502784180519298, + "normalized_load_entropy": 0.9694059339518402, + "max_load_share": 0.03996101364522417 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 130, + "ordered_topk_exact_tokens": 78, + "set_exact_tokens": 98, + "mean_set_jaccard": 0.9280219780219781, + "mean_token_weighted_tv": 0.010775133888595379, + "aggregate_load_tv": 0.029487179487179487 + }, + "system_bos": { + "tokens": 130, + "ordered_topk_exact_tokens": 80, + "set_exact_tokens": 95, + "mean_set_jaccard": 0.9197802197802198, + "mean_token_weighted_tv": 0.011866229041837728, + "aggregate_load_tv": 0.02692307692307693 + }, + "system_x": { + "tokens": 130, + "ordered_topk_exact_tokens": 72, + "set_exact_tokens": 95, + "mean_set_jaccard": 0.9230769230769231, + "mean_token_weighted_tv": 0.013185078571908749, + "aggregate_load_tv": 0.02307692307692308 + }, + "system_period": { + "tokens": 130, + "ordered_topk_exact_tokens": 77, + "set_exact_tokens": 92, + "mean_set_jaccard": 0.9115384615384615, + "mean_token_weighted_tv": 0.014943882077932357, + "aggregate_load_tv": 0.02948717948717949 + }, + "bos_at_s0": { + "tokens": 130, + "ordered_topk_exact_tokens": 73, + "set_exact_tokens": 91, + "mean_set_jaccard": 0.9126373626373626, + "mean_token_weighted_tv": 0.012776248400601056, + "aggregate_load_tv": 0.026923076923076928 + }, + "bos_at_s1": { + "tokens": 130, + "ordered_topk_exact_tokens": 73, + "set_exact_tokens": 90, + "mean_set_jaccard": 0.9071428571428571, + "mean_token_weighted_tv": 0.014536464278801129, + "aggregate_load_tv": 0.029487179487179493 + }, + "x_at_s0": { + "tokens": 130, + "ordered_topk_exact_tokens": 71, + "set_exact_tokens": 95, + "mean_set_jaccard": 0.9197802197802198, + "mean_token_weighted_tv": 0.013219272216352133, + "aggregate_load_tv": 0.02564102564102564 + }, + "x_at_s1": { + "tokens": 130, + "ordered_topk_exact_tokens": 63, + "set_exact_tokens": 81, + "mean_set_jaccard": 0.8860805860805862, + "mean_token_weighted_tv": 0.01798442735408361, + "aggregate_load_tv": 0.04102564102564103 + }, + "period_at_s0": { + "tokens": 130, + "ordered_topk_exact_tokens": 77, + "set_exact_tokens": 97, + "mean_set_jaccard": 0.9241758241758242, + "mean_token_weighted_tv": 0.01258031317534355, + "aggregate_load_tv": 0.026923076923076925 + }, + "period_at_s1": { + "tokens": 130, + "ordered_topk_exact_tokens": 59, + "set_exact_tokens": 76, + "mean_set_jaccard": 0.8730769230769232, + "mean_token_weighted_tv": 0.01989610746073035, + "aggregate_load_tv": 0.037179487179487186 + } + } + }, + "layer_26": { + "layer": 26, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "b4ea65ec9fca517907308b331473739c9b6a11e5f63120f7268ca2744c476db3", + "route_weight_sha256": "a8bb7a159c4bfe8631e38023b4d0f45f7752995ca036b14d444aba9d5092c1a0", + "loads": [ + 17, + 15, + 21, + 23, + 13, + 6, + 11, + 17, + 23, + 8, + 11, + 3, + 12, + 9, + 25, + 20, + 23, + 7, + 15, + 19, + 16, + 12, + 5, + 25, + 8, + 3, + 3, + 4, + 8, + 3, + 4, + 5, + 11, + 8, + 9, + 47, + 7, + 16, + 7, + 8, + 13, + 14, + 14, + 3, + 6, + 17, + 22, + 9, + 1, + 15, + 10, + 2, + 8, + 17, + 7, + 20, + 9, + 1, + 15, + 8, + 19, + 17, + 3, + 23 + ], + "weighted_loads": [ + 0.6999364160001278, + 1.085193820297718, + 1.3960320744663477, + 0.8553615435957909, + 0.9291006252169609, + 0.2298170905560255, + 0.5375747382640839, + 0.6240736581385136, + 1.4916371311992407, + 0.35128435119986534, + 0.5917023755609989, + 0.23237363621592522, + 0.7920315861701965, + 0.29932108521461487, + 2.114042904227972, + 1.382746871560812, + 1.326241198927164, + 0.2856051195412874, + 0.5520817302167416, + 1.0053064450621605, + 1.0615949351340532, + 0.5906777679920197, + 0.196475675329566, + 1.3495750539004803, + 0.6562210973352194, + 0.13426509127020836, + 0.11363700218498707, + 0.12646588869392872, + 0.4494776837527752, + 0.20604094117879868, + 0.1209902185946703, + 0.15078037418425083, + 0.4644416905939579, + 0.26449104584753513, + 0.6291670892387629, + 3.132301101461053, + 0.4505489133298397, + 0.6116531547158957, + 0.37434180825948715, + 0.40351469814777374, + 0.7012996599078178, + 1.1036025695502758, + 0.6872316803783178, + 0.15383610874414444, + 0.2427611816674471, + 0.7744403872638941, + 0.7710675317794085, + 0.35485445335507393, + 0.024802785366773605, + 0.9829519223421812, + 0.6033787112683058, + 0.062314802780747414, + 0.4454276245087385, + 0.6882943101227283, + 0.4697338920086622, + 1.247076028957963, + 0.8697019852697849, + 0.15336479246616364, + 0.6435336414724588, + 0.4674859195947647, + 1.1243388839066029, + 0.8885481990873814, + 0.11201984249055386, + 1.0928995795547962 + ], + "unique_experts": 64, + "load_cv": 0.651564646947541, + "normalized_load_entropy": 0.9512971714747465, + "max_load_share": 0.06025641025641026 + }, + "full_input": { + "tokens": 155, + "top_k": 6, + "decisions": 930, + "ordered_route_sha256": "2f22bd2995d45beb6b3edc71113e8003ceab442b8e05284a42c583f1bf1623c1", + "route_weight_sha256": "468dadd31e866bb96348a01b317085a4487119c8f48f806a51b1cef24c1c209d", + "loads": [ + 17, + 15, + 21, + 23, + 13, + 6, + 11, + 19, + 23, + 13, + 15, + 9, + 12, + 10, + 41, + 23, + 23, + 19, + 15, + 19, + 16, + 13, + 6, + 25, + 15, + 3, + 8, + 12, + 8, + 3, + 11, + 5, + 14, + 10, + 13, + 47, + 12, + 16, + 7, + 8, + 13, + 14, + 15, + 7, + 8, + 17, + 25, + 9, + 2, + 16, + 18, + 2, + 12, + 17, + 8, + 20, + 23, + 10, + 21, + 9, + 20, + 17, + 4, + 24 + ], + "weighted_loads": [ + 0.6999364160001278, + 1.085193820297718, + 1.3960320744663477, + 0.8553615435957909, + 0.9291006252169609, + 0.2298170905560255, + 0.5375747382640839, + 0.734592854976654, + 1.4916371311992407, + 0.675304252654314, + 0.9084024466574192, + 0.6216527936048806, + 0.7920315861701965, + 0.36118027567863464, + 2.885219036543276, + 1.5047703813761473, + 1.326241198927164, + 1.0317113080527633, + 0.5520817302167416, + 1.0053064450621605, + 1.0615949351340532, + 0.6230545714497566, + 0.23499649204313755, + 1.3495750539004803, + 1.0470382999628782, + 0.13426509127020836, + 1.1884896364063025, + 0.5012301057577133, + 0.4494776837527752, + 0.20604094117879868, + 0.7746219355612993, + 0.15078037418425083, + 0.5715100280940533, + 0.35695705376565456, + 0.8347354047000408, + 3.132301101461053, + 0.7269666232168674, + 0.6116531547158957, + 0.37434180825948715, + 0.40351469814777374, + 0.7012996599078178, + 1.1036025695502758, + 0.7299100253731012, + 0.40118052810430527, + 0.29580385237932205, + 0.7744403872638941, + 0.941053444519639, + 0.35485445335507393, + 0.059716518968343735, + 1.969347519800067, + 0.9504313673824072, + 0.062314802780747414, + 0.8781315442174673, + 0.6882943101227283, + 0.516434108838439, + 1.247076028957963, + 2.068700022995472, + 0.7096338700503111, + 0.8785160575062037, + 0.5158759951591492, + 1.125141526630614, + 0.8885481990873814, + 0.15253074280917645, + 1.1359167620539665 + ], + "unique_experts": 64, + "load_cv": 0.5534825469863309, + "normalized_load_entropy": 0.965255693684876, + "max_load_share": 0.05053763440860215 + } + }, + "s1_eos": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "682372ada9d0984cbdd39a424f01000b9c7338e521379e56d634bdaa71cc72ba", + "route_weight_sha256": "689c9df03a0164f166998bebf4974b72830796d2c8a8d968d3cbaccad39afecc", + "loads": [ + 18, + 15, + 22, + 19, + 13, + 5, + 12, + 17, + 22, + 12, + 11, + 3, + 12, + 8, + 24, + 19, + 23, + 6, + 17, + 20, + 15, + 11, + 6, + 26, + 8, + 3, + 4, + 2, + 8, + 5, + 6, + 6, + 10, + 7, + 8, + 49, + 7, + 14, + 7, + 9, + 13, + 14, + 13, + 4, + 7, + 17, + 21, + 9, + 0, + 14, + 10, + 2, + 8, + 15, + 7, + 20, + 10, + 1, + 15, + 8, + 19, + 17, + 2, + 25 + ], + "weighted_loads": [ + 0.7378079071640968, + 1.090038089081645, + 1.4190311674028635, + 0.7365540526807308, + 0.9188510105013847, + 0.1917204186320305, + 0.5681278072297573, + 0.6230536382645369, + 1.4413696117699146, + 0.4936314169317484, + 0.5803641229867935, + 0.23223240301012993, + 0.8012136332690716, + 0.2636082600802183, + 2.067167790606618, + 1.3637825790792704, + 1.3227614779025316, + 0.2541053518652916, + 0.6194247454404831, + 1.0481689274311066, + 1.028825679793954, + 0.5564922001212835, + 0.22315159998834133, + 1.3945296984165907, + 0.664287744089961, + 0.1301456056535244, + 0.13988742977380753, + 0.062393633648753166, + 0.45776013657450676, + 0.2711502853780985, + 0.17861304990947247, + 0.17835326865315437, + 0.42928270623087883, + 0.2240450717508793, + 0.6140791308134794, + 3.2434349432587624, + 0.4522795230150223, + 0.5368179529905319, + 0.39414558932185173, + 0.4409538824111223, + 0.7041224390268326, + 1.1121480278670788, + 0.6664089728146791, + 0.17520019598305225, + 0.27413248643279076, + 0.7653359603136778, + 0.7234784811735153, + 0.3431062866002321, + 0.0, + 0.9589926246553659, + 0.6035059671849012, + 0.06342549435794353, + 0.4454584326595068, + 0.6297328621149063, + 0.46984122321009636, + 1.2325309608131647, + 0.8810873311012983, + 0.15289098024368286, + 0.6430653054267168, + 0.4818869549781084, + 1.1303348541259766, + 0.9056013766676188, + 0.08355157636106014, + 1.1510698813945055 + ], + "unique_experts": 63, + "load_cv": 0.6559092639417855, + "normalized_load_entropy": 0.9508956237879733, + "max_load_share": 0.06282051282051282 + }, + "full_input": { + "tokens": 171, + "top_k": 6, + "decisions": 1026, + "ordered_route_sha256": "bf1a93fe47d579a0870b528b876cb6acf3a074b0a78b4dcd436bc99908c34d5d", + "route_weight_sha256": "c57af21ffe28baefab77d7e858bdcec90f5d80697d1dfe12b7392f4c4d9e5510", + "loads": [ + 19, + 15, + 22, + 19, + 16, + 5, + 12, + 19, + 22, + 20, + 18, + 11, + 12, + 9, + 39, + 26, + 23, + 13, + 18, + 20, + 15, + 17, + 13, + 26, + 18, + 4, + 15, + 13, + 8, + 8, + 15, + 7, + 14, + 8, + 15, + 49, + 18, + 19, + 10, + 10, + 14, + 14, + 15, + 9, + 10, + 18, + 24, + 10, + 1, + 17, + 17, + 2, + 17, + 17, + 10, + 22, + 28, + 11, + 25, + 15, + 22, + 17, + 5, + 26 + ], + "weighted_loads": [ + 0.7885192967951298, + 1.090038089081645, + 1.4190311674028635, + 0.7365540526807308, + 1.0972062479704618, + 0.1917204186320305, + 0.5681278072297573, + 0.7917339857667685, + 1.4413696117699146, + 0.9854896832257509, + 1.3256494589149952, + 0.933387344237417, + 0.8012136332690716, + 0.316573491320014, + 2.9257544831489213, + 1.7319270130246878, + 1.3227614779025316, + 0.8096961614210159, + 0.6763548590242863, + 1.0481689274311066, + 1.028825679793954, + 0.9098630025982857, + 0.7171193193644285, + 1.3945296984165907, + 1.1652328595519066, + 0.20191935822367668, + 1.72885063290596, + 0.5465155150741339, + 0.45776013657450676, + 0.3724995981901884, + 1.0997995901852846, + 0.2577473111450672, + 0.6047349534928799, + 0.27546149864792824, + 0.9748676475137472, + 3.2434349432587624, + 1.0545935593545437, + 0.83503832295537, + 0.6851935982704163, + 0.4766384866088629, + 0.7342133615165949, + 1.1121480278670788, + 0.7545956131070852, + 0.475168077275157, + 0.3696430139243603, + 0.7825827766209841, + 0.9392938613891602, + 0.38550868444144726, + 0.034055210649967194, + 2.1013500187546015, + 0.8847159277647734, + 0.06342549435794353, + 1.2427264135330915, + 0.8218291886150837, + 0.686611145734787, + 1.3455781396478415, + 2.7499336544424295, + 1.043979188427329, + 1.2101597059518099, + 0.7845606245100498, + 1.3705552578903735, + 0.9056013766676188, + 0.21154654771089554, + 1.1960520539432764 + ], + "unique_experts": 64, + "load_cv": 0.4919044509520826, + "normalized_load_entropy": 0.971610303811497, + "max_load_share": 0.04775828460038986 + } + }, + "s0_bos": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "5f2556e7b950ef85428ee331a3648df3dfd37371a2611ecb3889e4c265b6a9ab", + "route_weight_sha256": "3f49ef38a14fbc48c1af05b2ef1c971e0a67bd70cfe483ca513aa523f6cb0af6", + "loads": [ + 17, + 15, + 20, + 22, + 14, + 6, + 11, + 17, + 22, + 7, + 12, + 3, + 12, + 7, + 26, + 19, + 23, + 7, + 16, + 21, + 16, + 12, + 5, + 24, + 8, + 3, + 3, + 4, + 10, + 4, + 3, + 6, + 12, + 7, + 8, + 47, + 7, + 17, + 7, + 8, + 13, + 15, + 14, + 3, + 8, + 15, + 24, + 9, + 0, + 13, + 8, + 2, + 8, + 15, + 9, + 20, + 9, + 1, + 15, + 9, + 19, + 18, + 2, + 23 + ], + "weighted_loads": [ + 0.7052583284676075, + 1.103713782504201, + 1.3960593082010746, + 0.8288245666772127, + 0.9486231543123722, + 0.22042194567620754, + 0.5454955287277699, + 0.633173206821084, + 1.4524103850126266, + 0.32257397286593914, + 0.6350253894925117, + 0.2393069677054882, + 0.8086418323218822, + 0.24762030318379402, + 2.144740065559745, + 1.3506971336901188, + 1.3412542510777712, + 0.29659554176032543, + 0.5741390660405159, + 1.0557816158980131, + 1.0743334330618382, + 0.5992872398346663, + 0.19209129735827446, + 1.3171670213341713, + 0.6595388948917389, + 0.13537672720849514, + 0.11795888282358646, + 0.13370497524738312, + 0.511841518804431, + 0.24247052147984505, + 0.0906180739402771, + 0.18433542549610138, + 0.5131036285310984, + 0.2274095769971609, + 0.6032682992517948, + 3.1502240020781755, + 0.4558706134557724, + 0.6343744322657585, + 0.39185863733291626, + 0.41050053760409355, + 0.7088539488613605, + 1.141209127381444, + 0.6774685457348824, + 0.15773775801062584, + 0.2945234291255474, + 0.7047906462103128, + 0.8316369317471981, + 0.3641103394329548, + 0.0, + 0.9332264512777328, + 0.5385259687900543, + 0.06294888630509377, + 0.4449077919125557, + 0.630608007311821, + 0.5263241343200207, + 1.2589948400855064, + 0.8911862187087536, + 0.15944859385490417, + 0.6331548858433962, + 0.5036359801888466, + 1.1217316091060638, + 0.9011797420680523, + 0.08383909612894058, + 1.079549953341484 + ], + "unique_experts": 63, + "load_cv": 0.6534991537746785, + "normalized_load_entropy": 0.9500837555461104, + "max_load_share": 0.06025641025641026 + }, + "full_input": { + "tokens": 155, + "top_k": 6, + "decisions": 930, + "ordered_route_sha256": "7e80b0b73fb5b3bc4004f8070f4da16f137b7c92204907a7853e9b0bab41fb77", + "route_weight_sha256": "f0a411be61ef6e5c0fcfc02dc39ba56a4881b18c108a26a108c234aa13391fd9", + "loads": [ + 18, + 15, + 20, + 22, + 14, + 6, + 11, + 19, + 22, + 13, + 15, + 8, + 12, + 8, + 40, + 21, + 23, + 17, + 16, + 21, + 16, + 14, + 7, + 24, + 14, + 3, + 9, + 13, + 10, + 4, + 11, + 6, + 14, + 8, + 13, + 47, + 12, + 17, + 7, + 8, + 13, + 16, + 16, + 7, + 13, + 15, + 26, + 9, + 1, + 13, + 16, + 2, + 12, + 15, + 10, + 20, + 23, + 9, + 21, + 10, + 19, + 18, + 3, + 25 + ], + "weighted_loads": [ + 0.7305014934390783, + 1.103713782504201, + 1.3960593082010746, + 0.8288245666772127, + 0.9486231543123722, + 0.22042194567620754, + 0.5454955287277699, + 0.7413313072174788, + 1.4524103850126266, + 0.6890896391123533, + 0.8775440156459808, + 0.6334426570683718, + 0.8086418323218822, + 0.3094794936478138, + 2.843639489263296, + 1.4656761921942234, + 1.3412542510777712, + 0.9707321412861347, + 0.5741390660405159, + 1.0557816158980131, + 1.0743334330618382, + 0.6489431206136942, + 0.2629093825817108, + 1.3171670213341713, + 1.0063237324357033, + 0.13537672720849514, + 1.315900070592761, + 0.6013486590236425, + 0.511841518804431, + 0.24247052147984505, + 0.879006166011095, + 0.18433542549610138, + 0.5840877126902342, + 0.28533810190856457, + 0.8749976828694344, + 3.1502240020781755, + 0.733360692858696, + 0.6343744322657585, + 0.39185863733291626, + 0.41050053760409355, + 0.7088539488613605, + 1.4403745252639055, + 0.7780071087181568, + 0.4202384240925312, + 0.5083820540457964, + 0.7047906462103128, + 0.9556738622486591, + 0.3641103394329548, + 0.07217765599489212, + 0.9332264512777328, + 0.8855786249041557, + 0.06294888630509377, + 0.8774018287658691, + 0.630608007311821, + 0.5730243511497974, + 1.2589948400855064, + 2.1719065606594086, + 0.7093509528785944, + 0.868137301877141, + 0.552026055753231, + 1.1217316091060638, + 0.9011797420680523, + 0.12434999644756317, + 1.1905962862074375 + ], + "unique_experts": 64, + "load_cv": 0.5425453131409321, + "normalized_load_entropy": 0.9663013421575342, + "max_load_share": 0.05053763440860215 + } + }, + "s1_bos": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "59cab6764e65f8f4c2166821968b43d57345ae8489858658b08c42bf45e3fa0e", + "route_weight_sha256": "890a048d257669da1a22794581b48774fd016eda2cfc48c84271fee0b7718793", + "loads": [ + 16, + 15, + 20, + 21, + 14, + 5, + 12, + 15, + 22, + 9, + 14, + 3, + 12, + 7, + 26, + 20, + 21, + 9, + 16, + 20, + 16, + 12, + 5, + 24, + 8, + 3, + 3, + 4, + 9, + 5, + 4, + 6, + 10, + 9, + 10, + 47, + 7, + 15, + 8, + 9, + 13, + 16, + 13, + 3, + 7, + 14, + 22, + 10, + 2, + 13, + 7, + 2, + 8, + 15, + 8, + 19, + 9, + 2, + 14, + 9, + 19, + 14, + 4, + 26 + ], + "weighted_loads": [ + 0.6837829183787107, + 1.0990696121007204, + 1.3849340286105871, + 0.7976317834109068, + 0.9622479844838381, + 0.18883122503757477, + 0.5685414765030146, + 0.5633749160915613, + 1.4248705133795738, + 0.3921842910349369, + 0.688087698072195, + 0.23189910501241684, + 0.8090845569968224, + 0.23786146380007267, + 2.1433629002422094, + 1.3820203449577093, + 1.25722430460155, + 0.3409443777054548, + 0.5810115858912468, + 1.0639456287026405, + 1.0625525526702404, + 0.5984041299670935, + 0.1951204501092434, + 1.3252152409404516, + 0.664529412984848, + 0.13410811312496662, + 0.11448351480066776, + 0.12575105763971806, + 0.48815140686929226, + 0.2681143842637539, + 0.12002775445580482, + 0.18473987467586994, + 0.4292682483792305, + 0.2833729311823845, + 0.6647000890225172, + 3.1196102797985077, + 0.45677807182073593, + 0.5706759262830019, + 0.42707204073667526, + 0.43551379069685936, + 0.7066603768616915, + 1.184979248791933, + 0.6514883693307638, + 0.15398086979985237, + 0.2821481265127659, + 0.6768818031996489, + 0.7644505426287651, + 0.4090446028858423, + 0.05892116203904152, + 0.9480555579066277, + 0.48826258815824986, + 0.06460032984614372, + 0.44220869801938534, + 0.6298861522227526, + 0.4952075034379959, + 1.2253396920859814, + 0.8717705979943275, + 0.18157894723117352, + 0.6181450504809618, + 0.5331817902624607, + 1.1384394094347954, + 0.7952069919556379, + 0.1423652544617653, + 1.2052922025322914 + ], + "unique_experts": 64, + "load_cv": 0.6298930750500876, + "normalized_load_entropy": 0.9557968734292646, + "max_load_share": 0.06025641025641026 + }, + "full_input": { + "tokens": 171, + "top_k": 6, + "decisions": 1026, + "ordered_route_sha256": "194ef1a0e3b44fe1edccd7c4c28300dbe79b7d45dc9cd95e707213b19d736371", + "route_weight_sha256": "4ba41649a9b0cec500b8593d347090043b7d5ded5a7e87fb864281dbcedfeecf", + "loads": [ + 17, + 15, + 20, + 23, + 17, + 5, + 12, + 17, + 22, + 18, + 22, + 10, + 12, + 9, + 39, + 27, + 21, + 15, + 16, + 20, + 16, + 18, + 12, + 24, + 17, + 4, + 15, + 14, + 9, + 8, + 15, + 7, + 13, + 11, + 17, + 47, + 18, + 20, + 12, + 10, + 14, + 16, + 15, + 8, + 10, + 15, + 25, + 11, + 3, + 15, + 14, + 2, + 17, + 17, + 11, + 21, + 27, + 11, + 24, + 16, + 21, + 14, + 7, + 28 + ], + "weighted_loads": [ + 0.7262972574681044, + 1.0990696121007204, + 1.3849340286105871, + 0.8546816669404507, + 1.1406032219529152, + 0.18883122503757477, + 0.5685414765030146, + 0.7201097402721643, + 1.4248705133795738, + 0.9273222982883453, + 1.496812455356121, + 0.9384742043912411, + 0.8090845569968224, + 0.33757241629064083, + 2.938357127830386, + 1.7494160681962967, + 1.25722430460155, + 0.9001648742705584, + 0.5810115858912468, + 1.0639456287026405, + 1.0625525526702404, + 0.9517749324440956, + 0.6711193323135376, + 1.3252152409404516, + 1.1295352298766375, + 0.2058818656951189, + 1.8478731382638216, + 0.5688174571841955, + 0.48815140686929226, + 0.3694636970758438, + 1.1964839808642864, + 0.2641339171677828, + 0.5631757043302059, + 0.3900576941668987, + 1.0696497689932585, + 3.1196102797985077, + 1.0599288754165173, + 0.8688962962478399, + 0.7661088034510612, + 0.4711983948945999, + 0.7367512993514538, + 1.184979248791933, + 0.7462968546897173, + 0.467906229197979, + 0.39154401049017906, + 0.6941286195069551, + 0.9715952798724174, + 0.45144700072705746, + 0.09297637268900871, + 1.1057109013199806, + 0.769472548738122, + 0.06460032984614372, + 1.21784402243793, + 0.82198247872293, + 0.7119774259626865, + 1.3383868709206581, + 2.7914819456636906, + 1.0693287570029497, + 1.1852394510060549, + 0.8358554597944021, + 1.3777342289686203, + 0.7952069919556379, + 0.2703602258116007, + 1.3314048945903778 + ], + "unique_experts": 64, + "load_cv": 0.4723587452546062, + "normalized_load_entropy": 0.9743431550500335, + "max_load_share": 0.04580896686159844 + } + }, + "s0_x": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "02ed9d241c0150b7cb742fe87133a90d6b5794a2f78b0a125512baddc9593f8e", + "route_weight_sha256": "13bf639ffbd2f15951bc28c6db76a3d4f7e1f31860021c209eade14d98a9fda0", + "loads": [ + 17, + 14, + 21, + 22, + 16, + 5, + 11, + 17, + 21, + 8, + 12, + 4, + 12, + 6, + 26, + 20, + 22, + 7, + 17, + 21, + 16, + 13, + 6, + 23, + 8, + 3, + 3, + 4, + 9, + 4, + 3, + 5, + 12, + 8, + 8, + 47, + 7, + 17, + 8, + 9, + 14, + 16, + 14, + 3, + 7, + 16, + 21, + 10, + 1, + 13, + 10, + 2, + 8, + 15, + 6, + 20, + 9, + 1, + 14, + 8, + 19, + 13, + 3, + 25 + ], + "weighted_loads": [ + 0.7149065714329481, + 1.056464396417141, + 1.4196926075965166, + 0.8345944415777922, + 1.0139023289084435, + 0.19312801398336887, + 0.5392081178724766, + 0.6269042007625103, + 1.4247910119593143, + 0.33857477828860283, + 0.6282955929636955, + 0.26631143502891064, + 0.815318301320076, + 0.2102130688726902, + 2.157958125695586, + 1.3728166427463293, + 1.313947768881917, + 0.2905211690813303, + 0.6069537978619337, + 1.0643120016902685, + 1.0771153904497623, + 0.6265782453119755, + 0.2205689288675785, + 1.2783401161432266, + 0.6602189261466265, + 0.13936526887118816, + 0.11664946004748344, + 0.12457967922091484, + 0.48440295830368996, + 0.24509278684854507, + 0.08942209742963314, + 0.14854965917766094, + 0.4849210921674967, + 0.2602090574800968, + 0.5929625369608402, + 3.160312309861183, + 0.4554526247084141, + 0.6315051019191742, + 0.4264349937438965, + 0.43909732066094875, + 0.7365911062806845, + 1.1810367051512003, + 0.6773019284009933, + 0.15512333437800407, + 0.2732795216143131, + 0.7394223362207413, + 0.7414005007594824, + 0.39691573195159435, + 0.030207913368940353, + 0.932999761775136, + 0.5980005543678999, + 0.06445769220590591, + 0.44322718121111393, + 0.6408156417310238, + 0.4371287636458874, + 1.2586013153195381, + 0.879936957731843, + 0.1563405841588974, + 0.6221857387572527, + 0.45941518619656563, + 1.1152500659227371, + 0.7467446867376566, + 0.1133132167160511, + 1.163230774924159 + ], + "unique_experts": 64, + "load_cv": 0.6462148933310955, + "normalized_load_entropy": 0.9521043838933115, + "max_load_share": 0.06025641025641026 + }, + "full_input": { + "tokens": 155, + "top_k": 6, + "decisions": 930, + "ordered_route_sha256": "a2923524a773dcda9d4c9729e06994606dcaff0faeb30f307ec616816c81ff0f", + "route_weight_sha256": "a7b928c9709633963d061625759f1fc09f4fbf3a8005aaa36918799db9c3b39d", + "loads": [ + 17, + 14, + 21, + 22, + 16, + 5, + 11, + 19, + 21, + 13, + 16, + 11, + 12, + 8, + 41, + 23, + 22, + 19, + 17, + 21, + 16, + 14, + 6, + 23, + 14, + 3, + 8, + 13, + 9, + 5, + 9, + 5, + 14, + 9, + 12, + 47, + 12, + 17, + 9, + 9, + 14, + 16, + 15, + 9, + 8, + 16, + 23, + 10, + 1, + 13, + 18, + 2, + 12, + 15, + 7, + 20, + 26, + 10, + 20, + 9, + 19, + 13, + 4, + 27 + ], + "weighted_loads": [ + 0.7149065714329481, + 1.056464396417141, + 1.4196926075965166, + 0.8345944415777922, + 1.0139023289084435, + 0.19312801398336887, + 0.5392081178724766, + 0.7343635559082031, + 1.4247910119593143, + 0.6625576019287109, + 0.923722643405199, + 0.8059117384254932, + 0.815318301320076, + 0.3175477422773838, + 2.95413551107049, + 1.487533999606967, + 1.313947768881917, + 1.0881395861506462, + 0.6069537978619337, + 1.0643120016902685, + 1.0771153904497623, + 0.6589550487697124, + 0.2205689288675785, + 1.2783401161432266, + 1.0116138439625502, + 0.13936526887118816, + 1.1516717672348022, + 0.5262158345431089, + 0.48440295830368996, + 0.2935468330979347, + 0.7429277766495943, + 0.14854965917766094, + 0.5536303054541349, + 0.33283546194434166, + 0.801324712112546, + 3.160312309861183, + 0.7275103405117989, + 0.6315051019191742, + 0.4657394103705883, + 0.43909732066094875, + 0.7365911062806845, + 1.1810367051512003, + 0.7309955283999443, + 0.4989268071949482, + 0.30655112862586975, + 0.7394223362207413, + 0.8654374312609434, + 0.39691573195159435, + 0.030207913368940353, + 0.932999761775136, + 0.9450532104820013, + 0.06445769220590591, + 0.8632064703851938, + 0.6408156417310238, + 0.48382898047566414, + 1.2586013153195381, + 2.2951074335724115, + 0.8170016948133707, + 0.8571681547909975, + 0.5078052617609501, + 1.1152500659227371, + 0.7467446867376566, + 0.1538241170346737, + 1.2332373969256878 + ], + "unique_experts": 64, + "load_cv": 0.5498609752922837, + "normalized_load_entropy": 0.9657147095949502, + "max_load_share": 0.05053763440860215 + } + }, + "s1_x": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "64e3e4f27a5c120e561c0a9d1b43934cd8e86a2d753204ef4968b922d6a71d93", + "route_weight_sha256": "b13f5c1b10da4bacea5b4721659a936bfd75ef154cfa584105604690625174fb", + "loads": [ + 17, + 15, + 21, + 21, + 13, + 6, + 11, + 14, + 21, + 8, + 13, + 4, + 12, + 8, + 24, + 18, + 24, + 8, + 16, + 21, + 14, + 11, + 7, + 25, + 8, + 3, + 4, + 3, + 8, + 6, + 2, + 5, + 10, + 10, + 8, + 49, + 7, + 13, + 10, + 8, + 13, + 17, + 13, + 4, + 8, + 15, + 22, + 10, + 1, + 14, + 9, + 2, + 8, + 14, + 8, + 20, + 9, + 1, + 14, + 10, + 19, + 15, + 1, + 27 + ], + "weighted_loads": [ + 0.699631055817008, + 1.0600745677947998, + 1.410704094916582, + 0.8051008563488722, + 0.9159173518419266, + 0.20935741253197193, + 0.5324499495327473, + 0.529783558100462, + 1.3949672058224678, + 0.36141729913651943, + 0.633307158946991, + 0.25785037130117416, + 0.805714450776577, + 0.2617446072399616, + 2.075701555237174, + 1.308729289099574, + 1.339155899360776, + 0.3103352691978216, + 0.5860059410333633, + 1.0830008406192064, + 0.9838486649096012, + 0.5566413998603821, + 0.24664337746798992, + 1.3579412810504436, + 0.6594582796096802, + 0.13286679238080978, + 0.13861460983753204, + 0.09865142963826656, + 0.453543309122324, + 0.3235398903489113, + 0.054356254637241364, + 0.15304562263190746, + 0.41422577388584614, + 0.3231108095496893, + 0.601953525096178, + 3.19867429882288, + 0.46128566190600395, + 0.4797179941087961, + 0.5002763047814369, + 0.40707552805542946, + 0.7199706453830004, + 1.213126229122281, + 0.6503774095326662, + 0.17285281047224998, + 0.3087394516915083, + 0.6948388814926147, + 0.7639679629355669, + 0.38989875093102455, + 0.03375205025076866, + 0.9592547118663788, + 0.5490690637379885, + 0.06397602148354053, + 0.45202374644577503, + 0.5868951268494129, + 0.4925609715282917, + 1.2186784464865923, + 0.8546091336756945, + 0.15355229377746582, + 0.6550253108143806, + 0.564813282340765, + 1.1363754644989967, + 0.8179805483669043, + 0.052619826048612595, + 1.239566134288907 + ], + "unique_experts": 64, + "load_cv": 0.6509185337206888, + "normalized_load_entropy": 0.9523972279508023, + "max_load_share": 0.06282051282051282 + }, + "full_input": { + "tokens": 171, + "top_k": 6, + "decisions": 1026, + "ordered_route_sha256": "6cc08017b2cee98721e7fab8ae587d41e844ab3f29169e7f7411c1ecf919c2c1", + "route_weight_sha256": "0262c5c060e9ae16fdd9c867f85176e37f4c61ada99c0ec8ed70519b88eb9aa9", + "loads": [ + 17, + 15, + 21, + 22, + 16, + 7, + 11, + 16, + 21, + 16, + 20, + 13, + 12, + 9, + 39, + 25, + 24, + 14, + 16, + 21, + 14, + 17, + 13, + 25, + 17, + 4, + 16, + 14, + 8, + 10, + 11, + 6, + 14, + 11, + 14, + 49, + 18, + 18, + 14, + 9, + 14, + 17, + 15, + 9, + 9, + 16, + 24, + 11, + 2, + 16, + 16, + 2, + 17, + 16, + 11, + 22, + 29, + 12, + 25, + 18, + 21, + 15, + 4, + 28 + ], + "weighted_loads": [ + 0.699631055817008, + 1.0600745677947998, + 1.410704094916582, + 0.8307162839919329, + 1.0942725893110037, + 0.2571623045951128, + 0.5324499495327473, + 0.7094675935804844, + 1.3949672058224678, + 0.8518453985452652, + 1.4539868272840977, + 1.1225213892757893, + 0.805714450776577, + 0.3147098384797573, + 3.0261290948837996, + 1.681061638519168, + 1.339155899360776, + 0.8702732268720865, + 0.5860059410333633, + 1.0830008406192064, + 0.9838486649096012, + 0.9100122023373842, + 0.686808655038476, + 1.3579412810504436, + 1.12593531049788, + 0.20464054495096207, + 1.697477612644434, + 0.5785302873700857, + 0.453543309122324, + 0.4983840249478817, + 0.9565176665782928, + 0.2324396651238203, + 0.5794828943908215, + 0.35565888695418835, + 0.9248945713043213, + 3.19867429882288, + 1.0616582408547401, + 0.7779383640736341, + 0.8405961133539677, + 0.44276013225317, + 0.7500615678727627, + 1.213126229122281, + 0.7417354267090559, + 0.4645399674773216, + 0.33927260152995586, + 0.712085697799921, + 0.925523055717349, + 0.4323011487722397, + 0.06780726090073586, + 1.1169100552797318, + 0.8302790243178606, + 0.06397602148354053, + 1.223094018176198, + 0.7789914533495903, + 0.7093308940529823, + 1.331725625321269, + 2.8521033618599176, + 1.2094905264675617, + 1.2859403640031815, + 0.913208482787013, + 1.3756702840328217, + 0.8179805483669043, + 0.180614797398448, + 1.284548306837678 + ], + "unique_experts": 64, + "load_cv": 0.4850590387655508, + "normalized_load_entropy": 0.9729719715104909, + "max_load_share": 0.04775828460038986 + } + }, + "s0_period": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "eb623b14e5586841a34e1dcc9ebc1658d1f35ece6eca333a1c07a45b8c0c2bfb", + "route_weight_sha256": "1964a35e3146a0c5ef26556439c0793b900cff77c1b69921115c8011ea064906", + "loads": [ + 17, + 14, + 21, + 22, + 13, + 5, + 11, + 15, + 21, + 8, + 13, + 4, + 12, + 8, + 26, + 20, + 21, + 7, + 18, + 19, + 16, + 13, + 5, + 25, + 8, + 3, + 3, + 4, + 8, + 5, + 4, + 5, + 11, + 8, + 10, + 49, + 7, + 16, + 8, + 8, + 13, + 16, + 12, + 3, + 8, + 17, + 23, + 9, + 0, + 13, + 11, + 2, + 8, + 15, + 6, + 20, + 9, + 1, + 14, + 10, + 19, + 13, + 2, + 25 + ], + "weighted_loads": [ + 0.6971296109259129, + 1.0661552753299475, + 1.4257082417607307, + 0.830750247463584, + 0.9395809769630432, + 0.19206259585916996, + 0.5367708373814821, + 0.5683553088456392, + 1.4188072625547647, + 0.347200445830822, + 0.6550379153341055, + 0.26617674343287945, + 0.8184729516506195, + 0.2701748237013817, + 2.148819899186492, + 1.3585894089192152, + 1.2729182913899422, + 0.28310939110815525, + 0.6416332144290209, + 1.0193876810371876, + 1.0624372269958258, + 0.6277379151433706, + 0.1979680322110653, + 1.3458900786936283, + 0.6636399198323488, + 0.13842210359871387, + 0.11736350320279598, + 0.12457650154829025, + 0.4642723985016346, + 0.27387747541069984, + 0.11778774112462997, + 0.14994580298662186, + 0.4579239450395107, + 0.2638250384479761, + 0.6524624973535538, + 3.2017757054418325, + 0.44994568824768066, + 0.6080450713634491, + 0.4181790463626385, + 0.41167955845594406, + 0.7123680617660284, + 1.1759061813354492, + 0.6301491372287273, + 0.15558336675167084, + 0.3080669045448303, + 0.7725913729518652, + 0.8010990601032972, + 0.3560098297894001, + 0.0, + 0.9274937100708485, + 0.6326053962111473, + 0.0679545421153307, + 0.4444285240024328, + 0.6379293724894524, + 0.43059512972831726, + 1.2586882207542658, + 0.8893180824816227, + 0.15500767529010773, + 0.6174501106142998, + 0.5472811870276928, + 1.1240346767008305, + 0.7474317345768213, + 0.07943778485059738, + 1.1638925522565842 + ], + "unique_experts": 63, + "load_cv": 0.6576710647841415, + "normalized_load_entropy": 0.9507128138160548, + "max_load_share": 0.06282051282051282 + }, + "full_input": { + "tokens": 155, + "top_k": 6, + "decisions": 930, + "ordered_route_sha256": "c099ccb7889bb40cd9aefd9137484554c9aed98bb201d445764c5f3f134d1e8f", + "route_weight_sha256": "115776b4d161f5ed46fdeb59b5e33b35666a6c27dc4a1fc7b55a0214490e0bbf", + "loads": [ + 17, + 14, + 21, + 22, + 13, + 6, + 11, + 17, + 21, + 13, + 17, + 9, + 12, + 10, + 40, + 21, + 21, + 18, + 18, + 19, + 16, + 14, + 5, + 25, + 15, + 3, + 8, + 12, + 8, + 5, + 12, + 5, + 14, + 10, + 14, + 49, + 13, + 16, + 8, + 8, + 13, + 16, + 13, + 7, + 10, + 17, + 26, + 9, + 1, + 13, + 19, + 2, + 13, + 15, + 7, + 20, + 25, + 9, + 20, + 11, + 19, + 13, + 3, + 29 + ], + "weighted_loads": [ + 0.6971296109259129, + 1.0661552753299475, + 1.4257082417607307, + 0.830750247463584, + 0.9395809769630432, + 0.22990396805107594, + 0.5367708373814821, + 0.699770225211978, + 1.4188072625547647, + 0.6766736954450607, + 0.963461821898818, + 0.65488475933671, + 0.8184729516506195, + 0.3762529529631138, + 2.8443211875855923, + 1.4168981928378344, + 1.2729182913899422, + 1.0368991568684578, + 0.6416332144290209, + 1.0193876810371876, + 1.0624372269958258, + 0.6601147186011076, + 0.1979680322110653, + 1.3458900786936283, + 1.1092378553003073, + 0.13842210359871387, + 1.1885157767683268, + 0.49965166114270687, + 0.4642723985016346, + 0.27387747541069984, + 0.8317446950823069, + 0.14994580298662186, + 0.5650331974029541, + 0.37896388210356236, + 0.8565698582679033, + 3.2017757054418325, + 0.782215278595686, + 0.6080450713634491, + 0.4181790463626385, + 0.41167955845594406, + 0.7123680617660284, + 1.1759061813354492, + 0.683767206966877, + 0.41361483931541443, + 0.37756356596946716, + 0.7725913729518652, + 0.9649463873356581, + 0.3560098297894001, + 0.03861139714717865, + 0.9274937100708485, + 0.9796580523252487, + 0.0679545421153307, + 0.9455206487327814, + 0.6379293724894524, + 0.477295346558094, + 1.2586882207542658, + 2.253873582929373, + 0.7035979721695185, + 0.8524325266480446, + 0.5956712625920773, + 1.1240346767008305, + 0.7474317345768213, + 0.11994868516921997, + 1.339731251820922 + ], + "unique_experts": 64, + "load_cv": 0.5606555138020721, + "normalized_load_entropy": 0.964617127760724, + "max_load_share": 0.05268817204301075 + } + }, + "s1_period": { + "target_content": { + "tokens": 130, + "top_k": 6, + "decisions": 780, + "ordered_route_sha256": "785d81a4be4ba913b2a655abff41cf7f3e015e65a377e6d3b923c0780c31bf86", + "route_weight_sha256": "6161d0ca7fd1e659e69950fbfa63715361cc07b2e8c5379f231c6793e2ff23b2", + "loads": [ + 17, + 15, + 20, + 21, + 14, + 6, + 11, + 14, + 21, + 8, + 12, + 3, + 12, + 8, + 24, + 18, + 23, + 9, + 19, + 21, + 14, + 10, + 7, + 24, + 8, + 2, + 3, + 3, + 8, + 7, + 4, + 5, + 10, + 8, + 8, + 49, + 7, + 14, + 10, + 9, + 13, + 16, + 13, + 4, + 7, + 15, + 21, + 11, + 1, + 13, + 10, + 2, + 8, + 15, + 6, + 22, + 9, + 1, + 15, + 10, + 20, + 16, + 1, + 25 + ], + "weighted_loads": [ + 0.6974578015506268, + 1.0546313654631376, + 1.3795308228582144, + 0.8105266690254211, + 0.9417560063302517, + 0.21244193613529205, + 0.5256133414804935, + 0.5291239004582167, + 1.3900582119822502, + 0.3594332616776228, + 0.6062254775315523, + 0.23696225136518478, + 0.8093934096395969, + 0.26122305542230606, + 2.0836971756070852, + 1.3120628744363785, + 1.3133030869066715, + 0.3405025005340576, + 0.6851545963436365, + 1.0832863375544548, + 0.9809709973633289, + 0.524260763078928, + 0.2497893888503313, + 1.3359583914279938, + 0.6617188919335604, + 0.10197893902659416, + 0.10752218402922153, + 0.10078225657343864, + 0.45227038487792015, + 0.35174597427248955, + 0.11093767918646336, + 0.15095606073737144, + 0.407110545784235, + 0.2623451203107834, + 0.6035285610705614, + 3.207488875836134, + 0.4624696597456932, + 0.5195109434425831, + 0.5038616433739662, + 0.4353579729795456, + 0.7135368529707193, + 1.2042326480150223, + 0.6480525564402342, + 0.17705871909856796, + 0.28050119802355766, + 0.6893449518829584, + 0.7314953617751598, + 0.42675526812672615, + 0.03534465655684471, + 0.9279988631606102, + 0.5770623665302992, + 0.06443080678582191, + 0.44351223669946194, + 0.6140247359871864, + 0.43410706892609596, + 1.284360133111477, + 0.8363806009292603, + 0.15554174780845642, + 0.6866329219192266, + 0.5550953727215528, + 1.162988618016243, + 0.8499861769378185, + 0.05235033109784126, + 1.2048410382121801 + ], + "unique_experts": 64, + "load_cv": 0.6494624287954085, + "normalized_load_entropy": 0.9521178807683991, + "max_load_share": 0.06282051282051282 + }, + "full_input": { + "tokens": 171, + "top_k": 6, + "decisions": 1026, + "ordered_route_sha256": "1b6421c0c1d0b4e282353da072e6062241b68f20cd0c3ad56e3a521043647863", + "route_weight_sha256": "3e2ea2c6d643f038024590ddc684971a1f09c6acf5a327d822664791e00b37bf", + "loads": [ + 17, + 15, + 20, + 22, + 17, + 7, + 11, + 16, + 21, + 16, + 20, + 10, + 12, + 9, + 38, + 25, + 23, + 16, + 19, + 21, + 14, + 16, + 13, + 24, + 18, + 3, + 14, + 14, + 8, + 10, + 13, + 6, + 14, + 8, + 14, + 49, + 19, + 20, + 14, + 10, + 14, + 16, + 16, + 9, + 8, + 16, + 24, + 12, + 2, + 15, + 17, + 2, + 18, + 17, + 10, + 24, + 29, + 10, + 25, + 17, + 22, + 16, + 4, + 27 + ], + "weighted_loads": [ + 0.6974578015506268, + 1.0546313654631376, + 1.3795308228582144, + 0.8386640325188637, + 1.1201112437993288, + 0.25876181945204735, + 0.5256133414804935, + 0.708661375567317, + 1.3900582119822502, + 0.8522046711295843, + 1.4812427144497633, + 0.9350873194634914, + 0.8093934096395969, + 0.31418828666210175, + 3.0038668792694807, + 1.6872097812592983, + 1.3133030869066715, + 1.0056656636297703, + 0.6851545963436365, + 1.0832863375544548, + 0.9809709973633289, + 0.8776315655559301, + 0.6899546664208174, + 1.3359583914279938, + 1.202952679246664, + 0.17375269159674644, + 1.581259386613965, + 0.5641483180224895, + 0.45227038487792015, + 0.45309528708457947, + 1.0203063916414976, + 0.2303501032292843, + 0.5652769654989243, + 0.2623451203107834, + 0.9277861546725035, + 3.207488875836134, + 1.1275441907346249, + 0.8458579145371914, + 0.8322221636772156, + 0.47104257717728615, + 0.7436277754604816, + 1.2042326480150223, + 0.77015913836658, + 0.47629277035593987, + 0.31009070947766304, + 0.7065917681902647, + 0.9351567514240742, + 0.4691576659679413, + 0.0693998672068119, + 1.0856542065739632, + 0.8582723271101713, + 0.06443080678582191, + 1.2723471578210592, + 0.8061210624873638, + 0.6895524188876152, + 1.3974073119461536, + 2.899914998561144, + 1.045371163636446, + 1.2537273224443197, + 0.8577690422534943, + 1.402283437550068, + 0.8499861769378185, + 0.18034530244767666, + 1.3280847575515509 + ], + "unique_experts": 64, + "load_cv": 0.48868038867992214, + "normalized_load_entropy": 0.9720673901882868, + "max_load_share": 0.04775828460038986 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 130, + "ordered_topk_exact_tokens": 81, + "set_exact_tokens": 99, + "mean_set_jaccard": 0.9252747252747252, + "mean_token_weighted_tv": 0.012137702737863246, + "aggregate_load_tv": 0.033333333333333326 + }, + "system_bos": { + "tokens": 130, + "ordered_topk_exact_tokens": 80, + "set_exact_tokens": 93, + "mean_set_jaccard": 0.9104395604395604, + "mean_token_weighted_tv": 0.013833767333282874, + "aggregate_load_tv": 0.03333333333333333 + }, + "system_x": { + "tokens": 130, + "ordered_topk_exact_tokens": 66, + "set_exact_tokens": 78, + "mean_set_jaccard": 0.8758241758241758, + "mean_token_weighted_tv": 0.019305699024922574, + "aggregate_load_tv": 0.04230769230769231 + }, + "system_period": { + "tokens": 130, + "ordered_topk_exact_tokens": 72, + "set_exact_tokens": 80, + "mean_set_jaccard": 0.8851648351648354, + "mean_token_weighted_tv": 0.018485157335033784, + "aggregate_load_tv": 0.03717948717948717 + }, + "bos_at_s0": { + "tokens": 130, + "ordered_topk_exact_tokens": 86, + "set_exact_tokens": 101, + "mean_set_jaccard": 0.9346153846153846, + "mean_token_weighted_tv": 0.010871496424078942, + "aggregate_load_tv": 0.026923076923076925 + }, + "bos_at_s1": { + "tokens": 130, + "ordered_topk_exact_tokens": 72, + "set_exact_tokens": 87, + "mean_set_jaccard": 0.8923076923076924, + "mean_token_weighted_tv": 0.016812540877323884, + "aggregate_load_tv": 0.04487179487179487 + }, + "x_at_s0": { + "tokens": 130, + "ordered_topk_exact_tokens": 73, + "set_exact_tokens": 89, + "mean_set_jaccard": 0.9, + "mean_token_weighted_tv": 0.015359282959252596, + "aggregate_load_tv": 0.03205128205128205 + }, + "x_at_s1": { + "tokens": 130, + "ordered_topk_exact_tokens": 61, + "set_exact_tokens": 80, + "mean_set_jaccard": 0.8851648351648351, + "mean_token_weighted_tv": 0.01882780151298413, + "aggregate_load_tv": 0.03974358974358975 + }, + "period_at_s0": { + "tokens": 130, + "ordered_topk_exact_tokens": 81, + "set_exact_tokens": 97, + "mean_set_jaccard": 0.9208791208791209, + "mean_token_weighted_tv": 0.013261354650155856, + "aggregate_load_tv": 0.030769230769230764 + }, + "period_at_s1": { + "tokens": 130, + "ordered_topk_exact_tokens": 61, + "set_exact_tokens": 81, + "mean_set_jaccard": 0.8873626373626374, + "mean_token_weighted_tv": 0.019257729593664407, + "aggregate_load_tv": 0.037179487179487186 + } + } + } + } + }, + { + "id": "gsm8k/test/1251", + "domain": "math", + "label": "Grade-school math", + "within_domain_index": 3, + "selection_rank": "0056e66a635febc5b2ace25221ed8fe25366682898fc2d4d0132b30812f59e30", + "source_text_sha256": "a45936495f064c16cf6621fe21bf0d84f54f5850bf6bfe19ced45b30c591aa36", + "source_characters": 269, + "source_tokens": 75, + "content_token_ids_sha256": "b334bff623f54ef427c7c3e29cdbf323c0cceac25302b6c53d6925130817209c", + "prompt_tokens_by_condition": { + "s0_eos": 99, + "s1_eos": 115, + "s0_bos": 99, + "s1_bos": 115, + "s0_x": 99, + "s1_x": 115, + "s0_period": 99, + "s1_period": 115 + }, + "batch_prompt_tokens": 115, + "content_tokens": 74, + "boundary_crossing_tokens_by_condition": { + "s0_eos": 1, + "s1_eos": 1, + "s0_bos": 1, + "s1_bos": 1, + "s0_x": 1, + "s1_x": 1, + "s0_period": 1, + "s1_period": 1 + }, + "forward_seconds": 0.759499265026534, + "peak_cuda_memory_allocated_bytes": 27659682304, + "hidden_stages": { + "embedding": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ffa8725a3f189192409228f94d9710065f7114379ff4397eb789585f24ca0cc9", + "mean": -0.0010599135421216488, + "std": 0.08597956597805023, + "rms": 0.08598610013723373, + "max_abs": 1.7109375 + }, + "full_input": { + "shape": [ + 99, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e63f71ea9f709c93c2df2fc86a5f22829d715cf661548ff480314660653a49ee", + "mean": -0.001011671731248498, + "std": 0.08596169203519821, + "rms": 0.08596765249967575, + "max_abs": 2.046875 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ffa8725a3f189192409228f94d9710065f7114379ff4397eb789585f24ca0cc9", + "mean": -0.0010599135421216488, + "std": 0.08597956597805023, + "rms": 0.08598610013723373, + "max_abs": 1.7109375 + }, + "full_input": { + "shape": [ + 115, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7d95fcd78fe663285bc70affe9023d611149369f00ddd502196c78daf2c689b6", + "mean": -0.0011765975505113602, + "std": 0.08881592005491257, + "rms": 0.08882370591163635, + "max_abs": 2.046875 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ffa8725a3f189192409228f94d9710065f7114379ff4397eb789585f24ca0cc9", + "mean": -0.0010599135421216488, + "std": 0.08597956597805023, + "rms": 0.08598610013723373, + "max_abs": 1.7109375 + }, + "full_input": { + "shape": [ + 99, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9c8c346f1354bd3e357c448eaf01132d30eac610bd7ccb5f7c2ddf1c3aebc670", + "mean": -0.000996184884570539, + "std": 0.08574186265468597, + "rms": 0.08574764430522919, + "max_abs": 2.046875 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ffa8725a3f189192409228f94d9710065f7114379ff4397eb789585f24ca0cc9", + "mean": -0.0010599135421216488, + "std": 0.08597956597805023, + "rms": 0.08598610013723373, + "max_abs": 1.7109375 + }, + "full_input": { + "shape": [ + 115, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e0d013e5a2e79f0cc2830fd9cc6a24f6ed1da3e691b58a07872daeaaf9665002", + "mean": -0.0011632655514404178, + "std": 0.08863282203674316, + "rms": 0.08864045143127441, + "max_abs": 2.046875 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ffa8725a3f189192409228f94d9710065f7114379ff4397eb789585f24ca0cc9", + "mean": -0.0010599135421216488, + "std": 0.08597956597805023, + "rms": 0.08598610013723373, + "max_abs": 1.7109375 + }, + "full_input": { + "shape": [ + 99, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1602c915ad3edc3fb8ec43dc78feff05b54b337adf3f0a3d79fb88966dab46b0", + "mean": -0.0010341895977035165, + "std": 0.08588999509811401, + "rms": 0.08589622378349304, + "max_abs": 2.046875 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ffa8725a3f189192409228f94d9710065f7114379ff4397eb789585f24ca0cc9", + "mean": -0.0010599135421216488, + "std": 0.08597956597805023, + "rms": 0.08598610013723373, + "max_abs": 1.7109375 + }, + "full_input": { + "shape": [ + 115, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "618af241b92d32beb92c931f5ef943665ac08457cd9144a9ff7053a1a5cd83df", + "mean": -0.0011959824478253722, + "std": 0.08875615149736404, + "rms": 0.08876420557498932, + "max_abs": 2.046875 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ffa8725a3f189192409228f94d9710065f7114379ff4397eb789585f24ca0cc9", + "mean": -0.0010599135421216488, + "std": 0.08597956597805023, + "rms": 0.08598610013723373, + "max_abs": 1.7109375 + }, + "full_input": { + "shape": [ + 99, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2ce6a8615a93d94bcb05338cf35fd17820644dde9d62792786746109e361db2f", + "mean": -0.001035009161569178, + "std": 0.08572109788656235, + "rms": 0.08572734892368317, + "max_abs": 2.046875 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ffa8725a3f189192409228f94d9710065f7114379ff4397eb789585f24ca0cc9", + "mean": -0.0010599135421216488, + "std": 0.08597956597805023, + "rms": 0.08598610013723373, + "max_abs": 1.7109375 + }, + "full_input": { + "shape": [ + 115, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c9e25c9ee3a475dfa64fbf428433c0ccc4aa87940a5a29b7a5347a2f0f8fc315", + "mean": -0.001196688157506287, + "std": 0.08861546963453293, + "rms": 0.0886235460639, + "max_abs": 2.046875 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 74, + "exact_hidden_rows": 74, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999999403953552, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "system_bos": { + "tokens": 74, + "exact_hidden_rows": 74, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999999403953552, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "system_x": { + "tokens": 74, + "exact_hidden_rows": 74, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999999403953552, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "system_period": { + "tokens": 74, + "exact_hidden_rows": 74, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999999403953552, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "bos_at_s0": { + "tokens": 74, + "exact_hidden_rows": 74, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999999403953552, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "bos_at_s1": { + "tokens": 74, + "exact_hidden_rows": 74, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999999403953552, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "x_at_s0": { + "tokens": 74, + "exact_hidden_rows": 74, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999999403953552, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "x_at_s1": { + "tokens": 74, + "exact_hidden_rows": 74, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999999403953552, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "period_at_s0": { + "tokens": 74, + "exact_hidden_rows": 74, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999999403953552, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "period_at_s1": { + "tokens": 74, + "exact_hidden_rows": 74, + "mean_cosine_similarity": 1.0, + "min_cosine_similarity": 0.9999999403953552, + "mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + } + } + }, + "layer_00": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7283e8b2d2515811bb90b2f77d12cc4f2243a599cebbc99ff3327c6410cd14f6", + "mean": -0.001676980871707201, + "std": 0.08293125033378601, + "rms": 0.08294820785522461, + "max_abs": 2.5625 + }, + "full_input": { + "shape": [ + 99, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3eff310ead5ac0653afdd05b25d6b201777dd4a5f63c071727d8e7976cc69d7c", + "mean": -0.001643829164095223, + "std": 0.08475653827190399, + "rms": 0.08477248251438141, + "max_abs": 2.5625 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8e438796ccf7e8a5c8c536eafc8da49c2798994dcbb5b0350ba98bbdcb54565f", + "mean": -0.0016841267934069037, + "std": 0.0829344242811203, + "rms": 0.08295152336359024, + "max_abs": 2.578125 + }, + "full_input": { + "shape": [ + 115, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d939e0f5bd2c32c0905030b1b754fec9ddf32f6a0dc3365cc2276479326635ec", + "mean": -0.0017430116422474384, + "std": 0.08675236254930496, + "rms": 0.08676987141370773, + "max_abs": 2.578125 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3ddef53b072eb9311185888ca920c1c370c8d0b514decc96d7f0332915d438d2", + "mean": -0.0015920833684504032, + "std": 0.08229051530361176, + "rms": 0.0823059156537056, + "max_abs": 2.5 + }, + "full_input": { + "shape": [ + 99, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1154feb421617f4155db4f7567e89860e66cdb37b5cc6871895f8afc8baf5fc6", + "mean": -0.0015539188170805573, + "std": 0.0839107558131218, + "rms": 0.08392514288425446, + "max_abs": 2.5 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8a792b7f5b32e420c2e9af61e2748d8ee26a41846a1a1d71a0b2f4e52a87bca7", + "mean": -0.0016182969557121396, + "std": 0.08215992897748947, + "rms": 0.08217586576938629, + "max_abs": 2.515625 + }, + "full_input": { + "shape": [ + 115, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "34197124d31d72003d9cdee264664c972934c57efb45d2280220f81ba84cbc2f", + "mean": -0.001679070177488029, + "std": 0.08597992360591888, + "rms": 0.08599631488323212, + "max_abs": 2.515625 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "eb5b3a15cc4256fb435172b1498d173d5b6e7496d1b765ac96cc42ee9eef336e", + "mean": -0.0015966517385095358, + "std": 0.08187951892614365, + "rms": 0.08189508318901062, + "max_abs": 2.5 + }, + "full_input": { + "shape": [ + 99, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ccefb2397e0c072394aed23f6a8aca92f39dd0dc868245529ca9ec3ad280da70", + "mean": -0.0015801740810275078, + "std": 0.08376622945070267, + "rms": 0.08378113061189651, + "max_abs": 2.5 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "db5c6ad46cec4ff600803be6b73c15a2bd1800c130931648f5256a2615758ed1", + "mean": -0.0016330842627212405, + "std": 0.08187463879585266, + "rms": 0.08189092576503754, + "max_abs": 2.53125 + }, + "full_input": { + "shape": [ + 115, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ebf6b19b21686260b2d2d656e4ac1674116788ee715afaa6ecef49036af610e7", + "mean": -0.0017123681027442217, + "std": 0.08595344424247742, + "rms": 0.08597049862146378, + "max_abs": 2.53125 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e191f075a13b4f3e9942bbfa29769e8b7d8799601585f814647c81d3e6976688", + "mean": -0.001586920116096735, + "std": 0.08186569809913635, + "rms": 0.0818810760974884, + "max_abs": 2.5 + }, + "full_input": { + "shape": [ + 99, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e204d0a96fc6e1434bc7e6f589dfd8076616191900f8fd132ddc0447c5330f81", + "mean": -0.0015734722837805748, + "std": 0.08349601179361343, + "rms": 0.08351083844900131, + "max_abs": 2.5 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "22503a725f179b7d7742a8756e9252a473fe3526b1ee63f379410c607543f90a", + "mean": -0.0016279530245810747, + "std": 0.08185656368732452, + "rms": 0.08187275379896164, + "max_abs": 2.53125 + }, + "full_input": { + "shape": [ + 115, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "69c8db234012cf3671af9d48cc664fc167d959affcb2c2b45b50e87c79cf4b4a", + "mean": -0.0017077067168429494, + "std": 0.08569935709238052, + "rms": 0.0857163667678833, + "max_abs": 2.53125 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9995741844177246, + "min_cosine_similarity": 0.992929220199585, + "mean_relative_l2": 0.02353055402636528, + "max_abs_delta": 0.0625 + }, + "system_bos": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9992575645446777, + "min_cosine_similarity": 0.9853809475898743, + "mean_relative_l2": 0.03228434920310974, + "max_abs_delta": 0.15625 + }, + "system_x": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9993473887443542, + "min_cosine_similarity": 0.9891274571418762, + "mean_relative_l2": 0.03133901581168175, + "max_abs_delta": 0.1171875 + }, + "system_period": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9993954300880432, + "min_cosine_similarity": 0.9898329377174377, + "mean_relative_l2": 0.0302596315741539, + "max_abs_delta": 0.109375 + }, + "bos_at_s0": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.987394392490387, + "min_cosine_similarity": 0.9592540264129639, + "mean_relative_l2": 0.15567468106746674, + "max_abs_delta": 0.216796875 + }, + "bos_at_s1": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9892328381538391, + "min_cosine_similarity": 0.971167266368866, + "mean_relative_l2": 0.14403897523880005, + "max_abs_delta": 0.20703125 + }, + "x_at_s0": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9883599281311035, + "min_cosine_similarity": 0.9652910232543945, + "mean_relative_l2": 0.14919297397136688, + "max_abs_delta": 0.212890625 + }, + "x_at_s1": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.98990797996521, + "min_cosine_similarity": 0.9730391502380371, + "mean_relative_l2": 0.13904604315757751, + "max_abs_delta": 0.2119140625 + }, + "period_at_s0": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9885545969009399, + "min_cosine_similarity": 0.9669122695922852, + "mean_relative_l2": 0.14809967577457428, + "max_abs_delta": 0.212890625 + }, + "period_at_s1": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9900182485580444, + "min_cosine_similarity": 0.9735884070396423, + "mean_relative_l2": 0.13840098679065704, + "max_abs_delta": 0.2119140625 + } + } + }, + "layer_01": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8794fc7198c460d5ef307a895b04e6102a6d92fdd18822394f2e35fabd9c9909", + "mean": -0.00200820853933692, + "std": 0.09789185971021652, + "rms": 0.09791245311498642, + "max_abs": 3.0 + }, + "full_input": { + "shape": [ + 99, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3c0796c4e76efe776f081f3db179d947c24acaac46d617541ad4985b338d9312", + "mean": -0.0047456612810492516, + "std": 0.8067469000816345, + "rms": 0.806760847568512, + "max_abs": 126.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a75b1a61816cf80e28411e4b8663192e39d86216f9cb3f5922d34f50de81a968", + "mean": -0.0019947770051658154, + "std": 0.09806545078754425, + "rms": 0.09808573871850967, + "max_abs": 3.0 + }, + "full_input": { + "shape": [ + 115, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fd825a05d103ea68a06999acbb87fe8671dfc8fe691da0c415b9ef95a8f0c965", + "mean": -0.004671247210353613, + "std": 0.7772584557533264, + "rms": 0.7772724628448486, + "max_abs": 135.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d6cc313404595890fd896827ccf5c45af9456980138333a69a548471c2bb230d", + "mean": -0.002249369863420725, + "std": 0.0982394590973854, + "rms": 0.09826520085334778, + "max_abs": 3.03125 + }, + "full_input": { + "shape": [ + 99, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "52e4353a0529107bf162d5f985c4e020eae012afaf389090cac4247a87ebbf2f", + "mean": -0.002045977860689163, + "std": 0.10258467495441437, + "rms": 0.10260507464408875, + "max_abs": 4.6875 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8f53d301b05a9f9acd9ff0760daa8ba42613c407b61fefdd47add0ef5219a123", + "mean": -0.002290118718519807, + "std": 0.09749535471200943, + "rms": 0.09752225130796432, + "max_abs": 3.03125 + }, + "full_input": { + "shape": [ + 115, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "df430bebdf153dce9022b2196397dcc40ecf0e42921626076764f91dc22d2e61", + "mean": -0.0022499235346913338, + "std": 0.10374657064676285, + "rms": 0.10377096384763718, + "max_abs": 4.6875 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d04bdd97a8931e1244838af613ce5a5d9f7347d51e642926ac88ff692c36fa05", + "mean": -0.002167397877201438, + "std": 0.09800704568624496, + "rms": 0.09803101420402527, + "max_abs": 3.0625 + }, + "full_input": { + "shape": [ + 99, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "96b80f7e702815ec1a3a808478907569acdd9b2131db12639abed2dd62c0e532", + "mean": -0.0019809359218925238, + "std": 0.10243870317935944, + "rms": 0.10245785117149353, + "max_abs": 4.6875 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4acfa61825d02b2c44d8daa4250244172e5dc95337148f5e03c85622626385cc", + "mean": -0.002265555551275611, + "std": 0.0971110388636589, + "rms": 0.0971374586224556, + "max_abs": 3.078125 + }, + "full_input": { + "shape": [ + 115, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ef36786115b26ef99a3411103a2bb0a657f2e2bf9ea12b310f9b80e8ac14bacc", + "mean": -0.0022376382257789373, + "std": 0.10357493907213211, + "rms": 0.10359911620616913, + "max_abs": 4.6875 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b5cc07174838f4141d84d05c72fe61eff123087bff481ab3882c2fdcfb5dee5d", + "mean": -0.002178770024329424, + "std": 0.09795427322387695, + "rms": 0.09797850251197815, + "max_abs": 3.0625 + }, + "full_input": { + "shape": [ + 99, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8ab82c7293d2b5e32245f557cf68e4caf840462b99658e575592cbe4b4e1e602", + "mean": -0.0020092520862817764, + "std": 0.10203255712985992, + "rms": 0.10205233842134476, + "max_abs": 4.6875 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "85ce4e81e2a7b61311c55a09dd898ba2d43867cfd31e707cb689960a1b33acad", + "mean": -0.0022691732738167048, + "std": 0.09702255576848984, + "rms": 0.09704908728599548, + "max_abs": 3.078125 + }, + "full_input": { + "shape": [ + 115, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c52d870ef4fc46bcd088216f6b5c354742d005b54d95e0af691fabf0a84b3c06", + "mean": -0.002252864884212613, + "std": 0.10320529341697693, + "rms": 0.10322988778352737, + "max_abs": 4.6875 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.998842716217041, + "min_cosine_similarity": 0.9854177236557007, + "mean_relative_l2": 0.04218677431344986, + "max_abs_delta": 0.0986328125 + }, + "system_bos": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9951909184455872, + "min_cosine_similarity": 0.9423143863677979, + "mean_relative_l2": 0.09103861451148987, + "max_abs_delta": 0.3095703125 + }, + "system_x": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9937816262245178, + "min_cosine_similarity": 0.9430800080299377, + "mean_relative_l2": 0.10455597192049026, + "max_abs_delta": 0.2841796875 + }, + "system_period": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9937355518341064, + "min_cosine_similarity": 0.9432699680328369, + "mean_relative_l2": 0.10485059022903442, + "max_abs_delta": 0.2734375 + }, + "bos_at_s0": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9858955144882202, + "min_cosine_similarity": 0.9378843307495117, + "mean_relative_l2": 0.16487587988376617, + "max_abs_delta": 0.3203125 + }, + "bos_at_s1": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9867852926254272, + "min_cosine_similarity": 0.9640672206878662, + "mean_relative_l2": 0.15914678573608398, + "max_abs_delta": 0.20703125 + }, + "x_at_s0": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9870778918266296, + "min_cosine_similarity": 0.9443722367286682, + "mean_relative_l2": 0.15629315376281738, + "max_abs_delta": 0.2890625 + }, + "x_at_s1": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9852180480957031, + "min_cosine_similarity": 0.9589622020721436, + "mean_relative_l2": 0.1676613986492157, + "max_abs_delta": 0.28125 + }, + "period_at_s0": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9872401356697083, + "min_cosine_similarity": 0.9479150772094727, + "mean_relative_l2": 0.1555221974849701, + "max_abs_delta": 0.263671875 + }, + "period_at_s1": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9853007197380066, + "min_cosine_similarity": 0.9567402601242065, + "mean_relative_l2": 0.1670204997062683, + "max_abs_delta": 0.28515625 + } + } + }, + "layer_02": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fd1b3e39cb411539c1e607328c65f0a836c59beda7931cc976f9d159b0bcbd91", + "mean": -0.002313316101208329, + "std": 0.12053601443767548, + "rms": 0.12055820971727371, + "max_abs": 3.5625 + }, + "full_input": { + "shape": [ + 99, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a1974a42d61c5c3d1f62ca91bd58a37623dac9f6e984551545a0f41f2151f57f", + "mean": -0.011638052761554718, + "std": 2.4159765243530273, + "rms": 2.4160048961639404, + "max_abs": 392.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5894c99f7176e1690b81340028a0cd046253ea23bd7b2fb001ea27745f179048", + "mean": -0.0022247261367738247, + "std": 0.12052334100008011, + "rms": 0.12054386734962463, + "max_abs": 3.5625 + }, + "full_input": { + "shape": [ + 115, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1be339551c96c61026842e13f15643667a7acfa509309dab23fc98d58c757c03", + "mean": -0.011721792630851269, + "std": 2.4809420108795166, + "rms": 2.4809694290161133, + "max_abs": 436.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f53cd85e66d7b0b266c48788ab5242b9a7ec4a040e1d406f5edff463f9c418e8", + "mean": -0.00244433362968266, + "std": 0.12091920524835587, + "rms": 0.12094391137361526, + "max_abs": 3.53125 + }, + "full_input": { + "shape": [ + 99, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f6cfd999dcf6dc0f81a61d265ace747c8093915d51635a743d3011e0051b1ca2", + "mean": -0.002526394324377179, + "std": 0.20410609245300293, + "rms": 0.20412172377109528, + "max_abs": 23.75 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "173f6e970d92b33dc63d21f967c020fe3e18f38da4aa01ccc40ef7ff45756e4e", + "mean": -0.002304068533703685, + "std": 0.12028336524963379, + "rms": 0.12030542641878128, + "max_abs": 3.46875 + }, + "full_input": { + "shape": [ + 115, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b04f254ec335d2f59843f07e9456452c0aeca87e42699b076ba4a04a3130a4d4", + "mean": -0.002405335661023855, + "std": 0.19573485851287842, + "rms": 0.19574962556362152, + "max_abs": 23.75 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c150f88cbb08455731ad2c2bdd8461f10f3ae7a434a33e4a828e63ea63fb370c", + "mean": -0.0024303640238940716, + "std": 0.12019282579421997, + "rms": 0.12021739035844803, + "max_abs": 3.484375 + }, + "full_input": { + "shape": [ + 99, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "01df8083ca3f2c9803684ff6655ec3a8b48b24f0d796b5c6e566551154721183", + "mean": -0.0025148210115730762, + "std": 0.20382796227931976, + "rms": 0.20384347438812256, + "max_abs": 23.75 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "76de95bd9971065b71b226fd28799169b04eb04c949988adeda53052431ee1b7", + "mean": -0.0023003534879535437, + "std": 0.11943034827709198, + "rms": 0.11945249885320663, + "max_abs": 3.390625 + }, + "full_input": { + "shape": [ + 115, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "13cce5f0a676ad1d2d84dbe35736c5ad1c79e3315cf45740df1bb5455c673d7d", + "mean": -0.0024017891846597195, + "std": 0.1954340785741806, + "rms": 0.1954488307237625, + "max_abs": 23.75 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ddc79afef06c7454cfb50b01ac8054d472f76d15dc19674a636fb961269347dd", + "mean": -0.002365950495004654, + "std": 0.12000149488449097, + "rms": 0.12002481520175934, + "max_abs": 3.453125 + }, + "full_input": { + "shape": [ + 99, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7600661481dfb440c0f8849ba7bc43c22fc07c848c0842342c0dbce490593cd0", + "mean": -0.002528563840314746, + "std": 0.2034197896718979, + "rms": 0.2034355103969574, + "max_abs": 23.75 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6ea3d67ffb5194fa2e90977ef8fc1fa417005f6f0c91dc1a47c1bcefe4664c13", + "mean": -0.002267264062538743, + "std": 0.11922804266214371, + "rms": 0.11924959719181061, + "max_abs": 3.375 + }, + "full_input": { + "shape": [ + 115, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d5b7fc265c11a99ce179c1184ff973d243c8df626977575e7ee539afbf49c4a8", + "mean": -0.0024238508194684982, + "std": 0.1950329840183258, + "rms": 0.1950480341911316, + "max_abs": 23.75 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.998615562915802, + "min_cosine_similarity": 0.9897775053977966, + "mean_relative_l2": 0.047595035284757614, + "max_abs_delta": 0.09375 + }, + "system_bos": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.994552493095398, + "min_cosine_similarity": 0.9365070462226868, + "mean_relative_l2": 0.09779383987188339, + "max_abs_delta": 0.3994140625 + }, + "system_x": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9924319386482239, + "min_cosine_similarity": 0.9368910789489746, + "mean_relative_l2": 0.11656911671161652, + "max_abs_delta": 0.350341796875 + }, + "system_period": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.992455244064331, + "min_cosine_similarity": 0.9385804533958435, + "mean_relative_l2": 0.11639177799224854, + "max_abs_delta": 0.3193359375 + }, + "bos_at_s0": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9869359135627747, + "min_cosine_similarity": 0.9281449317932129, + "mean_relative_l2": 0.15656405687332153, + "max_abs_delta": 0.3759765625 + }, + "bos_at_s1": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9861759543418884, + "min_cosine_similarity": 0.9599447846412659, + "mean_relative_l2": 0.16182637214660645, + "max_abs_delta": 0.330078125 + }, + "x_at_s0": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9862204790115356, + "min_cosine_similarity": 0.9326989054679871, + "mean_relative_l2": 0.1584794521331787, + "max_abs_delta": 0.34375 + }, + "x_at_s1": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9829275012016296, + "min_cosine_similarity": 0.9458827972412109, + "mean_relative_l2": 0.17807134985923767, + "max_abs_delta": 0.421875 + }, + "period_at_s0": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9863479137420654, + "min_cosine_similarity": 0.9369170665740967, + "mean_relative_l2": 0.15826478600502014, + "max_abs_delta": 0.33203125 + }, + "period_at_s1": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9828950762748718, + "min_cosine_similarity": 0.9440811276435852, + "mean_relative_l2": 0.17815205454826355, + "max_abs_delta": 0.421875 + } + } + }, + "layer_03": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bd41714aea6581f7d4b6bccfc5461117ce73d2b42123a6ecc408273f9a366f9b", + "mean": -0.0028969428967684507, + "std": 0.15158356726169586, + "rms": 0.15161125361919403, + "max_abs": 4.1875 + }, + "full_input": { + "shape": [ + 99, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "95cad4cd81b29b1add1c88c8c1161a2f60d509901c2e00bee81e705ffa96dbf9", + "mean": -0.015411549247801304, + "std": 7.235475540161133, + "rms": 7.2354912757873535, + "max_abs": 1136.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a1e26134c5050b686e202ed335701c0f4a6e741aa1adebee0856c6dd429a8776", + "mean": -0.0028131548315286636, + "std": 0.15176288783550262, + "rms": 0.15178896486759186, + "max_abs": 4.125 + }, + "full_input": { + "shape": [ + 115, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a920eb4aca1b3855ef17c3f9c0a55a360b48c7f34c94b8bf9fe1a235212c209c", + "mean": -0.015300769358873367, + "std": 6.931356906890869, + "rms": 6.931373596191406, + "max_abs": 1136.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e7701f32d23118c4120e2ad1e42e8d8c7030e7a705a63bbddb846145ec3b7a24", + "mean": -0.0030132762622088194, + "std": 0.15201550722122192, + "rms": 0.1520453691482544, + "max_abs": 4.3125 + }, + "full_input": { + "shape": [ + 99, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8076fe4d44c37ab603f252202068a246fa88b503aaca990fe5a8e0a89846f585", + "mean": -0.005193581338971853, + "std": 6.449677467346191, + "rms": 6.449679374694824, + "max_abs": 1136.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a9ac1b0e4fe870cbcf9c2e111057cda069d291037e6e2f2184c1dec54a8c889d", + "mean": -0.0030281967483460903, + "std": 0.15157419443130493, + "rms": 0.15160442888736725, + "max_abs": 4.3125 + }, + "full_input": { + "shape": [ + 115, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "adc6b1ea2e1ab8aea76d54a768c443f31ab8c71366afaf800650cb1020d4dec6", + "mean": -0.005030589643865824, + "std": 5.984467506408691, + "rms": 5.984469413757324, + "max_abs": 1136.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a5677b05522dae54c37d62ed55738e980776795877b2ea269742ea2a560ef22d", + "mean": -0.00304462225176394, + "std": 0.1506079137325287, + "rms": 0.15063868463039398, + "max_abs": 4.25 + }, + "full_input": { + "shape": [ + 99, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cab018a64d2ef18fa2605f6efa0280065252fa73e237a4ad59b6e4af5869a18c", + "mean": -0.005270805675536394, + "std": 6.449638843536377, + "rms": 6.449641227722168, + "max_abs": 1136.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fc10d7ebc6388cf546ecec587e2ba1a1efc9779f12bc68ddc7acc5b8aa2cb930", + "mean": -0.0031307372264564037, + "std": 0.15012995898723602, + "rms": 0.15016259253025055, + "max_abs": 4.3125 + }, + "full_input": { + "shape": [ + 115, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "dbeea5110ab426ad9835f78180379b53f674a9f72987f269d4ef538d5029d6b5", + "mean": -0.005145756993442774, + "std": 5.984435081481934, + "rms": 5.984436988830566, + "max_abs": 1136.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "de416fada56e9698713b56cad1b6662b0d89bdffb2d920fe8ae7f6a48f73e491", + "mean": -0.0030216812156140804, + "std": 0.15044371783733368, + "rms": 0.15047405660152435, + "max_abs": 4.25 + }, + "full_input": { + "shape": [ + 99, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e9a1b6e8165cd181c1ae65b7cb2a0b28efe2b2446f80923df29f4de21792afa8", + "mean": -0.005265282932668924, + "std": 6.449626445770264, + "rms": 6.4496283531188965, + "max_abs": 1136.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2b6d627d1d66b2b33d056198b4b2a07011fd8816d4a1420f636c6bac500d6864", + "mean": -0.0030955136753618717, + "std": 0.15001146495342255, + "rms": 0.15004338324069977, + "max_abs": 4.3125 + }, + "full_input": { + "shape": [ + 115, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5d8cfb51f1bcc52700e1cc51ac0ff89e61e1d7d645b2e34116b591c2fa19ea3d", + "mean": -0.005124490708112717, + "std": 5.984424591064453, + "rms": 5.984426498413086, + "max_abs": 1136.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9984979629516602, + "min_cosine_similarity": 0.9902182817459106, + "mean_relative_l2": 0.04995380714535713, + "max_abs_delta": 0.10546875 + }, + "system_bos": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9947293996810913, + "min_cosine_similarity": 0.9720532298088074, + "mean_relative_l2": 0.09757302701473236, + "max_abs_delta": 0.216796875 + }, + "system_x": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9921996593475342, + "min_cosine_similarity": 0.9621808528900146, + "mean_relative_l2": 0.11842527985572815, + "max_abs_delta": 0.21923828125 + }, + "system_period": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9920141100883484, + "min_cosine_similarity": 0.960216760635376, + "mean_relative_l2": 0.1193765327334404, + "max_abs_delta": 0.21337890625 + }, + "bos_at_s0": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9882984757423401, + "min_cosine_similarity": 0.9543365240097046, + "mean_relative_l2": 0.1491899937391281, + "max_abs_delta": 0.3515625 + }, + "bos_at_s1": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9872775673866272, + "min_cosine_similarity": 0.9535717964172363, + "mean_relative_l2": 0.15490850806236267, + "max_abs_delta": 0.330078125 + }, + "x_at_s0": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9872128367424011, + "min_cosine_similarity": 0.9467971920967102, + "mean_relative_l2": 0.1523832082748413, + "max_abs_delta": 0.34375 + }, + "x_at_s1": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9834226369857788, + "min_cosine_similarity": 0.9354020953178406, + "mean_relative_l2": 0.17421549558639526, + "max_abs_delta": 0.4296875 + }, + "period_at_s0": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9873428344726562, + "min_cosine_similarity": 0.9512261152267456, + "mean_relative_l2": 0.1518218070268631, + "max_abs_delta": 0.322265625 + }, + "period_at_s1": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9835450649261475, + "min_cosine_similarity": 0.9396705627441406, + "mean_relative_l2": 0.1738240271806717, + "max_abs_delta": 0.434814453125 + } + } + }, + "layer_04": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "316d41f59d2f7f8305725e1ba19d5f1aaf324a1be2d916ad195882f6081d4dce", + "mean": -0.0036347685381770134, + "std": 0.17936024069786072, + "rms": 0.17939704656600952, + "max_abs": 4.96875 + }, + "full_input": { + "shape": [ + 99, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ca8f849420bc8cb1730c6f682889cd782cc921a81e33e87ac06b188ba0e45539", + "mean": -0.015774130821228027, + "std": 7.553494930267334, + "rms": 7.553512096405029, + "max_abs": 1152.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "967237d5cbace0e15e54216aab4fd616a29be3cae4dbcd142b05c4aa6651d126", + "mean": -0.0036000206600874662, + "std": 0.17959018051624298, + "rms": 0.1796262413263321, + "max_abs": 4.9375 + }, + "full_input": { + "shape": [ + 115, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "442d28ea28c43a08150a43668840d64edd86b08588acca77d34bd187b1ee9fd1", + "mean": -0.0156832505017519, + "std": 7.214130401611328, + "rms": 7.214147090911865, + "max_abs": 1152.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c2990a270ac83747d84734a0fd4438e928ea6b680894404d1b7f2252606b94cc", + "mean": -0.0038541024550795555, + "std": 0.1805250346660614, + "rms": 0.18056616187095642, + "max_abs": 5.25 + }, + "full_input": { + "shape": [ + 99, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e9706704e8df7adb8b8251615c1d71818cbbd44ed680fb94aa978c406de0c500", + "mean": -0.005658324807882309, + "std": 6.768471717834473, + "rms": 6.7684736251831055, + "max_abs": 1152.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "74fe15adfc2eeb6174913e0b911b532322acc23e65007f641d0dc008a46b98cc", + "mean": -0.0038561352994292974, + "std": 0.1807856410741806, + "rms": 0.18082676827907562, + "max_abs": 5.25 + }, + "full_input": { + "shape": [ + 115, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f8199c2be9bd48148410f555cbb284f356207885de9399db5442ef00bdc14492", + "mean": -0.005442467983812094, + "std": 6.27124547958374, + "rms": 6.271247386932373, + "max_abs": 1152.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9fbb91cf3da7c282308a623e6dbb6a9d7a82c1962116d0954f391b039bc0cf8e", + "mean": -0.0036876918748021126, + "std": 0.17792831361293793, + "rms": 0.17796652019023895, + "max_abs": 4.96875 + }, + "full_input": { + "shape": [ + 99, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "52fbfd79794000958cefeb322f954338799a6cb71b13244ea534ca184db92d1f", + "mean": -0.005492683034390211, + "std": 6.768392086029053, + "rms": 6.7683939933776855, + "max_abs": 1152.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "30587b92664750eefa7bb697c2d99bf1d853d8953b1abbf903057ac319aafe21", + "mean": -0.0037429851945489645, + "std": 0.17848339676856995, + "rms": 0.17852263152599335, + "max_abs": 5.03125 + }, + "full_input": { + "shape": [ + 115, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8190df908b24e4e65f7d9ef405396f15c1e6c2b4b7fb23c14f2b61882aec1e21", + "mean": -0.005342533811926842, + "std": 6.271176338195801, + "rms": 6.271178245544434, + "max_abs": 1152.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3793febdde83f33da01dfdbbedcacd4994e48069de347db0e255a879c4e0a11a", + "mean": -0.003599343355745077, + "std": 0.1777700036764145, + "rms": 0.17780643701553345, + "max_abs": 4.96875 + }, + "full_input": { + "shape": [ + 99, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "861d3bfbfd5db64f785a9ef827d9c249e39f5d57333d15d9880888cef920eb27", + "mean": -0.005444774869829416, + "std": 6.768380165100098, + "rms": 6.768382549285889, + "max_abs": 1152.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "46ffada801b574efe6c570b0b111c799ed63992ccde559a5d7b93963f2a21bc7", + "mean": -0.0037080110050737858, + "std": 0.17839455604553223, + "rms": 0.17843307554721832, + "max_abs": 5.0625 + }, + "full_input": { + "shape": [ + 115, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8bba206cb747badab5fecde35c3a545f6d4d114b2e28f2519c0c1708a98c98b0", + "mean": -0.0053228652104735374, + "std": 6.2711663246154785, + "rms": 6.2711687088012695, + "max_abs": 1152.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9985206127166748, + "min_cosine_similarity": 0.9933004379272461, + "mean_relative_l2": 0.049946464598178864, + "max_abs_delta": 0.100341796875 + }, + "system_bos": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9953054189682007, + "min_cosine_similarity": 0.9805240631103516, + "mean_relative_l2": 0.09290728718042374, + "max_abs_delta": 0.25 + }, + "system_x": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9926922917366028, + "min_cosine_similarity": 0.9663534164428711, + "mean_relative_l2": 0.11507461965084076, + "max_abs_delta": 0.2763671875 + }, + "system_period": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9923818707466125, + "min_cosine_similarity": 0.9638314247131348, + "mean_relative_l2": 0.11728271096944809, + "max_abs_delta": 0.2578125 + }, + "bos_at_s0": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9909000992774963, + "min_cosine_similarity": 0.9608321785926819, + "mean_relative_l2": 0.13086993992328644, + "max_abs_delta": 0.453125 + }, + "bos_at_s1": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9900976419448853, + "min_cosine_similarity": 0.9612247347831726, + "mean_relative_l2": 0.13651162385940552, + "max_abs_delta": 0.375 + }, + "x_at_s0": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9893147349357605, + "min_cosine_similarity": 0.9539284706115723, + "mean_relative_l2": 0.13915982842445374, + "max_abs_delta": 0.37890625 + }, + "x_at_s1": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9854585528373718, + "min_cosine_similarity": 0.9347295761108398, + "mean_relative_l2": 0.16258645057678223, + "max_abs_delta": 0.53515625 + }, + "period_at_s0": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9891495704650879, + "min_cosine_similarity": 0.9540302753448486, + "mean_relative_l2": 0.14011141657829285, + "max_abs_delta": 0.34521484375 + }, + "period_at_s1": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.985309898853302, + "min_cosine_similarity": 0.9324096441268921, + "mean_relative_l2": 0.16316990554332733, + "max_abs_delta": 0.541015625 + } + } + }, + "layer_05": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ed6e0713d03c90a23392b137a4ea155dceca3cb79f05e6a2abe3ebcc35518a39", + "mean": -0.0033043602015823126, + "std": 0.20769944787025452, + "rms": 0.20772571861743927, + "max_abs": 5.21875 + }, + "full_input": { + "shape": [ + 99, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6fd27ea10b29c8b4ae312b6afe25afaadd44633c2d570f58f6229e39bf152662", + "mean": -0.01702462136745453, + "std": 7.783963203430176, + "rms": 7.7839813232421875, + "max_abs": 1152.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "33d84beb198c030960ea57a5174064ca029b29315670e78b1c52a6433c03f040", + "mean": -0.0033516224939376116, + "std": 0.20812980830669403, + "rms": 0.2081567943096161, + "max_abs": 5.1875 + }, + "full_input": { + "shape": [ + 115, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bc46f5088531d7d9f39ee6d7bb88b8493fa5cf6452e16368e2fd4259dc7a279f", + "mean": -0.0166842732578516, + "std": 7.437371730804443, + "rms": 7.4373908042907715, + "max_abs": 1152.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "93dd1743faea7cbd94e9ca001403aeb1f9aeb3fdb10a1082784e78713fb0e7ea", + "mean": -0.003357413224875927, + "std": 0.20882104337215424, + "rms": 0.2088480293750763, + "max_abs": 5.125 + }, + "full_input": { + "shape": [ + 99, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "87e15b50a9af01b1ecaf5faa544999ba11906fa1ea03044b643d517ef7f9b31d", + "mean": -0.005777635145932436, + "std": 6.887420654296875, + "rms": 6.887423038482666, + "max_abs": 1152.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8c6d8ebe270987b0cd622d535114db044b76fde1e19adca8a7b6cc3057fcf105", + "mean": -0.0035352655686438084, + "std": 0.20956048369407654, + "rms": 0.20959028601646423, + "max_abs": 5.1875 + }, + "full_input": { + "shape": [ + 115, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b0fd92aeb29457f5c0c82f9091e6abb45529535db1f9c6cbfb9a8e70118516c5", + "mean": -0.005503910128027201, + "std": 6.380671977996826, + "rms": 6.380674839019775, + "max_abs": 1152.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8bf5ec16b03d5e8d30acb68fd38d4c27f8c8a37b9c8fde967349c895ec18db2b", + "mean": -0.0034509324468672276, + "std": 0.2070719301700592, + "rms": 0.20710068941116333, + "max_abs": 5.3125 + }, + "full_input": { + "shape": [ + 99, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "18d2b981d62e421630e401ac72792376ea9cdab6257ed97874081eb9d8004c47", + "mean": -0.0057641188614070415, + "std": 6.887355804443359, + "rms": 6.88735818862915, + "max_abs": 1152.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f6570989a0519956c2fd65c0c65d2f63a64205e3509144ab1f560b17d9e213b9", + "mean": -0.003670868929475546, + "std": 0.20769284665584564, + "rms": 0.20772528648376465, + "max_abs": 5.3125 + }, + "full_input": { + "shape": [ + 115, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e531f14c068a24161bd2daed880a11ea4da4bf0aedece5f5c67fbdf8b66b97dd", + "mean": -0.005540485493838787, + "std": 6.380608081817627, + "rms": 6.380611419677734, + "max_abs": 1152.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3a5938aa7b0379bc2a0716d8519108ceea432ea90105cb0802f23298b7ad8d56", + "mean": -0.0034224947448819876, + "std": 0.2072577178478241, + "rms": 0.20728597044944763, + "max_abs": 5.3125 + }, + "full_input": { + "shape": [ + 99, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cb3cb98010832c37e9b74a092193411bb96ef2250ed4ad06f619d2c1c29d5ede", + "mean": -0.005751650780439377, + "std": 6.887344837188721, + "rms": 6.8873467445373535, + "max_abs": 1152.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "11c2ad30a6e909f2a45a32bd3335a804e37e6da59ef68d5f76e0319b036f00c9", + "mean": -0.003709721378982067, + "std": 0.20747731626033783, + "rms": 0.20751048624515533, + "max_abs": 5.3125 + }, + "full_input": { + "shape": [ + 115, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9bb59b5e8b6024425c78e804d578d9dc2135dc21b05823702d8baf7417c91796", + "mean": -0.005583883263170719, + "std": 6.380589962005615, + "rms": 6.3805928230285645, + "max_abs": 1152.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9978823065757751, + "min_cosine_similarity": 0.9900854229927063, + "mean_relative_l2": 0.06088689714670181, + "max_abs_delta": 0.15625 + }, + "system_bos": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9941650629043579, + "min_cosine_similarity": 0.9784737825393677, + "mean_relative_l2": 0.10424941778182983, + "max_abs_delta": 0.328125 + }, + "system_x": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9906100630760193, + "min_cosine_similarity": 0.9531154632568359, + "mean_relative_l2": 0.13083645701408386, + "max_abs_delta": 0.40625 + }, + "system_period": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9900088906288147, + "min_cosine_similarity": 0.9512364268302917, + "mean_relative_l2": 0.1342982053756714, + "max_abs_delta": 0.40625 + }, + "bos_at_s0": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9897302985191345, + "min_cosine_similarity": 0.9641246199607849, + "mean_relative_l2": 0.13855639100074768, + "max_abs_delta": 0.3125 + }, + "bos_at_s1": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9888930320739746, + "min_cosine_similarity": 0.9586468935012817, + "mean_relative_l2": 0.14467911422252655, + "max_abs_delta": 0.453125 + }, + "x_at_s0": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9875324368476868, + "min_cosine_similarity": 0.9516288042068481, + "mean_relative_l2": 0.1504170149564743, + "max_abs_delta": 0.53125 + }, + "x_at_s1": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9824398159980774, + "min_cosine_similarity": 0.9382419586181641, + "mean_relative_l2": 0.17888174951076508, + "max_abs_delta": 0.546875 + }, + "period_at_s0": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9877744317054749, + "min_cosine_similarity": 0.9489461183547974, + "mean_relative_l2": 0.1489657312631607, + "max_abs_delta": 0.453125 + }, + "period_at_s1": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9824457764625549, + "min_cosine_similarity": 0.9350109100341797, + "mean_relative_l2": 0.1792578250169754, + "max_abs_delta": 0.55078125 + } + } + }, + "layer_06": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7dfbc50da969fc02a7d7ec57c743c920511c6825fe7b8dad007cf1619d5f5789", + "mean": -0.004461860749870539, + "std": 0.2450852394104004, + "rms": 0.24512583017349243, + "max_abs": 7.28125 + }, + "full_input": { + "shape": [ + 99, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c82ae16ebef643d4a3ea373aad4780ce30872c324485dd5184872f9893188137", + "mean": -0.01872386783361435, + "std": 7.926252365112305, + "rms": 7.926274299621582, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a7ad42ba33733101743a1341581689ba9800cac62d5ce8017a8d0db223f93789", + "mean": -0.004453579895198345, + "std": 0.24582649767398834, + "rms": 0.2458668351173401, + "max_abs": 7.34375 + }, + "full_input": { + "shape": [ + 115, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cfbc26a76fd86b3a3d3264a711c1393e53b832eb1f2c89e1564e52734df0593c", + "mean": -0.01828308030962944, + "std": 7.572644233703613, + "rms": 7.572666168212891, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3915891166c6627e69a53e62abfba5eff23df8dd5ab3e290379a49950d9b2213", + "mean": -0.004389086738228798, + "std": 0.2451574057340622, + "rms": 0.24519670009613037, + "max_abs": 7.25 + }, + "full_input": { + "shape": [ + 99, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5b3458e1267ec69d16e36bec8f5898b9dea5c83c4e04189ac7b630fe8a84a200", + "mean": -0.007073747925460339, + "std": 6.998520851135254, + "rms": 6.998523712158203, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7a04970405cf3425e9b7a61d072e167fb207563bba1403aa096caefcb318323c", + "mean": -0.004432193469256163, + "std": 0.24734477698802948, + "rms": 0.2473844736814499, + "max_abs": 7.0625 + }, + "full_input": { + "shape": [ + 115, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "be8ff85cfba6a2e94fe47b01677f80e9cc931cf9338526631f06e685e6d3fcd1", + "mean": -0.006670027039945126, + "std": 6.483901023864746, + "rms": 6.483904838562012, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "dd614999e83327d8c04c6881d7bd66ca48bb86ef53e863aa1066897c42a5d1ef", + "mean": -0.004490818828344345, + "std": 0.24383887648582458, + "rms": 0.24388021230697632, + "max_abs": 7.0625 + }, + "full_input": { + "shape": [ + 99, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bc604d21dd58f546e7cf92d70fefe9d8f2c6612ac3c8aa5455d525197bb4275c", + "mean": -0.007018544245511293, + "std": 6.998450756072998, + "rms": 6.998453617095947, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c5b0152b6f91aea8d090b8c5e4c7abf498c105298010bc5fafca4e9f5ce2deb2", + "mean": -0.004502635449171066, + "std": 0.2447572946548462, + "rms": 0.2447986900806427, + "max_abs": 6.75 + }, + "full_input": { + "shape": [ + 115, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0c46d5692abbba534834f4156f0d4d0f4e9383de94db3f8428b7fbfe3d5f07d9", + "mean": -0.006600980181246996, + "std": 6.483799934387207, + "rms": 6.483803749084473, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "75810f07d4baa49c8dedf201c37f86cd101c50f1c8bc3b44f0b94650f3b703f1", + "mean": -0.004495598375797272, + "std": 0.24401384592056274, + "rms": 0.24405525624752045, + "max_abs": 7.0625 + }, + "full_input": { + "shape": [ + 99, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1060f6e9814319252b7f55360c5676c2c60fa1396ab83d9880b173986ddf0b1c", + "mean": -0.0070001352578401566, + "std": 6.998447895050049, + "rms": 6.998450756072998, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "02050a0ec706cbfcbedfb7bea159560119acdbe5b6a5c4b42f39830a693008a8", + "mean": -0.0045423912815749645, + "std": 0.24459601938724518, + "rms": 0.24463818967342377, + "max_abs": 6.84375 + }, + "full_input": { + "shape": [ + 115, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8f0b893620abf2a6ca7fc87f3ec9af9ad0125530133e34ab8150498abf026a82", + "mean": -0.006631087511777878, + "std": 6.4837870597839355, + "rms": 6.483790397644043, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9979027509689331, + "min_cosine_similarity": 0.9888864755630493, + "mean_relative_l2": 0.06073543056845665, + "max_abs_delta": 0.1875 + }, + "system_bos": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9943394064903259, + "min_cosine_similarity": 0.9561709761619568, + "mean_relative_l2": 0.10150859504938126, + "max_abs_delta": 0.78125 + }, + "system_x": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9907020330429077, + "min_cosine_similarity": 0.9421391487121582, + "mean_relative_l2": 0.1288665533065796, + "max_abs_delta": 0.6875 + }, + "system_period": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9896712303161621, + "min_cosine_similarity": 0.937535285949707, + "mean_relative_l2": 0.13471192121505737, + "max_abs_delta": 0.6875 + }, + "bos_at_s0": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9906811118125916, + "min_cosine_similarity": 0.9646514654159546, + "mean_relative_l2": 0.1311100721359253, + "max_abs_delta": 0.5625 + }, + "bos_at_s1": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9898021817207336, + "min_cosine_similarity": 0.9560638070106506, + "mean_relative_l2": 0.13771174848079681, + "max_abs_delta": 0.53125 + }, + "x_at_s0": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9884072542190552, + "min_cosine_similarity": 0.9517372250556946, + "mean_relative_l2": 0.1439894288778305, + "max_abs_delta": 0.5 + }, + "x_at_s1": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9828365445137024, + "min_cosine_similarity": 0.9188363552093506, + "mean_relative_l2": 0.17444109916687012, + "max_abs_delta": 0.96875 + }, + "period_at_s0": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.988235354423523, + "min_cosine_similarity": 0.94215989112854, + "mean_relative_l2": 0.14448752999305725, + "max_abs_delta": 0.59375 + }, + "period_at_s1": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9824514389038086, + "min_cosine_similarity": 0.9135757088661194, + "mean_relative_l2": 0.1771882027387619, + "max_abs_delta": 0.78125 + } + } + }, + "layer_07": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "07539a6866b236c58ad10487f6900a1546a5602ac691bc2b11a46bc9f181cf36", + "mean": -0.004450979642570019, + "std": 0.26680079102516174, + "rms": 0.2668379247188568, + "max_abs": 6.59375 + }, + "full_input": { + "shape": [ + 99, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0114d42acbd70db90e0bddf3617c5f6f6fb6145e429950ffa5dd3628bdb84db6", + "mean": -0.018615299835801125, + "std": 7.949676513671875, + "rms": 7.949697971343994, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3d26cc6c6b34f2208331ea0ff1834e9a095ad79a7fba5abd9c89525c43bf3059", + "mean": -0.004459790885448456, + "std": 0.26842913031578064, + "rms": 0.26846620440483093, + "max_abs": 6.625 + }, + "full_input": { + "shape": [ + 115, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "db9c1beb74803cee714716c958679f28a8b4607fae74da84398edd937f5cc9a9", + "mean": -0.018687671050429344, + "std": 7.595392227172852, + "rms": 7.5954155921936035, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e017e219220247ee440be3f6aa020a31c31c5395cefade5b53192e4883df4d5b", + "mean": -0.004359855782240629, + "std": 0.2669591009616852, + "rms": 0.2669947147369385, + "max_abs": 6.5 + }, + "full_input": { + "shape": [ + 99, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ce2583748fb6134d295eb4262c9abc9287ab92234d51cc7d2543de2775227eac", + "mean": -0.006919011939316988, + "std": 7.011741638183594, + "rms": 7.011744976043701, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "aad2d426ef7caa616706b06db4e722704705804afa7f31287dc0f33225e67d8d", + "mean": -0.004450080916285515, + "std": 0.26864296197891235, + "rms": 0.26867979764938354, + "max_abs": 6.625 + }, + "full_input": { + "shape": [ + 115, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ec1ee7818b7598e29ce0b754c990b12165c1ac216ab945eeb1cab0f269eb3863", + "mean": -0.007041774690151215, + "std": 6.496280670166016, + "rms": 6.496284484863281, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "68359edb9d8d0ae297b10c615e4a0179faba515cb6774171602d77db4cdb846b", + "mean": -0.0044497596099972725, + "std": 0.26404109597206116, + "rms": 0.2640785872936249, + "max_abs": 6.5 + }, + "full_input": { + "shape": [ + 99, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f1245df50e9621fdada9030a0d1948a10cb176e2d68c86355baf4f62be26f695", + "mean": -0.007025114726275206, + "std": 7.011613368988037, + "rms": 7.0116167068481445, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f349999c636b458955d6ff004566995d9444fc8c4c63c55f8353117175abb18e", + "mean": -0.004498418420553207, + "std": 0.2657213807106018, + "rms": 0.2657594680786133, + "max_abs": 6.65625 + }, + "full_input": { + "shape": [ + 115, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4ed009b1290a41cde95ade26d754b8215e0140465cc365de5b9cfe463df5f2dc", + "mean": -0.007085722405463457, + "std": 6.496158599853516, + "rms": 6.4961628913879395, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "02a4abce51d07c608809f20e4d33545378c73a2b91318a54bf385671d16d91e9", + "mean": -0.004422083031386137, + "std": 0.26485803723335266, + "rms": 0.26489493250846863, + "max_abs": 6.5 + }, + "full_input": { + "shape": [ + 99, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4dbc319525fb5fb4fd3376d5e39617f79ad06467154d92b13d556e87be14c101", + "mean": -0.006889696698635817, + "std": 7.011636734008789, + "rms": 7.011640548706055, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "33c9c277380ef715204c1e5740a20dd132b874049ab7993c17f88588423f6bd5", + "mean": -0.004562843590974808, + "std": 0.2660022974014282, + "rms": 0.26604142785072327, + "max_abs": 6.71875 + }, + "full_input": { + "shape": [ + 115, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ed9a61ae4a3a807b7b71b6ffa2316e0f153cd59bb03817f159067e5482c68191", + "mean": -0.007048643659800291, + "std": 6.496166229248047, + "rms": 6.496170520782471, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9973616600036621, + "min_cosine_similarity": 0.984570324420929, + "mean_relative_l2": 0.06780856847763062, + "max_abs_delta": 0.3125 + }, + "system_bos": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9933697581291199, + "min_cosine_similarity": 0.9492658376693726, + "mean_relative_l2": 0.10886991024017334, + "max_abs_delta": 1.15625 + }, + "system_x": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9894785284996033, + "min_cosine_similarity": 0.939703106880188, + "mean_relative_l2": 0.13710053265094757, + "max_abs_delta": 1.03125 + }, + "system_period": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9883604049682617, + "min_cosine_similarity": 0.9337083697319031, + "mean_relative_l2": 0.14333005249500275, + "max_abs_delta": 1.0625 + }, + "bos_at_s0": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9892104864120483, + "min_cosine_similarity": 0.9637428522109985, + "mean_relative_l2": 0.14114505052566528, + "max_abs_delta": 0.671875 + }, + "bos_at_s1": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9882456064224243, + "min_cosine_similarity": 0.9328657388687134, + "mean_relative_l2": 0.14624689519405365, + "max_abs_delta": 0.921875 + }, + "x_at_s0": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9865906238555908, + "min_cosine_similarity": 0.9487653970718384, + "mean_relative_l2": 0.15503203868865967, + "max_abs_delta": 0.646484375 + }, + "x_at_s1": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9802303910255432, + "min_cosine_similarity": 0.8726001977920532, + "mean_relative_l2": 0.18529698252677917, + "max_abs_delta": 0.953125 + }, + "period_at_s0": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9862019419670105, + "min_cosine_similarity": 0.9373059272766113, + "mean_relative_l2": 0.15697012841701508, + "max_abs_delta": 0.701171875 + }, + "period_at_s1": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9795256853103638, + "min_cosine_similarity": 0.8652735948562622, + "mean_relative_l2": 0.18938316404819489, + "max_abs_delta": 0.921875 + } + } + }, + "layer_08": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "70d1b21d8d8192956229af201da54b40365aac8abf8ec46a40dbb5ea2232d8c4", + "mean": -0.006031686440110207, + "std": 0.30159980058670044, + "rms": 0.30166009068489075, + "max_abs": 7.65625 + }, + "full_input": { + "shape": [ + 99, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "31e13876c003e6f022882b1ab094c454f18cbf6e426f56d7aa685e8c1838d45e", + "mean": -0.0200531966984272, + "std": 7.97707986831665, + "rms": 7.977105140686035, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "95b455aab70a75808a59465ef57c4e07721e0ec56838a75f521bd213de05ee49", + "mean": -0.006036914885044098, + "std": 0.3028295934200287, + "rms": 0.30288976430892944, + "max_abs": 7.75 + }, + "full_input": { + "shape": [ + 115, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "21208fede1d7514e1ad0ef26d35b9ff77899b37fcc5aa7bdab80baff49eb0348", + "mean": -0.019687261432409286, + "std": 7.621992111206055, + "rms": 7.6220173835754395, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "44dba3072823549dc2d78c1dbdd0e14cf5b3801dd4a8bca9a1256b76e8f90135", + "mean": -0.00606493791565299, + "std": 0.30237799882888794, + "rms": 0.3024388253688812, + "max_abs": 7.625 + }, + "full_input": { + "shape": [ + 99, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4c728cd09c6ad19be01a7fbd5ad7244423e4c50438ec9eb34a0dfce5f736ce0d", + "mean": -0.00855982769280672, + "std": 7.0273542404174805, + "rms": 7.0273590087890625, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4a41a47440a68de0ea760dfc9f24d6d85f729acc7ac257524377fd9adc4c3295", + "mean": -0.006263293791562319, + "std": 0.3036741316318512, + "rms": 0.30373871326446533, + "max_abs": 7.8125 + }, + "full_input": { + "shape": [ + 115, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "edfff9f890b0d104b01248ab1c49c494ab4889885ca2adc8ce5b165424a8a6c6", + "mean": -0.008318604901432991, + "std": 6.510832786560059, + "rms": 6.510837554931641, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "dc4da2ea9feeaa8e8db4a1ce0aff593ced3674fcf6da991574e4c832a95eba07", + "mean": -0.006300582084804773, + "std": 0.29990527033805847, + "rms": 0.29997146129608154, + "max_abs": 7.78125 + }, + "full_input": { + "shape": [ + 99, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0f5638c8df3db3df9ecbd115842ea3d77417f767a8dc1d45ba4637c73a5a90ff", + "mean": -0.008725730702280998, + "std": 7.0272417068481445, + "rms": 7.027246475219727, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "488c77b18c165f42a6fd7bed1ea3b1913032be167a394a449512c72acd8b866b", + "mean": -0.006385874468833208, + "std": 0.2998040020465851, + "rms": 0.2998720109462738, + "max_abs": 8.25 + }, + "full_input": { + "shape": [ + 115, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d66304630f222189517f02a50c2bf1e4f0445a702a432c313bb78587be4c7781", + "mean": -0.008318247273564339, + "std": 6.510687351226807, + "rms": 6.510692119598389, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "781f960a2fdf996938a8b918a419f37acfe5fe9405ed56695c19070c72ecad66", + "mean": -0.006418817676603794, + "std": 0.30045726895332336, + "rms": 0.30052584409713745, + "max_abs": 7.8125 + }, + "full_input": { + "shape": [ + 99, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "97bfc9a94c84a1f45a773a4b078680174a66205113f40208ec6c8067344e2cf1", + "mean": -0.008808192797005177, + "std": 7.02726411819458, + "rms": 7.027268886566162, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "52c1e1b18e0a4343378ee0a61be98cbd9a21f8cd39dda44aa56e37741bb8918a", + "mean": -0.006470709107816219, + "std": 0.30020350217819214, + "rms": 0.30027323961257935, + "max_abs": 8.25 + }, + "full_input": { + "shape": [ + 115, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "83bd8e99cbd4b22e8ff5520ccc81254b3093a9f18b3b1b3dd47f2840742f7b25", + "mean": -0.008294845931231976, + "std": 6.510694980621338, + "rms": 6.51069974899292, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9968066811561584, + "min_cosine_similarity": 0.9820320010185242, + "mean_relative_l2": 0.0744665265083313, + "max_abs_delta": 0.375 + }, + "system_bos": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9927502274513245, + "min_cosine_similarity": 0.9645975828170776, + "mean_relative_l2": 0.11463196575641632, + "max_abs_delta": 0.84375 + }, + "system_x": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9883276224136353, + "min_cosine_similarity": 0.9406358599662781, + "mean_relative_l2": 0.1441858559846878, + "max_abs_delta": 0.90625 + }, + "system_period": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9869855642318726, + "min_cosine_similarity": 0.9288557767868042, + "mean_relative_l2": 0.1524074375629425, + "max_abs_delta": 0.8125 + }, + "bos_at_s0": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9882010221481323, + "min_cosine_similarity": 0.9593353271484375, + "mean_relative_l2": 0.1483849138021469, + "max_abs_delta": 0.71875 + }, + "bos_at_s1": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.987258791923523, + "min_cosine_similarity": 0.923514723777771, + "mean_relative_l2": 0.15266773104667664, + "max_abs_delta": 0.96875 + }, + "x_at_s0": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9847521185874939, + "min_cosine_similarity": 0.9450362920761108, + "mean_relative_l2": 0.16631904244422913, + "max_abs_delta": 0.8359375 + }, + "x_at_s1": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9780267477035522, + "min_cosine_similarity": 0.8600254058837891, + "mean_relative_l2": 0.19678083062171936, + "max_abs_delta": 0.84375 + }, + "period_at_s0": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9839800000190735, + "min_cosine_similarity": 0.9281152486801147, + "mean_relative_l2": 0.170383021235466, + "max_abs_delta": 0.90625 + }, + "period_at_s1": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9774224758148193, + "min_cosine_similarity": 0.8459200859069824, + "mean_relative_l2": 0.2001483291387558, + "max_abs_delta": 1.03125 + } + } + }, + "layer_09": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "477229927c6823a69bbf8bd4c746ca3a264bedc8d1792ea5978d398b495cb675", + "mean": -0.0068208640441298485, + "std": 0.3543417751789093, + "rms": 0.354407399892807, + "max_abs": 11.0 + }, + "full_input": { + "shape": [ + 99, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2b978f5b73d3a9507776cf97c4723f9e54911ac8bce7c5944d764c5e7f5d5971", + "mean": -0.02032531425356865, + "std": 7.97967004776001, + "rms": 7.979695796966553, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f984e45c2908571006c206e89ecbf28fad3e26ef8594670d99b40303da08a590", + "mean": -0.006713076028972864, + "std": 0.35440242290496826, + "rms": 0.3544660210609436, + "max_abs": 11.0 + }, + "full_input": { + "shape": [ + 115, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3a6265852c912b637a564d4cea42cad8e16858425b1e33916bbd5a0c3fcd8393", + "mean": -0.0204275231808424, + "std": 7.624495983123779, + "rms": 7.624522686004639, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "808032fc205a753334b2972b8cf3d4bb2698df41e2dddb7a9644a76e88ea6d5f", + "mean": -0.006967383436858654, + "std": 0.3554277718067169, + "rms": 0.35549604892730713, + "max_abs": 11.0 + }, + "full_input": { + "shape": [ + 99, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cc326a982a010e52169275cfdfcdf4a153231dfce338c310101b64a9857289ce", + "mean": -0.009041431359946728, + "std": 7.030194282531738, + "rms": 7.030200004577637, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "980f5d3e865c38ed695f64e1a92b938b2abd286342c47a8a87f1d7c91d3c8871", + "mean": -0.006971894763410091, + "std": 0.3563002943992615, + "rms": 0.3563684821128845, + "max_abs": 10.875 + }, + "full_input": { + "shape": [ + 115, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4b3c1dcce32a22d153be792cf7f4ed062062f22d5499f5d0fd9aac591b65649b", + "mean": -0.00922715850174427, + "std": 6.513754844665527, + "rms": 6.513761520385742, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2a56b3d18ffb3e03c3774f81bfd5f209e1b90d2254070a1a3ba037ecfbfbe45e", + "mean": -0.00692764250561595, + "std": 0.3521914482116699, + "rms": 0.3522595763206482, + "max_abs": 11.125 + }, + "full_input": { + "shape": [ + 99, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9fb85a809c73caab19e5a844502b4b7235da5aa182297e55e2d61c111e27ef0e", + "mean": -0.008959037251770496, + "std": 7.030031681060791, + "rms": 7.030037879943848, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7348cecf5be55303f2e64c810690cbf2d98647bbfc9e93de3c2f9b3c4437788a", + "mean": -0.006758751813322306, + "std": 0.34981635212898254, + "rms": 0.3498816192150116, + "max_abs": 11.125 + }, + "full_input": { + "shape": [ + 115, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2f27235af94e19228326307eca773dfa188b80a7b7396688f9b66dab4737c70b", + "mean": -0.00905589759349823, + "std": 6.513480186462402, + "rms": 6.513486385345459, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "87de6fe7ca77af20925f23634f8de681ba7edc6aac407011eb6ee5c32da03259", + "mean": -0.007032481487840414, + "std": 0.3524523079395294, + "rms": 0.35252246260643005, + "max_abs": 11.125 + }, + "full_input": { + "shape": [ + 99, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8936acdd7fcbc8716bf124c9dbc5d0f3ccd94373753dbe8f5f529c6493e9e6d8", + "mean": -0.00892655923962593, + "std": 7.030019283294678, + "rms": 7.030025959014893, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "720c094bda2452555f8a3230c16e656ea6de12a78c84318c951f4df52bd82ae1", + "mean": -0.007070602383464575, + "std": 0.35082757472991943, + "rms": 0.3508988320827484, + "max_abs": 11.0625 + }, + "full_input": { + "shape": [ + 115, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "20c3c613edddebba7885a3521cc830e9283d6f07eee13d03430609e90fb7a95b", + "mean": -0.009121354669332504, + "std": 6.513487339019775, + "rms": 6.51349401473999, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9966309070587158, + "min_cosine_similarity": 0.9882441759109497, + "mean_relative_l2": 0.07662615925073624, + "max_abs_delta": 0.5 + }, + "system_bos": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9935723543167114, + "min_cosine_similarity": 0.9699949622154236, + "mean_relative_l2": 0.10907628387212753, + "max_abs_delta": 0.5625 + }, + "system_x": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9884669184684753, + "min_cosine_similarity": 0.9188449382781982, + "mean_relative_l2": 0.14210838079452515, + "max_abs_delta": 0.75 + }, + "system_period": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9876924753189087, + "min_cosine_similarity": 0.9319538474082947, + "mean_relative_l2": 0.14893005788326263, + "max_abs_delta": 0.84375 + }, + "bos_at_s0": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9891924262046814, + "min_cosine_similarity": 0.9628623127937317, + "mean_relative_l2": 0.14277112483978271, + "max_abs_delta": 0.984375 + }, + "bos_at_s1": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9878159761428833, + "min_cosine_similarity": 0.9291173219680786, + "mean_relative_l2": 0.14944374561309814, + "max_abs_delta": 1.96875 + }, + "x_at_s0": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9861637949943542, + "min_cosine_similarity": 0.9528061151504517, + "mean_relative_l2": 0.15948057174682617, + "max_abs_delta": 1.328125 + }, + "x_at_s1": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9791460037231445, + "min_cosine_similarity": 0.8675163388252258, + "mean_relative_l2": 0.19105258584022522, + "max_abs_delta": 1.125 + }, + "period_at_s0": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9853548407554626, + "min_cosine_similarity": 0.9415614008903503, + "mean_relative_l2": 0.16402101516723633, + "max_abs_delta": 1.203125 + }, + "period_at_s1": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9787885546684265, + "min_cosine_similarity": 0.8803332448005676, + "mean_relative_l2": 0.1944410800933838, + "max_abs_delta": 1.71875 + } + } + }, + "layer_10": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b8e21f373f79da148ccc04107b5286c85ca16e4d8824a28238620ea7826baea6", + "mean": -0.00514368899166584, + "std": 0.3978995680809021, + "rms": 0.3979327976703644, + "max_abs": 11.75 + }, + "full_input": { + "shape": [ + 99, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8e23774599916ec0cf8dc20f0b318d4a65a09dd6d88acde4ae22975fe96c811a", + "mean": -0.019464708864688873, + "std": 7.98820686340332, + "rms": 7.988231182098389, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7ad9f0206d8ba4e979f3c567b209e97f40a2ca8f97bf6b712e1c57b45809d480", + "mean": -0.005224983207881451, + "std": 0.3981460630893707, + "rms": 0.39818036556243896, + "max_abs": 11.8125 + }, + "full_input": { + "shape": [ + 115, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9ee0db3b2cfaabb79fdf7ee914c4fa9835d54577d378e02bf00330d2c50ec8a8", + "mean": -0.019988318905234337, + "std": 7.632644176483154, + "rms": 7.6326704025268555, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "adfe911e5ffd5e00fa32c82794f275601bcc1cfad05874880ad0b7612a40dafe", + "mean": -0.005078462418168783, + "std": 0.4010080397129059, + "rms": 0.4010401666164398, + "max_abs": 11.5625 + }, + "full_input": { + "shape": [ + 99, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e70937178f79a8e1d3dc908f57af3830673d4b7061b75c5f228be57462e9a251", + "mean": -0.00811593234539032, + "std": 7.039579391479492, + "rms": 7.039584159851074, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2e8f83a5d4ecd2b41e58157b0e39496e1b85e533f3335b4395c3828604a05847", + "mean": -0.005191602278500795, + "std": 0.4021482765674591, + "rms": 0.4021817743778229, + "max_abs": 11.75 + }, + "full_input": { + "shape": [ + 115, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4e6571b4f0ced1ddaf5f069abf9f9e7d520e44eba8a7d0828edf3f6d931e667c", + "mean": -0.008641310036182404, + "std": 6.522840976715088, + "rms": 6.522846221923828, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bbb8f1bf2171900df1e7d97654d2a90c82bd3f5fc44a1940b9153a631767ba0c", + "mean": -0.0052839661948382854, + "std": 0.39911532402038574, + "rms": 0.3991503119468689, + "max_abs": 11.625 + }, + "full_input": { + "shape": [ + 99, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "67185ae11947bebe27e7e395471a3561478c5d0cfeb900606c2e4291e25f1f11", + "mean": -0.008266061544418335, + "std": 7.03944730758667, + "rms": 7.03945255279541, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e09f383312c9e9e77d6b04eacea9d914d9eb26766dbe4a360cb6397c184ad101", + "mean": -0.005197280552238226, + "std": 0.3975886106491089, + "rms": 0.39762255549430847, + "max_abs": 11.625 + }, + "full_input": { + "shape": [ + 115, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "56cd6501193f15d64eb07fe7b45726051465f7b23c819711ff943585569d4b56", + "mean": -0.00865933671593666, + "std": 6.522582054138184, + "rms": 6.52258825302124, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e0e018a08a539ed794a73e05f0df01fe82ee84597e61dd7d06e436190747bc7c", + "mean": -0.005142332054674625, + "std": 0.399333655834198, + "rms": 0.39936673641204834, + "max_abs": 11.5625 + }, + "full_input": { + "shape": [ + 99, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "88938094dbaaa022ae5893f56b3d6f58cae4592c502293786ca32ed4340666cc", + "mean": -0.007969682104885578, + "std": 7.039432525634766, + "rms": 7.039437294006348, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0c9435fbb5b502960508f92eef01a356ea9ad450e8012fdd99709bda9ed78745", + "mean": -0.005433785729110241, + "std": 0.3980467915534973, + "rms": 0.39808389544487, + "max_abs": 11.625 + }, + "full_input": { + "shape": [ + 115, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f86e8d3a8d6de920a7dde2d65699c3ea999a7e88034521440cb2957cb5028a0d", + "mean": -0.008705006912350655, + "std": 6.522571563720703, + "rms": 6.52257776260376, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9961409568786621, + "min_cosine_similarity": 0.9862120747566223, + "mean_relative_l2": 0.08301351219415665, + "max_abs_delta": 0.4375 + }, + "system_bos": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9925197958946228, + "min_cosine_similarity": 0.9671496748924255, + "mean_relative_l2": 0.1185774952173233, + "max_abs_delta": 0.5 + }, + "system_x": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9871013760566711, + "min_cosine_similarity": 0.9209584593772888, + "mean_relative_l2": 0.1514713615179062, + "max_abs_delta": 0.625 + }, + "system_period": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9861299395561218, + "min_cosine_similarity": 0.9324676394462585, + "mean_relative_l2": 0.15834203362464905, + "max_abs_delta": 1.125 + }, + "bos_at_s0": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9874292612075806, + "min_cosine_similarity": 0.9553952217102051, + "mean_relative_l2": 0.15465979278087616, + "max_abs_delta": 1.0625 + }, + "bos_at_s1": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9859148859977722, + "min_cosine_similarity": 0.9324785470962524, + "mean_relative_l2": 0.16254954040050507, + "max_abs_delta": 1.75 + }, + "x_at_s0": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9846118092536926, + "min_cosine_similarity": 0.9518221616744995, + "mean_relative_l2": 0.16980654001235962, + "max_abs_delta": 1.78125 + }, + "x_at_s1": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9771358370780945, + "min_cosine_similarity": 0.8821475505828857, + "mean_relative_l2": 0.2035847157239914, + "max_abs_delta": 1.375 + }, + "period_at_s0": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9835408329963684, + "min_cosine_similarity": 0.9421935081481934, + "mean_relative_l2": 0.1755303144454956, + "max_abs_delta": 1.40625 + }, + "period_at_s1": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9764312505722046, + "min_cosine_similarity": 0.8825362324714661, + "mean_relative_l2": 0.20793147385120392, + "max_abs_delta": 1.75 + } + } + }, + "layer_11": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "64bdcc366b389db573b988b6c8a0ae3d3e2e3eaf86b147fdb352098b9b995eef", + "mean": -0.008999872021377087, + "std": 0.47911667823791504, + "rms": 0.47920119762420654, + "max_abs": 17.625 + }, + "full_input": { + "shape": [ + 99, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c4469ec3244797e075021b733253e8c9229c76bb0a1a02bd559dff6b49fb390a", + "mean": -0.021949313580989838, + "std": 8.03376293182373, + "rms": 8.033792495727539, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "10bdc9db3ce27a1facaf61df9891c0632321ffcf71a81059a832d2826ecad567", + "mean": -0.009006085805594921, + "std": 0.47757408022880554, + "rms": 0.4776589870452881, + "max_abs": 17.25 + }, + "full_input": { + "shape": [ + 115, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3aa43b59e5773fb97e7d24f26f173c641cd60c0de54c0db49f6063c137a78466", + "mean": -0.022079093381762505, + "std": 7.675246715545654, + "rms": 7.675278186798096, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cfd6cd29520f9122c38c24e4133d650e9a5259e725dd8f36c2d8a5cbbbd5924c", + "mean": -0.009112635627388954, + "std": 0.48125359416007996, + "rms": 0.48133987188339233, + "max_abs": 17.25 + }, + "full_input": { + "shape": [ + 99, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9a3c352d53b7965db62826ad83ccab1f7480bf33f634d62aa6eb4f1ab1964006", + "mean": -0.010647634044289589, + "std": 7.077523231506348, + "rms": 7.077530860900879, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4c7a16a85c8faa6eba8bcfebc2e764290e2c61231a1122926b9dcd255ae056f5", + "mean": -0.008894171565771103, + "std": 0.4791654348373413, + "rms": 0.47924795746803284, + "max_abs": 16.875 + }, + "full_input": { + "shape": [ + 115, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ba1e0d8fda65e7cf2dcb5139e5ee666b6a3654445b5f637edb4c02c73de8f56a", + "mean": -0.01062279287725687, + "std": 6.558333873748779, + "rms": 6.558341979980469, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0a561afca960cccb0cb3a2afdc9e2d80b7a4e83d46089470de165844a63efc52", + "mean": -0.009040378034114838, + "std": 0.4807617664337158, + "rms": 0.4808467626571655, + "max_abs": 17.25 + }, + "full_input": { + "shape": [ + 99, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1ac4fda43860eaf6be3324428472af08270b47df178cbc674dedafd8a36fd1f8", + "mean": -0.010442351922392845, + "std": 7.077457904815674, + "rms": 7.077466011047363, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "89c1ac10f87ed10c7cd7cb417dd62ff63246afcd92ddefbd7b2af13ebb074fa8", + "mean": -0.008841075003147125, + "std": 0.4764382243156433, + "rms": 0.47652024030685425, + "max_abs": 16.875 + }, + "full_input": { + "shape": [ + 115, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "eb60cdeef4aa93de31c9531f3785c5802ae2372c1090ce66abdc7aa19e9f8aa2", + "mean": -0.01042008213698864, + "std": 6.55806827545166, + "rms": 6.55807638168335, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4217945d6fc49fbfda017ba54f4c2b2c94b16ce5b4e06e4be4f6376bf9864d6a", + "mean": -0.008930292911827564, + "std": 0.4809398055076599, + "rms": 0.4810226857662201, + "max_abs": 17.125 + }, + "full_input": { + "shape": [ + 99, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "af12fe513dedf6addac290735ac701fbda6f8b5750f5aca4c86f94afb93acfde", + "mean": -0.010226384736597538, + "std": 7.077424049377441, + "rms": 7.0774312019348145, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f47a2835c16b342485e6afa64aa89c786e8b6594f815abb9a1bf2979b4743fb7", + "mean": -0.008947191759943962, + "std": 0.4777333438396454, + "rms": 0.4778171181678772, + "max_abs": 17.0 + }, + "full_input": { + "shape": [ + 115, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4d56ced9cf61327ff5bb90a991ba37c2b07418419eaa30d6c86aaee77ed4d0b6", + "mean": -0.010408603586256504, + "std": 6.558080196380615, + "rms": 6.558088779449463, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9962354898452759, + "min_cosine_similarity": 0.9858911633491516, + "mean_relative_l2": 0.08305001258850098, + "max_abs_delta": 0.625 + }, + "system_bos": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9930025339126587, + "min_cosine_similarity": 0.9685314893722534, + "mean_relative_l2": 0.114787258207798, + "max_abs_delta": 0.75 + }, + "system_x": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9871582984924316, + "min_cosine_similarity": 0.9129276871681213, + "mean_relative_l2": 0.15210288763046265, + "max_abs_delta": 0.984375 + }, + "system_period": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9865062832832336, + "min_cosine_similarity": 0.9279435873031616, + "mean_relative_l2": 0.15723709762096405, + "max_abs_delta": 1.25 + }, + "bos_at_s0": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9887055158615112, + "min_cosine_similarity": 0.9574931263923645, + "mean_relative_l2": 0.14622293412685394, + "max_abs_delta": 1.125 + }, + "bos_at_s1": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.987095832824707, + "min_cosine_similarity": 0.9409379363059998, + "mean_relative_l2": 0.15459543466567993, + "max_abs_delta": 1.25 + }, + "x_at_s0": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9861146807670593, + "min_cosine_similarity": 0.956626296043396, + "mean_relative_l2": 0.16148610413074493, + "max_abs_delta": 1.65625 + }, + "x_at_s1": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9792692065238953, + "min_cosine_similarity": 0.8999838829040527, + "mean_relative_l2": 0.195197194814682, + "max_abs_delta": 1.4375 + }, + "period_at_s0": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9850186705589294, + "min_cosine_similarity": 0.9491835832595825, + "mean_relative_l2": 0.16761064529418945, + "max_abs_delta": 1.375 + }, + "period_at_s1": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9787012338638306, + "min_cosine_similarity": 0.8992962837219238, + "mean_relative_l2": 0.1988576054573059, + "max_abs_delta": 1.8125 + } + } + }, + "layer_12": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9ca5d27f75d4bab696b7e4c97cd7c68858915689b29bfa09954ddb7040db2985", + "mean": -0.01076582446694374, + "std": 0.49943113327026367, + "rms": 0.4995471239089966, + "max_abs": 14.75 + }, + "full_input": { + "shape": [ + 99, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "84526e68be675b9116f85b912dc0e60856659a3ddb19ddb1a7626aac7af54b40", + "mean": -0.02385951578617096, + "std": 8.089786529541016, + "rms": 8.089821815490723, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "165d051e4f1b419fce9b1e5205e55a9ec99c7aa48949698a3df47e3cf38e0247", + "mean": -0.010757971554994583, + "std": 0.49788981676101685, + "rms": 0.49800601601600647, + "max_abs": 14.375 + }, + "full_input": { + "shape": [ + 115, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8808a3d74cced429042ad67a400d9931481909d08f4489cc571b81ad5af64b12", + "mean": -0.02340075932443142, + "std": 7.731329441070557, + "rms": 7.731364727020264, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "50bd5074b56ec71a8d90256e709250a98b823cd7e717b12406e184e2e24c859a", + "mean": -0.01110120490193367, + "std": 0.5012277364730835, + "rms": 0.5013506412506104, + "max_abs": 14.3125 + }, + "full_input": { + "shape": [ + 99, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "93b8212fd4fcc464f19bfe5708e0ea18c7353eea7c40bf1db398c3697fe00a43", + "mean": -0.01251593604683876, + "std": 7.0902485847473145, + "rms": 7.090260028839111, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3dff9b63ef24ff1a278e16a94ebd91e94b8a5510618f6cf8767730659ac24e4f", + "mean": -0.01084071584045887, + "std": 0.4996223747730255, + "rms": 0.49973997473716736, + "max_abs": 13.875 + }, + "full_input": { + "shape": [ + 115, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c84eaad878aa5921569949e686809a9318ecb06fbb62873f35c7e42572abe45e", + "mean": -0.01204066164791584, + "std": 6.570893287658691, + "rms": 6.57090425491333, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a97ca805607bdc300d9341b750821ea37b40fda4d8246a27a0e8b05f18981407", + "mean": -0.01082975696772337, + "std": 0.4997809827327728, + "rms": 0.4998982846736908, + "max_abs": 14.25 + }, + "full_input": { + "shape": [ + 99, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cf4d11cdb6eb36c8096518be8672b9d09f5ce5b59c4361aec19e43c153c1cc1b", + "mean": -0.012460551224648952, + "std": 7.090137958526611, + "rms": 7.09014892578125, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "494ceede53b4f895e9c371182117d39186d7168dbe9d250fb7788bdab055d0cd", + "mean": -0.010717455297708511, + "std": 0.4965044856071472, + "rms": 0.49662014842033386, + "max_abs": 13.9375 + }, + "full_input": { + "shape": [ + 115, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "21a7807cffed5e9b74ffc9aa52697bcd4364ac2714ab8f4464e00f20a1679774", + "mean": -0.0119210509583354, + "std": 6.570499897003174, + "rms": 6.5705108642578125, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "45a79a4ada0b039163616a4352c8a8e483aefec205d8d9683c6f1b46b64ad5f7", + "mean": -0.010739754885435104, + "std": 0.5003157258033752, + "rms": 0.5004309415817261, + "max_abs": 14.25 + }, + "full_input": { + "shape": [ + 99, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "537f1f65bcaf01bbde94c2e024ce21a3855583f7ceb53ad3fb0e947ac1b125ce", + "mean": -0.01213508378714323, + "std": 7.090106964111328, + "rms": 7.090117454528809, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "441d4e272cdb6ac9d63f92e8eccf5e6219a76e6c74bcb13b03d58567c5a9e564", + "mean": -0.010661249049007893, + "std": 0.4969393312931061, + "rms": 0.49705368280410767, + "max_abs": 13.875 + }, + "full_input": { + "shape": [ + 115, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2fae35d53cbc004aa9f24ba803f0a2a5ad82b8c12c5dbf2727553b4e2e1b17fb", + "mean": -0.011693434789776802, + "std": 6.57051944732666, + "rms": 6.570530414581299, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9952477216720581, + "min_cosine_similarity": 0.9855219125747681, + "mean_relative_l2": 0.09322948753833771, + "max_abs_delta": 0.5625 + }, + "system_bos": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9914548993110657, + "min_cosine_similarity": 0.9643856883049011, + "mean_relative_l2": 0.12706857919692993, + "max_abs_delta": 0.625 + }, + "system_x": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9843149781227112, + "min_cosine_similarity": 0.8879221677780151, + "mean_relative_l2": 0.1674557775259018, + "max_abs_delta": 1.125 + }, + "system_period": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.983651876449585, + "min_cosine_similarity": 0.911554217338562, + "mean_relative_l2": 0.17341147363185883, + "max_abs_delta": 1.1875 + }, + "bos_at_s0": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9864819645881653, + "min_cosine_similarity": 0.9500223398208618, + "mean_relative_l2": 0.15970303118228912, + "max_abs_delta": 1.125 + }, + "bos_at_s1": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9848207235336304, + "min_cosine_similarity": 0.9378049373626709, + "mean_relative_l2": 0.16844739019870758, + "max_abs_delta": 1.4375 + }, + "x_at_s0": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9831243753433228, + "min_cosine_similarity": 0.949244499206543, + "mean_relative_l2": 0.17712557315826416, + "max_abs_delta": 1.3125 + }, + "x_at_s1": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9753737449645996, + "min_cosine_similarity": 0.8891934156417847, + "mean_relative_l2": 0.2130773365497589, + "max_abs_delta": 1.125 + }, + "period_at_s0": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9817100763320923, + "min_cosine_similarity": 0.943518877029419, + "mean_relative_l2": 0.1847011148929596, + "max_abs_delta": 1.1875 + }, + "period_at_s1": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9750165343284607, + "min_cosine_similarity": 0.8986039161682129, + "mean_relative_l2": 0.2161642611026764, + "max_abs_delta": 1.4375 + } + } + }, + "layer_13": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fc05c3a460cfb60af9fdad8d0abaac0ae8748af685838e9b257bebbb3c2cd33a", + "mean": -0.01416184101253748, + "std": 0.5270759463310242, + "rms": 0.5272662043571472, + "max_abs": 15.125 + }, + "full_input": { + "shape": [ + 99, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ae5c5925007c12abacc2664546d02e9fcdfef2a1b82ba53bd2028cfb52bad827", + "mean": -0.02635069563984871, + "std": 8.096996307373047, + "rms": 8.097038269042969, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "774c0437cc05bc76a813d755a748805511621450b6012b4ae4577a99e1bd1a44", + "mean": -0.013973717577755451, + "std": 0.5263594388961792, + "rms": 0.5265448689460754, + "max_abs": 14.875 + }, + "full_input": { + "shape": [ + 115, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "88b63540c70bc090043e4bb04ca7295c49e1ac8d6a892bf9875ba89de1895486", + "mean": -0.026087265461683273, + "std": 7.738722801208496, + "rms": 7.738766670227051, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "812c37178a1f6e1daeb0679dc980d2bc5d4ed86c189c6fe5dc651c69c8ea8687", + "mean": -0.014412321150302887, + "std": 0.5286460518836975, + "rms": 0.5288424491882324, + "max_abs": 14.5625 + }, + "full_input": { + "shape": [ + 99, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "63ca487bec81d4ca22d4687d9ed8fb422cad8fc078b04e2ddf2a30b46761c7ea", + "mean": -0.014887387864291668, + "std": 7.09677267074585, + "rms": 7.09678840637207, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "42a1c44c40a9ea302fa7eb2aa8047e026880367ee04269cf75d88977827957b1", + "mean": -0.014237281866371632, + "std": 0.5280076265335083, + "rms": 0.5281995534896851, + "max_abs": 14.3125 + }, + "full_input": { + "shape": [ + 115, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fc4a113a0baea2020c4d40df071de8ccf81ff2dcec7ce5cd017b63e6cc126b67", + "mean": -0.014756613411009312, + "std": 6.577759265899658, + "rms": 6.577775478363037, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0f7cdd8c9a453f1f297b665910f987c2bff1eb714a769f011cc5248c912e6cf4", + "mean": -0.01416140329092741, + "std": 0.5270744562149048, + "rms": 0.5272646546363831, + "max_abs": 14.5625 + }, + "full_input": { + "shape": [ + 99, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "923c82f8138ff7112716260ac5d6bfc8352ef15c1eabdc94fd1dfd759d0242e9", + "mean": -0.014982447028160095, + "std": 7.09670352935791, + "rms": 7.096719264984131, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f6157c35931d47cd9e21a756f25d6565ebe8a69e8882112c3c9d3b87fa202a6d", + "mean": -0.013694041408598423, + "std": 0.525559663772583, + "rms": 0.5257380604743958, + "max_abs": 14.375 + }, + "full_input": { + "shape": [ + 115, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6acc8a47a7e42244575fd8b6e655a09089d988584d039aa0dce581e7de9b4444", + "mean": -0.014373276382684708, + "std": 6.577426910400391, + "rms": 6.577441692352295, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d2d4a3d5f14c45bd22c02a5bdb359b4832537662dbca12070127a20c1534207f", + "mean": -0.013941241428256035, + "std": 0.5278640389442444, + "rms": 0.5280480980873108, + "max_abs": 14.375 + }, + "full_input": { + "shape": [ + 99, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "03033b686894e607ebd5d80aa2314cb15619fab91ede5d0b51306cd382f25ae5", + "mean": -0.0145414462313056, + "std": 7.096664905548096, + "rms": 7.0966796875, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2ba190515c93ed5108067bb392242294f09b75cb192b39235aec07bacc174449", + "mean": -0.013895271345973015, + "std": 0.5261842608451843, + "rms": 0.5263676643371582, + "max_abs": 14.375 + }, + "full_input": { + "shape": [ + 115, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "89b251c5d4e47da9bb9eaa60a26dadf68d5fd5024295e18eb5f553283a4b9577", + "mean": -0.014382598921656609, + "std": 6.577449798583984, + "rms": 6.577465057373047, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9949890375137329, + "min_cosine_similarity": 0.9837898015975952, + "mean_relative_l2": 0.09578268229961395, + "max_abs_delta": 0.6875 + }, + "system_bos": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9912219643592834, + "min_cosine_similarity": 0.9608229994773865, + "mean_relative_l2": 0.12895239889621735, + "max_abs_delta": 0.75 + }, + "system_x": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9835363626480103, + "min_cosine_similarity": 0.8775280714035034, + "mean_relative_l2": 0.17188985645771027, + "max_abs_delta": 1.5625 + }, + "system_period": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9830179810523987, + "min_cosine_similarity": 0.8862388134002686, + "mean_relative_l2": 0.17637097835540771, + "max_abs_delta": 1.8125 + }, + "bos_at_s0": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9860380291938782, + "min_cosine_similarity": 0.9483096599578857, + "mean_relative_l2": 0.1621093451976776, + "max_abs_delta": 1.0625 + }, + "bos_at_s1": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9843378067016602, + "min_cosine_similarity": 0.937730610370636, + "mean_relative_l2": 0.1707889884710312, + "max_abs_delta": 1.75 + }, + "x_at_s0": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9827099442481995, + "min_cosine_similarity": 0.9461259841918945, + "mean_relative_l2": 0.17882901430130005, + "max_abs_delta": 1.3125 + }, + "x_at_s1": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9750741720199585, + "min_cosine_similarity": 0.8963627815246582, + "mean_relative_l2": 0.2147587537765503, + "max_abs_delta": 1.3125 + }, + "period_at_s0": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9810187816619873, + "min_cosine_similarity": 0.9314473867416382, + "mean_relative_l2": 0.1874549686908722, + "max_abs_delta": 1.3125 + }, + "period_at_s1": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9749031066894531, + "min_cosine_similarity": 0.9055304527282715, + "mean_relative_l2": 0.21742093563079834, + "max_abs_delta": 1.5 + } + } + }, + "layer_14": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "72d4df39d6ad2d7042ab3d5d60b4d8444553e91adc18082008207d8b62b7f35b", + "mean": -0.013376171700656414, + "std": 0.5961233377456665, + "rms": 0.5962734222412109, + "max_abs": 19.5 + }, + "full_input": { + "shape": [ + 99, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7ea7e15863d8c70240dcb6c072b7b4c8d3add80d914ca1c31803e14531d4d641", + "mean": -0.025116756558418274, + "std": 8.115418434143066, + "rms": 8.115458488464355, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bde0520beb1b66695f838ecbc4efb53302f7e8109b3292174e673cb6fc7e72b8", + "mean": -0.013263245113193989, + "std": 0.5960251092910767, + "rms": 0.5961726307868958, + "max_abs": 19.25 + }, + "full_input": { + "shape": [ + 115, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3da7d74fbdda3094a3c19caa15602230d0f5fd02ae4ded82b0dbf4e70c71a192", + "mean": -0.025301095098257065, + "std": 7.755643844604492, + "rms": 7.755685329437256, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ae01b514aeeb97a8c5bea3788744051bdf640beed011eb1303cc5fae672ee7c7", + "mean": -0.013570061884820461, + "std": 0.5981273651123047, + "rms": 0.5982813239097595, + "max_abs": 19.125 + }, + "full_input": { + "shape": [ + 99, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4e7dddee9ac068a91dff3777ac49fcb85e31eb3e7fe0497ec2a84d3ed20cc837", + "mean": -0.013653760775923729, + "std": 7.116861343383789, + "rms": 7.116875171661377, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7ded899de54dab4df9b5168d75789d7215150a8c76a2ac313281b967aa0d1536", + "mean": -0.013745230622589588, + "std": 0.598467230796814, + "rms": 0.598625123500824, + "max_abs": 19.0 + }, + "full_input": { + "shape": [ + 115, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "32ae633d0673e0dbe094baf15cec1844323b1bc825d37f84b200ded83da06595", + "mean": -0.01406027190387249, + "std": 6.596776485443115, + "rms": 6.5967912673950195, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2ca6923ed02fc66e166bb8dff7c3e0bbf5449320b7b2320a5773171c9b56e948", + "mean": -0.013522647321224213, + "std": 0.5965325832366943, + "rms": 0.5966858267784119, + "max_abs": 18.75 + }, + "full_input": { + "shape": [ + 99, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "60d7730a4238ead9953b2da5558ea33641ee55cf83c1abb877d44a7aaca068ca", + "mean": -0.013840352185070515, + "std": 7.1168107986450195, + "rms": 7.116824626922607, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "233665d8fb8de9f7e3270e46a0f4fc2b7f4c694b0825c1d6853e6b5275dc3327", + "mean": -0.013193958438932896, + "std": 0.5956982970237732, + "rms": 0.5958443880081177, + "max_abs": 18.5 + }, + "full_input": { + "shape": [ + 115, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6b8c3e77ccffcb7e00088cc67a079bf0a133977cf0d9ba9a24010c395548e32b", + "mean": -0.013711933046579361, + "std": 6.596449851989746, + "rms": 6.596464157104492, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "28f29ded7676eb60f2885b0a33ddf4da85c4171e46e43b4f02c82ff48af57856", + "mean": -0.013435469008982182, + "std": 0.5977743268013, + "rms": 0.5979253053665161, + "max_abs": 18.75 + }, + "full_input": { + "shape": [ + 99, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "546de87c4b91a357e5ece0c8dd4461cd05d49af93b8f64d44fbde27ca15bbcdc", + "mean": -0.013599076308310032, + "std": 7.116779327392578, + "rms": 7.116792678833008, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c93bcef9559338d7eb0b74b099a65996dbb904f609f0cfe1bea11b8b1ddc1356", + "mean": -0.013196229003369808, + "std": 0.5973894000053406, + "rms": 0.5975351333618164, + "max_abs": 18.25 + }, + "full_input": { + "shape": [ + 115, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "92567f9c0f49c9035053b68612f0aabf4736afc1e60e001b0509e87fe31005c6", + "mean": -0.013666590675711632, + "std": 6.596487045288086, + "rms": 6.596501350402832, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9950860738754272, + "min_cosine_similarity": 0.9811388254165649, + "mean_relative_l2": 0.09532758593559265, + "max_abs_delta": 0.6875 + }, + "system_bos": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9914441704750061, + "min_cosine_similarity": 0.954132080078125, + "mean_relative_l2": 0.12708382308483124, + "max_abs_delta": 1.0 + }, + "system_x": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9839094877243042, + "min_cosine_similarity": 0.8793987035751343, + "mean_relative_l2": 0.16987372934818268, + "max_abs_delta": 1.4375 + }, + "system_period": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9831480979919434, + "min_cosine_similarity": 0.8831831812858582, + "mean_relative_l2": 0.17594271898269653, + "max_abs_delta": 1.5 + }, + "bos_at_s0": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9867832064628601, + "min_cosine_similarity": 0.9615406394004822, + "mean_relative_l2": 0.15824590623378754, + "max_abs_delta": 1.125 + }, + "bos_at_s1": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9853675365447998, + "min_cosine_similarity": 0.9430235624313354, + "mean_relative_l2": 0.1658141165971756, + "max_abs_delta": 1.75 + }, + "x_at_s0": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9835352301597595, + "min_cosine_similarity": 0.9450862407684326, + "mean_relative_l2": 0.1744621843099594, + "max_abs_delta": 1.6875 + }, + "x_at_s1": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9764467477798462, + "min_cosine_similarity": 0.8969905376434326, + "mean_relative_l2": 0.20915856957435608, + "max_abs_delta": 1.5625 + }, + "period_at_s0": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9816257357597351, + "min_cosine_similarity": 0.9271606206893921, + "mean_relative_l2": 0.18449994921684265, + "max_abs_delta": 1.625 + }, + "period_at_s1": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.976081132888794, + "min_cosine_similarity": 0.904853105545044, + "mean_relative_l2": 0.21259666979312897, + "max_abs_delta": 1.75 + } + } + }, + "layer_15": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e9c55bdf3bd31222cf41b273a81ad14e22c4a581771e4fef99f2d5ebb130e663", + "mean": -0.014968437142670155, + "std": 0.6551330089569092, + "rms": 0.655303955078125, + "max_abs": 22.0 + }, + "full_input": { + "shape": [ + 99, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7f95adeec400031e3d2255a020c9fdef8653f88b015cfb90fea6640f6959c7f8", + "mean": -0.025847461074590683, + "std": 8.123440742492676, + "rms": 8.123482704162598, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "92ea15c875a9f16a491ce94b7001c159a1d48444b5e7005eb1c33e3e0e06c70b", + "mean": -0.014937265776097775, + "std": 0.654658317565918, + "rms": 0.6548287272453308, + "max_abs": 22.25 + }, + "full_input": { + "shape": [ + 115, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4139e90aa98ce8e506b7317f35482e43cf7d205dd4210deec84226faf4bcbcf5", + "mean": -0.026267163455486298, + "std": 7.764225482940674, + "rms": 7.764270305633545, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "435e6e2a2f5b76ebd1959efb16c24c3e005d7b029de108008d9525b0ebfe7377", + "mean": -0.015213917940855026, + "std": 0.6595808863639832, + "rms": 0.6597563028335571, + "max_abs": 21.375 + }, + "full_input": { + "shape": [ + 99, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "99d1222a1eab4145dab6e84e62d99c2b1200d370f27dea751d55a227178f768b", + "mean": -0.01445560622960329, + "std": 7.1255574226379395, + "rms": 7.125572204589844, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "76f4deaf9f9c9856764a53502618fe6ded8defd8ff8c28db6c1807be432cb2ba", + "mean": -0.015465160831809044, + "std": 0.6580595374107361, + "rms": 0.6582412123680115, + "max_abs": 21.75 + }, + "full_input": { + "shape": [ + 115, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1c6ed50389fbbb1939289126dfec2e1d9a07f6fc17d1741ecb4b06d0c1ea0810", + "mean": -0.0150662362575531, + "std": 6.606122970581055, + "rms": 6.60614013671875, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7425b383641ba4d4a4c7789138584d17a30cb0070941ebc7647d67bf19872fed", + "mean": -0.014960805885493755, + "std": 0.6573210954666138, + "rms": 0.6574912667274475, + "max_abs": 21.75 + }, + "full_input": { + "shape": [ + 99, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f0f1ca7d8aa8a651f6ee76ae8c3ba99a9454d4abef1643da0e6dac0006b28922", + "mean": -0.014434739015996456, + "std": 7.125445365905762, + "rms": 7.125459671020508, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "82d693b05d31144b7e2336a86bbc5757e5932574bda3b7fa33759543634b3957", + "mean": -0.01467372477054596, + "std": 0.6546531319618225, + "rms": 0.654817521572113, + "max_abs": 21.75 + }, + "full_input": { + "shape": [ + 115, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d8454696bd448883f6fd7e4f0067360fe7bcc778c288fba43aac0f64ba68c11e", + "mean": -0.014596660621464252, + "std": 6.605708599090576, + "rms": 6.605724334716797, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fbb3e230c41b453215c717bf857778c06fd71d7cca12918c4cd93a3ee69b6199", + "mean": -0.014844179153442383, + "std": 0.6582911610603333, + "rms": 0.6584584712982178, + "max_abs": 21.5 + }, + "full_input": { + "shape": [ + 99, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "29a94b14457dcd3c8efb74db0de70f010a7ed11969a164365d8ca482a901e0a2", + "mean": -0.014107337221503258, + "std": 7.1254072189331055, + "rms": 7.125421047210693, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4008c86f234eecec8ca372890d321392ae51491950eb1492bcf2771f6f4a50ed", + "mean": -0.014903978444635868, + "std": 0.6561508178710938, + "rms": 0.6563200950622559, + "max_abs": 21.75 + }, + "full_input": { + "shape": [ + 115, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "332f8dee3bc080deb0f8ee75ae0e462741ad4b9d68b782d77e078b53a2ab19f6", + "mean": -0.014592209830880165, + "std": 6.60576868057251, + "rms": 6.6057844161987305, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9948505759239197, + "min_cosine_similarity": 0.9828313589096069, + "mean_relative_l2": 0.09756231307983398, + "max_abs_delta": 0.8125 + }, + "system_bos": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9913097023963928, + "min_cosine_similarity": 0.9513270854949951, + "mean_relative_l2": 0.12763476371765137, + "max_abs_delta": 1.25 + }, + "system_x": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9838635325431824, + "min_cosine_similarity": 0.8979991674423218, + "mean_relative_l2": 0.171024888753891, + "max_abs_delta": 1.4375 + }, + "system_period": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9829936623573303, + "min_cosine_similarity": 0.9021984934806824, + "mean_relative_l2": 0.17710734903812408, + "max_abs_delta": 2.25 + }, + "bos_at_s0": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9868138432502747, + "min_cosine_similarity": 0.9599179029464722, + "mean_relative_l2": 0.15789170563220978, + "max_abs_delta": 1.5 + }, + "bos_at_s1": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9855414628982544, + "min_cosine_similarity": 0.9471046924591064, + "mean_relative_l2": 0.16505388915538788, + "max_abs_delta": 1.625 + }, + "x_at_s0": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.983749270439148, + "min_cosine_similarity": 0.9398094415664673, + "mean_relative_l2": 0.17332689464092255, + "max_abs_delta": 1.6875 + }, + "x_at_s1": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9765971302986145, + "min_cosine_similarity": 0.9087693691253662, + "mean_relative_l2": 0.20884418487548828, + "max_abs_delta": 1.625 + }, + "period_at_s0": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9817792773246765, + "min_cosine_similarity": 0.9355990290641785, + "mean_relative_l2": 0.18371404707431793, + "max_abs_delta": 1.625 + }, + "period_at_s1": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9765058159828186, + "min_cosine_similarity": 0.916718602180481, + "mean_relative_l2": 0.2113410383462906, + "max_abs_delta": 1.75 + } + } + }, + "layer_16": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c70ec89a09d5f867e9c45f77d0ab6db653646b5616be7783fe2353d971e9cbdc", + "mean": -0.016995860263705254, + "std": 0.7496556043624878, + "rms": 0.7498482465744019, + "max_abs": 24.375 + }, + "full_input": { + "shape": [ + 99, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5b8011d38d3e3d1019bb3a80921bd60578232a576ce3a2a7e1ba6a4e7d303268", + "mean": -0.027486614882946014, + "std": 8.134925842285156, + "rms": 8.13497257232666, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8951c957be2d18f4288364ae4f3d244b48e29cfd513225daa551c73b36c234d8", + "mean": -0.016901571303606033, + "std": 0.7513872981071472, + "rms": 0.7515774369239807, + "max_abs": 24.25 + }, + "full_input": { + "shape": [ + 115, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1215b690a6c1a6d4888139254cb5ae6368e1981adefc28da646dafa2289718f5", + "mean": -0.027427101507782936, + "std": 7.775850296020508, + "rms": 7.775898456573486, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "49f31f946883c88ea0d5a13f996650028d9f19b3379674888d64c64b0480f601", + "mean": -0.01723213493824005, + "std": 0.753845751285553, + "rms": 0.7540426850318909, + "max_abs": 24.125 + }, + "full_input": { + "shape": [ + 99, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1d3ebd4af9ac27b91d734dfd9e79a26a80bf4a95c5145dfc56e248462c927ecd", + "mean": -0.01605193316936493, + "std": 7.137564659118652, + "rms": 7.137582302093506, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "949ac8b5a046754760895d1e66308a644f7d8fa3cd034cfe4f530a64c750d9bb", + "mean": -0.01715654693543911, + "std": 0.7548767924308777, + "rms": 0.755071759223938, + "max_abs": 23.875 + }, + "full_input": { + "shape": [ + 115, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ba540fdf4d95a948056a1a7fa4fa09cd9083b159adc1dabc4f1f728d583cb742", + "mean": -0.015901898965239525, + "std": 6.61895227432251, + "rms": 6.618971347808838, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "77cc56b2ce9b32a272b2ab1a0513b87aa1fcd585601dd680ef103fc1dd589e73", + "mean": -0.01712471805512905, + "std": 0.752284049987793, + "rms": 0.7524788975715637, + "max_abs": 24.25 + }, + "full_input": { + "shape": [ + 99, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "078d9b5c73f05a1233f138d9c245b2c1bc15a8459bfcc9a84c0ed30f8bc59222", + "mean": -0.016071384772658348, + "std": 7.137621879577637, + "rms": 7.13763952255249, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "17bf6e371d42f5496970bd16895a38909f7f534bbdd7cf768e49e4e6e2c25e7a", + "mean": -0.01632024720311165, + "std": 0.7529221177101135, + "rms": 0.7530989050865173, + "max_abs": 24.0 + }, + "full_input": { + "shape": [ + 115, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6128ef19280d00ffa0d775242f44d8748cc3584419930b5f989fb7b22fc1f644", + "mean": -0.015307143330574036, + "std": 6.618711471557617, + "rms": 6.618729591369629, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "38b2cf85224593afee1d61980dcf4da155c22b9586cc3ada863ae9c5e0bfee20", + "mean": -0.016959678381681442, + "std": 0.7536739706993103, + "rms": 0.7538647651672363, + "max_abs": 24.5 + }, + "full_input": { + "shape": [ + 99, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2aba89ae712fff659fc438729876b28687ecb6641bb42eb4c57780a5ab7340cc", + "mean": -0.015665894374251366, + "std": 7.137471675872803, + "rms": 7.13748836517334, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ae7f9efc099ba6a0471b81310b374edad45a97715062872a2151f58078f6f825", + "mean": -0.016637161374092102, + "std": 0.7554827332496643, + "rms": 0.7556658983230591, + "max_abs": 24.25 + }, + "full_input": { + "shape": [ + 115, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "671c7a77354c05d089b78a85995795cabd4c175c8c90713a8215475a47554f95", + "mean": -0.015205750241875648, + "std": 6.618723392486572, + "rms": 6.618741035461426, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9947943687438965, + "min_cosine_similarity": 0.9834842681884766, + "mean_relative_l2": 0.09825370460748672, + "max_abs_delta": 0.75 + }, + "system_bos": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9915649890899658, + "min_cosine_similarity": 0.9563600420951843, + "mean_relative_l2": 0.1261565387248993, + "max_abs_delta": 1.25 + }, + "system_x": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9835910201072693, + "min_cosine_similarity": 0.8996754288673401, + "mean_relative_l2": 0.17284348607063293, + "max_abs_delta": 1.5625 + }, + "system_period": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9832509160041809, + "min_cosine_similarity": 0.912339448928833, + "mean_relative_l2": 0.17659388482570648, + "max_abs_delta": 1.625 + }, + "bos_at_s0": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9869499206542969, + "min_cosine_similarity": 0.9615905284881592, + "mean_relative_l2": 0.15746766328811646, + "max_abs_delta": 1.5 + }, + "bos_at_s1": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9858061075210571, + "min_cosine_similarity": 0.951305091381073, + "mean_relative_l2": 0.16400013864040375, + "max_abs_delta": 1.625 + }, + "x_at_s0": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.983852207660675, + "min_cosine_similarity": 0.9463575482368469, + "mean_relative_l2": 0.17315144836902618, + "max_abs_delta": 1.75 + }, + "x_at_s1": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9767091870307922, + "min_cosine_similarity": 0.9094986319541931, + "mean_relative_l2": 0.20871120691299438, + "max_abs_delta": 1.875 + }, + "period_at_s0": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9818037152290344, + "min_cosine_similarity": 0.9356991648674011, + "mean_relative_l2": 0.18390457332134247, + "max_abs_delta": 1.875 + }, + "period_at_s1": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9768668413162231, + "min_cosine_similarity": 0.9240219593048096, + "mean_relative_l2": 0.21046589314937592, + "max_abs_delta": 2.0 + } + } + }, + "layer_17": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "83323ecfc1084de428fe72ea47c610616647783f8aaf7a0a915a906bb16a6608", + "mean": -0.01943361572921276, + "std": 0.8694124817848206, + "rms": 0.8696296215057373, + "max_abs": 28.0 + }, + "full_input": { + "shape": [ + 99, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "14c1a0e132ae56f26428f3f915044f4fdbc87cedaaadfdaa137a5bfe5a645b37", + "mean": -0.029607698321342468, + "std": 8.1497220993042, + "rms": 8.149775505065918, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9d88544d128474215c15896578c8de4691f7fbdcfdce48da91df0f3f9aab8744", + "mean": -0.019169513136148453, + "std": 0.8704275488853455, + "rms": 0.8706386089324951, + "max_abs": 27.75 + }, + "full_input": { + "shape": [ + 115, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "86124ae6a693dc61335e4521c1ecc48d6b3bb8b723d0698a0b4df86da4f5d9ba", + "mean": -0.029818540439009666, + "std": 7.791162967681885, + "rms": 7.791220188140869, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7cd6fef3fe0c9ac291d4f8a452ca221ff37dd2462bd6ec84b3fe07e437b1c066", + "mean": -0.01954958215355873, + "std": 0.8741691708564758, + "rms": 0.8743877410888672, + "max_abs": 28.0 + }, + "full_input": { + "shape": [ + 99, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "279b3a133a31c8be5cb3425213cbb110914c7acc7b84e8dbc7cc484696e5ddef", + "mean": -0.01800224557518959, + "std": 7.153862953186035, + "rms": 7.1538848876953125, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0f51f7b9cbaaa4e5b2b08110a477d21e289eb37549d74d7e4cc5a1a1fe5b828c", + "mean": -0.019336611032485962, + "std": 0.8758120536804199, + "rms": 0.8760254979133606, + "max_abs": 27.625 + }, + "full_input": { + "shape": [ + 115, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b2667c53fa8fb522201633397e3567eff3248cd7d2b442e5a8d76be18cc46d75", + "mean": -0.018294038251042366, + "std": 6.636605739593506, + "rms": 6.636631011962891, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9a1ead660decccb3ce18ba64df03189609fcc7aa94ad3e1e9166746b9144b27a", + "mean": -0.020043298602104187, + "std": 0.87382572889328, + "rms": 0.8740555644035339, + "max_abs": 28.25 + }, + "full_input": { + "shape": [ + 99, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fee9c8d91a0059bc3131f42faca44be4eb8ab535fe50adc4111146b1c5ab3dc8", + "mean": -0.01861945539712906, + "std": 7.154122829437256, + "rms": 7.154146671295166, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "dab30661737fc206681016ac681fc715927329faeeaf44ed98e065652b17b8e1", + "mean": -0.019182266667485237, + "std": 0.8737737536430359, + "rms": 0.8739842772483826, + "max_abs": 27.875 + }, + "full_input": { + "shape": [ + 115, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fc7aeb6063a3cf25aca4a6099be25dfb01e554af810ec834ef64d22f0226e2d5", + "mean": -0.018328582867980003, + "std": 6.636307716369629, + "rms": 6.636332988739014, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8fff1a0f2ce454392534bf9ceddf8d4e56f091b5be786ee124097bb7f342677c", + "mean": -0.019857624545693398, + "std": 0.8742798566818237, + "rms": 0.8745054006576538, + "max_abs": 28.375 + }, + "full_input": { + "shape": [ + 99, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6d4af92cbe4e0af795b6da82964e4407eeebe748eda9cb240e5abc7905351c52", + "mean": -0.018162203952670097, + "std": 7.1538286209106445, + "rms": 7.153851509094238, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "419dd680ecee68c980ae9f4132e1f1794896938d00b3b4cad303f1036768b47e", + "mean": -0.018961088731884956, + "std": 0.8753731846809387, + "rms": 0.8755785226821899, + "max_abs": 27.75 + }, + "full_input": { + "shape": [ + 115, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4698e4fe4fc1c2eab0a41d7d311c2532e94163ba3274dbc96973b5fae045747d", + "mean": -0.017865020781755447, + "std": 6.6363067626953125, + "rms": 6.636330604553223, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9949362277984619, + "min_cosine_similarity": 0.9851768016815186, + "mean_relative_l2": 0.09707426279783249, + "max_abs_delta": 0.875 + }, + "system_bos": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9918786287307739, + "min_cosine_similarity": 0.9596243500709534, + "mean_relative_l2": 0.12417210638523102, + "max_abs_delta": 1.25 + }, + "system_x": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9842837452888489, + "min_cosine_similarity": 0.9088252186775208, + "mean_relative_l2": 0.16881337761878967, + "max_abs_delta": 1.75 + }, + "system_period": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9843571782112122, + "min_cosine_similarity": 0.9268903732299805, + "mean_relative_l2": 0.17057397961616516, + "max_abs_delta": 1.875 + }, + "bos_at_s0": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9877884387969971, + "min_cosine_similarity": 0.9656437635421753, + "mean_relative_l2": 0.15257659554481506, + "max_abs_delta": 1.625 + }, + "bos_at_s1": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9865068197250366, + "min_cosine_similarity": 0.9518528580665588, + "mean_relative_l2": 0.1599239856004715, + "max_abs_delta": 1.375 + }, + "x_at_s0": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9846868515014648, + "min_cosine_similarity": 0.9546566009521484, + "mean_relative_l2": 0.1697043776512146, + "max_abs_delta": 2.1875 + }, + "x_at_s1": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9779767394065857, + "min_cosine_similarity": 0.9255122542381287, + "mean_relative_l2": 0.20352092385292053, + "max_abs_delta": 2.25 + }, + "period_at_s0": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9827669262886047, + "min_cosine_similarity": 0.9467901587486267, + "mean_relative_l2": 0.17955483496189117, + "max_abs_delta": 2.1875 + }, + "period_at_s1": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9781803488731384, + "min_cosine_similarity": 0.927448034286499, + "mean_relative_l2": 0.20435230433940887, + "max_abs_delta": 2.375 + } + } + }, + "layer_18": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "be6b2bbe34bb62889491e26a1325aad8c7eae83e72a3edcdf5d6033c8f896468", + "mean": -0.022741984575986862, + "std": 1.0126333236694336, + "rms": 1.0128885507583618, + "max_abs": 34.0 + }, + "full_input": { + "shape": [ + 99, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a0d745a59e428d5d2201182f79589fab04737a1f78080780e90e568c982474ea", + "mean": -0.031916096806526184, + "std": 8.171623229980469, + "rms": 8.171685218811035, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8c7fec8a7b0d5d4ea5cc3aface5a8df8a8d310153bd962e332d498de8fae9578", + "mean": -0.02266067825257778, + "std": 1.0115481615066528, + "rms": 1.0118019580841064, + "max_abs": 34.5 + }, + "full_input": { + "shape": [ + 115, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "01c8f51a25d7d8e7f40fb47a2f58e8fdec4450a0337e3a9969b7eea573d02300", + "mean": -0.031747039407491684, + "std": 7.81329870223999, + "rms": 7.813363075256348, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "70888ecebb863089ce40dee460af3838d924e7b89517f0b9b0643dc94d42cef5", + "mean": -0.022923773154616356, + "std": 1.0147782564163208, + "rms": 1.015037178993225, + "max_abs": 33.25 + }, + "full_input": { + "shape": [ + 99, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f6b39d820a53811feae9a7f8a13409028917007c1f2a4b6a78cb446b20875870", + "mean": -0.02035265415906906, + "std": 7.175817489624023, + "rms": 7.175846576690674, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "66e6aee845e363d0db4b8587fa7a194a6ff2095664debc353c36ce25a6eda5b7", + "mean": -0.022877508774399757, + "std": 1.0154913663864136, + "rms": 1.0157490968704224, + "max_abs": 33.25 + }, + "full_input": { + "shape": [ + 115, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6750aaab8b25edd6007059359a30385942bd3811f2b116264e3bf3e7c9200ecc", + "mean": -0.020222945138812065, + "std": 6.659839153289795, + "rms": 6.65986967086792, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e2ad9657647712f5b3094608f2659d1f25062f55b22f8b93fdcc16cedd5f155d", + "mean": -0.023284774273633957, + "std": 1.016062617301941, + "rms": 1.0163294076919556, + "max_abs": 33.5 + }, + "full_input": { + "shape": [ + 99, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3b4cbd96e5d8f468ecb1d4c989a4e663d3a475ff9da94c295c16feb5573e9383", + "mean": -0.020849309861660004, + "std": 7.176224708557129, + "rms": 7.176254749298096, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1a5b1be18c8d98957ff688257db0ece5d34174c11e0bce89642a379fc5ec26cc", + "mean": -0.022886846214532852, + "std": 1.012068510055542, + "rms": 1.0123273134231567, + "max_abs": 33.0 + }, + "full_input": { + "shape": [ + 115, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7f488147a4477f262af97d2173692b009501fbacc58bee597fd1bc95b150261a", + "mean": -0.02031416818499565, + "std": 6.659359931945801, + "rms": 6.659391403198242, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b143cedb450aa8e97f098249116e9a0ab6a83963ca72bc949d7ae0479cb33f52", + "mean": -0.02318708784878254, + "std": 1.0168077945709229, + "rms": 1.017072081565857, + "max_abs": 34.0 + }, + "full_input": { + "shape": [ + 99, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "07e3d472ebbbf131d13926efc6f05264a5027274a57220349d6785b61c0374da", + "mean": -0.020539790391921997, + "std": 7.1759748458862305, + "rms": 7.176003932952881, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "062aea50818c6618be7abf49bf8d3451282040bbc68fc8ea38bb3648f8094474", + "mean": -0.022493010386824608, + "std": 1.0134762525558472, + "rms": 1.013725757598877, + "max_abs": 33.5 + }, + "full_input": { + "shape": [ + 115, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c3e787de633b3e6942f235003f8a350e4bda2477c7d774d24150c3194fdc1f04", + "mean": -0.019858641549944878, + "std": 6.659255504608154, + "rms": 6.659285068511963, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9953494668006897, + "min_cosine_similarity": 0.986417293548584, + "mean_relative_l2": 0.09316273778676987, + "max_abs_delta": 1.125 + }, + "system_bos": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9926844239234924, + "min_cosine_similarity": 0.962293267250061, + "mean_relative_l2": 0.11747796088457108, + "max_abs_delta": 1.5 + }, + "system_x": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9857019782066345, + "min_cosine_similarity": 0.9235576391220093, + "mean_relative_l2": 0.1608847975730896, + "max_abs_delta": 1.875 + }, + "system_period": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9854534268379211, + "min_cosine_similarity": 0.9405521750450134, + "mean_relative_l2": 0.16418783366680145, + "max_abs_delta": 2.75 + }, + "bos_at_s0": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9892910122871399, + "min_cosine_similarity": 0.9723984003067017, + "mean_relative_l2": 0.14266422390937805, + "max_abs_delta": 1.625 + }, + "bos_at_s1": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9879878163337708, + "min_cosine_similarity": 0.9547260999679565, + "mean_relative_l2": 0.1509288251399994, + "max_abs_delta": 2.625 + }, + "x_at_s0": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9863921403884888, + "min_cosine_similarity": 0.9545618295669556, + "mean_relative_l2": 0.15971356630325317, + "max_abs_delta": 2.375 + }, + "x_at_s1": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9803131818771362, + "min_cosine_similarity": 0.9336956739425659, + "mean_relative_l2": 0.19216875731945038, + "max_abs_delta": 2.75 + }, + "period_at_s0": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.984684407711029, + "min_cosine_similarity": 0.9447253942489624, + "mean_relative_l2": 0.1687157303094864, + "max_abs_delta": 2.6875 + }, + "period_at_s1": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9803346991539001, + "min_cosine_similarity": 0.9353768825531006, + "mean_relative_l2": 0.19379878044128418, + "max_abs_delta": 3.875 + } + } + }, + "layer_19": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cfcab1a3ce391144b84b1b252a0cefab95e31fd61a06f0d2cf13c66e9c50af72", + "mean": -0.02303439937531948, + "std": 1.1093283891677856, + "rms": 1.109567642211914, + "max_abs": 30.75 + }, + "full_input": { + "shape": [ + 99, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "edc3b7cc5393dd95a1d1bef4a8bb87b7a0a1d58c271baa0f6f6ac44d782d1f38", + "mean": -0.031508032232522964, + "std": 8.18170166015625, + "rms": 8.181761741638184, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "80b3173f62c5ed399989ac424903d00ec5a6ec5cd65e3022aa92bc8a7306c1c8", + "mean": -0.02253131754696369, + "std": 1.1107964515686035, + "rms": 1.1110248565673828, + "max_abs": 30.875 + }, + "full_input": { + "shape": [ + 115, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "202e1955e1f625015aeadc3b901ea630b57cb05e046a08ab6e2c1fa77e37e4d7", + "mean": -0.03058360144495964, + "std": 7.82523775100708, + "rms": 7.8252973556518555, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a6d8770708294d6abf0b911be8dfa44219019198911b0cb23a4138be5f2fe477", + "mean": -0.022538911551237106, + "std": 1.1153595447540283, + "rms": 1.1155872344970703, + "max_abs": 29.875 + }, + "full_input": { + "shape": [ + 99, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "87dd3962a4d2c157623f00b2d7abd6ab03005309603a39ea19c7a429772bdbec", + "mean": -0.019581662490963936, + "std": 7.187969207763672, + "rms": 7.187995910644531, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "aadb1b503cb3808b770d879d5f015b4919924a94b380f1cb52bfdcb341989ee4", + "mean": -0.0230253878980875, + "std": 1.1184041500091553, + "rms": 1.1186411380767822, + "max_abs": 29.5 + }, + "full_input": { + "shape": [ + 115, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b6b3f300871a187c1ed6a1e7d14231284c76a69d49ef6ebb8458b815f441fa53", + "mean": -0.019323652610182762, + "std": 6.674084186553955, + "rms": 6.674111366271973, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1a2c9d65813cdca3fc1ad9449d24df049d17c991af9b525d5723b08b0fcb651e", + "mean": -0.02316327579319477, + "std": 1.1151084899902344, + "rms": 1.1153490543365479, + "max_abs": 29.875 + }, + "full_input": { + "shape": [ + 99, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "657b5b8a0618a5e992311321e72dbabdefd12e21158e0a9e66ff6e9f6d7cc3da", + "mean": -0.0202731192111969, + "std": 7.188478469848633, + "rms": 7.188507080078125, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f02577f8e26baa4a49af3ea8a5b8593ed64febcd469d9b978f8c91a6f9f8cad4", + "mean": -0.023143429309129715, + "std": 1.1149623394012451, + "rms": 1.11520254611969, + "max_abs": 29.25 + }, + "full_input": { + "shape": [ + 115, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1df570e8b27b1d5a9fe80252f1d32f21ba1c2fdc6b36b42a34da09a1cb1f51a2", + "mean": -0.019229037687182426, + "std": 6.673478603363037, + "rms": 6.673506259918213, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8b3e087c198dba168c14a078322c44ea2434ce222c3050bd30bf03f7544aa93f", + "mean": -0.022978948429226875, + "std": 1.1164219379425049, + "rms": 1.116658329963684, + "max_abs": 30.625 + }, + "full_input": { + "shape": [ + 99, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cdff259656a2fb401982145c273167c567e26098d5a8743f0896a4b82463aa1f", + "mean": -0.020003804937005043, + "std": 7.18814754486084, + "rms": 7.188174724578857, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3b49e1d7b1e185c2c652f670bdffc3e69f89ca204f38aa65b164c1b13e57ce8d", + "mean": -0.022594278678297997, + "std": 1.1182615756988525, + "rms": 1.1184897422790527, + "max_abs": 29.5 + }, + "full_input": { + "shape": [ + 115, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "2e026350052be243add354f502f39da68c1d5d8635423751bbda2bb721e2402e", + "mean": -0.018875205889344215, + "std": 6.6736273765563965, + "rms": 6.673654556274414, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9949299693107605, + "min_cosine_similarity": 0.9870580434799194, + "mean_relative_l2": 0.09733636677265167, + "max_abs_delta": 1.125 + }, + "system_bos": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.992148756980896, + "min_cosine_similarity": 0.9610961675643921, + "mean_relative_l2": 0.121586874127388, + "max_abs_delta": 2.0625 + }, + "system_x": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9847840070724487, + "min_cosine_similarity": 0.9139540195465088, + "mean_relative_l2": 0.1657068431377411, + "max_abs_delta": 2.75 + }, + "system_period": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9844009876251221, + "min_cosine_similarity": 0.9382663369178772, + "mean_relative_l2": 0.16994786262512207, + "max_abs_delta": 3.375 + }, + "bos_at_s0": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9886449575424194, + "min_cosine_similarity": 0.9703797101974487, + "mean_relative_l2": 0.14698819816112518, + "max_abs_delta": 1.75 + }, + "bos_at_s1": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9870794415473938, + "min_cosine_similarity": 0.9542069435119629, + "mean_relative_l2": 0.15592721104621887, + "max_abs_delta": 1.75 + }, + "x_at_s0": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9854536056518555, + "min_cosine_similarity": 0.941155195236206, + "mean_relative_l2": 0.1649015247821808, + "max_abs_delta": 2.375 + }, + "x_at_s1": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.979095995426178, + "min_cosine_similarity": 0.9265918731689453, + "mean_relative_l2": 0.19793522357940674, + "max_abs_delta": 3.25 + }, + "period_at_s0": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9836981296539307, + "min_cosine_similarity": 0.9362841844558716, + "mean_relative_l2": 0.17402121424674988, + "max_abs_delta": 3.0625 + }, + "period_at_s1": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9790725708007812, + "min_cosine_similarity": 0.9388482570648193, + "mean_relative_l2": 0.19989454746246338, + "max_abs_delta": 3.1875 + } + } + }, + "layer_20": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "400d5346e496916caace339cba8a008bff7f24a396856a3e938f9c2a92900bbf", + "mean": -0.024055296555161476, + "std": 1.3053306341171265, + "rms": 1.305552363395691, + "max_abs": 40.5 + }, + "full_input": { + "shape": [ + 99, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ad9535a4053010408efe56a6a664f2f3ee567d0aaf790c952f3cf2c87e3386a8", + "mean": -0.03245185688138008, + "std": 8.45117473602295, + "rms": 8.451236724853516, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "386fdc75ece5611016f1bc1941cfa6d83a16638e0782b6afc0c5d5b2674df06b", + "mean": -0.023539144545793533, + "std": 1.3072291612625122, + "rms": 1.307441234588623, + "max_abs": 40.0 + }, + "full_input": { + "shape": [ + 115, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f49af7a72d10845267920d29dc772dedae0fe9308d0b3f2a90e5c619ba110871", + "mean": -0.0312250554561615, + "std": 8.093560218811035, + "rms": 8.093620300292969, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4eb822ad971908d715310f54506296070f80e38732a99083abc4879f8d3c2740", + "mean": -0.02347412146627903, + "std": 1.3086538314819336, + "rms": 1.3088643550872803, + "max_abs": 40.75 + }, + "full_input": { + "shape": [ + 99, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "db92bb60f4e12099367398d81cb834f64a06adb4ccc82810dd4fde8ba8ae9da7", + "mean": -0.02095298282802105, + "std": 7.2188334465026855, + "rms": 7.2188639640808105, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "51204f1c4ec615148c4a2fb524086f736e8d5a6024bb8b047d5e297afbab29b5", + "mean": -0.024074934422969818, + "std": 1.3125865459442139, + "rms": 1.312807321548462, + "max_abs": 41.25 + }, + "full_input": { + "shape": [ + 115, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f4b9b845b05e5872c12e946943bcb134e2aabc7421ce56beebd19e67402a42ae", + "mean": -0.020428817719221115, + "std": 6.707396984100342, + "rms": 6.707427978515625, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "31c9f4dd8c9c11c7fea5ebf4e2857bc6c1c88799e2e0dc5fdbe5f81bd4b452c1", + "mean": -0.023772109299898148, + "std": 1.310768961906433, + "rms": 1.310984492301941, + "max_abs": 40.75 + }, + "full_input": { + "shape": [ + 99, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f056bf7d26756e330b48d28aeedcc5757dcbf8c731c06c1311871fc6dc004690", + "mean": -0.0213629137724638, + "std": 7.219926357269287, + "rms": 7.219958305358887, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d631dd8f75b109d9d96891bfd1f507d65cdb80dbdcba82e04b3397eb0b77cb8d", + "mean": -0.023508772253990173, + "std": 1.3086844682693481, + "rms": 1.3088955879211426, + "max_abs": 39.75 + }, + "full_input": { + "shape": [ + 115, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8abe27aa69ae4c2770a93b62eaa563851d0e89e1be974652020f554c60ad2ff8", + "mean": -0.01986544020473957, + "std": 6.706871509552002, + "rms": 6.7069010734558105, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1f4cb51986c09971b86b29332d384d7f574fbbc45b2ae6df49c54b7458ed1bf3", + "mean": -0.023807436227798462, + "std": 1.3125932216644287, + "rms": 1.3128089904785156, + "max_abs": 40.75 + }, + "full_input": { + "shape": [ + 99, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c4d2475743a000f727012771f13868c451dc5eef6d9714435972c61b01860e9b", + "mean": -0.02120935544371605, + "std": 7.219629764556885, + "rms": 7.219660758972168, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d8cfe6a637ef56e49ac57d3d485b2977ef169770d18ac8433ac2f92afb44618f", + "mean": -0.02363777905702591, + "std": 1.3122519254684448, + "rms": 1.3124648332595825, + "max_abs": 39.75 + }, + "full_input": { + "shape": [ + 115, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9ecec9fb85ad948c0158a1ffb2f2f6b8283bde8b08b96ae5ea1bcf10ce2b5395", + "mean": -0.02005578577518463, + "std": 6.7070393562316895, + "rms": 6.707068920135498, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9952828884124756, + "min_cosine_similarity": 0.9858136177062988, + "mean_relative_l2": 0.09367785602807999, + "max_abs_delta": 1.5 + }, + "system_bos": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9929726123809814, + "min_cosine_similarity": 0.9673330783843994, + "mean_relative_l2": 0.1153280958533287, + "max_abs_delta": 2.75 + }, + "system_x": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9857405424118042, + "min_cosine_similarity": 0.9160723686218262, + "mean_relative_l2": 0.16055446863174438, + "max_abs_delta": 3.0 + }, + "system_period": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.985343337059021, + "min_cosine_similarity": 0.9441242218017578, + "mean_relative_l2": 0.16467881202697754, + "max_abs_delta": 3.625 + }, + "bos_at_s0": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9897559881210327, + "min_cosine_similarity": 0.9665191173553467, + "mean_relative_l2": 0.13917937874794006, + "max_abs_delta": 1.75 + }, + "bos_at_s1": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9882776141166687, + "min_cosine_similarity": 0.9622764587402344, + "mean_relative_l2": 0.1484551727771759, + "max_abs_delta": 3.25 + }, + "x_at_s0": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9869130849838257, + "min_cosine_similarity": 0.9435725212097168, + "mean_relative_l2": 0.15615342557430267, + "max_abs_delta": 2.25 + }, + "x_at_s1": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9809208512306213, + "min_cosine_similarity": 0.9350343942642212, + "mean_relative_l2": 0.1889641284942627, + "max_abs_delta": 3.25 + }, + "period_at_s0": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9852579236030579, + "min_cosine_similarity": 0.9391977787017822, + "mean_relative_l2": 0.1651105433702469, + "max_abs_delta": 3.4375 + }, + "period_at_s1": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.980945885181427, + "min_cosine_similarity": 0.9412420988082886, + "mean_relative_l2": 0.19058851897716522, + "max_abs_delta": 4.625 + } + } + }, + "layer_21": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0534b680c8e1d5d4e1c107dd15d33cb931e221888fc0c6a131497dc11c28771e", + "mean": -0.028573332354426384, + "std": 1.41190505027771, + "rms": 1.4121941328048706, + "max_abs": 51.5 + }, + "full_input": { + "shape": [ + 99, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "467cf96ba1bf003355b2b1fd9b543168940db2b0f008e0418c1971e2eaa557c6", + "mean": -0.035605430603027344, + "std": 8.546874046325684, + "rms": 8.546947479248047, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3809ae3d843b0c8951df534bae2a256352494b3683b92cdcfe7d8635c4f3a561", + "mean": -0.028762895613908768, + "std": 1.4190151691436768, + "rms": 1.4193066358566284, + "max_abs": 51.5 + }, + "full_input": { + "shape": [ + 115, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cd9c8ccd46c035063d0305e6fa6847e37292ecc670d0bac2e1e2a539907f97e3", + "mean": -0.033796537667512894, + "std": 8.181548118591309, + "rms": 8.181617736816406, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8d8059846ddcae25c4fc6d018b8fa882a811b0552f9fdf8e4ee6b47504744578", + "mean": -0.0279829241335392, + "std": 1.4116543531417847, + "rms": 1.4119317531585693, + "max_abs": 51.75 + }, + "full_input": { + "shape": [ + 99, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "07e54129dd99f28443e20a4194ce26710c7cea8788cf6aa52f91bd2adb3df5bb", + "mean": -0.023755647242069244, + "std": 7.221216201782227, + "rms": 7.221254825592041, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "917f07e14689b6275661069e5de6e43eb295289fcc9334434e7675d6319a1270", + "mean": -0.028360163792967796, + "std": 1.4168323278427124, + "rms": 1.4171160459518433, + "max_abs": 52.5 + }, + "full_input": { + "shape": [ + 115, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ad14a376582e3f28cc93487e22223bf29d76004f4d102778dc72f3a64a4b7946", + "mean": -0.0221189484000206, + "std": 6.716335296630859, + "rms": 6.716371536254883, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "a4e4317c1eea40a55da83223742cc172da7c09c14c45dd08411d65b0eaf41e89", + "mean": -0.028687352314591408, + "std": 1.4186280965805054, + "rms": 1.4189181327819824, + "max_abs": 52.0 + }, + "full_input": { + "shape": [ + 99, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1194cb1dbdf11ff12d8515d83714d58767e0810bd7fd02324022c81cda6d5647", + "mean": -0.024438638240098953, + "std": 7.2234883308410645, + "rms": 7.22352933883667, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "45f70cf418ed28cfca88b893c20fea18891ae5890d7e4e1642dcb2271b4921c7", + "mean": -0.02930334396660328, + "std": 1.4247183799743652, + "rms": 1.42501962184906, + "max_abs": 51.75 + }, + "full_input": { + "shape": [ + 115, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "13df69ad1fc4ec7e10359f723f2dca31b476d3ee13ef937325122b6b6b1b4522", + "mean": -0.02275044284760952, + "std": 6.718099117279053, + "rms": 6.718137264251709, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "312b07bb840392e1f2f635627ef62dd71a7a2a776e11baf7e4d1c23babd6cc6f", + "mean": -0.02859664335846901, + "std": 1.4203354120254517, + "rms": 1.4206231832504272, + "max_abs": 52.0 + }, + "full_input": { + "shape": [ + 99, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f9ef5d701d7d70ae96b4a521c3cbd2fdf5092ab54f659fca59b953426280c9a4", + "mean": -0.024279160425066948, + "std": 7.222765922546387, + "rms": 7.222806930541992, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7125549be761a92b759cd3b4e8ae6bb2d9aa38c8ffcaf62cb1f716b2ae6a6ea4", + "mean": -0.029833484441041946, + "std": 1.4315612316131592, + "rms": 1.431872010231018, + "max_abs": 51.5 + }, + "full_input": { + "shape": [ + 115, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ac31de7938f8ee5622d27fbdf863a5ef782fc5c0296cf395242921db8e5de30f", + "mean": -0.023119118064641953, + "std": 6.718025207519531, + "rms": 6.718064785003662, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.994899570941925, + "min_cosine_similarity": 0.984175443649292, + "mean_relative_l2": 0.09785950183868408, + "max_abs_delta": 2.125 + }, + "system_bos": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9927220940589905, + "min_cosine_similarity": 0.9637268781661987, + "mean_relative_l2": 0.11763671785593033, + "max_abs_delta": 3.25 + }, + "system_x": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.984571099281311, + "min_cosine_similarity": 0.9027238488197327, + "mean_relative_l2": 0.16721367835998535, + "max_abs_delta": 5.375 + }, + "system_period": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9843896627426147, + "min_cosine_similarity": 0.9394612312316895, + "mean_relative_l2": 0.17093773186206818, + "max_abs_delta": 4.0 + }, + "bos_at_s0": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9894701838493347, + "min_cosine_similarity": 0.9661998748779297, + "mean_relative_l2": 0.14136798679828644, + "max_abs_delta": 2.125 + }, + "bos_at_s1": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9878822565078735, + "min_cosine_similarity": 0.9573987722396851, + "mean_relative_l2": 0.15077653527259827, + "max_abs_delta": 5.0 + }, + "x_at_s0": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.986639678478241, + "min_cosine_similarity": 0.942626416683197, + "mean_relative_l2": 0.15835826098918915, + "max_abs_delta": 2.5 + }, + "x_at_s1": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9799898266792297, + "min_cosine_similarity": 0.9364869594573975, + "mean_relative_l2": 0.19384635984897614, + "max_abs_delta": 4.25 + }, + "period_at_s0": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9850103855133057, + "min_cosine_similarity": 0.936744749546051, + "mean_relative_l2": 0.16705238819122314, + "max_abs_delta": 3.21875 + }, + "period_at_s1": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9803922772407532, + "min_cosine_similarity": 0.9369903802871704, + "mean_relative_l2": 0.1943269968032837, + "max_abs_delta": 6.25 + } + } + }, + "layer_22": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ab2ad9cd2f6d3ce16b2f8bbe13611d36e9d4377f6232fdc1773ab7b0563ce0fa", + "mean": -0.03879200667142868, + "std": 1.6534446477890015, + "rms": 1.6538996696472168, + "max_abs": 66.0 + }, + "full_input": { + "shape": [ + 99, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "08d824dba1550f8388df68f4e528842087bacc2786dc62810de4bac1720b5110", + "mean": -0.043622542172670364, + "std": 8.585317611694336, + "rms": 8.585429191589355, + "max_abs": 1168.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4fd0b05d56f052f05761b33a17259bd1fc2eaf4249bd754d19dec0d440d34891", + "mean": -0.0389099195599556, + "std": 1.6635558605194092, + "rms": 1.6640108823776245, + "max_abs": 66.5 + }, + "full_input": { + "shape": [ + 115, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ef4a91f6ee088c63131c98b778f01670f27dc147df67fcb005e213684af834a3", + "mean": -0.04102284461259842, + "std": 8.225703239440918, + "rms": 8.225805282592773, + "max_abs": 1168.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "531a69ee237ac6d90d21cf15c53ed790ce9192751f4de2120fb9cd44dd56e0f5", + "mean": -0.03793463110923767, + "std": 1.650672435760498, + "rms": 1.6511082649230957, + "max_abs": 66.0 + }, + "full_input": { + "shape": [ + 99, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "753e4c5a467139888e2b4ed0418c0970a7f8737f86995edcef4741316c43cd86", + "mean": -0.03181575611233711, + "std": 7.266689777374268, + "rms": 7.266759395599365, + "max_abs": 1168.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f08a02b2d37adaf7f8660426cb6215bf9e1de6fd06f9edf09a0bd09f6b5d6b4e", + "mean": -0.03817111998796463, + "std": 1.659156322479248, + "rms": 1.6595953702926636, + "max_abs": 67.0 + }, + "full_input": { + "shape": [ + 115, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c579920ada9aaf0656ff6dbf6c4f18355f1d309ee50ef17ea0dbb930d1783896", + "mean": -0.029225878417491913, + "std": 6.770190238952637, + "rms": 6.770252704620361, + "max_abs": 1168.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "06e939c3942b0572651c5a59f6330e2d5cd740730509013552f103cbce22cf44", + "mean": -0.0385914109647274, + "std": 1.6598604917526245, + "rms": 1.6603089570999146, + "max_abs": 66.5 + }, + "full_input": { + "shape": [ + 99, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "924585784a56b11786431fdfd559deba6d368c2a7e7a2a6c8a884e97728cfcca", + "mean": -0.032446518540382385, + "std": 7.269962310791016, + "rms": 7.270034313201904, + "max_abs": 1168.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d53f3956619e5236f007b964cd40eea4b8636accec251f379263891dbdce24cf", + "mean": -0.03875088319182396, + "std": 1.6705801486968994, + "rms": 1.6710295677185059, + "max_abs": 67.0 + }, + "full_input": { + "shape": [ + 115, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4dba48d930a186e37712659ec0ad6954f65ffeb3591f46a69283071947465f0d", + "mean": -0.02926131896674633, + "std": 6.773331165313721, + "rms": 6.773393630981445, + "max_abs": 1168.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d212c6630a4c67f0744d1b7841cd509db1416a34df51f2007844a7989a2d6995", + "mean": -0.03835552558302879, + "std": 1.6612485647201538, + "rms": 1.6616913080215454, + "max_abs": 66.5 + }, + "full_input": { + "shape": [ + 99, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "55ae649e63945c706e96a5fd4edda022ce064af8ce1ca4380e172dad63f39f9a", + "mean": -0.03222387284040451, + "std": 7.269031047821045, + "rms": 7.269102096557617, + "max_abs": 1168.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bf67b03282e7a50d333289f2ef009c10e9980fabe7c80df5eea89fff5630ee22", + "mean": -0.039822470396757126, + "std": 1.679750919342041, + "rms": 1.680222988128662, + "max_abs": 67.0 + }, + "full_input": { + "shape": [ + 115, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "75680cefecd978c7b8680540bc7a4f17c3a59d32f978cd78e9a4c49d397756e6", + "mean": -0.03001118078827858, + "std": 6.77340841293335, + "rms": 6.773474216461182, + "max_abs": 1168.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9949469566345215, + "min_cosine_similarity": 0.9838773608207703, + "mean_relative_l2": 0.09751801937818527, + "max_abs_delta": 1.625 + }, + "system_bos": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9930881857872009, + "min_cosine_similarity": 0.9660959243774414, + "mean_relative_l2": 0.11500309407711029, + "max_abs_delta": 3.5 + }, + "system_x": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9850957989692688, + "min_cosine_similarity": 0.9112297892570496, + "mean_relative_l2": 0.16423870623111725, + "max_abs_delta": 5.25 + }, + "system_period": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9851037859916687, + "min_cosine_similarity": 0.9454521536827087, + "mean_relative_l2": 0.16720327734947205, + "max_abs_delta": 5.25 + }, + "bos_at_s0": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9901185035705566, + "min_cosine_similarity": 0.9686002135276794, + "mean_relative_l2": 0.1370219886302948, + "max_abs_delta": 2.5 + }, + "bos_at_s1": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9884941577911377, + "min_cosine_similarity": 0.9606178998947144, + "mean_relative_l2": 0.14661194384098053, + "max_abs_delta": 5.75 + }, + "x_at_s0": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9873562455177307, + "min_cosine_similarity": 0.9452468156814575, + "mean_relative_l2": 0.15383800864219666, + "max_abs_delta": 3.25 + }, + "x_at_s1": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9811278581619263, + "min_cosine_similarity": 0.9425418376922607, + "mean_relative_l2": 0.18825814127922058, + "max_abs_delta": 4.25 + }, + "period_at_s0": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9857648015022278, + "min_cosine_similarity": 0.9362159967422485, + "mean_relative_l2": 0.16255536675453186, + "max_abs_delta": 4.5 + }, + "period_at_s1": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.981427788734436, + "min_cosine_similarity": 0.9377365708351135, + "mean_relative_l2": 0.1890651434659958, + "max_abs_delta": 7.5 + } + } + }, + "layer_23": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ed0b61835d91dd88d390c64c7550b4aeb44e4a624b9429c33cfa011473b2cf08", + "mean": -0.051823005080223083, + "std": 2.1123499870300293, + "rms": 2.112985610961914, + "max_abs": 90.0 + }, + "full_input": { + "shape": [ + 99, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bcbed068d1c76bc653f0a76c2ef4435e95872a11adaeda49044b282c0817dcbe", + "mean": -0.05352100357413292, + "std": 8.6414794921875, + "rms": 8.641644477844238, + "max_abs": 1160.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "55824a60f57a42a3b828e287af802e8b1a5dd3a455e4d13796d6627003e689e0", + "mean": -0.052035581320524216, + "std": 2.1205735206604004, + "rms": 2.1212117671966553, + "max_abs": 89.5 + }, + "full_input": { + "shape": [ + 115, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "de045091f794550a1c74745fe647a73ce21621f3f48eb1d79df90efd3bee2d1f", + "mean": -0.04834544658660889, + "std": 8.286530494689941, + "rms": 8.28667163848877, + "max_abs": 1160.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "750d7d4b1964541abbce2f85f0ef72ed35dbf63adb88482255438ee43226b6da", + "mean": -0.051093924790620804, + "std": 2.1108713150024414, + "rms": 2.1114895343780518, + "max_abs": 89.5 + }, + "full_input": { + "shape": [ + 99, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "662fc633501ab1e84506558d0b4abb7f110d4dfa4312275fc15fbd29d863faa1", + "mean": -0.04191743582487106, + "std": 7.343480110168457, + "rms": 7.343599796295166, + "max_abs": 1160.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3ad93aa6b735ef054b39b297bebb5e91affc0194807d79b74a9f196d9514a9e8", + "mean": -0.051238782703876495, + "std": 2.1191704273223877, + "rms": 2.1197898387908936, + "max_abs": 90.5 + }, + "full_input": { + "shape": [ + 115, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7f61356a7ad1a42c6df78a41a9f117fb212649a783b2563ba52c8c68b0f479fe", + "mean": -0.036584481596946716, + "std": 6.8594651222229, + "rms": 6.859562397003174, + "max_abs": 1160.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ea7d6db9ce3749e286004ea99c148107f3f69263bc9f8caee7d9faf90e91f68f", + "mean": -0.05180376023054123, + "std": 2.1230955123901367, + "rms": 2.123727560043335, + "max_abs": 90.0 + }, + "full_input": { + "shape": [ + 99, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b587e606fa5f82c47f80f931de2eb685141e198db8a00b0229037aa3b286feb5", + "mean": -0.0421593151986599, + "std": 7.3492817878723145, + "rms": 7.34940242767334, + "max_abs": 1160.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bceaaaa6ceb8b71be6aa9c7f49f0f8a8dd56e7b63360cf6686856649a0d57bde", + "mean": -0.05160566791892052, + "std": 2.1290271282196045, + "rms": 2.129652500152588, + "max_abs": 91.0 + }, + "full_input": { + "shape": [ + 115, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5716dfe92f3f852215d8f6885817a9579dc66a3fad8244d34ac94123bd1ebba9", + "mean": -0.036286577582359314, + "std": 6.864160060882568, + "rms": 6.864255905151367, + "max_abs": 1160.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7370b91c27616a73b79eb8674687d9b0ff2572a5f68c7cff61eaa38e109f4772", + "mean": -0.05182395130395889, + "std": 2.1254656314849854, + "rms": 2.1260972023010254, + "max_abs": 90.0 + }, + "full_input": { + "shape": [ + 99, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7fd73810ca521436c9b2e0ec9dfa077a662c28c42cfc85b9fec10b574fc38c2d", + "mean": -0.04244089499115944, + "std": 7.347613334655762, + "rms": 7.34773588180542, + "max_abs": 1160.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "51b5bab427d1d3280d34a890f16856c80aa865351c766f527e94dfad5492efbe", + "mean": -0.05275975167751312, + "std": 2.141390562057495, + "rms": 2.142040252685547, + "max_abs": 90.5 + }, + "full_input": { + "shape": [ + 115, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9606b1e6fba473be2b22db0eda6c96328ead54abad1806efc88e35a4e88c964e", + "mean": -0.037248753011226654, + "std": 6.8642988204956055, + "rms": 6.864398956298828, + "max_abs": 1160.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.995980441570282, + "min_cosine_similarity": 0.9876437187194824, + "mean_relative_l2": 0.08730696141719818, + "max_abs_delta": 2.5 + }, + "system_bos": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9946300387382507, + "min_cosine_similarity": 0.9794257283210754, + "mean_relative_l2": 0.10202499479055405, + "max_abs_delta": 5.5 + }, + "system_x": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9882490634918213, + "min_cosine_similarity": 0.9376556277275085, + "mean_relative_l2": 0.14624209702014923, + "max_abs_delta": 7.25 + }, + "system_period": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9884039163589478, + "min_cosine_similarity": 0.9612076282501221, + "mean_relative_l2": 0.1481250375509262, + "max_abs_delta": 8.5 + }, + "bos_at_s0": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.992239773273468, + "min_cosine_similarity": 0.9751503467559814, + "mean_relative_l2": 0.12199299782514572, + "max_abs_delta": 4.0 + }, + "bos_at_s1": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9911356568336487, + "min_cosine_similarity": 0.9750470519065857, + "mean_relative_l2": 0.12961910665035248, + "max_abs_delta": 5.5 + }, + "x_at_s0": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9898965954780579, + "min_cosine_similarity": 0.9610384106636047, + "mean_relative_l2": 0.13823823630809784, + "max_abs_delta": 4.5 + }, + "x_at_s1": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9851387739181519, + "min_cosine_similarity": 0.9576335549354553, + "mean_relative_l2": 0.1677010953426361, + "max_abs_delta": 6.0 + }, + "period_at_s0": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9887826442718506, + "min_cosine_similarity": 0.9564186930656433, + "mean_relative_l2": 0.1452340930700302, + "max_abs_delta": 6.0 + }, + "period_at_s1": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9853689670562744, + "min_cosine_similarity": 0.9558547139167786, + "mean_relative_l2": 0.16852030158042908, + "max_abs_delta": 9.5 + } + } + }, + "layer_24": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f315ec1b98c6db7c74d358699eefab6558467f3202c70b9077ebb896ae6a6ba5", + "mean": -0.06472309678792953, + "std": 2.585435152053833, + "rms": 2.586245059967041, + "max_abs": 112.0 + }, + "full_input": { + "shape": [ + 99, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "0c34d438ad9728e768f626331e869d328a0cd77b98cb21531064b5b7e85a2e4b", + "mean": -0.06505411118268967, + "std": 8.215182304382324, + "rms": 8.21544075012207, + "max_abs": 1008.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "4810ae92b9a66995ac95f9eed6c724f0c61130a5c43472216124897b1c50f963", + "mean": -0.0646897479891777, + "std": 2.5931355953216553, + "rms": 2.593942403793335, + "max_abs": 112.0 + }, + "full_input": { + "shape": [ + 115, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8e0069d45d36b5da8653dcf304fba1e2d9c64e9173f34c6fe884c08955fb841a", + "mean": -0.058060016483068466, + "std": 8.130123138427734, + "rms": 8.130331039428711, + "max_abs": 1120.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "09346f5cad99c70719b3e4ccb14b4da64d45174d6e5d1bdfff61da4e4c0855b1", + "mean": -0.06372151523828506, + "std": 2.5851011276245117, + "rms": 2.585886240005493, + "max_abs": 112.5 + }, + "full_input": { + "shape": [ + 99, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3537d81ff9705902418ec67347afcd9cc04ebb23e434f6b84cda71a92ce425cd", + "mean": -0.05168536305427551, + "std": 5.39129114151001, + "rms": 5.391538619995117, + "max_abs": 840.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6322021140586e9d97a10a01b51b64cf8e1028b15f86f3c4992f4f88fd616b84", + "mean": -0.06394704431295395, + "std": 2.5951693058013916, + "rms": 2.595957040786743, + "max_abs": 113.0 + }, + "full_input": { + "shape": [ + 115, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f46794a1da162d7a6a5c18548361caf8f1ba0af3f8a983d34ee1824535bf7b47", + "mean": -0.044736139476299286, + "std": 5.116901874542236, + "rms": 5.117097854614258, + "max_abs": 840.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "66a77d9f49b5290a72f6786e8aee4e1cc95d176bc968f02f1f84ce5707e5214a", + "mean": -0.063973568379879, + "std": 2.601707696914673, + "rms": 2.60249400138855, + "max_abs": 112.5 + }, + "full_input": { + "shape": [ + 99, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6469ef8ae5103b5dba4e52d31154ee792a04c4ea713910f2013b06e28eafb3fa", + "mean": -0.05166963115334511, + "std": 5.402740478515625, + "rms": 5.402987480163574, + "max_abs": 840.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fd954c82561d2da5a7b3a2e69400a368c3cb624d5245c34a61166c49ba95666f", + "mean": -0.0631861463189125, + "std": 2.6072518825531006, + "rms": 2.6080174446105957, + "max_abs": 112.5 + }, + "full_input": { + "shape": [ + 115, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c0a9e801d064b2fc752efc469c02c371d19eea483b8af82ba6fb605d0e1fcffb", + "mean": -0.04390079528093338, + "std": 5.125281810760498, + "rms": 5.12546968460083, + "max_abs": 840.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8178bb73268a553da7098f1ed76c456b299fd89c5870361c2d2ed714efb447d8", + "mean": -0.06373538821935654, + "std": 2.605121612548828, + "rms": 2.6059012413024902, + "max_abs": 113.0 + }, + "full_input": { + "shape": [ + 99, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "58416d744fdeab6cdd15229dd30f47ddd3849070eda49cf39f2846cda5b90bbb", + "mean": -0.051589999347925186, + "std": 5.400728702545166, + "rms": 5.400975227355957, + "max_abs": 840.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "c06601c7ac912f44f9e73cc8a8c3b15b88d1ccd7863ffef6b598e3e978486fcc", + "mean": -0.0640462264418602, + "std": 2.6213672161102295, + "rms": 2.622149705886841, + "max_abs": 112.0 + }, + "full_input": { + "shape": [ + 115, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9365e7a9454f1c252594741259fdd62beae7b6c45d99f98635973ff28d4a5404", + "mean": -0.044620081782341, + "std": 5.125687122344971, + "rms": 5.125881195068359, + "max_abs": 840.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9966511130332947, + "min_cosine_similarity": 0.9903623461723328, + "mean_relative_l2": 0.07949578016996384, + "max_abs_delta": 3.5 + }, + "system_bos": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9954797625541687, + "min_cosine_similarity": 0.9805526733398438, + "mean_relative_l2": 0.09336718916893005, + "max_abs_delta": 6.5 + }, + "system_x": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9902645945549011, + "min_cosine_similarity": 0.9536605477333069, + "mean_relative_l2": 0.1329655945301056, + "max_abs_delta": 7.0 + }, + "system_period": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9905291199684143, + "min_cosine_similarity": 0.968738317489624, + "mean_relative_l2": 0.13383497297763824, + "max_abs_delta": 8.5 + }, + "bos_at_s0": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9935855269432068, + "min_cosine_similarity": 0.9779096245765686, + "mean_relative_l2": 0.11076311022043228, + "max_abs_delta": 5.0 + }, + "bos_at_s1": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9926949739456177, + "min_cosine_similarity": 0.9784682989120483, + "mean_relative_l2": 0.11736082285642624, + "max_abs_delta": 6.0 + }, + "x_at_s0": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9915700554847717, + "min_cosine_similarity": 0.9643250703811646, + "mean_relative_l2": 0.12590192258358002, + "max_abs_delta": 5.5 + }, + "x_at_s1": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9874781966209412, + "min_cosine_similarity": 0.958655595779419, + "mean_relative_l2": 0.15357771515846252, + "max_abs_delta": 7.0 + }, + "period_at_s0": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9907274842262268, + "min_cosine_similarity": 0.9612763524055481, + "mean_relative_l2": 0.13190555572509766, + "max_abs_delta": 5.0 + }, + "period_at_s1": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9878163933753967, + "min_cosine_similarity": 0.9573026299476624, + "mean_relative_l2": 0.15367749333381653, + "max_abs_delta": 9.5 + } + } + }, + "layer_25": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fd90c979a91480c23b8d5adce098e87f89ca0d59ba9761fc75581b53f61a14f8", + "mean": -0.11440178006887436, + "std": 3.500462770462036, + "rms": 3.5023317337036133, + "max_abs": 162.0 + }, + "full_input": { + "shape": [ + 99, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "113ccab07bda8d69af3ffaaf493544c682114d10da51d7868e2cc1ec9fd41471", + "mean": -0.10596371442079544, + "std": 6.656288146972656, + "rms": 6.657131195068359, + "max_abs": 872.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f5806c8baf40a5e8b849531a9c996e744bc4d761c859d1b0606393dc961cc9e4", + "mean": -0.11251749843358994, + "std": 3.5059428215026855, + "rms": 3.5077478885650635, + "max_abs": 162.0 + }, + "full_input": { + "shape": [ + 115, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d504c284d88a7b8ced5ab96c946106c779bf4d09bcaa5a80131705f967c80f7d", + "mean": -0.09398491680622101, + "std": 6.775187015533447, + "rms": 6.775838851928711, + "max_abs": 984.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ca9674e9f5135bfd6c0de0234dee4c2f59a3bf3b7c545e439e4e23ac0066440f", + "mean": -0.11373396217823029, + "std": 3.4970390796661377, + "rms": 3.4988880157470703, + "max_abs": 161.0 + }, + "full_input": { + "shape": [ + 99, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3d9ae18eeab305d6a78481322b810a97f9880dd6a849f217478ae6409c7437a6", + "mean": -0.09178957343101501, + "std": 3.709077835083008, + "rms": 3.7102131843566895, + "max_abs": 248.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "42d9c2e24898927b537cdceb107284838ae027b42286fb8612d295883a404368", + "mean": -0.11255799233913422, + "std": 3.5079524517059326, + "rms": 3.5097577571868896, + "max_abs": 161.0 + }, + "full_input": { + "shape": [ + 115, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "918f2ba7d0441e7a2adf540d9d0a7625497818c0451ee35112871c2041a4ad7c", + "mean": -0.08018266409635544, + "std": 3.7215657234191895, + "rms": 3.722429037094116, + "max_abs": 248.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "167c4fcde2c382c92133cbcc95344b70e3812ba0882ef47af6abc5be0844035e", + "mean": -0.11402515321969986, + "std": 3.5154223442077637, + "rms": 3.517271041870117, + "max_abs": 160.0 + }, + "full_input": { + "shape": [ + 99, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "b9b3d37e4139c8151c890964b17782c323fbba5a0933402d04d4be0feeab4a5b", + "mean": -0.09224779158830643, + "std": 3.7378780841827393, + "rms": 3.739016056060791, + "max_abs": 248.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6fc6deff9b2658dffc725937ba306e50ef9cd6b1af3416cd0bc62e7e4ecb361b", + "mean": -0.10956305265426636, + "std": 3.5132808685302734, + "rms": 3.514988899230957, + "max_abs": 160.0 + }, + "full_input": { + "shape": [ + 115, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "62a271a421b6313db65a2e11eb39f9ccb88281a8d3c518133c499ca08335eeec", + "mean": -0.07798965275287628, + "std": 3.7357559204101562, + "rms": 3.736569881439209, + "max_abs": 248.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "fe0f6a5bbddbb2c5bec15f39938108554ff4e3580c1af3cf607b069dc59fa580", + "mean": -0.11362507194280624, + "std": 3.5221643447875977, + "rms": 3.5239968299865723, + "max_abs": 161.0 + }, + "full_input": { + "shape": [ + 99, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "e73667451904c65165f2b815004e21d0675e4dad0486ba718833bc0e614279ed", + "mean": -0.09175468981266022, + "std": 3.7336459159851074, + "rms": 3.7347731590270996, + "max_abs": 248.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7729a39b629784c1fe1f2d6d3714887e59d8905d7a93203f793a3afa30de8390", + "mean": -0.11096212267875671, + "std": 3.5339508056640625, + "rms": 3.5356922149658203, + "max_abs": 161.0 + }, + "full_input": { + "shape": [ + 115, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6e2469b25a7523065db0b5ebb98b1eed8aa345a3c66bc8c3d6816bf0d913472e", + "mean": -0.07897379249334335, + "std": 3.736872434616089, + "rms": 3.7377068996429443, + "max_abs": 248.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9976660013198853, + "min_cosine_similarity": 0.9923391938209534, + "mean_relative_l2": 0.06647969037294388, + "max_abs_delta": 7.0 + }, + "system_bos": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9969143271446228, + "min_cosine_similarity": 0.9872016310691833, + "mean_relative_l2": 0.07767638564109802, + "max_abs_delta": 9.625 + }, + "system_x": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9929038286209106, + "min_cosine_similarity": 0.9667957425117493, + "mean_relative_l2": 0.11358927190303802, + "max_abs_delta": 21.5 + }, + "system_period": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9932626485824585, + "min_cosine_similarity": 0.9775413274765015, + "mean_relative_l2": 0.11322104930877686, + "max_abs_delta": 13.0 + }, + "bos_at_s0": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9956591725349426, + "min_cosine_similarity": 0.9851791262626648, + "mean_relative_l2": 0.09142835438251495, + "max_abs_delta": 8.0 + }, + "bos_at_s1": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9950248003005981, + "min_cosine_similarity": 0.9855802655220032, + "mean_relative_l2": 0.09720420092344284, + "max_abs_delta": 9.0 + }, + "x_at_s0": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9941982626914978, + "min_cosine_similarity": 0.9757004976272583, + "mean_relative_l2": 0.10449989885091782, + "max_abs_delta": 8.5 + }, + "x_at_s1": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9912033081054688, + "min_cosine_similarity": 0.964396595954895, + "mean_relative_l2": 0.12892486155033112, + "max_abs_delta": 11.5 + }, + "period_at_s0": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9937149286270142, + "min_cosine_similarity": 0.9764306545257568, + "mean_relative_l2": 0.10868118703365326, + "max_abs_delta": 6.5 + }, + "period_at_s1": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9915468096733093, + "min_cosine_similarity": 0.9630809426307678, + "mean_relative_l2": 0.12825635075569153, + "max_abs_delta": 15.0 + } + } + }, + "layer_26": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8e7306bd1f8fb81cd477b9610a6587b25c9a3b0ac109bbf79278f141f948abc2", + "mean": -0.16957537829875946, + "std": 4.100724220275879, + "rms": 4.104228973388672, + "max_abs": 239.0 + }, + "full_input": { + "shape": [ + 99, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "232852eb2b35f44f4b6881b369a1b0682c958ea15edd011d3fa1564e4f0d5d58", + "mean": -0.15712036192417145, + "std": 6.9658637046813965, + "rms": 6.967634677886963, + "max_abs": 840.0 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ff8340e333206359cfe9688411f30f29ea714944a2e346ceb75b2631921c368f", + "mean": -0.16436314582824707, + "std": 4.044479846954346, + "rms": 4.047818183898926, + "max_abs": 240.0 + }, + "full_input": { + "shape": [ + 115, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "8ce2ff83bf94fd6c644ac062d478112073855f2e06c75dafa214810656c88b32", + "mean": -0.13149113953113556, + "std": 7.087073802947998, + "rms": 7.088293552398682, + "max_abs": 868.0 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "79eb3318632b0d15dce354ba23869575a1c953b76b0d75cdfc3320ba8ee393f0", + "mean": -0.16873157024383545, + "std": 4.084161281585693, + "rms": 4.087645053863525, + "max_abs": 231.0 + }, + "full_input": { + "shape": [ + 99, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "d696c1b81ed89c53f97d2b44b0b5ee79426154803335c8a109194a0d0e7f680c", + "mean": -0.14036060869693756, + "std": 4.749821186065674, + "rms": 4.751894950866699, + "max_abs": 776.0 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "96502eb4c810da519603a79ad9853678c6357dd6c7d164895cf7e79949ee1ca3", + "mean": -0.1636793613433838, + "std": 4.024148941040039, + "rms": 4.0274763107299805, + "max_abs": 231.0 + }, + "full_input": { + "shape": [ + 115, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ea9279af4bd1f212519a70906a1385cb2a35458e65cff2b85f25e700a9c472f7", + "mean": -0.11525183171033859, + "std": 4.818541526794434, + "rms": 4.819919586181641, + "max_abs": 776.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ba6f1510c127a43d012fb1623674435dcb1a402e9e27091c5fb1389d06f35ffb", + "mean": -0.17031189799308777, + "std": 4.139953136444092, + "rms": 4.1434550285339355, + "max_abs": 230.0 + }, + "full_input": { + "shape": [ + 99, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "cb57d787125133f688fa9c97bb8e1b952feec73a780c1847488f20e9bc3bd4d8", + "mean": -0.1420997977256775, + "std": 4.8075432777404785, + "rms": 4.809642791748047, + "max_abs": 776.0 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "f2104c2b38b3a885095ab8c389b576ecf2c5329f41a71da596aae0d585effac9", + "mean": -0.15476128458976746, + "std": 3.9231584072113037, + "rms": 3.9262096881866455, + "max_abs": 222.0 + }, + "full_input": { + "shape": [ + 115, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "00babe11d6a5bc37165eafb0ac66bda8d4b1220dda2b7dcedb3a6059e9464259", + "mean": -0.10873325169086456, + "std": 4.771874904632568, + "rms": 4.773113250732422, + "max_abs": 776.0 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3447b6803158110a9a0a31bded834d6badaa675f9fc04e819c8046ca3b21bb23", + "mean": -0.16909241676330566, + "std": 4.134047031402588, + "rms": 4.1375041007995605, + "max_abs": 235.0 + }, + "full_input": { + "shape": [ + 99, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "454af86e82d4eff775c7c8fe07944d4e5a1045423c8f88c26d6f55d552d78fb5", + "mean": -0.14058354496955872, + "std": 4.7852559089660645, + "rms": 4.787320613861084, + "max_abs": 776.0 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "3b107b32953b521fcc29b07659158c3690654514586d879049e66d1b938cfbbd", + "mean": -0.15648019313812256, + "std": 3.931830883026123, + "rms": 3.934943675994873, + "max_abs": 216.0 + }, + "full_input": { + "shape": [ + 115, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "16d4e03e321ef6bd9b76a55a03b581329a549b023564fed94b078eebd04d4e16", + "mean": -0.10946402698755264, + "std": 4.750967025756836, + "rms": 4.752227783203125, + "max_abs": 776.0 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9975519180297852, + "min_cosine_similarity": 0.9920830726623535, + "mean_relative_l2": 0.07157180458307266, + "max_abs_delta": 38.0 + }, + "system_bos": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.996811032295227, + "min_cosine_similarity": 0.9814130067825317, + "mean_relative_l2": 0.0815458819270134, + "max_abs_delta": 22.0 + }, + "system_x": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9907454252243042, + "min_cosine_similarity": 0.9132583141326904, + "mean_relative_l2": 0.13623680174350739, + "max_abs_delta": 47.375 + }, + "system_period": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9917866587638855, + "min_cosine_similarity": 0.9620650410652161, + "mean_relative_l2": 0.13352690637111664, + "max_abs_delta": 45.0 + }, + "bos_at_s0": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9958997964859009, + "min_cosine_similarity": 0.9854451417922974, + "mean_relative_l2": 0.09147974103689194, + "max_abs_delta": 17.5 + }, + "bos_at_s1": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9950407147407532, + "min_cosine_similarity": 0.986112117767334, + "mean_relative_l2": 0.10091426223516464, + "max_abs_delta": 25.0 + }, + "x_at_s0": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.994874894618988, + "min_cosine_similarity": 0.9858764410018921, + "mean_relative_l2": 0.10426486283540726, + "max_abs_delta": 35.0 + }, + "x_at_s1": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.99017333984375, + "min_cosine_similarity": 0.9555208086967468, + "mean_relative_l2": 0.14176392555236816, + "max_abs_delta": 33.0 + }, + "period_at_s0": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9943637251853943, + "min_cosine_similarity": 0.9802983403205872, + "mean_relative_l2": 0.10753737390041351, + "max_abs_delta": 35.0 + }, + "period_at_s1": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9910306334495544, + "min_cosine_similarity": 0.9730197787284851, + "mean_relative_l2": 0.1383637636899948, + "max_abs_delta": 35.5 + } + } + }, + "final_norm": { + "conditions": { + "s0_eos": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "32a74db12d10f49b7052d1a0a369da383dc3bad098f8f00371bf8c2179f64049", + "mean": -0.02856164053082466, + "std": 0.7016959190368652, + "rms": 0.7022769451141357, + "max_abs": 17.25 + }, + "full_input": { + "shape": [ + 99, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "df26741c61de5602931b5769b5ff34a1f4bf740382eb2013f8294622eec9f14d", + "mean": -0.023440778255462646, + "std": 0.6831235885620117, + "rms": 0.6835256218910217, + "max_abs": 22.25 + } + }, + "s1_eos": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "672daa0f348cede6baee25c94feaba00bdd7f580d0687f845a35be5db2b71b5b", + "mean": -0.028065796941518784, + "std": 0.7000617384910583, + "rms": 0.7006241083145142, + "max_abs": 17.25 + }, + "full_input": { + "shape": [ + 115, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "bbba1c12117fae1bb53469d70e298470fbfea2c8ad42093a04295e6b64b3519d", + "mean": -0.019133737310767174, + "std": 0.6577872633934021, + "rms": 0.6580654978752136, + "max_abs": 21.125 + } + }, + "s0_bos": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "9a8ea3b34f5ed1be043e4295ef399f7cec733f5a6d9630f1fde305dbfff9bdbb", + "mean": -0.028575558215379715, + "std": 0.7088174223899841, + "rms": 0.7093932032585144, + "max_abs": 17.75 + }, + "full_input": { + "shape": [ + 99, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "68e5f43943fdacffec6ffc41e599dbf4a32e6ffcc74f2676a7931152fc15c856", + "mean": -0.023172171786427498, + "std": 0.6894397139549255, + "rms": 0.6898289918899536, + "max_abs": 22.875 + } + }, + "s1_bos": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "ceb8255280ef651a00de7af9a13567f5243354b030043d2a4f8f436053a8f425", + "mean": -0.028107210993766785, + "std": 0.7103091478347778, + "rms": 0.7108650803565979, + "max_abs": 17.5 + }, + "full_input": { + "shape": [ + 115, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "678430ee6a84dbc9f94fc23ee46346748e7b4a1b73cba5f8a26e6776c1e389ba", + "mean": -0.018994661048054695, + "std": 0.6666961312294006, + "rms": 0.6669666767120361, + "max_abs": 23.0 + } + }, + "s0_x": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "03cb37e1eb669c8525e59038de5cbc354adbf0bf95f796a03baf34d6fdf65768", + "mean": -0.028230441734194756, + "std": 0.6980166435241699, + "rms": 0.6985872983932495, + "max_abs": 17.5 + }, + "full_input": { + "shape": [ + 99, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "add5c616dbd68e1c88e5044f5918afd34052f88f30e5283348c12c1d88d9edbb", + "mean": -0.022853828966617584, + "std": 0.6792325377464294, + "rms": 0.6796169281005859, + "max_abs": 22.75 + } + }, + "s1_x": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "7e96b0199d23dbb28ec6477ab69984c671b344e4b45eec3342513c73ece5143b", + "mean": -0.026942403987050056, + "std": 0.691618025302887, + "rms": 0.6921425461769104, + "max_abs": 17.75 + }, + "full_input": { + "shape": [ + 115, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "461252e9e1938f5ecc3ff658ba8fead39e3e740da1b6c5857429ca1bf105bc5a", + "mean": -0.017975881695747375, + "std": 0.6487953066825867, + "rms": 0.6490442156791687, + "max_abs": 19.375 + } + }, + "s0_period": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "6f4b40e29a4166b8fe8faaef7e1cda7ebb4e0ad5bc7162f1373a3c01d621ce8e", + "mean": -0.02821866236627102, + "std": 0.7031519412994385, + "rms": 0.7037179470062256, + "max_abs": 17.625 + }, + "full_input": { + "shape": [ + 99, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "1e16385cc8544d500e926f12b19ae41e5ee432085e553cb297e7d95eae43ad58", + "mean": -0.022899704053997993, + "std": 0.6841028928756714, + "rms": 0.6844860315322876, + "max_abs": 21.875 + } + }, + "s1_period": { + "target_content": { + "shape": [ + 74, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "5ea95db5676129c6cddfcc206e1d93e3604146576cf4b02162e67e686e75ef27", + "mean": -0.02732645906507969, + "std": 0.6995732188224792, + "rms": 0.700106680393219, + "max_abs": 17.75 + }, + "full_input": { + "shape": [ + 115, + 2048 + ], + "dtype": "torch.bfloat16", + "tensor_sha256": "09d2a23c93749b703fa39915cfee8b2d641ef600621004e1ee5a5f542a5e35ee", + "mean": -0.018314272165298462, + "std": 0.6574016809463501, + "rms": 0.657656729221344, + "max_abs": 21.25 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9969813227653503, + "min_cosine_similarity": 0.9858332276344299, + "mean_relative_l2": 0.07400375604629517, + "max_abs_delta": 1.63671875 + }, + "system_bos": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.996337890625, + "min_cosine_similarity": 0.9792537093162537, + "mean_relative_l2": 0.08206132054328918, + "max_abs_delta": 1.8125 + }, + "system_x": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9887406826019287, + "min_cosine_similarity": 0.8927972316741943, + "mean_relative_l2": 0.1360447257757187, + "max_abs_delta": 4.6982421875 + }, + "system_period": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9898907542228699, + "min_cosine_similarity": 0.9520689845085144, + "mean_relative_l2": 0.13228674232959747, + "max_abs_delta": 2.83984375 + }, + "bos_at_s0": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9950674176216125, + "min_cosine_similarity": 0.9741902351379395, + "mean_relative_l2": 0.09636791795492172, + "max_abs_delta": 1.75 + }, + "bos_at_s1": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9942091107368469, + "min_cosine_similarity": 0.97857666015625, + "mean_relative_l2": 0.1048063263297081, + "max_abs_delta": 1.875 + }, + "x_at_s0": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9935846328735352, + "min_cosine_similarity": 0.9700896739959717, + "mean_relative_l2": 0.10707827657461166, + "max_abs_delta": 1.75 + }, + "x_at_s1": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9879551529884338, + "min_cosine_similarity": 0.9430524110794067, + "mean_relative_l2": 0.14486540853977203, + "max_abs_delta": 4.1875 + }, + "period_at_s0": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9932805895805359, + "min_cosine_similarity": 0.9696522951126099, + "mean_relative_l2": 0.11032961308956146, + "max_abs_delta": 1.5 + }, + "period_at_s1": { + "tokens": 74, + "exact_hidden_rows": 0, + "mean_cosine_similarity": 0.9894317388534546, + "min_cosine_similarity": 0.9423543810844421, + "mean_relative_l2": 0.13829179108142853, + "max_abs_delta": 2.5 + } + } + } + }, + "router_layers": { + "layer_01": { + "layer": 1, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "9f3d3c89108d7044213d0178229e62fe43a19603c3bc0c6398a638a7df785624", + "route_weight_sha256": "db67df2cf306765a7f34c909f1b28579420d79c347439be4c2b91ca5ecc7a970", + "loads": [ + 8, + 4, + 6, + 13, + 7, + 8, + 8, + 8, + 14, + 17, + 1, + 6, + 5, + 12, + 2, + 7, + 5, + 28, + 11, + 7, + 3, + 9, + 3, + 7, + 7, + 4, + 3, + 10, + 7, + 10, + 5, + 4, + 4, + 3, + 14, + 9, + 11, + 11, + 5, + 1, + 6, + 4, + 11, + 14, + 6, + 2, + 5, + 9, + 5, + 0, + 6, + 6, + 2, + 9, + 0, + 5, + 3, + 11, + 3, + 2, + 3, + 6, + 9, + 10 + ], + "weighted_loads": [ + 0.5184715650975704, + 0.1460789404809475, + 0.3802410885691643, + 0.942179586738348, + 0.6609876248985529, + 0.42738200910389423, + 0.3235752657055855, + 0.43137343414127827, + 0.6877897530794144, + 1.5745805762708187, + 0.032496728003025055, + 0.6521507687866688, + 0.1499250866472721, + 0.784782825037837, + 0.09087202325463295, + 0.397134842351079, + 0.24154829420149326, + 1.4478053003549576, + 0.5619842149317265, + 0.362296961247921, + 0.13209817558526993, + 0.8792560957372189, + 0.093886349350214, + 0.3830060735344887, + 0.36681247502565384, + 0.20244381949305534, + 0.08145247586071491, + 0.5531570836901665, + 0.4192014094442129, + 0.619360513985157, + 0.28271945379674435, + 0.29710471257567406, + 0.18111595138907433, + 0.11257559433579445, + 0.6845476571470499, + 0.4506837911903858, + 0.4307691752910614, + 0.42429299652576447, + 0.43085689283907413, + 0.05808278173208237, + 0.267703078687191, + 0.14772474579513073, + 0.7193775288760662, + 0.7486917562782764, + 0.21616407856345177, + 0.09176210314035416, + 0.4024759978055954, + 0.631578715518117, + 0.17945705726742744, + 0.0, + 0.2954965438693762, + 0.550309244543314, + 0.13475530222058296, + 0.6321739796549082, + 0.0, + 0.37296404875814915, + 0.33096931874752045, + 0.3791495729237795, + 0.07617854699492455, + 0.04059304669499397, + 0.15632604621350765, + 0.38358114659786224, + 0.6949822548776865, + 0.8126223310828209 + ], + "unique_experts": 62, + "load_cv": 0.6599983029690942, + "normalized_load_entropy": 0.9504472338364057, + "max_load_share": 0.06306306306306306 + }, + "full_input": { + "tokens": 99, + "top_k": 6, + "decisions": 594, + "ordered_route_sha256": "905d4f18895a58d80b79cd16c3adae9b7f39854dac292d75b252695653a0785c", + "route_weight_sha256": "c3ee377ca96ca1d376688dd26b21bfe8504b5b7a70c1b2669315d34508bf1870", + "loads": [ + 8, + 4, + 8, + 13, + 11, + 9, + 9, + 10, + 31, + 17, + 3, + 6, + 5, + 12, + 3, + 16, + 5, + 30, + 11, + 7, + 6, + 9, + 4, + 7, + 7, + 8, + 16, + 10, + 7, + 10, + 5, + 9, + 6, + 5, + 14, + 9, + 11, + 11, + 5, + 4, + 6, + 15, + 11, + 20, + 7, + 13, + 6, + 9, + 5, + 1, + 10, + 7, + 6, + 9, + 3, + 9, + 6, + 19, + 3, + 14, + 4, + 10, + 10, + 10 + ], + "weighted_loads": [ + 0.5184715650975704, + 0.1460789404809475, + 0.48299041017889977, + 0.942179586738348, + 0.8026641346514225, + 0.5057020876556635, + 0.3853330947458744, + 0.6990053299814463, + 1.6146210562437773, + 1.5745805762708187, + 0.27254775166511536, + 0.6521507687866688, + 0.1499250866472721, + 0.784782825037837, + 0.11357139237225056, + 1.0116007383912802, + 0.24154829420149326, + 1.5889888182282448, + 0.5619842149317265, + 0.362296961247921, + 0.5076054409146309, + 0.8792560957372189, + 0.12417102977633476, + 0.3830060735344887, + 0.36681247502565384, + 0.37165405228734016, + 0.8914365563541651, + 0.5531570836901665, + 0.4192014094442129, + 0.619360513985157, + 0.28271945379674435, + 0.7074414612725377, + 0.2948315441608429, + 0.33590537682175636, + 0.6845476571470499, + 0.4506837911903858, + 0.4307691752910614, + 0.42429299652576447, + 0.43085689283907413, + 0.2900508791208267, + 0.267703078687191, + 0.5789644531905651, + 0.7193775288760662, + 0.9078389637579676, + 1.2005319856107235, + 0.9083506318274885, + 0.48503316193819046, + 0.631578715518117, + 0.17945705726742744, + 0.024928519502282143, + 0.43988884799182415, + 0.5509127181139775, + 0.4029140844941139, + 0.6321739796549082, + 0.0451602530956734, + 0.9045396912842989, + 0.6041419021785259, + 0.8526919484138489, + 0.07617854699492455, + 0.7770821768790483, + 0.24691168777644634, + 0.5836042277514935, + 0.7539655212312937, + 0.8126223310828209 + ], + "unique_experts": 64, + "load_cv": 0.5948743185628002, + "normalized_load_entropy": 0.9633135217440842, + "max_load_share": 0.05218855218855219 + } + }, + "s1_eos": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "3c94999fc5ca13a960d58fc87278e6657ce64b26cb3ee9d4ac567c91179471ef", + "route_weight_sha256": "b170c6235df21a451601c991c7267661c5e28e35994a936f5eb863f3c6a558f2", + "loads": [ + 8, + 4, + 6, + 14, + 6, + 8, + 5, + 8, + 10, + 17, + 0, + 6, + 6, + 12, + 2, + 7, + 6, + 25, + 11, + 7, + 3, + 11, + 4, + 7, + 8, + 4, + 1, + 10, + 7, + 11, + 5, + 4, + 5, + 3, + 14, + 10, + 11, + 11, + 6, + 1, + 6, + 4, + 11, + 12, + 8, + 3, + 5, + 9, + 7, + 0, + 7, + 6, + 2, + 10, + 0, + 5, + 3, + 11, + 2, + 1, + 3, + 6, + 9, + 10 + ], + "weighted_loads": [ + 0.5208572670817375, + 0.14658379182219505, + 0.3783279024064541, + 1.018147300928831, + 0.6264522150158882, + 0.42065818421542645, + 0.2265690304338932, + 0.42057048343122005, + 0.5145637728273869, + 1.55914007127285, + 0.0, + 0.647412620484829, + 0.16878460720181465, + 0.8087361622601748, + 0.09044688567519188, + 0.4103099927306175, + 0.26626107282936573, + 1.3107225745916367, + 0.5529784150421619, + 0.3674056604504585, + 0.12964243814349174, + 0.9326061569154263, + 0.1171165183186531, + 0.38447886891663074, + 0.3995654582977295, + 0.20323048904538155, + 0.0272421482950449, + 0.519169382750988, + 0.42863333970308304, + 0.6608399692922831, + 0.2833306025713682, + 0.2952916882932186, + 0.211363784968853, + 0.11024388670921326, + 0.7014237847179174, + 0.4836930222809315, + 0.44004170782864094, + 0.43804210238158703, + 0.4595299307256937, + 0.05774103105068207, + 0.261469466611743, + 0.14634758606553078, + 0.7203879617154598, + 0.7042041309177876, + 0.27462694235146046, + 0.11315382458269596, + 0.4012462869286537, + 0.6503383293747902, + 0.23383868299424648, + 0.0, + 0.3267740998417139, + 0.5418435297906399, + 0.13763339072465897, + 0.6537849269807339, + 0.0, + 0.3763150479644537, + 0.32744625210762024, + 0.38590179942548275, + 0.05254252441227436, + 0.01960713416337967, + 0.1607583686709404, + 0.3887077830731869, + 0.692227179184556, + 0.8148398399353027 + ], + "unique_experts": 61, + "load_cv": 0.6308236512842239, + "normalized_load_entropy": 0.9503158869088355, + "max_load_share": 0.05630630630630631 + }, + "full_input": { + "tokens": 115, + "top_k": 6, + "decisions": 690, + "ordered_route_sha256": "2e2999c7b26cda18ac7f284211de9f19ab126e5f353ce03109c3be5493a4f9cb", + "route_weight_sha256": "dbf2c33a692b6e1e64e4caebac448c644616c87a9327a706db4124656106f235", + "loads": [ + 10, + 4, + 9, + 14, + 13, + 11, + 6, + 12, + 33, + 17, + 5, + 7, + 6, + 13, + 2, + 19, + 6, + 31, + 12, + 8, + 6, + 13, + 8, + 8, + 10, + 9, + 19, + 11, + 7, + 13, + 6, + 11, + 7, + 5, + 14, + 10, + 12, + 12, + 6, + 6, + 6, + 17, + 14, + 20, + 10, + 14, + 6, + 12, + 9, + 1, + 16, + 11, + 7, + 10, + 5, + 9, + 12, + 23, + 4, + 12, + 5, + 12, + 10, + 14 + ], + "weighted_loads": [ + 0.6261258870363235, + 0.14658379182219505, + 0.5440666563808918, + 1.018147300928831, + 1.0024778619408607, + 0.6279789414256811, + 0.2717498764395714, + 0.6779641024768353, + 1.8571525644510984, + 1.55914007127285, + 0.43143366649746895, + 0.7937412485480309, + 0.16878460720181465, + 0.8488032538443804, + 0.09044688567519188, + 1.1132983267307281, + 0.26626107282936573, + 1.5783027596771717, + 0.5923555232584476, + 0.4335077852010727, + 0.4440130330622196, + 1.1373754180967808, + 0.3875189144164324, + 0.4190590772777796, + 0.47154866717755795, + 0.3994798753410578, + 1.2839655485004187, + 0.5612271539866924, + 0.42863333970308304, + 0.8235997799783945, + 0.36957969330251217, + 0.9294391910952982, + 0.3107295371592045, + 0.28761567920446396, + 0.7014237847179174, + 0.4836930222809315, + 0.6984411347657442, + 0.4718318674713373, + 0.4595299307256937, + 0.4090871177613735, + 0.261469466611743, + 0.7386333588510752, + 0.9271857552230358, + 0.9740119408816099, + 1.4168931264430285, + 0.8830523412907496, + 0.48307058960199356, + 0.7331361949909478, + 0.38536895252764225, + 0.025010336190462112, + 0.7595629915595055, + 0.9071643785573542, + 0.47084442153573036, + 0.6537849269807339, + 0.09358464617980644, + 0.8864387925714254, + 0.7595389783382416, + 1.0835676547139883, + 0.1279089469462633, + 0.6908833980560303, + 0.2761706616729498, + 0.7034686487168074, + 0.7512775454670191, + 1.306547850370407 + ], + "unique_experts": 64, + "load_cv": 0.5389667820807841, + "normalized_load_entropy": 0.968289163867599, + "max_load_share": 0.04782608695652174 + } + }, + "s0_bos": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "d42e98d986ff1a69430b879734ee66f6fb69f3c15d7e26d05a15cc3d6d58bcec", + "route_weight_sha256": "b7d8194fccd1fee735bf5f81ebd228bfac1ad8e415845d50e14c12b7865f1915", + "loads": [ + 9, + 4, + 6, + 12, + 6, + 5, + 6, + 8, + 11, + 17, + 0, + 7, + 7, + 12, + 4, + 6, + 3, + 28, + 9, + 5, + 2, + 9, + 4, + 8, + 9, + 4, + 1, + 10, + 7, + 11, + 5, + 4, + 5, + 7, + 16, + 10, + 15, + 9, + 6, + 1, + 6, + 6, + 11, + 12, + 6, + 2, + 5, + 10, + 6, + 0, + 7, + 6, + 2, + 8, + 0, + 5, + 3, + 10, + 1, + 2, + 3, + 7, + 9, + 9 + ], + "weighted_loads": [ + 0.5973089598119259, + 0.13912713155150414, + 0.3878236822783947, + 0.9300229139626026, + 0.5689975637942553, + 0.29397664591670036, + 0.25057816691696644, + 0.42871204763650894, + 0.4505630172789097, + 1.6580618172883987, + 0.0, + 0.6741830706596375, + 0.21382892318069935, + 0.7473568040877581, + 0.1374683417379856, + 0.398696955293417, + 0.18841898068785667, + 1.613925989717245, + 0.41102972999215126, + 0.26013067178428173, + 0.09762656688690186, + 0.8480617590248585, + 0.11814501322805882, + 0.4431711193174124, + 0.4057822860777378, + 0.20395321771502495, + 0.024555165320634842, + 0.49762535095214844, + 0.44797251746058464, + 0.7022599410265684, + 0.26644626446068287, + 0.29654548317193985, + 0.24786482751369476, + 0.3224174529314041, + 0.8001614939421415, + 0.45340802520513535, + 0.5295546893030405, + 0.3302673753350973, + 0.5063825212419033, + 0.05618155375123024, + 0.23603512905538082, + 0.17025945335626602, + 0.712248433381319, + 0.6914761997759342, + 0.20762724243104458, + 0.0837373323738575, + 0.4078952372074127, + 0.6757187098264694, + 0.2019049059599638, + 0.0, + 0.3314249664545059, + 0.5379151590168476, + 0.1318134143948555, + 0.5957624763250351, + 0.0, + 0.3752375040203333, + 0.2837518900632858, + 0.3153688684105873, + 0.03082834742963314, + 0.05283702537417412, + 0.14318532682955265, + 0.39558444544672966, + 0.6825757790356874, + 0.7553513534367085 + ], + "unique_experts": 61, + "load_cv": 0.6639217901943317, + "normalized_load_entropy": 0.9479328172508626, + "max_load_share": 0.06306306306306306 + }, + "full_input": { + "tokens": 99, + "top_k": 6, + "decisions": 594, + "ordered_route_sha256": "d8083eec16cc791c931fc1376be36259af0d84ab885dd789480a9372f5d1c3f6", + "route_weight_sha256": "2a6836281ca090c0aabf8f632ea63636214ae14e120526da93f366f21d31563c", + "loads": [ + 10, + 4, + 8, + 12, + 10, + 6, + 7, + 10, + 27, + 17, + 2, + 8, + 7, + 12, + 5, + 15, + 3, + 31, + 9, + 5, + 5, + 9, + 5, + 8, + 9, + 8, + 14, + 10, + 7, + 11, + 5, + 8, + 7, + 9, + 16, + 10, + 15, + 9, + 6, + 4, + 6, + 17, + 12, + 17, + 6, + 12, + 7, + 10, + 6, + 1, + 11, + 6, + 6, + 8, + 2, + 9, + 7, + 19, + 1, + 13, + 5, + 11, + 10, + 9 + ], + "weighted_loads": [ + 0.6210041157901287, + 0.13912713155150414, + 0.4729020930826664, + 0.9300229139626026, + 0.7109178751707077, + 0.37552570179104805, + 0.31233599595725536, + 0.6884673684835434, + 1.3136277571320534, + 1.6580618172883987, + 0.22474255412817, + 0.6989430245012045, + 0.21382892318069935, + 0.7473568040877581, + 0.1586658675223589, + 1.0131628513336182, + 0.18841898068785667, + 1.7831224910914898, + 0.41102972999215126, + 0.26013067178428173, + 0.4011666476726532, + 0.8480617590248585, + 0.14842969365417957, + 0.4431711193174124, + 0.4057822860777378, + 0.37603896111249924, + 0.8339215144515038, + 0.49762535095214844, + 0.44797251746058464, + 0.7022599410265684, + 0.26644626446068287, + 0.7259337157011032, + 0.359658420085907, + 0.5486467480659485, + 0.8001614939421415, + 0.45340802520513535, + 0.5295546893030405, + 0.3302673753350973, + 0.5063825212419033, + 0.29239853471517563, + 0.23603512905538082, + 0.6042998861521482, + 0.7550968751311302, + 0.8471832443028688, + 0.20762724243104458, + 0.8998254686594009, + 0.5258523877710104, + 0.6757187098264694, + 0.2019049059599638, + 0.021473372355103493, + 0.48197682201862335, + 0.5379151590168476, + 0.3887653388082981, + 0.5957624763250351, + 0.04470905847847462, + 0.9106976930052042, + 0.6242421679198742, + 0.8675353806465864, + 0.03082834742963314, + 0.7545009255409241, + 0.33889362402260303, + 0.6014827527105808, + 0.7388984356075525, + 0.7553513534367085 + ], + "unique_experts": 64, + "load_cv": 0.5734492091813033, + "normalized_load_entropy": 0.9641378034553976, + "max_load_share": 0.05218855218855219 + } + }, + "s1_bos": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "7d23628eef4f3c8fde7ab886d5b8e8497c3eb7bdb3cbe29012cb8175d76bd16e", + "route_weight_sha256": "61d704e048d26372387f72e515d5d626fcc76ee01b17138e1310373ddadf401c", + "loads": [ + 9, + 3, + 5, + 13, + 6, + 7, + 6, + 10, + 10, + 17, + 0, + 8, + 6, + 12, + 2, + 6, + 3, + 26, + 11, + 6, + 2, + 10, + 4, + 9, + 8, + 4, + 6, + 10, + 7, + 11, + 6, + 4, + 5, + 4, + 15, + 10, + 12, + 9, + 6, + 1, + 5, + 7, + 11, + 10, + 9, + 3, + 5, + 9, + 4, + 0, + 7, + 6, + 2, + 9, + 0, + 5, + 3, + 10, + 1, + 1, + 3, + 7, + 9, + 9 + ], + "weighted_loads": [ + 0.580984715372324, + 0.11010079458355904, + 0.3281489685177803, + 0.9888749718666077, + 0.5751431956887245, + 0.3792361579835415, + 0.2374481614679098, + 0.4725205283612013, + 0.4038316700607538, + 1.597978513687849, + 0.0, + 0.7107576206326485, + 0.18600939773023129, + 0.7689963765442371, + 0.0909615270793438, + 0.4064231775701046, + 0.19370786845684052, + 1.3581093233078718, + 0.47621133364737034, + 0.3076180927455425, + 0.09810841828584671, + 0.9145630113780499, + 0.12185140512883663, + 0.44088531471788883, + 0.37624652683734894, + 0.20169411413371563, + 0.1616086047142744, + 0.46549325808882713, + 0.44807969592511654, + 0.6950272247195244, + 0.30345878563821316, + 0.30159690603613853, + 0.21481414884328842, + 0.1638009436428547, + 0.7768271882086992, + 0.4498039744794369, + 0.47194839641451836, + 0.3242196924984455, + 0.49655939266085625, + 0.05776706337928772, + 0.1908878218382597, + 0.22266553156077862, + 0.70249586366117, + 0.6455696318298578, + 0.29616596177220345, + 0.10724260099232197, + 0.4068576693534851, + 0.6663773115724325, + 0.1577491145581007, + 0.0, + 0.33437052369117737, + 0.5325142741203308, + 0.13558252900838852, + 0.6281286925077438, + 0.0, + 0.3689636401832104, + 0.2865850031375885, + 0.3223519027233124, + 0.02674981765449047, + 0.026912592351436615, + 0.13895509578287601, + 0.4007692262530327, + 0.6797614321112633, + 0.7552446648478508 + ], + "unique_experts": 61, + "load_cv": 0.6344159240165136, + "normalized_load_entropy": 0.9503285739655783, + "max_load_share": 0.05855855855855856 + }, + "full_input": { + "tokens": 115, + "top_k": 6, + "decisions": 690, + "ordered_route_sha256": "158d1d0f2b93a474f220587178adf91a89af29004f53752e7abea784d815b497", + "route_weight_sha256": "7a52a5141199aeb52cfdb065d8b5b17f4a9f4fe7851d5dc76ddfd6f012c5ed65", + "loads": [ + 12, + 3, + 8, + 14, + 13, + 10, + 7, + 14, + 32, + 17, + 5, + 10, + 6, + 13, + 2, + 18, + 3, + 32, + 12, + 7, + 5, + 12, + 8, + 10, + 10, + 9, + 25, + 11, + 7, + 13, + 7, + 10, + 7, + 6, + 15, + 10, + 13, + 10, + 6, + 6, + 5, + 20, + 15, + 17, + 10, + 13, + 7, + 11, + 6, + 1, + 16, + 10, + 7, + 9, + 5, + 9, + 13, + 23, + 3, + 11, + 6, + 12, + 10, + 13 + ], + "weighted_loads": [ + 0.7083754725754261, + 0.11010079458355904, + 0.4801960773766041, + 1.0207575783133507, + 0.9500994235277176, + 0.5977626778185368, + 0.282629007473588, + 0.7194133307784796, + 1.6736753918230534, + 1.597978513687849, + 0.4170038141310215, + 0.8811952359974384, + 0.18600939773023129, + 0.8090634681284428, + 0.0909615270793438, + 1.1094115115702152, + 0.19370786845684052, + 1.617672486230731, + 0.515588441863656, + 0.3737202174961567, + 0.3446088433265686, + 1.1193322725594044, + 0.3922538012266159, + 0.47546552307903767, + 0.4482297357171774, + 0.40373924374580383, + 1.4397703688591719, + 0.5075510293245316, + 0.44807969592511654, + 0.8577870354056358, + 0.3897078763693571, + 0.951555859297514, + 0.3083920441567898, + 0.33761170879006386, + 0.7768271882086992, + 0.4498039744794369, + 0.7303478233516216, + 0.3580094575881958, + 0.49655939266085625, + 0.4148232787847519, + 0.1908878218382597, + 0.8186939172446728, + 0.9456636775285006, + 0.8890727665275335, + 0.4493015296757221, + 0.8766796309500933, + 0.5318044163286686, + 0.7488637696951628, + 0.30927938409149647, + 0.021791333332657814, + 0.7781216353178024, + 0.8975297324359417, + 0.4447719007730484, + 0.6281286925077438, + 0.11752146296203136, + 0.8754911161959171, + 0.7712252661585808, + 1.0962362177670002, + 0.10211624018847942, + 0.6635619178414345, + 0.3560425192117691, + 0.6993774101138115, + 0.7351439334452152, + 1.2469526752829552 + ], + "unique_experts": 64, + "load_cv": 0.5616834898634009, + "normalized_load_entropy": 0.9653400528416094, + "max_load_share": 0.0463768115942029 + } + }, + "s0_x": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "20ed0612477fbcb2dae294924098daf42de7ee854141937a056b32bf74d2533d", + "route_weight_sha256": "d62b882048a5a77fa5186e01f850fae52018d427accb518a7b0c95390aedb6bd", + "loads": [ + 9, + 4, + 6, + 11, + 6, + 6, + 8, + 9, + 11, + 17, + 0, + 7, + 7, + 12, + 4, + 5, + 3, + 29, + 11, + 5, + 2, + 11, + 4, + 7, + 9, + 3, + 1, + 10, + 7, + 11, + 5, + 4, + 5, + 6, + 15, + 10, + 11, + 9, + 5, + 1, + 6, + 5, + 11, + 16, + 6, + 2, + 5, + 9, + 6, + 0, + 7, + 6, + 2, + 8, + 0, + 5, + 3, + 10, + 1, + 2, + 3, + 6, + 9, + 10 + ], + "weighted_loads": [ + 0.5992181040346622, + 0.1387584824115038, + 0.3796768821775913, + 0.8553181141614914, + 0.586431885138154, + 0.35718934796750546, + 0.32933214493095875, + 0.4487053696066141, + 0.47328392043709755, + 1.6202298738062382, + 0.0, + 0.6331924796104431, + 0.21554951556026936, + 0.7717335373163223, + 0.13847419060766697, + 0.3283073864877224, + 0.18987080827355385, + 1.688684567809105, + 0.5024574585258961, + 0.25885828025639057, + 0.10077193006873131, + 0.9399332031607628, + 0.11677676998078823, + 0.39658505097031593, + 0.4355380851775408, + 0.1769840531051159, + 0.02692611888051033, + 0.5038712956011295, + 0.4331333842128515, + 0.6627831608057022, + 0.2699630167335272, + 0.3092179708182812, + 0.2696392573416233, + 0.30705229565501213, + 0.7450484838336706, + 0.4651813004165888, + 0.4132386427372694, + 0.3487350009381771, + 0.46139627508819103, + 0.0573401004076004, + 0.25016757659614086, + 0.1548680905252695, + 0.7258437424898148, + 0.7987806759774685, + 0.20862413570284843, + 0.08423975110054016, + 0.40686045587062836, + 0.6290763206779957, + 0.20972000807523727, + 0.0, + 0.31346298567950726, + 0.5523814745247364, + 0.12639332562685013, + 0.598349068313837, + 0.0, + 0.38525266386568546, + 0.28101589530706406, + 0.325857549905777, + 0.03030434437096119, + 0.05198357626795769, + 0.15248341672122478, + 0.3596830777823925, + 0.6998567990958691, + 0.792019072920084 + ], + "unique_experts": 61, + "load_cv": 0.6798668808910237, + "normalized_load_entropy": 0.946155420019952, + "max_load_share": 0.06531531531531531 + }, + "full_input": { + "tokens": 99, + "top_k": 6, + "decisions": 594, + "ordered_route_sha256": "7570d913929a8adb47aa19f661a584949cd6c56c4fb8859a30276cb9e94d0a99", + "route_weight_sha256": "203d809e52ef888225e018eb9f1db8b1d778501a4c994ffdde3a784a3b206960", + "loads": [ + 9, + 4, + 8, + 11, + 10, + 7, + 9, + 12, + 27, + 18, + 2, + 7, + 7, + 12, + 5, + 15, + 3, + 31, + 11, + 5, + 5, + 11, + 6, + 7, + 9, + 7, + 15, + 10, + 7, + 11, + 5, + 8, + 7, + 8, + 15, + 10, + 11, + 9, + 5, + 4, + 6, + 17, + 11, + 21, + 6, + 13, + 6, + 9, + 6, + 1, + 11, + 6, + 6, + 8, + 2, + 9, + 6, + 18, + 1, + 14, + 4, + 10, + 10, + 10 + ], + "weighted_loads": [ + 0.5992181040346622, + 0.1387584824115038, + 0.47401614114642143, + 0.8553181141614914, + 0.7289431281387806, + 0.44824411533772945, + 0.3910899739712477, + 0.7481588758528233, + 1.338995061814785, + 1.6466845851391554, + 0.22822324186563492, + 0.6331924796104431, + 0.21554951556026936, + 0.7717335373163223, + 0.16107074357569218, + 1.0597673058509827, + 0.18987080827355385, + 1.8269344195723534, + 0.5024574585258961, + 0.25885828025639057, + 0.39930466189980507, + 0.9399332031607628, + 0.1780408639460802, + 0.39658505097031593, + 0.4355380851775408, + 0.3545684479176998, + 0.866810642182827, + 0.5038712956011295, + 0.4331333842128515, + 0.6627831608057022, + 0.2699630167335272, + 0.755169715732336, + 0.3851337395608425, + 0.5391800366342068, + 0.7450484838336706, + 0.4651813004165888, + 0.4132386427372694, + 0.3487350009381771, + 0.46139627508819103, + 0.3172629177570343, + 0.25016757659614086, + 0.6442778334021568, + 0.7258437424898148, + 0.956955598667264, + 0.20862413570284843, + 0.9342732653021812, + 0.5006616562604904, + 0.6290763206779957, + 0.20972000807523727, + 0.021731819957494736, + 0.4654725603759289, + 0.5523814745247364, + 0.36437568441033363, + 0.598349068313837, + 0.04470905847847462, + 0.9441752601414919, + 0.4725990444421768, + 0.7960851136595011, + 0.03030434437096119, + 0.8518038745969534, + 0.24306905828416348, + 0.5596205778419971, + 0.7575553767383099, + 0.792019072920084 + ], + "unique_experts": 64, + "load_cv": 0.5862744760145872, + "normalized_load_entropy": 0.9626636536990457, + "max_load_share": 0.05218855218855219 + } + }, + "s1_x": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "5dc1c72e240334891fbf12ea772118834d25ba265356414bdb161bee5991c8e1", + "route_weight_sha256": "51c1cb8d84a2bf86ad48a44d0c31a53478e8da14b36fd3a07447b6a0cba2b39a", + "loads": [ + 8, + 3, + 5, + 11, + 6, + 9, + 6, + 8, + 10, + 17, + 0, + 7, + 5, + 12, + 2, + 6, + 3, + 26, + 11, + 6, + 2, + 11, + 4, + 9, + 7, + 4, + 14, + 10, + 7, + 10, + 6, + 5, + 5, + 5, + 15, + 10, + 11, + 9, + 5, + 1, + 6, + 6, + 11, + 11, + 8, + 3, + 5, + 9, + 4, + 0, + 7, + 6, + 2, + 9, + 0, + 5, + 3, + 10, + 0, + 1, + 3, + 6, + 9, + 9 + ], + "weighted_loads": [ + 0.5595740471035242, + 0.111330047249794, + 0.3150826543569565, + 0.8718655370175838, + 0.5822704210877419, + 0.44577016308903694, + 0.24254073575139046, + 0.42966808192431927, + 0.3922416288405657, + 1.5610184632241726, + 0.0, + 0.6537392903119326, + 0.1605359073728323, + 0.7964479718357325, + 0.0893080048263073, + 0.39748601987957954, + 0.19183319434523582, + 1.3136894516646862, + 0.46782235242426395, + 0.30450914800167084, + 0.09977374225854874, + 0.9571641720831394, + 0.1214364618062973, + 0.42966186814010143, + 0.36438486352562904, + 0.20079557225108147, + 0.3657913878560066, + 0.46653662249445915, + 0.4396308436989784, + 0.6429962553083897, + 0.3102961238473654, + 0.3498119078576565, + 0.21852471679449081, + 0.21422333270311356, + 0.7576715890318155, + 0.45685665123164654, + 0.43281556479632854, + 0.33077107928693295, + 0.4622686542570591, + 0.0589175783097744, + 0.22048619389533997, + 0.20451814122498035, + 0.7041433583945036, + 0.6625224445015192, + 0.2808414362370968, + 0.10947414673864841, + 0.40402400493621826, + 0.6522937212139368, + 0.1601011510938406, + 0.0, + 0.3290801774710417, + 0.5368676297366619, + 0.1341334506869316, + 0.6405729558318853, + 0.0, + 0.3698764629662037, + 0.2888234108686447, + 0.3240945599973202, + 0.0, + 0.02657887153327465, + 0.14588616788387299, + 0.37246134877204895, + 0.6890152413398027, + 0.7611948773264885 + ], + "unique_experts": 60, + "load_cv": 0.6400201887895994, + "normalized_load_entropy": 0.9486211805580977, + "max_load_share": 0.05855855855855856 + }, + "full_input": { + "tokens": 115, + "top_k": 6, + "decisions": 690, + "ordered_route_sha256": "208ad43ed256447005632b44c4500c5576d1731e33fc6e77c1e2743be4abd851", + "route_weight_sha256": "76921ce6d60851c318bdb0a3cd12a9e997ca7433d10d857dd5456072a1951dff", + "loads": [ + 10, + 3, + 8, + 11, + 13, + 12, + 7, + 13, + 31, + 18, + 5, + 8, + 5, + 13, + 2, + 19, + 3, + 32, + 12, + 7, + 5, + 13, + 8, + 10, + 9, + 9, + 35, + 11, + 7, + 12, + 7, + 11, + 7, + 7, + 15, + 10, + 12, + 10, + 5, + 6, + 6, + 20, + 14, + 18, + 9, + 14, + 7, + 11, + 6, + 1, + 16, + 10, + 7, + 9, + 5, + 9, + 12, + 22, + 2, + 12, + 5, + 11, + 10, + 13 + ], + "weighted_loads": [ + 0.6648426670581102, + 0.111330047249794, + 0.47408050298690796, + 0.8718655370175838, + 0.9566052220761776, + 0.6661498434841633, + 0.28772158175706863, + 0.7150734513998032, + 1.6220061294734478, + 1.5859769992530346, + 0.41745181754231453, + 0.8000679183751345, + 0.1605359073728323, + 0.8365150634199381, + 0.0893080048263073, + 1.2107675112783909, + 0.19183319434523582, + 1.5706460177898407, + 0.5071994606405497, + 0.370611272752285, + 0.33925197273492813, + 1.161933433264494, + 0.3918388579040766, + 0.46424207650125027, + 0.4363680724054575, + 0.40809751860797405, + 1.7230943739414215, + 0.5085943937301636, + 0.4396308436989784, + 0.8057560659945011, + 0.39654521457850933, + 1.008453119546175, + 0.31256208568811417, + 0.38819239288568497, + 0.7576715890318155, + 0.45685665123164654, + 0.6912149917334318, + 0.36456084437668324, + 0.4622686542570591, + 0.43453213199973106, + 0.22048619389533997, + 0.8659117743372917, + 0.9109411519020796, + 0.9055816177278757, + 0.43397700414061546, + 0.9135353844612837, + 0.5362651534378529, + 0.7347801793366671, + 0.31163142062723637, + 0.021846598014235497, + 0.7756220828741789, + 0.9018830880522728, + 0.42673368006944656, + 0.6405729558318853, + 0.11616997420787811, + 0.8872150518000126, + 0.645687073469162, + 1.0149083770811558, + 0.07536642253398895, + 0.7575517054647207, + 0.2612984608858824, + 0.6685792058706284, + 0.744405971840024, + 1.2529028877615929 + ], + "unique_experts": 64, + "load_cv": 0.6052282191268622, + "normalized_load_entropy": 0.9612411213415083, + "max_load_share": 0.050724637681159424 + } + }, + "s0_period": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "19b44a3e52cea440f81bba4bb4160b31b06cb567e642c7f6a767c8168890b943", + "route_weight_sha256": "4512c966a7bb11ddf6d7cdb7b23e7b8cd50ca45b7384e4bdb0240e06a87e069a", + "loads": [ + 9, + 4, + 6, + 11, + 6, + 6, + 8, + 9, + 10, + 17, + 0, + 7, + 7, + 12, + 4, + 5, + 3, + 30, + 11, + 5, + 2, + 11, + 4, + 7, + 9, + 3, + 1, + 10, + 7, + 11, + 5, + 4, + 5, + 6, + 15, + 10, + 11, + 10, + 5, + 1, + 6, + 5, + 11, + 15, + 6, + 2, + 5, + 9, + 6, + 0, + 7, + 6, + 2, + 8, + 0, + 5, + 3, + 10, + 1, + 2, + 3, + 6, + 9, + 10 + ], + "weighted_loads": [ + 0.6000226642936468, + 0.14076441898941994, + 0.3794631138443947, + 0.8464170917868614, + 0.5745009295642376, + 0.3571243081241846, + 0.33138149604201317, + 0.4508141651749611, + 0.43369256518781185, + 1.6214212030172348, + 0.0, + 0.6150031462311745, + 0.2166085410863161, + 0.778770450502634, + 0.13902493938803673, + 0.33145971968770027, + 0.18818677216768265, + 1.7430964261293411, + 0.5053069088608027, + 0.2614195793867111, + 0.09962296485900879, + 0.9422122705727816, + 0.11672762222588062, + 0.39745951630175114, + 0.44173606112599373, + 0.1759362854063511, + 0.026971392333507538, + 0.5058101862668991, + 0.4320964366197586, + 0.6609240546822548, + 0.26926999539136887, + 0.3066730313003063, + 0.2617591321468353, + 0.30216653645038605, + 0.7437560129910707, + 0.46712934225797653, + 0.414066256955266, + 0.3887507151812315, + 0.46020717173814774, + 0.05765470489859581, + 0.25962941348552704, + 0.1544837187975645, + 0.7288427259773016, + 0.7789432927966118, + 0.20794700644910336, + 0.08414924889802933, + 0.4114266633987427, + 0.6217184066772461, + 0.20948626473546028, + 0.0, + 0.3136709649115801, + 0.54578572884202, + 0.12581586092710495, + 0.5995158441364765, + 0.0, + 0.38762566074728966, + 0.27583860605955124, + 0.3221470881253481, + 0.030580397695302963, + 0.05231829546391964, + 0.1519896425306797, + 0.35877126082777977, + 0.6991597078740597, + 0.7983768451958895 + ], + "unique_experts": 61, + "load_cv": 0.6860465356214748, + "normalized_load_entropy": 0.94586108179794, + "max_load_share": 0.06756756756756757 + }, + "full_input": { + "tokens": 99, + "top_k": 6, + "decisions": 594, + "ordered_route_sha256": "bf5317aa7c6161ac59e4962091dfdeb94d1b340e228ff8aec3cb94671f521356", + "route_weight_sha256": "bbcebc7a11d5a736811fdabbe1ffe8088382742a86f6f1d03d0a9311152b667a", + "loads": [ + 9, + 4, + 8, + 11, + 11, + 7, + 10, + 11, + 25, + 18, + 2, + 9, + 7, + 12, + 5, + 14, + 3, + 32, + 11, + 5, + 5, + 11, + 5, + 7, + 9, + 7, + 14, + 10, + 7, + 11, + 5, + 8, + 7, + 8, + 15, + 11, + 11, + 10, + 5, + 4, + 6, + 16, + 11, + 21, + 6, + 12, + 6, + 9, + 7, + 1, + 11, + 7, + 6, + 8, + 2, + 9, + 6, + 17, + 1, + 14, + 4, + 10, + 10, + 10 + ], + "weighted_loads": [ + 0.6000226642936468, + 0.14076441898941994, + 0.4653651751577854, + 0.8464170917868614, + 0.8386374730616808, + 0.44740874506533146, + 0.4321427345275879, + 0.7023953720927238, + 1.235520051792264, + 1.6470356155186892, + 0.22772400826215744, + 0.775104459375143, + 0.2166085410863161, + 0.778770450502634, + 0.16133016161620617, + 0.9459256157279015, + 0.18818677216768265, + 1.8815673515200615, + 0.5053069088608027, + 0.2614195793867111, + 0.3945332281291485, + 0.9422122705727816, + 0.14701230265200138, + 0.39745951630175114, + 0.44173606112599373, + 0.3530135042965412, + 0.8369768038392067, + 0.5058101862668991, + 0.4320964366197586, + 0.6609240546822548, + 0.26926999539136887, + 0.7553653158247471, + 0.376336507499218, + 0.5331273674964905, + 0.7437560129910707, + 0.4883335027843714, + 0.414066256955266, + 0.3887507151812315, + 0.46020717173814774, + 0.29751476272940636, + 0.25962941348552704, + 0.5881261695176363, + 0.7288427259773016, + 0.9653014931827784, + 0.20794700644910336, + 0.9002373851835728, + 0.5012882500886917, + 0.6217184066772461, + 0.23047951608896255, + 0.0217607319355011, + 0.46558300219476223, + 0.5990133434534073, + 0.3766423463821411, + 0.5995158441364765, + 0.04470905847847462, + 0.9496262259781361, + 0.46784770488739014, + 0.7641595900058746, + 0.030580397695302963, + 0.784273711964488, + 0.2425752840936184, + 0.5565244853496552, + 0.758303239941597, + 0.7983768451958895 + ], + "unique_experts": 64, + "load_cv": 0.5724994944888726, + "normalized_load_entropy": 0.9641415076638515, + "max_load_share": 0.05387205387205387 + } + }, + "s1_period": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "5d8a416dc1144a0c14b267e5f61b2bce105f21cd0c48fd2f5a8fafea905b5863", + "route_weight_sha256": "4d4870a2db5a67daa9eeb158b8210b61745b68363eceed887f352e9eab44d9f2", + "loads": [ + 8, + 3, + 5, + 12, + 6, + 9, + 6, + 8, + 10, + 17, + 0, + 7, + 5, + 12, + 2, + 6, + 3, + 26, + 11, + 6, + 2, + 11, + 4, + 8, + 7, + 4, + 14, + 10, + 7, + 10, + 6, + 4, + 5, + 5, + 16, + 10, + 11, + 9, + 5, + 1, + 6, + 6, + 11, + 11, + 8, + 3, + 5, + 9, + 4, + 0, + 7, + 6, + 2, + 9, + 0, + 5, + 3, + 10, + 0, + 1, + 3, + 6, + 9, + 9 + ], + "weighted_loads": [ + 0.5595686230808496, + 0.11286049336194992, + 0.31605176627635956, + 0.9144244156777859, + 0.5735867787152529, + 0.44779000617563725, + 0.24160266481339931, + 0.43073937110602856, + 0.3878817465156317, + 1.5625696815550327, + 0.0, + 0.6418841574341059, + 0.160982433706522, + 0.8018359262496233, + 0.08964017033576965, + 0.3983612172305584, + 0.19283011555671692, + 1.3185196612030268, + 0.47402699664235115, + 0.30538452230393887, + 0.09996536746621132, + 0.962440075352788, + 0.12124898470938206, + 0.4082164913415909, + 0.36630815640091896, + 0.20046069286763668, + 0.3664873242378235, + 0.46708397567272186, + 0.44122216291725636, + 0.6432622093707323, + 0.3105630576610565, + 0.3066876269876957, + 0.21626056358218193, + 0.2102454975247383, + 0.7803707160055637, + 0.45772940665483475, + 0.4322913233190775, + 0.3346576299518347, + 0.461336238309741, + 0.05912359803915024, + 0.22481361217796803, + 0.20484706945717335, + 0.7067050170153379, + 0.6626410577446222, + 0.2804721649736166, + 0.10943102464079857, + 0.40798940509557724, + 0.6551063191145658, + 0.1595881525427103, + 0.0, + 0.32968392223119736, + 0.5345228910446167, + 0.13311702758073807, + 0.6417343728244305, + 0.0, + 0.37028839252889156, + 0.2856804355978966, + 0.3218947947025299, + 0.0, + 0.026618212461471558, + 0.1460380256175995, + 0.37327663972973824, + 0.6881298329681158, + 0.7642717361450195 + ], + "unique_experts": 60, + "load_cv": 0.6470826943371365, + "normalized_load_entropy": 0.9477865417510039, + "max_load_share": 0.05855855855855856 + }, + "full_input": { + "tokens": 115, + "top_k": 6, + "decisions": 690, + "ordered_route_sha256": "67791facf08567e640d34dd2903761ceda202bbf7f7a1c3f1e727005d82f273b", + "route_weight_sha256": "29d81be3859faa1afa1962832014b952dbf58de8c75bc73b83c59b7de61a4ca6", + "loads": [ + 10, + 3, + 8, + 12, + 14, + 12, + 7, + 12, + 30, + 17, + 5, + 10, + 5, + 13, + 2, + 18, + 3, + 32, + 12, + 7, + 5, + 13, + 8, + 9, + 9, + 9, + 35, + 11, + 7, + 12, + 8, + 10, + 7, + 7, + 16, + 10, + 13, + 10, + 5, + 6, + 6, + 20, + 14, + 18, + 9, + 13, + 6, + 11, + 6, + 1, + 16, + 11, + 8, + 9, + 5, + 9, + 12, + 22, + 2, + 11, + 5, + 11, + 10, + 13 + ], + "weighted_loads": [ + 0.6648372430354357, + 0.11286049336194992, + 0.46545933932065964, + 0.9144244156777859, + 1.0674721021205187, + 0.6693601328879595, + 0.2867835108190775, + 0.6661250200122595, + 1.5767621621489525, + 1.5625696815550327, + 0.4170234836637974, + 0.9552116896957159, + 0.160982433706522, + 0.8419030178338289, + 0.08964017033576965, + 1.101349551230669, + 0.19283011555671692, + 1.5753165800124407, + 0.5134041048586369, + 0.37148664705455303, + 0.33599819242954254, + 1.1672093365341425, + 0.39165138080716133, + 0.4427966997027397, + 0.4382913652807474, + 0.4069182649254799, + 1.7139841075986624, + 0.5091417469084263, + 0.44122216291725636, + 0.8060220200568438, + 0.4177048485726118, + 0.9672333262860775, + 0.30929435417056084, + 0.38313259929418564, + 0.7803707160055637, + 0.45772940665483475, + 0.7127133272588253, + 0.36844739504158497, + 0.461336238309741, + 0.4160648360848427, + 0.22481361217796803, + 0.8352114446461201, + 0.9135028105229139, + 0.9076420906931162, + 0.4336077328771353, + 0.8788680545985699, + 0.502015195786953, + 0.7375927772372961, + 0.31111842207610607, + 0.021856587380170822, + 0.7758573219180107, + 0.942531630396843, + 0.4592472668737173, + 0.6417343728244305, + 0.11624417826533318, + 0.8893612828105688, + 0.6455411911010742, + 1.0126846190541983, + 0.07536642253398895, + 0.6632675379514694, + 0.2614503186196089, + 0.665068905800581, + 0.7447690982371569, + 1.255979746580124 + ], + "unique_experts": 64, + "load_cv": 0.5976288651408042, + "normalized_load_entropy": 0.9619937383675807, + "max_load_share": 0.050724637681159424 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 74, + "ordered_topk_exact_tokens": 49, + "set_exact_tokens": 53, + "mean_set_jaccard": 0.9160231660231661, + "mean_token_weighted_tv": 0.01209688131269571, + "aggregate_load_tv": 0.04054054054054053 + }, + "system_bos": { + "tokens": 74, + "ordered_topk_exact_tokens": 38, + "set_exact_tokens": 50, + "mean_set_jaccard": 0.9015444015444016, + "mean_token_weighted_tv": 0.017155294973604584, + "aggregate_load_tv": 0.0518018018018018 + }, + "system_x": { + "tokens": 74, + "ordered_topk_exact_tokens": 34, + "set_exact_tokens": 43, + "mean_set_jaccard": 0.8774131274131275, + "mean_token_weighted_tv": 0.02085958138057912, + "aggregate_load_tv": 0.06306306306306307 + }, + "system_period": { + "tokens": 74, + "ordered_topk_exact_tokens": 31, + "set_exact_tokens": 41, + "mean_set_jaccard": 0.8696911196911198, + "mean_token_weighted_tv": 0.021908530197735573, + "aggregate_load_tv": 0.06306306306306307 + }, + "bos_at_s0": { + "tokens": 74, + "ordered_topk_exact_tokens": 25, + "set_exact_tokens": 36, + "mean_set_jaccard": 0.8445945945945946, + "mean_token_weighted_tv": 0.02965580251671978, + "aggregate_load_tv": 0.06756756756756757 + }, + "bos_at_s1": { + "tokens": 74, + "ordered_topk_exact_tokens": 32, + "set_exact_tokens": 46, + "mean_set_jaccard": 0.8809523809523809, + "mean_token_weighted_tv": 0.022519052720855217, + "aggregate_load_tv": 0.0518018018018018 + }, + "x_at_s0": { + "tokens": 74, + "ordered_topk_exact_tokens": 30, + "set_exact_tokens": 42, + "mean_set_jaccard": 0.8677606177606179, + "mean_token_weighted_tv": 0.025920147214688966, + "aggregate_load_tv": 0.05630630630630631 + }, + "x_at_s1": { + "tokens": 74, + "ordered_topk_exact_tokens": 29, + "set_exact_tokens": 40, + "mean_set_jaccard": 0.8629343629343629, + "mean_token_weighted_tv": 0.024238055798451643, + "aggregate_load_tv": 0.05855855855855856 + }, + "period_at_s0": { + "tokens": 74, + "ordered_topk_exact_tokens": 29, + "set_exact_tokens": 41, + "mean_set_jaccard": 0.8638996138996139, + "mean_token_weighted_tv": 0.026264705682626448, + "aggregate_load_tv": 0.056306306306306314 + }, + "period_at_s1": { + "tokens": 74, + "ordered_topk_exact_tokens": 30, + "set_exact_tokens": 41, + "mean_set_jaccard": 0.8667953667953667, + "mean_token_weighted_tv": 0.023571165328895725, + "aggregate_load_tv": 0.0563063063063063 + } + } + }, + "layer_02": { + "layer": 2, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "5f06d08d373e7a6d396a68d0d847f07b5cc6ec035bd7f8ba13a672bf7e1c2692", + "route_weight_sha256": "4d90f3622742703d879d9bfa43fd919ef40be1f0779f8ad06e5fe50582780040", + "loads": [ + 8, + 9, + 11, + 8, + 4, + 10, + 2, + 13, + 10, + 6, + 5, + 6, + 5, + 9, + 6, + 9, + 6, + 17, + 9, + 3, + 3, + 4, + 6, + 13, + 6, + 17, + 1, + 4, + 2, + 11, + 8, + 7, + 6, + 6, + 5, + 4, + 3, + 4, + 9, + 5, + 9, + 4, + 6, + 8, + 3, + 13, + 7, + 4, + 6, + 9, + 6, + 3, + 14, + 4, + 2, + 5, + 9, + 5, + 16, + 6, + 4, + 10, + 7, + 4 + ], + "weighted_loads": [ + 0.7893539927899837, + 0.48200323060154915, + 0.462217727676034, + 0.5234126765280962, + 0.15481450408697128, + 0.8546151705086231, + 0.0877847671508789, + 0.7712831310927868, + 0.6844424419105053, + 0.3172150254249573, + 0.2146819569170475, + 0.27961909398436546, + 0.29230416007339954, + 0.3424105681478977, + 0.19480954855680466, + 0.5881594326347113, + 0.29744713567197323, + 1.5512674134224653, + 0.9769085757434368, + 0.3421003594994545, + 0.34791453182697296, + 0.3131012097001076, + 1.055341549217701, + 0.43360619992017746, + 0.3215978741645813, + 1.4499046672135592, + 0.07266281545162201, + 0.21464864537119865, + 0.057106126099824905, + 1.0585787668824196, + 0.4856411349028349, + 0.29506491497159004, + 0.5275040827691555, + 0.4002942815423012, + 0.6874841675162315, + 0.2973426468670368, + 0.9651246964931488, + 0.2166062779724598, + 1.1957333609461784, + 0.34506433084607124, + 0.36138566583395004, + 0.28948007337749004, + 0.3957937192171812, + 0.36707331240177155, + 0.5792720466852188, + 1.3523356672376394, + 0.5013801716268063, + 0.16431874781847, + 0.47370075434446335, + 0.4827688205987215, + 0.5126143153756857, + 0.0963342897593975, + 0.8798594791442156, + 0.4138847067952156, + 0.05346980504691601, + 0.2902589440345764, + 0.5401301216334105, + 0.27410121634602547, + 1.7758662700653076, + 0.3326541632413864, + 0.5766476057469845, + 1.0629942901432514, + 0.4407807067036629, + 0.15712470933794975 + ], + "unique_experts": 64, + "load_cv": 0.5252337242215643, + "normalized_load_entropy": 0.9683268835613992, + "max_load_share": 0.038288288288288286 + }, + "full_input": { + "tokens": 99, + "top_k": 6, + "decisions": 594, + "ordered_route_sha256": "436bbf7cddcee23af41625856b2939dfba800d3a6155323f3f9b6cde2f9868da", + "route_weight_sha256": "4261f38e532f2e4a7d85c92f9f5fda748f5977e2b7e01bae864db73d8601f968", + "loads": [ + 8, + 19, + 12, + 10, + 4, + 10, + 2, + 15, + 13, + 6, + 8, + 6, + 6, + 11, + 14, + 9, + 6, + 18, + 10, + 7, + 5, + 13, + 6, + 13, + 9, + 17, + 2, + 6, + 4, + 11, + 8, + 8, + 6, + 6, + 10, + 19, + 3, + 4, + 13, + 5, + 9, + 4, + 13, + 8, + 3, + 13, + 9, + 8, + 7, + 9, + 6, + 8, + 14, + 5, + 2, + 5, + 9, + 13, + 24, + 9, + 15, + 13, + 12, + 14 + ], + "weighted_loads": [ + 0.7893539927899837, + 1.426979210227728, + 0.4854341857135296, + 2.2214353401213884, + 0.15481450408697128, + 0.8546151705086231, + 0.0877847671508789, + 1.0015270970761776, + 0.8653280809521675, + 0.3172150254249573, + 0.340706005692482, + 0.27961909398436546, + 0.3314207550138235, + 0.39330715499818325, + 0.5281716249883175, + 0.5881594326347113, + 0.29744713567197323, + 1.551964062906336, + 0.9784922256367281, + 1.0890033021569252, + 0.6602705121040344, + 1.0073906779289246, + 1.055341549217701, + 0.43360619992017746, + 0.4741571806371212, + 1.4499046672135592, + 0.07350757130188867, + 0.4687465541064739, + 0.2659507654607296, + 1.0585787668824196, + 0.4856411349028349, + 0.29576116922544315, + 0.5275040827691555, + 0.4002942815423012, + 0.910631250590086, + 2.2614088198170066, + 0.9651246964931488, + 0.2166062779724598, + 1.3118184134364128, + 0.34506433084607124, + 0.36138566583395004, + 0.28948007337749004, + 1.1794383469969034, + 0.36707331240177155, + 0.5792720466852188, + 1.3523356672376394, + 0.5680305287241936, + 0.4045991078019142, + 0.4992980994284153, + 0.4827688205987215, + 0.5126143153756857, + 0.682588379830122, + 0.8798594791442156, + 0.41519916080869734, + 0.05346980504691601, + 0.2902589440345764, + 0.5401301216334105, + 0.7098973616957664, + 2.139032058417797, + 0.4433706309646368, + 1.434517408721149, + 1.244992882013321, + 0.8469773586839437, + 0.7657371982932091 + ], + "unique_experts": 64, + "load_cv": 0.49465164312599974, + "normalized_load_entropy": 0.9707547876698692, + "max_load_share": 0.04040404040404041 + } + }, + "s1_eos": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "bb8f34d96e760cd0a0ad5f5d00e8200b848f35dad240653c49f7fe1eee8c7d24", + "route_weight_sha256": "2ea6120f9df14f63ebb9bcaba6bb0fc268a3c8f73e590582471f5f97a707e7d1", + "loads": [ + 8, + 9, + 11, + 7, + 4, + 10, + 2, + 12, + 10, + 6, + 6, + 6, + 6, + 10, + 5, + 9, + 6, + 17, + 10, + 3, + 4, + 4, + 6, + 13, + 6, + 17, + 2, + 5, + 3, + 10, + 8, + 7, + 6, + 6, + 5, + 2, + 3, + 4, + 9, + 5, + 9, + 5, + 6, + 8, + 3, + 12, + 7, + 4, + 8, + 9, + 6, + 3, + 12, + 4, + 2, + 5, + 9, + 5, + 16, + 6, + 4, + 9, + 7, + 3 + ], + "weighted_loads": [ + 0.784178614616394, + 0.4786770213395357, + 0.478889649733901, + 0.5090525057166815, + 0.15795538388192654, + 0.867447454482317, + 0.08677535131573677, + 0.7285179682075977, + 0.6763650178909302, + 0.3170936293900013, + 0.23874390870332718, + 0.2811068259179592, + 0.316398611292243, + 0.3822241462767124, + 0.1653923001140356, + 0.5962812006473541, + 0.305375961586833, + 1.5568614974617958, + 1.0194109044969082, + 0.33609694242477417, + 0.37140234746038914, + 0.309953298419714, + 1.0576498061418533, + 0.4466714598238468, + 0.3192394748330116, + 1.46590194106102, + 0.12036856263875961, + 0.2351430244743824, + 0.09511640854179859, + 1.0203108042478561, + 0.49871466495096684, + 0.30259356647729874, + 0.5303605534136295, + 0.3986094146966934, + 0.6905495747923851, + 0.22659007459878922, + 0.9612876642495394, + 0.21500064805150032, + 1.1699487157166004, + 0.3352994732558727, + 0.3647030610591173, + 0.31735109351575375, + 0.3855967316776514, + 0.37202029302716255, + 0.5832659378647804, + 1.3676331155002117, + 0.5054001845419407, + 0.16479453817009926, + 0.5358094777911901, + 0.4828997850418091, + 0.5192354302853346, + 0.09870986640453339, + 0.8328544106334448, + 0.40705277025699615, + 0.05292137525975704, + 0.29188086092472076, + 0.5390990488231182, + 0.2540033459663391, + 1.7645257897675037, + 0.33273983001708984, + 0.5424864292144775, + 1.0314443781971931, + 0.4372200481593609, + 0.1273244544863701 + ], + "unique_experts": 64, + "load_cv": 0.5044240605106097, + "normalized_load_entropy": 0.9707984488931385, + "max_load_share": 0.038288288288288286 + }, + "full_input": { + "tokens": 115, + "top_k": 6, + "decisions": 690, + "ordered_route_sha256": "a6a5eb70ec7c53d05ada7c5dcb25181b5527afe350ac68a9e5701d8a5d153319", + "route_weight_sha256": "79939c029fef8e9b5fc0e93fa75eb6a29dd9e4b10a7db67e895e113020c45bc9", + "loads": [ + 12, + 20, + 13, + 10, + 5, + 11, + 2, + 16, + 19, + 7, + 13, + 6, + 6, + 14, + 16, + 10, + 8, + 18, + 11, + 9, + 6, + 15, + 7, + 13, + 12, + 18, + 3, + 8, + 7, + 10, + 9, + 9, + 6, + 6, + 14, + 19, + 3, + 5, + 14, + 8, + 9, + 5, + 16, + 9, + 6, + 12, + 14, + 11, + 10, + 10, + 7, + 11, + 13, + 8, + 2, + 5, + 14, + 13, + 18, + 15, + 15, + 15, + 17, + 17 + ], + "weighted_loads": [ + 1.3053092770278454, + 1.4886643718928099, + 0.5281608998775482, + 2.2414429131895304, + 0.1883462890982628, + 1.0074735172092915, + 0.08677535131573677, + 1.02079563960433, + 1.3972657639533281, + 0.4341118447482586, + 0.5445782914757729, + 0.2811068259179592, + 0.316398611292243, + 0.4551313859410584, + 0.7213420774787664, + 0.6287632696330547, + 0.3693904224783182, + 1.5574459984200075, + 1.0207926910370588, + 1.1209263149648905, + 0.6599130276590586, + 1.1022866144776344, + 1.0963958986103535, + 0.4466714598238468, + 0.597203504294157, + 1.5162174850702286, + 0.12119450705358759, + 0.8859547711908817, + 0.3139750976115465, + 1.0203108042478561, + 0.5327616091817617, + 0.3453112728893757, + 0.5303605534136295, + 0.3986094146966934, + 1.0585045535117388, + 1.9716582847759128, + 0.9612876642495394, + 0.25698719918727875, + 1.3247454483062029, + 0.6913942880928516, + 0.3647030610591173, + 0.31735109351575375, + 1.6231634709984064, + 0.5527405776083469, + 1.2265994623303413, + 1.3676331155002117, + 1.118001762777567, + 0.5270424820482731, + 0.6047632023692131, + 0.5263996571302414, + 0.5456210300326347, + 0.9732702225446701, + 1.0087564494460821, + 0.5925062119495124, + 0.05292137525975704, + 0.29188086092472076, + 0.8230463545769453, + 0.624488327652216, + 1.874367244541645, + 0.7284547705203295, + 1.250769522972405, + 1.4876111522316933, + 1.2877967581152916, + 1.1627249959856272 + ], + "unique_experts": 64, + "load_cv": 0.4245659532831743, + "normalized_load_entropy": 0.9767913789370963, + "max_load_share": 0.028985507246376812 + } + }, + "s0_bos": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "a8e7491fe279931302212361ac9160b25a8d3710561edede8ba94110b076458e", + "route_weight_sha256": "661fd157d4ebb2ae77f9991ee3aa2b5faf8ceda9d7edafbdb9d757d22966df58", + "loads": [ + 9, + 10, + 8, + 10, + 4, + 11, + 2, + 12, + 9, + 7, + 3, + 4, + 6, + 7, + 2, + 8, + 7, + 16, + 8, + 3, + 5, + 4, + 6, + 13, + 6, + 16, + 1, + 7, + 4, + 11, + 7, + 7, + 6, + 5, + 5, + 3, + 3, + 5, + 9, + 5, + 10, + 5, + 6, + 8, + 3, + 13, + 7, + 4, + 8, + 9, + 6, + 2, + 15, + 4, + 3, + 7, + 8, + 4, + 16, + 7, + 4, + 10, + 8, + 3 + ], + "weighted_loads": [ + 0.8515703473240137, + 0.530180498957634, + 0.38342175632715225, + 0.6477713268250227, + 0.15484578721225262, + 0.9099614918231964, + 0.0791870579123497, + 0.7043149545788765, + 0.6473851911723614, + 0.35960130393505096, + 0.15748442709445953, + 0.19686885178089142, + 0.292808435857296, + 0.26040568575263023, + 0.06722597405314445, + 0.5634128972887993, + 0.3399978131055832, + 1.4598166532814503, + 0.9124749377369881, + 0.3124609738588333, + 0.38715888001024723, + 0.3143046051263809, + 1.0012146085500717, + 0.43143863044679165, + 0.31506945192813873, + 1.3990288600325584, + 0.08289056271314621, + 0.28644895926117897, + 0.12940392829477787, + 1.1004270650446415, + 0.4736561942845583, + 0.30479886196553707, + 0.5224612280726433, + 0.39285520277917385, + 0.6716190129518509, + 0.24855515360832214, + 0.9642883278429508, + 0.2456485964357853, + 1.0967383049428463, + 0.3395426757633686, + 0.4027757588773966, + 0.31669661216437817, + 0.4142577201128006, + 0.38500411808490753, + 0.5374261513352394, + 1.434114396572113, + 0.518024031072855, + 0.159852497279644, + 0.5454583875834942, + 0.4794559832662344, + 0.5140780061483383, + 0.06259618513286114, + 0.9423098526895046, + 0.4322264716029167, + 0.07265428453683853, + 0.3706120103597641, + 0.528633289039135, + 0.1810390241444111, + 1.6716788411140442, + 0.3885932192206383, + 0.6167297884821892, + 1.1219948418438435, + 0.5901496484875679, + 0.11590543948113918 + ], + "unique_experts": 64, + "load_cv": 0.5158788577376724, + "normalized_load_entropy": 0.9688139332245506, + "max_load_share": 0.036036036036036036 + }, + "full_input": { + "tokens": 99, + "top_k": 6, + "decisions": 594, + "ordered_route_sha256": "872a4e4ea1748d1aa11c5d93b3e9e444b88df0a872c2b1018dad125e8ab0a9f0", + "route_weight_sha256": "1570078d56556410b339b3e5a3be87c7829185f481c4ba82564d8fec822f4ab5", + "loads": [ + 9, + 20, + 8, + 11, + 4, + 11, + 3, + 14, + 12, + 7, + 6, + 4, + 8, + 9, + 7, + 8, + 8, + 16, + 8, + 7, + 7, + 13, + 6, + 13, + 8, + 16, + 1, + 9, + 6, + 11, + 7, + 7, + 6, + 5, + 10, + 19, + 3, + 5, + 14, + 5, + 10, + 5, + 14, + 8, + 3, + 13, + 9, + 8, + 9, + 9, + 6, + 8, + 15, + 4, + 3, + 7, + 8, + 14, + 24, + 11, + 15, + 13, + 14, + 13 + ], + "weighted_loads": [ + 0.8515703473240137, + 1.4751564785838127, + 0.38342175632715225, + 1.3729437869042158, + 0.15484578721225262, + 0.9099614918231964, + 0.1003381609916687, + 0.891085647046566, + 0.8374233283102512, + 0.35960130393505096, + 0.283508475869894, + 0.19686885178089142, + 0.3692123182117939, + 0.307922026142478, + 0.2688069995492697, + 0.5634128972887993, + 0.36980987899005413, + 1.4598166532814503, + 0.9124749377369881, + 1.016567662358284, + 0.6781254801899195, + 1.0193445309996605, + 1.0012146085500717, + 0.43143863044679165, + 0.42350246384739876, + 1.3990288600325584, + 0.08289056271314621, + 0.5532386489212513, + 0.3874903414398432, + 1.1004270650446415, + 0.4736561942845583, + 0.30479886196553707, + 0.5224612280726433, + 0.39285520277917385, + 0.8947660960257053, + 2.2900368189439178, + 0.9642883278429508, + 0.2456485964357853, + 1.303268987685442, + 0.3395426757633686, + 0.4027757588773966, + 0.31669661216437817, + 1.2254909612238407, + 0.38500411808490753, + 0.5374261513352394, + 1.434114396572113, + 0.5846743881702423, + 0.40296192839741707, + 0.5710557326674461, + 0.4794559832662344, + 0.5140780061483383, + 0.7063002828508615, + 0.9423098526895046, + 0.4322264716029167, + 0.07265428453683853, + 0.3706120103597641, + 0.528633289039135, + 0.6647441126406193, + 2.0348446294665337, + 0.5484302695840597, + 1.4751393599435687, + 1.302923634648323, + 1.0892894510179758, + 0.9643134791404009 + ], + "unique_experts": 64, + "load_cv": 0.4805151471622746, + "normalized_load_entropy": 0.9726292642201256, + "max_load_share": 0.04040404040404041 + } + }, + "s1_bos": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "f828254adaf6f1203d6ec9febbe6f1406a89c346192416321062a29ecd51e7fe", + "route_weight_sha256": "b21213510267801f62d972bb271aea4e43f0b166a4d703ef2900b649d3c4df12", + "loads": [ + 8, + 10, + 11, + 10, + 4, + 11, + 2, + 11, + 9, + 7, + 4, + 5, + 6, + 8, + 2, + 8, + 8, + 16, + 8, + 3, + 4, + 4, + 6, + 12, + 6, + 17, + 1, + 7, + 3, + 10, + 9, + 7, + 6, + 5, + 5, + 3, + 3, + 4, + 9, + 5, + 10, + 6, + 5, + 8, + 3, + 13, + 7, + 4, + 11, + 9, + 6, + 2, + 14, + 4, + 2, + 6, + 8, + 4, + 16, + 6, + 4, + 10, + 7, + 2 + ], + "weighted_loads": [ + 0.8081360794603825, + 0.5351182110607624, + 0.49156613647937775, + 0.6451974287629128, + 0.16309992596507072, + 0.8995949812233448, + 0.0771302841603756, + 0.688732335343957, + 0.6824711635708809, + 0.3657787833362818, + 0.19469024613499641, + 0.24502940848469734, + 0.307630967348814, + 0.30245146714150906, + 0.06848246231675148, + 0.592384085059166, + 0.3607047665864229, + 1.459569826722145, + 0.9175064489245415, + 0.3127623647451401, + 0.3721264563500881, + 0.3112981654703617, + 1.0684634149074554, + 0.4159292187541723, + 0.31245747208595276, + 1.492067527025938, + 0.07565876841545105, + 0.2542015966027975, + 0.10320091620087624, + 1.0599485635757446, + 0.5456444211304188, + 0.31412655860185623, + 0.5259586125612259, + 0.38688725233078003, + 0.6775064170360565, + 0.2491048313677311, + 0.9769286252558231, + 0.2222229577600956, + 1.0614556185901165, + 0.32457977533340454, + 0.40651496313512325, + 0.3503606840968132, + 0.36273303255438805, + 0.39087745919823647, + 0.557506188750267, + 1.4607050623744726, + 0.5255918130278587, + 0.16438870131969452, + 0.6538540329784155, + 0.4728733915835619, + 0.5086654350161552, + 0.05967102572321892, + 0.9014226980507374, + 0.4160771667957306, + 0.04926043003797531, + 0.3513798713684082, + 0.5125620290637016, + 0.17437854409217834, + 1.718743808567524, + 0.33601779863238335, + 0.5564635954797268, + 1.0608106423169374, + 0.506803072988987, + 0.08279474079608917 + ], + "unique_experts": 64, + "load_cv": 0.5264684804932246, + "normalized_load_entropy": 0.9670490176047041, + "max_load_share": 0.038288288288288286 + }, + "full_input": { + "tokens": 115, + "top_k": 6, + "decisions": 690, + "ordered_route_sha256": "bb02344c67990e2fc1c837ba428da4d8a1282ec37ed836e160d29f3e706b52bb", + "route_weight_sha256": "6d01c0a9a614b27a572e61f6a302027a8a4521460c5875c03e91289b0485e532", + "loads": [ + 12, + 21, + 12, + 13, + 5, + 12, + 2, + 15, + 18, + 8, + 11, + 5, + 7, + 10, + 11, + 9, + 11, + 16, + 8, + 9, + 7, + 15, + 7, + 12, + 11, + 18, + 1, + 10, + 7, + 10, + 10, + 9, + 6, + 5, + 14, + 21, + 4, + 5, + 15, + 8, + 10, + 6, + 16, + 9, + 6, + 13, + 15, + 11, + 13, + 10, + 8, + 11, + 15, + 7, + 2, + 6, + 13, + 11, + 18, + 15, + 15, + 16, + 18, + 16 + ], + "weighted_loads": [ + 1.3292667418718338, + 1.5451055616140366, + 0.5170895401388407, + 1.4346402175724506, + 0.19349083118140697, + 1.0396210439503193, + 0.0771302841603756, + 0.9415643978863955, + 1.4201428163796663, + 0.48279699869453907, + 0.5005246289074421, + 0.24502940848469734, + 0.3354259431362152, + 0.35351395793259144, + 0.52510816603899, + 0.6248661540448666, + 0.45342438854277134, + 1.459569826722145, + 0.9175064489245415, + 1.0403042379766703, + 0.6650638356804848, + 1.1264588683843613, + 1.1072095073759556, + 0.4159292187541723, + 0.5535295456647873, + 1.5423830710351467, + 0.07565876841545105, + 0.9318379368633032, + 0.37049229070544243, + 1.0599485635757446, + 0.5796913653612137, + 0.3568442650139332, + 0.5259586125612259, + 0.38688725233078003, + 1.0454613957554102, + 2.090417175553739, + 0.9951206147670746, + 0.264209508895874, + 1.327360449358821, + 0.6806745901703835, + 0.40651496313512325, + 0.3503606840968132, + 1.621190631762147, + 0.5715977437794209, + 1.200839713215828, + 1.4607050623744726, + 1.1767135858535767, + 0.5317482128739357, + 0.7228077575564384, + 0.5163732636719942, + 0.5577662102878094, + 1.0349883623421192, + 1.0773247368633747, + 0.600439053028822, + 0.04926043003797531, + 0.3513798713684082, + 0.7965093348175287, + 0.47882016375660896, + 1.8285852633416653, + 0.7418770268559456, + 1.2647799206897616, + 1.529731536284089, + 1.4578524306416512, + 1.303812487050891 + ], + "unique_experts": 64, + "load_cv": 0.422343806768031, + "normalized_load_entropy": 0.9767460090327784, + "max_load_share": 0.030434782608695653 + } + }, + "s0_x": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "6ef98e918a497a5840d951fe11713acf637bfd135c5af8df741621aaf8739fad", + "route_weight_sha256": "82a2c8b4069fc9860811991dcca908ef07b25152c30afa5c8c0b0fac14ed2e84", + "loads": [ + 9, + 10, + 9, + 10, + 5, + 11, + 2, + 12, + 10, + 7, + 2, + 4, + 5, + 5, + 2, + 8, + 7, + 16, + 8, + 3, + 5, + 4, + 6, + 12, + 6, + 16, + 1, + 6, + 5, + 10, + 8, + 7, + 6, + 6, + 5, + 4, + 3, + 3, + 9, + 5, + 11, + 5, + 6, + 8, + 3, + 13, + 7, + 4, + 9, + 9, + 6, + 3, + 14, + 4, + 3, + 7, + 8, + 5, + 16, + 7, + 4, + 10, + 8, + 2 + ], + "weighted_loads": [ + 0.871093399822712, + 0.5358177069574594, + 0.40180235356092453, + 0.6500871032476425, + 0.17831210419535637, + 0.8893610835075378, + 0.07908173277974129, + 0.7077621407806873, + 0.6961628198623657, + 0.36636417731642723, + 0.12693672999739647, + 0.20487461425364017, + 0.24956509470939636, + 0.19139765948057175, + 0.06811517104506493, + 0.5636386089026928, + 0.3315909933298826, + 1.5024128928780556, + 0.891759380698204, + 0.3155766427516937, + 0.3836916908621788, + 0.3123541995882988, + 1.0091748759150505, + 0.4051211401820183, + 0.31233949214220047, + 1.4265701659023762, + 0.07208969444036484, + 0.2461266592144966, + 0.15356754325330257, + 1.0208022259175777, + 0.5090985894203186, + 0.2802936043590307, + 0.5177748426795006, + 0.4160901512950659, + 0.6683669462800026, + 0.29387756809592247, + 0.9619823023676872, + 0.19095230102539062, + 1.0813164599239826, + 0.34266622737050056, + 0.43760344572365284, + 0.31554210744798183, + 0.39657519571483135, + 0.36774735897779465, + 0.5373355373740196, + 1.4011466465890408, + 0.5206187106668949, + 0.15381795167922974, + 0.5751594696193933, + 0.4746108204126358, + 0.5100133679807186, + 0.10666918195784092, + 0.9298860132694244, + 0.41590385884046555, + 0.07235386595129967, + 0.3592052683234215, + 0.5299727953970432, + 0.22286440059542656, + 1.6589590460062027, + 0.38528092205524445, + 0.5902681276202202, + 1.1646630056202412, + 0.5748019032180309, + 0.08643654733896255 + ], + "unique_experts": 64, + "load_cv": 0.5127226405453044, + "normalized_load_entropy": 0.9688171595114811, + "max_load_share": 0.036036036036036036 + }, + "full_input": { + "tokens": 99, + "top_k": 6, + "decisions": 594, + "ordered_route_sha256": "33cdae0c9e3bea9ce6a2a7b8b8931343b4e573f392a96e5719d841b0092cee10", + "route_weight_sha256": "2e5ed9972d59f1cd1b897fc302b07ae38a2da92300f312b9b047126371cfb111", + "loads": [ + 9, + 20, + 9, + 11, + 5, + 11, + 3, + 14, + 13, + 7, + 7, + 5, + 7, + 7, + 6, + 8, + 8, + 16, + 8, + 7, + 7, + 14, + 6, + 12, + 8, + 16, + 1, + 8, + 7, + 10, + 8, + 7, + 6, + 6, + 10, + 19, + 3, + 3, + 13, + 5, + 11, + 5, + 13, + 8, + 3, + 13, + 9, + 9, + 10, + 9, + 8, + 8, + 14, + 4, + 3, + 7, + 8, + 13, + 25, + 11, + 16, + 13, + 13, + 11 + ], + "weighted_loads": [ + 0.871093399822712, + 1.4807936865836382, + 0.40180235356092453, + 1.3752595633268356, + 0.17831210419535637, + 0.8893610835075378, + 0.11429808661341667, + 0.8896847404539585, + 0.8844890519976616, + 0.36636417731642723, + 0.36134253069758415, + 0.24004691652953625, + 0.32066272012889385, + 0.24278241768479347, + 0.25099679082632065, + 0.5636386089026928, + 0.3625860847532749, + 1.5024128928780556, + 0.891759380698204, + 1.0303756296634674, + 0.6849465593695641, + 1.314094565808773, + 1.0091748759150505, + 0.4051211401820183, + 0.4205249138176441, + 1.4265701659023762, + 0.07208969444036484, + 0.5043649449944496, + 0.4147703554481268, + 1.0208022259175777, + 0.5090985894203186, + 0.2802936043590307, + 0.5177748426795006, + 0.4160901512950659, + 0.891514029353857, + 2.282794496975839, + 0.9619823023676872, + 0.19095230102539062, + 1.1992755234241486, + 0.34266622737050056, + 0.43760344572365284, + 0.31554210744798183, + 1.1285570990294218, + 0.36774735897779465, + 0.5373355373740196, + 1.4011466465890408, + 0.5872690677642822, + 0.42697783559560776, + 0.6007568147033453, + 0.4746108204126358, + 0.5542907156050205, + 0.672890217974782, + 0.9298860132694244, + 0.41590385884046555, + 0.07235386595129967, + 0.3592052683234215, + 0.5299727953970432, + 0.6396813355386257, + 2.151176743209362, + 0.5553149897605181, + 1.5007581887766719, + 1.350589081645012, + 1.0249117109924555, + 0.6037837080657482 + ], + "unique_experts": 64, + "load_cv": 0.4767253495639713, + "normalized_load_entropy": 0.973261175875455, + "max_load_share": 0.04208754208754209 + } + }, + "s1_x": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "631524e7434eaeecf8c99ee2c05d0e5bbe12adee99c32b8581c12ecc3405e33c", + "route_weight_sha256": "ac12211ab3f7c1c9dc1d56d89174cf6835211eb56fbb367f237ae1c2072396a7", + "loads": [ + 8, + 10, + 11, + 10, + 5, + 11, + 2, + 12, + 9, + 7, + 4, + 6, + 5, + 7, + 1, + 8, + 7, + 16, + 8, + 3, + 5, + 4, + 7, + 12, + 6, + 17, + 1, + 7, + 3, + 10, + 9, + 5, + 6, + 7, + 5, + 3, + 3, + 3, + 10, + 5, + 10, + 7, + 5, + 8, + 3, + 13, + 7, + 4, + 11, + 10, + 7, + 2, + 13, + 4, + 1, + 6, + 8, + 3, + 16, + 6, + 4, + 9, + 7, + 2 + ], + "weighted_loads": [ + 0.8200937323272228, + 0.5309572108089924, + 0.48821780644357204, + 0.6333702187985182, + 0.19220907986164093, + 0.8879252150654793, + 0.07551111653447151, + 0.6991685945540667, + 0.6901586651802063, + 0.3743549082428217, + 0.19135914370417595, + 0.27665875665843487, + 0.2647406943142414, + 0.26460930332541466, + 0.04204358160495758, + 0.5985338762402534, + 0.3301269132643938, + 1.4840471670031548, + 0.8999841921031475, + 0.3137011304497719, + 0.4067582245916128, + 0.31329571455717087, + 1.1208933908492327, + 0.41223248466849327, + 0.3103218711912632, + 1.4972430877387524, + 0.07305976748466492, + 0.24916324391961098, + 0.1025877594947815, + 1.043890319764614, + 0.5454204939305782, + 0.255050715059042, + 0.518235232681036, + 0.44095412641763687, + 0.6847353801131248, + 0.2563491053879261, + 0.9738804586231709, + 0.18192986026406288, + 1.060322867706418, + 0.3190692365169525, + 0.4137254822999239, + 0.38078908436000347, + 0.346807274967432, + 0.3868529237806797, + 0.5600748509168625, + 1.4445329941809177, + 0.5312494225800037, + 0.16316192597150803, + 0.6499316953122616, + 0.48900007642805576, + 0.5334252268075943, + 0.07379394769668579, + 0.8831777535378933, + 0.40537095069885254, + 0.025606980547308922, + 0.3496292345225811, + 0.5094072371721268, + 0.15215351432561874, + 1.7040677964687347, + 0.3385670240968466, + 0.5300240442156792, + 1.0162182003259659, + 0.49494145810604095, + 0.07744082808494568 + ], + "unique_experts": 64, + "load_cv": 0.5332085317822591, + "normalized_load_entropy": 0.9652038003453947, + "max_load_share": 0.038288288288288286 + }, + "full_input": { + "tokens": 115, + "top_k": 6, + "decisions": 690, + "ordered_route_sha256": "536c37d06f520b1579b106cbef7155b55732c14091152d4d39fbc1dd3f7457e4", + "route_weight_sha256": "6d3f8938aee78eded1adf517871ec7dc8dbcecb6f3e7588f61502e92fc2ce32d", + "loads": [ + 12, + 21, + 12, + 12, + 6, + 12, + 2, + 16, + 18, + 8, + 13, + 7, + 6, + 9, + 9, + 9, + 10, + 16, + 8, + 9, + 7, + 16, + 8, + 12, + 11, + 18, + 1, + 10, + 7, + 10, + 10, + 7, + 6, + 7, + 14, + 21, + 4, + 4, + 15, + 8, + 10, + 7, + 15, + 9, + 6, + 13, + 15, + 12, + 13, + 11, + 10, + 10, + 14, + 7, + 1, + 6, + 13, + 10, + 19, + 15, + 16, + 15, + 17, + 15 + ], + "weighted_loads": [ + 1.3412243947386742, + 1.5409445613622665, + 0.513741210103035, + 1.3903250712901354, + 0.22259998507797718, + 1.0279512777924538, + 0.07551111653447151, + 0.9387980941683054, + 1.427568243816495, + 0.491373123601079, + 0.6115607768297195, + 0.31153674609959126, + 0.2910357993096113, + 0.3161185272037983, + 0.4718267861753702, + 0.6310159452259541, + 0.4283085186034441, + 1.4840471670031548, + 0.8999841921031475, + 1.0482232589274645, + 0.6827653702348471, + 1.4119848795235157, + 1.1596394833177328, + 0.41223248466849327, + 0.5515001118183136, + 1.547558631747961, + 0.07305976748466492, + 0.9215079136192799, + 0.3715144321322441, + 1.043890319764614, + 0.5794674381613731, + 0.2977684214711189, + 0.518235232681036, + 0.44095412641763687, + 1.0526903588324785, + 2.0652642464265227, + 0.9925387743860483, + 0.2239164113998413, + 1.209051813930273, + 0.6751640513539314, + 0.4137254822999239, + 0.38078908436000347, + 1.5468529425561428, + 0.5675732083618641, + 1.2034083753824234, + 1.4445329941809177, + 1.1815059967339039, + 0.5586712267249823, + 0.7188854198902845, + 0.5324999485164881, + 0.6059708259999752, + 0.9737800657749176, + 1.0590797923505306, + 0.5897328369319439, + 0.025606980547308922, + 0.3496292345225811, + 0.7933545429259539, + 0.4545325040817261, + 1.919625896960497, + 0.7477253116667271, + 1.28404760081321, + 1.4941505193710327, + 1.3926227539777756, + 1.0192918051034212 + ], + "unique_experts": 64, + "load_cv": 0.41978980747710837, + "normalized_load_entropy": 0.9767720402168819, + "max_load_share": 0.030434782608695653 + } + }, + "s0_period": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "11e813f17caa72d8b82c776cbdbc66f99bd0754cb55b9c3197dd5bd67b5ce8ac", + "route_weight_sha256": "fa261afdb3187201043496fc8e88021c4f86df565883564fee516cc052bb96c5", + "loads": [ + 9, + 10, + 8, + 10, + 5, + 11, + 2, + 12, + 10, + 7, + 2, + 4, + 6, + 4, + 2, + 8, + 8, + 16, + 8, + 3, + 5, + 4, + 6, + 13, + 6, + 16, + 1, + 6, + 4, + 10, + 8, + 6, + 6, + 6, + 5, + 4, + 3, + 3, + 9, + 5, + 11, + 5, + 6, + 8, + 3, + 13, + 7, + 4, + 10, + 9, + 6, + 2, + 14, + 4, + 3, + 7, + 8, + 5, + 16, + 8, + 4, + 10, + 8, + 2 + ], + "weighted_loads": [ + 0.8706006966531277, + 0.5334743224084377, + 0.384002598002553, + 0.6482258029282093, + 0.17818951047956944, + 0.8876120783388615, + 0.07888446748256683, + 0.7047002874314785, + 0.6955354884266853, + 0.3669298179447651, + 0.12639249116182327, + 0.20609123073518276, + 0.29904728569090366, + 0.1664852350950241, + 0.06940679624676704, + 0.5633140131831169, + 0.3600971680134535, + 1.506456010043621, + 0.8965185210108757, + 0.3163871318101883, + 0.38612972758710384, + 0.3110021911561489, + 1.0074984356760979, + 0.43124844692647457, + 0.3122797794640064, + 1.4436216596513987, + 0.07238824665546417, + 0.2446352019906044, + 0.12664689309895039, + 1.0217408649623394, + 0.5105979423969984, + 0.2532899919897318, + 0.5207654200494289, + 0.41221663914620876, + 0.669491246342659, + 0.28463029488921165, + 0.9648047089576721, + 0.1859961710870266, + 1.0734458677470684, + 0.350310854613781, + 0.43603536672890186, + 0.31328352354466915, + 0.39126708172261715, + 0.3699503131210804, + 0.5483247935771942, + 1.41664401255548, + 0.5192884467542171, + 0.15584589540958405, + 0.6033635921776295, + 0.47002800926566124, + 0.512524863705039, + 0.05967143177986145, + 0.9260383322834969, + 0.4081299379467964, + 0.07264672592282295, + 0.36131060123443604, + 0.5343609265983105, + 0.22209180891513824, + 1.6638988144695759, + 0.4159162752330303, + 0.5828518904745579, + 1.1355443894863129, + 0.5829375274479389, + 0.08420399948954582 + ], + "unique_experts": 64, + "load_cv": 0.522755462212757, + "normalized_load_entropy": 0.9674177282164125, + "max_load_share": 0.036036036036036036 + }, + "full_input": { + "tokens": 99, + "top_k": 6, + "decisions": 594, + "ordered_route_sha256": "19e272873913eea2fa2109cc9c399554eb8795bd489da99151dacbeaee4a6298", + "route_weight_sha256": "6f3d37af2681081a443c30d19a6029f2194499968c182f2f31e21bfca2ce2a87", + "loads": [ + 10, + 20, + 8, + 12, + 5, + 11, + 2, + 14, + 14, + 7, + 5, + 4, + 7, + 6, + 6, + 9, + 8, + 16, + 8, + 7, + 7, + 13, + 6, + 13, + 9, + 16, + 1, + 8, + 6, + 10, + 8, + 6, + 6, + 7, + 10, + 18, + 3, + 3, + 14, + 5, + 11, + 5, + 13, + 8, + 3, + 13, + 10, + 9, + 12, + 9, + 8, + 7, + 14, + 4, + 3, + 7, + 8, + 13, + 24, + 12, + 17, + 13, + 13, + 10 + ], + "weighted_loads": [ + 1.1663126908242702, + 1.4784503020346165, + 0.384002598002553, + 1.4062463827431202, + 0.17818951047956944, + 0.8876120783388615, + 0.07888446748256683, + 0.8830725513398647, + 0.9318365007638931, + 0.3669298179447651, + 0.25241653993725777, + 0.20609123073518276, + 0.33620508946478367, + 0.21670677326619625, + 0.25237566605210304, + 0.6081922315061092, + 0.3600971680134535, + 1.506456010043621, + 0.8965185210108757, + 1.0555699616670609, + 0.6299864258617163, + 1.1830255277454853, + 1.0074984356760979, + 0.43124844692647457, + 0.44991894625127316, + 1.4436216596513987, + 0.07238824665546417, + 0.5069386586546898, + 0.35931977815926075, + 1.0217408649623394, + 0.5105979423969984, + 0.2532899919897318, + 0.5207654200494289, + 0.46029446460306644, + 0.8926383294165134, + 2.2117584412917495, + 0.9648047089576721, + 0.1859961710870266, + 1.2501924112439156, + 0.350310854613781, + 0.43603536672890186, + 0.31328352354466915, + 1.1495239604264498, + 0.3699503131210804, + 0.5483247935771942, + 1.41664401255548, + 0.6119050104171038, + 0.4318571873009205, + 0.6552104093134403, + 0.47002800926566124, + 0.557079404592514, + 0.6051637604832649, + 0.9260383322834969, + 0.4081299379467964, + 0.07264672592282295, + 0.36131060123443604, + 0.5343609265983105, + 0.634293869137764, + 2.0270646028220654, + 0.5819496866315603, + 1.499320582486689, + 1.3308306448161602, + 1.036259176209569, + 0.5523637682199478 + ], + "unique_experts": 64, + "load_cv": 0.4850238179048248, + "normalized_load_entropy": 0.9716255566728, + "max_load_share": 0.04040404040404041 + } + }, + "s1_period": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "13d86220825505d4bfcd4264ef2d4d9b26dfb2fb4250991b8068674e290b40d1", + "route_weight_sha256": "00f9a04778a86fe896d50c29d9ac0e4cd1137feea7b82f4cb80470e18262cb47", + "loads": [ + 8, + 10, + 11, + 10, + 4, + 11, + 3, + 11, + 9, + 7, + 4, + 6, + 6, + 7, + 1, + 8, + 8, + 16, + 8, + 3, + 5, + 4, + 7, + 12, + 6, + 17, + 1, + 7, + 3, + 10, + 9, + 5, + 6, + 6, + 5, + 3, + 3, + 3, + 9, + 5, + 10, + 7, + 5, + 8, + 3, + 13, + 7, + 4, + 10, + 10, + 7, + 1, + 13, + 4, + 3, + 6, + 9, + 3, + 16, + 6, + 4, + 9, + 7, + 2 + ], + "weighted_loads": [ + 0.8177430741488934, + 0.5319130700081587, + 0.489002225920558, + 0.637669624760747, + 0.16518844664096832, + 0.8919944651424885, + 0.09957144595682621, + 0.675948441028595, + 0.6860641464591026, + 0.3727277796715498, + 0.19334499910473824, + 0.27697465382516384, + 0.3059478383511305, + 0.27002257481217384, + 0.0415913350880146, + 0.5977149568498135, + 0.35413762740790844, + 1.4807971380650997, + 0.890471238642931, + 0.31317288428545, + 0.4069291837513447, + 0.31519537419080734, + 1.1227369718253613, + 0.41342453099787235, + 0.3098762109875679, + 1.5025304593145847, + 0.07389387488365173, + 0.2480464857071638, + 0.10257246159017086, + 1.043594315648079, + 0.5459261890500784, + 0.26171111315488815, + 0.5220059342682362, + 0.41143111884593964, + 0.6883760094642639, + 0.25505876913666725, + 0.9722522012889385, + 0.18301746621727943, + 1.0307661183178425, + 0.32249512895941734, + 0.4103009831160307, + 0.3791304547339678, + 0.34377092123031616, + 0.3884589523077011, + 0.5612332448363304, + 1.4566335435956717, + 0.528193473815918, + 0.1633666716516018, + 0.6248465366661549, + 0.4882550798356533, + 0.5329566430300474, + 0.028934460133314133, + 0.8831828068941832, + 0.40508855134248734, + 0.08010948821902275, + 0.3511744849383831, + 0.5404581259936094, + 0.15217576920986176, + 1.7090269662439823, + 0.34213036857545376, + 0.5206383019685745, + 0.9920244216918945, + 0.5023219063878059, + 0.07681240886449814 + ], + "unique_experts": 64, + "load_cv": 0.5233761278658672, + "normalized_load_entropy": 0.9666879688241453, + "max_load_share": 0.038288288288288286 + }, + "full_input": { + "tokens": 115, + "top_k": 6, + "decisions": 690, + "ordered_route_sha256": "a5d4b9e654e6a2e028fda97bc753954f91353c407d4140873c7e6651dc737cf3", + "route_weight_sha256": "ea657dce5b61e97564dbfddc70d0f792216367725367f889251b7dfe8ddd78d0", + "loads": [ + 13, + 21, + 13, + 13, + 5, + 12, + 3, + 15, + 19, + 8, + 11, + 6, + 7, + 9, + 9, + 10, + 11, + 16, + 8, + 9, + 7, + 15, + 8, + 12, + 11, + 18, + 1, + 10, + 7, + 10, + 10, + 7, + 6, + 7, + 14, + 20, + 3, + 4, + 15, + 8, + 10, + 7, + 15, + 9, + 6, + 13, + 16, + 12, + 13, + 11, + 10, + 8, + 14, + 7, + 3, + 6, + 14, + 9, + 18, + 15, + 17, + 15, + 17, + 14 + ], + "weighted_loads": [ + 1.6080114766955376, + 1.5419004205614328, + 0.5331206973642111, + 1.4299518037587404, + 0.19557935185730457, + 1.032020527869463, + 0.09957144595682621, + 0.9118853285908699, + 1.4693581629544497, + 0.4897459950298071, + 0.4991793818771839, + 0.27697465382516384, + 0.3402652982622385, + 0.32118913903832436, + 0.4714166522026062, + 0.6651345901191235, + 0.45101277716457844, + 1.4807971380650997, + 0.890471238642931, + 1.0772730130702257, + 0.6397936902940273, + 1.2419150657951832, + 1.1614830642938614, + 0.41342453099787235, + 0.5507356077432632, + 1.5528460033237934, + 0.07389387488365173, + 0.9247641395777464, + 0.3405934330075979, + 1.043594315648079, + 0.5799731332808733, + 0.3044288195669651, + 0.5220059342682362, + 0.45175326615571976, + 1.0563309881836176, + 2.00004496332258, + 0.9722522012889385, + 0.22500401735305786, + 1.247096860781312, + 0.6785899437963963, + 0.4103009831160307, + 0.3791304547339678, + 1.5641052909195423, + 0.5691792368888855, + 1.2045667693018913, + 1.4566335435956717, + 1.2045522332191467, + 0.5638751722872257, + 0.7179347183555365, + 0.5317549519240856, + 0.6056465096771717, + 0.8669442012906075, + 1.0590848457068205, + 0.5894504375755787, + 0.08010948821902275, + 0.3511744849383831, + 0.8244054317474365, + 0.4177488535642624, + 1.8188684210181236, + 0.7543785404413939, + 1.2916692858561873, + 1.478718712925911, + 1.401173934340477, + 0.962294040247798 + ], + "unique_experts": 64, + "load_cv": 0.4143102871914645, + "normalized_load_entropy": 0.9778896174784742, + "max_load_share": 0.030434782608695653 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 74, + "ordered_topk_exact_tokens": 52, + "set_exact_tokens": 61, + "mean_set_jaccard": 0.9498069498069499, + "mean_token_weighted_tv": 0.010219762227623849, + "aggregate_load_tv": 0.024774774774774765 + }, + "system_bos": { + "tokens": 74, + "ordered_topk_exact_tokens": 47, + "set_exact_tokens": 59, + "mean_set_jaccard": 0.9362934362934362, + "mean_token_weighted_tv": 0.01671013282611966, + "aggregate_load_tv": 0.031531531531531536 + }, + "system_x": { + "tokens": 74, + "ordered_topk_exact_tokens": 44, + "set_exact_tokens": 51, + "mean_set_jaccard": 0.9025096525096524, + "mean_token_weighted_tv": 0.02182741987997213, + "aggregate_load_tv": 0.04504504504504503 + }, + "system_period": { + "tokens": 74, + "ordered_topk_exact_tokens": 44, + "set_exact_tokens": 51, + "mean_set_jaccard": 0.9054054054054054, + "mean_token_weighted_tv": 0.021441229744940192, + "aggregate_load_tv": 0.04504504504504504 + }, + "bos_at_s0": { + "tokens": 74, + "ordered_topk_exact_tokens": 32, + "set_exact_tokens": 46, + "mean_set_jaccard": 0.8774131274131275, + "mean_token_weighted_tv": 0.029036469304481068, + "aggregate_load_tv": 0.05855855855855856 + }, + "bos_at_s1": { + "tokens": 74, + "ordered_topk_exact_tokens": 40, + "set_exact_tokens": 46, + "mean_set_jaccard": 0.8832046332046333, + "mean_token_weighted_tv": 0.02652738639782812, + "aggregate_load_tv": 0.04954954954954955 + }, + "x_at_s0": { + "tokens": 74, + "ordered_topk_exact_tokens": 29, + "set_exact_tokens": 43, + "mean_set_jaccard": 0.8629343629343629, + "mean_token_weighted_tv": 0.030046071970482934, + "aggregate_load_tv": 0.05855855855855856 + }, + "x_at_s1": { + "tokens": 74, + "ordered_topk_exact_tokens": 38, + "set_exact_tokens": 43, + "mean_set_jaccard": 0.862934362934363, + "mean_token_weighted_tv": 0.02969797992625752, + "aggregate_load_tv": 0.0608108108108108 + }, + "period_at_s0": { + "tokens": 74, + "ordered_topk_exact_tokens": 29, + "set_exact_tokens": 41, + "mean_set_jaccard": 0.8523166023166024, + "mean_token_weighted_tv": 0.030656014279638592, + "aggregate_load_tv": 0.06531531531531531 + }, + "period_at_s1": { + "tokens": 74, + "ordered_topk_exact_tokens": 37, + "set_exact_tokens": 43, + "mean_set_jaccard": 0.8716216216216216, + "mean_token_weighted_tv": 0.028864922870353266, + "aggregate_load_tv": 0.05855855855855855 + } + } + }, + "layer_03": { + "layer": 3, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "ed7daa286f50e78814a95bea2a17072359612e9b168f903c73e21be29bf755bd", + "route_weight_sha256": "04264f65094efc7b6e41bc3c5528f04e0dca2afc9d6178b21af13bba24abb5b2", + "loads": [ + 0, + 6, + 16, + 3, + 6, + 4, + 6, + 3, + 16, + 2, + 3, + 8, + 17, + 1, + 5, + 4, + 9, + 6, + 4, + 10, + 4, + 2, + 5, + 6, + 8, + 6, + 24, + 14, + 1, + 2, + 11, + 6, + 7, + 18, + 4, + 3, + 3, + 2, + 9, + 2, + 4, + 7, + 17, + 7, + 7, + 9, + 10, + 6, + 3, + 4, + 4, + 12, + 7, + 10, + 10, + 11, + 5, + 3, + 4, + 8, + 6, + 6, + 13, + 5 + ], + "weighted_loads": [ + 0.0, + 0.31536450050771236, + 1.3649466540664434, + 0.21415278688073158, + 0.5088066086173058, + 0.15215958654880524, + 0.6185045391321182, + 0.12806108221411705, + 1.0833243541419506, + 0.06661256961524487, + 0.11819631606340408, + 0.6210169792175293, + 1.0212204921990633, + 0.03705606609582901, + 0.43212850764393806, + 1.1878527700901031, + 0.8604659289121628, + 0.3696136511862278, + 0.1545671634376049, + 0.6624353583902121, + 0.2550596334040165, + 0.18273888528347015, + 0.3026919476687908, + 0.20269603841006756, + 0.9914845675230026, + 0.30851115472614765, + 2.8763675782829523, + 1.3481483850628138, + 0.022435298189520836, + 0.10196375846862793, + 0.9288696981966496, + 0.641846664249897, + 0.6571459881961346, + 1.7135728728026152, + 0.21335754729807377, + 0.11505669355392456, + 0.1031695269048214, + 0.07481444999575615, + 0.45576654002070427, + 0.06754366308450699, + 0.26419295743107796, + 0.43910225480794907, + 1.0990840923041105, + 0.5433592088520527, + 0.43421879038214684, + 0.5654969252645969, + 1.0387539230287075, + 0.40482015162706375, + 0.08751268684864044, + 0.3418060168623924, + 0.17504817247390747, + 0.9605105146765709, + 0.7393081001937389, + 0.7918548583984375, + 0.9315951596945524, + 0.8216452226042747, + 0.39895180985331535, + 0.16353001818060875, + 0.32159077748656273, + 0.4897112362086773, + 0.21188739500939846, + 0.5831688418984413, + 2.01718670129776, + 0.21978997066617012 + ], + "unique_experts": 63, + "load_cv": 0.6812979301100768, + "normalized_load_entropy": 0.9484123054008022, + "max_load_share": 0.05405405405405406 + }, + "full_input": { + "tokens": 99, + "top_k": 6, + "decisions": 594, + "ordered_route_sha256": "d1edebbe382f6926ef1451df96e163d0344244b10b3b9f3d45a84fa98fdd8e85", + "route_weight_sha256": "f05a30a2ef7092d14dc8ff4071e2940cff30a4a4aeefc8d4208b2d4289b5a4f6", + "loads": [ + 9, + 6, + 16, + 13, + 9, + 7, + 7, + 11, + 16, + 7, + 4, + 9, + 19, + 5, + 12, + 4, + 9, + 6, + 4, + 10, + 6, + 5, + 11, + 7, + 8, + 8, + 24, + 21, + 1, + 5, + 12, + 6, + 7, + 18, + 13, + 3, + 3, + 2, + 9, + 2, + 4, + 8, + 26, + 8, + 8, + 9, + 23, + 6, + 10, + 14, + 5, + 12, + 8, + 10, + 14, + 11, + 5, + 4, + 5, + 8, + 13, + 6, + 16, + 7 + ], + "weighted_loads": [ + 1.3036312498152256, + 0.31536450050771236, + 1.3649466540664434, + 0.8057800456881523, + 0.5927891542087309, + 0.27126476541161537, + 0.6637690961360931, + 1.3829716593027115, + 1.0833243541419506, + 0.2813776694238186, + 0.15418613702058792, + 0.6218985271407291, + 1.033235211361898, + 0.3761321008205414, + 0.9387414865195751, + 1.1878527700901031, + 0.8604659289121628, + 0.3696136511862278, + 0.1545671634376049, + 0.6624353583902121, + 0.32839493080973625, + 0.4766729697585106, + 0.7075617834925652, + 0.23024220578372478, + 0.9914845675230026, + 0.3221837753080763, + 2.8763675782829523, + 1.6083404179662466, + 0.022435298189520836, + 0.24616316705942154, + 0.9755664430558681, + 0.641846664249897, + 0.6571459881961346, + 1.7135728728026152, + 1.2434092331677675, + 0.11505669355392456, + 0.1031695269048214, + 0.07481444999575615, + 0.45576654002070427, + 0.06754366308450699, + 0.26419295743107796, + 0.4504814175888896, + 1.6425759810954332, + 0.5843608751893044, + 0.4809933975338936, + 0.5654969252645969, + 2.669808218255639, + 0.40482015162706375, + 0.8884642086923122, + 0.9570069350302219, + 0.20557070150971413, + 0.9605105146765709, + 0.7540045790374279, + 0.7918548583984375, + 2.7647691797465086, + 0.8216452226042747, + 0.39895180985331535, + 0.17630020901560783, + 0.40761179849505424, + 0.4897112362086773, + 0.7286176681518555, + 0.5831688418984413, + 2.342421919107437, + 0.29449131712317467 + ], + "unique_experts": 64, + "load_cv": 0.5803662985811153, + "normalized_load_entropy": 0.9623718332277444, + "max_load_share": 0.04377104377104377 + } + }, + "s1_eos": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "a917c27f6ef4169975e96d658053e3fa40bfdab435f0239585faf785275de9d8", + "route_weight_sha256": "865115102ab601d5e116cad61b708225ff6efa907bc941d8fce51f7682f8f348", + "loads": [ + 0, + 7, + 17, + 3, + 6, + 5, + 8, + 3, + 17, + 2, + 5, + 9, + 15, + 1, + 5, + 4, + 10, + 5, + 5, + 10, + 4, + 2, + 5, + 7, + 8, + 7, + 24, + 13, + 1, + 2, + 11, + 6, + 8, + 17, + 4, + 3, + 3, + 1, + 9, + 2, + 4, + 7, + 13, + 7, + 7, + 9, + 10, + 6, + 3, + 4, + 4, + 11, + 6, + 10, + 10, + 11, + 5, + 3, + 4, + 7, + 5, + 6, + 13, + 5 + ], + "weighted_loads": [ + 0.0, + 0.3530420698225498, + 1.393635768443346, + 0.20578182488679886, + 0.5058673601597548, + 0.17901918478310108, + 0.6807330772280693, + 0.13017777726054192, + 1.1217218283563852, + 0.07465438544750214, + 0.16734964586794376, + 0.6734968610107899, + 0.9627491645514965, + 0.035467080771923065, + 0.4279731474816799, + 1.181346371769905, + 0.8828335348516703, + 0.3185049742460251, + 0.17837713286280632, + 0.6477754916995764, + 0.25653520226478577, + 0.18423821777105331, + 0.300059761852026, + 0.2297083493322134, + 1.0083312541246414, + 0.33394013717770576, + 2.8797295689582825, + 1.3090477846562862, + 0.02273913286626339, + 0.09882667660713196, + 0.93419399112463, + 0.6373477764427662, + 0.685410887002945, + 1.6738574765622616, + 0.21891207993030548, + 0.11378885060548782, + 0.10060415044426918, + 0.03544207289814949, + 0.4662918858230114, + 0.06653827801346779, + 0.26436508633196354, + 0.42543991282582283, + 0.9640282485634089, + 0.5358906723558903, + 0.43019112572073936, + 0.5688975006341934, + 1.0119688250124454, + 0.4048292636871338, + 0.08621472306549549, + 0.34467894211411476, + 0.17663054913282394, + 0.9392832443118095, + 0.6840047873556614, + 0.7988482415676117, + 0.9237713851034641, + 0.826549232006073, + 0.4047782141715288, + 0.1611970253288746, + 0.32223184034228325, + 0.4620850011706352, + 0.1807581763714552, + 0.5800241976976395, + 2.006449058651924, + 0.2181781344115734 + ], + "unique_experts": 63, + "load_cv": 0.6560513519148652, + "normalized_load_entropy": 0.9509494944117984, + "max_load_share": 0.05405405405405406 + }, + "full_input": { + "tokens": 115, + "top_k": 6, + "decisions": 690, + "ordered_route_sha256": "78bfc3506501e450021aefabdc5659d7391071c3cff109f0b1555eb1c1c6afbf", + "route_weight_sha256": "1520b5aa583dbc7460fade9042cf6afb4bd40dbf0b22cd95beb3f971adf8f71d", + "loads": [ + 13, + 9, + 17, + 14, + 8, + 11, + 8, + 14, + 17, + 10, + 10, + 10, + 19, + 6, + 14, + 5, + 12, + 5, + 6, + 10, + 6, + 8, + 16, + 7, + 10, + 10, + 24, + 15, + 1, + 5, + 12, + 6, + 8, + 19, + 12, + 3, + 3, + 6, + 9, + 3, + 5, + 8, + 28, + 10, + 8, + 12, + 26, + 6, + 12, + 14, + 5, + 17, + 10, + 15, + 15, + 15, + 5, + 4, + 12, + 8, + 17, + 7, + 18, + 12 + ], + "weighted_loads": [ + 1.6864240691065788, + 0.42658207938075066, + 1.393635768443346, + 0.8636718802154064, + 0.559969566471409, + 0.42746723629534245, + 0.6807330772280693, + 1.466693865135312, + 1.1217218283563852, + 0.47431535087525845, + 0.3099520858377218, + 0.6743784089339897, + 1.0522499712824356, + 0.4384981170296669, + 1.104945421218872, + 1.2300416715443134, + 1.0951262433081865, + 0.3185049742460251, + 0.23426728695631027, + 0.6477754916995764, + 0.3226778842508793, + 0.5701394975185394, + 1.2083667926490307, + 0.2297083493322134, + 1.1098509654402733, + 0.3899752428405918, + 2.8797295689582825, + 1.3759941663593054, + 0.02273913286626339, + 0.23404612764716148, + 0.9755993112921715, + 0.6373477764427662, + 0.685410887002945, + 1.746500488370657, + 1.1369562186300755, + 0.11378885060548782, + 0.10060415044426918, + 0.45158103853464127, + 0.4662918858230114, + 0.11678039655089378, + 0.3390009645372629, + 0.4342740336433053, + 1.677815979346633, + 0.6437770687043667, + 0.4779612496495247, + 0.8105294369161129, + 3.1927112340927124, + 0.4048292636871338, + 1.1992860045284033, + 0.8111992999911308, + 0.20516090281307697, + 1.7170357033610344, + 0.8960188888013363, + 1.5152676776051521, + 2.86524074152112, + 1.0593422707170248, + 0.4047782141715288, + 0.17024163343012333, + 0.8902848623692989, + 0.49236833676695824, + 0.9525436889380217, + 0.6301804631948471, + 2.4202102683484554, + 0.6595401354134083 + ], + "unique_experts": 64, + "load_cv": 0.5126339149635405, + "normalized_load_entropy": 0.9690120226866663, + "max_load_share": 0.04057971014492753 + } + }, + "s0_bos": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "222948d79fdcb9b5212249220a117976f5bae6003a828cba25f7695eb5f6e259", + "route_weight_sha256": "461ddf1db3f40f87fdcda0c3679d672c3290bc8aa5c66244620ede97404aecdd", + "loads": [ + 0, + 8, + 18, + 3, + 6, + 4, + 7, + 3, + 18, + 2, + 5, + 10, + 15, + 1, + 5, + 4, + 9, + 9, + 4, + 10, + 3, + 2, + 4, + 6, + 9, + 7, + 23, + 13, + 0, + 3, + 11, + 7, + 6, + 18, + 2, + 3, + 3, + 2, + 9, + 2, + 2, + 7, + 16, + 7, + 7, + 9, + 10, + 6, + 4, + 3, + 3, + 11, + 7, + 9, + 10, + 11, + 6, + 3, + 4, + 7, + 5, + 6, + 12, + 5 + ], + "weighted_loads": [ + 0.0, + 0.36223772168159485, + 1.4909757394343615, + 0.22659742459654808, + 0.5294724348932505, + 0.15035099163651466, + 0.6500551924109459, + 0.12775402143597603, + 1.1295041665434837, + 0.07430148497223854, + 0.1840197667479515, + 0.7032450903207064, + 0.9574943110346794, + 0.03761197254061699, + 0.45795661211013794, + 1.1088891625404358, + 0.8437550254166126, + 0.45198812894523144, + 0.17156643979251385, + 0.6671633496880531, + 0.1976148560643196, + 0.19682609289884567, + 0.2789559103548527, + 0.20944704301655293, + 1.0197020582854748, + 0.33465784415602684, + 2.7898688670247793, + 1.295769540593028, + 0.0, + 0.14660421386361122, + 0.8838496636599302, + 0.6785596702247858, + 0.6035496331751347, + 1.721173994243145, + 0.11968473345041275, + 0.12064516916871071, + 0.10021912306547165, + 0.08523524552583694, + 0.4746179021894932, + 0.06587404385209084, + 0.19341564923524857, + 0.4457970503717661, + 1.0680141858756542, + 0.5622396059334278, + 0.481383066624403, + 0.5905517637729645, + 1.0163601972162724, + 0.3715239278972149, + 0.13672992028295994, + 0.2878635935485363, + 0.12418044358491898, + 0.914958193898201, + 0.7393039502203465, + 0.7533707618713379, + 0.9073241762816906, + 0.8698945045471191, + 0.4555400125682354, + 0.17319871857762337, + 0.3393189013004303, + 0.4876588135957718, + 0.18459520488977432, + 0.5898158624768257, + 1.9038331806659698, + 0.24024222791194916 + ], + "unique_experts": 62, + "load_cv": 0.6832013329602452, + "normalized_load_entropy": 0.9459672492292864, + "max_load_share": 0.0518018018018018 + }, + "full_input": { + "tokens": 99, + "top_k": 6, + "decisions": 594, + "ordered_route_sha256": "53643d5721869d66f9478c4ec7ffa032c4dc36dc1dab97adad8c68dd2bc05306", + "route_weight_sha256": "2bd55373962a7448df24f211577ddb85a91ecab0e0777ece24f7595517341f38", + "loads": [ + 10, + 8, + 18, + 13, + 9, + 6, + 8, + 11, + 18, + 7, + 7, + 11, + 16, + 5, + 12, + 4, + 9, + 9, + 5, + 10, + 5, + 5, + 10, + 7, + 9, + 8, + 23, + 20, + 0, + 7, + 12, + 7, + 6, + 18, + 10, + 3, + 3, + 2, + 9, + 2, + 2, + 7, + 27, + 8, + 7, + 10, + 23, + 6, + 12, + 13, + 4, + 11, + 7, + 9, + 13, + 12, + 6, + 3, + 5, + 7, + 12, + 6, + 15, + 7 + ], + "weighted_loads": [ + 1.422582108527422, + 0.36223772168159485, + 1.4909757394343615, + 0.8182246834039688, + 0.6174488269607536, + 0.24571086466312408, + 0.7066486850380898, + 1.338285006582737, + 1.1295041665434837, + 0.30867007561028004, + 0.25271183624863625, + 0.7041266382439062, + 0.9579724375798833, + 0.39091552421450615, + 0.9935375899076462, + 1.1088891625404358, + 0.8437550254166126, + 0.45198812894523144, + 0.20846347324550152, + 0.6671633496880531, + 0.26964420080184937, + 0.5086839273571968, + 0.6940561532974243, + 0.23699321039021015, + 1.0197020582854748, + 0.33519076328957453, + 2.7898688670247793, + 1.555961573496461, + 0.0, + 0.33381469547748566, + 0.9305464085191488, + 0.6785596702247858, + 0.6035496331751347, + 1.721173994243145, + 1.1132393293082714, + 0.12064516916871071, + 0.10021912306547165, + 0.08523524552583694, + 0.4746179021894932, + 0.06587404385209084, + 0.19341564923524857, + 0.4457970503717661, + 1.788916863501072, + 0.6040445938706398, + 0.481383066624403, + 0.6299095004796982, + 2.6488600838929415, + 0.3715239278972149, + 1.0233174916356802, + 0.9030645117163658, + 0.1559978798031807, + 0.914958193898201, + 0.7393039502203465, + 0.7533707618713379, + 2.0383198000490665, + 0.9139943942427635, + 0.4555400125682354, + 0.17319871857762337, + 0.41197287291288376, + 0.4876588135957718, + 0.6768199857324362, + 0.5898158624768257, + 2.229068398475647, + 0.31867023929953575 + ], + "unique_experts": 63, + "load_cv": 0.5753439355307026, + "normalized_load_entropy": 0.9616713783884573, + "max_load_share": 0.045454545454545456 + } + }, + "s1_bos": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "4a5d0c051a7ff6fbb3295b79a7b54b60978f764234377ec4222849864bb02a0c", + "route_weight_sha256": "1dec9c6ee990e77ec633253996009d320059a445174355fb2c96d46986ef13d4", + "loads": [ + 0, + 7, + 18, + 3, + 7, + 2, + 7, + 3, + 19, + 2, + 5, + 10, + 15, + 1, + 5, + 4, + 9, + 7, + 4, + 11, + 4, + 2, + 4, + 7, + 8, + 8, + 26, + 13, + 0, + 2, + 11, + 6, + 8, + 18, + 2, + 2, + 3, + 2, + 8, + 1, + 2, + 8, + 14, + 6, + 7, + 9, + 10, + 6, + 5, + 3, + 2, + 11, + 7, + 9, + 10, + 11, + 5, + 5, + 4, + 8, + 6, + 6, + 12, + 4 + ], + "weighted_loads": [ + 0.0, + 0.3404414691030979, + 1.4765975885093212, + 0.20789074152708054, + 0.5336575321853161, + 0.0851498506963253, + 0.6337571181356907, + 0.1339552104473114, + 1.2029139026999474, + 0.07637913525104523, + 0.18771785870194435, + 0.737248407676816, + 0.9686089269816875, + 0.03685731440782547, + 0.43242112547159195, + 1.1044010668992996, + 0.8384455256164074, + 0.3672442752867937, + 0.17886614799499512, + 0.6935255974531174, + 0.25148630142211914, + 0.17980509996414185, + 0.2761909104883671, + 0.2365134172141552, + 0.9466656297445297, + 0.37550152838230133, + 2.8830773811787367, + 1.2920267712324858, + 0.0, + 0.10394580289721489, + 0.8841809798032045, + 0.6464992947876453, + 0.670481126755476, + 1.685729719698429, + 0.12164080888032913, + 0.07784775644540787, + 0.09794276393949986, + 0.0780324786901474, + 0.4487559236586094, + 0.03373243659734726, + 0.19203434884548187, + 0.4398355446755886, + 1.0209929198026657, + 0.47417081519961357, + 0.46417104825377464, + 0.6216677203774452, + 0.9717323072254658, + 0.389480896294117, + 0.16085702553391457, + 0.26107805222272873, + 0.07774646952748299, + 0.9153862185776234, + 0.7326864376664162, + 0.777895100414753, + 0.9300399236381054, + 0.8402264080941677, + 0.4223997760564089, + 0.2367432825267315, + 0.3410772494971752, + 0.5281170532107353, + 0.23552947491407394, + 0.5808237344026566, + 1.8785497471690178, + 0.18935491144657135 + ], + "unique_experts": 62, + "load_cv": 0.71342023232268, + "normalized_load_entropy": 0.94182127151055, + "max_load_share": 0.05855855855855856 + }, + "full_input": { + "tokens": 115, + "top_k": 6, + "decisions": 690, + "ordered_route_sha256": "7b5ea6073f13676bec1eb820bbe8d215d6851e2f8283b362b1c1514578f204a3", + "route_weight_sha256": "b5acf157ca2a71f92225b8a5bf63edd3a65994433d4ec1ac1fe010198010a288", + "loads": [ + 13, + 9, + 18, + 14, + 10, + 6, + 8, + 14, + 19, + 10, + 10, + 11, + 18, + 6, + 14, + 5, + 11, + 7, + 6, + 11, + 6, + 8, + 15, + 7, + 10, + 10, + 26, + 15, + 0, + 5, + 12, + 6, + 8, + 20, + 10, + 2, + 3, + 7, + 8, + 2, + 3, + 8, + 30, + 9, + 7, + 13, + 28, + 6, + 15, + 13, + 3, + 17, + 10, + 14, + 14, + 16, + 5, + 5, + 12, + 9, + 18, + 7, + 17, + 11 + ], + "weighted_loads": [ + 1.7181244902312756, + 0.41398147866129875, + 1.4765975885093212, + 0.8657807968556881, + 0.6185400576214306, + 0.2833891026675701, + 0.6864114031195641, + 1.4161334838718176, + 1.2029139026999474, + 0.49903461523354053, + 0.3303202986717224, + 0.7381299556000158, + 1.0501726199581753, + 0.45572736114263535, + 1.1378849931061268, + 1.153096366673708, + 1.0507382340729237, + 0.3672442752867937, + 0.2714066728949547, + 0.6935255974531174, + 0.32181690633296967, + 0.569042444229126, + 1.1840710304677486, + 0.2365134172141552, + 1.0481853410601616, + 0.42269312735879794, + 2.8830773811787367, + 1.358973152935505, + 0.0, + 0.24081260710954666, + 0.925586299970746, + 0.6464992947876453, + 0.670481126755476, + 1.7583727315068245, + 1.04758395627141, + 0.07784775644540787, + 0.09794276393949986, + 0.4941714443266392, + 0.4487559236586094, + 0.08397455513477325, + 0.26667022705078125, + 0.4398355446755886, + 1.8906227201223373, + 0.5839588977396488, + 0.46417104825377464, + 0.911577332764864, + 3.2162907533347607, + 0.389480896294117, + 1.3404290974140167, + 0.7275984100997448, + 0.1091403104364872, + 1.6931386776268482, + 0.934302631765604, + 1.4943145364522934, + 2.081159610301256, + 1.1115756761282682, + 0.4223997760564089, + 0.2367432825267315, + 0.8918690718710423, + 0.5584003888070583, + 0.9664089009165764, + 0.6309799998998642, + 2.292310956865549, + 0.6343037188053131 + ], + "unique_experts": 63, + "load_cv": 0.5537294078237555, + "normalized_load_entropy": 0.9634422466143884, + "max_load_share": 0.043478260869565216 + } + }, + "s0_x": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "4456b2af54527b4d5f29c56021bef5cac10b07c7349b0fc295bcadba4a4fb4e3", + "route_weight_sha256": "5e95f8838a8a32376bcc84b486dbc3c2ceaf3b8a182621ac96dd5f22071dad5b", + "loads": [ + 0, + 7, + 18, + 3, + 5, + 4, + 6, + 3, + 19, + 2, + 5, + 10, + 15, + 1, + 5, + 4, + 9, + 8, + 4, + 9, + 4, + 2, + 5, + 6, + 8, + 9, + 24, + 13, + 0, + 3, + 11, + 7, + 7, + 18, + 2, + 3, + 2, + 2, + 9, + 2, + 2, + 8, + 15, + 7, + 7, + 9, + 10, + 6, + 4, + 3, + 2, + 12, + 8, + 9, + 10, + 11, + 5, + 3, + 4, + 7, + 5, + 6, + 12, + 5 + ], + "weighted_loads": [ + 0.0, + 0.33535666950047016, + 1.5048118066042662, + 0.2445187047123909, + 0.4847366213798523, + 0.14441324397921562, + 0.6087715141475201, + 0.1258922778069973, + 1.1856574844568968, + 0.06841811910271645, + 0.18462522514164448, + 0.716237461194396, + 0.9647110067307949, + 0.03780195862054825, + 0.44867685064673424, + 1.123994156718254, + 0.8640135228633881, + 0.41184646636247635, + 0.17374662682414055, + 0.6208310779184103, + 0.2500201053917408, + 0.18754664063453674, + 0.32843535020947456, + 0.21431872434914112, + 0.9376796633005142, + 0.39739347249269485, + 2.850929917767644, + 1.272310297936201, + 0.0, + 0.14567624032497406, + 0.9019063711166382, + 0.6816573515534401, + 0.6306090317666531, + 1.7408976964652538, + 0.11766726523637772, + 0.1184675469994545, + 0.06362124718725681, + 0.08826005831360817, + 0.4606733676046133, + 0.06704457104206085, + 0.18943054974079132, + 0.47545180656015873, + 1.0346878580749035, + 0.5578478537499905, + 0.5002587251365185, + 0.5916970856487751, + 0.973195556551218, + 0.383869182318449, + 0.1311584897339344, + 0.2674018107354641, + 0.08437221497297287, + 0.9591953903436661, + 0.7701618149876595, + 0.7575967647135258, + 0.9278816059231758, + 0.8641751259565353, + 0.4078604634851217, + 0.16988609544932842, + 0.3344486206769943, + 0.4654826372861862, + 0.16982543282210827, + 0.5955703482031822, + 1.9229528158903122, + 0.24242664873600006 + ], + "unique_experts": 62, + "load_cv": 0.6959131453829045, + "normalized_load_entropy": 0.9443753693697817, + "max_load_share": 0.05405405405405406 + }, + "full_input": { + "tokens": 99, + "top_k": 6, + "decisions": 594, + "ordered_route_sha256": "8156e50503072d0a199d8dbefdd9868c03c5cd244407c60d189220ec362945bc", + "route_weight_sha256": "a6b4231bbba47cfb0bcd604750a47e228988c9da88b01cbb903d1f29f8f3fabf", + "loads": [ + 7, + 7, + 18, + 14, + 9, + 6, + 7, + 12, + 19, + 7, + 6, + 11, + 16, + 5, + 12, + 4, + 9, + 8, + 4, + 9, + 5, + 5, + 11, + 7, + 8, + 10, + 25, + 21, + 0, + 7, + 12, + 7, + 7, + 18, + 11, + 3, + 3, + 2, + 9, + 2, + 2, + 8, + 25, + 8, + 8, + 10, + 23, + 6, + 10, + 14, + 3, + 12, + 8, + 9, + 13, + 12, + 5, + 3, + 5, + 7, + 12, + 6, + 15, + 7 + ], + "weighted_loads": [ + 1.068653792142868, + 0.33535666950047016, + 1.5048118066042662, + 0.9693995080888271, + 0.5943856813828461, + 0.23060612007975578, + 0.6725568063557148, + 1.375901099294424, + 1.1856574844568968, + 0.32390946336090565, + 0.22061504609882832, + 0.7171190091175959, + 0.9651891332759988, + 0.3903522826731205, + 0.9071952365338802, + 1.123994156718254, + 0.8640135228633881, + 0.41184646636247635, + 0.17374662682414055, + 0.6208310779184103, + 0.276864405721426, + 0.48513171821832657, + 0.7445533499121666, + 0.24186489172279835, + 0.9376796633005142, + 0.39792639162624255, + 2.8936510290950537, + 1.5799776203930378, + 0.0, + 0.3406791388988495, + 0.9486031159758568, + 0.6816573515534401, + 0.6306090317666531, + 1.7408976964652538, + 1.212031502276659, + 0.1184675469994545, + 0.11200087703764439, + 0.08826005831360817, + 0.4606733676046133, + 0.06704457104206085, + 0.18943054974079132, + 0.47545180656015873, + 1.6573699936270714, + 0.6015366837382317, + 0.5540252886712551, + 0.6378446705639362, + 2.6035785656422377, + 0.383869182318449, + 0.8686597160995007, + 0.9461063370108604, + 0.11607937142252922, + 0.9591953903436661, + 0.7701618149876595, + 0.7575967647135258, + 2.0372409261763096, + 0.9125624299049377, + 0.4078604634851217, + 0.16988609544932842, + 0.42164067924022675, + 0.4654826372861862, + 0.6878545843064785, + 0.5955703482031822, + 2.2481880336999893, + 0.3218216598033905 + ], + "unique_experts": 63, + "load_cv": 0.5890524036010051, + "normalized_load_entropy": 0.9597319060560243, + "max_load_share": 0.04208754208754209 + } + }, + "s1_x": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "b29585f6bffb32f6adc70afd160d2136a2b680371a3ee55b8d03c5abd8ac534a", + "route_weight_sha256": "477eb9a51be35fe20577fdaee86b9a8ab7312908d52e72d0d87c794184d66c69", + "loads": [ + 0, + 7, + 18, + 3, + 5, + 3, + 8, + 3, + 20, + 2, + 5, + 10, + 15, + 1, + 5, + 4, + 9, + 5, + 6, + 11, + 4, + 2, + 5, + 7, + 8, + 8, + 25, + 13, + 0, + 3, + 11, + 6, + 7, + 18, + 2, + 2, + 2, + 2, + 8, + 0, + 3, + 9, + 14, + 7, + 7, + 9, + 10, + 6, + 4, + 3, + 1, + 11, + 8, + 9, + 10, + 11, + 5, + 4, + 4, + 7, + 6, + 6, + 12, + 5 + ], + "weighted_loads": [ + 0.0, + 0.34190930984914303, + 1.4734473526477814, + 0.21533378213644028, + 0.4592911619693041, + 0.12323897331953049, + 0.6616660393774509, + 0.13756301626563072, + 1.2580053601413965, + 0.07779117301106453, + 0.1867721565067768, + 0.7388563100248575, + 0.9786558635532856, + 0.03703877329826355, + 0.42952486872673035, + 1.1082690358161926, + 0.8566119037568569, + 0.28828292340040207, + 0.23279350250959396, + 0.6978094801306725, + 0.2521525025367737, + 0.16655992716550827, + 0.3243470676243305, + 0.2333152648061514, + 0.9188017398118973, + 0.36698974296450615, + 2.8867483362555504, + 1.279339985921979, + 0.0, + 0.14416629076004028, + 0.8949215952306986, + 0.6335343811661005, + 0.6172567680478096, + 1.6927621737122536, + 0.12101135030388832, + 0.07483169808983803, + 0.06176702678203583, + 0.07889701426029205, + 0.44150711223483086, + 0.0, + 0.21809617429971695, + 0.4435995537787676, + 1.0463006496429443, + 0.5060874279588461, + 0.4863836094737053, + 0.6331556290388107, + 0.9769934378564358, + 0.39981328696012497, + 0.13169164210557938, + 0.24434897303581238, + 0.040290333330631256, + 0.9154733661562204, + 0.7549813613295555, + 0.7866944968700409, + 0.9396380204707384, + 0.8385668657720089, + 0.4162148553878069, + 0.20256192423403263, + 0.34396662563085556, + 0.4914860613644123, + 0.24131393805146217, + 0.5814031660556793, + 1.9157366752624512, + 0.22668753936886787 + ], + "unique_experts": 61, + "load_cv": 0.7125095311602199, + "normalized_load_entropy": 0.9406126349764672, + "max_load_share": 0.05630630630630631 + }, + "full_input": { + "tokens": 115, + "top_k": 6, + "decisions": 690, + "ordered_route_sha256": "d233e054de1577a5d3d8a52dda114156d16bef8c304d320c8f880766d362b833", + "route_weight_sha256": "d669420a9dd512018cc2fe13d515526301b34b1d62e2f62f77cfb65aa5ac15d5", + "loads": [ + 11, + 9, + 18, + 15, + 7, + 8, + 9, + 14, + 20, + 10, + 10, + 11, + 18, + 6, + 14, + 5, + 11, + 5, + 7, + 11, + 5, + 8, + 16, + 7, + 10, + 10, + 26, + 16, + 0, + 7, + 12, + 6, + 7, + 20, + 10, + 2, + 3, + 7, + 8, + 1, + 4, + 9, + 30, + 10, + 8, + 13, + 26, + 6, + 13, + 14, + 2, + 17, + 11, + 14, + 14, + 16, + 5, + 4, + 12, + 8, + 18, + 7, + 17, + 12 + ], + "weighted_loads": [ + 1.4300157278776169, + 0.41544931940734386, + 1.4734473526477814, + 1.0213120691478252, + 0.491166569001507, + 0.33772856183350086, + 0.7155668847262859, + 1.405511425808072, + 1.2580053601413965, + 0.5186771210283041, + 0.32937459647655487, + 0.7397378579480574, + 1.0602195565297734, + 0.4527428075671196, + 1.0798146650195122, + 1.156964335590601, + 1.0689046122133732, + 0.28828292340040207, + 0.2886836566030979, + 0.6978094801306725, + 0.2842062897980213, + 0.5496256202459335, + 1.2394059672951698, + 0.2333152648061514, + 1.0203214511275291, + 0.41418134194100276, + 2.9257432222366333, + 1.3915123268961906, + 0.0, + 0.3253745660185814, + 0.9363269153982401, + 0.6335343811661005, + 0.6172567680478096, + 1.765405185520649, + 1.0916628278791904, + 0.07483169808983803, + 0.10201510041952133, + 0.49503597989678383, + 0.44150711223483086, + 0.050242118537425995, + 0.2927320525050163, + 0.4435995537787676, + 1.8240084014832973, + 0.6159196700900793, + 0.5343655608594418, + 0.9336769804358482, + 3.1577358469367027, + 0.39981328696012497, + 1.199323620647192, + 0.7705837823450565, + 0.07077682018280029, + 1.6932258252054453, + 0.9565975554287434, + 1.5031139329075813, + 2.0712905284017324, + 1.1129756923764944, + 0.4162148553878069, + 0.20256192423403263, + 0.8989858701825142, + 0.5217693969607353, + 1.0183658935129642, + 0.631559431552887, + 2.3294978849589825, + 0.6729337237775326 + ], + "unique_experts": 63, + "load_cv": 0.5530006363863701, + "normalized_load_entropy": 0.9626840616992739, + "max_load_share": 0.043478260869565216 + } + }, + "s0_period": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "f5b31293957fbbb6d1e7856ca535613e60a036ca4d2ceff91640f03e0f0cd4d6", + "route_weight_sha256": "5212e63d5dbf3f4ff701b8c359f2bbcb1d6b17dcc2954c05e18b8b06e79829d5", + "loads": [ + 0, + 8, + 18, + 3, + 6, + 4, + 6, + 3, + 18, + 2, + 5, + 10, + 15, + 1, + 5, + 4, + 9, + 7, + 4, + 9, + 4, + 2, + 4, + 6, + 8, + 8, + 25, + 13, + 0, + 3, + 11, + 7, + 7, + 18, + 2, + 3, + 3, + 2, + 9, + 2, + 3, + 7, + 15, + 7, + 7, + 9, + 10, + 6, + 4, + 3, + 2, + 12, + 8, + 9, + 10, + 11, + 5, + 3, + 4, + 7, + 5, + 6, + 12, + 5 + ], + "weighted_loads": [ + 0.0, + 0.37798829562962055, + 1.5059145875275135, + 0.23644628003239632, + 0.5161057692021132, + 0.14733047038316727, + 0.6078316271305084, + 0.12269531190395355, + 1.118615448474884, + 0.06705850921571255, + 0.18594931811094284, + 0.7215161416679621, + 0.9615807346999645, + 0.03680097311735153, + 0.4474063962697983, + 1.129415899515152, + 0.8646022155880928, + 0.3864967003464699, + 0.17086328193545341, + 0.619919965043664, + 0.2506854049861431, + 0.18698403239250183, + 0.27500737830996513, + 0.21303513832390308, + 0.9427021071314812, + 0.3614013884216547, + 2.907235035672784, + 1.2826689183712006, + 0.0, + 0.14719556272029877, + 0.9008536841720343, + 0.6860249787569046, + 0.6291532777249813, + 1.740081349387765, + 0.11854702606797218, + 0.11933820694684982, + 0.09965969063341618, + 0.08614889532327652, + 0.4590069092810154, + 0.06705902516841888, + 0.2190258838236332, + 0.44452994130551815, + 1.0141471643000841, + 0.5588372685015202, + 0.5026861131191254, + 0.5920183658599854, + 0.9604625850915909, + 0.38724980875849724, + 0.12997188791632652, + 0.2730841562151909, + 0.08414997905492783, + 0.9524162486195564, + 0.7789307199418545, + 0.7536109052598476, + 0.9154209438711405, + 0.8542457148432732, + 0.40705813840031624, + 0.16850379668176174, + 0.33183659240603447, + 0.46425166353583336, + 0.17061961442232132, + 0.5953657254576683, + 1.9074699580669403, + 0.24119065329432487 + ], + "unique_experts": 62, + "load_cv": 0.6940446052886995, + "normalized_load_entropy": 0.9453784622756389, + "max_load_share": 0.05630630630630631 + }, + "full_input": { + "tokens": 99, + "top_k": 6, + "decisions": 594, + "ordered_route_sha256": "8181b29ae328453b197315d7f17eaeef7092050e45b2d2f70431cccab702f334", + "route_weight_sha256": "b4490f86ce4d617b289ec24bbfbc9019339bd5c38cb65018fc791a869d5421a0", + "loads": [ + 7, + 9, + 18, + 14, + 10, + 6, + 7, + 12, + 18, + 8, + 6, + 11, + 16, + 5, + 12, + 4, + 9, + 7, + 4, + 9, + 5, + 5, + 11, + 7, + 8, + 9, + 25, + 20, + 0, + 7, + 12, + 7, + 7, + 18, + 10, + 3, + 3, + 2, + 9, + 2, + 3, + 7, + 25, + 8, + 8, + 11, + 23, + 6, + 10, + 13, + 3, + 12, + 8, + 9, + 13, + 12, + 5, + 3, + 6, + 7, + 12, + 6, + 15, + 7 + ], + "weighted_loads": [ + 1.0030419453978539, + 0.5244525838643312, + 1.5059145875275135, + 0.8978453129529953, + 0.6360673324088566, + 0.23375775665044785, + 0.6821527779102325, + 1.3985983654856682, + 1.118615448474884, + 0.48033279180526733, + 0.22193913906812668, + 0.7223976895911619, + 0.9620588612451684, + 0.3875318095088005, + 1.0298565104603767, + 1.129415899515152, + 0.8646022155880928, + 0.3864967003464699, + 0.17086328193545341, + 0.619919965043664, + 0.2775297053158283, + 0.47864880412817, + 0.7392551638185978, + 0.2405813056975603, + 0.9427021071314812, + 0.3619343075552024, + 2.907235035672784, + 1.5428609512746334, + 0.0, + 0.334754042327404, + 0.9475504290312529, + 0.6860249787569046, + 0.6291532777249813, + 1.740081349387765, + 1.1121016219258308, + 0.11933820694684982, + 0.09965969063341618, + 0.08614889532327652, + 0.4590069092810154, + 0.06705902516841888, + 0.2190258838236332, + 0.44452994130551815, + 1.6399770062416792, + 0.6022543162107468, + 0.5623335316777229, + 0.6894412040710449, + 2.5916415490210056, + 0.38724980875849724, + 0.8651616163551807, + 0.8882850743830204, + 0.11621716246008873, + 0.9524162486195564, + 0.7789307199418545, + 0.7536109052598476, + 2.02009560726583, + 0.9024278968572617, + 0.40705813840031624, + 0.16850379668176174, + 0.45120181515812874, + 0.46425166353583336, + 0.6455373596400023, + 0.5953657254576683, + 2.2327051758766174, + 0.3204689100384712 + ], + "unique_experts": 63, + "load_cv": 0.5778605734434136, + "normalized_load_entropy": 0.9612652905223573, + "max_load_share": 0.04208754208754209 + } + }, + "s1_period": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "91d0fd1b7a75bd8bbcba4ae1a88c5501fd8611de5a773288645478ff19291b47", + "route_weight_sha256": "b7baab471b89f267af322c5234959044bfc28524eb19f9282e20abe64d2c9902", + "loads": [ + 0, + 7, + 18, + 3, + 5, + 3, + 8, + 3, + 20, + 2, + 6, + 10, + 15, + 1, + 5, + 4, + 9, + 5, + 6, + 11, + 4, + 2, + 4, + 6, + 8, + 8, + 24, + 13, + 0, + 3, + 11, + 6, + 8, + 18, + 2, + 2, + 3, + 2, + 8, + 0, + 3, + 9, + 13, + 7, + 7, + 9, + 10, + 6, + 4, + 3, + 1, + 11, + 8, + 9, + 10, + 11, + 5, + 4, + 4, + 7, + 7, + 6, + 12, + 5 + ], + "weighted_loads": [ + 0.0, + 0.34487539902329445, + 1.4775692261755466, + 0.20669473335146904, + 0.45710169337689877, + 0.12793797627091408, + 0.6632369942963123, + 0.13630762696266174, + 1.2483610641211271, + 0.07677113637328148, + 0.22055703029036522, + 0.7377697099000216, + 0.9795518480241299, + 0.03638733923435211, + 0.42874643951654434, + 1.1138428896665573, + 0.8599201627075672, + 0.2896106783300638, + 0.23709816113114357, + 0.6990274973213673, + 0.2519632540643215, + 0.17046452313661575, + 0.2728889323771, + 0.20066372863948345, + 0.9298139065504074, + 0.369178619235754, + 2.8213341869413853, + 1.281210996210575, + 0.0, + 0.14469121396541595, + 0.8920065052807331, + 0.6337610520422459, + 0.6506943739950657, + 1.6904564127326012, + 0.11968560516834259, + 0.0745951421558857, + 0.09693766199052334, + 0.07730227336287498, + 0.44128938019275665, + 0.0, + 0.21902857348322868, + 0.4432947114109993, + 1.00300282984972, + 0.5391190126538277, + 0.484783373773098, + 0.6376962475478649, + 0.977193608880043, + 0.4030879810452461, + 0.13148032687604427, + 0.24271556362509727, + 0.04017780348658562, + 0.9111630953848362, + 0.7609560005366802, + 0.7875721007585526, + 0.9291062541306019, + 0.8271767646074295, + 0.41869189590215683, + 0.2008685041218996, + 0.3351108133792877, + 0.4967842549085617, + 0.2795163318514824, + 0.5775040276348591, + 1.9115546122193336, + 0.22500601783394814 + ], + "unique_experts": 61, + "load_cv": 0.7000991268642496, + "normalized_load_entropy": 0.9420618317470448, + "max_load_share": 0.05405405405405406 + }, + "full_input": { + "tokens": 115, + "top_k": 6, + "decisions": 690, + "ordered_route_sha256": "a3cc073033f327fca8c6cda6d8c2f5d361f64b0fba996f3cf8ff85a94e5b636d", + "route_weight_sha256": "f4adef939870bfc1007c76f7a3e28cae267fcd9ce506fcd2d92f69b7e776caea", + "loads": [ + 10, + 10, + 18, + 15, + 7, + 8, + 9, + 15, + 20, + 11, + 11, + 11, + 18, + 6, + 14, + 5, + 11, + 5, + 7, + 11, + 5, + 8, + 16, + 6, + 10, + 10, + 24, + 15, + 0, + 7, + 12, + 6, + 8, + 20, + 9, + 2, + 3, + 7, + 8, + 1, + 4, + 9, + 30, + 10, + 8, + 14, + 26, + 6, + 12, + 13, + 2, + 17, + 11, + 14, + 14, + 16, + 5, + 4, + 13, + 8, + 19, + 7, + 17, + 12 + ], + "weighted_loads": [ + 1.33164931088686, + 0.5272809974849224, + 1.4775692261755466, + 0.9234991148114204, + 0.49432700098259374, + 0.34439443051815033, + 0.7264133132994175, + 1.4768140073865652, + 1.2483610641211271, + 0.6431167554110289, + 0.3631594702601433, + 0.7386512578232214, + 1.0611155410006177, + 0.45039328932762146, + 1.16559873893857, + 1.1625381894409657, + 1.0722128711640835, + 0.2896106783300638, + 0.2929883152246475, + 0.6990274973213673, + 0.28401704132556915, + 0.5423783510923386, + 1.2510990463197231, + 0.20066372863948345, + 1.0313336178660393, + 0.4163702182122506, + 2.8213341869413853, + 1.3481573779135942, + 0.0, + 0.3200584836304188, + 0.9334118254482746, + 0.6337610520422459, + 0.6506943739950657, + 1.7630994245409966, + 0.998318687081337, + 0.0745951421558857, + 0.09693766199052334, + 0.49344123899936676, + 0.44128938019275665, + 0.050242118537425995, + 0.29366445168852806, + 0.4432947114109993, + 1.8701394721865654, + 0.6488868221640587, + 0.5389241836965084, + 1.0014561861753464, + 3.15793601796031, + 0.4030879810452461, + 1.1530558783560991, + 0.7092359215021133, + 0.07150794565677643, + 1.688915554434061, + 0.9625721946358681, + 1.503991536796093, + 2.0526388958096504, + 1.1007260251790285, + 0.41869189590215683, + 0.2008685041218996, + 0.9362967424094677, + 0.5270675905048847, + 1.0125433430075645, + 0.6276602931320667, + 2.325315821915865, + 0.6714526452124119 + ], + "unique_experts": 63, + "load_cv": 0.5478720937663409, + "normalized_load_entropy": 0.9630645781277253, + "max_load_share": 0.043478260869565216 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 74, + "ordered_topk_exact_tokens": 54, + "set_exact_tokens": 59, + "mean_set_jaccard": 0.9391891891891891, + "mean_token_weighted_tv": 0.011920800810126034, + "aggregate_load_tv": 0.03153153153153152 + }, + "system_bos": { + "tokens": 74, + "ordered_topk_exact_tokens": 48, + "set_exact_tokens": 56, + "mean_set_jaccard": 0.9276061776061776, + "mean_token_weighted_tv": 0.018848387235020463, + "aggregate_load_tv": 0.03828828828828829 + }, + "system_x": { + "tokens": 74, + "ordered_topk_exact_tokens": 45, + "set_exact_tokens": 55, + "mean_set_jaccard": 0.9266409266409266, + "mean_token_weighted_tv": 0.02076095370324077, + "aggregate_load_tv": 0.02927927927927928 + }, + "system_period": { + "tokens": 74, + "ordered_topk_exact_tokens": 49, + "set_exact_tokens": 57, + "mean_set_jaccard": 0.9343629343629343, + "mean_token_weighted_tv": 0.020552032513896357, + "aggregate_load_tv": 0.033783783783783786 + }, + "bos_at_s0": { + "tokens": 74, + "ordered_topk_exact_tokens": 37, + "set_exact_tokens": 49, + "mean_set_jaccard": 0.8976833976833977, + "mean_token_weighted_tv": 0.028227075493919687, + "aggregate_load_tv": 0.04504504504504504 + }, + "bos_at_s1": { + "tokens": 74, + "ordered_topk_exact_tokens": 39, + "set_exact_tokens": 47, + "mean_set_jaccard": 0.8928571428571428, + "mean_token_weighted_tv": 0.02849538135971572, + "aggregate_load_tv": 0.04954954954954956 + }, + "x_at_s0": { + "tokens": 74, + "ordered_topk_exact_tokens": 41, + "set_exact_tokens": 52, + "mean_set_jaccard": 0.9092664092664093, + "mean_token_weighted_tv": 0.025974026944085554, + "aggregate_load_tv": 0.04504504504504504 + }, + "x_at_s1": { + "tokens": 74, + "ordered_topk_exact_tokens": 39, + "set_exact_tokens": 44, + "mean_set_jaccard": 0.8783783783783786, + "mean_token_weighted_tv": 0.03086457140995441, + "aggregate_load_tv": 0.04504504504504504 + }, + "period_at_s0": { + "tokens": 74, + "ordered_topk_exact_tokens": 45, + "set_exact_tokens": 53, + "mean_set_jaccard": 0.9102316602316602, + "mean_token_weighted_tv": 0.02629117574542761, + "aggregate_load_tv": 0.04054054054054053 + }, + "period_at_s1": { + "tokens": 74, + "ordered_topk_exact_tokens": 38, + "set_exact_tokens": 44, + "mean_set_jaccard": 0.8841698841698842, + "mean_token_weighted_tv": 0.029862454425342178, + "aggregate_load_tv": 0.04504504504504505 + } + } + }, + "layer_04": { + "layer": 4, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "e2a159bded100c9ce0291e470ec15a0c86d9fd0af4a7eff1d82e4f1add902c19", + "route_weight_sha256": "c0de27bfe859b92a12c249439c63c5ba746b171f24587d3e3c5996626c969c65", + "loads": [ + 11, + 7, + 2, + 8, + 13, + 10, + 3, + 11, + 11, + 6, + 15, + 20, + 0, + 0, + 6, + 2, + 4, + 8, + 5, + 19, + 6, + 3, + 11, + 6, + 0, + 0, + 1, + 10, + 2, + 9, + 10, + 10, + 17, + 7, + 2, + 0, + 3, + 6, + 10, + 7, + 13, + 5, + 2, + 3, + 5, + 4, + 2, + 25, + 6, + 5, + 0, + 4, + 10, + 5, + 7, + 14, + 9, + 5, + 14, + 8, + 0, + 14, + 1, + 2 + ], + "weighted_loads": [ + 0.6890336871147156, + 0.5001860894262791, + 0.14411324262619019, + 0.4433022178709507, + 0.7982331998646259, + 0.7400632202625275, + 0.10526054725050926, + 0.8112542480230331, + 1.0147643610835075, + 0.4790194518864155, + 1.5601179637014866, + 1.3523712623864412, + 0.0, + 0.0, + 0.7556742466986179, + 0.05979977920651436, + 0.4796471334993839, + 0.5293921940028667, + 0.26385641656816006, + 1.7091506198048592, + 0.2776508070528507, + 0.14078662171959877, + 0.7687329463660717, + 0.6397494655102491, + 0.0, + 0.0, + 0.03374040126800537, + 0.6735100746154785, + 0.16063817590475082, + 0.3729812540113926, + 0.6943601183593273, + 0.5901189539581537, + 1.265163915231824, + 0.3246740959584713, + 0.11848383024334908, + 0.0, + 0.22743036597967148, + 0.3686926029622555, + 1.2188054732978344, + 0.7377947866916656, + 0.814242722466588, + 0.3050449416041374, + 0.1309451013803482, + 0.21087076514959335, + 0.24477611482143402, + 0.25494422018527985, + 0.09778765588998795, + 2.0436380431056023, + 0.254148717969656, + 0.22604671493172646, + 0.0, + 0.24077541194856167, + 0.8734516873955727, + 0.23298144340515137, + 0.43916596472263336, + 1.3182071521878242, + 0.5969872139394283, + 0.2800578251481056, + 0.9513322561979294, + 0.4298408776521683, + 0.0, + 1.067129209637642, + 0.03428063541650772, + 0.07124899700284004 + ], + "unique_experts": 57, + "load_cv": 0.7770237628864721, + "normalized_load_entropy": 0.9227977406119888, + "max_load_share": 0.05630630630630631 + }, + "full_input": { + "tokens": 99, + "top_k": 6, + "decisions": 594, + "ordered_route_sha256": "399baf73f2e5cf8a1199c2245d15b2358de409816227c0cde5a5712bcd74af0a", + "route_weight_sha256": "202a262eab62b65273b69d328d85b67888cb065ce44c2d3549f35c1ec3aa2d2c", + "loads": [ + 11, + 10, + 4, + 12, + 14, + 10, + 4, + 11, + 11, + 6, + 25, + 22, + 0, + 13, + 8, + 5, + 4, + 8, + 9, + 19, + 6, + 5, + 13, + 6, + 0, + 6, + 6, + 11, + 3, + 27, + 11, + 12, + 17, + 9, + 13, + 0, + 3, + 8, + 13, + 7, + 16, + 7, + 10, + 3, + 5, + 5, + 13, + 25, + 7, + 7, + 1, + 4, + 10, + 5, + 7, + 14, + 9, + 5, + 14, + 21, + 4, + 14, + 4, + 2 + ], + "weighted_loads": [ + 0.6890336871147156, + 0.6665786653757095, + 0.2651943266391754, + 0.800279001618037, + 0.8497132323682308, + 0.7400632202625275, + 0.16334973648190498, + 0.8112542480230331, + 1.0147643610835075, + 0.4790194518864155, + 2.2170334067195654, + 1.378904257901013, + 0.0, + 0.9352740123867989, + 0.8014754746109247, + 0.24391790851950645, + 0.4796471334993839, + 0.5293921940028667, + 0.5365904371137731, + 1.7091506198048592, + 0.2776508070528507, + 1.207266066223383, + 0.8760798387229443, + 0.6397494655102491, + 0.0, + 0.4361209534108639, + 0.5151371657848358, + 0.6814913423731923, + 0.19509272649884224, + 1.7098698873305693, + 0.7597403414547443, + 0.6210170639678836, + 1.265163915231824, + 0.3649155627936125, + 1.1696331657003611, + 0.0, + 0.22743036597967148, + 0.4758550450205803, + 2.341784257441759, + 0.7377947866916656, + 0.9546687323600054, + 0.4370671547949314, + 0.4922024104744196, + 0.21087076514959335, + 0.24477611482143402, + 0.2851097621023655, + 1.2438896596431732, + 2.0436380431056023, + 0.2908012419939041, + 0.2763975989073515, + 0.04665762558579445, + 0.24077541194856167, + 0.8734516873955727, + 0.23298144340515137, + 0.43916596472263336, + 1.3182071521878242, + 0.5969872139394283, + 0.2800578251481056, + 0.9513322561979294, + 1.1391257662326097, + 0.42279248652630486, + 1.067129209637642, + 0.2571435421705246, + 0.07124899700284004 + ], + "unique_experts": 61, + "load_cv": 0.6538491675578094, + "normalized_load_entropy": 0.9477959975660752, + "max_load_share": 0.045454545454545456 + } + }, + "s1_eos": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "71dd2c35364dbb4db011ea2e71e3e96b0c38b4ff5fa39b8b7dfbc0494cecc9d2", + "route_weight_sha256": "4ad2fd8a20ff93f62b891ad2b48d007d95eb956d26942cc8552d588183e1e897", + "loads": [ + 11, + 7, + 2, + 8, + 13, + 10, + 2, + 12, + 11, + 5, + 15, + 20, + 0, + 0, + 6, + 1, + 4, + 8, + 5, + 20, + 6, + 3, + 11, + 6, + 1, + 0, + 1, + 11, + 2, + 8, + 10, + 10, + 16, + 8, + 2, + 0, + 3, + 7, + 10, + 7, + 13, + 4, + 2, + 3, + 5, + 4, + 2, + 24, + 5, + 5, + 0, + 5, + 9, + 6, + 7, + 14, + 9, + 5, + 14, + 8, + 0, + 14, + 1, + 3 + ], + "weighted_loads": [ + 0.690752025693655, + 0.4939683713018894, + 0.14418980479240417, + 0.4384850338101387, + 0.8088016305118799, + 0.74073151871562, + 0.07595675066113472, + 0.8415948450565338, + 1.029317930340767, + 0.4391026273369789, + 1.5475959740579128, + 1.3640371654182673, + 0.0, + 0.0, + 0.7536028772592545, + 0.027624884620308876, + 0.4744148291647434, + 0.5314047839492559, + 0.2535551879554987, + 1.7316876966506243, + 0.2828854098916054, + 0.14142853021621704, + 0.7572637535631657, + 0.6527277361601591, + 0.04297259449958801, + 0.0, + 0.033803269267082214, + 0.7222596406936646, + 0.16146941483020782, + 0.35088543966412544, + 0.6842904612421989, + 0.5946135632693768, + 1.2510765064507723, + 0.35341984778642654, + 0.12376835569739342, + 0.0, + 0.22742856293916702, + 0.40021830424666405, + 1.1773222610354424, + 0.7436951473355293, + 0.814601719379425, + 0.2706138677895069, + 0.1297672912478447, + 0.20721209421753883, + 0.23444650508463383, + 0.24633017554879189, + 0.09563275426626205, + 1.9983649589121342, + 0.20111045986413956, + 0.22335990518331528, + 0.0, + 0.26902761682868004, + 0.8330921828746796, + 0.2619732916355133, + 0.4311978556215763, + 1.3209545947611332, + 0.5981300622224808, + 0.2763672173023224, + 0.9804392829537392, + 0.42509498447179794, + 0.0, + 1.0681036077439785, + 0.0343647263944149, + 0.10603416338562965 + ], + "unique_experts": 58, + "load_cv": 0.7728343604060963, + "normalized_load_entropy": 0.9237906667791463, + "max_load_share": 0.05405405405405406 + }, + "full_input": { + "tokens": 115, + "top_k": 6, + "decisions": 690, + "ordered_route_sha256": "7874e7a2d5d242c6c90ff79e2672d651822df049b2cf7b4207c8a091397836e6", + "route_weight_sha256": "bf24569d59c8ad3e9b761cf9016863202311fa8ef29a49059b452672c566a343", + "loads": [ + 11, + 9, + 5, + 17, + 14, + 10, + 5, + 12, + 11, + 13, + 24, + 22, + 1, + 14, + 9, + 5, + 6, + 10, + 12, + 22, + 7, + 6, + 17, + 7, + 1, + 10, + 9, + 12, + 3, + 30, + 11, + 12, + 16, + 10, + 17, + 0, + 3, + 10, + 15, + 10, + 16, + 9, + 11, + 3, + 7, + 6, + 12, + 28, + 6, + 8, + 2, + 5, + 13, + 10, + 13, + 14, + 14, + 7, + 14, + 22, + 7, + 16, + 5, + 4 + ], + "weighted_loads": [ + 0.690752025693655, + 0.6386914737522602, + 0.3156674988567829, + 1.2602711907820776, + 0.8688207622617483, + 0.74073151871562, + 0.2892438732087612, + 0.8415948450565338, + 1.029317930340767, + 1.4879396930336952, + 2.134338753297925, + 1.3904850222170353, + 0.10173827409744263, + 0.9932698905467987, + 0.8282322380691767, + 0.2915791366249323, + 0.837524700909853, + 0.6023325510323048, + 0.8582847048528492, + 1.8220895659178495, + 0.33211149275302887, + 1.2393553406000137, + 1.1879164353013039, + 0.7458813618868589, + 0.04297259449958801, + 0.7094364389777184, + 0.8019304908812046, + 0.7305738497525454, + 0.19569047912955284, + 1.6383170541375875, + 0.749102033674717, + 0.6251616515219212, + 1.2510765064507723, + 0.3940346082672477, + 1.4957236062909942, + 0.0, + 0.22742856293916702, + 0.5449140667915344, + 2.497561037540436, + 0.9546687975525856, + 0.9741399474442005, + 0.503318387636682, + 0.5574565604329109, + 0.20721209421753883, + 0.30355955846607685, + 0.27605821486213244, + 1.292838480323553, + 2.337696645408869, + 0.23099017143249512, + 0.3100181631743908, + 0.0922313816845417, + 0.26902761682868004, + 1.2692118436098099, + 0.4430406913161278, + 0.9833156131207943, + 1.3209545947611332, + 1.017927274107933, + 0.34953257255256176, + 0.9804392829537392, + 1.220591077581048, + 0.9066006317734718, + 1.2645700462162495, + 0.3314632251858711, + 0.1499823033809662 + ], + "unique_experts": 63, + "load_cv": 0.5767970284374588, + "normalized_load_entropy": 0.9590260061838651, + "max_load_share": 0.043478260869565216 + } + }, + "s0_bos": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "a35a1dda42044318125a29444ad54ba56cd019a503724c5726dc788b749b385b", + "route_weight_sha256": "c52f721a72cfc44dce99ce416acfd19f51a64992d93620cbcd713417899d26e2", + "loads": [ + 10, + 8, + 3, + 9, + 13, + 11, + 2, + 11, + 11, + 6, + 15, + 19, + 0, + 0, + 6, + 2, + 4, + 8, + 4, + 19, + 7, + 3, + 11, + 5, + 0, + 0, + 1, + 11, + 2, + 6, + 9, + 11, + 17, + 9, + 2, + 0, + 3, + 6, + 10, + 7, + 12, + 6, + 2, + 3, + 5, + 5, + 2, + 26, + 6, + 5, + 0, + 4, + 10, + 5, + 7, + 14, + 9, + 5, + 13, + 8, + 0, + 13, + 0, + 3 + ], + "weighted_loads": [ + 0.622971635311842, + 0.5442488864064217, + 0.15309912338852882, + 0.46603887528181076, + 0.7934014201164246, + 0.7830999363213778, + 0.0815262459218502, + 0.7994986996054649, + 0.9977195337414742, + 0.5034821145236492, + 1.5322227030992508, + 1.3713739961385727, + 0.0, + 0.0, + 0.7757033742964268, + 0.05762913636863232, + 0.446001298725605, + 0.533325333148241, + 0.21911543235182762, + 1.7022289521992207, + 0.296075914055109, + 0.13955694809556007, + 0.7607773020863533, + 0.6323072239756584, + 0.0, + 0.0, + 0.032933805137872696, + 0.7837135680019855, + 0.16534344851970673, + 0.24055009335279465, + 0.7004018407315016, + 0.6184997502714396, + 1.2537935264408588, + 0.4109414331614971, + 0.10272029414772987, + 0.0, + 0.21912399679422379, + 0.3442053310573101, + 1.1900885999202728, + 0.7523826733231544, + 0.7762512154877186, + 0.32591425254940987, + 0.12260688096284866, + 0.21226132661104202, + 0.24535332061350346, + 0.30128124728798866, + 0.10133771225810051, + 2.1343764159828424, + 0.24328330159187317, + 0.2283516824245453, + 0.0, + 0.27460087090730667, + 0.859874501824379, + 0.23061145469546318, + 0.4652840308845043, + 1.261848695576191, + 0.6082248948514462, + 0.29806090146303177, + 0.8481830023229122, + 0.4472891725599766, + 0.0, + 1.0337221212685108, + 0.0, + 0.09917331859469414 + ], + "unique_experts": 56, + "load_cv": 0.7753507182584353, + "normalized_load_entropy": 0.9222278745650754, + "max_load_share": 0.05855855855855856 + }, + "full_input": { + "tokens": 99, + "top_k": 6, + "decisions": 594, + "ordered_route_sha256": "8345f8566236af8b788659072a28a3109aff44df0ec7c5c31be9132b107abd97", + "route_weight_sha256": "f9ee9d73e4185710cfae8152e7ea02cc20248178b66e02772a172a28ec7837a5", + "loads": [ + 10, + 11, + 5, + 14, + 14, + 11, + 3, + 11, + 11, + 6, + 25, + 20, + 0, + 13, + 8, + 5, + 4, + 8, + 9, + 19, + 7, + 4, + 13, + 5, + 0, + 6, + 6, + 11, + 3, + 25, + 10, + 12, + 17, + 10, + 14, + 0, + 3, + 8, + 13, + 7, + 15, + 8, + 10, + 3, + 5, + 6, + 13, + 26, + 7, + 6, + 1, + 4, + 10, + 5, + 7, + 14, + 9, + 5, + 13, + 21, + 6, + 13, + 3, + 3 + ], + "weighted_loads": [ + 0.622971635311842, + 0.7046650238335133, + 0.27418020740151405, + 0.8582215000933502, + 0.8558070957660675, + 0.7830999363213778, + 0.13428599014878273, + 0.7994986996054649, + 0.9977195337414742, + 0.5034821145236492, + 2.1891381461173296, + 1.3884767163544893, + 0.0, + 0.9272932447493076, + 0.8215046022087336, + 0.24340988136827946, + 0.446001298725605, + 0.533325333148241, + 0.6113018548930995, + 1.7022289521992207, + 0.296075914055109, + 0.43072206154465675, + 0.868786308914423, + 0.6323072239756584, + 0.0, + 0.4422571063041687, + 0.5291649214923382, + 0.7837135680019855, + 0.20396017283201218, + 1.725515965023078, + 0.7739646043628454, + 0.6368573326617479, + 1.2537935264408588, + 0.4362909346818924, + 1.2403444505762309, + 0.0, + 0.21912399679422379, + 0.4511031210422516, + 2.321320664137602, + 0.7523826733231544, + 0.9166772253811359, + 0.46166057139635086, + 0.48386419005692005, + 0.21226132661104202, + 0.24535332061350346, + 0.3314467892050743, + 1.2474397160112858, + 2.1343764159828424, + 0.2799358256161213, + 0.25638329423964024, + 0.04665762558579445, + 0.27460087090730667, + 0.859874501824379, + 0.23061145469546318, + 0.4652840308845043, + 1.261848695576191, + 0.6082248948514462, + 0.29806090146303177, + 0.8481830023229122, + 1.1533900145441294, + 0.6461758275108878, + 1.0337221212685108, + 0.22797224298119545, + 0.09917331859469414 + ], + "unique_experts": 61, + "load_cv": 0.6401115293541667, + "normalized_load_entropy": 0.9492934805473894, + "max_load_share": 0.04377104377104377 + } + }, + "s1_bos": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "bfc4a601d4d34caf15b01b93149c694f2b39452a0d61a27a8fd52aaa1669b045", + "route_weight_sha256": "7319a72eceddbe888d18f5beaded5ed0f4749c71073091038736287222d27278", + "loads": [ + 10, + 7, + 3, + 7, + 13, + 11, + 2, + 11, + 11, + 6, + 15, + 18, + 0, + 0, + 6, + 2, + 4, + 8, + 4, + 20, + 7, + 3, + 11, + 6, + 1, + 0, + 0, + 11, + 3, + 6, + 9, + 11, + 16, + 9, + 2, + 0, + 3, + 7, + 10, + 9, + 12, + 4, + 2, + 3, + 5, + 5, + 2, + 25, + 3, + 5, + 0, + 5, + 9, + 5, + 8, + 14, + 9, + 5, + 14, + 9, + 0, + 13, + 1, + 4 + ], + "weighted_loads": [ + 0.6130895018577576, + 0.5001805163919926, + 0.17311078310012817, + 0.3783414177596569, + 0.8160528019070625, + 0.7920945640653372, + 0.0809720829129219, + 0.8144633397459984, + 1.001023255288601, + 0.5066568441689014, + 1.5025073252618313, + 1.3166383877396584, + 0.0, + 0.0, + 0.7715850099921227, + 0.06026962772011757, + 0.45568787679076195, + 0.5385737419128418, + 0.2099815383553505, + 1.765379410237074, + 0.30944880843162537, + 0.1351669505238533, + 0.7528464272618294, + 0.6912918854504824, + 0.04054655507206917, + 0.0, + 0.0, + 0.7712765745818615, + 0.20377521961927414, + 0.22561420500278473, + 0.713030569255352, + 0.6100467201322317, + 1.2114956174045801, + 0.4010516479611397, + 0.10634402558207512, + 0.0, + 0.21483054757118225, + 0.3839920964092016, + 1.1626346819102764, + 0.837710402905941, + 0.7734488770365715, + 0.27837492898106575, + 0.1190430298447609, + 0.21459107473492622, + 0.24267777241766453, + 0.29496319964528084, + 0.10078943893313408, + 2.0847191847860813, + 0.11125064454972744, + 0.22099613025784492, + 0.0, + 0.3049376457929611, + 0.7997870445251465, + 0.24000293388962746, + 0.48712722957134247, + 1.2954209297895432, + 0.6132102571427822, + 0.28394729644060135, + 0.933462530374527, + 0.5054537579417229, + 0.0, + 1.0546400025486946, + 0.035887133330106735, + 0.13033868186175823 + ], + "unique_experts": 57, + "load_cv": 0.7631114570314153, + "normalized_load_entropy": 0.9248939729951544, + "max_load_share": 0.05630630630630631 + }, + "full_input": { + "tokens": 115, + "top_k": 6, + "decisions": 690, + "ordered_route_sha256": "5f759fad34bc549e7e4876beabe1ada03f54ab783ea4d373a04e0340ed1da9f5", + "route_weight_sha256": "1869c381e95b2e5d74fd2372147e1ed547683d3e8b84a578138eb1f6c3a0215f", + "loads": [ + 10, + 9, + 7, + 17, + 14, + 11, + 5, + 11, + 11, + 14, + 24, + 19, + 1, + 14, + 9, + 6, + 6, + 10, + 12, + 22, + 8, + 5, + 17, + 7, + 1, + 10, + 8, + 11, + 4, + 28, + 10, + 12, + 16, + 10, + 17, + 0, + 3, + 10, + 15, + 12, + 15, + 9, + 11, + 3, + 7, + 7, + 13, + 29, + 4, + 7, + 2, + 5, + 13, + 9, + 14, + 14, + 14, + 7, + 14, + 23, + 9, + 15, + 5, + 5 + ], + "weighted_loads": [ + 0.6130895018577576, + 0.6363733597099781, + 0.38103311881422997, + 1.233049466391094, + 0.885231077671051, + 0.7920945640653372, + 0.27582571282982826, + 0.8144633397459984, + 1.001023255288601, + 1.5554939098656178, + 2.0892501045018435, + 1.333741107955575, + 0.10173827409744263, + 0.9806098118424416, + 0.8462143708020449, + 0.3415476270020008, + 0.8187977485358715, + 0.6095015089958906, + 0.9262475580908358, + 1.8557812795042992, + 0.35867489129304886, + 0.4668489322066307, + 1.1807908937335014, + 0.7844455111771822, + 0.04054655507206917, + 0.6778008379042149, + 0.7840305231511593, + 0.7712765745818615, + 0.2432379052042961, + 1.5500872377306223, + 0.7968307361006737, + 0.6284043025225401, + 1.2114956174045801, + 0.42640114948153496, + 1.4738346386875492, + 0.0, + 0.21483054757118225, + 0.5289620850235224, + 2.490004075691104, + 1.0486840531229973, + 0.932987105101347, + 0.511568281421205, + 0.5467322990298271, + 0.21459107473492622, + 0.31179082579910755, + 0.3246912389586214, + 1.346206471323967, + 2.424050871282816, + 0.141130356118083, + 0.28486439771950245, + 0.0922313816845417, + 0.3049376457929611, + 1.2359067052602768, + 0.42107033357024193, + 1.0392449870705605, + 1.2954209297895432, + 1.0330074690282345, + 0.3571126516908407, + 0.933462530374527, + 1.2986066546291113, + 1.1363515108823776, + 1.2511064410209656, + 0.35407963767647743, + 0.17428682185709476 + ], + "unique_experts": 63, + "load_cv": 0.5633562819007771, + "normalized_load_entropy": 0.9606876086813115, + "max_load_share": 0.042028985507246375 + } + }, + "s0_x": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "fbdf2efd9fb5e7a3b8a3ab3c8f6e1b32c867e6039f900ead38cd8a732aac613c", + "route_weight_sha256": "2f9e05eb160b06c3a4330e32b8945d851964eb49270b63dcb0e5e64180b99267", + "loads": [ + 9, + 7, + 4, + 9, + 13, + 11, + 2, + 10, + 11, + 6, + 15, + 19, + 0, + 0, + 6, + 1, + 4, + 8, + 5, + 19, + 6, + 4, + 11, + 5, + 0, + 0, + 1, + 11, + 2, + 4, + 9, + 12, + 16, + 10, + 2, + 0, + 3, + 5, + 10, + 7, + 12, + 6, + 2, + 3, + 6, + 4, + 2, + 25, + 9, + 5, + 0, + 4, + 10, + 5, + 8, + 14, + 9, + 5, + 14, + 8, + 1, + 13, + 0, + 2 + ], + "weighted_loads": [ + 0.5640940591692924, + 0.5002764388918877, + 0.1953169833868742, + 0.5099732615053654, + 0.7931551747024059, + 0.7736460827291012, + 0.08467277884483337, + 0.7586139030754566, + 0.9814889915287495, + 0.5022187530994415, + 1.5554583556950092, + 1.3921623900532722, + 0.0, + 0.0, + 0.7746095173060894, + 0.026052286848425865, + 0.45930667594075203, + 0.5452412851154804, + 0.265205729752779, + 1.7189423963427544, + 0.2687147185206413, + 0.17382643558084965, + 0.8054189644753933, + 0.6296326890587807, + 0.0, + 0.0, + 0.033128876239061356, + 0.7689276374876499, + 0.16985932737588882, + 0.14501624181866646, + 0.6987014468759298, + 0.6648237854242325, + 1.1802823171019554, + 0.44157179445028305, + 0.11125204712152481, + 0.0, + 0.21861940622329712, + 0.3157370947301388, + 1.1451030746102333, + 0.7499110847711563, + 0.7685567028820515, + 0.3354126140475273, + 0.11467774584889412, + 0.21242893114686012, + 0.28300346434116364, + 0.26884885504841805, + 0.1033266969025135, + 2.111833769828081, + 0.3612273149192333, + 0.2362976409494877, + 0.0, + 0.26041097939014435, + 0.8866587318480015, + 0.23510020226240158, + 0.4952503703534603, + 1.2470586374402046, + 0.5992664247751236, + 0.30818498507142067, + 0.9040483701974154, + 0.43195099756121635, + 0.04005078971385956, + 1.0680051185190678, + 0.0, + 0.06235094368457794 + ], + "unique_experts": 57, + "load_cv": 0.7677769033157724, + "normalized_load_entropy": 0.923417778942071, + "max_load_share": 0.05630630630630631 + }, + "full_input": { + "tokens": 99, + "top_k": 6, + "decisions": 594, + "ordered_route_sha256": "6870bb4152f758cdc8dbfc735e43f67d7981dde77053459ef0153ddd8da966aa", + "route_weight_sha256": "d86defb955c525e5558a72365960d7f809c3368663497d3cfa477ed352b03fe6", + "loads": [ + 9, + 11, + 7, + 13, + 14, + 11, + 2, + 10, + 11, + 6, + 26, + 20, + 0, + 12, + 8, + 4, + 4, + 8, + 9, + 19, + 6, + 5, + 13, + 5, + 0, + 6, + 6, + 11, + 2, + 21, + 10, + 13, + 16, + 11, + 12, + 0, + 3, + 7, + 13, + 7, + 16, + 8, + 11, + 3, + 6, + 5, + 15, + 25, + 11, + 6, + 2, + 4, + 10, + 5, + 8, + 14, + 9, + 5, + 14, + 22, + 6, + 13, + 3, + 2 + ], + "weighted_loads": [ + 0.5640940591692924, + 0.7041259668767452, + 0.3475521057844162, + 0.8690357607847545, + 0.8534300625324249, + 0.7736460827291012, + 0.08467277884483337, + 0.7586139030754566, + 0.9814889915287495, + 0.5022187530994415, + 2.4279851969331503, + 1.4092651102691889, + 0.0, + 0.8875730261206627, + 0.8204107452183962, + 0.22093543969094753, + 0.45930667594075203, + 0.5452412851154804, + 0.524301000579726, + 1.7189423963427544, + 0.2687147185206413, + 0.4649915490299463, + 0.9321629144251347, + 0.6296326890587807, + 0.0, + 0.3773248568177223, + 0.5667827762663364, + 0.7689276374876499, + 0.16985932737588882, + 1.3861866291845217, + 0.782306207343936, + 0.6831813678145409, + 1.1802823171019554, + 0.46692129597067833, + 1.0276746943127364, + 0.0, + 0.21861940622329712, + 0.4242492690682411, + 2.2562738321721554, + 0.7499110847711563, + 0.9659261740744114, + 0.4731804095208645, + 0.5117990765720606, + 0.21242893114686012, + 0.28300346434116364, + 0.2990143969655037, + 1.4944857992231846, + 2.111833769828081, + 0.441173255443573, + 0.26432925276458263, + 0.0861375704407692, + 0.26041097939014435, + 0.8866587318480015, + 0.23510020226240158, + 0.4952503703534603, + 1.2470586374402046, + 0.5992664247751236, + 0.30818498507142067, + 0.9040483701974154, + 1.2108210679143667, + 0.4852999222057406, + 1.0680051185190678, + 0.2214426025748253, + 0.06235094368457794 + ], + "unique_experts": 61, + "load_cv": 0.630691051533956, + "normalized_load_entropy": 0.9497656091605597, + "max_load_share": 0.04377104377104377 + } + }, + "s1_x": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "0342bb653be3918e9315c9256d3296081a93993f91430b4e5cefefc3fb8e7f1d", + "route_weight_sha256": "ce9bc221f939b58515e5901b0df37e207300a590ea072458c02b989cae58bf06", + "loads": [ + 10, + 7, + 3, + 8, + 12, + 12, + 2, + 11, + 11, + 6, + 15, + 20, + 0, + 0, + 6, + 2, + 4, + 8, + 6, + 20, + 6, + 5, + 11, + 6, + 1, + 0, + 1, + 11, + 3, + 3, + 10, + 9, + 16, + 7, + 2, + 0, + 3, + 6, + 10, + 7, + 13, + 6, + 2, + 3, + 5, + 5, + 2, + 26, + 3, + 5, + 0, + 5, + 9, + 5, + 8, + 14, + 9, + 5, + 14, + 9, + 1, + 12, + 1, + 2 + ], + "weighted_loads": [ + 0.5855722837150097, + 0.4956401623785496, + 0.1788718793541193, + 0.4439360201358795, + 0.7687513995915651, + 0.8191856872290373, + 0.08000024035573006, + 0.7931771203875542, + 0.9894359894096851, + 0.5119217000901699, + 1.514265537261963, + 1.3665212467312813, + 0.0, + 0.0, + 0.765523225069046, + 0.05831162631511688, + 0.44818901643157005, + 0.5466464571654797, + 0.2757609486579895, + 1.8032606821507215, + 0.2767724208533764, + 0.20128808170557022, + 0.7735566347837448, + 0.6958095971494913, + 0.04026036709547043, + 0.0, + 0.0326136089861393, + 0.7539395093917847, + 0.2103411629796028, + 0.10528955981135368, + 0.7514690347015858, + 0.5417807921767235, + 1.1784079521894455, + 0.33029183000326157, + 0.11150968074798584, + 0.0, + 0.22031202912330627, + 0.34103943407535553, + 1.1102736331522465, + 0.764036200940609, + 0.796845955774188, + 0.3903055414557457, + 0.11254081130027771, + 0.20932664722204208, + 0.24439798295497894, + 0.30198150128126144, + 0.10372432693839073, + 2.122546996921301, + 0.10916694067418575, + 0.22316717728972435, + 0.0, + 0.2986339218914509, + 0.8323987349867821, + 0.23324736580252647, + 0.48811573535203934, + 1.3029456548392773, + 0.6111516989767551, + 0.2880357354879379, + 0.9366535469889641, + 0.5259780324995518, + 0.04062768444418907, + 1.0401219055056572, + 0.036211539059877396, + 0.07080481573939323 + ], + "unique_experts": 59, + "load_cv": 0.7732543220512221, + "normalized_load_entropy": 0.9264071337209556, + "max_load_share": 0.05855855855855856 + }, + "full_input": { + "tokens": 115, + "top_k": 6, + "decisions": 690, + "ordered_route_sha256": "2be9bd0cdad030ff77754f3bb6428902cd880d1afe042d84a0b3115cdf272ef0", + "route_weight_sha256": "67bca95fdfe2135841fd29eedc33ba284ec87d113519132a89f05cfca57e0b5a", + "loads": [ + 10, + 10, + 8, + 17, + 13, + 12, + 4, + 11, + 11, + 15, + 25, + 21, + 1, + 14, + 9, + 6, + 6, + 10, + 13, + 22, + 7, + 7, + 17, + 7, + 1, + 10, + 9, + 11, + 4, + 22, + 11, + 10, + 16, + 8, + 16, + 0, + 4, + 9, + 14, + 10, + 17, + 11, + 12, + 3, + 7, + 7, + 14, + 30, + 4, + 7, + 2, + 5, + 13, + 9, + 14, + 14, + 14, + 7, + 14, + 24, + 9, + 14, + 5, + 3 + ], + "weighted_loads": [ + 0.5855722837150097, + 0.6785622239112854, + 0.4231932256370783, + 1.2621834418969229, + 0.8395281229168177, + 0.8191856872290373, + 0.22537291422486305, + 0.7931771203875542, + 0.9894359894096851, + 1.5976699255406857, + 2.2910193856805563, + 1.383623966947198, + 0.10173827409744263, + 0.9661591481417418, + 0.8401525858789682, + 0.3411901891231537, + 0.8112988881766796, + 0.6175742242485285, + 0.8415225581265986, + 1.8936625514179468, + 0.3259985037147999, + 0.5329700633883476, + 1.2135286219418049, + 0.7889632228761911, + 0.04026036709547043, + 0.6264184266328812, + 0.8321158513426781, + 0.7539395093917847, + 0.2501780763268471, + 1.202267685905099, + 0.8469236679375172, + 0.5601383745670319, + 1.1784079521894455, + 0.35564133152365685, + 1.291303296777187, + 0.0, + 0.2463280688971281, + 0.4868650399148464, + 2.393411073833704, + 0.9750098511576653, + 1.0107427667826414, + 0.6253501992614474, + 0.5802659690380096, + 0.20932664722204208, + 0.31351103633642197, + 0.331709540594602, + 1.556385338306427, + 2.4618786834180355, + 0.1390466522425413, + 0.2870354447513819, + 0.0922313816845417, + 0.2986339218914509, + 1.2685183957219124, + 0.41431476548314095, + 1.0402334928512573, + 1.3029456548392773, + 1.0309489108622074, + 0.3612010907381773, + 0.9366535469889641, + 1.3838137965649366, + 0.9628535062074661, + 1.2365883439779282, + 0.3411857932806015, + 0.11475295573472977 + ], + "unique_experts": 63, + "load_cv": 0.5595254087615499, + "normalized_load_entropy": 0.9608290748458598, + "max_load_share": 0.043478260869565216 + } + }, + "s0_period": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "40f3f54631aec15e6152856cfd17397442c43ac10013119ff32ffd544a5799e3", + "route_weight_sha256": "267588f036535e10e1d7386675d38be154d582427f1e3e6a53c4bcefdff81d9a", + "loads": [ + 9, + 7, + 3, + 9, + 13, + 11, + 2, + 10, + 11, + 6, + 15, + 21, + 0, + 0, + 6, + 2, + 4, + 8, + 5, + 19, + 6, + 3, + 11, + 5, + 0, + 0, + 1, + 11, + 2, + 4, + 9, + 12, + 16, + 10, + 2, + 0, + 3, + 5, + 10, + 7, + 12, + 6, + 2, + 3, + 6, + 4, + 2, + 25, + 9, + 5, + 0, + 4, + 10, + 5, + 9, + 14, + 9, + 5, + 13, + 8, + 1, + 13, + 0, + 1 + ], + "weighted_loads": [ + 0.5752205178141594, + 0.4984976723790169, + 0.1634194441139698, + 0.5110334493219852, + 0.7925594933331013, + 0.7707628738135099, + 0.08294285461306572, + 0.7652832791209221, + 0.9816308878362179, + 0.5115544572472572, + 1.5430103577673435, + 1.4501389879733324, + 0.0, + 0.0, + 0.7796594798564911, + 0.0573530662804842, + 0.4508718401193619, + 0.5433760769665241, + 0.2654682733118534, + 1.7286464683711529, + 0.26479057036340237, + 0.14261797815561295, + 0.774166040122509, + 0.6229564547538757, + 0.0, + 0.0, + 0.03239385038614273, + 0.7614147439599037, + 0.1714189574122429, + 0.14583492279052734, + 0.6903024613857269, + 0.6660218331962824, + 1.1879728473722935, + 0.44755880907177925, + 0.11107202246785164, + 0.0, + 0.2217451110482216, + 0.31737889163196087, + 1.1137873567640781, + 0.7533723264932632, + 0.7644718959927559, + 0.33101779222488403, + 0.11473339796066284, + 0.21449748426675797, + 0.28359634056687355, + 0.27168233692646027, + 0.10228444635868073, + 2.1131531596183777, + 0.35700763389468193, + 0.23271207138895988, + 0.0, + 0.25588889978826046, + 0.8970866799354553, + 0.23611967265605927, + 0.5267102885991335, + 1.2343920469284058, + 0.6092888601124287, + 0.3058242052793503, + 0.8661943078041077, + 0.4242325760424137, + 0.040128279477357864, + 1.0701062381267548, + 0.0, + 0.03272630274295807 + ], + "unique_experts": 57, + "load_cv": 0.7795265972177113, + "normalized_load_entropy": 0.9217774296300362, + "max_load_share": 0.05630630630630631 + }, + "full_input": { + "tokens": 99, + "top_k": 6, + "decisions": 594, + "ordered_route_sha256": "a52a8ebaeb9276dfa3e88231d5df60e6abef80c9fa77b792080a16a32f1d20b7", + "route_weight_sha256": "783873150e6345d8de3426461fa67f5c08c2238d5358fc042484b7d4bdb85a90", + "loads": [ + 9, + 11, + 6, + 13, + 14, + 11, + 2, + 10, + 11, + 6, + 25, + 22, + 0, + 12, + 8, + 5, + 4, + 8, + 9, + 19, + 6, + 4, + 14, + 5, + 0, + 6, + 7, + 11, + 3, + 22, + 10, + 13, + 16, + 11, + 11, + 0, + 3, + 7, + 13, + 7, + 15, + 8, + 10, + 3, + 6, + 5, + 14, + 25, + 11, + 6, + 1, + 5, + 11, + 5, + 9, + 14, + 9, + 5, + 13, + 22, + 6, + 13, + 3, + 1 + ], + "weighted_loads": [ + 0.5752205178141594, + 0.7120993174612522, + 0.3279791474342346, + 0.8740526837354992, + 0.8482253216207027, + 0.7707628738135099, + 0.08294285461306572, + 0.7652832791209221, + 0.9816308878362179, + 0.5115544572472572, + 2.1999258007854223, + 1.467241708189249, + 0.0, + 0.864515945315361, + 0.8254607077687979, + 0.23663688264787197, + 0.4508718401193619, + 0.5433760769665241, + 0.5307696244562976, + 1.7286464683711529, + 0.26479057036340237, + 0.4337830916047096, + 0.9352502524852753, + 0.6229564547538757, + 0.0, + 0.35750859789550304, + 0.8304563090205193, + 0.7614147439599037, + 0.21030212566256523, + 1.4060663875425234, + 0.7811816334724426, + 0.6843794155865908, + 1.1879728473722935, + 0.47290831059217453, + 0.9699203677009791, + 0.0, + 0.2217451110482216, + 0.4266443122178316, + 2.2349098045378923, + 0.7533723264932632, + 0.9048979058861732, + 0.4654267095029354, + 0.47599070705473423, + 0.21449748426675797, + 0.28359634056687355, + 0.3018478788435459, + 1.409095637500286, + 2.1131531596183777, + 0.4482465386390686, + 0.26074368320405483, + 0.04665762558579445, + 0.38311617635190487, + 0.9617939889431, + 0.23611967265605927, + 0.5267102885991335, + 1.2343920469284058, + 0.6092888601124287, + 0.3058242052793503, + 0.8661943078041077, + 1.208836330100894, + 0.4848806258814875, + 1.0701062381267548, + 0.2216845639050007, + 0.03272630274295807 + ], + "unique_experts": 61, + "load_cv": 0.6332741708351525, + "normalized_load_entropy": 0.9490210089328989, + "max_load_share": 0.04208754208754209 + } + }, + "s1_period": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "5f9ca28a1fb0c12bcb2c02fcea30589965e7902b59028ca5ef93aa38452ccb1b", + "route_weight_sha256": "6e9b21041f341f59667f457870eabbffed74d8f11dd02dde00244113f869e3d7", + "loads": [ + 10, + 7, + 4, + 8, + 13, + 11, + 2, + 11, + 11, + 6, + 15, + 19, + 0, + 0, + 6, + 2, + 4, + 8, + 7, + 20, + 6, + 4, + 11, + 6, + 1, + 0, + 0, + 11, + 2, + 2, + 10, + 11, + 16, + 7, + 2, + 0, + 3, + 7, + 10, + 7, + 13, + 6, + 2, + 3, + 5, + 5, + 2, + 26, + 3, + 5, + 0, + 5, + 9, + 5, + 8, + 14, + 9, + 5, + 14, + 9, + 1, + 12, + 1, + 2 + ], + "weighted_loads": [ + 0.5981035754084587, + 0.5025601871311665, + 0.21000097692012787, + 0.4506232663989067, + 0.80031718313694, + 0.7920499593019485, + 0.07852635532617569, + 0.7966358177363873, + 0.9934442788362503, + 0.5124938786029816, + 1.51120350882411, + 1.3499383609741926, + 0.0, + 0.0, + 0.7649681493639946, + 0.05967448838055134, + 0.44634243473410606, + 0.5504214651882648, + 0.3068809285759926, + 1.787259640172124, + 0.27647511661052704, + 0.1685088574886322, + 0.7547266222536564, + 0.6898303162306547, + 0.039389729499816895, + 0.0, + 0.0, + 0.7505371272563934, + 0.17468377202749252, + 0.07149384915828705, + 0.747109929099679, + 0.6143439635634422, + 1.17899782769382, + 0.33474430814385414, + 0.11292752251029015, + 0.0, + 0.21490681171417236, + 0.37183162942528725, + 1.0881842896342278, + 0.767784871160984, + 0.8020380660891533, + 0.3769831359386444, + 0.11308635026216507, + 0.2144017443060875, + 0.2453796248883009, + 0.29780299589037895, + 0.10193952545523643, + 2.1284544058144093, + 0.10842087119817734, + 0.22373903170228004, + 0.0, + 0.29395547322928905, + 0.8249470517039299, + 0.23441537842154503, + 0.48599759489297867, + 1.2741874419152737, + 0.618601955473423, + 0.286890871822834, + 0.9343367721885443, + 0.5298569425940514, + 0.039755892008543015, + 1.0370318219065666, + 0.03623304143548012, + 0.0691729374229908 + ], + "unique_experts": 58, + "load_cv": 0.7766058396275791, + "normalized_load_entropy": 0.9240325227252828, + "max_load_share": 0.05855855855855856 + }, + "full_input": { + "tokens": 115, + "top_k": 6, + "decisions": 690, + "ordered_route_sha256": "04c8321f7a57137f8885de92f025716703c555b07ba64be3de05690a01914438", + "route_weight_sha256": "7272cb6608b27fe94de270d8a26114995bed6e8fbd5c75383b98f090d2c8e949", + "loads": [ + 10, + 10, + 8, + 17, + 14, + 11, + 4, + 11, + 11, + 15, + 24, + 20, + 1, + 14, + 9, + 6, + 6, + 10, + 14, + 22, + 7, + 6, + 18, + 7, + 1, + 10, + 9, + 11, + 3, + 21, + 11, + 12, + 16, + 8, + 15, + 0, + 4, + 11, + 14, + 10, + 16, + 11, + 11, + 3, + 7, + 7, + 13, + 30, + 4, + 7, + 2, + 6, + 14, + 9, + 14, + 14, + 14, + 7, + 14, + 24, + 9, + 14, + 5, + 4 + ], + "weighted_loads": [ + 0.5981035754084587, + 0.6739642545580864, + 0.41895365715026855, + 1.2710803142981604, + 0.8691328689455986, + 0.7920499593019485, + 0.22389902919530869, + 0.7966358177363873, + 0.9934442788362503, + 1.5981683433055878, + 2.097946288064122, + 1.3670410811901093, + 0.10173827409744263, + 0.9378316551446915, + 0.8395975101739168, + 0.35058903880417347, + 0.8094523064792156, + 0.6213492322713137, + 0.8811685130931437, + 1.8776615094393492, + 0.32570119947195053, + 0.5001908391714096, + 1.2272809632122517, + 0.7829839419573545, + 0.039389729499816895, + 0.5947999116033316, + 1.1028496883809566, + 0.7505371272563934, + 0.21519071608781815, + 1.1562416348606348, + 0.8395179677754641, + 0.6327015459537506, + 1.17899782769382, + 0.3600938096642494, + 1.2354109857406002, + 0.0, + 0.24108873680233955, + 0.5598236732184887, + 2.378610350191593, + 0.9787585213780403, + 0.9615762941539288, + 0.6087614890129771, + 0.5407756194472313, + 0.2144017443060875, + 0.3144926782697439, + 0.3275310352037195, + 1.4089582487940788, + 2.467786092311144, + 0.1383005827665329, + 0.28760729916393757, + 0.0922313816845417, + 0.3893642257899046, + 1.3134045749902725, + 0.4154827781021595, + 1.0381153523921967, + 1.2741874419152737, + 1.0383991673588753, + 0.3600562270730734, + 0.9343367721885443, + 1.4460541252046824, + 0.9624289907515049, + 1.2334982603788376, + 0.35482412949204445, + 0.14405407570302486 + ], + "unique_experts": 63, + "load_cv": 0.5508085367061594, + "normalized_load_entropy": 0.9616725406457329, + "max_load_share": 0.043478260869565216 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 74, + "ordered_topk_exact_tokens": 60, + "set_exact_tokens": 64, + "mean_set_jaccard": 0.9613899613899614, + "mean_token_weighted_tv": 0.009264209886660447, + "aggregate_load_tv": 0.02027027027027027 + }, + "system_bos": { + "tokens": 74, + "ordered_topk_exact_tokens": 50, + "set_exact_tokens": 58, + "mean_set_jaccard": 0.9382239382239382, + "mean_token_weighted_tv": 0.016036736527206125, + "aggregate_load_tv": 0.02927927927927928 + }, + "system_x": { + "tokens": 74, + "ordered_topk_exact_tokens": 43, + "set_exact_tokens": 51, + "mean_set_jaccard": 0.9083011583011584, + "mean_token_weighted_tv": 0.021624049952102674, + "aggregate_load_tv": 0.042792792792792786 + }, + "system_period": { + "tokens": 74, + "ordered_topk_exact_tokens": 41, + "set_exact_tokens": 50, + "mean_set_jaccard": 0.9073359073359075, + "mean_token_weighted_tv": 0.0213546375492336, + "aggregate_load_tv": 0.04504504504504504 + }, + "bos_at_s0": { + "tokens": 74, + "ordered_topk_exact_tokens": 49, + "set_exact_tokens": 59, + "mean_set_jaccard": 0.9362934362934362, + "mean_token_weighted_tv": 0.020870878474434484, + "aggregate_load_tv": 0.02927927927927928 + }, + "bos_at_s1": { + "tokens": 74, + "ordered_topk_exact_tokens": 43, + "set_exact_tokens": 57, + "mean_set_jaccard": 0.9343629343629345, + "mean_token_weighted_tv": 0.021173647995031363, + "aggregate_load_tv": 0.03378378378378378 + }, + "x_at_s0": { + "tokens": 74, + "ordered_topk_exact_tokens": 45, + "set_exact_tokens": 54, + "mean_set_jaccard": 0.9198841698841701, + "mean_token_weighted_tv": 0.022403472933817555, + "aggregate_load_tv": 0.04054054054054054 + }, + "x_at_s1": { + "tokens": 74, + "ordered_topk_exact_tokens": 43, + "set_exact_tokens": 56, + "mean_set_jaccard": 0.9218146718146719, + "mean_token_weighted_tv": 0.024709889992467454, + "aggregate_load_tv": 0.038288288288288286 + }, + "period_at_s0": { + "tokens": 74, + "ordered_topk_exact_tokens": 41, + "set_exact_tokens": 53, + "mean_set_jaccard": 0.918918918918919, + "mean_token_weighted_tv": 0.022574885760912218, + "aggregate_load_tv": 0.04054054054054054 + }, + "period_at_s1": { + "tokens": 74, + "ordered_topk_exact_tokens": 43, + "set_exact_tokens": 56, + "mean_set_jaccard": 0.9247104247104247, + "mean_token_weighted_tv": 0.023845474286055244, + "aggregate_load_tv": 0.038288288288288286 + } + } + }, + "layer_05": { + "layer": 5, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "5e94b7b26ffb87c1d5558b6a3a41de8e38d558e71bf84d235278ec2baac89490", + "route_weight_sha256": "a27675a800732e83903fd248315b6fcec6810820397f8132ae6933c1dbb62880", + "loads": [ + 7, + 5, + 4, + 1, + 10, + 0, + 0, + 0, + 8, + 0, + 0, + 1, + 10, + 3, + 47, + 4, + 4, + 2, + 5, + 3, + 7, + 11, + 6, + 2, + 6, + 11, + 14, + 6, + 13, + 16, + 0, + 5, + 5, + 8, + 8, + 3, + 10, + 2, + 0, + 6, + 21, + 0, + 9, + 7, + 3, + 14, + 0, + 4, + 9, + 2, + 2, + 12, + 0, + 6, + 7, + 2, + 5, + 9, + 6, + 33, + 6, + 14, + 10, + 10 + ], + "weighted_loads": [ + 0.6457410305738449, + 0.16462734527885914, + 0.1733204796910286, + 0.061047930270433426, + 0.7673912271857262, + 0.0, + 0.0, + 0.0, + 0.8192096576094627, + 0.0, + 0.0, + 0.04148566350340843, + 0.7596510574221611, + 0.13817834854125977, + 4.665665857493877, + 0.22031105309724808, + 0.32382678613066673, + 0.07991793006658554, + 0.361227884888649, + 0.16485083103179932, + 0.8885473050177097, + 0.9570901244878769, + 0.4664058946073055, + 0.09308703616261482, + 0.40462173894047737, + 0.6911572851240635, + 0.6612439937889576, + 0.6348779648542404, + 1.1295146979391575, + 1.0670126099139452, + 0.0, + 0.1708888951689005, + 0.3194965124130249, + 0.5936673358082771, + 0.6812329031527042, + 0.13716258108615875, + 0.7044696379452944, + 0.10876261815428734, + 0.0, + 0.3668734785169363, + 2.3021688908338547, + 0.0, + 0.6315839998424053, + 0.5205664373934269, + 0.2235405221581459, + 1.259036011993885, + 0.0, + 0.3318822495639324, + 0.6757525019347668, + 0.087065689265728, + 0.10695747658610344, + 0.8149766847491264, + 0.0, + 0.3702176846563816, + 0.47364355623722076, + 0.06439148262143135, + 0.2832901105284691, + 0.3395194783806801, + 0.45685070380568504, + 3.156584206968546, + 0.42516475170850754, + 1.2580498866736889, + 0.6485570333898067, + 0.5441741831600666 + ], + "unique_experts": 54, + "load_cv": 1.0947706824588863, + "normalized_load_entropy": 0.8865927676878518, + "max_load_share": 0.10585585585585586 + }, + "full_input": { + "tokens": 99, + "top_k": 6, + "decisions": 594, + "ordered_route_sha256": "6ecc5e85262c25abb3e22cbe161e447b896d44599d593bdd2d4259a013649231", + "route_weight_sha256": "c9440e9a8a1fb370718a07ae288a46d446f2198929f06f81dcaa3a64017b0893", + "loads": [ + 7, + 6, + 4, + 1, + 11, + 3, + 3, + 1, + 9, + 1, + 9, + 1, + 13, + 3, + 47, + 16, + 6, + 8, + 14, + 4, + 9, + 11, + 6, + 2, + 6, + 19, + 14, + 6, + 13, + 16, + 0, + 5, + 5, + 8, + 8, + 8, + 10, + 2, + 11, + 13, + 25, + 8, + 18, + 8, + 4, + 14, + 0, + 6, + 9, + 6, + 10, + 12, + 2, + 15, + 10, + 11, + 5, + 9, + 6, + 34, + 6, + 15, + 10, + 12 + ], + "weighted_loads": [ + 0.6457410305738449, + 0.16812902502715588, + 0.1733204796910286, + 0.061047930270433426, + 0.7691570761380717, + 0.09143495932221413, + 0.11346133053302765, + 0.0030409647151827812, + 0.8225511109922081, + 0.004533226136118174, + 0.5581668168306351, + 0.04148566350340843, + 0.952939298003912, + 0.13817834854125977, + 4.665665857493877, + 2.196240103803575, + 0.4746958799660206, + 0.3775258809328079, + 1.1827792637050152, + 0.17794302105903625, + 0.9040124805178493, + 0.9570901244878769, + 0.4664058946073055, + 0.09308703616261482, + 0.40462173894047737, + 1.5933942422270775, + 0.6612439937889576, + 0.6348779648542404, + 1.1295146979391575, + 1.0670126099139452, + 0.0, + 0.1708888951689005, + 0.3194965124130249, + 0.5936673358082771, + 0.6812329031527042, + 0.5712833926081657, + 0.7044696379452944, + 0.10876261815428734, + 1.0572766028344631, + 0.939684035256505, + 2.478014625608921, + 0.7801609933376312, + 1.3705791905522346, + 0.5621906965970993, + 0.30545157939195633, + 1.259036011993885, + 0.0, + 0.34987003076821566, + 0.6757525019347668, + 0.28983799181878567, + 0.9200251959264278, + 0.8149766847491264, + 1.629018783569336, + 0.9665587916970253, + 0.4905200630892068, + 0.7497379593551159, + 0.2832901105284691, + 0.3395194783806801, + 0.45685070380568504, + 3.202244333922863, + 0.42516475170850754, + 1.2985853478312492, + 0.6485570333898067, + 1.4805292636156082 + ], + "unique_experts": 62, + "load_cv": 0.8213211032860624, + "normalized_load_entropy": 0.9320585887978298, + "max_load_share": 0.07912457912457913 + } + }, + "s1_eos": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "b32c76cffb6a49ee1251be2a28e8b12798a0b605c40f3fdc6454d829882476e6", + "route_weight_sha256": "a9fc71a6a857354eae23f23eb92f352b23b55e4c2666a39ad7bed619e59de268", + "loads": [ + 7, + 5, + 4, + 1, + 11, + 0, + 0, + 0, + 8, + 0, + 0, + 1, + 11, + 3, + 46, + 3, + 4, + 1, + 5, + 3, + 9, + 11, + 6, + 2, + 7, + 11, + 15, + 6, + 13, + 16, + 0, + 4, + 6, + 8, + 8, + 3, + 9, + 2, + 0, + 6, + 20, + 0, + 9, + 7, + 3, + 14, + 0, + 4, + 9, + 2, + 2, + 12, + 0, + 6, + 7, + 2, + 4, + 8, + 6, + 34, + 6, + 14, + 9, + 11 + ], + "weighted_loads": [ + 0.6700411178171635, + 0.1642435286194086, + 0.1684124805033207, + 0.06176474317908287, + 0.814608983695507, + 0.0, + 0.0, + 0.0, + 0.8231517430394888, + 0.0, + 0.0, + 0.041385434567928314, + 0.807525210082531, + 0.1409437246620655, + 4.642033185809851, + 0.18921088799834251, + 0.33305108919739723, + 0.04380101338028908, + 0.3572319820523262, + 0.17205017246305943, + 0.9393526799976826, + 0.9587837792932987, + 0.4726380929350853, + 0.0941564291715622, + 0.4282527230679989, + 0.687454205006361, + 0.710956260561943, + 0.628385029733181, + 1.1823514737188816, + 1.0649834387004375, + 0.0, + 0.1286859605461359, + 0.35974644869565964, + 0.5968762896955013, + 0.6819366365671158, + 0.14414622262120247, + 0.6724141649901867, + 0.11113995313644409, + 0.0, + 0.35944060422480106, + 2.277224238961935, + 0.0, + 0.6468897722661495, + 0.521723136305809, + 0.2219293713569641, + 1.2536763213574886, + 0.0, + 0.33357974141836166, + 0.6737350076436996, + 0.08289916627109051, + 0.11031726747751236, + 0.8232653252780437, + 0.0, + 0.3695986531674862, + 0.4816913418471813, + 0.062278421595692635, + 0.24009572342038155, + 0.29995313100516796, + 0.4651000089943409, + 3.24779399856925, + 0.42312684282660484, + 1.2694981843233109, + 0.5890139080584049, + 0.5817023925483227 + ], + "unique_experts": 54, + "load_cv": 1.0944740971009321, + "normalized_load_entropy": 0.8850624953779238, + "max_load_share": 0.1036036036036036 + }, + "full_input": { + "tokens": 115, + "top_k": 6, + "decisions": 690, + "ordered_route_sha256": "6b5dfbe1b96fca2e8a91a6574ebd22460a92ce982536dbc2c0fbd1f86a424010", + "route_weight_sha256": "5e1683ff7688dd64e8d05b29f45743dfbd8f6e5680f523ff2405fc3fa69d3a18", + "loads": [ + 8, + 7, + 4, + 7, + 12, + 3, + 9, + 2, + 9, + 1, + 13, + 4, + 16, + 3, + 47, + 17, + 7, + 12, + 17, + 13, + 11, + 11, + 7, + 2, + 8, + 19, + 15, + 8, + 13, + 18, + 0, + 5, + 7, + 9, + 9, + 8, + 10, + 5, + 12, + 17, + 23, + 13, + 22, + 11, + 4, + 14, + 0, + 7, + 9, + 16, + 12, + 13, + 2, + 16, + 11, + 12, + 4, + 8, + 7, + 35, + 7, + 15, + 9, + 15 + ], + "weighted_loads": [ + 0.706308975815773, + 0.1883227911312133, + 0.1684124805033207, + 0.47963012009859085, + 0.8163809592369944, + 0.0986402053385973, + 1.0210980214178562, + 0.054491596296429634, + 0.8265196178108454, + 0.004425346851348877, + 0.7961312457919121, + 0.4101170226931572, + 1.233008872717619, + 0.1409437246620655, + 4.675354469567537, + 2.6654050922952592, + 0.5653406791388988, + 0.7189774923026562, + 1.5241102054715157, + 1.0145776402205229, + 0.9547075415030122, + 0.9587837792932987, + 0.5104866921901703, + 0.0941564291715622, + 0.5043555982410908, + 1.4089567139744759, + 0.710956260561943, + 0.8008537478744984, + 1.1823514737188816, + 1.1513929702341557, + 0.0, + 0.17000444047152996, + 0.4782230630517006, + 0.6395039297640324, + 0.716350395232439, + 0.6984490565955639, + 0.7173765078186989, + 0.2633896693587303, + 1.1879596039652824, + 1.3845666851848364, + 2.4016756154596806, + 1.1813821531832218, + 1.6967466473579407, + 0.764216486364603, + 0.2840859889984131, + 1.2536763213574886, + 0.0, + 0.38453305303119123, + 0.6737350076436996, + 0.934726495295763, + 1.3066247515380383, + 0.8716258369386196, + 1.6288249492645264, + 1.179132353514433, + 0.536433647852391, + 0.6790091414004564, + 0.24009572342038155, + 0.29995313100516796, + 0.5352175198495388, + 3.2953839264810085, + 0.46877989172935486, + 1.309904158115387, + 0.5890139080584049, + 1.758885893970728 + ], + "unique_experts": 62, + "load_cv": 0.7043836097548276, + "normalized_load_entropy": 0.9465584177473308, + "max_load_share": 0.06811594202898551 + } + }, + "s0_bos": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "60e49c2b85c9cf8fa8a01fada121b68120b63733664d7445268b2779d193febf", + "route_weight_sha256": "982963afb7e26c3cfb238c4bb1f935fc342e8499ffb325043ab79c8d75fd3c7f", + "loads": [ + 7, + 3, + 4, + 1, + 10, + 0, + 0, + 0, + 8, + 1, + 0, + 2, + 11, + 2, + 44, + 3, + 4, + 1, + 5, + 3, + 8, + 11, + 6, + 2, + 7, + 10, + 12, + 6, + 13, + 17, + 0, + 5, + 6, + 9, + 9, + 4, + 11, + 2, + 0, + 6, + 20, + 0, + 8, + 8, + 3, + 14, + 0, + 5, + 9, + 1, + 2, + 12, + 1, + 6, + 7, + 1, + 5, + 9, + 5, + 34, + 5, + 14, + 10, + 12 + ], + "weighted_loads": [ + 0.6397476978600025, + 0.09306247346103191, + 0.17760277166962624, + 0.05756635591387749, + 0.7921102829277515, + 0.0, + 0.0, + 0.0, + 0.8265519440174103, + 0.0379069522023201, + 0.0, + 0.07051385007798672, + 0.7970754764974117, + 0.1029159352183342, + 4.632352743297815, + 0.1798362210392952, + 0.3403201550245285, + 0.04562216252088547, + 0.37206990271806717, + 0.16268889233469963, + 0.9550414234399796, + 0.947417363524437, + 0.49951834604144096, + 0.08610891178250313, + 0.4374060891568661, + 0.6085675749927759, + 0.5707442052662373, + 0.6288041174411774, + 1.092112086713314, + 1.1617306377738714, + 0.0, + 0.19219678081572056, + 0.3645433224737644, + 0.5974738486111164, + 0.7396386750042439, + 0.16898871958255768, + 0.7333255857229233, + 0.10573124140501022, + 0.0, + 0.35894982516765594, + 2.256906621158123, + 0.0, + 0.636958621442318, + 0.5773645155131817, + 0.22905179858207703, + 1.254100639373064, + 0.0, + 0.40259805507957935, + 0.6669247038662434, + 0.05654533952474594, + 0.11754544824361801, + 0.8194800354540348, + 0.03345729410648346, + 0.3732466734945774, + 0.5033075772225857, + 0.03150274604558945, + 0.27270064875483513, + 0.3299761265516281, + 0.4196941629052162, + 3.2277494221925735, + 0.38885778561234474, + 1.2455564476549625, + 0.6422591917216778, + 0.6282846871763468 + ], + "unique_experts": 56, + "load_cv": 1.0695708577076581, + "normalized_load_entropy": 0.8891588119011968, + "max_load_share": 0.0990990990990991 + }, + "full_input": { + "tokens": 99, + "top_k": 6, + "decisions": 594, + "ordered_route_sha256": "52d73af5d79972fd695b11c4b3aab77460d3504060063f43bbe1bab397fa6b8c", + "route_weight_sha256": "e654fdbf9818d6f03e2eeb7f3137296f8f8fa480c1318e2b8ba61a826d4c7df4", + "loads": [ + 7, + 4, + 4, + 1, + 10, + 3, + 2, + 1, + 9, + 1, + 9, + 2, + 14, + 2, + 44, + 16, + 6, + 7, + 15, + 4, + 9, + 11, + 6, + 2, + 7, + 18, + 12, + 6, + 13, + 17, + 0, + 6, + 6, + 9, + 9, + 9, + 11, + 2, + 12, + 14, + 24, + 8, + 18, + 9, + 4, + 14, + 0, + 6, + 9, + 5, + 10, + 12, + 2, + 15, + 9, + 11, + 5, + 9, + 5, + 35, + 5, + 15, + 10, + 14 + ], + "weighted_loads": [ + 0.6397476978600025, + 0.09656415320932865, + 0.17760277166962624, + 0.05756635591387749, + 0.7921102829277515, + 0.09247666038572788, + 0.07367977127432823, + 0.0030409647151827812, + 0.8298933974001557, + 0.0379069522023201, + 0.5641792714595795, + 0.07051385007798672, + 0.993808850646019, + 0.1029159352183342, + 4.632352743297815, + 2.2096117017790675, + 0.4979984685778618, + 0.34323011338710785, + 1.3087041899561882, + 0.17578108236193657, + 0.9676083195954561, + 0.947417363524437, + 0.49951834604144096, + 0.08610891178250313, + 0.4374060891568661, + 1.51080453209579, + 0.5707442052662373, + 0.6288041174411774, + 1.092112086713314, + 1.1617306377738714, + 0.0, + 0.23348348774015903, + 0.3645433224737644, + 0.5974738486111164, + 0.7396386750042439, + 0.6041491404175758, + 0.7333255857229233, + 0.10573124140501022, + 1.2401492670178413, + 0.970090702176094, + 2.4327523559331894, + 0.8171003423631191, + 1.460955411195755, + 0.6231723837554455, + 0.31096285581588745, + 1.254100639373064, + 0.0, + 0.41818021330982447, + 0.6669247038662434, + 0.26849363930523396, + 0.8933890536427498, + 0.8194800354540348, + 0.6979363113641739, + 0.9695877805352211, + 0.5182776984293014, + 0.7180437967181206, + 0.27270064875483513, + 0.3299761265516281, + 0.4196941629052162, + 3.2734095491468906, + 0.38885778561234474, + 1.2884972169995308, + 0.6422591917216778, + 1.5646397676318884 + ], + "unique_experts": 62, + "load_cv": 0.8054882654521063, + "normalized_load_entropy": 0.9324964042065396, + "max_load_share": 0.07407407407407407 + } + }, + "s1_bos": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "54c6e82f5f08a8aba309ef50c4bef4d8469e6141e80693983339c4d884aa36dc", + "route_weight_sha256": "114108e60c11a1a603f3cea68fa086aeea95541c987731bd80709ea70e33e22b", + "loads": [ + 7, + 4, + 4, + 1, + 12, + 0, + 0, + 0, + 8, + 1, + 0, + 3, + 11, + 2, + 44, + 3, + 4, + 1, + 5, + 3, + 7, + 11, + 6, + 2, + 7, + 9, + 13, + 6, + 13, + 17, + 0, + 4, + 5, + 9, + 8, + 4, + 12, + 2, + 0, + 5, + 20, + 0, + 8, + 8, + 3, + 14, + 0, + 4, + 8, + 2, + 2, + 12, + 0, + 7, + 7, + 2, + 4, + 7, + 7, + 34, + 6, + 14, + 9, + 13 + ], + "weighted_loads": [ + 0.6625577248632908, + 0.13233136385679245, + 0.1690777838230133, + 0.061165161430835724, + 0.881091196089983, + 0.0, + 0.0, + 0.0, + 0.8265191167593002, + 0.039609458297491074, + 0.0, + 0.09252624027431011, + 0.8260557986795902, + 0.108903419226408, + 4.612943470478058, + 0.20221832022070885, + 0.3456331677734852, + 0.041461922228336334, + 0.3538232408463955, + 0.16538899019360542, + 0.9121885634958744, + 0.9753248430788517, + 0.5112791024148464, + 0.08821619674563408, + 0.4375941790640354, + 0.5720302164554596, + 0.6146714091300964, + 0.631629504263401, + 1.1033221296966076, + 1.1597489565610886, + 0.0, + 0.14781244657933712, + 0.3276965729892254, + 0.6018139459192753, + 0.6877679973840714, + 0.1716368831694126, + 0.7592375185340643, + 0.1116110347211361, + 0.0, + 0.31466666236519814, + 2.2564049512147903, + 0.0, + 0.6396866999566555, + 0.596078671514988, + 0.22897722572088242, + 1.2378962878137827, + 0.0, + 0.34101011976599693, + 0.6263207904994488, + 0.08268560096621513, + 0.13247716799378395, + 0.8325964398682117, + 0.0, + 0.3986027892678976, + 0.48389003425836563, + 0.06649928167462349, + 0.23132139816880226, + 0.27585212886333466, + 0.5141899287700653, + 3.220550872385502, + 0.4226313978433609, + 1.2564134821295738, + 0.6085152253508568, + 0.6778494119644165 + ], + "unique_experts": 55, + "load_cv": 1.0716934754320668, + "normalized_load_entropy": 0.8888855448618933, + "max_load_share": 0.0990990990990991 + }, + "full_input": { + "tokens": 115, + "top_k": 6, + "decisions": 690, + "ordered_route_sha256": "223fa79381ac88cfab54509b175b8968d3d9481ff350f5087e20a64967d07580", + "route_weight_sha256": "17e7fac6741056843186f3a6c4584cc2862beb09e9be1c961992bf4f69889aa3", + "loads": [ + 8, + 6, + 4, + 7, + 12, + 3, + 9, + 2, + 9, + 1, + 13, + 6, + 16, + 2, + 45, + 18, + 8, + 12, + 19, + 13, + 8, + 11, + 7, + 2, + 8, + 17, + 13, + 8, + 13, + 19, + 0, + 5, + 6, + 10, + 9, + 9, + 13, + 5, + 13, + 16, + 22, + 13, + 22, + 12, + 4, + 14, + 0, + 6, + 8, + 15, + 13, + 13, + 1, + 17, + 10, + 13, + 4, + 7, + 8, + 35, + 7, + 15, + 9, + 17 + ], + "weighted_loads": [ + 0.6988255828619003, + 0.15641062636859715, + 0.1690777838230133, + 0.4790305383503437, + 0.881091196089983, + 0.10104539804160595, + 1.0174862705171108, + 0.054491596296429634, + 0.8298869915306568, + 0.039609458297491074, + 0.794151596724987, + 0.461257828399539, + 1.2562467232346535, + 0.108903419226408, + 4.6462647542357445, + 2.737778780516237, + 0.6217804588377476, + 0.7166384011507034, + 1.6717695631086826, + 1.0079164579510689, + 0.924755459651351, + 0.9753248430788517, + 0.5491277016699314, + 0.08821619674563408, + 0.5136970542371273, + 1.2935327254235744, + 0.6146714091300964, + 0.8040982224047184, + 1.1033221296966076, + 1.2461584880948067, + 0.0, + 0.1911869365721941, + 0.44617318734526634, + 0.6444415859878063, + 0.7221817560493946, + 0.7296643666923046, + 0.8041998613625765, + 0.2638607509434223, + 1.3592483289539814, + 1.3291495516896248, + 2.3470993041992188, + 1.2105395123362541, + 1.7287302315235138, + 0.8404381088912487, + 0.2911338433623314, + 1.2378962878137827, + 0.0, + 0.38952119555324316, + 0.6263207904994488, + 0.8969692122191191, + 1.3579300753772259, + 0.8809569515287876, + 0.6644790172576904, + 1.2081364896148443, + 0.5366363299544901, + 0.7041920237243176, + 0.23132139816880226, + 0.27585212886333466, + 0.5843074396252632, + 3.2681408002972603, + 0.4682844467461109, + 1.3008403852581978, + 0.6085152253508568, + 1.8550329133868217 + ], + "unique_experts": 62, + "load_cv": 0.6963221411527923, + "normalized_load_entropy": 0.9460905393347093, + "max_load_share": 0.06521739130434782 + } + }, + "s0_x": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "79374aaff17723e0af6334a2e9d27c2f431c78b38cf95e087bc18e09ec7b6729", + "route_weight_sha256": "6d190aa1b273f220ea44e39881ec9b33631262d74e60c2ab7c2bbefc3c0b8f52", + "loads": [ + 7, + 3, + 4, + 1, + 11, + 0, + 0, + 0, + 9, + 1, + 0, + 2, + 10, + 2, + 46, + 3, + 4, + 2, + 5, + 3, + 9, + 11, + 6, + 2, + 7, + 10, + 12, + 6, + 13, + 17, + 0, + 5, + 4, + 9, + 9, + 4, + 11, + 2, + 0, + 6, + 20, + 0, + 7, + 8, + 3, + 14, + 0, + 4, + 8, + 2, + 3, + 12, + 1, + 6, + 7, + 3, + 4, + 8, + 6, + 33, + 6, + 13, + 10, + 10 + ], + "weighted_loads": [ + 0.6042931117117405, + 0.10268040001392365, + 0.17557137459516525, + 0.059667475521564484, + 0.863834772258997, + 0.0, + 0.0, + 0.0, + 0.8556504603475332, + 0.03699391335248947, + 0.0, + 0.06927366368472576, + 0.7842292711138725, + 0.10218258202075958, + 4.591417510062456, + 0.1748202070593834, + 0.32682038471102715, + 0.0809602215886116, + 0.3883146159350872, + 0.16741584986448288, + 1.0081118494272232, + 0.9174019247293472, + 0.4814521409571171, + 0.080294169485569, + 0.432945191860199, + 0.6232635751366615, + 0.5624192766845226, + 0.6313104555010796, + 1.0580198764801025, + 1.1548135448247194, + 0.0, + 0.19375787675380707, + 0.27731940895318985, + 0.5993716940283775, + 0.7341325618326664, + 0.17057056725025177, + 0.7460022587329149, + 0.10373253375291824, + 0.0, + 0.37673917785286903, + 2.27265902236104, + 0.0, + 0.5506999045610428, + 0.5782409235835075, + 0.23291566967964172, + 1.2318572290241718, + 0.0, + 0.33995010890066624, + 0.6325833387672901, + 0.08774106204509735, + 0.16635781154036522, + 0.8042773008346558, + 0.03211227431893349, + 0.36592836305499077, + 0.4837038032710552, + 0.09241880476474762, + 0.23596839606761932, + 0.29893311858177185, + 0.44038259610533714, + 3.1058026775717735, + 0.41884592920541763, + 1.1610507853329182, + 0.6437819227576256, + 0.5191248301416636 + ], + "unique_experts": 56, + "load_cv": 1.0741141879969858, + "normalized_load_entropy": 0.8919384368908907, + "max_load_share": 0.1036036036036036 + }, + "full_input": { + "tokens": 99, + "top_k": 6, + "decisions": 594, + "ordered_route_sha256": "7f6a23b1c0fe6bd403e46e539bf05de89df64bca0d84ebe358948cb2082e8075", + "route_weight_sha256": "97e8badb84dd064e768b30e757fc9c861c1e886440d9596fbe0aa7ac434eedc7", + "loads": [ + 7, + 4, + 4, + 1, + 11, + 3, + 2, + 1, + 10, + 1, + 10, + 2, + 13, + 2, + 46, + 16, + 6, + 8, + 14, + 4, + 10, + 11, + 6, + 2, + 7, + 19, + 12, + 6, + 13, + 17, + 0, + 6, + 4, + 9, + 9, + 9, + 11, + 2, + 10, + 13, + 26, + 8, + 16, + 9, + 4, + 14, + 0, + 5, + 8, + 5, + 11, + 12, + 2, + 17, + 9, + 13, + 4, + 8, + 6, + 34, + 6, + 14, + 10, + 12 + ], + "weighted_loads": [ + 0.6042931117117405, + 0.10618207976222038, + 0.17557137459516525, + 0.059667475521564484, + 0.863834772258997, + 0.09899572469294071, + 0.07281870394945145, + 0.0030409647151827812, + 0.8589919137302786, + 0.03699391335248947, + 0.6516875475645065, + 0.06927366368472576, + 0.975175254046917, + 0.10218258202075958, + 4.591417510062456, + 2.3894608533009887, + 0.4863334782421589, + 0.378568172454834, + 1.195093359798193, + 0.18050803989171982, + 1.0206787455826998, + 0.9174019247293472, + 0.4814521409571171, + 0.080294169485569, + 0.432945191860199, + 1.6109341122210026, + 0.5624192766845226, + 0.6313104555010796, + 1.0580198764801025, + 1.1548135448247194, + 0.0, + 0.2337840162217617, + 0.27731940895318985, + 0.5993716940283775, + 0.7341325618326664, + 0.5953182056546211, + 0.7460022587329149, + 0.10373253375291824, + 0.9250131361186504, + 0.9617868289351463, + 2.5641091503202915, + 0.7710450515151024, + 1.2461942173540592, + 0.6138599775731564, + 0.31482672691345215, + 1.2318572290241718, + 0.0, + 0.35553226713091135, + 0.6325833387672901, + 0.24634423665702343, + 0.9527902863919735, + 0.8042773008346558, + 0.6965912915766239, + 1.075589306652546, + 0.4986739244777709, + 0.8550206311047077, + 0.23596839606761932, + 0.29893311858177185, + 0.44038259610533714, + 3.1514628045260906, + 0.41884592920541763, + 1.2028621546924114, + 0.6437819227576256, + 1.4554799105972052 + ], + "unique_experts": 62, + "load_cv": 0.8217626812225858, + "normalized_load_entropy": 0.9308832628041742, + "max_load_share": 0.07744107744107744 + } + }, + "s1_x": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "79bb68243610f1fc164e0071a1282069f17f7938b2d178d7735092323a3e8814", + "route_weight_sha256": "49dbdc46f7fc0d6b85850b2aee2d890a91fd05c3d3b21c272eeedd8f6f0af8e2", + "loads": [ + 7, + 2, + 4, + 1, + 13, + 0, + 1, + 0, + 8, + 2, + 0, + 2, + 10, + 2, + 45, + 4, + 4, + 2, + 5, + 3, + 7, + 11, + 6, + 2, + 7, + 12, + 13, + 6, + 13, + 16, + 0, + 4, + 4, + 9, + 9, + 4, + 12, + 2, + 0, + 5, + 20, + 0, + 7, + 7, + 3, + 13, + 0, + 4, + 8, + 2, + 2, + 12, + 0, + 7, + 6, + 3, + 4, + 9, + 7, + 32, + 6, + 13, + 9, + 13 + ], + "weighted_loads": [ + 0.6594737358391285, + 0.07132054306566715, + 0.17069410905241966, + 0.06279165297746658, + 0.9538425877690315, + 0.0, + 0.030653145164251328, + 0.0, + 0.831076106056571, + 0.08359762281179428, + 0.0, + 0.069688456133008, + 0.8004734851419926, + 0.11125696450471878, + 4.56598442979157, + 0.25817448645830154, + 0.328378826379776, + 0.07786507904529572, + 0.36865653842687607, + 0.16439732536673546, + 0.9294427260756493, + 0.935471698641777, + 0.4940197728574276, + 0.0852464810013771, + 0.43814269825816154, + 0.6979307699948549, + 0.6211857348680496, + 0.6237114444375038, + 1.0453482829034328, + 1.1085983123630285, + 0.0, + 0.15466397069394588, + 0.2722458057105541, + 0.5656435415148735, + 0.7273099794983864, + 0.17495265044271946, + 0.792185602709651, + 0.11218415573239326, + 0.0, + 0.3214859403669834, + 2.23385414108634, + 0.0, + 0.601079810410738, + 0.5419899933040142, + 0.2287641316652298, + 1.1887051612138748, + 0.0, + 0.300599105656147, + 0.6242451518774033, + 0.07772709242999554, + 0.12774411216378212, + 0.8199122063815594, + 0.0, + 0.38747528940439224, + 0.44439002126455307, + 0.09608533978462219, + 0.22028080746531487, + 0.3424305524677038, + 0.5219633281230927, + 3.0965240262448788, + 0.43517692014575005, + 1.1887220740318298, + 0.6116922162473202, + 0.65660460293293 + ], + "unique_experts": 56, + "load_cv": 1.0619554468020842, + "normalized_load_entropy": 0.8922605037261998, + "max_load_share": 0.10135135135135136 + }, + "full_input": { + "tokens": 115, + "top_k": 6, + "decisions": 690, + "ordered_route_sha256": "3d2f0f9abda292c649b7804fe95fab0ec43cd6b0f3ab9ee2242f2f160bc0410f", + "route_weight_sha256": "7191c0e35c3d19e2553240c6e41b19289c640854a4290456b21599cdf4b135ea", + "loads": [ + 8, + 4, + 4, + 7, + 13, + 3, + 10, + 2, + 9, + 2, + 15, + 5, + 15, + 2, + 46, + 19, + 8, + 13, + 18, + 13, + 8, + 11, + 7, + 2, + 8, + 21, + 13, + 8, + 13, + 18, + 0, + 5, + 5, + 11, + 10, + 10, + 13, + 5, + 11, + 16, + 23, + 12, + 19, + 11, + 4, + 13, + 0, + 6, + 8, + 15, + 11, + 13, + 1, + 19, + 9, + 14, + 4, + 9, + 8, + 33, + 7, + 14, + 9, + 17 + ], + "weighted_loads": [ + 0.695741593837738, + 0.09539980557747185, + 0.17069410905241966, + 0.48065702989697456, + 0.9538425877690315, + 0.10792405903339386, + 1.0474457778036594, + 0.054491596296429634, + 0.8344439808279276, + 0.08359762281179428, + 0.9226126857101917, + 0.4384200442582369, + 1.2358240559697151, + 0.11125696450471878, + 4.599305713549256, + 3.0034170537255704, + 0.6131477616727352, + 0.7530415579676628, + 1.5175790190696716, + 1.006924793124199, + 0.9420096222311258, + 0.935471698641777, + 0.5318683721125126, + 0.0852464810013771, + 0.5142455734312534, + 1.497900439426303, + 0.6211857348680496, + 0.7961801625788212, + 1.0453482829034328, + 1.1950078438967466, + 0.0, + 0.20227240957319736, + 0.3907224200665951, + 0.651397317647934, + 0.7617237381637096, + 0.7646884974092245, + 0.8371479455381632, + 0.2644338719546795, + 1.031319323927164, + 1.3547489568591118, + 2.3990792967379093, + 1.1159202493727207, + 1.5472449958324432, + 0.7812074758112431, + 0.29092074930667877, + 1.1887051612138748, + 0.0, + 0.34911018144339323, + 0.6242451518774033, + 0.883265495300293, + 1.221285242587328, + 0.8682727180421352, + 0.6644790172576904, + 1.3094876743853092, + 0.4971363169606775, + 0.8082332573831081, + 0.22028080746531487, + 0.3424305524677038, + 0.5920808389782906, + 3.144113954156637, + 0.48082996904850006, + 1.2328106760978699, + 0.6116922162473202, + 1.8337881043553352 + ], + "unique_experts": 62, + "load_cv": 0.6980574360286975, + "normalized_load_entropy": 0.9460057783184228, + "max_load_share": 0.06666666666666667 + } + }, + "s0_period": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "4c4633c73c6bca980cb270f19ef4bef0c6b1d5b9694941d7aeb646cb28d9cb2a", + "route_weight_sha256": "876ebbca20eb9baf0404a2905168736117b632ad268fff4a083a74f75fad8e7a", + "loads": [ + 7, + 3, + 4, + 1, + 11, + 0, + 0, + 0, + 8, + 1, + 0, + 2, + 10, + 2, + 46, + 3, + 4, + 2, + 5, + 3, + 9, + 11, + 6, + 2, + 7, + 10, + 12, + 6, + 13, + 17, + 0, + 5, + 4, + 9, + 9, + 3, + 10, + 2, + 0, + 6, + 20, + 0, + 7, + 8, + 3, + 14, + 0, + 5, + 8, + 2, + 3, + 12, + 1, + 6, + 7, + 4, + 4, + 8, + 7, + 33, + 6, + 14, + 9, + 10 + ], + "weighted_loads": [ + 0.6028225719928741, + 0.10057747177779675, + 0.17652710899710655, + 0.05859967693686485, + 0.8449945859611034, + 0.0, + 0.0, + 0.0, + 0.8103036656975746, + 0.03763606399297714, + 0.0, + 0.06813088245689869, + 0.7790728658437729, + 0.10357699915766716, + 4.580073527991772, + 0.16519517824053764, + 0.3271546848118305, + 0.07798580452799797, + 0.4007176123559475, + 0.1647941693663597, + 1.0058975666761398, + 0.9413183704018593, + 0.4838389866054058, + 0.08070932701230049, + 0.43482865020632744, + 0.6330962739884853, + 0.5597987622022629, + 0.6279641315340996, + 1.0682168863713741, + 1.1617000363767147, + 0.0, + 0.20147464610636234, + 0.2778366468846798, + 0.6023431308567524, + 0.7325230054557323, + 0.13164032250642776, + 0.6986530292779207, + 0.103733841329813, + 0.0, + 0.37706313841044903, + 2.270984824746847, + 0.0, + 0.5538337416946888, + 0.5767271555960178, + 0.23454494029283524, + 1.230856765061617, + 0.0, + 0.3788759149610996, + 0.6218680068850517, + 0.08681723661720753, + 0.15858324244618416, + 0.8041884675621986, + 0.03167780861258507, + 0.3645767495036125, + 0.4851476438343525, + 0.13006115145981312, + 0.23747975751757622, + 0.30225105956196785, + 0.4850887060165405, + 3.10462786257267, + 0.41955622658133507, + 1.2144556567072868, + 0.6068325415253639, + 0.5266294591128826 + ], + "unique_experts": 56, + "load_cv": 1.072904514423368, + "normalized_load_entropy": 0.8923532812255471, + "max_load_share": 0.1036036036036036 + }, + "full_input": { + "tokens": 99, + "top_k": 6, + "decisions": 594, + "ordered_route_sha256": "f748615f2a64ca39a6db2c576e3ee5428d74a07ac6cec01b5cc3d082da10f275", + "route_weight_sha256": "95f2d11e42686b79c53bf66a78e7dc96b0af8cc12b000a2a84fe202c8f3a5669", + "loads": [ + 7, + 4, + 4, + 1, + 11, + 3, + 2, + 1, + 9, + 1, + 10, + 2, + 13, + 2, + 46, + 16, + 7, + 9, + 14, + 4, + 10, + 11, + 6, + 2, + 7, + 18, + 12, + 6, + 13, + 17, + 0, + 6, + 4, + 9, + 9, + 9, + 10, + 2, + 10, + 13, + 25, + 8, + 15, + 9, + 5, + 14, + 0, + 6, + 8, + 6, + 11, + 12, + 2, + 15, + 9, + 14, + 4, + 8, + 7, + 34, + 6, + 15, + 9, + 12 + ], + "weighted_loads": [ + 0.6028225719928741, + 0.10407915152609348, + 0.17652710899710655, + 0.05859967693686485, + 0.8449945859611034, + 0.09802407212555408, + 0.07329284399747849, + 0.0030409647151827812, + 0.81364511908032, + 0.03763606399297714, + 0.6528034880757332, + 0.06813088245689869, + 0.9705833084881306, + 0.10357699915766716, + 4.580073527991772, + 2.213478389196098, + 0.5254495218396187, + 0.4329567104578018, + 1.1527003310620785, + 0.17788635939359665, + 1.0184644628316164, + 0.9413183704018593, + 0.4838389866054058, + 0.08070932701230049, + 0.43482865020632744, + 1.5353332310914993, + 0.5597987622022629, + 0.6279641315340996, + 1.0682168863713741, + 1.1617000363767147, + 0.0, + 0.24897369928658009, + 0.2778366468846798, + 0.6023431308567524, + 0.7325230054557323, + 0.6118972599506378, + 0.6986530292779207, + 0.103733841329813, + 0.8860908597707748, + 0.9558484349399805, + 2.5045585073530674, + 0.8099591620266438, + 1.2128100283443928, + 0.6125572361052036, + 0.371946569532156, + 1.230856765061617, + 0.0, + 0.39445807319134474, + 0.6218680068850517, + 0.2810148447751999, + 0.9525541253387928, + 0.8041884675621986, + 0.6961568258702755, + 0.9609178565442562, + 0.5001177650410682, + 1.0187535155564547, + 0.23747975751757622, + 0.30225105956196785, + 0.4850887060165405, + 3.150287989526987, + 0.41955622658133507, + 1.2564457841217518, + 0.6068325415253639, + 1.4629845395684242 + ], + "unique_experts": 62, + "load_cv": 0.8093074304189841, + "normalized_load_entropy": 0.9329992094293271, + "max_load_share": 0.07744107744107744 + } + }, + "s1_period": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "89484ad38733238d25ee18937b2020dae52d874ee3090e89cce02339a92c50ff", + "route_weight_sha256": "8829dda06e3091156b2b9363241dea7514502221059c352e4a1ce5ddfff34730", + "loads": [ + 7, + 2, + 4, + 1, + 13, + 0, + 0, + 0, + 8, + 2, + 0, + 2, + 11, + 2, + 46, + 3, + 4, + 1, + 5, + 3, + 7, + 11, + 6, + 2, + 7, + 10, + 13, + 6, + 13, + 17, + 0, + 4, + 4, + 8, + 8, + 3, + 12, + 3, + 0, + 5, + 20, + 0, + 8, + 7, + 3, + 14, + 0, + 5, + 8, + 2, + 2, + 12, + 0, + 7, + 6, + 3, + 4, + 9, + 7, + 34, + 6, + 12, + 9, + 13 + ], + "weighted_loads": [ + 0.6629663668572903, + 0.0711025632917881, + 0.17175613716244698, + 0.06190648302435875, + 0.9359999746084213, + 0.0, + 0.0, + 0.0, + 0.8139979150146246, + 0.08251471817493439, + 0.0, + 0.06828327663242817, + 0.8434941358864307, + 0.11259889602661133, + 4.647069895640016, + 0.2001762017607689, + 0.33391787856817245, + 0.0405593179166317, + 0.38763412460684776, + 0.16016100719571114, + 0.9225889407098293, + 0.9516766928136349, + 0.49861229956150055, + 0.08580765128135681, + 0.43784765154123306, + 0.606422221288085, + 0.6235767751932144, + 0.6227707043290138, + 1.0253131948411465, + 1.1519169956445694, + 0.0, + 0.15771053545176983, + 0.2766753099858761, + 0.5493445843458176, + 0.689202293753624, + 0.12244928441941738, + 0.7950395420193672, + 0.14907551184296608, + 0.0, + 0.330491129308939, + 2.2325802855193615, + 0.0, + 0.6435105986893177, + 0.5426360480487347, + 0.2347315475344658, + 1.219070989638567, + 0.0, + 0.344948161393404, + 0.6239793598651886, + 0.079145148396492, + 0.12610502168536186, + 0.8241928890347481, + 0.0, + 0.38741837441921234, + 0.44260062277317047, + 0.09543863497674465, + 0.2283114492893219, + 0.3426744118332863, + 0.5276271067559719, + 3.1895837150514126, + 0.43202299252152443, + 1.179653838276863, + 0.610813032835722, + 0.6547743491828442 + ], + "unique_experts": 55, + "load_cv": 1.0938806851442757, + "normalized_load_entropy": 0.8871101590977218, + "max_load_share": 0.1036036036036036 + }, + "full_input": { + "tokens": 115, + "top_k": 6, + "decisions": 690, + "ordered_route_sha256": "d5c0a641ebe7ed87f6b16850728ab6899fb3c617206efcf40bbbb9447cc16f6a", + "route_weight_sha256": "2fa772adadc0fda0ac2ee1de6c8109b547eae7e54d9db6138cf2cdedac83eb3d", + "loads": [ + 8, + 4, + 4, + 7, + 13, + 3, + 9, + 2, + 9, + 2, + 15, + 5, + 16, + 2, + 47, + 19, + 8, + 13, + 18, + 13, + 8, + 11, + 7, + 2, + 8, + 18, + 13, + 8, + 13, + 19, + 0, + 5, + 5, + 9, + 9, + 9, + 13, + 6, + 11, + 16, + 23, + 13, + 20, + 11, + 5, + 14, + 0, + 7, + 8, + 15, + 11, + 13, + 1, + 17, + 9, + 14, + 4, + 9, + 8, + 35, + 7, + 13, + 9, + 17 + ], + "weighted_loads": [ + 0.6992342248558998, + 0.0951818258035928, + 0.17175613716244698, + 0.47977185994386673, + 0.9359999746084213, + 0.10722051933407784, + 1.0162265785038471, + 0.054491596296429634, + 0.8173657897859812, + 0.08251471817493439, + 0.9320448189973831, + 0.43701486475765705, + 1.2812188938260078, + 0.11259889602661133, + 4.680391179397702, + 2.811747574713081, + 0.641237199306488, + 0.75696637108922, + 1.500921554863453, + 1.0026884749531746, + 0.9351558368653059, + 0.9516766928136349, + 0.5364608988165855, + 0.08580765128135681, + 0.513950526714325, + 1.3279247302561998, + 0.6235767751932144, + 0.7952394224703312, + 1.0253131948411465, + 1.2383265271782875, + 0.0, + 0.21017270721495152, + 0.39515192434191704, + 0.5919722244143486, + 0.7236160524189472, + 0.7520542945712805, + 0.8400018848478794, + 0.3013252280652523, + 0.9931660704314709, + 1.366261899471283, + 2.3746130615472794, + 1.2326526306569576, + 1.5976351350545883, + 0.7812882177531719, + 0.3423762805759907, + 1.219070989638567, + 0.0, + 0.39345923718065023, + 0.6239793598651886, + 0.877107659354806, + 1.219109870493412, + 0.8725534006953239, + 0.6644790172576904, + 1.196952074766159, + 0.4953469184692949, + 0.8951697628945112, + 0.2283114492893219, + 0.3426744118332863, + 0.5977446176111698, + 3.237173642963171, + 0.47767604142427444, + 1.2243296913802624, + 0.610813032835722, + 1.8319578506052494 + ], + "unique_experts": 62, + "load_cv": 0.7083799421264392, + "normalized_load_entropy": 0.9456294815750799, + "max_load_share": 0.06811594202898551 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 74, + "ordered_topk_exact_tokens": 58, + "set_exact_tokens": 65, + "mean_set_jaccard": 0.9652509652509654, + "mean_token_weighted_tv": 0.009954050120369002, + "aggregate_load_tv": 0.02027027027027027 + }, + "system_bos": { + "tokens": 74, + "ordered_topk_exact_tokens": 53, + "set_exact_tokens": 55, + "mean_set_jaccard": 0.9266409266409268, + "mean_token_weighted_tv": 0.019045199519275007, + "aggregate_load_tv": 0.02927927927927928 + }, + "system_x": { + "tokens": 74, + "ordered_topk_exact_tokens": 44, + "set_exact_tokens": 54, + "mean_set_jaccard": 0.9227799227799228, + "mean_token_weighted_tv": 0.022338697900743904, + "aggregate_load_tv": 0.03378378378378378 + }, + "system_period": { + "tokens": 74, + "ordered_topk_exact_tokens": 44, + "set_exact_tokens": 53, + "mean_set_jaccard": 0.9131274131274131, + "mean_token_weighted_tv": 0.023315613384585123, + "aggregate_load_tv": 0.03378378378378378 + }, + "bos_at_s0": { + "tokens": 74, + "ordered_topk_exact_tokens": 38, + "set_exact_tokens": 48, + "mean_set_jaccard": 0.8996138996138996, + "mean_token_weighted_tv": 0.025899407151784445, + "aggregate_load_tv": 0.038288288288288286 + }, + "bos_at_s1": { + "tokens": 74, + "ordered_topk_exact_tokens": 41, + "set_exact_tokens": 51, + "mean_set_jaccard": 0.9083011583011584, + "mean_token_weighted_tv": 0.02469829989697885, + "aggregate_load_tv": 0.033783783783783786 + }, + "x_at_s0": { + "tokens": 74, + "ordered_topk_exact_tokens": 40, + "set_exact_tokens": 48, + "mean_set_jaccard": 0.8938223938223938, + "mean_token_weighted_tv": 0.026985958885602856, + "aggregate_load_tv": 0.03603603603603604 + }, + "x_at_s1": { + "tokens": 74, + "ordered_topk_exact_tokens": 33, + "set_exact_tokens": 45, + "mean_set_jaccard": 0.87998712998713, + "mean_token_weighted_tv": 0.03173520047267949, + "aggregate_load_tv": 0.047297297297297286 + }, + "period_at_s0": { + "tokens": 74, + "ordered_topk_exact_tokens": 42, + "set_exact_tokens": 53, + "mean_set_jaccard": 0.9131274131274133, + "mean_token_weighted_tv": 0.02426395200293612, + "aggregate_load_tv": 0.03603603603603604 + }, + "period_at_s1": { + "tokens": 74, + "ordered_topk_exact_tokens": 36, + "set_exact_tokens": 46, + "mean_set_jaccard": 0.8861003861003861, + "mean_token_weighted_tv": 0.030168585793895496, + "aggregate_load_tv": 0.038288288288288286 + } + } + }, + "layer_06": { + "layer": 6, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "affba7f6c7edfbb4b6d27b6420885298905d3b1955cd7455eab39c48df48ff5f", + "route_weight_sha256": "5d8eb3865e76ffbacb6c228bbe1286dc2cae7a32d18fdde9b4672d1d0fbbbbb5", + "loads": [ + 11, + 3, + 3, + 0, + 1, + 3, + 8, + 11, + 22, + 8, + 5, + 11, + 8, + 8, + 1, + 5, + 10, + 9, + 8, + 6, + 8, + 2, + 5, + 1, + 0, + 25, + 5, + 12, + 40, + 2, + 0, + 5, + 7, + 2, + 8, + 0, + 22, + 4, + 13, + 1, + 11, + 2, + 4, + 6, + 5, + 2, + 1, + 5, + 6, + 10, + 4, + 16, + 6, + 0, + 12, + 1, + 7, + 1, + 4, + 11, + 3, + 11, + 7, + 6 + ], + "weighted_loads": [ + 0.6341545153409243, + 0.10790037736296654, + 0.15611682459712029, + 0.0, + 0.0356714129447937, + 0.18258440494537354, + 0.6110900044441223, + 0.8237903453409672, + 1.8991768285632133, + 0.5764962248504162, + 0.5337793715298176, + 0.8336219638586044, + 0.8406340926885605, + 0.5051785446703434, + 0.06779661029577255, + 0.2888545785099268, + 0.7167566753923893, + 0.6041426379233599, + 0.690641961991787, + 0.337637223303318, + 0.4684113338589668, + 0.1848924607038498, + 0.3872990421950817, + 0.02746986597776413, + 0.0, + 1.7709710821509361, + 0.21557964757084846, + 0.9007274191826582, + 4.1333571299910545, + 0.1084214597940445, + 0.0, + 0.46917591243982315, + 0.9308930337429047, + 0.06781960092484951, + 0.6098823174834251, + 0.0, + 2.1886109486222267, + 0.2709661275148392, + 1.094143370166421, + 0.0406474769115448, + 0.8186547644436359, + 0.17163991183042526, + 0.20072934217751026, + 0.21630150265991688, + 0.37406885996460915, + 0.05633343756198883, + 0.040920570492744446, + 0.5722265020012856, + 0.46624235063791275, + 0.6459794491529465, + 0.19473068788647652, + 1.0207362528890371, + 0.39323998615145683, + 0.0, + 0.7854939959943295, + 0.06650803983211517, + 0.7802147343754768, + 0.045758478343486786, + 0.17483500391244888, + 0.8439017534255981, + 0.14523235335946083, + 1.088599320501089, + 0.2568923644721508, + 0.34970318526029587 + ], + "unique_experts": 59, + "load_cv": 0.9719297042753429, + "normalized_load_entropy": 0.9051451100191651, + "max_load_share": 0.09009009009009009 + }, + "full_input": { + "tokens": 99, + "top_k": 6, + "decisions": 594, + "ordered_route_sha256": "0ff7092c9adc99b69e1d1b60d7795d5faf5755390f823f0898429d8370fc87d9", + "route_weight_sha256": "3a33588e3a7646327d6961cb156a3ad2ac9a37787dcc25de33f5b58b835acc7a", + "loads": [ + 11, + 6, + 3, + 0, + 2, + 3, + 16, + 11, + 22, + 8, + 5, + 17, + 8, + 10, + 3, + 5, + 15, + 10, + 8, + 14, + 9, + 5, + 8, + 2, + 0, + 26, + 5, + 12, + 40, + 5, + 0, + 5, + 10, + 2, + 9, + 5, + 22, + 13, + 13, + 10, + 12, + 7, + 6, + 6, + 5, + 7, + 13, + 7, + 10, + 10, + 11, + 23, + 6, + 1, + 12, + 11, + 17, + 1, + 4, + 20, + 3, + 11, + 7, + 6 + ], + "weighted_loads": [ + 0.6341545153409243, + 0.17859839368611574, + 0.15611682459712029, + 0.0, + 0.06406372971832752, + 0.18258440494537354, + 1.5184022188186646, + 0.8237903453409672, + 1.8991768285632133, + 0.5764962248504162, + 0.5337793715298176, + 1.2410270981490612, + 0.8406340926885605, + 0.5332367452792823, + 0.21729717403650284, + 0.2888545785099268, + 1.0688650459051132, + 0.6081857178360224, + 0.690641961991787, + 0.8865304440259933, + 0.5121410042047501, + 0.35564687475562096, + 1.9084301143884659, + 0.06321300193667412, + 0.0, + 1.7984481994062662, + 0.21557964757084846, + 0.9007274191826582, + 4.1333571299910545, + 0.27493348345160484, + 0.0, + 0.46917591243982315, + 1.0321062467992306, + 0.06781960092484951, + 0.644829273223877, + 0.452108483761549, + 2.1886109486222267, + 0.9660094678401947, + 1.094143370166421, + 0.4037403017282486, + 0.876495823264122, + 0.5694425292313099, + 0.25875669717788696, + 0.21630150265991688, + 0.37406885996460915, + 0.19052044535055757, + 1.3401880748569965, + 0.5946180506143719, + 0.669709000736475, + 0.6459794491529465, + 0.6915691494941711, + 1.3261484745889902, + 0.39323998615145683, + 0.04325157031416893, + 0.7854939959943295, + 0.8275666795670986, + 2.0237882919609547, + 0.045758478343486786, + 0.17483500391244888, + 1.8105614855885506, + 0.14523235335946083, + 1.088599320501089, + 0.2568923644721508, + 0.34970318526029587 + ], + "unique_experts": 61, + "load_cv": 0.7521541880746789, + "normalized_load_entropy": 0.9367483440838474, + "max_load_share": 0.06734006734006734 + } + }, + "s1_eos": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "c206c9b714b841391ebbbc9b6fac1a140aaea3dd2a5999c541c04ecec9d20b45", + "route_weight_sha256": "87143f258098d3d5317c38fefe8d1f567ee8c9b89f8277e2c297a3ca01a8ee0d", + "loads": [ + 11, + 3, + 3, + 0, + 2, + 3, + 8, + 11, + 22, + 8, + 5, + 12, + 8, + 8, + 1, + 5, + 10, + 9, + 8, + 6, + 8, + 2, + 5, + 0, + 0, + 24, + 7, + 12, + 41, + 2, + 0, + 5, + 7, + 1, + 8, + 0, + 22, + 4, + 13, + 1, + 11, + 2, + 4, + 6, + 5, + 2, + 1, + 5, + 6, + 9, + 4, + 16, + 6, + 0, + 14, + 1, + 6, + 1, + 4, + 11, + 3, + 11, + 5, + 6 + ], + "weighted_loads": [ + 0.6468314453959465, + 0.10945066809654236, + 0.1556498184800148, + 0.0, + 0.06573349237442017, + 0.18220125883817673, + 0.6277451813220978, + 0.8109758347272873, + 1.885450728237629, + 0.5706702582538128, + 0.5358706340193748, + 0.8884594570845366, + 0.8403720110654831, + 0.5115864239633083, + 0.06599486619234085, + 0.2887144200503826, + 0.7191773764789104, + 0.6001232415437698, + 0.6882774494588375, + 0.34898932464420795, + 0.47370322048664093, + 0.1830468624830246, + 0.3848392106592655, + 0.0, + 0.0, + 1.7068319879472256, + 0.276879383251071, + 0.90311080776155, + 4.183059949427843, + 0.10487395897507668, + 0.0, + 0.4724181666970253, + 0.9374934285879135, + 0.045141831040382385, + 0.6011864393949509, + 0.0, + 2.187365412712097, + 0.25390976667404175, + 1.0865003522485495, + 0.03971560671925545, + 0.8271596878767014, + 0.17707934975624084, + 0.197887459769845, + 0.21462945453822613, + 0.37671131268143654, + 0.05607913061976433, + 0.03751544654369354, + 0.5815227217972279, + 0.468730665743351, + 0.6088718250393867, + 0.19046035408973694, + 1.030263263732195, + 0.4002962112426758, + 0.0, + 0.8472379446029663, + 0.06723051518201828, + 0.7266501002013683, + 0.04752276465296745, + 0.17628931626677513, + 0.8416531421244144, + 0.1503344364464283, + 1.1344688925892115, + 0.192894846200943, + 0.375265896320343 + ], + "unique_experts": 58, + "load_cv": 0.9842110414320597, + "normalized_load_entropy": 0.9024638940339498, + "max_load_share": 0.09234234234234234 + }, + "full_input": { + "tokens": 115, + "top_k": 6, + "decisions": 690, + "ordered_route_sha256": "56c25cac9b8c9a94e20449fe5518f1930f7f674ded3c0ec718b90e339e235190", + "route_weight_sha256": "66d8afa805419a0b501af90dc613c579adf3471f60ed8e02a9d4e933d6dd31ad", + "loads": [ + 11, + 5, + 6, + 1, + 4, + 3, + 22, + 12, + 27, + 14, + 5, + 22, + 12, + 10, + 10, + 6, + 20, + 10, + 10, + 16, + 10, + 6, + 7, + 1, + 1, + 25, + 7, + 13, + 42, + 5, + 0, + 8, + 14, + 2, + 12, + 7, + 23, + 21, + 13, + 10, + 12, + 9, + 6, + 6, + 6, + 5, + 16, + 7, + 9, + 9, + 12, + 22, + 7, + 4, + 14, + 12, + 23, + 1, + 4, + 23, + 8, + 11, + 5, + 6 + ], + "weighted_loads": [ + 0.6468314453959465, + 0.14914913149550557, + 0.2985963076353073, + 0.03719868138432503, + 0.21642587333917618, + 0.18220125883817673, + 1.9179971180856228, + 0.8727701380848885, + 2.224944267421961, + 1.2749188505113125, + 0.5358706340193748, + 1.5696728359907866, + 1.169005572795868, + 0.5399011569097638, + 0.7498638145625591, + 0.4001678414642811, + 1.4954719170928001, + 0.6041989042423666, + 0.8349378146231174, + 1.102002238854766, + 0.5650038905441761, + 0.4299025535583496, + 1.8761545158922672, + 0.03529132902622223, + 0.03247901052236557, + 1.7422505281865597, + 0.276879383251071, + 0.9296462442725897, + 4.218853231519461, + 0.295721884816885, + 0.0, + 0.6713932007551193, + 1.165180655196309, + 0.07917563989758492, + 0.8588952347636223, + 0.6756585985422134, + 2.221847202628851, + 1.51452973857522, + 1.0865003522485495, + 0.5106323510408401, + 0.8849396742880344, + 0.6464628204703331, + 0.25586674734950066, + 0.21462945453822613, + 0.46086395904421806, + 0.12388207903131843, + 1.6362976655364037, + 0.6039384256582707, + 0.636327113956213, + 0.6088718250393867, + 0.7751607075333595, + 1.2710544504225254, + 0.4376584105193615, + 0.20986193045973778, + 0.8472379446029663, + 1.0873599275946617, + 2.559301368892193, + 0.04752276465296745, + 0.17628931626677513, + 1.9383013229817152, + 0.4143589325249195, + 1.1344688925892115, + 0.192894846200943, + 0.375265896320343 + ], + "unique_experts": 63, + "load_cv": 0.7110316853354249, + "normalized_load_entropy": 0.943008052909846, + "max_load_share": 0.06086956521739131 + } + }, + "s0_bos": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "fda29a8332f2af2f78424182f8be35ae608a1d7f4caab77ce7f25d42c8c31241", + "route_weight_sha256": "99bb7d5cdab4685a6fd3dfb1e5f8ffe34c637c0530d605d20715162fef575571", + "loads": [ + 11, + 4, + 3, + 0, + 3, + 3, + 8, + 11, + 22, + 7, + 6, + 11, + 8, + 8, + 1, + 5, + 10, + 11, + 8, + 6, + 8, + 2, + 6, + 0, + 0, + 24, + 6, + 12, + 38, + 2, + 0, + 5, + 7, + 1, + 8, + 0, + 22, + 4, + 11, + 1, + 11, + 3, + 4, + 6, + 5, + 1, + 2, + 6, + 6, + 10, + 5, + 16, + 6, + 0, + 11, + 1, + 7, + 2, + 4, + 11, + 3, + 11, + 5, + 5 + ], + "weighted_loads": [ + 0.6457665897905827, + 0.13913820125162601, + 0.15030675753951073, + 0.0, + 0.0987497940659523, + 0.19541946984827518, + 0.6008738055825233, + 0.8320994824171066, + 1.8784816190600395, + 0.5346262827515602, + 0.5927094183862209, + 0.8215985335409641, + 0.8350486308336258, + 0.5249787122011185, + 0.07367370277643204, + 0.29681209847331047, + 0.7257166430354118, + 0.7163466103374958, + 0.7042770273983479, + 0.3417980745434761, + 0.48492641001939774, + 0.20323880016803741, + 0.4542974252253771, + 0.0, + 0.0, + 1.7579262368381023, + 0.23939852230250835, + 0.9250832255929708, + 3.998613379895687, + 0.11394599825143814, + 0.0, + 0.476015068590641, + 0.927986778318882, + 0.02733376994729042, + 0.587786290794611, + 0.0, + 2.203557513654232, + 0.2655368000268936, + 1.0453419350087643, + 0.04128130152821541, + 0.8315184600651264, + 0.21114430576562881, + 0.23704159818589687, + 0.22391030937433243, + 0.38830604031682014, + 0.025042535737156868, + 0.08401158824563026, + 0.6203885972499847, + 0.476410124450922, + 0.6384894140064716, + 0.2508760243654251, + 1.0255626905709505, + 0.40665070340037346, + 0.0, + 0.7466435395181179, + 0.06091923266649246, + 0.7739890590310097, + 0.0793196726590395, + 0.1702309064567089, + 0.8173860684037209, + 0.1575872004032135, + 1.0985861010849476, + 0.20063822343945503, + 0.2936309427022934 + ], + "unique_experts": 58, + "load_cv": 0.9355065311194061, + "normalized_load_entropy": 0.9093988483500319, + "max_load_share": 0.08558558558558559 + }, + "full_input": { + "tokens": 99, + "top_k": 6, + "decisions": 594, + "ordered_route_sha256": "23912b30eae50b634cb24cf92e879ad859ca5acc30502eaa03d242798371a551", + "route_weight_sha256": "57ca6d7293adbc1a0c7a96741a2b31e0fac31208b7ed79ffdee59290ce9f25a1", + "loads": [ + 11, + 6, + 3, + 0, + 4, + 3, + 16, + 11, + 22, + 7, + 6, + 17, + 8, + 9, + 4, + 6, + 16, + 11, + 8, + 14, + 9, + 5, + 8, + 1, + 0, + 25, + 6, + 12, + 38, + 6, + 0, + 5, + 10, + 1, + 9, + 5, + 22, + 13, + 11, + 11, + 12, + 8, + 6, + 6, + 5, + 5, + 15, + 7, + 10, + 10, + 12, + 23, + 6, + 1, + 11, + 11, + 17, + 2, + 4, + 20, + 3, + 11, + 5, + 5 + ], + "weighted_loads": [ + 0.6457665897905827, + 0.20509538799524307, + 0.15030675753951073, + 0.0, + 0.12714211083948612, + 0.19541946984827518, + 1.5015216320753098, + 0.8320994824171066, + 1.8784816190600395, + 0.5346262827515602, + 0.5927094183862209, + 1.2454002052545547, + 0.8350486308336258, + 0.5480984896421432, + 0.27588237449526787, + 0.34486715123057365, + 1.1151513382792473, + 0.7163466103374958, + 0.7042770273983479, + 0.885755680501461, + 0.528656080365181, + 0.376698087900877, + 1.0275884624570608, + 0.03574313595890999, + 0.0, + 1.7854033540934324, + 0.23939852230250835, + 0.9250832255929708, + 3.998613379895687, + 0.3308982662856579, + 0.0, + 0.476015068590641, + 1.032427117228508, + 0.02733376994729042, + 0.6227332465350628, + 0.4598083160817623, + 2.203557513654232, + 0.9840900897979736, + 1.0453419350087643, + 0.436654195189476, + 0.8897988386452198, + 0.6089469231665134, + 0.2950689531862736, + 0.22391030937433243, + 0.38830604031682014, + 0.1552016194909811, + 1.6206729002296925, + 0.6395280491560698, + 0.6856888718903065, + 0.6384894140064716, + 0.7973831370472908, + 1.3309749122709036, + 0.40665070340037346, + 0.040932796895504, + 0.7466435395181179, + 0.8219778724014759, + 2.0632318556308746, + 0.0793196726590395, + 0.1702309064567089, + 1.7840458005666733, + 0.1575872004032135, + 1.0985861010849476, + 0.20063822343945503, + 0.2936309427022934 + ], + "unique_experts": 61, + "load_cv": 0.734585692035135, + "normalized_load_entropy": 0.938400360126115, + "max_load_share": 0.06397306397306397 + } + }, + "s1_bos": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "b63c8a072389117a2039db18e79722f1ff783e35998dbf382f475a0f84f29a05", + "route_weight_sha256": "5e8ebb871d98d68e20f4f971258582a4b173c8988f47bc0501819aa1625f0fe9", + "loads": [ + 11, + 3, + 3, + 0, + 2, + 3, + 9, + 11, + 22, + 7, + 6, + 12, + 9, + 7, + 1, + 5, + 10, + 10, + 8, + 6, + 8, + 3, + 6, + 1, + 1, + 25, + 5, + 10, + 40, + 2, + 0, + 5, + 8, + 2, + 8, + 0, + 22, + 3, + 11, + 1, + 11, + 3, + 4, + 6, + 5, + 1, + 1, + 6, + 5, + 10, + 5, + 17, + 6, + 0, + 10, + 1, + 6, + 1, + 4, + 11, + 3, + 11, + 6, + 5 + ], + "weighted_loads": [ + 0.6382988132536411, + 0.10601088777184486, + 0.1478610411286354, + 0.0, + 0.06902871653437614, + 0.20978867262601852, + 0.6640496477484703, + 0.8180437535047531, + 1.8749298006296158, + 0.5508178845047951, + 0.5639302022755146, + 0.8604716919362545, + 0.9026992693543434, + 0.45903830230236053, + 0.07114863395690918, + 0.2874966338276863, + 0.7268727794289589, + 0.6740510258823633, + 0.7072317376732826, + 0.35516107454895973, + 0.4826236814260483, + 0.22692909836769104, + 0.44675142876803875, + 0.025406377390027046, + 0.031193610280752182, + 1.7728710640221834, + 0.2124442160129547, + 0.8073836006224155, + 4.055036000907421, + 0.11400029808282852, + 0.0, + 0.491112656891346, + 0.9876000843942165, + 0.07152297161519527, + 0.5874782782047987, + 0.0, + 2.1962806805968285, + 0.2116832584142685, + 1.0271757207810879, + 0.03980114683508873, + 0.8874741904437542, + 0.21943171694874763, + 0.20292549580335617, + 0.2207978591322899, + 0.399187870323658, + 0.0278019979596138, + 0.040989018976688385, + 0.6386954821646214, + 0.433868944644928, + 0.6333984509110451, + 0.2435925118625164, + 1.0781298726797104, + 0.4066057614982128, + 0.0, + 0.7245493680238724, + 0.06351811438798904, + 0.7424716427922249, + 0.049514636397361755, + 0.1732599399983883, + 0.8055080510675907, + 0.14977693557739258, + 1.1615391355007887, + 0.22900979034602642, + 0.3018776811659336 + ], + "unique_experts": 60, + "load_cv": 0.9645531583213338, + "normalized_load_entropy": 0.908264001580187, + "max_load_share": 0.09009009009009009 + }, + "full_input": { + "tokens": 115, + "top_k": 6, + "decisions": 690, + "ordered_route_sha256": "cd8d7402a328c60d22b9609a96d0e01494d6850987feb2760e62732228801f60", + "route_weight_sha256": "50bf8a9b49e27bc1103e69dce02d1a906d7d8acf1a118d4c6993c563d782fad9", + "loads": [ + 11, + 4, + 6, + 1, + 4, + 3, + 24, + 12, + 27, + 13, + 6, + 22, + 13, + 8, + 10, + 7, + 21, + 10, + 10, + 16, + 10, + 7, + 7, + 2, + 2, + 26, + 5, + 11, + 41, + 5, + 0, + 8, + 15, + 3, + 12, + 7, + 23, + 20, + 11, + 10, + 12, + 10, + 6, + 6, + 6, + 3, + 17, + 8, + 8, + 10, + 14, + 23, + 7, + 4, + 10, + 12, + 23, + 1, + 4, + 23, + 8, + 11, + 6, + 5 + ], + "weighted_loads": [ + 0.6382988132536411, + 0.14095404744148254, + 0.2908075302839279, + 0.03719868138432503, + 0.21972109749913216, + 0.20978867262601852, + 2.0045220255851746, + 0.8798380568623543, + 2.2144233398139477, + 1.2550664767622948, + 0.5639302022755146, + 1.556948196142912, + 1.2313328310847282, + 0.4821580797433853, + 0.7667865864932537, + 0.45150650292634964, + 1.5432464890182018, + 0.6740510258823633, + 0.8538921028375626, + 1.1086924448609352, + 0.5739243514835835, + 0.4766807407140732, + 0.9921451341360807, + 0.060697706416249275, + 0.06367262080311775, + 1.8082896042615175, + 0.2124442160129547, + 0.8339190371334553, + 4.090829282999039, + 0.30929121747612953, + 0.0, + 0.69008769094944, + 1.221452547237277, + 0.1055567804723978, + 0.8451870735734701, + 0.6875381246209145, + 2.2307624705135822, + 1.5203969962894917, + 1.0271757207810879, + 0.5107178911566734, + 0.9482511356472969, + 0.6888151876628399, + 0.2609047833830118, + 0.2207978591322899, + 0.4833405166864395, + 0.09182414039969444, + 1.8314844742417336, + 0.7141176108270884, + 0.6144414842128754, + 0.6333984509110451, + 0.9109421968460083, + 1.318921059370041, + 0.44396796077489853, + 0.20860906317830086, + 0.7245493680238724, + 1.0836475268006325, + 2.642553586512804, + 0.049514636397361755, + 0.1732599399983883, + 1.9021562319248915, + 0.4138014316558838, + 1.1615391355007887, + 0.22900979034602642, + 0.3018776811659336 + ], + "unique_experts": 63, + "load_cv": 0.7132967618960575, + "normalized_load_entropy": 0.9434072429902985, + "max_load_share": 0.059420289855072465 + } + }, + "s0_x": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "7427291152e34d2ca21f3acaf3fa8c681a2392b443b175e80bded07ab59349d8", + "route_weight_sha256": "120857f90f6ed5fc3f1ad9bf9551578a9b68ab9fc865882ff8067a97ba78848d", + "loads": [ + 11, + 3, + 3, + 0, + 3, + 3, + 8, + 11, + 22, + 8, + 6, + 10, + 8, + 6, + 2, + 5, + 10, + 8, + 8, + 6, + 8, + 2, + 5, + 0, + 1, + 25, + 6, + 11, + 39, + 2, + 0, + 5, + 8, + 1, + 8, + 0, + 22, + 5, + 13, + 1, + 11, + 3, + 4, + 6, + 5, + 1, + 2, + 5, + 6, + 10, + 6, + 16, + 6, + 0, + 10, + 1, + 8, + 1, + 4, + 11, + 3, + 11, + 5, + 6 + ], + "weighted_loads": [ + 0.637218751013279, + 0.1114051379263401, + 0.1499720886349678, + 0.0, + 0.08972278982400894, + 0.1943153664469719, + 0.6164732202887535, + 0.8338062725961208, + 1.8687396198511124, + 0.5736494362354279, + 0.5645186118781567, + 0.7809830978512764, + 0.8265702724456787, + 0.41048654541373253, + 0.11527174711227417, + 0.289166159927845, + 0.7496941573917866, + 0.5949212089180946, + 0.7023661658167839, + 0.33775713481009007, + 0.4710633419454098, + 0.19800172746181488, + 0.42792219668626785, + 0.0, + 0.029907671734690666, + 1.80725534632802, + 0.24547497741878033, + 0.8717331793159246, + 4.051393091678619, + 0.11398609355092049, + 0.0, + 0.46982773393392563, + 0.9499901682138443, + 0.029583962634205818, + 0.5827025473117828, + 0.0, + 2.230198062956333, + 0.3163588158786297, + 1.1237927824258804, + 0.04056780785322189, + 0.8281105980277061, + 0.21178028732538223, + 0.21418497897684574, + 0.2205350212752819, + 0.364407479763031, + 0.025905121117830276, + 0.0962568111717701, + 0.5566262938082218, + 0.46977831050753593, + 0.6528561785817146, + 0.3123270869255066, + 1.0276028234511614, + 0.4045056775212288, + 0.0, + 0.7160830870270729, + 0.05879528075456619, + 0.8180120661854744, + 0.047245629131793976, + 0.16857151687145233, + 0.8012476302683353, + 0.14279029332101345, + 1.0719708073884249, + 0.20598409324884415, + 0.29281250573694706 + ], + "unique_experts": 59, + "load_cv": 0.9479172937785728, + "normalized_load_entropy": 0.9097554248592489, + "max_load_share": 0.08783783783783784 + }, + "full_input": { + "tokens": 99, + "top_k": 6, + "decisions": 594, + "ordered_route_sha256": "fcf02b4e55c8fc97755eb7f56f1fab45d23ec2c912ecba4eef334888d653c6b8", + "route_weight_sha256": "4fe64e4b993e0c7d162177ec9ca167cd19c07acb30c2cc4c1cd5b301858c7da7", + "loads": [ + 11, + 5, + 3, + 0, + 4, + 3, + 18, + 11, + 22, + 8, + 6, + 15, + 8, + 7, + 5, + 6, + 15, + 8, + 8, + 15, + 9, + 5, + 7, + 1, + 1, + 26, + 6, + 11, + 39, + 5, + 0, + 5, + 11, + 1, + 9, + 5, + 22, + 15, + 13, + 9, + 12, + 10, + 6, + 6, + 5, + 5, + 14, + 6, + 10, + 10, + 11, + 24, + 6, + 1, + 10, + 12, + 17, + 1, + 4, + 21, + 3, + 11, + 5, + 6 + ], + "weighted_loads": [ + 0.637218751013279, + 0.17736232466995716, + 0.1499720886349678, + 0.0, + 0.11811510659754276, + 0.1943153664469719, + 1.8070959076285362, + 0.8338062725961208, + 1.8687396198511124, + 0.5736494362354279, + 0.5645186118781567, + 1.1398464180529118, + 0.8265702724456787, + 0.4336063228547573, + 0.3082357235252857, + 0.3328721262514591, + 1.0919976085424423, + 0.5949212089180946, + 0.7023661658167839, + 0.9545580726116896, + 0.514793012291193, + 0.3756944499909878, + 1.0012132339179516, + 0.03574313595890999, + 0.029907671734690666, + 1.8347324635833502, + 0.24547497741878033, + 0.8717331793159246, + 4.051393091678619, + 0.28171300143003464, + 0.0, + 0.46982773393392563, + 1.0463306866586208, + 0.029583962634205818, + 0.6176495030522346, + 0.4815208278596401, + 2.230198062956333, + 1.0236513204872608, + 1.1237927824258804, + 0.35828667134046555, + 0.8873591646552086, + 0.748761385679245, + 0.27221233397722244, + 0.2205350212752819, + 0.364407479763031, + 0.1560642048716545, + 1.3807029128074646, + 0.5757657457143068, + 0.678085520863533, + 0.6528561785817146, + 0.7235550098121166, + 1.3680649604648352, + 0.4045056775212288, + 0.03980758786201477, + 0.7160830870270729, + 0.8756749555468559, + 1.9681947194039822, + 0.047245629131793976, + 0.16857151687145233, + 1.8426277823746204, + 0.14279029332101345, + 1.0719708073884249, + 0.20598409324884415, + 0.29281250573694706 + ], + "unique_experts": 62, + "load_cv": 0.7540809776321592, + "normalized_load_entropy": 0.9369090237717838, + "max_load_share": 0.06565656565656566 + } + }, + "s1_x": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "633e20cfdf77ead1b37f900dd12f60c181e7b841537c463f172f460737cc337d", + "route_weight_sha256": "f0fc1d9634ba104b16c5cafa2a8b015efb74c6587de94f1a92d2e29d898a0927", + "loads": [ + 11, + 3, + 3, + 0, + 2, + 3, + 10, + 11, + 22, + 7, + 6, + 12, + 9, + 6, + 2, + 5, + 10, + 9, + 8, + 7, + 8, + 2, + 5, + 0, + 2, + 27, + 5, + 10, + 40, + 2, + 0, + 5, + 9, + 2, + 8, + 0, + 22, + 3, + 11, + 1, + 11, + 3, + 4, + 6, + 5, + 1, + 2, + 5, + 5, + 10, + 6, + 16, + 5, + 0, + 9, + 1, + 6, + 1, + 4, + 12, + 3, + 11, + 5, + 5 + ], + "weighted_loads": [ + 0.6262241546064615, + 0.11025165393948555, + 0.14786488935351372, + 0.0, + 0.06644638627767563, + 0.22158348187804222, + 0.7492477595806122, + 0.8237109147012234, + 1.8447151500731707, + 0.5545315593481064, + 0.5466421861201525, + 0.8290762342512608, + 0.9014128930866718, + 0.4112842008471489, + 0.10742770694196224, + 0.2818066030740738, + 0.7421726360917091, + 0.6152377035468817, + 0.7120841667056084, + 0.3611995130777359, + 0.4788315035402775, + 0.19063683599233627, + 0.4168500602245331, + 0.0, + 0.06236543878912926, + 1.8450762555003166, + 0.21179616078734398, + 0.7930190190672874, + 4.061475571244955, + 0.11427975818514824, + 0.0, + 0.4956877529621124, + 1.008226688951254, + 0.07324862852692604, + 0.5828510764986277, + 0.0, + 2.2085079587996006, + 0.2179049663245678, + 1.03278136998415, + 0.03856080025434494, + 0.8950804993510246, + 0.21797304973006248, + 0.18779998272657394, + 0.21750429086387157, + 0.3773288279771805, + 0.027897683903574944, + 0.09474707394838333, + 0.5859482996165752, + 0.43920500203967094, + 0.6483338475227356, + 0.30554230883717537, + 1.0405187532305717, + 0.35332125425338745, + 0.0, + 0.6893499866127968, + 0.06480874866247177, + 0.704054594039917, + 0.0470203161239624, + 0.17463089153170586, + 0.8312560431659222, + 0.14636724442243576, + 1.153081577271223, + 0.19985682144761086, + 0.27785078063607216 + ], + "unique_experts": 59, + "load_cv": 0.9749312958214608, + "normalized_load_entropy": 0.9070821060465207, + "max_load_share": 0.09009009009009009 + }, + "full_input": { + "tokens": 115, + "top_k": 6, + "decisions": 690, + "ordered_route_sha256": "8b6cf94ece6dd940a17a2acb674e240506e42a24e4cb8826b84c70b21e1c813e", + "route_weight_sha256": "4f940822c17892f4c3883cee64c567c3301f77ac2184be86f233e65c2b06a796", + "loads": [ + 11, + 4, + 6, + 1, + 4, + 3, + 28, + 12, + 27, + 13, + 6, + 21, + 13, + 7, + 11, + 7, + 19, + 9, + 10, + 19, + 10, + 6, + 6, + 1, + 3, + 28, + 5, + 11, + 41, + 5, + 0, + 8, + 15, + 3, + 12, + 7, + 23, + 19, + 11, + 10, + 12, + 12, + 6, + 6, + 6, + 3, + 16, + 6, + 8, + 10, + 14, + 23, + 6, + 4, + 9, + 13, + 22, + 1, + 4, + 25, + 8, + 11, + 5, + 5 + ], + "weighted_loads": [ + 0.6262241546064615, + 0.14519481360912323, + 0.29081137850880623, + 0.03719868138432503, + 0.21713876724243164, + 0.22158348187804222, + 2.4416135400533676, + 0.8855052180588245, + 2.1842086892575026, + 1.258780151605606, + 0.5466421861201525, + 1.4604431726038456, + 1.2300464548170567, + 0.4344039782881737, + 0.8050749246031046, + 0.45992108434438705, + 1.4689212441444397, + 0.6152377035468817, + 0.8587445318698883, + 1.1977455280721188, + 0.5701321735978127, + 0.43625251203775406, + 0.9622437655925751, + 0.03529132902622223, + 0.09484444931149483, + 1.8804947957396507, + 0.21179616078734398, + 0.8195544555783272, + 4.097268853336573, + 0.3059738799929619, + 0.0, + 0.6946627870202065, + 1.2012468557804823, + 0.10728243738412857, + 0.8405598718672991, + 0.674522191286087, + 2.2429897487163544, + 1.3899091891944408, + 1.03278136998415, + 0.5094775445759296, + 0.9598386213183403, + 0.820252314209938, + 0.2457792703062296, + 0.21750429086387157, + 0.461481474339962, + 0.09191982634365559, + 1.6111981980502605, + 0.6050877515226603, + 0.6171075813472271, + 0.6483338475227356, + 0.8719406872987747, + 1.3107243906706572, + 0.39068345353007317, + 0.20717444270849228, + 0.6893499866127968, + 1.1555368825793266, + 2.409451063722372, + 0.0470203161239624, + 0.17463089153170586, + 2.0019066240638494, + 0.41039174050092697, + 1.153081577271223, + 0.19985682144761086, + 0.27785078063607216 + ], + "unique_experts": 63, + "load_cv": 0.7353812271566077, + "normalized_load_entropy": 0.9402400424513221, + "max_load_share": 0.059420289855072465 + } + }, + "s0_period": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "3316b1877978a8ab0062836179df446253aadc42cca90cb1ab45a48e5168e419", + "route_weight_sha256": "8ce2ffd40f4e93bc24c16adf692531518b1f6f74c837a0e1c4bac68a0e35c282", + "loads": [ + 11, + 3, + 3, + 0, + 3, + 3, + 8, + 11, + 22, + 8, + 6, + 11, + 7, + 6, + 2, + 5, + 10, + 9, + 8, + 7, + 8, + 2, + 5, + 0, + 1, + 24, + 6, + 10, + 38, + 2, + 0, + 5, + 8, + 1, + 8, + 0, + 22, + 5, + 12, + 1, + 12, + 3, + 4, + 6, + 5, + 1, + 2, + 5, + 6, + 10, + 8, + 16, + 6, + 0, + 10, + 1, + 8, + 1, + 4, + 11, + 3, + 11, + 5, + 5 + ], + "weighted_loads": [ + 0.6350964643061161, + 0.11007979139685631, + 0.14900833740830421, + 0.0, + 0.093303382396698, + 0.1965574212372303, + 0.6174934245646, + 0.8391350321471691, + 1.873454635962844, + 0.576198436319828, + 0.5649848841130733, + 0.8104236237704754, + 0.788639672100544, + 0.4140266627073288, + 0.11266463808715343, + 0.2882365956902504, + 0.7391969747841358, + 0.6329778451472521, + 0.6914668455719948, + 0.37888073921203613, + 0.4773951917886734, + 0.20211344957351685, + 0.42655352875590324, + 0.0, + 0.03165066987276077, + 1.733977984637022, + 0.2467927411198616, + 0.8280045762658119, + 3.995496530085802, + 0.1141928993165493, + 0.0, + 0.4682384133338928, + 0.9638609364628792, + 0.029022671282291412, + 0.5839899815618992, + 0.0, + 2.23326363414526, + 0.3551781624555588, + 1.085830096155405, + 0.04054415225982666, + 0.8657347224652767, + 0.20957528054714203, + 0.21720469556748867, + 0.21951558999717236, + 0.36757487803697586, + 0.026683155447244644, + 0.10390084236860275, + 0.5637142695486546, + 0.4640926867723465, + 0.640918668359518, + 0.39644039049744606, + 1.0267291758209467, + 0.40988370031118393, + 0.0, + 0.7059676460921764, + 0.05812213942408562, + 0.8359461389482021, + 0.04737154394388199, + 0.16937560960650444, + 0.8103873692452908, + 0.14205103926360607, + 1.0469315722584724, + 0.20312244817614555, + 0.25846654921770096 + ], + "unique_experts": 59, + "load_cv": 0.9313328590831108, + "normalized_load_entropy": 0.9112473544734099, + "max_load_share": 0.08558558558558559 + }, + "full_input": { + "tokens": 99, + "top_k": 6, + "decisions": 594, + "ordered_route_sha256": "47b8cae8c1fb1631bab1ad44aaae55f08b6b469530e84ca75f3cd631f2410c69", + "route_weight_sha256": "ff67a87de7e032b3a952f82f57cce0adc01e811ea819039a2ed3ceab0b337232", + "loads": [ + 11, + 5, + 3, + 0, + 4, + 3, + 18, + 11, + 22, + 8, + 6, + 16, + 8, + 7, + 4, + 6, + 15, + 9, + 8, + 17, + 9, + 5, + 7, + 1, + 1, + 25, + 6, + 10, + 39, + 5, + 0, + 5, + 11, + 1, + 9, + 5, + 22, + 15, + 12, + 9, + 13, + 9, + 6, + 6, + 5, + 5, + 14, + 6, + 10, + 10, + 13, + 24, + 6, + 1, + 10, + 12, + 17, + 1, + 4, + 20, + 3, + 11, + 5, + 5 + ], + "weighted_loads": [ + 0.6350964643061161, + 0.17603697814047337, + 0.14900833740830421, + 0.0, + 0.12169569917023182, + 0.1965574212372303, + 1.6860050670802593, + 0.8391350321471691, + 1.873454635962844, + 0.576198436319828, + 0.5649848841130733, + 1.1622170060873032, + 0.8409083001315594, + 0.4371464401483536, + 0.2650259044021368, + 0.32601727172732353, + 1.0759966783225536, + 0.6329778451472521, + 0.6914668455719948, + 1.0794632695615292, + 0.5211248621344566, + 0.3753917030990124, + 0.999844565987587, + 0.03574313595890999, + 0.03165066987276077, + 1.761455101892352, + 0.2467927411198616, + 0.8280045762658119, + 4.100751411169767, + 0.28497008234262466, + 0.0, + 0.4682384133338928, + 1.064851302653551, + 0.029022671282291412, + 0.618936937302351, + 0.47882330790162086, + 2.23326363414526, + 1.1529949083924294, + 1.085830096155405, + 0.3582630157470703, + 0.928275104612112, + 0.6642792001366615, + 0.27523205056786537, + 0.21951558999717236, + 0.36757487803697586, + 0.15684223920106888, + 1.393820185214281, + 0.5828537214547396, + 0.6698646433651447, + 0.640918668359518, + 0.8050446435809135, + 1.3662757705897093, + 0.40988370031118393, + 0.03975887596607208, + 0.7059676460921764, + 0.9689868316054344, + 1.9896821938455105, + 0.04737154394388199, + 0.16937560960650444, + 1.7770471014082432, + 0.14205103926360607, + 1.0469315722584724, + 0.20312244817614555, + 0.25846654921770096 + ], + "unique_experts": 62, + "load_cv": 0.7550425285511205, + "normalized_load_entropy": 0.9363725158389719, + "max_load_share": 0.06565656565656566 + } + }, + "s1_period": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "39ed008048940742eb7421c9a539f88f6b94e0e4c63f3ba3c089af15478b196c", + "route_weight_sha256": "ec2ca9f7db92015c1c8863391b6cc74ce9722e1860406e8f021728628d48a4d7", + "loads": [ + 11, + 3, + 3, + 0, + 2, + 3, + 9, + 11, + 22, + 8, + 6, + 11, + 9, + 7, + 2, + 5, + 10, + 10, + 8, + 7, + 8, + 2, + 5, + 1, + 2, + 27, + 5, + 10, + 40, + 2, + 0, + 5, + 8, + 2, + 8, + 0, + 22, + 3, + 11, + 1, + 11, + 2, + 4, + 6, + 5, + 1, + 2, + 5, + 5, + 10, + 6, + 16, + 6, + 0, + 9, + 1, + 6, + 1, + 4, + 12, + 2, + 11, + 5, + 5 + ], + "weighted_loads": [ + 0.640170743688941, + 0.10924337804317474, + 0.14677992835640907, + 0.0, + 0.06742630153894424, + 0.22047226876020432, + 0.6911752037703991, + 0.8255295231938362, + 1.8640508446842432, + 0.5812797658145428, + 0.5505958367139101, + 0.8049255050718784, + 0.8970390968024731, + 0.47458115965127945, + 0.10522515513002872, + 0.2799413800239563, + 0.7400446906685829, + 0.6596655398607254, + 0.7019927687942982, + 0.37024187482893467, + 0.4796968400478363, + 0.20100213587284088, + 0.4217916876077652, + 0.027907278388738632, + 0.06408890523016453, + 1.8515342641621828, + 0.21809057518839836, + 0.7774007059633732, + 4.002336783334613, + 0.11401265487074852, + 0.0, + 0.49290941655635834, + 0.9765635654330254, + 0.07223306596279144, + 0.581591609865427, + 0.0, + 2.2105311267077923, + 0.24684837460517883, + 1.030505657196045, + 0.03871000558137894, + 0.8858552202582359, + 0.15504993498325348, + 0.18652992323040962, + 0.21785476058721542, + 0.3794087618589401, + 0.028394155204296112, + 0.10145002603530884, + 0.5881516300141811, + 0.4423235133290291, + 0.6372495666146278, + 0.31219758838415146, + 1.0443179532885551, + 0.40684811770915985, + 0.0, + 0.6750504970550537, + 0.06450879573822021, + 0.706960391253233, + 0.04974834993481636, + 0.17359545081853867, + 0.8349853120744228, + 0.11780231818556786, + 1.1356848608702421, + 0.19668438658118248, + 0.2806028909981251 + ], + "unique_experts": 60, + "load_cv": 0.973264887807598, + "normalized_load_entropy": 0.908063540992237, + "max_load_share": 0.09009009009009009 + }, + "full_input": { + "tokens": 115, + "top_k": 6, + "decisions": 690, + "ordered_route_sha256": "d23a5d2236e2beeeeb12b3004c469a8e1ae1d63f5017203cb48dcd9bc0b04d4c", + "route_weight_sha256": "7859653ec97827172ed8cde9c57b28fc77dc8139cfaab7fc6bea24ddbe968065", + "loads": [ + 11, + 4, + 6, + 1, + 4, + 3, + 27, + 12, + 27, + 14, + 6, + 20, + 14, + 8, + 11, + 7, + 19, + 10, + 10, + 19, + 10, + 6, + 6, + 2, + 3, + 28, + 5, + 11, + 42, + 5, + 0, + 8, + 14, + 3, + 12, + 7, + 23, + 20, + 11, + 10, + 12, + 9, + 6, + 6, + 6, + 3, + 17, + 6, + 8, + 10, + 13, + 23, + 7, + 4, + 9, + 13, + 22, + 1, + 4, + 24, + 7, + 11, + 5, + 5 + ], + "weighted_loads": [ + 0.640170743688941, + 0.14418653771281242, + 0.2897264175117016, + 0.03719868138432503, + 0.21811868250370026, + 0.22047226876020432, + 2.2363705188035965, + 0.8873238265514374, + 2.203544383868575, + 1.2855283580720425, + 0.5505958367139101, + 1.4254421256482601, + 1.2909872643649578, + 0.49770093709230423, + 0.8025066461414099, + 0.44406091421842575, + 1.463761143386364, + 0.6596655398607254, + 0.8486531339585781, + 1.3045744877308607, + 0.5709975101053715, + 0.44449570775032043, + 0.9671853929758072, + 0.06319860741496086, + 0.0965679157525301, + 1.886952804401517, + 0.21809057518839836, + 0.8039361424744129, + 4.160655943676829, + 0.3065705746412277, + 0.0, + 0.6918844506144524, + 1.169523747637868, + 0.10626687481999397, + 0.8393004052340984, + 0.682434506714344, + 2.245012916624546, + 1.5701692998409271, + 1.030505657196045, + 0.5096267499029636, + 0.952419213950634, + 0.6244334056973457, + 0.24450921081006527, + 0.21785476058721542, + 0.46356140822172165, + 0.09241629764437675, + 1.6652827970683575, + 0.6072910819202662, + 0.5879297889769077, + 0.6372495666146278, + 0.8172881565988064, + 1.3179923444986343, + 0.44421031698584557, + 0.20622242987155914, + 0.6750504970550537, + 1.2129026651382446, + 2.397433999925852, + 0.04974834993481636, + 0.17359545081853867, + 1.9316334929317236, + 0.38182681426405907, + 1.1356848608702421, + 0.19668438658118248, + 0.2806028909981251 + ], + "unique_experts": 63, + "load_cv": 0.7335509787583294, + "normalized_load_entropy": 0.9411604709580801, + "max_load_share": 0.06086956521739131 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 74, + "ordered_topk_exact_tokens": 63, + "set_exact_tokens": 67, + "mean_set_jaccard": 0.972972972972973, + "mean_token_weighted_tv": 0.00881564152754239, + "aggregate_load_tv": 0.01576576576576576 + }, + "system_bos": { + "tokens": 74, + "ordered_topk_exact_tokens": 57, + "set_exact_tokens": 61, + "mean_set_jaccard": 0.9469111969111971, + "mean_token_weighted_tv": 0.017427917960024363, + "aggregate_load_tv": 0.02927927927927928 + }, + "system_x": { + "tokens": 74, + "ordered_topk_exact_tokens": 52, + "set_exact_tokens": 59, + "mean_set_jaccard": 0.9391891891891891, + "mean_token_weighted_tv": 0.019685089084747677, + "aggregate_load_tv": 0.031531531531531536 + }, + "system_period": { + "tokens": 74, + "ordered_topk_exact_tokens": 54, + "set_exact_tokens": 57, + "mean_set_jaccard": 0.9314671814671815, + "mean_token_weighted_tv": 0.022024703161740624, + "aggregate_load_tv": 0.03153153153153153 + }, + "bos_at_s0": { + "tokens": 74, + "ordered_topk_exact_tokens": 47, + "set_exact_tokens": 57, + "mean_set_jaccard": 0.9343629343629343, + "mean_token_weighted_tv": 0.020761564625678835, + "aggregate_load_tv": 0.02927927927927928 + }, + "bos_at_s1": { + "tokens": 74, + "ordered_topk_exact_tokens": 50, + "set_exact_tokens": 56, + "mean_set_jaccard": 0.9305019305019305, + "mean_token_weighted_tv": 0.02180486439249, + "aggregate_load_tv": 0.03828828828828829 + }, + "x_at_s0": { + "tokens": 74, + "ordered_topk_exact_tokens": 47, + "set_exact_tokens": 56, + "mean_set_jaccard": 0.9305019305019304, + "mean_token_weighted_tv": 0.021784928438530582, + "aggregate_load_tv": 0.02927927927927928 + }, + "x_at_s1": { + "tokens": 74, + "ordered_topk_exact_tokens": 46, + "set_exact_tokens": 52, + "mean_set_jaccard": 0.9121621621621622, + "mean_token_weighted_tv": 0.026703103646837378, + "aggregate_load_tv": 0.04504504504504504 + }, + "period_at_s0": { + "tokens": 74, + "ordered_topk_exact_tokens": 47, + "set_exact_tokens": 54, + "mean_set_jaccard": 0.9227799227799227, + "mean_token_weighted_tv": 0.023371485036772652, + "aggregate_load_tv": 0.038288288288288286 + }, + "period_at_s1": { + "tokens": 74, + "ordered_topk_exact_tokens": 46, + "set_exact_tokens": 52, + "mean_set_jaccard": 0.9121621621621622, + "mean_token_weighted_tv": 0.026560591848416103, + "aggregate_load_tv": 0.0427927927927928 + } + } + }, + "layer_07": { + "layer": 7, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "1fef9fa12138abdf323b39bd80de10c4fbc3301f7c3d33373b30dab779c468cb", + "route_weight_sha256": "5a10f6ee35cc87d1631d9180bcce14a05ac122e8c5108361d0ace26973a1f7bd", + "loads": [ + 8, + 2, + 12, + 0, + 2, + 9, + 2, + 8, + 4, + 4, + 1, + 3, + 3, + 10, + 21, + 10, + 3, + 9, + 4, + 1, + 3, + 9, + 36, + 1, + 8, + 7, + 4, + 9, + 7, + 5, + 6, + 12, + 2, + 7, + 4, + 2, + 12, + 0, + 7, + 4, + 11, + 2, + 10, + 4, + 0, + 15, + 6, + 4, + 6, + 7, + 2, + 15, + 9, + 4, + 2, + 12, + 7, + 0, + 6, + 3, + 25, + 26, + 0, + 7 + ], + "weighted_loads": [ + 0.5879726596176624, + 0.10838563181459904, + 0.6339484713971615, + 0.0, + 0.10417942330241203, + 0.5210116021335125, + 0.11437046155333519, + 0.5072523504495621, + 0.2198818288743496, + 0.1861477605998516, + 0.04273834079504013, + 0.11261902004480362, + 0.12420985847711563, + 0.457301652058959, + 1.7035011015832424, + 0.6645978260785341, + 0.15737197175621986, + 0.43570075184106827, + 0.21884825453162193, + 0.061104096472263336, + 0.11811551079154015, + 0.8118856549263, + 2.6978919729590416, + 0.08113446086645126, + 0.5728911645710468, + 0.49323510751128197, + 0.2181302271783352, + 0.9233581125736237, + 0.5755500644445419, + 0.2524835504591465, + 0.35561054572463036, + 0.5320131499320269, + 0.2736983597278595, + 0.5002979636192322, + 0.23739783465862274, + 0.09304563701152802, + 0.9862257316708565, + 0.0, + 0.40175551921129227, + 0.19567029923200607, + 0.7613976374268532, + 0.10314024984836578, + 0.847393985837698, + 0.21093358844518661, + 0.0, + 0.9216778110712767, + 0.4766816161572933, + 0.23036538437008858, + 0.4053690116852522, + 0.4766996428370476, + 0.09521293267607689, + 1.0841351933777332, + 0.9443800747394562, + 0.17732304334640503, + 0.0901988036930561, + 0.607108049094677, + 0.3148858081549406, + 0.0, + 0.5083832442760468, + 0.14156749472022057, + 1.7218302451074123, + 3.7660722136497498, + 0.0, + 0.5400427058339119 + ], + "unique_experts": 59, + "load_cv": 0.9427659978200129, + "normalized_load_entropy": 0.9096959979393179, + "max_load_share": 0.08108108108108109 + }, + "full_input": { + "tokens": 99, + "top_k": 6, + "decisions": 594, + "ordered_route_sha256": "a291270a9856fa74ed04202d268c3849d6424038d727839efbbcd8dbc1fd4022", + "route_weight_sha256": "a589ba15316f7cd84c7a1daf11449a373ad29a15f22ce817ed54ffe84ba1bbd1", + "loads": [ + 8, + 2, + 12, + 3, + 2, + 10, + 7, + 8, + 11, + 4, + 3, + 7, + 3, + 15, + 21, + 10, + 17, + 12, + 6, + 1, + 4, + 9, + 39, + 3, + 12, + 7, + 8, + 9, + 10, + 5, + 6, + 12, + 5, + 9, + 4, + 2, + 12, + 0, + 17, + 7, + 11, + 13, + 15, + 6, + 3, + 15, + 8, + 6, + 6, + 7, + 17, + 15, + 9, + 6, + 2, + 19, + 7, + 0, + 10, + 3, + 25, + 32, + 3, + 14 + ], + "weighted_loads": [ + 0.5879726596176624, + 0.10838563181459904, + 0.6339484713971615, + 0.10986161604523659, + 0.10417942330241203, + 0.5626697614789009, + 0.6107499487698078, + 0.5072523504495621, + 0.8410761877894402, + 0.1861477605998516, + 0.1136559508740902, + 0.6303091421723366, + 0.12420985847711563, + 0.7429539710283279, + 1.7035011015832424, + 0.6645978260785341, + 2.114211954176426, + 0.6138949543237686, + 0.2603273130953312, + 0.061104096472263336, + 0.1843733824789524, + 0.8118856549263, + 2.8717962838709354, + 0.22945350408554077, + 0.7037672330625355, + 0.49323510751128197, + 0.5251968167722225, + 0.9233581125736237, + 0.6387655939906836, + 0.2524835504591465, + 0.35561054572463036, + 0.5320131499320269, + 0.3887585885822773, + 0.6164253614842892, + 0.23739783465862274, + 0.09304563701152802, + 0.9862257316708565, + 0.0, + 1.2781652808189392, + 0.332086693495512, + 0.7613976374268532, + 1.104400709271431, + 1.2308112047612667, + 0.24287596717476845, + 1.4800550416111946, + 0.9216778110712767, + 0.56288618221879, + 0.36149952188134193, + 0.4053690116852522, + 0.4766996428370476, + 1.1540737431496382, + 1.0841351933777332, + 0.9443800747394562, + 0.2546406388282776, + 0.0901988036930561, + 1.264278493821621, + 0.3148858081549406, + 0.0, + 0.5933953216299415, + 0.14156749472022057, + 1.7218302451074123, + 4.063800673931837, + 0.04856447037309408, + 0.8079434856772423 + ], + "unique_experts": 62, + "load_cv": 0.7643542608563701, + "normalized_load_entropy": 0.9371985780695431, + "max_load_share": 0.06565656565656566 + } + }, + "s1_eos": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "8c37881088f52fddd144aacb37ef24400e44644ade09b5e2f27ed28d95a904fb", + "route_weight_sha256": "e4e4a8ccbc2ed37918c149a7106dd00e0bc16ebe06f3291a8b34d2b5b8cbaf06", + "loads": [ + 8, + 2, + 13, + 0, + 2, + 9, + 2, + 8, + 5, + 4, + 1, + 4, + 3, + 10, + 21, + 10, + 3, + 9, + 4, + 0, + 2, + 9, + 35, + 1, + 8, + 7, + 3, + 8, + 7, + 5, + 6, + 14, + 3, + 6, + 4, + 2, + 12, + 0, + 7, + 4, + 11, + 2, + 10, + 4, + 0, + 14, + 5, + 5, + 6, + 7, + 2, + 15, + 9, + 4, + 3, + 12, + 7, + 0, + 6, + 3, + 25, + 26, + 0, + 7 + ], + "weighted_loads": [ + 0.5799724534153938, + 0.1053358856588602, + 0.7039511613547802, + 0.0, + 0.09984948858618736, + 0.5146514922380447, + 0.11181693151593208, + 0.5213212110102177, + 0.2762528732419014, + 0.18097421154379845, + 0.041570745408535004, + 0.14034252613782883, + 0.12672283127903938, + 0.4525776170194149, + 1.7057061083614826, + 0.6586850583553314, + 0.15387610346078873, + 0.42756516858935356, + 0.22120901197195053, + 0.0, + 0.08033416420221329, + 0.8145651593804359, + 2.6341388635337353, + 0.07826944440603256, + 0.5745217651128769, + 0.4904097504913807, + 0.17822107300162315, + 0.8893031775951385, + 0.5730699151754379, + 0.2544952817261219, + 0.3574163652956486, + 0.58671342022717, + 0.302938848733902, + 0.46327008306980133, + 0.24091485887765884, + 0.0915769636631012, + 0.971876721829176, + 0.0, + 0.3925553746521473, + 0.19321896880865097, + 0.759044673293829, + 0.10224286839365959, + 0.8369539976119995, + 0.2112709805369377, + 0.0, + 0.9052049648016691, + 0.46464890614151955, + 0.26496097072958946, + 0.4057861566543579, + 0.45936577394604683, + 0.09436867386102676, + 1.0795083865523338, + 0.9353722967207432, + 0.1764659322798252, + 0.1099293939769268, + 0.6157244127243757, + 0.31361933797597885, + 0.0, + 0.4984882213175297, + 0.13909361138939857, + 1.7542786467820406, + 3.7656831108033657, + 0.0, + 0.5517260171473026 + ], + "unique_experts": 58, + "load_cv": 0.9355065311194061, + "normalized_load_entropy": 0.9093657426085177, + "max_load_share": 0.07882882882882883 + }, + "full_input": { + "tokens": 115, + "top_k": 6, + "decisions": 690, + "ordered_route_sha256": "873ed5767bf5ac533dc5e2560e0979d58accb82efa6c9644a218664ed97e4ac1", + "route_weight_sha256": "9cf77715a4e82efd0227e3cb3329a696e9118eed16b46510d2730af2b04e2e30", + "loads": [ + 8, + 2, + 13, + 2, + 3, + 10, + 9, + 8, + 20, + 6, + 9, + 9, + 3, + 15, + 23, + 11, + 18, + 14, + 6, + 0, + 3, + 9, + 37, + 4, + 13, + 7, + 11, + 9, + 10, + 11, + 6, + 14, + 9, + 15, + 4, + 2, + 12, + 4, + 24, + 8, + 13, + 18, + 20, + 7, + 9, + 14, + 7, + 11, + 6, + 7, + 23, + 15, + 9, + 5, + 7, + 21, + 7, + 6, + 9, + 3, + 25, + 32, + 4, + 11 + ], + "weighted_loads": [ + 0.5799724534153938, + 0.1053358856588602, + 0.7039511613547802, + 0.06265795789659023, + 0.14631998166441917, + 0.5589092895388603, + 0.6036582160741091, + 0.5213212110102177, + 1.6219610571861267, + 0.28306693583726883, + 0.6419292725622654, + 0.7331276945769787, + 0.12672283127903938, + 0.7627983260899782, + 1.7734724022448063, + 0.7125952616333961, + 2.5291217863559723, + 0.6929350681602955, + 0.2623055074363947, + 0.0, + 0.14440039545297623, + 0.8145651593804359, + 2.752505537122488, + 0.2582053653895855, + 0.7300610719248652, + 0.4904097504913807, + 0.8314890526235104, + 0.9199061151593924, + 0.636737396940589, + 1.027811098843813, + 0.3574163652956486, + 0.58671342022717, + 0.6859076917171478, + 1.0599481873214245, + 0.24091485887765884, + 0.0915769636631012, + 0.971876721829176, + 0.22658509016036987, + 2.1148371063172817, + 0.3752421271055937, + 0.9815461076796055, + 1.5768846310675144, + 1.6507513113319874, + 0.2830975307151675, + 2.0253518000245094, + 0.9052049648016691, + 0.569558147341013, + 0.5959185641258955, + 0.4057861566543579, + 0.45936577394604683, + 1.6013030000030994, + 1.0795083865523338, + 0.9353722967207432, + 0.2198922075331211, + 0.31689906492829323, + 1.386847484856844, + 0.31361933797597885, + 0.5413603968918324, + 0.5556304389610887, + 0.13909361138939857, + 1.7542786467820406, + 4.058012183755636, + 0.08387708710506558, + 0.6688978094607592 + ], + "unique_experts": 63, + "load_cv": 0.671357160446664, + "normalized_load_entropy": 0.9498058359514845, + "max_load_share": 0.0536231884057971 + } + }, + "s0_bos": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "e5460bcaf7e9178d0ac2896da92658bf36c5a413fb650d2b23c767b36c3ee32e", + "route_weight_sha256": "18ad8f1eb1e8525c0cf5b1b602a29a1cdc4e2840b10b204a07da23aab6336875", + "loads": [ + 9, + 2, + 11, + 1, + 2, + 8, + 3, + 7, + 4, + 4, + 1, + 2, + 3, + 9, + 22, + 10, + 3, + 8, + 4, + 1, + 3, + 9, + 35, + 2, + 9, + 7, + 4, + 8, + 7, + 5, + 5, + 15, + 2, + 7, + 5, + 2, + 12, + 0, + 7, + 5, + 11, + 1, + 10, + 4, + 0, + 14, + 5, + 7, + 7, + 7, + 2, + 15, + 9, + 3, + 2, + 11, + 7, + 0, + 5, + 3, + 24, + 27, + 0, + 7 + ], + "weighted_loads": [ + 0.6166321411728859, + 0.11253754794597626, + 0.5901299845427275, + 0.022725241258740425, + 0.10947586223483086, + 0.48421552777290344, + 0.16064869984984398, + 0.42484406381845474, + 0.2393183335661888, + 0.20274962112307549, + 0.04146696627140045, + 0.08933945372700691, + 0.12389678321778774, + 0.41493308544158936, + 1.7104501966387033, + 0.6901263073086739, + 0.17041585594415665, + 0.40036415681242943, + 0.2460046485066414, + 0.04518028348684311, + 0.11074214056134224, + 0.8055997416377068, + 2.584087761119008, + 0.12795352935791016, + 0.6183826513588428, + 0.5044232308864594, + 0.23036915436387062, + 0.8502955436706543, + 0.5747067406773567, + 0.2481553554534912, + 0.33611072786152363, + 0.6222143545746803, + 0.2562571167945862, + 0.5103713665157557, + 0.30444295331835747, + 0.09240104258060455, + 0.9940741658210754, + 0.0, + 0.42381541058421135, + 0.24792595952749252, + 0.75298260897398, + 0.061759524047374725, + 0.8628631457686424, + 0.22175338119268417, + 0.0, + 0.9119690731167793, + 0.45916255936026573, + 0.3606693893671036, + 0.42291450314223766, + 0.49520502984523773, + 0.09928404912352562, + 1.1131359785795212, + 0.8616874814033508, + 0.1459214836359024, + 0.09869898110628128, + 0.5714536551386118, + 0.3129497654736042, + 0.0, + 0.42370040714740753, + 0.1387484185397625, + 1.6412399299442768, + 3.786395153030753, + 0.0, + 0.5248782895505428 + ], + "unique_experts": 60, + "load_cv": 0.935159436577779, + "normalized_load_entropy": 0.9118579209135135, + "max_load_share": 0.07882882882882883 + }, + "full_input": { + "tokens": 99, + "top_k": 6, + "decisions": 594, + "ordered_route_sha256": "f8ebf0fc2f2e2e931da6e9a17f084c6cefa3ad56552d9bfff515905400996c63", + "route_weight_sha256": "f817044007393159d5413c3d472510f2e2a30b8542868eddbadf84322fd32d14", + "loads": [ + 9, + 2, + 11, + 4, + 2, + 9, + 9, + 7, + 11, + 4, + 2, + 6, + 3, + 14, + 22, + 10, + 17, + 12, + 7, + 1, + 4, + 9, + 38, + 4, + 12, + 7, + 9, + 8, + 9, + 5, + 5, + 15, + 5, + 9, + 5, + 2, + 12, + 0, + 17, + 8, + 11, + 12, + 15, + 5, + 4, + 14, + 7, + 9, + 7, + 7, + 17, + 15, + 9, + 6, + 2, + 18, + 7, + 0, + 8, + 3, + 24, + 33, + 2, + 14 + ], + "weighted_loads": [ + 0.6166321411728859, + 0.11253754794597626, + 0.5901299845427275, + 0.132586857303977, + 0.10947586223483086, + 0.5258736871182919, + 0.753996703773737, + 0.42484406381845474, + 0.8660729713737965, + 0.20274962112307549, + 0.07427624240517616, + 0.6273711211979389, + 0.12389678321778774, + 0.7005854044109583, + 1.7104501966387033, + 0.6901263073086739, + 2.13756450638175, + 0.6151424124836922, + 0.32943592220544815, + 0.04518028348684311, + 0.17475462332367897, + 0.8055997416377068, + 2.757992072030902, + 0.27691612392663956, + 0.7422098331153393, + 0.5044232308864594, + 0.5936329886317253, + 0.8502955436706543, + 0.6248870082199574, + 0.2481553554534912, + 0.33611072786152363, + 0.6222143545746803, + 0.371317345649004, + 0.6410314496606588, + 0.30444295331835747, + 0.09240104258060455, + 0.9940741658210754, + 0.0, + 1.356457695364952, + 0.38828857243061066, + 0.75298260897398, + 1.0647092163562775, + 1.2417581677436829, + 0.23937351442873478, + 0.6915514841675758, + 0.9119690731167793, + 0.5603631883859634, + 0.4949941709637642, + 0.42291450314223766, + 0.49520502984523773, + 1.2709602657705545, + 1.1131359785795212, + 0.8616874814033508, + 0.265478890389204, + 0.09869898110628128, + 1.2286240998655558, + 0.3129497654736042, + 0.0, + 0.4937598202377558, + 0.1387484185397625, + 1.6412399299442768, + 4.0841236133128405, + 0.0429775957018137, + 0.7927790693938732 + ], + "unique_experts": 62, + "load_cv": 0.7567223026551511, + "normalized_load_entropy": 0.9381801077830458, + "max_load_share": 0.06397306397306397 + } + }, + "s1_bos": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "eeadab296873357dae441b49d1d66dc039d2644211f70d53963a14a911a7f15c", + "route_weight_sha256": "11e0b25c44d79216637ca3c98a4e30fb75e61789d0a426ff62d68b93ac103394", + "loads": [ + 9, + 2, + 13, + 1, + 2, + 8, + 2, + 7, + 4, + 4, + 1, + 1, + 3, + 9, + 22, + 10, + 3, + 6, + 3, + 1, + 2, + 9, + 35, + 2, + 8, + 8, + 7, + 9, + 7, + 4, + 6, + 13, + 2, + 6, + 6, + 2, + 12, + 0, + 8, + 5, + 11, + 1, + 10, + 3, + 0, + 14, + 6, + 7, + 7, + 7, + 2, + 14, + 9, + 5, + 1, + 12, + 6, + 0, + 5, + 3, + 23, + 27, + 0, + 9 + ], + "weighted_loads": [ + 0.619706965982914, + 0.10807610303163528, + 0.6697235908359289, + 0.022951871156692505, + 0.10729742050170898, + 0.4752257987856865, + 0.10823790356516838, + 0.4319044556468725, + 0.2452361285686493, + 0.19574692100286484, + 0.042262930423021317, + 0.05564301088452339, + 0.12995360419154167, + 0.3936081640422344, + 1.744848508387804, + 0.7103927172720432, + 0.17920322716236115, + 0.3160838223993778, + 0.17114794068038464, + 0.045779332518577576, + 0.08371087536215782, + 0.8049866445362568, + 2.5266948267817497, + 0.1332995891571045, + 0.605380479246378, + 0.5351785607635975, + 0.3639763221144676, + 0.9004738293588161, + 0.5628524124622345, + 0.21176033467054367, + 0.37472435273230076, + 0.5434993505477905, + 0.26676929742097855, + 0.45909508690238, + 0.3285234309732914, + 0.09303481131792068, + 0.9693982657045126, + 0.0, + 0.4555388391017914, + 0.24074020236730576, + 0.744000181555748, + 0.05472951754927635, + 0.8747284971177578, + 0.17121273651719093, + 0.0, + 0.894856546074152, + 0.48270710185170174, + 0.36314189806580544, + 0.4238822143524885, + 0.46728507801890373, + 0.09517773613333702, + 1.0784041285514832, + 0.8635665997862816, + 0.22329647839069366, + 0.06061650067567825, + 0.6160730794072151, + 0.2826378755271435, + 0.0, + 0.4167692381888628, + 0.13765207678079605, + 1.5844843443483114, + 3.7818911746144295, + 0.0, + 0.6300367824733257 + ], + "unique_experts": 60, + "load_cv": 0.9334220278563673, + "normalized_load_entropy": 0.9101233896151979, + "max_load_share": 0.07882882882882883 + }, + "full_input": { + "tokens": 115, + "top_k": 6, + "decisions": 690, + "ordered_route_sha256": "a49a1c1482feaee8dc18f5b61a4051737e67d82af60747a685a31626d24ebfe5", + "route_weight_sha256": "c0a52f1ec55cf604b73c2c7b43963feb3e5a34d7507cbe5de458a285f0eac1fd", + "loads": [ + 9, + 2, + 13, + 3, + 3, + 9, + 10, + 7, + 19, + 6, + 8, + 6, + 3, + 14, + 24, + 11, + 18, + 11, + 6, + 1, + 3, + 9, + 37, + 6, + 12, + 8, + 16, + 10, + 9, + 10, + 6, + 13, + 8, + 15, + 6, + 2, + 12, + 4, + 25, + 9, + 13, + 17, + 20, + 5, + 10, + 14, + 9, + 13, + 7, + 7, + 23, + 14, + 9, + 6, + 5, + 21, + 6, + 6, + 7, + 3, + 23, + 33, + 3, + 13 + ], + "weighted_loads": [ + 0.619706965982914, + 0.10807610303163528, + 0.6697235908359289, + 0.08560982905328274, + 0.1537679135799408, + 0.5194835960865021, + 0.7190421689301729, + 0.4319044556468725, + 1.5962768271565437, + 0.2978396452963352, + 0.604996807873249, + 0.679066326469183, + 0.12995360419154167, + 0.7038288731127977, + 1.8126148022711277, + 0.764302920550108, + 2.5638742446899414, + 0.571987010538578, + 0.249202448874712, + 0.045779332518577576, + 0.15633868798613548, + 0.8049866445362568, + 2.6450615003705025, + 0.3637947253882885, + 0.7537471726536751, + 0.5351785607635975, + 1.0903736799955368, + 0.93107676692307, + 0.6127948053181171, + 0.9850761517882347, + 0.37472435273230076, + 0.5434993505477905, + 0.6497381404042244, + 1.063240434974432, + 0.3285234309732914, + 0.09303481131792068, + 0.9693982657045126, + 0.22658509016036987, + 2.229957640171051, + 0.4278466757386923, + 0.9665016159415245, + 1.5243531726300716, + 1.698536317795515, + 0.2290827352553606, + 1.2266964763402939, + 0.894856546074152, + 0.6362013146281242, + 0.7000485751777887, + 0.4238822143524885, + 0.46728507801890373, + 1.753376044332981, + 1.0784041285514832, + 0.8635665997862816, + 0.2634892091155052, + 0.2675861716270447, + 1.3871961515396833, + 0.2826378755271435, + 0.5413603968918324, + 0.45842573046684265, + 0.13765207678079605, + 1.5844843443483114, + 4.0742202475667, + 0.07835143618285656, + 0.7472085747867823 + ], + "unique_experts": 64, + "load_cv": 0.6705557639422584, + "normalized_load_entropy": 0.9511913999785642, + "max_load_share": 0.0536231884057971 + } + }, + "s0_x": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "72c635957a7efb2a546e271fb1b5c43bc61f34179b05a2b38c5b34bae5a27ddf", + "route_weight_sha256": "ca4bb588750ffce0f44476b144d4d3c1af086b90f0f05fcc4dbb1e4f7c1101c7", + "loads": [ + 9, + 2, + 10, + 1, + 2, + 8, + 3, + 7, + 3, + 4, + 1, + 2, + 3, + 9, + 21, + 9, + 3, + 9, + 3, + 4, + 3, + 9, + 33, + 2, + 8, + 7, + 6, + 9, + 7, + 5, + 5, + 13, + 2, + 7, + 4, + 2, + 11, + 0, + 7, + 5, + 11, + 1, + 10, + 3, + 0, + 15, + 5, + 8, + 7, + 7, + 2, + 16, + 9, + 4, + 2, + 12, + 7, + 0, + 5, + 3, + 24, + 27, + 1, + 7 + ], + "weighted_loads": [ + 0.616234079003334, + 0.11311941221356392, + 0.5646832678467035, + 0.02333025634288788, + 0.1144888736307621, + 0.49885891377925873, + 0.14617897383868694, + 0.41123810037970543, + 0.18962303921580315, + 0.19870564714074135, + 0.041596945375204086, + 0.09769494459033012, + 0.12276080995798111, + 0.4017197545617819, + 1.69492207467556, + 0.6448215804994106, + 0.15962038189172745, + 0.44092701375484467, + 0.1967119723558426, + 0.18063097447156906, + 0.11288193613290787, + 0.803585845977068, + 2.524226613342762, + 0.12491820007562637, + 0.5900749433785677, + 0.5059184171259403, + 0.34685160778462887, + 0.886483695358038, + 0.5681290477514267, + 0.23814314231276512, + 0.33351860009133816, + 0.5340985860675573, + 0.250437967479229, + 0.5069301873445511, + 0.23868361115455627, + 0.093315739184618, + 0.9790329039096832, + 0.0, + 0.4463959410786629, + 0.2460414208471775, + 0.7392855174839497, + 0.06850457936525345, + 0.8819750733673573, + 0.18082061409950256, + 0.0, + 0.9797671288251877, + 0.42679886147379875, + 0.41995229199528694, + 0.41059649735689163, + 0.5015569254755974, + 0.09965820610523224, + 1.1527862269431353, + 0.8372991159558296, + 0.17801550030708313, + 0.103273905813694, + 0.6056222133338451, + 0.31567181646823883, + 0.0, + 0.42522113770246506, + 0.13417818024754524, + 1.605625819414854, + 3.7343812342733145, + 0.02754931151866913, + 0.5353700444102287 + ], + "unique_experts": 61, + "load_cv": 0.9051700648827674, + "normalized_load_entropy": 0.9171004185082005, + "max_load_share": 0.07432432432432433 + }, + "full_input": { + "tokens": 99, + "top_k": 6, + "decisions": 594, + "ordered_route_sha256": "013bd62ea8b758378397208c254d518be1a2e78b974799d652840da7ccdd5bde", + "route_weight_sha256": "c51482dfca3ded249ad26e2cef4d83a4105735a9b60675f90a0630fea9cfbb97", + "loads": [ + 9, + 2, + 10, + 4, + 2, + 10, + 7, + 7, + 10, + 4, + 3, + 6, + 3, + 15, + 21, + 9, + 18, + 13, + 5, + 4, + 4, + 9, + 36, + 4, + 11, + 7, + 10, + 9, + 9, + 5, + 5, + 13, + 5, + 9, + 4, + 2, + 11, + 0, + 17, + 8, + 11, + 12, + 15, + 4, + 2, + 15, + 8, + 11, + 7, + 7, + 16, + 16, + 9, + 6, + 2, + 19, + 7, + 0, + 8, + 3, + 24, + 34, + 3, + 15 + ], + "weighted_loads": [ + 0.616234079003334, + 0.11311941221356392, + 0.5646832678467035, + 0.13319187238812447, + 0.1144888736307621, + 0.5965905897319317, + 0.5124251525849104, + 0.41123810037970543, + 0.7915235832333565, + 0.19870564714074135, + 0.1146424449980259, + 0.6398042030632496, + 0.12276080995798111, + 0.7210014164447784, + 1.69492207467556, + 0.6448215804994106, + 2.3924321606755257, + 0.6752535440027714, + 0.23819103091955185, + 0.18063097447156906, + 0.18116136640310287, + 0.803585845977068, + 2.698130924254656, + 0.2721387594938278, + 0.7139021251350641, + 0.5059184171259403, + 0.6675193849951029, + 0.886483695358038, + 0.6183093152940273, + 0.23814314231276512, + 0.33351860009133816, + 0.5340985860675573, + 0.3654981963336468, + 0.6456038989126682, + 0.23868361115455627, + 0.093315739184618, + 0.9790329039096832, + 0.0, + 1.2862347923219204, + 0.3877127096056938, + 0.7392855174839497, + 1.0041828528046608, + 1.2630331926047802, + 0.19844074733555317, + 0.6019263342022896, + 0.9797671288251877, + 0.5592687241733074, + 0.599687572568655, + 0.41059649735689163, + 0.5015569254755974, + 1.0777493100613356, + 1.1527862269431353, + 0.8372991159558296, + 0.24732939153909683, + 0.103273905813694, + 1.262792658060789, + 0.31567181646823883, + 0.0, + 0.4952805507928133, + 0.13417818024754524, + 1.605625819414854, + 4.08476141653955, + 0.07052690722048283, + 0.8816829696297646 + ], + "unique_experts": 62, + "load_cv": 0.7499806328675007, + "normalized_load_entropy": 0.939352479505669, + "max_load_share": 0.06060606060606061 + } + }, + "s1_x": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "d84f2fc9b4888469d6b2f6b9bab7712e1c7f26daf0c3f1ac2d7f78ce0f1cbb0f", + "route_weight_sha256": "f330f2b1b4eab63745e423cdfe87f9765a2bce574e72d2bdba6b451d7d7ef5d7", + "loads": [ + 9, + 2, + 12, + 0, + 2, + 8, + 2, + 7, + 4, + 5, + 0, + 1, + 3, + 8, + 22, + 10, + 3, + 8, + 4, + 5, + 3, + 9, + 35, + 2, + 8, + 8, + 7, + 9, + 7, + 4, + 6, + 11, + 2, + 7, + 4, + 2, + 11, + 0, + 7, + 4, + 11, + 0, + 10, + 4, + 0, + 15, + 6, + 7, + 6, + 7, + 2, + 16, + 10, + 3, + 1, + 13, + 6, + 0, + 4, + 4, + 22, + 27, + 1, + 8 + ], + "weighted_loads": [ + 0.6200448200106621, + 0.1083221435546875, + 0.6488897055387497, + 0.0, + 0.10862718150019646, + 0.48940087109804153, + 0.10403566434979439, + 0.43031713552773, + 0.2535485252737999, + 0.23909008875489235, + 0.0, + 0.0582362525165081, + 0.12859290465712547, + 0.35376983135938644, + 1.7603649236261845, + 0.6889465805143118, + 0.18008670583367348, + 0.42070208862423897, + 0.20625160075724125, + 0.24232150986790657, + 0.11627068370580673, + 0.7887445911765099, + 2.507193226367235, + 0.13704940676689148, + 0.6199797131121159, + 0.5491976402699947, + 0.4168860390782356, + 0.8993966430425644, + 0.5472135432064533, + 0.2037358507514, + 0.37669821828603745, + 0.4557452145963907, + 0.26122215390205383, + 0.4821224845945835, + 0.23926131799817085, + 0.095280010253191, + 0.9514448866248131, + 0.0, + 0.44958655908703804, + 0.19758522883057594, + 0.7258094772696495, + 0.0, + 0.8834945410490036, + 0.21844838187098503, + 0.0, + 0.9443200789391994, + 0.4796904232352972, + 0.360539086163044, + 0.3944881372153759, + 0.4686710648238659, + 0.10594332218170166, + 1.1793376468122005, + 0.8705033324658871, + 0.14358385279774666, + 0.058075614273548126, + 0.6420640237629414, + 0.281791266053915, + 0.0, + 0.38806895166635513, + 0.18834959715604782, + 1.4540927931666374, + 3.7212624438107014, + 0.03324272483587265, + 0.5724571123719215 + ], + "unique_experts": 58, + "load_cv": 0.9288895568267278, + "normalized_load_entropy": 0.9097690602676617, + "max_load_share": 0.07882882882882883 + }, + "full_input": { + "tokens": 115, + "top_k": 6, + "decisions": 690, + "ordered_route_sha256": "d4bb18fa88e67506eb34f76f226b5df4a167575afa1c4310f30a300633b12fb9", + "route_weight_sha256": "60b6031b9f2570513725c91bd7ee0cbac5a09c51df13d9817a25d6d126ccba4f", + "loads": [ + 9, + 2, + 12, + 2, + 3, + 10, + 8, + 7, + 19, + 7, + 8, + 6, + 3, + 14, + 24, + 11, + 19, + 13, + 6, + 5, + 4, + 9, + 37, + 6, + 13, + 8, + 15, + 10, + 9, + 10, + 6, + 11, + 8, + 16, + 4, + 2, + 11, + 4, + 23, + 8, + 13, + 15, + 20, + 6, + 8, + 15, + 10, + 14, + 6, + 7, + 22, + 16, + 10, + 4, + 5, + 22, + 6, + 6, + 6, + 4, + 22, + 34, + 4, + 13 + ], + "weighted_loads": [ + 0.6200448200106621, + 0.1083221435546875, + 0.6488897055387497, + 0.06265795789659023, + 0.15509767457842827, + 0.5880963951349258, + 0.48424831219017506, + 0.43031713552773, + 1.579791396856308, + 0.34118281304836273, + 0.6062497310340405, + 0.705620139837265, + 0.12859290465712547, + 0.6947324480861425, + 1.8281312175095081, + 0.7428567837923765, + 2.8285138607025146, + 0.690407820045948, + 0.2473480962216854, + 0.24232150986790657, + 0.18192104995250702, + 0.7887445911765099, + 2.625559899955988, + 0.3453172780573368, + 0.8004863634705544, + 0.5491976402699947, + 1.081077840179205, + 0.9299995806068182, + 0.597155936062336, + 0.977051667869091, + 0.37669821828603745, + 0.4557452145963907, + 0.6441909968852997, + 1.0942845232784748, + 0.23926131799817085, + 0.095280010253191, + 0.9514448866248131, + 0.22658509016036987, + 2.134099416434765, + 0.3838482517749071, + 0.948310911655426, + 1.3366813659667969, + 1.7066073641180992, + 0.2763183806091547, + 1.1509604826569557, + 0.9443200789391994, + 0.6656464766710997, + 0.7667844537645578, + 0.3944881372153759, + 0.4686710648238659, + 1.5218190215528011, + 1.1793376468122005, + 0.8705033324658871, + 0.18283271417021751, + 0.26504528522491455, + 1.4131870958954096, + 0.281791266053915, + 0.5413603968918324, + 0.429725443944335, + 0.18834959715604782, + 1.4540927931666374, + 4.068029563874006, + 0.11159416101872921, + 0.7595165129750967 + ], + "unique_experts": 64, + "load_cv": 0.6661308495773666, + "normalized_load_entropy": 0.9526690562191954, + "max_load_share": 0.0536231884057971 + } + }, + "s0_period": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "464a9936b71343c52b497a31a73d36a3214be26ce4671779a396ac094270e175", + "route_weight_sha256": "47c67b7a53067942885027dfdcd4c0eaed2ac685c0a91da6dfea09316fc21b10", + "loads": [ + 9, + 2, + 10, + 1, + 2, + 8, + 3, + 6, + 4, + 5, + 1, + 2, + 3, + 8, + 22, + 10, + 3, + 9, + 3, + 3, + 3, + 9, + 33, + 2, + 7, + 8, + 5, + 9, + 7, + 4, + 5, + 13, + 2, + 7, + 4, + 2, + 11, + 0, + 8, + 4, + 11, + 2, + 10, + 4, + 0, + 15, + 5, + 8, + 7, + 7, + 2, + 16, + 9, + 4, + 2, + 13, + 7, + 0, + 5, + 3, + 23, + 27, + 0, + 7 + ], + "weighted_loads": [ + 0.6204123385250568, + 0.11445355415344238, + 0.5602026637643576, + 0.02351936139166355, + 0.11074847355484962, + 0.4877520017325878, + 0.15088754706084728, + 0.37384648993611336, + 0.2586793005466461, + 0.22884358651936054, + 0.041269317269325256, + 0.09147574380040169, + 0.12171703390777111, + 0.3656161706894636, + 1.7259746715426445, + 0.6792942825704813, + 0.1536317989230156, + 0.43948791548609734, + 0.2034425176680088, + 0.13939826004207134, + 0.11318724974989891, + 0.8040718175470829, + 2.5066798478364944, + 0.12458452582359314, + 0.5666155647486448, + 0.5529139637947083, + 0.2928840070962906, + 0.8899097330868244, + 0.5682629272341728, + 0.1990910768508911, + 0.3344900868833065, + 0.531145628541708, + 0.25522327423095703, + 0.5091243591159582, + 0.23828395456075668, + 0.09397683292627335, + 0.9716164134442806, + 0.0, + 0.4964969865977764, + 0.20069032162427902, + 0.7407863847911358, + 0.12414633855223656, + 0.875590942800045, + 0.2192823328077793, + 0.0, + 0.9839352443814278, + 0.42828529328107834, + 0.42639124765992165, + 0.4094436913728714, + 0.4944092519581318, + 0.1081448495388031, + 1.1580344587564468, + 0.8236415795981884, + 0.1741504929959774, + 0.10462401062250137, + 0.6476967055350542, + 0.3181743361055851, + 0.0, + 0.4235513936728239, + 0.13225887343287468, + 1.5532902367413044, + 3.7763636931777, + 0.0, + 0.5351147577166557 + ], + "unique_experts": 60, + "load_cv": 0.9076772179503241, + "normalized_load_entropy": 0.9159515463074525, + "max_load_share": 0.07432432432432433 + }, + "full_input": { + "tokens": 99, + "top_k": 6, + "decisions": 594, + "ordered_route_sha256": "c38ee46d7633eec7682fa42aea200e3d25087bbdc64369e35deae82891fb1f34", + "route_weight_sha256": "65d83352433effc53b7613d5aaff10502e0210c6ae9f7f886b54f1f5bc73f26b", + "loads": [ + 9, + 2, + 10, + 4, + 2, + 9, + 7, + 6, + 12, + 5, + 3, + 6, + 3, + 13, + 22, + 10, + 18, + 12, + 5, + 3, + 4, + 9, + 37, + 4, + 10, + 8, + 10, + 9, + 9, + 4, + 5, + 13, + 5, + 9, + 4, + 2, + 11, + 0, + 19, + 7, + 11, + 14, + 15, + 5, + 2, + 15, + 6, + 11, + 7, + 7, + 18, + 16, + 9, + 6, + 2, + 20, + 7, + 0, + 8, + 3, + 23, + 33, + 2, + 14 + ], + "weighted_loads": [ + 0.6204123385250568, + 0.11445355415344238, + 0.5602026637643576, + 0.13338097743690014, + 0.11074847355484962, + 0.5294101610779762, + 0.5106688570231199, + 0.37384648993611336, + 0.9386932514607906, + 0.22884358651936054, + 0.11344432085752487, + 0.6422440595924854, + 0.12171703390777111, + 0.6512684896588326, + 1.7259746715426445, + 0.6792942825704813, + 2.375121772289276, + 0.6214567646384239, + 0.24492157623171806, + 0.13939826004207134, + 0.17844706401228905, + 0.8040718175470829, + 2.72477812692523, + 0.27071644365787506, + 0.6904427465051413, + 0.5529139637947083, + 0.648823194205761, + 0.8899097330868244, + 0.6184431947767735, + 0.1990910768508911, + 0.3344900868833065, + 0.531145628541708, + 0.37028350308537483, + 0.6474906746298075, + 0.23828395456075668, + 0.09397683292627335, + 0.9716164134442806, + 0.0, + 1.4504856877028942, + 0.3426496610045433, + 0.7407863847911358, + 1.1230981908738613, + 1.2522763535380363, + 0.23690246604382992, + 0.6019263342022896, + 0.9839352443814278, + 0.4837486632168293, + 0.6013120077550411, + 0.4094436913728714, + 0.4944092519581318, + 1.4218450244516134, + 1.1580344587564468, + 0.8236415795981884, + 0.2438315972685814, + 0.10462401062250137, + 1.3048671502619982, + 0.3181743361055851, + 0.0, + 0.49361080676317215, + 0.13225887343287468, + 1.5532902367413044, + 4.074092153459787, + 0.0429775957018137, + 0.8030155375599861 + ], + "unique_experts": 62, + "load_cv": 0.7622154965148277, + "normalized_load_entropy": 0.9372906191463881, + "max_load_share": 0.06228956228956229 + } + }, + "s1_period": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "66eaa7b9d33ac0266f3c71bf3623b1a35468a9c819ef632a9f78f2f56ebc3bd1", + "route_weight_sha256": "ba28593830a017b31a7cda7ee332a4f7e11e62c37542b880de786590c17c4dd3", + "loads": [ + 9, + 2, + 13, + 1, + 2, + 8, + 2, + 8, + 4, + 5, + 0, + 2, + 3, + 8, + 22, + 9, + 3, + 7, + 5, + 5, + 2, + 9, + 34, + 2, + 8, + 8, + 7, + 9, + 7, + 4, + 6, + 11, + 2, + 6, + 5, + 2, + 11, + 0, + 7, + 5, + 11, + 1, + 10, + 3, + 0, + 15, + 6, + 8, + 7, + 7, + 2, + 15, + 9, + 2, + 1, + 13, + 6, + 0, + 5, + 3, + 21, + 27, + 0, + 9 + ], + "weighted_loads": [ + 0.6184331104159355, + 0.10852035321295261, + 0.6740035507827997, + 0.023823875933885574, + 0.1108502745628357, + 0.4785889461636543, + 0.10897909849882126, + 0.4592416789382696, + 0.2618318535387516, + 0.23990218713879585, + 0.0, + 0.08415627479553223, + 0.12713180109858513, + 0.3493601568043232, + 1.7651314958930016, + 0.6609514504671097, + 0.1758858524262905, + 0.35696805641055107, + 0.24036401137709618, + 0.23661698400974274, + 0.08304141461849213, + 0.7826865836977959, + 2.4355562310665846, + 0.1378665529191494, + 0.6181057263165712, + 0.5515614934265614, + 0.4121195003390312, + 0.8960284516215324, + 0.5534981489181519, + 0.20324061810970306, + 0.3772067129611969, + 0.4647630825638771, + 0.26478327065706253, + 0.45518919080495834, + 0.2746068984270096, + 0.09553766250610352, + 0.939963798969984, + 0.0, + 0.4582623392343521, + 0.23960590735077858, + 0.7222739011049271, + 0.058741550892591476, + 0.8914087936282158, + 0.17396122589707375, + 0.0, + 0.9280036985874176, + 0.4936209227889776, + 0.4115833044052124, + 0.41405846178531647, + 0.4744560718536377, + 0.1103026382625103, + 1.1305187530815601, + 0.844949021935463, + 0.10066420957446098, + 0.06179436296224594, + 0.6462353430688381, + 0.280389916151762, + 0.0, + 0.4208511020988226, + 0.1311107911169529, + 1.3896080572158098, + 3.736838858574629, + 0.0, + 0.6251512616872787 + ], + "unique_experts": 59, + "load_cv": 0.9098207074284534, + "normalized_load_entropy": 0.913070104890928, + "max_load_share": 0.07657657657657657 + }, + "full_input": { + "tokens": 115, + "top_k": 6, + "decisions": 690, + "ordered_route_sha256": "9b51a4f70c3c2b9e8219420089a0fc4b3b1f677dd3a29d4adc3cc7d35e3e8b65", + "route_weight_sha256": "459dc84de684d90a929a8f33e688194c64253c7ea7d444925d29135ff03627f8", + "loads": [ + 9, + 2, + 13, + 3, + 3, + 9, + 9, + 8, + 20, + 7, + 8, + 7, + 3, + 13, + 24, + 10, + 19, + 12, + 7, + 5, + 3, + 9, + 37, + 5, + 12, + 8, + 15, + 10, + 9, + 10, + 6, + 11, + 9, + 15, + 5, + 2, + 11, + 4, + 25, + 9, + 13, + 17, + 20, + 5, + 9, + 15, + 8, + 14, + 7, + 7, + 24, + 15, + 9, + 2, + 5, + 22, + 6, + 6, + 7, + 3, + 21, + 33, + 3, + 13 + ], + "weighted_loads": [ + 0.6184331104159355, + 0.10852035321295261, + 0.6740035507827997, + 0.08648183383047581, + 0.1573207676410675, + 0.5228467434644699, + 0.5184065345674753, + 0.4592416789382696, + 1.6482116021215916, + 0.34199491143226624, + 0.6075474955141544, + 0.6837264411151409, + 0.12713180109858513, + 0.6595808658748865, + 1.8328977897763252, + 0.7148616537451744, + 2.7602920532226562, + 0.6133629977703094, + 0.28146050684154034, + 0.23661698400974274, + 0.14358896762132645, + 0.7826865836977959, + 2.5860638674348593, + 0.31059730052948, + 0.7664724197238684, + 0.5515614934265614, + 1.0750587284564972, + 0.9266313891857862, + 0.6034405417740345, + 0.9765564352273941, + 0.3772067129611969, + 0.4647630825638771, + 0.6804523020982742, + 1.064614176750183, + 0.2746068984270096, + 0.09553766250610352, + 0.939963798969984, + 0.22658509016036987, + 2.2494721859693527, + 0.42679631523787975, + 0.9447753354907036, + 1.4740203656256199, + 1.7086281068623066, + 0.23183122463524342, + 1.1893218792974949, + 0.9280036985874176, + 0.598530163988471, + 0.7516547199338675, + 0.41405846178531647, + 0.4744560718536377, + 1.9751927852630615, + 1.1305187530815601, + 0.844949021935463, + 0.10066420957446098, + 0.26876403391361237, + 1.4173584152013063, + 0.280389916151762, + 0.5413603968918324, + 0.46250759437680244, + 0.1311107911169529, + 1.3896080572158098, + 4.029167931526899, + 0.07835143618285656, + 0.7423230540007353 + ], + "unique_experts": 64, + "load_cv": 0.6727573072475292, + "normalized_load_entropy": 0.9513233590238127, + "max_load_share": 0.0536231884057971 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 74, + "ordered_topk_exact_tokens": 53, + "set_exact_tokens": 63, + "mean_set_jaccard": 0.9575289575289576, + "mean_token_weighted_tv": 0.010918231529963983, + "aggregate_load_tv": 0.018018018018018018 + }, + "system_bos": { + "tokens": 74, + "ordered_topk_exact_tokens": 42, + "set_exact_tokens": 54, + "mean_set_jaccard": 0.9198841698841699, + "mean_token_weighted_tv": 0.019538857193814742, + "aggregate_load_tv": 0.03603603603603604 + }, + "system_x": { + "tokens": 74, + "ordered_topk_exact_tokens": 39, + "set_exact_tokens": 49, + "mean_set_jaccard": 0.9034749034749036, + "mean_token_weighted_tv": 0.024190649692271207, + "aggregate_load_tv": 0.042792792792792786 + }, + "system_period": { + "tokens": 74, + "ordered_topk_exact_tokens": 40, + "set_exact_tokens": 50, + "mean_set_jaccard": 0.9015444015444016, + "mean_token_weighted_tv": 0.025184704922139645, + "aggregate_load_tv": 0.042792792792792786 + }, + "bos_at_s0": { + "tokens": 74, + "ordered_topk_exact_tokens": 38, + "set_exact_tokens": 50, + "mean_set_jaccard": 0.9044401544401545, + "mean_token_weighted_tv": 0.0247032415700724, + "aggregate_load_tv": 0.03603603603603604 + }, + "bos_at_s1": { + "tokens": 74, + "ordered_topk_exact_tokens": 29, + "set_exact_tokens": 44, + "mean_set_jaccard": 0.8732303732303732, + "mean_token_weighted_tv": 0.0287542658908343, + "aggregate_load_tv": 0.05180180180180181 + }, + "x_at_s0": { + "tokens": 74, + "ordered_topk_exact_tokens": 35, + "set_exact_tokens": 47, + "mean_set_jaccard": 0.887065637065637, + "mean_token_weighted_tv": 0.02847398950944881, + "aggregate_load_tv": 0.04279279279279279 + }, + "x_at_s1": { + "tokens": 74, + "ordered_topk_exact_tokens": 26, + "set_exact_tokens": 41, + "mean_set_jaccard": 0.8529601029601029, + "mean_token_weighted_tv": 0.03649159666855593, + "aggregate_load_tv": 0.06306306306306306 + }, + "period_at_s0": { + "tokens": 74, + "ordered_topk_exact_tokens": 39, + "set_exact_tokens": 48, + "mean_set_jaccard": 0.890926640926641, + "mean_token_weighted_tv": 0.028541458833559945, + "aggregate_load_tv": 0.04504504504504505 + }, + "period_at_s1": { + "tokens": 74, + "ordered_topk_exact_tokens": 25, + "set_exact_tokens": 41, + "mean_set_jaccard": 0.8552123552123553, + "mean_token_weighted_tv": 0.03595278282473619, + "aggregate_load_tv": 0.06531531531531531 + } + } + }, + "layer_08": { + "layer": 8, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "86fb9e5245a1b831a8bbf8304bf23d47c8648696023461a6291b2624d4625d2d", + "route_weight_sha256": "2bc98e0709aa3fe4c4a46c5a2c764223f84b1d3652263efbefc021643210fcad", + "loads": [ + 2, + 37, + 2, + 11, + 0, + 9, + 5, + 36, + 0, + 6, + 11, + 6, + 8, + 5, + 0, + 0, + 0, + 11, + 1, + 7, + 12, + 5, + 17, + 0, + 15, + 3, + 2, + 9, + 9, + 7, + 7, + 21, + 10, + 3, + 2, + 2, + 5, + 18, + 1, + 7, + 0, + 8, + 8, + 9, + 14, + 9, + 2, + 10, + 9, + 9, + 1, + 15, + 3, + 5, + 5, + 6, + 1, + 2, + 0, + 4, + 7, + 0, + 5, + 0 + ], + "weighted_loads": [ + 0.05915909633040428, + 2.555409539490938, + 0.07886416837573051, + 0.8740172684192657, + 0.0, + 0.4757070578634739, + 0.34866174310445786, + 2.9686616584658623, + 0.0, + 0.2524036802351475, + 0.8764353282749653, + 0.40563493594527245, + 0.7437996566295624, + 0.37615741416811943, + 0.0, + 0.0, + 0.0, + 0.7982700411230326, + 0.0509454719722271, + 0.3430858198553324, + 1.0073723420500755, + 0.27273669466376305, + 1.2492571100592613, + 0.0, + 0.9328376688063145, + 0.14546474814414978, + 0.14448635280132294, + 0.5503788441419601, + 0.5328297354280949, + 0.34338338300585747, + 0.5574724674224854, + 1.996537771075964, + 0.7042472250759602, + 0.12969523668289185, + 0.23741424828767776, + 0.06851236149668694, + 0.21974514052271843, + 0.8922760505229235, + 0.05549704283475876, + 0.6927679628133774, + 0.0, + 0.3260426428169012, + 0.5363469906151295, + 0.6086766272783279, + 0.8411734383553267, + 0.5731242187321186, + 0.06811803951859474, + 0.6111005358397961, + 0.44082523323595524, + 0.5986030027270317, + 0.04135208949446678, + 1.469598475843668, + 0.11873620003461838, + 0.24997005239129066, + 0.2665054351091385, + 0.3088131658732891, + 0.03610866516828537, + 0.13887830078601837, + 0.0, + 0.1995798796415329, + 0.37455664947628975, + 0.0, + 0.2821652442216873, + 0.0 + ], + "unique_experts": 54, + "load_cv": 1.043451721066624, + "normalized_load_entropy": 0.8862297956350513, + "max_load_share": 0.08333333333333333 + }, + "full_input": { + "tokens": 99, + "top_k": 6, + "decisions": 594, + "ordered_route_sha256": "63f8964b46de743e4e02ca8005f72a53e89f8b06596683d3af6f927a74401e45", + "route_weight_sha256": "e3f25b45d17cec9b83e8bc913bbc48f3ac77d0ea984e339ec6377b546401bf08", + "loads": [ + 2, + 43, + 4, + 12, + 3, + 9, + 10, + 37, + 8, + 6, + 12, + 8, + 15, + 11, + 0, + 0, + 0, + 14, + 1, + 7, + 12, + 5, + 19, + 0, + 15, + 14, + 2, + 9, + 9, + 7, + 10, + 21, + 14, + 17, + 2, + 2, + 5, + 18, + 1, + 14, + 7, + 8, + 8, + 9, + 14, + 15, + 9, + 14, + 10, + 12, + 4, + 15, + 15, + 5, + 9, + 14, + 1, + 2, + 4, + 4, + 7, + 0, + 7, + 3 + ], + "weighted_loads": [ + 0.05915909633040428, + 2.9239803720265627, + 0.11788582149893045, + 0.9337424002587795, + 0.10411550849676132, + 0.4757070578634739, + 0.7646009176969528, + 3.0138443410396576, + 0.5523374006152153, + 0.2524036802351475, + 0.9461496956646442, + 0.4703974016010761, + 1.1258774064481258, + 0.8045161962509155, + 0.0, + 0.0, + 0.0, + 0.9788263384252787, + 0.0509454719722271, + 0.3430858198553324, + 1.0073723420500755, + 0.27273669466376305, + 1.3219313435256481, + 0.0, + 0.9328376688063145, + 0.9122094213962555, + 0.14448635280132294, + 0.5503788441419601, + 0.5328297354280949, + 0.34338338300585747, + 0.6357021098956466, + 1.996537771075964, + 0.8747172094881535, + 1.2723484970629215, + 0.23741424828767776, + 0.06851236149668694, + 0.21974514052271843, + 0.8922760505229235, + 0.05549704283475876, + 0.9158589248545468, + 0.3760008104145527, + 0.3260426428169012, + 0.5363469906151295, + 0.6086766272783279, + 0.8411734383553267, + 1.101003635674715, + 0.9056929387152195, + 0.7339858328923583, + 0.48064555786550045, + 0.7461404465138912, + 0.21256369724869728, + 1.469598475843668, + 0.8135278839617968, + 0.24997005239129066, + 1.8457681834697723, + 0.7709856033325195, + 0.03610866516828537, + 0.13887830078601837, + 0.11597549286670983, + 0.1995798796415329, + 0.37455664947628975, + 0.0, + 0.3703746162354946, + 0.20727672800421715 + ], + "unique_experts": 59, + "load_cv": 0.8320723037134122, + "normalized_load_entropy": 0.9221443266873731, + "max_load_share": 0.0723905723905724 + } + }, + "s1_eos": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "1a252068153ef4ace6ccc9c622594ae96b2391336e3f04963518e3c76fe13b71", + "route_weight_sha256": "63a550d5e31a3a2e3e46297ecdffdce2c2eb6c3926de223225c8052378a6c5f3", + "loads": [ + 1, + 37, + 2, + 11, + 0, + 9, + 5, + 36, + 0, + 6, + 11, + 6, + 9, + 5, + 0, + 0, + 0, + 11, + 1, + 7, + 13, + 5, + 17, + 0, + 14, + 3, + 2, + 9, + 9, + 6, + 7, + 21, + 10, + 2, + 2, + 2, + 7, + 18, + 1, + 7, + 0, + 8, + 9, + 9, + 13, + 9, + 0, + 11, + 9, + 8, + 1, + 16, + 3, + 5, + 5, + 6, + 1, + 3, + 0, + 4, + 7, + 0, + 5, + 0 + ], + "weighted_loads": [ + 0.03584253042936325, + 2.508665133267641, + 0.0809859111905098, + 0.8806844912469387, + 0.0, + 0.47573210671544075, + 0.34806810691952705, + 2.9656425304710865, + 0.0, + 0.25248344242572784, + 0.8886618763208389, + 0.4023275040090084, + 0.7779383771121502, + 0.37467801943421364, + 0.0, + 0.0, + 0.0, + 0.7774167750030756, + 0.05033911392092705, + 0.34297915175557137, + 1.0606541819870472, + 0.2790612392127514, + 1.227246105670929, + 0.0, + 0.9004745669662952, + 0.1531156226992607, + 0.1445421651005745, + 0.5419538989663124, + 0.5584596432745457, + 0.30204806849360466, + 0.5624396316707134, + 2.0164948888123035, + 0.6959992721676826, + 0.0869385190308094, + 0.24211648106575012, + 0.0668090172111988, + 0.27516450732946396, + 0.8869742341339588, + 0.054255757480859756, + 0.6908005028963089, + 0.0, + 0.32086240872740746, + 0.5769330076873302, + 0.6110870242118835, + 0.803824882954359, + 0.5574854724109173, + 0.0, + 0.6659103482961655, + 0.43682408332824707, + 0.5732124261558056, + 0.04057350009679794, + 1.4903769418597221, + 0.11752426624298096, + 0.2505757734179497, + 0.27153295651078224, + 0.31343940645456314, + 0.036101922392845154, + 0.1824268251657486, + 0.0, + 0.1983410269021988, + 0.37884949520230293, + 0.0, + 0.2781844884157181, + 0.0 + ], + "unique_experts": 53, + "load_cv": 1.04996511898034, + "normalized_load_entropy": 0.8827579145563103, + "max_load_share": 0.08333333333333333 + }, + "full_input": { + "tokens": 115, + "top_k": 6, + "decisions": 690, + "ordered_route_sha256": "0484f52bd9ef1cdd2773da8ddfa823ca54596c07bdb6314104f1956baa677837", + "route_weight_sha256": "51db7536c52e133c2e4a020214e54d2fae9a67f33347000c172dd131baf1f38e", + "loads": [ + 2, + 42, + 12, + 13, + 1, + 10, + 16, + 37, + 13, + 6, + 14, + 10, + 18, + 11, + 0, + 0, + 0, + 25, + 2, + 7, + 13, + 5, + 18, + 4, + 14, + 14, + 2, + 11, + 10, + 6, + 10, + 21, + 13, + 22, + 2, + 2, + 7, + 18, + 7, + 13, + 13, + 8, + 11, + 9, + 13, + 21, + 15, + 15, + 13, + 13, + 5, + 16, + 13, + 11, + 9, + 17, + 1, + 3, + 3, + 6, + 7, + 4, + 8, + 5 + ], + "weighted_loads": [ + 0.07507564499974251, + 2.789738355204463, + 0.701349119655788, + 0.9958193674683571, + 0.041328154504299164, + 0.5202657990157604, + 1.2845729179680347, + 3.000759072601795, + 0.8493147045373917, + 0.25248344242572784, + 1.0486872494220734, + 0.5215958177577704, + 1.30887570977211, + 0.7820407152175903, + 0.0, + 0.0, + 0.0, + 1.7968572359532118, + 0.09748854115605354, + 0.34297915175557137, + 1.0606541819870472, + 0.2790612392127514, + 1.2668814733624458, + 0.1872032769024372, + 0.9004745669662952, + 1.2646373584866524, + 0.1445421651005745, + 0.6610369868576527, + 0.6001086570322514, + 0.30204806849360466, + 0.6401493293233216, + 2.0164948888123035, + 0.8062835671007633, + 1.5385345481336117, + 0.24211648106575012, + 0.0668090172111988, + 0.27516450732946396, + 0.8869742341339588, + 0.4525582641363144, + 0.8643892980180681, + 0.598857581615448, + 0.32086240872740746, + 0.7455655187368393, + 0.6110870242118835, + 0.803824882954359, + 1.652102280408144, + 1.193988163024187, + 0.7829031469300389, + 0.7887375466525555, + 0.8961515538394451, + 0.26078004762530327, + 1.4903769418597221, + 0.6674112658947706, + 0.9271053001284599, + 1.855034925043583, + 1.01607146859169, + 0.036101922392845154, + 0.1824268251657486, + 0.10141646303236485, + 0.2709234170615673, + 0.37884949520230293, + 0.18679136410355568, + 0.41808152943849564, + 0.29391101747751236 + ], + "unique_experts": 61, + "load_cv": 0.7291396385304879, + "normalized_load_entropy": 0.9371072564281647, + "max_load_share": 0.06086956521739131 + } + }, + "s0_bos": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "a22139359a664d888f61d58e03a757b7cb7665016c7f858113e6951d417d8f2f", + "route_weight_sha256": "7b619564cf7d81396ee151b470e3bd6362152f610066285d932af47a0c5080d0", + "loads": [ + 1, + 37, + 2, + 11, + 0, + 7, + 5, + 37, + 0, + 4, + 11, + 7, + 8, + 5, + 0, + 0, + 0, + 12, + 1, + 10, + 12, + 5, + 18, + 0, + 14, + 2, + 2, + 9, + 11, + 6, + 7, + 21, + 10, + 3, + 2, + 2, + 6, + 18, + 1, + 7, + 0, + 8, + 9, + 10, + 12, + 8, + 1, + 10, + 7, + 8, + 1, + 15, + 2, + 5, + 5, + 5, + 0, + 5, + 0, + 5, + 7, + 1, + 5, + 1 + ], + "weighted_loads": [ + 0.035740599036216736, + 2.542797800153494, + 0.07194213569164276, + 0.8616872578859329, + 0.0, + 0.4059874154627323, + 0.3382660821080208, + 3.0253960862755775, + 0.0, + 0.18280695751309395, + 0.8800166137516499, + 0.46522383764386177, + 0.7298463620245457, + 0.37398163601756096, + 0.0, + 0.0, + 0.0, + 0.8591692596673965, + 0.05252371355891228, + 0.4690113849937916, + 1.02009966224432, + 0.26981063559651375, + 1.2821605876088142, + 0.0, + 0.9625654630362988, + 0.1073727086186409, + 0.1515180766582489, + 0.5561953075230122, + 0.5789191722869873, + 0.3090146966278553, + 0.569206640124321, + 1.9809775166213512, + 0.7001207135617733, + 0.1485489308834076, + 0.23452354967594147, + 0.07569975033402443, + 0.23567376099526882, + 0.9149738736450672, + 0.04107438027858734, + 0.7124718204140663, + 0.0, + 0.34912936203181744, + 0.5745335184037685, + 0.6236720308661461, + 0.7458849363029003, + 0.5143713839352131, + 0.04721281677484512, + 0.6183277890086174, + 0.37087771482765675, + 0.532748531550169, + 0.04032697156071663, + 1.470658902078867, + 0.07762645557522774, + 0.25134501978755, + 0.26719172671437263, + 0.2649546191096306, + 0.0, + 0.24383967369794846, + 0.0, + 0.23192697577178478, + 0.3830477222800255, + 0.025433143600821495, + 0.29965608194470406, + 0.028461826965212822 + ], + "unique_experts": 55, + "load_cv": 1.0549007148641636, + "normalized_load_entropy": 0.8849973821546835, + "max_load_share": 0.08333333333333333 + }, + "full_input": { + "tokens": 99, + "top_k": 6, + "decisions": 594, + "ordered_route_sha256": "13d3effdbc89b4a6c18beb86b15e66b9e6d027901dcd156b240c2c7f514ca8ba", + "route_weight_sha256": "e08a0fd68b3e2df9cd8a78a08418706263479496abdf0b0bab40dc41bfadf805", + "loads": [ + 1, + 43, + 4, + 13, + 1, + 7, + 10, + 38, + 7, + 4, + 12, + 9, + 15, + 12, + 0, + 1, + 0, + 16, + 1, + 10, + 12, + 5, + 20, + 0, + 15, + 13, + 2, + 9, + 11, + 6, + 10, + 21, + 14, + 18, + 2, + 2, + 6, + 18, + 2, + 13, + 5, + 8, + 9, + 10, + 12, + 15, + 8, + 13, + 8, + 11, + 4, + 15, + 14, + 5, + 9, + 13, + 0, + 5, + 3, + 5, + 7, + 1, + 7, + 4 + ], + "weighted_loads": [ + 0.035740599036216736, + 2.9113686326891184, + 0.1109637888148427, + 0.9588939808309078, + 0.06099314242601395, + 0.4059874154627323, + 0.7375700324773788, + 3.070578768849373, + 0.5182935297489166, + 0.18280695751309395, + 0.9498287029564381, + 0.5299863032996655, + 1.1119241118431091, + 0.8386855907738209, + 0.0, + 0.04762955382466316, + 0.0, + 1.0893856845796108, + 0.05252371355891228, + 0.4690113849937916, + 1.02009966224432, + 0.26981063559651375, + 1.354834821075201, + 0.0, + 1.010005198419094, + 0.8741173818707466, + 0.1515180766582489, + 0.5561953075230122, + 0.5789191722869873, + 0.3090146966278553, + 0.6981428004801273, + 1.9809775166213512, + 0.8705906979739666, + 1.4023206159472466, + 0.23452354967594147, + 0.07569975033402443, + 0.23567376099526882, + 0.9149738736450672, + 0.08053656667470932, + 0.9487724639475346, + 0.31862275674939156, + 0.34912936203181744, + 0.5745335184037685, + 0.6236720308661461, + 0.7458849363029003, + 1.102600947022438, + 0.8368127420544624, + 0.7318276800215244, + 0.41069803945720196, + 0.6875331401824951, + 0.21153857931494713, + 1.470658902078867, + 0.7841193731874228, + 0.25134501978755, + 0.9750405997037888, + 0.7382382862269878, + 0.0, + 0.24383967369794846, + 0.11293383687734604, + 0.23192697577178478, + 0.3830477222800255, + 0.025433143600821495, + 0.3952188827097416, + 0.23573855496942997 + ], + "unique_experts": 60, + "load_cv": 0.8392352984318926, + "normalized_load_entropy": 0.9221671569973684, + "max_load_share": 0.0723905723905724 + } + }, + "s1_bos": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "e8c4f16f81b97ba99961a31a866f1f9af6f32951cc9e1514d97209d1b54450f5", + "route_weight_sha256": "fe876e1cc621903b57a7225f7928bba5f2acac5972c468c5707406a829c49cb5", + "loads": [ + 1, + 35, + 2, + 11, + 0, + 8, + 5, + 36, + 0, + 6, + 11, + 6, + 8, + 6, + 0, + 0, + 0, + 11, + 1, + 9, + 12, + 5, + 17, + 0, + 14, + 2, + 2, + 10, + 10, + 6, + 7, + 21, + 10, + 3, + 2, + 3, + 5, + 17, + 1, + 7, + 1, + 8, + 9, + 11, + 11, + 9, + 1, + 9, + 7, + 9, + 1, + 16, + 2, + 4, + 5, + 4, + 0, + 5, + 0, + 6, + 8, + 1, + 6, + 1 + ], + "weighted_loads": [ + 0.03699502721428871, + 2.393269080668688, + 0.07195647433400154, + 0.8707979395985603, + 0.0, + 0.4471486546099186, + 0.3494190648198128, + 3.007339708507061, + 0.0, + 0.2643718607723713, + 0.8764705918729305, + 0.4021778255701065, + 0.7304637171328068, + 0.42063089087605476, + 0.0, + 0.0, + 0.0, + 0.8201240934431553, + 0.05072693154215813, + 0.4305623844265938, + 1.0193385146558285, + 0.27336035296320915, + 1.2436504252254963, + 0.0, + 0.9538564532995224, + 0.11675546690821648, + 0.15151981264352798, + 0.5839727893471718, + 0.5566922575235367, + 0.312821701169014, + 0.5623529069125652, + 2.0001313500106335, + 0.702272292226553, + 0.14374760910868645, + 0.23648635298013687, + 0.09719815663993359, + 0.203522939234972, + 0.8678907193243504, + 0.04276366904377937, + 0.6812805682420731, + 0.02916826121509075, + 0.35295336320996284, + 0.5806031450629234, + 0.6943979226052761, + 0.7151198796927929, + 0.5646727383136749, + 0.04517960175871849, + 0.5706408470869064, + 0.3682047054171562, + 0.5840493626892567, + 0.03957526013255119, + 1.5240113995969296, + 0.08182594180107117, + 0.1981751173734665, + 0.2652902901172638, + 0.23566210642457008, + 0.0, + 0.24266691505908966, + 0.0, + 0.273733401671052, + 0.4136500023305416, + 0.025920363143086433, + 0.3368371333926916, + 0.029905308037996292 + ], + "unique_experts": 56, + "load_cv": 1.0173002332789933, + "normalized_load_entropy": 0.8909156268445441, + "max_load_share": 0.08108108108108109 + }, + "full_input": { + "tokens": 115, + "top_k": 6, + "decisions": 690, + "ordered_route_sha256": "227b6789f8c2c9508d1f856d9ae70089e3fd3e32fa9ac6894cf18a849827cfe3", + "route_weight_sha256": "4e3d15963c2f9b54fe442c4c9055850c9cec8926692d89da1d365c282c5b5c9d", + "loads": [ + 2, + 40, + 12, + 14, + 2, + 9, + 16, + 37, + 12, + 6, + 14, + 9, + 17, + 12, + 0, + 0, + 0, + 26, + 2, + 9, + 12, + 5, + 18, + 4, + 14, + 13, + 2, + 12, + 11, + 6, + 10, + 21, + 13, + 25, + 2, + 3, + 5, + 17, + 7, + 12, + 14, + 8, + 11, + 11, + 11, + 22, + 16, + 12, + 11, + 15, + 5, + 16, + 12, + 10, + 8, + 15, + 0, + 5, + 2, + 7, + 8, + 5, + 9, + 6 + ], + "weighted_loads": [ + 0.07622814178466797, + 2.6743423026055098, + 0.6923196827992797, + 1.0285965353250504, + 0.08505269140005112, + 0.49168234691023827, + 1.2681399583816528, + 3.0424562506377697, + 0.8131464309990406, + 0.2643718607723713, + 1.0372251383960247, + 0.5182789266109467, + 1.2614010497927666, + 0.8279935866594315, + 0.0, + 0.0, + 0.0, + 1.8943502642214298, + 0.09787635877728462, + 0.4305623844265938, + 1.0193385146558285, + 0.27336035296320915, + 1.2832857929170132, + 0.1872032769024372, + 0.9538564532995224, + 1.2282772026956081, + 0.15151981264352798, + 0.703055877238512, + 0.5983412712812424, + 0.312821701169014, + 0.6842057667672634, + 2.0001313500106335, + 0.8125565871596336, + 1.7433804385364056, + 0.23648635298013687, + 0.09719815663993359, + 0.203522939234972, + 0.8678907193243504, + 0.441066175699234, + 0.8631106726825237, + 0.6584462877362967, + 0.35295336320996284, + 0.7492356561124325, + 0.6943979226052761, + 0.7151198796927929, + 1.7384947277605534, + 1.1979299746453762, + 0.6785346418619156, + 0.7201181687414646, + 0.9584828801453114, + 0.2597818076610565, + 1.5240113995969296, + 0.6405302751809359, + 0.8747046440839767, + 0.9352893531322479, + 0.9492022097110748, + 0.0, + 0.24266691505908966, + 0.09850038960576057, + 0.30702186934649944, + 0.4136500023305416, + 0.2127117272466421, + 0.482715530321002, + 0.32381632551550865 + ], + "unique_experts": 60, + "load_cv": 0.7194889549031891, + "normalized_load_entropy": 0.9382735666128816, + "max_load_share": 0.057971014492753624 + } + }, + "s0_x": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "f3b00ac3d1da382ed0171da9fe6077a789d13d7102fd1cb6a1fe98b58670ad11", + "route_weight_sha256": "2210dac1158af7f71a751e0f660de22c414d2ec0e68dab02c268c34091ef1d4f", + "loads": [ + 1, + 35, + 2, + 11, + 0, + 8, + 5, + 36, + 0, + 5, + 11, + 7, + 8, + 6, + 0, + 0, + 0, + 12, + 1, + 10, + 11, + 5, + 18, + 0, + 14, + 2, + 2, + 10, + 10, + 6, + 6, + 21, + 11, + 2, + 2, + 2, + 6, + 18, + 1, + 7, + 0, + 8, + 9, + 11, + 10, + 9, + 3, + 9, + 7, + 9, + 1, + 16, + 2, + 5, + 4, + 5, + 0, + 6, + 0, + 5, + 7, + 1, + 5, + 0 + ], + "weighted_loads": [ + 0.03538808599114418, + 2.40619857609272, + 0.07091240584850311, + 0.8776390738785267, + 0.0, + 0.4164879061281681, + 0.31692099943757057, + 2.985827501863241, + 0.0, + 0.2234502136707306, + 0.8673679009079933, + 0.4614475555717945, + 0.7270894162356853, + 0.415331844240427, + 0.0, + 0.0, + 0.0, + 0.893678467720747, + 0.055939581245183945, + 0.4601775035262108, + 0.9695950821042061, + 0.2645860090851784, + 1.2632023207843304, + 0.0, + 0.9993305988609791, + 0.11969637125730515, + 0.15723340213298798, + 0.6016665920615196, + 0.5285506621003151, + 0.30925899371504784, + 0.5046226419508457, + 1.9747803248465061, + 0.74630231782794, + 0.09108591452240944, + 0.22858873009681702, + 0.07417798787355423, + 0.23356734588742256, + 0.9179052636027336, + 0.0484771691262722, + 0.6951273083686829, + 0.0, + 0.35793700627982616, + 0.5723557732999325, + 0.6740022152662277, + 0.6744875051081181, + 0.6106949523091316, + 0.12735086120665073, + 0.5573069602251053, + 0.37465424090623856, + 0.5740099027752876, + 0.0407940112054348, + 1.5646907202899456, + 0.08171181753277779, + 0.23941617459058762, + 0.22714707627892494, + 0.2677127569913864, + 0.0, + 0.28843123465776443, + 0.0, + 0.2263084053993225, + 0.37844743952155113, + 0.027397992089390755, + 0.2991780787706375, + 0.0 + ], + "unique_experts": 54, + "load_cv": 1.0280933298167694, + "normalized_load_entropy": 0.8869968497116271, + "max_load_share": 0.08108108108108109 + }, + "full_input": { + "tokens": 99, + "top_k": 6, + "decisions": 594, + "ordered_route_sha256": "ebebfadcd792d8f83964b754bd590974c6ec9754c3dd010eb3e79bc80be5a1a2", + "route_weight_sha256": "aff6a8ebfb78bcf2078e1f9895b191f444ebd0c5b4de5dff95c0c113fbd75bc6", + "loads": [ + 1, + 42, + 5, + 13, + 2, + 8, + 11, + 37, + 9, + 5, + 12, + 9, + 15, + 13, + 0, + 0, + 0, + 15, + 1, + 10, + 11, + 5, + 20, + 0, + 14, + 14, + 2, + 10, + 10, + 6, + 8, + 21, + 16, + 16, + 2, + 2, + 6, + 18, + 1, + 12, + 6, + 8, + 9, + 11, + 10, + 15, + 10, + 12, + 8, + 13, + 5, + 16, + 13, + 5, + 6, + 13, + 0, + 6, + 3, + 5, + 7, + 1, + 7, + 3 + ], + "weighted_loads": [ + 0.03538808599114418, + 2.827801486477256, + 0.15118979010730982, + 0.9808470122516155, + 0.09749758988618851, + 0.4164879061281681, + 0.7545071169734001, + 3.0310101844370365, + 0.6119975671172142, + 0.2234502136707306, + 0.9344328790903091, + 0.5262100212275982, + 1.1091671660542488, + 0.9280916824936867, + 0.0, + 0.0, + 0.0, + 1.0662916712462902, + 0.055939581245183945, + 0.4601775035262108, + 0.9695950821042061, + 0.2645860090851784, + 1.3358765542507172, + 0.0, + 0.9993305988609791, + 0.9864910393953323, + 0.15723340213298798, + 0.6016665920615196, + 0.5285506621003151, + 0.30925899371504784, + 0.573688019067049, + 1.9747803248465061, + 0.9595161341130733, + 1.1598404571413994, + 0.22858873009681702, + 0.07417798787355423, + 0.23356734588742256, + 0.9179052636027336, + 0.0484771691262722, + 0.8743175938725471, + 0.33159760758280754, + 0.35793700627982616, + 0.5723557732999325, + 0.6740022152662277, + 0.6744875051081181, + 1.1669886372983456, + 0.9211477059870958, + 0.6708068512380123, + 0.41447456553578377, + 0.7865665256977081, + 0.2656409479677677, + 1.5646907202899456, + 0.7422524150460958, + 0.23941617459058762, + 0.8511269614100456, + 0.7417923659086227, + 0.0, + 0.28843123465776443, + 0.11293383687734604, + 0.2263084053993225, + 0.37844743952155113, + 0.027397992089390755, + 0.3894468694925308, + 0.20727672800421715 + ], + "unique_experts": 59, + "load_cv": 0.8219833812332719, + "normalized_load_entropy": 0.9232531544230512, + "max_load_share": 0.0707070707070707 + } + }, + "s1_x": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "0b00e9f154dde8793be4721e1e2e1f264b53ef9fc0e7b8c75b6336fa813d6374", + "route_weight_sha256": "4d9969af4ccd76f92c779a434b472a3c0fbdcb27c45d52d209aeca1db5e6f4f5", + "loads": [ + 1, + 34, + 1, + 11, + 0, + 7, + 3, + 36, + 0, + 5, + 11, + 6, + 9, + 5, + 0, + 0, + 0, + 11, + 1, + 12, + 11, + 5, + 17, + 0, + 14, + 2, + 2, + 10, + 10, + 6, + 7, + 21, + 10, + 2, + 2, + 4, + 6, + 18, + 1, + 7, + 2, + 8, + 9, + 11, + 12, + 9, + 2, + 11, + 7, + 9, + 0, + 18, + 1, + 4, + 5, + 5, + 0, + 4, + 0, + 6, + 6, + 1, + 5, + 1 + ], + "weighted_loads": [ + 0.03613429144024849, + 2.2615291476249695, + 0.03789575397968292, + 0.8749007880687714, + 0.0, + 0.3870086818933487, + 0.21655823290348053, + 3.021204996854067, + 0.0, + 0.23047131672501564, + 0.8562789894640446, + 0.40534596517682076, + 0.7660352699458599, + 0.3682187721133232, + 0.0, + 0.0, + 0.0, + 0.818636242300272, + 0.05221829190850258, + 0.5484575480222702, + 0.9558922834694386, + 0.2715090252459049, + 1.201642718166113, + 0.0, + 0.949615016579628, + 0.1508144810795784, + 0.15609223395586014, + 0.5910029038786888, + 0.5357168167829514, + 0.31285127252340317, + 0.5487755909562111, + 1.9926119446754456, + 0.7041381150484085, + 0.08191607519984245, + 0.22891511023044586, + 0.13960965164005756, + 0.25462019070982933, + 0.9351125434041023, + 0.05233184993267059, + 0.66920006275177, + 0.06572605483233929, + 0.36045329459011555, + 0.5800035372376442, + 0.6977643966674805, + 0.7674170844256878, + 0.6169619932770729, + 0.1060105562210083, + 0.6391013450920582, + 0.37453649193048477, + 0.5628041326999664, + 0.0, + 1.6269909590482712, + 0.04617515578866005, + 0.18662704154849052, + 0.2549008708447218, + 0.2933715544641018, + 0.0, + 0.21344519406557083, + 0.0, + 0.26985701732337475, + 0.33792147785425186, + 0.02712680585682392, + 0.30239119566977024, + 0.03073202632367611 + ], + "unique_experts": 55, + "load_cv": 1.0290402269364975, + "normalized_load_entropy": 0.8865538783523752, + "max_load_share": 0.08108108108108109 + }, + "full_input": { + "tokens": 115, + "top_k": 6, + "decisions": 690, + "ordered_route_sha256": "56483193984d9ee446d0f9b27a6237d00d411186347001fcfef8662a9713522f", + "route_weight_sha256": "1496c22c19c57bc6b3e3317f0c3d4bd9623506e0547e717b4f2798e0782d58c7", + "loads": [ + 2, + 40, + 12, + 13, + 1, + 8, + 15, + 37, + 14, + 5, + 14, + 10, + 18, + 14, + 0, + 0, + 0, + 25, + 3, + 12, + 11, + 5, + 18, + 4, + 14, + 15, + 2, + 12, + 11, + 6, + 9, + 21, + 14, + 21, + 2, + 4, + 6, + 18, + 7, + 11, + 14, + 8, + 11, + 11, + 12, + 21, + 17, + 14, + 11, + 15, + 5, + 18, + 10, + 10, + 7, + 14, + 0, + 4, + 2, + 7, + 6, + 5, + 8, + 6 + ], + "weighted_loads": [ + 0.07536740601062775, + 2.586673615500331, + 0.6950222169980407, + 0.9780926331877708, + 0.03824255242943764, + 0.43154237419366837, + 1.1887813322246075, + 3.0563215389847755, + 0.899856299161911, + 0.23047131672501564, + 1.0157776363193989, + 0.5596030354499817, + 1.2969726026058197, + 0.9421648364514112, + 0.0, + 0.0, + 0.0, + 1.8414370119571686, + 0.13921406865119934, + 0.5484575480222702, + 0.9558922834694386, + 0.2715090252459049, + 1.2412780858576298, + 0.1872032769024372, + 0.949615016579628, + 1.4304667226970196, + 0.15609223395586014, + 0.7100859917700291, + 0.577365830540657, + 0.31285127252340317, + 0.6168172135949135, + 1.9926119446754456, + 0.8570831939578056, + 1.3599669933319092, + 0.22891511023044586, + 0.13960965164005756, + 0.25462019070982933, + 0.9351125434041023, + 0.45063435658812523, + 0.800142914056778, + 0.6135947871953249, + 0.36045329459011555, + 0.7486360482871532, + 0.6977643966674805, + 0.7674170844256878, + 1.7135262191295624, + 1.2605239264667034, + 0.7469951398670673, + 0.7264499552547932, + 0.9506537988781929, + 0.2930588461458683, + 1.6269909590482712, + 0.562488729134202, + 0.8631565682590008, + 0.8787064459174871, + 0.8791636861860752, + 0.0, + 0.21344519406557083, + 0.09850038960576057, + 0.3031454849988222, + 0.33792147785425186, + 0.2139181699603796, + 0.4445326905697584, + 0.32464304380118847 + ], + "unique_experts": 60, + "load_cv": 0.7161180326992079, + "normalized_load_entropy": 0.9381007462868461, + "max_load_share": 0.057971014492753624 + } + }, + "s0_period": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "1fd2f4d49abb2fb8bc2cf5716d99781dcf1366bb60f88325bbab6b4eefeefe91", + "route_weight_sha256": "62e043f1fb39131f0ee045e07d193a342f37a615be52ca5320c7b993d5c317d2", + "loads": [ + 1, + 35, + 2, + 11, + 0, + 9, + 5, + 36, + 0, + 5, + 11, + 6, + 8, + 6, + 0, + 0, + 0, + 12, + 1, + 11, + 11, + 5, + 18, + 0, + 14, + 2, + 2, + 9, + 9, + 6, + 6, + 21, + 10, + 2, + 2, + 2, + 6, + 18, + 1, + 7, + 0, + 8, + 9, + 12, + 10, + 11, + 2, + 11, + 7, + 9, + 1, + 16, + 2, + 5, + 4, + 5, + 0, + 4, + 0, + 5, + 7, + 1, + 5, + 0 + ], + "weighted_loads": [ + 0.03658616170287132, + 2.409415688365698, + 0.06933129951357841, + 0.8809797279536724, + 0.0, + 0.4531574472784996, + 0.32276950404047966, + 2.9877038970589638, + 0.0, + 0.22531255707144737, + 0.8731208443641663, + 0.4230105057358742, + 0.730157382786274, + 0.4158995486795902, + 0.0, + 0.0, + 0.0, + 0.8903468810021877, + 0.05605524033308029, + 0.5016175415366888, + 0.9845479428768158, + 0.2655909117311239, + 1.2564699798822403, + 0.0, + 0.9583230689167976, + 0.1198657900094986, + 0.15416443347930908, + 0.5688555613160133, + 0.48826203122735023, + 0.30543040484189987, + 0.5055895820260048, + 1.9956970177590847, + 0.7055222131311893, + 0.08047572150826454, + 0.2277275249361992, + 0.07416423410177231, + 0.23713449575006962, + 0.9117617793381214, + 0.047978028655052185, + 0.7017175480723381, + 0.0, + 0.3560212254524231, + 0.5796909183263779, + 0.6944632567465305, + 0.6829685233533382, + 0.660183772444725, + 0.088618203997612, + 0.6405223496258259, + 0.37927979603409767, + 0.5658053085207939, + 0.041418641805648804, + 1.58717605099082, + 0.0836525447666645, + 0.24154741689562798, + 0.22811514511704445, + 0.2690238319337368, + 0.0, + 0.20883613266050816, + 0.0, + 0.2274872362613678, + 0.38366520404815674, + 0.025400254875421524, + 0.29695720598101616, + 0.0 + ], + "unique_experts": 54, + "load_cv": 1.0350171252877065, + "normalized_load_entropy": 0.8852109304277191, + "max_load_share": 0.08108108108108109 + }, + "full_input": { + "tokens": 99, + "top_k": 6, + "decisions": 594, + "ordered_route_sha256": "878495a6c2c08702d1280c2a7ec4cb5d7705fc80a9017ff4ff3e2589c03e391b", + "route_weight_sha256": "ff3642c2d0a3be748563596fb6b6ce8c0dc35ce9fdf494b6bb87703bb13c750d", + "loads": [ + 1, + 41, + 4, + 13, + 1, + 9, + 12, + 37, + 9, + 5, + 12, + 8, + 15, + 13, + 0, + 1, + 0, + 16, + 1, + 11, + 11, + 5, + 20, + 0, + 14, + 14, + 2, + 9, + 9, + 6, + 8, + 21, + 14, + 16, + 2, + 2, + 6, + 18, + 1, + 12, + 5, + 8, + 9, + 12, + 10, + 17, + 10, + 14, + 8, + 14, + 4, + 16, + 13, + 5, + 6, + 13, + 0, + 4, + 3, + 5, + 7, + 1, + 7, + 4 + ], + "weighted_loads": [ + 0.03658616170287132, + 2.7779865209013224, + 0.10835295263677835, + 0.9851226918399334, + 0.06099314242601395, + 0.4531574472784996, + 0.8647728003561497, + 3.032886579632759, + 0.6765496581792831, + 0.22531255707144737, + 0.9422594904899597, + 0.48777297139167786, + 1.1122351326048374, + 0.8826691508293152, + 0.0, + 0.0372609905898571, + 0.0, + 1.105209182947874, + 0.05605524033308029, + 0.5016175415366888, + 0.9845479428768158, + 0.2655909117311239, + 1.329144213348627, + 0.0, + 0.9583230689167976, + 0.9768868088722229, + 0.15416443347930908, + 0.5688555613160133, + 0.48826203122735023, + 0.30543040484189987, + 0.574248842895031, + 1.9956970177590847, + 0.8759921975433826, + 1.1525267325341702, + 0.2277275249361992, + 0.07416423410177231, + 0.23713449575006962, + 0.9117617793381214, + 0.047978028655052185, + 0.8814542591571808, + 0.28860292583703995, + 0.3560212254524231, + 0.5796909183263779, + 0.6944632567465305, + 0.6829685233533382, + 1.2013559564948082, + 0.9271379448473454, + 0.7540222406387329, + 0.4191001206636429, + 0.8116875998675823, + 0.2126302495598793, + 1.58717605099082, + 0.7441931422799826, + 0.24154741689562798, + 0.8520950302481651, + 0.7256572991609573, + 0.0, + 0.20883613266050816, + 0.11293383687734604, + 0.2274872362613678, + 0.38366520404815674, + 0.025400254875421524, + 0.3891748897731304, + 0.3322344236075878 + ], + "unique_experts": 60, + "load_cv": 0.8237468526265068, + "normalized_load_entropy": 0.9226223540150967, + "max_load_share": 0.06902356902356903 + } + }, + "s1_period": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "ba61baa1243aa18f0d22f0088299d8b828f67a72d4030c07d7699bdaedcf5a1d", + "route_weight_sha256": "ff0f1edd4df464b4458927d42e70772a8a964b7778811a826caa89375ad1ecc8", + "loads": [ + 1, + 35, + 1, + 11, + 0, + 7, + 4, + 36, + 0, + 5, + 11, + 6, + 9, + 6, + 0, + 0, + 0, + 11, + 1, + 10, + 11, + 6, + 17, + 0, + 14, + 2, + 2, + 10, + 11, + 6, + 7, + 21, + 11, + 2, + 2, + 4, + 5, + 19, + 1, + 7, + 1, + 8, + 9, + 10, + 13, + 9, + 2, + 9, + 7, + 9, + 0, + 17, + 1, + 4, + 5, + 4, + 0, + 4, + 0, + 5, + 8, + 1, + 5, + 1 + ], + "weighted_loads": [ + 0.036962561309337616, + 2.3303906098008156, + 0.03682554140686989, + 0.8768619410693645, + 0.0, + 0.38409648835659027, + 0.2609604671597481, + 2.988241858780384, + 0.0, + 0.23044823110103607, + 0.8564794696867466, + 0.40275558456778526, + 0.7682641372084618, + 0.42659781500697136, + 0.0, + 0.0, + 0.0, + 0.7918965481221676, + 0.05239857733249664, + 0.4717351570725441, + 0.9566331282258034, + 0.3038078974932432, + 1.21687912940979, + 0.0, + 0.9223967790603638, + 0.15180035680532455, + 0.15152569860219955, + 0.5964533910155296, + 0.5738397985696793, + 0.3083832412958145, + 0.5540564134716988, + 2.0296259485185146, + 0.7438614815473557, + 0.07387728989124298, + 0.2292102947831154, + 0.14273115620017052, + 0.202016469091177, + 0.9558015875518322, + 0.05083666741847992, + 0.6718068793416023, + 0.02780686505138874, + 0.36064653284847736, + 0.5743982009589672, + 0.6337285414338112, + 0.8041875027120113, + 0.6043037474155426, + 0.09692395105957985, + 0.5438675954937935, + 0.37349995225667953, + 0.5764390230178833, + 0.0, + 1.5942778326570988, + 0.04361852630972862, + 0.18381724506616592, + 0.25563845969736576, + 0.23714614659547806, + 0.0, + 0.21687732264399529, + 0.0, + 0.23872646316885948, + 0.4102650173008442, + 0.026566211134195328, + 0.29974858462810516, + 0.03206394985318184 + ], + "unique_experts": 55, + "load_cv": 1.0378362737725952, + "normalized_load_entropy": 0.8852952453396489, + "max_load_share": 0.08108108108108109 + }, + "full_input": { + "tokens": 115, + "top_k": 6, + "decisions": 690, + "ordered_route_sha256": "79e5bd6a5e15f43c68ec8099c6f51c6bb59ff076a2de34ac50d2ad5b355754ab", + "route_weight_sha256": "18576ff9d75001ca9ae94801221c6490bc8677d0e914d0c5ecac1ff760ee282a", + "loads": [ + 2, + 40, + 11, + 13, + 1, + 8, + 17, + 37, + 14, + 5, + 14, + 9, + 18, + 13, + 0, + 0, + 0, + 26, + 3, + 10, + 11, + 6, + 18, + 4, + 14, + 15, + 2, + 12, + 12, + 6, + 9, + 21, + 14, + 21, + 2, + 4, + 5, + 19, + 7, + 11, + 13, + 8, + 11, + 10, + 13, + 20, + 19, + 12, + 11, + 17, + 4, + 17, + 10, + 10, + 7, + 14, + 0, + 4, + 2, + 6, + 8, + 5, + 8, + 7 + ], + "weighted_loads": [ + 0.07619567587971687, + 2.6114638317376375, + 0.657188749872148, + 0.9794600382447243, + 0.04181905463337898, + 0.42863018065690994, + 1.3349690847098827, + 3.0233584009110928, + 0.9244476109743118, + 0.23044823110103607, + 1.0169307552278042, + 0.5188566856086254, + 1.2992014698684216, + 0.8651932571083307, + 0.0, + 0.0, + 0.0, + 1.8732513338327408, + 0.140382818877697, + 0.4717351570725441, + 0.9566331282258034, + 0.3038078974932432, + 1.256514497101307, + 0.1872032769024372, + 0.9223967790603638, + 1.3868343979120255, + 0.15152569860219955, + 0.7155364789068699, + 0.615488812327385, + 0.3083832412958145, + 0.6180867962539196, + 2.0296259485185146, + 0.8541457764804363, + 1.3535574600100517, + 0.2292102947831154, + 0.14273115620017052, + 0.202016469091177, + 0.9558015875518322, + 0.44913917407393456, + 0.8046758845448494, + 0.5821249466389418, + 0.36064653284847736, + 0.7430307120084763, + 0.6337285414338112, + 0.8041875027120113, + 1.6698899492621422, + 1.3640000596642494, + 0.6517613902688026, + 0.7254134155809879, + 1.0688236951828003, + 0.22020654752850533, + 1.5942778326570988, + 0.5599320996552706, + 0.8603467717766762, + 0.8794440347701311, + 0.8657071441411972, + 0.0, + 0.21687732264399529, + 0.09850038960576057, + 0.27201493084430695, + 0.4102650173008442, + 0.213357575237751, + 0.4376155287027359, + 0.4010483957827091 + ], + "unique_experts": 60, + "load_cv": 0.7222860392207966, + "normalized_load_entropy": 0.9372915619654955, + "max_load_share": 0.057971014492753624 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 74, + "ordered_topk_exact_tokens": 49, + "set_exact_tokens": 61, + "mean_set_jaccard": 0.9498069498069497, + "mean_token_weighted_tv": 0.011486745301029971, + "aggregate_load_tv": 0.018018018018018014 + }, + "system_bos": { + "tokens": 74, + "ordered_topk_exact_tokens": 47, + "set_exact_tokens": 58, + "mean_set_jaccard": 0.9382239382239382, + "mean_token_weighted_tv": 0.01615703316103365, + "aggregate_load_tv": 0.03153153153153153 + }, + "system_x": { + "tokens": 74, + "ordered_topk_exact_tokens": 41, + "set_exact_tokens": 51, + "mean_set_jaccard": 0.9083011583011584, + "mean_token_weighted_tv": 0.022236398509326013, + "aggregate_load_tv": 0.0382882882882883 + }, + "system_period": { + "tokens": 74, + "ordered_topk_exact_tokens": 38, + "set_exact_tokens": 48, + "mean_set_jaccard": 0.8938223938223939, + "mean_token_weighted_tv": 0.024553828092442977, + "aggregate_load_tv": 0.04054054054054054 + }, + "bos_at_s0": { + "tokens": 74, + "ordered_topk_exact_tokens": 45, + "set_exact_tokens": 51, + "mean_set_jaccard": 0.9083011583011584, + "mean_token_weighted_tv": 0.021698590946962703, + "aggregate_load_tv": 0.04054054054054054 + }, + "bos_at_s1": { + "tokens": 74, + "ordered_topk_exact_tokens": 41, + "set_exact_tokens": 50, + "mean_set_jaccard": 0.9021879021879023, + "mean_token_weighted_tv": 0.022716058216787672, + "aggregate_load_tv": 0.04504504504504505 + }, + "x_at_s0": { + "tokens": 74, + "ordered_topk_exact_tokens": 33, + "set_exact_tokens": 45, + "mean_set_jaccard": 0.8880308880308881, + "mean_token_weighted_tv": 0.025655936361668078, + "aggregate_load_tv": 0.04954954954954956 + }, + "x_at_s1": { + "tokens": 74, + "ordered_topk_exact_tokens": 30, + "set_exact_tokens": 40, + "mean_set_jaccard": 0.8606821106821106, + "mean_token_weighted_tv": 0.032277053813575894, + "aggregate_load_tv": 0.0518018018018018 + }, + "period_at_s0": { + "tokens": 74, + "ordered_topk_exact_tokens": 28, + "set_exact_tokens": 42, + "mean_set_jaccard": 0.8764478764478765, + "mean_token_weighted_tv": 0.02696204258481393, + "aggregate_load_tv": 0.04504504504504505 + }, + "period_at_s1": { + "tokens": 74, + "ordered_topk_exact_tokens": 35, + "set_exact_tokens": 46, + "mean_set_jaccard": 0.8838481338481338, + "mean_token_weighted_tv": 0.028921113714475085, + "aggregate_load_tv": 0.0518018018018018 + } + } + }, + "layer_09": { + "layer": 9, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "cce8d55bbdf94bd6cb6f2ed4999bfa733f6f98f51e5b94451be643778704e3dc", + "route_weight_sha256": "fffb987d1d21ff9424fa2ac76214c8e98e05cf969aeccc999163bc48bbc1f2dc", + "loads": [ + 8, + 11, + 4, + 6, + 2, + 14, + 0, + 6, + 6, + 2, + 3, + 16, + 1, + 7, + 0, + 7, + 4, + 5, + 4, + 7, + 4, + 5, + 1, + 1, + 1, + 0, + 0, + 26, + 32, + 5, + 3, + 0, + 5, + 3, + 12, + 10, + 6, + 15, + 5, + 4, + 1, + 5, + 5, + 0, + 2, + 1, + 3, + 20, + 11, + 1, + 1, + 12, + 8, + 0, + 5, + 4, + 40, + 34, + 12, + 5, + 10, + 3, + 4, + 6 + ], + "weighted_loads": [ + 0.36243750154972076, + 0.9546261727809906, + 0.39504240080714226, + 0.2687978558242321, + 0.12234434485435486, + 0.8686467371881008, + 0.0, + 0.4776749946177006, + 0.5423346161842346, + 0.11667603254318237, + 0.11548840068280697, + 1.1151402778923512, + 0.0380546972155571, + 0.5235612317919731, + 0.0, + 0.28914930671453476, + 0.2857702113687992, + 0.16665418073534966, + 0.1974617838859558, + 0.7943039610981941, + 0.19494817778468132, + 0.23843633756041527, + 0.04257233440876007, + 0.04117068275809288, + 0.047218505293130875, + 0.0, + 0.0, + 2.1279871873557568, + 3.401156857609749, + 0.21550280414521694, + 0.2425314150750637, + 0.0, + 0.35493456944823265, + 0.19410156831145287, + 0.9314879439771175, + 0.6895202398300171, + 0.5821879096329212, + 0.966804776340723, + 0.2532961815595627, + 0.2943591643124819, + 0.07801778614521027, + 0.234694205224514, + 0.2505653686821461, + 0.0, + 0.11711554601788521, + 0.02862630784511566, + 0.14739440754055977, + 1.4688603319227695, + 0.8079838976264, + 0.049197204411029816, + 0.04564132168889046, + 0.6959278713911772, + 0.5678421407938004, + 0.0, + 0.25762316957116127, + 0.45249518752098083, + 3.2190498895943165, + 1.7930257972329855, + 0.9569255411624908, + 0.23624762520194054, + 0.7880776487290859, + 0.10942952707409859, + 0.2387569472193718, + 0.5465104095637798 + ], + "unique_experts": 57, + "load_cv": 1.165439892072485, + "normalized_load_entropy": 0.8738529369931565, + "max_load_share": 0.09009009009009009 + }, + "full_input": { + "tokens": 99, + "top_k": 6, + "decisions": 594, + "ordered_route_sha256": "95eac5bc12a2b7abb373bb8c664b56679608298faece2d108658b3efcbae6b3a", + "route_weight_sha256": "9792f9a3379667e39756c0b991b3593a97d808b6efe260d59c52b3d25697834b", + "loads": [ + 15, + 14, + 4, + 6, + 4, + 14, + 0, + 6, + 8, + 2, + 14, + 16, + 4, + 13, + 0, + 7, + 5, + 6, + 5, + 17, + 4, + 5, + 6, + 5, + 4, + 2, + 0, + 27, + 32, + 5, + 4, + 6, + 6, + 3, + 21, + 17, + 6, + 15, + 8, + 4, + 1, + 14, + 5, + 0, + 6, + 8, + 15, + 20, + 13, + 1, + 5, + 13, + 8, + 3, + 5, + 9, + 45, + 34, + 14, + 9, + 10, + 3, + 6, + 7 + ], + "weighted_loads": [ + 0.8490164652466774, + 1.1574870757758617, + 0.39504240080714226, + 0.2687978558242321, + 0.36892472952604294, + 0.8686467371881008, + 0.0, + 0.4776749946177006, + 0.639110904186964, + 0.11667603254318237, + 1.2911494206637144, + 1.1151402778923512, + 0.09134666435420513, + 0.7329417124856263, + 0.0, + 0.28914930671453476, + 0.32681912183761597, + 0.20907295122742653, + 0.24738308042287827, + 1.7057133540511131, + 0.19494817778468132, + 0.23843633756041527, + 1.631378160789609, + 0.3384096510708332, + 0.17633184418082237, + 0.14831719547510147, + 0.0, + 2.140910449437797, + 3.401156857609749, + 0.21550280414521694, + 0.2824205867946148, + 0.1882339722942561, + 0.3586753068957478, + 0.19410156831145287, + 1.4265872687101364, + 1.155412558466196, + 0.5821879096329212, + 0.966804776340723, + 0.3747730404138565, + 0.2943591643124819, + 0.07801778614521027, + 1.1421605199575424, + 0.2505653686821461, + 0.0, + 0.3884493769146502, + 0.6485762596130371, + 1.0690050087869167, + 1.4688603319227695, + 0.9593737982213497, + 0.049197204411029816, + 0.2520234286785126, + 0.7295269723981619, + 0.5678421407938004, + 0.11882280744612217, + 0.25762316957116127, + 0.6946795955300331, + 3.460279706865549, + 1.7930257972329855, + 1.096934087574482, + 0.4103131331503391, + 0.7880776487290859, + 0.10942952707409859, + 0.29432142712175846, + 0.5827532857656479 + ], + "unique_experts": 60, + "load_cv": 0.9081613903664905, + "normalized_load_entropy": 0.9158846165271591, + "max_load_share": 0.07575757575757576 + } + }, + "s1_eos": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "c93c9c17be4951f784bb1ff54b80f608988bfc7eedd7f2e25d3760756a268bf8", + "route_weight_sha256": "0a4aac2643f57e6873e6a3267d3c77325da3106f2b909e3804a3147d29ce7f29", + "loads": [ + 7, + 11, + 5, + 6, + 2, + 14, + 0, + 6, + 6, + 2, + 3, + 14, + 0, + 6, + 0, + 7, + 4, + 5, + 4, + 7, + 4, + 5, + 1, + 2, + 1, + 1, + 0, + 27, + 31, + 4, + 2, + 1, + 5, + 3, + 13, + 10, + 6, + 15, + 5, + 4, + 1, + 5, + 7, + 0, + 2, + 1, + 3, + 21, + 11, + 1, + 1, + 11, + 8, + 0, + 5, + 5, + 41, + 31, + 12, + 6, + 10, + 2, + 5, + 6 + ], + "weighted_loads": [ + 0.3154563345015049, + 0.9519905969500542, + 0.44587478041648865, + 0.2707967683672905, + 0.12544863671064377, + 0.8758365549147129, + 0.0, + 0.4812213182449341, + 0.5465125404298306, + 0.11390257254242897, + 0.11556833237409592, + 1.05098682269454, + 0.0, + 0.4891406297683716, + 0.0, + 0.29531797766685486, + 0.2822795622050762, + 0.1645702663809061, + 0.1960436850786209, + 0.793479185551405, + 0.19761358946561813, + 0.2402719408273697, + 0.040960658341646194, + 0.08278170600533485, + 0.050206296145915985, + 0.04205416887998581, + 0.0, + 2.1479140296578407, + 3.384314678609371, + 0.1869388073682785, + 0.19849514216184616, + 0.03106103278696537, + 0.36871135979890823, + 0.1955399066209793, + 0.9783883132040501, + 0.6806901469826698, + 0.5871578268706799, + 0.9663071800023317, + 0.2593437023460865, + 0.2853875532746315, + 0.07878005504608154, + 0.225809745490551, + 0.3269500210881233, + 0.0, + 0.11362806707620621, + 0.027841707691550255, + 0.1457291543483734, + 1.5074897855520248, + 0.8074101023375988, + 0.04851602390408516, + 0.04728934168815613, + 0.650845842435956, + 0.5596010684967041, + 0.0, + 0.25653644278645515, + 0.5067644044756889, + 3.258801221847534, + 1.6530213132500648, + 0.9682628028094769, + 0.28156808018684387, + 0.7908599674701691, + 0.07235938310623169, + 0.27171986550092697, + 0.5467481724917889 + ], + "unique_experts": 58, + "load_cv": 1.148321804761895, + "normalized_load_entropy": 0.8777853058393476, + "max_load_share": 0.09234234234234234 + }, + "full_input": { + "tokens": 115, + "top_k": 6, + "decisions": 690, + "ordered_route_sha256": "7aeaed9eb999f939e48315677e2166c699325bc2f548b2a0f003a6fa3afaee0b", + "route_weight_sha256": "35a6175face56c495f84939c6fe38f39284f5aa92649063de4544da055de05e9", + "loads": [ + 18, + 16, + 5, + 6, + 4, + 14, + 0, + 6, + 13, + 4, + 14, + 16, + 3, + 11, + 1, + 7, + 5, + 6, + 5, + 17, + 4, + 8, + 6, + 14, + 6, + 10, + 4, + 28, + 37, + 4, + 4, + 6, + 6, + 6, + 19, + 22, + 6, + 18, + 10, + 5, + 7, + 19, + 9, + 0, + 7, + 13, + 24, + 21, + 17, + 6, + 3, + 12, + 8, + 3, + 6, + 10, + 46, + 31, + 17, + 10, + 10, + 3, + 7, + 7 + ], + "weighted_loads": [ + 1.0339502580463886, + 1.2439530901610851, + 0.44587478041648865, + 0.2707967683672905, + 0.39022836834192276, + 0.8758365549147129, + 0.0, + 0.4812213182449341, + 0.9591957032680511, + 0.20482943207025528, + 1.202589601278305, + 1.1475325264036655, + 0.05452255858108401, + 0.6393137213308364, + 0.03864428400993347, + 0.29531797766685486, + 0.3284585252404213, + 0.22063992358744144, + 0.2463321089744568, + 1.7923394590616226, + 0.19761358946561813, + 0.36689944937825203, + 1.6253112778067589, + 0.9671973139047623, + 0.24154428392648697, + 0.5458006113767624, + 0.25352393835783005, + 2.160837291739881, + 3.8080710358917713, + 0.1869388073682785, + 0.3360457345843315, + 0.17343729338608682, + 0.37233562441542745, + 0.41685131192207336, + 1.2791565842926502, + 1.471543375402689, + 0.5871578268706799, + 1.107823831960559, + 0.497221652418375, + 0.3526178374886513, + 0.47834739461541176, + 1.6365820541977882, + 0.4191127307713032, + 0.0, + 0.29764711018651724, + 1.064595041796565, + 1.9096096903085709, + 1.5074897855520248, + 1.1962770894169807, + 0.37833787128329277, + 0.16634589061141014, + 0.6838695611804724, + 0.5596010684967041, + 0.1489260084927082, + 0.2979028522968292, + 0.740526532754302, + 3.4921402409672737, + 1.6530213132500648, + 1.272136203944683, + 0.4662034474313259, + 0.7908599674701691, + 0.10984231159090996, + 0.4301983341574669, + 0.5827684551477432 + ], + "unique_experts": 62, + "load_cv": 0.8045188485111743, + "normalized_load_entropy": 0.9327212015785927, + "max_load_share": 0.06666666666666667 + } + }, + "s0_bos": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "e5451d08cb369f942d2dd596584d78ab6d7db0189d4a1c7ca48136423a9f5882", + "route_weight_sha256": "0ec828eed832659db48ddc7fcc77914218f931eda07c011be454ce7cbf7a1725", + "loads": [ + 5, + 12, + 4, + 5, + 2, + 14, + 0, + 6, + 6, + 2, + 2, + 16, + 1, + 7, + 0, + 7, + 4, + 4, + 4, + 7, + 4, + 5, + 1, + 1, + 1, + 2, + 0, + 29, + 32, + 5, + 2, + 0, + 5, + 3, + 13, + 10, + 5, + 15, + 4, + 4, + 3, + 4, + 7, + 0, + 1, + 0, + 4, + 21, + 11, + 1, + 2, + 12, + 8, + 0, + 4, + 5, + 40, + 31, + 12, + 5, + 11, + 1, + 5, + 7 + ], + "weighted_loads": [ + 0.2267838455736637, + 0.9940916076302528, + 0.39554598927497864, + 0.24936135113239288, + 0.1252131275832653, + 0.8875713832676411, + 0.0, + 0.4674845039844513, + 0.534197248518467, + 0.11640571430325508, + 0.08406157046556473, + 1.162147842347622, + 0.034321196377277374, + 0.5296070016920567, + 0.0, + 0.2846432030200958, + 0.27884265407919884, + 0.14406359940767288, + 0.19581853598356247, + 0.7609935216605663, + 0.19639421999454498, + 0.23345579206943512, + 0.041042882949113846, + 0.03938734903931618, + 0.05269761011004448, + 0.09316374361515045, + 0.0, + 2.222822740674019, + 3.2504703737795353, + 0.22183174639940262, + 0.1877540983259678, + 0.0, + 0.311413437128067, + 0.18776720762252808, + 0.9373396672308445, + 0.675581581890583, + 0.5446099862456322, + 0.9913414679467678, + 0.2275904268026352, + 0.29492298886179924, + 0.15771650522947311, + 0.18188358843326569, + 0.33130259066820145, + 0.0, + 0.053087156265974045, + 0.0, + 0.1989947110414505, + 1.5168664120137691, + 0.7948433384299278, + 0.04919162392616272, + 0.08374180272221565, + 0.7379780262708664, + 0.5536886304616928, + 0.0, + 0.2064858004450798, + 0.48734845593571663, + 3.186195369809866, + 1.6848290376365185, + 0.9541031681001186, + 0.2346549890935421, + 0.8565169088542461, + 0.03667278215289116, + 0.28440988063812256, + 0.5948946103453636 + ], + "unique_experts": 57, + "load_cv": 1.1707206340623006, + "normalized_load_entropy": 0.8721743011210035, + "max_load_share": 0.09009009009009009 + }, + "full_input": { + "tokens": 99, + "top_k": 6, + "decisions": 594, + "ordered_route_sha256": "88c0afd9f69ba9f1a9a20752e07ab1c98e8a0d569f579e38ba99e343c1758256", + "route_weight_sha256": "a2ec024b0c42402e71e0d830ac2646c0112faf69b63cd0249a5ac0f2f348b9a2", + "loads": [ + 13, + 15, + 4, + 5, + 5, + 14, + 0, + 6, + 8, + 2, + 13, + 16, + 3, + 12, + 0, + 7, + 5, + 7, + 5, + 16, + 4, + 5, + 5, + 5, + 4, + 4, + 0, + 30, + 32, + 5, + 3, + 5, + 5, + 3, + 22, + 17, + 5, + 15, + 6, + 5, + 3, + 13, + 7, + 0, + 4, + 7, + 16, + 21, + 14, + 1, + 8, + 13, + 8, + 3, + 4, + 10, + 45, + 31, + 14, + 9, + 11, + 1, + 7, + 8 + ], + "weighted_loads": [ + 0.75920145586133, + 1.194955714046955, + 0.39554598927497864, + 0.24936135113239288, + 0.43734393641352654, + 0.8875713832676411, + 0.0, + 0.4674845039844513, + 0.6309735365211964, + 0.11640571430325508, + 1.2597225904464722, + 1.162147842347622, + 0.08018577098846436, + 0.7398344073444605, + 0.0, + 0.2846432030200958, + 0.3198915645480156, + 0.26271576061844826, + 0.24575038626790047, + 1.6262581534683704, + 0.19639421999454498, + 0.23345579206943512, + 0.7001011576503515, + 0.4013504646718502, + 0.18181094899773598, + 0.24602752178907394, + 0.0, + 2.235746002756059, + 3.2504703737795353, + 0.22183174639940262, + 0.22764327004551888, + 0.18549004662781954, + 0.311413437128067, + 0.18776720762252808, + 1.4324389919638634, + 1.1350704915821552, + 0.5446099862456322, + 0.9913414679467678, + 0.3119930140674114, + 0.34098612517118454, + 0.15771650522947311, + 1.1155712604522705, + 0.33130259066820145, + 0.0, + 0.3167078709229827, + 0.7615143209695816, + 1.1141554452478886, + 1.5168664120137691, + 0.9911925196647644, + 0.04919162392616272, + 0.3687642179429531, + 0.7715771272778511, + 0.5536886304616928, + 0.12154421769082546, + 0.2064858004450798, + 0.7303991392254829, + 3.4274251870810986, + 1.6848290376365185, + 1.0928449966013432, + 0.4087204970419407, + 0.8565169088542461, + 0.03667278215289116, + 0.3399743605405092, + 0.6311374865472317 + ], + "unique_experts": 60, + "load_cv": 0.9093589827970536, + "normalized_load_entropy": 0.9154951868526043, + "max_load_share": 0.07575757575757576 + } + }, + "s1_bos": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "debaee16cde022da53da5c2d88ebf21f78629fa3c775521959855290513846c7", + "route_weight_sha256": "9fa7821cb235f8369d393aa2609964fa75b985ff284b3533e3bae7e22cec5770", + "loads": [ + 4, + 11, + 4, + 5, + 2, + 13, + 0, + 6, + 6, + 2, + 2, + 15, + 1, + 7, + 0, + 6, + 4, + 4, + 4, + 7, + 4, + 5, + 0, + 2, + 1, + 3, + 0, + 29, + 32, + 5, + 2, + 0, + 5, + 3, + 14, + 10, + 5, + 15, + 4, + 4, + 3, + 4, + 7, + 0, + 2, + 1, + 5, + 21, + 11, + 1, + 2, + 12, + 8, + 0, + 4, + 7, + 39, + 31, + 11, + 5, + 11, + 1, + 5, + 7 + ], + "weighted_loads": [ + 0.19132715091109276, + 0.9418966434895992, + 0.3937651924788952, + 0.24680658802390099, + 0.12680714577436447, + 0.8534758016467094, + 0.0, + 0.47379421815276146, + 0.5423546358942986, + 0.1171603873372078, + 0.08446728810667992, + 1.1226113513112068, + 0.036998361349105835, + 0.5260420739650726, + 0.0, + 0.2484297789633274, + 0.2822623699903488, + 0.14233918115496635, + 0.19778823107481003, + 0.7655319571495056, + 0.1997288390994072, + 0.24041523411870003, + 0.0, + 0.07682625949382782, + 0.050844524055719376, + 0.13340385630726814, + 0.0, + 2.222449619323015, + 3.2662166506052017, + 0.218678817152977, + 0.19061989337205887, + 0.0, + 0.29850561544299126, + 0.18927101790905, + 0.9817569181323051, + 0.6752967163920403, + 0.5787191987037659, + 0.9630471151322126, + 0.23014285787940025, + 0.28643084689974785, + 0.15899553149938583, + 0.19243014231324196, + 0.3258965350687504, + 0.0, + 0.08875505439937115, + 0.03269987925887108, + 0.24288680218160152, + 1.5228376127779484, + 0.7883619405329227, + 0.04829535260796547, + 0.07930757477879524, + 0.7538877055048943, + 0.5474774911999702, + 0.0, + 0.20052244141697884, + 0.5527038015425205, + 3.156430494040251, + 1.6702514123171568, + 0.9280416257679462, + 0.23599014058709145, + 0.8513246066868305, + 0.03400779888033867, + 0.29384371638298035, + 0.5801827870309353 + ], + "unique_experts": 57, + "load_cv": 1.1519912502260397, + "normalized_load_entropy": 0.8764609605432905, + "max_load_share": 0.08783783783783784 + }, + "full_input": { + "tokens": 115, + "top_k": 6, + "decisions": 690, + "ordered_route_sha256": "73faefe049ffa61d5a9fe6b9576df4f59f2b61305eca3c593a831763a715380a", + "route_weight_sha256": "0861f12fad5eb734cdb672ac2e23457c8dfb056cfd4674531271c81fbc6c5d19", + "loads": [ + 16, + 16, + 4, + 5, + 5, + 13, + 0, + 6, + 13, + 4, + 13, + 17, + 3, + 12, + 1, + 6, + 5, + 7, + 5, + 16, + 4, + 8, + 4, + 14, + 6, + 12, + 4, + 30, + 38, + 5, + 4, + 4, + 5, + 6, + 20, + 22, + 5, + 18, + 8, + 6, + 9, + 18, + 9, + 0, + 5, + 13, + 26, + 21, + 18, + 6, + 6, + 13, + 8, + 3, + 5, + 12, + 44, + 31, + 16, + 9, + 11, + 2, + 7, + 8 + ], + "weighted_loads": [ + 0.9930355660617352, + 1.2259118296205997, + 0.3937651924788952, + 0.24680658802390099, + 0.45530732721090317, + 0.8534758016467094, + 0.0, + 0.47379421815276146, + 0.9550377987325191, + 0.2080872468650341, + 1.171488557010889, + 1.2191570550203323, + 0.08454565517604351, + 0.7157054301351309, + 0.03864428400993347, + 0.2484297789633274, + 0.3284413330256939, + 0.28415317833423615, + 0.24479813501238823, + 1.7181902043521404, + 0.1997288390994072, + 0.36704274266958237, + 0.6583313308656216, + 0.9899780340492725, + 0.24218251183629036, + 0.6339262165129185, + 0.25352393835783005, + 2.2353728814050555, + 3.689973007887602, + 0.218678817152977, + 0.3281704857945442, + 0.13954942394047976, + 0.29850561544299126, + 0.41058242321014404, + 1.2825251892209053, + 1.4635643474757671, + 0.5787191987037659, + 1.1045637670904398, + 0.4252159781754017, + 0.4005866050720215, + 0.558562871068716, + 1.6393304951488972, + 0.41805924475193024, + 0.0, + 0.21887097600847483, + 1.250783532857895, + 2.019768314436078, + 1.5228376127779484, + 1.22454272210598, + 0.3781171999871731, + 0.2726950701326132, + 0.7869114242494106, + 0.5474774911999702, + 0.15342985093593597, + 0.2418888509273529, + 0.7882871050387621, + 3.3897695131599903, + 1.6702514123171568, + 1.2275063246488571, + 0.4206255078315735, + 0.8513246066868305, + 0.07149072736501694, + 0.45232218503952026, + 0.6162030696868896 + ], + "unique_experts": 62, + "load_cv": 0.810843337960272, + "normalized_load_entropy": 0.9310459877584288, + "max_load_share": 0.06376811594202898 + } + }, + "s0_x": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "b5dfad4d63f4c9d20c2748ed5b78ab24e87880de638eccd3ce69234a291b93d5", + "route_weight_sha256": "0b0cf2615ef664bdc7b34a3c3fafeec03cfdcaa8c7b0c913518c5473aa479f03", + "loads": [ + 8, + 12, + 5, + 8, + 2, + 14, + 0, + 6, + 6, + 2, + 2, + 16, + 1, + 7, + 0, + 8, + 3, + 3, + 4, + 7, + 3, + 4, + 1, + 1, + 1, + 4, + 0, + 28, + 32, + 4, + 2, + 0, + 5, + 3, + 14, + 10, + 5, + 14, + 4, + 4, + 3, + 3, + 6, + 0, + 2, + 1, + 4, + 21, + 11, + 1, + 1, + 12, + 9, + 0, + 4, + 4, + 40, + 29, + 11, + 6, + 10, + 2, + 4, + 7 + ], + "weighted_loads": [ + 0.34595391526818275, + 0.992250669747591, + 0.4218678530305624, + 0.34853190556168556, + 0.12299778312444687, + 0.8794101811945438, + 0.0, + 0.47516463324427605, + 0.5232967399060726, + 0.11680485308170319, + 0.08564863726496696, + 1.1314984820783138, + 0.03675156831741333, + 0.5005588047206402, + 0.0, + 0.3227848745882511, + 0.23109179735183716, + 0.10230527631938457, + 0.1905270256102085, + 0.7842727154493332, + 0.16423476859927177, + 0.19313859567046165, + 0.04429516941308975, + 0.03433192893862724, + 0.05457994341850281, + 0.157200675457716, + 0.0, + 2.1865872591733932, + 3.253680147230625, + 0.18514589592814445, + 0.1729809306561947, + 0.0, + 0.2822389043867588, + 0.1849370039999485, + 0.9382848329842091, + 0.6952388286590576, + 0.5492042079567909, + 0.950676541775465, + 0.23045532777905464, + 0.2845326289534569, + 0.15728295594453812, + 0.16049018129706383, + 0.28961119428277016, + 0.0, + 0.10383498668670654, + 0.034365180879831314, + 0.19969075918197632, + 1.502801787108183, + 0.8015176057815552, + 0.04624098166823387, + 0.047668490558862686, + 0.7269529961049557, + 0.5807732306420803, + 0.0, + 0.2059463933110237, + 0.46623923629522324, + 3.1745455488562584, + 1.642505344003439, + 0.9113579615950584, + 0.2819182984530926, + 0.7734145037829876, + 0.07303069531917572, + 0.24409307166934013, + 0.5981785729527473 + ], + "unique_experts": 58, + "load_cv": 1.149169639840612, + "normalized_load_entropy": 0.8764047594699707, + "max_load_share": 0.09009009009009009 + }, + "full_input": { + "tokens": 99, + "top_k": 6, + "decisions": 594, + "ordered_route_sha256": "30013945449f22859b5cf19905737220c77c7a5751d13e29d312cc71c08cd18b", + "route_weight_sha256": "f0ac43a27550443a9f5982a0dd776f9e9eeb7e8e6ccb87bb3397aa10fd07b347", + "loads": [ + 17, + 15, + 5, + 8, + 4, + 14, + 0, + 6, + 8, + 2, + 14, + 16, + 3, + 11, + 0, + 8, + 5, + 4, + 5, + 16, + 3, + 4, + 5, + 5, + 4, + 7, + 0, + 29, + 32, + 4, + 3, + 5, + 5, + 3, + 24, + 16, + 5, + 14, + 7, + 4, + 3, + 13, + 6, + 0, + 5, + 9, + 15, + 21, + 14, + 1, + 5, + 13, + 9, + 3, + 4, + 9, + 45, + 29, + 13, + 11, + 10, + 2, + 6, + 8 + ], + "weighted_loads": [ + 0.9954798817634583, + 1.1908230260014534, + 0.4218678530305624, + 0.34853190556168556, + 0.3702269196510315, + 0.8794101811945438, + 0.0, + 0.47516463324427605, + 0.620073027908802, + 0.11680485308170319, + 1.4124703295528889, + 1.1314984820783138, + 0.08261614292860031, + 0.6415302399545908, + 0.0, + 0.3227848745882511, + 0.30906788632273674, + 0.14472404681146145, + 0.24922649562358856, + 1.6495373472571373, + 0.16423476859927177, + 0.19313859567046165, + 0.7058956529945135, + 0.33320171386003494, + 0.1836932823061943, + 0.363073643296957, + 0.0, + 2.1995105212554336, + 3.253680147230625, + 0.18514589592814445, + 0.21287010237574577, + 0.18549004662781954, + 0.2822389043867588, + 0.1849370039999485, + 1.528462179005146, + 1.131715402007103, + 0.5492042079567909, + 0.950676541775465, + 0.35894354432821274, + 0.2845326289534569, + 0.15728295594453812, + 1.0954072959721088, + 0.28961119428277016, + 0.0, + 0.3674557013437152, + 0.6241137199103832, + 1.0225971937179565, + 1.502801787108183, + 1.0077158212661743, + 0.04624098166823387, + 0.2523559518158436, + 0.7605520971119404, + 0.5807732306420803, + 0.11833810992538929, + 0.2059463933110237, + 0.7105228789150715, + 3.415775366127491, + 1.642505344003439, + 1.046442523598671, + 0.496265210211277, + 0.7734145037829876, + 0.07303069531917572, + 0.2996575515717268, + 0.6344214491546154 + ], + "unique_experts": 60, + "load_cv": 0.903957322392968, + "normalized_load_entropy": 0.9159753419524541, + "max_load_share": 0.07575757575757576 + } + }, + "s1_x": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "6289d5354aacd45605829af6748ffc0969b719fb205e60d12621248d01795e1a", + "route_weight_sha256": "14437e52c1d313d64f45d973b4cf8ad756d2678e56e6c33833d7879df61f2382", + "loads": [ + 7, + 11, + 4, + 7, + 1, + 15, + 0, + 6, + 6, + 2, + 2, + 15, + 1, + 7, + 0, + 6, + 3, + 4, + 4, + 7, + 3, + 5, + 1, + 0, + 1, + 4, + 0, + 28, + 32, + 5, + 2, + 1, + 4, + 3, + 14, + 11, + 6, + 16, + 4, + 4, + 3, + 3, + 5, + 0, + 2, + 1, + 4, + 21, + 11, + 0, + 1, + 12, + 9, + 0, + 5, + 6, + 39, + 28, + 12, + 7, + 10, + 1, + 5, + 7 + ], + "weighted_loads": [ + 0.3201241195201874, + 0.9129520915448666, + 0.3999718129634857, + 0.3245012238621712, + 0.07513990998268127, + 0.9231736250221729, + 0.0, + 0.48423396050930023, + 0.5328009054064751, + 0.11657937243580818, + 0.08500400185585022, + 1.095924323424697, + 0.0383903793990612, + 0.5023755542933941, + 0.0, + 0.24665037170052528, + 0.23360227420926094, + 0.14643611386418343, + 0.19370121136307716, + 0.7757597155869007, + 0.164451252669096, + 0.23536177724599838, + 0.03857967257499695, + 0.0, + 0.04941471293568611, + 0.18250296264886856, + 0.0, + 2.169193495064974, + 3.164281629025936, + 0.2186857834458351, + 0.18992379680275917, + 0.03627846762537956, + 0.23452158644795418, + 0.1889738067984581, + 0.933213371783495, + 0.7222480401396751, + 0.6156204007565975, + 0.9900722168385983, + 0.2315855324268341, + 0.27615998312830925, + 0.16057955473661423, + 0.17834533751010895, + 0.2671351693570614, + 0.0, + 0.12119612097740173, + 0.03476396203041077, + 0.22760877758264542, + 1.5284487344324589, + 0.788563210517168, + 0.0, + 0.06336041539907455, + 0.7516433969140053, + 0.5675545148551464, + 0.0, + 0.2365790754556656, + 0.5041809305548668, + 3.1022261418402195, + 1.554854143410921, + 0.924938328564167, + 0.32528457418084145, + 0.7699227631092072, + 0.03312152251601219, + 0.29025543481111526, + 0.5705787166953087 + ], + "unique_experts": 57, + "load_cv": 1.1400935605643747, + "normalized_load_entropy": 0.8751502848378112, + "max_load_share": 0.08783783783783784 + }, + "full_input": { + "tokens": 115, + "top_k": 6, + "decisions": 690, + "ordered_route_sha256": "89d2cd955a46c25457d57f5412a2c001bbfa43a66d7da78592941d42a663add9", + "route_weight_sha256": "2aa3c872e9aaae0defe40a706e3022235c32d31d357c6bf17b04b203df2e6f12", + "loads": [ + 21, + 16, + 4, + 7, + 3, + 15, + 0, + 6, + 14, + 4, + 14, + 17, + 3, + 11, + 1, + 6, + 5, + 5, + 5, + 17, + 3, + 8, + 5, + 11, + 6, + 14, + 5, + 29, + 38, + 5, + 4, + 5, + 4, + 6, + 21, + 22, + 6, + 19, + 9, + 6, + 9, + 18, + 7, + 0, + 5, + 12, + 23, + 21, + 18, + 5, + 3, + 13, + 9, + 2, + 6, + 11, + 44, + 28, + 17, + 12, + 10, + 2, + 7, + 8 + ], + "weighted_loads": [ + 1.2619309350848198, + 1.1804584711790085, + 0.3999718129634857, + 0.3245012238621712, + 0.3400542065501213, + 0.9231736250221729, + 0.0, + 0.48423396050930023, + 0.9869265034794807, + 0.2075062319636345, + 1.334563486278057, + 1.1924700271338224, + 0.08593767322599888, + 0.6347658429294825, + 0.03864428400993347, + 0.24665037170052528, + 0.32038671150803566, + 0.20250577107071877, + 0.24218010529875755, + 1.7759803049266338, + 0.164451252669096, + 0.3619892857968807, + 0.6952908262610435, + 0.8638908006250858, + 0.2407527007162571, + 0.7394999377429485, + 0.300292007625103, + 2.182116757147014, + 3.5880379863083363, + 0.2186857834458351, + 0.3274743892252445, + 0.17582789156585932, + 0.23452158644795418, + 0.41028521209955215, + 1.2932508438825607, + 1.4702885821461678, + 0.6156204007565975, + 1.1315888687968254, + 0.47766876965761185, + 0.3869716264307499, + 0.5601468943059444, + 1.5700754933059216, + 0.35929787904024124, + 0.0, + 0.2513120425865054, + 0.9364778287708759, + 1.836766492575407, + 1.5284487344324589, + 1.2434336096048355, + 0.3298218473792076, + 0.1851900815963745, + 0.7846671156585217, + 0.5675545148551464, + 0.10022008419036865, + 0.27794548496603966, + 0.7392817307263613, + 3.335565160959959, + 1.554854143410921, + 1.2213213257491589, + 0.5649139881134033, + 0.7699227631092072, + 0.07060445100069046, + 0.4487339034676552, + 0.606598999351263 + ], + "unique_experts": 62, + "load_cv": 0.8091837911732417, + "normalized_load_entropy": 0.9297294486009361, + "max_load_share": 0.06376811594202898 + } + }, + "s0_period": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "f7c3d144461572155dfe9ecd46b7fd91db50b558b0dd2e313c179cd41523333f", + "route_weight_sha256": "7509cdbd3801e9605dfa6dbf490039d11e5ea35b76bbeea2d20b24cff54612cf", + "loads": [ + 8, + 12, + 5, + 7, + 2, + 14, + 0, + 6, + 6, + 2, + 2, + 15, + 1, + 7, + 0, + 7, + 3, + 3, + 4, + 7, + 4, + 5, + 1, + 1, + 1, + 3, + 0, + 28, + 31, + 4, + 2, + 0, + 5, + 3, + 13, + 10, + 5, + 14, + 5, + 4, + 3, + 4, + 6, + 0, + 2, + 0, + 4, + 21, + 11, + 1, + 1, + 12, + 9, + 0, + 5, + 5, + 39, + 30, + 12, + 6, + 10, + 1, + 5, + 7 + ], + "weighted_loads": [ + 0.35112059116363525, + 0.9795872457325459, + 0.4225305914878845, + 0.31063280440866947, + 0.1219528540968895, + 0.8842788673937321, + 0.0, + 0.4877017140388489, + 0.5360419303178787, + 0.11948754265904427, + 0.08238263428211212, + 1.1087995171546936, + 0.03664878010749817, + 0.5029030218720436, + 0.0, + 0.28440211340785027, + 0.23575104027986526, + 0.09922724403440952, + 0.195796150714159, + 0.7811368070542812, + 0.19540968909859657, + 0.23477398604154587, + 0.043460190296173096, + 0.03761744499206543, + 0.05619552358984947, + 0.12126271985471249, + 0.0, + 2.1752175390720367, + 3.2257461808621883, + 0.18551954627037048, + 0.17290741577744484, + 0.0, + 0.2823851741850376, + 0.1940142922103405, + 0.9178307577967644, + 0.6861119866371155, + 0.5410146936774254, + 0.9672286584973335, + 0.26963159814476967, + 0.2955978959798813, + 0.15915784239768982, + 0.18005514703691006, + 0.2936248183250427, + 0.0, + 0.10722170025110245, + 0.0, + 0.19369250535964966, + 1.530488297343254, + 0.7959878481924534, + 0.045825593173503876, + 0.04533568397164345, + 0.7376927696168423, + 0.582766268402338, + 0.0, + 0.24280793219804764, + 0.5098971277475357, + 3.154043346643448, + 1.6531468778848648, + 0.9430634342133999, + 0.2807157374918461, + 0.7873649783432484, + 0.03445596620440483, + 0.2796602938324213, + 0.5963054522871971 + ], + "unique_experts": 57, + "load_cv": 1.1349563708802377, + "normalized_load_entropy": 0.8771077963636237, + "max_load_share": 0.08783783783783784 + }, + "full_input": { + "tokens": 99, + "top_k": 6, + "decisions": 594, + "ordered_route_sha256": "e910e3a55f7024b3866211e14fb5ab070f7a8ae55c0089b02600606ca8174b0c", + "route_weight_sha256": "848a93b9fe3f2f15e88181f10f1083e796651c47a4dc316fe57a9aa122a4c322", + "loads": [ + 17, + 14, + 5, + 7, + 4, + 14, + 0, + 6, + 8, + 2, + 14, + 15, + 3, + 12, + 0, + 7, + 4, + 5, + 5, + 17, + 4, + 5, + 5, + 5, + 4, + 5, + 0, + 29, + 31, + 4, + 3, + 5, + 5, + 3, + 23, + 16, + 5, + 14, + 8, + 4, + 3, + 14, + 6, + 0, + 5, + 8, + 16, + 21, + 14, + 1, + 5, + 13, + 9, + 2, + 5, + 10, + 45, + 30, + 14, + 10, + 10, + 1, + 7, + 8 + ], + "weighted_loads": [ + 0.9859514385461807, + 1.1260295063257217, + 0.4225305914878845, + 0.31063280440866947, + 0.35982611030340195, + 0.8842788673937321, + 0.0, + 0.4877017140388489, + 0.6328182183206081, + 0.11948754265904427, + 1.353592075407505, + 1.1087995171546936, + 0.08251335471868515, + 0.6859619598835707, + 0.0, + 0.28440211340785027, + 0.276799950748682, + 0.1918254029005766, + 0.2528093606233597, + 1.6906402558088303, + 0.19540968909859657, + 0.23477398604154587, + 0.7060163412243128, + 0.36050907522439957, + 0.18530886247754097, + 0.27980594150722027, + 0.0, + 2.188140801154077, + 3.2257461808621883, + 0.18551954627037048, + 0.21279658749699593, + 0.18549004662781954, + 0.2823851741850376, + 0.1940142922103405, + 1.4696441479027271, + 1.11006910353899, + 0.5410146936774254, + 0.9672286584973335, + 0.3941042721271515, + 0.2955978959798813, + 0.15915784239768982, + 1.1274538394063711, + 0.2936248183250427, + 0.0, + 0.3708424149081111, + 0.589696116745472, + 1.1308208145201206, + 1.530488297343254, + 0.9935939237475395, + 0.045825593173503876, + 0.2479042187333107, + 0.771291870623827, + 0.582766268402338, + 0.07597984187304974, + 0.24280793219804764, + 0.7571090757846832, + 3.4334282614290714, + 1.6531468778848648, + 1.0774548910558224, + 0.4547812454402447, + 0.7873649783432484, + 0.03445596620440483, + 0.33522477373480797, + 0.6325483284890652 + ], + "unique_experts": 60, + "load_cv": 0.904157959364078, + "normalized_load_entropy": 0.9153462776525353, + "max_load_share": 0.07575757575757576 + } + }, + "s1_period": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "af9fb1810b4b93c05e3cc5294a4ddb97167660d680befae39efb05d801c9c110", + "route_weight_sha256": "a2440657c6734c51f5c472ee9a1ba45d3eb3ff3f86e94be5d5e1fc9b6e784872", + "loads": [ + 6, + 11, + 3, + 8, + 2, + 11, + 0, + 6, + 6, + 2, + 2, + 15, + 1, + 7, + 0, + 6, + 3, + 4, + 4, + 7, + 3, + 4, + 1, + 1, + 1, + 5, + 0, + 29, + 32, + 5, + 1, + 0, + 4, + 3, + 14, + 11, + 6, + 17, + 4, + 4, + 3, + 3, + 5, + 0, + 3, + 1, + 3, + 22, + 11, + 0, + 1, + 12, + 9, + 0, + 5, + 6, + 40, + 31, + 11, + 6, + 10, + 1, + 5, + 7 + ], + "weighted_loads": [ + 0.2739062123000622, + 0.9125401005148888, + 0.35873209312558174, + 0.34660886973142624, + 0.12124750763177872, + 0.7501972950994968, + 0.0, + 0.4834876134991646, + 0.5405276045203209, + 0.11832330375909805, + 0.08355627208948135, + 1.0996331796050072, + 0.03599401190876961, + 0.5088138952851295, + 0.0, + 0.24695223569869995, + 0.2303263023495674, + 0.15227435901761055, + 0.19258175045251846, + 0.7662769816815853, + 0.1623278297483921, + 0.19689655676484108, + 0.038473084568977356, + 0.03348155319690704, + 0.05060093477368355, + 0.20616663992404938, + 0.0, + 2.214468963444233, + 3.1855840049684048, + 0.2192867510020733, + 0.13676628470420837, + 0.0, + 0.23994920030236244, + 0.19244380667805672, + 0.9454464614391327, + 0.7274701409041882, + 0.6075411774218082, + 1.0412141177803278, + 0.23167526349425316, + 0.2807698994874954, + 0.1610986404120922, + 0.1552102230489254, + 0.25951918959617615, + 0.0, + 0.16854702681303024, + 0.03369859606027603, + 0.17187034711241722, + 1.574883572757244, + 0.788456629961729, + 0.0, + 0.053330451250076294, + 0.7435490526258945, + 0.5663842670619488, + 0.0, + 0.24002543836832047, + 0.5198315773159266, + 3.1249557193368673, + 1.6661859657615423, + 0.9014700800180435, + 0.2792290188372135, + 0.7818591743707657, + 0.03293522819876671, + 0.29110223054885864, + 0.5821413733065128 + ], + "unique_experts": 57, + "load_cv": 1.1740436015661337, + "normalized_load_entropy": 0.8713341662351725, + "max_load_share": 0.09009009009009009 + }, + "full_input": { + "tokens": 115, + "top_k": 6, + "decisions": 690, + "ordered_route_sha256": "cd68ed962d12b9c85a10262d6756a3fd4835736b17ac4a65097e93087cf8e366", + "route_weight_sha256": "93cfee1228109d6687ed1242a6f35263dbd293a50cc75cac62d3c2a2184ec13b", + "loads": [ + 19, + 16, + 3, + 8, + 4, + 11, + 0, + 6, + 13, + 4, + 14, + 17, + 3, + 12, + 1, + 6, + 4, + 6, + 5, + 16, + 3, + 7, + 5, + 13, + 6, + 15, + 4, + 30, + 38, + 5, + 3, + 4, + 4, + 6, + 20, + 23, + 6, + 20, + 9, + 5, + 9, + 18, + 7, + 0, + 6, + 11, + 25, + 22, + 18, + 5, + 3, + 13, + 9, + 3, + 6, + 11, + 46, + 31, + 16, + 10, + 10, + 2, + 7, + 8 + ], + "weighted_loads": [ + 1.1185388900339603, + 1.1713777370750904, + 0.35873209312558174, + 0.34660886973142624, + 0.3809902146458626, + 0.7501972950994968, + 0.0, + 0.4834876134991646, + 0.9532107673585415, + 0.20925016328692436, + 1.240037776529789, + 1.1961788833141327, + 0.08354130573570728, + 0.6789967771619558, + 0.03864428400993347, + 0.24695223569869995, + 0.2765052653849125, + 0.2603822536766529, + 0.2397981770336628, + 1.7189352288842201, + 0.1623278297483921, + 0.3235240653157234, + 0.7012530639767647, + 0.9323461540043354, + 0.24193892255425453, + 0.7650714255869389, + 0.25352393835783005, + 2.2273922255262733, + 3.609340362250805, + 0.2192867510020733, + 0.2743168771266937, + 0.13954942394047976, + 0.23994920030236244, + 0.41375521197915077, + 1.2462147325277328, + 1.5168012902140617, + 0.6075411774218082, + 1.182730769738555, + 0.4909672997891903, + 0.3480001837015152, + 0.5606659799814224, + 1.5874078646302223, + 0.351681899279356, + 0.0, + 0.2986629484221339, + 0.8552025146782398, + 2.0432210713624954, + 1.574883572757244, + 1.2349073626101017, + 0.3298218473792076, + 0.17487722262740135, + 0.7765727713704109, + 0.5663842670619488, + 0.149461317807436, + 0.28139184787869453, + 0.7569320797920227, + 3.399362215772271, + 1.6661859657615423, + 1.197384674102068, + 0.46386438608169556, + 0.7818591743707657, + 0.07041815668344498, + 0.44958069920539856, + 0.6181616559624672 + ], + "unique_experts": 62, + "load_cv": 0.8366273899556651, + "normalized_load_entropy": 0.9266284138714702, + "max_load_share": 0.06666666666666667 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 74, + "ordered_topk_exact_tokens": 52, + "set_exact_tokens": 59, + "mean_set_jaccard": 0.9420849420849422, + "mean_token_weighted_tv": 0.013301361805281124, + "aggregate_load_tv": 0.029279279279279292 + }, + "system_bos": { + "tokens": 74, + "ordered_topk_exact_tokens": 52, + "set_exact_tokens": 64, + "mean_set_jaccard": 0.9555984555984557, + "mean_token_weighted_tv": 0.013882149539485172, + "aggregate_load_tv": 0.01801801801801801 + }, + "system_x": { + "tokens": 74, + "ordered_topk_exact_tokens": 40, + "set_exact_tokens": 55, + "mean_set_jaccard": 0.9214929214929215, + "mean_token_weighted_tv": 0.021324457059538848, + "aggregate_load_tv": 0.033783783783783786 + }, + "system_period": { + "tokens": 74, + "ordered_topk_exact_tokens": 39, + "set_exact_tokens": 51, + "mean_set_jaccard": 0.9025096525096524, + "mean_token_weighted_tv": 0.02340881069618705, + "aggregate_load_tv": 0.042792792792792786 + }, + "bos_at_s0": { + "tokens": 74, + "ordered_topk_exact_tokens": 36, + "set_exact_tokens": 50, + "mean_set_jaccard": 0.9073359073359075, + "mean_token_weighted_tv": 0.024141830580963475, + "aggregate_load_tv": 0.04054054054054054 + }, + "bos_at_s1": { + "tokens": 74, + "ordered_topk_exact_tokens": 37, + "set_exact_tokens": 47, + "mean_set_jaccard": 0.8877091377091378, + "mean_token_weighted_tv": 0.027503315044718014, + "aggregate_load_tv": 0.04504504504504504 + }, + "x_at_s0": { + "tokens": 74, + "ordered_topk_exact_tokens": 27, + "set_exact_tokens": 44, + "mean_set_jaccard": 0.8812741312741313, + "mean_token_weighted_tv": 0.028036411612521153, + "aggregate_load_tv": 0.04729729729729729 + }, + "x_at_s1": { + "tokens": 74, + "ordered_topk_exact_tokens": 33, + "set_exact_tokens": 43, + "mean_set_jaccard": 0.8693693693693693, + "mean_token_weighted_tv": 0.03313202501551525, + "aggregate_load_tv": 0.04954954954954954 + }, + "period_at_s0": { + "tokens": 74, + "ordered_topk_exact_tokens": 28, + "set_exact_tokens": 45, + "mean_set_jaccard": 0.8851351351351353, + "mean_token_weighted_tv": 0.027668080997426767, + "aggregate_load_tv": 0.042792792792792786 + }, + "period_at_s1": { + "tokens": 74, + "ordered_topk_exact_tokens": 31, + "set_exact_tokens": 41, + "mean_set_jaccard": 0.8581081081081082, + "mean_token_weighted_tv": 0.03389331792808465, + "aggregate_load_tv": 0.0563063063063063 + } + } + }, + "layer_10": { + "layer": 10, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "a59cfb3d5c5ad5e2b15e0f3ddc2159543f06033505f16d7e70bfff97df9d462f", + "route_weight_sha256": "56e969ee21d2027c050c0f3bfe87033472b9a3d57c359d05441c305e7f9b4729", + "loads": [ + 5, + 0, + 0, + 12, + 5, + 7, + 5, + 21, + 1, + 6, + 11, + 12, + 2, + 2, + 2, + 0, + 6, + 2, + 2, + 9, + 0, + 34, + 16, + 2, + 7, + 4, + 9, + 0, + 11, + 10, + 6, + 12, + 3, + 11, + 9, + 4, + 0, + 3, + 18, + 8, + 3, + 1, + 6, + 43, + 2, + 6, + 1, + 4, + 4, + 4, + 0, + 2, + 8, + 8, + 3, + 7, + 1, + 19, + 6, + 1, + 9, + 5, + 8, + 16 + ], + "weighted_loads": [ + 0.22562631592154503, + 0.0, + 0.0, + 0.8011142164468765, + 0.6959120109677315, + 0.31435006856918335, + 0.26044638827443123, + 1.3430263362824917, + 0.027065394446253777, + 0.6779719665646553, + 0.8937867097556591, + 1.1005815528333187, + 0.10285727679729462, + 0.14094983786344528, + 0.1857714280486107, + 0.0, + 0.5194037444889545, + 0.09173793345689774, + 0.11177420988678932, + 0.5710938796401024, + 0.0, + 3.022152580320835, + 1.0497543290257454, + 0.0887652151286602, + 0.3491794168949127, + 0.40605828538537025, + 0.5129840895533562, + 0.0, + 0.43732981383800507, + 0.6967208608984947, + 0.343087837100029, + 0.6848952323198318, + 0.1796172931790352, + 0.5221712458878756, + 0.4931712634861469, + 0.2232215404510498, + 0.0, + 0.1838207207620144, + 1.1539465859532356, + 0.5485419891774654, + 0.20843173190951347, + 0.04052213579416275, + 0.36081302911043167, + 2.5186392851173878, + 0.09147942438721657, + 0.30427246540784836, + 0.03979136794805527, + 0.2949426397681236, + 0.20233827084302902, + 0.17509885504841805, + 0.0, + 0.16237671673297882, + 0.6393939554691315, + 0.45998863130807877, + 0.14442505687475204, + 0.4435972645878792, + 0.046012960374355316, + 1.809566993266344, + 0.38155603036284447, + 0.04588650166988373, + 0.5933934040367603, + 0.4158445931971073, + 0.4644881412386894, + 0.9587214328348637 + ], + "unique_experts": 57, + "load_cv": 1.0891217499371622, + "normalized_load_entropy": 0.8867799906935585, + "max_load_share": 0.09684684684684684 + }, + "full_input": { + "tokens": 99, + "top_k": 6, + "decisions": 594, + "ordered_route_sha256": "3243d77f1d51fb3da3250b49437fcc6c57c780d385dde3f1d19137913b4de978", + "route_weight_sha256": "7022ef0fd7899bd3061f3367533dfb7383685e29808eab43b2e076ab709be099", + "loads": [ + 6, + 1, + 2, + 12, + 5, + 7, + 5, + 25, + 1, + 8, + 13, + 13, + 3, + 5, + 4, + 0, + 6, + 4, + 9, + 12, + 4, + 36, + 17, + 2, + 7, + 6, + 9, + 7, + 12, + 11, + 10, + 13, + 3, + 18, + 10, + 5, + 0, + 4, + 18, + 8, + 3, + 10, + 10, + 45, + 6, + 8, + 7, + 7, + 4, + 6, + 3, + 7, + 8, + 9, + 3, + 15, + 1, + 25, + 6, + 14, + 14, + 18, + 8, + 16 + ], + "weighted_loads": [ + 0.2793775908648968, + 0.051285188645124435, + 0.019034215714782476, + 0.8011142164468765, + 0.6959120109677315, + 0.31435006856918335, + 0.26044638827443123, + 1.5167586654424667, + 0.027065394446253777, + 0.7025192771106958, + 0.9902189560234547, + 1.1486894637346268, + 0.13553180918097496, + 1.556126095354557, + 0.3315895088016987, + 0.0, + 0.5194037444889545, + 0.21554755046963692, + 0.49635977717116475, + 0.7225130684673786, + 0.16728679090738297, + 3.1059754602611065, + 1.0535168501082808, + 0.0887652151286602, + 0.3491794168949127, + 0.4695403706282377, + 0.5129840895533562, + 0.7941942811012268, + 0.4840698167681694, + 0.739397931843996, + 0.6944777481257915, + 0.6986407050862908, + 0.1796172931790352, + 0.8602572772651911, + 0.523025082424283, + 0.26032937318086624, + 0.0, + 0.22586092725396156, + 1.1539465859532356, + 0.5485419891774654, + 0.20843173190951347, + 0.9255834817886353, + 0.4743726486340165, + 2.616561956703663, + 0.3006468340754509, + 0.408781498670578, + 0.31021301448345184, + 0.4075078424066305, + 0.20233827084302902, + 0.2698996067047119, + 0.1320171244442463, + 0.42641250789165497, + 0.6393939554691315, + 0.5366896018385887, + 0.14442505687475204, + 1.0630690045654774, + 0.046012960374355316, + 2.157753687351942, + 0.38155603036284447, + 0.8751779869198799, + 0.9084185138344765, + 1.5640712268650532, + 0.4644881412386894, + 0.9587214328348637 + ], + "unique_experts": 62, + "load_cv": 0.8476226178568421, + "normalized_load_entropy": 0.928427256429692, + "max_load_share": 0.07575757575757576 + } + }, + "s1_eos": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "3e2de28790d634a5c35d74a9d56f24c0ddb77614e52cdf6d3e5feee3219e5098", + "route_weight_sha256": "f37f2c683e4342edb7cefe2af8f6fc4dce91d3abbdbf61ec2ded1f94105af1a3", + "loads": [ + 5, + 0, + 1, + 13, + 5, + 6, + 5, + 22, + 1, + 6, + 11, + 12, + 2, + 2, + 2, + 0, + 6, + 2, + 2, + 8, + 0, + 35, + 18, + 2, + 8, + 4, + 9, + 0, + 11, + 10, + 7, + 11, + 3, + 10, + 8, + 4, + 0, + 4, + 18, + 8, + 3, + 1, + 7, + 41, + 2, + 6, + 1, + 3, + 4, + 3, + 0, + 2, + 8, + 8, + 2, + 7, + 1, + 19, + 6, + 1, + 8, + 5, + 8, + 17 + ], + "weighted_loads": [ + 0.2323543019592762, + 0.0, + 0.03714480623602867, + 0.8590414226055145, + 0.6939409226179123, + 0.2627456709742546, + 0.2538139522075653, + 1.40337672829628, + 0.027302125468850136, + 0.6773791201412678, + 0.8954612463712692, + 1.1041526533663273, + 0.10704377293586731, + 0.14492209255695343, + 0.1903768628835678, + 0.0, + 0.5225753039121628, + 0.09212586283683777, + 0.11063406616449356, + 0.5324932001531124, + 0.0, + 3.0436874739825726, + 1.1396293882280588, + 0.08846332132816315, + 0.381915170699358, + 0.3970474675297737, + 0.5109105817973614, + 0.0, + 0.4393389131873846, + 0.7043241336941719, + 0.3876658156514168, + 0.643717173486948, + 0.17930801957845688, + 0.4967728666961193, + 0.462107140570879, + 0.21641384810209274, + 0.0, + 0.22617552988231182, + 1.1613080352544785, + 0.5562761947512627, + 0.21452027186751366, + 0.04326404258608818, + 0.4014058895409107, + 2.469815209507942, + 0.0903761014342308, + 0.3068894110620022, + 0.038971807807683945, + 0.25818322971463203, + 0.21151672676205635, + 0.13508785888552666, + 0.0, + 0.16418971866369247, + 0.6247740797698498, + 0.46947797015309334, + 0.10200687870383263, + 0.4277813211083412, + 0.048255808651447296, + 1.7736519984900951, + 0.39585939049720764, + 0.04620520398020744, + 0.5477000623941422, + 0.41863148659467697, + 0.4674980714917183, + 0.9703827425837517 + ], + "unique_experts": 58, + "load_cv": 1.0879287634766373, + "normalized_load_entropy": 0.8869737174162581, + "max_load_share": 0.09234234234234234 + }, + "full_input": { + "tokens": 115, + "top_k": 6, + "decisions": 690, + "ordered_route_sha256": "ab0375d4b2e4da97f0b4437f362b53948df3bd8aa04eb4e4c50d1868bc19bd75", + "route_weight_sha256": "7534958bb7cc8d577ab3ac6aeaa79da090ad741be0af4d68931202ca9c34f216", + "loads": [ + 6, + 1, + 3, + 13, + 10, + 6, + 5, + 24, + 1, + 8, + 13, + 15, + 6, + 4, + 5, + 0, + 6, + 6, + 8, + 9, + 1, + 37, + 19, + 2, + 9, + 7, + 10, + 21, + 11, + 13, + 18, + 12, + 8, + 26, + 10, + 6, + 3, + 7, + 19, + 8, + 4, + 16, + 11, + 43, + 5, + 11, + 7, + 6, + 12, + 6, + 4, + 16, + 9, + 11, + 2, + 20, + 2, + 25, + 6, + 19, + 18, + 16, + 8, + 17 + ], + "weighted_loads": [ + 0.28676342964172363, + 0.05079865828156471, + 0.05622443137690425, + 0.8590414226055145, + 0.9327454343438148, + 0.2627456709742546, + 0.2538139522075653, + 1.4873054921627045, + 0.027302125468850136, + 0.7024867665022612, + 0.9733353741466999, + 1.2768523171544075, + 0.3061102516949177, + 1.5202956646680832, + 0.4057912863790989, + 0.0, + 0.5225753039121628, + 0.32308580726385117, + 0.4775239722803235, + 0.5793431885540485, + 0.040737930685281754, + 3.128495991230011, + 1.1435345909558237, + 0.08846332132816315, + 0.4235930033028126, + 0.7230503484606743, + 0.552566409111023, + 1.3917465656995773, + 0.4393389131873846, + 0.8371180072426796, + 1.2379155606031418, + 0.657462646253407, + 0.6694768667221069, + 1.2870307303965092, + 0.6047344170510769, + 0.38029808178544044, + 0.11297727562487125, + 0.3543549831956625, + 1.198024693876505, + 0.5562761947512627, + 0.25702761858701706, + 1.2969929799437523, + 0.49935649428516626, + 2.537993399426341, + 0.2676839120686054, + 0.5677246078848839, + 0.36326978355646133, + 0.3638532254844904, + 0.8583336807787418, + 0.3033740743994713, + 0.2167796790599823, + 0.9827805906534195, + 0.6942065171897411, + 0.6307874843478203, + 0.10200687870383263, + 1.3601267635822296, + 0.12127996981143951, + 2.133407238870859, + 0.39585939049720764, + 1.2429890856146812, + 1.2607832625508308, + 1.4271922558546066, + 0.4674980714917183, + 0.9703827425837517 + ], + "unique_experts": 63, + "load_cv": 0.7584184120343239, + "normalized_load_entropy": 0.9374085405665495, + "max_load_share": 0.06231884057971015 + } + }, + "s0_bos": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "c25c2dec99ddac9bb6a9ce471cdaee2544b9965c8565b87c0e0e623555e13adf", + "route_weight_sha256": "54c53cc6e355b064bba14461767a8ad67ec1c2ca049b497e4f4c6c02ff90d1a5", + "loads": [ + 5, + 0, + 1, + 13, + 5, + 4, + 5, + 17, + 1, + 6, + 12, + 12, + 1, + 1, + 3, + 0, + 6, + 2, + 1, + 9, + 0, + 36, + 18, + 2, + 8, + 4, + 12, + 0, + 7, + 10, + 6, + 13, + 2, + 13, + 8, + 4, + 0, + 3, + 18, + 8, + 3, + 1, + 5, + 42, + 2, + 7, + 1, + 4, + 3, + 4, + 0, + 3, + 7, + 9, + 5, + 7, + 1, + 19, + 6, + 0, + 8, + 5, + 8, + 18 + ], + "weighted_loads": [ + 0.2242879942059517, + 0.0, + 0.03526616841554642, + 0.8551689013838768, + 0.7054684981703758, + 0.2007782869040966, + 0.26191452145576477, + 1.086677361279726, + 0.02708130143582821, + 0.6496957652270794, + 0.9234920293092728, + 1.1121482625603676, + 0.06686940044164658, + 0.09459207952022552, + 0.21886470913887024, + 0.0, + 0.5166244581341743, + 0.09862307831645012, + 0.05326813831925392, + 0.601499805226922, + 0.0, + 3.12422888353467, + 1.156546227633953, + 0.08850577473640442, + 0.3676711395382881, + 0.39558451250195503, + 0.6111886762082577, + 0.0, + 0.2959863021969795, + 0.7030459977686405, + 0.34112488850951195, + 0.7636127322912216, + 0.1479441225528717, + 0.6277723982930183, + 0.4556635767221451, + 0.2153322398662567, + 0.0, + 0.18797718361020088, + 1.1620541773736477, + 0.5734113492071629, + 0.21609492972493172, + 0.03986990451812744, + 0.3236391507089138, + 2.4000893142074347, + 0.09246531128883362, + 0.3602960854768753, + 0.040077049285173416, + 0.2935229763388634, + 0.16884304583072662, + 0.18292485550045967, + 0.0, + 0.18568621575832367, + 0.583903469145298, + 0.5144709385931492, + 0.2222222164273262, + 0.4210495315492153, + 0.050763390958309174, + 1.871408138424158, + 0.396344929933548, + 0.0, + 0.5464095026254654, + 0.4344686530530453, + 0.46076498180627823, + 1.105065256357193 + ], + "unique_experts": 57, + "load_cv": 1.1051010249304494, + "normalized_load_entropy": 0.8825155869052511, + "max_load_share": 0.0945945945945946 + }, + "full_input": { + "tokens": 99, + "top_k": 6, + "decisions": 594, + "ordered_route_sha256": "f3a2b91aa794359034c1264b69de46e8a419ab8d8e3f0b11ad13871dcbae072a", + "route_weight_sha256": "74d32d0445430a643e23e2799c7eb1ebb5426243134e58ed38c8062286b14888", + "loads": [ + 6, + 1, + 2, + 13, + 5, + 4, + 5, + 21, + 1, + 7, + 14, + 13, + 2, + 4, + 6, + 0, + 6, + 5, + 7, + 12, + 5, + 38, + 18, + 2, + 8, + 6, + 12, + 7, + 8, + 11, + 10, + 14, + 2, + 21, + 9, + 5, + 0, + 3, + 18, + 8, + 3, + 10, + 9, + 44, + 5, + 9, + 7, + 7, + 3, + 7, + 3, + 8, + 7, + 10, + 5, + 15, + 1, + 25, + 6, + 14, + 13, + 18, + 8, + 18 + ], + "weighted_loads": [ + 0.2611919976770878, + 0.04893742874264717, + 0.04935449454933405, + 0.8551689013838768, + 0.7054684981703758, + 0.2007782869040966, + 0.26191452145576477, + 1.260409690439701, + 0.02708130143582821, + 0.6659630220383406, + 1.0199242755770683, + 1.1602561734616756, + 0.09954393282532692, + 0.6421241872012615, + 0.4242294430732727, + 0.0, + 0.5166244581341743, + 0.27464964613318443, + 0.4555661529302597, + 0.7504580896347761, + 0.24101365357637405, + 3.2080517634749413, + 1.156546227633953, + 0.08850577473640442, + 0.3676711395382881, + 0.4590665977448225, + 0.6111886762082577, + 0.877275824546814, + 0.34272630512714386, + 0.7457230687141418, + 0.6901401951909065, + 0.7773582050576806, + 0.1479441225528717, + 1.0015485435724258, + 0.4855173956602812, + 0.25244007259607315, + 0.0, + 0.18797718361020088, + 1.1620541773736477, + 0.5734113492071629, + 0.21609492972493172, + 1.1113086566329002, + 0.48026842810213566, + 2.4980119857937098, + 0.289566982537508, + 0.46480511873960495, + 0.31049869582057, + 0.4100694861263037, + 0.16884304583072662, + 0.3530314303934574, + 0.1305965967476368, + 0.42480092495679855, + 0.583903469145298, + 0.5929275862872601, + 0.2222222164273262, + 1.0671413093805313, + 0.050763390958309174, + 2.219594832509756, + 0.396344929933548, + 0.873104628175497, + 0.8679931573569775, + 1.6164186112582684, + 0.46076498180627823, + 1.105065256357193 + ], + "unique_experts": 62, + "load_cv": 0.8567750098859682, + "normalized_load_entropy": 0.9262897319056497, + "max_load_share": 0.07407407407407407 + } + }, + "s1_bos": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "9e789cc138e37d25fe66a8a8e3edfe873b051bc2b915ddf50fa5b3a5da69f937", + "route_weight_sha256": "8bfb995816e51eac7e357d84fd0fe87f3868228f1a0d5210b16221cb82a22c81", + "loads": [ + 6, + 0, + 0, + 15, + 5, + 5, + 4, + 15, + 1, + 8, + 12, + 13, + 1, + 2, + 2, + 0, + 6, + 2, + 1, + 6, + 0, + 37, + 19, + 2, + 8, + 5, + 11, + 0, + 6, + 10, + 6, + 13, + 2, + 13, + 8, + 4, + 0, + 4, + 19, + 7, + 3, + 1, + 5, + 40, + 2, + 6, + 1, + 4, + 3, + 4, + 0, + 3, + 7, + 9, + 5, + 7, + 1, + 18, + 6, + 0, + 9, + 5, + 8, + 19 + ], + "weighted_loads": [ + 0.26555285416543484, + 0.0, + 0.0, + 0.9477229602634907, + 0.7117028534412384, + 0.23846597597002983, + 0.2250356562435627, + 1.027010701596737, + 0.028247302398085594, + 0.774243351072073, + 0.92978735268116, + 1.1488116197288036, + 0.07173340022563934, + 0.13253386318683624, + 0.19138351827859879, + 0.0, + 0.5168916322290897, + 0.09734899923205376, + 0.057466208934783936, + 0.47354457527399063, + 0.0, + 3.088505830615759, + 1.1956564150750637, + 0.08502325043082237, + 0.3717678226530552, + 0.4264002665877342, + 0.5751641280949116, + 0.0, + 0.26778727397322655, + 0.7132795080542564, + 0.3437854163348675, + 0.7512034699320793, + 0.14337345212697983, + 0.6380050349980593, + 0.452927079051733, + 0.2169925533235073, + 0.0, + 0.2279360555112362, + 1.2137418240308762, + 0.5310387462377548, + 0.22321775183081627, + 0.03805641084909439, + 0.3126708082854748, + 2.24444642663002, + 0.0925254300236702, + 0.34437817335128784, + 0.0394662544131279, + 0.27771472185850143, + 0.1693318635225296, + 0.17743627727031708, + 0.0, + 0.19102000072598457, + 0.5948331020772457, + 0.5300216190516949, + 0.22481445223093033, + 0.44030480831861496, + 0.0500793382525444, + 1.8093921393156052, + 0.4036627598106861, + 0.0, + 0.5871918201446533, + 0.4119071550667286, + 0.4622107036411762, + 1.0716123525053263 + ], + "unique_experts": 56, + "load_cv": 1.0992098600223819, + "normalized_load_entropy": 0.8819755062434566, + "max_load_share": 0.09009009009009009 + }, + "full_input": { + "tokens": 115, + "top_k": 6, + "decisions": 690, + "ordered_route_sha256": "3893bd271ee42e9f7cbb4056bee1c488b96005ad9d9f451009a45c624e224ceb", + "route_weight_sha256": "3ec37cd75d22454a57ba558bb4041bf3d72dbff3400498b560b7257a1724f1ba", + "loads": [ + 6, + 1, + 1, + 15, + 10, + 5, + 4, + 17, + 1, + 9, + 14, + 16, + 5, + 4, + 6, + 0, + 6, + 6, + 6, + 8, + 2, + 39, + 19, + 2, + 9, + 8, + 12, + 21, + 6, + 13, + 16, + 14, + 7, + 30, + 10, + 6, + 3, + 7, + 20, + 7, + 4, + 17, + 7, + 42, + 5, + 11, + 7, + 7, + 11, + 8, + 4, + 17, + 8, + 12, + 5, + 20, + 2, + 24, + 6, + 20, + 19, + 16, + 8, + 19 + ], + "weighted_loads": [ + 0.26555285416543484, + 0.04364508390426636, + 0.014088326133787632, + 0.9477229602634907, + 0.950507365167141, + 0.23846597597002983, + 0.2250356562435627, + 1.1109394654631615, + 0.028247302398085594, + 0.7905106078833342, + 1.0076614804565907, + 1.3215112835168839, + 0.2707998789846897, + 0.6416739635169506, + 0.46955811232328415, + 0.0, + 0.5168916322290897, + 0.32982243970036507, + 0.4580311216413975, + 0.5659716948866844, + 0.09377888962626457, + 3.1733143478631973, + 1.1956564150750637, + 0.08502325043082237, + 0.4134456552565098, + 0.7524031475186348, + 0.6168199554085732, + 1.4623963534832, + 0.26778727397322655, + 0.8460733816027641, + 1.1435044780373573, + 0.7649489426985383, + 0.6335422992706299, + 1.469032296910882, + 0.5955543555319309, + 0.380876787006855, + 0.11297727562487125, + 0.3497414141893387, + 1.2504584826529026, + 0.5310387462377548, + 0.26572509855031967, + 1.58061121404171, + 0.3585414197295904, + 2.312624616548419, + 0.30871106684207916, + 0.6052133701741695, + 0.3637642301619053, + 0.3866663184016943, + 0.8161488175392151, + 0.41192152723670006, + 0.21352629736065865, + 0.9807969890534878, + 0.6642655394971371, + 0.6959428451955318, + 0.22481445223093033, + 1.4182058162987232, + 0.12310349941253662, + 2.169147379696369, + 0.4036627598106861, + 1.304297897964716, + 1.3097274005413055, + 1.4479804001748562, + 0.4622107036411762, + 1.0716123525053263 + ], + "unique_experts": 63, + "load_cv": 0.7733374616929112, + "normalized_load_entropy": 0.9354763823502689, + "max_load_share": 0.06086956521739131 + } + }, + "s0_x": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "6467a141c9762c30b792a3e243ce40943c4c84064bb9899ef24a064756cd155c", + "route_weight_sha256": "6aaecfb7ead5c94cf6cd65928406989a88564c6f619444bfb9efb0ac2f6922c3", + "loads": [ + 5, + 0, + 1, + 13, + 5, + 7, + 6, + 16, + 0, + 6, + 12, + 12, + 1, + 1, + 3, + 0, + 6, + 2, + 2, + 9, + 0, + 37, + 15, + 2, + 8, + 4, + 9, + 0, + 7, + 10, + 6, + 13, + 2, + 15, + 8, + 4, + 0, + 3, + 18, + 7, + 3, + 0, + 6, + 43, + 2, + 6, + 1, + 4, + 4, + 5, + 0, + 3, + 7, + 9, + 3, + 7, + 1, + 19, + 6, + 0, + 9, + 5, + 9, + 17 + ], + "weighted_loads": [ + 0.22411343827843666, + 0.0, + 0.03732334077358246, + 0.8495419546961784, + 0.7027959525585175, + 0.3156011886894703, + 0.30283215641975403, + 1.0202611759305, + 0.0, + 0.66553645581007, + 0.9297601468861103, + 1.1216285564005375, + 0.06792294979095459, + 0.0947122648358345, + 0.21390672028064728, + 0.0, + 0.5316273719072342, + 0.09564253687858582, + 0.10299390181899071, + 0.5606742538511753, + 0.0, + 3.175116680562496, + 1.0381923392415047, + 0.0915512889623642, + 0.3709249086678028, + 0.3867526687681675, + 0.5025247819721699, + 0.0, + 0.28585484623908997, + 0.7032125815749168, + 0.342561699450016, + 0.7477261163294315, + 0.1422533430159092, + 0.7151084151118994, + 0.45478714257478714, + 0.21816399693489075, + 0.0, + 0.19757525995373726, + 1.1584818065166473, + 0.5280302874743938, + 0.22235258296132088, + 0.0, + 0.34962158277630806, + 2.365372758358717, + 0.0935649424791336, + 0.30205996334552765, + 0.03859734162688255, + 0.2887501195073128, + 0.19319451041519642, + 0.22392113134264946, + 0.0, + 0.18049120157957077, + 0.586001131683588, + 0.5188325121998787, + 0.1401631459593773, + 0.4388686530292034, + 0.051369693130254745, + 1.8724807500839233, + 0.39365072920918465, + 0.0, + 0.5944283530116081, + 0.4039177931845188, + 0.514825988560915, + 1.0508664213120937 + ], + "unique_experts": 55, + "load_cv": 1.1118372758969812, + "normalized_load_entropy": 0.8810147677606838, + "max_load_share": 0.09684684684684684 + }, + "full_input": { + "tokens": 99, + "top_k": 6, + "decisions": 594, + "ordered_route_sha256": "0b5a01e78950abba5499fed6e21ca653440fc20f75ce141434fd98658de04b6a", + "route_weight_sha256": "fb3725da7a2dc3b1792fd3b2a7b40ee711d407866e710be95bcb42c101bb2129", + "loads": [ + 6, + 1, + 2, + 13, + 5, + 7, + 6, + 21, + 0, + 7, + 14, + 13, + 2, + 3, + 5, + 0, + 6, + 6, + 7, + 13, + 4, + 39, + 15, + 2, + 8, + 6, + 9, + 5, + 8, + 11, + 10, + 14, + 2, + 23, + 9, + 5, + 0, + 4, + 18, + 7, + 3, + 8, + 9, + 45, + 6, + 9, + 8, + 8, + 4, + 7, + 3, + 8, + 7, + 10, + 3, + 15, + 1, + 26, + 6, + 13, + 14, + 19, + 9, + 17 + ], + "weighted_loads": [ + 0.27971455827355385, + 0.0545349046587944, + 0.05141166690737009, + 0.8495419546961784, + 0.7027959525585175, + 0.3156011886894703, + 0.30283215641975403, + 1.233619924634695, + 0.0, + 0.6818037126213312, + 1.0261923931539059, + 1.1697364673018456, + 0.10059748217463493, + 0.5986989662051201, + 0.3632107079029083, + 0.0, + 0.5316273719072342, + 0.32572856545448303, + 0.44132059812545776, + 0.7569703683257103, + 0.16728679090738297, + 3.2589395605027676, + 1.0381923392415047, + 0.0915512889623642, + 0.3709249086678028, + 0.45023475401103497, + 0.5025247819721699, + 0.7060014270246029, + 0.3325948491692543, + 0.7458896525204182, + 0.6738599948585033, + 0.7614715890958905, + 0.1422533430159092, + 1.1021416541188955, + 0.48464096151292324, + 0.2552718296647072, + 0.0, + 0.25297489389777184, + 1.1584818065166473, + 0.5280302874743938, + 0.22235258296132088, + 0.8018514141440392, + 0.455075291916728, + 2.463295429944992, + 0.30699264630675316, + 0.4768301919102669, + 0.3594251908361912, + 0.43612887151539326, + 0.19319451041519642, + 0.31736264005303383, + 0.13277617841959, + 0.45877040177583694, + 0.586001131683588, + 0.599905364215374, + 0.1401631459593773, + 1.0629403069615364, + 0.051369693130254745, + 2.282624214887619, + 0.39365072920918465, + 0.8257666118443012, + 0.9226225577294827, + 1.621941763907671, + 0.514825988560915, + 1.0508664213120937 + ], + "unique_experts": 61, + "load_cv": 0.8754144003904542, + "normalized_load_entropy": 0.9235915962105586, + "max_load_share": 0.07575757575757576 + } + }, + "s1_x": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "2199985be72d818ff1c19a3373688c3a2902b9a638c7e6648e8be84c9829f1e0", + "route_weight_sha256": "b7a2f115f45b2a8c148a3ceefea9ef296051c44dd2f3f5aadc3109c7f8d286e1", + "loads": [ + 6, + 0, + 0, + 14, + 5, + 6, + 4, + 16, + 0, + 7, + 12, + 12, + 1, + 1, + 2, + 0, + 6, + 3, + 2, + 6, + 0, + 37, + 18, + 2, + 8, + 4, + 11, + 0, + 8, + 10, + 6, + 13, + 2, + 15, + 8, + 4, + 0, + 3, + 19, + 7, + 3, + 1, + 4, + 37, + 2, + 7, + 1, + 4, + 4, + 3, + 0, + 3, + 8, + 10, + 6, + 8, + 1, + 18, + 6, + 0, + 9, + 5, + 8, + 18 + ], + "weighted_loads": [ + 0.2670950945466757, + 0.0, + 0.0, + 0.9075715057551861, + 0.6931727081537247, + 0.2613834962248802, + 0.22667795792222023, + 1.0256721749901772, + 0.0, + 0.7445915192365646, + 0.9223310686647892, + 1.0941906832158566, + 0.06844577193260193, + 0.09732784330844879, + 0.1777774542570114, + 0.0, + 0.5375740714371204, + 0.13971032574772835, + 0.09341131895780563, + 0.43513597920536995, + 0.0, + 3.0880603156983852, + 1.2117351591587067, + 0.08612191677093506, + 0.3693357892334461, + 0.39013003557920456, + 0.5789413377642632, + 0.0, + 0.33640240877866745, + 0.7112874388694763, + 0.3424711525440216, + 0.7362145185470581, + 0.14024878665804863, + 0.7033419106155634, + 0.451246902346611, + 0.21908463910222054, + 0.0, + 0.18835506588220596, + 1.2235054858028889, + 0.5226558409631252, + 0.22446003556251526, + 0.06721162050962448, + 0.2624530680477619, + 1.993508379906416, + 0.09473438933491707, + 0.36991516314446926, + 0.0375666469335556, + 0.27225771732628345, + 0.1978931538760662, + 0.12585457786917686, + 0.0, + 0.19303185120224953, + 0.6426224075257778, + 0.5661674663424492, + 0.25722772628068924, + 0.5281185060739517, + 0.04710667207837105, + 1.7990999221801758, + 0.4005850702524185, + 0.0, + 0.6124881766736507, + 0.3915659226477146, + 0.47036832198500633, + 1.0036846790462732 + ], + "unique_experts": 55, + "load_cv": 1.069874346642675, + "normalized_load_entropy": 0.8835379680948154, + "max_load_share": 0.08333333333333333 + }, + "full_input": { + "tokens": 115, + "top_k": 6, + "decisions": 690, + "ordered_route_sha256": "d2bfda6be2bcc723dcbd92bb46e7764f8520872253d305c7c3d36fad34059465", + "route_weight_sha256": "d92b035bf52047f7a32cb23d88f7bd4bf4505b83a0207c609f9b92bed191c4da", + "loads": [ + 7, + 1, + 1, + 14, + 10, + 6, + 4, + 19, + 0, + 8, + 15, + 15, + 5, + 2, + 6, + 0, + 6, + 8, + 6, + 7, + 1, + 39, + 18, + 2, + 9, + 7, + 12, + 18, + 8, + 13, + 17, + 14, + 7, + 32, + 10, + 6, + 3, + 6, + 20, + 7, + 4, + 17, + 7, + 39, + 4, + 13, + 8, + 8, + 12, + 6, + 5, + 17, + 9, + 12, + 6, + 20, + 2, + 25, + 6, + 19, + 19, + 17, + 8, + 18 + ], + "weighted_loads": [ + 0.3178050685673952, + 0.05944541469216347, + 0.014088326133787632, + 0.9075715057551861, + 0.9319772198796272, + 0.2613834962248802, + 0.22667795792222023, + 1.1599851213395596, + 0.0, + 0.7608587760478258, + 1.04980980604887, + 1.2668903470039368, + 0.2675122506916523, + 0.5666375011205673, + 0.4539531245827675, + 0.0, + 0.5375740714371204, + 0.4216693639755249, + 0.42017338797450066, + 0.47328895330429077, + 0.040737930685281754, + 3.1728688329458237, + 1.2117351591587067, + 0.08612191677093506, + 0.4110136218369007, + 0.7161329165101051, + 0.6205971650779247, + 1.2752561308443546, + 0.33640240877866745, + 0.844081312417984, + 1.160999096930027, + 0.7499599913135171, + 0.6304176338016987, + 1.547274762764573, + 0.5938741788268089, + 0.38296887278556824, + 0.11297727562487125, + 0.31999603286385536, + 1.2602221444249153, + 0.5226558409631252, + 0.26696738228201866, + 1.3371986709535122, + 0.3439192119985819, + 2.061686569824815, + 0.23835785314440727, + 0.6935226116329432, + 0.43002645298838615, + 0.4207420200109482, + 0.8447101078927517, + 0.3003212884068489, + 0.26195573806762695, + 1.015156913548708, + 0.7120548449456692, + 0.6871109195053577, + 0.25722772628068924, + 1.4011796079576015, + 0.12013083323836327, + 2.2111521661281586, + 0.4005850702524185, + 1.2409332022070885, + 1.3447249121963978, + 1.475061323493719, + 0.47036832198500633, + 1.0036846790462732 + ], + "unique_experts": 62, + "load_cv": 0.7656509531520168, + "normalized_load_entropy": 0.934413301199348, + "max_load_share": 0.05652173913043478 + } + }, + "s0_period": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "9d75c1a1ec739e973834d8bbc7850a785dc326d3b8fc6c5d5d527b7537fd4571", + "route_weight_sha256": "25aecd375322ea0ef08047fb7f60c55d0495498ba3677f977933995e8a155925", + "loads": [ + 5, + 0, + 1, + 14, + 5, + 6, + 5, + 16, + 0, + 6, + 12, + 12, + 1, + 1, + 2, + 0, + 6, + 3, + 3, + 7, + 0, + 37, + 20, + 2, + 8, + 4, + 9, + 0, + 6, + 10, + 5, + 13, + 2, + 12, + 8, + 4, + 0, + 4, + 19, + 7, + 3, + 0, + 5, + 41, + 2, + 7, + 1, + 4, + 5, + 5, + 0, + 3, + 7, + 9, + 4, + 7, + 1, + 18, + 6, + 0, + 8, + 5, + 9, + 19 + ], + "weighted_loads": [ + 0.2344776727259159, + 0.0, + 0.036400292068719864, + 0.9033640250563622, + 0.7214158549904823, + 0.2778918333351612, + 0.2600976824760437, + 1.022599559277296, + 0.0, + 0.6996498890221119, + 0.9415992721915245, + 1.1166535131633282, + 0.06829952448606491, + 0.09503933042287827, + 0.1827424317598343, + 0.0, + 0.5419905856251717, + 0.14758744090795517, + 0.14076612144708633, + 0.47971511259675026, + 0.0, + 3.1918105520308018, + 1.2564880959689617, + 0.09006313979625702, + 0.38014598190784454, + 0.39340877905488014, + 0.5011895447969437, + 0.0, + 0.24550064653158188, + 0.7008582502603531, + 0.2876366674900055, + 0.7562060244381428, + 0.1424611359834671, + 0.5885139666497707, + 0.44947265088558197, + 0.22031023353338242, + 0.0, + 0.22492816671729088, + 1.1986151486635208, + 0.5457096435129642, + 0.2273164875805378, + 0.0, + 0.31187591701745987, + 2.2379497289657593, + 0.09437005966901779, + 0.3498736284673214, + 0.03884930536150932, + 0.2972794398665428, + 0.2316121980547905, + 0.22494949027895927, + 0.0, + 0.1883053034543991, + 0.5862401872873306, + 0.510754719376564, + 0.1828879602253437, + 0.42052270844578743, + 0.051515981554985046, + 1.8547791428864002, + 0.39825889095664024, + 0.0, + 0.5469215884804726, + 0.41475681215524673, + 0.511198952794075, + 1.1192562654614449 + ], + "unique_experts": 55, + "load_cv": 1.105688415058926, + "normalized_load_entropy": 0.8815372440506952, + "max_load_share": 0.09234234234234234 + }, + "full_input": { + "tokens": 99, + "top_k": 6, + "decisions": 594, + "ordered_route_sha256": "91bc02f602dbb644dd8e367f7eb5a22ed7ce4c8f071a25e4c0a02d312d58fb33", + "route_weight_sha256": "233e09c585414338df015798f847df5fa05849a60aedf30d41247339bce6e522", + "loads": [ + 6, + 1, + 2, + 14, + 5, + 6, + 5, + 20, + 0, + 7, + 14, + 13, + 3, + 3, + 4, + 0, + 6, + 6, + 8, + 10, + 4, + 39, + 20, + 2, + 8, + 6, + 9, + 6, + 7, + 11, + 11, + 14, + 2, + 19, + 9, + 5, + 0, + 5, + 19, + 7, + 3, + 9, + 8, + 43, + 5, + 10, + 7, + 7, + 5, + 8, + 3, + 9, + 7, + 10, + 4, + 15, + 1, + 25, + 6, + 13, + 14, + 18, + 9, + 19 + ], + "weighted_loads": [ + 0.29248159378767014, + 0.043646879494190216, + 0.050488618202507496, + 0.9033640250563622, + 0.7214158549904823, + 0.2778918333351612, + 0.2600976824760437, + 1.1963318884372711, + 0.0, + 0.7159171458333731, + 1.03803151845932, + 1.1647614240646362, + 0.13820049166679382, + 0.5990260317921638, + 0.32684148475527763, + 0.0, + 0.5419905856251717, + 0.3551556468009949, + 0.4790928177535534, + 0.6374894753098488, + 0.16728679090738297, + 3.275633431971073, + 1.2564880959689617, + 0.09006313979625702, + 0.38014598190784454, + 0.4568908642977476, + 0.5011895447969437, + 0.7353137619793415, + 0.2922406494617462, + 0.7435353212058544, + 0.7296111732721329, + 0.7699514972046018, + 0.1424611359834671, + 0.9265999980270863, + 0.47932646982371807, + 0.25741806626319885, + 0.0, + 0.27993762493133545, + 1.1986151486635208, + 0.5457096435129642, + 0.2273164875805378, + 0.8738411292433739, + 0.41732962615787983, + 2.3358724005520344, + 0.26055628806352615, + 0.4966362565755844, + 0.3092709518969059, + 0.4072296302765608, + 0.2316121980547905, + 0.36918166652321815, + 0.13151955977082253, + 0.5394582785665989, + 0.5862401872873306, + 0.5904690623283386, + 0.1828879602253437, + 1.0519125312566757, + 0.051515981554985046, + 2.277121525257826, + 0.39825889095664024, + 0.840874221175909, + 0.9245729222893715, + 1.5627565830945969, + 0.511198952794075, + 1.1192562654614449 + ], + "unique_experts": 61, + "load_cv": 0.855291759664652, + "normalized_load_entropy": 0.9259506410104318, + "max_load_share": 0.0723905723905724 + } + }, + "s1_period": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "25fa3a19f0dfa63178769b25b3b9baed2ec0ab1b48749c7943cc195c1d9cfa34", + "route_weight_sha256": "80df9ab89dfbae790d7847cd8ad099b834dbce2c2e2dbfb45e39a9af91521de3", + "loads": [ + 6, + 0, + 0, + 14, + 5, + 6, + 5, + 16, + 0, + 8, + 12, + 12, + 1, + 1, + 2, + 0, + 6, + 2, + 1, + 7, + 0, + 37, + 18, + 2, + 8, + 4, + 11, + 0, + 6, + 10, + 4, + 13, + 2, + 16, + 8, + 4, + 0, + 3, + 19, + 7, + 3, + 1, + 5, + 39, + 2, + 8, + 1, + 4, + 3, + 3, + 0, + 3, + 8, + 9, + 6, + 7, + 1, + 18, + 6, + 0, + 10, + 5, + 8, + 18 + ], + "weighted_loads": [ + 0.27865996584296227, + 0.0, + 0.0, + 0.9258320070803165, + 0.7097810059785843, + 0.25822605937719345, + 0.26086609810590744, + 1.0345912482589483, + 0.0, + 0.7701555788516998, + 0.9491643570363522, + 1.0902546159923077, + 0.06659156829118729, + 0.10047625005245209, + 0.18194469809532166, + 0.0, + 0.5434495620429516, + 0.09870082885026932, + 0.054043158888816833, + 0.4977170526981354, + 0.0, + 3.089814279228449, + 1.1989814676344395, + 0.08132079616189003, + 0.3762313984334469, + 0.38742348924279213, + 0.5760954357683659, + 0.0, + 0.2593260854482651, + 0.7108946554362774, + 0.25143764540553093, + 0.7390280999243259, + 0.13561919331550598, + 0.7472670115530491, + 0.4605698511004448, + 0.2231443040072918, + 0.0, + 0.19029518216848373, + 1.2444874346256256, + 0.5190278142690659, + 0.22062432020902634, + 0.0620507188141346, + 0.3028378337621689, + 2.0941211991012096, + 0.0944223441183567, + 0.4120372850447893, + 0.03732618689537048, + 0.27203307673335075, + 0.16706731170415878, + 0.13110702484846115, + 0.0, + 0.19801875576376915, + 0.6560820043087006, + 0.5319724790751934, + 0.2585792765021324, + 0.4462107941508293, + 0.04680177941918373, + 1.7949263826012611, + 0.40181180462241173, + 0.0, + 0.6478121168911457, + 0.39846182242035866, + 0.46628860756754875, + 1.0043446496129036 + ], + "unique_experts": 55, + "load_cv": 1.0947706824588863, + "normalized_load_entropy": 0.8796013843794342, + "max_load_share": 0.08783783783783784 + }, + "full_input": { + "tokens": 115, + "top_k": 6, + "decisions": 690, + "ordered_route_sha256": "a48ce22c151d1045c1dcbb86b12fa18aec7f5fa4aa2eb634e4a5115072f95546", + "route_weight_sha256": "5f08937be152bab198f0195014b5685919f8b5a5e1c12630ee1ffc2766090b70", + "loads": [ + 8, + 1, + 1, + 15, + 10, + 6, + 5, + 18, + 0, + 9, + 14, + 15, + 5, + 2, + 6, + 0, + 6, + 7, + 5, + 9, + 1, + 39, + 18, + 2, + 9, + 7, + 12, + 18, + 6, + 13, + 16, + 14, + 7, + 32, + 10, + 6, + 3, + 6, + 20, + 7, + 4, + 16, + 8, + 41, + 4, + 14, + 7, + 8, + 11, + 6, + 4, + 18, + 9, + 11, + 6, + 20, + 2, + 25, + 6, + 19, + 20, + 17, + 8, + 18 + ], + "weighted_loads": [ + 0.36357827112078667, + 0.044106606394052505, + 0.014088326133787632, + 0.9840328544378281, + 0.9485855177044868, + 0.25822605937719345, + 0.26086609810590744, + 1.1185200121253729, + 0.0, + 0.786422835662961, + 1.0270384848117828, + 1.2629542797803879, + 0.26565804705023766, + 0.5697859078645706, + 0.4393072724342346, + 0.0, + 0.5434495620429516, + 0.428044144064188, + 0.38080522790551186, + 0.5842243768274784, + 0.040737930685281754, + 3.1746227964758873, + 1.1989814676344395, + 0.08132079616189003, + 0.4179092310369015, + 0.7134263701736927, + 0.6177512630820274, + 1.2812019921839237, + 0.2593260854482651, + 0.8436885289847851, + 1.1683500222861767, + 0.7527735726907849, + 0.625788040459156, + 1.537524875253439, + 0.6031971275806427, + 0.3870285376906395, + 0.11297727562487125, + 0.3202875703573227, + 1.281204093247652, + 0.5190278142690659, + 0.26313166692852974, + 1.3094361536204815, + 0.382830498740077, + 2.1622993890196085, + 0.2380458079278469, + 0.7121288385242224, + 0.3616241626441479, + 0.42195202223956585, + 0.8138842657208443, + 0.3048303499817848, + 0.22712863981723785, + 1.1170163564383984, + 0.7255144417285919, + 0.6477457508444786, + 0.2585792765021324, + 1.3675922751426697, + 0.11982594057917595, + 2.285343259572983, + 0.40181180462241173, + 1.2142551615834236, + 1.3734515644609928, + 1.46604860201478, + 0.46628860756754875, + 1.0043446496129036 + ], + "unique_experts": 62, + "load_cv": 0.7762868658212819, + "normalized_load_entropy": 0.9333298684939274, + "max_load_share": 0.059420289855072465 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 74, + "ordered_topk_exact_tokens": 51, + "set_exact_tokens": 62, + "mean_set_jaccard": 0.9507722007722008, + "mean_token_weighted_tv": 0.01294003487438769, + "aggregate_load_tv": 0.02477477477477477 + }, + "system_bos": { + "tokens": 74, + "ordered_topk_exact_tokens": 45, + "set_exact_tokens": 58, + "mean_set_jaccard": 0.9330759330759332, + "mean_token_weighted_tv": 0.017696173471474164, + "aggregate_load_tv": 0.03378378378378377 + }, + "system_x": { + "tokens": 74, + "ordered_topk_exact_tokens": 32, + "set_exact_tokens": 50, + "mean_set_jaccard": 0.8935006435006435, + "mean_token_weighted_tv": 0.0267587709744033, + "aggregate_load_tv": 0.04504504504504504 + }, + "system_period": { + "tokens": 74, + "ordered_topk_exact_tokens": 38, + "set_exact_tokens": 50, + "mean_set_jaccard": 0.8986486486486487, + "mean_token_weighted_tv": 0.02672489865909557, + "aggregate_load_tv": 0.03603603603603603 + }, + "bos_at_s0": { + "tokens": 74, + "ordered_topk_exact_tokens": 40, + "set_exact_tokens": 47, + "mean_set_jaccard": 0.892857142857143, + "mean_token_weighted_tv": 0.026482057040305557, + "aggregate_load_tv": 0.04954954954954956 + }, + "bos_at_s1": { + "tokens": 74, + "ordered_topk_exact_tokens": 29, + "set_exact_tokens": 39, + "mean_set_jaccard": 0.853925353925354, + "mean_token_weighted_tv": 0.03237252234405762, + "aggregate_load_tv": 0.06531531531531531 + }, + "x_at_s0": { + "tokens": 74, + "ordered_topk_exact_tokens": 29, + "set_exact_tokens": 45, + "mean_set_jaccard": 0.8793436293436295, + "mean_token_weighted_tv": 0.02938658104756394, + "aggregate_load_tv": 0.04279279279279279 + }, + "x_at_s1": { + "tokens": 74, + "ordered_topk_exact_tokens": 27, + "set_exact_tokens": 40, + "mean_set_jaccard": 0.8462033462033463, + "mean_token_weighted_tv": 0.03803129747157564, + "aggregate_load_tv": 0.06531531531531531 + }, + "period_at_s0": { + "tokens": 74, + "ordered_topk_exact_tokens": 31, + "set_exact_tokens": 42, + "mean_set_jaccard": 0.8626126126126128, + "mean_token_weighted_tv": 0.032948458793799616, + "aggregate_load_tv": 0.06306306306306306 + }, + "period_at_s1": { + "tokens": 74, + "ordered_topk_exact_tokens": 23, + "set_exact_tokens": 34, + "mean_set_jaccard": 0.8368725868725869, + "mean_token_weighted_tv": 0.037759365488749905, + "aggregate_load_tv": 0.06756756756756756 + } + } + }, + "layer_11": { + "layer": 11, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "d463168126e891b74c5d8e48091fad490115d4e3f7cc11bd78f125c43eeb8156", + "route_weight_sha256": "8d423ebbbbc53fa7756becf7e917dec7735e412341501789a417c94825ef18c5", + "loads": [ + 6, + 1, + 4, + 8, + 5, + 11, + 7, + 8, + 9, + 6, + 4, + 16, + 23, + 7, + 44, + 0, + 2, + 2, + 1, + 6, + 7, + 7, + 2, + 9, + 0, + 10, + 12, + 2, + 1, + 9, + 34, + 9, + 11, + 9, + 1, + 11, + 5, + 6, + 4, + 1, + 7, + 23, + 7, + 0, + 15, + 4, + 5, + 2, + 2, + 6, + 5, + 10, + 6, + 0, + 2, + 0, + 2, + 9, + 2, + 7, + 4, + 4, + 2, + 0 + ], + "weighted_loads": [ + 0.34819350205361843, + 0.039159536361694336, + 0.3195718079805374, + 0.39957303553819656, + 0.3551682122051716, + 0.5701760798692703, + 0.35486477240920067, + 0.4587377570569515, + 0.5143551677465439, + 0.22465680167078972, + 0.17779138311743736, + 0.9068664945662022, + 1.4147517010569572, + 0.5278923064470291, + 3.204411741346121, + 0.0, + 0.061854954808950424, + 0.09369631484150887, + 0.04101034253835678, + 0.34442562982439995, + 0.29066548123955727, + 0.4796057716012001, + 0.0723656490445137, + 0.7116602882742882, + 0.0, + 0.6362133398652077, + 0.5190757773816586, + 0.07677879557013512, + 0.03718917816877365, + 0.4132964313030243, + 1.9132359363138676, + 0.6540752053260803, + 1.1225752141326666, + 0.479943098500371, + 0.03989706560969353, + 0.955597922205925, + 0.25105490162968636, + 0.2750905603170395, + 0.19815857335925102, + 0.03858815133571625, + 0.6654552482068539, + 0.9776930343359709, + 0.4610973708331585, + 0.0, + 1.1737139113247395, + 0.3461221195757389, + 0.3675476685166359, + 0.06805834919214249, + 0.07183026522397995, + 0.4461279362440109, + 0.23892509937286377, + 0.8759814240038395, + 0.33664594776928425, + 0.0, + 0.09950372576713562, + 0.0, + 0.06881703436374664, + 0.5667542219161987, + 0.06014171428978443, + 0.5648970454931259, + 0.19834323972463608, + 0.36514386162161827, + 0.0821712352335453, + 0.0 + ], + "unique_experts": 58, + "load_cv": 1.0918012033816153, + "normalized_load_entropy": 0.8907626874700811, + "max_load_share": 0.0990990990990991 + }, + "full_input": { + "tokens": 99, + "top_k": 6, + "decisions": 594, + "ordered_route_sha256": "5c87f22f70471e53a713a1b42ab0d3472a92f345e38b35276d4a355d4c28987b", + "route_weight_sha256": "f6520c9d5f286b9731f4064b242122df3d6deb96138c0aa46954efe91eb8a5f1", + "loads": [ + 6, + 2, + 5, + 8, + 10, + 11, + 8, + 8, + 12, + 7, + 8, + 19, + 23, + 7, + 44, + 6, + 9, + 4, + 13, + 6, + 7, + 7, + 3, + 14, + 0, + 10, + 13, + 3, + 7, + 9, + 40, + 16, + 13, + 9, + 4, + 15, + 5, + 6, + 4, + 1, + 14, + 23, + 7, + 22, + 18, + 4, + 6, + 10, + 2, + 8, + 5, + 10, + 6, + 0, + 8, + 3, + 2, + 9, + 5, + 8, + 4, + 8, + 10, + 0 + ], + "weighted_loads": [ + 0.34819350205361843, + 0.0727321021258831, + 0.3777989596128464, + 0.39957303553819656, + 0.5790085308253765, + 0.5701760798692703, + 0.39171118661761284, + 0.4587377570569515, + 0.6721962839365005, + 0.25539830699563026, + 0.4173452272079885, + 0.9608902232721448, + 1.4147517010569572, + 0.5278923064470291, + 3.204411741346121, + 0.23155129700899124, + 0.7779448889195919, + 0.12363261263817549, + 2.1145922616124153, + 0.34442562982439995, + 0.29066548123955727, + 0.4796057716012001, + 0.07632728386670351, + 0.9604860879480839, + 0.0, + 0.6362133398652077, + 0.5224404174368829, + 0.08931774646043777, + 0.49397924169898033, + 0.4132964313030243, + 2.2068154849112034, + 0.97408427298069, + 1.1880831196904182, + 0.479943098500371, + 0.16539371758699417, + 1.2328828647732735, + 0.25105490162968636, + 0.2750905603170395, + 0.19815857335925102, + 0.03858815133571625, + 1.027103666216135, + 0.9776930343359709, + 0.4610973708331585, + 2.1869853138923645, + 1.3319164961576462, + 0.3461221195757389, + 0.4017181657254696, + 0.635316725820303, + 0.07183026522397995, + 0.5414098724722862, + 0.23892509937286377, + 0.8759814240038395, + 0.33664594776928425, + 0.0, + 0.37481752689927816, + 0.15242385119199753, + 0.06881703436374664, + 0.5667542219161987, + 0.1983988042920828, + 0.5940824449062347, + 0.19834323972463608, + 0.5302629396319389, + 0.554203949868679, + 0.0 + ], + "unique_experts": 61, + "load_cv": 0.8476226178568421, + "normalized_load_entropy": 0.9297891680258893, + "max_load_share": 0.07407407407407407 + } + }, + "s1_eos": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "59fcc7c3c57182d7bdb5ce13d8ce6491fef55f99581a87685d11d0ec8438bc20", + "route_weight_sha256": "c022294e65e96647c6af60d1d0c347a516d7589484f517c272deae38ba45dfb5", + "loads": [ + 6, + 1, + 4, + 8, + 5, + 10, + 7, + 9, + 9, + 6, + 4, + 16, + 23, + 7, + 46, + 0, + 2, + 2, + 1, + 5, + 7, + 7, + 2, + 9, + 0, + 10, + 14, + 1, + 1, + 9, + 33, + 9, + 11, + 9, + 1, + 11, + 5, + 6, + 4, + 1, + 7, + 24, + 7, + 0, + 15, + 4, + 5, + 2, + 2, + 6, + 5, + 10, + 5, + 0, + 2, + 0, + 1, + 9, + 2, + 7, + 4, + 4, + 2, + 0 + ], + "weighted_loads": [ + 0.35268597304821014, + 0.03858241066336632, + 0.315044891089201, + 0.4047852233052254, + 0.35580359771847725, + 0.5429980382323265, + 0.3555068299174309, + 0.495696060359478, + 0.5174216814339161, + 0.22933487221598625, + 0.1785183921456337, + 0.9101857244968414, + 1.4126205779612064, + 0.5259483121335506, + 3.3003781884908676, + 0.0, + 0.06226002983748913, + 0.0969267226755619, + 0.04128076136112213, + 0.31194254755973816, + 0.2892654426395893, + 0.465890821069479, + 0.0732155293226242, + 0.7072368338704109, + 0.0, + 0.6222905106842518, + 0.6011558584868908, + 0.03661201894283295, + 0.036784492433071136, + 0.41965943202376366, + 1.8751158863306046, + 0.6382260993123055, + 1.104976138100028, + 0.4772877786308527, + 0.04233134910464287, + 0.9681675806641579, + 0.2581005170941353, + 0.2775491029024124, + 0.1977260299026966, + 0.036660801619291306, + 0.6481886468827724, + 0.995753301307559, + 0.46127279102802277, + 0.0, + 1.1720835790038109, + 0.3497188352048397, + 0.3609792962670326, + 0.0666987020522356, + 0.07165071740746498, + 0.44275258854031563, + 0.238944660872221, + 0.874314371496439, + 0.3074830360710621, + 0.0, + 0.0897696278989315, + 0.0, + 0.03482789918780327, + 0.5704150274395943, + 0.06151663325726986, + 0.5601543560624123, + 0.19416134431958199, + 0.34818611666560173, + 0.0825452022254467, + 0.0 + ], + "unique_experts": 58, + "load_cv": 1.1182426762108104, + "normalized_load_entropy": 0.8864326157282972, + "max_load_share": 0.1036036036036036 + }, + "full_input": { + "tokens": 115, + "top_k": 6, + "decisions": 690, + "ordered_route_sha256": "4bbae5cb56f07b98c222c2a0f7b67bc77fd9b6a02fcc90b00f1de5e3cb187578", + "route_weight_sha256": "f00e428aeb9424ac2e8c68279776ec755d14b5792b7985ef7a57afafe3c39f46", + "loads": [ + 8, + 2, + 5, + 8, + 15, + 13, + 8, + 11, + 18, + 6, + 9, + 19, + 23, + 7, + 46, + 1, + 22, + 4, + 12, + 6, + 8, + 8, + 5, + 14, + 0, + 10, + 18, + 3, + 11, + 9, + 40, + 16, + 12, + 9, + 5, + 18, + 5, + 6, + 4, + 2, + 13, + 24, + 7, + 27, + 17, + 4, + 7, + 15, + 2, + 9, + 5, + 10, + 5, + 5, + 21, + 8, + 7, + 10, + 4, + 11, + 5, + 12, + 13, + 3 + ], + "weighted_loads": [ + 0.4996817633509636, + 0.07148192822933197, + 0.3616325557231903, + 0.4047852233052254, + 0.897986002266407, + 0.6533115282654762, + 0.3945225216448307, + 0.62493946403265, + 1.0432374626398087, + 0.22933487221598625, + 0.45112393563613296, + 0.9633504347875714, + 1.4126205779612064, + 0.5259483121335506, + 3.3003781884908676, + 0.03965266793966293, + 1.867625867947936, + 0.12596186529845, + 2.114945136010647, + 0.3506191410124302, + 0.3615526743233204, + 0.5357767753303051, + 0.184935980476439, + 0.932936429977417, + 0.0, + 0.6222905106842518, + 0.720178424147889, + 0.0880013257265091, + 0.815169271081686, + 0.41965943202376366, + 2.242834150791168, + 0.9445414952933788, + 1.1377971563488245, + 0.4772877786308527, + 0.2224065624177456, + 1.5194024741649628, + 0.2581005170941353, + 0.2775491029024124, + 0.1977260299026966, + 0.08383152633905411, + 0.9379493333399296, + 0.995753301307559, + 0.46127279102802277, + 2.515006046742201, + 1.3093104399740696, + 0.3497188352048397, + 0.44653812050819397, + 1.0607377272099257, + 0.07165071740746498, + 0.6628044620156288, + 0.238944660872221, + 0.874314371496439, + 0.3074830360710621, + 0.30233342573046684, + 1.242261872626841, + 0.392816636711359, + 0.505758736282587, + 0.6132451631128788, + 0.16411086358129978, + 0.7154437955468893, + 0.2319203056395054, + 0.6900868695229292, + 0.6440477930009365, + 0.10623768903315067 + ], + "unique_experts": 63, + "load_cv": 0.7750737645377311, + "normalized_load_entropy": 0.9387740731721275, + "max_load_share": 0.06666666666666667 + } + }, + "s0_bos": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "de15d9e019677dfb31ea15d5b8de366c9203d1445b69c077c21c54fa600135b4", + "route_weight_sha256": "0c627979c7b0a1da9ccaf8462908957a68b939765be5e5bb6320d36bd7e38952", + "loads": [ + 5, + 3, + 4, + 8, + 6, + 11, + 7, + 8, + 8, + 9, + 3, + 14, + 21, + 7, + 46, + 0, + 1, + 3, + 1, + 5, + 7, + 7, + 3, + 9, + 0, + 12, + 14, + 2, + 1, + 9, + 34, + 9, + 11, + 10, + 1, + 10, + 5, + 6, + 4, + 2, + 7, + 22, + 5, + 0, + 15, + 4, + 5, + 1, + 2, + 6, + 5, + 10, + 4, + 0, + 1, + 0, + 2, + 9, + 2, + 7, + 5, + 4, + 2, + 0 + ], + "weighted_loads": [ + 0.31665120646357536, + 0.11991779133677483, + 0.3276308476924896, + 0.3963191695511341, + 0.3884851038455963, + 0.5714749582111835, + 0.3647398017346859, + 0.4814927466213703, + 0.46863269433379173, + 0.34512040205299854, + 0.13386797159910202, + 0.8440555110573769, + 1.3467899337410927, + 0.5718914270401001, + 3.289985379204154, + 0.0, + 0.029970435425639153, + 0.1275704838335514, + 0.03894677385687828, + 0.3038163296878338, + 0.3101460225880146, + 0.47577790543437004, + 0.11162106692790985, + 0.7082783803343773, + 0.0, + 0.7103516831994057, + 0.5816893633455038, + 0.07470603659749031, + 0.0362292118370533, + 0.4528868943452835, + 2.0675281807780266, + 0.6289265900850296, + 1.0435197912156582, + 0.5164969936013222, + 0.040497127920389175, + 0.913991417735815, + 0.2577427364885807, + 0.26989252492785454, + 0.1889314204454422, + 0.0737382061779499, + 0.6660674139857292, + 0.9381521511822939, + 0.3763904571533203, + 0.0, + 1.1522731930017471, + 0.3055664040148258, + 0.33627308905124664, + 0.034903138875961304, + 0.07425977289676666, + 0.4387861154973507, + 0.23255520686507225, + 0.8846599236130714, + 0.24657579883933067, + 0.0, + 0.05836782231926918, + 0.0, + 0.07009994983673096, + 0.569435715675354, + 0.06183916702866554, + 0.5534343086183071, + 0.24068230390548706, + 0.35703177750110626, + 0.0871601402759552, + 0.0 + ], + "unique_experts": 58, + "load_cv": 1.1018647820353373, + "normalized_load_entropy": 0.890371929894477, + "max_load_share": 0.1036036036036036 + }, + "full_input": { + "tokens": 99, + "top_k": 6, + "decisions": 594, + "ordered_route_sha256": "98566ff3cf1e8358229c77e39670dcb7bea58b6b6666f91a9cc7c827eeb40b8e", + "route_weight_sha256": "984c96c274641ddd488e3e6ccae52b8fe4033c0a2f9742599e6022c1ee15ec75", + "loads": [ + 5, + 4, + 5, + 8, + 11, + 11, + 8, + 8, + 11, + 11, + 6, + 16, + 21, + 7, + 46, + 7, + 8, + 4, + 12, + 5, + 7, + 7, + 3, + 14, + 0, + 12, + 14, + 4, + 7, + 9, + 41, + 16, + 13, + 10, + 4, + 13, + 5, + 6, + 4, + 2, + 15, + 22, + 5, + 23, + 18, + 4, + 5, + 9, + 2, + 8, + 5, + 10, + 4, + 0, + 6, + 2, + 2, + 9, + 5, + 8, + 5, + 10, + 12, + 0 + ], + "weighted_loads": [ + 0.31665120646357536, + 0.1534903571009636, + 0.3858579993247986, + 0.3963191695511341, + 0.6123254224658012, + 0.5714749582111835, + 0.4017011560499668, + 0.4814927466213703, + 0.6262512654066086, + 0.41218346916139126, + 0.36337220575660467, + 0.8858965104445815, + 1.3467899337410927, + 0.5718914270401001, + 3.289985379204154, + 0.26352761313319206, + 0.7785776276141405, + 0.14238688815385103, + 1.217167567461729, + 0.3038163296878338, + 0.3101460225880146, + 0.47577790543437004, + 0.11162106692790985, + 0.957104180008173, + 0.0, + 0.7103516831994057, + 0.5816893633455038, + 0.13289859145879745, + 0.4861446488648653, + 0.4528868943452835, + 2.3916426096111536, + 0.9489356577396393, + 1.1090276967734098, + 0.5164969936013222, + 0.1670357808470726, + 1.1955200247466564, + 0.2577427364885807, + 0.26989252492785454, + 0.1889314204454422, + 0.0737382061779499, + 1.117573767900467, + 0.9381521511822939, + 0.3763904571533203, + 2.3689182363450527, + 1.3104757778346539, + 0.3055664040148258, + 0.33627308905124664, + 0.5923847928643227, + 0.07425977289676666, + 0.534068051725626, + 0.23255520686507225, + 0.8846599236130714, + 0.24657579883933067, + 0.0, + 0.29891465324908495, + 0.10019365325570107, + 0.07009994983673096, + 0.569435715675354, + 0.2000962570309639, + 0.5886637680232525, + 0.24068230390548706, + 0.6229255311191082, + 0.6703801788389683, + 0.0 + ], + "unique_experts": 61, + "load_cv": 0.8609987880572683, + "normalized_load_entropy": 0.9293341053512841, + "max_load_share": 0.07744107744107744 + } + }, + "s1_bos": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "7b3d6552f760cde4d1404b551f7221f2afa96eafb11deeb1f639f194407eba15", + "route_weight_sha256": "d7a142be094d6050fa9db6036eddca909b9c941d488b339e3d5b1adbf1926362", + "loads": [ + 5, + 2, + 4, + 7, + 5, + 11, + 7, + 9, + 8, + 10, + 3, + 14, + 21, + 7, + 48, + 0, + 1, + 2, + 1, + 5, + 7, + 7, + 3, + 9, + 0, + 12, + 13, + 2, + 1, + 10, + 34, + 9, + 11, + 9, + 1, + 11, + 4, + 5, + 4, + 1, + 8, + 20, + 7, + 0, + 14, + 5, + 6, + 2, + 2, + 6, + 5, + 10, + 4, + 0, + 2, + 0, + 2, + 9, + 2, + 6, + 5, + 4, + 2, + 0 + ], + "weighted_loads": [ + 0.32393619045615196, + 0.07854680716991425, + 0.32178860530257225, + 0.35084303840994835, + 0.36416153982281685, + 0.5728549510240555, + 0.3639192208647728, + 0.508590953424573, + 0.4706578999757767, + 0.39048415422439575, + 0.13742593675851822, + 0.8193699717521667, + 1.3261911794543266, + 0.57072464376688, + 3.3351185843348503, + 0.0, + 0.030664337798953056, + 0.09079471975564957, + 0.04233373701572418, + 0.30213380604982376, + 0.29286712780594826, + 0.46718986332416534, + 0.12148848176002502, + 0.6983460485935211, + 0.0, + 0.7028672955930233, + 0.5652010813355446, + 0.07293476164340973, + 0.03648383542895317, + 0.47803453356027603, + 1.99241404235363, + 0.6166585981845856, + 1.0286638047546148, + 0.4832761436700821, + 0.03877730667591095, + 0.96556081995368, + 0.21965264156460762, + 0.23361487686634064, + 0.19350388273596764, + 0.03450600802898407, + 0.6718486808240414, + 0.8406549617648125, + 0.4453204572200775, + 0.0, + 1.087171919643879, + 0.34826937317848206, + 0.390973836183548, + 0.06834608688950539, + 0.07541357353329659, + 0.4376597926020622, + 0.23084130138158798, + 0.8828374035656452, + 0.25007785111665726, + 0.0, + 0.09479517117142677, + 0.0, + 0.0692477896809578, + 0.5889225788414478, + 0.06393369287252426, + 0.532595407217741, + 0.2285868525505066, + 0.3546544723212719, + 0.08084320649504662, + 0.0 + ], + "unique_experts": 58, + "load_cv": 1.1162085814367082, + "normalized_load_entropy": 0.8894816346444359, + "max_load_share": 0.10810810810810811 + }, + "full_input": { + "tokens": 115, + "top_k": 6, + "decisions": 690, + "ordered_route_sha256": "504edca413d5601ae9840c85b35cb2bb4f5b27f619b204d7331e3a92038d09cb", + "route_weight_sha256": "516106757ecd6c2667f680a8a0924684b80ebb530ec9882a8680446973dc6147", + "loads": [ + 7, + 3, + 5, + 7, + 15, + 14, + 7, + 11, + 17, + 11, + 7, + 16, + 21, + 7, + 48, + 2, + 21, + 3, + 11, + 6, + 8, + 8, + 5, + 14, + 0, + 12, + 16, + 4, + 10, + 10, + 41, + 16, + 12, + 9, + 6, + 18, + 4, + 5, + 4, + 2, + 15, + 20, + 7, + 28, + 16, + 5, + 7, + 16, + 2, + 9, + 5, + 10, + 4, + 5, + 21, + 8, + 8, + 10, + 4, + 10, + 6, + 14, + 15, + 2 + ], + "weighted_loads": [ + 0.4709319807589054, + 0.1114463247358799, + 0.3683762699365616, + 0.35084303840994835, + 0.9063439443707466, + 0.6831684410572052, + 0.3639192208647728, + 0.6378343570977449, + 1.0004338845610619, + 0.4240812733769417, + 0.4187819426879287, + 0.8611033437773585, + 1.3261911794543266, + 0.57072464376688, + 3.3351185843348503, + 0.07101128250360489, + 1.8640328887850046, + 0.10561112407594919, + 1.2179154977202415, + 0.3408103995025158, + 0.36515435948967934, + 0.5370758175849915, + 0.22943924739956856, + 0.9240456447005272, + 0.0, + 0.7028672955930233, + 0.6810529641807079, + 0.12432406842708588, + 0.7655470333993435, + 0.47803453356027603, + 2.3601323068141937, + 0.922973994165659, + 1.0614848230034113, + 0.4832761436700821, + 0.2515069246292114, + 1.5669904835522175, + 0.21965264156460762, + 0.23361487686634064, + 0.19350388273596764, + 0.08167673274874687, + 1.0720353499054909, + 0.8406549617648125, + 0.4453204572200775, + 2.780186228454113, + 1.2243987806141376, + 0.34826937317848206, + 0.4373173303902149, + 1.0938841849565506, + 0.07541357353329659, + 0.6577116660773754, + 0.23084130138158798, + 0.8828374035656452, + 0.25007785111665726, + 0.30233342573046684, + 1.2459838250651956, + 0.3810458406805992, + 0.5401786267757416, + 0.6317527145147324, + 0.16652792319655418, + 0.6948408484458923, + 0.26634581387043, + 0.7873627487570047, + 0.7232649810612202, + 0.07524693757295609 + ], + "unique_experts": 63, + "load_cv": 0.7771522073925781, + "normalized_load_entropy": 0.9397673181090335, + "max_load_share": 0.06956521739130435 + } + }, + "s0_x": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "767445d24dfabd0941088ec169c66d0ea3820de0a086d2e63d7dae7e9310f8d8", + "route_weight_sha256": "6bb1fce9870360e792087e742490b5ca62790022efe64e08ba7fd9df42c06198", + "loads": [ + 6, + 2, + 4, + 7, + 6, + 9, + 7, + 9, + 10, + 8, + 4, + 16, + 25, + 7, + 46, + 0, + 1, + 3, + 1, + 4, + 8, + 7, + 2, + 9, + 0, + 12, + 11, + 2, + 1, + 9, + 33, + 9, + 10, + 9, + 0, + 10, + 5, + 6, + 4, + 2, + 7, + 22, + 6, + 0, + 16, + 4, + 5, + 2, + 2, + 6, + 4, + 10, + 5, + 0, + 1, + 0, + 2, + 9, + 2, + 7, + 4, + 4, + 2, + 0 + ], + "weighted_loads": [ + 0.34244989417493343, + 0.08701341599225998, + 0.331853523850441, + 0.37163883075118065, + 0.4002377577126026, + 0.4945058189332485, + 0.3690572902560234, + 0.5263963006436825, + 0.5459786746650934, + 0.30247304774820805, + 0.1745060384273529, + 0.9206245690584183, + 1.5295334458351135, + 0.5497771203517914, + 3.30210274271667, + 0.0, + 0.03179309517145157, + 0.1206771731376648, + 0.04038495197892189, + 0.2664879076182842, + 0.35216693952679634, + 0.4455083757638931, + 0.07697085663676262, + 0.7110861837863922, + 0.0, + 0.7148764096200466, + 0.4712648503482342, + 0.07426052913069725, + 0.03547558933496475, + 0.438000101596117, + 2.0361795239150524, + 0.6118077784776688, + 0.9974041096866131, + 0.48477743566036224, + 0.0, + 0.9213808178901672, + 0.2569841593503952, + 0.26762904971838, + 0.18579671531915665, + 0.07557399570941925, + 0.6154620014131069, + 0.9412089250981808, + 0.4183315932750702, + 0.0, + 1.1938797906041145, + 0.3067008964717388, + 0.3420227952301502, + 0.06960752233862877, + 0.07203922793269157, + 0.42281339317560196, + 0.1977592259645462, + 0.8771286308765411, + 0.27566225454211235, + 0.0, + 0.05317982658743858, + 0.0, + 0.06972406059503555, + 0.5930348560214043, + 0.06221291236579418, + 0.5340799801051617, + 0.1795753538608551, + 0.31169237568974495, + 0.08591155335307121, + 0.0 + ], + "unique_experts": 57, + "load_cv": 1.1153356909169376, + "normalized_load_entropy": 0.8871135889692398, + "max_load_share": 0.1036036036036036 + }, + "full_input": { + "tokens": 99, + "top_k": 6, + "decisions": 594, + "ordered_route_sha256": "cd5a6254fb9047bcc42a2a66f3ea44d3e0645ecd209b7ba05d2b9f35fad5733d", + "route_weight_sha256": "8ec44d6d28f769ce9c790388c0d08e96d379744d1ee76d269bf48670af610b77", + "loads": [ + 6, + 3, + 5, + 7, + 11, + 9, + 8, + 9, + 13, + 9, + 7, + 18, + 25, + 7, + 46, + 6, + 7, + 5, + 13, + 4, + 8, + 7, + 2, + 14, + 0, + 12, + 11, + 3, + 7, + 9, + 40, + 17, + 12, + 9, + 4, + 13, + 5, + 6, + 4, + 2, + 13, + 22, + 6, + 22, + 19, + 4, + 6, + 10, + 2, + 10, + 4, + 10, + 5, + 1, + 6, + 2, + 2, + 9, + 6, + 8, + 4, + 9, + 11, + 0 + ], + "weighted_loads": [ + 0.34244989417493343, + 0.12058598175644875, + 0.39008067548274994, + 0.37163883075118065, + 0.6240780763328075, + 0.4945058189332485, + 0.4043191000819206, + 0.5263963006436825, + 0.7075830902904272, + 0.3332145530730486, + 0.38800554629415274, + 0.9624655684456229, + 1.5295334458351135, + 0.5497771203517914, + 3.30210274271667, + 0.23155129700899124, + 0.6953046284615993, + 0.17126180697232485, + 1.3101037554442883, + 0.2664879076182842, + 0.35216693952679634, + 0.4455083757638931, + 0.07697085663676262, + 0.9599119834601879, + 0.0, + 0.7148764096200466, + 0.4712648503482342, + 0.08679948002099991, + 0.4806128442287445, + 0.438000101596117, + 2.361908171325922, + 0.9810045063495636, + 1.0629120152443647, + 0.48477743566036224, + 0.2055342011153698, + 1.1822808757424355, + 0.2569841593503952, + 0.26762904971838, + 0.18579671531915665, + 0.07557399570941925, + 0.9467333257198334, + 0.9412089250981808, + 0.4183315932750702, + 2.070050708949566, + 1.3520823754370213, + 0.3067008964717388, + 0.3820405676960945, + 0.6387868411839008, + 0.07203922793269157, + 0.6076034158468246, + 0.1977592259645462, + 0.8771286308765411, + 0.27566225454211235, + 0.055294234305620193, + 0.2927841553464532, + 0.10747240483760834, + 0.06972406059503555, + 0.5930348560214043, + 0.2607050742954016, + 0.565056812018156, + 0.1795753538608551, + 0.5341742001473904, + 0.5828029699623585, + 0.0 + ], + "unique_experts": 62, + "load_cv": 0.865830660595775, + "normalized_load_entropy": 0.9290297650543583, + "max_load_share": 0.07744107744107744 + } + }, + "s1_x": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "9f189f3817e47ecb6a53f791c415deeee600e4703a4681f6a008ff5d82172f96", + "route_weight_sha256": "45c0ccc043cb02b02cfd7163ab37135c4db7d5f5797beed9f7b2f49bb75377f5", + "loads": [ + 6, + 0, + 4, + 7, + 6, + 10, + 7, + 10, + 11, + 8, + 2, + 15, + 22, + 7, + 47, + 0, + 1, + 2, + 1, + 5, + 7, + 7, + 2, + 9, + 0, + 12, + 13, + 3, + 2, + 9, + 35, + 9, + 11, + 9, + 0, + 11, + 4, + 4, + 4, + 2, + 6, + 19, + 7, + 1, + 15, + 6, + 5, + 3, + 2, + 6, + 5, + 11, + 4, + 0, + 1, + 0, + 2, + 9, + 2, + 7, + 4, + 3, + 2, + 0 + ], + "weighted_loads": [ + 0.35902442038059235, + 0.0, + 0.3166007623076439, + 0.35708095133304596, + 0.4034547619521618, + 0.5415786020457745, + 0.36231429874897003, + 0.5693562030792236, + 0.6035204231739044, + 0.31915796361863613, + 0.08507359772920609, + 0.8468487225472927, + 1.3954938426613808, + 0.5575817227363586, + 3.3140854164958, + 0.0, + 0.031123017892241478, + 0.0985865406692028, + 0.04282357543706894, + 0.3023720309138298, + 0.2939663864672184, + 0.4522973708808422, + 0.0791461355984211, + 0.6838192045688629, + 0.0, + 0.6702885273844004, + 0.565582487732172, + 0.10639269649982452, + 0.07222944125533104, + 0.43793195486068726, + 2.0924149863421917, + 0.5973741263151169, + 0.989546712487936, + 0.4781885854899883, + 0.0, + 0.9967466779053211, + 0.22127026319503784, + 0.1940818391740322, + 0.1966174878180027, + 0.07946334779262543, + 0.5514443926513195, + 0.8001143839210272, + 0.4587930366396904, + 0.03792361915111542, + 1.1298878267407417, + 0.3787537291646004, + 0.3513618968427181, + 0.1113140732049942, + 0.07256314158439636, + 0.43270575627684593, + 0.23417433723807335, + 0.9088631682097912, + 0.24532900005578995, + 0.0, + 0.046978194266557693, + 0.0, + 0.06888125091791153, + 0.5971634760499, + 0.06782340258359909, + 0.5617193505167961, + 0.17635076493024826, + 0.22316405177116394, + 0.08513027057051659, + 0.0 + ], + "unique_experts": 57, + "load_cv": 1.121721114296356, + "normalized_load_entropy": 0.886440289843987, + "max_load_share": 0.10585585585585586 + }, + "full_input": { + "tokens": 115, + "top_k": 6, + "decisions": 690, + "ordered_route_sha256": "353fdba5a5877333c1c7dc5b6383921776332790d84ea5eff114432cdcd8e355", + "route_weight_sha256": "f4bcfb16af11d715f4828974d651a110cc09610b96bbe2712ee7693f9c418f5c", + "loads": [ + 8, + 1, + 5, + 7, + 16, + 13, + 7, + 12, + 21, + 8, + 6, + 17, + 22, + 7, + 47, + 1, + 21, + 3, + 12, + 6, + 8, + 8, + 4, + 14, + 0, + 12, + 16, + 6, + 12, + 9, + 42, + 17, + 12, + 9, + 5, + 17, + 4, + 4, + 4, + 3, + 10, + 19, + 7, + 28, + 17, + 6, + 7, + 16, + 2, + 10, + 5, + 11, + 4, + 6, + 21, + 9, + 8, + 10, + 5, + 11, + 5, + 11, + 14, + 2 + ], + "weighted_loads": [ + 0.5060202106833458, + 0.03289951756596565, + 0.3631884269416332, + 0.35708095133304596, + 0.9456371665000916, + 0.6518920920789242, + 0.36231429874897003, + 0.6985996067523956, + 1.203316394239664, + 0.31915796361863613, + 0.2983921682462096, + 0.8885820945724845, + 1.3954938426613808, + 0.5575817227363586, + 3.3140854164958, + 0.03965266793966293, + 1.8209106642752886, + 0.11340294498950243, + 1.2966553047299385, + 0.34104862436652184, + 0.3662536181509495, + 0.5221833251416683, + 0.18709690123796463, + 0.909518800675869, + 0.0, + 0.6702885273844004, + 0.6814343705773354, + 0.20165132731199265, + 0.8260361738502979, + 0.43793195486068726, + 2.4601332508027554, + 0.9536711573600769, + 1.0223677307367325, + 0.4781885854899883, + 0.24717261269688606, + 1.5473778955638409, + 0.22127026319503784, + 0.1940818391740322, + 0.1966174878180027, + 0.12663407251238823, + 0.7522593140602112, + 0.8001143839210272, + 0.4587930366396904, + 2.4223934412002563, + 1.2671146877110004, + 0.3787537291646004, + 0.4402150698006153, + 1.082351267337799, + 0.07256314158439636, + 0.7010741196572781, + 0.23417433723807335, + 0.9088631682097912, + 0.24532900005578995, + 0.35418467968702316, + 1.2298991596326232, + 0.4260874893516302, + 0.5398120880126953, + 0.6399936117231846, + 0.21761620044708252, + 0.7169720698148012, + 0.21410972625017166, + 0.5727885495871305, + 0.7190145328640938, + 0.07524693757295609 + ], + "unique_experts": 63, + "load_cv": 0.7842119916228538, + "normalized_load_entropy": 0.9378746342205415, + "max_load_share": 0.06811594202898551 + } + }, + "s0_period": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "2cd0232bca84b8d3ddc008cc259a4647fb5e708f389208c7cf654c400e116708", + "route_weight_sha256": "e91b5c08d88fcde5a311de426e94257aeacbc3853569e7f00aaa3c375304ca9b", + "loads": [ + 6, + 2, + 4, + 6, + 5, + 10, + 7, + 9, + 10, + 8, + 3, + 15, + 24, + 7, + 44, + 0, + 2, + 3, + 1, + 4, + 8, + 7, + 3, + 9, + 0, + 13, + 13, + 2, + 1, + 9, + 33, + 9, + 10, + 10, + 0, + 10, + 5, + 6, + 4, + 3, + 6, + 20, + 7, + 0, + 15, + 5, + 5, + 2, + 2, + 6, + 4, + 10, + 5, + 0, + 1, + 0, + 2, + 9, + 2, + 7, + 5, + 4, + 2, + 0 + ], + "weighted_loads": [ + 0.34966059029102325, + 0.08792420476675034, + 0.3323025181889534, + 0.32565292343497276, + 0.3796866051852703, + 0.5414343252778053, + 0.36532584577798843, + 0.524662584066391, + 0.5444886088371277, + 0.29678696021437645, + 0.13591599464416504, + 0.8967020027339458, + 1.5141000673174858, + 0.5547459125518799, + 3.298806682229042, + 0.0, + 0.060750434175133705, + 0.1268388219177723, + 0.04165911674499512, + 0.2677495963871479, + 0.3520115278661251, + 0.451777670532465, + 0.11557566374540329, + 0.7096817046403885, + 0.0, + 0.7326437253504992, + 0.5637120828032494, + 0.07366064563393593, + 0.03456874191761017, + 0.4478634186089039, + 2.0614989921450615, + 0.6163437180221081, + 1.0040288511663675, + 0.5111350640654564, + 0.0, + 0.9413276240229607, + 0.26133589819073677, + 0.2710031010210514, + 0.19653575494885445, + 0.11750302091240883, + 0.5685060918331146, + 0.8629935383796692, + 0.476081483066082, + 0.0, + 1.1690419986844063, + 0.33537954092025757, + 0.3499349467456341, + 0.06993969529867172, + 0.07077350839972496, + 0.4242323599755764, + 0.19663561135530472, + 0.8789505697786808, + 0.2784519586712122, + 0.0, + 0.05148687958717346, + 0.0, + 0.07011839002370834, + 0.5863617807626724, + 0.0617182832211256, + 0.5393912196159363, + 0.20923690870404243, + 0.323391605168581, + 0.08884356170892715, + 0.0 + ], + "unique_experts": 57, + "load_cv": 1.0762278450600462, + "normalized_load_entropy": 0.8925295923943419, + "max_load_share": 0.0990990990990991 + }, + "full_input": { + "tokens": 99, + "top_k": 6, + "decisions": 594, + "ordered_route_sha256": "e1834ee3f8fff057ce99d698b512979d60dd279f22fadf8671bb21cc3c35c19c", + "route_weight_sha256": "b704c1a7134f12ae25d3c85cc71545d75ada1a270e8ceb5bb5438cafb8f3d643", + "loads": [ + 6, + 3, + 5, + 6, + 11, + 10, + 8, + 9, + 13, + 9, + 6, + 17, + 24, + 7, + 44, + 7, + 9, + 4, + 13, + 4, + 8, + 7, + 3, + 14, + 0, + 13, + 13, + 3, + 8, + 9, + 40, + 17, + 12, + 10, + 3, + 14, + 5, + 6, + 4, + 3, + 12, + 20, + 7, + 23, + 18, + 5, + 6, + 10, + 2, + 9, + 4, + 10, + 5, + 0, + 6, + 3, + 2, + 9, + 5, + 8, + 5, + 9, + 9, + 0 + ], + "weighted_loads": [ + 0.34966059029102325, + 0.1214967705309391, + 0.39052966982126236, + 0.32565292343497276, + 0.6865469850599766, + 0.5414343252778053, + 0.3998153805732727, + 0.524662584066391, + 0.7059200890362263, + 0.327528465539217, + 0.37389404233545065, + 0.9385430021211505, + 1.5141000673174858, + 0.5547459125518799, + 3.298806682229042, + 0.273598987609148, + 0.7589376773685217, + 0.14165522623807192, + 1.2622444368898869, + 0.2677495963871479, + 0.3520115278661251, + 0.451777670532465, + 0.11557566374540329, + 0.9585075043141842, + 0.0, + 0.7326437253504992, + 0.5637120828032494, + 0.08619959652423859, + 0.522009864449501, + 0.4478634186089039, + 2.387505389750004, + 0.9758025780320168, + 1.0695367567241192, + 0.5111350640654564, + 0.13566620275378227, + 1.3474488109350204, + 0.26133589819073677, + 0.2710031010210514, + 0.19653575494885445, + 0.11750302091240883, + 0.9001569449901581, + 0.8629935383796692, + 0.476081483066082, + 2.1516010500490665, + 1.327244583517313, + 0.33537954092025757, + 0.38908251747488976, + 0.6335089653730392, + 0.07077350839972496, + 0.5696718692779541, + 0.19663561135530472, + 0.8789505697786808, + 0.2784519586712122, + 0.0, + 0.29950516391545534, + 0.14162983000278473, + 0.07011839002370834, + 0.5863617807626724, + 0.19997537322342396, + 0.5700090974569321, + 0.20923690870404243, + 0.547543291002512, + 0.5187530107796192, + 0.0 + ], + "unique_experts": 61, + "load_cv": 0.8409625938901572, + "normalized_load_entropy": 0.9314187257636071, + "max_load_share": 0.07407407407407407 + } + }, + "s1_period": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "4a2a09b6f07c1ec416761cc0f2531e02ab090330b594957281e17150623dc5af", + "route_weight_sha256": "175e822bd6ef6a64c6e9115f593b30abc89d89e7bf516e2172f1917f0aaad0ff", + "loads": [ + 6, + 0, + 4, + 7, + 5, + 11, + 7, + 10, + 9, + 10, + 4, + 15, + 24, + 7, + 47, + 1, + 1, + 1, + 1, + 5, + 7, + 7, + 3, + 9, + 0, + 13, + 13, + 3, + 1, + 8, + 35, + 9, + 10, + 9, + 0, + 11, + 4, + 4, + 4, + 2, + 6, + 17, + 6, + 0, + 15, + 5, + 5, + 2, + 2, + 6, + 5, + 12, + 5, + 0, + 2, + 0, + 2, + 9, + 1, + 7, + 4, + 4, + 2, + 0 + ], + "weighted_loads": [ + 0.3615831360220909, + 0.0, + 0.3178122639656067, + 0.36305876448750496, + 0.3785657547414303, + 0.5839481465518475, + 0.36719924584031105, + 0.5767347700893879, + 0.5284192785620689, + 0.3866117112338543, + 0.16285430639982224, + 0.85976767167449, + 1.4692795649170876, + 0.5681601390242577, + 3.3155444841831923, + 0.032153189182281494, + 0.03002096340060234, + 0.042363423854112625, + 0.04178175330162048, + 0.3063802719116211, + 0.2997654788196087, + 0.4617830775678158, + 0.11498351395130157, + 0.6875373125076294, + 0.0, + 0.6989393699914217, + 0.5604540072381496, + 0.10761663317680359, + 0.03510567918419838, + 0.37984756007790565, + 2.087101835757494, + 0.6140841469168663, + 0.949447825551033, + 0.4849213808774948, + 0.0, + 0.975441500544548, + 0.21835479140281677, + 0.20355643332004547, + 0.1943264938890934, + 0.0799596905708313, + 0.548718087375164, + 0.7108325250446796, + 0.4247056730091572, + 0.0, + 1.128870215266943, + 0.34289609268307686, + 0.3523196466267109, + 0.069442979991436, + 0.0710526704788208, + 0.42688167840242386, + 0.2363843247294426, + 0.9431402813643217, + 0.30763643234968185, + 0.0, + 0.08503397181630135, + 0.0, + 0.07084092497825623, + 0.5946092493832111, + 0.02979125827550888, + 0.560353871434927, + 0.17638105526566505, + 0.28696469590067863, + 0.0855230949819088, + 0.0 + ], + "unique_experts": 57, + "load_cv": 1.1266305176722213, + "normalized_load_entropy": 0.8853749271975084, + "max_load_share": 0.10585585585585586 + }, + "full_input": { + "tokens": 115, + "top_k": 6, + "decisions": 690, + "ordered_route_sha256": "4d0b76c6248115bac57f2772cd950020fd8959a5920e5f3d9c6017a6d47f62b4", + "route_weight_sha256": "3a03592921e28a30f3d6bcc603d894f58334cd083c8cb64efa8ddffcfba92c98", + "loads": [ + 8, + 1, + 5, + 7, + 16, + 16, + 8, + 12, + 19, + 10, + 8, + 17, + 24, + 7, + 48, + 3, + 21, + 2, + 11, + 6, + 8, + 8, + 5, + 14, + 0, + 13, + 16, + 5, + 12, + 8, + 42, + 16, + 11, + 9, + 5, + 18, + 4, + 4, + 4, + 3, + 10, + 17, + 6, + 27, + 17, + 5, + 7, + 15, + 2, + 10, + 5, + 12, + 5, + 5, + 21, + 8, + 8, + 10, + 3, + 11, + 5, + 12, + 12, + 3 + ], + "weighted_loads": [ + 0.5085789263248444, + 0.03289951756596565, + 0.364399928599596, + 0.36305876448750496, + 0.990913100540638, + 0.7648310009390116, + 0.4041519798338413, + 0.7059781737625599, + 1.125569924712181, + 0.3866117112338543, + 0.404015532694757, + 0.9015010436996818, + 1.4692795649170876, + 0.5681601390242577, + 3.3538777846843004, + 0.10437605902552605, + 1.7961924821138382, + 0.05717982817441225, + 1.2173635140061378, + 0.3450568653643131, + 0.37205271050333977, + 0.5316690318286419, + 0.2229342795908451, + 0.9132369086146355, + 0.0, + 0.6989393699914217, + 0.676305890083313, + 0.15900593996047974, + 0.8423954211175442, + 0.37984756007790565, + 2.4548201002180576, + 0.9203995428979397, + 0.9822688437998295, + 0.4849213808774948, + 0.23617736995220184, + 1.6015856936573982, + 0.21835479140281677, + 0.20355643332004547, + 0.1943264938890934, + 0.1271304152905941, + 0.7486424818634987, + 0.7108325250446796, + 0.4247056730091572, + 2.3804950080811977, + 1.2660970762372017, + 0.34289609268307686, + 0.4423605836927891, + 1.0408049374818802, + 0.0710526704788208, + 0.68755853921175, + 0.2363843247294426, + 0.9431402813643217, + 0.30763643234968185, + 0.30233342573046684, + 1.2403038972988725, + 0.39696889743208885, + 0.54177176207304, + 0.6374393850564957, + 0.1323854885995388, + 0.7173705361783504, + 0.21414001658558846, + 0.6427638586610556, + 0.6201321519911289, + 0.1039716936647892 + ], + "unique_experts": 63, + "load_cv": 0.7859242702844456, + "normalized_load_entropy": 0.9384470175710906, + "max_load_share": 0.06956521739130435 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 74, + "ordered_topk_exact_tokens": 53, + "set_exact_tokens": 64, + "mean_set_jaccard": 0.9613899613899616, + "mean_token_weighted_tv": 0.009707793719261079, + "aggregate_load_tv": 0.013513513513513507 + }, + "system_bos": { + "tokens": 74, + "ordered_topk_exact_tokens": 42, + "set_exact_tokens": 54, + "mean_set_jaccard": 0.9198841698841699, + "mean_token_weighted_tv": 0.017726107475322647, + "aggregate_load_tv": 0.029279279279279282 + }, + "system_x": { + "tokens": 74, + "ordered_topk_exact_tokens": 34, + "set_exact_tokens": 45, + "mean_set_jaccard": 0.8752895752895753, + "mean_token_weighted_tv": 0.02663854815418253, + "aggregate_load_tv": 0.045045045045045036 + }, + "system_period": { + "tokens": 74, + "ordered_topk_exact_tokens": 36, + "set_exact_tokens": 45, + "mean_set_jaccard": 0.87998712998713, + "mean_token_weighted_tv": 0.026630889347477538, + "aggregate_load_tv": 0.04279279279279279 + }, + "bos_at_s0": { + "tokens": 74, + "ordered_topk_exact_tokens": 34, + "set_exact_tokens": 48, + "mean_set_jaccard": 0.8967181467181468, + "mean_token_weighted_tv": 0.02288189604626717, + "aggregate_load_tv": 0.038288288288288286 + }, + "bos_at_s1": { + "tokens": 74, + "ordered_topk_exact_tokens": 37, + "set_exact_tokens": 45, + "mean_set_jaccard": 0.8828828828828829, + "mean_token_weighted_tv": 0.025334459666565463, + "aggregate_load_tv": 0.04279279279279279 + }, + "x_at_s0": { + "tokens": 74, + "ordered_topk_exact_tokens": 37, + "set_exact_tokens": 49, + "mean_set_jaccard": 0.8976833976833977, + "mean_token_weighted_tv": 0.025532630536503887, + "aggregate_load_tv": 0.03603603603603603 + }, + "x_at_s1": { + "tokens": 74, + "ordered_topk_exact_tokens": 25, + "set_exact_tokens": 39, + "mean_set_jaccard": 0.853925353925354, + "mean_token_weighted_tv": 0.03338120127650532, + "aggregate_load_tv": 0.04729729729729729 + }, + "period_at_s0": { + "tokens": 74, + "ordered_topk_exact_tokens": 37, + "set_exact_tokens": 46, + "mean_set_jaccard": 0.8838481338481338, + "mean_token_weighted_tv": 0.027853985002415406, + "aggregate_load_tv": 0.040540540540540536 + }, + "period_at_s1": { + "tokens": 74, + "ordered_topk_exact_tokens": 25, + "set_exact_tokens": 39, + "mean_set_jaccard": 0.8561776061776062, + "mean_token_weighted_tv": 0.03286843516587003, + "aggregate_load_tv": 0.04954954954954955 + } + } + }, + "layer_12": { + "layer": 12, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "6e0b0f90176a33e021915c88f3c4642d1b59c9b6c2fe6ce49fa1fdc1c49b2e0c", + "route_weight_sha256": "847bc9364609da9056b310ce28966cd75d208abde959c6b38f5334baa0259a71", + "loads": [ + 4, + 1, + 7, + 9, + 2, + 6, + 48, + 8, + 6, + 1, + 2, + 12, + 4, + 7, + 0, + 3, + 8, + 5, + 4, + 4, + 5, + 15, + 10, + 12, + 1, + 8, + 0, + 6, + 9, + 3, + 0, + 4, + 6, + 9, + 8, + 12, + 6, + 15, + 4, + 1, + 28, + 1, + 1, + 7, + 7, + 2, + 11, + 2, + 8, + 4, + 14, + 10, + 9, + 2, + 27, + 7, + 7, + 7, + 3, + 3, + 2, + 3, + 3, + 1 + ], + "weighted_loads": [ + 0.15841355733573437, + 0.03759895637631416, + 0.36060235276818275, + 0.45201823487877846, + 0.06552196852862835, + 0.28707255981862545, + 3.373335665091872, + 0.4922771453857422, + 0.3057078421115875, + 0.02846030332148075, + 0.09813418611884117, + 0.6376847568899393, + 0.2420196495950222, + 0.31897280365228653, + 0.0, + 0.1459251120686531, + 0.4889163486659527, + 0.2635897137224674, + 0.20902646332979202, + 0.157616363838315, + 0.22518273815512657, + 0.9516921676695347, + 0.6228104904294014, + 0.9110703133046627, + 0.04295098036527634, + 0.3881955072283745, + 0.0, + 0.3698725514113903, + 0.6599775888025761, + 0.12998030334711075, + 0.0, + 0.3791627585887909, + 0.2452954612672329, + 0.9707663413137197, + 0.516078531742096, + 0.7079972587525845, + 0.23200451210141182, + 1.1028995290398598, + 0.16203861683607101, + 0.0445667989552021, + 2.2970955073833466, + 0.024555856361985207, + 0.036691032350063324, + 0.48424093425273895, + 0.34693731740117073, + 0.11992151662707329, + 0.6924332324415445, + 0.08037389814853668, + 0.4116277229040861, + 0.14302902109920979, + 1.2077083736658096, + 0.5157422069460154, + 0.6617720611393452, + 0.08333352208137512, + 1.6567959506064653, + 0.30902162939310074, + 0.45031316950917244, + 0.3119140602648258, + 0.11866912618279457, + 0.1157754436135292, + 0.05989254452288151, + 0.16637242585420609, + 0.3284175582230091, + 0.03354545310139656 + ], + "unique_experts": 61, + "load_cv": 1.0735095215987762, + "normalized_load_entropy": 0.9011331552277737, + "max_load_share": 0.10810810810810811 + }, + "full_input": { + "tokens": 99, + "top_k": 6, + "decisions": 594, + "ordered_route_sha256": "89a6b12520e2382f72995478c1b009c50d56650f8c5636693af2450d7684cf42", + "route_weight_sha256": "a43d49f21572637bbfe6b8122c89e304545974eefa48156f24f706ef4b33da75", + "loads": [ + 4, + 1, + 7, + 14, + 6, + 7, + 48, + 10, + 13, + 1, + 2, + 12, + 9, + 7, + 0, + 3, + 9, + 5, + 4, + 4, + 6, + 15, + 11, + 17, + 1, + 9, + 1, + 13, + 24, + 13, + 3, + 9, + 7, + 11, + 8, + 19, + 6, + 19, + 18, + 1, + 28, + 7, + 7, + 8, + 9, + 3, + 12, + 8, + 11, + 4, + 15, + 10, + 9, + 2, + 27, + 7, + 10, + 7, + 4, + 7, + 2, + 7, + 9, + 4 + ], + "weighted_loads": [ + 0.15841355733573437, + 0.03759895637631416, + 0.36060235276818275, + 0.5798819959163666, + 1.6828660741448402, + 0.29118089424446225, + 3.373335665091872, + 0.6040043607354164, + 0.8436511140316725, + 0.02846030332148075, + 0.09813418611884117, + 0.6376847568899393, + 0.4690322130918503, + 0.31897280365228653, + 0.0, + 0.1459251120686531, + 0.569912251085043, + 0.2635897137224674, + 0.20902646332979202, + 0.157616363838315, + 0.22751016356050968, + 0.9516921676695347, + 0.6731754839420319, + 1.3683591112494469, + 0.04295098036527634, + 0.43578293174505234, + 0.03280985727906227, + 0.7664591334760189, + 2.5240561328828335, + 1.6177517138421535, + 0.1052259961143136, + 0.6274100989103317, + 0.291787076741457, + 1.0679252911359072, + 0.516078531742096, + 1.206657376140356, + 0.23200451210141182, + 1.2161887446418405, + 1.377291414886713, + 0.0445667989552021, + 2.2970955073833466, + 0.5266330782324076, + 0.41880742833018303, + 0.5653904601931572, + 0.4345579333603382, + 0.15894972160458565, + 0.7415761146694422, + 0.39498095214366913, + 0.5620972272008657, + 0.14302902109920979, + 1.2206762246787548, + 0.5157422069460154, + 0.6617720611393452, + 0.08333352208137512, + 1.6567959506064653, + 0.30902162939310074, + 0.5570190059952438, + 0.3119140602648258, + 0.17815351486206055, + 0.27845674101263285, + 0.05989254452288151, + 0.3230206873267889, + 0.5665845591574907, + 0.13101629354059696 + ], + "unique_experts": 63, + "load_cv": 0.8346841413909426, + "normalized_load_entropy": 0.9306747541518803, + "max_load_share": 0.08080808080808081 + } + }, + "s1_eos": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "0485686fbf0eed53e74f8ab658b7452abcbd3d6672b279acfa628476cfbfea9c", + "route_weight_sha256": "14dc85cb8db821a850eeecc2f20bcb2cf5ad9ac0fe1383f54680b08d2318d2f8", + "loads": [ + 3, + 1, + 6, + 12, + 0, + 8, + 48, + 8, + 6, + 0, + 2, + 10, + 4, + 7, + 0, + 2, + 7, + 5, + 4, + 3, + 5, + 14, + 9, + 12, + 1, + 8, + 1, + 6, + 10, + 2, + 0, + 5, + 5, + 9, + 8, + 13, + 8, + 15, + 3, + 2, + 28, + 2, + 2, + 7, + 9, + 2, + 10, + 2, + 8, + 5, + 15, + 9, + 9, + 1, + 25, + 7, + 9, + 6, + 3, + 3, + 2, + 3, + 4, + 1 + ], + "weighted_loads": [ + 0.1378423348069191, + 0.03689071536064148, + 0.3026015479117632, + 0.5275924913585186, + 0.0, + 0.3559726532548666, + 3.4166716635227203, + 0.49765385314822197, + 0.30357713624835014, + 0.0, + 0.10030296444892883, + 0.5659233927726746, + 0.24595651403069496, + 0.3288835994899273, + 0.0, + 0.11907988786697388, + 0.4459528215229511, + 0.2686213180422783, + 0.21159745007753372, + 0.13922128826379776, + 0.23613590002059937, + 0.9060673639178276, + 0.603478841483593, + 0.9180114809423685, + 0.04416818544268608, + 0.4093664437532425, + 0.031561270356178284, + 0.38220441341400146, + 0.7136758901178837, + 0.09173649549484253, + 0.0, + 0.43296271562576294, + 0.20139238983392715, + 0.9824364632368088, + 0.5358439348638058, + 0.7485148198902607, + 0.2911230269819498, + 1.0836520455777645, + 0.12472660467028618, + 0.0750411432236433, + 2.2638614363968372, + 0.054352765902876854, + 0.07576952129602432, + 0.488675132393837, + 0.42645331658422947, + 0.11944178864359856, + 0.6686346121132374, + 0.0788588710129261, + 0.3941162098199129, + 0.19326446391642094, + 1.234012009575963, + 0.483896866440773, + 0.6556132473051548, + 0.051774729043245316, + 1.5489202607423067, + 0.3041422385722399, + 0.5015879925340414, + 0.2616812214255333, + 0.11804309487342834, + 0.11864311248064041, + 0.0642370916903019, + 0.17395301908254623, + 0.36274219304323196, + 0.03445091098546982 + ], + "unique_experts": 60, + "load_cv": 1.0680521194794377, + "normalized_load_entropy": 0.8998608261216425, + "max_load_share": 0.10810810810810811 + }, + "full_input": { + "tokens": 115, + "top_k": 6, + "decisions": 690, + "ordered_route_sha256": "19eefef858ddcaf9543f600e7a922e4e8af64091e707e2cf46e0361f6d27bf0a", + "route_weight_sha256": "3386d5263f2209324d4112a8986ea532996721ddf2ee60b517ddb4e957d9835a", + "loads": [ + 7, + 1, + 6, + 15, + 4, + 9, + 48, + 13, + 13, + 3, + 3, + 10, + 9, + 7, + 0, + 2, + 10, + 7, + 5, + 3, + 6, + 16, + 11, + 18, + 1, + 9, + 4, + 13, + 27, + 17, + 11, + 10, + 9, + 14, + 13, + 21, + 8, + 19, + 21, + 2, + 28, + 14, + 10, + 11, + 22, + 6, + 13, + 9, + 15, + 5, + 17, + 9, + 9, + 4, + 25, + 8, + 12, + 10, + 4, + 8, + 4, + 11, + 10, + 1 + ], + "weighted_loads": [ + 0.3299537543207407, + 0.03689071536064148, + 0.3026015479117632, + 0.5833204290829599, + 1.62355862185359, + 0.3599190660752356, + 3.4166716635227203, + 0.7594293020665646, + 0.9369762539863586, + 0.31203586608171463, + 0.1435179002583027, + 0.5659233927726746, + 0.4453396759927273, + 0.3288835994899273, + 0.0, + 0.11907988786697388, + 0.6698827929794788, + 0.38260118290781975, + 0.24745383486151695, + 0.13922128826379776, + 0.238471198361367, + 0.9957055822014809, + 0.6894588097929955, + 1.3869150336831808, + 0.04416818544268608, + 0.45208142325282097, + 0.15432226657867432, + 0.748498197644949, + 2.914360586553812, + 2.353258542716503, + 0.8682461502030492, + 0.6629080399870872, + 0.3788094259798527, + 1.2889825105667114, + 0.784682285040617, + 1.3586746156215668, + 0.2911230269819498, + 1.2596102124080062, + 1.5992040783166885, + 0.0750411432236433, + 2.2638614363968372, + 1.0438668709248304, + 0.5524119511246681, + 0.72386734187603, + 1.6228344980627298, + 0.42694754898548126, + 0.8090632781386375, + 0.43991813249886036, + 0.7254011575132608, + 0.19326446391642094, + 1.3001219350844622, + 0.483896866440773, + 0.6556132473051548, + 0.20712435245513916, + 1.5489202607423067, + 0.33550466783344746, + 0.5808551288209856, + 0.4540947414934635, + 0.17551052570343018, + 0.3012239169329405, + 0.13529779948294163, + 0.5752883329987526, + 0.6289999708533287, + 0.03445091098546982 + ], + "unique_experts": 63, + "load_cv": 0.7318998419879276, + "normalized_load_entropy": 0.9422602554430389, + "max_load_share": 0.06956521739130435 + } + }, + "s0_bos": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "6a35419051a2c6e9f8fc107c8e92d729c22ef89e976f1ba2745ef6e46b31c883", + "route_weight_sha256": "1773855b9318325c707f4e24951f0ca4b610289e331f988501a5f006b38abb7e", + "loads": [ + 5, + 1, + 5, + 13, + 1, + 7, + 47, + 8, + 9, + 0, + 2, + 10, + 5, + 7, + 0, + 3, + 9, + 5, + 4, + 4, + 5, + 13, + 10, + 10, + 2, + 8, + 0, + 5, + 10, + 1, + 0, + 4, + 5, + 8, + 6, + 14, + 7, + 15, + 4, + 2, + 27, + 1, + 0, + 10, + 7, + 2, + 11, + 2, + 7, + 3, + 14, + 11, + 10, + 1, + 26, + 6, + 7, + 7, + 3, + 4, + 2, + 3, + 4, + 2 + ], + "weighted_loads": [ + 0.21172218210995197, + 0.03697876259684563, + 0.3145253323018551, + 0.5500630848109722, + 0.038139406591653824, + 0.33295875042676926, + 3.4409025963395834, + 0.50542102009058, + 0.4114692844450474, + 0.0, + 0.10358807817101479, + 0.582549799233675, + 0.27558983117341995, + 0.3264598660171032, + 0.0, + 0.15883318707346916, + 0.5732832029461861, + 0.27001602575182915, + 0.21880702674388885, + 0.15938974171876907, + 0.2020044717937708, + 0.8821498267352581, + 0.6239824555814266, + 0.839365778490901, + 0.0779520608484745, + 0.3783445358276367, + 0.0, + 0.3216841984540224, + 0.7183825895190239, + 0.05138044431805611, + 0.0, + 0.37331485748291016, + 0.1951281689107418, + 0.8807950802147388, + 0.46708839759230614, + 0.9163446463644505, + 0.2641922514885664, + 1.1109726764261723, + 0.1531037762761116, + 0.0768015943467617, + 2.243268247693777, + 0.02594376541674137, + 0.0, + 0.5787270218133926, + 0.37586796656250954, + 0.11716285720467567, + 0.7269527949392796, + 0.07623551413416862, + 0.4073449783027172, + 0.13405966758728027, + 1.223693884909153, + 0.5889717992395163, + 0.7129147462546825, + 0.05391975864768028, + 1.623365342617035, + 0.279347674921155, + 0.4122353158891201, + 0.3098107911646366, + 0.11593577638268471, + 0.13815411366522312, + 0.06932072900235653, + 0.17844616621732712, + 0.3699582852423191, + 0.06672743335366249 + ], + "unique_experts": 59, + "load_cv": 1.056745620241927, + "normalized_load_entropy": 0.8995090233215823, + "max_load_share": 0.10585585585585586 + }, + "full_input": { + "tokens": 99, + "top_k": 6, + "decisions": 594, + "ordered_route_sha256": "a1cee2c92145a06f2797c49b84e4684cc40cc0adc876e51ca353cc3bf7bdd56c", + "route_weight_sha256": "2c741ff97385506c8914d48de676cbff4fb02f18ac1172daefb9d62c266e8ffa", + "loads": [ + 5, + 1, + 5, + 17, + 4, + 7, + 47, + 10, + 16, + 0, + 2, + 10, + 11, + 7, + 0, + 3, + 13, + 5, + 4, + 4, + 5, + 13, + 11, + 15, + 2, + 9, + 2, + 12, + 26, + 11, + 2, + 9, + 7, + 10, + 6, + 21, + 7, + 19, + 18, + 2, + 27, + 7, + 5, + 12, + 9, + 3, + 12, + 7, + 11, + 3, + 15, + 11, + 10, + 1, + 26, + 6, + 9, + 7, + 4, + 8, + 2, + 7, + 9, + 5 + ], + "weighted_loads": [ + 0.21172218210995197, + 0.03697876259684563, + 0.3145253323018551, + 0.6747971307486296, + 0.7055216114968061, + 0.33295875042676926, + 3.4409025963395834, + 0.6162476390600204, + 1.0016631316393614, + 0.0, + 0.10358807817101479, + 0.582549799233675, + 0.5697323754429817, + 0.3264598660171032, + 0.0, + 0.15883318707346916, + 0.7565218880772591, + 0.27001602575182915, + 0.21880702674388885, + 0.15938974171876907, + 0.2020044717937708, + 0.8821498267352581, + 0.6743474490940571, + 1.2966545764356852, + 0.0779520608484745, + 0.42498571053147316, + 0.07750803604722023, + 0.718270780518651, + 2.6004442293196917, + 1.6482500061392784, + 0.06289747823029757, + 0.6306438222527504, + 0.27782778814435005, + 0.9748759381473064, + 0.46708839759230614, + 1.415004763752222, + 0.2641922514885664, + 1.224261892028153, + 1.448125347495079, + 0.0768015943467617, + 2.243268247693777, + 0.5488847363740206, + 0.34750450029969215, + 0.7089050561189651, + 0.4658265709877014, + 0.15619106218218803, + 0.77763981372118, + 0.3497217334806919, + 0.5950308814644814, + 0.13405966758728027, + 1.2366617359220982, + 0.5889717992395163, + 0.7129147462546825, + 0.05391975864768028, + 1.623365342617035, + 0.279347674921155, + 0.5143320672214031, + 0.3098107911646366, + 0.17547191679477692, + 0.3429127046838403, + 0.06932072900235653, + 0.33509442768990993, + 0.5620837938040495, + 0.1641982737928629 + ], + "unique_experts": 62, + "load_cv": 0.8381539311285976, + "normalized_load_entropy": 0.9285962478719781, + "max_load_share": 0.07912457912457913 + } + }, + "s1_bos": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "4387258c575b75d15b038b4d72b85f3a5f07eb1ce0179f5d2b257697c9e81502", + "route_weight_sha256": "f028c754ddbd015295e551cb73dc46de53a3976edc3a69c16930bc310f10263e", + "loads": [ + 4, + 1, + 7, + 11, + 2, + 9, + 48, + 8, + 9, + 0, + 2, + 10, + 3, + 7, + 0, + 3, + 7, + 5, + 4, + 4, + 5, + 13, + 10, + 11, + 2, + 7, + 1, + 4, + 10, + 2, + 0, + 4, + 5, + 9, + 8, + 14, + 6, + 15, + 3, + 2, + 28, + 2, + 2, + 8, + 8, + 2, + 11, + 2, + 7, + 2, + 15, + 11, + 9, + 1, + 25, + 7, + 9, + 4, + 3, + 3, + 2, + 3, + 4, + 1 + ], + "weighted_loads": [ + 0.1625646222382784, + 0.03733466938138008, + 0.34744133055210114, + 0.5019480306655169, + 0.06936541013419628, + 0.3990472462028265, + 3.4533666502684355, + 0.5078829042613506, + 0.3965028841048479, + 0.0, + 0.1020481176674366, + 0.5496725626289845, + 0.220772884786129, + 0.31307584419846535, + 0.0, + 0.14930976927280426, + 0.465083722025156, + 0.27122581377625465, + 0.21291684359312057, + 0.17246533185243607, + 0.21511571295559406, + 0.8877929076552391, + 0.6398422606289387, + 0.8947754930704832, + 0.07553023099899292, + 0.35676639899611473, + 0.03735658898949623, + 0.2757929898798466, + 0.7358523905277252, + 0.08807039633393288, + 0.0, + 0.37744511663913727, + 0.18856057710945606, + 0.9497072659432888, + 0.5323028936982155, + 0.8981748223304749, + 0.2244046814739704, + 1.1062357500195503, + 0.11940355971455574, + 0.07612501457333565, + 2.159073870629072, + 0.052696626633405685, + 0.07545045390725136, + 0.5065958630293608, + 0.4100089818239212, + 0.11696143820881844, + 0.7156567610800266, + 0.08631399273872375, + 0.4017064645886421, + 0.08791228383779526, + 1.2875426411628723, + 0.5552906226366758, + 0.6696134097874165, + 0.05418883636593819, + 1.5524968951940536, + 0.3165676034986973, + 0.518664238974452, + 0.195756945759058, + 0.11468981951475143, + 0.1089581772685051, + 0.07076830789446831, + 0.17842202633619308, + 0.36198844388127327, + 0.03501465171575546 + ], + "unique_experts": 61, + "load_cv": 1.0677481126079895, + "normalized_load_entropy": 0.9016622791484049, + "max_load_share": 0.10810810810810811 + }, + "full_input": { + "tokens": 115, + "top_k": 6, + "decisions": 690, + "ordered_route_sha256": "f761485b1caac0525c801bcf66efe7ec59ed7abfa8760ef770fcccf54c5b3e4e", + "route_weight_sha256": "228e5cff73175ddc15b96c466199b870cff99c63fd8e9c9b2f577e49898847a5", + "loads": [ + 8, + 1, + 7, + 13, + 5, + 9, + 48, + 14, + 16, + 3, + 3, + 10, + 8, + 7, + 0, + 3, + 11, + 7, + 5, + 4, + 5, + 15, + 12, + 17, + 2, + 7, + 4, + 11, + 27, + 20, + 11, + 10, + 9, + 14, + 13, + 22, + 6, + 19, + 21, + 2, + 28, + 14, + 9, + 12, + 21, + 6, + 14, + 9, + 15, + 2, + 17, + 11, + 9, + 4, + 25, + 8, + 11, + 8, + 4, + 8, + 4, + 11, + 10, + 1 + ], + "weighted_loads": [ + 0.3546760417521, + 0.03733466938138008, + 0.34744133055210114, + 0.5547312498092651, + 0.7426409218460321, + 0.3990472462028265, + 3.4533666502684355, + 0.8013696447014809, + 1.087712975218892, + 0.31203586608171463, + 0.14526305347681046, + 0.5496725626289845, + 0.47220513597130775, + 0.31307584419846535, + 0.0, + 0.14930976927280426, + 0.7269867844879627, + 0.3852056786417961, + 0.2487732283771038, + 0.17246533185243607, + 0.21511571295559406, + 0.9774311259388924, + 0.7258222289383411, + 1.3636790458112955, + 0.07553023099899292, + 0.35676639899611473, + 0.16011758521199226, + 0.6420867741107941, + 3.0526436790823936, + 2.6519308239221573, + 0.8682461502030492, + 0.6420414000749588, + 0.3659776132553816, + 1.2510820925235748, + 0.7811412438750267, + 1.508334618061781, + 0.2244046814739704, + 1.282193916849792, + 1.703349530696869, + 0.07612501457333565, + 2.159073870629072, + 1.058954168111086, + 0.5099760070443153, + 0.7735837753862143, + 1.6044992990791798, + 0.42446719855070114, + 0.8561130054295063, + 0.45206194929778576, + 0.7718907073140144, + 0.08791228383779526, + 1.3536525666713715, + 0.5552906226366758, + 0.6696134097874165, + 0.20953845977783203, + 1.5524968951940536, + 0.34793003275990486, + 0.5781861748546362, + 0.3881704658269882, + 0.1740756407380104, + 0.31372549291700125, + 0.14182901568710804, + 0.5797573402523994, + 0.6304553970694542, + 0.03501465171575546 + ], + "unique_experts": 63, + "load_cv": 0.7368421526405792, + "normalized_load_entropy": 0.9418180807202126, + "max_load_share": 0.06956521739130435 + } + }, + "s0_x": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "95de67b1f81cd4eb37488cc071808fcc77f987b4f899a4dc17609b129f9728df", + "route_weight_sha256": "f332da06a61a75f87a1ecd2259f1201555c40fb7817b767d86ad1872104650cc", + "loads": [ + 4, + 1, + 8, + 11, + 2, + 6, + 49, + 8, + 8, + 1, + 2, + 11, + 4, + 7, + 0, + 3, + 8, + 6, + 4, + 4, + 4, + 16, + 9, + 11, + 1, + 7, + 1, + 4, + 10, + 2, + 0, + 4, + 5, + 8, + 7, + 14, + 7, + 15, + 3, + 2, + 26, + 2, + 1, + 6, + 8, + 3, + 10, + 2, + 7, + 2, + 13, + 11, + 9, + 2, + 27, + 6, + 10, + 7, + 3, + 3, + 2, + 2, + 4, + 1 + ], + "weighted_loads": [ + 0.15453646518290043, + 0.03812920302152634, + 0.4058507662266493, + 0.5035290755331516, + 0.07286747172474861, + 0.29957652278244495, + 3.531142108142376, + 0.5016277395188808, + 0.35745101794600487, + 0.03313301131129265, + 0.09791727736592293, + 0.629824660718441, + 0.24409813061356544, + 0.3130251560360193, + 0.0, + 0.15989361330866814, + 0.5017222948372364, + 0.30463265627622604, + 0.21884525194764137, + 0.15840997360646725, + 0.17292619869112968, + 1.0121844559907913, + 0.561613705009222, + 0.8746151532977819, + 0.041551753878593445, + 0.35973572731018066, + 0.03824945539236069, + 0.3056454062461853, + 0.718452412635088, + 0.08450938016176224, + 0.0, + 0.3709063194692135, + 0.2078002505004406, + 0.9014542885124683, + 0.47547899931669235, + 0.899663582444191, + 0.24514839798212051, + 1.0859791785478592, + 0.12762848660349846, + 0.07802334800362587, + 2.084592044353485, + 0.05687720514833927, + 0.03787759318947792, + 0.4286445900797844, + 0.3988075517117977, + 0.17123980820178986, + 0.7062966171652079, + 0.07286256551742554, + 0.36624088883399963, + 0.08714324608445168, + 1.239100432023406, + 0.5690008476376534, + 0.6796797029674053, + 0.08339544758200645, + 1.6957385558634996, + 0.2759335972368717, + 0.5409720800817013, + 0.31727344542741776, + 0.11938056349754333, + 0.10881839692592621, + 0.07097232714295387, + 0.12415396049618721, + 0.3557286709547043, + 0.03385169431567192 + ], + "unique_experts": 62, + "load_cv": 1.078638381504827, + "normalized_load_entropy": 0.9019259962715266, + "max_load_share": 0.11036036036036036 + }, + "full_input": { + "tokens": 99, + "top_k": 6, + "decisions": 594, + "ordered_route_sha256": "eaf805da495d7a4f45a6f5c21c06cd61957030eb8b7bbc8f39dcd8ab4bef3e45", + "route_weight_sha256": "87985fea325969ef6914ff581f09514fa25595656f8cdbfa3010bc7c9ea04b5b", + "loads": [ + 4, + 1, + 8, + 15, + 5, + 6, + 49, + 10, + 15, + 1, + 2, + 11, + 8, + 7, + 0, + 3, + 10, + 6, + 4, + 4, + 4, + 16, + 10, + 17, + 1, + 8, + 2, + 12, + 27, + 12, + 3, + 9, + 6, + 10, + 7, + 22, + 7, + 19, + 18, + 3, + 26, + 7, + 5, + 7, + 10, + 5, + 11, + 8, + 11, + 2, + 14, + 11, + 9, + 2, + 27, + 6, + 12, + 7, + 4, + 6, + 2, + 7, + 9, + 4 + ], + "weighted_loads": [ + 0.15453646518290043, + 0.03812920302152634, + 0.4058507662266493, + 0.628263121470809, + 0.7402496766299009, + 0.29957652278244495, + 3.531142108142376, + 0.6129236742854118, + 0.8897598180919886, + 0.03313301131129265, + 0.09791727736592293, + 0.629824660718441, + 0.4359646774828434, + 0.3130251560360193, + 0.0, + 0.15989361330866814, + 0.6160053126513958, + 0.30463265627622604, + 0.21884525194764137, + 0.15840997360646725, + 0.17292619869112968, + 1.0121844559907913, + 0.6119786985218525, + 1.481735648587346, + 0.041551753878593445, + 0.4286564588546753, + 0.07105931267142296, + 0.7597570903599262, + 2.8396690599620342, + 1.3979497589170933, + 0.11711077112704515, + 0.6338075026869774, + 0.2542918659746647, + 0.9887206964194775, + 0.47547899931669235, + 1.4734739661216736, + 0.24514839798212051, + 1.1992683941498399, + 1.359653901308775, + 0.12198381498456001, + 2.084592044353485, + 0.5320894252508879, + 0.3395310752093792, + 0.500949427485466, + 0.49185333773493767, + 0.26196417212486267, + 0.7559925634413958, + 0.35641562566161156, + 0.5687450878322124, + 0.08714324608445168, + 1.2520682830363512, + 0.5690008476376534, + 0.6796797029674053, + 0.08339544758200645, + 1.6957385558634996, + 0.2759335972368717, + 0.6430688314139843, + 0.31727344542741776, + 0.18096208944916725, + 0.2522656237706542, + 0.07097232714295387, + 0.350078159943223, + 0.5379935447126627, + 0.13132253475487232 + ], + "unique_experts": 63, + "load_cv": 0.8561396458782022, + "normalized_load_entropy": 0.9287809267604418, + "max_load_share": 0.08249158249158249 + } + }, + "s1_x": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "fc6781d5b80b72107ddb6e3283cf8240f9d48ced980d3df0924d2626b45efe40", + "route_weight_sha256": "983cc6e1b021fab69374bdabe68fd912d18dedb92b1ae3369b47cf7b68314785", + "loads": [ + 5, + 1, + 7, + 10, + 2, + 7, + 47, + 8, + 7, + 0, + 1, + 9, + 4, + 8, + 0, + 3, + 6, + 6, + 4, + 3, + 4, + 14, + 10, + 10, + 2, + 7, + 1, + 5, + 10, + 2, + 0, + 4, + 6, + 9, + 7, + 16, + 7, + 15, + 4, + 2, + 28, + 2, + 3, + 8, + 7, + 2, + 11, + 2, + 8, + 0, + 15, + 11, + 9, + 2, + 26, + 8, + 10, + 6, + 3, + 1, + 2, + 3, + 3, + 1 + ], + "weighted_loads": [ + 0.19066166132688522, + 0.03974328562617302, + 0.3506775423884392, + 0.49590560235083103, + 0.07185384631156921, + 0.3369089774787426, + 3.502792451530695, + 0.5069174394011497, + 0.3204372227191925, + 0.0, + 0.0633792132139206, + 0.5229882635176182, + 0.2504645921289921, + 0.3323540519922972, + 0.0, + 0.17035963758826256, + 0.40589654445648193, + 0.3009609207510948, + 0.20424958691000938, + 0.11145740374922752, + 0.18553723581135273, + 0.9328965395689011, + 0.6364956237375736, + 0.8617368526756763, + 0.06736527755856514, + 0.3689795285463333, + 0.04375539347529411, + 0.31862661615014076, + 0.7309330217540264, + 0.15071182698011398, + 0.0, + 0.3804874122142792, + 0.23086683079600334, + 0.9660211503505707, + 0.4571462348103523, + 1.051753919571638, + 0.253330921754241, + 1.1023267321288586, + 0.2212815135717392, + 0.07363489083945751, + 2.06891462020576, + 0.051379287615418434, + 0.137395977973938, + 0.502100046724081, + 0.3151603154838085, + 0.12429675087332726, + 0.7314059846103191, + 0.08863268047571182, + 0.39827257208526134, + 0.0, + 1.3227068334817886, + 0.5541179925203323, + 0.6723712403327227, + 0.08013327419757843, + 1.6111644729971886, + 0.3475523851811886, + 0.5659040231257677, + 0.2790962904691696, + 0.11692667379975319, + 0.033594273030757904, + 0.06712573766708374, + 0.1737256795167923, + 0.31185847893357277, + 0.03636160492897034 + ], + "unique_experts": 60, + "load_cv": 1.0671398390486289, + "normalized_load_entropy": 0.8990945716257278, + "max_load_share": 0.10585585585585586 + }, + "full_input": { + "tokens": 115, + "top_k": 6, + "decisions": 690, + "ordered_route_sha256": "f21e7b73cbc2c4abc62616f66f5343ef43a4d99bc9ed9874471ae86262abbab2", + "route_weight_sha256": "333a6c6775144b6f51c59337203c778f20fd727777140ecff00d0ca748a68e64", + "loads": [ + 9, + 1, + 7, + 12, + 5, + 7, + 47, + 14, + 14, + 3, + 2, + 9, + 8, + 8, + 0, + 3, + 10, + 8, + 5, + 3, + 4, + 17, + 12, + 17, + 2, + 8, + 4, + 13, + 29, + 17, + 12, + 9, + 10, + 14, + 12, + 25, + 7, + 19, + 22, + 3, + 28, + 13, + 8, + 12, + 20, + 7, + 14, + 8, + 15, + 0, + 17, + 11, + 9, + 5, + 26, + 9, + 11, + 11, + 4, + 5, + 4, + 13, + 8, + 1 + ], + "weighted_loads": [ + 0.3827730808407068, + 0.03974328562617302, + 0.3506775423884392, + 0.5486888214945793, + 0.7451293580234051, + 0.3369089774787426, + 3.502792451530695, + 0.8166847266256809, + 0.8981047123670578, + 0.31203586608171463, + 0.10659414902329445, + 0.5229882635176182, + 0.418707050383091, + 0.3323540519922972, + 0.0, + 0.17035963758826256, + 0.6446762308478355, + 0.4149407856166363, + 0.24010597169399261, + 0.11145740374922752, + 0.18553723581135273, + 1.0541808642446995, + 0.7224755920469761, + 1.460586965084076, + 0.06736527755856514, + 0.4301932007074356, + 0.16651638969779015, + 0.7608829364180565, + 3.2334688790142536, + 2.2298123091459274, + 0.9153834627941251, + 0.6374285705387592, + 0.40828386694192886, + 1.2581608667969704, + 0.7059845849871635, + 1.7598906904459, + 0.253330921754241, + 1.2782848989591002, + 1.7067226022481918, + 0.11116236634552479, + 2.06891462020576, + 1.011267652735114, + 0.4727679267525673, + 0.7765073403716087, + 1.527768813073635, + 0.47248971089720726, + 0.8739418126642704, + 0.37560333125293255, + 0.7252519261091948, + 0.0, + 1.3888167589902878, + 0.5541179925203323, + 0.6723712403327227, + 0.23548289760947227, + 1.6111644729971886, + 0.37891481444239616, + 0.5936649646610022, + 0.49978116527199745, + 0.16829074546694756, + 0.197194735519588, + 0.13818644545972347, + 0.6593146715313196, + 0.5353048071265221, + 0.03636160492897034 + ], + "unique_experts": 62, + "load_cv": 0.7473484599883263, + "normalized_load_entropy": 0.9387455539463718, + "max_load_share": 0.06811594202898551 + } + }, + "s0_period": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "bf601bbb35f9eac1d9949f8125b9a1ad8d6d786a62597fe66db905f680cb6aaa", + "route_weight_sha256": "6ffb3853cba499c22ce4098ef23a7867c932d53a103ac8bee6c78233c0779db2", + "loads": [ + 5, + 1, + 7, + 11, + 2, + 6, + 50, + 8, + 6, + 0, + 2, + 11, + 5, + 7, + 0, + 3, + 8, + 5, + 3, + 5, + 4, + 16, + 11, + 11, + 2, + 7, + 1, + 5, + 9, + 1, + 0, + 4, + 4, + 8, + 6, + 14, + 7, + 15, + 3, + 2, + 26, + 2, + 1, + 7, + 7, + 3, + 11, + 2, + 8, + 4, + 13, + 11, + 9, + 1, + 27, + 5, + 9, + 8, + 3, + 3, + 2, + 2, + 4, + 1 + ], + "weighted_loads": [ + 0.20630132965743542, + 0.03737146034836769, + 0.3731817305088043, + 0.49817148223519325, + 0.07088049873709679, + 0.29414105229079723, + 3.589578043669462, + 0.5103359781205654, + 0.2954878397285938, + 0.0, + 0.10306332632899284, + 0.6191475931555033, + 0.2749314047396183, + 0.3188303280621767, + 0.0, + 0.16581393033266068, + 0.494539238512516, + 0.2689530551433563, + 0.17798802629113197, + 0.18873340636491776, + 0.1710989996790886, + 1.02309038490057, + 0.6516303084790707, + 0.8868980780243874, + 0.07672145962715149, + 0.3588464595377445, + 0.03500279411673546, + 0.3414010554552078, + 0.7240499071776867, + 0.05264829099178314, + 0.0, + 0.37905003502964973, + 0.16416047140955925, + 0.9125738777220249, + 0.4464138448238373, + 0.9308690614998341, + 0.2549507413059473, + 1.0666914768517017, + 0.12140385434031487, + 0.07881191000342369, + 2.0896503143012524, + 0.05528532154858112, + 0.03757670894265175, + 0.4696161486208439, + 0.3669750615954399, + 0.1738184541463852, + 0.7456524949520826, + 0.07304412499070168, + 0.3785284459590912, + 0.1519842930138111, + 1.2659880071878433, + 0.5759077854454517, + 0.6851619258522987, + 0.05310622975230217, + 1.6932403184473515, + 0.24197860807180405, + 0.5094635337591171, + 0.3413705099374056, + 0.11876757442951202, + 0.11088309064507484, + 0.07174855098128319, + 0.11689287051558495, + 0.3652525953948498, + 0.034375667572021484 + ], + "unique_experts": 61, + "load_cv": 1.093583858414669, + "normalized_load_entropy": 0.899169119479675, + "max_load_share": 0.11261261261261261 + }, + "full_input": { + "tokens": 99, + "top_k": 6, + "decisions": 594, + "ordered_route_sha256": "93a4282d05ff71e0a3df5dc3b7c4b0c79494d70f14ec269ca3f49c4fd8063ed2", + "route_weight_sha256": "0072f1ca5ac62ad22f7e94d4a3ea123d27d73aa8ffc22275c83d8366628884aa", + "loads": [ + 5, + 1, + 7, + 15, + 5, + 6, + 50, + 11, + 13, + 0, + 2, + 11, + 9, + 7, + 0, + 3, + 11, + 5, + 3, + 5, + 4, + 16, + 12, + 17, + 2, + 8, + 2, + 13, + 25, + 10, + 3, + 9, + 6, + 10, + 6, + 22, + 7, + 19, + 17, + 3, + 26, + 8, + 5, + 9, + 9, + 4, + 12, + 8, + 11, + 4, + 14, + 11, + 9, + 1, + 27, + 5, + 11, + 8, + 4, + 6, + 2, + 7, + 9, + 4 + ], + "weighted_loads": [ + 0.20630132965743542, + 0.03737146034836769, + 0.3731817305088043, + 0.6229055281728506, + 0.7382627036422491, + 0.29414105229079723, + 3.589578043669462, + 0.6639817208051682, + 0.8121338132768869, + 0.0, + 0.10306332632899284, + 0.6191475931555033, + 0.46848753839731216, + 0.3188303280621767, + 0.0, + 0.16581393033266068, + 0.6723050810396671, + 0.2689530551433563, + 0.17798802629113197, + 0.18873340636491776, + 0.1710989996790886, + 1.02309038490057, + 0.7019953019917011, + 1.402564276009798, + 0.07672145962715149, + 0.4276622198522091, + 0.06781265139579773, + 0.7759877778589725, + 2.8697397746145725, + 1.3154392130672932, + 0.09765395987778902, + 0.642299197614193, + 0.250776294618845, + 1.001270666718483, + 0.4464138448238373, + 1.4781163036823273, + 0.2549507413059473, + 1.1799806924536824, + 1.3140783570706844, + 0.12606296315789223, + 2.0896503143012524, + 0.6114750374108553, + 0.33762115240097046, + 0.5750194005668163, + 0.4659385718405247, + 0.21284665912389755, + 0.7937166560441256, + 0.34988038055598736, + 0.5468226410448551, + 0.1519842930138111, + 1.2789558582007885, + 0.5759077854454517, + 0.6851619258522987, + 0.05310622975230217, + 1.6932403184473515, + 0.24197860807180405, + 0.6115602850914001, + 0.3413705099374056, + 0.18035751208662987, + 0.25617008935660124, + 0.07174855098128319, + 0.3260009530931711, + 0.5604817736893892, + 0.13184650801122189 + ], + "unique_experts": 62, + "load_cv": 0.855503809999585, + "normalized_load_entropy": 0.9285114487364504, + "max_load_share": 0.08417508417508418 + } + }, + "s1_period": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "c404ca4f8941f7ada2cf22d7a6a36c078fdf157c1004d3dc2ebe7d921491c317", + "route_weight_sha256": "d3d1b58592583f053a0c6ceee3fda01776aa086322fcb273d4f1c0c9905aa829", + "loads": [ + 4, + 1, + 7, + 11, + 1, + 8, + 48, + 8, + 8, + 0, + 2, + 9, + 4, + 9, + 0, + 3, + 6, + 6, + 2, + 3, + 4, + 14, + 11, + 11, + 1, + 8, + 0, + 5, + 10, + 2, + 0, + 4, + 7, + 9, + 7, + 15, + 6, + 16, + 4, + 2, + 27, + 1, + 1, + 10, + 8, + 3, + 11, + 2, + 7, + 2, + 15, + 11, + 9, + 2, + 24, + 8, + 7, + 6, + 3, + 3, + 1, + 3, + 3, + 1 + ], + "weighted_loads": [ + 0.16468987613916397, + 0.0394657626748085, + 0.34786852821707726, + 0.5399343315511942, + 0.0319029800593853, + 0.38334400951862335, + 3.458736840635538, + 0.5156635008752346, + 0.3505421746522188, + 0.0, + 0.10325946286320686, + 0.5282800942659378, + 0.2633121572434902, + 0.3866986371576786, + 0.0, + 0.15850120410323143, + 0.373896025121212, + 0.31462881341576576, + 0.12473557144403458, + 0.09223804250359535, + 0.18608289398252964, + 0.9275120943784714, + 0.6820843890309334, + 0.9042408224195242, + 0.044716186821460724, + 0.41402174159884453, + 0.0, + 0.31910987943410873, + 0.734220415353775, + 0.13755984976887703, + 0.0, + 0.3729414865374565, + 0.27329148910939693, + 0.9724958948791027, + 0.4636044465005398, + 0.9990407787263393, + 0.23067865893244743, + 1.154219575226307, + 0.18481943756341934, + 0.07320180721580982, + 2.0833617486059666, + 0.02726106345653534, + 0.06372355669736862, + 0.5759291648864746, + 0.3860902935266495, + 0.1782415471971035, + 0.7398246750235558, + 0.08711116015911102, + 0.34537807665765285, + 0.06111254170536995, + 1.346445869654417, + 0.5498564820736647, + 0.6770034525543451, + 0.08022063784301281, + 1.4923938512802124, + 0.34734654426574707, + 0.434839753434062, + 0.2799573428928852, + 0.11733127012848854, + 0.104535773396492, + 0.03215287998318672, + 0.17101307213306427, + 0.29051806405186653, + 0.03944681957364082 + ], + "unique_experts": 60, + "load_cv": 1.071390501795245, + "normalized_load_entropy": 0.897033302934843, + "max_load_share": 0.10810810810810811 + }, + "full_input": { + "tokens": 115, + "top_k": 6, + "decisions": 690, + "ordered_route_sha256": "d8420a69be22e450e062adf1361bd3ec73705af29047fae1d2797064119dfeb0", + "route_weight_sha256": "caf5d8c7e5b42e8f5a2da5d7a46d8d224ff7c788d33482138e369176e6cea348", + "loads": [ + 8, + 1, + 7, + 13, + 4, + 8, + 48, + 15, + 15, + 3, + 3, + 9, + 7, + 9, + 0, + 3, + 10, + 8, + 3, + 3, + 4, + 16, + 13, + 18, + 1, + 9, + 3, + 13, + 29, + 17, + 12, + 9, + 11, + 14, + 12, + 24, + 6, + 20, + 22, + 3, + 27, + 13, + 9, + 13, + 22, + 7, + 14, + 7, + 14, + 2, + 17, + 11, + 9, + 5, + 24, + 9, + 8, + 10, + 4, + 7, + 3, + 12, + 9, + 1 + ], + "weighted_loads": [ + 0.3568012956529856, + 0.0394657626748085, + 0.34786852821707726, + 0.5927175506949425, + 0.7051784917712212, + 0.38334400951862335, + 3.458736840635538, + 0.865946039557457, + 0.9398686271160841, + 0.31203586608171463, + 0.14647439867258072, + 0.5282800942659378, + 0.38818734139204025, + 0.3866986371576786, + 0.0, + 0.15850120410323143, + 0.6461832523345947, + 0.4286086782813072, + 0.1605919562280178, + 0.09223804250359535, + 0.18608289398252964, + 1.0171503126621246, + 0.7680643573403358, + 1.4235587995499372, + 0.044716186821460724, + 0.46993428841233253, + 0.12276099622249603, + 0.7140891384333372, + 3.272157147526741, + 2.128856610506773, + 0.9027206050232053, + 0.6305229179561138, + 0.45070852525532246, + 1.2670988328754902, + 0.712442796677351, + 1.6663733944296837, + 0.23067865893244743, + 1.3301777420565486, + 1.6265689618885517, + 0.11954870633780956, + 2.0833617486059666, + 1.103695873171091, + 0.522082693874836, + 0.7682621143758297, + 1.6272456757724285, + 0.4857473075389862, + 0.8857957869768143, + 0.3356583211570978, + 0.6792151648551226, + 0.06111254170536995, + 1.4125557951629162, + 0.5498564820736647, + 0.6770034525543451, + 0.23557026125490665, + 1.4923938512802124, + 0.37870897352695465, + 0.46260069496929646, + 0.47237086296081543, + 0.17273948714137077, + 0.27616293262690306, + 0.10321358777582645, + 0.6283330135047436, + 0.548937875777483, + 0.03944681957364082 + ], + "unique_experts": 63, + "load_cv": 0.7520105376730213, + "normalized_load_entropy": 0.938649047762585, + "max_load_share": 0.06956521739130435 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 74, + "ordered_topk_exact_tokens": 38, + "set_exact_tokens": 47, + "mean_set_jaccard": 0.8899613899613901, + "mean_token_weighted_tv": 0.01965041785828165, + "aggregate_load_tv": 0.0472972972972973 + }, + "system_bos": { + "tokens": 74, + "ordered_topk_exact_tokens": 35, + "set_exact_tokens": 44, + "mean_set_jaccard": 0.8754826254826256, + "mean_token_weighted_tv": 0.02557973502002455, + "aggregate_load_tv": 0.04729729729729729 + }, + "system_x": { + "tokens": 74, + "ordered_topk_exact_tokens": 36, + "set_exact_tokens": 47, + "mean_set_jaccard": 0.8761261261261263, + "mean_token_weighted_tv": 0.030587107597573382, + "aggregate_load_tv": 0.05405405405405406 + }, + "system_period": { + "tokens": 74, + "ordered_topk_exact_tokens": 22, + "set_exact_tokens": 34, + "mean_set_jaccard": 0.8288288288288289, + "mean_token_weighted_tv": 0.036263634211610295, + "aggregate_load_tv": 0.06756756756756757 + }, + "bos_at_s0": { + "tokens": 74, + "ordered_topk_exact_tokens": 30, + "set_exact_tokens": 39, + "mean_set_jaccard": 0.8561776061776062, + "mean_token_weighted_tv": 0.030426957694863952, + "aggregate_load_tv": 0.0563063063063063 + }, + "bos_at_s1": { + "tokens": 74, + "ordered_topk_exact_tokens": 31, + "set_exact_tokens": 42, + "mean_set_jaccard": 0.8677606177606179, + "mean_token_weighted_tv": 0.028725888617840166, + "aggregate_load_tv": 0.038288288288288286 + }, + "x_at_s0": { + "tokens": 74, + "ordered_topk_exact_tokens": 27, + "set_exact_tokens": 41, + "mean_set_jaccard": 0.8558558558558558, + "mean_token_weighted_tv": 0.03210476772054224, + "aggregate_load_tv": 0.04954954954954954 + }, + "x_at_s1": { + "tokens": 74, + "ordered_topk_exact_tokens": 32, + "set_exact_tokens": 40, + "mean_set_jaccard": 0.8381595881595881, + "mean_token_weighted_tv": 0.03914896138264118, + "aggregate_load_tv": 0.056306306306306314 + }, + "period_at_s0": { + "tokens": 74, + "ordered_topk_exact_tokens": 29, + "set_exact_tokens": 37, + "mean_set_jaccard": 0.8433075933075933, + "mean_token_weighted_tv": 0.03447342831389727, + "aggregate_load_tv": 0.04954954954954954 + }, + "period_at_s1": { + "tokens": 74, + "ordered_topk_exact_tokens": 30, + "set_exact_tokens": 39, + "mean_set_jaccard": 0.833011583011583, + "mean_token_weighted_tv": 0.03930987067822669, + "aggregate_load_tv": 0.05855855855855856 + } + } + }, + "layer_13": { + "layer": 13, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "0b24815602c22b90ecdcf272cb3e7f68bc2f2c377f27694ed86ad42a02d6a591", + "route_weight_sha256": "b61bbedc2998ace772bc0b7723b2c2032c5798eb88fdb01873282a6ae89c5be8", + "loads": [ + 16, + 7, + 3, + 0, + 4, + 4, + 7, + 6, + 15, + 2, + 10, + 0, + 10, + 0, + 3, + 5, + 18, + 0, + 4, + 11, + 0, + 10, + 17, + 6, + 1, + 9, + 14, + 7, + 1, + 1, + 8, + 5, + 11, + 6, + 7, + 18, + 1, + 0, + 4, + 31, + 12, + 1, + 9, + 1, + 0, + 5, + 26, + 8, + 4, + 4, + 13, + 0, + 27, + 0, + 3, + 0, + 5, + 0, + 5, + 1, + 9, + 10, + 9, + 10 + ], + "weighted_loads": [ + 1.4029722791165113, + 0.34927256777882576, + 0.13477730751037598, + 0.0, + 0.16446522250771523, + 0.19742107763886452, + 0.3382887504994869, + 0.2884556483477354, + 0.7212310396134853, + 0.0710817463696003, + 0.5795678775757551, + 0.0, + 0.5978730674833059, + 0.0, + 0.10709123313426971, + 0.36478265561163425, + 1.1181685589253902, + 0.0, + 0.18817760422825813, + 0.5264021046459675, + 0.0, + 0.5417357422411442, + 1.1015596389770508, + 0.21305720321834087, + 0.031282439827919006, + 0.4865837711840868, + 0.6697332207113504, + 0.312173243612051, + 0.03231605142354965, + 0.029450254514813423, + 0.4043163098394871, + 0.28157487884163857, + 0.8582016006112099, + 0.222941055893898, + 0.4370189253240824, + 0.9833016041666269, + 0.03698502480983734, + 0.0, + 0.14773376286029816, + 1.5234417989850044, + 0.6439100224524736, + 0.03303080424666405, + 0.42789297364652157, + 0.03357178345322609, + 0.0, + 0.24202207662165165, + 1.3874969761818647, + 0.28050317615270615, + 0.4933401793241501, + 0.14576276019215584, + 0.6177478656172752, + 0.0, + 1.5047133155167103, + 0.0, + 0.12059487029910088, + 0.0, + 0.1651623547077179, + 0.0, + 0.172058193013072, + 0.04052769020199776, + 0.5607697293162346, + 0.5171871297061443, + 0.5216013323515654, + 0.9528098925948143 + ], + "unique_experts": 53, + "load_cv": 0.981899327044587, + "normalized_load_entropy": 0.8866899673990956, + "max_load_share": 0.06981981981981981 + }, + "full_input": { + "tokens": 99, + "top_k": 6, + "decisions": 594, + "ordered_route_sha256": "2c3f819893431dd7bea55d0210592f2979d5d4c7465f17c6a24b211c02796884", + "route_weight_sha256": "e3271da300ea4c159f76091dca95b5e356dba2b62b4a079b46412673a646d344", + "loads": [ + 16, + 10, + 3, + 0, + 4, + 6, + 23, + 6, + 15, + 4, + 22, + 6, + 10, + 0, + 4, + 11, + 18, + 2, + 5, + 12, + 0, + 12, + 17, + 6, + 4, + 9, + 17, + 8, + 1, + 13, + 8, + 5, + 11, + 12, + 8, + 18, + 6, + 1, + 4, + 33, + 13, + 3, + 12, + 3, + 10, + 15, + 28, + 10, + 5, + 4, + 14, + 0, + 31, + 4, + 5, + 0, + 8, + 1, + 11, + 6, + 10, + 11, + 9, + 11 + ], + "weighted_loads": [ + 1.4029722791165113, + 0.49914633855223656, + 0.13477730751037598, + 0.0, + 0.16446522250771523, + 0.2616078481078148, + 1.748971089720726, + 0.2884556483477354, + 0.7212310396134853, + 0.14744856767356396, + 1.3297602105885744, + 0.36958340695127845, + 0.5978730674833059, + 0.0, + 0.15239492803812027, + 0.6699990276247263, + 1.1181685589253902, + 0.04821039643138647, + 0.2308420017361641, + 0.5723884850740433, + 0.0, + 0.6344845630228519, + 1.1015596389770508, + 0.21305720321834087, + 0.09818232478573918, + 0.4865837711840868, + 0.7956148814409971, + 0.3998151235282421, + 0.03231605142354965, + 1.0386338289827108, + 0.4043163098394871, + 0.28157487884163857, + 0.8582016006112099, + 0.8966794013977051, + 0.4599035158753395, + 0.9833016041666269, + 0.3892735242843628, + 0.0336519256234169, + 0.14773376286029816, + 1.6204112209379673, + 0.7416851688176394, + 0.12079448252916336, + 0.5742373783141375, + 0.129153061658144, + 0.6939176358282566, + 1.2156726401299238, + 1.4547918643802404, + 1.472607545554638, + 0.5252302512526512, + 0.14576276019215584, + 0.656064473092556, + 0.0, + 1.6485439985990524, + 0.1723022684454918, + 0.20885992795228958, + 0.0, + 0.3309977538883686, + 0.03215477615594864, + 0.4988907463848591, + 0.28164154663681984, + 0.600379079580307, + 0.5467316694557667, + 0.5216013323515654, + 0.9905688539147377 + ], + "unique_experts": 59, + "load_cv": 0.7807891330171872, + "normalized_load_entropy": 0.9268880705427966, + "max_load_share": 0.05555555555555555 + } + }, + "s1_eos": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "e8c1ec34d3cf29780491072072bd9a19af85b2ed4ebdbe0ee2bd98c5f465bd24", + "route_weight_sha256": "9ad25d701087cfc486c6b0de81c5a8ad13e43cb8bb5fe2f5350cd590ae4a6aba", + "loads": [ + 16, + 7, + 3, + 1, + 5, + 6, + 7, + 5, + 16, + 3, + 11, + 0, + 9, + 2, + 2, + 4, + 18, + 0, + 5, + 11, + 0, + 9, + 17, + 5, + 2, + 9, + 11, + 7, + 0, + 1, + 8, + 5, + 11, + 6, + 5, + 18, + 1, + 0, + 4, + 31, + 13, + 1, + 8, + 1, + 0, + 6, + 26, + 9, + 3, + 4, + 13, + 0, + 26, + 0, + 3, + 2, + 7, + 0, + 5, + 1, + 9, + 9, + 8, + 9 + ], + "weighted_loads": [ + 1.3937372043728828, + 0.340483570471406, + 0.129898339509964, + 0.03563820570707321, + 0.20807868987321854, + 0.26482848823070526, + 0.31776492670178413, + 0.2546582743525505, + 0.7643012031912804, + 0.1083371527493, + 0.6046538539230824, + 0.0, + 0.5937055796384811, + 0.07385275885462761, + 0.07127873227000237, + 0.32631392031908035, + 1.109772328287363, + 0.0, + 0.21228701621294022, + 0.5579627230763435, + 0.0, + 0.5074711069464684, + 1.1306105889379978, + 0.18528747372329235, + 0.05844445526599884, + 0.4914821721613407, + 0.5825292151421309, + 0.3208702728152275, + 0.0, + 0.027892008423805237, + 0.40366386994719505, + 0.28407725505530834, + 0.8496923260390759, + 0.2286142148077488, + 0.3842138238251209, + 0.9741387814283371, + 0.03821832686662674, + 0.0, + 0.14408069103956223, + 1.5834787413477898, + 0.681547649204731, + 0.0332348607480526, + 0.3985350411385298, + 0.033225856721401215, + 0.0, + 0.2751376647502184, + 1.3546476606279612, + 0.30965373665094376, + 0.44709154963493347, + 0.14698299206793308, + 0.6176018863916397, + 0.0, + 1.4641005005687475, + 0.0, + 0.11586535349488258, + 0.05394171550869942, + 0.22619449719786644, + 0.0, + 0.16372874937951565, + 0.039950497448444366, + 0.5650882720947266, + 0.4751339666545391, + 0.4978797733783722, + 0.9171686880290508 + ], + "unique_experts": 55, + "load_cv": 0.9615191697040173, + "normalized_load_entropy": 0.8939788026268985, + "max_load_share": 0.06981981981981981 + }, + "full_input": { + "tokens": 115, + "top_k": 6, + "decisions": 690, + "ordered_route_sha256": "49057192bb6cb3985994261893d192fb6145481e08403003ebb84270f3787922", + "route_weight_sha256": "fbd612d463ab83213fb760906f07fe061cbd7e631f3d4c1c42478e8b51ec390a", + "loads": [ + 21, + 10, + 3, + 1, + 5, + 8, + 36, + 5, + 16, + 5, + 24, + 13, + 9, + 2, + 3, + 11, + 18, + 3, + 7, + 14, + 0, + 15, + 17, + 8, + 6, + 9, + 15, + 8, + 0, + 20, + 15, + 6, + 11, + 17, + 8, + 19, + 7, + 1, + 5, + 33, + 16, + 4, + 16, + 2, + 16, + 17, + 28, + 12, + 5, + 8, + 14, + 0, + 27, + 2, + 5, + 4, + 10, + 12, + 13, + 5, + 11, + 11, + 8, + 10 + ], + "weighted_loads": [ + 1.5976501256227493, + 0.5244568157941103, + 0.129898339509964, + 0.03563820570707321, + 0.20807868987321854, + 0.3325104471296072, + 2.6929356828331947, + 0.2546582743525505, + 0.7643012031912804, + 0.1969279944896698, + 1.383091339841485, + 0.9361711367964745, + 0.5937055796384811, + 0.07385275885462761, + 0.11487174779176712, + 0.7072715349495411, + 1.109772328287363, + 0.08417413756251335, + 0.2779608219861984, + 0.6804819889366627, + 0.0, + 0.8009167145937681, + 1.1306105889379978, + 0.3062586095184088, + 0.17439798498526216, + 0.4914821721613407, + 0.7419179882854223, + 0.3843819424510002, + 0.0, + 1.7936371620744467, + 0.7929226420819759, + 0.3238495159894228, + 0.8496923260390759, + 1.4122534841299057, + 0.6114932540804148, + 1.028734501451254, + 0.49569277465343475, + 0.03339637443423271, + 0.18626860156655312, + 1.6960230469703674, + 0.862740833312273, + 0.1644280031323433, + 1.062694687396288, + 0.10811599344015121, + 1.1654342599213123, + 1.2591131422668695, + 1.4299365524202585, + 1.5385985597968102, + 0.6985318958759308, + 0.347943427041173, + 0.6541736610233784, + 0.0, + 1.4997943881899118, + 0.07971052080392838, + 0.1856098622083664, + 0.12669140845537186, + 0.378147978335619, + 0.7358420118689537, + 0.5575872156769037, + 0.2460968866944313, + 0.6317425686866045, + 0.5623979344964027, + 0.4978797733783722, + 0.9740717709064484 + ], + "unique_experts": 61, + "load_cv": 0.7234018447194472, + "normalized_load_entropy": 0.9364838532988571, + "max_load_share": 0.05217391304347826 + } + }, + "s0_bos": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "1ee3bee4caa539222e9791a26fa0f81fd2d7f4e40d24cabf54b6efd79dd6a1f7", + "route_weight_sha256": "19eab9c6898664fa52660afe3ace4482aa576e47893b1f236c6407bf45aae276", + "loads": [ + 14, + 6, + 3, + 0, + 5, + 6, + 8, + 5, + 14, + 0, + 11, + 0, + 10, + 4, + 3, + 5, + 17, + 0, + 5, + 12, + 0, + 9, + 18, + 5, + 1, + 10, + 12, + 7, + 2, + 1, + 8, + 5, + 10, + 6, + 8, + 20, + 0, + 0, + 4, + 27, + 12, + 0, + 8, + 1, + 0, + 5, + 29, + 8, + 4, + 4, + 11, + 0, + 24, + 0, + 2, + 2, + 7, + 0, + 4, + 1, + 10, + 11, + 10, + 10 + ], + "weighted_loads": [ + 1.3754030801355839, + 0.30629653111100197, + 0.13678240031003952, + 0.0, + 0.20846080780029297, + 0.2589773293584585, + 0.3564119767397642, + 0.2612599618732929, + 0.6994455605745316, + 0.0, + 0.6030842904001474, + 0.0, + 0.6175055280327797, + 0.12077660113573074, + 0.10118076577782631, + 0.3510895501822233, + 1.1668561398983002, + 0.0, + 0.23807721212506294, + 0.5718434825539589, + 0.0, + 0.5080082640051842, + 1.1336868852376938, + 0.17700066603720188, + 0.031793735921382904, + 0.5470896512269974, + 0.5853209588676691, + 0.31781365163624287, + 0.06847536936402321, + 0.02968023531138897, + 0.43387155793607235, + 0.2887390945106745, + 0.8300470523536205, + 0.21623677387833595, + 0.47016829811036587, + 1.0376176796853542, + 0.0, + 0.0, + 0.1481688916683197, + 1.461112828925252, + 0.6522409245371819, + 0.0, + 0.36595720425248146, + 0.03743725270032883, + 0.0, + 0.2602848503738642, + 1.4590411763638258, + 0.2701402548700571, + 0.4940730668604374, + 0.1514876689761877, + 0.5710926838219166, + 0.0, + 1.3736268524080515, + 0.0, + 0.08185378089547157, + 0.05740426294505596, + 0.2297983281314373, + 0.0, + 0.11922984384000301, + 0.04390180483460426, + 0.5917126666754484, + 0.5636835880577564, + 0.5686718579381704, + 0.9640944488346577 + ], + "unique_experts": 52, + "load_cv": 0.9468892765285217, + "normalized_load_entropy": 0.8911988208663896, + "max_load_share": 0.06531531531531531 + }, + "full_input": { + "tokens": 99, + "top_k": 6, + "decisions": 594, + "ordered_route_sha256": "1cbf770a72debb36a744b61ad78e4ca1bf33ea0fec1eef4a6eac3166a4271716", + "route_weight_sha256": "9bc934ae8fb51fb0275d2ef59019a36e54e487ce9ebfcf0e3b2537141c8b9a72", + "loads": [ + 14, + 11, + 4, + 0, + 6, + 8, + 24, + 5, + 14, + 4, + 22, + 4, + 10, + 4, + 3, + 11, + 17, + 1, + 6, + 13, + 0, + 11, + 18, + 5, + 3, + 10, + 15, + 8, + 2, + 14, + 8, + 5, + 10, + 11, + 9, + 20, + 3, + 1, + 4, + 29, + 13, + 2, + 11, + 3, + 10, + 15, + 31, + 9, + 6, + 4, + 12, + 0, + 28, + 5, + 4, + 2, + 11, + 1, + 10, + 6, + 11, + 12, + 10, + 11 + ], + "weighted_loads": [ + 1.3754030801355839, + 0.575851634144783, + 0.207178495824337, + 0.0, + 0.2602699361741543, + 0.3231640998274088, + 1.8021849002689123, + 0.2612599618732929, + 0.6994455605745316, + 0.18238169886171818, + 1.257657127454877, + 0.29600306041538715, + 0.6175055280327797, + 0.12077660113573074, + 0.10118076577782631, + 0.6563059221953154, + 1.1668561398983002, + 0.03522845730185509, + 0.2807416096329689, + 0.6178298629820347, + 0.0, + 0.6044302619993687, + 1.1336868852376938, + 0.17700066603720188, + 0.09303232096135616, + 0.5470896512269974, + 0.7112026195973158, + 0.3845817018300295, + 0.06847536936402321, + 1.0864141564816236, + 0.43387155793607235, + 0.2887390945106745, + 0.8300470523536205, + 0.8396523967385292, + 0.493052888661623, + 1.0376176796853542, + 0.2982143945991993, + 0.0336519256234169, + 0.1481688916683197, + 1.5564020369201899, + 0.752464771270752, + 0.08789882063865662, + 0.5300578400492668, + 0.14590006694197655, + 0.6872006952762604, + 1.2339354138821363, + 1.5263360645622015, + 0.6308338586241007, + 0.5574992969632149, + 0.1514876689761877, + 0.6094092912971973, + 0.0, + 1.5174575354903936, + 0.23789452016353607, + 0.17011883854866028, + 0.05740426294505596, + 0.5179797187447548, + 0.0343993604183197, + 0.42963884957134724, + 0.28501566126942635, + 0.6274687293916941, + 0.5932281278073788, + 0.5686718579381704, + 1.001853410154581 + ], + "unique_experts": 61, + "load_cv": 0.7545619062567175, + "normalized_load_entropy": 0.9325027279007887, + "max_load_share": 0.05218855218855219 + } + }, + "s1_bos": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "7de78676512f0f1474f6f6260e69b8ffadb6b491a8e5dd0f6c9da4fb7d3f1a18", + "route_weight_sha256": "01d16384b9a2bf072a730556a2ca90eff1f72f291e47c7fffd5157fb7478d5d2", + "loads": [ + 14, + 4, + 3, + 0, + 7, + 5, + 8, + 6, + 15, + 1, + 11, + 0, + 10, + 4, + 3, + 5, + 18, + 0, + 4, + 11, + 0, + 8, + 19, + 5, + 1, + 9, + 11, + 7, + 2, + 1, + 8, + 5, + 10, + 5, + 8, + 18, + 0, + 0, + 4, + 29, + 12, + 2, + 10, + 2, + 0, + 5, + 31, + 10, + 3, + 4, + 11, + 0, + 21, + 0, + 2, + 2, + 7, + 0, + 2, + 1, + 10, + 11, + 9, + 10 + ], + "weighted_loads": [ + 1.348840907216072, + 0.2625900059938431, + 0.13956893235445023, + 0.0, + 0.27489857748150826, + 0.22337787225842476, + 0.34486448392271996, + 0.27685472927987576, + 0.7263378947973251, + 0.03091353550553322, + 0.5925341118127108, + 0.0, + 0.640680056065321, + 0.1375975962728262, + 0.09147019684314728, + 0.3734120726585388, + 1.1716070510447025, + 0.0, + 0.18107452616095543, + 0.5591197125613689, + 0.0, + 0.468942292034626, + 1.1746728383004665, + 0.17441546358168125, + 0.034316543489694595, + 0.5131198018789291, + 0.5530336853116751, + 0.3054581880569458, + 0.061825938522815704, + 0.02923058159649372, + 0.4453556425869465, + 0.3005457744002342, + 0.811204832047224, + 0.19642868638038635, + 0.46039725467562675, + 0.9421187676489353, + 0.0, + 0.0, + 0.1405388005077839, + 1.535717198625207, + 0.6616870537400246, + 0.062132660299539566, + 0.4449537619948387, + 0.08917589858174324, + 0.0, + 0.2528998423367739, + 1.5709560755640268, + 0.31830322183668613, + 0.44437484443187714, + 0.1583653800189495, + 0.555904820561409, + 0.0, + 1.223959669470787, + 0.0, + 0.08150976896286011, + 0.05968863517045975, + 0.230295455083251, + 0.0, + 0.06502427905797958, + 0.043836433440446854, + 0.6081666890531778, + 0.5560533851385117, + 0.5364487785845995, + 0.9709466062486172 + ], + "unique_experts": 54, + "load_cv": 0.9581368035110386, + "normalized_load_entropy": 0.8931069201113208, + "max_load_share": 0.06981981981981981 + }, + "full_input": { + "tokens": 115, + "top_k": 6, + "decisions": 690, + "ordered_route_sha256": "f1f71650d63524b385e93d2ff8bb3cf98e85c1cd833f2868a2e9b170a63f0299", + "route_weight_sha256": "d11800b19b7cbe07cb2aa92d5abf9e842fbc0342f067f45a275e611fde8e004d", + "loads": [ + 19, + 9, + 4, + 0, + 7, + 7, + 37, + 6, + 15, + 4, + 22, + 12, + 10, + 4, + 3, + 12, + 18, + 2, + 6, + 14, + 0, + 14, + 19, + 8, + 5, + 9, + 15, + 8, + 2, + 20, + 15, + 6, + 10, + 16, + 11, + 19, + 7, + 1, + 5, + 31, + 15, + 5, + 18, + 4, + 16, + 17, + 33, + 12, + 5, + 8, + 12, + 0, + 22, + 2, + 4, + 4, + 11, + 11, + 10, + 5, + 11, + 13, + 9, + 11 + ], + "weighted_loads": [ + 1.5527538284659386, + 0.5667112693190575, + 0.1882825680077076, + 0.0, + 0.27489857748150826, + 0.2910598311573267, + 2.803519159555435, + 0.27685472927987576, + 0.7263378947973251, + 0.17250341176986694, + 1.3126933574676514, + 0.9048274736851454, + 0.640680056065321, + 0.1375975962728262, + 0.09147019684314728, + 0.7543696872889996, + 1.1716070510447025, + 0.07049889117479324, + 0.24674833193421364, + 0.6816389784216881, + 0.0, + 0.7680742312222719, + 1.1746728383004665, + 0.2953865993767977, + 0.2060189712792635, + 0.5131198018789291, + 0.7124224584549665, + 0.3655054531991482, + 0.061825938522815704, + 1.846501037478447, + 0.8346144147217274, + 0.3403180353343487, + 0.811204832047224, + 1.3615142665803432, + 0.6876766849309206, + 0.9967144876718521, + 0.48524372838437557, + 0.03339637443423271, + 0.18272671103477478, + 1.6422712858766317, + 0.8473450876772404, + 0.19332580268383026, + 1.127517843618989, + 0.1985558457672596, + 1.1441181413829327, + 1.2661737147718668, + 1.6462449673563242, + 0.717582443729043, + 0.6958151906728745, + 0.3593258149921894, + 0.5924765951931477, + 0.0, + 1.2596535570919514, + 0.07971052080392838, + 0.15125427767634392, + 0.1324383281171322, + 0.4199483599513769, + 0.7047013826668262, + 0.42785486951470375, + 0.2499828226864338, + 0.6363648511469364, + 0.6433173529803753, + 0.5364487785845995, + 1.0278496891260147 + ], + "unique_experts": 61, + "load_cv": 0.7104642878469107, + "normalized_load_entropy": 0.9398123405162188, + "max_load_share": 0.0536231884057971 + } + }, + "s0_x": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "d0a150dbbb1557f4cf1f3bcc70b519902b42cba1d469e45bbbe4d78b07bab0d1", + "route_weight_sha256": "c046143925fbcdb051d2eb6dd4d35de623cbffa5fdc7b53bb79bfa80c42d038c", + "loads": [ + 15, + 5, + 3, + 0, + 4, + 4, + 9, + 6, + 15, + 0, + 10, + 0, + 10, + 5, + 4, + 4, + 17, + 0, + 4, + 9, + 2, + 10, + 17, + 4, + 0, + 10, + 14, + 7, + 2, + 1, + 9, + 5, + 11, + 7, + 8, + 18, + 0, + 0, + 4, + 28, + 12, + 1, + 9, + 0, + 0, + 4, + 29, + 11, + 4, + 4, + 11, + 0, + 23, + 0, + 2, + 4, + 6, + 0, + 2, + 1, + 11, + 9, + 9, + 11 + ], + "weighted_loads": [ + 1.4117504134774208, + 0.2430606372654438, + 0.142853531986475, + 0.0, + 0.17057932913303375, + 0.16754841804504395, + 0.4062744714319706, + 0.31732794269919395, + 0.714170441031456, + 0.0, + 0.563801821321249, + 0.0, + 0.624104417860508, + 0.16865989193320274, + 0.13117987848818302, + 0.3456570077687502, + 1.1502256728708744, + 0.0, + 0.21120306476950645, + 0.481475081294775, + 0.05912860296666622, + 0.5397775694727898, + 1.0758444368839264, + 0.14805962145328522, + 0.0, + 0.5475992746651173, + 0.632023386657238, + 0.3346813339740038, + 0.062227314338088036, + 0.030850611627101898, + 0.4581826813519001, + 0.28432356752455235, + 0.8660431019961834, + 0.24297849088907242, + 0.4805053025484085, + 0.9682905841618776, + 0.0, + 0.0, + 0.13359085656702518, + 1.523824080824852, + 0.6669010985642672, + 0.028750527650117874, + 0.41311515122652054, + 0.0, + 0.0, + 0.22994931042194366, + 1.5417605713009834, + 0.361038027331233, + 0.4900939203798771, + 0.16176912933588028, + 0.563982555642724, + 0.0, + 1.2409856393933296, + 0.0, + 0.08203160390257835, + 0.12158150039613247, + 0.19870085641741753, + 0.0, + 0.0650356262922287, + 0.04471152648329735, + 0.6331694796681404, + 0.47158049792051315, + 0.5389616210013628, + 1.003609737381339 + ], + "unique_experts": 52, + "load_cv": 0.9482597185323695, + "normalized_load_entropy": 0.8909165048191701, + "max_load_share": 0.06531531531531531 + }, + "full_input": { + "tokens": 99, + "top_k": 6, + "decisions": 594, + "ordered_route_sha256": "8e7e35bbbd7f54f6b2fa1e716435fc5222425097ceff4c17d27507c6cf23e694", + "route_weight_sha256": "b0bacf7a32429ea619c43afcc839791b37c2a57e69c7c7220a1435bccc557c42", + "loads": [ + 15, + 9, + 3, + 0, + 4, + 6, + 26, + 6, + 15, + 2, + 21, + 5, + 10, + 5, + 4, + 11, + 17, + 1, + 5, + 10, + 2, + 12, + 17, + 4, + 4, + 10, + 17, + 8, + 2, + 13, + 9, + 5, + 11, + 13, + 9, + 18, + 4, + 1, + 4, + 30, + 13, + 3, + 12, + 1, + 12, + 15, + 32, + 12, + 5, + 4, + 12, + 0, + 27, + 4, + 4, + 4, + 9, + 1, + 7, + 6, + 12, + 10, + 9, + 12 + ], + "weighted_loads": [ + 1.4117504134774208, + 0.43498267605900764, + 0.142853531986475, + 0.0, + 0.17057932913303375, + 0.23173518851399422, + 1.7745106667280197, + 0.31732794269919395, + 0.714170441031456, + 0.07636682130396366, + 1.1783142574131489, + 0.3406860325485468, + 0.624104417860508, + 0.16865989193320274, + 0.13117987848818302, + 0.8703736681491137, + 1.1502256728708744, + 0.03522845730185509, + 0.2538674622774124, + 0.5274614617228508, + 0.05912860296666622, + 0.6372816860675812, + 1.0758444368839264, + 0.14805962145328522, + 0.1519769039005041, + 0.5475992746651173, + 0.7579050473868847, + 0.40921897627413273, + 0.062227314338088036, + 1.057828076183796, + 0.4581826813519001, + 0.28432356752455235, + 0.8660431019961834, + 0.9122415632009506, + 0.5033898930996656, + 0.9682905841618776, + 0.30744242295622826, + 0.0336519256234169, + 0.13359085656702518, + 1.6126133687794209, + 0.7713354919105768, + 0.11942276358604431, + 0.5525473840534687, + 0.04539011791348457, + 0.8465126752853394, + 1.4030037708580494, + 1.6379824727773666, + 0.7217316310852766, + 0.5219839923083782, + 0.16176912933588028, + 0.6022991631180048, + 0.0, + 1.3848163224756718, + 0.1723022684454918, + 0.17029666155576706, + 0.12158150039613247, + 0.36453625559806824, + 0.04014194384217262, + 0.38173770532011986, + 0.28582538291811943, + 0.695179145783186, + 0.5011250376701355, + 0.5389616210013628, + 1.0413686987012625 + ], + "unique_experts": 62, + "load_cv": 0.7648287296096992, + "normalized_load_entropy": 0.9324111719036077, + "max_load_share": 0.05387205387205387 + } + }, + "s1_x": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "ccdfab25f7826b83a04d71c0763466d66679becdf7bde56cce2e4b809472f8aa", + "route_weight_sha256": "cf195233e0d537437a9b621675dd1a3fb10de5c7f23ad5a44e7fe573d11c254f", + "loads": [ + 14, + 5, + 3, + 0, + 4, + 4, + 7, + 6, + 14, + 3, + 10, + 1, + 11, + 3, + 3, + 3, + 20, + 0, + 5, + 15, + 1, + 10, + 19, + 4, + 1, + 10, + 13, + 7, + 1, + 0, + 7, + 5, + 10, + 6, + 7, + 18, + 0, + 0, + 3, + 30, + 12, + 2, + 7, + 0, + 1, + 4, + 32, + 11, + 4, + 4, + 15, + 0, + 19, + 0, + 3, + 2, + 6, + 0, + 1, + 2, + 10, + 9, + 8, + 9 + ], + "weighted_loads": [ + 1.3920308779925108, + 0.28098567947745323, + 0.14179300144314766, + 0.0, + 0.1466853078454733, + 0.19118067249655724, + 0.2909516915678978, + 0.29369368217885494, + 0.6549272816628218, + 0.11596223898231983, + 0.5557214505970478, + 0.031553369015455246, + 0.6638470254838467, + 0.10479775443673134, + 0.09606948308646679, + 0.3145848661661148, + 1.2525373548269272, + 0.0, + 0.2135851141065359, + 0.7001241967082024, + 0.02437407337129116, + 0.5437857769429684, + 1.1450083926320076, + 0.13393380492925644, + 0.03240106254816055, + 0.5414912384003401, + 0.6195983979851007, + 0.31376124545931816, + 0.0303626898676157, + 0.0, + 0.40539461374282837, + 0.2847313955426216, + 0.834937073290348, + 0.2543646991252899, + 0.4326840043067932, + 0.9106737915426493, + 0.0, + 0.0, + 0.10252366214990616, + 1.5958325397223234, + 0.6833347529172897, + 0.06217462942004204, + 0.34416212886571884, + 0.0, + 0.0469883568584919, + 0.23732579499483109, + 1.8315344173461199, + 0.3559364788234234, + 0.48854628950357437, + 0.16226039081811905, + 0.6884937286376953, + 0.0, + 1.1067130416631699, + 0.0, + 0.11195855215191841, + 0.061676232144236565, + 0.19891645200550556, + 0.0, + 0.02927219122648239, + 0.07197320461273193, + 0.6067383904010057, + 0.4706824757158756, + 0.5070492122322321, + 0.9140368364751339 + ], + "unique_experts": 55, + "load_cv": 0.9898027274002121, + "normalized_load_entropy": 0.8894501185144399, + "max_load_share": 0.07207207207207207 + }, + "full_input": { + "tokens": 115, + "top_k": 6, + "decisions": 690, + "ordered_route_sha256": "1c3b24bab3449eb5557d9773affb6763413a0c1282e31a9c071b49bb0598beea", + "route_weight_sha256": "922f842017c0b74c875ed150252dd6920b796dda83027d578c624bc3d08914a8", + "loads": [ + 19, + 9, + 3, + 0, + 4, + 6, + 36, + 6, + 14, + 4, + 20, + 12, + 11, + 3, + 3, + 11, + 20, + 2, + 7, + 18, + 1, + 15, + 19, + 7, + 6, + 10, + 18, + 8, + 1, + 19, + 14, + 6, + 10, + 18, + 10, + 19, + 7, + 1, + 4, + 32, + 15, + 6, + 15, + 0, + 19, + 16, + 35, + 13, + 6, + 8, + 16, + 0, + 20, + 2, + 5, + 5, + 9, + 12, + 7, + 6, + 12, + 12, + 8, + 10 + ], + "weighted_loads": [ + 1.5959437992423773, + 0.5007792972028255, + 0.14179300144314766, + 0.0, + 0.1466853078454733, + 0.2588626313954592, + 2.5732379965484142, + 0.29369368217885494, + 0.6549272816628218, + 0.1464062724262476, + 1.1683546546846628, + 0.8916487898677588, + 0.6638470254838467, + 0.10479775443673134, + 0.09606948308646679, + 0.8393823467195034, + 1.2525373548269272, + 0.07049889117479324, + 0.2792589198797941, + 0.8226434625685215, + 0.02437407337129116, + 0.8013941589742899, + 1.1450083926320076, + 0.25490494072437286, + 0.21607163734734058, + 0.5414912384003401, + 0.8106093164533377, + 0.36764957010746, + 0.0303626898676157, + 1.8063018005341291, + 0.7946533858776093, + 0.32450365647673607, + 0.834937073290348, + 1.4744072742760181, + 0.6599634345620871, + 0.9652695115655661, + 0.4167616665363312, + 0.03339637443423271, + 0.14471157267689705, + 1.6950362604111433, + 0.867629412561655, + 0.23210881650447845, + 1.0041440892964602, + 0.0, + 1.3931358866393566, + 1.3670134544372559, + 1.9496680367738008, + 0.7552157007157803, + 0.7399866357445717, + 0.36322082579135895, + 0.725065503269434, + 0.0, + 1.1424069292843342, + 0.07971052080392838, + 0.18170306086540222, + 0.1763534415513277, + 0.3508699331432581, + 0.7433354370296001, + 0.29408662393689156, + 0.27811959385871887, + 0.6901592388749123, + 0.5929147265851498, + 0.5070492122322321, + 0.9709399193525314 + ], + "unique_experts": 61, + "load_cv": 0.7320834855285693, + "normalized_load_entropy": 0.9352714489687839, + "max_load_share": 0.05217391304347826 + } + }, + "s0_period": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "cb5ec348ad93bd97c00b21cef13bac508ed36c0937bd2d9f4e976d5e88978c4b", + "route_weight_sha256": "84de6426e0723210c7fbc81b5421cb5251c74ace7108f844111796aef9359ab1", + "loads": [ + 15, + 3, + 3, + 0, + 3, + 4, + 9, + 6, + 16, + 2, + 10, + 0, + 11, + 4, + 3, + 3, + 18, + 0, + 4, + 10, + 2, + 9, + 18, + 5, + 0, + 9, + 13, + 7, + 3, + 1, + 8, + 5, + 10, + 5, + 8, + 18, + 0, + 0, + 3, + 27, + 12, + 2, + 8, + 1, + 0, + 4, + 34, + 10, + 5, + 4, + 10, + 0, + 23, + 0, + 3, + 3, + 6, + 0, + 3, + 1, + 11, + 9, + 9, + 11 + ], + "weighted_loads": [ + 1.4183423090726137, + 0.16962657496333122, + 0.13967111706733704, + 0.0, + 0.14768197759985924, + 0.16780509054660797, + 0.38454940542578697, + 0.32064112462103367, + 0.7387728672474623, + 0.06419776938855648, + 0.5557832978665829, + 0.0, + 0.6405162550508976, + 0.13570601493120193, + 0.1003968957811594, + 0.31830085068941116, + 1.2273963168263435, + 0.0, + 0.21704521030187607, + 0.5311731845140457, + 0.056619513779878616, + 0.5071161426603794, + 1.0953062772750854, + 0.17458966933190823, + 0.0, + 0.49225054308772087, + 0.599584212526679, + 0.328247232362628, + 0.09363484755158424, + 0.03250044956803322, + 0.42980414070189, + 0.28982838802039623, + 0.8503199890255928, + 0.18989237025380135, + 0.49422736279666424, + 0.9664554409682751, + 0.0, + 0.0, + 0.10966527089476585, + 1.5201100371778011, + 0.6683775521814823, + 0.06230098754167557, + 0.38553049601614475, + 0.03084292635321617, + 0.0, + 0.2299598567187786, + 1.7073273789137602, + 0.32750829868018627, + 0.5178363677114248, + 0.16609204187989235, + 0.541279923170805, + 0.0, + 1.2495489250868559, + 0.0, + 0.11497165262699127, + 0.09971860609948635, + 0.1999350618571043, + 0.0, + 0.09416867047548294, + 0.044095441699028015, + 0.6358413025736809, + 0.4876565895974636, + 0.5388584956526756, + 0.9874525293707848 + ], + "unique_experts": 54, + "load_cv": 0.9812378368965509, + "normalized_load_entropy": 0.8914623500547927, + "max_load_share": 0.07657657657657657 + }, + "full_input": { + "tokens": 99, + "top_k": 6, + "decisions": 594, + "ordered_route_sha256": "88a5e683f69aaf8049dac48cfd41f7c13278e0a1d35fa4621e3aaa6271cdc35d", + "route_weight_sha256": "913f0449551ca8bade2e401fd3f4b4594b4e31dd5a47edf543050f883aa84815", + "loads": [ + 15, + 8, + 3, + 0, + 3, + 6, + 25, + 6, + 16, + 4, + 20, + 5, + 11, + 4, + 4, + 9, + 18, + 1, + 5, + 11, + 2, + 11, + 18, + 5, + 3, + 9, + 16, + 8, + 3, + 14, + 8, + 5, + 10, + 12, + 9, + 18, + 5, + 1, + 3, + 29, + 13, + 5, + 11, + 3, + 11, + 14, + 36, + 11, + 6, + 4, + 11, + 0, + 27, + 4, + 5, + 3, + 9, + 1, + 8, + 6, + 12, + 10, + 9, + 12 + ], + "weighted_loads": [ + 1.4183423090726137, + 0.5402717925608158, + 0.13967111706733704, + 0.0, + 0.14768197759985924, + 0.23199186101555824, + 1.7560025677084923, + 0.32064112462103367, + 0.7387728672474623, + 0.14056459069252014, + 1.1824554353952408, + 0.3640232402831316, + 0.6405162550508976, + 0.13570601493120193, + 0.132943669334054, + 0.6235172227025032, + 1.2273963168263435, + 0.03522845730185509, + 0.25970960780978203, + 0.5771595649421215, + 0.056619513779878616, + 0.5986537225544453, + 1.0953062772750854, + 0.17458966933190823, + 0.18699343316257, + 0.49225054308772087, + 0.7254658732563257, + 0.40992224775254726, + 0.09363484755158424, + 1.131757941097021, + 0.42980414070189, + 0.28982838802039623, + 0.8503199890255928, + 0.8871490359306335, + 0.5171119533479214, + 0.9664554409682751, + 0.37032581865787506, + 0.0336519256234169, + 0.10966527089476585, + 1.6071821935474873, + 0.7685611732304096, + 0.196990717202425, + 0.511904725804925, + 0.13789307326078415, + 0.7734539695084095, + 1.2036104202270508, + 1.7746222671121359, + 0.6882019024342299, + 0.549726439639926, + 0.16609204187989235, + 0.5795965306460857, + 0.0, + 1.393379608169198, + 0.1723022684454918, + 0.20323671028017998, + 0.09971860609948635, + 0.365770461037755, + 0.04274905100464821, + 0.3793421909213066, + 0.2852092981338501, + 0.6928007043898106, + 0.517201129347086, + 0.5388584956526756, + 1.0252114906907082 + ], + "unique_experts": 62, + "load_cv": 0.7686139356095316, + "normalized_load_entropy": 0.9342839643663997, + "max_load_share": 0.06060606060606061 + } + }, + "s1_period": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "73dec88644e28f7ea1fc3b822b03a0d1401e7dc7c0da8052a2cea86d6617c45a", + "route_weight_sha256": "b7e75f6aba0a7c2c31cfad32ecfe196524543e58cbc75ff64903d3c002684adf", + "loads": [ + 14, + 5, + 3, + 0, + 5, + 4, + 7, + 6, + 15, + 3, + 9, + 1, + 11, + 3, + 2, + 3, + 19, + 0, + 6, + 13, + 1, + 10, + 21, + 5, + 1, + 10, + 13, + 7, + 1, + 0, + 8, + 4, + 10, + 6, + 7, + 18, + 0, + 0, + 3, + 28, + 12, + 3, + 8, + 0, + 1, + 4, + 34, + 6, + 5, + 4, + 14, + 0, + 21, + 0, + 3, + 1, + 7, + 0, + 0, + 1, + 10, + 9, + 9, + 10 + ], + "weighted_loads": [ + 1.3889012951403856, + 0.2875501848757267, + 0.14771423861384392, + 0.0, + 0.19440471567213535, + 0.17051858827471733, + 0.28324608132243156, + 0.3081959914416075, + 0.7228731699287891, + 0.10118402540683746, + 0.5104167610406876, + 0.03236287459731102, + 0.6687755715101957, + 0.10487597063183784, + 0.066847775131464, + 0.3043612018227577, + 1.2222256772220135, + 0.0, + 0.2526502702385187, + 0.6550772320479155, + 0.024480946362018585, + 0.5378047823905945, + 1.2264414820820093, + 0.16055269353091717, + 0.0321713462471962, + 0.5508727505803108, + 0.6039911210536957, + 0.29997782595455647, + 0.030795488506555557, + 0.0, + 0.44841600209474564, + 0.2654966674745083, + 0.86330796033144, + 0.24457107484340668, + 0.4394486453384161, + 0.920284753665328, + 0.0, + 0.0, + 0.10751776024699211, + 1.5481202136725187, + 0.68729661218822, + 0.0992924366146326, + 0.35956836864352226, + 0.0, + 0.04329439252614975, + 0.23823513090610504, + 1.890020800754428, + 0.20547950454056263, + 0.5288118403404951, + 0.16899102181196213, + 0.6627033278346062, + 0.0, + 1.1915415413677692, + 0.0, + 0.11103389039635658, + 0.026942437514662743, + 0.22304855845868587, + 0.0, + 0.0, + 0.04655751585960388, + 0.6014864537864923, + 0.484710942953825, + 0.5425647720694542, + 0.9622479751706123 + ], + "unique_experts": 54, + "load_cv": 1.00251287227951, + "normalized_load_entropy": 0.8860165714838698, + "max_load_share": 0.07657657657657657 + }, + "full_input": { + "tokens": 115, + "top_k": 6, + "decisions": 690, + "ordered_route_sha256": "4b5ee705253fdbfdb6f70a2068437432f1922689da0658005341a7a91eae3766", + "route_weight_sha256": "67122f6c5fa145afadf806f146c5e305e62b3a04d10c0db7bdef48d3f2be677e", + "loads": [ + 19, + 10, + 3, + 0, + 5, + 6, + 35, + 6, + 15, + 4, + 19, + 13, + 12, + 3, + 2, + 10, + 19, + 2, + 8, + 16, + 1, + 15, + 21, + 8, + 5, + 10, + 17, + 8, + 1, + 20, + 15, + 5, + 10, + 19, + 10, + 19, + 6, + 1, + 4, + 30, + 15, + 7, + 16, + 2, + 19, + 16, + 36, + 8, + 7, + 8, + 15, + 0, + 22, + 2, + 5, + 3, + 10, + 12, + 6, + 5, + 12, + 12, + 9, + 11 + ], + "weighted_loads": [ + 1.5928142163902521, + 0.6847972236573696, + 0.14771423861384392, + 0.0, + 0.19440471567213535, + 0.23820054717361927, + 2.5017509274184704, + 0.3081959914416075, + 0.7228731699287891, + 0.13162805885076523, + 1.1604121532291174, + 0.9093234669417143, + 0.708629822358489, + 0.10487597063183784, + 0.066847775131464, + 0.6853188164532185, + 1.2222256772220135, + 0.07049889117479324, + 0.3183240760117769, + 0.7775964979082346, + 0.024480946362018585, + 0.787080792710185, + 1.2264414820820093, + 0.2815238293260336, + 0.28928508050739765, + 0.5508727505803108, + 0.7633798941969872, + 0.3687210250645876, + 0.030795488506555557, + 1.8151448834687471, + 0.8376747742295265, + 0.30526892840862274, + 0.86330796033144, + 1.4865087941288948, + 0.66672807559371, + 0.9748804736882448, + 0.4066159427165985, + 0.03339637443423271, + 0.149705670773983, + 1.6422336231917143, + 0.8735929150134325, + 0.27304121665656567, + 1.0098566431552172, + 0.07554928585886955, + 1.3534270860254765, + 1.2559202015399933, + 1.9653096925467253, + 0.6047587264329195, + 0.7802521865814924, + 0.369951456785202, + 0.6992751024663448, + 0.0, + 1.2272354289889336, + 0.07971052080392838, + 0.1807783991098404, + 0.09969213046133518, + 0.3750020395964384, + 0.7481828331947327, + 0.27422018721699715, + 0.2527039051055908, + 0.6931837685406208, + 0.6044807620346546, + 0.5425647720694542, + 1.0191510580480099 + ], + "unique_experts": 62, + "load_cv": 0.7302449718872452, + "normalized_load_entropy": 0.9359598081060164, + "max_load_share": 0.05217391304347826 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 74, + "ordered_topk_exact_tokens": 34, + "set_exact_tokens": 45, + "mean_set_jaccard": 0.8880308880308881, + "mean_token_weighted_tv": 0.018228097655181144, + "aggregate_load_tv": 0.040540540540540536 + }, + "system_bos": { + "tokens": 74, + "ordered_topk_exact_tokens": 32, + "set_exact_tokens": 50, + "mean_set_jaccard": 0.8963963963963966, + "mean_token_weighted_tv": 0.021807705303905783, + "aggregate_load_tv": 0.04054054054054054 + }, + "system_x": { + "tokens": 74, + "ordered_topk_exact_tokens": 21, + "set_exact_tokens": 34, + "mean_set_jaccard": 0.8317245817245817, + "mean_token_weighted_tv": 0.03163578441819629, + "aggregate_load_tv": 0.06981981981981983 + }, + "system_period": { + "tokens": 74, + "ordered_topk_exact_tokens": 31, + "set_exact_tokens": 42, + "mean_set_jaccard": 0.8521235521235522, + "mean_token_weighted_tv": 0.03014513399653338, + "aggregate_load_tv": 0.0608108108108108 + }, + "bos_at_s0": { + "tokens": 74, + "ordered_topk_exact_tokens": 32, + "set_exact_tokens": 42, + "mean_set_jaccard": 0.861969111969112, + "mean_token_weighted_tv": 0.027328037027571653, + "aggregate_load_tv": 0.060810810810810814 + }, + "bos_at_s1": { + "tokens": 74, + "ordered_topk_exact_tokens": 18, + "set_exact_tokens": 36, + "mean_set_jaccard": 0.8423423423423424, + "mean_token_weighted_tv": 0.029420783478968048, + "aggregate_load_tv": 0.0698198198198198 + }, + "x_at_s0": { + "tokens": 74, + "ordered_topk_exact_tokens": 29, + "set_exact_tokens": 38, + "mean_set_jaccard": 0.8355855855855856, + "mean_token_weighted_tv": 0.032157483296720565, + "aggregate_load_tv": 0.06531531531531531 + }, + "x_at_s1": { + "tokens": 74, + "ordered_topk_exact_tokens": 16, + "set_exact_tokens": 30, + "mean_set_jaccard": 0.798906048906049, + "mean_token_weighted_tv": 0.03945157880819327, + "aggregate_load_tv": 0.08333333333333333 + }, + "period_at_s0": { + "tokens": 74, + "ordered_topk_exact_tokens": 22, + "set_exact_tokens": 37, + "mean_set_jaccard": 0.8294723294723295, + "mean_token_weighted_tv": 0.03363743679900024, + "aggregate_load_tv": 0.07432432432432431 + }, + "period_at_s1": { + "tokens": 74, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 29, + "mean_set_jaccard": 0.7950450450450451, + "mean_token_weighted_tv": 0.03998386117352827, + "aggregate_load_tv": 0.08558558558558559 + } + } + }, + "layer_14": { + "layer": 14, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "9407160eb0309c1e97d75fd37e82c7c5787f95a58a38d5501e949c8eeb5e2911", + "route_weight_sha256": "381f4d225528240da5620b72c23cb164a4d9036c577aace03d5b172cc1e3532b", + "loads": [ + 8, + 5, + 10, + 4, + 9, + 0, + 16, + 2, + 7, + 0, + 3, + 0, + 3, + 15, + 4, + 10, + 19, + 2, + 6, + 7, + 10, + 4, + 2, + 6, + 6, + 9, + 7, + 7, + 11, + 12, + 9, + 0, + 4, + 0, + 1, + 0, + 11, + 9, + 0, + 8, + 14, + 34, + 4, + 0, + 2, + 1, + 9, + 11, + 4, + 20, + 2, + 6, + 16, + 3, + 18, + 5, + 21, + 4, + 1, + 8, + 3, + 6, + 3, + 3 + ], + "weighted_loads": [ + 0.3831952717155218, + 0.2327842004597187, + 0.4713293593376875, + 0.1363625843077898, + 0.5234489552676678, + 0.0, + 1.3604720570147038, + 0.0791308730840683, + 0.36429474130272865, + 0.0, + 0.1065419353544712, + 0.0, + 0.17144232615828514, + 0.9774240627884865, + 0.13247454352676868, + 0.4850182291120291, + 1.0283640045672655, + 0.08787615597248077, + 0.22901552356779575, + 0.8561936244368553, + 0.6094948798418045, + 0.1595337577164173, + 0.06658228300511837, + 0.371749896556139, + 0.3294639866799116, + 0.5778273046016693, + 0.26446549966931343, + 0.31927756778895855, + 0.5938364434987307, + 0.678651113063097, + 0.4442378878593445, + 0.0, + 0.1376009564846754, + 0.0, + 0.05514317378401756, + 0.0, + 0.6621926929801702, + 0.8681786805391312, + 0.0, + 0.34723214991390705, + 0.4825591892004013, + 1.9001155532896519, + 0.16536063700914383, + 0.0, + 0.07898758351802826, + 0.048448577523231506, + 1.185389794409275, + 1.366337738931179, + 0.1294531524181366, + 1.6385719552636147, + 0.10318835824728012, + 0.21064743027091026, + 1.481251074001193, + 0.11129984632134438, + 1.2473872024565935, + 0.2502315081655979, + 1.571124441921711, + 0.1542515866458416, + 0.03777071088552475, + 0.29622271470725536, + 0.1228062603622675, + 0.22814201936125755, + 0.09439830668270588, + 0.1056341864168644 + ], + "unique_experts": 56, + "load_cv": 0.9105340825904333, + "normalized_load_entropy": 0.905407432252327, + "max_load_share": 0.07657657657657657 + }, + "full_input": { + "tokens": 99, + "top_k": 6, + "decisions": 594, + "ordered_route_sha256": "7ca957a9986ad6b3c2c022e4f6d87f3a69d6484ce38ac67481cc9e37e1e36e9c", + "route_weight_sha256": "718ab974f1f1046b52fde2ea71cc6b32302bc4996ad1faeeb6e59bd99e368f94", + "loads": [ + 13, + 5, + 10, + 6, + 10, + 11, + 16, + 5, + 7, + 7, + 5, + 3, + 3, + 15, + 4, + 13, + 19, + 2, + 12, + 9, + 10, + 5, + 2, + 17, + 7, + 12, + 13, + 13, + 19, + 12, + 11, + 4, + 4, + 7, + 1, + 0, + 12, + 10, + 2, + 8, + 14, + 34, + 5, + 1, + 4, + 1, + 15, + 14, + 4, + 20, + 7, + 12, + 22, + 9, + 18, + 9, + 22, + 4, + 1, + 18, + 3, + 7, + 3, + 3 + ], + "weighted_loads": [ + 1.0088283624500036, + 0.2327842004597187, + 0.4713293593376875, + 0.20039484649896622, + 0.5663500837981701, + 0.9911393467336893, + 1.3604720570147038, + 0.20801814645528793, + 0.36429474130272865, + 0.43159177899360657, + 0.1713783722370863, + 0.1943669505417347, + 0.17144232615828514, + 0.9774240627884865, + 0.13247454352676868, + 0.595916735008359, + 1.0283640045672655, + 0.08787615597248077, + 0.5958295036107302, + 0.939375426620245, + 0.6094948798418045, + 0.27798325940966606, + 0.06658228300511837, + 0.8461826480925083, + 0.3520638830959797, + 0.7704470753669739, + 0.6021216809749603, + 0.7946819495409727, + 1.9887436274439096, + 0.678651113063097, + 0.6056412160396576, + 0.15769119933247566, + 0.1376009564846754, + 0.7292141653597355, + 0.05514317378401756, + 0.0, + 0.7147714141756296, + 0.9096839241683483, + 0.13591189682483673, + 0.34723214991390705, + 0.4825591892004013, + 1.9001155532896519, + 0.21509066224098206, + 0.0490058995783329, + 0.14491236954927444, + 0.048448577523231506, + 1.474623279646039, + 1.4964309353381395, + 0.1294531524181366, + 1.6385719552636147, + 0.2907316070050001, + 1.5317974165081978, + 2.246617591008544, + 0.5430623441934586, + 1.2473872024565935, + 0.5504729114472866, + 1.6105810776352882, + 0.1542515866458416, + 0.03777071088552475, + 0.7570489216595888, + 0.1228062603622675, + 0.23320342879742384, + 0.09439830668270588, + 0.1056341864168644 + ], + "unique_experts": 63, + "load_cv": 0.7030428808039308, + "normalized_load_entropy": 0.9409387393492257, + "max_load_share": 0.05723905723905724 + } + }, + "s1_eos": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "b43ba1f5dce81970282a09008230d9f4ad0777c1c643655579f5d8fb55519fe5", + "route_weight_sha256": "24eed960f38862fb273e3b0200433da712bc89e1b921a23015969340aed4ad8d", + "loads": [ + 8, + 4, + 10, + 4, + 9, + 0, + 18, + 3, + 7, + 0, + 3, + 0, + 3, + 16, + 5, + 12, + 19, + 2, + 7, + 7, + 9, + 4, + 2, + 6, + 7, + 9, + 7, + 7, + 9, + 12, + 10, + 0, + 4, + 0, + 1, + 0, + 11, + 9, + 0, + 7, + 15, + 31, + 3, + 0, + 2, + 1, + 10, + 10, + 4, + 22, + 3, + 4, + 14, + 3, + 17, + 5, + 22, + 3, + 1, + 7, + 5, + 4, + 4, + 3 + ], + "weighted_loads": [ + 0.38725372590124607, + 0.20217899605631828, + 0.4784780703485012, + 0.13337642140686512, + 0.5337244160473347, + 0.0, + 1.4306749608367682, + 0.10627349093556404, + 0.35666000843048096, + 0.0, + 0.1040645819157362, + 0.0, + 0.17558665201067924, + 0.9922086950391531, + 0.15617804415524006, + 0.5644293334335089, + 1.0226206611841917, + 0.0910133607685566, + 0.2692512571811676, + 0.852913461625576, + 0.5778952166438103, + 0.16372667253017426, + 0.06801405549049377, + 0.3574265390634537, + 0.35682159662246704, + 0.5886658951640129, + 0.272322291508317, + 0.31519127637147903, + 0.5058893300592899, + 0.6876169219613075, + 0.49191753938794136, + 0.0, + 0.14260955527424812, + 0.0, + 0.055417608469724655, + 0.0, + 0.6592909023165703, + 0.8424770999699831, + 0.0, + 0.3009973354637623, + 0.4967897906899452, + 1.8192551080137491, + 0.12558896467089653, + 0.0, + 0.07681562192738056, + 0.053756821900606155, + 1.2478235978633165, + 1.3338619470596313, + 0.12731208093464375, + 1.6692702304571867, + 0.13612941652536392, + 0.14194589853286743, + 1.4173788540065289, + 0.11271273717284203, + 1.2021239008754492, + 0.2552744261920452, + 1.5865450836718082, + 0.10873628221452236, + 0.03546662628650665, + 0.2639906369149685, + 0.18690123409032822, + 0.1634119376540184, + 0.1225078646093607, + 0.10010642372071743 + ], + "unique_experts": 56, + "load_cv": 0.9001348094077575, + "normalized_load_entropy": 0.9063651764748295, + "max_load_share": 0.06981981981981981 + }, + "full_input": { + "tokens": 115, + "top_k": 6, + "decisions": 690, + "ordered_route_sha256": "5e4e29778b648d2257c7a4c6f3f4e2d2ecb5e2c910336da8e2063e1f6d6589b5", + "route_weight_sha256": "a9258af6e27a6ca015bdc1da2717cd840a8abdf25991257bdb920958977db1ae", + "loads": [ + 16, + 5, + 10, + 7, + 12, + 17, + 18, + 8, + 9, + 10, + 3, + 3, + 9, + 16, + 5, + 16, + 19, + 2, + 15, + 12, + 11, + 9, + 2, + 15, + 12, + 14, + 12, + 15, + 22, + 13, + 14, + 4, + 6, + 11, + 2, + 1, + 11, + 12, + 3, + 8, + 15, + 31, + 5, + 1, + 4, + 1, + 16, + 12, + 6, + 23, + 19, + 7, + 22, + 13, + 19, + 8, + 23, + 4, + 2, + 24, + 8, + 6, + 6, + 6 + ], + "weighted_loads": [ + 1.177249912172556, + 0.2527790628373623, + 0.4784780703485012, + 0.23332839831709862, + 0.7401884458959103, + 1.1871687900274992, + 1.4306749608367682, + 0.32330750301480293, + 0.5193920806050301, + 0.7347572818398476, + 0.1040645819157362, + 0.21552486345171928, + 0.5724773518741131, + 0.9922086950391531, + 0.15617804415524006, + 0.727710610255599, + 1.0226206611841917, + 0.0910133607685566, + 0.7746049240231514, + 1.0927654709666967, + 0.8099663779139519, + 0.42318110913038254, + 0.06801405549049377, + 0.7474563326686621, + 0.5980181191116571, + 0.83671860024333, + 0.6362326722592115, + 0.7017199378460646, + 2.4480976685881615, + 0.735860388725996, + 0.7030020728707314, + 0.11408466845750809, + 0.22154152765870094, + 1.242896642535925, + 0.1036800816655159, + 0.0797857791185379, + 0.6592909023165703, + 1.1987033355981112, + 0.22513936460018158, + 0.3577282391488552, + 0.4967897906899452, + 1.8192551080137491, + 0.22232671827077866, + 0.045591797679662704, + 0.14267837069928646, + 0.053756821900606155, + 1.5554424747824669, + 1.4026508331298828, + 0.25482565723359585, + 1.702363459393382, + 1.1012811064720154, + 1.3815196081995964, + 2.215242378413677, + 0.8690135627985001, + 1.2856649067252874, + 0.4999538064002991, + 1.6393495872616768, + 0.14630195684731007, + 0.14207488298416138, + 1.2363575361669064, + 0.43615030124783516, + 0.20721416594460607, + 0.22505767829716206, + 0.20808720402419567 + ], + "unique_experts": 64, + "load_cv": 0.618628412871176, + "normalized_load_entropy": 0.9519167953449451, + "max_load_share": 0.04492753623188406 + } + }, + "s0_bos": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "268f996d9a7449e638e8b4572ee51b6d67723e0b14fc1dfdac0374161dfa4014", + "route_weight_sha256": "25248e9e1cf74163e160a5177e9e3367696e6c7a4383be16fc97bd63f314d299", + "loads": [ + 8, + 5, + 10, + 6, + 9, + 1, + 16, + 2, + 7, + 0, + 4, + 1, + 3, + 14, + 4, + 7, + 19, + 2, + 6, + 7, + 10, + 5, + 2, + 7, + 6, + 9, + 7, + 6, + 9, + 12, + 10, + 0, + 4, + 1, + 1, + 0, + 14, + 10, + 0, + 8, + 12, + 28, + 5, + 0, + 4, + 1, + 9, + 10, + 4, + 22, + 3, + 5, + 16, + 3, + 18, + 4, + 20, + 5, + 1, + 7, + 4, + 3, + 5, + 3 + ], + "weighted_loads": [ + 0.38525593653321266, + 0.24096070602536201, + 0.4783972781151533, + 0.20155631750822067, + 0.5264071002602577, + 0.02580496482551098, + 1.4563021436333656, + 0.06965027004480362, + 0.3544502258300781, + 0.0, + 0.13929429650306702, + 0.028074773028492928, + 0.17305617779493332, + 1.0230453182011843, + 0.1340023148804903, + 0.3990703970193863, + 1.0307020153850317, + 0.1041351780295372, + 0.22630900889635086, + 0.8461940512061119, + 0.6302101761102676, + 0.20227285474538803, + 0.07442335039377213, + 0.3766982927918434, + 0.3258837256580591, + 0.5800734832882881, + 0.2619862612336874, + 0.2602818328887224, + 0.5465350560843945, + 0.6552685052156448, + 0.48261841014027596, + 0.0, + 0.14332283660769463, + 0.03465582802891731, + 0.05154868960380554, + 0.0, + 0.7539732027798891, + 0.8860948998481035, + 0.0, + 0.36409100517630577, + 0.45218334160745144, + 1.6785590089857578, + 0.21084489300847054, + 0.0, + 0.12980952858924866, + 0.0499761737883091, + 1.1938507538288832, + 1.3519749864935875, + 0.12746996618807316, + 1.7153256218880415, + 0.13781575858592987, + 0.1700291819870472, + 1.5038897078484297, + 0.11469560116529465, + 1.3173681385815144, + 0.2295798473060131, + 1.5657639503479004, + 0.19656236842274666, + 0.033767540007829666, + 0.25208012759685516, + 0.15929651260375977, + 0.1305653266608715, + 0.14735800959169865, + 0.11229407601058483 + ], + "unique_experts": 59, + "load_cv": 0.8412214925603668, + "normalized_load_entropy": 0.9180031331908031, + "max_load_share": 0.06306306306306306 + }, + "full_input": { + "tokens": 99, + "top_k": 6, + "decisions": 594, + "ordered_route_sha256": "7423683e6548bc3da4d2636ab224c80432fb0d6d5ddd61c6ae9a97e1d4c151d7", + "route_weight_sha256": "7616bdea8895d6cabd99f183d2e65e3c5e25f436472eaa0b747b68d56947d44a", + "loads": [ + 13, + 5, + 10, + 9, + 10, + 12, + 16, + 4, + 7, + 7, + 6, + 4, + 3, + 14, + 4, + 9, + 19, + 2, + 13, + 9, + 10, + 6, + 2, + 17, + 7, + 12, + 13, + 12, + 18, + 12, + 13, + 4, + 4, + 8, + 1, + 0, + 15, + 11, + 2, + 8, + 12, + 28, + 6, + 1, + 7, + 1, + 15, + 12, + 4, + 22, + 7, + 10, + 22, + 9, + 18, + 7, + 21, + 6, + 2, + 18, + 4, + 3, + 5, + 3 + ], + "weighted_loads": [ + 1.0108890272676945, + 0.24096070602536201, + 0.4783972781151533, + 0.3223531059920788, + 0.5706066861748695, + 0.9935053288936615, + 1.4563021436333656, + 0.15137235075235367, + 0.3544502258300781, + 0.44969988241791725, + 0.2041307333856821, + 0.22244172357022762, + 0.17305617779493332, + 1.0230453182011843, + 0.1340023148804903, + 0.4977920204401016, + 1.0307020153850317, + 0.1041351780295372, + 0.669968206435442, + 0.9319514334201813, + 0.6302101761102676, + 0.31967074424028397, + 0.07442335039377213, + 0.8235349785536528, + 0.3484836220741272, + 0.7878507748246193, + 0.5996424425393343, + 0.7849012706428766, + 2.0331025533378124, + 0.6552685052156448, + 0.6681032609194517, + 0.2011871077120304, + 0.14332283660769463, + 0.7765304483473301, + 0.05154868960380554, + 0.0, + 0.8065519239753485, + 0.9276001434773207, + 0.1374019905924797, + 0.36409100517630577, + 0.45218334160745144, + 1.6785590089857578, + 0.26152294129133224, + 0.0490058995783329, + 0.2766672298312187, + 0.0499761737883091, + 1.4678726457059383, + 1.4378186259418726, + 0.12746996618807316, + 1.7153256218880415, + 0.29777607321739197, + 0.6461886372417212, + 2.2692562248557806, + 0.5464580990374088, + 1.3173681385815144, + 0.5112118758261204, + 1.6052205860614777, + 0.23949825391173363, + 0.07832257822155952, + 0.7522657066583633, + 0.15929651260375977, + 0.1305653266608715, + 0.14735800959169865, + 0.11229407601058483 + ], + "unique_experts": 63, + "load_cv": 0.6546808827487541, + "normalized_load_entropy": 0.9470658102360373, + "max_load_share": 0.04713804713804714 + } + }, + "s1_bos": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "87dfdfd82a598227429807c3be064dfd0da55f424bba3bb9e5c2aedd7c2c9209", + "route_weight_sha256": "a81db1f1f1e32eaa69efea13d392ef38903ddd875d0e2175698eea478c6577c2", + "loads": [ + 8, + 4, + 11, + 6, + 9, + 1, + 16, + 3, + 7, + 0, + 3, + 0, + 3, + 16, + 3, + 10, + 22, + 2, + 4, + 7, + 10, + 4, + 3, + 6, + 8, + 10, + 6, + 6, + 8, + 12, + 10, + 0, + 4, + 0, + 1, + 0, + 14, + 10, + 0, + 8, + 9, + 32, + 5, + 0, + 4, + 1, + 8, + 10, + 3, + 21, + 3, + 4, + 14, + 3, + 18, + 5, + 19, + 5, + 1, + 7, + 4, + 5, + 4, + 4 + ], + "weighted_loads": [ + 0.3817794043570757, + 0.2038292959332466, + 0.5280392970889807, + 0.2043407615274191, + 0.5364851169288158, + 0.025220025330781937, + 1.4270149394869804, + 0.09482754208147526, + 0.34789013117551804, + 0.0, + 0.10949215665459633, + 0.0, + 0.17190488427877426, + 1.132915511727333, + 0.09948138147592545, + 0.4854314886033535, + 1.1599930133670568, + 0.0995057187974453, + 0.16666477359831333, + 0.8470215126872063, + 0.6049105077981949, + 0.16170847788453102, + 0.10084035433828831, + 0.32140856981277466, + 0.409541055560112, + 0.6112213879823685, + 0.26056235283613205, + 0.23397929593920708, + 0.4694306328892708, + 0.6740901954472065, + 0.4800185486674309, + 0.0, + 0.14477270282804966, + 0.0, + 0.05101895332336426, + 0.0, + 0.7939143758267164, + 0.8427606709301472, + 0.0, + 0.3450030256062746, + 0.33594617061316967, + 1.814617682248354, + 0.1975824311375618, + 0.0, + 0.13817145489156246, + 0.05274234339594841, + 1.1893389821052551, + 1.34853127412498, + 0.09666429832577705, + 1.6968575455248356, + 0.1342524215579033, + 0.15831242129206657, + 1.3430418204516172, + 0.11012405529618263, + 1.300203213468194, + 0.23576689697802067, + 1.5045294798910618, + 0.1969633586704731, + 0.03156321868300438, + 0.23576947674155235, + 0.15144356526434422, + 0.2003430686891079, + 0.12045253440737724, + 0.13566765747964382 + ], + "unique_experts": 57, + "load_cv": 0.886323503658185, + "normalized_load_entropy": 0.9110662251289902, + "max_load_share": 0.07207207207207207 + }, + "full_input": { + "tokens": 115, + "top_k": 6, + "decisions": 690, + "ordered_route_sha256": "2a41b95f283d7de7b5891b589cc2e4143c8285ace6deeba949161b29750bcfa3", + "route_weight_sha256": "43cf9cef405360f50194560d8dce193dbdfa922c08598c4e729ea6039d0d29b9", + "loads": [ + 16, + 5, + 11, + 9, + 13, + 18, + 16, + 6, + 9, + 10, + 4, + 3, + 9, + 16, + 3, + 13, + 22, + 2, + 12, + 12, + 12, + 8, + 3, + 14, + 13, + 15, + 11, + 14, + 22, + 13, + 15, + 4, + 6, + 11, + 2, + 1, + 14, + 13, + 3, + 9, + 9, + 32, + 6, + 1, + 6, + 2, + 14, + 13, + 5, + 22, + 19, + 7, + 22, + 12, + 20, + 8, + 20, + 7, + 2, + 25, + 7, + 6, + 6, + 7 + ], + "weighted_loads": [ + 1.1717755906283855, + 0.2544293627142906, + 0.5280392970889807, + 0.3395910058170557, + 0.7868993692100048, + 1.1831045430153608, + 1.4270149394869804, + 0.22244413383305073, + 0.5106222033500671, + 0.7670456096529961, + 0.14131345227360725, + 0.21552486345171928, + 0.5687955841422081, + 1.132915511727333, + 0.09948138147592545, + 0.6150099262595177, + 1.1599930133670568, + 0.0995057187974453, + 0.6540176849812269, + 1.0895197223871946, + 0.8369816690683365, + 0.3647366352379322, + 0.10084035433828831, + 0.6838332507759333, + 0.6507375780493021, + 0.8777748830616474, + 0.6244727335870266, + 0.6953046191483736, + 2.5813249088823795, + 0.722333662211895, + 0.7232023533433676, + 0.1616186536848545, + 0.22370467521250248, + 1.2337266840040684, + 0.0992814265191555, + 0.0797857791185379, + 0.7939143758267164, + 1.1989869065582752, + 0.21671678870916367, + 0.40173392929136753, + 0.33594617061316967, + 1.814617682248354, + 0.24981579184532166, + 0.045591797679662704, + 0.20403420366346836, + 0.09371786564588547, + 1.5071099679917097, + 1.457734251394868, + 0.22417787462472916, + 1.729950774461031, + 1.1016082521528006, + 0.5754939392209053, + 2.1409053448587656, + 0.8246381059288979, + 1.3837442193180323, + 0.5329196397215128, + 1.5573339834809303, + 0.2774963416159153, + 0.1381714753806591, + 1.2501972652971745, + 0.40069263242185116, + 0.23936781287193298, + 0.2230023480951786, + 0.24364843778312206 + ], + "unique_experts": 64, + "load_cv": 0.6098746346121383, + "normalized_load_entropy": 0.9542941587209832, + "max_load_share": 0.0463768115942029 + } + }, + "s0_x": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "ace7aff85d43927bbae90367df2e3c7e58b41f8e0f3dd97e26029ca4b7d40d3c", + "route_weight_sha256": "d17be55e1d909de906fb5d3a9a8179b125c09c864f4f100d1f241edfa54f2b95", + "loads": [ + 9, + 6, + 10, + 3, + 9, + 1, + 16, + 2, + 7, + 0, + 2, + 1, + 3, + 13, + 3, + 9, + 19, + 3, + 4, + 7, + 10, + 6, + 1, + 7, + 8, + 11, + 6, + 6, + 7, + 12, + 9, + 1, + 4, + 1, + 1, + 0, + 12, + 8, + 0, + 8, + 11, + 33, + 5, + 0, + 4, + 2, + 8, + 11, + 4, + 22, + 4, + 6, + 15, + 3, + 19, + 4, + 21, + 3, + 1, + 7, + 4, + 4, + 3, + 5 + ], + "weighted_loads": [ + 0.4331248626112938, + 0.2664319686591625, + 0.48411515541374683, + 0.11148130893707275, + 0.5230228342115879, + 0.026796607300639153, + 1.4373591467738152, + 0.06772323325276375, + 0.3546027410775423, + 0.0, + 0.0918666198849678, + 0.030107172206044197, + 0.16089706495404243, + 0.9834017027169466, + 0.1022859551012516, + 0.44004181772470474, + 1.0626724250614643, + 0.14072129130363464, + 0.17426623031497002, + 0.8722874075174332, + 0.6197809632867575, + 0.23917509242892265, + 0.032695215195417404, + 0.3887627571821213, + 0.40289273113012314, + 0.6448459271341562, + 0.2574156876653433, + 0.22201274149119854, + 0.4525029808282852, + 0.6764597054570913, + 0.44996948912739754, + 0.04872395098209381, + 0.1485941056162119, + 0.034489598125219345, + 0.05239612236618996, + 0.0, + 0.6691724676638842, + 0.7755779679864645, + 0.0, + 0.3612032011151314, + 0.4210767950862646, + 1.873392604291439, + 0.21182499453425407, + 0.0, + 0.1341299656778574, + 0.06701929867267609, + 1.103867881000042, + 1.3505085464566946, + 0.12690191343426704, + 1.7393622603267431, + 0.1709928810596466, + 0.22337919287383556, + 1.4515336751937866, + 0.11572585999965668, + 1.3336248025298119, + 0.21915053948760033, + 1.6171704791486263, + 0.11952416971325874, + 0.038601554930210114, + 0.24913666397333145, + 0.1676756516098976, + 0.1694336198270321, + 0.08674710057675838, + 0.1643974557518959 + ], + "unique_experts": 60, + "load_cv": 0.8866897152237168, + "normalized_load_entropy": 0.9146821172341395, + "max_load_share": 0.07432432432432433 + }, + "full_input": { + "tokens": 99, + "top_k": 6, + "decisions": 594, + "ordered_route_sha256": "a65d796d34b2ffc901251f7ca49a6b295f3c3bc1770839b98995e316fa1f0f40", + "route_weight_sha256": "f2388b1d3811488c3059c125b8f5f74cf604e2310739899d3c61929c12db49c1", + "loads": [ + 15, + 6, + 10, + 4, + 10, + 14, + 16, + 4, + 7, + 6, + 4, + 4, + 3, + 13, + 3, + 11, + 19, + 3, + 8, + 10, + 10, + 7, + 1, + 17, + 9, + 14, + 13, + 11, + 15, + 12, + 12, + 5, + 4, + 8, + 1, + 0, + 13, + 10, + 2, + 8, + 11, + 33, + 6, + 1, + 6, + 2, + 15, + 13, + 4, + 22, + 9, + 10, + 21, + 10, + 19, + 7, + 22, + 4, + 1, + 19, + 4, + 4, + 4, + 5 + ], + "weighted_loads": [ + 1.166590467095375, + 0.2664319686591625, + 0.48411515541374683, + 0.15166493132710457, + 0.5686453953385353, + 1.1949798092246056, + 1.4373591467738152, + 0.1646689958870411, + 0.3546027410775423, + 0.385029636323452, + 0.1567030567675829, + 0.2244741227477789, + 0.16089706495404243, + 0.9834017027169466, + 0.1022859551012516, + 0.5158171877264977, + 1.0626724250614643, + 0.14072129130363464, + 0.4378376081585884, + 1.0258416421711445, + 0.6197809632867575, + 0.3330301158130169, + 0.032695215195417404, + 0.8355994429439306, + 0.4254926275461912, + 0.8560604844242334, + 0.7075780425220728, + 0.6922038923949003, + 1.6311406753957272, + 0.6764597054570913, + 0.641894219443202, + 0.2470662146806717, + 0.1485941056162119, + 0.8415181338787079, + 0.05239612236618996, + 0.0, + 0.7217511888593435, + 0.8891990650445223, + 0.11017975211143494, + 0.3612032011151314, + 0.4210767950862646, + 1.873392604291439, + 0.2603742592036724, + 0.0490058995783329, + 0.20005475170910358, + 0.06701929867267609, + 1.4410451333969831, + 1.4363521859049797, + 0.12690191343426704, + 1.7393622603267431, + 0.3721311204135418, + 0.6628535836935043, + 2.2169001922011375, + 0.6327185817062855, + 1.3336248025298119, + 0.4611039198935032, + 1.6566271148622036, + 0.1595396026968956, + 0.038601554930210114, + 0.8059568852186203, + 0.1676756516098976, + 0.1694336198270321, + 0.13090847246348858, + 0.1643974557518959 + ], + "unique_experts": 63, + "load_cv": 0.6868604343598784, + "normalized_load_entropy": 0.9437872674666837, + "max_load_share": 0.05555555555555555 + } + }, + "s1_x": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "bdfb850923e0520c070126f2515ddf96f029fe59d36cb4865999119ba4d73fb0", + "route_weight_sha256": "11468e069929de94cdf4b4bb7e9f2907a9b3b1b7399e8a30a85cb89adbc3badd", + "loads": [ + 8, + 5, + 11, + 4, + 9, + 1, + 18, + 3, + 8, + 0, + 1, + 0, + 3, + 15, + 4, + 9, + 20, + 2, + 3, + 7, + 10, + 4, + 4, + 7, + 9, + 11, + 9, + 4, + 8, + 12, + 9, + 0, + 5, + 0, + 1, + 0, + 17, + 9, + 0, + 7, + 10, + 34, + 5, + 0, + 5, + 0, + 8, + 10, + 4, + 21, + 4, + 5, + 15, + 3, + 17, + 4, + 20, + 3, + 0, + 5, + 2, + 6, + 3, + 3 + ], + "weighted_loads": [ + 0.387953769415617, + 0.23031730391085148, + 0.5320829320698977, + 0.14925584942102432, + 0.5324653424322605, + 0.02623538114130497, + 1.4945037141442299, + 0.10239976085722446, + 0.38205282390117645, + 0.0, + 0.038475360721349716, + 0.0, + 0.15646012499928474, + 1.0825148597359657, + 0.11328555457293987, + 0.49418925680220127, + 1.146315535530448, + 0.11635681986808777, + 0.12379413843154907, + 0.8562178164720535, + 0.6233425792306662, + 0.16429774463176727, + 0.12437546625733376, + 0.37577907368540764, + 0.4350460898131132, + 0.6805019695311785, + 0.35086075589060783, + 0.18205420672893524, + 0.45430026575922966, + 0.6865204349160194, + 0.45204319059848785, + 0.0, + 0.17524263449013233, + 0.0, + 0.05123148858547211, + 0.0, + 0.8849164973944426, + 0.7816213127225637, + 0.0, + 0.31128257140517235, + 0.3757092822343111, + 1.9008629154413939, + 0.2036995105445385, + 0.0, + 0.16221540980041027, + 0.0, + 1.1952863689512014, + 1.3243694938719273, + 0.118545763194561, + 1.727854184806347, + 0.1695978380739689, + 0.1941283605992794, + 1.3663695845752954, + 0.11755332723259926, + 1.2396499682217836, + 0.1823318637907505, + 1.5978737324476242, + 0.11217764765024185, + 0.0, + 0.17617084830999374, + 0.09085647016763687, + 0.23641173541545868, + 0.08941266313195229, + 0.10241581313312054 + ], + "unique_experts": 55, + "load_cv": 0.9243348611169097, + "normalized_load_entropy": 0.9024117461013049, + "max_load_share": 0.07657657657657657 + }, + "full_input": { + "tokens": 115, + "top_k": 6, + "decisions": 690, + "ordered_route_sha256": "1aeb6d9e7b301f3061d65bcdeab7b0b4a815c35251595592d5846cb43460443e", + "route_weight_sha256": "9b88628e01f5f4fa9d1dd047691254cf85437cb19c3e0393058053caedde8dc5", + "loads": [ + 18, + 6, + 11, + 5, + 12, + 20, + 18, + 7, + 10, + 10, + 1, + 4, + 9, + 15, + 4, + 12, + 20, + 2, + 9, + 12, + 12, + 8, + 4, + 16, + 14, + 15, + 15, + 12, + 21, + 13, + 13, + 3, + 7, + 11, + 2, + 1, + 17, + 13, + 2, + 8, + 10, + 34, + 7, + 1, + 7, + 0, + 15, + 12, + 6, + 22, + 19, + 7, + 23, + 14, + 19, + 7, + 21, + 4, + 1, + 25, + 5, + 7, + 6, + 6 + ], + "weighted_loads": [ + 1.276009188964963, + 0.2809173706918955, + 0.5320829320698977, + 0.19330137223005295, + 0.7389293722808361, + 1.4433596953749657, + 1.4945037141442299, + 0.2794188614934683, + 0.5447848960757256, + 0.7599296011030674, + 0.038475360721349716, + 0.26401081681251526, + 0.5533508248627186, + 1.0825148597359657, + 0.11328555457293987, + 0.6032653544098139, + 1.146315535530448, + 0.11635681986808777, + 0.541589267551899, + 1.0997552778571844, + 0.8554137405008078, + 0.3610739931464195, + 0.12437546625733376, + 0.7921864148229361, + 0.6762426123023033, + 0.8776500690728426, + 0.8194257393479347, + 0.5450614895671606, + 2.1577168591320515, + 0.7347639016807079, + 0.6788418553769588, + 0.10326759144663811, + 0.25417460687458515, + 1.2830633148550987, + 0.09949396178126335, + 0.0797857791185379, + 0.8849164973944426, + 1.2361834924668074, + 0.1413000002503395, + 0.3680134750902653, + 0.3757092822343111, + 1.9008629154413939, + 0.31332915276288986, + 0.045591797679662704, + 0.22807815857231617, + 0.0, + 1.5475392006337643, + 1.3931583799421787, + 0.2460593394935131, + 1.7609474137425423, + 1.1108445674180984, + 0.5881495550274849, + 2.164233108982444, + 1.0009438171982765, + 1.323190974071622, + 0.3961568623781204, + 1.6506782360374928, + 0.14974332228302956, + 0.10660825669765472, + 1.2774787843227386, + 0.3401055373251438, + 0.27543647959828377, + 0.23341844975948334, + 0.21039659343659878 + ], + "unique_experts": 63, + "load_cv": 0.6427139997263436, + "normalized_load_entropy": 0.9477201349133931, + "max_load_share": 0.04927536231884058 + } + }, + "s0_period": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "ced5b7130da2406bf08452b9f55ed11e8783025456b85a4492a15d83cc0e7bcb", + "route_weight_sha256": "83259b4d7bd51c97ad848d955e72a38fee899462afa9a2f2f04aa46fee46586c", + "loads": [ + 8, + 4, + 10, + 3, + 9, + 1, + 18, + 0, + 7, + 0, + 3, + 0, + 3, + 13, + 4, + 10, + 19, + 4, + 3, + 7, + 10, + 6, + 1, + 8, + 8, + 11, + 7, + 7, + 7, + 12, + 9, + 1, + 4, + 1, + 1, + 0, + 13, + 8, + 0, + 8, + 10, + 32, + 5, + 0, + 4, + 2, + 8, + 11, + 5, + 21, + 4, + 5, + 17, + 3, + 19, + 4, + 22, + 4, + 1, + 5, + 4, + 4, + 3, + 3 + ], + "weighted_loads": [ + 0.4009478222578764, + 0.2001318372786045, + 0.4786492809653282, + 0.11356991529464722, + 0.5284461677074432, + 0.0275097843259573, + 1.475031228736043, + 0.0, + 0.35729016549885273, + 0.0, + 0.12162048742175102, + 0.0, + 0.16042553260922432, + 1.0136641971766949, + 0.13558554649353027, + 0.47799803130328655, + 1.0674284864217043, + 0.17857125028967857, + 0.15743904188275337, + 0.8748280107975006, + 0.6352707967162132, + 0.24263477325439453, + 0.03232470899820328, + 0.4118971899151802, + 0.4108807984739542, + 0.6445036269724369, + 0.2898642662912607, + 0.26407286524772644, + 0.4472118690609932, + 0.6807567309588194, + 0.440600261092186, + 0.047270238399505615, + 0.1421230100095272, + 0.03730026260018349, + 0.057693786919116974, + 0.0, + 0.7408539019525051, + 0.7742452323436737, + 0.0, + 0.3539126254618168, + 0.3575468771159649, + 1.8388044461607933, + 0.21036946401000023, + 0.0, + 0.1312320977449417, + 0.06180024519562721, + 1.1142214089632034, + 1.3636541310697794, + 0.14720699563622475, + 1.6642448417842388, + 0.18319574370980263, + 0.17780184373259544, + 1.5279136206954718, + 0.11213424429297447, + 1.3513381220400333, + 0.21990635246038437, + 1.6753174401819706, + 0.1609419547021389, + 0.03959924355149269, + 0.18314470164477825, + 0.17165124602615833, + 0.1668049581348896, + 0.08880596980452538, + 0.11315617337822914 + ], + "unique_experts": 58, + "load_cv": 0.8986909832201272, + "normalized_load_entropy": 0.9097760869113986, + "max_load_share": 0.07207207207207207 + }, + "full_input": { + "tokens": 99, + "top_k": 6, + "decisions": 594, + "ordered_route_sha256": "c8cafe965cefde3a809bf8d8ad188b46c62ba5d6a946bdbcc17bcbf5d1d4bfd1", + "route_weight_sha256": "ebf97dc179178a40ee510d260e1f36983d0a0c3d66786550b38406dec989069b", + "loads": [ + 15, + 4, + 10, + 4, + 10, + 13, + 18, + 2, + 7, + 6, + 5, + 3, + 3, + 13, + 4, + 11, + 19, + 4, + 8, + 9, + 10, + 7, + 1, + 18, + 10, + 14, + 14, + 13, + 15, + 12, + 11, + 5, + 4, + 8, + 1, + 0, + 15, + 10, + 2, + 8, + 10, + 32, + 5, + 1, + 6, + 2, + 14, + 14, + 5, + 22, + 9, + 8, + 23, + 10, + 19, + 8, + 23, + 5, + 1, + 16, + 4, + 4, + 4, + 3 + ], + "weighted_loads": [ + 1.102913025766611, + 0.2001318372786045, + 0.4786492809653282, + 0.15375353768467903, + 0.5729036442935467, + 1.0992649421095848, + 1.475031228736043, + 0.09605115279555321, + 0.35729016549885273, + 0.4057414121925831, + 0.1864569243043661, + 0.1943669505417347, + 0.16042553260922432, + 1.0136641971766949, + 0.13558554649353027, + 0.5167718324810266, + 1.0674284864217043, + 0.17857125028967857, + 0.4672045670449734, + 0.9532203823328018, + 0.6352707967162132, + 0.3635087013244629, + 0.03232470899820328, + 0.8587338756769896, + 0.47059130668640137, + 0.8466713801026344, + 0.6817390229552984, + 0.7534264773130417, + 1.725249007344246, + 0.6807567309588194, + 0.6075880229473114, + 0.2416311427950859, + 0.1421230100095272, + 0.7984519228339195, + 0.057693786919116974, + 0.0, + 0.8368993066251278, + 0.876900926232338, + 0.1115245372056961, + 0.3539126254618168, + 0.3575468771159649, + 1.8388044461607933, + 0.21036946401000023, + 0.0490058995783329, + 0.1971568837761879, + 0.06180024519562721, + 1.389787683263421, + 1.514574695378542, + 0.14720699563622475, + 1.7109633348882198, + 0.3919238746166229, + 0.5709417965263128, + 2.2932801377028227, + 0.6265125125646591, + 1.3513381220400333, + 0.5821519680321217, + 1.7147740758955479, + 0.199275154620409, + 0.03959924355149269, + 0.6778890173882246, + 0.17165124602615833, + 0.1668049581348896, + 0.12713871896266937, + 0.11315617337822914 + ], + "unique_experts": 63, + "load_cv": 0.6970835476881225, + "normalized_load_entropy": 0.9418856675298077, + "max_load_share": 0.05387205387205387 + } + }, + "s1_period": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "e571f3d5fe1438c8ad5b61d65e2e75e0308312f9aa7d50fd13cced4dedc29594", + "route_weight_sha256": "82db206adb6b3da067eb5e66292c1d76c18d50a3115bb4fdce2bc1bbdb5f44b7", + "loads": [ + 8, + 5, + 11, + 4, + 9, + 1, + 18, + 3, + 8, + 0, + 2, + 0, + 3, + 15, + 4, + 8, + 20, + 2, + 5, + 7, + 10, + 4, + 2, + 8, + 9, + 12, + 9, + 4, + 7, + 12, + 9, + 0, + 5, + 0, + 1, + 0, + 14, + 7, + 0, + 7, + 13, + 32, + 5, + 0, + 4, + 0, + 8, + 10, + 3, + 20, + 4, + 5, + 14, + 3, + 18, + 5, + 22, + 4, + 1, + 5, + 3, + 5, + 3, + 4 + ], + "weighted_loads": [ + 0.3922526314854622, + 0.24257398210465908, + 0.5407810024917126, + 0.14456695690751076, + 0.5425922125577927, + 0.026202144101262093, + 1.5110505763441324, + 0.10479428432881832, + 0.38451554626226425, + 0.0, + 0.05974654667079449, + 0.0, + 0.1591021604835987, + 1.0803195126354694, + 0.11492419987916946, + 0.4578639343380928, + 1.1357461754232645, + 0.10570653527975082, + 0.17935455031692982, + 0.8685324415564537, + 0.5927727967500687, + 0.17115404829382896, + 0.06764791905879974, + 0.3985793460160494, + 0.42760297656059265, + 0.6920977551490068, + 0.3709672689437866, + 0.1879230961203575, + 0.42376207187771797, + 0.6969594433903694, + 0.4540317840874195, + 0.0, + 0.16912569850683212, + 0.0, + 0.05148749053478241, + 0.0, + 0.7876723855733871, + 0.7407234236598015, + 0.0, + 0.3119451329112053, + 0.4620044659823179, + 1.835732065141201, + 0.19683562591671944, + 0.0, + 0.1353602111339569, + 0.0, + 1.212904181331396, + 1.2990226112306118, + 0.09560213796794415, + 1.7169300056993961, + 0.17076853290200233, + 0.1871105469763279, + 1.3595028184354305, + 0.11257386207580566, + 1.287741757929325, + 0.2291740495711565, + 1.6519114896655083, + 0.15375157818198204, + 0.03307117521762848, + 0.1689535602927208, + 0.12883823737502098, + 0.20453722402453423, + 0.09572603367269039, + 0.12262827530503273 + ], + "unique_experts": 56, + "load_cv": 0.9022962167642683, + "normalized_load_entropy": 0.9067727536472813, + "max_load_share": 0.07207207207207207 + }, + "full_input": { + "tokens": 115, + "top_k": 6, + "decisions": 690, + "ordered_route_sha256": "5d3adcba2388ec9f85c973660a76c6c6bce56ed5080a31a1882402497a28d799", + "route_weight_sha256": "8789dd3d3341e078ec2959b1340777c5447ec368368f05d475af860ee254f8f8", + "loads": [ + 17, + 6, + 11, + 5, + 13, + 19, + 18, + 7, + 10, + 11, + 2, + 3, + 9, + 15, + 4, + 11, + 20, + 2, + 11, + 12, + 12, + 8, + 2, + 16, + 15, + 16, + 15, + 11, + 20, + 13, + 13, + 5, + 7, + 11, + 2, + 1, + 14, + 11, + 2, + 8, + 13, + 32, + 6, + 1, + 6, + 0, + 13, + 13, + 5, + 22, + 20, + 7, + 22, + 14, + 20, + 8, + 23, + 6, + 2, + 24, + 6, + 6, + 6, + 7 + ], + "weighted_loads": [ + 1.239852273836732, + 0.2931740488857031, + 0.5407810024917126, + 0.18861247971653938, + 0.7917563915252686, + 1.275358572602272, + 1.5110505763441324, + 0.2870981674641371, + 0.5472476184368134, + 0.8502930179238319, + 0.05974654667079449, + 0.21552486345171928, + 0.5559928603470325, + 1.0803195126354694, + 0.11492419987916946, + 0.5689884386956692, + 1.1357461754232645, + 0.10570653527975082, + 0.6491127330809832, + 1.1038553584367037, + 0.8248439580202103, + 0.4011498726904392, + 0.06764791905879974, + 0.761004026979208, + 0.7099202405661345, + 0.8820598516613245, + 0.7812988348305225, + 0.5092887114733458, + 1.990471288561821, + 0.7452029101550579, + 0.680833175778389, + 0.1923462487757206, + 0.24805767089128494, + 1.2624328695237637, + 0.09974996373057365, + 0.0797857791185379, + 0.7876723855733871, + 1.1913164556026459, + 0.1413000002503395, + 0.3686760365962982, + 0.4620044659823179, + 1.835732065141201, + 0.2490689866244793, + 0.045591797679662704, + 0.2012229599058628, + 0.0, + 1.4715473484247923, + 1.4066155962646008, + 0.22311571426689625, + 1.7913392558693886, + 1.161352425813675, + 0.5749173425137997, + 2.157366342842579, + 0.9599436372518539, + 1.3712827637791634, + 0.5323639381676912, + 1.7047159932553768, + 0.23636078462004662, + 0.1396794319152832, + 1.2327082119882107, + 0.3780873045325279, + 0.24356196820735931, + 0.24365852214396, + 0.23060905560851097 + ], + "unique_experts": 63, + "load_cv": 0.6251133062594939, + "normalized_load_entropy": 0.9501771571802685, + "max_load_share": 0.0463768115942029 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 74, + "ordered_topk_exact_tokens": 42, + "set_exact_tokens": 52, + "mean_set_jaccard": 0.9092664092664091, + "mean_token_weighted_tv": 0.017132176589724178, + "aggregate_load_tv": 0.0427927927927928 + }, + "system_bos": { + "tokens": 74, + "ordered_topk_exact_tokens": 30, + "set_exact_tokens": 39, + "mean_set_jaccard": 0.8561776061776062, + "mean_token_weighted_tv": 0.026319706384595985, + "aggregate_load_tv": 0.04954954954954955 + }, + "system_x": { + "tokens": 74, + "ordered_topk_exact_tokens": 28, + "set_exact_tokens": 35, + "mean_set_jaccard": 0.8211068211068211, + "mean_token_weighted_tv": 0.03398206561954843, + "aggregate_load_tv": 0.06531531531531533 + }, + "system_period": { + "tokens": 74, + "ordered_topk_exact_tokens": 23, + "set_exact_tokens": 30, + "mean_set_jaccard": 0.8086872586872588, + "mean_token_weighted_tv": 0.03598161942854121, + "aggregate_load_tv": 0.05630630630630631 + }, + "bos_at_s0": { + "tokens": 74, + "ordered_topk_exact_tokens": 19, + "set_exact_tokens": 35, + "mean_set_jaccard": 0.8407335907335907, + "mean_token_weighted_tv": 0.03021452489082475, + "aggregate_load_tv": 0.0518018018018018 + }, + "bos_at_s1": { + "tokens": 74, + "ordered_topk_exact_tokens": 22, + "set_exact_tokens": 35, + "mean_set_jaccard": 0.8355855855855857, + "mean_token_weighted_tv": 0.031211529896166677, + "aggregate_load_tv": 0.058558558558558564 + }, + "x_at_s0": { + "tokens": 74, + "ordered_topk_exact_tokens": 22, + "set_exact_tokens": 36, + "mean_set_jaccard": 0.8220720720720721, + "mean_token_weighted_tv": 0.03501202349827902, + "aggregate_load_tv": 0.0608108108108108 + }, + "x_at_s1": { + "tokens": 74, + "ordered_topk_exact_tokens": 16, + "set_exact_tokens": 23, + "mean_set_jaccard": 0.7696267696267696, + "mean_token_weighted_tv": 0.04215225311801643, + "aggregate_load_tv": 0.07882882882882884 + }, + "period_at_s0": { + "tokens": 74, + "ordered_topk_exact_tokens": 18, + "set_exact_tokens": 26, + "mean_set_jaccard": 0.7841055341055342, + "mean_token_weighted_tv": 0.03980766558969343, + "aggregate_load_tv": 0.06531531531531531 + }, + "period_at_s1": { + "tokens": 74, + "ordered_topk_exact_tokens": 19, + "set_exact_tokens": 25, + "mean_set_jaccard": 0.7789575289575289, + "mean_token_weighted_tv": 0.04114020049471308, + "aggregate_load_tv": 0.06756756756756757 + } + } + }, + "layer_15": { + "layer": 15, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "90a40d9f771f667f610590bf464dc5b6089442eabdabe7c686bb85b1e2d3f6c7", + "route_weight_sha256": "ce674e1a7191b1a7458c60d265eec0b965e6c47cc8e3a566447b970b12a2ee9f", + "loads": [ + 5, + 16, + 7, + 5, + 2, + 1, + 0, + 0, + 3, + 0, + 17, + 4, + 2, + 6, + 1, + 2, + 4, + 3, + 0, + 29, + 1, + 9, + 0, + 6, + 6, + 11, + 7, + 10, + 4, + 9, + 6, + 23, + 0, + 8, + 4, + 12, + 6, + 11, + 1, + 7, + 4, + 3, + 5, + 6, + 7, + 6, + 21, + 14, + 0, + 3, + 5, + 15, + 11, + 8, + 4, + 2, + 14, + 8, + 15, + 21, + 13, + 0, + 8, + 3 + ], + "weighted_loads": [ + 0.23350351303815842, + 0.8335836119949818, + 0.32937295734882355, + 0.19574610702693462, + 0.07005593180656433, + 0.033905621618032455, + 0.0, + 0.0, + 0.10505997203290462, + 0.0, + 2.179096058011055, + 0.45017580687999725, + 0.12541933730244637, + 0.3556430786848068, + 0.048147737979888916, + 0.05985354259610176, + 0.1537276953458786, + 0.17511364072561264, + 0.0, + 2.119899583980441, + 0.08643711358308792, + 0.5234871618449688, + 0.0, + 0.3981984108686447, + 0.20352829806506634, + 1.2292045280337334, + 0.25727009400725365, + 0.7009894214570522, + 0.2131487913429737, + 0.4692823104560375, + 0.2785896360874176, + 1.5315855871886015, + 0.0, + 0.3783122058957815, + 0.2100518736988306, + 0.4084899462759495, + 0.32285063713788986, + 0.719113651663065, + 0.04004378244280815, + 0.3469098247587681, + 0.34478428214788437, + 0.12092416733503342, + 0.2829764038324356, + 0.33392516896128654, + 0.26203882694244385, + 0.3343459442257881, + 1.9883128628134727, + 1.578042421489954, + 0.0, + 0.15633653849363327, + 0.23272831737995148, + 0.7482557073235512, + 1.000461746007204, + 0.4929553270339966, + 0.21617929637432098, + 0.06882433779537678, + 0.6356854848563671, + 0.4751399904489517, + 0.8090561889111996, + 0.8979365024715662, + 0.7789022549986839, + 0.0, + 0.5340069644153118, + 0.14452138543128967 + ], + "unique_experts": 56, + "load_cv": 0.8939824439078324, + "normalized_load_entropy": 0.905806536064859, + "max_load_share": 0.06531531531531531 + }, + "full_input": { + "tokens": 99, + "top_k": 6, + "decisions": 594, + "ordered_route_sha256": "714d27a87e26591fc3b42049154db42db51ce50f4f5be71857545685097496b4", + "route_weight_sha256": "4e46f244de5875ba95989a7a2c074cd67c7190143e922db9124a7b1c8494b9da", + "loads": [ + 7, + 16, + 7, + 5, + 7, + 4, + 7, + 1, + 9, + 1, + 21, + 7, + 7, + 6, + 12, + 3, + 11, + 6, + 0, + 33, + 1, + 9, + 0, + 12, + 10, + 12, + 17, + 10, + 8, + 9, + 9, + 23, + 5, + 10, + 4, + 12, + 11, + 11, + 1, + 7, + 10, + 5, + 5, + 8, + 8, + 6, + 21, + 15, + 1, + 11, + 9, + 17, + 15, + 8, + 4, + 7, + 14, + 8, + 16, + 22, + 13, + 3, + 8, + 9 + ], + "weighted_loads": [ + 0.3412323370575905, + 0.8335836119949818, + 0.32937295734882355, + 0.19574610702693462, + 0.5008829180151224, + 0.11242297478020191, + 0.6975858248770237, + 0.03453255072236061, + 0.5025626234710217, + 0.03141424432396889, + 2.3287091478705406, + 0.6316542942076921, + 0.5009788796305656, + 0.3556430786848068, + 0.464635674841702, + 0.09160299971699715, + 0.7966489344835281, + 0.2802194803953171, + 0.0, + 2.3298194985836744, + 0.08643711358308792, + 0.5234871618449688, + 0.0, + 0.7026244923472404, + 0.29669100302271545, + 1.2576346434652805, + 0.9156806096434593, + 0.7009894214570522, + 0.3574696723371744, + 0.4692823104560375, + 0.4209270253777504, + 1.5315855871886015, + 0.40411207266151905, + 0.4670958314090967, + 0.2100518736988306, + 0.4084899462759495, + 1.0607163487002254, + 0.719113651663065, + 0.04004378244280815, + 0.3469098247587681, + 0.6573623339645565, + 0.1593270367011428, + 0.2829764038324356, + 0.4168250113725662, + 0.3016745373606682, + 0.3343459442257881, + 1.9883128628134727, + 1.612484473735094, + 0.013515403494238853, + 1.4286484830081463, + 0.43225621804594994, + 0.834646187722683, + 1.1149609284475446, + 0.4929553270339966, + 0.21617929637432098, + 1.7867608088999987, + 0.6356854848563671, + 0.4751399904489517, + 0.8543926663696766, + 0.9630918744951487, + 0.7789022549986839, + 0.11812381260097027, + 0.5340069644153118, + 0.5673661958426237 + ], + "unique_experts": 62, + "load_cv": 0.6566174545742233, + "normalized_load_entropy": 0.9479766714554047, + "max_load_share": 0.05555555555555555 + } + }, + "s1_eos": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "5558d38d897c3c8e8db65d90dfbe5be4ad0819f4800cdd9a7aab739fd8dec6ce", + "route_weight_sha256": "70813ed63d400248b465283ebcd6b629e42e1f4471fb523f0ac4912c08bd7415", + "loads": [ + 5, + 15, + 5, + 6, + 2, + 1, + 0, + 0, + 3, + 2, + 18, + 4, + 3, + 6, + 1, + 2, + 3, + 3, + 0, + 30, + 1, + 10, + 0, + 4, + 4, + 11, + 7, + 10, + 4, + 9, + 7, + 22, + 0, + 6, + 3, + 13, + 6, + 12, + 4, + 5, + 4, + 4, + 4, + 6, + 7, + 6, + 21, + 14, + 1, + 3, + 5, + 14, + 10, + 8, + 5, + 2, + 14, + 7, + 15, + 19, + 15, + 1, + 8, + 4 + ], + "weighted_loads": [ + 0.23499490320682526, + 0.7957052700221539, + 0.2501075528562069, + 0.2171137873083353, + 0.0710478313267231, + 0.03665157034993172, + 0.0, + 0.0, + 0.10338641703128815, + 0.06290025822818279, + 2.2073896937072277, + 0.4416388124227524, + 0.16929084435105324, + 0.36185619607567787, + 0.050593551248311996, + 0.059881970286369324, + 0.12432677298784256, + 0.18107955530285835, + 0.0, + 2.1781397592276335, + 0.08906510472297668, + 0.5615219473838806, + 0.0, + 0.3199104778468609, + 0.13675042241811752, + 1.2574770711362362, + 0.253466060385108, + 0.6985264904797077, + 0.21367263793945312, + 0.45975561439991, + 0.3022707961499691, + 1.5085327848792076, + 0.0, + 0.3003745302557945, + 0.17233764380216599, + 0.4393801689147949, + 0.31605970673263073, + 0.7216049861162901, + 0.12901467271149158, + 0.2748487591743469, + 0.3467148467898369, + 0.16330675035715103, + 0.22574163228273392, + 0.3265271559357643, + 0.2575582582503557, + 0.3215809501707554, + 1.987055018544197, + 1.5556933842599392, + 0.03378119692206383, + 0.1623969003558159, + 0.22803368419408798, + 0.7376559898257256, + 0.9650255218148232, + 0.4910310246050358, + 0.24373648315668106, + 0.06792120821774006, + 0.6435094121843576, + 0.44052294455468655, + 0.8183744847774506, + 0.8760627079755068, + 0.8845021650195122, + 0.032884832471609116, + 0.5439896397292614, + 0.18076056614518166 + ], + "unique_experts": 59, + "load_cv": 0.8811805614541138, + "normalized_load_entropy": 0.9129396440520966, + "max_load_share": 0.06756756756756757 + }, + "full_input": { + "tokens": 115, + "top_k": 6, + "decisions": 690, + "ordered_route_sha256": "2dce5236f1e5a18b058a16b9b1e5ce10e6ee8baa43cda3fd47752fff1379e84f", + "route_weight_sha256": "17603ad4e0c8305800441bc36f23669eb20053fa4c9207c9b310c7adb9b65787", + "loads": [ + 22, + 16, + 5, + 6, + 10, + 6, + 13, + 1, + 13, + 3, + 23, + 10, + 9, + 7, + 7, + 12, + 15, + 8, + 1, + 35, + 2, + 11, + 0, + 8, + 5, + 12, + 17, + 12, + 10, + 10, + 13, + 26, + 6, + 8, + 5, + 13, + 13, + 12, + 5, + 6, + 11, + 6, + 4, + 8, + 8, + 7, + 21, + 15, + 4, + 15, + 12, + 16, + 12, + 9, + 5, + 7, + 14, + 13, + 17, + 24, + 15, + 9, + 11, + 11 + ], + "weighted_loads": [ + 1.3778434619307518, + 0.8228318113833666, + 0.2501075528562069, + 0.2171137873083353, + 0.6023553498089314, + 0.24285017419606447, + 1.2041696608066559, + 0.03231624513864517, + 0.6726894415915012, + 0.0939442329108715, + 2.4397834166884422, + 0.9142347108572721, + 0.6694338824599981, + 0.44478777423501015, + 0.2585721993818879, + 0.7249338198453188, + 1.2465732023119926, + 0.37318461015820503, + 0.05224977806210518, + 2.524225687608123, + 0.1180361732840538, + 0.6432689502835274, + 0.0, + 0.5220014341175556, + 0.14039608696475625, + 1.285967344418168, + 0.9547556098550558, + 0.8195603080093861, + 0.6383039094507694, + 0.49779417365789413, + 0.5281353481113911, + 1.951246801763773, + 0.43595120683312416, + 0.4136012941598892, + 0.3209092617034912, + 0.4393801689147949, + 1.0743343019858003, + 0.7216049861162901, + 0.16206068731844425, + 0.3108176253736019, + 0.6557394941337407, + 0.2507004523649812, + 0.22574163228273392, + 0.6017343178391457, + 0.2956253085285425, + 0.36060982197523117, + 1.987055018544197, + 1.5898567326366901, + 0.17982017435133457, + 2.2898844182491302, + 0.5219505485147238, + 0.8033802099525928, + 1.0133398966863751, + 0.623828861862421, + 0.24373648315668106, + 1.7692885007709265, + 0.6435094121843576, + 1.1012613531202078, + 0.9031356200575829, + 1.1165681909769773, + 0.8845021650195122, + 0.4544060677289963, + 0.6945285424590111, + 0.5709099527448416 + ], + "unique_experts": 63, + "load_cv": 0.5855861619941959, + "normalized_load_entropy": 0.959364493673104, + "max_load_share": 0.050724637681159424 + } + }, + "s0_bos": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "e6ddc8b0a391e385f8dfc46656529e022f996ac53b661fad2f07fb527341533d", + "route_weight_sha256": "e2f71acba41b5aaa13cb456501ad0626debce766e23ae2192ad1dbc04593f205", + "loads": [ + 5, + 13, + 8, + 4, + 2, + 1, + 0, + 0, + 4, + 3, + 17, + 5, + 4, + 6, + 1, + 2, + 4, + 3, + 0, + 28, + 2, + 8, + 0, + 5, + 6, + 9, + 8, + 11, + 4, + 9, + 5, + 24, + 0, + 7, + 4, + 11, + 5, + 11, + 1, + 7, + 5, + 3, + 5, + 6, + 7, + 6, + 20, + 14, + 0, + 4, + 5, + 14, + 11, + 9, + 4, + 2, + 13, + 7, + 14, + 20, + 16, + 0, + 8, + 4 + ], + "weighted_loads": [ + 0.23798447102308273, + 0.7410052418708801, + 0.35872974060475826, + 0.18421907722949982, + 0.06577861681580544, + 0.03197503089904785, + 0.0, + 0.0, + 0.1339203044772148, + 0.09530752152204514, + 2.1872851997613907, + 0.45833317562937737, + 0.20680173486471176, + 0.37701185047626495, + 0.03792216256260872, + 0.05088264308869839, + 0.1487143523991108, + 0.1601046919822693, + 0.0, + 2.1564434617757797, + 0.1251221038401127, + 0.48276636376976967, + 0.0, + 0.3477790839970112, + 0.1910226996988058, + 1.1775854527950287, + 0.2675702665001154, + 0.7557978741824627, + 0.21134502068161964, + 0.4803164694458246, + 0.20602344907820225, + 1.6279268823564053, + 0.0, + 0.35639235749840736, + 0.20291006565093994, + 0.39397932030260563, + 0.29762640222907066, + 0.7024530917406082, + 0.035934001207351685, + 0.33920424059033394, + 0.3915725313127041, + 0.12041030451655388, + 0.26948509737849236, + 0.3331008851528168, + 0.2471610177308321, + 0.331566259264946, + 1.9942998588085175, + 1.5377792231738567, + 0.0, + 0.21475891210138798, + 0.21445269882678986, + 0.7425863351672888, + 1.0288021080195904, + 0.5467980224639177, + 0.23285626247525215, + 0.0686231441795826, + 0.598395649343729, + 0.4630346428602934, + 0.789612291380763, + 0.8988143149763346, + 0.937384620308876, + 0.0, + 0.5580849163234234, + 0.18514010310173035 + ], + "unique_experts": 57, + "load_cv": 0.8572771508109216, + "normalized_load_entropy": 0.9144149718219967, + "max_load_share": 0.06306306306306306 + }, + "full_input": { + "tokens": 99, + "top_k": 6, + "decisions": 594, + "ordered_route_sha256": "5b6d61d7d1ddf093fd98cf497f4a36cbc0dab9d6c3f8e34bbef65227ccf30fd5", + "route_weight_sha256": "53c65bcb8698373a11279999badfd66b3a1a221ce94c3762207ed412131c9d2a", + "loads": [ + 8, + 13, + 8, + 4, + 7, + 4, + 7, + 1, + 8, + 4, + 21, + 8, + 9, + 6, + 10, + 3, + 11, + 6, + 0, + 32, + 2, + 8, + 0, + 11, + 9, + 10, + 18, + 11, + 8, + 9, + 8, + 24, + 5, + 9, + 4, + 12, + 10, + 11, + 1, + 7, + 12, + 4, + 5, + 8, + 8, + 6, + 20, + 15, + 1, + 12, + 9, + 17, + 15, + 9, + 6, + 5, + 13, + 7, + 15, + 21, + 16, + 3, + 8, + 12 + ], + "weighted_loads": [ + 0.420865286141634, + 0.7410052418708801, + 0.35872974060475826, + 0.18421907722949982, + 0.4998790081590414, + 0.14180507324635983, + 0.6170777603983879, + 0.03453255072236061, + 0.44581733644008636, + 0.12672176584601402, + 2.3368982896208763, + 0.6433968897908926, + 0.5995813719928265, + 0.37701185047626495, + 0.4112207666039467, + 0.08263210020959377, + 0.8114778436720371, + 0.2702876143157482, + 0.0, + 2.3665633723139763, + 0.1251221038401127, + 0.48276636376976967, + 0.0, + 0.6522051654756069, + 0.2804640606045723, + 1.2060155682265759, + 0.9259807821363211, + 0.7557978741824627, + 0.35566590167582035, + 0.4803164694458246, + 0.34836083836853504, + 1.6279268823564053, + 0.40411207266151905, + 0.44517598301172256, + 0.20291006565093994, + 0.5031627658754587, + 1.0187568133696914, + 0.7024530917406082, + 0.035934001207351685, + 0.33920424059033394, + 0.7815392129123211, + 0.15197189524769783, + 0.26948509737849236, + 0.41600072756409645, + 0.2841959837824106, + 0.331566259264946, + 1.9942998588085175, + 1.5722212754189968, + 0.013515403494238853, + 1.4943830650299788, + 0.4800786357372999, + 0.8826508354395628, + 1.143301290459931, + 0.5467980224639177, + 0.33996617794036865, + 0.7548248209059238, + 0.598395649343729, + 0.4630346428602934, + 0.8349487688392401, + 0.966737749055028, + 0.937384620308876, + 0.11812381260097027, + 0.5580849163234234, + 0.6554051619023085 + ], + "unique_experts": 62, + "load_cv": 0.6398280981940235, + "normalized_load_entropy": 0.9510866492258426, + "max_load_share": 0.05387205387205387 + } + }, + "s1_bos": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "5441fd88294253388107195744a9f61304cac23ec800a9a9189e29fd32376047", + "route_weight_sha256": "6fdb1bdc48557bc6e7d2ead9ec1bd10abc4445e507e723d09025dbd7d561e015", + "loads": [ + 5, + 14, + 8, + 6, + 2, + 1, + 0, + 0, + 3, + 1, + 17, + 5, + 2, + 7, + 1, + 2, + 2, + 4, + 0, + 28, + 1, + 9, + 0, + 5, + 6, + 8, + 8, + 10, + 4, + 6, + 7, + 21, + 0, + 7, + 3, + 17, + 6, + 12, + 1, + 6, + 5, + 4, + 5, + 6, + 7, + 6, + 21, + 13, + 0, + 3, + 6, + 13, + 9, + 9, + 4, + 1, + 15, + 6, + 14, + 24, + 16, + 0, + 8, + 4 + ], + "weighted_loads": [ + 0.21591618284583092, + 0.7521491274237633, + 0.3561189007014036, + 0.23770559951663017, + 0.06257911026477814, + 0.03364691883325577, + 0.0, + 0.0, + 0.11251484602689743, + 0.03315349668264389, + 2.204784706234932, + 0.46623412519693375, + 0.12737129256129265, + 0.3989158980548382, + 0.04778832569718361, + 0.05536794103682041, + 0.08303097635507584, + 0.19907399266958237, + 0.0, + 2.1308245807886124, + 0.08589684218168259, + 0.5286234132945538, + 0.0, + 0.35535357892513275, + 0.2132480051368475, + 1.1015680953860283, + 0.29126107320189476, + 0.6959189102053642, + 0.20600470155477524, + 0.38106730952858925, + 0.2715621665120125, + 1.5204009003937244, + 0.0, + 0.36041949689388275, + 0.17953277379274368, + 0.5738186202943325, + 0.31966428831219673, + 0.7211339697241783, + 0.029243722558021545, + 0.3101535700261593, + 0.4005961436778307, + 0.1505816150456667, + 0.2504040412604809, + 0.3165275305509567, + 0.25932546705007553, + 0.3289710432291031, + 2.019632225856185, + 1.5424664169549942, + 0.0, + 0.1778765805065632, + 0.263642854988575, + 0.6602800469845533, + 0.9414922632277012, + 0.5320834536105394, + 0.2140883170068264, + 0.040007900446653366, + 0.6874086912721395, + 0.4365531653165817, + 0.7877782955765724, + 1.0471309199929237, + 0.9458204582333565, + 0.0, + 0.555689487606287, + 0.18972494453191757 + ], + "unique_experts": 57, + "load_cv": 0.8950712283696792, + "normalized_load_entropy": 0.906482817308633, + "max_load_share": 0.06306306306306306 + }, + "full_input": { + "tokens": 115, + "top_k": 6, + "decisions": 690, + "ordered_route_sha256": "19906ec8a21325579cea4c7ecde0be46111493be5302c0ae60235c6eefa66a06", + "route_weight_sha256": "1ed94179748403eb3b2b8301351ffdcfc8d593f2c5163cae5172fb05bc8c8114", + "loads": [ + 23, + 15, + 8, + 6, + 12, + 6, + 13, + 1, + 12, + 2, + 22, + 11, + 8, + 8, + 6, + 12, + 14, + 9, + 1, + 33, + 2, + 10, + 0, + 9, + 7, + 9, + 18, + 12, + 10, + 7, + 13, + 25, + 6, + 9, + 5, + 17, + 14, + 12, + 2, + 7, + 12, + 5, + 5, + 8, + 7, + 7, + 21, + 14, + 3, + 16, + 13, + 15, + 11, + 10, + 4, + 5, + 15, + 12, + 16, + 29, + 16, + 8, + 11, + 11 + ], + "weighted_loads": [ + 1.4566615745425224, + 0.779275668784976, + 0.3561189007014036, + 0.23770559951663017, + 0.5909128375351429, + 0.27523246221244335, + 1.1191953346133232, + 0.03231624513864517, + 0.6196415983140469, + 0.0641974713653326, + 2.4371784292161465, + 0.9599052723497152, + 0.6253289859741926, + 0.48184747621417046, + 0.24425124004483223, + 0.7204197905957699, + 1.2459230460226536, + 0.3999853730201721, + 0.05224977806210518, + 2.4675410389900208, + 0.1148679107427597, + 0.6103704161942005, + 0.0, + 0.5574445351958275, + 0.2653339635580778, + 1.1300583686679602, + 0.9925506226718426, + 0.8169527277350426, + 0.6306359730660915, + 0.4191058687865734, + 0.49742671847343445, + 1.9631149172782898, + 0.43595120683312416, + 0.47364626079797745, + 0.3281043916940689, + 0.5738186202943325, + 1.1054604453966022, + 0.7211339697241783, + 0.06228973716497421, + 0.3461224362254143, + 0.8362181186676025, + 0.23379494436085224, + 0.2504040412604809, + 0.5917346924543381, + 0.25932546705007553, + 0.3679999150335789, + 2.019632225856185, + 1.5766297653317451, + 0.14603897742927074, + 2.277065049856901, + 0.5940160285681486, + 0.7260042671114206, + 0.9898066380992532, + 0.6648812908679247, + 0.2140883170068264, + 0.8077774196863174, + 0.6874086912721395, + 1.097291573882103, + 0.8725394308567047, + 1.2921899445354939, + 0.9458204582333565, + 0.42152123525738716, + 0.7049041762948036, + 0.5866329707205296 + ], + "unique_experts": 63, + "load_cv": 0.6007696526900828, + "normalized_load_entropy": 0.9565175622941341, + "max_load_share": 0.04782608695652174 + } + }, + "s0_x": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "adb547fcb85dc95f93b8856bf42bae1a59bcb64154daa109c822f67a09a21c75", + "route_weight_sha256": "ace9d7a3bc46b7a39cecf3e605173c3d284a5217f2e6729794a116a908beed61", + "loads": [ + 5, + 13, + 8, + 6, + 1, + 1, + 0, + 0, + 4, + 1, + 17, + 5, + 4, + 8, + 1, + 2, + 3, + 4, + 0, + 29, + 1, + 9, + 0, + 5, + 6, + 10, + 6, + 11, + 4, + 7, + 7, + 24, + 0, + 6, + 4, + 14, + 5, + 12, + 3, + 6, + 6, + 2, + 5, + 6, + 7, + 6, + 20, + 13, + 0, + 3, + 4, + 12, + 9, + 11, + 4, + 1, + 14, + 8, + 13, + 19, + 17, + 0, + 8, + 4 + ], + "weighted_loads": [ + 0.2268061675131321, + 0.7345448583364487, + 0.3563034776598215, + 0.23145730793476105, + 0.03078393079340458, + 0.029287436977028847, + 0.0, + 0.0, + 0.1342627163976431, + 0.034848403185606, + 2.252556100487709, + 0.4636403117328882, + 0.20268523506820202, + 0.43611935153603554, + 0.04776060953736305, + 0.05345640145242214, + 0.11448875069618225, + 0.20813458040356636, + 0.0, + 2.2122579142451286, + 0.08373616635799408, + 0.5194752812385559, + 0.0, + 0.3105432242155075, + 0.2047558669000864, + 1.1729732938110828, + 0.21828429400920868, + 0.768177505582571, + 0.2242554873228073, + 0.4078462589532137, + 0.27448683232069016, + 1.628584984689951, + 0.0, + 0.3127623423933983, + 0.20670750737190247, + 0.48104286938905716, + 0.29398734122514725, + 0.7474443521350622, + 0.0935269221663475, + 0.30238486640155315, + 0.42874105647206306, + 0.08434458822011948, + 0.2517920695245266, + 0.324528094381094, + 0.25338572822511196, + 0.32353102788329124, + 2.0076137259602547, + 1.4721412174403667, + 0.0, + 0.17719455435872078, + 0.17936939373612404, + 0.6513547711074352, + 0.9420508407056332, + 0.6182005852460861, + 0.2180340215563774, + 0.02610650286078453, + 0.6272052135318518, + 0.47371079213917255, + 0.7793526351451874, + 0.8857690915465355, + 0.978591226041317, + 0.0, + 0.5620866864919662, + 0.17679423466324806 + ], + "unique_experts": 57, + "load_cv": 0.8737809925563055, + "normalized_load_entropy": 0.9102792953543448, + "max_load_share": 0.06531531531531531 + }, + "full_input": { + "tokens": 99, + "top_k": 6, + "decisions": 594, + "ordered_route_sha256": "833b1e91651c570f71665744a1c931847c4458caab49a456852428274d7d1642", + "route_weight_sha256": "0c87fa68c911f3fd47bf9b99b2fa2f1655eacc01c1f705b97c2cf529ae777c6c", + "loads": [ + 7, + 13, + 8, + 6, + 7, + 3, + 7, + 1, + 10, + 2, + 22, + 7, + 9, + 8, + 10, + 4, + 10, + 6, + 0, + 34, + 1, + 9, + 0, + 12, + 9, + 11, + 17, + 11, + 8, + 7, + 10, + 24, + 5, + 8, + 4, + 14, + 10, + 12, + 3, + 6, + 11, + 3, + 5, + 9, + 8, + 6, + 20, + 14, + 1, + 11, + 8, + 14, + 14, + 11, + 4, + 5, + 14, + 8, + 14, + 20, + 17, + 4, + 9, + 9 + ], + "weighted_loads": [ + 0.35817882791161537, + 0.7345448583364487, + 0.3563034776598215, + 0.23145730793476105, + 0.45655834302306175, + 0.09683605656027794, + 0.6843339987099171, + 0.03453255072236061, + 0.5649516563862562, + 0.06626264750957489, + 2.4696103036403656, + 0.5964684523642063, + 0.591713348403573, + 0.43611935153603554, + 0.421059213578701, + 0.12035906873643398, + 0.7919020913541317, + 0.28020675107836723, + 0.0, + 2.470120921730995, + 0.08373616635799408, + 0.5194752812385559, + 0.0, + 0.7109594419598579, + 0.2941972278058529, + 1.20140340924263, + 0.9938623197376728, + 0.768177505582571, + 0.368576368317008, + 0.4078462589532137, + 0.41682422161102295, + 1.628584984689951, + 0.40411207266151905, + 0.4015459679067135, + 0.20670750737190247, + 0.48104286938905716, + 0.9972025481984019, + 0.7474443521350622, + 0.0935269221663475, + 0.30238486640155315, + 0.7161988615989685, + 0.11760615557432175, + 0.2517920695245266, + 0.48753777891397476, + 0.2947625871747732, + 0.32353102788329124, + 2.0076137259602547, + 1.5065832696855068, + 0.013515403494238853, + 1.2576112523674965, + 0.38041089475154877, + 0.737745251506567, + 1.0940156849101186, + 0.6182005852460861, + 0.2180340215563774, + 0.7716253511607647, + 0.6272052135318518, + 0.47371079213917255, + 0.8246891126036644, + 0.9557974264025688, + 0.978591226041317, + 0.18327336572110653, + 0.5944339334964752, + 0.48778983764350414 + ], + "unique_experts": 62, + "load_cv": 0.6479972713457268, + "normalized_load_entropy": 0.9504603073107182, + "max_load_share": 0.05723905723905724 + } + }, + "s1_x": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "e5ce7505076652fbfb2b989b134a081fb560a5011e35369a082dd76099221cdd", + "route_weight_sha256": "1254a0525dbb1a7cf3a1ec7d124f070232bfe3535a3063dd2f253abb56ffeea8", + "loads": [ + 5, + 12, + 7, + 5, + 2, + 0, + 0, + 1, + 4, + 1, + 17, + 5, + 4, + 9, + 1, + 2, + 3, + 4, + 0, + 27, + 1, + 9, + 0, + 5, + 5, + 9, + 8, + 10, + 4, + 6, + 6, + 24, + 0, + 8, + 4, + 15, + 3, + 10, + 1, + 7, + 5, + 3, + 4, + 6, + 7, + 6, + 21, + 13, + 2, + 3, + 5, + 14, + 8, + 10, + 4, + 1, + 14, + 5, + 14, + 26, + 18, + 0, + 8, + 3 + ], + "weighted_loads": [ + 0.2787317968904972, + 0.6395426280796528, + 0.31114159151911736, + 0.16333777084946632, + 0.06108933687210083, + 0.0, + 0.0, + 0.03609037771821022, + 0.16042020171880722, + 0.03513890132308006, + 2.218711256980896, + 0.48116298392415047, + 0.1956138089299202, + 0.4890872649848461, + 0.04671410471200943, + 0.055810051038861275, + 0.11666489578783512, + 0.18256192281842232, + 0.0, + 2.176366452127695, + 0.0813465490937233, + 0.5428533926606178, + 0.0, + 0.3400229178369045, + 0.1727011725306511, + 1.1285363212227821, + 0.276216983795166, + 0.7144184075295925, + 0.20786329731345177, + 0.3740961067378521, + 0.2573135122656822, + 1.5835911631584167, + 0.0, + 0.40073905512690544, + 0.19771163165569305, + 0.49853209033608437, + 0.20994353666901588, + 0.6473368853330612, + 0.032631758600473404, + 0.35504867881536484, + 0.42328563146293163, + 0.10686253942549229, + 0.19276561215519905, + 0.3085455633699894, + 0.25883135572075844, + 0.3149550464004278, + 2.0229764878749847, + 1.530223149806261, + 0.06652425229549408, + 0.17380842193961143, + 0.21516017615795135, + 0.6898515354841948, + 0.8956978097558022, + 0.5728640034794807, + 0.19912273436784744, + 0.0402706004679203, + 0.6648748144507408, + 0.40922706946730614, + 0.7815082855522633, + 1.1871628183871508, + 0.9893234968185425, + 0.0, + 0.5676732622087002, + 0.13269652426242828 + ], + "unique_experts": 58, + "load_cv": 0.9091067724818802, + "normalized_load_entropy": 0.9071980107466435, + "max_load_share": 0.060810810810810814 + }, + "full_input": { + "tokens": 115, + "top_k": 6, + "decisions": 690, + "ordered_route_sha256": "e5d3122bfaa490d051d7b0a9d26f5d76f57a89511cb28e6d7a27dc9fedc25fc3", + "route_weight_sha256": "2bb7beb8afea3ea9210127a523c6b43577169877eeb10f3d5c813b4d8cdc64d5", + "loads": [ + 23, + 13, + 7, + 5, + 10, + 3, + 13, + 2, + 14, + 2, + 23, + 11, + 10, + 10, + 6, + 12, + 15, + 9, + 1, + 33, + 2, + 10, + 0, + 10, + 5, + 10, + 19, + 12, + 10, + 7, + 12, + 28, + 7, + 10, + 6, + 15, + 10, + 10, + 2, + 8, + 10, + 4, + 4, + 9, + 8, + 7, + 21, + 14, + 6, + 15, + 12, + 17, + 10, + 11, + 4, + 5, + 14, + 11, + 16, + 31, + 18, + 9, + 11, + 8 + ], + "weighted_loads": [ + 1.5046856962144375, + 0.6666691694408655, + 0.31114159151911736, + 0.16333777084946632, + 0.461100023239851, + 0.15201040543615818, + 1.2299297749996185, + 0.06840662285685539, + 0.7966814674437046, + 0.06618287600576878, + 2.5043125338852406, + 0.9692336078733206, + 0.6884980071336031, + 0.5720188431441784, + 0.24317701905965805, + 0.7208619005978107, + 1.2619169112294912, + 0.3925038278102875, + 0.05224977806210518, + 2.554497703909874, + 0.11031761765480042, + 0.6246003955602646, + 0.0, + 0.6201635785400867, + 0.1727011725306511, + 1.157026594504714, + 1.1002200096845627, + 0.8354522250592709, + 0.6324945688247681, + 0.41213466599583626, + 0.4831780642271042, + 2.026305180042982, + 0.48648562654852867, + 0.5139658190310001, + 0.3462832495570183, + 0.49853209033608437, + 0.8602511798962951, + 0.6473368853330612, + 0.06567777320742607, + 0.3910175450146198, + 0.7387714684009552, + 0.19007586874067783, + 0.19276561215519905, + 0.7134191729128361, + 0.2907681204378605, + 0.3539839182049036, + 2.0229764878749847, + 1.564386498183012, + 0.24243131093680859, + 2.015351738780737, + 0.4854373186826706, + 0.7901301365345716, + 0.9440121846273541, + 0.705661840736866, + 0.19912273436784744, + 0.7603122554719448, + 0.6648748144507408, + 1.0699654780328274, + 0.8662694208323956, + 1.4344199653714895, + 0.9893234968185425, + 0.4737439639866352, + 0.7366707511246204, + 0.3393338229507208 + ], + "unique_experts": 63, + "load_cv": 0.6214468418728041, + "normalized_load_entropy": 0.9549808088634151, + "max_load_share": 0.04782608695652174 + } + }, + "s0_period": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "6c21eaca737ee1964f649309e9a9f18728da1bdb948f4f99f1a345d99d08c976", + "route_weight_sha256": "906c858e3d5ed7cf2a4656996da54f2c826521063b4e41f14ca69feead421b19", + "loads": [ + 5, + 13, + 7, + 7, + 3, + 0, + 1, + 1, + 2, + 1, + 17, + 5, + 4, + 6, + 1, + 2, + 5, + 4, + 0, + 30, + 1, + 10, + 0, + 5, + 6, + 9, + 7, + 11, + 4, + 7, + 8, + 25, + 0, + 6, + 4, + 12, + 5, + 12, + 2, + 7, + 5, + 3, + 5, + 5, + 6, + 6, + 20, + 13, + 0, + 3, + 4, + 12, + 9, + 10, + 4, + 1, + 13, + 6, + 13, + 21, + 18, + 0, + 8, + 4 + ], + "weighted_loads": [ + 0.21771322563290596, + 0.7292155660688877, + 0.33869158662855625, + 0.2580537721514702, + 0.09103638678789139, + 0.0, + 0.026960572227835655, + 0.0352848656475544, + 0.074437465518713, + 0.03479115664958954, + 2.2119481824338436, + 0.4512953385710716, + 0.1997604202479124, + 0.3685200400650501, + 0.043585196137428284, + 0.053201526403427124, + 0.18022655323147774, + 0.20525015518069267, + 0.0, + 2.229481440037489, + 0.08539099246263504, + 0.5489568635821342, + 0.0, + 0.3559150658547878, + 0.2197445947676897, + 1.1306787729263306, + 0.24678407981991768, + 0.7828327380120754, + 0.23133181780576706, + 0.4091266542673111, + 0.31462385319173336, + 1.647173060104251, + 0.0, + 0.32263970375061035, + 0.2054484821856022, + 0.4096038155257702, + 0.2926415167748928, + 0.7648723423480988, + 0.06421936675906181, + 0.3557854853570461, + 0.4225938692688942, + 0.12179495021700859, + 0.24834143370389938, + 0.28119930997490883, + 0.22913763672113419, + 0.32037194818258286, + 2.016839873045683, + 1.4942361004650593, + 0.0, + 0.1766762062907219, + 0.1782982014119625, + 0.6762287076562643, + 0.9439212866127491, + 0.5623250007629395, + 0.21513446047902107, + 0.02696172706782818, + 0.6256346888840199, + 0.43561609275639057, + 0.7534403465688229, + 0.9341538026928902, + 1.024211946874857, + 0.0, + 0.5498060546815395, + 0.17119297571480274 + ], + "unique_experts": 58, + "load_cv": 0.8892489734094061, + "normalized_load_entropy": 0.9109250909330049, + "max_load_share": 0.06756756756756757 + }, + "full_input": { + "tokens": 99, + "top_k": 6, + "decisions": 594, + "ordered_route_sha256": "d159369ef8d11c82c4733a6e837ac632445fd59819b58cdd6bf081e5f35c924e", + "route_weight_sha256": "8f936fad2333f149702f5b9a6b572e2bc72a425bf911705b6df3866fbc1b9344", + "loads": [ + 7, + 13, + 7, + 7, + 8, + 2, + 9, + 2, + 9, + 2, + 21, + 8, + 9, + 6, + 11, + 3, + 12, + 6, + 0, + 34, + 1, + 10, + 0, + 12, + 9, + 10, + 18, + 11, + 8, + 7, + 11, + 25, + 5, + 8, + 4, + 12, + 10, + 12, + 2, + 7, + 11, + 4, + 5, + 7, + 7, + 6, + 20, + 14, + 1, + 11, + 8, + 14, + 13, + 10, + 4, + 5, + 13, + 6, + 15, + 22, + 18, + 4, + 9, + 9 + ], + "weighted_loads": [ + 0.3396558128297329, + 0.7292155660688877, + 0.33869158662855625, + 0.2580537721514702, + 0.5315133053809404, + 0.061109842732548714, + 0.7347381617873907, + 0.06981741636991501, + 0.5464558526873589, + 0.06620540097355843, + 2.3615612722933292, + 0.627191474661231, + 0.5662667844444513, + 0.3685200400650501, + 0.4440682325512171, + 0.08495098352432251, + 0.8516538627445698, + 0.27732232585549355, + 0.0, + 2.4321153946220875, + 0.08539099246263504, + 0.5489568635821342, + 0.0, + 0.7555085830390453, + 0.3091859556734562, + 1.1591088883578777, + 0.9482811167836189, + 0.7828327380120754, + 0.37565269879996777, + 0.4091266542673111, + 0.45696124248206615, + 1.647173060104251, + 0.40411207266151905, + 0.41142332926392555, + 0.2054484821856022, + 0.4096038155257702, + 1.0525290435180068, + 0.7648723423480988, + 0.06421936675906181, + 0.3557854853570461, + 0.8211951553821564, + 0.15586615726351738, + 0.24834143370389938, + 0.3640991523861885, + 0.26999929919838905, + 0.32037194818258286, + 2.016839873045683, + 1.5286781527101994, + 0.013515403494238853, + 1.282000970095396, + 0.3811105899512768, + 0.7626191880553961, + 1.0584204690530896, + 0.5623250007629395, + 0.21513446047902107, + 0.7796433512121439, + 0.6256346888840199, + 0.43561609275639057, + 0.849987730383873, + 1.0035056322813034, + 1.024211946874857, + 0.2594366054981947, + 0.581725250929594, + 0.49835709668695927 + ], + "unique_experts": 62, + "load_cv": 0.6604735638019289, + "normalized_load_entropy": 0.948996530346475, + "max_load_share": 0.05723905723905724 + } + }, + "s1_period": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "5fa1a2102ab5f279eed8ba70a0957e8b6191a7386bc07ee6a86d02c75cc209f5", + "route_weight_sha256": "a6bdd7377a4fd05509862db48b5f531008c0072ede8e3b0b4c9fde3fb7d1466b", + "loads": [ + 3, + 13, + 7, + 6, + 2, + 0, + 0, + 1, + 3, + 0, + 17, + 4, + 3, + 9, + 1, + 2, + 2, + 3, + 0, + 28, + 2, + 9, + 0, + 6, + 5, + 10, + 8, + 10, + 4, + 7, + 6, + 24, + 0, + 7, + 4, + 12, + 6, + 10, + 0, + 7, + 6, + 3, + 4, + 6, + 6, + 6, + 21, + 14, + 2, + 3, + 5, + 15, + 8, + 9, + 5, + 1, + 14, + 6, + 14, + 26, + 17, + 1, + 8, + 3 + ], + "weighted_loads": [ + 0.18033437803387642, + 0.6861568056046963, + 0.3196841087192297, + 0.2077987901866436, + 0.0689782053232193, + 0.0, + 0.0, + 0.03674173355102539, + 0.11705169826745987, + 0.0, + 2.2011563517153263, + 0.44901344180107117, + 0.1716359443962574, + 0.5048738196492195, + 0.04175349697470665, + 0.05406441539525986, + 0.08060042560100555, + 0.1755848154425621, + 0.0, + 2.159700334072113, + 0.12406843528151512, + 0.5468432307243347, + 0.0, + 0.4053684026002884, + 0.16248990781605244, + 1.1610173881053925, + 0.29953393526375294, + 0.7070231810212135, + 0.2115505449473858, + 0.39570162631571293, + 0.2593081183731556, + 1.5794601868838072, + 0.0, + 0.3503393456339836, + 0.20549196936190128, + 0.40817341953516006, + 0.3060287721455097, + 0.6355991587042809, + 0.0, + 0.3493516445159912, + 0.4239155016839504, + 0.10608909651637077, + 0.21910818293690681, + 0.31866253167390823, + 0.21900609135627747, + 0.31016432493925095, + 2.016169609501958, + 1.6050618551671505, + 0.06399811804294586, + 0.1768285408616066, + 0.20579568296670914, + 0.7458984795957804, + 0.8847357258200645, + 0.5466563738882542, + 0.2282030452042818, + 0.03679238259792328, + 0.6450893804430962, + 0.4376649670302868, + 0.7738524079322815, + 1.1580888386815786, + 0.9757939223200083, + 0.03502919524908066, + 0.5787314549088478, + 0.13272025436162949 + ], + "unique_experts": 57, + "load_cv": 0.9155121445459561, + "normalized_load_entropy": 0.9052032188387328, + "max_load_share": 0.06306306306306306 + }, + "full_input": { + "tokens": 115, + "top_k": 6, + "decisions": 690, + "ordered_route_sha256": "9055e429f754fc650fbb2ea26bf694301622a23f195adbb4980ac95dec5bd61f", + "route_weight_sha256": "5c756689f2d2d4fb7cd36f36a08e204bbe7d598f0d3499aac1d7daaad43d6d6f", + "loads": [ + 21, + 14, + 7, + 6, + 10, + 3, + 13, + 2, + 14, + 1, + 22, + 9, + 9, + 10, + 6, + 13, + 14, + 8, + 1, + 33, + 3, + 10, + 0, + 10, + 5, + 11, + 19, + 12, + 10, + 8, + 12, + 28, + 6, + 10, + 6, + 12, + 13, + 10, + 1, + 8, + 12, + 5, + 4, + 9, + 7, + 7, + 21, + 16, + 5, + 15, + 12, + 17, + 10, + 10, + 5, + 4, + 14, + 12, + 17, + 31, + 17, + 10, + 11, + 9 + ], + "weighted_loads": [ + 1.4116677679121494, + 0.713283346965909, + 0.3196841087192297, + 0.2077987901866436, + 0.5187451764941216, + 0.15201040543615818, + 1.1937244161963463, + 0.06905797868967056, + 0.7598194293677807, + 0.031043974682688713, + 2.433550074696541, + 0.8957370836287737, + 0.6470963265746832, + 0.5878053978085518, + 0.23821641132235527, + 0.7559209745377302, + 1.2081942409276962, + 0.40451202169060707, + 0.05224977806210518, + 2.4909099265933037, + 0.15303950384259224, + 0.6285902336239815, + 0.0, + 0.6074593588709831, + 0.16248990781605244, + 1.1895076613873243, + 1.051725434139371, + 0.8280569985508919, + 0.6361818164587021, + 0.4337401855736971, + 0.48517267033457756, + 2.0221742037683725, + 0.43595120683312416, + 0.4924509320408106, + 0.3540635872632265, + 0.40817341953516006, + 1.1003340175375342, + 0.6355991587042809, + 0.03304601460695267, + 0.3853205107152462, + 0.8110690396279097, + 0.2303050495684147, + 0.21910818293690681, + 0.6439617946743965, + 0.2650553248822689, + 0.34919319674372673, + 2.016169609501958, + 1.6680907141417265, + 0.2100370954722166, + 1.9944579880684614, + 0.48589898832142353, + 0.8116226997226477, + 0.9330501006916165, + 0.6794542111456394, + 0.2282030452042818, + 0.7257566452026367, + 0.6450893804430962, + 1.098403375595808, + 0.9199545718729496, + 1.4058333653956652, + 0.9757939223200083, + 0.6324717812240124, + 0.760737769305706, + 0.3829329386353493 + ], + "unique_experts": 63, + "load_cv": 0.6168875947511556, + "normalized_load_entropy": 0.95482995101034, + "max_load_share": 0.04782608695652174 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 74, + "ordered_topk_exact_tokens": 34, + "set_exact_tokens": 48, + "mean_set_jaccard": 0.8996138996138998, + "mean_token_weighted_tv": 0.019522317068500293, + "aggregate_load_tv": 0.04504504504504504 + }, + "system_bos": { + "tokens": 74, + "ordered_topk_exact_tokens": 30, + "set_exact_tokens": 41, + "mean_set_jaccard": 0.8645431145431145, + "mean_token_weighted_tv": 0.026890722191515, + "aggregate_load_tv": 0.0563063063063063 + }, + "system_x": { + "tokens": 74, + "ordered_topk_exact_tokens": 24, + "set_exact_tokens": 34, + "mean_set_jaccard": 0.8397683397683399, + "mean_token_weighted_tv": 0.03257613756215653, + "aggregate_load_tv": 0.0563063063063063 + }, + "system_period": { + "tokens": 74, + "ordered_topk_exact_tokens": 23, + "set_exact_tokens": 31, + "mean_set_jaccard": 0.8223938223938224, + "mean_token_weighted_tv": 0.03463079404035533, + "aggregate_load_tv": 0.06531531531531531 + }, + "bos_at_s0": { + "tokens": 74, + "ordered_topk_exact_tokens": 24, + "set_exact_tokens": 40, + "mean_set_jaccard": 0.8542471042471043, + "mean_token_weighted_tv": 0.0308741250679501, + "aggregate_load_tv": 0.042792792792792814 + }, + "bos_at_s1": { + "tokens": 74, + "ordered_topk_exact_tokens": 24, + "set_exact_tokens": 36, + "mean_set_jaccard": 0.8416988416988418, + "mean_token_weighted_tv": 0.030887138664823125, + "aggregate_load_tv": 0.06081081081081082 + }, + "x_at_s0": { + "tokens": 74, + "ordered_topk_exact_tokens": 21, + "set_exact_tokens": 33, + "mean_set_jaccard": 0.8272200772200772, + "mean_token_weighted_tv": 0.03486695297918207, + "aggregate_load_tv": 0.06306306306306306 + }, + "x_at_s1": { + "tokens": 74, + "ordered_topk_exact_tokens": 18, + "set_exact_tokens": 29, + "mean_set_jaccard": 0.7972972972972973, + "mean_token_weighted_tv": 0.0402225539767863, + "aggregate_load_tv": 0.08108108108108109 + }, + "period_at_s0": { + "tokens": 74, + "ordered_topk_exact_tokens": 20, + "set_exact_tokens": 34, + "mean_set_jaccard": 0.8281853281853283, + "mean_token_weighted_tv": 0.035682955769368925, + "aggregate_load_tv": 0.06531531531531531 + }, + "period_at_s1": { + "tokens": 74, + "ordered_topk_exact_tokens": 17, + "set_exact_tokens": 29, + "mean_set_jaccard": 0.8001930501930502, + "mean_token_weighted_tv": 0.03902528340601035, + "aggregate_load_tv": 0.06981981981981983 + } + } + }, + "layer_16": { + "layer": 16, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "9bdf14976a5e02f75e7c0a5f2dd66df628f5f97260732c7bb662d258defbbee5", + "route_weight_sha256": "2b9863c57830bfbfe806f7498ad9bc16c55162b395ec285398c0cd418e97509d", + "loads": [ + 5, + 12, + 9, + 8, + 5, + 2, + 7, + 12, + 20, + 4, + 0, + 6, + 0, + 1, + 13, + 9, + 6, + 8, + 5, + 12, + 0, + 33, + 3, + 14, + 1, + 6, + 2, + 4, + 4, + 9, + 6, + 2, + 1, + 2, + 5, + 12, + 19, + 7, + 5, + 1, + 11, + 3, + 12, + 3, + 2, + 9, + 14, + 6, + 4, + 7, + 15, + 8, + 1, + 5, + 0, + 0, + 10, + 8, + 12, + 4, + 9, + 10, + 3, + 8 + ], + "weighted_loads": [ + 0.1975122131407261, + 0.6164857223629951, + 0.29357887990772724, + 0.5775915235280991, + 0.17839995585381985, + 0.09151171892881393, + 0.8096796367317438, + 0.8739118129014969, + 2.240207653492689, + 0.11220130696892738, + 0.0, + 0.39406983368098736, + 0.0, + 0.03792708367109299, + 0.8107843119651079, + 1.2535149455070496, + 0.2748795934021473, + 0.6251262053847313, + 0.19213865883648396, + 0.6284669917076826, + 0.0, + 2.265567174181342, + 0.09279489517211914, + 1.3137067444622517, + 0.03238771855831146, + 0.30073513463139534, + 0.05928475968539715, + 0.13019622676074505, + 0.18082067370414734, + 0.5244772098958492, + 0.20263313315808773, + 0.07095974311232567, + 0.039941854774951935, + 0.07841650769114494, + 0.16036362946033478, + 0.989563025534153, + 1.2705251071602106, + 0.614477202296257, + 0.2787850722670555, + 0.03963438794016838, + 1.3370373006910086, + 0.1389898620545864, + 0.7894650585949421, + 0.11304283700883389, + 0.06679743528366089, + 0.8252600505948067, + 0.6980104725807905, + 0.37431476823985577, + 0.22312992438673973, + 0.31481401063501835, + 0.8365876693278551, + 0.31192473508417606, + 0.033726766705513, + 0.2863816674798727, + 0.0, + 0.0, + 0.6588146165013313, + 0.3021634854376316, + 1.019627619534731, + 0.2285690139979124, + 1.3843240663409233, + 0.43146226182579994, + 0.28504569455981255, + 0.31564350239932537 + ], + "unique_experts": 59, + "load_cv": 0.8224884790128795, + "normalized_load_entropy": 0.9224303622072688, + "max_load_share": 0.07432432432432433 + }, + "full_input": { + "tokens": 99, + "top_k": 6, + "decisions": 594, + "ordered_route_sha256": "a29ec063afdbb373f77e3a7c33fb627fe6bf15e306107f26ad379e87bf9f8020", + "route_weight_sha256": "087915a992ee673da9576308e9cf8f6136db1ec8d315231c4988f5e54e8633fb", + "loads": [ + 6, + 12, + 9, + 8, + 5, + 10, + 11, + 12, + 20, + 6, + 3, + 6, + 0, + 2, + 13, + 16, + 14, + 13, + 10, + 13, + 11, + 35, + 5, + 14, + 9, + 6, + 8, + 4, + 4, + 9, + 7, + 2, + 2, + 9, + 5, + 12, + 19, + 17, + 6, + 1, + 12, + 11, + 15, + 3, + 5, + 11, + 14, + 8, + 4, + 8, + 15, + 10, + 1, + 17, + 0, + 10, + 10, + 8, + 12, + 4, + 12, + 12, + 3, + 15 + ], + "weighted_loads": [ + 0.29486631229519844, + 0.6164857223629951, + 0.29357887990772724, + 0.5775915235280991, + 0.17839995585381985, + 0.8793361820280552, + 0.9764982592314482, + 0.8739118129014969, + 2.240207653492689, + 1.4392861761152744, + 0.1772652454674244, + 0.39406983368098736, + 0.0, + 0.057137854397296906, + 0.8107843119651079, + 1.7617620900273323, + 0.6944466112181544, + 1.0234048776328564, + 0.8042556904256344, + 0.6309466396924108, + 0.9746926687657833, + 2.34639366902411, + 0.21428994461894035, + 1.3137067444622517, + 0.7599274590611458, + 0.30073513463139534, + 0.3861668761819601, + 0.13019622676074505, + 0.18082067370414734, + 0.5244772098958492, + 0.27769806049764156, + 0.07095974311232567, + 0.0811440646648407, + 0.4853709312155843, + 0.16036362946033478, + 0.989563025534153, + 1.2705251071602106, + 1.1574574001133442, + 0.3095879480242729, + 0.03963438794016838, + 1.3781769443303347, + 1.551761832088232, + 0.8917380031198263, + 0.11304283700883389, + 0.17160639353096485, + 0.9909300953149796, + 0.6980104725807905, + 0.47632970474660397, + 0.22312992438673973, + 0.33216175995767117, + 0.8365876693278551, + 0.4108224008232355, + 0.033726766705513, + 1.1108566336333752, + 0.0, + 0.8097853288054466, + 0.6588146165013313, + 0.3021634854376316, + 1.019627619534731, + 0.2285690139979124, + 1.5907076708972454, + 0.479077979340218, + 0.28504569455981255, + 0.6753685865551233 + ], + "unique_experts": 62, + "load_cv": 0.6240411706717562, + "normalized_load_entropy": 0.9523435657725601, + "max_load_share": 0.058922558922558925 + } + }, + "s1_eos": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "c2e6096764fadbe7ebf90c63232ac61c2c1ec13e6b58cd21fe73f1737bc8e9f7", + "route_weight_sha256": "c42d159ac25a4aea11f07553000d09eb1b0791348d0568e4da7bdb5f894a8ff6", + "loads": [ + 4, + 12, + 7, + 8, + 5, + 2, + 6, + 12, + 20, + 5, + 0, + 6, + 0, + 2, + 14, + 9, + 6, + 8, + 5, + 12, + 0, + 34, + 4, + 14, + 2, + 7, + 1, + 6, + 4, + 9, + 6, + 2, + 0, + 0, + 4, + 12, + 19, + 6, + 6, + 1, + 11, + 3, + 12, + 2, + 1, + 10, + 15, + 5, + 4, + 7, + 14, + 8, + 1, + 6, + 0, + 0, + 10, + 7, + 13, + 4, + 9, + 9, + 4, + 9 + ], + "weighted_loads": [ + 0.16787313297390938, + 0.6178824976086617, + 0.24120280146598816, + 0.5690184310078621, + 0.17379550263285637, + 0.09361474961042404, + 0.7679103333503008, + 0.8627462387084961, + 2.242288436740637, + 0.14691258408129215, + 0.0, + 0.3964005187153816, + 0.0, + 0.08323097601532936, + 0.8412877526134253, + 1.2857074402272701, + 0.26678408682346344, + 0.6354510374367237, + 0.18625151365995407, + 0.6098332926630974, + 0.0, + 2.2928052693605423, + 0.13249372318387032, + 1.3355040811002254, + 0.06486664339900017, + 0.32665206491947174, + 0.03398287668824196, + 0.18403802253305912, + 0.17657433450222015, + 0.5162773560732603, + 0.201121149584651, + 0.06676259823143482, + 0.0, + 0.0, + 0.13992751017212868, + 0.9850796982645988, + 1.2728510592132807, + 0.5842376872897148, + 0.3224345035851002, + 0.03873821347951889, + 1.3751789331436157, + 0.13046449422836304, + 0.7748154029250145, + 0.08353591710329056, + 0.026335209608078003, + 0.8612946271896362, + 0.713722325861454, + 0.34624508768320084, + 0.22571252286434174, + 0.31841656006872654, + 0.802937975153327, + 0.3196711018681526, + 0.032497406005859375, + 0.3099232632666826, + 0.0, + 0.0, + 0.6622361689805984, + 0.2638231348246336, + 1.0464090332388878, + 0.21930820867419243, + 1.405910199508071, + 0.3921026736497879, + 0.3011439796537161, + 0.34601107984781265 + ], + "unique_experts": 57, + "load_cv": 0.8423784739564973, + "normalized_load_entropy": 0.9173669179220378, + "max_load_share": 0.07657657657657657 + }, + "full_input": { + "tokens": 115, + "top_k": 6, + "decisions": 690, + "ordered_route_sha256": "52502ab56c5a3331171b36890b29d28b02caee0b7d3c0213b47643335fa3becb", + "route_weight_sha256": "33f78f7dcdb68299879c155f303743981111209077742e0c996041aa507079e6", + "loads": [ + 5, + 15, + 7, + 10, + 5, + 11, + 11, + 13, + 20, + 8, + 6, + 6, + 0, + 6, + 15, + 20, + 16, + 19, + 13, + 14, + 11, + 37, + 7, + 15, + 16, + 7, + 13, + 6, + 4, + 9, + 9, + 2, + 6, + 5, + 5, + 14, + 19, + 15, + 9, + 4, + 14, + 17, + 16, + 4, + 3, + 15, + 16, + 13, + 6, + 11, + 20, + 8, + 1, + 19, + 0, + 11, + 12, + 7, + 13, + 5, + 13, + 10, + 7, + 16 + ], + "weighted_loads": [ + 0.26871519163250923, + 0.7374801971018314, + 0.24120280146598816, + 0.659729927778244, + 0.17379550263285637, + 0.9336825124919415, + 1.0146113466471434, + 0.8878367766737938, + 2.242288436740637, + 1.5079431142657995, + 0.2118899766355753, + 0.3964005187153816, + 0.0, + 0.20471594482660294, + 0.8947269860655069, + 2.296940803527832, + 0.6926200082525611, + 1.5045800283551216, + 1.0449145659804344, + 0.6464028139598668, + 0.9568516481667757, + 2.416785191744566, + 0.24874131008982658, + 1.4121919684112072, + 1.2952872663736343, + 0.32665206491947174, + 1.2878532949835062, + 0.18403802253305912, + 0.17657433450222015, + 0.5162773560732603, + 0.34115140326321125, + 0.06676259823143482, + 0.24377847462892532, + 0.28288397938013077, + 0.17496705055236816, + 1.1119478978216648, + 1.2728510592132807, + 1.0903256721794605, + 0.4606744535267353, + 0.21621480584144592, + 1.4795444421470165, + 2.551300026476383, + 0.9009964894503355, + 0.17526503279805183, + 0.0941020455211401, + 1.1637473218142986, + 0.744690416380763, + 0.7295835725963116, + 0.31609709560871124, + 0.49344384856522083, + 1.0649867001920938, + 0.3196711018681526, + 0.032497406005859375, + 1.431468479335308, + 0.0, + 0.9653021320700645, + 0.7691295966506004, + 0.2638231348246336, + 1.0464090332388878, + 0.4135436378419399, + 1.5880283061414957, + 0.39394458348397166, + 0.6272195521742105, + 0.722324563190341 + ], + "unique_experts": 62, + "load_cv": 0.5770300365630789, + "normalized_load_entropy": 0.9585348010399469, + "max_load_share": 0.0536231884057971 + } + }, + "s0_bos": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "fb8a0c5da1dc21d89cd8c22c52036fa5484a2f42aba6d559249cce3b65b00542", + "route_weight_sha256": "f5d841b568e29b7de526e6a4cde00fae11659f0eb9199de7ca33a1f592d57e89", + "loads": [ + 3, + 11, + 5, + 8, + 4, + 2, + 7, + 11, + 20, + 4, + 0, + 8, + 0, + 1, + 16, + 9, + 7, + 8, + 4, + 13, + 0, + 33, + 1, + 15, + 1, + 7, + 1, + 3, + 4, + 10, + 6, + 2, + 1, + 1, + 4, + 13, + 19, + 6, + 6, + 1, + 16, + 3, + 12, + 3, + 3, + 10, + 15, + 4, + 4, + 6, + 15, + 9, + 2, + 4, + 0, + 1, + 9, + 8, + 12, + 4, + 8, + 8, + 4, + 9 + ], + "weighted_loads": [ + 0.13437598571181297, + 0.5865467917174101, + 0.18037463910877705, + 0.5845043025910854, + 0.14461633190512657, + 0.09521747566759586, + 0.8265511933714151, + 0.81141247600317, + 2.2561270482838154, + 0.10905604250729084, + 0.0, + 0.48588586784899235, + 0.0, + 0.03740653768181801, + 0.9592796918004751, + 1.2513766549527645, + 0.2953363321721554, + 0.6279765032231808, + 0.15615937113761902, + 0.6009118966758251, + 0.0, + 2.321877535432577, + 0.0324665829539299, + 1.3396872766315937, + 0.03213853761553764, + 0.3290220685303211, + 0.0407051146030426, + 0.08992004208266735, + 0.18964582681655884, + 0.5443057361990213, + 0.1997650098055601, + 0.06525219231843948, + 0.04339081794023514, + 0.028009021654725075, + 0.13067214377224445, + 1.0334692262113094, + 1.3266585487872362, + 0.559717733412981, + 0.32129303738474846, + 0.04211069643497467, + 1.4982829596847296, + 0.1347463931888342, + 0.7977172136306763, + 0.12295960634946823, + 0.10208097472786903, + 0.8542202301323414, + 0.7414755746722221, + 0.2870701290667057, + 0.22950047627091408, + 0.27820485830307007, + 0.8740105517208576, + 0.37562015280127525, + 0.06464585289359093, + 0.2553765047341585, + 0.0, + 0.029713625088334084, + 0.6247603297233582, + 0.30473255924880505, + 1.0314455851912498, + 0.20905381999909878, + 1.3655138723552227, + 0.36523203924298286, + 0.3125777691602707, + 0.3556706439703703 + ], + "unique_experts": 60, + "load_cv": 0.8591685533325041, + "normalized_load_entropy": 0.9166684893583412, + "max_load_share": 0.07432432432432433 + }, + "full_input": { + "tokens": 99, + "top_k": 6, + "decisions": 594, + "ordered_route_sha256": "7aa4f0175add05a4a519e359572beb00134dbedd0a2a531c2ba2591840df5213", + "route_weight_sha256": "6b0a9ce2d97d58265eefc190a3a697493f915d42e8b05d279ebbe375a62fb2ba", + "loads": [ + 4, + 11, + 6, + 8, + 4, + 12, + 11, + 11, + 20, + 6, + 3, + 9, + 1, + 2, + 16, + 16, + 15, + 13, + 9, + 14, + 11, + 35, + 3, + 15, + 8, + 7, + 5, + 3, + 4, + 10, + 7, + 2, + 3, + 7, + 5, + 13, + 19, + 16, + 7, + 1, + 17, + 12, + 15, + 3, + 5, + 12, + 15, + 5, + 4, + 8, + 16, + 11, + 2, + 16, + 0, + 11, + 9, + 8, + 12, + 4, + 10, + 9, + 4, + 14 + ], + "weighted_loads": [ + 0.22390251234173775, + 0.5865467917174101, + 0.22122924216091633, + 0.5845043025910854, + 0.14461633190512657, + 0.9614919703453779, + 0.9933698158711195, + 0.81141247600317, + 2.2561270482838154, + 0.5265845898538828, + 0.1772652454674244, + 0.5274916384369135, + 0.07871393859386444, + 0.05661730840802193, + 0.9592796918004751, + 1.751965295523405, + 1.190969729796052, + 1.063300684094429, + 0.7417523507028818, + 0.6328350007534027, + 0.9746926687657833, + 2.402704030275345, + 0.15396163240075111, + 1.3396872766315937, + 0.6996882520616055, + 0.3290220685303211, + 0.2771738786250353, + 0.08992004208266735, + 0.18964582681655884, + 0.5443057361990213, + 0.27482993714511395, + 0.06525219231843948, + 0.11704858019948006, + 0.39314224012196064, + 0.2590996492654085, + 1.0334692262113094, + 1.3266585487872362, + 1.113271750509739, + 0.3527928926050663, + 0.04211069643497467, + 1.5394226033240557, + 1.5792253147810698, + 0.8988348320126534, + 0.12295960634946823, + 0.17769007943570614, + 1.022961962968111, + 0.7414755746722221, + 0.3567035160958767, + 0.22950047627091408, + 0.3390122875571251, + 0.9176488071680069, + 0.4745178185403347, + 0.06464585289359093, + 1.090240240097046, + 0.0, + 0.8394989538937807, + 0.6247603297233582, + 0.30473255924880505, + 1.0314455851912498, + 0.20905381999909878, + 1.4942204356193542, + 0.41100355237722397, + 0.3125777691602707, + 0.6778276301920414 + ], + "unique_experts": 63, + "load_cv": 0.6426567847413368, + "normalized_load_entropy": 0.9509311888140233, + "max_load_share": 0.058922558922558925 + } + }, + "s1_bos": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "7aafacec50e09f61eeca668a763907c0ca245e4011f59ada1948247b9d32f219", + "route_weight_sha256": "513458854462e985837883c779d8068f8520f231968a01ef5841fa47ed44ae77", + "loads": [ + 4, + 13, + 6, + 8, + 4, + 2, + 4, + 11, + 20, + 3, + 0, + 7, + 0, + 1, + 15, + 9, + 6, + 8, + 5, + 12, + 0, + 35, + 1, + 15, + 2, + 7, + 1, + 3, + 4, + 7, + 5, + 2, + 1, + 0, + 4, + 12, + 20, + 7, + 6, + 1, + 14, + 2, + 12, + 3, + 4, + 10, + 15, + 6, + 4, + 6, + 16, + 9, + 2, + 5, + 0, + 1, + 9, + 9, + 12, + 4, + 10, + 8, + 4, + 8 + ], + "weighted_loads": [ + 0.15933088585734367, + 0.668228279799223, + 0.19910190626978874, + 0.5882941633462906, + 0.13899263925850391, + 0.09508427232503891, + 0.711477167904377, + 0.8068837746977806, + 2.2323691360652447, + 0.08916257694363594, + 0.0, + 0.4284621812403202, + 0.0, + 0.03680731728672981, + 0.902874369174242, + 1.2127145789563656, + 0.25035106018185616, + 0.6601074449717999, + 0.17927736602723598, + 0.5722662582993507, + 0.0, + 2.439710546284914, + 0.03358815982937813, + 1.3357802778482437, + 0.06403090246021748, + 0.3291320241987705, + 0.03856906294822693, + 0.0863665733486414, + 0.1821802332997322, + 0.4433091301470995, + 0.174985995516181, + 0.06049354374408722, + 0.041441548615694046, + 0.0, + 0.13201339170336723, + 0.9867516253143549, + 1.34217494353652, + 0.5760234855115414, + 0.34293488785624504, + 0.041338831186294556, + 1.5027455650269985, + 0.10599122196435928, + 0.744748517870903, + 0.11469202488660812, + 0.12753316387534142, + 0.8255729489028454, + 0.7544255219399929, + 0.3618311658501625, + 0.2362084612250328, + 0.27605894207954407, + 0.913811830803752, + 0.36344159208238125, + 0.06668184325098991, + 0.29486229456961155, + 0.0, + 0.02744870074093342, + 0.6169817894697189, + 0.32864497788250446, + 1.006477639079094, + 0.22485945373773575, + 1.444312922656536, + 0.35492756217718124, + 0.31263500079512596, + 0.32402088306844234 + ], + "unique_experts": 59, + "load_cv": 0.8763779484781946, + "normalized_load_entropy": 0.9148512187182846, + "max_load_share": 0.07882882882882883 + }, + "full_input": { + "tokens": 115, + "top_k": 6, + "decisions": 690, + "ordered_route_sha256": "e8ade274a1315b2f07735f65580d4d055ab4f93d0d734434297fad978ded6793", + "route_weight_sha256": "8f3fb5b3ed166c4707068430cc0c2c514b72fe828f0b30c77caf2aa43941ba6c", + "loads": [ + 5, + 16, + 6, + 10, + 4, + 11, + 10, + 12, + 20, + 6, + 6, + 7, + 0, + 6, + 16, + 20, + 17, + 18, + 13, + 12, + 11, + 37, + 4, + 16, + 15, + 7, + 11, + 3, + 4, + 7, + 8, + 2, + 8, + 5, + 6, + 14, + 20, + 16, + 9, + 4, + 17, + 18, + 16, + 5, + 8, + 15, + 16, + 13, + 6, + 10, + 22, + 9, + 2, + 18, + 0, + 12, + 11, + 9, + 12, + 5, + 15, + 8, + 7, + 14 + ], + "weighted_loads": [ + 0.22447792068123817, + 0.7878259792923927, + 0.19910190626978874, + 0.6790056601166725, + 0.13899263925850391, + 0.9318334944546223, + 1.0000606663525105, + 0.8319743126630783, + 2.2323691360652447, + 0.5382744930684566, + 0.2118899766355753, + 0.4284621812403202, + 0.0, + 0.19437043368816376, + 0.9563136026263237, + 2.2051874957978725, + 1.150712488219142, + 1.5060594640672207, + 1.0384204592555761, + 0.5722662582993507, + 0.9568516481667757, + 2.5327212773263454, + 0.1498357467353344, + 1.4124681651592255, + 1.2238134499639273, + 0.3291320241987705, + 1.2115350980311632, + 0.0863665733486414, + 0.1821802332997322, + 0.4433091301470995, + 0.31501624919474125, + 0.06049354374408722, + 0.3188117519021034, + 0.3027578629553318, + 0.20852981135249138, + 1.1136198248714209, + 1.34217494353652, + 1.0856619365513325, + 0.49928473494946957, + 0.2188154235482216, + 1.6071110740303993, + 2.6108074225485325, + 0.8712876010686159, + 0.2064211405813694, + 0.2713720481842756, + 1.1227098628878593, + 0.785393612459302, + 0.7158854454755783, + 0.3265930339694023, + 0.45108623057603836, + 1.1826634276658297, + 0.36344159208238125, + 0.06668184325098991, + 1.4293448217213154, + 0.0, + 0.992750832810998, + 0.7238752171397209, + 0.32864497788250446, + 1.006477639079094, + 0.41909488290548325, + 1.6874811220914125, + 0.35492756217718124, + 0.6387105733156204, + 0.7011429257690907 + ], + "unique_experts": 62, + "load_cv": 0.5862744292259463, + "normalized_load_entropy": 0.9578901266816225, + "max_load_share": 0.0536231884057971 + } + }, + "s0_x": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "55fbd53cd9c8b07870f0c8faf59f36ded958b028a277adbef64fb0ca17ea8f29", + "route_weight_sha256": "e9434f51e84fa128ef4f106e8cda94c697d97a5d0dd401e677544f21a7ce740c", + "loads": [ + 3, + 11, + 8, + 8, + 5, + 2, + 6, + 11, + 20, + 4, + 0, + 7, + 0, + 1, + 15, + 9, + 7, + 8, + 5, + 12, + 0, + 34, + 1, + 15, + 1, + 7, + 1, + 3, + 4, + 10, + 4, + 2, + 0, + 1, + 6, + 13, + 20, + 7, + 7, + 1, + 14, + 2, + 12, + 3, + 3, + 9, + 16, + 4, + 4, + 5, + 16, + 10, + 1, + 4, + 0, + 1, + 10, + 8, + 12, + 4, + 8, + 8, + 4, + 7 + ], + "weighted_loads": [ + 0.13842270709574223, + 0.5962927509099245, + 0.26475898176431656, + 0.6077771596610546, + 0.1909998022019863, + 0.09473173692822456, + 0.8148532900959253, + 0.8024508059024811, + 2.261899996548891, + 0.1234679576009512, + 0.0, + 0.44015110842883587, + 0.0, + 0.038795437663793564, + 0.9591868314892054, + 1.2855300232768059, + 0.2758130319416523, + 0.6380199901759624, + 0.18186910264194012, + 0.5853924918919802, + 0.0, + 2.3910689651966095, + 0.03029601275920868, + 1.3549253642559052, + 0.03236202523112297, + 0.33196185529232025, + 0.0365232490003109, + 0.10020060651004314, + 0.18758142739534378, + 0.5147131998091936, + 0.13445495069026947, + 0.06360137648880482, + 0.0, + 0.029894450679421425, + 0.1841329038143158, + 1.0148100703954697, + 1.3913547210395336, + 0.550204087048769, + 0.352707514539361, + 0.040573835372924805, + 1.4549472890794277, + 0.1136523075401783, + 0.7879568822681904, + 0.10977676883339882, + 0.09700535424053669, + 0.8519449643790722, + 0.775850210338831, + 0.27224041894078255, + 0.226757250726223, + 0.2391316555440426, + 0.895428029820323, + 0.42081970162689686, + 0.03412315249443054, + 0.26027949899435043, + 0.0, + 0.026284681633114815, + 0.6753878258168697, + 0.31080849282443523, + 1.026930507272482, + 0.22625800780951977, + 1.3543200865387917, + 0.3754210192710161, + 0.3124295473098755, + 0.26811591163277626 + ], + "unique_experts": 59, + "load_cv": 0.8730375862810786, + "normalized_load_entropy": 0.9135115669943479, + "max_load_share": 0.07657657657657657 + }, + "full_input": { + "tokens": 99, + "top_k": 6, + "decisions": 594, + "ordered_route_sha256": "bd1da7f78b4b98d3fdf17f5b62eb755360cda9bbf600b7c46b0dde4c124e1e38", + "route_weight_sha256": "fba8ed82089318462e88811d1842b5d36aa09e644789572c464bd185c2213c04", + "loads": [ + 4, + 11, + 8, + 8, + 5, + 10, + 10, + 11, + 20, + 5, + 3, + 7, + 0, + 2, + 15, + 16, + 14, + 14, + 11, + 12, + 12, + 37, + 3, + 15, + 9, + 7, + 6, + 3, + 4, + 10, + 6, + 2, + 2, + 6, + 6, + 13, + 20, + 18, + 8, + 1, + 15, + 10, + 15, + 3, + 4, + 11, + 16, + 6, + 4, + 6, + 17, + 12, + 1, + 17, + 0, + 12, + 10, + 8, + 12, + 4, + 11, + 9, + 4, + 13 + ], + "weighted_loads": [ + 0.2602578643709421, + 0.5962927509099245, + 0.26475898176431656, + 0.6077771596610546, + 0.1909998022019863, + 0.8825562000274658, + 0.9816719125956297, + 0.8024508059024811, + 2.261899996548891, + 0.5004469808191061, + 0.1772652454674244, + 0.44015110842883587, + 0.0, + 0.05800620838999748, + 0.9591868314892054, + 1.812380090355873, + 0.61601397767663, + 1.104348111897707, + 0.8867875076830387, + 0.5853924918919802, + 1.2207322679460049, + 2.5062606036663055, + 0.1517910622060299, + 1.3549253642559052, + 0.7751205526292324, + 0.33196185529232025, + 0.3034688998013735, + 0.10020060651004314, + 0.18758142739534378, + 0.5147131998091936, + 0.25569014251232147, + 0.06360137648880482, + 0.11199277639389038, + 0.39329045079648495, + 0.1841329038143158, + 1.0148100703954697, + 1.3913547210395336, + 1.1248240135610104, + 0.3834736570715904, + 0.040573835372924805, + 1.4960869327187538, + 1.4392441250383854, + 0.9092415031045675, + 0.10977676883339882, + 0.14290033839643002, + 1.0019519217312336, + 0.775850210338831, + 0.3517024964094162, + 0.226757250726223, + 0.2564794048666954, + 0.931478088721633, + 0.5197173673659563, + 0.03412315249443054, + 1.2109460588544607, + 0.0, + 0.9511443469673395, + 0.6753878258168697, + 0.31080849282443523, + 1.026930507272482, + 0.22625800780951977, + 1.5538265220820904, + 0.4211925324052572, + 0.3124295473098755, + 0.6282722372561693 + ], + "unique_experts": 62, + "load_cv": 0.6670321754206472, + "normalized_load_entropy": 0.9470520406416044, + "max_load_share": 0.06228956228956229 + } + }, + "s1_x": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "fb740a545a119be8c2b17d2ebc6aa51e1a1ea5cffb008c7e4918a678a84e6f12", + "route_weight_sha256": "f01652187a68dcca670a04f6b50d6e5a20ea625505705ca553decb1f655da139", + "loads": [ + 2, + 12, + 7, + 8, + 5, + 2, + 6, + 12, + 21, + 3, + 0, + 6, + 0, + 1, + 15, + 9, + 7, + 7, + 5, + 11, + 0, + 33, + 1, + 15, + 2, + 6, + 1, + 3, + 4, + 10, + 4, + 2, + 1, + 1, + 3, + 13, + 23, + 7, + 7, + 1, + 12, + 4, + 12, + 2, + 4, + 10, + 15, + 4, + 4, + 3, + 17, + 8, + 1, + 5, + 0, + 1, + 10, + 9, + 13, + 4, + 11, + 8, + 4, + 7 + ], + "weighted_loads": [ + 0.11301333084702492, + 0.6394734662026167, + 0.24213813245296478, + 0.574715830385685, + 0.17503977566957474, + 0.09221125207841396, + 0.8269212115556002, + 0.8335240706801414, + 2.288044862449169, + 0.07313928753137589, + 0.0, + 0.3597439732402563, + 0.0, + 0.035322122275829315, + 0.9468214772641659, + 1.247284546494484, + 0.3004110883921385, + 0.5896625034511089, + 0.17092361487448215, + 0.5742043294012547, + 0.0, + 2.4239707216620445, + 0.03335284814238548, + 1.3310538232326508, + 0.0683266669511795, + 0.30639078840613365, + 0.03495294600725174, + 0.09349173121154308, + 0.18102680146694183, + 0.5281274355947971, + 0.13397857546806335, + 0.06025971844792366, + 0.04114058241248131, + 0.03280777484178543, + 0.09812615625560284, + 1.0081862770020962, + 1.4688210431486368, + 0.5513574313372374, + 0.3854321390390396, + 0.040521182119846344, + 1.479345876723528, + 0.17831135541200638, + 0.7496819458901882, + 0.08402997255325317, + 0.17873199097812176, + 0.841765359044075, + 0.7356872502714396, + 0.2800855115056038, + 0.2262890413403511, + 0.18296286091208458, + 0.9539591409265995, + 0.34703556820750237, + 0.028704067692160606, + 0.2918623983860016, + 0.0, + 0.025514086708426476, + 0.6684292182326317, + 0.3169833105057478, + 1.0459651798009872, + 0.2165132872760296, + 1.4624900110065937, + 0.3362711723893881, + 0.3022231627255678, + 0.2776033990085125 + ], + "unique_experts": 60, + "load_cv": 0.8866897152237168, + "normalized_load_entropy": 0.912641808704603, + "max_load_share": 0.07432432432432433 + }, + "full_input": { + "tokens": 115, + "top_k": 6, + "decisions": 690, + "ordered_route_sha256": "21e71d1c9514abc1910cdba1b2965a7fadb028a51ee04d79d31282023f3ee3c8", + "route_weight_sha256": "801d2da366fe30ccf0544fd374df545ff2193b51c6da5f32904d7f1f8dc883a7", + "loads": [ + 3, + 15, + 7, + 10, + 5, + 11, + 12, + 13, + 21, + 5, + 8, + 6, + 0, + 5, + 16, + 20, + 17, + 18, + 13, + 11, + 15, + 36, + 5, + 16, + 17, + 6, + 11, + 3, + 4, + 10, + 7, + 2, + 8, + 4, + 4, + 15, + 23, + 16, + 9, + 4, + 15, + 18, + 16, + 4, + 6, + 15, + 16, + 10, + 6, + 7, + 22, + 8, + 1, + 19, + 0, + 13, + 12, + 10, + 13, + 5, + 15, + 9, + 7, + 12 + ], + "weighted_loads": [ + 0.21691079065203667, + 0.7590711656957865, + 0.24213813245296478, + 0.6654273271560669, + 0.17503977566957474, + 0.9292032066732645, + 1.123110281303525, + 0.8586146086454391, + 2.288044862449169, + 0.48527102544903755, + 0.2675547581166029, + 0.3597439732402563, + 0.0, + 0.1568070910871029, + 1.0002607107162476, + 2.330154702067375, + 0.6795040536671877, + 1.5020884796977043, + 0.9948355425149202, + 0.5742043294012547, + 1.354384358972311, + 2.5519966147840023, + 0.18193842098116875, + 1.4077417105436325, + 1.398552343249321, + 0.30639078840613365, + 1.1834249999374151, + 0.09349173121154308, + 0.18102680146694183, + 0.5281274355947971, + 0.2740088291466236, + 0.06025971844792366, + 0.34923629090189934, + 0.21288909390568733, + 0.13316569663584232, + 1.1350544765591621, + 1.4688210431486368, + 1.0602769795805216, + 0.5115088075399399, + 0.21799777448177338, + 1.5837113857269287, + 2.2951082214713097, + 0.8858459275215864, + 0.17575908824801445, + 0.24649882689118385, + 1.1281610168516636, + 0.7666553407907486, + 0.5767402052879333, + 0.3166736140847206, + 0.3579901494085789, + 1.1755410470068455, + 0.34703556820750237, + 0.028704067692160606, + 1.5122804697602987, + 0.0, + 1.1248500775545835, + 0.7753226459026337, + 0.37817678786814213, + 1.0459651798009872, + 0.4107487164437771, + 1.627604614943266, + 0.392233831807971, + 0.6282987352460623, + 0.5629281830042601 + ], + "unique_experts": 62, + "load_cv": 0.604783841602983, + "normalized_load_entropy": 0.9543152056497619, + "max_load_share": 0.05217391304347826 + } + }, + "s0_period": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "5239ad954969de8fa1626ed800c0fcf3cdf3cdfbb629263affa9cfe967b26779", + "route_weight_sha256": "9e13f837bb3d0d88c0d60f6d35bb98f9d93933d395888ff686ef8d09a4fb4452", + "loads": [ + 3, + 11, + 6, + 9, + 5, + 2, + 7, + 11, + 20, + 5, + 0, + 6, + 0, + 1, + 15, + 9, + 7, + 8, + 5, + 11, + 0, + 34, + 3, + 15, + 2, + 6, + 1, + 2, + 4, + 10, + 5, + 2, + 0, + 0, + 6, + 13, + 20, + 6, + 7, + 1, + 13, + 2, + 12, + 3, + 1, + 10, + 15, + 4, + 3, + 6, + 16, + 10, + 2, + 5, + 1, + 1, + 10, + 8, + 13, + 4, + 7, + 8, + 4, + 8 + ], + "weighted_loads": [ + 0.14156292751431465, + 0.6023082882165909, + 0.21122723445296288, + 0.6289161518216133, + 0.19205397367477417, + 0.0957813411951065, + 0.8497864343225956, + 0.8292832411825657, + 2.23799180239439, + 0.15491501986980438, + 0.0, + 0.40259057469666004, + 0.0, + 0.039969004690647125, + 0.9628637302666903, + 1.2514008358120918, + 0.2669731881469488, + 0.607805922627449, + 0.1809265110641718, + 0.5558010619133711, + 0.0, + 2.42641338147223, + 0.10833465680480003, + 1.357078056782484, + 0.062040483579039574, + 0.28293856605887413, + 0.039392102509737015, + 0.06582920253276825, + 0.1887178122997284, + 0.5069814287126064, + 0.16366965509951115, + 0.06310458295047283, + 0.0, + 0.0, + 0.1853126361966133, + 1.0368808712810278, + 1.3828110378235579, + 0.5246915780007839, + 0.3462339900434017, + 0.04066218435764313, + 1.4138425402343273, + 0.12156769633293152, + 0.7909502312541008, + 0.1129168402403593, + 0.04457010328769684, + 0.9125398378819227, + 0.7669985331594944, + 0.2628093510866165, + 0.18959737569093704, + 0.2765921391546726, + 0.8965803161263466, + 0.41503048688173294, + 0.06634069979190826, + 0.2777431346476078, + 0.027501480653882027, + 0.027671968564391136, + 0.6704061925411224, + 0.30030446872115135, + 1.0686782654374838, + 0.2192237824201584, + 1.352080311626196, + 0.371106768026948, + 0.31875566206872463, + 0.2980738077312708 + ], + "unique_experts": 59, + "load_cv": 0.8651932559729021, + "normalized_load_entropy": 0.9155006197379888, + "max_load_share": 0.07657657657657657 + }, + "full_input": { + "tokens": 99, + "top_k": 6, + "decisions": 594, + "ordered_route_sha256": "bac36332513b1c24b096fd665cc50876e2cb19444b6f010f6c82e3b18a89c990", + "route_weight_sha256": "76cc75266b2f756d68f55a961537fb58449b1c8f82dea83f0d514f431a99ca4d", + "loads": [ + 4, + 11, + 6, + 9, + 5, + 11, + 11, + 11, + 20, + 6, + 4, + 6, + 0, + 2, + 15, + 16, + 14, + 14, + 11, + 11, + 13, + 36, + 6, + 15, + 11, + 6, + 6, + 2, + 4, + 10, + 7, + 2, + 1, + 4, + 6, + 13, + 20, + 16, + 8, + 1, + 14, + 9, + 15, + 3, + 3, + 12, + 15, + 7, + 3, + 7, + 16, + 12, + 2, + 17, + 1, + 12, + 10, + 8, + 13, + 4, + 10, + 10, + 4, + 13 + ], + "weighted_loads": [ + 0.2560991384088993, + 0.6023082882165909, + 0.21122723445296288, + 0.6289161518216133, + 0.19205397367477417, + 0.9299737960100174, + 1.0166050568223, + 0.8292832411825657, + 2.23799180239439, + 0.5318940430879593, + 0.23235749825835228, + 0.40259057469666004, + 0.0, + 0.059179775416851044, + 0.9628637302666903, + 1.7380015030503273, + 0.6507946029305458, + 1.170129381120205, + 0.8241971358656883, + 0.5558010619133711, + 1.0952825024724007, + 2.5072398763149977, + 0.27092640846967697, + 1.357078056782484, + 0.8828908409923315, + 0.28293856605887413, + 0.3348745685070753, + 0.06582920253276825, + 0.1887178122997284, + 0.5069814287126064, + 0.30504179932177067, + 0.06310458295047283, + 0.04120220988988876, + 0.3003479577600956, + 0.1853126361966133, + 1.0368808712810278, + 1.3828110378235579, + 1.0650994628667831, + 0.3778189457952976, + 0.04066218435764313, + 1.4549821838736534, + 1.3912345916032791, + 0.9127925094217062, + 0.1129168402403593, + 0.134184081107378, + 1.068705065175891, + 0.7669985331594944, + 0.3781874515116215, + 0.18959737569093704, + 0.29393988847732544, + 0.8965803161263466, + 0.5139281526207924, + 0.06634069979190826, + 1.092677989974618, + 0.027501480653882027, + 0.9021239262074232, + 0.6704061925411224, + 0.30030446872115135, + 1.0686782654374838, + 0.2192237824201584, + 1.5408931039273739, + 0.4557012189179659, + 0.31875566206872463, + 0.6155411526560783 + ], + "unique_experts": 63, + "load_cv": 0.6513476498415403, + "normalized_load_entropy": 0.9493016885364194, + "max_load_share": 0.06060606060606061 + } + }, + "s1_period": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "04bfc80af4549d46d43f4e1d3f70f3d56fa4b4cd87fa5ca6b6170e6491d58d17", + "route_weight_sha256": "988ea5f7d953beaf336fa6610fc2a7c8a755792947323c3053a6bd05a3d60861", + "loads": [ + 3, + 12, + 6, + 7, + 4, + 2, + 5, + 12, + 21, + 2, + 0, + 9, + 0, + 1, + 15, + 9, + 8, + 8, + 4, + 11, + 0, + 32, + 1, + 15, + 2, + 6, + 1, + 3, + 4, + 10, + 4, + 2, + 1, + 1, + 3, + 13, + 21, + 6, + 7, + 1, + 13, + 3, + 12, + 2, + 4, + 10, + 14, + 4, + 4, + 5, + 18, + 11, + 0, + 5, + 1, + 0, + 10, + 8, + 13, + 5, + 10, + 8, + 4, + 8 + ], + "weighted_loads": [ + 0.13897658698260784, + 0.6613017879426479, + 0.2098137103021145, + 0.5518341436982155, + 0.14836779609322548, + 0.0906841941177845, + 0.7938140500336885, + 0.8432650566101074, + 2.308174405246973, + 0.05486859753727913, + 0.0, + 0.4505789056420326, + 0.0, + 0.036593977361917496, + 0.9232917930930853, + 1.2581292390823364, + 0.3082767967134714, + 0.6097988020628691, + 0.13881593570113182, + 0.5651621744036674, + 0.0, + 2.393729530274868, + 0.03204528987407684, + 1.342727404087782, + 0.06631421856582165, + 0.3101317957043648, + 0.03526156023144722, + 0.09706010296940804, + 0.18622485920786858, + 0.5259298030287027, + 0.13703664392232895, + 0.060281435027718544, + 0.044214196503162384, + 0.030554477125406265, + 0.09844368137419224, + 1.0004950314760208, + 1.367102911695838, + 0.5125710479915142, + 0.39200953021645546, + 0.044789355248212814, + 1.5290680322796106, + 0.1418863795697689, + 0.7646435797214508, + 0.0853937529027462, + 0.15420814789831638, + 0.8725419864058495, + 0.7086643557995558, + 0.28285907208919525, + 0.2233365699648857, + 0.2351769618690014, + 1.003411840647459, + 0.43545681796967983, + 0.0, + 0.2752185855060816, + 0.024049805477261543, + 0.0, + 0.6649731397628784, + 0.28608607687056065, + 1.0737630687654018, + 0.2489358577877283, + 1.4092410784214735, + 0.3440609220415354, + 0.31393859535455704, + 0.33381302654743195 + ], + "unique_experts": 59, + "load_cv": 0.8745237668845101, + "normalized_load_entropy": 0.9121492123898597, + "max_load_share": 0.07207207207207207 + }, + "full_input": { + "tokens": 115, + "top_k": 6, + "decisions": 690, + "ordered_route_sha256": "4665eade2894d51653671aff32316b0553f49dfac3dbc29c181582cd3a7400a2", + "route_weight_sha256": "b629fdbeec131d72d96352adb1ede40b78cf37bcc964def06f709209e9c90c3f", + "loads": [ + 4, + 15, + 6, + 9, + 4, + 12, + 11, + 13, + 21, + 4, + 7, + 9, + 0, + 5, + 16, + 20, + 17, + 20, + 12, + 11, + 12, + 34, + 4, + 16, + 17, + 6, + 11, + 3, + 4, + 10, + 8, + 2, + 9, + 4, + 4, + 15, + 22, + 15, + 10, + 4, + 16, + 18, + 16, + 4, + 6, + 15, + 15, + 10, + 6, + 9, + 23, + 11, + 0, + 19, + 2, + 12, + 12, + 8, + 13, + 6, + 14, + 9, + 7, + 13 + ], + "weighted_loads": [ + 0.24369697086513042, + 0.7808994874358177, + 0.2098137103021145, + 0.6425456404685974, + 0.14836779609322548, + 0.9589268825948238, + 1.093713192269206, + 0.8683555945754051, + 2.308174405246973, + 0.4670003354549408, + 0.23950152657926083, + 0.4505789056420326, + 0.0, + 0.15807894617319107, + 0.976731026545167, + 2.2521400675177574, + 0.6780397202819586, + 1.5662522036582232, + 1.0091208927333355, + 0.5651621744036674, + 1.0198342073708773, + 2.4867402613162994, + 0.1482928767800331, + 1.4194152913987637, + 1.396274657920003, + 0.3101317957043648, + 1.2092110645025969, + 0.09706010296940804, + 0.18622485920786858, + 0.5259298030287027, + 0.3442283533513546, + 0.060281435027718544, + 0.3521038331091404, + 0.22053811699151993, + 0.13348322175443172, + 1.1273632310330868, + 1.401692708954215, + 1.0081400871276855, + 0.575232557952404, + 0.22226594761013985, + 1.6334335412830114, + 2.2330940142273903, + 0.9001989830285311, + 0.17712286859750748, + 0.22197498381137848, + 1.1814523674547672, + 0.7396324463188648, + 0.5795137658715248, + 0.3137211427092552, + 0.4102042503654957, + 1.224993746727705, + 0.43545681796967983, + 0.0, + 1.4529269337654114, + 0.06396645121276379, + 1.0126694440841675, + 0.7718665674328804, + 0.28608607687056065, + 1.0737630687654018, + 0.4431712869554758, + 1.6041581463068724, + 0.4094502944499254, + 0.6400141678750515, + 0.6184698734432459 + ], + "unique_experts": 62, + "load_cv": 0.5897037159369034, + "normalized_load_entropy": 0.9561738673238646, + "max_load_share": 0.04927536231884058 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 74, + "ordered_topk_exact_tokens": 44, + "set_exact_tokens": 54, + "mean_set_jaccard": 0.9198841698841701, + "mean_token_weighted_tv": 0.016554112369949754, + "aggregate_load_tv": 0.03603603603603603 + }, + "system_bos": { + "tokens": 74, + "ordered_topk_exact_tokens": 34, + "set_exact_tokens": 46, + "mean_set_jaccard": 0.8918918918918919, + "mean_token_weighted_tv": 0.02219842415856751, + "aggregate_load_tv": 0.04054054054054053 + }, + "system_x": { + "tokens": 74, + "ordered_topk_exact_tokens": 25, + "set_exact_tokens": 35, + "mean_set_jaccard": 0.834942084942085, + "mean_token_weighted_tv": 0.03248684497147396, + "aggregate_load_tv": 0.042792792792792786 + }, + "system_period": { + "tokens": 74, + "ordered_topk_exact_tokens": 29, + "set_exact_tokens": 40, + "mean_set_jaccard": 0.8571428571428572, + "mean_token_weighted_tv": 0.031098529482512054, + "aggregate_load_tv": 0.05180180180180182 + }, + "bos_at_s0": { + "tokens": 74, + "ordered_topk_exact_tokens": 20, + "set_exact_tokens": 33, + "mean_set_jaccard": 0.8301158301158301, + "mean_token_weighted_tv": 0.0323869714110687, + "aggregate_load_tv": 0.0563063063063063 + }, + "bos_at_s1": { + "tokens": 74, + "ordered_topk_exact_tokens": 26, + "set_exact_tokens": 41, + "mean_set_jaccard": 0.8667953667953667, + "mean_token_weighted_tv": 0.02901195242648592, + "aggregate_load_tv": 0.05405405405405406 + }, + "x_at_s0": { + "tokens": 74, + "ordered_topk_exact_tokens": 21, + "set_exact_tokens": 33, + "mean_set_jaccard": 0.8220720720720722, + "mean_token_weighted_tv": 0.03506724143753181, + "aggregate_load_tv": 0.05405405405405404 + }, + "x_at_s1": { + "tokens": 74, + "ordered_topk_exact_tokens": 21, + "set_exact_tokens": 33, + "mean_set_jaccard": 0.8220720720720722, + "mean_token_weighted_tv": 0.0374704195765426, + "aggregate_load_tv": 0.06081081081081081 + }, + "period_at_s0": { + "tokens": 74, + "ordered_topk_exact_tokens": 22, + "set_exact_tokens": 34, + "mean_set_jaccard": 0.8172458172458174, + "mean_token_weighted_tv": 0.037857687641942014, + "aggregate_load_tv": 0.05855855855855854 + }, + "period_at_s1": { + "tokens": 74, + "ordered_topk_exact_tokens": 20, + "set_exact_tokens": 31, + "mean_set_jaccard": 0.8172458172458174, + "mean_token_weighted_tv": 0.03775656364254049, + "aggregate_load_tv": 0.06981981981981983 + } + } + }, + "layer_17": { + "layer": 17, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "921e12fba0d9d906b92418b74ecfc072a4c0f9909e8ca140e38e1694bdcb453e", + "route_weight_sha256": "20b97ba847664abd1be1ed386f914939bf86fc069ae94f11aac7385bb50943cb", + "loads": [ + 3, + 4, + 1, + 13, + 7, + 7, + 2, + 3, + 10, + 18, + 4, + 1, + 7, + 13, + 13, + 5, + 8, + 5, + 7, + 0, + 1, + 2, + 5, + 7, + 0, + 13, + 7, + 7, + 3, + 1, + 13, + 8, + 0, + 12, + 15, + 23, + 2, + 7, + 4, + 13, + 4, + 4, + 5, + 7, + 4, + 6, + 13, + 10, + 21, + 5, + 0, + 8, + 8, + 8, + 10, + 8, + 3, + 0, + 10, + 12, + 8, + 1, + 4, + 11 + ], + "weighted_loads": [ + 0.11159927770495415, + 0.13734700717031956, + 0.03508244454860687, + 1.0534964296966791, + 0.720984123647213, + 0.3206662442535162, + 0.067034175619483, + 0.17204424366354942, + 0.5339438803493977, + 1.0779974311590195, + 0.16028020158410072, + 0.03708432987332344, + 0.2717458885163069, + 0.8086952548474073, + 0.6087148077785969, + 0.21700410917401314, + 0.3900403566658497, + 0.18949727341532707, + 1.2863745987415314, + 0.0, + 0.07347514480352402, + 0.07252438366413116, + 0.34772999584674835, + 0.7742893807590008, + 0.0, + 0.8120993003249168, + 0.25134821236133575, + 0.30902935937047005, + 0.11427008733153343, + 0.0331941582262516, + 0.8292129617184401, + 0.9080220013856888, + 0.0, + 0.9342411030083895, + 0.9173873644322157, + 3.258661162108183, + 0.07036504335701466, + 0.2680623512715101, + 0.5894147232174873, + 1.0169080570340157, + 0.164988212287426, + 0.17880591936409473, + 0.36061137169599533, + 0.3048463836312294, + 0.15814534574747086, + 1.0293378792703152, + 0.5865179896354675, + 0.6254299096763134, + 2.605768436565995, + 0.16320745833218098, + 0.0, + 0.7457840964198112, + 0.47283090837299824, + 0.4192723445594311, + 0.3938545025885105, + 0.5315309315919876, + 0.19586005434393883, + 0.0, + 0.5976522155106068, + 0.45887687616050243, + 0.4408133327960968, + 0.042197324335575104, + 0.208750793710351, + 0.771677527576685 + ], + "unique_experts": 59, + "load_cv": 0.7309521515151052, + "normalized_load_entropy": 0.931541731001594, + "max_load_share": 0.0518018018018018 + }, + "full_input": { + "tokens": 99, + "top_k": 6, + "decisions": 594, + "ordered_route_sha256": "b4c00239d7f1da816267a379df198a15349ac4718f1898d08a91f49228d78720", + "route_weight_sha256": "18afd14d1ecc6d903e1a28898c04dbdb0041aa774c161b1994756b1b661ffa30", + "loads": [ + 11, + 5, + 3, + 20, + 7, + 7, + 4, + 3, + 11, + 22, + 12, + 2, + 9, + 21, + 13, + 9, + 8, + 12, + 9, + 0, + 4, + 2, + 5, + 14, + 6, + 20, + 16, + 10, + 7, + 2, + 13, + 8, + 9, + 13, + 15, + 23, + 2, + 7, + 9, + 13, + 11, + 9, + 7, + 9, + 4, + 10, + 13, + 10, + 21, + 5, + 1, + 8, + 11, + 8, + 10, + 13, + 3, + 2, + 10, + 12, + 8, + 3, + 9, + 11 + ], + "weighted_loads": [ + 0.38137001264840364, + 0.1734968964010477, + 0.13012030348181725, + 1.6445102710276842, + 0.720984123647213, + 0.3206662442535162, + 0.16356202401220798, + 0.17204424366354942, + 0.5930126346647739, + 1.223903976380825, + 0.6289341039955616, + 0.055639490485191345, + 0.33571508899331093, + 1.4018943477422, + 0.6087148077785969, + 0.4904104098677635, + 0.3900403566658497, + 0.858774408698082, + 1.3389022294431925, + 0.0, + 0.3676205202937126, + 0.07252438366413116, + 0.34772999584674835, + 1.098042644560337, + 0.47710686922073364, + 1.3498798459768295, + 1.8676163665950298, + 0.4559711068868637, + 0.26755772717297077, + 0.038527342956513166, + 0.8292129617184401, + 0.9080220013856888, + 0.35718466993421316, + 1.0356130097061396, + 0.9173873644322157, + 3.258661162108183, + 0.07036504335701466, + 0.2680623512715101, + 0.8312476668506861, + 1.0169080570340157, + 1.2379414960741997, + 0.3510748934932053, + 0.5017903856933117, + 0.32693258626386523, + 0.15814534574747086, + 1.9100193046033382, + 0.5865179896354675, + 0.6254299096763134, + 2.605768436565995, + 0.16320745833218098, + 0.0660620704293251, + 0.7457840964198112, + 0.6908863745629787, + 0.4192723445594311, + 0.3938545025885105, + 0.8057937994599342, + 0.19586005434393883, + 0.11141287535429001, + 0.5976522155106068, + 0.45887687616050243, + 0.4408133327960968, + 0.1498187780380249, + 0.6517759878188372, + 0.771677527576685 + ], + "unique_experts": 63, + "load_cv": 0.5775465934163247, + "normalized_load_entropy": 0.9579088084002936, + "max_load_share": 0.03872053872053872 + } + }, + "s1_eos": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "09928fbc533053060778d4d2737e28c209f69df9f08da67528da851d0ec8db42", + "route_weight_sha256": "6233c264f64bc2eaf669e1a82dce96088720c216f647d7f479378615ded5aa3c", + "loads": [ + 3, + 6, + 0, + 13, + 7, + 8, + 2, + 3, + 9, + 18, + 4, + 3, + 5, + 12, + 13, + 2, + 8, + 5, + 8, + 0, + 2, + 2, + 5, + 7, + 0, + 13, + 3, + 6, + 3, + 1, + 12, + 8, + 1, + 12, + 14, + 23, + 3, + 8, + 5, + 13, + 3, + 3, + 5, + 7, + 4, + 7, + 12, + 11, + 21, + 7, + 0, + 8, + 10, + 7, + 8, + 8, + 3, + 0, + 10, + 11, + 9, + 1, + 4, + 15 + ], + "weighted_loads": [ + 0.10770544782280922, + 0.20705246552824974, + 0.0, + 1.0800593048334122, + 0.7202514819800854, + 0.3365633748471737, + 0.06267241947352886, + 0.1790853589773178, + 0.504060260951519, + 1.0880830772221088, + 0.15727771259844303, + 0.10195198282599449, + 0.1889475341886282, + 0.782405573874712, + 0.6206205636262894, + 0.10763899236917496, + 0.38418084755539894, + 0.19608661346137524, + 1.3428910467773676, + 0.0, + 0.09754768386483192, + 0.06907487660646439, + 0.3520786575973034, + 0.7659459058195353, + 0.0, + 0.8267696499824524, + 0.15090341679751873, + 0.2627962492406368, + 0.116579819470644, + 0.03505788743495941, + 0.7848062664270401, + 0.8644231520593166, + 0.039388258010149, + 0.9442189000546932, + 0.8958946503698826, + 3.2164496183395386, + 0.11009186878800392, + 0.31400361843407154, + 0.6077932473272085, + 1.0270941257476807, + 0.12935921922326088, + 0.1536145880818367, + 0.3715493902564049, + 0.3056521285325289, + 0.1588810309767723, + 1.0729540642350912, + 0.5746158920228481, + 0.6645167097449303, + 2.5483521427959204, + 0.20728135854005814, + 0.0, + 0.720563504844904, + 0.5618648417294025, + 0.39714919216930866, + 0.3101235646754503, + 0.5284629538655281, + 0.21042563766241074, + 0.0, + 0.6045082919299603, + 0.41684860922396183, + 0.46950197219848633, + 0.040912166237831116, + 0.206713842228055, + 0.9060978293418884 + ], + "unique_experts": 59, + "load_cv": 0.730063320480745, + "normalized_load_entropy": 0.9322817779221005, + "max_load_share": 0.0518018018018018 + }, + "full_input": { + "tokens": 115, + "top_k": 6, + "decisions": 690, + "ordered_route_sha256": "a7034fd1e75458a3e7bdb32e49f261e110b4507df36f45b8e890bcdc6e085a64", + "route_weight_sha256": "17fb68f88504e9995fdd6f22125fd1c99f3f6c1f2b1ec240f0440b748618c379", + "loads": [ + 11, + 7, + 2, + 19, + 13, + 8, + 5, + 4, + 10, + 23, + 12, + 5, + 5, + 20, + 13, + 10, + 10, + 11, + 10, + 0, + 3, + 3, + 5, + 19, + 10, + 33, + 14, + 9, + 4, + 3, + 13, + 9, + 8, + 13, + 14, + 23, + 8, + 10, + 9, + 14, + 15, + 10, + 8, + 8, + 6, + 12, + 14, + 13, + 21, + 8, + 1, + 14, + 15, + 7, + 9, + 17, + 10, + 11, + 11, + 13, + 10, + 7, + 13, + 15 + ], + "weighted_loads": [ + 0.4279595576226711, + 0.2491496466100216, + 0.07693642936646938, + 1.7075358889997005, + 1.1217492036521435, + 0.3365633748471737, + 0.18140840157866478, + 0.23523062467575073, + 0.5581858828663826, + 1.246313188225031, + 0.6920553706586361, + 0.1695246919989586, + 0.1889475341886282, + 1.4000465869903564, + 0.6206205636262894, + 0.5840848907828331, + 0.5555473454296589, + 0.7729813288897276, + 1.4096495918929577, + 0.0, + 0.16544407978653908, + 0.14494070410728455, + 0.3520786575973034, + 1.5539260860532522, + 0.6067042120266706, + 2.3227834589779377, + 1.8864489886909723, + 0.3941779173910618, + 0.16902554035186768, + 0.11255093570798635, + 0.844975546002388, + 0.9038698673248291, + 0.287875912617892, + 1.0447827465832233, + 0.8958946503698826, + 3.2164496183395386, + 0.3704214170575142, + 0.38680942356586456, + 0.9733652044087648, + 1.0607787035405636, + 1.8978538736701012, + 0.5495625678449869, + 0.5016411207616329, + 0.3245063666254282, + 0.4000950716435909, + 2.389867065474391, + 0.789139274507761, + 0.7967261523008347, + 2.5483521427959204, + 0.24239590391516685, + 0.13530679047107697, + 1.012835182249546, + 0.8768632616847754, + 0.39714919216930866, + 0.39645216800272465, + 1.0550236217677593, + 0.8271123170852661, + 0.5909160412847996, + 0.6278918534517288, + 0.5056767221540213, + 0.5015180446207523, + 0.38162535801529884, + 0.9777240809053183, + 0.9060978293418884 + ], + "unique_experts": 63, + "load_cv": 0.5344584854933225, + "normalized_load_entropy": 0.9650484915085479, + "max_load_share": 0.04782608695652174 + } + }, + "s0_bos": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "e003832a6b85567def1941b93eae7882c2bf7023f893fae2a39f83e23150ec9c", + "route_weight_sha256": "15cd0a45a1bd6c1a3490c8fa1902fd54d11fc2cebb76deb47ea8d129c81c46ca", + "loads": [ + 4, + 5, + 0, + 13, + 8, + 9, + 1, + 3, + 10, + 15, + 5, + 1, + 5, + 13, + 11, + 6, + 9, + 4, + 7, + 0, + 2, + 2, + 5, + 8, + 0, + 15, + 4, + 6, + 3, + 0, + 13, + 8, + 1, + 11, + 13, + 24, + 4, + 6, + 3, + 13, + 3, + 3, + 5, + 9, + 6, + 5, + 10, + 11, + 23, + 7, + 0, + 8, + 8, + 7, + 10, + 8, + 4, + 0, + 10, + 15, + 8, + 1, + 4, + 9 + ], + "weighted_loads": [ + 0.1260352935642004, + 0.17307824455201626, + 0.0, + 1.0257684979587793, + 0.7810567766427994, + 0.37863793037831783, + 0.032643117010593414, + 0.1664450354874134, + 0.5491934157907963, + 1.0416806507855654, + 0.20213899947702885, + 0.04496697708964348, + 0.19462371990084648, + 0.8071817923337221, + 0.5160568915307522, + 0.24709316529333591, + 0.44562237337231636, + 0.15979108959436417, + 1.3464147113263607, + 0.0, + 0.1132175475358963, + 0.07079514116048813, + 0.34161583706736565, + 0.7761034015566111, + 0.0, + 0.8621298465877771, + 0.18731580674648285, + 0.23938717879354954, + 0.10569137707352638, + 0.0, + 0.8432836253196001, + 0.9042114317417145, + 0.0384480357170105, + 0.9162420220673084, + 0.8943014368414879, + 3.306100621819496, + 0.13878783769905567, + 0.24684119038283825, + 0.533856712281704, + 0.9845972526818514, + 0.12261230871081352, + 0.13019168376922607, + 0.374965064227581, + 0.37428078427910805, + 0.22128473035991192, + 0.9864705353975296, + 0.5028293244540691, + 0.6696448959410191, + 2.6848949063569307, + 0.21962003968656063, + 0.0, + 0.7673691511154175, + 0.47087898664176464, + 0.3847583457827568, + 0.36574955470860004, + 0.5249550342559814, + 0.24671757593750954, + 0.0, + 0.5983732603490353, + 0.5632038693875074, + 0.42757401801645756, + 0.043839555233716965, + 0.20814454555511475, + 0.6862994059920311 + ], + "unique_experts": 58, + "load_cv": 0.7371439608766356, + "normalized_load_entropy": 0.930450247811888, + "max_load_share": 0.05405405405405406 + }, + "full_input": { + "tokens": 99, + "top_k": 6, + "decisions": 594, + "ordered_route_sha256": "54af729cce7a2c079dbf3f7cc41d9aa8ffcb2e2510beb82fe63d261a4ad35615", + "route_weight_sha256": "12f45ce48800e061e35cdebe57d3190c8c05a4b0f17622635f76c5b6e33c081a", + "loads": [ + 10, + 7, + 1, + 20, + 8, + 9, + 3, + 3, + 11, + 19, + 13, + 2, + 9, + 21, + 11, + 10, + 9, + 11, + 9, + 1, + 5, + 2, + 5, + 15, + 5, + 22, + 12, + 8, + 7, + 0, + 13, + 8, + 9, + 12, + 13, + 24, + 4, + 6, + 8, + 13, + 11, + 7, + 7, + 10, + 6, + 9, + 10, + 11, + 23, + 8, + 2, + 8, + 10, + 8, + 10, + 13, + 4, + 3, + 10, + 16, + 8, + 3, + 10, + 9 + ], + "weighted_loads": [ + 0.36030582897365093, + 0.258491026237607, + 0.053010616451501846, + 1.6167823392897844, + 0.7810567766427994, + 0.37863793037831783, + 0.1291709654033184, + 0.1664450354874134, + 0.6178164668381214, + 1.187587196007371, + 0.6710419338196516, + 0.06352213770151138, + 0.45390655659139156, + 1.4003808852285147, + 0.5160568915307522, + 0.5606546234339476, + 0.44562237337231636, + 0.8290682248771191, + 1.3989423420280218, + 0.055849697440862656, + 0.4210209846496582, + 0.07079514116048813, + 0.34161583706736565, + 1.1054495815187693, + 0.4208931028842926, + 1.376443961635232, + 0.8887753523886204, + 0.33430942334234715, + 0.25494244508445263, + 0.0, + 0.8432836253196001, + 0.9042114317417145, + 0.37808078713715076, + 1.0130422972142696, + 0.8943014368414879, + 3.306100621819496, + 0.13878783769905567, + 0.24684119038283825, + 0.7744780648499727, + 0.9845972526818514, + 1.2176965959370136, + 0.2782223094254732, + 0.5171969160437584, + 0.39313502237200737, + 0.22128473035991192, + 1.8051561564207077, + 0.5028293244540691, + 0.6696448959410191, + 2.6848949063569307, + 0.4048834200948477, + 0.11286114156246185, + 0.7673691511154175, + 0.6644069757312536, + 0.43580083921551704, + 0.36574955470860004, + 0.8034600932151079, + 0.24671757593750954, + 0.13096447847783566, + 0.5983732603490353, + 0.6076892074197531, + 0.42757401801645756, + 0.15335630998015404, + 0.7728266566991806, + 0.6862994059920311 + ], + "unique_experts": 63, + "load_cv": 0.5715482017025048, + "normalized_load_entropy": 0.9594152427081208, + "max_load_share": 0.04040404040404041 + } + }, + "s1_bos": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "b818209f2cf20e43fef345d3aa2e88991a1f81c6a28eddc8d7a725c2ac25bc3f", + "route_weight_sha256": "48ec84325c8e557dd0aedcacaf89ae3db24ff9322b70c4e8db4c2f35adb8fbab", + "loads": [ + 3, + 7, + 0, + 13, + 8, + 7, + 0, + 3, + 11, + 15, + 6, + 2, + 6, + 13, + 11, + 4, + 9, + 5, + 7, + 0, + 2, + 2, + 5, + 8, + 0, + 13, + 6, + 7, + 2, + 0, + 13, + 8, + 0, + 12, + 14, + 23, + 6, + 6, + 4, + 13, + 3, + 3, + 5, + 7, + 5, + 7, + 10, + 11, + 23, + 5, + 1, + 8, + 8, + 5, + 9, + 8, + 3, + 0, + 10, + 11, + 8, + 1, + 5, + 14 + ], + "weighted_loads": [ + 0.09653589315712452, + 0.2362483385950327, + 0.0, + 1.0497376136481762, + 0.7671235203742981, + 0.3204367719590664, + 0.0, + 0.16792565770447254, + 0.5760450679808855, + 1.0006269458681345, + 0.22944986633956432, + 0.07522601634263992, + 0.23592402786016464, + 0.8043777160346508, + 0.5569695122539997, + 0.18197831511497498, + 0.4437120668590069, + 0.18677395023405552, + 1.2989373318850994, + 0.0, + 0.10868435353040695, + 0.07759634032845497, + 0.34837767109274864, + 0.8163620978593826, + 0.0, + 0.7961949575692415, + 0.2630455195903778, + 0.2525255624204874, + 0.07427006587386131, + 0.0, + 0.8317722100764513, + 0.8449075780808926, + 0.0, + 0.942423252388835, + 0.9152384605258703, + 3.2465195767581463, + 0.21637026593089104, + 0.2507122438400984, + 0.5602388586848974, + 1.0144344791769981, + 0.12206241488456726, + 0.13509630039334297, + 0.38798799365758896, + 0.30870272405445576, + 0.20553093776106834, + 1.1041109152138233, + 0.4911783840507269, + 0.669187530875206, + 2.6596565656363964, + 0.17120184935629368, + 0.029236622154712677, + 0.7301884144544601, + 0.48375649750232697, + 0.3077714294195175, + 0.3389676082879305, + 0.518415454775095, + 0.20806105807423592, + 0.0, + 0.6017043814063072, + 0.4373565688729286, + 0.4220654424279928, + 0.04246749356389046, + 0.228252237662673, + 0.8205993063747883 + ], + "unique_experts": 57, + "load_cv": 0.7256028338184867, + "normalized_load_entropy": 0.9308061037978904, + "max_load_share": 0.0518018018018018 + }, + "full_input": { + "tokens": 115, + "top_k": 6, + "decisions": 690, + "ordered_route_sha256": "7d2137170d188ba6ccd96b344bf5a482162f72bc8419c649e8e3c720c200c95a", + "route_weight_sha256": "166304c9697950218762c07cab1a2d2291fa0b2d33444dd8df45ccf0d2ca4b8d", + "loads": [ + 8, + 10, + 1, + 19, + 14, + 7, + 3, + 4, + 12, + 21, + 14, + 4, + 8, + 21, + 11, + 12, + 11, + 11, + 9, + 0, + 3, + 3, + 5, + 20, + 9, + 33, + 17, + 10, + 3, + 1, + 14, + 9, + 6, + 13, + 14, + 23, + 11, + 8, + 8, + 14, + 16, + 9, + 9, + 8, + 7, + 12, + 12, + 13, + 23, + 6, + 4, + 14, + 12, + 5, + 10, + 16, + 10, + 12, + 11, + 13, + 9, + 6, + 15, + 14 + ], + "weighted_loads": [ + 0.3061272148042917, + 0.3820032011717558, + 0.04773971810936928, + 1.6772141978144646, + 1.1686212420463562, + 0.3204367719590664, + 0.11873598210513592, + 0.22407092340290546, + 0.6374656427651644, + 1.2185502108186483, + 0.7620890140533447, + 0.14279872551560402, + 0.3326978199183941, + 1.4220187291502953, + 0.5569695122539997, + 0.7033394575119019, + 0.6150785647332668, + 0.7636686656624079, + 1.3656958770006895, + 0.0, + 0.20600230991840363, + 0.15346216782927513, + 0.34837767109274864, + 1.610775526612997, + 0.5725140944123268, + 2.267781740054488, + 1.130186289548874, + 0.3763584177941084, + 0.11474701017141342, + 0.07225511223077774, + 0.8919414896517992, + 0.884354293346405, + 0.22944957204163074, + 1.0225925203412771, + 0.9152384605258703, + 3.2465195767581463, + 0.4766998142004013, + 0.3235180489718914, + 0.9191287849098444, + 1.048119056969881, + 1.894071038812399, + 0.5270570367574692, + 0.5587490014731884, + 0.3275569621473551, + 0.44674497842788696, + 2.577326525002718, + 0.7057017665356398, + 0.8013969734311104, + 2.6596565656363964, + 0.21390373073518276, + 0.27447791397571564, + 1.0224600918591022, + 0.771441638469696, + 0.3077714294195175, + 0.4252962116152048, + 1.01347522623837, + 0.8247477374970913, + 0.6100928317755461, + 0.6250879429280758, + 0.526184681802988, + 0.4540815148502588, + 0.3295998349785805, + 1.1213903333991766, + 0.8205993063747883 + ], + "unique_experts": 63, + "load_cv": 0.55275749905544, + "normalized_load_entropy": 0.9620286212289088, + "max_load_share": 0.04782608695652174 + } + }, + "s0_x": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "7e3d9a71c1f96d4e1016e76ca58ff7e492fca46e88201c86ff539123ccd31b3c", + "route_weight_sha256": "8c116835d2679bb9728015bbac2c68f230225e9ef821ef58f79452ea012bf74d", + "loads": [ + 3, + 3, + 0, + 13, + 8, + 11, + 2, + 3, + 11, + 14, + 4, + 1, + 7, + 13, + 10, + 5, + 8, + 4, + 7, + 0, + 2, + 2, + 5, + 8, + 0, + 13, + 5, + 8, + 2, + 0, + 12, + 8, + 1, + 12, + 14, + 23, + 6, + 8, + 3, + 13, + 3, + 3, + 5, + 7, + 4, + 8, + 12, + 11, + 23, + 7, + 0, + 8, + 11, + 6, + 9, + 8, + 3, + 0, + 9, + 11, + 9, + 1, + 4, + 10 + ], + "weighted_loads": [ + 0.11065045185387135, + 0.10657165572047234, + 0.0, + 1.011251013725996, + 0.7778969965875149, + 0.44828846864402294, + 0.06283128820359707, + 0.16776467114686966, + 0.5764676444232464, + 0.9376485086977482, + 0.16206335090100765, + 0.04595775157213211, + 0.2709754668176174, + 0.8130990546196699, + 0.5175230354070663, + 0.19591413624584675, + 0.3954261615872383, + 0.17223839461803436, + 1.3263247646391392, + 0.0, + 0.10126354545354843, + 0.06828932836651802, + 0.3234056942164898, + 0.7784893438220024, + 0.0, + 0.8171839639544487, + 0.21680947951972485, + 0.3205536026507616, + 0.07282636687159538, + 0.0, + 0.7946840692311525, + 0.919950895011425, + 0.025592930614948273, + 0.9663388859480619, + 0.9111281223595142, + 3.2094861567020416, + 0.20714988186955452, + 0.32960951142013073, + 0.5114899352192879, + 1.0070176105946302, + 0.13667388632893562, + 0.13463733345270157, + 0.3885525166988373, + 0.2978110257536173, + 0.17261429876089096, + 1.0426480323076248, + 0.5628065578639507, + 0.6672925427556038, + 2.733406299725175, + 0.20512212067842484, + 0.0, + 0.7525961026549339, + 0.5931975096464157, + 0.3565668761730194, + 0.3690226450562477, + 0.5331150032579899, + 0.21097787469625473, + 0.0, + 0.5440808273851871, + 0.46939455531537533, + 0.46219375543296337, + 0.04764123260974884, + 0.20169592835009098, + 0.7624272629618645 + ], + "unique_experts": 58, + "load_cv": 0.7242593310449184, + "normalized_load_entropy": 0.9312709471820622, + "max_load_share": 0.0518018018018018 + }, + "full_input": { + "tokens": 99, + "top_k": 6, + "decisions": 594, + "ordered_route_sha256": "7ea8531e04b9b10d6bc12d62133fa859eb3a3e19780fffc00d3e169d94460d48", + "route_weight_sha256": "9ebd9330d4e7caa4bd3a40bcc8457b01cde586a021f2cf914b568f11d0c8d723", + "loads": [ + 9, + 4, + 3, + 21, + 8, + 11, + 4, + 3, + 12, + 19, + 13, + 2, + 9, + 22, + 10, + 8, + 8, + 12, + 9, + 0, + 4, + 2, + 5, + 15, + 5, + 21, + 12, + 10, + 7, + 0, + 12, + 8, + 9, + 13, + 14, + 23, + 6, + 8, + 9, + 13, + 10, + 7, + 7, + 8, + 4, + 12, + 12, + 11, + 24, + 7, + 2, + 8, + 13, + 6, + 9, + 14, + 3, + 3, + 9, + 11, + 9, + 3, + 9, + 10 + ], + "weighted_loads": [ + 0.32540189288556576, + 0.14272154495120049, + 0.1285305805504322, + 1.7540779896080494, + 0.7778969965875149, + 0.44828846864402294, + 0.15935913659632206, + 0.16776467114686966, + 0.6335616372525692, + 1.129081666469574, + 0.7931990642100573, + 0.06451291218400002, + 0.33494466729462147, + 1.4443784188479185, + 0.5175230354070663, + 0.4206497725099325, + 0.3954261615872383, + 0.8873843029141426, + 1.3788523953408003, + 0.0, + 0.31100600957870483, + 0.06828932836651802, + 0.3234056942164898, + 1.108675979077816, + 0.4420233964920044, + 1.4385424442589283, + 0.8298968318849802, + 0.4154758471995592, + 0.2648497689515352, + 0.0, + 0.7946840692311525, + 0.919950895011425, + 0.3799529355019331, + 1.0635905917733908, + 0.9111281223595142, + 3.2094861567020416, + 0.20714988186955452, + 0.32960951142013073, + 0.7774161230772734, + 1.0070176105946302, + 1.1926664039492607, + 0.3107395488768816, + 0.53101971372962, + 0.3166652638465166, + 0.17261429876089096, + 1.8902528584003448, + 0.5628065578639507, + 0.6672925427556038, + 2.7740850429981947, + 0.20512212067842484, + 0.1303686872124672, + 0.7525961026549339, + 0.7919353619217873, + 0.3565668761730194, + 0.3690226450562477, + 0.8597294837236404, + 0.21097787469625473, + 0.14697211235761642, + 0.5440808273851871, + 0.46939455531537533, + 0.46219375543296337, + 0.17125392705202103, + 0.6629316378384829, + 0.7624272629618645 + ], + "unique_experts": 62, + "load_cv": 0.5800536748915526, + "normalized_load_entropy": 0.9578445908716522, + "max_load_share": 0.04040404040404041 + } + }, + "s1_x": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "974bc6367621aee473ff4fa36f4da821cacc8dc562481f5dd24810a12850abdc", + "route_weight_sha256": "162319d6e8c27dc7df8bda24be59d26963ce225f8544aed122a78a9fa53b9679", + "loads": [ + 4, + 5, + 0, + 14, + 8, + 9, + 2, + 3, + 9, + 14, + 4, + 3, + 7, + 13, + 12, + 2, + 7, + 5, + 8, + 0, + 2, + 2, + 5, + 8, + 0, + 14, + 5, + 8, + 2, + 0, + 13, + 8, + 1, + 10, + 15, + 23, + 7, + 8, + 3, + 13, + 4, + 5, + 5, + 8, + 5, + 7, + 9, + 11, + 22, + 3, + 0, + 8, + 10, + 6, + 10, + 8, + 3, + 0, + 9, + 10, + 9, + 1, + 4, + 11 + ], + "weighted_loads": [ + 0.14147811755537987, + 0.17887642979621887, + 0.0, + 1.0735231414437294, + 0.7750520519912243, + 0.3854034040123224, + 0.05934844724833965, + 0.1707589291036129, + 0.5277008526027203, + 0.9367239847779274, + 0.15880942717194557, + 0.11970961466431618, + 0.2805951591581106, + 0.7937415279448032, + 0.6374365203082561, + 0.08576769195497036, + 0.3734506815671921, + 0.1894026268273592, + 1.4264323934912682, + 0.0, + 0.10327302664518356, + 0.07054441422224045, + 0.3405817784368992, + 0.8041481953114271, + 0.0, + 0.8627384211868048, + 0.2358073554933071, + 0.29388536140322685, + 0.07613073289394379, + 0.0, + 0.809588398784399, + 0.8369769528508186, + 0.03638927638530731, + 0.8967843726277351, + 0.9511428102850914, + 3.179869305342436, + 0.2731518819928169, + 0.31803951412439346, + 0.5107609704136848, + 1.0419367887079716, + 0.17389093339443207, + 0.21104024909436703, + 0.3837308846414089, + 0.3441942371428013, + 0.19467773661017418, + 1.0791187603026628, + 0.4389417748898268, + 0.6735247746109962, + 2.6250273901969194, + 0.12347836047410965, + 0.0, + 0.7290322966873646, + 0.5660374518483877, + 0.34167706966400146, + 0.38640438579022884, + 0.4954693466424942, + 0.21400213986635208, + 0.0, + 0.5475012995302677, + 0.4003433082252741, + 0.44858348928391933, + 0.04775752127170563, + 0.22375807911157608, + 0.7448351290076971 + ], + "unique_experts": 58, + "load_cv": 0.7111412926798517, + "normalized_load_entropy": 0.9339089268990908, + "max_load_share": 0.0518018018018018 + }, + "full_input": { + "tokens": 115, + "top_k": 6, + "decisions": 690, + "ordered_route_sha256": "41c82857c04c0b149eb12263ad1f1e66224456b4f308b3bcf2a1088c0556c398", + "route_weight_sha256": "2edd01129903680014171c36327c2855dc9d86f1263a29e89f0b87f1b7f0ea41", + "loads": [ + 9, + 6, + 3, + 21, + 14, + 9, + 5, + 4, + 10, + 20, + 14, + 5, + 7, + 22, + 12, + 9, + 9, + 12, + 11, + 0, + 2, + 3, + 5, + 21, + 9, + 35, + 14, + 10, + 2, + 1, + 14, + 9, + 7, + 11, + 15, + 23, + 12, + 10, + 7, + 14, + 16, + 11, + 9, + 9, + 7, + 12, + 11, + 13, + 23, + 3, + 2, + 14, + 14, + 6, + 11, + 16, + 10, + 12, + 11, + 12, + 10, + 8, + 13, + 11 + ], + "weighted_loads": [ + 0.3510694392025471, + 0.22097361087799072, + 0.14466344192624092, + 1.8625469245016575, + 1.1765497736632824, + 0.3854034040123224, + 0.17808442935347557, + 0.22690419480204582, + 0.5923139788210392, + 1.131112765520811, + 0.8881776947528124, + 0.18728232383728027, + 0.2805951591581106, + 1.4710926115512848, + 0.6374365203082561, + 0.5053800735622644, + 0.544817179441452, + 0.8165401127189398, + 1.5319304410368204, + 0.0, + 0.10327302664518356, + 0.1464102417230606, + 0.3405817784368992, + 1.6143044587224722, + 0.5929765328764915, + 2.4165783021599054, + 0.95971386320889, + 0.3699444495141506, + 0.07613073289394379, + 0.07225511223077774, + 0.8697576783597469, + 0.8764236681163311, + 0.2968583572655916, + 1.0008529052138329, + 0.9511428102850914, + 3.179869305342436, + 0.5334814302623272, + 0.3908453192561865, + 0.8625771924853325, + 1.0756213665008545, + 1.8993614427745342, + 0.5721128191798925, + 0.5478145256638527, + 0.3630484752357006, + 0.4358917772769928, + 2.3073375318199396, + 0.6534651573747396, + 0.8057342171669006, + 2.6652707252651453, + 0.12347836047410965, + 0.22332237660884857, + 1.0213039740920067, + 0.857554828748107, + 0.34167706966400146, + 0.47273298911750317, + 1.0150703191757202, + 0.8306888192892075, + 0.6368544884026051, + 0.6213460862636566, + 0.4891714211553335, + 0.48059956170618534, + 0.4205733947455883, + 0.9418761283159256, + 0.7448351290076971 + ], + "unique_experts": 63, + "load_cv": 0.5654997436713987, + "normalized_load_entropy": 0.9610871812933155, + "max_load_share": 0.050724637681159424 + } + }, + "s0_period": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "810ffa8360c5a0aae6c5c56bb256b3c2b1a0b6bf96283250260ba2424b6cffa1", + "route_weight_sha256": "a86a7b4b696738b494e548f5253f9b8b5c4f93f0829e6478adbbc717afdfb152", + "loads": [ + 4, + 4, + 1, + 13, + 8, + 8, + 2, + 3, + 8, + 16, + 4, + 2, + 6, + 13, + 11, + 5, + 7, + 4, + 8, + 0, + 2, + 2, + 5, + 7, + 0, + 13, + 5, + 7, + 2, + 0, + 13, + 8, + 0, + 11, + 14, + 23, + 7, + 8, + 3, + 14, + 4, + 3, + 6, + 7, + 4, + 7, + 11, + 11, + 23, + 4, + 0, + 8, + 11, + 6, + 11, + 8, + 4, + 0, + 9, + 13, + 7, + 1, + 4, + 11 + ], + "weighted_loads": [ + 0.13673586770892143, + 0.13124271295964718, + 0.021379007026553154, + 0.9969821609556675, + 0.7851714268326759, + 0.3664945997297764, + 0.06296660006046295, + 0.16426196694374084, + 0.47992172464728355, + 1.0181838013231754, + 0.16270996443927288, + 0.07758943364024162, + 0.22943143174052238, + 0.8016373608261347, + 0.5636676214635372, + 0.20261629484593868, + 0.36114196479320526, + 0.16566390171647072, + 1.3127928785979748, + 0.0, + 0.10013265535235405, + 0.070632828399539, + 0.3279616944491863, + 0.7606816850602627, + 0.0, + 0.8143965378403664, + 0.21430813521146774, + 0.30152754858136177, + 0.07185690477490425, + 0.0, + 0.8414464145898819, + 0.9173495545983315, + 0.0, + 0.9180972743779421, + 0.9079370591789484, + 3.2391169741749763, + 0.24699103832244873, + 0.3203574735671282, + 0.49407242238521576, + 1.0582494959235191, + 0.17547592148184776, + 0.1346082091331482, + 0.41668426990509033, + 0.29465791396796703, + 0.16616005450487137, + 1.0346485786139965, + 0.5171775631606579, + 0.661362785845995, + 2.723761284723878, + 0.1366978958249092, + 0.0, + 0.7536628507077694, + 0.5855882503092289, + 0.34430286288261414, + 0.4041194785386324, + 0.5362026244401932, + 0.24134371802210808, + 0.0, + 0.5569681897759438, + 0.5128856468945742, + 0.4169643074274063, + 0.04541497305035591, + 0.2083234153687954, + 0.7815497778356075 + ], + "unique_experts": 58, + "load_cv": 0.7273903107904307, + "normalized_load_entropy": 0.9322122430226667, + "max_load_share": 0.0518018018018018 + }, + "full_input": { + "tokens": 99, + "top_k": 6, + "decisions": 594, + "ordered_route_sha256": "5591736b3a0e9b337219577bf09bdb7b130939ee1833f9c654e73702776f40d7", + "route_weight_sha256": "88a854603e7e10b8f20a3076b6fe691a5f5194c9bc3d6cec6ddb4ff0c8196f18", + "loads": [ + 10, + 5, + 5, + 21, + 8, + 8, + 4, + 3, + 9, + 20, + 12, + 3, + 8, + 21, + 11, + 8, + 7, + 11, + 10, + 0, + 6, + 2, + 5, + 13, + 5, + 21, + 12, + 10, + 6, + 0, + 13, + 8, + 8, + 12, + 14, + 23, + 7, + 8, + 9, + 14, + 11, + 7, + 9, + 8, + 4, + 11, + 11, + 11, + 23, + 4, + 2, + 8, + 13, + 6, + 11, + 15, + 4, + 4, + 9, + 13, + 7, + 3, + 9, + 11 + ], + "weighted_loads": [ + 0.3617381118237972, + 0.16739260219037533, + 0.2058494482189417, + 1.633861169219017, + 0.7851714268326759, + 0.3664945997297764, + 0.15949444845318794, + 0.16426196694374084, + 0.5416793338954449, + 1.164090346544981, + 0.644117483869195, + 0.09614459425210953, + 0.29340063221752644, + 1.3948364537209272, + 0.5636676214635372, + 0.43973311223089695, + 0.36114196479320526, + 0.8349410369992256, + 1.3653205092996359, + 0.0, + 0.396465927362442, + 0.070632828399539, + 0.3279616944491863, + 1.0332929380238056, + 0.44058407843112946, + 1.4011251255869865, + 0.8244276307523251, + 0.4338012561202049, + 0.2221581619232893, + 0.0, + 0.8414464145898819, + 0.9173495545983315, + 0.35856723226606846, + 1.016602212563157, + 0.9079370591789484, + 3.2391169741749763, + 0.24699103832244873, + 0.3203574735671282, + 0.764591921120882, + 1.0582494959235191, + 1.2110779583454132, + 0.3204511497169733, + 0.607087280601263, + 0.31351215206086636, + 0.16616005450487137, + 1.9831435047090054, + 0.5171775631606579, + 0.661362785845995, + 2.723761284723878, + 0.1366978958249092, + 0.13508857786655426, + 0.7536628507077694, + 0.7851674444973469, + 0.34430286288261414, + 0.4041194785386324, + 1.025919608771801, + 0.24134371802210808, + 0.18868989497423172, + 0.5569681897759438, + 0.5128856468945742, + 0.4169643074274063, + 0.17012092471122742, + 0.6923377253115177, + 0.7815497778356075 + ], + "unique_experts": 62, + "load_cv": 0.5651653310301185, + "normalized_load_entropy": 0.9603825472886491, + "max_load_share": 0.03872053872053872 + } + }, + "s1_period": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "30ded3c87b150d6885d6a52de531ecaa110252dac097448ab6ec282c62df443e", + "route_weight_sha256": "28e93b13dde75237485d978cbe2bc23a1791aa39b56742de4df5dfeb4a520dd5", + "loads": [ + 3, + 4, + 0, + 14, + 8, + 9, + 2, + 3, + 9, + 15, + 4, + 1, + 7, + 12, + 10, + 4, + 8, + 5, + 8, + 0, + 1, + 2, + 5, + 8, + 0, + 13, + 4, + 7, + 2, + 0, + 14, + 8, + 0, + 11, + 15, + 23, + 7, + 7, + 3, + 13, + 2, + 4, + 7, + 8, + 5, + 7, + 10, + 11, + 22, + 4, + 0, + 8, + 11, + 7, + 10, + 8, + 3, + 0, + 9, + 13, + 9, + 1, + 4, + 12 + ], + "weighted_loads": [ + 0.11000311002135277, + 0.13484390079975128, + 0.0, + 1.0890920367091894, + 0.796350859105587, + 0.39464364759624004, + 0.05644757114350796, + 0.16903727687895298, + 0.5330324545502663, + 0.9784454256296158, + 0.1542859636247158, + 0.0487319715321064, + 0.2647267319262028, + 0.7715174723416567, + 0.5673433281481266, + 0.1785589586943388, + 0.3840615414083004, + 0.18875977210700512, + 1.348511015996337, + 0.0, + 0.0678819864988327, + 0.0765694621950388, + 0.33480317145586014, + 0.8040218837559223, + 0.0, + 0.8144947160035372, + 0.21633834764361382, + 0.2785860635340214, + 0.07627037912607193, + 0.0, + 0.8469118997454643, + 0.8484422937035561, + 0.0, + 0.9358065724372864, + 0.955308148637414, + 3.1764613166451454, + 0.2889782264828682, + 0.2934410758316517, + 0.5004223957657814, + 1.0548736043274403, + 0.08792486414313316, + 0.17230284959077835, + 0.4789349213242531, + 0.3384758457541466, + 0.20065478794276714, + 1.0767808593809605, + 0.4862528517842293, + 0.6671878360211849, + 2.6354432478547096, + 0.12808740325272083, + 0.0, + 0.7336060851812363, + 0.6027895230799913, + 0.36015618965029716, + 0.37045360170304775, + 0.5045335181057453, + 0.22004227340221405, + 0.0, + 0.5634633805602789, + 0.513596223667264, + 0.4420030824840069, + 0.05081595107913017, + 0.20498491451144218, + 0.7514810282737017 + ], + "unique_experts": 57, + "load_cv": 0.732726579012214, + "normalized_load_entropy": 0.9283247261347878, + "max_load_share": 0.0518018018018018 + }, + "full_input": { + "tokens": 115, + "top_k": 6, + "decisions": 690, + "ordered_route_sha256": "a358d01ad3a353a0848d4b8d3ecbe73e2f8a6c0c303b61ea8ad28e5c9fc5e1fd", + "route_weight_sha256": "97dcbcd22fe4c2ffc0b1be233f9f65d5d48e2a7965398438f9d825d5d90008eb", + "loads": [ + 8, + 5, + 2, + 21, + 14, + 9, + 5, + 4, + 10, + 20, + 13, + 3, + 7, + 20, + 10, + 11, + 10, + 11, + 10, + 0, + 1, + 3, + 5, + 20, + 10, + 35, + 15, + 9, + 3, + 1, + 15, + 9, + 6, + 12, + 15, + 23, + 12, + 9, + 7, + 14, + 15, + 10, + 13, + 9, + 7, + 12, + 12, + 13, + 22, + 4, + 2, + 14, + 15, + 7, + 11, + 18, + 10, + 13, + 10, + 15, + 10, + 7, + 12, + 12 + ], + "weighted_loads": [ + 0.31959443166852, + 0.17694108188152313, + 0.09496230632066727, + 1.76665192656219, + 1.1978485807776451, + 0.39464364759624004, + 0.17518355324864388, + 0.2251825425773859, + 0.5997641235589981, + 1.1366755366325378, + 0.740751950070262, + 0.1163046807050705, + 0.2647267319262028, + 1.3891584854573011, + 0.5673433281481266, + 0.6193112079054117, + 0.5554280392825603, + 0.7656544875353575, + 1.415269561111927, + 0.0, + 0.0678819864988327, + 0.15243528969585896, + 0.33480317145586014, + 1.5784691497683525, + 0.6291292198002338, + 2.3995690438896418, + 1.0147452671080828, + 0.35464515164494514, + 0.10549225099384785, + 0.07225511223077774, + 0.9070811793208122, + 0.8878890089690685, + 0.2701431605964899, + 1.0288021117448807, + 0.955308148637414, + 3.1764613166451454, + 0.5493077747523785, + 0.3662468809634447, + 0.8510873802006245, + 1.0885581821203232, + 1.8091581352055073, + 0.5662651471793652, + 0.7254975661635399, + 0.3573300838470459, + 0.44186882860958576, + 2.4505247212946415, + 0.7007762342691422, + 0.7993972785770893, + 2.6354432478547096, + 0.12808740325272083, + 0.1964518539607525, + 1.0258777625858784, + 0.893308462575078, + 0.36015618965029716, + 0.4567822050303221, + 1.2178704403340816, + 0.8367289528250694, + 0.6959227584302425, + 0.5868469420820475, + 0.6024243365973234, + 0.4740191549062729, + 0.40711936727166176, + 0.8527770712971687, + 0.7514810282737017 + ], + "unique_experts": 63, + "load_cv": 0.5678718789564006, + "normalized_load_entropy": 0.9599066494944123, + "max_load_share": 0.050724637681159424 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 74, + "ordered_topk_exact_tokens": 42, + "set_exact_tokens": 50, + "mean_set_jaccard": 0.8957528957528959, + "mean_token_weighted_tv": 0.01973905584246323, + "aggregate_load_tv": 0.04954954954954955 + }, + "system_bos": { + "tokens": 74, + "ordered_topk_exact_tokens": 26, + "set_exact_tokens": 37, + "mean_set_jaccard": 0.8426640926640927, + "mean_token_weighted_tv": 0.02945322946116731, + "aggregate_load_tv": 0.05405405405405405 + }, + "system_x": { + "tokens": 74, + "ordered_topk_exact_tokens": 25, + "set_exact_tokens": 38, + "mean_set_jaccard": 0.8384813384813385, + "mean_token_weighted_tv": 0.034523147447789844, + "aggregate_load_tv": 0.0472972972972973 + }, + "system_period": { + "tokens": 74, + "ordered_topk_exact_tokens": 29, + "set_exact_tokens": 46, + "mean_set_jaccard": 0.8889961389961389, + "mean_token_weighted_tv": 0.02815069171373506, + "aggregate_load_tv": 0.038288288288288286 + }, + "bos_at_s0": { + "tokens": 74, + "ordered_topk_exact_tokens": 22, + "set_exact_tokens": 30, + "mean_set_jaccard": 0.8214285714285715, + "mean_token_weighted_tv": 0.03364504666092831, + "aggregate_load_tv": 0.06531531531531531 + }, + "bos_at_s1": { + "tokens": 74, + "ordered_topk_exact_tokens": 23, + "set_exact_tokens": 31, + "mean_set_jaccard": 0.8194980694980696, + "mean_token_weighted_tv": 0.03401715096992415, + "aggregate_load_tv": 0.05855855855855856 + }, + "x_at_s0": { + "tokens": 74, + "ordered_topk_exact_tokens": 24, + "set_exact_tokens": 29, + "mean_set_jaccard": 0.8146718146718147, + "mean_token_weighted_tv": 0.0357538561361867, + "aggregate_load_tv": 0.058558558558558564 + }, + "x_at_s1": { + "tokens": 74, + "ordered_topk_exact_tokens": 17, + "set_exact_tokens": 26, + "mean_set_jaccard": 0.7944015444015445, + "mean_token_weighted_tv": 0.041382375097758065, + "aggregate_load_tv": 0.06081081081081081 + }, + "period_at_s0": { + "tokens": 74, + "ordered_topk_exact_tokens": 18, + "set_exact_tokens": 28, + "mean_set_jaccard": 0.8021235521235521, + "mean_token_weighted_tv": 0.03903827899311845, + "aggregate_load_tv": 0.05405405405405405 + }, + "period_at_s1": { + "tokens": 74, + "ordered_topk_exact_tokens": 16, + "set_exact_tokens": 26, + "mean_set_jaccard": 0.8001930501930501, + "mean_token_weighted_tv": 0.03987684934022459, + "aggregate_load_tv": 0.06306306306306307 + } + } + }, + "layer_18": { + "layer": 18, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "c98c32788ca2b5f64d296b4d31029ab7f0d4d33510a9db586f9b635c6d54ee29", + "route_weight_sha256": "edb214a1bb3b06b9258e466682c5a2df94b98b2d4f491bf3a95be7969749acc4", + "loads": [ + 3, + 10, + 10, + 4, + 5, + 1, + 0, + 2, + 2, + 5, + 7, + 2, + 15, + 6, + 5, + 0, + 8, + 3, + 2, + 10, + 15, + 0, + 11, + 6, + 12, + 2, + 4, + 25, + 4, + 9, + 2, + 2, + 5, + 6, + 8, + 1, + 11, + 6, + 20, + 2, + 5, + 0, + 27, + 0, + 9, + 11, + 5, + 17, + 2, + 7, + 9, + 7, + 16, + 3, + 10, + 17, + 2, + 6, + 6, + 7, + 4, + 3, + 20, + 0 + ], + "weighted_loads": [ + 0.14081848040223122, + 0.432562367990613, + 1.2501929122954607, + 0.19138605892658234, + 0.1563960611820221, + 0.03564990311861038, + 0.0, + 0.08098789304494858, + 0.08593403175473213, + 0.21963153406977654, + 0.6125529445707798, + 0.14258523285388947, + 0.5953388623893261, + 0.3613451514393091, + 0.2600707523524761, + 0.0, + 0.5146820284426212, + 0.119302773848176, + 0.07843358442187309, + 0.819738756865263, + 0.856446735560894, + 0.0, + 1.0366116873919964, + 0.46806027740240097, + 0.4854634627699852, + 0.06260989233851433, + 0.14758880250155926, + 1.8497357740998268, + 0.23414570093154907, + 0.6829520612955093, + 0.07799983024597168, + 0.07527994737029076, + 0.2584012597799301, + 0.22045660950243473, + 0.6696153618395329, + 0.04317781329154968, + 0.4102509208023548, + 0.24079352244734764, + 0.9378051664680243, + 0.07152825593948364, + 0.22546421363949776, + 0.0, + 1.1632069181650877, + 0.0, + 0.34184635803103447, + 0.8847674131393433, + 0.3140646703541279, + 1.0923508629202843, + 0.09297136589884758, + 0.6474554613232613, + 0.5011736564338207, + 0.3571135550737381, + 0.9095014594495296, + 0.11848386749625206, + 0.3532510790973902, + 1.6262225229293108, + 0.0868405681103468, + 0.45867957547307014, + 0.8918052911758423, + 0.44625017419457436, + 0.14310459420084953, + 0.12363506481051445, + 1.171721315011382, + 0.0 + ], + "unique_experts": 58, + "load_cv": 0.8715488714197906, + "normalized_load_entropy": 0.9126114212212586, + "max_load_share": 0.060810810810810814 + }, + "full_input": { + "tokens": 99, + "top_k": 6, + "decisions": 594, + "ordered_route_sha256": "43840783ab59c2e7d8b4b1a44d3ac9c3b34685d1141a0ff4505e283bb39af123", + "route_weight_sha256": "eb401c6705c2c07343467e38fdf9bb39f6cf248cd2b0234cf540fbb6a9711ec5", + "loads": [ + 10, + 11, + 23, + 4, + 5, + 3, + 0, + 2, + 10, + 5, + 8, + 6, + 16, + 6, + 10, + 4, + 8, + 3, + 21, + 10, + 15, + 1, + 11, + 6, + 12, + 3, + 4, + 25, + 4, + 9, + 9, + 2, + 5, + 6, + 8, + 4, + 12, + 8, + 20, + 5, + 10, + 0, + 30, + 0, + 9, + 12, + 12, + 17, + 5, + 18, + 12, + 9, + 25, + 11, + 10, + 17, + 4, + 9, + 8, + 10, + 4, + 6, + 20, + 2 + ], + "weighted_loads": [ + 0.6171263419091702, + 0.5046860594302416, + 2.3198993504047394, + 0.19138605892658234, + 0.1563960611820221, + 0.08466929569840431, + 0.0, + 0.08098789304494858, + 0.5886145904660225, + 0.21963153406977654, + 0.6235063225030899, + 0.5178894698619843, + 0.6283149681985378, + 0.3613451514393091, + 1.303421651944518, + 0.1313847415149212, + 0.5146820284426212, + 0.119302773848176, + 1.2245938908308744, + 0.819738756865263, + 0.856446735560894, + 0.02604789473116398, + 1.0366116873919964, + 0.46806027740240097, + 0.4854634627699852, + 0.1052463948726654, + 0.14758880250155926, + 1.8497357740998268, + 0.23414570093154907, + 0.6829520612955093, + 0.35384921077638865, + 0.07527994737029076, + 0.2584012597799301, + 0.22045660950243473, + 0.6696153618395329, + 0.2601245827972889, + 0.43380509689450264, + 0.3022669032216072, + 0.9378051664680243, + 0.14780601114034653, + 0.4370133150368929, + 0.0, + 1.2482058741152287, + 0.0, + 0.34184635803103447, + 0.9357289746403694, + 2.214205924421549, + 1.0923508629202843, + 0.2384169064462185, + 1.137499375268817, + 0.6167117804288864, + 0.5433300584554672, + 1.5043014343827963, + 0.6892916150391102, + 0.3532510790973902, + 1.6262225229293108, + 1.0848692040890455, + 0.5629489496350288, + 0.9954028427600861, + 0.5342488493770361, + 0.14310459420084953, + 0.20710942521691322, + 1.171721315011382, + 0.09228051453828812 + ], + "unique_experts": 61, + "load_cv": 0.706902336855897, + "normalized_load_entropy": 0.9404630317360477, + "max_load_share": 0.050505050505050504 + } + }, + "s1_eos": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "6c9be2c12f2972170987288e524ef3afd0f3ed8c6fa8b319830ed43aee24c873", + "route_weight_sha256": "577b3441922ec728122856f5846c4b9b33d7d420b1f9d123b437960a69346757", + "loads": [ + 2, + 10, + 8, + 4, + 4, + 1, + 0, + 2, + 3, + 6, + 10, + 2, + 19, + 6, + 5, + 0, + 8, + 3, + 2, + 10, + 15, + 0, + 11, + 6, + 13, + 1, + 4, + 26, + 3, + 9, + 4, + 2, + 6, + 6, + 7, + 1, + 12, + 6, + 18, + 2, + 5, + 0, + 24, + 0, + 9, + 11, + 5, + 16, + 3, + 7, + 8, + 7, + 16, + 2, + 9, + 17, + 2, + 7, + 6, + 8, + 3, + 3, + 19, + 0 + ], + "weighted_loads": [ + 0.10781058669090271, + 0.43454501032829285, + 1.1506223119795322, + 0.19530173018574715, + 0.12699578888714314, + 0.03480588644742966, + 0.0, + 0.08280438929796219, + 0.1277204006910324, + 0.2952953279018402, + 0.7080274783074856, + 0.13667840138077736, + 0.7522621508687735, + 0.3673304319381714, + 0.26777510717511177, + 0.0, + 0.4966161474585533, + 0.11448013409972191, + 0.08111084997653961, + 0.7895521856844425, + 0.8686550334095955, + 0.0, + 1.0379254519939423, + 0.4673290029168129, + 0.5134702883660793, + 0.03196638450026512, + 0.14888518303632736, + 1.8873879294842482, + 0.21651124954223633, + 0.6718964576721191, + 0.14029431901872158, + 0.07643508538603783, + 0.29078805446624756, + 0.19647286646068096, + 0.6323089879006147, + 0.042851388454437256, + 0.43739440478384495, + 0.22791452705860138, + 0.8684253115206957, + 0.0713798962533474, + 0.22200917452573776, + 0.0, + 1.046154960989952, + 0.0, + 0.33947987109422684, + 0.8756586909294128, + 0.30971571430563927, + 1.0683947056531906, + 0.12838249653577805, + 0.6514881402254105, + 0.4753392729908228, + 0.37170401215553284, + 0.8861806280910969, + 0.07813326269388199, + 0.3249760288745165, + 1.614550745114684, + 0.0803777202963829, + 0.5082034021615982, + 0.8656804319471121, + 0.4538494870066643, + 0.11023731343448162, + 0.12361757457256317, + 1.1317270938307047, + 0.0 + ], + "unique_experts": 58, + "load_cv": 0.8591685533325041, + "normalized_load_entropy": 0.9132465465743262, + "max_load_share": 0.05855855855855856 + }, + "full_input": { + "tokens": 115, + "top_k": 6, + "decisions": 690, + "ordered_route_sha256": "5ac294436587d0693fe4f98eb75181df58b853b7da7fb91725245b0c24ba6630", + "route_weight_sha256": "2da969c8503caaa37a9f30664196e26d21cd0b101eb90e3713997dbebca907f4", + "loads": [ + 10, + 13, + 22, + 4, + 5, + 4, + 1, + 4, + 13, + 7, + 11, + 6, + 19, + 7, + 14, + 2, + 8, + 12, + 24, + 11, + 15, + 1, + 12, + 6, + 13, + 2, + 4, + 26, + 3, + 10, + 14, + 4, + 8, + 7, + 11, + 15, + 13, + 11, + 19, + 5, + 10, + 0, + 27, + 5, + 9, + 12, + 22, + 20, + 6, + 20, + 10, + 10, + 25, + 14, + 11, + 18, + 5, + 15, + 9, + 12, + 3, + 6, + 19, + 6 + ], + "weighted_loads": [ + 0.6047886908054352, + 0.5750810131430626, + 2.2792908530682325, + 0.19530173018574715, + 0.16347158513963223, + 0.12390918843448162, + 0.02887732721865177, + 0.1514724288135767, + 0.990843266248703, + 0.33212176337838173, + 0.7198489839211106, + 0.4941256083548069, + 0.7522621508687735, + 0.410260409116745, + 1.479685865342617, + 0.058918749913573265, + 0.4966161474585533, + 0.6709997039288282, + 1.9652469828724861, + 0.9245277084410191, + 0.8686550334095955, + 0.02482496201992035, + 1.0725685618817806, + 0.4673290029168129, + 0.5134702883660793, + 0.08133341372013092, + 0.14888518303632736, + 1.8873879294842482, + 0.21651124954223633, + 0.7088276445865631, + 0.6777500128373504, + 0.32128285616636276, + 0.3676035348325968, + 0.27242726646363735, + 1.043729143217206, + 1.3590252418071032, + 0.46083424612879753, + 0.44336729124188423, + 0.9056586232036352, + 0.14220278337597847, + 0.4054877609014511, + 0.0, + 1.1312226578593254, + 0.4608093574643135, + 0.33947987109422684, + 0.9206538498401642, + 3.3863172829151154, + 1.2433145437389612, + 0.22482248581945896, + 1.2289424259215593, + 0.5497730784118176, + 0.589251883327961, + 1.4651718605309725, + 0.8283556625247002, + 0.441431587561965, + 1.6491508688777685, + 1.0882934853434563, + 0.8389414269477129, + 1.2583022434264421, + 0.6965207103639841, + 0.11023731343448162, + 0.21438084356486797, + 1.1317270938307047, + 0.23533602058887482 + ], + "unique_experts": 63, + "load_cv": 0.6120748163095296, + "normalized_load_entropy": 0.9531172027441118, + "max_load_share": 0.0391304347826087 + } + }, + "s0_bos": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "986fb04bca2826f26b4dedc9f73b5f12e3d637a7b96b3874634aa5e25689301a", + "route_weight_sha256": "f28cc68e74f2838d535d1927954b0652f5b0a5f9b35237ad03f627876af1cc50", + "loads": [ + 2, + 8, + 11, + 6, + 4, + 0, + 0, + 2, + 2, + 6, + 10, + 2, + 19, + 6, + 4, + 0, + 8, + 3, + 2, + 10, + 15, + 0, + 10, + 6, + 12, + 2, + 4, + 25, + 3, + 10, + 4, + 2, + 6, + 7, + 8, + 1, + 8, + 4, + 21, + 3, + 3, + 0, + 24, + 0, + 8, + 12, + 5, + 17, + 2, + 7, + 8, + 7, + 14, + 4, + 8, + 16, + 2, + 7, + 6, + 9, + 5, + 3, + 21, + 0 + ], + "weighted_loads": [ + 0.10752860456705093, + 0.3308694399893284, + 1.326377708464861, + 0.260873019695282, + 0.14746780693531036, + 0.0, + 0.0, + 0.08868655376136303, + 0.08988429605960846, + 0.2941388450562954, + 0.7190655544400215, + 0.13283071666955948, + 0.755742747336626, + 0.3522364944219589, + 0.21375329047441483, + 0.0, + 0.4910342637449503, + 0.12025384977459908, + 0.07260086759924889, + 0.7616889979690313, + 0.8788969032466412, + 0.0, + 0.9718278534710407, + 0.45764587074518204, + 0.490500396117568, + 0.0690508708357811, + 0.14979732409119606, + 1.8890115413814783, + 0.22874822467565536, + 0.7421888895332813, + 0.13836883939802647, + 0.0729011781513691, + 0.28998320549726486, + 0.23419351316988468, + 0.6625803392380476, + 0.041508521884679794, + 0.2996094264090061, + 0.17270109057426453, + 0.9925675056874752, + 0.09377025254070759, + 0.13686250150203705, + 0.0, + 1.014216748997569, + 0.0, + 0.32731061428785324, + 0.9325360395014286, + 0.29998188465833664, + 1.0604423638433218, + 0.102635957300663, + 0.6306984424591064, + 0.48926040902733803, + 0.35941073298454285, + 0.8095998242497444, + 0.15976465865969658, + 0.3068843372166157, + 1.585476078093052, + 0.08213251084089279, + 0.48489462956786156, + 0.8881458435207605, + 0.5112550146877766, + 0.16553169675171375, + 0.11562623456120491, + 1.1797559782862663, + 0.0 + ], + "unique_experts": 57, + "load_cv": 0.8655684075378369, + "normalized_load_entropy": 0.9121044993646344, + "max_load_share": 0.05630630630630631 + }, + "full_input": { + "tokens": 99, + "top_k": 6, + "decisions": 594, + "ordered_route_sha256": "e7485d3e63744be544c06ec9eada19b2d49b601169bbf4045d9111b0363d88aa", + "route_weight_sha256": "d42d7edcb40825b14c3f35110479744c045ab931caeaa782e3977b8556eb67ef", + "loads": [ + 9, + 9, + 23, + 6, + 4, + 2, + 0, + 2, + 10, + 6, + 10, + 5, + 20, + 6, + 9, + 3, + 8, + 3, + 22, + 10, + 15, + 1, + 10, + 7, + 12, + 3, + 5, + 25, + 3, + 10, + 10, + 2, + 7, + 7, + 8, + 5, + 8, + 6, + 21, + 6, + 9, + 1, + 27, + 0, + 8, + 13, + 13, + 17, + 5, + 17, + 10, + 9, + 23, + 12, + 8, + 16, + 3, + 10, + 8, + 12, + 5, + 7, + 21, + 2 + ], + "weighted_loads": [ + 0.5506615377962589, + 0.402993131428957, + 2.369859740138054, + 0.260873019695282, + 0.14746780693531036, + 0.04901939257979393, + 0.0, + 0.08868655376136303, + 0.5925648547708988, + 0.2941388450562954, + 0.7190655544400215, + 0.3782528340816498, + 0.9272178299725056, + 0.3522364944219589, + 1.1256856936961412, + 0.09726505354046822, + 0.4910342637449503, + 0.12025384977459908, + 1.2425072491168976, + 0.7616889979690313, + 0.8788969032466412, + 0.02604789473116398, + 0.9718278534710407, + 0.5075780637562275, + 0.490500396117568, + 0.10789639130234718, + 0.198545902967453, + 1.8890115413814783, + 0.22874822467565536, + 0.7421888895332813, + 0.44746256060898304, + 0.0729011781513691, + 0.3179654125124216, + 0.23419351316988468, + 0.6625803392380476, + 0.29539062455296516, + 0.2996094264090061, + 0.2341744713485241, + 0.9925675056874752, + 0.2514174524694681, + 0.3978555351495743, + 0.06842090934515, + 1.1268400233238935, + 0.0, + 0.32731061428785324, + 0.9918066710233688, + 2.2290230616927147, + 1.0604423638433218, + 0.2480814978480339, + 1.0720326956361532, + 0.5701078474521637, + 0.5469377711415291, + 1.404399799183011, + 0.7469654195010662, + 0.3068843372166157, + 1.585476078093052, + 0.304846815764904, + 0.5933868978172541, + 0.996911907568574, + 0.6596095971763134, + 0.16553169675171375, + 0.23224051296710968, + 1.1797559782862663, + 0.09228051453828812 + ], + "unique_experts": 62, + "load_cv": 0.6949987584658447, + "normalized_load_entropy": 0.9423385094268697, + "max_load_share": 0.045454545454545456 + } + }, + "s1_bos": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "89d73ed402d88b131d6c283203632401b03c642e96529e0c0111e77e5e3b4936", + "route_weight_sha256": "3c9cc31ab3f339707c4bcbfe674c32c70982e86aaeeaf9038395255c6843d696", + "loads": [ + 2, + 9, + 10, + 5, + 4, + 1, + 0, + 2, + 3, + 7, + 11, + 2, + 16, + 6, + 5, + 0, + 8, + 2, + 1, + 10, + 15, + 0, + 11, + 6, + 16, + 2, + 4, + 27, + 3, + 10, + 3, + 1, + 5, + 5, + 8, + 3, + 9, + 6, + 21, + 1, + 4, + 0, + 21, + 0, + 8, + 11, + 5, + 16, + 3, + 7, + 8, + 7, + 15, + 3, + 8, + 18, + 2, + 7, + 6, + 8, + 5, + 3, + 19, + 0 + ], + "weighted_loads": [ + 0.10134729370474815, + 0.3693688940256834, + 1.3243367820978165, + 0.21723126247525215, + 0.14835721999406815, + 0.034059710800647736, + 0.0, + 0.0890723392367363, + 0.13009300455451012, + 0.35273225978016853, + 0.741436094045639, + 0.13034510053694248, + 0.6614596880972385, + 0.35176319256424904, + 0.2474554069340229, + 0.0, + 0.496610663831234, + 0.08780973590910435, + 0.03595288470387459, + 0.7482738941907883, + 0.8855264373123646, + 0.0, + 1.0368828922510147, + 0.45283306762576103, + 0.624940812587738, + 0.06784753501415253, + 0.15006677620112896, + 2.0136903040111065, + 0.23444171622395515, + 0.7150961756706238, + 0.14665692672133446, + 0.03578353300690651, + 0.2505415566265583, + 0.1590931285172701, + 0.6477617509663105, + 0.11011460795998573, + 0.3377596214413643, + 0.23645645380020142, + 0.9734355676919222, + 0.03439672663807869, + 0.16897300630807877, + 0.0, + 0.9530280493199825, + 0.0, + 0.3215965423732996, + 0.8968530297279358, + 0.2998673692345619, + 1.0122514702379704, + 0.13598770275712013, + 0.6312295794487, + 0.4852059967815876, + 0.37832000479102135, + 0.8379710391163826, + 0.11429901793599129, + 0.29819587245583534, + 1.6615908090025187, + 0.08237003907561302, + 0.5009659454226494, + 0.8931582029908895, + 0.4712226688861847, + 0.1692131645977497, + 0.1102137453854084, + 1.0712152160704136, + 0.0 + ], + "unique_experts": 58, + "load_cv": 0.8587906060786137, + "normalized_load_entropy": 0.9130707695984913, + "max_load_share": 0.060810810810810814 + }, + "full_input": { + "tokens": 115, + "top_k": 6, + "decisions": 690, + "ordered_route_sha256": "804d5cf5dee107477dda2714eaa052a0053114fb068ca92b51c915e5564141a0", + "route_weight_sha256": "363b5efa4dfb038fc61902c29e838df4d18874670469ab79186a2dcd987a1ab9", + "loads": [ + 10, + 12, + 22, + 5, + 5, + 4, + 1, + 4, + 13, + 8, + 11, + 6, + 16, + 7, + 14, + 3, + 8, + 11, + 24, + 11, + 15, + 1, + 12, + 6, + 16, + 3, + 4, + 27, + 3, + 11, + 11, + 3, + 7, + 6, + 12, + 16, + 9, + 11, + 22, + 4, + 10, + 1, + 25, + 5, + 8, + 12, + 23, + 20, + 6, + 20, + 10, + 10, + 24, + 15, + 10, + 19, + 4, + 15, + 9, + 12, + 5, + 8, + 19, + 6 + ], + "weighted_loads": [ + 0.5545693561434746, + 0.5099048968404531, + 2.397113297134638, + 0.21723126247525215, + 0.18483301624655724, + 0.1231630127876997, + 0.02887732721865177, + 0.1577403787523508, + 0.9932158701121807, + 0.38955869525671005, + 0.741436094045639, + 0.46449641324579716, + 0.6614596880972385, + 0.39469316974282265, + 1.525479570031166, + 0.09097630716860294, + 0.496610663831234, + 0.6443293057382107, + 1.9127647541463375, + 0.8832494169473648, + 0.8855264373123646, + 0.02482496201992035, + 1.071526002138853, + 0.45283306762576103, + 0.624940812587738, + 0.10803528130054474, + 0.15006677620112896, + 2.0136903040111065, + 0.23444171622395515, + 0.7520273625850677, + 0.6713394187390804, + 0.28063130378723145, + 0.3383829966187477, + 0.23504752852022648, + 1.0591819062829018, + 1.3720095828175545, + 0.3377596214413643, + 0.45190921798348427, + 1.0106688793748617, + 0.1088603101670742, + 0.3888362739235163, + 0.04173944890499115, + 1.0891946759074926, + 0.4608093574643135, + 0.3215965423732996, + 0.9471284635365009, + 3.4169346652925014, + 1.187171308323741, + 0.23242769204080105, + 1.218198923394084, + 0.5629004035145044, + 0.5990804322063923, + 1.4169622715562582, + 0.8636442050337791, + 0.41465143114328384, + 1.696190932765603, + 0.33846017345786095, + 0.8440489787608385, + 1.296386731788516, + 0.7814174629747868, + 0.1692131645977497, + 0.29927732422947884, + 1.0712152160704136, + 0.23533602058887482 + ], + "unique_experts": 64, + "load_cv": 0.6085507073802939, + "normalized_load_entropy": 0.9550232846059395, + "max_load_share": 0.0391304347826087 + } + }, + "s0_x": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "34371b26c55197e9c97d124c738cbec52066580db8ad39c514029cec8e3317d4", + "route_weight_sha256": "3c3cf89ef5aa16e8577e6379137ac5ce233fcf30c29dea3aba31182b49db4744", + "loads": [ + 3, + 9, + 8, + 4, + 4, + 1, + 0, + 2, + 2, + 6, + 11, + 3, + 18, + 6, + 6, + 0, + 7, + 3, + 2, + 10, + 15, + 0, + 10, + 5, + 12, + 2, + 5, + 25, + 4, + 11, + 3, + 1, + 6, + 7, + 7, + 1, + 9, + 4, + 21, + 1, + 4, + 0, + 23, + 0, + 8, + 12, + 6, + 16, + 3, + 7, + 8, + 7, + 15, + 3, + 8, + 18, + 2, + 8, + 6, + 8, + 5, + 3, + 20, + 0 + ], + "weighted_loads": [ + 0.15061576664447784, + 0.3802647776901722, + 1.2384118475019932, + 0.1877109296619892, + 0.135061239823699, + 0.03528011590242386, + 0.0, + 0.07251236587762833, + 0.09556398540735245, + 0.29253697767853737, + 0.7588361017405987, + 0.17238826304674149, + 0.6795543655753136, + 0.3394163195043802, + 0.2822508439421654, + 0.0, + 0.4582369215786457, + 0.11878498643636703, + 0.07671070471405983, + 0.7862082943320274, + 0.8779362924396992, + 0.0, + 0.9787956364452839, + 0.40710116922855377, + 0.48047699220478535, + 0.06795863062143326, + 0.1826720479875803, + 1.894005760550499, + 0.2940248027443886, + 0.7743877302855253, + 0.11752516031265259, + 0.03469253331422806, + 0.282071091234684, + 0.23959225788712502, + 0.6092713214457035, + 0.042630940675735474, + 0.3344897609204054, + 0.164521474391222, + 0.9869376830756664, + 0.032132625579833984, + 0.17635301686823368, + 0.0, + 0.9524350669234991, + 0.0, + 0.3145377151668072, + 0.9379848092794418, + 0.3421725817024708, + 1.053131353110075, + 0.14501181989908218, + 0.6539971828460693, + 0.45664193481206894, + 0.37801797688007355, + 0.8850118182599545, + 0.11479370668530464, + 0.3059851322323084, + 1.6737663969397545, + 0.07833753153681755, + 0.5343608744442463, + 0.9226647615432739, + 0.49887534976005554, + 0.1670159250497818, + 0.12181120365858078, + 1.1211327258497477, + 0.0 + ], + "unique_experts": 58, + "load_cv": 0.8542421961772491, + "normalized_load_entropy": 0.9142297505412981, + "max_load_share": 0.05630630630630631 + }, + "full_input": { + "tokens": 99, + "top_k": 6, + "decisions": 594, + "ordered_route_sha256": "e22224e728436a8d9a79b484d009928a3d8e80f88caa2e2711ae9232e38f4591", + "route_weight_sha256": "64ded70c83da4e1fad5952eac01be18964b085d15fca70818f5ee0c9b92fbcbb", + "loads": [ + 11, + 10, + 20, + 4, + 4, + 3, + 0, + 2, + 10, + 6, + 11, + 7, + 18, + 6, + 11, + 4, + 7, + 3, + 21, + 10, + 15, + 1, + 10, + 5, + 12, + 3, + 5, + 25, + 4, + 11, + 10, + 1, + 6, + 7, + 7, + 5, + 9, + 6, + 21, + 4, + 8, + 0, + 25, + 0, + 8, + 13, + 13, + 16, + 7, + 18, + 10, + 10, + 25, + 11, + 8, + 18, + 3, + 11, + 10, + 11, + 5, + 6, + 20, + 3 + ], + "weighted_loads": [ + 0.7209407575428486, + 0.4523884691298008, + 2.4092385955154896, + 0.1877109296619892, + 0.135061239823699, + 0.08429950848221779, + 0.0, + 0.07251236587762833, + 0.5982445441186428, + 0.29253697767853737, + 0.7588361017405987, + 0.5380852296948433, + 0.6795543655753136, + 0.3394163195043802, + 1.2565553355962038, + 0.1313626542687416, + 0.4582369215786457, + 0.11878498643636703, + 1.239177618175745, + 0.7862082943320274, + 0.8779362924396992, + 0.02604789473116398, + 0.9787956364452839, + 0.40710116922855377, + 0.48047699220478535, + 0.11418681964278221, + 0.1826720479875803, + 1.894005760550499, + 0.2940248027443886, + 0.7743877302855253, + 0.43456847593188286, + 0.03469253331422806, + 0.282071091234684, + 0.23959225788712502, + 0.6092713214457035, + 0.3306130953133106, + 0.3344897609204054, + 0.22599485516548157, + 0.9869376830756664, + 0.10962477512657642, + 0.3566944357007742, + 0.0, + 1.007545342668891, + 0.0, + 0.3145377151668072, + 0.9882578887045383, + 2.2286706008017063, + 1.053131353110075, + 0.33180591464042664, + 1.1345218736678362, + 0.5289488956332207, + 0.5988122932612896, + 1.5766391959041357, + 0.6702014170587063, + 0.3059851322323084, + 1.6737663969397545, + 0.3010518364608288, + 0.6571253761649132, + 1.1273617185652256, + 0.5970459152013063, + 0.1670159250497818, + 0.20383558608591557, + 1.1211327258497477, + 0.17190346866846085 + ], + "unique_experts": 61, + "load_cv": 0.6807594556797647, + "normalized_load_entropy": 0.9427532245613794, + "max_load_share": 0.04208754208754209 + } + }, + "s1_x": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "0c63e8956ee5975156d0c238cd5ff6e35df5c903412f2db93f7ad282d1ece82a", + "route_weight_sha256": "f45c52d98732ef0534659795158f02b0037f9e9b87e8d939c683f12be7eb9988", + "loads": [ + 3, + 9, + 9, + 5, + 4, + 1, + 1, + 2, + 2, + 7, + 11, + 2, + 16, + 6, + 5, + 0, + 8, + 2, + 2, + 10, + 15, + 0, + 11, + 5, + 15, + 1, + 5, + 28, + 3, + 10, + 2, + 1, + 5, + 6, + 9, + 4, + 8, + 4, + 21, + 1, + 3, + 0, + 17, + 0, + 7, + 12, + 6, + 16, + 3, + 7, + 8, + 7, + 16, + 3, + 9, + 18, + 3, + 8, + 6, + 8, + 6, + 3, + 19, + 0 + ], + "weighted_loads": [ + 0.1550077199935913, + 0.3624955154955387, + 1.2282591871917248, + 0.19521817192435265, + 0.1387720573693514, + 0.03596329316496849, + 0.03496497496962547, + 0.08099448680877686, + 0.1296347826719284, + 0.38947151228785515, + 0.73388297483325, + 0.13069909624755383, + 0.6676103733479977, + 0.35622885078191757, + 0.25041649118065834, + 0.0, + 0.4920872189104557, + 0.08030615001916885, + 0.08926578983664513, + 0.7619751915335655, + 0.8900228142738342, + 0.0, + 1.0419213734567165, + 0.4170232489705086, + 0.5665783863514662, + 0.03266126289963722, + 0.18775609321892262, + 2.0552486404776573, + 0.23696039989590645, + 0.7271895799785852, + 0.0737643614411354, + 0.034526627510786057, + 0.2330491505563259, + 0.2064564898610115, + 0.6820005122572184, + 0.1561914961785078, + 0.3241916447877884, + 0.1493665799498558, + 0.9391516465693712, + 0.030524717643857002, + 0.14840483665466309, + 0.0, + 0.851985152810812, + 0.0, + 0.27302588522434235, + 0.9542627260088921, + 0.3159922659397125, + 1.0669761821627617, + 0.1290477104485035, + 0.6403659135103226, + 0.5027797296643257, + 0.3883083164691925, + 0.89055435359478, + 0.11462891474366188, + 0.32020658254623413, + 1.6473129838705063, + 0.12454483285546303, + 0.5633981227874756, + 0.9209538195282221, + 0.4734257720410824, + 0.2035365253686905, + 0.10610530152916908, + 1.0832521431148052, + 0.0 + ], + "unique_experts": 59, + "load_cv": 0.84660721163821, + "normalized_load_entropy": 0.9160071496687906, + "max_load_share": 0.06306306306306306 + }, + "full_input": { + "tokens": 115, + "top_k": 6, + "decisions": 690, + "ordered_route_sha256": "0dff85532cf2e02c4182d8350c5bc059390342f1c93a9d2c6d832dbe2111e4a7", + "route_weight_sha256": "2c4f8b85ab1ba8e45e3e49aae9951ac90ca3ca6109e887959c7d7d0fae71665b", + "loads": [ + 13, + 12, + 22, + 5, + 5, + 4, + 2, + 4, + 13, + 8, + 11, + 6, + 16, + 7, + 14, + 2, + 8, + 11, + 25, + 11, + 15, + 1, + 12, + 5, + 15, + 2, + 5, + 28, + 3, + 11, + 11, + 3, + 7, + 7, + 13, + 16, + 8, + 9, + 22, + 4, + 8, + 0, + 19, + 6, + 7, + 13, + 23, + 20, + 7, + 21, + 10, + 11, + 26, + 15, + 11, + 19, + 5, + 16, + 9, + 11, + 6, + 5, + 19, + 7 + ], + "weighted_loads": [ + 0.8202365562319756, + 0.5030315183103085, + 2.414105586707592, + 0.19521817192435265, + 0.17524785362184048, + 0.12506659515202045, + 0.06384230218827724, + 0.14966252632439137, + 1.0343602411448956, + 0.42629794776439667, + 0.73388297483325, + 0.43697806261479855, + 0.6676103733479977, + 0.3991588279604912, + 1.3658382296562195, + 0.058918749913573265, + 0.4920872189104557, + 0.6368257198482752, + 2.079461708664894, + 0.8969507142901421, + 0.8900228142738342, + 0.02482496201992035, + 1.076564483344555, + 0.4170232489705086, + 0.5665783863514662, + 0.07596053183078766, + 0.18775609321892262, + 2.0552486404776573, + 0.23696039989590645, + 0.7641207668930292, + 0.6212007515132427, + 0.279374398291111, + 0.3208196945488453, + 0.2824108898639679, + 1.0934206675738096, + 1.3954924177378416, + 0.3241916447877884, + 0.36481934413313866, + 0.9763849582523108, + 0.10671457648277283, + 0.3121672682464123, + 0.0, + 0.9018674083054066, + 0.5137435719370842, + 0.27302588522434235, + 1.0161724090576172, + 3.282302860170603, + 1.2418960202485323, + 0.2652051206678152, + 1.2253013383597136, + 0.5691561121493578, + 0.6323918625712395, + 1.5453440379351377, + 0.804603822529316, + 0.43666214123368263, + 1.6819131076335907, + 0.38063496723771095, + 0.9237138759344816, + 1.325257072225213, + 0.6959459409117699, + 0.2035365253686905, + 0.17027289047837257, + 1.0832521431148052, + 0.29962386935949326 + ], + "unique_experts": 63, + "load_cv": 0.6120748163095296, + "normalized_load_entropy": 0.9538994442238478, + "max_load_share": 0.04057971014492753 + } + }, + "s0_period": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "8d5243f17cf773dccfb6a4dd27589aa45f5633baefc3697c87ae80b736149a0c", + "route_weight_sha256": "5f58d7fa916d1c4288bb1ec990bae0b5fe48a0ac1faacaca3d4a1ff6f328bfc7", + "loads": [ + 3, + 9, + 9, + 5, + 4, + 1, + 0, + 2, + 2, + 6, + 11, + 2, + 19, + 5, + 5, + 0, + 8, + 3, + 2, + 10, + 14, + 0, + 10, + 5, + 12, + 2, + 6, + 25, + 4, + 11, + 3, + 2, + 6, + 8, + 7, + 1, + 9, + 5, + 21, + 1, + 3, + 0, + 21, + 0, + 7, + 12, + 6, + 16, + 3, + 7, + 8, + 7, + 16, + 3, + 8, + 17, + 1, + 8, + 6, + 9, + 5, + 3, + 20, + 0 + ], + "weighted_loads": [ + 0.15070636197924614, + 0.36983519047498703, + 1.208056965842843, + 0.20548910088837147, + 0.14742300286889076, + 0.03384023904800415, + 0.0, + 0.07250134088099003, + 0.09324588254094124, + 0.31182240322232246, + 0.7567469328641891, + 0.14060153625905514, + 0.7462809514254332, + 0.3123616222292185, + 0.2643129639327526, + 0.0, + 0.48474691808223724, + 0.12036376819014549, + 0.07179338112473488, + 0.8104376401752234, + 0.8599077351391315, + 0.0, + 0.953064177185297, + 0.4000324606895447, + 0.4730252418667078, + 0.0649060495197773, + 0.20909531600773335, + 1.8833065554499626, + 0.316372636705637, + 0.7581392731517553, + 0.11502393707633018, + 0.07312780246138573, + 0.27651406452059746, + 0.2657732516527176, + 0.6026251092553139, + 0.042634498327970505, + 0.3399779386818409, + 0.20654631778597832, + 0.9560807105153799, + 0.03248535096645355, + 0.1457657478749752, + 0.0, + 0.8735851477831602, + 0.0, + 0.2946806978434324, + 0.9422574751079082, + 0.36121828854084015, + 1.0634666755795479, + 0.13747895136475563, + 0.6608770713210106, + 0.45256564393639565, + 0.38094303384423256, + 0.9037915430963039, + 0.12109088525176048, + 0.306873444467783, + 1.6598933804780245, + 0.025942763313651085, + 0.5315509960055351, + 0.9095057155936956, + 0.5254660397768021, + 0.16684159077703953, + 0.12320693209767342, + 1.13877953030169, + 0.0 + ], + "unique_experts": 58, + "load_cv": 0.84660721163821, + "normalized_load_entropy": 0.9145677779718926, + "max_load_share": 0.05630630630630631 + }, + "full_input": { + "tokens": 99, + "top_k": 6, + "decisions": 594, + "ordered_route_sha256": "5b29ec86a95daddcf79a0d503c14a3763020a5bb3eb47756edcdbc6a260c7617", + "route_weight_sha256": "eddfb6a3aad08a0f9b048e26788f8d6aebeb35dbb09e1ef3623e9a754862b27a", + "loads": [ + 11, + 10, + 21, + 5, + 4, + 3, + 0, + 2, + 10, + 6, + 11, + 6, + 19, + 5, + 10, + 3, + 8, + 3, + 22, + 10, + 14, + 2, + 10, + 5, + 12, + 3, + 6, + 25, + 4, + 11, + 9, + 3, + 6, + 8, + 7, + 4, + 9, + 8, + 21, + 4, + 7, + 0, + 23, + 0, + 7, + 13, + 14, + 16, + 6, + 18, + 11, + 9, + 26, + 12, + 8, + 17, + 2, + 12, + 9, + 11, + 5, + 6, + 20, + 2 + ], + "weighted_loads": [ + 0.7393447980284691, + 0.44195888191461563, + 2.250599781051278, + 0.20548910088837147, + 0.14742300286889076, + 0.08285963162779808, + 0.0, + 0.07250134088099003, + 0.5959264412522316, + 0.31182240322232246, + 0.7567469328641891, + 0.48704749904572964, + 0.7462809514254332, + 0.3123616222292185, + 1.371706372126937, + 0.09726505354046822, + 0.48474691808223724, + 0.12036376819014549, + 1.3048151694238186, + 0.8104376401752234, + 0.8599077351391315, + 0.056712014600634575, + 0.953064177185297, + 0.4000324606895447, + 0.4730252418667078, + 0.11420677229762077, + 0.20909531600773335, + 1.8833065554499626, + 0.316372636705637, + 0.7581392731517553, + 0.3963967002928257, + 0.09989401511847973, + 0.27651406452059746, + 0.2657732516527176, + 0.6026251092553139, + 0.27491019666194916, + 0.3399779386818409, + 0.29260071367025375, + 0.9560807105153799, + 0.11200942099094391, + 0.3201104886829853, + 0.0, + 0.928695423528552, + 0.0, + 0.2946806978434324, + 0.9934343732893467, + 2.345203697681427, + 1.0634666755795479, + 0.28292449191212654, + 1.1350934747606516, + 0.5599630549550056, + 0.5625695921480656, + 1.5732224863022566, + 0.7354350052773952, + 0.306873444467783, + 1.6598933804780245, + 0.24865706823766232, + 0.6956982556730509, + 1.0492272544652224, + 0.6013911478221416, + 0.16684159077703953, + 0.19962654635310173, + 1.13877953030169, + 0.09228051453828812 + ], + "unique_experts": 61, + "load_cv": 0.6839493649240416, + "normalized_load_entropy": 0.9428163339519356, + "max_load_share": 0.04377104377104377 + } + }, + "s1_period": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "b61c025895be98f5540ade1dff5bcc0f5e746f9d1b7281bb8d2aabe837f8fe75", + "route_weight_sha256": "7a641b15c0709ba837862fe012e34173644120014901e775eb62fd774be0eecf", + "loads": [ + 3, + 10, + 8, + 5, + 3, + 1, + 1, + 2, + 2, + 7, + 10, + 2, + 17, + 6, + 6, + 0, + 9, + 4, + 1, + 10, + 15, + 0, + 10, + 5, + 15, + 1, + 5, + 28, + 3, + 11, + 2, + 1, + 5, + 6, + 9, + 3, + 9, + 4, + 20, + 2, + 3, + 0, + 22, + 0, + 5, + 11, + 6, + 16, + 3, + 7, + 8, + 7, + 15, + 4, + 9, + 17, + 3, + 7, + 4, + 7, + 5, + 4, + 20, + 0 + ], + "weighted_loads": [ + 0.1488773189485073, + 0.39362289011478424, + 1.2070354484021664, + 0.20690074190497398, + 0.10312316194176674, + 0.035327520221471786, + 0.032071154564619064, + 0.08296278864145279, + 0.09623028710484505, + 0.4293079972267151, + 0.6976535804569721, + 0.12653914093971252, + 0.7175721302628517, + 0.35693732649087906, + 0.2809259332716465, + 0.0, + 0.5306182876229286, + 0.14879542402923107, + 0.05459926649928093, + 0.7739552892744541, + 0.908543199300766, + 0.0, + 1.0303648225963116, + 0.4232061430811882, + 0.5617904309183359, + 0.0312730148434639, + 0.1924288272857666, + 2.104272721335292, + 0.22022682428359985, + 0.753242552280426, + 0.06892967969179153, + 0.030893467366695404, + 0.23075759410858154, + 0.20953768864274025, + 0.6797229666262865, + 0.1165759265422821, + 0.34423848055303097, + 0.1488734968006611, + 0.9464891143143177, + 0.06146148592233658, + 0.1494079977273941, + 0.0, + 0.9964345134794712, + 0.0, + 0.21494478359818459, + 0.9113068617880344, + 0.30331626161932945, + 1.0564018413424492, + 0.1268012709915638, + 0.6529411375522614, + 0.4859038107097149, + 0.39872028678655624, + 0.8791482523083687, + 0.14229251071810722, + 0.3063148111104965, + 1.6322728283703327, + 0.1295267790555954, + 0.5048298947513103, + 0.8484077341854572, + 0.4149383381009102, + 0.1716922614723444, + 0.1420254185795784, + 1.14468602091074, + 0.0 + ], + "unique_experts": 59, + "load_cv": 0.8636910202118642, + "normalized_load_entropy": 0.9144165829290154, + "max_load_share": 0.06306306306306306 + }, + "full_input": { + "tokens": 115, + "top_k": 6, + "decisions": 690, + "ordered_route_sha256": "ccf431ff9d6c4f7a3fdc0685dbba0e0e8542a965207cf6169967706a6b100b3e", + "route_weight_sha256": "c4678a819714caa600e5b26157ee8702d67a5044a4388474184b2261f8b4fe6f", + "loads": [ + 11, + 13, + 20, + 5, + 4, + 4, + 2, + 4, + 13, + 9, + 10, + 6, + 17, + 7, + 15, + 2, + 9, + 13, + 23, + 11, + 15, + 1, + 11, + 5, + 15, + 2, + 5, + 28, + 3, + 12, + 11, + 3, + 7, + 7, + 13, + 16, + 9, + 9, + 21, + 5, + 8, + 0, + 24, + 6, + 5, + 12, + 24, + 20, + 6, + 21, + 10, + 12, + 25, + 17, + 11, + 18, + 5, + 15, + 7, + 10, + 5, + 6, + 20, + 7 + ], + "weighted_loads": [ + 0.6478170938789845, + 0.534158892929554, + 2.275674946606159, + 0.20690074190497398, + 0.13959895819425583, + 0.12443082220852375, + 0.060948481783270836, + 0.1516308281570673, + 0.98433549515903, + 0.5129442326724529, + 0.6976535804569721, + 0.47925397008657455, + 0.7175721302628517, + 0.39986730366945267, + 1.478197693824768, + 0.058918749913573265, + 0.5306182876229286, + 0.7053149938583374, + 2.0032593570649624, + 0.9089308120310307, + 0.908543199300766, + 0.02482496201992035, + 1.06500793248415, + 0.4232061430811882, + 0.5617904309183359, + 0.08055570349097252, + 0.1924288272857666, + 2.104272721335292, + 0.22022682428359985, + 0.79017373919487, + 0.5858600959181786, + 0.27574123814702034, + 0.3133131116628647, + 0.28549208864569664, + 1.0911431219428778, + 1.3907341584563255, + 0.34423848055303097, + 0.36432626098394394, + 0.9837224259972572, + 0.15263364650309086, + 0.30811217427253723, + 0.0, + 1.0463167689740658, + 0.49073880538344383, + 0.21494478359818459, + 0.970560222864151, + 3.3906371742486954, + 1.2313216794282198, + 0.2232412602752447, + 1.254172621294856, + 0.5563028883188963, + 0.7129240706562996, + 1.5103028398007154, + 0.8599507138133049, + 0.422770369797945, + 1.6668729521334171, + 0.3856169134378433, + 0.8882759790867567, + 1.2460818104445934, + 0.6315507516264915, + 0.1716922614723444, + 0.2061930075287819, + 1.14468602091074, + 0.2655983045697212 + ], + "unique_experts": 63, + "load_cv": 0.6173232595012738, + "normalized_load_entropy": 0.9529835206137133, + "max_load_share": 0.04057971014492753 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 74, + "ordered_topk_exact_tokens": 32, + "set_exact_tokens": 50, + "mean_set_jaccard": 0.9073359073359073, + "mean_token_weighted_tv": 0.018312736187834997, + "aggregate_load_tv": 0.040540540540540536 + }, + "system_bos": { + "tokens": 74, + "ordered_topk_exact_tokens": 32, + "set_exact_tokens": 45, + "mean_set_jaccard": 0.8822393822393821, + "mean_token_weighted_tv": 0.023915737036716293, + "aggregate_load_tv": 0.051801801801801814 + }, + "system_x": { + "tokens": 74, + "ordered_topk_exact_tokens": 30, + "set_exact_tokens": 47, + "mean_set_jaccard": 0.887065637065637, + "mean_token_weighted_tv": 0.026869055563332262, + "aggregate_load_tv": 0.0472972972972973 + }, + "system_period": { + "tokens": 74, + "ordered_topk_exact_tokens": 26, + "set_exact_tokens": 40, + "mean_set_jaccard": 0.865830115830116, + "mean_token_weighted_tv": 0.030742327179256325, + "aggregate_load_tv": 0.056306306306306314 + }, + "bos_at_s0": { + "tokens": 74, + "ordered_topk_exact_tokens": 21, + "set_exact_tokens": 40, + "mean_set_jaccard": 0.862934362934363, + "mean_token_weighted_tv": 0.028050271605418342, + "aggregate_load_tv": 0.056306306306306314 + }, + "bos_at_s1": { + "tokens": 74, + "ordered_topk_exact_tokens": 26, + "set_exact_tokens": 49, + "mean_set_jaccard": 0.8918918918918919, + "mean_token_weighted_tv": 0.02590566862223519, + "aggregate_load_tv": 0.0472972972972973 + }, + "x_at_s0": { + "tokens": 74, + "ordered_topk_exact_tokens": 24, + "set_exact_tokens": 40, + "mean_set_jaccard": 0.8600386100386102, + "mean_token_weighted_tv": 0.029672944591053435, + "aggregate_load_tv": 0.056306306306306314 + }, + "x_at_s1": { + "tokens": 74, + "ordered_topk_exact_tokens": 26, + "set_exact_tokens": 40, + "mean_set_jaccard": 0.8600386100386099, + "mean_token_weighted_tv": 0.03097352383003847, + "aggregate_load_tv": 0.06531531531531533 + }, + "period_at_s0": { + "tokens": 74, + "ordered_topk_exact_tokens": 22, + "set_exact_tokens": 38, + "mean_set_jaccard": 0.8523166023166023, + "mean_token_weighted_tv": 0.03167859180452856, + "aggregate_load_tv": 0.060810810810810814 + }, + "period_at_s1": { + "tokens": 74, + "ordered_topk_exact_tokens": 23, + "set_exact_tokens": 37, + "mean_set_jaccard": 0.8455598455598456, + "mean_token_weighted_tv": 0.033613165764993916, + "aggregate_load_tv": 0.06306306306306307 + } + } + }, + "layer_19": { + "layer": 19, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "1620df2b5e4575c8ac75539c91ae7dc464fe93c5a43a1451b746fa7c835a960b", + "route_weight_sha256": "3ac3bc330ad888ac38c0422528975e0aa7b14380931221e7c37d63e3e4550531", + "loads": [ + 5, + 1, + 8, + 23, + 5, + 3, + 4, + 22, + 2, + 6, + 2, + 4, + 3, + 6, + 5, + 5, + 10, + 8, + 4, + 8, + 5, + 15, + 3, + 5, + 4, + 21, + 9, + 3, + 5, + 2, + 11, + 18, + 4, + 3, + 7, + 4, + 2, + 13, + 8, + 7, + 2, + 0, + 2, + 4, + 25, + 0, + 4, + 9, + 25, + 11, + 1, + 2, + 9, + 9, + 1, + 6, + 7, + 8, + 3, + 13, + 10, + 0, + 5, + 5 + ], + "weighted_loads": [ + 0.17734546028077602, + 0.031126242130994797, + 0.6382342129945755, + 2.1577621307224035, + 0.20704222470521927, + 0.10160760581493378, + 0.3859422206878662, + 1.6393043398857117, + 0.0993981845676899, + 0.24351730570197105, + 0.10655951872467995, + 0.17680322006344795, + 0.15265135280787945, + 0.26649559289216995, + 0.30113035812973976, + 0.2336200587451458, + 0.4144837949424982, + 0.3582333717495203, + 0.1198826003819704, + 0.39253639802336693, + 0.1928900983184576, + 1.1497504860162735, + 0.11147119477391243, + 0.26381796784698963, + 0.17172148078680038, + 2.1204313822090626, + 0.3350163772702217, + 0.14866384118795395, + 0.4076080862432718, + 0.06760819628834724, + 0.5569294635206461, + 1.3604010082781315, + 0.13145020604133606, + 0.11714790016412735, + 0.6843969337642193, + 0.2795703858137131, + 0.06611507385969162, + 0.43363562412559986, + 0.7054694816470146, + 0.5211412683129311, + 0.06748485937714577, + 0.0, + 0.06308693438768387, + 0.16226927004754543, + 2.110661892220378, + 0.0, + 0.18640150502324104, + 0.5935843586921692, + 1.070079518482089, + 0.8279560543596745, + 0.03066972643136978, + 0.08803294599056244, + 0.5975364819169044, + 0.5186210349202156, + 0.040351755917072296, + 0.27184489741921425, + 0.2958254888653755, + 0.4430420957505703, + 0.7930838242173195, + 1.30528274923563, + 0.5593184903264046, + 0.0, + 0.2612366247922182, + 0.24946405366063118 + ], + "unique_experts": 61, + "load_cv": 0.8621861670244019, + "normalized_load_entropy": 0.9215852409318595, + "max_load_share": 0.05630630630630631 + }, + "full_input": { + "tokens": 99, + "top_k": 6, + "decisions": 594, + "ordered_route_sha256": "c4661e78695c92b3cfc6d2a7a17b8b2abc4cee02e14a5514f9b541e4510266e0", + "route_weight_sha256": "8af3b1f28de9959f0de90212f2dfa6565479fc4e356bcb65513299120a046d48", + "loads": [ + 7, + 4, + 9, + 23, + 10, + 6, + 13, + 22, + 2, + 10, + 2, + 4, + 10, + 7, + 10, + 5, + 12, + 9, + 4, + 13, + 5, + 15, + 8, + 14, + 14, + 21, + 9, + 5, + 6, + 7, + 16, + 18, + 4, + 3, + 7, + 5, + 4, + 18, + 10, + 7, + 6, + 2, + 10, + 5, + 26, + 0, + 4, + 14, + 26, + 12, + 1, + 2, + 9, + 12, + 9, + 6, + 7, + 8, + 10, + 13, + 13, + 5, + 11, + 5 + ], + "weighted_loads": [ + 0.22129898658022285, + 0.2895328514277935, + 0.6628091223537922, + 2.1577621307224035, + 1.233025474473834, + 0.18988892994821072, + 0.8205515872687101, + 1.6393043398857117, + 0.0993981845676899, + 0.4414610303938389, + 0.10655951872467995, + 0.17680322006344795, + 0.6306770127266645, + 0.30630841106176376, + 0.7955217659473419, + 0.2336200587451458, + 0.4999865908175707, + 0.4030547495931387, + 0.1198826003819704, + 0.6139747053384781, + 0.1928900983184576, + 1.1497504860162735, + 0.2915137242525816, + 0.5849273912608624, + 0.7191132646985352, + 2.1204313822090626, + 0.3350163772702217, + 0.21103599853813648, + 0.5434850696474314, + 0.2610864993184805, + 0.7506994586437941, + 1.3604010082781315, + 0.13145020604133606, + 0.11714790016412735, + 0.6843969337642193, + 0.3392420522868633, + 0.10934090544469655, + 0.6650469731539488, + 0.9275584742426872, + 0.5211412683129311, + 0.18245950434356928, + 0.1126578263938427, + 0.6485224142670631, + 0.2195479664951563, + 2.1213595727458596, + 0.0, + 0.18640150502324104, + 1.1104078590869904, + 1.1081615667790174, + 0.8723570145666599, + 0.03066972643136978, + 0.08803294599056244, + 0.5975364819169044, + 0.7994237244129181, + 1.8434080109000206, + 0.27184489741921425, + 0.2958254888653755, + 0.4430420957505703, + 1.1041276808828115, + 1.30528274923563, + 0.7276774346828461, + 0.2596956118941307, + 0.773990361019969, + 0.24946405366063118 + ], + "unique_experts": 63, + "load_cv": 0.6327010557126103, + "normalized_load_entropy": 0.9531924264236492, + "max_load_share": 0.04377104377104377 + } + }, + "s1_eos": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "948dbcbaa229d2755fd61c5eec53b1bf97ced79553776e104dbe7b7b0c4e9377", + "route_weight_sha256": "aebb4d7cdea4eaa7a6c12f020dbc9815d77ad889c49eadfda9b90c16a8c9aebd", + "loads": [ + 4, + 1, + 9, + 26, + 5, + 2, + 4, + 21, + 1, + 5, + 2, + 4, + 4, + 6, + 5, + 5, + 9, + 11, + 4, + 9, + 7, + 15, + 4, + 5, + 4, + 20, + 9, + 3, + 4, + 2, + 9, + 17, + 4, + 3, + 9, + 3, + 1, + 14, + 8, + 6, + 1, + 0, + 3, + 3, + 25, + 0, + 4, + 9, + 24, + 11, + 1, + 2, + 10, + 7, + 1, + 5, + 7, + 9, + 3, + 14, + 11, + 0, + 5, + 5 + ], + "weighted_loads": [ + 0.15356405265629292, + 0.03386181220412254, + 0.7008992172777653, + 2.34789358638227, + 0.19800517708063126, + 0.064815828576684, + 0.38326119631528854, + 1.5963857360184193, + 0.06483805179595947, + 0.20266415551304817, + 0.09172187745571136, + 0.1767302267253399, + 0.19013149105012417, + 0.27199457585811615, + 0.317047830671072, + 0.225333821028471, + 0.3752605617046356, + 0.48401881381869316, + 0.11942529492080212, + 0.42169997841119766, + 0.2666682694107294, + 1.155065968632698, + 0.12970504723489285, + 0.2745043896138668, + 0.1915763057768345, + 2.0601662062108517, + 0.32646033354103565, + 0.158728564158082, + 0.3750110752880573, + 0.06358291767537594, + 0.46137261018157005, + 1.3400809168815613, + 0.1281870324164629, + 0.1172444187104702, + 0.7732874676585197, + 0.22574537247419357, + 0.03368118405342102, + 0.46601060405373573, + 0.7090394236147404, + 0.4674195125699043, + 0.03655316308140755, + 0.0, + 0.0929564256221056, + 0.1258702166378498, + 2.1055588498711586, + 0.0, + 0.1771807000041008, + 0.5979021154344082, + 1.0387345161288977, + 0.8181677423417568, + 0.031214961782097816, + 0.0916685089468956, + 0.6355959475040436, + 0.4048136733472347, + 0.03861790895462036, + 0.22655197605490685, + 0.29700881615281105, + 0.4744160585105419, + 0.8127834238111973, + 1.347587265074253, + 0.5539008900523186, + 0.0, + 0.2595956940203905, + 0.24875390715897083 + ], + "unique_experts": 61, + "load_cv": 0.8778584739952279, + "normalized_load_entropy": 0.9174191958516951, + "max_load_share": 0.05855855855855856 + }, + "full_input": { + "tokens": 115, + "top_k": 6, + "decisions": 690, + "ordered_route_sha256": "fde677371923759221790cb95f7f43796bda6147db1071f157eedf66e7a7c87f", + "route_weight_sha256": "73ca43ddeaa7d32ef919674acf83cc20b87d5f1a202c6c6875eac3b4649e7c05", + "loads": [ + 6, + 7, + 12, + 26, + 17, + 5, + 17, + 21, + 1, + 10, + 3, + 11, + 15, + 6, + 16, + 7, + 12, + 16, + 5, + 17, + 10, + 16, + 11, + 11, + 17, + 20, + 9, + 5, + 6, + 3, + 13, + 17, + 6, + 3, + 9, + 3, + 4, + 19, + 10, + 8, + 6, + 7, + 12, + 4, + 26, + 0, + 4, + 21, + 25, + 13, + 6, + 2, + 13, + 18, + 6, + 5, + 9, + 11, + 13, + 16, + 14, + 8, + 14, + 7 + ], + "weighted_loads": [ + 0.17905579088255763, + 0.43967148289084435, + 0.8013442046940327, + 2.34789358638227, + 1.8727588076144457, + 0.20030513405799866, + 1.0438748020678759, + 1.5963857360184193, + 0.06483805179595947, + 0.42026226595044136, + 0.15888433158397675, + 0.9056832827627659, + 0.8234613370150328, + 0.27199457585811615, + 1.2436569593846798, + 0.33466673642396927, + 0.7651735097169876, + 0.7128384038805962, + 0.21651907078921795, + 0.8037311397492886, + 0.5703190136700869, + 1.209619827568531, + 0.4057616014033556, + 0.4648437276482582, + 0.9893121495842934, + 2.0601662062108517, + 0.32646033354103565, + 0.24195747636258602, + 0.5430327132344246, + 0.09771251119673252, + 0.6158436331897974, + 1.3400809168815613, + 0.21555546671152115, + 0.1172444187104702, + 0.7732874676585197, + 0.22574537247419357, + 0.11855317978188396, + 0.6676976624876261, + 0.9321042411029339, + 0.5716215874999762, + 0.19405899103730917, + 0.333671148866415, + 0.818450191989541, + 0.1628929264843464, + 2.1162565303966403, + 0.0, + 0.1771807000041008, + 1.5549523755908012, + 1.071763576939702, + 0.9108399637043476, + 0.3698086831718683, + 0.0916685089468956, + 0.7825768440961838, + 1.2970586828887463, + 1.7514220215380192, + 0.22655197605490685, + 0.3796723708510399, + 0.5615362524986267, + 1.3181679490953684, + 1.4130321815609932, + 0.7151820473372936, + 0.37586721032857895, + 0.9836631659418344, + 0.41516957245767117 + ], + "unique_experts": 63, + "load_cv": 0.5786584663408346, + "normalized_load_entropy": 0.9578718325213629, + "max_load_share": 0.03768115942028986 + } + }, + "s0_bos": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "161407d3d76708c1ce321d4cbd048cdbc48b9e2883e5bbc8d9286be0cbd57d5b", + "route_weight_sha256": "571ddbb9256a5eb648aaa7537413b25cbfa2847d3eba14a01033523b1628b088", + "loads": [ + 4, + 1, + 10, + 25, + 4, + 4, + 4, + 23, + 1, + 5, + 2, + 4, + 2, + 5, + 5, + 5, + 7, + 9, + 4, + 9, + 6, + 15, + 6, + 5, + 3, + 20, + 11, + 2, + 5, + 5, + 9, + 19, + 6, + 3, + 8, + 5, + 2, + 12, + 7, + 8, + 1, + 0, + 1, + 5, + 22, + 1, + 4, + 9, + 19, + 11, + 1, + 2, + 11, + 8, + 1, + 6, + 7, + 7, + 3, + 14, + 12, + 0, + 5, + 4 + ], + "weighted_loads": [ + 0.14072557166218758, + 0.03292891010642052, + 0.7628940977156162, + 2.269070692360401, + 0.15876520797610283, + 0.13807638734579086, + 0.3811032809317112, + 1.6758857406675816, + 0.05598248541355133, + 0.23580660298466682, + 0.09335247427225113, + 0.17541088536381721, + 0.11985659785568714, + 0.24005956947803497, + 0.3078528009355068, + 0.22879409790039062, + 0.32686323672533035, + 0.4151541832834482, + 0.12109755724668503, + 0.4363333936780691, + 0.23301486670970917, + 1.1594667322933674, + 0.19763967208564281, + 0.252054775133729, + 0.13233458623290062, + 2.112144235521555, + 0.44097099266946316, + 0.11943546310067177, + 0.4183877557516098, + 0.1488073244690895, + 0.4971991889178753, + 1.3812820930033922, + 0.2035534828901291, + 0.11896813288331032, + 0.7459723874926567, + 0.33596745133399963, + 0.06903906166553497, + 0.3917940557003021, + 0.6881170272827148, + 0.6068095397204161, + 0.03754877299070358, + 0.0, + 0.030027514323592186, + 0.18901079893112183, + 2.0132809169590473, + 0.027703577652573586, + 0.17468087747693062, + 0.6050963960587978, + 0.8537128921598196, + 0.8509494625031948, + 0.032474856823682785, + 0.10292701795697212, + 0.690710412338376, + 0.4470425993204117, + 0.039901893585920334, + 0.2842427846044302, + 0.3050561062991619, + 0.38676707074046135, + 0.7621578127145767, + 1.315093420445919, + 0.6105154640972614, + 0.0, + 0.2783013619482517, + 0.21784239634871483 + ], + "unique_experts": 62, + "load_cv": 0.8334672402761769, + "normalized_load_entropy": 0.9242363568112968, + "max_load_share": 0.05630630630630631 + }, + "full_input": { + "tokens": 99, + "top_k": 6, + "decisions": 594, + "ordered_route_sha256": "c313b1d16edc84fbfe0b3c0d7fd3485404bd2bac776b2b8d4284b1b1ffaa6d84", + "route_weight_sha256": "d328fa7681bdaad5fcbd14f3118a61999a3d625c75ed867016c2480e72573c41", + "loads": [ + 6, + 4, + 11, + 25, + 8, + 7, + 13, + 23, + 1, + 8, + 2, + 4, + 9, + 8, + 10, + 5, + 9, + 10, + 4, + 14, + 6, + 15, + 11, + 11, + 12, + 20, + 12, + 4, + 6, + 10, + 16, + 19, + 6, + 3, + 8, + 7, + 2, + 17, + 9, + 8, + 4, + 3, + 9, + 6, + 23, + 2, + 4, + 14, + 21, + 12, + 1, + 3, + 11, + 11, + 8, + 6, + 7, + 7, + 10, + 14, + 15, + 5, + 11, + 4 + ], + "weighted_loads": [ + 0.2196967452764511, + 0.2826612591743469, + 0.7874690070748329, + 2.269070692360401, + 0.9611377287656069, + 0.21269449032843113, + 0.8029044661670923, + 1.6758857406675816, + 0.05598248541355133, + 0.3969167098402977, + 0.09335247427225113, + 0.17541088536381721, + 0.5978822577744722, + 0.3602454587817192, + 0.7943350449204445, + 0.22879409790039062, + 0.41236603260040283, + 1.1880961898714304, + 0.12109755724668503, + 0.8415743801742792, + 0.23301486670970917, + 1.1594667322933674, + 0.377682201564312, + 0.48274263832718134, + 0.7580336108803749, + 2.112144235521555, + 0.46989174745976925, + 0.19057438522577286, + 0.5551445931196213, + 0.34228562749922276, + 0.773052416741848, + 1.3812820930033922, + 0.2035534828901291, + 0.11896813288331032, + 0.7459723874926567, + 0.412309380248189, + 0.06903906166553497, + 0.6311383470892906, + 0.902266800403595, + 0.6068095397204161, + 0.15321234799921513, + 0.14944516122341156, + 0.6154629942029715, + 0.24628949537873268, + 2.023978597484529, + 0.05433911271393299, + 0.17468087747693062, + 1.1312509886920452, + 0.9245060291141272, + 0.9020726941525936, + 0.032474856823682785, + 0.11660760827362537, + 0.690710412338376, + 0.6954250931739807, + 0.8989395461976528, + 0.2842427846044302, + 0.3050561062991619, + 0.38676707074046135, + 1.080826634541154, + 1.315093420445919, + 0.7890944108366966, + 0.25835350155830383, + 0.7910550981760025, + 0.21784239634871483 + ], + "unique_experts": 64, + "load_cv": 0.6030508882104261, + "normalized_load_entropy": 0.9572124442387739, + "max_load_share": 0.04208754208754209 + } + }, + "s1_bos": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "ebcdbfa78a4132df2be03a321f7993ef3c8a7fa928533786bbec94e345f66ede", + "route_weight_sha256": "b53e8d91c0d4b0f3f48dfa220cea2f00b13b951f2ef6c991dd5e22479a468579", + "loads": [ + 4, + 1, + 10, + 26, + 5, + 4, + 4, + 21, + 1, + 6, + 2, + 4, + 3, + 5, + 5, + 5, + 8, + 9, + 4, + 9, + 5, + 15, + 6, + 5, + 4, + 20, + 9, + 3, + 5, + 3, + 9, + 20, + 5, + 2, + 7, + 5, + 2, + 10, + 10, + 8, + 1, + 0, + 3, + 4, + 23, + 2, + 4, + 8, + 17, + 11, + 1, + 2, + 11, + 9, + 1, + 6, + 6, + 7, + 3, + 15, + 11, + 1, + 5, + 4 + ], + "weighted_loads": [ + 0.15435502864420414, + 0.03236503154039383, + 0.7766117341816425, + 2.4302583914250135, + 0.1857994794845581, + 0.12779439613223076, + 0.3798096626996994, + 1.6557442545890808, + 0.05016309767961502, + 0.2706588841974735, + 0.09963355585932732, + 0.17684719897806644, + 0.14432423561811447, + 0.2504381127655506, + 0.30994439125061035, + 0.2263958491384983, + 0.35359758883714676, + 0.4060351178050041, + 0.12206263653934002, + 0.4514079689979553, + 0.20256634056568146, + 1.1645467914640903, + 0.1940239667892456, + 0.2582646328955889, + 0.20573623478412628, + 2.098744425922632, + 0.3603637218475342, + 0.1421264447271824, + 0.42256662249565125, + 0.08973065204918385, + 0.4589940793812275, + 1.4572704583406448, + 0.16464350931346416, + 0.08518298715353012, + 0.6814323775470257, + 0.32245667837560177, + 0.06749176606535912, + 0.34134385734796524, + 0.7731773220002651, + 0.5509727988392115, + 0.04919344559311867, + 0.0, + 0.10089564695954323, + 0.15331757813692093, + 1.9930260479450226, + 0.06146811693906784, + 0.16916024312376976, + 0.5491375811398029, + 0.7966018617153168, + 0.8485678732395172, + 0.0327441431581974, + 0.10528666153550148, + 0.6974807605147362, + 0.46970907412469387, + 0.04130684211850166, + 0.2679964303970337, + 0.2568903900682926, + 0.39124132320284843, + 0.790229570120573, + 1.3505288772284985, + 0.5881078895181417, + 0.03388693928718567, + 0.27129270136356354, + 0.2184615358710289 + ], + "unique_experts": 63, + "load_cv": 0.8201167663383966, + "normalized_load_entropy": 0.9290462795222417, + "max_load_share": 0.05855855855855856 + }, + "full_input": { + "tokens": 115, + "top_k": 6, + "decisions": 690, + "ordered_route_sha256": "bfa3bcf7e300852f25787d26a4bc9a5f5d72c81311e642269e5c0e0a3eb9a14c", + "route_weight_sha256": "70bff59dae2ecfa5fc1c7e3341b1ba265cfcf281f64641402bdea012717f3d03", + "loads": [ + 5, + 7, + 13, + 26, + 17, + 6, + 15, + 21, + 1, + 13, + 3, + 11, + 15, + 7, + 16, + 7, + 11, + 14, + 5, + 18, + 8, + 16, + 13, + 10, + 16, + 20, + 9, + 5, + 7, + 4, + 14, + 20, + 7, + 2, + 7, + 6, + 5, + 15, + 12, + 11, + 5, + 7, + 13, + 5, + 24, + 2, + 4, + 19, + 18, + 12, + 6, + 2, + 14, + 20, + 5, + 6, + 8, + 9, + 13, + 17, + 14, + 9, + 14, + 6 + ], + "weighted_loads": [ + 0.17546897754073143, + 0.43789755925536156, + 0.8738209418952465, + 2.4302583914250135, + 1.9013454411178827, + 0.21831143088638783, + 0.9488660302013159, + 1.6557442545890808, + 0.05016309767961502, + 0.5830767750740051, + 0.1667960099875927, + 0.9058002550154924, + 0.8087281994521618, + 0.3286697566509247, + 1.2082310765981674, + 0.3357287645339966, + 0.7435105368494987, + 0.6348547078669071, + 0.21915641240775585, + 1.078312911093235, + 0.5062170848250389, + 1.2191006503999233, + 0.47008052095770836, + 0.4384622285142541, + 1.1071326490491629, + 2.098744425922632, + 0.3603637218475342, + 0.23018182814121246, + 0.6004042364656925, + 0.12386024557054043, + 0.6580456513911486, + 1.4572704583406448, + 0.2520119436085224, + 0.08518298715353012, + 0.6814323775470257, + 0.3788206968456507, + 0.1848621517419815, + 0.5257849972695112, + 0.9732815958559513, + 0.6924388147890568, + 0.1866061333566904, + 0.3349325768649578, + 0.8748794831335545, + 0.1903402879834175, + 2.0037237284705043, + 0.06146811693906784, + 0.16916024312376976, + 1.4710240997374058, + 0.8296309225261211, + 0.8911716565489769, + 0.3713378645479679, + 0.10528666153550148, + 0.8444616571068764, + 1.3245306145399809, + 0.8128186091780663, + 0.2679964303970337, + 0.33955394476652145, + 0.4783615171909332, + 1.3064514305442572, + 1.4159737937152386, + 0.7527746316045523, + 0.4133422411978245, + 0.9953601732850075, + 0.38487720116972923 + ], + "unique_experts": 64, + "load_cv": 0.5417033820138806, + "normalized_load_entropy": 0.9633847771756915, + "max_load_share": 0.03768115942028986 + } + }, + "s0_x": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "ac3caab2f6c2d3ba39d2de0147a53c2d4313d5e43fbaa01f39616dcc8073bf64", + "route_weight_sha256": "98467cd976e4be87205c803245d3c3a9d233ce532a9ea82c5716fd4ebaccb97f", + "loads": [ + 4, + 1, + 10, + 27, + 5, + 3, + 5, + 22, + 2, + 4, + 2, + 4, + 3, + 5, + 6, + 5, + 7, + 8, + 3, + 8, + 7, + 15, + 6, + 5, + 4, + 21, + 13, + 3, + 5, + 3, + 9, + 18, + 7, + 2, + 9, + 4, + 3, + 12, + 9, + 7, + 1, + 1, + 2, + 4, + 22, + 0, + 3, + 9, + 16, + 11, + 1, + 2, + 10, + 7, + 1, + 6, + 7, + 7, + 3, + 14, + 12, + 0, + 4, + 5 + ], + "weighted_loads": [ + 0.15377958118915558, + 0.03653769940137863, + 0.7339095044881105, + 2.2986682914197445, + 0.19588786363601685, + 0.1034140344709158, + 0.4009013958275318, + 1.6550311986356974, + 0.0842701755464077, + 0.17255566269159317, + 0.08325646072626114, + 0.17638827860355377, + 0.16351640410721302, + 0.23247703537344933, + 0.3516470827162266, + 0.233898114413023, + 0.33308468014001846, + 0.38623751141130924, + 0.09258679673075676, + 0.39747219160199165, + 0.2750293593853712, + 1.1608859561383724, + 0.1979740373790264, + 0.25641151517629623, + 0.15926584973931313, + 2.193361356854439, + 0.5019519347697496, + 0.13496048003435135, + 0.42077586986124516, + 0.0981278233230114, + 0.4800584129989147, + 1.3795039504766464, + 0.21790913864970207, + 0.0818115696310997, + 0.8058019168674946, + 0.29416651278734207, + 0.10698511451482773, + 0.38838879205286503, + 0.7556059472262859, + 0.534996222704649, + 0.03592241182923317, + 0.02758430317044258, + 0.05666370503604412, + 0.15524813160300255, + 2.02642510458827, + 0.0, + 0.1498408429324627, + 0.6298626512289047, + 0.7319526113569736, + 0.8715438470244408, + 0.035395752638578415, + 0.10090840980410576, + 0.6513027250766754, + 0.3925629034638405, + 0.04599792882800102, + 0.27535954117774963, + 0.31638050451874733, + 0.3940843492746353, + 0.7582640014588833, + 1.3572266157716513, + 0.5692925155162811, + 0.0, + 0.23663141578435898, + 0.2561843153089285 + ], + "unique_experts": 62, + "load_cv": 0.8303452637552794, + "normalized_load_entropy": 0.9259644600201768, + "max_load_share": 0.060810810810810814 + }, + "full_input": { + "tokens": 99, + "top_k": 6, + "decisions": 594, + "ordered_route_sha256": "f5f1e72dcc8063f47729be69de27b4a5ea09b1321a0102e69fe13bf9d7149e2a", + "route_weight_sha256": "eb203fd3ab33397b0f71c37992bf85582e34dd7957810670d0e0260c06bc12ce", + "loads": [ + 5, + 4, + 11, + 27, + 10, + 7, + 15, + 22, + 2, + 7, + 2, + 4, + 12, + 6, + 12, + 5, + 9, + 8, + 3, + 13, + 7, + 15, + 12, + 11, + 12, + 21, + 13, + 5, + 6, + 8, + 14, + 18, + 7, + 2, + 9, + 5, + 3, + 16, + 11, + 8, + 5, + 3, + 11, + 5, + 23, + 0, + 3, + 15, + 17, + 12, + 1, + 2, + 10, + 12, + 8, + 6, + 7, + 7, + 11, + 14, + 15, + 4, + 11, + 5 + ], + "weighted_loads": [ + 0.19330259039998055, + 0.26281358674168587, + 0.7584844138473272, + 2.2986682914197445, + 1.0811044182628393, + 0.2885963097214699, + 0.8952674400061369, + 1.6550311986356974, + 0.0842701755464077, + 0.3542444221675396, + 0.08325646072626114, + 0.17638827860355377, + 0.8177133146673441, + 0.27228985354304314, + 0.8486914522945881, + 0.233898114413023, + 0.41858747601509094, + 0.38623751141130924, + 0.09258679673075676, + 0.6190678998827934, + 0.2750293593853712, + 1.1608859561383724, + 0.4261463936418295, + 0.4870993783697486, + 0.6363731734454632, + 2.193361356854439, + 0.5019519347697496, + 0.20792289078235626, + 0.5584357175976038, + 0.29160612635314465, + 0.6711777299642563, + 1.3795039504766464, + 0.21790913864970207, + 0.0818115696310997, + 0.8058019168674946, + 0.3538381792604923, + 0.10698511451482773, + 0.5531622786074877, + 0.9706171117722988, + 0.5680617764592171, + 0.20377004705369473, + 0.14069031178951263, + 0.7852325867861509, + 0.2125268280506134, + 2.037122785113752, + 0.0, + 0.1498408429324627, + 1.2227527797222137, + 0.770034659653902, + 0.9158670343458652, + 0.035395752638578415, + 0.10090840980410576, + 0.6513027250766754, + 0.7039712816476822, + 0.9050355814397335, + 0.27535954117774963, + 0.31638050451874733, + 0.3940843492746353, + 1.1098801847547293, + 1.3572266157716513, + 0.7715553101152182, + 0.23162098973989487, + 0.7975447773933411, + 0.2561843153089285 + ], + "unique_experts": 63, + "load_cv": 0.6105241544035039, + "normalized_load_entropy": 0.954572648791173, + "max_load_share": 0.045454545454545456 + } + }, + "s1_x": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "25d6dcde2d9994aef0672e523c84c760cd7c84d3119df0fdf51652834a903e39", + "route_weight_sha256": "8360dec77d5bfdf1957966a95314b1cfd12ea6f8966639b79754f65e61a3f989", + "loads": [ + 4, + 1, + 10, + 28, + 3, + 2, + 3, + 21, + 1, + 5, + 2, + 3, + 4, + 5, + 5, + 5, + 9, + 7, + 3, + 9, + 6, + 15, + 6, + 4, + 4, + 19, + 11, + 4, + 5, + 3, + 9, + 20, + 6, + 2, + 7, + 5, + 2, + 12, + 9, + 7, + 0, + 1, + 2, + 5, + 24, + 1, + 3, + 8, + 17, + 11, + 2, + 2, + 10, + 8, + 1, + 6, + 7, + 7, + 4, + 16, + 12, + 1, + 5, + 5 + ], + "weighted_loads": [ + 0.16151710785925388, + 0.039220210164785385, + 0.7726855520159006, + 2.547491207718849, + 0.13067376613616943, + 0.06043408811092377, + 0.32729077339172363, + 1.706070777028799, + 0.05195543169975281, + 0.20726651698350906, + 0.09274743869900703, + 0.1417083591222763, + 0.20704219676554203, + 0.22553865611553192, + 0.31926072016358376, + 0.22903387621045113, + 0.3997562825679779, + 0.32305146753787994, + 0.09381085075438023, + 0.4415629841387272, + 0.25954786129295826, + 1.1857846602797508, + 0.19178123213350773, + 0.2206528577953577, + 0.19885103963315487, + 2.086231619119644, + 0.4416985288262367, + 0.17905334010720253, + 0.42915238440036774, + 0.10140841454267502, + 0.41515107825398445, + 1.4670770801603794, + 0.20211943238973618, + 0.08884114772081375, + 0.7005724981427193, + 0.3273275066167116, + 0.07046077027916908, + 0.39362149499356747, + 0.7383098974823952, + 0.4602665398269892, + 0.0, + 0.026311518624424934, + 0.05890584550797939, + 0.20895720086991787, + 2.0966161526739597, + 0.026437368243932724, + 0.13987799361348152, + 0.5453961715102196, + 0.7738695479929447, + 0.8712884150445461, + 0.07399891503155231, + 0.10286808013916016, + 0.6736944057047367, + 0.4342881850898266, + 0.042388640344142914, + 0.2659438382834196, + 0.30760254338383675, + 0.39491797238588333, + 0.8250834122300148, + 1.4020615220069885, + 0.5830728448927402, + 0.03296343609690666, + 0.26007924787700176, + 0.24488095939159393 + ], + "unique_experts": 63, + "load_cv": 0.8511964204324216, + "normalized_load_entropy": 0.924392815280923, + "max_load_share": 0.06306306306306306 + }, + "full_input": { + "tokens": 115, + "top_k": 6, + "decisions": 690, + "ordered_route_sha256": "9571975db0a71c3a24a151e7398bc8cc392b7aa12d012dc06ac8498b7ab2ca1a", + "route_weight_sha256": "ecc288a06f6bbeb5c632833c914823d497cb5d49ca3c17c540f17f65a61ec62a", + "loads": [ + 5, + 8, + 12, + 28, + 15, + 6, + 15, + 21, + 1, + 10, + 3, + 10, + 17, + 5, + 17, + 7, + 12, + 12, + 4, + 16, + 9, + 16, + 14, + 9, + 15, + 19, + 11, + 6, + 7, + 4, + 13, + 20, + 9, + 2, + 7, + 5, + 4, + 16, + 11, + 10, + 3, + 8, + 12, + 6, + 25, + 1, + 3, + 20, + 18, + 13, + 7, + 2, + 13, + 19, + 5, + 6, + 9, + 9, + 15, + 18, + 15, + 10, + 15, + 7 + ], + "weighted_loads": [ + 0.18263105675578117, + 0.46527577191591263, + 0.8334862124174833, + 2.547491207718849, + 1.5736231300979853, + 0.23218885622918606, + 0.9293906595557928, + 1.706070777028799, + 0.05195543169975281, + 0.4465792737901211, + 0.15990989282727242, + 0.8706614151597023, + 0.9760090056806803, + 0.22553865611553192, + 1.3175649233162403, + 0.3383667916059494, + 0.7896692305803299, + 0.5518710575997829, + 0.19090462662279606, + 0.7809091806411743, + 0.5631986055523157, + 1.2403385192155838, + 0.5030725132673979, + 0.4008504534140229, + 0.9295940473675728, + 2.086231619119644, + 0.4416985288262367, + 0.27468593046069145, + 0.6034936644136906, + 0.1355380080640316, + 0.562828941270709, + 1.4670770801603794, + 0.32622295804321766, + 0.08884114772081375, + 0.7005724981427193, + 0.3273275066167116, + 0.15139461681246758, + 0.5122895482927561, + 0.9318347871303558, + 0.5993379503488541, + 0.0959253553301096, + 0.35890076123178005, + 0.9692283105105162, + 0.24597991071641445, + 2.1073138331994414, + 0.026437368243932724, + 0.13987799361348152, + 1.5479103103280067, + 0.8068986088037491, + 0.9855794794857502, + 0.4125926364213228, + 0.10286808013916016, + 0.8206753022968769, + 1.2813323251903057, + 0.8139004074037075, + 0.2659438382834196, + 0.3902660980820656, + 0.4820381663739681, + 1.3619258981198072, + 1.4675064384937286, + 0.7397211343050003, + 0.47508735582232475, + 1.073066322132945, + 0.41129662469029427 + ], + "unique_experts": 64, + "load_cv": 0.5566349522526529, + "normalized_load_entropy": 0.9610464694513103, + "max_load_share": 0.04057971014492753 + } + }, + "s0_period": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "d13a996ca305a902c4b2721dd979c68c8d59e9c5a24f90ceaa219c63dfeb58ac", + "route_weight_sha256": "cd11155d141a29ff14c1e94dab2b4a19efbd02b2090f904ffcf4c53844fac8b8", + "loads": [ + 4, + 1, + 9, + 26, + 5, + 5, + 3, + 21, + 2, + 4, + 2, + 4, + 3, + 5, + 6, + 5, + 9, + 8, + 4, + 10, + 7, + 15, + 5, + 4, + 4, + 20, + 13, + 3, + 5, + 3, + 9, + 17, + 6, + 1, + 9, + 4, + 3, + 12, + 10, + 7, + 1, + 0, + 2, + 5, + 24, + 0, + 3, + 9, + 18, + 11, + 1, + 2, + 9, + 6, + 1, + 6, + 7, + 6, + 3, + 15, + 14, + 0, + 4, + 4 + ], + "weighted_loads": [ + 0.13325930945575237, + 0.037399813532829285, + 0.6864019464701414, + 2.287476373836398, + 0.20634596794843674, + 0.1808116976171732, + 0.33501750230789185, + 1.5931786336004734, + 0.08344498090445995, + 0.1723174825310707, + 0.0870305746793747, + 0.17778674513101578, + 0.16492411121726036, + 0.2351139858365059, + 0.35748419910669327, + 0.2341785803437233, + 0.41043666936457157, + 0.3967545237392187, + 0.12191865779459476, + 0.4582046326249838, + 0.2762381359934807, + 1.1618341691792011, + 0.16727015376091003, + 0.24523817002773285, + 0.1556958220899105, + 2.1378211807459593, + 0.4952205326408148, + 0.13676338642835617, + 0.414231987670064, + 0.09889406338334084, + 0.47520911693573, + 1.3484576046466827, + 0.19505526311695576, + 0.04619578644633293, + 0.7904198672622442, + 0.30032432451844215, + 0.10725646838545799, + 0.3986463341861963, + 0.7955305501818657, + 0.4950577821582556, + 0.03928910940885544, + 0.0, + 0.04797768220305443, + 0.19637997448444366, + 2.1144935954362154, + 0.0, + 0.14258669689297676, + 0.6322756446897984, + 0.823767639696598, + 0.8824423514306545, + 0.033628519624471664, + 0.10342535004019737, + 0.6103003323078156, + 0.35941268131136894, + 0.04213627800345421, + 0.27142583578824997, + 0.3093873281031847, + 0.353379487991333, + 0.7426611892879009, + 1.3997489102184772, + 0.6476461216807365, + 0.0, + 0.23780516907572746, + 0.2229340374469757 + ], + "unique_experts": 61, + "load_cv": 0.8423784739564973, + "normalized_load_entropy": 0.9222556789579256, + "max_load_share": 0.05855855855855856 + }, + "full_input": { + "tokens": 99, + "top_k": 6, + "decisions": 594, + "ordered_route_sha256": "6eb8bb32f82542e05da80576042ab2eb4d561eac1ab5ea58ed6a5a1837a335b4", + "route_weight_sha256": "a75c531f6cc6d168fb0a562a3ecf397ea5ca9694348247f72eb0740cc86e7651", + "loads": [ + 5, + 4, + 10, + 26, + 10, + 9, + 12, + 21, + 2, + 7, + 2, + 4, + 11, + 6, + 12, + 5, + 12, + 8, + 4, + 15, + 7, + 15, + 10, + 11, + 12, + 20, + 13, + 5, + 6, + 8, + 14, + 17, + 6, + 1, + 10, + 5, + 4, + 17, + 12, + 7, + 5, + 2, + 11, + 6, + 25, + 0, + 3, + 16, + 19, + 11, + 1, + 2, + 9, + 10, + 8, + 6, + 7, + 6, + 10, + 15, + 17, + 5, + 11, + 4 + ], + "weighted_loads": [ + 0.17278231866657734, + 0.259085800498724, + 0.7109768558293581, + 2.287476373836398, + 1.146386994048953, + 0.3557976149022579, + 0.77329414896667, + 1.5931786336004734, + 0.08344498090445995, + 0.3574209623038769, + 0.0870305746793747, + 0.17778674513101578, + 0.7075191251933575, + 0.2749268040060997, + 0.8793786354362965, + 0.2341785803437233, + 0.5244797915220261, + 0.3967545237392187, + 0.12191865779459476, + 0.6777993272989988, + 0.2762381359934807, + 1.1618341691792011, + 0.3473126832395792, + 0.5064191734418273, + 0.632233764976263, + 2.1378211807459593, + 0.4952205326408148, + 0.21966969594359398, + 0.5475195217877626, + 0.2923723664134741, + 0.665386650711298, + 1.3484576046466827, + 0.19505526311695576, + 0.04619578644633293, + 0.8587630745023489, + 0.3599959909915924, + 0.16541336104273796, + 0.5996370930224657, + 1.0165184810757637, + 0.4950577821582556, + 0.2016886044293642, + 0.11388767138123512, + 0.6785356998443604, + 0.2536586709320545, + 2.125191275961697, + 0.0, + 0.14258669689297676, + 1.3022683188319206, + 0.8618496879935265, + 0.8824423514306545, + 0.033628519624471664, + 0.10342535004019737, + 0.6103003323078156, + 0.6711801998317242, + 0.9011739306151867, + 0.27142583578824997, + 0.3093873281031847, + 0.353379487991333, + 1.0555639769881964, + 1.3997489102184772, + 0.8447410333901644, + 0.3263317719101906, + 0.7895889207720757, + 0.2229340374469757 + ], + "unique_experts": 63, + "load_cv": 0.6173196602261625, + "normalized_load_entropy": 0.953454646430251, + "max_load_share": 0.04377104377104377 + } + }, + "s1_period": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "1ec781cd91a2862d023c895add16d1374066383cf5c8d54a67070ab10238b244", + "route_weight_sha256": "72fc9322714c4d99cdbd18b8e2260b42a04a4f93dfd92adbb042014010e1c65e", + "loads": [ + 3, + 1, + 10, + 28, + 4, + 3, + 3, + 22, + 1, + 5, + 2, + 4, + 5, + 5, + 5, + 5, + 8, + 10, + 4, + 9, + 6, + 15, + 5, + 5, + 3, + 19, + 12, + 3, + 4, + 3, + 9, + 19, + 5, + 2, + 8, + 5, + 3, + 10, + 10, + 6, + 1, + 1, + 3, + 3, + 23, + 1, + 4, + 8, + 15, + 11, + 2, + 2, + 11, + 9, + 1, + 5, + 7, + 7, + 3, + 15, + 12, + 0, + 5, + 6 + ], + "weighted_loads": [ + 0.11932787299156189, + 0.03163709491491318, + 0.7621370032429695, + 2.6331426724791527, + 0.16616703942418098, + 0.08826799131929874, + 0.3206770196557045, + 1.758666591718793, + 0.05240369588136673, + 0.19685456156730652, + 0.09634141996502876, + 0.17728656716644764, + 0.22027762234210968, + 0.22827614471316338, + 0.3069627694785595, + 0.23875031620264053, + 0.3724840097129345, + 0.41750241070985794, + 0.12646530009806156, + 0.43478140234947205, + 0.2621998284012079, + 1.1908817365765572, + 0.1670121494680643, + 0.27031340822577477, + 0.14434608817100525, + 2.122245494276285, + 0.47171069867908955, + 0.15038005262613297, + 0.396837443113327, + 0.09803368151187897, + 0.41730607114732265, + 1.4689289182424545, + 0.1726907342672348, + 0.08726657554507256, + 0.7249667309224606, + 0.31795304268598557, + 0.10776448994874954, + 0.33793413639068604, + 0.7752460427582264, + 0.44339494965970516, + 0.03343921899795532, + 0.02739682048559189, + 0.09778415970504284, + 0.12237993814051151, + 2.037836480885744, + 0.02649262547492981, + 0.1787816323339939, + 0.548368014395237, + 0.7026728130877018, + 0.8853675276041031, + 0.0786840170621872, + 0.10715170949697495, + 0.6952001955360174, + 0.46891218051314354, + 0.041151970624923706, + 0.2311024982482195, + 0.30148281902074814, + 0.3934643939137459, + 0.7876849137246609, + 1.3462311960756779, + 0.5744829326868057, + 0.0, + 0.25836273469030857, + 0.2735398933291435 + ], + "unique_experts": 63, + "load_cv": 0.8358010698085747, + "normalized_load_entropy": 0.9268149607001767, + "max_load_share": 0.06306306306306306 + }, + "full_input": { + "tokens": 115, + "top_k": 6, + "decisions": 690, + "ordered_route_sha256": "46aead2fc8b54be799bd3b46fcdc90dcd30154941f7f63a60e155c0348150f5a", + "route_weight_sha256": "b59dc2115d8e619a2a841a0e589c6135c1a294e43e46ec6154eac6ef773b0ab8", + "loads": [ + 4, + 7, + 12, + 28, + 16, + 7, + 14, + 22, + 1, + 10, + 3, + 11, + 17, + 5, + 18, + 7, + 11, + 15, + 5, + 17, + 9, + 16, + 12, + 10, + 13, + 19, + 12, + 5, + 6, + 4, + 13, + 19, + 7, + 2, + 9, + 5, + 5, + 13, + 12, + 9, + 5, + 9, + 13, + 4, + 24, + 1, + 4, + 21, + 16, + 13, + 7, + 2, + 14, + 20, + 5, + 5, + 9, + 9, + 13, + 17, + 16, + 10, + 15, + 8 + ], + "weighted_loads": [ + 0.14044182188808918, + 0.4003138467669487, + 0.8229376636445522, + 2.6331426724791527, + 1.6355970781296492, + 0.2748333178460598, + 0.8874365221709013, + 1.758666591718793, + 0.05240369588136673, + 0.44089896604418755, + 0.16350387409329414, + 0.9062396232038736, + 0.8960414379835129, + 0.22827614471316338, + 1.3303654417395592, + 0.3480832315981388, + 0.7623969577252865, + 0.6463220007717609, + 0.2235590759664774, + 0.8329004012048244, + 0.5658505726605654, + 1.2454355955123901, + 0.44306870363652706, + 0.45051100384444, + 0.8152212630957365, + 2.122245494276285, + 0.47171069867908955, + 0.2666286379098892, + 0.5695386566221714, + 0.13216327503323555, + 0.562699019908905, + 1.4689289182424545, + 0.26005916856229305, + 0.08726657554507256, + 0.7904461063444614, + 0.31795304268598557, + 0.18869833648204803, + 0.4210204668343067, + 0.9991648606956005, + 0.5911117196083069, + 0.18478833325207233, + 0.40556688979268074, + 0.8586512301117182, + 0.1594026479870081, + 2.048534161411226, + 0.02649262547492981, + 0.1787816323339939, + 1.5783025473356247, + 0.7357018738985062, + 0.9980248659849167, + 0.4172777384519577, + 0.10715170949697495, + 0.8421810921281576, + 1.3349364809691906, + 0.8126637376844883, + 0.2311024982482195, + 0.384146373718977, + 0.4805845879018307, + 1.2836647015064955, + 1.411676112562418, + 0.773153442889452, + 0.47654394060373306, + 1.023635933175683, + 0.43995555862784386 + ], + "unique_experts": 64, + "load_cv": 0.552514254730427, + "normalized_load_entropy": 0.9617817266047278, + "max_load_share": 0.04057971014492753 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 74, + "ordered_topk_exact_tokens": 44, + "set_exact_tokens": 48, + "mean_set_jaccard": 0.8880308880308879, + "mean_token_weighted_tv": 0.021163884160184377, + "aggregate_load_tv": 0.04504504504504504 + }, + "system_bos": { + "tokens": 74, + "ordered_topk_exact_tokens": 35, + "set_exact_tokens": 46, + "mean_set_jaccard": 0.8787001287001286, + "mean_token_weighted_tv": 0.025772358215338475, + "aggregate_load_tv": 0.04054054054054055 + }, + "system_x": { + "tokens": 74, + "ordered_topk_exact_tokens": 24, + "set_exact_tokens": 33, + "mean_set_jaccard": 0.8191763191763192, + "mean_token_weighted_tv": 0.03537796449067222, + "aggregate_load_tv": 0.04954954954954955 + }, + "system_period": { + "tokens": 74, + "ordered_topk_exact_tokens": 22, + "set_exact_tokens": 31, + "mean_set_jaccard": 0.8108108108108109, + "mean_token_weighted_tv": 0.03733389046848626, + "aggregate_load_tv": 0.06306306306306306 + }, + "bos_at_s0": { + "tokens": 74, + "ordered_topk_exact_tokens": 23, + "set_exact_tokens": 35, + "mean_set_jaccard": 0.8297940797940798, + "mean_token_weighted_tv": 0.032853383470225976, + "aggregate_load_tv": 0.06756756756756757 + }, + "bos_at_s1": { + "tokens": 74, + "ordered_topk_exact_tokens": 33, + "set_exact_tokens": 43, + "mean_set_jaccard": 0.862934362934363, + "mean_token_weighted_tv": 0.03031506315125404, + "aggregate_load_tv": 0.06306306306306307 + }, + "x_at_s0": { + "tokens": 74, + "ordered_topk_exact_tokens": 24, + "set_exact_tokens": 37, + "mean_set_jaccard": 0.8404118404118405, + "mean_token_weighted_tv": 0.03293094772694481, + "aggregate_load_tv": 0.06756756756756757 + }, + "x_at_s1": { + "tokens": 74, + "ordered_topk_exact_tokens": 20, + "set_exact_tokens": 32, + "mean_set_jaccard": 0.8095238095238096, + "mean_token_weighted_tv": 0.03904230989566123, + "aggregate_load_tv": 0.07207207207207209 + }, + "period_at_s0": { + "tokens": 74, + "ordered_topk_exact_tokens": 21, + "set_exact_tokens": 35, + "mean_set_jaccard": 0.8262548262548264, + "mean_token_weighted_tv": 0.035759375267032836, + "aggregate_load_tv": 0.07207207207207207 + }, + "period_at_s1": { + "tokens": 74, + "ordered_topk_exact_tokens": 24, + "set_exact_tokens": 35, + "mean_set_jaccard": 0.8291505791505792, + "mean_token_weighted_tv": 0.03637445514165872, + "aggregate_load_tv": 0.06531531531531531 + } + } + }, + "layer_20": { + "layer": 20, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "0ed5d76f0326616b0351bc8bb3c3a2f84766a9bed3f061c52985c193e3020b8c", + "route_weight_sha256": "aa09d09ca37e97d624e034abcf7993cbcc28f18d636bb61c4a2d39759245fdf7", + "loads": [ + 3, + 3, + 4, + 13, + 3, + 13, + 19, + 6, + 8, + 3, + 3, + 3, + 9, + 3, + 3, + 3, + 3, + 21, + 6, + 25, + 1, + 8, + 7, + 8, + 10, + 2, + 6, + 21, + 6, + 3, + 2, + 16, + 2, + 6, + 2, + 4, + 10, + 10, + 0, + 13, + 0, + 8, + 12, + 8, + 4, + 14, + 12, + 10, + 2, + 3, + 1, + 11, + 15, + 7, + 7, + 3, + 3, + 6, + 3, + 10, + 5, + 4, + 1, + 4 + ], + "weighted_loads": [ + 0.10734645649790764, + 0.08889705128967762, + 0.12564028427004814, + 0.7548776436597109, + 0.12195448949933052, + 0.9982454366981983, + 1.9264553375542164, + 0.31982525810599327, + 0.4225316792726517, + 0.2955549508333206, + 0.11824264377355576, + 0.14702506735920906, + 0.7874007504433393, + 0.24412943795323372, + 0.09825494885444641, + 0.11595055647194386, + 0.10752411186695099, + 1.3715126160532236, + 0.21538257785141468, + 2.0964299365878105, + 0.04001650586724281, + 0.419095516204834, + 0.4697294235229492, + 0.3770868759602308, + 0.908571869134903, + 0.08286460116505623, + 0.20041628554463387, + 1.378763735294342, + 0.6673666574060917, + 0.14530857652425766, + 0.06926270015537739, + 0.5471407249569893, + 0.05620680935680866, + 0.24540703184902668, + 0.049354517832398415, + 0.3698437735438347, + 0.5911316256970167, + 0.41707881167531013, + 0.0, + 0.49031420052051544, + 0.0, + 0.8882943280041218, + 0.7295369878411293, + 0.3829119186848402, + 0.24430417641997337, + 0.7980772685259581, + 0.9594700634479523, + 0.4972781501710415, + 0.07149497605860233, + 0.1077214926481247, + 0.03392408415675163, + 0.43220850825309753, + 0.6448975186794996, + 0.3699177522212267, + 0.28887166641652584, + 0.16218707337975502, + 0.1456831358373165, + 0.20600365288555622, + 0.12235968187451363, + 0.495798634365201, + 0.7422417998313904, + 0.14949459955096245, + 0.040911123156547546, + 0.17770856618881226 + ], + "unique_experts": 62, + "load_cv": 0.7869873434868812, + "normalized_load_entropy": 0.9307613267930853, + "max_load_share": 0.05630630630630631 + }, + "full_input": { + "tokens": 99, + "top_k": 6, + "decisions": 594, + "ordered_route_sha256": "ff8aebedde59be84cd57c54d757fbcb48e081f092c6b5cb9a524c9ee88cc60ae", + "route_weight_sha256": "f82d60441c646e11d5bf131f0ed9a1f4476cfac3a1ca1d697e28cf6dd946b6b0", + "loads": [ + 3, + 6, + 4, + 21, + 11, + 16, + 24, + 13, + 8, + 3, + 3, + 3, + 12, + 3, + 3, + 6, + 4, + 21, + 16, + 25, + 7, + 8, + 14, + 8, + 11, + 9, + 7, + 21, + 6, + 5, + 2, + 16, + 2, + 7, + 4, + 4, + 14, + 13, + 2, + 13, + 1, + 9, + 14, + 11, + 13, + 14, + 12, + 11, + 4, + 5, + 9, + 11, + 15, + 15, + 7, + 6, + 3, + 11, + 4, + 10, + 18, + 8, + 1, + 4 + ], + "weighted_loads": [ + 0.10734645649790764, + 0.16250616125762463, + 0.12564028427004814, + 1.3530669156461954, + 0.5162228234112263, + 1.1224108710885048, + 2.0734852701425552, + 0.9582778494805098, + 0.4225316792726517, + 0.2955549508333206, + 0.11824264377355576, + 0.14702506735920906, + 0.8704052083194256, + 0.24412943795323372, + 0.09825494885444641, + 0.2521922569721937, + 0.14455532655119896, + 1.3715126160532236, + 1.1055029425770044, + 2.0964299365878105, + 0.23931328649632633, + 0.419095516204834, + 0.8792526535689831, + 0.3770868759602308, + 0.9744091853499413, + 0.5792107582092285, + 0.21786369383335114, + 1.378763735294342, + 0.6673666574060917, + 0.21016644686460495, + 0.06926270015537739, + 0.5471407249569893, + 0.05620680935680866, + 0.26843714341521263, + 0.129987308755517, + 0.3698437735438347, + 0.781610120087862, + 0.5017396174371243, + 1.3183590471744537, + 0.49031420052051544, + 0.05501540005207062, + 0.9293707944452763, + 0.9436617642641068, + 0.4533094947692007, + 0.5694744940847158, + 0.7980772685259581, + 0.9594700634479523, + 0.5277163963764906, + 0.10286499420180917, + 0.18592499196529388, + 1.242585513740778, + 0.43220850825309753, + 0.6448975186794996, + 0.8165548834949732, + 0.28887166641652584, + 0.645859245210886, + 0.1456831358373165, + 0.36655994690954685, + 0.15813947468996048, + 0.495798634365201, + 2.050058276159689, + 0.35331193916499615, + 0.040911123156547546, + 0.17770856618881226 + ], + "unique_experts": 64, + "load_cv": 0.6324143033852905, + "normalized_load_entropy": 0.9518059967317659, + "max_load_share": 0.04208754208754209 + } + }, + "s1_eos": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "2da5e67496ad876598b620b10607a0b048e08167f925dfa950f670bbcf6f7cdb", + "route_weight_sha256": "40757ca8f4dc816e84adf1f9dd031f93608cebccd6bad1420e78d49041be1c59", + "loads": [ + 3, + 2, + 3, + 14, + 5, + 13, + 20, + 6, + 8, + 3, + 2, + 3, + 10, + 3, + 3, + 2, + 5, + 20, + 6, + 26, + 1, + 8, + 7, + 9, + 10, + 2, + 5, + 20, + 6, + 2, + 4, + 21, + 2, + 6, + 1, + 5, + 10, + 10, + 0, + 11, + 0, + 6, + 11, + 6, + 5, + 14, + 12, + 10, + 3, + 3, + 1, + 10, + 14, + 5, + 7, + 3, + 5, + 4, + 3, + 10, + 5, + 5, + 1, + 4 + ], + "weighted_loads": [ + 0.10771968215703964, + 0.06097068451344967, + 0.0966642927378416, + 0.7611771374940872, + 0.1809262689203024, + 0.9861137103289366, + 1.9647205993533134, + 0.31686313822865486, + 0.4204106815159321, + 0.29961977154016495, + 0.10632960498332977, + 0.13461999595165253, + 0.8522792309522629, + 0.2357751540839672, + 0.09696443565189838, + 0.06806821376085281, + 0.1600800547748804, + 1.33558682911098, + 0.22218377701938152, + 2.1475825179368258, + 0.03305928036570549, + 0.41915350407361984, + 0.4725717008113861, + 0.4409232512116432, + 0.9047589860856533, + 0.08167105540633202, + 0.17103409580886364, + 1.3423320278525352, + 0.6733269840478897, + 0.11209598556160927, + 0.15138966962695122, + 0.6908205430954695, + 0.054925110191106796, + 0.23236130736768246, + 0.030781418085098267, + 0.38843877613544464, + 0.5991324484348297, + 0.3884889595210552, + 0.0, + 0.41352139599621296, + 0.0, + 0.7914065737277269, + 0.6878433004021645, + 0.3516838476061821, + 0.2762458100914955, + 0.7973740138113499, + 0.9189204014837742, + 0.4933227375149727, + 0.09843497350811958, + 0.10872495919466019, + 0.03420610353350639, + 0.4279089905321598, + 0.6261908877640963, + 0.28750854544341564, + 0.28029584512114525, + 0.15127330645918846, + 0.19411965273320675, + 0.14496389031410217, + 0.11982256919145584, + 0.5023286305367947, + 0.7573646269738674, + 0.1737849935889244, + 0.04012828320264816, + 0.1755094826221466 + ], + "unique_experts": 62, + "load_cv": 0.8045302297068357, + "normalized_load_entropy": 0.9288106763715559, + "max_load_share": 0.05855855855855856 + }, + "full_input": { + "tokens": 115, + "top_k": 6, + "decisions": 690, + "ordered_route_sha256": "2967a79c739e7cda38e38b4755bf674e408345c72730835d120f5f37f73c962b", + "route_weight_sha256": "0a4f3d963ac2f650f293706770ddece1cb3e3b4b88cab1bb08e077177f7db33a", + "loads": [ + 8, + 4, + 3, + 25, + 13, + 18, + 22, + 16, + 8, + 5, + 4, + 3, + 12, + 4, + 4, + 14, + 10, + 20, + 16, + 27, + 8, + 9, + 17, + 11, + 12, + 15, + 6, + 21, + 7, + 8, + 4, + 22, + 3, + 6, + 5, + 6, + 14, + 15, + 3, + 15, + 3, + 7, + 13, + 12, + 18, + 15, + 12, + 11, + 6, + 8, + 13, + 10, + 14, + 15, + 9, + 14, + 7, + 11, + 5, + 12, + 19, + 7, + 2, + 4 + ], + "weighted_loads": [ + 0.3362591899931431, + 0.10516729950904846, + 0.0966642927378416, + 1.538246639072895, + 0.5976276081055403, + 1.1806467771530151, + 2.033724272623658, + 1.0749774035066366, + 0.4204106815159321, + 0.5336041003465652, + 0.19668204337358475, + 0.13461999595165253, + 0.9121882654726505, + 0.5182727389037609, + 0.15562685392796993, + 0.7504715025424957, + 0.4568784534931183, + 1.33558682911098, + 1.2027680929750204, + 2.185784900560975, + 0.2663928559049964, + 0.4519890435039997, + 1.1080237664282322, + 0.6129007041454315, + 1.0015062652528286, + 0.9549583233892918, + 0.1884815040975809, + 1.3790550380945206, + 0.7202079072594643, + 0.2989105936139822, + 0.15138966962695122, + 0.7202841099351645, + 0.10385299474000931, + 0.23236130736768246, + 0.22050649300217628, + 0.5188413262367249, + 0.8174664694815874, + 0.5711486749351025, + 1.3592431470751762, + 0.6101839039474726, + 0.14498120732605457, + 0.8434501122683287, + 0.8978426530957222, + 0.5755819538608193, + 1.1211491860449314, + 0.8699383698403835, + 0.9189204014837742, + 0.5245627034455538, + 0.16667316027451307, + 0.41452888771891594, + 1.8100937455892563, + 0.4279089905321598, + 0.6261908877640963, + 0.8003285713493824, + 0.34234112687408924, + 1.2511404491961002, + 0.27972584404051304, + 0.684974629431963, + 0.19367709755897522, + 0.5556598324328661, + 2.228705714456737, + 0.2638427074998617, + 0.10041053220629692, + 0.1755094826221466 + ], + "unique_experts": 64, + "load_cv": 0.5530006363863701, + "normalized_load_entropy": 0.9629894835210775, + "max_load_share": 0.0391304347826087 + } + }, + "s0_bos": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "c7e0d30200e680c6c074307d1f0395ede5856fc908e0bcdd86055898ee4bee7f", + "route_weight_sha256": "069d4716a32ddca4723d0b2b565034b98862743a1b8a4ce0e9959c03665627f5", + "loads": [ + 2, + 2, + 2, + 12, + 3, + 14, + 19, + 6, + 8, + 3, + 2, + 6, + 9, + 3, + 3, + 5, + 5, + 20, + 5, + 25, + 1, + 7, + 7, + 9, + 10, + 2, + 5, + 20, + 6, + 2, + 2, + 17, + 3, + 5, + 0, + 5, + 7, + 12, + 1, + 17, + 0, + 8, + 12, + 7, + 5, + 14, + 12, + 10, + 2, + 3, + 1, + 10, + 11, + 7, + 7, + 3, + 4, + 6, + 3, + 10, + 5, + 6, + 2, + 4 + ], + "weighted_loads": [ + 0.08159677684307098, + 0.0597041305154562, + 0.06613686308264732, + 0.6905599553138018, + 0.12331635877490044, + 1.0231060851365328, + 1.9471588879823685, + 0.31382108852267265, + 0.44735719077289104, + 0.30250097811222076, + 0.10011976957321167, + 0.2598511651158333, + 0.7904401235282421, + 0.26165295019745827, + 0.09903498366475105, + 0.17735585011541843, + 0.16253884881734848, + 1.3434836454689503, + 0.18915862403810024, + 2.0758774112910032, + 0.04059048742055893, + 0.3771974556148052, + 0.49418236315250397, + 0.4136802442371845, + 0.9527174793183804, + 0.08329159393906593, + 0.1760743483901024, + 1.3753753695636988, + 0.6755655072629452, + 0.11171896010637283, + 0.06989549845457077, + 0.5849006045609713, + 0.09583615325391293, + 0.19440610334277153, + 0.0, + 0.3962591625750065, + 0.4732164368033409, + 0.4849412404000759, + 0.029777128249406815, + 0.602142421528697, + 0.0, + 0.9126530010253191, + 0.7183266244828701, + 0.3645064979791641, + 0.27668333053588867, + 0.8164361007511616, + 0.9816486202180386, + 0.5019000861793756, + 0.06791328079998493, + 0.10108919069170952, + 0.03434188291430473, + 0.3907219357788563, + 0.56660595536232, + 0.43828580528497696, + 0.2784370705485344, + 0.17314216867089272, + 0.17095432616770267, + 0.1931991633027792, + 0.12025643512606621, + 0.4962209463119507, + 0.7356839776039124, + 0.2092062644660473, + 0.07431667298078537, + 0.14882762543857098 + ], + "unique_experts": 62, + "load_cv": 0.7811906985853101, + "normalized_load_entropy": 0.9313119713671524, + "max_load_share": 0.05630630630630631 + }, + "full_input": { + "tokens": 99, + "top_k": 6, + "decisions": 594, + "ordered_route_sha256": "fc939429b2d1ebf89ae31bda0f233402b3149fe2f6b5115a06ab4bec02f96ff1", + "route_weight_sha256": "a55b21dccecd61be9f925e8edba8cc475fb24b6ef6f4b43f9f2e8874edbc95e6", + "loads": [ + 2, + 3, + 2, + 20, + 11, + 17, + 24, + 14, + 8, + 3, + 2, + 7, + 12, + 3, + 3, + 10, + 6, + 20, + 15, + 25, + 5, + 7, + 16, + 9, + 11, + 9, + 8, + 20, + 6, + 4, + 3, + 18, + 3, + 6, + 1, + 5, + 10, + 15, + 2, + 17, + 1, + 10, + 14, + 10, + 15, + 14, + 13, + 12, + 2, + 4, + 9, + 10, + 11, + 13, + 8, + 6, + 4, + 10, + 4, + 10, + 17, + 9, + 2, + 4 + ], + "weighted_loads": [ + 0.08159677684307098, + 0.08386936970055103, + 0.06613686308264732, + 1.2887492273002863, + 0.5175846926867962, + 1.1629596520215273, + 2.0941888205707073, + 0.9345342591404915, + 0.44735719077289104, + 0.30250097811222076, + 0.10011976957321167, + 0.9944436028599739, + 0.8734445814043283, + 0.26165295019745827, + 0.09903498366475105, + 0.43881663493812084, + 0.19957006350159645, + 1.3434836454689503, + 1.07927898876369, + 2.0758774112910032, + 0.19474534690380096, + 0.3771974556148052, + 0.9827186912298203, + 0.4136802442371845, + 1.0213679857552052, + 0.5729515850543976, + 0.2737385369837284, + 1.3753753695636988, + 0.6755655072629452, + 0.17657683044672012, + 0.10820849612355232, + 0.5951511794701219, + 0.09583615325391293, + 0.21743621490895748, + 0.043164484202861786, + 0.3962591625750065, + 0.6305820401757956, + 0.56960204616189, + 0.3939198739826679, + 0.602142421528697, + 0.04521181061863899, + 0.9645222630351782, + 0.9345554523169994, + 0.5192095562815666, + 0.6598139125853777, + 0.8164361007511616, + 1.1126086227595806, + 0.5410532969981432, + 0.06791328079998493, + 0.13161356933414936, + 1.3000589720904827, + 0.3907219357788563, + 0.56660595536232, + 0.7981515191495419, + 0.3098791353404522, + 0.6532029248774052, + 0.17095432616770267, + 0.313787491992116, + 0.15603622794151306, + 0.4962209463119507, + 2.0552628487348557, + 0.3697266299277544, + 0.07431667298078537, + 0.14882762543857098 + ], + "unique_experts": 64, + "load_cv": 0.6395445414238417, + "normalized_load_entropy": 0.9496244139046554, + "max_load_share": 0.04208754208754209 + } + }, + "s1_bos": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "d97315db39b9daccd7e1d7eb30f3d750e1b5a4b349b32f9a9222e8c6b5e2a4f9", + "route_weight_sha256": "1dcbe37e1f1b44615c9dbce81c874bff38a4e170dd5cc6c59928518352721bca", + "loads": [ + 4, + 3, + 3, + 13, + 4, + 13, + 19, + 5, + 8, + 4, + 2, + 5, + 8, + 3, + 4, + 4, + 7, + 20, + 5, + 25, + 2, + 7, + 7, + 9, + 10, + 1, + 4, + 21, + 6, + 2, + 3, + 19, + 3, + 4, + 1, + 5, + 7, + 12, + 1, + 15, + 2, + 8, + 11, + 7, + 5, + 14, + 12, + 9, + 3, + 2, + 1, + 11, + 10, + 7, + 6, + 3, + 3, + 4, + 3, + 10, + 5, + 5, + 1, + 4 + ], + "weighted_loads": [ + 0.15177014470100403, + 0.08681653067469597, + 0.09474942088127136, + 0.7131869588047266, + 0.15572240948677063, + 1.0121092926710844, + 1.9588683880865574, + 0.25493770837783813, + 0.4508430138230324, + 0.34006016328930855, + 0.10978119820356369, + 0.1935495249927044, + 0.7311773430556059, + 0.2717730477452278, + 0.12395507656037807, + 0.14947955310344696, + 0.2210211046040058, + 1.3672710191458464, + 0.20479666441679, + 2.1324529759585857, + 0.07910487055778503, + 0.36720044538378716, + 0.49269629642367363, + 0.4267357103526592, + 0.9521180540323257, + 0.04836687073111534, + 0.13914690911769867, + 1.452648587524891, + 0.6693283319473267, + 0.09730048105120659, + 0.11059504747390747, + 0.6947335693985224, + 0.08933930471539497, + 0.16693351417779922, + 0.027820801362395287, + 0.3829382359981537, + 0.46210064366459846, + 0.49266792088747025, + 0.031188316643238068, + 0.5410670265555382, + 0.07415617071092129, + 0.9323932398110628, + 0.7036420218646526, + 0.357273830100894, + 0.26385407894849777, + 0.8059789501130581, + 0.9466443285346031, + 0.4524681940674782, + 0.09838764928281307, + 0.07195784896612167, + 0.036050379276275635, + 0.43170637264847755, + 0.5130451917648315, + 0.37601855769753456, + 0.24530245922505856, + 0.15317979454994202, + 0.13419712707400322, + 0.1314139310270548, + 0.12253367155790329, + 0.5045132301747799, + 0.7225852087140083, + 0.17080299369990826, + 0.0386645644903183, + 0.15939561650156975 + ], + "unique_experts": 64, + "load_cv": 0.7732543220512221, + "normalized_load_entropy": 0.9363945157800323, + "max_load_share": 0.05630630630630631 + }, + "full_input": { + "tokens": 115, + "top_k": 6, + "decisions": 690, + "ordered_route_sha256": "d45ed7ce7c80af10fdf3155699c63e7730ae2c5ae8633d4aa29eec0f497d5645", + "route_weight_sha256": "ab0c05bb54a9d9936836ffcca082e311257a4d24512301c15b504f9683ea4293", + "loads": [ + 9, + 5, + 3, + 24, + 12, + 19, + 21, + 16, + 8, + 6, + 4, + 5, + 10, + 4, + 5, + 17, + 12, + 20, + 15, + 26, + 8, + 8, + 18, + 11, + 12, + 14, + 6, + 22, + 7, + 7, + 3, + 20, + 4, + 4, + 5, + 6, + 11, + 18, + 3, + 20, + 5, + 10, + 13, + 13, + 19, + 15, + 12, + 11, + 3, + 7, + 14, + 11, + 10, + 16, + 7, + 14, + 4, + 11, + 4, + 12, + 18, + 7, + 2, + 4 + ], + "weighted_loads": [ + 0.3815714195370674, + 0.14386484771966934, + 0.09474942088127136, + 1.4902564603835344, + 0.5724237486720085, + 1.2687303945422173, + 2.027872061356902, + 1.0522088017314672, + 0.4508430138230324, + 0.5740444920957088, + 0.20013363659381866, + 0.1935495249927044, + 0.7910863775759935, + 0.5542706325650215, + 0.18261749483644962, + 0.9018581099808216, + 0.5178195033222437, + 1.3672710191458464, + 1.185380980372429, + 2.170655358582735, + 0.3064109943807125, + 0.400035984814167, + 1.1602793633937836, + 0.5987131632864475, + 1.0558637380599976, + 0.9113225787878036, + 0.2053162194788456, + 1.4893715977668762, + 0.7162092551589012, + 0.23258271627128124, + 0.11059504747390747, + 0.7241971362382174, + 0.13826718926429749, + 0.16693351417779922, + 0.17126287147402763, + 0.5133407860994339, + 0.6641271989792585, + 0.7180312015116215, + 0.4395139813423157, + 0.7960281111299992, + 0.21722065284848213, + 1.0246638376265764, + 0.9137673638761044, + 0.6704467441886663, + 1.164882156997919, + 0.8785433061420918, + 0.9466443285346031, + 0.5156023111194372, + 0.09838764928281307, + 0.4122229032218456, + 1.9860470853745937, + 0.43170637264847755, + 0.5130451917648315, + 0.8659525532275438, + 0.2731545940041542, + 1.2768905386328697, + 0.18002497032284737, + 0.6714246701449156, + 0.15859194099903107, + 0.5578444320708513, + 2.1974814236164093, + 0.26310464181005955, + 0.09894681349396706, + 0.15939561650156975 + ], + "unique_experts": 64, + "load_cv": 0.5604855817740556, + "normalized_load_entropy": 0.9619035273015767, + "max_load_share": 0.03768115942028986 + } + }, + "s0_x": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "584f68c03b7b41ad963d5f686edf04d5c6539a851a3968a20ec6a411624631a5", + "route_weight_sha256": "3db1d68d8624881f9bec9d0a1be783152fcefab1c24ec5a1d3ed78314c77e7f6", + "loads": [ + 2, + 2, + 3, + 12, + 6, + 13, + 20, + 6, + 9, + 4, + 2, + 6, + 11, + 3, + 3, + 2, + 4, + 21, + 5, + 25, + 1, + 7, + 7, + 9, + 10, + 3, + 4, + 21, + 7, + 2, + 3, + 17, + 3, + 5, + 0, + 5, + 7, + 13, + 1, + 15, + 0, + 7, + 11, + 7, + 5, + 14, + 11, + 8, + 4, + 2, + 1, + 7, + 12, + 6, + 7, + 3, + 4, + 6, + 3, + 10, + 5, + 7, + 1, + 4 + ], + "weighted_loads": [ + 0.0757143497467041, + 0.05922377295792103, + 0.1011812873184681, + 0.6743075586855412, + 0.20348893478512764, + 1.0312683284282684, + 1.9918556492775679, + 0.2918735668063164, + 0.5066394694149494, + 0.341666541993618, + 0.10195116326212883, + 0.2364351563155651, + 0.8740361910313368, + 0.2761055678129196, + 0.09991833008825779, + 0.07333636470139027, + 0.1364120114594698, + 1.3679537866264582, + 0.17993801459670067, + 2.1279024221003056, + 0.03797633945941925, + 0.378133337944746, + 0.4721122495830059, + 0.41261436231434345, + 0.9565325118601322, + 0.10979704558849335, + 0.1300627775490284, + 1.4199176914989948, + 0.7122199758887291, + 0.0968371331691742, + 0.10375269129872322, + 0.596733245998621, + 0.09034389071166515, + 0.19095579162240028, + 0.0, + 0.3909657374024391, + 0.4728657752275467, + 0.5126367192715406, + 0.035441190004348755, + 0.5707786995917559, + 0.0, + 0.9028867091983557, + 0.6890621222555637, + 0.34103889390826225, + 0.27697304263710976, + 0.822186753153801, + 0.8891399949789047, + 0.4585067369043827, + 0.12645498663187027, + 0.07305557653307915, + 0.03406152129173279, + 0.2995279263705015, + 0.5636624488979578, + 0.3822776637971401, + 0.27958112955093384, + 0.16032536327838898, + 0.15809307247400284, + 0.1911088265478611, + 0.11552285775542259, + 0.510451490059495, + 0.6951960157603025, + 0.25753516145050526, + 0.04367714375257492, + 0.15398358553647995 + ], + "unique_experts": 62, + "load_cv": 0.784094377726541, + "normalized_load_entropy": 0.9316466308513374, + "max_load_share": 0.05630630630630631 + }, + "full_input": { + "tokens": 99, + "top_k": 6, + "decisions": 594, + "ordered_route_sha256": "30d09620ceb9189ffc64256aeeb50b79f56e993009bda1fcc40b03006c929b68", + "route_weight_sha256": "0008f1c344d841b2785c5e72bb674e2a4e8c49ed2dc51abd6686d0c4490b2949", + "loads": [ + 2, + 4, + 3, + 20, + 15, + 15, + 26, + 13, + 9, + 4, + 2, + 6, + 14, + 4, + 3, + 5, + 5, + 21, + 16, + 25, + 5, + 7, + 14, + 9, + 11, + 11, + 5, + 21, + 7, + 6, + 3, + 17, + 3, + 6, + 1, + 5, + 11, + 16, + 2, + 15, + 3, + 8, + 13, + 9, + 17, + 14, + 11, + 8, + 4, + 3, + 9, + 7, + 12, + 11, + 8, + 7, + 4, + 12, + 4, + 10, + 18, + 10, + 1, + 4 + ], + "weighted_loads": [ + 0.0757143497467041, + 0.1216315645724535, + 0.1011812873184681, + 1.2724968306720257, + 0.7215378470718861, + 1.1061150133609772, + 2.1765236016362906, + 0.7833558488637209, + 0.5066394694149494, + 0.341666541993618, + 0.10195116326212883, + 0.2364351563155651, + 0.957040648907423, + 0.30370048992335796, + 0.09991833008825779, + 0.19182605855166912, + 0.17344322614371777, + 1.3679537866264582, + 1.168991845101118, + 2.1279024221003056, + 0.20591427385807037, + 0.378133337944746, + 0.8696535155177116, + 0.41261436231434345, + 1.0346494875848293, + 0.638818945735693, + 0.14751018583774567, + 1.4199176914989948, + 0.7122199758887291, + 0.22976377978920937, + 0.10375269129872322, + 0.596733245998621, + 0.09034389071166515, + 0.21398590318858624, + 0.03642374277114868, + 0.3909657374024391, + 0.6842900943011045, + 0.5972975250333548, + 0.39958393573760986, + 0.5707786995917559, + 0.09255996532738209, + 0.9439631756395102, + 0.9048270024359226, + 0.41100505739450455, + 0.733715370297432, + 0.822186753153801, + 0.8891399949789047, + 0.4585067369043827, + 0.12645498663187027, + 0.11155568808317184, + 1.2850710563361645, + 0.2995279263705015, + 0.5636624488979578, + 0.7119330577552319, + 0.31040132977068424, + 0.6855620332062244, + 0.15809307247400284, + 0.40398258715867996, + 0.15130265057086945, + 0.510451490059495, + 2.1979955676943064, + 0.4404843579977751, + 0.04367714375257492, + 0.15398358553647995 + ], + "unique_experts": 64, + "load_cv": 0.6463155692308614, + "normalized_load_entropy": 0.9504889261078651, + "max_load_share": 0.04377104377104377 + } + }, + "s1_x": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "d05fe1f2ee57db5d19402920478a3af8d796153c9f41da354777a5455d7d6eee", + "route_weight_sha256": "a9025a2afa23fd8a9a6bc940ec9b612a86b7ec6148c20628df49e26ba9f592e2", + "loads": [ + 3, + 2, + 4, + 16, + 6, + 13, + 19, + 5, + 9, + 5, + 2, + 3, + 8, + 2, + 3, + 3, + 7, + 20, + 5, + 26, + 3, + 6, + 6, + 8, + 10, + 3, + 1, + 22, + 7, + 2, + 4, + 18, + 3, + 4, + 1, + 6, + 7, + 11, + 1, + 10, + 2, + 8, + 10, + 8, + 5, + 13, + 12, + 9, + 1, + 5, + 1, + 12, + 12, + 7, + 4, + 3, + 3, + 5, + 3, + 10, + 6, + 6, + 1, + 4 + ], + "weighted_loads": [ + 0.11620723828673363, + 0.05567900277674198, + 0.11717933602631092, + 0.8131924495100975, + 0.25444121286273, + 1.0067739896476269, + 1.9429284147918224, + 0.23197050392627716, + 0.5009436756372452, + 0.3705579340457916, + 0.09773583337664604, + 0.11521009728312492, + 0.7527733407914639, + 0.23616669327020645, + 0.09854053147137165, + 0.12123971059918404, + 0.22665551118552685, + 1.380169253796339, + 0.18903017044067383, + 2.208071392029524, + 0.11032525077462196, + 0.35510584712028503, + 0.3984081894159317, + 0.42303745821118355, + 0.9773681983351707, + 0.11103333905339241, + 0.04883698746562004, + 1.5017682183533907, + 0.699124176055193, + 0.09813414886593819, + 0.15857523679733276, + 0.6581960748881102, + 0.08981103263795376, + 0.15024182572960854, + 0.030693959444761276, + 0.3897315487265587, + 0.4760422483086586, + 0.41247591003775597, + 0.031028803437948227, + 0.36951796151697636, + 0.07275266945362091, + 0.9480192363262177, + 0.694625735282898, + 0.45148973166942596, + 0.29706720262765884, + 0.7896803505718708, + 0.8832354303449392, + 0.49861030653119087, + 0.033940497785806656, + 0.17012912221252918, + 0.03220748528838158, + 0.46943203546106815, + 0.5742691978812218, + 0.3484266474843025, + 0.1870337538421154, + 0.1435937136411667, + 0.11777370423078537, + 0.15856043808162212, + 0.11667866259813309, + 0.5076751336455345, + 0.739121425896883, + 0.2034646775573492, + 0.039848797023296356, + 0.16943740099668503 + ], + "unique_experts": 64, + "load_cv": 0.7828512625924454, + "normalized_load_entropy": 0.9347083226962067, + "max_load_share": 0.05855855855855856 + }, + "full_input": { + "tokens": 115, + "top_k": 6, + "decisions": 690, + "ordered_route_sha256": "07ac22ea9dc67a32e1a1fc8b04aac1186894e4d786cb79693c4c4f0963ece158", + "route_weight_sha256": "58322f42f3a0e86ffffe4b097e1fb62c8d0910b37ab4f2daa9d6f58677ddade8", + "loads": [ + 7, + 3, + 4, + 28, + 16, + 20, + 22, + 16, + 9, + 7, + 4, + 3, + 10, + 3, + 4, + 16, + 13, + 20, + 16, + 27, + 7, + 8, + 16, + 10, + 13, + 17, + 2, + 24, + 8, + 7, + 4, + 19, + 4, + 4, + 3, + 7, + 11, + 17, + 3, + 14, + 5, + 9, + 12, + 12, + 20, + 14, + 12, + 9, + 1, + 9, + 14, + 12, + 12, + 15, + 6, + 14, + 4, + 13, + 4, + 12, + 21, + 8, + 2, + 4 + ], + "weighted_loads": [ + 0.3098794259130955, + 0.07984424196183681, + 0.11717933602631092, + 1.6226941235363483, + 0.8260676972568035, + 1.287866035476327, + 2.0499158706516027, + 0.8864496927708387, + 0.5009436756372452, + 0.6045422628521919, + 0.18808827176690102, + 0.11521009728312492, + 0.8126823753118515, + 0.5186642780900002, + 0.1572029497474432, + 0.8436252176761627, + 0.6618024744093418, + 1.380169253796339, + 1.2826530486345291, + 2.246273774653673, + 0.2711495943367481, + 0.42038366943597794, + 1.0114368945360184, + 0.5950149111449718, + 1.1143940053880215, + 1.0452083870768547, + 0.06628439575433731, + 1.5782413091510534, + 0.7460050992667675, + 0.23341638408601284, + 0.15857523679733276, + 0.6876596417278051, + 0.13873891718685627, + 0.15024182572960854, + 0.10013193637132645, + 0.5201340988278389, + 0.703362176194787, + 0.6361981257796288, + 0.43935446813702583, + 0.566180469468236, + 0.21771196834743023, + 1.0000627748668194, + 0.8977033942937851, + 0.6358607932925224, + 1.2364685498178005, + 0.8622447066009045, + 0.8832354303449392, + 0.49861030653119087, + 0.033940497785806656, + 0.40512446872889996, + 1.846442986279726, + 0.46943203546106815, + 0.5742691978812218, + 0.7043234761804342, + 0.2551055531948805, + 1.2609591260552406, + 0.16360154747962952, + 0.7472867723554373, + 0.15273693203926086, + 0.561006335541606, + 2.3609084524214268, + 0.31986928544938564, + 0.10013104602694511, + 0.16943740099668503 + ], + "unique_experts": 64, + "load_cv": 0.6041166624245234, + "normalized_load_entropy": 0.9552242717563453, + "max_load_share": 0.04057971014492753 + } + }, + "s0_period": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "5bc272003e4ea33d7aa8c16b975c7ebd0dd8ab21808dfa0d6c77605562169c26", + "route_weight_sha256": "98505c26c4dbf76644562826a2f202599607c1aefd1190f98ceee988e6aaa299", + "loads": [ + 3, + 2, + 4, + 13, + 3, + 13, + 19, + 6, + 10, + 4, + 2, + 7, + 11, + 3, + 4, + 3, + 5, + 20, + 4, + 26, + 1, + 6, + 7, + 8, + 10, + 2, + 5, + 21, + 7, + 2, + 4, + 17, + 3, + 5, + 0, + 5, + 7, + 13, + 1, + 13, + 0, + 7, + 11, + 8, + 5, + 14, + 11, + 9, + 2, + 3, + 1, + 9, + 11, + 8, + 6, + 3, + 3, + 5, + 3, + 10, + 5, + 7, + 1, + 3 + ], + "weighted_loads": [ + 0.11083933711051941, + 0.059124087914824486, + 0.1264928188174963, + 0.7056533955037594, + 0.12237401306629181, + 1.0011160168796778, + 1.963488157838583, + 0.27742405608296394, + 0.5525418315082788, + 0.3345389924943447, + 0.09336072579026222, + 0.2614417038857937, + 0.8839317578822374, + 0.26285747811198235, + 0.12521942704916, + 0.10560903325676918, + 0.17836553789675236, + 1.3455541841685772, + 0.1396812368184328, + 2.1903792060911655, + 0.03568337485194206, + 0.35713572055101395, + 0.47563251107931137, + 0.4043505825102329, + 0.9566809982061386, + 0.07868922501802444, + 0.16561920568346977, + 1.424012590199709, + 0.7193180024623871, + 0.10096915066242218, + 0.13389681093394756, + 0.6170458104461432, + 0.0926961861550808, + 0.19185250997543335, + 0.0, + 0.3869255483150482, + 0.46470244228839874, + 0.4999721385538578, + 0.030752623453736305, + 0.5171969681978226, + 0.0, + 0.8913988843560219, + 0.7073011435568333, + 0.3571388926357031, + 0.271354790776968, + 0.8264952916651964, + 0.8711096234619617, + 0.4793123882263899, + 0.06118752434849739, + 0.10274337232112885, + 0.03215523064136505, + 0.35153889283537865, + 0.5386917311698198, + 0.44106256775557995, + 0.24833384342491627, + 0.1650853529572487, + 0.1302870810031891, + 0.15451645106077194, + 0.1165807731449604, + 0.5226638726890087, + 0.7136905863881111, + 0.2529612649232149, + 0.042701780796051025, + 0.12646888382732868 + ], + "unique_experts": 62, + "load_cv": 0.7786932129385958, + "normalized_load_entropy": 0.9323282975706211, + "max_load_share": 0.05855855855855856 + }, + "full_input": { + "tokens": 99, + "top_k": 6, + "decisions": 594, + "ordered_route_sha256": "5f45b8859376fdebe6bd468ee166f652a3bce87e7c43cbd9d1ed007aaf127678", + "route_weight_sha256": "4f7fee4a84863cb5f866eef5d4e26842a280d9914ada5dc2323137abf841c0b5", + "loads": [ + 3, + 4, + 4, + 21, + 12, + 15, + 25, + 15, + 10, + 4, + 2, + 7, + 15, + 3, + 4, + 6, + 6, + 20, + 14, + 26, + 6, + 6, + 14, + 8, + 11, + 11, + 6, + 21, + 7, + 5, + 4, + 17, + 3, + 6, + 1, + 5, + 10, + 16, + 2, + 14, + 2, + 8, + 13, + 10, + 16, + 14, + 11, + 9, + 2, + 4, + 10, + 9, + 11, + 14, + 7, + 6, + 3, + 10, + 4, + 10, + 17, + 11, + 1, + 3 + ], + "weighted_loads": [ + 0.11083933711051941, + 0.125781686976552, + 0.1264928188174963, + 1.303842667490244, + 0.5656170956790447, + 1.0759627018123865, + 2.165796961635351, + 1.0699495114386082, + 0.5525418315082788, + 0.3345389924943447, + 0.09336072579026222, + 0.2614417038857937, + 1.0143784396350384, + 0.26285747811198235, + 0.12521942704916, + 0.22950921580195427, + 0.21539675258100033, + 1.3455541841685772, + 1.0298016015440226, + 2.1903792060911655, + 0.2534032501280308, + 0.35713572055101395, + 0.8758261129260063, + 0.4043505825102329, + 1.0447560921311378, + 0.6783629916608334, + 0.18306661397218704, + 1.424012590199709, + 0.7193180024623871, + 0.2010597549378872, + 0.13389681093394756, + 0.6170458104461432, + 0.0926961861550808, + 0.2148826215416193, + 0.03571818396449089, + 0.3869255483150482, + 0.6264097075909376, + 0.5846329443156719, + 0.3948953691869974, + 0.5552806854248047, + 0.09182332828640938, + 0.9324753507971764, + 0.9194191806018353, + 0.42964271642267704, + 0.678214343264699, + 0.8264952916651964, + 0.8711096234619617, + 0.4793123882263899, + 0.06118752434849739, + 0.1612134650349617, + 1.2916520237922668, + 0.35153889283537865, + 0.5386917311698198, + 0.8015424888581038, + 0.27501508221030235, + 0.6421906873583794, + 0.1302870810031891, + 0.30217529460787773, + 0.15236056596040726, + 0.5226638726890087, + 2.025394342839718, + 0.4767645578831434, + 0.042701780796051025, + 0.12646888382732868 + ], + "unique_experts": 64, + "load_cv": 0.6384090548941448, + "normalized_load_entropy": 0.9513182465752819, + "max_load_share": 0.04377104377104377 + } + }, + "s1_period": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "c6485b5fc91447782c8e49a85703f4647499150a3fc6c744237288530d24e355", + "route_weight_sha256": "b8f2031f79d309f51566f9285c15ac5125dfd4b66c2897edb6793d94a671880d", + "loads": [ + 4, + 3, + 4, + 14, + 5, + 14, + 19, + 5, + 9, + 5, + 2, + 3, + 9, + 2, + 3, + 4, + 3, + 20, + 5, + 28, + 0, + 6, + 6, + 8, + 10, + 2, + 1, + 21, + 6, + 2, + 4, + 21, + 2, + 4, + 1, + 6, + 8, + 15, + 0, + 13, + 1, + 7, + 11, + 8, + 5, + 13, + 12, + 9, + 2, + 5, + 1, + 9, + 12, + 6, + 5, + 3, + 3, + 5, + 3, + 10, + 7, + 5, + 1, + 4 + ], + "weighted_loads": [ + 0.15186391025781631, + 0.08366662263870239, + 0.11849427968263626, + 0.7702758815139532, + 0.21600395813584328, + 1.0505114551633596, + 1.9634605254977942, + 0.22775255143642426, + 0.5023362692445517, + 0.3629647344350815, + 0.09592213854193687, + 0.12184569984674454, + 0.7964755389839411, + 0.22935114800930023, + 0.09748663380742073, + 0.14822923578321934, + 0.10294175148010254, + 1.3850647993385792, + 0.19995412975549698, + 2.225656732916832, + 0.0, + 0.3521334379911423, + 0.4007767513394356, + 0.4121965169906616, + 0.993770245462656, + 0.072028623893857, + 0.0470954030752182, + 1.4730488769710064, + 0.6633120961487293, + 0.09450370445847511, + 0.1539965532720089, + 0.7346686664968729, + 0.06933942809700966, + 0.16663796454668045, + 0.026781223714351654, + 0.4007359556853771, + 0.4948823656886816, + 0.6220013108104467, + 0.0, + 0.48029550164937973, + 0.045625489205121994, + 0.8998998925089836, + 0.7299257647246122, + 0.41990491189062595, + 0.28667205199599266, + 0.7952974438667297, + 0.9004132486879826, + 0.48318061605095863, + 0.06545456871390343, + 0.1633896753191948, + 0.03045472502708435, + 0.3728277590125799, + 0.5604373794049025, + 0.31918063946068287, + 0.21184365265071392, + 0.1446193866431713, + 0.11699704080820084, + 0.1451105885207653, + 0.11565040051937103, + 0.5140534453094006, + 0.7809848934412003, + 0.1843824815005064, + 0.040907904505729675, + 0.17084408551454544 + ], + "unique_experts": 62, + "load_cv": 0.829171492033487, + "normalized_load_entropy": 0.925599073018407, + "max_load_share": 0.06306306306306306 + }, + "full_input": { + "tokens": 115, + "top_k": 6, + "decisions": 690, + "ordered_route_sha256": "e8ef84259f2753682bca072a160ce37f556311ee035a142c4e72ee83c27a9095", + "route_weight_sha256": "efeede5df28b423c5ed67736e7dee5a1339eb3b1bc30b70a471ea37f4db821a7", + "loads": [ + 8, + 4, + 4, + 25, + 14, + 19, + 22, + 17, + 9, + 7, + 4, + 3, + 13, + 3, + 4, + 16, + 8, + 20, + 16, + 29, + 5, + 7, + 16, + 10, + 12, + 16, + 2, + 22, + 7, + 7, + 4, + 22, + 3, + 4, + 4, + 7, + 12, + 21, + 2, + 18, + 5, + 8, + 13, + 12, + 21, + 14, + 12, + 9, + 2, + 10, + 14, + 9, + 12, + 14, + 7, + 15, + 4, + 12, + 4, + 12, + 21, + 8, + 2, + 4 + ], + "weighted_loads": [ + 0.34553609788417816, + 0.10783186182379723, + 0.11849427968263626, + 1.547345383092761, + 0.6726240627467632, + 1.2450445219874382, + 2.071007903665304, + 0.9543619845062494, + 0.5023362692445517, + 0.5969490632414818, + 0.18627457693219185, + 0.12184569984674454, + 0.9340287800878286, + 0.5118487328290939, + 0.15614905208349228, + 0.8576811645179987, + 0.3997401501983404, + 1.3850647993385792, + 1.2129570357501507, + 2.2638591155409813, + 0.19840558990836143, + 0.38496897742152214, + 1.0587700940668583, + 0.5841739699244499, + 1.1221812702715397, + 1.0722482781857252, + 0.06454281136393547, + 1.5097718872129917, + 0.7101930193603039, + 0.22978593967854977, + 0.1539965532720089, + 0.7641322333365679, + 0.11826731264591217, + 0.16663796454668045, + 0.128506600856781, + 0.5311385057866573, + 0.7030209675431252, + 0.8452199082821608, + 0.4083256646990776, + 0.7206507176160812, + 0.23039701022207737, + 0.9519434310495853, + 0.9301225822418928, + 0.6042759735137224, + 1.2249058205634356, + 0.8678617998957634, + 0.9004132486879826, + 0.48318061605095863, + 0.06545456871390343, + 0.48383665457367897, + 1.793389681726694, + 0.3728277590125799, + 0.5604373794049025, + 0.6859068125486374, + 0.2876424826681614, + 1.2937982864677906, + 0.16282488405704498, + 0.6851213276386261, + 0.1517086699604988, + 0.567384647205472, + 2.3072533160448074, + 0.34311393089592457, + 0.10119015350937843, + 0.17084408551454544 + ], + "unique_experts": 64, + "load_cv": 0.613610249533271, + "normalized_load_entropy": 0.954279786275498, + "max_load_share": 0.042028985507246375 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 74, + "ordered_topk_exact_tokens": 42, + "set_exact_tokens": 48, + "mean_set_jaccard": 0.8996138996138998, + "mean_token_weighted_tv": 0.01854995168695176, + "aggregate_load_tv": 0.04954954954954955 + }, + "system_bos": { + "tokens": 74, + "ordered_topk_exact_tokens": 34, + "set_exact_tokens": 44, + "mean_set_jaccard": 0.8790218790218791, + "mean_token_weighted_tv": 0.02411850168042489, + "aggregate_load_tv": 0.04504504504504504 + }, + "system_x": { + "tokens": 74, + "ordered_topk_exact_tokens": 26, + "set_exact_tokens": 31, + "mean_set_jaccard": 0.8005148005148005, + "mean_token_weighted_tv": 0.03689817261152171, + "aggregate_load_tv": 0.07882882882882883 + }, + "system_period": { + "tokens": 74, + "ordered_topk_exact_tokens": 22, + "set_exact_tokens": 30, + "mean_set_jaccard": 0.8133848133848135, + "mean_token_weighted_tv": 0.03398401125309032, + "aggregate_load_tv": 0.06306306306306306 + }, + "bos_at_s0": { + "tokens": 74, + "ordered_topk_exact_tokens": 26, + "set_exact_tokens": 40, + "mean_set_jaccard": 0.862934362934363, + "mean_token_weighted_tv": 0.02607421880285885, + "aggregate_load_tv": 0.05405405405405406 + }, + "bos_at_s1": { + "tokens": 74, + "ordered_topk_exact_tokens": 23, + "set_exact_tokens": 35, + "mean_set_jaccard": 0.8384813384813385, + "mean_token_weighted_tv": 0.030948821065091604, + "aggregate_load_tv": 0.06306306306306306 + }, + "x_at_s0": { + "tokens": 74, + "ordered_topk_exact_tokens": 26, + "set_exact_tokens": 37, + "mean_set_jaccard": 0.8375160875160876, + "mean_token_weighted_tv": 0.031004982257916314, + "aggregate_load_tv": 0.07207207207207207 + }, + "x_at_s1": { + "tokens": 74, + "ordered_topk_exact_tokens": 19, + "set_exact_tokens": 26, + "mean_set_jaccard": 0.797940797940798, + "mean_token_weighted_tv": 0.0389016171967661, + "aggregate_load_tv": 0.07882882882882883 + }, + "period_at_s0": { + "tokens": 74, + "ordered_topk_exact_tokens": 22, + "set_exact_tokens": 29, + "mean_set_jaccard": 0.8095238095238095, + "mean_token_weighted_tv": 0.03524783371972877, + "aggregate_load_tv": 0.06306306306306307 + }, + "period_at_s1": { + "tokens": 74, + "ordered_topk_exact_tokens": 20, + "set_exact_tokens": 31, + "mean_set_jaccard": 0.8166023166023167, + "mean_token_weighted_tv": 0.03688172490109463, + "aggregate_load_tv": 0.06756756756756754 + } + } + }, + "layer_21": { + "layer": 21, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "5ecaae26ea363ac252fcc893f1dcda9314b8b9918705fabc9319d85d37c56585", + "route_weight_sha256": "31408a9a6c1ff6ec41235a0e0f18bbaeea5212fe7cf40d951ecadd5425a328b0", + "loads": [ + 5, + 11, + 10, + 4, + 3, + 13, + 4, + 3, + 5, + 9, + 9, + 3, + 2, + 2, + 8, + 6, + 8, + 4, + 3, + 4, + 20, + 2, + 10, + 10, + 10, + 1, + 2, + 11, + 3, + 8, + 14, + 6, + 10, + 12, + 2, + 7, + 0, + 2, + 10, + 6, + 33, + 5, + 5, + 33, + 20, + 1, + 8, + 9, + 0, + 5, + 9, + 5, + 1, + 0, + 2, + 1, + 4, + 6, + 5, + 4, + 13, + 7, + 1, + 5 + ], + "weighted_loads": [ + 0.17322519607841969, + 1.301372880116105, + 0.3571855388581753, + 0.13549191877245903, + 0.10863689333200455, + 0.7945180535316467, + 0.14525062032043934, + 0.11886543035507202, + 0.1942632757127285, + 0.7041445299983025, + 0.7140233553946018, + 0.11178014054894447, + 0.060147520154714584, + 0.09055572748184204, + 0.38628496043384075, + 0.2555488124489784, + 0.3237991947680712, + 0.15613210946321487, + 0.11705215275287628, + 0.13247991539537907, + 1.1939478572458029, + 0.06133628636598587, + 0.599421314895153, + 0.5689332205802202, + 0.6352150365710258, + 0.039540570229291916, + 0.11614298447966576, + 0.5589766167104244, + 0.10977562516927719, + 0.6638244166970253, + 0.9665724895894527, + 0.21944458410143852, + 0.4728882238268852, + 0.7917256690561771, + 0.08501764014363289, + 0.2688071187585592, + 0.0, + 0.061154358088970184, + 0.6471368186175823, + 0.19906305335462093, + 1.5720437914133072, + 0.28624015487730503, + 0.26120446249842644, + 2.3436722699552774, + 1.2661630362272263, + 0.035494450479745865, + 0.441722609102726, + 0.8225300833582878, + 0.0, + 0.1916918382048607, + 0.5141191259026527, + 0.2991250157356262, + 0.045718964189291, + 0.0, + 0.07352330163121223, + 0.032138943672180176, + 0.404782947152853, + 0.4565827213227749, + 0.3117818031460047, + 0.19467639923095703, + 0.5340258050709963, + 0.3138924576342106, + 0.03996424004435539, + 0.3021283634006977 + ], + "unique_experts": 61, + "load_cv": 0.9211684178024447, + "normalized_load_entropy": 0.9162332754540371, + "max_load_share": 0.07432432432432433 + }, + "full_input": { + "tokens": 99, + "top_k": 6, + "decisions": 594, + "ordered_route_sha256": "422348a0543774a3bd621b7846de3006c0c986fd1419170e3f69332475006da7", + "route_weight_sha256": "afedca55a2a32eb5e7e073312ec798343d70aa20b9b822ae4ff9b9a82676bf4f", + "loads": [ + 5, + 12, + 13, + 4, + 10, + 14, + 7, + 3, + 7, + 9, + 18, + 4, + 7, + 7, + 10, + 12, + 10, + 7, + 3, + 8, + 20, + 10, + 10, + 11, + 10, + 2, + 11, + 16, + 7, + 8, + 17, + 6, + 11, + 12, + 3, + 17, + 0, + 2, + 10, + 7, + 34, + 5, + 9, + 33, + 20, + 1, + 8, + 9, + 10, + 7, + 9, + 12, + 11, + 1, + 5, + 4, + 6, + 6, + 8, + 8, + 13, + 7, + 3, + 5 + ], + "weighted_loads": [ + 0.17322519607841969, + 1.4385038260370493, + 0.43146979343146086, + 0.13549191877245903, + 0.36650384590029716, + 0.8321557454764843, + 0.3909409884363413, + 0.11886543035507202, + 0.29134372249245644, + 0.7041445299983025, + 1.2888664044439793, + 0.14389117434620857, + 0.2861065901815891, + 0.43940358981490135, + 0.4678706992417574, + 0.46474161464720964, + 0.36365553829818964, + 0.24140241090208292, + 0.11705215275287628, + 1.6833538468927145, + 1.1939478572458029, + 0.5227201608940959, + 0.599421314895153, + 0.6111844126135111, + 0.6352150365710258, + 0.0750335268676281, + 0.5477188043296337, + 1.02956148609519, + 0.21108555095270276, + 0.6638244166970253, + 1.143692184239626, + 0.21944458410143852, + 0.49574148282408714, + 0.7917256690561771, + 0.1339438073337078, + 0.84005082026124, + 0.0, + 0.061154358088970184, + 0.6471368186175823, + 0.23904545418918133, + 1.6235531121492386, + 0.28624015487730503, + 0.49022791907191277, + 2.3436722699552774, + 1.2661630362272263, + 0.035494450479745865, + 0.441722609102726, + 0.8225300833582878, + 0.5568216554820538, + 0.5408505722880363, + 0.5141191259026527, + 0.6270722858607769, + 0.6803056225180626, + 0.013012474402785301, + 0.16777277179062366, + 0.41348445415496826, + 0.6530559696257114, + 0.4565827213227749, + 0.4521837383508682, + 0.3691928070038557, + 0.5340258050709963, + 0.3138924576342106, + 0.12957803532481194, + 0.3021283634006977 + ], + "unique_experts": 63, + "load_cv": 0.6694750899087611, + "normalized_load_entropy": 0.9518595306687128, + "max_load_share": 0.05723905723905724 + } + }, + "s1_eos": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "d447558b47a8eb1039702071f79d82e17148047eac1840c0f2ff3fcab0fa369f", + "route_weight_sha256": "1961c36d102621561a99a08afb3fcc3a2b1bd4b49681bef16fb9525e4acc9236", + "loads": [ + 5, + 11, + 8, + 4, + 3, + 14, + 5, + 1, + 5, + 9, + 9, + 5, + 2, + 3, + 10, + 6, + 7, + 4, + 3, + 2, + 19, + 2, + 10, + 11, + 11, + 0, + 2, + 10, + 2, + 9, + 14, + 5, + 11, + 12, + 2, + 7, + 0, + 2, + 12, + 6, + 36, + 4, + 5, + 33, + 20, + 1, + 9, + 9, + 0, + 5, + 9, + 5, + 2, + 1, + 1, + 0, + 5, + 5, + 4, + 4, + 11, + 6, + 1, + 5 + ], + "weighted_loads": [ + 0.1823373530060053, + 1.2351408898830414, + 0.29617680981755257, + 0.13016167655587196, + 0.11775249987840652, + 0.8369422201067209, + 0.1778349131345749, + 0.04795999079942703, + 0.2001790702342987, + 0.7092860490083694, + 0.7052715420722961, + 0.17102584801614285, + 0.05928155593574047, + 0.11881010606884956, + 0.4399458710104227, + 0.25402458384633064, + 0.2977568097412586, + 0.16100463271141052, + 0.11868659779429436, + 0.06866948679089546, + 1.1580860614776611, + 0.07159940153360367, + 0.6118155345320702, + 0.6326439082622528, + 0.6726155579090118, + 0.0, + 0.11513984948396683, + 0.5297755710780621, + 0.07402929291129112, + 0.6908951122313738, + 0.8826791048049927, + 0.1889766063541174, + 0.5017171334475279, + 0.7787103075534105, + 0.08121426589787006, + 0.2529103197157383, + 0.0, + 0.0624042022973299, + 0.7010358795523643, + 0.19859172403812408, + 1.6811352279037237, + 0.24497457221150398, + 0.26294976472854614, + 2.314299175515771, + 1.4092755541205406, + 0.03477044776082039, + 0.4919436350464821, + 0.7934529259800911, + 0.0, + 0.19301758706569672, + 0.5052701644599438, + 0.3041869215667248, + 0.0740492232143879, + 0.03495782986283302, + 0.04320396110415459, + 0.0, + 0.45812201499938965, + 0.37013402581214905, + 0.2641156315803528, + 0.1888478733599186, + 0.4808289110660553, + 0.3081840053200722, + 0.040083061903715134, + 0.30342015251517296 + ], + "unique_experts": 60, + "load_cv": 0.9577979099453889, + "normalized_load_entropy": 0.9096991676366214, + "max_load_share": 0.08108108108108109 + }, + "full_input": { + "tokens": 115, + "top_k": 6, + "decisions": 690, + "ordered_route_sha256": "8565c88a8f4309b999482c44eecb88bcc8c4db2d6e6adf839f35cf1e254545d7", + "route_weight_sha256": "b4db009c9d811c6257b886ab468291897e57a962ebd9ae5c7faba41dde42aa86", + "loads": [ + 12, + 13, + 11, + 5, + 3, + 16, + 9, + 2, + 10, + 11, + 20, + 5, + 7, + 13, + 15, + 11, + 10, + 13, + 5, + 8, + 20, + 9, + 11, + 16, + 12, + 3, + 11, + 19, + 6, + 10, + 21, + 5, + 12, + 16, + 2, + 23, + 1, + 3, + 13, + 7, + 36, + 6, + 13, + 34, + 21, + 2, + 9, + 9, + 10, + 8, + 11, + 15, + 12, + 2, + 13, + 11, + 10, + 5, + 7, + 9, + 12, + 7, + 3, + 6 + ], + "weighted_loads": [ + 0.6539132781326771, + 1.415513925254345, + 0.9880534647963941, + 0.1575265619903803, + 0.11775249987840652, + 0.8842277061194181, + 0.3577123023569584, + 0.12640489637851715, + 0.4000570699572563, + 0.8551287837326527, + 1.3871274553239346, + 0.17102584801614285, + 0.2983586471527815, + 0.6688710208982229, + 0.6510513238608837, + 0.4338494911789894, + 0.38045714143663645, + 0.4786838497966528, + 0.17180812917649746, + 1.6664068084210157, + 1.2043528072535992, + 0.5101571390405297, + 0.6418662276118994, + 1.1306395884603262, + 0.7090207040309906, + 0.09744143299758434, + 0.47655768133699894, + 1.3977478183805943, + 0.1476939655840397, + 0.7400312814861536, + 1.2292871940881014, + 0.1889766063541174, + 0.5244079101830721, + 1.3726656306535006, + 0.08121426589787006, + 1.1365806870162487, + 0.06994215399026871, + 0.10301738418638706, + 0.752830907702446, + 0.23794390633702278, + 1.6811352279037237, + 0.3699740506708622, + 0.6722208298742771, + 2.3564276453107595, + 1.4734624028205872, + 0.09574900940060616, + 0.4919436350464821, + 0.7934529259800911, + 0.7896717488765717, + 1.2778600603342056, + 0.5848251804709435, + 1.0200312212109566, + 0.6843520514667034, + 0.047970304265618324, + 0.7534746937453747, + 0.805693244561553, + 0.8088173735886812, + 0.37013402581214905, + 0.4015536643564701, + 0.45229518599808216, + 0.5032315030694008, + 0.36960041150450706, + 0.11527839303016663, + 0.39641445502638817 + ], + "unique_experts": 64, + "load_cv": 0.6242525461188394, + "normalized_load_entropy": 0.9564138104143804, + "max_load_share": 0.05217391304347826 + } + }, + "s0_bos": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "81ebbd6027a7cd57508b5ef392283b3dd09d6dc14a4e80f84a00c46ae49acab9", + "route_weight_sha256": "ac60ee6bed17ec868cd7a6ee72b9829c37aec5d8afa9b1841e8401031d279e09", + "loads": [ + 3, + 8, + 9, + 4, + 3, + 12, + 4, + 3, + 6, + 8, + 7, + 5, + 3, + 5, + 8, + 6, + 6, + 3, + 4, + 4, + 19, + 3, + 9, + 10, + 10, + 1, + 3, + 12, + 5, + 9, + 16, + 6, + 10, + 12, + 2, + 7, + 0, + 2, + 10, + 6, + 31, + 6, + 4, + 32, + 22, + 1, + 8, + 9, + 0, + 7, + 9, + 5, + 2, + 0, + 3, + 0, + 4, + 5, + 4, + 4, + 12, + 7, + 1, + 5 + ], + "weighted_loads": [ + 0.1065131351351738, + 1.1236827746033669, + 0.3447287082672119, + 0.13294907845556736, + 0.11082075908780098, + 0.7513259537518024, + 0.15545909106731415, + 0.13136624917387962, + 0.23048024252057076, + 0.6743957214057446, + 0.616559311747551, + 0.18344631604850292, + 0.09861717186868191, + 0.18940073251724243, + 0.3868058528751135, + 0.2505875639617443, + 0.2674827463924885, + 0.12715324759483337, + 0.15993756242096424, + 0.13626252859830856, + 1.1593538410961628, + 0.10173776559531689, + 0.5514401122927666, + 0.592778081074357, + 0.6414842307567596, + 0.04564058035612106, + 0.14785873889923096, + 0.6247824784368277, + 0.16825855150818825, + 0.6826440617442131, + 1.0735469795763493, + 0.2142880391329527, + 0.4625793341547251, + 0.7925250679254532, + 0.0840592309832573, + 0.23280807957053185, + 0.0, + 0.06226944923400879, + 0.6534159816801548, + 0.1985872145742178, + 1.5397408250719309, + 0.30396702513098717, + 0.22191718965768814, + 2.3043389227241278, + 1.5427976623177528, + 0.03417007252573967, + 0.47106475569307804, + 0.8475616089999676, + 0.0, + 0.24691645614802837, + 0.5231265388429165, + 0.30748525634407997, + 0.07220372371375561, + 0.0, + 0.11153051815927029, + 0.0, + 0.40841221809387207, + 0.42701205238699913, + 0.2834478095173836, + 0.20248246751725674, + 0.4839402176439762, + 0.2954604681581259, + 0.03597359359264374, + 0.297605711966753 + ], + "unique_experts": 60, + "load_cv": 0.886323503658185, + "normalized_load_entropy": 0.9216812916927508, + "max_load_share": 0.07207207207207207 + }, + "full_input": { + "tokens": 99, + "top_k": 6, + "decisions": 594, + "ordered_route_sha256": "7e09c55e69d050c7f049373cdd526e57e65050a818e5a4d10809317677546b1b", + "route_weight_sha256": "db3be57098ba38b483fa71172be220a62f3ff8da31f80a5b4b6866dcc4db6a03", + "loads": [ + 3, + 11, + 11, + 5, + 8, + 13, + 6, + 3, + 10, + 8, + 15, + 6, + 8, + 10, + 10, + 11, + 7, + 6, + 5, + 7, + 19, + 10, + 9, + 11, + 10, + 2, + 12, + 17, + 8, + 9, + 18, + 8, + 11, + 12, + 3, + 17, + 0, + 2, + 10, + 7, + 33, + 6, + 8, + 32, + 22, + 2, + 8, + 9, + 10, + 9, + 9, + 12, + 12, + 1, + 6, + 4, + 6, + 5, + 6, + 8, + 12, + 7, + 4, + 5 + ], + "weighted_loads": [ + 0.1065131351351738, + 1.309595288708806, + 0.41649316623806953, + 0.32986349798738956, + 0.30124034732580185, + 0.7829247750341892, + 0.35857829079031944, + 0.13136624917387962, + 0.4044502377510071, + 0.6743957214057446, + 1.113639123737812, + 0.2105538323521614, + 0.3420022651553154, + 0.49445950239896774, + 0.46807929314672947, + 0.44512505643069744, + 0.28077266830950975, + 0.23370609059929848, + 0.20733811147511005, + 0.7452280707657337, + 1.1593538410961628, + 0.5618867082521319, + 0.5514401122927666, + 0.6350292731076479, + 0.6414842307567596, + 0.08113353699445724, + 0.5880497768521309, + 1.0904096346348524, + 0.2631204193457961, + 0.6826440617442131, + 1.2224131487309933, + 0.37405348382890224, + 0.485432593151927, + 0.7925250679254532, + 0.13298539817333221, + 0.8040517810732126, + 0.0, + 0.06226944923400879, + 0.6534159816801548, + 0.239731939509511, + 1.6786237638443708, + 0.30396702513098717, + 0.4506065659224987, + 2.3043389227241278, + 1.5427976623177528, + 0.15709305182099342, + 0.47106475569307804, + 0.8475616089999676, + 0.5568216554820538, + 0.5722200404852629, + 0.5231265388429165, + 0.6354325264692307, + 0.7067903820425272, + 0.013012474402785301, + 0.20577998831868172, + 0.42478858307003975, + 0.6496631279587746, + 0.42701205238699913, + 0.3467440251260996, + 0.3681766390800476, + 0.4839402176439762, + 0.2954604681581259, + 0.18246326968073845, + 0.297605711966753 + ], + "unique_experts": 63, + "load_cv": 0.6463155692308614, + "normalized_load_entropy": 0.9553466059274588, + "max_load_share": 0.05555555555555555 + } + }, + "s1_bos": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "5b0e3a69c6ae1e059398ecaf6829484aa0c92cfe7bb8ee62824a1f8cfdb9e100", + "route_weight_sha256": "bde8e3f39aa631748ab176dd44cde63ed55d2137318237e291cfdaeba6b766cb", + "loads": [ + 2, + 10, + 7, + 6, + 5, + 12, + 4, + 3, + 4, + 8, + 7, + 5, + 2, + 4, + 7, + 6, + 7, + 4, + 4, + 4, + 19, + 2, + 9, + 10, + 11, + 1, + 3, + 12, + 3, + 8, + 15, + 5, + 12, + 11, + 2, + 7, + 0, + 2, + 11, + 8, + 28, + 5, + 5, + 36, + 21, + 1, + 8, + 9, + 0, + 7, + 9, + 6, + 2, + 1, + 3, + 0, + 4, + 6, + 4, + 4, + 10, + 7, + 1, + 5 + ], + "weighted_loads": [ + 0.08133549243211746, + 1.1777868922799826, + 0.2837271150201559, + 0.19390434212982655, + 0.17909930273890495, + 0.7483109161257744, + 0.14758320152759552, + 0.12173041328787804, + 0.15593226626515388, + 0.6594568192958832, + 0.5889436192810535, + 0.18023704923689365, + 0.06638146005570889, + 0.14546752721071243, + 0.344839658588171, + 0.2585091982036829, + 0.298190925270319, + 0.15656931325793266, + 0.1496352180838585, + 0.135375889018178, + 1.15969517827034, + 0.07293906062841415, + 0.5605854578316212, + 0.6342944838106632, + 0.652374591678381, + 0.044359829276800156, + 0.1488768383860588, + 0.6241985019296408, + 0.11715183779597282, + 0.643192745745182, + 0.9675348177552223, + 0.18799294158816338, + 0.5538649521768093, + 0.7614564411342144, + 0.08349454961717129, + 0.24267824925482273, + 0.0, + 0.06608152575790882, + 0.6826379224658012, + 0.26364298164844513, + 1.418692458420992, + 0.2699051406234503, + 0.2538265436887741, + 2.499455440789461, + 1.5774492099881172, + 0.032932914793491364, + 0.46716475300490856, + 0.8163662850856781, + 0.0, + 0.26261116191744804, + 0.5083684101700783, + 0.3492783512920141, + 0.07104498706758022, + 0.03577068820595741, + 0.10811488330364227, + 0.0, + 0.4186224564909935, + 0.4559944346547127, + 0.26998480036854744, + 0.18889247998595238, + 0.42123251408338547, + 0.32386973313987255, + 0.0369655080139637, + 0.2940901853144169 + ], + "unique_experts": 61, + "load_cv": 0.8947084474333588, + "normalized_load_entropy": 0.9218101215623276, + "max_load_share": 0.08108108108108109 + }, + "full_input": { + "tokens": 115, + "top_k": 6, + "decisions": 690, + "ordered_route_sha256": "20cd2dee1acbb21e16bb4611554eeaf56ebf7d9f1d69667c8a27196ecc9724be", + "route_weight_sha256": "3e9ef7d737660e382014e75a055eabef1ce228c70987a35c422aed9eed3b4726", + "loads": [ + 9, + 13, + 10, + 6, + 8, + 13, + 10, + 5, + 9, + 10, + 16, + 7, + 8, + 13, + 12, + 10, + 8, + 11, + 8, + 9, + 20, + 8, + 10, + 15, + 12, + 4, + 12, + 22, + 5, + 9, + 21, + 6, + 13, + 15, + 2, + 23, + 1, + 3, + 12, + 9, + 29, + 7, + 13, + 37, + 22, + 2, + 8, + 9, + 10, + 11, + 11, + 16, + 12, + 2, + 15, + 11, + 9, + 6, + 5, + 9, + 11, + 8, + 4, + 6 + ], + "weighted_loads": [ + 0.5529114175587893, + 1.3587589021772146, + 1.0097628943622112, + 0.19390434212982655, + 0.29398978501558304, + 0.7630732879042625, + 0.45879990607500076, + 0.23681210353970528, + 0.36456744000315666, + 0.8052995540201664, + 1.177760075777769, + 0.25925989635288715, + 0.36979437433183193, + 0.6120177078992128, + 0.5564291048794985, + 0.43662109784781933, + 0.31148084718734026, + 0.435738991945982, + 0.3028895538300276, + 0.7948540784418583, + 1.205961924046278, + 0.5034911492839456, + 0.5906361509114504, + 1.1322901640087366, + 0.6887797378003597, + 0.1418012622743845, + 0.5114565212279558, + 1.537688409909606, + 0.14776126574724913, + 0.6923289149999619, + 1.2826383467763662, + 0.28634336218237877, + 0.5765557289123535, + 1.3554117642343044, + 0.08349454961717129, + 1.1263486165553331, + 0.06994215399026871, + 0.10669470764696598, + 0.7344329506158829, + 0.29730233922600746, + 1.4639035873115063, + 0.3949046190828085, + 0.6604194492101669, + 2.5415839105844498, + 1.6416360586881638, + 0.09391147643327713, + 0.46716475300490856, + 0.8163662850856781, + 0.7896717488765717, + 1.3902002684772015, + 0.587923426181078, + 1.065122650936246, + 0.6813478153198957, + 0.048783162608742714, + 0.823357529938221, + 0.7758347522467375, + 0.7389673981815577, + 0.4559944346547127, + 0.2949337363243103, + 0.44443156756460667, + 0.44363510608673096, + 0.38528613932430744, + 0.18091009557247162, + 0.3870844878256321 + ], + "unique_experts": 64, + "load_cv": 0.5835164893846128, + "normalized_load_entropy": 0.9628660826275947, + "max_load_share": 0.0536231884057971 + } + }, + "s0_x": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "332f4785cfab8a438b458cc3b3d6aa98e6fda4bbb71cb65a77aa41f9508cf198", + "route_weight_sha256": "8bcd09c4c9c0b34c36e04d34f8223329672f922462757ce66b8280ffbc70b1a0", + "loads": [ + 3, + 9, + 8, + 4, + 4, + 14, + 4, + 3, + 4, + 8, + 8, + 7, + 2, + 4, + 8, + 5, + 6, + 3, + 4, + 3, + 20, + 3, + 9, + 11, + 10, + 1, + 4, + 11, + 3, + 8, + 14, + 3, + 11, + 12, + 3, + 7, + 0, + 2, + 10, + 8, + 31, + 6, + 5, + 31, + 22, + 1, + 8, + 9, + 0, + 6, + 9, + 6, + 2, + 2, + 2, + 2, + 4, + 5, + 4, + 4, + 11, + 7, + 1, + 5 + ], + "weighted_loads": [ + 0.1098275501281023, + 1.130498731508851, + 0.321547569707036, + 0.12462480738759041, + 0.143613887950778, + 0.8125494718551636, + 0.15658867731690407, + 0.1269024759531021, + 0.15244876593351364, + 0.6681482903659344, + 0.6416224651038647, + 0.2547973059117794, + 0.08148592710494995, + 0.14497917145490646, + 0.3752031046897173, + 0.220830786973238, + 0.2659953571856022, + 0.12163959816098213, + 0.16043800860643387, + 0.10775266960263252, + 1.1920113693922758, + 0.1018022745847702, + 0.5811701789498329, + 0.6895440630614758, + 0.6369086243212223, + 0.043954331427812576, + 0.1756955999881029, + 0.5528165474534035, + 0.09670842997729778, + 0.6512323133647442, + 0.9743692055344582, + 0.10030131973326206, + 0.5025357604026794, + 0.7929103597998619, + 0.12072378024458885, + 0.25109836272895336, + 0.0, + 0.05763910338282585, + 0.6517086625099182, + 0.27110546082258224, + 1.5075223688036203, + 0.30019029788672924, + 0.2564135976135731, + 2.2728863526135683, + 1.5447635725140572, + 0.0333595871925354, + 0.4670388102531433, + 0.8189159147441387, + 0.0, + 0.22422187216579914, + 0.5418970957398415, + 0.3379936944693327, + 0.07442878559231758, + 0.063382338732481, + 0.06840941123664379, + 0.06946151331067085, + 0.41796426475048065, + 0.4123096168041229, + 0.2807707376778126, + 0.17972389236092567, + 0.445756945759058, + 0.3116613235324621, + 0.03644205257296562, + 0.29702920839190483 + ], + "unique_experts": 62, + "load_cv": 0.8767483142415755, + "normalized_load_entropy": 0.9253554277838372, + "max_load_share": 0.06981981981981981 + }, + "full_input": { + "tokens": 99, + "top_k": 6, + "decisions": 594, + "ordered_route_sha256": "49d1e88357aa010539d6c3a456098e1309051067235f2bde353ee87f7d0505f2", + "route_weight_sha256": "edf5d3e0a899fbada5b5458d35d756d6c654a9bdcbf69cc03f706ee4b1e2c71b", + "loads": [ + 3, + 10, + 10, + 4, + 9, + 14, + 7, + 3, + 7, + 8, + 18, + 7, + 7, + 8, + 10, + 11, + 8, + 7, + 5, + 6, + 20, + 9, + 9, + 12, + 10, + 2, + 13, + 16, + 6, + 8, + 16, + 3, + 12, + 13, + 4, + 18, + 0, + 2, + 10, + 8, + 31, + 6, + 11, + 31, + 22, + 1, + 8, + 9, + 12, + 9, + 9, + 13, + 13, + 3, + 6, + 5, + 7, + 5, + 6, + 8, + 11, + 7, + 3, + 5 + ], + "weighted_loads": [ + 0.1098275501281023, + 1.2351664323359728, + 0.39331202767789364, + 0.12462480738759041, + 0.3340334761887789, + 0.8125494718551636, + 0.4153841845691204, + 0.1269024759531021, + 0.29302432015538216, + 0.6681482903659344, + 1.2753625698387623, + 0.2547973059117794, + 0.3319843076169491, + 0.4819377101957798, + 0.4562531765550375, + 0.46916878409683704, + 0.30893552023917437, + 0.2716450020670891, + 0.20448719337582588, + 0.7173700742423534, + 1.1920113693922758, + 0.5198725098744035, + 0.5811701789498329, + 0.7317952550947666, + 0.6369086243212223, + 0.07944728806614876, + 0.6098228339105844, + 0.9956274330615997, + 0.1983891250565648, + 0.6512323133647442, + 1.1098742261528969, + 0.10030131973326206, + 0.5253890193998814, + 0.8248159661889076, + 0.16964994743466377, + 0.9162227921187878, + 0.0, + 0.05763910338282585, + 0.6517086625099182, + 0.27110546082258224, + 1.5075223688036203, + 0.30019029788672924, + 0.565063888207078, + 2.2728863526135683, + 1.5447635725140572, + 0.0333595871925354, + 0.4670388102531433, + 0.8189159147441387, + 0.682210361585021, + 0.49994915165007114, + 0.5418970957398415, + 0.6659409645944834, + 0.9011745005846024, + 0.0763948131352663, + 0.1945386417210102, + 0.4303426593542099, + 0.7098124884068966, + 0.4123096168041229, + 0.34755306504666805, + 0.3484695050865412, + 0.445756945759058, + 0.3116613235324621, + 0.12176593393087387, + 0.29702920839190483 + ], + "unique_experts": 63, + "load_cv": 0.64067801551109, + "normalized_load_entropy": 0.9550902583685655, + "max_load_share": 0.05218855218855219 + } + }, + "s1_x": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "7b06f8e26661179aae61e3bce5f121604b9b889d38d3cce5dca0bb141ba545a9", + "route_weight_sha256": "f6be61f58a923171240a9cf4ebd2308c25260d47608084eac319dc6fd6e748b4", + "loads": [ + 4, + 8, + 7, + 4, + 6, + 12, + 4, + 2, + 5, + 8, + 8, + 4, + 3, + 1, + 8, + 6, + 8, + 4, + 3, + 4, + 18, + 2, + 10, + 10, + 10, + 1, + 3, + 12, + 2, + 9, + 14, + 6, + 13, + 10, + 2, + 8, + 0, + 2, + 10, + 8, + 30, + 4, + 4, + 37, + 23, + 0, + 7, + 9, + 1, + 7, + 9, + 6, + 1, + 4, + 1, + 0, + 4, + 7, + 4, + 4, + 10, + 7, + 1, + 5 + ], + "weighted_loads": [ + 0.1586056873202324, + 1.0816186051815748, + 0.31379761546850204, + 0.14015371166169643, + 0.21763921529054642, + 0.6991773806512356, + 0.1483137160539627, + 0.07903653010725975, + 0.1854952797293663, + 0.6556261852383614, + 0.6035040598362684, + 0.14944351091980934, + 0.1042698435485363, + 0.045210517942905426, + 0.36729734390974045, + 0.248812697827816, + 0.31673644483089447, + 0.15812887251377106, + 0.10681973770260811, + 0.12703136168420315, + 1.1247941255569458, + 0.0720858983695507, + 0.6301434487104416, + 0.7423577588051558, + 0.6328828018158674, + 0.04795900732278824, + 0.14238044619560242, + 0.591787789016962, + 0.07734231650829315, + 0.7131052985787392, + 0.881491519510746, + 0.2249420080333948, + 0.5913947783410549, + 0.7037605531513691, + 0.09581738337874413, + 0.32259792275726795, + 0.0, + 0.0655441377311945, + 0.6233838014304638, + 0.2529744952917099, + 1.473356269299984, + 0.23849976062774658, + 0.252578005194664, + 2.4662360697984695, + 1.687049426138401, + 0.0, + 0.4003589488565922, + 0.8005686551332474, + 0.029377784579992294, + 0.25282569229602814, + 0.49706730246543884, + 0.3764670863747597, + 0.06113807111978531, + 0.12704268470406532, + 0.03321310505270958, + 0.0, + 0.43385448679327965, + 0.4607124663889408, + 0.26851245388388634, + 0.17942737601697445, + 0.44498115591704845, + 0.3357245083898306, + 0.03611769154667854, + 0.31387023255228996 + ], + "unique_experts": 61, + "load_cv": 0.9309842084919197, + "normalized_load_entropy": 0.9164908654312415, + "max_load_share": 0.08333333333333333 + }, + "full_input": { + "tokens": 115, + "top_k": 6, + "decisions": 690, + "ordered_route_sha256": "4c0f14253bf0d03721eb069f98f9c38047efa04bf8ea0767dcae1ac9b777d131", + "route_weight_sha256": "52facf60b80ec64397ae66ff11d89adef80d00bc41432eb4bd2931571881143a", + "loads": [ + 11, + 10, + 9, + 4, + 8, + 13, + 7, + 3, + 9, + 10, + 19, + 4, + 11, + 10, + 13, + 10, + 10, + 12, + 6, + 8, + 19, + 7, + 11, + 16, + 11, + 6, + 12, + 21, + 4, + 10, + 20, + 6, + 14, + 14, + 2, + 26, + 1, + 3, + 11, + 9, + 30, + 7, + 14, + 38, + 25, + 1, + 7, + 9, + 14, + 11, + 11, + 16, + 12, + 5, + 12, + 11, + 9, + 7, + 5, + 9, + 11, + 8, + 2, + 6 + ], + "weighted_loads": [ + 0.6301816124469042, + 1.1747515369206667, + 1.003004239872098, + 0.14015371166169643, + 0.3014961928129196, + 0.7139397524297237, + 0.25622621551156044, + 0.15748143568634987, + 0.3790080286562443, + 0.8014689199626446, + 1.3039509002119303, + 0.14944351091980934, + 0.505222961306572, + 0.5081196147948503, + 0.5780627746134996, + 0.40752478316426277, + 0.3601990966126323, + 0.46509869024157524, + 0.22787429206073284, + 0.7544703595340252, + 1.1710608713328838, + 0.4640255505219102, + 0.6601941417902708, + 1.2897378206253052, + 0.6692879479378462, + 0.24220064468681812, + 0.506596153602004, + 1.3775309212505817, + 0.10795174445956945, + 0.762241467833519, + 1.1806471776217222, + 0.2249420080333948, + 0.6140855550765991, + 1.2977158762514591, + 0.09581738337874413, + 1.3115184549242258, + 0.06994215399026871, + 0.10615731962025166, + 0.6751788295805454, + 0.2881735861301422, + 1.473356269299984, + 0.43946829438209534, + 0.7543470114469528, + 2.508364539593458, + 1.7842673994600773, + 0.06097856163978577, + 0.4003589488565922, + 0.8005686551332474, + 1.0810941755771637, + 1.2234909571707249, + 0.5766223184764385, + 1.0923113860189915, + 0.8779670894145966, + 0.14005515910685062, + 0.7185608483850956, + 0.9169025141745806, + 0.7812083046883345, + 0.4607124663889408, + 0.2934613898396492, + 0.482150599360466, + 0.46738374792039394, + 0.3971409145742655, + 0.07106349244713783, + 0.4068645350635052 + ], + "unique_experts": 64, + "load_cv": 0.6201476201546281, + "normalized_load_entropy": 0.9580858777697725, + "max_load_share": 0.05507246376811594 + } + }, + "s0_period": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "4e5b01e961984ee9e0fc4437cfeaa7a3ff147ca82a293ebd9c3a67abc8e85046", + "route_weight_sha256": "f5d23f73738adf98a078503d8b30e4c0ec17cf4c3e47cd601172a28171d9eb9d", + "loads": [ + 2, + 7, + 7, + 5, + 5, + 15, + 4, + 3, + 5, + 8, + 7, + 6, + 4, + 2, + 7, + 6, + 8, + 3, + 4, + 3, + 18, + 3, + 10, + 11, + 11, + 1, + 3, + 12, + 3, + 8, + 14, + 4, + 12, + 12, + 4, + 7, + 0, + 1, + 12, + 7, + 31, + 5, + 5, + 34, + 23, + 1, + 6, + 9, + 0, + 6, + 9, + 6, + 2, + 1, + 1, + 0, + 5, + 4, + 4, + 5, + 10, + 6, + 2, + 5 + ], + "weighted_loads": [ + 0.07885649800300598, + 1.0850750133395195, + 0.28065970353782177, + 0.15381123311817646, + 0.17575353384017944, + 0.8336137644946575, + 0.1468172650784254, + 0.11979096755385399, + 0.19644368812441826, + 0.667118489742279, + 0.5935689061880112, + 0.21104552038013935, + 0.13632217049598694, + 0.0804452896118164, + 0.3589362856000662, + 0.25168430991470814, + 0.3343977089971304, + 0.1187652088701725, + 0.16531605646014214, + 0.10690245404839516, + 1.12067162245512, + 0.10159527324140072, + 0.6219368893653154, + 0.6588844377547503, + 0.6596304681152105, + 0.04076329246163368, + 0.14602387696504593, + 0.6066293492913246, + 0.099118797108531, + 0.6694458946585655, + 0.9755546189844608, + 0.1329385582357645, + 0.5349934846162796, + 0.7931641116738319, + 0.14983468502759933, + 0.24437116645276546, + 0.0, + 0.027498187497258186, + 0.7270766030997038, + 0.23095008917152882, + 1.5038047451525927, + 0.282032398506999, + 0.2666441723704338, + 2.401366278529167, + 1.5535058304667473, + 0.034000907093286514, + 0.3618423044681549, + 0.8253161124885082, + 0.0, + 0.2153677847236395, + 0.5526267401874065, + 0.3435078524053097, + 0.07896792888641357, + 0.03600912168622017, + 0.04075373336672783, + 0.0, + 0.4453306309878826, + 0.37532199919223785, + 0.28764722868800163, + 0.2465673591941595, + 0.42231727577745914, + 0.28428608551621437, + 0.0702826976776123, + 0.29492131993174553 + ], + "unique_experts": 61, + "load_cv": 0.9151574667042499, + "normalized_load_entropy": 0.9185822096274527, + "max_load_share": 0.07657657657657657 + }, + "full_input": { + "tokens": 99, + "top_k": 6, + "decisions": 594, + "ordered_route_sha256": "1e0ab34e0c03a688ca8630181e738ddd6d6fad3d528f22dd247251ab288d8183", + "route_weight_sha256": "e9437872d01f214da0771bd898141b63f72748353839618af24b3a2acf149be0", + "loads": [ + 2, + 8, + 9, + 5, + 12, + 15, + 7, + 3, + 8, + 8, + 15, + 6, + 9, + 7, + 10, + 13, + 9, + 6, + 6, + 6, + 18, + 9, + 10, + 12, + 11, + 2, + 12, + 17, + 6, + 8, + 16, + 4, + 13, + 13, + 5, + 18, + 0, + 1, + 12, + 7, + 31, + 5, + 9, + 34, + 23, + 1, + 6, + 9, + 11, + 9, + 9, + 14, + 12, + 2, + 6, + 4, + 7, + 4, + 5, + 10, + 10, + 6, + 4, + 5 + ], + "weighted_loads": [ + 0.07885649800300598, + 1.1957255080342293, + 0.3524241615086794, + 0.15381123311817646, + 0.4357045851647854, + 0.8336137644946575, + 0.43926130421459675, + 0.11979096755385399, + 0.3358031287789345, + 0.667118489742279, + 1.1410580277442932, + 0.21104552038013935, + 0.3842724524438381, + 0.42180317267775536, + 0.4726537335664034, + 0.546597383916378, + 0.34768763091415167, + 0.23849444836378098, + 0.25283583998680115, + 0.7159372791647911, + 1.12067162245512, + 0.519665508531034, + 0.6219368893653154, + 0.7011356297880411, + 0.6596304681152105, + 0.07625624909996986, + 0.5772288031876087, + 1.0421580262482166, + 0.19627625588327646, + 0.6694458946585655, + 1.123919878154993, + 0.1329385582357645, + 0.5578467436134815, + 0.8231855388730764, + 0.19876085221767426, + 0.8786569572985172, + 0.0, + 0.027498187497258186, + 0.7270766030997038, + 0.23095008917152882, + 1.5038047451525927, + 0.282032398506999, + 0.5124341137707233, + 2.401366278529167, + 1.5535058304667473, + 0.034000907093286514, + 0.3618423044681549, + 0.8253161124885082, + 0.6297716684639454, + 0.5498769786208868, + 0.5526267401874065, + 0.7316736541688442, + 0.7135545872151852, + 0.04902159608900547, + 0.1980534177273512, + 0.4373653046786785, + 0.7044812925159931, + 0.37532199919223785, + 0.3123273756355047, + 0.5054426863789558, + 0.42231727577745914, + 0.28428608551621437, + 0.1612059399485588, + 0.29492131993174553 + ], + "unique_experts": 63, + "load_cv": 0.6653985831102334, + "normalized_load_entropy": 0.9518727859497442, + "max_load_share": 0.05723905723905724 + } + }, + "s1_period": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "875bc481044178c119fa855abbaeb94d621aa636ebafd40e32fc3ab6834d746d", + "route_weight_sha256": "650abc40ee0316cef0be654c29107e362fcbbdea5d50a095c32ca3c7c1ec2183", + "loads": [ + 3, + 7, + 8, + 5, + 4, + 14, + 3, + 2, + 4, + 8, + 8, + 4, + 3, + 4, + 7, + 6, + 7, + 4, + 4, + 4, + 17, + 2, + 10, + 11, + 9, + 0, + 2, + 11, + 2, + 9, + 16, + 5, + 12, + 10, + 2, + 8, + 0, + 2, + 11, + 6, + 31, + 6, + 4, + 38, + 25, + 0, + 7, + 9, + 0, + 6, + 8, + 5, + 2, + 3, + 1, + 0, + 5, + 7, + 4, + 6, + 10, + 6, + 2, + 5 + ], + "weighted_loads": [ + 0.13079942390322685, + 1.0298800580203533, + 0.33333248272538185, + 0.16286705248057842, + 0.14830678142607212, + 0.7712753117084503, + 0.11777812615036964, + 0.07673898339271545, + 0.1522194966673851, + 0.6485686302185059, + 0.6000645123422146, + 0.15254325792193413, + 0.09395404160022736, + 0.13832784444093704, + 0.3401171453297138, + 0.2505235243588686, + 0.29711975157260895, + 0.14869973622262478, + 0.14451528899371624, + 0.1382692288607359, + 1.088896781206131, + 0.07469642534852028, + 0.6167845483869314, + 0.7610742095857859, + 0.6008094996213913, + 0.0, + 0.10757219418883324, + 0.5949335061013699, + 0.07659924402832985, + 0.6968371160328388, + 0.9866562373936176, + 0.18385140225291252, + 0.5524257775396109, + 0.6992922369390726, + 0.07857558876276016, + 0.32473177276551723, + 0.0, + 0.07101945951581001, + 0.6585183031857014, + 0.19721014238893986, + 1.5125331692397594, + 0.2987328227609396, + 0.24408965185284615, + 2.5439080838114023, + 1.8564256113022566, + 0.0, + 0.4033432826399803, + 0.7923973836004734, + 0.0, + 0.21285851299762726, + 0.4763089455664158, + 0.3208012804389, + 0.08459071069955826, + 0.09092126600444317, + 0.03414979577064514, + 0.0, + 0.47093190625309944, + 0.4870842006057501, + 0.2670903131365776, + 0.24869012832641602, + 0.43035978078842163, + 0.3216095604002476, + 0.07085420563817024, + 0.3091053254902363 + ], + "unique_experts": 59, + "load_cv": 0.9635428902689669, + "normalized_load_entropy": 0.9121706590030421, + "max_load_share": 0.08558558558558559 + }, + "full_input": { + "tokens": 115, + "top_k": 6, + "decisions": 690, + "ordered_route_sha256": "e1aa37d8a66dae640fa1d399f4e783f149783932a30db6befeb8c3e2c9fc5b57", + "route_weight_sha256": "ade386507c9231146dac0b7a152aad929a24754db70d44a9ef6aa36bb02b2d09", + "loads": [ + 10, + 8, + 10, + 5, + 6, + 15, + 8, + 3, + 8, + 10, + 17, + 4, + 10, + 14, + 12, + 10, + 9, + 12, + 8, + 9, + 18, + 7, + 11, + 17, + 10, + 3, + 11, + 20, + 4, + 10, + 22, + 5, + 13, + 14, + 2, + 26, + 1, + 3, + 12, + 6, + 31, + 8, + 14, + 39, + 26, + 1, + 7, + 9, + 12, + 10, + 10, + 16, + 12, + 4, + 15, + 12, + 10, + 7, + 5, + 12, + 11, + 7, + 3, + 6 + ], + "weighted_loads": [ + 0.6023753490298986, + 1.07662508264184, + 1.0225391071289778, + 0.16286705248057842, + 0.2351252492517233, + 0.7860376834869385, + 0.33211376145482063, + 0.15518388897180557, + 0.36400895938277245, + 0.7944113649427891, + 1.225683581084013, + 0.15254325792193413, + 0.4983857125043869, + 0.6533507164567709, + 0.5476812180131674, + 0.41924783028662205, + 0.3433478372171521, + 0.4709314201027155, + 0.3019440099596977, + 0.7972975112497807, + 1.135163526982069, + 0.46663607750087976, + 0.6468352414667606, + 1.3226416409015656, + 0.6372146457433701, + 0.09744143299758434, + 0.4742728341370821, + 1.3749394677579403, + 0.10720867197960615, + 0.7459732852876186, + 1.2697420734912157, + 0.18385140225291252, + 0.5751165542751551, + 1.2932475600391626, + 0.07857558876276016, + 1.290585147216916, + 0.06994215399026871, + 0.11163264140486717, + 0.710313331335783, + 0.19721014238893986, + 1.5125331692397594, + 0.4237323012202978, + 0.7679048348218203, + 2.586036553606391, + 1.9206124600023031, + 0.06097856163978577, + 0.4033432826399803, + 0.7923973836004734, + 0.8827789090573788, + 1.2791827097535133, + 0.5558639615774155, + 1.1018413417041302, + 0.6948935389518738, + 0.10393374040722847, + 0.8113736175000668, + 0.8575955051928759, + 0.8036459591239691, + 0.4870842006057501, + 0.29203924909234047, + 0.5741739813238382, + 0.4527623727917671, + 0.38302596658468246, + 0.10580000653862953, + 0.4020996280014515 + ], + "unique_experts": 64, + "load_cv": 0.6399892353642072, + "normalized_load_entropy": 0.9558010207284215, + "max_load_share": 0.05652173913043478 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 74, + "ordered_topk_exact_tokens": 34, + "set_exact_tokens": 49, + "mean_set_jaccard": 0.8947876447876449, + "mean_token_weighted_tv": 0.02050853904487716, + "aggregate_load_tv": 0.04504504504504505 + }, + "system_bos": { + "tokens": 74, + "ordered_topk_exact_tokens": 24, + "set_exact_tokens": 44, + "mean_set_jaccard": 0.8783783783783784, + "mean_token_weighted_tv": 0.024340868411535346, + "aggregate_load_tv": 0.04954954954954956 + }, + "system_x": { + "tokens": 74, + "ordered_topk_exact_tokens": 21, + "set_exact_tokens": 29, + "mean_set_jaccard": 0.8014800514800515, + "mean_token_weighted_tv": 0.037954462906094014, + "aggregate_load_tv": 0.07207207207207206 + }, + "system_period": { + "tokens": 74, + "ordered_topk_exact_tokens": 19, + "set_exact_tokens": 31, + "mean_set_jaccard": 0.8223938223938225, + "mean_token_weighted_tv": 0.03559676891293477, + "aggregate_load_tv": 0.06081081081081083 + }, + "bos_at_s0": { + "tokens": 74, + "ordered_topk_exact_tokens": 34, + "set_exact_tokens": 49, + "mean_set_jaccard": 0.8803088803088804, + "mean_token_weighted_tv": 0.026536756459422207, + "aggregate_load_tv": 0.05180180180180181 + }, + "bos_at_s1": { + "tokens": 74, + "ordered_topk_exact_tokens": 23, + "set_exact_tokens": 32, + "mean_set_jaccard": 0.8262548262548263, + "mean_token_weighted_tv": 0.03341142587816796, + "aggregate_load_tv": 0.06981981981981984 + }, + "x_at_s0": { + "tokens": 74, + "ordered_topk_exact_tokens": 23, + "set_exact_tokens": 39, + "mean_set_jaccard": 0.8452380952380952, + "mean_token_weighted_tv": 0.032317211436158094, + "aggregate_load_tv": 0.058558558558558564 + }, + "x_at_s1": { + "tokens": 74, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 28, + "mean_set_jaccard": 0.7980694980694981, + "mean_token_weighted_tv": 0.0415920063828093, + "aggregate_load_tv": 0.07882882882882883 + }, + "period_at_s0": { + "tokens": 74, + "ordered_topk_exact_tokens": 16, + "set_exact_tokens": 35, + "mean_set_jaccard": 0.8275418275418277, + "mean_token_weighted_tv": 0.03504919834636353, + "aggregate_load_tv": 0.07657657657657657 + }, + "period_at_s1": { + "tokens": 74, + "ordered_topk_exact_tokens": 20, + "set_exact_tokens": 32, + "mean_set_jaccard": 0.8146718146718147, + "mean_token_weighted_tv": 0.0388094113535575, + "aggregate_load_tv": 0.07432432432432434 + } + } + }, + "layer_22": { + "layer": 22, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "f3a8fe9c1bcce2e3368dd94c709a49bc3538a40796cb56fcdcbe1c3dff69b89a", + "route_weight_sha256": "82f897943cd6f4b6c1140c9f92abf32dd5f1cfb336faa3beb73d2e392ab33d8c", + "loads": [ + 9, + 8, + 13, + 4, + 32, + 7, + 3, + 22, + 13, + 0, + 9, + 4, + 9, + 1, + 1, + 9, + 11, + 5, + 7, + 1, + 5, + 6, + 4, + 4, + 15, + 3, + 25, + 4, + 6, + 4, + 13, + 7, + 2, + 1, + 4, + 4, + 7, + 8, + 10, + 18, + 7, + 11, + 8, + 2, + 4, + 4, + 7, + 14, + 0, + 5, + 2, + 7, + 3, + 5, + 4, + 2, + 11, + 5, + 0, + 13, + 7, + 0, + 2, + 3 + ], + "weighted_loads": [ + 0.6925891805440187, + 0.43408865109086037, + 0.8201817721128464, + 0.326235793530941, + 2.6815181244164705, + 0.2548259701579809, + 0.11611033231019974, + 1.3063566498458385, + 0.6745184976607561, + 0.0, + 0.5113469697535038, + 0.33668316528201103, + 0.32649637944996357, + 0.038164351135492325, + 0.027605198323726654, + 0.32506806775927544, + 0.6870720349252224, + 1.1079936400055885, + 0.33327656239271164, + 0.048179809004068375, + 0.20548242144286633, + 0.2978605516254902, + 0.1999792605638504, + 0.2058720663189888, + 0.9812016431242228, + 0.12048916332423687, + 1.2938471548259258, + 0.12507720291614532, + 0.25799818336963654, + 0.18478840589523315, + 0.651419261470437, + 0.34889712557196617, + 0.06138882599771023, + 0.0313553549349308, + 0.1440938450396061, + 0.16035504639148712, + 0.2770787514746189, + 0.31800696812570095, + 0.7803051099181175, + 1.0137778371572495, + 0.3602774366736412, + 0.8281176835298538, + 0.6969990991055965, + 0.14624783024191856, + 0.16538140177726746, + 0.14267933927476406, + 0.47180069237947464, + 1.0248230416327715, + 0.0, + 0.22173823043704033, + 0.06414668634533882, + 0.4025122970342636, + 0.13233499228954315, + 0.20028012618422508, + 0.16701781749725342, + 0.055769747123122215, + 0.8076151087880135, + 0.36835527047514915, + 0.0, + 0.8238420635461807, + 0.5626849383115768, + 0.0, + 0.0625635925680399, + 0.10616028122603893 + ], + "unique_experts": 60, + "load_cv": 0.8599239495028955, + "normalized_load_entropy": 0.9212957577523575, + "max_load_share": 0.07207207207207207 + }, + "full_input": { + "tokens": 99, + "top_k": 6, + "decisions": 594, + "ordered_route_sha256": "0c5aa583aaface81af3080e442b75b74fc99422f5d1aaf3114eef347496f0fe4", + "route_weight_sha256": "96330e85fdbee36b8c19b4d7fe4136bbb976b562494bccf8a525a82008320eab", + "loads": [ + 14, + 9, + 15, + 14, + 32, + 10, + 7, + 23, + 27, + 5, + 9, + 6, + 9, + 1, + 6, + 9, + 11, + 8, + 7, + 1, + 5, + 13, + 5, + 4, + 15, + 5, + 26, + 8, + 6, + 4, + 13, + 8, + 6, + 6, + 5, + 6, + 7, + 8, + 10, + 19, + 11, + 11, + 13, + 2, + 5, + 5, + 8, + 14, + 3, + 7, + 7, + 7, + 3, + 8, + 4, + 15, + 15, + 6, + 0, + 13, + 15, + 8, + 3, + 9 + ], + "weighted_loads": [ + 0.9006402818486094, + 0.4734570309519768, + 0.8954644724726677, + 2.263589758425951, + 2.6815181244164705, + 0.3634513448923826, + 0.3390989927574992, + 1.3550669513642788, + 1.9467037972062826, + 0.20185422152280807, + 0.5113469697535038, + 0.3660711720585823, + 0.32649637944996357, + 0.038164351135492325, + 0.4939831383526325, + 0.32506806775927544, + 0.6870720349252224, + 1.2373292986303568, + 0.33327656239271164, + 0.048179809004068375, + 0.20548242144286633, + 0.8797205667942762, + 0.2304559424519539, + 0.2058720663189888, + 0.9812016431242228, + 0.18282321467995644, + 1.3370622992515564, + 0.2917378582060337, + 0.25799818336963654, + 0.18478840589523315, + 0.651419261470437, + 0.3817913718521595, + 0.21839541848748922, + 0.20530976727604866, + 0.2016966976225376, + 0.23830792680382729, + 0.2770787514746189, + 0.31800696812570095, + 0.7803051099181175, + 1.0528373681008816, + 0.6568062640726566, + 0.8281176835298538, + 1.098333042114973, + 0.14624783024191856, + 0.18598933145403862, + 0.17377887479960918, + 0.5109902061522007, + 1.0248230416327715, + 0.16542931646108627, + 0.4065115228295326, + 0.3510116823017597, + 0.4025122970342636, + 0.13233499228954315, + 0.3489963561296463, + 0.16701781749725342, + 1.1562565746717155, + 0.9888518191874027, + 0.39402576349675655, + 0.0, + 0.8238420635461807, + 1.7067708000540733, + 0.28059494495391846, + 0.08573366887867451, + 0.32754758931696415 + ], + "unique_experts": 63, + "load_cv": 0.6615711810345258, + "normalized_load_entropy": 0.9521198485068745, + "max_load_share": 0.05387205387205387 + } + }, + "s1_eos": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "fab39fbed6c817c06a4263a30cfc02e2fcdf75831ad43121aa368516cbda9488", + "route_weight_sha256": "5cd00f99fe9050a2a7a763a54812567850ef4dca08c6753639a5f4545718e4b1", + "loads": [ + 10, + 9, + 12, + 3, + 30, + 6, + 3, + 25, + 12, + 0, + 9, + 4, + 8, + 1, + 1, + 6, + 11, + 5, + 6, + 2, + 5, + 5, + 4, + 4, + 14, + 3, + 26, + 3, + 5, + 3, + 14, + 8, + 3, + 2, + 6, + 5, + 8, + 8, + 10, + 18, + 7, + 11, + 8, + 2, + 4, + 5, + 9, + 11, + 1, + 5, + 2, + 6, + 2, + 5, + 4, + 2, + 11, + 5, + 0, + 13, + 7, + 0, + 1, + 6 + ], + "weighted_loads": [ + 0.7705089785158634, + 0.46028323099017143, + 0.7682121694087982, + 0.2693660892546177, + 2.6226783730089664, + 0.22742463648319244, + 0.11230253614485264, + 1.466499473899603, + 0.6019714716821909, + 0.0, + 0.49274466931819916, + 0.35669566318392754, + 0.2872624881565571, + 0.03846094012260437, + 0.02538173459470272, + 0.2303064465522766, + 0.6875523701310158, + 1.145879752933979, + 0.31031258404254913, + 0.07438566721975803, + 0.20427507534623146, + 0.24987992644309998, + 0.18974535539746284, + 0.19031298160552979, + 0.9184003937989473, + 0.12212754413485527, + 1.3147464450448751, + 0.09777520224452019, + 0.2190947476774454, + 0.13257329165935516, + 0.6799347158521414, + 0.3775203861296177, + 0.09222407825291157, + 0.06575075164437294, + 0.20481877774000168, + 0.1807548776268959, + 0.31322915479540825, + 0.3161819037050009, + 0.7790927886962891, + 1.0230844281613827, + 0.38093411177396774, + 0.8469453118741512, + 0.6833603382110596, + 0.151059839874506, + 0.1619074810296297, + 0.178164878860116, + 0.5260143429040909, + 0.9159158915281296, + 0.03572530299425125, + 0.2126640174537897, + 0.06337093375623226, + 0.3651683032512665, + 0.10865271836519241, + 0.20950450003147125, + 0.1623326614499092, + 0.06959662027657032, + 0.8183356150984764, + 0.3627411276102066, + 0.0, + 0.8260138109326363, + 0.5516067035496235, + 0.0, + 0.031017635017633438, + 0.2048044577240944 + ], + "unique_experts": 61, + "load_cv": 0.8531013045881151, + "normalized_load_entropy": 0.9240906339354459, + "max_load_share": 0.06756756756756757 + }, + "full_input": { + "tokens": 115, + "top_k": 6, + "decisions": 690, + "ordered_route_sha256": "89b7afe394a89e9e2e575af6e2b08d5cda8a433b7ff193ff6171f34aa63be8a9", + "route_weight_sha256": "fec1031b36f35d73afe3ab7668772ca6b6020ca24a66925e85ffce59dd32bb1e", + "loads": [ + 14, + 14, + 12, + 15, + 30, + 9, + 8, + 26, + 34, + 9, + 9, + 9, + 11, + 1, + 6, + 10, + 14, + 9, + 7, + 2, + 6, + 18, + 5, + 4, + 14, + 4, + 27, + 6, + 6, + 3, + 15, + 9, + 6, + 11, + 13, + 9, + 10, + 8, + 10, + 20, + 18, + 12, + 13, + 4, + 4, + 6, + 10, + 13, + 5, + 8, + 13, + 9, + 7, + 8, + 4, + 22, + 16, + 5, + 4, + 13, + 21, + 10, + 3, + 9 + ], + "weighted_loads": [ + 0.9554317565634847, + 0.9271838217973709, + 0.7682121694087982, + 2.4882882200181484, + 2.6226783730089664, + 0.31341342255473137, + 0.38945791590958834, + 1.506868164986372, + 2.437118435278535, + 0.460909154266119, + 0.49274466931819916, + 0.6598850060254335, + 0.4266965389251709, + 0.03846094012260437, + 0.4832352474331856, + 0.4634905233979225, + 0.8301731832325459, + 1.2840118408203125, + 0.34915777295827866, + 0.07438566721975803, + 0.2547607347369194, + 1.347702018916607, + 0.23264678940176964, + 0.19031298160552979, + 0.9184003937989473, + 0.14768013916909695, + 1.3541494216769934, + 0.22182057052850723, + 0.30281507410109043, + 0.13257329165935516, + 0.731803560629487, + 0.40868714079260826, + 0.2146762628108263, + 0.390612930059433, + 0.5138612426817417, + 0.34870657697319984, + 0.40305953845381737, + 0.3161819037050009, + 0.7790927886962891, + 1.105963807553053, + 1.1598451137542725, + 0.8722164016216993, + 1.1168363317847252, + 0.29020439088344574, + 0.1619074810296297, + 0.20715273171663284, + 0.5599164329469204, + 0.9876926131546497, + 0.2319263070821762, + 0.7112643364816904, + 0.646044235676527, + 0.5659826509654522, + 0.6527270264923573, + 0.377717025578022, + 0.1623326614499092, + 1.7599481577053666, + 1.0973033271729946, + 0.3627411276102066, + 0.10380758065730333, + 0.8260138109326363, + 2.5391175597906113, + 0.4275932293385267, + 0.0839648637920618, + 0.3440823145210743 + ], + "unique_experts": 64, + "load_cv": 0.6192799580614787, + "normalized_load_entropy": 0.9581357419025947, + "max_load_share": 0.04927536231884058 + } + }, + "s0_bos": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "e6c9f4197c6601b56fb64d6ba34bcfd5638fb5ccd397a8aa9c49288e30faa767", + "route_weight_sha256": "8937edd662e10ee6ae77e068afb8bd8aca1da1f28b8a893dd8618e9ed5e947eb", + "loads": [ + 9, + 9, + 13, + 4, + 32, + 8, + 3, + 24, + 13, + 0, + 8, + 4, + 6, + 1, + 0, + 11, + 12, + 5, + 8, + 1, + 5, + 6, + 4, + 4, + 14, + 3, + 26, + 3, + 4, + 6, + 15, + 7, + 1, + 1, + 6, + 3, + 6, + 7, + 10, + 17, + 7, + 11, + 8, + 2, + 3, + 7, + 8, + 13, + 0, + 5, + 2, + 6, + 2, + 6, + 3, + 2, + 11, + 5, + 0, + 13, + 7, + 0, + 1, + 3 + ], + "weighted_loads": [ + 0.6898017264902592, + 0.4780186153948307, + 0.8359862603247166, + 0.3194010257720947, + 2.6427568793296814, + 0.2986862789839506, + 0.11434659361839294, + 1.499863836914301, + 0.6555546727031469, + 0.0, + 0.48972251266241074, + 0.3149113040417433, + 0.2247394360601902, + 0.03864863142371178, + 0.0, + 0.3848761897534132, + 0.7062262147665024, + 1.1491155996918678, + 0.3769574575126171, + 0.049945369362831116, + 0.2166060358285904, + 0.29837245121598244, + 0.1828579492866993, + 0.21151559054851532, + 0.9244459494948387, + 0.1235407330095768, + 1.3279264718294144, + 0.094280656427145, + 0.19550123065710068, + 0.2543512750416994, + 0.7058371268212795, + 0.3499903082847595, + 0.036842864006757736, + 0.030500229448080063, + 0.21873680502176285, + 0.13096366077661514, + 0.24749620631337166, + 0.2758193463087082, + 0.7727056294679642, + 0.9730877317488194, + 0.3629622645676136, + 0.8398380279541016, + 0.7074509635567665, + 0.1560167707502842, + 0.15026789158582687, + 0.2407829836010933, + 0.46639202162623405, + 1.056945364922285, + 0.0, + 0.23540383949875832, + 0.06268912926316261, + 0.3571409247815609, + 0.1063767783343792, + 0.25042442604899406, + 0.11861423403024673, + 0.05408680811524391, + 0.8052431531250477, + 0.37551912665367126, + 0.0, + 0.8376722764223814, + 0.5365277379751205, + 0.0, + 0.036087922751903534, + 0.10467915423214436 + ], + "unique_experts": 59, + "load_cv": 0.8885185089892569, + "normalized_load_entropy": 0.9146571713097703, + "max_load_share": 0.07207207207207207 + }, + "full_input": { + "tokens": 99, + "top_k": 6, + "decisions": 594, + "ordered_route_sha256": "d752008387f0ab7d566aeafef79a609c7c69d167c5ea4b94a1a9147604be8ec5", + "route_weight_sha256": "0882756c669bb623678a13c22d3cb4553f97b66a564780ad326c3aed2fac8a10", + "loads": [ + 15, + 9, + 15, + 13, + 32, + 10, + 6, + 25, + 26, + 5, + 9, + 5, + 6, + 1, + 2, + 12, + 12, + 8, + 8, + 1, + 5, + 13, + 5, + 4, + 16, + 5, + 27, + 9, + 4, + 6, + 15, + 7, + 4, + 6, + 7, + 6, + 6, + 8, + 10, + 18, + 11, + 11, + 14, + 2, + 3, + 8, + 9, + 13, + 4, + 7, + 6, + 6, + 2, + 8, + 3, + 14, + 15, + 7, + 0, + 13, + 16, + 8, + 2, + 11 + ], + "weighted_loads": [ + 0.9199734507128596, + 0.4780186153948307, + 0.9112689606845379, + 1.3679859228432178, + 2.6427568793296814, + 0.34157587587833405, + 0.32626112550497055, + 2.3997970558702946, + 1.8802313599735498, + 0.20185422152280807, + 0.5124427564442158, + 0.3273843973875046, + 0.2247394360601902, + 0.03864863142371178, + 0.3576686680316925, + 0.4279120955616236, + 0.7062262147665024, + 1.2682111989706755, + 0.3769574575126171, + 0.049945369362831116, + 0.2166060358285904, + 0.887325732037425, + 0.21333463117480278, + 0.21151559054851532, + 0.9575177086517215, + 0.18587478436529636, + 1.3679794296622276, + 0.32453759759664536, + 0.19550123065710068, + 0.2543512750416994, + 0.7058371268212795, + 0.3499903082847595, + 0.16331682726740837, + 0.20445464178919792, + 0.27633965760469437, + 0.26185616105794907, + 0.24749620631337166, + 0.32484741881489754, + 0.7727056294679642, + 1.0151857286691666, + 0.6491710320115089, + 0.8398380279541016, + 1.054654342122376, + 0.1560167707502842, + 0.15026789158582687, + 0.2718825191259384, + 0.5055815353989601, + 1.056945364922285, + 0.2654397189617157, + 0.3654859126545489, + 0.3068949058651924, + 0.3571409247815609, + 0.1063767783343792, + 0.35672423988580704, + 0.11861423403024673, + 1.147979049012065, + 0.9951544590294361, + 0.4107770221307874, + 0.0, + 0.8376722764223814, + 1.7883529365062714, + 0.28059494495391846, + 0.07180368527770042, + 0.430543115362525 + ], + "unique_experts": 63, + "load_cv": 0.6884431021735463, + "normalized_load_entropy": 0.9470023984980455, + "max_load_share": 0.05387205387205387 + } + }, + "s1_bos": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "099cd9b1d1a52a0c5ed3acda84a371ac2b78b311a4984f8c0e93b982825c6178", + "route_weight_sha256": "218893356e8f5894cfce6ae40788ffc95dfdf5001e4b2737ee3cdfe549b54766", + "loads": [ + 11, + 9, + 13, + 4, + 30, + 9, + 3, + 24, + 15, + 0, + 8, + 4, + 8, + 1, + 0, + 7, + 12, + 4, + 7, + 2, + 3, + 5, + 4, + 4, + 13, + 3, + 24, + 3, + 5, + 5, + 16, + 6, + 1, + 1, + 6, + 4, + 7, + 8, + 10, + 16, + 8, + 11, + 8, + 4, + 3, + 5, + 8, + 13, + 0, + 5, + 2, + 6, + 2, + 6, + 4, + 2, + 12, + 5, + 0, + 13, + 7, + 0, + 1, + 4 + ], + "weighted_loads": [ + 0.7711945176124573, + 0.46752869337797165, + 0.8169451393187046, + 0.31648584827780724, + 2.6004514545202255, + 0.30899002216756344, + 0.11656941846013069, + 1.5376803874969482, + 0.7435605600476265, + 0.0, + 0.4923398792743683, + 0.3164874166250229, + 0.29143248684704304, + 0.03809677064418793, + 0.0, + 0.2636871263384819, + 0.7085367701947689, + 1.0956664346158504, + 0.33897220715880394, + 0.07642046548426151, + 0.14610927551984787, + 0.24546080082654953, + 0.1830933280289173, + 0.19636845588684082, + 0.9373390357941389, + 0.12453210167586803, + 1.2540934402495623, + 0.09461148828268051, + 0.22441862523555756, + 0.2160962149500847, + 0.7838649936020374, + 0.3152100294828415, + 0.034331027418375015, + 0.0325508676469326, + 0.2209098469465971, + 0.15528822503983974, + 0.27127642929553986, + 0.3033150192350149, + 0.7685447372496128, + 0.9413715749979019, + 0.40270203538239, + 0.858737651258707, + 0.687106441706419, + 0.2169312033802271, + 0.14303971081972122, + 0.1784638985991478, + 0.4752577543258667, + 1.0231839902698994, + 0.0, + 0.24449696019291878, + 0.06118449941277504, + 0.3546062745153904, + 0.1138947382569313, + 0.25152795389294624, + 0.15563520602881908, + 0.06673587113618851, + 0.8387923054397106, + 0.37438443303108215, + 0.0, + 0.8237111121416092, + 0.5198815353214741, + 0.0, + 0.03853299468755722, + 0.15490564703941345 + ], + "unique_experts": 59, + "load_cv": 0.8565194203340057, + "normalized_load_entropy": 0.9188842558876086, + "max_load_share": 0.06756756756756757 + }, + "full_input": { + "tokens": 115, + "top_k": 6, + "decisions": 690, + "ordered_route_sha256": "442cc4a4e41f199794cf5320024bcad020fa50e36d75528e8a8068d2a9c46163", + "route_weight_sha256": "011fb16f2bb30ef44497cc746951b18757828a12f601cc5f9cba3f9a91c5aa50", + "loads": [ + 15, + 13, + 13, + 15, + 30, + 11, + 7, + 25, + 36, + 9, + 8, + 9, + 11, + 1, + 4, + 12, + 15, + 8, + 8, + 2, + 4, + 17, + 5, + 4, + 14, + 4, + 25, + 8, + 6, + 5, + 16, + 6, + 3, + 10, + 13, + 10, + 9, + 9, + 10, + 18, + 19, + 12, + 14, + 6, + 3, + 6, + 9, + 15, + 6, + 8, + 12, + 9, + 7, + 10, + 4, + 21, + 17, + 5, + 2, + 13, + 22, + 10, + 3, + 9 + ], + "weighted_loads": [ + 0.9492641044780612, + 0.8977109268307686, + 0.8169451393187046, + 1.6307928524911404, + 2.6004514545202255, + 0.3408679813146591, + 0.3837563954293728, + 1.5780490785837173, + 2.513389103114605, + 0.460909154266119, + 0.4923398792743683, + 0.6458791010081768, + 0.43086653761565685, + 0.03809677064418793, + 0.43394951336085796, + 0.5394584499299526, + 0.851157583296299, + 1.2561195343732834, + 0.37781739607453346, + 0.07642046548426151, + 0.1965949349105358, + 1.3182308301329613, + 0.2259947620332241, + 0.19636845588684082, + 0.9646457340568304, + 0.1500846967101097, + 1.294801065698266, + 0.3031218945980072, + 0.3081389516592026, + 0.2160962149500847, + 0.7838649936020374, + 0.3152100294828415, + 0.1313701570034027, + 0.35741304606199265, + 0.5299523118883371, + 0.4143885914236307, + 0.361106812953949, + 0.34742232970893383, + 0.7685447372496128, + 1.0250420719385147, + 1.1851227600127459, + 0.8840087410062551, + 1.152312658727169, + 0.35607575438916683, + 0.14303971081972122, + 0.20747471414506435, + 0.5091598443686962, + 1.0949607118964195, + 0.3621709533035755, + 0.7887254618108273, + 0.5768881011754274, + 0.5554206222295761, + 0.6579690463840961, + 0.454571433365345, + 0.15563520602881908, + 1.750607930123806, + 1.1287159994244576, + 0.37438443303108215, + 0.06420446000993252, + 0.8237111121416092, + 2.6620755419135094, + 0.4275932293385267, + 0.09717674367129803, + 0.4011247754096985 + ], + "unique_experts": 64, + "load_cv": 0.6296129909543576, + "normalized_load_entropy": 0.9560509106616202, + "max_load_share": 0.05217391304347826 + } + }, + "s0_x": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "5cca8989d910326c42ea67ddc86341b7ffd7906d7d08163c11766643384389be", + "route_weight_sha256": "52fe642d7e9ee45dfde350e02783f33f18866aa4b403d9537c129600d05090ce", + "loads": [ + 10, + 8, + 13, + 4, + 31, + 6, + 3, + 25, + 15, + 0, + 8, + 4, + 7, + 1, + 0, + 7, + 12, + 5, + 8, + 1, + 4, + 6, + 4, + 4, + 12, + 3, + 24, + 4, + 6, + 5, + 17, + 7, + 2, + 2, + 5, + 4, + 6, + 6, + 10, + 19, + 8, + 11, + 8, + 2, + 3, + 5, + 9, + 12, + 0, + 5, + 2, + 6, + 2, + 6, + 3, + 2, + 12, + 5, + 0, + 13, + 7, + 0, + 1, + 4 + ], + "weighted_loads": [ + 0.7653793655335903, + 0.4223242662847042, + 0.8329805918037891, + 0.3427271172404289, + 2.6283684447407722, + 0.20594458281993866, + 0.12608534842729568, + 1.4115236327052116, + 0.7209070511162281, + 0.0, + 0.5056236907839775, + 0.28474988229572773, + 0.25327388010919094, + 0.03895245119929314, + 0.0, + 0.2632599528878927, + 0.7041359357535839, + 1.0831757299602032, + 0.384360957890749, + 0.045625828206539154, + 0.1830628141760826, + 0.29832565784454346, + 0.18155930563807487, + 0.1967829093337059, + 0.8299081549048424, + 0.12305214814841747, + 1.272133395075798, + 0.12664695270359516, + 0.25943857431411743, + 0.21629434265196323, + 0.8262839298695326, + 0.3543741963803768, + 0.06442604400217533, + 0.0665791667997837, + 0.174572991207242, + 0.1526620350778103, + 0.2488938458263874, + 0.24399209767580032, + 0.7719256542623043, + 1.066160686314106, + 0.393767224624753, + 0.8373631425201893, + 0.6860316209495068, + 0.15612659975886345, + 0.13970384746789932, + 0.16722236946225166, + 0.5494305398315191, + 0.9983125124126673, + 0.0, + 0.2549586780369282, + 0.06742294132709503, + 0.36626117676496506, + 0.1024068333208561, + 0.26520893909037113, + 0.12431778013706207, + 0.06508748047053814, + 0.8419607989490032, + 0.3598112426698208, + 0.0, + 0.8338754065334797, + 0.5208151787519455, + 0.0, + 0.04167291894555092, + 0.1216097790747881 + ], + "unique_experts": 59, + "load_cv": 0.8793365067774742, + "normalized_load_entropy": 0.9170575004353483, + "max_load_share": 0.06981981981981981 + }, + "full_input": { + "tokens": 99, + "top_k": 6, + "decisions": 594, + "ordered_route_sha256": "e9a473f168d9dc9b1e95273637dc061bb646856f7f7271f8259c16a2c2957190", + "route_weight_sha256": "d69471dbc5d6f062eb1da2d0665eef48dc8c89b9d729bdf540d3cfc8a63de929", + "loads": [ + 14, + 9, + 15, + 14, + 31, + 9, + 7, + 25, + 28, + 6, + 8, + 5, + 7, + 1, + 3, + 7, + 12, + 8, + 8, + 1, + 4, + 14, + 5, + 4, + 13, + 5, + 25, + 7, + 6, + 5, + 18, + 7, + 5, + 9, + 6, + 6, + 6, + 7, + 10, + 20, + 12, + 11, + 13, + 2, + 3, + 6, + 10, + 12, + 2, + 7, + 7, + 6, + 3, + 8, + 3, + 16, + 16, + 6, + 1, + 13, + 15, + 9, + 2, + 11 + ], + "weighted_loads": [ + 0.9405547613278031, + 0.4664580896496773, + 0.9082632921636105, + 1.4834099970757961, + 2.6283684447407722, + 0.28733343072235584, + 0.4077531769871712, + 1.4115236327052116, + 1.9420572891831398, + 0.23385531455278397, + 0.5056236907839775, + 0.29722297564148903, + 0.25327388010919094, + 0.03895245119929314, + 0.4266355261206627, + 0.2632599528878927, + 0.7041359357535839, + 1.17551345564425, + 0.384360957890749, + 0.045625828206539154, + 0.1830628141760826, + 0.9511220846325159, + 0.21203598752617836, + 0.1967829093337059, + 0.8510792497545481, + 0.18538619950413704, + 1.3081548027694225, + 0.2446563895791769, + 0.25943857431411743, + 0.21629434265196323, + 0.8697090540081263, + 0.3543741963803768, + 0.1966418121010065, + 0.32736627385020256, + 0.23217584379017353, + 0.24074523523449898, + 0.2488938458263874, + 0.27979040890932083, + 0.7719256542623043, + 1.1033178456127644, + 0.6716343816369772, + 0.8373631425201893, + 1.1084118075668812, + 0.15612659975886345, + 0.13970384746789932, + 0.1983219049870968, + 0.5886200536042452, + 0.9983125124126673, + 0.10916824266314507, + 0.5047197975218296, + 0.3343563936650753, + 0.36626117676496506, + 0.13437780365347862, + 0.3638485688716173, + 0.12431778013706207, + 1.3672046177089214, + 1.0355343632400036, + 0.3854817356914282, + 0.04587463289499283, + 0.8338754065334797, + 1.7088448256254196, + 0.3369409628212452, + 0.06579104997217655, + 0.3760626707226038 + ], + "unique_experts": 64, + "load_cv": 0.6873883951858215, + "normalized_load_entropy": 0.9483492995693307, + "max_load_share": 0.05218855218855219 + } + }, + "s1_x": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "3c4d12fcb884535a25c1a76e5dd2a106bdbb65b9c55cb0a860d9f733663fcb0d", + "route_weight_sha256": "2602815f35f8cb97e611d3aa974b86153dae73f1804cb9c1f5b33f04c24f0332", + "loads": [ + 12, + 9, + 13, + 4, + 28, + 6, + 3, + 27, + 14, + 1, + 8, + 5, + 6, + 1, + 0, + 5, + 12, + 4, + 8, + 2, + 4, + 5, + 3, + 5, + 14, + 3, + 22, + 2, + 4, + 5, + 16, + 7, + 2, + 3, + 2, + 4, + 7, + 8, + 10, + 19, + 9, + 11, + 8, + 2, + 3, + 1, + 9, + 13, + 1, + 5, + 1, + 7, + 2, + 6, + 3, + 3, + 12, + 5, + 0, + 15, + 6, + 1, + 2, + 6 + ], + "weighted_loads": [ + 0.7745355702936649, + 0.4346320927143097, + 0.8237523771822453, + 0.33268727734684944, + 2.5490789227187634, + 0.20891277492046356, + 0.12100368365645409, + 1.5919150952249765, + 0.7112514860928059, + 0.035130616277456284, + 0.48326636105775833, + 0.3640666976571083, + 0.23271723464131355, + 0.039436012506484985, + 0.0, + 0.19424369186162949, + 0.6951093077659607, + 1.0685280375182629, + 0.4191809706389904, + 0.07089784741401672, + 0.16663500480353832, + 0.2585568353533745, + 0.14506961405277252, + 0.24018390849232674, + 0.9997270572930574, + 0.11968472972512245, + 1.1861050426959991, + 0.06953901052474976, + 0.1909666396677494, + 0.2198557872325182, + 0.7904517017304897, + 0.3463904485106468, + 0.06455430015921593, + 0.0886410903185606, + 0.07359198480844498, + 0.14465709403157234, + 0.27560074627399445, + 0.2919517196714878, + 0.7799345441162586, + 1.0993687473237514, + 0.44808733090758324, + 0.8516598604619503, + 0.68445910140872, + 0.14337798953056335, + 0.13428668305277824, + 0.041710738092660904, + 0.5256392080336809, + 1.0502309557050467, + 0.034773413091897964, + 0.25841421633958817, + 0.04017066955566406, + 0.4112999886274338, + 0.1079912930727005, + 0.24835235811769962, + 0.11862374469637871, + 0.10794845409691334, + 0.8145941980183125, + 0.3464139401912689, + 0.0, + 0.8904431611299515, + 0.4375811405479908, + 0.035551175475120544, + 0.0689249224960804, + 0.2064998559653759 + ], + "unique_experts": 62, + "load_cv": 0.8678159112433688, + "normalized_load_entropy": 0.9198645714920152, + "max_load_share": 0.06306306306306306 + }, + "full_input": { + "tokens": 115, + "top_k": 6, + "decisions": 690, + "ordered_route_sha256": "efad3a1c479c92d94a6ade57d1d1d00c45e338e2c17039c425cfe85157f1df26", + "route_weight_sha256": "8bba3881cb79c2a3fc5aeab2c6f3cb3005fab41b7e427d3d8cb310b606f88006", + "loads": [ + 15, + 13, + 13, + 16, + 28, + 8, + 9, + 28, + 36, + 11, + 8, + 9, + 9, + 1, + 4, + 9, + 15, + 7, + 9, + 2, + 5, + 18, + 4, + 5, + 14, + 4, + 22, + 4, + 5, + 5, + 16, + 7, + 4, + 13, + 9, + 8, + 9, + 9, + 10, + 21, + 21, + 12, + 14, + 4, + 3, + 2, + 10, + 15, + 5, + 8, + 13, + 10, + 7, + 10, + 3, + 26, + 17, + 5, + 2, + 15, + 20, + 13, + 3, + 10 + ], + "weighted_loads": [ + 0.9243982853367925, + 0.8648143261671066, + 0.8237523771822453, + 1.7285962738096714, + 2.5490789227187634, + 0.25424099899828434, + 0.4778847023844719, + 1.6322837863117456, + 2.5083745196461678, + 0.5431379713118076, + 0.48326636105775833, + 0.6499694958329201, + 0.37215128540992737, + 0.039436012506484985, + 0.4665019568055868, + 0.4274277687072754, + 0.8377301208674908, + 1.167103759944439, + 0.4580261595547199, + 0.07089784741401672, + 0.21712066419422626, + 1.4164302051067352, + 0.18797104805707932, + 0.24018390849232674, + 0.9997270572930574, + 0.14523732475936413, + 1.1861050426959991, + 0.16154376789927483, + 0.2746869660913944, + 0.2198557872325182, + 0.7904517017304897, + 0.3463904485106468, + 0.16289247572422028, + 0.44705973006784916, + 0.382634449750185, + 0.3126087933778763, + 0.36543112993240356, + 0.3264566920697689, + 0.7799345441162586, + 1.1795036867260933, + 1.2509803511202335, + 0.8769309502094984, + 1.2224402651190758, + 0.2825225405395031, + 0.13428668305277824, + 0.08069251850247383, + 0.5595412980765104, + 1.1220076773315668, + 0.20115308463573456, + 0.8066710978746414, + 0.6203630417585373, + 0.6121143363416195, + 0.6520656011998653, + 0.420537693426013, + 0.11862374469637871, + 2.1508991587907076, + 1.10636205971241, + 0.3464139401912689, + 0.06420446000993252, + 0.8904431611299515, + 2.4399081394076347, + 0.6316842865198851, + 0.09700721316039562, + 0.37463916279375553 + ], + "unique_experts": 64, + "load_cv": 0.659029984825403, + "normalized_load_entropy": 0.951225489876138, + "max_load_share": 0.05217391304347826 + } + }, + "s0_period": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "01fdf7a4e8a3b313f17b7de2739c30e312bf2b9668f8439edde4573a908ee26a", + "route_weight_sha256": "1d60416a02b8baec1276094accc617a9377fbc17787580adb6801a61b33eaf30", + "loads": [ + 10, + 8, + 13, + 4, + 32, + 7, + 3, + 25, + 13, + 0, + 10, + 4, + 7, + 0, + 0, + 11, + 12, + 3, + 7, + 2, + 4, + 5, + 4, + 4, + 13, + 3, + 24, + 2, + 6, + 4, + 17, + 7, + 2, + 1, + 2, + 3, + 7, + 8, + 11, + 19, + 7, + 11, + 8, + 2, + 3, + 5, + 10, + 13, + 0, + 4, + 2, + 6, + 2, + 6, + 3, + 2, + 11, + 5, + 0, + 14, + 7, + 0, + 1, + 5 + ], + "weighted_loads": [ + 0.7303063906729221, + 0.41763950884342194, + 0.8384052887558937, + 0.3364446982741356, + 2.631238080561161, + 0.24295357428491116, + 0.12591223791241646, + 1.495231255888939, + 0.6635922156274319, + 0.0, + 0.5764147825539112, + 0.2848615478724241, + 0.26575483940541744, + 0.0, + 0.0, + 0.38420882634818554, + 0.7212477065622807, + 0.9977464564144611, + 0.3472011759877205, + 0.08610447868704796, + 0.17957963794469833, + 0.2707235664129257, + 0.18227698653936386, + 0.20258305594325066, + 0.8554084897041321, + 0.1229352280497551, + 1.276924442499876, + 0.06655771657824516, + 0.2640088349580765, + 0.17420752346515656, + 0.7972272466868162, + 0.3553813099861145, + 0.06451974622905254, + 0.02968733012676239, + 0.06779395043849945, + 0.1185874342918396, + 0.28918057307600975, + 0.3104156292974949, + 0.8031123150140047, + 1.0827339068055153, + 0.37189485505223274, + 0.8375586792826653, + 0.6886395327746868, + 0.15933793038129807, + 0.14198574796319008, + 0.16540837846696377, + 0.5891198255121708, + 1.0398541036993265, + 0.0, + 0.20925434678792953, + 0.06696533598005772, + 0.3710581511259079, + 0.09976010024547577, + 0.2698192223906517, + 0.12413622252643108, + 0.06015377677977085, + 0.8031853996217251, + 0.356155414134264, + 0.0, + 0.868731064721942, + 0.5453300476074219, + 0.0, + 0.03761885315179825, + 0.15765201300382614 + ], + "unique_experts": 58, + "load_cv": 0.9076772179503241, + "normalized_load_entropy": 0.910177112390802, + "max_load_share": 0.07207207207207207 + }, + "full_input": { + "tokens": 99, + "top_k": 6, + "decisions": 594, + "ordered_route_sha256": "24583da6664429e294d8d881720c87dbb801582c7488c84d44d515bf6cdf5cbf", + "route_weight_sha256": "620d09510f032e52fd086770011fa35d1d6844b05a4bca95daeb1902354baa82", + "loads": [ + 14, + 9, + 15, + 13, + 32, + 10, + 6, + 25, + 26, + 5, + 10, + 5, + 7, + 0, + 4, + 11, + 12, + 6, + 7, + 2, + 4, + 13, + 5, + 4, + 14, + 5, + 25, + 6, + 6, + 5, + 17, + 8, + 5, + 6, + 3, + 5, + 7, + 9, + 11, + 21, + 12, + 11, + 13, + 2, + 3, + 6, + 11, + 13, + 3, + 5, + 8, + 6, + 2, + 10, + 3, + 15, + 15, + 6, + 1, + 14, + 16, + 8, + 1, + 12 + ], + "weighted_loads": [ + 0.905481786467135, + 0.5169330835342407, + 0.913687989115715, + 1.392324898391962, + 2.631238080561161, + 0.31005479395389557, + 0.33782676979899406, + 1.495231255888939, + 1.8925095535814762, + 0.20185422152280807, + 0.5764147825539112, + 0.2973346412181854, + 0.26575483940541744, + 0.0, + 0.49570324644446373, + 0.38420882634818554, + 0.7212477065622807, + 1.1213264223188162, + 0.3472011759877205, + 0.08610447868704796, + 0.17957963794469833, + 0.9356415811926126, + 0.21275366842746735, + 0.20258305594325066, + 0.8767386246472597, + 0.18526927940547466, + 1.3128571771085262, + 0.20984863489866257, + 0.2640088349580765, + 0.224451445043087, + 0.7972272466868162, + 0.385404035449028, + 0.19274351932108402, + 0.20364174246788025, + 0.12539680302143097, + 0.20386020094156265, + 0.28918057307600975, + 0.34307166561484337, + 0.8031123150140047, + 1.1541070975363255, + 0.7051655985414982, + 0.8375586792826653, + 1.0567867867648602, + 0.15933793038129807, + 0.14198574796319008, + 0.1965079139918089, + 0.6283093392848969, + 1.0398541036993265, + 0.1522929109632969, + 0.33448510617017746, + 0.4205175656825304, + 0.3710581511259079, + 0.09976010024547577, + 0.4620555192232132, + 0.12413622252643108, + 1.273878563195467, + 0.9991148598492146, + 0.3818259071558714, + 0.045969560742378235, + 0.868731064721942, + 1.7771412506699562, + 0.28059494495391846, + 0.03761885315179825, + 0.4215068034827709 + ], + "unique_experts": 63, + "load_cv": 0.695259698992121, + "normalized_load_entropy": 0.945598897649535, + "max_load_share": 0.05387205387205387 + } + }, + "s1_period": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "ced274e7f34b4798c819d936b8e798c6d4c3f5e1aeb096052860fd30155417a3", + "route_weight_sha256": "c031e55e763154e8ad4b26d7864a1d670216f0ce83197f6972029d6e797a72cf", + "loads": [ + 11, + 10, + 13, + 4, + 29, + 7, + 3, + 26, + 11, + 0, + 9, + 4, + 7, + 1, + 0, + 5, + 12, + 4, + 8, + 2, + 3, + 5, + 3, + 5, + 14, + 3, + 22, + 4, + 4, + 4, + 16, + 7, + 2, + 2, + 2, + 4, + 8, + 7, + 10, + 21, + 8, + 11, + 8, + 2, + 4, + 3, + 9, + 12, + 0, + 5, + 1, + 6, + 2, + 6, + 4, + 3, + 11, + 5, + 0, + 15, + 7, + 0, + 1, + 9 + ], + "weighted_loads": [ + 0.7375899255275726, + 0.4857777189463377, + 0.8336238637566566, + 0.31215930730104446, + 2.5965528450906277, + 0.24557465128600597, + 0.13221727311611176, + 1.5360738299787045, + 0.5538605265319347, + 0.0, + 0.523427490144968, + 0.3121894132345915, + 0.2650928758084774, + 0.03629317134618759, + 0.0, + 0.19383858516812325, + 0.6973799504339695, + 1.0680398382246494, + 0.4251154139637947, + 0.07079241424798965, + 0.14150789007544518, + 0.25513407960534096, + 0.14522424712777138, + 0.24534443020820618, + 0.9897736925631762, + 0.12336624041199684, + 1.1729357652366161, + 0.12650144658982754, + 0.19320621713995934, + 0.18824084848165512, + 0.7747185807675123, + 0.34636298194527626, + 0.0591917559504509, + 0.06895029917359352, + 0.07679484412074089, + 0.15218472853302956, + 0.31252182833850384, + 0.2605990506708622, + 0.7852958887815475, + 1.1654043141752481, + 0.4220401868224144, + 0.8501182682812214, + 0.6662331447005272, + 0.1544579230248928, + 0.1726028248667717, + 0.09967176057398319, + 0.5231736991554499, + 1.0319128669798374, + 0.0, + 0.2522667162120342, + 0.04146368429064751, + 0.3631931468844414, + 0.108342494815588, + 0.26038315147161484, + 0.1466061118990183, + 0.107511505484581, + 0.7767272405326366, + 0.35505589097738266, + 0.0, + 0.8910613618791103, + 0.4872395284473896, + 0.0, + 0.04109400883316994, + 0.2950414642691612 + ], + "unique_experts": 59, + "load_cv": 0.8726656456586891, + "normalized_load_entropy": 0.9163417528611346, + "max_load_share": 0.06531531531531531 + }, + "full_input": { + "tokens": 115, + "top_k": 6, + "decisions": 690, + "ordered_route_sha256": "2daf3dc781030f54fcd94dcf68762c8ca9b322a4a8986f7a1d1d9e24adeeaa6a", + "route_weight_sha256": "edb76413ee7e32a2ab40608344b4db125b3bc0123484fdd6476c9f44b5308209", + "loads": [ + 14, + 15, + 13, + 15, + 29, + 8, + 8, + 27, + 32, + 9, + 9, + 8, + 10, + 1, + 4, + 9, + 15, + 7, + 9, + 3, + 4, + 18, + 4, + 5, + 15, + 4, + 23, + 6, + 5, + 4, + 17, + 7, + 4, + 13, + 9, + 9, + 10, + 8, + 10, + 24, + 20, + 12, + 13, + 4, + 4, + 3, + 12, + 14, + 5, + 7, + 12, + 9, + 7, + 10, + 4, + 24, + 16, + 5, + 2, + 15, + 22, + 11, + 2, + 13 + ], + "weighted_loads": [ + 0.8874526405707002, + 0.9633618798106909, + 0.8336238637566566, + 1.6439527049660683, + 2.5965528450906277, + 0.2581823244690895, + 0.4390401504933834, + 1.5764425210654736, + 2.3274952322244644, + 0.460909154266119, + 0.523427490144968, + 0.5980922114104033, + 0.4045269265770912, + 0.03629317134618759, + 0.5255766939371824, + 0.42702266201376915, + 0.8400007635354996, + 1.1596257649362087, + 0.46396060287952423, + 0.11036574468016624, + 0.19199354946613312, + 1.3911085166037083, + 0.18812568113207817, + 0.24534443020820618, + 1.022436959668994, + 0.14891883544623852, + 1.2080698497593403, + 0.23174098320305347, + 0.27692654356360435, + 0.18824084848165512, + 0.814743896946311, + 0.34636298194527626, + 0.1706426590681076, + 0.47189632803201675, + 0.3858373090624809, + 0.3559870719909668, + 0.40235221199691296, + 0.2899511344730854, + 0.7852958887815475, + 1.290434269234538, + 1.2264176420867443, + 0.8753893580287695, + 1.1297199428081512, + 0.29360247403383255, + 0.1726028248667717, + 0.09967176057398319, + 0.6264779437333345, + 1.1036895886063576, + 0.21837447956204414, + 0.7128263600170612, + 0.6310659255832434, + 0.5640074945986271, + 0.6524168029427528, + 0.45198746025562286, + 0.1466061118990183, + 1.9945515841245651, + 1.0686669200658798, + 0.35505589097738266, + 0.06420446000993252, + 0.8910613618791103, + 2.5752949230372906, + 0.4700284581631422, + 0.06917629949748516, + 0.46408468298614025 + ], + "unique_experts": 64, + "load_cv": 0.6414578543863979, + "normalized_load_entropy": 0.9533170782850863, + "max_load_share": 0.0463768115942029 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 74, + "ordered_topk_exact_tokens": 34, + "set_exact_tokens": 40, + "mean_set_jaccard": 0.862934362934363, + "mean_token_weighted_tv": 0.02440813590294203, + "aggregate_load_tv": 0.04954954954954954 + }, + "system_bos": { + "tokens": 74, + "ordered_topk_exact_tokens": 34, + "set_exact_tokens": 45, + "mean_set_jaccard": 0.8851351351351351, + "mean_token_weighted_tv": 0.02227972320759216, + "aggregate_load_tv": 0.042792792792792786 + }, + "system_x": { + "tokens": 74, + "ordered_topk_exact_tokens": 24, + "set_exact_tokens": 35, + "mean_set_jaccard": 0.8211068211068211, + "mean_token_weighted_tv": 0.034497046314582634, + "aggregate_load_tv": 0.05855855855855856 + }, + "system_period": { + "tokens": 74, + "ordered_topk_exact_tokens": 21, + "set_exact_tokens": 35, + "mean_set_jaccard": 0.8378378378378378, + "mean_token_weighted_tv": 0.03214462046083566, + "aggregate_load_tv": 0.05855855855855856 + }, + "bos_at_s0": { + "tokens": 74, + "ordered_topk_exact_tokens": 29, + "set_exact_tokens": 46, + "mean_set_jaccard": 0.8774131274131275, + "mean_token_weighted_tv": 0.02673155052990124, + "aggregate_load_tv": 0.04504504504504505 + }, + "bos_at_s1": { + "tokens": 74, + "ordered_topk_exact_tokens": 29, + "set_exact_tokens": 37, + "mean_set_jaccard": 0.8455598455598455, + "mean_token_weighted_tv": 0.030375217377031978, + "aggregate_load_tv": 0.05180180180180179 + }, + "x_at_s0": { + "tokens": 74, + "ordered_topk_exact_tokens": 24, + "set_exact_tokens": 43, + "mean_set_jaccard": 0.8693693693693695, + "mean_token_weighted_tv": 0.028318661176977126, + "aggregate_load_tv": 0.0518018018018018 + }, + "x_at_s1": { + "tokens": 74, + "ordered_topk_exact_tokens": 21, + "set_exact_tokens": 32, + "mean_set_jaccard": 0.8117760617760619, + "mean_token_weighted_tv": 0.03660128280721806, + "aggregate_load_tv": 0.07207207207207209 + }, + "period_at_s0": { + "tokens": 74, + "ordered_topk_exact_tokens": 25, + "set_exact_tokens": 39, + "mean_set_jaccard": 0.8510296010296011, + "mean_token_weighted_tv": 0.030974408649411554, + "aggregate_load_tv": 0.05180180180180179 + }, + "period_at_s1": { + "tokens": 74, + "ordered_topk_exact_tokens": 19, + "set_exact_tokens": 32, + "mean_set_jaccard": 0.8233590733590734, + "mean_token_weighted_tv": 0.03517643208741336, + "aggregate_load_tv": 0.05855855855855856 + } + } + }, + "layer_23": { + "layer": 23, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "7479168a314c23c58004d5879ff0a387a4f4b3f0b29bdf6c239708378a20e23a", + "route_weight_sha256": "99c30a3fd419e32c13556800757bacb9cc3f2ae5b562c0e2a0d8f2b5c58f3a2d", + "loads": [ + 9, + 12, + 14, + 4, + 4, + 5, + 9, + 2, + 9, + 4, + 3, + 4, + 0, + 9, + 16, + 3, + 1, + 9, + 11, + 19, + 10, + 6, + 16, + 7, + 9, + 13, + 1, + 1, + 4, + 13, + 8, + 6, + 1, + 1, + 5, + 16, + 10, + 1, + 8, + 15, + 6, + 17, + 6, + 4, + 7, + 7, + 4, + 5, + 13, + 11, + 0, + 1, + 6, + 7, + 2, + 3, + 4, + 4, + 4, + 14, + 0, + 12, + 8, + 1 + ], + "weighted_loads": [ + 1.2115111872553825, + 0.9574409313499928, + 0.7221987172961235, + 0.35599498450756073, + 0.16340682469308376, + 0.22269585356116295, + 0.6839022487401962, + 0.06348831579089165, + 0.47297633439302444, + 0.14589108899235725, + 0.13269004598259926, + 0.13220085203647614, + 0.0, + 0.430081132799387, + 1.1015388574451208, + 0.11794786527752876, + 0.032874513417482376, + 0.6707984283566475, + 0.6011530496180058, + 0.9811732936650515, + 0.5312184765934944, + 0.20181810297071934, + 1.1986963171511889, + 0.8731423020362854, + 0.308882649987936, + 0.5099968649446964, + 0.03176845610141754, + 0.07078234106302261, + 0.1269154902547598, + 0.8186864499002695, + 0.28799346275627613, + 0.4244789034128189, + 0.03916170448064804, + 0.02660113014280796, + 0.18953073397278786, + 0.9764783121645451, + 0.718262629583478, + 0.03165278211236, + 0.4178021363914013, + 0.6459231190383434, + 0.24451005272567272, + 0.8403711505234241, + 0.20936754159629345, + 0.17962418124079704, + 0.4000672195106745, + 0.5379699170589447, + 0.2272106669843197, + 0.43344904854893684, + 0.8978486880660057, + 0.4561884719878435, + 0.0, + 0.0348823145031929, + 0.41903042048215866, + 0.28296197205781937, + 0.1176435723900795, + 0.2729577533900738, + 0.2246381938457489, + 0.16777542233467102, + 0.14920063503086567, + 0.9013164844363928, + 0.0, + 1.0253290012478828, + 0.4556115698069334, + 0.04321246221661568 + ], + "unique_experts": 61, + "load_cv": 0.7033376664606066, + "normalized_load_entropy": 0.9354306319337504, + "max_load_share": 0.04279279279279279 + }, + "full_input": { + "tokens": 99, + "top_k": 6, + "decisions": 594, + "ordered_route_sha256": "0673ec2b852438db6ffbc75df7eb0ece9b2cf119616d3b1f1e0dc708fafb6de4", + "route_weight_sha256": "d8f1e900f59d028a7e9bc4367b115bfce7acc1ea4cf903bfe95c7301021f2e1b", + "loads": [ + 15, + 16, + 15, + 11, + 9, + 7, + 15, + 5, + 11, + 16, + 3, + 5, + 1, + 14, + 18, + 3, + 4, + 9, + 11, + 19, + 10, + 6, + 17, + 17, + 12, + 13, + 2, + 1, + 4, + 13, + 8, + 6, + 4, + 5, + 5, + 16, + 11, + 1, + 13, + 17, + 11, + 17, + 8, + 4, + 7, + 15, + 15, + 9, + 15, + 11, + 1, + 2, + 6, + 8, + 12, + 4, + 4, + 13, + 6, + 14, + 0, + 12, + 11, + 1 + ], + "weighted_loads": [ + 1.6312101297080517, + 1.2431830503046513, + 0.7747342996299267, + 0.5604148427955806, + 0.36393592692911625, + 0.2804398671723902, + 1.134643491357565, + 0.20207449048757553, + 0.5047476140898652, + 0.5697162970900536, + 0.13269004598259926, + 0.1837911605834961, + 0.010220847092568874, + 0.6403513830155134, + 1.2266343291848898, + 0.11794786527752876, + 0.08430427545681596, + 0.6707984283566475, + 0.6011530496180058, + 0.9811732936650515, + 0.5312184765934944, + 0.20181810297071934, + 1.2172455452382565, + 2.1767378747463226, + 0.4101276118308306, + 0.5099968649446964, + 0.054243626073002815, + 0.07078234106302261, + 0.1269154902547598, + 0.8186864499002695, + 0.28799346275627613, + 0.4244789034128189, + 0.19364231079816818, + 0.29633437341544777, + 0.18953073397278786, + 0.9764783121645451, + 0.7600548807531595, + 0.03165278211236, + 0.6540578110143542, + 0.6970087438821793, + 0.4604007750749588, + 0.8403711505234241, + 0.2607776504009962, + 0.17962418124079704, + 0.4000672195106745, + 2.610000401735306, + 1.1957119926810265, + 0.5735044709872454, + 0.990844402462244, + 0.4561884719878435, + 0.04452579841017723, + 0.12434760481119156, + 0.41903042048215866, + 0.32627157494425774, + 1.0483895987272263, + 0.31382428854703903, + 0.2246381938457489, + 1.1413290165364742, + 0.2531710471957922, + 0.9013164844363928, + 0.0, + 1.0253290012478828, + 0.5533333327621222, + 0.04321246221661568 + ], + "unique_experts": 63, + "load_cv": 0.5709131258976875, + "normalized_load_entropy": 0.9543791550298788, + "max_load_share": 0.03198653198653199 + } + }, + "s1_eos": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "b4343a8233f9d4e12fd1aac922fc7ba6ac042250171f5f33c250e07097815946", + "route_weight_sha256": "93abcc57a895bfc7b0d581ddd45b87c28df3b0c05602db098755a766ebb3e8e1", + "loads": [ + 9, + 12, + 13, + 5, + 4, + 4, + 9, + 2, + 9, + 5, + 5, + 4, + 0, + 9, + 14, + 3, + 0, + 9, + 12, + 22, + 11, + 6, + 15, + 7, + 8, + 9, + 1, + 2, + 3, + 12, + 8, + 9, + 1, + 1, + 5, + 16, + 9, + 0, + 8, + 14, + 6, + 16, + 6, + 4, + 8, + 7, + 4, + 7, + 13, + 10, + 0, + 2, + 5, + 7, + 2, + 3, + 3, + 6, + 5, + 14, + 0, + 12, + 8, + 1 + ], + "weighted_loads": [ + 1.2773254923522472, + 0.9598309621214867, + 0.7069491427391768, + 0.38532351329922676, + 0.16091468930244446, + 0.19407997652888298, + 0.6744516678154469, + 0.06637031398713589, + 0.46216586232185364, + 0.18833494000136852, + 0.20402970351278782, + 0.14023736119270325, + 0.0, + 0.440873583778739, + 1.0293680466711521, + 0.1071226429194212, + 0.0, + 0.6571215353906155, + 0.6288852225989103, + 1.1021125800907612, + 0.5812021642923355, + 0.19561302289366722, + 1.1483314465731382, + 0.9017825499176979, + 0.27917218767106533, + 0.383473489433527, + 0.03125859424471855, + 0.0986962579190731, + 0.10669235326349735, + 0.7974212244153023, + 0.27378024719655514, + 0.5127163883298635, + 0.04091040417551994, + 0.026708440855145454, + 0.20034439489245415, + 0.9846693370491266, + 0.682948749512434, + 0.0, + 0.4237511605024338, + 0.6002610009163618, + 0.23013112880289555, + 0.79473508708179, + 0.20458153448998928, + 0.18325509130954742, + 0.44464351423084736, + 0.5235699880868196, + 0.20279712229967117, + 0.474727937951684, + 0.9010628908872604, + 0.395405150949955, + 0.0, + 0.06958531215786934, + 0.4100092723965645, + 0.26745253428816795, + 0.1213986910879612, + 0.2600081004202366, + 0.19046497717499733, + 0.2318100892007351, + 0.17589394003152847, + 0.8886781744658947, + 0.0, + 1.0050797797739506, + 0.46362073719501495, + 0.04418472200632095 + ], + "unique_experts": 59, + "load_cv": 0.6879368000220721, + "normalized_load_entropy": 0.9365545011766779, + "max_load_share": 0.04954954954954955 + }, + "full_input": { + "tokens": 115, + "top_k": 6, + "decisions": 690, + "ordered_route_sha256": "d22a83259161093bf68be1350a7924497edfbca7f7c52ca395f966a84a416fb8", + "route_weight_sha256": "cd90da4f124111867d533ca40a2df7989b6b8c19da5f0224737134185f6b2c08", + "loads": [ + 16, + 20, + 20, + 14, + 7, + 7, + 22, + 8, + 11, + 10, + 7, + 5, + 1, + 14, + 17, + 6, + 4, + 10, + 14, + 22, + 12, + 6, + 16, + 21, + 10, + 9, + 2, + 2, + 3, + 13, + 8, + 9, + 3, + 13, + 5, + 16, + 15, + 1, + 16, + 15, + 13, + 16, + 7, + 4, + 10, + 15, + 20, + 12, + 20, + 13, + 0, + 12, + 11, + 9, + 12, + 5, + 3, + 23, + 7, + 14, + 2, + 13, + 16, + 3 + ], + "weighted_loads": [ + 1.8231285074725747, + 1.4561052825301886, + 1.0696948003023863, + 0.8918608108069748, + 0.2804031576961279, + 0.28339276323094964, + 1.4909075032919645, + 0.26187799125909805, + 0.49553237040527165, + 0.38811760023236275, + 0.29444550536572933, + 0.1677977219223976, + 0.010198070667684078, + 0.6574899815022945, + 1.2107047699391842, + 0.2266068533062935, + 0.07505009649321437, + 0.7162077613174915, + 0.7182246167212725, + 1.1021125800907612, + 0.6265836618840694, + 0.19561302289366722, + 1.1668467540293932, + 2.7797766365110874, + 0.3590935803949833, + 0.383473489433527, + 0.06047787703573704, + 0.0986962579190731, + 0.10669235326349735, + 0.8424667790532112, + 0.27378024719655514, + 0.5127163883298635, + 0.12972873449325562, + 0.7500038897851482, + 0.20034439489245415, + 0.9846693370491266, + 1.112345453351736, + 0.04672352969646454, + 0.8992804400622845, + 0.6250622924417257, + 0.5048060156404972, + 0.79473508708179, + 0.23392060212790966, + 0.18325509130954742, + 0.547295717522502, + 2.605069514364004, + 1.8194773085415363, + 0.7710368908010423, + 1.2241818942129612, + 0.5422085002064705, + 0.0, + 0.6893517859280109, + 1.055141944438219, + 0.34195178374648094, + 1.091490302234888, + 0.3286387212574482, + 0.19046497717499733, + 1.9096348341554403, + 0.2944420613348484, + 0.8886781744658947, + 0.07489510998129845, + 1.1313615180552006, + 0.7523596584796906, + 0.12138956785202026 + ], + "unique_experts": 63, + "load_cv": 0.5549419001097092, + "normalized_load_entropy": 0.9579586450146809, + "max_load_share": 0.03333333333333333 + } + }, + "s0_bos": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "4f70d8bb51a0cbabe0f0bf3db98d5138d22f774ac1a3163c4602d0f371ebba4a", + "route_weight_sha256": "0c0516b58eea77aa0a82c3a1b93b198cc7288c0d6cbbd7fb2eadccd5755e7f8b", + "loads": [ + 9, + 12, + 17, + 4, + 3, + 6, + 9, + 2, + 9, + 4, + 4, + 5, + 0, + 10, + 12, + 2, + 0, + 9, + 11, + 19, + 10, + 4, + 14, + 7, + 6, + 11, + 1, + 2, + 5, + 13, + 9, + 9, + 0, + 0, + 4, + 17, + 11, + 2, + 8, + 13, + 6, + 16, + 6, + 4, + 9, + 7, + 4, + 7, + 13, + 10, + 1, + 2, + 5, + 8, + 2, + 5, + 4, + 5, + 3, + 14, + 0, + 12, + 7, + 1 + ], + "weighted_loads": [ + 1.2189582474529743, + 0.975226879119873, + 0.8182767871767282, + 0.3486565724015236, + 0.13766488432884216, + 0.2548422645777464, + 0.6806322112679482, + 0.0636199526488781, + 0.4630596227943897, + 0.14749165996909142, + 0.17936667427420616, + 0.17958217300474644, + 0.0, + 0.4549211207777262, + 0.9776961207389832, + 0.0766679085791111, + 0.0, + 0.6633138209581375, + 0.600063556805253, + 0.9627238176763058, + 0.5344714187085629, + 0.13033454678952694, + 1.126156723126769, + 0.9208605512976646, + 0.21932079456746578, + 0.4689966272562742, + 0.034438200294971466, + 0.09974773228168488, + 0.1759408935904503, + 0.8717917446047068, + 0.3128402791917324, + 0.5213873740285635, + 0.0, + 0.0, + 0.14138087630271912, + 1.015786774456501, + 0.7639408074319363, + 0.058931389823555946, + 0.41198450699448586, + 0.5716873463243246, + 0.24875088781118393, + 0.8038827907294035, + 0.2156086303293705, + 0.18973079323768616, + 0.46746996976435184, + 0.561123663559556, + 0.19494658894836903, + 0.49188030511140823, + 0.8969917520880699, + 0.39391234517097473, + 0.04147446155548096, + 0.05818648636341095, + 0.38118309155106544, + 0.3151935338973999, + 0.11765750870108604, + 0.3507236782461405, + 0.23054814338684082, + 0.19567153230309486, + 0.10174806788563728, + 0.9259113781154156, + 0.0, + 0.9958215616643429, + 0.4396253414452076, + 0.04815621301531792 + ], + "unique_experts": 59, + "load_cv": 0.6841510485644573, + "normalized_load_entropy": 0.9366843738312617, + "max_load_share": 0.04279279279279279 + }, + "full_input": { + "tokens": 99, + "top_k": 6, + "decisions": 594, + "ordered_route_sha256": "8596489d0643df890ddd638575d64e24c4a6c14a42177e2eb73cba76098940fc", + "route_weight_sha256": "0db378e9b6f43eee076588d1d3631433ad7442fe96d66efd671ae8c172056600", + "loads": [ + 13, + 16, + 18, + 10, + 8, + 8, + 15, + 5, + 10, + 15, + 4, + 5, + 2, + 15, + 14, + 2, + 3, + 9, + 11, + 20, + 10, + 4, + 16, + 18, + 9, + 11, + 2, + 2, + 5, + 13, + 9, + 9, + 2, + 3, + 4, + 17, + 11, + 2, + 12, + 15, + 14, + 16, + 8, + 5, + 9, + 14, + 15, + 10, + 15, + 10, + 2, + 3, + 5, + 10, + 12, + 7, + 4, + 15, + 5, + 15, + 0, + 12, + 10, + 1 + ], + "weighted_loads": [ + 1.5458458582870662, + 1.266617015004158, + 0.8764397222548723, + 0.5495027336291969, + 0.3548576422035694, + 0.31258627818897367, + 1.1509062051773071, + 0.2067088969051838, + 0.5102877132594585, + 0.5293064117431641, + 0.17936667427420616, + 0.17958217300474644, + 0.04692457523196936, + 0.6651913709938526, + 1.1002191752195358, + 0.0766679085791111, + 0.05142976203933358, + 0.6633138209581375, + 0.600063556805253, + 1.0993905328214169, + 0.5344714187085629, + 0.13033454678952694, + 1.1875328831374645, + 2.312725752592087, + 0.32056575641036034, + 0.4689966272562742, + 0.1842484250664711, + 0.09974773228168488, + 0.1759408935904503, + 0.8717917446047068, + 0.3128402791917324, + 0.5213873740285635, + 0.09929116070270538, + 0.24933017045259476, + 0.14138087630271912, + 1.015786774456501, + 0.7639408074319363, + 0.058931389823555946, + 0.6188738672062755, + 0.6227729711681604, + 0.5914605278521776, + 0.8038827907294035, + 0.26701873913407326, + 0.2548579201102257, + 0.46746996976435184, + 1.6623716745525599, + 1.1634479146450758, + 0.6454516611993313, + 0.9984429813921452, + 0.39391234517097473, + 0.10693579167127609, + 0.1476517766714096, + 0.38118309155106544, + 0.4285180829465389, + 1.0484035350382328, + 0.43668382801115513, + 0.23054814338684082, + 1.1995666474103928, + 0.21285346522927284, + 1.1454244814813137, + 0.0, + 0.9958215616643429, + 0.5362282767891884, + 0.04815621301531792 + ], + "unique_experts": 63, + "load_cv": 0.5600066562297241, + "normalized_load_entropy": 0.9568855616380731, + "max_load_share": 0.03367003367003367 + } + }, + "s1_bos": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "0056422c5ea08b8eb5a4118bb1e1f5a56a3ddcef3c85d945a1dfb9358155e3a0", + "route_weight_sha256": "636f1556225046c7ae16428775f1c457c5cca947bc64a0b0f5a1dec865541d48", + "loads": [ + 9, + 12, + 16, + 4, + 3, + 5, + 9, + 3, + 9, + 5, + 4, + 4, + 0, + 9, + 12, + 2, + 0, + 9, + 11, + 21, + 11, + 6, + 14, + 7, + 8, + 11, + 2, + 2, + 5, + 12, + 5, + 9, + 1, + 1, + 4, + 17, + 11, + 1, + 8, + 12, + 6, + 14, + 7, + 4, + 9, + 7, + 5, + 6, + 13, + 9, + 1, + 0, + 6, + 10, + 2, + 6, + 4, + 5, + 4, + 14, + 0, + 11, + 6, + 1 + ], + "weighted_loads": [ + 1.2187080346047878, + 0.9901305921375751, + 0.7825366407632828, + 0.3489130698144436, + 0.13044549897313118, + 0.22209226340055466, + 0.6709643974900246, + 0.10244638286530972, + 0.46258776634931564, + 0.18343321979045868, + 0.16498042456805706, + 0.14674239233136177, + 0.0, + 0.439753495156765, + 0.9449614137411118, + 0.07440430670976639, + 0.0, + 0.6403506770730019, + 0.5942256785929203, + 1.042574007064104, + 0.5732449777424335, + 0.20094139873981476, + 1.1334806457161903, + 0.9383877292275429, + 0.2873335611075163, + 0.4776604827493429, + 0.06556123867630959, + 0.10699070617556572, + 0.1758160386234522, + 0.8095269948244095, + 0.18704220838844776, + 0.5499506611377001, + 0.03967313840985298, + 0.02982783503830433, + 0.15923657827079296, + 1.0239409767091274, + 0.7511101961135864, + 0.029420025646686554, + 0.40918083116412163, + 0.5211655888706446, + 0.2571095433086157, + 0.7371887341141701, + 0.23036998137831688, + 0.1895428653806448, + 0.47111652977764606, + 0.5520620625466108, + 0.21704561822116375, + 0.4432522691786289, + 0.8963254764676094, + 0.35978754237294197, + 0.036724530160427094, + 0.0, + 0.4331056699156761, + 0.38378056697547436, + 0.1131323017179966, + 0.36871696822345257, + 0.22071570344269276, + 0.19923172146081924, + 0.13022954761981964, + 0.9076354373246431, + 0.0, + 0.9323645494878292, + 0.41383839026093483, + 0.04447469115257263 + ], + "unique_experts": 60, + "load_cv": 0.6702484739263375, + "normalized_load_entropy": 0.939939544318723, + "max_load_share": 0.0472972972972973 + }, + "full_input": { + "tokens": 115, + "top_k": 6, + "decisions": 690, + "ordered_route_sha256": "251629a997f57fd4bbf3e1b5d4cc615a7d5df66cc82a6d808a6fb739f4db9531", + "route_weight_sha256": "76594745723261106dabcd2b6c87237224242df8cb4c704e014c43ca769d23fe", + "loads": [ + 15, + 20, + 23, + 12, + 6, + 8, + 21, + 9, + 11, + 10, + 6, + 5, + 1, + 14, + 13, + 5, + 4, + 10, + 13, + 21, + 12, + 6, + 16, + 22, + 11, + 11, + 2, + 2, + 5, + 13, + 7, + 9, + 2, + 12, + 4, + 17, + 17, + 3, + 15, + 13, + 15, + 14, + 8, + 4, + 11, + 14, + 21, + 10, + 20, + 12, + 1, + 10, + 12, + 14, + 12, + 9, + 4, + 23, + 6, + 14, + 2, + 12, + 13, + 3 + ], + "weighted_loads": [ + 1.74669918557629, + 1.488811718299985, + 1.142426759004593, + 0.851952716242522, + 0.25853234715759754, + 0.30858770618215203, + 1.4789882097393274, + 0.32348494604229927, + 0.5485111325979233, + 0.3975084740668535, + 0.2553962264209986, + 0.1858132742345333, + 0.010198070667684078, + 0.6563698928803205, + 1.0411965027451515, + 0.19388851709663868, + 0.07505009649321437, + 0.6994369029998779, + 0.6835650727152824, + 1.042574007064104, + 0.6186264753341675, + 0.20094139873981476, + 1.1979338750243187, + 2.9087623320519924, + 0.4097669757902622, + 0.4776604827493429, + 0.06556123867630959, + 0.10699070617556572, + 0.1758160386234522, + 0.8545725494623184, + 0.27757234312593937, + 0.5499506611377001, + 0.08402154967188835, + 0.7341145239770412, + 0.15923657827079296, + 1.0239409767091274, + 1.1805068999528885, + 0.12106814980506897, + 0.8273367621004581, + 0.5459668803960085, + 0.624353926628828, + 0.7371887341141701, + 0.25970904901623726, + 0.1895428653806448, + 0.5737687330693007, + 1.668383315205574, + 1.833725804463029, + 0.745766393840313, + 1.2277360446751118, + 0.5065908916294575, + 0.036724530160427094, + 0.6197664737701416, + 1.0782383419573307, + 0.5873725023120642, + 1.0832239128649235, + 0.49629886634647846, + 0.22071570344269276, + 1.9114094022661448, + 0.2702721916139126, + 0.9076354373246431, + 0.07489510998129845, + 1.0586462877690792, + 0.6632680874317884, + 0.13262833654880524 + ], + "unique_experts": 64, + "load_cv": 0.54269508788278, + "normalized_load_entropy": 0.9612450079679989, + "max_load_share": 0.03333333333333333 + } + }, + "s0_x": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "c25ca3a12b72dfbf334ae876f1a9067b3999f53836923bb8187df54901c0677f", + "route_weight_sha256": "0d15230708e8f1bdf8231b2c3ec3d7d2079bda294f71c757929d4e93613123ec", + "loads": [ + 9, + 12, + 16, + 4, + 3, + 6, + 9, + 2, + 9, + 4, + 4, + 2, + 0, + 11, + 13, + 3, + 1, + 11, + 11, + 22, + 11, + 7, + 14, + 7, + 7, + 12, + 2, + 2, + 3, + 13, + 12, + 7, + 0, + 1, + 4, + 17, + 9, + 1, + 8, + 10, + 6, + 15, + 6, + 4, + 9, + 6, + 4, + 7, + 13, + 10, + 1, + 1, + 5, + 6, + 2, + 4, + 4, + 4, + 5, + 13, + 0, + 12, + 7, + 1 + ], + "weighted_loads": [ + 1.2264074236154556, + 0.9891427904367447, + 0.7817346155643463, + 0.36647985875606537, + 0.1312498189508915, + 0.24391083233058453, + 0.6923711262643337, + 0.06843942403793335, + 0.45721637457609177, + 0.1407628208398819, + 0.1551941353827715, + 0.07251150161027908, + 0.0, + 0.46529338508844376, + 1.0205398108810186, + 0.10756977275013924, + 0.04087172448635101, + 0.7357900217175484, + 0.5997918248176575, + 1.0555629879236221, + 0.6002999097108841, + 0.2303070779889822, + 1.1552607268095016, + 0.9051976278424263, + 0.24686302058398724, + 0.4879588559269905, + 0.05774840712547302, + 0.10549487173557281, + 0.10529942438006401, + 0.8380662351846695, + 0.41254977881908417, + 0.4619523175060749, + 0.0, + 0.026392141357064247, + 0.1436225287616253, + 1.0116487983614206, + 0.7022746875882149, + 0.03651764616370201, + 0.4166640341281891, + 0.46273027546703815, + 0.24579938501119614, + 0.7690142914652824, + 0.213993389159441, + 0.1844784952700138, + 0.4772376976907253, + 0.5623967237770557, + 0.2041523065418005, + 0.4833250753581524, + 0.8978596813976765, + 0.39645485021173954, + 0.04046003147959709, + 0.03101000376045704, + 0.37604106217622757, + 0.243333101272583, + 0.1170792505145073, + 0.3417387530207634, + 0.2170589342713356, + 0.156331405043602, + 0.15571067854762077, + 0.8437630087137222, + 0.0, + 0.9991418793797493, + 0.4125004094094038, + 0.045742981135845184 + ], + "unique_experts": 61, + "load_cv": 0.696845536550187, + "normalized_load_entropy": 0.9371159850379783, + "max_load_share": 0.04954954954954955 + }, + "full_input": { + "tokens": 99, + "top_k": 6, + "decisions": 594, + "ordered_route_sha256": "2daea24d34df9b8e641ca2919d2133fbf09dac29ee609ab1579bd7999fdb357b", + "route_weight_sha256": "49458a9fd9be2d577cb608fdb4712253d10d1f9b09a861a234712aa40de39da5", + "loads": [ + 14, + 16, + 17, + 12, + 6, + 8, + 16, + 6, + 9, + 15, + 4, + 4, + 1, + 16, + 15, + 3, + 5, + 11, + 11, + 22, + 11, + 8, + 15, + 18, + 11, + 12, + 2, + 2, + 3, + 13, + 12, + 7, + 2, + 5, + 4, + 17, + 10, + 1, + 13, + 12, + 11, + 15, + 8, + 4, + 9, + 14, + 17, + 10, + 15, + 10, + 1, + 2, + 5, + 6, + 13, + 5, + 4, + 13, + 7, + 13, + 0, + 12, + 10, + 1 + ], + "weighted_loads": [ + 1.6597515004687011, + 1.293925128877163, + 0.8268973790109158, + 0.7069038855843246, + 0.2487422078847885, + 0.3016548459418118, + 1.1899258084595203, + 0.23161876574158669, + 0.45721637457609177, + 0.5059342961758375, + 0.1551941353827715, + 0.1563998032361269, + 0.010220847092568874, + 0.6755636353045702, + 1.1393364686518908, + 0.10756977275013924, + 0.12090028123930097, + 0.7357900217175484, + 0.5997918248176575, + 1.0555629879236221, + 0.6002999097108841, + 0.25078775361180305, + 1.1738099548965693, + 2.2439403384923935, + 0.3878635875880718, + 0.4879588559269905, + 0.05774840712547302, + 0.10549487173557281, + 0.10529942438006401, + 0.8380662351846695, + 0.41254977881908417, + 0.4619523175060749, + 0.10545974224805832, + 0.40135165862739086, + 0.1436225287616253, + 1.0116487983614206, + 0.740711685270071, + 0.03651764616370201, + 0.6848866017535329, + 0.513815900310874, + 0.4451089445501566, + 0.7690142914652824, + 0.26540349796414375, + 0.1844784952700138, + 0.4772376976907253, + 1.679499115794897, + 1.3289884459227324, + 0.6107572913169861, + 0.991765096783638, + 0.39645485021173954, + 0.04046003147959709, + 0.1204752940684557, + 0.37604106217622757, + 0.243333101272583, + 1.1835619509220123, + 0.38539788126945496, + 0.2170589342713356, + 1.1806434951722622, + 0.25746696069836617, + 0.8437630087137222, + 0.0, + 0.9991418793797493, + 0.5116120744496584, + 0.045742981135845184 + ], + "unique_experts": 63, + "load_cv": 0.5705953229292363, + "normalized_load_entropy": 0.9546702018335703, + "max_load_share": 0.037037037037037035 + } + }, + "s1_x": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "ce4bc49b3fbbb42cbd02c8e916ce653fc6234f1d79c8bb8c614a0b3a76e84207", + "route_weight_sha256": "fd812f43da0084a81df12be39526bcb83bbc9a6ab2689b7f8ead776a65860284", + "loads": [ + 9, + 12, + 14, + 4, + 2, + 5, + 9, + 5, + 9, + 7, + 3, + 4, + 0, + 9, + 11, + 1, + 1, + 9, + 11, + 19, + 11, + 5, + 13, + 7, + 7, + 15, + 2, + 3, + 4, + 13, + 10, + 7, + 1, + 1, + 4, + 14, + 11, + 2, + 7, + 11, + 6, + 15, + 3, + 4, + 10, + 7, + 4, + 6, + 13, + 13, + 0, + 1, + 7, + 4, + 3, + 5, + 5, + 4, + 6, + 15, + 0, + 12, + 7, + 2 + ], + "weighted_loads": [ + 1.2778123952448368, + 0.978153184056282, + 0.74388781003654, + 0.36244241893291473, + 0.08871487900614738, + 0.2112758830189705, + 0.6573471017181873, + 0.1579396277666092, + 0.4674977846443653, + 0.27120407298207283, + 0.12817620858550072, + 0.1292330827564001, + 0.0, + 0.40525306202471256, + 0.9117037747055292, + 0.03973513841629028, + 0.03306502103805542, + 0.6461425274610519, + 0.5875868014991283, + 0.9628980625420809, + 0.6031696051359177, + 0.17133170552551746, + 1.1725842952728271, + 0.930598609149456, + 0.25414084643125534, + 0.6212879214435816, + 0.060587579384446144, + 0.14582910388708115, + 0.1385980937629938, + 0.8111624382436275, + 0.3528049513697624, + 0.4534762352705002, + 0.04850846156477928, + 0.02748156525194645, + 0.15279369242489338, + 0.8932186458259821, + 0.7691324576735497, + 0.05705970712006092, + 0.3687908537685871, + 0.5156753808259964, + 0.2489109020680189, + 0.7461985349655151, + 0.10849363543093204, + 0.1692829690873623, + 0.5134466644376516, + 0.5731404088437557, + 0.17689628899097443, + 0.4445108398795128, + 0.9015428870916367, + 0.47938830219209194, + 0.0, + 0.02896919846534729, + 0.47548432648181915, + 0.14847297593951225, + 0.12369313649833202, + 0.364610955119133, + 0.24625673331320286, + 0.16272760555148125, + 0.18685800023376942, + 0.908545047044754, + 0.0, + 0.9742932785302401, + 0.4376929812133312, + 0.07032950036227703 + ], + "unique_experts": 61, + "load_cv": 0.657534234993972, + "normalized_load_entropy": 0.9425559920820687, + "max_load_share": 0.04279279279279279 + }, + "full_input": { + "tokens": 115, + "top_k": 6, + "decisions": 690, + "ordered_route_sha256": "3cfe7d6039b147c433d608985467e6a8c57754bcee79ed5a971ae69c78842fbb", + "route_weight_sha256": "ad4e6217070eba95cfbc600c1269135ffd01d8817a26482cf148bee11944fba2", + "loads": [ + 15, + 20, + 20, + 14, + 4, + 8, + 22, + 11, + 10, + 11, + 5, + 5, + 1, + 15, + 12, + 4, + 6, + 10, + 13, + 19, + 12, + 5, + 14, + 23, + 10, + 15, + 2, + 3, + 4, + 14, + 10, + 7, + 2, + 11, + 4, + 14, + 17, + 3, + 15, + 12, + 13, + 15, + 4, + 4, + 12, + 14, + 24, + 10, + 21, + 17, + 0, + 12, + 13, + 5, + 16, + 7, + 5, + 21, + 7, + 15, + 2, + 13, + 15, + 3 + ], + "weighted_loads": [ + 1.8369719623588026, + 1.4748673867434263, + 1.0541738364845514, + 0.9554204675368965, + 0.17314309813082218, + 0.2945656278170645, + 1.4851341340690851, + 0.35230490379035473, + 0.5001550726592541, + 0.45170252956449986, + 0.21859201043844223, + 0.1718334723263979, + 0.010198070667684078, + 0.6536718159914017, + 1.007938863709569, + 0.15921934880316257, + 0.14694813219830394, + 0.705228753387928, + 0.6769261956214905, + 0.9628980625420809, + 0.6485511027276516, + 0.17133170552551746, + 1.191099602729082, + 2.8544095754623413, + 0.3847872670739889, + 0.6212879214435816, + 0.060587579384446144, + 0.14582910388708115, + 0.1385980937629938, + 0.8562079928815365, + 0.3528049513697624, + 0.4534762352705002, + 0.09285687282681465, + 0.7560330033302307, + 0.15279369242489338, + 0.8932186458259821, + 1.1985291615128517, + 0.10378323681652546, + 0.8516740538179874, + 0.5404766723513603, + 0.4976984076201916, + 0.7461985349655151, + 0.13783270306885242, + 0.1692829690873623, + 0.6160988677293062, + 1.7168094255030155, + 2.0881366711109877, + 0.7358709834516048, + 1.29592290148139, + 0.664175933226943, + 0.0, + 0.733981229364872, + 1.1206169985234737, + 0.18074961751699448, + 1.3491536062210798, + 0.4304036609828472, + 0.24625673331320286, + 1.834679601714015, + 0.26784671284258366, + 0.908545047044754, + 0.07489510998129845, + 1.10057501681149, + 0.7173725087195635, + 0.11223071627318859 + ], + "unique_experts": 63, + "load_cv": 0.5619227650370064, + "normalized_load_entropy": 0.9576065727650466, + "max_load_share": 0.034782608695652174 + } + }, + "s0_period": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "57476f0f14e1d3837ff017355659b5c297e1b389fffb76646d246e9bba5e5d77", + "route_weight_sha256": "6c145e4d5838d9de6351452459fddf94354c6d6b8279da98a87253192e2ebf95", + "loads": [ + 9, + 12, + 17, + 4, + 4, + 6, + 9, + 3, + 9, + 4, + 3, + 3, + 0, + 9, + 13, + 3, + 1, + 10, + 11, + 20, + 11, + 5, + 15, + 7, + 8, + 11, + 1, + 3, + 4, + 12, + 10, + 8, + 1, + 1, + 4, + 17, + 11, + 0, + 8, + 12, + 6, + 15, + 4, + 4, + 9, + 6, + 4, + 7, + 13, + 8, + 1, + 2, + 6, + 7, + 2, + 4, + 4, + 4, + 3, + 14, + 0, + 12, + 9, + 1 + ], + "weighted_loads": [ + 1.2110953405499458, + 0.9860618785023689, + 0.815121728926897, + 0.36243999004364014, + 0.16449795104563236, + 0.24380564875900745, + 0.6898456737399101, + 0.10115723684430122, + 0.45107123628258705, + 0.14230351895093918, + 0.1324346512556076, + 0.0895058661699295, + 0.0, + 0.42574432492256165, + 1.013050263747573, + 0.09988800995051861, + 0.034711938351392746, + 0.6991463378071785, + 0.6166503764688969, + 0.9674327168613672, + 0.6019147261977196, + 0.17099222540855408, + 1.182050945237279, + 0.9356655143201351, + 0.27256936579942703, + 0.4584844261407852, + 0.03015958145260811, + 0.13523544184863567, + 0.13199278339743614, + 0.8082663454115391, + 0.35292970202863216, + 0.488537922501564, + 0.03909364342689514, + 0.027018725872039795, + 0.142434261739254, + 1.0160755850374699, + 0.7749361991882324, + 0.0, + 0.4057185649871826, + 0.5378669984638691, + 0.23806954361498356, + 0.7694722265005112, + 0.14485278725624084, + 0.1827862448990345, + 0.4745508190244436, + 0.5664512701332569, + 0.2060165349394083, + 0.48385703936219215, + 0.9124407917261124, + 0.3324823547154665, + 0.040149785578250885, + 0.06115191429853439, + 0.40812281519174576, + 0.26876313239336014, + 0.10877847671508789, + 0.3281567022204399, + 0.20817806757986546, + 0.15542185679078102, + 0.10853983834385872, + 0.8928923234343529, + 0.0, + 0.9987299889326096, + 0.47603399120271206, + 0.04720774665474892 + ], + "unique_experts": 61, + "load_cv": 0.6846254123230029, + "normalized_load_entropy": 0.9390191458754633, + "max_load_share": 0.04504504504504504 + }, + "full_input": { + "tokens": 99, + "top_k": 6, + "decisions": 594, + "ordered_route_sha256": "2d6854e943487502a9ee17de396c84193d01ad07376805ebeb9df6392a7dff4f", + "route_weight_sha256": "e7252dabcf1fb36ebfba276871a6a78cc4a83cd02dc97788922ac053c4b7c8ac", + "loads": [ + 14, + 16, + 19, + 10, + 8, + 8, + 17, + 8, + 9, + 16, + 3, + 5, + 1, + 14, + 14, + 3, + 4, + 10, + 11, + 20, + 11, + 5, + 16, + 18, + 12, + 11, + 1, + 3, + 4, + 12, + 10, + 8, + 3, + 5, + 4, + 17, + 11, + 0, + 14, + 14, + 12, + 15, + 6, + 4, + 9, + 13, + 15, + 10, + 15, + 8, + 1, + 3, + 6, + 8, + 13, + 5, + 4, + 14, + 5, + 14, + 0, + 12, + 12, + 1 + ], + "weighted_loads": [ + 1.6442199531011283, + 1.2798095047473907, + 0.9003441371023655, + 0.5632861512713134, + 0.32640153355896473, + 0.30154966237023473, + 1.256455585360527, + 0.2993052676320076, + 0.45107123628258705, + 0.5851414166390896, + 0.1324346512556076, + 0.17122861742973328, + 0.010220847092568874, + 0.6360145751386881, + 1.0874354373663664, + 0.09988800995051861, + 0.08614170039072633, + 0.6991463378071785, + 0.6166503764688969, + 0.9674327168613672, + 0.6019147261977196, + 0.17099222540855408, + 1.2006001733243465, + 2.2611540406942368, + 0.4168694745749235, + 0.4584844261407852, + 0.03015958145260811, + 0.13523544184863567, + 0.13199278339743614, + 0.8082663454115391, + 0.35292970202863216, + 0.488537922501564, + 0.14375369995832443, + 0.3827096074819565, + 0.142434261739254, + 1.0160755850374699, + 0.7749361991882324, + 0.0, + 0.8079425832256675, + 0.5889526233077049, + 0.49367677606642246, + 0.7694722265005112, + 0.1962628960609436, + 0.1827862448990345, + 0.4745508190244436, + 1.6525161154568195, + 1.174517860636115, + 0.6179025918245316, + 1.0106552354991436, + 0.3324823547154665, + 0.040149785578250885, + 0.15061720460653305, + 0.40812281519174576, + 0.3137909360229969, + 1.0896551795303822, + 0.3677987903356552, + 0.20817806757986546, + 1.1968914531171322, + 0.21645214781165123, + 0.8928923234343529, + 0.0, + 0.9987299889326096, + 0.5710405111312866, + 0.04720774665474892 + ], + "unique_experts": 62, + "load_cv": 0.5680464984139292, + "normalized_load_entropy": 0.9542342844169157, + "max_load_share": 0.03367003367003367 + } + }, + "s1_period": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "4f1562d27b409091638c42a081351bf91afa6ffe0095380932f2c2103aa392fe", + "route_weight_sha256": "5fc3fd9a15237f05a0e52fe7df96f952e7ea6e3f97f2f801bd5ddae74c372ee7", + "loads": [ + 9, + 12, + 16, + 4, + 1, + 7, + 9, + 3, + 9, + 8, + 3, + 4, + 0, + 9, + 12, + 2, + 0, + 10, + 11, + 20, + 12, + 7, + 13, + 7, + 6, + 14, + 1, + 3, + 4, + 13, + 8, + 7, + 1, + 1, + 4, + 15, + 11, + 3, + 8, + 11, + 6, + 15, + 2, + 3, + 10, + 8, + 4, + 6, + 13, + 9, + 0, + 1, + 6, + 7, + 3, + 3, + 4, + 5, + 5, + 15, + 0, + 12, + 8, + 1 + ], + "weighted_loads": [ + 1.2510631084442139, + 0.9776043742895126, + 0.7858098559081554, + 0.35220085829496384, + 0.055024780333042145, + 0.2835921086370945, + 0.6727960333228111, + 0.09901132248342037, + 0.4700687937438488, + 0.29807054810225964, + 0.12877607718110085, + 0.1431489959359169, + 0.0, + 0.43063085712492466, + 0.9235744830220938, + 0.06926876865327358, + 0.0, + 0.6713538505136967, + 0.5866455789655447, + 1.0423377342522144, + 0.6383085697889328, + 0.24375846050679684, + 1.1374106146395206, + 0.9265274107456207, + 0.22046882659196854, + 0.6029002666473389, + 0.029129451140761375, + 0.14420196786522865, + 0.13330967724323273, + 0.8064586315304041, + 0.2749202027916908, + 0.46690878830850124, + 0.04427298158407211, + 0.029351163655519485, + 0.15974567830562592, + 0.9213245920836926, + 0.7475319318473339, + 0.08911552838981152, + 0.4031464718282223, + 0.48995282500982285, + 0.23815692588686943, + 0.7529439181089401, + 0.07894546538591385, + 0.13807760179042816, + 0.5207942128181458, + 0.5979288145899773, + 0.17849008552730083, + 0.43069903180003166, + 0.9046864658594131, + 0.3515693638473749, + 0.0, + 0.03101937472820282, + 0.4237894155085087, + 0.25930627062916756, + 0.13079323433339596, + 0.28980331495404243, + 0.2129786778241396, + 0.20138020440936089, + 0.15764383226633072, + 0.9193529933691025, + 0.0, + 0.9481738097965717, + 0.4730540756136179, + 0.04217426851391792 + ], + "unique_experts": 60, + "load_cv": 0.6812979301100768, + "normalized_load_entropy": 0.9372099256296427, + "max_load_share": 0.04504504504504504 + }, + "full_input": { + "tokens": 115, + "top_k": 6, + "decisions": 690, + "ordered_route_sha256": "8d8bbeb76910bfca0de391342e819352fbef9ce55a6c3a812e3cf3284b1741d3", + "route_weight_sha256": "50246b9d6e539d5b329255479441989f016742aa2ae73c195dcb70fb6b483354", + "loads": [ + 15, + 20, + 24, + 12, + 3, + 10, + 23, + 11, + 12, + 13, + 5, + 5, + 1, + 14, + 13, + 5, + 5, + 11, + 13, + 20, + 13, + 7, + 14, + 21, + 9, + 14, + 1, + 3, + 4, + 14, + 8, + 7, + 2, + 12, + 4, + 15, + 17, + 4, + 17, + 12, + 13, + 15, + 3, + 3, + 12, + 15, + 22, + 10, + 20, + 13, + 1, + 11, + 12, + 9, + 15, + 5, + 4, + 22, + 6, + 15, + 2, + 13, + 14, + 2 + ], + "weighted_loads": [ + 1.7839202298782766, + 1.4728830810636282, + 1.158167414367199, + 0.8552405047230422, + 0.13945299945771694, + 0.36976673314347863, + 1.5339010562747717, + 0.3627305068075657, + 0.5661144685000181, + 0.5215318016707897, + 0.21919187903404236, + 0.18236849084496498, + 0.010198070667684078, + 0.6472472548484802, + 1.0198095720261335, + 0.18875297904014587, + 0.1109520117752254, + 0.7304400764405727, + 0.6759849730879068, + 1.0423377342522144, + 0.6836900673806667, + 0.24375846050679684, + 1.1559259220957756, + 2.786158699542284, + 0.3513756711035967, + 0.6029002666473389, + 0.029129451140761375, + 0.14420196786522865, + 0.13330967724323273, + 0.851504186168313, + 0.2749202027916908, + 0.46690878830850124, + 0.08862139284610748, + 0.8134903330355883, + 0.15974567830562592, + 0.9213245920836926, + 1.176928635686636, + 0.13583905808627605, + 1.0639115814119577, + 0.5147541165351868, + 0.4950966238975525, + 0.7529439181089401, + 0.10828453302383423, + 0.13807760179042816, + 0.6234464161098003, + 1.7248165309429169, + 1.8825532775372267, + 0.7137684971094131, + 1.2418474219739437, + 0.5403565969318151, + 0.02557286061346531, + 0.6507858484983444, + 1.0689220875501633, + 0.33783140033483505, + 1.2092324923723936, + 0.3603700213134289, + 0.2129786778241396, + 1.87369748018682, + 0.23863254487514496, + 0.9193529933691025, + 0.07489510998129845, + 1.0744555480778217, + 0.6935573946684599, + 0.08407548442482948 + ], + "unique_experts": 64, + "load_cv": 0.5671612801173544, + "normalized_load_entropy": 0.9569219546048737, + "max_load_share": 0.034782608695652174 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 74, + "ordered_topk_exact_tokens": 36, + "set_exact_tokens": 44, + "mean_set_jaccard": 0.8812741312741313, + "mean_token_weighted_tv": 0.02022517188074621, + "aggregate_load_tv": 0.04504504504504504 + }, + "system_bos": { + "tokens": 74, + "ordered_topk_exact_tokens": 33, + "set_exact_tokens": 46, + "mean_set_jaccard": 0.8832046332046333, + "mean_token_weighted_tv": 0.021630516238007193, + "aggregate_load_tv": 0.04279279279279279 + }, + "system_x": { + "tokens": 74, + "ordered_topk_exact_tokens": 23, + "set_exact_tokens": 32, + "mean_set_jaccard": 0.805984555984556, + "mean_token_weighted_tv": 0.03416626412119415, + "aggregate_load_tv": 0.07207207207207207 + }, + "system_period": { + "tokens": 74, + "ordered_topk_exact_tokens": 27, + "set_exact_tokens": 40, + "mean_set_jaccard": 0.8530888030888032, + "mean_token_weighted_tv": 0.02838416687036688, + "aggregate_load_tv": 0.05630630630630629 + }, + "bos_at_s0": { + "tokens": 74, + "ordered_topk_exact_tokens": 31, + "set_exact_tokens": 35, + "mean_set_jaccard": 0.8362290862290863, + "mean_token_weighted_tv": 0.028907012307664025, + "aggregate_load_tv": 0.058558558558558564 + }, + "bos_at_s1": { + "tokens": 74, + "ordered_topk_exact_tokens": 30, + "set_exact_tokens": 39, + "mean_set_jaccard": 0.8561776061776062, + "mean_token_weighted_tv": 0.026083452224328712, + "aggregate_load_tv": 0.05855855855855855 + }, + "x_at_s0": { + "tokens": 74, + "ordered_topk_exact_tokens": 23, + "set_exact_tokens": 33, + "mean_set_jaccard": 0.8144787644787645, + "mean_token_weighted_tv": 0.03305891839585997, + "aggregate_load_tv": 0.06306306306306306 + }, + "x_at_s1": { + "tokens": 74, + "ordered_topk_exact_tokens": 24, + "set_exact_tokens": 29, + "mean_set_jaccard": 0.7961389961389961, + "mean_token_weighted_tv": 0.037312988984725765, + "aggregate_load_tv": 0.08783783783783784 + }, + "period_at_s0": { + "tokens": 74, + "ordered_topk_exact_tokens": 23, + "set_exact_tokens": 31, + "mean_set_jaccard": 0.8201415701415702, + "mean_token_weighted_tv": 0.03207822215768534, + "aggregate_load_tv": 0.05405405405405404 + }, + "period_at_s1": { + "tokens": 74, + "ordered_topk_exact_tokens": 23, + "set_exact_tokens": 31, + "mean_set_jaccard": 0.8137065637065638, + "mean_token_weighted_tv": 0.03462678603072827, + "aggregate_load_tv": 0.07432432432432431 + } + } + }, + "layer_24": { + "layer": 24, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "56dba22df3eb05366536cbf9bb886ecee6470cb72021afb6e0a8807bd36c7a76", + "route_weight_sha256": "30efb528939f7379d52b11c0ce583c93646f8b6e83a1ecefd6771b34f214d5ab", + "loads": [ + 16, + 0, + 14, + 1, + 4, + 14, + 5, + 2, + 7, + 12, + 3, + 5, + 9, + 14, + 7, + 2, + 1, + 13, + 1, + 0, + 13, + 26, + 3, + 6, + 8, + 2, + 3, + 3, + 11, + 6, + 21, + 10, + 7, + 9, + 6, + 6, + 0, + 4, + 7, + 10, + 6, + 9, + 10, + 1, + 9, + 5, + 1, + 3, + 5, + 10, + 4, + 7, + 1, + 6, + 7, + 9, + 22, + 4, + 14, + 1, + 10, + 2, + 0, + 7 + ], + "weighted_loads": [ + 0.6231642011553049, + 0.0, + 0.4565447364002466, + 0.033331383019685745, + 0.1747075878083706, + 0.8505719676613808, + 0.16904493793845177, + 0.05538199841976166, + 0.7042455337941647, + 0.5525344908237457, + 0.3934805169701576, + 0.2338237166404724, + 0.5275963097810745, + 0.6904250681400299, + 0.32635005190968513, + 0.09182926639914513, + 0.039480939507484436, + 0.6171743255108595, + 0.039655011147260666, + 0.0, + 0.831879073753953, + 1.214598035439849, + 0.09103146195411682, + 0.26984730921685696, + 0.27916603721678257, + 0.07046151533722878, + 0.09502779506146908, + 0.08067351579666138, + 0.5082814488559961, + 0.3592674620449543, + 0.9708217289298773, + 0.32130431197583675, + 0.2665171790868044, + 0.6456734277307987, + 0.17978133261203766, + 0.4597671665251255, + 0.0, + 0.1449190080165863, + 0.2477489858865738, + 0.42712973803281784, + 0.49828916788101196, + 0.3073587790131569, + 0.39882054179906845, + 0.02606135979294777, + 0.37233004346489906, + 0.21305646188557148, + 0.03518560528755188, + 0.11926350370049477, + 0.4018467366695404, + 0.7528785057365894, + 0.3482452742755413, + 0.506062351167202, + 0.025172343477606773, + 0.4787822924554348, + 0.3321314323693514, + 0.5380759313702583, + 1.490891806781292, + 0.16156472638249397, + 0.8226690348237753, + 0.02780533954501152, + 0.3934911862015724, + 0.07834405824542046, + 0.0, + 0.31884023174643517 + ], + "unique_experts": 60, + "load_cv": 0.7902806225520782, + "normalized_load_entropy": 0.9249592244572916, + "max_load_share": 0.05855855855855856 + }, + "full_input": { + "tokens": 99, + "top_k": 6, + "decisions": 594, + "ordered_route_sha256": "baa2d13e2b6070acde25f74bdec6890fc353803cd5226506c64c74316a5568b4", + "route_weight_sha256": "8a6abf0a0f3cc02d367aae15ed32b93a4d84ebce8e4acd2a78ef5f1e8de11bc6", + "loads": [ + 16, + 0, + 16, + 1, + 5, + 20, + 5, + 3, + 16, + 12, + 13, + 5, + 10, + 14, + 10, + 2, + 1, + 13, + 1, + 0, + 14, + 26, + 8, + 6, + 19, + 2, + 3, + 3, + 18, + 13, + 21, + 13, + 7, + 12, + 13, + 7, + 1, + 6, + 8, + 10, + 7, + 11, + 14, + 3, + 9, + 7, + 1, + 9, + 5, + 11, + 9, + 13, + 4, + 9, + 7, + 9, + 22, + 4, + 23, + 1, + 13, + 17, + 3, + 10 + ], + "weighted_loads": [ + 0.6231642011553049, + 0.0, + 0.5240742117166519, + 0.033331383019685745, + 0.2122093103826046, + 1.1382128619588912, + 0.16904493793845177, + 0.11061456799507141, + 1.1116507844999433, + 0.5525344908237457, + 0.7763237501494586, + 0.2338237166404724, + 0.5303512250538915, + 0.6904250681400299, + 0.4349411688745022, + 0.09182926639914513, + 0.039480939507484436, + 0.6171743255108595, + 0.039655011147260666, + 0.0, + 0.865749416872859, + 1.214598035439849, + 0.43443507701158524, + 0.26984730921685696, + 0.6861600235570222, + 0.07046151533722878, + 0.09502779506146908, + 0.08067351579666138, + 0.7953122314065695, + 0.762655122205615, + 0.9708217289298773, + 0.4349548388272524, + 0.2665171790868044, + 0.8040453605353832, + 0.3870846265926957, + 0.5002751871943474, + 0.09632903337478638, + 1.037024937570095, + 0.2910996563732624, + 0.42712973803281784, + 0.5352862291038036, + 0.4170369766652584, + 0.5146673724520952, + 0.23064318299293518, + 0.37233004346489906, + 0.3041627835482359, + 0.03518560528755188, + 0.4905382370343432, + 0.4018467366695404, + 0.8117504976689816, + 0.5326214134693146, + 0.979269091039896, + 0.11031365767121315, + 0.6169358156621456, + 0.3321314323693514, + 0.5380759313702583, + 1.490891806781292, + 0.16156472638249397, + 1.1151141850859858, + 0.02780533954501152, + 0.5166981816291809, + 1.377856316510588, + 0.03661983157508075, + 2.3043758496642113 + ], + "unique_experts": 62, + "load_cv": 0.6735269241920337, + "normalized_load_entropy": 0.9402923957271853, + "max_load_share": 0.04377104377104377 + } + }, + "s1_eos": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "a8247d35916d2e8b99562dc4a4028089c87fdf0474847981fc45bf5858d9397b", + "route_weight_sha256": "8c91d33177a9d1490a75efcd0bfb58221562049f00cc9d3ff9257f0f84140a47", + "loads": [ + 13, + 0, + 15, + 1, + 4, + 14, + 5, + 2, + 6, + 12, + 2, + 4, + 11, + 14, + 7, + 2, + 1, + 13, + 1, + 0, + 15, + 25, + 4, + 8, + 7, + 2, + 3, + 2, + 11, + 8, + 24, + 8, + 7, + 10, + 5, + 6, + 0, + 5, + 6, + 9, + 6, + 8, + 10, + 2, + 9, + 4, + 1, + 2, + 5, + 10, + 5, + 5, + 1, + 6, + 9, + 10, + 23, + 4, + 13, + 1, + 9, + 2, + 0, + 7 + ], + "weighted_loads": [ + 0.5339285396039486, + 0.0, + 0.4986852165311575, + 0.03692781180143356, + 0.18059485033154488, + 0.8409524634480476, + 0.17171225883066654, + 0.06463404186069965, + 0.672791576012969, + 0.5690113939344883, + 0.34943901002407074, + 0.19437658414244652, + 0.5918783582746983, + 0.687972079962492, + 0.3246021494269371, + 0.08882761374115944, + 0.027169333770871162, + 0.6171144023537636, + 0.04167895391583443, + 0.0, + 0.8649911694228649, + 1.1738243829458952, + 0.1247487124055624, + 0.33887211792171, + 0.24220073223114014, + 0.07427708059549332, + 0.09831046871840954, + 0.05683101899921894, + 0.5060847904533148, + 0.4055719319730997, + 1.0569956209510565, + 0.2606149557977915, + 0.271186750382185, + 0.6678966209292412, + 0.15218058973550797, + 0.471004381775856, + 0.0, + 0.18526559695601463, + 0.21091827750205994, + 0.39737497456371784, + 0.5155792981386185, + 0.27508192509412766, + 0.42977297864854336, + 0.05233665369451046, + 0.3724454715847969, + 0.18028015829622746, + 0.033705491572618484, + 0.08403271809220314, + 0.3932400643825531, + 0.7645766213536263, + 0.3596087545156479, + 0.4169011376798153, + 0.02921200729906559, + 0.4784785322844982, + 0.3920736350119114, + 0.5663889832794666, + 1.5024321153759956, + 0.15757481008768082, + 0.7894777227193117, + 0.02794964239001274, + 0.36214120127260685, + 0.07762689143419266, + 0.0, + 0.3240180090069771 + ], + "unique_experts": 60, + "load_cv": 0.809358057889879, + "normalized_load_entropy": 0.9225692183036655, + "max_load_share": 0.05630630630630631 + }, + "full_input": { + "tokens": 115, + "top_k": 6, + "decisions": 690, + "ordered_route_sha256": "383e380e0ef8abe05846f73cce29a3318c80f4552a89aa48b603f45738786fb9", + "route_weight_sha256": "5a565780eea4e43370d84b43cfc6fa3c9e163d038f8e4700a18a3882c6610ca8", + "loads": [ + 13, + 0, + 15, + 2, + 7, + 24, + 5, + 3, + 16, + 15, + 10, + 6, + 14, + 14, + 10, + 2, + 1, + 13, + 2, + 2, + 20, + 25, + 14, + 9, + 19, + 3, + 3, + 2, + 31, + 14, + 25, + 12, + 7, + 16, + 10, + 8, + 7, + 7, + 7, + 9, + 8, + 16, + 15, + 5, + 11, + 5, + 1, + 10, + 5, + 11, + 10, + 19, + 7, + 10, + 12, + 12, + 23, + 5, + 26, + 2, + 15, + 21, + 7, + 12 + ], + "weighted_loads": [ + 0.5339285396039486, + 0.0, + 0.4986852165311575, + 0.146589457988739, + 0.2802106738090515, + 1.2649451647885144, + 0.17171225883066654, + 0.10212052054703236, + 1.3091728910803795, + 0.6992444023489952, + 0.6854285453446209, + 0.2596840653568506, + 0.6528510213829577, + 0.687972079962492, + 0.4385246578603983, + 0.08882761374115944, + 0.027169333770871162, + 0.6171144023537636, + 0.07473873719573021, + 0.05725189857184887, + 1.0826258026063442, + 1.1738243829458952, + 0.7777742948383093, + 0.364341638982296, + 0.6762498181778938, + 0.10164876095950603, + 0.09831046871840954, + 0.05683101899921894, + 1.5028737727552652, + 0.8007245883345604, + 1.0828589461743832, + 0.4363388065248728, + 0.271186750382185, + 0.9742777589708567, + 0.3139711138792336, + 0.5674788504838943, + 0.5194124169647694, + 1.0929023660719395, + 0.2593810334801674, + 0.39737497456371784, + 0.6701084785163403, + 0.7571680769324303, + 0.5680000400170684, + 0.41047517769038677, + 0.47058582678437233, + 0.2363084051758051, + 0.033705491572618484, + 0.608059762394987, + 0.3932400643825531, + 0.8169806338846684, + 0.5605570413172245, + 1.4454908184707165, + 0.2028497476130724, + 0.7680559903383255, + 0.5985425338149071, + 0.6638062708079815, + 1.5024321153759956, + 0.2007945515215397, + 1.3108753115520813, + 0.06213125213980675, + 0.5762606840580702, + 2.0853192480280995, + 0.35268108488526195, + 2.3970380164682865 + ], + "unique_experts": 63, + "load_cv": 0.6528820631996295, + "normalized_load_entropy": 0.9466349343241967, + "max_load_share": 0.04492753623188406 + } + }, + "s0_bos": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "beeb31007cc3f120f7aca3d1f49ee19b0aa194cb7309f22c403751711873a8e1", + "route_weight_sha256": "1576236f5638a7270fe35c9d194e5db565fe9a86b02c98fa328fc77335c7ca1d", + "loads": [ + 13, + 0, + 12, + 1, + 5, + 15, + 3, + 2, + 6, + 11, + 3, + 5, + 10, + 14, + 7, + 2, + 1, + 12, + 1, + 0, + 15, + 29, + 4, + 6, + 8, + 3, + 3, + 2, + 11, + 6, + 24, + 12, + 9, + 9, + 3, + 5, + 0, + 3, + 8, + 9, + 6, + 12, + 7, + 2, + 8, + 5, + 1, + 1, + 4, + 10, + 4, + 8, + 1, + 5, + 8, + 11, + 23, + 4, + 14, + 1, + 9, + 2, + 0, + 6 + ], + "weighted_loads": [ + 0.5219483282417059, + 0.0, + 0.3768112678080797, + 0.032252416014671326, + 0.20569819957017899, + 0.9006713889539242, + 0.11327488720417023, + 0.05909774452447891, + 0.6771014146506786, + 0.5126861985772848, + 0.3876652643084526, + 0.23283251374959946, + 0.5185882020741701, + 0.7017450630664825, + 0.329418059438467, + 0.08610157668590546, + 0.02445811592042446, + 0.6079355888068676, + 0.04214169457554817, + 0.0, + 0.8644118029624224, + 1.289083955809474, + 0.1214348878711462, + 0.28529366850852966, + 0.27829791232943535, + 0.10654611326754093, + 0.09044945985078812, + 0.06660354323685169, + 0.5029445886611938, + 0.3677338883280754, + 1.1013987883925438, + 0.38835959509015083, + 0.34158704802393913, + 0.6589895822107792, + 0.08872652240097523, + 0.43915123492479324, + 0.0, + 0.1103690080344677, + 0.27478300780057907, + 0.4117665495723486, + 0.4973362609744072, + 0.4066229574382305, + 0.30047276616096497, + 0.05445041321218014, + 0.3454984128475189, + 0.2067696489393711, + 0.03572333976626396, + 0.04340749606490135, + 0.37154946848750114, + 0.7783602066338062, + 0.32796649634838104, + 0.5323302503675222, + 0.026025308296084404, + 0.45958057045936584, + 0.3823978304862976, + 0.6236589550971985, + 1.5449234005063772, + 0.16953884065151215, + 0.8383920416235924, + 0.029235953465104103, + 0.37733495235443115, + 0.07838780805468559, + 0.0, + 0.2858258746564388 + ], + "unique_experts": 60, + "load_cv": 0.84660721163821, + "normalized_load_entropy": 0.9180236944660297, + "max_load_share": 0.06531531531531531 + }, + "full_input": { + "tokens": 99, + "top_k": 6, + "decisions": 594, + "ordered_route_sha256": "52163f7b32b5729f9c88446b58a289f3924b5fca819a636d47617a49e3229a9d", + "route_weight_sha256": "415b5b4074ec0305249aff02a8087309fdb7472543c91a80d586230b7c67cb05", + "loads": [ + 13, + 0, + 15, + 1, + 6, + 21, + 4, + 3, + 14, + 11, + 12, + 5, + 11, + 14, + 10, + 2, + 1, + 12, + 1, + 0, + 16, + 29, + 10, + 6, + 19, + 3, + 4, + 2, + 19, + 13, + 25, + 16, + 9, + 12, + 9, + 5, + 1, + 5, + 8, + 9, + 7, + 14, + 12, + 3, + 8, + 7, + 2, + 5, + 4, + 11, + 11, + 14, + 4, + 8, + 8, + 11, + 23, + 4, + 21, + 2, + 12, + 18, + 1, + 8 + ], + "weighted_loads": [ + 0.5219483282417059, + 0.0, + 0.4705689400434494, + 0.032252416014671326, + 0.23907333239912987, + 1.188337875995785, + 0.20486846566200256, + 0.11433031409978867, + 1.0959565229713917, + 0.5126861985772848, + 0.7678724764846265, + 0.23283251374959946, + 0.5213431173469871, + 0.7017450630664825, + 0.4359194189310074, + 0.08610157668590546, + 0.02445811592042446, + 0.6079355888068676, + 0.04214169457554817, + 0.0, + 0.8982821460813284, + 1.289083955809474, + 0.5881506782025099, + 0.28529366850852966, + 0.6834244143683463, + 0.10654611326754093, + 0.4668731167912483, + 0.06660354323685169, + 0.8228193372488022, + 0.7677347380667925, + 1.1418421864509583, + 0.5233491249382496, + 0.34158704802393913, + 0.8173615150153637, + 0.2499232804402709, + 0.43915123492479324, + 0.09632903337478638, + 0.9999443013221025, + 0.27478300780057907, + 0.4117665495723486, + 0.5319716073572636, + 0.5299384444952011, + 0.5097053528297693, + 0.20827237330377102, + 0.3454984128475189, + 0.3198011517524719, + 0.09804733470082283, + 0.3799328883178532, + 0.37154946848750114, + 0.8314587399363518, + 0.6283518932759762, + 0.9696367140859365, + 0.11116662248969078, + 0.5977340936660767, + 0.3823978304862976, + 0.6236589550971985, + 1.5449234005063772, + 0.16953884065151215, + 1.0964074991643429, + 0.06596586667001247, + 0.5073231346905231, + 1.4728592061437666, + 0.0017162092262879014, + 1.3017685636878014 + ], + "unique_experts": 62, + "load_cv": 0.706902336855897, + "normalized_load_entropy": 0.936835890937716, + "max_load_share": 0.04882154882154882 + } + }, + "s1_bos": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "1cc90c76ea2f244aa7208163d3abc7ba8bdb77060fc2235be304d90da79a88d7", + "route_weight_sha256": "ccefd7c8b722c54df83ac00087fca57da6615eaa8774884932d8fa3036def43b", + "loads": [ + 13, + 0, + 15, + 2, + 5, + 12, + 3, + 2, + 6, + 11, + 3, + 3, + 11, + 14, + 6, + 1, + 0, + 13, + 1, + 1, + 16, + 27, + 4, + 7, + 8, + 2, + 3, + 2, + 12, + 6, + 24, + 12, + 8, + 10, + 4, + 5, + 0, + 5, + 8, + 9, + 6, + 12, + 9, + 2, + 8, + 4, + 1, + 1, + 5, + 10, + 4, + 6, + 2, + 5, + 8, + 11, + 22, + 3, + 13, + 2, + 8, + 2, + 0, + 6 + ], + "weighted_loads": [ + 0.5385566223412752, + 0.0, + 0.47208568826317787, + 0.06783591210842133, + 0.20631831139326096, + 0.7693143673241138, + 0.11545886844396591, + 0.05502867139875889, + 0.6680381447076797, + 0.5244581680744886, + 0.39732381515204906, + 0.1628137044608593, + 0.5863665416836739, + 0.7009187042713165, + 0.28545549884438515, + 0.05484562739729881, + 0.0, + 0.6268045622855425, + 0.04207281395792961, + 0.021604768931865692, + 0.9015506468713284, + 1.217228202149272, + 0.1241995207965374, + 0.31043129600584507, + 0.2787049226462841, + 0.07914546877145767, + 0.09050401672720909, + 0.05655915103852749, + 0.5276195928454399, + 0.36143189668655396, + 1.0698885284364223, + 0.4037308096885681, + 0.3075127359479666, + 0.6701422706246376, + 0.12071973644196987, + 0.4315156973898411, + 0.0, + 0.18829774856567383, + 0.27605014480650425, + 0.40941111743450165, + 0.5162505209445953, + 0.39608574099838734, + 0.36725708097219467, + 0.05267001502215862, + 0.3449651263654232, + 0.17155122384428978, + 0.03452811762690544, + 0.04553203284740448, + 0.39863133057951927, + 0.7734398245811462, + 0.30967380106449127, + 0.4549180939793587, + 0.04905460216104984, + 0.44626547396183014, + 0.3616983890533447, + 0.619736822322011, + 1.5244502108544111, + 0.13727858662605286, + 0.8169771656394005, + 0.05211738310754299, + 0.34060700237751007, + 0.07835015654563904, + 0.0, + 0.2875727005302906 + ], + "unique_experts": 60, + "load_cv": 0.8283880535762502, + "normalized_load_entropy": 0.9203074999574125, + "max_load_share": 0.060810810810810814 + }, + "full_input": { + "tokens": 115, + "top_k": 6, + "decisions": 690, + "ordered_route_sha256": "e3b1226ff71626fd19d2905e623e01ab51b98416e99badaac8099cfcca574b8f", + "route_weight_sha256": "6a673f72f8f8ea3ef0f7dcdd03a6ca7d739bb47fd628d07dc07fe46a1b6ee76b", + "loads": [ + 13, + 0, + 16, + 3, + 8, + 22, + 3, + 3, + 15, + 14, + 10, + 5, + 14, + 14, + 9, + 1, + 0, + 13, + 2, + 4, + 21, + 27, + 16, + 8, + 19, + 3, + 3, + 2, + 32, + 12, + 24, + 17, + 8, + 16, + 10, + 7, + 7, + 7, + 9, + 9, + 8, + 22, + 15, + 6, + 9, + 6, + 1, + 8, + 5, + 11, + 10, + 20, + 8, + 9, + 11, + 13, + 22, + 3, + 25, + 2, + 13, + 22, + 6, + 9 + ], + "weighted_loads": [ + 0.5385566223412752, + 0.0, + 0.49461473152041435, + 0.17749755829572678, + 0.30268993601202965, + 1.1693889913149178, + 0.11545886844396591, + 0.09251515008509159, + 1.3174466527998447, + 0.6546911764889956, + 0.7427874426357448, + 0.2281211856752634, + 0.6473392047919333, + 0.7009187042713165, + 0.39635890536010265, + 0.05484562739729881, + 0.0, + 0.6268045622855425, + 0.0751325972378254, + 0.10800050012767315, + 1.1191852800548077, + 1.217228202149272, + 0.9575258791446686, + 0.33590081706643105, + 0.669821297051385, + 0.10651714913547039, + 0.09050401672720909, + 0.05655915103852749, + 1.5325771030038595, + 0.7619310449808836, + 1.0698885284364223, + 0.6198652759194374, + 0.3075127359479666, + 0.9765234086662531, + 0.31857126438990235, + 0.5279901660978794, + 0.5194124169647694, + 1.0959345176815987, + 0.31711521930992603, + 0.40941111743450165, + 0.6696185655891895, + 0.942292295396328, + 0.6458400087431073, + 0.45082238130271435, + 0.3847839683294296, + 0.2691395469009876, + 0.03452811762690544, + 0.5851760772056878, + 0.39863133057951927, + 0.8253348506987095, + 0.6122130788862705, + 1.4224328100681305, + 0.22269234247505665, + 0.7358429320156574, + 0.5681672878563404, + 0.7171541098505259, + 1.5244502108544111, + 0.13727858662605286, + 1.3376066070050001, + 0.05211738310754299, + 0.5215508677065372, + 2.17201588395983, + 0.35139264131430537, + 1.3471793159842491 + ], + "unique_experts": 62, + "load_cv": 0.6729570904126443, + "normalized_load_entropy": 0.943105888704595, + "max_load_share": 0.0463768115942029 + } + }, + "s0_x": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "4a07e53faff07bfa1dce0a722405d77064e623f55ee0dbf65534e333be5cb8cf", + "route_weight_sha256": "8f15183a37066138377d4db2fbc45bd7d39fcbb8637d10a74c3bc47e109c3327", + "loads": [ + 12, + 0, + 14, + 1, + 6, + 14, + 3, + 2, + 7, + 11, + 4, + 5, + 11, + 14, + 7, + 2, + 0, + 10, + 1, + 1, + 14, + 27, + 4, + 7, + 8, + 2, + 2, + 2, + 12, + 6, + 23, + 12, + 8, + 10, + 4, + 5, + 1, + 4, + 8, + 9, + 6, + 9, + 7, + 2, + 9, + 5, + 1, + 3, + 4, + 10, + 4, + 7, + 1, + 5, + 8, + 10, + 24, + 3, + 14, + 2, + 9, + 2, + 0, + 6 + ], + "weighted_loads": [ + 0.47195560671389103, + 0.0, + 0.44888579472899437, + 0.03201700747013092, + 0.2293461561203003, + 0.8480199873447418, + 0.11413993686437607, + 0.07502556964755058, + 0.7099730428308249, + 0.5131125506013632, + 0.47697930596768856, + 0.2372939344495535, + 0.5735550634562969, + 0.7022256962954998, + 0.3245736099779606, + 0.08709647879004478, + 0.0, + 0.517001461237669, + 0.04255254566669464, + 0.020855041220784187, + 0.858200915157795, + 1.2237755190581083, + 0.1201624795794487, + 0.3022535350173712, + 0.28835812769830227, + 0.07822282984852791, + 0.06260920874774456, + 0.06040756031870842, + 0.5253459960222244, + 0.3587376456707716, + 1.0634168144315481, + 0.38885635882616043, + 0.2863485813140869, + 0.6718030031770468, + 0.1174940001219511, + 0.4358183927834034, + 0.021029280498623848, + 0.14213234372437, + 0.264649223536253, + 0.4125286377966404, + 0.5133597031235695, + 0.3052529562264681, + 0.29406844452023506, + 0.053765349090099335, + 0.3761419653892517, + 0.19185595586895943, + 0.03253282606601715, + 0.1158115491271019, + 0.3618380203843117, + 0.7774215564131737, + 0.3139583133161068, + 0.519955225288868, + 0.02599666640162468, + 0.45926565676927567, + 0.3859305717051029, + 0.5860715042799711, + 1.5556000974029303, + 0.13133997097611427, + 0.8385368958115578, + 0.05554806813597679, + 0.39297058433294296, + 0.07303455099463463, + 0.0, + 0.2945551574230194 + ], + "unique_experts": 61, + "load_cv": 0.8133593580559759, + "normalized_load_entropy": 0.9243928289690018, + "max_load_share": 0.060810810810810814 + }, + "full_input": { + "tokens": 99, + "top_k": 6, + "decisions": 594, + "ordered_route_sha256": "bc938dadc8dde5b0e45190d98fc925f2b7608c21cec7ff23a2446732d13b6fc3", + "route_weight_sha256": "497c88af34ccf3fae88df0d7d1723fdce42b4706c210a5f30f30e8a44d208d4a", + "loads": [ + 12, + 0, + 16, + 1, + 6, + 21, + 3, + 3, + 16, + 11, + 14, + 5, + 13, + 14, + 10, + 2, + 0, + 10, + 1, + 1, + 16, + 27, + 11, + 7, + 18, + 2, + 2, + 2, + 21, + 13, + 23, + 14, + 8, + 13, + 12, + 6, + 4, + 5, + 9, + 9, + 6, + 12, + 10, + 3, + 9, + 7, + 1, + 8, + 4, + 11, + 8, + 13, + 4, + 9, + 8, + 10, + 24, + 3, + 22, + 2, + 12, + 17, + 1, + 9 + ], + "weighted_loads": [ + 0.47195560671389103, + 0.0, + 0.5164152700453997, + 0.03201700747013092, + 0.2293461561203003, + 1.1557067059911788, + 0.11413993686437607, + 0.13025813922286034, + 1.1878048609942198, + 0.5131125506013632, + 0.8866622033528984, + 0.2372939344495535, + 0.6103521918412298, + 0.7022256962954998, + 0.4289924055337906, + 0.08709647879004478, + 0.0, + 0.517001461237669, + 0.04255254566669464, + 0.020855041220784187, + 0.929998379200697, + 1.2237755190581083, + 0.5460717100650072, + 0.3022535350173712, + 0.6533934168983251, + 0.07822282984852791, + 0.06260920874774456, + 0.06040756031870842, + 0.8947099037468433, + 0.7417478486895561, + 1.0634168144315481, + 0.4639996103942394, + 0.2863485813140869, + 0.8301749359816313, + 0.37438666727393866, + 0.47399870678782463, + 0.19794204272329807, + 1.0051733870059252, + 0.30134017392992973, + 0.4125286377966404, + 0.5133597031235695, + 0.46069868467748165, + 0.37976664979942143, + 0.15267812460660934, + 0.3761419653892517, + 0.2799605466425419, + 0.03253282606601715, + 0.5316148665733635, + 0.3618380203843117, + 0.8522367253899574, + 0.45934170857071877, + 0.9787214361131191, + 0.11113798059523106, + 0.6458549909293652, + 0.3859305717051029, + 0.5860715042799711, + 1.5556000974029303, + 0.13133997097611427, + 1.1274203080683947, + 0.05554806813597679, + 0.5103258192539215, + 1.3659923472441733, + 0.0017162092262879014, + 1.345057152211666 + ], + "unique_experts": 62, + "load_cv": 0.699421507690035, + "normalized_load_entropy": 0.9370219234673289, + "max_load_share": 0.045454545454545456 + } + }, + "s1_x": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "736419bdff09b3a59051b64da5bb22f5a89bfd7b76a7c24ab21ba102e19bbad2", + "route_weight_sha256": "3adb075ff2fd8d2d936824543b3f73baea2afc529a585d2fb4a4f7ba5b09abcf", + "loads": [ + 15, + 0, + 13, + 1, + 6, + 12, + 3, + 3, + 5, + 12, + 3, + 3, + 12, + 14, + 5, + 2, + 1, + 11, + 1, + 0, + 19, + 27, + 3, + 8, + 7, + 2, + 1, + 1, + 12, + 6, + 25, + 13, + 10, + 11, + 2, + 7, + 1, + 4, + 8, + 9, + 6, + 8, + 7, + 0, + 8, + 3, + 1, + 2, + 4, + 10, + 6, + 7, + 1, + 5, + 8, + 10, + 24, + 4, + 14, + 1, + 9, + 3, + 0, + 5 + ], + "weighted_loads": [ + 0.5916172284632921, + 0.0, + 0.4068578276783228, + 0.03235238790512085, + 0.230873703956604, + 0.7685218974947929, + 0.11344702914357185, + 0.09427151270210743, + 0.6425230596214533, + 0.5525915250182152, + 0.41171084344387054, + 0.16105538979172707, + 0.5854068081825972, + 0.709744531661272, + 0.24876848608255386, + 0.07850183732807636, + 0.04393408074975014, + 0.5510262381285429, + 0.04477753862738609, + 0.0, + 1.0314138941466808, + 1.2305366825312376, + 0.1089599821716547, + 0.33023827336728573, + 0.24523871764540672, + 0.07134229317307472, + 0.032077185809612274, + 0.0275742094963789, + 0.5268099065870047, + 0.3602256756275892, + 1.1252446677535772, + 0.4334594886749983, + 0.37440041452646255, + 0.6878276634961367, + 0.05890079773962498, + 0.5127264801412821, + 0.020601918920874596, + 0.161957535892725, + 0.268112663179636, + 0.40915812365710735, + 0.5299728512763977, + 0.24926086142659187, + 0.3070668503642082, + 0.0, + 0.3281935006380081, + 0.13702112063765526, + 0.0307158250361681, + 0.0752115286886692, + 0.37928199768066406, + 0.7759715057909489, + 0.37212640047073364, + 0.494192436337471, + 0.025461990386247635, + 0.445405799895525, + 0.3567117489874363, + 0.6021709758788347, + 1.549856536090374, + 0.164128590375185, + 0.833195224404335, + 0.027076851576566696, + 0.3774625528603792, + 0.1133432686328888, + 0.0, + 0.23511218279600143 + ], + "unique_experts": 60, + "load_cv": 0.8719212884313046, + "normalized_load_entropy": 0.9124631472956042, + "max_load_share": 0.060810810810810814 + }, + "full_input": { + "tokens": 115, + "top_k": 6, + "decisions": 690, + "ordered_route_sha256": "a337309c76aca4b9731385a1ec3d1aa01aa54dc573e180950bd766bec4ad049e", + "route_weight_sha256": "f9ec4c10bb30219dad97dad20b3f9d43e0a203d7faafd95b4db0ca8744652e8b", + "loads": [ + 15, + 0, + 13, + 2, + 8, + 23, + 3, + 4, + 16, + 15, + 10, + 5, + 15, + 14, + 7, + 2, + 1, + 11, + 2, + 2, + 24, + 27, + 15, + 9, + 17, + 3, + 1, + 1, + 34, + 12, + 25, + 18, + 10, + 18, + 8, + 10, + 11, + 7, + 8, + 9, + 8, + 16, + 11, + 3, + 9, + 4, + 1, + 9, + 4, + 11, + 10, + 21, + 7, + 11, + 11, + 12, + 24, + 4, + 27, + 1, + 14, + 23, + 6, + 8 + ], + "weighted_loads": [ + 0.5916172284632921, + 0.0, + 0.4068578276783228, + 0.1420140340924263, + 0.2904900722205639, + 1.1891272072680295, + 0.11344702914357185, + 0.13175799138844013, + 1.3729006666690111, + 0.6828245334327221, + 0.73549879854545, + 0.22636287100613117, + 0.6463794712908566, + 0.709744531661272, + 0.3121227752417326, + 0.07850183732807636, + 0.04393408074975014, + 0.5510262381285429, + 0.07783732190728188, + 0.05725189857184887, + 1.2490485273301601, + 1.2305366825312376, + 0.9039561673998833, + 0.3557077944278717, + 0.6017087635118514, + 0.09871397353708744, + 0.032077185809612274, + 0.0275742094963789, + 1.6102583520114422, + 0.7245921306312084, + 1.1252446677535772, + 0.6586958542466164, + 0.37440041452646255, + 1.033589020371437, + 0.25553892413154244, + 0.6541435364633799, + 0.7272706497460604, + 1.1024803705513477, + 0.268112663179636, + 0.40915812365710735, + 0.6799283847212791, + 0.7216965705156326, + 0.4189975028857589, + 0.2530996538698673, + 0.36801234260201454, + 0.1930493675172329, + 0.0307158250361681, + 0.6029939320869744, + 0.37928199768066406, + 0.8446613661944866, + 0.5364226996898651, + 1.5294271111488342, + 0.19909973070025444, + 0.8004027754068375, + 0.563180647790432, + 0.6995882634073496, + 1.549856536090374, + 0.164128590375185, + 1.399913651868701, + 0.027076851576566696, + 0.5649579372256994, + 2.111206096597016, + 0.35139264131430537, + 1.29471879824996 + ], + "unique_experts": 63, + "load_cv": 0.7089490077940542, + "normalized_load_entropy": 0.9377665888907079, + "max_load_share": 0.04927536231884058 + } + }, + "s0_period": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "c1c21cbc19d055259fd8e831cc6a80da987de8e870024cf370ba7103248e0d8f", + "route_weight_sha256": "aa40b8c6578010b872c3037a5358507898bd719b4b4920bedee648bbdf24e3a5", + "loads": [ + 10, + 0, + 12, + 1, + 6, + 13, + 3, + 4, + 5, + 12, + 4, + 6, + 12, + 14, + 7, + 2, + 1, + 11, + 1, + 0, + 15, + 27, + 4, + 7, + 8, + 3, + 3, + 2, + 12, + 6, + 19, + 12, + 8, + 10, + 5, + 5, + 1, + 5, + 9, + 9, + 6, + 9, + 7, + 3, + 10, + 4, + 2, + 2, + 4, + 10, + 4, + 7, + 2, + 5, + 8, + 10, + 24, + 3, + 12, + 1, + 9, + 2, + 0, + 6 + ], + "weighted_loads": [ + 0.4162081405520439, + 0.0, + 0.395459171384573, + 0.030961932614445686, + 0.24151445552706718, + 0.8158247284591198, + 0.11378951370716095, + 0.12968084029853344, + 0.6482217647135258, + 0.5584199018776417, + 0.4645758979022503, + 0.28560596331954, + 0.5810757763683796, + 0.7003699317574501, + 0.32733887806534767, + 0.08873550221323967, + 0.02615249715745449, + 0.5584519784897566, + 0.04189206659793854, + 0.0, + 0.8911938238888979, + 1.21537877433002, + 0.12298578582704067, + 0.30694304034113884, + 0.2829574588686228, + 0.10375143773853779, + 0.08683999627828598, + 0.06036873161792755, + 0.54322874173522, + 0.36223987117409706, + 0.9462198745459318, + 0.39450971595942974, + 0.29046183824539185, + 0.6693995594978333, + 0.150735754519701, + 0.44589506834745407, + 0.022002113983035088, + 0.1784033551812172, + 0.29478966630995274, + 0.4077240116894245, + 0.5180158615112305, + 0.3100166656076908, + 0.29780852049589157, + 0.08419106155633926, + 0.40209479443728924, + 0.17044187523424625, + 0.058037951588630676, + 0.08264223113656044, + 0.3556850627064705, + 0.7705933786928654, + 0.3074589744210243, + 0.5133807063102722, + 0.05299725756049156, + 0.4696722961962223, + 0.3845600225031376, + 0.586424145847559, + 1.5523325521498919, + 0.13113027811050415, + 0.7873369622975588, + 0.02977043204009533, + 0.3854534178972244, + 0.0763615146279335, + 0.0, + 0.28258679434657097 + ], + "unique_experts": 61, + "load_cv": 0.7745128407009667, + "normalized_load_entropy": 0.9306361523175883, + "max_load_share": 0.060810810810810814 + }, + "full_input": { + "tokens": 99, + "top_k": 6, + "decisions": 594, + "ordered_route_sha256": "0e6f6550aed608d0608cf3df59f2293be039b3ff26cbea17137cae4a5c36c555", + "route_weight_sha256": "5179c31cee0cbe8dcd21f14355e6f99381d950a2762ceabcc17f15c41771f568", + "loads": [ + 10, + 0, + 14, + 1, + 6, + 19, + 3, + 6, + 13, + 12, + 13, + 6, + 13, + 14, + 10, + 2, + 1, + 11, + 1, + 0, + 16, + 27, + 11, + 7, + 18, + 3, + 3, + 2, + 21, + 13, + 19, + 15, + 8, + 14, + 12, + 5, + 3, + 7, + 9, + 9, + 7, + 13, + 11, + 5, + 10, + 5, + 2, + 7, + 4, + 11, + 9, + 14, + 5, + 8, + 8, + 10, + 24, + 3, + 20, + 1, + 11, + 18, + 2, + 9 + ], + "weighted_loads": [ + 0.4162081405520439, + 0.0, + 0.4629886467009783, + 0.030961932614445686, + 0.24151445552706718, + 1.0934828170575202, + 0.11378951370716095, + 0.2248383592814207, + 1.0452227629721165, + 0.5584199018776417, + 0.8235169290564954, + 0.28560596331954, + 0.5838306916411966, + 0.7003699317574501, + 0.4300963096320629, + 0.08873550221323967, + 0.02615249715745449, + 0.5584519784897566, + 0.04189206659793854, + 0.0, + 0.9250641670078039, + 1.21537877433002, + 0.5772582720965147, + 0.30694304034113884, + 0.6479927480686456, + 0.10375143773853779, + 0.08683999627828598, + 0.06036873161792755, + 0.9024903550744057, + 0.753948537632823, + 0.9462198745459318, + 0.5011788234114647, + 0.29046183824539185, + 0.8625562340021133, + 0.3780424492433667, + 0.44589506834745407, + 0.16131486557424068, + 1.0727167427539825, + 0.29478966630995274, + 0.4077240116894245, + 0.5537435114383698, + 0.5179215632379055, + 0.4181157269049436, + 0.23486722633242607, + 0.40209479443728924, + 0.2211758065968752, + 0.058037951588630676, + 0.483437926042825, + 0.3556850627064705, + 0.8374063260853291, + 0.5366910547018051, + 1.0596974939107895, + 0.13813857175409794, + 0.6078258194029331, + 0.3845600225031376, + 0.586424145847559, + 1.5523325521498919, + 0.13113027811050415, + 1.084281912073493, + 0.02977043204009533, + 0.46830492466688156, + 1.429967860225588, + 0.038371903472580016, + 1.3302941918373108 + ], + "unique_experts": 62, + "load_cv": 0.6607481390475269, + "normalized_load_entropy": 0.9432307464824896, + "max_load_share": 0.045454545454545456 + } + }, + "s1_period": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "d652701ba31ef9224ab755d9d01009b01d64e8795a92b566b94985a8a3bfe257", + "route_weight_sha256": "a142ba632d2fbfc194d81e68b03bed58961b6579052bf20ba4fce9d6d78062aa", + "loads": [ + 15, + 1, + 13, + 2, + 6, + 12, + 3, + 3, + 5, + 12, + 3, + 3, + 13, + 14, + 5, + 1, + 1, + 12, + 1, + 0, + 18, + 28, + 5, + 7, + 7, + 2, + 3, + 1, + 14, + 6, + 24, + 10, + 9, + 11, + 2, + 6, + 1, + 5, + 7, + 9, + 6, + 8, + 7, + 0, + 10, + 3, + 1, + 1, + 4, + 10, + 5, + 6, + 1, + 5, + 9, + 11, + 24, + 3, + 12, + 1, + 9, + 2, + 0, + 6 + ], + "weighted_loads": [ + 0.6079607401043177, + 0.03229176253080368, + 0.4064042214304209, + 0.056978924199938774, + 0.22802290320396423, + 0.7767675407230854, + 0.11703082919120789, + 0.0978668462485075, + 0.6485942602157593, + 0.5557019934058189, + 0.39393769577145576, + 0.15973961725831032, + 0.6229525003582239, + 0.7066657170653343, + 0.2474454566836357, + 0.04734911769628525, + 0.047397758811712265, + 0.5849644653499126, + 0.042912259697914124, + 0.0, + 0.9776784330606461, + 1.2630293816328049, + 0.16376622952520847, + 0.3012746833264828, + 0.23915154114365578, + 0.07558631151914597, + 0.09259407222270966, + 0.026287062093615532, + 0.5892163701355457, + 0.3603770546615124, + 1.0688077509403229, + 0.3214211277663708, + 0.33650295808911324, + 0.6951970141381025, + 0.05875985138118267, + 0.4768647104501724, + 0.018851719796657562, + 0.1901378445327282, + 0.24040399491786957, + 0.4104245640337467, + 0.5375237539410591, + 0.25667927227914333, + 0.30324577540159225, + 0.0, + 0.4109141584485769, + 0.1315415222197771, + 0.030332405120134354, + 0.03753255307674408, + 0.3688281215727329, + 0.7811062186956406, + 0.3394949082285166, + 0.4553920477628708, + 0.025033721700310707, + 0.4376130774617195, + 0.3987624514847994, + 0.6071886923164129, + 1.5373375304043293, + 0.12423378229141235, + 0.7681367006152868, + 0.027111800387501717, + 0.3761047497391701, + 0.07165267691016197, + 0.0, + 0.2877882309257984 + ], + "unique_experts": 61, + "load_cv": 0.8655684075378369, + "normalized_load_entropy": 0.9147859030065045, + "max_load_share": 0.06306306306306306 + }, + "full_input": { + "tokens": 115, + "top_k": 6, + "decisions": 690, + "ordered_route_sha256": "d4db43c82e817c938f74bcf03ff1870a67131effe86dd07e5fac2b094e3805fb", + "route_weight_sha256": "1b700b24735578a22258b40d5ad9f3d9eeba85f17b993e581ba6833e88bed665", + "loads": [ + 15, + 1, + 13, + 3, + 8, + 22, + 3, + 4, + 14, + 15, + 10, + 5, + 16, + 14, + 9, + 1, + 1, + 12, + 2, + 3, + 23, + 28, + 15, + 8, + 19, + 3, + 3, + 1, + 36, + 12, + 24, + 14, + 9, + 17, + 8, + 8, + 9, + 9, + 7, + 9, + 7, + 17, + 11, + 4, + 11, + 5, + 1, + 9, + 4, + 11, + 10, + 20, + 7, + 10, + 12, + 13, + 24, + 3, + 27, + 1, + 13, + 22, + 6, + 9 + ], + "weighted_loads": [ + 0.6079607401043177, + 0.03229176253080368, + 0.4064042214304209, + 0.16664057038724422, + 0.2876392714679241, + 1.1498976876027882, + 0.11703082919120789, + 0.1353533249348402, + 1.2963594757020473, + 0.6859350018203259, + 0.7133070691488683, + 0.22504709847271442, + 0.6839251634664834, + 0.7066657170653343, + 0.37663443572819233, + 0.04734911769628525, + 0.047397758811712265, + 0.5849644653499126, + 0.0759720429778099, + 0.08710782788693905, + 1.1953130662441254, + 1.2630293816328049, + 0.928808705881238, + 0.32674420438706875, + 0.6706309143919498, + 0.10295799188315868, + 0.09259407222270966, + 0.026287062093615532, + 1.6771691888570786, + 0.7178223971277475, + 1.0688077509403229, + 0.5301128290593624, + 0.33650295808911324, + 1.001578152179718, + 0.25861732894554734, + 0.5733391791582108, + 0.5913320668041706, + 1.163838904350996, + 0.24040399491786957, + 0.4104245640337467, + 0.6504975035786629, + 0.7716912683099508, + 0.40743577387183905, + 0.31434978172183037, + 0.45073300041258335, + 0.22948205657303333, + 0.030332405120134354, + 0.6297489744611084, + 0.3688281215727329, + 0.8462352603673935, + 0.5797717031091452, + 1.5015796795487404, + 0.1986714620143175, + 0.7723321206867695, + 0.6052313502877951, + 0.7046059798449278, + 1.5373375304043293, + 0.12423378229141235, + 1.3851860295981169, + 0.027111800387501717, + 0.5124415941536427, + 2.0628362046554685, + 0.35139264131430537, + 1.347394846379757 + ], + "unique_experts": 64, + "load_cv": 0.7001725115239242, + "normalized_load_entropy": 0.9412118464921346, + "max_load_share": 0.05217391304347826 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 74, + "ordered_topk_exact_tokens": 35, + "set_exact_tokens": 48, + "mean_set_jaccard": 0.890926640926641, + "mean_token_weighted_tv": 0.017375085288910446, + "aggregate_load_tv": 0.047297297297297286 + }, + "system_bos": { + "tokens": 74, + "ordered_topk_exact_tokens": 30, + "set_exact_tokens": 40, + "mean_set_jaccard": 0.8577863577863578, + "mean_token_weighted_tv": 0.022381880773684464, + "aggregate_load_tv": 0.042792792792792786 + }, + "system_x": { + "tokens": 74, + "ordered_topk_exact_tokens": 20, + "set_exact_tokens": 30, + "mean_set_jaccard": 0.7931145431145432, + "mean_token_weighted_tv": 0.03319703002233763, + "aggregate_load_tv": 0.05855855855855856 + }, + "system_period": { + "tokens": 74, + "ordered_topk_exact_tokens": 27, + "set_exact_tokens": 41, + "mean_set_jaccard": 0.8471685971685972, + "mean_token_weighted_tv": 0.02648476040544542, + "aggregate_load_tv": 0.06306306306306306 + }, + "bos_at_s0": { + "tokens": 74, + "ordered_topk_exact_tokens": 26, + "set_exact_tokens": 32, + "mean_set_jaccard": 0.8320463320463322, + "mean_token_weighted_tv": 0.0260168854524759, + "aggregate_load_tv": 0.060810810810810814 + }, + "bos_at_s1": { + "tokens": 74, + "ordered_topk_exact_tokens": 20, + "set_exact_tokens": 34, + "mean_set_jaccard": 0.8223938223938224, + "mean_token_weighted_tv": 0.027166768480595703, + "aggregate_load_tv": 0.05405405405405406 + }, + "x_at_s0": { + "tokens": 74, + "ordered_topk_exact_tokens": 22, + "set_exact_tokens": 36, + "mean_set_jaccard": 0.838803088803089, + "mean_token_weighted_tv": 0.02664321000259873, + "aggregate_load_tv": 0.0563063063063063 + }, + "x_at_s1": { + "tokens": 74, + "ordered_topk_exact_tokens": 13, + "set_exact_tokens": 26, + "mean_set_jaccard": 0.7725225225225226, + "mean_token_weighted_tv": 0.03620684438863316, + "aggregate_load_tv": 0.07657657657657657 + }, + "period_at_s0": { + "tokens": 74, + "ordered_topk_exact_tokens": 14, + "set_exact_tokens": 31, + "mean_set_jaccard": 0.8137065637065638, + "mean_token_weighted_tv": 0.02974694363168768, + "aggregate_load_tv": 0.07432432432432431 + }, + "period_at_s1": { + "tokens": 74, + "ordered_topk_exact_tokens": 15, + "set_exact_tokens": 28, + "mean_set_jaccard": 0.7847490347490347, + "mean_token_weighted_tv": 0.03350673279901211, + "aggregate_load_tv": 0.0698198198198198 + } + } + }, + "layer_25": { + "layer": 25, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "074e81844e985ea3489703f7f692d67b131ebfee0b466ff03deb2ba7aea272f7", + "route_weight_sha256": "ba9534cdf1653e52776ee2088070d04565ba32fec25dfdf0f9242865553f1b55", + "loads": [ + 8, + 8, + 8, + 9, + 9, + 11, + 9, + 9, + 8, + 3, + 3, + 12, + 6, + 2, + 6, + 4, + 15, + 5, + 8, + 5, + 6, + 8, + 2, + 2, + 7, + 12, + 2, + 17, + 1, + 7, + 0, + 6, + 6, + 4, + 2, + 20, + 8, + 6, + 5, + 7, + 3, + 2, + 6, + 1, + 2, + 7, + 8, + 18, + 4, + 4, + 13, + 17, + 4, + 3, + 5, + 6, + 12, + 3, + 13, + 9, + 4, + 9, + 10, + 5 + ], + "weighted_loads": [ + 0.5495887268334627, + 0.6762294620275497, + 0.28469204157590866, + 0.5470802783966064, + 0.4441189765930176, + 0.8827876877039671, + 0.7137645911425352, + 0.6984713934361935, + 0.23567906953394413, + 0.10015052929520607, + 0.11393046379089355, + 0.5534508805721998, + 0.2678684238344431, + 0.07408640533685684, + 0.2712469194084406, + 0.1360777486115694, + 0.8350181020796299, + 0.21329503878951073, + 0.3247085940092802, + 0.29016210697591305, + 0.2913253381848335, + 0.23036567494273186, + 0.10002798959612846, + 0.05914387106895447, + 0.2743557542562485, + 0.7432422079145908, + 0.05502738989889622, + 0.7227403894066811, + 0.033110808581113815, + 0.20762125588953495, + 0.0, + 0.5994421988725662, + 0.28448574244976044, + 0.1168305054306984, + 0.06301966309547424, + 1.4839475564658642, + 0.9329909179359674, + 0.19242931716144085, + 0.5124169941991568, + 1.770616002380848, + 0.09051189199090004, + 0.09796464070677757, + 0.26829519495368004, + 0.032014887779951096, + 0.07701526209712029, + 0.5239703394472599, + 0.24543128535151482, + 1.5751389153301716, + 0.1455165632069111, + 0.15382598154246807, + 0.640538526698947, + 1.064170191064477, + 0.732250303030014, + 0.10028936341404915, + 0.2697859462350607, + 0.3278818931430578, + 0.5024563074111938, + 0.08954658918082714, + 0.6065207608044147, + 0.27350979670882225, + 0.12299516797065735, + 0.8416198827326298, + 0.881203792989254, + 0.33934216387569904 + ], + "unique_experts": 63, + "load_cv": 0.6282451665445457, + "normalized_load_entropy": 0.9532359226480744, + "max_load_share": 0.04504504504504504 + }, + "full_input": { + "tokens": 99, + "top_k": 6, + "decisions": 594, + "ordered_route_sha256": "1b78e801f5b9255ae200db1dacb79c2dd2087b78d76fb6cb17f46008d76cfe38", + "route_weight_sha256": "fd6c2950617e904925fac0bb7f871b915f1a44ba9d5c76d8ae093315e146a9b3", + "loads": [ + 11, + 26, + 12, + 10, + 9, + 11, + 15, + 11, + 9, + 3, + 12, + 17, + 8, + 2, + 6, + 4, + 15, + 9, + 9, + 5, + 6, + 8, + 2, + 6, + 7, + 12, + 2, + 17, + 2, + 8, + 0, + 7, + 8, + 5, + 3, + 20, + 8, + 8, + 17, + 9, + 9, + 2, + 6, + 2, + 8, + 17, + 11, + 18, + 4, + 4, + 24, + 17, + 12, + 3, + 13, + 6, + 14, + 5, + 13, + 10, + 8, + 10, + 14, + 5 + ], + "weighted_loads": [ + 0.8216319214552641, + 2.121909148292616, + 0.5370727702975273, + 0.6064073666930199, + 0.4441189765930176, + 0.8827876877039671, + 1.1240188982337713, + 0.7563592493534088, + 0.2836835812777281, + 0.10015052929520607, + 1.0661386288702488, + 1.2929657911881804, + 0.4773361515253782, + 0.07408640533685684, + 0.2712469194084406, + 0.1360777486115694, + 0.8350181020796299, + 0.34551065415143967, + 0.35108461789786816, + 0.29016210697591305, + 0.2913253381848335, + 0.23036567494273186, + 0.10002798959612846, + 0.28526727110147476, + 0.2743557542562485, + 0.7432422079145908, + 0.05502738989889622, + 0.7227403894066811, + 0.07399433478713036, + 0.24333150126039982, + 0.0, + 0.6853112354874611, + 0.3894607312977314, + 0.17752378433942795, + 0.10339340940117836, + 1.4839475564658642, + 0.9329909179359674, + 0.2806046437472105, + 2.009400211274624, + 1.969553966075182, + 0.35030953772366047, + 0.09796464070677757, + 0.26829519495368004, + 0.0652887299656868, + 0.610676933079958, + 1.380365015938878, + 0.33603889460209757, + 1.5751389153301716, + 0.1455165632069111, + 0.15382598154246807, + 1.2876149956136942, + 1.064170191064477, + 1.1415806906297803, + 0.10028936341404915, + 0.660395817598328, + 0.3278818931430578, + 0.5934956967830658, + 0.16113569773733616, + 0.6065207608044147, + 0.40601782128214836, + 0.313551414757967, + 0.8814280368387699, + 1.254827618598938, + 0.33934216387569904 + ], + "unique_experts": 63, + "load_cv": 0.5905900507592955, + "normalized_load_entropy": 0.9571878032450375, + "max_load_share": 0.04377104377104377 + } + }, + "s1_eos": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "5cf878bf6a563a6d322357c52f3fe858dd394b03d423e8884ca5eb1e25af2956", + "route_weight_sha256": "4b90c00b882214a09e6bef1b263b9fb274bf57cccc6c626fb89bac22e31870a6", + "loads": [ + 8, + 8, + 6, + 10, + 9, + 11, + 9, + 8, + 8, + 1, + 3, + 14, + 5, + 3, + 5, + 4, + 15, + 5, + 7, + 5, + 6, + 7, + 3, + 2, + 7, + 12, + 2, + 17, + 3, + 5, + 0, + 7, + 5, + 2, + 4, + 20, + 8, + 3, + 5, + 7, + 2, + 2, + 8, + 2, + 3, + 7, + 8, + 20, + 4, + 5, + 12, + 17, + 4, + 3, + 5, + 6, + 12, + 3, + 13, + 9, + 5, + 9, + 12, + 4 + ], + "weighted_loads": [ + 0.5289838258177042, + 0.692425936460495, + 0.22635960020124912, + 0.5444945804774761, + 0.4357107821851969, + 0.8939406275749207, + 0.7218625042587519, + 0.6684411615133286, + 0.2395339421927929, + 0.040781911462545395, + 0.1194659098982811, + 0.617551002651453, + 0.23267232067883015, + 0.11475741490721703, + 0.24300609901547432, + 0.1385753396898508, + 0.8121222592890263, + 0.21759702265262604, + 0.27397169545292854, + 0.27665372379124165, + 0.2997858040034771, + 0.2103696260601282, + 0.1275244690477848, + 0.05972771532833576, + 0.2505783885717392, + 0.7429461199790239, + 0.05401729792356491, + 0.7335585430264473, + 0.0894548948854208, + 0.15002073533833027, + 0.0, + 0.6141324583441019, + 0.251890130341053, + 0.06532571092247963, + 0.11008046939969063, + 1.4660044685006142, + 0.9326107632368803, + 0.10781028494238853, + 0.504101175814867, + 1.7907084226608276, + 0.061456842347979546, + 0.09561701864004135, + 0.3191673830151558, + 0.06523235887289047, + 0.1025872528553009, + 0.5209397226572037, + 0.2472455557435751, + 1.6536942720413208, + 0.1433272808790207, + 0.18955558352172375, + 0.6338878646492958, + 1.082262571901083, + 0.7170509397983551, + 0.10123041272163391, + 0.2496815174818039, + 0.33553893864154816, + 0.5020070504397154, + 0.09245643764734268, + 0.5968434680253267, + 0.27811465226113796, + 0.16131328605115414, + 0.8485646024346352, + 0.9290121179074049, + 0.31920536421239376 + ], + "unique_experts": 63, + "load_cv": 0.6460784916845765, + "normalized_load_entropy": 0.9522580610890291, + "max_load_share": 0.04504504504504504 + }, + "full_input": { + "tokens": 115, + "top_k": 6, + "decisions": 690, + "ordered_route_sha256": "421bf6e72e2169271718163b30ac23e7fcf1fefd7c98c6eaba5d148eda80d0e5", + "route_weight_sha256": "f04669bd0b7ade3dc7b2b35851b3d61b591e5107505fc9d815c73f5c40e8eadd", + "loads": [ + 12, + 32, + 13, + 11, + 9, + 12, + 18, + 10, + 11, + 2, + 26, + 20, + 10, + 3, + 5, + 4, + 15, + 13, + 8, + 6, + 9, + 14, + 3, + 9, + 7, + 12, + 3, + 17, + 4, + 8, + 0, + 10, + 11, + 3, + 6, + 20, + 9, + 10, + 16, + 11, + 8, + 2, + 9, + 3, + 13, + 21, + 10, + 20, + 4, + 5, + 24, + 17, + 12, + 9, + 16, + 7, + 15, + 8, + 13, + 11, + 9, + 11, + 17, + 4 + ], + "weighted_loads": [ + 0.9719966109842062, + 2.7130316377151757, + 0.5853081680834293, + 0.6150755546987057, + 0.4357107821851969, + 0.9318066537380219, + 1.3783832360059023, + 0.7236443962901831, + 0.4018837511539459, + 0.06938412226736546, + 2.1799542885273695, + 1.4368434818461537, + 0.5613384265452623, + 0.11475741490721703, + 0.24300609901547432, + 0.1385753396898508, + 0.8121222592890263, + 0.8695332184433937, + 0.32510431855916977, + 0.3005099631845951, + 0.5570666901767254, + 0.8580728098750114, + 0.1275244690477848, + 0.4082644935697317, + 0.2505783885717392, + 0.7429461199790239, + 0.0874374769628048, + 0.7335585430264473, + 0.13703923486173153, + 0.25578918866813183, + 0.0, + 1.0870552901178598, + 0.5486572962254286, + 0.11519663035869598, + 0.20697841048240662, + 1.4660044685006142, + 0.9748701546341181, + 0.4197186715900898, + 2.2332714200019836, + 2.1732110381126404, + 0.3435856979340315, + 0.09561701864004135, + 0.4040115773677826, + 0.09525983408093452, + 0.922661766409874, + 1.8519414141774178, + 0.29024607641622424, + 1.6536942720413208, + 0.1433272808790207, + 0.18955558352172375, + 1.3957422748208046, + 1.082262571901083, + 1.2216499629430473, + 0.5746759697794914, + 0.9920955782290548, + 0.3619870152324438, + 0.6338935513049364, + 0.2645644471049309, + 0.5968434680253267, + 0.4998616259545088, + 0.4279299508780241, + 0.9346331469714642, + 1.3539801836013794, + 0.31920536421239376 + ], + "unique_experts": 63, + "load_cv": 0.5756305730290523, + "normalized_load_entropy": 0.959719073734651, + "max_load_share": 0.0463768115942029 + } + }, + "s0_bos": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "76e0417061113743c871068017168e2501390821222534c5d00a878e6460c7e0", + "route_weight_sha256": "f2b76def25a1b77a068b691d98394a13f9eea52c6b62ddb8780a6a724a62ed15", + "loads": [ + 9, + 8, + 6, + 10, + 9, + 11, + 8, + 9, + 7, + 1, + 2, + 14, + 6, + 1, + 5, + 5, + 15, + 6, + 7, + 7, + 5, + 7, + 3, + 0, + 8, + 11, + 2, + 17, + 1, + 8, + 0, + 6, + 6, + 3, + 2, + 20, + 8, + 4, + 4, + 7, + 5, + 2, + 7, + 3, + 2, + 7, + 7, + 19, + 5, + 5, + 13, + 17, + 4, + 4, + 4, + 6, + 11, + 1, + 16, + 10, + 3, + 9, + 10, + 6 + ], + "weighted_loads": [ + 0.575858149677515, + 0.6694154143333435, + 0.22871246002614498, + 0.538963757455349, + 0.457429489120841, + 0.8828162811696529, + 0.657300278544426, + 0.6904073264449835, + 0.21445830911397934, + 0.04105507582426071, + 0.07028979063034058, + 0.626891378313303, + 0.2629581540822983, + 0.042355190962553024, + 0.24908500909805298, + 0.15472556464374065, + 0.8268631789833307, + 0.23294368758797646, + 0.2906924616545439, + 0.38023303635418415, + 0.2511572726070881, + 0.22885527834296227, + 0.12899425998330116, + 0.0, + 0.2968205362558365, + 0.7355028595775366, + 0.05558785796165466, + 0.7366445157676935, + 0.03336789458990097, + 0.24703615345060825, + 0.0, + 0.6257447935640812, + 0.28473396599292755, + 0.09351184591650963, + 0.06672807782888412, + 1.4909637197852135, + 0.8979951795190573, + 0.12775777094066143, + 0.48585088551044464, + 1.7940894439816475, + 0.15311184339225292, + 0.09136962890625, + 0.2899894881993532, + 0.08982216194272041, + 0.0756943877786398, + 0.5254607424139977, + 0.2102698367089033, + 1.661776840686798, + 0.17467004619538784, + 0.17921183444559574, + 0.6428145673125982, + 1.1001679114997387, + 0.6901983469724655, + 0.14278142526745796, + 0.2062820941209793, + 0.33859504014253616, + 0.4973340090364218, + 0.03350042179226875, + 0.7044899445027113, + 0.2923485729843378, + 0.0938256736844778, + 0.8511020429432392, + 0.8626854885369539, + 0.37480461969971657 + ], + "unique_experts": 62, + "load_cv": 0.66098135814505, + "normalized_load_entropy": 0.9467686183898754, + "max_load_share": 0.04504504504504504 + }, + "full_input": { + "tokens": 99, + "top_k": 6, + "decisions": 594, + "ordered_route_sha256": "1276445971e60b2ac49e7b659ce7ad84d6bfd8afad30e605c2e0e71d1ac8de97", + "route_weight_sha256": "f12240a20bd4083dc830c4c76641f0aac25c0e9d3e427ff834de5ad7e4aaf32d", + "loads": [ + 11, + 26, + 11, + 11, + 9, + 11, + 14, + 12, + 8, + 1, + 12, + 17, + 9, + 1, + 5, + 5, + 15, + 10, + 8, + 7, + 5, + 7, + 3, + 5, + 8, + 11, + 2, + 17, + 2, + 8, + 1, + 7, + 8, + 4, + 3, + 20, + 8, + 5, + 15, + 8, + 11, + 3, + 7, + 5, + 8, + 16, + 9, + 19, + 5, + 6, + 24, + 17, + 11, + 4, + 13, + 6, + 12, + 4, + 16, + 11, + 6, + 10, + 14, + 7 + ], + "weighted_loads": [ + 0.7912965193390846, + 2.08678003330715, + 0.5895296912640333, + 0.6986455246806145, + 0.457429489120841, + 0.8828162811696529, + 1.067554585635662, + 0.7955328430980444, + 0.268787894397974, + 0.04105507582426071, + 1.1456302292644978, + 1.343880694359541, + 0.5043031089007854, + 0.042355190962553024, + 0.24908500909805298, + 0.15472556464374065, + 0.8268631789833307, + 0.3651593029499054, + 0.31706848554313183, + 0.38023303635418415, + 0.2511572726070881, + 0.22885527834296227, + 0.12899425998330116, + 0.2702513989061117, + 0.2968205362558365, + 0.7355028595775366, + 0.05558785796165466, + 0.7366445157676935, + 0.07425142079591751, + 0.24703615345060825, + 0.16812792420387268, + 0.7116138301789761, + 0.41649025306105614, + 0.15420512482523918, + 0.13807972520589828, + 1.4909637197852135, + 0.8979951795190573, + 0.17794394679367542, + 1.0761344749480486, + 1.9483832493424416, + 0.41290948912501335, + 0.14715220034122467, + 0.2899894881993532, + 0.1598927453160286, + 0.6106223966926336, + 1.3376489840447903, + 0.2995706479996443, + 1.661776840686798, + 0.17467004619538784, + 0.22291689179837704, + 1.2907068636268377, + 1.1001679114997387, + 1.1051522456109524, + 0.14278142526745796, + 0.6527541091199964, + 0.33859504014253616, + 0.5555089320987463, + 0.1496250182390213, + 0.7044899445027113, + 0.42135983146727085, + 0.23534956760704517, + 0.8918015025556087, + 1.236309314146638, + 0.4071141518652439 + ], + "unique_experts": 64, + "load_cv": 0.5806787539615114, + "normalized_load_entropy": 0.9595097645827034, + "max_load_share": 0.04377104377104377 + } + }, + "s1_bos": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "fe13717144e2181166441c8d8807b7d9ee6d6919c11a1a8300d192181c2093a9", + "route_weight_sha256": "c8c2155ce703e7ac15d4a2e26731fa8219b537a3d5f93c079713ee9efa87c625", + "loads": [ + 9, + 8, + 6, + 9, + 10, + 11, + 8, + 9, + 6, + 1, + 2, + 12, + 6, + 2, + 5, + 5, + 16, + 4, + 6, + 5, + 5, + 12, + 3, + 1, + 7, + 12, + 2, + 17, + 2, + 7, + 0, + 6, + 6, + 5, + 1, + 20, + 8, + 3, + 4, + 7, + 4, + 2, + 8, + 3, + 2, + 7, + 10, + 19, + 5, + 4, + 12, + 17, + 4, + 4, + 4, + 7, + 11, + 2, + 13, + 8, + 4, + 9, + 11, + 6 + ], + "weighted_loads": [ + 0.5645878780633211, + 0.6897947080433369, + 0.24290429428219795, + 0.5045780055224895, + 0.49064119532704353, + 0.8685986120253801, + 0.649296373128891, + 0.6808996368199587, + 0.18811829574406147, + 0.04213250055909157, + 0.07114161550998688, + 0.5600295607000589, + 0.27129859663546085, + 0.07557958737015724, + 0.24558992683887482, + 0.15859238617122173, + 0.8682779166847467, + 0.17191411927342415, + 0.2417757734656334, + 0.2849715147167444, + 0.26811961457133293, + 0.38600678369402885, + 0.13058926351368427, + 0.02930745854973793, + 0.24695776216685772, + 0.7547518368810415, + 0.060842135921120644, + 0.7323003597557545, + 0.06549801677465439, + 0.21558234468102455, + 0.0, + 0.6104323081672192, + 0.29410678893327713, + 0.1504865288734436, + 0.03589619696140289, + 1.4900181740522385, + 0.9449980929493904, + 0.10703979432582855, + 0.48518717661499977, + 1.7604410946369171, + 0.1310538351535797, + 0.09145815670490265, + 0.31753584556281567, + 0.0971419271081686, + 0.07376090809702873, + 0.5167958587408066, + 0.2856267336755991, + 1.5990932006388903, + 0.16780702583491802, + 0.16878637485206127, + 0.6214954219758511, + 1.127792350947857, + 0.6663170605897903, + 0.14246595092117786, + 0.20046027936041355, + 0.34842396154999733, + 0.487071730196476, + 0.07135342061519623, + 0.614392064511776, + 0.2439555786550045, + 0.1215379610657692, + 0.843714639544487, + 0.8737828265875578, + 0.37235286831855774 + ], + "unique_experts": 63, + "load_cv": 0.6495864092201931, + "normalized_load_entropy": 0.950055686566514, + "max_load_share": 0.04504504504504504 + }, + "full_input": { + "tokens": 115, + "top_k": 6, + "decisions": 690, + "ordered_route_sha256": "d35621afab04522ea78fcbc654b9cb6383a527388832401b218dee5efd37fac2", + "route_weight_sha256": "f81636464e8e16fba1e61cd226afd59bd0754b49259cdda9a12e0420501dd26d", + "loads": [ + 13, + 33, + 14, + 9, + 10, + 12, + 17, + 10, + 11, + 2, + 26, + 17, + 13, + 2, + 5, + 5, + 16, + 12, + 7, + 6, + 8, + 19, + 3, + 8, + 7, + 12, + 3, + 17, + 3, + 9, + 0, + 9, + 13, + 6, + 4, + 20, + 9, + 9, + 14, + 10, + 10, + 2, + 9, + 4, + 12, + 21, + 11, + 19, + 5, + 5, + 24, + 17, + 11, + 10, + 15, + 8, + 14, + 7, + 13, + 10, + 7, + 11, + 16, + 6 + ], + "weighted_loads": [ + 0.987596532329917, + 2.6723586835432798, + 0.7149343173950911, + 0.5045780055224895, + 0.49064119532704353, + 0.9064646381884813, + 1.3058171048760414, + 0.719333665445447, + 0.42829333432018757, + 0.07073471136391163, + 2.2291967030614614, + 1.3593873381614685, + 0.7331686206161976, + 0.07557958737015724, + 0.24558992683887482, + 0.15859238617122173, + 0.8682779166847467, + 0.8238503150641918, + 0.2929083965718746, + 0.3088277541100979, + 0.5254005007445812, + 1.033709967508912, + 0.13058926351368427, + 0.3879777602851391, + 0.24695776216685772, + 0.7547518368810415, + 0.09426231496036053, + 0.7323003597557545, + 0.11308235675096512, + 0.2866986393928528, + 0.0, + 1.083355139940977, + 0.6444227639585733, + 0.20035744830965996, + 0.1798325479030609, + 1.4900181740522385, + 0.9872574843466282, + 0.37058020755648613, + 1.3188844583928585, + 2.0919392593204975, + 0.41318269073963165, + 0.09145815670490265, + 0.40238003991544247, + 0.12716940231621265, + 0.8926373608410358, + 1.8121889792382717, + 0.3272986840456724, + 1.5990932006388903, + 0.16780702583491802, + 0.21284089423716068, + 1.383373249322176, + 1.127792350947857, + 1.1734844222664833, + 0.6159115079790354, + 0.9428743401076645, + 0.374872038140893, + 0.6404243521392345, + 0.2638667896389961, + 0.614392064511776, + 0.47480127587914467, + 0.3239646479487419, + 0.9288809299468994, + 1.2987508922815323, + 0.37235286831855774 + ], + "unique_experts": 63, + "load_cv": 0.5721169376798525, + "normalized_load_entropy": 0.9605537029625442, + "max_load_share": 0.04782608695652174 + } + }, + "s0_x": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "7a8833c302dc55a3155924d942951ad7ec61ff1cda56250cbe0b8e45417e4d6d", + "route_weight_sha256": "60f6cecf2963902755ba8e6014c113cc15b4f8ac988c5439dae16a617b8b3eb4", + "loads": [ + 9, + 8, + 7, + 10, + 9, + 11, + 8, + 9, + 6, + 1, + 2, + 13, + 6, + 1, + 5, + 5, + 15, + 5, + 9, + 6, + 5, + 5, + 3, + 0, + 8, + 12, + 2, + 17, + 1, + 8, + 0, + 6, + 6, + 5, + 2, + 20, + 8, + 4, + 4, + 7, + 5, + 3, + 6, + 3, + 2, + 7, + 9, + 18, + 4, + 5, + 13, + 17, + 4, + 4, + 4, + 7, + 11, + 2, + 15, + 9, + 3, + 9, + 10, + 6 + ], + "weighted_loads": [ + 0.5770454481244087, + 0.6685199290513992, + 0.26564523205161095, + 0.4942236915230751, + 0.46165223605930805, + 0.8870653863996267, + 0.6523352339863777, + 0.6602862253785133, + 0.18143232353031635, + 0.040308885276317596, + 0.07292075082659721, + 0.6110593639314175, + 0.26687384583055973, + 0.032781992107629776, + 0.24099867418408394, + 0.14832737483084202, + 0.8234058246016502, + 0.21301144734025002, + 0.3262211140245199, + 0.3066816180944443, + 0.24571477994322777, + 0.1671452708542347, + 0.12467740289866924, + 0.0, + 0.3032548911869526, + 0.7532911524176598, + 0.06189773231744766, + 0.7228555604815483, + 0.03348095715045929, + 0.23333989456295967, + 0.0, + 0.6048590242862701, + 0.2757544666528702, + 0.15672112070024014, + 0.07099805027246475, + 1.4831932187080383, + 0.9143926929682493, + 0.13683881424367428, + 0.5395417623221874, + 1.7496652007102966, + 0.1733058374375105, + 0.1109724435955286, + 0.26665549352765083, + 0.09211861528456211, + 0.07481384091079235, + 0.5156002826988697, + 0.2625875063240528, + 1.640704732388258, + 0.14758533984422684, + 0.17808339931070805, + 0.6493614576756954, + 1.105692069977522, + 0.7356852889060974, + 0.13850852102041245, + 0.2046410869807005, + 0.35238663107156754, + 0.4682195205241442, + 0.07005511224269867, + 0.6623473428189754, + 0.2651955131441355, + 0.0935576967895031, + 0.8615817576646805, + 0.8679329566657543, + 0.38970600068569183 + ], + "unique_experts": 62, + "load_cv": 0.6460784916845765, + "normalized_load_entropy": 0.949132742617855, + "max_load_share": 0.04504504504504504 + }, + "full_input": { + "tokens": 99, + "top_k": 6, + "decisions": 594, + "ordered_route_sha256": "082f795b020bf395edc641957907b80ca848bc1d339db85cb28d08fce962be56", + "route_weight_sha256": "aee665dccf4dc2deecb80130c04d0f658ea12ed28fcca364b03bc40aeca1e257", + "loads": [ + 12, + 27, + 11, + 11, + 9, + 11, + 16, + 11, + 7, + 1, + 11, + 16, + 9, + 1, + 5, + 5, + 15, + 9, + 11, + 6, + 5, + 5, + 3, + 3, + 8, + 12, + 2, + 17, + 2, + 9, + 0, + 8, + 8, + 6, + 3, + 20, + 8, + 5, + 16, + 8, + 12, + 3, + 6, + 4, + 8, + 16, + 11, + 18, + 5, + 5, + 24, + 17, + 12, + 4, + 13, + 7, + 11, + 4, + 15, + 10, + 6, + 10, + 15, + 6 + ], + "weighted_loads": [ + 0.8392011225223541, + 2.1701793104875833, + 0.5206216834485531, + 0.5278078392148018, + 0.46165223605930805, + 0.8870653863996267, + 1.1858232654631138, + 0.7216864600777626, + 0.23521834053099155, + 0.040308885276317596, + 1.0249984562397003, + 1.3216687850654125, + 0.49312046356499195, + 0.032781992107629776, + 0.24099867418408394, + 0.14832737483084202, + 0.8234058246016502, + 0.34522706270217896, + 0.379784656688571, + 0.3066816180944443, + 0.24571477994322777, + 0.1671452708542347, + 0.12467740289866924, + 0.20199374109506607, + 0.3032548911869526, + 0.7532911524176598, + 0.06189773231744766, + 0.7228555604815483, + 0.07436448335647583, + 0.26485374569892883, + 0.0, + 0.7855812460184097, + 0.3911791890859604, + 0.2174143996089697, + 0.12416428327560425, + 1.4831932187080383, + 0.9143926929682493, + 0.1962075736373663, + 1.2380361948162317, + 1.9039590060710907, + 0.48274923488497734, + 0.1109724435955286, + 0.26665549352765083, + 0.1253924574702978, + 0.5820239763706923, + 1.3620087020099163, + 0.3518883176147938, + 1.640704732388258, + 0.1882987655699253, + 0.17808339931070805, + 1.295987844467163, + 1.105692069977522, + 1.2580729611217976, + 0.13850852102041245, + 0.6682208569254726, + 0.35238663107156754, + 0.4682195205241442, + 0.1335606947541237, + 0.6623473428189754, + 0.4333879742771387, + 0.2357637882232666, + 0.8963729999959469, + 1.2799900472164154, + 0.38970600068569183 + ], + "unique_experts": 63, + "load_cv": 0.5963969556874866, + "normalized_load_entropy": 0.9563116812095888, + "max_load_share": 0.045454545454545456 + } + }, + "s1_x": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "307acd1f72cd351d9e7616e45d8d51ae208b463378e1e5f487869d59782076a0", + "route_weight_sha256": "810e84995649af76c7ef3d38e73df2e4a9fb4f8ce0c7d45c01796a0ca0ea9fe4", + "loads": [ + 7, + 8, + 7, + 11, + 9, + 11, + 8, + 9, + 4, + 1, + 3, + 12, + 5, + 1, + 4, + 5, + 17, + 5, + 8, + 6, + 6, + 9, + 2, + 2, + 8, + 12, + 2, + 16, + 1, + 4, + 0, + 6, + 6, + 4, + 2, + 20, + 8, + 5, + 3, + 7, + 5, + 2, + 6, + 3, + 2, + 7, + 12, + 18, + 4, + 6, + 14, + 17, + 4, + 4, + 4, + 8, + 11, + 2, + 12, + 9, + 4, + 9, + 10, + 7 + ], + "weighted_loads": [ + 0.49208031222224236, + 0.6784420013427734, + 0.27541120164096355, + 0.5205689091235399, + 0.450913866981864, + 0.8819041065871716, + 0.6333930790424347, + 0.6513635311275721, + 0.12475674040615559, + 0.03600997477769852, + 0.13574877381324768, + 0.5740389972925186, + 0.2189306728541851, + 0.047196969389915466, + 0.20450787246227264, + 0.16358143463730812, + 0.9083589129149914, + 0.2167714312672615, + 0.2872582543641329, + 0.28827102668583393, + 0.30562572553753853, + 0.2649699840694666, + 0.09907582029700279, + 0.051483407616615295, + 0.2714291960000992, + 0.7656895220279694, + 0.07195065729320049, + 0.6943305190652609, + 0.035632651299238205, + 0.11952594667673111, + 0.0, + 0.5874434486031532, + 0.2836518958210945, + 0.1273930612951517, + 0.06922219693660736, + 1.4657247737050056, + 0.9264674205332994, + 0.16539177112281322, + 0.48649977520108223, + 1.6682265624403954, + 0.1617218591272831, + 0.08290538750588894, + 0.24905585870146751, + 0.10802576690912247, + 0.07299504242837429, + 0.4929317310452461, + 0.3542419262230396, + 1.5627985540777445, + 0.1440067533403635, + 0.22171181440353394, + 0.6896492652595043, + 1.1226418130099773, + 0.678851306438446, + 0.1503276787698269, + 0.19974355585873127, + 0.3637272119522095, + 0.46396439895033836, + 0.06046515330672264, + 0.5802838243544102, + 0.2698499523103237, + 0.13042687065899372, + 0.8622459657490253, + 0.8413232676684856, + 0.38977070339024067 + ], + "unique_experts": 63, + "load_cv": 0.6470826943371365, + "normalized_load_entropy": 0.9501548200391683, + "max_load_share": 0.04504504504504504 + }, + "full_input": { + "tokens": 115, + "top_k": 6, + "decisions": 690, + "ordered_route_sha256": "79b86ea3286adc59c89e2c7f0d125a9daf059528a5aaa704aa3f343a682182fb", + "route_weight_sha256": "21080f3cd1bb6db4a7521adf49754e73e8fadd044b9ddd85d2e644f536c90b8c", + "loads": [ + 10, + 33, + 14, + 11, + 9, + 12, + 19, + 11, + 6, + 2, + 26, + 16, + 11, + 1, + 4, + 5, + 17, + 14, + 9, + 7, + 9, + 16, + 2, + 10, + 8, + 12, + 4, + 16, + 2, + 6, + 0, + 10, + 12, + 5, + 4, + 20, + 9, + 11, + 14, + 10, + 11, + 2, + 7, + 4, + 13, + 20, + 14, + 18, + 4, + 6, + 28, + 17, + 13, + 10, + 16, + 9, + 12, + 7, + 12, + 11, + 6, + 11, + 15, + 7 + ], + "weighted_loads": [ + 0.8813899382948875, + 2.7208071791101247, + 0.6236136220395565, + 0.5205689091235399, + 0.450913866981864, + 0.9197701327502728, + 1.4833232387900352, + 0.7082248795777559, + 0.23635187558829784, + 0.06461218558251858, + 2.2124917935580015, + 1.3170658517628908, + 0.596362242475152, + 0.047196969389915466, + 0.20450787246227264, + 0.16358143463730812, + 0.9083589129149914, + 0.9157945141196251, + 0.3383908774703741, + 0.3121272660791874, + 0.5629066117107868, + 0.9126731678843498, + 0.09907582029700279, + 0.40199708938598633, + 0.2714291960000992, + 0.7656895220279694, + 0.15327244065701962, + 0.6943305190652609, + 0.08321699127554893, + 0.19064224138855934, + 0.0, + 1.172216735780239, + 0.5687077175825834, + 0.17726398073136806, + 0.17092358693480492, + 1.4657247737050056, + 0.9687268119305372, + 0.4394937064498663, + 1.393111139535904, + 1.9997247271239758, + 0.44385071471333504, + 0.08290538750588894, + 0.3339000530540943, + 0.13805324211716652, + 0.8768236935138702, + 1.8112399503588676, + 0.45775245875120163, + 1.5627985540777445, + 0.1440067533403635, + 0.22171181440353394, + 1.5981513895094395, + 1.1226418130099773, + 1.3610474467277527, + 0.6237732358276844, + 1.0213065349962562, + 0.3901752885431051, + 0.49293598532676697, + 0.22712614014744759, + 0.5802838243544102, + 0.4660703130066395, + 0.2713483665138483, + 0.9470991007983685, + 1.2662913333624601, + 0.38977070339024067 + ], + "unique_experts": 63, + "load_cv": 0.5874197492191907, + "normalized_load_entropy": 0.9579714373259133, + "max_load_share": 0.04782608695652174 + } + }, + "s0_period": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "89fed7efeda8632e48f3297763ae5e53673f7de06aed42e6d759a4aec4a8c49f", + "route_weight_sha256": "6d1f85745fe45d02ee4d7abeff9d74b0f1bcfc4b00ddbf8b583000d27e704245", + "loads": [ + 8, + 8, + 7, + 10, + 9, + 11, + 8, + 9, + 6, + 2, + 3, + 13, + 5, + 1, + 5, + 6, + 15, + 5, + 8, + 7, + 5, + 6, + 3, + 0, + 9, + 13, + 3, + 16, + 1, + 4, + 0, + 6, + 6, + 3, + 1, + 20, + 8, + 5, + 4, + 7, + 5, + 2, + 7, + 3, + 3, + 7, + 10, + 19, + 4, + 4, + 12, + 17, + 4, + 4, + 5, + 8, + 13, + 1, + 14, + 10, + 2, + 9, + 12, + 3 + ], + "weighted_loads": [ + 0.5391231197863817, + 0.6814207807183266, + 0.2572453636676073, + 0.5110580250620842, + 0.44978791289031506, + 0.8897166568785906, + 0.6456243805587292, + 0.6758722309023142, + 0.175602026283741, + 0.07004421390593052, + 0.11171780526638031, + 0.6156311128288507, + 0.23446308448910713, + 0.03050355240702629, + 0.24247082136571407, + 0.17901861108839512, + 0.8251147605478764, + 0.20434056967496872, + 0.2990160118788481, + 0.3488479107618332, + 0.25845062360167503, + 0.18590585887432098, + 0.12805502861738205, + 0.0, + 0.3256254158914089, + 0.7840532436966896, + 0.08607738837599754, + 0.6915426347404718, + 0.03318098187446594, + 0.1268917080014944, + 0.0, + 0.5927337966859341, + 0.28425743244588375, + 0.09776696376502514, + 0.03570117801427841, + 1.4697819612920284, + 0.9256308004260063, + 0.17505497112870216, + 0.5188703164458275, + 1.770086519420147, + 0.1596271600574255, + 0.08537363260984421, + 0.29005008563399315, + 0.09185203351080418, + 0.10033874586224556, + 0.5218170285224915, + 0.2895720563828945, + 1.6500547267496586, + 0.1475931592285633, + 0.15830283798277378, + 0.6349632292985916, + 1.1029659807682037, + 0.7274886220693588, + 0.1395468059927225, + 0.24209407903254032, + 0.3860656749457121, + 0.5320036839693785, + 0.03665316104888916, + 0.6410176008939743, + 0.29251760244369507, + 0.06418163515627384, + 0.8481405563652515, + 0.9121582712978125, + 0.3167826011776924 + ], + "unique_experts": 62, + "load_cv": 0.66098135814505, + "normalized_load_entropy": 0.9465597338603093, + "max_load_share": 0.04504504504504504 + }, + "full_input": { + "tokens": 99, + "top_k": 6, + "decisions": 594, + "ordered_route_sha256": "bdfbd48350501821622825705a243cd1be6cf0ad55d28acb412dda37422b77cd", + "route_weight_sha256": "aead70868cd14cda47f888937ed0713867dabdf3dd18628e5d041bf366a2718f", + "loads": [ + 11, + 27, + 11, + 10, + 9, + 11, + 14, + 11, + 7, + 2, + 13, + 16, + 9, + 2, + 5, + 7, + 15, + 9, + 9, + 7, + 5, + 6, + 3, + 3, + 9, + 13, + 3, + 16, + 2, + 5, + 0, + 7, + 8, + 4, + 3, + 20, + 8, + 6, + 15, + 8, + 11, + 2, + 7, + 5, + 9, + 17, + 12, + 19, + 4, + 4, + 23, + 17, + 12, + 4, + 14, + 8, + 13, + 3, + 14, + 11, + 6, + 10, + 16, + 4 + ], + "weighted_loads": [ + 0.8241700027137995, + 2.257455825107172, + 0.5149239432066679, + 0.5110580250620842, + 0.44978791289031506, + 0.8897166568785906, + 1.0558786876499653, + 0.7342955600470304, + 0.2310001738369465, + 0.07004421390593052, + 1.1340729966759682, + 1.328931512311101, + 0.49139109812676907, + 0.06714720278978348, + 0.24247082136571407, + 0.22032255493104458, + 0.8251147605478764, + 0.33655618503689766, + 0.325392035767436, + 0.3488479107618332, + 0.25845062360167503, + 0.18590585887432098, + 0.12805502861738205, + 0.1897997409105301, + 0.3256254158914089, + 0.7840532436966896, + 0.08607738837599754, + 0.6915426347404718, + 0.07406450808048248, + 0.15872706659138203, + 0.0, + 0.6786028333008289, + 0.4092059526592493, + 0.1584602426737547, + 0.13441254571080208, + 1.4697819612920284, + 0.9256308004260063, + 0.2527535669505596, + 1.0992839019745588, + 1.924380324780941, + 0.41942480579018593, + 0.08537363260984421, + 0.29005008563399315, + 0.15556428581476212, + 0.5977192856371403, + 1.4857508912682533, + 0.3788728676736355, + 1.6500547267496586, + 0.1475931592285633, + 0.15830283798277378, + 1.2857887372374535, + 1.1029659807682037, + 1.16432461515069, + 0.1395468059927225, + 0.6782066316809505, + 0.3860656749457121, + 0.5320036839693785, + 0.1022084392607212, + 0.6410176008939743, + 0.4237207621335983, + 0.23661956749856472, + 0.8894421681761742, + 1.2857820969074965, + 0.4391377866268158 + ], + "unique_experts": 63, + "load_cv": 0.5942641713400342, + "normalized_load_entropy": 0.9568883641508145, + "max_load_share": 0.045454545454545456 + } + }, + "s1_period": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "a467cd331fd3802d44ec6b774a66ef56e060ac72fb51b0910d58f5f8cc675cbf", + "route_weight_sha256": "aca0e04e4762033d8b6e978dc9ecb8c0657eb77fe67cf0594a15ec174864e431", + "loads": [ + 8, + 8, + 8, + 10, + 9, + 11, + 8, + 10, + 5, + 2, + 3, + 12, + 5, + 3, + 5, + 4, + 18, + 5, + 8, + 4, + 6, + 7, + 2, + 2, + 7, + 12, + 1, + 15, + 1, + 4, + 0, + 6, + 6, + 5, + 2, + 20, + 9, + 5, + 4, + 7, + 4, + 2, + 6, + 2, + 3, + 7, + 11, + 19, + 4, + 6, + 14, + 17, + 4, + 4, + 4, + 7, + 12, + 3, + 11, + 9, + 3, + 9, + 10, + 6 + ], + "weighted_loads": [ + 0.5438840761780739, + 0.696652490645647, + 0.31335371173918247, + 0.49035511165857315, + 0.45944729447364807, + 0.8795414939522743, + 0.6360766235738993, + 0.6851324588060379, + 0.15867265313863754, + 0.07453904300928116, + 0.11134058982133865, + 0.5725792497396469, + 0.21520541608333588, + 0.104320352897048, + 0.22957092709839344, + 0.12466009706258774, + 0.9361421186476946, + 0.1981259025633335, + 0.2847365736961365, + 0.21635875292122364, + 0.30083825439214706, + 0.2120274007320404, + 0.09541914612054825, + 0.05136931128799915, + 0.260366003960371, + 0.7647284101694822, + 0.048702422529459, + 0.6670995093882084, + 0.03426538407802582, + 0.119282441213727, + 0.0, + 0.5718587003648281, + 0.29483430460095406, + 0.16228368505835533, + 0.07001973316073418, + 1.4796906262636185, + 0.9699626117944717, + 0.16823242604732513, + 0.5104447472840548, + 1.6556794196367264, + 0.12911765277385712, + 0.08049396425485611, + 0.2514945436269045, + 0.07543613389134407, + 0.1048832107335329, + 0.4886068031191826, + 0.32518433406949043, + 1.6039551682770252, + 0.14683246612548828, + 0.2337872926145792, + 0.6848057620227337, + 1.1420007608830929, + 0.6760146617889404, + 0.14884320460259914, + 0.19542305544018745, + 0.3202448058873415, + 0.4668542090803385, + 0.09219308756291866, + 0.5490186288952827, + 0.2688262388110161, + 0.09180817566812038, + 0.8580353073775768, + 0.8391902148723602, + 0.38000004924833775 + ], + "unique_experts": 63, + "load_cv": 0.6445692542912915, + "normalized_load_entropy": 0.9517178021175553, + "max_load_share": 0.04504504504504504 + }, + "full_input": { + "tokens": 115, + "top_k": 6, + "decisions": 690, + "ordered_route_sha256": "f3c540a55b426c6f672813a4073c0aa6a876d0445f6fbef1146bf8cfe89b26bd", + "route_weight_sha256": "fa26d4213f1baf718db5b1d9fdcc60007ac694742a902bde999e3fc5fe843baf", + "loads": [ + 12, + 33, + 14, + 11, + 9, + 12, + 17, + 11, + 7, + 3, + 26, + 16, + 12, + 3, + 5, + 5, + 18, + 13, + 9, + 5, + 9, + 14, + 2, + 8, + 7, + 12, + 3, + 15, + 2, + 6, + 0, + 9, + 12, + 6, + 5, + 20, + 10, + 12, + 14, + 10, + 11, + 2, + 7, + 3, + 15, + 21, + 12, + 19, + 5, + 6, + 26, + 17, + 12, + 10, + 16, + 8, + 14, + 8, + 11, + 11, + 6, + 11, + 15, + 7 + ], + "weighted_loads": [ + 1.0032927952706814, + 2.7772576056886464, + 0.6357335336506367, + 0.5404661893844604, + 0.45944729447364807, + 0.9174075201153755, + 1.2925973553210497, + 0.7198741994798183, + 0.2702677883207798, + 0.10314125381410122, + 2.2045023422688246, + 1.345584275200963, + 0.6229221895337105, + 0.104320352897048, + 0.22957092709839344, + 0.16683321073651314, + 0.9361421186476946, + 0.8500620983541012, + 0.3358691968023777, + 0.2402149923145771, + 0.5581191405653954, + 0.8597305845469236, + 0.09541914612054825, + 0.3020734954625368, + 0.260366003960371, + 0.7647284101694822, + 0.12948112934827805, + 0.6670995093882084, + 0.08184972405433655, + 0.19039873592555523, + 0.0, + 1.044781532138586, + 0.572777995839715, + 0.21215460449457169, + 0.21254439651966095, + 1.4796906262636185, + 1.0122220031917095, + 0.4997633006423712, + 1.3546973075717688, + 1.9871775843203068, + 0.4497683160007, + 0.08049396425485611, + 0.3363387379795313, + 0.10546360909938812, + 0.9263406991958618, + 1.86262197047472, + 0.36685628443956375, + 1.6039551682770252, + 0.18107784166932106, + 0.2337872926145792, + 1.450949177145958, + 1.1420007608830929, + 1.2493827305734158, + 0.6222887616604567, + 0.9975234006997198, + 0.34669288247823715, + 0.5512452851980925, + 0.26433884911239147, + 0.5490186288952827, + 0.4495644271373749, + 0.28167653270065784, + 0.9412487633526325, + 1.2641582805663347, + 0.6059275809675455 + ], + "unique_experts": 63, + "load_cv": 0.5742276988403833, + "normalized_load_entropy": 0.9602921892318864, + "max_load_share": 0.04782608695652174 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 74, + "ordered_topk_exact_tokens": 42, + "set_exact_tokens": 51, + "mean_set_jaccard": 0.9025096525096524, + "mean_token_weighted_tv": 0.015555183541633794, + "aggregate_load_tv": 0.04504504504504504 + }, + "system_bos": { + "tokens": 74, + "ordered_topk_exact_tokens": 39, + "set_exact_tokens": 45, + "mean_set_jaccard": 0.8851351351351351, + "mean_token_weighted_tv": 0.018845572765614535, + "aggregate_load_tv": 0.04729729729729729 + }, + "system_x": { + "tokens": 74, + "ordered_topk_exact_tokens": 24, + "set_exact_tokens": 33, + "mean_set_jaccard": 0.8330115830115831, + "mean_token_weighted_tv": 0.028717069156669283, + "aggregate_load_tv": 0.04504504504504504 + }, + "system_period": { + "tokens": 74, + "ordered_topk_exact_tokens": 25, + "set_exact_tokens": 32, + "mean_set_jaccard": 0.8130630630630631, + "mean_token_weighted_tv": 0.03066184527769282, + "aggregate_load_tv": 0.05855855855855856 + }, + "bos_at_s0": { + "tokens": 74, + "ordered_topk_exact_tokens": 31, + "set_exact_tokens": 40, + "mean_set_jaccard": 0.862934362934363, + "mean_token_weighted_tv": 0.0233612581835808, + "aggregate_load_tv": 0.05630630630630631 + }, + "bos_at_s1": { + "tokens": 74, + "ordered_topk_exact_tokens": 32, + "set_exact_tokens": 41, + "mean_set_jaccard": 0.8610038610038611, + "mean_token_weighted_tv": 0.02361784768416672, + "aggregate_load_tv": 0.06081081081081081 + }, + "x_at_s0": { + "tokens": 74, + "ordered_topk_exact_tokens": 28, + "set_exact_tokens": 39, + "mean_set_jaccard": 0.8532818532818534, + "mean_token_weighted_tv": 0.025785058132700017, + "aggregate_load_tv": 0.04954954954954956 + }, + "x_at_s1": { + "tokens": 74, + "ordered_topk_exact_tokens": 32, + "set_exact_tokens": 36, + "mean_set_jaccard": 0.8330115830115832, + "mean_token_weighted_tv": 0.030684296029141626, + "aggregate_load_tv": 0.07432432432432431 + }, + "period_at_s0": { + "tokens": 74, + "ordered_topk_exact_tokens": 28, + "set_exact_tokens": 36, + "mean_set_jaccard": 0.833011583011583, + "mean_token_weighted_tv": 0.028568103896907053, + "aggregate_load_tv": 0.06306306306306306 + }, + "period_at_s1": { + "tokens": 74, + "ordered_topk_exact_tokens": 28, + "set_exact_tokens": 34, + "mean_set_jaccard": 0.8252895752895754, + "mean_token_weighted_tv": 0.03089367734217966, + "aggregate_load_tv": 0.06306306306306306 + } + } + }, + "layer_26": { + "layer": 26, + "conditions": { + "s0_eos": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "bd836135c2c23a65cce1a0caa5137da394aa109c393f4fcaad0afa54ac37a175", + "route_weight_sha256": "2edff3a9c7b9f8f9fd110e4934d1556a7f17cc6fb56ca1f1a1f3d3f280db2794", + "loads": [ + 4, + 8, + 8, + 3, + 9, + 4, + 4, + 4, + 5, + 6, + 1, + 4, + 11, + 13, + 6, + 14, + 6, + 6, + 5, + 23, + 8, + 5, + 2, + 5, + 7, + 3, + 1, + 3, + 9, + 1, + 1, + 2, + 13, + 2, + 8, + 27, + 7, + 12, + 6, + 4, + 9, + 17, + 7, + 9, + 7, + 7, + 15, + 6, + 3, + 13, + 10, + 6, + 7, + 1, + 7, + 4, + 8, + 4, + 3, + 3, + 13, + 7, + 1, + 7 + ], + "weighted_loads": [ + 0.14582992903888226, + 0.7245500683784485, + 0.7337956614792347, + 0.1002453938126564, + 0.5568528473377228, + 0.1398518718779087, + 0.29638784378767014, + 0.16960690543055534, + 0.27932022511959076, + 0.28501773439347744, + 0.04980388656258583, + 0.41700074076652527, + 0.8829004280269146, + 0.4410643335431814, + 0.29061343148350716, + 0.972429633140564, + 0.2747053913772106, + 0.3572728782892227, + 0.1966946255415678, + 1.6070540472865105, + 0.6023728996515274, + 0.19925468415021896, + 0.09243663772940636, + 0.18407254293560982, + 0.5176244117319584, + 0.13208376802504063, + 0.03219970688223839, + 0.27321549132466316, + 0.5529027581214905, + 0.037118975073099136, + 0.03664426878094673, + 0.062472572550177574, + 0.7125108782202005, + 0.05549175478518009, + 0.6368524245917797, + 1.7622161712497473, + 0.4342104010283947, + 0.6384751070290804, + 0.30296756513416767, + 0.29446920193731785, + 0.4792945273220539, + 0.7305098529905081, + 0.32495363987982273, + 0.7338795736432076, + 0.2755767833441496, + 0.38524262979626656, + 0.5505958460271358, + 0.3022269383072853, + 0.174845140427351, + 1.4099375810474157, + 0.4417334087193012, + 0.29118431359529495, + 0.38584096170961857, + 0.049613967537879944, + 0.29693648777902126, + 0.20349213480949402, + 0.7765056975185871, + 0.42785388603806496, + 0.1503705009818077, + 0.1777673065662384, + 0.8042963929474354, + 0.4585314430296421, + 0.0648450255393982, + 1.0173197519034147 + ], + "unique_experts": 64, + "load_cv": 0.7129650271512282, + "normalized_load_entropy": 0.9458225017939522, + "max_load_share": 0.060810810810810814 + }, + "full_input": { + "tokens": 99, + "top_k": 6, + "decisions": 594, + "ordered_route_sha256": "38670d0c526c238cff18cf0049d5db6304d329d2aafbd7b47340059752592790", + "route_weight_sha256": "9478c4e653bb46eb4d5c7ff27cf4edf959315fa7aea2d6f88e3e54fd6181afe8", + "loads": [ + 4, + 8, + 8, + 3, + 9, + 4, + 4, + 6, + 5, + 11, + 5, + 10, + 11, + 14, + 22, + 16, + 6, + 18, + 5, + 23, + 9, + 7, + 3, + 5, + 13, + 4, + 6, + 11, + 9, + 1, + 7, + 2, + 17, + 3, + 10, + 27, + 13, + 12, + 7, + 4, + 9, + 17, + 7, + 12, + 8, + 7, + 19, + 6, + 4, + 14, + 18, + 6, + 13, + 1, + 8, + 4, + 21, + 12, + 9, + 4, + 14, + 7, + 2, + 10 + ], + "weighted_loads": [ + 0.14582992903888226, + 0.7245500683784485, + 0.7337956614792347, + 0.1002453938126564, + 0.5568528473377228, + 0.1398518718779087, + 0.29638784378767014, + 0.3066123351454735, + 0.27932022511959076, + 0.6641118172556162, + 0.3252768814563751, + 0.767722332617268, + 0.8829004280269146, + 0.5032334011048079, + 1.1230659144930542, + 1.0696522071957588, + 0.2747053913772106, + 0.962973814457655, + 0.1966946255415678, + 1.6070540472865105, + 0.7279243618249893, + 0.2582951970398426, + 0.13759901747107506, + 0.18407254293560982, + 0.8592255525290966, + 0.17316757328808308, + 0.9996389746665955, + 0.5941223111003637, + 0.5529027581214905, + 0.037118975073099136, + 0.6213023774325848, + 0.062472572550177574, + 0.8547980915755033, + 0.10032195039093494, + 0.7854600436985493, + 1.7622161712497473, + 0.7443550322204828, + 0.6384751070290804, + 0.3438888620585203, + 0.29446920193731785, + 0.4792945273220539, + 0.7305098529905081, + 0.32495363987982273, + 0.8829480446875095, + 0.3117326404899359, + 0.38524262979626656, + 0.7584163285791874, + 0.3022269383072853, + 0.21641775220632553, + 2.396206995472312, + 0.7915277481079102, + 0.29118431359529495, + 0.8915102705359459, + 0.049613967537879944, + 0.3441073801368475, + 0.20349213480949402, + 1.846619512885809, + 0.8462164727970958, + 0.39361531659960747, + 0.22614876553416252, + 0.8051078821881674, + 0.4585314430296421, + 0.10581503808498383, + 1.1364771034568548 + ], + "unique_experts": 64, + "load_cv": 0.6176134208995898, + "normalized_load_entropy": 0.9558985482802923, + "max_load_share": 0.045454545454545456 + } + }, + "s1_eos": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "f09ecf59938fbe66614af6a1425817a5e2aa8ed1f4f514b00814507965a1a928", + "route_weight_sha256": "58ed97d34e2749ec4ba0ef097de48e5f43e229a72e01a635358d3b836b556cee", + "loads": [ + 4, + 8, + 9, + 4, + 9, + 3, + 4, + 4, + 5, + 6, + 1, + 4, + 10, + 13, + 6, + 14, + 7, + 6, + 4, + 24, + 7, + 5, + 3, + 5, + 7, + 5, + 1, + 3, + 9, + 1, + 2, + 2, + 13, + 2, + 7, + 27, + 7, + 10, + 6, + 4, + 11, + 16, + 7, + 9, + 7, + 7, + 13, + 6, + 3, + 13, + 9, + 6, + 6, + 2, + 7, + 4, + 8, + 4, + 3, + 3, + 13, + 7, + 2, + 7 + ], + "weighted_loads": [ + 0.1490035280585289, + 0.7222936674952507, + 0.7930261455476284, + 0.12784850597381592, + 0.586103018373251, + 0.1085897795855999, + 0.28638024255633354, + 0.15972918458282948, + 0.2791885770857334, + 0.2909637652337551, + 0.047247812151908875, + 0.4185650497674942, + 0.8645811602473259, + 0.4521242994815111, + 0.296714486554265, + 0.9665462523698807, + 0.30684924498200417, + 0.34127075783908367, + 0.17567601427435875, + 1.6494134664535522, + 0.5786515809595585, + 0.2009564097970724, + 0.12247233465313911, + 0.18902255222201347, + 0.5146452151238918, + 0.1902334913611412, + 0.028928305953741074, + 0.27370578423142433, + 0.56509979814291, + 0.039146680384874344, + 0.07244158163666725, + 0.06315002404153347, + 0.6720977127552032, + 0.06394021585583687, + 0.6207429058849812, + 1.731377812102437, + 0.447481956332922, + 0.5949453972280025, + 0.30762336403131485, + 0.29014931432902813, + 0.5476793572306633, + 0.6970085576176643, + 0.322086401283741, + 0.7038395702838898, + 0.28752674348652363, + 0.36758603528141975, + 0.4931665938347578, + 0.30806853622198105, + 0.19487551599740982, + 1.3943781089037657, + 0.42631522193551064, + 0.28942734375596046, + 0.334984727203846, + 0.09117191657423973, + 0.2949236873537302, + 0.2026221603155136, + 0.7641087789088488, + 0.4204447343945503, + 0.1540796011686325, + 0.195712111890316, + 0.7974362410604954, + 0.47254983708262444, + 0.09241736121475697, + 0.9253944009542465 + ], + "unique_experts": 64, + "load_cv": 0.694979503311815, + "normalized_load_entropy": 0.95031023115189, + "max_load_share": 0.060810810810810814 + }, + "full_input": { + "tokens": 115, + "top_k": 6, + "decisions": 690, + "ordered_route_sha256": "d4382fc500c8372f9da7bc5455b1046c69ef58e7bf6862c10955516111d8e3ee", + "route_weight_sha256": "0e723cbc8091f705adf681e826601773c3d11a61336300bb05ededa81001ea3b", + "loads": [ + 4, + 8, + 9, + 4, + 12, + 3, + 4, + 6, + 5, + 14, + 8, + 12, + 10, + 14, + 22, + 19, + 7, + 13, + 5, + 24, + 8, + 10, + 11, + 5, + 16, + 7, + 12, + 14, + 9, + 3, + 11, + 3, + 19, + 4, + 12, + 27, + 18, + 15, + 10, + 5, + 12, + 16, + 8, + 13, + 7, + 8, + 17, + 7, + 4, + 16, + 16, + 6, + 18, + 4, + 10, + 6, + 26, + 13, + 13, + 11, + 16, + 7, + 5, + 9 + ], + "weighted_loads": [ + 0.1490035280585289, + 0.7222936674952507, + 0.7930261455476284, + 0.12784850597381592, + 0.7758282888680696, + 0.1085897795855999, + 0.28638024255633354, + 0.3462133873254061, + 0.2791885770857334, + 0.8588068559765816, + 0.7637744657695293, + 1.078469472238794, + 0.8645811602473259, + 0.508082328364253, + 1.2843668087152764, + 1.2726962007582188, + 0.30684924498200417, + 0.7325107243377715, + 0.2306634485721588, + 1.6494134664535522, + 0.6880518905818462, + 0.5196344684809446, + 0.6703447252511978, + 0.18902255222201347, + 0.9651451967656612, + 0.30050748586654663, + 1.5351314954459667, + 0.6989887431263924, + 0.56509979814291, + 0.11075205728411674, + 0.9460269026458263, + 0.1439847480505705, + 0.9108910169452429, + 0.15571396425366402, + 0.9262609109282494, + 1.731377812102437, + 1.0582191981375217, + 0.8914473950862885, + 0.6374639272689819, + 0.3252899441868067, + 0.5786060057580471, + 0.6970085576176643, + 0.3660796694457531, + 0.9023886322975159, + 0.28752674348652363, + 0.3850558903068304, + 0.7409820538014174, + 0.3492872193455696, + 0.2289755716919899, + 2.531087452545762, + 0.7173437960445881, + 0.28942734375596046, + 1.229444194585085, + 0.27629679068922997, + 0.5044321287423372, + 0.31942037492990494, + 2.4666429217904806, + 1.173099356237799, + 0.7215352915227413, + 0.5300227105617523, + 1.0392189127160236, + 0.47254983708262444, + 0.2153091710060835, + 1.0111275427043438 + ], + "unique_experts": 64, + "load_cv": 0.5314317074990442, + "normalized_load_entropy": 0.9670260919003573, + "max_load_share": 0.0391304347826087 + } + }, + "s0_bos": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "969ea44db9eaae8918fa250d3fb85a0f18aad217b05154ea6b241490f14c9552", + "route_weight_sha256": "7e12b1e836ae21f2f726e38e84d5855ee530240fc4a12a61bfc0b11ef60922ca", + "loads": [ + 4, + 9, + 9, + 3, + 11, + 4, + 4, + 5, + 5, + 5, + 1, + 4, + 10, + 12, + 2, + 15, + 7, + 6, + 4, + 23, + 8, + 6, + 2, + 5, + 7, + 5, + 1, + 3, + 9, + 1, + 1, + 2, + 14, + 3, + 7, + 26, + 7, + 11, + 6, + 3, + 11, + 17, + 6, + 9, + 6, + 7, + 14, + 6, + 2, + 13, + 9, + 6, + 7, + 2, + 7, + 4, + 7, + 4, + 2, + 4, + 13, + 9, + 2, + 7 + ], + "weighted_loads": [ + 0.1554621309041977, + 0.7864050790667534, + 0.78886329382658, + 0.10205674916505814, + 0.6256917975842953, + 0.1450793519616127, + 0.29985643178224564, + 0.2115163877606392, + 0.28023411706089973, + 0.2367558814585209, + 0.04374659061431885, + 0.4114098474383354, + 0.8791107144206762, + 0.41640472412109375, + 0.16698144376277924, + 1.0119618065655231, + 0.3178702723234892, + 0.3486995901912451, + 0.1682964488863945, + 1.584791749715805, + 0.636112755164504, + 0.22522610425949097, + 0.08636055514216423, + 0.18153699859976768, + 0.5260452851653099, + 0.2132625412195921, + 0.029874932020902634, + 0.26614596880972385, + 0.5740605071187019, + 0.03860146179795265, + 0.031852226704359055, + 0.06945699080824852, + 0.744135545566678, + 0.09260453842580318, + 0.5695332288742065, + 1.663349524140358, + 0.4358857050538063, + 0.6185295544564724, + 0.3059990517795086, + 0.2801935076713562, + 0.5483881421387196, + 0.7238787952810526, + 0.29846547544002533, + 0.6888552010059357, + 0.25381289795041084, + 0.374316805973649, + 0.5271223857998848, + 0.31081628799438477, + 0.15245626121759415, + 1.4268639795482159, + 0.40626085363328457, + 0.3040352277457714, + 0.4004053585231304, + 0.09162472188472748, + 0.28959085047245026, + 0.19773513823747635, + 0.7455835826694965, + 0.4151250869035721, + 0.10897444188594818, + 0.20250849425792694, + 0.8207132555544376, + 0.5210611615329981, + 0.08616616390645504, + 0.9665958192199469 + ], + "unique_experts": 64, + "load_cv": 0.7070206903867902, + "normalized_load_entropy": 0.9465030507967733, + "max_load_share": 0.05855855855855856 + }, + "full_input": { + "tokens": 99, + "top_k": 6, + "decisions": 594, + "ordered_route_sha256": "332412f977b794d6730ffc6f2abf608b3855eb01f9dca3f3130f6a4accc8003e", + "route_weight_sha256": "bf10c5ebc831a2787ece26e5a5097ccec94da72e2594ce76c63bda297151f550", + "loads": [ + 6, + 9, + 9, + 3, + 11, + 5, + 4, + 7, + 5, + 11, + 3, + 9, + 10, + 13, + 16, + 17, + 7, + 16, + 4, + 23, + 9, + 8, + 4, + 5, + 13, + 6, + 7, + 12, + 9, + 1, + 9, + 2, + 17, + 4, + 10, + 26, + 12, + 11, + 6, + 3, + 11, + 18, + 8, + 12, + 8, + 7, + 16, + 6, + 3, + 13, + 17, + 6, + 14, + 2, + 8, + 4, + 20, + 11, + 8, + 5, + 13, + 9, + 3, + 10 + ], + "weighted_loads": [ + 0.23754708096385002, + 0.7864050790667534, + 0.78886329382658, + 0.10205674916505814, + 0.6256917975842953, + 0.18696843460202217, + 0.29985643178224564, + 0.33990782871842384, + 0.28023411706089973, + 0.6613592021167278, + 0.19322528690099716, + 0.7729924954473972, + 0.8791107144206762, + 0.4785737916827202, + 0.9230024311691523, + 1.1259866692125797, + 0.3178702723234892, + 0.8594215046614408, + 0.1682964488863945, + 1.584791749715805, + 0.7442044746130705, + 0.2842666171491146, + 0.17102711275219917, + 0.18153699859976768, + 0.8688194267451763, + 0.25746374391019344, + 1.1609523445367813, + 0.6677020154893398, + 0.5740605071187019, + 0.03860146179795265, + 0.7691910341382027, + 0.06945699080824852, + 0.8538220692425966, + 0.16102022491395473, + 0.7904775962233543, + 1.663349524140358, + 0.7173694036900997, + 0.6185295544564724, + 0.3059990517795086, + 0.2801935076713562, + 0.5483881421387196, + 0.9586839620023966, + 0.41498058289289474, + 0.8379236720502377, + 0.37838196754455566, + 0.374316805973649, + 0.6528516001999378, + 0.31081628799438477, + 0.22539810836315155, + 1.4268639795482159, + 0.7560551930218935, + 0.3040352277457714, + 0.9331308715045452, + 0.09162472188472748, + 0.3367617428302765, + 0.19773513823747635, + 1.8004264198243618, + 0.837394692003727, + 0.35221925750374794, + 0.25088995322585106, + 0.8207132555544376, + 0.5210611615329981, + 0.12713617645204067, + 1.131065433844924 + ], + "unique_experts": 64, + "load_cv": 0.5645230746845386, + "normalized_load_entropy": 0.962488841127594, + "max_load_share": 0.04377104377104377 + } + }, + "s1_bos": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "52726862066162a5f407b332240531e00d7e426a4b799da414a9fc4e1a4aab68", + "route_weight_sha256": "e493973adf7e77ff12d4935ee61caac25d00e87b6da83d2128e6cbbc95af0035", + "loads": [ + 4, + 10, + 9, + 6, + 12, + 3, + 4, + 5, + 5, + 5, + 1, + 4, + 9, + 10, + 3, + 16, + 7, + 7, + 5, + 23, + 7, + 4, + 3, + 5, + 7, + 6, + 1, + 3, + 9, + 1, + 1, + 2, + 13, + 3, + 6, + 27, + 7, + 10, + 7, + 4, + 10, + 17, + 6, + 9, + 9, + 7, + 14, + 5, + 3, + 12, + 8, + 6, + 6, + 3, + 7, + 4, + 7, + 4, + 2, + 3, + 13, + 8, + 1, + 6 + ], + "weighted_loads": [ + 0.1574014201760292, + 0.8040690328925848, + 0.8040053956210613, + 0.1786731630563736, + 0.6656892243772745, + 0.10862641409039497, + 0.28982650861144066, + 0.200160950422287, + 0.27723443508148193, + 0.26073556020855904, + 0.046689022332429886, + 0.3969128280878067, + 0.8662661164999008, + 0.3655347563326359, + 0.19950099103152752, + 1.0441472921520472, + 0.3244910519570112, + 0.3596729561686516, + 0.1978419739753008, + 1.6109200101345778, + 0.5887286886572838, + 0.17348349653184414, + 0.12411657720804214, + 0.19487420842051506, + 0.5170785412192345, + 0.2258909624069929, + 0.028055241331458092, + 0.26973077841103077, + 0.5547277629375458, + 0.03914457932114601, + 0.038409940898418427, + 0.06704562529921532, + 0.6616906337440014, + 0.09574649296700954, + 0.578083448112011, + 1.6709404978901148, + 0.4396560676395893, + 0.6021736972033978, + 0.3380609918385744, + 0.29584578052163124, + 0.5173018835484982, + 0.7124360762536526, + 0.29908856749534607, + 0.6886514946818352, + 0.3455748148262501, + 0.3801367226988077, + 0.5264731217175722, + 0.27061476558446884, + 0.1983237899839878, + 1.4066891185939312, + 0.3580143917351961, + 0.31010352447628975, + 0.3455689363181591, + 0.1203323807567358, + 0.294151708483696, + 0.19294539839029312, + 0.7680226042866707, + 0.40473349392414093, + 0.11056201905012131, + 0.14924053102731705, + 0.7959340494126081, + 0.4969358555972576, + 0.06052851304411888, + 0.8834361601620913 + ], + "unique_experts": 64, + "load_cv": 0.7019515504808475, + "normalized_load_entropy": 0.9484248912794442, + "max_load_share": 0.060810810810810814 + }, + "full_input": { + "tokens": 115, + "top_k": 6, + "decisions": 690, + "ordered_route_sha256": "c3ede74c9c31a82aa241575d3b178050dabe72b95ca16da1fa3a21972b6f9eae", + "route_weight_sha256": "8b18b853a20d76f947695c6b5aff5b7ca9a2c5119a4e03112f5b5f60f50796b9", + "loads": [ + 5, + 10, + 9, + 6, + 15, + 4, + 4, + 7, + 5, + 14, + 9, + 11, + 9, + 11, + 17, + 21, + 7, + 13, + 5, + 23, + 8, + 9, + 10, + 5, + 16, + 8, + 13, + 13, + 9, + 3, + 12, + 3, + 18, + 5, + 12, + 27, + 18, + 15, + 11, + 5, + 11, + 17, + 8, + 13, + 11, + 8, + 17, + 6, + 4, + 14, + 15, + 6, + 18, + 5, + 10, + 6, + 25, + 12, + 12, + 11, + 15, + 8, + 4, + 9 + ], + "weighted_loads": [ + 0.20765629783272743, + 0.8040690328925848, + 0.8040053956210613, + 0.1786731630563736, + 0.8554144948720932, + 0.15891879796981812, + 0.28982650861144066, + 0.36411895602941513, + 0.27723443508148193, + 0.8554673567414284, + 0.8195463940501213, + 1.0645514093339443, + 0.8662661164999008, + 0.4214927852153778, + 1.1108551938086748, + 1.363189635798335, + 0.3244910519570112, + 0.7455537728965282, + 0.1978419739753008, + 1.6109200101345778, + 0.7023279666900635, + 0.49216155521571636, + 0.6049425192177296, + 0.19487420842051506, + 0.9735337719321251, + 0.3379186186939478, + 1.7830861862748861, + 0.6511545348912477, + 0.5547277629375458, + 0.11074995622038841, + 1.0793974697589874, + 0.14788034930825233, + 0.8624022603034973, + 0.1888089645653963, + 0.9511772505939007, + 1.6709404978901148, + 1.0531620979309082, + 0.8986756950616837, + 0.6763327624648809, + 0.3309864103794098, + 0.548228532075882, + 0.7124360762536526, + 0.386384267359972, + 0.8872005566954613, + 0.4239148646593094, + 0.39760657772421837, + 0.7222667280584574, + 0.3118334487080574, + 0.2324238456785679, + 1.558453045785427, + 0.6490429658442736, + 0.31010352447628975, + 1.2119750697165728, + 0.30545725487172604, + 0.503660149872303, + 0.30974361300468445, + 2.5136747770011425, + 1.159302458167076, + 0.6780177094042301, + 0.48355112969875336, + 1.0367895420640707, + 0.4969358555972576, + 0.1834203228354454, + 1.0523200202733278 + ], + "unique_experts": 64, + "load_cv": 0.49935055490664093, + "normalized_load_entropy": 0.9709711839514433, + "max_load_share": 0.0391304347826087 + } + }, + "s0_x": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "65d84d72278f3a9fc3bdca53c098ee587ea7cd470622c43ee8ffd1e2559441fa", + "route_weight_sha256": "5e42173c50317300bdb6e855c0b810c097c84dffb52d6432bc2e2a45a11aa4f1", + "loads": [ + 4, + 9, + 8, + 3, + 11, + 6, + 4, + 4, + 6, + 6, + 0, + 4, + 11, + 12, + 5, + 15, + 7, + 5, + 4, + 24, + 8, + 3, + 2, + 4, + 7, + 3, + 1, + 3, + 9, + 1, + 1, + 2, + 12, + 1, + 6, + 25, + 7, + 12, + 6, + 4, + 12, + 18, + 6, + 9, + 7, + 9, + 16, + 5, + 3, + 13, + 10, + 6, + 7, + 1, + 7, + 3, + 7, + 4, + 2, + 4, + 14, + 8, + 2, + 6 + ], + "weighted_loads": [ + 0.15660689771175385, + 0.7809503003954887, + 0.7399390414357185, + 0.09520608000457287, + 0.6306457296013832, + 0.2051889356225729, + 0.29355109110474586, + 0.17359408177435398, + 0.31784380599856377, + 0.2699726466089487, + 0.0, + 0.4075300544500351, + 0.9125450048595667, + 0.42324496805667877, + 0.25606653839349747, + 1.0297098495066166, + 0.3050920832902193, + 0.3168546110391617, + 0.1710110753774643, + 1.6111724115908146, + 0.629910446703434, + 0.12992969527840614, + 0.08232354745268822, + 0.1508791223168373, + 0.5260892622172832, + 0.1348443701863289, + 0.028659282252192497, + 0.27145038917660713, + 0.5534662641584873, + 0.038875240832567215, + 0.03334037959575653, + 0.06735494919121265, + 0.6297416482120752, + 0.030084846541285515, + 0.5689353123307228, + 1.612766519188881, + 0.4475674442946911, + 0.6582964770495892, + 0.29918061569333076, + 0.28425576351583004, + 0.5771945491433144, + 0.7516756225377321, + 0.2983801029622555, + 0.6779807955026627, + 0.2675645649433136, + 0.4528836999088526, + 0.6145609002560377, + 0.2602093406021595, + 0.15096421539783478, + 1.440196556970477, + 0.45091247372329235, + 0.3069142587482929, + 0.39196888729929924, + 0.051477961242198944, + 0.29613442346453667, + 0.15758027881383896, + 0.7267713285982609, + 0.42074862495064735, + 0.11737889423966408, + 0.2042708732187748, + 0.8687074035406113, + 0.475612822920084, + 0.08523869886994362, + 0.9888475742191076 + ], + "unique_experts": 63, + "load_cv": 0.7318399030510374, + "normalized_load_entropy": 0.9410643135870417, + "max_load_share": 0.05630630630630631 + }, + "full_input": { + "tokens": 99, + "top_k": 6, + "decisions": 594, + "ordered_route_sha256": "45434866ff61c6a28eb8dcb27c0f8ef5e24c5e94432307aec46b0dfba55a1681", + "route_weight_sha256": "964ed71a7a44639dcc441eba30f3649b9175cae7915d946c3c7f54086b4194d0", + "loads": [ + 4, + 9, + 8, + 3, + 11, + 7, + 4, + 6, + 6, + 11, + 4, + 11, + 11, + 13, + 20, + 17, + 7, + 17, + 4, + 24, + 9, + 6, + 3, + 4, + 13, + 4, + 6, + 12, + 9, + 2, + 7, + 2, + 15, + 1, + 8, + 25, + 12, + 12, + 7, + 4, + 12, + 18, + 7, + 14, + 7, + 9, + 18, + 5, + 3, + 13, + 18, + 6, + 13, + 1, + 8, + 3, + 23, + 12, + 8, + 5, + 14, + 8, + 3, + 8 + ], + "weighted_loads": [ + 0.15660689771175385, + 0.7809503003954887, + 0.7399390414357185, + 0.09520608000457287, + 0.6306457296013832, + 0.2500117029994726, + 0.29355109110474586, + 0.33278979919850826, + 0.31784380599856377, + 0.6522148605436087, + 0.2830845005810261, + 0.9057943932712078, + 0.9125450048595667, + 0.4854140356183052, + 1.1214285884052515, + 1.1236458867788315, + 0.3050920832902193, + 0.967113770544529, + 0.1710110753774643, + 1.6111724115908146, + 0.7569194510579109, + 0.2226983830332756, + 0.1294342316687107, + 0.1508791223168373, + 0.8650534451007843, + 0.17004311457276344, + 1.015183674171567, + 0.6250179763883352, + 0.5534662641584873, + 0.08637693896889687, + 0.6306145340204239, + 0.06735494919121265, + 0.7373741436749697, + 0.030084846541285515, + 0.7175429314374924, + 1.612766519188881, + 0.7246348336338997, + 0.6582964770495892, + 0.3424563445150852, + 0.28425576351583004, + 0.5771945491433144, + 0.7516756225377321, + 0.3436523452401161, + 0.9214986301958561, + 0.2675645649433136, + 0.4528836999088526, + 0.7402901146560907, + 0.2602093406021595, + 0.15096421539783478, + 1.440196556970477, + 0.8007068131119013, + 0.3069142587482929, + 0.875910023227334, + 0.051477961242198944, + 0.3433053158223629, + 0.15758027881383896, + 1.964351113885641, + 0.9472952298820019, + 0.36062370985746384, + 0.2526523321866989, + 0.8687074035406113, + 0.475612822920084, + 0.12620871141552925, + 1.0678009185940027 + ], + "unique_experts": 64, + "load_cv": 0.6117114043438378, + "normalized_load_entropy": 0.9559557171179766, + "max_load_share": 0.04208754208754209 + } + }, + "s1_x": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "616e76b2ad638fabe8803a9cf706ca4893afc05e9ca1eac339f83b6dfe06ca61", + "route_weight_sha256": "ba45df7cfc8ef887f2b4a19873384dce37593a9d6e9e6fd2a931e1bc8671e68b", + "loads": [ + 5, + 10, + 9, + 8, + 11, + 3, + 3, + 5, + 5, + 5, + 0, + 5, + 10, + 12, + 5, + 16, + 7, + 7, + 4, + 23, + 7, + 5, + 3, + 5, + 7, + 6, + 1, + 3, + 9, + 1, + 1, + 2, + 12, + 2, + 6, + 26, + 7, + 10, + 7, + 6, + 10, + 18, + 5, + 9, + 6, + 5, + 16, + 5, + 3, + 12, + 8, + 6, + 6, + 3, + 6, + 3, + 7, + 3, + 2, + 4, + 14, + 6, + 2, + 6 + ], + "weighted_loads": [ + 0.19028343632817268, + 0.7921382263302803, + 0.7928955778479576, + 0.2628583703190088, + 0.6323364190757275, + 0.10921752452850342, + 0.2583762891590595, + 0.18523726053535938, + 0.2882171534001827, + 0.25017406418919563, + 0.0, + 0.4091718830168247, + 0.8908531945198774, + 0.4250179510563612, + 0.27413160353899, + 1.046566665172577, + 0.30941709876060486, + 0.3396859113126993, + 0.17179745063185692, + 1.6025609262287617, + 0.5863302871584892, + 0.19547110982239246, + 0.12414992600679398, + 0.1826312579214573, + 0.5064964927732944, + 0.215068144723773, + 0.02747274935245514, + 0.2697015795856714, + 0.5322209522128105, + 0.04216944798827171, + 0.044060707092285156, + 0.06541973352432251, + 0.5752987321466208, + 0.06842544302344322, + 0.5893825590610504, + 1.6004347875714302, + 0.45116548612713814, + 0.6027297340333462, + 0.3704245686531067, + 0.3340971637517214, + 0.514070151373744, + 0.7698209844529629, + 0.26157087460160255, + 0.6432567052543163, + 0.2500810530036688, + 0.30035166814923286, + 0.6251379754394293, + 0.2573886178433895, + 0.19314265996217728, + 1.4141740202903748, + 0.3389237616211176, + 0.3101603537797928, + 0.3323661908507347, + 0.1282346211373806, + 0.262016873806715, + 0.15865816920995712, + 0.7141963802278042, + 0.35857879742980003, + 0.11681915447115898, + 0.20981372520327568, + 0.860816091299057, + 0.4212774261832237, + 0.08812521584331989, + 0.8930767942219973 + ], + "unique_experts": 63, + "load_cv": 0.7083968876800626, + "normalized_load_entropy": 0.9465595570354404, + "max_load_share": 0.05855855855855856 + }, + "full_input": { + "tokens": 115, + "top_k": 6, + "decisions": 690, + "ordered_route_sha256": "4dbe93f194ede3953ab8d8baa87ce5523475633ff320715ea085d06a39140d3e", + "route_weight_sha256": "cd80007c901457829b02655dbaa01bc6f97ec78a1702255fa308f92048b1178f", + "loads": [ + 5, + 10, + 9, + 8, + 14, + 4, + 3, + 7, + 5, + 13, + 7, + 14, + 10, + 13, + 21, + 21, + 7, + 14, + 4, + 23, + 8, + 10, + 9, + 5, + 16, + 7, + 13, + 14, + 9, + 4, + 10, + 3, + 17, + 2, + 11, + 26, + 19, + 15, + 11, + 7, + 11, + 18, + 6, + 13, + 6, + 6, + 19, + 6, + 4, + 14, + 15, + 6, + 18, + 5, + 9, + 5, + 27, + 13, + 13, + 13, + 16, + 6, + 5, + 8 + ], + "weighted_loads": [ + 0.19028343632817268, + 0.7921382263302803, + 0.7928955778479576, + 0.2628583703190088, + 0.8220616895705462, + 0.16752324625849724, + 0.2583762891590595, + 0.3306776899844408, + 0.2882171534001827, + 0.7586495466530323, + 0.7499090917408466, + 1.2412657253444195, + 0.8908531945198774, + 0.4809759799391031, + 1.3403525426983833, + 1.3572122044861317, + 0.30941709876060486, + 0.8104190547019243, + 0.17179745063185692, + 1.6025609262287617, + 0.6866022869944572, + 0.5141491685062647, + 0.5684021599590778, + 0.1826312579214573, + 0.9583902545273304, + 0.2850396167486906, + 1.651185356080532, + 0.6946034152060747, + 0.5322209522128105, + 0.18996578082442284, + 0.9215106852352619, + 0.14625445753335953, + 0.7782417107373476, + 0.06842544302344322, + 0.8949005641043186, + 1.6004347875714302, + 1.0810680277645588, + 0.8992317318916321, + 0.7068127244710922, + 0.36923779360949993, + 0.5449967999011278, + 0.7698209844529629, + 0.30556414276361465, + 0.8418057672679424, + 0.2500810530036688, + 0.3178215231746435, + 0.8343023378401995, + 0.2986073009669781, + 0.22724271565675735, + 1.5659379474818707, + 0.629952335730195, + 0.3101603537797928, + 1.2021271791309118, + 0.31335949525237083, + 0.47152531519532204, + 0.27545638382434845, + 2.579676453024149, + 1.2781534679234028, + 0.7495250478386879, + 0.5913946330547333, + 1.1016715839505196, + 0.4212774261832237, + 0.21101702563464642, + 0.9754959512501955 + ], + "unique_experts": 64, + "load_cv": 0.5359654645646948, + "normalized_load_entropy": 0.9663703528102849, + "max_load_share": 0.0391304347826087 + } + }, + "s0_period": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "cb74acdb393b0948b819791bc96364933f247d439873d03ea03e7d951609b640", + "route_weight_sha256": "57b68305e8a6e051cce4c4f260c3f5dd15b507847f8a8ca8f1b98703a070926e", + "loads": [ + 4, + 10, + 9, + 4, + 10, + 4, + 4, + 5, + 6, + 5, + 1, + 4, + 10, + 10, + 5, + 17, + 7, + 5, + 4, + 25, + 8, + 4, + 1, + 4, + 7, + 5, + 1, + 2, + 9, + 1, + 0, + 2, + 13, + 1, + 6, + 24, + 7, + 12, + 7, + 4, + 11, + 16, + 6, + 9, + 6, + 7, + 14, + 5, + 3, + 13, + 11, + 6, + 7, + 3, + 8, + 4, + 7, + 4, + 2, + 4, + 14, + 8, + 2, + 7 + ], + "weighted_loads": [ + 0.15354834869503975, + 0.8069885745644569, + 0.7764636278152466, + 0.12618148885667324, + 0.5950902253389359, + 0.1462610885500908, + 0.2903413735330105, + 0.20217548683285713, + 0.32042356953024864, + 0.24399546347558498, + 0.039663393050432205, + 0.4063526839017868, + 0.8868494778871536, + 0.3584188725799322, + 0.2665361016988754, + 1.1101033799350262, + 0.3093543779104948, + 0.316913940012455, + 0.17102520540356636, + 1.6527567952871323, + 0.6114501785486937, + 0.16447138972580433, + 0.051147546619176865, + 0.1499011255800724, + 0.5222198143601418, + 0.21171238645911217, + 0.02942168153822422, + 0.25569429248571396, + 0.5514064393937588, + 0.03903055563569069, + 0.0, + 0.06711947545409203, + 0.6610809080302715, + 0.02630605734884739, + 0.5652504004538059, + 1.565514074638486, + 0.44756998494267464, + 0.6614700295031071, + 0.33902884274721146, + 0.2857893146574497, + 0.5395080745220184, + 0.7044854424893856, + 0.29652684181928635, + 0.6799996867775917, + 0.2602555379271507, + 0.3657998852431774, + 0.5377453248947859, + 0.2590346001088619, + 0.16510719060897827, + 1.4238930977880955, + 0.4745023474097252, + 0.30378643050789833, + 0.38666898757219315, + 0.11522693186998367, + 0.3263066280633211, + 0.19010772928595543, + 0.7302356027066708, + 0.4175609387457371, + 0.11120510473847389, + 0.21396782994270325, + 0.8681811671704054, + 0.49234070628881454, + 0.08252458460628986, + 0.9751066844910383 + ], + "unique_experts": 63, + "load_cv": 0.7138751472309021, + "normalized_load_entropy": 0.9439791246795475, + "max_load_share": 0.05630630630630631 + }, + "full_input": { + "tokens": 99, + "top_k": 6, + "decisions": 594, + "ordered_route_sha256": "6e7770a2e551a753574210a2b0db563dfe0daff7f9f4f5ea4bcd62fddb78fcda", + "route_weight_sha256": "11d2417fc828b95eafef168997e5b0f33e4e2e6aafd3290decfb5a35962d791f", + "loads": [ + 4, + 10, + 9, + 4, + 10, + 5, + 4, + 7, + 6, + 10, + 5, + 9, + 10, + 11, + 20, + 18, + 7, + 16, + 4, + 25, + 9, + 6, + 2, + 4, + 14, + 6, + 6, + 10, + 9, + 1, + 8, + 2, + 17, + 3, + 8, + 24, + 13, + 12, + 7, + 4, + 11, + 16, + 7, + 12, + 7, + 7, + 17, + 5, + 3, + 13, + 19, + 6, + 15, + 3, + 9, + 4, + 22, + 11, + 8, + 5, + 14, + 8, + 3, + 10 + ], + "weighted_loads": [ + 0.15354834869503975, + 0.8069885745644569, + 0.7764636278152466, + 0.12618148885667324, + 0.5950902253389359, + 0.18875205144286156, + 0.2903413735330105, + 0.3703780323266983, + 0.32042356953024864, + 0.6263504941016436, + 0.3262808360159397, + 0.7518535815179348, + 0.8868494778871536, + 0.42058794014155865, + 1.0574629213660955, + 1.167614720761776, + 0.3093543779104948, + 0.9158842824399471, + 0.17102520540356636, + 1.6527567952871323, + 0.7588120084255934, + 0.22351190261542797, + 0.09831772744655609, + 0.1499011255800724, + 0.9449515044689178, + 0.24805444851517677, + 1.025403095409274, + 0.5734341237694025, + 0.5514064393937588, + 0.03903055563569069, + 0.6589284930378199, + 0.06711947545409203, + 0.8005506880581379, + 0.10872418247163296, + 0.7138580195605755, + 1.565514074638486, + 0.7838704399764538, + 0.6614700295031071, + 0.33902884274721146, + 0.2857893146574497, + 0.5395080745220184, + 0.7044854424893856, + 0.34793345630168915, + 0.8290681578218937, + 0.2955257073044777, + 0.3657998852431774, + 0.7012115847319365, + 0.2590346001088619, + 0.16510719060897827, + 1.4238930977880955, + 0.8242966867983341, + 0.30378643050789833, + 0.9788677860051394, + 0.11522693186998367, + 0.37347752042114735, + 0.19010772928595543, + 1.9981569200754166, + 0.8262799084186554, + 0.35444992035627365, + 0.26234928891062737, + 0.8681811671704054, + 0.49234070628881454, + 0.1234945971518755, + 1.1310950051993132 + ], + "unique_experts": 64, + "load_cv": 0.5939588626873988, + "normalized_load_entropy": 0.9594224772261397, + "max_load_share": 0.04208754208754209 + } + }, + "s1_period": { + "target_content": { + "tokens": 74, + "top_k": 6, + "decisions": 444, + "ordered_route_sha256": "bdc9ac26403f326115266290369e37ec27f38a7153d18d21d88539b5b2f4f3a0", + "route_weight_sha256": "53c2cf0dc75cf22bee532fd6c7ab53259db59d279569c59ae54e85fba643ff0f", + "loads": [ + 4, + 10, + 9, + 7, + 11, + 4, + 4, + 4, + 5, + 5, + 1, + 4, + 11, + 12, + 5, + 15, + 8, + 6, + 4, + 23, + 7, + 2, + 3, + 5, + 7, + 6, + 1, + 2, + 9, + 1, + 1, + 2, + 12, + 2, + 7, + 25, + 7, + 10, + 7, + 5, + 10, + 19, + 6, + 9, + 6, + 6, + 17, + 5, + 3, + 12, + 8, + 6, + 6, + 3, + 6, + 3, + 7, + 3, + 2, + 4, + 14, + 7, + 2, + 7 + ], + "weighted_loads": [ + 0.1564769111573696, + 0.7899584397673607, + 0.792753528803587, + 0.2357978280633688, + 0.633246548473835, + 0.14128193631768227, + 0.2958144210278988, + 0.1509508453309536, + 0.2861090414226055, + 0.25035612285137177, + 0.039069678634405136, + 0.3776434697210789, + 0.9224057607352734, + 0.414595702663064, + 0.26877509988844395, + 1.0156924426555634, + 0.35204062797129154, + 0.3161852937191725, + 0.17285847663879395, + 1.6073705479502678, + 0.596597358584404, + 0.11483125388622284, + 0.1195782721042633, + 0.1848980113863945, + 0.5125712417066097, + 0.21227705664932728, + 0.027946455404162407, + 0.24091246724128723, + 0.5405261889100075, + 0.04187248274683952, + 0.041948042809963226, + 0.06487222015857697, + 0.573648339137435, + 0.06739243678748608, + 0.6254924237728119, + 1.5735227428376675, + 0.45479683950543404, + 0.6125273182988167, + 0.36372433230280876, + 0.3036190811544657, + 0.5010095108300447, + 0.7975138742476702, + 0.29440200328826904, + 0.6184044703841209, + 0.2631722427904606, + 0.32993223145604134, + 0.6607700958848, + 0.26073602586984634, + 0.19061171263456345, + 1.3757480904459953, + 0.3599586635828018, + 0.30253729969263077, + 0.3215090483427048, + 0.11900580674409866, + 0.25643512047827244, + 0.15838764607906342, + 0.6807258576154709, + 0.36244575679302216, + 0.1172732375562191, + 0.21549921110272408, + 0.8582253493368626, + 0.45497990399599075, + 0.08574644476175308, + 0.9646792206913233 + ], + "unique_experts": 64, + "load_cv": 0.7102276693153964, + "normalized_load_entropy": 0.9465813408494449, + "max_load_share": 0.05630630630630631 + }, + "full_input": { + "tokens": 115, + "top_k": 6, + "decisions": 690, + "ordered_route_sha256": "b83cac321d2e9bbc3c40fa9cce809b3723323c6f503dfa05a6b6b55733f1a4c1", + "route_weight_sha256": "93d33f9354661ffab3d0a5adb26779609fe5ce725d153144f7e7e717dcc41d65", + "loads": [ + 4, + 10, + 9, + 8, + 14, + 5, + 4, + 6, + 5, + 13, + 9, + 11, + 11, + 13, + 20, + 20, + 8, + 13, + 4, + 23, + 8, + 7, + 9, + 5, + 17, + 8, + 12, + 13, + 9, + 3, + 10, + 3, + 17, + 2, + 13, + 25, + 19, + 16, + 11, + 6, + 11, + 19, + 8, + 13, + 6, + 7, + 21, + 6, + 4, + 14, + 15, + 6, + 18, + 5, + 10, + 5, + 27, + 11, + 12, + 12, + 16, + 7, + 5, + 9 + ], + "weighted_loads": [ + 0.1564769111573696, + 0.7899584397673607, + 0.792753528803587, + 0.2634414955973625, + 0.8229718189686537, + 0.20128578692674637, + 0.2958144210278988, + 0.3116018883883953, + 0.2861090414226055, + 0.7447842843830585, + 0.8291841670870781, + 1.044714666903019, + 0.9224057607352734, + 0.47055373154580593, + 1.3013600166887045, + 1.320829801261425, + 0.35204062797129154, + 0.8400428239256144, + 0.17285847663879395, + 1.6073705479502678, + 0.6950094401836395, + 0.43350931257009506, + 0.5638305060565472, + 0.1848980113863945, + 1.0335821881890297, + 0.3175483662635088, + 1.5740394722670317, + 0.6547697018831968, + 0.5405261889100075, + 0.11347785964608192, + 0.9433030821382999, + 0.14570694416761398, + 0.7821234744042158, + 0.06739243678748608, + 0.958631556481123, + 1.5735227428376675, + 1.1104782037436962, + 0.9378211256116629, + 0.7038873061537743, + 0.3387597110122442, + 0.5319361593574286, + 0.7975138742476702, + 0.369287958368659, + 0.816953532397747, + 0.2631722427904606, + 0.347402086481452, + 0.9204879589378834, + 0.3019547089934349, + 0.22471176832914352, + 1.5275120176374912, + 0.6509872376918793, + 0.30253729969263077, + 1.2189296558499336, + 0.3041306808590889, + 0.50432482175529, + 0.27518586069345474, + 2.6686015091836452, + 1.118896171450615, + 0.6847289279103279, + 0.5498098097741604, + 1.0990808419883251, + 0.45497990399599075, + 0.2086382545530796, + 1.0866256896406412 + ], + "unique_experts": 64, + "load_cv": 0.5283875914088856, + "normalized_load_entropy": 0.9673372339562489, + "max_load_share": 0.0391304347826087 + } + } + }, + "target_comparisons": { + "system_eos": { + "tokens": 74, + "ordered_topk_exact_tokens": 42, + "set_exact_tokens": 54, + "mean_set_jaccard": 0.9198841698841701, + "mean_token_weighted_tv": 0.016370629577117192, + "aggregate_load_tv": 0.027027027027027025 + }, + "system_bos": { + "tokens": 74, + "ordered_topk_exact_tokens": 42, + "set_exact_tokens": 44, + "mean_set_jaccard": 0.8812741312741313, + "mean_token_weighted_tv": 0.021362803221957105, + "aggregate_load_tv": 0.04279279279279279 + }, + "system_x": { + "tokens": 74, + "ordered_topk_exact_tokens": 25, + "set_exact_tokens": 31, + "mean_set_jaccard": 0.8114543114543115, + "mean_token_weighted_tv": 0.03411713450190586, + "aggregate_load_tv": 0.060810810810810814 + }, + "system_period": { + "tokens": 74, + "ordered_topk_exact_tokens": 35, + "set_exact_tokens": 45, + "mean_set_jaccard": 0.8770913770913772, + "mean_token_weighted_tv": 0.025541513025559282, + "aggregate_load_tv": 0.05405405405405406 + }, + "bos_at_s0": { + "tokens": 74, + "ordered_topk_exact_tokens": 35, + "set_exact_tokens": 44, + "mean_set_jaccard": 0.8812741312741312, + "mean_token_weighted_tv": 0.022254113447726577, + "aggregate_load_tv": 0.0427927927927928 + }, + "bos_at_s1": { + "tokens": 74, + "ordered_topk_exact_tokens": 35, + "set_exact_tokens": 43, + "mean_set_jaccard": 0.8803088803088804, + "mean_token_weighted_tv": 0.02322795576843861, + "aggregate_load_tv": 0.0472972972972973 + }, + "x_at_s0": { + "tokens": 74, + "ordered_topk_exact_tokens": 31, + "set_exact_tokens": 42, + "mean_set_jaccard": 0.8706563706563707, + "mean_token_weighted_tv": 0.025839421319196355, + "aggregate_load_tv": 0.04504504504504506 + }, + "x_at_s1": { + "tokens": 74, + "ordered_topk_exact_tokens": 25, + "set_exact_tokens": 31, + "mean_set_jaccard": 0.831081081081081, + "mean_token_weighted_tv": 0.03271735998222957, + "aggregate_load_tv": 0.05855855855855856 + }, + "period_at_s0": { + "tokens": 74, + "ordered_topk_exact_tokens": 30, + "set_exact_tokens": 39, + "mean_set_jaccard": 0.8590733590733592, + "mean_token_weighted_tv": 0.027581038242961105, + "aggregate_load_tv": 0.05855855855855856 + }, + "period_at_s1": { + "tokens": 74, + "ordered_topk_exact_tokens": 25, + "set_exact_tokens": 31, + "mean_set_jaccard": 0.8281853281853282, + "mean_token_weighted_tv": 0.03255502643013323, + "aggregate_load_tv": 0.05405405405405406 + } + } + } + } + } + ], + "summary": { + "sources": 16, + "conditions_per_source": 8, + "decoder_layers_executed": 27, + "moe_gates_executed": 26, + "hidden_stages": 29, + "target_content_tokens_per_condition": 1537, + "target_route_decisions": 1918176, + "hidden": { + "embedding": { + "system_eos": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 1537, + "token_weighted_mean_cosine_similarity": 1.0, + "source_mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "system_bos": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 1537, + "token_weighted_mean_cosine_similarity": 1.0, + "source_mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "system_x": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 1537, + "token_weighted_mean_cosine_similarity": 1.0, + "source_mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "system_period": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 1537, + "token_weighted_mean_cosine_similarity": 1.0, + "source_mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "bos_at_s0": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 1537, + "token_weighted_mean_cosine_similarity": 1.0, + "source_mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "bos_at_s1": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 1537, + "token_weighted_mean_cosine_similarity": 1.0, + "source_mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "x_at_s0": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 1537, + "token_weighted_mean_cosine_similarity": 1.0, + "source_mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "x_at_s1": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 1537, + "token_weighted_mean_cosine_similarity": 1.0, + "source_mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "period_at_s0": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 1537, + "token_weighted_mean_cosine_similarity": 1.0, + "source_mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + }, + "period_at_s1": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 1537, + "token_weighted_mean_cosine_similarity": 1.0, + "source_mean_relative_l2": 0.0, + "max_abs_delta": 0.0 + } + }, + "layer_00": { + "system_eos": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9995740788977256, + "source_mean_relative_l2": 0.026541569794062525, + "max_abs_delta": 0.171875 + }, + "system_bos": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9993778440420241, + "source_mean_relative_l2": 0.03268232592381537, + "max_abs_delta": 0.171875 + }, + "system_x": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9994067405056628, + "source_mean_relative_l2": 0.03226005844771862, + "max_abs_delta": 0.171875 + }, + "system_period": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9994327905275795, + "source_mean_relative_l2": 0.03135601186659187, + "max_abs_delta": 0.1796875 + }, + "bos_at_s0": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9905310608228461, + "source_mean_relative_l2": 0.14540393417701125, + "max_abs_delta": 0.28125 + }, + "bos_at_s1": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9916161531043193, + "source_mean_relative_l2": 0.1371695720590651, + "max_abs_delta": 0.28125 + }, + "x_at_s0": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9912487028788342, + "source_mean_relative_l2": 0.14065681165084243, + "max_abs_delta": 0.296875 + }, + "x_at_s1": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9921616222770011, + "source_mean_relative_l2": 0.13338942639529705, + "max_abs_delta": 0.3125 + }, + "period_at_s0": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9913677308337597, + "source_mean_relative_l2": 0.13959865784272552, + "max_abs_delta": 0.3125 + }, + "period_at_s1": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9922365242192399, + "source_mean_relative_l2": 0.13263636687770486, + "max_abs_delta": 0.328125 + } + }, + "layer_01": { + "system_eos": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9990745525741701, + "source_mean_relative_l2": 0.041919392184354365, + "max_abs_delta": 0.2109375 + }, + "system_bos": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9969392231942464, + "source_mean_relative_l2": 0.07685172208584845, + "max_abs_delta": 0.3330078125 + }, + "system_x": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9958411259703924, + "source_mean_relative_l2": 0.08964474685490131, + "max_abs_delta": 0.3212890625 + }, + "system_period": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.995944818856271, + "source_mean_relative_l2": 0.08837105240672827, + "max_abs_delta": 0.2998046875 + }, + "bos_at_s0": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9899734908214388, + "source_mean_relative_l2": 0.14902647864073515, + "max_abs_delta": 0.3740234375 + }, + "bos_at_s1": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9897871118283691, + "source_mean_relative_l2": 0.1497314884327352, + "max_abs_delta": 0.283203125 + }, + "x_at_s0": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9910026412934705, + "source_mean_relative_l2": 0.1409186371602118, + "max_abs_delta": 0.361328125 + }, + "x_at_s1": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9891226440183358, + "source_mean_relative_l2": 0.154518723487854, + "max_abs_delta": 0.361328125 + }, + "period_at_s0": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9911534263471853, + "source_mean_relative_l2": 0.13982344418764114, + "max_abs_delta": 0.33203125 + }, + "period_at_s1": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9892073139480437, + "source_mean_relative_l2": 0.15368623193353415, + "max_abs_delta": 0.3515625 + } + }, + "layer_02": { + "system_eos": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9988076181557556, + "source_mean_relative_l2": 0.04928529146127403, + "max_abs_delta": 0.3125 + }, + "system_bos": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9963408525919247, + "source_mean_relative_l2": 0.0867034113034606, + "max_abs_delta": 0.404296875 + }, + "system_x": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9949375862569567, + "source_mean_relative_l2": 0.10124093946069479, + "max_abs_delta": 0.421875 + }, + "system_period": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9950908737750355, + "source_mean_relative_l2": 0.09975895704701543, + "max_abs_delta": 0.4375 + }, + "bos_at_s0": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9905966647507389, + "source_mean_relative_l2": 0.14468843303620815, + "max_abs_delta": 0.5 + }, + "bos_at_s1": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9890504890086981, + "source_mean_relative_l2": 0.155851062387228, + "max_abs_delta": 0.46484375 + }, + "x_at_s0": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9906254368473666, + "source_mean_relative_l2": 0.1447152253240347, + "max_abs_delta": 0.546875 + }, + "x_at_s1": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9873158718055149, + "source_mean_relative_l2": 0.1682691229507327, + "max_abs_delta": 0.5859375 + }, + "period_at_s0": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9906815106634513, + "source_mean_relative_l2": 0.1446462362073362, + "max_abs_delta": 0.5234375 + }, + "period_at_s1": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9873156044183804, + "source_mean_relative_l2": 0.16817105188965797, + "max_abs_delta": 0.5703125 + } + }, + "layer_03": { + "system_eos": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9987378821562232, + "source_mean_relative_l2": 0.05012279818765819, + "max_abs_delta": 0.3125 + }, + "system_bos": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.996292127675644, + "source_mean_relative_l2": 0.08758943434804678, + "max_abs_delta": 0.34375 + }, + "system_x": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9946176968539157, + "source_mean_relative_l2": 0.10508272983133793, + "max_abs_delta": 0.40625 + }, + "system_period": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9947301580212531, + "source_mean_relative_l2": 0.10403680335730314, + "max_abs_delta": 0.484375 + }, + "bos_at_s0": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9915156176746396, + "source_mean_relative_l2": 0.13808333594352007, + "max_abs_delta": 0.4375 + }, + "bos_at_s1": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9897284091643568, + "source_mean_relative_l2": 0.15129210241138935, + "max_abs_delta": 0.5 + }, + "x_at_s0": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9912194356021745, + "source_mean_relative_l2": 0.1396624566987157, + "max_abs_delta": 0.5703125 + }, + "x_at_s1": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9876250262840583, + "source_mean_relative_l2": 0.16548986174166203, + "max_abs_delta": 0.55859375 + }, + "period_at_s0": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9913112722051245, + "source_mean_relative_l2": 0.1387676759622991, + "max_abs_delta": 0.55859375 + }, + "period_at_s1": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9875148849667243, + "source_mean_relative_l2": 0.16567408945411444, + "max_abs_delta": 0.57421875 + } + }, + "layer_04": { + "system_eos": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9987564588337652, + "source_mean_relative_l2": 0.04912583786062896, + "max_abs_delta": 0.21875 + }, + "system_bos": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9965691402816276, + "source_mean_relative_l2": 0.08456931868568063, + "max_abs_delta": 0.34375 + }, + "system_x": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9948968496040315, + "source_mean_relative_l2": 0.10330007504671812, + "max_abs_delta": 0.5 + }, + "system_period": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9948939370814281, + "source_mean_relative_l2": 0.10321774752810597, + "max_abs_delta": 0.46875 + }, + "bos_at_s0": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9931829456935553, + "source_mean_relative_l2": 0.12286349851638079, + "max_abs_delta": 0.546875 + }, + "bos_at_s1": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9914855783297477, + "source_mean_relative_l2": 0.13679034356027842, + "max_abs_delta": 0.625 + }, + "x_at_s0": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9923721776042732, + "source_mean_relative_l2": 0.1292660259641707, + "max_abs_delta": 0.68359375 + }, + "x_at_s1": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9888794481870643, + "source_mean_relative_l2": 0.1566438302397728, + "max_abs_delta": 0.728515625 + }, + "period_at_s0": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9923054571266522, + "source_mean_relative_l2": 0.12942433496937156, + "max_abs_delta": 0.6826171875 + }, + "period_at_s1": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.988684248482165, + "source_mean_relative_l2": 0.15744845429435372, + "max_abs_delta": 0.7734375 + } + }, + "layer_05": { + "system_eos": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9982688488243614, + "source_mean_relative_l2": 0.05803673341870308, + "max_abs_delta": 0.3515625 + }, + "system_bos": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.995865110615747, + "source_mean_relative_l2": 0.091684325132519, + "max_abs_delta": 0.4375 + }, + "system_x": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9935454737853135, + "source_mean_relative_l2": 0.11548144975677133, + "max_abs_delta": 0.46875 + }, + "system_period": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.99339776521545, + "source_mean_relative_l2": 0.11647011851891875, + "max_abs_delta": 0.484375 + }, + "bos_at_s0": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9923924711825558, + "source_mean_relative_l2": 0.1280195559374988, + "max_abs_delta": 0.65625 + }, + "bos_at_s1": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9906212865104129, + "source_mean_relative_l2": 0.1419921857304871, + "max_abs_delta": 0.78125 + }, + "x_at_s0": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.991314663465099, + "source_mean_relative_l2": 0.1362163727171719, + "max_abs_delta": 0.80859375 + }, + "x_at_s1": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9872317085734574, + "source_mean_relative_l2": 0.16580600198358297, + "max_abs_delta": 0.888671875 + }, + "period_at_s0": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9912980949250458, + "source_mean_relative_l2": 0.13625301187857985, + "max_abs_delta": 0.791015625 + }, + "period_at_s1": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.987085975100642, + "source_mean_relative_l2": 0.16655867919325829, + "max_abs_delta": 0.9765625 + } + }, + "layer_06": { + "system_eos": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9980427927992603, + "source_mean_relative_l2": 0.06077818898484111, + "max_abs_delta": 0.625 + }, + "system_bos": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9957885297770305, + "source_mean_relative_l2": 0.09088909346610308, + "max_abs_delta": 0.875 + }, + "system_x": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9932173994662472, + "source_mean_relative_l2": 0.11608999129384756, + "max_abs_delta": 0.8125 + }, + "system_period": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9928957691965121, + "source_mean_relative_l2": 0.11857915809378028, + "max_abs_delta": 1.0 + }, + "bos_at_s0": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.992939200584347, + "source_mean_relative_l2": 0.12104662135243416, + "max_abs_delta": 0.84375 + }, + "bos_at_s1": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9912765381703845, + "source_mean_relative_l2": 0.13424320425838232, + "max_abs_delta": 1.09375 + }, + "x_at_s0": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9915831145250572, + "source_mean_relative_l2": 0.13237616093829274, + "max_abs_delta": 1.46875 + }, + "x_at_s1": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9873037938181269, + "source_mean_relative_l2": 0.16218275018036366, + "max_abs_delta": 1.28125 + }, + "period_at_s0": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9914597264341356, + "source_mean_relative_l2": 0.13297382602468133, + "max_abs_delta": 1.28125 + }, + "period_at_s1": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9869693501785194, + "source_mean_relative_l2": 0.16439994145184755, + "max_abs_delta": 1.3095703125 + } + }, + "layer_07": { + "system_eos": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9976431092970853, + "source_mean_relative_l2": 0.06538312137126923, + "max_abs_delta": 0.9375 + }, + "system_bos": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9952103213668257, + "source_mean_relative_l2": 0.09576857043430209, + "max_abs_delta": 1.1875 + }, + "system_x": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9923224972685825, + "source_mean_relative_l2": 0.12191515136510134, + "max_abs_delta": 1.03125 + }, + "system_period": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9919988514544054, + "source_mean_relative_l2": 0.12480698665603995, + "max_abs_delta": 1.0625 + }, + "bos_at_s0": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.992334475126372, + "source_mean_relative_l2": 0.12483719317242503, + "max_abs_delta": 0.8125 + }, + "bos_at_s1": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9906607424972425, + "source_mean_relative_l2": 0.13691103039309382, + "max_abs_delta": 0.921875 + }, + "x_at_s0": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9907520912495541, + "source_mean_relative_l2": 0.13715392397716641, + "max_abs_delta": 1.21875 + }, + "x_at_s1": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.986149796511961, + "source_mean_relative_l2": 0.16754659451544285, + "max_abs_delta": 1.78125 + }, + "period_at_s0": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9906365653486631, + "source_mean_relative_l2": 0.13781993091106415, + "max_abs_delta": 1.21875 + }, + "period_at_s1": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9858203111876895, + "source_mean_relative_l2": 0.16989469528198242, + "max_abs_delta": 1.5 + } + }, + "layer_08": { + "system_eos": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9970279263845108, + "source_mean_relative_l2": 0.07258906331844628, + "max_abs_delta": 1.0 + }, + "system_bos": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.994552351005991, + "source_mean_relative_l2": 0.10126419179141521, + "max_abs_delta": 1.28125 + }, + "system_x": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9909093995798541, + "source_mean_relative_l2": 0.1315021812915802, + "max_abs_delta": 0.9140625 + }, + "system_period": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9906470607687454, + "source_mean_relative_l2": 0.13463967526331544, + "max_abs_delta": 1.125 + }, + "bos_at_s0": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9915874468946736, + "source_mean_relative_l2": 0.1296531236730516, + "max_abs_delta": 0.875 + }, + "bos_at_s1": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9898841879781998, + "source_mean_relative_l2": 0.14126913016662002, + "max_abs_delta": 0.984375 + }, + "x_at_s0": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9896609200311312, + "source_mean_relative_l2": 0.1444848789833486, + "max_abs_delta": 1.65625 + }, + "x_at_s1": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.984661516580166, + "source_mean_relative_l2": 0.17571741808205843, + "max_abs_delta": 1.8125 + }, + "period_at_s0": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9895275011416295, + "source_mean_relative_l2": 0.1453725416213274, + "max_abs_delta": 1.40625 + }, + "period_at_s1": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9845106013424613, + "source_mean_relative_l2": 0.17714062053710222, + "max_abs_delta": 1.5625 + } + }, + "layer_09": { + "system_eos": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9971079260556823, + "source_mean_relative_l2": 0.07105764513835311, + "max_abs_delta": 1.296875 + }, + "system_bos": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9950019388751078, + "source_mean_relative_l2": 0.09663280518725514, + "max_abs_delta": 1.65625 + }, + "system_x": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9909707909678979, + "source_mean_relative_l2": 0.1287030722014606, + "max_abs_delta": 1.875 + }, + "system_period": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9910515145814954, + "source_mean_relative_l2": 0.1298412261530757, + "max_abs_delta": 1.8125 + }, + "bos_at_s0": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9924058293706811, + "source_mean_relative_l2": 0.1217851648107171, + "max_abs_delta": 1.15625 + }, + "bos_at_s1": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9908176204874365, + "source_mean_relative_l2": 0.1330389860086143, + "max_abs_delta": 1.96875 + }, + "x_at_s0": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9906214988689261, + "source_mean_relative_l2": 0.13574171718209982, + "max_abs_delta": 2.0625 + }, + "x_at_s1": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9856630797190719, + "source_mean_relative_l2": 0.16735188383609056, + "max_abs_delta": 2.25 + }, + "period_at_s0": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.990560646520936, + "source_mean_relative_l2": 0.1366005023010075, + "max_abs_delta": 1.625 + }, + "period_at_s1": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9858082986219253, + "source_mean_relative_l2": 0.16744133923202753, + "max_abs_delta": 1.96875 + } + }, + "layer_10": { + "system_eos": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9966923841114702, + "source_mean_relative_l2": 0.07547172368504107, + "max_abs_delta": 1.75 + }, + "system_bos": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9943990580975117, + "source_mean_relative_l2": 0.10175536246970296, + "max_abs_delta": 1.84375 + }, + "system_x": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9899965980724615, + "source_mean_relative_l2": 0.13429195526987314, + "max_abs_delta": 2.265625 + }, + "system_period": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9902105037857358, + "source_mean_relative_l2": 0.13498050067573786, + "max_abs_delta": 2.296875 + }, + "bos_at_s0": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9917043754243199, + "source_mean_relative_l2": 0.1265001487918198, + "max_abs_delta": 1.4375 + }, + "bos_at_s1": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9900243535938399, + "source_mean_relative_l2": 0.1379852443933487, + "max_abs_delta": 1.75 + }, + "x_at_s0": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9895962426704328, + "source_mean_relative_l2": 0.14143533306196332, + "max_abs_delta": 2.40625 + }, + "x_at_s1": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9844063717045408, + "source_mean_relative_l2": 0.17393207643181086, + "max_abs_delta": 3.28125 + }, + "period_at_s0": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9897032802804538, + "source_mean_relative_l2": 0.14191102888435125, + "max_abs_delta": 2.1875 + }, + "period_at_s1": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9846719586003811, + "source_mean_relative_l2": 0.17404363863170147, + "max_abs_delta": 3.1875 + } + }, + "layer_11": { + "system_eos": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9969381400339775, + "source_mean_relative_l2": 0.07296121632680297, + "max_abs_delta": 1.875 + }, + "system_bos": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9951220515802764, + "source_mean_relative_l2": 0.09516267012804747, + "max_abs_delta": 2.25 + }, + "system_x": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9907366159525334, + "source_mean_relative_l2": 0.1278938027098775, + "max_abs_delta": 5.9375 + }, + "system_period": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9909482988817938, + "source_mean_relative_l2": 0.12909179087728262, + "max_abs_delta": 5.84375 + }, + "bos_at_s0": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9929384198294263, + "source_mean_relative_l2": 0.11521973181515932, + "max_abs_delta": 1.9375 + }, + "bos_at_s1": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9914110281596187, + "source_mean_relative_l2": 0.12632144195958972, + "max_abs_delta": 2.375 + }, + "x_at_s0": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9911314777608188, + "source_mean_relative_l2": 0.12941231625154614, + "max_abs_delta": 3.5 + }, + "x_at_s1": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.98641570225581, + "source_mean_relative_l2": 0.16075804829597473, + "max_abs_delta": 5.25 + }, + "period_at_s0": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9911595838909112, + "source_mean_relative_l2": 0.13030020659789443, + "max_abs_delta": 2.875 + }, + "period_at_s1": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9866424700852409, + "source_mean_relative_l2": 0.16121394699439406, + "max_abs_delta": 5.3125 + } + }, + "layer_12": { + "system_eos": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9963385728790765, + "source_mean_relative_l2": 0.07891326025128365, + "max_abs_delta": 1.71875 + }, + "system_bos": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9943868957251485, + "source_mean_relative_l2": 0.10157283348962665, + "max_abs_delta": 2.5625 + }, + "system_x": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9894831287604924, + "source_mean_relative_l2": 0.13532286463305354, + "max_abs_delta": 7.375 + }, + "system_period": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.98974432410865, + "source_mean_relative_l2": 0.13664561277255416, + "max_abs_delta": 7.03125 + }, + "bos_at_s0": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9920087038268497, + "source_mean_relative_l2": 0.12231476092711091, + "max_abs_delta": 3.0625 + }, + "bos_at_s1": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9903529083565915, + "source_mean_relative_l2": 0.13309124717488885, + "max_abs_delta": 2.75 + }, + "x_at_s0": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.989916208159559, + "source_mean_relative_l2": 0.1372022582218051, + "max_abs_delta": 4.8125 + }, + "x_at_s1": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9849228393977233, + "source_mean_relative_l2": 0.16919163055717945, + "max_abs_delta": 6.75 + }, + "period_at_s0": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9899704309353676, + "source_mean_relative_l2": 0.1380782425403595, + "max_abs_delta": 4.15625 + }, + "period_at_s1": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9851258467293903, + "source_mean_relative_l2": 0.17011642176657915, + "max_abs_delta": 6.78125 + } + }, + "layer_13": { + "system_eos": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9961696515706893, + "source_mean_relative_l2": 0.08070490043610334, + "max_abs_delta": 2.21875 + }, + "system_bos": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9941997341157247, + "source_mean_relative_l2": 0.10259270062670112, + "max_abs_delta": 2.5625 + }, + "system_x": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9891657818426307, + "source_mean_relative_l2": 0.13655134150758386, + "max_abs_delta": 5.4375 + }, + "system_period": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9895077488526324, + "source_mean_relative_l2": 0.13774158712476492, + "max_abs_delta": 5.484375 + }, + "bos_at_s0": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9918414746000926, + "source_mean_relative_l2": 0.12311934446915984, + "max_abs_delta": 3.1875 + }, + "bos_at_s1": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9902535940271426, + "source_mean_relative_l2": 0.13294092053547502, + "max_abs_delta": 4.21875 + }, + "x_at_s0": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9895561478629699, + "source_mean_relative_l2": 0.13809488527476788, + "max_abs_delta": 4.5625 + }, + "x_at_s1": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9848020629752512, + "source_mean_relative_l2": 0.16920572984963655, + "max_abs_delta": 5.25 + }, + "period_at_s0": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9897377157490519, + "source_mean_relative_l2": 0.13846481684595346, + "max_abs_delta": 5.15625 + }, + "period_at_s1": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9850540166949792, + "source_mean_relative_l2": 0.17014211136847734, + "max_abs_delta": 5.9375 + } + }, + "layer_14": { + "system_eos": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9960505612189691, + "source_mean_relative_l2": 0.08195926831103861, + "max_abs_delta": 2.0625 + }, + "system_bos": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.994281703726223, + "source_mean_relative_l2": 0.10208113910630345, + "max_abs_delta": 2.75 + }, + "system_x": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.989056746255444, + "source_mean_relative_l2": 0.13760423194617033, + "max_abs_delta": 6.4375 + }, + "system_period": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9892897145966857, + "source_mean_relative_l2": 0.1395717691630125, + "max_abs_delta": 5.6875 + }, + "bos_at_s0": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9920692522182973, + "source_mean_relative_l2": 0.12110459385439754, + "max_abs_delta": 3.0625 + }, + "bos_at_s1": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9905572459925749, + "source_mean_relative_l2": 0.1308679049834609, + "max_abs_delta": 3.375 + }, + "x_at_s0": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9898444432753126, + "source_mean_relative_l2": 0.1353558930568397, + "max_abs_delta": 4.28125 + }, + "x_at_s1": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9851722280236135, + "source_mean_relative_l2": 0.16702135559171438, + "max_abs_delta": 5.5625 + }, + "period_at_s0": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9899931244828442, + "source_mean_relative_l2": 0.13577316608279943, + "max_abs_delta": 5.1875 + }, + "period_at_s1": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9853125570575836, + "source_mean_relative_l2": 0.16862528678029776, + "max_abs_delta": 5.84375 + } + }, + "layer_15": { + "system_eos": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9959217394491877, + "source_mean_relative_l2": 0.08303570747375488, + "max_abs_delta": 2.375 + }, + "system_bos": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.994253098460553, + "source_mean_relative_l2": 0.10191086959093809, + "max_abs_delta": 2.75 + }, + "system_x": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9887929590553453, + "source_mean_relative_l2": 0.13958916626870632, + "max_abs_delta": 6.5 + }, + "system_period": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9890423821953108, + "source_mean_relative_l2": 0.1414533075876534, + "max_abs_delta": 6.125 + }, + "bos_at_s0": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9920807843015965, + "source_mean_relative_l2": 0.12005874095484614, + "max_abs_delta": 3.3125 + }, + "bos_at_s1": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9906467874095125, + "source_mean_relative_l2": 0.12960797222331166, + "max_abs_delta": 3.9375 + }, + "x_at_s0": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9899548817627136, + "source_mean_relative_l2": 0.1338134645484388, + "max_abs_delta": 4.25 + }, + "x_at_s1": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9852528750857674, + "source_mean_relative_l2": 0.1662092744372785, + "max_abs_delta": 5.875 + }, + "period_at_s0": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9900374315586972, + "source_mean_relative_l2": 0.1344242268241942, + "max_abs_delta": 4.625 + }, + "period_at_s1": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9852848308149994, + "source_mean_relative_l2": 0.1681548785418272, + "max_abs_delta": 6.46875 + } + }, + "layer_16": { + "system_eos": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9958026031821132, + "source_mean_relative_l2": 0.08420354872941971, + "max_abs_delta": 2.46875 + }, + "system_bos": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9941233933631212, + "source_mean_relative_l2": 0.10283792112022638, + "max_abs_delta": 3.6875 + }, + "system_x": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9884776922503926, + "source_mean_relative_l2": 0.14084367640316486, + "max_abs_delta": 7.5 + }, + "system_period": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9888618330173703, + "source_mean_relative_l2": 0.14244661526754498, + "max_abs_delta": 7.25 + }, + "bos_at_s0": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9919948737653882, + "source_mean_relative_l2": 0.12028177874162793, + "max_abs_delta": 3.25 + }, + "bos_at_s1": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9905522137240458, + "source_mean_relative_l2": 0.12959027662873268, + "max_abs_delta": 4.4296875 + }, + "x_at_s0": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9897977836192546, + "source_mean_relative_l2": 0.13414883241057396, + "max_abs_delta": 4.28125 + }, + "x_at_s1": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9851331300524511, + "source_mean_relative_l2": 0.16608077054843307, + "max_abs_delta": 6.25 + }, + "period_at_s0": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9899030202537988, + "source_mean_relative_l2": 0.13460144167765975, + "max_abs_delta": 4.3125 + }, + "period_at_s1": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9852509769279614, + "source_mean_relative_l2": 0.16798654524609447, + "max_abs_delta": 6.4375 + } + }, + "layer_17": { + "system_eos": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9960135465794441, + "source_mean_relative_l2": 0.08217688277363777, + "max_abs_delta": 2.5625 + }, + "system_bos": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9944117009911199, + "source_mean_relative_l2": 0.10046469513326883, + "max_abs_delta": 3.875 + }, + "system_x": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9890573364849128, + "source_mean_relative_l2": 0.13747553993016481, + "max_abs_delta": 7.78125 + }, + "system_period": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9894422549432024, + "source_mean_relative_l2": 0.13881344813853502, + "max_abs_delta": 6.0 + }, + "bos_at_s0": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9924716346048269, + "source_mean_relative_l2": 0.11645399266853929, + "max_abs_delta": 4.0 + }, + "bos_at_s1": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9910918136812606, + "source_mean_relative_l2": 0.12583672255277634, + "max_abs_delta": 4.9140625 + }, + "x_at_s0": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9903329377369828, + "source_mean_relative_l2": 0.1305353231728077, + "max_abs_delta": 4.75 + }, + "x_at_s1": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9860594003093499, + "source_mean_relative_l2": 0.1615998544730246, + "max_abs_delta": 6.53125 + }, + "period_at_s0": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9904399328442774, + "source_mean_relative_l2": 0.13083440531045198, + "max_abs_delta": 4.25 + }, + "period_at_s1": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9861871432234268, + "source_mean_relative_l2": 0.16316866362467408, + "max_abs_delta": 7.5 + } + }, + "layer_18": { + "system_eos": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.995988845902755, + "source_mean_relative_l2": 0.08214063243940473, + "max_abs_delta": 2.9375 + }, + "system_bos": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9945154444071559, + "source_mean_relative_l2": 0.09908437542617321, + "max_abs_delta": 4.625 + }, + "system_x": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9890297648964101, + "source_mean_relative_l2": 0.137291400693357, + "max_abs_delta": 9.5 + }, + "system_period": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9892772920890217, + "source_mean_relative_l2": 0.13932511024177074, + "max_abs_delta": 7.5 + }, + "bos_at_s0": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9926294501756955, + "source_mean_relative_l2": 0.11428670166060328, + "max_abs_delta": 4.3671875 + }, + "bos_at_s1": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.991184282434708, + "source_mean_relative_l2": 0.12451910367235541, + "max_abs_delta": 6.5703125 + }, + "x_at_s0": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9905130799202928, + "source_mean_relative_l2": 0.1281941719353199, + "max_abs_delta": 5.5 + }, + "x_at_s1": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9861804217429773, + "source_mean_relative_l2": 0.16022778488695621, + "max_abs_delta": 8.625 + }, + "period_at_s0": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.990607984436745, + "source_mean_relative_l2": 0.12857991131022573, + "max_abs_delta": 6.0 + }, + "period_at_s1": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9862177442558105, + "source_mean_relative_l2": 0.16224791901186109, + "max_abs_delta": 8.6875 + } + }, + "layer_19": { + "system_eos": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9958618525258116, + "source_mean_relative_l2": 0.08356876182369888, + "max_abs_delta": 4.3125 + }, + "system_bos": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9943937815158648, + "source_mean_relative_l2": 0.10056838346645236, + "max_abs_delta": 4.640625 + }, + "system_x": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9887662842898843, + "source_mean_relative_l2": 0.13902735663577914, + "max_abs_delta": 9.0 + }, + "system_period": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9891711986910312, + "source_mean_relative_l2": 0.14056314248591661, + "max_abs_delta": 7.25 + }, + "bos_at_s0": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9924766993708788, + "source_mean_relative_l2": 0.11606868589296937, + "max_abs_delta": 4.515625 + }, + "bos_at_s1": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9909968717034637, + "source_mean_relative_l2": 0.12577811861410737, + "max_abs_delta": 8.25 + }, + "x_at_s0": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.990344346306428, + "source_mean_relative_l2": 0.12993225222453475, + "max_abs_delta": 4.5625 + }, + "x_at_s1": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9858189701801318, + "source_mean_relative_l2": 0.16261915676295757, + "max_abs_delta": 8.125 + }, + "period_at_s0": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9904838290087341, + "source_mean_relative_l2": 0.13026659796014428, + "max_abs_delta": 6.25 + }, + "period_at_s1": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9860598866863536, + "source_mean_relative_l2": 0.1639427193440497, + "max_abs_delta": 9.75 + } + }, + "layer_20": { + "system_eos": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9959022400436575, + "source_mean_relative_l2": 0.0838350560516119, + "max_abs_delta": 6.4375 + }, + "system_bos": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.994575797425669, + "source_mean_relative_l2": 0.09960785415023565, + "max_abs_delta": 7.5625 + }, + "system_x": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9888663863546289, + "source_mean_relative_l2": 0.1401374926790595, + "max_abs_delta": 8.5 + }, + "system_period": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9890742379888436, + "source_mean_relative_l2": 0.14310038881376386, + "max_abs_delta": 7.375 + }, + "bos_at_s0": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9927070290916681, + "source_mean_relative_l2": 0.11401394521817565, + "max_abs_delta": 5.15625 + }, + "bos_at_s1": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9913093525244961, + "source_mean_relative_l2": 0.12396937888115644, + "max_abs_delta": 7.0703125 + }, + "x_at_s0": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9906660057773975, + "source_mean_relative_l2": 0.1280153263360262, + "max_abs_delta": 7.0 + }, + "x_at_s1": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9861356278247623, + "source_mean_relative_l2": 0.1620227205567062, + "max_abs_delta": 10.0625 + }, + "period_at_s0": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9908316717879991, + "source_mean_relative_l2": 0.12793055223301053, + "max_abs_delta": 6.5 + }, + "period_at_s1": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9862555542314836, + "source_mean_relative_l2": 0.16424277517944574, + "max_abs_delta": 10.0 + } + }, + "layer_21": { + "system_eos": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9954525232315063, + "source_mean_relative_l2": 0.08917711256071925, + "max_abs_delta": 6.25 + }, + "system_bos": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9941505370934287, + "source_mean_relative_l2": 0.10403220262378454, + "max_abs_delta": 6.875 + }, + "system_x": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9877016143358289, + "source_mean_relative_l2": 0.14937674580141902, + "max_abs_delta": 8.375 + }, + "system_period": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9877942779580726, + "source_mean_relative_l2": 0.15267642959952354, + "max_abs_delta": 7.25 + }, + "bos_at_s0": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9921452617521168, + "source_mean_relative_l2": 0.1183754033409059, + "max_abs_delta": 5.375 + }, + "bos_at_s1": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9907553524030984, + "source_mean_relative_l2": 0.12834413954988122, + "max_abs_delta": 7.3583984375 + }, + "x_at_s0": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9899953917085775, + "source_mean_relative_l2": 0.13280894793570042, + "max_abs_delta": 8.375 + }, + "x_at_s1": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9849942062067071, + "source_mean_relative_l2": 0.16988718276843429, + "max_abs_delta": 10.25 + }, + "period_at_s0": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9901581769960611, + "source_mean_relative_l2": 0.13237037044018507, + "max_abs_delta": 8.0 + }, + "period_at_s1": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9851655210468314, + "source_mean_relative_l2": 0.17159152682870626, + "max_abs_delta": 12.0 + } + }, + "layer_22": { + "system_eos": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9952690807269934, + "source_mean_relative_l2": 0.08997178031131625, + "max_abs_delta": 10.375 + }, + "system_bos": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9939644304125357, + "source_mean_relative_l2": 0.10505827376618981, + "max_abs_delta": 11.1875 + }, + "system_x": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9874797748836822, + "source_mean_relative_l2": 0.15085909282788634, + "max_abs_delta": 9.25 + }, + "system_period": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9874594717655542, + "source_mean_relative_l2": 0.15457809250801802, + "max_abs_delta": 8.5 + }, + "bos_at_s0": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9918372711347309, + "source_mean_relative_l2": 0.11890412913635373, + "max_abs_delta": 6.0 + }, + "bos_at_s1": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9905285162823342, + "source_mean_relative_l2": 0.12840275280177593, + "max_abs_delta": 8.75 + }, + "x_at_s0": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9898093298572026, + "source_mean_relative_l2": 0.13281093025580049, + "max_abs_delta": 9.375 + }, + "x_at_s1": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.984825845965334, + "source_mean_relative_l2": 0.17013862449675798, + "max_abs_delta": 16.375 + }, + "period_at_s0": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9899658100048132, + "source_mean_relative_l2": 0.13250939780846238, + "max_abs_delta": 9.75 + }, + "period_at_s1": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9849589154870773, + "source_mean_relative_l2": 0.1720419297926128, + "max_abs_delta": 14.875 + } + }, + "layer_23": { + "system_eos": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9957798085355417, + "source_mean_relative_l2": 0.08500573574565351, + "max_abs_delta": 11.0 + }, + "system_bos": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9945515960396771, + "source_mean_relative_l2": 0.09907629783265293, + "max_abs_delta": 13.0 + }, + "system_x": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.989057035669539, + "source_mean_relative_l2": 0.14142292411997914, + "max_abs_delta": 12.625 + }, + "system_period": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9888993718830423, + "source_mean_relative_l2": 0.14484320161864161, + "max_abs_delta": 13.5 + }, + "bos_at_s0": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9925004018151923, + "source_mean_relative_l2": 0.11235564248636365, + "max_abs_delta": 9.8125 + }, + "bos_at_s1": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9918078541678117, + "source_mean_relative_l2": 0.11986028775572777, + "max_abs_delta": 14.8125 + }, + "x_at_s0": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9911148698979876, + "source_mean_relative_l2": 0.12408364657312632, + "max_abs_delta": 14.0 + }, + "x_at_s1": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9868230607576315, + "source_mean_relative_l2": 0.15913673862814903, + "max_abs_delta": 14.5 + }, + "period_at_s0": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9912239337169123, + "source_mean_relative_l2": 0.12398684304207563, + "max_abs_delta": 12.5 + }, + "period_at_s1": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9868503496409549, + "source_mean_relative_l2": 0.16081331530585885, + "max_abs_delta": 18.25 + } + }, + "layer_24": { + "system_eos": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.995608764068601, + "source_mean_relative_l2": 0.07959229638800025, + "max_abs_delta": 336.8359375 + }, + "system_bos": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9949187377325963, + "source_mean_relative_l2": 0.09368397342041135, + "max_abs_delta": 536.9375 + }, + "system_x": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9896389956433973, + "source_mean_relative_l2": 0.13531467784196138, + "max_abs_delta": 509.0 + }, + "system_period": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9894277875347423, + "source_mean_relative_l2": 0.1382684507407248, + "max_abs_delta": 503.21875 + }, + "bos_at_s0": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9925661708289489, + "source_mean_relative_l2": 0.11576898698695004, + "max_abs_delta": 542.53125 + }, + "bos_at_s1": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9927823700219218, + "source_mean_relative_l2": 0.11138605140149593, + "max_abs_delta": 58.0 + }, + "x_at_s0": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9917528756888718, + "source_mean_relative_l2": 0.11558779142796993, + "max_abs_delta": 336.828125 + }, + "x_at_s1": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.98772665511189, + "source_mean_relative_l2": 0.15182778192684054, + "max_abs_delta": 508.3125 + }, + "period_at_s0": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9916742700373266, + "source_mean_relative_l2": 0.11640575202181935, + "max_abs_delta": 336.765625 + }, + "period_at_s1": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9877277420725851, + "source_mean_relative_l2": 0.15351457288488746, + "max_abs_delta": 502.3125 + } + }, + "layer_25": { + "system_eos": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9965445137908107, + "source_mean_relative_l2": 0.06958195590414107, + "max_abs_delta": 338.359375 + }, + "system_bos": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9960013827334462, + "source_mean_relative_l2": 0.0817512848880142, + "max_abs_delta": 542.34375 + }, + "system_x": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9918477306834428, + "source_mean_relative_l2": 0.11801284598186612, + "max_abs_delta": 514.421875 + }, + "system_period": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9917068674569015, + "source_mean_relative_l2": 0.12029860401526093, + "max_abs_delta": 508.90625 + }, + "bos_at_s0": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.994345393131209, + "source_mean_relative_l2": 0.09666740242391825, + "max_abs_delta": 547.6875 + }, + "bos_at_s1": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9948858311599776, + "source_mean_relative_l2": 0.09530238364823163, + "max_abs_delta": 58.0 + }, + "x_at_s0": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.993960324129503, + "source_mean_relative_l2": 0.09886522917076945, + "max_abs_delta": 338.3671875 + }, + "x_at_s1": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9907389262626911, + "source_mean_relative_l2": 0.13018729304894805, + "max_abs_delta": 513.078125 + }, + "period_at_s0": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9939006833806779, + "source_mean_relative_l2": 0.09944069408811629, + "max_abs_delta": 338.28125 + }, + "period_at_s1": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9907616865115269, + "source_mean_relative_l2": 0.1313898889347911, + "max_abs_delta": 507.078125 + } + }, + "layer_26": { + "system_eos": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9965245394095555, + "source_mean_relative_l2": 0.07579565513879061, + "max_abs_delta": 60.25 + }, + "system_bos": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9955047235600578, + "source_mean_relative_l2": 0.08790485421195626, + "max_abs_delta": 74.5 + }, + "system_x": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.990289631763215, + "source_mean_relative_l2": 0.1377094043418765, + "max_abs_delta": 57.0 + }, + "system_period": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9902793217108633, + "source_mean_relative_l2": 0.14080877183005214, + "max_abs_delta": 64.25 + }, + "bos_at_s0": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9948390861494477, + "source_mean_relative_l2": 0.09100685967132449, + "max_abs_delta": 66.5 + }, + "bos_at_s1": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.994685711144005, + "source_mean_relative_l2": 0.09948121523484588, + "max_abs_delta": 74.5 + }, + "x_at_s0": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9943997008349109, + "source_mean_relative_l2": 0.09856285154819489, + "max_abs_delta": 68.25 + }, + "x_at_s1": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9902665031444895, + "source_mean_relative_l2": 0.1390487770549953, + "max_abs_delta": 63.5 + }, + "period_at_s0": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.994291977441846, + "source_mean_relative_l2": 0.09839509148150682, + "max_abs_delta": 64.5 + }, + "period_at_s1": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.990635792970192, + "source_mean_relative_l2": 0.14024129882454872, + "max_abs_delta": 88.0 + } + }, + "final_norm": { + "system_eos": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9953002745870964, + "source_mean_relative_l2": 0.08473945129662752, + "max_abs_delta": 6.92578125 + }, + "system_bos": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9944039278008678, + "source_mean_relative_l2": 0.0961449178867042, + "max_abs_delta": 4.4375 + }, + "system_x": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9877148998504967, + "source_mean_relative_l2": 0.14813534216955304, + "max_abs_delta": 7.46875 + }, + "system_period": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9874725330938514, + "source_mean_relative_l2": 0.1523011322133243, + "max_abs_delta": 6.984375 + }, + "bos_at_s0": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9932140656780251, + "source_mean_relative_l2": 0.10376310441643, + "max_abs_delta": 7.55078125 + }, + "bos_at_s1": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9930446012189191, + "source_mean_relative_l2": 0.11122636962682009, + "max_abs_delta": 8.625 + }, + "x_at_s0": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9925193790886878, + "source_mean_relative_l2": 0.11333498079329729, + "max_abs_delta": 8.15625 + }, + "x_at_s1": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9870622614101691, + "source_mean_relative_l2": 0.1569378967396915, + "max_abs_delta": 4.859375 + }, + "period_at_s0": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9925206691782895, + "source_mean_relative_l2": 0.11367968819104135, + "max_abs_delta": 8.171875 + }, + "period_at_s1": { + "sources": 16, + "tokens": 1537, + "exact_hidden_rows": 0, + "token_weighted_mean_cosine_similarity": 0.9875410248803566, + "source_mean_relative_l2": 0.15810229536145926, + "max_abs_delta": 4.65625 + } + } + }, + "routes": { + "layer_01": { + "system_eos": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 1051, + "set_exact_tokens": 1179, + "token_weighted_mean_set_jaccard": 0.9299811010936582, + "source_mean_token_weighted_tv": 0.011249926180288656, + "source_mean_aggregate_load_tv": 0.03670251765719302 + }, + "system_bos": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 859, + "set_exact_tokens": 1034, + "token_weighted_mean_set_jaccard": 0.9005019053815413, + "source_mean_token_weighted_tv": 0.016074599835792475, + "source_mean_aggregate_load_tv": 0.04832418406407723 + }, + "system_x": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 826, + "set_exact_tokens": 999, + "token_weighted_mean_set_jaccard": 0.891966415713976, + "source_mean_token_weighted_tv": 0.018751724843809103, + "source_mean_aggregate_load_tv": 0.05609844993581721 + }, + "system_period": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 829, + "set_exact_tokens": 1006, + "token_weighted_mean_set_jaccard": 0.8935464882114198, + "source_mean_token_weighted_tv": 0.018303350693876234, + "source_mean_aggregate_load_tv": 0.053960613181719436 + }, + "bos_at_s0": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 646, + "set_exact_tokens": 840, + "token_weighted_mean_set_jaccard": 0.8476004585308424, + "source_mean_token_weighted_tv": 0.028301049866100478, + "source_mean_aggregate_load_tv": 0.07973784976827858 + }, + "bos_at_s1": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 629, + "set_exact_tokens": 798, + "token_weighted_mean_set_jaccard": 0.8426433683427828, + "source_mean_token_weighted_tv": 0.028436056012126548, + "source_mean_aggregate_load_tv": 0.08336380853020339 + }, + "x_at_s0": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 695, + "set_exact_tokens": 876, + "token_weighted_mean_set_jaccard": 0.858583511478762, + "source_mean_token_weighted_tv": 0.025354109292542466, + "source_mean_aggregate_load_tv": 0.07274003618994834 + }, + "x_at_s1": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 644, + "set_exact_tokens": 810, + "token_weighted_mean_set_jaccard": 0.8461133314744245, + "source_mean_token_weighted_tv": 0.02843186556733575, + "source_mean_aggregate_load_tv": 0.08266480695583901 + }, + "period_at_s0": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 707, + "set_exact_tokens": 888, + "token_weighted_mean_set_jaccard": 0.8597298385847506, + "source_mean_token_weighted_tv": 0.025262315880045853, + "source_mean_aggregate_load_tv": 0.07275855638233324 + }, + "period_at_s1": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 641, + "set_exact_tokens": 811, + "token_weighted_mean_set_jaccard": 0.8470892586051988, + "source_mean_token_weighted_tv": 0.02821337037240353, + "source_mean_aggregate_load_tv": 0.08240120120956554 + } + }, + "layer_02": { + "system_eos": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 1130, + "set_exact_tokens": 1265, + "token_weighted_mean_set_jaccard": 0.9484927347646931, + "source_mean_token_weighted_tv": 0.010742563571886571, + "source_mean_aggregate_load_tv": 0.02502592192671146 + }, + "system_bos": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 946, + "set_exact_tokens": 1138, + "token_weighted_mean_set_jaccard": 0.9227933203209717, + "source_mean_token_weighted_tv": 0.017421457082468457, + "source_mean_aggregate_load_tv": 0.03390538344066165 + }, + "system_x": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 902, + "set_exact_tokens": 1097, + "token_weighted_mean_set_jaccard": 0.9143662670012703, + "source_mean_token_weighted_tv": 0.019542182226957944, + "source_mean_aggregate_load_tv": 0.038815912684124786 + }, + "system_period": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 896, + "set_exact_tokens": 1094, + "token_weighted_mean_set_jaccard": 0.9137311398209251, + "source_mean_token_weighted_tv": 0.020238939644011272, + "source_mean_aggregate_load_tv": 0.04231286705581256 + }, + "bos_at_s0": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 718, + "set_exact_tokens": 928, + "token_weighted_mean_set_jaccard": 0.876150199832698, + "source_mean_token_weighted_tv": 0.027644492576563654, + "source_mean_aggregate_load_tv": 0.051470170798457414 + }, + "bos_at_s1": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 717, + "set_exact_tokens": 930, + "token_weighted_mean_set_jaccard": 0.8787216903677542, + "source_mean_token_weighted_tv": 0.027796439077860398, + "source_mean_aggregate_load_tv": 0.05282745686008174 + }, + "x_at_s0": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 730, + "set_exact_tokens": 941, + "token_weighted_mean_set_jaccard": 0.8807974718840041, + "source_mean_token_weighted_tv": 0.026915455656915742, + "source_mean_aggregate_load_tv": 0.05207202027136524 + }, + "x_at_s1": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 721, + "set_exact_tokens": 933, + "token_weighted_mean_set_jaccard": 0.8794497629891255, + "source_mean_token_weighted_tv": 0.02877742215713689, + "source_mean_aggregate_load_tv": 0.054791045030037566 + }, + "period_at_s0": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 747, + "set_exact_tokens": 951, + "token_weighted_mean_set_jaccard": 0.8815720172258883, + "source_mean_token_weighted_tv": 0.026615304367816076, + "source_mean_aggregate_load_tv": 0.051943280978636236 + }, + "period_at_s1": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 721, + "set_exact_tokens": 928, + "token_weighted_mean_set_jaccard": 0.8790469994113453, + "source_mean_token_weighted_tv": 0.028851513014984037, + "source_mean_aggregate_load_tv": 0.05504115757341841 + } + }, + "layer_03": { + "system_eos": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 1221, + "set_exact_tokens": 1331, + "token_weighted_mean_set_jaccard": 0.961288223812622, + "source_mean_token_weighted_tv": 0.009040952053494141, + "source_mean_aggregate_load_tv": 0.018555566236889004 + }, + "system_bos": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 1028, + "set_exact_tokens": 1181, + "token_weighted_mean_set_jaccard": 0.9325680825355517, + "source_mean_token_weighted_tv": 0.01583038489832135, + "source_mean_aggregate_load_tv": 0.02984544214425355 + }, + "system_x": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 967, + "set_exact_tokens": 1136, + "token_weighted_mean_set_jaccard": 0.9235059020355054, + "source_mean_token_weighted_tv": 0.018731231904945363, + "source_mean_aggregate_load_tv": 0.03298280865684854 + }, + "system_period": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 980, + "set_exact_tokens": 1142, + "token_weighted_mean_set_jaccard": 0.9246212473278186, + "source_mean_token_weighted_tv": 0.01839802386984429, + "source_mean_aggregate_load_tv": 0.03398715532956604 + }, + "bos_at_s0": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 852, + "set_exact_tokens": 1045, + "token_weighted_mean_set_jaccard": 0.9054744864764382, + "source_mean_token_weighted_tv": 0.024243688884171166, + "source_mean_aggregate_load_tv": 0.040835586509260745 + }, + "bos_at_s1": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 790, + "set_exact_tokens": 984, + "token_weighted_mean_set_jaccard": 0.894135142671252, + "source_mean_token_weighted_tv": 0.025892070609476698, + "source_mean_aggregate_load_tv": 0.04314318162254377 + }, + "x_at_s0": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 867, + "set_exact_tokens": 1053, + "token_weighted_mean_set_jaccard": 0.9068221953713168, + "source_mean_token_weighted_tv": 0.023964068789937704, + "source_mean_aggregate_load_tv": 0.04184601758380807 + }, + "x_at_s1": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 800, + "set_exact_tokens": 982, + "token_weighted_mean_set_jaccard": 0.8923691792917556, + "source_mean_token_weighted_tv": 0.027195898545160423, + "source_mean_aggregate_load_tv": 0.04236425235151339 + }, + "period_at_s0": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 887, + "set_exact_tokens": 1063, + "token_weighted_mean_set_jaccard": 0.9085416860303002, + "source_mean_token_weighted_tv": 0.023382361183824255, + "source_mean_aggregate_load_tv": 0.039419884836808174 + }, + "period_at_s1": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 803, + "set_exact_tokens": 986, + "token_weighted_mean_set_jaccard": 0.8919819066208137, + "source_mean_token_weighted_tv": 0.027359608744659418, + "source_mean_aggregate_load_tv": 0.04369452097746564 + } + }, + "layer_04": { + "system_eos": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 1228, + "set_exact_tokens": 1353, + "token_weighted_mean_set_jaccard": 0.9653778232177713, + "source_mean_token_weighted_tv": 0.008654591025436543, + "source_mean_aggregate_load_tv": 0.01789895910877534 + }, + "system_bos": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 1060, + "set_exact_tokens": 1218, + "token_weighted_mean_set_jaccard": 0.9388883725253275, + "source_mean_token_weighted_tv": 0.015393865140490723, + "source_mean_aggregate_load_tv": 0.02984604123344008 + }, + "system_x": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 992, + "set_exact_tokens": 1170, + "token_weighted_mean_set_jaccard": 0.9290206648697215, + "source_mean_token_weighted_tv": 0.01877819007080155, + "source_mean_aggregate_load_tv": 0.036299206002557045 + }, + "system_period": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 991, + "set_exact_tokens": 1157, + "token_weighted_mean_set_jaccard": 0.9270533197013354, + "source_mean_token_weighted_tv": 0.018825190473306507, + "source_mean_aggregate_load_tv": 0.03704265904328575 + }, + "bos_at_s0": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 886, + "set_exact_tokens": 1093, + "token_weighted_mean_set_jaccard": 0.9149549214611022, + "source_mean_token_weighted_tv": 0.022016210258004643, + "source_mean_aggregate_load_tv": 0.03689655594882009 + }, + "bos_at_s1": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 809, + "set_exact_tokens": 1024, + "token_weighted_mean_set_jaccard": 0.9014313597918022, + "source_mean_token_weighted_tv": 0.025611694903799664, + "source_mean_aggregate_load_tv": 0.04628600629838937 + }, + "x_at_s0": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 907, + "set_exact_tokens": 1106, + "token_weighted_mean_set_jaccard": 0.9172320847662425, + "source_mean_token_weighted_tv": 0.02310491674958684, + "source_mean_aggregate_load_tv": 0.040274380154434866 + }, + "x_at_s1": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 792, + "set_exact_tokens": 987, + "token_weighted_mean_set_jaccard": 0.8934380518635562, + "source_mean_token_weighted_tv": 0.028902006683415075, + "source_mean_aggregate_load_tv": 0.05329845453294438 + }, + "period_at_s0": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 892, + "set_exact_tokens": 1092, + "token_weighted_mean_set_jaccard": 0.9144901942559718, + "source_mean_token_weighted_tv": 0.023341507263199456, + "source_mean_aggregate_load_tv": 0.04226227418547699 + }, + "period_at_s1": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 783, + "set_exact_tokens": 980, + "token_weighted_mean_set_jaccard": 0.8922762338507294, + "source_mean_token_weighted_tv": 0.029144952449752768, + "source_mean_aggregate_load_tv": 0.053151757121584646 + } + }, + "layer_05": { + "system_eos": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 1208, + "set_exact_tokens": 1336, + "token_weighted_mean_set_jaccard": 0.962078260061344, + "source_mean_token_weighted_tv": 0.009569958323105877, + "source_mean_aggregate_load_tv": 0.0192001007774026 + }, + "system_bos": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 1042, + "set_exact_tokens": 1201, + "token_weighted_mean_set_jaccard": 0.9360070638535181, + "source_mean_token_weighted_tv": 0.015718072748287206, + "source_mean_aggregate_load_tv": 0.029106350348584525 + }, + "system_x": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 961, + "set_exact_tokens": 1145, + "token_weighted_mean_set_jaccard": 0.9252099017876506, + "source_mean_token_weighted_tv": 0.019248309235809807, + "source_mean_aggregate_load_tv": 0.03399281789973051 + }, + "system_period": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 955, + "set_exact_tokens": 1128, + "token_weighted_mean_set_jaccard": 0.9218793568175483, + "source_mean_token_weighted_tv": 0.020018341779837894, + "source_mean_aggregate_load_tv": 0.03585022050074503 + }, + "bos_at_s0": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 885, + "set_exact_tokens": 1086, + "token_weighted_mean_set_jaccard": 0.9124299036465593, + "source_mean_token_weighted_tv": 0.022489087713130563, + "source_mean_aggregate_load_tv": 0.036993573163388575 + }, + "bos_at_s1": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 834, + "set_exact_tokens": 1055, + "token_weighted_mean_set_jaccard": 0.9074728134585, + "source_mean_token_weighted_tv": 0.024688092537298992, + "source_mean_aggregate_load_tv": 0.039827253489987585 + }, + "x_at_s0": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 880, + "set_exact_tokens": 1096, + "token_weighted_mean_set_jaccard": 0.914288812467082, + "source_mean_token_weighted_tv": 0.022998452694965543, + "source_mean_aggregate_load_tv": 0.037302606473703245 + }, + "x_at_s1": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 809, + "set_exact_tokens": 1006, + "token_weighted_mean_set_jaccard": 0.8954208879387802, + "source_mean_token_weighted_tv": 0.027664900514590664, + "source_mean_aggregate_load_tv": 0.044096166845529014 + }, + "period_at_s0": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 883, + "set_exact_tokens": 1095, + "token_weighted_mean_set_jaccard": 0.9141339033987049, + "source_mean_token_weighted_tv": 0.02292789212211361, + "source_mean_aggregate_load_tv": 0.03818079005790098 + }, + "period_at_s1": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 802, + "set_exact_tokens": 1001, + "token_weighted_mean_set_jaccard": 0.8942900517396289, + "source_mean_token_weighted_tv": 0.028352535430366782, + "source_mean_aggregate_load_tv": 0.04665361650526172 + } + }, + "layer_06": { + "system_eos": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 1203, + "set_exact_tokens": 1316, + "token_weighted_mean_set_jaccard": 0.9584998605818384, + "source_mean_token_weighted_tv": 0.010558898963902684, + "source_mean_aggregate_load_tv": 0.020779777579280314 + }, + "system_bos": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 1025, + "set_exact_tokens": 1199, + "token_weighted_mean_set_jaccard": 0.9357747002509527, + "source_mean_token_weighted_tv": 0.016079513011898854, + "source_mean_aggregate_load_tv": 0.030417132026196964 + }, + "system_x": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 952, + "set_exact_tokens": 1151, + "token_weighted_mean_set_jaccard": 0.9257365926201319, + "source_mean_token_weighted_tv": 0.019067212386159688, + "source_mean_aggregate_load_tv": 0.0334447617293746 + }, + "system_period": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 958, + "set_exact_tokens": 1150, + "token_weighted_mean_set_jaccard": 0.9251634290671376, + "source_mean_token_weighted_tv": 0.019382337979483372, + "source_mean_aggregate_load_tv": 0.032594681534014285 + }, + "bos_at_s0": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 886, + "set_exact_tokens": 1102, + "token_weighted_mean_set_jaccard": 0.9167673575611115, + "source_mean_token_weighted_tv": 0.022119315432437326, + "source_mean_aggregate_load_tv": 0.037864718743131486 + }, + "bos_at_s1": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 859, + "set_exact_tokens": 1067, + "token_weighted_mean_set_jaccard": 0.9092852495585092, + "source_mean_token_weighted_tv": 0.023212663962101098, + "source_mean_aggregate_load_tv": 0.038748243178779 + }, + "x_at_s0": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 880, + "set_exact_tokens": 1099, + "token_weighted_mean_set_jaccard": 0.9156520122687982, + "source_mean_token_weighted_tv": 0.023177302340740016, + "source_mean_aggregate_load_tv": 0.04174895788345431 + }, + "x_at_s1": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 797, + "set_exact_tokens": 1016, + "token_weighted_mean_set_jaccard": 0.8993865600892275, + "source_mean_token_weighted_tv": 0.027334693396407272, + "source_mean_aggregate_load_tv": 0.04720595147498408 + }, + "period_at_s0": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 878, + "set_exact_tokens": 1082, + "token_weighted_mean_set_jaccard": 0.9120736127892927, + "source_mean_token_weighted_tv": 0.023462609431960057, + "source_mean_aggregate_load_tv": 0.04185591627983001 + }, + "period_at_s1": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 800, + "set_exact_tokens": 1011, + "token_weighted_mean_set_jaccard": 0.8983176875174274, + "source_mean_token_weighted_tv": 0.02717141627869886, + "source_mean_aggregate_load_tv": 0.046601918408095 + } + }, + "layer_07": { + "system_eos": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 1142, + "set_exact_tokens": 1306, + "token_weighted_mean_set_jaccard": 0.9566409517613161, + "source_mean_token_weighted_tv": 0.011289585623603573, + "source_mean_aggregate_load_tv": 0.02213596615147395 + }, + "system_bos": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 1005, + "set_exact_tokens": 1197, + "token_weighted_mean_set_jaccard": 0.9351240821637701, + "source_mean_token_weighted_tv": 0.01716776921345759, + "source_mean_aggregate_load_tv": 0.03067944888126328 + }, + "system_x": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 910, + "set_exact_tokens": 1128, + "token_weighted_mean_set_jaccard": 0.9215757350435296, + "source_mean_token_weighted_tv": 0.021458783229618805, + "source_mean_aggregate_load_tv": 0.03713857926618528 + }, + "system_period": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 906, + "set_exact_tokens": 1119, + "token_weighted_mean_set_jaccard": 0.9201815534281378, + "source_mean_token_weighted_tv": 0.02292982568321313, + "source_mean_aggregate_load_tv": 0.03758170699303984 + }, + "bos_at_s0": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 901, + "set_exact_tokens": 1100, + "token_weighted_mean_set_jaccard": 0.91517179415683, + "source_mean_token_weighted_tv": 0.022656454762253045, + "source_mean_aggregate_load_tv": 0.041494431401472465 + }, + "bos_at_s1": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 841, + "set_exact_tokens": 1061, + "token_weighted_mean_set_jaccard": 0.905644886451653, + "source_mean_token_weighted_tv": 0.02481206951405236, + "source_mean_aggregate_load_tv": 0.04281897719300777 + }, + "x_at_s0": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 874, + "set_exact_tokens": 1067, + "token_weighted_mean_set_jaccard": 0.9079220497567928, + "source_mean_token_weighted_tv": 0.025582174587481514, + "source_mean_aggregate_load_tv": 0.04414256680518691 + }, + "x_at_s1": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 773, + "set_exact_tokens": 986, + "token_weighted_mean_set_jaccard": 0.8880905908231866, + "source_mean_token_weighted_tv": 0.030348595656053693, + "source_mean_aggregate_load_tv": 0.0501393135556353 + }, + "period_at_s0": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 884, + "set_exact_tokens": 1075, + "token_weighted_mean_set_jaccard": 0.9081389224525204, + "source_mean_token_weighted_tv": 0.02578205982798794, + "source_mean_aggregate_load_tv": 0.044891585356105906 + }, + "period_at_s1": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 765, + "set_exact_tokens": 1000, + "token_weighted_mean_set_jaccard": 0.8923134120271398, + "source_mean_token_weighted_tv": 0.029897704336317908, + "source_mean_aggregate_load_tv": 0.04868773165847369 + } + }, + "layer_08": { + "system_eos": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 1128, + "set_exact_tokens": 1279, + "token_weighted_mean_set_jaccard": 0.9509248071382099, + "source_mean_token_weighted_tv": 0.012054591210469784, + "source_mean_aggregate_load_tv": 0.023302364908301402 + }, + "system_bos": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 1007, + "set_exact_tokens": 1188, + "token_weighted_mean_set_jaccard": 0.9325061189082007, + "source_mean_token_weighted_tv": 0.016348323122452744, + "source_mean_aggregate_load_tv": 0.030226786693617266 + }, + "system_x": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 913, + "set_exact_tokens": 1108, + "token_weighted_mean_set_jaccard": 0.9172292682377262, + "source_mean_token_weighted_tv": 0.020649512653173135, + "source_mean_aggregate_load_tv": 0.035456821164059446 + }, + "system_period": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 901, + "set_exact_tokens": 1091, + "token_weighted_mean_set_jaccard": 0.9137593051060845, + "source_mean_token_weighted_tv": 0.02240886246702317, + "source_mean_aggregate_load_tv": 0.04212730113579183 + }, + "bos_at_s0": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 917, + "set_exact_tokens": 1106, + "token_weighted_mean_set_jaccard": 0.9168138302816248, + "source_mean_token_weighted_tv": 0.021496876962131928, + "source_mean_aggregate_load_tv": 0.03669762916968094 + }, + "bos_at_s1": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 850, + "set_exact_tokens": 1068, + "token_weighted_mean_set_jaccard": 0.9078600861294421, + "source_mean_token_weighted_tv": 0.022642312490641185, + "source_mean_aggregate_load_tv": 0.040939461485221706 + }, + "x_at_s0": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 861, + "set_exact_tokens": 1068, + "token_weighted_mean_set_jaccard": 0.9089134677944049, + "source_mean_token_weighted_tv": 0.024681358851677195, + "source_mean_aggregate_load_tv": 0.04290167479365357 + }, + "x_at_s1": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 768, + "set_exact_tokens": 1004, + "token_weighted_mean_set_jaccard": 0.8952228859841092, + "source_mean_token_weighted_tv": 0.028067847457445488, + "source_mean_aggregate_load_tv": 0.050016680899389196 + }, + "period_at_s0": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 862, + "set_exact_tokens": 1069, + "token_weighted_mean_set_jaccard": 0.908262849707222, + "source_mean_token_weighted_tv": 0.024750174654811552, + "source_mean_aggregate_load_tv": 0.045092428063890584 + }, + "period_at_s1": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 758, + "set_exact_tokens": 997, + "token_weighted_mean_set_jaccard": 0.8955636859345384, + "source_mean_token_weighted_tv": 0.027351098760140816, + "source_mean_aggregate_load_tv": 0.0475174608652097 + } + }, + "layer_09": { + "system_eos": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 1114, + "set_exact_tokens": 1279, + "token_weighted_mean_set_jaccard": 0.9514824797843666, + "source_mean_token_weighted_tv": 0.012398783399025596, + "source_mean_aggregate_load_tv": 0.026902681771784755 + }, + "system_bos": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 1004, + "set_exact_tokens": 1178, + "token_weighted_mean_set_jaccard": 0.9322892462124733, + "source_mean_token_weighted_tv": 0.017294838370005193, + "source_mean_aggregate_load_tv": 0.032098456976488055 + }, + "system_x": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 851, + "set_exact_tokens": 1088, + "token_weighted_mean_set_jaccard": 0.9123276636614306, + "source_mean_token_weighted_tv": 0.02197673857597916, + "source_mean_aggregate_load_tv": 0.03905954484495132 + }, + "system_period": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 859, + "set_exact_tokens": 1087, + "token_weighted_mean_set_jaccard": 0.9124890507453941, + "source_mean_token_weighted_tv": 0.021957376860038822, + "source_mean_aggregate_load_tv": 0.03950568908216403 + }, + "bos_at_s0": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 874, + "set_exact_tokens": 1084, + "token_weighted_mean_set_jaccard": 0.9130030671995539, + "source_mean_token_weighted_tv": 0.02164115825958039, + "source_mean_aggregate_load_tv": 0.041092933950549956 + }, + "bos_at_s1": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 834, + "set_exact_tokens": 1036, + "token_weighted_mean_set_jaccard": 0.9022988505747126, + "source_mean_token_weighted_tv": 0.023487768001056127, + "source_mean_aggregate_load_tv": 0.04148669019942916 + }, + "x_at_s0": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 837, + "set_exact_tokens": 1054, + "token_weighted_mean_set_jaccard": 0.9065123772345635, + "source_mean_token_weighted_tv": 0.02398733413509449, + "source_mean_aggregate_load_tv": 0.04371394345495313 + }, + "x_at_s1": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 741, + "set_exact_tokens": 951, + "token_weighted_mean_set_jaccard": 0.8826070914554974, + "source_mean_token_weighted_tv": 0.029586217234967505, + "source_mean_aggregate_load_tv": 0.049074857471432434 + }, + "period_at_s0": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 835, + "set_exact_tokens": 1055, + "token_weighted_mean_set_jaccard": 0.9060011773089196, + "source_mean_token_weighted_tv": 0.024215596424442203, + "source_mean_aggregate_load_tv": 0.04368912425679965 + }, + "period_at_s1": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 742, + "set_exact_tokens": 969, + "token_weighted_mean_set_jaccard": 0.8872078907862905, + "source_mean_token_weighted_tv": 0.02862950872100726, + "source_mean_aggregate_load_tv": 0.04579333608817779 + } + }, + "layer_10": { + "system_eos": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 1107, + "set_exact_tokens": 1260, + "token_weighted_mean_set_jaccard": 0.9473928803792174, + "source_mean_token_weighted_tv": 0.012218733600283185, + "source_mean_aggregate_load_tv": 0.02388891350026624 + }, + "system_bos": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 984, + "set_exact_tokens": 1178, + "token_weighted_mean_set_jaccard": 0.930678191901354, + "source_mean_token_weighted_tv": 0.01728675614880697, + "source_mean_aggregate_load_tv": 0.027552565370264168 + }, + "system_x": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 831, + "set_exact_tokens": 1052, + "token_weighted_mean_set_jaccard": 0.9039408866995076, + "source_mean_token_weighted_tv": 0.023709640984163564, + "source_mean_aggregate_load_tv": 0.038919017317636716 + }, + "system_period": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 851, + "set_exact_tokens": 1070, + "token_weighted_mean_set_jaccard": 0.9087895405397032, + "source_mean_token_weighted_tv": 0.022936704817994598, + "source_mean_aggregate_load_tv": 0.04078097785405086 + }, + "bos_at_s0": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 879, + "set_exact_tokens": 1091, + "token_weighted_mean_set_jaccard": 0.9128016854106639, + "source_mean_token_weighted_tv": 0.02207349912149757, + "source_mean_aggregate_load_tv": 0.03652217232188096 + }, + "bos_at_s1": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 846, + "set_exact_tokens": 1056, + "token_weighted_mean_set_jaccard": 0.9052111410601975, + "source_mean_token_weighted_tv": 0.02408938816168484, + "source_mean_aggregate_load_tv": 0.03984087450916336 + }, + "x_at_s0": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 827, + "set_exact_tokens": 1051, + "token_weighted_mean_set_jaccard": 0.9050562319918211, + "source_mean_token_weighted_tv": 0.024719085028322315, + "source_mean_aggregate_load_tv": 0.039539206974163355 + }, + "x_at_s1": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 725, + "set_exact_tokens": 963, + "token_weighted_mean_set_jaccard": 0.8846856895002633, + "source_mean_token_weighted_tv": 0.030643245135472445, + "source_mean_aggregate_load_tv": 0.049150886454066525 + }, + "period_at_s0": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 822, + "set_exact_tokens": 1050, + "token_weighted_mean_set_jaccard": 0.9046224866003655, + "source_mean_token_weighted_tv": 0.02467059878842953, + "source_mean_aggregate_load_tv": 0.04045079364782796 + }, + "period_at_s1": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 744, + "set_exact_tokens": 983, + "token_weighted_mean_set_jaccard": 0.8900920159866159, + "source_mean_token_weighted_tv": 0.030029274480660523, + "source_mean_aggregate_load_tv": 0.04991180170204927 + } + }, + "layer_11": { + "system_eos": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 1072, + "set_exact_tokens": 1246, + "token_weighted_mean_set_jaccard": 0.9446509898689469, + "source_mean_token_weighted_tv": 0.012140599647144978, + "source_mean_aggregate_load_tv": 0.026074736068592327 + }, + "system_bos": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 956, + "set_exact_tokens": 1153, + "token_weighted_mean_set_jaccard": 0.9259689562226971, + "source_mean_token_weighted_tv": 0.01639338080691022, + "source_mean_aggregate_load_tv": 0.032019981720742496 + }, + "system_x": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 855, + "set_exact_tokens": 1069, + "token_weighted_mean_set_jaccard": 0.9060445518480652, + "source_mean_token_weighted_tv": 0.02176645963466117, + "source_mean_aggregate_load_tv": 0.041687389985130864 + }, + "system_period": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 820, + "set_exact_tokens": 1030, + "token_weighted_mean_set_jaccard": 0.9002664435976083, + "source_mean_token_weighted_tv": 0.022346341008717904, + "source_mean_aggregate_load_tv": 0.04257724774543393 + }, + "bos_at_s0": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 862, + "set_exact_tokens": 1059, + "token_weighted_mean_set_jaccard": 0.9066672863029404, + "source_mean_token_weighted_tv": 0.02052451852444198, + "source_mean_aggregate_load_tv": 0.03845922705544084 + }, + "bos_at_s1": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 791, + "set_exact_tokens": 995, + "token_weighted_mean_set_jaccard": 0.894274560832791, + "source_mean_token_weighted_tv": 0.022374741052122695, + "source_mean_aggregate_load_tv": 0.04061112013529043 + }, + "x_at_s0": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 835, + "set_exact_tokens": 1040, + "token_weighted_mean_set_jaccard": 0.9026396505251416, + "source_mean_token_weighted_tv": 0.022758268359074702, + "source_mean_aggregate_load_tv": 0.04119097042242572 + }, + "x_at_s1": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 707, + "set_exact_tokens": 936, + "token_weighted_mean_set_jaccard": 0.8780434703011151, + "source_mean_token_weighted_tv": 0.02847366748717539, + "source_mean_aggregate_load_tv": 0.053298795503756345 + }, + "period_at_s0": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 814, + "set_exact_tokens": 1034, + "token_weighted_mean_set_jaccard": 0.9011587198314589, + "source_mean_token_weighted_tv": 0.023559437153178934, + "source_mean_aggregate_load_tv": 0.04369558423321272 + }, + "period_at_s1": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 698, + "set_exact_tokens": 922, + "token_weighted_mean_set_jaccard": 0.875224125256656, + "source_mean_token_weighted_tv": 0.029047784795438084, + "source_mean_aggregate_load_tv": 0.05415344902521147 + } + }, + "layer_12": { + "system_eos": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 1029, + "set_exact_tokens": 1194, + "token_weighted_mean_set_jaccard": 0.9339003005235926, + "source_mean_token_weighted_tv": 0.014282638654638354, + "source_mean_aggregate_load_tv": 0.02688014277734084 + }, + "system_bos": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 924, + "set_exact_tokens": 1124, + "token_weighted_mean_set_jaccard": 0.9191839390277904, + "source_mean_token_weighted_tv": 0.018935301163208886, + "source_mean_aggregate_load_tv": 0.03746640922531232 + }, + "system_x": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 811, + "set_exact_tokens": 1023, + "token_weighted_mean_set_jaccard": 0.8976670694302444, + "source_mean_token_weighted_tv": 0.02400924101420237, + "source_mean_aggregate_load_tv": 0.04171021098843332 + }, + "system_period": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 787, + "set_exact_tokens": 1014, + "token_weighted_mean_set_jaccard": 0.8969699786225486, + "source_mean_token_weighted_tv": 0.024631338131559155, + "source_mean_aggregate_load_tv": 0.042389823883100156 + }, + "bos_at_s0": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 821, + "set_exact_tokens": 1063, + "token_weighted_mean_set_jaccard": 0.9065898317687516, + "source_mean_token_weighted_tv": 0.022568930897481927, + "source_mean_aggregate_load_tv": 0.03876930343992389 + }, + "bos_at_s1": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 779, + "set_exact_tokens": 1026, + "token_weighted_mean_set_jaccard": 0.8983176875174271, + "source_mean_token_weighted_tv": 0.02331077608682419, + "source_mean_aggregate_load_tv": 0.03817500052333886 + }, + "x_at_s0": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 784, + "set_exact_tokens": 1020, + "token_weighted_mean_set_jaccard": 0.8969080149951977, + "source_mean_token_weighted_tv": 0.025389412252463498, + "source_mean_aggregate_load_tv": 0.04263988097898464 + }, + "x_at_s1": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 707, + "set_exact_tokens": 940, + "token_weighted_mean_set_jaccard": 0.8778449050407411, + "source_mean_token_weighted_tv": 0.030024839674197456, + "source_mean_aggregate_load_tv": 0.050481571885008264 + }, + "period_at_s0": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 773, + "set_exact_tokens": 1001, + "token_weighted_mean_set_jaccard": 0.8934380518635562, + "source_mean_token_weighted_tv": 0.025969711625392126, + "source_mean_aggregate_load_tv": 0.04197008047950515 + }, + "period_at_s1": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 679, + "set_exact_tokens": 919, + "token_weighted_mean_set_jaccard": 0.8735384329398644, + "source_mean_token_weighted_tv": 0.03139834694470757, + "source_mean_aggregate_load_tv": 0.05181198927223272 + } + }, + "layer_13": { + "system_eos": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 958, + "set_exact_tokens": 1149, + "token_weighted_mean_set_jaccard": 0.9253957926697028, + "source_mean_token_weighted_tv": 0.01486607646920801, + "source_mean_aggregate_load_tv": 0.034523190283486445 + }, + "system_bos": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 829, + "set_exact_tokens": 1073, + "token_weighted_mean_set_jaccard": 0.9100133221798804, + "source_mean_token_weighted_tv": 0.017957704723593194, + "source_mean_aggregate_load_tv": 0.035257195793626885 + }, + "system_x": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 714, + "set_exact_tokens": 940, + "token_weighted_mean_set_jaccard": 0.879041084701462, + "source_mean_token_weighted_tv": 0.025087891411380767, + "source_mean_aggregate_load_tv": 0.04823776494854726 + }, + "system_period": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 688, + "set_exact_tokens": 931, + "token_weighted_mean_set_jaccard": 0.8762465251079433, + "source_mean_token_weighted_tv": 0.025779133623309525, + "source_mean_aggregate_load_tv": 0.04816015486701688 + }, + "bos_at_s0": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 754, + "set_exact_tokens": 997, + "token_weighted_mean_set_jaccard": 0.892849397403724, + "source_mean_token_weighted_tv": 0.022266344380338084, + "source_mean_aggregate_load_tv": 0.04095768837019011 + }, + "bos_at_s1": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 702, + "set_exact_tokens": 949, + "token_weighted_mean_set_jaccard": 0.882981689748118, + "source_mean_token_weighted_tv": 0.0237043383542082, + "source_mean_aggregate_load_tv": 0.04649759724293014 + }, + "x_at_s0": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 695, + "set_exact_tokens": 926, + "token_weighted_mean_set_jaccard": 0.8780710722805711, + "source_mean_token_weighted_tv": 0.026110371678370235, + "source_mean_aggregate_load_tv": 0.049699933631819945 + }, + "x_at_s1": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 587, + "set_exact_tokens": 832, + "token_weighted_mean_set_jaccard": 0.8547324720389132, + "source_mean_token_weighted_tv": 0.03227433694299723, + "source_mean_aggregate_load_tv": 0.06016053432101612 + }, + "period_at_s0": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 679, + "set_exact_tokens": 926, + "token_weighted_mean_set_jaccard": 0.8777612541438173, + "source_mean_token_weighted_tv": 0.025478433187552323, + "source_mean_aggregate_load_tv": 0.050083481662263576 + }, + "period_at_s1": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 606, + "set_exact_tokens": 838, + "token_weighted_mean_set_jaccard": 0.8552966227006567, + "source_mean_token_weighted_tv": 0.03172857640303473, + "source_mean_aggregate_load_tv": 0.056084808953262295 + } + }, + "layer_14": { + "system_eos": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 929, + "set_exact_tokens": 1121, + "token_weighted_mean_set_jaccard": 0.9198810298354865, + "source_mean_token_weighted_tv": 0.016102934504306197, + "source_mean_aggregate_load_tv": 0.03496223442237913 + }, + "system_bos": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 846, + "set_exact_tokens": 1058, + "token_weighted_mean_set_jaccard": 0.9051336865260093, + "source_mean_token_weighted_tv": 0.020121105119267402, + "source_mean_aggregate_load_tv": 0.03777169753724919 + }, + "system_x": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 743, + "set_exact_tokens": 953, + "token_weighted_mean_set_jaccard": 0.8826161043467484, + "source_mean_token_weighted_tv": 0.02662009146817534, + "source_mean_aggregate_load_tv": 0.04877311163940475 + }, + "system_period": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 718, + "set_exact_tokens": 952, + "token_weighted_mean_set_jaccard": 0.8820401242652383, + "source_mean_token_weighted_tv": 0.026991341444945447, + "source_mean_aggregate_load_tv": 0.04879729651603178 + }, + "bos_at_s0": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 750, + "set_exact_tokens": 965, + "token_weighted_mean_set_jaccard": 0.8860333983951421, + "source_mean_token_weighted_tv": 0.024466630488835298, + "source_mean_aggregate_load_tv": 0.045421207540234085 + }, + "bos_at_s1": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 731, + "set_exact_tokens": 956, + "token_weighted_mean_set_jaccard": 0.8837872169036777, + "source_mean_token_weighted_tv": 0.025598520291411117, + "source_mean_aggregate_load_tv": 0.04520255176520509 + }, + "x_at_s0": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 712, + "set_exact_tokens": 950, + "token_weighted_mean_set_jaccard": 0.881200235461784, + "source_mean_token_weighted_tv": 0.02596490954406952, + "source_mean_aggregate_load_tv": 0.043566293804591434 + }, + "x_at_s1": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 643, + "set_exact_tokens": 866, + "token_weighted_mean_set_jaccard": 0.8620751618799762, + "source_mean_token_weighted_tv": 0.03237705103326532, + "source_mean_aggregate_load_tv": 0.05320952552188754 + }, + "period_at_s0": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 732, + "set_exact_tokens": 955, + "token_weighted_mean_set_jaccard": 0.882826780679741, + "source_mean_token_weighted_tv": 0.025598363679382168, + "source_mean_aggregate_load_tv": 0.04463239466656334 + }, + "period_at_s1": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 642, + "set_exact_tokens": 866, + "token_weighted_mean_set_jaccard": 0.8617963255568979, + "source_mean_token_weighted_tv": 0.03285454202423708, + "source_mean_aggregate_load_tv": 0.055880211580820446 + } + }, + "layer_15": { + "system_eos": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 922, + "set_exact_tokens": 1113, + "token_weighted_mean_set_jaccard": 0.9179198810298357, + "source_mean_token_weighted_tv": 0.01656291626322963, + "source_mean_aggregate_load_tv": 0.03597864095102585 + }, + "system_bos": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 797, + "set_exact_tokens": 1022, + "token_weighted_mean_set_jaccard": 0.8988753601635839, + "source_mean_token_weighted_tv": 0.021051753378329704, + "source_mean_aggregate_load_tv": 0.040483933318493134 + }, + "system_x": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 710, + "set_exact_tokens": 912, + "token_weighted_mean_set_jaccard": 0.8737026365523437, + "source_mean_token_weighted_tv": 0.0278290441034733, + "source_mean_aggregate_load_tv": 0.0516124351401803 + }, + "system_period": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 684, + "set_exact_tokens": 890, + "token_weighted_mean_set_jaccard": 0.8688849645258234, + "source_mean_token_weighted_tv": 0.027814849487177034, + "source_mean_aggregate_load_tv": 0.05052609032030526 + }, + "bos_at_s0": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 752, + "set_exact_tokens": 989, + "token_weighted_mean_set_jaccard": 0.890974997676364, + "source_mean_token_weighted_tv": 0.02450054937676817, + "source_mean_aggregate_load_tv": 0.048156942566583885 + }, + "bos_at_s1": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 705, + "set_exact_tokens": 924, + "token_weighted_mean_set_jaccard": 0.8763887597979987, + "source_mean_token_weighted_tv": 0.026813246747409324, + "source_mean_aggregate_load_tv": 0.0523222091583764 + }, + "x_at_s0": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 722, + "set_exact_tokens": 926, + "token_weighted_mean_set_jaccard": 0.8756544908138923, + "source_mean_token_weighted_tv": 0.027897486312657916, + "source_mean_aggregate_load_tv": 0.050392746049081734 + }, + "x_at_s1": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 613, + "set_exact_tokens": 829, + "token_weighted_mean_set_jaccard": 0.8525299467394456, + "source_mean_token_weighted_tv": 0.03301860271612741, + "source_mean_aggregate_load_tv": 0.05886529558000583 + }, + "period_at_s0": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 713, + "set_exact_tokens": 920, + "token_weighted_mean_set_jaccard": 0.8750875236236328, + "source_mean_token_weighted_tv": 0.02782426398534745, + "source_mean_aggregate_load_tv": 0.04973965461941469 + }, + "period_at_s1": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 616, + "set_exact_tokens": 837, + "token_weighted_mean_set_jaccard": 0.854181277408343, + "source_mean_token_weighted_tv": 0.033086019438942446, + "source_mean_aggregate_load_tv": 0.05687390175384552 + } + }, + "layer_16": { + "system_eos": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 948, + "set_exact_tokens": 1144, + "token_weighted_mean_set_jaccard": 0.9235213929423427, + "source_mean_token_weighted_tv": 0.01665692373459701, + "source_mean_aggregate_load_tv": 0.03309232779079226 + }, + "system_bos": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 851, + "set_exact_tokens": 1077, + "token_weighted_mean_set_jaccard": 0.9089754314217554, + "source_mean_token_weighted_tv": 0.020502826477898275, + "source_mean_aggregate_load_tv": 0.0364119302616824 + }, + "system_x": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 698, + "set_exact_tokens": 913, + "token_weighted_mean_set_jaccard": 0.8723456331133624, + "source_mean_token_weighted_tv": 0.028812470306095583, + "source_mean_aggregate_load_tv": 0.050720793925177345 + }, + "system_period": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 686, + "set_exact_tokens": 910, + "token_weighted_mean_set_jaccard": 0.873699538370976, + "source_mean_token_weighted_tv": 0.028670869178690717, + "source_mean_aggregate_load_tv": 0.051653658717336334 + }, + "bos_at_s0": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 772, + "set_exact_tokens": 986, + "token_weighted_mean_set_jaccard": 0.8901075068934535, + "source_mean_token_weighted_tv": 0.024869546101940847, + "source_mean_aggregate_load_tv": 0.04664692374245792 + }, + "bos_at_s1": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 726, + "set_exact_tokens": 949, + "token_weighted_mean_set_jaccard": 0.8805558137373359, + "source_mean_token_weighted_tv": 0.026265081016136376, + "source_mean_aggregate_load_tv": 0.04877844428665126 + }, + "x_at_s0": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 703, + "set_exact_tokens": 935, + "token_weighted_mean_set_jaccard": 0.8775505778108249, + "source_mean_token_weighted_tv": 0.0280610302625136, + "source_mean_aggregate_load_tv": 0.053452071584638265 + }, + "x_at_s1": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 613, + "set_exact_tokens": 822, + "token_weighted_mean_set_jaccard": 0.8522973014840287, + "source_mean_token_weighted_tv": 0.0340603657090726, + "source_mean_aggregate_load_tv": 0.06477413250779611 + }, + "period_at_s0": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 718, + "set_exact_tokens": 951, + "token_weighted_mean_set_jaccard": 0.8817176317501628, + "source_mean_token_weighted_tv": 0.02767099217302788, + "source_mean_aggregate_load_tv": 0.051006409261571094 + }, + "period_at_s1": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 606, + "set_exact_tokens": 832, + "token_weighted_mean_set_jaccard": 0.8531740868110418, + "source_mean_token_weighted_tv": 0.03489247977623433, + "source_mean_aggregate_load_tv": 0.06440750770501773 + } + }, + "layer_17": { + "system_eos": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 972, + "set_exact_tokens": 1152, + "token_weighted_mean_set_jaccard": 0.9241720110295255, + "source_mean_token_weighted_tv": 0.016424489850545843, + "source_mean_aggregate_load_tv": 0.03224050768673641 + }, + "system_bos": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 828, + "set_exact_tokens": 1044, + "token_weighted_mean_set_jaccard": 0.9016947052080431, + "source_mean_token_weighted_tv": 0.021689449608113174, + "source_mean_aggregate_load_tv": 0.03749308292228755 + }, + "system_x": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 703, + "set_exact_tokens": 934, + "token_weighted_mean_set_jaccard": 0.8767267432199115, + "source_mean_token_weighted_tv": 0.02838988423229886, + "source_mean_aggregate_load_tv": 0.0464335129486422 + }, + "system_period": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 698, + "set_exact_tokens": 934, + "token_weighted_mean_set_jaccard": 0.8789602503330544, + "source_mean_token_weighted_tv": 0.028507432505393646, + "source_mean_aggregate_load_tv": 0.04852099891007625 + }, + "bos_at_s0": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 785, + "set_exact_tokens": 1003, + "token_weighted_mean_set_jaccard": 0.8936301391083433, + "source_mean_token_weighted_tv": 0.02390671946989789, + "source_mean_aggregate_load_tv": 0.04063816274697608 + }, + "bos_at_s1": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 733, + "set_exact_tokens": 952, + "token_weighted_mean_set_jaccard": 0.8801158719831459, + "source_mean_token_weighted_tv": 0.026738618186368048, + "source_mean_aggregate_load_tv": 0.04345158187357359 + }, + "x_at_s0": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 698, + "set_exact_tokens": 912, + "token_weighted_mean_set_jaccard": 0.8730987728385257, + "source_mean_token_weighted_tv": 0.029008729085187722, + "source_mean_aggregate_load_tv": 0.04900208686226187 + }, + "x_at_s1": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 619, + "set_exact_tokens": 858, + "token_weighted_mean_set_jaccard": 0.856585466149552, + "source_mean_token_weighted_tv": 0.034266646122466646, + "source_mean_aggregate_load_tv": 0.05591773393470036 + }, + "period_at_s0": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 717, + "set_exact_tokens": 941, + "token_weighted_mean_set_jaccard": 0.8780558630265852, + "source_mean_token_weighted_tv": 0.028515844174036728, + "source_mean_aggregate_load_tv": 0.04843520738224057 + }, + "period_at_s1": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 623, + "set_exact_tokens": 853, + "token_weighted_mean_set_jaccard": 0.8547699318681751, + "source_mean_token_weighted_tv": 0.034400829862610526, + "source_mean_aggregate_load_tv": 0.05777132194934027 + } + }, + "layer_18": { + "system_eos": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 918, + "set_exact_tokens": 1113, + "token_weighted_mean_set_jaccard": 0.9177897574123991, + "source_mean_token_weighted_tv": 0.017882878425619756, + "source_mean_aggregate_load_tv": 0.03492032417615494 + }, + "system_bos": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 827, + "set_exact_tokens": 1032, + "token_weighted_mean_set_jaccard": 0.9001611054311119, + "source_mean_token_weighted_tv": 0.021229048230747675, + "source_mean_aggregate_load_tv": 0.040362086945613544 + }, + "system_x": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 689, + "set_exact_tokens": 925, + "token_weighted_mean_set_jaccard": 0.8760758434798772, + "source_mean_token_weighted_tv": 0.02927951243769051, + "source_mean_aggregate_load_tv": 0.05416395182482708 + }, + "system_period": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 679, + "set_exact_tokens": 909, + "token_weighted_mean_set_jaccard": 0.8721814295008831, + "source_mean_token_weighted_tv": 0.02985863890095945, + "source_mean_aggregate_load_tv": 0.05471070181654047 + }, + "bos_at_s0": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 742, + "set_exact_tokens": 957, + "token_weighted_mean_set_jaccard": 0.8864516528797595, + "source_mean_token_weighted_tv": 0.024705662706689765, + "source_mean_aggregate_load_tv": 0.04367843565414766 + }, + "bos_at_s1": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 721, + "set_exact_tokens": 930, + "token_weighted_mean_set_jaccard": 0.8777271741487747, + "source_mean_token_weighted_tv": 0.026463184913484764, + "source_mean_aggregate_load_tv": 0.04677630782258108 + }, + "x_at_s0": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 695, + "set_exact_tokens": 916, + "token_weighted_mean_set_jaccard": 0.8743997273600397, + "source_mean_token_weighted_tv": 0.027894349473513595, + "source_mean_aggregate_load_tv": 0.04559878836055904 + }, + "x_at_s1": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 640, + "set_exact_tokens": 880, + "token_weighted_mean_set_jaccard": 0.8629088543206955, + "source_mean_token_weighted_tv": 0.03344863221120644, + "source_mean_aggregate_load_tv": 0.059207309295844876 + }, + "period_at_s0": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 671, + "set_exact_tokens": 896, + "token_weighted_mean_set_jaccard": 0.8714564550608792, + "source_mean_token_weighted_tv": 0.028591746637299985, + "source_mean_aggregate_load_tv": 0.051277640935969 + }, + "period_at_s1": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 646, + "set_exact_tokens": 858, + "token_weighted_mean_set_jaccard": 0.8563004334637387, + "source_mean_token_weighted_tv": 0.035020203909758824, + "source_mean_aggregate_load_tv": 0.0629106439982979 + } + }, + "layer_19": { + "system_eos": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 918, + "set_exact_tokens": 1108, + "token_weighted_mean_set_jaccard": 0.9165504848653842, + "source_mean_token_weighted_tv": 0.01774002281412407, + "source_mean_aggregate_load_tv": 0.03497283464575753 + }, + "system_bos": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 838, + "set_exact_tokens": 1034, + "token_weighted_mean_set_jaccard": 0.8997583418533321, + "source_mean_token_weighted_tv": 0.022217802933969282, + "source_mean_aggregate_load_tv": 0.041037656641868085 + }, + "system_x": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 687, + "set_exact_tokens": 904, + "token_weighted_mean_set_jaccard": 0.8677510301453047, + "source_mean_token_weighted_tv": 0.028800121025144898, + "source_mean_aggregate_load_tv": 0.049191267333055 + }, + "system_period": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 668, + "set_exact_tokens": 899, + "token_weighted_mean_set_jaccard": 0.8667534157449578, + "source_mean_token_weighted_tv": 0.02978157611859537, + "source_mean_aggregate_load_tv": 0.0514372384094516 + }, + "bos_at_s0": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 761, + "set_exact_tokens": 962, + "token_weighted_mean_set_jaccard": 0.8847941258481272, + "source_mean_token_weighted_tv": 0.0252494098056852, + "source_mean_aggregate_load_tv": 0.045622639399559343 + }, + "bos_at_s1": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 738, + "set_exact_tokens": 940, + "token_weighted_mean_set_jaccard": 0.8766954797533849, + "source_mean_token_weighted_tv": 0.026248755672801022, + "source_mean_aggregate_load_tv": 0.04772607280901514 + }, + "x_at_s0": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 725, + "set_exact_tokens": 934, + "token_weighted_mean_set_jaccard": 0.8760262725779967, + "source_mean_token_weighted_tv": 0.02779730401188973, + "source_mean_aggregate_load_tv": 0.05165355934476638 + }, + "x_at_s1": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 592, + "set_exact_tokens": 812, + "token_weighted_mean_set_jaccard": 0.8467952130281343, + "source_mean_token_weighted_tv": 0.03440095881263203, + "source_mean_aggregate_load_tv": 0.05634622940335547 + }, + "period_at_s0": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 726, + "set_exact_tokens": 946, + "token_weighted_mean_set_jaccard": 0.8767140688415898, + "source_mean_token_weighted_tv": 0.02816846707659017, + "source_mean_aggregate_load_tv": 0.050935248625448175 + }, + "period_at_s1": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 601, + "set_exact_tokens": 823, + "token_weighted_mean_set_jaccard": 0.8480775784614432, + "source_mean_token_weighted_tv": 0.03499010982189807, + "source_mean_aggregate_load_tv": 0.05807666584031799 + } + }, + "layer_20": { + "system_eos": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 849, + "set_exact_tokens": 1051, + "token_weighted_mean_set_jaccard": 0.9041267775815598, + "source_mean_token_weighted_tv": 0.018480191735749687, + "source_mean_aggregate_load_tv": 0.03778564832843407 + }, + "system_bos": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 779, + "set_exact_tokens": 1001, + "token_weighted_mean_set_jaccard": 0.8952659788704032, + "source_mean_token_weighted_tv": 0.022131128785342388, + "source_mean_aggregate_load_tv": 0.04296597073594246 + }, + "system_x": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 618, + "set_exact_tokens": 846, + "token_weighted_mean_set_jaccard": 0.8564364717910585, + "source_mean_token_weighted_tv": 0.030762159601207466, + "source_mean_aggregate_load_tv": 0.053702510574427764 + }, + "system_period": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 572, + "set_exact_tokens": 806, + "token_weighted_mean_set_jaccard": 0.8511850543730828, + "source_mean_token_weighted_tv": 0.03160760452313695, + "source_mean_aggregate_load_tv": 0.058361116362724244 + }, + "bos_at_s0": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 701, + "set_exact_tokens": 930, + "token_weighted_mean_set_jaccard": 0.8771075378752672, + "source_mean_token_weighted_tv": 0.02588561335643499, + "source_mean_aggregate_load_tv": 0.047460076023863894 + }, + "bos_at_s1": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 679, + "set_exact_tokens": 920, + "token_weighted_mean_set_jaccard": 0.8743194562973352, + "source_mean_token_weighted_tv": 0.027572294749182543, + "source_mean_aggregate_load_tv": 0.050957242400728915 + }, + "x_at_s0": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 636, + "set_exact_tokens": 878, + "token_weighted_mean_set_jaccard": 0.8650711032623848, + "source_mean_token_weighted_tv": 0.028113791666382195, + "source_mean_aggregate_load_tv": 0.05060234331657911 + }, + "x_at_s1": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 550, + "set_exact_tokens": 749, + "token_weighted_mean_set_jaccard": 0.8340681656231429, + "source_mean_token_weighted_tv": 0.03576564053596308, + "source_mean_aggregate_load_tv": 0.06388787568777203 + }, + "period_at_s0": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 663, + "set_exact_tokens": 904, + "token_weighted_mean_set_jaccard": 0.8699104625584781, + "source_mean_token_weighted_tv": 0.027975821274924196, + "source_mean_aggregate_load_tv": 0.049569971293156344 + }, + "period_at_s1": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 550, + "set_exact_tokens": 771, + "token_weighted_mean_set_jaccard": 0.837844567057319, + "source_mean_token_weighted_tv": 0.03642691478745823, + "source_mean_aggregate_load_tv": 0.06361825468244978 + } + }, + "layer_21": { + "system_eos": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 834, + "set_exact_tokens": 1055, + "token_weighted_mean_set_jaccard": 0.9039718685131828, + "source_mean_token_weighted_tv": 0.018954909475148933, + "source_mean_aggregate_load_tv": 0.037622393792017435 + }, + "system_bos": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 762, + "set_exact_tokens": 999, + "token_weighted_mean_set_jaccard": 0.8934442482262911, + "source_mean_token_weighted_tv": 0.022563482507295174, + "source_mean_aggregate_load_tv": 0.045455179485474055 + }, + "system_x": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 624, + "set_exact_tokens": 857, + "token_weighted_mean_set_jaccard": 0.8555596864640455, + "source_mean_token_weighted_tv": 0.03187286964604458, + "source_mean_aggregate_load_tv": 0.05776467248780488 + }, + "system_period": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 612, + "set_exact_tokens": 835, + "token_weighted_mean_set_jaccard": 0.8521888651361651, + "source_mean_token_weighted_tv": 0.03323829115468648, + "source_mean_aggregate_load_tv": 0.061992358245419224 + }, + "bos_at_s0": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 743, + "set_exact_tokens": 968, + "token_weighted_mean_set_jaccard": 0.881661864485547, + "source_mean_token_weighted_tv": 0.02559193475271567, + "source_mean_aggregate_load_tv": 0.04908973892220742 + }, + "bos_at_s1": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 657, + "set_exact_tokens": 891, + "token_weighted_mean_set_jaccard": 0.8691018372215509, + "source_mean_token_weighted_tv": 0.027510928380942403, + "source_mean_aggregate_load_tv": 0.048174926911159224 + }, + "x_at_s0": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 631, + "set_exact_tokens": 865, + "token_weighted_mean_set_jaccard": 0.8616507110326237, + "source_mean_token_weighted_tv": 0.0292221343358467, + "source_mean_aggregate_load_tv": 0.0580752584114245 + }, + "x_at_s1": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 537, + "set_exact_tokens": 765, + "token_weighted_mean_set_jaccard": 0.8355085383061961, + "source_mean_token_weighted_tv": 0.03745310536897461, + "source_mean_aggregate_load_tv": 0.06836896556437377 + }, + "period_at_s0": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 670, + "set_exact_tokens": 904, + "token_weighted_mean_set_jaccard": 0.8679926882919725, + "source_mean_token_weighted_tv": 0.028186295324194886, + "source_mean_aggregate_load_tv": 0.04996717594818891 + }, + "period_at_s1": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 550, + "set_exact_tokens": 788, + "token_weighted_mean_set_jaccard": 0.8402270685289553, + "source_mean_token_weighted_tv": 0.03754208179538073, + "source_mean_aggregate_load_tv": 0.06886572928521775 + } + }, + "layer_22": { + "system_eos": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 875, + "set_exact_tokens": 1067, + "token_weighted_mean_set_jaccard": 0.9068129008272143, + "source_mean_token_weighted_tv": 0.018660762936707664, + "source_mean_aggregate_load_tv": 0.03719598050340802 + }, + "system_bos": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 779, + "set_exact_tokens": 980, + "token_weighted_mean_set_jaccard": 0.8891935433900299, + "source_mean_token_weighted_tv": 0.022291937792777355, + "source_mean_aggregate_load_tv": 0.04115356282393013 + }, + "system_x": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 652, + "set_exact_tokens": 852, + "token_weighted_mean_set_jaccard": 0.8567589643061344, + "source_mean_token_weighted_tv": 0.03207883798243883, + "source_mean_aggregate_load_tv": 0.05656963861624088 + }, + "system_period": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 635, + "set_exact_tokens": 846, + "token_weighted_mean_set_jaccard": 0.8576326514517796, + "source_mean_token_weighted_tv": 0.03308550439165309, + "source_mean_aggregate_load_tv": 0.058062825810714994 + }, + "bos_at_s0": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 731, + "set_exact_tokens": 959, + "token_weighted_mean_set_jaccard": 0.8834773987669239, + "source_mean_token_weighted_tv": 0.02492970544936719, + "source_mean_aggregate_load_tv": 0.04567557369992672 + }, + "bos_at_s1": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 701, + "set_exact_tokens": 923, + "token_weighted_mean_set_jaccard": 0.8725194129227962, + "source_mean_token_weighted_tv": 0.026792242148322157, + "source_mean_aggregate_load_tv": 0.047770929895173356 + }, + "x_at_s0": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 709, + "set_exact_tokens": 910, + "token_weighted_mean_set_jaccard": 0.8705672770083961, + "source_mean_token_weighted_tv": 0.02844415133592819, + "source_mean_aggregate_load_tv": 0.0501163626967699 + }, + "x_at_s1": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 576, + "set_exact_tokens": 786, + "token_weighted_mean_set_jaccard": 0.8406791213557643, + "source_mean_token_weighted_tv": 0.03716098654884562, + "source_mean_aggregate_load_tv": 0.0651168909166684 + }, + "period_at_s0": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 681, + "set_exact_tokens": 891, + "token_weighted_mean_set_jaccard": 0.8687145645506088, + "source_mean_token_weighted_tv": 0.02796619196592226, + "source_mean_aggregate_load_tv": 0.049249031210287154 + }, + "period_at_s1": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 598, + "set_exact_tokens": 798, + "token_weighted_mean_set_jaccard": 0.8428199646807322, + "source_mean_token_weighted_tv": 0.037887968187425354, + "source_mean_aggregate_load_tv": 0.06550296087390844 + } + }, + "layer_23": { + "system_eos": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 909, + "set_exact_tokens": 1106, + "token_weighted_mean_set_jaccard": 0.9170926666047031, + "source_mean_token_weighted_tv": 0.018437061259919653, + "source_mean_aggregate_load_tv": 0.040147492513030986 + }, + "system_bos": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 840, + "set_exact_tokens": 1045, + "token_weighted_mean_set_jaccard": 0.9024692505499273, + "source_mean_token_weighted_tv": 0.021586262537002333, + "source_mean_aggregate_load_tv": 0.04327731530507382 + }, + "system_x": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 674, + "set_exact_tokens": 891, + "token_weighted_mean_set_jaccard": 0.8654183812284008, + "source_mean_token_weighted_tv": 0.029906224589843416, + "source_mean_aggregate_load_tv": 0.05420125994379827 + }, + "system_period": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 688, + "set_exact_tokens": 911, + "token_weighted_mean_set_jaccard": 0.8720299002667252, + "source_mean_token_weighted_tv": 0.029322481966050258, + "source_mean_aggregate_load_tv": 0.05121101600082662 + }, + "bos_at_s0": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 792, + "set_exact_tokens": 1000, + "token_weighted_mean_set_jaccard": 0.8917805248319236, + "source_mean_token_weighted_tv": 0.024309954603993277, + "source_mean_aggregate_load_tv": 0.043814492061942906 + }, + "bos_at_s1": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 733, + "set_exact_tokens": 947, + "token_weighted_mean_set_jaccard": 0.880952380952381, + "source_mean_token_weighted_tv": 0.026566726605668105, + "source_mean_aggregate_load_tv": 0.05225609895410459 + }, + "x_at_s0": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 737, + "set_exact_tokens": 943, + "token_weighted_mean_set_jaccard": 0.8776469030860702, + "source_mean_token_weighted_tv": 0.027484588005944006, + "source_mean_aggregate_load_tv": 0.04943251437650665 + }, + "x_at_s1": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 638, + "set_exact_tokens": 859, + "token_weighted_mean_set_jaccard": 0.8574064842119494, + "source_mean_token_weighted_tv": 0.033769729386475385, + "source_mean_aggregate_load_tv": 0.059675004854406424 + }, + "period_at_s0": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 717, + "set_exact_tokens": 941, + "token_weighted_mean_set_jaccard": 0.8783223066241934, + "source_mean_token_weighted_tv": 0.027787813643804584, + "source_mean_aggregate_load_tv": 0.0502464820684301 + }, + "period_at_s1": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 634, + "set_exact_tokens": 858, + "token_weighted_mean_set_jaccard": 0.8582925640830651, + "source_mean_token_weighted_tv": 0.034486160897170846, + "source_mean_aggregate_load_tv": 0.060996090351735234 + } + }, + "layer_24": { + "system_eos": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 809, + "set_exact_tokens": 1000, + "token_weighted_mean_set_jaccard": 0.8933605973293677, + "source_mean_token_weighted_tv": 0.01839851689355966, + "source_mean_aggregate_load_tv": 0.041424563790966845 + }, + "system_bos": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 722, + "set_exact_tokens": 952, + "token_weighted_mean_set_jaccard": 0.8820429407937539, + "source_mean_token_weighted_tv": 0.021238610090936406, + "source_mean_aggregate_load_tv": 0.042791302661528016 + }, + "system_x": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 585, + "set_exact_tokens": 804, + "token_weighted_mean_set_jaccard": 0.8475542674631809, + "source_mean_token_weighted_tv": 0.029384011352607747, + "source_mean_aggregate_load_tv": 0.05676206921364493 + }, + "system_period": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 563, + "set_exact_tokens": 797, + "token_weighted_mean_set_jaccard": 0.8411568045920681, + "source_mean_token_weighted_tv": 0.03074698778893931, + "source_mean_aggregate_load_tv": 0.05959426474720383 + }, + "bos_at_s0": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 704, + "set_exact_tokens": 919, + "token_weighted_mean_set_jaccard": 0.8748461471298167, + "source_mean_token_weighted_tv": 0.023000589386387344, + "source_mean_aggregate_load_tv": 0.042382797779067706 + }, + "bos_at_s1": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 628, + "set_exact_tokens": 868, + "token_weighted_mean_set_jaccard": 0.8612014747343308, + "source_mean_token_weighted_tv": 0.02521083873054497, + "source_mean_aggregate_load_tv": 0.050894801071186546 + }, + "x_at_s0": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 668, + "set_exact_tokens": 885, + "token_weighted_mean_set_jaccard": 0.8640115252346873, + "source_mean_token_weighted_tv": 0.025230221312706785, + "source_mean_aggregate_load_tv": 0.0480897632063151 + }, + "x_at_s1": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 505, + "set_exact_tokens": 751, + "token_weighted_mean_set_jaccard": 0.8286117049292065, + "source_mean_token_weighted_tv": 0.033279068751787266, + "source_mean_aggregate_load_tv": 0.05936982185137107 + }, + "period_at_s0": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 657, + "set_exact_tokens": 878, + "token_weighted_mean_set_jaccard": 0.8632679617064783, + "source_mean_token_weighted_tv": 0.025411241485694177, + "source_mean_aggregate_load_tv": 0.049356223226906304 + }, + "period_at_s1": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 535, + "set_exact_tokens": 751, + "token_weighted_mean_set_jaccard": 0.8274034141958672, + "source_mean_token_weighted_tv": 0.034373186505850785, + "source_mean_aggregate_load_tv": 0.06424316413617533 + } + }, + "layer_25": { + "system_eos": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 882, + "set_exact_tokens": 1062, + "token_weighted_mean_set_jaccard": 0.9059670973138766, + "source_mean_token_weighted_tv": 0.019059286855684747, + "source_mean_aggregate_load_tv": 0.040582969529921575 + }, + "system_bos": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 848, + "set_exact_tokens": 1046, + "token_weighted_mean_set_jaccard": 0.9030269231960839, + "source_mean_token_weighted_tv": 0.020319173005634746, + "source_mean_aggregate_load_tv": 0.04021799730532043 + }, + "system_x": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 699, + "set_exact_tokens": 905, + "token_weighted_mean_set_jaccard": 0.8716578368497693, + "source_mean_token_weighted_tv": 0.028566219526761326, + "source_mean_aggregate_load_tv": 0.05090031714061417 + }, + "system_period": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 689, + "set_exact_tokens": 901, + "token_weighted_mean_set_jaccard": 0.8687052700065063, + "source_mean_token_weighted_tv": 0.02990909836476298, + "source_mean_aggregate_load_tv": 0.05331014474276567 + }, + "bos_at_s0": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 756, + "set_exact_tokens": 963, + "token_weighted_mean_set_jaccard": 0.8870619946091642, + "source_mean_token_weighted_tv": 0.024308624565805424, + "source_mean_aggregate_load_tv": 0.047226291884100206 + }, + "bos_at_s1": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 755, + "set_exact_tokens": 962, + "token_weighted_mean_set_jaccard": 0.8855903584595842, + "source_mean_token_weighted_tv": 0.024786732752323442, + "source_mean_aggregate_load_tv": 0.046200459220000836 + }, + "x_at_s0": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 717, + "set_exact_tokens": 946, + "token_weighted_mean_set_jaccard": 0.8809430864082785, + "source_mean_token_weighted_tv": 0.02608540725018258, + "source_mean_aggregate_load_tv": 0.049459694628323884 + }, + "x_at_s1": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 681, + "set_exact_tokens": 886, + "token_weighted_mean_set_jaccard": 0.863261765343743, + "source_mean_token_weighted_tv": 0.03183821934976099, + "source_mean_aggregate_load_tv": 0.05433789440833124 + }, + "period_at_s0": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 748, + "set_exact_tokens": 971, + "token_weighted_mean_set_jaccard": 0.8848932676518884, + "source_mean_token_weighted_tv": 0.02567237595921808, + "source_mean_aggregate_load_tv": 0.05006669066443994 + }, + "period_at_s1": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 657, + "set_exact_tokens": 856, + "token_weighted_mean_set_jaccard": 0.859481984075348, + "source_mean_token_weighted_tv": 0.0328607540130906, + "source_mean_aggregate_load_tv": 0.056496181008437174 + } + }, + "layer_26": { + "system_eos": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 926, + "set_exact_tokens": 1100, + "token_weighted_mean_set_jaccard": 0.9122254236763019, + "source_mean_token_weighted_tv": 0.01804532875685491, + "source_mean_aggregate_load_tv": 0.03438627183542763 + }, + "system_bos": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 874, + "set_exact_tokens": 1073, + "token_weighted_mean_set_jaccard": 0.9087740496328656, + "source_mean_token_weighted_tv": 0.020392470883088598, + "source_mean_aggregate_load_tv": 0.038065208876058694 + }, + "system_x": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 703, + "set_exact_tokens": 930, + "token_weighted_mean_set_jaccard": 0.8755987235492766, + "source_mean_token_weighted_tv": 0.029952612859552138, + "source_mean_aggregate_load_tv": 0.05394186197211668 + }, + "system_period": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 680, + "set_exact_tokens": 909, + "token_weighted_mean_set_jaccard": 0.871781764104471, + "source_mean_token_weighted_tv": 0.030581506541155882, + "source_mean_aggregate_load_tv": 0.05445142375449176 + }, + "bos_at_s0": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 831, + "set_exact_tokens": 1030, + "token_weighted_mean_set_jaccard": 0.8970164513430615, + "source_mean_token_weighted_tv": 0.02408770364034258, + "source_mean_aggregate_load_tv": 0.0427684669196576 + }, + "bos_at_s1": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 778, + "set_exact_tokens": 997, + "token_weighted_mean_set_jaccard": 0.8895870124237072, + "source_mean_token_weighted_tv": 0.025472772889764683, + "source_mean_aggregate_load_tv": 0.047980150149921054 + }, + "x_at_s0": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 755, + "set_exact_tokens": 978, + "token_weighted_mean_set_jaccard": 0.8883787216903678, + "source_mean_token_weighted_tv": 0.025673933169551605, + "source_mean_aggregate_load_tv": 0.04771765906095578 + }, + "x_at_s1": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 685, + "set_exact_tokens": 905, + "token_weighted_mean_set_jaccard": 0.8701428261610435, + "source_mean_token_weighted_tv": 0.0327309362305611, + "source_mean_aggregate_load_tv": 0.05709114582683336 + }, + "period_at_s0": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 751, + "set_exact_tokens": 980, + "token_weighted_mean_set_jaccard": 0.8865786783158287, + "source_mean_token_weighted_tv": 0.026402440508733374, + "source_mean_aggregate_load_tv": 0.0498051555629198 + }, + "period_at_s1": { + "sources": 16, + "tokens": 1537, + "ordered_topk_exact_tokens": 667, + "set_exact_tokens": 879, + "token_weighted_mean_set_jaccard": 0.8637636707252841, + "source_mean_token_weighted_tv": 0.03421398528609809, + "source_mean_aggregate_load_tv": 0.061407901545608205 + } + } + } + }, + "claim_boundary": [ + "The trace observes one fixed SFT Chat checkpoint, not the Base checkpoint.", + "Target comparisons exclude boundary-crossing tokens and require exact token IDs.", + "Router and hidden associations do not establish mediation or capability causality.", + "CPU in hf_device_map is offload residency, not proof of CPU matrix execution.", + "Prompt-only use_cache=False traces are not generation-time KV or serving traces." + ] +} diff --git a/src/pages/deepseek/index.astro b/src/pages/deepseek/index.astro index 2991134..94c9479 100644 --- a/src/pages/deepseek/index.astro +++ b/src/pages/deepseek/index.astro @@ -4,6 +4,7 @@ import DeepSeekLineage from "@/components/DeepSeekLineage.astro"; import DeepSeekLab from "@/components/DeepSeekLab.astro"; import DeepSeekArtifactLab from "@/components/DeepSeekArtifactLab.astro"; import DeepSeekBehaviorLab from "@/components/DeepSeekBehaviorLab.astro"; +import DeepSeekCompletionDepthLab from "@/components/DeepSeekCompletionDepthLab.astro"; import { deepseekBranches, deepseekLedgers, deepseekPaperChain, deepseekWaves } from "@/data/deepseek"; const toc = [ @@ -31,21 +32,22 @@ const toc = [ ["21", "lab", "四联交互实验"], ["22", "artifact", "真实权重执行"], ["23", "behavior", "Chat:最终生成行为"], - ["24", "branches", "别漏掉旁支"], - ["25", "audit", "事实、推导与教学模型"], + ["24", "completion-depth", "Chat:完成度与全深度"], + ["25", "branches", "别漏掉旁支"], + ["26", "audit", "事实、推导与教学模型"], ["↳", "papers", "六十节点阅读链"], ]; ---
-

SPOTLIGHT / DEEPSEEK · ROUND 04 ROUTING × CHAT OUTPUT × REAL WEIGHTS

+

SPOTLIGHT / DEEPSEEK · ROUND 05 COMPLETION × FULL DEPTH × REAL WEIGHTS

不要背模型名
要看懂每次为什么转向

这不是七篇报告的摘要,而是一套可追问、可计算、可反驳的技术谱系: @@ -57,9 +59,9 @@ const toc = [

SPAN
2024.01 → 2026.06
LEDGERS
24 张问题账
LINEAGE
10 次技术转向
-
LABS
18 个可操作实验
+
LABS
19 个可操作实验
EVIDENCE
60 个一手 / 官方节点
-
STATUS
三轮 · 真实权重执行
+
STATUS
五轮 · 全 27 层执行
@@ -795,8 +797,21 @@ const toc = [ +
+

24 COMPLETION IS NOT CORRECTNESS

+

把 128-token 的截断账补齐,再沿完整 27 层看差异怎样传播

+

+ 上一轮证明固定 Chat checkpoint 的 greedy 输出会分叉,却有 97 / 128 格在 128-token + 上限处停止。这一轮对全部 128 格统一重跑 512-token 预算,用官方 GSM8K gold 与 + HumanEval tests 分开记录完成、可评测和正确;同时在相同输入上执行 prompt-only + 全深度 forward,追踪 29 个隐藏状态阶段、26 个 MoE gate 与 1,918,176 次 top-6 + 目标路由决定。隐藏状态、路由与任务结果仍是三类证据,不互相冒充因果解释。 +

+ +
+
-

24 THE MAIN LINE IS NOT THE WHOLE TREE

+

25 THE MAIN LINE IS NOT THE WHOLE TREE

如果只读 V2 → V3 → R1 → V4,会漏掉五条反过来影响主线的旁支

{deepseekBranches.map(([name, line, text, url]) => ( @@ -816,7 +831,7 @@ const toc = [
-

25 EVIDENCE AUDIT

+

26 EVIDENCE AUDIT

同一张页面里有三种知识,它们的语气必须不同

diff --git a/src/pages/index.astro b/src/pages/index.astro index a07fa8e..ae95066 100644 --- a/src/pages/index.astro +++ b/src/pages/index.astro @@ -145,18 +145,18 @@ const paths = [
-

NEW / DEEPSEEK ROUND 04 LINEAGE · REAL WEIGHTS · ROUTES · GENERATION

+

NEW / DEEPSEEK ROUND 05 COMPLETION · TASK TESTS · FULL DEPTH

从 Dense 到百万上下文:每次创新都在偿还上一代最贵的一张账

- 用二十四张问题账和十次技术转向走完 Dense→V4,再把 Base 路由证据接到官方 - V2-Lite-Chat 的 31.4 GB 完整 BF16 权重:16 个公开来源、8 种边界条件生成 - 128 个输出,并把 31 个自然 EOS 与 97 个长度截断分开解释。 + 用二十四张问题账和十次技术转向走完 Dense→V4,再把官方 V2-Lite-Chat 的 + 128 个输出统一延长到 512-token:121 个自然 EOS、Math / Code 真实 evaluator; + 同时沿 29 个隐藏阶段与 26 个 MoE gate 追踪 1,918,176 次目标路由决定。

LINEAGE
1991 → 2026 · 10 次转向
NODES
60 个一手 / 官方节点
-
LAB
4 公式 · 13 Base 工件 · 1 Chat 行为
+
LAB
19 · Base / Chat / full depth
diff --git a/src/pages/progress/index.astro b/src/pages/progress/index.astro index 9b63090..c932ca7 100644 --- a/src/pages/progress/index.astro +++ b/src/pages/progress/index.astro @@ -15,7 +15,7 @@ const workstreams = [ { label: "表示、位置与残差高速公路", value: 81, next: "加入真实 hidden-state / norm traces、长上下文位置外推复现与更多深层稳定性消融" }, { label: "Scaling Laws", value: 74, next: "加入真实拟合复现、置信区间与更多模型族对照" }, { label: "数据工程与预训练配方", value: 73, next: "逐图精读 FineWeb / DCLM,加入真实去重与 mixture traces" }, - { label: "DeepSeek 专题", value: 98, next: "completion-aware 生成评测、完整 27 层与固定 batch content,再推进 SM90 FlashMLA、FP8/pipeline 与 R1-like RL" }, + { label: "DeepSeek 专题", value: 99, next: "扩大 completion/task 样本、sampling robustness 与干预式 mediation,再推进 SM90 FlashMLA、FP8/pipeline 与 R1-like RL" }, { label: "指令微调与人类偏好", value: 75, next: "加入真实偏好分歧样本、RM 长度偏置与 PPO/DPO 小模型复现" }, { label: "推理与测试时扩展", value: 76, next: "真实模型采样曲线、PRM 案例与逐篇图表精读" }, { label: "工具使用与长程 Agent", value: 74, next: "补真实环境 traces、cross-harness 对照、Agent RL 训练曲线与安全案例" }, @@ -97,12 +97,12 @@ const workstreams = [
✓

K3 报告已结构化拆解

47 页报告目录、151 条参考来源和架构/后训练/系统主线已经提取。

✓

17 专题知识图

从语言模型基础到评测安全,包含先修依赖和三条贯穿案例。

✓

编辑式网站系统

响应式导航、章节模板、侧栏、进度、论文链和证据提示组件。

-
✓

八十五个原创交互视图

K3 三轴图、八联报告实验与四联开放工件实验,DeepSeek 四联公式实验、十三联 Base 工件实验与一联完整 Chat 行为实验,以及语言模型前史、Transformer、表示深度、长上下文、MoE、推理、Agent、多模态、训练系统、推理服务、Scaling、数据工程、数值、Alignment 与评测安全专题。

+
✓

八十六个原创交互视图

K3 三轴图、八联报告实验与四联开放工件实验,DeepSeek 四联公式实验、十三联 Base 工件实验、Chat 行为与 completion/full-depth 两轮实验,以及语言模型前史、Transformer、表示深度、长上下文、MoE、推理、Agent、多模态、训练系统、推理服务、Scaling、数据工程、数值、Alignment 与评测安全专题。

✓

十七篇首版长文

K3、语言模型前史、Transformer、表示/位置/残差、DeepSeek、Scaling、数据工程、长上下文、MoE、后训练、推理、Agent、原生多模态、训练系统、推理服务、数值优化与评测安全专题。

✓

语言模型前史深度专题

八张独立问题账、33 个正式节点、20 段长文与概率—向量—记忆—对齐四联实验。

✓

Transformer 深度专题

十张独立问题账、40 个正式节点、21 段正文与 QKV—Mask—多头位置—Block 成本四联实验。

✓

表示、位置与残差高速公路深度专题

二十张问题账、66 个一手节点、DeepSeek/Kimi 双谱系,以及 Token—位置—Norm—Residual/FFN 四联实验。

-
✓

DeepSeek 四轮真实权重里程碑

在 Base 路由与缓存实证上,新增官方 V2-Lite-Chat 的 31.4 GB 完整 BF16 生成:16 个公开来源 × 8 条件得到 128 个输出,31 个自然 EOS、97 个长度截断;独立复跑的 32 / 32 token 序列 exact。逐来源双输出、十边分歧、GPU/CPU offload 与证据边界共同组成第十八个实验,不把生成差异越界写成能力。

+
✓

DeepSeek 五轮真实权重里程碑

统一 512-token 预算让自然 EOS 从 31 / 128 增至 121 / 128;GSM8K strict exact 23 / 32、HumanEval 官方 tests pass 24 / 32,并保留四任务/域的样本边界。相同 Chat checkpoint 再执行 29-stage hidden 与 26-gate route trace;1,856 个 hidden hashes、1,664 个 route hashes 和 1,664 个 weight hashes 在新进程子集复跑中全部 exact。

✓

Kimi K3 技术报告二轮深读

三十二张问题账、Figure 1–16 / Table 1–5 审计、100 节点阅读链,以及 Delta—Decay—AttnRes—LatentMoE—SiTU—QB—MOPD—Cache 八联实验。

✓

Kimi K3 三轮开放工件里程碑

固定官方 revisions,审计 96 个 shards、497,220 个 tensor entries 与真实 KDA / MLA / MoE / MoonViT shapes;四联实验分开显示层型、tensor anatomy、参数范围和复现边界。

✓

FlashKDA RTX 5090 执行闸门

隔离 CUDA 13.0 / glibc 2.39 编译 sm_120a wheel;6/6 官方参考逐元素相等,并完成 fixed / varlen、三种 state mode 的 1,800 个 CUDA Event samples。

@@ -134,7 +134,7 @@ const workstreams = [
优先级专题本轮交付完成闸门
P0K3 三轮

开放权重 traces → FlashKDA / AttnRes / MoE 真实行为 → Figure 1–16 数值重绘与独立复现

运行证据 + 逐图复现
-
P0DeepSeek 四轮

completion-aware 行为评测 → 完整 27 层与固定 batch content → SM90 FlashMLA / FP8 / pipeline traces → R1-like RL 小模型复现

运行证据 + 独立复现
+
P0DeepSeek 五轮后续

扩大任务与语言 source → sampling robustness → 干预式 mediation → SM90 FlashMLA / FP8 / pipeline traces → R1-like RL 小模型复现

运行证据 + 独立复现
P0Transformer 二轮

多头电路逐图 → Pre/Post-LN 真实 traces → Flash/KV 配置与 kernel 对照

逐图笔记 + 实测边界
P0表示、位置与残差二轮

真实 hidden-state / norm traces → 长上下文位置外推 → mHC / AttnRes 深层稳定性消融

可复现实验 + 逐图笔记
P0语言模型前史二轮

Kneser–Ney / LSTM / Bahdanau 逐图 → 真实小语料复现 → tokenizer 公平性

可复现实验 + 逐图笔记
@@ -229,6 +229,10 @@ const workstreams = [
Chat、生成行为与能力永久分层

完整官方 Chat 权重可以支撑真实生成;成对输出分歧只证明干预传播,没有 evaluator 与足够 completion 就不升级成能力判断。

completion 是生成实验的首要审计字段

31 / 128 自然 EOS 与 97 / 128 长度截断同时显示;截断答案不冒充完整回答。

offload 拓扑进入复现合同

31.4 GB BF16 权重按 GPU 25 层、CPU 2 层 + norm / lm_head 执行;设备切分不被写成模型结构。

+
更长预算统一重跑全部八格

不选择性续写 97 个截断格;128→512 的 prompt hash 与前 128 generated tokens 必须全 exact。

+
停止、终点、可评测与正确分四张账

自然 EOS 不等于答对;fallback 不冒充 strict completion;HumanEval tests pass 不冒充代码安全。

+
全深度比较只保留 exact interior tokens

1,537 个 content tokens / condition 在八格中 ID exact;56 个跨字符边界 token 排除,不拿不同 token 比隐藏状态。

+
表示与路由分叉不是中介因果

29-stage hidden 与 26-gate route 曲线描述传播;没有干预式 mediation 前不解释输出或能力因果。